[2023-12-25 23:33:57,792][121949] Saving configuration to ./train_mujoco/mujoco_walker_APPO/config.json... [2023-12-25 23:33:58,795][121949] Rollout worker 0 uses device cpu [2023-12-25 23:33:58,796][121949] Rollout worker 1 uses device cpu [2023-12-25 23:33:58,796][121949] Rollout worker 2 uses device cpu [2023-12-25 23:33:58,796][121949] Rollout worker 3 uses device cpu [2023-12-25 23:33:58,796][121949] Rollout worker 4 uses device cpu [2023-12-25 23:33:58,797][121949] Rollout worker 5 uses device cpu [2023-12-25 23:33:58,797][121949] Rollout worker 6 uses device cpu [2023-12-25 23:33:58,797][121949] Rollout worker 7 uses device cpu [2023-12-25 23:33:58,797][121949] Rollout worker 8 uses device cpu [2023-12-25 23:33:58,798][121949] Rollout worker 9 uses device cpu [2023-12-25 23:33:58,798][121949] Rollout worker 10 uses device cpu [2023-12-25 23:33:58,798][121949] Rollout worker 11 uses device cpu [2023-12-25 23:33:58,798][121949] Rollout worker 12 uses device cpu [2023-12-25 23:33:58,799][121949] Rollout worker 13 uses device cpu [2023-12-25 23:33:58,799][121949] Rollout worker 14 uses device cpu [2023-12-25 23:33:58,799][121949] Rollout worker 15 uses device cpu [2023-12-25 23:33:58,834][121949] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-25 23:33:58,835][121949] InferenceWorker_p0-w0: min num requests: 2 [2023-12-25 23:33:58,839][121949] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-25 23:33:58,840][121949] InferenceWorker_p1-w0: min num requests: 2 [2023-12-25 23:33:58,906][121949] Starting all processes... [2023-12-25 23:33:58,907][121949] Starting process learner_proc0 [2023-12-25 23:33:58,910][121949] Starting process learner_proc1 [2023-12-25 23:33:58,956][121949] Starting all processes... [2023-12-25 23:33:58,964][121949] Starting process inference_proc0-0 [2023-12-25 23:33:58,965][121949] Starting process inference_proc1-0 [2023-12-25 23:33:58,965][121949] Starting process rollout_proc0 [2023-12-25 23:33:58,965][121949] Starting process rollout_proc1 [2023-12-25 23:33:58,965][121949] Starting process rollout_proc2 [2023-12-25 23:33:58,966][121949] Starting process rollout_proc3 [2023-12-25 23:33:58,966][121949] Starting process rollout_proc4 [2023-12-25 23:33:58,966][121949] Starting process rollout_proc5 [2023-12-25 23:33:58,967][121949] Starting process rollout_proc6 [2023-12-25 23:33:58,969][121949] Starting process rollout_proc7 [2023-12-25 23:33:58,975][121949] Starting process rollout_proc8 [2023-12-25 23:33:58,988][121949] Starting process rollout_proc9 [2023-12-25 23:33:58,988][121949] Starting process rollout_proc10 [2023-12-25 23:33:58,994][121949] Starting process rollout_proc11 [2023-12-25 23:33:58,995][121949] Starting process rollout_proc12 [2023-12-25 23:33:58,997][121949] Starting process rollout_proc13 [2023-12-25 23:33:58,997][121949] Starting process rollout_proc14 [2023-12-25 23:33:59,000][121949] Starting process rollout_proc15 [2023-12-25 23:34:01,491][123091] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-25 23:34:01,492][123091] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2023-12-25 23:34:01,546][123091] Num visible devices: 1 [2023-12-25 23:34:01,593][123167] Worker 13 uses CPU cores [26, 27] [2023-12-25 23:34:01,609][123093] Worker 0 uses CPU cores [0, 1] [2023-12-25 23:34:01,805][123099] Worker 9 uses CPU cores [18, 19] [2023-12-25 23:34:01,848][123090] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-25 23:34:01,848][123090] Set environment var CUDA_VISIBLE_DEVICES to '1' (GPU indices [1]) for inference process 1 [2023-12-25 23:34:01,895][123090] Num visible devices: 1 [2023-12-25 23:34:01,922][123095] Worker 3 uses CPU cores [6, 7] [2023-12-25 23:34:01,940][123096] Worker 4 uses CPU cores [8, 9] [2023-12-25 23:34:01,989][123134] Worker 11 uses CPU cores [22, 23] [2023-12-25 23:34:01,997][123201] Worker 15 uses CPU cores [30, 31] [2023-12-25 23:34:02,050][123101] Worker 12 uses CPU cores [24, 25] [2023-12-25 23:34:02,071][123100] Worker 8 uses CPU cores [16, 17] [2023-12-25 23:34:02,107][123007] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-25 23:34:02,107][123007] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2023-12-25 23:34:02,116][123008] Using GPUs [1] for process 1 (actually maps to GPUs [1]) [2023-12-25 23:34:02,116][123008] Set environment var CUDA_VISIBLE_DEVICES to '1' (GPU indices [1]) for learning process 1 [2023-12-25 23:34:02,131][123097] Worker 6 uses CPU cores [12, 13] [2023-12-25 23:34:02,160][123166] Worker 14 uses CPU cores [28, 29] [2023-12-25 23:34:02,164][123007] Num visible devices: 1 [2023-12-25 23:34:02,165][123008] Num visible devices: 1 [2023-12-25 23:34:02,173][123092] Worker 2 uses CPU cores [4, 5] [2023-12-25 23:34:02,208][123098] Worker 5 uses CPU cores [10, 11] [2023-12-25 23:34:02,209][123007] Setting fixed seed 1234 [2023-12-25 23:34:02,209][123008] Setting fixed seed 1234 [2023-12-25 23:34:02,210][123007] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-25 23:34:02,210][123008] Using GPUs [0] for process 1 (actually maps to GPUs [1]) [2023-12-25 23:34:02,211][123007] Initializing actor-critic model on device cuda:0 [2023-12-25 23:34:02,211][123008] Initializing actor-critic model on device cuda:0 [2023-12-25 23:34:02,211][123007] RunningMeanStd input shape: (17,) [2023-12-25 23:34:02,212][123008] RunningMeanStd input shape: (17,) [2023-12-25 23:34:02,212][123007] RunningMeanStd input shape: (1,) [2023-12-25 23:34:02,212][123008] RunningMeanStd input shape: (1,) [2023-12-25 23:34:02,247][123007] Created Actor Critic model with architecture: [2023-12-25 23:34:02,248][123008] Created Actor Critic model with architecture: [2023-12-25 23:34:02,247][123007] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=6, bias=True) ) ) [2023-12-25 23:34:02,248][123008] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=6, bias=True) ) ) [2023-12-25 23:34:02,251][123102] Worker 7 uses CPU cores [14, 15] [2023-12-25 23:34:02,258][123094] Worker 1 uses CPU cores [2, 3] [2023-12-25 23:34:02,277][123137] Worker 10 uses CPU cores [20, 21] [2023-12-25 23:34:02,930][123007] Using optimizer [2023-12-25 23:34:02,930][123007] No checkpoints found [2023-12-25 23:34:02,931][123007] Did not load from checkpoint, starting from scratch! [2023-12-25 23:34:02,931][123007] Initialized policy 0 weights for model version 0 [2023-12-25 23:34:02,931][123008] Using optimizer [2023-12-25 23:34:02,932][123008] No checkpoints found [2023-12-25 23:34:02,932][123008] Did not load from checkpoint, starting from scratch! [2023-12-25 23:34:02,932][123008] Initialized policy 1 weights for model version 0 [2023-12-25 23:34:02,932][123007] LearnerWorker_p0 finished initialization! [2023-12-25 23:34:02,933][123007] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2023-12-25 23:34:02,934][123008] LearnerWorker_p1 finished initialization! [2023-12-25 23:34:02,934][123008] Using GPUs [0] for process 1 (actually maps to GPUs [1]) [2023-12-25 23:34:03,551][123090] RunningMeanStd input shape: (17,) [2023-12-25 23:34:03,552][123090] RunningMeanStd input shape: (1,) [2023-12-25 23:34:03,554][123091] RunningMeanStd input shape: (17,) [2023-12-25 23:34:03,554][123091] RunningMeanStd input shape: (1,) [2023-12-25 23:34:03,585][121949] Inference worker 1-0 is ready! [2023-12-25 23:34:03,595][121949] Inference worker 0-0 is ready! [2023-12-25 23:34:03,596][121949] All inference workers are ready! Signal rollout workers to start! [2023-12-25 23:34:03,597][123167] EnvRunner 13-0 uses policy 1 [2023-12-25 23:34:03,597][123096] EnvRunner 4-0 uses policy 0 [2023-12-25 23:34:03,597][123098] EnvRunner 5-0 uses policy 1 [2023-12-25 23:34:03,597][123094] EnvRunner 1-0 uses policy 1 [2023-12-25 23:34:03,597][123137] EnvRunner 10-0 uses policy 0 [2023-12-25 23:34:03,597][123099] EnvRunner 9-0 uses policy 1 [2023-12-25 23:34:03,597][123097] EnvRunner 6-0 uses policy 0 [2023-12-25 23:34:03,597][123134] EnvRunner 11-0 uses policy 1 [2023-12-25 23:34:03,597][123201] EnvRunner 15-0 uses policy 1 [2023-12-25 23:34:03,597][123166] EnvRunner 14-0 uses policy 0 [2023-12-25 23:34:03,597][123101] EnvRunner 12-0 uses policy 0 [2023-12-25 23:34:03,597][123092] EnvRunner 2-0 uses policy 0 [2023-12-25 23:34:03,597][123102] EnvRunner 7-0 uses policy 1 [2023-12-25 23:34:03,597][123100] EnvRunner 8-0 uses policy 0 [2023-12-25 23:34:03,597][123093] EnvRunner 0-0 uses policy 0 [2023-12-25 23:34:03,597][123095] EnvRunner 3-0 uses policy 1 [2023-12-25 23:34:03,698][123099] EnvRunner 9-1 uses policy 1 [2023-12-25 23:34:03,698][123094] EnvRunner 1-1 uses policy 1 [2023-12-25 23:34:03,698][123092] EnvRunner 2-1 uses policy 0 [2023-12-25 23:34:03,698][123096] EnvRunner 4-1 uses policy 0 [2023-12-25 23:34:03,698][123137] EnvRunner 10-1 uses policy 0 [2023-12-25 23:34:03,698][123098] EnvRunner 5-1 uses policy 1 [2023-12-25 23:34:03,698][123101] EnvRunner 12-1 uses policy 0 [2023-12-25 23:34:03,722][123100] EnvRunner 8-1 uses policy 0 [2023-12-25 23:34:03,726][123093] EnvRunner 0-1 uses policy 0 [2023-12-25 23:34:03,735][123167] EnvRunner 13-1 uses policy 1 [2023-12-25 23:34:03,748][123166] EnvRunner 14-1 uses policy 0 [2023-12-25 23:34:03,755][123102] EnvRunner 7-1 uses policy 1 [2023-12-25 23:34:03,755][123201] EnvRunner 15-1 uses policy 1 [2023-12-25 23:34:03,756][123097] EnvRunner 6-1 uses policy 0 [2023-12-25 23:34:03,758][123095] EnvRunner 3-1 uses policy 1 [2023-12-25 23:34:03,758][123134] EnvRunner 11-1 uses policy 1 [2023-12-25 23:34:03,784][121949] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan, 1: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-12-25 23:34:06,236][123008] Signal inference workers to stop experience collection... [2023-12-25 23:34:06,239][123091] InferenceWorker_p0-w0: stopping experience collection [2023-12-25 23:34:06,244][123090] InferenceWorker_p1-w0: stopping experience collection [2023-12-25 23:34:06,793][123008] Signal inference workers to resume experience collection... [2023-12-25 23:34:06,794][123090] InferenceWorker_p1-w0: resuming experience collection [2023-12-25 23:34:06,794][123091] InferenceWorker_p0-w0: resuming experience collection [2023-12-25 23:34:07,749][123007] Signal inference workers to stop experience collection... [2023-12-25 23:34:08,018][123007] Signal inference workers to resume experience collection... [2023-12-25 23:34:08,683][123091] Updated weights for policy 0, policy_version 69 (0.0011) [2023-12-25 23:34:08,753][123091] Updated weights for policy 0, policy_version 79 (0.0010) [2023-12-25 23:34:08,784][121949] Fps is (10 sec: 6553.8, 60 sec: 6553.8, 300 sec: 6553.8). Total num frames: 32768. Throughput: 0: 3379.3, 1: 3448.9. Samples: 34140. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:34:08,785][121949] Avg episode reward: [(0, '1.355'), (1, '1.467')] [2023-12-25 23:34:08,816][123091] Updated weights for policy 0, policy_version 89 (0.0010) [2023-12-25 23:34:08,816][121949] Heartbeat connected on Batcher_0 [2023-12-25 23:34:08,825][121949] Heartbeat connected on Batcher_1 [2023-12-25 23:34:08,839][121949] Heartbeat connected on InferenceWorker_p0-w0 [2023-12-25 23:34:08,844][121949] Heartbeat connected on InferenceWorker_p1-w0 [2023-12-25 23:34:08,846][121949] Heartbeat connected on RolloutWorker_w0 [2023-12-25 23:34:08,849][121949] Heartbeat connected on RolloutWorker_w1 [2023-12-25 23:34:08,853][121949] Heartbeat connected on RolloutWorker_w2 [2023-12-25 23:34:08,857][121949] Heartbeat connected on RolloutWorker_w3 [2023-12-25 23:34:08,862][121949] Heartbeat connected on RolloutWorker_w4 [2023-12-25 23:34:08,865][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000000096_24576.pth... [2023-12-25 23:34:08,866][121949] Heartbeat connected on RolloutWorker_w5 [2023-12-25 23:34:08,868][121949] Heartbeat connected on LearnerWorker_p0 [2023-12-25 23:34:08,874][121949] Heartbeat connected on RolloutWorker_w6 [2023-12-25 23:34:08,880][121949] Heartbeat connected on RolloutWorker_w7 [2023-12-25 23:34:08,885][121949] Heartbeat connected on RolloutWorker_w8 [2023-12-25 23:34:08,888][121949] Heartbeat connected on RolloutWorker_w9 [2023-12-25 23:34:08,889][121949] Heartbeat connected on RolloutWorker_w10 [2023-12-25 23:34:08,892][121949] Heartbeat connected on RolloutWorker_w11 [2023-12-25 23:34:08,896][121949] Heartbeat connected on RolloutWorker_w12 [2023-12-25 23:34:08,900][121949] Heartbeat connected on RolloutWorker_w13 [2023-12-25 23:34:08,903][121949] Heartbeat connected on RolloutWorker_w14 [2023-12-25 23:34:08,907][121949] Heartbeat connected on RolloutWorker_w15 [2023-12-25 23:34:08,941][123090] Updated weights for policy 1, policy_version 71 (0.0327) [2023-12-25 23:34:08,992][123090] Updated weights for policy 1, policy_version 81 (0.0009) [2023-12-25 23:34:09,042][123090] Updated weights for policy 1, policy_version 91 (0.0009) [2023-12-25 23:34:09,070][123091] Updated weights for policy 0, policy_version 99 (0.0010) [2023-12-25 23:34:09,075][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000000096_24576.pth... [2023-12-25 23:34:09,082][121949] Heartbeat connected on LearnerWorker_p1 [2023-12-25 23:34:09,117][123091] Updated weights for policy 0, policy_version 109 (0.0011) [2023-12-25 23:34:09,179][123091] Updated weights for policy 0, policy_version 119 (0.0011) [2023-12-25 23:34:09,443][123090] Updated weights for policy 1, policy_version 101 (0.0008) [2023-12-25 23:34:09,509][123090] Updated weights for policy 1, policy_version 111 (0.0009) [2023-12-25 23:34:09,581][123090] Updated weights for policy 1, policy_version 121 (0.0007) [2023-12-25 23:34:10,049][123091] Updated weights for policy 0, policy_version 129 (0.0009) [2023-12-25 23:34:10,100][123091] Updated weights for policy 0, policy_version 139 (0.0007) [2023-12-25 23:34:10,157][123091] Updated weights for policy 0, policy_version 149 (0.0010) [2023-12-25 23:34:10,212][123091] Updated weights for policy 0, policy_version 159 (0.0009) [2023-12-25 23:34:10,418][123090] Updated weights for policy 1, policy_version 131 (0.0008) [2023-12-25 23:34:10,482][123090] Updated weights for policy 1, policy_version 141 (0.0010) [2023-12-25 23:34:10,552][123090] Updated weights for policy 1, policy_version 151 (0.0009) [2023-12-25 23:34:11,100][123091] Updated weights for policy 0, policy_version 169 (0.0007) [2023-12-25 23:34:11,175][123091] Updated weights for policy 0, policy_version 179 (0.0008) [2023-12-25 23:34:11,243][123091] Updated weights for policy 0, policy_version 189 (0.0009) [2023-12-25 23:34:11,473][123090] Updated weights for policy 1, policy_version 161 (0.0008) [2023-12-25 23:34:11,535][123090] Updated weights for policy 1, policy_version 171 (0.0008) [2023-12-25 23:34:11,596][123090] Updated weights for policy 1, policy_version 181 (0.0009) [2023-12-25 23:34:11,670][123090] Updated weights for policy 1, policy_version 191 (0.0009) [2023-12-25 23:34:12,118][123091] Updated weights for policy 0, policy_version 199 (0.0008) [2023-12-25 23:34:12,178][123091] Updated weights for policy 0, policy_version 209 (0.0008) [2023-12-25 23:34:12,252][123091] Updated weights for policy 0, policy_version 219 (0.0010) [2023-12-25 23:34:12,497][123090] Updated weights for policy 1, policy_version 201 (0.0009) [2023-12-25 23:34:12,559][123090] Updated weights for policy 1, policy_version 211 (0.0010) [2023-12-25 23:34:12,609][123090] Updated weights for policy 1, policy_version 221 (0.0009) [2023-12-25 23:34:13,121][123091] Updated weights for policy 0, policy_version 229 (0.0009) [2023-12-25 23:34:13,177][123091] Updated weights for policy 0, policy_version 239 (0.0008) [2023-12-25 23:34:13,247][123091] Updated weights for policy 0, policy_version 249 (0.0011) [2023-12-25 23:34:13,332][123090] Updated weights for policy 1, policy_version 231 (0.0009) [2023-12-25 23:34:13,389][123090] Updated weights for policy 1, policy_version 241 (0.0009) [2023-12-25 23:34:13,446][123090] Updated weights for policy 1, policy_version 251 (0.0008) [2023-12-25 23:34:13,784][121949] Fps is (10 sec: 13107.4, 60 sec: 13107.4, 300 sec: 13107.4). Total num frames: 131072. Throughput: 0: 6282.1, 1: 5999.3. Samples: 122812. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-25 23:34:13,785][121949] Avg episode reward: [(0, '24.997'), (1, '27.847')] [2023-12-25 23:34:14,098][123091] Updated weights for policy 0, policy_version 259 (0.0010) [2023-12-25 23:34:14,170][123091] Updated weights for policy 0, policy_version 269 (0.0009) [2023-12-25 23:34:14,229][123091] Updated weights for policy 0, policy_version 279 (0.0009) [2023-12-25 23:34:14,269][123090] Updated weights for policy 1, policy_version 261 (0.0007) [2023-12-25 23:34:14,317][123090] Updated weights for policy 1, policy_version 271 (0.0006) [2023-12-25 23:34:14,374][123090] Updated weights for policy 1, policy_version 281 (0.0006) [2023-12-25 23:34:15,079][123091] Updated weights for policy 0, policy_version 289 (0.0009) [2023-12-25 23:34:15,138][123091] Updated weights for policy 0, policy_version 299 (0.0010) [2023-12-25 23:34:15,194][123091] Updated weights for policy 0, policy_version 309 (0.0010) [2023-12-25 23:34:15,216][123090] Updated weights for policy 1, policy_version 291 (0.0008) [2023-12-25 23:34:15,245][123091] Updated weights for policy 0, policy_version 319 (0.0008) [2023-12-25 23:34:15,273][123090] Updated weights for policy 1, policy_version 301 (0.0009) [2023-12-25 23:34:15,342][123090] Updated weights for policy 1, policy_version 311 (0.0010) [2023-12-25 23:34:16,116][123091] Updated weights for policy 0, policy_version 329 (0.0009) [2023-12-25 23:34:16,172][123090] Updated weights for policy 1, policy_version 321 (0.0010) [2023-12-25 23:34:16,180][123091] Updated weights for policy 0, policy_version 339 (0.0009) [2023-12-25 23:34:16,240][123090] Updated weights for policy 1, policy_version 331 (0.0007) [2023-12-25 23:34:16,245][123091] Updated weights for policy 0, policy_version 349 (0.0009) [2023-12-25 23:34:16,290][123090] Updated weights for policy 1, policy_version 341 (0.0009) [2023-12-25 23:34:16,337][123090] Updated weights for policy 1, policy_version 351 (0.0008) [2023-12-25 23:34:17,004][123091] Updated weights for policy 0, policy_version 359 (0.0006) [2023-12-25 23:34:17,056][123091] Updated weights for policy 0, policy_version 369 (0.0005) [2023-12-25 23:34:17,112][123091] Updated weights for policy 0, policy_version 379 (0.0005) [2023-12-25 23:34:17,229][123090] Updated weights for policy 1, policy_version 361 (0.0009) [2023-12-25 23:34:17,301][123090] Updated weights for policy 1, policy_version 371 (0.0009) [2023-12-25 23:34:17,365][123090] Updated weights for policy 1, policy_version 381 (0.0009) [2023-12-25 23:34:17,811][123091] Updated weights for policy 0, policy_version 389 (0.0008) [2023-12-25 23:34:17,858][123091] Updated weights for policy 0, policy_version 399 (0.0010) [2023-12-25 23:34:17,914][123091] Updated weights for policy 0, policy_version 409 (0.0010) [2023-12-25 23:34:18,246][123090] Updated weights for policy 1, policy_version 391 (0.0009) [2023-12-25 23:34:18,300][123090] Updated weights for policy 1, policy_version 401 (0.0009) [2023-12-25 23:34:18,365][123090] Updated weights for policy 1, policy_version 411 (0.0010) [2023-12-25 23:34:18,702][123091] Updated weights for policy 0, policy_version 419 (0.0009) [2023-12-25 23:34:18,764][123091] Updated weights for policy 0, policy_version 429 (0.0010) [2023-12-25 23:34:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 14199.6, 300 sec: 14199.6). Total num frames: 212992. Throughput: 0: 7673.4, 1: 7353.4. Samples: 225400. Policy #0 lag: (min: 22.0, avg: 27.6, max: 54.0) [2023-12-25 23:34:18,785][121949] Avg episode reward: [(0, '144.076'), (1, '87.848')] [2023-12-25 23:34:18,786][123008] Saving new best policy, reward=87.848! [2023-12-25 23:34:18,827][123091] Updated weights for policy 0, policy_version 439 (0.0010) [2023-12-25 23:34:18,880][123007] Saving new best policy, reward=144.076! [2023-12-25 23:34:19,243][123090] Updated weights for policy 1, policy_version 421 (0.0008) [2023-12-25 23:34:19,312][123090] Updated weights for policy 1, policy_version 431 (0.0009) [2023-12-25 23:34:19,378][123090] Updated weights for policy 1, policy_version 441 (0.0009) [2023-12-25 23:34:19,701][123091] Updated weights for policy 0, policy_version 449 (0.0011) [2023-12-25 23:34:19,751][123091] Updated weights for policy 0, policy_version 459 (0.0011) [2023-12-25 23:34:19,800][123091] Updated weights for policy 0, policy_version 469 (0.0010) [2023-12-25 23:34:19,863][123091] Updated weights for policy 0, policy_version 479 (0.0011) [2023-12-25 23:34:20,239][123090] Updated weights for policy 1, policy_version 451 (0.0009) [2023-12-25 23:34:20,294][123090] Updated weights for policy 1, policy_version 461 (0.0010) [2023-12-25 23:34:20,361][123090] Updated weights for policy 1, policy_version 471 (0.0010) [2023-12-25 23:34:20,632][123091] Updated weights for policy 0, policy_version 489 (0.0011) [2023-12-25 23:34:20,685][123091] Updated weights for policy 0, policy_version 499 (0.0007) [2023-12-25 23:34:20,743][123091] Updated weights for policy 0, policy_version 509 (0.0006) [2023-12-25 23:34:21,236][123090] Updated weights for policy 1, policy_version 481 (0.0010) [2023-12-25 23:34:21,304][123090] Updated weights for policy 1, policy_version 491 (0.0011) [2023-12-25 23:34:21,376][123090] Updated weights for policy 1, policy_version 501 (0.0010) [2023-12-25 23:34:21,440][123090] Updated weights for policy 1, policy_version 511 (0.0010) [2023-12-25 23:34:21,498][123091] Updated weights for policy 0, policy_version 519 (0.0008) [2023-12-25 23:34:21,548][123091] Updated weights for policy 0, policy_version 529 (0.0008) [2023-12-25 23:34:21,610][123091] Updated weights for policy 0, policy_version 539 (0.0009) [2023-12-25 23:34:22,273][123090] Updated weights for policy 1, policy_version 521 (0.0010) [2023-12-25 23:34:22,352][123090] Updated weights for policy 1, policy_version 531 (0.0006) [2023-12-25 23:34:22,423][123090] Updated weights for policy 1, policy_version 541 (0.0007) [2023-12-25 23:34:22,453][123091] Updated weights for policy 0, policy_version 549 (0.0008) [2023-12-25 23:34:22,521][123091] Updated weights for policy 0, policy_version 559 (0.0008) [2023-12-25 23:34:22,580][123091] Updated weights for policy 0, policy_version 569 (0.0008) [2023-12-25 23:34:23,279][123090] Updated weights for policy 1, policy_version 551 (0.0010) [2023-12-25 23:34:23,318][123091] Updated weights for policy 0, policy_version 579 (0.0007) [2023-12-25 23:34:23,341][123090] Updated weights for policy 1, policy_version 561 (0.0009) [2023-12-25 23:34:23,381][123091] Updated weights for policy 0, policy_version 589 (0.0006) [2023-12-25 23:34:23,406][123090] Updated weights for policy 1, policy_version 571 (0.0009) [2023-12-25 23:34:23,449][123091] Updated weights for policy 0, policy_version 599 (0.0005) [2023-12-25 23:34:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 15155.2, 300 sec: 15155.2). Total num frames: 303104. Throughput: 0: 7067.4, 1: 6738.0. Samples: 276108. Policy #0 lag: (min: 17.0, avg: 32.3, max: 49.0) [2023-12-25 23:34:23,785][121949] Avg episode reward: [(0, '229.086'), (1, '209.062')] [2023-12-25 23:34:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000000608_155648.pth... [2023-12-25 23:34:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000000576_147456.pth... [2023-12-25 23:34:23,794][123007] Saving new best policy, reward=229.086! [2023-12-25 23:34:23,796][123008] Saving new best policy, reward=209.062! [2023-12-25 23:34:24,222][123091] Updated weights for policy 0, policy_version 609 (0.0006) [2023-12-25 23:34:24,290][123090] Updated weights for policy 1, policy_version 581 (0.0009) [2023-12-25 23:34:24,292][123091] Updated weights for policy 0, policy_version 619 (0.0009) [2023-12-25 23:34:24,342][123091] Updated weights for policy 0, policy_version 629 (0.0007) [2023-12-25 23:34:24,348][123090] Updated weights for policy 1, policy_version 591 (0.0009) [2023-12-25 23:34:24,388][123091] Updated weights for policy 0, policy_version 639 (0.0008) [2023-12-25 23:34:24,412][123090] Updated weights for policy 1, policy_version 601 (0.0008) [2023-12-25 23:34:25,178][123091] Updated weights for policy 0, policy_version 649 (0.0009) [2023-12-25 23:34:25,243][123091] Updated weights for policy 0, policy_version 659 (0.0009) [2023-12-25 23:34:25,296][123091] Updated weights for policy 0, policy_version 669 (0.0009) [2023-12-25 23:34:25,299][123090] Updated weights for policy 1, policy_version 611 (0.0009) [2023-12-25 23:34:25,360][123090] Updated weights for policy 1, policy_version 621 (0.0008) [2023-12-25 23:34:25,417][123090] Updated weights for policy 1, policy_version 631 (0.0008) [2023-12-25 23:34:26,054][123091] Updated weights for policy 0, policy_version 679 (0.0009) [2023-12-25 23:34:26,119][123091] Updated weights for policy 0, policy_version 689 (0.0009) [2023-12-25 23:34:26,179][123091] Updated weights for policy 0, policy_version 699 (0.0009) [2023-12-25 23:34:26,256][123090] Updated weights for policy 1, policy_version 641 (0.0008) [2023-12-25 23:34:26,327][123090] Updated weights for policy 1, policy_version 651 (0.0009) [2023-12-25 23:34:26,394][123090] Updated weights for policy 1, policy_version 661 (0.0009) [2023-12-25 23:34:26,461][123090] Updated weights for policy 1, policy_version 671 (0.0009) [2023-12-25 23:34:27,010][123091] Updated weights for policy 0, policy_version 709 (0.0008) [2023-12-25 23:34:27,059][123091] Updated weights for policy 0, policy_version 719 (0.0009) [2023-12-25 23:34:27,112][123091] Updated weights for policy 0, policy_version 729 (0.0009) [2023-12-25 23:34:27,281][123090] Updated weights for policy 1, policy_version 681 (0.0008) [2023-12-25 23:34:27,338][123090] Updated weights for policy 1, policy_version 691 (0.0009) [2023-12-25 23:34:27,395][123090] Updated weights for policy 1, policy_version 701 (0.0009) [2023-12-25 23:34:27,966][123091] Updated weights for policy 0, policy_version 739 (0.0009) [2023-12-25 23:34:28,021][123091] Updated weights for policy 0, policy_version 749 (0.0009) [2023-12-25 23:34:28,088][123091] Updated weights for policy 0, policy_version 760 (0.0008) [2023-12-25 23:34:28,232][123090] Updated weights for policy 1, policy_version 711 (0.0010) [2023-12-25 23:34:28,301][123090] Updated weights for policy 1, policy_version 721 (0.0009) [2023-12-25 23:34:28,366][123090] Updated weights for policy 1, policy_version 731 (0.0009) [2023-12-25 23:34:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 15401.0, 300 sec: 15401.0). Total num frames: 385024. Throughput: 0: 7802.1, 1: 7362.9. Samples: 379124. Policy #0 lag: (min: 15.0, avg: 18.4, max: 47.0) [2023-12-25 23:34:28,785][121949] Avg episode reward: [(0, '280.009'), (1, '241.659')] [2023-12-25 23:34:28,787][123007] Saving new best policy, reward=280.009! [2023-12-25 23:34:28,787][123008] Saving new best policy, reward=241.659! [2023-12-25 23:34:28,930][123091] Updated weights for policy 0, policy_version 771 (0.0010) [2023-12-25 23:34:28,987][123091] Updated weights for policy 0, policy_version 781 (0.0009) [2023-12-25 23:34:29,041][123091] Updated weights for policy 0, policy_version 791 (0.0009) [2023-12-25 23:34:29,206][123090] Updated weights for policy 1, policy_version 742 (0.0011) [2023-12-25 23:34:29,277][123090] Updated weights for policy 1, policy_version 752 (0.0009) [2023-12-25 23:34:29,348][123090] Updated weights for policy 1, policy_version 762 (0.0008) [2023-12-25 23:34:29,810][123091] Updated weights for policy 0, policy_version 801 (0.0009) [2023-12-25 23:34:29,875][123091] Updated weights for policy 0, policy_version 811 (0.0007) [2023-12-25 23:34:29,939][123091] Updated weights for policy 0, policy_version 821 (0.0007) [2023-12-25 23:34:29,995][123091] Updated weights for policy 0, policy_version 831 (0.0006) [2023-12-25 23:34:30,099][123090] Updated weights for policy 1, policy_version 772 (0.0007) [2023-12-25 23:34:30,164][123090] Updated weights for policy 1, policy_version 782 (0.0005) [2023-12-25 23:34:30,236][123090] Updated weights for policy 1, policy_version 792 (0.0005) [2023-12-25 23:34:30,674][123091] Updated weights for policy 0, policy_version 841 (0.0006) [2023-12-25 23:34:30,745][123091] Updated weights for policy 0, policy_version 851 (0.0005) [2023-12-25 23:34:30,805][123091] Updated weights for policy 0, policy_version 861 (0.0005) [2023-12-25 23:34:30,920][123090] Updated weights for policy 1, policy_version 802 (0.0005) [2023-12-25 23:34:30,965][123090] Updated weights for policy 1, policy_version 812 (0.0005) [2023-12-25 23:34:31,026][123090] Updated weights for policy 1, policy_version 822 (0.0005) [2023-12-25 23:34:31,094][123090] Updated weights for policy 1, policy_version 832 (0.0007) [2023-12-25 23:34:31,562][123091] Updated weights for policy 0, policy_version 871 (0.0008) [2023-12-25 23:34:31,626][123091] Updated weights for policy 0, policy_version 881 (0.0010) [2023-12-25 23:34:31,696][123091] Updated weights for policy 0, policy_version 891 (0.0008) [2023-12-25 23:34:31,791][123090] Updated weights for policy 1, policy_version 842 (0.0006) [2023-12-25 23:34:31,863][123090] Updated weights for policy 1, policy_version 852 (0.0005) [2023-12-25 23:34:31,923][123090] Updated weights for policy 1, policy_version 862 (0.0006) [2023-12-25 23:34:32,634][123091] Updated weights for policy 0, policy_version 901 (0.0011) [2023-12-25 23:34:32,675][123090] Updated weights for policy 1, policy_version 872 (0.0006) [2023-12-25 23:34:32,697][123091] Updated weights for policy 0, policy_version 911 (0.0010) [2023-12-25 23:34:32,729][123090] Updated weights for policy 1, policy_version 882 (0.0007) [2023-12-25 23:34:32,764][123091] Updated weights for policy 0, policy_version 921 (0.0010) [2023-12-25 23:34:32,785][123090] Updated weights for policy 1, policy_version 892 (0.0009) [2023-12-25 23:34:33,585][123091] Updated weights for policy 0, policy_version 931 (0.0010) [2023-12-25 23:34:33,619][123090] Updated weights for policy 1, policy_version 902 (0.0008) [2023-12-25 23:34:33,631][123091] Updated weights for policy 0, policy_version 941 (0.0008) [2023-12-25 23:34:33,668][123090] Updated weights for policy 1, policy_version 912 (0.0009) [2023-12-25 23:34:33,687][123091] Updated weights for policy 0, policy_version 951 (0.0008) [2023-12-25 23:34:33,714][123090] Updated weights for policy 1, policy_version 922 (0.0007) [2023-12-25 23:34:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 16111.1, 300 sec: 16111.1). Total num frames: 483328. Throughput: 0: 8256.6, 1: 7976.1. Samples: 486976. Policy #0 lag: (min: 16.0, avg: 44.1, max: 48.0) [2023-12-25 23:34:33,785][121949] Avg episode reward: [(0, '300.987'), (1, '285.219')] [2023-12-25 23:34:33,785][123007] Saving new best policy, reward=300.987! [2023-12-25 23:34:33,785][123008] Saving new best policy, reward=285.219! [2023-12-25 23:34:34,520][123091] Updated weights for policy 0, policy_version 961 (0.0007) [2023-12-25 23:34:34,548][123090] Updated weights for policy 1, policy_version 932 (0.0008) [2023-12-25 23:34:34,577][123091] Updated weights for policy 0, policy_version 971 (0.0007) [2023-12-25 23:34:34,616][123090] Updated weights for policy 1, policy_version 942 (0.0010) [2023-12-25 23:34:34,639][123091] Updated weights for policy 0, policy_version 981 (0.0007) [2023-12-25 23:34:34,678][123090] Updated weights for policy 1, policy_version 952 (0.0009) [2023-12-25 23:34:34,707][123091] Updated weights for policy 0, policy_version 991 (0.0007) [2023-12-25 23:34:35,442][123090] Updated weights for policy 1, policy_version 962 (0.0006) [2023-12-25 23:34:35,498][123091] Updated weights for policy 0, policy_version 1001 (0.0009) [2023-12-25 23:34:35,502][123090] Updated weights for policy 1, policy_version 972 (0.0006) [2023-12-25 23:34:35,555][123091] Updated weights for policy 0, policy_version 1011 (0.0008) [2023-12-25 23:34:35,558][123090] Updated weights for policy 1, policy_version 982 (0.0005) [2023-12-25 23:34:35,608][123091] Updated weights for policy 0, policy_version 1021 (0.0008) [2023-12-25 23:34:35,619][123090] Updated weights for policy 1, policy_version 992 (0.0005) [2023-12-25 23:34:36,396][123090] Updated weights for policy 1, policy_version 1002 (0.0010) [2023-12-25 23:34:36,454][123091] Updated weights for policy 0, policy_version 1031 (0.0008) [2023-12-25 23:34:36,464][123090] Updated weights for policy 1, policy_version 1012 (0.0010) [2023-12-25 23:34:36,516][123091] Updated weights for policy 0, policy_version 1041 (0.0007) [2023-12-25 23:34:36,532][123090] Updated weights for policy 1, policy_version 1022 (0.0009) [2023-12-25 23:34:36,582][123091] Updated weights for policy 0, policy_version 1051 (0.0008) [2023-12-25 23:34:37,335][123091] Updated weights for policy 0, policy_version 1062 (0.0009) [2023-12-25 23:34:37,377][123090] Updated weights for policy 1, policy_version 1032 (0.0009) [2023-12-25 23:34:37,389][123091] Updated weights for policy 0, policy_version 1072 (0.0007) [2023-12-25 23:34:37,437][123091] Updated weights for policy 0, policy_version 1082 (0.0007) [2023-12-25 23:34:37,438][123090] Updated weights for policy 1, policy_version 1042 (0.0010) [2023-12-25 23:34:37,499][123090] Updated weights for policy 1, policy_version 1052 (0.0008) [2023-12-25 23:34:38,315][123091] Updated weights for policy 0, policy_version 1092 (0.0009) [2023-12-25 23:34:38,352][123090] Updated weights for policy 1, policy_version 1062 (0.0009) [2023-12-25 23:34:38,377][123091] Updated weights for policy 0, policy_version 1102 (0.0011) [2023-12-25 23:34:38,416][123090] Updated weights for policy 1, policy_version 1072 (0.0009) [2023-12-25 23:34:38,430][123091] Updated weights for policy 0, policy_version 1112 (0.0011) [2023-12-25 23:34:38,477][123090] Updated weights for policy 1, policy_version 1082 (0.0007) [2023-12-25 23:34:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 16150.0, 300 sec: 16150.0). Total num frames: 565248. Throughput: 0: 7802.6, 1: 7587.1. Samples: 538636. Policy #0 lag: (min: 31.0, avg: 43.3, max: 63.0) [2023-12-25 23:34:38,785][121949] Avg episode reward: [(0, '335.607'), (1, '327.870')] [2023-12-25 23:34:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000001120_286720.pth... [2023-12-25 23:34:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000001088_278528.pth... [2023-12-25 23:34:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000000096_24576.pth [2023-12-25 23:34:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000000096_24576.pth [2023-12-25 23:34:38,793][123008] Saving new best policy, reward=327.870! [2023-12-25 23:34:38,794][123007] Saving new best policy, reward=335.607! [2023-12-25 23:34:39,277][123091] Updated weights for policy 0, policy_version 1122 (0.0010) [2023-12-25 23:34:39,290][123090] Updated weights for policy 1, policy_version 1092 (0.0010) [2023-12-25 23:34:39,341][123091] Updated weights for policy 0, policy_version 1132 (0.0011) [2023-12-25 23:34:39,344][123090] Updated weights for policy 1, policy_version 1102 (0.0007) [2023-12-25 23:34:39,417][123091] Updated weights for policy 0, policy_version 1142 (0.0011) [2023-12-25 23:34:39,423][123090] Updated weights for policy 1, policy_version 1112 (0.0009) [2023-12-25 23:34:39,478][123091] Updated weights for policy 0, policy_version 1152 (0.0009) [2023-12-25 23:34:40,282][123090] Updated weights for policy 1, policy_version 1122 (0.0007) [2023-12-25 23:34:40,302][123091] Updated weights for policy 0, policy_version 1162 (0.0011) [2023-12-25 23:34:40,349][123090] Updated weights for policy 1, policy_version 1132 (0.0007) [2023-12-25 23:34:40,359][123091] Updated weights for policy 0, policy_version 1172 (0.0011) [2023-12-25 23:34:40,414][123090] Updated weights for policy 1, policy_version 1142 (0.0006) [2023-12-25 23:34:40,416][123091] Updated weights for policy 0, policy_version 1182 (0.0011) [2023-12-25 23:34:40,489][123090] Updated weights for policy 1, policy_version 1152 (0.0005) [2023-12-25 23:34:41,268][123090] Updated weights for policy 1, policy_version 1162 (0.0008) [2023-12-25 23:34:41,322][123091] Updated weights for policy 0, policy_version 1192 (0.0007) [2023-12-25 23:34:41,333][123090] Updated weights for policy 1, policy_version 1172 (0.0008) [2023-12-25 23:34:41,406][123090] Updated weights for policy 1, policy_version 1182 (0.0009) [2023-12-25 23:34:41,409][123091] Updated weights for policy 0, policy_version 1202 (0.0009) [2023-12-25 23:34:41,466][123091] Updated weights for policy 0, policy_version 1212 (0.0011) [2023-12-25 23:34:42,228][123090] Updated weights for policy 1, policy_version 1192 (0.0009) [2023-12-25 23:34:42,292][123091] Updated weights for policy 0, policy_version 1222 (0.0011) [2023-12-25 23:34:42,296][123090] Updated weights for policy 1, policy_version 1202 (0.0011) [2023-12-25 23:34:42,353][123091] Updated weights for policy 0, policy_version 1232 (0.0011) [2023-12-25 23:34:42,366][123090] Updated weights for policy 1, policy_version 1212 (0.0009) [2023-12-25 23:34:42,426][123091] Updated weights for policy 0, policy_version 1242 (0.0009) [2023-12-25 23:34:43,223][123090] Updated weights for policy 1, policy_version 1222 (0.0010) [2023-12-25 23:34:43,279][123090] Updated weights for policy 1, policy_version 1232 (0.0008) [2023-12-25 23:34:43,282][123091] Updated weights for policy 0, policy_version 1252 (0.0009) [2023-12-25 23:34:43,331][123090] Updated weights for policy 1, policy_version 1242 (0.0006) [2023-12-25 23:34:43,346][123091] Updated weights for policy 0, policy_version 1262 (0.0009) [2023-12-25 23:34:43,401][123091] Updated weights for policy 0, policy_version 1272 (0.0010) [2023-12-25 23:34:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16179.3, 300 sec: 16179.3). Total num frames: 647168. Throughput: 0: 8107.6, 1: 7929.0. Samples: 641464. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-25 23:34:43,785][121949] Avg episode reward: [(0, '328.103'), (1, '325.028')] [2023-12-25 23:34:44,093][123090] Updated weights for policy 1, policy_version 1252 (0.0009) [2023-12-25 23:34:44,145][123090] Updated weights for policy 1, policy_version 1262 (0.0006) [2023-12-25 23:34:44,199][123090] Updated weights for policy 1, policy_version 1272 (0.0005) [2023-12-25 23:34:44,278][123091] Updated weights for policy 0, policy_version 1283 (0.0010) [2023-12-25 23:34:44,341][123091] Updated weights for policy 0, policy_version 1293 (0.0009) [2023-12-25 23:34:44,391][123091] Updated weights for policy 0, policy_version 1303 (0.0009) [2023-12-25 23:34:44,858][123090] Updated weights for policy 1, policy_version 1282 (0.0007) [2023-12-25 23:34:44,928][123090] Updated weights for policy 1, policy_version 1292 (0.0011) [2023-12-25 23:34:44,995][123090] Updated weights for policy 1, policy_version 1302 (0.0011) [2023-12-25 23:34:45,069][123090] Updated weights for policy 1, policy_version 1312 (0.0010) [2023-12-25 23:34:45,316][123091] Updated weights for policy 0, policy_version 1313 (0.0009) [2023-12-25 23:34:45,375][123091] Updated weights for policy 0, policy_version 1323 (0.0010) [2023-12-25 23:34:45,441][123091] Updated weights for policy 0, policy_version 1333 (0.0010) [2023-12-25 23:34:45,511][123091] Updated weights for policy 0, policy_version 1343 (0.0009) [2023-12-25 23:34:45,740][123090] Updated weights for policy 1, policy_version 1322 (0.0005) [2023-12-25 23:34:45,794][123090] Updated weights for policy 1, policy_version 1332 (0.0007) [2023-12-25 23:34:45,843][123090] Updated weights for policy 1, policy_version 1342 (0.0005) [2023-12-25 23:34:46,400][123091] Updated weights for policy 0, policy_version 1353 (0.0009) [2023-12-25 23:34:46,448][123091] Updated weights for policy 0, policy_version 1363 (0.0008) [2023-12-25 23:34:46,505][123091] Updated weights for policy 0, policy_version 1373 (0.0009) [2023-12-25 23:34:46,608][123090] Updated weights for policy 1, policy_version 1352 (0.0009) [2023-12-25 23:34:46,671][123090] Updated weights for policy 1, policy_version 1362 (0.0010) [2023-12-25 23:34:46,733][123090] Updated weights for policy 1, policy_version 1372 (0.0010) [2023-12-25 23:34:47,430][123091] Updated weights for policy 0, policy_version 1383 (0.0010) [2023-12-25 23:34:47,457][123090] Updated weights for policy 1, policy_version 1382 (0.0007) [2023-12-25 23:34:47,492][123091] Updated weights for policy 0, policy_version 1393 (0.0009) [2023-12-25 23:34:47,514][123090] Updated weights for policy 1, policy_version 1392 (0.0005) [2023-12-25 23:34:47,547][123091] Updated weights for policy 0, policy_version 1403 (0.0009) [2023-12-25 23:34:47,570][123090] Updated weights for policy 1, policy_version 1402 (0.0005) [2023-12-25 23:34:48,151][123090] Updated weights for policy 1, policy_version 1412 (0.0005) [2023-12-25 23:34:48,213][123090] Updated weights for policy 1, policy_version 1422 (0.0005) [2023-12-25 23:34:48,265][123090] Updated weights for policy 1, policy_version 1432 (0.0005) [2023-12-25 23:34:48,484][123091] Updated weights for policy 0, policy_version 1414 (0.0010) [2023-12-25 23:34:48,543][123091] Updated weights for policy 0, policy_version 1424 (0.0009) [2023-12-25 23:34:48,606][123091] Updated weights for policy 0, policy_version 1434 (0.0009) [2023-12-25 23:34:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 16384.0, 300 sec: 16384.0). Total num frames: 737280. Throughput: 0: 8258.3, 1: 8330.5. Samples: 746496. Policy #0 lag: (min: 10.0, avg: 17.4, max: 42.0) [2023-12-25 23:34:48,785][121949] Avg episode reward: [(0, '343.283'), (1, '365.481')] [2023-12-25 23:34:48,787][123007] Saving new best policy, reward=343.283! [2023-12-25 23:34:48,787][123008] Saving new best policy, reward=365.481! [2023-12-25 23:34:48,977][123090] Updated weights for policy 1, policy_version 1442 (0.0005) [2023-12-25 23:34:49,047][123090] Updated weights for policy 1, policy_version 1452 (0.0005) [2023-12-25 23:34:49,122][123090] Updated weights for policy 1, policy_version 1462 (0.0007) [2023-12-25 23:34:49,186][123090] Updated weights for policy 1, policy_version 1472 (0.0008) [2023-12-25 23:34:49,555][123091] Updated weights for policy 0, policy_version 1444 (0.0010) [2023-12-25 23:34:49,608][123091] Updated weights for policy 0, policy_version 1454 (0.0010) [2023-12-25 23:34:49,668][123091] Updated weights for policy 0, policy_version 1464 (0.0010) [2023-12-25 23:34:49,922][123090] Updated weights for policy 1, policy_version 1482 (0.0006) [2023-12-25 23:34:49,982][123090] Updated weights for policy 1, policy_version 1492 (0.0009) [2023-12-25 23:34:50,039][123090] Updated weights for policy 1, policy_version 1502 (0.0009) [2023-12-25 23:34:50,523][123091] Updated weights for policy 0, policy_version 1474 (0.0009) [2023-12-25 23:34:50,579][123091] Updated weights for policy 0, policy_version 1484 (0.0009) [2023-12-25 23:34:50,642][123091] Updated weights for policy 0, policy_version 1494 (0.0010) [2023-12-25 23:34:50,701][123091] Updated weights for policy 0, policy_version 1504 (0.0008) [2023-12-25 23:34:50,894][123090] Updated weights for policy 1, policy_version 1512 (0.0009) [2023-12-25 23:34:50,964][123090] Updated weights for policy 1, policy_version 1522 (0.0008) [2023-12-25 23:34:51,035][123090] Updated weights for policy 1, policy_version 1532 (0.0009) [2023-12-25 23:34:51,529][123091] Updated weights for policy 0, policy_version 1514 (0.0007) [2023-12-25 23:34:51,594][123091] Updated weights for policy 0, policy_version 1524 (0.0008) [2023-12-25 23:34:51,865][123090] Updated weights for policy 1, policy_version 1542 (0.0010) [2023-12-25 23:34:51,929][123090] Updated weights for policy 1, policy_version 1552 (0.0009) [2023-12-25 23:34:51,988][123090] Updated weights for policy 1, policy_version 1562 (0.0008) [2023-12-25 23:34:52,433][123091] Updated weights for policy 0, policy_version 1538 (0.0008) [2023-12-25 23:34:52,482][123091] Updated weights for policy 0, policy_version 1548 (0.0006) [2023-12-25 23:34:52,542][123091] Updated weights for policy 0, policy_version 1558 (0.0006) [2023-12-25 23:34:52,600][123091] Updated weights for policy 0, policy_version 1568 (0.0006) [2023-12-25 23:34:52,909][123090] Updated weights for policy 1, policy_version 1572 (0.0007) [2023-12-25 23:34:52,971][123090] Updated weights for policy 1, policy_version 1582 (0.0006) [2023-12-25 23:34:53,037][123090] Updated weights for policy 1, policy_version 1592 (0.0007) [2023-12-25 23:34:53,369][123091] Updated weights for policy 0, policy_version 1578 (0.0009) [2023-12-25 23:34:53,429][123091] Updated weights for policy 0, policy_version 1588 (0.0009) [2023-12-25 23:34:53,481][123091] Updated weights for policy 0, policy_version 1598 (0.0009) [2023-12-25 23:34:53,728][123090] Updated weights for policy 1, policy_version 1602 (0.0007) [2023-12-25 23:34:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16384.1, 300 sec: 16384.1). Total num frames: 819200. Throughput: 0: 8438.4, 1: 8538.2. Samples: 798088. Policy #0 lag: (min: 30.0, avg: 37.2, max: 62.0) [2023-12-25 23:34:53,784][121949] Avg episode reward: [(0, '366.387'), (1, '377.099')] [2023-12-25 23:34:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000001600_409600.pth... [2023-12-25 23:34:53,793][123090] Updated weights for policy 1, policy_version 1612 (0.0006) [2023-12-25 23:34:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000000608_155648.pth [2023-12-25 23:34:53,795][123007] Saving new best policy, reward=366.387! [2023-12-25 23:34:53,860][123090] Updated weights for policy 1, policy_version 1622 (0.0005) [2023-12-25 23:34:53,932][123090] Updated weights for policy 1, policy_version 1632 (0.0005) [2023-12-25 23:34:53,933][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000001632_417792.pth... [2023-12-25 23:34:53,937][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000000576_147456.pth [2023-12-25 23:34:53,937][123008] Saving new best policy, reward=377.099! [2023-12-25 23:34:54,285][123091] Updated weights for policy 0, policy_version 1608 (0.0010) [2023-12-25 23:34:54,358][123091] Updated weights for policy 0, policy_version 1618 (0.0010) [2023-12-25 23:34:54,414][123091] Updated weights for policy 0, policy_version 1628 (0.0011) [2023-12-25 23:34:54,613][123090] Updated weights for policy 1, policy_version 1642 (0.0009) [2023-12-25 23:34:54,674][123090] Updated weights for policy 1, policy_version 1652 (0.0009) [2023-12-25 23:34:54,728][123090] Updated weights for policy 1, policy_version 1662 (0.0009) [2023-12-25 23:34:55,167][123091] Updated weights for policy 0, policy_version 1638 (0.0010) [2023-12-25 23:34:55,231][123091] Updated weights for policy 0, policy_version 1648 (0.0010) [2023-12-25 23:34:55,301][123091] Updated weights for policy 0, policy_version 1658 (0.0010) [2023-12-25 23:34:55,640][123090] Updated weights for policy 1, policy_version 1672 (0.0010) [2023-12-25 23:34:55,702][123090] Updated weights for policy 1, policy_version 1682 (0.0010) [2023-12-25 23:34:55,761][123090] Updated weights for policy 1, policy_version 1692 (0.0010) [2023-12-25 23:34:55,956][123091] Updated weights for policy 0, policy_version 1668 (0.0008) [2023-12-25 23:34:56,016][123091] Updated weights for policy 0, policy_version 1678 (0.0005) [2023-12-25 23:34:56,065][123091] Updated weights for policy 0, policy_version 1688 (0.0005) [2023-12-25 23:34:56,554][123090] Updated weights for policy 1, policy_version 1702 (0.0007) [2023-12-25 23:34:56,628][123090] Updated weights for policy 1, policy_version 1712 (0.0005) [2023-12-25 23:34:56,702][123090] Updated weights for policy 1, policy_version 1722 (0.0005) [2023-12-25 23:34:56,801][123091] Updated weights for policy 0, policy_version 1698 (0.0008) [2023-12-25 23:34:56,848][123091] Updated weights for policy 0, policy_version 1708 (0.0010) [2023-12-25 23:34:56,898][123091] Updated weights for policy 0, policy_version 1718 (0.0009) [2023-12-25 23:34:56,944][123091] Updated weights for policy 0, policy_version 1728 (0.0005) [2023-12-25 23:34:57,493][123090] Updated weights for policy 1, policy_version 1732 (0.0007) [2023-12-25 23:34:57,550][123090] Updated weights for policy 1, policy_version 1742 (0.0010) [2023-12-25 23:34:57,590][123091] Updated weights for policy 0, policy_version 1738 (0.0005) [2023-12-25 23:34:57,601][123090] Updated weights for policy 1, policy_version 1753 (0.0009) [2023-12-25 23:34:57,648][123091] Updated weights for policy 0, policy_version 1748 (0.0005) [2023-12-25 23:34:57,702][123091] Updated weights for policy 0, policy_version 1758 (0.0005) [2023-12-25 23:34:58,397][123091] Updated weights for policy 0, policy_version 1768 (0.0009) [2023-12-25 23:34:58,465][123091] Updated weights for policy 0, policy_version 1778 (0.0009) [2023-12-25 23:34:58,499][123090] Updated weights for policy 1, policy_version 1764 (0.0009) [2023-12-25 23:34:58,533][123091] Updated weights for policy 0, policy_version 1788 (0.0008) [2023-12-25 23:34:58,565][123090] Updated weights for policy 1, policy_version 1774 (0.0010) [2023-12-25 23:34:58,636][123090] Updated weights for policy 1, policy_version 1784 (0.0010) [2023-12-25 23:34:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 16681.9, 300 sec: 16681.9). Total num frames: 917504. Throughput: 0: 8682.6, 1: 8751.2. Samples: 907332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:34:58,785][121949] Avg episode reward: [(0, '358.209'), (1, '382.110')] [2023-12-25 23:34:58,786][123008] Saving new best policy, reward=382.110! [2023-12-25 23:34:59,311][123091] Updated weights for policy 0, policy_version 1798 (0.0010) [2023-12-25 23:34:59,377][123091] Updated weights for policy 0, policy_version 1808 (0.0010) [2023-12-25 23:34:59,405][123090] Updated weights for policy 1, policy_version 1794 (0.0007) [2023-12-25 23:34:59,440][123091] Updated weights for policy 0, policy_version 1818 (0.0010) [2023-12-25 23:34:59,465][123090] Updated weights for policy 1, policy_version 1804 (0.0009) [2023-12-25 23:34:59,517][123090] Updated weights for policy 1, policy_version 1814 (0.0009) [2023-12-25 23:34:59,573][123090] Updated weights for policy 1, policy_version 1824 (0.0009) [2023-12-25 23:35:00,185][123091] Updated weights for policy 0, policy_version 1828 (0.0008) [2023-12-25 23:35:00,249][123091] Updated weights for policy 0, policy_version 1838 (0.0006) [2023-12-25 23:35:00,319][123091] Updated weights for policy 0, policy_version 1848 (0.0005) [2023-12-25 23:35:00,486][123090] Updated weights for policy 1, policy_version 1834 (0.0010) [2023-12-25 23:35:00,545][123090] Updated weights for policy 1, policy_version 1844 (0.0010) [2023-12-25 23:35:00,598][123090] Updated weights for policy 1, policy_version 1854 (0.0010) [2023-12-25 23:35:00,886][123091] Updated weights for policy 0, policy_version 1858 (0.0006) [2023-12-25 23:35:00,938][123091] Updated weights for policy 0, policy_version 1868 (0.0009) [2023-12-25 23:35:00,986][123091] Updated weights for policy 0, policy_version 1878 (0.0009) [2023-12-25 23:35:01,060][123091] Updated weights for policy 0, policy_version 1888 (0.0009) [2023-12-25 23:35:01,390][123090] Updated weights for policy 1, policy_version 1864 (0.0008) [2023-12-25 23:35:01,435][123090] Updated weights for policy 1, policy_version 1874 (0.0008) [2023-12-25 23:35:01,499][123090] Updated weights for policy 1, policy_version 1884 (0.0008) [2023-12-25 23:35:01,923][123091] Updated weights for policy 0, policy_version 1898 (0.0005) [2023-12-25 23:35:01,977][123091] Updated weights for policy 0, policy_version 1908 (0.0007) [2023-12-25 23:35:02,043][123091] Updated weights for policy 0, policy_version 1918 (0.0008) [2023-12-25 23:35:02,205][123090] Updated weights for policy 1, policy_version 1894 (0.0009) [2023-12-25 23:35:02,269][123090] Updated weights for policy 1, policy_version 1904 (0.0009) [2023-12-25 23:35:02,341][123090] Updated weights for policy 1, policy_version 1914 (0.0010) [2023-12-25 23:35:02,772][123091] Updated weights for policy 0, policy_version 1928 (0.0010) [2023-12-25 23:35:02,835][123091] Updated weights for policy 0, policy_version 1938 (0.0010) [2023-12-25 23:35:02,886][123091] Updated weights for policy 0, policy_version 1948 (0.0010) [2023-12-25 23:35:03,226][123090] Updated weights for policy 1, policy_version 1924 (0.0009) [2023-12-25 23:35:03,280][123090] Updated weights for policy 1, policy_version 1934 (0.0009) [2023-12-25 23:35:03,342][123090] Updated weights for policy 1, policy_version 1944 (0.0010) [2023-12-25 23:35:03,617][123091] Updated weights for policy 0, policy_version 1958 (0.0007) [2023-12-25 23:35:03,677][123091] Updated weights for policy 0, policy_version 1968 (0.0009) [2023-12-25 23:35:03,735][123091] Updated weights for policy 0, policy_version 1978 (0.0009) [2023-12-25 23:35:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 16793.7, 300 sec: 16793.7). Total num frames: 1007616. Throughput: 0: 8762.8, 1: 8757.5. Samples: 1013812. Policy #0 lag: (min: 31.0, avg: 34.8, max: 63.0) [2023-12-25 23:35:03,785][121949] Avg episode reward: [(0, '369.970'), (1, '388.064')] [2023-12-25 23:35:03,785][123007] Saving new best policy, reward=369.970! [2023-12-25 23:35:03,785][123008] Saving new best policy, reward=388.064! [2023-12-25 23:35:04,223][123090] Updated weights for policy 1, policy_version 1954 (0.0010) [2023-12-25 23:35:04,291][123090] Updated weights for policy 1, policy_version 1964 (0.0010) [2023-12-25 23:35:04,356][123090] Updated weights for policy 1, policy_version 1974 (0.0010) [2023-12-25 23:35:04,418][123090] Updated weights for policy 1, policy_version 1984 (0.0011) [2023-12-25 23:35:04,576][123091] Updated weights for policy 0, policy_version 1988 (0.0009) [2023-12-25 23:35:04,637][123091] Updated weights for policy 0, policy_version 1998 (0.0009) [2023-12-25 23:35:04,705][123091] Updated weights for policy 0, policy_version 2008 (0.0009) [2023-12-25 23:35:05,174][123090] Updated weights for policy 1, policy_version 1994 (0.0005) [2023-12-25 23:35:05,238][123090] Updated weights for policy 1, policy_version 2004 (0.0005) [2023-12-25 23:35:05,290][123090] Updated weights for policy 1, policy_version 2014 (0.0005) [2023-12-25 23:35:05,556][123091] Updated weights for policy 0, policy_version 2018 (0.0010) [2023-12-25 23:35:05,615][123091] Updated weights for policy 0, policy_version 2028 (0.0010) [2023-12-25 23:35:05,677][123091] Updated weights for policy 0, policy_version 2038 (0.0008) [2023-12-25 23:35:05,726][123091] Updated weights for policy 0, policy_version 2048 (0.0005) [2023-12-25 23:35:06,032][123090] Updated weights for policy 1, policy_version 2024 (0.0009) [2023-12-25 23:35:06,101][123090] Updated weights for policy 1, policy_version 2034 (0.0010) [2023-12-25 23:35:06,160][123090] Updated weights for policy 1, policy_version 2044 (0.0009) [2023-12-25 23:35:06,530][123091] Updated weights for policy 0, policy_version 2058 (0.0006) [2023-12-25 23:35:06,591][123091] Updated weights for policy 0, policy_version 2068 (0.0006) [2023-12-25 23:35:06,653][123091] Updated weights for policy 0, policy_version 2078 (0.0007) [2023-12-25 23:35:06,952][123090] Updated weights for policy 1, policy_version 2054 (0.0006) [2023-12-25 23:35:07,012][123090] Updated weights for policy 1, policy_version 2064 (0.0005) [2023-12-25 23:35:07,073][123090] Updated weights for policy 1, policy_version 2074 (0.0006) [2023-12-25 23:35:07,399][123091] Updated weights for policy 0, policy_version 2088 (0.0006) [2023-12-25 23:35:07,455][123091] Updated weights for policy 0, policy_version 2098 (0.0005) [2023-12-25 23:35:07,512][123091] Updated weights for policy 0, policy_version 2108 (0.0005) [2023-12-25 23:35:07,796][123090] Updated weights for policy 1, policy_version 2084 (0.0005) [2023-12-25 23:35:07,858][123090] Updated weights for policy 1, policy_version 2094 (0.0008) [2023-12-25 23:35:07,916][123090] Updated weights for policy 1, policy_version 2104 (0.0010) [2023-12-25 23:35:08,221][123091] Updated weights for policy 0, policy_version 2118 (0.0005) [2023-12-25 23:35:08,277][123091] Updated weights for policy 0, policy_version 2128 (0.0005) [2023-12-25 23:35:08,347][123091] Updated weights for policy 0, policy_version 2138 (0.0007) [2023-12-25 23:35:08,608][123090] Updated weights for policy 1, policy_version 2114 (0.0010) [2023-12-25 23:35:08,672][123090] Updated weights for policy 1, policy_version 2124 (0.0010) [2023-12-25 23:35:08,732][123090] Updated weights for policy 1, policy_version 2134 (0.0010) [2023-12-25 23:35:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16762.1). Total num frames: 1089536. Throughput: 0: 8751.8, 1: 8806.7. Samples: 1066240. Policy #0 lag: (min: 26.0, avg: 35.5, max: 58.0) [2023-12-25 23:35:08,785][121949] Avg episode reward: [(0, '361.731'), (1, '379.374')] [2023-12-25 23:35:08,788][123090] Updated weights for policy 1, policy_version 2144 (0.0010) [2023-12-25 23:35:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000002144_548864.pth... [2023-12-25 23:35:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000002144_548864.pth... [2023-12-25 23:35:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000001120_286720.pth [2023-12-25 23:35:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000001088_278528.pth [2023-12-25 23:35:09,104][123091] Updated weights for policy 0, policy_version 2148 (0.0008) [2023-12-25 23:35:09,176][123091] Updated weights for policy 0, policy_version 2158 (0.0006) [2023-12-25 23:35:09,248][123091] Updated weights for policy 0, policy_version 2168 (0.0008) [2023-12-25 23:35:09,669][123090] Updated weights for policy 1, policy_version 2154 (0.0008) [2023-12-25 23:35:09,732][123090] Updated weights for policy 1, policy_version 2164 (0.0010) [2023-12-25 23:35:09,789][123090] Updated weights for policy 1, policy_version 2174 (0.0009) [2023-12-25 23:35:10,020][123091] Updated weights for policy 0, policy_version 2178 (0.0007) [2023-12-25 23:35:10,074][123091] Updated weights for policy 0, policy_version 2188 (0.0009) [2023-12-25 23:35:10,125][123091] Updated weights for policy 0, policy_version 2198 (0.0009) [2023-12-25 23:35:10,179][123091] Updated weights for policy 0, policy_version 2208 (0.0010) [2023-12-25 23:35:10,692][123090] Updated weights for policy 1, policy_version 2184 (0.0010) [2023-12-25 23:35:10,744][123090] Updated weights for policy 1, policy_version 2194 (0.0010) [2023-12-25 23:35:10,808][123090] Updated weights for policy 1, policy_version 2204 (0.0010) [2023-12-25 23:35:11,037][123091] Updated weights for policy 0, policy_version 2218 (0.0009) [2023-12-25 23:35:11,099][123091] Updated weights for policy 0, policy_version 2228 (0.0009) [2023-12-25 23:35:11,155][123091] Updated weights for policy 0, policy_version 2238 (0.0009) [2023-12-25 23:35:11,700][123090] Updated weights for policy 1, policy_version 2214 (0.0011) [2023-12-25 23:35:11,771][123090] Updated weights for policy 1, policy_version 2224 (0.0010) [2023-12-25 23:35:11,836][123090] Updated weights for policy 1, policy_version 2234 (0.0009) [2023-12-25 23:35:12,047][123091] Updated weights for policy 0, policy_version 2248 (0.0009) [2023-12-25 23:35:12,117][123091] Updated weights for policy 0, policy_version 2258 (0.0009) [2023-12-25 23:35:12,180][123091] Updated weights for policy 0, policy_version 2268 (0.0009) [2023-12-25 23:35:12,651][123090] Updated weights for policy 1, policy_version 2244 (0.0009) [2023-12-25 23:35:12,723][123090] Updated weights for policy 1, policy_version 2254 (0.0006) [2023-12-25 23:35:12,791][123090] Updated weights for policy 1, policy_version 2264 (0.0006) [2023-12-25 23:35:13,120][123091] Updated weights for policy 0, policy_version 2278 (0.0009) [2023-12-25 23:35:13,182][123091] Updated weights for policy 0, policy_version 2288 (0.0009) [2023-12-25 23:35:13,251][123091] Updated weights for policy 0, policy_version 2298 (0.0009) [2023-12-25 23:35:13,575][123090] Updated weights for policy 1, policy_version 2274 (0.0006) [2023-12-25 23:35:13,627][123090] Updated weights for policy 1, policy_version 2284 (0.0005) [2023-12-25 23:35:13,689][123090] Updated weights for policy 1, policy_version 2294 (0.0005) [2023-12-25 23:35:13,762][123090] Updated weights for policy 1, policy_version 2304 (0.0008) [2023-12-25 23:35:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 16852.2). Total num frames: 1179648. Throughput: 0: 8732.7, 1: 8868.9. Samples: 1171192. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-25 23:35:13,785][121949] Avg episode reward: [(0, '389.838'), (1, '395.554')] [2023-12-25 23:35:13,786][123007] Saving new best policy, reward=389.838! [2023-12-25 23:35:13,786][123008] Saving new best policy, reward=395.554! [2023-12-25 23:35:14,111][123091] Updated weights for policy 0, policy_version 2308 (0.0008) [2023-12-25 23:35:14,176][123091] Updated weights for policy 0, policy_version 2318 (0.0007) [2023-12-25 23:35:14,241][123091] Updated weights for policy 0, policy_version 2328 (0.0010) [2023-12-25 23:35:14,541][123090] Updated weights for policy 1, policy_version 2314 (0.0009) [2023-12-25 23:35:14,589][123090] Updated weights for policy 1, policy_version 2324 (0.0008) [2023-12-25 23:35:14,634][123090] Updated weights for policy 1, policy_version 2334 (0.0005) [2023-12-25 23:35:15,063][123091] Updated weights for policy 0, policy_version 2338 (0.0009) [2023-12-25 23:35:15,135][123091] Updated weights for policy 0, policy_version 2348 (0.0007) [2023-12-25 23:35:15,198][123091] Updated weights for policy 0, policy_version 2358 (0.0009) [2023-12-25 23:35:15,262][123091] Updated weights for policy 0, policy_version 2368 (0.0010) [2023-12-25 23:35:15,342][123090] Updated weights for policy 1, policy_version 2345 (0.0008) [2023-12-25 23:35:15,394][123090] Updated weights for policy 1, policy_version 2355 (0.0009) [2023-12-25 23:35:15,442][123090] Updated weights for policy 1, policy_version 2365 (0.0008) [2023-12-25 23:35:16,126][123091] Updated weights for policy 0, policy_version 2378 (0.0009) [2023-12-25 23:35:16,189][123091] Updated weights for policy 0, policy_version 2388 (0.0009) [2023-12-25 23:35:16,193][123090] Updated weights for policy 1, policy_version 2375 (0.0006) [2023-12-25 23:35:16,241][123090] Updated weights for policy 1, policy_version 2385 (0.0005) [2023-12-25 23:35:16,248][123091] Updated weights for policy 0, policy_version 2398 (0.0010) [2023-12-25 23:35:16,297][123090] Updated weights for policy 1, policy_version 2395 (0.0005) [2023-12-25 23:35:17,041][123090] Updated weights for policy 1, policy_version 2405 (0.0007) [2023-12-25 23:35:17,105][123090] Updated weights for policy 1, policy_version 2415 (0.0009) [2023-12-25 23:35:17,136][123091] Updated weights for policy 0, policy_version 2408 (0.0007) [2023-12-25 23:35:17,171][123090] Updated weights for policy 1, policy_version 2425 (0.0007) [2023-12-25 23:35:17,190][123091] Updated weights for policy 0, policy_version 2418 (0.0007) [2023-12-25 23:35:17,244][123091] Updated weights for policy 0, policy_version 2428 (0.0007) [2023-12-25 23:35:17,843][123090] Updated weights for policy 1, policy_version 2435 (0.0005) [2023-12-25 23:35:17,917][123090] Updated weights for policy 1, policy_version 2445 (0.0005) [2023-12-25 23:35:17,927][123091] Updated weights for policy 0, policy_version 2438 (0.0006) [2023-12-25 23:35:17,990][123091] Updated weights for policy 0, policy_version 2448 (0.0006) [2023-12-25 23:35:17,993][123090] Updated weights for policy 1, policy_version 2455 (0.0005) [2023-12-25 23:35:18,041][123091] Updated weights for policy 0, policy_version 2458 (0.0006) [2023-12-25 23:35:18,776][123090] Updated weights for policy 1, policy_version 2465 (0.0009) [2023-12-25 23:35:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 16820.9). Total num frames: 1261568. Throughput: 0: 8704.8, 1: 8870.8. Samples: 1277880. Policy #0 lag: (min: 14.0, avg: 15.1, max: 41.0) [2023-12-25 23:35:18,785][121949] Avg episode reward: [(0, '403.899'), (1, '407.437')] [2023-12-25 23:35:18,813][123091] Updated weights for policy 0, policy_version 2468 (0.0007) [2023-12-25 23:35:18,834][123090] Updated weights for policy 1, policy_version 2475 (0.0009) [2023-12-25 23:35:18,862][123091] Updated weights for policy 0, policy_version 2478 (0.0008) [2023-12-25 23:35:18,891][123090] Updated weights for policy 1, policy_version 2485 (0.0008) [2023-12-25 23:35:18,915][123091] Updated weights for policy 0, policy_version 2488 (0.0006) [2023-12-25 23:35:18,954][123007] Saving new best policy, reward=403.899! [2023-12-25 23:35:18,956][123090] Updated weights for policy 1, policy_version 2495 (0.0007) [2023-12-25 23:35:18,959][123008] Saving new best policy, reward=407.437! [2023-12-25 23:35:19,768][123090] Updated weights for policy 1, policy_version 2505 (0.0010) [2023-12-25 23:35:19,800][123091] Updated weights for policy 0, policy_version 2498 (0.0010) [2023-12-25 23:35:19,831][123090] Updated weights for policy 1, policy_version 2515 (0.0007) [2023-12-25 23:35:19,869][123091] Updated weights for policy 0, policy_version 2508 (0.0008) [2023-12-25 23:35:19,897][123090] Updated weights for policy 1, policy_version 2525 (0.0010) [2023-12-25 23:35:19,938][123091] Updated weights for policy 0, policy_version 2518 (0.0008) [2023-12-25 23:35:19,997][123091] Updated weights for policy 0, policy_version 2528 (0.0010) [2023-12-25 23:35:20,699][123090] Updated weights for policy 1, policy_version 2535 (0.0006) [2023-12-25 23:35:20,757][123090] Updated weights for policy 1, policy_version 2545 (0.0005) [2023-12-25 23:35:20,825][123090] Updated weights for policy 1, policy_version 2555 (0.0006) [2023-12-25 23:35:20,910][123091] Updated weights for policy 0, policy_version 2538 (0.0010) [2023-12-25 23:35:20,969][123091] Updated weights for policy 0, policy_version 2548 (0.0010) [2023-12-25 23:35:21,028][123091] Updated weights for policy 0, policy_version 2558 (0.0010) [2023-12-25 23:35:21,614][123090] Updated weights for policy 1, policy_version 2565 (0.0006) [2023-12-25 23:35:21,682][123090] Updated weights for policy 1, policy_version 2575 (0.0009) [2023-12-25 23:35:21,755][123090] Updated weights for policy 1, policy_version 2585 (0.0010) [2023-12-25 23:35:21,911][123091] Updated weights for policy 0, policy_version 2568 (0.0009) [2023-12-25 23:35:21,970][123091] Updated weights for policy 0, policy_version 2578 (0.0009) [2023-12-25 23:35:22,028][123091] Updated weights for policy 0, policy_version 2588 (0.0006) [2023-12-25 23:35:22,613][123090] Updated weights for policy 1, policy_version 2595 (0.0009) [2023-12-25 23:35:22,682][123090] Updated weights for policy 1, policy_version 2605 (0.0011) [2023-12-25 23:35:22,747][123090] Updated weights for policy 1, policy_version 2615 (0.0010) [2023-12-25 23:35:22,810][123091] Updated weights for policy 0, policy_version 2598 (0.0006) [2023-12-25 23:35:22,866][123091] Updated weights for policy 0, policy_version 2608 (0.0007) [2023-12-25 23:35:22,933][123091] Updated weights for policy 0, policy_version 2618 (0.0005) [2023-12-25 23:35:23,598][123090] Updated weights for policy 1, policy_version 2625 (0.0011) [2023-12-25 23:35:23,663][123090] Updated weights for policy 1, policy_version 2635 (0.0011) [2023-12-25 23:35:23,728][123090] Updated weights for policy 1, policy_version 2645 (0.0011) [2023-12-25 23:35:23,729][123091] Updated weights for policy 0, policy_version 2628 (0.0008) [2023-12-25 23:35:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 16793.6). Total num frames: 1343488. Throughput: 0: 8683.1, 1: 8872.2. Samples: 1328624. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-25 23:35:23,785][121949] Avg episode reward: [(0, '449.802'), (1, '362.227')] [2023-12-25 23:35:23,794][123091] Updated weights for policy 0, policy_version 2638 (0.0009) [2023-12-25 23:35:23,794][123090] Updated weights for policy 1, policy_version 2655 (0.0010) [2023-12-25 23:35:23,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000002656_679936.pth... [2023-12-25 23:35:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000001632_417792.pth [2023-12-25 23:35:23,862][123091] Updated weights for policy 0, policy_version 2648 (0.0008) [2023-12-25 23:35:23,916][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000002656_679936.pth... [2023-12-25 23:35:23,922][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000001600_409600.pth [2023-12-25 23:35:23,922][123007] Saving new best policy, reward=449.802! [2023-12-25 23:35:24,543][123090] Updated weights for policy 1, policy_version 2665 (0.0006) [2023-12-25 23:35:24,599][123090] Updated weights for policy 1, policy_version 2675 (0.0005) [2023-12-25 23:35:24,661][123090] Updated weights for policy 1, policy_version 2685 (0.0005) [2023-12-25 23:35:24,791][123091] Updated weights for policy 0, policy_version 2658 (0.0010) [2023-12-25 23:35:24,852][123091] Updated weights for policy 0, policy_version 2668 (0.0009) [2023-12-25 23:35:24,908][123091] Updated weights for policy 0, policy_version 2678 (0.0010) [2023-12-25 23:35:24,967][123091] Updated weights for policy 0, policy_version 2688 (0.0010) [2023-12-25 23:35:25,302][123090] Updated weights for policy 1, policy_version 2695 (0.0006) [2023-12-25 23:35:25,360][123090] Updated weights for policy 1, policy_version 2705 (0.0006) [2023-12-25 23:35:25,419][123090] Updated weights for policy 1, policy_version 2715 (0.0005) [2023-12-25 23:35:25,817][123091] Updated weights for policy 0, policy_version 2698 (0.0009) [2023-12-25 23:35:25,883][123091] Updated weights for policy 0, policy_version 2708 (0.0009) [2023-12-25 23:35:25,932][123091] Updated weights for policy 0, policy_version 2718 (0.0010) [2023-12-25 23:35:26,160][123090] Updated weights for policy 1, policy_version 2725 (0.0008) [2023-12-25 23:35:26,214][123090] Updated weights for policy 1, policy_version 2735 (0.0010) [2023-12-25 23:35:26,269][123090] Updated weights for policy 1, policy_version 2745 (0.0010) [2023-12-25 23:35:26,652][123091] Updated weights for policy 0, policy_version 2728 (0.0007) [2023-12-25 23:35:26,712][123091] Updated weights for policy 0, policy_version 2738 (0.0005) [2023-12-25 23:35:26,767][123091] Updated weights for policy 0, policy_version 2748 (0.0005) [2023-12-25 23:35:27,092][123090] Updated weights for policy 1, policy_version 2755 (0.0010) [2023-12-25 23:35:27,149][123090] Updated weights for policy 1, policy_version 2765 (0.0010) [2023-12-25 23:35:27,197][123090] Updated weights for policy 1, policy_version 2775 (0.0010) [2023-12-25 23:35:27,462][123091] Updated weights for policy 0, policy_version 2758 (0.0005) [2023-12-25 23:35:27,515][123091] Updated weights for policy 0, policy_version 2768 (0.0005) [2023-12-25 23:35:27,567][123091] Updated weights for policy 0, policy_version 2778 (0.0005) [2023-12-25 23:35:27,935][123090] Updated weights for policy 1, policy_version 2785 (0.0010) [2023-12-25 23:35:27,985][123090] Updated weights for policy 1, policy_version 2795 (0.0006) [2023-12-25 23:35:28,036][123090] Updated weights for policy 1, policy_version 2805 (0.0010) [2023-12-25 23:35:28,081][123090] Updated weights for policy 1, policy_version 2815 (0.0010) [2023-12-25 23:35:28,188][123091] Updated weights for policy 0, policy_version 2788 (0.0005) [2023-12-25 23:35:28,235][123091] Updated weights for policy 0, policy_version 2798 (0.0005) [2023-12-25 23:35:28,280][123091] Updated weights for policy 0, policy_version 2808 (0.0005) [2023-12-25 23:35:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 16962.3). Total num frames: 1441792. Throughput: 0: 8719.6, 1: 8920.5. Samples: 1435264. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-25 23:35:28,785][121949] Avg episode reward: [(0, '472.766'), (1, '397.680')] [2023-12-25 23:35:28,786][123007] Saving new best policy, reward=472.766! [2023-12-25 23:35:28,893][123090] Updated weights for policy 1, policy_version 2825 (0.0006) [2023-12-25 23:35:28,941][123090] Updated weights for policy 1, policy_version 2835 (0.0006) [2023-12-25 23:35:28,995][123090] Updated weights for policy 1, policy_version 2845 (0.0009) [2023-12-25 23:35:29,054][123091] Updated weights for policy 0, policy_version 2818 (0.0005) [2023-12-25 23:35:29,105][123091] Updated weights for policy 0, policy_version 2828 (0.0006) [2023-12-25 23:35:29,173][123091] Updated weights for policy 0, policy_version 2838 (0.0008) [2023-12-25 23:35:29,247][123091] Updated weights for policy 0, policy_version 2848 (0.0008) [2023-12-25 23:35:29,887][123090] Updated weights for policy 1, policy_version 2855 (0.0008) [2023-12-25 23:35:29,912][123091] Updated weights for policy 0, policy_version 2858 (0.0009) [2023-12-25 23:35:29,955][123090] Updated weights for policy 1, policy_version 2865 (0.0007) [2023-12-25 23:35:29,985][123091] Updated weights for policy 0, policy_version 2868 (0.0009) [2023-12-25 23:35:30,008][123090] Updated weights for policy 1, policy_version 2875 (0.0005) [2023-12-25 23:35:30,046][123091] Updated weights for policy 0, policy_version 2878 (0.0007) [2023-12-25 23:35:30,687][123091] Updated weights for policy 0, policy_version 2888 (0.0006) [2023-12-25 23:35:30,747][123091] Updated weights for policy 0, policy_version 2898 (0.0005) [2023-12-25 23:35:30,809][123091] Updated weights for policy 0, policy_version 2908 (0.0006) [2023-12-25 23:35:30,824][123090] Updated weights for policy 1, policy_version 2885 (0.0006) [2023-12-25 23:35:30,880][123090] Updated weights for policy 1, policy_version 2895 (0.0009) [2023-12-25 23:35:30,942][123090] Updated weights for policy 1, policy_version 2906 (0.0010) [2023-12-25 23:35:31,539][123091] Updated weights for policy 0, policy_version 2918 (0.0007) [2023-12-25 23:35:31,601][123091] Updated weights for policy 0, policy_version 2928 (0.0007) [2023-12-25 23:35:31,673][123091] Updated weights for policy 0, policy_version 2938 (0.0008) [2023-12-25 23:35:31,855][123090] Updated weights for policy 1, policy_version 2916 (0.0009) [2023-12-25 23:35:31,929][123090] Updated weights for policy 1, policy_version 2926 (0.0010) [2023-12-25 23:35:32,000][123090] Updated weights for policy 1, policy_version 2936 (0.0010) [2023-12-25 23:35:32,386][123091] Updated weights for policy 0, policy_version 2948 (0.0007) [2023-12-25 23:35:32,442][123091] Updated weights for policy 0, policy_version 2958 (0.0008) [2023-12-25 23:35:32,500][123091] Updated weights for policy 0, policy_version 2968 (0.0008) [2023-12-25 23:35:32,759][123090] Updated weights for policy 1, policy_version 2946 (0.0010) [2023-12-25 23:35:32,824][123090] Updated weights for policy 1, policy_version 2956 (0.0008) [2023-12-25 23:35:32,882][123090] Updated weights for policy 1, policy_version 2966 (0.0010) [2023-12-25 23:35:32,933][123090] Updated weights for policy 1, policy_version 2976 (0.0009) [2023-12-25 23:35:33,349][123091] Updated weights for policy 0, policy_version 2978 (0.0008) [2023-12-25 23:35:33,395][123091] Updated weights for policy 0, policy_version 2988 (0.0007) [2023-12-25 23:35:33,455][123091] Updated weights for policy 0, policy_version 2998 (0.0005) [2023-12-25 23:35:33,514][123091] Updated weights for policy 0, policy_version 3008 (0.0005) [2023-12-25 23:35:33,645][123090] Updated weights for policy 1, policy_version 2986 (0.0005) [2023-12-25 23:35:33,720][123090] Updated weights for policy 1, policy_version 2996 (0.0005) [2023-12-25 23:35:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.2, 300 sec: 17021.2). Total num frames: 1531904. Throughput: 0: 8946.8, 1: 8837.0. Samples: 1546764. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-25 23:35:33,785][121949] Avg episode reward: [(0, '522.043'), (1, '467.044')] [2023-12-25 23:35:33,785][123007] Saving new best policy, reward=522.043! [2023-12-25 23:35:33,790][123090] Updated weights for policy 1, policy_version 3006 (0.0005) [2023-12-25 23:35:33,802][123008] Saving new best policy, reward=467.044! [2023-12-25 23:35:34,279][123091] Updated weights for policy 0, policy_version 3018 (0.0006) [2023-12-25 23:35:34,354][123091] Updated weights for policy 0, policy_version 3028 (0.0006) [2023-12-25 23:35:34,413][123090] Updated weights for policy 1, policy_version 3016 (0.0007) [2023-12-25 23:35:34,418][123091] Updated weights for policy 0, policy_version 3038 (0.0009) [2023-12-25 23:35:34,470][123090] Updated weights for policy 1, policy_version 3026 (0.0006) [2023-12-25 23:35:34,533][123090] Updated weights for policy 1, policy_version 3036 (0.0005) [2023-12-25 23:35:35,152][123091] Updated weights for policy 0, policy_version 3048 (0.0009) [2023-12-25 23:35:35,204][123091] Updated weights for policy 0, policy_version 3058 (0.0009) [2023-12-25 23:35:35,253][123091] Updated weights for policy 0, policy_version 3068 (0.0009) [2023-12-25 23:35:35,308][123090] Updated weights for policy 1, policy_version 3046 (0.0008) [2023-12-25 23:35:35,375][123090] Updated weights for policy 1, policy_version 3056 (0.0010) [2023-12-25 23:35:35,438][123090] Updated weights for policy 1, policy_version 3066 (0.0010) [2023-12-25 23:35:36,112][123091] Updated weights for policy 0, policy_version 3078 (0.0009) [2023-12-25 23:35:36,175][123091] Updated weights for policy 0, policy_version 3088 (0.0009) [2023-12-25 23:35:36,244][123091] Updated weights for policy 0, policy_version 3098 (0.0009) [2023-12-25 23:35:36,270][123090] Updated weights for policy 1, policy_version 3076 (0.0010) [2023-12-25 23:35:36,331][123090] Updated weights for policy 1, policy_version 3086 (0.0010) [2023-12-25 23:35:36,394][123090] Updated weights for policy 1, policy_version 3096 (0.0010) [2023-12-25 23:35:37,081][123091] Updated weights for policy 0, policy_version 3108 (0.0009) [2023-12-25 23:35:37,139][123091] Updated weights for policy 0, policy_version 3118 (0.0009) [2023-12-25 23:35:37,200][123091] Updated weights for policy 0, policy_version 3128 (0.0009) [2023-12-25 23:35:37,235][123090] Updated weights for policy 1, policy_version 3106 (0.0011) [2023-12-25 23:35:37,288][123090] Updated weights for policy 1, policy_version 3116 (0.0010) [2023-12-25 23:35:37,344][123090] Updated weights for policy 1, policy_version 3126 (0.0010) [2023-12-25 23:35:37,395][123090] Updated weights for policy 1, policy_version 3136 (0.0010) [2023-12-25 23:35:38,075][123091] Updated weights for policy 0, policy_version 3138 (0.0008) [2023-12-25 23:35:38,127][123091] Updated weights for policy 0, policy_version 3148 (0.0009) [2023-12-25 23:35:38,180][123091] Updated weights for policy 0, policy_version 3158 (0.0009) [2023-12-25 23:35:38,237][123091] Updated weights for policy 0, policy_version 3168 (0.0009) [2023-12-25 23:35:38,258][123090] Updated weights for policy 1, policy_version 3146 (0.0010) [2023-12-25 23:35:38,317][123090] Updated weights for policy 1, policy_version 3156 (0.0010) [2023-12-25 23:35:38,381][123090] Updated weights for policy 1, policy_version 3166 (0.0010) [2023-12-25 23:35:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17073.9). Total num frames: 1622016. Throughput: 0: 8980.3, 1: 8844.3. Samples: 1600200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:35:38,785][121949] Avg episode reward: [(0, '579.925'), (1, '465.626')] [2023-12-25 23:35:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000003168_811008.pth... [2023-12-25 23:35:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000003168_811008.pth... [2023-12-25 23:35:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000002144_548864.pth [2023-12-25 23:35:38,796][123007] Saving new best policy, reward=579.925! [2023-12-25 23:35:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000002144_548864.pth [2023-12-25 23:35:39,125][123091] Updated weights for policy 0, policy_version 3178 (0.0009) [2023-12-25 23:35:39,189][123091] Updated weights for policy 0, policy_version 3188 (0.0008) [2023-12-25 23:35:39,224][123090] Updated weights for policy 1, policy_version 3176 (0.0010) [2023-12-25 23:35:39,273][123091] Updated weights for policy 0, policy_version 3198 (0.0008) [2023-12-25 23:35:39,283][123090] Updated weights for policy 1, policy_version 3186 (0.0010) [2023-12-25 23:35:39,340][123090] Updated weights for policy 1, policy_version 3196 (0.0010) [2023-12-25 23:35:40,107][123091] Updated weights for policy 0, policy_version 3208 (0.0010) [2023-12-25 23:35:40,171][123091] Updated weights for policy 0, policy_version 3218 (0.0011) [2023-12-25 23:35:40,200][123090] Updated weights for policy 1, policy_version 3206 (0.0011) [2023-12-25 23:35:40,236][123091] Updated weights for policy 0, policy_version 3228 (0.0011) [2023-12-25 23:35:40,263][123090] Updated weights for policy 1, policy_version 3216 (0.0011) [2023-12-25 23:35:40,319][123090] Updated weights for policy 1, policy_version 3226 (0.0010) [2023-12-25 23:35:41,009][123091] Updated weights for policy 0, policy_version 3238 (0.0010) [2023-12-25 23:35:41,079][123091] Updated weights for policy 0, policy_version 3248 (0.0009) [2023-12-25 23:35:41,099][123090] Updated weights for policy 1, policy_version 3236 (0.0010) [2023-12-25 23:35:41,147][123091] Updated weights for policy 0, policy_version 3258 (0.0008) [2023-12-25 23:35:41,172][123090] Updated weights for policy 1, policy_version 3246 (0.0008) [2023-12-25 23:35:41,232][123090] Updated weights for policy 1, policy_version 3256 (0.0010) [2023-12-25 23:35:41,932][123091] Updated weights for policy 0, policy_version 3268 (0.0008) [2023-12-25 23:35:41,997][123091] Updated weights for policy 0, policy_version 3278 (0.0009) [2023-12-25 23:35:42,065][123091] Updated weights for policy 0, policy_version 3288 (0.0008) [2023-12-25 23:35:42,076][123090] Updated weights for policy 1, policy_version 3266 (0.0008) [2023-12-25 23:35:42,140][123090] Updated weights for policy 1, policy_version 3276 (0.0008) [2023-12-25 23:35:42,203][123090] Updated weights for policy 1, policy_version 3286 (0.0009) [2023-12-25 23:35:42,267][123090] Updated weights for policy 1, policy_version 3296 (0.0009) [2023-12-25 23:35:42,849][123091] Updated weights for policy 0, policy_version 3298 (0.0007) [2023-12-25 23:35:42,904][123091] Updated weights for policy 0, policy_version 3308 (0.0006) [2023-12-25 23:35:42,966][123091] Updated weights for policy 0, policy_version 3318 (0.0009) [2023-12-25 23:35:43,016][123091] Updated weights for policy 0, policy_version 3328 (0.0009) [2023-12-25 23:35:43,121][123090] Updated weights for policy 1, policy_version 3306 (0.0010) [2023-12-25 23:35:43,183][123090] Updated weights for policy 1, policy_version 3316 (0.0006) [2023-12-25 23:35:43,239][123090] Updated weights for policy 1, policy_version 3326 (0.0006) [2023-12-25 23:35:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17039.4). Total num frames: 1703936. Throughput: 0: 8831.8, 1: 8804.0. Samples: 1700944. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-25 23:35:43,785][121949] Avg episode reward: [(0, '629.728'), (1, '536.768')] [2023-12-25 23:35:43,786][123008] Saving new best policy, reward=536.768! [2023-12-25 23:35:43,816][123091] Updated weights for policy 0, policy_version 3338 (0.0005) [2023-12-25 23:35:43,873][123091] Updated weights for policy 0, policy_version 3348 (0.0005) [2023-12-25 23:35:43,932][123091] Updated weights for policy 0, policy_version 3358 (0.0005) [2023-12-25 23:35:43,945][123007] Saving new best policy, reward=629.728! [2023-12-25 23:35:44,027][123090] Updated weights for policy 1, policy_version 3336 (0.0006) [2023-12-25 23:35:44,085][123090] Updated weights for policy 1, policy_version 3346 (0.0005) [2023-12-25 23:35:44,143][123090] Updated weights for policy 1, policy_version 3356 (0.0006) [2023-12-25 23:35:44,631][123091] Updated weights for policy 0, policy_version 3368 (0.0005) [2023-12-25 23:35:44,694][123091] Updated weights for policy 0, policy_version 3378 (0.0008) [2023-12-25 23:35:44,762][123091] Updated weights for policy 0, policy_version 3388 (0.0011) [2023-12-25 23:35:44,851][123090] Updated weights for policy 1, policy_version 3366 (0.0008) [2023-12-25 23:35:44,905][123090] Updated weights for policy 1, policy_version 3376 (0.0005) [2023-12-25 23:35:44,964][123090] Updated weights for policy 1, policy_version 3386 (0.0006) [2023-12-25 23:35:45,546][123091] Updated weights for policy 0, policy_version 3398 (0.0007) [2023-12-25 23:35:45,613][123091] Updated weights for policy 0, policy_version 3408 (0.0005) [2023-12-25 23:35:45,677][123091] Updated weights for policy 0, policy_version 3418 (0.0005) [2023-12-25 23:35:45,840][123090] Updated weights for policy 1, policy_version 3396 (0.0008) [2023-12-25 23:35:45,894][123090] Updated weights for policy 1, policy_version 3406 (0.0010) [2023-12-25 23:35:45,950][123090] Updated weights for policy 1, policy_version 3417 (0.0010) [2023-12-25 23:35:46,353][123091] Updated weights for policy 0, policy_version 3428 (0.0005) [2023-12-25 23:35:46,420][123091] Updated weights for policy 0, policy_version 3438 (0.0005) [2023-12-25 23:35:46,482][123091] Updated weights for policy 0, policy_version 3448 (0.0005) [2023-12-25 23:35:46,710][123090] Updated weights for policy 1, policy_version 3427 (0.0009) [2023-12-25 23:35:46,775][123090] Updated weights for policy 1, policy_version 3437 (0.0009) [2023-12-25 23:35:46,835][123090] Updated weights for policy 1, policy_version 3447 (0.0006) [2023-12-25 23:35:47,244][123091] Updated weights for policy 0, policy_version 3458 (0.0006) [2023-12-25 23:35:47,307][123091] Updated weights for policy 0, policy_version 3468 (0.0010) [2023-12-25 23:35:47,369][123091] Updated weights for policy 0, policy_version 3478 (0.0010) [2023-12-25 23:35:47,423][123091] Updated weights for policy 0, policy_version 3488 (0.0010) [2023-12-25 23:35:47,588][123090] Updated weights for policy 1, policy_version 3457 (0.0006) [2023-12-25 23:35:47,653][123090] Updated weights for policy 1, policy_version 3467 (0.0009) [2023-12-25 23:35:47,713][123090] Updated weights for policy 1, policy_version 3477 (0.0009) [2023-12-25 23:35:47,765][123090] Updated weights for policy 1, policy_version 3487 (0.0009) [2023-12-25 23:35:48,204][123091] Updated weights for policy 0, policy_version 3498 (0.0006) [2023-12-25 23:35:48,267][123091] Updated weights for policy 0, policy_version 3508 (0.0010) [2023-12-25 23:35:48,333][123091] Updated weights for policy 0, policy_version 3518 (0.0010) [2023-12-25 23:35:48,669][123090] Updated weights for policy 1, policy_version 3497 (0.0009) [2023-12-25 23:35:48,722][123090] Updated weights for policy 1, policy_version 3507 (0.0009) [2023-12-25 23:35:48,770][123090] Updated weights for policy 1, policy_version 3517 (0.0009) [2023-12-25 23:35:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17164.2). Total num frames: 1802240. Throughput: 0: 8837.8, 1: 8864.5. Samples: 1810416. Policy #0 lag: (min: 31.0, avg: 37.8, max: 63.0) [2023-12-25 23:35:48,785][121949] Avg episode reward: [(0, '664.634'), (1, '666.883')] [2023-12-25 23:35:48,786][123007] Saving new best policy, reward=664.634! [2023-12-25 23:35:48,786][123008] Saving new best policy, reward=666.883! [2023-12-25 23:35:49,132][123091] Updated weights for policy 0, policy_version 3528 (0.0011) [2023-12-25 23:35:49,192][123091] Updated weights for policy 0, policy_version 3538 (0.0010) [2023-12-25 23:35:49,256][123091] Updated weights for policy 0, policy_version 3548 (0.0011) [2023-12-25 23:35:49,646][123090] Updated weights for policy 1, policy_version 3527 (0.0008) [2023-12-25 23:35:49,709][123090] Updated weights for policy 1, policy_version 3537 (0.0010) [2023-12-25 23:35:49,779][123090] Updated weights for policy 1, policy_version 3547 (0.0009) [2023-12-25 23:35:50,050][123091] Updated weights for policy 0, policy_version 3558 (0.0010) [2023-12-25 23:35:50,111][123091] Updated weights for policy 0, policy_version 3568 (0.0007) [2023-12-25 23:35:50,168][123091] Updated weights for policy 0, policy_version 3578 (0.0005) [2023-12-25 23:35:50,513][123090] Updated weights for policy 1, policy_version 3557 (0.0009) [2023-12-25 23:35:50,587][123090] Updated weights for policy 1, policy_version 3567 (0.0009) [2023-12-25 23:35:50,640][123090] Updated weights for policy 1, policy_version 3577 (0.0010) [2023-12-25 23:35:50,920][123091] Updated weights for policy 0, policy_version 3588 (0.0006) [2023-12-25 23:35:50,976][123091] Updated weights for policy 0, policy_version 3598 (0.0005) [2023-12-25 23:35:51,040][123091] Updated weights for policy 0, policy_version 3608 (0.0007) [2023-12-25 23:35:51,560][123090] Updated weights for policy 1, policy_version 3587 (0.0009) [2023-12-25 23:35:51,635][123090] Updated weights for policy 1, policy_version 3597 (0.0010) [2023-12-25 23:35:51,704][123090] Updated weights for policy 1, policy_version 3607 (0.0008) [2023-12-25 23:35:51,896][123091] Updated weights for policy 0, policy_version 3618 (0.0010) [2023-12-25 23:35:51,957][123091] Updated weights for policy 0, policy_version 3628 (0.0010) [2023-12-25 23:35:52,015][123091] Updated weights for policy 0, policy_version 3638 (0.0010) [2023-12-25 23:35:52,068][123091] Updated weights for policy 0, policy_version 3648 (0.0009) [2023-12-25 23:35:52,541][123090] Updated weights for policy 1, policy_version 3617 (0.0008) [2023-12-25 23:35:52,599][123090] Updated weights for policy 1, policy_version 3627 (0.0008) [2023-12-25 23:35:52,658][123090] Updated weights for policy 1, policy_version 3637 (0.0007) [2023-12-25 23:35:52,734][123090] Updated weights for policy 1, policy_version 3647 (0.0005) [2023-12-25 23:35:52,936][123091] Updated weights for policy 0, policy_version 3658 (0.0010) [2023-12-25 23:35:52,990][123091] Updated weights for policy 0, policy_version 3669 (0.0010) [2023-12-25 23:35:53,039][123091] Updated weights for policy 0, policy_version 3679 (0.0009) [2023-12-25 23:35:53,505][123090] Updated weights for policy 1, policy_version 3657 (0.0009) [2023-12-25 23:35:53,567][123090] Updated weights for policy 1, policy_version 3667 (0.0009) [2023-12-25 23:35:53,618][123090] Updated weights for policy 1, policy_version 3677 (0.0009) [2023-12-25 23:35:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17128.7). Total num frames: 1884160. Throughput: 0: 8857.4, 1: 8825.9. Samples: 1861988. Policy #0 lag: (min: 31.0, avg: 37.1, max: 63.0) [2023-12-25 23:35:53,785][121949] Avg episode reward: [(0, '666.276'), (1, '683.735')] [2023-12-25 23:35:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000003680_942080.pth... [2023-12-25 23:35:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000003680_942080.pth... [2023-12-25 23:35:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000002656_679936.pth [2023-12-25 23:35:53,797][123007] Saving new best policy, reward=666.276! [2023-12-25 23:35:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000002656_679936.pth [2023-12-25 23:35:53,798][123008] Saving new best policy, reward=683.735! [2023-12-25 23:35:53,951][123091] Updated weights for policy 0, policy_version 3689 (0.0010) [2023-12-25 23:35:54,017][123091] Updated weights for policy 0, policy_version 3699 (0.0010) [2023-12-25 23:35:54,071][123091] Updated weights for policy 0, policy_version 3709 (0.0010) [2023-12-25 23:35:54,424][123090] Updated weights for policy 1, policy_version 3687 (0.0009) [2023-12-25 23:35:54,498][123090] Updated weights for policy 1, policy_version 3697 (0.0009) [2023-12-25 23:35:54,552][123090] Updated weights for policy 1, policy_version 3707 (0.0009) [2023-12-25 23:35:54,953][123091] Updated weights for policy 0, policy_version 3719 (0.0009) [2023-12-25 23:35:55,006][123091] Updated weights for policy 0, policy_version 3729 (0.0010) [2023-12-25 23:35:55,064][123091] Updated weights for policy 0, policy_version 3739 (0.0010) [2023-12-25 23:35:55,277][123090] Updated weights for policy 1, policy_version 3717 (0.0010) [2023-12-25 23:35:55,334][123090] Updated weights for policy 1, policy_version 3727 (0.0009) [2023-12-25 23:35:55,390][123090] Updated weights for policy 1, policy_version 3737 (0.0009) [2023-12-25 23:35:55,960][123091] Updated weights for policy 0, policy_version 3750 (0.0010) [2023-12-25 23:35:56,026][123091] Updated weights for policy 0, policy_version 3760 (0.0010) [2023-12-25 23:35:56,075][123091] Updated weights for policy 0, policy_version 3770 (0.0009) [2023-12-25 23:35:56,180][123090] Updated weights for policy 1, policy_version 3747 (0.0009) [2023-12-25 23:35:56,239][123090] Updated weights for policy 1, policy_version 3757 (0.0010) [2023-12-25 23:35:56,299][123090] Updated weights for policy 1, policy_version 3767 (0.0010) [2023-12-25 23:35:56,933][123091] Updated weights for policy 0, policy_version 3780 (0.0009) [2023-12-25 23:35:56,985][123091] Updated weights for policy 0, policy_version 3791 (0.0009) [2023-12-25 23:35:57,038][123091] Updated weights for policy 0, policy_version 3801 (0.0009) [2023-12-25 23:35:57,085][123090] Updated weights for policy 1, policy_version 3777 (0.0010) [2023-12-25 23:35:57,145][123090] Updated weights for policy 1, policy_version 3787 (0.0008) [2023-12-25 23:35:57,200][123090] Updated weights for policy 1, policy_version 3797 (0.0008) [2023-12-25 23:35:57,256][123090] Updated weights for policy 1, policy_version 3807 (0.0008) [2023-12-25 23:35:57,898][123091] Updated weights for policy 0, policy_version 3811 (0.0010) [2023-12-25 23:35:57,952][123091] Updated weights for policy 0, policy_version 3821 (0.0008) [2023-12-25 23:35:58,016][123091] Updated weights for policy 0, policy_version 3831 (0.0009) [2023-12-25 23:35:58,069][123090] Updated weights for policy 1, policy_version 3817 (0.0009) [2023-12-25 23:35:58,129][123090] Updated weights for policy 1, policy_version 3827 (0.0005) [2023-12-25 23:35:58,196][123090] Updated weights for policy 1, policy_version 3837 (0.0006) [2023-12-25 23:35:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17096.4). Total num frames: 1966080. Throughput: 0: 8779.4, 1: 8851.0. Samples: 1964560. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-25 23:35:58,785][121949] Avg episode reward: [(0, '779.494'), (1, '787.703')] [2023-12-25 23:35:58,786][123007] Saving new best policy, reward=779.494! [2023-12-25 23:35:58,786][123008] Saving new best policy, reward=787.703! [2023-12-25 23:35:58,875][123091] Updated weights for policy 0, policy_version 3841 (0.0008) [2023-12-25 23:35:58,951][123091] Updated weights for policy 0, policy_version 3851 (0.0008) [2023-12-25 23:35:59,032][123091] Updated weights for policy 0, policy_version 3861 (0.0008) [2023-12-25 23:35:59,071][123090] Updated weights for policy 1, policy_version 3847 (0.0007) [2023-12-25 23:35:59,087][123091] Updated weights for policy 0, policy_version 3871 (0.0007) [2023-12-25 23:35:59,131][123090] Updated weights for policy 1, policy_version 3857 (0.0007) [2023-12-25 23:35:59,192][123090] Updated weights for policy 1, policy_version 3867 (0.0007) [2023-12-25 23:35:59,770][123091] Updated weights for policy 0, policy_version 3881 (0.0005) [2023-12-25 23:35:59,833][123091] Updated weights for policy 0, policy_version 3891 (0.0006) [2023-12-25 23:35:59,903][123091] Updated weights for policy 0, policy_version 3901 (0.0008) [2023-12-25 23:36:00,036][123090] Updated weights for policy 1, policy_version 3877 (0.0008) [2023-12-25 23:36:00,093][123090] Updated weights for policy 1, policy_version 3887 (0.0008) [2023-12-25 23:36:00,154][123090] Updated weights for policy 1, policy_version 3897 (0.0008) [2023-12-25 23:36:00,711][123091] Updated weights for policy 0, policy_version 3911 (0.0009) [2023-12-25 23:36:00,761][123091] Updated weights for policy 0, policy_version 3921 (0.0009) [2023-12-25 23:36:00,779][123090] Updated weights for policy 1, policy_version 3907 (0.0007) [2023-12-25 23:36:00,816][123091] Updated weights for policy 0, policy_version 3931 (0.0009) [2023-12-25 23:36:00,844][123090] Updated weights for policy 1, policy_version 3917 (0.0005) [2023-12-25 23:36:00,902][123090] Updated weights for policy 1, policy_version 3927 (0.0005) [2023-12-25 23:36:01,640][123090] Updated weights for policy 1, policy_version 3937 (0.0005) [2023-12-25 23:36:01,685][123091] Updated weights for policy 0, policy_version 3941 (0.0007) [2023-12-25 23:36:01,709][123090] Updated weights for policy 1, policy_version 3947 (0.0007) [2023-12-25 23:36:01,748][123091] Updated weights for policy 0, policy_version 3951 (0.0007) [2023-12-25 23:36:01,774][123090] Updated weights for policy 1, policy_version 3957 (0.0007) [2023-12-25 23:36:01,814][123091] Updated weights for policy 0, policy_version 3961 (0.0008) [2023-12-25 23:36:01,835][123090] Updated weights for policy 1, policy_version 3967 (0.0009) [2023-12-25 23:36:02,588][123091] Updated weights for policy 0, policy_version 3971 (0.0008) [2023-12-25 23:36:02,648][123090] Updated weights for policy 1, policy_version 3977 (0.0010) [2023-12-25 23:36:02,661][123091] Updated weights for policy 0, policy_version 3981 (0.0005) [2023-12-25 23:36:02,714][123090] Updated weights for policy 1, policy_version 3987 (0.0009) [2023-12-25 23:36:02,727][123091] Updated weights for policy 0, policy_version 3991 (0.0005) [2023-12-25 23:36:02,782][123090] Updated weights for policy 1, policy_version 3997 (0.0009) [2023-12-25 23:36:03,270][123091] Updated weights for policy 0, policy_version 4001 (0.0005) [2023-12-25 23:36:03,318][123091] Updated weights for policy 0, policy_version 4011 (0.0005) [2023-12-25 23:36:03,364][123091] Updated weights for policy 0, policy_version 4021 (0.0005) [2023-12-25 23:36:03,408][123091] Updated weights for policy 0, policy_version 4031 (0.0005) [2023-12-25 23:36:03,607][123090] Updated weights for policy 1, policy_version 4007 (0.0009) [2023-12-25 23:36:03,671][123090] Updated weights for policy 1, policy_version 4017 (0.0010) [2023-12-25 23:36:03,721][123090] Updated weights for policy 1, policy_version 4027 (0.0009) [2023-12-25 23:36:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17203.2). Total num frames: 2064384. Throughput: 0: 8827.3, 1: 8803.2. Samples: 2071252. Policy #0 lag: (min: 17.0, avg: 34.7, max: 49.0) [2023-12-25 23:36:03,784][121949] Avg episode reward: [(0, '802.370'), (1, '799.434')] [2023-12-25 23:36:03,785][123007] Saving new best policy, reward=802.370! [2023-12-25 23:36:03,785][123008] Saving new best policy, reward=799.434! [2023-12-25 23:36:04,152][123091] Updated weights for policy 0, policy_version 4041 (0.0009) [2023-12-25 23:36:04,223][123091] Updated weights for policy 0, policy_version 4051 (0.0009) [2023-12-25 23:36:04,290][123091] Updated weights for policy 0, policy_version 4061 (0.0009) [2023-12-25 23:36:04,575][123090] Updated weights for policy 1, policy_version 4037 (0.0008) [2023-12-25 23:36:04,637][123090] Updated weights for policy 1, policy_version 4047 (0.0010) [2023-12-25 23:36:04,701][123090] Updated weights for policy 1, policy_version 4057 (0.0006) [2023-12-25 23:36:05,078][123091] Updated weights for policy 0, policy_version 4071 (0.0007) [2023-12-25 23:36:05,136][123091] Updated weights for policy 0, policy_version 4081 (0.0005) [2023-12-25 23:36:05,192][123091] Updated weights for policy 0, policy_version 4091 (0.0005) [2023-12-25 23:36:05,454][123090] Updated weights for policy 1, policy_version 4067 (0.0007) [2023-12-25 23:36:05,515][123090] Updated weights for policy 1, policy_version 4077 (0.0009) [2023-12-25 23:36:05,569][123090] Updated weights for policy 1, policy_version 4088 (0.0008) [2023-12-25 23:36:05,928][123091] Updated weights for policy 0, policy_version 4101 (0.0005) [2023-12-25 23:36:05,973][123091] Updated weights for policy 0, policy_version 4111 (0.0005) [2023-12-25 23:36:06,030][123091] Updated weights for policy 0, policy_version 4121 (0.0005) [2023-12-25 23:36:06,372][123090] Updated weights for policy 1, policy_version 4098 (0.0009) [2023-12-25 23:36:06,436][123090] Updated weights for policy 1, policy_version 4108 (0.0010) [2023-12-25 23:36:06,503][123090] Updated weights for policy 1, policy_version 4118 (0.0010) [2023-12-25 23:36:06,574][123090] Updated weights for policy 1, policy_version 4128 (0.0010) [2023-12-25 23:36:06,699][123091] Updated weights for policy 0, policy_version 4131 (0.0005) [2023-12-25 23:36:06,772][123091] Updated weights for policy 0, policy_version 4141 (0.0006) [2023-12-25 23:36:06,838][123091] Updated weights for policy 0, policy_version 4151 (0.0008) [2023-12-25 23:36:07,327][123090] Updated weights for policy 1, policy_version 4138 (0.0006) [2023-12-25 23:36:07,396][123090] Updated weights for policy 1, policy_version 4148 (0.0010) [2023-12-25 23:36:07,458][123090] Updated weights for policy 1, policy_version 4158 (0.0010) [2023-12-25 23:36:07,679][123091] Updated weights for policy 0, policy_version 4161 (0.0009) [2023-12-25 23:36:07,737][123091] Updated weights for policy 0, policy_version 4171 (0.0005) [2023-12-25 23:36:07,802][123091] Updated weights for policy 0, policy_version 4181 (0.0005) [2023-12-25 23:36:07,864][123091] Updated weights for policy 0, policy_version 4191 (0.0005) [2023-12-25 23:36:08,103][123090] Updated weights for policy 1, policy_version 4168 (0.0006) [2023-12-25 23:36:08,151][123090] Updated weights for policy 1, policy_version 4178 (0.0005) [2023-12-25 23:36:08,210][123090] Updated weights for policy 1, policy_version 4188 (0.0005) [2023-12-25 23:36:08,537][123091] Updated weights for policy 0, policy_version 4201 (0.0010) [2023-12-25 23:36:08,585][123091] Updated weights for policy 0, policy_version 4211 (0.0010) [2023-12-25 23:36:08,629][123091] Updated weights for policy 0, policy_version 4221 (0.0010) [2023-12-25 23:36:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17236.0). Total num frames: 2154496. Throughput: 0: 8924.6, 1: 8798.8. Samples: 2126176. Policy #0 lag: (min: 9.0, avg: 23.1, max: 41.0) [2023-12-25 23:36:08,785][121949] Avg episode reward: [(0, '894.354'), (1, '885.711')] [2023-12-25 23:36:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000004224_1081344.pth... [2023-12-25 23:36:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000004192_1073152.pth... [2023-12-25 23:36:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000003168_811008.pth [2023-12-25 23:36:08,795][123008] Saving new best policy, reward=885.711! [2023-12-25 23:36:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000003168_811008.pth [2023-12-25 23:36:08,797][123007] Saving new best policy, reward=894.354! [2023-12-25 23:36:08,897][123090] Updated weights for policy 1, policy_version 4198 (0.0006) [2023-12-25 23:36:08,970][123090] Updated weights for policy 1, policy_version 4208 (0.0007) [2023-12-25 23:36:09,038][123090] Updated weights for policy 1, policy_version 4218 (0.0008) [2023-12-25 23:36:09,478][123091] Updated weights for policy 0, policy_version 4231 (0.0008) [2023-12-25 23:36:09,535][123091] Updated weights for policy 0, policy_version 4241 (0.0006) [2023-12-25 23:36:09,592][123091] Updated weights for policy 0, policy_version 4251 (0.0005) [2023-12-25 23:36:09,874][123090] Updated weights for policy 1, policy_version 4228 (0.0009) [2023-12-25 23:36:09,937][123090] Updated weights for policy 1, policy_version 4238 (0.0009) [2023-12-25 23:36:10,009][123090] Updated weights for policy 1, policy_version 4248 (0.0009) [2023-12-25 23:36:10,379][123091] Updated weights for policy 0, policy_version 4261 (0.0009) [2023-12-25 23:36:10,450][123091] Updated weights for policy 0, policy_version 4271 (0.0010) [2023-12-25 23:36:10,498][123091] Updated weights for policy 0, policy_version 4281 (0.0009) [2023-12-25 23:36:10,835][123090] Updated weights for policy 1, policy_version 4258 (0.0008) [2023-12-25 23:36:10,886][123090] Updated weights for policy 1, policy_version 4268 (0.0006) [2023-12-25 23:36:10,937][123090] Updated weights for policy 1, policy_version 4278 (0.0005) [2023-12-25 23:36:10,995][123090] Updated weights for policy 1, policy_version 4288 (0.0005) [2023-12-25 23:36:11,268][123091] Updated weights for policy 0, policy_version 4291 (0.0009) [2023-12-25 23:36:11,335][123091] Updated weights for policy 0, policy_version 4301 (0.0010) [2023-12-25 23:36:11,406][123091] Updated weights for policy 0, policy_version 4311 (0.0010) [2023-12-25 23:36:11,826][123090] Updated weights for policy 1, policy_version 4298 (0.0011) [2023-12-25 23:36:11,890][123090] Updated weights for policy 1, policy_version 4308 (0.0011) [2023-12-25 23:36:11,963][123090] Updated weights for policy 1, policy_version 4318 (0.0009) [2023-12-25 23:36:12,203][123091] Updated weights for policy 0, policy_version 4321 (0.0009) [2023-12-25 23:36:12,267][123091] Updated weights for policy 0, policy_version 4331 (0.0008) [2023-12-25 23:36:12,329][123091] Updated weights for policy 0, policy_version 4341 (0.0010) [2023-12-25 23:36:12,397][123091] Updated weights for policy 0, policy_version 4351 (0.0009) [2023-12-25 23:36:12,782][123090] Updated weights for policy 1, policy_version 4328 (0.0010) [2023-12-25 23:36:12,839][123090] Updated weights for policy 1, policy_version 4338 (0.0008) [2023-12-25 23:36:12,886][123090] Updated weights for policy 1, policy_version 4348 (0.0006) [2023-12-25 23:36:13,190][123091] Updated weights for policy 0, policy_version 4361 (0.0006) [2023-12-25 23:36:13,244][123091] Updated weights for policy 0, policy_version 4371 (0.0005) [2023-12-25 23:36:13,305][123091] Updated weights for policy 0, policy_version 4381 (0.0005) [2023-12-25 23:36:13,675][123090] Updated weights for policy 1, policy_version 4358 (0.0009) [2023-12-25 23:36:13,737][123090] Updated weights for policy 1, policy_version 4368 (0.0010) [2023-12-25 23:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17203.2). Total num frames: 2236416. Throughput: 0: 8938.0, 1: 8791.6. Samples: 2233100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:36:13,784][121949] Avg episode reward: [(0, '859.150'), (1, '903.025')] [2023-12-25 23:36:13,796][123090] Updated weights for policy 1, policy_version 4378 (0.0010) [2023-12-25 23:36:13,836][123008] Saving new best policy, reward=903.025! [2023-12-25 23:36:14,001][123091] Updated weights for policy 0, policy_version 4391 (0.0006) [2023-12-25 23:36:14,049][123091] Updated weights for policy 0, policy_version 4401 (0.0009) [2023-12-25 23:36:14,098][123091] Updated weights for policy 0, policy_version 4411 (0.0009) [2023-12-25 23:36:14,607][123090] Updated weights for policy 1, policy_version 4388 (0.0008) [2023-12-25 23:36:14,678][123090] Updated weights for policy 1, policy_version 4398 (0.0009) [2023-12-25 23:36:14,743][123090] Updated weights for policy 1, policy_version 4408 (0.0011) [2023-12-25 23:36:14,935][123091] Updated weights for policy 0, policy_version 4421 (0.0010) [2023-12-25 23:36:14,998][123091] Updated weights for policy 0, policy_version 4431 (0.0009) [2023-12-25 23:36:15,068][123091] Updated weights for policy 0, policy_version 4441 (0.0009) [2023-12-25 23:36:15,544][123090] Updated weights for policy 1, policy_version 4418 (0.0011) [2023-12-25 23:36:15,616][123090] Updated weights for policy 1, policy_version 4428 (0.0010) [2023-12-25 23:36:15,683][123090] Updated weights for policy 1, policy_version 4438 (0.0011) [2023-12-25 23:36:15,751][123090] Updated weights for policy 1, policy_version 4448 (0.0011) [2023-12-25 23:36:15,906][123091] Updated weights for policy 0, policy_version 4451 (0.0009) [2023-12-25 23:36:15,955][123091] Updated weights for policy 0, policy_version 4461 (0.0009) [2023-12-25 23:36:16,008][123091] Updated weights for policy 0, policy_version 4471 (0.0008) [2023-12-25 23:36:16,552][123090] Updated weights for policy 1, policy_version 4458 (0.0010) [2023-12-25 23:36:16,603][123090] Updated weights for policy 1, policy_version 4468 (0.0010) [2023-12-25 23:36:16,666][123090] Updated weights for policy 1, policy_version 4478 (0.0010) [2023-12-25 23:36:16,861][123091] Updated weights for policy 0, policy_version 4481 (0.0009) [2023-12-25 23:36:16,917][123091] Updated weights for policy 0, policy_version 4491 (0.0005) [2023-12-25 23:36:16,977][123091] Updated weights for policy 0, policy_version 4501 (0.0006) [2023-12-25 23:36:17,034][123091] Updated weights for policy 0, policy_version 4511 (0.0009) [2023-12-25 23:36:17,489][123090] Updated weights for policy 1, policy_version 4488 (0.0010) [2023-12-25 23:36:17,548][123090] Updated weights for policy 1, policy_version 4498 (0.0010) [2023-12-25 23:36:17,611][123090] Updated weights for policy 1, policy_version 4508 (0.0010) [2023-12-25 23:36:17,777][123091] Updated weights for policy 0, policy_version 4521 (0.0010) [2023-12-25 23:36:17,843][123091] Updated weights for policy 0, policy_version 4531 (0.0011) [2023-12-25 23:36:17,906][123091] Updated weights for policy 0, policy_version 4541 (0.0011) [2023-12-25 23:36:18,442][123090] Updated weights for policy 1, policy_version 4518 (0.0010) [2023-12-25 23:36:18,505][123090] Updated weights for policy 1, policy_version 4528 (0.0010) [2023-12-25 23:36:18,559][123090] Updated weights for policy 1, policy_version 4538 (0.0010) [2023-12-25 23:36:18,706][123091] Updated weights for policy 0, policy_version 4551 (0.0009) [2023-12-25 23:36:18,767][123091] Updated weights for policy 0, policy_version 4561 (0.0009) [2023-12-25 23:36:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17233.6). Total num frames: 2326528. Throughput: 0: 8854.9, 1: 8738.6. Samples: 2338472. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-25 23:36:18,785][121949] Avg episode reward: [(0, '925.702'), (1, '990.358')] [2023-12-25 23:36:18,786][123008] Saving new best policy, reward=990.358! [2023-12-25 23:36:18,825][123091] Updated weights for policy 0, policy_version 4571 (0.0009) [2023-12-25 23:36:18,853][123007] Saving new best policy, reward=925.702! [2023-12-25 23:36:19,402][123090] Updated weights for policy 1, policy_version 4548 (0.0011) [2023-12-25 23:36:19,462][123090] Updated weights for policy 1, policy_version 4558 (0.0010) [2023-12-25 23:36:19,535][123090] Updated weights for policy 1, policy_version 4568 (0.0010) [2023-12-25 23:36:19,676][123091] Updated weights for policy 0, policy_version 4581 (0.0009) [2023-12-25 23:36:19,736][123091] Updated weights for policy 0, policy_version 4591 (0.0009) [2023-12-25 23:36:19,804][123091] Updated weights for policy 0, policy_version 4601 (0.0009) [2023-12-25 23:36:20,389][123090] Updated weights for policy 1, policy_version 4578 (0.0011) [2023-12-25 23:36:20,452][123090] Updated weights for policy 1, policy_version 4588 (0.0010) [2023-12-25 23:36:20,506][123090] Updated weights for policy 1, policy_version 4598 (0.0008) [2023-12-25 23:36:20,561][123090] Updated weights for policy 1, policy_version 4608 (0.0009) [2023-12-25 23:36:20,642][123091] Updated weights for policy 0, policy_version 4611 (0.0007) [2023-12-25 23:36:20,710][123091] Updated weights for policy 0, policy_version 4621 (0.0010) [2023-12-25 23:36:20,770][123091] Updated weights for policy 0, policy_version 4631 (0.0009) [2023-12-25 23:36:21,461][123090] Updated weights for policy 1, policy_version 4618 (0.0009) [2023-12-25 23:36:21,515][123090] Updated weights for policy 1, policy_version 4628 (0.0009) [2023-12-25 23:36:21,563][123090] Updated weights for policy 1, policy_version 4638 (0.0009) [2023-12-25 23:36:21,624][123091] Updated weights for policy 0, policy_version 4641 (0.0009) [2023-12-25 23:36:21,685][123091] Updated weights for policy 0, policy_version 4651 (0.0010) [2023-12-25 23:36:21,752][123091] Updated weights for policy 0, policy_version 4661 (0.0010) [2023-12-25 23:36:21,819][123091] Updated weights for policy 0, policy_version 4671 (0.0010) [2023-12-25 23:36:22,471][123090] Updated weights for policy 1, policy_version 4648 (0.0011) [2023-12-25 23:36:22,543][123090] Updated weights for policy 1, policy_version 4658 (0.0011) [2023-12-25 23:36:22,608][123090] Updated weights for policy 1, policy_version 4668 (0.0011) [2023-12-25 23:36:22,702][123091] Updated weights for policy 0, policy_version 4681 (0.0006) [2023-12-25 23:36:22,769][123091] Updated weights for policy 0, policy_version 4691 (0.0005) [2023-12-25 23:36:22,836][123091] Updated weights for policy 0, policy_version 4701 (0.0005) [2023-12-25 23:36:23,371][123090] Updated weights for policy 1, policy_version 4678 (0.0009) [2023-12-25 23:36:23,424][123090] Updated weights for policy 1, policy_version 4688 (0.0010) [2023-12-25 23:36:23,485][123090] Updated weights for policy 1, policy_version 4698 (0.0008) [2023-12-25 23:36:23,501][123091] Updated weights for policy 0, policy_version 4711 (0.0009) [2023-12-25 23:36:23,557][123091] Updated weights for policy 0, policy_version 4721 (0.0008) [2023-12-25 23:36:23,613][123091] Updated weights for policy 0, policy_version 4731 (0.0010) [2023-12-25 23:36:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17261.7). Total num frames: 2416640. Throughput: 0: 8826.8, 1: 8687.0. Samples: 2388324. Policy #0 lag: (min: 31.0, avg: 31.2, max: 40.0) [2023-12-25 23:36:23,785][121949] Avg episode reward: [(0, '966.869'), (1, '1092.209')] [2023-12-25 23:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000004736_1212416.pth... [2023-12-25 23:36:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000004704_1204224.pth... [2023-12-25 23:36:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000003680_942080.pth [2023-12-25 23:36:23,795][123007] Saving new best policy, reward=966.869! [2023-12-25 23:36:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000003680_942080.pth [2023-12-25 23:36:23,796][123008] Saving new best policy, reward=1092.209! [2023-12-25 23:36:24,331][123091] Updated weights for policy 0, policy_version 4741 (0.0008) [2023-12-25 23:36:24,358][123090] Updated weights for policy 1, policy_version 4708 (0.0009) [2023-12-25 23:36:24,397][123091] Updated weights for policy 0, policy_version 4751 (0.0006) [2023-12-25 23:36:24,426][123090] Updated weights for policy 1, policy_version 4718 (0.0011) [2023-12-25 23:36:24,462][123091] Updated weights for policy 0, policy_version 4761 (0.0006) [2023-12-25 23:36:24,490][123090] Updated weights for policy 1, policy_version 4728 (0.0007) [2023-12-25 23:36:25,161][123091] Updated weights for policy 0, policy_version 4771 (0.0006) [2023-12-25 23:36:25,226][123091] Updated weights for policy 0, policy_version 4781 (0.0010) [2023-12-25 23:36:25,283][123091] Updated weights for policy 0, policy_version 4791 (0.0010) [2023-12-25 23:36:25,291][123090] Updated weights for policy 1, policy_version 4738 (0.0010) [2023-12-25 23:36:25,348][123090] Updated weights for policy 1, policy_version 4748 (0.0005) [2023-12-25 23:36:25,394][123090] Updated weights for policy 1, policy_version 4758 (0.0005) [2023-12-25 23:36:25,445][123090] Updated weights for policy 1, policy_version 4768 (0.0005) [2023-12-25 23:36:26,128][123090] Updated weights for policy 1, policy_version 4778 (0.0008) [2023-12-25 23:36:26,196][123090] Updated weights for policy 1, policy_version 4788 (0.0011) [2023-12-25 23:36:26,208][123091] Updated weights for policy 0, policy_version 4801 (0.0009) [2023-12-25 23:36:26,252][123090] Updated weights for policy 1, policy_version 4798 (0.0010) [2023-12-25 23:36:26,271][123091] Updated weights for policy 0, policy_version 4811 (0.0011) [2023-12-25 23:36:26,335][123091] Updated weights for policy 0, policy_version 4821 (0.0011) [2023-12-25 23:36:26,395][123091] Updated weights for policy 0, policy_version 4831 (0.0011) [2023-12-25 23:36:27,035][123090] Updated weights for policy 1, policy_version 4808 (0.0010) [2023-12-25 23:36:27,094][123090] Updated weights for policy 1, policy_version 4818 (0.0010) [2023-12-25 23:36:27,144][123091] Updated weights for policy 0, policy_version 4841 (0.0009) [2023-12-25 23:36:27,151][123090] Updated weights for policy 1, policy_version 4828 (0.0006) [2023-12-25 23:36:27,194][123091] Updated weights for policy 0, policy_version 4851 (0.0009) [2023-12-25 23:36:27,239][123091] Updated weights for policy 0, policy_version 4861 (0.0008) [2023-12-25 23:36:27,918][123090] Updated weights for policy 1, policy_version 4838 (0.0009) [2023-12-25 23:36:27,977][123090] Updated weights for policy 1, policy_version 4848 (0.0009) [2023-12-25 23:36:28,055][123090] Updated weights for policy 1, policy_version 4858 (0.0009) [2023-12-25 23:36:28,135][123091] Updated weights for policy 0, policy_version 4871 (0.0010) [2023-12-25 23:36:28,186][123091] Updated weights for policy 0, policy_version 4882 (0.0009) [2023-12-25 23:36:28,236][123091] Updated weights for policy 0, policy_version 4892 (0.0010) [2023-12-25 23:36:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17231.5). Total num frames: 2498560. Throughput: 0: 8908.3, 1: 8752.2. Samples: 2495664. Policy #0 lag: (min: 31.0, avg: 32.7, max: 62.0) [2023-12-25 23:36:28,785][121949] Avg episode reward: [(0, '1036.277'), (1, '1067.549')] [2023-12-25 23:36:28,786][123007] Saving new best policy, reward=1036.277! [2023-12-25 23:36:28,841][123090] Updated weights for policy 1, policy_version 4868 (0.0009) [2023-12-25 23:36:28,895][123090] Updated weights for policy 1, policy_version 4878 (0.0009) [2023-12-25 23:36:28,956][123090] Updated weights for policy 1, policy_version 4888 (0.0010) [2023-12-25 23:36:29,111][123091] Updated weights for policy 0, policy_version 4902 (0.0010) [2023-12-25 23:36:29,173][123091] Updated weights for policy 0, policy_version 4912 (0.0009) [2023-12-25 23:36:29,244][123091] Updated weights for policy 0, policy_version 4922 (0.0009) [2023-12-25 23:36:29,710][123090] Updated weights for policy 1, policy_version 4898 (0.0009) [2023-12-25 23:36:29,777][123090] Updated weights for policy 1, policy_version 4908 (0.0009) [2023-12-25 23:36:29,836][123090] Updated weights for policy 1, policy_version 4918 (0.0008) [2023-12-25 23:36:29,909][123090] Updated weights for policy 1, policy_version 4928 (0.0009) [2023-12-25 23:36:30,103][123091] Updated weights for policy 0, policy_version 4932 (0.0010) [2023-12-25 23:36:30,167][123091] Updated weights for policy 0, policy_version 4942 (0.0009) [2023-12-25 23:36:30,222][123091] Updated weights for policy 0, policy_version 4952 (0.0009) [2023-12-25 23:36:30,690][123090] Updated weights for policy 1, policy_version 4938 (0.0005) [2023-12-25 23:36:30,748][123090] Updated weights for policy 1, policy_version 4948 (0.0005) [2023-12-25 23:36:30,801][123090] Updated weights for policy 1, policy_version 4958 (0.0005) [2023-12-25 23:36:31,120][123091] Updated weights for policy 0, policy_version 4962 (0.0008) [2023-12-25 23:36:31,185][123091] Updated weights for policy 0, policy_version 4972 (0.0009) [2023-12-25 23:36:31,233][123091] Updated weights for policy 0, policy_version 4982 (0.0009) [2023-12-25 23:36:31,299][123091] Updated weights for policy 0, policy_version 4992 (0.0009) [2023-12-25 23:36:31,580][123090] Updated weights for policy 1, policy_version 4968 (0.0009) [2023-12-25 23:36:31,650][123090] Updated weights for policy 1, policy_version 4978 (0.0009) [2023-12-25 23:36:31,721][123090] Updated weights for policy 1, policy_version 4988 (0.0008) [2023-12-25 23:36:32,159][123091] Updated weights for policy 0, policy_version 5002 (0.0011) [2023-12-25 23:36:32,222][123091] Updated weights for policy 0, policy_version 5012 (0.0010) [2023-12-25 23:36:32,293][123091] Updated weights for policy 0, policy_version 5022 (0.0011) [2023-12-25 23:36:32,567][123090] Updated weights for policy 1, policy_version 4998 (0.0008) [2023-12-25 23:36:32,616][123090] Updated weights for policy 1, policy_version 5009 (0.0009) [2023-12-25 23:36:32,674][123090] Updated weights for policy 1, policy_version 5019 (0.0009) [2023-12-25 23:36:32,942][123091] Updated weights for policy 0, policy_version 5032 (0.0006) [2023-12-25 23:36:32,989][123091] Updated weights for policy 0, policy_version 5042 (0.0005) [2023-12-25 23:36:33,053][123091] Updated weights for policy 0, policy_version 5052 (0.0010) [2023-12-25 23:36:33,568][123090] Updated weights for policy 1, policy_version 5029 (0.0009) [2023-12-25 23:36:33,621][123090] Updated weights for policy 1, policy_version 5039 (0.0008) [2023-12-25 23:36:33,672][123090] Updated weights for policy 1, policy_version 5049 (0.0009) [2023-12-25 23:36:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17257.8). Total num frames: 2588672. Throughput: 0: 8792.7, 1: 8745.7. Samples: 2599644. Policy #0 lag: (min: 22.0, avg: 24.7, max: 54.0) [2023-12-25 23:36:33,785][121949] Avg episode reward: [(0, '990.552'), (1, '1087.470')] [2023-12-25 23:36:33,824][123091] Updated weights for policy 0, policy_version 5062 (0.0010) [2023-12-25 23:36:33,878][123091] Updated weights for policy 0, policy_version 5072 (0.0010) [2023-12-25 23:36:33,932][123091] Updated weights for policy 0, policy_version 5082 (0.0010) [2023-12-25 23:36:34,535][123090] Updated weights for policy 1, policy_version 5059 (0.0009) [2023-12-25 23:36:34,603][123090] Updated weights for policy 1, policy_version 5069 (0.0009) [2023-12-25 23:36:34,667][123090] Updated weights for policy 1, policy_version 5079 (0.0008) [2023-12-25 23:36:34,772][123091] Updated weights for policy 0, policy_version 5092 (0.0010) [2023-12-25 23:36:34,837][123091] Updated weights for policy 0, policy_version 5102 (0.0009) [2023-12-25 23:36:34,890][123091] Updated weights for policy 0, policy_version 5113 (0.0010) [2023-12-25 23:36:35,407][123090] Updated weights for policy 1, policy_version 5089 (0.0008) [2023-12-25 23:36:35,466][123090] Updated weights for policy 1, policy_version 5099 (0.0009) [2023-12-25 23:36:35,515][123090] Updated weights for policy 1, policy_version 5109 (0.0009) [2023-12-25 23:36:35,575][123090] Updated weights for policy 1, policy_version 5119 (0.0010) [2023-12-25 23:36:35,734][123091] Updated weights for policy 0, policy_version 5123 (0.0009) [2023-12-25 23:36:35,797][123091] Updated weights for policy 0, policy_version 5133 (0.0009) [2023-12-25 23:36:35,865][123091] Updated weights for policy 0, policy_version 5143 (0.0009) [2023-12-25 23:36:36,397][123090] Updated weights for policy 1, policy_version 5129 (0.0009) [2023-12-25 23:36:36,465][123090] Updated weights for policy 1, policy_version 5139 (0.0009) [2023-12-25 23:36:36,538][123090] Updated weights for policy 1, policy_version 5149 (0.0009) [2023-12-25 23:36:36,660][123091] Updated weights for policy 0, policy_version 5153 (0.0008) [2023-12-25 23:36:36,735][123091] Updated weights for policy 0, policy_version 5163 (0.0006) [2023-12-25 23:36:36,805][123091] Updated weights for policy 0, policy_version 5173 (0.0009) [2023-12-25 23:36:36,870][123091] Updated weights for policy 0, policy_version 5183 (0.0010) [2023-12-25 23:36:37,397][123090] Updated weights for policy 1, policy_version 5159 (0.0009) [2023-12-25 23:36:37,451][123090] Updated weights for policy 1, policy_version 5169 (0.0009) [2023-12-25 23:36:37,518][123090] Updated weights for policy 1, policy_version 5179 (0.0009) [2023-12-25 23:36:37,592][123091] Updated weights for policy 0, policy_version 5193 (0.0009) [2023-12-25 23:36:37,648][123091] Updated weights for policy 0, policy_version 5204 (0.0009) [2023-12-25 23:36:37,700][123091] Updated weights for policy 0, policy_version 5214 (0.0010) [2023-12-25 23:36:38,411][123090] Updated weights for policy 1, policy_version 5189 (0.0010) [2023-12-25 23:36:38,476][123090] Updated weights for policy 1, policy_version 5199 (0.0009) [2023-12-25 23:36:38,495][123091] Updated weights for policy 0, policy_version 5224 (0.0009) [2023-12-25 23:36:38,537][123090] Updated weights for policy 1, policy_version 5209 (0.0009) [2023-12-25 23:36:38,557][123091] Updated weights for policy 0, policy_version 5234 (0.0007) [2023-12-25 23:36:38,626][123091] Updated weights for policy 0, policy_version 5244 (0.0008) [2023-12-25 23:36:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17282.5). Total num frames: 2678784. Throughput: 0: 8772.5, 1: 8758.9. Samples: 2650904. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-25 23:36:38,785][121949] Avg episode reward: [(0, '1077.406'), (1, '1160.797')] [2023-12-25 23:36:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000005248_1343488.pth... [2023-12-25 23:36:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000005216_1335296.pth... [2023-12-25 23:36:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000004224_1081344.pth [2023-12-25 23:36:38,797][123007] Saving new best policy, reward=1077.406! [2023-12-25 23:36:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000004192_1073152.pth [2023-12-25 23:36:38,803][123008] Saving new best policy, reward=1160.797! [2023-12-25 23:36:39,354][123091] Updated weights for policy 0, policy_version 5254 (0.0009) [2023-12-25 23:36:39,421][123091] Updated weights for policy 0, policy_version 5264 (0.0008) [2023-12-25 23:36:39,426][123090] Updated weights for policy 1, policy_version 5219 (0.0009) [2023-12-25 23:36:39,482][123091] Updated weights for policy 0, policy_version 5274 (0.0006) [2023-12-25 23:36:39,485][123090] Updated weights for policy 1, policy_version 5229 (0.0008) [2023-12-25 23:36:39,554][123090] Updated weights for policy 1, policy_version 5239 (0.0010) [2023-12-25 23:36:40,297][123091] Updated weights for policy 0, policy_version 5284 (0.0008) [2023-12-25 23:36:40,364][123091] Updated weights for policy 0, policy_version 5294 (0.0009) [2023-12-25 23:36:40,390][123090] Updated weights for policy 1, policy_version 5249 (0.0009) [2023-12-25 23:36:40,432][123091] Updated weights for policy 0, policy_version 5304 (0.0009) [2023-12-25 23:36:40,440][123090] Updated weights for policy 1, policy_version 5259 (0.0009) [2023-12-25 23:36:40,502][123090] Updated weights for policy 1, policy_version 5269 (0.0007) [2023-12-25 23:36:40,560][123090] Updated weights for policy 1, policy_version 5279 (0.0010) [2023-12-25 23:36:41,260][123091] Updated weights for policy 0, policy_version 5314 (0.0009) [2023-12-25 23:36:41,328][123091] Updated weights for policy 0, policy_version 5324 (0.0010) [2023-12-25 23:36:41,399][123091] Updated weights for policy 0, policy_version 5334 (0.0010) [2023-12-25 23:36:41,455][123091] Updated weights for policy 0, policy_version 5344 (0.0007) [2023-12-25 23:36:41,459][123090] Updated weights for policy 1, policy_version 5289 (0.0008) [2023-12-25 23:36:41,524][123090] Updated weights for policy 1, policy_version 5299 (0.0008) [2023-12-25 23:36:41,589][123090] Updated weights for policy 1, policy_version 5309 (0.0008) [2023-12-25 23:36:42,246][123091] Updated weights for policy 0, policy_version 5354 (0.0011) [2023-12-25 23:36:42,312][123091] Updated weights for policy 0, policy_version 5364 (0.0011) [2023-12-25 23:36:42,323][123090] Updated weights for policy 1, policy_version 5319 (0.0008) [2023-12-25 23:36:42,384][123091] Updated weights for policy 0, policy_version 5374 (0.0010) [2023-12-25 23:36:42,395][123090] Updated weights for policy 1, policy_version 5329 (0.0009) [2023-12-25 23:36:42,456][123090] Updated weights for policy 1, policy_version 5339 (0.0009) [2023-12-25 23:36:43,218][123091] Updated weights for policy 0, policy_version 5384 (0.0011) [2023-12-25 23:36:43,273][123091] Updated weights for policy 0, policy_version 5394 (0.0010) [2023-12-25 23:36:43,311][123090] Updated weights for policy 1, policy_version 5349 (0.0009) [2023-12-25 23:36:43,336][123091] Updated weights for policy 0, policy_version 5404 (0.0010) [2023-12-25 23:36:43,373][123090] Updated weights for policy 1, policy_version 5359 (0.0008) [2023-12-25 23:36:43,428][123090] Updated weights for policy 1, policy_version 5369 (0.0009) [2023-12-25 23:36:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17254.4). Total num frames: 2760704. Throughput: 0: 8841.9, 1: 8682.7. Samples: 2753168. Policy #0 lag: (min: 3.0, avg: 4.5, max: 25.0) [2023-12-25 23:36:43,785][121949] Avg episode reward: [(0, '1062.192'), (1, '1304.359')] [2023-12-25 23:36:43,787][123008] Saving new best policy, reward=1304.359! [2023-12-25 23:36:44,163][123091] Updated weights for policy 0, policy_version 5414 (0.0010) [2023-12-25 23:36:44,211][123091] Updated weights for policy 0, policy_version 5424 (0.0009) [2023-12-25 23:36:44,262][123091] Updated weights for policy 0, policy_version 5434 (0.0009) [2023-12-25 23:36:44,275][123090] Updated weights for policy 1, policy_version 5379 (0.0008) [2023-12-25 23:36:44,334][123090] Updated weights for policy 1, policy_version 5389 (0.0008) [2023-12-25 23:36:44,383][123090] Updated weights for policy 1, policy_version 5399 (0.0009) [2023-12-25 23:36:45,135][123091] Updated weights for policy 0, policy_version 5444 (0.0009) [2023-12-25 23:36:45,204][123090] Updated weights for policy 1, policy_version 5409 (0.0009) [2023-12-25 23:36:45,205][123091] Updated weights for policy 0, policy_version 5454 (0.0006) [2023-12-25 23:36:45,273][123090] Updated weights for policy 1, policy_version 5419 (0.0008) [2023-12-25 23:36:45,280][123091] Updated weights for policy 0, policy_version 5464 (0.0007) [2023-12-25 23:36:45,342][123090] Updated weights for policy 1, policy_version 5429 (0.0008) [2023-12-25 23:36:45,414][123090] Updated weights for policy 1, policy_version 5439 (0.0008) [2023-12-25 23:36:46,102][123090] Updated weights for policy 1, policy_version 5449 (0.0008) [2023-12-25 23:36:46,155][123090] Updated weights for policy 1, policy_version 5459 (0.0006) [2023-12-25 23:36:46,156][123091] Updated weights for policy 0, policy_version 5474 (0.0009) [2023-12-25 23:36:46,208][123090] Updated weights for policy 1, policy_version 5469 (0.0005) [2023-12-25 23:36:46,209][123091] Updated weights for policy 0, policy_version 5485 (0.0009) [2023-12-25 23:36:46,281][123091] Updated weights for policy 0, policy_version 5495 (0.0006) [2023-12-25 23:36:46,906][123090] Updated weights for policy 1, policy_version 5479 (0.0005) [2023-12-25 23:36:46,975][123090] Updated weights for policy 1, policy_version 5489 (0.0008) [2023-12-25 23:36:47,040][123090] Updated weights for policy 1, policy_version 5499 (0.0007) [2023-12-25 23:36:47,054][123091] Updated weights for policy 0, policy_version 5505 (0.0006) [2023-12-25 23:36:47,130][123091] Updated weights for policy 0, policy_version 5515 (0.0006) [2023-12-25 23:36:47,197][123091] Updated weights for policy 0, policy_version 5525 (0.0005) [2023-12-25 23:36:47,263][123091] Updated weights for policy 0, policy_version 5535 (0.0008) [2023-12-25 23:36:47,751][123090] Updated weights for policy 1, policy_version 5509 (0.0007) [2023-12-25 23:36:47,816][123090] Updated weights for policy 1, policy_version 5519 (0.0008) [2023-12-25 23:36:47,887][123090] Updated weights for policy 1, policy_version 5529 (0.0007) [2023-12-25 23:36:48,083][123091] Updated weights for policy 0, policy_version 5545 (0.0009) [2023-12-25 23:36:48,135][123091] Updated weights for policy 0, policy_version 5555 (0.0009) [2023-12-25 23:36:48,187][123091] Updated weights for policy 0, policy_version 5566 (0.0010) [2023-12-25 23:36:48,576][123090] Updated weights for policy 1, policy_version 5539 (0.0006) [2023-12-25 23:36:48,641][123090] Updated weights for policy 1, policy_version 5549 (0.0006) [2023-12-25 23:36:48,694][123090] Updated weights for policy 1, policy_version 5559 (0.0005) [2023-12-25 23:36:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17277.7). Total num frames: 2850816. Throughput: 0: 8773.2, 1: 8745.4. Samples: 2859588. Policy #0 lag: (min: 3.0, avg: 4.5, max: 25.0) [2023-12-25 23:36:48,785][121949] Avg episode reward: [(0, '1057.465'), (1, '1141.453')] [2023-12-25 23:36:49,122][123091] Updated weights for policy 0, policy_version 5576 (0.0009) [2023-12-25 23:36:49,175][123091] Updated weights for policy 0, policy_version 5586 (0.0009) [2023-12-25 23:36:49,226][123091] Updated weights for policy 0, policy_version 5596 (0.0009) [2023-12-25 23:36:49,489][123090] Updated weights for policy 1, policy_version 5569 (0.0009) [2023-12-25 23:36:49,544][123090] Updated weights for policy 1, policy_version 5580 (0.0010) [2023-12-25 23:36:49,598][123090] Updated weights for policy 1, policy_version 5590 (0.0010) [2023-12-25 23:36:49,960][123091] Updated weights for policy 0, policy_version 5606 (0.0010) [2023-12-25 23:36:50,016][123091] Updated weights for policy 0, policy_version 5616 (0.0009) [2023-12-25 23:36:50,074][123091] Updated weights for policy 0, policy_version 5626 (0.0005) [2023-12-25 23:36:50,473][123090] Updated weights for policy 1, policy_version 5601 (0.0011) [2023-12-25 23:36:50,533][123090] Updated weights for policy 1, policy_version 5611 (0.0010) [2023-12-25 23:36:50,601][123090] Updated weights for policy 1, policy_version 5622 (0.0010) [2023-12-25 23:36:50,674][123090] Updated weights for policy 1, policy_version 5632 (0.0006) [2023-12-25 23:36:50,788][123091] Updated weights for policy 0, policy_version 5636 (0.0008) [2023-12-25 23:36:50,844][123091] Updated weights for policy 0, policy_version 5646 (0.0010) [2023-12-25 23:36:50,906][123091] Updated weights for policy 0, policy_version 5656 (0.0011) [2023-12-25 23:36:51,423][123090] Updated weights for policy 1, policy_version 5642 (0.0008) [2023-12-25 23:36:51,473][123090] Updated weights for policy 1, policy_version 5652 (0.0008) [2023-12-25 23:36:51,527][123090] Updated weights for policy 1, policy_version 5662 (0.0009) [2023-12-25 23:36:51,686][123091] Updated weights for policy 0, policy_version 5666 (0.0007) [2023-12-25 23:36:51,753][123091] Updated weights for policy 0, policy_version 5676 (0.0010) [2023-12-25 23:36:51,812][123091] Updated weights for policy 0, policy_version 5687 (0.0010) [2023-12-25 23:36:52,438][123090] Updated weights for policy 1, policy_version 5672 (0.0007) [2023-12-25 23:36:52,501][123090] Updated weights for policy 1, policy_version 5682 (0.0005) [2023-12-25 23:36:52,561][123090] Updated weights for policy 1, policy_version 5692 (0.0009) [2023-12-25 23:36:52,659][123091] Updated weights for policy 0, policy_version 5697 (0.0010) [2023-12-25 23:36:52,734][123091] Updated weights for policy 0, policy_version 5707 (0.0010) [2023-12-25 23:36:52,796][123091] Updated weights for policy 0, policy_version 5717 (0.0010) [2023-12-25 23:36:52,860][123091] Updated weights for policy 0, policy_version 5727 (0.0009) [2023-12-25 23:36:53,390][123090] Updated weights for policy 1, policy_version 5702 (0.0009) [2023-12-25 23:36:53,450][123090] Updated weights for policy 1, policy_version 5712 (0.0009) [2023-12-25 23:36:53,512][123090] Updated weights for policy 1, policy_version 5722 (0.0009) [2023-12-25 23:36:53,597][123091] Updated weights for policy 0, policy_version 5737 (0.0006) [2023-12-25 23:36:53,645][123091] Updated weights for policy 0, policy_version 5747 (0.0006) [2023-12-25 23:36:53,702][123091] Updated weights for policy 0, policy_version 5757 (0.0005) [2023-12-25 23:36:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17299.6). Total num frames: 2940928. Throughput: 0: 8746.4, 1: 8745.2. Samples: 2913304. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:36:53,785][121949] Avg episode reward: [(0, '1054.864'), (1, '1313.215')] [2023-12-25 23:36:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000005728_1466368.pth... [2023-12-25 23:36:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000005760_1474560.pth... [2023-12-25 23:36:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000004704_1204224.pth [2023-12-25 23:36:53,797][123008] Saving new best policy, reward=1313.215! [2023-12-25 23:36:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000004736_1212416.pth [2023-12-25 23:36:54,365][123091] Updated weights for policy 0, policy_version 5767 (0.0009) [2023-12-25 23:36:54,425][123090] Updated weights for policy 1, policy_version 5732 (0.0008) [2023-12-25 23:36:54,425][123091] Updated weights for policy 0, policy_version 5777 (0.0010) [2023-12-25 23:36:54,489][123090] Updated weights for policy 1, policy_version 5742 (0.0008) [2023-12-25 23:36:54,490][123091] Updated weights for policy 0, policy_version 5787 (0.0011) [2023-12-25 23:36:54,547][123090] Updated weights for policy 1, policy_version 5752 (0.0008) [2023-12-25 23:36:55,172][123091] Updated weights for policy 0, policy_version 5797 (0.0008) [2023-12-25 23:36:55,227][123091] Updated weights for policy 0, policy_version 5807 (0.0005) [2023-12-25 23:36:55,287][123091] Updated weights for policy 0, policy_version 5817 (0.0006) [2023-12-25 23:36:55,307][123090] Updated weights for policy 1, policy_version 5762 (0.0008) [2023-12-25 23:36:55,374][123090] Updated weights for policy 1, policy_version 5772 (0.0005) [2023-12-25 23:36:55,426][123090] Updated weights for policy 1, policy_version 5782 (0.0005) [2023-12-25 23:36:55,491][123090] Updated weights for policy 1, policy_version 5792 (0.0005) [2023-12-25 23:36:55,950][123091] Updated weights for policy 0, policy_version 5827 (0.0006) [2023-12-25 23:36:56,006][123091] Updated weights for policy 0, policy_version 5837 (0.0006) [2023-12-25 23:36:56,063][123091] Updated weights for policy 0, policy_version 5847 (0.0007) [2023-12-25 23:36:56,206][123090] Updated weights for policy 1, policy_version 5802 (0.0009) [2023-12-25 23:36:56,278][123090] Updated weights for policy 1, policy_version 5812 (0.0005) [2023-12-25 23:36:56,359][123090] Updated weights for policy 1, policy_version 5822 (0.0005) [2023-12-25 23:36:56,813][123091] Updated weights for policy 0, policy_version 5857 (0.0009) [2023-12-25 23:36:56,879][123091] Updated weights for policy 0, policy_version 5867 (0.0006) [2023-12-25 23:36:56,940][123091] Updated weights for policy 0, policy_version 5877 (0.0006) [2023-12-25 23:36:56,960][123090] Updated weights for policy 1, policy_version 5832 (0.0005) [2023-12-25 23:36:56,990][123091] Updated weights for policy 0, policy_version 5887 (0.0008) [2023-12-25 23:36:57,014][123090] Updated weights for policy 1, policy_version 5842 (0.0005) [2023-12-25 23:36:57,063][123090] Updated weights for policy 1, policy_version 5852 (0.0005) [2023-12-25 23:36:57,794][123091] Updated weights for policy 0, policy_version 5897 (0.0010) [2023-12-25 23:36:57,826][123090] Updated weights for policy 1, policy_version 5862 (0.0006) [2023-12-25 23:36:57,846][123091] Updated weights for policy 0, policy_version 5907 (0.0010) [2023-12-25 23:36:57,875][123090] Updated weights for policy 1, policy_version 5872 (0.0008) [2023-12-25 23:36:57,909][123091] Updated weights for policy 0, policy_version 5917 (0.0008) [2023-12-25 23:36:57,925][123090] Updated weights for policy 1, policy_version 5882 (0.0007) [2023-12-25 23:36:58,713][123091] Updated weights for policy 0, policy_version 5927 (0.0009) [2023-12-25 23:36:58,776][123091] Updated weights for policy 0, policy_version 5937 (0.0008) [2023-12-25 23:36:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17273.4). Total num frames: 3022848. Throughput: 0: 8831.5, 1: 8749.3. Samples: 3024240. Policy #0 lag: (min: 31.0, avg: 38.5, max: 63.0) [2023-12-25 23:36:58,785][121949] Avg episode reward: [(0, '1084.443'), (1, '1291.018')] [2023-12-25 23:36:58,831][123091] Updated weights for policy 0, policy_version 5947 (0.0006) [2023-12-25 23:36:58,858][123007] Saving new best policy, reward=1084.443! [2023-12-25 23:36:58,882][123090] Updated weights for policy 1, policy_version 5892 (0.0009) [2023-12-25 23:36:58,943][123090] Updated weights for policy 1, policy_version 5902 (0.0010) [2023-12-25 23:36:59,000][123090] Updated weights for policy 1, policy_version 5912 (0.0009) [2023-12-25 23:36:59,604][123091] Updated weights for policy 0, policy_version 5957 (0.0007) [2023-12-25 23:36:59,676][123091] Updated weights for policy 0, policy_version 5967 (0.0009) [2023-12-25 23:36:59,735][123091] Updated weights for policy 0, policy_version 5977 (0.0009) [2023-12-25 23:36:59,862][123090] Updated weights for policy 1, policy_version 5922 (0.0009) [2023-12-25 23:36:59,928][123090] Updated weights for policy 1, policy_version 5932 (0.0010) [2023-12-25 23:36:59,980][123090] Updated weights for policy 1, policy_version 5942 (0.0010) [2023-12-25 23:37:00,043][123090] Updated weights for policy 1, policy_version 5952 (0.0009) [2023-12-25 23:37:00,550][123091] Updated weights for policy 0, policy_version 5987 (0.0009) [2023-12-25 23:37:00,603][123091] Updated weights for policy 0, policy_version 5997 (0.0007) [2023-12-25 23:37:00,658][123091] Updated weights for policy 0, policy_version 6007 (0.0009) [2023-12-25 23:37:00,912][123090] Updated weights for policy 1, policy_version 5962 (0.0008) [2023-12-25 23:37:00,960][123090] Updated weights for policy 1, policy_version 5972 (0.0009) [2023-12-25 23:37:01,020][123090] Updated weights for policy 1, policy_version 5982 (0.0008) [2023-12-25 23:37:01,448][123091] Updated weights for policy 0, policy_version 6017 (0.0009) [2023-12-25 23:37:01,513][123091] Updated weights for policy 0, policy_version 6027 (0.0006) [2023-12-25 23:37:01,576][123091] Updated weights for policy 0, policy_version 6037 (0.0010) [2023-12-25 23:37:01,654][123091] Updated weights for policy 0, policy_version 6047 (0.0009) [2023-12-25 23:37:01,827][123090] Updated weights for policy 1, policy_version 5992 (0.0010) [2023-12-25 23:37:01,871][123090] Updated weights for policy 1, policy_version 6002 (0.0010) [2023-12-25 23:37:01,919][123090] Updated weights for policy 1, policy_version 6012 (0.0010) [2023-12-25 23:37:02,428][123091] Updated weights for policy 0, policy_version 6057 (0.0010) [2023-12-25 23:37:02,495][123091] Updated weights for policy 0, policy_version 6067 (0.0010) [2023-12-25 23:37:02,550][123091] Updated weights for policy 0, policy_version 6077 (0.0010) [2023-12-25 23:37:02,775][123090] Updated weights for policy 1, policy_version 6022 (0.0007) [2023-12-25 23:37:02,841][123090] Updated weights for policy 1, policy_version 6032 (0.0006) [2023-12-25 23:37:02,906][123090] Updated weights for policy 1, policy_version 6042 (0.0005) [2023-12-25 23:37:03,391][123091] Updated weights for policy 0, policy_version 6087 (0.0010) [2023-12-25 23:37:03,438][123091] Updated weights for policy 0, policy_version 6097 (0.0010) [2023-12-25 23:37:03,497][123091] Updated weights for policy 0, policy_version 6107 (0.0010) [2023-12-25 23:37:03,538][123090] Updated weights for policy 1, policy_version 6052 (0.0006) [2023-12-25 23:37:03,584][123090] Updated weights for policy 1, policy_version 6062 (0.0008) [2023-12-25 23:37:03,649][123090] Updated weights for policy 1, policy_version 6072 (0.0006) [2023-12-25 23:37:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17339.7). Total num frames: 3121152. Throughput: 0: 8817.2, 1: 8736.6. Samples: 3128396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:03,785][121949] Avg episode reward: [(0, '1146.798'), (1, '1355.252')] [2023-12-25 23:37:03,787][123007] Saving new best policy, reward=1146.798! [2023-12-25 23:37:03,787][123008] Saving new best policy, reward=1355.252! [2023-12-25 23:37:04,307][123091] Updated weights for policy 0, policy_version 6117 (0.0008) [2023-12-25 23:37:04,366][123091] Updated weights for policy 0, policy_version 6127 (0.0007) [2023-12-25 23:37:04,416][123090] Updated weights for policy 1, policy_version 6082 (0.0005) [2023-12-25 23:37:04,427][123091] Updated weights for policy 0, policy_version 6137 (0.0009) [2023-12-25 23:37:04,483][123090] Updated weights for policy 1, policy_version 6092 (0.0008) [2023-12-25 23:37:04,556][123090] Updated weights for policy 1, policy_version 6102 (0.0008) [2023-12-25 23:37:04,626][123090] Updated weights for policy 1, policy_version 6112 (0.0008) [2023-12-25 23:37:05,218][123091] Updated weights for policy 0, policy_version 6147 (0.0009) [2023-12-25 23:37:05,265][123091] Updated weights for policy 0, policy_version 6157 (0.0009) [2023-12-25 23:37:05,313][123091] Updated weights for policy 0, policy_version 6167 (0.0009) [2023-12-25 23:37:05,389][123090] Updated weights for policy 1, policy_version 6122 (0.0008) [2023-12-25 23:37:05,455][123090] Updated weights for policy 1, policy_version 6132 (0.0010) [2023-12-25 23:37:05,513][123090] Updated weights for policy 1, policy_version 6142 (0.0010) [2023-12-25 23:37:05,943][123091] Updated weights for policy 0, policy_version 6178 (0.0008) [2023-12-25 23:37:06,005][123091] Updated weights for policy 0, policy_version 6188 (0.0005) [2023-12-25 23:37:06,063][123091] Updated weights for policy 0, policy_version 6198 (0.0008) [2023-12-25 23:37:06,129][123091] Updated weights for policy 0, policy_version 6208 (0.0010) [2023-12-25 23:37:06,418][123090] Updated weights for policy 1, policy_version 6152 (0.0010) [2023-12-25 23:37:06,482][123090] Updated weights for policy 1, policy_version 6162 (0.0010) [2023-12-25 23:37:06,546][123090] Updated weights for policy 1, policy_version 6172 (0.0010) [2023-12-25 23:37:06,826][123091] Updated weights for policy 0, policy_version 6218 (0.0005) [2023-12-25 23:37:06,895][123091] Updated weights for policy 0, policy_version 6228 (0.0005) [2023-12-25 23:37:06,961][123091] Updated weights for policy 0, policy_version 6238 (0.0005) [2023-12-25 23:37:07,485][123090] Updated weights for policy 1, policy_version 6182 (0.0010) [2023-12-25 23:37:07,546][123090] Updated weights for policy 1, policy_version 6192 (0.0009) [2023-12-25 23:37:07,605][123090] Updated weights for policy 1, policy_version 6202 (0.0008) [2023-12-25 23:37:07,616][123091] Updated weights for policy 0, policy_version 6248 (0.0008) [2023-12-25 23:37:07,680][123091] Updated weights for policy 0, policy_version 6258 (0.0009) [2023-12-25 23:37:07,744][123091] Updated weights for policy 0, policy_version 6268 (0.0011) [2023-12-25 23:37:08,354][123091] Updated weights for policy 0, policy_version 6278 (0.0007) [2023-12-25 23:37:08,422][123091] Updated weights for policy 0, policy_version 6288 (0.0008) [2023-12-25 23:37:08,487][123091] Updated weights for policy 0, policy_version 6298 (0.0008) [2023-12-25 23:37:08,503][123090] Updated weights for policy 1, policy_version 6212 (0.0007) [2023-12-25 23:37:08,572][123090] Updated weights for policy 1, policy_version 6222 (0.0009) [2023-12-25 23:37:08,638][123090] Updated weights for policy 1, policy_version 6232 (0.0009) [2023-12-25 23:37:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17358.2). Total num frames: 3211264. Throughput: 0: 8880.8, 1: 8742.4. Samples: 3181360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:08,785][121949] Avg episode reward: [(0, '1149.872'), (1, '1356.513')] [2023-12-25 23:37:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000006304_1613824.pth... [2023-12-25 23:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000006240_1597440.pth... [2023-12-25 23:37:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000005248_1343488.pth [2023-12-25 23:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000005216_1335296.pth [2023-12-25 23:37:08,795][123008] Saving new best policy, reward=1356.513! [2023-12-25 23:37:08,795][123007] Saving new best policy, reward=1149.872! [2023-12-25 23:37:09,212][123091] Updated weights for policy 0, policy_version 6308 (0.0006) [2023-12-25 23:37:09,285][123091] Updated weights for policy 0, policy_version 6318 (0.0009) [2023-12-25 23:37:09,357][123091] Updated weights for policy 0, policy_version 6328 (0.0009) [2023-12-25 23:37:09,535][123090] Updated weights for policy 1, policy_version 6242 (0.0010) [2023-12-25 23:37:09,599][123090] Updated weights for policy 1, policy_version 6252 (0.0010) [2023-12-25 23:37:09,669][123090] Updated weights for policy 1, policy_version 6262 (0.0010) [2023-12-25 23:37:09,741][123090] Updated weights for policy 1, policy_version 6272 (0.0008) [2023-12-25 23:37:10,181][123091] Updated weights for policy 0, policy_version 6338 (0.0008) [2023-12-25 23:37:10,252][123091] Updated weights for policy 0, policy_version 6348 (0.0010) [2023-12-25 23:37:10,317][123091] Updated weights for policy 0, policy_version 6358 (0.0009) [2023-12-25 23:37:10,380][123091] Updated weights for policy 0, policy_version 6368 (0.0010) [2023-12-25 23:37:10,519][123090] Updated weights for policy 1, policy_version 6282 (0.0009) [2023-12-25 23:37:10,584][123090] Updated weights for policy 1, policy_version 6292 (0.0007) [2023-12-25 23:37:10,654][123090] Updated weights for policy 1, policy_version 6302 (0.0005) [2023-12-25 23:37:11,289][123091] Updated weights for policy 0, policy_version 6378 (0.0010) [2023-12-25 23:37:11,344][123091] Updated weights for policy 0, policy_version 6388 (0.0010) [2023-12-25 23:37:11,410][123090] Updated weights for policy 1, policy_version 6312 (0.0008) [2023-12-25 23:37:11,420][123091] Updated weights for policy 0, policy_version 6398 (0.0009) [2023-12-25 23:37:11,475][123090] Updated weights for policy 1, policy_version 6322 (0.0006) [2023-12-25 23:37:11,540][123090] Updated weights for policy 1, policy_version 6332 (0.0009) [2023-12-25 23:37:12,290][123091] Updated weights for policy 0, policy_version 6408 (0.0009) [2023-12-25 23:37:12,360][123091] Updated weights for policy 0, policy_version 6418 (0.0009) [2023-12-25 23:37:12,363][123090] Updated weights for policy 1, policy_version 6342 (0.0007) [2023-12-25 23:37:12,424][123091] Updated weights for policy 0, policy_version 6428 (0.0010) [2023-12-25 23:37:12,428][123090] Updated weights for policy 1, policy_version 6352 (0.0009) [2023-12-25 23:37:12,493][123090] Updated weights for policy 1, policy_version 6362 (0.0008) [2023-12-25 23:37:13,238][123091] Updated weights for policy 0, policy_version 6438 (0.0008) [2023-12-25 23:37:13,294][123091] Updated weights for policy 0, policy_version 6448 (0.0009) [2023-12-25 23:37:13,331][123090] Updated weights for policy 1, policy_version 6372 (0.0010) [2023-12-25 23:37:13,346][123091] Updated weights for policy 0, policy_version 6458 (0.0007) [2023-12-25 23:37:13,395][123090] Updated weights for policy 1, policy_version 6382 (0.0009) [2023-12-25 23:37:13,462][123090] Updated weights for policy 1, policy_version 6392 (0.0010) [2023-12-25 23:37:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17332.6). Total num frames: 3293184. Throughput: 0: 8880.8, 1: 8651.7. Samples: 3284624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:13,785][121949] Avg episode reward: [(0, '1110.300'), (1, '1405.110')] [2023-12-25 23:37:13,785][123008] Saving new best policy, reward=1405.110! [2023-12-25 23:37:13,964][123091] Updated weights for policy 0, policy_version 6468 (0.0005) [2023-12-25 23:37:14,029][123091] Updated weights for policy 0, policy_version 6478 (0.0009) [2023-12-25 23:37:14,091][123091] Updated weights for policy 0, policy_version 6488 (0.0010) [2023-12-25 23:37:14,349][123090] Updated weights for policy 1, policy_version 6402 (0.0009) [2023-12-25 23:37:14,416][123090] Updated weights for policy 1, policy_version 6412 (0.0009) [2023-12-25 23:37:14,479][123090] Updated weights for policy 1, policy_version 6422 (0.0009) [2023-12-25 23:37:14,554][123090] Updated weights for policy 1, policy_version 6432 (0.0009) [2023-12-25 23:37:14,849][123091] Updated weights for policy 0, policy_version 6498 (0.0010) [2023-12-25 23:37:14,911][123091] Updated weights for policy 0, policy_version 6508 (0.0009) [2023-12-25 23:37:14,976][123091] Updated weights for policy 0, policy_version 6518 (0.0009) [2023-12-25 23:37:15,050][123091] Updated weights for policy 0, policy_version 6528 (0.0009) [2023-12-25 23:37:15,405][123090] Updated weights for policy 1, policy_version 6442 (0.0010) [2023-12-25 23:37:15,471][123090] Updated weights for policy 1, policy_version 6452 (0.0010) [2023-12-25 23:37:15,535][123090] Updated weights for policy 1, policy_version 6462 (0.0010) [2023-12-25 23:37:15,856][123091] Updated weights for policy 0, policy_version 6538 (0.0005) [2023-12-25 23:37:15,910][123091] Updated weights for policy 0, policy_version 6548 (0.0005) [2023-12-25 23:37:15,974][123091] Updated weights for policy 0, policy_version 6558 (0.0005) [2023-12-25 23:37:16,421][123090] Updated weights for policy 1, policy_version 6472 (0.0010) [2023-12-25 23:37:16,487][123090] Updated weights for policy 1, policy_version 6482 (0.0010) [2023-12-25 23:37:16,551][123090] Updated weights for policy 1, policy_version 6492 (0.0009) [2023-12-25 23:37:16,707][123091] Updated weights for policy 0, policy_version 6568 (0.0009) [2023-12-25 23:37:16,755][123091] Updated weights for policy 0, policy_version 6578 (0.0009) [2023-12-25 23:37:16,815][123091] Updated weights for policy 0, policy_version 6588 (0.0006) [2023-12-25 23:37:17,405][123090] Updated weights for policy 1, policy_version 6502 (0.0009) [2023-12-25 23:37:17,413][123091] Updated weights for policy 0, policy_version 6598 (0.0005) [2023-12-25 23:37:17,454][123090] Updated weights for policy 1, policy_version 6512 (0.0009) [2023-12-25 23:37:17,474][123091] Updated weights for policy 0, policy_version 6608 (0.0006) [2023-12-25 23:37:17,503][123090] Updated weights for policy 1, policy_version 6522 (0.0008) [2023-12-25 23:37:17,537][123091] Updated weights for policy 0, policy_version 6618 (0.0008) [2023-12-25 23:37:18,338][123091] Updated weights for policy 0, policy_version 6628 (0.0009) [2023-12-25 23:37:18,401][123090] Updated weights for policy 1, policy_version 6532 (0.0008) [2023-12-25 23:37:18,409][123091] Updated weights for policy 0, policy_version 6638 (0.0010) [2023-12-25 23:37:18,469][123090] Updated weights for policy 1, policy_version 6542 (0.0007) [2023-12-25 23:37:18,479][123091] Updated weights for policy 0, policy_version 6648 (0.0009) [2023-12-25 23:37:18,536][123090] Updated weights for policy 1, policy_version 6552 (0.0008) [2023-12-25 23:37:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17350.3). Total num frames: 3383296. Throughput: 0: 8994.0, 1: 8563.2. Samples: 3389720. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-25 23:37:18,785][121949] Avg episode reward: [(0, '1151.202'), (1, '1544.062')] [2023-12-25 23:37:18,785][123008] Saving new best policy, reward=1544.062! [2023-12-25 23:37:18,785][123007] Saving new best policy, reward=1151.202! [2023-12-25 23:37:19,274][123091] Updated weights for policy 0, policy_version 6658 (0.0009) [2023-12-25 23:37:19,339][123091] Updated weights for policy 0, policy_version 6668 (0.0009) [2023-12-25 23:37:19,364][123090] Updated weights for policy 1, policy_version 6562 (0.0010) [2023-12-25 23:37:19,407][123091] Updated weights for policy 0, policy_version 6678 (0.0009) [2023-12-25 23:37:19,431][123090] Updated weights for policy 1, policy_version 6572 (0.0009) [2023-12-25 23:37:19,473][123091] Updated weights for policy 0, policy_version 6688 (0.0007) [2023-12-25 23:37:19,498][123090] Updated weights for policy 1, policy_version 6582 (0.0009) [2023-12-25 23:37:19,576][123090] Updated weights for policy 1, policy_version 6592 (0.0009) [2023-12-25 23:37:20,333][123091] Updated weights for policy 0, policy_version 6698 (0.0010) [2023-12-25 23:37:20,394][123091] Updated weights for policy 0, policy_version 6708 (0.0009) [2023-12-25 23:37:20,431][123090] Updated weights for policy 1, policy_version 6602 (0.0009) [2023-12-25 23:37:20,459][123091] Updated weights for policy 0, policy_version 6718 (0.0008) [2023-12-25 23:37:20,497][123090] Updated weights for policy 1, policy_version 6612 (0.0009) [2023-12-25 23:37:20,566][123090] Updated weights for policy 1, policy_version 6622 (0.0009) [2023-12-25 23:37:21,394][123091] Updated weights for policy 0, policy_version 6728 (0.0008) [2023-12-25 23:37:21,408][123090] Updated weights for policy 1, policy_version 6632 (0.0009) [2023-12-25 23:37:21,449][123091] Updated weights for policy 0, policy_version 6738 (0.0008) [2023-12-25 23:37:21,469][123090] Updated weights for policy 1, policy_version 6642 (0.0009) [2023-12-25 23:37:21,502][123091] Updated weights for policy 0, policy_version 6748 (0.0009) [2023-12-25 23:37:21,531][123090] Updated weights for policy 1, policy_version 6652 (0.0009) [2023-12-25 23:37:22,354][123091] Updated weights for policy 0, policy_version 6758 (0.0008) [2023-12-25 23:37:22,409][123090] Updated weights for policy 1, policy_version 6662 (0.0008) [2023-12-25 23:37:22,419][123091] Updated weights for policy 0, policy_version 6768 (0.0010) [2023-12-25 23:37:22,473][123090] Updated weights for policy 1, policy_version 6672 (0.0008) [2023-12-25 23:37:22,486][123091] Updated weights for policy 0, policy_version 6778 (0.0009) [2023-12-25 23:37:22,537][123090] Updated weights for policy 1, policy_version 6682 (0.0009) [2023-12-25 23:37:23,330][123090] Updated weights for policy 1, policy_version 6692 (0.0008) [2023-12-25 23:37:23,349][123091] Updated weights for policy 0, policy_version 6788 (0.0010) [2023-12-25 23:37:23,391][123090] Updated weights for policy 1, policy_version 6702 (0.0005) [2023-12-25 23:37:23,403][123091] Updated weights for policy 0, policy_version 6798 (0.0008) [2023-12-25 23:37:23,451][123090] Updated weights for policy 1, policy_version 6712 (0.0005) [2023-12-25 23:37:23,456][123091] Updated weights for policy 0, policy_version 6808 (0.0010) [2023-12-25 23:37:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17326.1). Total num frames: 3465216. Throughput: 0: 8971.5, 1: 8545.2. Samples: 3439152. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-25 23:37:23,785][121949] Avg episode reward: [(0, '1107.472'), (1, '1456.563')] [2023-12-25 23:37:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000006816_1744896.pth... [2023-12-25 23:37:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000006720_1720320.pth... [2023-12-25 23:37:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000005760_1474560.pth [2023-12-25 23:37:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000005728_1466368.pth [2023-12-25 23:37:24,267][123090] Updated weights for policy 1, policy_version 6722 (0.0006) [2023-12-25 23:37:24,305][123091] Updated weights for policy 0, policy_version 6818 (0.0008) [2023-12-25 23:37:24,330][123090] Updated weights for policy 1, policy_version 6732 (0.0007) [2023-12-25 23:37:24,369][123091] Updated weights for policy 0, policy_version 6828 (0.0008) [2023-12-25 23:37:24,385][123090] Updated weights for policy 1, policy_version 6742 (0.0007) [2023-12-25 23:37:24,434][123091] Updated weights for policy 0, policy_version 6838 (0.0006) [2023-12-25 23:37:24,445][123090] Updated weights for policy 1, policy_version 6752 (0.0008) [2023-12-25 23:37:24,484][123091] Updated weights for policy 0, policy_version 6848 (0.0005) [2023-12-25 23:37:25,213][123090] Updated weights for policy 1, policy_version 6762 (0.0005) [2023-12-25 23:37:25,214][123091] Updated weights for policy 0, policy_version 6858 (0.0009) [2023-12-25 23:37:25,266][123090] Updated weights for policy 1, policy_version 6772 (0.0005) [2023-12-25 23:37:25,273][123091] Updated weights for policy 0, policy_version 6868 (0.0008) [2023-12-25 23:37:25,336][123091] Updated weights for policy 0, policy_version 6878 (0.0005) [2023-12-25 23:37:25,339][123090] Updated weights for policy 1, policy_version 6782 (0.0005) [2023-12-25 23:37:26,045][123091] Updated weights for policy 0, policy_version 6888 (0.0010) [2023-12-25 23:37:26,101][123091] Updated weights for policy 0, policy_version 6898 (0.0009) [2023-12-25 23:37:26,148][123091] Updated weights for policy 0, policy_version 6908 (0.0008) [2023-12-25 23:37:26,178][123090] Updated weights for policy 1, policy_version 6792 (0.0007) [2023-12-25 23:37:26,231][123090] Updated weights for policy 1, policy_version 6803 (0.0010) [2023-12-25 23:37:26,285][123090] Updated weights for policy 1, policy_version 6814 (0.0010) [2023-12-25 23:37:26,918][123091] Updated weights for policy 0, policy_version 6918 (0.0010) [2023-12-25 23:37:26,984][123091] Updated weights for policy 0, policy_version 6928 (0.0009) [2023-12-25 23:37:27,044][123091] Updated weights for policy 0, policy_version 6938 (0.0009) [2023-12-25 23:37:27,137][123090] Updated weights for policy 1, policy_version 6824 (0.0008) [2023-12-25 23:37:27,189][123090] Updated weights for policy 1, policy_version 6834 (0.0009) [2023-12-25 23:37:27,244][123090] Updated weights for policy 1, policy_version 6844 (0.0009) [2023-12-25 23:37:27,882][123091] Updated weights for policy 0, policy_version 6948 (0.0008) [2023-12-25 23:37:27,954][123091] Updated weights for policy 0, policy_version 6958 (0.0007) [2023-12-25 23:37:28,016][123091] Updated weights for policy 0, policy_version 6968 (0.0009) [2023-12-25 23:37:28,106][123090] Updated weights for policy 1, policy_version 6854 (0.0009) [2023-12-25 23:37:28,166][123090] Updated weights for policy 1, policy_version 6864 (0.0009) [2023-12-25 23:37:28,248][123090] Updated weights for policy 1, policy_version 6874 (0.0009) [2023-12-25 23:37:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17303.1). Total num frames: 3547136. Throughput: 0: 8992.2, 1: 8602.8. Samples: 3544940. Policy #0 lag: (min: 11.0, avg: 12.0, max: 40.0) [2023-12-25 23:37:28,785][121949] Avg episode reward: [(0, '1146.423'), (1, '1511.088')] [2023-12-25 23:37:28,829][123091] Updated weights for policy 0, policy_version 6979 (0.0009) [2023-12-25 23:37:28,884][123091] Updated weights for policy 0, policy_version 6989 (0.0009) [2023-12-25 23:37:28,945][123091] Updated weights for policy 0, policy_version 6999 (0.0009) [2023-12-25 23:37:29,059][123090] Updated weights for policy 1, policy_version 6884 (0.0009) [2023-12-25 23:37:29,117][123090] Updated weights for policy 1, policy_version 6894 (0.0009) [2023-12-25 23:37:29,176][123090] Updated weights for policy 1, policy_version 6904 (0.0005) [2023-12-25 23:37:29,790][123091] Updated weights for policy 0, policy_version 7009 (0.0010) [2023-12-25 23:37:29,850][123091] Updated weights for policy 0, policy_version 7019 (0.0009) [2023-12-25 23:37:29,910][123091] Updated weights for policy 0, policy_version 7029 (0.0009) [2023-12-25 23:37:29,923][123090] Updated weights for policy 1, policy_version 6914 (0.0007) [2023-12-25 23:37:29,970][123091] Updated weights for policy 0, policy_version 7039 (0.0010) [2023-12-25 23:37:29,980][123090] Updated weights for policy 1, policy_version 6924 (0.0007) [2023-12-25 23:37:30,050][123090] Updated weights for policy 1, policy_version 6934 (0.0009) [2023-12-25 23:37:30,123][123090] Updated weights for policy 1, policy_version 6944 (0.0009) [2023-12-25 23:37:30,655][123091] Updated weights for policy 0, policy_version 7049 (0.0005) [2023-12-25 23:37:30,718][123091] Updated weights for policy 0, policy_version 7059 (0.0007) [2023-12-25 23:37:30,783][123091] Updated weights for policy 0, policy_version 7069 (0.0008) [2023-12-25 23:37:30,904][123090] Updated weights for policy 1, policy_version 6954 (0.0009) [2023-12-25 23:37:30,955][123090] Updated weights for policy 1, policy_version 6965 (0.0009) [2023-12-25 23:37:31,006][123090] Updated weights for policy 1, policy_version 6975 (0.0008) [2023-12-25 23:37:31,554][123091] Updated weights for policy 0, policy_version 7079 (0.0010) [2023-12-25 23:37:31,602][123091] Updated weights for policy 0, policy_version 7089 (0.0009) [2023-12-25 23:37:31,671][123091] Updated weights for policy 0, policy_version 7099 (0.0010) [2023-12-25 23:37:31,864][123090] Updated weights for policy 1, policy_version 6985 (0.0006) [2023-12-25 23:37:31,917][123090] Updated weights for policy 1, policy_version 6995 (0.0005) [2023-12-25 23:37:31,964][123090] Updated weights for policy 1, policy_version 7005 (0.0005) [2023-12-25 23:37:32,586][123091] Updated weights for policy 0, policy_version 7109 (0.0010) [2023-12-25 23:37:32,622][123090] Updated weights for policy 1, policy_version 7015 (0.0005) [2023-12-25 23:37:32,647][123091] Updated weights for policy 0, policy_version 7119 (0.0009) [2023-12-25 23:37:32,692][123090] Updated weights for policy 1, policy_version 7025 (0.0005) [2023-12-25 23:37:32,704][123091] Updated weights for policy 0, policy_version 7129 (0.0009) [2023-12-25 23:37:32,754][123090] Updated weights for policy 1, policy_version 7035 (0.0006) [2023-12-25 23:37:33,415][123090] Updated weights for policy 1, policy_version 7045 (0.0007) [2023-12-25 23:37:33,474][123090] Updated weights for policy 1, policy_version 7055 (0.0009) [2023-12-25 23:37:33,522][123090] Updated weights for policy 1, policy_version 7065 (0.0009) [2023-12-25 23:37:33,613][123091] Updated weights for policy 0, policy_version 7139 (0.0009) [2023-12-25 23:37:33,665][123091] Updated weights for policy 0, policy_version 7149 (0.0009) [2023-12-25 23:37:33,722][123091] Updated weights for policy 0, policy_version 7159 (0.0009) [2023-12-25 23:37:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17359.3). Total num frames: 3645440. Throughput: 0: 9008.9, 1: 8568.3. Samples: 3650564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:33,785][121949] Avg episode reward: [(0, '1139.358'), (1, '1415.429')] [2023-12-25 23:37:34,261][123090] Updated weights for policy 1, policy_version 7075 (0.0010) [2023-12-25 23:37:34,319][123090] Updated weights for policy 1, policy_version 7085 (0.0009) [2023-12-25 23:37:34,394][123090] Updated weights for policy 1, policy_version 7095 (0.0005) [2023-12-25 23:37:34,593][123091] Updated weights for policy 0, policy_version 7169 (0.0009) [2023-12-25 23:37:34,654][123091] Updated weights for policy 0, policy_version 7179 (0.0009) [2023-12-25 23:37:34,709][123091] Updated weights for policy 0, policy_version 7189 (0.0009) [2023-12-25 23:37:34,779][123091] Updated weights for policy 0, policy_version 7199 (0.0005) [2023-12-25 23:37:35,277][123090] Updated weights for policy 1, policy_version 7105 (0.0009) [2023-12-25 23:37:35,335][123090] Updated weights for policy 1, policy_version 7115 (0.0005) [2023-12-25 23:37:35,398][123090] Updated weights for policy 1, policy_version 7125 (0.0005) [2023-12-25 23:37:35,469][123090] Updated weights for policy 1, policy_version 7135 (0.0005) [2023-12-25 23:37:35,517][123091] Updated weights for policy 0, policy_version 7209 (0.0007) [2023-12-25 23:37:35,570][123091] Updated weights for policy 0, policy_version 7219 (0.0005) [2023-12-25 23:37:35,636][123091] Updated weights for policy 0, policy_version 7229 (0.0005) [2023-12-25 23:37:36,233][123090] Updated weights for policy 1, policy_version 7145 (0.0006) [2023-12-25 23:37:36,302][123090] Updated weights for policy 1, policy_version 7155 (0.0006) [2023-12-25 23:37:36,304][123091] Updated weights for policy 0, policy_version 7239 (0.0008) [2023-12-25 23:37:36,360][123090] Updated weights for policy 1, policy_version 7165 (0.0007) [2023-12-25 23:37:36,364][123091] Updated weights for policy 0, policy_version 7249 (0.0009) [2023-12-25 23:37:36,418][123091] Updated weights for policy 0, policy_version 7259 (0.0009) [2023-12-25 23:37:37,163][123090] Updated weights for policy 1, policy_version 7175 (0.0009) [2023-12-25 23:37:37,225][123090] Updated weights for policy 1, policy_version 7185 (0.0008) [2023-12-25 23:37:37,284][123090] Updated weights for policy 1, policy_version 7195 (0.0006) [2023-12-25 23:37:37,316][123091] Updated weights for policy 0, policy_version 7269 (0.0010) [2023-12-25 23:37:37,379][123091] Updated weights for policy 0, policy_version 7279 (0.0011) [2023-12-25 23:37:37,450][123091] Updated weights for policy 0, policy_version 7289 (0.0011) [2023-12-25 23:37:38,054][123090] Updated weights for policy 1, policy_version 7205 (0.0008) [2023-12-25 23:37:38,114][123090] Updated weights for policy 1, policy_version 7215 (0.0010) [2023-12-25 23:37:38,170][123090] Updated weights for policy 1, policy_version 7225 (0.0010) [2023-12-25 23:37:38,186][123091] Updated weights for policy 0, policy_version 7299 (0.0010) [2023-12-25 23:37:38,242][123091] Updated weights for policy 0, policy_version 7309 (0.0010) [2023-12-25 23:37:38,293][123091] Updated weights for policy 0, policy_version 7319 (0.0010) [2023-12-25 23:37:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17336.6). Total num frames: 3727360. Throughput: 0: 9005.8, 1: 8579.1. Samples: 3704616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:38,784][121949] Avg episode reward: [(0, '1177.873'), (1, '1550.732')] [2023-12-25 23:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000007328_1875968.pth... [2023-12-25 23:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000007232_1851392.pth... [2023-12-25 23:37:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000006304_1613824.pth [2023-12-25 23:37:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000006240_1597440.pth [2023-12-25 23:37:38,796][123007] Saving new best policy, reward=1177.873! [2023-12-25 23:37:38,796][123008] Saving new best policy, reward=1550.732! [2023-12-25 23:37:38,959][123091] Updated weights for policy 0, policy_version 7329 (0.0009) [2023-12-25 23:37:39,013][123091] Updated weights for policy 0, policy_version 7339 (0.0005) [2023-12-25 23:37:39,018][123090] Updated weights for policy 1, policy_version 7235 (0.0010) [2023-12-25 23:37:39,069][123091] Updated weights for policy 0, policy_version 7349 (0.0005) [2023-12-25 23:37:39,086][123090] Updated weights for policy 1, policy_version 7245 (0.0011) [2023-12-25 23:37:39,137][123091] Updated weights for policy 0, policy_version 7359 (0.0006) [2023-12-25 23:37:39,149][123090] Updated weights for policy 1, policy_version 7255 (0.0010) [2023-12-25 23:37:40,006][123091] Updated weights for policy 0, policy_version 7369 (0.0009) [2023-12-25 23:37:40,019][123090] Updated weights for policy 1, policy_version 7265 (0.0011) [2023-12-25 23:37:40,072][123091] Updated weights for policy 0, policy_version 7379 (0.0010) [2023-12-25 23:37:40,087][123090] Updated weights for policy 1, policy_version 7275 (0.0011) [2023-12-25 23:37:40,133][123091] Updated weights for policy 0, policy_version 7389 (0.0007) [2023-12-25 23:37:40,151][123090] Updated weights for policy 1, policy_version 7285 (0.0010) [2023-12-25 23:37:40,208][123090] Updated weights for policy 1, policy_version 7295 (0.0010) [2023-12-25 23:37:40,909][123091] Updated weights for policy 0, policy_version 7399 (0.0006) [2023-12-25 23:37:40,958][123091] Updated weights for policy 0, policy_version 7409 (0.0007) [2023-12-25 23:37:41,024][123091] Updated weights for policy 0, policy_version 7419 (0.0006) [2023-12-25 23:37:41,075][123090] Updated weights for policy 1, policy_version 7305 (0.0008) [2023-12-25 23:37:41,144][123090] Updated weights for policy 1, policy_version 7315 (0.0008) [2023-12-25 23:37:41,207][123090] Updated weights for policy 1, policy_version 7325 (0.0009) [2023-12-25 23:37:41,821][123091] Updated weights for policy 0, policy_version 7429 (0.0008) [2023-12-25 23:37:41,890][123091] Updated weights for policy 0, policy_version 7439 (0.0006) [2023-12-25 23:37:41,904][123090] Updated weights for policy 1, policy_version 7335 (0.0007) [2023-12-25 23:37:41,948][123091] Updated weights for policy 0, policy_version 7449 (0.0011) [2023-12-25 23:37:41,974][123090] Updated weights for policy 1, policy_version 7345 (0.0008) [2023-12-25 23:37:42,040][123090] Updated weights for policy 1, policy_version 7355 (0.0005) [2023-12-25 23:37:42,676][123090] Updated weights for policy 1, policy_version 7365 (0.0006) [2023-12-25 23:37:42,739][123090] Updated weights for policy 1, policy_version 7375 (0.0010) [2023-12-25 23:37:42,765][123091] Updated weights for policy 0, policy_version 7459 (0.0011) [2023-12-25 23:37:42,795][123090] Updated weights for policy 1, policy_version 7385 (0.0010) [2023-12-25 23:37:42,817][123091] Updated weights for policy 0, policy_version 7469 (0.0010) [2023-12-25 23:37:42,869][123091] Updated weights for policy 0, policy_version 7479 (0.0010) [2023-12-25 23:37:43,506][123090] Updated weights for policy 1, policy_version 7395 (0.0009) [2023-12-25 23:37:43,553][123090] Updated weights for policy 1, policy_version 7405 (0.0005) [2023-12-25 23:37:43,601][123090] Updated weights for policy 1, policy_version 7415 (0.0010) [2023-12-25 23:37:43,620][123091] Updated weights for policy 0, policy_version 7489 (0.0010) [2023-12-25 23:37:43,674][123091] Updated weights for policy 0, policy_version 7499 (0.0006) [2023-12-25 23:37:43,727][123091] Updated weights for policy 0, policy_version 7509 (0.0007) [2023-12-25 23:37:43,775][123091] Updated weights for policy 0, policy_version 7519 (0.0005) [2023-12-25 23:37:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17389.4). Total num frames: 3825664. Throughput: 0: 8920.9, 1: 8550.7. Samples: 3810460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:37:43,784][121949] Avg episode reward: [(0, '1140.002'), (1, '1518.571')] [2023-12-25 23:37:44,333][123090] Updated weights for policy 1, policy_version 7425 (0.0010) [2023-12-25 23:37:44,390][123091] Updated weights for policy 0, policy_version 7529 (0.0010) [2023-12-25 23:37:44,392][123090] Updated weights for policy 1, policy_version 7435 (0.0005) [2023-12-25 23:37:44,444][123090] Updated weights for policy 1, policy_version 7445 (0.0005) [2023-12-25 23:37:44,453][123091] Updated weights for policy 0, policy_version 7539 (0.0010) [2023-12-25 23:37:44,509][123090] Updated weights for policy 1, policy_version 7455 (0.0005) [2023-12-25 23:37:44,517][123091] Updated weights for policy 0, policy_version 7549 (0.0011) [2023-12-25 23:37:45,252][123090] Updated weights for policy 1, policy_version 7465 (0.0010) [2023-12-25 23:37:45,304][123090] Updated weights for policy 1, policy_version 7475 (0.0010) [2023-12-25 23:37:45,357][123090] Updated weights for policy 1, policy_version 7485 (0.0010) [2023-12-25 23:37:45,363][123091] Updated weights for policy 0, policy_version 7559 (0.0011) [2023-12-25 23:37:45,418][123091] Updated weights for policy 0, policy_version 7569 (0.0010) [2023-12-25 23:37:45,470][123091] Updated weights for policy 0, policy_version 7579 (0.0010) [2023-12-25 23:37:46,149][123090] Updated weights for policy 1, policy_version 7495 (0.0007) [2023-12-25 23:37:46,204][123090] Updated weights for policy 1, policy_version 7505 (0.0006) [2023-12-25 23:37:46,257][123090] Updated weights for policy 1, policy_version 7515 (0.0006) [2023-12-25 23:37:46,271][123091] Updated weights for policy 0, policy_version 7589 (0.0008) [2023-12-25 23:37:46,327][123091] Updated weights for policy 0, policy_version 7599 (0.0005) [2023-12-25 23:37:46,373][123091] Updated weights for policy 0, policy_version 7609 (0.0009) [2023-12-25 23:37:46,875][123090] Updated weights for policy 1, policy_version 7525 (0.0005) [2023-12-25 23:37:46,925][123090] Updated weights for policy 1, policy_version 7535 (0.0006) [2023-12-25 23:37:46,973][123090] Updated weights for policy 1, policy_version 7545 (0.0009) [2023-12-25 23:37:47,144][123091] Updated weights for policy 0, policy_version 7619 (0.0010) [2023-12-25 23:37:47,203][123091] Updated weights for policy 0, policy_version 7629 (0.0010) [2023-12-25 23:37:47,253][123091] Updated weights for policy 0, policy_version 7639 (0.0010) [2023-12-25 23:37:47,783][123090] Updated weights for policy 1, policy_version 7555 (0.0009) [2023-12-25 23:37:47,842][123090] Updated weights for policy 1, policy_version 7565 (0.0005) [2023-12-25 23:37:47,898][123090] Updated weights for policy 1, policy_version 7575 (0.0009) [2023-12-25 23:37:48,094][123091] Updated weights for policy 0, policy_version 7649 (0.0011) [2023-12-25 23:37:48,149][123091] Updated weights for policy 0, policy_version 7659 (0.0010) [2023-12-25 23:37:48,205][123091] Updated weights for policy 0, policy_version 7669 (0.0011) [2023-12-25 23:37:48,257][123091] Updated weights for policy 0, policy_version 7679 (0.0011) [2023-12-25 23:37:48,673][123090] Updated weights for policy 1, policy_version 7585 (0.0011) [2023-12-25 23:37:48,728][123090] Updated weights for policy 1, policy_version 7595 (0.0006) [2023-12-25 23:37:48,775][123090] Updated weights for policy 1, policy_version 7605 (0.0005) [2023-12-25 23:37:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17367.1). Total num frames: 3907584. Throughput: 0: 8955.3, 1: 8690.1. Samples: 3922436. Policy #0 lag: (min: 25.0, avg: 47.2, max: 57.0) [2023-12-25 23:37:48,785][121949] Avg episode reward: [(0, '1146.585'), (1, '1477.418')] [2023-12-25 23:37:48,823][123090] Updated weights for policy 1, policy_version 7615 (0.0005) [2023-12-25 23:37:49,117][123091] Updated weights for policy 0, policy_version 7689 (0.0011) [2023-12-25 23:37:49,184][123091] Updated weights for policy 0, policy_version 7699 (0.0010) [2023-12-25 23:37:49,255][123091] Updated weights for policy 0, policy_version 7709 (0.0011) [2023-12-25 23:37:49,583][123090] Updated weights for policy 1, policy_version 7625 (0.0010) [2023-12-25 23:37:49,638][123090] Updated weights for policy 1, policy_version 7635 (0.0010) [2023-12-25 23:37:49,686][123090] Updated weights for policy 1, policy_version 7645 (0.0010) [2023-12-25 23:37:50,063][123091] Updated weights for policy 0, policy_version 7719 (0.0010) [2023-12-25 23:37:50,127][123091] Updated weights for policy 0, policy_version 7729 (0.0009) [2023-12-25 23:37:50,192][123091] Updated weights for policy 0, policy_version 7739 (0.0006) [2023-12-25 23:37:50,547][123090] Updated weights for policy 1, policy_version 7655 (0.0011) [2023-12-25 23:37:50,630][123090] Updated weights for policy 1, policy_version 7665 (0.0011) [2023-12-25 23:37:50,694][123090] Updated weights for policy 1, policy_version 7675 (0.0011) [2023-12-25 23:37:50,964][123091] Updated weights for policy 0, policy_version 7749 (0.0006) [2023-12-25 23:37:51,035][123091] Updated weights for policy 0, policy_version 7759 (0.0007) [2023-12-25 23:37:51,101][123091] Updated weights for policy 0, policy_version 7769 (0.0007) [2023-12-25 23:37:51,596][123090] Updated weights for policy 1, policy_version 7685 (0.0010) [2023-12-25 23:37:51,666][123090] Updated weights for policy 1, policy_version 7695 (0.0010) [2023-12-25 23:37:51,727][123090] Updated weights for policy 1, policy_version 7705 (0.0007) [2023-12-25 23:37:51,897][123091] Updated weights for policy 0, policy_version 7779 (0.0010) [2023-12-25 23:37:51,962][123091] Updated weights for policy 0, policy_version 7789 (0.0008) [2023-12-25 23:37:52,023][123091] Updated weights for policy 0, policy_version 7799 (0.0005) [2023-12-25 23:37:52,516][123090] Updated weights for policy 1, policy_version 7715 (0.0010) [2023-12-25 23:37:52,586][123090] Updated weights for policy 1, policy_version 7725 (0.0008) [2023-12-25 23:37:52,655][123090] Updated weights for policy 1, policy_version 7735 (0.0006) [2023-12-25 23:37:52,754][123091] Updated weights for policy 0, policy_version 7809 (0.0006) [2023-12-25 23:37:52,817][123091] Updated weights for policy 0, policy_version 7819 (0.0009) [2023-12-25 23:37:52,881][123091] Updated weights for policy 0, policy_version 7829 (0.0007) [2023-12-25 23:37:52,944][123091] Updated weights for policy 0, policy_version 7839 (0.0005) [2023-12-25 23:37:53,344][123090] Updated weights for policy 1, policy_version 7745 (0.0006) [2023-12-25 23:37:53,415][123090] Updated weights for policy 1, policy_version 7755 (0.0006) [2023-12-25 23:37:53,464][123090] Updated weights for policy 1, policy_version 7765 (0.0006) [2023-12-25 23:37:53,527][123090] Updated weights for policy 1, policy_version 7776 (0.0010) [2023-12-25 23:37:53,662][123091] Updated weights for policy 0, policy_version 7849 (0.0005) [2023-12-25 23:37:53,712][123091] Updated weights for policy 0, policy_version 7859 (0.0005) [2023-12-25 23:37:53,766][123091] Updated weights for policy 0, policy_version 7869 (0.0005) [2023-12-25 23:37:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17416.9). Total num frames: 4005888. Throughput: 0: 8911.3, 1: 8709.3. Samples: 3974284. Policy #0 lag: (min: 25.0, avg: 47.2, max: 57.0) [2023-12-25 23:37:53,784][121949] Avg episode reward: [(0, '1178.938'), (1, '1624.887')] [2023-12-25 23:37:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000007872_2015232.pth... [2023-12-25 23:37:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000007776_1990656.pth... [2023-12-25 23:37:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000006816_1744896.pth [2023-12-25 23:37:53,794][123007] Saving new best policy, reward=1178.938! [2023-12-25 23:37:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000006720_1720320.pth [2023-12-25 23:37:53,795][123008] Saving new best policy, reward=1624.887! [2023-12-25 23:37:54,373][123090] Updated weights for policy 1, policy_version 7786 (0.0011) [2023-12-25 23:37:54,380][123091] Updated weights for policy 0, policy_version 7879 (0.0005) [2023-12-25 23:37:54,437][123090] Updated weights for policy 1, policy_version 7796 (0.0010) [2023-12-25 23:37:54,443][123091] Updated weights for policy 0, policy_version 7889 (0.0005) [2023-12-25 23:37:54,497][123091] Updated weights for policy 0, policy_version 7899 (0.0005) [2023-12-25 23:37:54,504][123090] Updated weights for policy 1, policy_version 7806 (0.0011) [2023-12-25 23:37:55,311][123091] Updated weights for policy 0, policy_version 7909 (0.0008) [2023-12-25 23:37:55,340][123090] Updated weights for policy 1, policy_version 7816 (0.0007) [2023-12-25 23:37:55,372][123091] Updated weights for policy 0, policy_version 7919 (0.0010) [2023-12-25 23:37:55,406][123090] Updated weights for policy 1, policy_version 7826 (0.0007) [2023-12-25 23:37:55,431][123091] Updated weights for policy 0, policy_version 7929 (0.0007) [2023-12-25 23:37:55,470][123090] Updated weights for policy 1, policy_version 7836 (0.0009) [2023-12-25 23:37:56,039][123091] Updated weights for policy 0, policy_version 7939 (0.0006) [2023-12-25 23:37:56,098][123091] Updated weights for policy 0, policy_version 7949 (0.0006) [2023-12-25 23:37:56,153][123091] Updated weights for policy 0, policy_version 7959 (0.0006) [2023-12-25 23:37:56,376][123090] Updated weights for policy 1, policy_version 7846 (0.0009) [2023-12-25 23:37:56,447][123090] Updated weights for policy 1, policy_version 7856 (0.0009) [2023-12-25 23:37:56,505][123090] Updated weights for policy 1, policy_version 7866 (0.0009) [2023-12-25 23:37:56,762][123091] Updated weights for policy 0, policy_version 7969 (0.0005) [2023-12-25 23:37:56,810][123091] Updated weights for policy 0, policy_version 7979 (0.0008) [2023-12-25 23:37:56,860][123091] Updated weights for policy 0, policy_version 7989 (0.0010) [2023-12-25 23:37:56,911][123091] Updated weights for policy 0, policy_version 7999 (0.0010) [2023-12-25 23:37:57,368][123090] Updated weights for policy 1, policy_version 7876 (0.0009) [2023-12-25 23:37:57,441][123090] Updated weights for policy 1, policy_version 7886 (0.0006) [2023-12-25 23:37:57,509][123090] Updated weights for policy 1, policy_version 7896 (0.0005) [2023-12-25 23:37:57,714][123091] Updated weights for policy 0, policy_version 8009 (0.0007) [2023-12-25 23:37:57,775][123091] Updated weights for policy 0, policy_version 8019 (0.0010) [2023-12-25 23:37:57,828][123091] Updated weights for policy 0, policy_version 8030 (0.0010) [2023-12-25 23:37:58,245][123090] Updated weights for policy 1, policy_version 7906 (0.0006) [2023-12-25 23:37:58,308][123090] Updated weights for policy 1, policy_version 7916 (0.0009) [2023-12-25 23:37:58,374][123090] Updated weights for policy 1, policy_version 7926 (0.0009) [2023-12-25 23:37:58,434][123090] Updated weights for policy 1, policy_version 7936 (0.0008) [2023-12-25 23:37:58,697][123091] Updated weights for policy 0, policy_version 8040 (0.0009) [2023-12-25 23:37:58,762][123091] Updated weights for policy 0, policy_version 8050 (0.0010) [2023-12-25 23:37:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17394.9). Total num frames: 4087808. Throughput: 0: 9022.0, 1: 8757.1. Samples: 4084684. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-25 23:37:58,785][121949] Avg episode reward: [(0, '1173.272'), (1, '1772.386')] [2023-12-25 23:37:58,787][123008] Saving new best policy, reward=1772.386! [2023-12-25 23:37:58,837][123091] Updated weights for policy 0, policy_version 8060 (0.0009) [2023-12-25 23:37:59,379][123090] Updated weights for policy 1, policy_version 7946 (0.0008) [2023-12-25 23:37:59,451][123090] Updated weights for policy 1, policy_version 7956 (0.0008) [2023-12-25 23:37:59,534][123090] Updated weights for policy 1, policy_version 7966 (0.0008) [2023-12-25 23:37:59,688][123091] Updated weights for policy 0, policy_version 8070 (0.0008) [2023-12-25 23:37:59,754][123091] Updated weights for policy 0, policy_version 8080 (0.0010) [2023-12-25 23:37:59,810][123091] Updated weights for policy 0, policy_version 8090 (0.0011) [2023-12-25 23:38:00,271][123090] Updated weights for policy 1, policy_version 7976 (0.0006) [2023-12-25 23:38:00,334][123090] Updated weights for policy 1, policy_version 7986 (0.0005) [2023-12-25 23:38:00,406][123090] Updated weights for policy 1, policy_version 7996 (0.0006) [2023-12-25 23:38:00,661][123091] Updated weights for policy 0, policy_version 8100 (0.0011) [2023-12-25 23:38:00,709][123091] Updated weights for policy 0, policy_version 8110 (0.0010) [2023-12-25 23:38:00,767][123091] Updated weights for policy 0, policy_version 8120 (0.0010) [2023-12-25 23:38:01,106][123090] Updated weights for policy 1, policy_version 8006 (0.0008) [2023-12-25 23:38:01,170][123090] Updated weights for policy 1, policy_version 8017 (0.0013) [2023-12-25 23:38:01,228][123090] Updated weights for policy 1, policy_version 8027 (0.0005) [2023-12-25 23:38:01,545][123091] Updated weights for policy 0, policy_version 8130 (0.0010) [2023-12-25 23:38:01,595][123091] Updated weights for policy 0, policy_version 8140 (0.0008) [2023-12-25 23:38:01,651][123091] Updated weights for policy 0, policy_version 8150 (0.0008) [2023-12-25 23:38:01,709][123091] Updated weights for policy 0, policy_version 8160 (0.0010) [2023-12-25 23:38:02,022][123090] Updated weights for policy 1, policy_version 8037 (0.0008) [2023-12-25 23:38:02,085][123090] Updated weights for policy 1, policy_version 8047 (0.0007) [2023-12-25 23:38:02,149][123090] Updated weights for policy 1, policy_version 8057 (0.0005) [2023-12-25 23:38:02,555][123091] Updated weights for policy 0, policy_version 8170 (0.0011) [2023-12-25 23:38:02,610][123091] Updated weights for policy 0, policy_version 8180 (0.0010) [2023-12-25 23:38:02,661][123091] Updated weights for policy 0, policy_version 8190 (0.0010) [2023-12-25 23:38:02,905][123090] Updated weights for policy 1, policy_version 8067 (0.0006) [2023-12-25 23:38:02,965][123090] Updated weights for policy 1, policy_version 8077 (0.0009) [2023-12-25 23:38:03,025][123090] Updated weights for policy 1, policy_version 8087 (0.0009) [2023-12-25 23:38:03,415][123091] Updated weights for policy 0, policy_version 8200 (0.0009) [2023-12-25 23:38:03,465][123091] Updated weights for policy 0, policy_version 8210 (0.0010) [2023-12-25 23:38:03,511][123091] Updated weights for policy 0, policy_version 8220 (0.0009) [2023-12-25 23:38:03,748][123090] Updated weights for policy 1, policy_version 8097 (0.0009) [2023-12-25 23:38:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17408.0). Total num frames: 4177920. Throughput: 0: 8926.1, 1: 8876.3. Samples: 4190828. Policy #0 lag: (min: 15.0, avg: 19.0, max: 47.0) [2023-12-25 23:38:03,784][121949] Avg episode reward: [(0, '1158.669'), (1, '1593.067')] [2023-12-25 23:38:03,799][123090] Updated weights for policy 1, policy_version 8107 (0.0010) [2023-12-25 23:38:03,861][123090] Updated weights for policy 1, policy_version 8117 (0.0010) [2023-12-25 23:38:03,924][123090] Updated weights for policy 1, policy_version 8127 (0.0010) [2023-12-25 23:38:04,269][123091] Updated weights for policy 0, policy_version 8230 (0.0009) [2023-12-25 23:38:04,329][123091] Updated weights for policy 0, policy_version 8240 (0.0008) [2023-12-25 23:38:04,396][123091] Updated weights for policy 0, policy_version 8250 (0.0007) [2023-12-25 23:38:04,768][123090] Updated weights for policy 1, policy_version 8137 (0.0010) [2023-12-25 23:38:04,828][123090] Updated weights for policy 1, policy_version 8147 (0.0005) [2023-12-25 23:38:04,882][123090] Updated weights for policy 1, policy_version 8157 (0.0006) [2023-12-25 23:38:05,185][123091] Updated weights for policy 0, policy_version 8260 (0.0009) [2023-12-25 23:38:05,230][123091] Updated weights for policy 0, policy_version 8270 (0.0007) [2023-12-25 23:38:05,277][123091] Updated weights for policy 0, policy_version 8280 (0.0007) [2023-12-25 23:38:05,697][123090] Updated weights for policy 1, policy_version 8167 (0.0009) [2023-12-25 23:38:05,764][123090] Updated weights for policy 1, policy_version 8177 (0.0009) [2023-12-25 23:38:05,829][123090] Updated weights for policy 1, policy_version 8187 (0.0010) [2023-12-25 23:38:06,083][123091] Updated weights for policy 0, policy_version 8290 (0.0006) [2023-12-25 23:38:06,156][123091] Updated weights for policy 0, policy_version 8300 (0.0010) [2023-12-25 23:38:06,230][123091] Updated weights for policy 0, policy_version 8310 (0.0010) [2023-12-25 23:38:06,299][123091] Updated weights for policy 0, policy_version 8320 (0.0009) [2023-12-25 23:38:06,649][123090] Updated weights for policy 1, policy_version 8197 (0.0009) [2023-12-25 23:38:06,705][123090] Updated weights for policy 1, policy_version 8207 (0.0010) [2023-12-25 23:38:06,773][123090] Updated weights for policy 1, policy_version 8217 (0.0009) [2023-12-25 23:38:07,074][123091] Updated weights for policy 0, policy_version 8330 (0.0010) [2023-12-25 23:38:07,128][123091] Updated weights for policy 0, policy_version 8340 (0.0010) [2023-12-25 23:38:07,178][123091] Updated weights for policy 0, policy_version 8350 (0.0009) [2023-12-25 23:38:07,617][123090] Updated weights for policy 1, policy_version 8227 (0.0009) [2023-12-25 23:38:07,673][123090] Updated weights for policy 1, policy_version 8237 (0.0008) [2023-12-25 23:38:07,732][123090] Updated weights for policy 1, policy_version 8247 (0.0009) [2023-12-25 23:38:08,036][123091] Updated weights for policy 0, policy_version 8360 (0.0009) [2023-12-25 23:38:08,098][123091] Updated weights for policy 0, policy_version 8370 (0.0009) [2023-12-25 23:38:08,157][123091] Updated weights for policy 0, policy_version 8380 (0.0010) [2023-12-25 23:38:08,512][123090] Updated weights for policy 1, policy_version 8257 (0.0008) [2023-12-25 23:38:08,587][123090] Updated weights for policy 1, policy_version 8267 (0.0010) [2023-12-25 23:38:08,643][123090] Updated weights for policy 1, policy_version 8277 (0.0010) [2023-12-25 23:38:08,701][123090] Updated weights for policy 1, policy_version 8287 (0.0010) [2023-12-25 23:38:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17420.5). Total num frames: 4268032. Throughput: 0: 8977.8, 1: 8895.5. Samples: 4243448. Policy #0 lag: (min: 15.0, avg: 19.0, max: 47.0) [2023-12-25 23:38:08,785][121949] Avg episode reward: [(0, '1218.301'), (1, '1611.564')] [2023-12-25 23:38:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000008384_2146304.pth... [2023-12-25 23:38:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000008288_2121728.pth... [2023-12-25 23:38:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000007328_1875968.pth [2023-12-25 23:38:08,798][123007] Saving new best policy, reward=1218.301! [2023-12-25 23:38:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000007232_1851392.pth [2023-12-25 23:38:09,043][123091] Updated weights for policy 0, policy_version 8390 (0.0011) [2023-12-25 23:38:09,103][123091] Updated weights for policy 0, policy_version 8400 (0.0010) [2023-12-25 23:38:09,166][123091] Updated weights for policy 0, policy_version 8410 (0.0010) [2023-12-25 23:38:09,573][123090] Updated weights for policy 1, policy_version 8297 (0.0010) [2023-12-25 23:38:09,639][123090] Updated weights for policy 1, policy_version 8307 (0.0011) [2023-12-25 23:38:09,709][123090] Updated weights for policy 1, policy_version 8317 (0.0011) [2023-12-25 23:38:10,027][123091] Updated weights for policy 0, policy_version 8420 (0.0010) [2023-12-25 23:38:10,095][123091] Updated weights for policy 0, policy_version 8430 (0.0009) [2023-12-25 23:38:10,158][123091] Updated weights for policy 0, policy_version 8440 (0.0009) [2023-12-25 23:38:10,466][123090] Updated weights for policy 1, policy_version 8327 (0.0007) [2023-12-25 23:38:10,522][123090] Updated weights for policy 1, policy_version 8337 (0.0007) [2023-12-25 23:38:10,570][123090] Updated weights for policy 1, policy_version 8347 (0.0010) [2023-12-25 23:38:11,000][123091] Updated weights for policy 0, policy_version 8450 (0.0009) [2023-12-25 23:38:11,062][123091] Updated weights for policy 0, policy_version 8460 (0.0007) [2023-12-25 23:38:11,128][123091] Updated weights for policy 0, policy_version 8470 (0.0007) [2023-12-25 23:38:11,195][123091] Updated weights for policy 0, policy_version 8480 (0.0009) [2023-12-25 23:38:11,399][123090] Updated weights for policy 1, policy_version 8357 (0.0009) [2023-12-25 23:38:11,471][123090] Updated weights for policy 1, policy_version 8367 (0.0007) [2023-12-25 23:38:11,535][123090] Updated weights for policy 1, policy_version 8377 (0.0010) [2023-12-25 23:38:12,045][123091] Updated weights for policy 0, policy_version 8490 (0.0008) [2023-12-25 23:38:12,115][123091] Updated weights for policy 0, policy_version 8500 (0.0008) [2023-12-25 23:38:12,186][123091] Updated weights for policy 0, policy_version 8510 (0.0006) [2023-12-25 23:38:12,361][123090] Updated weights for policy 1, policy_version 8387 (0.0009) [2023-12-25 23:38:12,419][123090] Updated weights for policy 1, policy_version 8397 (0.0008) [2023-12-25 23:38:12,467][123090] Updated weights for policy 1, policy_version 8407 (0.0008) [2023-12-25 23:38:12,971][123091] Updated weights for policy 0, policy_version 8520 (0.0009) [2023-12-25 23:38:13,029][123091] Updated weights for policy 0, policy_version 8530 (0.0010) [2023-12-25 23:38:13,079][123091] Updated weights for policy 0, policy_version 8540 (0.0009) [2023-12-25 23:38:13,258][123090] Updated weights for policy 1, policy_version 8417 (0.0008) [2023-12-25 23:38:13,324][123090] Updated weights for policy 1, policy_version 8427 (0.0010) [2023-12-25 23:38:13,394][123090] Updated weights for policy 1, policy_version 8437 (0.0010) [2023-12-25 23:38:13,460][123090] Updated weights for policy 1, policy_version 8447 (0.0010) [2023-12-25 23:38:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17399.8). Total num frames: 4349952. Throughput: 0: 8908.1, 1: 8881.7. Samples: 4345480. Policy #0 lag: (min: 21.0, avg: 35.6, max: 53.0) [2023-12-25 23:38:13,785][121949] Avg episode reward: [(0, '1132.134'), (1, '1674.301')] [2023-12-25 23:38:13,934][123091] Updated weights for policy 0, policy_version 8550 (0.0009) [2023-12-25 23:38:13,981][123091] Updated weights for policy 0, policy_version 8560 (0.0010) [2023-12-25 23:38:14,025][123091] Updated weights for policy 0, policy_version 8570 (0.0010) [2023-12-25 23:38:14,243][123090] Updated weights for policy 1, policy_version 8457 (0.0010) [2023-12-25 23:38:14,292][123090] Updated weights for policy 1, policy_version 8467 (0.0007) [2023-12-25 23:38:14,339][123090] Updated weights for policy 1, policy_version 8477 (0.0005) [2023-12-25 23:38:14,747][123091] Updated weights for policy 0, policy_version 8580 (0.0008) [2023-12-25 23:38:14,819][123091] Updated weights for policy 0, policy_version 8590 (0.0007) [2023-12-25 23:38:14,891][123091] Updated weights for policy 0, policy_version 8600 (0.0006) [2023-12-25 23:38:15,053][123090] Updated weights for policy 1, policy_version 8487 (0.0005) [2023-12-25 23:38:15,127][123090] Updated weights for policy 1, policy_version 8497 (0.0006) [2023-12-25 23:38:15,200][123090] Updated weights for policy 1, policy_version 8507 (0.0010) [2023-12-25 23:38:15,550][123091] Updated weights for policy 0, policy_version 8610 (0.0006) [2023-12-25 23:38:15,616][123091] Updated weights for policy 0, policy_version 8620 (0.0005) [2023-12-25 23:38:15,685][123091] Updated weights for policy 0, policy_version 8630 (0.0006) [2023-12-25 23:38:15,744][123091] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-12-25 23:38:15,888][123090] Updated weights for policy 1, policy_version 8517 (0.0009) [2023-12-25 23:38:15,953][123090] Updated weights for policy 1, policy_version 8527 (0.0006) [2023-12-25 23:38:16,000][123090] Updated weights for policy 1, policy_version 8537 (0.0005) [2023-12-25 23:38:16,330][123091] Updated weights for policy 0, policy_version 8650 (0.0009) [2023-12-25 23:38:16,397][123091] Updated weights for policy 0, policy_version 8660 (0.0010) [2023-12-25 23:38:16,462][123091] Updated weights for policy 0, policy_version 8670 (0.0010) [2023-12-25 23:38:16,720][123090] Updated weights for policy 1, policy_version 8547 (0.0005) [2023-12-25 23:38:16,777][123090] Updated weights for policy 1, policy_version 8557 (0.0006) [2023-12-25 23:38:16,836][123090] Updated weights for policy 1, policy_version 8567 (0.0005) [2023-12-25 23:38:17,271][123091] Updated weights for policy 0, policy_version 8680 (0.0010) [2023-12-25 23:38:17,323][123091] Updated weights for policy 0, policy_version 8690 (0.0010) [2023-12-25 23:38:17,387][123091] Updated weights for policy 0, policy_version 8700 (0.0011) [2023-12-25 23:38:17,476][123090] Updated weights for policy 1, policy_version 8577 (0.0005) [2023-12-25 23:38:17,533][123090] Updated weights for policy 1, policy_version 8587 (0.0005) [2023-12-25 23:38:17,592][123090] Updated weights for policy 1, policy_version 8597 (0.0006) [2023-12-25 23:38:17,673][123090] Updated weights for policy 1, policy_version 8607 (0.0008) [2023-12-25 23:38:18,178][123091] Updated weights for policy 0, policy_version 8710 (0.0011) [2023-12-25 23:38:18,240][123091] Updated weights for policy 0, policy_version 8720 (0.0011) [2023-12-25 23:38:18,299][123091] Updated weights for policy 0, policy_version 8730 (0.0010) [2023-12-25 23:38:18,472][123090] Updated weights for policy 1, policy_version 8617 (0.0009) [2023-12-25 23:38:18,539][123090] Updated weights for policy 1, policy_version 8627 (0.0010) [2023-12-25 23:38:18,603][123090] Updated weights for policy 1, policy_version 8637 (0.0009) [2023-12-25 23:38:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17444.2). Total num frames: 4448256. Throughput: 0: 9006.5, 1: 8936.8. Samples: 4458012. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-25 23:38:18,785][121949] Avg episode reward: [(0, '1139.539'), (1, '1633.632')] [2023-12-25 23:38:19,046][123091] Updated weights for policy 0, policy_version 8740 (0.0009) [2023-12-25 23:38:19,118][123091] Updated weights for policy 0, policy_version 8750 (0.0006) [2023-12-25 23:38:19,180][123091] Updated weights for policy 0, policy_version 8760 (0.0006) [2023-12-25 23:38:19,501][123090] Updated weights for policy 1, policy_version 8647 (0.0010) [2023-12-25 23:38:19,573][123090] Updated weights for policy 1, policy_version 8657 (0.0010) [2023-12-25 23:38:19,639][123090] Updated weights for policy 1, policy_version 8667 (0.0009) [2023-12-25 23:38:19,978][123091] Updated weights for policy 0, policy_version 8770 (0.0009) [2023-12-25 23:38:20,043][123091] Updated weights for policy 0, policy_version 8780 (0.0009) [2023-12-25 23:38:20,102][123091] Updated weights for policy 0, policy_version 8790 (0.0010) [2023-12-25 23:38:20,166][123091] Updated weights for policy 0, policy_version 8800 (0.0010) [2023-12-25 23:38:20,491][123090] Updated weights for policy 1, policy_version 8677 (0.0009) [2023-12-25 23:38:20,544][123090] Updated weights for policy 1, policy_version 8687 (0.0009) [2023-12-25 23:38:20,613][123090] Updated weights for policy 1, policy_version 8697 (0.0009) [2023-12-25 23:38:20,956][123091] Updated weights for policy 0, policy_version 8810 (0.0009) [2023-12-25 23:38:21,018][123091] Updated weights for policy 0, policy_version 8820 (0.0010) [2023-12-25 23:38:21,101][123091] Updated weights for policy 0, policy_version 8830 (0.0010) [2023-12-25 23:38:21,495][123090] Updated weights for policy 1, policy_version 8707 (0.0010) [2023-12-25 23:38:21,566][123090] Updated weights for policy 1, policy_version 8717 (0.0010) [2023-12-25 23:38:21,630][123090] Updated weights for policy 1, policy_version 8727 (0.0009) [2023-12-25 23:38:21,994][123091] Updated weights for policy 0, policy_version 8840 (0.0006) [2023-12-25 23:38:22,054][123091] Updated weights for policy 0, policy_version 8850 (0.0006) [2023-12-25 23:38:22,122][123091] Updated weights for policy 0, policy_version 8860 (0.0007) [2023-12-25 23:38:22,532][123090] Updated weights for policy 1, policy_version 8737 (0.0009) [2023-12-25 23:38:22,599][123090] Updated weights for policy 1, policy_version 8747 (0.0010) [2023-12-25 23:38:22,663][123090] Updated weights for policy 1, policy_version 8757 (0.0010) [2023-12-25 23:38:22,727][123090] Updated weights for policy 1, policy_version 8767 (0.0010) [2023-12-25 23:38:22,848][123091] Updated weights for policy 0, policy_version 8870 (0.0010) [2023-12-25 23:38:22,898][123091] Updated weights for policy 0, policy_version 8880 (0.0010) [2023-12-25 23:38:22,956][123091] Updated weights for policy 0, policy_version 8890 (0.0009) [2023-12-25 23:38:23,572][123090] Updated weights for policy 1, policy_version 8777 (0.0006) [2023-12-25 23:38:23,644][123090] Updated weights for policy 1, policy_version 8787 (0.0005) [2023-12-25 23:38:23,700][123090] Updated weights for policy 1, policy_version 8797 (0.0009) [2023-12-25 23:38:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17423.7). Total num frames: 4530176. Throughput: 0: 8982.2, 1: 8876.5. Samples: 4508264. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-25 23:38:23,786][121949] Avg episode reward: [(0, '1167.411'), (1, '1701.412')] [2023-12-25 23:38:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000008800_2252800.pth... [2023-12-25 23:38:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000007776_1990656.pth [2023-12-25 23:38:23,815][123091] Updated weights for policy 0, policy_version 8900 (0.0010) [2023-12-25 23:38:23,868][123091] Updated weights for policy 0, policy_version 8911 (0.0010) [2023-12-25 23:38:23,920][123091] Updated weights for policy 0, policy_version 8921 (0.0009) [2023-12-25 23:38:23,952][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000008928_2285568.pth... [2023-12-25 23:38:23,956][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000007872_2015232.pth [2023-12-25 23:38:24,485][123090] Updated weights for policy 1, policy_version 8807 (0.0007) [2023-12-25 23:38:24,560][123090] Updated weights for policy 1, policy_version 8817 (0.0005) [2023-12-25 23:38:24,612][123090] Updated weights for policy 1, policy_version 8827 (0.0007) [2023-12-25 23:38:24,812][123091] Updated weights for policy 0, policy_version 8931 (0.0009) [2023-12-25 23:38:24,873][123091] Updated weights for policy 0, policy_version 8941 (0.0009) [2023-12-25 23:38:24,937][123091] Updated weights for policy 0, policy_version 8951 (0.0009) [2023-12-25 23:38:25,235][123090] Updated weights for policy 1, policy_version 8837 (0.0008) [2023-12-25 23:38:25,306][123090] Updated weights for policy 1, policy_version 8847 (0.0010) [2023-12-25 23:38:25,377][123090] Updated weights for policy 1, policy_version 8857 (0.0009) [2023-12-25 23:38:25,718][123091] Updated weights for policy 0, policy_version 8961 (0.0008) [2023-12-25 23:38:25,766][123091] Updated weights for policy 0, policy_version 8971 (0.0005) [2023-12-25 23:38:25,820][123091] Updated weights for policy 0, policy_version 8981 (0.0005) [2023-12-25 23:38:25,875][123091] Updated weights for policy 0, policy_version 8991 (0.0006) [2023-12-25 23:38:26,260][123090] Updated weights for policy 1, policy_version 8867 (0.0009) [2023-12-25 23:38:26,326][123090] Updated weights for policy 1, policy_version 8877 (0.0009) [2023-12-25 23:38:26,393][123090] Updated weights for policy 1, policy_version 8887 (0.0010) [2023-12-25 23:38:26,566][123091] Updated weights for policy 0, policy_version 9001 (0.0010) [2023-12-25 23:38:26,629][123091] Updated weights for policy 0, policy_version 9011 (0.0010) [2023-12-25 23:38:26,692][123091] Updated weights for policy 0, policy_version 9021 (0.0010) [2023-12-25 23:38:27,278][123090] Updated weights for policy 1, policy_version 8897 (0.0010) [2023-12-25 23:38:27,343][123090] Updated weights for policy 1, policy_version 8907 (0.0009) [2023-12-25 23:38:27,395][123090] Updated weights for policy 1, policy_version 8917 (0.0009) [2023-12-25 23:38:27,428][123091] Updated weights for policy 0, policy_version 9031 (0.0007) [2023-12-25 23:38:27,445][123090] Updated weights for policy 1, policy_version 8927 (0.0009) [2023-12-25 23:38:27,474][123091] Updated weights for policy 0, policy_version 9041 (0.0005) [2023-12-25 23:38:27,517][123091] Updated weights for policy 0, policy_version 9051 (0.0005) [2023-12-25 23:38:28,182][123091] Updated weights for policy 0, policy_version 9061 (0.0005) [2023-12-25 23:38:28,245][123091] Updated weights for policy 0, policy_version 9071 (0.0005) [2023-12-25 23:38:28,320][123091] Updated weights for policy 0, policy_version 9081 (0.0006) [2023-12-25 23:38:28,380][123090] Updated weights for policy 1, policy_version 8938 (0.0009) [2023-12-25 23:38:28,442][123090] Updated weights for policy 1, policy_version 8948 (0.0010) [2023-12-25 23:38:28,510][123090] Updated weights for policy 1, policy_version 8958 (0.0007) [2023-12-25 23:38:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17435.1). Total num frames: 4620288. Throughput: 0: 9011.2, 1: 8821.8. Samples: 4612948. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-25 23:38:28,785][121949] Avg episode reward: [(0, '1173.801'), (1, '1780.290')] [2023-12-25 23:38:28,786][123008] Saving new best policy, reward=1780.290! [2023-12-25 23:38:29,001][123091] Updated weights for policy 0, policy_version 9091 (0.0008) [2023-12-25 23:38:29,072][123091] Updated weights for policy 0, policy_version 9101 (0.0006) [2023-12-25 23:38:29,138][123091] Updated weights for policy 0, policy_version 9111 (0.0010) [2023-12-25 23:38:29,276][123090] Updated weights for policy 1, policy_version 8968 (0.0007) [2023-12-25 23:38:29,346][123090] Updated weights for policy 1, policy_version 8978 (0.0006) [2023-12-25 23:38:29,421][123090] Updated weights for policy 1, policy_version 8988 (0.0011) [2023-12-25 23:38:29,918][123091] Updated weights for policy 0, policy_version 9121 (0.0010) [2023-12-25 23:38:29,976][123091] Updated weights for policy 0, policy_version 9131 (0.0008) [2023-12-25 23:38:30,033][123091] Updated weights for policy 0, policy_version 9141 (0.0008) [2023-12-25 23:38:30,095][123091] Updated weights for policy 0, policy_version 9151 (0.0008) [2023-12-25 23:38:30,194][123090] Updated weights for policy 1, policy_version 8998 (0.0009) [2023-12-25 23:38:30,257][123090] Updated weights for policy 1, policy_version 9008 (0.0010) [2023-12-25 23:38:30,323][123090] Updated weights for policy 1, policy_version 9018 (0.0010) [2023-12-25 23:38:30,794][123091] Updated weights for policy 0, policy_version 9161 (0.0006) [2023-12-25 23:38:30,842][123091] Updated weights for policy 0, policy_version 9171 (0.0005) [2023-12-25 23:38:30,890][123091] Updated weights for policy 0, policy_version 9181 (0.0005) [2023-12-25 23:38:31,055][123090] Updated weights for policy 1, policy_version 9028 (0.0009) [2023-12-25 23:38:31,107][123090] Updated weights for policy 1, policy_version 9038 (0.0007) [2023-12-25 23:38:31,168][123090] Updated weights for policy 1, policy_version 9048 (0.0010) [2023-12-25 23:38:31,626][123091] Updated weights for policy 0, policy_version 9191 (0.0007) [2023-12-25 23:38:31,692][123091] Updated weights for policy 0, policy_version 9201 (0.0010) [2023-12-25 23:38:31,768][123091] Updated weights for policy 0, policy_version 9211 (0.0010) [2023-12-25 23:38:31,930][123090] Updated weights for policy 1, policy_version 9058 (0.0009) [2023-12-25 23:38:31,993][123090] Updated weights for policy 1, policy_version 9068 (0.0005) [2023-12-25 23:38:32,050][123090] Updated weights for policy 1, policy_version 9078 (0.0005) [2023-12-25 23:38:32,118][123090] Updated weights for policy 1, policy_version 9088 (0.0006) [2023-12-25 23:38:32,630][123091] Updated weights for policy 0, policy_version 9221 (0.0010) [2023-12-25 23:38:32,680][123091] Updated weights for policy 0, policy_version 9232 (0.0009) [2023-12-25 23:38:32,727][123091] Updated weights for policy 0, policy_version 9242 (0.0009) [2023-12-25 23:38:32,897][123090] Updated weights for policy 1, policy_version 9098 (0.0009) [2023-12-25 23:38:32,948][123090] Updated weights for policy 1, policy_version 9108 (0.0010) [2023-12-25 23:38:33,000][123090] Updated weights for policy 1, policy_version 9119 (0.0009) [2023-12-25 23:38:33,463][123091] Updated weights for policy 0, policy_version 9252 (0.0008) [2023-12-25 23:38:33,521][123091] Updated weights for policy 0, policy_version 9262 (0.0005) [2023-12-25 23:38:33,579][123091] Updated weights for policy 0, policy_version 9272 (0.0005) [2023-12-25 23:38:33,684][123090] Updated weights for policy 1, policy_version 9129 (0.0006) [2023-12-25 23:38:33,735][123090] Updated weights for policy 1, policy_version 9140 (0.0007) [2023-12-25 23:38:33,781][123090] Updated weights for policy 1, policy_version 9150 (0.0005) [2023-12-25 23:38:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17445.9). Total num frames: 4710400. Throughput: 0: 9049.6, 1: 8767.6. Samples: 4724216. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-25 23:38:33,785][121949] Avg episode reward: [(0, '1166.738'), (1, '1912.631')] [2023-12-25 23:38:33,789][123008] Saving new best policy, reward=1912.631! [2023-12-25 23:38:34,278][123091] Updated weights for policy 0, policy_version 9282 (0.0006) [2023-12-25 23:38:34,342][123091] Updated weights for policy 0, policy_version 9292 (0.0009) [2023-12-25 23:38:34,415][123091] Updated weights for policy 0, policy_version 9302 (0.0009) [2023-12-25 23:38:34,471][123091] Updated weights for policy 0, policy_version 9312 (0.0009) [2023-12-25 23:38:34,515][123090] Updated weights for policy 1, policy_version 9160 (0.0006) [2023-12-25 23:38:34,586][123090] Updated weights for policy 1, policy_version 9170 (0.0009) [2023-12-25 23:38:34,633][123090] Updated weights for policy 1, policy_version 9180 (0.0008) [2023-12-25 23:38:35,327][123091] Updated weights for policy 0, policy_version 9322 (0.0009) [2023-12-25 23:38:35,380][123091] Updated weights for policy 0, policy_version 9332 (0.0009) [2023-12-25 23:38:35,406][123090] Updated weights for policy 1, policy_version 9190 (0.0008) [2023-12-25 23:38:35,431][123091] Updated weights for policy 0, policy_version 9342 (0.0008) [2023-12-25 23:38:35,462][123090] Updated weights for policy 1, policy_version 9200 (0.0009) [2023-12-25 23:38:35,518][123090] Updated weights for policy 1, policy_version 9210 (0.0009) [2023-12-25 23:38:36,278][123091] Updated weights for policy 0, policy_version 9352 (0.0010) [2023-12-25 23:38:36,315][123090] Updated weights for policy 1, policy_version 9220 (0.0007) [2023-12-25 23:38:36,346][123091] Updated weights for policy 0, policy_version 9362 (0.0010) [2023-12-25 23:38:36,376][123090] Updated weights for policy 1, policy_version 9230 (0.0006) [2023-12-25 23:38:36,409][123091] Updated weights for policy 0, policy_version 9372 (0.0009) [2023-12-25 23:38:36,438][123090] Updated weights for policy 1, policy_version 9240 (0.0005) [2023-12-25 23:38:37,065][123091] Updated weights for policy 0, policy_version 9382 (0.0007) [2023-12-25 23:38:37,125][123091] Updated weights for policy 0, policy_version 9392 (0.0006) [2023-12-25 23:38:37,191][123090] Updated weights for policy 1, policy_version 9250 (0.0007) [2023-12-25 23:38:37,195][123091] Updated weights for policy 0, policy_version 9402 (0.0009) [2023-12-25 23:38:37,251][123090] Updated weights for policy 1, policy_version 9260 (0.0006) [2023-12-25 23:38:37,321][123090] Updated weights for policy 1, policy_version 9270 (0.0010) [2023-12-25 23:38:37,384][123090] Updated weights for policy 1, policy_version 9280 (0.0007) [2023-12-25 23:38:37,948][123091] Updated weights for policy 0, policy_version 9412 (0.0009) [2023-12-25 23:38:38,004][123091] Updated weights for policy 0, policy_version 9422 (0.0010) [2023-12-25 23:38:38,059][123091] Updated weights for policy 0, policy_version 9432 (0.0009) [2023-12-25 23:38:38,165][123090] Updated weights for policy 1, policy_version 9290 (0.0009) [2023-12-25 23:38:38,230][123090] Updated weights for policy 1, policy_version 9300 (0.0010) [2023-12-25 23:38:38,294][123090] Updated weights for policy 1, policy_version 9311 (0.0009) [2023-12-25 23:38:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17456.4). Total num frames: 4800512. Throughput: 0: 9060.0, 1: 8813.6. Samples: 4778596. Policy #0 lag: (min: 31.0, avg: 37.5, max: 63.0) [2023-12-25 23:38:38,784][121949] Avg episode reward: [(0, '1166.328'), (1, '1904.042')] [2023-12-25 23:38:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000009312_2383872.pth... [2023-12-25 23:38:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000009440_2416640.pth... [2023-12-25 23:38:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000008384_2146304.pth [2023-12-25 23:38:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000008288_2121728.pth [2023-12-25 23:38:38,901][123091] Updated weights for policy 0, policy_version 9442 (0.0009) [2023-12-25 23:38:38,961][123091] Updated weights for policy 0, policy_version 9452 (0.0010) [2023-12-25 23:38:39,012][123091] Updated weights for policy 0, policy_version 9462 (0.0010) [2023-12-25 23:38:39,072][123091] Updated weights for policy 0, policy_version 9472 (0.0010) [2023-12-25 23:38:39,141][123090] Updated weights for policy 1, policy_version 9321 (0.0009) [2023-12-25 23:38:39,201][123090] Updated weights for policy 1, policy_version 9331 (0.0009) [2023-12-25 23:38:39,268][123090] Updated weights for policy 1, policy_version 9341 (0.0009) [2023-12-25 23:38:39,936][123091] Updated weights for policy 0, policy_version 9482 (0.0009) [2023-12-25 23:38:40,007][123091] Updated weights for policy 0, policy_version 9492 (0.0011) [2023-12-25 23:38:40,071][123091] Updated weights for policy 0, policy_version 9502 (0.0010) [2023-12-25 23:38:40,123][123090] Updated weights for policy 1, policy_version 9351 (0.0009) [2023-12-25 23:38:40,186][123090] Updated weights for policy 1, policy_version 9361 (0.0009) [2023-12-25 23:38:40,259][123090] Updated weights for policy 1, policy_version 9371 (0.0009) [2023-12-25 23:38:40,905][123091] Updated weights for policy 0, policy_version 9512 (0.0010) [2023-12-25 23:38:40,971][123091] Updated weights for policy 0, policy_version 9522 (0.0011) [2023-12-25 23:38:41,033][123091] Updated weights for policy 0, policy_version 9532 (0.0008) [2023-12-25 23:38:41,058][123090] Updated weights for policy 1, policy_version 9381 (0.0010) [2023-12-25 23:38:41,134][123090] Updated weights for policy 1, policy_version 9391 (0.0010) [2023-12-25 23:38:41,201][123090] Updated weights for policy 1, policy_version 9401 (0.0010) [2023-12-25 23:38:41,848][123091] Updated weights for policy 0, policy_version 9542 (0.0008) [2023-12-25 23:38:41,898][123091] Updated weights for policy 0, policy_version 9552 (0.0009) [2023-12-25 23:38:41,963][123091] Updated weights for policy 0, policy_version 9562 (0.0009) [2023-12-25 23:38:42,101][123090] Updated weights for policy 1, policy_version 9411 (0.0010) [2023-12-25 23:38:42,160][123090] Updated weights for policy 1, policy_version 9421 (0.0009) [2023-12-25 23:38:42,220][123090] Updated weights for policy 1, policy_version 9431 (0.0009) [2023-12-25 23:38:42,809][123091] Updated weights for policy 0, policy_version 9572 (0.0008) [2023-12-25 23:38:42,874][123091] Updated weights for policy 0, policy_version 9582 (0.0005) [2023-12-25 23:38:42,934][123091] Updated weights for policy 0, policy_version 9592 (0.0007) [2023-12-25 23:38:43,113][123090] Updated weights for policy 1, policy_version 9441 (0.0010) [2023-12-25 23:38:43,174][123090] Updated weights for policy 1, policy_version 9451 (0.0009) [2023-12-25 23:38:43,223][123090] Updated weights for policy 1, policy_version 9461 (0.0009) [2023-12-25 23:38:43,277][123090] Updated weights for policy 1, policy_version 9472 (0.0009) [2023-12-25 23:38:43,734][123091] Updated weights for policy 0, policy_version 9602 (0.0009) [2023-12-25 23:38:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17437.3). Total num frames: 4882432. Throughput: 0: 8904.8, 1: 8781.8. Samples: 4880580. Policy #0 lag: (min: 11.0, avg: 37.8, max: 41.0) [2023-12-25 23:38:43,785][121949] Avg episode reward: [(0, '1191.837'), (1, '2020.298')] [2023-12-25 23:38:43,786][123008] Saving new best policy, reward=2020.298! [2023-12-25 23:38:43,795][123091] Updated weights for policy 0, policy_version 9612 (0.0010) [2023-12-25 23:38:43,868][123091] Updated weights for policy 0, policy_version 9622 (0.0010) [2023-12-25 23:38:43,925][123091] Updated weights for policy 0, policy_version 9632 (0.0010) [2023-12-25 23:38:44,020][123090] Updated weights for policy 1, policy_version 9482 (0.0005) [2023-12-25 23:38:44,071][123090] Updated weights for policy 1, policy_version 9492 (0.0005) [2023-12-25 23:38:44,124][123090] Updated weights for policy 1, policy_version 9502 (0.0005) [2023-12-25 23:38:44,786][123091] Updated weights for policy 0, policy_version 9642 (0.0008) [2023-12-25 23:38:44,852][123091] Updated weights for policy 0, policy_version 9652 (0.0005) [2023-12-25 23:38:44,905][123090] Updated weights for policy 1, policy_version 9512 (0.0010) [2023-12-25 23:38:44,910][123091] Updated weights for policy 0, policy_version 9662 (0.0006) [2023-12-25 23:38:44,965][123090] Updated weights for policy 1, policy_version 9522 (0.0010) [2023-12-25 23:38:45,029][123090] Updated weights for policy 1, policy_version 9532 (0.0010) [2023-12-25 23:38:45,692][123091] Updated weights for policy 0, policy_version 9672 (0.0008) [2023-12-25 23:38:45,748][123091] Updated weights for policy 0, policy_version 9682 (0.0009) [2023-12-25 23:38:45,755][123090] Updated weights for policy 1, policy_version 9542 (0.0010) [2023-12-25 23:38:45,804][123091] Updated weights for policy 0, policy_version 9692 (0.0005) [2023-12-25 23:38:45,818][123090] Updated weights for policy 1, policy_version 9552 (0.0010) [2023-12-25 23:38:45,880][123090] Updated weights for policy 1, policy_version 9562 (0.0010) [2023-12-25 23:38:46,584][123091] Updated weights for policy 0, policy_version 9702 (0.0008) [2023-12-25 23:38:46,639][123091] Updated weights for policy 0, policy_version 9712 (0.0009) [2023-12-25 23:38:46,685][123090] Updated weights for policy 1, policy_version 9572 (0.0010) [2023-12-25 23:38:46,701][123091] Updated weights for policy 0, policy_version 9722 (0.0007) [2023-12-25 23:38:46,740][123090] Updated weights for policy 1, policy_version 9582 (0.0006) [2023-12-25 23:38:46,809][123090] Updated weights for policy 1, policy_version 9592 (0.0005) [2023-12-25 23:38:47,407][123090] Updated weights for policy 1, policy_version 9602 (0.0005) [2023-12-25 23:38:47,463][123090] Updated weights for policy 1, policy_version 9612 (0.0005) [2023-12-25 23:38:47,514][123091] Updated weights for policy 0, policy_version 9732 (0.0008) [2023-12-25 23:38:47,521][123090] Updated weights for policy 1, policy_version 9622 (0.0005) [2023-12-25 23:38:47,561][123091] Updated weights for policy 0, policy_version 9742 (0.0009) [2023-12-25 23:38:47,579][123090] Updated weights for policy 1, policy_version 9632 (0.0005) [2023-12-25 23:38:47,612][123091] Updated weights for policy 0, policy_version 9752 (0.0005) [2023-12-25 23:38:48,347][123091] Updated weights for policy 0, policy_version 9762 (0.0006) [2023-12-25 23:38:48,370][123090] Updated weights for policy 1, policy_version 9642 (0.0011) [2023-12-25 23:38:48,414][123091] Updated weights for policy 0, policy_version 9772 (0.0007) [2023-12-25 23:38:48,439][123090] Updated weights for policy 1, policy_version 9652 (0.0011) [2023-12-25 23:38:48,479][123091] Updated weights for policy 0, policy_version 9782 (0.0007) [2023-12-25 23:38:48,503][123090] Updated weights for policy 1, policy_version 9662 (0.0011) [2023-12-25 23:38:48,547][123091] Updated weights for policy 0, policy_version 9792 (0.0009) [2023-12-25 23:38:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17476.3). Total num frames: 4980736. Throughput: 0: 8926.0, 1: 8806.6. Samples: 4988800. Policy #0 lag: (min: 11.0, avg: 37.8, max: 41.0) [2023-12-25 23:38:48,785][121949] Avg episode reward: [(0, '1198.678'), (1, '1993.364')] [2023-12-25 23:38:49,177][123091] Updated weights for policy 0, policy_version 9802 (0.0005) [2023-12-25 23:38:49,245][123091] Updated weights for policy 0, policy_version 9812 (0.0007) [2023-12-25 23:38:49,315][123090] Updated weights for policy 1, policy_version 9672 (0.0010) [2023-12-25 23:38:49,319][123091] Updated weights for policy 0, policy_version 9822 (0.0008) [2023-12-25 23:38:49,391][123090] Updated weights for policy 1, policy_version 9682 (0.0011) [2023-12-25 23:38:49,455][123090] Updated weights for policy 1, policy_version 9692 (0.0011) [2023-12-25 23:38:50,030][123091] Updated weights for policy 0, policy_version 9832 (0.0010) [2023-12-25 23:38:50,090][123091] Updated weights for policy 0, policy_version 9842 (0.0011) [2023-12-25 23:38:50,153][123091] Updated weights for policy 0, policy_version 9852 (0.0010) [2023-12-25 23:38:50,293][123090] Updated weights for policy 1, policy_version 9702 (0.0011) [2023-12-25 23:38:50,353][123090] Updated weights for policy 1, policy_version 9712 (0.0011) [2023-12-25 23:38:50,412][123090] Updated weights for policy 1, policy_version 9722 (0.0011) [2023-12-25 23:38:50,928][123091] Updated weights for policy 0, policy_version 9862 (0.0011) [2023-12-25 23:38:50,991][123091] Updated weights for policy 0, policy_version 9872 (0.0011) [2023-12-25 23:38:51,058][123091] Updated weights for policy 0, policy_version 9882 (0.0010) [2023-12-25 23:38:51,189][123090] Updated weights for policy 1, policy_version 9732 (0.0010) [2023-12-25 23:38:51,250][123090] Updated weights for policy 1, policy_version 9742 (0.0009) [2023-12-25 23:38:51,308][123090] Updated weights for policy 1, policy_version 9752 (0.0009) [2023-12-25 23:38:51,937][123091] Updated weights for policy 0, policy_version 9892 (0.0009) [2023-12-25 23:38:51,995][123091] Updated weights for policy 0, policy_version 9902 (0.0009) [2023-12-25 23:38:52,059][123091] Updated weights for policy 0, policy_version 9912 (0.0009) [2023-12-25 23:38:52,204][123090] Updated weights for policy 1, policy_version 9762 (0.0011) [2023-12-25 23:38:52,267][123090] Updated weights for policy 1, policy_version 9772 (0.0010) [2023-12-25 23:38:52,327][123090] Updated weights for policy 1, policy_version 9782 (0.0011) [2023-12-25 23:38:52,392][123090] Updated weights for policy 1, policy_version 9792 (0.0010) [2023-12-25 23:38:52,944][123091] Updated weights for policy 0, policy_version 9922 (0.0009) [2023-12-25 23:38:52,995][123091] Updated weights for policy 0, policy_version 9932 (0.0009) [2023-12-25 23:38:53,047][123091] Updated weights for policy 0, policy_version 9942 (0.0008) [2023-12-25 23:38:53,094][123091] Updated weights for policy 0, policy_version 9952 (0.0008) [2023-12-25 23:38:53,223][123090] Updated weights for policy 1, policy_version 9802 (0.0010) [2023-12-25 23:38:53,284][123090] Updated weights for policy 1, policy_version 9812 (0.0011) [2023-12-25 23:38:53,342][123090] Updated weights for policy 1, policy_version 9822 (0.0010) [2023-12-25 23:38:53,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17612.6, 300 sec: 17457.4). Total num frames: 5062656. Throughput: 0: 8936.3, 1: 8803.6. Samples: 5041748. Policy #0 lag: (min: 27.0, avg: 34.1, max: 59.0) [2023-12-25 23:38:53,786][121949] Avg episode reward: [(0, '1180.642'), (1, '1854.334')] [2023-12-25 23:38:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000009952_2547712.pth... [2023-12-25 23:38:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000009824_2514944.pth... [2023-12-25 23:38:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000008928_2285568.pth [2023-12-25 23:38:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000008800_2252800.pth [2023-12-25 23:38:53,959][123091] Updated weights for policy 0, policy_version 9962 (0.0009) [2023-12-25 23:38:54,012][123091] Updated weights for policy 0, policy_version 9973 (0.0009) [2023-12-25 23:38:54,060][123091] Updated weights for policy 0, policy_version 9983 (0.0009) [2023-12-25 23:38:54,169][123090] Updated weights for policy 1, policy_version 9832 (0.0010) [2023-12-25 23:38:54,236][123090] Updated weights for policy 1, policy_version 9842 (0.0010) [2023-12-25 23:38:54,299][123090] Updated weights for policy 1, policy_version 9852 (0.0010) [2023-12-25 23:38:54,919][123091] Updated weights for policy 0, policy_version 9993 (0.0009) [2023-12-25 23:38:54,971][123091] Updated weights for policy 0, policy_version 10003 (0.0009) [2023-12-25 23:38:55,024][123091] Updated weights for policy 0, policy_version 10013 (0.0010) [2023-12-25 23:38:55,126][123090] Updated weights for policy 1, policy_version 9862 (0.0010) [2023-12-25 23:38:55,174][123090] Updated weights for policy 1, policy_version 9872 (0.0010) [2023-12-25 23:38:55,230][123090] Updated weights for policy 1, policy_version 9882 (0.0010) [2023-12-25 23:38:55,897][123091] Updated weights for policy 0, policy_version 10023 (0.0010) [2023-12-25 23:38:55,960][123091] Updated weights for policy 0, policy_version 10033 (0.0008) [2023-12-25 23:38:56,025][123091] Updated weights for policy 0, policy_version 10043 (0.0005) [2023-12-25 23:38:56,098][123090] Updated weights for policy 1, policy_version 9892 (0.0011) [2023-12-25 23:38:56,168][123090] Updated weights for policy 1, policy_version 9902 (0.0010) [2023-12-25 23:38:56,219][123090] Updated weights for policy 1, policy_version 9912 (0.0010) [2023-12-25 23:38:56,778][123091] Updated weights for policy 0, policy_version 10053 (0.0008) [2023-12-25 23:38:56,846][123091] Updated weights for policy 0, policy_version 10063 (0.0010) [2023-12-25 23:38:56,916][123091] Updated weights for policy 0, policy_version 10073 (0.0008) [2023-12-25 23:38:56,960][123090] Updated weights for policy 1, policy_version 9922 (0.0009) [2023-12-25 23:38:57,015][123090] Updated weights for policy 1, policy_version 9932 (0.0007) [2023-12-25 23:38:57,072][123090] Updated weights for policy 1, policy_version 9942 (0.0010) [2023-12-25 23:38:57,123][123090] Updated weights for policy 1, policy_version 9952 (0.0010) [2023-12-25 23:38:57,728][123091] Updated weights for policy 0, policy_version 10083 (0.0009) [2023-12-25 23:38:57,781][123091] Updated weights for policy 0, policy_version 10093 (0.0009) [2023-12-25 23:38:57,840][123091] Updated weights for policy 0, policy_version 10103 (0.0009) [2023-12-25 23:38:57,941][123090] Updated weights for policy 1, policy_version 9962 (0.0009) [2023-12-25 23:38:58,002][123090] Updated weights for policy 1, policy_version 9972 (0.0008) [2023-12-25 23:38:58,063][123090] Updated weights for policy 1, policy_version 9982 (0.0010) [2023-12-25 23:38:58,709][123091] Updated weights for policy 0, policy_version 10113 (0.0009) [2023-12-25 23:38:58,782][123091] Updated weights for policy 0, policy_version 10124 (0.0009) [2023-12-25 23:38:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 5144576. Throughput: 0: 8951.3, 1: 8809.5. Samples: 5144716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:38:58,785][121949] Avg episode reward: [(0, '1198.497'), (1, '1987.872')] [2023-12-25 23:38:58,852][123091] Updated weights for policy 0, policy_version 10134 (0.0009) [2023-12-25 23:38:58,915][123091] Updated weights for policy 0, policy_version 10144 (0.0008) [2023-12-25 23:38:59,015][123090] Updated weights for policy 1, policy_version 9992 (0.0010) [2023-12-25 23:38:59,078][123090] Updated weights for policy 1, policy_version 10002 (0.0010) [2023-12-25 23:38:59,133][123090] Updated weights for policy 1, policy_version 10012 (0.0010) [2023-12-25 23:38:59,766][123091] Updated weights for policy 0, policy_version 10154 (0.0009) [2023-12-25 23:38:59,843][123091] Updated weights for policy 0, policy_version 10164 (0.0009) [2023-12-25 23:38:59,916][123091] Updated weights for policy 0, policy_version 10174 (0.0008) [2023-12-25 23:38:59,941][123090] Updated weights for policy 1, policy_version 10022 (0.0010) [2023-12-25 23:39:00,013][123090] Updated weights for policy 1, policy_version 10032 (0.0011) [2023-12-25 23:39:00,080][123090] Updated weights for policy 1, policy_version 10042 (0.0010) [2023-12-25 23:39:00,715][123091] Updated weights for policy 0, policy_version 10184 (0.0010) [2023-12-25 23:39:00,762][123091] Updated weights for policy 0, policy_version 10194 (0.0010) [2023-12-25 23:39:00,817][123091] Updated weights for policy 0, policy_version 10204 (0.0009) [2023-12-25 23:39:00,923][123090] Updated weights for policy 1, policy_version 10052 (0.0009) [2023-12-25 23:39:00,977][123090] Updated weights for policy 1, policy_version 10062 (0.0005) [2023-12-25 23:39:01,046][123090] Updated weights for policy 1, policy_version 10072 (0.0007) [2023-12-25 23:39:01,582][123091] Updated weights for policy 0, policy_version 10214 (0.0008) [2023-12-25 23:39:01,645][123091] Updated weights for policy 0, policy_version 10224 (0.0009) [2023-12-25 23:39:01,705][123091] Updated weights for policy 0, policy_version 10234 (0.0006) [2023-12-25 23:39:01,874][123090] Updated weights for policy 1, policy_version 10082 (0.0007) [2023-12-25 23:39:01,936][123090] Updated weights for policy 1, policy_version 10092 (0.0010) [2023-12-25 23:39:01,994][123090] Updated weights for policy 1, policy_version 10102 (0.0010) [2023-12-25 23:39:02,053][123090] Updated weights for policy 1, policy_version 10112 (0.0009) [2023-12-25 23:39:02,493][123091] Updated weights for policy 0, policy_version 10244 (0.0008) [2023-12-25 23:39:02,547][123091] Updated weights for policy 0, policy_version 10254 (0.0007) [2023-12-25 23:39:02,605][123091] Updated weights for policy 0, policy_version 10264 (0.0005) [2023-12-25 23:39:02,919][123090] Updated weights for policy 1, policy_version 10122 (0.0005) [2023-12-25 23:39:02,991][123090] Updated weights for policy 1, policy_version 10132 (0.0006) [2023-12-25 23:39:03,042][123090] Updated weights for policy 1, policy_version 10142 (0.0010) [2023-12-25 23:39:03,281][123091] Updated weights for policy 0, policy_version 10274 (0.0006) [2023-12-25 23:39:03,334][123091] Updated weights for policy 0, policy_version 10284 (0.0005) [2023-12-25 23:39:03,386][123091] Updated weights for policy 0, policy_version 10294 (0.0005) [2023-12-25 23:39:03,435][123091] Updated weights for policy 0, policy_version 10304 (0.0005) [2023-12-25 23:39:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 5234688. Throughput: 0: 8929.7, 1: 8654.4. Samples: 5249300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:03,785][121949] Avg episode reward: [(0, '1151.052'), (1, '2055.154')] [2023-12-25 23:39:03,822][123090] Updated weights for policy 1, policy_version 10152 (0.0007) [2023-12-25 23:39:03,882][123090] Updated weights for policy 1, policy_version 10162 (0.0008) [2023-12-25 23:39:03,950][123090] Updated weights for policy 1, policy_version 10172 (0.0005) [2023-12-25 23:39:03,978][123008] Saving new best policy, reward=2055.154! [2023-12-25 23:39:04,041][123091] Updated weights for policy 0, policy_version 10314 (0.0006) [2023-12-25 23:39:04,108][123091] Updated weights for policy 0, policy_version 10324 (0.0006) [2023-12-25 23:39:04,168][123091] Updated weights for policy 0, policy_version 10334 (0.0010) [2023-12-25 23:39:04,587][123090] Updated weights for policy 1, policy_version 10182 (0.0007) [2023-12-25 23:39:04,653][123090] Updated weights for policy 1, policy_version 10192 (0.0009) [2023-12-25 23:39:04,714][123090] Updated weights for policy 1, policy_version 10202 (0.0009) [2023-12-25 23:39:04,960][123091] Updated weights for policy 0, policy_version 10344 (0.0010) [2023-12-25 23:39:05,011][123091] Updated weights for policy 0, policy_version 10354 (0.0010) [2023-12-25 23:39:05,053][123091] Updated weights for policy 0, policy_version 10364 (0.0010) [2023-12-25 23:39:05,524][123090] Updated weights for policy 1, policy_version 10212 (0.0007) [2023-12-25 23:39:05,582][123090] Updated weights for policy 1, policy_version 10222 (0.0005) [2023-12-25 23:39:05,638][123090] Updated weights for policy 1, policy_version 10232 (0.0005) [2023-12-25 23:39:05,866][123091] Updated weights for policy 0, policy_version 10374 (0.0007) [2023-12-25 23:39:05,928][123091] Updated weights for policy 0, policy_version 10384 (0.0005) [2023-12-25 23:39:05,988][123091] Updated weights for policy 0, policy_version 10394 (0.0007) [2023-12-25 23:39:06,322][123090] Updated weights for policy 1, policy_version 10242 (0.0006) [2023-12-25 23:39:06,380][123090] Updated weights for policy 1, policy_version 10252 (0.0009) [2023-12-25 23:39:06,439][123090] Updated weights for policy 1, policy_version 10262 (0.0009) [2023-12-25 23:39:06,496][123090] Updated weights for policy 1, policy_version 10272 (0.0008) [2023-12-25 23:39:06,747][123091] Updated weights for policy 0, policy_version 10404 (0.0008) [2023-12-25 23:39:06,812][123091] Updated weights for policy 0, policy_version 10414 (0.0006) [2023-12-25 23:39:06,876][123091] Updated weights for policy 0, policy_version 10424 (0.0006) [2023-12-25 23:39:07,403][123090] Updated weights for policy 1, policy_version 10282 (0.0009) [2023-12-25 23:39:07,460][123090] Updated weights for policy 1, policy_version 10292 (0.0010) [2023-12-25 23:39:07,509][123090] Updated weights for policy 1, policy_version 10302 (0.0009) [2023-12-25 23:39:07,572][123091] Updated weights for policy 0, policy_version 10434 (0.0007) [2023-12-25 23:39:07,633][123091] Updated weights for policy 0, policy_version 10444 (0.0010) [2023-12-25 23:39:07,700][123091] Updated weights for policy 0, policy_version 10454 (0.0009) [2023-12-25 23:39:07,761][123091] Updated weights for policy 0, policy_version 10464 (0.0009) [2023-12-25 23:39:08,395][123090] Updated weights for policy 1, policy_version 10312 (0.0009) [2023-12-25 23:39:08,453][123090] Updated weights for policy 1, policy_version 10322 (0.0009) [2023-12-25 23:39:08,509][123090] Updated weights for policy 1, policy_version 10332 (0.0009) [2023-12-25 23:39:08,553][123091] Updated weights for policy 0, policy_version 10474 (0.0009) [2023-12-25 23:39:08,606][123091] Updated weights for policy 0, policy_version 10484 (0.0009) [2023-12-25 23:39:08,656][123091] Updated weights for policy 0, policy_version 10494 (0.0009) [2023-12-25 23:39:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 5332992. Throughput: 0: 8936.4, 1: 8738.7. Samples: 5303640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:08,785][121949] Avg episode reward: [(0, '1210.837'), (1, '1863.852')] [2023-12-25 23:39:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000010496_2686976.pth... [2023-12-25 23:39:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000010336_2646016.pth... [2023-12-25 23:39:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000009312_2383872.pth [2023-12-25 23:39:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000009440_2416640.pth [2023-12-25 23:39:09,375][123090] Updated weights for policy 1, policy_version 10342 (0.0009) [2023-12-25 23:39:09,444][123090] Updated weights for policy 1, policy_version 10352 (0.0009) [2023-12-25 23:39:09,506][123090] Updated weights for policy 1, policy_version 10362 (0.0009) [2023-12-25 23:39:09,535][123091] Updated weights for policy 0, policy_version 10504 (0.0008) [2023-12-25 23:39:09,598][123091] Updated weights for policy 0, policy_version 10514 (0.0009) [2023-12-25 23:39:09,660][123091] Updated weights for policy 0, policy_version 10524 (0.0009) [2023-12-25 23:39:10,433][123090] Updated weights for policy 1, policy_version 10372 (0.0009) [2023-12-25 23:39:10,464][123091] Updated weights for policy 0, policy_version 10534 (0.0007) [2023-12-25 23:39:10,494][123090] Updated weights for policy 1, policy_version 10382 (0.0009) [2023-12-25 23:39:10,519][123091] Updated weights for policy 0, policy_version 10544 (0.0008) [2023-12-25 23:39:10,551][123090] Updated weights for policy 1, policy_version 10392 (0.0007) [2023-12-25 23:39:10,587][123091] Updated weights for policy 0, policy_version 10554 (0.0008) [2023-12-25 23:39:11,444][123091] Updated weights for policy 0, policy_version 10564 (0.0009) [2023-12-25 23:39:11,455][123090] Updated weights for policy 1, policy_version 10402 (0.0008) [2023-12-25 23:39:11,500][123091] Updated weights for policy 0, policy_version 10574 (0.0007) [2023-12-25 23:39:11,514][123090] Updated weights for policy 1, policy_version 10412 (0.0008) [2023-12-25 23:39:11,564][123091] Updated weights for policy 0, policy_version 10584 (0.0008) [2023-12-25 23:39:11,573][123090] Updated weights for policy 1, policy_version 10422 (0.0008) [2023-12-25 23:39:11,635][123090] Updated weights for policy 1, policy_version 10432 (0.0009) [2023-12-25 23:39:12,445][123091] Updated weights for policy 0, policy_version 10594 (0.0008) [2023-12-25 23:39:12,506][123091] Updated weights for policy 0, policy_version 10604 (0.0010) [2023-12-25 23:39:12,527][123090] Updated weights for policy 1, policy_version 10442 (0.0010) [2023-12-25 23:39:12,572][123091] Updated weights for policy 0, policy_version 10614 (0.0008) [2023-12-25 23:39:12,586][123090] Updated weights for policy 1, policy_version 10452 (0.0010) [2023-12-25 23:39:12,632][123091] Updated weights for policy 0, policy_version 10624 (0.0010) [2023-12-25 23:39:12,649][123090] Updated weights for policy 1, policy_version 10462 (0.0008) [2023-12-25 23:39:13,371][123091] Updated weights for policy 0, policy_version 10634 (0.0006) [2023-12-25 23:39:13,430][123091] Updated weights for policy 0, policy_version 10644 (0.0010) [2023-12-25 23:39:13,492][123091] Updated weights for policy 0, policy_version 10654 (0.0010) [2023-12-25 23:39:13,531][123090] Updated weights for policy 1, policy_version 10472 (0.0009) [2023-12-25 23:39:13,591][123090] Updated weights for policy 1, policy_version 10482 (0.0009) [2023-12-25 23:39:13,663][123090] Updated weights for policy 1, policy_version 10492 (0.0010) [2023-12-25 23:39:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 5414912. Throughput: 0: 8873.6, 1: 8712.0. Samples: 5404300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:13,785][121949] Avg episode reward: [(0, '1149.612'), (1, '2083.688')] [2023-12-25 23:39:13,787][123008] Saving new best policy, reward=2083.688! [2023-12-25 23:39:14,268][123091] Updated weights for policy 0, policy_version 10664 (0.0007) [2023-12-25 23:39:14,330][123091] Updated weights for policy 0, policy_version 10674 (0.0005) [2023-12-25 23:39:14,400][123091] Updated weights for policy 0, policy_version 10684 (0.0005) [2023-12-25 23:39:14,506][123090] Updated weights for policy 1, policy_version 10502 (0.0010) [2023-12-25 23:39:14,566][123090] Updated weights for policy 1, policy_version 10512 (0.0010) [2023-12-25 23:39:14,626][123090] Updated weights for policy 1, policy_version 10522 (0.0008) [2023-12-25 23:39:15,097][123091] Updated weights for policy 0, policy_version 10694 (0.0008) [2023-12-25 23:39:15,166][123091] Updated weights for policy 0, policy_version 10704 (0.0005) [2023-12-25 23:39:15,237][123091] Updated weights for policy 0, policy_version 10714 (0.0007) [2023-12-25 23:39:15,563][123090] Updated weights for policy 1, policy_version 10532 (0.0010) [2023-12-25 23:39:15,631][123090] Updated weights for policy 1, policy_version 10542 (0.0007) [2023-12-25 23:39:15,696][123090] Updated weights for policy 1, policy_version 10552 (0.0010) [2023-12-25 23:39:16,074][123091] Updated weights for policy 0, policy_version 10724 (0.0009) [2023-12-25 23:39:16,126][123091] Updated weights for policy 0, policy_version 10734 (0.0010) [2023-12-25 23:39:16,180][123091] Updated weights for policy 0, policy_version 10744 (0.0010) [2023-12-25 23:39:16,339][123090] Updated weights for policy 1, policy_version 10562 (0.0007) [2023-12-25 23:39:16,403][123090] Updated weights for policy 1, policy_version 10572 (0.0005) [2023-12-25 23:39:16,463][123090] Updated weights for policy 1, policy_version 10582 (0.0005) [2023-12-25 23:39:16,526][123090] Updated weights for policy 1, policy_version 10592 (0.0005) [2023-12-25 23:39:17,131][123091] Updated weights for policy 0, policy_version 10754 (0.0010) [2023-12-25 23:39:17,131][123090] Updated weights for policy 1, policy_version 10602 (0.0005) [2023-12-25 23:39:17,177][123090] Updated weights for policy 1, policy_version 10612 (0.0005) [2023-12-25 23:39:17,180][123091] Updated weights for policy 0, policy_version 10765 (0.0009) [2023-12-25 23:39:17,227][123090] Updated weights for policy 1, policy_version 10622 (0.0005) [2023-12-25 23:39:17,237][123091] Updated weights for policy 0, policy_version 10775 (0.0009) [2023-12-25 23:39:17,881][123090] Updated weights for policy 1, policy_version 10632 (0.0007) [2023-12-25 23:39:17,942][123090] Updated weights for policy 1, policy_version 10642 (0.0008) [2023-12-25 23:39:18,001][123090] Updated weights for policy 1, policy_version 10652 (0.0011) [2023-12-25 23:39:18,150][123091] Updated weights for policy 0, policy_version 10785 (0.0010) [2023-12-25 23:39:18,199][123091] Updated weights for policy 0, policy_version 10795 (0.0009) [2023-12-25 23:39:18,247][123091] Updated weights for policy 0, policy_version 10805 (0.0009) [2023-12-25 23:39:18,299][123091] Updated weights for policy 0, policy_version 10815 (0.0009) [2023-12-25 23:39:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 5496832. Throughput: 0: 8764.7, 1: 8711.6. Samples: 5510648. Policy #0 lag: (min: 2.0, avg: 8.8, max: 34.0) [2023-12-25 23:39:18,785][121949] Avg episode reward: [(0, '1172.611'), (1, '2066.797')] [2023-12-25 23:39:18,795][123090] Updated weights for policy 1, policy_version 10662 (0.0007) [2023-12-25 23:39:18,865][123090] Updated weights for policy 1, policy_version 10672 (0.0006) [2023-12-25 23:39:18,941][123090] Updated weights for policy 1, policy_version 10682 (0.0006) [2023-12-25 23:39:19,112][123091] Updated weights for policy 0, policy_version 10825 (0.0010) [2023-12-25 23:39:19,171][123091] Updated weights for policy 0, policy_version 10835 (0.0010) [2023-12-25 23:39:19,229][123091] Updated weights for policy 0, policy_version 10845 (0.0009) [2023-12-25 23:39:19,670][123090] Updated weights for policy 1, policy_version 10692 (0.0007) [2023-12-25 23:39:19,742][123090] Updated weights for policy 1, policy_version 10702 (0.0010) [2023-12-25 23:39:19,808][123090] Updated weights for policy 1, policy_version 10712 (0.0010) [2023-12-25 23:39:20,093][123091] Updated weights for policy 0, policy_version 10855 (0.0010) [2023-12-25 23:39:20,162][123091] Updated weights for policy 0, policy_version 10865 (0.0010) [2023-12-25 23:39:20,235][123091] Updated weights for policy 0, policy_version 10875 (0.0010) [2023-12-25 23:39:20,679][123090] Updated weights for policy 1, policy_version 10722 (0.0009) [2023-12-25 23:39:20,753][123090] Updated weights for policy 1, policy_version 10732 (0.0010) [2023-12-25 23:39:20,820][123090] Updated weights for policy 1, policy_version 10742 (0.0009) [2023-12-25 23:39:20,890][123090] Updated weights for policy 1, policy_version 10752 (0.0009) [2023-12-25 23:39:21,083][123091] Updated weights for policy 0, policy_version 10885 (0.0010) [2023-12-25 23:39:21,143][123091] Updated weights for policy 0, policy_version 10895 (0.0010) [2023-12-25 23:39:21,207][123091] Updated weights for policy 0, policy_version 10905 (0.0009) [2023-12-25 23:39:21,689][123090] Updated weights for policy 1, policy_version 10762 (0.0008) [2023-12-25 23:39:21,768][123090] Updated weights for policy 1, policy_version 10772 (0.0008) [2023-12-25 23:39:21,831][123090] Updated weights for policy 1, policy_version 10782 (0.0008) [2023-12-25 23:39:22,087][123091] Updated weights for policy 0, policy_version 10915 (0.0010) [2023-12-25 23:39:22,153][123091] Updated weights for policy 0, policy_version 10925 (0.0010) [2023-12-25 23:39:22,215][123091] Updated weights for policy 0, policy_version 10935 (0.0010) [2023-12-25 23:39:22,580][123090] Updated weights for policy 1, policy_version 10792 (0.0008) [2023-12-25 23:39:22,635][123090] Updated weights for policy 1, policy_version 10802 (0.0008) [2023-12-25 23:39:22,701][123090] Updated weights for policy 1, policy_version 10812 (0.0008) [2023-12-25 23:39:23,110][123091] Updated weights for policy 0, policy_version 10945 (0.0009) [2023-12-25 23:39:23,176][123091] Updated weights for policy 0, policy_version 10955 (0.0009) [2023-12-25 23:39:23,239][123091] Updated weights for policy 0, policy_version 10966 (0.0009) [2023-12-25 23:39:23,297][123091] Updated weights for policy 0, policy_version 10976 (0.0009) [2023-12-25 23:39:23,451][123090] Updated weights for policy 1, policy_version 10822 (0.0007) [2023-12-25 23:39:23,511][123090] Updated weights for policy 1, policy_version 10832 (0.0005) [2023-12-25 23:39:23,568][123090] Updated weights for policy 1, policy_version 10842 (0.0005) [2023-12-25 23:39:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 5586944. Throughput: 0: 8745.2, 1: 8675.7. Samples: 5562540. Policy #0 lag: (min: 2.0, avg: 8.8, max: 34.0) [2023-12-25 23:39:23,785][121949] Avg episode reward: [(0, '1182.861'), (1, '2143.996')] [2023-12-25 23:39:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000010976_2809856.pth... [2023-12-25 23:39:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000010848_2777088.pth... [2023-12-25 23:39:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000009824_2514944.pth [2023-12-25 23:39:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000009952_2547712.pth [2023-12-25 23:39:23,797][123008] Saving new best policy, reward=2143.996! [2023-12-25 23:39:24,094][123091] Updated weights for policy 0, policy_version 10986 (0.0005) [2023-12-25 23:39:24,146][123091] Updated weights for policy 0, policy_version 10996 (0.0006) [2023-12-25 23:39:24,185][123090] Updated weights for policy 1, policy_version 10852 (0.0005) [2023-12-25 23:39:24,204][123091] Updated weights for policy 0, policy_version 11006 (0.0005) [2023-12-25 23:39:24,236][123090] Updated weights for policy 1, policy_version 10862 (0.0007) [2023-12-25 23:39:24,296][123090] Updated weights for policy 1, policy_version 10872 (0.0010) [2023-12-25 23:39:24,959][123091] Updated weights for policy 0, policy_version 11016 (0.0008) [2023-12-25 23:39:25,012][123091] Updated weights for policy 0, policy_version 11026 (0.0009) [2023-12-25 23:39:25,088][123091] Updated weights for policy 0, policy_version 11036 (0.0009) [2023-12-25 23:39:25,126][123090] Updated weights for policy 1, policy_version 10882 (0.0011) [2023-12-25 23:39:25,192][123090] Updated weights for policy 1, policy_version 10892 (0.0010) [2023-12-25 23:39:25,256][123090] Updated weights for policy 1, policy_version 10902 (0.0011) [2023-12-25 23:39:25,312][123090] Updated weights for policy 1, policy_version 10912 (0.0010) [2023-12-25 23:39:25,882][123091] Updated weights for policy 0, policy_version 11046 (0.0009) [2023-12-25 23:39:25,931][123091] Updated weights for policy 0, policy_version 11056 (0.0009) [2023-12-25 23:39:26,004][123091] Updated weights for policy 0, policy_version 11066 (0.0009) [2023-12-25 23:39:26,149][123090] Updated weights for policy 1, policy_version 10922 (0.0011) [2023-12-25 23:39:26,219][123090] Updated weights for policy 1, policy_version 10932 (0.0011) [2023-12-25 23:39:26,271][123090] Updated weights for policy 1, policy_version 10942 (0.0010) [2023-12-25 23:39:26,862][123091] Updated weights for policy 0, policy_version 11076 (0.0008) [2023-12-25 23:39:26,919][123091] Updated weights for policy 0, policy_version 11086 (0.0009) [2023-12-25 23:39:26,979][123091] Updated weights for policy 0, policy_version 11096 (0.0009) [2023-12-25 23:39:27,062][123090] Updated weights for policy 1, policy_version 10952 (0.0009) [2023-12-25 23:39:27,125][123090] Updated weights for policy 1, policy_version 10962 (0.0008) [2023-12-25 23:39:27,182][123090] Updated weights for policy 1, policy_version 10972 (0.0009) [2023-12-25 23:39:27,812][123091] Updated weights for policy 0, policy_version 11106 (0.0009) [2023-12-25 23:39:27,871][123091] Updated weights for policy 0, policy_version 11116 (0.0009) [2023-12-25 23:39:27,928][123091] Updated weights for policy 0, policy_version 11126 (0.0009) [2023-12-25 23:39:27,977][123091] Updated weights for policy 0, policy_version 11136 (0.0009) [2023-12-25 23:39:27,993][123090] Updated weights for policy 1, policy_version 10982 (0.0008) [2023-12-25 23:39:28,050][123090] Updated weights for policy 1, policy_version 10992 (0.0008) [2023-12-25 23:39:28,104][123090] Updated weights for policy 1, policy_version 11002 (0.0007) [2023-12-25 23:39:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 5668864. Throughput: 0: 8734.0, 1: 8766.2. Samples: 5668084. Policy #0 lag: (min: 26.0, avg: 40.5, max: 58.0) [2023-12-25 23:39:28,784][121949] Avg episode reward: [(0, '1207.526'), (1, '2171.985')] [2023-12-25 23:39:28,785][123008] Saving new best policy, reward=2171.985! [2023-12-25 23:39:28,830][123091] Updated weights for policy 0, policy_version 11146 (0.0010) [2023-12-25 23:39:28,877][123090] Updated weights for policy 1, policy_version 11012 (0.0008) [2023-12-25 23:39:28,888][123091] Updated weights for policy 0, policy_version 11156 (0.0009) [2023-12-25 23:39:28,942][123090] Updated weights for policy 1, policy_version 11022 (0.0006) [2023-12-25 23:39:28,943][123091] Updated weights for policy 0, policy_version 11166 (0.0009) [2023-12-25 23:39:29,010][123090] Updated weights for policy 1, policy_version 11032 (0.0006) [2023-12-25 23:39:29,780][123091] Updated weights for policy 0, policy_version 11176 (0.0008) [2023-12-25 23:39:29,791][123090] Updated weights for policy 1, policy_version 11042 (0.0007) [2023-12-25 23:39:29,847][123091] Updated weights for policy 0, policy_version 11186 (0.0007) [2023-12-25 23:39:29,855][123090] Updated weights for policy 1, policy_version 11052 (0.0011) [2023-12-25 23:39:29,906][123091] Updated weights for policy 0, policy_version 11196 (0.0009) [2023-12-25 23:39:29,912][123090] Updated weights for policy 1, policy_version 11062 (0.0006) [2023-12-25 23:39:29,980][123090] Updated weights for policy 1, policy_version 11072 (0.0011) [2023-12-25 23:39:30,720][123091] Updated weights for policy 0, policy_version 11206 (0.0009) [2023-12-25 23:39:30,782][123091] Updated weights for policy 0, policy_version 11216 (0.0009) [2023-12-25 23:39:30,790][123090] Updated weights for policy 1, policy_version 11082 (0.0009) [2023-12-25 23:39:30,837][123091] Updated weights for policy 0, policy_version 11226 (0.0009) [2023-12-25 23:39:30,839][123090] Updated weights for policy 1, policy_version 11092 (0.0007) [2023-12-25 23:39:30,901][123090] Updated weights for policy 1, policy_version 11102 (0.0007) [2023-12-25 23:39:31,685][123091] Updated weights for policy 0, policy_version 11236 (0.0007) [2023-12-25 23:39:31,737][123090] Updated weights for policy 1, policy_version 11112 (0.0009) [2023-12-25 23:39:31,750][123091] Updated weights for policy 0, policy_version 11246 (0.0007) [2023-12-25 23:39:31,801][123090] Updated weights for policy 1, policy_version 11122 (0.0008) [2023-12-25 23:39:31,806][123091] Updated weights for policy 0, policy_version 11256 (0.0007) [2023-12-25 23:39:31,865][123090] Updated weights for policy 1, policy_version 11132 (0.0008) [2023-12-25 23:39:32,481][123091] Updated weights for policy 0, policy_version 11266 (0.0006) [2023-12-25 23:39:32,553][123091] Updated weights for policy 0, policy_version 11276 (0.0010) [2023-12-25 23:39:32,616][123091] Updated weights for policy 0, policy_version 11286 (0.0010) [2023-12-25 23:39:32,674][123091] Updated weights for policy 0, policy_version 11296 (0.0010) [2023-12-25 23:39:32,781][123090] Updated weights for policy 1, policy_version 11143 (0.0009) [2023-12-25 23:39:32,832][123090] Updated weights for policy 1, policy_version 11153 (0.0006) [2023-12-25 23:39:32,882][123090] Updated weights for policy 1, policy_version 11163 (0.0008) [2023-12-25 23:39:33,482][123091] Updated weights for policy 0, policy_version 11306 (0.0010) [2023-12-25 23:39:33,529][123091] Updated weights for policy 0, policy_version 11316 (0.0010) [2023-12-25 23:39:33,584][123091] Updated weights for policy 0, policy_version 11326 (0.0010) [2023-12-25 23:39:33,606][123090] Updated weights for policy 1, policy_version 11173 (0.0007) [2023-12-25 23:39:33,674][123090] Updated weights for policy 1, policy_version 11183 (0.0008) [2023-12-25 23:39:33,726][123090] Updated weights for policy 1, policy_version 11193 (0.0005) [2023-12-25 23:39:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 5767168. Throughput: 0: 8718.7, 1: 8707.4. Samples: 5772972. Policy #0 lag: (min: 26.0, avg: 40.5, max: 58.0) [2023-12-25 23:39:33,785][121949] Avg episode reward: [(0, '1105.072'), (1, '2118.759')] [2023-12-25 23:39:34,408][123090] Updated weights for policy 1, policy_version 11203 (0.0006) [2023-12-25 23:39:34,433][123091] Updated weights for policy 0, policy_version 11336 (0.0011) [2023-12-25 23:39:34,475][123090] Updated weights for policy 1, policy_version 11213 (0.0006) [2023-12-25 23:39:34,493][123091] Updated weights for policy 0, policy_version 11346 (0.0011) [2023-12-25 23:39:34,536][123090] Updated weights for policy 1, policy_version 11223 (0.0007) [2023-12-25 23:39:34,561][123091] Updated weights for policy 0, policy_version 11356 (0.0011) [2023-12-25 23:39:35,091][123090] Updated weights for policy 1, policy_version 11233 (0.0006) [2023-12-25 23:39:35,140][123090] Updated weights for policy 1, policy_version 11243 (0.0005) [2023-12-25 23:39:35,184][123090] Updated weights for policy 1, policy_version 11253 (0.0005) [2023-12-25 23:39:35,240][123090] Updated weights for policy 1, policy_version 11263 (0.0005) [2023-12-25 23:39:35,402][123091] Updated weights for policy 0, policy_version 11366 (0.0011) [2023-12-25 23:39:35,464][123091] Updated weights for policy 0, policy_version 11376 (0.0010) [2023-12-25 23:39:35,527][123091] Updated weights for policy 0, policy_version 11386 (0.0010) [2023-12-25 23:39:35,972][123090] Updated weights for policy 1, policy_version 11273 (0.0007) [2023-12-25 23:39:36,021][123090] Updated weights for policy 1, policy_version 11283 (0.0006) [2023-12-25 23:39:36,069][123090] Updated weights for policy 1, policy_version 11293 (0.0005) [2023-12-25 23:39:36,283][123091] Updated weights for policy 0, policy_version 11396 (0.0011) [2023-12-25 23:39:36,343][123091] Updated weights for policy 0, policy_version 11406 (0.0011) [2023-12-25 23:39:36,395][123091] Updated weights for policy 0, policy_version 11416 (0.0010) [2023-12-25 23:39:36,819][123090] Updated weights for policy 1, policy_version 11303 (0.0009) [2023-12-25 23:39:36,889][123090] Updated weights for policy 1, policy_version 11313 (0.0010) [2023-12-25 23:39:36,957][123090] Updated weights for policy 1, policy_version 11323 (0.0010) [2023-12-25 23:39:37,214][123091] Updated weights for policy 0, policy_version 11426 (0.0011) [2023-12-25 23:39:37,262][123091] Updated weights for policy 0, policy_version 11436 (0.0010) [2023-12-25 23:39:37,322][123091] Updated weights for policy 0, policy_version 11446 (0.0011) [2023-12-25 23:39:37,373][123091] Updated weights for policy 0, policy_version 11456 (0.0010) [2023-12-25 23:39:37,642][123090] Updated weights for policy 1, policy_version 11333 (0.0008) [2023-12-25 23:39:37,705][123090] Updated weights for policy 1, policy_version 11343 (0.0006) [2023-12-25 23:39:37,760][123090] Updated weights for policy 1, policy_version 11353 (0.0010) [2023-12-25 23:39:38,222][123091] Updated weights for policy 0, policy_version 11466 (0.0011) [2023-12-25 23:39:38,269][123091] Updated weights for policy 0, policy_version 11476 (0.0010) [2023-12-25 23:39:38,330][123091] Updated weights for policy 0, policy_version 11486 (0.0011) [2023-12-25 23:39:38,580][123090] Updated weights for policy 1, policy_version 11363 (0.0009) [2023-12-25 23:39:38,642][123090] Updated weights for policy 1, policy_version 11373 (0.0005) [2023-12-25 23:39:38,689][123090] Updated weights for policy 1, policy_version 11383 (0.0005) [2023-12-25 23:39:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 5857280. Throughput: 0: 8687.0, 1: 8815.8. Samples: 5829364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:38,784][121949] Avg episode reward: [(0, '1044.500'), (1, '2247.636')] [2023-12-25 23:39:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000011392_2916352.pth... [2023-12-25 23:39:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000011488_2940928.pth... [2023-12-25 23:39:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000010336_2646016.pth [2023-12-25 23:39:38,797][123008] Saving new best policy, reward=2247.636! [2023-12-25 23:39:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000010496_2686976.pth [2023-12-25 23:39:39,190][123091] Updated weights for policy 0, policy_version 11496 (0.0010) [2023-12-25 23:39:39,236][123091] Updated weights for policy 0, policy_version 11506 (0.0010) [2023-12-25 23:39:39,290][123091] Updated weights for policy 0, policy_version 11516 (0.0011) [2023-12-25 23:39:39,445][123090] Updated weights for policy 1, policy_version 11393 (0.0006) [2023-12-25 23:39:39,504][123090] Updated weights for policy 1, policy_version 11403 (0.0008) [2023-12-25 23:39:39,576][123090] Updated weights for policy 1, policy_version 11413 (0.0007) [2023-12-25 23:39:39,643][123090] Updated weights for policy 1, policy_version 11423 (0.0007) [2023-12-25 23:39:40,232][123091] Updated weights for policy 0, policy_version 11526 (0.0010) [2023-12-25 23:39:40,302][123091] Updated weights for policy 0, policy_version 11536 (0.0009) [2023-12-25 23:39:40,371][123091] Updated weights for policy 0, policy_version 11546 (0.0009) [2023-12-25 23:39:40,467][123090] Updated weights for policy 1, policy_version 11433 (0.0010) [2023-12-25 23:39:40,519][123090] Updated weights for policy 1, policy_version 11443 (0.0010) [2023-12-25 23:39:40,575][123090] Updated weights for policy 1, policy_version 11453 (0.0010) [2023-12-25 23:39:41,252][123091] Updated weights for policy 0, policy_version 11556 (0.0009) [2023-12-25 23:39:41,324][123091] Updated weights for policy 0, policy_version 11566 (0.0011) [2023-12-25 23:39:41,395][123091] Updated weights for policy 0, policy_version 11576 (0.0009) [2023-12-25 23:39:41,452][123090] Updated weights for policy 1, policy_version 11463 (0.0010) [2023-12-25 23:39:41,524][123090] Updated weights for policy 1, policy_version 11473 (0.0009) [2023-12-25 23:39:41,590][123090] Updated weights for policy 1, policy_version 11483 (0.0009) [2023-12-25 23:39:42,246][123091] Updated weights for policy 0, policy_version 11586 (0.0007) [2023-12-25 23:39:42,317][123091] Updated weights for policy 0, policy_version 11596 (0.0008) [2023-12-25 23:39:42,346][123090] Updated weights for policy 1, policy_version 11493 (0.0008) [2023-12-25 23:39:42,391][123091] Updated weights for policy 0, policy_version 11606 (0.0008) [2023-12-25 23:39:42,418][123090] Updated weights for policy 1, policy_version 11503 (0.0008) [2023-12-25 23:39:42,442][123091] Updated weights for policy 0, policy_version 11616 (0.0005) [2023-12-25 23:39:42,488][123090] Updated weights for policy 1, policy_version 11513 (0.0009) [2023-12-25 23:39:43,237][123091] Updated weights for policy 0, policy_version 11626 (0.0010) [2023-12-25 23:39:43,302][123090] Updated weights for policy 1, policy_version 11523 (0.0009) [2023-12-25 23:39:43,305][123091] Updated weights for policy 0, policy_version 11636 (0.0009) [2023-12-25 23:39:43,365][123091] Updated weights for policy 0, policy_version 11646 (0.0008) [2023-12-25 23:39:43,367][123090] Updated weights for policy 1, policy_version 11533 (0.0008) [2023-12-25 23:39:43,430][123090] Updated weights for policy 1, policy_version 11543 (0.0010) [2023-12-25 23:39:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 5939200. Throughput: 0: 8654.8, 1: 8846.2. Samples: 5932256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:43,784][121949] Avg episode reward: [(0, '1119.586'), (1, '2503.439')] [2023-12-25 23:39:43,785][123008] Saving new best policy, reward=2503.439! [2023-12-25 23:39:44,170][123091] Updated weights for policy 0, policy_version 11656 (0.0009) [2023-12-25 23:39:44,228][123091] Updated weights for policy 0, policy_version 11666 (0.0009) [2023-12-25 23:39:44,229][123090] Updated weights for policy 1, policy_version 11553 (0.0010) [2023-12-25 23:39:44,290][123090] Updated weights for policy 1, policy_version 11563 (0.0006) [2023-12-25 23:39:44,296][123091] Updated weights for policy 0, policy_version 11676 (0.0009) [2023-12-25 23:39:44,361][123090] Updated weights for policy 1, policy_version 11573 (0.0006) [2023-12-25 23:39:44,432][123090] Updated weights for policy 1, policy_version 11583 (0.0007) [2023-12-25 23:39:45,043][123091] Updated weights for policy 0, policy_version 11686 (0.0009) [2023-12-25 23:39:45,088][123091] Updated weights for policy 0, policy_version 11696 (0.0006) [2023-12-25 23:39:45,088][123090] Updated weights for policy 1, policy_version 11593 (0.0010) [2023-12-25 23:39:45,142][123091] Updated weights for policy 0, policy_version 11707 (0.0008) [2023-12-25 23:39:45,157][123090] Updated weights for policy 1, policy_version 11603 (0.0011) [2023-12-25 23:39:45,224][123090] Updated weights for policy 1, policy_version 11613 (0.0010) [2023-12-25 23:39:45,981][123091] Updated weights for policy 0, policy_version 11717 (0.0008) [2023-12-25 23:39:46,044][123091] Updated weights for policy 0, policy_version 11727 (0.0010) [2023-12-25 23:39:46,055][123090] Updated weights for policy 1, policy_version 11623 (0.0010) [2023-12-25 23:39:46,107][123091] Updated weights for policy 0, policy_version 11737 (0.0010) [2023-12-25 23:39:46,120][123090] Updated weights for policy 1, policy_version 11633 (0.0010) [2023-12-25 23:39:46,171][123090] Updated weights for policy 1, policy_version 11643 (0.0010) [2023-12-25 23:39:46,937][123091] Updated weights for policy 0, policy_version 11747 (0.0010) [2023-12-25 23:39:46,975][123090] Updated weights for policy 1, policy_version 11653 (0.0008) [2023-12-25 23:39:47,007][123091] Updated weights for policy 0, policy_version 11757 (0.0010) [2023-12-25 23:39:47,022][123090] Updated weights for policy 1, policy_version 11663 (0.0005) [2023-12-25 23:39:47,073][123091] Updated weights for policy 0, policy_version 11767 (0.0010) [2023-12-25 23:39:47,076][123090] Updated weights for policy 1, policy_version 11673 (0.0006) [2023-12-25 23:39:47,733][123090] Updated weights for policy 1, policy_version 11683 (0.0009) [2023-12-25 23:39:47,782][123090] Updated weights for policy 1, policy_version 11693 (0.0005) [2023-12-25 23:39:47,838][123090] Updated weights for policy 1, policy_version 11703 (0.0006) [2023-12-25 23:39:47,845][123091] Updated weights for policy 0, policy_version 11777 (0.0010) [2023-12-25 23:39:47,906][123091] Updated weights for policy 0, policy_version 11787 (0.0010) [2023-12-25 23:39:47,961][123091] Updated weights for policy 0, policy_version 11797 (0.0010) [2023-12-25 23:39:48,023][123091] Updated weights for policy 0, policy_version 11807 (0.0010) [2023-12-25 23:39:48,663][123090] Updated weights for policy 1, policy_version 11713 (0.0007) [2023-12-25 23:39:48,724][123090] Updated weights for policy 1, policy_version 11723 (0.0008) [2023-12-25 23:39:48,757][123091] Updated weights for policy 0, policy_version 11817 (0.0008) [2023-12-25 23:39:48,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 6021120. Throughput: 0: 8622.2, 1: 8932.6. Samples: 6039264. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-25 23:39:48,785][121949] Avg episode reward: [(0, '1033.863'), (1, '2651.100')] [2023-12-25 23:39:48,790][123090] Updated weights for policy 1, policy_version 11733 (0.0007) [2023-12-25 23:39:48,822][123091] Updated weights for policy 0, policy_version 11827 (0.0008) [2023-12-25 23:39:48,855][123090] Updated weights for policy 1, policy_version 11743 (0.0007) [2023-12-25 23:39:48,858][123008] Saving new best policy, reward=2651.100! [2023-12-25 23:39:48,877][123091] Updated weights for policy 0, policy_version 11837 (0.0008) [2023-12-25 23:39:49,633][123091] Updated weights for policy 0, policy_version 11847 (0.0010) [2023-12-25 23:39:49,700][123091] Updated weights for policy 0, policy_version 11857 (0.0011) [2023-12-25 23:39:49,729][123090] Updated weights for policy 1, policy_version 11753 (0.0006) [2023-12-25 23:39:49,763][123091] Updated weights for policy 0, policy_version 11867 (0.0008) [2023-12-25 23:39:49,785][123090] Updated weights for policy 1, policy_version 11763 (0.0007) [2023-12-25 23:39:49,855][123090] Updated weights for policy 1, policy_version 11773 (0.0011) [2023-12-25 23:39:50,560][123091] Updated weights for policy 0, policy_version 11877 (0.0008) [2023-12-25 23:39:50,629][123091] Updated weights for policy 0, policy_version 11887 (0.0011) [2023-12-25 23:39:50,693][123091] Updated weights for policy 0, policy_version 11897 (0.0011) [2023-12-25 23:39:50,694][123090] Updated weights for policy 1, policy_version 11783 (0.0007) [2023-12-25 23:39:50,752][123090] Updated weights for policy 1, policy_version 11793 (0.0006) [2023-12-25 23:39:50,820][123090] Updated weights for policy 1, policy_version 11803 (0.0010) [2023-12-25 23:39:51,538][123091] Updated weights for policy 0, policy_version 11907 (0.0011) [2023-12-25 23:39:51,598][123091] Updated weights for policy 0, policy_version 11917 (0.0010) [2023-12-25 23:39:51,615][123090] Updated weights for policy 1, policy_version 11813 (0.0012) [2023-12-25 23:39:51,676][123091] Updated weights for policy 0, policy_version 11928 (0.0008) [2023-12-25 23:39:51,688][123090] Updated weights for policy 1, policy_version 11823 (0.0008) [2023-12-25 23:39:51,760][123090] Updated weights for policy 1, policy_version 11833 (0.0008) [2023-12-25 23:39:52,495][123091] Updated weights for policy 0, policy_version 11938 (0.0008) [2023-12-25 23:39:52,536][123090] Updated weights for policy 1, policy_version 11843 (0.0008) [2023-12-25 23:39:52,558][123091] Updated weights for policy 0, policy_version 11948 (0.0009) [2023-12-25 23:39:52,593][123090] Updated weights for policy 1, policy_version 11853 (0.0009) [2023-12-25 23:39:52,621][123091] Updated weights for policy 0, policy_version 11958 (0.0008) [2023-12-25 23:39:52,653][123090] Updated weights for policy 1, policy_version 11863 (0.0010) [2023-12-25 23:39:52,674][123091] Updated weights for policy 0, policy_version 11968 (0.0006) [2023-12-25 23:39:53,386][123090] Updated weights for policy 1, policy_version 11873 (0.0008) [2023-12-25 23:39:53,444][123090] Updated weights for policy 1, policy_version 11883 (0.0010) [2023-12-25 23:39:53,476][123091] Updated weights for policy 0, policy_version 11978 (0.0006) [2023-12-25 23:39:53,498][123090] Updated weights for policy 1, policy_version 11893 (0.0010) [2023-12-25 23:39:53,540][123091] Updated weights for policy 0, policy_version 11988 (0.0007) [2023-12-25 23:39:53,550][123090] Updated weights for policy 1, policy_version 11903 (0.0010) [2023-12-25 23:39:53,608][123091] Updated weights for policy 0, policy_version 11998 (0.0008) [2023-12-25 23:39:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 6119424. Throughput: 0: 8606.1, 1: 8880.7. Samples: 6090548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:53,785][121949] Avg episode reward: [(0, '1030.616'), (1, '2457.024')] [2023-12-25 23:39:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000012000_3072000.pth... [2023-12-25 23:39:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000011904_3047424.pth... [2023-12-25 23:39:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000010976_2809856.pth [2023-12-25 23:39:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000010848_2777088.pth [2023-12-25 23:39:54,333][123090] Updated weights for policy 1, policy_version 11913 (0.0010) [2023-12-25 23:39:54,405][123090] Updated weights for policy 1, policy_version 11923 (0.0007) [2023-12-25 23:39:54,442][123091] Updated weights for policy 0, policy_version 12008 (0.0009) [2023-12-25 23:39:54,477][123090] Updated weights for policy 1, policy_version 11933 (0.0005) [2023-12-25 23:39:54,495][123091] Updated weights for policy 0, policy_version 12018 (0.0009) [2023-12-25 23:39:54,547][123091] Updated weights for policy 0, policy_version 12028 (0.0009) [2023-12-25 23:39:55,225][123090] Updated weights for policy 1, policy_version 11943 (0.0009) [2023-12-25 23:39:55,291][123090] Updated weights for policy 1, policy_version 11953 (0.0010) [2023-12-25 23:39:55,328][123091] Updated weights for policy 0, policy_version 12038 (0.0007) [2023-12-25 23:39:55,342][123090] Updated weights for policy 1, policy_version 11963 (0.0010) [2023-12-25 23:39:55,392][123091] Updated weights for policy 0, policy_version 12048 (0.0008) [2023-12-25 23:39:55,454][123091] Updated weights for policy 0, policy_version 12058 (0.0010) [2023-12-25 23:39:56,131][123090] Updated weights for policy 1, policy_version 11973 (0.0009) [2023-12-25 23:39:56,195][123090] Updated weights for policy 1, policy_version 11983 (0.0009) [2023-12-25 23:39:56,261][123090] Updated weights for policy 1, policy_version 11993 (0.0010) [2023-12-25 23:39:56,298][123091] Updated weights for policy 0, policy_version 12068 (0.0009) [2023-12-25 23:39:56,368][123091] Updated weights for policy 0, policy_version 12078 (0.0006) [2023-12-25 23:39:56,435][123091] Updated weights for policy 0, policy_version 12088 (0.0006) [2023-12-25 23:39:57,026][123090] Updated weights for policy 1, policy_version 12003 (0.0008) [2023-12-25 23:39:57,090][123090] Updated weights for policy 1, policy_version 12013 (0.0006) [2023-12-25 23:39:57,131][123091] Updated weights for policy 0, policy_version 12098 (0.0010) [2023-12-25 23:39:57,141][123090] Updated weights for policy 1, policy_version 12023 (0.0005) [2023-12-25 23:39:57,193][123091] Updated weights for policy 0, policy_version 12108 (0.0008) [2023-12-25 23:39:57,251][123091] Updated weights for policy 0, policy_version 12118 (0.0008) [2023-12-25 23:39:57,317][123091] Updated weights for policy 0, policy_version 12128 (0.0009) [2023-12-25 23:39:57,945][123090] Updated weights for policy 1, policy_version 12033 (0.0007) [2023-12-25 23:39:58,011][123090] Updated weights for policy 1, policy_version 12043 (0.0009) [2023-12-25 23:39:58,079][123090] Updated weights for policy 1, policy_version 12053 (0.0009) [2023-12-25 23:39:58,099][123091] Updated weights for policy 0, policy_version 12138 (0.0008) [2023-12-25 23:39:58,140][123090] Updated weights for policy 1, policy_version 12063 (0.0009) [2023-12-25 23:39:58,161][123091] Updated weights for policy 0, policy_version 12148 (0.0007) [2023-12-25 23:39:58,225][123091] Updated weights for policy 0, policy_version 12158 (0.0010) [2023-12-25 23:39:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 6201344. Throughput: 0: 8618.1, 1: 9022.8. Samples: 6198136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:39:58,785][121949] Avg episode reward: [(0, '1064.112'), (1, '2523.241')] [2023-12-25 23:39:59,039][123090] Updated weights for policy 1, policy_version 12073 (0.0009) [2023-12-25 23:39:59,048][123091] Updated weights for policy 0, policy_version 12168 (0.0007) [2023-12-25 23:39:59,099][123090] Updated weights for policy 1, policy_version 12083 (0.0008) [2023-12-25 23:39:59,104][123091] Updated weights for policy 0, policy_version 12178 (0.0008) [2023-12-25 23:39:59,149][123090] Updated weights for policy 1, policy_version 12093 (0.0009) [2023-12-25 23:39:59,155][123091] Updated weights for policy 0, policy_version 12188 (0.0007) [2023-12-25 23:39:59,958][123090] Updated weights for policy 1, policy_version 12103 (0.0008) [2023-12-25 23:39:59,986][123091] Updated weights for policy 0, policy_version 12198 (0.0008) [2023-12-25 23:40:00,012][123090] Updated weights for policy 1, policy_version 12113 (0.0008) [2023-12-25 23:40:00,045][123091] Updated weights for policy 0, policy_version 12208 (0.0008) [2023-12-25 23:40:00,079][123090] Updated weights for policy 1, policy_version 12123 (0.0008) [2023-12-25 23:40:00,103][123091] Updated weights for policy 0, policy_version 12218 (0.0009) [2023-12-25 23:40:00,827][123090] Updated weights for policy 1, policy_version 12133 (0.0006) [2023-12-25 23:40:00,876][123090] Updated weights for policy 1, policy_version 12143 (0.0005) [2023-12-25 23:40:00,924][123090] Updated weights for policy 1, policy_version 12153 (0.0006) [2023-12-25 23:40:00,965][123091] Updated weights for policy 0, policy_version 12228 (0.0008) [2023-12-25 23:40:01,025][123091] Updated weights for policy 0, policy_version 12238 (0.0006) [2023-12-25 23:40:01,097][123091] Updated weights for policy 0, policy_version 12248 (0.0006) [2023-12-25 23:40:01,759][123090] Updated weights for policy 1, policy_version 12163 (0.0007) [2023-12-25 23:40:01,819][123090] Updated weights for policy 1, policy_version 12173 (0.0009) [2023-12-25 23:40:01,881][123090] Updated weights for policy 1, policy_version 12183 (0.0009) [2023-12-25 23:40:01,909][123091] Updated weights for policy 0, policy_version 12258 (0.0008) [2023-12-25 23:40:01,973][123091] Updated weights for policy 0, policy_version 12268 (0.0009) [2023-12-25 23:40:02,035][123091] Updated weights for policy 0, policy_version 12278 (0.0010) [2023-12-25 23:40:02,101][123091] Updated weights for policy 0, policy_version 12288 (0.0009) [2023-12-25 23:40:02,679][123090] Updated weights for policy 1, policy_version 12193 (0.0008) [2023-12-25 23:40:02,733][123090] Updated weights for policy 1, policy_version 12203 (0.0005) [2023-12-25 23:40:02,788][123090] Updated weights for policy 1, policy_version 12213 (0.0005) [2023-12-25 23:40:02,858][123090] Updated weights for policy 1, policy_version 12223 (0.0005) [2023-12-25 23:40:02,944][123091] Updated weights for policy 0, policy_version 12298 (0.0009) [2023-12-25 23:40:03,011][123091] Updated weights for policy 0, policy_version 12308 (0.0009) [2023-12-25 23:40:03,097][123091] Updated weights for policy 0, policy_version 12318 (0.0009) [2023-12-25 23:40:03,590][123090] Updated weights for policy 1, policy_version 12233 (0.0005) [2023-12-25 23:40:03,656][123090] Updated weights for policy 1, policy_version 12243 (0.0005) [2023-12-25 23:40:03,723][123090] Updated weights for policy 1, policy_version 12253 (0.0005) [2023-12-25 23:40:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 6291456. Throughput: 0: 8611.6, 1: 8966.8. Samples: 6301676. Policy #0 lag: (min: 27.0, avg: 36.1, max: 59.0) [2023-12-25 23:40:03,785][121949] Avg episode reward: [(0, '1019.365'), (1, '2511.643')] [2023-12-25 23:40:03,911][123091] Updated weights for policy 0, policy_version 12328 (0.0010) [2023-12-25 23:40:03,969][123091] Updated weights for policy 0, policy_version 12339 (0.0009) [2023-12-25 23:40:04,018][123091] Updated weights for policy 0, policy_version 12349 (0.0008) [2023-12-25 23:40:04,437][123090] Updated weights for policy 1, policy_version 12263 (0.0008) [2023-12-25 23:40:04,503][123090] Updated weights for policy 1, policy_version 12273 (0.0010) [2023-12-25 23:40:04,579][123090] Updated weights for policy 1, policy_version 12283 (0.0009) [2023-12-25 23:40:04,901][123091] Updated weights for policy 0, policy_version 12359 (0.0009) [2023-12-25 23:40:04,960][123091] Updated weights for policy 0, policy_version 12370 (0.0010) [2023-12-25 23:40:05,015][123091] Updated weights for policy 0, policy_version 12380 (0.0009) [2023-12-25 23:40:05,374][123090] Updated weights for policy 1, policy_version 12293 (0.0008) [2023-12-25 23:40:05,436][123090] Updated weights for policy 1, policy_version 12303 (0.0008) [2023-12-25 23:40:05,505][123090] Updated weights for policy 1, policy_version 12313 (0.0009) [2023-12-25 23:40:05,880][123091] Updated weights for policy 0, policy_version 12390 (0.0009) [2023-12-25 23:40:05,928][123091] Updated weights for policy 0, policy_version 12400 (0.0009) [2023-12-25 23:40:05,980][123091] Updated weights for policy 0, policy_version 12410 (0.0010) [2023-12-25 23:40:06,345][123090] Updated weights for policy 1, policy_version 12323 (0.0008) [2023-12-25 23:40:06,406][123090] Updated weights for policy 1, policy_version 12333 (0.0009) [2023-12-25 23:40:06,462][123090] Updated weights for policy 1, policy_version 12343 (0.0009) [2023-12-25 23:40:06,827][123091] Updated weights for policy 0, policy_version 12420 (0.0009) [2023-12-25 23:40:06,880][123091] Updated weights for policy 0, policy_version 12430 (0.0009) [2023-12-25 23:40:06,929][123091] Updated weights for policy 0, policy_version 12440 (0.0009) [2023-12-25 23:40:07,220][123090] Updated weights for policy 1, policy_version 12353 (0.0009) [2023-12-25 23:40:07,284][123090] Updated weights for policy 1, policy_version 12363 (0.0005) [2023-12-25 23:40:07,339][123090] Updated weights for policy 1, policy_version 12373 (0.0005) [2023-12-25 23:40:07,385][123090] Updated weights for policy 1, policy_version 12383 (0.0005) [2023-12-25 23:40:07,862][123091] Updated weights for policy 0, policy_version 12450 (0.0008) [2023-12-25 23:40:07,915][123091] Updated weights for policy 0, policy_version 12460 (0.0005) [2023-12-25 23:40:07,972][123091] Updated weights for policy 0, policy_version 12470 (0.0007) [2023-12-25 23:40:08,044][123091] Updated weights for policy 0, policy_version 12480 (0.0010) [2023-12-25 23:40:08,075][123090] Updated weights for policy 1, policy_version 12393 (0.0005) [2023-12-25 23:40:08,142][123090] Updated weights for policy 1, policy_version 12403 (0.0006) [2023-12-25 23:40:08,194][123090] Updated weights for policy 1, policy_version 12413 (0.0008) [2023-12-25 23:40:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17605.8). Total num frames: 6373376. Throughput: 0: 8598.6, 1: 8960.3. Samples: 6352688. Policy #0 lag: (min: 27.0, avg: 36.1, max: 59.0) [2023-12-25 23:40:08,785][121949] Avg episode reward: [(0, '990.362'), (1, '2470.979')] [2023-12-25 23:40:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000012416_3178496.pth... [2023-12-25 23:40:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000011392_2916352.pth [2023-12-25 23:40:08,839][123091] Updated weights for policy 0, policy_version 12490 (0.0010) [2023-12-25 23:40:08,907][123091] Updated weights for policy 0, policy_version 12500 (0.0009) [2023-12-25 23:40:08,978][123091] Updated weights for policy 0, policy_version 12510 (0.0009) [2023-12-25 23:40:08,987][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000012512_3203072.pth... [2023-12-25 23:40:08,991][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000011488_2940928.pth [2023-12-25 23:40:09,013][123090] Updated weights for policy 1, policy_version 12423 (0.0008) [2023-12-25 23:40:09,071][123090] Updated weights for policy 1, policy_version 12433 (0.0008) [2023-12-25 23:40:09,129][123090] Updated weights for policy 1, policy_version 12443 (0.0009) [2023-12-25 23:40:09,811][123091] Updated weights for policy 0, policy_version 12520 (0.0006) [2023-12-25 23:40:09,887][123091] Updated weights for policy 0, policy_version 12530 (0.0008) [2023-12-25 23:40:09,959][123091] Updated weights for policy 0, policy_version 12540 (0.0009) [2023-12-25 23:40:10,058][123090] Updated weights for policy 1, policy_version 12453 (0.0010) [2023-12-25 23:40:10,118][123090] Updated weights for policy 1, policy_version 12463 (0.0010) [2023-12-25 23:40:10,175][123090] Updated weights for policy 1, policy_version 12473 (0.0010) [2023-12-25 23:40:10,650][123091] Updated weights for policy 0, policy_version 12550 (0.0008) [2023-12-25 23:40:10,714][123091] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-12-25 23:40:10,773][123091] Updated weights for policy 0, policy_version 12570 (0.0006) [2023-12-25 23:40:10,905][123090] Updated weights for policy 1, policy_version 12483 (0.0009) [2023-12-25 23:40:10,977][123090] Updated weights for policy 1, policy_version 12493 (0.0007) [2023-12-25 23:40:11,059][123090] Updated weights for policy 1, policy_version 12503 (0.0007) [2023-12-25 23:40:11,593][123091] Updated weights for policy 0, policy_version 12580 (0.0007) [2023-12-25 23:40:11,665][123091] Updated weights for policy 0, policy_version 12590 (0.0009) [2023-12-25 23:40:11,738][123091] Updated weights for policy 0, policy_version 12600 (0.0010) [2023-12-25 23:40:11,826][123090] Updated weights for policy 1, policy_version 12513 (0.0009) [2023-12-25 23:40:11,887][123090] Updated weights for policy 1, policy_version 12523 (0.0009) [2023-12-25 23:40:11,953][123090] Updated weights for policy 1, policy_version 12533 (0.0008) [2023-12-25 23:40:12,021][123090] Updated weights for policy 1, policy_version 12543 (0.0009) [2023-12-25 23:40:12,551][123091] Updated weights for policy 0, policy_version 12610 (0.0009) [2023-12-25 23:40:12,612][123091] Updated weights for policy 0, policy_version 12620 (0.0005) [2023-12-25 23:40:12,679][123091] Updated weights for policy 0, policy_version 12630 (0.0009) [2023-12-25 23:40:12,750][123091] Updated weights for policy 0, policy_version 12640 (0.0011) [2023-12-25 23:40:12,856][123090] Updated weights for policy 1, policy_version 12553 (0.0010) [2023-12-25 23:40:12,916][123090] Updated weights for policy 1, policy_version 12563 (0.0010) [2023-12-25 23:40:12,990][123090] Updated weights for policy 1, policy_version 12573 (0.0008) [2023-12-25 23:40:13,482][123091] Updated weights for policy 0, policy_version 12650 (0.0009) [2023-12-25 23:40:13,542][123091] Updated weights for policy 0, policy_version 12660 (0.0009) [2023-12-25 23:40:13,601][123091] Updated weights for policy 0, policy_version 12670 (0.0008) [2023-12-25 23:40:13,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 6463488. Throughput: 0: 8610.5, 1: 8954.7. Samples: 6458524. Policy #0 lag: (min: 19.0, avg: 29.1, max: 51.0) [2023-12-25 23:40:13,786][121949] Avg episode reward: [(0, '1077.387'), (1, '2414.539')] [2023-12-25 23:40:13,837][123090] Updated weights for policy 1, policy_version 12583 (0.0010) [2023-12-25 23:40:13,889][123090] Updated weights for policy 1, policy_version 12593 (0.0010) [2023-12-25 23:40:13,948][123090] Updated weights for policy 1, policy_version 12603 (0.0010) [2023-12-25 23:40:14,327][123091] Updated weights for policy 0, policy_version 12680 (0.0006) [2023-12-25 23:40:14,392][123091] Updated weights for policy 0, policy_version 12690 (0.0005) [2023-12-25 23:40:14,455][123091] Updated weights for policy 0, policy_version 12700 (0.0005) [2023-12-25 23:40:14,803][123090] Updated weights for policy 1, policy_version 12613 (0.0010) [2023-12-25 23:40:14,865][123090] Updated weights for policy 1, policy_version 12623 (0.0009) [2023-12-25 23:40:14,928][123090] Updated weights for policy 1, policy_version 12633 (0.0010) [2023-12-25 23:40:15,131][123091] Updated weights for policy 0, policy_version 12710 (0.0008) [2023-12-25 23:40:15,197][123091] Updated weights for policy 0, policy_version 12720 (0.0010) [2023-12-25 23:40:15,259][123091] Updated weights for policy 0, policy_version 12730 (0.0010) [2023-12-25 23:40:15,778][123090] Updated weights for policy 1, policy_version 12643 (0.0009) [2023-12-25 23:40:15,840][123090] Updated weights for policy 1, policy_version 12653 (0.0010) [2023-12-25 23:40:15,894][123090] Updated weights for policy 1, policy_version 12663 (0.0010) [2023-12-25 23:40:16,011][123091] Updated weights for policy 0, policy_version 12740 (0.0009) [2023-12-25 23:40:16,079][123091] Updated weights for policy 0, policy_version 12750 (0.0010) [2023-12-25 23:40:16,140][123091] Updated weights for policy 0, policy_version 12760 (0.0009) [2023-12-25 23:40:16,777][123090] Updated weights for policy 1, policy_version 12673 (0.0010) [2023-12-25 23:40:16,847][123090] Updated weights for policy 1, policy_version 12683 (0.0008) [2023-12-25 23:40:16,907][123091] Updated weights for policy 0, policy_version 12770 (0.0006) [2023-12-25 23:40:16,911][123090] Updated weights for policy 1, policy_version 12693 (0.0009) [2023-12-25 23:40:16,974][123090] Updated weights for policy 1, policy_version 12703 (0.0008) [2023-12-25 23:40:16,975][123091] Updated weights for policy 0, policy_version 12780 (0.0007) [2023-12-25 23:40:17,038][123091] Updated weights for policy 0, policy_version 12790 (0.0010) [2023-12-25 23:40:17,096][123091] Updated weights for policy 0, policy_version 12800 (0.0009) [2023-12-25 23:40:17,820][123091] Updated weights for policy 0, policy_version 12810 (0.0008) [2023-12-25 23:40:17,830][123090] Updated weights for policy 1, policy_version 12713 (0.0006) [2023-12-25 23:40:17,885][123090] Updated weights for policy 1, policy_version 12723 (0.0006) [2023-12-25 23:40:17,886][123091] Updated weights for policy 0, policy_version 12820 (0.0008) [2023-12-25 23:40:17,940][123090] Updated weights for policy 1, policy_version 12733 (0.0005) [2023-12-25 23:40:17,943][123091] Updated weights for policy 0, policy_version 12830 (0.0008) [2023-12-25 23:40:18,723][123091] Updated weights for policy 0, policy_version 12840 (0.0009) [2023-12-25 23:40:18,779][123090] Updated weights for policy 1, policy_version 12743 (0.0008) [2023-12-25 23:40:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 6545408. Throughput: 0: 8698.4, 1: 8893.0. Samples: 6564584. Policy #0 lag: (min: 19.0, avg: 29.1, max: 51.0) [2023-12-25 23:40:18,785][121949] Avg episode reward: [(0, '1044.204'), (1, '2556.126')] [2023-12-25 23:40:18,787][123091] Updated weights for policy 0, policy_version 12850 (0.0009) [2023-12-25 23:40:18,845][123090] Updated weights for policy 1, policy_version 12753 (0.0009) [2023-12-25 23:40:18,847][123091] Updated weights for policy 0, policy_version 12860 (0.0007) [2023-12-25 23:40:18,909][123090] Updated weights for policy 1, policy_version 12763 (0.0009) [2023-12-25 23:40:19,703][123091] Updated weights for policy 0, policy_version 12870 (0.0008) [2023-12-25 23:40:19,757][123090] Updated weights for policy 1, policy_version 12773 (0.0008) [2023-12-25 23:40:19,763][123091] Updated weights for policy 0, policy_version 12880 (0.0010) [2023-12-25 23:40:19,823][123090] Updated weights for policy 1, policy_version 12783 (0.0009) [2023-12-25 23:40:19,828][123091] Updated weights for policy 0, policy_version 12890 (0.0008) [2023-12-25 23:40:19,894][123090] Updated weights for policy 1, policy_version 12793 (0.0008) [2023-12-25 23:40:20,575][123091] Updated weights for policy 0, policy_version 12900 (0.0008) [2023-12-25 23:40:20,642][123091] Updated weights for policy 0, policy_version 12910 (0.0008) [2023-12-25 23:40:20,710][123091] Updated weights for policy 0, policy_version 12920 (0.0008) [2023-12-25 23:40:20,730][123090] Updated weights for policy 1, policy_version 12803 (0.0010) [2023-12-25 23:40:20,789][123090] Updated weights for policy 1, policy_version 12813 (0.0009) [2023-12-25 23:40:20,851][123090] Updated weights for policy 1, policy_version 12823 (0.0009) [2023-12-25 23:40:21,535][123091] Updated weights for policy 0, policy_version 12930 (0.0009) [2023-12-25 23:40:21,610][123091] Updated weights for policy 0, policy_version 12940 (0.0009) [2023-12-25 23:40:21,675][123091] Updated weights for policy 0, policy_version 12950 (0.0009) [2023-12-25 23:40:21,738][123090] Updated weights for policy 1, policy_version 12833 (0.0009) [2023-12-25 23:40:21,753][123091] Updated weights for policy 0, policy_version 12960 (0.0009) [2023-12-25 23:40:21,804][123090] Updated weights for policy 1, policy_version 12843 (0.0010) [2023-12-25 23:40:21,860][123090] Updated weights for policy 1, policy_version 12853 (0.0009) [2023-12-25 23:40:21,939][123090] Updated weights for policy 1, policy_version 12863 (0.0010) [2023-12-25 23:40:22,473][123091] Updated weights for policy 0, policy_version 12970 (0.0007) [2023-12-25 23:40:22,531][123091] Updated weights for policy 0, policy_version 12980 (0.0006) [2023-12-25 23:40:22,603][123091] Updated weights for policy 0, policy_version 12990 (0.0009) [2023-12-25 23:40:22,856][123090] Updated weights for policy 1, policy_version 12873 (0.0009) [2023-12-25 23:40:22,914][123090] Updated weights for policy 1, policy_version 12883 (0.0009) [2023-12-25 23:40:22,972][123090] Updated weights for policy 1, policy_version 12893 (0.0009) [2023-12-25 23:40:23,420][123091] Updated weights for policy 0, policy_version 13000 (0.0008) [2023-12-25 23:40:23,494][123091] Updated weights for policy 0, policy_version 13010 (0.0006) [2023-12-25 23:40:23,560][123091] Updated weights for policy 0, policy_version 13020 (0.0010) [2023-12-25 23:40:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 6635520. Throughput: 0: 8695.2, 1: 8768.3. Samples: 6615228. Policy #0 lag: (min: 10.0, avg: 27.5, max: 42.0) [2023-12-25 23:40:23,786][121949] Avg episode reward: [(0, '1020.001'), (1, '2633.116')] [2023-12-25 23:40:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000013024_3334144.pth... [2023-12-25 23:40:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000012000_3072000.pth [2023-12-25 23:40:23,839][123090] Updated weights for policy 1, policy_version 12903 (0.0010) [2023-12-25 23:40:23,905][123090] Updated weights for policy 1, policy_version 12913 (0.0009) [2023-12-25 23:40:23,955][123090] Updated weights for policy 1, policy_version 12923 (0.0009) [2023-12-25 23:40:23,977][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000012928_3309568.pth... [2023-12-25 23:40:23,982][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000011904_3047424.pth [2023-12-25 23:40:24,358][123091] Updated weights for policy 0, policy_version 13030 (0.0009) [2023-12-25 23:40:24,427][123091] Updated weights for policy 0, policy_version 13040 (0.0009) [2023-12-25 23:40:24,489][123091] Updated weights for policy 0, policy_version 13050 (0.0009) [2023-12-25 23:40:24,781][123090] Updated weights for policy 1, policy_version 12934 (0.0010) [2023-12-25 23:40:24,833][123090] Updated weights for policy 1, policy_version 12944 (0.0009) [2023-12-25 23:40:24,885][123090] Updated weights for policy 1, policy_version 12954 (0.0009) [2023-12-25 23:40:25,222][123091] Updated weights for policy 0, policy_version 13060 (0.0009) [2023-12-25 23:40:25,273][123091] Updated weights for policy 0, policy_version 13070 (0.0009) [2023-12-25 23:40:25,320][123091] Updated weights for policy 0, policy_version 13080 (0.0009) [2023-12-25 23:40:25,737][123090] Updated weights for policy 1, policy_version 12965 (0.0010) [2023-12-25 23:40:25,807][123090] Updated weights for policy 1, policy_version 12975 (0.0007) [2023-12-25 23:40:25,883][123090] Updated weights for policy 1, policy_version 12985 (0.0006) [2023-12-25 23:40:26,162][123091] Updated weights for policy 0, policy_version 13090 (0.0009) [2023-12-25 23:40:26,221][123091] Updated weights for policy 0, policy_version 13100 (0.0010) [2023-12-25 23:40:26,291][123091] Updated weights for policy 0, policy_version 13110 (0.0010) [2023-12-25 23:40:26,354][123091] Updated weights for policy 0, policy_version 13120 (0.0009) [2023-12-25 23:40:26,655][123090] Updated weights for policy 1, policy_version 12995 (0.0009) [2023-12-25 23:40:26,717][123090] Updated weights for policy 1, policy_version 13005 (0.0009) [2023-12-25 23:40:26,779][123090] Updated weights for policy 1, policy_version 13015 (0.0007) [2023-12-25 23:40:27,164][123091] Updated weights for policy 0, policy_version 13130 (0.0010) [2023-12-25 23:40:27,226][123091] Updated weights for policy 0, policy_version 13140 (0.0010) [2023-12-25 23:40:27,288][123091] Updated weights for policy 0, policy_version 13150 (0.0009) [2023-12-25 23:40:27,623][123090] Updated weights for policy 1, policy_version 13025 (0.0010) [2023-12-25 23:40:27,687][123090] Updated weights for policy 1, policy_version 13035 (0.0009) [2023-12-25 23:40:27,749][123090] Updated weights for policy 1, policy_version 13045 (0.0009) [2023-12-25 23:40:27,816][123090] Updated weights for policy 1, policy_version 13055 (0.0009) [2023-12-25 23:40:28,111][123091] Updated weights for policy 0, policy_version 13160 (0.0009) [2023-12-25 23:40:28,166][123091] Updated weights for policy 0, policy_version 13170 (0.0009) [2023-12-25 23:40:28,228][123091] Updated weights for policy 0, policy_version 13180 (0.0009) [2023-12-25 23:40:28,646][123090] Updated weights for policy 1, policy_version 13065 (0.0010) [2023-12-25 23:40:28,711][123090] Updated weights for policy 1, policy_version 13075 (0.0009) [2023-12-25 23:40:28,775][123090] Updated weights for policy 1, policy_version 13085 (0.0010) [2023-12-25 23:40:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 6717440. Throughput: 0: 8768.9, 1: 8682.5. Samples: 6717568. Policy #0 lag: (min: 10.0, avg: 27.5, max: 42.0) [2023-12-25 23:40:28,785][121949] Avg episode reward: [(0, '1014.148'), (1, '2895.895')] [2023-12-25 23:40:28,789][123008] Saving new best policy, reward=2895.895! [2023-12-25 23:40:29,058][123091] Updated weights for policy 0, policy_version 13190 (0.0009) [2023-12-25 23:40:29,122][123091] Updated weights for policy 0, policy_version 13200 (0.0009) [2023-12-25 23:40:29,188][123091] Updated weights for policy 0, policy_version 13210 (0.0010) [2023-12-25 23:40:29,662][123090] Updated weights for policy 1, policy_version 13095 (0.0008) [2023-12-25 23:40:29,729][123090] Updated weights for policy 1, policy_version 13105 (0.0007) [2023-12-25 23:40:29,792][123090] Updated weights for policy 1, policy_version 13115 (0.0008) [2023-12-25 23:40:29,995][123091] Updated weights for policy 0, policy_version 13220 (0.0008) [2023-12-25 23:40:30,049][123091] Updated weights for policy 0, policy_version 13230 (0.0009) [2023-12-25 23:40:30,098][123091] Updated weights for policy 0, policy_version 13240 (0.0009) [2023-12-25 23:40:30,592][123090] Updated weights for policy 1, policy_version 13125 (0.0009) [2023-12-25 23:40:30,644][123090] Updated weights for policy 1, policy_version 13135 (0.0008) [2023-12-25 23:40:30,706][123090] Updated weights for policy 1, policy_version 13145 (0.0009) [2023-12-25 23:40:30,946][123091] Updated weights for policy 0, policy_version 13250 (0.0009) [2023-12-25 23:40:31,004][123091] Updated weights for policy 0, policy_version 13260 (0.0009) [2023-12-25 23:40:31,071][123091] Updated weights for policy 0, policy_version 13270 (0.0010) [2023-12-25 23:40:31,138][123091] Updated weights for policy 0, policy_version 13280 (0.0008) [2023-12-25 23:40:31,574][123090] Updated weights for policy 1, policy_version 13155 (0.0009) [2023-12-25 23:40:31,646][123090] Updated weights for policy 1, policy_version 13165 (0.0009) [2023-12-25 23:40:31,711][123090] Updated weights for policy 1, policy_version 13175 (0.0009) [2023-12-25 23:40:31,987][123091] Updated weights for policy 0, policy_version 13290 (0.0010) [2023-12-25 23:40:32,051][123091] Updated weights for policy 0, policy_version 13300 (0.0010) [2023-12-25 23:40:32,113][123091] Updated weights for policy 0, policy_version 13310 (0.0009) [2023-12-25 23:40:32,560][123090] Updated weights for policy 1, policy_version 13185 (0.0009) [2023-12-25 23:40:32,623][123090] Updated weights for policy 1, policy_version 13195 (0.0005) [2023-12-25 23:40:32,689][123090] Updated weights for policy 1, policy_version 13205 (0.0008) [2023-12-25 23:40:32,754][123090] Updated weights for policy 1, policy_version 13215 (0.0008) [2023-12-25 23:40:32,909][123091] Updated weights for policy 0, policy_version 13320 (0.0006) [2023-12-25 23:40:32,972][123091] Updated weights for policy 0, policy_version 13330 (0.0005) [2023-12-25 23:40:33,017][123091] Updated weights for policy 0, policy_version 13340 (0.0005) [2023-12-25 23:40:33,599][123090] Updated weights for policy 1, policy_version 13225 (0.0010) [2023-12-25 23:40:33,629][123091] Updated weights for policy 0, policy_version 13350 (0.0005) [2023-12-25 23:40:33,663][123090] Updated weights for policy 1, policy_version 13235 (0.0009) [2023-12-25 23:40:33,685][123091] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-12-25 23:40:33,723][123090] Updated weights for policy 1, policy_version 13245 (0.0008) [2023-12-25 23:40:33,735][123091] Updated weights for policy 0, policy_version 13370 (0.0005) [2023-12-25 23:40:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 6815744. Throughput: 0: 8758.7, 1: 8606.9. Samples: 6820712. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-25 23:40:33,785][121949] Avg episode reward: [(0, '1073.161'), (1, '2737.947')] [2023-12-25 23:40:34,433][123091] Updated weights for policy 0, policy_version 13380 (0.0007) [2023-12-25 23:40:34,492][123091] Updated weights for policy 0, policy_version 13390 (0.0011) [2023-12-25 23:40:34,540][123091] Updated weights for policy 0, policy_version 13400 (0.0010) [2023-12-25 23:40:34,593][123090] Updated weights for policy 1, policy_version 13255 (0.0010) [2023-12-25 23:40:34,649][123090] Updated weights for policy 1, policy_version 13265 (0.0008) [2023-12-25 23:40:34,707][123090] Updated weights for policy 1, policy_version 13275 (0.0009) [2023-12-25 23:40:35,350][123091] Updated weights for policy 0, policy_version 13410 (0.0010) [2023-12-25 23:40:35,411][123091] Updated weights for policy 0, policy_version 13420 (0.0005) [2023-12-25 23:40:35,475][123091] Updated weights for policy 0, policy_version 13430 (0.0005) [2023-12-25 23:40:35,527][123091] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-12-25 23:40:35,583][123090] Updated weights for policy 1, policy_version 13285 (0.0010) [2023-12-25 23:40:35,649][123090] Updated weights for policy 1, policy_version 13295 (0.0009) [2023-12-25 23:40:35,715][123090] Updated weights for policy 1, policy_version 13305 (0.0010) [2023-12-25 23:40:36,226][123091] Updated weights for policy 0, policy_version 13450 (0.0011) [2023-12-25 23:40:36,281][123091] Updated weights for policy 0, policy_version 13460 (0.0010) [2023-12-25 23:40:36,340][123091] Updated weights for policy 0, policy_version 13470 (0.0010) [2023-12-25 23:40:36,577][123090] Updated weights for policy 1, policy_version 13315 (0.0009) [2023-12-25 23:40:36,639][123090] Updated weights for policy 1, policy_version 13325 (0.0008) [2023-12-25 23:40:36,708][123090] Updated weights for policy 1, policy_version 13335 (0.0009) [2023-12-25 23:40:37,203][123091] Updated weights for policy 0, policy_version 13480 (0.0011) [2023-12-25 23:40:37,261][123091] Updated weights for policy 0, policy_version 13490 (0.0010) [2023-12-25 23:40:37,319][123091] Updated weights for policy 0, policy_version 13500 (0.0011) [2023-12-25 23:40:37,550][123090] Updated weights for policy 1, policy_version 13345 (0.0009) [2023-12-25 23:40:37,620][123090] Updated weights for policy 1, policy_version 13355 (0.0009) [2023-12-25 23:40:37,684][123090] Updated weights for policy 1, policy_version 13365 (0.0009) [2023-12-25 23:40:37,745][123090] Updated weights for policy 1, policy_version 13375 (0.0009) [2023-12-25 23:40:38,111][123091] Updated weights for policy 0, policy_version 13510 (0.0008) [2023-12-25 23:40:38,189][123091] Updated weights for policy 0, policy_version 13520 (0.0005) [2023-12-25 23:40:38,256][123091] Updated weights for policy 0, policy_version 13530 (0.0005) [2023-12-25 23:40:38,527][123090] Updated weights for policy 1, policy_version 13385 (0.0009) [2023-12-25 23:40:38,586][123090] Updated weights for policy 1, policy_version 13395 (0.0009) [2023-12-25 23:40:38,643][123090] Updated weights for policy 1, policy_version 13405 (0.0009) [2023-12-25 23:40:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 6897664. Throughput: 0: 8803.5, 1: 8578.3. Samples: 6872724. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-25 23:40:38,784][121949] Avg episode reward: [(0, '1110.562'), (1, '2780.597')] [2023-12-25 23:40:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000013408_3432448.pth... [2023-12-25 23:40:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000013536_3465216.pth... [2023-12-25 23:40:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000012416_3178496.pth [2023-12-25 23:40:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000012512_3203072.pth [2023-12-25 23:40:39,051][123091] Updated weights for policy 0, policy_version 13540 (0.0010) [2023-12-25 23:40:39,110][123091] Updated weights for policy 0, policy_version 13550 (0.0009) [2023-12-25 23:40:39,169][123091] Updated weights for policy 0, policy_version 13560 (0.0010) [2023-12-25 23:40:39,497][123090] Updated weights for policy 1, policy_version 13415 (0.0009) [2023-12-25 23:40:39,562][123090] Updated weights for policy 1, policy_version 13425 (0.0009) [2023-12-25 23:40:39,630][123090] Updated weights for policy 1, policy_version 13435 (0.0009) [2023-12-25 23:40:40,025][123091] Updated weights for policy 0, policy_version 13570 (0.0009) [2023-12-25 23:40:40,088][123091] Updated weights for policy 0, policy_version 13580 (0.0009) [2023-12-25 23:40:40,145][123091] Updated weights for policy 0, policy_version 13590 (0.0009) [2023-12-25 23:40:40,195][123091] Updated weights for policy 0, policy_version 13600 (0.0009) [2023-12-25 23:40:40,482][123090] Updated weights for policy 1, policy_version 13445 (0.0009) [2023-12-25 23:40:40,538][123090] Updated weights for policy 1, policy_version 13455 (0.0009) [2023-12-25 23:40:40,595][123090] Updated weights for policy 1, policy_version 13465 (0.0009) [2023-12-25 23:40:40,991][123091] Updated weights for policy 0, policy_version 13610 (0.0006) [2023-12-25 23:40:41,065][123091] Updated weights for policy 0, policy_version 13620 (0.0007) [2023-12-25 23:40:41,138][123091] Updated weights for policy 0, policy_version 13630 (0.0007) [2023-12-25 23:40:41,482][123090] Updated weights for policy 1, policy_version 13475 (0.0009) [2023-12-25 23:40:41,549][123090] Updated weights for policy 1, policy_version 13485 (0.0009) [2023-12-25 23:40:41,613][123090] Updated weights for policy 1, policy_version 13495 (0.0006) [2023-12-25 23:40:41,969][123091] Updated weights for policy 0, policy_version 13640 (0.0010) [2023-12-25 23:40:42,038][123091] Updated weights for policy 0, policy_version 13650 (0.0011) [2023-12-25 23:40:42,112][123091] Updated weights for policy 0, policy_version 13660 (0.0010) [2023-12-25 23:40:42,404][123090] Updated weights for policy 1, policy_version 13505 (0.0007) [2023-12-25 23:40:42,470][123090] Updated weights for policy 1, policy_version 13515 (0.0010) [2023-12-25 23:40:42,536][123090] Updated weights for policy 1, policy_version 13525 (0.0010) [2023-12-25 23:40:42,605][123090] Updated weights for policy 1, policy_version 13535 (0.0008) [2023-12-25 23:40:42,906][123091] Updated weights for policy 0, policy_version 13670 (0.0007) [2023-12-25 23:40:42,956][123091] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-12-25 23:40:43,004][123091] Updated weights for policy 0, policy_version 13690 (0.0005) [2023-12-25 23:40:43,355][123090] Updated weights for policy 1, policy_version 13545 (0.0010) [2023-12-25 23:40:43,411][123090] Updated weights for policy 1, policy_version 13555 (0.0010) [2023-12-25 23:40:43,470][123090] Updated weights for policy 1, policy_version 13565 (0.0010) [2023-12-25 23:40:43,722][123091] Updated weights for policy 0, policy_version 13700 (0.0005) [2023-12-25 23:40:43,775][123091] Updated weights for policy 0, policy_version 13710 (0.0005) [2023-12-25 23:40:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 6979584. Throughput: 0: 8777.1, 1: 8465.7. Samples: 6974060. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-25 23:40:43,785][121949] Avg episode reward: [(0, '1082.929'), (1, '3070.617')] [2023-12-25 23:40:43,785][123008] Saving new best policy, reward=3070.617! [2023-12-25 23:40:43,827][123091] Updated weights for policy 0, policy_version 13720 (0.0005) [2023-12-25 23:40:44,292][123090] Updated weights for policy 1, policy_version 13575 (0.0010) [2023-12-25 23:40:44,355][123090] Updated weights for policy 1, policy_version 13585 (0.0010) [2023-12-25 23:40:44,418][123090] Updated weights for policy 1, policy_version 13595 (0.0010) [2023-12-25 23:40:44,561][123091] Updated weights for policy 0, policy_version 13730 (0.0005) [2023-12-25 23:40:44,629][123091] Updated weights for policy 0, policy_version 13740 (0.0005) [2023-12-25 23:40:44,695][123091] Updated weights for policy 0, policy_version 13750 (0.0007) [2023-12-25 23:40:44,753][123091] Updated weights for policy 0, policy_version 13760 (0.0006) [2023-12-25 23:40:45,225][123090] Updated weights for policy 1, policy_version 13605 (0.0010) [2023-12-25 23:40:45,276][123090] Updated weights for policy 1, policy_version 13615 (0.0009) [2023-12-25 23:40:45,338][123090] Updated weights for policy 1, policy_version 13625 (0.0010) [2023-12-25 23:40:45,465][123091] Updated weights for policy 0, policy_version 13770 (0.0009) [2023-12-25 23:40:45,520][123091] Updated weights for policy 0, policy_version 13780 (0.0010) [2023-12-25 23:40:45,577][123091] Updated weights for policy 0, policy_version 13790 (0.0010) [2023-12-25 23:40:46,061][123090] Updated weights for policy 1, policy_version 13635 (0.0007) [2023-12-25 23:40:46,113][123090] Updated weights for policy 1, policy_version 13645 (0.0005) [2023-12-25 23:40:46,183][123090] Updated weights for policy 1, policy_version 13655 (0.0005) [2023-12-25 23:40:46,409][123091] Updated weights for policy 0, policy_version 13800 (0.0007) [2023-12-25 23:40:46,471][123091] Updated weights for policy 0, policy_version 13810 (0.0006) [2023-12-25 23:40:46,528][123091] Updated weights for policy 0, policy_version 13820 (0.0006) [2023-12-25 23:40:46,857][123090] Updated weights for policy 1, policy_version 13665 (0.0006) [2023-12-25 23:40:46,920][123090] Updated weights for policy 1, policy_version 13675 (0.0005) [2023-12-25 23:40:46,969][123090] Updated weights for policy 1, policy_version 13685 (0.0005) [2023-12-25 23:40:47,027][123090] Updated weights for policy 1, policy_version 13695 (0.0005) [2023-12-25 23:40:47,155][123091] Updated weights for policy 0, policy_version 13830 (0.0006) [2023-12-25 23:40:47,218][123091] Updated weights for policy 0, policy_version 13840 (0.0007) [2023-12-25 23:40:47,274][123091] Updated weights for policy 0, policy_version 13850 (0.0006) [2023-12-25 23:40:47,810][123090] Updated weights for policy 1, policy_version 13705 (0.0010) [2023-12-25 23:40:47,876][123090] Updated weights for policy 1, policy_version 13715 (0.0010) [2023-12-25 23:40:47,938][123090] Updated weights for policy 1, policy_version 13725 (0.0010) [2023-12-25 23:40:47,975][123091] Updated weights for policy 0, policy_version 13860 (0.0006) [2023-12-25 23:40:48,026][123091] Updated weights for policy 0, policy_version 13870 (0.0006) [2023-12-25 23:40:48,094][123091] Updated weights for policy 0, policy_version 13880 (0.0006) [2023-12-25 23:40:48,730][123090] Updated weights for policy 1, policy_version 13735 (0.0010) [2023-12-25 23:40:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 7069696. Throughput: 0: 8924.4, 1: 8529.5. Samples: 7087100. Policy #0 lag: (min: 2.0, avg: 17.8, max: 34.0) [2023-12-25 23:40:48,785][121949] Avg episode reward: [(0, '1061.282'), (1, '3152.720')] [2023-12-25 23:40:48,789][123090] Updated weights for policy 1, policy_version 13745 (0.0010) [2023-12-25 23:40:48,848][123090] Updated weights for policy 1, policy_version 13755 (0.0007) [2023-12-25 23:40:48,853][123091] Updated weights for policy 0, policy_version 13890 (0.0006) [2023-12-25 23:40:48,882][123008] Saving new best policy, reward=3152.720! [2023-12-25 23:40:48,919][123091] Updated weights for policy 0, policy_version 13900 (0.0011) [2023-12-25 23:40:48,974][123091] Updated weights for policy 0, policy_version 13910 (0.0010) [2023-12-25 23:40:49,018][123091] Updated weights for policy 0, policy_version 13920 (0.0010) [2023-12-25 23:40:49,632][123090] Updated weights for policy 1, policy_version 13765 (0.0005) [2023-12-25 23:40:49,702][123090] Updated weights for policy 1, policy_version 13775 (0.0008) [2023-12-25 23:40:49,767][123090] Updated weights for policy 1, policy_version 13785 (0.0009) [2023-12-25 23:40:49,865][123091] Updated weights for policy 0, policy_version 13930 (0.0010) [2023-12-25 23:40:49,938][123091] Updated weights for policy 0, policy_version 13940 (0.0008) [2023-12-25 23:40:50,001][123091] Updated weights for policy 0, policy_version 13950 (0.0008) [2023-12-25 23:40:50,473][123090] Updated weights for policy 1, policy_version 13795 (0.0009) [2023-12-25 23:40:50,528][123090] Updated weights for policy 1, policy_version 13805 (0.0010) [2023-12-25 23:40:50,600][123090] Updated weights for policy 1, policy_version 13815 (0.0010) [2023-12-25 23:40:50,733][123091] Updated weights for policy 0, policy_version 13960 (0.0006) [2023-12-25 23:40:50,797][123091] Updated weights for policy 0, policy_version 13970 (0.0006) [2023-12-25 23:40:50,854][123091] Updated weights for policy 0, policy_version 13980 (0.0006) [2023-12-25 23:40:51,355][123090] Updated weights for policy 1, policy_version 13825 (0.0009) [2023-12-25 23:40:51,423][123090] Updated weights for policy 1, policy_version 13835 (0.0008) [2023-12-25 23:40:51,487][123090] Updated weights for policy 1, policy_version 13845 (0.0008) [2023-12-25 23:40:51,552][123090] Updated weights for policy 1, policy_version 13855 (0.0008) [2023-12-25 23:40:51,640][123091] Updated weights for policy 0, policy_version 13990 (0.0010) [2023-12-25 23:40:51,713][123091] Updated weights for policy 0, policy_version 14000 (0.0007) [2023-12-25 23:40:51,783][123091] Updated weights for policy 0, policy_version 14010 (0.0007) [2023-12-25 23:40:52,273][123090] Updated weights for policy 1, policy_version 13865 (0.0009) [2023-12-25 23:40:52,334][123090] Updated weights for policy 1, policy_version 13875 (0.0009) [2023-12-25 23:40:52,405][123090] Updated weights for policy 1, policy_version 13885 (0.0009) [2023-12-25 23:40:52,578][123091] Updated weights for policy 0, policy_version 14020 (0.0008) [2023-12-25 23:40:52,641][123091] Updated weights for policy 0, policy_version 14030 (0.0008) [2023-12-25 23:40:52,703][123091] Updated weights for policy 0, policy_version 14040 (0.0006) [2023-12-25 23:40:53,209][123090] Updated weights for policy 1, policy_version 13895 (0.0009) [2023-12-25 23:40:53,262][123090] Updated weights for policy 1, policy_version 13905 (0.0010) [2023-12-25 23:40:53,318][123090] Updated weights for policy 1, policy_version 13916 (0.0010) [2023-12-25 23:40:53,346][123091] Updated weights for policy 0, policy_version 14050 (0.0007) [2023-12-25 23:40:53,396][123091] Updated weights for policy 0, policy_version 14060 (0.0006) [2023-12-25 23:40:53,447][123091] Updated weights for policy 0, policy_version 14070 (0.0006) [2023-12-25 23:40:53,502][123091] Updated weights for policy 0, policy_version 14080 (0.0006) [2023-12-25 23:40:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 7168000. Throughput: 0: 8966.6, 1: 8564.3. Samples: 7141576. Policy #0 lag: (min: 2.0, avg: 17.8, max: 34.0) [2023-12-25 23:40:53,785][121949] Avg episode reward: [(0, '1096.103'), (1, '3108.512')] [2023-12-25 23:40:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000014080_3604480.pth... [2023-12-25 23:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000013920_3563520.pth... [2023-12-25 23:40:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000013024_3334144.pth [2023-12-25 23:40:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000012928_3309568.pth [2023-12-25 23:40:54,105][123090] Updated weights for policy 1, policy_version 13926 (0.0007) [2023-12-25 23:40:54,161][123090] Updated weights for policy 1, policy_version 13936 (0.0010) [2023-12-25 23:40:54,199][123091] Updated weights for policy 0, policy_version 14090 (0.0006) [2023-12-25 23:40:54,213][123090] Updated weights for policy 1, policy_version 13946 (0.0010) [2023-12-25 23:40:54,264][123091] Updated weights for policy 0, policy_version 14100 (0.0007) [2023-12-25 23:40:54,336][123091] Updated weights for policy 0, policy_version 14110 (0.0009) [2023-12-25 23:40:55,042][123090] Updated weights for policy 1, policy_version 13956 (0.0010) [2023-12-25 23:40:55,094][123091] Updated weights for policy 0, policy_version 14120 (0.0009) [2023-12-25 23:40:55,101][123090] Updated weights for policy 1, policy_version 13966 (0.0009) [2023-12-25 23:40:55,143][123091] Updated weights for policy 0, policy_version 14130 (0.0006) [2023-12-25 23:40:55,154][123090] Updated weights for policy 1, policy_version 13976 (0.0010) [2023-12-25 23:40:55,201][123091] Updated weights for policy 0, policy_version 14140 (0.0006) [2023-12-25 23:40:55,859][123091] Updated weights for policy 0, policy_version 14150 (0.0007) [2023-12-25 23:40:55,908][123090] Updated weights for policy 1, policy_version 13986 (0.0009) [2023-12-25 23:40:55,910][123091] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-12-25 23:40:55,970][123091] Updated weights for policy 0, policy_version 14170 (0.0005) [2023-12-25 23:40:55,970][123090] Updated weights for policy 1, policy_version 13996 (0.0009) [2023-12-25 23:40:56,024][123090] Updated weights for policy 1, policy_version 14006 (0.0010) [2023-12-25 23:40:56,075][123090] Updated weights for policy 1, policy_version 14016 (0.0010) [2023-12-25 23:40:56,629][123091] Updated weights for policy 0, policy_version 14180 (0.0005) [2023-12-25 23:40:56,686][123091] Updated weights for policy 0, policy_version 14190 (0.0006) [2023-12-25 23:40:56,750][123091] Updated weights for policy 0, policy_version 14200 (0.0005) [2023-12-25 23:40:56,814][123090] Updated weights for policy 1, policy_version 14026 (0.0006) [2023-12-25 23:40:56,877][123090] Updated weights for policy 1, policy_version 14036 (0.0005) [2023-12-25 23:40:56,941][123090] Updated weights for policy 1, policy_version 14046 (0.0005) [2023-12-25 23:40:57,492][123091] Updated weights for policy 0, policy_version 14210 (0.0005) [2023-12-25 23:40:57,540][123091] Updated weights for policy 0, policy_version 14220 (0.0005) [2023-12-25 23:40:57,586][123091] Updated weights for policy 0, policy_version 14230 (0.0005) [2023-12-25 23:40:57,640][123091] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-12-25 23:40:57,693][123090] Updated weights for policy 1, policy_version 14056 (0.0008) [2023-12-25 23:40:57,753][123090] Updated weights for policy 1, policy_version 14066 (0.0009) [2023-12-25 23:40:57,807][123090] Updated weights for policy 1, policy_version 14076 (0.0009) [2023-12-25 23:40:58,496][123091] Updated weights for policy 0, policy_version 14250 (0.0008) [2023-12-25 23:40:58,558][123091] Updated weights for policy 0, policy_version 14260 (0.0010) [2023-12-25 23:40:58,629][123091] Updated weights for policy 0, policy_version 14270 (0.0009) [2023-12-25 23:40:58,700][123090] Updated weights for policy 1, policy_version 14086 (0.0010) [2023-12-25 23:40:58,757][123090] Updated weights for policy 1, policy_version 14096 (0.0011) [2023-12-25 23:40:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 7258112. Throughput: 0: 9115.1, 1: 8579.4. Samples: 7254768. Policy #0 lag: (min: 17.0, avg: 35.2, max: 49.0) [2023-12-25 23:40:58,785][121949] Avg episode reward: [(0, '1248.442'), (1, '3124.719')] [2023-12-25 23:40:58,785][123007] Saving new best policy, reward=1248.442! [2023-12-25 23:40:58,812][123090] Updated weights for policy 1, policy_version 14106 (0.0010) [2023-12-25 23:40:59,412][123091] Updated weights for policy 0, policy_version 14280 (0.0009) [2023-12-25 23:40:59,464][123091] Updated weights for policy 0, policy_version 14290 (0.0009) [2023-12-25 23:40:59,519][123091] Updated weights for policy 0, policy_version 14300 (0.0008) [2023-12-25 23:40:59,602][123090] Updated weights for policy 1, policy_version 14116 (0.0009) [2023-12-25 23:40:59,665][123090] Updated weights for policy 1, policy_version 14126 (0.0007) [2023-12-25 23:40:59,723][123090] Updated weights for policy 1, policy_version 14136 (0.0009) [2023-12-25 23:41:00,309][123091] Updated weights for policy 0, policy_version 14310 (0.0008) [2023-12-25 23:41:00,372][123091] Updated weights for policy 0, policy_version 14320 (0.0010) [2023-12-25 23:41:00,438][123091] Updated weights for policy 0, policy_version 14330 (0.0009) [2023-12-25 23:41:00,487][123090] Updated weights for policy 1, policy_version 14146 (0.0009) [2023-12-25 23:41:00,555][123090] Updated weights for policy 1, policy_version 14156 (0.0006) [2023-12-25 23:41:00,609][123090] Updated weights for policy 1, policy_version 14166 (0.0005) [2023-12-25 23:41:00,662][123090] Updated weights for policy 1, policy_version 14176 (0.0005) [2023-12-25 23:41:01,339][123091] Updated weights for policy 0, policy_version 14340 (0.0009) [2023-12-25 23:41:01,386][123090] Updated weights for policy 1, policy_version 14186 (0.0009) [2023-12-25 23:41:01,399][123091] Updated weights for policy 0, policy_version 14350 (0.0009) [2023-12-25 23:41:01,442][123090] Updated weights for policy 1, policy_version 14196 (0.0010) [2023-12-25 23:41:01,457][123091] Updated weights for policy 0, policy_version 14360 (0.0006) [2023-12-25 23:41:01,504][123090] Updated weights for policy 1, policy_version 14206 (0.0010) [2023-12-25 23:41:02,262][123090] Updated weights for policy 1, policy_version 14216 (0.0010) [2023-12-25 23:41:02,326][123090] Updated weights for policy 1, policy_version 14226 (0.0010) [2023-12-25 23:41:02,332][123091] Updated weights for policy 0, policy_version 14370 (0.0009) [2023-12-25 23:41:02,393][123090] Updated weights for policy 1, policy_version 14236 (0.0011) [2023-12-25 23:41:02,401][123091] Updated weights for policy 0, policy_version 14380 (0.0009) [2023-12-25 23:41:02,458][123091] Updated weights for policy 0, policy_version 14390 (0.0009) [2023-12-25 23:41:02,523][123091] Updated weights for policy 0, policy_version 14400 (0.0009) [2023-12-25 23:41:03,193][123090] Updated weights for policy 1, policy_version 14246 (0.0010) [2023-12-25 23:41:03,245][123090] Updated weights for policy 1, policy_version 14256 (0.0010) [2023-12-25 23:41:03,292][123090] Updated weights for policy 1, policy_version 14266 (0.0010) [2023-12-25 23:41:03,401][123091] Updated weights for policy 0, policy_version 14410 (0.0010) [2023-12-25 23:41:03,466][123091] Updated weights for policy 0, policy_version 14420 (0.0010) [2023-12-25 23:41:03,531][123091] Updated weights for policy 0, policy_version 14430 (0.0009) [2023-12-25 23:41:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 7348224. Throughput: 0: 8977.4, 1: 8664.5. Samples: 7358472. Policy #0 lag: (min: 17.0, avg: 35.2, max: 49.0) [2023-12-25 23:41:03,784][121949] Avg episode reward: [(0, '1363.543'), (1, '3256.323')] [2023-12-25 23:41:03,785][123007] Saving new best policy, reward=1363.543! [2023-12-25 23:41:03,785][123008] Saving new best policy, reward=3256.323! [2023-12-25 23:41:04,088][123090] Updated weights for policy 1, policy_version 14276 (0.0011) [2023-12-25 23:41:04,160][123090] Updated weights for policy 1, policy_version 14286 (0.0011) [2023-12-25 23:41:04,232][123090] Updated weights for policy 1, policy_version 14296 (0.0011) [2023-12-25 23:41:04,349][123091] Updated weights for policy 0, policy_version 14440 (0.0007) [2023-12-25 23:41:04,406][123091] Updated weights for policy 0, policy_version 14450 (0.0006) [2023-12-25 23:41:04,477][123091] Updated weights for policy 0, policy_version 14460 (0.0006) [2023-12-25 23:41:05,012][123090] Updated weights for policy 1, policy_version 14306 (0.0010) [2023-12-25 23:41:05,081][123090] Updated weights for policy 1, policy_version 14316 (0.0010) [2023-12-25 23:41:05,151][123090] Updated weights for policy 1, policy_version 14326 (0.0007) [2023-12-25 23:41:05,224][123090] Updated weights for policy 1, policy_version 14336 (0.0006) [2023-12-25 23:41:05,254][123091] Updated weights for policy 0, policy_version 14470 (0.0006) [2023-12-25 23:41:05,329][123091] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-12-25 23:41:05,396][123091] Updated weights for policy 0, policy_version 14490 (0.0006) [2023-12-25 23:41:05,857][123090] Updated weights for policy 1, policy_version 14346 (0.0010) [2023-12-25 23:41:05,913][123090] Updated weights for policy 1, policy_version 14356 (0.0009) [2023-12-25 23:41:05,965][123090] Updated weights for policy 1, policy_version 14366 (0.0009) [2023-12-25 23:41:06,115][123091] Updated weights for policy 0, policy_version 14500 (0.0005) [2023-12-25 23:41:06,177][123091] Updated weights for policy 0, policy_version 14510 (0.0005) [2023-12-25 23:41:06,237][123091] Updated weights for policy 0, policy_version 14520 (0.0009) [2023-12-25 23:41:06,882][123090] Updated weights for policy 1, policy_version 14376 (0.0009) [2023-12-25 23:41:06,942][123090] Updated weights for policy 1, policy_version 14386 (0.0009) [2023-12-25 23:41:07,019][123090] Updated weights for policy 1, policy_version 14396 (0.0009) [2023-12-25 23:41:07,044][123091] Updated weights for policy 0, policy_version 14530 (0.0009) [2023-12-25 23:41:07,118][123091] Updated weights for policy 0, policy_version 14540 (0.0006) [2023-12-25 23:41:07,184][123091] Updated weights for policy 0, policy_version 14550 (0.0006) [2023-12-25 23:41:07,247][123091] Updated weights for policy 0, policy_version 14560 (0.0010) [2023-12-25 23:41:07,861][123090] Updated weights for policy 1, policy_version 14406 (0.0010) [2023-12-25 23:41:07,913][123090] Updated weights for policy 1, policy_version 14416 (0.0009) [2023-12-25 23:41:07,964][123090] Updated weights for policy 1, policy_version 14426 (0.0008) [2023-12-25 23:41:07,995][123091] Updated weights for policy 0, policy_version 14570 (0.0010) [2023-12-25 23:41:08,046][123091] Updated weights for policy 0, policy_version 14580 (0.0010) [2023-12-25 23:41:08,104][123091] Updated weights for policy 0, policy_version 14590 (0.0010) [2023-12-25 23:41:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 7430144. Throughput: 0: 9009.9, 1: 8704.5. Samples: 7412372. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-25 23:41:08,784][121949] Avg episode reward: [(0, '1511.014'), (1, '3259.107')] [2023-12-25 23:41:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000014432_3694592.pth... [2023-12-25 23:41:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000013408_3432448.pth [2023-12-25 23:41:08,794][123008] Saving new best policy, reward=3259.107! [2023-12-25 23:41:08,800][123091] Updated weights for policy 0, policy_version 14600 (0.0006) [2023-12-25 23:41:08,864][123091] Updated weights for policy 0, policy_version 14610 (0.0005) [2023-12-25 23:41:08,904][123090] Updated weights for policy 1, policy_version 14436 (0.0007) [2023-12-25 23:41:08,915][123091] Updated weights for policy 0, policy_version 14620 (0.0005) [2023-12-25 23:41:08,937][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000014624_3743744.pth... [2023-12-25 23:41:08,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000013536_3465216.pth [2023-12-25 23:41:08,941][123007] Saving new best policy, reward=1511.014! [2023-12-25 23:41:08,968][123090] Updated weights for policy 1, policy_version 14446 (0.0009) [2023-12-25 23:41:09,039][123090] Updated weights for policy 1, policy_version 14456 (0.0010) [2023-12-25 23:41:09,696][123091] Updated weights for policy 0, policy_version 14630 (0.0009) [2023-12-25 23:41:09,753][123091] Updated weights for policy 0, policy_version 14640 (0.0010) [2023-12-25 23:41:09,809][123091] Updated weights for policy 0, policy_version 14650 (0.0011) [2023-12-25 23:41:09,924][123090] Updated weights for policy 1, policy_version 14466 (0.0010) [2023-12-25 23:41:09,994][123090] Updated weights for policy 1, policy_version 14476 (0.0009) [2023-12-25 23:41:10,056][123090] Updated weights for policy 1, policy_version 14486 (0.0010) [2023-12-25 23:41:10,126][123090] Updated weights for policy 1, policy_version 14496 (0.0007) [2023-12-25 23:41:10,668][123091] Updated weights for policy 0, policy_version 14660 (0.0008) [2023-12-25 23:41:10,745][123091] Updated weights for policy 0, policy_version 14670 (0.0006) [2023-12-25 23:41:10,812][123091] Updated weights for policy 0, policy_version 14680 (0.0005) [2023-12-25 23:41:10,992][123090] Updated weights for policy 1, policy_version 14506 (0.0009) [2023-12-25 23:41:11,062][123090] Updated weights for policy 1, policy_version 14516 (0.0009) [2023-12-25 23:41:11,126][123090] Updated weights for policy 1, policy_version 14526 (0.0009) [2023-12-25 23:41:11,605][123091] Updated weights for policy 0, policy_version 14690 (0.0007) [2023-12-25 23:41:11,673][123091] Updated weights for policy 0, policy_version 14700 (0.0008) [2023-12-25 23:41:11,748][123091] Updated weights for policy 0, policy_version 14710 (0.0008) [2023-12-25 23:41:11,818][123091] Updated weights for policy 0, policy_version 14720 (0.0009) [2023-12-25 23:41:11,941][123090] Updated weights for policy 1, policy_version 14536 (0.0010) [2023-12-25 23:41:12,005][123090] Updated weights for policy 1, policy_version 14546 (0.0010) [2023-12-25 23:41:12,074][123090] Updated weights for policy 1, policy_version 14556 (0.0010) [2023-12-25 23:41:12,609][123091] Updated weights for policy 0, policy_version 14730 (0.0010) [2023-12-25 23:41:12,680][123091] Updated weights for policy 0, policy_version 14740 (0.0009) [2023-12-25 23:41:12,742][123091] Updated weights for policy 0, policy_version 14750 (0.0010) [2023-12-25 23:41:12,892][123090] Updated weights for policy 1, policy_version 14566 (0.0010) [2023-12-25 23:41:12,948][123090] Updated weights for policy 1, policy_version 14576 (0.0009) [2023-12-25 23:41:13,016][123090] Updated weights for policy 1, policy_version 14587 (0.0009) [2023-12-25 23:41:13,569][123091] Updated weights for policy 0, policy_version 14760 (0.0009) [2023-12-25 23:41:13,626][123091] Updated weights for policy 0, policy_version 14770 (0.0009) [2023-12-25 23:41:13,683][123091] Updated weights for policy 0, policy_version 14780 (0.0008) [2023-12-25 23:41:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 7520256. Throughput: 0: 9031.2, 1: 8681.5. Samples: 7514640. Policy #0 lag: (min: 31.0, avg: 39.3, max: 63.0) [2023-12-25 23:41:13,784][121949] Avg episode reward: [(0, '1794.784'), (1, '3347.879')] [2023-12-25 23:41:13,785][123007] Saving new best policy, reward=1794.784! [2023-12-25 23:41:13,785][123008] Saving new best policy, reward=3347.879! [2023-12-25 23:41:13,874][123090] Updated weights for policy 1, policy_version 14597 (0.0009) [2023-12-25 23:41:13,924][123090] Updated weights for policy 1, policy_version 14608 (0.0010) [2023-12-25 23:41:13,976][123090] Updated weights for policy 1, policy_version 14618 (0.0010) [2023-12-25 23:41:14,519][123091] Updated weights for policy 0, policy_version 14790 (0.0007) [2023-12-25 23:41:14,575][123091] Updated weights for policy 0, policy_version 14800 (0.0009) [2023-12-25 23:41:14,638][123091] Updated weights for policy 0, policy_version 14810 (0.0008) [2023-12-25 23:41:14,787][123090] Updated weights for policy 1, policy_version 14628 (0.0010) [2023-12-25 23:41:14,851][123090] Updated weights for policy 1, policy_version 14638 (0.0007) [2023-12-25 23:41:14,905][123090] Updated weights for policy 1, policy_version 14648 (0.0006) [2023-12-25 23:41:15,493][123091] Updated weights for policy 0, policy_version 14820 (0.0010) [2023-12-25 23:41:15,544][123091] Updated weights for policy 0, policy_version 14830 (0.0008) [2023-12-25 23:41:15,604][123091] Updated weights for policy 0, policy_version 14840 (0.0009) [2023-12-25 23:41:15,714][123090] Updated weights for policy 1, policy_version 14658 (0.0009) [2023-12-25 23:41:15,770][123090] Updated weights for policy 1, policy_version 14668 (0.0005) [2023-12-25 23:41:15,828][123090] Updated weights for policy 1, policy_version 14678 (0.0005) [2023-12-25 23:41:15,884][123090] Updated weights for policy 1, policy_version 14688 (0.0005) [2023-12-25 23:41:16,524][123090] Updated weights for policy 1, policy_version 14698 (0.0009) [2023-12-25 23:41:16,544][123091] Updated weights for policy 0, policy_version 14850 (0.0009) [2023-12-25 23:41:16,576][123090] Updated weights for policy 1, policy_version 14708 (0.0010) [2023-12-25 23:41:16,608][123091] Updated weights for policy 0, policy_version 14860 (0.0006) [2023-12-25 23:41:16,627][123090] Updated weights for policy 1, policy_version 14718 (0.0010) [2023-12-25 23:41:16,676][123091] Updated weights for policy 0, policy_version 14870 (0.0008) [2023-12-25 23:41:16,744][123091] Updated weights for policy 0, policy_version 14880 (0.0009) [2023-12-25 23:41:17,385][123090] Updated weights for policy 1, policy_version 14728 (0.0006) [2023-12-25 23:41:17,433][123090] Updated weights for policy 1, policy_version 14738 (0.0005) [2023-12-25 23:41:17,502][123090] Updated weights for policy 1, policy_version 14748 (0.0005) [2023-12-25 23:41:17,600][123091] Updated weights for policy 0, policy_version 14890 (0.0009) [2023-12-25 23:41:17,662][123091] Updated weights for policy 0, policy_version 14900 (0.0010) [2023-12-25 23:41:17,715][123091] Updated weights for policy 0, policy_version 14911 (0.0010) [2023-12-25 23:41:18,145][123090] Updated weights for policy 1, policy_version 14758 (0.0006) [2023-12-25 23:41:18,217][123090] Updated weights for policy 1, policy_version 14768 (0.0005) [2023-12-25 23:41:18,285][123090] Updated weights for policy 1, policy_version 14778 (0.0005) [2023-12-25 23:41:18,656][123091] Updated weights for policy 0, policy_version 14921 (0.0010) [2023-12-25 23:41:18,707][123091] Updated weights for policy 0, policy_version 14931 (0.0009) [2023-12-25 23:41:18,765][123091] Updated weights for policy 0, policy_version 14941 (0.0009) [2023-12-25 23:41:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 7610368. Throughput: 0: 8940.3, 1: 8832.4. Samples: 7620480. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-25 23:41:18,784][121949] Avg episode reward: [(0, '1769.676'), (1, '3497.076')] [2023-12-25 23:41:18,785][123008] Saving new best policy, reward=3497.076! [2023-12-25 23:41:18,886][123090] Updated weights for policy 1, policy_version 14788 (0.0005) [2023-12-25 23:41:18,959][123090] Updated weights for policy 1, policy_version 14798 (0.0007) [2023-12-25 23:41:19,032][123090] Updated weights for policy 1, policy_version 14808 (0.0005) [2023-12-25 23:41:19,669][123091] Updated weights for policy 0, policy_version 14951 (0.0009) [2023-12-25 23:41:19,722][123091] Updated weights for policy 0, policy_version 14961 (0.0009) [2023-12-25 23:41:19,727][123090] Updated weights for policy 1, policy_version 14818 (0.0006) [2023-12-25 23:41:19,776][123091] Updated weights for policy 0, policy_version 14971 (0.0009) [2023-12-25 23:41:19,793][123090] Updated weights for policy 1, policy_version 14828 (0.0009) [2023-12-25 23:41:19,865][123090] Updated weights for policy 1, policy_version 14838 (0.0007) [2023-12-25 23:41:19,940][123090] Updated weights for policy 1, policy_version 14848 (0.0009) [2023-12-25 23:41:20,586][123091] Updated weights for policy 0, policy_version 14981 (0.0008) [2023-12-25 23:41:20,655][123091] Updated weights for policy 0, policy_version 14991 (0.0009) [2023-12-25 23:41:20,722][123091] Updated weights for policy 0, policy_version 15001 (0.0010) [2023-12-25 23:41:20,744][123090] Updated weights for policy 1, policy_version 14858 (0.0011) [2023-12-25 23:41:20,819][123090] Updated weights for policy 1, policy_version 14868 (0.0011) [2023-12-25 23:41:20,894][123090] Updated weights for policy 1, policy_version 14878 (0.0010) [2023-12-25 23:41:21,533][123091] Updated weights for policy 0, policy_version 15011 (0.0008) [2023-12-25 23:41:21,587][123091] Updated weights for policy 0, policy_version 15021 (0.0009) [2023-12-25 23:41:21,660][123091] Updated weights for policy 0, policy_version 15031 (0.0009) [2023-12-25 23:41:21,759][123090] Updated weights for policy 1, policy_version 14888 (0.0010) [2023-12-25 23:41:21,830][123090] Updated weights for policy 1, policy_version 14898 (0.0010) [2023-12-25 23:41:21,898][123090] Updated weights for policy 1, policy_version 14908 (0.0011) [2023-12-25 23:41:22,524][123091] Updated weights for policy 0, policy_version 15041 (0.0009) [2023-12-25 23:41:22,595][123091] Updated weights for policy 0, policy_version 15051 (0.0010) [2023-12-25 23:41:22,670][123091] Updated weights for policy 0, policy_version 15061 (0.0009) [2023-12-25 23:41:22,725][123090] Updated weights for policy 1, policy_version 14918 (0.0010) [2023-12-25 23:41:22,732][123091] Updated weights for policy 0, policy_version 15071 (0.0007) [2023-12-25 23:41:22,788][123090] Updated weights for policy 1, policy_version 14928 (0.0010) [2023-12-25 23:41:22,857][123090] Updated weights for policy 1, policy_version 14938 (0.0009) [2023-12-25 23:41:23,455][123091] Updated weights for policy 0, policy_version 15081 (0.0006) [2023-12-25 23:41:23,514][123091] Updated weights for policy 0, policy_version 15091 (0.0005) [2023-12-25 23:41:23,564][123091] Updated weights for policy 0, policy_version 15101 (0.0005) [2023-12-25 23:41:23,613][123090] Updated weights for policy 1, policy_version 14948 (0.0009) [2023-12-25 23:41:23,671][123090] Updated weights for policy 1, policy_version 14958 (0.0009) [2023-12-25 23:41:23,724][123090] Updated weights for policy 1, policy_version 14968 (0.0010) [2023-12-25 23:41:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 7700480. Throughput: 0: 8880.8, 1: 8892.9. Samples: 7672540. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-25 23:41:23,785][121949] Avg episode reward: [(0, '1779.535'), (1, '3565.008')] [2023-12-25 23:41:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000015104_3866624.pth... [2023-12-25 23:41:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000014976_3833856.pth... [2023-12-25 23:41:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000014080_3604480.pth [2023-12-25 23:41:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000013920_3563520.pth [2023-12-25 23:41:23,795][123008] Saving new best policy, reward=3565.008! [2023-12-25 23:41:24,235][123091] Updated weights for policy 0, policy_version 15111 (0.0008) [2023-12-25 23:41:24,296][123091] Updated weights for policy 0, policy_version 15121 (0.0010) [2023-12-25 23:41:24,350][123091] Updated weights for policy 0, policy_version 15132 (0.0010) [2023-12-25 23:41:24,485][123090] Updated weights for policy 1, policy_version 14978 (0.0009) [2023-12-25 23:41:24,548][123090] Updated weights for policy 1, policy_version 14988 (0.0005) [2023-12-25 23:41:24,608][123090] Updated weights for policy 1, policy_version 14998 (0.0005) [2023-12-25 23:41:24,677][123090] Updated weights for policy 1, policy_version 15008 (0.0005) [2023-12-25 23:41:25,164][123091] Updated weights for policy 0, policy_version 15142 (0.0007) [2023-12-25 23:41:25,210][123091] Updated weights for policy 0, policy_version 15152 (0.0005) [2023-12-25 23:41:25,257][123091] Updated weights for policy 0, policy_version 15162 (0.0005) [2023-12-25 23:41:25,328][123090] Updated weights for policy 1, policy_version 15018 (0.0010) [2023-12-25 23:41:25,380][123090] Updated weights for policy 1, policy_version 15028 (0.0010) [2023-12-25 23:41:25,431][123090] Updated weights for policy 1, policy_version 15038 (0.0010) [2023-12-25 23:41:25,891][123091] Updated weights for policy 0, policy_version 15172 (0.0005) [2023-12-25 23:41:25,939][123091] Updated weights for policy 0, policy_version 15182 (0.0005) [2023-12-25 23:41:25,988][123091] Updated weights for policy 0, policy_version 15192 (0.0005) [2023-12-25 23:41:26,153][123090] Updated weights for policy 1, policy_version 15048 (0.0006) [2023-12-25 23:41:26,218][123090] Updated weights for policy 1, policy_version 15058 (0.0005) [2023-12-25 23:41:26,279][123090] Updated weights for policy 1, policy_version 15068 (0.0009) [2023-12-25 23:41:26,752][123091] Updated weights for policy 0, policy_version 15202 (0.0007) [2023-12-25 23:41:26,818][123091] Updated weights for policy 0, policy_version 15212 (0.0006) [2023-12-25 23:41:26,884][123091] Updated weights for policy 0, policy_version 15222 (0.0007) [2023-12-25 23:41:26,940][123091] Updated weights for policy 0, policy_version 15232 (0.0010) [2023-12-25 23:41:27,063][123090] Updated weights for policy 1, policy_version 15078 (0.0007) [2023-12-25 23:41:27,137][123090] Updated weights for policy 1, policy_version 15088 (0.0008) [2023-12-25 23:41:27,188][123090] Updated weights for policy 1, policy_version 15098 (0.0008) [2023-12-25 23:41:27,777][123090] Updated weights for policy 1, policy_version 15108 (0.0007) [2023-12-25 23:41:27,779][123091] Updated weights for policy 0, policy_version 15242 (0.0009) [2023-12-25 23:41:27,826][123091] Updated weights for policy 0, policy_version 15252 (0.0009) [2023-12-25 23:41:27,828][123090] Updated weights for policy 1, policy_version 15118 (0.0006) [2023-12-25 23:41:27,874][123091] Updated weights for policy 0, policy_version 15262 (0.0008) [2023-12-25 23:41:27,886][123090] Updated weights for policy 1, policy_version 15128 (0.0009) [2023-12-25 23:41:28,560][123090] Updated weights for policy 1, policy_version 15138 (0.0007) [2023-12-25 23:41:28,621][123090] Updated weights for policy 1, policy_version 15148 (0.0005) [2023-12-25 23:41:28,683][123090] Updated weights for policy 1, policy_version 15158 (0.0007) [2023-12-25 23:41:28,751][123090] Updated weights for policy 1, policy_version 15168 (0.0006) [2023-12-25 23:41:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 7790592. Throughput: 0: 8979.9, 1: 9017.9. Samples: 7783960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:41:28,785][121949] Avg episode reward: [(0, '2097.251'), (1, '3748.016')] [2023-12-25 23:41:28,786][123008] Saving new best policy, reward=3748.016! [2023-12-25 23:41:28,791][123091] Updated weights for policy 0, policy_version 15272 (0.0010) [2023-12-25 23:41:28,854][123091] Updated weights for policy 0, policy_version 15282 (0.0007) [2023-12-25 23:41:28,934][123091] Updated weights for policy 0, policy_version 15292 (0.0005) [2023-12-25 23:41:28,966][123007] Saving new best policy, reward=2097.251! [2023-12-25 23:41:29,522][123090] Updated weights for policy 1, policy_version 15178 (0.0010) [2023-12-25 23:41:29,543][123091] Updated weights for policy 0, policy_version 15302 (0.0006) [2023-12-25 23:41:29,587][123090] Updated weights for policy 1, policy_version 15188 (0.0008) [2023-12-25 23:41:29,597][123091] Updated weights for policy 0, policy_version 15312 (0.0007) [2023-12-25 23:41:29,646][123091] Updated weights for policy 0, policy_version 15322 (0.0008) [2023-12-25 23:41:29,653][123090] Updated weights for policy 1, policy_version 15198 (0.0008) [2023-12-25 23:41:30,470][123091] Updated weights for policy 0, policy_version 15332 (0.0008) [2023-12-25 23:41:30,503][123090] Updated weights for policy 1, policy_version 15208 (0.0008) [2023-12-25 23:41:30,534][123091] Updated weights for policy 0, policy_version 15342 (0.0005) [2023-12-25 23:41:30,560][123090] Updated weights for policy 1, policy_version 15218 (0.0008) [2023-12-25 23:41:30,606][123091] Updated weights for policy 0, policy_version 15352 (0.0008) [2023-12-25 23:41:30,624][123090] Updated weights for policy 1, policy_version 15228 (0.0008) [2023-12-25 23:41:31,377][123090] Updated weights for policy 1, policy_version 15238 (0.0008) [2023-12-25 23:41:31,427][123091] Updated weights for policy 0, policy_version 15362 (0.0008) [2023-12-25 23:41:31,441][123090] Updated weights for policy 1, policy_version 15248 (0.0010) [2023-12-25 23:41:31,491][123091] Updated weights for policy 0, policy_version 15372 (0.0007) [2023-12-25 23:41:31,507][123090] Updated weights for policy 1, policy_version 15258 (0.0009) [2023-12-25 23:41:31,559][123091] Updated weights for policy 0, policy_version 15382 (0.0009) [2023-12-25 23:41:31,618][123091] Updated weights for policy 0, policy_version 15392 (0.0010) [2023-12-25 23:41:32,392][123090] Updated weights for policy 1, policy_version 15268 (0.0007) [2023-12-25 23:41:32,408][123091] Updated weights for policy 0, policy_version 15402 (0.0009) [2023-12-25 23:41:32,454][123090] Updated weights for policy 1, policy_version 15278 (0.0008) [2023-12-25 23:41:32,474][123091] Updated weights for policy 0, policy_version 15412 (0.0008) [2023-12-25 23:41:32,499][123090] Updated weights for policy 1, policy_version 15288 (0.0007) [2023-12-25 23:41:32,541][123091] Updated weights for policy 0, policy_version 15422 (0.0009) [2023-12-25 23:41:33,346][123090] Updated weights for policy 1, policy_version 15298 (0.0008) [2023-12-25 23:41:33,356][123091] Updated weights for policy 0, policy_version 15432 (0.0010) [2023-12-25 23:41:33,407][123091] Updated weights for policy 0, policy_version 15442 (0.0006) [2023-12-25 23:41:33,408][123090] Updated weights for policy 1, policy_version 15308 (0.0009) [2023-12-25 23:41:33,465][123091] Updated weights for policy 0, policy_version 15452 (0.0006) [2023-12-25 23:41:33,467][123090] Updated weights for policy 1, policy_version 15318 (0.0009) [2023-12-25 23:41:33,520][123090] Updated weights for policy 1, policy_version 15328 (0.0009) [2023-12-25 23:41:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 7880704. Throughput: 0: 8849.0, 1: 8974.6. Samples: 7889164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:41:33,785][121949] Avg episode reward: [(0, '1947.690'), (1, '3611.017')] [2023-12-25 23:41:34,146][123091] Updated weights for policy 0, policy_version 15462 (0.0007) [2023-12-25 23:41:34,223][123091] Updated weights for policy 0, policy_version 15472 (0.0007) [2023-12-25 23:41:34,285][123091] Updated weights for policy 0, policy_version 15482 (0.0009) [2023-12-25 23:41:34,402][123090] Updated weights for policy 1, policy_version 15338 (0.0009) [2023-12-25 23:41:34,475][123090] Updated weights for policy 1, policy_version 15348 (0.0005) [2023-12-25 23:41:34,539][123090] Updated weights for policy 1, policy_version 15358 (0.0005) [2023-12-25 23:41:35,117][123091] Updated weights for policy 0, policy_version 15492 (0.0009) [2023-12-25 23:41:35,177][123091] Updated weights for policy 0, policy_version 15503 (0.0009) [2023-12-25 23:41:35,231][123090] Updated weights for policy 1, policy_version 15368 (0.0006) [2023-12-25 23:41:35,232][123091] Updated weights for policy 0, policy_version 15513 (0.0008) [2023-12-25 23:41:35,287][123090] Updated weights for policy 1, policy_version 15378 (0.0010) [2023-12-25 23:41:35,339][123090] Updated weights for policy 1, policy_version 15388 (0.0010) [2023-12-25 23:41:36,073][123091] Updated weights for policy 0, policy_version 15523 (0.0008) [2023-12-25 23:41:36,137][123091] Updated weights for policy 0, policy_version 15533 (0.0009) [2023-12-25 23:41:36,159][123090] Updated weights for policy 1, policy_version 15398 (0.0010) [2023-12-25 23:41:36,201][123091] Updated weights for policy 0, policy_version 15543 (0.0006) [2023-12-25 23:41:36,223][123090] Updated weights for policy 1, policy_version 15408 (0.0011) [2023-12-25 23:41:36,285][123090] Updated weights for policy 1, policy_version 15418 (0.0008) [2023-12-25 23:41:36,939][123090] Updated weights for policy 1, policy_version 15428 (0.0005) [2023-12-25 23:41:36,988][123090] Updated weights for policy 1, policy_version 15438 (0.0005) [2023-12-25 23:41:37,035][123090] Updated weights for policy 1, policy_version 15448 (0.0005) [2023-12-25 23:41:37,127][123091] Updated weights for policy 0, policy_version 15553 (0.0010) [2023-12-25 23:41:37,181][123091] Updated weights for policy 0, policy_version 15563 (0.0010) [2023-12-25 23:41:37,235][123091] Updated weights for policy 0, policy_version 15574 (0.0010) [2023-12-25 23:41:37,296][123091] Updated weights for policy 0, policy_version 15584 (0.0010) [2023-12-25 23:41:37,772][123090] Updated weights for policy 1, policy_version 15458 (0.0006) [2023-12-25 23:41:37,834][123090] Updated weights for policy 1, policy_version 15468 (0.0010) [2023-12-25 23:41:37,894][123090] Updated weights for policy 1, policy_version 15478 (0.0011) [2023-12-25 23:41:37,938][123090] Updated weights for policy 1, policy_version 15488 (0.0010) [2023-12-25 23:41:38,202][123091] Updated weights for policy 0, policy_version 15595 (0.0010) [2023-12-25 23:41:38,262][123091] Updated weights for policy 0, policy_version 15605 (0.0010) [2023-12-25 23:41:38,315][123091] Updated weights for policy 0, policy_version 15615 (0.0011) [2023-12-25 23:41:38,780][123090] Updated weights for policy 1, policy_version 15498 (0.0009) [2023-12-25 23:41:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 7962624. Throughput: 0: 8827.1, 1: 8972.3. Samples: 7942548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:41:38,785][121949] Avg episode reward: [(0, '1929.346'), (1, '3453.527')] [2023-12-25 23:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000015616_3997696.pth... [2023-12-25 23:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000014624_3743744.pth [2023-12-25 23:41:38,843][123090] Updated weights for policy 1, policy_version 15508 (0.0010) [2023-12-25 23:41:38,902][123090] Updated weights for policy 1, policy_version 15518 (0.0009) [2023-12-25 23:41:38,910][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000015520_3973120.pth... [2023-12-25 23:41:38,915][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000014432_3694592.pth [2023-12-25 23:41:39,227][123091] Updated weights for policy 0, policy_version 15625 (0.0009) [2023-12-25 23:41:39,302][123091] Updated weights for policy 0, policy_version 15635 (0.0010) [2023-12-25 23:41:39,367][123091] Updated weights for policy 0, policy_version 15645 (0.0009) [2023-12-25 23:41:39,704][123090] Updated weights for policy 1, policy_version 15528 (0.0010) [2023-12-25 23:41:39,767][123090] Updated weights for policy 1, policy_version 15538 (0.0009) [2023-12-25 23:41:39,833][123090] Updated weights for policy 1, policy_version 15548 (0.0009) [2023-12-25 23:41:40,196][123091] Updated weights for policy 0, policy_version 15655 (0.0008) [2023-12-25 23:41:40,252][123091] Updated weights for policy 0, policy_version 15665 (0.0009) [2023-12-25 23:41:40,303][123091] Updated weights for policy 0, policy_version 15675 (0.0007) [2023-12-25 23:41:40,734][123090] Updated weights for policy 1, policy_version 15558 (0.0009) [2023-12-25 23:41:40,799][123090] Updated weights for policy 1, policy_version 15568 (0.0009) [2023-12-25 23:41:40,864][123090] Updated weights for policy 1, policy_version 15578 (0.0009) [2023-12-25 23:41:41,100][123091] Updated weights for policy 0, policy_version 15685 (0.0009) [2023-12-25 23:41:41,171][123091] Updated weights for policy 0, policy_version 15695 (0.0009) [2023-12-25 23:41:41,243][123091] Updated weights for policy 0, policy_version 15705 (0.0009) [2023-12-25 23:41:41,680][123090] Updated weights for policy 1, policy_version 15588 (0.0010) [2023-12-25 23:41:41,761][123090] Updated weights for policy 1, policy_version 15598 (0.0010) [2023-12-25 23:41:41,829][123090] Updated weights for policy 1, policy_version 15608 (0.0010) [2023-12-25 23:41:42,108][123091] Updated weights for policy 0, policy_version 15715 (0.0007) [2023-12-25 23:41:42,168][123091] Updated weights for policy 0, policy_version 15725 (0.0010) [2023-12-25 23:41:42,222][123091] Updated weights for policy 0, policy_version 15735 (0.0009) [2023-12-25 23:41:42,672][123090] Updated weights for policy 1, policy_version 15618 (0.0010) [2023-12-25 23:41:42,736][123090] Updated weights for policy 1, policy_version 15628 (0.0009) [2023-12-25 23:41:42,793][123090] Updated weights for policy 1, policy_version 15638 (0.0009) [2023-12-25 23:41:42,853][123090] Updated weights for policy 1, policy_version 15648 (0.0009) [2023-12-25 23:41:43,075][123091] Updated weights for policy 0, policy_version 15745 (0.0010) [2023-12-25 23:41:43,131][123091] Updated weights for policy 0, policy_version 15755 (0.0009) [2023-12-25 23:41:43,189][123091] Updated weights for policy 0, policy_version 15765 (0.0010) [2023-12-25 23:41:43,258][123091] Updated weights for policy 0, policy_version 15775 (0.0010) [2023-12-25 23:41:43,614][123090] Updated weights for policy 1, policy_version 15658 (0.0005) [2023-12-25 23:41:43,674][123090] Updated weights for policy 1, policy_version 15668 (0.0005) [2023-12-25 23:41:43,726][123090] Updated weights for policy 1, policy_version 15678 (0.0009) [2023-12-25 23:41:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 8052736. Throughput: 0: 8624.2, 1: 8912.3. Samples: 8043908. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-25 23:41:43,785][121949] Avg episode reward: [(0, '2010.499'), (1, '3469.867')] [2023-12-25 23:41:44,124][123091] Updated weights for policy 0, policy_version 15785 (0.0008) [2023-12-25 23:41:44,179][123091] Updated weights for policy 0, policy_version 15795 (0.0006) [2023-12-25 23:41:44,247][123091] Updated weights for policy 0, policy_version 15805 (0.0010) [2023-12-25 23:41:44,414][123090] Updated weights for policy 1, policy_version 15688 (0.0009) [2023-12-25 23:41:44,467][123090] Updated weights for policy 1, policy_version 15698 (0.0009) [2023-12-25 23:41:44,516][123090] Updated weights for policy 1, policy_version 15708 (0.0009) [2023-12-25 23:41:44,972][123091] Updated weights for policy 0, policy_version 15815 (0.0010) [2023-12-25 23:41:45,031][123091] Updated weights for policy 0, policy_version 15825 (0.0010) [2023-12-25 23:41:45,102][123091] Updated weights for policy 0, policy_version 15835 (0.0010) [2023-12-25 23:41:45,358][123090] Updated weights for policy 1, policy_version 15718 (0.0009) [2023-12-25 23:41:45,430][123090] Updated weights for policy 1, policy_version 15728 (0.0010) [2023-12-25 23:41:45,491][123090] Updated weights for policy 1, policy_version 15738 (0.0009) [2023-12-25 23:41:45,900][123091] Updated weights for policy 0, policy_version 15845 (0.0007) [2023-12-25 23:41:45,951][123091] Updated weights for policy 0, policy_version 15855 (0.0009) [2023-12-25 23:41:46,005][123091] Updated weights for policy 0, policy_version 15865 (0.0008) [2023-12-25 23:41:46,351][123090] Updated weights for policy 1, policy_version 15748 (0.0010) [2023-12-25 23:41:46,412][123090] Updated weights for policy 1, policy_version 15758 (0.0009) [2023-12-25 23:41:46,478][123090] Updated weights for policy 1, policy_version 15768 (0.0010) [2023-12-25 23:41:46,726][123091] Updated weights for policy 0, policy_version 15875 (0.0007) [2023-12-25 23:41:46,779][123091] Updated weights for policy 0, policy_version 15885 (0.0005) [2023-12-25 23:41:46,826][123091] Updated weights for policy 0, policy_version 15895 (0.0005) [2023-12-25 23:41:47,381][123090] Updated weights for policy 1, policy_version 15778 (0.0010) [2023-12-25 23:41:47,437][123090] Updated weights for policy 1, policy_version 15788 (0.0009) [2023-12-25 23:41:47,494][123090] Updated weights for policy 1, policy_version 15798 (0.0009) [2023-12-25 23:41:47,540][123091] Updated weights for policy 0, policy_version 15905 (0.0006) [2023-12-25 23:41:47,555][123090] Updated weights for policy 1, policy_version 15808 (0.0008) [2023-12-25 23:41:47,588][123091] Updated weights for policy 0, policy_version 15915 (0.0010) [2023-12-25 23:41:47,639][123091] Updated weights for policy 0, policy_version 15925 (0.0010) [2023-12-25 23:41:47,687][123091] Updated weights for policy 0, policy_version 15935 (0.0010) [2023-12-25 23:41:48,314][123090] Updated weights for policy 1, policy_version 15818 (0.0005) [2023-12-25 23:41:48,384][123090] Updated weights for policy 1, policy_version 15828 (0.0007) [2023-12-25 23:41:48,453][123090] Updated weights for policy 1, policy_version 15838 (0.0006) [2023-12-25 23:41:48,519][123091] Updated weights for policy 0, policy_version 15945 (0.0010) [2023-12-25 23:41:48,581][123091] Updated weights for policy 0, policy_version 15955 (0.0009) [2023-12-25 23:41:48,639][123091] Updated weights for policy 0, policy_version 15965 (0.0010) [2023-12-25 23:41:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 8142848. Throughput: 0: 8701.6, 1: 8890.6. Samples: 8150120. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-25 23:41:48,785][121949] Avg episode reward: [(0, '2094.973'), (1, '3716.297')] [2023-12-25 23:41:49,258][123090] Updated weights for policy 1, policy_version 15848 (0.0008) [2023-12-25 23:41:49,333][123090] Updated weights for policy 1, policy_version 15858 (0.0009) [2023-12-25 23:41:49,410][123090] Updated weights for policy 1, policy_version 15868 (0.0008) [2023-12-25 23:41:49,439][123091] Updated weights for policy 0, policy_version 15975 (0.0007) [2023-12-25 23:41:49,491][123091] Updated weights for policy 0, policy_version 15985 (0.0005) [2023-12-25 23:41:49,537][123091] Updated weights for policy 0, policy_version 15995 (0.0005) [2023-12-25 23:41:50,214][123090] Updated weights for policy 1, policy_version 15878 (0.0010) [2023-12-25 23:41:50,270][123090] Updated weights for policy 1, policy_version 15888 (0.0010) [2023-12-25 23:41:50,309][123091] Updated weights for policy 0, policy_version 16005 (0.0008) [2023-12-25 23:41:50,330][123090] Updated weights for policy 1, policy_version 15898 (0.0010) [2023-12-25 23:41:50,367][123091] Updated weights for policy 0, policy_version 16015 (0.0010) [2023-12-25 23:41:50,419][123091] Updated weights for policy 0, policy_version 16025 (0.0010) [2023-12-25 23:41:51,055][123090] Updated weights for policy 1, policy_version 15908 (0.0009) [2023-12-25 23:41:51,127][123090] Updated weights for policy 1, policy_version 15918 (0.0008) [2023-12-25 23:41:51,199][123090] Updated weights for policy 1, policy_version 15928 (0.0011) [2023-12-25 23:41:51,295][123091] Updated weights for policy 0, policy_version 16035 (0.0011) [2023-12-25 23:41:51,363][123091] Updated weights for policy 0, policy_version 16045 (0.0011) [2023-12-25 23:41:51,432][123091] Updated weights for policy 0, policy_version 16055 (0.0011) [2023-12-25 23:41:52,039][123090] Updated weights for policy 1, policy_version 15938 (0.0011) [2023-12-25 23:41:52,115][123090] Updated weights for policy 1, policy_version 15948 (0.0011) [2023-12-25 23:41:52,134][123091] Updated weights for policy 0, policy_version 16065 (0.0008) [2023-12-25 23:41:52,183][123090] Updated weights for policy 1, policy_version 15958 (0.0011) [2023-12-25 23:41:52,197][123091] Updated weights for policy 0, policy_version 16075 (0.0009) [2023-12-25 23:41:52,251][123090] Updated weights for policy 1, policy_version 15968 (0.0011) [2023-12-25 23:41:52,273][123091] Updated weights for policy 0, policy_version 16086 (0.0009) [2023-12-25 23:41:52,338][123091] Updated weights for policy 0, policy_version 16096 (0.0010) [2023-12-25 23:41:53,072][123090] Updated weights for policy 1, policy_version 15978 (0.0009) [2023-12-25 23:41:53,075][123091] Updated weights for policy 0, policy_version 16106 (0.0005) [2023-12-25 23:41:53,133][123091] Updated weights for policy 0, policy_version 16116 (0.0006) [2023-12-25 23:41:53,135][123090] Updated weights for policy 1, policy_version 15988 (0.0008) [2023-12-25 23:41:53,200][123090] Updated weights for policy 1, policy_version 15998 (0.0010) [2023-12-25 23:41:53,200][123091] Updated weights for policy 0, policy_version 16126 (0.0006) [2023-12-25 23:41:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 8224768. Throughput: 0: 8683.6, 1: 8881.0. Samples: 8202784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:41:53,785][121949] Avg episode reward: [(0, '2059.031'), (1, '3917.031')] [2023-12-25 23:41:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000016128_4128768.pth... [2023-12-25 23:41:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000016000_4096000.pth... [2023-12-25 23:41:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000015104_3866624.pth [2023-12-25 23:41:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000014976_3833856.pth [2023-12-25 23:41:53,800][123008] Saving new best policy, reward=3917.031! [2023-12-25 23:41:53,874][123091] Updated weights for policy 0, policy_version 16136 (0.0005) [2023-12-25 23:41:53,925][123091] Updated weights for policy 0, policy_version 16146 (0.0006) [2023-12-25 23:41:53,986][123091] Updated weights for policy 0, policy_version 16156 (0.0008) [2023-12-25 23:41:54,100][123090] Updated weights for policy 1, policy_version 16008 (0.0007) [2023-12-25 23:41:54,159][123090] Updated weights for policy 1, policy_version 16018 (0.0005) [2023-12-25 23:41:54,214][123090] Updated weights for policy 1, policy_version 16028 (0.0005) [2023-12-25 23:41:54,796][123091] Updated weights for policy 0, policy_version 16166 (0.0009) [2023-12-25 23:41:54,848][123091] Updated weights for policy 0, policy_version 16176 (0.0010) [2023-12-25 23:41:54,896][123091] Updated weights for policy 0, policy_version 16186 (0.0010) [2023-12-25 23:41:54,905][123090] Updated weights for policy 1, policy_version 16038 (0.0007) [2023-12-25 23:41:54,958][123090] Updated weights for policy 1, policy_version 16048 (0.0005) [2023-12-25 23:41:55,015][123090] Updated weights for policy 1, policy_version 16058 (0.0006) [2023-12-25 23:41:55,721][123090] Updated weights for policy 1, policy_version 16068 (0.0008) [2023-12-25 23:41:55,742][123091] Updated weights for policy 0, policy_version 16196 (0.0010) [2023-12-25 23:41:55,772][123090] Updated weights for policy 1, policy_version 16078 (0.0005) [2023-12-25 23:41:55,789][123091] Updated weights for policy 0, policy_version 16206 (0.0010) [2023-12-25 23:41:55,822][123090] Updated weights for policy 1, policy_version 16088 (0.0005) [2023-12-25 23:41:55,836][123091] Updated weights for policy 0, policy_version 16216 (0.0010) [2023-12-25 23:41:56,477][123090] Updated weights for policy 1, policy_version 16098 (0.0005) [2023-12-25 23:41:56,534][123090] Updated weights for policy 1, policy_version 16108 (0.0005) [2023-12-25 23:41:56,595][123090] Updated weights for policy 1, policy_version 16118 (0.0005) [2023-12-25 23:41:56,647][123090] Updated weights for policy 1, policy_version 16128 (0.0005) [2023-12-25 23:41:56,693][123091] Updated weights for policy 0, policy_version 16226 (0.0010) [2023-12-25 23:41:56,744][123091] Updated weights for policy 0, policy_version 16236 (0.0010) [2023-12-25 23:41:56,799][123091] Updated weights for policy 0, policy_version 16246 (0.0010) [2023-12-25 23:41:56,865][123091] Updated weights for policy 0, policy_version 16256 (0.0010) [2023-12-25 23:41:57,291][123090] Updated weights for policy 1, policy_version 16138 (0.0006) [2023-12-25 23:41:57,367][123090] Updated weights for policy 1, policy_version 16148 (0.0006) [2023-12-25 23:41:57,428][123090] Updated weights for policy 1, policy_version 16158 (0.0008) [2023-12-25 23:41:57,781][123091] Updated weights for policy 0, policy_version 16266 (0.0009) [2023-12-25 23:41:57,840][123091] Updated weights for policy 0, policy_version 16276 (0.0009) [2023-12-25 23:41:57,905][123091] Updated weights for policy 0, policy_version 16286 (0.0009) [2023-12-25 23:41:58,124][123090] Updated weights for policy 1, policy_version 16168 (0.0009) [2023-12-25 23:41:58,191][123090] Updated weights for policy 1, policy_version 16178 (0.0010) [2023-12-25 23:41:58,257][123090] Updated weights for policy 1, policy_version 16188 (0.0010) [2023-12-25 23:41:58,693][123091] Updated weights for policy 0, policy_version 16296 (0.0008) [2023-12-25 23:41:58,766][123091] Updated weights for policy 0, policy_version 16306 (0.0009) [2023-12-25 23:41:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 8314880. Throughput: 0: 8693.2, 1: 9049.9. Samples: 8313080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:41:58,785][121949] Avg episode reward: [(0, '2332.204'), (1, '3917.750')] [2023-12-25 23:41:58,785][123008] Saving new best policy, reward=3917.750! [2023-12-25 23:41:58,830][123091] Updated weights for policy 0, policy_version 16316 (0.0008) [2023-12-25 23:41:58,848][123007] Saving new best policy, reward=2332.204! [2023-12-25 23:41:59,198][123090] Updated weights for policy 1, policy_version 16198 (0.0009) [2023-12-25 23:41:59,265][123090] Updated weights for policy 1, policy_version 16208 (0.0006) [2023-12-25 23:41:59,325][123090] Updated weights for policy 1, policy_version 16218 (0.0007) [2023-12-25 23:41:59,685][123091] Updated weights for policy 0, policy_version 16326 (0.0009) [2023-12-25 23:41:59,741][123091] Updated weights for policy 0, policy_version 16336 (0.0010) [2023-12-25 23:41:59,798][123091] Updated weights for policy 0, policy_version 16346 (0.0010) [2023-12-25 23:42:00,030][123090] Updated weights for policy 1, policy_version 16228 (0.0007) [2023-12-25 23:42:00,090][123090] Updated weights for policy 1, policy_version 16238 (0.0006) [2023-12-25 23:42:00,160][123090] Updated weights for policy 1, policy_version 16248 (0.0007) [2023-12-25 23:42:00,660][123091] Updated weights for policy 0, policy_version 16356 (0.0010) [2023-12-25 23:42:00,718][123091] Updated weights for policy 0, policy_version 16366 (0.0010) [2023-12-25 23:42:00,777][123091] Updated weights for policy 0, policy_version 16376 (0.0009) [2023-12-25 23:42:00,937][123090] Updated weights for policy 1, policy_version 16258 (0.0010) [2023-12-25 23:42:00,984][123090] Updated weights for policy 1, policy_version 16268 (0.0010) [2023-12-25 23:42:01,046][123090] Updated weights for policy 1, policy_version 16278 (0.0010) [2023-12-25 23:42:01,107][123090] Updated weights for policy 1, policy_version 16288 (0.0010) [2023-12-25 23:42:01,515][123091] Updated weights for policy 0, policy_version 16386 (0.0005) [2023-12-25 23:42:01,580][123091] Updated weights for policy 0, policy_version 16396 (0.0005) [2023-12-25 23:42:01,651][123091] Updated weights for policy 0, policy_version 16406 (0.0008) [2023-12-25 23:42:01,712][123091] Updated weights for policy 0, policy_version 16416 (0.0009) [2023-12-25 23:42:01,991][123090] Updated weights for policy 1, policy_version 16298 (0.0009) [2023-12-25 23:42:02,053][123090] Updated weights for policy 1, policy_version 16308 (0.0008) [2023-12-25 23:42:02,118][123090] Updated weights for policy 1, policy_version 16318 (0.0008) [2023-12-25 23:42:02,314][123091] Updated weights for policy 0, policy_version 16426 (0.0010) [2023-12-25 23:42:02,380][123091] Updated weights for policy 0, policy_version 16436 (0.0008) [2023-12-25 23:42:02,448][123091] Updated weights for policy 0, policy_version 16446 (0.0005) [2023-12-25 23:42:02,796][123090] Updated weights for policy 1, policy_version 16328 (0.0005) [2023-12-25 23:42:02,845][123090] Updated weights for policy 1, policy_version 16338 (0.0005) [2023-12-25 23:42:02,913][123090] Updated weights for policy 1, policy_version 16348 (0.0005) [2023-12-25 23:42:03,129][123091] Updated weights for policy 0, policy_version 16456 (0.0006) [2023-12-25 23:42:03,180][123091] Updated weights for policy 0, policy_version 16466 (0.0005) [2023-12-25 23:42:03,242][123091] Updated weights for policy 0, policy_version 16477 (0.0007) [2023-12-25 23:42:03,574][123090] Updated weights for policy 1, policy_version 16358 (0.0008) [2023-12-25 23:42:03,626][123090] Updated weights for policy 1, policy_version 16368 (0.0010) [2023-12-25 23:42:03,697][123090] Updated weights for policy 1, policy_version 16378 (0.0011) [2023-12-25 23:42:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 8413184. Throughput: 0: 8816.1, 1: 8979.5. Samples: 8421284. Policy #0 lag: (min: 6.0, avg: 6.4, max: 18.0) [2023-12-25 23:42:03,785][121949] Avg episode reward: [(0, '2568.110'), (1, '3688.749')] [2023-12-25 23:42:03,786][123007] Saving new best policy, reward=2568.110! [2023-12-25 23:42:04,090][123091] Updated weights for policy 0, policy_version 16487 (0.0009) [2023-12-25 23:42:04,151][123091] Updated weights for policy 0, policy_version 16497 (0.0009) [2023-12-25 23:42:04,218][123091] Updated weights for policy 0, policy_version 16507 (0.0009) [2023-12-25 23:42:04,527][123090] Updated weights for policy 1, policy_version 16388 (0.0011) [2023-12-25 23:42:04,595][123090] Updated weights for policy 1, policy_version 16398 (0.0011) [2023-12-25 23:42:04,658][123090] Updated weights for policy 1, policy_version 16408 (0.0010) [2023-12-25 23:42:05,098][123091] Updated weights for policy 0, policy_version 16517 (0.0009) [2023-12-25 23:42:05,150][123091] Updated weights for policy 0, policy_version 16528 (0.0010) [2023-12-25 23:42:05,208][123091] Updated weights for policy 0, policy_version 16538 (0.0009) [2023-12-25 23:42:05,427][123090] Updated weights for policy 1, policy_version 16418 (0.0009) [2023-12-25 23:42:05,481][123090] Updated weights for policy 1, policy_version 16428 (0.0005) [2023-12-25 23:42:05,534][123090] Updated weights for policy 1, policy_version 16438 (0.0005) [2023-12-25 23:42:05,580][123090] Updated weights for policy 1, policy_version 16448 (0.0005) [2023-12-25 23:42:06,108][123091] Updated weights for policy 0, policy_version 16548 (0.0009) [2023-12-25 23:42:06,180][123091] Updated weights for policy 0, policy_version 16558 (0.0008) [2023-12-25 23:42:06,238][123091] Updated weights for policy 0, policy_version 16568 (0.0008) [2023-12-25 23:42:06,266][123090] Updated weights for policy 1, policy_version 16458 (0.0010) [2023-12-25 23:42:06,331][123090] Updated weights for policy 1, policy_version 16468 (0.0011) [2023-12-25 23:42:06,390][123090] Updated weights for policy 1, policy_version 16478 (0.0010) [2023-12-25 23:42:07,057][123091] Updated weights for policy 0, policy_version 16578 (0.0007) [2023-12-25 23:42:07,121][123091] Updated weights for policy 0, policy_version 16588 (0.0009) [2023-12-25 23:42:07,177][123091] Updated weights for policy 0, policy_version 16598 (0.0009) [2023-12-25 23:42:07,232][123090] Updated weights for policy 1, policy_version 16488 (0.0007) [2023-12-25 23:42:07,242][123091] Updated weights for policy 0, policy_version 16608 (0.0009) [2023-12-25 23:42:07,301][123090] Updated weights for policy 1, policy_version 16498 (0.0005) [2023-12-25 23:42:07,356][123090] Updated weights for policy 1, policy_version 16508 (0.0008) [2023-12-25 23:42:08,069][123091] Updated weights for policy 0, policy_version 16618 (0.0009) [2023-12-25 23:42:08,128][123091] Updated weights for policy 0, policy_version 16628 (0.0008) [2023-12-25 23:42:08,150][123090] Updated weights for policy 1, policy_version 16518 (0.0010) [2023-12-25 23:42:08,176][123091] Updated weights for policy 0, policy_version 16638 (0.0010) [2023-12-25 23:42:08,198][123090] Updated weights for policy 1, policy_version 16528 (0.0010) [2023-12-25 23:42:08,261][123090] Updated weights for policy 1, policy_version 16538 (0.0010) [2023-12-25 23:42:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 8495104. Throughput: 0: 8795.7, 1: 8983.5. Samples: 8472604. Policy #0 lag: (min: 6.0, avg: 6.4, max: 18.0) [2023-12-25 23:42:08,785][121949] Avg episode reward: [(0, '2255.286'), (1, '3731.802')] [2023-12-25 23:42:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000016640_4259840.pth... [2023-12-25 23:42:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000016544_4235264.pth... [2023-12-25 23:42:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000015616_3997696.pth [2023-12-25 23:42:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000015520_3973120.pth [2023-12-25 23:42:09,017][123091] Updated weights for policy 0, policy_version 16648 (0.0010) [2023-12-25 23:42:09,037][123090] Updated weights for policy 1, policy_version 16548 (0.0009) [2023-12-25 23:42:09,075][123091] Updated weights for policy 0, policy_version 16658 (0.0008) [2023-12-25 23:42:09,103][123090] Updated weights for policy 1, policy_version 16558 (0.0009) [2023-12-25 23:42:09,139][123091] Updated weights for policy 0, policy_version 16668 (0.0009) [2023-12-25 23:42:09,163][123090] Updated weights for policy 1, policy_version 16568 (0.0009) [2023-12-25 23:42:10,021][123090] Updated weights for policy 1, policy_version 16578 (0.0009) [2023-12-25 23:42:10,035][123091] Updated weights for policy 0, policy_version 16678 (0.0008) [2023-12-25 23:42:10,086][123090] Updated weights for policy 1, policy_version 16588 (0.0010) [2023-12-25 23:42:10,095][123091] Updated weights for policy 0, policy_version 16688 (0.0007) [2023-12-25 23:42:10,149][123090] Updated weights for policy 1, policy_version 16598 (0.0009) [2023-12-25 23:42:10,158][123091] Updated weights for policy 0, policy_version 16698 (0.0009) [2023-12-25 23:42:10,206][123090] Updated weights for policy 1, policy_version 16608 (0.0009) [2023-12-25 23:42:10,972][123090] Updated weights for policy 1, policy_version 16618 (0.0005) [2023-12-25 23:42:10,989][123091] Updated weights for policy 0, policy_version 16708 (0.0010) [2023-12-25 23:42:11,038][123090] Updated weights for policy 1, policy_version 16628 (0.0006) [2023-12-25 23:42:11,054][123091] Updated weights for policy 0, policy_version 16718 (0.0009) [2023-12-25 23:42:11,107][123090] Updated weights for policy 1, policy_version 16638 (0.0009) [2023-12-25 23:42:11,123][123091] Updated weights for policy 0, policy_version 16728 (0.0008) [2023-12-25 23:42:11,849][123090] Updated weights for policy 1, policy_version 16648 (0.0009) [2023-12-25 23:42:11,921][123090] Updated weights for policy 1, policy_version 16658 (0.0007) [2023-12-25 23:42:11,990][123090] Updated weights for policy 1, policy_version 16668 (0.0010) [2023-12-25 23:42:12,050][123091] Updated weights for policy 0, policy_version 16738 (0.0010) [2023-12-25 23:42:12,102][123091] Updated weights for policy 0, policy_version 16748 (0.0009) [2023-12-25 23:42:12,157][123091] Updated weights for policy 0, policy_version 16758 (0.0010) [2023-12-25 23:42:12,219][123091] Updated weights for policy 0, policy_version 16768 (0.0009) [2023-12-25 23:42:12,751][123090] Updated weights for policy 1, policy_version 16678 (0.0007) [2023-12-25 23:42:12,816][123090] Updated weights for policy 1, policy_version 16688 (0.0005) [2023-12-25 23:42:12,876][123090] Updated weights for policy 1, policy_version 16698 (0.0005) [2023-12-25 23:42:13,097][123091] Updated weights for policy 0, policy_version 16778 (0.0010) [2023-12-25 23:42:13,155][123091] Updated weights for policy 0, policy_version 16788 (0.0009) [2023-12-25 23:42:13,228][123091] Updated weights for policy 0, policy_version 16798 (0.0010) [2023-12-25 23:42:13,454][123090] Updated weights for policy 1, policy_version 16708 (0.0005) [2023-12-25 23:42:13,508][123090] Updated weights for policy 1, policy_version 16718 (0.0005) [2023-12-25 23:42:13,565][123090] Updated weights for policy 1, policy_version 16728 (0.0005) [2023-12-25 23:42:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 8585216. Throughput: 0: 8651.8, 1: 8936.5. Samples: 8575436. Policy #0 lag: (min: 6.0, avg: 6.4, max: 18.0) [2023-12-25 23:42:13,785][121949] Avg episode reward: [(0, '2087.585'), (1, '3650.121')] [2023-12-25 23:42:14,149][123091] Updated weights for policy 0, policy_version 16808 (0.0006) [2023-12-25 23:42:14,201][123090] Updated weights for policy 1, policy_version 16738 (0.0005) [2023-12-25 23:42:14,212][123091] Updated weights for policy 0, policy_version 16818 (0.0005) [2023-12-25 23:42:14,265][123091] Updated weights for policy 0, policy_version 16828 (0.0005) [2023-12-25 23:42:14,268][123090] Updated weights for policy 1, policy_version 16748 (0.0005) [2023-12-25 23:42:14,328][123090] Updated weights for policy 1, policy_version 16758 (0.0009) [2023-12-25 23:42:14,391][123090] Updated weights for policy 1, policy_version 16768 (0.0009) [2023-12-25 23:42:15,014][123091] Updated weights for policy 0, policy_version 16838 (0.0008) [2023-12-25 23:42:15,074][123091] Updated weights for policy 0, policy_version 16848 (0.0009) [2023-12-25 23:42:15,130][123091] Updated weights for policy 0, policy_version 16858 (0.0009) [2023-12-25 23:42:15,211][123090] Updated weights for policy 1, policy_version 16778 (0.0007) [2023-12-25 23:42:15,286][123090] Updated weights for policy 1, policy_version 16788 (0.0005) [2023-12-25 23:42:15,355][123090] Updated weights for policy 1, policy_version 16798 (0.0006) [2023-12-25 23:42:16,011][123091] Updated weights for policy 0, policy_version 16868 (0.0009) [2023-12-25 23:42:16,064][123091] Updated weights for policy 0, policy_version 16879 (0.0010) [2023-12-25 23:42:16,114][123091] Updated weights for policy 0, policy_version 16889 (0.0007) [2023-12-25 23:42:16,122][123090] Updated weights for policy 1, policy_version 16808 (0.0008) [2023-12-25 23:42:16,180][123090] Updated weights for policy 1, policy_version 16818 (0.0009) [2023-12-25 23:42:16,233][123090] Updated weights for policy 1, policy_version 16828 (0.0005) [2023-12-25 23:42:16,936][123091] Updated weights for policy 0, policy_version 16899 (0.0007) [2023-12-25 23:42:16,997][123091] Updated weights for policy 0, policy_version 16909 (0.0010) [2023-12-25 23:42:17,048][123090] Updated weights for policy 1, policy_version 16838 (0.0005) [2023-12-25 23:42:17,060][123091] Updated weights for policy 0, policy_version 16919 (0.0010) [2023-12-25 23:42:17,098][123090] Updated weights for policy 1, policy_version 16848 (0.0005) [2023-12-25 23:42:17,157][123090] Updated weights for policy 1, policy_version 16858 (0.0009) [2023-12-25 23:42:17,818][123091] Updated weights for policy 0, policy_version 16929 (0.0009) [2023-12-25 23:42:17,877][123091] Updated weights for policy 0, policy_version 16939 (0.0008) [2023-12-25 23:42:17,879][123090] Updated weights for policy 1, policy_version 16868 (0.0008) [2023-12-25 23:42:17,937][123091] Updated weights for policy 0, policy_version 16949 (0.0009) [2023-12-25 23:42:17,946][123090] Updated weights for policy 1, policy_version 16878 (0.0005) [2023-12-25 23:42:17,998][123091] Updated weights for policy 0, policy_version 16959 (0.0009) [2023-12-25 23:42:18,017][123090] Updated weights for policy 1, policy_version 16888 (0.0006) [2023-12-25 23:42:18,784][123090] Updated weights for policy 1, policy_version 16898 (0.0007) [2023-12-25 23:42:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 8667136. Throughput: 0: 8658.1, 1: 9020.9. Samples: 8684716. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-25 23:42:18,785][121949] Avg episode reward: [(0, '2231.912'), (1, '3610.508')] [2023-12-25 23:42:18,796][123091] Updated weights for policy 0, policy_version 16969 (0.0008) [2023-12-25 23:42:18,848][123090] Updated weights for policy 1, policy_version 16908 (0.0011) [2023-12-25 23:42:18,860][123091] Updated weights for policy 0, policy_version 16979 (0.0007) [2023-12-25 23:42:18,912][123090] Updated weights for policy 1, policy_version 16918 (0.0010) [2023-12-25 23:42:18,913][123091] Updated weights for policy 0, policy_version 16989 (0.0009) [2023-12-25 23:42:18,971][123090] Updated weights for policy 1, policy_version 16928 (0.0010) [2023-12-25 23:42:19,768][123091] Updated weights for policy 0, policy_version 16999 (0.0010) [2023-12-25 23:42:19,829][123090] Updated weights for policy 1, policy_version 16938 (0.0011) [2023-12-25 23:42:19,835][123091] Updated weights for policy 0, policy_version 17009 (0.0007) [2023-12-25 23:42:19,896][123090] Updated weights for policy 1, policy_version 16948 (0.0010) [2023-12-25 23:42:19,905][123091] Updated weights for policy 0, policy_version 17019 (0.0008) [2023-12-25 23:42:19,967][123090] Updated weights for policy 1, policy_version 16958 (0.0007) [2023-12-25 23:42:20,629][123091] Updated weights for policy 0, policy_version 17029 (0.0008) [2023-12-25 23:42:20,692][123091] Updated weights for policy 0, policy_version 17039 (0.0011) [2023-12-25 23:42:20,757][123091] Updated weights for policy 0, policy_version 17049 (0.0011) [2023-12-25 23:42:20,804][123090] Updated weights for policy 1, policy_version 16968 (0.0010) [2023-12-25 23:42:20,865][123090] Updated weights for policy 1, policy_version 16978 (0.0011) [2023-12-25 23:42:20,930][123090] Updated weights for policy 1, policy_version 16988 (0.0007) [2023-12-25 23:42:21,559][123091] Updated weights for policy 0, policy_version 17059 (0.0010) [2023-12-25 23:42:21,633][123091] Updated weights for policy 0, policy_version 17069 (0.0011) [2023-12-25 23:42:21,687][123090] Updated weights for policy 1, policy_version 16998 (0.0007) [2023-12-25 23:42:21,698][123091] Updated weights for policy 0, policy_version 17079 (0.0011) [2023-12-25 23:42:21,759][123090] Updated weights for policy 1, policy_version 17008 (0.0006) [2023-12-25 23:42:21,835][123090] Updated weights for policy 1, policy_version 17018 (0.0010) [2023-12-25 23:42:22,501][123091] Updated weights for policy 0, policy_version 17089 (0.0010) [2023-12-25 23:42:22,572][123091] Updated weights for policy 0, policy_version 17099 (0.0006) [2023-12-25 23:42:22,639][123091] Updated weights for policy 0, policy_version 17109 (0.0008) [2023-12-25 23:42:22,671][123090] Updated weights for policy 1, policy_version 17028 (0.0009) [2023-12-25 23:42:22,704][123091] Updated weights for policy 0, policy_version 17119 (0.0011) [2023-12-25 23:42:22,738][123090] Updated weights for policy 1, policy_version 17038 (0.0007) [2023-12-25 23:42:22,802][123090] Updated weights for policy 1, policy_version 17048 (0.0009) [2023-12-25 23:42:23,437][123091] Updated weights for policy 0, policy_version 17129 (0.0006) [2023-12-25 23:42:23,495][123091] Updated weights for policy 0, policy_version 17139 (0.0005) [2023-12-25 23:42:23,542][123091] Updated weights for policy 0, policy_version 17149 (0.0005) [2023-12-25 23:42:23,685][123090] Updated weights for policy 1, policy_version 17058 (0.0009) [2023-12-25 23:42:23,751][123090] Updated weights for policy 1, policy_version 17068 (0.0005) [2023-12-25 23:42:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 8757248. Throughput: 0: 8658.7, 1: 8989.4. Samples: 8736708. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-25 23:42:23,784][121949] Avg episode reward: [(0, '2468.160'), (1, '3689.757')] [2023-12-25 23:42:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000017152_4390912.pth... [2023-12-25 23:42:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000016128_4128768.pth [2023-12-25 23:42:23,821][123090] Updated weights for policy 1, policy_version 17078 (0.0005) [2023-12-25 23:42:23,894][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000017088_4374528.pth... [2023-12-25 23:42:23,895][123090] Updated weights for policy 1, policy_version 17088 (0.0005) [2023-12-25 23:42:23,897][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000016000_4096000.pth [2023-12-25 23:42:24,231][123091] Updated weights for policy 0, policy_version 17159 (0.0006) [2023-12-25 23:42:24,283][123091] Updated weights for policy 0, policy_version 17169 (0.0005) [2023-12-25 23:42:24,344][123091] Updated weights for policy 0, policy_version 17179 (0.0005) [2023-12-25 23:42:24,546][123090] Updated weights for policy 1, policy_version 17098 (0.0006) [2023-12-25 23:42:24,604][123090] Updated weights for policy 1, policy_version 17108 (0.0007) [2023-12-25 23:42:24,684][123090] Updated weights for policy 1, policy_version 17118 (0.0005) [2023-12-25 23:42:24,997][123091] Updated weights for policy 0, policy_version 17189 (0.0006) [2023-12-25 23:42:25,053][123091] Updated weights for policy 0, policy_version 17199 (0.0009) [2023-12-25 23:42:25,108][123091] Updated weights for policy 0, policy_version 17209 (0.0009) [2023-12-25 23:42:25,373][123090] Updated weights for policy 1, policy_version 17129 (0.0010) [2023-12-25 23:42:25,428][123090] Updated weights for policy 1, policy_version 17139 (0.0010) [2023-12-25 23:42:25,482][123090] Updated weights for policy 1, policy_version 17150 (0.0010) [2023-12-25 23:42:25,849][123091] Updated weights for policy 0, policy_version 17219 (0.0007) [2023-12-25 23:42:25,903][123091] Updated weights for policy 0, policy_version 17229 (0.0006) [2023-12-25 23:42:25,964][123091] Updated weights for policy 0, policy_version 17239 (0.0008) [2023-12-25 23:42:26,404][123090] Updated weights for policy 1, policy_version 17160 (0.0010) [2023-12-25 23:42:26,471][123090] Updated weights for policy 1, policy_version 17170 (0.0010) [2023-12-25 23:42:26,537][123090] Updated weights for policy 1, policy_version 17180 (0.0010) [2023-12-25 23:42:26,736][123091] Updated weights for policy 0, policy_version 17249 (0.0009) [2023-12-25 23:42:26,790][123091] Updated weights for policy 0, policy_version 17260 (0.0007) [2023-12-25 23:42:26,847][123091] Updated weights for policy 0, policy_version 17271 (0.0010) [2023-12-25 23:42:27,236][123090] Updated weights for policy 1, policy_version 17190 (0.0009) [2023-12-25 23:42:27,301][123090] Updated weights for policy 1, policy_version 17200 (0.0009) [2023-12-25 23:42:27,365][123090] Updated weights for policy 1, policy_version 17210 (0.0009) [2023-12-25 23:42:27,722][123091] Updated weights for policy 0, policy_version 17281 (0.0008) [2023-12-25 23:42:27,787][123091] Updated weights for policy 0, policy_version 17291 (0.0005) [2023-12-25 23:42:27,844][123091] Updated weights for policy 0, policy_version 17301 (0.0005) [2023-12-25 23:42:27,901][123091] Updated weights for policy 0, policy_version 17311 (0.0005) [2023-12-25 23:42:28,076][123090] Updated weights for policy 1, policy_version 17220 (0.0006) [2023-12-25 23:42:28,123][123090] Updated weights for policy 1, policy_version 17230 (0.0005) [2023-12-25 23:42:28,170][123090] Updated weights for policy 1, policy_version 17240 (0.0005) [2023-12-25 23:42:28,606][123091] Updated weights for policy 0, policy_version 17321 (0.0006) [2023-12-25 23:42:28,668][123091] Updated weights for policy 0, policy_version 17331 (0.0006) [2023-12-25 23:42:28,731][123091] Updated weights for policy 0, policy_version 17341 (0.0007) [2023-12-25 23:42:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 8855552. Throughput: 0: 8792.1, 1: 9021.9. Samples: 8845544. Policy #0 lag: (min: 10.0, avg: 25.0, max: 42.0) [2023-12-25 23:42:28,785][121949] Avg episode reward: [(0, '2539.928'), (1, '3634.583')] [2023-12-25 23:42:28,873][123090] Updated weights for policy 1, policy_version 17250 (0.0005) [2023-12-25 23:42:28,931][123090] Updated weights for policy 1, policy_version 17260 (0.0005) [2023-12-25 23:42:28,978][123090] Updated weights for policy 1, policy_version 17270 (0.0005) [2023-12-25 23:42:29,030][123090] Updated weights for policy 1, policy_version 17280 (0.0005) [2023-12-25 23:42:29,586][123091] Updated weights for policy 0, policy_version 17351 (0.0010) [2023-12-25 23:42:29,643][123091] Updated weights for policy 0, policy_version 17361 (0.0009) [2023-12-25 23:42:29,689][123090] Updated weights for policy 1, policy_version 17290 (0.0007) [2023-12-25 23:42:29,696][123091] Updated weights for policy 0, policy_version 17371 (0.0009) [2023-12-25 23:42:29,741][123090] Updated weights for policy 1, policy_version 17300 (0.0008) [2023-12-25 23:42:29,794][123090] Updated weights for policy 1, policy_version 17310 (0.0009) [2023-12-25 23:42:30,359][123091] Updated weights for policy 0, policy_version 17381 (0.0008) [2023-12-25 23:42:30,430][123091] Updated weights for policy 0, policy_version 17391 (0.0009) [2023-12-25 23:42:30,482][123091] Updated weights for policy 0, policy_version 17401 (0.0010) [2023-12-25 23:42:30,616][123090] Updated weights for policy 1, policy_version 17320 (0.0009) [2023-12-25 23:42:30,670][123090] Updated weights for policy 1, policy_version 17330 (0.0010) [2023-12-25 23:42:30,722][123090] Updated weights for policy 1, policy_version 17340 (0.0010) [2023-12-25 23:42:31,268][123091] Updated weights for policy 0, policy_version 17411 (0.0008) [2023-12-25 23:42:31,349][123091] Updated weights for policy 0, policy_version 17421 (0.0007) [2023-12-25 23:42:31,416][123091] Updated weights for policy 0, policy_version 17431 (0.0010) [2023-12-25 23:42:31,510][123090] Updated weights for policy 1, policy_version 17350 (0.0010) [2023-12-25 23:42:31,559][123090] Updated weights for policy 1, policy_version 17360 (0.0009) [2023-12-25 23:42:31,607][123090] Updated weights for policy 1, policy_version 17370 (0.0009) [2023-12-25 23:42:32,180][123091] Updated weights for policy 0, policy_version 17441 (0.0009) [2023-12-25 23:42:32,236][123091] Updated weights for policy 0, policy_version 17451 (0.0005) [2023-12-25 23:42:32,302][123091] Updated weights for policy 0, policy_version 17461 (0.0006) [2023-12-25 23:42:32,372][123091] Updated weights for policy 0, policy_version 17471 (0.0007) [2023-12-25 23:42:32,398][123090] Updated weights for policy 1, policy_version 17380 (0.0007) [2023-12-25 23:42:32,464][123090] Updated weights for policy 1, policy_version 17390 (0.0009) [2023-12-25 23:42:32,524][123090] Updated weights for policy 1, policy_version 17400 (0.0009) [2023-12-25 23:42:33,180][123091] Updated weights for policy 0, policy_version 17482 (0.0009) [2023-12-25 23:42:33,237][123090] Updated weights for policy 1, policy_version 17410 (0.0008) [2023-12-25 23:42:33,242][123091] Updated weights for policy 0, policy_version 17492 (0.0007) [2023-12-25 23:42:33,302][123090] Updated weights for policy 1, policy_version 17420 (0.0006) [2023-12-25 23:42:33,312][123091] Updated weights for policy 0, policy_version 17502 (0.0009) [2023-12-25 23:42:33,346][123090] Updated weights for policy 1, policy_version 17430 (0.0008) [2023-12-25 23:42:33,402][123090] Updated weights for policy 1, policy_version 17440 (0.0009) [2023-12-25 23:42:33,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 8945664. Throughput: 0: 8805.3, 1: 9112.5. Samples: 8956424. Policy #0 lag: (min: 10.0, avg: 25.0, max: 42.0) [2023-12-25 23:42:33,785][121949] Avg episode reward: [(0, '2569.024'), (1, '3773.124')] [2023-12-25 23:42:33,787][123007] Saving new best policy, reward=2569.024! [2023-12-25 23:42:34,114][123091] Updated weights for policy 0, policy_version 17512 (0.0009) [2023-12-25 23:42:34,174][123091] Updated weights for policy 0, policy_version 17522 (0.0007) [2023-12-25 23:42:34,188][123090] Updated weights for policy 1, policy_version 17450 (0.0012) [2023-12-25 23:42:34,235][123091] Updated weights for policy 0, policy_version 17532 (0.0010) [2023-12-25 23:42:34,260][123090] Updated weights for policy 1, policy_version 17460 (0.0008) [2023-12-25 23:42:34,331][123090] Updated weights for policy 1, policy_version 17470 (0.0009) [2023-12-25 23:42:35,099][123090] Updated weights for policy 1, policy_version 17480 (0.0007) [2023-12-25 23:42:35,131][123091] Updated weights for policy 0, policy_version 17542 (0.0008) [2023-12-25 23:42:35,159][123090] Updated weights for policy 1, policy_version 17490 (0.0008) [2023-12-25 23:42:35,187][123091] Updated weights for policy 0, policy_version 17552 (0.0008) [2023-12-25 23:42:35,211][123090] Updated weights for policy 1, policy_version 17500 (0.0007) [2023-12-25 23:42:35,254][123091] Updated weights for policy 0, policy_version 17562 (0.0010) [2023-12-25 23:42:36,049][123090] Updated weights for policy 1, policy_version 17510 (0.0010) [2023-12-25 23:42:36,097][123091] Updated weights for policy 0, policy_version 17572 (0.0010) [2023-12-25 23:42:36,106][123090] Updated weights for policy 1, policy_version 17520 (0.0009) [2023-12-25 23:42:36,164][123091] Updated weights for policy 0, policy_version 17582 (0.0008) [2023-12-25 23:42:36,171][123090] Updated weights for policy 1, policy_version 17530 (0.0008) [2023-12-25 23:42:36,225][123091] Updated weights for policy 0, policy_version 17592 (0.0009) [2023-12-25 23:42:37,034][123090] Updated weights for policy 1, policy_version 17540 (0.0009) [2023-12-25 23:42:37,085][123091] Updated weights for policy 0, policy_version 17602 (0.0009) [2023-12-25 23:42:37,088][123090] Updated weights for policy 1, policy_version 17550 (0.0009) [2023-12-25 23:42:37,137][123091] Updated weights for policy 0, policy_version 17612 (0.0010) [2023-12-25 23:42:37,143][123090] Updated weights for policy 1, policy_version 17560 (0.0007) [2023-12-25 23:42:37,189][123091] Updated weights for policy 0, policy_version 17622 (0.0007) [2023-12-25 23:42:37,253][123091] Updated weights for policy 0, policy_version 17632 (0.0009) [2023-12-25 23:42:37,961][123090] Updated weights for policy 1, policy_version 17570 (0.0009) [2023-12-25 23:42:38,020][123090] Updated weights for policy 1, policy_version 17580 (0.0008) [2023-12-25 23:42:38,080][123090] Updated weights for policy 1, policy_version 17590 (0.0007) [2023-12-25 23:42:38,098][123091] Updated weights for policy 0, policy_version 17642 (0.0009) [2023-12-25 23:42:38,142][123090] Updated weights for policy 1, policy_version 17600 (0.0007) [2023-12-25 23:42:38,144][123091] Updated weights for policy 0, policy_version 17652 (0.0008) [2023-12-25 23:42:38,197][123091] Updated weights for policy 0, policy_version 17662 (0.0008) [2023-12-25 23:42:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 9027584. Throughput: 0: 8762.1, 1: 9119.1. Samples: 9007436. Policy #0 lag: (min: 10.0, avg: 25.0, max: 42.0) [2023-12-25 23:42:38,784][121949] Avg episode reward: [(0, '2626.871'), (1, '3631.661')] [2023-12-25 23:42:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000017600_4505600.pth... [2023-12-25 23:42:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000017664_4521984.pth... [2023-12-25 23:42:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000016544_4235264.pth [2023-12-25 23:42:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000016640_4259840.pth [2023-12-25 23:42:38,798][123007] Saving new best policy, reward=2626.871! [2023-12-25 23:42:38,970][123090] Updated weights for policy 1, policy_version 17610 (0.0009) [2023-12-25 23:42:39,038][123091] Updated weights for policy 0, policy_version 17672 (0.0008) [2023-12-25 23:42:39,040][123090] Updated weights for policy 1, policy_version 17620 (0.0008) [2023-12-25 23:42:39,101][123091] Updated weights for policy 0, policy_version 17682 (0.0008) [2023-12-25 23:42:39,104][123090] Updated weights for policy 1, policy_version 17630 (0.0007) [2023-12-25 23:42:39,165][123091] Updated weights for policy 0, policy_version 17692 (0.0010) [2023-12-25 23:42:39,969][123090] Updated weights for policy 1, policy_version 17640 (0.0009) [2023-12-25 23:42:40,001][123091] Updated weights for policy 0, policy_version 17702 (0.0009) [2023-12-25 23:42:40,039][123090] Updated weights for policy 1, policy_version 17650 (0.0008) [2023-12-25 23:42:40,064][123091] Updated weights for policy 0, policy_version 17712 (0.0008) [2023-12-25 23:42:40,103][123090] Updated weights for policy 1, policy_version 17660 (0.0008) [2023-12-25 23:42:40,131][123091] Updated weights for policy 0, policy_version 17722 (0.0008) [2023-12-25 23:42:40,895][123091] Updated weights for policy 0, policy_version 17732 (0.0010) [2023-12-25 23:42:40,924][123090] Updated weights for policy 1, policy_version 17670 (0.0008) [2023-12-25 23:42:40,960][123091] Updated weights for policy 0, policy_version 17742 (0.0008) [2023-12-25 23:42:40,989][123090] Updated weights for policy 1, policy_version 17680 (0.0009) [2023-12-25 23:42:41,021][123091] Updated weights for policy 0, policy_version 17752 (0.0008) [2023-12-25 23:42:41,057][123090] Updated weights for policy 1, policy_version 17690 (0.0007) [2023-12-25 23:42:41,889][123091] Updated weights for policy 0, policy_version 17762 (0.0008) [2023-12-25 23:42:41,949][123091] Updated weights for policy 0, policy_version 17772 (0.0006) [2023-12-25 23:42:41,982][123090] Updated weights for policy 1, policy_version 17700 (0.0007) [2023-12-25 23:42:42,007][123091] Updated weights for policy 0, policy_version 17782 (0.0006) [2023-12-25 23:42:42,050][123090] Updated weights for policy 1, policy_version 17710 (0.0008) [2023-12-25 23:42:42,073][123091] Updated weights for policy 0, policy_version 17792 (0.0006) [2023-12-25 23:42:42,120][123090] Updated weights for policy 1, policy_version 17720 (0.0010) [2023-12-25 23:42:42,856][123091] Updated weights for policy 0, policy_version 17802 (0.0010) [2023-12-25 23:42:42,911][123091] Updated weights for policy 0, policy_version 17812 (0.0009) [2023-12-25 23:42:42,959][123091] Updated weights for policy 0, policy_version 17822 (0.0009) [2023-12-25 23:42:42,959][123090] Updated weights for policy 1, policy_version 17730 (0.0010) [2023-12-25 23:42:43,015][123090] Updated weights for policy 1, policy_version 17740 (0.0008) [2023-12-25 23:42:43,083][123090] Updated weights for policy 1, policy_version 17750 (0.0010) [2023-12-25 23:42:43,146][123090] Updated weights for policy 1, policy_version 17760 (0.0009) [2023-12-25 23:42:43,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 9109504. Throughput: 0: 8720.9, 1: 8989.5. Samples: 9110048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:42:43,784][121949] Avg episode reward: [(0, '2478.959'), (1, '3678.171')] [2023-12-25 23:42:43,813][123091] Updated weights for policy 0, policy_version 17832 (0.0008) [2023-12-25 23:42:43,855][123090] Updated weights for policy 1, policy_version 17770 (0.0010) [2023-12-25 23:42:43,874][123091] Updated weights for policy 0, policy_version 17842 (0.0007) [2023-12-25 23:42:43,904][123090] Updated weights for policy 1, policy_version 17780 (0.0010) [2023-12-25 23:42:43,928][123091] Updated weights for policy 0, policy_version 17852 (0.0008) [2023-12-25 23:42:43,961][123090] Updated weights for policy 1, policy_version 17790 (0.0010) [2023-12-25 23:42:44,582][123091] Updated weights for policy 0, policy_version 17862 (0.0006) [2023-12-25 23:42:44,648][123091] Updated weights for policy 0, policy_version 17872 (0.0010) [2023-12-25 23:42:44,684][123090] Updated weights for policy 1, policy_version 17800 (0.0009) [2023-12-25 23:42:44,704][123091] Updated weights for policy 0, policy_version 17882 (0.0010) [2023-12-25 23:42:44,747][123090] Updated weights for policy 1, policy_version 17810 (0.0010) [2023-12-25 23:42:44,813][123090] Updated weights for policy 1, policy_version 17820 (0.0007) [2023-12-25 23:42:45,404][123091] Updated weights for policy 0, policy_version 17892 (0.0006) [2023-12-25 23:42:45,458][123091] Updated weights for policy 0, policy_version 17902 (0.0006) [2023-12-25 23:42:45,514][123091] Updated weights for policy 0, policy_version 17912 (0.0006) [2023-12-25 23:42:45,611][123090] Updated weights for policy 1, policy_version 17830 (0.0009) [2023-12-25 23:42:45,675][123090] Updated weights for policy 1, policy_version 17840 (0.0011) [2023-12-25 23:42:45,744][123090] Updated weights for policy 1, policy_version 17850 (0.0007) [2023-12-25 23:42:46,318][123091] Updated weights for policy 0, policy_version 17922 (0.0010) [2023-12-25 23:42:46,349][123090] Updated weights for policy 1, policy_version 17860 (0.0005) [2023-12-25 23:42:46,377][123091] Updated weights for policy 0, policy_version 17932 (0.0006) [2023-12-25 23:42:46,410][123090] Updated weights for policy 1, policy_version 17870 (0.0005) [2023-12-25 23:42:46,436][123091] Updated weights for policy 0, policy_version 17942 (0.0006) [2023-12-25 23:42:46,460][123090] Updated weights for policy 1, policy_version 17880 (0.0005) [2023-12-25 23:42:46,503][123091] Updated weights for policy 0, policy_version 17952 (0.0008) [2023-12-25 23:42:47,201][123090] Updated weights for policy 1, policy_version 17890 (0.0006) [2023-12-25 23:42:47,250][123090] Updated weights for policy 1, policy_version 17900 (0.0009) [2023-12-25 23:42:47,266][123091] Updated weights for policy 0, policy_version 17962 (0.0005) [2023-12-25 23:42:47,308][123090] Updated weights for policy 1, policy_version 17910 (0.0009) [2023-12-25 23:42:47,320][123091] Updated weights for policy 0, policy_version 17972 (0.0005) [2023-12-25 23:42:47,356][123090] Updated weights for policy 1, policy_version 17920 (0.0009) [2023-12-25 23:42:47,377][123091] Updated weights for policy 0, policy_version 17982 (0.0005) [2023-12-25 23:42:48,027][123091] Updated weights for policy 0, policy_version 17992 (0.0006) [2023-12-25 23:42:48,086][123091] Updated weights for policy 0, policy_version 18002 (0.0005) [2023-12-25 23:42:48,147][123091] Updated weights for policy 0, policy_version 18012 (0.0005) [2023-12-25 23:42:48,199][123090] Updated weights for policy 1, policy_version 17930 (0.0010) [2023-12-25 23:42:48,262][123090] Updated weights for policy 1, policy_version 17940 (0.0010) [2023-12-25 23:42:48,315][123090] Updated weights for policy 1, policy_version 17950 (0.0007) [2023-12-25 23:42:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 9207808. Throughput: 0: 8786.0, 1: 9016.7. Samples: 9222408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:42:48,785][121949] Avg episode reward: [(0, '2765.933'), (1, '3886.381')] [2023-12-25 23:42:48,786][123007] Saving new best policy, reward=2765.933! [2023-12-25 23:42:48,844][123091] Updated weights for policy 0, policy_version 18022 (0.0005) [2023-12-25 23:42:48,917][123091] Updated weights for policy 0, policy_version 18032 (0.0005) [2023-12-25 23:42:48,987][123091] Updated weights for policy 0, policy_version 18042 (0.0005) [2023-12-25 23:42:49,162][123090] Updated weights for policy 1, policy_version 17960 (0.0010) [2023-12-25 23:42:49,238][123090] Updated weights for policy 1, policy_version 17970 (0.0011) [2023-12-25 23:42:49,306][123090] Updated weights for policy 1, policy_version 17980 (0.0011) [2023-12-25 23:42:49,620][123091] Updated weights for policy 0, policy_version 18052 (0.0006) [2023-12-25 23:42:49,674][123091] Updated weights for policy 0, policy_version 18062 (0.0007) [2023-12-25 23:42:49,735][123091] Updated weights for policy 0, policy_version 18072 (0.0008) [2023-12-25 23:42:50,136][123090] Updated weights for policy 1, policy_version 17990 (0.0011) [2023-12-25 23:42:50,188][123090] Updated weights for policy 1, policy_version 18000 (0.0010) [2023-12-25 23:42:50,238][123090] Updated weights for policy 1, policy_version 18010 (0.0009) [2023-12-25 23:42:50,506][123091] Updated weights for policy 0, policy_version 18082 (0.0010) [2023-12-25 23:42:50,561][123091] Updated weights for policy 0, policy_version 18092 (0.0008) [2023-12-25 23:42:50,626][123091] Updated weights for policy 0, policy_version 18102 (0.0008) [2023-12-25 23:42:50,684][123091] Updated weights for policy 0, policy_version 18112 (0.0006) [2023-12-25 23:42:51,134][123090] Updated weights for policy 1, policy_version 18020 (0.0010) [2023-12-25 23:42:51,192][123090] Updated weights for policy 1, policy_version 18030 (0.0007) [2023-12-25 23:42:51,248][123090] Updated weights for policy 1, policy_version 18040 (0.0008) [2023-12-25 23:42:51,551][123091] Updated weights for policy 0, policy_version 18122 (0.0010) [2023-12-25 23:42:51,608][123091] Updated weights for policy 0, policy_version 18132 (0.0011) [2023-12-25 23:42:51,678][123091] Updated weights for policy 0, policy_version 18142 (0.0010) [2023-12-25 23:42:52,026][123090] Updated weights for policy 1, policy_version 18050 (0.0008) [2023-12-25 23:42:52,090][123090] Updated weights for policy 1, policy_version 18060 (0.0009) [2023-12-25 23:42:52,157][123090] Updated weights for policy 1, policy_version 18070 (0.0009) [2023-12-25 23:42:52,215][123090] Updated weights for policy 1, policy_version 18080 (0.0010) [2023-12-25 23:42:52,369][123091] Updated weights for policy 0, policy_version 18152 (0.0009) [2023-12-25 23:42:52,421][123091] Updated weights for policy 0, policy_version 18162 (0.0009) [2023-12-25 23:42:52,482][123091] Updated weights for policy 0, policy_version 18172 (0.0011) [2023-12-25 23:42:52,973][123090] Updated weights for policy 1, policy_version 18090 (0.0009) [2023-12-25 23:42:53,042][123090] Updated weights for policy 1, policy_version 18100 (0.0009) [2023-12-25 23:42:53,103][123090] Updated weights for policy 1, policy_version 18110 (0.0009) [2023-12-25 23:42:53,295][123091] Updated weights for policy 0, policy_version 18182 (0.0009) [2023-12-25 23:42:53,361][123091] Updated weights for policy 0, policy_version 18192 (0.0010) [2023-12-25 23:42:53,429][123091] Updated weights for policy 0, policy_version 18202 (0.0010) [2023-12-25 23:42:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 9297920. Throughput: 0: 8855.3, 1: 8974.7. Samples: 9274960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:42:53,785][121949] Avg episode reward: [(0, '2806.645'), (1, '3945.115')] [2023-12-25 23:42:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000018208_4661248.pth... [2023-12-25 23:42:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000018112_4636672.pth... [2023-12-25 23:42:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000017088_4374528.pth [2023-12-25 23:42:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000017152_4390912.pth [2023-12-25 23:42:53,796][123008] Saving new best policy, reward=3945.115! [2023-12-25 23:42:53,797][123007] Saving new best policy, reward=2806.645! [2023-12-25 23:42:53,907][123090] Updated weights for policy 1, policy_version 18120 (0.0009) [2023-12-25 23:42:53,964][123090] Updated weights for policy 1, policy_version 18130 (0.0007) [2023-12-25 23:42:54,027][123090] Updated weights for policy 1, policy_version 18140 (0.0010) [2023-12-25 23:42:54,199][123091] Updated weights for policy 0, policy_version 18212 (0.0009) [2023-12-25 23:42:54,258][123091] Updated weights for policy 0, policy_version 18222 (0.0008) [2023-12-25 23:42:54,307][123091] Updated weights for policy 0, policy_version 18232 (0.0008) [2023-12-25 23:42:54,761][123090] Updated weights for policy 1, policy_version 18150 (0.0010) [2023-12-25 23:42:54,828][123090] Updated weights for policy 1, policy_version 18160 (0.0010) [2023-12-25 23:42:54,896][123090] Updated weights for policy 1, policy_version 18170 (0.0010) [2023-12-25 23:42:55,087][123091] Updated weights for policy 0, policy_version 18242 (0.0007) [2023-12-25 23:42:55,141][123091] Updated weights for policy 0, policy_version 18252 (0.0006) [2023-12-25 23:42:55,205][123091] Updated weights for policy 0, policy_version 18262 (0.0008) [2023-12-25 23:42:55,257][123091] Updated weights for policy 0, policy_version 18272 (0.0009) [2023-12-25 23:42:55,580][123090] Updated weights for policy 1, policy_version 18180 (0.0008) [2023-12-25 23:42:55,632][123090] Updated weights for policy 1, policy_version 18190 (0.0006) [2023-12-25 23:42:55,689][123090] Updated weights for policy 1, policy_version 18200 (0.0005) [2023-12-25 23:42:56,145][123091] Updated weights for policy 0, policy_version 18282 (0.0009) [2023-12-25 23:42:56,195][123091] Updated weights for policy 0, policy_version 18292 (0.0009) [2023-12-25 23:42:56,252][123091] Updated weights for policy 0, policy_version 18302 (0.0009) [2023-12-25 23:42:56,420][123090] Updated weights for policy 1, policy_version 18210 (0.0006) [2023-12-25 23:42:56,476][123090] Updated weights for policy 1, policy_version 18220 (0.0009) [2023-12-25 23:42:56,530][123090] Updated weights for policy 1, policy_version 18230 (0.0010) [2023-12-25 23:42:56,591][123090] Updated weights for policy 1, policy_version 18240 (0.0010) [2023-12-25 23:42:57,152][123091] Updated weights for policy 0, policy_version 18312 (0.0010) [2023-12-25 23:42:57,212][123091] Updated weights for policy 0, policy_version 18322 (0.0009) [2023-12-25 23:42:57,265][123091] Updated weights for policy 0, policy_version 18333 (0.0010) [2023-12-25 23:42:57,398][123090] Updated weights for policy 1, policy_version 18250 (0.0007) [2023-12-25 23:42:57,453][123090] Updated weights for policy 1, policy_version 18260 (0.0007) [2023-12-25 23:42:57,514][123090] Updated weights for policy 1, policy_version 18270 (0.0010) [2023-12-25 23:42:58,056][123091] Updated weights for policy 0, policy_version 18343 (0.0009) [2023-12-25 23:42:58,113][123091] Updated weights for policy 0, policy_version 18353 (0.0009) [2023-12-25 23:42:58,173][123091] Updated weights for policy 0, policy_version 18363 (0.0009) [2023-12-25 23:42:58,315][123090] Updated weights for policy 1, policy_version 18280 (0.0010) [2023-12-25 23:42:58,387][123090] Updated weights for policy 1, policy_version 18290 (0.0009) [2023-12-25 23:42:58,456][123090] Updated weights for policy 1, policy_version 18300 (0.0007) [2023-12-25 23:42:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 9388032. Throughput: 0: 8919.6, 1: 9014.5. Samples: 9382468. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-25 23:42:58,785][121949] Avg episode reward: [(0, '2822.221'), (1, '3838.412')] [2023-12-25 23:42:58,786][123007] Saving new best policy, reward=2822.221! [2023-12-25 23:42:59,045][123091] Updated weights for policy 0, policy_version 18373 (0.0009) [2023-12-25 23:42:59,102][123091] Updated weights for policy 0, policy_version 18383 (0.0007) [2023-12-25 23:42:59,166][123091] Updated weights for policy 0, policy_version 18393 (0.0010) [2023-12-25 23:42:59,348][123090] Updated weights for policy 1, policy_version 18310 (0.0010) [2023-12-25 23:42:59,417][123090] Updated weights for policy 1, policy_version 18320 (0.0010) [2023-12-25 23:42:59,475][123090] Updated weights for policy 1, policy_version 18330 (0.0010) [2023-12-25 23:42:59,930][123091] Updated weights for policy 0, policy_version 18403 (0.0008) [2023-12-25 23:42:59,988][123091] Updated weights for policy 0, policy_version 18413 (0.0011) [2023-12-25 23:43:00,045][123091] Updated weights for policy 0, policy_version 18423 (0.0011) [2023-12-25 23:43:00,280][123090] Updated weights for policy 1, policy_version 18340 (0.0008) [2023-12-25 23:43:00,347][123090] Updated weights for policy 1, policy_version 18350 (0.0009) [2023-12-25 23:43:00,402][123090] Updated weights for policy 1, policy_version 18360 (0.0010) [2023-12-25 23:43:00,815][123091] Updated weights for policy 0, policy_version 18433 (0.0010) [2023-12-25 23:43:00,870][123091] Updated weights for policy 0, policy_version 18443 (0.0006) [2023-12-25 23:43:00,925][123091] Updated weights for policy 0, policy_version 18453 (0.0006) [2023-12-25 23:43:00,981][123091] Updated weights for policy 0, policy_version 18463 (0.0006) [2023-12-25 23:43:01,032][123090] Updated weights for policy 1, policy_version 18370 (0.0008) [2023-12-25 23:43:01,090][123090] Updated weights for policy 1, policy_version 18380 (0.0008) [2023-12-25 23:43:01,159][123090] Updated weights for policy 1, policy_version 18390 (0.0008) [2023-12-25 23:43:01,229][123090] Updated weights for policy 1, policy_version 18400 (0.0008) [2023-12-25 23:43:01,782][123091] Updated weights for policy 0, policy_version 18473 (0.0008) [2023-12-25 23:43:01,839][123091] Updated weights for policy 0, policy_version 18483 (0.0007) [2023-12-25 23:43:01,900][123091] Updated weights for policy 0, policy_version 18493 (0.0005) [2023-12-25 23:43:02,032][123090] Updated weights for policy 1, policy_version 18410 (0.0011) [2023-12-25 23:43:02,097][123090] Updated weights for policy 1, policy_version 18420 (0.0011) [2023-12-25 23:43:02,160][123090] Updated weights for policy 1, policy_version 18430 (0.0005) [2023-12-25 23:43:02,664][123091] Updated weights for policy 0, policy_version 18503 (0.0007) [2023-12-25 23:43:02,726][123091] Updated weights for policy 0, policy_version 18513 (0.0007) [2023-12-25 23:43:02,779][123091] Updated weights for policy 0, policy_version 18523 (0.0008) [2023-12-25 23:43:02,884][123090] Updated weights for policy 1, policy_version 18440 (0.0009) [2023-12-25 23:43:02,941][123090] Updated weights for policy 1, policy_version 18450 (0.0009) [2023-12-25 23:43:03,001][123090] Updated weights for policy 1, policy_version 18460 (0.0009) [2023-12-25 23:43:03,573][123091] Updated weights for policy 0, policy_version 18533 (0.0008) [2023-12-25 23:43:03,629][123091] Updated weights for policy 0, policy_version 18543 (0.0009) [2023-12-25 23:43:03,675][123091] Updated weights for policy 0, policy_version 18553 (0.0009) [2023-12-25 23:43:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 9478144. Throughput: 0: 8964.4, 1: 8926.7. Samples: 9489820. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-25 23:43:03,785][121949] Avg episode reward: [(0, '2914.974'), (1, '3786.833')] [2023-12-25 23:43:03,787][123007] Saving new best policy, reward=2914.974! [2023-12-25 23:43:03,821][123090] Updated weights for policy 1, policy_version 18470 (0.0009) [2023-12-25 23:43:03,890][123090] Updated weights for policy 1, policy_version 18480 (0.0009) [2023-12-25 23:43:03,964][123090] Updated weights for policy 1, policy_version 18490 (0.0009) [2023-12-25 23:43:04,515][123091] Updated weights for policy 0, policy_version 18563 (0.0009) [2023-12-25 23:43:04,578][123091] Updated weights for policy 0, policy_version 18573 (0.0009) [2023-12-25 23:43:04,631][123091] Updated weights for policy 0, policy_version 18583 (0.0009) [2023-12-25 23:43:04,663][123090] Updated weights for policy 1, policy_version 18500 (0.0005) [2023-12-25 23:43:04,719][123090] Updated weights for policy 1, policy_version 18510 (0.0005) [2023-12-25 23:43:04,789][123090] Updated weights for policy 1, policy_version 18520 (0.0006) [2023-12-25 23:43:05,490][123091] Updated weights for policy 0, policy_version 18593 (0.0009) [2023-12-25 23:43:05,511][123090] Updated weights for policy 1, policy_version 18530 (0.0006) [2023-12-25 23:43:05,552][123091] Updated weights for policy 0, policy_version 18603 (0.0010) [2023-12-25 23:43:05,567][123090] Updated weights for policy 1, policy_version 18540 (0.0007) [2023-12-25 23:43:05,608][123091] Updated weights for policy 0, policy_version 18613 (0.0008) [2023-12-25 23:43:05,626][123090] Updated weights for policy 1, policy_version 18550 (0.0007) [2023-12-25 23:43:05,674][123091] Updated weights for policy 0, policy_version 18623 (0.0009) [2023-12-25 23:43:05,689][123090] Updated weights for policy 1, policy_version 18560 (0.0008) [2023-12-25 23:43:06,475][123090] Updated weights for policy 1, policy_version 18570 (0.0008) [2023-12-25 23:43:06,542][123091] Updated weights for policy 0, policy_version 18633 (0.0009) [2023-12-25 23:43:06,547][123090] Updated weights for policy 1, policy_version 18580 (0.0006) [2023-12-25 23:43:06,605][123091] Updated weights for policy 0, policy_version 18643 (0.0006) [2023-12-25 23:43:06,618][123090] Updated weights for policy 1, policy_version 18590 (0.0011) [2023-12-25 23:43:06,676][123091] Updated weights for policy 0, policy_version 18653 (0.0009) [2023-12-25 23:43:07,427][123090] Updated weights for policy 1, policy_version 18600 (0.0011) [2023-12-25 23:43:07,484][123090] Updated weights for policy 1, policy_version 18610 (0.0011) [2023-12-25 23:43:07,511][123091] Updated weights for policy 0, policy_version 18663 (0.0010) [2023-12-25 23:43:07,547][123090] Updated weights for policy 1, policy_version 18620 (0.0011) [2023-12-25 23:43:07,568][123091] Updated weights for policy 0, policy_version 18673 (0.0006) [2023-12-25 23:43:07,625][123091] Updated weights for policy 0, policy_version 18683 (0.0009) [2023-12-25 23:43:08,304][123090] Updated weights for policy 1, policy_version 18630 (0.0007) [2023-12-25 23:43:08,370][123090] Updated weights for policy 1, policy_version 18640 (0.0007) [2023-12-25 23:43:08,437][123090] Updated weights for policy 1, policy_version 18650 (0.0005) [2023-12-25 23:43:08,521][123091] Updated weights for policy 0, policy_version 18693 (0.0008) [2023-12-25 23:43:08,595][123091] Updated weights for policy 0, policy_version 18703 (0.0005) [2023-12-25 23:43:08,667][123091] Updated weights for policy 0, policy_version 18713 (0.0005) [2023-12-25 23:43:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 9568256. Throughput: 0: 8940.2, 1: 8956.9. Samples: 9542080. Policy #0 lag: (min: 11.0, avg: 23.0, max: 43.0) [2023-12-25 23:43:08,785][121949] Avg episode reward: [(0, '3058.307'), (1, '3963.375')] [2023-12-25 23:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000018656_4775936.pth... [2023-12-25 23:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000018720_4792320.pth... [2023-12-25 23:43:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000017600_4505600.pth [2023-12-25 23:43:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000017664_4521984.pth [2023-12-25 23:43:08,796][123008] Saving new best policy, reward=3963.375! [2023-12-25 23:43:08,796][123007] Saving new best policy, reward=3058.307! [2023-12-25 23:43:09,164][123090] Updated weights for policy 1, policy_version 18660 (0.0006) [2023-12-25 23:43:09,230][123090] Updated weights for policy 1, policy_version 18670 (0.0007) [2023-12-25 23:43:09,258][123091] Updated weights for policy 0, policy_version 18723 (0.0006) [2023-12-25 23:43:09,296][123090] Updated weights for policy 1, policy_version 18680 (0.0011) [2023-12-25 23:43:09,315][123091] Updated weights for policy 0, policy_version 18733 (0.0009) [2023-12-25 23:43:09,377][123091] Updated weights for policy 0, policy_version 18743 (0.0009) [2023-12-25 23:43:10,111][123090] Updated weights for policy 1, policy_version 18690 (0.0010) [2023-12-25 23:43:10,170][123090] Updated weights for policy 1, policy_version 18700 (0.0009) [2023-12-25 23:43:10,174][123091] Updated weights for policy 0, policy_version 18753 (0.0009) [2023-12-25 23:43:10,230][123090] Updated weights for policy 1, policy_version 18710 (0.0008) [2023-12-25 23:43:10,241][123091] Updated weights for policy 0, policy_version 18763 (0.0008) [2023-12-25 23:43:10,298][123090] Updated weights for policy 1, policy_version 18720 (0.0008) [2023-12-25 23:43:10,307][123091] Updated weights for policy 0, policy_version 18773 (0.0008) [2023-12-25 23:43:10,370][123091] Updated weights for policy 0, policy_version 18783 (0.0007) [2023-12-25 23:43:11,073][123091] Updated weights for policy 0, policy_version 18793 (0.0006) [2023-12-25 23:43:11,139][123091] Updated weights for policy 0, policy_version 18803 (0.0006) [2023-12-25 23:43:11,185][123090] Updated weights for policy 1, policy_version 18730 (0.0008) [2023-12-25 23:43:11,213][123091] Updated weights for policy 0, policy_version 18813 (0.0007) [2023-12-25 23:43:11,262][123090] Updated weights for policy 1, policy_version 18740 (0.0006) [2023-12-25 23:43:11,337][123090] Updated weights for policy 1, policy_version 18750 (0.0006) [2023-12-25 23:43:11,966][123091] Updated weights for policy 0, policy_version 18823 (0.0008) [2023-12-25 23:43:12,024][123091] Updated weights for policy 0, policy_version 18833 (0.0010) [2023-12-25 23:43:12,083][123091] Updated weights for policy 0, policy_version 18843 (0.0009) [2023-12-25 23:43:12,139][123090] Updated weights for policy 1, policy_version 18760 (0.0009) [2023-12-25 23:43:12,198][123090] Updated weights for policy 1, policy_version 18770 (0.0009) [2023-12-25 23:43:12,254][123090] Updated weights for policy 1, policy_version 18780 (0.0009) [2023-12-25 23:43:13,016][123091] Updated weights for policy 0, policy_version 18853 (0.0009) [2023-12-25 23:43:13,049][123090] Updated weights for policy 1, policy_version 18790 (0.0010) [2023-12-25 23:43:13,064][123091] Updated weights for policy 0, policy_version 18863 (0.0006) [2023-12-25 23:43:13,111][123090] Updated weights for policy 1, policy_version 18800 (0.0010) [2023-12-25 23:43:13,130][123091] Updated weights for policy 0, policy_version 18873 (0.0007) [2023-12-25 23:43:13,177][123090] Updated weights for policy 1, policy_version 18810 (0.0010) [2023-12-25 23:43:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 9650176. Throughput: 0: 8883.8, 1: 8925.8. Samples: 9646972. Policy #0 lag: (min: 11.0, avg: 23.0, max: 43.0) [2023-12-25 23:43:13,785][121949] Avg episode reward: [(0, '3056.182'), (1, '4075.842')] [2023-12-25 23:43:13,786][123008] Saving new best policy, reward=4075.842! [2023-12-25 23:43:13,943][123090] Updated weights for policy 1, policy_version 18820 (0.0008) [2023-12-25 23:43:13,964][123091] Updated weights for policy 0, policy_version 18883 (0.0008) [2023-12-25 23:43:14,012][123090] Updated weights for policy 1, policy_version 18830 (0.0005) [2023-12-25 23:43:14,027][123091] Updated weights for policy 0, policy_version 18893 (0.0011) [2023-12-25 23:43:14,078][123091] Updated weights for policy 0, policy_version 18903 (0.0010) [2023-12-25 23:43:14,103][123090] Updated weights for policy 1, policy_version 18840 (0.0006) [2023-12-25 23:43:14,860][123091] Updated weights for policy 0, policy_version 18913 (0.0010) [2023-12-25 23:43:14,889][123090] Updated weights for policy 1, policy_version 18850 (0.0008) [2023-12-25 23:43:14,926][123091] Updated weights for policy 0, policy_version 18923 (0.0009) [2023-12-25 23:43:14,940][123090] Updated weights for policy 1, policy_version 18860 (0.0008) [2023-12-25 23:43:14,987][123091] Updated weights for policy 0, policy_version 18933 (0.0008) [2023-12-25 23:43:15,003][123090] Updated weights for policy 1, policy_version 18870 (0.0009) [2023-12-25 23:43:15,045][123091] Updated weights for policy 0, policy_version 18943 (0.0009) [2023-12-25 23:43:15,066][123090] Updated weights for policy 1, policy_version 18880 (0.0008) [2023-12-25 23:43:15,827][123090] Updated weights for policy 1, policy_version 18890 (0.0006) [2023-12-25 23:43:15,846][123091] Updated weights for policy 0, policy_version 18953 (0.0008) [2023-12-25 23:43:15,890][123090] Updated weights for policy 1, policy_version 18900 (0.0005) [2023-12-25 23:43:15,916][123091] Updated weights for policy 0, policy_version 18963 (0.0008) [2023-12-25 23:43:15,946][123090] Updated weights for policy 1, policy_version 18910 (0.0005) [2023-12-25 23:43:15,990][123091] Updated weights for policy 0, policy_version 18973 (0.0009) [2023-12-25 23:43:16,677][123090] Updated weights for policy 1, policy_version 18920 (0.0009) [2023-12-25 23:43:16,726][123090] Updated weights for policy 1, policy_version 18930 (0.0009) [2023-12-25 23:43:16,773][123090] Updated weights for policy 1, policy_version 18940 (0.0008) [2023-12-25 23:43:16,791][123091] Updated weights for policy 0, policy_version 18983 (0.0008) [2023-12-25 23:43:16,856][123091] Updated weights for policy 0, policy_version 18993 (0.0009) [2023-12-25 23:43:16,922][123091] Updated weights for policy 0, policy_version 19003 (0.0009) [2023-12-25 23:43:17,613][123090] Updated weights for policy 1, policy_version 18950 (0.0008) [2023-12-25 23:43:17,670][123090] Updated weights for policy 1, policy_version 18960 (0.0010) [2023-12-25 23:43:17,732][123091] Updated weights for policy 0, policy_version 19013 (0.0009) [2023-12-25 23:43:17,733][123090] Updated weights for policy 1, policy_version 18970 (0.0008) [2023-12-25 23:43:17,793][123091] Updated weights for policy 0, policy_version 19023 (0.0010) [2023-12-25 23:43:17,847][123091] Updated weights for policy 0, policy_version 19033 (0.0009) [2023-12-25 23:43:18,594][123090] Updated weights for policy 1, policy_version 18980 (0.0006) [2023-12-25 23:43:18,650][123091] Updated weights for policy 0, policy_version 19043 (0.0009) [2023-12-25 23:43:18,654][123090] Updated weights for policy 1, policy_version 18990 (0.0005) [2023-12-25 23:43:18,700][123091] Updated weights for policy 0, policy_version 19053 (0.0009) [2023-12-25 23:43:18,708][123090] Updated weights for policy 1, policy_version 19000 (0.0006) [2023-12-25 23:43:18,769][123091] Updated weights for policy 0, policy_version 19063 (0.0009) [2023-12-25 23:43:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 9740288. Throughput: 0: 8844.8, 1: 8864.8. Samples: 9753356. Policy #0 lag: (min: 11.0, avg: 23.0, max: 43.0) [2023-12-25 23:43:18,785][121949] Avg episode reward: [(0, '3318.995'), (1, '3961.124')] [2023-12-25 23:43:18,812][123007] Saving new best policy, reward=3318.995! [2023-12-25 23:43:19,337][123090] Updated weights for policy 1, policy_version 19010 (0.0006) [2023-12-25 23:43:19,408][123090] Updated weights for policy 1, policy_version 19020 (0.0007) [2023-12-25 23:43:19,474][123090] Updated weights for policy 1, policy_version 19030 (0.0006) [2023-12-25 23:43:19,541][123090] Updated weights for policy 1, policy_version 19040 (0.0006) [2023-12-25 23:43:19,704][123091] Updated weights for policy 0, policy_version 19073 (0.0009) [2023-12-25 23:43:19,771][123091] Updated weights for policy 0, policy_version 19083 (0.0010) [2023-12-25 23:43:19,839][123091] Updated weights for policy 0, policy_version 19093 (0.0010) [2023-12-25 23:43:19,899][123091] Updated weights for policy 0, policy_version 19103 (0.0009) [2023-12-25 23:43:20,269][123090] Updated weights for policy 1, policy_version 19050 (0.0010) [2023-12-25 23:43:20,326][123090] Updated weights for policy 1, policy_version 19060 (0.0009) [2023-12-25 23:43:20,378][123090] Updated weights for policy 1, policy_version 19070 (0.0009) [2023-12-25 23:43:20,768][123091] Updated weights for policy 0, policy_version 19113 (0.0009) [2023-12-25 23:43:20,826][123091] Updated weights for policy 0, policy_version 19123 (0.0009) [2023-12-25 23:43:20,883][123091] Updated weights for policy 0, policy_version 19133 (0.0009) [2023-12-25 23:43:21,249][123090] Updated weights for policy 1, policy_version 19080 (0.0009) [2023-12-25 23:43:21,315][123090] Updated weights for policy 1, policy_version 19090 (0.0009) [2023-12-25 23:43:21,391][123090] Updated weights for policy 1, policy_version 19100 (0.0010) [2023-12-25 23:43:21,759][123091] Updated weights for policy 0, policy_version 19143 (0.0010) [2023-12-25 23:43:21,830][123091] Updated weights for policy 0, policy_version 19153 (0.0010) [2023-12-25 23:43:21,900][123091] Updated weights for policy 0, policy_version 19163 (0.0010) [2023-12-25 23:43:22,208][123090] Updated weights for policy 1, policy_version 19110 (0.0010) [2023-12-25 23:43:22,270][123090] Updated weights for policy 1, policy_version 19120 (0.0009) [2023-12-25 23:43:22,335][123090] Updated weights for policy 1, policy_version 19130 (0.0007) [2023-12-25 23:43:22,758][123091] Updated weights for policy 0, policy_version 19173 (0.0008) [2023-12-25 23:43:22,813][123091] Updated weights for policy 0, policy_version 19183 (0.0005) [2023-12-25 23:43:22,876][123091] Updated weights for policy 0, policy_version 19193 (0.0005) [2023-12-25 23:43:23,126][123090] Updated weights for policy 1, policy_version 19140 (0.0009) [2023-12-25 23:43:23,178][123090] Updated weights for policy 1, policy_version 19150 (0.0009) [2023-12-25 23:43:23,227][123090] Updated weights for policy 1, policy_version 19160 (0.0010) [2023-12-25 23:43:23,460][123091] Updated weights for policy 0, policy_version 19203 (0.0008) [2023-12-25 23:43:23,522][123091] Updated weights for policy 0, policy_version 19213 (0.0005) [2023-12-25 23:43:23,587][123091] Updated weights for policy 0, policy_version 19223 (0.0005) [2023-12-25 23:43:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 9830400. Throughput: 0: 8839.1, 1: 8865.4. Samples: 9804140. Policy #0 lag: (min: 18.0, avg: 28.6, max: 50.0) [2023-12-25 23:43:23,785][121949] Avg episode reward: [(0, '3350.464'), (1, '3988.716')] [2023-12-25 23:43:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000019232_4923392.pth... [2023-12-25 23:43:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000019168_4907008.pth... [2023-12-25 23:43:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000018112_4636672.pth [2023-12-25 23:43:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000018208_4661248.pth [2023-12-25 23:43:23,793][123007] Saving new best policy, reward=3350.464! [2023-12-25 23:43:24,033][123090] Updated weights for policy 1, policy_version 19170 (0.0009) [2023-12-25 23:43:24,086][123090] Updated weights for policy 1, policy_version 19180 (0.0005) [2023-12-25 23:43:24,133][123090] Updated weights for policy 1, policy_version 19190 (0.0005) [2023-12-25 23:43:24,177][123091] Updated weights for policy 0, policy_version 19233 (0.0005) [2023-12-25 23:43:24,183][123090] Updated weights for policy 1, policy_version 19200 (0.0006) [2023-12-25 23:43:24,236][123091] Updated weights for policy 0, policy_version 19243 (0.0005) [2023-12-25 23:43:24,291][123091] Updated weights for policy 0, policy_version 19253 (0.0006) [2023-12-25 23:43:24,352][123091] Updated weights for policy 0, policy_version 19263 (0.0008) [2023-12-25 23:43:24,841][123090] Updated weights for policy 1, policy_version 19210 (0.0005) [2023-12-25 23:43:24,913][123090] Updated weights for policy 1, policy_version 19220 (0.0005) [2023-12-25 23:43:24,985][123090] Updated weights for policy 1, policy_version 19230 (0.0005) [2023-12-25 23:43:25,217][123091] Updated weights for policy 0, policy_version 19273 (0.0009) [2023-12-25 23:43:25,274][123091] Updated weights for policy 0, policy_version 19283 (0.0010) [2023-12-25 23:43:25,332][123091] Updated weights for policy 0, policy_version 19293 (0.0009) [2023-12-25 23:43:25,598][123090] Updated weights for policy 1, policy_version 19240 (0.0005) [2023-12-25 23:43:25,668][123090] Updated weights for policy 1, policy_version 19250 (0.0005) [2023-12-25 23:43:25,740][123090] Updated weights for policy 1, policy_version 19260 (0.0007) [2023-12-25 23:43:26,183][123091] Updated weights for policy 0, policy_version 19303 (0.0009) [2023-12-25 23:43:26,231][123091] Updated weights for policy 0, policy_version 19313 (0.0009) [2023-12-25 23:43:26,279][123091] Updated weights for policy 0, policy_version 19323 (0.0009) [2023-12-25 23:43:26,501][123090] Updated weights for policy 1, policy_version 19270 (0.0010) [2023-12-25 23:43:26,568][123090] Updated weights for policy 1, policy_version 19280 (0.0011) [2023-12-25 23:43:26,629][123090] Updated weights for policy 1, policy_version 19290 (0.0010) [2023-12-25 23:43:27,134][123091] Updated weights for policy 0, policy_version 19333 (0.0009) [2023-12-25 23:43:27,195][123091] Updated weights for policy 0, policy_version 19343 (0.0008) [2023-12-25 23:43:27,253][123091] Updated weights for policy 0, policy_version 19353 (0.0009) [2023-12-25 23:43:27,417][123090] Updated weights for policy 1, policy_version 19300 (0.0007) [2023-12-25 23:43:27,472][123090] Updated weights for policy 1, policy_version 19310 (0.0010) [2023-12-25 23:43:27,536][123090] Updated weights for policy 1, policy_version 19320 (0.0005) [2023-12-25 23:43:27,975][123091] Updated weights for policy 0, policy_version 19363 (0.0008) [2023-12-25 23:43:28,037][123091] Updated weights for policy 0, policy_version 19373 (0.0005) [2023-12-25 23:43:28,110][123091] Updated weights for policy 0, policy_version 19383 (0.0007) [2023-12-25 23:43:28,229][123090] Updated weights for policy 1, policy_version 19330 (0.0006) [2023-12-25 23:43:28,285][123090] Updated weights for policy 1, policy_version 19340 (0.0008) [2023-12-25 23:43:28,358][123090] Updated weights for policy 1, policy_version 19350 (0.0007) [2023-12-25 23:43:28,420][123090] Updated weights for policy 1, policy_version 19360 (0.0008) [2023-12-25 23:43:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 9920512. Throughput: 0: 8868.4, 1: 8983.4. Samples: 9913380. Policy #0 lag: (min: 18.0, avg: 28.6, max: 50.0) [2023-12-25 23:43:28,785][121949] Avg episode reward: [(0, '3293.853'), (1, '4015.896')] [2023-12-25 23:43:28,896][123091] Updated weights for policy 0, policy_version 19393 (0.0009) [2023-12-25 23:43:28,949][123091] Updated weights for policy 0, policy_version 19403 (0.0010) [2023-12-25 23:43:29,001][123091] Updated weights for policy 0, policy_version 19415 (0.0010) [2023-12-25 23:43:29,174][123090] Updated weights for policy 1, policy_version 19370 (0.0010) [2023-12-25 23:43:29,233][123090] Updated weights for policy 1, policy_version 19380 (0.0010) [2023-12-25 23:43:29,300][123090] Updated weights for policy 1, policy_version 19390 (0.0011) [2023-12-25 23:43:29,793][123091] Updated weights for policy 0, policy_version 19425 (0.0008) [2023-12-25 23:43:29,856][123091] Updated weights for policy 0, policy_version 19435 (0.0006) [2023-12-25 23:43:29,911][123091] Updated weights for policy 0, policy_version 19445 (0.0005) [2023-12-25 23:43:29,977][123091] Updated weights for policy 0, policy_version 19455 (0.0010) [2023-12-25 23:43:30,161][123090] Updated weights for policy 1, policy_version 19400 (0.0011) [2023-12-25 23:43:30,224][123090] Updated weights for policy 1, policy_version 19410 (0.0010) [2023-12-25 23:43:30,295][123090] Updated weights for policy 1, policy_version 19420 (0.0011) [2023-12-25 23:43:30,595][123091] Updated weights for policy 0, policy_version 19465 (0.0006) [2023-12-25 23:43:30,652][123091] Updated weights for policy 0, policy_version 19475 (0.0006) [2023-12-25 23:43:30,710][123091] Updated weights for policy 0, policy_version 19485 (0.0006) [2023-12-25 23:43:31,101][123090] Updated weights for policy 1, policy_version 19430 (0.0008) [2023-12-25 23:43:31,171][123090] Updated weights for policy 1, policy_version 19440 (0.0007) [2023-12-25 23:43:31,230][123090] Updated weights for policy 1, policy_version 19450 (0.0005) [2023-12-25 23:43:31,459][123091] Updated weights for policy 0, policy_version 19495 (0.0009) [2023-12-25 23:43:31,513][123091] Updated weights for policy 0, policy_version 19505 (0.0010) [2023-12-25 23:43:31,576][123091] Updated weights for policy 0, policy_version 19515 (0.0011) [2023-12-25 23:43:31,967][123090] Updated weights for policy 1, policy_version 19460 (0.0007) [2023-12-25 23:43:32,024][123090] Updated weights for policy 1, policy_version 19470 (0.0005) [2023-12-25 23:43:32,086][123090] Updated weights for policy 1, policy_version 19480 (0.0005) [2023-12-25 23:43:32,413][123091] Updated weights for policy 0, policy_version 19525 (0.0010) [2023-12-25 23:43:32,461][123091] Updated weights for policy 0, policy_version 19535 (0.0011) [2023-12-25 23:43:32,509][123091] Updated weights for policy 0, policy_version 19545 (0.0010) [2023-12-25 23:43:32,755][123090] Updated weights for policy 1, policy_version 19490 (0.0006) [2023-12-25 23:43:32,816][123090] Updated weights for policy 1, policy_version 19500 (0.0005) [2023-12-25 23:43:32,871][123090] Updated weights for policy 1, policy_version 19510 (0.0005) [2023-12-25 23:43:32,928][123090] Updated weights for policy 1, policy_version 19520 (0.0005) [2023-12-25 23:43:33,293][123091] Updated weights for policy 0, policy_version 19555 (0.0010) [2023-12-25 23:43:33,359][123091] Updated weights for policy 0, policy_version 19565 (0.0011) [2023-12-25 23:43:33,408][123091] Updated weights for policy 0, policy_version 19575 (0.0009) [2023-12-25 23:43:33,564][123090] Updated weights for policy 1, policy_version 19530 (0.0005) [2023-12-25 23:43:33,626][123090] Updated weights for policy 1, policy_version 19540 (0.0005) [2023-12-25 23:43:33,676][123090] Updated weights for policy 1, policy_version 19550 (0.0006) [2023-12-25 23:43:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 10018816. Throughput: 0: 8831.6, 1: 9018.8. Samples: 10025680. Policy #0 lag: (min: 18.0, avg: 28.6, max: 50.0) [2023-12-25 23:43:33,785][121949] Avg episode reward: [(0, '3337.785'), (1, '3943.114')] [2023-12-25 23:43:34,206][123091] Updated weights for policy 0, policy_version 19585 (0.0006) [2023-12-25 23:43:34,258][123091] Updated weights for policy 0, policy_version 19595 (0.0010) [2023-12-25 23:43:34,315][123091] Updated weights for policy 0, policy_version 19605 (0.0005) [2023-12-25 23:43:34,371][123091] Updated weights for policy 0, policy_version 19615 (0.0006) [2023-12-25 23:43:34,426][123090] Updated weights for policy 1, policy_version 19560 (0.0005) [2023-12-25 23:43:34,497][123090] Updated weights for policy 1, policy_version 19570 (0.0005) [2023-12-25 23:43:34,566][123090] Updated weights for policy 1, policy_version 19580 (0.0006) [2023-12-25 23:43:35,157][123091] Updated weights for policy 0, policy_version 19625 (0.0006) [2023-12-25 23:43:35,224][123091] Updated weights for policy 0, policy_version 19635 (0.0009) [2023-12-25 23:43:35,281][123091] Updated weights for policy 0, policy_version 19645 (0.0008) [2023-12-25 23:43:35,284][123090] Updated weights for policy 1, policy_version 19590 (0.0007) [2023-12-25 23:43:35,349][123090] Updated weights for policy 1, policy_version 19600 (0.0009) [2023-12-25 23:43:35,415][123090] Updated weights for policy 1, policy_version 19610 (0.0010) [2023-12-25 23:43:36,135][123090] Updated weights for policy 1, policy_version 19620 (0.0006) [2023-12-25 23:43:36,148][123091] Updated weights for policy 0, policy_version 19655 (0.0010) [2023-12-25 23:43:36,202][123090] Updated weights for policy 1, policy_version 19630 (0.0008) [2023-12-25 23:43:36,214][123091] Updated weights for policy 0, policy_version 19665 (0.0008) [2023-12-25 23:43:36,270][123090] Updated weights for policy 1, policy_version 19640 (0.0005) [2023-12-25 23:43:36,275][123091] Updated weights for policy 0, policy_version 19675 (0.0009) [2023-12-25 23:43:37,034][123090] Updated weights for policy 1, policy_version 19650 (0.0005) [2023-12-25 23:43:37,090][123090] Updated weights for policy 1, policy_version 19660 (0.0005) [2023-12-25 23:43:37,148][123091] Updated weights for policy 0, policy_version 19685 (0.0009) [2023-12-25 23:43:37,155][123090] Updated weights for policy 1, policy_version 19670 (0.0005) [2023-12-25 23:43:37,204][123091] Updated weights for policy 0, policy_version 19695 (0.0009) [2023-12-25 23:43:37,221][123090] Updated weights for policy 1, policy_version 19680 (0.0006) [2023-12-25 23:43:37,267][123091] Updated weights for policy 0, policy_version 19705 (0.0009) [2023-12-25 23:43:37,919][123090] Updated weights for policy 1, policy_version 19690 (0.0005) [2023-12-25 23:43:37,982][123090] Updated weights for policy 1, policy_version 19700 (0.0007) [2023-12-25 23:43:38,043][123090] Updated weights for policy 1, policy_version 19710 (0.0009) [2023-12-25 23:43:38,130][123091] Updated weights for policy 0, policy_version 19715 (0.0007) [2023-12-25 23:43:38,187][123091] Updated weights for policy 0, policy_version 19725 (0.0005) [2023-12-25 23:43:38,233][123091] Updated weights for policy 0, policy_version 19735 (0.0005) [2023-12-25 23:43:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 10100736. Throughput: 0: 8791.4, 1: 9096.5. Samples: 10079912. Policy #0 lag: (min: 24.0, avg: 51.4, max: 56.0) [2023-12-25 23:43:38,785][121949] Avg episode reward: [(0, '3269.128'), (1, '3990.949')] [2023-12-25 23:43:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000019744_5054464.pth... [2023-12-25 23:43:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000019712_5046272.pth... [2023-12-25 23:43:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000018720_4792320.pth [2023-12-25 23:43:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000018656_4775936.pth [2023-12-25 23:43:38,894][123090] Updated weights for policy 1, policy_version 19720 (0.0006) [2023-12-25 23:43:38,953][123090] Updated weights for policy 1, policy_version 19730 (0.0006) [2023-12-25 23:43:39,011][123090] Updated weights for policy 1, policy_version 19740 (0.0009) [2023-12-25 23:43:39,025][123091] Updated weights for policy 0, policy_version 19745 (0.0006) [2023-12-25 23:43:39,080][123091] Updated weights for policy 0, policy_version 19755 (0.0009) [2023-12-25 23:43:39,133][123091] Updated weights for policy 0, policy_version 19765 (0.0009) [2023-12-25 23:43:39,195][123091] Updated weights for policy 0, policy_version 19775 (0.0009) [2023-12-25 23:43:39,883][123090] Updated weights for policy 1, policy_version 19750 (0.0008) [2023-12-25 23:43:39,952][123090] Updated weights for policy 1, policy_version 19760 (0.0010) [2023-12-25 23:43:40,017][123090] Updated weights for policy 1, policy_version 19770 (0.0009) [2023-12-25 23:43:40,068][123091] Updated weights for policy 0, policy_version 19785 (0.0007) [2023-12-25 23:43:40,136][123091] Updated weights for policy 0, policy_version 19796 (0.0009) [2023-12-25 23:43:40,199][123091] Updated weights for policy 0, policy_version 19806 (0.0010) [2023-12-25 23:43:40,919][123090] Updated weights for policy 1, policy_version 19780 (0.0009) [2023-12-25 23:43:40,928][123091] Updated weights for policy 0, policy_version 19816 (0.0010) [2023-12-25 23:43:40,970][123090] Updated weights for policy 1, policy_version 19790 (0.0008) [2023-12-25 23:43:40,982][123091] Updated weights for policy 0, policy_version 19826 (0.0008) [2023-12-25 23:43:41,028][123090] Updated weights for policy 1, policy_version 19800 (0.0008) [2023-12-25 23:43:41,045][123091] Updated weights for policy 0, policy_version 19836 (0.0007) [2023-12-25 23:43:41,844][123091] Updated weights for policy 0, policy_version 19846 (0.0007) [2023-12-25 23:43:41,902][123091] Updated weights for policy 0, policy_version 19856 (0.0008) [2023-12-25 23:43:41,917][123090] Updated weights for policy 1, policy_version 19810 (0.0009) [2023-12-25 23:43:41,962][123091] Updated weights for policy 0, policy_version 19866 (0.0008) [2023-12-25 23:43:41,971][123090] Updated weights for policy 1, policy_version 19820 (0.0008) [2023-12-25 23:43:42,041][123090] Updated weights for policy 1, policy_version 19830 (0.0008) [2023-12-25 23:43:42,106][123090] Updated weights for policy 1, policy_version 19840 (0.0008) [2023-12-25 23:43:42,803][123091] Updated weights for policy 0, policy_version 19876 (0.0008) [2023-12-25 23:43:42,873][123091] Updated weights for policy 0, policy_version 19886 (0.0007) [2023-12-25 23:43:42,895][123090] Updated weights for policy 1, policy_version 19850 (0.0009) [2023-12-25 23:43:42,934][123091] Updated weights for policy 0, policy_version 19896 (0.0008) [2023-12-25 23:43:42,957][123090] Updated weights for policy 1, policy_version 19860 (0.0006) [2023-12-25 23:43:43,021][123090] Updated weights for policy 1, policy_version 19870 (0.0008) [2023-12-25 23:43:43,646][123091] Updated weights for policy 0, policy_version 19906 (0.0008) [2023-12-25 23:43:43,701][123091] Updated weights for policy 0, policy_version 19916 (0.0005) [2023-12-25 23:43:43,773][123091] Updated weights for policy 0, policy_version 19926 (0.0005) [2023-12-25 23:43:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 10182656. Throughput: 0: 8791.7, 1: 9008.3. Samples: 10183468. Policy #0 lag: (min: 24.0, avg: 51.4, max: 56.0) [2023-12-25 23:43:43,784][121949] Avg episode reward: [(0, '3277.173'), (1, '4061.547')] [2023-12-25 23:43:43,827][123090] Updated weights for policy 1, policy_version 19880 (0.0009) [2023-12-25 23:43:43,835][123091] Updated weights for policy 0, policy_version 19936 (0.0005) [2023-12-25 23:43:43,893][123090] Updated weights for policy 1, policy_version 19890 (0.0010) [2023-12-25 23:43:43,958][123090] Updated weights for policy 1, policy_version 19900 (0.0009) [2023-12-25 23:43:44,598][123091] Updated weights for policy 0, policy_version 19946 (0.0009) [2023-12-25 23:43:44,667][123091] Updated weights for policy 0, policy_version 19956 (0.0009) [2023-12-25 23:43:44,722][123090] Updated weights for policy 1, policy_version 19910 (0.0007) [2023-12-25 23:43:44,728][123091] Updated weights for policy 0, policy_version 19966 (0.0008) [2023-12-25 23:43:44,797][123090] Updated weights for policy 1, policy_version 19920 (0.0009) [2023-12-25 23:43:44,869][123090] Updated weights for policy 1, policy_version 19930 (0.0007) [2023-12-25 23:43:45,538][123091] Updated weights for policy 0, policy_version 19976 (0.0010) [2023-12-25 23:43:45,591][123091] Updated weights for policy 0, policy_version 19987 (0.0010) [2023-12-25 23:43:45,632][123090] Updated weights for policy 1, policy_version 19940 (0.0007) [2023-12-25 23:43:45,653][123091] Updated weights for policy 0, policy_version 19997 (0.0009) [2023-12-25 23:43:45,682][123090] Updated weights for policy 1, policy_version 19950 (0.0006) [2023-12-25 23:43:45,737][123090] Updated weights for policy 1, policy_version 19960 (0.0005) [2023-12-25 23:43:46,430][123090] Updated weights for policy 1, policy_version 19970 (0.0006) [2023-12-25 23:43:46,492][123090] Updated weights for policy 1, policy_version 19980 (0.0005) [2023-12-25 23:43:46,547][123090] Updated weights for policy 1, policy_version 19990 (0.0006) [2023-12-25 23:43:46,595][123091] Updated weights for policy 0, policy_version 20007 (0.0008) [2023-12-25 23:43:46,600][123090] Updated weights for policy 1, policy_version 20000 (0.0009) [2023-12-25 23:43:46,654][123091] Updated weights for policy 0, policy_version 20017 (0.0009) [2023-12-25 23:43:46,714][123091] Updated weights for policy 0, policy_version 20027 (0.0009) [2023-12-25 23:43:47,408][123090] Updated weights for policy 1, policy_version 20010 (0.0006) [2023-12-25 23:43:47,465][123090] Updated weights for policy 1, policy_version 20020 (0.0006) [2023-12-25 23:43:47,528][123090] Updated weights for policy 1, policy_version 20030 (0.0005) [2023-12-25 23:43:47,558][123091] Updated weights for policy 0, policy_version 20037 (0.0009) [2023-12-25 23:43:47,612][123091] Updated weights for policy 0, policy_version 20048 (0.0010) [2023-12-25 23:43:47,665][123091] Updated weights for policy 0, policy_version 20058 (0.0009) [2023-12-25 23:43:48,125][123090] Updated weights for policy 1, policy_version 20040 (0.0008) [2023-12-25 23:43:48,181][123090] Updated weights for policy 1, policy_version 20050 (0.0005) [2023-12-25 23:43:48,236][123090] Updated weights for policy 1, policy_version 20060 (0.0005) [2023-12-25 23:43:48,584][123091] Updated weights for policy 0, policy_version 20068 (0.0010) [2023-12-25 23:43:48,656][123091] Updated weights for policy 0, policy_version 20078 (0.0009) [2023-12-25 23:43:48,728][123091] Updated weights for policy 0, policy_version 20088 (0.0009) [2023-12-25 23:43:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 10272768. Throughput: 0: 8720.1, 1: 9072.7. Samples: 10290496. Policy #0 lag: (min: 24.0, avg: 51.4, max: 56.0) [2023-12-25 23:43:48,785][121949] Avg episode reward: [(0, '3265.861'), (1, '4026.205')] [2023-12-25 23:43:48,869][123090] Updated weights for policy 1, policy_version 20070 (0.0005) [2023-12-25 23:43:48,935][123090] Updated weights for policy 1, policy_version 20080 (0.0006) [2023-12-25 23:43:49,002][123090] Updated weights for policy 1, policy_version 20090 (0.0011) [2023-12-25 23:43:49,577][123091] Updated weights for policy 0, policy_version 20098 (0.0009) [2023-12-25 23:43:49,640][123091] Updated weights for policy 0, policy_version 20108 (0.0007) [2023-12-25 23:43:49,703][123091] Updated weights for policy 0, policy_version 20118 (0.0008) [2023-12-25 23:43:49,766][123091] Updated weights for policy 0, policy_version 20128 (0.0006) [2023-12-25 23:43:49,801][123090] Updated weights for policy 1, policy_version 20100 (0.0010) [2023-12-25 23:43:49,872][123090] Updated weights for policy 1, policy_version 20110 (0.0008) [2023-12-25 23:43:49,936][123090] Updated weights for policy 1, policy_version 20120 (0.0010) [2023-12-25 23:43:50,541][123091] Updated weights for policy 0, policy_version 20138 (0.0009) [2023-12-25 23:43:50,615][123091] Updated weights for policy 0, policy_version 20148 (0.0009) [2023-12-25 23:43:50,671][123091] Updated weights for policy 0, policy_version 20158 (0.0009) [2023-12-25 23:43:50,794][123090] Updated weights for policy 1, policy_version 20130 (0.0011) [2023-12-25 23:43:50,842][123090] Updated weights for policy 1, policy_version 20140 (0.0010) [2023-12-25 23:43:50,902][123090] Updated weights for policy 1, policy_version 20150 (0.0010) [2023-12-25 23:43:50,954][123090] Updated weights for policy 1, policy_version 20160 (0.0011) [2023-12-25 23:43:51,528][123091] Updated weights for policy 0, policy_version 20168 (0.0009) [2023-12-25 23:43:51,583][123091] Updated weights for policy 0, policy_version 20178 (0.0008) [2023-12-25 23:43:51,651][123091] Updated weights for policy 0, policy_version 20188 (0.0009) [2023-12-25 23:43:51,797][123090] Updated weights for policy 1, policy_version 20170 (0.0008) [2023-12-25 23:43:51,869][123090] Updated weights for policy 1, policy_version 20180 (0.0008) [2023-12-25 23:43:51,940][123090] Updated weights for policy 1, policy_version 20190 (0.0009) [2023-12-25 23:43:52,531][123091] Updated weights for policy 0, policy_version 20198 (0.0010) [2023-12-25 23:43:52,595][123091] Updated weights for policy 0, policy_version 20208 (0.0010) [2023-12-25 23:43:52,654][123091] Updated weights for policy 0, policy_version 20218 (0.0010) [2023-12-25 23:43:52,701][123090] Updated weights for policy 1, policy_version 20200 (0.0008) [2023-12-25 23:43:52,764][123090] Updated weights for policy 1, policy_version 20210 (0.0009) [2023-12-25 23:43:52,829][123090] Updated weights for policy 1, policy_version 20220 (0.0009) [2023-12-25 23:43:53,445][123091] Updated weights for policy 0, policy_version 20228 (0.0008) [2023-12-25 23:43:53,498][123091] Updated weights for policy 0, policy_version 20238 (0.0006) [2023-12-25 23:43:53,551][123091] Updated weights for policy 0, policy_version 20248 (0.0005) [2023-12-25 23:43:53,710][123090] Updated weights for policy 1, policy_version 20230 (0.0009) [2023-12-25 23:43:53,762][123090] Updated weights for policy 1, policy_version 20240 (0.0009) [2023-12-25 23:43:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 10362880. Throughput: 0: 8723.4, 1: 9039.7. Samples: 10341420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:43:53,786][121949] Avg episode reward: [(0, '3313.808'), (1, '3958.499')] [2023-12-25 23:43:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000020256_5185536.pth... [2023-12-25 23:43:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000019232_4923392.pth [2023-12-25 23:43:53,825][123090] Updated weights for policy 1, policy_version 20250 (0.0010) [2023-12-25 23:43:53,851][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000020256_5185536.pth... [2023-12-25 23:43:53,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000019168_4907008.pth [2023-12-25 23:43:54,198][123091] Updated weights for policy 0, policy_version 20258 (0.0005) [2023-12-25 23:43:54,256][123091] Updated weights for policy 0, policy_version 20268 (0.0005) [2023-12-25 23:43:54,302][123091] Updated weights for policy 0, policy_version 20278 (0.0005) [2023-12-25 23:43:54,358][123091] Updated weights for policy 0, policy_version 20288 (0.0005) [2023-12-25 23:43:54,669][123090] Updated weights for policy 1, policy_version 20260 (0.0010) [2023-12-25 23:43:54,732][123090] Updated weights for policy 1, policy_version 20270 (0.0010) [2023-12-25 23:43:54,788][123090] Updated weights for policy 1, policy_version 20280 (0.0010) [2023-12-25 23:43:55,065][123091] Updated weights for policy 0, policy_version 20298 (0.0010) [2023-12-25 23:43:55,124][123091] Updated weights for policy 0, policy_version 20308 (0.0010) [2023-12-25 23:43:55,167][123091] Updated weights for policy 0, policy_version 20318 (0.0010) [2023-12-25 23:43:55,515][123090] Updated weights for policy 1, policy_version 20290 (0.0007) [2023-12-25 23:43:55,570][123090] Updated weights for policy 1, policy_version 20300 (0.0010) [2023-12-25 23:43:55,644][123090] Updated weights for policy 1, policy_version 20310 (0.0010) [2023-12-25 23:43:55,719][123090] Updated weights for policy 1, policy_version 20320 (0.0011) [2023-12-25 23:43:55,950][123091] Updated weights for policy 0, policy_version 20328 (0.0010) [2023-12-25 23:43:56,001][123091] Updated weights for policy 0, policy_version 20338 (0.0010) [2023-12-25 23:43:56,056][123091] Updated weights for policy 0, policy_version 20348 (0.0010) [2023-12-25 23:43:56,519][123090] Updated weights for policy 1, policy_version 20330 (0.0010) [2023-12-25 23:43:56,573][123090] Updated weights for policy 1, policy_version 20340 (0.0010) [2023-12-25 23:43:56,635][123090] Updated weights for policy 1, policy_version 20350 (0.0010) [2023-12-25 23:43:56,834][123091] Updated weights for policy 0, policy_version 20358 (0.0005) [2023-12-25 23:43:56,905][123091] Updated weights for policy 0, policy_version 20368 (0.0005) [2023-12-25 23:43:56,977][123091] Updated weights for policy 0, policy_version 20378 (0.0005) [2023-12-25 23:43:57,421][123090] Updated weights for policy 1, policy_version 20360 (0.0006) [2023-12-25 23:43:57,470][123090] Updated weights for policy 1, policy_version 20370 (0.0005) [2023-12-25 23:43:57,529][123090] Updated weights for policy 1, policy_version 20380 (0.0005) [2023-12-25 23:43:57,688][123091] Updated weights for policy 0, policy_version 20388 (0.0009) [2023-12-25 23:43:57,750][123091] Updated weights for policy 0, policy_version 20398 (0.0006) [2023-12-25 23:43:57,806][123091] Updated weights for policy 0, policy_version 20408 (0.0007) [2023-12-25 23:43:58,308][123090] Updated weights for policy 1, policy_version 20390 (0.0008) [2023-12-25 23:43:58,385][123090] Updated weights for policy 1, policy_version 20400 (0.0009) [2023-12-25 23:43:58,446][123090] Updated weights for policy 1, policy_version 20410 (0.0009) [2023-12-25 23:43:58,582][123091] Updated weights for policy 0, policy_version 20418 (0.0005) [2023-12-25 23:43:58,654][123091] Updated weights for policy 0, policy_version 20428 (0.0008) [2023-12-25 23:43:58,717][123091] Updated weights for policy 0, policy_version 20438 (0.0008) [2023-12-25 23:43:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 10452992. Throughput: 0: 8788.2, 1: 9057.2. Samples: 10450020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:43:58,785][121949] Avg episode reward: [(0, '3579.166'), (1, '3728.138')] [2023-12-25 23:43:58,786][123007] Saving new best policy, reward=3579.166! [2023-12-25 23:43:58,788][123091] Updated weights for policy 0, policy_version 20448 (0.0009) [2023-12-25 23:43:59,383][123090] Updated weights for policy 1, policy_version 20420 (0.0009) [2023-12-25 23:43:59,438][123090] Updated weights for policy 1, policy_version 20430 (0.0010) [2023-12-25 23:43:59,485][123090] Updated weights for policy 1, policy_version 20440 (0.0010) [2023-12-25 23:43:59,652][123091] Updated weights for policy 0, policy_version 20458 (0.0009) [2023-12-25 23:43:59,705][123091] Updated weights for policy 0, policy_version 20468 (0.0010) [2023-12-25 23:43:59,760][123091] Updated weights for policy 0, policy_version 20478 (0.0009) [2023-12-25 23:44:00,253][123090] Updated weights for policy 1, policy_version 20450 (0.0010) [2023-12-25 23:44:00,323][123090] Updated weights for policy 1, policy_version 20460 (0.0010) [2023-12-25 23:44:00,384][123090] Updated weights for policy 1, policy_version 20470 (0.0010) [2023-12-25 23:44:00,443][123090] Updated weights for policy 1, policy_version 20480 (0.0010) [2023-12-25 23:44:00,548][123091] Updated weights for policy 0, policy_version 20488 (0.0006) [2023-12-25 23:44:00,608][123091] Updated weights for policy 0, policy_version 20498 (0.0005) [2023-12-25 23:44:00,668][123091] Updated weights for policy 0, policy_version 20508 (0.0005) [2023-12-25 23:44:01,194][123090] Updated weights for policy 1, policy_version 20490 (0.0010) [2023-12-25 23:44:01,263][123090] Updated weights for policy 1, policy_version 20500 (0.0008) [2023-12-25 23:44:01,321][123090] Updated weights for policy 1, policy_version 20510 (0.0009) [2023-12-25 23:44:01,377][123091] Updated weights for policy 0, policy_version 20518 (0.0007) [2023-12-25 23:44:01,433][123091] Updated weights for policy 0, policy_version 20528 (0.0010) [2023-12-25 23:44:01,487][123091] Updated weights for policy 0, policy_version 20540 (0.0010) [2023-12-25 23:44:02,104][123090] Updated weights for policy 1, policy_version 20520 (0.0006) [2023-12-25 23:44:02,156][123090] Updated weights for policy 1, policy_version 20530 (0.0005) [2023-12-25 23:44:02,206][123090] Updated weights for policy 1, policy_version 20540 (0.0005) [2023-12-25 23:44:02,421][123091] Updated weights for policy 0, policy_version 20550 (0.0010) [2023-12-25 23:44:02,469][123091] Updated weights for policy 0, policy_version 20560 (0.0008) [2023-12-25 23:44:02,519][123091] Updated weights for policy 0, policy_version 20570 (0.0009) [2023-12-25 23:44:02,943][123090] Updated weights for policy 1, policy_version 20550 (0.0005) [2023-12-25 23:44:03,001][123090] Updated weights for policy 1, policy_version 20560 (0.0005) [2023-12-25 23:44:03,066][123090] Updated weights for policy 1, policy_version 20570 (0.0006) [2023-12-25 23:44:03,381][123091] Updated weights for policy 0, policy_version 20580 (0.0010) [2023-12-25 23:44:03,440][123091] Updated weights for policy 0, policy_version 20590 (0.0010) [2023-12-25 23:44:03,487][123091] Updated weights for policy 0, policy_version 20600 (0.0010) [2023-12-25 23:44:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 10543104. Throughput: 0: 8788.1, 1: 9047.4. Samples: 10555960. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-25 23:44:03,785][121949] Avg episode reward: [(0, '3734.786'), (1, '3818.153')] [2023-12-25 23:44:03,786][123007] Saving new best policy, reward=3734.786! [2023-12-25 23:44:03,831][123090] Updated weights for policy 1, policy_version 20581 (0.0010) [2023-12-25 23:44:03,896][123090] Updated weights for policy 1, policy_version 20591 (0.0010) [2023-12-25 23:44:03,959][123090] Updated weights for policy 1, policy_version 20601 (0.0011) [2023-12-25 23:44:04,221][123091] Updated weights for policy 0, policy_version 20610 (0.0007) [2023-12-25 23:44:04,291][123091] Updated weights for policy 0, policy_version 20620 (0.0009) [2023-12-25 23:44:04,365][123091] Updated weights for policy 0, policy_version 20630 (0.0010) [2023-12-25 23:44:04,435][123091] Updated weights for policy 0, policy_version 20640 (0.0009) [2023-12-25 23:44:04,806][123090] Updated weights for policy 1, policy_version 20611 (0.0009) [2023-12-25 23:44:04,865][123090] Updated weights for policy 1, policy_version 20621 (0.0010) [2023-12-25 23:44:04,931][123090] Updated weights for policy 1, policy_version 20631 (0.0010) [2023-12-25 23:44:05,181][123091] Updated weights for policy 0, policy_version 20650 (0.0006) [2023-12-25 23:44:05,239][123091] Updated weights for policy 0, policy_version 20660 (0.0005) [2023-12-25 23:44:05,312][123091] Updated weights for policy 0, policy_version 20670 (0.0005) [2023-12-25 23:44:05,722][123090] Updated weights for policy 1, policy_version 20641 (0.0010) [2023-12-25 23:44:05,785][123090] Updated weights for policy 1, policy_version 20651 (0.0005) [2023-12-25 23:44:05,836][123090] Updated weights for policy 1, policy_version 20661 (0.0005) [2023-12-25 23:44:05,885][123090] Updated weights for policy 1, policy_version 20671 (0.0006) [2023-12-25 23:44:05,939][123091] Updated weights for policy 0, policy_version 20680 (0.0008) [2023-12-25 23:44:05,994][123091] Updated weights for policy 0, policy_version 20690 (0.0008) [2023-12-25 23:44:06,053][123091] Updated weights for policy 0, policy_version 20700 (0.0008) [2023-12-25 23:44:06,712][123090] Updated weights for policy 1, policy_version 20681 (0.0008) [2023-12-25 23:44:06,773][123090] Updated weights for policy 1, policy_version 20691 (0.0009) [2023-12-25 23:44:06,839][123090] Updated weights for policy 1, policy_version 20701 (0.0006) [2023-12-25 23:44:06,938][123091] Updated weights for policy 0, policy_version 20710 (0.0009) [2023-12-25 23:44:06,995][123091] Updated weights for policy 0, policy_version 20721 (0.0010) [2023-12-25 23:44:07,052][123091] Updated weights for policy 0, policy_version 20731 (0.0010) [2023-12-25 23:44:07,509][123090] Updated weights for policy 1, policy_version 20711 (0.0009) [2023-12-25 23:44:07,570][123090] Updated weights for policy 1, policy_version 20721 (0.0010) [2023-12-25 23:44:07,632][123090] Updated weights for policy 1, policy_version 20731 (0.0010) [2023-12-25 23:44:07,875][123091] Updated weights for policy 0, policy_version 20741 (0.0009) [2023-12-25 23:44:07,926][123091] Updated weights for policy 0, policy_version 20751 (0.0009) [2023-12-25 23:44:07,973][123091] Updated weights for policy 0, policy_version 20761 (0.0008) [2023-12-25 23:44:08,451][123090] Updated weights for policy 1, policy_version 20741 (0.0011) [2023-12-25 23:44:08,519][123090] Updated weights for policy 1, policy_version 20751 (0.0011) [2023-12-25 23:44:08,575][123090] Updated weights for policy 1, policy_version 20761 (0.0010) [2023-12-25 23:44:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 10633216. Throughput: 0: 8872.0, 1: 9040.3. Samples: 10610192. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-25 23:44:08,785][121949] Avg episode reward: [(0, '3492.230'), (1, '3981.407')] [2023-12-25 23:44:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000020768_5316608.pth... [2023-12-25 23:44:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000019712_5046272.pth [2023-12-25 23:44:08,822][123091] Updated weights for policy 0, policy_version 20771 (0.0009) [2023-12-25 23:44:08,881][123091] Updated weights for policy 0, policy_version 20781 (0.0006) [2023-12-25 23:44:08,943][123091] Updated weights for policy 0, policy_version 20791 (0.0008) [2023-12-25 23:44:09,000][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000020800_5324800.pth... [2023-12-25 23:44:09,003][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000019744_5054464.pth [2023-12-25 23:44:09,336][123090] Updated weights for policy 1, policy_version 20771 (0.0010) [2023-12-25 23:44:09,403][123090] Updated weights for policy 1, policy_version 20781 (0.0009) [2023-12-25 23:44:09,478][123090] Updated weights for policy 1, policy_version 20791 (0.0006) [2023-12-25 23:44:09,789][123091] Updated weights for policy 0, policy_version 20801 (0.0010) [2023-12-25 23:44:09,862][123091] Updated weights for policy 0, policy_version 20811 (0.0009) [2023-12-25 23:44:09,934][123091] Updated weights for policy 0, policy_version 20821 (0.0010) [2023-12-25 23:44:09,991][123091] Updated weights for policy 0, policy_version 20831 (0.0009) [2023-12-25 23:44:10,293][123090] Updated weights for policy 1, policy_version 20801 (0.0009) [2023-12-25 23:44:10,367][123090] Updated weights for policy 1, policy_version 20811 (0.0010) [2023-12-25 23:44:10,428][123090] Updated weights for policy 1, policy_version 20821 (0.0011) [2023-12-25 23:44:10,489][123090] Updated weights for policy 1, policy_version 20831 (0.0011) [2023-12-25 23:44:10,788][123091] Updated weights for policy 0, policy_version 20841 (0.0006) [2023-12-25 23:44:10,850][123091] Updated weights for policy 0, policy_version 20851 (0.0005) [2023-12-25 23:44:10,918][123091] Updated weights for policy 0, policy_version 20861 (0.0009) [2023-12-25 23:44:11,317][123090] Updated weights for policy 1, policy_version 20841 (0.0010) [2023-12-25 23:44:11,388][123090] Updated weights for policy 1, policy_version 20851 (0.0010) [2023-12-25 23:44:11,454][123090] Updated weights for policy 1, policy_version 20861 (0.0009) [2023-12-25 23:44:11,774][123091] Updated weights for policy 0, policy_version 20871 (0.0009) [2023-12-25 23:44:11,839][123091] Updated weights for policy 0, policy_version 20881 (0.0009) [2023-12-25 23:44:11,901][123091] Updated weights for policy 0, policy_version 20891 (0.0010) [2023-12-25 23:44:12,232][123090] Updated weights for policy 1, policy_version 20871 (0.0005) [2023-12-25 23:44:12,304][123090] Updated weights for policy 1, policy_version 20881 (0.0008) [2023-12-25 23:44:12,375][123090] Updated weights for policy 1, policy_version 20891 (0.0008) [2023-12-25 23:44:12,807][123091] Updated weights for policy 0, policy_version 20901 (0.0009) [2023-12-25 23:44:12,872][123091] Updated weights for policy 0, policy_version 20911 (0.0009) [2023-12-25 23:44:12,933][123091] Updated weights for policy 0, policy_version 20921 (0.0010) [2023-12-25 23:44:13,082][123090] Updated weights for policy 1, policy_version 20902 (0.0009) [2023-12-25 23:44:13,151][123090] Updated weights for policy 1, policy_version 20912 (0.0007) [2023-12-25 23:44:13,224][123090] Updated weights for policy 1, policy_version 20922 (0.0007) [2023-12-25 23:44:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 10715136. Throughput: 0: 8793.8, 1: 8966.7. Samples: 10712600. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-25 23:44:13,784][121949] Avg episode reward: [(0, '3490.085'), (1, '3915.131')] [2023-12-25 23:44:13,833][123091] Updated weights for policy 0, policy_version 20931 (0.0010) [2023-12-25 23:44:13,856][123090] Updated weights for policy 1, policy_version 20932 (0.0006) [2023-12-25 23:44:13,886][123091] Updated weights for policy 0, policy_version 20941 (0.0007) [2023-12-25 23:44:13,928][123090] Updated weights for policy 1, policy_version 20942 (0.0005) [2023-12-25 23:44:13,946][123091] Updated weights for policy 0, policy_version 20951 (0.0005) [2023-12-25 23:44:13,996][123090] Updated weights for policy 1, policy_version 20952 (0.0006) [2023-12-25 23:44:14,644][123091] Updated weights for policy 0, policy_version 20961 (0.0006) [2023-12-25 23:44:14,664][123090] Updated weights for policy 1, policy_version 20962 (0.0006) [2023-12-25 23:44:14,700][123091] Updated weights for policy 0, policy_version 20971 (0.0006) [2023-12-25 23:44:14,722][123090] Updated weights for policy 1, policy_version 20972 (0.0010) [2023-12-25 23:44:14,773][123091] Updated weights for policy 0, policy_version 20981 (0.0006) [2023-12-25 23:44:14,792][123090] Updated weights for policy 1, policy_version 20982 (0.0011) [2023-12-25 23:44:14,841][123091] Updated weights for policy 0, policy_version 20991 (0.0006) [2023-12-25 23:44:14,855][123090] Updated weights for policy 1, policy_version 20992 (0.0011) [2023-12-25 23:44:15,698][123090] Updated weights for policy 1, policy_version 21002 (0.0011) [2023-12-25 23:44:15,703][123091] Updated weights for policy 0, policy_version 21001 (0.0007) [2023-12-25 23:44:15,764][123090] Updated weights for policy 1, policy_version 21012 (0.0011) [2023-12-25 23:44:15,768][123091] Updated weights for policy 0, policy_version 21011 (0.0011) [2023-12-25 23:44:15,821][123090] Updated weights for policy 1, policy_version 21022 (0.0011) [2023-12-25 23:44:15,837][123091] Updated weights for policy 0, policy_version 21021 (0.0006) [2023-12-25 23:44:16,607][123090] Updated weights for policy 1, policy_version 21032 (0.0006) [2023-12-25 23:44:16,621][123091] Updated weights for policy 0, policy_version 21031 (0.0006) [2023-12-25 23:44:16,666][123090] Updated weights for policy 1, policy_version 21042 (0.0005) [2023-12-25 23:44:16,677][123091] Updated weights for policy 0, policy_version 21041 (0.0008) [2023-12-25 23:44:16,722][123090] Updated weights for policy 1, policy_version 21052 (0.0005) [2023-12-25 23:44:16,730][123091] Updated weights for policy 0, policy_version 21051 (0.0008) [2023-12-25 23:44:17,369][123090] Updated weights for policy 1, policy_version 21062 (0.0008) [2023-12-25 23:44:17,420][123090] Updated weights for policy 1, policy_version 21072 (0.0010) [2023-12-25 23:44:17,468][123090] Updated weights for policy 1, policy_version 21082 (0.0010) [2023-12-25 23:44:17,581][123091] Updated weights for policy 0, policy_version 21061 (0.0007) [2023-12-25 23:44:17,642][123091] Updated weights for policy 0, policy_version 21071 (0.0010) [2023-12-25 23:44:17,696][123091] Updated weights for policy 0, policy_version 21081 (0.0010) [2023-12-25 23:44:18,233][123090] Updated weights for policy 1, policy_version 21092 (0.0008) [2023-12-25 23:44:18,288][123090] Updated weights for policy 1, policy_version 21102 (0.0005) [2023-12-25 23:44:18,360][123090] Updated weights for policy 1, policy_version 21112 (0.0007) [2023-12-25 23:44:18,384][123091] Updated weights for policy 0, policy_version 21091 (0.0010) [2023-12-25 23:44:18,433][123091] Updated weights for policy 0, policy_version 21101 (0.0008) [2023-12-25 23:44:18,505][123091] Updated weights for policy 0, policy_version 21111 (0.0008) [2023-12-25 23:44:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 10813440. Throughput: 0: 8719.3, 1: 8972.6. Samples: 10821816. Policy #0 lag: (min: 27.0, avg: 35.5, max: 59.0) [2023-12-25 23:44:18,785][121949] Avg episode reward: [(0, '3616.912'), (1, '3972.035')] [2023-12-25 23:44:19,193][123090] Updated weights for policy 1, policy_version 21122 (0.0011) [2023-12-25 23:44:19,260][123090] Updated weights for policy 1, policy_version 21132 (0.0010) [2023-12-25 23:44:19,324][123090] Updated weights for policy 1, policy_version 21142 (0.0011) [2023-12-25 23:44:19,345][123091] Updated weights for policy 0, policy_version 21121 (0.0009) [2023-12-25 23:44:19,396][123090] Updated weights for policy 1, policy_version 21152 (0.0008) [2023-12-25 23:44:19,413][123091] Updated weights for policy 0, policy_version 21131 (0.0010) [2023-12-25 23:44:19,466][123091] Updated weights for policy 0, policy_version 21141 (0.0010) [2023-12-25 23:44:19,534][123091] Updated weights for policy 0, policy_version 21151 (0.0010) [2023-12-25 23:44:20,213][123090] Updated weights for policy 1, policy_version 21162 (0.0010) [2023-12-25 23:44:20,272][123090] Updated weights for policy 1, policy_version 21172 (0.0010) [2023-12-25 23:44:20,327][123090] Updated weights for policy 1, policy_version 21182 (0.0009) [2023-12-25 23:44:20,339][123091] Updated weights for policy 0, policy_version 21161 (0.0006) [2023-12-25 23:44:20,393][123091] Updated weights for policy 0, policy_version 21171 (0.0006) [2023-12-25 23:44:20,466][123091] Updated weights for policy 0, policy_version 21181 (0.0006) [2023-12-25 23:44:21,276][123091] Updated weights for policy 0, policy_version 21191 (0.0008) [2023-12-25 23:44:21,308][123090] Updated weights for policy 1, policy_version 21192 (0.0009) [2023-12-25 23:44:21,337][123091] Updated weights for policy 0, policy_version 21201 (0.0007) [2023-12-25 23:44:21,368][123090] Updated weights for policy 1, policy_version 21202 (0.0009) [2023-12-25 23:44:21,404][123091] Updated weights for policy 0, policy_version 21211 (0.0009) [2023-12-25 23:44:21,441][123090] Updated weights for policy 1, policy_version 21212 (0.0010) [2023-12-25 23:44:22,150][123091] Updated weights for policy 0, policy_version 21221 (0.0011) [2023-12-25 23:44:22,214][123091] Updated weights for policy 0, policy_version 21231 (0.0011) [2023-12-25 23:44:22,279][123091] Updated weights for policy 0, policy_version 21241 (0.0011) [2023-12-25 23:44:22,340][123090] Updated weights for policy 1, policy_version 21222 (0.0009) [2023-12-25 23:44:22,417][123090] Updated weights for policy 1, policy_version 21232 (0.0009) [2023-12-25 23:44:22,486][123090] Updated weights for policy 1, policy_version 21242 (0.0010) [2023-12-25 23:44:23,028][123091] Updated weights for policy 0, policy_version 21251 (0.0011) [2023-12-25 23:44:23,093][123091] Updated weights for policy 0, policy_version 21261 (0.0009) [2023-12-25 23:44:23,147][123091] Updated weights for policy 0, policy_version 21271 (0.0009) [2023-12-25 23:44:23,285][123090] Updated weights for policy 1, policy_version 21252 (0.0009) [2023-12-25 23:44:23,337][123090] Updated weights for policy 1, policy_version 21262 (0.0009) [2023-12-25 23:44:23,392][123090] Updated weights for policy 1, policy_version 21272 (0.0007) [2023-12-25 23:44:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 10895360. Throughput: 0: 8722.9, 1: 8879.3. Samples: 10872012. Policy #0 lag: (min: 27.0, avg: 35.5, max: 59.0) [2023-12-25 23:44:23,785][121949] Avg episode reward: [(0, '3768.533'), (1, '3964.384')] [2023-12-25 23:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000021280_5447680.pth... [2023-12-25 23:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000021280_5447680.pth... [2023-12-25 23:44:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000020256_5185536.pth [2023-12-25 23:44:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000020256_5185536.pth [2023-12-25 23:44:23,797][123007] Saving new best policy, reward=3768.533! [2023-12-25 23:44:23,945][123091] Updated weights for policy 0, policy_version 21281 (0.0008) [2023-12-25 23:44:23,999][123091] Updated weights for policy 0, policy_version 21291 (0.0005) [2023-12-25 23:44:24,057][123091] Updated weights for policy 0, policy_version 21301 (0.0005) [2023-12-25 23:44:24,124][123091] Updated weights for policy 0, policy_version 21311 (0.0007) [2023-12-25 23:44:24,204][123090] Updated weights for policy 1, policy_version 21282 (0.0006) [2023-12-25 23:44:24,261][123090] Updated weights for policy 1, policy_version 21292 (0.0009) [2023-12-25 23:44:24,323][123090] Updated weights for policy 1, policy_version 21302 (0.0009) [2023-12-25 23:44:24,392][123090] Updated weights for policy 1, policy_version 21312 (0.0009) [2023-12-25 23:44:24,920][123091] Updated weights for policy 0, policy_version 21321 (0.0009) [2023-12-25 23:44:24,973][123091] Updated weights for policy 0, policy_version 21332 (0.0009) [2023-12-25 23:44:25,038][123091] Updated weights for policy 0, policy_version 21342 (0.0007) [2023-12-25 23:44:25,084][123090] Updated weights for policy 1, policy_version 21322 (0.0006) [2023-12-25 23:44:25,155][123090] Updated weights for policy 1, policy_version 21332 (0.0009) [2023-12-25 23:44:25,225][123090] Updated weights for policy 1, policy_version 21342 (0.0008) [2023-12-25 23:44:25,668][123091] Updated weights for policy 0, policy_version 21352 (0.0005) [2023-12-25 23:44:25,721][123091] Updated weights for policy 0, policy_version 21362 (0.0005) [2023-12-25 23:44:25,778][123091] Updated weights for policy 0, policy_version 21372 (0.0005) [2023-12-25 23:44:25,851][123090] Updated weights for policy 1, policy_version 21352 (0.0005) [2023-12-25 23:44:25,909][123090] Updated weights for policy 1, policy_version 21362 (0.0005) [2023-12-25 23:44:25,957][123090] Updated weights for policy 1, policy_version 21372 (0.0005) [2023-12-25 23:44:26,458][123091] Updated weights for policy 0, policy_version 21382 (0.0008) [2023-12-25 23:44:26,518][123091] Updated weights for policy 0, policy_version 21392 (0.0009) [2023-12-25 23:44:26,566][123091] Updated weights for policy 0, policy_version 21402 (0.0009) [2023-12-25 23:44:26,676][123090] Updated weights for policy 1, policy_version 21382 (0.0008) [2023-12-25 23:44:26,731][123090] Updated weights for policy 1, policy_version 21392 (0.0010) [2023-12-25 23:44:26,789][123090] Updated weights for policy 1, policy_version 21402 (0.0010) [2023-12-25 23:44:27,343][123091] Updated weights for policy 0, policy_version 21412 (0.0008) [2023-12-25 23:44:27,398][123091] Updated weights for policy 0, policy_version 21422 (0.0009) [2023-12-25 23:44:27,445][123091] Updated weights for policy 0, policy_version 21432 (0.0008) [2023-12-25 23:44:27,597][123090] Updated weights for policy 1, policy_version 21412 (0.0008) [2023-12-25 23:44:27,647][123090] Updated weights for policy 1, policy_version 21422 (0.0005) [2023-12-25 23:44:27,694][123090] Updated weights for policy 1, policy_version 21432 (0.0005) [2023-12-25 23:44:28,337][123091] Updated weights for policy 0, policy_version 21442 (0.0008) [2023-12-25 23:44:28,350][123090] Updated weights for policy 1, policy_version 21442 (0.0006) [2023-12-25 23:44:28,400][123091] Updated weights for policy 0, policy_version 21452 (0.0007) [2023-12-25 23:44:28,410][123090] Updated weights for policy 1, policy_version 21452 (0.0008) [2023-12-25 23:44:28,446][123091] Updated weights for policy 0, policy_version 21462 (0.0007) [2023-12-25 23:44:28,468][123090] Updated weights for policy 1, policy_version 21462 (0.0008) [2023-12-25 23:44:28,506][123091] Updated weights for policy 0, policy_version 21472 (0.0008) [2023-12-25 23:44:28,539][123090] Updated weights for policy 1, policy_version 21472 (0.0011) [2023-12-25 23:44:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 10993664. Throughput: 0: 8815.6, 1: 8951.0. Samples: 10982968. Policy #0 lag: (min: 27.0, avg: 35.5, max: 59.0) [2023-12-25 23:44:28,785][121949] Avg episode reward: [(0, '3802.496'), (1, '4044.501')] [2023-12-25 23:44:28,787][123007] Saving new best policy, reward=3802.496! [2023-12-25 23:44:29,219][123090] Updated weights for policy 1, policy_version 21482 (0.0010) [2023-12-25 23:44:29,290][123090] Updated weights for policy 1, policy_version 21492 (0.0007) [2023-12-25 23:44:29,360][123090] Updated weights for policy 1, policy_version 21502 (0.0010) [2023-12-25 23:44:29,404][123091] Updated weights for policy 0, policy_version 21482 (0.0008) [2023-12-25 23:44:29,464][123091] Updated weights for policy 0, policy_version 21492 (0.0008) [2023-12-25 23:44:29,512][123091] Updated weights for policy 0, policy_version 21502 (0.0009) [2023-12-25 23:44:30,168][123090] Updated weights for policy 1, policy_version 21512 (0.0007) [2023-12-25 23:44:30,232][123090] Updated weights for policy 1, policy_version 21522 (0.0006) [2023-12-25 23:44:30,300][123090] Updated weights for policy 1, policy_version 21532 (0.0009) [2023-12-25 23:44:30,365][123091] Updated weights for policy 0, policy_version 21512 (0.0008) [2023-12-25 23:44:30,419][123091] Updated weights for policy 0, policy_version 21522 (0.0009) [2023-12-25 23:44:30,479][123091] Updated weights for policy 0, policy_version 21532 (0.0009) [2023-12-25 23:44:31,066][123090] Updated weights for policy 1, policy_version 21542 (0.0008) [2023-12-25 23:44:31,138][123090] Updated weights for policy 1, policy_version 21552 (0.0006) [2023-12-25 23:44:31,192][123090] Updated weights for policy 1, policy_version 21562 (0.0007) [2023-12-25 23:44:31,324][123091] Updated weights for policy 0, policy_version 21542 (0.0010) [2023-12-25 23:44:31,392][123091] Updated weights for policy 0, policy_version 21552 (0.0008) [2023-12-25 23:44:31,446][123091] Updated weights for policy 0, policy_version 21562 (0.0010) [2023-12-25 23:44:31,958][123090] Updated weights for policy 1, policy_version 21572 (0.0006) [2023-12-25 23:44:32,013][123090] Updated weights for policy 1, policy_version 21582 (0.0005) [2023-12-25 23:44:32,078][123090] Updated weights for policy 1, policy_version 21592 (0.0005) [2023-12-25 23:44:32,315][123091] Updated weights for policy 0, policy_version 21572 (0.0009) [2023-12-25 23:44:32,379][123091] Updated weights for policy 0, policy_version 21583 (0.0010) [2023-12-25 23:44:32,448][123091] Updated weights for policy 0, policy_version 21593 (0.0010) [2023-12-25 23:44:32,778][123090] Updated weights for policy 1, policy_version 21602 (0.0005) [2023-12-25 23:44:32,839][123090] Updated weights for policy 1, policy_version 21612 (0.0005) [2023-12-25 23:44:32,884][123090] Updated weights for policy 1, policy_version 21622 (0.0005) [2023-12-25 23:44:32,935][123090] Updated weights for policy 1, policy_version 21632 (0.0005) [2023-12-25 23:44:33,340][123091] Updated weights for policy 0, policy_version 21603 (0.0009) [2023-12-25 23:44:33,407][123091] Updated weights for policy 0, policy_version 21613 (0.0009) [2023-12-25 23:44:33,467][123091] Updated weights for policy 0, policy_version 21623 (0.0010) [2023-12-25 23:44:33,586][123090] Updated weights for policy 1, policy_version 21642 (0.0005) [2023-12-25 23:44:33,641][123090] Updated weights for policy 1, policy_version 21652 (0.0005) [2023-12-25 23:44:33,698][123090] Updated weights for policy 1, policy_version 21662 (0.0005) [2023-12-25 23:44:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 11083776. Throughput: 0: 8770.1, 1: 9003.0. Samples: 11090288. Policy #0 lag: (min: 5.0, avg: 8.3, max: 37.0) [2023-12-25 23:44:33,785][121949] Avg episode reward: [(0, '3624.132'), (1, '4049.267')] [2023-12-25 23:44:34,303][123091] Updated weights for policy 0, policy_version 21633 (0.0009) [2023-12-25 23:44:34,368][123091] Updated weights for policy 0, policy_version 21643 (0.0009) [2023-12-25 23:44:34,435][123091] Updated weights for policy 0, policy_version 21653 (0.0010) [2023-12-25 23:44:34,476][123090] Updated weights for policy 1, policy_version 21672 (0.0008) [2023-12-25 23:44:34,496][123091] Updated weights for policy 0, policy_version 21663 (0.0009) [2023-12-25 23:44:34,526][123090] Updated weights for policy 1, policy_version 21682 (0.0007) [2023-12-25 23:44:34,595][123090] Updated weights for policy 1, policy_version 21692 (0.0010) [2023-12-25 23:44:35,290][123091] Updated weights for policy 0, policy_version 21673 (0.0010) [2023-12-25 23:44:35,343][123091] Updated weights for policy 0, policy_version 21684 (0.0009) [2023-12-25 23:44:35,397][123091] Updated weights for policy 0, policy_version 21694 (0.0009) [2023-12-25 23:44:35,420][123090] Updated weights for policy 1, policy_version 21702 (0.0008) [2023-12-25 23:44:35,477][123090] Updated weights for policy 1, policy_version 21712 (0.0009) [2023-12-25 23:44:35,538][123090] Updated weights for policy 1, policy_version 21722 (0.0009) [2023-12-25 23:44:36,246][123091] Updated weights for policy 0, policy_version 21704 (0.0006) [2023-12-25 23:44:36,257][123090] Updated weights for policy 1, policy_version 21732 (0.0009) [2023-12-25 23:44:36,315][123091] Updated weights for policy 0, policy_version 21714 (0.0006) [2023-12-25 23:44:36,325][123090] Updated weights for policy 1, policy_version 21742 (0.0009) [2023-12-25 23:44:36,380][123091] Updated weights for policy 0, policy_version 21724 (0.0008) [2023-12-25 23:44:36,394][123090] Updated weights for policy 1, policy_version 21752 (0.0007) [2023-12-25 23:44:37,095][123091] Updated weights for policy 0, policy_version 21734 (0.0009) [2023-12-25 23:44:37,155][123091] Updated weights for policy 0, policy_version 21744 (0.0009) [2023-12-25 23:44:37,209][123091] Updated weights for policy 0, policy_version 21754 (0.0009) [2023-12-25 23:44:37,255][123090] Updated weights for policy 1, policy_version 21762 (0.0009) [2023-12-25 23:44:37,321][123090] Updated weights for policy 1, policy_version 21772 (0.0010) [2023-12-25 23:44:37,376][123090] Updated weights for policy 1, policy_version 21782 (0.0009) [2023-12-25 23:44:37,432][123090] Updated weights for policy 1, policy_version 21792 (0.0010) [2023-12-25 23:44:38,047][123091] Updated weights for policy 0, policy_version 21764 (0.0010) [2023-12-25 23:44:38,101][123091] Updated weights for policy 0, policy_version 21774 (0.0009) [2023-12-25 23:44:38,158][123091] Updated weights for policy 0, policy_version 21784 (0.0009) [2023-12-25 23:44:38,260][123090] Updated weights for policy 1, policy_version 21802 (0.0009) [2023-12-25 23:44:38,310][123090] Updated weights for policy 1, policy_version 21812 (0.0009) [2023-12-25 23:44:38,372][123090] Updated weights for policy 1, policy_version 21822 (0.0009) [2023-12-25 23:44:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 11165696. Throughput: 0: 8791.1, 1: 9022.9. Samples: 11143052. Policy #0 lag: (min: 5.0, avg: 8.3, max: 37.0) [2023-12-25 23:44:38,785][121949] Avg episode reward: [(0, '3618.252'), (1, '3793.169')] [2023-12-25 23:44:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000021824_5586944.pth... [2023-12-25 23:44:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000021792_5578752.pth... [2023-12-25 23:44:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000020768_5316608.pth [2023-12-25 23:44:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000020800_5324800.pth [2023-12-25 23:44:38,990][123091] Updated weights for policy 0, policy_version 21794 (0.0010) [2023-12-25 23:44:39,043][123091] Updated weights for policy 0, policy_version 21804 (0.0007) [2023-12-25 23:44:39,103][123091] Updated weights for policy 0, policy_version 21814 (0.0009) [2023-12-25 23:44:39,206][123090] Updated weights for policy 1, policy_version 21832 (0.0009) [2023-12-25 23:44:39,275][123090] Updated weights for policy 1, policy_version 21842 (0.0009) [2023-12-25 23:44:39,346][123090] Updated weights for policy 1, policy_version 21852 (0.0010) [2023-12-25 23:44:39,897][123091] Updated weights for policy 0, policy_version 21825 (0.0008) [2023-12-25 23:44:39,968][123091] Updated weights for policy 0, policy_version 21835 (0.0009) [2023-12-25 23:44:40,024][123091] Updated weights for policy 0, policy_version 21845 (0.0008) [2023-12-25 23:44:40,089][123091] Updated weights for policy 0, policy_version 21855 (0.0009) [2023-12-25 23:44:40,255][123090] Updated weights for policy 1, policy_version 21862 (0.0009) [2023-12-25 23:44:40,305][123090] Updated weights for policy 1, policy_version 21872 (0.0009) [2023-12-25 23:44:40,363][123090] Updated weights for policy 1, policy_version 21882 (0.0010) [2023-12-25 23:44:40,878][123091] Updated weights for policy 0, policy_version 21865 (0.0005) [2023-12-25 23:44:40,943][123091] Updated weights for policy 0, policy_version 21875 (0.0005) [2023-12-25 23:44:40,997][123091] Updated weights for policy 0, policy_version 21885 (0.0005) [2023-12-25 23:44:41,246][123090] Updated weights for policy 1, policy_version 21892 (0.0009) [2023-12-25 23:44:41,316][123090] Updated weights for policy 1, policy_version 21902 (0.0011) [2023-12-25 23:44:41,394][123090] Updated weights for policy 1, policy_version 21912 (0.0009) [2023-12-25 23:44:41,760][123091] Updated weights for policy 0, policy_version 21895 (0.0008) [2023-12-25 23:44:41,813][123091] Updated weights for policy 0, policy_version 21905 (0.0010) [2023-12-25 23:44:41,880][123091] Updated weights for policy 0, policy_version 21915 (0.0011) [2023-12-25 23:44:42,206][123090] Updated weights for policy 1, policy_version 21922 (0.0009) [2023-12-25 23:44:42,281][123090] Updated weights for policy 1, policy_version 21932 (0.0010) [2023-12-25 23:44:42,350][123090] Updated weights for policy 1, policy_version 21942 (0.0009) [2023-12-25 23:44:42,427][123090] Updated weights for policy 1, policy_version 21952 (0.0008) [2023-12-25 23:44:42,765][123091] Updated weights for policy 0, policy_version 21925 (0.0011) [2023-12-25 23:44:42,822][123091] Updated weights for policy 0, policy_version 21935 (0.0011) [2023-12-25 23:44:42,878][123091] Updated weights for policy 0, policy_version 21945 (0.0011) [2023-12-25 23:44:43,282][123090] Updated weights for policy 1, policy_version 21962 (0.0009) [2023-12-25 23:44:43,352][123090] Updated weights for policy 1, policy_version 21972 (0.0009) [2023-12-25 23:44:43,417][123090] Updated weights for policy 1, policy_version 21982 (0.0009) [2023-12-25 23:44:43,671][123091] Updated weights for policy 0, policy_version 21955 (0.0009) [2023-12-25 23:44:43,740][123091] Updated weights for policy 0, policy_version 21965 (0.0005) [2023-12-25 23:44:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 11247616. Throughput: 0: 8724.3, 1: 8938.5. Samples: 11244844. Policy #0 lag: (min: 5.0, avg: 8.3, max: 37.0) [2023-12-25 23:44:43,785][121949] Avg episode reward: [(0, '3674.339'), (1, '3692.546')] [2023-12-25 23:44:43,803][123091] Updated weights for policy 0, policy_version 21975 (0.0006) [2023-12-25 23:44:44,182][123090] Updated weights for policy 1, policy_version 21992 (0.0009) [2023-12-25 23:44:44,236][123090] Updated weights for policy 1, policy_version 22003 (0.0010) [2023-12-25 23:44:44,288][123090] Updated weights for policy 1, policy_version 22013 (0.0009) [2023-12-25 23:44:44,432][123091] Updated weights for policy 0, policy_version 21985 (0.0007) [2023-12-25 23:44:44,479][123091] Updated weights for policy 0, policy_version 21995 (0.0010) [2023-12-25 23:44:44,527][123091] Updated weights for policy 0, policy_version 22005 (0.0010) [2023-12-25 23:44:44,588][123091] Updated weights for policy 0, policy_version 22015 (0.0010) [2023-12-25 23:44:45,132][123090] Updated weights for policy 1, policy_version 22023 (0.0006) [2023-12-25 23:44:45,203][123090] Updated weights for policy 1, policy_version 22033 (0.0006) [2023-12-25 23:44:45,265][123090] Updated weights for policy 1, policy_version 22043 (0.0005) [2023-12-25 23:44:45,427][123091] Updated weights for policy 0, policy_version 22025 (0.0011) [2023-12-25 23:44:45,494][123091] Updated weights for policy 0, policy_version 22035 (0.0010) [2023-12-25 23:44:45,566][123091] Updated weights for policy 0, policy_version 22045 (0.0011) [2023-12-25 23:44:45,970][123090] Updated weights for policy 1, policy_version 22053 (0.0007) [2023-12-25 23:44:46,019][123090] Updated weights for policy 1, policy_version 22063 (0.0005) [2023-12-25 23:44:46,073][123090] Updated weights for policy 1, policy_version 22073 (0.0005) [2023-12-25 23:44:46,387][123091] Updated weights for policy 0, policy_version 22055 (0.0011) [2023-12-25 23:44:46,452][123091] Updated weights for policy 0, policy_version 22065 (0.0010) [2023-12-25 23:44:46,515][123091] Updated weights for policy 0, policy_version 22075 (0.0010) [2023-12-25 23:44:46,697][123090] Updated weights for policy 1, policy_version 22083 (0.0006) [2023-12-25 23:44:46,752][123090] Updated weights for policy 1, policy_version 22093 (0.0010) [2023-12-25 23:44:46,814][123090] Updated weights for policy 1, policy_version 22103 (0.0010) [2023-12-25 23:44:47,304][123091] Updated weights for policy 0, policy_version 22085 (0.0008) [2023-12-25 23:44:47,360][123091] Updated weights for policy 0, policy_version 22095 (0.0005) [2023-12-25 23:44:47,420][123091] Updated weights for policy 0, policy_version 22105 (0.0006) [2023-12-25 23:44:47,632][123090] Updated weights for policy 1, policy_version 22113 (0.0010) [2023-12-25 23:44:47,683][123090] Updated weights for policy 1, policy_version 22123 (0.0010) [2023-12-25 23:44:47,738][123090] Updated weights for policy 1, policy_version 22133 (0.0010) [2023-12-25 23:44:47,800][123090] Updated weights for policy 1, policy_version 22143 (0.0010) [2023-12-25 23:44:48,144][123091] Updated weights for policy 0, policy_version 22115 (0.0009) [2023-12-25 23:44:48,205][123091] Updated weights for policy 0, policy_version 22125 (0.0005) [2023-12-25 23:44:48,267][123091] Updated weights for policy 0, policy_version 22135 (0.0005) [2023-12-25 23:44:48,641][123090] Updated weights for policy 1, policy_version 22153 (0.0006) [2023-12-25 23:44:48,702][123090] Updated weights for policy 1, policy_version 22163 (0.0005) [2023-12-25 23:44:48,781][123090] Updated weights for policy 1, policy_version 22173 (0.0005) [2023-12-25 23:44:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 11337728. Throughput: 0: 8788.9, 1: 8957.0. Samples: 11354524. Policy #0 lag: (min: 5.0, avg: 8.3, max: 37.0) [2023-12-25 23:44:48,785][121949] Avg episode reward: [(0, '3744.861'), (1, '3766.048')] [2023-12-25 23:44:48,975][123091] Updated weights for policy 0, policy_version 22145 (0.0006) [2023-12-25 23:44:49,053][123091] Updated weights for policy 0, policy_version 22155 (0.0005) [2023-12-25 23:44:49,114][123091] Updated weights for policy 0, policy_version 22165 (0.0006) [2023-12-25 23:44:49,186][123091] Updated weights for policy 0, policy_version 22175 (0.0005) [2023-12-25 23:44:49,454][123090] Updated weights for policy 1, policy_version 22183 (0.0009) [2023-12-25 23:44:49,526][123090] Updated weights for policy 1, policy_version 22193 (0.0011) [2023-12-25 23:44:49,600][123090] Updated weights for policy 1, policy_version 22203 (0.0010) [2023-12-25 23:44:49,870][123091] Updated weights for policy 0, policy_version 22185 (0.0008) [2023-12-25 23:44:49,932][123091] Updated weights for policy 0, policy_version 22195 (0.0006) [2023-12-25 23:44:50,007][123091] Updated weights for policy 0, policy_version 22205 (0.0010) [2023-12-25 23:44:50,403][123090] Updated weights for policy 1, policy_version 22213 (0.0008) [2023-12-25 23:44:50,469][123090] Updated weights for policy 1, policy_version 22223 (0.0007) [2023-12-25 23:44:50,541][123090] Updated weights for policy 1, policy_version 22233 (0.0005) [2023-12-25 23:44:50,779][123091] Updated weights for policy 0, policy_version 22215 (0.0007) [2023-12-25 23:44:50,846][123091] Updated weights for policy 0, policy_version 22225 (0.0005) [2023-12-25 23:44:50,914][123091] Updated weights for policy 0, policy_version 22235 (0.0006) [2023-12-25 23:44:51,342][123090] Updated weights for policy 1, policy_version 22243 (0.0008) [2023-12-25 23:44:51,404][123090] Updated weights for policy 1, policy_version 22253 (0.0008) [2023-12-25 23:44:51,463][123090] Updated weights for policy 1, policy_version 22263 (0.0008) [2023-12-25 23:44:51,652][123091] Updated weights for policy 0, policy_version 22245 (0.0008) [2023-12-25 23:44:51,707][123091] Updated weights for policy 0, policy_version 22255 (0.0011) [2023-12-25 23:44:51,775][123091] Updated weights for policy 0, policy_version 22265 (0.0011) [2023-12-25 23:44:52,283][123090] Updated weights for policy 1, policy_version 22273 (0.0008) [2023-12-25 23:44:52,335][123090] Updated weights for policy 1, policy_version 22283 (0.0009) [2023-12-25 23:44:52,405][123090] Updated weights for policy 1, policy_version 22293 (0.0009) [2023-12-25 23:44:52,466][123090] Updated weights for policy 1, policy_version 22303 (0.0010) [2023-12-25 23:44:52,594][123091] Updated weights for policy 0, policy_version 22275 (0.0011) [2023-12-25 23:44:52,666][123091] Updated weights for policy 0, policy_version 22285 (0.0010) [2023-12-25 23:44:52,746][123091] Updated weights for policy 0, policy_version 22295 (0.0011) [2023-12-25 23:44:53,200][123090] Updated weights for policy 1, policy_version 22313 (0.0006) [2023-12-25 23:44:53,254][123090] Updated weights for policy 1, policy_version 22323 (0.0005) [2023-12-25 23:44:53,310][123090] Updated weights for policy 1, policy_version 22333 (0.0005) [2023-12-25 23:44:53,520][123091] Updated weights for policy 0, policy_version 22305 (0.0011) [2023-12-25 23:44:53,575][123091] Updated weights for policy 0, policy_version 22315 (0.0010) [2023-12-25 23:44:53,637][123091] Updated weights for policy 0, policy_version 22325 (0.0010) [2023-12-25 23:44:53,706][123091] Updated weights for policy 0, policy_version 22335 (0.0010) [2023-12-25 23:44:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 11436032. Throughput: 0: 8789.8, 1: 8974.1. Samples: 11409568. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:44:53,785][121949] Avg episode reward: [(0, '3795.750'), (1, '3940.677')] [2023-12-25 23:44:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000022336_5718016.pth... [2023-12-25 23:44:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000022336_5718016.pth... [2023-12-25 23:44:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000021280_5447680.pth [2023-12-25 23:44:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000021280_5447680.pth [2023-12-25 23:44:54,027][123090] Updated weights for policy 1, policy_version 22343 (0.0005) [2023-12-25 23:44:54,074][123090] Updated weights for policy 1, policy_version 22353 (0.0005) [2023-12-25 23:44:54,129][123090] Updated weights for policy 1, policy_version 22363 (0.0006) [2023-12-25 23:44:54,489][123091] Updated weights for policy 0, policy_version 22345 (0.0010) [2023-12-25 23:44:54,544][123091] Updated weights for policy 0, policy_version 22355 (0.0010) [2023-12-25 23:44:54,604][123091] Updated weights for policy 0, policy_version 22365 (0.0010) [2023-12-25 23:44:54,874][123090] Updated weights for policy 1, policy_version 22373 (0.0009) [2023-12-25 23:44:54,939][123090] Updated weights for policy 1, policy_version 22383 (0.0009) [2023-12-25 23:44:55,007][123090] Updated weights for policy 1, policy_version 22393 (0.0010) [2023-12-25 23:44:55,431][123091] Updated weights for policy 0, policy_version 22375 (0.0010) [2023-12-25 23:44:55,474][123091] Updated weights for policy 0, policy_version 22385 (0.0010) [2023-12-25 23:44:55,517][123091] Updated weights for policy 0, policy_version 22395 (0.0010) [2023-12-25 23:44:55,707][123090] Updated weights for policy 1, policy_version 22403 (0.0011) [2023-12-25 23:44:55,770][123090] Updated weights for policy 1, policy_version 22413 (0.0008) [2023-12-25 23:44:55,834][123090] Updated weights for policy 1, policy_version 22423 (0.0008) [2023-12-25 23:44:56,371][123091] Updated weights for policy 0, policy_version 22405 (0.0010) [2023-12-25 23:44:56,418][123091] Updated weights for policy 0, policy_version 22415 (0.0010) [2023-12-25 23:44:56,466][123091] Updated weights for policy 0, policy_version 22425 (0.0010) [2023-12-25 23:44:56,549][123090] Updated weights for policy 1, policy_version 22433 (0.0006) [2023-12-25 23:44:56,600][123090] Updated weights for policy 1, policy_version 22443 (0.0008) [2023-12-25 23:44:56,649][123090] Updated weights for policy 1, policy_version 22453 (0.0009) [2023-12-25 23:44:56,700][123090] Updated weights for policy 1, policy_version 22463 (0.0008) [2023-12-25 23:44:57,271][123091] Updated weights for policy 0, policy_version 22435 (0.0009) [2023-12-25 23:44:57,334][123091] Updated weights for policy 0, policy_version 22445 (0.0006) [2023-12-25 23:44:57,395][123091] Updated weights for policy 0, policy_version 22455 (0.0006) [2023-12-25 23:44:57,459][123090] Updated weights for policy 1, policy_version 22473 (0.0006) [2023-12-25 23:44:57,525][123090] Updated weights for policy 1, policy_version 22483 (0.0005) [2023-12-25 23:44:57,583][123090] Updated weights for policy 1, policy_version 22493 (0.0005) [2023-12-25 23:44:58,234][123091] Updated weights for policy 0, policy_version 22465 (0.0008) [2023-12-25 23:44:58,288][123090] Updated weights for policy 1, policy_version 22503 (0.0007) [2023-12-25 23:44:58,297][123091] Updated weights for policy 0, policy_version 22475 (0.0009) [2023-12-25 23:44:58,348][123090] Updated weights for policy 1, policy_version 22513 (0.0008) [2023-12-25 23:44:58,360][123091] Updated weights for policy 0, policy_version 22485 (0.0010) [2023-12-25 23:44:58,419][123090] Updated weights for policy 1, policy_version 22523 (0.0008) [2023-12-25 23:44:58,423][123091] Updated weights for policy 0, policy_version 22495 (0.0008) [2023-12-25 23:44:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 11526144. Throughput: 0: 8833.7, 1: 9077.1. Samples: 11518588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:44:58,785][121949] Avg episode reward: [(0, '3709.681'), (1, '4069.099')] [2023-12-25 23:44:59,248][123091] Updated weights for policy 0, policy_version 22505 (0.0010) [2023-12-25 23:44:59,273][123090] Updated weights for policy 1, policy_version 22533 (0.0009) [2023-12-25 23:44:59,302][123091] Updated weights for policy 0, policy_version 22515 (0.0008) [2023-12-25 23:44:59,333][123090] Updated weights for policy 1, policy_version 22543 (0.0008) [2023-12-25 23:44:59,370][123091] Updated weights for policy 0, policy_version 22525 (0.0009) [2023-12-25 23:44:59,401][123090] Updated weights for policy 1, policy_version 22553 (0.0010) [2023-12-25 23:45:00,185][123091] Updated weights for policy 0, policy_version 22535 (0.0009) [2023-12-25 23:45:00,200][123090] Updated weights for policy 1, policy_version 22563 (0.0008) [2023-12-25 23:45:00,247][123091] Updated weights for policy 0, policy_version 22545 (0.0009) [2023-12-25 23:45:00,256][123090] Updated weights for policy 1, policy_version 22573 (0.0005) [2023-12-25 23:45:00,304][123091] Updated weights for policy 0, policy_version 22555 (0.0009) [2023-12-25 23:45:00,306][123090] Updated weights for policy 1, policy_version 22583 (0.0006) [2023-12-25 23:45:01,017][123090] Updated weights for policy 1, policy_version 22593 (0.0008) [2023-12-25 23:45:01,082][123090] Updated weights for policy 1, policy_version 22603 (0.0006) [2023-12-25 23:45:01,149][123090] Updated weights for policy 1, policy_version 22613 (0.0008) [2023-12-25 23:45:01,171][123091] Updated weights for policy 0, policy_version 22565 (0.0008) [2023-12-25 23:45:01,213][123090] Updated weights for policy 1, policy_version 22623 (0.0010) [2023-12-25 23:45:01,235][123091] Updated weights for policy 0, policy_version 22575 (0.0009) [2023-12-25 23:45:01,292][123091] Updated weights for policy 0, policy_version 22585 (0.0009) [2023-12-25 23:45:01,975][123090] Updated weights for policy 1, policy_version 22633 (0.0006) [2023-12-25 23:45:02,035][123090] Updated weights for policy 1, policy_version 22643 (0.0005) [2023-12-25 23:45:02,097][123090] Updated weights for policy 1, policy_version 22653 (0.0005) [2023-12-25 23:45:02,183][123091] Updated weights for policy 0, policy_version 22595 (0.0010) [2023-12-25 23:45:02,239][123091] Updated weights for policy 0, policy_version 22605 (0.0008) [2023-12-25 23:45:02,297][123091] Updated weights for policy 0, policy_version 22615 (0.0009) [2023-12-25 23:45:02,747][123090] Updated weights for policy 1, policy_version 22663 (0.0006) [2023-12-25 23:45:02,810][123090] Updated weights for policy 1, policy_version 22673 (0.0008) [2023-12-25 23:45:02,875][123090] Updated weights for policy 1, policy_version 22683 (0.0009) [2023-12-25 23:45:03,165][123091] Updated weights for policy 0, policy_version 22625 (0.0009) [2023-12-25 23:45:03,221][123091] Updated weights for policy 0, policy_version 22635 (0.0010) [2023-12-25 23:45:03,268][123091] Updated weights for policy 0, policy_version 22645 (0.0010) [2023-12-25 23:45:03,316][123091] Updated weights for policy 0, policy_version 22655 (0.0010) [2023-12-25 23:45:03,564][123090] Updated weights for policy 1, policy_version 22693 (0.0007) [2023-12-25 23:45:03,615][123090] Updated weights for policy 1, policy_version 22703 (0.0005) [2023-12-25 23:45:03,662][123090] Updated weights for policy 1, policy_version 22713 (0.0005) [2023-12-25 23:45:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 11616256. Throughput: 0: 8788.0, 1: 9053.6. Samples: 11624688. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:45:03,785][121949] Avg episode reward: [(0, '3748.607'), (1, '3876.512')] [2023-12-25 23:45:04,157][123091] Updated weights for policy 0, policy_version 22665 (0.0011) [2023-12-25 23:45:04,213][123091] Updated weights for policy 0, policy_version 22675 (0.0011) [2023-12-25 23:45:04,283][123091] Updated weights for policy 0, policy_version 22685 (0.0011) [2023-12-25 23:45:04,386][123090] Updated weights for policy 1, policy_version 22723 (0.0007) [2023-12-25 23:45:04,453][123090] Updated weights for policy 1, policy_version 22733 (0.0010) [2023-12-25 23:45:04,520][123090] Updated weights for policy 1, policy_version 22743 (0.0009) [2023-12-25 23:45:05,015][123091] Updated weights for policy 0, policy_version 22695 (0.0010) [2023-12-25 23:45:05,070][123091] Updated weights for policy 0, policy_version 22706 (0.0010) [2023-12-25 23:45:05,123][123091] Updated weights for policy 0, policy_version 22717 (0.0010) [2023-12-25 23:45:05,255][123090] Updated weights for policy 1, policy_version 22753 (0.0009) [2023-12-25 23:45:05,331][123090] Updated weights for policy 1, policy_version 22763 (0.0009) [2023-12-25 23:45:05,389][123090] Updated weights for policy 1, policy_version 22773 (0.0005) [2023-12-25 23:45:05,446][123090] Updated weights for policy 1, policy_version 22783 (0.0005) [2023-12-25 23:45:05,823][123091] Updated weights for policy 0, policy_version 22727 (0.0007) [2023-12-25 23:45:05,882][123091] Updated weights for policy 0, policy_version 22737 (0.0007) [2023-12-25 23:45:05,943][123091] Updated weights for policy 0, policy_version 22747 (0.0009) [2023-12-25 23:45:06,249][123090] Updated weights for policy 1, policy_version 22793 (0.0010) [2023-12-25 23:45:06,317][123090] Updated weights for policy 1, policy_version 22803 (0.0010) [2023-12-25 23:45:06,373][123090] Updated weights for policy 1, policy_version 22813 (0.0010) [2023-12-25 23:45:06,680][123091] Updated weights for policy 0, policy_version 22757 (0.0008) [2023-12-25 23:45:06,736][123091] Updated weights for policy 0, policy_version 22767 (0.0011) [2023-12-25 23:45:06,793][123091] Updated weights for policy 0, policy_version 22777 (0.0011) [2023-12-25 23:45:07,217][123090] Updated weights for policy 1, policy_version 22823 (0.0010) [2023-12-25 23:45:07,287][123090] Updated weights for policy 1, policy_version 22833 (0.0010) [2023-12-25 23:45:07,350][123090] Updated weights for policy 1, policy_version 22843 (0.0009) [2023-12-25 23:45:07,498][123091] Updated weights for policy 0, policy_version 22787 (0.0009) [2023-12-25 23:45:07,562][123091] Updated weights for policy 0, policy_version 22797 (0.0005) [2023-12-25 23:45:07,620][123091] Updated weights for policy 0, policy_version 22807 (0.0005) [2023-12-25 23:45:08,071][123090] Updated weights for policy 1, policy_version 22853 (0.0006) [2023-12-25 23:45:08,140][123090] Updated weights for policy 1, policy_version 22863 (0.0007) [2023-12-25 23:45:08,210][123090] Updated weights for policy 1, policy_version 22873 (0.0007) [2023-12-25 23:45:08,350][123091] Updated weights for policy 0, policy_version 22817 (0.0006) [2023-12-25 23:45:08,415][123091] Updated weights for policy 0, policy_version 22827 (0.0007) [2023-12-25 23:45:08,484][123091] Updated weights for policy 0, policy_version 22837 (0.0006) [2023-12-25 23:45:08,549][123091] Updated weights for policy 0, policy_version 22847 (0.0009) [2023-12-25 23:45:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 11706368. Throughput: 0: 8842.7, 1: 9121.9. Samples: 11680416. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:45:08,785][121949] Avg episode reward: [(0, '3773.464'), (1, '3859.461')] [2023-12-25 23:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000022848_5849088.pth... [2023-12-25 23:45:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000022880_5857280.pth... [2023-12-25 23:45:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000021824_5586944.pth [2023-12-25 23:45:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000021792_5578752.pth [2023-12-25 23:45:08,994][123090] Updated weights for policy 1, policy_version 22883 (0.0007) [2023-12-25 23:45:09,053][123090] Updated weights for policy 1, policy_version 22893 (0.0010) [2023-12-25 23:45:09,116][123090] Updated weights for policy 1, policy_version 22903 (0.0010) [2023-12-25 23:45:09,284][123091] Updated weights for policy 0, policy_version 22857 (0.0008) [2023-12-25 23:45:09,357][123091] Updated weights for policy 0, policy_version 22867 (0.0006) [2023-12-25 23:45:09,423][123091] Updated weights for policy 0, policy_version 22877 (0.0007) [2023-12-25 23:45:09,933][123090] Updated weights for policy 1, policy_version 22913 (0.0010) [2023-12-25 23:45:09,999][123090] Updated weights for policy 1, policy_version 22923 (0.0007) [2023-12-25 23:45:10,055][123090] Updated weights for policy 1, policy_version 22933 (0.0009) [2023-12-25 23:45:10,108][123090] Updated weights for policy 1, policy_version 22943 (0.0009) [2023-12-25 23:45:10,243][123091] Updated weights for policy 0, policy_version 22887 (0.0010) [2023-12-25 23:45:10,299][123091] Updated weights for policy 0, policy_version 22898 (0.0011) [2023-12-25 23:45:10,350][123091] Updated weights for policy 0, policy_version 22908 (0.0009) [2023-12-25 23:45:10,919][123090] Updated weights for policy 1, policy_version 22953 (0.0010) [2023-12-25 23:45:10,979][123090] Updated weights for policy 1, policy_version 22963 (0.0010) [2023-12-25 23:45:11,040][123090] Updated weights for policy 1, policy_version 22973 (0.0010) [2023-12-25 23:45:11,262][123091] Updated weights for policy 0, policy_version 22918 (0.0010) [2023-12-25 23:45:11,329][123091] Updated weights for policy 0, policy_version 22928 (0.0010) [2023-12-25 23:45:11,397][123091] Updated weights for policy 0, policy_version 22938 (0.0010) [2023-12-25 23:45:11,799][123090] Updated weights for policy 1, policy_version 22983 (0.0008) [2023-12-25 23:45:11,866][123090] Updated weights for policy 1, policy_version 22993 (0.0009) [2023-12-25 23:45:11,930][123090] Updated weights for policy 1, policy_version 23003 (0.0009) [2023-12-25 23:45:12,317][123091] Updated weights for policy 0, policy_version 22948 (0.0010) [2023-12-25 23:45:12,378][123091] Updated weights for policy 0, policy_version 22958 (0.0010) [2023-12-25 23:45:12,437][123091] Updated weights for policy 0, policy_version 22968 (0.0010) [2023-12-25 23:45:12,650][123090] Updated weights for policy 1, policy_version 23013 (0.0009) [2023-12-25 23:45:12,719][123090] Updated weights for policy 1, policy_version 23023 (0.0006) [2023-12-25 23:45:12,791][123090] Updated weights for policy 1, policy_version 23033 (0.0008) [2023-12-25 23:45:13,357][123091] Updated weights for policy 0, policy_version 22978 (0.0009) [2023-12-25 23:45:13,425][123091] Updated weights for policy 0, policy_version 22988 (0.0010) [2023-12-25 23:45:13,480][123090] Updated weights for policy 1, policy_version 23043 (0.0006) [2023-12-25 23:45:13,497][123091] Updated weights for policy 0, policy_version 22998 (0.0009) [2023-12-25 23:45:13,545][123090] Updated weights for policy 1, policy_version 23053 (0.0006) [2023-12-25 23:45:13,562][123091] Updated weights for policy 0, policy_version 23008 (0.0008) [2023-12-25 23:45:13,610][123090] Updated weights for policy 1, policy_version 23063 (0.0010) [2023-12-25 23:45:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 11796480. Throughput: 0: 8746.6, 1: 9097.6. Samples: 11785956. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:45:13,785][121949] Avg episode reward: [(0, '3793.315'), (1, '3934.523')] [2023-12-25 23:45:14,386][123091] Updated weights for policy 0, policy_version 23018 (0.0009) [2023-12-25 23:45:14,435][123090] Updated weights for policy 1, policy_version 23073 (0.0009) [2023-12-25 23:45:14,441][123091] Updated weights for policy 0, policy_version 23028 (0.0008) [2023-12-25 23:45:14,500][123090] Updated weights for policy 1, policy_version 23083 (0.0008) [2023-12-25 23:45:14,505][123091] Updated weights for policy 0, policy_version 23038 (0.0009) [2023-12-25 23:45:14,568][123090] Updated weights for policy 1, policy_version 23093 (0.0008) [2023-12-25 23:45:14,630][123090] Updated weights for policy 1, policy_version 23103 (0.0008) [2023-12-25 23:45:15,404][123091] Updated weights for policy 0, policy_version 23048 (0.0009) [2023-12-25 23:45:15,432][123090] Updated weights for policy 1, policy_version 23113 (0.0009) [2023-12-25 23:45:15,467][123091] Updated weights for policy 0, policy_version 23058 (0.0006) [2023-12-25 23:45:15,493][123090] Updated weights for policy 1, policy_version 23123 (0.0009) [2023-12-25 23:45:15,529][123091] Updated weights for policy 0, policy_version 23068 (0.0010) [2023-12-25 23:45:15,554][123090] Updated weights for policy 1, policy_version 23133 (0.0008) [2023-12-25 23:45:16,349][123090] Updated weights for policy 1, policy_version 23143 (0.0006) [2023-12-25 23:45:16,366][123091] Updated weights for policy 0, policy_version 23079 (0.0008) [2023-12-25 23:45:16,394][123090] Updated weights for policy 1, policy_version 23153 (0.0005) [2023-12-25 23:45:16,424][123091] Updated weights for policy 0, policy_version 23089 (0.0009) [2023-12-25 23:45:16,454][123090] Updated weights for policy 1, policy_version 23163 (0.0005) [2023-12-25 23:45:16,477][123091] Updated weights for policy 0, policy_version 23099 (0.0009) [2023-12-25 23:45:17,205][123091] Updated weights for policy 0, policy_version 23109 (0.0008) [2023-12-25 23:45:17,268][123091] Updated weights for policy 0, policy_version 23119 (0.0008) [2023-12-25 23:45:17,277][123090] Updated weights for policy 1, policy_version 23173 (0.0006) [2023-12-25 23:45:17,323][123091] Updated weights for policy 0, policy_version 23129 (0.0005) [2023-12-25 23:45:17,337][123090] Updated weights for policy 1, policy_version 23183 (0.0006) [2023-12-25 23:45:17,385][123090] Updated weights for policy 1, policy_version 23193 (0.0005) [2023-12-25 23:45:18,012][123091] Updated weights for policy 0, policy_version 23139 (0.0006) [2023-12-25 23:45:18,061][123090] Updated weights for policy 1, policy_version 23203 (0.0007) [2023-12-25 23:45:18,068][123091] Updated weights for policy 0, policy_version 23149 (0.0008) [2023-12-25 23:45:18,113][123090] Updated weights for policy 1, policy_version 23213 (0.0010) [2023-12-25 23:45:18,124][123091] Updated weights for policy 0, policy_version 23159 (0.0006) [2023-12-25 23:45:18,165][123090] Updated weights for policy 1, policy_version 23223 (0.0010) [2023-12-25 23:45:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 11878400. Throughput: 0: 8830.5, 1: 9007.8. Samples: 11893012. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:45:18,785][121949] Avg episode reward: [(0, '3852.455'), (1, '3972.866')] [2023-12-25 23:45:18,785][123007] Saving new best policy, reward=3852.455! [2023-12-25 23:45:18,836][123091] Updated weights for policy 0, policy_version 23169 (0.0007) [2023-12-25 23:45:18,897][123091] Updated weights for policy 0, policy_version 23179 (0.0006) [2023-12-25 23:45:18,943][123091] Updated weights for policy 0, policy_version 23189 (0.0006) [2023-12-25 23:45:18,949][123090] Updated weights for policy 1, policy_version 23233 (0.0010) [2023-12-25 23:45:18,994][123091] Updated weights for policy 0, policy_version 23199 (0.0008) [2023-12-25 23:45:19,019][123090] Updated weights for policy 1, policy_version 23243 (0.0006) [2023-12-25 23:45:19,093][123090] Updated weights for policy 1, policy_version 23253 (0.0006) [2023-12-25 23:45:19,165][123090] Updated weights for policy 1, policy_version 23263 (0.0005) [2023-12-25 23:45:19,751][123091] Updated weights for policy 0, policy_version 23209 (0.0007) [2023-12-25 23:45:19,805][123091] Updated weights for policy 0, policy_version 23219 (0.0008) [2023-12-25 23:45:19,872][123091] Updated weights for policy 0, policy_version 23229 (0.0010) [2023-12-25 23:45:19,901][123090] Updated weights for policy 1, policy_version 23273 (0.0010) [2023-12-25 23:45:19,970][123090] Updated weights for policy 1, policy_version 23283 (0.0009) [2023-12-25 23:45:20,032][123090] Updated weights for policy 1, policy_version 23293 (0.0011) [2023-12-25 23:45:20,685][123091] Updated weights for policy 0, policy_version 23239 (0.0010) [2023-12-25 23:45:20,750][123091] Updated weights for policy 0, policy_version 23249 (0.0009) [2023-12-25 23:45:20,817][123091] Updated weights for policy 0, policy_version 23259 (0.0009) [2023-12-25 23:45:20,892][123090] Updated weights for policy 1, policy_version 23303 (0.0011) [2023-12-25 23:45:20,960][123090] Updated weights for policy 1, policy_version 23313 (0.0011) [2023-12-25 23:45:21,037][123090] Updated weights for policy 1, policy_version 23323 (0.0011) [2023-12-25 23:45:21,665][123091] Updated weights for policy 0, policy_version 23269 (0.0009) [2023-12-25 23:45:21,735][123091] Updated weights for policy 0, policy_version 23279 (0.0010) [2023-12-25 23:45:21,804][123091] Updated weights for policy 0, policy_version 23289 (0.0006) [2023-12-25 23:45:21,864][123090] Updated weights for policy 1, policy_version 23333 (0.0009) [2023-12-25 23:45:21,934][123090] Updated weights for policy 1, policy_version 23343 (0.0008) [2023-12-25 23:45:21,994][123090] Updated weights for policy 1, policy_version 23353 (0.0008) [2023-12-25 23:45:22,559][123091] Updated weights for policy 0, policy_version 23299 (0.0007) [2023-12-25 23:45:22,613][123091] Updated weights for policy 0, policy_version 23309 (0.0010) [2023-12-25 23:45:22,673][123091] Updated weights for policy 0, policy_version 23319 (0.0010) [2023-12-25 23:45:22,773][123090] Updated weights for policy 1, policy_version 23363 (0.0008) [2023-12-25 23:45:22,829][123090] Updated weights for policy 1, policy_version 23373 (0.0009) [2023-12-25 23:45:22,891][123090] Updated weights for policy 1, policy_version 23383 (0.0007) [2023-12-25 23:45:23,538][123091] Updated weights for policy 0, policy_version 23329 (0.0010) [2023-12-25 23:45:23,594][123091] Updated weights for policy 0, policy_version 23339 (0.0009) [2023-12-25 23:45:23,646][123091] Updated weights for policy 0, policy_version 23349 (0.0009) [2023-12-25 23:45:23,681][123090] Updated weights for policy 1, policy_version 23393 (0.0005) [2023-12-25 23:45:23,693][123091] Updated weights for policy 0, policy_version 23359 (0.0009) [2023-12-25 23:45:23,735][123090] Updated weights for policy 1, policy_version 23403 (0.0008) [2023-12-25 23:45:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 11968512. Throughput: 0: 8848.3, 1: 8996.0. Samples: 11946044. Policy #0 lag: (min: 16.0, avg: 31.4, max: 32.0) [2023-12-25 23:45:23,785][121949] Avg episode reward: [(0, '3861.686'), (1, '3949.230')] [2023-12-25 23:45:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000023360_5980160.pth... [2023-12-25 23:45:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000022336_5718016.pth [2023-12-25 23:45:23,799][123007] Saving new best policy, reward=3861.686! [2023-12-25 23:45:23,800][123090] Updated weights for policy 1, policy_version 23413 (0.0010) [2023-12-25 23:45:23,865][123090] Updated weights for policy 1, policy_version 23423 (0.0009) [2023-12-25 23:45:23,870][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000023424_5996544.pth... [2023-12-25 23:45:23,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000022336_5718016.pth [2023-12-25 23:45:24,538][123091] Updated weights for policy 0, policy_version 23369 (0.0009) [2023-12-25 23:45:24,587][123091] Updated weights for policy 0, policy_version 23379 (0.0009) [2023-12-25 23:45:24,641][123091] Updated weights for policy 0, policy_version 23389 (0.0009) [2023-12-25 23:45:24,707][123090] Updated weights for policy 1, policy_version 23433 (0.0007) [2023-12-25 23:45:24,775][123090] Updated weights for policy 1, policy_version 23443 (0.0005) [2023-12-25 23:45:24,849][123090] Updated weights for policy 1, policy_version 23453 (0.0008) [2023-12-25 23:45:25,474][123091] Updated weights for policy 0, policy_version 23399 (0.0008) [2023-12-25 23:45:25,527][123091] Updated weights for policy 0, policy_version 23409 (0.0009) [2023-12-25 23:45:25,582][123091] Updated weights for policy 0, policy_version 23419 (0.0009) [2023-12-25 23:45:25,602][123090] Updated weights for policy 1, policy_version 23463 (0.0007) [2023-12-25 23:45:25,650][123090] Updated weights for policy 1, policy_version 23473 (0.0005) [2023-12-25 23:45:25,696][123090] Updated weights for policy 1, policy_version 23483 (0.0005) [2023-12-25 23:45:26,406][123090] Updated weights for policy 1, policy_version 23493 (0.0005) [2023-12-25 23:45:26,456][123091] Updated weights for policy 0, policy_version 23429 (0.0008) [2023-12-25 23:45:26,460][123090] Updated weights for policy 1, policy_version 23503 (0.0005) [2023-12-25 23:45:26,509][123091] Updated weights for policy 0, policy_version 23439 (0.0009) [2023-12-25 23:45:26,513][123090] Updated weights for policy 1, policy_version 23513 (0.0005) [2023-12-25 23:45:26,570][123091] Updated weights for policy 0, policy_version 23449 (0.0010) [2023-12-25 23:45:27,162][123090] Updated weights for policy 1, policy_version 23523 (0.0005) [2023-12-25 23:45:27,229][123090] Updated weights for policy 1, policy_version 23533 (0.0005) [2023-12-25 23:45:27,277][123090] Updated weights for policy 1, policy_version 23543 (0.0005) [2023-12-25 23:45:27,503][123091] Updated weights for policy 0, policy_version 23459 (0.0010) [2023-12-25 23:45:27,557][123091] Updated weights for policy 0, policy_version 23469 (0.0010) [2023-12-25 23:45:27,616][123091] Updated weights for policy 0, policy_version 23479 (0.0010) [2023-12-25 23:45:27,929][123090] Updated weights for policy 1, policy_version 23553 (0.0005) [2023-12-25 23:45:27,990][123090] Updated weights for policy 1, policy_version 23563 (0.0006) [2023-12-25 23:45:28,053][123090] Updated weights for policy 1, policy_version 23573 (0.0005) [2023-12-25 23:45:28,118][123090] Updated weights for policy 1, policy_version 23583 (0.0005) [2023-12-25 23:45:28,533][123091] Updated weights for policy 0, policy_version 23489 (0.0010) [2023-12-25 23:45:28,593][123091] Updated weights for policy 0, policy_version 23499 (0.0005) [2023-12-25 23:45:28,669][123091] Updated weights for policy 0, policy_version 23509 (0.0006) [2023-12-25 23:45:28,733][123091] Updated weights for policy 0, policy_version 23519 (0.0007) [2023-12-25 23:45:28,745][123090] Updated weights for policy 1, policy_version 23593 (0.0009) [2023-12-25 23:45:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 12058624. Throughput: 0: 8785.9, 1: 9150.9. Samples: 12052004. Policy #0 lag: (min: 16.0, avg: 31.4, max: 32.0) [2023-12-25 23:45:28,785][121949] Avg episode reward: [(0, '3809.288'), (1, '3972.264')] [2023-12-25 23:45:28,805][123090] Updated weights for policy 1, policy_version 23603 (0.0010) [2023-12-25 23:45:28,867][123090] Updated weights for policy 1, policy_version 23613 (0.0010) [2023-12-25 23:45:29,407][123091] Updated weights for policy 0, policy_version 23529 (0.0009) [2023-12-25 23:45:29,470][123091] Updated weights for policy 0, policy_version 23539 (0.0009) [2023-12-25 23:45:29,532][123091] Updated weights for policy 0, policy_version 23549 (0.0010) [2023-12-25 23:45:29,709][123090] Updated weights for policy 1, policy_version 23623 (0.0010) [2023-12-25 23:45:29,774][123090] Updated weights for policy 1, policy_version 23633 (0.0006) [2023-12-25 23:45:29,843][123090] Updated weights for policy 1, policy_version 23643 (0.0007) [2023-12-25 23:45:30,393][123091] Updated weights for policy 0, policy_version 23559 (0.0009) [2023-12-25 23:45:30,447][123091] Updated weights for policy 0, policy_version 23569 (0.0009) [2023-12-25 23:45:30,496][123091] Updated weights for policy 0, policy_version 23579 (0.0009) [2023-12-25 23:45:30,570][123090] Updated weights for policy 1, policy_version 23653 (0.0008) [2023-12-25 23:45:30,640][123090] Updated weights for policy 1, policy_version 23663 (0.0009) [2023-12-25 23:45:30,703][123090] Updated weights for policy 1, policy_version 23673 (0.0008) [2023-12-25 23:45:31,358][123091] Updated weights for policy 0, policy_version 23589 (0.0008) [2023-12-25 23:45:31,431][123091] Updated weights for policy 0, policy_version 23599 (0.0008) [2023-12-25 23:45:31,479][123090] Updated weights for policy 1, policy_version 23683 (0.0009) [2023-12-25 23:45:31,492][123091] Updated weights for policy 0, policy_version 23609 (0.0008) [2023-12-25 23:45:31,535][123090] Updated weights for policy 1, policy_version 23693 (0.0008) [2023-12-25 23:45:31,598][123090] Updated weights for policy 1, policy_version 23703 (0.0008) [2023-12-25 23:45:32,230][123090] Updated weights for policy 1, policy_version 23713 (0.0008) [2023-12-25 23:45:32,297][123090] Updated weights for policy 1, policy_version 23723 (0.0009) [2023-12-25 23:45:32,345][123091] Updated weights for policy 0, policy_version 23619 (0.0007) [2023-12-25 23:45:32,356][123090] Updated weights for policy 1, policy_version 23734 (0.0010) [2023-12-25 23:45:32,408][123091] Updated weights for policy 0, policy_version 23629 (0.0007) [2023-12-25 23:45:32,422][123090] Updated weights for policy 1, policy_version 23744 (0.0007) [2023-12-25 23:45:32,469][123091] Updated weights for policy 0, policy_version 23639 (0.0010) [2023-12-25 23:45:33,125][123090] Updated weights for policy 1, policy_version 23754 (0.0005) [2023-12-25 23:45:33,191][123090] Updated weights for policy 1, policy_version 23764 (0.0005) [2023-12-25 23:45:33,264][123090] Updated weights for policy 1, policy_version 23774 (0.0005) [2023-12-25 23:45:33,359][123091] Updated weights for policy 0, policy_version 23649 (0.0010) [2023-12-25 23:45:33,409][123091] Updated weights for policy 0, policy_version 23659 (0.0009) [2023-12-25 23:45:33,457][123091] Updated weights for policy 0, policy_version 23669 (0.0008) [2023-12-25 23:45:33,509][123091] Updated weights for policy 0, policy_version 23679 (0.0010) [2023-12-25 23:45:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 12148736. Throughput: 0: 8689.0, 1: 9220.1. Samples: 12160432. Policy #0 lag: (min: 16.0, avg: 31.4, max: 32.0) [2023-12-25 23:45:33,784][121949] Avg episode reward: [(0, '3794.344'), (1, '4201.646')] [2023-12-25 23:45:33,785][123008] Saving new best policy, reward=4201.646! [2023-12-25 23:45:33,895][123090] Updated weights for policy 1, policy_version 23784 (0.0005) [2023-12-25 23:45:33,965][123090] Updated weights for policy 1, policy_version 23794 (0.0005) [2023-12-25 23:45:34,041][123090] Updated weights for policy 1, policy_version 23804 (0.0005) [2023-12-25 23:45:34,403][123091] Updated weights for policy 0, policy_version 23689 (0.0006) [2023-12-25 23:45:34,465][123091] Updated weights for policy 0, policy_version 23699 (0.0006) [2023-12-25 23:45:34,543][123091] Updated weights for policy 0, policy_version 23709 (0.0006) [2023-12-25 23:45:34,807][123090] Updated weights for policy 1, policy_version 23814 (0.0008) [2023-12-25 23:45:34,872][123090] Updated weights for policy 1, policy_version 23824 (0.0009) [2023-12-25 23:45:34,925][123090] Updated weights for policy 1, policy_version 23834 (0.0009) [2023-12-25 23:45:35,135][123091] Updated weights for policy 0, policy_version 23719 (0.0007) [2023-12-25 23:45:35,198][123091] Updated weights for policy 0, policy_version 23729 (0.0005) [2023-12-25 23:45:35,258][123091] Updated weights for policy 0, policy_version 23739 (0.0005) [2023-12-25 23:45:35,764][123090] Updated weights for policy 1, policy_version 23844 (0.0008) [2023-12-25 23:45:35,812][123090] Updated weights for policy 1, policy_version 23854 (0.0005) [2023-12-25 23:45:35,867][123090] Updated weights for policy 1, policy_version 23864 (0.0005) [2023-12-25 23:45:35,869][123091] Updated weights for policy 0, policy_version 23749 (0.0006) [2023-12-25 23:45:35,920][123091] Updated weights for policy 0, policy_version 23759 (0.0008) [2023-12-25 23:45:35,975][123091] Updated weights for policy 0, policy_version 23769 (0.0010) [2023-12-25 23:45:36,676][123090] Updated weights for policy 1, policy_version 23874 (0.0006) [2023-12-25 23:45:36,744][123090] Updated weights for policy 1, policy_version 23884 (0.0009) [2023-12-25 23:45:36,796][123091] Updated weights for policy 0, policy_version 23779 (0.0010) [2023-12-25 23:45:36,810][123090] Updated weights for policy 1, policy_version 23894 (0.0007) [2023-12-25 23:45:36,857][123091] Updated weights for policy 0, policy_version 23789 (0.0009) [2023-12-25 23:45:36,880][123090] Updated weights for policy 1, policy_version 23904 (0.0005) [2023-12-25 23:45:36,917][123091] Updated weights for policy 0, policy_version 23799 (0.0009) [2023-12-25 23:45:37,666][123090] Updated weights for policy 1, policy_version 23914 (0.0010) [2023-12-25 23:45:37,727][123090] Updated weights for policy 1, policy_version 23924 (0.0010) [2023-12-25 23:45:37,756][123091] Updated weights for policy 0, policy_version 23809 (0.0009) [2023-12-25 23:45:37,790][123090] Updated weights for policy 1, policy_version 23934 (0.0008) [2023-12-25 23:45:37,810][123091] Updated weights for policy 0, policy_version 23819 (0.0010) [2023-12-25 23:45:37,866][123091] Updated weights for policy 0, policy_version 23829 (0.0010) [2023-12-25 23:45:37,929][123091] Updated weights for policy 0, policy_version 23839 (0.0009) [2023-12-25 23:45:38,621][123090] Updated weights for policy 1, policy_version 23944 (0.0006) [2023-12-25 23:45:38,695][123090] Updated weights for policy 1, policy_version 23954 (0.0006) [2023-12-25 23:45:38,768][123090] Updated weights for policy 1, policy_version 23964 (0.0005) [2023-12-25 23:45:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 12230656. Throughput: 0: 8697.2, 1: 9213.3. Samples: 12215540. Policy #0 lag: (min: 10.0, avg: 21.8, max: 42.0) [2023-12-25 23:45:38,785][121949] Avg episode reward: [(0, '3845.324'), (1, '4087.494')] [2023-12-25 23:45:38,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000023968_6135808.pth... [2023-12-25 23:45:38,798][123091] Updated weights for policy 0, policy_version 23849 (0.0009) [2023-12-25 23:45:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000022880_5857280.pth [2023-12-25 23:45:38,870][123091] Updated weights for policy 0, policy_version 23859 (0.0009) [2023-12-25 23:45:38,936][123091] Updated weights for policy 0, policy_version 23869 (0.0008) [2023-12-25 23:45:38,954][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000023872_6111232.pth... [2023-12-25 23:45:38,959][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000022848_5849088.pth [2023-12-25 23:45:39,553][123090] Updated weights for policy 1, policy_version 23974 (0.0009) [2023-12-25 23:45:39,621][123090] Updated weights for policy 1, policy_version 23984 (0.0010) [2023-12-25 23:45:39,679][123090] Updated weights for policy 1, policy_version 23994 (0.0009) [2023-12-25 23:45:39,754][123091] Updated weights for policy 0, policy_version 23879 (0.0009) [2023-12-25 23:45:39,825][123091] Updated weights for policy 0, policy_version 23889 (0.0009) [2023-12-25 23:45:39,894][123091] Updated weights for policy 0, policy_version 23899 (0.0008) [2023-12-25 23:45:40,512][123090] Updated weights for policy 1, policy_version 24004 (0.0008) [2023-12-25 23:45:40,580][123090] Updated weights for policy 1, policy_version 24014 (0.0005) [2023-12-25 23:45:40,646][123090] Updated weights for policy 1, policy_version 24024 (0.0006) [2023-12-25 23:45:40,662][123091] Updated weights for policy 0, policy_version 23909 (0.0008) [2023-12-25 23:45:40,728][123091] Updated weights for policy 0, policy_version 23919 (0.0009) [2023-12-25 23:45:40,791][123091] Updated weights for policy 0, policy_version 23929 (0.0008) [2023-12-25 23:45:41,402][123090] Updated weights for policy 1, policy_version 24034 (0.0007) [2023-12-25 23:45:41,462][123090] Updated weights for policy 1, policy_version 24044 (0.0009) [2023-12-25 23:45:41,526][123090] Updated weights for policy 1, policy_version 24054 (0.0009) [2023-12-25 23:45:41,599][123090] Updated weights for policy 1, policy_version 24064 (0.0009) [2023-12-25 23:45:41,660][123091] Updated weights for policy 0, policy_version 23939 (0.0010) [2023-12-25 23:45:41,733][123091] Updated weights for policy 0, policy_version 23949 (0.0010) [2023-12-25 23:45:41,801][123091] Updated weights for policy 0, policy_version 23959 (0.0009) [2023-12-25 23:45:42,455][123090] Updated weights for policy 1, policy_version 24074 (0.0009) [2023-12-25 23:45:42,506][123090] Updated weights for policy 1, policy_version 24084 (0.0010) [2023-12-25 23:45:42,569][123090] Updated weights for policy 1, policy_version 24094 (0.0010) [2023-12-25 23:45:42,680][123091] Updated weights for policy 0, policy_version 23969 (0.0009) [2023-12-25 23:45:42,734][123091] Updated weights for policy 0, policy_version 23979 (0.0010) [2023-12-25 23:45:42,787][123091] Updated weights for policy 0, policy_version 23989 (0.0010) [2023-12-25 23:45:42,842][123091] Updated weights for policy 0, policy_version 23999 (0.0010) [2023-12-25 23:45:43,370][123090] Updated weights for policy 1, policy_version 24104 (0.0005) [2023-12-25 23:45:43,423][123090] Updated weights for policy 1, policy_version 24114 (0.0005) [2023-12-25 23:45:43,481][123090] Updated weights for policy 1, policy_version 24124 (0.0005) [2023-12-25 23:45:43,755][123091] Updated weights for policy 0, policy_version 24010 (0.0010) [2023-12-25 23:45:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 12320768. Throughput: 0: 8655.5, 1: 9082.5. Samples: 12316796. Policy #0 lag: (min: 10.0, avg: 21.8, max: 42.0) [2023-12-25 23:45:43,784][121949] Avg episode reward: [(0, '3853.349'), (1, '3905.353')] [2023-12-25 23:45:43,807][123091] Updated weights for policy 0, policy_version 24021 (0.0010) [2023-12-25 23:45:43,874][123091] Updated weights for policy 0, policy_version 24031 (0.0008) [2023-12-25 23:45:44,220][123090] Updated weights for policy 1, policy_version 24134 (0.0008) [2023-12-25 23:45:44,286][123090] Updated weights for policy 1, policy_version 24144 (0.0009) [2023-12-25 23:45:44,355][123090] Updated weights for policy 1, policy_version 24154 (0.0010) [2023-12-25 23:45:44,714][123091] Updated weights for policy 0, policy_version 24041 (0.0009) [2023-12-25 23:45:44,775][123091] Updated weights for policy 0, policy_version 24051 (0.0009) [2023-12-25 23:45:44,834][123091] Updated weights for policy 0, policy_version 24061 (0.0009) [2023-12-25 23:45:45,174][123090] Updated weights for policy 1, policy_version 24164 (0.0010) [2023-12-25 23:45:45,225][123090] Updated weights for policy 1, policy_version 24174 (0.0009) [2023-12-25 23:45:45,290][123090] Updated weights for policy 1, policy_version 24184 (0.0010) [2023-12-25 23:45:45,677][123091] Updated weights for policy 0, policy_version 24071 (0.0008) [2023-12-25 23:45:45,739][123091] Updated weights for policy 0, policy_version 24081 (0.0008) [2023-12-25 23:45:45,804][123091] Updated weights for policy 0, policy_version 24091 (0.0008) [2023-12-25 23:45:46,187][123090] Updated weights for policy 1, policy_version 24194 (0.0008) [2023-12-25 23:45:46,244][123090] Updated weights for policy 1, policy_version 24204 (0.0006) [2023-12-25 23:45:46,301][123090] Updated weights for policy 1, policy_version 24214 (0.0008) [2023-12-25 23:45:46,353][123090] Updated weights for policy 1, policy_version 24224 (0.0010) [2023-12-25 23:45:46,544][123091] Updated weights for policy 0, policy_version 24101 (0.0007) [2023-12-25 23:45:46,604][123091] Updated weights for policy 0, policy_version 24111 (0.0010) [2023-12-25 23:45:46,658][123091] Updated weights for policy 0, policy_version 24121 (0.0010) [2023-12-25 23:45:47,128][123090] Updated weights for policy 1, policy_version 24234 (0.0009) [2023-12-25 23:45:47,191][123090] Updated weights for policy 1, policy_version 24244 (0.0009) [2023-12-25 23:45:47,258][123090] Updated weights for policy 1, policy_version 24254 (0.0010) [2023-12-25 23:45:47,558][123091] Updated weights for policy 0, policy_version 24131 (0.0009) [2023-12-25 23:45:47,610][123091] Updated weights for policy 0, policy_version 24141 (0.0009) [2023-12-25 23:45:47,678][123091] Updated weights for policy 0, policy_version 24151 (0.0009) [2023-12-25 23:45:48,127][123090] Updated weights for policy 1, policy_version 24264 (0.0010) [2023-12-25 23:45:48,192][123090] Updated weights for policy 1, policy_version 24274 (0.0009) [2023-12-25 23:45:48,256][123090] Updated weights for policy 1, policy_version 24284 (0.0010) [2023-12-25 23:45:48,493][123091] Updated weights for policy 0, policy_version 24161 (0.0008) [2023-12-25 23:45:48,545][123091] Updated weights for policy 0, policy_version 24171 (0.0008) [2023-12-25 23:45:48,600][123091] Updated weights for policy 0, policy_version 24181 (0.0008) [2023-12-25 23:45:48,666][123091] Updated weights for policy 0, policy_version 24191 (0.0008) [2023-12-25 23:45:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 12410880. Throughput: 0: 8669.0, 1: 9002.0. Samples: 12419880. Policy #0 lag: (min: 10.0, avg: 21.8, max: 42.0) [2023-12-25 23:45:48,785][121949] Avg episode reward: [(0, '3850.406'), (1, '3856.968')] [2023-12-25 23:45:49,155][123090] Updated weights for policy 1, policy_version 24294 (0.0011) [2023-12-25 23:45:49,216][123090] Updated weights for policy 1, policy_version 24304 (0.0011) [2023-12-25 23:45:49,284][123090] Updated weights for policy 1, policy_version 24314 (0.0011) [2023-12-25 23:45:49,548][123091] Updated weights for policy 0, policy_version 24201 (0.0010) [2023-12-25 23:45:49,605][123091] Updated weights for policy 0, policy_version 24211 (0.0009) [2023-12-25 23:45:49,674][123091] Updated weights for policy 0, policy_version 24221 (0.0006) [2023-12-25 23:45:50,051][123090] Updated weights for policy 1, policy_version 24324 (0.0010) [2023-12-25 23:45:50,120][123090] Updated weights for policy 1, policy_version 24334 (0.0010) [2023-12-25 23:45:50,185][123090] Updated weights for policy 1, policy_version 24344 (0.0010) [2023-12-25 23:45:50,491][123091] Updated weights for policy 0, policy_version 24231 (0.0008) [2023-12-25 23:45:50,559][123091] Updated weights for policy 0, policy_version 24241 (0.0008) [2023-12-25 23:45:50,627][123091] Updated weights for policy 0, policy_version 24251 (0.0009) [2023-12-25 23:45:51,026][123090] Updated weights for policy 1, policy_version 24354 (0.0010) [2023-12-25 23:45:51,101][123090] Updated weights for policy 1, policy_version 24364 (0.0009) [2023-12-25 23:45:51,171][123090] Updated weights for policy 1, policy_version 24374 (0.0010) [2023-12-25 23:45:51,239][123090] Updated weights for policy 1, policy_version 24384 (0.0010) [2023-12-25 23:45:51,500][123091] Updated weights for policy 0, policy_version 24261 (0.0009) [2023-12-25 23:45:51,565][123091] Updated weights for policy 0, policy_version 24271 (0.0009) [2023-12-25 23:45:51,625][123091] Updated weights for policy 0, policy_version 24281 (0.0009) [2023-12-25 23:45:52,152][123090] Updated weights for policy 1, policy_version 24394 (0.0008) [2023-12-25 23:45:52,218][123090] Updated weights for policy 1, policy_version 24404 (0.0009) [2023-12-25 23:45:52,282][123090] Updated weights for policy 1, policy_version 24414 (0.0010) [2023-12-25 23:45:52,446][123091] Updated weights for policy 0, policy_version 24291 (0.0008) [2023-12-25 23:45:52,520][123091] Updated weights for policy 0, policy_version 24301 (0.0007) [2023-12-25 23:45:52,590][123091] Updated weights for policy 0, policy_version 24311 (0.0010) [2023-12-25 23:45:53,082][123090] Updated weights for policy 1, policy_version 24424 (0.0007) [2023-12-25 23:45:53,137][123090] Updated weights for policy 1, policy_version 24434 (0.0006) [2023-12-25 23:45:53,184][123090] Updated weights for policy 1, policy_version 24444 (0.0007) [2023-12-25 23:45:53,373][123091] Updated weights for policy 0, policy_version 24321 (0.0011) [2023-12-25 23:45:53,435][123091] Updated weights for policy 0, policy_version 24331 (0.0011) [2023-12-25 23:45:53,490][123091] Updated weights for policy 0, policy_version 24341 (0.0010) [2023-12-25 23:45:53,550][123091] Updated weights for policy 0, policy_version 24351 (0.0011) [2023-12-25 23:45:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 12492800. Throughput: 0: 8590.9, 1: 8948.8. Samples: 12469704. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-25 23:45:53,785][121949] Avg episode reward: [(0, '3768.170'), (1, '3995.399')] [2023-12-25 23:45:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000024352_6234112.pth... [2023-12-25 23:45:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000023360_5980160.pth [2023-12-25 23:45:53,818][123090] Updated weights for policy 1, policy_version 24454 (0.0006) [2023-12-25 23:45:53,875][123090] Updated weights for policy 1, policy_version 24464 (0.0006) [2023-12-25 23:45:53,928][123090] Updated weights for policy 1, policy_version 24474 (0.0005) [2023-12-25 23:45:53,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000024480_6266880.pth... [2023-12-25 23:45:53,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000023424_5996544.pth [2023-12-25 23:45:54,380][123091] Updated weights for policy 0, policy_version 24361 (0.0011) [2023-12-25 23:45:54,440][123091] Updated weights for policy 0, policy_version 24371 (0.0010) [2023-12-25 23:45:54,495][123091] Updated weights for policy 0, policy_version 24381 (0.0010) [2023-12-25 23:45:54,654][123090] Updated weights for policy 1, policy_version 24484 (0.0007) [2023-12-25 23:45:54,705][123090] Updated weights for policy 1, policy_version 24494 (0.0010) [2023-12-25 23:45:54,753][123090] Updated weights for policy 1, policy_version 24504 (0.0010) [2023-12-25 23:45:55,262][123091] Updated weights for policy 0, policy_version 24391 (0.0007) [2023-12-25 23:45:55,318][123091] Updated weights for policy 0, policy_version 24401 (0.0008) [2023-12-25 23:45:55,387][123091] Updated weights for policy 0, policy_version 24411 (0.0009) [2023-12-25 23:45:55,561][123090] Updated weights for policy 1, policy_version 24514 (0.0009) [2023-12-25 23:45:55,620][123090] Updated weights for policy 1, policy_version 24524 (0.0005) [2023-12-25 23:45:55,673][123090] Updated weights for policy 1, policy_version 24534 (0.0005) [2023-12-25 23:45:55,737][123090] Updated weights for policy 1, policy_version 24544 (0.0005) [2023-12-25 23:45:56,229][123091] Updated weights for policy 0, policy_version 24421 (0.0009) [2023-12-25 23:45:56,288][123091] Updated weights for policy 0, policy_version 24432 (0.0007) [2023-12-25 23:45:56,343][123091] Updated weights for policy 0, policy_version 24442 (0.0005) [2023-12-25 23:45:56,474][123090] Updated weights for policy 1, policy_version 24554 (0.0006) [2023-12-25 23:45:56,538][123090] Updated weights for policy 1, policy_version 24564 (0.0006) [2023-12-25 23:45:56,592][123090] Updated weights for policy 1, policy_version 24575 (0.0006) [2023-12-25 23:45:56,921][123091] Updated weights for policy 0, policy_version 24452 (0.0007) [2023-12-25 23:45:56,973][123091] Updated weights for policy 0, policy_version 24462 (0.0011) [2023-12-25 23:45:57,037][123091] Updated weights for policy 0, policy_version 24472 (0.0011) [2023-12-25 23:45:57,255][123090] Updated weights for policy 1, policy_version 24585 (0.0005) [2023-12-25 23:45:57,317][123090] Updated weights for policy 1, policy_version 24595 (0.0005) [2023-12-25 23:45:57,378][123090] Updated weights for policy 1, policy_version 24605 (0.0006) [2023-12-25 23:45:57,825][123091] Updated weights for policy 0, policy_version 24482 (0.0009) [2023-12-25 23:45:57,880][123091] Updated weights for policy 0, policy_version 24492 (0.0006) [2023-12-25 23:45:57,935][123091] Updated weights for policy 0, policy_version 24502 (0.0006) [2023-12-25 23:45:58,005][123091] Updated weights for policy 0, policy_version 24512 (0.0007) [2023-12-25 23:45:58,044][123090] Updated weights for policy 1, policy_version 24615 (0.0009) [2023-12-25 23:45:58,111][123090] Updated weights for policy 1, policy_version 24625 (0.0010) [2023-12-25 23:45:58,169][123090] Updated weights for policy 1, policy_version 24635 (0.0010) [2023-12-25 23:45:58,775][123091] Updated weights for policy 0, policy_version 24522 (0.0010) [2023-12-25 23:45:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 12582912. Throughput: 0: 8624.0, 1: 9011.5. Samples: 12579552. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-25 23:45:58,785][121949] Avg episode reward: [(0, '3756.692'), (1, '3949.626')] [2023-12-25 23:45:58,843][123091] Updated weights for policy 0, policy_version 24532 (0.0010) [2023-12-25 23:45:58,911][123091] Updated weights for policy 0, policy_version 24542 (0.0009) [2023-12-25 23:45:58,994][123090] Updated weights for policy 1, policy_version 24645 (0.0009) [2023-12-25 23:45:59,053][123090] Updated weights for policy 1, policy_version 24655 (0.0010) [2023-12-25 23:45:59,112][123090] Updated weights for policy 1, policy_version 24665 (0.0010) [2023-12-25 23:45:59,714][123091] Updated weights for policy 0, policy_version 24552 (0.0010) [2023-12-25 23:45:59,772][123091] Updated weights for policy 0, policy_version 24562 (0.0010) [2023-12-25 23:45:59,837][123091] Updated weights for policy 0, policy_version 24572 (0.0010) [2023-12-25 23:45:59,943][123090] Updated weights for policy 1, policy_version 24675 (0.0010) [2023-12-25 23:46:00,008][123090] Updated weights for policy 1, policy_version 24685 (0.0009) [2023-12-25 23:46:00,076][123090] Updated weights for policy 1, policy_version 24695 (0.0006) [2023-12-25 23:46:00,697][123091] Updated weights for policy 0, policy_version 24582 (0.0007) [2023-12-25 23:46:00,765][123091] Updated weights for policy 0, policy_version 24592 (0.0005) [2023-12-25 23:46:00,813][123090] Updated weights for policy 1, policy_version 24705 (0.0005) [2023-12-25 23:46:00,835][123091] Updated weights for policy 0, policy_version 24602 (0.0007) [2023-12-25 23:46:00,883][123090] Updated weights for policy 1, policy_version 24715 (0.0008) [2023-12-25 23:46:00,954][123090] Updated weights for policy 1, policy_version 24725 (0.0010) [2023-12-25 23:46:01,012][123090] Updated weights for policy 1, policy_version 24735 (0.0010) [2023-12-25 23:46:01,592][123091] Updated weights for policy 0, policy_version 24612 (0.0007) [2023-12-25 23:46:01,662][123091] Updated weights for policy 0, policy_version 24622 (0.0009) [2023-12-25 23:46:01,729][123091] Updated weights for policy 0, policy_version 24632 (0.0008) [2023-12-25 23:46:01,913][123090] Updated weights for policy 1, policy_version 24745 (0.0006) [2023-12-25 23:46:01,969][123090] Updated weights for policy 1, policy_version 24755 (0.0005) [2023-12-25 23:46:02,037][123090] Updated weights for policy 1, policy_version 24765 (0.0006) [2023-12-25 23:46:02,652][123091] Updated weights for policy 0, policy_version 24642 (0.0009) [2023-12-25 23:46:02,696][123091] Updated weights for policy 0, policy_version 24652 (0.0009) [2023-12-25 23:46:02,700][123090] Updated weights for policy 1, policy_version 24775 (0.0009) [2023-12-25 23:46:02,746][123091] Updated weights for policy 0, policy_version 24662 (0.0008) [2023-12-25 23:46:02,759][123090] Updated weights for policy 1, policy_version 24785 (0.0010) [2023-12-25 23:46:02,804][123091] Updated weights for policy 0, policy_version 24672 (0.0007) [2023-12-25 23:46:02,822][123090] Updated weights for policy 1, policy_version 24795 (0.0010) [2023-12-25 23:46:03,533][123090] Updated weights for policy 1, policy_version 24805 (0.0010) [2023-12-25 23:46:03,589][123090] Updated weights for policy 1, policy_version 24815 (0.0009) [2023-12-25 23:46:03,610][123091] Updated weights for policy 0, policy_version 24682 (0.0008) [2023-12-25 23:46:03,651][123090] Updated weights for policy 1, policy_version 24825 (0.0008) [2023-12-25 23:46:03,655][123091] Updated weights for policy 0, policy_version 24692 (0.0009) [2023-12-25 23:46:03,702][123091] Updated weights for policy 0, policy_version 24702 (0.0008) [2023-12-25 23:46:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 12681216. Throughput: 0: 8605.4, 1: 9014.7. Samples: 12685916. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-25 23:46:03,785][121949] Avg episode reward: [(0, '3846.178'), (1, '3959.251')] [2023-12-25 23:46:04,431][123090] Updated weights for policy 1, policy_version 24835 (0.0008) [2023-12-25 23:46:04,489][123090] Updated weights for policy 1, policy_version 24845 (0.0009) [2023-12-25 23:46:04,545][123090] Updated weights for policy 1, policy_version 24855 (0.0008) [2023-12-25 23:46:04,615][123091] Updated weights for policy 0, policy_version 24712 (0.0010) [2023-12-25 23:46:04,668][123091] Updated weights for policy 0, policy_version 24722 (0.0009) [2023-12-25 23:46:04,722][123091] Updated weights for policy 0, policy_version 24733 (0.0010) [2023-12-25 23:46:05,235][123090] Updated weights for policy 1, policy_version 24865 (0.0005) [2023-12-25 23:46:05,305][123090] Updated weights for policy 1, policy_version 24875 (0.0007) [2023-12-25 23:46:05,357][123090] Updated weights for policy 1, policy_version 24885 (0.0008) [2023-12-25 23:46:05,407][123090] Updated weights for policy 1, policy_version 24895 (0.0005) [2023-12-25 23:46:05,628][123091] Updated weights for policy 0, policy_version 24743 (0.0010) [2023-12-25 23:46:05,690][123091] Updated weights for policy 0, policy_version 24753 (0.0010) [2023-12-25 23:46:05,747][123091] Updated weights for policy 0, policy_version 24763 (0.0010) [2023-12-25 23:46:06,138][123090] Updated weights for policy 1, policy_version 24905 (0.0010) [2023-12-25 23:46:06,205][123090] Updated weights for policy 1, policy_version 24915 (0.0011) [2023-12-25 23:46:06,272][123090] Updated weights for policy 1, policy_version 24925 (0.0010) [2023-12-25 23:46:06,603][123091] Updated weights for policy 0, policy_version 24773 (0.0009) [2023-12-25 23:46:06,652][123091] Updated weights for policy 0, policy_version 24783 (0.0009) [2023-12-25 23:46:06,706][123091] Updated weights for policy 0, policy_version 24793 (0.0009) [2023-12-25 23:46:07,050][123090] Updated weights for policy 1, policy_version 24935 (0.0007) [2023-12-25 23:46:07,097][123090] Updated weights for policy 1, policy_version 24945 (0.0009) [2023-12-25 23:46:07,153][123090] Updated weights for policy 1, policy_version 24955 (0.0010) [2023-12-25 23:46:07,613][123091] Updated weights for policy 0, policy_version 24803 (0.0010) [2023-12-25 23:46:07,664][123091] Updated weights for policy 0, policy_version 24814 (0.0008) [2023-12-25 23:46:07,711][123091] Updated weights for policy 0, policy_version 24824 (0.0005) [2023-12-25 23:46:07,885][123090] Updated weights for policy 1, policy_version 24965 (0.0008) [2023-12-25 23:46:07,942][123090] Updated weights for policy 1, policy_version 24975 (0.0005) [2023-12-25 23:46:07,990][123090] Updated weights for policy 1, policy_version 24985 (0.0007) [2023-12-25 23:46:08,480][123091] Updated weights for policy 0, policy_version 24834 (0.0007) [2023-12-25 23:46:08,545][123091] Updated weights for policy 0, policy_version 24844 (0.0009) [2023-12-25 23:46:08,610][123091] Updated weights for policy 0, policy_version 24854 (0.0009) [2023-12-25 23:46:08,667][123090] Updated weights for policy 1, policy_version 24995 (0.0005) [2023-12-25 23:46:08,669][123091] Updated weights for policy 0, policy_version 24864 (0.0008) [2023-12-25 23:46:08,729][123090] Updated weights for policy 1, policy_version 25005 (0.0005) [2023-12-25 23:46:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 12763136. Throughput: 0: 8553.2, 1: 9054.8. Samples: 12738400. Policy #0 lag: (min: 31.0, avg: 36.1, max: 63.0) [2023-12-25 23:46:08,785][121949] Avg episode reward: [(0, '3876.207'), (1, '4030.142')] [2023-12-25 23:46:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000024864_6365184.pth... [2023-12-25 23:46:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000023872_6111232.pth [2023-12-25 23:46:08,798][123007] Saving new best policy, reward=3876.207! [2023-12-25 23:46:08,803][123090] Updated weights for policy 1, policy_version 25015 (0.0008) [2023-12-25 23:46:08,857][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000025024_6406144.pth... [2023-12-25 23:46:08,861][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000023968_6135808.pth [2023-12-25 23:46:09,480][123091] Updated weights for policy 0, policy_version 24874 (0.0009) [2023-12-25 23:46:09,533][123091] Updated weights for policy 0, policy_version 24884 (0.0009) [2023-12-25 23:46:09,546][123090] Updated weights for policy 1, policy_version 25025 (0.0010) [2023-12-25 23:46:09,590][123091] Updated weights for policy 0, policy_version 24894 (0.0009) [2023-12-25 23:46:09,606][123090] Updated weights for policy 1, policy_version 25035 (0.0006) [2023-12-25 23:46:09,671][123090] Updated weights for policy 1, policy_version 25045 (0.0010) [2023-12-25 23:46:09,736][123090] Updated weights for policy 1, policy_version 25055 (0.0010) [2023-12-25 23:46:10,363][123091] Updated weights for policy 0, policy_version 24904 (0.0009) [2023-12-25 23:46:10,432][123091] Updated weights for policy 0, policy_version 24914 (0.0010) [2023-12-25 23:46:10,495][123091] Updated weights for policy 0, policy_version 24924 (0.0011) [2023-12-25 23:46:10,544][123090] Updated weights for policy 1, policy_version 25065 (0.0010) [2023-12-25 23:46:10,607][123090] Updated weights for policy 1, policy_version 25075 (0.0010) [2023-12-25 23:46:10,666][123090] Updated weights for policy 1, policy_version 25085 (0.0010) [2023-12-25 23:46:11,309][123091] Updated weights for policy 0, policy_version 24934 (0.0008) [2023-12-25 23:46:11,374][123091] Updated weights for policy 0, policy_version 24944 (0.0007) [2023-12-25 23:46:11,445][123091] Updated weights for policy 0, policy_version 24954 (0.0011) [2023-12-25 23:46:11,508][123090] Updated weights for policy 1, policy_version 25095 (0.0010) [2023-12-25 23:46:11,563][123090] Updated weights for policy 1, policy_version 25105 (0.0010) [2023-12-25 23:46:11,622][123090] Updated weights for policy 1, policy_version 25115 (0.0009) [2023-12-25 23:46:12,270][123091] Updated weights for policy 0, policy_version 24964 (0.0010) [2023-12-25 23:46:12,339][123091] Updated weights for policy 0, policy_version 24974 (0.0011) [2023-12-25 23:46:12,409][123091] Updated weights for policy 0, policy_version 24984 (0.0011) [2023-12-25 23:46:12,433][123090] Updated weights for policy 1, policy_version 25125 (0.0010) [2023-12-25 23:46:12,503][123090] Updated weights for policy 1, policy_version 25135 (0.0007) [2023-12-25 23:46:12,577][123090] Updated weights for policy 1, policy_version 25145 (0.0008) [2023-12-25 23:46:13,262][123091] Updated weights for policy 0, policy_version 24994 (0.0011) [2023-12-25 23:46:13,321][123091] Updated weights for policy 0, policy_version 25004 (0.0010) [2023-12-25 23:46:13,375][123090] Updated weights for policy 1, policy_version 25155 (0.0009) [2023-12-25 23:46:13,380][123091] Updated weights for policy 0, policy_version 25014 (0.0010) [2023-12-25 23:46:13,439][123090] Updated weights for policy 1, policy_version 25165 (0.0005) [2023-12-25 23:46:13,439][123091] Updated weights for policy 0, policy_version 25024 (0.0011) [2023-12-25 23:46:13,509][123090] Updated weights for policy 1, policy_version 25175 (0.0005) [2023-12-25 23:46:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 12853248. Throughput: 0: 8590.7, 1: 9020.4. Samples: 12844500. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-25 23:46:13,785][121949] Avg episode reward: [(0, '3919.077'), (1, '4080.405')] [2023-12-25 23:46:13,787][123007] Saving new best policy, reward=3919.077! [2023-12-25 23:46:14,139][123091] Updated weights for policy 0, policy_version 25034 (0.0006) [2023-12-25 23:46:14,205][123091] Updated weights for policy 0, policy_version 25044 (0.0005) [2023-12-25 23:46:14,235][123090] Updated weights for policy 1, policy_version 25185 (0.0006) [2023-12-25 23:46:14,264][123091] Updated weights for policy 0, policy_version 25054 (0.0005) [2023-12-25 23:46:14,295][123090] Updated weights for policy 1, policy_version 25195 (0.0010) [2023-12-25 23:46:14,356][123090] Updated weights for policy 1, policy_version 25205 (0.0010) [2023-12-25 23:46:14,415][123090] Updated weights for policy 1, policy_version 25215 (0.0010) [2023-12-25 23:46:15,071][123091] Updated weights for policy 0, policy_version 25064 (0.0010) [2023-12-25 23:46:15,130][123091] Updated weights for policy 0, policy_version 25074 (0.0011) [2023-12-25 23:46:15,183][123091] Updated weights for policy 0, policy_version 25084 (0.0011) [2023-12-25 23:46:15,227][123090] Updated weights for policy 1, policy_version 25225 (0.0010) [2023-12-25 23:46:15,298][123090] Updated weights for policy 1, policy_version 25235 (0.0010) [2023-12-25 23:46:15,358][123090] Updated weights for policy 1, policy_version 25245 (0.0010) [2023-12-25 23:46:15,976][123091] Updated weights for policy 0, policy_version 25094 (0.0010) [2023-12-25 23:46:16,023][123091] Updated weights for policy 0, policy_version 25104 (0.0008) [2023-12-25 23:46:16,073][123091] Updated weights for policy 0, policy_version 25115 (0.0009) [2023-12-25 23:46:16,148][123090] Updated weights for policy 1, policy_version 25255 (0.0007) [2023-12-25 23:46:16,206][123090] Updated weights for policy 1, policy_version 25265 (0.0006) [2023-12-25 23:46:16,253][123090] Updated weights for policy 1, policy_version 25275 (0.0010) [2023-12-25 23:46:16,921][123091] Updated weights for policy 0, policy_version 25125 (0.0008) [2023-12-25 23:46:16,975][123091] Updated weights for policy 0, policy_version 25135 (0.0006) [2023-12-25 23:46:17,041][123091] Updated weights for policy 0, policy_version 25145 (0.0007) [2023-12-25 23:46:17,069][123090] Updated weights for policy 1, policy_version 25285 (0.0011) [2023-12-25 23:46:17,129][123090] Updated weights for policy 1, policy_version 25295 (0.0011) [2023-12-25 23:46:17,196][123090] Updated weights for policy 1, policy_version 25305 (0.0010) [2023-12-25 23:46:17,700][123091] Updated weights for policy 0, policy_version 25155 (0.0007) [2023-12-25 23:46:17,762][123091] Updated weights for policy 0, policy_version 25165 (0.0011) [2023-12-25 23:46:17,822][123091] Updated weights for policy 0, policy_version 25175 (0.0010) [2023-12-25 23:46:18,019][123090] Updated weights for policy 1, policy_version 25315 (0.0011) [2023-12-25 23:46:18,076][123090] Updated weights for policy 1, policy_version 25325 (0.0010) [2023-12-25 23:46:18,128][123090] Updated weights for policy 1, policy_version 25335 (0.0011) [2023-12-25 23:46:18,641][123091] Updated weights for policy 0, policy_version 25185 (0.0010) [2023-12-25 23:46:18,692][123091] Updated weights for policy 0, policy_version 25195 (0.0008) [2023-12-25 23:46:18,754][123091] Updated weights for policy 0, policy_version 25205 (0.0006) [2023-12-25 23:46:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 12935168. Throughput: 0: 8677.3, 1: 8924.9. Samples: 12952532. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-25 23:46:18,785][121949] Avg episode reward: [(0, '3999.528'), (1, '4153.870')] [2023-12-25 23:46:18,818][123091] Updated weights for policy 0, policy_version 25215 (0.0006) [2023-12-25 23:46:18,824][123007] Saving new best policy, reward=3999.528! [2023-12-25 23:46:18,902][123090] Updated weights for policy 1, policy_version 25345 (0.0010) [2023-12-25 23:46:18,975][123090] Updated weights for policy 1, policy_version 25355 (0.0010) [2023-12-25 23:46:19,030][123090] Updated weights for policy 1, policy_version 25365 (0.0010) [2023-12-25 23:46:19,086][123090] Updated weights for policy 1, policy_version 25375 (0.0010) [2023-12-25 23:46:19,557][123091] Updated weights for policy 0, policy_version 25225 (0.0009) [2023-12-25 23:46:19,621][123091] Updated weights for policy 0, policy_version 25235 (0.0009) [2023-12-25 23:46:19,688][123091] Updated weights for policy 0, policy_version 25245 (0.0010) [2023-12-25 23:46:19,880][123090] Updated weights for policy 1, policy_version 25385 (0.0008) [2023-12-25 23:46:19,953][123090] Updated weights for policy 1, policy_version 25395 (0.0010) [2023-12-25 23:46:20,025][123090] Updated weights for policy 1, policy_version 25405 (0.0008) [2023-12-25 23:46:20,537][123091] Updated weights for policy 0, policy_version 25255 (0.0009) [2023-12-25 23:46:20,616][123091] Updated weights for policy 0, policy_version 25265 (0.0008) [2023-12-25 23:46:20,687][123091] Updated weights for policy 0, policy_version 25275 (0.0006) [2023-12-25 23:46:20,863][123090] Updated weights for policy 1, policy_version 25415 (0.0009) [2023-12-25 23:46:20,924][123090] Updated weights for policy 1, policy_version 25425 (0.0006) [2023-12-25 23:46:20,990][123090] Updated weights for policy 1, policy_version 25435 (0.0006) [2023-12-25 23:46:21,481][123091] Updated weights for policy 0, policy_version 25285 (0.0006) [2023-12-25 23:46:21,543][123091] Updated weights for policy 0, policy_version 25295 (0.0009) [2023-12-25 23:46:21,604][123091] Updated weights for policy 0, policy_version 25305 (0.0010) [2023-12-25 23:46:21,793][123090] Updated weights for policy 1, policy_version 25445 (0.0007) [2023-12-25 23:46:21,863][123090] Updated weights for policy 1, policy_version 25455 (0.0009) [2023-12-25 23:46:21,928][123090] Updated weights for policy 1, policy_version 25465 (0.0009) [2023-12-25 23:46:22,419][123091] Updated weights for policy 0, policy_version 25315 (0.0010) [2023-12-25 23:46:22,482][123091] Updated weights for policy 0, policy_version 25325 (0.0009) [2023-12-25 23:46:22,539][123091] Updated weights for policy 0, policy_version 25335 (0.0010) [2023-12-25 23:46:22,723][123090] Updated weights for policy 1, policy_version 25475 (0.0010) [2023-12-25 23:46:22,794][123090] Updated weights for policy 1, policy_version 25485 (0.0009) [2023-12-25 23:46:22,862][123090] Updated weights for policy 1, policy_version 25495 (0.0007) [2023-12-25 23:46:23,392][123091] Updated weights for policy 0, policy_version 25345 (0.0010) [2023-12-25 23:46:23,455][123091] Updated weights for policy 0, policy_version 25355 (0.0011) [2023-12-25 23:46:23,514][123091] Updated weights for policy 0, policy_version 25365 (0.0009) [2023-12-25 23:46:23,574][123091] Updated weights for policy 0, policy_version 25375 (0.0009) [2023-12-25 23:46:23,638][123090] Updated weights for policy 1, policy_version 25505 (0.0006) [2023-12-25 23:46:23,704][123090] Updated weights for policy 1, policy_version 25515 (0.0009) [2023-12-25 23:46:23,767][123090] Updated weights for policy 1, policy_version 25525 (0.0010) [2023-12-25 23:46:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 13025280. Throughput: 0: 8614.1, 1: 8921.9. Samples: 13004660. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-25 23:46:23,785][121949] Avg episode reward: [(0, '3935.402'), (1, '4208.041')] [2023-12-25 23:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000025376_6496256.pth... [2023-12-25 23:46:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000024352_6234112.pth [2023-12-25 23:46:23,827][123090] Updated weights for policy 1, policy_version 25535 (0.0006) [2023-12-25 23:46:23,831][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000025536_6537216.pth... [2023-12-25 23:46:23,834][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000024480_6266880.pth [2023-12-25 23:46:23,834][123008] Saving new best policy, reward=4208.041! [2023-12-25 23:46:24,440][123091] Updated weights for policy 0, policy_version 25385 (0.0010) [2023-12-25 23:46:24,492][123091] Updated weights for policy 0, policy_version 25395 (0.0009) [2023-12-25 23:46:24,556][123091] Updated weights for policy 0, policy_version 25405 (0.0010) [2023-12-25 23:46:24,580][123090] Updated weights for policy 1, policy_version 25545 (0.0005) [2023-12-25 23:46:24,635][123090] Updated weights for policy 1, policy_version 25555 (0.0005) [2023-12-25 23:46:24,690][123090] Updated weights for policy 1, policy_version 25565 (0.0005) [2023-12-25 23:46:25,393][123091] Updated weights for policy 0, policy_version 25415 (0.0010) [2023-12-25 23:46:25,409][123090] Updated weights for policy 1, policy_version 25575 (0.0006) [2023-12-25 23:46:25,446][123091] Updated weights for policy 0, policy_version 25425 (0.0010) [2023-12-25 23:46:25,473][123090] Updated weights for policy 1, policy_version 25585 (0.0010) [2023-12-25 23:46:25,493][123091] Updated weights for policy 0, policy_version 25435 (0.0010) [2023-12-25 23:46:25,528][123090] Updated weights for policy 1, policy_version 25595 (0.0010) [2023-12-25 23:46:26,247][123090] Updated weights for policy 1, policy_version 25605 (0.0008) [2023-12-25 23:46:26,303][123091] Updated weights for policy 0, policy_version 25445 (0.0008) [2023-12-25 23:46:26,307][123090] Updated weights for policy 1, policy_version 25615 (0.0009) [2023-12-25 23:46:26,355][123090] Updated weights for policy 1, policy_version 25625 (0.0009) [2023-12-25 23:46:26,360][123091] Updated weights for policy 0, policy_version 25455 (0.0005) [2023-12-25 23:46:26,418][123091] Updated weights for policy 0, policy_version 25465 (0.0009) [2023-12-25 23:46:27,108][123091] Updated weights for policy 0, policy_version 25475 (0.0009) [2023-12-25 23:46:27,118][123090] Updated weights for policy 1, policy_version 25635 (0.0008) [2023-12-25 23:46:27,166][123091] Updated weights for policy 0, policy_version 25485 (0.0010) [2023-12-25 23:46:27,172][123090] Updated weights for policy 1, policy_version 25645 (0.0008) [2023-12-25 23:46:27,209][123091] Updated weights for policy 0, policy_version 25495 (0.0010) [2023-12-25 23:46:27,218][123090] Updated weights for policy 1, policy_version 25655 (0.0010) [2023-12-25 23:46:27,892][123090] Updated weights for policy 1, policy_version 25665 (0.0010) [2023-12-25 23:46:27,957][123090] Updated weights for policy 1, policy_version 25675 (0.0005) [2023-12-25 23:46:28,012][123090] Updated weights for policy 1, policy_version 25685 (0.0005) [2023-12-25 23:46:28,078][123091] Updated weights for policy 0, policy_version 25505 (0.0010) [2023-12-25 23:46:28,080][123090] Updated weights for policy 1, policy_version 25695 (0.0010) [2023-12-25 23:46:28,148][123091] Updated weights for policy 0, policy_version 25515 (0.0005) [2023-12-25 23:46:28,215][123091] Updated weights for policy 0, policy_version 25525 (0.0008) [2023-12-25 23:46:28,275][123091] Updated weights for policy 0, policy_version 25535 (0.0009) [2023-12-25 23:46:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 13115392. Throughput: 0: 8660.5, 1: 9019.2. Samples: 13112384. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:46:28,784][121949] Avg episode reward: [(0, '3858.774'), (1, '4077.448')] [2023-12-25 23:46:28,828][123090] Updated weights for policy 1, policy_version 25705 (0.0010) [2023-12-25 23:46:28,884][123090] Updated weights for policy 1, policy_version 25715 (0.0010) [2023-12-25 23:46:28,940][123090] Updated weights for policy 1, policy_version 25725 (0.0010) [2023-12-25 23:46:29,033][123091] Updated weights for policy 0, policy_version 25545 (0.0006) [2023-12-25 23:46:29,093][123091] Updated weights for policy 0, policy_version 25555 (0.0005) [2023-12-25 23:46:29,147][123091] Updated weights for policy 0, policy_version 25565 (0.0009) [2023-12-25 23:46:29,817][123090] Updated weights for policy 1, policy_version 25735 (0.0010) [2023-12-25 23:46:29,884][123090] Updated weights for policy 1, policy_version 25745 (0.0010) [2023-12-25 23:46:29,902][123091] Updated weights for policy 0, policy_version 25575 (0.0008) [2023-12-25 23:46:29,949][123090] Updated weights for policy 1, policy_version 25755 (0.0009) [2023-12-25 23:46:29,966][123091] Updated weights for policy 0, policy_version 25585 (0.0010) [2023-12-25 23:46:30,028][123091] Updated weights for policy 0, policy_version 25595 (0.0008) [2023-12-25 23:46:30,731][123090] Updated weights for policy 1, policy_version 25765 (0.0008) [2023-12-25 23:46:30,798][123090] Updated weights for policy 1, policy_version 25775 (0.0009) [2023-12-25 23:46:30,809][123091] Updated weights for policy 0, policy_version 25605 (0.0008) [2023-12-25 23:46:30,850][123090] Updated weights for policy 1, policy_version 25785 (0.0009) [2023-12-25 23:46:30,852][123091] Updated weights for policy 0, policy_version 25615 (0.0006) [2023-12-25 23:46:30,901][123091] Updated weights for policy 0, policy_version 25625 (0.0008) [2023-12-25 23:46:31,720][123090] Updated weights for policy 1, policy_version 25795 (0.0008) [2023-12-25 23:46:31,760][123091] Updated weights for policy 0, policy_version 25635 (0.0010) [2023-12-25 23:46:31,784][123090] Updated weights for policy 1, policy_version 25805 (0.0009) [2023-12-25 23:46:31,809][123091] Updated weights for policy 0, policy_version 25645 (0.0008) [2023-12-25 23:46:31,847][123090] Updated weights for policy 1, policy_version 25815 (0.0009) [2023-12-25 23:46:31,867][123091] Updated weights for policy 0, policy_version 25655 (0.0008) [2023-12-25 23:46:32,670][123090] Updated weights for policy 1, policy_version 25825 (0.0010) [2023-12-25 23:46:32,673][123091] Updated weights for policy 0, policy_version 25665 (0.0008) [2023-12-25 23:46:32,726][123091] Updated weights for policy 0, policy_version 25675 (0.0009) [2023-12-25 23:46:32,728][123090] Updated weights for policy 1, policy_version 25835 (0.0005) [2023-12-25 23:46:32,785][123091] Updated weights for policy 0, policy_version 25685 (0.0009) [2023-12-25 23:46:32,789][123090] Updated weights for policy 1, policy_version 25845 (0.0007) [2023-12-25 23:46:32,838][123091] Updated weights for policy 0, policy_version 25695 (0.0008) [2023-12-25 23:46:32,851][123090] Updated weights for policy 1, policy_version 25855 (0.0008) [2023-12-25 23:46:33,641][123090] Updated weights for policy 1, policy_version 25865 (0.0008) [2023-12-25 23:46:33,657][123091] Updated weights for policy 0, policy_version 25705 (0.0010) [2023-12-25 23:46:33,699][123090] Updated weights for policy 1, policy_version 25875 (0.0008) [2023-12-25 23:46:33,702][123091] Updated weights for policy 0, policy_version 25715 (0.0008) [2023-12-25 23:46:33,754][123090] Updated weights for policy 1, policy_version 25885 (0.0007) [2023-12-25 23:46:33,756][123091] Updated weights for policy 0, policy_version 25725 (0.0009) [2023-12-25 23:46:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 13213696. Throughput: 0: 8714.9, 1: 9016.6. Samples: 13217796. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:46:33,785][121949] Avg episode reward: [(0, '3934.594'), (1, '4082.273')] [2023-12-25 23:46:34,590][123091] Updated weights for policy 0, policy_version 25735 (0.0006) [2023-12-25 23:46:34,603][123090] Updated weights for policy 1, policy_version 25895 (0.0009) [2023-12-25 23:46:34,657][123091] Updated weights for policy 0, policy_version 25745 (0.0009) [2023-12-25 23:46:34,658][123090] Updated weights for policy 1, policy_version 25905 (0.0006) [2023-12-25 23:46:34,712][123090] Updated weights for policy 1, policy_version 25915 (0.0005) [2023-12-25 23:46:34,724][123091] Updated weights for policy 0, policy_version 25755 (0.0009) [2023-12-25 23:46:35,524][123090] Updated weights for policy 1, policy_version 25925 (0.0007) [2023-12-25 23:46:35,530][123091] Updated weights for policy 0, policy_version 25765 (0.0009) [2023-12-25 23:46:35,586][123091] Updated weights for policy 0, policy_version 25775 (0.0007) [2023-12-25 23:46:35,588][123090] Updated weights for policy 1, policy_version 25935 (0.0009) [2023-12-25 23:46:35,643][123090] Updated weights for policy 1, policy_version 25945 (0.0006) [2023-12-25 23:46:35,650][123091] Updated weights for policy 0, policy_version 25785 (0.0010) [2023-12-25 23:46:36,476][123091] Updated weights for policy 0, policy_version 25795 (0.0010) [2023-12-25 23:46:36,479][123090] Updated weights for policy 1, policy_version 25955 (0.0006) [2023-12-25 23:46:36,537][123091] Updated weights for policy 0, policy_version 25805 (0.0007) [2023-12-25 23:46:36,550][123090] Updated weights for policy 1, policy_version 25965 (0.0010) [2023-12-25 23:46:36,608][123091] Updated weights for policy 0, policy_version 25815 (0.0009) [2023-12-25 23:46:36,614][123090] Updated weights for policy 1, policy_version 25975 (0.0009) [2023-12-25 23:46:37,431][123091] Updated weights for policy 0, policy_version 25825 (0.0008) [2023-12-25 23:46:37,434][123090] Updated weights for policy 1, policy_version 25985 (0.0008) [2023-12-25 23:46:37,477][123091] Updated weights for policy 0, policy_version 25835 (0.0008) [2023-12-25 23:46:37,499][123090] Updated weights for policy 1, policy_version 25995 (0.0008) [2023-12-25 23:46:37,523][123091] Updated weights for policy 0, policy_version 25845 (0.0009) [2023-12-25 23:46:37,563][123090] Updated weights for policy 1, policy_version 26005 (0.0009) [2023-12-25 23:46:37,582][123091] Updated weights for policy 0, policy_version 25855 (0.0008) [2023-12-25 23:46:37,613][123090] Updated weights for policy 1, policy_version 26015 (0.0007) [2023-12-25 23:46:38,444][123090] Updated weights for policy 1, policy_version 26025 (0.0007) [2023-12-25 23:46:38,449][123091] Updated weights for policy 0, policy_version 25865 (0.0009) [2023-12-25 23:46:38,505][123091] Updated weights for policy 0, policy_version 25875 (0.0010) [2023-12-25 23:46:38,512][123090] Updated weights for policy 1, policy_version 26035 (0.0008) [2023-12-25 23:46:38,563][123091] Updated weights for policy 0, policy_version 25885 (0.0009) [2023-12-25 23:46:38,574][123090] Updated weights for policy 1, policy_version 26045 (0.0008) [2023-12-25 23:46:38,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 13295616. Throughput: 0: 8736.5, 1: 9026.6. Samples: 13269048. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:46:38,786][121949] Avg episode reward: [(0, '3906.533'), (1, '4069.367')] [2023-12-25 23:46:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000025888_6627328.pth... [2023-12-25 23:46:38,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000026048_6668288.pth... [2023-12-25 23:46:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000024864_6365184.pth [2023-12-25 23:46:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000025024_6406144.pth [2023-12-25 23:46:39,367][123090] Updated weights for policy 1, policy_version 26055 (0.0008) [2023-12-25 23:46:39,437][123091] Updated weights for policy 0, policy_version 25895 (0.0009) [2023-12-25 23:46:39,447][123090] Updated weights for policy 1, policy_version 26065 (0.0013) [2023-12-25 23:46:39,505][123091] Updated weights for policy 0, policy_version 25905 (0.0006) [2023-12-25 23:46:39,516][123090] Updated weights for policy 1, policy_version 26075 (0.0011) [2023-12-25 23:46:39,573][123091] Updated weights for policy 0, policy_version 25915 (0.0008) [2023-12-25 23:46:40,393][123090] Updated weights for policy 1, policy_version 26085 (0.0010) [2023-12-25 23:46:40,453][123090] Updated weights for policy 1, policy_version 26095 (0.0009) [2023-12-25 23:46:40,461][123091] Updated weights for policy 0, policy_version 25925 (0.0009) [2023-12-25 23:46:40,518][123090] Updated weights for policy 1, policy_version 26105 (0.0009) [2023-12-25 23:46:40,526][123091] Updated weights for policy 0, policy_version 25935 (0.0009) [2023-12-25 23:46:40,589][123091] Updated weights for policy 0, policy_version 25945 (0.0008) [2023-12-25 23:46:41,299][123090] Updated weights for policy 1, policy_version 26115 (0.0009) [2023-12-25 23:46:41,357][123090] Updated weights for policy 1, policy_version 26125 (0.0008) [2023-12-25 23:46:41,379][123091] Updated weights for policy 0, policy_version 25955 (0.0007) [2023-12-25 23:46:41,426][123090] Updated weights for policy 1, policy_version 26135 (0.0008) [2023-12-25 23:46:41,446][123091] Updated weights for policy 0, policy_version 25965 (0.0008) [2023-12-25 23:46:41,500][123091] Updated weights for policy 0, policy_version 25975 (0.0008) [2023-12-25 23:46:42,198][123090] Updated weights for policy 1, policy_version 26145 (0.0010) [2023-12-25 23:46:42,262][123090] Updated weights for policy 1, policy_version 26155 (0.0010) [2023-12-25 23:46:42,333][123090] Updated weights for policy 1, policy_version 26165 (0.0008) [2023-12-25 23:46:42,351][123091] Updated weights for policy 0, policy_version 25985 (0.0008) [2023-12-25 23:46:42,409][123090] Updated weights for policy 1, policy_version 26176 (0.0008) [2023-12-25 23:46:42,413][123091] Updated weights for policy 0, policy_version 25995 (0.0011) [2023-12-25 23:46:42,477][123091] Updated weights for policy 0, policy_version 26005 (0.0011) [2023-12-25 23:46:42,541][123091] Updated weights for policy 0, policy_version 26015 (0.0010) [2023-12-25 23:46:43,193][123090] Updated weights for policy 1, policy_version 26186 (0.0008) [2023-12-25 23:46:43,246][123090] Updated weights for policy 1, policy_version 26196 (0.0010) [2023-12-25 23:46:43,297][123090] Updated weights for policy 1, policy_version 26206 (0.0010) [2023-12-25 23:46:43,299][123091] Updated weights for policy 0, policy_version 26025 (0.0011) [2023-12-25 23:46:43,361][123091] Updated weights for policy 0, policy_version 26035 (0.0010) [2023-12-25 23:46:43,420][123091] Updated weights for policy 0, policy_version 26045 (0.0007) [2023-12-25 23:46:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 13377536. Throughput: 0: 8664.2, 1: 8924.0. Samples: 13371020. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:46:43,784][121949] Avg episode reward: [(0, '3902.106'), (1, '3987.554')] [2023-12-25 23:46:44,065][123090] Updated weights for policy 1, policy_version 26216 (0.0006) [2023-12-25 23:46:44,121][123090] Updated weights for policy 1, policy_version 26226 (0.0005) [2023-12-25 23:46:44,177][123090] Updated weights for policy 1, policy_version 26236 (0.0009) [2023-12-25 23:46:44,189][123091] Updated weights for policy 0, policy_version 26055 (0.0009) [2023-12-25 23:46:44,233][123091] Updated weights for policy 0, policy_version 26065 (0.0010) [2023-12-25 23:46:44,283][123091] Updated weights for policy 0, policy_version 26075 (0.0010) [2023-12-25 23:46:44,992][123090] Updated weights for policy 1, policy_version 26246 (0.0007) [2023-12-25 23:46:45,063][123090] Updated weights for policy 1, policy_version 26256 (0.0006) [2023-12-25 23:46:45,077][123091] Updated weights for policy 0, policy_version 26085 (0.0010) [2023-12-25 23:46:45,130][123090] Updated weights for policy 1, policy_version 26266 (0.0009) [2023-12-25 23:46:45,144][123091] Updated weights for policy 0, policy_version 26095 (0.0010) [2023-12-25 23:46:45,209][123091] Updated weights for policy 0, policy_version 26105 (0.0010) [2023-12-25 23:46:45,909][123090] Updated weights for policy 1, policy_version 26276 (0.0008) [2023-12-25 23:46:45,960][123091] Updated weights for policy 0, policy_version 26115 (0.0008) [2023-12-25 23:46:45,982][123090] Updated weights for policy 1, policy_version 26286 (0.0006) [2023-12-25 23:46:46,009][123091] Updated weights for policy 0, policy_version 26125 (0.0005) [2023-12-25 23:46:46,041][123090] Updated weights for policy 1, policy_version 26296 (0.0005) [2023-12-25 23:46:46,057][123091] Updated weights for policy 0, policy_version 26135 (0.0005) [2023-12-25 23:46:46,600][123090] Updated weights for policy 1, policy_version 26306 (0.0005) [2023-12-25 23:46:46,659][123090] Updated weights for policy 1, policy_version 26316 (0.0005) [2023-12-25 23:46:46,713][123090] Updated weights for policy 1, policy_version 26326 (0.0005) [2023-12-25 23:46:46,764][123090] Updated weights for policy 1, policy_version 26336 (0.0008) [2023-12-25 23:46:46,774][123091] Updated weights for policy 0, policy_version 26145 (0.0006) [2023-12-25 23:46:46,828][123091] Updated weights for policy 0, policy_version 26155 (0.0009) [2023-12-25 23:46:46,894][123091] Updated weights for policy 0, policy_version 26165 (0.0009) [2023-12-25 23:46:46,943][123091] Updated weights for policy 0, policy_version 26175 (0.0009) [2023-12-25 23:46:47,458][123090] Updated weights for policy 1, policy_version 26346 (0.0005) [2023-12-25 23:46:47,517][123090] Updated weights for policy 1, policy_version 26356 (0.0005) [2023-12-25 23:46:47,566][123090] Updated weights for policy 1, policy_version 26366 (0.0005) [2023-12-25 23:46:47,837][123091] Updated weights for policy 0, policy_version 26185 (0.0010) [2023-12-25 23:46:47,890][123091] Updated weights for policy 0, policy_version 26195 (0.0009) [2023-12-25 23:46:47,949][123091] Updated weights for policy 0, policy_version 26205 (0.0009) [2023-12-25 23:46:48,159][123090] Updated weights for policy 1, policy_version 26376 (0.0005) [2023-12-25 23:46:48,219][123090] Updated weights for policy 1, policy_version 26386 (0.0006) [2023-12-25 23:46:48,277][123090] Updated weights for policy 1, policy_version 26396 (0.0010) [2023-12-25 23:46:48,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 13467648. Throughput: 0: 8690.4, 1: 9003.0. Samples: 13482120. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-25 23:46:48,785][121949] Avg episode reward: [(0, '3901.066'), (1, '4066.938')] [2023-12-25 23:46:48,886][123091] Updated weights for policy 0, policy_version 26215 (0.0009) [2023-12-25 23:46:48,950][123091] Updated weights for policy 0, policy_version 26225 (0.0009) [2023-12-25 23:46:48,996][123090] Updated weights for policy 1, policy_version 26406 (0.0011) [2023-12-25 23:46:49,012][123091] Updated weights for policy 0, policy_version 26235 (0.0006) [2023-12-25 23:46:49,064][123090] Updated weights for policy 1, policy_version 26416 (0.0010) [2023-12-25 23:46:49,133][123090] Updated weights for policy 1, policy_version 26426 (0.0011) [2023-12-25 23:46:49,857][123091] Updated weights for policy 0, policy_version 26245 (0.0008) [2023-12-25 23:46:49,923][123091] Updated weights for policy 0, policy_version 26255 (0.0009) [2023-12-25 23:46:49,955][123090] Updated weights for policy 1, policy_version 26436 (0.0009) [2023-12-25 23:46:49,988][123091] Updated weights for policy 0, policy_version 26265 (0.0008) [2023-12-25 23:46:50,021][123090] Updated weights for policy 1, policy_version 26446 (0.0008) [2023-12-25 23:46:50,093][123090] Updated weights for policy 1, policy_version 26456 (0.0011) [2023-12-25 23:46:50,758][123090] Updated weights for policy 1, policy_version 26466 (0.0011) [2023-12-25 23:46:50,800][123091] Updated weights for policy 0, policy_version 26275 (0.0007) [2023-12-25 23:46:50,810][123090] Updated weights for policy 1, policy_version 26476 (0.0010) [2023-12-25 23:46:50,864][123091] Updated weights for policy 0, policy_version 26285 (0.0007) [2023-12-25 23:46:50,867][123090] Updated weights for policy 1, policy_version 26486 (0.0011) [2023-12-25 23:46:50,920][123090] Updated weights for policy 1, policy_version 26496 (0.0010) [2023-12-25 23:46:50,926][123091] Updated weights for policy 0, policy_version 26295 (0.0008) [2023-12-25 23:46:51,719][123090] Updated weights for policy 1, policy_version 26506 (0.0008) [2023-12-25 23:46:51,782][123090] Updated weights for policy 1, policy_version 26516 (0.0006) [2023-12-25 23:46:51,812][123091] Updated weights for policy 0, policy_version 26305 (0.0008) [2023-12-25 23:46:51,845][123090] Updated weights for policy 1, policy_version 26526 (0.0006) [2023-12-25 23:46:51,875][123091] Updated weights for policy 0, policy_version 26315 (0.0006) [2023-12-25 23:46:51,931][123091] Updated weights for policy 0, policy_version 26325 (0.0006) [2023-12-25 23:46:51,994][123091] Updated weights for policy 0, policy_version 26335 (0.0005) [2023-12-25 23:46:52,612][123090] Updated weights for policy 1, policy_version 26536 (0.0005) [2023-12-25 23:46:52,681][123090] Updated weights for policy 1, policy_version 26546 (0.0005) [2023-12-25 23:46:52,750][123090] Updated weights for policy 1, policy_version 26556 (0.0006) [2023-12-25 23:46:52,787][123091] Updated weights for policy 0, policy_version 26345 (0.0008) [2023-12-25 23:46:52,842][123091] Updated weights for policy 0, policy_version 26355 (0.0009) [2023-12-25 23:46:52,904][123091] Updated weights for policy 0, policy_version 26365 (0.0010) [2023-12-25 23:46:53,470][123090] Updated weights for policy 1, policy_version 26566 (0.0006) [2023-12-25 23:46:53,518][123090] Updated weights for policy 1, policy_version 26576 (0.0006) [2023-12-25 23:46:53,567][123090] Updated weights for policy 1, policy_version 26586 (0.0005) [2023-12-25 23:46:53,717][123091] Updated weights for policy 0, policy_version 26375 (0.0006) [2023-12-25 23:46:53,770][123091] Updated weights for policy 0, policy_version 26385 (0.0005) [2023-12-25 23:46:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 13557760. Throughput: 0: 8695.5, 1: 8979.9. Samples: 13533796. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-25 23:46:53,785][121949] Avg episode reward: [(0, '3897.186'), (1, '4136.732')] [2023-12-25 23:46:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000026592_6807552.pth... [2023-12-25 23:46:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000025536_6537216.pth [2023-12-25 23:46:53,828][123091] Updated weights for policy 0, policy_version 26395 (0.0005) [2023-12-25 23:46:53,861][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000026400_6758400.pth... [2023-12-25 23:46:53,866][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000025376_6496256.pth [2023-12-25 23:46:54,257][123090] Updated weights for policy 1, policy_version 26596 (0.0007) [2023-12-25 23:46:54,326][123090] Updated weights for policy 1, policy_version 26606 (0.0010) [2023-12-25 23:46:54,393][123090] Updated weights for policy 1, policy_version 26616 (0.0009) [2023-12-25 23:46:54,589][123091] Updated weights for policy 0, policy_version 26405 (0.0007) [2023-12-25 23:46:54,647][123091] Updated weights for policy 0, policy_version 26415 (0.0005) [2023-12-25 23:46:54,697][123091] Updated weights for policy 0, policy_version 26426 (0.0009) [2023-12-25 23:46:55,212][123090] Updated weights for policy 1, policy_version 26626 (0.0010) [2023-12-25 23:46:55,277][123090] Updated weights for policy 1, policy_version 26636 (0.0009) [2023-12-25 23:46:55,335][123090] Updated weights for policy 1, policy_version 26646 (0.0009) [2023-12-25 23:46:55,396][123090] Updated weights for policy 1, policy_version 26656 (0.0009) [2023-12-25 23:46:55,532][123091] Updated weights for policy 0, policy_version 26436 (0.0010) [2023-12-25 23:46:55,581][123091] Updated weights for policy 0, policy_version 26447 (0.0009) [2023-12-25 23:46:55,629][123091] Updated weights for policy 0, policy_version 26457 (0.0009) [2023-12-25 23:46:56,225][123090] Updated weights for policy 1, policy_version 26666 (0.0010) [2023-12-25 23:46:56,294][123090] Updated weights for policy 1, policy_version 26676 (0.0008) [2023-12-25 23:46:56,361][123090] Updated weights for policy 1, policy_version 26686 (0.0005) [2023-12-25 23:46:56,479][123091] Updated weights for policy 0, policy_version 26468 (0.0009) [2023-12-25 23:46:56,538][123091] Updated weights for policy 0, policy_version 26478 (0.0008) [2023-12-25 23:46:56,589][123091] Updated weights for policy 0, policy_version 26488 (0.0005) [2023-12-25 23:46:57,066][123090] Updated weights for policy 1, policy_version 26696 (0.0005) [2023-12-25 23:46:57,113][123090] Updated weights for policy 1, policy_version 26706 (0.0005) [2023-12-25 23:46:57,158][123090] Updated weights for policy 1, policy_version 26716 (0.0005) [2023-12-25 23:46:57,475][123091] Updated weights for policy 0, policy_version 26498 (0.0006) [2023-12-25 23:46:57,532][123091] Updated weights for policy 0, policy_version 26508 (0.0010) [2023-12-25 23:46:57,589][123091] Updated weights for policy 0, policy_version 26519 (0.0010) [2023-12-25 23:46:57,681][123090] Updated weights for policy 1, policy_version 26726 (0.0005) [2023-12-25 23:46:57,732][123090] Updated weights for policy 1, policy_version 26736 (0.0005) [2023-12-25 23:46:57,790][123090] Updated weights for policy 1, policy_version 26746 (0.0005) [2023-12-25 23:46:58,365][123091] Updated weights for policy 0, policy_version 26530 (0.0009) [2023-12-25 23:46:58,424][123091] Updated weights for policy 0, policy_version 26540 (0.0007) [2023-12-25 23:46:58,492][123091] Updated weights for policy 0, policy_version 26550 (0.0011) [2023-12-25 23:46:58,551][123091] Updated weights for policy 0, policy_version 26560 (0.0010) [2023-12-25 23:46:58,618][123090] Updated weights for policy 1, policy_version 26756 (0.0009) [2023-12-25 23:46:58,677][123090] Updated weights for policy 1, policy_version 26766 (0.0011) [2023-12-25 23:46:58,741][123090] Updated weights for policy 1, policy_version 26776 (0.0010) [2023-12-25 23:46:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 13656064. Throughput: 0: 8708.6, 1: 9048.4. Samples: 13643564. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-25 23:46:58,785][121949] Avg episode reward: [(0, '3985.119'), (1, '4174.992')] [2023-12-25 23:46:59,383][123091] Updated weights for policy 0, policy_version 26570 (0.0008) [2023-12-25 23:46:59,445][123091] Updated weights for policy 0, policy_version 26580 (0.0006) [2023-12-25 23:46:59,518][123091] Updated weights for policy 0, policy_version 26590 (0.0008) [2023-12-25 23:46:59,595][123090] Updated weights for policy 1, policy_version 26786 (0.0010) [2023-12-25 23:46:59,655][123090] Updated weights for policy 1, policy_version 26796 (0.0011) [2023-12-25 23:46:59,721][123090] Updated weights for policy 1, policy_version 26806 (0.0010) [2023-12-25 23:46:59,780][123090] Updated weights for policy 1, policy_version 26816 (0.0010) [2023-12-25 23:47:00,203][123091] Updated weights for policy 0, policy_version 26600 (0.0008) [2023-12-25 23:47:00,255][123091] Updated weights for policy 0, policy_version 26610 (0.0008) [2023-12-25 23:47:00,309][123091] Updated weights for policy 0, policy_version 26620 (0.0008) [2023-12-25 23:47:00,615][123090] Updated weights for policy 1, policy_version 26826 (0.0011) [2023-12-25 23:47:00,662][123090] Updated weights for policy 1, policy_version 26836 (0.0010) [2023-12-25 23:47:00,705][123090] Updated weights for policy 1, policy_version 26846 (0.0010) [2023-12-25 23:47:01,052][123091] Updated weights for policy 0, policy_version 26630 (0.0010) [2023-12-25 23:47:01,119][123091] Updated weights for policy 0, policy_version 26640 (0.0011) [2023-12-25 23:47:01,174][123091] Updated weights for policy 0, policy_version 26650 (0.0010) [2023-12-25 23:47:01,581][123090] Updated weights for policy 1, policy_version 26856 (0.0009) [2023-12-25 23:47:01,656][123090] Updated weights for policy 1, policy_version 26866 (0.0009) [2023-12-25 23:47:01,720][123090] Updated weights for policy 1, policy_version 26876 (0.0009) [2023-12-25 23:47:02,021][123091] Updated weights for policy 0, policy_version 26660 (0.0008) [2023-12-25 23:47:02,075][123091] Updated weights for policy 0, policy_version 26670 (0.0006) [2023-12-25 23:47:02,137][123091] Updated weights for policy 0, policy_version 26680 (0.0007) [2023-12-25 23:47:02,563][123090] Updated weights for policy 1, policy_version 26886 (0.0010) [2023-12-25 23:47:02,626][123090] Updated weights for policy 1, policy_version 26896 (0.0011) [2023-12-25 23:47:02,693][123090] Updated weights for policy 1, policy_version 26906 (0.0010) [2023-12-25 23:47:02,876][123091] Updated weights for policy 0, policy_version 26690 (0.0009) [2023-12-25 23:47:02,941][123091] Updated weights for policy 0, policy_version 26700 (0.0005) [2023-12-25 23:47:03,010][123091] Updated weights for policy 0, policy_version 26710 (0.0005) [2023-12-25 23:47:03,084][123091] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-12-25 23:47:03,414][123090] Updated weights for policy 1, policy_version 26916 (0.0009) [2023-12-25 23:47:03,465][123090] Updated weights for policy 1, policy_version 26926 (0.0010) [2023-12-25 23:47:03,516][123090] Updated weights for policy 1, policy_version 26936 (0.0010) [2023-12-25 23:47:03,703][123091] Updated weights for policy 0, policy_version 26730 (0.0008) [2023-12-25 23:47:03,751][123091] Updated weights for policy 0, policy_version 26740 (0.0008) [2023-12-25 23:47:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 13737984. Throughput: 0: 8736.6, 1: 8996.2. Samples: 13750512. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-25 23:47:03,785][121949] Avg episode reward: [(0, '4088.491'), (1, '4289.926')] [2023-12-25 23:47:03,787][123008] Saving new best policy, reward=4289.926! [2023-12-25 23:47:03,802][123091] Updated weights for policy 0, policy_version 26750 (0.0008) [2023-12-25 23:47:03,813][123007] Saving new best policy, reward=4088.491! [2023-12-25 23:47:04,287][123090] Updated weights for policy 1, policy_version 26946 (0.0009) [2023-12-25 23:47:04,352][123090] Updated weights for policy 1, policy_version 26956 (0.0008) [2023-12-25 23:47:04,415][123090] Updated weights for policy 1, policy_version 26966 (0.0010) [2023-12-25 23:47:04,478][123090] Updated weights for policy 1, policy_version 26976 (0.0010) [2023-12-25 23:47:04,648][123091] Updated weights for policy 0, policy_version 26760 (0.0009) [2023-12-25 23:47:04,714][123091] Updated weights for policy 0, policy_version 26770 (0.0009) [2023-12-25 23:47:04,771][123091] Updated weights for policy 0, policy_version 26780 (0.0006) [2023-12-25 23:47:05,236][123090] Updated weights for policy 1, policy_version 26986 (0.0005) [2023-12-25 23:47:05,286][123090] Updated weights for policy 1, policy_version 26996 (0.0005) [2023-12-25 23:47:05,347][123090] Updated weights for policy 1, policy_version 27006 (0.0006) [2023-12-25 23:47:05,630][123091] Updated weights for policy 0, policy_version 26790 (0.0008) [2023-12-25 23:47:05,682][123091] Updated weights for policy 0, policy_version 26800 (0.0009) [2023-12-25 23:47:05,733][123091] Updated weights for policy 0, policy_version 26810 (0.0008) [2023-12-25 23:47:06,186][123090] Updated weights for policy 1, policy_version 27016 (0.0010) [2023-12-25 23:47:06,250][123090] Updated weights for policy 1, policy_version 27026 (0.0010) [2023-12-25 23:47:06,313][123090] Updated weights for policy 1, policy_version 27036 (0.0010) [2023-12-25 23:47:06,531][123091] Updated weights for policy 0, policy_version 26820 (0.0009) [2023-12-25 23:47:06,596][123091] Updated weights for policy 0, policy_version 26830 (0.0009) [2023-12-25 23:47:06,663][123091] Updated weights for policy 0, policy_version 26840 (0.0009) [2023-12-25 23:47:07,079][123090] Updated weights for policy 1, policy_version 27046 (0.0007) [2023-12-25 23:47:07,133][123090] Updated weights for policy 1, policy_version 27056 (0.0006) [2023-12-25 23:47:07,204][123090] Updated weights for policy 1, policy_version 27066 (0.0005) [2023-12-25 23:47:07,489][123091] Updated weights for policy 0, policy_version 26850 (0.0009) [2023-12-25 23:47:07,537][123091] Updated weights for policy 0, policy_version 26860 (0.0009) [2023-12-25 23:47:07,590][123091] Updated weights for policy 0, policy_version 26870 (0.0009) [2023-12-25 23:47:07,638][123091] Updated weights for policy 0, policy_version 26880 (0.0009) [2023-12-25 23:47:07,980][123090] Updated weights for policy 1, policy_version 27076 (0.0007) [2023-12-25 23:47:08,036][123090] Updated weights for policy 1, policy_version 27086 (0.0010) [2023-12-25 23:47:08,090][123090] Updated weights for policy 1, policy_version 27096 (0.0010) [2023-12-25 23:47:08,506][123091] Updated weights for policy 0, policy_version 26890 (0.0009) [2023-12-25 23:47:08,575][123091] Updated weights for policy 0, policy_version 26900 (0.0009) [2023-12-25 23:47:08,642][123091] Updated weights for policy 0, policy_version 26910 (0.0009) [2023-12-25 23:47:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 13828096. Throughput: 0: 8733.7, 1: 9010.6. Samples: 13803152. Policy #0 lag: (min: 22.0, avg: 35.6, max: 54.0) [2023-12-25 23:47:08,785][121949] Avg episode reward: [(0, '4035.021'), (1, '4289.712')] [2023-12-25 23:47:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000027104_6938624.pth... [2023-12-25 23:47:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000026912_6889472.pth... [2023-12-25 23:47:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000026048_6668288.pth [2023-12-25 23:47:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000025888_6627328.pth [2023-12-25 23:47:08,930][123090] Updated weights for policy 1, policy_version 27106 (0.0010) [2023-12-25 23:47:09,000][123090] Updated weights for policy 1, policy_version 27116 (0.0010) [2023-12-25 23:47:09,074][123090] Updated weights for policy 1, policy_version 27126 (0.0011) [2023-12-25 23:47:09,142][123090] Updated weights for policy 1, policy_version 27136 (0.0011) [2023-12-25 23:47:09,431][123091] Updated weights for policy 0, policy_version 26920 (0.0009) [2023-12-25 23:47:09,483][123091] Updated weights for policy 0, policy_version 26930 (0.0009) [2023-12-25 23:47:09,536][123091] Updated weights for policy 0, policy_version 26940 (0.0009) [2023-12-25 23:47:09,939][123090] Updated weights for policy 1, policy_version 27146 (0.0011) [2023-12-25 23:47:10,009][123090] Updated weights for policy 1, policy_version 27156 (0.0011) [2023-12-25 23:47:10,076][123090] Updated weights for policy 1, policy_version 27166 (0.0011) [2023-12-25 23:47:10,410][123091] Updated weights for policy 0, policy_version 26950 (0.0009) [2023-12-25 23:47:10,474][123091] Updated weights for policy 0, policy_version 26960 (0.0008) [2023-12-25 23:47:10,524][123091] Updated weights for policy 0, policy_version 26970 (0.0009) [2023-12-25 23:47:10,920][123090] Updated weights for policy 1, policy_version 27176 (0.0010) [2023-12-25 23:47:10,985][123090] Updated weights for policy 1, policy_version 27186 (0.0011) [2023-12-25 23:47:11,061][123090] Updated weights for policy 1, policy_version 27196 (0.0010) [2023-12-25 23:47:11,388][123091] Updated weights for policy 0, policy_version 26980 (0.0009) [2023-12-25 23:47:11,452][123091] Updated weights for policy 0, policy_version 26991 (0.0010) [2023-12-25 23:47:11,513][123091] Updated weights for policy 0, policy_version 27001 (0.0009) [2023-12-25 23:47:11,926][123090] Updated weights for policy 1, policy_version 27206 (0.0009) [2023-12-25 23:47:11,994][123090] Updated weights for policy 1, policy_version 27216 (0.0005) [2023-12-25 23:47:12,068][123090] Updated weights for policy 1, policy_version 27226 (0.0005) [2023-12-25 23:47:12,425][123091] Updated weights for policy 0, policy_version 27011 (0.0010) [2023-12-25 23:47:12,490][123091] Updated weights for policy 0, policy_version 27021 (0.0010) [2023-12-25 23:47:12,559][123091] Updated weights for policy 0, policy_version 27031 (0.0007) [2023-12-25 23:47:12,827][123090] Updated weights for policy 1, policy_version 27236 (0.0007) [2023-12-25 23:47:12,896][123090] Updated weights for policy 1, policy_version 27246 (0.0009) [2023-12-25 23:47:12,964][123090] Updated weights for policy 1, policy_version 27256 (0.0008) [2023-12-25 23:47:13,374][123091] Updated weights for policy 0, policy_version 27041 (0.0007) [2023-12-25 23:47:13,424][123091] Updated weights for policy 0, policy_version 27051 (0.0009) [2023-12-25 23:47:13,473][123091] Updated weights for policy 0, policy_version 27061 (0.0009) [2023-12-25 23:47:13,530][123091] Updated weights for policy 0, policy_version 27072 (0.0009) [2023-12-25 23:47:13,781][123090] Updated weights for policy 1, policy_version 27266 (0.0010) [2023-12-25 23:47:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 13910016. Throughput: 0: 8684.5, 1: 8930.7. Samples: 13905072. Policy #0 lag: (min: 22.0, avg: 35.6, max: 54.0) [2023-12-25 23:47:13,785][121949] Avg episode reward: [(0, '4049.424'), (1, '4257.544')] [2023-12-25 23:47:13,845][123090] Updated weights for policy 1, policy_version 27276 (0.0009) [2023-12-25 23:47:13,907][123090] Updated weights for policy 1, policy_version 27286 (0.0008) [2023-12-25 23:47:13,960][123090] Updated weights for policy 1, policy_version 27296 (0.0009) [2023-12-25 23:47:14,399][123091] Updated weights for policy 0, policy_version 27082 (0.0009) [2023-12-25 23:47:14,457][123091] Updated weights for policy 0, policy_version 27092 (0.0009) [2023-12-25 23:47:14,526][123091] Updated weights for policy 0, policy_version 27102 (0.0009) [2023-12-25 23:47:14,812][123090] Updated weights for policy 1, policy_version 27306 (0.0010) [2023-12-25 23:47:14,881][123090] Updated weights for policy 1, policy_version 27316 (0.0009) [2023-12-25 23:47:14,948][123090] Updated weights for policy 1, policy_version 27326 (0.0009) [2023-12-25 23:47:15,370][123091] Updated weights for policy 0, policy_version 27112 (0.0009) [2023-12-25 23:47:15,441][123091] Updated weights for policy 0, policy_version 27122 (0.0009) [2023-12-25 23:47:15,503][123091] Updated weights for policy 0, policy_version 27132 (0.0009) [2023-12-25 23:47:15,794][123090] Updated weights for policy 1, policy_version 27336 (0.0010) [2023-12-25 23:47:15,861][123090] Updated weights for policy 1, policy_version 27346 (0.0010) [2023-12-25 23:47:15,931][123090] Updated weights for policy 1, policy_version 27356 (0.0010) [2023-12-25 23:47:16,115][123091] Updated weights for policy 0, policy_version 27143 (0.0008) [2023-12-25 23:47:16,170][123091] Updated weights for policy 0, policy_version 27153 (0.0005) [2023-12-25 23:47:16,231][123091] Updated weights for policy 0, policy_version 27163 (0.0005) [2023-12-25 23:47:16,707][123090] Updated weights for policy 1, policy_version 27366 (0.0007) [2023-12-25 23:47:16,760][123090] Updated weights for policy 1, policy_version 27376 (0.0009) [2023-12-25 23:47:16,808][123090] Updated weights for policy 1, policy_version 27386 (0.0008) [2023-12-25 23:47:16,937][123091] Updated weights for policy 0, policy_version 27173 (0.0005) [2023-12-25 23:47:16,981][123091] Updated weights for policy 0, policy_version 27183 (0.0005) [2023-12-25 23:47:17,031][123091] Updated weights for policy 0, policy_version 27193 (0.0005) [2023-12-25 23:47:17,507][123090] Updated weights for policy 1, policy_version 27396 (0.0009) [2023-12-25 23:47:17,565][123090] Updated weights for policy 1, policy_version 27406 (0.0008) [2023-12-25 23:47:17,613][123090] Updated weights for policy 1, policy_version 27416 (0.0008) [2023-12-25 23:47:17,861][123091] Updated weights for policy 0, policy_version 27203 (0.0007) [2023-12-25 23:47:17,922][123091] Updated weights for policy 0, policy_version 27214 (0.0010) [2023-12-25 23:47:17,975][123091] Updated weights for policy 0, policy_version 27225 (0.0010) [2023-12-25 23:47:18,380][123090] Updated weights for policy 1, policy_version 27426 (0.0008) [2023-12-25 23:47:18,446][123090] Updated weights for policy 1, policy_version 27436 (0.0009) [2023-12-25 23:47:18,515][123090] Updated weights for policy 1, policy_version 27446 (0.0010) [2023-12-25 23:47:18,568][123090] Updated weights for policy 1, policy_version 27456 (0.0010) [2023-12-25 23:47:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 14000128. Throughput: 0: 8712.7, 1: 8930.1. Samples: 14011724. Policy #0 lag: (min: 22.0, avg: 35.6, max: 54.0) [2023-12-25 23:47:18,785][121949] Avg episode reward: [(0, '3993.841'), (1, '4085.527')] [2023-12-25 23:47:18,865][123091] Updated weights for policy 0, policy_version 27235 (0.0009) [2023-12-25 23:47:18,930][123091] Updated weights for policy 0, policy_version 27245 (0.0010) [2023-12-25 23:47:18,981][123091] Updated weights for policy 0, policy_version 27255 (0.0010) [2023-12-25 23:47:19,406][123090] Updated weights for policy 1, policy_version 27466 (0.0010) [2023-12-25 23:47:19,460][123090] Updated weights for policy 1, policy_version 27476 (0.0008) [2023-12-25 23:47:19,526][123090] Updated weights for policy 1, policy_version 27486 (0.0009) [2023-12-25 23:47:19,786][123091] Updated weights for policy 0, policy_version 27265 (0.0010) [2023-12-25 23:47:19,859][123091] Updated weights for policy 0, policy_version 27275 (0.0006) [2023-12-25 23:47:19,925][123091] Updated weights for policy 0, policy_version 27285 (0.0007) [2023-12-25 23:47:19,994][123091] Updated weights for policy 0, policy_version 27295 (0.0007) [2023-12-25 23:47:20,349][123090] Updated weights for policy 1, policy_version 27496 (0.0011) [2023-12-25 23:47:20,415][123090] Updated weights for policy 1, policy_version 27506 (0.0010) [2023-12-25 23:47:20,484][123090] Updated weights for policy 1, policy_version 27516 (0.0011) [2023-12-25 23:47:20,789][123091] Updated weights for policy 0, policy_version 27305 (0.0009) [2023-12-25 23:47:20,858][123091] Updated weights for policy 0, policy_version 27315 (0.0006) [2023-12-25 23:47:20,927][123091] Updated weights for policy 0, policy_version 27325 (0.0006) [2023-12-25 23:47:21,354][123090] Updated weights for policy 1, policy_version 27526 (0.0010) [2023-12-25 23:47:21,428][123090] Updated weights for policy 1, policy_version 27536 (0.0007) [2023-12-25 23:47:21,503][123090] Updated weights for policy 1, policy_version 27546 (0.0008) [2023-12-25 23:47:21,679][123091] Updated weights for policy 0, policy_version 27335 (0.0008) [2023-12-25 23:47:21,756][123091] Updated weights for policy 0, policy_version 27345 (0.0007) [2023-12-25 23:47:21,826][123091] Updated weights for policy 0, policy_version 27355 (0.0006) [2023-12-25 23:47:22,271][123090] Updated weights for policy 1, policy_version 27556 (0.0008) [2023-12-25 23:47:22,330][123090] Updated weights for policy 1, policy_version 27566 (0.0009) [2023-12-25 23:47:22,408][123090] Updated weights for policy 1, policy_version 27576 (0.0010) [2023-12-25 23:47:22,620][123091] Updated weights for policy 0, policy_version 27365 (0.0007) [2023-12-25 23:47:22,682][123091] Updated weights for policy 0, policy_version 27375 (0.0007) [2023-12-25 23:47:22,746][123091] Updated weights for policy 0, policy_version 27385 (0.0010) [2023-12-25 23:47:23,210][123090] Updated weights for policy 1, policy_version 27586 (0.0009) [2023-12-25 23:47:23,280][123090] Updated weights for policy 1, policy_version 27596 (0.0005) [2023-12-25 23:47:23,342][123090] Updated weights for policy 1, policy_version 27606 (0.0005) [2023-12-25 23:47:23,414][123090] Updated weights for policy 1, policy_version 27616 (0.0008) [2023-12-25 23:47:23,574][123091] Updated weights for policy 0, policy_version 27395 (0.0009) [2023-12-25 23:47:23,638][123091] Updated weights for policy 0, policy_version 27405 (0.0008) [2023-12-25 23:47:23,686][123091] Updated weights for policy 0, policy_version 27415 (0.0009) [2023-12-25 23:47:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 14090240. Throughput: 0: 8731.2, 1: 8930.3. Samples: 14063808. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:47:23,785][121949] Avg episode reward: [(0, '3935.601'), (1, '4133.349')] [2023-12-25 23:47:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000027424_7020544.pth... [2023-12-25 23:47:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000027616_7069696.pth... [2023-12-25 23:47:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000026400_6758400.pth [2023-12-25 23:47:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000026592_6807552.pth [2023-12-25 23:47:24,121][123090] Updated weights for policy 1, policy_version 27626 (0.0005) [2023-12-25 23:47:24,167][123090] Updated weights for policy 1, policy_version 27636 (0.0007) [2023-12-25 23:47:24,233][123090] Updated weights for policy 1, policy_version 27646 (0.0008) [2023-12-25 23:47:24,486][123091] Updated weights for policy 0, policy_version 27425 (0.0009) [2023-12-25 23:47:24,545][123091] Updated weights for policy 0, policy_version 27435 (0.0008) [2023-12-25 23:47:24,599][123091] Updated weights for policy 0, policy_version 27445 (0.0005) [2023-12-25 23:47:24,652][123091] Updated weights for policy 0, policy_version 27455 (0.0006) [2023-12-25 23:47:24,888][123090] Updated weights for policy 1, policy_version 27656 (0.0010) [2023-12-25 23:47:24,949][123090] Updated weights for policy 1, policy_version 27666 (0.0010) [2023-12-25 23:47:25,005][123090] Updated weights for policy 1, policy_version 27676 (0.0010) [2023-12-25 23:47:25,350][123091] Updated weights for policy 0, policy_version 27465 (0.0006) [2023-12-25 23:47:25,402][123091] Updated weights for policy 0, policy_version 27475 (0.0010) [2023-12-25 23:47:25,454][123091] Updated weights for policy 0, policy_version 27485 (0.0010) [2023-12-25 23:47:25,803][123090] Updated weights for policy 1, policy_version 27686 (0.0010) [2023-12-25 23:47:25,858][123090] Updated weights for policy 1, policy_version 27696 (0.0005) [2023-12-25 23:47:25,917][123090] Updated weights for policy 1, policy_version 27706 (0.0005) [2023-12-25 23:47:26,196][123091] Updated weights for policy 0, policy_version 27495 (0.0010) [2023-12-25 23:47:26,254][123091] Updated weights for policy 0, policy_version 27505 (0.0010) [2023-12-25 23:47:26,308][123091] Updated weights for policy 0, policy_version 27515 (0.0010) [2023-12-25 23:47:26,581][123090] Updated weights for policy 1, policy_version 27716 (0.0007) [2023-12-25 23:47:26,650][123090] Updated weights for policy 1, policy_version 27726 (0.0010) [2023-12-25 23:47:26,712][123090] Updated weights for policy 1, policy_version 27736 (0.0010) [2023-12-25 23:47:27,022][123091] Updated weights for policy 0, policy_version 27525 (0.0007) [2023-12-25 23:47:27,073][123091] Updated weights for policy 0, policy_version 27535 (0.0007) [2023-12-25 23:47:27,120][123091] Updated weights for policy 0, policy_version 27545 (0.0008) [2023-12-25 23:47:27,502][123090] Updated weights for policy 1, policy_version 27746 (0.0010) [2023-12-25 23:47:27,560][123090] Updated weights for policy 1, policy_version 27756 (0.0010) [2023-12-25 23:47:27,621][123090] Updated weights for policy 1, policy_version 27766 (0.0010) [2023-12-25 23:47:27,682][123090] Updated weights for policy 1, policy_version 27776 (0.0010) [2023-12-25 23:47:27,943][123091] Updated weights for policy 0, policy_version 27555 (0.0008) [2023-12-25 23:47:28,001][123091] Updated weights for policy 0, policy_version 27565 (0.0009) [2023-12-25 23:47:28,054][123091] Updated weights for policy 0, policy_version 27576 (0.0010) [2023-12-25 23:47:28,490][123090] Updated weights for policy 1, policy_version 27786 (0.0010) [2023-12-25 23:47:28,556][123090] Updated weights for policy 1, policy_version 27796 (0.0010) [2023-12-25 23:47:28,618][123090] Updated weights for policy 1, policy_version 27806 (0.0010) [2023-12-25 23:47:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 14180352. Throughput: 0: 8804.2, 1: 9013.5. Samples: 14172820. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:47:28,785][121949] Avg episode reward: [(0, '3988.195'), (1, '4249.329')] [2023-12-25 23:47:28,931][123091] Updated weights for policy 0, policy_version 27587 (0.0010) [2023-12-25 23:47:28,985][123091] Updated weights for policy 0, policy_version 27598 (0.0010) [2023-12-25 23:47:29,040][123091] Updated weights for policy 0, policy_version 27610 (0.0010) [2023-12-25 23:47:29,310][123090] Updated weights for policy 1, policy_version 27816 (0.0006) [2023-12-25 23:47:29,399][123090] Updated weights for policy 1, policy_version 27826 (0.0007) [2023-12-25 23:47:29,468][123090] Updated weights for policy 1, policy_version 27836 (0.0006) [2023-12-25 23:47:29,983][123091] Updated weights for policy 0, policy_version 27620 (0.0008) [2023-12-25 23:47:30,049][123091] Updated weights for policy 0, policy_version 27630 (0.0005) [2023-12-25 23:47:30,118][123091] Updated weights for policy 0, policy_version 27640 (0.0008) [2023-12-25 23:47:30,158][123090] Updated weights for policy 1, policy_version 27846 (0.0008) [2023-12-25 23:47:30,223][123090] Updated weights for policy 1, policy_version 27856 (0.0009) [2023-12-25 23:47:30,283][123090] Updated weights for policy 1, policy_version 27866 (0.0008) [2023-12-25 23:47:30,871][123091] Updated weights for policy 0, policy_version 27650 (0.0007) [2023-12-25 23:47:30,929][123091] Updated weights for policy 0, policy_version 27660 (0.0006) [2023-12-25 23:47:30,977][123091] Updated weights for policy 0, policy_version 27670 (0.0005) [2023-12-25 23:47:31,020][123090] Updated weights for policy 1, policy_version 27876 (0.0009) [2023-12-25 23:47:31,050][123091] Updated weights for policy 0, policy_version 27680 (0.0010) [2023-12-25 23:47:31,088][123090] Updated weights for policy 1, policy_version 27886 (0.0008) [2023-12-25 23:47:31,158][123090] Updated weights for policy 1, policy_version 27896 (0.0006) [2023-12-25 23:47:31,864][123091] Updated weights for policy 0, policy_version 27690 (0.0005) [2023-12-25 23:47:31,895][123090] Updated weights for policy 1, policy_version 27906 (0.0006) [2023-12-25 23:47:31,931][123091] Updated weights for policy 0, policy_version 27700 (0.0006) [2023-12-25 23:47:31,961][123090] Updated weights for policy 1, policy_version 27916 (0.0006) [2023-12-25 23:47:31,987][123091] Updated weights for policy 0, policy_version 27710 (0.0006) [2023-12-25 23:47:32,032][123090] Updated weights for policy 1, policy_version 27926 (0.0009) [2023-12-25 23:47:32,102][123090] Updated weights for policy 1, policy_version 27936 (0.0009) [2023-12-25 23:47:32,719][123091] Updated weights for policy 0, policy_version 27720 (0.0009) [2023-12-25 23:47:32,777][123091] Updated weights for policy 0, policy_version 27730 (0.0009) [2023-12-25 23:47:32,843][123091] Updated weights for policy 0, policy_version 27740 (0.0009) [2023-12-25 23:47:32,932][123090] Updated weights for policy 1, policy_version 27946 (0.0010) [2023-12-25 23:47:32,984][123090] Updated weights for policy 1, policy_version 27956 (0.0009) [2023-12-25 23:47:33,043][123090] Updated weights for policy 1, policy_version 27966 (0.0005) [2023-12-25 23:47:33,528][123091] Updated weights for policy 0, policy_version 27750 (0.0005) [2023-12-25 23:47:33,591][123091] Updated weights for policy 0, policy_version 27760 (0.0006) [2023-12-25 23:47:33,666][123091] Updated weights for policy 0, policy_version 27770 (0.0005) [2023-12-25 23:47:33,750][123090] Updated weights for policy 1, policy_version 27976 (0.0009) [2023-12-25 23:47:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 14270464. Throughput: 0: 8827.5, 1: 8970.9. Samples: 14283048. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:47:33,785][121949] Avg episode reward: [(0, '4064.117'), (1, '4293.289')] [2023-12-25 23:47:33,806][123090] Updated weights for policy 1, policy_version 27986 (0.0012) [2023-12-25 23:47:33,864][123090] Updated weights for policy 1, policy_version 27996 (0.0010) [2023-12-25 23:47:33,883][123008] Saving new best policy, reward=4293.289! [2023-12-25 23:47:34,358][123091] Updated weights for policy 0, policy_version 27780 (0.0007) [2023-12-25 23:47:34,419][123091] Updated weights for policy 0, policy_version 27790 (0.0009) [2023-12-25 23:47:34,481][123091] Updated weights for policy 0, policy_version 27800 (0.0009) [2023-12-25 23:47:34,661][123090] Updated weights for policy 1, policy_version 28006 (0.0010) [2023-12-25 23:47:34,718][123090] Updated weights for policy 1, policy_version 28016 (0.0010) [2023-12-25 23:47:34,782][123090] Updated weights for policy 1, policy_version 28026 (0.0009) [2023-12-25 23:47:35,244][123091] Updated weights for policy 0, policy_version 27810 (0.0009) [2023-12-25 23:47:35,297][123091] Updated weights for policy 0, policy_version 27820 (0.0008) [2023-12-25 23:47:35,345][123091] Updated weights for policy 0, policy_version 27830 (0.0009) [2023-12-25 23:47:35,404][123091] Updated weights for policy 0, policy_version 27840 (0.0008) [2023-12-25 23:47:35,634][123090] Updated weights for policy 1, policy_version 28036 (0.0011) [2023-12-25 23:47:35,694][123090] Updated weights for policy 1, policy_version 28046 (0.0011) [2023-12-25 23:47:35,745][123090] Updated weights for policy 1, policy_version 28056 (0.0010) [2023-12-25 23:47:36,191][123091] Updated weights for policy 0, policy_version 27850 (0.0009) [2023-12-25 23:47:36,250][123091] Updated weights for policy 0, policy_version 27860 (0.0009) [2023-12-25 23:47:36,305][123091] Updated weights for policy 0, policy_version 27870 (0.0009) [2023-12-25 23:47:36,508][123090] Updated weights for policy 1, policy_version 28066 (0.0010) [2023-12-25 23:47:36,575][123090] Updated weights for policy 1, policy_version 28076 (0.0009) [2023-12-25 23:47:36,639][123090] Updated weights for policy 1, policy_version 28086 (0.0007) [2023-12-25 23:47:36,700][123090] Updated weights for policy 1, policy_version 28096 (0.0006) [2023-12-25 23:47:37,185][123091] Updated weights for policy 0, policy_version 27880 (0.0006) [2023-12-25 23:47:37,253][123091] Updated weights for policy 0, policy_version 27890 (0.0005) [2023-12-25 23:47:37,327][123091] Updated weights for policy 0, policy_version 27900 (0.0005) [2023-12-25 23:47:37,439][123090] Updated weights for policy 1, policy_version 28106 (0.0005) [2023-12-25 23:47:37,496][123090] Updated weights for policy 1, policy_version 28116 (0.0005) [2023-12-25 23:47:37,572][123090] Updated weights for policy 1, policy_version 28126 (0.0005) [2023-12-25 23:47:37,950][123091] Updated weights for policy 0, policy_version 27910 (0.0005) [2023-12-25 23:47:38,019][123091] Updated weights for policy 0, policy_version 27920 (0.0007) [2023-12-25 23:47:38,080][123091] Updated weights for policy 0, policy_version 27930 (0.0009) [2023-12-25 23:47:38,284][123090] Updated weights for policy 1, policy_version 28136 (0.0010) [2023-12-25 23:47:38,348][123090] Updated weights for policy 1, policy_version 28146 (0.0013) [2023-12-25 23:47:38,411][123090] Updated weights for policy 1, policy_version 28156 (0.0010) [2023-12-25 23:47:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 14360576. Throughput: 0: 8877.5, 1: 8957.0. Samples: 14336344. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-25 23:47:38,785][121949] Avg episode reward: [(0, '3988.026'), (1, '4206.856')] [2023-12-25 23:47:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000028160_7208960.pth... [2023-12-25 23:47:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000027936_7151616.pth... [2023-12-25 23:47:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000027104_6938624.pth [2023-12-25 23:47:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000026912_6889472.pth [2023-12-25 23:47:38,829][123091] Updated weights for policy 0, policy_version 27940 (0.0007) [2023-12-25 23:47:38,892][123091] Updated weights for policy 0, policy_version 27950 (0.0007) [2023-12-25 23:47:38,944][123091] Updated weights for policy 0, policy_version 27960 (0.0009) [2023-12-25 23:47:39,206][123090] Updated weights for policy 1, policy_version 28166 (0.0010) [2023-12-25 23:47:39,277][123090] Updated weights for policy 1, policy_version 28176 (0.0009) [2023-12-25 23:47:39,339][123090] Updated weights for policy 1, policy_version 28186 (0.0010) [2023-12-25 23:47:39,802][123091] Updated weights for policy 0, policy_version 27970 (0.0009) [2023-12-25 23:47:39,878][123091] Updated weights for policy 0, policy_version 27980 (0.0008) [2023-12-25 23:47:39,952][123091] Updated weights for policy 0, policy_version 27990 (0.0006) [2023-12-25 23:47:40,023][123091] Updated weights for policy 0, policy_version 28000 (0.0007) [2023-12-25 23:47:40,153][123090] Updated weights for policy 1, policy_version 28196 (0.0008) [2023-12-25 23:47:40,225][123090] Updated weights for policy 1, policy_version 28206 (0.0006) [2023-12-25 23:47:40,301][123090] Updated weights for policy 1, policy_version 28216 (0.0006) [2023-12-25 23:47:40,744][123091] Updated weights for policy 0, policy_version 28010 (0.0005) [2023-12-25 23:47:40,815][123091] Updated weights for policy 0, policy_version 28020 (0.0005) [2023-12-25 23:47:40,882][123091] Updated weights for policy 0, policy_version 28030 (0.0005) [2023-12-25 23:47:41,111][123090] Updated weights for policy 1, policy_version 28226 (0.0010) [2023-12-25 23:47:41,182][123090] Updated weights for policy 1, policy_version 28236 (0.0009) [2023-12-25 23:47:41,261][123090] Updated weights for policy 1, policy_version 28246 (0.0006) [2023-12-25 23:47:41,324][123090] Updated weights for policy 1, policy_version 28256 (0.0008) [2023-12-25 23:47:41,615][123091] Updated weights for policy 0, policy_version 28040 (0.0008) [2023-12-25 23:47:41,692][123091] Updated weights for policy 0, policy_version 28050 (0.0008) [2023-12-25 23:47:41,767][123091] Updated weights for policy 0, policy_version 28060 (0.0008) [2023-12-25 23:47:42,153][123090] Updated weights for policy 1, policy_version 28266 (0.0008) [2023-12-25 23:47:42,202][123090] Updated weights for policy 1, policy_version 28276 (0.0007) [2023-12-25 23:47:42,250][123090] Updated weights for policy 1, policy_version 28286 (0.0008) [2023-12-25 23:47:42,557][123091] Updated weights for policy 0, policy_version 28070 (0.0008) [2023-12-25 23:47:42,618][123091] Updated weights for policy 0, policy_version 28080 (0.0009) [2023-12-25 23:47:42,682][123091] Updated weights for policy 0, policy_version 28090 (0.0009) [2023-12-25 23:47:43,143][123090] Updated weights for policy 1, policy_version 28296 (0.0009) [2023-12-25 23:47:43,199][123090] Updated weights for policy 1, policy_version 28306 (0.0007) [2023-12-25 23:47:43,248][123090] Updated weights for policy 1, policy_version 28316 (0.0009) [2023-12-25 23:47:43,512][123091] Updated weights for policy 0, policy_version 28100 (0.0009) [2023-12-25 23:47:43,575][123091] Updated weights for policy 0, policy_version 28110 (0.0009) [2023-12-25 23:47:43,646][123091] Updated weights for policy 0, policy_version 28120 (0.0006) [2023-12-25 23:47:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 14450688. Throughput: 0: 8917.2, 1: 8841.2. Samples: 14442696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:47:43,785][121949] Avg episode reward: [(0, '3936.184'), (1, '4084.042')] [2023-12-25 23:47:44,036][123090] Updated weights for policy 1, policy_version 28326 (0.0007) [2023-12-25 23:47:44,098][123090] Updated weights for policy 1, policy_version 28336 (0.0007) [2023-12-25 23:47:44,158][123090] Updated weights for policy 1, policy_version 28346 (0.0010) [2023-12-25 23:47:44,441][123091] Updated weights for policy 0, policy_version 28130 (0.0007) [2023-12-25 23:47:44,497][123091] Updated weights for policy 0, policy_version 28140 (0.0009) [2023-12-25 23:47:44,559][123091] Updated weights for policy 0, policy_version 28150 (0.0009) [2023-12-25 23:47:44,616][123091] Updated weights for policy 0, policy_version 28160 (0.0009) [2023-12-25 23:47:44,786][123090] Updated weights for policy 1, policy_version 28356 (0.0008) [2023-12-25 23:47:44,857][123090] Updated weights for policy 1, policy_version 28366 (0.0007) [2023-12-25 23:47:44,928][123090] Updated weights for policy 1, policy_version 28376 (0.0009) [2023-12-25 23:47:45,508][123091] Updated weights for policy 0, policy_version 28170 (0.0010) [2023-12-25 23:47:45,567][123091] Updated weights for policy 0, policy_version 28180 (0.0010) [2023-12-25 23:47:45,630][123091] Updated weights for policy 0, policy_version 28190 (0.0009) [2023-12-25 23:47:45,742][123090] Updated weights for policy 1, policy_version 28386 (0.0010) [2023-12-25 23:47:45,805][123090] Updated weights for policy 1, policy_version 28396 (0.0006) [2023-12-25 23:47:45,866][123090] Updated weights for policy 1, policy_version 28406 (0.0007) [2023-12-25 23:47:45,928][123090] Updated weights for policy 1, policy_version 28416 (0.0006) [2023-12-25 23:47:46,538][123091] Updated weights for policy 0, policy_version 28200 (0.0009) [2023-12-25 23:47:46,582][123090] Updated weights for policy 1, policy_version 28426 (0.0005) [2023-12-25 23:47:46,596][123091] Updated weights for policy 0, policy_version 28210 (0.0009) [2023-12-25 23:47:46,635][123090] Updated weights for policy 1, policy_version 28436 (0.0005) [2023-12-25 23:47:46,653][123091] Updated weights for policy 0, policy_version 28220 (0.0009) [2023-12-25 23:47:46,701][123090] Updated weights for policy 1, policy_version 28446 (0.0005) [2023-12-25 23:47:47,424][123091] Updated weights for policy 0, policy_version 28230 (0.0006) [2023-12-25 23:47:47,461][123090] Updated weights for policy 1, policy_version 28456 (0.0007) [2023-12-25 23:47:47,494][123091] Updated weights for policy 0, policy_version 28240 (0.0006) [2023-12-25 23:47:47,520][123090] Updated weights for policy 1, policy_version 28466 (0.0009) [2023-12-25 23:47:47,555][123091] Updated weights for policy 0, policy_version 28250 (0.0007) [2023-12-25 23:47:47,578][123090] Updated weights for policy 1, policy_version 28476 (0.0009) [2023-12-25 23:47:48,365][123091] Updated weights for policy 0, policy_version 28260 (0.0009) [2023-12-25 23:47:48,399][123090] Updated weights for policy 1, policy_version 28486 (0.0008) [2023-12-25 23:47:48,420][123091] Updated weights for policy 0, policy_version 28270 (0.0009) [2023-12-25 23:47:48,465][123090] Updated weights for policy 1, policy_version 28496 (0.0007) [2023-12-25 23:47:48,475][123091] Updated weights for policy 0, policy_version 28280 (0.0010) [2023-12-25 23:47:48,528][123090] Updated weights for policy 1, policy_version 28506 (0.0007) [2023-12-25 23:47:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 14540800. Throughput: 0: 8795.9, 1: 8938.9. Samples: 14548576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:47:48,785][121949] Avg episode reward: [(0, '4016.315'), (1, '3951.149')] [2023-12-25 23:47:49,347][123091] Updated weights for policy 0, policy_version 28290 (0.0009) [2023-12-25 23:47:49,357][123090] Updated weights for policy 1, policy_version 28516 (0.0010) [2023-12-25 23:47:49,418][123091] Updated weights for policy 0, policy_version 28300 (0.0009) [2023-12-25 23:47:49,428][123090] Updated weights for policy 1, policy_version 28526 (0.0008) [2023-12-25 23:47:49,481][123091] Updated weights for policy 0, policy_version 28310 (0.0007) [2023-12-25 23:47:49,502][123090] Updated weights for policy 1, policy_version 28536 (0.0009) [2023-12-25 23:47:49,547][123091] Updated weights for policy 0, policy_version 28320 (0.0006) [2023-12-25 23:47:50,312][123090] Updated weights for policy 1, policy_version 28546 (0.0010) [2023-12-25 23:47:50,373][123090] Updated weights for policy 1, policy_version 28556 (0.0009) [2023-12-25 23:47:50,383][123091] Updated weights for policy 0, policy_version 28330 (0.0007) [2023-12-25 23:47:50,435][123090] Updated weights for policy 1, policy_version 28566 (0.0007) [2023-12-25 23:47:50,448][123091] Updated weights for policy 0, policy_version 28340 (0.0009) [2023-12-25 23:47:50,486][123090] Updated weights for policy 1, policy_version 28576 (0.0007) [2023-12-25 23:47:50,507][123091] Updated weights for policy 0, policy_version 28350 (0.0009) [2023-12-25 23:47:51,322][123091] Updated weights for policy 0, policy_version 28360 (0.0010) [2023-12-25 23:47:51,339][123090] Updated weights for policy 1, policy_version 28586 (0.0010) [2023-12-25 23:47:51,391][123091] Updated weights for policy 0, policy_version 28370 (0.0009) [2023-12-25 23:47:51,411][123090] Updated weights for policy 1, policy_version 28596 (0.0009) [2023-12-25 23:47:51,461][123091] Updated weights for policy 0, policy_version 28380 (0.0008) [2023-12-25 23:47:51,472][123090] Updated weights for policy 1, policy_version 28606 (0.0008) [2023-12-25 23:47:52,237][123091] Updated weights for policy 0, policy_version 28390 (0.0009) [2023-12-25 23:47:52,301][123091] Updated weights for policy 0, policy_version 28400 (0.0011) [2023-12-25 23:47:52,345][123090] Updated weights for policy 1, policy_version 28616 (0.0007) [2023-12-25 23:47:52,373][123091] Updated weights for policy 0, policy_version 28410 (0.0009) [2023-12-25 23:47:52,417][123090] Updated weights for policy 1, policy_version 28626 (0.0010) [2023-12-25 23:47:52,489][123090] Updated weights for policy 1, policy_version 28636 (0.0010) [2023-12-25 23:47:53,198][123091] Updated weights for policy 0, policy_version 28420 (0.0008) [2023-12-25 23:47:53,212][123090] Updated weights for policy 1, policy_version 28646 (0.0008) [2023-12-25 23:47:53,252][123091] Updated weights for policy 0, policy_version 28430 (0.0008) [2023-12-25 23:47:53,267][123090] Updated weights for policy 1, policy_version 28656 (0.0007) [2023-12-25 23:47:53,300][123091] Updated weights for policy 0, policy_version 28440 (0.0009) [2023-12-25 23:47:53,325][123090] Updated weights for policy 1, policy_version 28666 (0.0005) [2023-12-25 23:47:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 14622720. Throughput: 0: 8790.1, 1: 8900.8. Samples: 14599252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:47:53,786][121949] Avg episode reward: [(0, '4138.086'), (1, '4185.889')] [2023-12-25 23:47:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000028448_7282688.pth... [2023-12-25 23:47:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000028672_7340032.pth... [2023-12-25 23:47:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000027424_7020544.pth [2023-12-25 23:47:53,800][123007] Saving new best policy, reward=4138.086! [2023-12-25 23:47:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000027616_7069696.pth [2023-12-25 23:47:53,986][123090] Updated weights for policy 1, policy_version 28676 (0.0005) [2023-12-25 23:47:54,042][123090] Updated weights for policy 1, policy_version 28686 (0.0010) [2023-12-25 23:47:54,075][123091] Updated weights for policy 0, policy_version 28450 (0.0008) [2023-12-25 23:47:54,095][123090] Updated weights for policy 1, policy_version 28696 (0.0009) [2023-12-25 23:47:54,130][123091] Updated weights for policy 0, policy_version 28460 (0.0005) [2023-12-25 23:47:54,182][123091] Updated weights for policy 0, policy_version 28470 (0.0005) [2023-12-25 23:47:54,242][123091] Updated weights for policy 0, policy_version 28480 (0.0006) [2023-12-25 23:47:54,804][123090] Updated weights for policy 1, policy_version 28706 (0.0008) [2023-12-25 23:47:54,879][123090] Updated weights for policy 1, policy_version 28716 (0.0005) [2023-12-25 23:47:54,949][123090] Updated weights for policy 1, policy_version 28726 (0.0006) [2023-12-25 23:47:54,949][123091] Updated weights for policy 0, policy_version 28490 (0.0007) [2023-12-25 23:47:55,008][123091] Updated weights for policy 0, policy_version 28500 (0.0007) [2023-12-25 23:47:55,017][123090] Updated weights for policy 1, policy_version 28736 (0.0006) [2023-12-25 23:47:55,059][123091] Updated weights for policy 0, policy_version 28510 (0.0009) [2023-12-25 23:47:55,650][123090] Updated weights for policy 1, policy_version 28747 (0.0009) [2023-12-25 23:47:55,711][123090] Updated weights for policy 1, policy_version 28757 (0.0009) [2023-12-25 23:47:55,718][123091] Updated weights for policy 0, policy_version 28520 (0.0006) [2023-12-25 23:47:55,770][123090] Updated weights for policy 1, policy_version 28767 (0.0009) [2023-12-25 23:47:55,771][123091] Updated weights for policy 0, policy_version 28530 (0.0005) [2023-12-25 23:47:55,817][123091] Updated weights for policy 0, policy_version 28540 (0.0005) [2023-12-25 23:47:56,550][123090] Updated weights for policy 1, policy_version 28777 (0.0009) [2023-12-25 23:47:56,593][123091] Updated weights for policy 0, policy_version 28550 (0.0008) [2023-12-25 23:47:56,608][123090] Updated weights for policy 1, policy_version 28787 (0.0008) [2023-12-25 23:47:56,649][123091] Updated weights for policy 0, policy_version 28561 (0.0008) [2023-12-25 23:47:56,673][123090] Updated weights for policy 1, policy_version 28797 (0.0009) [2023-12-25 23:47:56,697][123091] Updated weights for policy 0, policy_version 28571 (0.0007) [2023-12-25 23:47:57,494][123090] Updated weights for policy 1, policy_version 28807 (0.0010) [2023-12-25 23:47:57,540][123090] Updated weights for policy 1, policy_version 28817 (0.0008) [2023-12-25 23:47:57,552][123091] Updated weights for policy 0, policy_version 28581 (0.0008) [2023-12-25 23:47:57,601][123090] Updated weights for policy 1, policy_version 28827 (0.0009) [2023-12-25 23:47:57,602][123091] Updated weights for policy 0, policy_version 28591 (0.0009) [2023-12-25 23:47:57,665][123091] Updated weights for policy 0, policy_version 28601 (0.0009) [2023-12-25 23:47:58,397][123091] Updated weights for policy 0, policy_version 28611 (0.0007) [2023-12-25 23:47:58,458][123091] Updated weights for policy 0, policy_version 28621 (0.0008) [2023-12-25 23:47:58,468][123090] Updated weights for policy 1, policy_version 28837 (0.0008) [2023-12-25 23:47:58,527][123091] Updated weights for policy 0, policy_version 28631 (0.0008) [2023-12-25 23:47:58,538][123090] Updated weights for policy 1, policy_version 28847 (0.0008) [2023-12-25 23:47:58,610][123090] Updated weights for policy 1, policy_version 28857 (0.0007) [2023-12-25 23:47:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 14721024. Throughput: 0: 8914.8, 1: 8995.6. Samples: 14711040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:47:58,785][121949] Avg episode reward: [(0, '4143.287'), (1, '4407.226')] [2023-12-25 23:47:58,785][123008] Saving new best policy, reward=4407.226! [2023-12-25 23:47:58,785][123007] Saving new best policy, reward=4143.287! [2023-12-25 23:47:59,359][123090] Updated weights for policy 1, policy_version 28867 (0.0009) [2023-12-25 23:47:59,376][123091] Updated weights for policy 0, policy_version 28641 (0.0008) [2023-12-25 23:47:59,414][123090] Updated weights for policy 1, policy_version 28877 (0.0010) [2023-12-25 23:47:59,443][123091] Updated weights for policy 0, policy_version 28651 (0.0011) [2023-12-25 23:47:59,472][123090] Updated weights for policy 1, policy_version 28887 (0.0010) [2023-12-25 23:47:59,505][123091] Updated weights for policy 0, policy_version 28661 (0.0011) [2023-12-25 23:47:59,566][123091] Updated weights for policy 0, policy_version 28671 (0.0011) [2023-12-25 23:48:00,292][123090] Updated weights for policy 1, policy_version 28897 (0.0010) [2023-12-25 23:48:00,356][123090] Updated weights for policy 1, policy_version 28907 (0.0009) [2023-12-25 23:48:00,404][123091] Updated weights for policy 0, policy_version 28681 (0.0011) [2023-12-25 23:48:00,414][123090] Updated weights for policy 1, policy_version 28917 (0.0007) [2023-12-25 23:48:00,459][123091] Updated weights for policy 0, policy_version 28691 (0.0010) [2023-12-25 23:48:00,464][123090] Updated weights for policy 1, policy_version 28927 (0.0007) [2023-12-25 23:48:00,510][123091] Updated weights for policy 0, policy_version 28701 (0.0010) [2023-12-25 23:48:01,166][123090] Updated weights for policy 1, policy_version 28937 (0.0008) [2023-12-25 23:48:01,216][123090] Updated weights for policy 1, policy_version 28947 (0.0009) [2023-12-25 23:48:01,273][123090] Updated weights for policy 1, policy_version 28957 (0.0009) [2023-12-25 23:48:01,366][123091] Updated weights for policy 0, policy_version 28711 (0.0010) [2023-12-25 23:48:01,428][123091] Updated weights for policy 0, policy_version 28721 (0.0011) [2023-12-25 23:48:01,484][123091] Updated weights for policy 0, policy_version 28731 (0.0011) [2023-12-25 23:48:02,113][123090] Updated weights for policy 1, policy_version 28967 (0.0007) [2023-12-25 23:48:02,167][123090] Updated weights for policy 1, policy_version 28977 (0.0006) [2023-12-25 23:48:02,233][123091] Updated weights for policy 0, policy_version 28741 (0.0009) [2023-12-25 23:48:02,235][123090] Updated weights for policy 1, policy_version 28987 (0.0006) [2023-12-25 23:48:02,303][123091] Updated weights for policy 0, policy_version 28751 (0.0010) [2023-12-25 23:48:02,359][123091] Updated weights for policy 0, policy_version 28762 (0.0009) [2023-12-25 23:48:02,905][123090] Updated weights for policy 1, policy_version 28997 (0.0007) [2023-12-25 23:48:02,977][123090] Updated weights for policy 1, policy_version 29007 (0.0009) [2023-12-25 23:48:03,045][123090] Updated weights for policy 1, policy_version 29017 (0.0010) [2023-12-25 23:48:03,208][123091] Updated weights for policy 0, policy_version 28772 (0.0007) [2023-12-25 23:48:03,262][123091] Updated weights for policy 0, policy_version 28782 (0.0010) [2023-12-25 23:48:03,320][123091] Updated weights for policy 0, policy_version 28792 (0.0006) [2023-12-25 23:48:03,738][123090] Updated weights for policy 1, policy_version 29027 (0.0008) [2023-12-25 23:48:03,783][123090] Updated weights for policy 1, policy_version 29037 (0.0005) [2023-12-25 23:48:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 14802944. Throughput: 0: 8885.5, 1: 9049.8. Samples: 14818812. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:48:03,785][121949] Avg episode reward: [(0, '3991.381'), (1, '4406.284')] [2023-12-25 23:48:03,845][123090] Updated weights for policy 1, policy_version 29047 (0.0006) [2023-12-25 23:48:03,970][123091] Updated weights for policy 0, policy_version 28802 (0.0006) [2023-12-25 23:48:04,031][123091] Updated weights for policy 0, policy_version 28812 (0.0008) [2023-12-25 23:48:04,099][123091] Updated weights for policy 0, policy_version 28822 (0.0008) [2023-12-25 23:48:04,161][123091] Updated weights for policy 0, policy_version 28832 (0.0009) [2023-12-25 23:48:04,656][123090] Updated weights for policy 1, policy_version 29057 (0.0008) [2023-12-25 23:48:04,713][123090] Updated weights for policy 1, policy_version 29067 (0.0009) [2023-12-25 23:48:04,768][123090] Updated weights for policy 1, policy_version 29077 (0.0010) [2023-12-25 23:48:04,822][123090] Updated weights for policy 1, policy_version 29087 (0.0010) [2023-12-25 23:48:04,904][123091] Updated weights for policy 0, policy_version 28842 (0.0009) [2023-12-25 23:48:04,968][123091] Updated weights for policy 0, policy_version 28852 (0.0010) [2023-12-25 23:48:05,027][123091] Updated weights for policy 0, policy_version 28862 (0.0010) [2023-12-25 23:48:05,708][123090] Updated weights for policy 1, policy_version 29097 (0.0006) [2023-12-25 23:48:05,757][123091] Updated weights for policy 0, policy_version 28872 (0.0006) [2023-12-25 23:48:05,768][123090] Updated weights for policy 1, policy_version 29107 (0.0007) [2023-12-25 23:48:05,807][123091] Updated weights for policy 0, policy_version 28882 (0.0007) [2023-12-25 23:48:05,827][123090] Updated weights for policy 1, policy_version 29117 (0.0008) [2023-12-25 23:48:05,868][123091] Updated weights for policy 0, policy_version 28892 (0.0009) [2023-12-25 23:48:06,554][123090] Updated weights for policy 1, policy_version 29127 (0.0008) [2023-12-25 23:48:06,620][123091] Updated weights for policy 0, policy_version 28902 (0.0007) [2023-12-25 23:48:06,625][123090] Updated weights for policy 1, policy_version 29137 (0.0008) [2023-12-25 23:48:06,671][123091] Updated weights for policy 0, policy_version 28912 (0.0010) [2023-12-25 23:48:06,690][123090] Updated weights for policy 1, policy_version 29147 (0.0008) [2023-12-25 23:48:06,737][123091] Updated weights for policy 0, policy_version 28922 (0.0009) [2023-12-25 23:48:07,438][123091] Updated weights for policy 0, policy_version 28932 (0.0010) [2023-12-25 23:48:07,497][123091] Updated weights for policy 0, policy_version 28942 (0.0009) [2023-12-25 23:48:07,553][123090] Updated weights for policy 1, policy_version 29157 (0.0008) [2023-12-25 23:48:07,560][123091] Updated weights for policy 0, policy_version 28952 (0.0009) [2023-12-25 23:48:07,610][123090] Updated weights for policy 1, policy_version 29167 (0.0010) [2023-12-25 23:48:07,670][123090] Updated weights for policy 1, policy_version 29177 (0.0010) [2023-12-25 23:48:08,369][123091] Updated weights for policy 0, policy_version 28962 (0.0007) [2023-12-25 23:48:08,436][123091] Updated weights for policy 0, policy_version 28972 (0.0006) [2023-12-25 23:48:08,483][123090] Updated weights for policy 1, policy_version 29187 (0.0009) [2023-12-25 23:48:08,500][123091] Updated weights for policy 0, policy_version 28982 (0.0009) [2023-12-25 23:48:08,542][123090] Updated weights for policy 1, policy_version 29197 (0.0006) [2023-12-25 23:48:08,567][123091] Updated weights for policy 0, policy_version 28992 (0.0009) [2023-12-25 23:48:08,604][123090] Updated weights for policy 1, policy_version 29207 (0.0010) [2023-12-25 23:48:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 14901248. Throughput: 0: 8922.7, 1: 9071.3. Samples: 14873540. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:48:08,785][121949] Avg episode reward: [(0, '3928.840'), (1, '4372.422')] [2023-12-25 23:48:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000028992_7421952.pth... [2023-12-25 23:48:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000029216_7479296.pth... [2023-12-25 23:48:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000027936_7151616.pth [2023-12-25 23:48:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000028160_7208960.pth [2023-12-25 23:48:09,364][123091] Updated weights for policy 0, policy_version 29002 (0.0008) [2023-12-25 23:48:09,435][123091] Updated weights for policy 0, policy_version 29012 (0.0009) [2023-12-25 23:48:09,469][123090] Updated weights for policy 1, policy_version 29217 (0.0010) [2023-12-25 23:48:09,503][123091] Updated weights for policy 0, policy_version 29022 (0.0007) [2023-12-25 23:48:09,535][123090] Updated weights for policy 1, policy_version 29227 (0.0008) [2023-12-25 23:48:09,606][123090] Updated weights for policy 1, policy_version 29237 (0.0006) [2023-12-25 23:48:09,666][123090] Updated weights for policy 1, policy_version 29247 (0.0007) [2023-12-25 23:48:10,374][123091] Updated weights for policy 0, policy_version 29032 (0.0010) [2023-12-25 23:48:10,439][123091] Updated weights for policy 0, policy_version 29042 (0.0006) [2023-12-25 23:48:10,452][123090] Updated weights for policy 1, policy_version 29257 (0.0008) [2023-12-25 23:48:10,512][123091] Updated weights for policy 0, policy_version 29052 (0.0006) [2023-12-25 23:48:10,522][123090] Updated weights for policy 1, policy_version 29267 (0.0006) [2023-12-25 23:48:10,583][123090] Updated weights for policy 1, policy_version 29277 (0.0006) [2023-12-25 23:48:11,258][123091] Updated weights for policy 0, policy_version 29062 (0.0009) [2023-12-25 23:48:11,287][123090] Updated weights for policy 1, policy_version 29287 (0.0008) [2023-12-25 23:48:11,315][123091] Updated weights for policy 0, policy_version 29072 (0.0010) [2023-12-25 23:48:11,353][123090] Updated weights for policy 1, policy_version 29297 (0.0008) [2023-12-25 23:48:11,377][123091] Updated weights for policy 0, policy_version 29082 (0.0011) [2023-12-25 23:48:11,429][123090] Updated weights for policy 1, policy_version 29308 (0.0008) [2023-12-25 23:48:12,236][123090] Updated weights for policy 1, policy_version 29318 (0.0008) [2023-12-25 23:48:12,245][123091] Updated weights for policy 0, policy_version 29092 (0.0010) [2023-12-25 23:48:12,305][123090] Updated weights for policy 1, policy_version 29328 (0.0009) [2023-12-25 23:48:12,319][123091] Updated weights for policy 0, policy_version 29102 (0.0007) [2023-12-25 23:48:12,377][123090] Updated weights for policy 1, policy_version 29338 (0.0008) [2023-12-25 23:48:12,386][123091] Updated weights for policy 0, policy_version 29112 (0.0009) [2023-12-25 23:48:13,105][123091] Updated weights for policy 0, policy_version 29122 (0.0005) [2023-12-25 23:48:13,132][123090] Updated weights for policy 1, policy_version 29348 (0.0008) [2023-12-25 23:48:13,155][123091] Updated weights for policy 0, policy_version 29132 (0.0005) [2023-12-25 23:48:13,196][123090] Updated weights for policy 1, policy_version 29358 (0.0005) [2023-12-25 23:48:13,204][123091] Updated weights for policy 0, policy_version 29142 (0.0005) [2023-12-25 23:48:13,253][123090] Updated weights for policy 1, policy_version 29368 (0.0005) [2023-12-25 23:48:13,261][123091] Updated weights for policy 0, policy_version 29152 (0.0006) [2023-12-25 23:48:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 14983168. Throughput: 0: 8901.0, 1: 8985.3. Samples: 14977704. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:48:13,785][121949] Avg episode reward: [(0, '4008.103'), (1, '4353.738')] [2023-12-25 23:48:13,979][123090] Updated weights for policy 1, policy_version 29378 (0.0006) [2023-12-25 23:48:14,027][123090] Updated weights for policy 1, policy_version 29388 (0.0009) [2023-12-25 23:48:14,074][123090] Updated weights for policy 1, policy_version 29398 (0.0008) [2023-12-25 23:48:14,114][123091] Updated weights for policy 0, policy_version 29162 (0.0008) [2023-12-25 23:48:14,129][123090] Updated weights for policy 1, policy_version 29408 (0.0009) [2023-12-25 23:48:14,171][123091] Updated weights for policy 0, policy_version 29172 (0.0006) [2023-12-25 23:48:14,219][123091] Updated weights for policy 0, policy_version 29182 (0.0005) [2023-12-25 23:48:14,722][123091] Updated weights for policy 0, policy_version 29192 (0.0006) [2023-12-25 23:48:14,774][123091] Updated weights for policy 0, policy_version 29202 (0.0008) [2023-12-25 23:48:14,831][123091] Updated weights for policy 0, policy_version 29212 (0.0009) [2023-12-25 23:48:15,001][123090] Updated weights for policy 1, policy_version 29418 (0.0009) [2023-12-25 23:48:15,070][123090] Updated weights for policy 1, policy_version 29428 (0.0009) [2023-12-25 23:48:15,136][123090] Updated weights for policy 1, policy_version 29438 (0.0009) [2023-12-25 23:48:15,754][123091] Updated weights for policy 0, policy_version 29222 (0.0010) [2023-12-25 23:48:15,812][123091] Updated weights for policy 0, policy_version 29232 (0.0010) [2023-12-25 23:48:15,865][123091] Updated weights for policy 0, policy_version 29242 (0.0010) [2023-12-25 23:48:15,918][123090] Updated weights for policy 1, policy_version 29448 (0.0006) [2023-12-25 23:48:15,964][123090] Updated weights for policy 1, policy_version 29458 (0.0005) [2023-12-25 23:48:16,009][123090] Updated weights for policy 1, policy_version 29468 (0.0005) [2023-12-25 23:48:16,644][123091] Updated weights for policy 0, policy_version 29252 (0.0008) [2023-12-25 23:48:16,699][123091] Updated weights for policy 0, policy_version 29262 (0.0005) [2023-12-25 23:48:16,770][123091] Updated weights for policy 0, policy_version 29272 (0.0005) [2023-12-25 23:48:16,777][123090] Updated weights for policy 1, policy_version 29478 (0.0010) [2023-12-25 23:48:16,841][123090] Updated weights for policy 1, policy_version 29488 (0.0010) [2023-12-25 23:48:16,903][123090] Updated weights for policy 1, policy_version 29498 (0.0010) [2023-12-25 23:48:17,505][123091] Updated weights for policy 0, policy_version 29282 (0.0007) [2023-12-25 23:48:17,565][123091] Updated weights for policy 0, policy_version 29292 (0.0009) [2023-12-25 23:48:17,624][123091] Updated weights for policy 0, policy_version 29302 (0.0008) [2023-12-25 23:48:17,687][123090] Updated weights for policy 1, policy_version 29508 (0.0008) [2023-12-25 23:48:17,691][123091] Updated weights for policy 0, policy_version 29312 (0.0009) [2023-12-25 23:48:17,747][123090] Updated weights for policy 1, policy_version 29518 (0.0005) [2023-12-25 23:48:17,803][123090] Updated weights for policy 1, policy_version 29528 (0.0005) [2023-12-25 23:48:18,490][123090] Updated weights for policy 1, policy_version 29538 (0.0006) [2023-12-25 23:48:18,511][123091] Updated weights for policy 0, policy_version 29322 (0.0011) [2023-12-25 23:48:18,554][123090] Updated weights for policy 1, policy_version 29548 (0.0010) [2023-12-25 23:48:18,575][123091] Updated weights for policy 0, policy_version 29332 (0.0010) [2023-12-25 23:48:18,618][123090] Updated weights for policy 1, policy_version 29558 (0.0011) [2023-12-25 23:48:18,642][123091] Updated weights for policy 0, policy_version 29342 (0.0011) [2023-12-25 23:48:18,701][123090] Updated weights for policy 1, policy_version 29568 (0.0009) [2023-12-25 23:48:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 15081472. Throughput: 0: 8900.4, 1: 8970.8. Samples: 15087248. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:48:18,784][121949] Avg episode reward: [(0, '4221.729'), (1, '4304.809')] [2023-12-25 23:48:18,785][123007] Saving new best policy, reward=4221.729! [2023-12-25 23:48:19,383][123091] Updated weights for policy 0, policy_version 29353 (0.0009) [2023-12-25 23:48:19,434][123091] Updated weights for policy 0, policy_version 29363 (0.0005) [2023-12-25 23:48:19,488][123091] Updated weights for policy 0, policy_version 29373 (0.0006) [2023-12-25 23:48:19,519][123090] Updated weights for policy 1, policy_version 29578 (0.0010) [2023-12-25 23:48:19,587][123090] Updated weights for policy 1, policy_version 29588 (0.0006) [2023-12-25 23:48:19,647][123090] Updated weights for policy 1, policy_version 29598 (0.0008) [2023-12-25 23:48:20,299][123091] Updated weights for policy 0, policy_version 29383 (0.0010) [2023-12-25 23:48:20,372][123091] Updated weights for policy 0, policy_version 29393 (0.0011) [2023-12-25 23:48:20,424][123090] Updated weights for policy 1, policy_version 29608 (0.0011) [2023-12-25 23:48:20,433][123091] Updated weights for policy 0, policy_version 29403 (0.0011) [2023-12-25 23:48:20,493][123090] Updated weights for policy 1, policy_version 29618 (0.0007) [2023-12-25 23:48:20,566][123090] Updated weights for policy 1, policy_version 29628 (0.0007) [2023-12-25 23:48:21,266][123091] Updated weights for policy 0, policy_version 29413 (0.0011) [2023-12-25 23:48:21,342][123091] Updated weights for policy 0, policy_version 29424 (0.0011) [2023-12-25 23:48:21,391][123090] Updated weights for policy 1, policy_version 29639 (0.0010) [2023-12-25 23:48:21,405][123091] Updated weights for policy 0, policy_version 29434 (0.0010) [2023-12-25 23:48:21,455][123090] Updated weights for policy 1, policy_version 29649 (0.0011) [2023-12-25 23:48:21,519][123090] Updated weights for policy 1, policy_version 29659 (0.0011) [2023-12-25 23:48:22,198][123091] Updated weights for policy 0, policy_version 29444 (0.0010) [2023-12-25 23:48:22,254][123091] Updated weights for policy 0, policy_version 29454 (0.0013) [2023-12-25 23:48:22,288][123090] Updated weights for policy 1, policy_version 29669 (0.0009) [2023-12-25 23:48:22,322][123091] Updated weights for policy 0, policy_version 29464 (0.0008) [2023-12-25 23:48:22,361][123090] Updated weights for policy 1, policy_version 29679 (0.0008) [2023-12-25 23:48:22,432][123090] Updated weights for policy 1, policy_version 29689 (0.0011) [2023-12-25 23:48:23,152][123090] Updated weights for policy 1, policy_version 29699 (0.0009) [2023-12-25 23:48:23,154][123091] Updated weights for policy 0, policy_version 29474 (0.0009) [2023-12-25 23:48:23,215][123091] Updated weights for policy 0, policy_version 29484 (0.0011) [2023-12-25 23:48:23,218][123090] Updated weights for policy 1, policy_version 29709 (0.0005) [2023-12-25 23:48:23,275][123091] Updated weights for policy 0, policy_version 29494 (0.0011) [2023-12-25 23:48:23,284][123090] Updated weights for policy 1, policy_version 29719 (0.0005) [2023-12-25 23:48:23,339][123091] Updated weights for policy 0, policy_version 29504 (0.0011) [2023-12-25 23:48:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 15163392. Throughput: 0: 8892.4, 1: 8955.6. Samples: 15139504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:48:23,785][121949] Avg episode reward: [(0, '4227.182'), (1, '4314.430')] [2023-12-25 23:48:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000029728_7610368.pth... [2023-12-25 23:48:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000029504_7553024.pth... [2023-12-25 23:48:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000028672_7340032.pth [2023-12-25 23:48:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000028448_7282688.pth [2023-12-25 23:48:23,794][123007] Saving new best policy, reward=4227.182! [2023-12-25 23:48:23,849][123090] Updated weights for policy 1, policy_version 29729 (0.0005) [2023-12-25 23:48:23,905][123090] Updated weights for policy 1, policy_version 29739 (0.0005) [2023-12-25 23:48:23,967][123090] Updated weights for policy 1, policy_version 29749 (0.0006) [2023-12-25 23:48:24,037][123090] Updated weights for policy 1, policy_version 29759 (0.0006) [2023-12-25 23:48:24,190][123091] Updated weights for policy 0, policy_version 29514 (0.0011) [2023-12-25 23:48:24,250][123091] Updated weights for policy 0, policy_version 29524 (0.0011) [2023-12-25 23:48:24,311][123091] Updated weights for policy 0, policy_version 29534 (0.0011) [2023-12-25 23:48:24,787][123090] Updated weights for policy 1, policy_version 29769 (0.0010) [2023-12-25 23:48:24,848][123090] Updated weights for policy 1, policy_version 29779 (0.0007) [2023-12-25 23:48:24,902][123090] Updated weights for policy 1, policy_version 29789 (0.0005) [2023-12-25 23:48:25,135][123091] Updated weights for policy 0, policy_version 29544 (0.0011) [2023-12-25 23:48:25,195][123091] Updated weights for policy 0, policy_version 29554 (0.0011) [2023-12-25 23:48:25,247][123091] Updated weights for policy 0, policy_version 29564 (0.0010) [2023-12-25 23:48:25,586][123090] Updated weights for policy 1, policy_version 29799 (0.0005) [2023-12-25 23:48:25,654][123090] Updated weights for policy 1, policy_version 29809 (0.0005) [2023-12-25 23:48:25,721][123090] Updated weights for policy 1, policy_version 29819 (0.0005) [2023-12-25 23:48:26,087][123091] Updated weights for policy 0, policy_version 29574 (0.0011) [2023-12-25 23:48:26,154][123091] Updated weights for policy 0, policy_version 29584 (0.0011) [2023-12-25 23:48:26,210][123091] Updated weights for policy 0, policy_version 29594 (0.0010) [2023-12-25 23:48:26,458][123090] Updated weights for policy 1, policy_version 29829 (0.0005) [2023-12-25 23:48:26,522][123090] Updated weights for policy 1, policy_version 29839 (0.0005) [2023-12-25 23:48:26,591][123090] Updated weights for policy 1, policy_version 29849 (0.0005) [2023-12-25 23:48:27,033][123091] Updated weights for policy 0, policy_version 29604 (0.0010) [2023-12-25 23:48:27,080][123091] Updated weights for policy 0, policy_version 29614 (0.0010) [2023-12-25 23:48:27,141][123091] Updated weights for policy 0, policy_version 29624 (0.0010) [2023-12-25 23:48:27,199][123090] Updated weights for policy 1, policy_version 29859 (0.0007) [2023-12-25 23:48:27,250][123090] Updated weights for policy 1, policy_version 29869 (0.0010) [2023-12-25 23:48:27,301][123090] Updated weights for policy 1, policy_version 29879 (0.0010) [2023-12-25 23:48:27,810][123091] Updated weights for policy 0, policy_version 29634 (0.0007) [2023-12-25 23:48:27,857][123091] Updated weights for policy 0, policy_version 29644 (0.0005) [2023-12-25 23:48:27,901][123091] Updated weights for policy 0, policy_version 29654 (0.0005) [2023-12-25 23:48:27,946][123091] Updated weights for policy 0, policy_version 29664 (0.0005) [2023-12-25 23:48:28,155][123090] Updated weights for policy 1, policy_version 29889 (0.0010) [2023-12-25 23:48:28,213][123090] Updated weights for policy 1, policy_version 29899 (0.0010) [2023-12-25 23:48:28,264][123090] Updated weights for policy 1, policy_version 29909 (0.0010) [2023-12-25 23:48:28,312][123090] Updated weights for policy 1, policy_version 29919 (0.0010) [2023-12-25 23:48:28,690][123091] Updated weights for policy 0, policy_version 29674 (0.0010) [2023-12-25 23:48:28,752][123091] Updated weights for policy 0, policy_version 29684 (0.0010) [2023-12-25 23:48:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 15253504. Throughput: 0: 8854.1, 1: 9108.5. Samples: 15251008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:48:28,785][121949] Avg episode reward: [(0, '4240.582'), (1, '4241.977')] [2023-12-25 23:48:28,807][123091] Updated weights for policy 0, policy_version 29694 (0.0010) [2023-12-25 23:48:28,819][123007] Saving new best policy, reward=4240.582! [2023-12-25 23:48:28,927][123090] Updated weights for policy 1, policy_version 29929 (0.0006) [2023-12-25 23:48:28,973][123090] Updated weights for policy 1, policy_version 29939 (0.0005) [2023-12-25 23:48:29,025][123090] Updated weights for policy 1, policy_version 29949 (0.0006) [2023-12-25 23:48:29,682][123091] Updated weights for policy 0, policy_version 29704 (0.0010) [2023-12-25 23:48:29,743][123090] Updated weights for policy 1, policy_version 29959 (0.0007) [2023-12-25 23:48:29,744][123091] Updated weights for policy 0, policy_version 29714 (0.0011) [2023-12-25 23:48:29,803][123090] Updated weights for policy 1, policy_version 29969 (0.0007) [2023-12-25 23:48:29,807][123091] Updated weights for policy 0, policy_version 29724 (0.0011) [2023-12-25 23:48:29,871][123090] Updated weights for policy 1, policy_version 29979 (0.0009) [2023-12-25 23:48:30,570][123091] Updated weights for policy 0, policy_version 29734 (0.0010) [2023-12-25 23:48:30,625][123091] Updated weights for policy 0, policy_version 29744 (0.0010) [2023-12-25 23:48:30,684][123091] Updated weights for policy 0, policy_version 29754 (0.0011) [2023-12-25 23:48:30,728][123090] Updated weights for policy 1, policy_version 29990 (0.0008) [2023-12-25 23:48:30,778][123090] Updated weights for policy 1, policy_version 30000 (0.0008) [2023-12-25 23:48:30,830][123090] Updated weights for policy 1, policy_version 30010 (0.0007) [2023-12-25 23:48:31,470][123091] Updated weights for policy 0, policy_version 29764 (0.0010) [2023-12-25 23:48:31,518][123091] Updated weights for policy 0, policy_version 29774 (0.0009) [2023-12-25 23:48:31,571][123091] Updated weights for policy 0, policy_version 29784 (0.0007) [2023-12-25 23:48:31,632][123090] Updated weights for policy 1, policy_version 30020 (0.0006) [2023-12-25 23:48:31,703][123090] Updated weights for policy 1, policy_version 30030 (0.0007) [2023-12-25 23:48:31,782][123090] Updated weights for policy 1, policy_version 30040 (0.0009) [2023-12-25 23:48:32,456][123091] Updated weights for policy 0, policy_version 29794 (0.0010) [2023-12-25 23:48:32,512][123091] Updated weights for policy 0, policy_version 29804 (0.0008) [2023-12-25 23:48:32,533][123090] Updated weights for policy 1, policy_version 30050 (0.0010) [2023-12-25 23:48:32,570][123091] Updated weights for policy 0, policy_version 29814 (0.0008) [2023-12-25 23:48:32,606][123090] Updated weights for policy 1, policy_version 30060 (0.0011) [2023-12-25 23:48:32,631][123091] Updated weights for policy 0, policy_version 29824 (0.0008) [2023-12-25 23:48:32,663][123090] Updated weights for policy 1, policy_version 30070 (0.0011) [2023-12-25 23:48:32,726][123090] Updated weights for policy 1, policy_version 30080 (0.0011) [2023-12-25 23:48:33,448][123091] Updated weights for policy 0, policy_version 29834 (0.0009) [2023-12-25 23:48:33,505][123091] Updated weights for policy 0, policy_version 29844 (0.0009) [2023-12-25 23:48:33,534][123090] Updated weights for policy 1, policy_version 30090 (0.0010) [2023-12-25 23:48:33,567][123091] Updated weights for policy 0, policy_version 29854 (0.0006) [2023-12-25 23:48:33,589][123090] Updated weights for policy 1, policy_version 30100 (0.0010) [2023-12-25 23:48:33,655][123090] Updated weights for policy 1, policy_version 30110 (0.0010) [2023-12-25 23:48:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 15351808. Throughput: 0: 8911.4, 1: 9083.1. Samples: 15358328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:48:33,785][121949] Avg episode reward: [(0, '4197.803'), (1, '4281.979')] [2023-12-25 23:48:34,375][123090] Updated weights for policy 1, policy_version 30120 (0.0009) [2023-12-25 23:48:34,435][123090] Updated weights for policy 1, policy_version 30130 (0.0010) [2023-12-25 23:48:34,479][123091] Updated weights for policy 0, policy_version 29864 (0.0008) [2023-12-25 23:48:34,502][123090] Updated weights for policy 1, policy_version 30140 (0.0006) [2023-12-25 23:48:34,536][123091] Updated weights for policy 0, policy_version 29874 (0.0010) [2023-12-25 23:48:34,603][123091] Updated weights for policy 0, policy_version 29884 (0.0007) [2023-12-25 23:48:35,343][123090] Updated weights for policy 1, policy_version 30150 (0.0008) [2023-12-25 23:48:35,349][123091] Updated weights for policy 0, policy_version 29894 (0.0006) [2023-12-25 23:48:35,404][123090] Updated weights for policy 1, policy_version 30160 (0.0008) [2023-12-25 23:48:35,422][123091] Updated weights for policy 0, policy_version 29904 (0.0005) [2023-12-25 23:48:35,458][123090] Updated weights for policy 1, policy_version 30170 (0.0007) [2023-12-25 23:48:35,482][123091] Updated weights for policy 0, policy_version 29914 (0.0008) [2023-12-25 23:48:36,117][123090] Updated weights for policy 1, policy_version 30180 (0.0007) [2023-12-25 23:48:36,173][123090] Updated weights for policy 1, policy_version 30190 (0.0009) [2023-12-25 23:48:36,240][123090] Updated weights for policy 1, policy_version 30200 (0.0006) [2023-12-25 23:48:36,273][123091] Updated weights for policy 0, policy_version 29924 (0.0010) [2023-12-25 23:48:36,342][123091] Updated weights for policy 0, policy_version 29934 (0.0008) [2023-12-25 23:48:36,396][123091] Updated weights for policy 0, policy_version 29944 (0.0005) [2023-12-25 23:48:36,979][123090] Updated weights for policy 1, policy_version 30210 (0.0008) [2023-12-25 23:48:37,035][123090] Updated weights for policy 1, policy_version 30220 (0.0005) [2023-12-25 23:48:37,046][123091] Updated weights for policy 0, policy_version 29954 (0.0006) [2023-12-25 23:48:37,096][123091] Updated weights for policy 0, policy_version 29964 (0.0005) [2023-12-25 23:48:37,109][123090] Updated weights for policy 1, policy_version 30230 (0.0005) [2023-12-25 23:48:37,152][123091] Updated weights for policy 0, policy_version 29974 (0.0005) [2023-12-25 23:48:37,165][123090] Updated weights for policy 1, policy_version 30240 (0.0007) [2023-12-25 23:48:37,217][123091] Updated weights for policy 0, policy_version 29984 (0.0005) [2023-12-25 23:48:37,907][123091] Updated weights for policy 0, policy_version 29994 (0.0005) [2023-12-25 23:48:37,911][123090] Updated weights for policy 1, policy_version 30250 (0.0005) [2023-12-25 23:48:37,961][123090] Updated weights for policy 1, policy_version 30260 (0.0005) [2023-12-25 23:48:37,974][123091] Updated weights for policy 0, policy_version 30004 (0.0005) [2023-12-25 23:48:38,023][123090] Updated weights for policy 1, policy_version 30270 (0.0005) [2023-12-25 23:48:38,046][123091] Updated weights for policy 0, policy_version 30014 (0.0006) [2023-12-25 23:48:38,732][123091] Updated weights for policy 0, policy_version 30024 (0.0008) [2023-12-25 23:48:38,779][123090] Updated weights for policy 1, policy_version 30280 (0.0010) [2023-12-25 23:48:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 15433728. Throughput: 0: 8943.3, 1: 9143.7. Samples: 15413160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:48:38,785][121949] Avg episode reward: [(0, '4142.453'), (1, '4372.626')] [2023-12-25 23:48:38,799][123091] Updated weights for policy 0, policy_version 30034 (0.0008) [2023-12-25 23:48:38,839][123090] Updated weights for policy 1, policy_version 30290 (0.0010) [2023-12-25 23:48:38,864][123091] Updated weights for policy 0, policy_version 30044 (0.0008) [2023-12-25 23:48:38,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000030048_7692288.pth... [2023-12-25 23:48:38,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000028992_7421952.pth [2023-12-25 23:48:38,905][123090] Updated weights for policy 1, policy_version 30300 (0.0010) [2023-12-25 23:48:38,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000030304_7757824.pth... [2023-12-25 23:48:38,932][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000029216_7479296.pth [2023-12-25 23:48:39,613][123091] Updated weights for policy 0, policy_version 30054 (0.0010) [2023-12-25 23:48:39,665][123091] Updated weights for policy 0, policy_version 30064 (0.0010) [2023-12-25 23:48:39,738][123091] Updated weights for policy 0, policy_version 30074 (0.0011) [2023-12-25 23:48:39,746][123090] Updated weights for policy 1, policy_version 30310 (0.0009) [2023-12-25 23:48:39,810][123090] Updated weights for policy 1, policy_version 30320 (0.0007) [2023-12-25 23:48:39,883][123090] Updated weights for policy 1, policy_version 30330 (0.0011) [2023-12-25 23:48:40,526][123091] Updated weights for policy 0, policy_version 30084 (0.0011) [2023-12-25 23:48:40,584][123090] Updated weights for policy 1, policy_version 30340 (0.0008) [2023-12-25 23:48:40,586][123091] Updated weights for policy 0, policy_version 30094 (0.0009) [2023-12-25 23:48:40,640][123090] Updated weights for policy 1, policy_version 30350 (0.0006) [2023-12-25 23:48:40,647][123091] Updated weights for policy 0, policy_version 30104 (0.0009) [2023-12-25 23:48:40,698][123090] Updated weights for policy 1, policy_version 30360 (0.0005) [2023-12-25 23:48:41,438][123090] Updated weights for policy 1, policy_version 30370 (0.0006) [2023-12-25 23:48:41,498][123090] Updated weights for policy 1, policy_version 30380 (0.0009) [2023-12-25 23:48:41,512][123091] Updated weights for policy 0, policy_version 30114 (0.0008) [2023-12-25 23:48:41,556][123090] Updated weights for policy 1, policy_version 30390 (0.0009) [2023-12-25 23:48:41,566][123091] Updated weights for policy 0, policy_version 30124 (0.0008) [2023-12-25 23:48:41,621][123090] Updated weights for policy 1, policy_version 30400 (0.0008) [2023-12-25 23:48:41,629][123091] Updated weights for policy 0, policy_version 30134 (0.0009) [2023-12-25 23:48:41,693][123091] Updated weights for policy 0, policy_version 30144 (0.0010) [2023-12-25 23:48:42,463][123090] Updated weights for policy 1, policy_version 30410 (0.0009) [2023-12-25 23:48:42,523][123090] Updated weights for policy 1, policy_version 30420 (0.0010) [2023-12-25 23:48:42,576][123091] Updated weights for policy 0, policy_version 30154 (0.0007) [2023-12-25 23:48:42,587][123090] Updated weights for policy 1, policy_version 30430 (0.0008) [2023-12-25 23:48:42,648][123091] Updated weights for policy 0, policy_version 30164 (0.0008) [2023-12-25 23:48:42,718][123091] Updated weights for policy 0, policy_version 30174 (0.0010) [2023-12-25 23:48:43,464][123090] Updated weights for policy 1, policy_version 30440 (0.0010) [2023-12-25 23:48:43,516][123090] Updated weights for policy 1, policy_version 30451 (0.0008) [2023-12-25 23:48:43,518][123091] Updated weights for policy 0, policy_version 30184 (0.0009) [2023-12-25 23:48:43,570][123090] Updated weights for policy 1, policy_version 30461 (0.0008) [2023-12-25 23:48:43,572][123091] Updated weights for policy 0, policy_version 30194 (0.0009) [2023-12-25 23:48:43,625][123091] Updated weights for policy 0, policy_version 30204 (0.0010) [2023-12-25 23:48:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 15532032. Throughput: 0: 8921.6, 1: 9079.2. Samples: 15521076. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-25 23:48:43,785][121949] Avg episode reward: [(0, '4096.957'), (1, '4366.598')] [2023-12-25 23:48:44,441][123090] Updated weights for policy 1, policy_version 30471 (0.0009) [2023-12-25 23:48:44,464][123091] Updated weights for policy 0, policy_version 30214 (0.0007) [2023-12-25 23:48:44,503][123090] Updated weights for policy 1, policy_version 30481 (0.0007) [2023-12-25 23:48:44,524][123091] Updated weights for policy 0, policy_version 30224 (0.0008) [2023-12-25 23:48:44,556][123090] Updated weights for policy 1, policy_version 30491 (0.0009) [2023-12-25 23:48:44,587][123091] Updated weights for policy 0, policy_version 30234 (0.0008) [2023-12-25 23:48:45,413][123091] Updated weights for policy 0, policy_version 30244 (0.0009) [2023-12-25 23:48:45,429][123090] Updated weights for policy 1, policy_version 30501 (0.0007) [2023-12-25 23:48:45,479][123091] Updated weights for policy 0, policy_version 30254 (0.0008) [2023-12-25 23:48:45,479][123090] Updated weights for policy 1, policy_version 30511 (0.0009) [2023-12-25 23:48:45,543][123091] Updated weights for policy 0, policy_version 30264 (0.0010) [2023-12-25 23:48:45,548][123090] Updated weights for policy 1, policy_version 30521 (0.0008) [2023-12-25 23:48:46,387][123091] Updated weights for policy 0, policy_version 30274 (0.0009) [2023-12-25 23:48:46,402][123090] Updated weights for policy 1, policy_version 30531 (0.0008) [2023-12-25 23:48:46,449][123091] Updated weights for policy 0, policy_version 30284 (0.0009) [2023-12-25 23:48:46,457][123090] Updated weights for policy 1, policy_version 30541 (0.0008) [2023-12-25 23:48:46,505][123090] Updated weights for policy 1, policy_version 30551 (0.0008) [2023-12-25 23:48:46,507][123091] Updated weights for policy 0, policy_version 30294 (0.0009) [2023-12-25 23:48:46,567][123091] Updated weights for policy 0, policy_version 30304 (0.0009) [2023-12-25 23:48:47,284][123090] Updated weights for policy 1, policy_version 30561 (0.0008) [2023-12-25 23:48:47,340][123090] Updated weights for policy 1, policy_version 30571 (0.0008) [2023-12-25 23:48:47,371][123091] Updated weights for policy 0, policy_version 30314 (0.0008) [2023-12-25 23:48:47,395][123090] Updated weights for policy 1, policy_version 30581 (0.0008) [2023-12-25 23:48:47,429][123091] Updated weights for policy 0, policy_version 30324 (0.0009) [2023-12-25 23:48:47,457][123090] Updated weights for policy 1, policy_version 30591 (0.0009) [2023-12-25 23:48:47,488][123091] Updated weights for policy 0, policy_version 30334 (0.0006) [2023-12-25 23:48:48,280][123091] Updated weights for policy 0, policy_version 30344 (0.0007) [2023-12-25 23:48:48,290][123090] Updated weights for policy 1, policy_version 30601 (0.0010) [2023-12-25 23:48:48,351][123091] Updated weights for policy 0, policy_version 30354 (0.0008) [2023-12-25 23:48:48,363][123090] Updated weights for policy 1, policy_version 30611 (0.0007) [2023-12-25 23:48:48,412][123091] Updated weights for policy 0, policy_version 30364 (0.0007) [2023-12-25 23:48:48,421][123090] Updated weights for policy 1, policy_version 30621 (0.0008) [2023-12-25 23:48:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 15613952. Throughput: 0: 8883.7, 1: 8997.8. Samples: 15623480. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-25 23:48:48,785][121949] Avg episode reward: [(0, '4092.984'), (1, '4408.899')] [2023-12-25 23:48:48,787][123008] Saving new best policy, reward=4408.899! [2023-12-25 23:48:49,150][123090] Updated weights for policy 1, policy_version 30631 (0.0006) [2023-12-25 23:48:49,224][123090] Updated weights for policy 1, policy_version 30641 (0.0005) [2023-12-25 23:48:49,284][123091] Updated weights for policy 0, policy_version 30374 (0.0009) [2023-12-25 23:48:49,293][123090] Updated weights for policy 1, policy_version 30651 (0.0008) [2023-12-25 23:48:49,361][123091] Updated weights for policy 0, policy_version 30384 (0.0008) [2023-12-25 23:48:49,430][123091] Updated weights for policy 0, policy_version 30394 (0.0008) [2023-12-25 23:48:50,009][123090] Updated weights for policy 1, policy_version 30661 (0.0009) [2023-12-25 23:48:50,067][123090] Updated weights for policy 1, policy_version 30671 (0.0009) [2023-12-25 23:48:50,122][123090] Updated weights for policy 1, policy_version 30681 (0.0008) [2023-12-25 23:48:50,231][123091] Updated weights for policy 0, policy_version 30404 (0.0009) [2023-12-25 23:48:50,302][123091] Updated weights for policy 0, policy_version 30414 (0.0009) [2023-12-25 23:48:50,357][123091] Updated weights for policy 0, policy_version 30424 (0.0009) [2023-12-25 23:48:50,937][123090] Updated weights for policy 1, policy_version 30691 (0.0008) [2023-12-25 23:48:50,999][123090] Updated weights for policy 1, policy_version 30701 (0.0007) [2023-12-25 23:48:51,063][123090] Updated weights for policy 1, policy_version 30711 (0.0009) [2023-12-25 23:48:51,183][123091] Updated weights for policy 0, policy_version 30434 (0.0009) [2023-12-25 23:48:51,245][123091] Updated weights for policy 0, policy_version 30444 (0.0009) [2023-12-25 23:48:51,309][123091] Updated weights for policy 0, policy_version 30454 (0.0009) [2023-12-25 23:48:51,380][123091] Updated weights for policy 0, policy_version 30464 (0.0009) [2023-12-25 23:48:51,953][123090] Updated weights for policy 1, policy_version 30721 (0.0008) [2023-12-25 23:48:52,017][123090] Updated weights for policy 1, policy_version 30731 (0.0005) [2023-12-25 23:48:52,073][123090] Updated weights for policy 1, policy_version 30741 (0.0005) [2023-12-25 23:48:52,132][123090] Updated weights for policy 1, policy_version 30751 (0.0005) [2023-12-25 23:48:52,211][123091] Updated weights for policy 0, policy_version 30474 (0.0010) [2023-12-25 23:48:52,270][123091] Updated weights for policy 0, policy_version 30484 (0.0010) [2023-12-25 23:48:52,328][123091] Updated weights for policy 0, policy_version 30494 (0.0010) [2023-12-25 23:48:52,884][123090] Updated weights for policy 1, policy_version 30761 (0.0009) [2023-12-25 23:48:52,929][123090] Updated weights for policy 1, policy_version 30771 (0.0007) [2023-12-25 23:48:52,976][123090] Updated weights for policy 1, policy_version 30781 (0.0005) [2023-12-25 23:48:53,206][123091] Updated weights for policy 0, policy_version 30504 (0.0009) [2023-12-25 23:48:53,260][123091] Updated weights for policy 0, policy_version 30514 (0.0010) [2023-12-25 23:48:53,313][123091] Updated weights for policy 0, policy_version 30524 (0.0010) [2023-12-25 23:48:53,672][123090] Updated weights for policy 1, policy_version 30791 (0.0007) [2023-12-25 23:48:53,723][123090] Updated weights for policy 1, policy_version 30801 (0.0009) [2023-12-25 23:48:53,778][123090] Updated weights for policy 1, policy_version 30811 (0.0010) [2023-12-25 23:48:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 15695872. Throughput: 0: 8803.3, 1: 9023.5. Samples: 15675744. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-25 23:48:53,785][121949] Avg episode reward: [(0, '4050.595'), (1, '4463.709')] [2023-12-25 23:48:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000030528_7815168.pth... [2023-12-25 23:48:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000029504_7553024.pth [2023-12-25 23:48:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000030816_7888896.pth... [2023-12-25 23:48:53,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000029728_7610368.pth [2023-12-25 23:48:53,806][123008] Saving new best policy, reward=4463.709! [2023-12-25 23:48:54,144][123091] Updated weights for policy 0, policy_version 30535 (0.0010) [2023-12-25 23:48:54,193][123091] Updated weights for policy 0, policy_version 30545 (0.0009) [2023-12-25 23:48:54,247][123091] Updated weights for policy 0, policy_version 30555 (0.0009) [2023-12-25 23:48:54,581][123090] Updated weights for policy 1, policy_version 30821 (0.0009) [2023-12-25 23:48:54,632][123090] Updated weights for policy 1, policy_version 30831 (0.0009) [2023-12-25 23:48:54,689][123090] Updated weights for policy 1, policy_version 30841 (0.0009) [2023-12-25 23:48:55,065][123091] Updated weights for policy 0, policy_version 30565 (0.0009) [2023-12-25 23:48:55,114][123091] Updated weights for policy 0, policy_version 30575 (0.0009) [2023-12-25 23:48:55,166][123091] Updated weights for policy 0, policy_version 30585 (0.0009) [2023-12-25 23:48:55,556][123090] Updated weights for policy 1, policy_version 30851 (0.0010) [2023-12-25 23:48:55,608][123090] Updated weights for policy 1, policy_version 30861 (0.0009) [2023-12-25 23:48:55,661][123090] Updated weights for policy 1, policy_version 30872 (0.0009) [2023-12-25 23:48:56,007][123091] Updated weights for policy 0, policy_version 30595 (0.0008) [2023-12-25 23:48:56,067][123091] Updated weights for policy 0, policy_version 30605 (0.0006) [2023-12-25 23:48:56,135][123091] Updated weights for policy 0, policy_version 30615 (0.0005) [2023-12-25 23:48:56,444][123090] Updated weights for policy 1, policy_version 30882 (0.0010) [2023-12-25 23:48:56,503][123090] Updated weights for policy 1, policy_version 30892 (0.0009) [2023-12-25 23:48:56,555][123090] Updated weights for policy 1, policy_version 30903 (0.0009) [2023-12-25 23:48:56,929][123091] Updated weights for policy 0, policy_version 30625 (0.0006) [2023-12-25 23:48:56,977][123091] Updated weights for policy 0, policy_version 30635 (0.0009) [2023-12-25 23:48:57,026][123091] Updated weights for policy 0, policy_version 30645 (0.0009) [2023-12-25 23:48:57,079][123091] Updated weights for policy 0, policy_version 30655 (0.0009) [2023-12-25 23:48:57,381][123090] Updated weights for policy 1, policy_version 30913 (0.0009) [2023-12-25 23:48:57,429][123090] Updated weights for policy 1, policy_version 30923 (0.0008) [2023-12-25 23:48:57,490][123090] Updated weights for policy 1, policy_version 30933 (0.0009) [2023-12-25 23:48:57,540][123090] Updated weights for policy 1, policy_version 30943 (0.0008) [2023-12-25 23:48:57,978][123091] Updated weights for policy 0, policy_version 30665 (0.0009) [2023-12-25 23:48:58,043][123091] Updated weights for policy 0, policy_version 30675 (0.0010) [2023-12-25 23:48:58,107][123091] Updated weights for policy 0, policy_version 30685 (0.0011) [2023-12-25 23:48:58,285][123090] Updated weights for policy 1, policy_version 30953 (0.0011) [2023-12-25 23:48:58,349][123090] Updated weights for policy 1, policy_version 30963 (0.0010) [2023-12-25 23:48:58,417][123090] Updated weights for policy 1, policy_version 30973 (0.0009) [2023-12-25 23:48:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 15785984. Throughput: 0: 8769.2, 1: 9085.6. Samples: 15781168. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-25 23:48:58,785][121949] Avg episode reward: [(0, '4092.217'), (1, '4510.592')] [2023-12-25 23:48:58,786][123008] Saving new best policy, reward=4510.592! [2023-12-25 23:48:58,949][123091] Updated weights for policy 0, policy_version 30695 (0.0007) [2023-12-25 23:48:59,003][123091] Updated weights for policy 0, policy_version 30705 (0.0005) [2023-12-25 23:48:59,051][123091] Updated weights for policy 0, policy_version 30715 (0.0005) [2023-12-25 23:48:59,368][123090] Updated weights for policy 1, policy_version 30983 (0.0010) [2023-12-25 23:48:59,430][123090] Updated weights for policy 1, policy_version 30993 (0.0009) [2023-12-25 23:48:59,483][123090] Updated weights for policy 1, policy_version 31003 (0.0009) [2023-12-25 23:48:59,840][123091] Updated weights for policy 0, policy_version 30725 (0.0007) [2023-12-25 23:48:59,897][123091] Updated weights for policy 0, policy_version 30735 (0.0009) [2023-12-25 23:48:59,962][123091] Updated weights for policy 0, policy_version 30745 (0.0010) [2023-12-25 23:49:00,308][123090] Updated weights for policy 1, policy_version 31013 (0.0009) [2023-12-25 23:49:00,366][123090] Updated weights for policy 1, policy_version 31023 (0.0008) [2023-12-25 23:49:00,422][123090] Updated weights for policy 1, policy_version 31033 (0.0006) [2023-12-25 23:49:00,725][123091] Updated weights for policy 0, policy_version 30755 (0.0006) [2023-12-25 23:49:00,783][123091] Updated weights for policy 0, policy_version 30765 (0.0006) [2023-12-25 23:49:00,845][123091] Updated weights for policy 0, policy_version 30775 (0.0005) [2023-12-25 23:49:01,115][123090] Updated weights for policy 1, policy_version 31043 (0.0008) [2023-12-25 23:49:01,178][123090] Updated weights for policy 1, policy_version 31053 (0.0009) [2023-12-25 23:49:01,227][123090] Updated weights for policy 1, policy_version 31063 (0.0009) [2023-12-25 23:49:01,631][123091] Updated weights for policy 0, policy_version 30785 (0.0005) [2023-12-25 23:49:01,700][123091] Updated weights for policy 0, policy_version 30795 (0.0006) [2023-12-25 23:49:01,771][123091] Updated weights for policy 0, policy_version 30805 (0.0009) [2023-12-25 23:49:01,827][123091] Updated weights for policy 0, policy_version 30816 (0.0011) [2023-12-25 23:49:01,991][123090] Updated weights for policy 1, policy_version 31073 (0.0010) [2023-12-25 23:49:02,044][123090] Updated weights for policy 1, policy_version 31083 (0.0010) [2023-12-25 23:49:02,095][123090] Updated weights for policy 1, policy_version 31093 (0.0010) [2023-12-25 23:49:02,153][123090] Updated weights for policy 1, policy_version 31103 (0.0010) [2023-12-25 23:49:02,624][123091] Updated weights for policy 0, policy_version 30826 (0.0008) [2023-12-25 23:49:02,679][123091] Updated weights for policy 0, policy_version 30836 (0.0010) [2023-12-25 23:49:02,723][123091] Updated weights for policy 0, policy_version 30846 (0.0010) [2023-12-25 23:49:03,018][123090] Updated weights for policy 1, policy_version 31113 (0.0009) [2023-12-25 23:49:03,077][123090] Updated weights for policy 1, policy_version 31123 (0.0010) [2023-12-25 23:49:03,130][123090] Updated weights for policy 1, policy_version 31133 (0.0010) [2023-12-25 23:49:03,535][123091] Updated weights for policy 0, policy_version 30856 (0.0011) [2023-12-25 23:49:03,592][123091] Updated weights for policy 0, policy_version 30866 (0.0011) [2023-12-25 23:49:03,655][123091] Updated weights for policy 0, policy_version 30876 (0.0010) [2023-12-25 23:49:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 15876096. Throughput: 0: 8732.8, 1: 9002.9. Samples: 15885356. Policy #0 lag: (min: 31.0, avg: 43.1, max: 63.0) [2023-12-25 23:49:03,785][121949] Avg episode reward: [(0, '3977.458'), (1, '4474.039')] [2023-12-25 23:49:04,002][123090] Updated weights for policy 1, policy_version 31143 (0.0008) [2023-12-25 23:49:04,064][123090] Updated weights for policy 1, policy_version 31153 (0.0010) [2023-12-25 23:49:04,118][123090] Updated weights for policy 1, policy_version 31163 (0.0010) [2023-12-25 23:49:04,484][123091] Updated weights for policy 0, policy_version 30886 (0.0007) [2023-12-25 23:49:04,554][123091] Updated weights for policy 0, policy_version 30896 (0.0008) [2023-12-25 23:49:04,607][123091] Updated weights for policy 0, policy_version 30906 (0.0009) [2023-12-25 23:49:05,017][123090] Updated weights for policy 1, policy_version 31173 (0.0010) [2023-12-25 23:49:05,083][123090] Updated weights for policy 1, policy_version 31183 (0.0010) [2023-12-25 23:49:05,140][123090] Updated weights for policy 1, policy_version 31193 (0.0009) [2023-12-25 23:49:05,295][123091] Updated weights for policy 0, policy_version 30916 (0.0010) [2023-12-25 23:49:05,352][123091] Updated weights for policy 0, policy_version 30926 (0.0009) [2023-12-25 23:49:05,403][123091] Updated weights for policy 0, policy_version 30936 (0.0009) [2023-12-25 23:49:05,924][123090] Updated weights for policy 1, policy_version 31203 (0.0008) [2023-12-25 23:49:05,970][123090] Updated weights for policy 1, policy_version 31213 (0.0005) [2023-12-25 23:49:06,028][123090] Updated weights for policy 1, policy_version 31223 (0.0005) [2023-12-25 23:49:06,332][123091] Updated weights for policy 0, policy_version 30946 (0.0010) [2023-12-25 23:49:06,389][123091] Updated weights for policy 0, policy_version 30956 (0.0009) [2023-12-25 23:49:06,453][123091] Updated weights for policy 0, policy_version 30966 (0.0010) [2023-12-25 23:49:06,505][123091] Updated weights for policy 0, policy_version 30976 (0.0010) [2023-12-25 23:49:06,728][123090] Updated weights for policy 1, policy_version 31233 (0.0005) [2023-12-25 23:49:06,800][123090] Updated weights for policy 1, policy_version 31243 (0.0009) [2023-12-25 23:49:06,870][123090] Updated weights for policy 1, policy_version 31253 (0.0009) [2023-12-25 23:49:06,945][123090] Updated weights for policy 1, policy_version 31263 (0.0007) [2023-12-25 23:49:07,376][123091] Updated weights for policy 0, policy_version 30986 (0.0009) [2023-12-25 23:49:07,440][123091] Updated weights for policy 0, policy_version 30996 (0.0011) [2023-12-25 23:49:07,496][123091] Updated weights for policy 0, policy_version 31006 (0.0010) [2023-12-25 23:49:07,707][123090] Updated weights for policy 1, policy_version 31273 (0.0009) [2023-12-25 23:49:07,770][123090] Updated weights for policy 1, policy_version 31283 (0.0008) [2023-12-25 23:49:07,839][123090] Updated weights for policy 1, policy_version 31293 (0.0009) [2023-12-25 23:49:08,293][123091] Updated weights for policy 0, policy_version 31016 (0.0006) [2023-12-25 23:49:08,351][123091] Updated weights for policy 0, policy_version 31026 (0.0008) [2023-12-25 23:49:08,422][123091] Updated weights for policy 0, policy_version 31036 (0.0011) [2023-12-25 23:49:08,692][123090] Updated weights for policy 1, policy_version 31303 (0.0008) [2023-12-25 23:49:08,751][123090] Updated weights for policy 1, policy_version 31313 (0.0007) [2023-12-25 23:49:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 15958016. Throughput: 0: 8712.1, 1: 9025.1. Samples: 15937676. Policy #0 lag: (min: 31.0, avg: 43.1, max: 63.0) [2023-12-25 23:49:08,785][121949] Avg episode reward: [(0, '4035.302'), (1, '4448.494')] [2023-12-25 23:49:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000031040_7946240.pth... [2023-12-25 23:49:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000030048_7692288.pth [2023-12-25 23:49:08,814][123090] Updated weights for policy 1, policy_version 31323 (0.0011) [2023-12-25 23:49:08,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000031328_8019968.pth... [2023-12-25 23:49:08,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000030304_7757824.pth [2023-12-25 23:49:09,240][123091] Updated weights for policy 0, policy_version 31046 (0.0010) [2023-12-25 23:49:09,299][123091] Updated weights for policy 0, policy_version 31056 (0.0011) [2023-12-25 23:49:09,370][123091] Updated weights for policy 0, policy_version 31066 (0.0009) [2023-12-25 23:49:09,625][123090] Updated weights for policy 1, policy_version 31333 (0.0009) [2023-12-25 23:49:09,695][123090] Updated weights for policy 1, policy_version 31343 (0.0009) [2023-12-25 23:49:09,768][123090] Updated weights for policy 1, policy_version 31353 (0.0009) [2023-12-25 23:49:10,209][123091] Updated weights for policy 0, policy_version 31076 (0.0011) [2023-12-25 23:49:10,279][123091] Updated weights for policy 0, policy_version 31086 (0.0011) [2023-12-25 23:49:10,356][123091] Updated weights for policy 0, policy_version 31096 (0.0011) [2023-12-25 23:49:10,533][123090] Updated weights for policy 1, policy_version 31363 (0.0008) [2023-12-25 23:49:10,594][123090] Updated weights for policy 1, policy_version 31373 (0.0006) [2023-12-25 23:49:10,668][123090] Updated weights for policy 1, policy_version 31383 (0.0006) [2023-12-25 23:49:11,100][123091] Updated weights for policy 0, policy_version 31106 (0.0010) [2023-12-25 23:49:11,172][123091] Updated weights for policy 0, policy_version 31116 (0.0008) [2023-12-25 23:49:11,239][123091] Updated weights for policy 0, policy_version 31126 (0.0009) [2023-12-25 23:49:11,305][123091] Updated weights for policy 0, policy_version 31136 (0.0009) [2023-12-25 23:49:11,386][123090] Updated weights for policy 1, policy_version 31393 (0.0006) [2023-12-25 23:49:11,447][123090] Updated weights for policy 1, policy_version 31403 (0.0010) [2023-12-25 23:49:11,509][123090] Updated weights for policy 1, policy_version 31413 (0.0009) [2023-12-25 23:49:11,578][123090] Updated weights for policy 1, policy_version 31423 (0.0005) [2023-12-25 23:49:12,171][123091] Updated weights for policy 0, policy_version 31146 (0.0009) [2023-12-25 23:49:12,219][123091] Updated weights for policy 0, policy_version 31156 (0.0005) [2023-12-25 23:49:12,274][123091] Updated weights for policy 0, policy_version 31166 (0.0006) [2023-12-25 23:49:12,392][123090] Updated weights for policy 1, policy_version 31433 (0.0008) [2023-12-25 23:49:12,461][123090] Updated weights for policy 1, policy_version 31443 (0.0008) [2023-12-25 23:49:12,528][123090] Updated weights for policy 1, policy_version 31453 (0.0009) [2023-12-25 23:49:13,147][123091] Updated weights for policy 0, policy_version 31176 (0.0009) [2023-12-25 23:49:13,207][123091] Updated weights for policy 0, policy_version 31186 (0.0009) [2023-12-25 23:49:13,276][123091] Updated weights for policy 0, policy_version 31196 (0.0009) [2023-12-25 23:49:13,295][123090] Updated weights for policy 1, policy_version 31463 (0.0009) [2023-12-25 23:49:13,368][123090] Updated weights for policy 1, policy_version 31473 (0.0010) [2023-12-25 23:49:13,432][123090] Updated weights for policy 1, policy_version 31483 (0.0010) [2023-12-25 23:49:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 16048128. Throughput: 0: 8680.9, 1: 8874.8. Samples: 16041016. Policy #0 lag: (min: 31.0, avg: 43.1, max: 63.0) [2023-12-25 23:49:13,784][121949] Avg episode reward: [(0, '4193.558'), (1, '4423.166')] [2023-12-25 23:49:14,069][123091] Updated weights for policy 0, policy_version 31206 (0.0006) [2023-12-25 23:49:14,130][123091] Updated weights for policy 0, policy_version 31216 (0.0008) [2023-12-25 23:49:14,189][123091] Updated weights for policy 0, policy_version 31227 (0.0010) [2023-12-25 23:49:14,258][123090] Updated weights for policy 1, policy_version 31493 (0.0010) [2023-12-25 23:49:14,323][123090] Updated weights for policy 1, policy_version 31503 (0.0009) [2023-12-25 23:49:14,381][123090] Updated weights for policy 1, policy_version 31513 (0.0010) [2023-12-25 23:49:14,968][123091] Updated weights for policy 0, policy_version 31237 (0.0010) [2023-12-25 23:49:15,032][123091] Updated weights for policy 0, policy_version 31247 (0.0011) [2023-12-25 23:49:15,092][123091] Updated weights for policy 0, policy_version 31257 (0.0011) [2023-12-25 23:49:15,252][123090] Updated weights for policy 1, policy_version 31523 (0.0008) [2023-12-25 23:49:15,310][123090] Updated weights for policy 1, policy_version 31533 (0.0005) [2023-12-25 23:49:15,364][123090] Updated weights for policy 1, policy_version 31543 (0.0008) [2023-12-25 23:49:15,870][123091] Updated weights for policy 0, policy_version 31267 (0.0011) [2023-12-25 23:49:15,915][123091] Updated weights for policy 0, policy_version 31277 (0.0009) [2023-12-25 23:49:15,969][123091] Updated weights for policy 0, policy_version 31287 (0.0005) [2023-12-25 23:49:16,152][123090] Updated weights for policy 1, policy_version 31553 (0.0009) [2023-12-25 23:49:16,215][123090] Updated weights for policy 1, policy_version 31563 (0.0009) [2023-12-25 23:49:16,279][123090] Updated weights for policy 1, policy_version 31573 (0.0010) [2023-12-25 23:49:16,350][123090] Updated weights for policy 1, policy_version 31583 (0.0006) [2023-12-25 23:49:16,716][123091] Updated weights for policy 0, policy_version 31297 (0.0006) [2023-12-25 23:49:16,775][123091] Updated weights for policy 0, policy_version 31307 (0.0005) [2023-12-25 23:49:16,831][123091] Updated weights for policy 0, policy_version 31317 (0.0005) [2023-12-25 23:49:16,879][123091] Updated weights for policy 0, policy_version 31327 (0.0007) [2023-12-25 23:49:17,003][123090] Updated weights for policy 1, policy_version 31593 (0.0006) [2023-12-25 23:49:17,066][123090] Updated weights for policy 1, policy_version 31603 (0.0010) [2023-12-25 23:49:17,119][123090] Updated weights for policy 1, policy_version 31613 (0.0009) [2023-12-25 23:49:17,629][123091] Updated weights for policy 0, policy_version 31337 (0.0009) [2023-12-25 23:49:17,686][123091] Updated weights for policy 0, policy_version 31347 (0.0010) [2023-12-25 23:49:17,741][123091] Updated weights for policy 0, policy_version 31357 (0.0010) [2023-12-25 23:49:17,975][123090] Updated weights for policy 1, policy_version 31623 (0.0009) [2023-12-25 23:49:18,032][123090] Updated weights for policy 1, policy_version 31633 (0.0009) [2023-12-25 23:49:18,092][123090] Updated weights for policy 1, policy_version 31643 (0.0009) [2023-12-25 23:49:18,547][123091] Updated weights for policy 0, policy_version 31367 (0.0010) [2023-12-25 23:49:18,612][123091] Updated weights for policy 0, policy_version 31377 (0.0009) [2023-12-25 23:49:18,679][123091] Updated weights for policy 0, policy_version 31387 (0.0008) [2023-12-25 23:49:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 16138240. Throughput: 0: 8710.3, 1: 8844.3. Samples: 16148288. Policy #0 lag: (min: 31.0, avg: 43.1, max: 63.0) [2023-12-25 23:49:18,785][121949] Avg episode reward: [(0, '4304.523'), (1, '4505.459')] [2023-12-25 23:49:18,786][123007] Saving new best policy, reward=4304.523! [2023-12-25 23:49:18,891][123090] Updated weights for policy 1, policy_version 31653 (0.0008) [2023-12-25 23:49:18,956][123090] Updated weights for policy 1, policy_version 31663 (0.0009) [2023-12-25 23:49:19,030][123090] Updated weights for policy 1, policy_version 31673 (0.0009) [2023-12-25 23:49:19,398][123091] Updated weights for policy 0, policy_version 31397 (0.0008) [2023-12-25 23:49:19,466][123091] Updated weights for policy 0, policy_version 31407 (0.0007) [2023-12-25 23:49:19,539][123091] Updated weights for policy 0, policy_version 31417 (0.0011) [2023-12-25 23:49:19,877][123090] Updated weights for policy 1, policy_version 31683 (0.0009) [2023-12-25 23:49:19,948][123090] Updated weights for policy 1, policy_version 31693 (0.0009) [2023-12-25 23:49:20,001][123090] Updated weights for policy 1, policy_version 31703 (0.0009) [2023-12-25 23:49:20,367][123091] Updated weights for policy 0, policy_version 31427 (0.0011) [2023-12-25 23:49:20,434][123091] Updated weights for policy 0, policy_version 31437 (0.0011) [2023-12-25 23:49:20,497][123091] Updated weights for policy 0, policy_version 31447 (0.0010) [2023-12-25 23:49:20,828][123090] Updated weights for policy 1, policy_version 31713 (0.0009) [2023-12-25 23:49:20,886][123090] Updated weights for policy 1, policy_version 31723 (0.0008) [2023-12-25 23:49:20,956][123090] Updated weights for policy 1, policy_version 31733 (0.0009) [2023-12-25 23:49:21,035][123090] Updated weights for policy 1, policy_version 31743 (0.0007) [2023-12-25 23:49:21,327][123091] Updated weights for policy 0, policy_version 31457 (0.0010) [2023-12-25 23:49:21,396][123091] Updated weights for policy 0, policy_version 31467 (0.0009) [2023-12-25 23:49:21,453][123091] Updated weights for policy 0, policy_version 31477 (0.0010) [2023-12-25 23:49:21,513][123091] Updated weights for policy 0, policy_version 31487 (0.0011) [2023-12-25 23:49:21,891][123090] Updated weights for policy 1, policy_version 31753 (0.0009) [2023-12-25 23:49:21,958][123090] Updated weights for policy 1, policy_version 31763 (0.0010) [2023-12-25 23:49:22,026][123090] Updated weights for policy 1, policy_version 31773 (0.0010) [2023-12-25 23:49:22,344][123091] Updated weights for policy 0, policy_version 31497 (0.0011) [2023-12-25 23:49:22,417][123091] Updated weights for policy 0, policy_version 31507 (0.0010) [2023-12-25 23:49:22,487][123091] Updated weights for policy 0, policy_version 31517 (0.0010) [2023-12-25 23:49:22,923][123090] Updated weights for policy 1, policy_version 31783 (0.0009) [2023-12-25 23:49:22,986][123090] Updated weights for policy 1, policy_version 31793 (0.0009) [2023-12-25 23:49:23,039][123090] Updated weights for policy 1, policy_version 31803 (0.0009) [2023-12-25 23:49:23,319][123091] Updated weights for policy 0, policy_version 31527 (0.0006) [2023-12-25 23:49:23,379][123091] Updated weights for policy 0, policy_version 31537 (0.0006) [2023-12-25 23:49:23,435][123091] Updated weights for policy 0, policy_version 31547 (0.0010) [2023-12-25 23:49:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 16220160. Throughput: 0: 8688.2, 1: 8784.1. Samples: 16199420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:49:23,785][121949] Avg episode reward: [(0, '4216.672'), (1, '4471.761')] [2023-12-25 23:49:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000031552_8077312.pth... [2023-12-25 23:49:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000031808_8142848.pth... [2023-12-25 23:49:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000030528_7815168.pth [2023-12-25 23:49:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000030816_7888896.pth [2023-12-25 23:49:23,903][123090] Updated weights for policy 1, policy_version 31813 (0.0009) [2023-12-25 23:49:23,959][123090] Updated weights for policy 1, policy_version 31823 (0.0008) [2023-12-25 23:49:24,015][123090] Updated weights for policy 1, policy_version 31833 (0.0009) [2023-12-25 23:49:24,237][123091] Updated weights for policy 0, policy_version 31557 (0.0008) [2023-12-25 23:49:24,289][123091] Updated weights for policy 0, policy_version 31567 (0.0005) [2023-12-25 23:49:24,344][123091] Updated weights for policy 0, policy_version 31577 (0.0005) [2023-12-25 23:49:24,774][123090] Updated weights for policy 1, policy_version 31843 (0.0007) [2023-12-25 23:49:24,831][123090] Updated weights for policy 1, policy_version 31853 (0.0005) [2023-12-25 23:49:24,895][123090] Updated weights for policy 1, policy_version 31863 (0.0005) [2023-12-25 23:49:25,021][123091] Updated weights for policy 0, policy_version 31587 (0.0005) [2023-12-25 23:49:25,068][123091] Updated weights for policy 0, policy_version 31597 (0.0005) [2023-12-25 23:49:25,123][123091] Updated weights for policy 0, policy_version 31607 (0.0005) [2023-12-25 23:49:25,673][123090] Updated weights for policy 1, policy_version 31873 (0.0005) [2023-12-25 23:49:25,751][123090] Updated weights for policy 1, policy_version 31883 (0.0006) [2023-12-25 23:49:25,825][123090] Updated weights for policy 1, policy_version 31893 (0.0005) [2023-12-25 23:49:25,836][123091] Updated weights for policy 0, policy_version 31617 (0.0006) [2023-12-25 23:49:25,886][123090] Updated weights for policy 1, policy_version 31903 (0.0006) [2023-12-25 23:49:25,892][123091] Updated weights for policy 0, policy_version 31627 (0.0009) [2023-12-25 23:49:25,951][123091] Updated weights for policy 0, policy_version 31637 (0.0009) [2023-12-25 23:49:26,013][123091] Updated weights for policy 0, policy_version 31647 (0.0010) [2023-12-25 23:49:26,622][123090] Updated weights for policy 1, policy_version 31913 (0.0011) [2023-12-25 23:49:26,673][123090] Updated weights for policy 1, policy_version 31923 (0.0010) [2023-12-25 23:49:26,723][123090] Updated weights for policy 1, policy_version 31933 (0.0010) [2023-12-25 23:49:26,839][123091] Updated weights for policy 0, policy_version 31657 (0.0009) [2023-12-25 23:49:26,890][123091] Updated weights for policy 0, policy_version 31668 (0.0009) [2023-12-25 23:49:26,937][123091] Updated weights for policy 0, policy_version 31678 (0.0008) [2023-12-25 23:49:27,464][123090] Updated weights for policy 1, policy_version 31943 (0.0007) [2023-12-25 23:49:27,539][123090] Updated weights for policy 1, policy_version 31953 (0.0005) [2023-12-25 23:49:27,614][123090] Updated weights for policy 1, policy_version 31963 (0.0006) [2023-12-25 23:49:27,779][123091] Updated weights for policy 0, policy_version 31688 (0.0010) [2023-12-25 23:49:27,847][123091] Updated weights for policy 0, policy_version 31698 (0.0009) [2023-12-25 23:49:27,913][123091] Updated weights for policy 0, policy_version 31708 (0.0007) [2023-12-25 23:49:28,267][123090] Updated weights for policy 1, policy_version 31973 (0.0009) [2023-12-25 23:49:28,319][123090] Updated weights for policy 1, policy_version 31983 (0.0010) [2023-12-25 23:49:28,391][123090] Updated weights for policy 1, policy_version 31993 (0.0011) [2023-12-25 23:49:28,744][123091] Updated weights for policy 0, policy_version 31718 (0.0010) [2023-12-25 23:49:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 16310272. Throughput: 0: 8698.1, 1: 8779.2. Samples: 16307552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:49:28,785][121949] Avg episode reward: [(0, '4199.542'), (1, '4417.475')] [2023-12-25 23:49:28,810][123091] Updated weights for policy 0, policy_version 31728 (0.0010) [2023-12-25 23:49:28,862][123091] Updated weights for policy 0, policy_version 31738 (0.0010) [2023-12-25 23:49:29,125][123090] Updated weights for policy 1, policy_version 32003 (0.0010) [2023-12-25 23:49:29,173][123090] Updated weights for policy 1, policy_version 32013 (0.0008) [2023-12-25 23:49:29,225][123090] Updated weights for policy 1, policy_version 32023 (0.0008) [2023-12-25 23:49:29,752][123091] Updated weights for policy 0, policy_version 31748 (0.0010) [2023-12-25 23:49:29,816][123091] Updated weights for policy 0, policy_version 31758 (0.0011) [2023-12-25 23:49:29,881][123091] Updated weights for policy 0, policy_version 31769 (0.0006) [2023-12-25 23:49:30,047][123090] Updated weights for policy 1, policy_version 32033 (0.0008) [2023-12-25 23:49:30,112][123090] Updated weights for policy 1, policy_version 32043 (0.0009) [2023-12-25 23:49:30,179][123090] Updated weights for policy 1, policy_version 32053 (0.0010) [2023-12-25 23:49:30,244][123090] Updated weights for policy 1, policy_version 32063 (0.0009) [2023-12-25 23:49:30,522][123091] Updated weights for policy 0, policy_version 31779 (0.0007) [2023-12-25 23:49:30,579][123091] Updated weights for policy 0, policy_version 31789 (0.0009) [2023-12-25 23:49:30,631][123091] Updated weights for policy 0, policy_version 31799 (0.0010) [2023-12-25 23:49:31,029][123090] Updated weights for policy 1, policy_version 32073 (0.0006) [2023-12-25 23:49:31,090][123090] Updated weights for policy 1, policy_version 32083 (0.0009) [2023-12-25 23:49:31,150][123090] Updated weights for policy 1, policy_version 32093 (0.0010) [2023-12-25 23:49:31,527][123091] Updated weights for policy 0, policy_version 31810 (0.0010) [2023-12-25 23:49:31,580][123091] Updated weights for policy 0, policy_version 31820 (0.0009) [2023-12-25 23:49:31,647][123091] Updated weights for policy 0, policy_version 31830 (0.0009) [2023-12-25 23:49:31,707][123091] Updated weights for policy 0, policy_version 31840 (0.0009) [2023-12-25 23:49:31,915][123090] Updated weights for policy 1, policy_version 32103 (0.0007) [2023-12-25 23:49:31,971][123090] Updated weights for policy 1, policy_version 32113 (0.0008) [2023-12-25 23:49:32,035][123090] Updated weights for policy 1, policy_version 32123 (0.0008) [2023-12-25 23:49:32,521][123091] Updated weights for policy 0, policy_version 31850 (0.0010) [2023-12-25 23:49:32,568][123091] Updated weights for policy 0, policy_version 31860 (0.0009) [2023-12-25 23:49:32,621][123091] Updated weights for policy 0, policy_version 31871 (0.0010) [2023-12-25 23:49:32,863][123090] Updated weights for policy 1, policy_version 32133 (0.0009) [2023-12-25 23:49:32,916][123090] Updated weights for policy 1, policy_version 32143 (0.0009) [2023-12-25 23:49:32,970][123090] Updated weights for policy 1, policy_version 32154 (0.0010) [2023-12-25 23:49:33,308][123091] Updated weights for policy 0, policy_version 31881 (0.0006) [2023-12-25 23:49:33,356][123091] Updated weights for policy 0, policy_version 31891 (0.0005) [2023-12-25 23:49:33,421][123091] Updated weights for policy 0, policy_version 31901 (0.0005) [2023-12-25 23:49:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 16400384. Throughput: 0: 8728.4, 1: 8817.0. Samples: 16413020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:49:33,785][121949] Avg episode reward: [(0, '4134.661'), (1, '4475.673')] [2023-12-25 23:49:33,888][123090] Updated weights for policy 1, policy_version 32164 (0.0010) [2023-12-25 23:49:33,949][123090] Updated weights for policy 1, policy_version 32174 (0.0010) [2023-12-25 23:49:34,011][123090] Updated weights for policy 1, policy_version 32184 (0.0010) [2023-12-25 23:49:34,172][123091] Updated weights for policy 0, policy_version 31911 (0.0006) [2023-12-25 23:49:34,230][123091] Updated weights for policy 0, policy_version 31921 (0.0007) [2023-12-25 23:49:34,282][123091] Updated weights for policy 0, policy_version 31931 (0.0006) [2023-12-25 23:49:34,926][123090] Updated weights for policy 1, policy_version 32194 (0.0010) [2023-12-25 23:49:34,998][123090] Updated weights for policy 1, policy_version 32204 (0.0010) [2023-12-25 23:49:35,037][123091] Updated weights for policy 0, policy_version 31941 (0.0008) [2023-12-25 23:49:35,060][123090] Updated weights for policy 1, policy_version 32214 (0.0010) [2023-12-25 23:49:35,100][123091] Updated weights for policy 0, policy_version 31951 (0.0008) [2023-12-25 23:49:35,120][123090] Updated weights for policy 1, policy_version 32224 (0.0008) [2023-12-25 23:49:35,159][123091] Updated weights for policy 0, policy_version 31961 (0.0009) [2023-12-25 23:49:35,939][123090] Updated weights for policy 1, policy_version 32234 (0.0010) [2023-12-25 23:49:35,942][123091] Updated weights for policy 0, policy_version 31971 (0.0009) [2023-12-25 23:49:35,988][123091] Updated weights for policy 0, policy_version 31981 (0.0008) [2023-12-25 23:49:35,996][123090] Updated weights for policy 1, policy_version 32244 (0.0007) [2023-12-25 23:49:36,038][123091] Updated weights for policy 0, policy_version 31991 (0.0008) [2023-12-25 23:49:36,062][123090] Updated weights for policy 1, policy_version 32254 (0.0009) [2023-12-25 23:49:36,796][123090] Updated weights for policy 1, policy_version 32264 (0.0008) [2023-12-25 23:49:36,803][123091] Updated weights for policy 0, policy_version 32001 (0.0007) [2023-12-25 23:49:36,846][123090] Updated weights for policy 1, policy_version 32274 (0.0007) [2023-12-25 23:49:36,855][123091] Updated weights for policy 0, policy_version 32011 (0.0007) [2023-12-25 23:49:36,906][123090] Updated weights for policy 1, policy_version 32284 (0.0009) [2023-12-25 23:49:36,912][123091] Updated weights for policy 0, policy_version 32021 (0.0009) [2023-12-25 23:49:36,963][123091] Updated weights for policy 0, policy_version 32031 (0.0007) [2023-12-25 23:49:37,690][123091] Updated weights for policy 0, policy_version 32041 (0.0006) [2023-12-25 23:49:37,756][123091] Updated weights for policy 0, policy_version 32051 (0.0008) [2023-12-25 23:49:37,814][123090] Updated weights for policy 1, policy_version 32294 (0.0007) [2023-12-25 23:49:37,819][123091] Updated weights for policy 0, policy_version 32061 (0.0008) [2023-12-25 23:49:37,884][123090] Updated weights for policy 1, policy_version 32304 (0.0010) [2023-12-25 23:49:37,952][123090] Updated weights for policy 1, policy_version 32314 (0.0010) [2023-12-25 23:49:38,426][123091] Updated weights for policy 0, policy_version 32071 (0.0006) [2023-12-25 23:49:38,481][123091] Updated weights for policy 0, policy_version 32081 (0.0009) [2023-12-25 23:49:38,540][123091] Updated weights for policy 0, policy_version 32091 (0.0011) [2023-12-25 23:49:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 16490496. Throughput: 0: 8795.5, 1: 8773.6. Samples: 16466352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:49:38,785][121949] Avg episode reward: [(0, '4190.066'), (1, '4523.787')] [2023-12-25 23:49:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000032096_8216576.pth... [2023-12-25 23:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000032320_8273920.pth... [2023-12-25 23:49:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000031328_8019968.pth [2023-12-25 23:49:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000031040_7946240.pth [2023-12-25 23:49:38,797][123008] Saving new best policy, reward=4523.787! [2023-12-25 23:49:38,849][123090] Updated weights for policy 1, policy_version 32324 (0.0009) [2023-12-25 23:49:38,913][123090] Updated weights for policy 1, policy_version 32334 (0.0009) [2023-12-25 23:49:38,985][123090] Updated weights for policy 1, policy_version 32344 (0.0010) [2023-12-25 23:49:39,312][123091] Updated weights for policy 0, policy_version 32101 (0.0008) [2023-12-25 23:49:39,383][123091] Updated weights for policy 0, policy_version 32111 (0.0009) [2023-12-25 23:49:39,451][123091] Updated weights for policy 0, policy_version 32121 (0.0008) [2023-12-25 23:49:39,842][123090] Updated weights for policy 1, policy_version 32354 (0.0010) [2023-12-25 23:49:39,914][123090] Updated weights for policy 1, policy_version 32364 (0.0007) [2023-12-25 23:49:39,987][123090] Updated weights for policy 1, policy_version 32374 (0.0007) [2023-12-25 23:49:40,059][123090] Updated weights for policy 1, policy_version 32384 (0.0007) [2023-12-25 23:49:40,220][123091] Updated weights for policy 0, policy_version 32131 (0.0008) [2023-12-25 23:49:40,293][123091] Updated weights for policy 0, policy_version 32141 (0.0006) [2023-12-25 23:49:40,356][123091] Updated weights for policy 0, policy_version 32151 (0.0006) [2023-12-25 23:49:40,875][123090] Updated weights for policy 1, policy_version 32394 (0.0010) [2023-12-25 23:49:40,941][123090] Updated weights for policy 1, policy_version 32404 (0.0009) [2023-12-25 23:49:41,006][123090] Updated weights for policy 1, policy_version 32414 (0.0009) [2023-12-25 23:49:41,026][123091] Updated weights for policy 0, policy_version 32161 (0.0006) [2023-12-25 23:49:41,099][123091] Updated weights for policy 0, policy_version 32171 (0.0007) [2023-12-25 23:49:41,171][123091] Updated weights for policy 0, policy_version 32181 (0.0010) [2023-12-25 23:49:41,239][123091] Updated weights for policy 0, policy_version 32191 (0.0006) [2023-12-25 23:49:41,878][123090] Updated weights for policy 1, policy_version 32425 (0.0010) [2023-12-25 23:49:41,941][123090] Updated weights for policy 1, policy_version 32435 (0.0010) [2023-12-25 23:49:41,983][123091] Updated weights for policy 0, policy_version 32201 (0.0008) [2023-12-25 23:49:42,004][123090] Updated weights for policy 1, policy_version 32445 (0.0008) [2023-12-25 23:49:42,049][123091] Updated weights for policy 0, policy_version 32211 (0.0008) [2023-12-25 23:49:42,102][123091] Updated weights for policy 0, policy_version 32221 (0.0009) [2023-12-25 23:49:42,814][123090] Updated weights for policy 1, policy_version 32455 (0.0009) [2023-12-25 23:49:42,875][123090] Updated weights for policy 1, policy_version 32465 (0.0010) [2023-12-25 23:49:42,935][123090] Updated weights for policy 1, policy_version 32475 (0.0009) [2023-12-25 23:49:42,978][123091] Updated weights for policy 0, policy_version 32231 (0.0008) [2023-12-25 23:49:43,038][123091] Updated weights for policy 0, policy_version 32241 (0.0009) [2023-12-25 23:49:43,107][123091] Updated weights for policy 0, policy_version 32251 (0.0009) [2023-12-25 23:49:43,750][123090] Updated weights for policy 1, policy_version 32485 (0.0010) [2023-12-25 23:49:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17744.7). Total num frames: 16572416. Throughput: 0: 8915.7, 1: 8650.8. Samples: 16571656. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-25 23:49:43,785][121949] Avg episode reward: [(0, '4230.433'), (1, '4532.108')] [2023-12-25 23:49:43,814][123090] Updated weights for policy 1, policy_version 32495 (0.0008) [2023-12-25 23:49:43,885][123090] Updated weights for policy 1, policy_version 32505 (0.0009) [2023-12-25 23:49:43,933][123008] Saving new best policy, reward=4532.108! [2023-12-25 23:49:43,939][123091] Updated weights for policy 0, policy_version 32261 (0.0009) [2023-12-25 23:49:44,000][123091] Updated weights for policy 0, policy_version 32271 (0.0010) [2023-12-25 23:49:44,060][123091] Updated weights for policy 0, policy_version 32281 (0.0008) [2023-12-25 23:49:44,706][123090] Updated weights for policy 1, policy_version 32515 (0.0009) [2023-12-25 23:49:44,760][123090] Updated weights for policy 1, policy_version 32526 (0.0011) [2023-12-25 23:49:44,826][123090] Updated weights for policy 1, policy_version 32536 (0.0010) [2023-12-25 23:49:44,907][123091] Updated weights for policy 0, policy_version 32291 (0.0009) [2023-12-25 23:49:44,970][123091] Updated weights for policy 0, policy_version 32301 (0.0008) [2023-12-25 23:49:45,025][123091] Updated weights for policy 0, policy_version 32311 (0.0009) [2023-12-25 23:49:45,684][123090] Updated weights for policy 1, policy_version 32546 (0.0008) [2023-12-25 23:49:45,746][123090] Updated weights for policy 1, policy_version 32556 (0.0006) [2023-12-25 23:49:45,802][123090] Updated weights for policy 1, policy_version 32566 (0.0006) [2023-12-25 23:49:45,866][123090] Updated weights for policy 1, policy_version 32576 (0.0007) [2023-12-25 23:49:45,883][123091] Updated weights for policy 0, policy_version 32321 (0.0010) [2023-12-25 23:49:45,950][123091] Updated weights for policy 0, policy_version 32331 (0.0010) [2023-12-25 23:49:46,022][123091] Updated weights for policy 0, policy_version 32341 (0.0010) [2023-12-25 23:49:46,091][123091] Updated weights for policy 0, policy_version 32351 (0.0010) [2023-12-25 23:49:46,612][123090] Updated weights for policy 1, policy_version 32586 (0.0010) [2023-12-25 23:49:46,674][123090] Updated weights for policy 1, policy_version 32596 (0.0010) [2023-12-25 23:49:46,743][123090] Updated weights for policy 1, policy_version 32606 (0.0007) [2023-12-25 23:49:46,961][123091] Updated weights for policy 0, policy_version 32361 (0.0010) [2023-12-25 23:49:47,015][123091] Updated weights for policy 0, policy_version 32371 (0.0010) [2023-12-25 23:49:47,074][123091] Updated weights for policy 0, policy_version 32382 (0.0011) [2023-12-25 23:49:47,420][123090] Updated weights for policy 1, policy_version 32616 (0.0005) [2023-12-25 23:49:47,467][123090] Updated weights for policy 1, policy_version 32626 (0.0005) [2023-12-25 23:49:47,521][123090] Updated weights for policy 1, policy_version 32636 (0.0005) [2023-12-25 23:49:48,009][123091] Updated weights for policy 0, policy_version 32392 (0.0009) [2023-12-25 23:49:48,062][123091] Updated weights for policy 0, policy_version 32402 (0.0009) [2023-12-25 23:49:48,118][123091] Updated weights for policy 0, policy_version 32412 (0.0009) [2023-12-25 23:49:48,298][123090] Updated weights for policy 1, policy_version 32646 (0.0005) [2023-12-25 23:49:48,364][123090] Updated weights for policy 1, policy_version 32656 (0.0008) [2023-12-25 23:49:48,438][123090] Updated weights for policy 1, policy_version 32666 (0.0010) [2023-12-25 23:49:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 16662528. Throughput: 0: 8848.6, 1: 8701.8. Samples: 16675120. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-25 23:49:48,785][121949] Avg episode reward: [(0, '4291.409'), (1, '4534.588')] [2023-12-25 23:49:48,785][123008] Saving new best policy, reward=4534.588! [2023-12-25 23:49:49,071][123091] Updated weights for policy 0, policy_version 32422 (0.0010) [2023-12-25 23:49:49,121][123090] Updated weights for policy 1, policy_version 32676 (0.0008) [2023-12-25 23:49:49,131][123091] Updated weights for policy 0, policy_version 32432 (0.0009) [2023-12-25 23:49:49,173][123090] Updated weights for policy 1, policy_version 32686 (0.0006) [2023-12-25 23:49:49,189][123091] Updated weights for policy 0, policy_version 32442 (0.0009) [2023-12-25 23:49:49,249][123090] Updated weights for policy 1, policy_version 32698 (0.0007) [2023-12-25 23:49:49,977][123090] Updated weights for policy 1, policy_version 32708 (0.0008) [2023-12-25 23:49:50,042][123090] Updated weights for policy 1, policy_version 32718 (0.0011) [2023-12-25 23:49:50,109][123090] Updated weights for policy 1, policy_version 32728 (0.0010) [2023-12-25 23:49:50,129][123091] Updated weights for policy 0, policy_version 32452 (0.0009) [2023-12-25 23:49:50,188][123091] Updated weights for policy 0, policy_version 32462 (0.0008) [2023-12-25 23:49:50,247][123091] Updated weights for policy 0, policy_version 32472 (0.0009) [2023-12-25 23:49:50,918][123090] Updated weights for policy 1, policy_version 32738 (0.0010) [2023-12-25 23:49:50,970][123090] Updated weights for policy 1, policy_version 32748 (0.0010) [2023-12-25 23:49:51,032][123090] Updated weights for policy 1, policy_version 32758 (0.0009) [2023-12-25 23:49:51,098][123090] Updated weights for policy 1, policy_version 32768 (0.0007) [2023-12-25 23:49:51,112][123091] Updated weights for policy 0, policy_version 32482 (0.0009) [2023-12-25 23:49:51,178][123091] Updated weights for policy 0, policy_version 32492 (0.0009) [2023-12-25 23:49:51,232][123091] Updated weights for policy 0, policy_version 32502 (0.0009) [2023-12-25 23:49:51,286][123091] Updated weights for policy 0, policy_version 32512 (0.0009) [2023-12-25 23:49:51,885][123090] Updated weights for policy 1, policy_version 32778 (0.0006) [2023-12-25 23:49:51,952][123090] Updated weights for policy 1, policy_version 32788 (0.0005) [2023-12-25 23:49:52,025][123090] Updated weights for policy 1, policy_version 32798 (0.0006) [2023-12-25 23:49:52,218][123091] Updated weights for policy 0, policy_version 32522 (0.0010) [2023-12-25 23:49:52,278][123091] Updated weights for policy 0, policy_version 32533 (0.0009) [2023-12-25 23:49:52,338][123091] Updated weights for policy 0, policy_version 32543 (0.0009) [2023-12-25 23:49:52,693][123090] Updated weights for policy 1, policy_version 32808 (0.0009) [2023-12-25 23:49:52,748][123090] Updated weights for policy 1, policy_version 32818 (0.0008) [2023-12-25 23:49:52,810][123090] Updated weights for policy 1, policy_version 32828 (0.0005) [2023-12-25 23:49:53,281][123091] Updated weights for policy 0, policy_version 32553 (0.0010) [2023-12-25 23:49:53,337][123091] Updated weights for policy 0, policy_version 32563 (0.0010) [2023-12-25 23:49:53,391][123091] Updated weights for policy 0, policy_version 32573 (0.0010) [2023-12-25 23:49:53,490][123090] Updated weights for policy 1, policy_version 32838 (0.0005) [2023-12-25 23:49:53,538][123090] Updated weights for policy 1, policy_version 32848 (0.0005) [2023-12-25 23:49:53,591][123090] Updated weights for policy 1, policy_version 32858 (0.0005) [2023-12-25 23:49:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 16752640. Throughput: 0: 8797.3, 1: 8731.7. Samples: 16726484. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-25 23:49:53,784][121949] Avg episode reward: [(0, '4288.806'), (1, '4509.335')] [2023-12-25 23:49:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000032864_8413184.pth... [2023-12-25 23:49:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000032576_8339456.pth... [2023-12-25 23:49:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000031808_8142848.pth [2023-12-25 23:49:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000031552_8077312.pth [2023-12-25 23:49:54,267][123090] Updated weights for policy 1, policy_version 32868 (0.0006) [2023-12-25 23:49:54,333][123090] Updated weights for policy 1, policy_version 32878 (0.0005) [2023-12-25 23:49:54,368][123091] Updated weights for policy 0, policy_version 32583 (0.0009) [2023-12-25 23:49:54,387][123090] Updated weights for policy 1, policy_version 32888 (0.0005) [2023-12-25 23:49:54,426][123091] Updated weights for policy 0, policy_version 32593 (0.0009) [2023-12-25 23:49:54,490][123091] Updated weights for policy 0, policy_version 32603 (0.0009) [2023-12-25 23:49:55,126][123090] Updated weights for policy 1, policy_version 32898 (0.0005) [2023-12-25 23:49:55,182][123090] Updated weights for policy 1, policy_version 32908 (0.0005) [2023-12-25 23:49:55,261][123090] Updated weights for policy 1, policy_version 32918 (0.0005) [2023-12-25 23:49:55,330][123090] Updated weights for policy 1, policy_version 32928 (0.0005) [2023-12-25 23:49:55,392][123091] Updated weights for policy 0, policy_version 32613 (0.0009) [2023-12-25 23:49:55,458][123091] Updated weights for policy 0, policy_version 32623 (0.0009) [2023-12-25 23:49:55,520][123091] Updated weights for policy 0, policy_version 32633 (0.0009) [2023-12-25 23:49:56,017][123090] Updated weights for policy 1, policy_version 32938 (0.0005) [2023-12-25 23:49:56,068][123090] Updated weights for policy 1, policy_version 32948 (0.0005) [2023-12-25 23:49:56,131][123090] Updated weights for policy 1, policy_version 32958 (0.0005) [2023-12-25 23:49:56,193][123091] Updated weights for policy 0, policy_version 32643 (0.0009) [2023-12-25 23:49:56,247][123091] Updated weights for policy 0, policy_version 32653 (0.0010) [2023-12-25 23:49:56,305][123091] Updated weights for policy 0, policy_version 32664 (0.0008) [2023-12-25 23:49:56,802][123090] Updated weights for policy 1, policy_version 32968 (0.0009) [2023-12-25 23:49:56,859][123090] Updated weights for policy 1, policy_version 32978 (0.0010) [2023-12-25 23:49:56,928][123090] Updated weights for policy 1, policy_version 32988 (0.0010) [2023-12-25 23:49:57,141][123091] Updated weights for policy 0, policy_version 32674 (0.0007) [2023-12-25 23:49:57,197][123091] Updated weights for policy 0, policy_version 32684 (0.0008) [2023-12-25 23:49:57,260][123091] Updated weights for policy 0, policy_version 32694 (0.0009) [2023-12-25 23:49:57,321][123091] Updated weights for policy 0, policy_version 32704 (0.0009) [2023-12-25 23:49:57,698][123090] Updated weights for policy 1, policy_version 32998 (0.0007) [2023-12-25 23:49:57,758][123090] Updated weights for policy 1, policy_version 33008 (0.0005) [2023-12-25 23:49:57,819][123090] Updated weights for policy 1, policy_version 33018 (0.0005) [2023-12-25 23:49:58,212][123091] Updated weights for policy 0, policy_version 32714 (0.0010) [2023-12-25 23:49:58,282][123091] Updated weights for policy 0, policy_version 32724 (0.0011) [2023-12-25 23:49:58,358][123091] Updated weights for policy 0, policy_version 32734 (0.0011) [2023-12-25 23:49:58,483][123090] Updated weights for policy 1, policy_version 33028 (0.0006) [2023-12-25 23:49:58,561][123090] Updated weights for policy 1, policy_version 33038 (0.0008) [2023-12-25 23:49:58,645][123090] Updated weights for policy 1, policy_version 33048 (0.0009) [2023-12-25 23:49:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 16842752. Throughput: 0: 8740.3, 1: 8867.4. Samples: 16833364. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-25 23:49:58,785][121949] Avg episode reward: [(0, '4124.185'), (1, '4520.013')] [2023-12-25 23:49:59,235][123091] Updated weights for policy 0, policy_version 32744 (0.0009) [2023-12-25 23:49:59,303][123091] Updated weights for policy 0, policy_version 32754 (0.0010) [2023-12-25 23:49:59,372][123091] Updated weights for policy 0, policy_version 32764 (0.0008) [2023-12-25 23:49:59,520][123090] Updated weights for policy 1, policy_version 33058 (0.0008) [2023-12-25 23:49:59,576][123090] Updated weights for policy 1, policy_version 33068 (0.0010) [2023-12-25 23:49:59,631][123090] Updated weights for policy 1, policy_version 33078 (0.0009) [2023-12-25 23:49:59,697][123090] Updated weights for policy 1, policy_version 33088 (0.0009) [2023-12-25 23:50:00,141][123091] Updated weights for policy 0, policy_version 32774 (0.0007) [2023-12-25 23:50:00,210][123091] Updated weights for policy 0, policy_version 32784 (0.0009) [2023-12-25 23:50:00,278][123091] Updated weights for policy 0, policy_version 32794 (0.0010) [2023-12-25 23:50:00,532][123090] Updated weights for policy 1, policy_version 33098 (0.0010) [2023-12-25 23:50:00,590][123090] Updated weights for policy 1, policy_version 33109 (0.0010) [2023-12-25 23:50:00,650][123090] Updated weights for policy 1, policy_version 33120 (0.0009) [2023-12-25 23:50:01,000][123091] Updated weights for policy 0, policy_version 32804 (0.0010) [2023-12-25 23:50:01,064][123091] Updated weights for policy 0, policy_version 32814 (0.0010) [2023-12-25 23:50:01,125][123091] Updated weights for policy 0, policy_version 32824 (0.0008) [2023-12-25 23:50:01,465][123090] Updated weights for policy 1, policy_version 33130 (0.0007) [2023-12-25 23:50:01,533][123090] Updated weights for policy 1, policy_version 33140 (0.0009) [2023-12-25 23:50:01,601][123090] Updated weights for policy 1, policy_version 33150 (0.0010) [2023-12-25 23:50:01,926][123091] Updated weights for policy 0, policy_version 32834 (0.0006) [2023-12-25 23:50:01,981][123091] Updated weights for policy 0, policy_version 32845 (0.0010) [2023-12-25 23:50:02,034][123091] Updated weights for policy 0, policy_version 32855 (0.0010) [2023-12-25 23:50:02,362][123090] Updated weights for policy 1, policy_version 33160 (0.0007) [2023-12-25 23:50:02,408][123090] Updated weights for policy 1, policy_version 33170 (0.0005) [2023-12-25 23:50:02,461][123090] Updated weights for policy 1, policy_version 33180 (0.0005) [2023-12-25 23:50:02,913][123091] Updated weights for policy 0, policy_version 32865 (0.0009) [2023-12-25 23:50:02,972][123091] Updated weights for policy 0, policy_version 32875 (0.0010) [2023-12-25 23:50:03,029][123091] Updated weights for policy 0, policy_version 32887 (0.0010) [2023-12-25 23:50:03,237][123090] Updated weights for policy 1, policy_version 33190 (0.0007) [2023-12-25 23:50:03,299][123090] Updated weights for policy 1, policy_version 33200 (0.0009) [2023-12-25 23:50:03,358][123090] Updated weights for policy 1, policy_version 33210 (0.0009) [2023-12-25 23:50:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 16924672. Throughput: 0: 8666.8, 1: 8874.3. Samples: 16937636. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-25 23:50:03,785][121949] Avg episode reward: [(0, '4196.481'), (1, '4536.846')] [2023-12-25 23:50:03,786][123008] Saving new best policy, reward=4536.846! [2023-12-25 23:50:03,866][123091] Updated weights for policy 0, policy_version 32897 (0.0010) [2023-12-25 23:50:03,929][123091] Updated weights for policy 0, policy_version 32907 (0.0010) [2023-12-25 23:50:03,980][123091] Updated weights for policy 0, policy_version 32917 (0.0009) [2023-12-25 23:50:04,036][123091] Updated weights for policy 0, policy_version 32927 (0.0010) [2023-12-25 23:50:04,145][123090] Updated weights for policy 1, policy_version 33220 (0.0008) [2023-12-25 23:50:04,208][123090] Updated weights for policy 1, policy_version 33230 (0.0006) [2023-12-25 23:50:04,256][123090] Updated weights for policy 1, policy_version 33240 (0.0005) [2023-12-25 23:50:04,933][123091] Updated weights for policy 0, policy_version 32937 (0.0008) [2023-12-25 23:50:05,000][123091] Updated weights for policy 0, policy_version 32947 (0.0009) [2023-12-25 23:50:05,034][123090] Updated weights for policy 1, policy_version 33250 (0.0007) [2023-12-25 23:50:05,063][123091] Updated weights for policy 0, policy_version 32957 (0.0007) [2023-12-25 23:50:05,093][123090] Updated weights for policy 1, policy_version 33260 (0.0010) [2023-12-25 23:50:05,152][123090] Updated weights for policy 1, policy_version 33270 (0.0010) [2023-12-25 23:50:05,222][123090] Updated weights for policy 1, policy_version 33280 (0.0010) [2023-12-25 23:50:05,888][123091] Updated weights for policy 0, policy_version 32967 (0.0008) [2023-12-25 23:50:05,945][123091] Updated weights for policy 0, policy_version 32977 (0.0008) [2023-12-25 23:50:06,005][123091] Updated weights for policy 0, policy_version 32987 (0.0010) [2023-12-25 23:50:06,049][123090] Updated weights for policy 1, policy_version 33290 (0.0009) [2023-12-25 23:50:06,104][123090] Updated weights for policy 1, policy_version 33300 (0.0009) [2023-12-25 23:50:06,173][123090] Updated weights for policy 1, policy_version 33310 (0.0009) [2023-12-25 23:50:06,853][123091] Updated weights for policy 0, policy_version 32997 (0.0008) [2023-12-25 23:50:06,901][123091] Updated weights for policy 0, policy_version 33007 (0.0008) [2023-12-25 23:50:06,956][123091] Updated weights for policy 0, policy_version 33017 (0.0009) [2023-12-25 23:50:07,005][123090] Updated weights for policy 1, policy_version 33320 (0.0006) [2023-12-25 23:50:07,054][123090] Updated weights for policy 1, policy_version 33330 (0.0008) [2023-12-25 23:50:07,117][123090] Updated weights for policy 1, policy_version 33340 (0.0006) [2023-12-25 23:50:07,840][123090] Updated weights for policy 1, policy_version 33350 (0.0007) [2023-12-25 23:50:07,846][123091] Updated weights for policy 0, policy_version 33027 (0.0009) [2023-12-25 23:50:07,890][123090] Updated weights for policy 1, policy_version 33360 (0.0007) [2023-12-25 23:50:07,902][123091] Updated weights for policy 0, policy_version 33037 (0.0009) [2023-12-25 23:50:07,949][123090] Updated weights for policy 1, policy_version 33370 (0.0005) [2023-12-25 23:50:07,960][123091] Updated weights for policy 0, policy_version 33047 (0.0009) [2023-12-25 23:50:08,597][123090] Updated weights for policy 1, policy_version 33380 (0.0007) [2023-12-25 23:50:08,664][123090] Updated weights for policy 1, policy_version 33390 (0.0009) [2023-12-25 23:50:08,741][123090] Updated weights for policy 1, policy_version 33400 (0.0009) [2023-12-25 23:50:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 17006592. Throughput: 0: 8646.1, 1: 8891.0. Samples: 16988584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-25 23:50:08,785][121949] Avg episode reward: [(0, '4220.864'), (1, '4545.626')] [2023-12-25 23:50:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000033056_8462336.pth... [2023-12-25 23:50:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000032096_8216576.pth [2023-12-25 23:50:08,799][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000033408_8552448.pth... [2023-12-25 23:50:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000032320_8273920.pth [2023-12-25 23:50:08,804][123008] Saving new best policy, reward=4545.626! [2023-12-25 23:50:08,865][123091] Updated weights for policy 0, policy_version 33057 (0.0009) [2023-12-25 23:50:08,934][123091] Updated weights for policy 0, policy_version 33067 (0.0009) [2023-12-25 23:50:09,001][123091] Updated weights for policy 0, policy_version 33077 (0.0009) [2023-12-25 23:50:09,067][123091] Updated weights for policy 0, policy_version 33087 (0.0010) [2023-12-25 23:50:09,552][123090] Updated weights for policy 1, policy_version 33410 (0.0009) [2023-12-25 23:50:09,614][123090] Updated weights for policy 1, policy_version 33420 (0.0010) [2023-12-25 23:50:09,679][123090] Updated weights for policy 1, policy_version 33430 (0.0010) [2023-12-25 23:50:09,735][123090] Updated weights for policy 1, policy_version 33440 (0.0009) [2023-12-25 23:50:09,920][123091] Updated weights for policy 0, policy_version 33097 (0.0010) [2023-12-25 23:50:09,991][123091] Updated weights for policy 0, policy_version 33107 (0.0007) [2023-12-25 23:50:10,059][123091] Updated weights for policy 0, policy_version 33117 (0.0006) [2023-12-25 23:50:10,577][123090] Updated weights for policy 1, policy_version 33450 (0.0009) [2023-12-25 23:50:10,626][123090] Updated weights for policy 1, policy_version 33460 (0.0009) [2023-12-25 23:50:10,676][123090] Updated weights for policy 1, policy_version 33470 (0.0009) [2023-12-25 23:50:10,892][123091] Updated weights for policy 0, policy_version 33127 (0.0010) [2023-12-25 23:50:10,942][123091] Updated weights for policy 0, policy_version 33137 (0.0010) [2023-12-25 23:50:11,000][123091] Updated weights for policy 0, policy_version 33147 (0.0009) [2023-12-25 23:50:11,620][123090] Updated weights for policy 1, policy_version 33480 (0.0008) [2023-12-25 23:50:11,691][123090] Updated weights for policy 1, policy_version 33490 (0.0006) [2023-12-25 23:50:11,759][123090] Updated weights for policy 1, policy_version 33500 (0.0008) [2023-12-25 23:50:11,863][123091] Updated weights for policy 0, policy_version 33157 (0.0011) [2023-12-25 23:50:11,923][123091] Updated weights for policy 0, policy_version 33167 (0.0011) [2023-12-25 23:50:11,975][123091] Updated weights for policy 0, policy_version 33177 (0.0011) [2023-12-25 23:50:12,594][123090] Updated weights for policy 1, policy_version 33510 (0.0010) [2023-12-25 23:50:12,646][123090] Updated weights for policy 1, policy_version 33520 (0.0010) [2023-12-25 23:50:12,717][123090] Updated weights for policy 1, policy_version 33530 (0.0006) [2023-12-25 23:50:12,790][123091] Updated weights for policy 0, policy_version 33187 (0.0009) [2023-12-25 23:50:12,843][123091] Updated weights for policy 0, policy_version 33197 (0.0006) [2023-12-25 23:50:12,910][123091] Updated weights for policy 0, policy_version 33207 (0.0006) [2023-12-25 23:50:13,354][123090] Updated weights for policy 1, policy_version 33540 (0.0007) [2023-12-25 23:50:13,416][123090] Updated weights for policy 1, policy_version 33550 (0.0009) [2023-12-25 23:50:13,465][123090] Updated weights for policy 1, policy_version 33560 (0.0009) [2023-12-25 23:50:13,613][123091] Updated weights for policy 0, policy_version 33217 (0.0006) [2023-12-25 23:50:13,681][123091] Updated weights for policy 0, policy_version 33227 (0.0010) [2023-12-25 23:50:13,751][123091] Updated weights for policy 0, policy_version 33237 (0.0009) [2023-12-25 23:50:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 17096704. Throughput: 0: 8528.0, 1: 8884.3. Samples: 17091108. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-25 23:50:13,785][121949] Avg episode reward: [(0, '4257.397'), (1, '4537.454')] [2023-12-25 23:50:13,820][123091] Updated weights for policy 0, policy_version 33247 (0.0009) [2023-12-25 23:50:14,143][123090] Updated weights for policy 1, policy_version 33570 (0.0008) [2023-12-25 23:50:14,193][123090] Updated weights for policy 1, policy_version 33580 (0.0009) [2023-12-25 23:50:14,242][123090] Updated weights for policy 1, policy_version 33590 (0.0009) [2023-12-25 23:50:14,289][123090] Updated weights for policy 1, policy_version 33600 (0.0009) [2023-12-25 23:50:14,638][123091] Updated weights for policy 0, policy_version 33257 (0.0006) [2023-12-25 23:50:14,710][123091] Updated weights for policy 0, policy_version 33267 (0.0006) [2023-12-25 23:50:14,777][123091] Updated weights for policy 0, policy_version 33277 (0.0008) [2023-12-25 23:50:15,143][123090] Updated weights for policy 1, policy_version 33610 (0.0009) [2023-12-25 23:50:15,209][123090] Updated weights for policy 1, policy_version 33620 (0.0007) [2023-12-25 23:50:15,277][123090] Updated weights for policy 1, policy_version 33630 (0.0010) [2023-12-25 23:50:15,492][123091] Updated weights for policy 0, policy_version 33287 (0.0010) [2023-12-25 23:50:15,563][123091] Updated weights for policy 0, policy_version 33297 (0.0011) [2023-12-25 23:50:15,627][123091] Updated weights for policy 0, policy_version 33307 (0.0011) [2023-12-25 23:50:15,986][123090] Updated weights for policy 1, policy_version 33640 (0.0006) [2023-12-25 23:50:16,034][123090] Updated weights for policy 1, policy_version 33650 (0.0006) [2023-12-25 23:50:16,080][123090] Updated weights for policy 1, policy_version 33660 (0.0005) [2023-12-25 23:50:16,440][123091] Updated weights for policy 0, policy_version 33317 (0.0011) [2023-12-25 23:50:16,496][123091] Updated weights for policy 0, policy_version 33327 (0.0010) [2023-12-25 23:50:16,554][123091] Updated weights for policy 0, policy_version 33337 (0.0011) [2023-12-25 23:50:16,864][123090] Updated weights for policy 1, policy_version 33670 (0.0007) [2023-12-25 23:50:16,928][123090] Updated weights for policy 1, policy_version 33680 (0.0010) [2023-12-25 23:50:16,986][123090] Updated weights for policy 1, policy_version 33690 (0.0008) [2023-12-25 23:50:17,246][123091] Updated weights for policy 0, policy_version 33347 (0.0009) [2023-12-25 23:50:17,303][123091] Updated weights for policy 0, policy_version 33357 (0.0005) [2023-12-25 23:50:17,358][123091] Updated weights for policy 0, policy_version 33367 (0.0005) [2023-12-25 23:50:17,786][123090] Updated weights for policy 1, policy_version 33700 (0.0009) [2023-12-25 23:50:17,837][123090] Updated weights for policy 1, policy_version 33710 (0.0010) [2023-12-25 23:50:17,888][123090] Updated weights for policy 1, policy_version 33720 (0.0010) [2023-12-25 23:50:18,056][123091] Updated weights for policy 0, policy_version 33377 (0.0005) [2023-12-25 23:50:18,110][123091] Updated weights for policy 0, policy_version 33387 (0.0005) [2023-12-25 23:50:18,155][123091] Updated weights for policy 0, policy_version 33397 (0.0005) [2023-12-25 23:50:18,202][123091] Updated weights for policy 0, policy_version 33407 (0.0006) [2023-12-25 23:50:18,733][123090] Updated weights for policy 1, policy_version 33730 (0.0010) [2023-12-25 23:50:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 17186816. Throughput: 0: 8623.0, 1: 8950.8. Samples: 17203844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-25 23:50:18,785][121949] Avg episode reward: [(0, '4247.452'), (1, '4536.817')] [2023-12-25 23:50:18,793][123090] Updated weights for policy 1, policy_version 33740 (0.0010) [2023-12-25 23:50:18,848][123090] Updated weights for policy 1, policy_version 33750 (0.0010) [2023-12-25 23:50:18,911][123090] Updated weights for policy 1, policy_version 33760 (0.0010) [2023-12-25 23:50:18,945][123091] Updated weights for policy 0, policy_version 33417 (0.0010) [2023-12-25 23:50:19,005][123091] Updated weights for policy 0, policy_version 33427 (0.0011) [2023-12-25 23:50:19,061][123091] Updated weights for policy 0, policy_version 33437 (0.0010) [2023-12-25 23:50:19,753][123090] Updated weights for policy 1, policy_version 33770 (0.0010) [2023-12-25 23:50:19,817][123090] Updated weights for policy 1, policy_version 33780 (0.0010) [2023-12-25 23:50:19,868][123091] Updated weights for policy 0, policy_version 33447 (0.0011) [2023-12-25 23:50:19,886][123090] Updated weights for policy 1, policy_version 33790 (0.0010) [2023-12-25 23:50:19,938][123091] Updated weights for policy 0, policy_version 33457 (0.0010) [2023-12-25 23:50:19,995][123091] Updated weights for policy 0, policy_version 33467 (0.0011) [2023-12-25 23:50:20,737][123090] Updated weights for policy 1, policy_version 33800 (0.0011) [2023-12-25 23:50:20,741][123091] Updated weights for policy 0, policy_version 33477 (0.0010) [2023-12-25 23:50:20,795][123091] Updated weights for policy 0, policy_version 33487 (0.0008) [2023-12-25 23:50:20,805][123090] Updated weights for policy 1, policy_version 33810 (0.0010) [2023-12-25 23:50:20,850][123091] Updated weights for policy 0, policy_version 33497 (0.0006) [2023-12-25 23:50:20,869][123090] Updated weights for policy 1, policy_version 33820 (0.0010) [2023-12-25 23:50:21,682][123091] Updated weights for policy 0, policy_version 33507 (0.0007) [2023-12-25 23:50:21,719][123090] Updated weights for policy 1, policy_version 33830 (0.0009) [2023-12-25 23:50:21,751][123091] Updated weights for policy 0, policy_version 33517 (0.0009) [2023-12-25 23:50:21,784][123090] Updated weights for policy 1, policy_version 33840 (0.0011) [2023-12-25 23:50:21,812][123091] Updated weights for policy 0, policy_version 33527 (0.0006) [2023-12-25 23:50:21,844][123090] Updated weights for policy 1, policy_version 33850 (0.0011) [2023-12-25 23:50:22,644][123091] Updated weights for policy 0, policy_version 33537 (0.0006) [2023-12-25 23:50:22,681][123090] Updated weights for policy 1, policy_version 33860 (0.0011) [2023-12-25 23:50:22,696][123091] Updated weights for policy 0, policy_version 33547 (0.0010) [2023-12-25 23:50:22,737][123090] Updated weights for policy 1, policy_version 33870 (0.0010) [2023-12-25 23:50:22,745][123091] Updated weights for policy 0, policy_version 33557 (0.0007) [2023-12-25 23:50:22,785][123090] Updated weights for policy 1, policy_version 33880 (0.0010) [2023-12-25 23:50:22,797][123091] Updated weights for policy 0, policy_version 33567 (0.0007) [2023-12-25 23:50:23,621][123090] Updated weights for policy 1, policy_version 33890 (0.0010) [2023-12-25 23:50:23,666][123091] Updated weights for policy 0, policy_version 33577 (0.0007) [2023-12-25 23:50:23,672][123090] Updated weights for policy 1, policy_version 33900 (0.0010) [2023-12-25 23:50:23,724][123090] Updated weights for policy 1, policy_version 33910 (0.0010) [2023-12-25 23:50:23,730][123091] Updated weights for policy 0, policy_version 33587 (0.0006) [2023-12-25 23:50:23,772][123090] Updated weights for policy 1, policy_version 33920 (0.0010) [2023-12-25 23:50:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 17276928. Throughput: 0: 8601.4, 1: 8934.5. Samples: 17255464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-25 23:50:23,784][121949] Avg episode reward: [(0, '4210.078'), (1, '4534.303')] [2023-12-25 23:50:23,787][123091] Updated weights for policy 0, policy_version 33597 (0.0006) [2023-12-25 23:50:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000033920_8683520.pth... [2023-12-25 23:50:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000032864_8413184.pth [2023-12-25 23:50:23,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000033600_8601600.pth... [2023-12-25 23:50:23,809][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000032576_8339456.pth [2023-12-25 23:50:24,608][123091] Updated weights for policy 0, policy_version 33607 (0.0008) [2023-12-25 23:50:24,643][123090] Updated weights for policy 1, policy_version 33930 (0.0010) [2023-12-25 23:50:24,662][123091] Updated weights for policy 0, policy_version 33617 (0.0007) [2023-12-25 23:50:24,702][123090] Updated weights for policy 1, policy_version 33940 (0.0010) [2023-12-25 23:50:24,707][123091] Updated weights for policy 0, policy_version 33627 (0.0009) [2023-12-25 23:50:24,768][123090] Updated weights for policy 1, policy_version 33950 (0.0010) [2023-12-25 23:50:25,502][123091] Updated weights for policy 0, policy_version 33637 (0.0005) [2023-12-25 23:50:25,518][123090] Updated weights for policy 1, policy_version 33960 (0.0006) [2023-12-25 23:50:25,567][123091] Updated weights for policy 0, policy_version 33647 (0.0005) [2023-12-25 23:50:25,581][123090] Updated weights for policy 1, policy_version 33970 (0.0005) [2023-12-25 23:50:25,642][123091] Updated weights for policy 0, policy_version 33657 (0.0005) [2023-12-25 23:50:25,644][123090] Updated weights for policy 1, policy_version 33980 (0.0005) [2023-12-25 23:50:26,256][123090] Updated weights for policy 1, policy_version 33990 (0.0005) [2023-12-25 23:50:26,288][123091] Updated weights for policy 0, policy_version 33667 (0.0006) [2023-12-25 23:50:26,314][123090] Updated weights for policy 1, policy_version 34000 (0.0005) [2023-12-25 23:50:26,349][123091] Updated weights for policy 0, policy_version 33677 (0.0008) [2023-12-25 23:50:26,371][123090] Updated weights for policy 1, policy_version 34010 (0.0005) [2023-12-25 23:50:26,405][123091] Updated weights for policy 0, policy_version 33687 (0.0005) [2023-12-25 23:50:27,044][123090] Updated weights for policy 1, policy_version 34020 (0.0006) [2023-12-25 23:50:27,106][123090] Updated weights for policy 1, policy_version 34030 (0.0005) [2023-12-25 23:50:27,115][123091] Updated weights for policy 0, policy_version 33697 (0.0006) [2023-12-25 23:50:27,150][123090] Updated weights for policy 1, policy_version 34040 (0.0005) [2023-12-25 23:50:27,188][123091] Updated weights for policy 0, policy_version 33707 (0.0007) [2023-12-25 23:50:27,263][123091] Updated weights for policy 0, policy_version 33717 (0.0009) [2023-12-25 23:50:27,330][123091] Updated weights for policy 0, policy_version 33727 (0.0010) [2023-12-25 23:50:27,871][123090] Updated weights for policy 1, policy_version 34050 (0.0005) [2023-12-25 23:50:27,937][123090] Updated weights for policy 1, policy_version 34060 (0.0005) [2023-12-25 23:50:28,007][123090] Updated weights for policy 1, policy_version 34070 (0.0008) [2023-12-25 23:50:28,059][123091] Updated weights for policy 0, policy_version 33737 (0.0006) [2023-12-25 23:50:28,067][123090] Updated weights for policy 1, policy_version 34080 (0.0009) [2023-12-25 23:50:28,109][123091] Updated weights for policy 0, policy_version 33747 (0.0005) [2023-12-25 23:50:28,166][123091] Updated weights for policy 0, policy_version 33757 (0.0006) [2023-12-25 23:50:28,759][123090] Updated weights for policy 1, policy_version 34090 (0.0010) [2023-12-25 23:50:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 17367040. Throughput: 0: 8525.4, 1: 9074.1. Samples: 17363636. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-25 23:50:28,785][121949] Avg episode reward: [(0, '4311.975'), (1, '4555.090')] [2023-12-25 23:50:28,785][123007] Saving new best policy, reward=4311.975! [2023-12-25 23:50:28,820][123090] Updated weights for policy 1, policy_version 34100 (0.0009) [2023-12-25 23:50:28,874][123090] Updated weights for policy 1, policy_version 34110 (0.0010) [2023-12-25 23:50:28,883][123008] Saving new best policy, reward=4555.090! [2023-12-25 23:50:28,961][123091] Updated weights for policy 0, policy_version 33767 (0.0008) [2023-12-25 23:50:29,013][123091] Updated weights for policy 0, policy_version 33777 (0.0010) [2023-12-25 23:50:29,076][123091] Updated weights for policy 0, policy_version 33787 (0.0008) [2023-12-25 23:50:29,703][123090] Updated weights for policy 1, policy_version 34120 (0.0009) [2023-12-25 23:50:29,768][123090] Updated weights for policy 1, policy_version 34130 (0.0010) [2023-12-25 23:50:29,828][123090] Updated weights for policy 1, policy_version 34140 (0.0010) [2023-12-25 23:50:29,939][123091] Updated weights for policy 0, policy_version 33797 (0.0009) [2023-12-25 23:50:30,000][123091] Updated weights for policy 0, policy_version 33807 (0.0009) [2023-12-25 23:50:30,063][123091] Updated weights for policy 0, policy_version 33817 (0.0010) [2023-12-25 23:50:30,659][123090] Updated weights for policy 1, policy_version 34150 (0.0007) [2023-12-25 23:50:30,713][123090] Updated weights for policy 1, policy_version 34160 (0.0005) [2023-12-25 23:50:30,730][123091] Updated weights for policy 0, policy_version 33827 (0.0008) [2023-12-25 23:50:30,766][123090] Updated weights for policy 1, policy_version 34170 (0.0005) [2023-12-25 23:50:30,796][123091] Updated weights for policy 0, policy_version 33837 (0.0006) [2023-12-25 23:50:30,872][123091] Updated weights for policy 0, policy_version 33847 (0.0006) [2023-12-25 23:50:31,492][123090] Updated weights for policy 1, policy_version 34180 (0.0005) [2023-12-25 23:50:31,554][123090] Updated weights for policy 1, policy_version 34190 (0.0008) [2023-12-25 23:50:31,625][123090] Updated weights for policy 1, policy_version 34200 (0.0013) [2023-12-25 23:50:31,707][123091] Updated weights for policy 0, policy_version 33857 (0.0011) [2023-12-25 23:50:31,771][123091] Updated weights for policy 0, policy_version 33867 (0.0009) [2023-12-25 23:50:31,820][123091] Updated weights for policy 0, policy_version 33877 (0.0009) [2023-12-25 23:50:31,868][123091] Updated weights for policy 0, policy_version 33887 (0.0009) [2023-12-25 23:50:32,430][123090] Updated weights for policy 1, policy_version 34210 (0.0011) [2023-12-25 23:50:32,500][123090] Updated weights for policy 1, policy_version 34220 (0.0010) [2023-12-25 23:50:32,567][123090] Updated weights for policy 1, policy_version 34230 (0.0010) [2023-12-25 23:50:32,634][123090] Updated weights for policy 1, policy_version 34240 (0.0010) [2023-12-25 23:50:32,725][123091] Updated weights for policy 0, policy_version 33897 (0.0009) [2023-12-25 23:50:32,780][123091] Updated weights for policy 0, policy_version 33907 (0.0009) [2023-12-25 23:50:32,840][123091] Updated weights for policy 0, policy_version 33917 (0.0009) [2023-12-25 23:50:33,423][123090] Updated weights for policy 1, policy_version 34250 (0.0010) [2023-12-25 23:50:33,470][123090] Updated weights for policy 1, policy_version 34260 (0.0010) [2023-12-25 23:50:33,521][123090] Updated weights for policy 1, policy_version 34270 (0.0010) [2023-12-25 23:50:33,640][123091] Updated weights for policy 0, policy_version 33927 (0.0007) [2023-12-25 23:50:33,692][123091] Updated weights for policy 0, policy_version 33937 (0.0008) [2023-12-25 23:50:33,735][123091] Updated weights for policy 0, policy_version 33947 (0.0010) [2023-12-25 23:50:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 17465344. Throughput: 0: 8623.7, 1: 9063.3. Samples: 17471032. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-25 23:50:33,784][121949] Avg episode reward: [(0, '4349.492'), (1, '4455.773')] [2023-12-25 23:50:33,785][123007] Saving new best policy, reward=4349.492! [2023-12-25 23:50:34,334][123090] Updated weights for policy 1, policy_version 34280 (0.0009) [2023-12-25 23:50:34,399][123090] Updated weights for policy 1, policy_version 34290 (0.0010) [2023-12-25 23:50:34,424][123091] Updated weights for policy 0, policy_version 33957 (0.0008) [2023-12-25 23:50:34,468][123090] Updated weights for policy 1, policy_version 34300 (0.0010) [2023-12-25 23:50:34,490][123091] Updated weights for policy 0, policy_version 33967 (0.0007) [2023-12-25 23:50:34,555][123091] Updated weights for policy 0, policy_version 33977 (0.0009) [2023-12-25 23:50:35,236][123091] Updated weights for policy 0, policy_version 33987 (0.0006) [2023-12-25 23:50:35,296][123091] Updated weights for policy 0, policy_version 33997 (0.0005) [2023-12-25 23:50:35,364][123091] Updated weights for policy 0, policy_version 34007 (0.0006) [2023-12-25 23:50:35,394][123090] Updated weights for policy 1, policy_version 34310 (0.0010) [2023-12-25 23:50:35,456][123090] Updated weights for policy 1, policy_version 34320 (0.0009) [2023-12-25 23:50:35,510][123090] Updated weights for policy 1, policy_version 34330 (0.0010) [2023-12-25 23:50:35,928][123091] Updated weights for policy 0, policy_version 34017 (0.0006) [2023-12-25 23:50:35,982][123091] Updated weights for policy 0, policy_version 34027 (0.0005) [2023-12-25 23:50:36,032][123091] Updated weights for policy 0, policy_version 34037 (0.0009) [2023-12-25 23:50:36,090][123091] Updated weights for policy 0, policy_version 34047 (0.0010) [2023-12-25 23:50:36,364][123090] Updated weights for policy 1, policy_version 34341 (0.0008) [2023-12-25 23:50:36,439][123090] Updated weights for policy 1, policy_version 34351 (0.0006) [2023-12-25 23:50:36,511][123090] Updated weights for policy 1, policy_version 34361 (0.0009) [2023-12-25 23:50:36,948][123091] Updated weights for policy 0, policy_version 34057 (0.0011) [2023-12-25 23:50:37,000][123091] Updated weights for policy 0, policy_version 34067 (0.0011) [2023-12-25 23:50:37,051][123091] Updated weights for policy 0, policy_version 34077 (0.0010) [2023-12-25 23:50:37,302][123090] Updated weights for policy 1, policy_version 34371 (0.0011) [2023-12-25 23:50:37,350][123090] Updated weights for policy 1, policy_version 34381 (0.0010) [2023-12-25 23:50:37,401][123090] Updated weights for policy 1, policy_version 34391 (0.0010) [2023-12-25 23:50:37,896][123091] Updated weights for policy 0, policy_version 34087 (0.0007) [2023-12-25 23:50:37,959][123091] Updated weights for policy 0, policy_version 34097 (0.0009) [2023-12-25 23:50:38,007][123091] Updated weights for policy 0, policy_version 34107 (0.0010) [2023-12-25 23:50:38,190][123090] Updated weights for policy 1, policy_version 34401 (0.0010) [2023-12-25 23:50:38,259][123090] Updated weights for policy 1, policy_version 34411 (0.0009) [2023-12-25 23:50:38,327][123090] Updated weights for policy 1, policy_version 34421 (0.0009) [2023-12-25 23:50:38,391][123090] Updated weights for policy 1, policy_version 34431 (0.0009) [2023-12-25 23:50:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 17547264. Throughput: 0: 8761.0, 1: 9000.5. Samples: 17525748. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-25 23:50:38,785][121949] Avg episode reward: [(0, '4316.504'), (1, '4440.385')] [2023-12-25 23:50:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000034432_8814592.pth... [2023-12-25 23:50:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000033408_8552448.pth [2023-12-25 23:50:38,818][123091] Updated weights for policy 0, policy_version 34117 (0.0008) [2023-12-25 23:50:38,886][123091] Updated weights for policy 0, policy_version 34127 (0.0008) [2023-12-25 23:50:38,956][123091] Updated weights for policy 0, policy_version 34137 (0.0009) [2023-12-25 23:50:39,008][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000034144_8740864.pth... [2023-12-25 23:50:39,013][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000033056_8462336.pth [2023-12-25 23:50:39,172][123090] Updated weights for policy 1, policy_version 34441 (0.0010) [2023-12-25 23:50:39,240][123090] Updated weights for policy 1, policy_version 34451 (0.0011) [2023-12-25 23:50:39,310][123090] Updated weights for policy 1, policy_version 34461 (0.0010) [2023-12-25 23:50:39,718][123091] Updated weights for policy 0, policy_version 34147 (0.0007) [2023-12-25 23:50:39,791][123091] Updated weights for policy 0, policy_version 34157 (0.0008) [2023-12-25 23:50:39,860][123091] Updated weights for policy 0, policy_version 34167 (0.0009) [2023-12-25 23:50:40,166][123090] Updated weights for policy 1, policy_version 34471 (0.0011) [2023-12-25 23:50:40,222][123090] Updated weights for policy 1, policy_version 34481 (0.0010) [2023-12-25 23:50:40,278][123090] Updated weights for policy 1, policy_version 34491 (0.0010) [2023-12-25 23:50:40,648][123091] Updated weights for policy 0, policy_version 34177 (0.0011) [2023-12-25 23:50:40,720][123091] Updated weights for policy 0, policy_version 34187 (0.0006) [2023-12-25 23:50:40,784][123091] Updated weights for policy 0, policy_version 34197 (0.0005) [2023-12-25 23:50:40,848][123091] Updated weights for policy 0, policy_version 34207 (0.0005) [2023-12-25 23:50:41,146][123090] Updated weights for policy 1, policy_version 34501 (0.0011) [2023-12-25 23:50:41,211][123090] Updated weights for policy 1, policy_version 34511 (0.0011) [2023-12-25 23:50:41,282][123090] Updated weights for policy 1, policy_version 34521 (0.0011) [2023-12-25 23:50:41,564][123091] Updated weights for policy 0, policy_version 34217 (0.0006) [2023-12-25 23:50:41,632][123091] Updated weights for policy 0, policy_version 34227 (0.0008) [2023-12-25 23:50:41,698][123091] Updated weights for policy 0, policy_version 34237 (0.0009) [2023-12-25 23:50:42,124][123090] Updated weights for policy 1, policy_version 34531 (0.0011) [2023-12-25 23:50:42,191][123090] Updated weights for policy 1, policy_version 34541 (0.0010) [2023-12-25 23:50:42,266][123090] Updated weights for policy 1, policy_version 34551 (0.0010) [2023-12-25 23:50:42,515][123091] Updated weights for policy 0, policy_version 34247 (0.0009) [2023-12-25 23:50:42,585][123091] Updated weights for policy 0, policy_version 34257 (0.0008) [2023-12-25 23:50:42,647][123091] Updated weights for policy 0, policy_version 34267 (0.0008) [2023-12-25 23:50:43,072][123090] Updated weights for policy 1, policy_version 34561 (0.0009) [2023-12-25 23:50:43,132][123090] Updated weights for policy 1, policy_version 34571 (0.0010) [2023-12-25 23:50:43,195][123090] Updated weights for policy 1, policy_version 34581 (0.0010) [2023-12-25 23:50:43,258][123090] Updated weights for policy 1, policy_version 34591 (0.0011) [2023-12-25 23:50:43,396][123091] Updated weights for policy 0, policy_version 34277 (0.0007) [2023-12-25 23:50:43,457][123091] Updated weights for policy 0, policy_version 34287 (0.0005) [2023-12-25 23:50:43,508][123091] Updated weights for policy 0, policy_version 34297 (0.0006) [2023-12-25 23:50:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 17637376. Throughput: 0: 8862.8, 1: 8840.1. Samples: 17629996. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-25 23:50:43,785][121949] Avg episode reward: [(0, '4248.618'), (1, '4505.955')] [2023-12-25 23:50:43,979][123090] Updated weights for policy 1, policy_version 34601 (0.0010) [2023-12-25 23:50:44,041][123090] Updated weights for policy 1, policy_version 34611 (0.0010) [2023-12-25 23:50:44,092][123090] Updated weights for policy 1, policy_version 34621 (0.0010) [2023-12-25 23:50:44,105][123091] Updated weights for policy 0, policy_version 34307 (0.0007) [2023-12-25 23:50:44,168][123091] Updated weights for policy 0, policy_version 34317 (0.0011) [2023-12-25 23:50:44,233][123091] Updated weights for policy 0, policy_version 34327 (0.0010) [2023-12-25 23:50:44,787][123090] Updated weights for policy 1, policy_version 34631 (0.0009) [2023-12-25 23:50:44,855][123090] Updated weights for policy 1, policy_version 34641 (0.0011) [2023-12-25 23:50:44,919][123090] Updated weights for policy 1, policy_version 34651 (0.0011) [2023-12-25 23:50:45,025][123091] Updated weights for policy 0, policy_version 34337 (0.0010) [2023-12-25 23:50:45,086][123091] Updated weights for policy 0, policy_version 34347 (0.0006) [2023-12-25 23:50:45,150][123091] Updated weights for policy 0, policy_version 34357 (0.0006) [2023-12-25 23:50:45,216][123091] Updated weights for policy 0, policy_version 34367 (0.0008) [2023-12-25 23:50:45,756][123090] Updated weights for policy 1, policy_version 34661 (0.0010) [2023-12-25 23:50:45,823][123090] Updated weights for policy 1, policy_version 34671 (0.0011) [2023-12-25 23:50:45,886][123090] Updated weights for policy 1, policy_version 34681 (0.0010) [2023-12-25 23:50:45,960][123091] Updated weights for policy 0, policy_version 34377 (0.0008) [2023-12-25 23:50:46,017][123091] Updated weights for policy 0, policy_version 34387 (0.0008) [2023-12-25 23:50:46,069][123091] Updated weights for policy 0, policy_version 34397 (0.0009) [2023-12-25 23:50:46,752][123090] Updated weights for policy 1, policy_version 34691 (0.0010) [2023-12-25 23:50:46,810][123091] Updated weights for policy 0, policy_version 34407 (0.0010) [2023-12-25 23:50:46,811][123090] Updated weights for policy 1, policy_version 34701 (0.0009) [2023-12-25 23:50:46,861][123091] Updated weights for policy 0, policy_version 34417 (0.0010) [2023-12-25 23:50:46,874][123090] Updated weights for policy 1, policy_version 34711 (0.0006) [2023-12-25 23:50:46,921][123091] Updated weights for policy 0, policy_version 34427 (0.0011) [2023-12-25 23:50:47,695][123090] Updated weights for policy 1, policy_version 34721 (0.0006) [2023-12-25 23:50:47,749][123091] Updated weights for policy 0, policy_version 34437 (0.0008) [2023-12-25 23:50:47,760][123090] Updated weights for policy 1, policy_version 34731 (0.0008) [2023-12-25 23:50:47,803][123091] Updated weights for policy 0, policy_version 34447 (0.0006) [2023-12-25 23:50:47,823][123090] Updated weights for policy 1, policy_version 34741 (0.0009) [2023-12-25 23:50:47,869][123091] Updated weights for policy 0, policy_version 34457 (0.0006) [2023-12-25 23:50:47,887][123090] Updated weights for policy 1, policy_version 34751 (0.0009) [2023-12-25 23:50:48,543][123091] Updated weights for policy 0, policy_version 34467 (0.0005) [2023-12-25 23:50:48,602][123091] Updated weights for policy 0, policy_version 34477 (0.0005) [2023-12-25 23:50:48,662][123091] Updated weights for policy 0, policy_version 34487 (0.0009) [2023-12-25 23:50:48,757][123090] Updated weights for policy 1, policy_version 34761 (0.0009) [2023-12-25 23:50:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 17727488. Throughput: 0: 8987.8, 1: 8813.3. Samples: 17738688. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-25 23:50:48,785][121949] Avg episode reward: [(0, '4209.216'), (1, '4555.644')] [2023-12-25 23:50:48,814][123090] Updated weights for policy 1, policy_version 34771 (0.0010) [2023-12-25 23:50:48,867][123090] Updated weights for policy 1, policy_version 34781 (0.0009) [2023-12-25 23:50:48,879][123008] Saving new best policy, reward=4555.644! [2023-12-25 23:50:49,393][123091] Updated weights for policy 0, policy_version 34497 (0.0009) [2023-12-25 23:50:49,454][123091] Updated weights for policy 0, policy_version 34507 (0.0006) [2023-12-25 23:50:49,511][123091] Updated weights for policy 0, policy_version 34517 (0.0005) [2023-12-25 23:50:49,570][123091] Updated weights for policy 0, policy_version 34527 (0.0006) [2023-12-25 23:50:49,842][123090] Updated weights for policy 1, policy_version 34791 (0.0010) [2023-12-25 23:50:49,899][123090] Updated weights for policy 1, policy_version 34801 (0.0009) [2023-12-25 23:50:49,964][123090] Updated weights for policy 1, policy_version 34811 (0.0009) [2023-12-25 23:50:50,320][123091] Updated weights for policy 0, policy_version 34537 (0.0010) [2023-12-25 23:50:50,371][123091] Updated weights for policy 0, policy_version 34547 (0.0010) [2023-12-25 23:50:50,424][123091] Updated weights for policy 0, policy_version 34557 (0.0008) [2023-12-25 23:50:50,797][123090] Updated weights for policy 1, policy_version 34821 (0.0007) [2023-12-25 23:50:50,862][123090] Updated weights for policy 1, policy_version 34831 (0.0005) [2023-12-25 23:50:50,920][123090] Updated weights for policy 1, policy_version 34841 (0.0005) [2023-12-25 23:50:51,170][123091] Updated weights for policy 0, policy_version 34567 (0.0006) [2023-12-25 23:50:51,250][123091] Updated weights for policy 0, policy_version 34577 (0.0009) [2023-12-25 23:50:51,315][123091] Updated weights for policy 0, policy_version 34587 (0.0010) [2023-12-25 23:50:51,705][123090] Updated weights for policy 1, policy_version 34851 (0.0006) [2023-12-25 23:50:51,773][123090] Updated weights for policy 1, policy_version 34861 (0.0010) [2023-12-25 23:50:51,837][123090] Updated weights for policy 1, policy_version 34871 (0.0010) [2023-12-25 23:50:52,142][123091] Updated weights for policy 0, policy_version 34597 (0.0009) [2023-12-25 23:50:52,194][123091] Updated weights for policy 0, policy_version 34607 (0.0009) [2023-12-25 23:50:52,263][123091] Updated weights for policy 0, policy_version 34617 (0.0009) [2023-12-25 23:50:52,669][123090] Updated weights for policy 1, policy_version 34881 (0.0010) [2023-12-25 23:50:52,733][123090] Updated weights for policy 1, policy_version 34891 (0.0009) [2023-12-25 23:50:52,789][123090] Updated weights for policy 1, policy_version 34901 (0.0009) [2023-12-25 23:50:52,846][123090] Updated weights for policy 1, policy_version 34911 (0.0009) [2023-12-25 23:50:53,117][123091] Updated weights for policy 0, policy_version 34627 (0.0009) [2023-12-25 23:50:53,168][123091] Updated weights for policy 0, policy_version 34637 (0.0008) [2023-12-25 23:50:53,215][123091] Updated weights for policy 0, policy_version 34647 (0.0008) [2023-12-25 23:50:53,641][123090] Updated weights for policy 1, policy_version 34921 (0.0006) [2023-12-25 23:50:53,712][123090] Updated weights for policy 1, policy_version 34931 (0.0008) [2023-12-25 23:50:53,778][123090] Updated weights for policy 1, policy_version 34941 (0.0010) [2023-12-25 23:50:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 17809408. Throughput: 0: 9054.5, 1: 8789.6. Samples: 17791568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:50:53,784][121949] Avg episode reward: [(0, '4140.307'), (1, '4590.999')] [2023-12-25 23:50:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000034656_8871936.pth... [2023-12-25 23:50:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000034944_8945664.pth... [2023-12-25 23:50:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000033600_8601600.pth [2023-12-25 23:50:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000033920_8683520.pth [2023-12-25 23:50:53,797][123008] Saving new best policy, reward=4590.999! [2023-12-25 23:50:54,099][123091] Updated weights for policy 0, policy_version 34657 (0.0009) [2023-12-25 23:50:54,164][123091] Updated weights for policy 0, policy_version 34667 (0.0008) [2023-12-25 23:50:54,225][123091] Updated weights for policy 0, policy_version 34677 (0.0010) [2023-12-25 23:50:54,287][123091] Updated weights for policy 0, policy_version 34687 (0.0009) [2023-12-25 23:50:54,409][123090] Updated weights for policy 1, policy_version 34951 (0.0007) [2023-12-25 23:50:54,463][123090] Updated weights for policy 1, policy_version 34961 (0.0005) [2023-12-25 23:50:54,524][123090] Updated weights for policy 1, policy_version 34971 (0.0005) [2023-12-25 23:50:55,160][123090] Updated weights for policy 1, policy_version 34981 (0.0008) [2023-12-25 23:50:55,163][123091] Updated weights for policy 0, policy_version 34697 (0.0008) [2023-12-25 23:50:55,208][123090] Updated weights for policy 1, policy_version 34991 (0.0010) [2023-12-25 23:50:55,227][123091] Updated weights for policy 0, policy_version 34707 (0.0009) [2023-12-25 23:50:55,259][123090] Updated weights for policy 1, policy_version 35001 (0.0010) [2023-12-25 23:50:55,283][123091] Updated weights for policy 0, policy_version 34717 (0.0006) [2023-12-25 23:50:56,074][123090] Updated weights for policy 1, policy_version 35011 (0.0009) [2023-12-25 23:50:56,135][123091] Updated weights for policy 0, policy_version 34727 (0.0007) [2023-12-25 23:50:56,140][123090] Updated weights for policy 1, policy_version 35021 (0.0007) [2023-12-25 23:50:56,198][123090] Updated weights for policy 1, policy_version 35031 (0.0007) [2023-12-25 23:50:56,200][123091] Updated weights for policy 0, policy_version 34737 (0.0008) [2023-12-25 23:50:56,261][123091] Updated weights for policy 0, policy_version 34747 (0.0007) [2023-12-25 23:50:56,897][123090] Updated weights for policy 1, policy_version 35041 (0.0007) [2023-12-25 23:50:56,947][123090] Updated weights for policy 1, policy_version 35051 (0.0005) [2023-12-25 23:50:56,993][123090] Updated weights for policy 1, policy_version 35061 (0.0005) [2023-12-25 23:50:57,044][123091] Updated weights for policy 0, policy_version 34757 (0.0007) [2023-12-25 23:50:57,047][123090] Updated weights for policy 1, policy_version 35071 (0.0007) [2023-12-25 23:50:57,116][123091] Updated weights for policy 0, policy_version 34767 (0.0008) [2023-12-25 23:50:57,178][123091] Updated weights for policy 0, policy_version 34777 (0.0009) [2023-12-25 23:50:57,805][123090] Updated weights for policy 1, policy_version 35081 (0.0006) [2023-12-25 23:50:57,856][123090] Updated weights for policy 1, policy_version 35091 (0.0005) [2023-12-25 23:50:57,906][123090] Updated weights for policy 1, policy_version 35101 (0.0008) [2023-12-25 23:50:58,001][123091] Updated weights for policy 0, policy_version 34787 (0.0010) [2023-12-25 23:50:58,061][123091] Updated weights for policy 0, policy_version 34797 (0.0010) [2023-12-25 23:50:58,131][123091] Updated weights for policy 0, policy_version 34807 (0.0009) [2023-12-25 23:50:58,781][123090] Updated weights for policy 1, policy_version 35112 (0.0009) [2023-12-25 23:50:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 17899520. Throughput: 0: 9068.3, 1: 8886.7. Samples: 17899088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:50:58,785][121949] Avg episode reward: [(0, '4213.762'), (1, '4554.765')] [2023-12-25 23:50:58,846][123090] Updated weights for policy 1, policy_version 35122 (0.0006) [2023-12-25 23:50:58,913][123090] Updated weights for policy 1, policy_version 35132 (0.0006) [2023-12-25 23:50:58,990][123091] Updated weights for policy 0, policy_version 34817 (0.0009) [2023-12-25 23:50:59,057][123091] Updated weights for policy 0, policy_version 34827 (0.0006) [2023-12-25 23:50:59,129][123091] Updated weights for policy 0, policy_version 34837 (0.0007) [2023-12-25 23:50:59,198][123091] Updated weights for policy 0, policy_version 34847 (0.0008) [2023-12-25 23:50:59,657][123090] Updated weights for policy 1, policy_version 35142 (0.0008) [2023-12-25 23:50:59,713][123090] Updated weights for policy 1, policy_version 35152 (0.0010) [2023-12-25 23:50:59,769][123090] Updated weights for policy 1, policy_version 35162 (0.0009) [2023-12-25 23:50:59,999][123091] Updated weights for policy 0, policy_version 34857 (0.0009) [2023-12-25 23:51:00,069][123091] Updated weights for policy 0, policy_version 34867 (0.0008) [2023-12-25 23:51:00,136][123091] Updated weights for policy 0, policy_version 34877 (0.0010) [2023-12-25 23:51:00,636][123090] Updated weights for policy 1, policy_version 35172 (0.0009) [2023-12-25 23:51:00,692][123090] Updated weights for policy 1, policy_version 35182 (0.0009) [2023-12-25 23:51:00,755][123090] Updated weights for policy 1, policy_version 35192 (0.0009) [2023-12-25 23:51:00,833][123091] Updated weights for policy 0, policy_version 34887 (0.0009) [2023-12-25 23:51:00,880][123091] Updated weights for policy 0, policy_version 34897 (0.0008) [2023-12-25 23:51:00,932][123091] Updated weights for policy 0, policy_version 34907 (0.0009) [2023-12-25 23:51:01,607][123090] Updated weights for policy 1, policy_version 35202 (0.0009) [2023-12-25 23:51:01,676][123090] Updated weights for policy 1, policy_version 35212 (0.0008) [2023-12-25 23:51:01,741][123090] Updated weights for policy 1, policy_version 35222 (0.0010) [2023-12-25 23:51:01,808][123090] Updated weights for policy 1, policy_version 35232 (0.0008) [2023-12-25 23:51:01,815][123091] Updated weights for policy 0, policy_version 34917 (0.0008) [2023-12-25 23:51:01,873][123091] Updated weights for policy 0, policy_version 34927 (0.0010) [2023-12-25 23:51:01,935][123091] Updated weights for policy 0, policy_version 34937 (0.0009) [2023-12-25 23:51:02,495][123090] Updated weights for policy 1, policy_version 35242 (0.0010) [2023-12-25 23:51:02,562][123090] Updated weights for policy 1, policy_version 35252 (0.0011) [2023-12-25 23:51:02,636][123090] Updated weights for policy 1, policy_version 35262 (0.0010) [2023-12-25 23:51:02,759][123091] Updated weights for policy 0, policy_version 34947 (0.0009) [2023-12-25 23:51:02,815][123091] Updated weights for policy 0, policy_version 34957 (0.0007) [2023-12-25 23:51:02,867][123091] Updated weights for policy 0, policy_version 34967 (0.0005) [2023-12-25 23:51:03,451][123090] Updated weights for policy 1, policy_version 35272 (0.0010) [2023-12-25 23:51:03,517][123090] Updated weights for policy 1, policy_version 35282 (0.0010) [2023-12-25 23:51:03,568][123091] Updated weights for policy 0, policy_version 34977 (0.0009) [2023-12-25 23:51:03,580][123090] Updated weights for policy 1, policy_version 35292 (0.0011) [2023-12-25 23:51:03,636][123091] Updated weights for policy 0, policy_version 34987 (0.0008) [2023-12-25 23:51:03,697][123091] Updated weights for policy 0, policy_version 34997 (0.0009) [2023-12-25 23:51:03,755][123091] Updated weights for policy 0, policy_version 35007 (0.0009) [2023-12-25 23:51:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 17997824. Throughput: 0: 8977.1, 1: 8795.9. Samples: 18003628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:51:03,785][121949] Avg episode reward: [(0, '4277.592'), (1, '4530.137')] [2023-12-25 23:51:04,340][123090] Updated weights for policy 1, policy_version 35302 (0.0009) [2023-12-25 23:51:04,406][123090] Updated weights for policy 1, policy_version 35312 (0.0008) [2023-12-25 23:51:04,470][123090] Updated weights for policy 1, policy_version 35322 (0.0008) [2023-12-25 23:51:04,568][123091] Updated weights for policy 0, policy_version 35017 (0.0008) [2023-12-25 23:51:04,619][123091] Updated weights for policy 0, policy_version 35027 (0.0006) [2023-12-25 23:51:04,673][123091] Updated weights for policy 0, policy_version 35037 (0.0010) [2023-12-25 23:51:05,218][123090] Updated weights for policy 1, policy_version 35332 (0.0005) [2023-12-25 23:51:05,273][123090] Updated weights for policy 1, policy_version 35342 (0.0005) [2023-12-25 23:51:05,347][123090] Updated weights for policy 1, policy_version 35352 (0.0005) [2023-12-25 23:51:05,447][123091] Updated weights for policy 0, policy_version 35047 (0.0011) [2023-12-25 23:51:05,494][123091] Updated weights for policy 0, policy_version 35057 (0.0010) [2023-12-25 23:51:05,545][123091] Updated weights for policy 0, policy_version 35067 (0.0007) [2023-12-25 23:51:06,055][123090] Updated weights for policy 1, policy_version 35362 (0.0006) [2023-12-25 23:51:06,128][123090] Updated weights for policy 1, policy_version 35372 (0.0011) [2023-12-25 23:51:06,196][123090] Updated weights for policy 1, policy_version 35382 (0.0011) [2023-12-25 23:51:06,265][123090] Updated weights for policy 1, policy_version 35392 (0.0011) [2023-12-25 23:51:06,389][123091] Updated weights for policy 0, policy_version 35077 (0.0008) [2023-12-25 23:51:06,460][123091] Updated weights for policy 0, policy_version 35087 (0.0008) [2023-12-25 23:51:06,521][123091] Updated weights for policy 0, policy_version 35097 (0.0009) [2023-12-25 23:51:07,061][123090] Updated weights for policy 1, policy_version 35402 (0.0011) [2023-12-25 23:51:07,133][123090] Updated weights for policy 1, policy_version 35412 (0.0011) [2023-12-25 23:51:07,209][123090] Updated weights for policy 1, policy_version 35422 (0.0011) [2023-12-25 23:51:07,266][123091] Updated weights for policy 0, policy_version 35107 (0.0008) [2023-12-25 23:51:07,325][123091] Updated weights for policy 0, policy_version 35117 (0.0011) [2023-12-25 23:51:07,388][123091] Updated weights for policy 0, policy_version 35127 (0.0011) [2023-12-25 23:51:08,046][123090] Updated weights for policy 1, policy_version 35432 (0.0011) [2023-12-25 23:51:08,116][123090] Updated weights for policy 1, policy_version 35442 (0.0010) [2023-12-25 23:51:08,159][123091] Updated weights for policy 0, policy_version 35137 (0.0010) [2023-12-25 23:51:08,185][123090] Updated weights for policy 1, policy_version 35452 (0.0009) [2023-12-25 23:51:08,220][123091] Updated weights for policy 0, policy_version 35147 (0.0009) [2023-12-25 23:51:08,276][123091] Updated weights for policy 0, policy_version 35157 (0.0011) [2023-12-25 23:51:08,341][123091] Updated weights for policy 0, policy_version 35167 (0.0009) [2023-12-25 23:51:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 18079744. Throughput: 0: 8966.2, 1: 8844.2. Samples: 18056936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:51:08,785][121949] Avg episode reward: [(0, '4248.302'), (1, '4460.332')] [2023-12-25 23:51:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000035168_9003008.pth... [2023-12-25 23:51:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000035456_9076736.pth... [2023-12-25 23:51:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000034144_8740864.pth [2023-12-25 23:51:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000034432_8814592.pth [2023-12-25 23:51:08,977][123090] Updated weights for policy 1, policy_version 35462 (0.0011) [2023-12-25 23:51:09,037][123090] Updated weights for policy 1, policy_version 35472 (0.0010) [2023-12-25 23:51:09,101][123090] Updated weights for policy 1, policy_version 35482 (0.0011) [2023-12-25 23:51:09,120][123091] Updated weights for policy 0, policy_version 35177 (0.0010) [2023-12-25 23:51:09,182][123091] Updated weights for policy 0, policy_version 35187 (0.0006) [2023-12-25 23:51:09,257][123091] Updated weights for policy 0, policy_version 35197 (0.0009) [2023-12-25 23:51:09,963][123090] Updated weights for policy 1, policy_version 35492 (0.0011) [2023-12-25 23:51:10,032][123090] Updated weights for policy 1, policy_version 35502 (0.0011) [2023-12-25 23:51:10,035][123091] Updated weights for policy 0, policy_version 35207 (0.0007) [2023-12-25 23:51:10,094][123090] Updated weights for policy 1, policy_version 35512 (0.0010) [2023-12-25 23:51:10,096][123091] Updated weights for policy 0, policy_version 35217 (0.0008) [2023-12-25 23:51:10,163][123091] Updated weights for policy 0, policy_version 35227 (0.0009) [2023-12-25 23:51:10,811][123090] Updated weights for policy 1, policy_version 35522 (0.0005) [2023-12-25 23:51:10,861][123090] Updated weights for policy 1, policy_version 35532 (0.0006) [2023-12-25 23:51:10,920][123090] Updated weights for policy 1, policy_version 35542 (0.0006) [2023-12-25 23:51:10,925][123091] Updated weights for policy 0, policy_version 35237 (0.0008) [2023-12-25 23:51:10,991][123091] Updated weights for policy 0, policy_version 35247 (0.0007) [2023-12-25 23:51:10,991][123090] Updated weights for policy 1, policy_version 35552 (0.0006) [2023-12-25 23:51:11,060][123091] Updated weights for policy 0, policy_version 35257 (0.0011) [2023-12-25 23:51:11,800][123091] Updated weights for policy 0, policy_version 35267 (0.0009) [2023-12-25 23:51:11,827][123090] Updated weights for policy 1, policy_version 35562 (0.0010) [2023-12-25 23:51:11,865][123091] Updated weights for policy 0, policy_version 35277 (0.0005) [2023-12-25 23:51:11,894][123090] Updated weights for policy 1, policy_version 35572 (0.0009) [2023-12-25 23:51:11,930][123091] Updated weights for policy 0, policy_version 35287 (0.0005) [2023-12-25 23:51:11,959][123090] Updated weights for policy 1, policy_version 35582 (0.0008) [2023-12-25 23:51:12,628][123091] Updated weights for policy 0, policy_version 35297 (0.0005) [2023-12-25 23:51:12,686][123091] Updated weights for policy 0, policy_version 35307 (0.0005) [2023-12-25 23:51:12,746][123091] Updated weights for policy 0, policy_version 35317 (0.0005) [2023-12-25 23:51:12,807][123090] Updated weights for policy 1, policy_version 35592 (0.0008) [2023-12-25 23:51:12,810][123091] Updated weights for policy 0, policy_version 35327 (0.0011) [2023-12-25 23:51:12,867][123090] Updated weights for policy 1, policy_version 35602 (0.0007) [2023-12-25 23:51:12,936][123090] Updated weights for policy 1, policy_version 35612 (0.0008) [2023-12-25 23:51:13,584][123090] Updated weights for policy 1, policy_version 35622 (0.0006) [2023-12-25 23:51:13,602][123091] Updated weights for policy 0, policy_version 35337 (0.0011) [2023-12-25 23:51:13,636][123090] Updated weights for policy 1, policy_version 35632 (0.0006) [2023-12-25 23:51:13,658][123091] Updated weights for policy 0, policy_version 35347 (0.0010) [2023-12-25 23:51:13,686][123090] Updated weights for policy 1, policy_version 35642 (0.0006) [2023-12-25 23:51:13,715][123091] Updated weights for policy 0, policy_version 35357 (0.0010) [2023-12-25 23:51:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 18178048. Throughput: 0: 9017.9, 1: 8759.3. Samples: 18163608. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-25 23:51:13,785][121949] Avg episode reward: [(0, '4105.120'), (1, '4367.419')] [2023-12-25 23:51:14,509][123090] Updated weights for policy 1, policy_version 35652 (0.0007) [2023-12-25 23:51:14,534][123091] Updated weights for policy 0, policy_version 35367 (0.0009) [2023-12-25 23:51:14,571][123090] Updated weights for policy 1, policy_version 35662 (0.0009) [2023-12-25 23:51:14,596][123091] Updated weights for policy 0, policy_version 35377 (0.0010) [2023-12-25 23:51:14,628][123090] Updated weights for policy 1, policy_version 35672 (0.0006) [2023-12-25 23:51:14,658][123091] Updated weights for policy 0, policy_version 35387 (0.0010) [2023-12-25 23:51:15,433][123091] Updated weights for policy 0, policy_version 35397 (0.0010) [2023-12-25 23:51:15,438][123090] Updated weights for policy 1, policy_version 35682 (0.0010) [2023-12-25 23:51:15,486][123091] Updated weights for policy 0, policy_version 35407 (0.0011) [2023-12-25 23:51:15,502][123090] Updated weights for policy 1, policy_version 35692 (0.0011) [2023-12-25 23:51:15,541][123091] Updated weights for policy 0, policy_version 35417 (0.0010) [2023-12-25 23:51:15,562][123090] Updated weights for policy 1, policy_version 35702 (0.0011) [2023-12-25 23:51:15,625][123090] Updated weights for policy 1, policy_version 35712 (0.0010) [2023-12-25 23:51:16,379][123090] Updated weights for policy 1, policy_version 35722 (0.0005) [2023-12-25 23:51:16,390][123091] Updated weights for policy 0, policy_version 35427 (0.0010) [2023-12-25 23:51:16,428][123090] Updated weights for policy 1, policy_version 35732 (0.0005) [2023-12-25 23:51:16,437][123091] Updated weights for policy 0, policy_version 35437 (0.0010) [2023-12-25 23:51:16,489][123091] Updated weights for policy 0, policy_version 35447 (0.0010) [2023-12-25 23:51:16,494][123090] Updated weights for policy 1, policy_version 35742 (0.0005) [2023-12-25 23:51:17,182][123090] Updated weights for policy 1, policy_version 35752 (0.0005) [2023-12-25 23:51:17,238][123090] Updated weights for policy 1, policy_version 35762 (0.0005) [2023-12-25 23:51:17,289][123090] Updated weights for policy 1, policy_version 35772 (0.0005) [2023-12-25 23:51:17,324][123091] Updated weights for policy 0, policy_version 35457 (0.0010) [2023-12-25 23:51:17,374][123091] Updated weights for policy 0, policy_version 35467 (0.0010) [2023-12-25 23:51:17,432][123091] Updated weights for policy 0, policy_version 35477 (0.0010) [2023-12-25 23:51:17,497][123091] Updated weights for policy 0, policy_version 35487 (0.0010) [2023-12-25 23:51:18,015][123090] Updated weights for policy 1, policy_version 35782 (0.0006) [2023-12-25 23:51:18,065][123090] Updated weights for policy 1, policy_version 35792 (0.0005) [2023-12-25 23:51:18,121][123090] Updated weights for policy 1, policy_version 35802 (0.0005) [2023-12-25 23:51:18,273][123091] Updated weights for policy 0, policy_version 35497 (0.0011) [2023-12-25 23:51:18,328][123091] Updated weights for policy 0, policy_version 35507 (0.0011) [2023-12-25 23:51:18,397][123091] Updated weights for policy 0, policy_version 35517 (0.0011) [2023-12-25 23:51:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 18259968. Throughput: 0: 8982.9, 1: 8850.8. Samples: 18273552. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-25 23:51:18,785][121949] Avg episode reward: [(0, '4071.150'), (1, '4365.245')] [2023-12-25 23:51:18,805][123090] Updated weights for policy 1, policy_version 35812 (0.0006) [2023-12-25 23:51:18,861][123090] Updated weights for policy 1, policy_version 35822 (0.0009) [2023-12-25 23:51:18,916][123090] Updated weights for policy 1, policy_version 35832 (0.0010) [2023-12-25 23:51:19,172][123091] Updated weights for policy 0, policy_version 35527 (0.0010) [2023-12-25 23:51:19,249][123091] Updated weights for policy 0, policy_version 35538 (0.0010) [2023-12-25 23:51:19,310][123091] Updated weights for policy 0, policy_version 35548 (0.0007) [2023-12-25 23:51:19,810][123090] Updated weights for policy 1, policy_version 35842 (0.0010) [2023-12-25 23:51:19,884][123090] Updated weights for policy 1, policy_version 35852 (0.0009) [2023-12-25 23:51:19,950][123090] Updated weights for policy 1, policy_version 35862 (0.0009) [2023-12-25 23:51:20,024][123090] Updated weights for policy 1, policy_version 35872 (0.0009) [2023-12-25 23:51:20,161][123091] Updated weights for policy 0, policy_version 35558 (0.0010) [2023-12-25 23:51:20,229][123091] Updated weights for policy 0, policy_version 35568 (0.0011) [2023-12-25 23:51:20,296][123091] Updated weights for policy 0, policy_version 35578 (0.0011) [2023-12-25 23:51:20,949][123090] Updated weights for policy 1, policy_version 35882 (0.0011) [2023-12-25 23:51:21,018][123090] Updated weights for policy 1, policy_version 35892 (0.0011) [2023-12-25 23:51:21,088][123091] Updated weights for policy 0, policy_version 35588 (0.0009) [2023-12-25 23:51:21,091][123090] Updated weights for policy 1, policy_version 35902 (0.0011) [2023-12-25 23:51:21,162][123091] Updated weights for policy 0, policy_version 35598 (0.0007) [2023-12-25 23:51:21,229][123091] Updated weights for policy 0, policy_version 35608 (0.0009) [2023-12-25 23:51:21,921][123090] Updated weights for policy 1, policy_version 35912 (0.0010) [2023-12-25 23:51:21,989][123090] Updated weights for policy 1, policy_version 35922 (0.0009) [2023-12-25 23:51:22,064][123090] Updated weights for policy 1, policy_version 35932 (0.0008) [2023-12-25 23:51:22,082][123091] Updated weights for policy 0, policy_version 35618 (0.0008) [2023-12-25 23:51:22,137][123091] Updated weights for policy 0, policy_version 35628 (0.0010) [2023-12-25 23:51:22,195][123091] Updated weights for policy 0, policy_version 35638 (0.0007) [2023-12-25 23:51:22,264][123091] Updated weights for policy 0, policy_version 35648 (0.0009) [2023-12-25 23:51:22,878][123090] Updated weights for policy 1, policy_version 35942 (0.0005) [2023-12-25 23:51:22,945][123090] Updated weights for policy 1, policy_version 35952 (0.0009) [2023-12-25 23:51:23,011][123090] Updated weights for policy 1, policy_version 35962 (0.0010) [2023-12-25 23:51:23,044][123091] Updated weights for policy 0, policy_version 35658 (0.0008) [2023-12-25 23:51:23,108][123091] Updated weights for policy 0, policy_version 35668 (0.0006) [2023-12-25 23:51:23,172][123091] Updated weights for policy 0, policy_version 35678 (0.0010) [2023-12-25 23:51:23,766][123091] Updated weights for policy 0, policy_version 35688 (0.0010) [2023-12-25 23:51:23,785][121949] Fps is (10 sec: 16383.3, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 18341888. Throughput: 0: 8904.1, 1: 8832.8. Samples: 18323916. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-25 23:51:23,786][121949] Avg episode reward: [(0, '4246.964'), (1, '4427.243')] [2023-12-25 23:51:23,828][123090] Updated weights for policy 1, policy_version 35972 (0.0010) [2023-12-25 23:51:23,834][123091] Updated weights for policy 0, policy_version 35698 (0.0009) [2023-12-25 23:51:23,880][123090] Updated weights for policy 1, policy_version 35982 (0.0007) [2023-12-25 23:51:23,892][123091] Updated weights for policy 0, policy_version 35708 (0.0008) [2023-12-25 23:51:23,913][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000035712_9142272.pth... [2023-12-25 23:51:23,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000034656_8871936.pth [2023-12-25 23:51:23,934][123090] Updated weights for policy 1, policy_version 35992 (0.0009) [2023-12-25 23:51:23,977][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036000_9216000.pth... [2023-12-25 23:51:23,981][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000034944_8945664.pth [2023-12-25 23:51:24,731][123091] Updated weights for policy 0, policy_version 35718 (0.0008) [2023-12-25 23:51:24,750][123090] Updated weights for policy 1, policy_version 36002 (0.0008) [2023-12-25 23:51:24,789][123091] Updated weights for policy 0, policy_version 35728 (0.0009) [2023-12-25 23:51:24,809][123090] Updated weights for policy 1, policy_version 36012 (0.0005) [2023-12-25 23:51:24,849][123091] Updated weights for policy 0, policy_version 35738 (0.0009) [2023-12-25 23:51:24,867][123090] Updated weights for policy 1, policy_version 36022 (0.0006) [2023-12-25 23:51:24,934][123090] Updated weights for policy 1, policy_version 36032 (0.0005) [2023-12-25 23:51:25,605][123091] Updated weights for policy 0, policy_version 35748 (0.0005) [2023-12-25 23:51:25,669][123091] Updated weights for policy 0, policy_version 35758 (0.0005) [2023-12-25 23:51:25,684][123090] Updated weights for policy 1, policy_version 36042 (0.0009) [2023-12-25 23:51:25,719][123091] Updated weights for policy 0, policy_version 35768 (0.0005) [2023-12-25 23:51:25,733][123090] Updated weights for policy 1, policy_version 36052 (0.0007) [2023-12-25 23:51:25,781][123090] Updated weights for policy 1, policy_version 36062 (0.0009) [2023-12-25 23:51:26,395][123091] Updated weights for policy 0, policy_version 35778 (0.0007) [2023-12-25 23:51:26,442][123091] Updated weights for policy 0, policy_version 35788 (0.0006) [2023-12-25 23:51:26,504][123091] Updated weights for policy 0, policy_version 35798 (0.0005) [2023-12-25 23:51:26,571][123091] Updated weights for policy 0, policy_version 35808 (0.0006) [2023-12-25 23:51:26,632][123090] Updated weights for policy 1, policy_version 36072 (0.0006) [2023-12-25 23:51:26,705][123090] Updated weights for policy 1, policy_version 36082 (0.0005) [2023-12-25 23:51:26,761][123090] Updated weights for policy 1, policy_version 36092 (0.0005) [2023-12-25 23:51:27,330][123091] Updated weights for policy 0, policy_version 35818 (0.0009) [2023-12-25 23:51:27,362][123090] Updated weights for policy 1, policy_version 36102 (0.0008) [2023-12-25 23:51:27,382][123091] Updated weights for policy 0, policy_version 35828 (0.0008) [2023-12-25 23:51:27,410][123090] Updated weights for policy 1, policy_version 36112 (0.0008) [2023-12-25 23:51:27,437][123091] Updated weights for policy 0, policy_version 35838 (0.0008) [2023-12-25 23:51:27,455][123090] Updated weights for policy 1, policy_version 36122 (0.0008) [2023-12-25 23:51:28,165][123090] Updated weights for policy 1, policy_version 36132 (0.0007) [2023-12-25 23:51:28,210][123091] Updated weights for policy 0, policy_version 35848 (0.0006) [2023-12-25 23:51:28,212][123090] Updated weights for policy 1, policy_version 36142 (0.0005) [2023-12-25 23:51:28,256][123091] Updated weights for policy 0, policy_version 35858 (0.0005) [2023-12-25 23:51:28,257][123090] Updated weights for policy 1, policy_version 36152 (0.0005) [2023-12-25 23:51:28,304][123091] Updated weights for policy 0, policy_version 35868 (0.0005) [2023-12-25 23:51:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 18440192. Throughput: 0: 8957.7, 1: 8890.2. Samples: 18433148. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-25 23:51:28,785][121949] Avg episode reward: [(0, '4263.400'), (1, '4419.400')] [2023-12-25 23:51:28,881][123090] Updated weights for policy 1, policy_version 36162 (0.0008) [2023-12-25 23:51:28,930][123090] Updated weights for policy 1, policy_version 36172 (0.0005) [2023-12-25 23:51:28,975][123090] Updated weights for policy 1, policy_version 36182 (0.0005) [2023-12-25 23:51:29,022][123090] Updated weights for policy 1, policy_version 36192 (0.0005) [2023-12-25 23:51:29,200][123091] Updated weights for policy 0, policy_version 35878 (0.0008) [2023-12-25 23:51:29,275][123091] Updated weights for policy 0, policy_version 35888 (0.0008) [2023-12-25 23:51:29,347][123091] Updated weights for policy 0, policy_version 35898 (0.0009) [2023-12-25 23:51:29,687][123090] Updated weights for policy 1, policy_version 36202 (0.0009) [2023-12-25 23:51:29,747][123090] Updated weights for policy 1, policy_version 36212 (0.0010) [2023-12-25 23:51:29,805][123090] Updated weights for policy 1, policy_version 36222 (0.0008) [2023-12-25 23:51:30,143][123091] Updated weights for policy 0, policy_version 35908 (0.0008) [2023-12-25 23:51:30,200][123091] Updated weights for policy 0, policy_version 35918 (0.0005) [2023-12-25 23:51:30,247][123091] Updated weights for policy 0, policy_version 35928 (0.0006) [2023-12-25 23:51:30,669][123090] Updated weights for policy 1, policy_version 36232 (0.0008) [2023-12-25 23:51:30,727][123090] Updated weights for policy 1, policy_version 36242 (0.0010) [2023-12-25 23:51:30,797][123090] Updated weights for policy 1, policy_version 36252 (0.0009) [2023-12-25 23:51:31,055][123091] Updated weights for policy 0, policy_version 35938 (0.0009) [2023-12-25 23:51:31,118][123091] Updated weights for policy 0, policy_version 35948 (0.0009) [2023-12-25 23:51:31,183][123091] Updated weights for policy 0, policy_version 35958 (0.0009) [2023-12-25 23:51:31,249][123091] Updated weights for policy 0, policy_version 35968 (0.0009) [2023-12-25 23:51:31,645][123090] Updated weights for policy 1, policy_version 36262 (0.0009) [2023-12-25 23:51:31,709][123090] Updated weights for policy 1, policy_version 36272 (0.0009) [2023-12-25 23:51:31,780][123090] Updated weights for policy 1, policy_version 36282 (0.0007) [2023-12-25 23:51:32,068][123091] Updated weights for policy 0, policy_version 35978 (0.0009) [2023-12-25 23:51:32,120][123091] Updated weights for policy 0, policy_version 35989 (0.0010) [2023-12-25 23:51:32,177][123091] Updated weights for policy 0, policy_version 36000 (0.0008) [2023-12-25 23:51:32,544][123090] Updated weights for policy 1, policy_version 36292 (0.0007) [2023-12-25 23:51:32,600][123090] Updated weights for policy 1, policy_version 36302 (0.0009) [2023-12-25 23:51:32,648][123090] Updated weights for policy 1, policy_version 36312 (0.0008) [2023-12-25 23:51:32,950][123091] Updated weights for policy 0, policy_version 36010 (0.0010) [2023-12-25 23:51:32,998][123091] Updated weights for policy 0, policy_version 36020 (0.0010) [2023-12-25 23:51:33,064][123091] Updated weights for policy 0, policy_version 36030 (0.0010) [2023-12-25 23:51:33,511][123090] Updated weights for policy 1, policy_version 36322 (0.0008) [2023-12-25 23:51:33,558][123090] Updated weights for policy 1, policy_version 36332 (0.0008) [2023-12-25 23:51:33,618][123090] Updated weights for policy 1, policy_version 36342 (0.0008) [2023-12-25 23:51:33,672][123090] Updated weights for policy 1, policy_version 36352 (0.0009) [2023-12-25 23:51:33,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 18530304. Throughput: 0: 8867.7, 1: 8946.1. Samples: 18540308. Policy #0 lag: (min: 6.0, avg: 14.0, max: 38.0) [2023-12-25 23:51:33,785][121949] Avg episode reward: [(0, '4226.492'), (1, '4522.390')] [2023-12-25 23:51:33,830][123091] Updated weights for policy 0, policy_version 36040 (0.0006) [2023-12-25 23:51:33,890][123091] Updated weights for policy 0, policy_version 36050 (0.0005) [2023-12-25 23:51:33,949][123091] Updated weights for policy 0, policy_version 36060 (0.0005) [2023-12-25 23:51:34,614][123090] Updated weights for policy 1, policy_version 36362 (0.0010) [2023-12-25 23:51:34,649][123091] Updated weights for policy 0, policy_version 36070 (0.0006) [2023-12-25 23:51:34,676][123090] Updated weights for policy 1, policy_version 36372 (0.0010) [2023-12-25 23:51:34,714][123091] Updated weights for policy 0, policy_version 36080 (0.0009) [2023-12-25 23:51:34,731][123090] Updated weights for policy 1, policy_version 36382 (0.0009) [2023-12-25 23:51:34,783][123091] Updated weights for policy 0, policy_version 36090 (0.0010) [2023-12-25 23:51:35,540][123091] Updated weights for policy 0, policy_version 36100 (0.0009) [2023-12-25 23:51:35,598][123090] Updated weights for policy 1, policy_version 36392 (0.0006) [2023-12-25 23:51:35,602][123091] Updated weights for policy 0, policy_version 36110 (0.0008) [2023-12-25 23:51:35,667][123091] Updated weights for policy 0, policy_version 36120 (0.0008) [2023-12-25 23:51:35,667][123090] Updated weights for policy 1, policy_version 36402 (0.0005) [2023-12-25 23:51:35,714][123090] Updated weights for policy 1, policy_version 36412 (0.0005) [2023-12-25 23:51:36,397][123091] Updated weights for policy 0, policy_version 36130 (0.0007) [2023-12-25 23:51:36,443][123090] Updated weights for policy 1, policy_version 36422 (0.0008) [2023-12-25 23:51:36,463][123091] Updated weights for policy 0, policy_version 36140 (0.0006) [2023-12-25 23:51:36,511][123090] Updated weights for policy 1, policy_version 36432 (0.0011) [2023-12-25 23:51:36,524][123091] Updated weights for policy 0, policy_version 36150 (0.0006) [2023-12-25 23:51:36,579][123090] Updated weights for policy 1, policy_version 36442 (0.0011) [2023-12-25 23:51:36,585][123091] Updated weights for policy 0, policy_version 36160 (0.0006) [2023-12-25 23:51:37,330][123091] Updated weights for policy 0, policy_version 36170 (0.0009) [2023-12-25 23:51:37,394][123091] Updated weights for policy 0, policy_version 36180 (0.0009) [2023-12-25 23:51:37,398][123090] Updated weights for policy 1, policy_version 36452 (0.0008) [2023-12-25 23:51:37,455][123090] Updated weights for policy 1, policy_version 36462 (0.0006) [2023-12-25 23:51:37,456][123091] Updated weights for policy 0, policy_version 36190 (0.0009) [2023-12-25 23:51:37,512][123090] Updated weights for policy 1, policy_version 36472 (0.0006) [2023-12-25 23:51:38,308][123090] Updated weights for policy 1, policy_version 36482 (0.0010) [2023-12-25 23:51:38,314][123091] Updated weights for policy 0, policy_version 36200 (0.0009) [2023-12-25 23:51:38,371][123090] Updated weights for policy 1, policy_version 36492 (0.0007) [2023-12-25 23:51:38,381][123091] Updated weights for policy 0, policy_version 36210 (0.0008) [2023-12-25 23:51:38,433][123091] Updated weights for policy 0, policy_version 36220 (0.0009) [2023-12-25 23:51:38,436][123090] Updated weights for policy 1, policy_version 36502 (0.0008) [2023-12-25 23:51:38,502][123090] Updated weights for policy 1, policy_version 36512 (0.0008) [2023-12-25 23:51:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.7, 300 sec: 17772.4). Total num frames: 18620416. Throughput: 0: 8894.0, 1: 8953.0. Samples: 18594688. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:51:38,786][121949] Avg episode reward: [(0, '4215.568'), (1, '4571.922')] [2023-12-25 23:51:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000036224_9273344.pth... [2023-12-25 23:51:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036512_9347072.pth... [2023-12-25 23:51:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000035456_9076736.pth [2023-12-25 23:51:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000035168_9003008.pth [2023-12-25 23:51:39,255][123091] Updated weights for policy 0, policy_version 36230 (0.0007) [2023-12-25 23:51:39,318][123091] Updated weights for policy 0, policy_version 36240 (0.0008) [2023-12-25 23:51:39,379][123090] Updated weights for policy 1, policy_version 36522 (0.0009) [2023-12-25 23:51:39,383][123091] Updated weights for policy 0, policy_version 36250 (0.0008) [2023-12-25 23:51:39,451][123090] Updated weights for policy 1, policy_version 36532 (0.0008) [2023-12-25 23:51:39,528][123090] Updated weights for policy 1, policy_version 36542 (0.0005) [2023-12-25 23:51:40,178][123091] Updated weights for policy 0, policy_version 36260 (0.0011) [2023-12-25 23:51:40,242][123091] Updated weights for policy 0, policy_version 36270 (0.0011) [2023-12-25 23:51:40,306][123091] Updated weights for policy 0, policy_version 36280 (0.0007) [2023-12-25 23:51:40,342][123090] Updated weights for policy 1, policy_version 36552 (0.0007) [2023-12-25 23:51:40,402][123090] Updated weights for policy 1, policy_version 36562 (0.0009) [2023-12-25 23:51:40,467][123090] Updated weights for policy 1, policy_version 36572 (0.0009) [2023-12-25 23:51:41,126][123091] Updated weights for policy 0, policy_version 36290 (0.0011) [2023-12-25 23:51:41,186][123091] Updated weights for policy 0, policy_version 36300 (0.0011) [2023-12-25 23:51:41,238][123091] Updated weights for policy 0, policy_version 36310 (0.0009) [2023-12-25 23:51:41,305][123091] Updated weights for policy 0, policy_version 36320 (0.0010) [2023-12-25 23:51:41,335][123090] Updated weights for policy 1, policy_version 36582 (0.0009) [2023-12-25 23:51:41,394][123090] Updated weights for policy 1, policy_version 36592 (0.0010) [2023-12-25 23:51:41,448][123090] Updated weights for policy 1, policy_version 36602 (0.0010) [2023-12-25 23:51:42,054][123091] Updated weights for policy 0, policy_version 36330 (0.0009) [2023-12-25 23:51:42,120][123091] Updated weights for policy 0, policy_version 36340 (0.0009) [2023-12-25 23:51:42,184][123091] Updated weights for policy 0, policy_version 36350 (0.0008) [2023-12-25 23:51:42,373][123090] Updated weights for policy 1, policy_version 36612 (0.0009) [2023-12-25 23:51:42,431][123090] Updated weights for policy 1, policy_version 36622 (0.0009) [2023-12-25 23:51:42,487][123090] Updated weights for policy 1, policy_version 36632 (0.0009) [2023-12-25 23:51:42,924][123091] Updated weights for policy 0, policy_version 36360 (0.0006) [2023-12-25 23:51:42,994][123091] Updated weights for policy 0, policy_version 36370 (0.0010) [2023-12-25 23:51:43,049][123091] Updated weights for policy 0, policy_version 36380 (0.0010) [2023-12-25 23:51:43,383][123090] Updated weights for policy 1, policy_version 36642 (0.0009) [2023-12-25 23:51:43,446][123090] Updated weights for policy 1, policy_version 36652 (0.0010) [2023-12-25 23:51:43,504][123090] Updated weights for policy 1, policy_version 36662 (0.0010) [2023-12-25 23:51:43,566][123090] Updated weights for policy 1, policy_version 36672 (0.0010) [2023-12-25 23:51:43,744][123091] Updated weights for policy 0, policy_version 36390 (0.0009) [2023-12-25 23:51:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 18702336. Throughput: 0: 8929.0, 1: 8793.3. Samples: 18696588. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:51:43,785][121949] Avg episode reward: [(0, '3993.687'), (1, '4477.050')] [2023-12-25 23:51:43,803][123091] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-12-25 23:51:43,855][123091] Updated weights for policy 0, policy_version 36410 (0.0006) [2023-12-25 23:51:44,469][123090] Updated weights for policy 1, policy_version 36682 (0.0010) [2023-12-25 23:51:44,523][123091] Updated weights for policy 0, policy_version 36420 (0.0006) [2023-12-25 23:51:44,534][123090] Updated weights for policy 1, policy_version 36692 (0.0009) [2023-12-25 23:51:44,581][123091] Updated weights for policy 0, policy_version 36430 (0.0006) [2023-12-25 23:51:44,592][123090] Updated weights for policy 1, policy_version 36702 (0.0009) [2023-12-25 23:51:44,638][123091] Updated weights for policy 0, policy_version 36440 (0.0005) [2023-12-25 23:51:45,396][123091] Updated weights for policy 0, policy_version 36450 (0.0006) [2023-12-25 23:51:45,462][123091] Updated weights for policy 0, policy_version 36460 (0.0010) [2023-12-25 23:51:45,492][123090] Updated weights for policy 1, policy_version 36712 (0.0007) [2023-12-25 23:51:45,530][123091] Updated weights for policy 0, policy_version 36470 (0.0009) [2023-12-25 23:51:45,556][123090] Updated weights for policy 1, policy_version 36722 (0.0008) [2023-12-25 23:51:45,593][123091] Updated weights for policy 0, policy_version 36480 (0.0009) [2023-12-25 23:51:45,618][123090] Updated weights for policy 1, policy_version 36732 (0.0009) [2023-12-25 23:51:46,379][123091] Updated weights for policy 0, policy_version 36490 (0.0008) [2023-12-25 23:51:46,431][123091] Updated weights for policy 0, policy_version 36500 (0.0009) [2023-12-25 23:51:46,470][123090] Updated weights for policy 1, policy_version 36742 (0.0008) [2023-12-25 23:51:46,477][123091] Updated weights for policy 0, policy_version 36510 (0.0008) [2023-12-25 23:51:46,521][123090] Updated weights for policy 1, policy_version 36752 (0.0009) [2023-12-25 23:51:46,567][123090] Updated weights for policy 1, policy_version 36762 (0.0009) [2023-12-25 23:51:47,265][123091] Updated weights for policy 0, policy_version 36520 (0.0009) [2023-12-25 23:51:47,332][123091] Updated weights for policy 0, policy_version 36530 (0.0009) [2023-12-25 23:51:47,394][123091] Updated weights for policy 0, policy_version 36540 (0.0009) [2023-12-25 23:51:47,474][123090] Updated weights for policy 1, policy_version 36772 (0.0009) [2023-12-25 23:51:47,523][123090] Updated weights for policy 1, policy_version 36782 (0.0009) [2023-12-25 23:51:47,579][123090] Updated weights for policy 1, policy_version 36792 (0.0009) [2023-12-25 23:51:48,144][123091] Updated weights for policy 0, policy_version 36550 (0.0006) [2023-12-25 23:51:48,196][123091] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-12-25 23:51:48,251][123091] Updated weights for policy 0, policy_version 36570 (0.0007) [2023-12-25 23:51:48,500][123090] Updated weights for policy 1, policy_version 36802 (0.0009) [2023-12-25 23:51:48,559][123090] Updated weights for policy 1, policy_version 36812 (0.0010) [2023-12-25 23:51:48,614][123090] Updated weights for policy 1, policy_version 36822 (0.0010) [2023-12-25 23:51:48,670][123090] Updated weights for policy 1, policy_version 36832 (0.0010) [2023-12-25 23:51:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 18792448. Throughput: 0: 9010.7, 1: 8714.5. Samples: 18801264. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:51:48,785][121949] Avg episode reward: [(0, '3958.323'), (1, '4429.295')] [2023-12-25 23:51:48,991][123091] Updated weights for policy 0, policy_version 36580 (0.0006) [2023-12-25 23:51:49,050][123091] Updated weights for policy 0, policy_version 36590 (0.0005) [2023-12-25 23:51:49,112][123091] Updated weights for policy 0, policy_version 36600 (0.0006) [2023-12-25 23:51:49,611][123090] Updated weights for policy 1, policy_version 36842 (0.0010) [2023-12-25 23:51:49,664][123090] Updated weights for policy 1, policy_version 36852 (0.0009) [2023-12-25 23:51:49,726][123090] Updated weights for policy 1, policy_version 36862 (0.0010) [2023-12-25 23:51:49,795][123091] Updated weights for policy 0, policy_version 36610 (0.0009) [2023-12-25 23:51:49,861][123091] Updated weights for policy 0, policy_version 36620 (0.0007) [2023-12-25 23:51:49,929][123091] Updated weights for policy 0, policy_version 36630 (0.0011) [2023-12-25 23:51:49,988][123091] Updated weights for policy 0, policy_version 36640 (0.0010) [2023-12-25 23:51:50,648][123090] Updated weights for policy 1, policy_version 36872 (0.0009) [2023-12-25 23:51:50,710][123090] Updated weights for policy 1, policy_version 36882 (0.0009) [2023-12-25 23:51:50,770][123090] Updated weights for policy 1, policy_version 36892 (0.0009) [2023-12-25 23:51:50,830][123091] Updated weights for policy 0, policy_version 36650 (0.0011) [2023-12-25 23:51:50,893][123091] Updated weights for policy 0, policy_version 36660 (0.0011) [2023-12-25 23:51:50,952][123091] Updated weights for policy 0, policy_version 36670 (0.0011) [2023-12-25 23:51:51,637][123090] Updated weights for policy 1, policy_version 36902 (0.0009) [2023-12-25 23:51:51,706][123090] Updated weights for policy 1, policy_version 36912 (0.0008) [2023-12-25 23:51:51,724][123091] Updated weights for policy 0, policy_version 36680 (0.0011) [2023-12-25 23:51:51,775][123090] Updated weights for policy 1, policy_version 36922 (0.0009) [2023-12-25 23:51:51,783][123091] Updated weights for policy 0, policy_version 36690 (0.0011) [2023-12-25 23:51:51,839][123091] Updated weights for policy 0, policy_version 36700 (0.0010) [2023-12-25 23:51:52,584][123090] Updated weights for policy 1, policy_version 36932 (0.0008) [2023-12-25 23:51:52,648][123090] Updated weights for policy 1, policy_version 36942 (0.0009) [2023-12-25 23:51:52,680][123091] Updated weights for policy 0, policy_version 36710 (0.0010) [2023-12-25 23:51:52,714][123090] Updated weights for policy 1, policy_version 36952 (0.0008) [2023-12-25 23:51:52,745][123091] Updated weights for policy 0, policy_version 36720 (0.0009) [2023-12-25 23:51:52,810][123091] Updated weights for policy 0, policy_version 36730 (0.0010) [2023-12-25 23:51:53,526][123090] Updated weights for policy 1, policy_version 36962 (0.0009) [2023-12-25 23:51:53,541][123091] Updated weights for policy 0, policy_version 36740 (0.0008) [2023-12-25 23:51:53,579][123090] Updated weights for policy 1, policy_version 36972 (0.0007) [2023-12-25 23:51:53,593][123091] Updated weights for policy 0, policy_version 36750 (0.0010) [2023-12-25 23:51:53,626][123090] Updated weights for policy 1, policy_version 36982 (0.0006) [2023-12-25 23:51:53,641][123091] Updated weights for policy 0, policy_version 36760 (0.0010) [2023-12-25 23:51:53,678][123090] Updated weights for policy 1, policy_version 36992 (0.0005) [2023-12-25 23:51:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 18882560. Throughput: 0: 9033.8, 1: 8650.5. Samples: 18852728. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:51:53,785][121949] Avg episode reward: [(0, '4084.073'), (1, '4367.165')] [2023-12-25 23:51:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000036768_9412608.pth... [2023-12-25 23:51:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036992_9469952.pth... [2023-12-25 23:51:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000035712_9142272.pth [2023-12-25 23:51:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036000_9216000.pth [2023-12-25 23:51:54,467][123090] Updated weights for policy 1, policy_version 37002 (0.0008) [2023-12-25 23:51:54,475][123091] Updated weights for policy 0, policy_version 36770 (0.0010) [2023-12-25 23:51:54,535][123091] Updated weights for policy 0, policy_version 36780 (0.0011) [2023-12-25 23:51:54,538][123090] Updated weights for policy 1, policy_version 37012 (0.0007) [2023-12-25 23:51:54,590][123091] Updated weights for policy 0, policy_version 36790 (0.0011) [2023-12-25 23:51:54,603][123090] Updated weights for policy 1, policy_version 37022 (0.0008) [2023-12-25 23:51:54,646][123091] Updated weights for policy 0, policy_version 36800 (0.0010) [2023-12-25 23:51:55,378][123090] Updated weights for policy 1, policy_version 37032 (0.0009) [2023-12-25 23:51:55,425][123090] Updated weights for policy 1, policy_version 37042 (0.0010) [2023-12-25 23:51:55,487][123090] Updated weights for policy 1, policy_version 37052 (0.0010) [2023-12-25 23:51:55,491][123091] Updated weights for policy 0, policy_version 36810 (0.0010) [2023-12-25 23:51:55,538][123091] Updated weights for policy 0, policy_version 36820 (0.0010) [2023-12-25 23:51:55,581][123091] Updated weights for policy 0, policy_version 36830 (0.0010) [2023-12-25 23:51:56,300][123091] Updated weights for policy 0, policy_version 36840 (0.0006) [2023-12-25 23:51:56,363][123091] Updated weights for policy 0, policy_version 36850 (0.0005) [2023-12-25 23:51:56,375][123090] Updated weights for policy 1, policy_version 37062 (0.0009) [2023-12-25 23:51:56,424][123091] Updated weights for policy 0, policy_version 36860 (0.0005) [2023-12-25 23:51:56,451][123090] Updated weights for policy 1, policy_version 37072 (0.0007) [2023-12-25 23:51:56,526][123090] Updated weights for policy 1, policy_version 37082 (0.0010) [2023-12-25 23:51:57,161][123091] Updated weights for policy 0, policy_version 36870 (0.0008) [2023-12-25 23:51:57,208][123091] Updated weights for policy 0, policy_version 36880 (0.0010) [2023-12-25 23:51:57,252][123090] Updated weights for policy 1, policy_version 37092 (0.0009) [2023-12-25 23:51:57,255][123091] Updated weights for policy 0, policy_version 36890 (0.0010) [2023-12-25 23:51:57,305][123090] Updated weights for policy 1, policy_version 37102 (0.0006) [2023-12-25 23:51:57,357][123090] Updated weights for policy 1, policy_version 37112 (0.0009) [2023-12-25 23:51:57,982][123091] Updated weights for policy 0, policy_version 36900 (0.0009) [2023-12-25 23:51:58,042][123091] Updated weights for policy 0, policy_version 36910 (0.0007) [2023-12-25 23:51:58,097][123091] Updated weights for policy 0, policy_version 36920 (0.0010) [2023-12-25 23:51:58,250][123090] Updated weights for policy 1, policy_version 37122 (0.0009) [2023-12-25 23:51:58,319][123090] Updated weights for policy 1, policy_version 37132 (0.0008) [2023-12-25 23:51:58,395][123090] Updated weights for policy 1, policy_version 37142 (0.0008) [2023-12-25 23:51:58,470][123090] Updated weights for policy 1, policy_version 37152 (0.0010) [2023-12-25 23:51:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 18964480. Throughput: 0: 9019.4, 1: 8661.5. Samples: 18959248. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-25 23:51:58,785][121949] Avg episode reward: [(0, '4148.837'), (1, '4467.421')] [2023-12-25 23:51:58,878][123091] Updated weights for policy 0, policy_version 36930 (0.0009) [2023-12-25 23:51:58,946][123091] Updated weights for policy 0, policy_version 36940 (0.0008) [2023-12-25 23:51:59,015][123091] Updated weights for policy 0, policy_version 36950 (0.0008) [2023-12-25 23:51:59,080][123091] Updated weights for policy 0, policy_version 36960 (0.0008) [2023-12-25 23:51:59,393][123090] Updated weights for policy 1, policy_version 37162 (0.0008) [2023-12-25 23:51:59,456][123090] Updated weights for policy 1, policy_version 37172 (0.0010) [2023-12-25 23:51:59,522][123090] Updated weights for policy 1, policy_version 37182 (0.0010) [2023-12-25 23:51:59,725][123091] Updated weights for policy 0, policy_version 36970 (0.0009) [2023-12-25 23:51:59,783][123091] Updated weights for policy 0, policy_version 36980 (0.0010) [2023-12-25 23:51:59,850][123091] Updated weights for policy 0, policy_version 36990 (0.0007) [2023-12-25 23:52:00,399][123090] Updated weights for policy 1, policy_version 37192 (0.0010) [2023-12-25 23:52:00,456][123090] Updated weights for policy 1, policy_version 37202 (0.0008) [2023-12-25 23:52:00,503][123090] Updated weights for policy 1, policy_version 37212 (0.0009) [2023-12-25 23:52:00,652][123091] Updated weights for policy 0, policy_version 37000 (0.0005) [2023-12-25 23:52:00,698][123091] Updated weights for policy 0, policy_version 37010 (0.0007) [2023-12-25 23:52:00,751][123091] Updated weights for policy 0, policy_version 37020 (0.0006) [2023-12-25 23:52:01,347][123090] Updated weights for policy 1, policy_version 37222 (0.0008) [2023-12-25 23:52:01,417][123090] Updated weights for policy 1, policy_version 37232 (0.0009) [2023-12-25 23:52:01,485][123090] Updated weights for policy 1, policy_version 37242 (0.0009) [2023-12-25 23:52:01,501][123091] Updated weights for policy 0, policy_version 37030 (0.0007) [2023-12-25 23:52:01,563][123091] Updated weights for policy 0, policy_version 37040 (0.0008) [2023-12-25 23:52:01,618][123091] Updated weights for policy 0, policy_version 37050 (0.0009) [2023-12-25 23:52:02,253][123090] Updated weights for policy 1, policy_version 37252 (0.0010) [2023-12-25 23:52:02,323][123090] Updated weights for policy 1, policy_version 37262 (0.0010) [2023-12-25 23:52:02,367][123091] Updated weights for policy 0, policy_version 37060 (0.0008) [2023-12-25 23:52:02,382][123090] Updated weights for policy 1, policy_version 37272 (0.0008) [2023-12-25 23:52:02,419][123091] Updated weights for policy 0, policy_version 37070 (0.0009) [2023-12-25 23:52:02,474][123091] Updated weights for policy 0, policy_version 37080 (0.0010) [2023-12-25 23:52:03,219][123090] Updated weights for policy 1, policy_version 37282 (0.0008) [2023-12-25 23:52:03,266][123091] Updated weights for policy 0, policy_version 37090 (0.0009) [2023-12-25 23:52:03,278][123090] Updated weights for policy 1, policy_version 37292 (0.0009) [2023-12-25 23:52:03,329][123091] Updated weights for policy 0, policy_version 37100 (0.0005) [2023-12-25 23:52:03,333][123090] Updated weights for policy 1, policy_version 37302 (0.0008) [2023-12-25 23:52:03,384][123091] Updated weights for policy 0, policy_version 37110 (0.0008) [2023-12-25 23:52:03,387][123090] Updated weights for policy 1, policy_version 37312 (0.0008) [2023-12-25 23:52:03,431][123091] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-12-25 23:52:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 19054592. Throughput: 0: 9102.6, 1: 8480.3. Samples: 19064780. Policy #0 lag: (min: 2.0, avg: 16.1, max: 34.0) [2023-12-25 23:52:03,785][121949] Avg episode reward: [(0, '4252.462'), (1, '4534.513')] [2023-12-25 23:52:04,213][123091] Updated weights for policy 0, policy_version 37130 (0.0008) [2023-12-25 23:52:04,250][123090] Updated weights for policy 1, policy_version 37322 (0.0009) [2023-12-25 23:52:04,266][123091] Updated weights for policy 0, policy_version 37140 (0.0007) [2023-12-25 23:52:04,311][123090] Updated weights for policy 1, policy_version 37332 (0.0010) [2023-12-25 23:52:04,323][123091] Updated weights for policy 0, policy_version 37150 (0.0008) [2023-12-25 23:52:04,363][123090] Updated weights for policy 1, policy_version 37342 (0.0008) [2023-12-25 23:52:05,088][123091] Updated weights for policy 0, policy_version 37160 (0.0006) [2023-12-25 23:52:05,148][123091] Updated weights for policy 0, policy_version 37170 (0.0006) [2023-12-25 23:52:05,214][123091] Updated weights for policy 0, policy_version 37180 (0.0005) [2023-12-25 23:52:05,272][123090] Updated weights for policy 1, policy_version 37352 (0.0009) [2023-12-25 23:52:05,330][123090] Updated weights for policy 1, policy_version 37363 (0.0010) [2023-12-25 23:52:05,385][123090] Updated weights for policy 1, policy_version 37373 (0.0010) [2023-12-25 23:52:05,925][123091] Updated weights for policy 0, policy_version 37190 (0.0005) [2023-12-25 23:52:05,982][123091] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-12-25 23:52:06,042][123091] Updated weights for policy 0, policy_version 37210 (0.0009) [2023-12-25 23:52:06,323][123090] Updated weights for policy 1, policy_version 37383 (0.0009) [2023-12-25 23:52:06,385][123090] Updated weights for policy 1, policy_version 37393 (0.0009) [2023-12-25 23:52:06,455][123090] Updated weights for policy 1, policy_version 37403 (0.0009) [2023-12-25 23:52:06,887][123091] Updated weights for policy 0, policy_version 37220 (0.0010) [2023-12-25 23:52:06,958][123091] Updated weights for policy 0, policy_version 37230 (0.0010) [2023-12-25 23:52:07,023][123091] Updated weights for policy 0, policy_version 37240 (0.0009) [2023-12-25 23:52:07,292][123090] Updated weights for policy 1, policy_version 37413 (0.0009) [2023-12-25 23:52:07,360][123090] Updated weights for policy 1, policy_version 37423 (0.0009) [2023-12-25 23:52:07,429][123090] Updated weights for policy 1, policy_version 37433 (0.0009) [2023-12-25 23:52:07,807][123091] Updated weights for policy 0, policy_version 37250 (0.0011) [2023-12-25 23:52:07,867][123091] Updated weights for policy 0, policy_version 37260 (0.0009) [2023-12-25 23:52:07,920][123091] Updated weights for policy 0, policy_version 37270 (0.0009) [2023-12-25 23:52:07,966][123091] Updated weights for policy 0, policy_version 37280 (0.0008) [2023-12-25 23:52:08,268][123090] Updated weights for policy 1, policy_version 37443 (0.0009) [2023-12-25 23:52:08,338][123090] Updated weights for policy 1, policy_version 37453 (0.0010) [2023-12-25 23:52:08,411][123090] Updated weights for policy 1, policy_version 37463 (0.0009) [2023-12-25 23:52:08,759][123091] Updated weights for policy 0, policy_version 37290 (0.0009) [2023-12-25 23:52:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 19136512. Throughput: 0: 9142.2, 1: 8475.7. Samples: 19116716. Policy #0 lag: (min: 2.0, avg: 16.1, max: 34.0) [2023-12-25 23:52:08,785][121949] Avg episode reward: [(0, '4148.094'), (1, '4587.127')] [2023-12-25 23:52:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000037472_9592832.pth... [2023-12-25 23:52:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036512_9347072.pth [2023-12-25 23:52:08,825][123091] Updated weights for policy 0, policy_version 37300 (0.0009) [2023-12-25 23:52:08,884][123091] Updated weights for policy 0, policy_version 37310 (0.0009) [2023-12-25 23:52:08,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000037312_9551872.pth... [2023-12-25 23:52:08,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000036224_9273344.pth [2023-12-25 23:52:09,270][123090] Updated weights for policy 1, policy_version 37473 (0.0010) [2023-12-25 23:52:09,339][123090] Updated weights for policy 1, policy_version 37483 (0.0010) [2023-12-25 23:52:09,408][123090] Updated weights for policy 1, policy_version 37493 (0.0009) [2023-12-25 23:52:09,479][123090] Updated weights for policy 1, policy_version 37503 (0.0009) [2023-12-25 23:52:09,647][123091] Updated weights for policy 0, policy_version 37320 (0.0010) [2023-12-25 23:52:09,708][123091] Updated weights for policy 0, policy_version 37330 (0.0009) [2023-12-25 23:52:09,779][123091] Updated weights for policy 0, policy_version 37340 (0.0010) [2023-12-25 23:52:10,268][123090] Updated weights for policy 1, policy_version 37513 (0.0009) [2023-12-25 23:52:10,322][123090] Updated weights for policy 1, policy_version 37523 (0.0009) [2023-12-25 23:52:10,377][123090] Updated weights for policy 1, policy_version 37533 (0.0009) [2023-12-25 23:52:10,615][123091] Updated weights for policy 0, policy_version 37350 (0.0007) [2023-12-25 23:52:10,668][123091] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-12-25 23:52:10,728][123091] Updated weights for policy 0, policy_version 37370 (0.0005) [2023-12-25 23:52:11,170][123090] Updated weights for policy 1, policy_version 37543 (0.0009) [2023-12-25 23:52:11,230][123090] Updated weights for policy 1, policy_version 37553 (0.0009) [2023-12-25 23:52:11,298][123090] Updated weights for policy 1, policy_version 37563 (0.0011) [2023-12-25 23:52:11,525][123091] Updated weights for policy 0, policy_version 37380 (0.0007) [2023-12-25 23:52:11,593][123091] Updated weights for policy 0, policy_version 37390 (0.0009) [2023-12-25 23:52:11,664][123091] Updated weights for policy 0, policy_version 37400 (0.0010) [2023-12-25 23:52:12,134][123090] Updated weights for policy 1, policy_version 37573 (0.0011) [2023-12-25 23:52:12,202][123090] Updated weights for policy 1, policy_version 37583 (0.0011) [2023-12-25 23:52:12,275][123090] Updated weights for policy 1, policy_version 37593 (0.0011) [2023-12-25 23:52:12,468][123091] Updated weights for policy 0, policy_version 37410 (0.0009) [2023-12-25 23:52:12,525][123091] Updated weights for policy 0, policy_version 37420 (0.0005) [2023-12-25 23:52:12,574][123091] Updated weights for policy 0, policy_version 37430 (0.0005) [2023-12-25 23:52:12,638][123091] Updated weights for policy 0, policy_version 37440 (0.0008) [2023-12-25 23:52:13,111][123090] Updated weights for policy 1, policy_version 37603 (0.0009) [2023-12-25 23:52:13,171][123090] Updated weights for policy 1, policy_version 37613 (0.0007) [2023-12-25 23:52:13,226][123090] Updated weights for policy 1, policy_version 37623 (0.0006) [2023-12-25 23:52:13,380][123091] Updated weights for policy 0, policy_version 37450 (0.0010) [2023-12-25 23:52:13,432][123091] Updated weights for policy 0, policy_version 37460 (0.0009) [2023-12-25 23:52:13,491][123091] Updated weights for policy 0, policy_version 37470 (0.0009) [2023-12-25 23:52:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 19226624. Throughput: 0: 9077.9, 1: 8410.5. Samples: 19220128. Policy #0 lag: (min: 2.0, avg: 16.1, max: 34.0) [2023-12-25 23:52:13,785][121949] Avg episode reward: [(0, '4108.403'), (1, '4629.395')] [2023-12-25 23:52:13,787][123008] Saving new best policy, reward=4629.395! [2023-12-25 23:52:13,837][123090] Updated weights for policy 1, policy_version 37633 (0.0005) [2023-12-25 23:52:13,892][123090] Updated weights for policy 1, policy_version 37643 (0.0005) [2023-12-25 23:52:13,940][123090] Updated weights for policy 1, policy_version 37653 (0.0005) [2023-12-25 23:52:13,988][123090] Updated weights for policy 1, policy_version 37663 (0.0005) [2023-12-25 23:52:14,433][123091] Updated weights for policy 0, policy_version 37480 (0.0009) [2023-12-25 23:52:14,498][123091] Updated weights for policy 0, policy_version 37490 (0.0009) [2023-12-25 23:52:14,559][123091] Updated weights for policy 0, policy_version 37500 (0.0009) [2023-12-25 23:52:14,700][123090] Updated weights for policy 1, policy_version 37673 (0.0007) [2023-12-25 23:52:14,778][123090] Updated weights for policy 1, policy_version 37683 (0.0006) [2023-12-25 23:52:14,839][123090] Updated weights for policy 1, policy_version 37693 (0.0006) [2023-12-25 23:52:15,390][123090] Updated weights for policy 1, policy_version 37703 (0.0009) [2023-12-25 23:52:15,454][123090] Updated weights for policy 1, policy_version 37713 (0.0011) [2023-12-25 23:52:15,463][123091] Updated weights for policy 0, policy_version 37510 (0.0010) [2023-12-25 23:52:15,502][123090] Updated weights for policy 1, policy_version 37723 (0.0010) [2023-12-25 23:52:15,527][123091] Updated weights for policy 0, policy_version 37520 (0.0006) [2023-12-25 23:52:15,579][123091] Updated weights for policy 0, policy_version 37530 (0.0008) [2023-12-25 23:52:16,171][123090] Updated weights for policy 1, policy_version 37733 (0.0008) [2023-12-25 23:52:16,226][123090] Updated weights for policy 1, policy_version 37743 (0.0006) [2023-12-25 23:52:16,285][123090] Updated weights for policy 1, policy_version 37753 (0.0005) [2023-12-25 23:52:16,402][123091] Updated weights for policy 0, policy_version 37540 (0.0007) [2023-12-25 23:52:16,452][123091] Updated weights for policy 0, policy_version 37550 (0.0005) [2023-12-25 23:52:16,502][123091] Updated weights for policy 0, policy_version 37560 (0.0005) [2023-12-25 23:52:17,036][123090] Updated weights for policy 1, policy_version 37763 (0.0007) [2023-12-25 23:52:17,092][123090] Updated weights for policy 1, policy_version 37773 (0.0010) [2023-12-25 23:52:17,150][123090] Updated weights for policy 1, policy_version 37783 (0.0010) [2023-12-25 23:52:17,275][123091] Updated weights for policy 0, policy_version 37570 (0.0009) [2023-12-25 23:52:17,348][123091] Updated weights for policy 0, policy_version 37580 (0.0009) [2023-12-25 23:52:17,417][123091] Updated weights for policy 0, policy_version 37590 (0.0010) [2023-12-25 23:52:17,478][123091] Updated weights for policy 0, policy_version 37600 (0.0009) [2023-12-25 23:52:17,935][123090] Updated weights for policy 1, policy_version 37793 (0.0010) [2023-12-25 23:52:17,999][123090] Updated weights for policy 1, policy_version 37803 (0.0009) [2023-12-25 23:52:18,074][123090] Updated weights for policy 1, policy_version 37813 (0.0006) [2023-12-25 23:52:18,139][123090] Updated weights for policy 1, policy_version 37823 (0.0008) [2023-12-25 23:52:18,353][123091] Updated weights for policy 0, policy_version 37610 (0.0009) [2023-12-25 23:52:18,410][123091] Updated weights for policy 0, policy_version 37620 (0.0009) [2023-12-25 23:52:18,477][123091] Updated weights for policy 0, policy_version 37630 (0.0010) [2023-12-25 23:52:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 19316736. Throughput: 0: 9021.1, 1: 8491.0. Samples: 19328352. Policy #0 lag: (min: 2.0, avg: 16.1, max: 34.0) [2023-12-25 23:52:18,784][121949] Avg episode reward: [(0, '4205.866'), (1, '4616.231')] [2023-12-25 23:52:18,932][123090] Updated weights for policy 1, policy_version 37833 (0.0009) [2023-12-25 23:52:18,993][123090] Updated weights for policy 1, policy_version 37843 (0.0009) [2023-12-25 23:52:19,048][123090] Updated weights for policy 1, policy_version 37853 (0.0009) [2023-12-25 23:52:19,357][123091] Updated weights for policy 0, policy_version 37640 (0.0009) [2023-12-25 23:52:19,413][123091] Updated weights for policy 0, policy_version 37650 (0.0007) [2023-12-25 23:52:19,470][123091] Updated weights for policy 0, policy_version 37660 (0.0009) [2023-12-25 23:52:19,964][123090] Updated weights for policy 1, policy_version 37863 (0.0009) [2023-12-25 23:52:20,026][123090] Updated weights for policy 1, policy_version 37873 (0.0010) [2023-12-25 23:52:20,089][123090] Updated weights for policy 1, policy_version 37883 (0.0010) [2023-12-25 23:52:20,283][123091] Updated weights for policy 0, policy_version 37670 (0.0009) [2023-12-25 23:52:20,350][123091] Updated weights for policy 0, policy_version 37680 (0.0009) [2023-12-25 23:52:20,404][123091] Updated weights for policy 0, policy_version 37690 (0.0009) [2023-12-25 23:52:20,933][123090] Updated weights for policy 1, policy_version 37893 (0.0010) [2023-12-25 23:52:20,999][123090] Updated weights for policy 1, policy_version 37903 (0.0009) [2023-12-25 23:52:21,073][123090] Updated weights for policy 1, policy_version 37913 (0.0010) [2023-12-25 23:52:21,250][123091] Updated weights for policy 0, policy_version 37700 (0.0009) [2023-12-25 23:52:21,324][123091] Updated weights for policy 0, policy_version 37710 (0.0010) [2023-12-25 23:52:21,394][123091] Updated weights for policy 0, policy_version 37720 (0.0010) [2023-12-25 23:52:21,936][123090] Updated weights for policy 1, policy_version 37923 (0.0010) [2023-12-25 23:52:21,997][123090] Updated weights for policy 1, policy_version 37933 (0.0010) [2023-12-25 23:52:22,059][123090] Updated weights for policy 1, policy_version 37943 (0.0009) [2023-12-25 23:52:22,268][123091] Updated weights for policy 0, policy_version 37730 (0.0009) [2023-12-25 23:52:22,319][123091] Updated weights for policy 0, policy_version 37740 (0.0010) [2023-12-25 23:52:22,388][123091] Updated weights for policy 0, policy_version 37750 (0.0009) [2023-12-25 23:52:22,461][123091] Updated weights for policy 0, policy_version 37760 (0.0009) [2023-12-25 23:52:22,897][123090] Updated weights for policy 1, policy_version 37953 (0.0010) [2023-12-25 23:52:22,965][123090] Updated weights for policy 1, policy_version 37963 (0.0009) [2023-12-25 23:52:23,034][123090] Updated weights for policy 1, policy_version 37973 (0.0010) [2023-12-25 23:52:23,105][123090] Updated weights for policy 1, policy_version 37983 (0.0009) [2023-12-25 23:52:23,322][123091] Updated weights for policy 0, policy_version 37770 (0.0009) [2023-12-25 23:52:23,370][123091] Updated weights for policy 0, policy_version 37780 (0.0009) [2023-12-25 23:52:23,429][123091] Updated weights for policy 0, policy_version 37790 (0.0009) [2023-12-25 23:52:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 19398656. Throughput: 0: 8938.1, 1: 8460.1. Samples: 19377608. Policy #0 lag: (min: 2.0, avg: 16.1, max: 34.0) [2023-12-25 23:52:23,786][121949] Avg episode reward: [(0, '4192.272'), (1, '4599.538')] [2023-12-25 23:52:23,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000037792_9674752.pth... [2023-12-25 23:52:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000037984_9723904.pth... [2023-12-25 23:52:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000036768_9412608.pth [2023-12-25 23:52:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000036992_9469952.pth [2023-12-25 23:52:23,911][123090] Updated weights for policy 1, policy_version 37993 (0.0009) [2023-12-25 23:52:23,961][123090] Updated weights for policy 1, policy_version 38003 (0.0010) [2023-12-25 23:52:24,012][123090] Updated weights for policy 1, policy_version 38013 (0.0010) [2023-12-25 23:52:24,267][123091] Updated weights for policy 0, policy_version 37800 (0.0009) [2023-12-25 23:52:24,320][123091] Updated weights for policy 0, policy_version 37810 (0.0008) [2023-12-25 23:52:24,389][123091] Updated weights for policy 0, policy_version 37820 (0.0006) [2023-12-25 23:52:24,773][123090] Updated weights for policy 1, policy_version 38023 (0.0009) [2023-12-25 23:52:24,824][123090] Updated weights for policy 1, policy_version 38033 (0.0009) [2023-12-25 23:52:24,872][123090] Updated weights for policy 1, policy_version 38043 (0.0008) [2023-12-25 23:52:25,238][123091] Updated weights for policy 0, policy_version 37830 (0.0009) [2023-12-25 23:52:25,291][123091] Updated weights for policy 0, policy_version 37841 (0.0009) [2023-12-25 23:52:25,350][123091] Updated weights for policy 0, policy_version 37851 (0.0009) [2023-12-25 23:52:25,701][123090] Updated weights for policy 1, policy_version 38053 (0.0010) [2023-12-25 23:52:25,757][123090] Updated weights for policy 1, policy_version 38063 (0.0010) [2023-12-25 23:52:25,804][123090] Updated weights for policy 1, policy_version 38073 (0.0010) [2023-12-25 23:52:26,040][123091] Updated weights for policy 0, policy_version 37861 (0.0008) [2023-12-25 23:52:26,109][123091] Updated weights for policy 0, policy_version 37871 (0.0009) [2023-12-25 23:52:26,165][123091] Updated weights for policy 0, policy_version 37881 (0.0009) [2023-12-25 23:52:26,575][123090] Updated weights for policy 1, policy_version 38083 (0.0010) [2023-12-25 23:52:26,622][123090] Updated weights for policy 1, policy_version 38093 (0.0010) [2023-12-25 23:52:26,672][123090] Updated weights for policy 1, policy_version 38103 (0.0010) [2023-12-25 23:52:26,961][123091] Updated weights for policy 0, policy_version 37891 (0.0008) [2023-12-25 23:52:27,016][123091] Updated weights for policy 0, policy_version 37901 (0.0006) [2023-12-25 23:52:27,063][123091] Updated weights for policy 0, policy_version 37911 (0.0005) [2023-12-25 23:52:27,511][123090] Updated weights for policy 1, policy_version 38113 (0.0010) [2023-12-25 23:52:27,562][123090] Updated weights for policy 1, policy_version 38123 (0.0010) [2023-12-25 23:52:27,632][123090] Updated weights for policy 1, policy_version 38133 (0.0010) [2023-12-25 23:52:27,688][123090] Updated weights for policy 1, policy_version 38143 (0.0010) [2023-12-25 23:52:27,834][123091] Updated weights for policy 0, policy_version 37921 (0.0005) [2023-12-25 23:52:27,898][123091] Updated weights for policy 0, policy_version 37931 (0.0008) [2023-12-25 23:52:27,947][123091] Updated weights for policy 0, policy_version 37941 (0.0006) [2023-12-25 23:52:27,990][123091] Updated weights for policy 0, policy_version 37951 (0.0007) [2023-12-25 23:52:28,504][123090] Updated weights for policy 1, policy_version 38153 (0.0010) [2023-12-25 23:52:28,563][123090] Updated weights for policy 1, policy_version 38163 (0.0010) [2023-12-25 23:52:28,628][123090] Updated weights for policy 1, policy_version 38173 (0.0009) [2023-12-25 23:52:28,706][123091] Updated weights for policy 0, policy_version 37961 (0.0009) [2023-12-25 23:52:28,754][123091] Updated weights for policy 0, policy_version 37971 (0.0009) [2023-12-25 23:52:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 19488768. Throughput: 0: 8945.3, 1: 8535.0. Samples: 19483204. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:52:28,785][121949] Avg episode reward: [(0, '4093.791'), (1, '4625.304')] [2023-12-25 23:52:28,803][123091] Updated weights for policy 0, policy_version 37981 (0.0009) [2023-12-25 23:52:29,432][123090] Updated weights for policy 1, policy_version 38183 (0.0007) [2023-12-25 23:52:29,485][123090] Updated weights for policy 1, policy_version 38193 (0.0005) [2023-12-25 23:52:29,532][123090] Updated weights for policy 1, policy_version 38203 (0.0005) [2023-12-25 23:52:29,635][123091] Updated weights for policy 0, policy_version 37991 (0.0009) [2023-12-25 23:52:29,686][123091] Updated weights for policy 0, policy_version 38001 (0.0010) [2023-12-25 23:52:29,741][123091] Updated weights for policy 0, policy_version 38011 (0.0010) [2023-12-25 23:52:30,245][123090] Updated weights for policy 1, policy_version 38213 (0.0005) [2023-12-25 23:52:30,310][123090] Updated weights for policy 1, policy_version 38223 (0.0005) [2023-12-25 23:52:30,391][123090] Updated weights for policy 1, policy_version 38233 (0.0006) [2023-12-25 23:52:30,560][123091] Updated weights for policy 0, policy_version 38021 (0.0008) [2023-12-25 23:52:30,616][123091] Updated weights for policy 0, policy_version 38031 (0.0009) [2023-12-25 23:52:30,670][123091] Updated weights for policy 0, policy_version 38041 (0.0009) [2023-12-25 23:52:31,059][123090] Updated weights for policy 1, policy_version 38243 (0.0007) [2023-12-25 23:52:31,127][123090] Updated weights for policy 1, policy_version 38253 (0.0008) [2023-12-25 23:52:31,194][123090] Updated weights for policy 1, policy_version 38263 (0.0009) [2023-12-25 23:52:31,420][123091] Updated weights for policy 0, policy_version 38051 (0.0006) [2023-12-25 23:52:31,483][123091] Updated weights for policy 0, policy_version 38061 (0.0011) [2023-12-25 23:52:31,530][123091] Updated weights for policy 0, policy_version 38071 (0.0010) [2023-12-25 23:52:31,939][123090] Updated weights for policy 1, policy_version 38273 (0.0009) [2023-12-25 23:52:31,991][123090] Updated weights for policy 1, policy_version 38283 (0.0009) [2023-12-25 23:52:32,055][123090] Updated weights for policy 1, policy_version 38293 (0.0008) [2023-12-25 23:52:32,122][123090] Updated weights for policy 1, policy_version 38303 (0.0009) [2023-12-25 23:52:32,355][123091] Updated weights for policy 0, policy_version 38081 (0.0008) [2023-12-25 23:52:32,426][123091] Updated weights for policy 0, policy_version 38091 (0.0011) [2023-12-25 23:52:32,488][123091] Updated weights for policy 0, policy_version 38101 (0.0010) [2023-12-25 23:52:32,554][123091] Updated weights for policy 0, policy_version 38111 (0.0011) [2023-12-25 23:52:32,956][123090] Updated weights for policy 1, policy_version 38313 (0.0009) [2023-12-25 23:52:33,027][123090] Updated weights for policy 1, policy_version 38323 (0.0009) [2023-12-25 23:52:33,091][123090] Updated weights for policy 1, policy_version 38333 (0.0009) [2023-12-25 23:52:33,354][123091] Updated weights for policy 0, policy_version 38121 (0.0010) [2023-12-25 23:52:33,408][123091] Updated weights for policy 0, policy_version 38131 (0.0009) [2023-12-25 23:52:33,458][123091] Updated weights for policy 0, policy_version 38141 (0.0010) [2023-12-25 23:52:33,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 19578880. Throughput: 0: 8880.2, 1: 8688.6. Samples: 19591856. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:52:33,784][121949] Avg episode reward: [(0, '4045.997'), (1, '4616.162')] [2023-12-25 23:52:33,904][123090] Updated weights for policy 1, policy_version 38343 (0.0009) [2023-12-25 23:52:33,951][123090] Updated weights for policy 1, policy_version 38353 (0.0008) [2023-12-25 23:52:33,998][123090] Updated weights for policy 1, policy_version 38363 (0.0008) [2023-12-25 23:52:34,303][123091] Updated weights for policy 0, policy_version 38151 (0.0011) [2023-12-25 23:52:34,370][123091] Updated weights for policy 0, policy_version 38161 (0.0011) [2023-12-25 23:52:34,434][123091] Updated weights for policy 0, policy_version 38171 (0.0010) [2023-12-25 23:52:34,848][123090] Updated weights for policy 1, policy_version 38373 (0.0009) [2023-12-25 23:52:34,903][123090] Updated weights for policy 1, policy_version 38383 (0.0008) [2023-12-25 23:52:34,978][123090] Updated weights for policy 1, policy_version 38393 (0.0010) [2023-12-25 23:52:35,243][123091] Updated weights for policy 0, policy_version 38181 (0.0010) [2023-12-25 23:52:35,293][123091] Updated weights for policy 0, policy_version 38191 (0.0008) [2023-12-25 23:52:35,344][123091] Updated weights for policy 0, policy_version 38201 (0.0006) [2023-12-25 23:52:35,846][123090] Updated weights for policy 1, policy_version 38403 (0.0009) [2023-12-25 23:52:35,912][123090] Updated weights for policy 1, policy_version 38413 (0.0010) [2023-12-25 23:52:35,991][123090] Updated weights for policy 1, policy_version 38423 (0.0010) [2023-12-25 23:52:36,020][123091] Updated weights for policy 0, policy_version 38211 (0.0005) [2023-12-25 23:52:36,070][123091] Updated weights for policy 0, policy_version 38221 (0.0005) [2023-12-25 23:52:36,135][123091] Updated weights for policy 0, policy_version 38231 (0.0007) [2023-12-25 23:52:36,789][123090] Updated weights for policy 1, policy_version 38433 (0.0009) [2023-12-25 23:52:36,861][123090] Updated weights for policy 1, policy_version 38443 (0.0009) [2023-12-25 23:52:36,906][123091] Updated weights for policy 0, policy_version 38241 (0.0006) [2023-12-25 23:52:36,931][123090] Updated weights for policy 1, policy_version 38453 (0.0010) [2023-12-25 23:52:36,982][123091] Updated weights for policy 0, policy_version 38251 (0.0006) [2023-12-25 23:52:37,000][123090] Updated weights for policy 1, policy_version 38463 (0.0009) [2023-12-25 23:52:37,048][123091] Updated weights for policy 0, policy_version 38261 (0.0009) [2023-12-25 23:52:37,107][123091] Updated weights for policy 0, policy_version 38271 (0.0009) [2023-12-25 23:52:37,807][123090] Updated weights for policy 1, policy_version 38473 (0.0009) [2023-12-25 23:52:37,867][123090] Updated weights for policy 1, policy_version 38484 (0.0010) [2023-12-25 23:52:37,897][123091] Updated weights for policy 0, policy_version 38281 (0.0008) [2023-12-25 23:52:37,925][123090] Updated weights for policy 1, policy_version 38494 (0.0009) [2023-12-25 23:52:37,949][123091] Updated weights for policy 0, policy_version 38291 (0.0009) [2023-12-25 23:52:38,004][123091] Updated weights for policy 0, policy_version 38301 (0.0009) [2023-12-25 23:52:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 19660800. Throughput: 0: 8890.9, 1: 8708.8. Samples: 19644716. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:52:38,785][121949] Avg episode reward: [(0, '4104.263'), (1, '4612.992')] [2023-12-25 23:52:38,802][123090] Updated weights for policy 1, policy_version 38504 (0.0009) [2023-12-25 23:52:38,832][123091] Updated weights for policy 0, policy_version 38311 (0.0009) [2023-12-25 23:52:38,867][123090] Updated weights for policy 1, policy_version 38514 (0.0009) [2023-12-25 23:52:38,897][123091] Updated weights for policy 0, policy_version 38321 (0.0007) [2023-12-25 23:52:38,929][123090] Updated weights for policy 1, policy_version 38524 (0.0010) [2023-12-25 23:52:38,953][123091] Updated weights for policy 0, policy_version 38331 (0.0007) [2023-12-25 23:52:38,953][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000038528_9863168.pth... [2023-12-25 23:52:38,958][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000037472_9592832.pth [2023-12-25 23:52:38,976][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000038336_9814016.pth... [2023-12-25 23:52:38,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000037312_9551872.pth [2023-12-25 23:52:39,769][123091] Updated weights for policy 0, policy_version 38341 (0.0010) [2023-12-25 23:52:39,813][123090] Updated weights for policy 1, policy_version 38534 (0.0009) [2023-12-25 23:52:39,842][123091] Updated weights for policy 0, policy_version 38351 (0.0009) [2023-12-25 23:52:39,884][123090] Updated weights for policy 1, policy_version 38544 (0.0009) [2023-12-25 23:52:39,904][123091] Updated weights for policy 0, policy_version 38361 (0.0008) [2023-12-25 23:52:39,958][123090] Updated weights for policy 1, policy_version 38554 (0.0007) [2023-12-25 23:52:40,700][123091] Updated weights for policy 0, policy_version 38371 (0.0008) [2023-12-25 23:52:40,755][123090] Updated weights for policy 1, policy_version 38564 (0.0008) [2023-12-25 23:52:40,758][123091] Updated weights for policy 0, policy_version 38381 (0.0008) [2023-12-25 23:52:40,822][123091] Updated weights for policy 0, policy_version 38391 (0.0009) [2023-12-25 23:52:40,822][123090] Updated weights for policy 1, policy_version 38574 (0.0011) [2023-12-25 23:52:40,886][123090] Updated weights for policy 1, policy_version 38584 (0.0011) [2023-12-25 23:52:41,649][123091] Updated weights for policy 0, policy_version 38401 (0.0006) [2023-12-25 23:52:41,699][123090] Updated weights for policy 1, policy_version 38594 (0.0010) [2023-12-25 23:52:41,718][123091] Updated weights for policy 0, policy_version 38411 (0.0009) [2023-12-25 23:52:41,768][123090] Updated weights for policy 1, policy_version 38604 (0.0007) [2023-12-25 23:52:41,798][123091] Updated weights for policy 0, policy_version 38421 (0.0009) [2023-12-25 23:52:41,829][123090] Updated weights for policy 1, policy_version 38614 (0.0007) [2023-12-25 23:52:41,863][123091] Updated weights for policy 0, policy_version 38431 (0.0009) [2023-12-25 23:52:41,890][123090] Updated weights for policy 1, policy_version 38624 (0.0007) [2023-12-25 23:52:42,693][123091] Updated weights for policy 0, policy_version 38441 (0.0006) [2023-12-25 23:52:42,726][123090] Updated weights for policy 1, policy_version 38634 (0.0005) [2023-12-25 23:52:42,759][123091] Updated weights for policy 0, policy_version 38451 (0.0006) [2023-12-25 23:52:42,786][123090] Updated weights for policy 1, policy_version 38644 (0.0007) [2023-12-25 23:52:42,821][123091] Updated weights for policy 0, policy_version 38461 (0.0006) [2023-12-25 23:52:42,864][123090] Updated weights for policy 1, policy_version 38654 (0.0005) [2023-12-25 23:52:43,350][123091] Updated weights for policy 0, policy_version 38471 (0.0005) [2023-12-25 23:52:43,411][123091] Updated weights for policy 0, policy_version 38481 (0.0007) [2023-12-25 23:52:43,467][123091] Updated weights for policy 0, policy_version 38491 (0.0011) [2023-12-25 23:52:43,533][123090] Updated weights for policy 1, policy_version 38664 (0.0008) [2023-12-25 23:52:43,592][123090] Updated weights for policy 1, policy_version 38674 (0.0008) [2023-12-25 23:52:43,653][123090] Updated weights for policy 1, policy_version 38684 (0.0009) [2023-12-25 23:52:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 19759104. Throughput: 0: 8826.0, 1: 8670.4. Samples: 19746588. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:52:43,785][121949] Avg episode reward: [(0, '3903.310'), (1, '4674.041')] [2023-12-25 23:52:43,786][123008] Saving new best policy, reward=4674.041! [2023-12-25 23:52:44,280][123091] Updated weights for policy 0, policy_version 38501 (0.0011) [2023-12-25 23:52:44,343][123091] Updated weights for policy 0, policy_version 38511 (0.0010) [2023-12-25 23:52:44,346][123090] Updated weights for policy 1, policy_version 38694 (0.0007) [2023-12-25 23:52:44,391][123091] Updated weights for policy 0, policy_version 38521 (0.0010) [2023-12-25 23:52:44,406][123090] Updated weights for policy 1, policy_version 38704 (0.0006) [2023-12-25 23:52:44,462][123090] Updated weights for policy 1, policy_version 38714 (0.0007) [2023-12-25 23:52:45,191][123090] Updated weights for policy 1, policy_version 38724 (0.0009) [2023-12-25 23:52:45,202][123091] Updated weights for policy 0, policy_version 38531 (0.0011) [2023-12-25 23:52:45,254][123090] Updated weights for policy 1, policy_version 38734 (0.0008) [2023-12-25 23:52:45,266][123091] Updated weights for policy 0, policy_version 38541 (0.0011) [2023-12-25 23:52:45,319][123090] Updated weights for policy 1, policy_version 38744 (0.0007) [2023-12-25 23:52:45,325][123091] Updated weights for policy 0, policy_version 38551 (0.0010) [2023-12-25 23:52:46,117][123091] Updated weights for policy 0, policy_version 38561 (0.0010) [2023-12-25 23:52:46,131][123090] Updated weights for policy 1, policy_version 38754 (0.0007) [2023-12-25 23:52:46,182][123091] Updated weights for policy 0, policy_version 38571 (0.0010) [2023-12-25 23:52:46,189][123090] Updated weights for policy 1, policy_version 38764 (0.0007) [2023-12-25 23:52:46,238][123091] Updated weights for policy 0, policy_version 38581 (0.0011) [2023-12-25 23:52:46,241][123090] Updated weights for policy 1, policy_version 38774 (0.0007) [2023-12-25 23:52:46,297][123090] Updated weights for policy 1, policy_version 38784 (0.0008) [2023-12-25 23:52:46,305][123091] Updated weights for policy 0, policy_version 38591 (0.0011) [2023-12-25 23:52:47,111][123091] Updated weights for policy 0, policy_version 38601 (0.0010) [2023-12-25 23:52:47,132][123090] Updated weights for policy 1, policy_version 38794 (0.0007) [2023-12-25 23:52:47,170][123091] Updated weights for policy 0, policy_version 38611 (0.0010) [2023-12-25 23:52:47,191][123090] Updated weights for policy 1, policy_version 38804 (0.0007) [2023-12-25 23:52:47,236][123091] Updated weights for policy 0, policy_version 38621 (0.0011) [2023-12-25 23:52:47,244][123090] Updated weights for policy 1, policy_version 38814 (0.0008) [2023-12-25 23:52:48,030][123090] Updated weights for policy 1, policy_version 38824 (0.0010) [2023-12-25 23:52:48,069][123091] Updated weights for policy 0, policy_version 38631 (0.0011) [2023-12-25 23:52:48,102][123090] Updated weights for policy 1, policy_version 38834 (0.0006) [2023-12-25 23:52:48,138][123091] Updated weights for policy 0, policy_version 38641 (0.0011) [2023-12-25 23:52:48,163][123090] Updated weights for policy 1, policy_version 38844 (0.0006) [2023-12-25 23:52:48,203][123091] Updated weights for policy 0, policy_version 38651 (0.0011) [2023-12-25 23:52:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 19841024. Throughput: 0: 8763.2, 1: 8814.4. Samples: 19855772. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-25 23:52:48,785][121949] Avg episode reward: [(0, '3899.440'), (1, '4675.479')] [2023-12-25 23:52:48,786][123008] Saving new best policy, reward=4675.479! [2023-12-25 23:52:48,901][123090] Updated weights for policy 1, policy_version 38854 (0.0008) [2023-12-25 23:52:48,960][123090] Updated weights for policy 1, policy_version 38864 (0.0008) [2023-12-25 23:52:49,022][123090] Updated weights for policy 1, policy_version 38874 (0.0008) [2023-12-25 23:52:49,044][123091] Updated weights for policy 0, policy_version 38661 (0.0010) [2023-12-25 23:52:49,088][123091] Updated weights for policy 0, policy_version 38671 (0.0010) [2023-12-25 23:52:49,136][123091] Updated weights for policy 0, policy_version 38681 (0.0010) [2023-12-25 23:52:49,786][123090] Updated weights for policy 1, policy_version 38884 (0.0009) [2023-12-25 23:52:49,845][123090] Updated weights for policy 1, policy_version 38894 (0.0011) [2023-12-25 23:52:49,897][123090] Updated weights for policy 1, policy_version 38904 (0.0010) [2023-12-25 23:52:50,020][123091] Updated weights for policy 0, policy_version 38691 (0.0011) [2023-12-25 23:52:50,085][123091] Updated weights for policy 0, policy_version 38701 (0.0011) [2023-12-25 23:52:50,144][123091] Updated weights for policy 0, policy_version 38711 (0.0011) [2023-12-25 23:52:50,630][123090] Updated weights for policy 1, policy_version 38914 (0.0007) [2023-12-25 23:52:50,703][123090] Updated weights for policy 1, policy_version 38924 (0.0006) [2023-12-25 23:52:50,778][123090] Updated weights for policy 1, policy_version 38934 (0.0006) [2023-12-25 23:52:50,855][123090] Updated weights for policy 1, policy_version 38944 (0.0005) [2023-12-25 23:52:50,969][123091] Updated weights for policy 0, policy_version 38721 (0.0010) [2023-12-25 23:52:51,033][123091] Updated weights for policy 0, policy_version 38731 (0.0011) [2023-12-25 23:52:51,100][123091] Updated weights for policy 0, policy_version 38741 (0.0010) [2023-12-25 23:52:51,161][123091] Updated weights for policy 0, policy_version 38751 (0.0010) [2023-12-25 23:52:51,587][123090] Updated weights for policy 1, policy_version 38955 (0.0009) [2023-12-25 23:52:51,662][123090] Updated weights for policy 1, policy_version 38965 (0.0007) [2023-12-25 23:52:51,730][123090] Updated weights for policy 1, policy_version 38975 (0.0006) [2023-12-25 23:52:51,994][123091] Updated weights for policy 0, policy_version 38761 (0.0006) [2023-12-25 23:52:52,051][123091] Updated weights for policy 0, policy_version 38771 (0.0007) [2023-12-25 23:52:52,120][123091] Updated weights for policy 0, policy_version 38781 (0.0007) [2023-12-25 23:52:52,438][123090] Updated weights for policy 1, policy_version 38985 (0.0006) [2023-12-25 23:52:52,499][123090] Updated weights for policy 1, policy_version 38995 (0.0007) [2023-12-25 23:52:52,557][123090] Updated weights for policy 1, policy_version 39005 (0.0006) [2023-12-25 23:52:52,832][123091] Updated weights for policy 0, policy_version 38791 (0.0008) [2023-12-25 23:52:52,894][123091] Updated weights for policy 0, policy_version 38801 (0.0011) [2023-12-25 23:52:52,952][123091] Updated weights for policy 0, policy_version 38811 (0.0006) [2023-12-25 23:52:53,376][123090] Updated weights for policy 1, policy_version 39015 (0.0007) [2023-12-25 23:52:53,431][123090] Updated weights for policy 1, policy_version 39025 (0.0005) [2023-12-25 23:52:53,499][123090] Updated weights for policy 1, policy_version 39035 (0.0005) [2023-12-25 23:52:53,680][123091] Updated weights for policy 0, policy_version 38821 (0.0005) [2023-12-25 23:52:53,737][123091] Updated weights for policy 0, policy_version 38831 (0.0005) [2023-12-25 23:52:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 19931136. Throughput: 0: 8701.1, 1: 8891.8. Samples: 19908396. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:52:53,785][121949] Avg episode reward: [(0, '3927.104'), (1, '4652.049')] [2023-12-25 23:52:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000039040_9994240.pth... [2023-12-25 23:52:53,795][123091] Updated weights for policy 0, policy_version 38841 (0.0005) [2023-12-25 23:52:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000037984_9723904.pth [2023-12-25 23:52:53,839][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000038848_9945088.pth... [2023-12-25 23:52:53,846][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000037792_9674752.pth [2023-12-25 23:52:54,233][123090] Updated weights for policy 1, policy_version 39045 (0.0005) [2023-12-25 23:52:54,288][123090] Updated weights for policy 1, policy_version 39055 (0.0005) [2023-12-25 23:52:54,338][123090] Updated weights for policy 1, policy_version 39065 (0.0005) [2023-12-25 23:52:54,510][123091] Updated weights for policy 0, policy_version 38851 (0.0006) [2023-12-25 23:52:54,578][123091] Updated weights for policy 0, policy_version 38861 (0.0006) [2023-12-25 23:52:54,645][123091] Updated weights for policy 0, policy_version 38871 (0.0008) [2023-12-25 23:52:55,141][123090] Updated weights for policy 1, policy_version 39075 (0.0006) [2023-12-25 23:52:55,196][123090] Updated weights for policy 1, policy_version 39085 (0.0009) [2023-12-25 23:52:55,262][123090] Updated weights for policy 1, policy_version 39095 (0.0008) [2023-12-25 23:52:55,325][123091] Updated weights for policy 0, policy_version 38881 (0.0007) [2023-12-25 23:52:55,376][123091] Updated weights for policy 0, policy_version 38891 (0.0010) [2023-12-25 23:52:55,419][123091] Updated weights for policy 0, policy_version 38901 (0.0010) [2023-12-25 23:52:55,470][123091] Updated weights for policy 0, policy_version 38911 (0.0010) [2023-12-25 23:52:56,110][123090] Updated weights for policy 1, policy_version 39105 (0.0009) [2023-12-25 23:52:56,167][123090] Updated weights for policy 1, policy_version 39115 (0.0010) [2023-12-25 23:52:56,212][123091] Updated weights for policy 0, policy_version 38921 (0.0006) [2023-12-25 23:52:56,224][123090] Updated weights for policy 1, policy_version 39125 (0.0007) [2023-12-25 23:52:56,260][123091] Updated weights for policy 0, policy_version 38931 (0.0005) [2023-12-25 23:52:56,272][123090] Updated weights for policy 1, policy_version 39135 (0.0008) [2023-12-25 23:52:56,304][123091] Updated weights for policy 0, policy_version 38941 (0.0005) [2023-12-25 23:52:56,968][123091] Updated weights for policy 0, policy_version 38951 (0.0005) [2023-12-25 23:52:57,013][123091] Updated weights for policy 0, policy_version 38961 (0.0005) [2023-12-25 23:52:57,065][123091] Updated weights for policy 0, policy_version 38971 (0.0006) [2023-12-25 23:52:57,218][123090] Updated weights for policy 1, policy_version 39145 (0.0009) [2023-12-25 23:52:57,273][123090] Updated weights for policy 1, policy_version 39155 (0.0009) [2023-12-25 23:52:57,334][123090] Updated weights for policy 1, policy_version 39165 (0.0010) [2023-12-25 23:52:57,683][123091] Updated weights for policy 0, policy_version 38981 (0.0006) [2023-12-25 23:52:57,748][123091] Updated weights for policy 0, policy_version 38991 (0.0006) [2023-12-25 23:52:57,802][123091] Updated weights for policy 0, policy_version 39001 (0.0006) [2023-12-25 23:52:58,299][123090] Updated weights for policy 1, policy_version 39175 (0.0010) [2023-12-25 23:52:58,366][123090] Updated weights for policy 1, policy_version 39185 (0.0009) [2023-12-25 23:52:58,433][123090] Updated weights for policy 1, policy_version 39195 (0.0009) [2023-12-25 23:52:58,519][123091] Updated weights for policy 0, policy_version 39011 (0.0007) [2023-12-25 23:52:58,593][123091] Updated weights for policy 0, policy_version 39021 (0.0008) [2023-12-25 23:52:58,663][123091] Updated weights for policy 0, policy_version 39031 (0.0011) [2023-12-25 23:52:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 20029440. Throughput: 0: 8864.0, 1: 8908.4. Samples: 20019880. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:52:58,785][121949] Avg episode reward: [(0, '3954.452'), (1, '4601.968')] [2023-12-25 23:52:59,361][123090] Updated weights for policy 1, policy_version 39205 (0.0008) [2023-12-25 23:52:59,442][123090] Updated weights for policy 1, policy_version 39215 (0.0009) [2023-12-25 23:52:59,487][123091] Updated weights for policy 0, policy_version 39041 (0.0009) [2023-12-25 23:52:59,505][123090] Updated weights for policy 1, policy_version 39225 (0.0011) [2023-12-25 23:52:59,547][123091] Updated weights for policy 0, policy_version 39051 (0.0011) [2023-12-25 23:52:59,606][123091] Updated weights for policy 0, policy_version 39061 (0.0011) [2023-12-25 23:52:59,673][123091] Updated weights for policy 0, policy_version 39071 (0.0007) [2023-12-25 23:53:00,268][123090] Updated weights for policy 1, policy_version 39235 (0.0009) [2023-12-25 23:53:00,327][123090] Updated weights for policy 1, policy_version 39245 (0.0006) [2023-12-25 23:53:00,332][123091] Updated weights for policy 0, policy_version 39081 (0.0006) [2023-12-25 23:53:00,382][123090] Updated weights for policy 1, policy_version 39255 (0.0007) [2023-12-25 23:53:00,421][123091] Updated weights for policy 0, policy_version 39091 (0.0010) [2023-12-25 23:53:00,476][123091] Updated weights for policy 0, policy_version 39101 (0.0011) [2023-12-25 23:53:01,188][123090] Updated weights for policy 1, policy_version 39265 (0.0006) [2023-12-25 23:53:01,194][123091] Updated weights for policy 0, policy_version 39111 (0.0007) [2023-12-25 23:53:01,238][123090] Updated weights for policy 1, policy_version 39275 (0.0006) [2023-12-25 23:53:01,259][123091] Updated weights for policy 0, policy_version 39121 (0.0007) [2023-12-25 23:53:01,300][123090] Updated weights for policy 1, policy_version 39285 (0.0006) [2023-12-25 23:53:01,324][123091] Updated weights for policy 0, policy_version 39131 (0.0009) [2023-12-25 23:53:01,366][123090] Updated weights for policy 1, policy_version 39295 (0.0008) [2023-12-25 23:53:02,122][123091] Updated weights for policy 0, policy_version 39141 (0.0008) [2023-12-25 23:53:02,157][123090] Updated weights for policy 1, policy_version 39305 (0.0009) [2023-12-25 23:53:02,178][123091] Updated weights for policy 0, policy_version 39151 (0.0006) [2023-12-25 23:53:02,220][123090] Updated weights for policy 1, policy_version 39315 (0.0010) [2023-12-25 23:53:02,231][123091] Updated weights for policy 0, policy_version 39161 (0.0009) [2023-12-25 23:53:02,284][123090] Updated weights for policy 1, policy_version 39325 (0.0010) [2023-12-25 23:53:03,094][123091] Updated weights for policy 0, policy_version 39171 (0.0009) [2023-12-25 23:53:03,114][123090] Updated weights for policy 1, policy_version 39335 (0.0010) [2023-12-25 23:53:03,156][123091] Updated weights for policy 0, policy_version 39181 (0.0011) [2023-12-25 23:53:03,172][123090] Updated weights for policy 1, policy_version 39345 (0.0010) [2023-12-25 23:53:03,218][123091] Updated weights for policy 0, policy_version 39191 (0.0010) [2023-12-25 23:53:03,231][123090] Updated weights for policy 1, policy_version 39355 (0.0010) [2023-12-25 23:53:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 20111360. Throughput: 0: 8964.8, 1: 8732.0. Samples: 20124712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:53:03,785][121949] Avg episode reward: [(0, '3999.039'), (1, '4662.528')] [2023-12-25 23:53:03,954][123091] Updated weights for policy 0, policy_version 39201 (0.0010) [2023-12-25 23:53:04,004][123091] Updated weights for policy 0, policy_version 39211 (0.0006) [2023-12-25 23:53:04,057][123090] Updated weights for policy 1, policy_version 39365 (0.0010) [2023-12-25 23:53:04,070][123091] Updated weights for policy 0, policy_version 39221 (0.0005) [2023-12-25 23:53:04,113][123090] Updated weights for policy 1, policy_version 39375 (0.0011) [2023-12-25 23:53:04,134][123091] Updated weights for policy 0, policy_version 39231 (0.0006) [2023-12-25 23:53:04,161][123090] Updated weights for policy 1, policy_version 39385 (0.0008) [2023-12-25 23:53:04,850][123091] Updated weights for policy 0, policy_version 39241 (0.0008) [2023-12-25 23:53:04,916][123091] Updated weights for policy 0, policy_version 39251 (0.0010) [2023-12-25 23:53:04,966][123091] Updated weights for policy 0, policy_version 39261 (0.0010) [2023-12-25 23:53:05,004][123090] Updated weights for policy 1, policy_version 39395 (0.0009) [2023-12-25 23:53:05,063][123090] Updated weights for policy 1, policy_version 39405 (0.0005) [2023-12-25 23:53:05,125][123090] Updated weights for policy 1, policy_version 39415 (0.0005) [2023-12-25 23:53:05,703][123091] Updated weights for policy 0, policy_version 39271 (0.0007) [2023-12-25 23:53:05,778][123091] Updated weights for policy 0, policy_version 39281 (0.0007) [2023-12-25 23:53:05,848][123091] Updated weights for policy 0, policy_version 39291 (0.0007) [2023-12-25 23:53:05,855][123090] Updated weights for policy 1, policy_version 39425 (0.0006) [2023-12-25 23:53:05,915][123090] Updated weights for policy 1, policy_version 39435 (0.0010) [2023-12-25 23:53:05,974][123090] Updated weights for policy 1, policy_version 39445 (0.0010) [2023-12-25 23:53:06,034][123090] Updated weights for policy 1, policy_version 39455 (0.0010) [2023-12-25 23:53:06,487][123091] Updated weights for policy 0, policy_version 39301 (0.0007) [2023-12-25 23:53:06,559][123091] Updated weights for policy 0, policy_version 39311 (0.0006) [2023-12-25 23:53:06,634][123091] Updated weights for policy 0, policy_version 39321 (0.0005) [2023-12-25 23:53:06,971][123090] Updated weights for policy 1, policy_version 39465 (0.0009) [2023-12-25 23:53:07,036][123090] Updated weights for policy 1, policy_version 39475 (0.0009) [2023-12-25 23:53:07,097][123090] Updated weights for policy 1, policy_version 39485 (0.0009) [2023-12-25 23:53:07,324][123091] Updated weights for policy 0, policy_version 39331 (0.0006) [2023-12-25 23:53:07,387][123091] Updated weights for policy 0, policy_version 39341 (0.0005) [2023-12-25 23:53:07,457][123091] Updated weights for policy 0, policy_version 39351 (0.0005) [2023-12-25 23:53:07,894][123090] Updated weights for policy 1, policy_version 39495 (0.0010) [2023-12-25 23:53:07,957][123090] Updated weights for policy 1, policy_version 39505 (0.0010) [2023-12-25 23:53:08,013][123090] Updated weights for policy 1, policy_version 39515 (0.0010) [2023-12-25 23:53:08,137][123091] Updated weights for policy 0, policy_version 39361 (0.0005) [2023-12-25 23:53:08,196][123091] Updated weights for policy 0, policy_version 39371 (0.0005) [2023-12-25 23:53:08,249][123091] Updated weights for policy 0, policy_version 39381 (0.0006) [2023-12-25 23:53:08,304][123091] Updated weights for policy 0, policy_version 39391 (0.0005) [2023-12-25 23:53:08,758][123090] Updated weights for policy 1, policy_version 39525 (0.0009) [2023-12-25 23:53:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 20201472. Throughput: 0: 9062.3, 1: 8765.7. Samples: 20179864. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:53:08,785][121949] Avg episode reward: [(0, '3978.673'), (1, '4702.036')] [2023-12-25 23:53:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000039392_10084352.pth... [2023-12-25 23:53:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000038336_9814016.pth [2023-12-25 23:53:08,825][123090] Updated weights for policy 1, policy_version 39535 (0.0009) [2023-12-25 23:53:08,892][123090] Updated weights for policy 1, policy_version 39545 (0.0010) [2023-12-25 23:53:08,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000039552_10125312.pth... [2023-12-25 23:53:08,946][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000038528_9863168.pth [2023-12-25 23:53:08,947][123008] Saving new best policy, reward=4702.036! [2023-12-25 23:53:09,044][123091] Updated weights for policy 0, policy_version 39401 (0.0010) [2023-12-25 23:53:09,111][123091] Updated weights for policy 0, policy_version 39411 (0.0011) [2023-12-25 23:53:09,175][123091] Updated weights for policy 0, policy_version 39421 (0.0010) [2023-12-25 23:53:09,779][123090] Updated weights for policy 1, policy_version 39555 (0.0010) [2023-12-25 23:53:09,856][123090] Updated weights for policy 1, policy_version 39565 (0.0012) [2023-12-25 23:53:09,931][123090] Updated weights for policy 1, policy_version 39575 (0.0008) [2023-12-25 23:53:10,035][123091] Updated weights for policy 0, policy_version 39431 (0.0008) [2023-12-25 23:53:10,109][123091] Updated weights for policy 0, policy_version 39441 (0.0009) [2023-12-25 23:53:10,174][123091] Updated weights for policy 0, policy_version 39451 (0.0009) [2023-12-25 23:53:10,734][123090] Updated weights for policy 1, policy_version 39585 (0.0008) [2023-12-25 23:53:10,792][123090] Updated weights for policy 1, policy_version 39595 (0.0010) [2023-12-25 23:53:10,857][123090] Updated weights for policy 1, policy_version 39605 (0.0009) [2023-12-25 23:53:10,919][123090] Updated weights for policy 1, policy_version 39615 (0.0010) [2023-12-25 23:53:10,993][123091] Updated weights for policy 0, policy_version 39461 (0.0008) [2023-12-25 23:53:11,065][123091] Updated weights for policy 0, policy_version 39471 (0.0009) [2023-12-25 23:53:11,124][123091] Updated weights for policy 0, policy_version 39481 (0.0010) [2023-12-25 23:53:11,760][123090] Updated weights for policy 1, policy_version 39625 (0.0008) [2023-12-25 23:53:11,822][123090] Updated weights for policy 1, policy_version 39636 (0.0009) [2023-12-25 23:53:11,890][123090] Updated weights for policy 1, policy_version 39646 (0.0010) [2023-12-25 23:53:11,893][123091] Updated weights for policy 0, policy_version 39491 (0.0007) [2023-12-25 23:53:11,951][123091] Updated weights for policy 0, policy_version 39501 (0.0009) [2023-12-25 23:53:12,013][123091] Updated weights for policy 0, policy_version 39511 (0.0009) [2023-12-25 23:53:12,661][123090] Updated weights for policy 1, policy_version 39656 (0.0010) [2023-12-25 23:53:12,724][123090] Updated weights for policy 1, policy_version 39666 (0.0010) [2023-12-25 23:53:12,802][123090] Updated weights for policy 1, policy_version 39676 (0.0008) [2023-12-25 23:53:12,819][123091] Updated weights for policy 0, policy_version 39521 (0.0009) [2023-12-25 23:53:12,877][123091] Updated weights for policy 0, policy_version 39531 (0.0010) [2023-12-25 23:53:12,935][123091] Updated weights for policy 0, policy_version 39541 (0.0010) [2023-12-25 23:53:12,998][123091] Updated weights for policy 0, policy_version 39551 (0.0008) [2023-12-25 23:53:13,585][123090] Updated weights for policy 1, policy_version 39686 (0.0008) [2023-12-25 23:53:13,632][123090] Updated weights for policy 1, policy_version 39696 (0.0008) [2023-12-25 23:53:13,688][123090] Updated weights for policy 1, policy_version 39707 (0.0009) [2023-12-25 23:53:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 20291584. Throughput: 0: 9101.1, 1: 8725.1. Samples: 20285388. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:53:13,785][121949] Avg episode reward: [(0, '3816.724'), (1, '4724.926')] [2023-12-25 23:53:13,786][123008] Saving new best policy, reward=4724.926! [2023-12-25 23:53:13,841][123091] Updated weights for policy 0, policy_version 39561 (0.0010) [2023-12-25 23:53:13,892][123091] Updated weights for policy 0, policy_version 39571 (0.0010) [2023-12-25 23:53:13,955][123091] Updated weights for policy 0, policy_version 39581 (0.0011) [2023-12-25 23:53:14,581][123090] Updated weights for policy 1, policy_version 39717 (0.0009) [2023-12-25 23:53:14,640][123090] Updated weights for policy 1, policy_version 39727 (0.0009) [2023-12-25 23:53:14,685][123091] Updated weights for policy 0, policy_version 39591 (0.0007) [2023-12-25 23:53:14,707][123090] Updated weights for policy 1, policy_version 39737 (0.0009) [2023-12-25 23:53:14,742][123091] Updated weights for policy 0, policy_version 39601 (0.0006) [2023-12-25 23:53:14,802][123091] Updated weights for policy 0, policy_version 39611 (0.0006) [2023-12-25 23:53:15,561][123091] Updated weights for policy 0, policy_version 39621 (0.0006) [2023-12-25 23:53:15,585][123090] Updated weights for policy 1, policy_version 39747 (0.0008) [2023-12-25 23:53:15,629][123091] Updated weights for policy 0, policy_version 39631 (0.0011) [2023-12-25 23:53:15,651][123090] Updated weights for policy 1, policy_version 39757 (0.0010) [2023-12-25 23:53:15,688][123091] Updated weights for policy 0, policy_version 39641 (0.0011) [2023-12-25 23:53:15,713][123090] Updated weights for policy 1, policy_version 39767 (0.0006) [2023-12-25 23:53:16,453][123091] Updated weights for policy 0, policy_version 39651 (0.0009) [2023-12-25 23:53:16,498][123091] Updated weights for policy 0, policy_version 39661 (0.0005) [2023-12-25 23:53:16,545][123091] Updated weights for policy 0, policy_version 39671 (0.0005) [2023-12-25 23:53:16,571][123090] Updated weights for policy 1, policy_version 39777 (0.0008) [2023-12-25 23:53:16,643][123090] Updated weights for policy 1, policy_version 39787 (0.0008) [2023-12-25 23:53:16,713][123090] Updated weights for policy 1, policy_version 39797 (0.0008) [2023-12-25 23:53:16,776][123090] Updated weights for policy 1, policy_version 39807 (0.0010) [2023-12-25 23:53:17,296][123091] Updated weights for policy 0, policy_version 39681 (0.0006) [2023-12-25 23:53:17,364][123091] Updated weights for policy 0, policy_version 39691 (0.0006) [2023-12-25 23:53:17,438][123091] Updated weights for policy 0, policy_version 39701 (0.0008) [2023-12-25 23:53:17,503][123091] Updated weights for policy 0, policy_version 39711 (0.0010) [2023-12-25 23:53:17,639][123090] Updated weights for policy 1, policy_version 39817 (0.0008) [2023-12-25 23:53:17,706][123090] Updated weights for policy 1, policy_version 39827 (0.0009) [2023-12-25 23:53:17,771][123090] Updated weights for policy 1, policy_version 39837 (0.0009) [2023-12-25 23:53:18,253][123091] Updated weights for policy 0, policy_version 39721 (0.0011) [2023-12-25 23:53:18,317][123091] Updated weights for policy 0, policy_version 39731 (0.0009) [2023-12-25 23:53:18,404][123091] Updated weights for policy 0, policy_version 39742 (0.0011) [2023-12-25 23:53:18,633][123090] Updated weights for policy 1, policy_version 39847 (0.0009) [2023-12-25 23:53:18,703][123090] Updated weights for policy 1, policy_version 39857 (0.0009) [2023-12-25 23:53:18,774][123090] Updated weights for policy 1, policy_version 39867 (0.0009) [2023-12-25 23:53:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 20373504. Throughput: 0: 9121.8, 1: 8596.5. Samples: 20389184. Policy #0 lag: (min: 13.0, avg: 22.3, max: 45.0) [2023-12-25 23:53:18,785][121949] Avg episode reward: [(0, '3939.567'), (1, '4623.079')] [2023-12-25 23:53:19,257][123091] Updated weights for policy 0, policy_version 39752 (0.0009) [2023-12-25 23:53:19,323][123091] Updated weights for policy 0, policy_version 39762 (0.0008) [2023-12-25 23:53:19,388][123091] Updated weights for policy 0, policy_version 39772 (0.0007) [2023-12-25 23:53:19,586][123090] Updated weights for policy 1, policy_version 39877 (0.0009) [2023-12-25 23:53:19,653][123090] Updated weights for policy 1, policy_version 39887 (0.0009) [2023-12-25 23:53:19,720][123090] Updated weights for policy 1, policy_version 39897 (0.0009) [2023-12-25 23:53:20,171][123091] Updated weights for policy 0, policy_version 39782 (0.0008) [2023-12-25 23:53:20,231][123091] Updated weights for policy 0, policy_version 39792 (0.0010) [2023-12-25 23:53:20,296][123091] Updated weights for policy 0, policy_version 39802 (0.0010) [2023-12-25 23:53:20,566][123090] Updated weights for policy 1, policy_version 39907 (0.0010) [2023-12-25 23:53:20,639][123090] Updated weights for policy 1, policy_version 39917 (0.0010) [2023-12-25 23:53:20,709][123090] Updated weights for policy 1, policy_version 39927 (0.0010) [2023-12-25 23:53:21,140][123091] Updated weights for policy 0, policy_version 39812 (0.0010) [2023-12-25 23:53:21,200][123091] Updated weights for policy 0, policy_version 39822 (0.0010) [2023-12-25 23:53:21,276][123091] Updated weights for policy 0, policy_version 39832 (0.0010) [2023-12-25 23:53:21,631][123090] Updated weights for policy 1, policy_version 39937 (0.0011) [2023-12-25 23:53:21,693][123090] Updated weights for policy 1, policy_version 39947 (0.0009) [2023-12-25 23:53:21,756][123090] Updated weights for policy 1, policy_version 39957 (0.0008) [2023-12-25 23:53:21,808][123090] Updated weights for policy 1, policy_version 39967 (0.0010) [2023-12-25 23:53:22,114][123091] Updated weights for policy 0, policy_version 39842 (0.0009) [2023-12-25 23:53:22,168][123091] Updated weights for policy 0, policy_version 39852 (0.0010) [2023-12-25 23:53:22,227][123091] Updated weights for policy 0, policy_version 39863 (0.0010) [2023-12-25 23:53:22,678][123090] Updated weights for policy 1, policy_version 39977 (0.0009) [2023-12-25 23:53:22,731][123090] Updated weights for policy 1, policy_version 39987 (0.0008) [2023-12-25 23:53:22,787][123090] Updated weights for policy 1, policy_version 39997 (0.0009) [2023-12-25 23:53:23,105][123091] Updated weights for policy 0, policy_version 39873 (0.0010) [2023-12-25 23:53:23,171][123091] Updated weights for policy 0, policy_version 39883 (0.0011) [2023-12-25 23:53:23,226][123091] Updated weights for policy 0, policy_version 39893 (0.0011) [2023-12-25 23:53:23,284][123091] Updated weights for policy 0, policy_version 39903 (0.0011) [2023-12-25 23:53:23,650][123090] Updated weights for policy 1, policy_version 40007 (0.0009) [2023-12-25 23:53:23,719][123090] Updated weights for policy 1, policy_version 40017 (0.0009) [2023-12-25 23:53:23,784][123090] Updated weights for policy 1, policy_version 40027 (0.0008) [2023-12-25 23:53:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 20455424. Throughput: 0: 9064.8, 1: 8587.6. Samples: 20439072. Policy #0 lag: (min: 13.0, avg: 22.3, max: 45.0) [2023-12-25 23:53:23,785][121949] Avg episode reward: [(0, '4136.823'), (1, '4591.280')] [2023-12-25 23:53:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000039904_10215424.pth... [2023-12-25 23:53:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000038848_9945088.pth [2023-12-25 23:53:23,814][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000040032_10248192.pth... [2023-12-25 23:53:23,818][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000039040_9994240.pth [2023-12-25 23:53:24,112][123091] Updated weights for policy 0, policy_version 39913 (0.0006) [2023-12-25 23:53:24,165][123091] Updated weights for policy 0, policy_version 39923 (0.0005) [2023-12-25 23:53:24,210][123091] Updated weights for policy 0, policy_version 39933 (0.0005) [2023-12-25 23:53:24,671][123090] Updated weights for policy 1, policy_version 40037 (0.0009) [2023-12-25 23:53:24,725][123090] Updated weights for policy 1, policy_version 40047 (0.0010) [2023-12-25 23:53:24,781][123090] Updated weights for policy 1, policy_version 40059 (0.0011) [2023-12-25 23:53:24,870][123091] Updated weights for policy 0, policy_version 39943 (0.0006) [2023-12-25 23:53:24,923][123091] Updated weights for policy 0, policy_version 39953 (0.0006) [2023-12-25 23:53:24,978][123091] Updated weights for policy 0, policy_version 39963 (0.0005) [2023-12-25 23:53:25,599][123091] Updated weights for policy 0, policy_version 39973 (0.0005) [2023-12-25 23:53:25,671][123091] Updated weights for policy 0, policy_version 39983 (0.0005) [2023-12-25 23:53:25,732][123091] Updated weights for policy 0, policy_version 39993 (0.0010) [2023-12-25 23:53:25,740][123090] Updated weights for policy 1, policy_version 40070 (0.0008) [2023-12-25 23:53:25,800][123090] Updated weights for policy 1, policy_version 40080 (0.0009) [2023-12-25 23:53:25,881][123090] Updated weights for policy 1, policy_version 40090 (0.0010) [2023-12-25 23:53:26,300][123091] Updated weights for policy 0, policy_version 40003 (0.0006) [2023-12-25 23:53:26,355][123091] Updated weights for policy 0, policy_version 40013 (0.0005) [2023-12-25 23:53:26,401][123091] Updated weights for policy 0, policy_version 40023 (0.0005) [2023-12-25 23:53:26,810][123090] Updated weights for policy 1, policy_version 40100 (0.0010) [2023-12-25 23:53:26,865][123090] Updated weights for policy 1, policy_version 40111 (0.0010) [2023-12-25 23:53:26,924][123090] Updated weights for policy 1, policy_version 40121 (0.0010) [2023-12-25 23:53:27,053][123091] Updated weights for policy 0, policy_version 40033 (0.0005) [2023-12-25 23:53:27,119][123091] Updated weights for policy 0, policy_version 40043 (0.0006) [2023-12-25 23:53:27,183][123091] Updated weights for policy 0, policy_version 40053 (0.0010) [2023-12-25 23:53:27,243][123091] Updated weights for policy 0, policy_version 40063 (0.0009) [2023-12-25 23:53:27,834][123090] Updated weights for policy 1, policy_version 40131 (0.0010) [2023-12-25 23:53:27,877][123091] Updated weights for policy 0, policy_version 40073 (0.0005) [2023-12-25 23:53:27,883][123090] Updated weights for policy 1, policy_version 40141 (0.0008) [2023-12-25 23:53:27,933][123090] Updated weights for policy 1, policy_version 40151 (0.0009) [2023-12-25 23:53:27,936][123091] Updated weights for policy 0, policy_version 40083 (0.0006) [2023-12-25 23:53:27,986][123091] Updated weights for policy 0, policy_version 40093 (0.0006) [2023-12-25 23:53:28,686][123091] Updated weights for policy 0, policy_version 40103 (0.0008) [2023-12-25 23:53:28,737][123091] Updated weights for policy 0, policy_version 40113 (0.0008) [2023-12-25 23:53:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 20545536. Throughput: 0: 9220.3, 1: 8532.2. Samples: 20545448. Policy #0 lag: (min: 13.0, avg: 22.3, max: 45.0) [2023-12-25 23:53:28,785][121949] Avg episode reward: [(0, '4001.070'), (1, '4633.318')] [2023-12-25 23:53:28,794][123091] Updated weights for policy 0, policy_version 40123 (0.0009) [2023-12-25 23:53:28,842][123090] Updated weights for policy 1, policy_version 40161 (0.0009) [2023-12-25 23:53:28,903][123090] Updated weights for policy 1, policy_version 40171 (0.0009) [2023-12-25 23:53:28,961][123090] Updated weights for policy 1, policy_version 40181 (0.0009) [2023-12-25 23:53:29,013][123090] Updated weights for policy 1, policy_version 40191 (0.0010) [2023-12-25 23:53:29,584][123091] Updated weights for policy 0, policy_version 40133 (0.0009) [2023-12-25 23:53:29,648][123091] Updated weights for policy 0, policy_version 40143 (0.0010) [2023-12-25 23:53:29,713][123091] Updated weights for policy 0, policy_version 40153 (0.0009) [2023-12-25 23:53:29,926][123090] Updated weights for policy 1, policy_version 40202 (0.0010) [2023-12-25 23:53:29,989][123090] Updated weights for policy 1, policy_version 40212 (0.0010) [2023-12-25 23:53:30,045][123090] Updated weights for policy 1, policy_version 40222 (0.0009) [2023-12-25 23:53:30,542][123091] Updated weights for policy 0, policy_version 40163 (0.0009) [2023-12-25 23:53:30,594][123091] Updated weights for policy 0, policy_version 40174 (0.0009) [2023-12-25 23:53:30,646][123091] Updated weights for policy 0, policy_version 40184 (0.0009) [2023-12-25 23:53:30,902][123090] Updated weights for policy 1, policy_version 40232 (0.0010) [2023-12-25 23:53:30,954][123090] Updated weights for policy 1, policy_version 40242 (0.0009) [2023-12-25 23:53:31,011][123090] Updated weights for policy 1, policy_version 40252 (0.0009) [2023-12-25 23:53:31,428][123091] Updated weights for policy 0, policy_version 40194 (0.0011) [2023-12-25 23:53:31,472][123091] Updated weights for policy 0, policy_version 40204 (0.0011) [2023-12-25 23:53:31,526][123091] Updated weights for policy 0, policy_version 40214 (0.0010) [2023-12-25 23:53:31,579][123091] Updated weights for policy 0, policy_version 40224 (0.0006) [2023-12-25 23:53:31,893][123090] Updated weights for policy 1, policy_version 40262 (0.0008) [2023-12-25 23:53:31,949][123090] Updated weights for policy 1, policy_version 40272 (0.0005) [2023-12-25 23:53:32,015][123090] Updated weights for policy 1, policy_version 40282 (0.0005) [2023-12-25 23:53:32,216][123091] Updated weights for policy 0, policy_version 40234 (0.0006) [2023-12-25 23:53:32,266][123091] Updated weights for policy 0, policy_version 40244 (0.0006) [2023-12-25 23:53:32,320][123091] Updated weights for policy 0, policy_version 40254 (0.0007) [2023-12-25 23:53:32,742][123090] Updated weights for policy 1, policy_version 40292 (0.0007) [2023-12-25 23:53:32,795][123090] Updated weights for policy 1, policy_version 40302 (0.0009) [2023-12-25 23:53:32,845][123090] Updated weights for policy 1, policy_version 40313 (0.0009) [2023-12-25 23:53:33,090][123091] Updated weights for policy 0, policy_version 40264 (0.0009) [2023-12-25 23:53:33,154][123091] Updated weights for policy 0, policy_version 40274 (0.0008) [2023-12-25 23:53:33,219][123091] Updated weights for policy 0, policy_version 40284 (0.0008) [2023-12-25 23:53:33,612][123090] Updated weights for policy 1, policy_version 40324 (0.0008) [2023-12-25 23:53:33,678][123090] Updated weights for policy 1, policy_version 40334 (0.0005) [2023-12-25 23:53:33,731][123090] Updated weights for policy 1, policy_version 40344 (0.0005) [2023-12-25 23:53:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 20643840. Throughput: 0: 9284.5, 1: 8426.9. Samples: 20652784. Policy #0 lag: (min: 13.0, avg: 22.3, max: 45.0) [2023-12-25 23:53:33,784][121949] Avg episode reward: [(0, '3932.835'), (1, '4664.032')] [2023-12-25 23:53:33,997][123091] Updated weights for policy 0, policy_version 40294 (0.0006) [2023-12-25 23:53:34,054][123091] Updated weights for policy 0, policy_version 40304 (0.0007) [2023-12-25 23:53:34,118][123091] Updated weights for policy 0, policy_version 40314 (0.0007) [2023-12-25 23:53:34,477][123090] Updated weights for policy 1, policy_version 40354 (0.0006) [2023-12-25 23:53:34,537][123090] Updated weights for policy 1, policy_version 40364 (0.0009) [2023-12-25 23:53:34,609][123090] Updated weights for policy 1, policy_version 40374 (0.0007) [2023-12-25 23:53:34,677][123090] Updated weights for policy 1, policy_version 40384 (0.0006) [2023-12-25 23:53:34,850][123091] Updated weights for policy 0, policy_version 40324 (0.0007) [2023-12-25 23:53:34,918][123091] Updated weights for policy 0, policy_version 40334 (0.0006) [2023-12-25 23:53:34,977][123091] Updated weights for policy 0, policy_version 40344 (0.0005) [2023-12-25 23:53:35,437][123090] Updated weights for policy 1, policy_version 40394 (0.0010) [2023-12-25 23:53:35,493][123090] Updated weights for policy 1, policy_version 40404 (0.0010) [2023-12-25 23:53:35,540][123090] Updated weights for policy 1, policy_version 40414 (0.0010) [2023-12-25 23:53:35,665][123091] Updated weights for policy 0, policy_version 40354 (0.0006) [2023-12-25 23:53:35,725][123091] Updated weights for policy 0, policy_version 40364 (0.0005) [2023-12-25 23:53:35,772][123091] Updated weights for policy 0, policy_version 40374 (0.0007) [2023-12-25 23:53:35,822][123091] Updated weights for policy 0, policy_version 40384 (0.0010) [2023-12-25 23:53:36,312][123090] Updated weights for policy 1, policy_version 40424 (0.0008) [2023-12-25 23:53:36,367][123090] Updated weights for policy 1, policy_version 40434 (0.0009) [2023-12-25 23:53:36,438][123090] Updated weights for policy 1, policy_version 40444 (0.0007) [2023-12-25 23:53:36,650][123091] Updated weights for policy 0, policy_version 40394 (0.0010) [2023-12-25 23:53:36,724][123091] Updated weights for policy 0, policy_version 40404 (0.0009) [2023-12-25 23:53:36,793][123091] Updated weights for policy 0, policy_version 40414 (0.0009) [2023-12-25 23:53:37,161][123090] Updated weights for policy 1, policy_version 40454 (0.0006) [2023-12-25 23:53:37,217][123090] Updated weights for policy 1, policy_version 40464 (0.0005) [2023-12-25 23:53:37,266][123090] Updated weights for policy 1, policy_version 40474 (0.0006) [2023-12-25 23:53:37,612][123091] Updated weights for policy 0, policy_version 40424 (0.0008) [2023-12-25 23:53:37,671][123091] Updated weights for policy 0, policy_version 40434 (0.0010) [2023-12-25 23:53:37,729][123091] Updated weights for policy 0, policy_version 40444 (0.0010) [2023-12-25 23:53:38,057][123090] Updated weights for policy 1, policy_version 40484 (0.0007) [2023-12-25 23:53:38,125][123090] Updated weights for policy 1, policy_version 40494 (0.0009) [2023-12-25 23:53:38,182][123090] Updated weights for policy 1, policy_version 40504 (0.0010) [2023-12-25 23:53:38,549][123091] Updated weights for policy 0, policy_version 40454 (0.0010) [2023-12-25 23:53:38,613][123091] Updated weights for policy 0, policy_version 40464 (0.0009) [2023-12-25 23:53:38,675][123091] Updated weights for policy 0, policy_version 40474 (0.0005) [2023-12-25 23:53:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 20733952. Throughput: 0: 9351.6, 1: 8428.4. Samples: 20708492. Policy #0 lag: (min: 13.0, avg: 22.3, max: 45.0) [2023-12-25 23:53:38,785][121949] Avg episode reward: [(0, '4048.259'), (1, '4693.066')] [2023-12-25 23:53:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000040480_10362880.pth... [2023-12-25 23:53:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000040512_10371072.pth... [2023-12-25 23:53:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000039392_10084352.pth [2023-12-25 23:53:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000039552_10125312.pth [2023-12-25 23:53:39,131][123090] Updated weights for policy 1, policy_version 40514 (0.0010) [2023-12-25 23:53:39,200][123090] Updated weights for policy 1, policy_version 40524 (0.0010) [2023-12-25 23:53:39,269][123090] Updated weights for policy 1, policy_version 40534 (0.0008) [2023-12-25 23:53:39,346][123090] Updated weights for policy 1, policy_version 40544 (0.0007) [2023-12-25 23:53:39,389][123091] Updated weights for policy 0, policy_version 40484 (0.0007) [2023-12-25 23:53:39,452][123091] Updated weights for policy 0, policy_version 40494 (0.0011) [2023-12-25 23:53:39,516][123091] Updated weights for policy 0, policy_version 40504 (0.0011) [2023-12-25 23:53:40,208][123090] Updated weights for policy 1, policy_version 40554 (0.0010) [2023-12-25 23:53:40,262][123090] Updated weights for policy 1, policy_version 40564 (0.0010) [2023-12-25 23:53:40,315][123091] Updated weights for policy 0, policy_version 40514 (0.0010) [2023-12-25 23:53:40,326][123090] Updated weights for policy 1, policy_version 40574 (0.0008) [2023-12-25 23:53:40,379][123091] Updated weights for policy 0, policy_version 40524 (0.0011) [2023-12-25 23:53:40,445][123091] Updated weights for policy 0, policy_version 40534 (0.0010) [2023-12-25 23:53:40,511][123091] Updated weights for policy 0, policy_version 40544 (0.0010) [2023-12-25 23:53:41,217][123090] Updated weights for policy 1, policy_version 40584 (0.0008) [2023-12-25 23:53:41,290][123090] Updated weights for policy 1, policy_version 40594 (0.0010) [2023-12-25 23:53:41,328][123091] Updated weights for policy 0, policy_version 40554 (0.0010) [2023-12-25 23:53:41,365][123090] Updated weights for policy 1, policy_version 40604 (0.0008) [2023-12-25 23:53:41,404][123091] Updated weights for policy 0, policy_version 40564 (0.0011) [2023-12-25 23:53:41,471][123091] Updated weights for policy 0, policy_version 40574 (0.0006) [2023-12-25 23:53:42,234][123090] Updated weights for policy 1, policy_version 40614 (0.0009) [2023-12-25 23:53:42,285][123091] Updated weights for policy 0, policy_version 40584 (0.0009) [2023-12-25 23:53:42,299][123090] Updated weights for policy 1, policy_version 40624 (0.0010) [2023-12-25 23:53:42,346][123091] Updated weights for policy 0, policy_version 40594 (0.0010) [2023-12-25 23:53:42,365][123090] Updated weights for policy 1, policy_version 40634 (0.0008) [2023-12-25 23:53:42,409][123091] Updated weights for policy 0, policy_version 40604 (0.0010) [2023-12-25 23:53:43,129][123090] Updated weights for policy 1, policy_version 40644 (0.0007) [2023-12-25 23:53:43,195][123090] Updated weights for policy 1, policy_version 40654 (0.0009) [2023-12-25 23:53:43,246][123091] Updated weights for policy 0, policy_version 40614 (0.0010) [2023-12-25 23:53:43,257][123090] Updated weights for policy 1, policy_version 40664 (0.0007) [2023-12-25 23:53:43,305][123091] Updated weights for policy 0, policy_version 40624 (0.0010) [2023-12-25 23:53:43,367][123091] Updated weights for policy 0, policy_version 40634 (0.0011) [2023-12-25 23:53:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 20815872. Throughput: 0: 9179.9, 1: 8377.8. Samples: 20809976. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-25 23:53:43,785][121949] Avg episode reward: [(0, '3958.357'), (1, '4652.696')] [2023-12-25 23:53:44,034][123090] Updated weights for policy 1, policy_version 40674 (0.0006) [2023-12-25 23:53:44,098][123090] Updated weights for policy 1, policy_version 40684 (0.0008) [2023-12-25 23:53:44,160][123090] Updated weights for policy 1, policy_version 40694 (0.0008) [2023-12-25 23:53:44,191][123091] Updated weights for policy 0, policy_version 40644 (0.0011) [2023-12-25 23:53:44,217][123090] Updated weights for policy 1, policy_version 40704 (0.0005) [2023-12-25 23:53:44,235][123091] Updated weights for policy 0, policy_version 40654 (0.0010) [2023-12-25 23:53:44,282][123091] Updated weights for policy 0, policy_version 40664 (0.0010) [2023-12-25 23:53:44,971][123090] Updated weights for policy 1, policy_version 40714 (0.0011) [2023-12-25 23:53:45,038][123090] Updated weights for policy 1, policy_version 40724 (0.0011) [2023-12-25 23:53:45,108][123090] Updated weights for policy 1, policy_version 40734 (0.0008) [2023-12-25 23:53:45,127][123091] Updated weights for policy 0, policy_version 40674 (0.0010) [2023-12-25 23:53:45,190][123091] Updated weights for policy 0, policy_version 40684 (0.0011) [2023-12-25 23:53:45,254][123091] Updated weights for policy 0, policy_version 40694 (0.0011) [2023-12-25 23:53:45,320][123091] Updated weights for policy 0, policy_version 40704 (0.0011) [2023-12-25 23:53:45,818][123090] Updated weights for policy 1, policy_version 40744 (0.0008) [2023-12-25 23:53:45,878][123090] Updated weights for policy 1, policy_version 40754 (0.0010) [2023-12-25 23:53:45,940][123090] Updated weights for policy 1, policy_version 40764 (0.0010) [2023-12-25 23:53:46,132][123091] Updated weights for policy 0, policy_version 40714 (0.0011) [2023-12-25 23:53:46,187][123091] Updated weights for policy 0, policy_version 40724 (0.0010) [2023-12-25 23:53:46,242][123091] Updated weights for policy 0, policy_version 40734 (0.0010) [2023-12-25 23:53:46,754][123090] Updated weights for policy 1, policy_version 40774 (0.0010) [2023-12-25 23:53:46,820][123090] Updated weights for policy 1, policy_version 40784 (0.0010) [2023-12-25 23:53:46,876][123090] Updated weights for policy 1, policy_version 40794 (0.0007) [2023-12-25 23:53:47,082][123091] Updated weights for policy 0, policy_version 40744 (0.0011) [2023-12-25 23:53:47,145][123091] Updated weights for policy 0, policy_version 40754 (0.0010) [2023-12-25 23:53:47,212][123091] Updated weights for policy 0, policy_version 40764 (0.0011) [2023-12-25 23:53:47,669][123090] Updated weights for policy 1, policy_version 40804 (0.0009) [2023-12-25 23:53:47,729][123090] Updated weights for policy 1, policy_version 40814 (0.0008) [2023-12-25 23:53:47,788][123090] Updated weights for policy 1, policy_version 40824 (0.0009) [2023-12-25 23:53:48,018][123091] Updated weights for policy 0, policy_version 40774 (0.0011) [2023-12-25 23:53:48,065][123091] Updated weights for policy 0, policy_version 40784 (0.0010) [2023-12-25 23:53:48,127][123091] Updated weights for policy 0, policy_version 40794 (0.0010) [2023-12-25 23:53:48,575][123090] Updated weights for policy 1, policy_version 40834 (0.0008) [2023-12-25 23:53:48,648][123090] Updated weights for policy 1, policy_version 40844 (0.0006) [2023-12-25 23:53:48,704][123090] Updated weights for policy 1, policy_version 40854 (0.0008) [2023-12-25 23:53:48,767][123090] Updated weights for policy 1, policy_version 40864 (0.0009) [2023-12-25 23:53:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 20905984. Throughput: 0: 9115.2, 1: 8456.7. Samples: 20915440. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-25 23:53:48,785][121949] Avg episode reward: [(0, '3811.322'), (1, '4774.133')] [2023-12-25 23:53:48,786][123008] Saving new best policy, reward=4774.133! [2023-12-25 23:53:48,951][123091] Updated weights for policy 0, policy_version 40804 (0.0010) [2023-12-25 23:53:48,994][123091] Updated weights for policy 0, policy_version 40814 (0.0010) [2023-12-25 23:53:49,048][123091] Updated weights for policy 0, policy_version 40824 (0.0010) [2023-12-25 23:53:49,477][123090] Updated weights for policy 1, policy_version 40874 (0.0009) [2023-12-25 23:53:49,531][123090] Updated weights for policy 1, policy_version 40884 (0.0009) [2023-12-25 23:53:49,584][123090] Updated weights for policy 1, policy_version 40894 (0.0009) [2023-12-25 23:53:49,873][123091] Updated weights for policy 0, policy_version 40834 (0.0010) [2023-12-25 23:53:49,943][123091] Updated weights for policy 0, policy_version 40844 (0.0011) [2023-12-25 23:53:50,015][123091] Updated weights for policy 0, policy_version 40854 (0.0011) [2023-12-25 23:53:50,075][123091] Updated weights for policy 0, policy_version 40864 (0.0011) [2023-12-25 23:53:50,455][123090] Updated weights for policy 1, policy_version 40904 (0.0009) [2023-12-25 23:53:50,518][123090] Updated weights for policy 1, policy_version 40914 (0.0009) [2023-12-25 23:53:50,583][123090] Updated weights for policy 1, policy_version 40924 (0.0009) [2023-12-25 23:53:50,879][123091] Updated weights for policy 0, policy_version 40874 (0.0006) [2023-12-25 23:53:50,943][123091] Updated weights for policy 0, policy_version 40884 (0.0006) [2023-12-25 23:53:51,012][123091] Updated weights for policy 0, policy_version 40894 (0.0007) [2023-12-25 23:53:51,402][123090] Updated weights for policy 1, policy_version 40934 (0.0007) [2023-12-25 23:53:51,466][123090] Updated weights for policy 1, policy_version 40944 (0.0009) [2023-12-25 23:53:51,530][123090] Updated weights for policy 1, policy_version 40954 (0.0009) [2023-12-25 23:53:51,837][123091] Updated weights for policy 0, policy_version 40904 (0.0009) [2023-12-25 23:53:51,908][123091] Updated weights for policy 0, policy_version 40914 (0.0009) [2023-12-25 23:53:51,970][123091] Updated weights for policy 0, policy_version 40924 (0.0010) [2023-12-25 23:53:52,293][123090] Updated weights for policy 1, policy_version 40964 (0.0008) [2023-12-25 23:53:52,361][123090] Updated weights for policy 1, policy_version 40974 (0.0010) [2023-12-25 23:53:52,422][123090] Updated weights for policy 1, policy_version 40984 (0.0011) [2023-12-25 23:53:52,775][123091] Updated weights for policy 0, policy_version 40934 (0.0007) [2023-12-25 23:53:52,830][123091] Updated weights for policy 0, policy_version 40944 (0.0005) [2023-12-25 23:53:52,899][123091] Updated weights for policy 0, policy_version 40954 (0.0005) [2023-12-25 23:53:53,261][123090] Updated weights for policy 1, policy_version 40994 (0.0010) [2023-12-25 23:53:53,328][123090] Updated weights for policy 1, policy_version 41004 (0.0010) [2023-12-25 23:53:53,389][123090] Updated weights for policy 1, policy_version 41014 (0.0010) [2023-12-25 23:53:53,455][123090] Updated weights for policy 1, policy_version 41024 (0.0010) [2023-12-25 23:53:53,521][123091] Updated weights for policy 0, policy_version 40964 (0.0005) [2023-12-25 23:53:53,577][123091] Updated weights for policy 0, policy_version 40974 (0.0005) [2023-12-25 23:53:53,624][123091] Updated weights for policy 0, policy_version 40984 (0.0005) [2023-12-25 23:53:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 20996096. Throughput: 0: 9037.4, 1: 8458.4. Samples: 20967176. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-25 23:53:53,785][121949] Avg episode reward: [(0, '3861.609'), (1, '4862.282')] [2023-12-25 23:53:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000040992_10493952.pth... [2023-12-25 23:53:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000041024_10502144.pth... [2023-12-25 23:53:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000040032_10248192.pth [2023-12-25 23:53:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000039904_10215424.pth [2023-12-25 23:53:53,798][123008] Saving new best policy, reward=4862.282! [2023-12-25 23:53:53,799][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000040992_10493952.pth [2023-12-25 23:53:53,802][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000041024_10502144.pth [2023-12-25 23:53:54,183][123090] Updated weights for policy 1, policy_version 41034 (0.0008) [2023-12-25 23:53:54,229][123090] Updated weights for policy 1, policy_version 41044 (0.0007) [2023-12-25 23:53:54,237][123091] Updated weights for policy 0, policy_version 40994 (0.0006) [2023-12-25 23:53:54,279][123090] Updated weights for policy 1, policy_version 41054 (0.0005) [2023-12-25 23:53:54,286][123091] Updated weights for policy 0, policy_version 41004 (0.0009) [2023-12-25 23:53:54,347][123091] Updated weights for policy 0, policy_version 41014 (0.0010) [2023-12-25 23:53:54,404][123091] Updated weights for policy 0, policy_version 41024 (0.0009) [2023-12-25 23:53:54,993][123090] Updated weights for policy 1, policy_version 41064 (0.0010) [2023-12-25 23:53:55,056][123090] Updated weights for policy 1, policy_version 41074 (0.0006) [2023-12-25 23:53:55,115][123090] Updated weights for policy 1, policy_version 41084 (0.0005) [2023-12-25 23:53:55,332][123091] Updated weights for policy 0, policy_version 41034 (0.0009) [2023-12-25 23:53:55,385][123091] Updated weights for policy 0, policy_version 41044 (0.0010) [2023-12-25 23:53:55,439][123091] Updated weights for policy 0, policy_version 41054 (0.0010) [2023-12-25 23:53:55,786][123090] Updated weights for policy 1, policy_version 41094 (0.0008) [2023-12-25 23:53:55,841][123090] Updated weights for policy 1, policy_version 41104 (0.0010) [2023-12-25 23:53:55,888][123090] Updated weights for policy 1, policy_version 41114 (0.0010) [2023-12-25 23:53:56,319][123091] Updated weights for policy 0, policy_version 41064 (0.0009) [2023-12-25 23:53:56,379][123091] Updated weights for policy 0, policy_version 41074 (0.0009) [2023-12-25 23:53:56,443][123091] Updated weights for policy 0, policy_version 41084 (0.0009) [2023-12-25 23:53:56,735][123090] Updated weights for policy 1, policy_version 41124 (0.0010) [2023-12-25 23:53:56,778][123090] Updated weights for policy 1, policy_version 41134 (0.0010) [2023-12-25 23:53:56,822][123090] Updated weights for policy 1, policy_version 41144 (0.0010) [2023-12-25 23:53:57,231][123091] Updated weights for policy 0, policy_version 41094 (0.0009) [2023-12-25 23:53:57,294][123091] Updated weights for policy 0, policy_version 41104 (0.0009) [2023-12-25 23:53:57,349][123091] Updated weights for policy 0, policy_version 41114 (0.0009) [2023-12-25 23:53:57,599][123090] Updated weights for policy 1, policy_version 41154 (0.0010) [2023-12-25 23:53:57,650][123090] Updated weights for policy 1, policy_version 41164 (0.0010) [2023-12-25 23:53:57,694][123090] Updated weights for policy 1, policy_version 41174 (0.0010) [2023-12-25 23:53:57,742][123090] Updated weights for policy 1, policy_version 41184 (0.0010) [2023-12-25 23:53:58,218][123091] Updated weights for policy 0, policy_version 41124 (0.0010) [2023-12-25 23:53:58,271][123091] Updated weights for policy 0, policy_version 41134 (0.0010) [2023-12-25 23:53:58,332][123091] Updated weights for policy 0, policy_version 41144 (0.0009) [2023-12-25 23:53:58,569][123090] Updated weights for policy 1, policy_version 41194 (0.0011) [2023-12-25 23:53:58,647][123090] Updated weights for policy 1, policy_version 41204 (0.0009) [2023-12-25 23:53:58,718][123090] Updated weights for policy 1, policy_version 41214 (0.0008) [2023-12-25 23:53:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 21086208. Throughput: 0: 9035.7, 1: 8557.6. Samples: 21077084. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-25 23:53:58,785][121949] Avg episode reward: [(0, '3849.081'), (1, '4744.129')] [2023-12-25 23:53:59,256][123091] Updated weights for policy 0, policy_version 41154 (0.0010) [2023-12-25 23:53:59,316][123091] Updated weights for policy 0, policy_version 41164 (0.0009) [2023-12-25 23:53:59,386][123091] Updated weights for policy 0, policy_version 41174 (0.0010) [2023-12-25 23:53:59,441][123091] Updated weights for policy 0, policy_version 41184 (0.0009) [2023-12-25 23:53:59,566][123090] Updated weights for policy 1, policy_version 41224 (0.0009) [2023-12-25 23:53:59,627][123090] Updated weights for policy 1, policy_version 41235 (0.0010) [2023-12-25 23:53:59,689][123090] Updated weights for policy 1, policy_version 41246 (0.0010) [2023-12-25 23:54:00,231][123091] Updated weights for policy 0, policy_version 41194 (0.0009) [2023-12-25 23:54:00,295][123091] Updated weights for policy 0, policy_version 41204 (0.0008) [2023-12-25 23:54:00,350][123091] Updated weights for policy 0, policy_version 41214 (0.0009) [2023-12-25 23:54:00,556][123090] Updated weights for policy 1, policy_version 41256 (0.0006) [2023-12-25 23:54:00,626][123090] Updated weights for policy 1, policy_version 41267 (0.0006) [2023-12-25 23:54:00,672][123090] Updated weights for policy 1, policy_version 41277 (0.0005) [2023-12-25 23:54:01,179][123091] Updated weights for policy 0, policy_version 41224 (0.0010) [2023-12-25 23:54:01,231][123091] Updated weights for policy 0, policy_version 41234 (0.0007) [2023-12-25 23:54:01,298][123091] Updated weights for policy 0, policy_version 41244 (0.0010) [2023-12-25 23:54:01,385][123090] Updated weights for policy 1, policy_version 41287 (0.0010) [2023-12-25 23:54:01,452][123090] Updated weights for policy 1, policy_version 41297 (0.0009) [2023-12-25 23:54:01,527][123090] Updated weights for policy 1, policy_version 41307 (0.0005) [2023-12-25 23:54:02,028][123091] Updated weights for policy 0, policy_version 41254 (0.0010) [2023-12-25 23:54:02,079][123091] Updated weights for policy 0, policy_version 41264 (0.0009) [2023-12-25 23:54:02,141][123091] Updated weights for policy 0, policy_version 41274 (0.0008) [2023-12-25 23:54:02,190][123090] Updated weights for policy 1, policy_version 41317 (0.0007) [2023-12-25 23:54:02,243][123090] Updated weights for policy 1, policy_version 41327 (0.0009) [2023-12-25 23:54:02,300][123090] Updated weights for policy 1, policy_version 41337 (0.0009) [2023-12-25 23:54:02,903][123091] Updated weights for policy 0, policy_version 41284 (0.0006) [2023-12-25 23:54:02,973][123091] Updated weights for policy 0, policy_version 41294 (0.0006) [2023-12-25 23:54:03,048][123091] Updated weights for policy 0, policy_version 41304 (0.0005) [2023-12-25 23:54:03,218][123090] Updated weights for policy 1, policy_version 41347 (0.0009) [2023-12-25 23:54:03,270][123090] Updated weights for policy 1, policy_version 41357 (0.0010) [2023-12-25 23:54:03,324][123090] Updated weights for policy 1, policy_version 41368 (0.0008) [2023-12-25 23:54:03,688][123091] Updated weights for policy 0, policy_version 41314 (0.0005) [2023-12-25 23:54:03,761][123091] Updated weights for policy 0, policy_version 41324 (0.0005) [2023-12-25 23:54:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 21168128. Throughput: 0: 9007.7, 1: 8620.1. Samples: 21182436. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-25 23:54:03,784][121949] Avg episode reward: [(0, '3867.014'), (1, '4657.693')] [2023-12-25 23:54:03,830][123091] Updated weights for policy 0, policy_version 41334 (0.0006) [2023-12-25 23:54:03,896][123091] Updated weights for policy 0, policy_version 41344 (0.0009) [2023-12-25 23:54:04,258][123090] Updated weights for policy 1, policy_version 41378 (0.0010) [2023-12-25 23:54:04,329][123090] Updated weights for policy 1, policy_version 41388 (0.0009) [2023-12-25 23:54:04,396][123090] Updated weights for policy 1, policy_version 41398 (0.0009) [2023-12-25 23:54:04,465][123090] Updated weights for policy 1, policy_version 41408 (0.0009) [2023-12-25 23:54:04,692][123091] Updated weights for policy 0, policy_version 41354 (0.0006) [2023-12-25 23:54:04,759][123091] Updated weights for policy 0, policy_version 41364 (0.0008) [2023-12-25 23:54:04,826][123091] Updated weights for policy 0, policy_version 41374 (0.0007) [2023-12-25 23:54:05,297][123090] Updated weights for policy 1, policy_version 41418 (0.0009) [2023-12-25 23:54:05,358][123090] Updated weights for policy 1, policy_version 41428 (0.0009) [2023-12-25 23:54:05,431][123090] Updated weights for policy 1, policy_version 41438 (0.0008) [2023-12-25 23:54:05,528][123091] Updated weights for policy 0, policy_version 41384 (0.0005) [2023-12-25 23:54:05,575][123091] Updated weights for policy 0, policy_version 41394 (0.0005) [2023-12-25 23:54:05,620][123091] Updated weights for policy 0, policy_version 41404 (0.0005) [2023-12-25 23:54:06,208][123090] Updated weights for policy 1, policy_version 41448 (0.0008) [2023-12-25 23:54:06,232][123091] Updated weights for policy 0, policy_version 41414 (0.0005) [2023-12-25 23:54:06,278][123090] Updated weights for policy 1, policy_version 41458 (0.0008) [2023-12-25 23:54:06,301][123091] Updated weights for policy 0, policy_version 41424 (0.0008) [2023-12-25 23:54:06,347][123090] Updated weights for policy 1, policy_version 41468 (0.0008) [2023-12-25 23:54:06,370][123091] Updated weights for policy 0, policy_version 41434 (0.0011) [2023-12-25 23:54:07,081][123090] Updated weights for policy 1, policy_version 41478 (0.0006) [2023-12-25 23:54:07,139][123090] Updated weights for policy 1, policy_version 41488 (0.0007) [2023-12-25 23:54:07,188][123091] Updated weights for policy 0, policy_version 41444 (0.0010) [2023-12-25 23:54:07,195][123090] Updated weights for policy 1, policy_version 41498 (0.0009) [2023-12-25 23:54:07,245][123091] Updated weights for policy 0, policy_version 41454 (0.0007) [2023-12-25 23:54:07,305][123091] Updated weights for policy 0, policy_version 41464 (0.0009) [2023-12-25 23:54:07,964][123090] Updated weights for policy 1, policy_version 41508 (0.0010) [2023-12-25 23:54:08,022][123090] Updated weights for policy 1, policy_version 41518 (0.0008) [2023-12-25 23:54:08,078][123091] Updated weights for policy 0, policy_version 41474 (0.0007) [2023-12-25 23:54:08,089][123090] Updated weights for policy 1, policy_version 41528 (0.0006) [2023-12-25 23:54:08,143][123091] Updated weights for policy 0, policy_version 41484 (0.0006) [2023-12-25 23:54:08,210][123091] Updated weights for policy 0, policy_version 41494 (0.0009) [2023-12-25 23:54:08,281][123091] Updated weights for policy 0, policy_version 41504 (0.0010) [2023-12-25 23:54:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 21258240. Throughput: 0: 9083.9, 1: 8637.1. Samples: 21236512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:08,784][121949] Avg episode reward: [(0, '3745.171'), (1, '4738.889')] [2023-12-25 23:54:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000041504_10625024.pth... [2023-12-25 23:54:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000041536_10633216.pth... [2023-12-25 23:54:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000040480_10362880.pth [2023-12-25 23:54:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000040512_10371072.pth [2023-12-25 23:54:08,892][123090] Updated weights for policy 1, policy_version 41538 (0.0009) [2023-12-25 23:54:08,972][123090] Updated weights for policy 1, policy_version 41548 (0.0006) [2023-12-25 23:54:09,040][123090] Updated weights for policy 1, policy_version 41558 (0.0006) [2023-12-25 23:54:09,041][123091] Updated weights for policy 0, policy_version 41514 (0.0009) [2023-12-25 23:54:09,107][123091] Updated weights for policy 0, policy_version 41524 (0.0009) [2023-12-25 23:54:09,120][123090] Updated weights for policy 1, policy_version 41568 (0.0006) [2023-12-25 23:54:09,169][123091] Updated weights for policy 0, policy_version 41534 (0.0008) [2023-12-25 23:54:09,821][123090] Updated weights for policy 1, policy_version 41578 (0.0011) [2023-12-25 23:54:09,884][123090] Updated weights for policy 1, policy_version 41588 (0.0011) [2023-12-25 23:54:09,957][123090] Updated weights for policy 1, policy_version 41598 (0.0011) [2023-12-25 23:54:10,024][123091] Updated weights for policy 0, policy_version 41544 (0.0009) [2023-12-25 23:54:10,074][123091] Updated weights for policy 0, policy_version 41554 (0.0009) [2023-12-25 23:54:10,132][123091] Updated weights for policy 0, policy_version 41564 (0.0009) [2023-12-25 23:54:10,801][123090] Updated weights for policy 1, policy_version 41608 (0.0011) [2023-12-25 23:54:10,865][123090] Updated weights for policy 1, policy_version 41618 (0.0011) [2023-12-25 23:54:10,927][123090] Updated weights for policy 1, policy_version 41628 (0.0007) [2023-12-25 23:54:10,956][123091] Updated weights for policy 0, policy_version 41574 (0.0009) [2023-12-25 23:54:11,023][123091] Updated weights for policy 0, policy_version 41584 (0.0006) [2023-12-25 23:54:11,090][123091] Updated weights for policy 0, policy_version 41594 (0.0008) [2023-12-25 23:54:11,812][123090] Updated weights for policy 1, policy_version 41638 (0.0010) [2023-12-25 23:54:11,874][123090] Updated weights for policy 1, policy_version 41648 (0.0009) [2023-12-25 23:54:11,936][123090] Updated weights for policy 1, policy_version 41658 (0.0009) [2023-12-25 23:54:11,943][123091] Updated weights for policy 0, policy_version 41604 (0.0008) [2023-12-25 23:54:12,011][123091] Updated weights for policy 0, policy_version 41614 (0.0009) [2023-12-25 23:54:12,069][123091] Updated weights for policy 0, policy_version 41624 (0.0010) [2023-12-25 23:54:12,786][123090] Updated weights for policy 1, policy_version 41668 (0.0009) [2023-12-25 23:54:12,857][123090] Updated weights for policy 1, policy_version 41678 (0.0009) [2023-12-25 23:54:12,875][123091] Updated weights for policy 0, policy_version 41634 (0.0010) [2023-12-25 23:54:12,925][123090] Updated weights for policy 1, policy_version 41688 (0.0009) [2023-12-25 23:54:12,932][123091] Updated weights for policy 0, policy_version 41644 (0.0009) [2023-12-25 23:54:12,983][123091] Updated weights for policy 0, policy_version 41654 (0.0009) [2023-12-25 23:54:13,032][123091] Updated weights for policy 0, policy_version 41664 (0.0009) [2023-12-25 23:54:13,772][123091] Updated weights for policy 0, policy_version 41674 (0.0009) [2023-12-25 23:54:13,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 21340160. Throughput: 0: 8916.8, 1: 8739.3. Samples: 21339972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:13,785][121949] Avg episode reward: [(0, '3746.521'), (1, '4818.529')] [2023-12-25 23:54:13,804][123090] Updated weights for policy 1, policy_version 41698 (0.0008) [2023-12-25 23:54:13,824][123091] Updated weights for policy 0, policy_version 41684 (0.0008) [2023-12-25 23:54:13,873][123090] Updated weights for policy 1, policy_version 41708 (0.0008) [2023-12-25 23:54:13,878][123091] Updated weights for policy 0, policy_version 41694 (0.0009) [2023-12-25 23:54:13,918][123090] Updated weights for policy 1, policy_version 41718 (0.0009) [2023-12-25 23:54:13,970][123090] Updated weights for policy 1, policy_version 41728 (0.0009) [2023-12-25 23:54:14,647][123091] Updated weights for policy 0, policy_version 41704 (0.0010) [2023-12-25 23:54:14,700][123091] Updated weights for policy 0, policy_version 41714 (0.0009) [2023-12-25 23:54:14,752][123091] Updated weights for policy 0, policy_version 41724 (0.0009) [2023-12-25 23:54:14,855][123090] Updated weights for policy 1, policy_version 41738 (0.0010) [2023-12-25 23:54:14,922][123090] Updated weights for policy 1, policy_version 41748 (0.0009) [2023-12-25 23:54:14,990][123090] Updated weights for policy 1, policy_version 41758 (0.0009) [2023-12-25 23:54:15,607][123091] Updated weights for policy 0, policy_version 41734 (0.0010) [2023-12-25 23:54:15,614][123090] Updated weights for policy 1, policy_version 41768 (0.0006) [2023-12-25 23:54:15,659][123091] Updated weights for policy 0, policy_version 41744 (0.0011) [2023-12-25 23:54:15,665][123090] Updated weights for policy 1, policy_version 41778 (0.0005) [2023-12-25 23:54:15,714][123091] Updated weights for policy 0, policy_version 41754 (0.0010) [2023-12-25 23:54:15,720][123090] Updated weights for policy 1, policy_version 41788 (0.0008) [2023-12-25 23:54:16,432][123091] Updated weights for policy 0, policy_version 41764 (0.0009) [2023-12-25 23:54:16,480][123091] Updated weights for policy 0, policy_version 41774 (0.0005) [2023-12-25 23:54:16,516][123090] Updated weights for policy 1, policy_version 41798 (0.0005) [2023-12-25 23:54:16,537][123091] Updated weights for policy 0, policy_version 41784 (0.0005) [2023-12-25 23:54:16,576][123090] Updated weights for policy 1, policy_version 41808 (0.0005) [2023-12-25 23:54:16,624][123090] Updated weights for policy 1, policy_version 41818 (0.0005) [2023-12-25 23:54:17,215][123091] Updated weights for policy 0, policy_version 41794 (0.0005) [2023-12-25 23:54:17,273][123090] Updated weights for policy 1, policy_version 41828 (0.0005) [2023-12-25 23:54:17,275][123091] Updated weights for policy 0, policy_version 41804 (0.0007) [2023-12-25 23:54:17,324][123091] Updated weights for policy 0, policy_version 41814 (0.0007) [2023-12-25 23:54:17,341][123090] Updated weights for policy 1, policy_version 41838 (0.0005) [2023-12-25 23:54:17,371][123091] Updated weights for policy 0, policy_version 41824 (0.0007) [2023-12-25 23:54:17,405][123090] Updated weights for policy 1, policy_version 41848 (0.0006) [2023-12-25 23:54:18,035][123091] Updated weights for policy 0, policy_version 41834 (0.0008) [2023-12-25 23:54:18,084][123091] Updated weights for policy 0, policy_version 41844 (0.0009) [2023-12-25 23:54:18,132][123091] Updated weights for policy 0, policy_version 41854 (0.0009) [2023-12-25 23:54:18,174][123090] Updated weights for policy 1, policy_version 41858 (0.0006) [2023-12-25 23:54:18,228][123090] Updated weights for policy 1, policy_version 41868 (0.0008) [2023-12-25 23:54:18,292][123090] Updated weights for policy 1, policy_version 41878 (0.0009) [2023-12-25 23:54:18,359][123090] Updated weights for policy 1, policy_version 41888 (0.0009) [2023-12-25 23:54:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 21438464. Throughput: 0: 8938.2, 1: 8796.6. Samples: 21450852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:18,785][121949] Avg episode reward: [(0, '3878.114'), (1, '4854.546')] [2023-12-25 23:54:18,975][123091] Updated weights for policy 0, policy_version 41864 (0.0010) [2023-12-25 23:54:19,044][123091] Updated weights for policy 0, policy_version 41874 (0.0009) [2023-12-25 23:54:19,106][123091] Updated weights for policy 0, policy_version 41884 (0.0010) [2023-12-25 23:54:19,172][123090] Updated weights for policy 1, policy_version 41898 (0.0009) [2023-12-25 23:54:19,256][123090] Updated weights for policy 1, policy_version 41909 (0.0011) [2023-12-25 23:54:19,326][123090] Updated weights for policy 1, policy_version 41919 (0.0006) [2023-12-25 23:54:19,986][123091] Updated weights for policy 0, policy_version 41894 (0.0008) [2023-12-25 23:54:20,061][123091] Updated weights for policy 0, policy_version 41904 (0.0012) [2023-12-25 23:54:20,069][123090] Updated weights for policy 1, policy_version 41929 (0.0008) [2023-12-25 23:54:20,131][123090] Updated weights for policy 1, policy_version 41939 (0.0007) [2023-12-25 23:54:20,133][123091] Updated weights for policy 0, policy_version 41914 (0.0009) [2023-12-25 23:54:20,193][123090] Updated weights for policy 1, policy_version 41949 (0.0010) [2023-12-25 23:54:20,873][123091] Updated weights for policy 0, policy_version 41924 (0.0007) [2023-12-25 23:54:20,944][123091] Updated weights for policy 0, policy_version 41934 (0.0006) [2023-12-25 23:54:21,018][123091] Updated weights for policy 0, policy_version 41944 (0.0007) [2023-12-25 23:54:21,025][123090] Updated weights for policy 1, policy_version 41959 (0.0013) [2023-12-25 23:54:21,089][123090] Updated weights for policy 1, policy_version 41969 (0.0009) [2023-12-25 23:54:21,156][123090] Updated weights for policy 1, policy_version 41979 (0.0008) [2023-12-25 23:54:21,803][123091] Updated weights for policy 0, policy_version 41954 (0.0010) [2023-12-25 23:54:21,872][123091] Updated weights for policy 0, policy_version 41964 (0.0010) [2023-12-25 23:54:21,939][123091] Updated weights for policy 0, policy_version 41974 (0.0011) [2023-12-25 23:54:22,004][123090] Updated weights for policy 1, policy_version 41989 (0.0009) [2023-12-25 23:54:22,008][123091] Updated weights for policy 0, policy_version 41984 (0.0011) [2023-12-25 23:54:22,053][123090] Updated weights for policy 1, policy_version 41999 (0.0008) [2023-12-25 23:54:22,105][123090] Updated weights for policy 1, policy_version 42009 (0.0008) [2023-12-25 23:54:22,820][123091] Updated weights for policy 0, policy_version 41994 (0.0011) [2023-12-25 23:54:22,880][123091] Updated weights for policy 0, policy_version 42004 (0.0011) [2023-12-25 23:54:22,921][123090] Updated weights for policy 1, policy_version 42019 (0.0007) [2023-12-25 23:54:22,932][123091] Updated weights for policy 0, policy_version 42014 (0.0011) [2023-12-25 23:54:22,986][123090] Updated weights for policy 1, policy_version 42029 (0.0006) [2023-12-25 23:54:23,059][123090] Updated weights for policy 1, policy_version 42039 (0.0005) [2023-12-25 23:54:23,705][123090] Updated weights for policy 1, policy_version 42049 (0.0005) [2023-12-25 23:54:23,770][123091] Updated weights for policy 0, policy_version 42024 (0.0011) [2023-12-25 23:54:23,774][123090] Updated weights for policy 1, policy_version 42059 (0.0007) [2023-12-25 23:54:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 21520384. Throughput: 0: 8890.6, 1: 8770.7. Samples: 21503252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:23,785][121949] Avg episode reward: [(0, '3898.849'), (1, '4816.412')] [2023-12-25 23:54:23,829][123091] Updated weights for policy 0, policy_version 42034 (0.0011) [2023-12-25 23:54:23,833][123090] Updated weights for policy 1, policy_version 42069 (0.0008) [2023-12-25 23:54:23,884][123091] Updated weights for policy 0, policy_version 42044 (0.0011) [2023-12-25 23:54:23,896][123090] Updated weights for policy 1, policy_version 42079 (0.0008) [2023-12-25 23:54:23,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000042048_10764288.pth... [2023-12-25 23:54:23,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000042080_10772480.pth... [2023-12-25 23:54:23,905][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000040992_10493952.pth [2023-12-25 23:54:23,907][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000041024_10502144.pth [2023-12-25 23:54:24,619][123090] Updated weights for policy 1, policy_version 42089 (0.0007) [2023-12-25 23:54:24,690][123090] Updated weights for policy 1, policy_version 42099 (0.0006) [2023-12-25 23:54:24,694][123091] Updated weights for policy 0, policy_version 42054 (0.0011) [2023-12-25 23:54:24,755][123090] Updated weights for policy 1, policy_version 42109 (0.0005) [2023-12-25 23:54:24,757][123091] Updated weights for policy 0, policy_version 42064 (0.0010) [2023-12-25 23:54:24,819][123091] Updated weights for policy 0, policy_version 42074 (0.0008) [2023-12-25 23:54:25,391][123090] Updated weights for policy 1, policy_version 42119 (0.0005) [2023-12-25 23:54:25,454][123090] Updated weights for policy 1, policy_version 42129 (0.0006) [2023-12-25 23:54:25,506][123091] Updated weights for policy 0, policy_version 42084 (0.0005) [2023-12-25 23:54:25,509][123090] Updated weights for policy 1, policy_version 42139 (0.0008) [2023-12-25 23:54:25,559][123091] Updated weights for policy 0, policy_version 42094 (0.0005) [2023-12-25 23:54:25,617][123091] Updated weights for policy 0, policy_version 42104 (0.0007) [2023-12-25 23:54:26,187][123090] Updated weights for policy 1, policy_version 42149 (0.0008) [2023-12-25 23:54:26,239][123090] Updated weights for policy 1, policy_version 42159 (0.0005) [2023-12-25 23:54:26,296][123090] Updated weights for policy 1, policy_version 42169 (0.0005) [2023-12-25 23:54:26,387][123091] Updated weights for policy 0, policy_version 42114 (0.0011) [2023-12-25 23:54:26,434][123091] Updated weights for policy 0, policy_version 42124 (0.0010) [2023-12-25 23:54:26,478][123091] Updated weights for policy 0, policy_version 42134 (0.0010) [2023-12-25 23:54:26,526][123091] Updated weights for policy 0, policy_version 42144 (0.0010) [2023-12-25 23:54:27,012][123090] Updated weights for policy 1, policy_version 42179 (0.0005) [2023-12-25 23:54:27,062][123090] Updated weights for policy 1, policy_version 42189 (0.0005) [2023-12-25 23:54:27,115][123090] Updated weights for policy 1, policy_version 42199 (0.0005) [2023-12-25 23:54:27,394][123091] Updated weights for policy 0, policy_version 42154 (0.0010) [2023-12-25 23:54:27,443][123091] Updated weights for policy 0, policy_version 42164 (0.0009) [2023-12-25 23:54:27,491][123091] Updated weights for policy 0, policy_version 42174 (0.0009) [2023-12-25 23:54:27,788][123090] Updated weights for policy 1, policy_version 42209 (0.0006) [2023-12-25 23:54:27,855][123090] Updated weights for policy 1, policy_version 42219 (0.0008) [2023-12-25 23:54:27,922][123090] Updated weights for policy 1, policy_version 42229 (0.0009) [2023-12-25 23:54:27,986][123090] Updated weights for policy 1, policy_version 42239 (0.0009) [2023-12-25 23:54:28,346][123091] Updated weights for policy 0, policy_version 42184 (0.0009) [2023-12-25 23:54:28,415][123091] Updated weights for policy 0, policy_version 42194 (0.0007) [2023-12-25 23:54:28,473][123091] Updated weights for policy 0, policy_version 42204 (0.0010) [2023-12-25 23:54:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 21618688. Throughput: 0: 8892.0, 1: 8979.5. Samples: 21614192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:28,785][121949] Avg episode reward: [(0, '3922.370'), (1, '4803.125')] [2023-12-25 23:54:28,820][123090] Updated weights for policy 1, policy_version 42249 (0.0009) [2023-12-25 23:54:28,883][123090] Updated weights for policy 1, policy_version 42259 (0.0010) [2023-12-25 23:54:28,937][123090] Updated weights for policy 1, policy_version 42269 (0.0010) [2023-12-25 23:54:29,172][123091] Updated weights for policy 0, policy_version 42214 (0.0009) [2023-12-25 23:54:29,228][123091] Updated weights for policy 0, policy_version 42224 (0.0010) [2023-12-25 23:54:29,292][123091] Updated weights for policy 0, policy_version 42234 (0.0009) [2023-12-25 23:54:29,826][123090] Updated weights for policy 1, policy_version 42279 (0.0010) [2023-12-25 23:54:29,889][123090] Updated weights for policy 1, policy_version 42289 (0.0010) [2023-12-25 23:54:29,951][123090] Updated weights for policy 1, policy_version 42299 (0.0009) [2023-12-25 23:54:30,096][123091] Updated weights for policy 0, policy_version 42244 (0.0010) [2023-12-25 23:54:30,144][123091] Updated weights for policy 0, policy_version 42254 (0.0009) [2023-12-25 23:54:30,193][123091] Updated weights for policy 0, policy_version 42264 (0.0009) [2023-12-25 23:54:30,822][123090] Updated weights for policy 1, policy_version 42309 (0.0009) [2023-12-25 23:54:30,885][123090] Updated weights for policy 1, policy_version 42319 (0.0009) [2023-12-25 23:54:30,949][123090] Updated weights for policy 1, policy_version 42329 (0.0009) [2023-12-25 23:54:31,033][123091] Updated weights for policy 0, policy_version 42274 (0.0008) [2023-12-25 23:54:31,096][123091] Updated weights for policy 0, policy_version 42284 (0.0009) [2023-12-25 23:54:31,163][123091] Updated weights for policy 0, policy_version 42294 (0.0009) [2023-12-25 23:54:31,233][123091] Updated weights for policy 0, policy_version 42304 (0.0010) [2023-12-25 23:54:31,715][123090] Updated weights for policy 1, policy_version 42339 (0.0009) [2023-12-25 23:54:31,788][123090] Updated weights for policy 1, policy_version 42349 (0.0010) [2023-12-25 23:54:31,852][123090] Updated weights for policy 1, policy_version 42359 (0.0010) [2023-12-25 23:54:32,081][123091] Updated weights for policy 0, policy_version 42314 (0.0010) [2023-12-25 23:54:32,143][123091] Updated weights for policy 0, policy_version 42324 (0.0009) [2023-12-25 23:54:32,191][123091] Updated weights for policy 0, policy_version 42334 (0.0008) [2023-12-25 23:54:32,720][123090] Updated weights for policy 1, policy_version 42369 (0.0009) [2023-12-25 23:54:32,790][123090] Updated weights for policy 1, policy_version 42379 (0.0010) [2023-12-25 23:54:32,848][123090] Updated weights for policy 1, policy_version 42389 (0.0007) [2023-12-25 23:54:32,849][123091] Updated weights for policy 0, policy_version 42344 (0.0005) [2023-12-25 23:54:32,904][123091] Updated weights for policy 0, policy_version 42354 (0.0006) [2023-12-25 23:54:32,909][123090] Updated weights for policy 1, policy_version 42399 (0.0005) [2023-12-25 23:54:32,973][123091] Updated weights for policy 0, policy_version 42364 (0.0005) [2023-12-25 23:54:33,494][123090] Updated weights for policy 1, policy_version 42409 (0.0005) [2023-12-25 23:54:33,556][123090] Updated weights for policy 1, policy_version 42419 (0.0006) [2023-12-25 23:54:33,591][123091] Updated weights for policy 0, policy_version 42374 (0.0006) [2023-12-25 23:54:33,628][123090] Updated weights for policy 1, policy_version 42429 (0.0006) [2023-12-25 23:54:33,644][123091] Updated weights for policy 0, policy_version 42384 (0.0007) [2023-12-25 23:54:33,696][123091] Updated weights for policy 0, policy_version 42394 (0.0010) [2023-12-25 23:54:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 21716992. Throughput: 0: 8981.4, 1: 8928.7. Samples: 21721396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-25 23:54:33,785][121949] Avg episode reward: [(0, '3986.703'), (1, '4835.958')] [2023-12-25 23:54:34,332][123090] Updated weights for policy 1, policy_version 42439 (0.0008) [2023-12-25 23:54:34,394][123090] Updated weights for policy 1, policy_version 42449 (0.0010) [2023-12-25 23:54:34,454][123090] Updated weights for policy 1, policy_version 42459 (0.0006) [2023-12-25 23:54:34,562][123091] Updated weights for policy 0, policy_version 42405 (0.0009) [2023-12-25 23:54:34,636][123091] Updated weights for policy 0, policy_version 42415 (0.0009) [2023-12-25 23:54:34,703][123091] Updated weights for policy 0, policy_version 42425 (0.0011) [2023-12-25 23:54:35,130][123090] Updated weights for policy 1, policy_version 42469 (0.0006) [2023-12-25 23:54:35,184][123090] Updated weights for policy 1, policy_version 42479 (0.0006) [2023-12-25 23:54:35,228][123090] Updated weights for policy 1, policy_version 42489 (0.0010) [2023-12-25 23:54:35,437][123091] Updated weights for policy 0, policy_version 42435 (0.0009) [2023-12-25 23:54:35,488][123091] Updated weights for policy 0, policy_version 42445 (0.0005) [2023-12-25 23:54:35,549][123091] Updated weights for policy 0, policy_version 42455 (0.0005) [2023-12-25 23:54:36,045][123090] Updated weights for policy 1, policy_version 42499 (0.0010) [2023-12-25 23:54:36,111][123090] Updated weights for policy 1, policy_version 42509 (0.0010) [2023-12-25 23:54:36,173][123090] Updated weights for policy 1, policy_version 42519 (0.0010) [2023-12-25 23:54:36,227][123091] Updated weights for policy 0, policy_version 42465 (0.0006) [2023-12-25 23:54:36,292][123091] Updated weights for policy 0, policy_version 42475 (0.0006) [2023-12-25 23:54:36,347][123091] Updated weights for policy 0, policy_version 42485 (0.0006) [2023-12-25 23:54:36,420][123091] Updated weights for policy 0, policy_version 42495 (0.0005) [2023-12-25 23:54:36,902][123090] Updated weights for policy 1, policy_version 42529 (0.0007) [2023-12-25 23:54:36,959][123090] Updated weights for policy 1, policy_version 42539 (0.0005) [2023-12-25 23:54:37,023][123090] Updated weights for policy 1, policy_version 42549 (0.0008) [2023-12-25 23:54:37,075][123090] Updated weights for policy 1, policy_version 42559 (0.0010) [2023-12-25 23:54:37,113][123091] Updated weights for policy 0, policy_version 42505 (0.0005) [2023-12-25 23:54:37,170][123091] Updated weights for policy 0, policy_version 42515 (0.0006) [2023-12-25 23:54:37,218][123091] Updated weights for policy 0, policy_version 42525 (0.0006) [2023-12-25 23:54:37,890][123090] Updated weights for policy 1, policy_version 42569 (0.0010) [2023-12-25 23:54:37,945][123090] Updated weights for policy 1, policy_version 42579 (0.0010) [2023-12-25 23:54:38,003][123091] Updated weights for policy 0, policy_version 42535 (0.0006) [2023-12-25 23:54:38,005][123090] Updated weights for policy 1, policy_version 42589 (0.0010) [2023-12-25 23:54:38,069][123091] Updated weights for policy 0, policy_version 42545 (0.0008) [2023-12-25 23:54:38,123][123091] Updated weights for policy 0, policy_version 42555 (0.0006) [2023-12-25 23:54:38,615][123090] Updated weights for policy 1, policy_version 42599 (0.0006) [2023-12-25 23:54:38,678][123090] Updated weights for policy 1, policy_version 42609 (0.0005) [2023-12-25 23:54:38,746][123090] Updated weights for policy 1, policy_version 42619 (0.0005) [2023-12-25 23:54:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 21807104. Throughput: 0: 9026.8, 1: 9000.4. Samples: 21778396. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-25 23:54:38,784][121949] Avg episode reward: [(0, '4124.775'), (1, '4858.371')] [2023-12-25 23:54:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000042560_10895360.pth... [2023-12-25 23:54:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000042624_10911744.pth... [2023-12-25 23:54:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000041504_10625024.pth [2023-12-25 23:54:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000041536_10633216.pth [2023-12-25 23:54:39,013][123091] Updated weights for policy 0, policy_version 42565 (0.0008) [2023-12-25 23:54:39,075][123091] Updated weights for policy 0, policy_version 42575 (0.0009) [2023-12-25 23:54:39,134][123091] Updated weights for policy 0, policy_version 42585 (0.0008) [2023-12-25 23:54:39,553][123090] Updated weights for policy 1, policy_version 42629 (0.0007) [2023-12-25 23:54:39,613][123090] Updated weights for policy 1, policy_version 42639 (0.0010) [2023-12-25 23:54:39,673][123090] Updated weights for policy 1, policy_version 42649 (0.0010) [2023-12-25 23:54:39,974][123091] Updated weights for policy 0, policy_version 42595 (0.0007) [2023-12-25 23:54:40,033][123091] Updated weights for policy 0, policy_version 42605 (0.0010) [2023-12-25 23:54:40,097][123091] Updated weights for policy 0, policy_version 42615 (0.0010) [2023-12-25 23:54:40,471][123090] Updated weights for policy 1, policy_version 42659 (0.0009) [2023-12-25 23:54:40,527][123090] Updated weights for policy 1, policy_version 42669 (0.0005) [2023-12-25 23:54:40,597][123090] Updated weights for policy 1, policy_version 42679 (0.0005) [2023-12-25 23:54:41,022][123091] Updated weights for policy 0, policy_version 42625 (0.0009) [2023-12-25 23:54:41,089][123091] Updated weights for policy 0, policy_version 42635 (0.0009) [2023-12-25 23:54:41,163][123091] Updated weights for policy 0, policy_version 42645 (0.0009) [2023-12-25 23:54:41,221][123090] Updated weights for policy 1, policy_version 42689 (0.0006) [2023-12-25 23:54:41,237][123091] Updated weights for policy 0, policy_version 42655 (0.0007) [2023-12-25 23:54:41,293][123090] Updated weights for policy 1, policy_version 42699 (0.0011) [2023-12-25 23:54:41,362][123090] Updated weights for policy 1, policy_version 42709 (0.0014) [2023-12-25 23:54:41,432][123090] Updated weights for policy 1, policy_version 42719 (0.0012) [2023-12-25 23:54:42,117][123091] Updated weights for policy 0, policy_version 42665 (0.0009) [2023-12-25 23:54:42,179][123091] Updated weights for policy 0, policy_version 42675 (0.0009) [2023-12-25 23:54:42,239][123091] Updated weights for policy 0, policy_version 42685 (0.0009) [2023-12-25 23:54:42,277][123090] Updated weights for policy 1, policy_version 42729 (0.0011) [2023-12-25 23:54:42,345][123090] Updated weights for policy 1, policy_version 42739 (0.0011) [2023-12-25 23:54:42,411][123090] Updated weights for policy 1, policy_version 42749 (0.0011) [2023-12-25 23:54:43,091][123091] Updated weights for policy 0, policy_version 42695 (0.0009) [2023-12-25 23:54:43,151][123091] Updated weights for policy 0, policy_version 42705 (0.0009) [2023-12-25 23:54:43,204][123091] Updated weights for policy 0, policy_version 42715 (0.0009) [2023-12-25 23:54:43,245][123090] Updated weights for policy 1, policy_version 42759 (0.0010) [2023-12-25 23:54:43,304][123090] Updated weights for policy 1, policy_version 42769 (0.0010) [2023-12-25 23:54:43,370][123090] Updated weights for policy 1, policy_version 42779 (0.0010) [2023-12-25 23:54:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 21889024. Throughput: 0: 8935.1, 1: 8963.5. Samples: 21882520. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-25 23:54:43,785][121949] Avg episode reward: [(0, '4036.174'), (1, '4912.640')] [2023-12-25 23:54:43,786][123008] Saving new best policy, reward=4912.640! [2023-12-25 23:54:44,065][123091] Updated weights for policy 0, policy_version 42725 (0.0009) [2023-12-25 23:54:44,133][123091] Updated weights for policy 0, policy_version 42735 (0.0010) [2023-12-25 23:54:44,159][123090] Updated weights for policy 1, policy_version 42789 (0.0008) [2023-12-25 23:54:44,187][123091] Updated weights for policy 0, policy_version 42745 (0.0009) [2023-12-25 23:54:44,228][123090] Updated weights for policy 1, policy_version 42799 (0.0008) [2023-12-25 23:54:44,280][123090] Updated weights for policy 1, policy_version 42809 (0.0009) [2023-12-25 23:54:45,073][123090] Updated weights for policy 1, policy_version 42819 (0.0009) [2023-12-25 23:54:45,076][123091] Updated weights for policy 0, policy_version 42755 (0.0008) [2023-12-25 23:54:45,138][123090] Updated weights for policy 1, policy_version 42829 (0.0006) [2023-12-25 23:54:45,139][123091] Updated weights for policy 0, policy_version 42765 (0.0010) [2023-12-25 23:54:45,201][123090] Updated weights for policy 1, policy_version 42839 (0.0008) [2023-12-25 23:54:45,209][123091] Updated weights for policy 0, policy_version 42775 (0.0008) [2023-12-25 23:54:45,923][123090] Updated weights for policy 1, policy_version 42849 (0.0007) [2023-12-25 23:54:45,982][123090] Updated weights for policy 1, policy_version 42859 (0.0010) [2023-12-25 23:54:46,034][123090] Updated weights for policy 1, policy_version 42869 (0.0010) [2023-12-25 23:54:46,057][123091] Updated weights for policy 0, policy_version 42785 (0.0008) [2023-12-25 23:54:46,096][123090] Updated weights for policy 1, policy_version 42879 (0.0010) [2023-12-25 23:54:46,112][123091] Updated weights for policy 0, policy_version 42795 (0.0005) [2023-12-25 23:54:46,175][123091] Updated weights for policy 0, policy_version 42805 (0.0005) [2023-12-25 23:54:46,240][123091] Updated weights for policy 0, policy_version 42815 (0.0005) [2023-12-25 23:54:46,907][123090] Updated weights for policy 1, policy_version 42889 (0.0006) [2023-12-25 23:54:46,976][123090] Updated weights for policy 1, policy_version 42899 (0.0007) [2023-12-25 23:54:47,011][123091] Updated weights for policy 0, policy_version 42825 (0.0009) [2023-12-25 23:54:47,041][123090] Updated weights for policy 1, policy_version 42909 (0.0010) [2023-12-25 23:54:47,068][123091] Updated weights for policy 0, policy_version 42835 (0.0009) [2023-12-25 23:54:47,121][123091] Updated weights for policy 0, policy_version 42845 (0.0009) [2023-12-25 23:54:47,731][123090] Updated weights for policy 1, policy_version 42919 (0.0007) [2023-12-25 23:54:47,801][123090] Updated weights for policy 1, policy_version 42929 (0.0005) [2023-12-25 23:54:47,876][123090] Updated weights for policy 1, policy_version 42939 (0.0005) [2023-12-25 23:54:47,912][123091] Updated weights for policy 0, policy_version 42855 (0.0009) [2023-12-25 23:54:47,963][123091] Updated weights for policy 0, policy_version 42865 (0.0009) [2023-12-25 23:54:48,023][123091] Updated weights for policy 0, policy_version 42875 (0.0009) [2023-12-25 23:54:48,582][123090] Updated weights for policy 1, policy_version 42949 (0.0005) [2023-12-25 23:54:48,643][123090] Updated weights for policy 1, policy_version 42959 (0.0006) [2023-12-25 23:54:48,710][123090] Updated weights for policy 1, policy_version 42969 (0.0007) [2023-12-25 23:54:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 21979136. Throughput: 0: 8875.3, 1: 9056.5. Samples: 21989368. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-25 23:54:48,785][121949] Avg episode reward: [(0, '4059.288'), (1, '4870.153')] [2023-12-25 23:54:48,874][123091] Updated weights for policy 0, policy_version 42885 (0.0008) [2023-12-25 23:54:48,922][123091] Updated weights for policy 0, policy_version 42895 (0.0008) [2023-12-25 23:54:48,967][123091] Updated weights for policy 0, policy_version 42905 (0.0008) [2023-12-25 23:54:49,427][123090] Updated weights for policy 1, policy_version 42979 (0.0006) [2023-12-25 23:54:49,495][123090] Updated weights for policy 1, policy_version 42989 (0.0005) [2023-12-25 23:54:49,558][123090] Updated weights for policy 1, policy_version 42999 (0.0006) [2023-12-25 23:54:49,748][123091] Updated weights for policy 0, policy_version 42915 (0.0008) [2023-12-25 23:54:49,805][123091] Updated weights for policy 0, policy_version 42926 (0.0010) [2023-12-25 23:54:49,886][123091] Updated weights for policy 0, policy_version 42936 (0.0010) [2023-12-25 23:54:50,205][123090] Updated weights for policy 1, policy_version 43009 (0.0010) [2023-12-25 23:54:50,265][123090] Updated weights for policy 1, policy_version 43019 (0.0006) [2023-12-25 23:54:50,338][123090] Updated weights for policy 1, policy_version 43029 (0.0006) [2023-12-25 23:54:50,415][123090] Updated weights for policy 1, policy_version 43039 (0.0005) [2023-12-25 23:54:50,668][123091] Updated weights for policy 0, policy_version 42946 (0.0008) [2023-12-25 23:54:50,727][123091] Updated weights for policy 0, policy_version 42956 (0.0008) [2023-12-25 23:54:50,792][123091] Updated weights for policy 0, policy_version 42966 (0.0009) [2023-12-25 23:54:50,852][123091] Updated weights for policy 0, policy_version 42976 (0.0009) [2023-12-25 23:54:51,202][123090] Updated weights for policy 1, policy_version 43049 (0.0008) [2023-12-25 23:54:51,264][123090] Updated weights for policy 1, policy_version 43059 (0.0009) [2023-12-25 23:54:51,317][123090] Updated weights for policy 1, policy_version 43069 (0.0009) [2023-12-25 23:54:51,791][123091] Updated weights for policy 0, policy_version 42986 (0.0011) [2023-12-25 23:54:51,857][123091] Updated weights for policy 0, policy_version 42996 (0.0011) [2023-12-25 23:54:51,918][123091] Updated weights for policy 0, policy_version 43006 (0.0011) [2023-12-25 23:54:52,200][123090] Updated weights for policy 1, policy_version 43079 (0.0010) [2023-12-25 23:54:52,258][123090] Updated weights for policy 1, policy_version 43090 (0.0010) [2023-12-25 23:54:52,316][123090] Updated weights for policy 1, policy_version 43100 (0.0009) [2023-12-25 23:54:52,697][123091] Updated weights for policy 0, policy_version 43016 (0.0009) [2023-12-25 23:54:52,755][123091] Updated weights for policy 0, policy_version 43026 (0.0010) [2023-12-25 23:54:52,819][123091] Updated weights for policy 0, policy_version 43036 (0.0009) [2023-12-25 23:54:53,110][123090] Updated weights for policy 1, policy_version 43110 (0.0010) [2023-12-25 23:54:53,169][123090] Updated weights for policy 1, policy_version 43120 (0.0010) [2023-12-25 23:54:53,234][123090] Updated weights for policy 1, policy_version 43130 (0.0010) [2023-12-25 23:54:53,716][123091] Updated weights for policy 0, policy_version 43046 (0.0007) [2023-12-25 23:54:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 22061056. Throughput: 0: 8816.9, 1: 9099.6. Samples: 22042756. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-25 23:54:53,785][121949] Avg episode reward: [(0, '4046.900'), (1, '4764.131')] [2023-12-25 23:54:53,788][123091] Updated weights for policy 0, policy_version 43056 (0.0006) [2023-12-25 23:54:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000043136_11042816.pth... [2023-12-25 23:54:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000042080_10772480.pth [2023-12-25 23:54:53,850][123091] Updated weights for policy 0, policy_version 43066 (0.0006) [2023-12-25 23:54:53,887][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000043072_11026432.pth... [2023-12-25 23:54:53,890][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000042048_10764288.pth [2023-12-25 23:54:53,927][123090] Updated weights for policy 1, policy_version 43140 (0.0006) [2023-12-25 23:54:53,981][123090] Updated weights for policy 1, policy_version 43150 (0.0005) [2023-12-25 23:54:54,037][123090] Updated weights for policy 1, policy_version 43160 (0.0005) [2023-12-25 23:54:54,503][123091] Updated weights for policy 0, policy_version 43076 (0.0006) [2023-12-25 23:54:54,558][123091] Updated weights for policy 0, policy_version 43086 (0.0006) [2023-12-25 23:54:54,630][123091] Updated weights for policy 0, policy_version 43096 (0.0006) [2023-12-25 23:54:54,739][123090] Updated weights for policy 1, policy_version 43170 (0.0005) [2023-12-25 23:54:54,805][123090] Updated weights for policy 1, policy_version 43180 (0.0005) [2023-12-25 23:54:54,869][123090] Updated weights for policy 1, policy_version 43190 (0.0005) [2023-12-25 23:54:54,933][123090] Updated weights for policy 1, policy_version 43200 (0.0006) [2023-12-25 23:54:55,463][123091] Updated weights for policy 0, policy_version 43106 (0.0009) [2023-12-25 23:54:55,515][123090] Updated weights for policy 1, policy_version 43210 (0.0007) [2023-12-25 23:54:55,519][123091] Updated weights for policy 0, policy_version 43116 (0.0008) [2023-12-25 23:54:55,570][123091] Updated weights for policy 0, policy_version 43126 (0.0008) [2023-12-25 23:54:55,579][123090] Updated weights for policy 1, policy_version 43220 (0.0007) [2023-12-25 23:54:55,624][123091] Updated weights for policy 0, policy_version 43136 (0.0009) [2023-12-25 23:54:55,644][123090] Updated weights for policy 1, policy_version 43230 (0.0009) [2023-12-25 23:54:56,425][123091] Updated weights for policy 0, policy_version 43146 (0.0008) [2023-12-25 23:54:56,427][123090] Updated weights for policy 1, policy_version 43240 (0.0010) [2023-12-25 23:54:56,483][123091] Updated weights for policy 0, policy_version 43156 (0.0008) [2023-12-25 23:54:56,496][123090] Updated weights for policy 1, policy_version 43250 (0.0010) [2023-12-25 23:54:56,534][123091] Updated weights for policy 0, policy_version 43166 (0.0010) [2023-12-25 23:54:56,562][123090] Updated weights for policy 1, policy_version 43260 (0.0010) [2023-12-25 23:54:57,375][123090] Updated weights for policy 1, policy_version 43270 (0.0010) [2023-12-25 23:54:57,382][123091] Updated weights for policy 0, policy_version 43176 (0.0006) [2023-12-25 23:54:57,430][123090] Updated weights for policy 1, policy_version 43280 (0.0010) [2023-12-25 23:54:57,440][123091] Updated weights for policy 0, policy_version 43186 (0.0006) [2023-12-25 23:54:57,488][123090] Updated weights for policy 1, policy_version 43290 (0.0010) [2023-12-25 23:54:57,495][123091] Updated weights for policy 0, policy_version 43196 (0.0005) [2023-12-25 23:54:58,300][123091] Updated weights for policy 0, policy_version 43206 (0.0008) [2023-12-25 23:54:58,317][123090] Updated weights for policy 1, policy_version 43300 (0.0011) [2023-12-25 23:54:58,383][123090] Updated weights for policy 1, policy_version 43310 (0.0009) [2023-12-25 23:54:58,387][123091] Updated weights for policy 0, policy_version 43216 (0.0007) [2023-12-25 23:54:58,453][123090] Updated weights for policy 1, policy_version 43320 (0.0008) [2023-12-25 23:54:58,463][123091] Updated weights for policy 0, policy_version 43226 (0.0008) [2023-12-25 23:54:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 22159360. Throughput: 0: 8843.8, 1: 9174.6. Samples: 22150796. Policy #0 lag: (min: 31.0, avg: 34.1, max: 63.0) [2023-12-25 23:54:58,785][121949] Avg episode reward: [(0, '4033.669'), (1, '4825.131')] [2023-12-25 23:54:59,261][123090] Updated weights for policy 1, policy_version 43330 (0.0008) [2023-12-25 23:54:59,308][123090] Updated weights for policy 1, policy_version 43340 (0.0010) [2023-12-25 23:54:59,340][123091] Updated weights for policy 0, policy_version 43236 (0.0008) [2023-12-25 23:54:59,380][123090] Updated weights for policy 1, policy_version 43350 (0.0008) [2023-12-25 23:54:59,407][123091] Updated weights for policy 0, policy_version 43246 (0.0007) [2023-12-25 23:54:59,445][123090] Updated weights for policy 1, policy_version 43360 (0.0008) [2023-12-25 23:54:59,471][123091] Updated weights for policy 0, policy_version 43256 (0.0006) [2023-12-25 23:55:00,264][123090] Updated weights for policy 1, policy_version 43370 (0.0010) [2023-12-25 23:55:00,266][123091] Updated weights for policy 0, policy_version 43266 (0.0005) [2023-12-25 23:55:00,326][123091] Updated weights for policy 0, policy_version 43276 (0.0006) [2023-12-25 23:55:00,328][123090] Updated weights for policy 1, policy_version 43380 (0.0009) [2023-12-25 23:55:00,393][123090] Updated weights for policy 1, policy_version 43390 (0.0009) [2023-12-25 23:55:00,393][123091] Updated weights for policy 0, policy_version 43286 (0.0008) [2023-12-25 23:55:00,454][123091] Updated weights for policy 0, policy_version 43296 (0.0009) [2023-12-25 23:55:01,103][123090] Updated weights for policy 1, policy_version 43400 (0.0007) [2023-12-25 23:55:01,184][123090] Updated weights for policy 1, policy_version 43410 (0.0010) [2023-12-25 23:55:01,236][123090] Updated weights for policy 1, policy_version 43420 (0.0010) [2023-12-25 23:55:01,339][123091] Updated weights for policy 0, policy_version 43306 (0.0010) [2023-12-25 23:55:01,412][123091] Updated weights for policy 0, policy_version 43316 (0.0010) [2023-12-25 23:55:01,470][123091] Updated weights for policy 0, policy_version 43326 (0.0009) [2023-12-25 23:55:02,055][123090] Updated weights for policy 1, policy_version 43430 (0.0007) [2023-12-25 23:55:02,110][123090] Updated weights for policy 1, policy_version 43440 (0.0005) [2023-12-25 23:55:02,168][123090] Updated weights for policy 1, policy_version 43450 (0.0009) [2023-12-25 23:55:02,334][123091] Updated weights for policy 0, policy_version 43336 (0.0007) [2023-12-25 23:55:02,392][123091] Updated weights for policy 0, policy_version 43346 (0.0009) [2023-12-25 23:55:02,444][123091] Updated weights for policy 0, policy_version 43356 (0.0005) [2023-12-25 23:55:03,039][123091] Updated weights for policy 0, policy_version 43366 (0.0005) [2023-12-25 23:55:03,049][123090] Updated weights for policy 1, policy_version 43460 (0.0009) [2023-12-25 23:55:03,088][123091] Updated weights for policy 0, policy_version 43376 (0.0005) [2023-12-25 23:55:03,110][123090] Updated weights for policy 1, policy_version 43470 (0.0010) [2023-12-25 23:55:03,135][123091] Updated weights for policy 0, policy_version 43386 (0.0005) [2023-12-25 23:55:03,171][123090] Updated weights for policy 1, policy_version 43480 (0.0009) [2023-12-25 23:55:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 22241280. Throughput: 0: 8769.4, 1: 9119.0. Samples: 22255824. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:03,785][121949] Avg episode reward: [(0, '3838.622'), (1, '4874.177')] [2023-12-25 23:55:03,811][123091] Updated weights for policy 0, policy_version 43396 (0.0006) [2023-12-25 23:55:03,877][123091] Updated weights for policy 0, policy_version 43406 (0.0007) [2023-12-25 23:55:03,932][123091] Updated weights for policy 0, policy_version 43416 (0.0006) [2023-12-25 23:55:04,105][123090] Updated weights for policy 1, policy_version 43490 (0.0009) [2023-12-25 23:55:04,175][123090] Updated weights for policy 1, policy_version 43500 (0.0010) [2023-12-25 23:55:04,241][123090] Updated weights for policy 1, policy_version 43510 (0.0009) [2023-12-25 23:55:04,312][123090] Updated weights for policy 1, policy_version 43520 (0.0010) [2023-12-25 23:55:04,518][123091] Updated weights for policy 0, policy_version 43426 (0.0006) [2023-12-25 23:55:04,579][123091] Updated weights for policy 0, policy_version 43436 (0.0009) [2023-12-25 23:55:04,640][123091] Updated weights for policy 0, policy_version 43446 (0.0009) [2023-12-25 23:55:04,703][123091] Updated weights for policy 0, policy_version 43456 (0.0010) [2023-12-25 23:55:05,218][123090] Updated weights for policy 1, policy_version 43530 (0.0008) [2023-12-25 23:55:05,276][123090] Updated weights for policy 1, policy_version 43540 (0.0009) [2023-12-25 23:55:05,334][123090] Updated weights for policy 1, policy_version 43550 (0.0008) [2023-12-25 23:55:05,421][123091] Updated weights for policy 0, policy_version 43466 (0.0005) [2023-12-25 23:55:05,490][123091] Updated weights for policy 0, policy_version 43476 (0.0005) [2023-12-25 23:55:05,551][123091] Updated weights for policy 0, policy_version 43486 (0.0006) [2023-12-25 23:55:06,121][123090] Updated weights for policy 1, policy_version 43560 (0.0009) [2023-12-25 23:55:06,180][123090] Updated weights for policy 1, policy_version 43570 (0.0010) [2023-12-25 23:55:06,247][123090] Updated weights for policy 1, policy_version 43580 (0.0010) [2023-12-25 23:55:06,310][123091] Updated weights for policy 0, policy_version 43496 (0.0011) [2023-12-25 23:55:06,366][123091] Updated weights for policy 0, policy_version 43506 (0.0011) [2023-12-25 23:55:06,434][123091] Updated weights for policy 0, policy_version 43516 (0.0011) [2023-12-25 23:55:07,028][123090] Updated weights for policy 1, policy_version 43590 (0.0007) [2023-12-25 23:55:07,074][123090] Updated weights for policy 1, policy_version 43600 (0.0005) [2023-12-25 23:55:07,145][123090] Updated weights for policy 1, policy_version 43610 (0.0005) [2023-12-25 23:55:07,281][123091] Updated weights for policy 0, policy_version 43526 (0.0011) [2023-12-25 23:55:07,336][123091] Updated weights for policy 0, policy_version 43536 (0.0011) [2023-12-25 23:55:07,392][123091] Updated weights for policy 0, policy_version 43546 (0.0011) [2023-12-25 23:55:07,790][123090] Updated weights for policy 1, policy_version 43620 (0.0005) [2023-12-25 23:55:07,861][123090] Updated weights for policy 1, policy_version 43630 (0.0008) [2023-12-25 23:55:07,926][123090] Updated weights for policy 1, policy_version 43640 (0.0009) [2023-12-25 23:55:08,227][123091] Updated weights for policy 0, policy_version 43556 (0.0011) [2023-12-25 23:55:08,282][123091] Updated weights for policy 0, policy_version 43566 (0.0010) [2023-12-25 23:55:08,337][123091] Updated weights for policy 0, policy_version 43576 (0.0010) [2023-12-25 23:55:08,628][123090] Updated weights for policy 1, policy_version 43650 (0.0006) [2023-12-25 23:55:08,692][123090] Updated weights for policy 1, policy_version 43660 (0.0008) [2023-12-25 23:55:08,753][123090] Updated weights for policy 1, policy_version 43670 (0.0009) [2023-12-25 23:55:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 22331392. Throughput: 0: 8841.0, 1: 9082.6. Samples: 22309812. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:08,785][121949] Avg episode reward: [(0, '3934.806'), (1, '4873.087')] [2023-12-25 23:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000043584_11157504.pth... [2023-12-25 23:55:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000042560_10895360.pth [2023-12-25 23:55:08,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000043680_11182080.pth... [2023-12-25 23:55:08,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000042624_10911744.pth [2023-12-25 23:55:08,814][123090] Updated weights for policy 1, policy_version 43680 (0.0010) [2023-12-25 23:55:09,112][123091] Updated weights for policy 0, policy_version 43586 (0.0011) [2023-12-25 23:55:09,171][123091] Updated weights for policy 0, policy_version 43596 (0.0011) [2023-12-25 23:55:09,241][123091] Updated weights for policy 0, policy_version 43606 (0.0011) [2023-12-25 23:55:09,308][123091] Updated weights for policy 0, policy_version 43616 (0.0011) [2023-12-25 23:55:09,714][123090] Updated weights for policy 1, policy_version 43690 (0.0009) [2023-12-25 23:55:09,785][123090] Updated weights for policy 1, policy_version 43700 (0.0009) [2023-12-25 23:55:09,852][123090] Updated weights for policy 1, policy_version 43710 (0.0010) [2023-12-25 23:55:10,118][123091] Updated weights for policy 0, policy_version 43626 (0.0009) [2023-12-25 23:55:10,172][123091] Updated weights for policy 0, policy_version 43636 (0.0008) [2023-12-25 23:55:10,229][123091] Updated weights for policy 0, policy_version 43646 (0.0009) [2023-12-25 23:55:10,623][123090] Updated weights for policy 1, policy_version 43720 (0.0010) [2023-12-25 23:55:10,685][123090] Updated weights for policy 1, policy_version 43730 (0.0010) [2023-12-25 23:55:10,752][123090] Updated weights for policy 1, policy_version 43740 (0.0010) [2023-12-25 23:55:11,086][123091] Updated weights for policy 0, policy_version 43656 (0.0009) [2023-12-25 23:55:11,156][123091] Updated weights for policy 0, policy_version 43666 (0.0010) [2023-12-25 23:55:11,222][123091] Updated weights for policy 0, policy_version 43676 (0.0010) [2023-12-25 23:55:11,590][123090] Updated weights for policy 1, policy_version 43750 (0.0010) [2023-12-25 23:55:11,664][123090] Updated weights for policy 1, policy_version 43760 (0.0009) [2023-12-25 23:55:11,737][123090] Updated weights for policy 1, policy_version 43770 (0.0008) [2023-12-25 23:55:12,024][123091] Updated weights for policy 0, policy_version 43686 (0.0008) [2023-12-25 23:55:12,075][123091] Updated weights for policy 0, policy_version 43696 (0.0009) [2023-12-25 23:55:12,129][123091] Updated weights for policy 0, policy_version 43706 (0.0010) [2023-12-25 23:55:12,574][123090] Updated weights for policy 1, policy_version 43780 (0.0009) [2023-12-25 23:55:12,635][123090] Updated weights for policy 1, policy_version 43790 (0.0009) [2023-12-25 23:55:12,701][123090] Updated weights for policy 1, policy_version 43800 (0.0010) [2023-12-25 23:55:13,016][123091] Updated weights for policy 0, policy_version 43716 (0.0010) [2023-12-25 23:55:13,079][123091] Updated weights for policy 0, policy_version 43726 (0.0009) [2023-12-25 23:55:13,148][123091] Updated weights for policy 0, policy_version 43736 (0.0010) [2023-12-25 23:55:13,536][123090] Updated weights for policy 1, policy_version 43810 (0.0010) [2023-12-25 23:55:13,591][123090] Updated weights for policy 1, policy_version 43820 (0.0009) [2023-12-25 23:55:13,644][123090] Updated weights for policy 1, policy_version 43831 (0.0010) [2023-12-25 23:55:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 22421504. Throughput: 0: 8813.4, 1: 8966.3. Samples: 22414280. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:13,784][121949] Avg episode reward: [(0, '4030.634'), (1, '4799.945')] [2023-12-25 23:55:13,891][123091] Updated weights for policy 0, policy_version 43746 (0.0008) [2023-12-25 23:55:13,951][123091] Updated weights for policy 0, policy_version 43756 (0.0009) [2023-12-25 23:55:14,007][123091] Updated weights for policy 0, policy_version 43766 (0.0009) [2023-12-25 23:55:14,059][123091] Updated weights for policy 0, policy_version 43776 (0.0009) [2023-12-25 23:55:14,584][123090] Updated weights for policy 1, policy_version 43841 (0.0010) [2023-12-25 23:55:14,656][123090] Updated weights for policy 1, policy_version 43851 (0.0010) [2023-12-25 23:55:14,722][123090] Updated weights for policy 1, policy_version 43861 (0.0009) [2023-12-25 23:55:14,792][123090] Updated weights for policy 1, policy_version 43871 (0.0010) [2023-12-25 23:55:14,796][123091] Updated weights for policy 0, policy_version 43786 (0.0008) [2023-12-25 23:55:14,860][123091] Updated weights for policy 0, policy_version 43796 (0.0006) [2023-12-25 23:55:14,919][123091] Updated weights for policy 0, policy_version 43806 (0.0007) [2023-12-25 23:55:15,611][123090] Updated weights for policy 1, policy_version 43881 (0.0009) [2023-12-25 23:55:15,660][123090] Updated weights for policy 1, policy_version 43891 (0.0009) [2023-12-25 23:55:15,709][123090] Updated weights for policy 1, policy_version 43901 (0.0008) [2023-12-25 23:55:15,721][123091] Updated weights for policy 0, policy_version 43816 (0.0007) [2023-12-25 23:55:15,786][123091] Updated weights for policy 0, policy_version 43826 (0.0010) [2023-12-25 23:55:15,856][123091] Updated weights for policy 0, policy_version 43836 (0.0009) [2023-12-25 23:55:16,485][123090] Updated weights for policy 1, policy_version 43911 (0.0006) [2023-12-25 23:55:16,539][123090] Updated weights for policy 1, policy_version 43921 (0.0005) [2023-12-25 23:55:16,595][123090] Updated weights for policy 1, policy_version 43931 (0.0005) [2023-12-25 23:55:16,601][123091] Updated weights for policy 0, policy_version 43846 (0.0007) [2023-12-25 23:55:16,669][123091] Updated weights for policy 0, policy_version 43856 (0.0006) [2023-12-25 23:55:16,742][123091] Updated weights for policy 0, policy_version 43866 (0.0006) [2023-12-25 23:55:17,411][123090] Updated weights for policy 1, policy_version 43941 (0.0007) [2023-12-25 23:55:17,435][123091] Updated weights for policy 0, policy_version 43876 (0.0006) [2023-12-25 23:55:17,462][123090] Updated weights for policy 1, policy_version 43951 (0.0009) [2023-12-25 23:55:17,489][123091] Updated weights for policy 0, policy_version 43886 (0.0005) [2023-12-25 23:55:17,512][123090] Updated weights for policy 1, policy_version 43961 (0.0009) [2023-12-25 23:55:17,546][123091] Updated weights for policy 0, policy_version 43896 (0.0005) [2023-12-25 23:55:18,198][123091] Updated weights for policy 0, policy_version 43906 (0.0005) [2023-12-25 23:55:18,257][123091] Updated weights for policy 0, policy_version 43916 (0.0007) [2023-12-25 23:55:18,259][123090] Updated weights for policy 1, policy_version 43971 (0.0008) [2023-12-25 23:55:18,307][123091] Updated weights for policy 0, policy_version 43926 (0.0008) [2023-12-25 23:55:18,309][123090] Updated weights for policy 1, policy_version 43981 (0.0010) [2023-12-25 23:55:18,371][123091] Updated weights for policy 0, policy_version 43936 (0.0009) [2023-12-25 23:55:18,376][123090] Updated weights for policy 1, policy_version 43991 (0.0010) [2023-12-25 23:55:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 22511616. Throughput: 0: 8806.2, 1: 8973.1. Samples: 22521464. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:18,785][121949] Avg episode reward: [(0, '4004.262'), (1, '4682.769')] [2023-12-25 23:55:19,214][123091] Updated weights for policy 0, policy_version 43946 (0.0009) [2023-12-25 23:55:19,222][123090] Updated weights for policy 1, policy_version 44001 (0.0009) [2023-12-25 23:55:19,280][123091] Updated weights for policy 0, policy_version 43956 (0.0011) [2023-12-25 23:55:19,286][123090] Updated weights for policy 1, policy_version 44011 (0.0008) [2023-12-25 23:55:19,342][123091] Updated weights for policy 0, policy_version 43966 (0.0007) [2023-12-25 23:55:19,358][123090] Updated weights for policy 1, policy_version 44021 (0.0009) [2023-12-25 23:55:19,427][123090] Updated weights for policy 1, policy_version 44031 (0.0010) [2023-12-25 23:55:20,091][123091] Updated weights for policy 0, policy_version 43976 (0.0009) [2023-12-25 23:55:20,142][123091] Updated weights for policy 0, policy_version 43986 (0.0009) [2023-12-25 23:55:20,191][123091] Updated weights for policy 0, policy_version 43996 (0.0011) [2023-12-25 23:55:20,296][123090] Updated weights for policy 1, policy_version 44041 (0.0009) [2023-12-25 23:55:20,369][123090] Updated weights for policy 1, policy_version 44051 (0.0009) [2023-12-25 23:55:20,434][123090] Updated weights for policy 1, policy_version 44061 (0.0008) [2023-12-25 23:55:21,043][123091] Updated weights for policy 0, policy_version 44006 (0.0010) [2023-12-25 23:55:21,107][123091] Updated weights for policy 0, policy_version 44016 (0.0007) [2023-12-25 23:55:21,183][123091] Updated weights for policy 0, policy_version 44026 (0.0008) [2023-12-25 23:55:21,243][123090] Updated weights for policy 1, policy_version 44071 (0.0008) [2023-12-25 23:55:21,317][123090] Updated weights for policy 1, policy_version 44081 (0.0007) [2023-12-25 23:55:21,390][123090] Updated weights for policy 1, policy_version 44091 (0.0009) [2023-12-25 23:55:22,075][123091] Updated weights for policy 0, policy_version 44036 (0.0008) [2023-12-25 23:55:22,130][123091] Updated weights for policy 0, policy_version 44046 (0.0006) [2023-12-25 23:55:22,192][123091] Updated weights for policy 0, policy_version 44056 (0.0005) [2023-12-25 23:55:22,237][123090] Updated weights for policy 1, policy_version 44101 (0.0009) [2023-12-25 23:55:22,308][123090] Updated weights for policy 1, policy_version 44111 (0.0007) [2023-12-25 23:55:22,381][123090] Updated weights for policy 1, policy_version 44121 (0.0009) [2023-12-25 23:55:22,982][123091] Updated weights for policy 0, policy_version 44066 (0.0006) [2023-12-25 23:55:23,044][123091] Updated weights for policy 0, policy_version 44076 (0.0007) [2023-12-25 23:55:23,104][123091] Updated weights for policy 0, policy_version 44086 (0.0009) [2023-12-25 23:55:23,164][123091] Updated weights for policy 0, policy_version 44096 (0.0006) [2023-12-25 23:55:23,206][123090] Updated weights for policy 1, policy_version 44131 (0.0010) [2023-12-25 23:55:23,283][123090] Updated weights for policy 1, policy_version 44141 (0.0009) [2023-12-25 23:55:23,360][123090] Updated weights for policy 1, policy_version 44151 (0.0009) [2023-12-25 23:55:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 22593536. Throughput: 0: 8756.1, 1: 8890.5. Samples: 22572496. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:23,785][121949] Avg episode reward: [(0, '4125.731'), (1, '4747.348')] [2023-12-25 23:55:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000044160_11304960.pth... [2023-12-25 23:55:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000043136_11042816.pth [2023-12-25 23:55:23,831][123091] Updated weights for policy 0, policy_version 44106 (0.0006) [2023-12-25 23:55:23,878][123091] Updated weights for policy 0, policy_version 44116 (0.0005) [2023-12-25 23:55:23,924][123091] Updated weights for policy 0, policy_version 44126 (0.0005) [2023-12-25 23:55:23,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000044128_11296768.pth... [2023-12-25 23:55:23,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000043072_11026432.pth [2023-12-25 23:55:24,123][123090] Updated weights for policy 1, policy_version 44161 (0.0008) [2023-12-25 23:55:24,181][123090] Updated weights for policy 1, policy_version 44171 (0.0010) [2023-12-25 23:55:24,235][123090] Updated weights for policy 1, policy_version 44181 (0.0010) [2023-12-25 23:55:24,293][123090] Updated weights for policy 1, policy_version 44191 (0.0010) [2023-12-25 23:55:24,572][123091] Updated weights for policy 0, policy_version 44136 (0.0008) [2023-12-25 23:55:24,620][123091] Updated weights for policy 0, policy_version 44146 (0.0008) [2023-12-25 23:55:24,665][123091] Updated weights for policy 0, policy_version 44156 (0.0009) [2023-12-25 23:55:25,167][123090] Updated weights for policy 1, policy_version 44201 (0.0009) [2023-12-25 23:55:25,227][123090] Updated weights for policy 1, policy_version 44211 (0.0009) [2023-12-25 23:55:25,279][123090] Updated weights for policy 1, policy_version 44221 (0.0009) [2023-12-25 23:55:25,484][123091] Updated weights for policy 0, policy_version 44166 (0.0010) [2023-12-25 23:55:25,530][123091] Updated weights for policy 0, policy_version 44176 (0.0007) [2023-12-25 23:55:25,581][123091] Updated weights for policy 0, policy_version 44186 (0.0006) [2023-12-25 23:55:26,149][123090] Updated weights for policy 1, policy_version 44231 (0.0009) [2023-12-25 23:55:26,205][123090] Updated weights for policy 1, policy_version 44241 (0.0009) [2023-12-25 23:55:26,262][123090] Updated weights for policy 1, policy_version 44251 (0.0009) [2023-12-25 23:55:26,307][123091] Updated weights for policy 0, policy_version 44196 (0.0006) [2023-12-25 23:55:26,361][123091] Updated weights for policy 0, policy_version 44206 (0.0009) [2023-12-25 23:55:26,420][123091] Updated weights for policy 0, policy_version 44216 (0.0006) [2023-12-25 23:55:27,114][123091] Updated weights for policy 0, policy_version 44226 (0.0005) [2023-12-25 23:55:27,162][123091] Updated weights for policy 0, policy_version 44236 (0.0005) [2023-12-25 23:55:27,198][123090] Updated weights for policy 1, policy_version 44261 (0.0008) [2023-12-25 23:55:27,210][123091] Updated weights for policy 0, policy_version 44246 (0.0005) [2023-12-25 23:55:27,254][123090] Updated weights for policy 1, policy_version 44271 (0.0009) [2023-12-25 23:55:27,268][123091] Updated weights for policy 0, policy_version 44256 (0.0005) [2023-12-25 23:55:27,305][123090] Updated weights for policy 1, policy_version 44281 (0.0009) [2023-12-25 23:55:27,937][123091] Updated weights for policy 0, policy_version 44266 (0.0007) [2023-12-25 23:55:28,007][123091] Updated weights for policy 0, policy_version 44276 (0.0011) [2023-12-25 23:55:28,062][123091] Updated weights for policy 0, policy_version 44286 (0.0010) [2023-12-25 23:55:28,185][123090] Updated weights for policy 1, policy_version 44291 (0.0009) [2023-12-25 23:55:28,239][123090] Updated weights for policy 1, policy_version 44302 (0.0010) [2023-12-25 23:55:28,293][123090] Updated weights for policy 1, policy_version 44312 (0.0009) [2023-12-25 23:55:28,764][123091] Updated weights for policy 0, policy_version 44296 (0.0006) [2023-12-25 23:55:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 22683648. Throughput: 0: 8948.3, 1: 8776.4. Samples: 22680132. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:55:28,785][121949] Avg episode reward: [(0, '4191.096'), (1, '4815.354')] [2023-12-25 23:55:28,831][123091] Updated weights for policy 0, policy_version 44306 (0.0005) [2023-12-25 23:55:28,896][123091] Updated weights for policy 0, policy_version 44316 (0.0009) [2023-12-25 23:55:29,220][123090] Updated weights for policy 1, policy_version 44323 (0.0009) [2023-12-25 23:55:29,286][123090] Updated weights for policy 1, policy_version 44333 (0.0009) [2023-12-25 23:55:29,346][123090] Updated weights for policy 1, policy_version 44343 (0.0009) [2023-12-25 23:55:29,673][123091] Updated weights for policy 0, policy_version 44326 (0.0011) [2023-12-25 23:55:29,740][123091] Updated weights for policy 0, policy_version 44336 (0.0011) [2023-12-25 23:55:29,798][123091] Updated weights for policy 0, policy_version 44346 (0.0010) [2023-12-25 23:55:30,170][123090] Updated weights for policy 1, policy_version 44353 (0.0009) [2023-12-25 23:55:30,231][123090] Updated weights for policy 1, policy_version 44363 (0.0009) [2023-12-25 23:55:30,287][123090] Updated weights for policy 1, policy_version 44373 (0.0009) [2023-12-25 23:55:30,348][123090] Updated weights for policy 1, policy_version 44383 (0.0008) [2023-12-25 23:55:30,620][123091] Updated weights for policy 0, policy_version 44356 (0.0011) [2023-12-25 23:55:30,663][123091] Updated weights for policy 0, policy_version 44366 (0.0010) [2023-12-25 23:55:30,717][123091] Updated weights for policy 0, policy_version 44376 (0.0010) [2023-12-25 23:55:31,187][123090] Updated weights for policy 1, policy_version 44393 (0.0009) [2023-12-25 23:55:31,244][123090] Updated weights for policy 1, policy_version 44403 (0.0009) [2023-12-25 23:55:31,301][123090] Updated weights for policy 1, policy_version 44413 (0.0008) [2023-12-25 23:55:31,556][123091] Updated weights for policy 0, policy_version 44386 (0.0010) [2023-12-25 23:55:31,603][123091] Updated weights for policy 0, policy_version 44396 (0.0010) [2023-12-25 23:55:31,668][123091] Updated weights for policy 0, policy_version 44406 (0.0006) [2023-12-25 23:55:31,749][123091] Updated weights for policy 0, policy_version 44416 (0.0008) [2023-12-25 23:55:32,169][123090] Updated weights for policy 1, policy_version 44423 (0.0008) [2023-12-25 23:55:32,241][123090] Updated weights for policy 1, policy_version 44433 (0.0009) [2023-12-25 23:55:32,306][123090] Updated weights for policy 1, policy_version 44443 (0.0009) [2023-12-25 23:55:32,500][123091] Updated weights for policy 0, policy_version 44426 (0.0005) [2023-12-25 23:55:32,561][123091] Updated weights for policy 0, policy_version 44436 (0.0005) [2023-12-25 23:55:32,628][123091] Updated weights for policy 0, policy_version 44446 (0.0008) [2023-12-25 23:55:33,140][123090] Updated weights for policy 1, policy_version 44453 (0.0008) [2023-12-25 23:55:33,204][123090] Updated weights for policy 1, policy_version 44463 (0.0009) [2023-12-25 23:55:33,260][123090] Updated weights for policy 1, policy_version 44473 (0.0008) [2023-12-25 23:55:33,413][123091] Updated weights for policy 0, policy_version 44456 (0.0010) [2023-12-25 23:55:33,459][123091] Updated weights for policy 0, policy_version 44466 (0.0010) [2023-12-25 23:55:33,506][123091] Updated weights for policy 0, policy_version 44476 (0.0010) [2023-12-25 23:55:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 22773760. Throughput: 0: 9031.8, 1: 8632.8. Samples: 22784276. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:33,785][121949] Avg episode reward: [(0, '4121.899'), (1, '4904.342')] [2023-12-25 23:55:34,077][123090] Updated weights for policy 1, policy_version 44483 (0.0009) [2023-12-25 23:55:34,142][123090] Updated weights for policy 1, policy_version 44493 (0.0010) [2023-12-25 23:55:34,216][123090] Updated weights for policy 1, policy_version 44503 (0.0008) [2023-12-25 23:55:34,325][123091] Updated weights for policy 0, policy_version 44486 (0.0008) [2023-12-25 23:55:34,380][123091] Updated weights for policy 0, policy_version 44496 (0.0006) [2023-12-25 23:55:34,436][123091] Updated weights for policy 0, policy_version 44506 (0.0006) [2023-12-25 23:55:35,050][123090] Updated weights for policy 1, policy_version 44513 (0.0009) [2023-12-25 23:55:35,106][123090] Updated weights for policy 1, policy_version 44523 (0.0005) [2023-12-25 23:55:35,186][123090] Updated weights for policy 1, policy_version 44533 (0.0005) [2023-12-25 23:55:35,221][123091] Updated weights for policy 0, policy_version 44516 (0.0007) [2023-12-25 23:55:35,250][123090] Updated weights for policy 1, policy_version 44543 (0.0007) [2023-12-25 23:55:35,281][123091] Updated weights for policy 0, policy_version 44526 (0.0010) [2023-12-25 23:55:35,341][123091] Updated weights for policy 0, policy_version 44536 (0.0007) [2023-12-25 23:55:36,016][123090] Updated weights for policy 1, policy_version 44553 (0.0006) [2023-12-25 23:55:36,090][123090] Updated weights for policy 1, policy_version 44563 (0.0005) [2023-12-25 23:55:36,148][123091] Updated weights for policy 0, policy_version 44546 (0.0005) [2023-12-25 23:55:36,163][123090] Updated weights for policy 1, policy_version 44573 (0.0007) [2023-12-25 23:55:36,218][123091] Updated weights for policy 0, policy_version 44556 (0.0006) [2023-12-25 23:55:36,277][123091] Updated weights for policy 0, policy_version 44566 (0.0006) [2023-12-25 23:55:36,345][123091] Updated weights for policy 0, policy_version 44576 (0.0006) [2023-12-25 23:55:36,864][123090] Updated weights for policy 1, policy_version 44583 (0.0007) [2023-12-25 23:55:36,904][123091] Updated weights for policy 0, policy_version 44586 (0.0007) [2023-12-25 23:55:36,934][123090] Updated weights for policy 1, policy_version 44593 (0.0008) [2023-12-25 23:55:36,958][123091] Updated weights for policy 0, policy_version 44596 (0.0007) [2023-12-25 23:55:36,999][123090] Updated weights for policy 1, policy_version 44603 (0.0006) [2023-12-25 23:55:37,016][123091] Updated weights for policy 0, policy_version 44606 (0.0006) [2023-12-25 23:55:37,707][123091] Updated weights for policy 0, policy_version 44616 (0.0006) [2023-12-25 23:55:37,768][123091] Updated weights for policy 0, policy_version 44626 (0.0006) [2023-12-25 23:55:37,792][123090] Updated weights for policy 1, policy_version 44613 (0.0008) [2023-12-25 23:55:37,831][123091] Updated weights for policy 0, policy_version 44636 (0.0006) [2023-12-25 23:55:37,848][123090] Updated weights for policy 1, policy_version 44623 (0.0010) [2023-12-25 23:55:37,907][123090] Updated weights for policy 1, policy_version 44633 (0.0010) [2023-12-25 23:55:38,543][123091] Updated weights for policy 0, policy_version 44646 (0.0008) [2023-12-25 23:55:38,592][123091] Updated weights for policy 0, policy_version 44656 (0.0009) [2023-12-25 23:55:38,652][123091] Updated weights for policy 0, policy_version 44666 (0.0009) [2023-12-25 23:55:38,742][123090] Updated weights for policy 1, policy_version 44643 (0.0010) [2023-12-25 23:55:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 22863872. Throughput: 0: 9073.8, 1: 8603.2. Samples: 22838220. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:38,785][121949] Avg episode reward: [(0, '4195.035'), (1, '4801.882')] [2023-12-25 23:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000044672_11436032.pth... [2023-12-25 23:55:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000043584_11157504.pth [2023-12-25 23:55:38,812][123090] Updated weights for policy 1, policy_version 44653 (0.0010) [2023-12-25 23:55:38,868][123090] Updated weights for policy 1, policy_version 44663 (0.0010) [2023-12-25 23:55:38,923][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000044672_11436032.pth... [2023-12-25 23:55:38,928][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000043680_11182080.pth [2023-12-25 23:55:39,497][123091] Updated weights for policy 0, policy_version 44676 (0.0008) [2023-12-25 23:55:39,559][123091] Updated weights for policy 0, policy_version 44686 (0.0008) [2023-12-25 23:55:39,615][123091] Updated weights for policy 0, policy_version 44696 (0.0008) [2023-12-25 23:55:39,699][123090] Updated weights for policy 1, policy_version 44673 (0.0010) [2023-12-25 23:55:39,762][123090] Updated weights for policy 1, policy_version 44683 (0.0010) [2023-12-25 23:55:39,829][123090] Updated weights for policy 1, policy_version 44693 (0.0008) [2023-12-25 23:55:39,899][123090] Updated weights for policy 1, policy_version 44703 (0.0009) [2023-12-25 23:55:40,347][123091] Updated weights for policy 0, policy_version 44706 (0.0009) [2023-12-25 23:55:40,405][123091] Updated weights for policy 0, policy_version 44716 (0.0009) [2023-12-25 23:55:40,467][123091] Updated weights for policy 0, policy_version 44726 (0.0010) [2023-12-25 23:55:40,531][123091] Updated weights for policy 0, policy_version 44736 (0.0010) [2023-12-25 23:55:40,771][123090] Updated weights for policy 1, policy_version 44713 (0.0010) [2023-12-25 23:55:40,833][123090] Updated weights for policy 1, policy_version 44723 (0.0010) [2023-12-25 23:55:40,898][123090] Updated weights for policy 1, policy_version 44733 (0.0010) [2023-12-25 23:55:41,255][123091] Updated weights for policy 0, policy_version 44746 (0.0007) [2023-12-25 23:55:41,321][123091] Updated weights for policy 0, policy_version 44756 (0.0010) [2023-12-25 23:55:41,397][123091] Updated weights for policy 0, policy_version 44766 (0.0009) [2023-12-25 23:55:41,767][123090] Updated weights for policy 1, policy_version 44743 (0.0010) [2023-12-25 23:55:41,835][123090] Updated weights for policy 1, policy_version 44753 (0.0008) [2023-12-25 23:55:41,897][123090] Updated weights for policy 1, policy_version 44763 (0.0009) [2023-12-25 23:55:42,163][123091] Updated weights for policy 0, policy_version 44776 (0.0006) [2023-12-25 23:55:42,222][123091] Updated weights for policy 0, policy_version 44786 (0.0007) [2023-12-25 23:55:42,295][123091] Updated weights for policy 0, policy_version 44796 (0.0007) [2023-12-25 23:55:42,786][123090] Updated weights for policy 1, policy_version 44773 (0.0009) [2023-12-25 23:55:42,861][123090] Updated weights for policy 1, policy_version 44783 (0.0009) [2023-12-25 23:55:42,916][123090] Updated weights for policy 1, policy_version 44793 (0.0009) [2023-12-25 23:55:43,068][123091] Updated weights for policy 0, policy_version 44806 (0.0006) [2023-12-25 23:55:43,131][123091] Updated weights for policy 0, policy_version 44816 (0.0006) [2023-12-25 23:55:43,191][123091] Updated weights for policy 0, policy_version 44826 (0.0006) [2023-12-25 23:55:43,657][123090] Updated weights for policy 1, policy_version 44803 (0.0010) [2023-12-25 23:55:43,718][123090] Updated weights for policy 1, policy_version 44813 (0.0009) [2023-12-25 23:55:43,780][123090] Updated weights for policy 1, policy_version 44823 (0.0009) [2023-12-25 23:55:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 22945792. Throughput: 0: 9160.8, 1: 8474.6. Samples: 22944388. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:43,785][121949] Avg episode reward: [(0, '4031.662'), (1, '4636.002')] [2023-12-25 23:55:43,903][123091] Updated weights for policy 0, policy_version 44836 (0.0006) [2023-12-25 23:55:43,956][123091] Updated weights for policy 0, policy_version 44846 (0.0005) [2023-12-25 23:55:44,011][123091] Updated weights for policy 0, policy_version 44856 (0.0005) [2023-12-25 23:55:44,565][123090] Updated weights for policy 1, policy_version 44833 (0.0008) [2023-12-25 23:55:44,629][123090] Updated weights for policy 1, policy_version 44843 (0.0005) [2023-12-25 23:55:44,655][123091] Updated weights for policy 0, policy_version 44866 (0.0006) [2023-12-25 23:55:44,685][123090] Updated weights for policy 1, policy_version 44853 (0.0007) [2023-12-25 23:55:44,707][123091] Updated weights for policy 0, policy_version 44876 (0.0005) [2023-12-25 23:55:44,746][123090] Updated weights for policy 1, policy_version 44863 (0.0008) [2023-12-25 23:55:44,765][123091] Updated weights for policy 0, policy_version 44886 (0.0006) [2023-12-25 23:55:44,830][123091] Updated weights for policy 0, policy_version 44896 (0.0008) [2023-12-25 23:55:45,482][123090] Updated weights for policy 1, policy_version 44873 (0.0009) [2023-12-25 23:55:45,549][123090] Updated weights for policy 1, policy_version 44883 (0.0009) [2023-12-25 23:55:45,615][123090] Updated weights for policy 1, policy_version 44893 (0.0008) [2023-12-25 23:55:45,659][123091] Updated weights for policy 0, policy_version 44906 (0.0008) [2023-12-25 23:55:45,719][123091] Updated weights for policy 0, policy_version 44916 (0.0010) [2023-12-25 23:55:45,771][123091] Updated weights for policy 0, policy_version 44926 (0.0010) [2023-12-25 23:55:46,333][123090] Updated weights for policy 1, policy_version 44903 (0.0006) [2023-12-25 23:55:46,383][123090] Updated weights for policy 1, policy_version 44913 (0.0005) [2023-12-25 23:55:46,438][123090] Updated weights for policy 1, policy_version 44923 (0.0006) [2023-12-25 23:55:46,698][123091] Updated weights for policy 0, policy_version 44936 (0.0009) [2023-12-25 23:55:46,766][123091] Updated weights for policy 0, policy_version 44946 (0.0010) [2023-12-25 23:55:46,827][123091] Updated weights for policy 0, policy_version 44956 (0.0005) [2023-12-25 23:55:47,162][123090] Updated weights for policy 1, policy_version 44933 (0.0007) [2023-12-25 23:55:47,229][123090] Updated weights for policy 1, policy_version 44943 (0.0009) [2023-12-25 23:55:47,291][123090] Updated weights for policy 1, policy_version 44953 (0.0009) [2023-12-25 23:55:47,598][123091] Updated weights for policy 0, policy_version 44966 (0.0008) [2023-12-25 23:55:47,661][123091] Updated weights for policy 0, policy_version 44976 (0.0009) [2023-12-25 23:55:47,719][123091] Updated weights for policy 0, policy_version 44986 (0.0010) [2023-12-25 23:55:48,139][123090] Updated weights for policy 1, policy_version 44963 (0.0010) [2023-12-25 23:55:48,199][123090] Updated weights for policy 1, policy_version 44973 (0.0009) [2023-12-25 23:55:48,259][123090] Updated weights for policy 1, policy_version 44983 (0.0009) [2023-12-25 23:55:48,537][123091] Updated weights for policy 0, policy_version 44996 (0.0008) [2023-12-25 23:55:48,585][123091] Updated weights for policy 0, policy_version 45006 (0.0010) [2023-12-25 23:55:48,641][123091] Updated weights for policy 0, policy_version 45016 (0.0011) [2023-12-25 23:55:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 23044096. Throughput: 0: 9162.9, 1: 8545.1. Samples: 23052688. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:48,785][121949] Avg episode reward: [(0, '3885.493'), (1, '4669.436')] [2023-12-25 23:55:49,101][123090] Updated weights for policy 1, policy_version 44993 (0.0008) [2023-12-25 23:55:49,151][123090] Updated weights for policy 1, policy_version 45003 (0.0005) [2023-12-25 23:55:49,206][123090] Updated weights for policy 1, policy_version 45013 (0.0008) [2023-12-25 23:55:49,277][123090] Updated weights for policy 1, policy_version 45023 (0.0008) [2023-12-25 23:55:49,460][123091] Updated weights for policy 0, policy_version 45026 (0.0010) [2023-12-25 23:55:49,512][123091] Updated weights for policy 0, policy_version 45036 (0.0011) [2023-12-25 23:55:49,563][123091] Updated weights for policy 0, policy_version 45046 (0.0010) [2023-12-25 23:55:49,616][123091] Updated weights for policy 0, policy_version 45056 (0.0011) [2023-12-25 23:55:50,068][123090] Updated weights for policy 1, policy_version 45033 (0.0010) [2023-12-25 23:55:50,126][123090] Updated weights for policy 1, policy_version 45043 (0.0009) [2023-12-25 23:55:50,179][123090] Updated weights for policy 1, policy_version 45053 (0.0009) [2023-12-25 23:55:50,398][123091] Updated weights for policy 0, policy_version 45066 (0.0005) [2023-12-25 23:55:50,489][123091] Updated weights for policy 0, policy_version 45076 (0.0005) [2023-12-25 23:55:50,541][123091] Updated weights for policy 0, policy_version 45086 (0.0005) [2023-12-25 23:55:51,115][123090] Updated weights for policy 1, policy_version 45063 (0.0009) [2023-12-25 23:55:51,177][123090] Updated weights for policy 1, policy_version 45073 (0.0007) [2023-12-25 23:55:51,182][123091] Updated weights for policy 0, policy_version 45096 (0.0008) [2023-12-25 23:55:51,245][123090] Updated weights for policy 1, policy_version 45083 (0.0008) [2023-12-25 23:55:51,248][123091] Updated weights for policy 0, policy_version 45106 (0.0008) [2023-12-25 23:55:51,310][123091] Updated weights for policy 0, policy_version 45116 (0.0008) [2023-12-25 23:55:52,050][123091] Updated weights for policy 0, policy_version 45126 (0.0010) [2023-12-25 23:55:52,102][123091] Updated weights for policy 0, policy_version 45136 (0.0010) [2023-12-25 23:55:52,142][123090] Updated weights for policy 1, policy_version 45093 (0.0009) [2023-12-25 23:55:52,150][123091] Updated weights for policy 0, policy_version 45146 (0.0010) [2023-12-25 23:55:52,193][123090] Updated weights for policy 1, policy_version 45104 (0.0009) [2023-12-25 23:55:52,254][123090] Updated weights for policy 1, policy_version 45114 (0.0009) [2023-12-25 23:55:52,925][123091] Updated weights for policy 0, policy_version 45156 (0.0010) [2023-12-25 23:55:52,986][123091] Updated weights for policy 0, policy_version 45166 (0.0007) [2023-12-25 23:55:53,051][123091] Updated weights for policy 0, policy_version 45176 (0.0005) [2023-12-25 23:55:53,089][123090] Updated weights for policy 1, policy_version 45124 (0.0009) [2023-12-25 23:55:53,158][123090] Updated weights for policy 1, policy_version 45134 (0.0007) [2023-12-25 23:55:53,224][123090] Updated weights for policy 1, policy_version 45144 (0.0007) [2023-12-25 23:55:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 23126016. Throughput: 0: 9123.5, 1: 8546.3. Samples: 23104956. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:53,785][121949] Avg episode reward: [(0, '3935.058'), (1, '4723.669')] [2023-12-25 23:55:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000045184_11567104.pth... [2023-12-25 23:55:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000045152_11558912.pth... [2023-12-25 23:55:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000044160_11304960.pth [2023-12-25 23:55:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000044128_11296768.pth [2023-12-25 23:55:53,835][123091] Updated weights for policy 0, policy_version 45186 (0.0008) [2023-12-25 23:55:53,857][123090] Updated weights for policy 1, policy_version 45154 (0.0008) [2023-12-25 23:55:53,900][123091] Updated weights for policy 0, policy_version 45196 (0.0006) [2023-12-25 23:55:53,928][123090] Updated weights for policy 1, policy_version 45164 (0.0009) [2023-12-25 23:55:53,967][123091] Updated weights for policy 0, policy_version 45206 (0.0008) [2023-12-25 23:55:53,981][123090] Updated weights for policy 1, policy_version 45174 (0.0009) [2023-12-25 23:55:54,025][123091] Updated weights for policy 0, policy_version 45216 (0.0008) [2023-12-25 23:55:54,039][123090] Updated weights for policy 1, policy_version 45184 (0.0010) [2023-12-25 23:55:54,820][123091] Updated weights for policy 0, policy_version 45226 (0.0008) [2023-12-25 23:55:54,868][123090] Updated weights for policy 1, policy_version 45194 (0.0010) [2023-12-25 23:55:54,869][123091] Updated weights for policy 0, policy_version 45236 (0.0008) [2023-12-25 23:55:54,918][123091] Updated weights for policy 0, policy_version 45246 (0.0009) [2023-12-25 23:55:54,933][123090] Updated weights for policy 1, policy_version 45204 (0.0010) [2023-12-25 23:55:54,981][123090] Updated weights for policy 1, policy_version 45214 (0.0010) [2023-12-25 23:55:55,771][123091] Updated weights for policy 0, policy_version 45256 (0.0009) [2023-12-25 23:55:55,803][123090] Updated weights for policy 1, policy_version 45224 (0.0006) [2023-12-25 23:55:55,830][123091] Updated weights for policy 0, policy_version 45266 (0.0007) [2023-12-25 23:55:55,851][123090] Updated weights for policy 1, policy_version 45234 (0.0005) [2023-12-25 23:55:55,883][123091] Updated weights for policy 0, policy_version 45276 (0.0008) [2023-12-25 23:55:55,903][123090] Updated weights for policy 1, policy_version 45244 (0.0005) [2023-12-25 23:55:56,727][123090] Updated weights for policy 1, policy_version 45254 (0.0006) [2023-12-25 23:55:56,740][123091] Updated weights for policy 0, policy_version 45286 (0.0008) [2023-12-25 23:55:56,785][123090] Updated weights for policy 1, policy_version 45264 (0.0008) [2023-12-25 23:55:56,791][123091] Updated weights for policy 0, policy_version 45296 (0.0008) [2023-12-25 23:55:56,833][123090] Updated weights for policy 1, policy_version 45274 (0.0005) [2023-12-25 23:55:56,842][123091] Updated weights for policy 0, policy_version 45306 (0.0008) [2023-12-25 23:55:57,548][123090] Updated weights for policy 1, policy_version 45284 (0.0005) [2023-12-25 23:55:57,606][123090] Updated weights for policy 1, policy_version 45294 (0.0005) [2023-12-25 23:55:57,664][123090] Updated weights for policy 1, policy_version 45304 (0.0009) [2023-12-25 23:55:57,756][123091] Updated weights for policy 0, policy_version 45316 (0.0009) [2023-12-25 23:55:57,814][123091] Updated weights for policy 0, policy_version 45328 (0.0010) [2023-12-25 23:55:57,873][123091] Updated weights for policy 0, policy_version 45338 (0.0009) [2023-12-25 23:55:58,369][123090] Updated weights for policy 1, policy_version 45314 (0.0006) [2023-12-25 23:55:58,447][123090] Updated weights for policy 1, policy_version 45324 (0.0008) [2023-12-25 23:55:58,514][123090] Updated weights for policy 1, policy_version 45334 (0.0008) [2023-12-25 23:55:58,580][123090] Updated weights for policy 1, policy_version 45344 (0.0008) [2023-12-25 23:55:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 23216128. Throughput: 0: 9144.5, 1: 8569.4. Samples: 23211408. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-25 23:55:58,784][121949] Avg episode reward: [(0, '4065.636'), (1, '4802.240')] [2023-12-25 23:55:58,837][123091] Updated weights for policy 0, policy_version 45348 (0.0008) [2023-12-25 23:55:58,900][123091] Updated weights for policy 0, policy_version 45358 (0.0007) [2023-12-25 23:55:58,969][123091] Updated weights for policy 0, policy_version 45368 (0.0008) [2023-12-25 23:55:59,442][123090] Updated weights for policy 1, policy_version 45354 (0.0010) [2023-12-25 23:55:59,508][123090] Updated weights for policy 1, policy_version 45364 (0.0009) [2023-12-25 23:55:59,574][123090] Updated weights for policy 1, policy_version 45374 (0.0009) [2023-12-25 23:55:59,790][123091] Updated weights for policy 0, policy_version 45378 (0.0008) [2023-12-25 23:55:59,850][123091] Updated weights for policy 0, policy_version 45388 (0.0011) [2023-12-25 23:55:59,909][123091] Updated weights for policy 0, policy_version 45398 (0.0011) [2023-12-25 23:55:59,978][123091] Updated weights for policy 0, policy_version 45408 (0.0011) [2023-12-25 23:56:00,437][123090] Updated weights for policy 1, policy_version 45384 (0.0009) [2023-12-25 23:56:00,495][123090] Updated weights for policy 1, policy_version 45394 (0.0008) [2023-12-25 23:56:00,547][123090] Updated weights for policy 1, policy_version 45404 (0.0008) [2023-12-25 23:56:00,782][123091] Updated weights for policy 0, policy_version 45418 (0.0010) [2023-12-25 23:56:00,833][123091] Updated weights for policy 0, policy_version 45428 (0.0010) [2023-12-25 23:56:00,894][123091] Updated weights for policy 0, policy_version 45438 (0.0010) [2023-12-25 23:56:01,370][123090] Updated weights for policy 1, policy_version 45414 (0.0009) [2023-12-25 23:56:01,443][123090] Updated weights for policy 1, policy_version 45424 (0.0009) [2023-12-25 23:56:01,511][123090] Updated weights for policy 1, policy_version 45434 (0.0009) [2023-12-25 23:56:01,688][123091] Updated weights for policy 0, policy_version 45448 (0.0007) [2023-12-25 23:56:01,749][123091] Updated weights for policy 0, policy_version 45458 (0.0010) [2023-12-25 23:56:01,804][123091] Updated weights for policy 0, policy_version 45468 (0.0008) [2023-12-25 23:56:02,370][123090] Updated weights for policy 1, policy_version 45444 (0.0009) [2023-12-25 23:56:02,434][123090] Updated weights for policy 1, policy_version 45454 (0.0010) [2023-12-25 23:56:02,495][123090] Updated weights for policy 1, policy_version 45464 (0.0009) [2023-12-25 23:56:02,620][123091] Updated weights for policy 0, policy_version 45478 (0.0007) [2023-12-25 23:56:02,688][123091] Updated weights for policy 0, policy_version 45488 (0.0009) [2023-12-25 23:56:02,749][123091] Updated weights for policy 0, policy_version 45498 (0.0007) [2023-12-25 23:56:03,371][123090] Updated weights for policy 1, policy_version 45474 (0.0010) [2023-12-25 23:56:03,390][123091] Updated weights for policy 0, policy_version 45508 (0.0006) [2023-12-25 23:56:03,419][123090] Updated weights for policy 1, policy_version 45484 (0.0008) [2023-12-25 23:56:03,457][123091] Updated weights for policy 0, policy_version 45518 (0.0007) [2023-12-25 23:56:03,469][123090] Updated weights for policy 1, policy_version 45495 (0.0008) [2023-12-25 23:56:03,512][123091] Updated weights for policy 0, policy_version 45528 (0.0008) [2023-12-25 23:56:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 23306240. Throughput: 0: 9081.4, 1: 8523.9. Samples: 23313704. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:03,784][121949] Avg episode reward: [(0, '4027.762'), (1, '4712.098')] [2023-12-25 23:56:04,240][123091] Updated weights for policy 0, policy_version 45538 (0.0008) [2023-12-25 23:56:04,310][123091] Updated weights for policy 0, policy_version 45548 (0.0006) [2023-12-25 23:56:04,380][123091] Updated weights for policy 0, policy_version 45558 (0.0007) [2023-12-25 23:56:04,399][123090] Updated weights for policy 1, policy_version 45505 (0.0009) [2023-12-25 23:56:04,444][123091] Updated weights for policy 0, policy_version 45568 (0.0006) [2023-12-25 23:56:04,471][123090] Updated weights for policy 1, policy_version 45515 (0.0009) [2023-12-25 23:56:04,539][123090] Updated weights for policy 1, policy_version 45525 (0.0009) [2023-12-25 23:56:04,611][123090] Updated weights for policy 1, policy_version 45535 (0.0010) [2023-12-25 23:56:05,176][123091] Updated weights for policy 0, policy_version 45578 (0.0010) [2023-12-25 23:56:05,230][123091] Updated weights for policy 0, policy_version 45588 (0.0010) [2023-12-25 23:56:05,299][123091] Updated weights for policy 0, policy_version 45598 (0.0007) [2023-12-25 23:56:05,445][123090] Updated weights for policy 1, policy_version 45545 (0.0008) [2023-12-25 23:56:05,513][123090] Updated weights for policy 1, policy_version 45555 (0.0009) [2023-12-25 23:56:05,580][123090] Updated weights for policy 1, policy_version 45565 (0.0010) [2023-12-25 23:56:05,989][123091] Updated weights for policy 0, policy_version 45608 (0.0005) [2023-12-25 23:56:06,049][123091] Updated weights for policy 0, policy_version 45618 (0.0005) [2023-12-25 23:56:06,114][123091] Updated weights for policy 0, policy_version 45628 (0.0006) [2023-12-25 23:56:06,479][123090] Updated weights for policy 1, policy_version 45575 (0.0010) [2023-12-25 23:56:06,544][123090] Updated weights for policy 1, policy_version 45585 (0.0010) [2023-12-25 23:56:06,609][123090] Updated weights for policy 1, policy_version 45595 (0.0008) [2023-12-25 23:56:06,843][123091] Updated weights for policy 0, policy_version 45638 (0.0009) [2023-12-25 23:56:06,897][123091] Updated weights for policy 0, policy_version 45648 (0.0010) [2023-12-25 23:56:06,946][123091] Updated weights for policy 0, policy_version 45658 (0.0011) [2023-12-25 23:56:07,452][123090] Updated weights for policy 1, policy_version 45605 (0.0009) [2023-12-25 23:56:07,503][123090] Updated weights for policy 1, policy_version 45615 (0.0009) [2023-12-25 23:56:07,555][123090] Updated weights for policy 1, policy_version 45625 (0.0009) [2023-12-25 23:56:07,800][123091] Updated weights for policy 0, policy_version 45668 (0.0010) [2023-12-25 23:56:07,848][123091] Updated weights for policy 0, policy_version 45678 (0.0010) [2023-12-25 23:56:07,915][123091] Updated weights for policy 0, policy_version 45688 (0.0011) [2023-12-25 23:56:08,400][123090] Updated weights for policy 1, policy_version 45635 (0.0009) [2023-12-25 23:56:08,461][123090] Updated weights for policy 1, policy_version 45645 (0.0009) [2023-12-25 23:56:08,514][123090] Updated weights for policy 1, policy_version 45655 (0.0009) [2023-12-25 23:56:08,749][123091] Updated weights for policy 0, policy_version 45698 (0.0010) [2023-12-25 23:56:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 23388160. Throughput: 0: 9152.2, 1: 8501.1. Samples: 23366892. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:08,785][121949] Avg episode reward: [(0, '4046.238'), (1, '4760.548')] [2023-12-25 23:56:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000045664_11689984.pth... [2023-12-25 23:56:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000044672_11436032.pth [2023-12-25 23:56:08,810][123091] Updated weights for policy 0, policy_version 45708 (0.0011) [2023-12-25 23:56:08,869][123091] Updated weights for policy 0, policy_version 45718 (0.0011) [2023-12-25 23:56:08,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000045728_11706368.pth... [2023-12-25 23:56:08,936][123091] Updated weights for policy 0, policy_version 45728 (0.0011) [2023-12-25 23:56:08,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000044672_11436032.pth [2023-12-25 23:56:09,368][123090] Updated weights for policy 1, policy_version 45665 (0.0008) [2023-12-25 23:56:09,439][123090] Updated weights for policy 1, policy_version 45675 (0.0008) [2023-12-25 23:56:09,510][123090] Updated weights for policy 1, policy_version 45685 (0.0010) [2023-12-25 23:56:09,582][123090] Updated weights for policy 1, policy_version 45695 (0.0010) [2023-12-25 23:56:09,740][123091] Updated weights for policy 0, policy_version 45738 (0.0011) [2023-12-25 23:56:09,804][123091] Updated weights for policy 0, policy_version 45748 (0.0011) [2023-12-25 23:56:09,874][123091] Updated weights for policy 0, policy_version 45758 (0.0013) [2023-12-25 23:56:10,445][123090] Updated weights for policy 1, policy_version 45705 (0.0006) [2023-12-25 23:56:10,517][123090] Updated weights for policy 1, policy_version 45715 (0.0006) [2023-12-25 23:56:10,590][123090] Updated weights for policy 1, policy_version 45725 (0.0009) [2023-12-25 23:56:10,712][123091] Updated weights for policy 0, policy_version 45768 (0.0010) [2023-12-25 23:56:10,767][123091] Updated weights for policy 0, policy_version 45778 (0.0010) [2023-12-25 23:56:10,814][123091] Updated weights for policy 0, policy_version 45788 (0.0010) [2023-12-25 23:56:11,357][123090] Updated weights for policy 1, policy_version 45735 (0.0008) [2023-12-25 23:56:11,419][123090] Updated weights for policy 1, policy_version 45745 (0.0007) [2023-12-25 23:56:11,468][123090] Updated weights for policy 1, policy_version 45755 (0.0005) [2023-12-25 23:56:11,709][123091] Updated weights for policy 0, policy_version 45798 (0.0010) [2023-12-25 23:56:11,773][123091] Updated weights for policy 0, policy_version 45808 (0.0009) [2023-12-25 23:56:11,826][123091] Updated weights for policy 0, policy_version 45818 (0.0009) [2023-12-25 23:56:12,270][123090] Updated weights for policy 1, policy_version 45765 (0.0007) [2023-12-25 23:56:12,339][123090] Updated weights for policy 1, policy_version 45775 (0.0009) [2023-12-25 23:56:12,410][123090] Updated weights for policy 1, policy_version 45785 (0.0008) [2023-12-25 23:56:12,653][123091] Updated weights for policy 0, policy_version 45828 (0.0009) [2023-12-25 23:56:12,716][123091] Updated weights for policy 0, policy_version 45838 (0.0009) [2023-12-25 23:56:12,780][123091] Updated weights for policy 0, policy_version 45848 (0.0009) [2023-12-25 23:56:13,146][123090] Updated weights for policy 1, policy_version 45795 (0.0008) [2023-12-25 23:56:13,221][123090] Updated weights for policy 1, policy_version 45805 (0.0005) [2023-12-25 23:56:13,294][123090] Updated weights for policy 1, policy_version 45815 (0.0005) [2023-12-25 23:56:13,671][123091] Updated weights for policy 0, policy_version 45858 (0.0010) [2023-12-25 23:56:13,724][123091] Updated weights for policy 0, policy_version 45868 (0.0009) [2023-12-25 23:56:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 23470080. Throughput: 0: 8979.5, 1: 8534.3. Samples: 23468252. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:13,785][121949] Avg episode reward: [(0, '3961.929'), (1, '4871.597')] [2023-12-25 23:56:13,793][123091] Updated weights for policy 0, policy_version 45878 (0.0009) [2023-12-25 23:56:13,850][123091] Updated weights for policy 0, policy_version 45888 (0.0009) [2023-12-25 23:56:13,993][123090] Updated weights for policy 1, policy_version 45825 (0.0006) [2023-12-25 23:56:14,057][123090] Updated weights for policy 1, policy_version 45835 (0.0009) [2023-12-25 23:56:14,104][123090] Updated weights for policy 1, policy_version 45845 (0.0009) [2023-12-25 23:56:14,162][123090] Updated weights for policy 1, policy_version 45855 (0.0008) [2023-12-25 23:56:14,704][123091] Updated weights for policy 0, policy_version 45898 (0.0010) [2023-12-25 23:56:14,770][123091] Updated weights for policy 0, policy_version 45908 (0.0010) [2023-12-25 23:56:14,839][123091] Updated weights for policy 0, policy_version 45918 (0.0008) [2023-12-25 23:56:15,020][123090] Updated weights for policy 1, policy_version 45865 (0.0009) [2023-12-25 23:56:15,090][123090] Updated weights for policy 1, policy_version 45875 (0.0009) [2023-12-25 23:56:15,160][123090] Updated weights for policy 1, policy_version 45885 (0.0009) [2023-12-25 23:56:15,694][123091] Updated weights for policy 0, policy_version 45928 (0.0010) [2023-12-25 23:56:15,753][123091] Updated weights for policy 0, policy_version 45938 (0.0005) [2023-12-25 23:56:15,821][123091] Updated weights for policy 0, policy_version 45948 (0.0005) [2023-12-25 23:56:15,980][123090] Updated weights for policy 1, policy_version 45895 (0.0010) [2023-12-25 23:56:16,037][123090] Updated weights for policy 1, policy_version 45905 (0.0009) [2023-12-25 23:56:16,089][123090] Updated weights for policy 1, policy_version 45915 (0.0009) [2023-12-25 23:56:16,409][123091] Updated weights for policy 0, policy_version 45958 (0.0005) [2023-12-25 23:56:16,464][123091] Updated weights for policy 0, policy_version 45968 (0.0005) [2023-12-25 23:56:16,513][123091] Updated weights for policy 0, policy_version 45978 (0.0005) [2023-12-25 23:56:17,024][123090] Updated weights for policy 1, policy_version 45925 (0.0008) [2023-12-25 23:56:17,079][123090] Updated weights for policy 1, policy_version 45935 (0.0009) [2023-12-25 23:56:17,132][123090] Updated weights for policy 1, policy_version 45945 (0.0009) [2023-12-25 23:56:17,264][123091] Updated weights for policy 0, policy_version 45988 (0.0007) [2023-12-25 23:56:17,310][123091] Updated weights for policy 0, policy_version 45998 (0.0010) [2023-12-25 23:56:17,361][123091] Updated weights for policy 0, policy_version 46008 (0.0010) [2023-12-25 23:56:18,014][123090] Updated weights for policy 1, policy_version 45955 (0.0009) [2023-12-25 23:56:18,068][123090] Updated weights for policy 1, policy_version 45965 (0.0010) [2023-12-25 23:56:18,115][123091] Updated weights for policy 0, policy_version 46018 (0.0010) [2023-12-25 23:56:18,123][123090] Updated weights for policy 1, policy_version 45975 (0.0008) [2023-12-25 23:56:18,181][123091] Updated weights for policy 0, policy_version 46028 (0.0009) [2023-12-25 23:56:18,245][123091] Updated weights for policy 0, policy_version 46038 (0.0011) [2023-12-25 23:56:18,297][123091] Updated weights for policy 0, policy_version 46048 (0.0011) [2023-12-25 23:56:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 23560192. Throughput: 0: 8963.6, 1: 8568.4. Samples: 23573212. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:18,785][121949] Avg episode reward: [(0, '3935.762'), (1, '4778.893')] [2023-12-25 23:56:18,956][123090] Updated weights for policy 1, policy_version 45985 (0.0008) [2023-12-25 23:56:19,022][123090] Updated weights for policy 1, policy_version 45995 (0.0006) [2023-12-25 23:56:19,092][123090] Updated weights for policy 1, policy_version 46005 (0.0008) [2023-12-25 23:56:19,127][123091] Updated weights for policy 0, policy_version 46058 (0.0008) [2023-12-25 23:56:19,152][123090] Updated weights for policy 1, policy_version 46015 (0.0007) [2023-12-25 23:56:19,191][123091] Updated weights for policy 0, policy_version 46068 (0.0010) [2023-12-25 23:56:19,254][123091] Updated weights for policy 0, policy_version 46078 (0.0009) [2023-12-25 23:56:19,919][123090] Updated weights for policy 1, policy_version 46026 (0.0009) [2023-12-25 23:56:19,981][123090] Updated weights for policy 1, policy_version 46036 (0.0010) [2023-12-25 23:56:20,049][123090] Updated weights for policy 1, policy_version 46046 (0.0009) [2023-12-25 23:56:20,172][123091] Updated weights for policy 0, policy_version 46088 (0.0007) [2023-12-25 23:56:20,234][123091] Updated weights for policy 0, policy_version 46098 (0.0008) [2023-12-25 23:56:20,289][123091] Updated weights for policy 0, policy_version 46108 (0.0009) [2023-12-25 23:56:20,898][123090] Updated weights for policy 1, policy_version 46056 (0.0010) [2023-12-25 23:56:20,967][123090] Updated weights for policy 1, policy_version 46066 (0.0009) [2023-12-25 23:56:21,035][123090] Updated weights for policy 1, policy_version 46076 (0.0009) [2023-12-25 23:56:21,117][123091] Updated weights for policy 0, policy_version 46118 (0.0009) [2023-12-25 23:56:21,185][123091] Updated weights for policy 0, policy_version 46128 (0.0010) [2023-12-25 23:56:21,252][123091] Updated weights for policy 0, policy_version 46138 (0.0010) [2023-12-25 23:56:21,930][123090] Updated weights for policy 1, policy_version 46086 (0.0009) [2023-12-25 23:56:21,998][123090] Updated weights for policy 1, policy_version 46096 (0.0009) [2023-12-25 23:56:22,051][123091] Updated weights for policy 0, policy_version 46148 (0.0009) [2023-12-25 23:56:22,062][123090] Updated weights for policy 1, policy_version 46106 (0.0008) [2023-12-25 23:56:22,114][123091] Updated weights for policy 0, policy_version 46158 (0.0008) [2023-12-25 23:56:22,176][123091] Updated weights for policy 0, policy_version 46168 (0.0008) [2023-12-25 23:56:22,915][123090] Updated weights for policy 1, policy_version 46116 (0.0008) [2023-12-25 23:56:22,973][123090] Updated weights for policy 1, policy_version 46126 (0.0010) [2023-12-25 23:56:23,021][123091] Updated weights for policy 0, policy_version 46178 (0.0009) [2023-12-25 23:56:23,033][123090] Updated weights for policy 1, policy_version 46136 (0.0009) [2023-12-25 23:56:23,086][123091] Updated weights for policy 0, policy_version 46188 (0.0008) [2023-12-25 23:56:23,150][123091] Updated weights for policy 0, policy_version 46198 (0.0006) [2023-12-25 23:56:23,204][123091] Updated weights for policy 0, policy_version 46208 (0.0005) [2023-12-25 23:56:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 23642112. Throughput: 0: 8885.0, 1: 8564.0. Samples: 23623424. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:23,785][121949] Avg episode reward: [(0, '4001.598'), (1, '4833.151')] [2023-12-25 23:56:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000046208_11829248.pth... [2023-12-25 23:56:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000046144_11812864.pth... [2023-12-25 23:56:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000045184_11567104.pth [2023-12-25 23:56:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000045152_11558912.pth [2023-12-25 23:56:23,880][123091] Updated weights for policy 0, policy_version 46218 (0.0009) [2023-12-25 23:56:23,923][123090] Updated weights for policy 1, policy_version 46146 (0.0008) [2023-12-25 23:56:23,930][123091] Updated weights for policy 0, policy_version 46228 (0.0009) [2023-12-25 23:56:23,974][123090] Updated weights for policy 1, policy_version 46156 (0.0008) [2023-12-25 23:56:23,987][123091] Updated weights for policy 0, policy_version 46238 (0.0009) [2023-12-25 23:56:24,029][123090] Updated weights for policy 1, policy_version 46166 (0.0009) [2023-12-25 23:56:24,082][123090] Updated weights for policy 1, policy_version 46176 (0.0008) [2023-12-25 23:56:24,808][123091] Updated weights for policy 0, policy_version 46248 (0.0010) [2023-12-25 23:56:24,862][123091] Updated weights for policy 0, policy_version 46258 (0.0009) [2023-12-25 23:56:24,929][123091] Updated weights for policy 0, policy_version 46268 (0.0009) [2023-12-25 23:56:24,957][123090] Updated weights for policy 1, policy_version 46186 (0.0009) [2023-12-25 23:56:25,013][123090] Updated weights for policy 1, policy_version 46196 (0.0009) [2023-12-25 23:56:25,065][123090] Updated weights for policy 1, policy_version 46206 (0.0008) [2023-12-25 23:56:25,717][123091] Updated weights for policy 0, policy_version 46278 (0.0009) [2023-12-25 23:56:25,771][123091] Updated weights for policy 0, policy_version 46288 (0.0009) [2023-12-25 23:56:25,830][123091] Updated weights for policy 0, policy_version 46298 (0.0010) [2023-12-25 23:56:25,918][123090] Updated weights for policy 1, policy_version 46216 (0.0010) [2023-12-25 23:56:25,974][123090] Updated weights for policy 1, policy_version 46226 (0.0009) [2023-12-25 23:56:26,028][123090] Updated weights for policy 1, policy_version 46236 (0.0010) [2023-12-25 23:56:26,541][123091] Updated weights for policy 0, policy_version 46308 (0.0005) [2023-12-25 23:56:26,590][123091] Updated weights for policy 0, policy_version 46318 (0.0005) [2023-12-25 23:56:26,636][123091] Updated weights for policy 0, policy_version 46328 (0.0005) [2023-12-25 23:56:26,977][123090] Updated weights for policy 1, policy_version 46246 (0.0010) [2023-12-25 23:56:27,030][123090] Updated weights for policy 1, policy_version 46256 (0.0010) [2023-12-25 23:56:27,089][123090] Updated weights for policy 1, policy_version 46267 (0.0010) [2023-12-25 23:56:27,308][123091] Updated weights for policy 0, policy_version 46338 (0.0005) [2023-12-25 23:56:27,372][123091] Updated weights for policy 0, policy_version 46348 (0.0006) [2023-12-25 23:56:27,419][123091] Updated weights for policy 0, policy_version 46358 (0.0005) [2023-12-25 23:56:27,483][123091] Updated weights for policy 0, policy_version 46368 (0.0005) [2023-12-25 23:56:28,048][123090] Updated weights for policy 1, policy_version 46277 (0.0010) [2023-12-25 23:56:28,101][123090] Updated weights for policy 1, policy_version 46288 (0.0010) [2023-12-25 23:56:28,144][123091] Updated weights for policy 0, policy_version 46378 (0.0005) [2023-12-25 23:56:28,159][123090] Updated weights for policy 1, policy_version 46298 (0.0008) [2023-12-25 23:56:28,196][123091] Updated weights for policy 0, policy_version 46388 (0.0005) [2023-12-25 23:56:28,263][123091] Updated weights for policy 0, policy_version 46398 (0.0005) [2023-12-25 23:56:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 23732224. Throughput: 0: 8888.8, 1: 8528.3. Samples: 23728156. Policy #0 lag: (min: 9.0, avg: 31.8, max: 41.0) [2023-12-25 23:56:28,784][121949] Avg episode reward: [(0, '4144.031'), (1, '4831.200')] [2023-12-25 23:56:28,907][123091] Updated weights for policy 0, policy_version 46408 (0.0006) [2023-12-25 23:56:28,970][123091] Updated weights for policy 0, policy_version 46418 (0.0006) [2023-12-25 23:56:29,038][123091] Updated weights for policy 0, policy_version 46428 (0.0005) [2023-12-25 23:56:29,129][123090] Updated weights for policy 1, policy_version 46308 (0.0009) [2023-12-25 23:56:29,199][123090] Updated weights for policy 1, policy_version 46318 (0.0010) [2023-12-25 23:56:29,269][123090] Updated weights for policy 1, policy_version 46328 (0.0009) [2023-12-25 23:56:29,700][123091] Updated weights for policy 0, policy_version 46438 (0.0008) [2023-12-25 23:56:29,756][123091] Updated weights for policy 0, policy_version 46448 (0.0007) [2023-12-25 23:56:29,810][123091] Updated weights for policy 0, policy_version 46458 (0.0010) [2023-12-25 23:56:30,109][123090] Updated weights for policy 1, policy_version 46338 (0.0010) [2023-12-25 23:56:30,162][123090] Updated weights for policy 1, policy_version 46348 (0.0009) [2023-12-25 23:56:30,214][123090] Updated weights for policy 1, policy_version 46358 (0.0009) [2023-12-25 23:56:30,277][123090] Updated weights for policy 1, policy_version 46368 (0.0009) [2023-12-25 23:56:30,653][123091] Updated weights for policy 0, policy_version 46468 (0.0009) [2023-12-25 23:56:30,705][123091] Updated weights for policy 0, policy_version 46478 (0.0009) [2023-12-25 23:56:30,766][123091] Updated weights for policy 0, policy_version 46488 (0.0010) [2023-12-25 23:56:31,170][123090] Updated weights for policy 1, policy_version 46378 (0.0010) [2023-12-25 23:56:31,227][123090] Updated weights for policy 1, policy_version 46388 (0.0010) [2023-12-25 23:56:31,288][123090] Updated weights for policy 1, policy_version 46398 (0.0009) [2023-12-25 23:56:31,543][123091] Updated weights for policy 0, policy_version 46498 (0.0009) [2023-12-25 23:56:31,596][123091] Updated weights for policy 0, policy_version 46508 (0.0009) [2023-12-25 23:56:31,654][123091] Updated weights for policy 0, policy_version 46518 (0.0009) [2023-12-25 23:56:31,711][123091] Updated weights for policy 0, policy_version 46528 (0.0009) [2023-12-25 23:56:32,178][123090] Updated weights for policy 1, policy_version 46408 (0.0009) [2023-12-25 23:56:32,227][123090] Updated weights for policy 1, policy_version 46418 (0.0009) [2023-12-25 23:56:32,289][123090] Updated weights for policy 1, policy_version 46428 (0.0009) [2023-12-25 23:56:32,473][123091] Updated weights for policy 0, policy_version 46538 (0.0009) [2023-12-25 23:56:32,521][123091] Updated weights for policy 0, policy_version 46548 (0.0009) [2023-12-25 23:56:32,580][123091] Updated weights for policy 0, policy_version 46558 (0.0010) [2023-12-25 23:56:33,066][123090] Updated weights for policy 1, policy_version 46438 (0.0007) [2023-12-25 23:56:33,130][123090] Updated weights for policy 1, policy_version 46448 (0.0006) [2023-12-25 23:56:33,184][123090] Updated weights for policy 1, policy_version 46458 (0.0005) [2023-12-25 23:56:33,343][123091] Updated weights for policy 0, policy_version 46568 (0.0006) [2023-12-25 23:56:33,390][123091] Updated weights for policy 0, policy_version 46578 (0.0005) [2023-12-25 23:56:33,436][123091] Updated weights for policy 0, policy_version 46588 (0.0005) [2023-12-25 23:56:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 23822336. Throughput: 0: 8957.8, 1: 8427.1. Samples: 23835008. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:33,785][121949] Avg episode reward: [(0, '4116.940'), (1, '4941.562')] [2023-12-25 23:56:33,787][123008] Saving new best policy, reward=4941.562! [2023-12-25 23:56:33,944][123090] Updated weights for policy 1, policy_version 46468 (0.0007) [2023-12-25 23:56:33,997][123090] Updated weights for policy 1, policy_version 46478 (0.0008) [2023-12-25 23:56:34,052][123090] Updated weights for policy 1, policy_version 46488 (0.0005) [2023-12-25 23:56:34,156][123091] Updated weights for policy 0, policy_version 46598 (0.0008) [2023-12-25 23:56:34,214][123091] Updated weights for policy 0, policy_version 46608 (0.0010) [2023-12-25 23:56:34,266][123091] Updated weights for policy 0, policy_version 46618 (0.0009) [2023-12-25 23:56:34,823][123090] Updated weights for policy 1, policy_version 46498 (0.0006) [2023-12-25 23:56:34,887][123090] Updated weights for policy 1, policy_version 46508 (0.0010) [2023-12-25 23:56:34,944][123090] Updated weights for policy 1, policy_version 46518 (0.0009) [2023-12-25 23:56:35,005][123090] Updated weights for policy 1, policy_version 46528 (0.0010) [2023-12-25 23:56:35,118][123091] Updated weights for policy 0, policy_version 46629 (0.0008) [2023-12-25 23:56:35,186][123091] Updated weights for policy 0, policy_version 46639 (0.0007) [2023-12-25 23:56:35,247][123091] Updated weights for policy 0, policy_version 46649 (0.0005) [2023-12-25 23:56:35,872][123090] Updated weights for policy 1, policy_version 46538 (0.0008) [2023-12-25 23:56:35,924][123090] Updated weights for policy 1, policy_version 46548 (0.0005) [2023-12-25 23:56:35,983][123090] Updated weights for policy 1, policy_version 46558 (0.0009) [2023-12-25 23:56:35,999][123091] Updated weights for policy 0, policy_version 46659 (0.0006) [2023-12-25 23:56:36,053][123091] Updated weights for policy 0, policy_version 46669 (0.0008) [2023-12-25 23:56:36,114][123091] Updated weights for policy 0, policy_version 46679 (0.0009) [2023-12-25 23:56:36,791][123090] Updated weights for policy 1, policy_version 46568 (0.0010) [2023-12-25 23:56:36,842][123090] Updated weights for policy 1, policy_version 46578 (0.0009) [2023-12-25 23:56:36,901][123090] Updated weights for policy 1, policy_version 46588 (0.0010) [2023-12-25 23:56:36,988][123091] Updated weights for policy 0, policy_version 46689 (0.0009) [2023-12-25 23:56:37,047][123091] Updated weights for policy 0, policy_version 46699 (0.0005) [2023-12-25 23:56:37,105][123091] Updated weights for policy 0, policy_version 46709 (0.0005) [2023-12-25 23:56:37,158][123091] Updated weights for policy 0, policy_version 46719 (0.0005) [2023-12-25 23:56:37,768][123091] Updated weights for policy 0, policy_version 46729 (0.0007) [2023-12-25 23:56:37,831][123091] Updated weights for policy 0, policy_version 46739 (0.0010) [2023-12-25 23:56:37,834][123090] Updated weights for policy 1, policy_version 46598 (0.0007) [2023-12-25 23:56:37,890][123091] Updated weights for policy 0, policy_version 46749 (0.0007) [2023-12-25 23:56:37,894][123090] Updated weights for policy 1, policy_version 46608 (0.0007) [2023-12-25 23:56:37,953][123090] Updated weights for policy 1, policy_version 46618 (0.0010) [2023-12-25 23:56:38,588][123091] Updated weights for policy 0, policy_version 46759 (0.0009) [2023-12-25 23:56:38,640][123091] Updated weights for policy 0, policy_version 46769 (0.0010) [2023-12-25 23:56:38,687][123091] Updated weights for policy 0, policy_version 46779 (0.0010) [2023-12-25 23:56:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 23912448. Throughput: 0: 8931.7, 1: 8450.6. Samples: 23887156. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:38,785][121949] Avg episode reward: [(0, '4093.116'), (1, '4790.364')] [2023-12-25 23:56:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000046784_11976704.pth... [2023-12-25 23:56:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000046624_11935744.pth... [2023-12-25 23:56:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000045664_11689984.pth [2023-12-25 23:56:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000045728_11706368.pth [2023-12-25 23:56:38,872][123090] Updated weights for policy 1, policy_version 46628 (0.0009) [2023-12-25 23:56:38,940][123090] Updated weights for policy 1, policy_version 46638 (0.0009) [2023-12-25 23:56:39,005][123090] Updated weights for policy 1, policy_version 46648 (0.0009) [2023-12-25 23:56:39,448][123091] Updated weights for policy 0, policy_version 46789 (0.0010) [2023-12-25 23:56:39,509][123091] Updated weights for policy 0, policy_version 46799 (0.0008) [2023-12-25 23:56:39,581][123091] Updated weights for policy 0, policy_version 46809 (0.0010) [2023-12-25 23:56:39,880][123090] Updated weights for policy 1, policy_version 46658 (0.0009) [2023-12-25 23:56:39,947][123090] Updated weights for policy 1, policy_version 46668 (0.0010) [2023-12-25 23:56:40,013][123090] Updated weights for policy 1, policy_version 46678 (0.0009) [2023-12-25 23:56:40,075][123090] Updated weights for policy 1, policy_version 46688 (0.0008) [2023-12-25 23:56:40,430][123091] Updated weights for policy 0, policy_version 46819 (0.0009) [2023-12-25 23:56:40,490][123091] Updated weights for policy 0, policy_version 46829 (0.0010) [2023-12-25 23:56:40,544][123091] Updated weights for policy 0, policy_version 46840 (0.0009) [2023-12-25 23:56:40,882][123090] Updated weights for policy 1, policy_version 46698 (0.0010) [2023-12-25 23:56:40,932][123090] Updated weights for policy 1, policy_version 46708 (0.0010) [2023-12-25 23:56:40,983][123090] Updated weights for policy 1, policy_version 46719 (0.0010) [2023-12-25 23:56:41,463][123091] Updated weights for policy 0, policy_version 46850 (0.0010) [2023-12-25 23:56:41,522][123091] Updated weights for policy 0, policy_version 46860 (0.0010) [2023-12-25 23:56:41,588][123091] Updated weights for policy 0, policy_version 46870 (0.0010) [2023-12-25 23:56:41,663][123091] Updated weights for policy 0, policy_version 46880 (0.0008) [2023-12-25 23:56:41,834][123090] Updated weights for policy 1, policy_version 46729 (0.0009) [2023-12-25 23:56:41,898][123090] Updated weights for policy 1, policy_version 46739 (0.0010) [2023-12-25 23:56:41,960][123090] Updated weights for policy 1, policy_version 46749 (0.0010) [2023-12-25 23:56:42,556][123091] Updated weights for policy 0, policy_version 46890 (0.0009) [2023-12-25 23:56:42,607][123091] Updated weights for policy 0, policy_version 46900 (0.0009) [2023-12-25 23:56:42,658][123091] Updated weights for policy 0, policy_version 46910 (0.0009) [2023-12-25 23:56:42,785][123090] Updated weights for policy 1, policy_version 46759 (0.0010) [2023-12-25 23:56:42,857][123090] Updated weights for policy 1, policy_version 46769 (0.0008) [2023-12-25 23:56:42,925][123090] Updated weights for policy 1, policy_version 46779 (0.0009) [2023-12-25 23:56:43,514][123091] Updated weights for policy 0, policy_version 46920 (0.0010) [2023-12-25 23:56:43,571][123091] Updated weights for policy 0, policy_version 46930 (0.0009) [2023-12-25 23:56:43,627][123091] Updated weights for policy 0, policy_version 46940 (0.0009) [2023-12-25 23:56:43,734][123090] Updated weights for policy 1, policy_version 46789 (0.0010) [2023-12-25 23:56:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 23994368. Throughput: 0: 8965.7, 1: 8326.4. Samples: 23989552. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:43,785][121949] Avg episode reward: [(0, '4126.537'), (1, '4646.122')] [2023-12-25 23:56:43,800][123090] Updated weights for policy 1, policy_version 46799 (0.0008) [2023-12-25 23:56:43,850][123090] Updated weights for policy 1, policy_version 46809 (0.0008) [2023-12-25 23:56:44,482][123091] Updated weights for policy 0, policy_version 46950 (0.0010) [2023-12-25 23:56:44,528][123091] Updated weights for policy 0, policy_version 46960 (0.0010) [2023-12-25 23:56:44,590][123091] Updated weights for policy 0, policy_version 46970 (0.0010) [2023-12-25 23:56:44,671][123090] Updated weights for policy 1, policy_version 46819 (0.0009) [2023-12-25 23:56:44,746][123090] Updated weights for policy 1, policy_version 46829 (0.0009) [2023-12-25 23:56:44,810][123090] Updated weights for policy 1, policy_version 46839 (0.0009) [2023-12-25 23:56:45,325][123091] Updated weights for policy 0, policy_version 46980 (0.0005) [2023-12-25 23:56:45,395][123091] Updated weights for policy 0, policy_version 46990 (0.0006) [2023-12-25 23:56:45,463][123091] Updated weights for policy 0, policy_version 47000 (0.0007) [2023-12-25 23:56:45,696][123090] Updated weights for policy 1, policy_version 46849 (0.0009) [2023-12-25 23:56:45,756][123090] Updated weights for policy 1, policy_version 46859 (0.0009) [2023-12-25 23:56:45,810][123090] Updated weights for policy 1, policy_version 46869 (0.0008) [2023-12-25 23:56:45,891][123090] Updated weights for policy 1, policy_version 46879 (0.0007) [2023-12-25 23:56:46,247][123091] Updated weights for policy 0, policy_version 47010 (0.0010) [2023-12-25 23:56:46,305][123091] Updated weights for policy 0, policy_version 47020 (0.0010) [2023-12-25 23:56:46,359][123091] Updated weights for policy 0, policy_version 47030 (0.0007) [2023-12-25 23:56:46,427][123091] Updated weights for policy 0, policy_version 47040 (0.0009) [2023-12-25 23:56:46,618][123090] Updated weights for policy 1, policy_version 46889 (0.0005) [2023-12-25 23:56:46,682][123090] Updated weights for policy 1, policy_version 46899 (0.0007) [2023-12-25 23:56:46,725][123090] Updated weights for policy 1, policy_version 46909 (0.0007) [2023-12-25 23:56:47,285][123091] Updated weights for policy 0, policy_version 47050 (0.0010) [2023-12-25 23:56:47,340][123091] Updated weights for policy 0, policy_version 47062 (0.0011) [2023-12-25 23:56:47,393][123091] Updated weights for policy 0, policy_version 47072 (0.0010) [2023-12-25 23:56:47,435][123090] Updated weights for policy 1, policy_version 46919 (0.0005) [2023-12-25 23:56:47,487][123090] Updated weights for policy 1, policy_version 46929 (0.0005) [2023-12-25 23:56:47,536][123090] Updated weights for policy 1, policy_version 46939 (0.0005) [2023-12-25 23:56:48,238][123090] Updated weights for policy 1, policy_version 46949 (0.0007) [2023-12-25 23:56:48,276][123091] Updated weights for policy 0, policy_version 47082 (0.0008) [2023-12-25 23:56:48,289][123090] Updated weights for policy 1, policy_version 46959 (0.0008) [2023-12-25 23:56:48,338][123091] Updated weights for policy 0, policy_version 47092 (0.0008) [2023-12-25 23:56:48,353][123090] Updated weights for policy 1, policy_version 46969 (0.0007) [2023-12-25 23:56:48,404][123091] Updated weights for policy 0, policy_version 47102 (0.0009) [2023-12-25 23:56:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 24084480. Throughput: 0: 8950.9, 1: 8407.7. Samples: 24094844. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:48,785][121949] Avg episode reward: [(0, '4002.577'), (1, '4662.145')] [2023-12-25 23:56:49,190][123090] Updated weights for policy 1, policy_version 46979 (0.0007) [2023-12-25 23:56:49,260][123091] Updated weights for policy 0, policy_version 47112 (0.0007) [2023-12-25 23:56:49,261][123090] Updated weights for policy 1, policy_version 46989 (0.0007) [2023-12-25 23:56:49,320][123091] Updated weights for policy 0, policy_version 47122 (0.0009) [2023-12-25 23:56:49,328][123090] Updated weights for policy 1, policy_version 46999 (0.0007) [2023-12-25 23:56:49,383][123091] Updated weights for policy 0, policy_version 47132 (0.0008) [2023-12-25 23:56:50,138][123090] Updated weights for policy 1, policy_version 47009 (0.0009) [2023-12-25 23:56:50,201][123090] Updated weights for policy 1, policy_version 47019 (0.0008) [2023-12-25 23:56:50,259][123091] Updated weights for policy 0, policy_version 47142 (0.0007) [2023-12-25 23:56:50,264][123090] Updated weights for policy 1, policy_version 47029 (0.0009) [2023-12-25 23:56:50,317][123091] Updated weights for policy 0, policy_version 47152 (0.0008) [2023-12-25 23:56:50,319][123090] Updated weights for policy 1, policy_version 47039 (0.0010) [2023-12-25 23:56:50,374][123091] Updated weights for policy 0, policy_version 47162 (0.0010) [2023-12-25 23:56:51,189][123090] Updated weights for policy 1, policy_version 47049 (0.0010) [2023-12-25 23:56:51,227][123091] Updated weights for policy 0, policy_version 47172 (0.0010) [2023-12-25 23:56:51,261][123090] Updated weights for policy 1, policy_version 47059 (0.0008) [2023-12-25 23:56:51,294][123091] Updated weights for policy 0, policy_version 47182 (0.0009) [2023-12-25 23:56:51,319][123090] Updated weights for policy 1, policy_version 47069 (0.0007) [2023-12-25 23:56:51,372][123091] Updated weights for policy 0, policy_version 47192 (0.0009) [2023-12-25 23:56:52,162][123090] Updated weights for policy 1, policy_version 47079 (0.0009) [2023-12-25 23:56:52,194][123091] Updated weights for policy 0, policy_version 47202 (0.0008) [2023-12-25 23:56:52,229][123090] Updated weights for policy 1, policy_version 47089 (0.0010) [2023-12-25 23:56:52,252][123091] Updated weights for policy 0, policy_version 47212 (0.0008) [2023-12-25 23:56:52,293][123090] Updated weights for policy 1, policy_version 47099 (0.0009) [2023-12-25 23:56:52,322][123091] Updated weights for policy 0, policy_version 47222 (0.0009) [2023-12-25 23:56:52,388][123091] Updated weights for policy 0, policy_version 47232 (0.0009) [2023-12-25 23:56:52,999][123090] Updated weights for policy 1, policy_version 47109 (0.0008) [2023-12-25 23:56:53,061][123090] Updated weights for policy 1, policy_version 47119 (0.0008) [2023-12-25 23:56:53,134][123090] Updated weights for policy 1, policy_version 47129 (0.0005) [2023-12-25 23:56:53,167][123091] Updated weights for policy 0, policy_version 47242 (0.0010) [2023-12-25 23:56:53,241][123091] Updated weights for policy 0, policy_version 47252 (0.0010) [2023-12-25 23:56:53,320][123091] Updated weights for policy 0, policy_version 47262 (0.0010) [2023-12-25 23:56:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 24166400. Throughput: 0: 8843.9, 1: 8446.6. Samples: 24144968. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:53,786][121949] Avg episode reward: [(0, '4030.542'), (1, '4723.835')] [2023-12-25 23:56:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000047264_12099584.pth... [2023-12-25 23:56:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000046208_11829248.pth [2023-12-25 23:56:53,819][123090] Updated weights for policy 1, policy_version 47139 (0.0005) [2023-12-25 23:56:53,871][123090] Updated weights for policy 1, policy_version 47149 (0.0005) [2023-12-25 23:56:53,918][123090] Updated weights for policy 1, policy_version 47159 (0.0005) [2023-12-25 23:56:53,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000047168_12075008.pth... [2023-12-25 23:56:53,969][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000046144_11812864.pth [2023-12-25 23:56:54,144][123091] Updated weights for policy 0, policy_version 47272 (0.0006) [2023-12-25 23:56:54,215][123091] Updated weights for policy 0, policy_version 47282 (0.0008) [2023-12-25 23:56:54,269][123091] Updated weights for policy 0, policy_version 47292 (0.0010) [2023-12-25 23:56:54,611][123090] Updated weights for policy 1, policy_version 47169 (0.0009) [2023-12-25 23:56:54,674][123090] Updated weights for policy 1, policy_version 47179 (0.0010) [2023-12-25 23:56:54,734][123090] Updated weights for policy 1, policy_version 47189 (0.0009) [2023-12-25 23:56:54,783][123090] Updated weights for policy 1, policy_version 47199 (0.0009) [2023-12-25 23:56:55,087][123091] Updated weights for policy 0, policy_version 47302 (0.0008) [2023-12-25 23:56:55,140][123091] Updated weights for policy 0, policy_version 47312 (0.0008) [2023-12-25 23:56:55,184][123091] Updated weights for policy 0, policy_version 47322 (0.0008) [2023-12-25 23:56:55,466][123090] Updated weights for policy 1, policy_version 47209 (0.0005) [2023-12-25 23:56:55,523][123090] Updated weights for policy 1, policy_version 47219 (0.0007) [2023-12-25 23:56:55,575][123090] Updated weights for policy 1, policy_version 47229 (0.0010) [2023-12-25 23:56:55,929][123091] Updated weights for policy 0, policy_version 47332 (0.0006) [2023-12-25 23:56:55,974][123091] Updated weights for policy 0, policy_version 47342 (0.0005) [2023-12-25 23:56:56,022][123091] Updated weights for policy 0, policy_version 47352 (0.0005) [2023-12-25 23:56:56,424][123090] Updated weights for policy 1, policy_version 47239 (0.0007) [2023-12-25 23:56:56,481][123090] Updated weights for policy 1, policy_version 47249 (0.0005) [2023-12-25 23:56:56,546][123090] Updated weights for policy 1, policy_version 47259 (0.0006) [2023-12-25 23:56:56,689][123091] Updated weights for policy 0, policy_version 47362 (0.0006) [2023-12-25 23:56:56,741][123091] Updated weights for policy 0, policy_version 47372 (0.0010) [2023-12-25 23:56:56,795][123091] Updated weights for policy 0, policy_version 47382 (0.0011) [2023-12-25 23:56:56,852][123091] Updated weights for policy 0, policy_version 47392 (0.0010) [2023-12-25 23:56:57,137][123090] Updated weights for policy 1, policy_version 47269 (0.0005) [2023-12-25 23:56:57,183][123090] Updated weights for policy 1, policy_version 47279 (0.0006) [2023-12-25 23:56:57,235][123090] Updated weights for policy 1, policy_version 47289 (0.0006) [2023-12-25 23:56:57,608][123091] Updated weights for policy 0, policy_version 47402 (0.0006) [2023-12-25 23:56:57,663][123091] Updated weights for policy 0, policy_version 47412 (0.0005) [2023-12-25 23:56:57,720][123091] Updated weights for policy 0, policy_version 47422 (0.0005) [2023-12-25 23:56:57,937][123090] Updated weights for policy 1, policy_version 47299 (0.0006) [2023-12-25 23:56:57,998][123090] Updated weights for policy 1, policy_version 47309 (0.0007) [2023-12-25 23:56:58,065][123090] Updated weights for policy 1, policy_version 47319 (0.0006) [2023-12-25 23:56:58,520][123091] Updated weights for policy 0, policy_version 47432 (0.0010) [2023-12-25 23:56:58,588][123091] Updated weights for policy 0, policy_version 47442 (0.0011) [2023-12-25 23:56:58,662][123091] Updated weights for policy 0, policy_version 47452 (0.0010) [2023-12-25 23:56:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 24264704. Throughput: 0: 8937.1, 1: 8601.2. Samples: 24257480. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-25 23:56:58,785][121949] Avg episode reward: [(0, '4104.485'), (1, '4833.888')] [2023-12-25 23:56:58,930][123090] Updated weights for policy 1, policy_version 47329 (0.0007) [2023-12-25 23:56:59,003][123090] Updated weights for policy 1, policy_version 47339 (0.0010) [2023-12-25 23:56:59,069][123090] Updated weights for policy 1, policy_version 47349 (0.0013) [2023-12-25 23:56:59,134][123090] Updated weights for policy 1, policy_version 47359 (0.0010) [2023-12-25 23:56:59,463][123091] Updated weights for policy 0, policy_version 47462 (0.0011) [2023-12-25 23:56:59,515][123091] Updated weights for policy 0, policy_version 47472 (0.0010) [2023-12-25 23:56:59,575][123091] Updated weights for policy 0, policy_version 47482 (0.0009) [2023-12-25 23:56:59,976][123090] Updated weights for policy 1, policy_version 47369 (0.0008) [2023-12-25 23:57:00,049][123090] Updated weights for policy 1, policy_version 47379 (0.0006) [2023-12-25 23:57:00,110][123090] Updated weights for policy 1, policy_version 47389 (0.0005) [2023-12-25 23:57:00,321][123091] Updated weights for policy 0, policy_version 47492 (0.0009) [2023-12-25 23:57:00,389][123091] Updated weights for policy 0, policy_version 47502 (0.0005) [2023-12-25 23:57:00,450][123091] Updated weights for policy 0, policy_version 47512 (0.0006) [2023-12-25 23:57:00,746][123090] Updated weights for policy 1, policy_version 47399 (0.0005) [2023-12-25 23:57:00,793][123090] Updated weights for policy 1, policy_version 47409 (0.0005) [2023-12-25 23:57:00,844][123090] Updated weights for policy 1, policy_version 47419 (0.0005) [2023-12-25 23:57:01,081][123091] Updated weights for policy 0, policy_version 47522 (0.0006) [2023-12-25 23:57:01,140][123091] Updated weights for policy 0, policy_version 47532 (0.0008) [2023-12-25 23:57:01,202][123091] Updated weights for policy 0, policy_version 47542 (0.0007) [2023-12-25 23:57:01,261][123091] Updated weights for policy 0, policy_version 47552 (0.0006) [2023-12-25 23:57:01,644][123090] Updated weights for policy 1, policy_version 47429 (0.0007) [2023-12-25 23:57:01,703][123090] Updated weights for policy 1, policy_version 47439 (0.0009) [2023-12-25 23:57:01,765][123090] Updated weights for policy 1, policy_version 47449 (0.0009) [2023-12-25 23:57:02,028][123091] Updated weights for policy 0, policy_version 47562 (0.0006) [2023-12-25 23:57:02,095][123091] Updated weights for policy 0, policy_version 47572 (0.0005) [2023-12-25 23:57:02,161][123091] Updated weights for policy 0, policy_version 47582 (0.0005) [2023-12-25 23:57:02,418][123090] Updated weights for policy 1, policy_version 47459 (0.0008) [2023-12-25 23:57:02,465][123090] Updated weights for policy 1, policy_version 47469 (0.0005) [2023-12-25 23:57:02,536][123090] Updated weights for policy 1, policy_version 47479 (0.0006) [2023-12-25 23:57:02,833][123091] Updated weights for policy 0, policy_version 47592 (0.0009) [2023-12-25 23:57:02,886][123091] Updated weights for policy 0, policy_version 47602 (0.0010) [2023-12-25 23:57:02,950][123091] Updated weights for policy 0, policy_version 47612 (0.0009) [2023-12-25 23:57:03,199][123090] Updated weights for policy 1, policy_version 47489 (0.0006) [2023-12-25 23:57:03,251][123090] Updated weights for policy 1, policy_version 47499 (0.0009) [2023-12-25 23:57:03,302][123090] Updated weights for policy 1, policy_version 47510 (0.0009) [2023-12-25 23:57:03,350][123090] Updated weights for policy 1, policy_version 47520 (0.0009) [2023-12-25 23:57:03,775][123091] Updated weights for policy 0, policy_version 47622 (0.0009) [2023-12-25 23:57:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 24354816. Throughput: 0: 8986.0, 1: 8685.0. Samples: 24368404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:03,785][121949] Avg episode reward: [(0, '4061.758'), (1, '4748.337')] [2023-12-25 23:57:03,823][123091] Updated weights for policy 0, policy_version 47632 (0.0005) [2023-12-25 23:57:03,891][123091] Updated weights for policy 0, policy_version 47642 (0.0008) [2023-12-25 23:57:04,155][123090] Updated weights for policy 1, policy_version 47530 (0.0007) [2023-12-25 23:57:04,215][123090] Updated weights for policy 1, policy_version 47540 (0.0009) [2023-12-25 23:57:04,288][123090] Updated weights for policy 1, policy_version 47550 (0.0008) [2023-12-25 23:57:04,722][123091] Updated weights for policy 0, policy_version 47652 (0.0007) [2023-12-25 23:57:04,786][123091] Updated weights for policy 0, policy_version 47662 (0.0009) [2023-12-25 23:57:04,838][123091] Updated weights for policy 0, policy_version 47672 (0.0009) [2023-12-25 23:57:05,096][123090] Updated weights for policy 1, policy_version 47560 (0.0007) [2023-12-25 23:57:05,165][123090] Updated weights for policy 1, policy_version 47570 (0.0007) [2023-12-25 23:57:05,233][123090] Updated weights for policy 1, policy_version 47580 (0.0011) [2023-12-25 23:57:05,582][123091] Updated weights for policy 0, policy_version 47682 (0.0008) [2023-12-25 23:57:05,640][123091] Updated weights for policy 0, policy_version 47692 (0.0005) [2023-12-25 23:57:05,690][123091] Updated weights for policy 0, policy_version 47702 (0.0005) [2023-12-25 23:57:05,735][123091] Updated weights for policy 0, policy_version 47712 (0.0005) [2023-12-25 23:57:05,949][123090] Updated weights for policy 1, policy_version 47590 (0.0010) [2023-12-25 23:57:06,016][123090] Updated weights for policy 1, policy_version 47600 (0.0006) [2023-12-25 23:57:06,093][123090] Updated weights for policy 1, policy_version 47610 (0.0005) [2023-12-25 23:57:06,526][123091] Updated weights for policy 0, policy_version 47722 (0.0011) [2023-12-25 23:57:06,589][123091] Updated weights for policy 0, policy_version 47732 (0.0011) [2023-12-25 23:57:06,653][123091] Updated weights for policy 0, policy_version 47742 (0.0011) [2023-12-25 23:57:06,854][123090] Updated weights for policy 1, policy_version 47620 (0.0010) [2023-12-25 23:57:06,902][123090] Updated weights for policy 1, policy_version 47630 (0.0010) [2023-12-25 23:57:06,959][123090] Updated weights for policy 1, policy_version 47640 (0.0010) [2023-12-25 23:57:07,405][123091] Updated weights for policy 0, policy_version 47752 (0.0007) [2023-12-25 23:57:07,458][123091] Updated weights for policy 0, policy_version 47762 (0.0006) [2023-12-25 23:57:07,514][123091] Updated weights for policy 0, policy_version 47772 (0.0006) [2023-12-25 23:57:07,809][123090] Updated weights for policy 1, policy_version 47650 (0.0011) [2023-12-25 23:57:07,872][123090] Updated weights for policy 1, policy_version 47660 (0.0008) [2023-12-25 23:57:07,936][123090] Updated weights for policy 1, policy_version 47670 (0.0009) [2023-12-25 23:57:07,994][123090] Updated weights for policy 1, policy_version 47680 (0.0009) [2023-12-25 23:57:08,311][123091] Updated weights for policy 0, policy_version 47782 (0.0008) [2023-12-25 23:57:08,371][123091] Updated weights for policy 0, policy_version 47792 (0.0010) [2023-12-25 23:57:08,427][123091] Updated weights for policy 0, policy_version 47802 (0.0009) [2023-12-25 23:57:08,778][123090] Updated weights for policy 1, policy_version 47690 (0.0005) [2023-12-25 23:57:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 24444928. Throughput: 0: 9046.1, 1: 8720.3. Samples: 24422912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:08,785][121949] Avg episode reward: [(0, '4026.340'), (1, '4819.133')] [2023-12-25 23:57:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000047808_12238848.pth... [2023-12-25 23:57:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000046784_11976704.pth [2023-12-25 23:57:08,850][123090] Updated weights for policy 1, policy_version 47700 (0.0010) [2023-12-25 23:57:08,906][123090] Updated weights for policy 1, policy_version 47710 (0.0010) [2023-12-25 23:57:08,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000047712_12214272.pth... [2023-12-25 23:57:08,921][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000046624_11935744.pth [2023-12-25 23:57:09,196][123091] Updated weights for policy 0, policy_version 47812 (0.0006) [2023-12-25 23:57:09,257][123091] Updated weights for policy 0, policy_version 47822 (0.0009) [2023-12-25 23:57:09,318][123091] Updated weights for policy 0, policy_version 47832 (0.0009) [2023-12-25 23:57:09,706][123090] Updated weights for policy 1, policy_version 47720 (0.0010) [2023-12-25 23:57:09,774][123090] Updated weights for policy 1, policy_version 47730 (0.0007) [2023-12-25 23:57:09,830][123090] Updated weights for policy 1, policy_version 47740 (0.0006) [2023-12-25 23:57:10,137][123091] Updated weights for policy 0, policy_version 47842 (0.0009) [2023-12-25 23:57:10,187][123091] Updated weights for policy 0, policy_version 47852 (0.0007) [2023-12-25 23:57:10,244][123091] Updated weights for policy 0, policy_version 47862 (0.0005) [2023-12-25 23:57:10,307][123091] Updated weights for policy 0, policy_version 47872 (0.0005) [2023-12-25 23:57:10,722][123090] Updated weights for policy 1, policy_version 47750 (0.0006) [2023-12-25 23:57:10,779][123090] Updated weights for policy 1, policy_version 47760 (0.0005) [2023-12-25 23:57:10,825][123090] Updated weights for policy 1, policy_version 47770 (0.0007) [2023-12-25 23:57:11,134][123091] Updated weights for policy 0, policy_version 47882 (0.0010) [2023-12-25 23:57:11,194][123091] Updated weights for policy 0, policy_version 47892 (0.0010) [2023-12-25 23:57:11,256][123091] Updated weights for policy 0, policy_version 47902 (0.0010) [2023-12-25 23:57:11,649][123090] Updated weights for policy 1, policy_version 47780 (0.0007) [2023-12-25 23:57:11,725][123090] Updated weights for policy 1, policy_version 47790 (0.0010) [2023-12-25 23:57:11,789][123090] Updated weights for policy 1, policy_version 47800 (0.0010) [2023-12-25 23:57:12,031][123091] Updated weights for policy 0, policy_version 47912 (0.0009) [2023-12-25 23:57:12,091][123091] Updated weights for policy 0, policy_version 47922 (0.0010) [2023-12-25 23:57:12,148][123091] Updated weights for policy 0, policy_version 47932 (0.0010) [2023-12-25 23:57:12,679][123090] Updated weights for policy 1, policy_version 47810 (0.0009) [2023-12-25 23:57:12,730][123090] Updated weights for policy 1, policy_version 47820 (0.0008) [2023-12-25 23:57:12,785][123090] Updated weights for policy 1, policy_version 47830 (0.0009) [2023-12-25 23:57:12,847][123090] Updated weights for policy 1, policy_version 47840 (0.0009) [2023-12-25 23:57:12,959][123091] Updated weights for policy 0, policy_version 47942 (0.0009) [2023-12-25 23:57:13,013][123091] Updated weights for policy 0, policy_version 47952 (0.0009) [2023-12-25 23:57:13,065][123091] Updated weights for policy 0, policy_version 47962 (0.0009) [2023-12-25 23:57:13,648][123090] Updated weights for policy 1, policy_version 47850 (0.0009) [2023-12-25 23:57:13,709][123090] Updated weights for policy 1, policy_version 47860 (0.0010) [2023-12-25 23:57:13,758][123090] Updated weights for policy 1, policy_version 47870 (0.0008) [2023-12-25 23:57:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 24535040. Throughput: 0: 8970.0, 1: 8790.3. Samples: 24527372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:13,785][121949] Avg episode reward: [(0, '4059.013'), (1, '4885.904')] [2023-12-25 23:57:13,899][123091] Updated weights for policy 0, policy_version 47973 (0.0010) [2023-12-25 23:57:13,956][123091] Updated weights for policy 0, policy_version 47983 (0.0010) [2023-12-25 23:57:14,009][123091] Updated weights for policy 0, policy_version 47993 (0.0010) [2023-12-25 23:57:14,497][123090] Updated weights for policy 1, policy_version 47880 (0.0005) [2023-12-25 23:57:14,573][123090] Updated weights for policy 1, policy_version 47890 (0.0006) [2023-12-25 23:57:14,639][123090] Updated weights for policy 1, policy_version 47900 (0.0007) [2023-12-25 23:57:14,787][123091] Updated weights for policy 0, policy_version 48003 (0.0010) [2023-12-25 23:57:14,842][123091] Updated weights for policy 0, policy_version 48013 (0.0008) [2023-12-25 23:57:14,907][123091] Updated weights for policy 0, policy_version 48023 (0.0008) [2023-12-25 23:57:15,386][123090] Updated weights for policy 1, policy_version 47910 (0.0010) [2023-12-25 23:57:15,439][123090] Updated weights for policy 1, policy_version 47920 (0.0010) [2023-12-25 23:57:15,488][123090] Updated weights for policy 1, policy_version 47930 (0.0010) [2023-12-25 23:57:15,713][123091] Updated weights for policy 0, policy_version 48033 (0.0008) [2023-12-25 23:57:15,763][123091] Updated weights for policy 0, policy_version 48043 (0.0007) [2023-12-25 23:57:15,823][123091] Updated weights for policy 0, policy_version 48053 (0.0008) [2023-12-25 23:57:15,874][123091] Updated weights for policy 0, policy_version 48063 (0.0010) [2023-12-25 23:57:16,254][123090] Updated weights for policy 1, policy_version 47940 (0.0008) [2023-12-25 23:57:16,307][123090] Updated weights for policy 1, policy_version 47950 (0.0005) [2023-12-25 23:57:16,354][123090] Updated weights for policy 1, policy_version 47960 (0.0005) [2023-12-25 23:57:16,767][123091] Updated weights for policy 0, policy_version 48073 (0.0010) [2023-12-25 23:57:16,820][123091] Updated weights for policy 0, policy_version 48083 (0.0010) [2023-12-25 23:57:16,874][123091] Updated weights for policy 0, policy_version 48093 (0.0010) [2023-12-25 23:57:16,974][123090] Updated weights for policy 1, policy_version 47970 (0.0005) [2023-12-25 23:57:17,023][123090] Updated weights for policy 1, policy_version 47980 (0.0005) [2023-12-25 23:57:17,087][123090] Updated weights for policy 1, policy_version 47990 (0.0005) [2023-12-25 23:57:17,158][123090] Updated weights for policy 1, policy_version 48000 (0.0005) [2023-12-25 23:57:17,795][123091] Updated weights for policy 0, policy_version 48103 (0.0009) [2023-12-25 23:57:17,819][123090] Updated weights for policy 1, policy_version 48010 (0.0006) [2023-12-25 23:57:17,855][123091] Updated weights for policy 0, policy_version 48113 (0.0008) [2023-12-25 23:57:17,866][123090] Updated weights for policy 1, policy_version 48020 (0.0007) [2023-12-25 23:57:17,904][123091] Updated weights for policy 0, policy_version 48123 (0.0008) [2023-12-25 23:57:17,917][123090] Updated weights for policy 1, policy_version 48030 (0.0008) [2023-12-25 23:57:18,721][123090] Updated weights for policy 1, policy_version 48040 (0.0009) [2023-12-25 23:57:18,781][123091] Updated weights for policy 0, policy_version 48133 (0.0008) [2023-12-25 23:57:18,781][123090] Updated weights for policy 1, policy_version 48050 (0.0010) [2023-12-25 23:57:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 24616960. Throughput: 0: 8840.9, 1: 8954.3. Samples: 24635788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:18,785][121949] Avg episode reward: [(0, '4072.787'), (1, '4825.740')] [2023-12-25 23:57:18,832][123091] Updated weights for policy 0, policy_version 48143 (0.0009) [2023-12-25 23:57:18,847][123090] Updated weights for policy 1, policy_version 48060 (0.0008) [2023-12-25 23:57:18,894][123091] Updated weights for policy 0, policy_version 48153 (0.0008) [2023-12-25 23:57:19,685][123090] Updated weights for policy 1, policy_version 48070 (0.0010) [2023-12-25 23:57:19,749][123090] Updated weights for policy 1, policy_version 48080 (0.0010) [2023-12-25 23:57:19,760][123091] Updated weights for policy 0, policy_version 48163 (0.0008) [2023-12-25 23:57:19,815][123090] Updated weights for policy 1, policy_version 48090 (0.0008) [2023-12-25 23:57:19,835][123091] Updated weights for policy 0, policy_version 48173 (0.0007) [2023-12-25 23:57:19,900][123091] Updated weights for policy 0, policy_version 48183 (0.0008) [2023-12-25 23:57:20,699][123090] Updated weights for policy 1, policy_version 48100 (0.0009) [2023-12-25 23:57:20,720][123091] Updated weights for policy 0, policy_version 48193 (0.0008) [2023-12-25 23:57:20,765][123090] Updated weights for policy 1, policy_version 48110 (0.0008) [2023-12-25 23:57:20,788][123091] Updated weights for policy 0, policy_version 48203 (0.0010) [2023-12-25 23:57:20,827][123090] Updated weights for policy 1, policy_version 48120 (0.0009) [2023-12-25 23:57:20,844][123091] Updated weights for policy 0, policy_version 48213 (0.0008) [2023-12-25 23:57:20,912][123091] Updated weights for policy 0, policy_version 48223 (0.0009) [2023-12-25 23:57:21,733][123090] Updated weights for policy 1, policy_version 48130 (0.0008) [2023-12-25 23:57:21,774][123091] Updated weights for policy 0, policy_version 48233 (0.0009) [2023-12-25 23:57:21,795][123090] Updated weights for policy 1, policy_version 48140 (0.0008) [2023-12-25 23:57:21,842][123091] Updated weights for policy 0, policy_version 48243 (0.0009) [2023-12-25 23:57:21,856][123090] Updated weights for policy 1, policy_version 48150 (0.0008) [2023-12-25 23:57:21,905][123091] Updated weights for policy 0, policy_version 48253 (0.0009) [2023-12-25 23:57:21,919][123090] Updated weights for policy 1, policy_version 48160 (0.0008) [2023-12-25 23:57:22,707][123090] Updated weights for policy 1, policy_version 48170 (0.0006) [2023-12-25 23:57:22,721][123091] Updated weights for policy 0, policy_version 48263 (0.0008) [2023-12-25 23:57:22,775][123090] Updated weights for policy 1, policy_version 48180 (0.0006) [2023-12-25 23:57:22,791][123091] Updated weights for policy 0, policy_version 48273 (0.0007) [2023-12-25 23:57:22,846][123090] Updated weights for policy 1, policy_version 48190 (0.0006) [2023-12-25 23:57:22,851][123091] Updated weights for policy 0, policy_version 48283 (0.0007) [2023-12-25 23:57:23,554][123090] Updated weights for policy 1, policy_version 48200 (0.0010) [2023-12-25 23:57:23,568][123091] Updated weights for policy 0, policy_version 48293 (0.0008) [2023-12-25 23:57:23,618][123090] Updated weights for policy 1, policy_version 48210 (0.0008) [2023-12-25 23:57:23,628][123091] Updated weights for policy 0, policy_version 48303 (0.0011) [2023-12-25 23:57:23,681][123090] Updated weights for policy 1, policy_version 48220 (0.0008) [2023-12-25 23:57:23,685][123091] Updated weights for policy 0, policy_version 48313 (0.0006) [2023-12-25 23:57:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 24715264. Throughput: 0: 8817.6, 1: 8919.4. Samples: 24685316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:23,785][121949] Avg episode reward: [(0, '4066.269'), (1, '4707.832')] [2023-12-25 23:57:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000048224_12345344.pth... [2023-12-25 23:57:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000048320_12369920.pth... [2023-12-25 23:57:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000047168_12075008.pth [2023-12-25 23:57:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000047264_12099584.pth [2023-12-25 23:57:24,378][123091] Updated weights for policy 0, policy_version 48323 (0.0007) [2023-12-25 23:57:24,381][123090] Updated weights for policy 1, policy_version 48230 (0.0008) [2023-12-25 23:57:24,429][123090] Updated weights for policy 1, policy_version 48240 (0.0005) [2023-12-25 23:57:24,442][123091] Updated weights for policy 0, policy_version 48333 (0.0007) [2023-12-25 23:57:24,479][123090] Updated weights for policy 1, policy_version 48250 (0.0005) [2023-12-25 23:57:24,505][123091] Updated weights for policy 0, policy_version 48343 (0.0010) [2023-12-25 23:57:25,183][123091] Updated weights for policy 0, policy_version 48353 (0.0010) [2023-12-25 23:57:25,243][123090] Updated weights for policy 1, policy_version 48260 (0.0007) [2023-12-25 23:57:25,244][123091] Updated weights for policy 0, policy_version 48363 (0.0006) [2023-12-25 23:57:25,296][123091] Updated weights for policy 0, policy_version 48373 (0.0007) [2023-12-25 23:57:25,310][123090] Updated weights for policy 1, policy_version 48270 (0.0007) [2023-12-25 23:57:25,354][123091] Updated weights for policy 0, policy_version 48383 (0.0011) [2023-12-25 23:57:25,374][123090] Updated weights for policy 1, policy_version 48280 (0.0009) [2023-12-25 23:57:26,153][123091] Updated weights for policy 0, policy_version 48393 (0.0006) [2023-12-25 23:57:26,202][123090] Updated weights for policy 1, policy_version 48290 (0.0009) [2023-12-25 23:57:26,204][123091] Updated weights for policy 0, policy_version 48403 (0.0007) [2023-12-25 23:57:26,265][123091] Updated weights for policy 0, policy_version 48413 (0.0007) [2023-12-25 23:57:26,269][123090] Updated weights for policy 1, policy_version 48300 (0.0009) [2023-12-25 23:57:26,337][123090] Updated weights for policy 1, policy_version 48310 (0.0010) [2023-12-25 23:57:26,403][123090] Updated weights for policy 1, policy_version 48320 (0.0010) [2023-12-25 23:57:27,068][123090] Updated weights for policy 1, policy_version 48330 (0.0009) [2023-12-25 23:57:27,125][123090] Updated weights for policy 1, policy_version 48340 (0.0008) [2023-12-25 23:57:27,127][123091] Updated weights for policy 0, policy_version 48423 (0.0009) [2023-12-25 23:57:27,175][123091] Updated weights for policy 0, policy_version 48433 (0.0007) [2023-12-25 23:57:27,185][123090] Updated weights for policy 1, policy_version 48350 (0.0009) [2023-12-25 23:57:27,238][123091] Updated weights for policy 0, policy_version 48443 (0.0008) [2023-12-25 23:57:27,861][123090] Updated weights for policy 1, policy_version 48360 (0.0006) [2023-12-25 23:57:27,909][123090] Updated weights for policy 1, policy_version 48370 (0.0005) [2023-12-25 23:57:27,968][123090] Updated weights for policy 1, policy_version 48380 (0.0005) [2023-12-25 23:57:28,099][123091] Updated weights for policy 0, policy_version 48453 (0.0009) [2023-12-25 23:57:28,158][123091] Updated weights for policy 0, policy_version 48463 (0.0010) [2023-12-25 23:57:28,212][123091] Updated weights for policy 0, policy_version 48473 (0.0010) [2023-12-25 23:57:28,707][123090] Updated weights for policy 1, policy_version 48390 (0.0008) [2023-12-25 23:57:28,772][123090] Updated weights for policy 1, policy_version 48400 (0.0010) [2023-12-25 23:57:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 24797184. Throughput: 0: 8834.3, 1: 9066.0. Samples: 24795064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-25 23:57:28,785][121949] Avg episode reward: [(0, '3947.461'), (1, '4764.959')] [2023-12-25 23:57:28,842][123090] Updated weights for policy 1, policy_version 48410 (0.0010) [2023-12-25 23:57:29,050][123091] Updated weights for policy 0, policy_version 48483 (0.0008) [2023-12-25 23:57:29,095][123091] Updated weights for policy 0, policy_version 48493 (0.0005) [2023-12-25 23:57:29,144][123091] Updated weights for policy 0, policy_version 48503 (0.0006) [2023-12-25 23:57:29,681][123090] Updated weights for policy 1, policy_version 48420 (0.0010) [2023-12-25 23:57:29,753][123090] Updated weights for policy 1, policy_version 48430 (0.0008) [2023-12-25 23:57:29,818][123090] Updated weights for policy 1, policy_version 48440 (0.0010) [2023-12-25 23:57:29,934][123091] Updated weights for policy 0, policy_version 48513 (0.0006) [2023-12-25 23:57:29,986][123091] Updated weights for policy 0, policy_version 48523 (0.0006) [2023-12-25 23:57:30,049][123091] Updated weights for policy 0, policy_version 48533 (0.0006) [2023-12-25 23:57:30,111][123091] Updated weights for policy 0, policy_version 48543 (0.0008) [2023-12-25 23:57:30,659][123090] Updated weights for policy 1, policy_version 48450 (0.0010) [2023-12-25 23:57:30,729][123090] Updated weights for policy 1, policy_version 48460 (0.0008) [2023-12-25 23:57:30,781][123090] Updated weights for policy 1, policy_version 48470 (0.0009) [2023-12-25 23:57:30,829][123090] Updated weights for policy 1, policy_version 48480 (0.0008) [2023-12-25 23:57:30,915][123091] Updated weights for policy 0, policy_version 48553 (0.0008) [2023-12-25 23:57:30,974][123091] Updated weights for policy 0, policy_version 48565 (0.0009) [2023-12-25 23:57:31,036][123091] Updated weights for policy 0, policy_version 48575 (0.0009) [2023-12-25 23:57:31,607][123090] Updated weights for policy 1, policy_version 48490 (0.0006) [2023-12-25 23:57:31,672][123090] Updated weights for policy 1, policy_version 48500 (0.0010) [2023-12-25 23:57:31,740][123090] Updated weights for policy 1, policy_version 48510 (0.0009) [2023-12-25 23:57:31,868][123091] Updated weights for policy 0, policy_version 48585 (0.0009) [2023-12-25 23:57:31,917][123091] Updated weights for policy 0, policy_version 48595 (0.0007) [2023-12-25 23:57:31,975][123091] Updated weights for policy 0, policy_version 48605 (0.0005) [2023-12-25 23:57:32,543][123090] Updated weights for policy 1, policy_version 48520 (0.0009) [2023-12-25 23:57:32,597][123090] Updated weights for policy 1, policy_version 48530 (0.0009) [2023-12-25 23:57:32,646][123090] Updated weights for policy 1, policy_version 48540 (0.0009) [2023-12-25 23:57:32,725][123091] Updated weights for policy 0, policy_version 48615 (0.0009) [2023-12-25 23:57:32,799][123091] Updated weights for policy 0, policy_version 48625 (0.0011) [2023-12-25 23:57:32,861][123091] Updated weights for policy 0, policy_version 48635 (0.0010) [2023-12-25 23:57:33,507][123090] Updated weights for policy 1, policy_version 48550 (0.0008) [2023-12-25 23:57:33,555][123090] Updated weights for policy 1, policy_version 48560 (0.0008) [2023-12-25 23:57:33,602][123090] Updated weights for policy 1, policy_version 48570 (0.0007) [2023-12-25 23:57:33,609][123091] Updated weights for policy 0, policy_version 48645 (0.0008) [2023-12-25 23:57:33,659][123091] Updated weights for policy 0, policy_version 48655 (0.0010) [2023-12-25 23:57:33,720][123091] Updated weights for policy 0, policy_version 48665 (0.0010) [2023-12-25 23:57:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 24895488. Throughput: 0: 8866.9, 1: 9041.7. Samples: 24900732. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:33,785][121949] Avg episode reward: [(0, '3901.119'), (1, '4727.438')] [2023-12-25 23:57:34,396][123090] Updated weights for policy 1, policy_version 48580 (0.0006) [2023-12-25 23:57:34,466][123090] Updated weights for policy 1, policy_version 48590 (0.0010) [2023-12-25 23:57:34,473][123091] Updated weights for policy 0, policy_version 48675 (0.0010) [2023-12-25 23:57:34,526][123090] Updated weights for policy 1, policy_version 48600 (0.0008) [2023-12-25 23:57:34,528][123091] Updated weights for policy 0, policy_version 48685 (0.0008) [2023-12-25 23:57:34,589][123091] Updated weights for policy 0, policy_version 48695 (0.0009) [2023-12-25 23:57:35,276][123090] Updated weights for policy 1, policy_version 48610 (0.0007) [2023-12-25 23:57:35,328][123090] Updated weights for policy 1, policy_version 48620 (0.0009) [2023-12-25 23:57:35,384][123090] Updated weights for policy 1, policy_version 48630 (0.0010) [2023-12-25 23:57:35,433][123090] Updated weights for policy 1, policy_version 48640 (0.0010) [2023-12-25 23:57:35,470][123091] Updated weights for policy 0, policy_version 48705 (0.0009) [2023-12-25 23:57:35,534][123091] Updated weights for policy 0, policy_version 48715 (0.0009) [2023-12-25 23:57:35,606][123091] Updated weights for policy 0, policy_version 48725 (0.0010) [2023-12-25 23:57:35,668][123091] Updated weights for policy 0, policy_version 48735 (0.0009) [2023-12-25 23:57:36,231][123090] Updated weights for policy 1, policy_version 48650 (0.0009) [2023-12-25 23:57:36,294][123090] Updated weights for policy 1, policy_version 48660 (0.0005) [2023-12-25 23:57:36,356][123090] Updated weights for policy 1, policy_version 48670 (0.0005) [2023-12-25 23:57:36,545][123091] Updated weights for policy 0, policy_version 48745 (0.0009) [2023-12-25 23:57:36,598][123091] Updated weights for policy 0, policy_version 48755 (0.0009) [2023-12-25 23:57:36,648][123091] Updated weights for policy 0, policy_version 48765 (0.0008) [2023-12-25 23:57:37,122][123090] Updated weights for policy 1, policy_version 48680 (0.0009) [2023-12-25 23:57:37,170][123090] Updated weights for policy 1, policy_version 48690 (0.0010) [2023-12-25 23:57:37,221][123090] Updated weights for policy 1, policy_version 48700 (0.0010) [2023-12-25 23:57:37,370][123091] Updated weights for policy 0, policy_version 48775 (0.0007) [2023-12-25 23:57:37,419][123091] Updated weights for policy 0, policy_version 48785 (0.0009) [2023-12-25 23:57:37,475][123091] Updated weights for policy 0, policy_version 48795 (0.0008) [2023-12-25 23:57:38,077][123090] Updated weights for policy 1, policy_version 48710 (0.0010) [2023-12-25 23:57:38,129][123090] Updated weights for policy 1, policy_version 48720 (0.0011) [2023-12-25 23:57:38,184][123090] Updated weights for policy 1, policy_version 48730 (0.0010) [2023-12-25 23:57:38,298][123091] Updated weights for policy 0, policy_version 48805 (0.0007) [2023-12-25 23:57:38,364][123091] Updated weights for policy 0, policy_version 48815 (0.0009) [2023-12-25 23:57:38,431][123091] Updated weights for policy 0, policy_version 48825 (0.0011) [2023-12-25 23:57:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 24977408. Throughput: 0: 8876.8, 1: 9093.6. Samples: 24953628. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:38,785][121949] Avg episode reward: [(0, '3798.042'), (1, '4721.324')] [2023-12-25 23:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000048832_12500992.pth... [2023-12-25 23:57:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000048736_12476416.pth... [2023-12-25 23:57:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000047808_12238848.pth [2023-12-25 23:57:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000047712_12214272.pth [2023-12-25 23:57:39,035][123090] Updated weights for policy 1, policy_version 48740 (0.0011) [2023-12-25 23:57:39,097][123090] Updated weights for policy 1, policy_version 48750 (0.0010) [2023-12-25 23:57:39,159][123090] Updated weights for policy 1, policy_version 48760 (0.0010) [2023-12-25 23:57:39,256][123091] Updated weights for policy 0, policy_version 48835 (0.0011) [2023-12-25 23:57:39,306][123091] Updated weights for policy 0, policy_version 48845 (0.0010) [2023-12-25 23:57:39,375][123091] Updated weights for policy 0, policy_version 48855 (0.0011) [2023-12-25 23:57:39,946][123090] Updated weights for policy 1, policy_version 48770 (0.0010) [2023-12-25 23:57:40,014][123090] Updated weights for policy 1, policy_version 48780 (0.0007) [2023-12-25 23:57:40,081][123090] Updated weights for policy 1, policy_version 48790 (0.0008) [2023-12-25 23:57:40,145][123090] Updated weights for policy 1, policy_version 48800 (0.0010) [2023-12-25 23:57:40,233][123091] Updated weights for policy 0, policy_version 48865 (0.0010) [2023-12-25 23:57:40,283][123091] Updated weights for policy 0, policy_version 48875 (0.0005) [2023-12-25 23:57:40,336][123091] Updated weights for policy 0, policy_version 48885 (0.0007) [2023-12-25 23:57:40,399][123091] Updated weights for policy 0, policy_version 48895 (0.0011) [2023-12-25 23:57:41,006][123090] Updated weights for policy 1, policy_version 48810 (0.0010) [2023-12-25 23:57:41,072][123090] Updated weights for policy 1, policy_version 48820 (0.0009) [2023-12-25 23:57:41,141][123090] Updated weights for policy 1, policy_version 48830 (0.0010) [2023-12-25 23:57:41,172][123091] Updated weights for policy 0, policy_version 48905 (0.0010) [2023-12-25 23:57:41,227][123091] Updated weights for policy 0, policy_version 48915 (0.0008) [2023-12-25 23:57:41,284][123091] Updated weights for policy 0, policy_version 48925 (0.0008) [2023-12-25 23:57:42,050][123090] Updated weights for policy 1, policy_version 48840 (0.0009) [2023-12-25 23:57:42,106][123091] Updated weights for policy 0, policy_version 48935 (0.0008) [2023-12-25 23:57:42,106][123090] Updated weights for policy 1, policy_version 48850 (0.0009) [2023-12-25 23:57:42,160][123091] Updated weights for policy 0, policy_version 48945 (0.0009) [2023-12-25 23:57:42,167][123090] Updated weights for policy 1, policy_version 48860 (0.0007) [2023-12-25 23:57:42,215][123091] Updated weights for policy 0, policy_version 48955 (0.0007) [2023-12-25 23:57:43,025][123090] Updated weights for policy 1, policy_version 48870 (0.0009) [2023-12-25 23:57:43,039][123091] Updated weights for policy 0, policy_version 48965 (0.0009) [2023-12-25 23:57:43,088][123090] Updated weights for policy 1, policy_version 48880 (0.0007) [2023-12-25 23:57:43,091][123091] Updated weights for policy 0, policy_version 48975 (0.0009) [2023-12-25 23:57:43,140][123091] Updated weights for policy 0, policy_version 48985 (0.0007) [2023-12-25 23:57:43,150][123090] Updated weights for policy 1, policy_version 48890 (0.0009) [2023-12-25 23:57:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 25059328. Throughput: 0: 8844.5, 1: 8922.9. Samples: 25057016. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:43,785][121949] Avg episode reward: [(0, '3723.290'), (1, '4714.154')] [2023-12-25 23:57:43,932][123090] Updated weights for policy 1, policy_version 48900 (0.0008) [2023-12-25 23:57:43,979][123091] Updated weights for policy 0, policy_version 48995 (0.0007) [2023-12-25 23:57:43,996][123090] Updated weights for policy 1, policy_version 48910 (0.0005) [2023-12-25 23:57:44,035][123091] Updated weights for policy 0, policy_version 49005 (0.0008) [2023-12-25 23:57:44,057][123090] Updated weights for policy 1, policy_version 48920 (0.0007) [2023-12-25 23:57:44,086][123091] Updated weights for policy 0, policy_version 49015 (0.0007) [2023-12-25 23:57:44,849][123090] Updated weights for policy 1, policy_version 48930 (0.0010) [2023-12-25 23:57:44,901][123091] Updated weights for policy 0, policy_version 49025 (0.0008) [2023-12-25 23:57:44,922][123090] Updated weights for policy 1, policy_version 48940 (0.0009) [2023-12-25 23:57:44,966][123091] Updated weights for policy 0, policy_version 49035 (0.0009) [2023-12-25 23:57:44,983][123090] Updated weights for policy 1, policy_version 48950 (0.0008) [2023-12-25 23:57:45,031][123091] Updated weights for policy 0, policy_version 49045 (0.0009) [2023-12-25 23:57:45,044][123090] Updated weights for policy 1, policy_version 48960 (0.0009) [2023-12-25 23:57:45,096][123091] Updated weights for policy 0, policy_version 49055 (0.0011) [2023-12-25 23:57:45,829][123090] Updated weights for policy 1, policy_version 48970 (0.0008) [2023-12-25 23:57:45,902][123090] Updated weights for policy 1, policy_version 48980 (0.0009) [2023-12-25 23:57:45,932][123091] Updated weights for policy 0, policy_version 49065 (0.0007) [2023-12-25 23:57:45,961][123090] Updated weights for policy 1, policy_version 48990 (0.0009) [2023-12-25 23:57:45,984][123091] Updated weights for policy 0, policy_version 49075 (0.0009) [2023-12-25 23:57:46,038][123091] Updated weights for policy 0, policy_version 49085 (0.0010) [2023-12-25 23:57:46,789][123090] Updated weights for policy 1, policy_version 49000 (0.0008) [2023-12-25 23:57:46,842][123090] Updated weights for policy 1, policy_version 49010 (0.0009) [2023-12-25 23:57:46,865][123091] Updated weights for policy 0, policy_version 49095 (0.0009) [2023-12-25 23:57:46,902][123090] Updated weights for policy 1, policy_version 49020 (0.0007) [2023-12-25 23:57:46,923][123091] Updated weights for policy 0, policy_version 49105 (0.0007) [2023-12-25 23:57:46,981][123091] Updated weights for policy 0, policy_version 49115 (0.0009) [2023-12-25 23:57:47,762][123091] Updated weights for policy 0, policy_version 49125 (0.0008) [2023-12-25 23:57:47,770][123090] Updated weights for policy 1, policy_version 49030 (0.0008) [2023-12-25 23:57:47,816][123090] Updated weights for policy 1, policy_version 49040 (0.0008) [2023-12-25 23:57:47,823][123091] Updated weights for policy 0, policy_version 49135 (0.0010) [2023-12-25 23:57:47,869][123090] Updated weights for policy 1, policy_version 49050 (0.0008) [2023-12-25 23:57:47,883][123091] Updated weights for policy 0, policy_version 49145 (0.0005) [2023-12-25 23:57:48,564][123091] Updated weights for policy 0, policy_version 49155 (0.0005) [2023-12-25 23:57:48,626][123091] Updated weights for policy 0, policy_version 49165 (0.0005) [2023-12-25 23:57:48,688][123091] Updated weights for policy 0, policy_version 49175 (0.0005) [2023-12-25 23:57:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 25149440. Throughput: 0: 8785.6, 1: 8831.0. Samples: 25161152. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:48,785][121949] Avg episode reward: [(0, '3702.629'), (1, '4765.284')] [2023-12-25 23:57:48,806][123090] Updated weights for policy 1, policy_version 49060 (0.0008) [2023-12-25 23:57:48,866][123090] Updated weights for policy 1, policy_version 49070 (0.0009) [2023-12-25 23:57:48,923][123090] Updated weights for policy 1, policy_version 49080 (0.0009) [2023-12-25 23:57:49,406][123091] Updated weights for policy 0, policy_version 49185 (0.0005) [2023-12-25 23:57:49,461][123091] Updated weights for policy 0, policy_version 49195 (0.0005) [2023-12-25 23:57:49,541][123091] Updated weights for policy 0, policy_version 49205 (0.0007) [2023-12-25 23:57:49,604][123091] Updated weights for policy 0, policy_version 49215 (0.0010) [2023-12-25 23:57:49,727][123090] Updated weights for policy 1, policy_version 49090 (0.0007) [2023-12-25 23:57:49,792][123090] Updated weights for policy 1, policy_version 49100 (0.0005) [2023-12-25 23:57:49,862][123090] Updated weights for policy 1, policy_version 49110 (0.0007) [2023-12-25 23:57:49,931][123090] Updated weights for policy 1, policy_version 49120 (0.0008) [2023-12-25 23:57:50,395][123091] Updated weights for policy 0, policy_version 49225 (0.0007) [2023-12-25 23:57:50,457][123091] Updated weights for policy 0, policy_version 49235 (0.0008) [2023-12-25 23:57:50,521][123091] Updated weights for policy 0, policy_version 49245 (0.0007) [2023-12-25 23:57:50,699][123090] Updated weights for policy 1, policy_version 49130 (0.0010) [2023-12-25 23:57:50,765][123090] Updated weights for policy 1, policy_version 49140 (0.0009) [2023-12-25 23:57:50,832][123090] Updated weights for policy 1, policy_version 49150 (0.0010) [2023-12-25 23:57:51,295][123091] Updated weights for policy 0, policy_version 49255 (0.0009) [2023-12-25 23:57:51,353][123091] Updated weights for policy 0, policy_version 49265 (0.0009) [2023-12-25 23:57:51,425][123091] Updated weights for policy 0, policy_version 49275 (0.0010) [2023-12-25 23:57:51,619][123090] Updated weights for policy 1, policy_version 49160 (0.0008) [2023-12-25 23:57:51,679][123090] Updated weights for policy 1, policy_version 49170 (0.0008) [2023-12-25 23:57:51,740][123090] Updated weights for policy 1, policy_version 49180 (0.0008) [2023-12-25 23:57:52,256][123091] Updated weights for policy 0, policy_version 49285 (0.0007) [2023-12-25 23:57:52,319][123091] Updated weights for policy 0, policy_version 49295 (0.0008) [2023-12-25 23:57:52,384][123091] Updated weights for policy 0, policy_version 49305 (0.0008) [2023-12-25 23:57:52,516][123090] Updated weights for policy 1, policy_version 49190 (0.0006) [2023-12-25 23:57:52,570][123090] Updated weights for policy 1, policy_version 49200 (0.0009) [2023-12-25 23:57:52,627][123090] Updated weights for policy 1, policy_version 49210 (0.0009) [2023-12-25 23:57:53,183][123091] Updated weights for policy 0, policy_version 49315 (0.0009) [2023-12-25 23:57:53,252][123091] Updated weights for policy 0, policy_version 49325 (0.0010) [2023-12-25 23:57:53,305][123091] Updated weights for policy 0, policy_version 49335 (0.0010) [2023-12-25 23:57:53,393][123090] Updated weights for policy 1, policy_version 49220 (0.0007) [2023-12-25 23:57:53,445][123090] Updated weights for policy 1, policy_version 49230 (0.0005) [2023-12-25 23:57:53,502][123090] Updated weights for policy 1, policy_version 49240 (0.0006) [2023-12-25 23:57:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 25239552. Throughput: 0: 8769.1, 1: 8808.0. Samples: 25213880. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:53,785][121949] Avg episode reward: [(0, '3773.817'), (1, '4857.312')] [2023-12-25 23:57:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000049344_12632064.pth... [2023-12-25 23:57:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000049248_12607488.pth... [2023-12-25 23:57:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000048320_12369920.pth [2023-12-25 23:57:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000048224_12345344.pth [2023-12-25 23:57:53,989][123091] Updated weights for policy 0, policy_version 49345 (0.0009) [2023-12-25 23:57:54,035][123091] Updated weights for policy 0, policy_version 49355 (0.0005) [2023-12-25 23:57:54,087][123091] Updated weights for policy 0, policy_version 49365 (0.0005) [2023-12-25 23:57:54,140][123091] Updated weights for policy 0, policy_version 49375 (0.0005) [2023-12-25 23:57:54,327][123090] Updated weights for policy 1, policy_version 49250 (0.0008) [2023-12-25 23:57:54,402][123090] Updated weights for policy 1, policy_version 49260 (0.0006) [2023-12-25 23:57:54,475][123090] Updated weights for policy 1, policy_version 49270 (0.0006) [2023-12-25 23:57:54,553][123090] Updated weights for policy 1, policy_version 49280 (0.0005) [2023-12-25 23:57:54,802][123091] Updated weights for policy 0, policy_version 49385 (0.0009) [2023-12-25 23:57:54,857][123091] Updated weights for policy 0, policy_version 49395 (0.0010) [2023-12-25 23:57:54,919][123091] Updated weights for policy 0, policy_version 49405 (0.0011) [2023-12-25 23:57:55,162][123090] Updated weights for policy 1, policy_version 49290 (0.0006) [2023-12-25 23:57:55,217][123090] Updated weights for policy 1, policy_version 49300 (0.0006) [2023-12-25 23:57:55,275][123090] Updated weights for policy 1, policy_version 49310 (0.0006) [2023-12-25 23:57:55,790][123091] Updated weights for policy 0, policy_version 49415 (0.0010) [2023-12-25 23:57:55,851][123091] Updated weights for policy 0, policy_version 49425 (0.0009) [2023-12-25 23:57:55,912][123091] Updated weights for policy 0, policy_version 49435 (0.0008) [2023-12-25 23:57:55,955][123090] Updated weights for policy 1, policy_version 49320 (0.0006) [2023-12-25 23:57:56,011][123090] Updated weights for policy 1, policy_version 49330 (0.0006) [2023-12-25 23:57:56,071][123090] Updated weights for policy 1, policy_version 49340 (0.0007) [2023-12-25 23:57:56,739][123091] Updated weights for policy 0, policy_version 49445 (0.0007) [2023-12-25 23:57:56,801][123091] Updated weights for policy 0, policy_version 49455 (0.0008) [2023-12-25 23:57:56,866][123091] Updated weights for policy 0, policy_version 49465 (0.0010) [2023-12-25 23:57:56,887][123090] Updated weights for policy 1, policy_version 49350 (0.0006) [2023-12-25 23:57:56,955][123090] Updated weights for policy 1, policy_version 49360 (0.0010) [2023-12-25 23:57:57,008][123090] Updated weights for policy 1, policy_version 49370 (0.0009) [2023-12-25 23:57:57,491][123091] Updated weights for policy 0, policy_version 49475 (0.0007) [2023-12-25 23:57:57,546][123091] Updated weights for policy 0, policy_version 49485 (0.0008) [2023-12-25 23:57:57,615][123091] Updated weights for policy 0, policy_version 49495 (0.0009) [2023-12-25 23:57:57,891][123090] Updated weights for policy 1, policy_version 49380 (0.0010) [2023-12-25 23:57:57,953][123090] Updated weights for policy 1, policy_version 49390 (0.0009) [2023-12-25 23:57:58,021][123090] Updated weights for policy 1, policy_version 49400 (0.0009) [2023-12-25 23:57:58,287][123091] Updated weights for policy 0, policy_version 49505 (0.0010) [2023-12-25 23:57:58,357][123091] Updated weights for policy 0, policy_version 49515 (0.0008) [2023-12-25 23:57:58,429][123091] Updated weights for policy 0, policy_version 49525 (0.0006) [2023-12-25 23:57:58,504][123091] Updated weights for policy 0, policy_version 49535 (0.0007) [2023-12-25 23:57:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 25329664. Throughput: 0: 8831.8, 1: 8881.3. Samples: 25324464. Policy #0 lag: (min: 31.0, avg: 32.3, max: 60.0) [2023-12-25 23:57:58,785][121949] Avg episode reward: [(0, '3874.453'), (1, '4889.423')] [2023-12-25 23:57:58,973][123090] Updated weights for policy 1, policy_version 49411 (0.0009) [2023-12-25 23:57:59,044][123090] Updated weights for policy 1, policy_version 49421 (0.0009) [2023-12-25 23:57:59,101][123090] Updated weights for policy 1, policy_version 49431 (0.0009) [2023-12-25 23:57:59,320][123091] Updated weights for policy 0, policy_version 49545 (0.0008) [2023-12-25 23:57:59,390][123091] Updated weights for policy 0, policy_version 49555 (0.0009) [2023-12-25 23:57:59,449][123091] Updated weights for policy 0, policy_version 49565 (0.0005) [2023-12-25 23:57:59,925][123090] Updated weights for policy 1, policy_version 49441 (0.0009) [2023-12-25 23:57:59,991][123090] Updated weights for policy 1, policy_version 49451 (0.0008) [2023-12-25 23:58:00,049][123090] Updated weights for policy 1, policy_version 49461 (0.0009) [2023-12-25 23:58:00,115][123090] Updated weights for policy 1, policy_version 49471 (0.0009) [2023-12-25 23:58:00,174][123091] Updated weights for policy 0, policy_version 49575 (0.0005) [2023-12-25 23:58:00,252][123091] Updated weights for policy 0, policy_version 49585 (0.0005) [2023-12-25 23:58:00,323][123091] Updated weights for policy 0, policy_version 49595 (0.0005) [2023-12-25 23:58:00,911][123090] Updated weights for policy 1, policy_version 49481 (0.0009) [2023-12-25 23:58:00,963][123090] Updated weights for policy 1, policy_version 49491 (0.0010) [2023-12-25 23:58:01,021][123090] Updated weights for policy 1, policy_version 49501 (0.0010) [2023-12-25 23:58:01,038][123091] Updated weights for policy 0, policy_version 49605 (0.0011) [2023-12-25 23:58:01,098][123091] Updated weights for policy 0, policy_version 49615 (0.0013) [2023-12-25 23:58:01,163][123091] Updated weights for policy 0, policy_version 49625 (0.0010) [2023-12-25 23:58:01,813][123090] Updated weights for policy 1, policy_version 49511 (0.0009) [2023-12-25 23:58:01,871][123090] Updated weights for policy 1, policy_version 49521 (0.0008) [2023-12-25 23:58:01,879][123091] Updated weights for policy 0, policy_version 49635 (0.0009) [2023-12-25 23:58:01,922][123090] Updated weights for policy 1, policy_version 49531 (0.0008) [2023-12-25 23:58:01,940][123091] Updated weights for policy 0, policy_version 49645 (0.0007) [2023-12-25 23:58:01,998][123091] Updated weights for policy 0, policy_version 49655 (0.0005) [2023-12-25 23:58:02,628][123090] Updated weights for policy 1, policy_version 49541 (0.0006) [2023-12-25 23:58:02,694][123090] Updated weights for policy 1, policy_version 49551 (0.0009) [2023-12-25 23:58:02,720][123091] Updated weights for policy 0, policy_version 49665 (0.0005) [2023-12-25 23:58:02,758][123090] Updated weights for policy 1, policy_version 49561 (0.0010) [2023-12-25 23:58:02,775][123091] Updated weights for policy 0, policy_version 49675 (0.0007) [2023-12-25 23:58:02,825][123091] Updated weights for policy 0, policy_version 49685 (0.0010) [2023-12-25 23:58:02,879][123091] Updated weights for policy 0, policy_version 49695 (0.0010) [2023-12-25 23:58:03,347][123090] Updated weights for policy 1, policy_version 49571 (0.0008) [2023-12-25 23:58:03,411][123090] Updated weights for policy 1, policy_version 49581 (0.0006) [2023-12-25 23:58:03,469][123090] Updated weights for policy 1, policy_version 49591 (0.0009) [2023-12-25 23:58:03,747][123091] Updated weights for policy 0, policy_version 49705 (0.0010) [2023-12-25 23:58:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 25419776. Throughput: 0: 8925.0, 1: 8793.9. Samples: 25433144. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:03,785][121949] Avg episode reward: [(0, '4062.106'), (1, '4940.707')] [2023-12-25 23:58:03,804][123091] Updated weights for policy 0, policy_version 49715 (0.0009) [2023-12-25 23:58:03,860][123091] Updated weights for policy 0, policy_version 49725 (0.0007) [2023-12-25 23:58:04,180][123090] Updated weights for policy 1, policy_version 49601 (0.0007) [2023-12-25 23:58:04,239][123090] Updated weights for policy 1, policy_version 49611 (0.0008) [2023-12-25 23:58:04,289][123090] Updated weights for policy 1, policy_version 49621 (0.0009) [2023-12-25 23:58:04,338][123090] Updated weights for policy 1, policy_version 49631 (0.0009) [2023-12-25 23:58:04,728][123091] Updated weights for policy 0, policy_version 49735 (0.0010) [2023-12-25 23:58:04,780][123091] Updated weights for policy 0, policy_version 49745 (0.0010) [2023-12-25 23:58:04,839][123091] Updated weights for policy 0, policy_version 49755 (0.0011) [2023-12-25 23:58:05,166][123090] Updated weights for policy 1, policy_version 49641 (0.0006) [2023-12-25 23:58:05,238][123090] Updated weights for policy 1, policy_version 49651 (0.0007) [2023-12-25 23:58:05,304][123090] Updated weights for policy 1, policy_version 49661 (0.0008) [2023-12-25 23:58:05,661][123091] Updated weights for policy 0, policy_version 49765 (0.0009) [2023-12-25 23:58:05,736][123091] Updated weights for policy 0, policy_version 49775 (0.0008) [2023-12-25 23:58:05,808][123091] Updated weights for policy 0, policy_version 49785 (0.0008) [2023-12-25 23:58:06,009][123090] Updated weights for policy 1, policy_version 49671 (0.0009) [2023-12-25 23:58:06,068][123090] Updated weights for policy 1, policy_version 49681 (0.0009) [2023-12-25 23:58:06,129][123090] Updated weights for policy 1, policy_version 49691 (0.0009) [2023-12-25 23:58:06,515][123091] Updated weights for policy 0, policy_version 49795 (0.0009) [2023-12-25 23:58:06,579][123091] Updated weights for policy 0, policy_version 49805 (0.0010) [2023-12-25 23:58:06,644][123091] Updated weights for policy 0, policy_version 49815 (0.0010) [2023-12-25 23:58:07,012][123090] Updated weights for policy 1, policy_version 49701 (0.0010) [2023-12-25 23:58:07,080][123090] Updated weights for policy 1, policy_version 49711 (0.0008) [2023-12-25 23:58:07,147][123090] Updated weights for policy 1, policy_version 49721 (0.0005) [2023-12-25 23:58:07,378][123091] Updated weights for policy 0, policy_version 49825 (0.0009) [2023-12-25 23:58:07,438][123091] Updated weights for policy 0, policy_version 49835 (0.0006) [2023-12-25 23:58:07,486][123091] Updated weights for policy 0, policy_version 49845 (0.0006) [2023-12-25 23:58:07,543][123091] Updated weights for policy 0, policy_version 49855 (0.0006) [2023-12-25 23:58:07,895][123090] Updated weights for policy 1, policy_version 49731 (0.0007) [2023-12-25 23:58:07,957][123090] Updated weights for policy 1, policy_version 49741 (0.0005) [2023-12-25 23:58:08,013][123090] Updated weights for policy 1, policy_version 49751 (0.0005) [2023-12-25 23:58:08,373][123091] Updated weights for policy 0, policy_version 49865 (0.0010) [2023-12-25 23:58:08,429][123091] Updated weights for policy 0, policy_version 49875 (0.0010) [2023-12-25 23:58:08,491][123091] Updated weights for policy 0, policy_version 49885 (0.0009) [2023-12-25 23:58:08,740][123090] Updated weights for policy 1, policy_version 49761 (0.0005) [2023-12-25 23:58:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 25509888. Throughput: 0: 8941.0, 1: 8851.3. Samples: 25485968. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:08,785][121949] Avg episode reward: [(0, '4137.939'), (1, '4849.844')] [2023-12-25 23:58:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000049888_12771328.pth... [2023-12-25 23:58:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000048832_12500992.pth [2023-12-25 23:58:08,810][123090] Updated weights for policy 1, policy_version 49771 (0.0007) [2023-12-25 23:58:08,874][123090] Updated weights for policy 1, policy_version 49781 (0.0010) [2023-12-25 23:58:08,933][123090] Updated weights for policy 1, policy_version 49791 (0.0010) [2023-12-25 23:58:08,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000049792_12746752.pth... [2023-12-25 23:58:08,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000048736_12476416.pth [2023-12-25 23:58:09,226][123091] Updated weights for policy 0, policy_version 49895 (0.0007) [2023-12-25 23:58:09,286][123091] Updated weights for policy 0, policy_version 49905 (0.0007) [2023-12-25 23:58:09,343][123091] Updated weights for policy 0, policy_version 49915 (0.0009) [2023-12-25 23:58:09,700][123090] Updated weights for policy 1, policy_version 49801 (0.0009) [2023-12-25 23:58:09,764][123090] Updated weights for policy 1, policy_version 49811 (0.0011) [2023-12-25 23:58:09,837][123090] Updated weights for policy 1, policy_version 49821 (0.0011) [2023-12-25 23:58:10,116][123091] Updated weights for policy 0, policy_version 49925 (0.0008) [2023-12-25 23:58:10,180][123091] Updated weights for policy 0, policy_version 49935 (0.0006) [2023-12-25 23:58:10,241][123091] Updated weights for policy 0, policy_version 49945 (0.0010) [2023-12-25 23:58:10,644][123090] Updated weights for policy 1, policy_version 49831 (0.0008) [2023-12-25 23:58:10,695][123090] Updated weights for policy 1, policy_version 49841 (0.0010) [2023-12-25 23:58:10,754][123090] Updated weights for policy 1, policy_version 49851 (0.0010) [2023-12-25 23:58:11,023][123091] Updated weights for policy 0, policy_version 49955 (0.0010) [2023-12-25 23:58:11,090][123091] Updated weights for policy 0, policy_version 49965 (0.0009) [2023-12-25 23:58:11,156][123091] Updated weights for policy 0, policy_version 49975 (0.0009) [2023-12-25 23:58:11,577][123090] Updated weights for policy 1, policy_version 49861 (0.0012) [2023-12-25 23:58:11,644][123090] Updated weights for policy 1, policy_version 49871 (0.0009) [2023-12-25 23:58:11,719][123090] Updated weights for policy 1, policy_version 49881 (0.0009) [2023-12-25 23:58:12,077][123091] Updated weights for policy 0, policy_version 49985 (0.0009) [2023-12-25 23:58:12,148][123091] Updated weights for policy 0, policy_version 49995 (0.0009) [2023-12-25 23:58:12,211][123091] Updated weights for policy 0, policy_version 50005 (0.0010) [2023-12-25 23:58:12,271][123091] Updated weights for policy 0, policy_version 50015 (0.0009) [2023-12-25 23:58:12,480][123090] Updated weights for policy 1, policy_version 49891 (0.0010) [2023-12-25 23:58:12,548][123090] Updated weights for policy 1, policy_version 49901 (0.0010) [2023-12-25 23:58:12,606][123090] Updated weights for policy 1, policy_version 49911 (0.0010) [2023-12-25 23:58:13,061][123091] Updated weights for policy 0, policy_version 50025 (0.0009) [2023-12-25 23:58:13,124][123091] Updated weights for policy 0, policy_version 50035 (0.0008) [2023-12-25 23:58:13,172][123091] Updated weights for policy 0, policy_version 50045 (0.0009) [2023-12-25 23:58:13,444][123090] Updated weights for policy 1, policy_version 49921 (0.0010) [2023-12-25 23:58:13,495][123090] Updated weights for policy 1, policy_version 49931 (0.0010) [2023-12-25 23:58:13,546][123090] Updated weights for policy 1, policy_version 49941 (0.0010) [2023-12-25 23:58:13,612][123090] Updated weights for policy 1, policy_version 49951 (0.0010) [2023-12-25 23:58:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 25600000. Throughput: 0: 8908.9, 1: 8806.2. Samples: 25592248. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:13,785][121949] Avg episode reward: [(0, '4001.590'), (1, '4578.671')] [2023-12-25 23:58:14,003][123091] Updated weights for policy 0, policy_version 50055 (0.0009) [2023-12-25 23:58:14,064][123091] Updated weights for policy 0, policy_version 50065 (0.0009) [2023-12-25 23:58:14,126][123091] Updated weights for policy 0, policy_version 50075 (0.0009) [2023-12-25 23:58:14,456][123090] Updated weights for policy 1, policy_version 49961 (0.0010) [2023-12-25 23:58:14,529][123090] Updated weights for policy 1, policy_version 49971 (0.0010) [2023-12-25 23:58:14,604][123090] Updated weights for policy 1, policy_version 49981 (0.0010) [2023-12-25 23:58:14,865][123091] Updated weights for policy 0, policy_version 50085 (0.0009) [2023-12-25 23:58:14,928][123091] Updated weights for policy 0, policy_version 50095 (0.0009) [2023-12-25 23:58:14,984][123091] Updated weights for policy 0, policy_version 50105 (0.0010) [2023-12-25 23:58:15,445][123090] Updated weights for policy 1, policy_version 49991 (0.0009) [2023-12-25 23:58:15,507][123090] Updated weights for policy 1, policy_version 50001 (0.0006) [2023-12-25 23:58:15,573][123090] Updated weights for policy 1, policy_version 50011 (0.0008) [2023-12-25 23:58:15,842][123091] Updated weights for policy 0, policy_version 50115 (0.0009) [2023-12-25 23:58:15,896][123091] Updated weights for policy 0, policy_version 50125 (0.0008) [2023-12-25 23:58:15,963][123091] Updated weights for policy 0, policy_version 50135 (0.0006) [2023-12-25 23:58:16,355][123090] Updated weights for policy 1, policy_version 50021 (0.0007) [2023-12-25 23:58:16,407][123090] Updated weights for policy 1, policy_version 50031 (0.0006) [2023-12-25 23:58:16,462][123090] Updated weights for policy 1, policy_version 50041 (0.0009) [2023-12-25 23:58:16,644][123091] Updated weights for policy 0, policy_version 50145 (0.0007) [2023-12-25 23:58:16,716][123091] Updated weights for policy 0, policy_version 50155 (0.0005) [2023-12-25 23:58:16,787][123091] Updated weights for policy 0, policy_version 50165 (0.0008) [2023-12-25 23:58:16,852][123091] Updated weights for policy 0, policy_version 50175 (0.0011) [2023-12-25 23:58:17,303][123090] Updated weights for policy 1, policy_version 50051 (0.0009) [2023-12-25 23:58:17,366][123090] Updated weights for policy 1, policy_version 50061 (0.0006) [2023-12-25 23:58:17,433][123090] Updated weights for policy 1, policy_version 50071 (0.0005) [2023-12-25 23:58:17,589][123091] Updated weights for policy 0, policy_version 50185 (0.0010) [2023-12-25 23:58:17,647][123091] Updated weights for policy 0, policy_version 50195 (0.0010) [2023-12-25 23:58:17,701][123091] Updated weights for policy 0, policy_version 50205 (0.0010) [2023-12-25 23:58:18,106][123090] Updated weights for policy 1, policy_version 50081 (0.0005) [2023-12-25 23:58:18,167][123090] Updated weights for policy 1, policy_version 50091 (0.0005) [2023-12-25 23:58:18,229][123090] Updated weights for policy 1, policy_version 50101 (0.0006) [2023-12-25 23:58:18,292][123090] Updated weights for policy 1, policy_version 50111 (0.0005) [2023-12-25 23:58:18,572][123091] Updated weights for policy 0, policy_version 50215 (0.0011) [2023-12-25 23:58:18,640][123091] Updated weights for policy 0, policy_version 50225 (0.0011) [2023-12-25 23:58:18,707][123091] Updated weights for policy 0, policy_version 50235 (0.0011) [2023-12-25 23:58:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 25690112. Throughput: 0: 8920.9, 1: 8812.0. Samples: 25698712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:18,785][121949] Avg episode reward: [(0, '3985.933'), (1, '4534.158')] [2023-12-25 23:58:19,037][123090] Updated weights for policy 1, policy_version 50121 (0.0009) [2023-12-25 23:58:19,086][123090] Updated weights for policy 1, policy_version 50131 (0.0009) [2023-12-25 23:58:19,141][123090] Updated weights for policy 1, policy_version 50141 (0.0007) [2023-12-25 23:58:19,531][123091] Updated weights for policy 0, policy_version 50245 (0.0009) [2023-12-25 23:58:19,606][123091] Updated weights for policy 0, policy_version 50255 (0.0007) [2023-12-25 23:58:19,670][123091] Updated weights for policy 0, policy_version 50265 (0.0010) [2023-12-25 23:58:20,026][123090] Updated weights for policy 1, policy_version 50151 (0.0008) [2023-12-25 23:58:20,096][123090] Updated weights for policy 1, policy_version 50161 (0.0009) [2023-12-25 23:58:20,164][123090] Updated weights for policy 1, policy_version 50171 (0.0009) [2023-12-25 23:58:20,448][123091] Updated weights for policy 0, policy_version 50275 (0.0010) [2023-12-25 23:58:20,512][123091] Updated weights for policy 0, policy_version 50285 (0.0005) [2023-12-25 23:58:20,583][123091] Updated weights for policy 0, policy_version 50295 (0.0006) [2023-12-25 23:58:21,010][123090] Updated weights for policy 1, policy_version 50181 (0.0010) [2023-12-25 23:58:21,071][123090] Updated weights for policy 1, policy_version 50191 (0.0010) [2023-12-25 23:58:21,124][123090] Updated weights for policy 1, policy_version 50201 (0.0009) [2023-12-25 23:58:21,403][123091] Updated weights for policy 0, policy_version 50305 (0.0009) [2023-12-25 23:58:21,462][123091] Updated weights for policy 0, policy_version 50315 (0.0010) [2023-12-25 23:58:21,517][123091] Updated weights for policy 0, policy_version 50325 (0.0010) [2023-12-25 23:58:21,568][123091] Updated weights for policy 0, policy_version 50335 (0.0009) [2023-12-25 23:58:21,968][123090] Updated weights for policy 1, policy_version 50211 (0.0009) [2023-12-25 23:58:22,035][123090] Updated weights for policy 1, policy_version 50221 (0.0010) [2023-12-25 23:58:22,095][123090] Updated weights for policy 1, policy_version 50231 (0.0009) [2023-12-25 23:58:22,468][123091] Updated weights for policy 0, policy_version 50345 (0.0010) [2023-12-25 23:58:22,530][123091] Updated weights for policy 0, policy_version 50355 (0.0009) [2023-12-25 23:58:22,589][123091] Updated weights for policy 0, policy_version 50365 (0.0010) [2023-12-25 23:58:22,985][123090] Updated weights for policy 1, policy_version 50241 (0.0010) [2023-12-25 23:58:23,047][123090] Updated weights for policy 1, policy_version 50251 (0.0010) [2023-12-25 23:58:23,122][123090] Updated weights for policy 1, policy_version 50261 (0.0010) [2023-12-25 23:58:23,197][123090] Updated weights for policy 1, policy_version 50271 (0.0010) [2023-12-25 23:58:23,329][123091] Updated weights for policy 0, policy_version 50375 (0.0011) [2023-12-25 23:58:23,393][123091] Updated weights for policy 0, policy_version 50385 (0.0011) [2023-12-25 23:58:23,464][123091] Updated weights for policy 0, policy_version 50395 (0.0011) [2023-12-25 23:58:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 25772032. Throughput: 0: 8927.8, 1: 8738.2. Samples: 25748600. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:23,785][121949] Avg episode reward: [(0, '4092.860'), (1, '4831.320')] [2023-12-25 23:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000050400_12902400.pth... [2023-12-25 23:58:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000050272_12869632.pth... [2023-12-25 23:58:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000049344_12632064.pth [2023-12-25 23:58:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000049248_12607488.pth [2023-12-25 23:58:24,044][123090] Updated weights for policy 1, policy_version 50281 (0.0008) [2023-12-25 23:58:24,092][123090] Updated weights for policy 1, policy_version 50291 (0.0009) [2023-12-25 23:58:24,156][123090] Updated weights for policy 1, policy_version 50301 (0.0008) [2023-12-25 23:58:24,178][123091] Updated weights for policy 0, policy_version 50405 (0.0011) [2023-12-25 23:58:24,247][123091] Updated weights for policy 0, policy_version 50415 (0.0007) [2023-12-25 23:58:24,314][123091] Updated weights for policy 0, policy_version 50425 (0.0008) [2023-12-25 23:58:24,819][123090] Updated weights for policy 1, policy_version 50311 (0.0006) [2023-12-25 23:58:24,867][123090] Updated weights for policy 1, policy_version 50321 (0.0005) [2023-12-25 23:58:24,916][123090] Updated weights for policy 1, policy_version 50331 (0.0005) [2023-12-25 23:58:25,112][123091] Updated weights for policy 0, policy_version 50435 (0.0011) [2023-12-25 23:58:25,170][123091] Updated weights for policy 0, policy_version 50445 (0.0010) [2023-12-25 23:58:25,232][123091] Updated weights for policy 0, policy_version 50455 (0.0010) [2023-12-25 23:58:25,689][123090] Updated weights for policy 1, policy_version 50341 (0.0008) [2023-12-25 23:58:25,745][123090] Updated weights for policy 1, policy_version 50351 (0.0009) [2023-12-25 23:58:25,794][123090] Updated weights for policy 1, policy_version 50361 (0.0009) [2023-12-25 23:58:26,066][123091] Updated weights for policy 0, policy_version 50465 (0.0010) [2023-12-25 23:58:26,125][123091] Updated weights for policy 0, policy_version 50475 (0.0009) [2023-12-25 23:58:26,178][123091] Updated weights for policy 0, policy_version 50485 (0.0011) [2023-12-25 23:58:26,248][123091] Updated weights for policy 0, policy_version 50495 (0.0010) [2023-12-25 23:58:26,615][123090] Updated weights for policy 1, policy_version 50371 (0.0008) [2023-12-25 23:58:26,663][123090] Updated weights for policy 1, policy_version 50381 (0.0008) [2023-12-25 23:58:26,725][123090] Updated weights for policy 1, policy_version 50391 (0.0009) [2023-12-25 23:58:27,074][123091] Updated weights for policy 0, policy_version 50505 (0.0010) [2023-12-25 23:58:27,121][123091] Updated weights for policy 0, policy_version 50515 (0.0010) [2023-12-25 23:58:27,172][123091] Updated weights for policy 0, policy_version 50525 (0.0010) [2023-12-25 23:58:27,528][123090] Updated weights for policy 1, policy_version 50401 (0.0009) [2023-12-25 23:58:27,583][123090] Updated weights for policy 1, policy_version 50411 (0.0005) [2023-12-25 23:58:27,627][123090] Updated weights for policy 1, policy_version 50421 (0.0005) [2023-12-25 23:58:27,673][123090] Updated weights for policy 1, policy_version 50431 (0.0005) [2023-12-25 23:58:28,017][123091] Updated weights for policy 0, policy_version 50535 (0.0010) [2023-12-25 23:58:28,064][123091] Updated weights for policy 0, policy_version 50545 (0.0010) [2023-12-25 23:58:28,115][123091] Updated weights for policy 0, policy_version 50555 (0.0010) [2023-12-25 23:58:28,389][123090] Updated weights for policy 1, policy_version 50441 (0.0008) [2023-12-25 23:58:28,459][123090] Updated weights for policy 1, policy_version 50451 (0.0007) [2023-12-25 23:58:28,524][123090] Updated weights for policy 1, policy_version 50461 (0.0005) [2023-12-25 23:58:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 25862144. Throughput: 0: 8915.9, 1: 8814.2. Samples: 25854872. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:28,785][121949] Avg episode reward: [(0, '4199.965'), (1, '4842.196')] [2023-12-25 23:58:28,884][123091] Updated weights for policy 0, policy_version 50565 (0.0010) [2023-12-25 23:58:28,936][123091] Updated weights for policy 0, policy_version 50575 (0.0005) [2023-12-25 23:58:28,999][123091] Updated weights for policy 0, policy_version 50585 (0.0006) [2023-12-25 23:58:29,124][123090] Updated weights for policy 1, policy_version 50471 (0.0007) [2023-12-25 23:58:29,194][123090] Updated weights for policy 1, policy_version 50481 (0.0005) [2023-12-25 23:58:29,264][123090] Updated weights for policy 1, policy_version 50491 (0.0009) [2023-12-25 23:58:29,792][123091] Updated weights for policy 0, policy_version 50595 (0.0010) [2023-12-25 23:58:29,861][123091] Updated weights for policy 0, policy_version 50605 (0.0010) [2023-12-25 23:58:29,924][123091] Updated weights for policy 0, policy_version 50615 (0.0009) [2023-12-25 23:58:30,103][123090] Updated weights for policy 1, policy_version 50501 (0.0009) [2023-12-25 23:58:30,160][123090] Updated weights for policy 1, policy_version 50511 (0.0009) [2023-12-25 23:58:30,214][123090] Updated weights for policy 1, policy_version 50521 (0.0009) [2023-12-25 23:58:30,755][123091] Updated weights for policy 0, policy_version 50625 (0.0009) [2023-12-25 23:58:30,824][123091] Updated weights for policy 0, policy_version 50635 (0.0010) [2023-12-25 23:58:30,885][123091] Updated weights for policy 0, policy_version 50645 (0.0009) [2023-12-25 23:58:30,944][123091] Updated weights for policy 0, policy_version 50655 (0.0009) [2023-12-25 23:58:31,060][123090] Updated weights for policy 1, policy_version 50531 (0.0010) [2023-12-25 23:58:31,124][123090] Updated weights for policy 1, policy_version 50541 (0.0009) [2023-12-25 23:58:31,191][123090] Updated weights for policy 1, policy_version 50551 (0.0010) [2023-12-25 23:58:31,684][123091] Updated weights for policy 0, policy_version 50665 (0.0010) [2023-12-25 23:58:31,747][123091] Updated weights for policy 0, policy_version 50675 (0.0013) [2023-12-25 23:58:31,808][123091] Updated weights for policy 0, policy_version 50685 (0.0008) [2023-12-25 23:58:32,056][123090] Updated weights for policy 1, policy_version 50561 (0.0009) [2023-12-25 23:58:32,116][123090] Updated weights for policy 1, policy_version 50571 (0.0009) [2023-12-25 23:58:32,174][123090] Updated weights for policy 1, policy_version 50581 (0.0010) [2023-12-25 23:58:32,227][123090] Updated weights for policy 1, policy_version 50591 (0.0009) [2023-12-25 23:58:32,595][123091] Updated weights for policy 0, policy_version 50695 (0.0011) [2023-12-25 23:58:32,652][123091] Updated weights for policy 0, policy_version 50705 (0.0011) [2023-12-25 23:58:32,708][123091] Updated weights for policy 0, policy_version 50715 (0.0011) [2023-12-25 23:58:33,120][123090] Updated weights for policy 1, policy_version 50601 (0.0009) [2023-12-25 23:58:33,171][123090] Updated weights for policy 1, policy_version 50611 (0.0007) [2023-12-25 23:58:33,229][123090] Updated weights for policy 1, policy_version 50621 (0.0005) [2023-12-25 23:58:33,403][123091] Updated weights for policy 0, policy_version 50725 (0.0008) [2023-12-25 23:58:33,454][123091] Updated weights for policy 0, policy_version 50735 (0.0005) [2023-12-25 23:58:33,505][123091] Updated weights for policy 0, policy_version 50745 (0.0005) [2023-12-25 23:58:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 25952256. Throughput: 0: 8962.3, 1: 8866.5. Samples: 25963452. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-25 23:58:33,785][121949] Avg episode reward: [(0, '4093.831'), (1, '4767.544')] [2023-12-25 23:58:34,051][123090] Updated weights for policy 1, policy_version 50631 (0.0009) [2023-12-25 23:58:34,105][123090] Updated weights for policy 1, policy_version 50641 (0.0010) [2023-12-25 23:58:34,149][123091] Updated weights for policy 0, policy_version 50755 (0.0006) [2023-12-25 23:58:34,172][123090] Updated weights for policy 1, policy_version 50651 (0.0009) [2023-12-25 23:58:34,213][123091] Updated weights for policy 0, policy_version 50765 (0.0009) [2023-12-25 23:58:34,282][123091] Updated weights for policy 0, policy_version 50775 (0.0009) [2023-12-25 23:58:35,020][123090] Updated weights for policy 1, policy_version 50661 (0.0009) [2023-12-25 23:58:35,076][123090] Updated weights for policy 1, policy_version 50671 (0.0009) [2023-12-25 23:58:35,095][123091] Updated weights for policy 0, policy_version 50785 (0.0009) [2023-12-25 23:58:35,137][123090] Updated weights for policy 1, policy_version 50681 (0.0009) [2023-12-25 23:58:35,161][123091] Updated weights for policy 0, policy_version 50795 (0.0005) [2023-12-25 23:58:35,229][123091] Updated weights for policy 0, policy_version 50805 (0.0010) [2023-12-25 23:58:35,291][123091] Updated weights for policy 0, policy_version 50815 (0.0011) [2023-12-25 23:58:35,988][123090] Updated weights for policy 1, policy_version 50691 (0.0009) [2023-12-25 23:58:36,041][123090] Updated weights for policy 1, policy_version 50701 (0.0008) [2023-12-25 23:58:36,042][123091] Updated weights for policy 0, policy_version 50825 (0.0006) [2023-12-25 23:58:36,095][123090] Updated weights for policy 1, policy_version 50711 (0.0009) [2023-12-25 23:58:36,105][123091] Updated weights for policy 0, policy_version 50835 (0.0006) [2023-12-25 23:58:36,169][123091] Updated weights for policy 0, policy_version 50845 (0.0007) [2023-12-25 23:58:36,887][123091] Updated weights for policy 0, policy_version 50855 (0.0008) [2023-12-25 23:58:36,940][123091] Updated weights for policy 0, policy_version 50865 (0.0009) [2023-12-25 23:58:36,996][123091] Updated weights for policy 0, policy_version 50875 (0.0009) [2023-12-25 23:58:37,042][123090] Updated weights for policy 1, policy_version 50721 (0.0009) [2023-12-25 23:58:37,098][123090] Updated weights for policy 1, policy_version 50731 (0.0009) [2023-12-25 23:58:37,147][123090] Updated weights for policy 1, policy_version 50741 (0.0009) [2023-12-25 23:58:37,200][123090] Updated weights for policy 1, policy_version 50751 (0.0009) [2023-12-25 23:58:37,835][123091] Updated weights for policy 0, policy_version 50885 (0.0011) [2023-12-25 23:58:37,896][123091] Updated weights for policy 0, policy_version 50895 (0.0010) [2023-12-25 23:58:37,965][123091] Updated weights for policy 0, policy_version 50905 (0.0010) [2023-12-25 23:58:38,054][123090] Updated weights for policy 1, policy_version 50761 (0.0010) [2023-12-25 23:58:38,112][123090] Updated weights for policy 1, policy_version 50771 (0.0009) [2023-12-25 23:58:38,161][123090] Updated weights for policy 1, policy_version 50781 (0.0009) [2023-12-25 23:58:38,774][123091] Updated weights for policy 0, policy_version 50915 (0.0008) [2023-12-25 23:58:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 26034176. Throughput: 0: 8991.9, 1: 8821.5. Samples: 26015484. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:58:38,785][121949] Avg episode reward: [(0, '3871.289'), (1, '4806.830')] [2023-12-25 23:58:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000050784_13000704.pth... [2023-12-25 23:58:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000049792_12746752.pth [2023-12-25 23:58:38,850][123091] Updated weights for policy 0, policy_version 50925 (0.0006) [2023-12-25 23:58:38,911][123091] Updated weights for policy 0, policy_version 50935 (0.0006) [2023-12-25 23:58:38,973][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000050944_13041664.pth... [2023-12-25 23:58:38,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000049888_12771328.pth [2023-12-25 23:58:39,059][123090] Updated weights for policy 1, policy_version 50791 (0.0010) [2023-12-25 23:58:39,112][123090] Updated weights for policy 1, policy_version 50801 (0.0009) [2023-12-25 23:58:39,176][123090] Updated weights for policy 1, policy_version 50811 (0.0009) [2023-12-25 23:58:39,594][123091] Updated weights for policy 0, policy_version 50945 (0.0006) [2023-12-25 23:58:39,652][123091] Updated weights for policy 0, policy_version 50955 (0.0006) [2023-12-25 23:58:39,705][123091] Updated weights for policy 0, policy_version 50965 (0.0006) [2023-12-25 23:58:39,752][123091] Updated weights for policy 0, policy_version 50975 (0.0005) [2023-12-25 23:58:40,149][123090] Updated weights for policy 1, policy_version 50821 (0.0007) [2023-12-25 23:58:40,210][123090] Updated weights for policy 1, policy_version 50832 (0.0010) [2023-12-25 23:58:40,261][123090] Updated weights for policy 1, policy_version 50842 (0.0009) [2023-12-25 23:58:40,554][123091] Updated weights for policy 0, policy_version 50985 (0.0006) [2023-12-25 23:58:40,601][123091] Updated weights for policy 0, policy_version 50995 (0.0005) [2023-12-25 23:58:40,650][123091] Updated weights for policy 0, policy_version 51005 (0.0005) [2023-12-25 23:58:41,098][123090] Updated weights for policy 1, policy_version 50852 (0.0011) [2023-12-25 23:58:41,170][123090] Updated weights for policy 1, policy_version 50862 (0.0011) [2023-12-25 23:58:41,227][123090] Updated weights for policy 1, policy_version 50872 (0.0011) [2023-12-25 23:58:41,405][123091] Updated weights for policy 0, policy_version 51015 (0.0007) [2023-12-25 23:58:41,460][123091] Updated weights for policy 0, policy_version 51025 (0.0010) [2023-12-25 23:58:41,518][123091] Updated weights for policy 0, policy_version 51035 (0.0010) [2023-12-25 23:58:42,018][123090] Updated weights for policy 1, policy_version 50882 (0.0009) [2023-12-25 23:58:42,084][123090] Updated weights for policy 1, policy_version 50892 (0.0010) [2023-12-25 23:58:42,139][123090] Updated weights for policy 1, policy_version 50902 (0.0006) [2023-12-25 23:58:42,197][123090] Updated weights for policy 1, policy_version 50912 (0.0005) [2023-12-25 23:58:42,396][123091] Updated weights for policy 0, policy_version 51045 (0.0010) [2023-12-25 23:58:42,462][123091] Updated weights for policy 0, policy_version 51055 (0.0008) [2023-12-25 23:58:42,551][123091] Updated weights for policy 0, policy_version 51065 (0.0011) [2023-12-25 23:58:42,866][123090] Updated weights for policy 1, policy_version 50922 (0.0010) [2023-12-25 23:58:42,914][123090] Updated weights for policy 1, policy_version 50932 (0.0010) [2023-12-25 23:58:42,984][123090] Updated weights for policy 1, policy_version 50942 (0.0010) [2023-12-25 23:58:43,301][123091] Updated weights for policy 0, policy_version 51075 (0.0009) [2023-12-25 23:58:43,355][123091] Updated weights for policy 0, policy_version 51085 (0.0008) [2023-12-25 23:58:43,411][123091] Updated weights for policy 0, policy_version 51095 (0.0009) [2023-12-25 23:58:43,763][123090] Updated weights for policy 1, policy_version 50952 (0.0006) [2023-12-25 23:58:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 26124288. Throughput: 0: 8940.6, 1: 8738.0. Samples: 26120004. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:58:43,785][121949] Avg episode reward: [(0, '4014.424'), (1, '4824.118')] [2023-12-25 23:58:43,816][123090] Updated weights for policy 1, policy_version 50962 (0.0005) [2023-12-25 23:58:43,863][123090] Updated weights for policy 1, policy_version 50972 (0.0006) [2023-12-25 23:58:44,198][123091] Updated weights for policy 0, policy_version 51105 (0.0009) [2023-12-25 23:58:44,254][123091] Updated weights for policy 0, policy_version 51115 (0.0006) [2023-12-25 23:58:44,325][123091] Updated weights for policy 0, policy_version 51125 (0.0005) [2023-12-25 23:58:44,400][123091] Updated weights for policy 0, policy_version 51135 (0.0005) [2023-12-25 23:58:44,574][123090] Updated weights for policy 1, policy_version 50982 (0.0007) [2023-12-25 23:58:44,626][123090] Updated weights for policy 1, policy_version 50992 (0.0005) [2023-12-25 23:58:44,678][123090] Updated weights for policy 1, policy_version 51002 (0.0005) [2023-12-25 23:58:45,122][123091] Updated weights for policy 0, policy_version 51145 (0.0010) [2023-12-25 23:58:45,182][123091] Updated weights for policy 0, policy_version 51155 (0.0011) [2023-12-25 23:58:45,249][123091] Updated weights for policy 0, policy_version 51165 (0.0011) [2023-12-25 23:58:45,469][123090] Updated weights for policy 1, policy_version 51012 (0.0007) [2023-12-25 23:58:45,524][123090] Updated weights for policy 1, policy_version 51022 (0.0010) [2023-12-25 23:58:45,572][123090] Updated weights for policy 1, policy_version 51032 (0.0010) [2023-12-25 23:58:46,081][123091] Updated weights for policy 0, policy_version 51175 (0.0011) [2023-12-25 23:58:46,135][123091] Updated weights for policy 0, policy_version 51185 (0.0010) [2023-12-25 23:58:46,194][123091] Updated weights for policy 0, policy_version 51195 (0.0010) [2023-12-25 23:58:46,407][123090] Updated weights for policy 1, policy_version 51042 (0.0009) [2023-12-25 23:58:46,461][123090] Updated weights for policy 1, policy_version 51052 (0.0005) [2023-12-25 23:58:46,518][123090] Updated weights for policy 1, policy_version 51062 (0.0005) [2023-12-25 23:58:46,571][123090] Updated weights for policy 1, policy_version 51072 (0.0005) [2023-12-25 23:58:46,994][123091] Updated weights for policy 0, policy_version 51205 (0.0010) [2023-12-25 23:58:47,051][123091] Updated weights for policy 0, policy_version 51216 (0.0008) [2023-12-25 23:58:47,120][123091] Updated weights for policy 0, policy_version 51227 (0.0009) [2023-12-25 23:58:47,347][123090] Updated weights for policy 1, policy_version 51082 (0.0010) [2023-12-25 23:58:47,406][123090] Updated weights for policy 1, policy_version 51092 (0.0009) [2023-12-25 23:58:47,452][123090] Updated weights for policy 1, policy_version 51102 (0.0007) [2023-12-25 23:58:47,956][123091] Updated weights for policy 0, policy_version 51237 (0.0009) [2023-12-25 23:58:48,009][123091] Updated weights for policy 0, policy_version 51247 (0.0010) [2023-12-25 23:58:48,076][123091] Updated weights for policy 0, policy_version 51257 (0.0010) [2023-12-25 23:58:48,302][123090] Updated weights for policy 1, policy_version 51112 (0.0009) [2023-12-25 23:58:48,381][123090] Updated weights for policy 1, policy_version 51122 (0.0009) [2023-12-25 23:58:48,446][123090] Updated weights for policy 1, policy_version 51132 (0.0009) [2023-12-25 23:58:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 26214400. Throughput: 0: 8877.6, 1: 8756.8. Samples: 26226692. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:58:48,785][121949] Avg episode reward: [(0, '4098.533'), (1, '4796.329')] [2023-12-25 23:58:48,919][123091] Updated weights for policy 0, policy_version 51267 (0.0011) [2023-12-25 23:58:48,985][123091] Updated weights for policy 0, policy_version 51277 (0.0011) [2023-12-25 23:58:49,044][123091] Updated weights for policy 0, policy_version 51287 (0.0008) [2023-12-25 23:58:49,311][123090] Updated weights for policy 1, policy_version 51142 (0.0009) [2023-12-25 23:58:49,379][123090] Updated weights for policy 1, policy_version 51152 (0.0009) [2023-12-25 23:58:49,450][123090] Updated weights for policy 1, policy_version 51162 (0.0010) [2023-12-25 23:58:49,816][123091] Updated weights for policy 0, policy_version 51297 (0.0007) [2023-12-25 23:58:49,878][123091] Updated weights for policy 0, policy_version 51307 (0.0010) [2023-12-25 23:58:49,945][123091] Updated weights for policy 0, policy_version 51317 (0.0009) [2023-12-25 23:58:50,009][123091] Updated weights for policy 0, policy_version 51327 (0.0009) [2023-12-25 23:58:50,308][123090] Updated weights for policy 1, policy_version 51172 (0.0009) [2023-12-25 23:58:50,373][123090] Updated weights for policy 1, policy_version 51182 (0.0010) [2023-12-25 23:58:50,435][123090] Updated weights for policy 1, policy_version 51192 (0.0009) [2023-12-25 23:58:50,812][123091] Updated weights for policy 0, policy_version 51337 (0.0009) [2023-12-25 23:58:50,882][123091] Updated weights for policy 0, policy_version 51347 (0.0009) [2023-12-25 23:58:50,951][123091] Updated weights for policy 0, policy_version 51357 (0.0007) [2023-12-25 23:58:51,332][123090] Updated weights for policy 1, policy_version 51202 (0.0009) [2023-12-25 23:58:51,407][123090] Updated weights for policy 1, policy_version 51212 (0.0009) [2023-12-25 23:58:51,457][123090] Updated weights for policy 1, policy_version 51222 (0.0009) [2023-12-25 23:58:51,506][123090] Updated weights for policy 1, policy_version 51232 (0.0009) [2023-12-25 23:58:51,710][123091] Updated weights for policy 0, policy_version 51367 (0.0010) [2023-12-25 23:58:51,771][123091] Updated weights for policy 0, policy_version 51377 (0.0008) [2023-12-25 23:58:51,829][123091] Updated weights for policy 0, policy_version 51387 (0.0009) [2023-12-25 23:58:52,415][123090] Updated weights for policy 1, policy_version 51242 (0.0011) [2023-12-25 23:58:52,493][123090] Updated weights for policy 1, policy_version 51252 (0.0011) [2023-12-25 23:58:52,552][123090] Updated weights for policy 1, policy_version 51262 (0.0010) [2023-12-25 23:58:52,563][123091] Updated weights for policy 0, policy_version 51397 (0.0010) [2023-12-25 23:58:52,626][123091] Updated weights for policy 0, policy_version 51407 (0.0010) [2023-12-25 23:58:52,689][123091] Updated weights for policy 0, policy_version 51417 (0.0010) [2023-12-25 23:58:53,270][123090] Updated weights for policy 1, policy_version 51272 (0.0010) [2023-12-25 23:58:53,321][123090] Updated weights for policy 1, policy_version 51282 (0.0010) [2023-12-25 23:58:53,387][123090] Updated weights for policy 1, policy_version 51292 (0.0010) [2023-12-25 23:58:53,511][123091] Updated weights for policy 0, policy_version 51427 (0.0011) [2023-12-25 23:58:53,569][123091] Updated weights for policy 0, policy_version 51437 (0.0010) [2023-12-25 23:58:53,617][123091] Updated weights for policy 0, policy_version 51447 (0.0010) [2023-12-25 23:58:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 26304512. Throughput: 0: 8878.8, 1: 8693.5. Samples: 26276724. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:58:53,785][121949] Avg episode reward: [(0, '4152.504'), (1, '4901.242')] [2023-12-25 23:58:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000051456_13172736.pth... [2023-12-25 23:58:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000051296_13131776.pth... [2023-12-25 23:58:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000050400_12902400.pth [2023-12-25 23:58:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000050272_12869632.pth [2023-12-25 23:58:54,135][123090] Updated weights for policy 1, policy_version 51302 (0.0007) [2023-12-25 23:58:54,209][123090] Updated weights for policy 1, policy_version 51312 (0.0006) [2023-12-25 23:58:54,274][123090] Updated weights for policy 1, policy_version 51322 (0.0005) [2023-12-25 23:58:54,361][123091] Updated weights for policy 0, policy_version 51457 (0.0010) [2023-12-25 23:58:54,426][123091] Updated weights for policy 0, policy_version 51467 (0.0009) [2023-12-25 23:58:54,492][123091] Updated weights for policy 0, policy_version 51478 (0.0009) [2023-12-25 23:58:54,559][123091] Updated weights for policy 0, policy_version 51488 (0.0005) [2023-12-25 23:58:54,993][123090] Updated weights for policy 1, policy_version 51332 (0.0007) [2023-12-25 23:58:55,045][123090] Updated weights for policy 1, policy_version 51342 (0.0009) [2023-12-25 23:58:55,119][123090] Updated weights for policy 1, policy_version 51352 (0.0010) [2023-12-25 23:58:55,264][123091] Updated weights for policy 0, policy_version 51498 (0.0008) [2023-12-25 23:58:55,321][123091] Updated weights for policy 0, policy_version 51508 (0.0010) [2023-12-25 23:58:55,386][123091] Updated weights for policy 0, policy_version 51518 (0.0011) [2023-12-25 23:58:55,855][123090] Updated weights for policy 1, policy_version 51362 (0.0009) [2023-12-25 23:58:55,911][123090] Updated weights for policy 1, policy_version 51372 (0.0009) [2023-12-25 23:58:55,963][123090] Updated weights for policy 1, policy_version 51382 (0.0010) [2023-12-25 23:58:56,013][123090] Updated weights for policy 1, policy_version 51392 (0.0008) [2023-12-25 23:58:56,028][123091] Updated weights for policy 0, policy_version 51528 (0.0007) [2023-12-25 23:58:56,092][123091] Updated weights for policy 0, policy_version 51538 (0.0006) [2023-12-25 23:58:56,154][123091] Updated weights for policy 0, policy_version 51548 (0.0005) [2023-12-25 23:58:56,790][123091] Updated weights for policy 0, policy_version 51558 (0.0007) [2023-12-25 23:58:56,852][123091] Updated weights for policy 0, policy_version 51568 (0.0010) [2023-12-25 23:58:56,918][123090] Updated weights for policy 1, policy_version 51402 (0.0005) [2023-12-25 23:58:56,918][123091] Updated weights for policy 0, policy_version 51578 (0.0010) [2023-12-25 23:58:56,977][123090] Updated weights for policy 1, policy_version 51412 (0.0006) [2023-12-25 23:58:57,029][123090] Updated weights for policy 1, policy_version 51422 (0.0010) [2023-12-25 23:58:57,546][123091] Updated weights for policy 0, policy_version 51588 (0.0008) [2023-12-25 23:58:57,599][123091] Updated weights for policy 0, policy_version 51598 (0.0005) [2023-12-25 23:58:57,648][123091] Updated weights for policy 0, policy_version 51608 (0.0005) [2023-12-25 23:58:57,942][123090] Updated weights for policy 1, policy_version 51432 (0.0007) [2023-12-25 23:58:57,998][123090] Updated weights for policy 1, policy_version 51442 (0.0006) [2023-12-25 23:58:58,066][123090] Updated weights for policy 1, policy_version 51452 (0.0009) [2023-12-25 23:58:58,419][123091] Updated weights for policy 0, policy_version 51618 (0.0006) [2023-12-25 23:58:58,488][123091] Updated weights for policy 0, policy_version 51628 (0.0010) [2023-12-25 23:58:58,556][123091] Updated weights for policy 0, policy_version 51638 (0.0010) [2023-12-25 23:58:58,623][123091] Updated weights for policy 0, policy_version 51648 (0.0010) [2023-12-25 23:58:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 26394624. Throughput: 0: 9023.0, 1: 8671.6. Samples: 26388504. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:58:58,785][121949] Avg episode reward: [(0, '4076.951'), (1, '4933.158')] [2023-12-25 23:58:58,977][123090] Updated weights for policy 1, policy_version 51462 (0.0008) [2023-12-25 23:58:59,042][123090] Updated weights for policy 1, policy_version 51472 (0.0007) [2023-12-25 23:58:59,106][123090] Updated weights for policy 1, policy_version 51482 (0.0009) [2023-12-25 23:58:59,502][123091] Updated weights for policy 0, policy_version 51658 (0.0010) [2023-12-25 23:58:59,561][123091] Updated weights for policy 0, policy_version 51668 (0.0010) [2023-12-25 23:58:59,619][123091] Updated weights for policy 0, policy_version 51678 (0.0010) [2023-12-25 23:58:59,877][123090] Updated weights for policy 1, policy_version 51492 (0.0008) [2023-12-25 23:58:59,933][123090] Updated weights for policy 1, policy_version 51502 (0.0009) [2023-12-25 23:59:00,001][123090] Updated weights for policy 1, policy_version 51512 (0.0009) [2023-12-25 23:59:00,379][123091] Updated weights for policy 0, policy_version 51688 (0.0006) [2023-12-25 23:59:00,439][123091] Updated weights for policy 0, policy_version 51698 (0.0005) [2023-12-25 23:59:00,496][123091] Updated weights for policy 0, policy_version 51708 (0.0005) [2023-12-25 23:59:00,778][123090] Updated weights for policy 1, policy_version 51522 (0.0009) [2023-12-25 23:59:00,825][123090] Updated weights for policy 1, policy_version 51532 (0.0005) [2023-12-25 23:59:00,872][123090] Updated weights for policy 1, policy_version 51542 (0.0005) [2023-12-25 23:59:00,923][123090] Updated weights for policy 1, policy_version 51552 (0.0005) [2023-12-25 23:59:01,182][123091] Updated weights for policy 0, policy_version 51718 (0.0009) [2023-12-25 23:59:01,244][123091] Updated weights for policy 0, policy_version 51728 (0.0010) [2023-12-25 23:59:01,315][123091] Updated weights for policy 0, policy_version 51738 (0.0010) [2023-12-25 23:59:01,669][123090] Updated weights for policy 1, policy_version 51562 (0.0010) [2023-12-25 23:59:01,730][123090] Updated weights for policy 1, policy_version 51572 (0.0010) [2023-12-25 23:59:01,795][123090] Updated weights for policy 1, policy_version 51582 (0.0009) [2023-12-25 23:59:02,007][123091] Updated weights for policy 0, policy_version 51748 (0.0009) [2023-12-25 23:59:02,076][123091] Updated weights for policy 0, policy_version 51758 (0.0007) [2023-12-25 23:59:02,141][123091] Updated weights for policy 0, policy_version 51768 (0.0005) [2023-12-25 23:59:02,728][123090] Updated weights for policy 1, policy_version 51592 (0.0009) [2023-12-25 23:59:02,768][123091] Updated weights for policy 0, policy_version 51778 (0.0006) [2023-12-25 23:59:02,788][123090] Updated weights for policy 1, policy_version 51602 (0.0009) [2023-12-25 23:59:02,835][123091] Updated weights for policy 0, policy_version 51788 (0.0011) [2023-12-25 23:59:02,854][123090] Updated weights for policy 1, policy_version 51612 (0.0009) [2023-12-25 23:59:02,893][123091] Updated weights for policy 0, policy_version 51798 (0.0010) [2023-12-25 23:59:02,954][123091] Updated weights for policy 0, policy_version 51808 (0.0010) [2023-12-25 23:59:03,596][123091] Updated weights for policy 0, policy_version 51818 (0.0005) [2023-12-25 23:59:03,664][123091] Updated weights for policy 0, policy_version 51828 (0.0005) [2023-12-25 23:59:03,716][123091] Updated weights for policy 0, policy_version 51838 (0.0005) [2023-12-25 23:59:03,746][123090] Updated weights for policy 1, policy_version 51622 (0.0008) [2023-12-25 23:59:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 26484736. Throughput: 0: 9097.8, 1: 8628.9. Samples: 26496416. Policy #0 lag: (min: 31.0, avg: 32.0, max: 56.0) [2023-12-25 23:59:03,785][121949] Avg episode reward: [(0, '3998.607'), (1, '4837.782')] [2023-12-25 23:59:03,799][123090] Updated weights for policy 1, policy_version 51632 (0.0010) [2023-12-25 23:59:03,856][123090] Updated weights for policy 1, policy_version 51642 (0.0008) [2023-12-25 23:59:04,476][123091] Updated weights for policy 0, policy_version 51848 (0.0010) [2023-12-25 23:59:04,544][123091] Updated weights for policy 0, policy_version 51858 (0.0011) [2023-12-25 23:59:04,599][123091] Updated weights for policy 0, policy_version 51868 (0.0010) [2023-12-25 23:59:04,699][123090] Updated weights for policy 1, policy_version 51652 (0.0007) [2023-12-25 23:59:04,762][123090] Updated weights for policy 1, policy_version 51662 (0.0006) [2023-12-25 23:59:04,820][123090] Updated weights for policy 1, policy_version 51672 (0.0006) [2023-12-25 23:59:05,408][123091] Updated weights for policy 0, policy_version 51878 (0.0011) [2023-12-25 23:59:05,448][123090] Updated weights for policy 1, policy_version 51682 (0.0006) [2023-12-25 23:59:05,467][123091] Updated weights for policy 0, policy_version 51888 (0.0010) [2023-12-25 23:59:05,515][123090] Updated weights for policy 1, policy_version 51692 (0.0005) [2023-12-25 23:59:05,522][123091] Updated weights for policy 0, policy_version 51898 (0.0010) [2023-12-25 23:59:05,580][123090] Updated weights for policy 1, policy_version 51702 (0.0007) [2023-12-25 23:59:05,639][123090] Updated weights for policy 1, policy_version 51712 (0.0009) [2023-12-25 23:59:06,286][123090] Updated weights for policy 1, policy_version 51722 (0.0008) [2023-12-25 23:59:06,345][123091] Updated weights for policy 0, policy_version 51908 (0.0011) [2023-12-25 23:59:06,356][123090] Updated weights for policy 1, policy_version 51732 (0.0006) [2023-12-25 23:59:06,417][123091] Updated weights for policy 0, policy_version 51918 (0.0011) [2023-12-25 23:59:06,421][123090] Updated weights for policy 1, policy_version 51742 (0.0008) [2023-12-25 23:59:06,485][123091] Updated weights for policy 0, policy_version 51928 (0.0011) [2023-12-25 23:59:07,189][123091] Updated weights for policy 0, policy_version 51938 (0.0010) [2023-12-25 23:59:07,257][123090] Updated weights for policy 1, policy_version 51752 (0.0009) [2023-12-25 23:59:07,262][123091] Updated weights for policy 0, policy_version 51948 (0.0006) [2023-12-25 23:59:07,306][123090] Updated weights for policy 1, policy_version 51762 (0.0009) [2023-12-25 23:59:07,326][123091] Updated weights for policy 0, policy_version 51958 (0.0005) [2023-12-25 23:59:07,359][123090] Updated weights for policy 1, policy_version 51772 (0.0009) [2023-12-25 23:59:07,389][123091] Updated weights for policy 0, policy_version 51968 (0.0005) [2023-12-25 23:59:08,047][123091] Updated weights for policy 0, policy_version 51978 (0.0005) [2023-12-25 23:59:08,111][123091] Updated weights for policy 0, policy_version 51988 (0.0006) [2023-12-25 23:59:08,167][123091] Updated weights for policy 0, policy_version 51998 (0.0005) [2023-12-25 23:59:08,247][123090] Updated weights for policy 1, policy_version 51782 (0.0007) [2023-12-25 23:59:08,298][123090] Updated weights for policy 1, policy_version 51792 (0.0005) [2023-12-25 23:59:08,360][123090] Updated weights for policy 1, policy_version 51802 (0.0007) [2023-12-25 23:59:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 26574848. Throughput: 0: 9122.7, 1: 8706.2. Samples: 26550896. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:08,785][121949] Avg episode reward: [(0, '3882.717'), (1, '4843.437')] [2023-12-25 23:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000051808_13262848.pth... [2023-12-25 23:59:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000050784_13000704.pth [2023-12-25 23:59:08,827][123091] Updated weights for policy 0, policy_version 52008 (0.0006) [2023-12-25 23:59:08,896][123091] Updated weights for policy 0, policy_version 52018 (0.0005) [2023-12-25 23:59:08,957][123091] Updated weights for policy 0, policy_version 52028 (0.0005) [2023-12-25 23:59:08,984][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000052032_13320192.pth... [2023-12-25 23:59:08,989][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000050944_13041664.pth [2023-12-25 23:59:09,118][123090] Updated weights for policy 1, policy_version 51812 (0.0007) [2023-12-25 23:59:09,195][123090] Updated weights for policy 1, policy_version 51822 (0.0005) [2023-12-25 23:59:09,262][123090] Updated weights for policy 1, policy_version 51832 (0.0007) [2023-12-25 23:59:09,628][123091] Updated weights for policy 0, policy_version 52038 (0.0009) [2023-12-25 23:59:09,689][123091] Updated weights for policy 0, policy_version 52048 (0.0011) [2023-12-25 23:59:09,754][123091] Updated weights for policy 0, policy_version 52058 (0.0011) [2023-12-25 23:59:10,041][123090] Updated weights for policy 1, policy_version 51842 (0.0008) [2023-12-25 23:59:10,094][123090] Updated weights for policy 1, policy_version 51852 (0.0010) [2023-12-25 23:59:10,153][123090] Updated weights for policy 1, policy_version 51862 (0.0009) [2023-12-25 23:59:10,219][123090] Updated weights for policy 1, policy_version 51872 (0.0009) [2023-12-25 23:59:10,517][123091] Updated weights for policy 0, policy_version 52068 (0.0008) [2023-12-25 23:59:10,576][123091] Updated weights for policy 0, policy_version 52078 (0.0008) [2023-12-25 23:59:10,647][123091] Updated weights for policy 0, policy_version 52088 (0.0009) [2023-12-25 23:59:11,200][123090] Updated weights for policy 1, policy_version 51882 (0.0011) [2023-12-25 23:59:11,270][123090] Updated weights for policy 1, policy_version 51892 (0.0010) [2023-12-25 23:59:11,329][123090] Updated weights for policy 1, policy_version 51902 (0.0010) [2023-12-25 23:59:11,388][123091] Updated weights for policy 0, policy_version 52098 (0.0007) [2023-12-25 23:59:11,459][123091] Updated weights for policy 0, policy_version 52108 (0.0006) [2023-12-25 23:59:11,523][123091] Updated weights for policy 0, policy_version 52118 (0.0011) [2023-12-25 23:59:11,578][123091] Updated weights for policy 0, policy_version 52128 (0.0011) [2023-12-25 23:59:12,210][123090] Updated weights for policy 1, policy_version 51912 (0.0008) [2023-12-25 23:59:12,275][123090] Updated weights for policy 1, policy_version 51922 (0.0009) [2023-12-25 23:59:12,340][123090] Updated weights for policy 1, policy_version 51932 (0.0007) [2023-12-25 23:59:12,350][123091] Updated weights for policy 0, policy_version 52138 (0.0010) [2023-12-25 23:59:12,408][123091] Updated weights for policy 0, policy_version 52148 (0.0011) [2023-12-25 23:59:12,456][123091] Updated weights for policy 0, policy_version 52158 (0.0010) [2023-12-25 23:59:13,058][123090] Updated weights for policy 1, policy_version 51942 (0.0007) [2023-12-25 23:59:13,123][123090] Updated weights for policy 1, policy_version 51952 (0.0008) [2023-12-25 23:59:13,187][123090] Updated weights for policy 1, policy_version 51962 (0.0008) [2023-12-25 23:59:13,248][123091] Updated weights for policy 0, policy_version 52168 (0.0006) [2023-12-25 23:59:13,305][123091] Updated weights for policy 0, policy_version 52178 (0.0005) [2023-12-25 23:59:13,368][123091] Updated weights for policy 0, policy_version 52188 (0.0009) [2023-12-25 23:59:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 26664960. Throughput: 0: 9219.9, 1: 8627.8. Samples: 26658020. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:13,785][121949] Avg episode reward: [(0, '3990.713'), (1, '4748.011')] [2023-12-25 23:59:13,930][123090] Updated weights for policy 1, policy_version 51972 (0.0008) [2023-12-25 23:59:13,979][123090] Updated weights for policy 1, policy_version 51982 (0.0009) [2023-12-25 23:59:14,031][123090] Updated weights for policy 1, policy_version 51992 (0.0010) [2023-12-25 23:59:14,099][123091] Updated weights for policy 0, policy_version 52198 (0.0008) [2023-12-25 23:59:14,155][123091] Updated weights for policy 0, policy_version 52208 (0.0008) [2023-12-25 23:59:14,201][123091] Updated weights for policy 0, policy_version 52218 (0.0007) [2023-12-25 23:59:14,924][123090] Updated weights for policy 1, policy_version 52002 (0.0010) [2023-12-25 23:59:14,939][123091] Updated weights for policy 0, policy_version 52228 (0.0006) [2023-12-25 23:59:14,984][123090] Updated weights for policy 1, policy_version 52012 (0.0009) [2023-12-25 23:59:15,007][123091] Updated weights for policy 0, policy_version 52238 (0.0008) [2023-12-25 23:59:15,073][123091] Updated weights for policy 0, policy_version 52248 (0.0007) [2023-12-25 23:59:15,077][123090] Updated weights for policy 1, policy_version 52022 (0.0009) [2023-12-25 23:59:15,141][123090] Updated weights for policy 1, policy_version 52032 (0.0009) [2023-12-25 23:59:15,812][123091] Updated weights for policy 0, policy_version 52258 (0.0007) [2023-12-25 23:59:15,876][123091] Updated weights for policy 0, policy_version 52268 (0.0006) [2023-12-25 23:59:15,943][123091] Updated weights for policy 0, policy_version 52278 (0.0005) [2023-12-25 23:59:16,015][123090] Updated weights for policy 1, policy_version 52042 (0.0009) [2023-12-25 23:59:16,017][123091] Updated weights for policy 0, policy_version 52288 (0.0006) [2023-12-25 23:59:16,073][123090] Updated weights for policy 1, policy_version 52052 (0.0009) [2023-12-25 23:59:16,132][123090] Updated weights for policy 1, policy_version 52062 (0.0009) [2023-12-25 23:59:16,649][123091] Updated weights for policy 0, policy_version 52298 (0.0005) [2023-12-25 23:59:16,711][123091] Updated weights for policy 0, policy_version 52308 (0.0005) [2023-12-25 23:59:16,763][123091] Updated weights for policy 0, policy_version 52318 (0.0005) [2023-12-25 23:59:17,034][123090] Updated weights for policy 1, policy_version 52072 (0.0010) [2023-12-25 23:59:17,094][123090] Updated weights for policy 1, policy_version 52082 (0.0009) [2023-12-25 23:59:17,165][123090] Updated weights for policy 1, policy_version 52092 (0.0010) [2023-12-25 23:59:17,384][123091] Updated weights for policy 0, policy_version 52328 (0.0009) [2023-12-25 23:59:17,438][123091] Updated weights for policy 0, policy_version 52338 (0.0009) [2023-12-25 23:59:17,495][123091] Updated weights for policy 0, policy_version 52349 (0.0010) [2023-12-25 23:59:18,017][123090] Updated weights for policy 1, policy_version 52102 (0.0009) [2023-12-25 23:59:18,088][123090] Updated weights for policy 1, policy_version 52112 (0.0010) [2023-12-25 23:59:18,165][123090] Updated weights for policy 1, policy_version 52122 (0.0010) [2023-12-25 23:59:18,309][123091] Updated weights for policy 0, policy_version 52359 (0.0009) [2023-12-25 23:59:18,373][123091] Updated weights for policy 0, policy_version 52369 (0.0008) [2023-12-25 23:59:18,427][123091] Updated weights for policy 0, policy_version 52379 (0.0007) [2023-12-25 23:59:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 26755072. Throughput: 0: 9273.2, 1: 8568.7. Samples: 26766332. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:18,785][121949] Avg episode reward: [(0, '4100.058'), (1, '4703.067')] [2023-12-25 23:59:18,988][123090] Updated weights for policy 1, policy_version 52132 (0.0009) [2023-12-25 23:59:19,043][123090] Updated weights for policy 1, policy_version 52142 (0.0009) [2023-12-25 23:59:19,091][123090] Updated weights for policy 1, policy_version 52152 (0.0006) [2023-12-25 23:59:19,171][123091] Updated weights for policy 0, policy_version 52389 (0.0008) [2023-12-25 23:59:19,232][123091] Updated weights for policy 0, policy_version 52399 (0.0008) [2023-12-25 23:59:19,288][123091] Updated weights for policy 0, policy_version 52409 (0.0009) [2023-12-25 23:59:19,964][123090] Updated weights for policy 1, policy_version 52162 (0.0006) [2023-12-25 23:59:20,029][123090] Updated weights for policy 1, policy_version 52172 (0.0009) [2023-12-25 23:59:20,090][123090] Updated weights for policy 1, policy_version 52182 (0.0009) [2023-12-25 23:59:20,090][123091] Updated weights for policy 0, policy_version 52419 (0.0010) [2023-12-25 23:59:20,150][123090] Updated weights for policy 1, policy_version 52192 (0.0010) [2023-12-25 23:59:20,151][123091] Updated weights for policy 0, policy_version 52429 (0.0009) [2023-12-25 23:59:20,211][123091] Updated weights for policy 0, policy_version 52439 (0.0009) [2023-12-25 23:59:20,944][123090] Updated weights for policy 1, policy_version 52202 (0.0006) [2023-12-25 23:59:20,953][123091] Updated weights for policy 0, policy_version 52449 (0.0010) [2023-12-25 23:59:21,012][123091] Updated weights for policy 0, policy_version 52459 (0.0006) [2023-12-25 23:59:21,012][123090] Updated weights for policy 1, policy_version 52212 (0.0005) [2023-12-25 23:59:21,088][123090] Updated weights for policy 1, policy_version 52222 (0.0013) [2023-12-25 23:59:21,088][123091] Updated weights for policy 0, policy_version 52469 (0.0008) [2023-12-25 23:59:21,164][123091] Updated weights for policy 0, policy_version 52479 (0.0008) [2023-12-25 23:59:21,836][123090] Updated weights for policy 1, policy_version 52232 (0.0010) [2023-12-25 23:59:21,896][123090] Updated weights for policy 1, policy_version 52242 (0.0011) [2023-12-25 23:59:21,904][123091] Updated weights for policy 0, policy_version 52489 (0.0008) [2023-12-25 23:59:21,960][123090] Updated weights for policy 1, policy_version 52252 (0.0009) [2023-12-25 23:59:21,968][123091] Updated weights for policy 0, policy_version 52499 (0.0007) [2023-12-25 23:59:22,017][123091] Updated weights for policy 0, policy_version 52509 (0.0008) [2023-12-25 23:59:22,783][123090] Updated weights for policy 1, policy_version 52262 (0.0007) [2023-12-25 23:59:22,831][123091] Updated weights for policy 0, policy_version 52519 (0.0007) [2023-12-25 23:59:22,855][123090] Updated weights for policy 1, policy_version 52272 (0.0006) [2023-12-25 23:59:22,893][123091] Updated weights for policy 0, policy_version 52529 (0.0007) [2023-12-25 23:59:22,916][123090] Updated weights for policy 1, policy_version 52282 (0.0007) [2023-12-25 23:59:22,946][123091] Updated weights for policy 0, policy_version 52539 (0.0007) [2023-12-25 23:59:23,498][123090] Updated weights for policy 1, policy_version 52292 (0.0008) [2023-12-25 23:59:23,552][123090] Updated weights for policy 1, policy_version 52302 (0.0005) [2023-12-25 23:59:23,599][123090] Updated weights for policy 1, policy_version 52312 (0.0005) [2023-12-25 23:59:23,759][123091] Updated weights for policy 0, policy_version 52549 (0.0007) [2023-12-25 23:59:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 26845184. Throughput: 0: 9265.7, 1: 8618.3. Samples: 26820260. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:23,785][121949] Avg episode reward: [(0, '4065.995'), (1, '4843.175')] [2023-12-25 23:59:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000052320_13393920.pth... [2023-12-25 23:59:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000051296_13131776.pth [2023-12-25 23:59:23,829][123091] Updated weights for policy 0, policy_version 52559 (0.0006) [2023-12-25 23:59:23,892][123091] Updated weights for policy 0, policy_version 52569 (0.0005) [2023-12-25 23:59:23,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000052576_13459456.pth... [2023-12-25 23:59:23,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000051456_13172736.pth [2023-12-25 23:59:24,304][123090] Updated weights for policy 1, policy_version 52322 (0.0005) [2023-12-25 23:59:24,355][123090] Updated weights for policy 1, policy_version 52332 (0.0007) [2023-12-25 23:59:24,414][123090] Updated weights for policy 1, policy_version 52342 (0.0008) [2023-12-25 23:59:24,462][123090] Updated weights for policy 1, policy_version 52352 (0.0006) [2023-12-25 23:59:24,587][123091] Updated weights for policy 0, policy_version 52579 (0.0007) [2023-12-25 23:59:24,646][123091] Updated weights for policy 0, policy_version 52589 (0.0010) [2023-12-25 23:59:24,699][123091] Updated weights for policy 0, policy_version 52599 (0.0009) [2023-12-25 23:59:25,319][123090] Updated weights for policy 1, policy_version 52362 (0.0010) [2023-12-25 23:59:25,379][123090] Updated weights for policy 1, policy_version 52372 (0.0009) [2023-12-25 23:59:25,400][123091] Updated weights for policy 0, policy_version 52609 (0.0008) [2023-12-25 23:59:25,436][123090] Updated weights for policy 1, policy_version 52382 (0.0010) [2023-12-25 23:59:25,463][123091] Updated weights for policy 0, policy_version 52619 (0.0007) [2023-12-25 23:59:25,522][123091] Updated weights for policy 0, policy_version 52629 (0.0006) [2023-12-25 23:59:25,575][123091] Updated weights for policy 0, policy_version 52639 (0.0005) [2023-12-25 23:59:26,289][123090] Updated weights for policy 1, policy_version 52392 (0.0009) [2023-12-25 23:59:26,341][123090] Updated weights for policy 1, policy_version 52402 (0.0009) [2023-12-25 23:59:26,382][123091] Updated weights for policy 0, policy_version 52649 (0.0007) [2023-12-25 23:59:26,397][123090] Updated weights for policy 1, policy_version 52412 (0.0009) [2023-12-25 23:59:26,446][123091] Updated weights for policy 0, policy_version 52659 (0.0008) [2023-12-25 23:59:26,503][123091] Updated weights for policy 0, policy_version 52669 (0.0009) [2023-12-25 23:59:27,233][123090] Updated weights for policy 1, policy_version 52422 (0.0006) [2023-12-25 23:59:27,290][123090] Updated weights for policy 1, policy_version 52432 (0.0005) [2023-12-25 23:59:27,318][123091] Updated weights for policy 0, policy_version 52679 (0.0007) [2023-12-25 23:59:27,346][123090] Updated weights for policy 1, policy_version 52442 (0.0005) [2023-12-25 23:59:27,380][123091] Updated weights for policy 0, policy_version 52689 (0.0008) [2023-12-25 23:59:27,432][123091] Updated weights for policy 0, policy_version 52700 (0.0010) [2023-12-25 23:59:27,926][123090] Updated weights for policy 1, policy_version 52452 (0.0008) [2023-12-25 23:59:27,972][123090] Updated weights for policy 1, policy_version 52462 (0.0005) [2023-12-25 23:59:28,030][123090] Updated weights for policy 1, policy_version 52472 (0.0005) [2023-12-25 23:59:28,217][123091] Updated weights for policy 0, policy_version 52711 (0.0007) [2023-12-25 23:59:28,265][123091] Updated weights for policy 0, policy_version 52721 (0.0006) [2023-12-25 23:59:28,321][123091] Updated weights for policy 0, policy_version 52731 (0.0009) [2023-12-25 23:59:28,748][123090] Updated weights for policy 1, policy_version 52482 (0.0006) [2023-12-25 23:59:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 26935296. Throughput: 0: 9276.6, 1: 8719.2. Samples: 26929812. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:28,784][121949] Avg episode reward: [(0, '3935.270'), (1, '4782.704')] [2023-12-25 23:59:28,806][123090] Updated weights for policy 1, policy_version 52492 (0.0008) [2023-12-25 23:59:28,869][123090] Updated weights for policy 1, policy_version 52502 (0.0008) [2023-12-25 23:59:28,927][123090] Updated weights for policy 1, policy_version 52512 (0.0008) [2023-12-25 23:59:29,124][123091] Updated weights for policy 0, policy_version 52741 (0.0009) [2023-12-25 23:59:29,188][123091] Updated weights for policy 0, policy_version 52751 (0.0009) [2023-12-25 23:59:29,255][123091] Updated weights for policy 0, policy_version 52761 (0.0009) [2023-12-25 23:59:29,766][123090] Updated weights for policy 1, policy_version 52522 (0.0009) [2023-12-25 23:59:29,829][123090] Updated weights for policy 1, policy_version 52532 (0.0009) [2023-12-25 23:59:29,892][123090] Updated weights for policy 1, policy_version 52542 (0.0007) [2023-12-25 23:59:30,003][123091] Updated weights for policy 0, policy_version 52771 (0.0006) [2023-12-25 23:59:30,058][123091] Updated weights for policy 0, policy_version 52781 (0.0005) [2023-12-25 23:59:30,125][123091] Updated weights for policy 0, policy_version 52791 (0.0006) [2023-12-25 23:59:30,695][123090] Updated weights for policy 1, policy_version 52552 (0.0009) [2023-12-25 23:59:30,745][123090] Updated weights for policy 1, policy_version 52563 (0.0010) [2023-12-25 23:59:30,802][123090] Updated weights for policy 1, policy_version 52573 (0.0009) [2023-12-25 23:59:30,825][123091] Updated weights for policy 0, policy_version 52802 (0.0009) [2023-12-25 23:59:30,876][123091] Updated weights for policy 0, policy_version 52812 (0.0009) [2023-12-25 23:59:30,940][123091] Updated weights for policy 0, policy_version 52822 (0.0009) [2023-12-25 23:59:31,002][123091] Updated weights for policy 0, policy_version 52832 (0.0009) [2023-12-25 23:59:31,664][123090] Updated weights for policy 1, policy_version 52583 (0.0009) [2023-12-25 23:59:31,728][123090] Updated weights for policy 1, policy_version 52593 (0.0009) [2023-12-25 23:59:31,787][123090] Updated weights for policy 1, policy_version 52603 (0.0009) [2023-12-25 23:59:31,830][123091] Updated weights for policy 0, policy_version 52842 (0.0009) [2023-12-25 23:59:31,877][123091] Updated weights for policy 0, policy_version 52852 (0.0009) [2023-12-25 23:59:31,926][123091] Updated weights for policy 0, policy_version 52862 (0.0009) [2023-12-25 23:59:32,498][123090] Updated weights for policy 1, policy_version 52613 (0.0008) [2023-12-25 23:59:32,556][123090] Updated weights for policy 1, policy_version 52623 (0.0008) [2023-12-25 23:59:32,617][123090] Updated weights for policy 1, policy_version 52633 (0.0006) [2023-12-25 23:59:32,860][123091] Updated weights for policy 0, policy_version 52872 (0.0010) [2023-12-25 23:59:32,923][123091] Updated weights for policy 0, policy_version 52882 (0.0010) [2023-12-25 23:59:32,976][123091] Updated weights for policy 0, policy_version 52892 (0.0010) [2023-12-25 23:59:33,234][123090] Updated weights for policy 1, policy_version 52643 (0.0007) [2023-12-25 23:59:33,306][123090] Updated weights for policy 1, policy_version 52653 (0.0005) [2023-12-25 23:59:33,352][123090] Updated weights for policy 1, policy_version 52663 (0.0005) [2023-12-25 23:59:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 27025408. Throughput: 0: 9272.0, 1: 8763.1. Samples: 27038272. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:33,785][121949] Avg episode reward: [(0, '3884.154'), (1, '4646.264')] [2023-12-25 23:59:33,906][123091] Updated weights for policy 0, policy_version 52902 (0.0009) [2023-12-25 23:59:33,961][123091] Updated weights for policy 0, policy_version 52913 (0.0009) [2023-12-25 23:59:34,008][123091] Updated weights for policy 0, policy_version 52923 (0.0009) [2023-12-25 23:59:34,059][123090] Updated weights for policy 1, policy_version 52673 (0.0006) [2023-12-25 23:59:34,122][123090] Updated weights for policy 1, policy_version 52683 (0.0009) [2023-12-25 23:59:34,182][123090] Updated weights for policy 1, policy_version 52693 (0.0009) [2023-12-25 23:59:34,246][123090] Updated weights for policy 1, policy_version 52703 (0.0009) [2023-12-25 23:59:34,863][123091] Updated weights for policy 0, policy_version 52933 (0.0009) [2023-12-25 23:59:34,913][123091] Updated weights for policy 0, policy_version 52943 (0.0009) [2023-12-25 23:59:34,962][123091] Updated weights for policy 0, policy_version 52953 (0.0009) [2023-12-25 23:59:35,063][123090] Updated weights for policy 1, policy_version 52713 (0.0009) [2023-12-25 23:59:35,117][123090] Updated weights for policy 1, policy_version 52723 (0.0008) [2023-12-25 23:59:35,174][123090] Updated weights for policy 1, policy_version 52733 (0.0009) [2023-12-25 23:59:35,795][123091] Updated weights for policy 0, policy_version 52963 (0.0010) [2023-12-25 23:59:35,846][123091] Updated weights for policy 0, policy_version 52973 (0.0009) [2023-12-25 23:59:35,898][123091] Updated weights for policy 0, policy_version 52983 (0.0009) [2023-12-25 23:59:35,995][123090] Updated weights for policy 1, policy_version 52743 (0.0009) [2023-12-25 23:59:36,061][123090] Updated weights for policy 1, policy_version 52753 (0.0009) [2023-12-25 23:59:36,118][123090] Updated weights for policy 1, policy_version 52763 (0.0009) [2023-12-25 23:59:36,827][123091] Updated weights for policy 0, policy_version 52993 (0.0009) [2023-12-25 23:59:36,878][123090] Updated weights for policy 1, policy_version 52773 (0.0008) [2023-12-25 23:59:36,888][123091] Updated weights for policy 0, policy_version 53003 (0.0009) [2023-12-25 23:59:36,935][123090] Updated weights for policy 1, policy_version 52783 (0.0007) [2023-12-25 23:59:36,940][123091] Updated weights for policy 0, policy_version 53013 (0.0008) [2023-12-25 23:59:36,990][123090] Updated weights for policy 1, policy_version 52793 (0.0005) [2023-12-25 23:59:36,997][123091] Updated weights for policy 0, policy_version 53023 (0.0009) [2023-12-25 23:59:37,806][123090] Updated weights for policy 1, policy_version 52803 (0.0009) [2023-12-25 23:59:37,857][123091] Updated weights for policy 0, policy_version 53033 (0.0009) [2023-12-25 23:59:37,864][123090] Updated weights for policy 1, policy_version 52813 (0.0007) [2023-12-25 23:59:37,919][123090] Updated weights for policy 1, policy_version 52823 (0.0010) [2023-12-25 23:59:37,919][123091] Updated weights for policy 0, policy_version 53043 (0.0008) [2023-12-25 23:59:37,972][123091] Updated weights for policy 0, policy_version 53053 (0.0008) [2023-12-25 23:59:38,760][123090] Updated weights for policy 1, policy_version 52833 (0.0009) [2023-12-25 23:59:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 27107328. Throughput: 0: 9253.4, 1: 8819.0. Samples: 27089984. Policy #0 lag: (min: 10.0, avg: 37.1, max: 40.0) [2023-12-25 23:59:38,785][121949] Avg episode reward: [(0, '3953.213'), (1, '4656.751')] [2023-12-25 23:59:38,790][123091] Updated weights for policy 0, policy_version 53063 (0.0008) [2023-12-25 23:59:38,814][123090] Updated weights for policy 1, policy_version 52843 (0.0009) [2023-12-25 23:59:38,855][123091] Updated weights for policy 0, policy_version 53073 (0.0010) [2023-12-25 23:59:38,870][123090] Updated weights for policy 1, policy_version 52853 (0.0006) [2023-12-25 23:59:38,910][123091] Updated weights for policy 0, policy_version 53083 (0.0008) [2023-12-25 23:59:38,934][123090] Updated weights for policy 1, policy_version 52863 (0.0008) [2023-12-25 23:59:38,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000053088_13590528.pth... [2023-12-25 23:59:38,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000052032_13320192.pth [2023-12-25 23:59:38,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000052864_13533184.pth... [2023-12-25 23:59:38,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000051808_13262848.pth [2023-12-25 23:59:39,710][123090] Updated weights for policy 1, policy_version 52873 (0.0009) [2023-12-25 23:59:39,780][123090] Updated weights for policy 1, policy_version 52883 (0.0009) [2023-12-25 23:59:39,841][123091] Updated weights for policy 0, policy_version 53093 (0.0008) [2023-12-25 23:59:39,846][123090] Updated weights for policy 1, policy_version 52893 (0.0009) [2023-12-25 23:59:39,919][123091] Updated weights for policy 0, policy_version 53103 (0.0009) [2023-12-25 23:59:39,991][123091] Updated weights for policy 0, policy_version 53113 (0.0010) [2023-12-25 23:59:40,688][123090] Updated weights for policy 1, policy_version 52903 (0.0009) [2023-12-25 23:59:40,757][123090] Updated weights for policy 1, policy_version 52913 (0.0009) [2023-12-25 23:59:40,792][123091] Updated weights for policy 0, policy_version 53123 (0.0009) [2023-12-25 23:59:40,821][123090] Updated weights for policy 1, policy_version 52923 (0.0009) [2023-12-25 23:59:40,852][123091] Updated weights for policy 0, policy_version 53133 (0.0008) [2023-12-25 23:59:40,908][123091] Updated weights for policy 0, policy_version 53143 (0.0009) [2023-12-25 23:59:41,653][123090] Updated weights for policy 1, policy_version 52933 (0.0009) [2023-12-25 23:59:41,725][123090] Updated weights for policy 1, policy_version 52943 (0.0006) [2023-12-25 23:59:41,786][123090] Updated weights for policy 1, policy_version 52953 (0.0010) [2023-12-25 23:59:41,805][123091] Updated weights for policy 0, policy_version 53153 (0.0008) [2023-12-25 23:59:41,864][123091] Updated weights for policy 0, policy_version 53163 (0.0009) [2023-12-25 23:59:41,924][123091] Updated weights for policy 0, policy_version 53173 (0.0009) [2023-12-25 23:59:42,003][123091] Updated weights for policy 0, policy_version 53183 (0.0010) [2023-12-25 23:59:42,493][123090] Updated weights for policy 1, policy_version 52963 (0.0008) [2023-12-25 23:59:42,564][123090] Updated weights for policy 1, policy_version 52973 (0.0005) [2023-12-25 23:59:42,634][123090] Updated weights for policy 1, policy_version 52983 (0.0008) [2023-12-25 23:59:42,873][123091] Updated weights for policy 0, policy_version 53193 (0.0009) [2023-12-25 23:59:42,922][123091] Updated weights for policy 0, policy_version 53203 (0.0009) [2023-12-25 23:59:42,977][123091] Updated weights for policy 0, policy_version 53213 (0.0009) [2023-12-25 23:59:43,427][123090] Updated weights for policy 1, policy_version 52993 (0.0010) [2023-12-25 23:59:43,491][123090] Updated weights for policy 1, policy_version 53003 (0.0005) [2023-12-25 23:59:43,562][123090] Updated weights for policy 1, policy_version 53013 (0.0005) [2023-12-25 23:59:43,625][123090] Updated weights for policy 1, policy_version 53023 (0.0005) [2023-12-25 23:59:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 27197440. Throughput: 0: 9035.4, 1: 8829.9. Samples: 27192448. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-25 23:59:43,785][121949] Avg episode reward: [(0, '4041.275'), (1, '4794.061')] [2023-12-25 23:59:43,869][123091] Updated weights for policy 0, policy_version 53223 (0.0008) [2023-12-25 23:59:43,921][123091] Updated weights for policy 0, policy_version 53233 (0.0005) [2023-12-25 23:59:43,968][123091] Updated weights for policy 0, policy_version 53243 (0.0005) [2023-12-25 23:59:44,244][123090] Updated weights for policy 1, policy_version 53033 (0.0005) [2023-12-25 23:59:44,291][123090] Updated weights for policy 1, policy_version 53043 (0.0005) [2023-12-25 23:59:44,338][123090] Updated weights for policy 1, policy_version 53053 (0.0005) [2023-12-25 23:59:44,670][123091] Updated weights for policy 0, policy_version 53253 (0.0005) [2023-12-25 23:59:44,746][123091] Updated weights for policy 0, policy_version 53263 (0.0005) [2023-12-25 23:59:44,814][123091] Updated weights for policy 0, policy_version 53273 (0.0009) [2023-12-25 23:59:45,004][123090] Updated weights for policy 1, policy_version 53063 (0.0009) [2023-12-25 23:59:45,072][123090] Updated weights for policy 1, policy_version 53073 (0.0011) [2023-12-25 23:59:45,139][123090] Updated weights for policy 1, policy_version 53083 (0.0010) [2023-12-25 23:59:45,585][123091] Updated weights for policy 0, policy_version 53283 (0.0009) [2023-12-25 23:59:45,643][123091] Updated weights for policy 0, policy_version 53293 (0.0010) [2023-12-25 23:59:45,697][123091] Updated weights for policy 0, policy_version 53304 (0.0010) [2023-12-25 23:59:45,804][123090] Updated weights for policy 1, policy_version 53093 (0.0005) [2023-12-25 23:59:45,871][123090] Updated weights for policy 1, policy_version 53103 (0.0005) [2023-12-25 23:59:45,934][123090] Updated weights for policy 1, policy_version 53113 (0.0006) [2023-12-25 23:59:46,548][123090] Updated weights for policy 1, policy_version 53123 (0.0008) [2023-12-25 23:59:46,598][123091] Updated weights for policy 0, policy_version 53314 (0.0010) [2023-12-25 23:59:46,608][123090] Updated weights for policy 1, policy_version 53133 (0.0008) [2023-12-25 23:59:46,663][123091] Updated weights for policy 0, policy_version 53324 (0.0008) [2023-12-25 23:59:46,666][123090] Updated weights for policy 1, policy_version 53143 (0.0009) [2023-12-25 23:59:46,730][123091] Updated weights for policy 0, policy_version 53334 (0.0008) [2023-12-25 23:59:46,796][123091] Updated weights for policy 0, policy_version 53344 (0.0009) [2023-12-25 23:59:47,452][123090] Updated weights for policy 1, policy_version 53153 (0.0008) [2023-12-25 23:59:47,506][123090] Updated weights for policy 1, policy_version 53163 (0.0010) [2023-12-25 23:59:47,565][123090] Updated weights for policy 1, policy_version 53173 (0.0010) [2023-12-25 23:59:47,603][123091] Updated weights for policy 0, policy_version 53354 (0.0009) [2023-12-25 23:59:47,629][123090] Updated weights for policy 1, policy_version 53183 (0.0007) [2023-12-25 23:59:47,669][123091] Updated weights for policy 0, policy_version 53364 (0.0008) [2023-12-25 23:59:47,723][123091] Updated weights for policy 0, policy_version 53374 (0.0008) [2023-12-25 23:59:48,407][123090] Updated weights for policy 1, policy_version 53193 (0.0009) [2023-12-25 23:59:48,436][123091] Updated weights for policy 0, policy_version 53384 (0.0006) [2023-12-25 23:59:48,470][123090] Updated weights for policy 1, policy_version 53203 (0.0009) [2023-12-25 23:59:48,505][123091] Updated weights for policy 0, policy_version 53394 (0.0007) [2023-12-25 23:59:48,533][123090] Updated weights for policy 1, policy_version 53213 (0.0010) [2023-12-25 23:59:48,572][123091] Updated weights for policy 0, policy_version 53404 (0.0006) [2023-12-25 23:59:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 27295744. Throughput: 0: 8958.2, 1: 8971.9. Samples: 27303264. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-25 23:59:48,785][121949] Avg episode reward: [(0, '3884.074'), (1, '4836.892')] [2023-12-25 23:59:49,349][123091] Updated weights for policy 0, policy_version 53414 (0.0009) [2023-12-25 23:59:49,411][123090] Updated weights for policy 1, policy_version 53223 (0.0007) [2023-12-25 23:59:49,413][123091] Updated weights for policy 0, policy_version 53424 (0.0008) [2023-12-25 23:59:49,476][123091] Updated weights for policy 0, policy_version 53434 (0.0007) [2023-12-25 23:59:49,478][123090] Updated weights for policy 1, policy_version 53233 (0.0010) [2023-12-25 23:59:49,544][123090] Updated weights for policy 1, policy_version 53243 (0.0009) [2023-12-25 23:59:50,335][123091] Updated weights for policy 0, policy_version 53444 (0.0006) [2023-12-25 23:59:50,355][123090] Updated weights for policy 1, policy_version 53253 (0.0009) [2023-12-25 23:59:50,402][123091] Updated weights for policy 0, policy_version 53454 (0.0006) [2023-12-25 23:59:50,417][123090] Updated weights for policy 1, policy_version 53263 (0.0009) [2023-12-25 23:59:50,467][123091] Updated weights for policy 0, policy_version 53464 (0.0006) [2023-12-25 23:59:50,473][123090] Updated weights for policy 1, policy_version 53273 (0.0008) [2023-12-25 23:59:51,208][123091] Updated weights for policy 0, policy_version 53474 (0.0007) [2023-12-25 23:59:51,275][123091] Updated weights for policy 0, policy_version 53484 (0.0009) [2023-12-25 23:59:51,325][123091] Updated weights for policy 0, policy_version 53494 (0.0009) [2023-12-25 23:59:51,359][123090] Updated weights for policy 1, policy_version 53283 (0.0009) [2023-12-25 23:59:51,391][123091] Updated weights for policy 0, policy_version 53504 (0.0010) [2023-12-25 23:59:51,425][123090] Updated weights for policy 1, policy_version 53293 (0.0007) [2023-12-25 23:59:51,483][123090] Updated weights for policy 1, policy_version 53303 (0.0009) [2023-12-25 23:59:52,209][123091] Updated weights for policy 0, policy_version 53514 (0.0009) [2023-12-25 23:59:52,274][123091] Updated weights for policy 0, policy_version 53524 (0.0009) [2023-12-25 23:59:52,338][123091] Updated weights for policy 0, policy_version 53534 (0.0009) [2023-12-25 23:59:52,384][123090] Updated weights for policy 1, policy_version 53313 (0.0009) [2023-12-25 23:59:52,441][123090] Updated weights for policy 1, policy_version 53323 (0.0009) [2023-12-25 23:59:52,496][123090] Updated weights for policy 1, policy_version 53333 (0.0010) [2023-12-25 23:59:52,561][123090] Updated weights for policy 1, policy_version 53343 (0.0011) [2023-12-25 23:59:52,977][123091] Updated weights for policy 0, policy_version 53544 (0.0006) [2023-12-25 23:59:53,049][123091] Updated weights for policy 0, policy_version 53554 (0.0006) [2023-12-25 23:59:53,119][123091] Updated weights for policy 0, policy_version 53564 (0.0005) [2023-12-25 23:59:53,411][123090] Updated weights for policy 1, policy_version 53353 (0.0006) [2023-12-25 23:59:53,475][123090] Updated weights for policy 1, policy_version 53363 (0.0006) [2023-12-25 23:59:53,541][123090] Updated weights for policy 1, policy_version 53373 (0.0009) [2023-12-25 23:59:53,784][123091] Updated weights for policy 0, policy_version 53574 (0.0008) [2023-12-25 23:59:53,785][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.7, 300 sec: 17689.1). Total num frames: 27377664. Throughput: 0: 8945.0, 1: 8895.3. Samples: 27353716. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-25 23:59:53,786][121949] Avg episode reward: [(0, '3958.413'), (1, '4828.000')] [2023-12-25 23:59:53,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000053376_13664256.pth... [2023-12-25 23:59:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000052320_13393920.pth [2023-12-25 23:59:53,850][123091] Updated weights for policy 0, policy_version 53584 (0.0009) [2023-12-25 23:59:53,904][123091] Updated weights for policy 0, policy_version 53594 (0.0010) [2023-12-25 23:59:53,930][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000053600_13721600.pth... [2023-12-25 23:59:53,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000052576_13459456.pth [2023-12-25 23:59:54,310][123090] Updated weights for policy 1, policy_version 53383 (0.0007) [2023-12-25 23:59:54,382][123090] Updated weights for policy 1, policy_version 53393 (0.0006) [2023-12-25 23:59:54,444][123090] Updated weights for policy 1, policy_version 53403 (0.0009) [2023-12-25 23:59:54,722][123091] Updated weights for policy 0, policy_version 53604 (0.0009) [2023-12-25 23:59:54,774][123091] Updated weights for policy 0, policy_version 53614 (0.0009) [2023-12-25 23:59:54,829][123091] Updated weights for policy 0, policy_version 53624 (0.0009) [2023-12-25 23:59:55,126][123090] Updated weights for policy 1, policy_version 53413 (0.0009) [2023-12-25 23:59:55,180][123090] Updated weights for policy 1, policy_version 53423 (0.0010) [2023-12-25 23:59:55,240][123090] Updated weights for policy 1, policy_version 53434 (0.0009) [2023-12-25 23:59:55,655][123091] Updated weights for policy 0, policy_version 53634 (0.0009) [2023-12-25 23:59:55,704][123091] Updated weights for policy 0, policy_version 53645 (0.0009) [2023-12-25 23:59:55,759][123091] Updated weights for policy 0, policy_version 53656 (0.0010) [2023-12-25 23:59:56,018][123090] Updated weights for policy 1, policy_version 53444 (0.0008) [2023-12-25 23:59:56,088][123090] Updated weights for policy 1, policy_version 53454 (0.0009) [2023-12-25 23:59:56,156][123090] Updated weights for policy 1, policy_version 53464 (0.0010) [2023-12-25 23:59:56,613][123091] Updated weights for policy 0, policy_version 53666 (0.0013) [2023-12-25 23:59:56,662][123091] Updated weights for policy 0, policy_version 53676 (0.0009) [2023-12-25 23:59:56,720][123091] Updated weights for policy 0, policy_version 53686 (0.0010) [2023-12-25 23:59:56,768][123091] Updated weights for policy 0, policy_version 53696 (0.0009) [2023-12-25 23:59:56,982][123090] Updated weights for policy 1, policy_version 53474 (0.0009) [2023-12-25 23:59:57,050][123090] Updated weights for policy 1, policy_version 53484 (0.0008) [2023-12-25 23:59:57,120][123090] Updated weights for policy 1, policy_version 53494 (0.0010) [2023-12-25 23:59:57,192][123090] Updated weights for policy 1, policy_version 53504 (0.0009) [2023-12-25 23:59:57,574][123091] Updated weights for policy 0, policy_version 53706 (0.0005) [2023-12-25 23:59:57,621][123091] Updated weights for policy 0, policy_version 53716 (0.0005) [2023-12-25 23:59:57,671][123091] Updated weights for policy 0, policy_version 53726 (0.0005) [2023-12-25 23:59:58,039][123090] Updated weights for policy 1, policy_version 53514 (0.0011) [2023-12-25 23:59:58,097][123090] Updated weights for policy 1, policy_version 53524 (0.0010) [2023-12-25 23:59:58,147][123090] Updated weights for policy 1, policy_version 53534 (0.0008) [2023-12-25 23:59:58,385][123091] Updated weights for policy 0, policy_version 53736 (0.0008) [2023-12-25 23:59:58,460][123091] Updated weights for policy 0, policy_version 53747 (0.0010) [2023-12-25 23:59:58,529][123091] Updated weights for policy 0, policy_version 53757 (0.0008) [2023-12-25 23:59:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 27467776. Throughput: 0: 8893.7, 1: 8967.4. Samples: 27461768. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-25 23:59:58,785][121949] Avg episode reward: [(0, '3966.198'), (1, '4911.815')] [2023-12-25 23:59:59,074][123090] Updated weights for policy 1, policy_version 53544 (0.0008) [2023-12-25 23:59:59,147][123090] Updated weights for policy 1, policy_version 53554 (0.0008) [2023-12-25 23:59:59,223][123090] Updated weights for policy 1, policy_version 53564 (0.0008) [2023-12-25 23:59:59,487][123091] Updated weights for policy 0, policy_version 53767 (0.0008) [2023-12-25 23:59:59,542][123091] Updated weights for policy 0, policy_version 53777 (0.0008) [2023-12-25 23:59:59,599][123091] Updated weights for policy 0, policy_version 53787 (0.0009) [2023-12-25 23:59:59,955][123090] Updated weights for policy 1, policy_version 53574 (0.0009) [2023-12-26 00:00:00,009][123090] Updated weights for policy 1, policy_version 53584 (0.0010) [2023-12-26 00:00:00,083][123090] Updated weights for policy 1, policy_version 53594 (0.0008) [2023-12-26 00:00:00,472][123091] Updated weights for policy 0, policy_version 53797 (0.0009) [2023-12-26 00:00:00,543][123091] Updated weights for policy 0, policy_version 53807 (0.0010) [2023-12-26 00:00:00,609][123091] Updated weights for policy 0, policy_version 53817 (0.0009) [2023-12-26 00:00:00,962][123090] Updated weights for policy 1, policy_version 53604 (0.0010) [2023-12-26 00:00:01,033][123090] Updated weights for policy 1, policy_version 53614 (0.0011) [2023-12-26 00:00:01,104][123090] Updated weights for policy 1, policy_version 53624 (0.0012) [2023-12-26 00:00:01,509][123091] Updated weights for policy 0, policy_version 53827 (0.0010) [2023-12-26 00:00:01,577][123091] Updated weights for policy 0, policy_version 53837 (0.0010) [2023-12-26 00:00:01,651][123091] Updated weights for policy 0, policy_version 53847 (0.0008) [2023-12-26 00:00:02,002][123090] Updated weights for policy 1, policy_version 53634 (0.0010) [2023-12-26 00:00:02,069][123090] Updated weights for policy 1, policy_version 53644 (0.0007) [2023-12-26 00:00:02,132][123090] Updated weights for policy 1, policy_version 53654 (0.0006) [2023-12-26 00:00:02,192][123090] Updated weights for policy 1, policy_version 53664 (0.0006) [2023-12-26 00:00:02,420][123091] Updated weights for policy 0, policy_version 53857 (0.0009) [2023-12-26 00:00:02,500][123091] Updated weights for policy 0, policy_version 53867 (0.0008) [2023-12-26 00:00:02,569][123091] Updated weights for policy 0, policy_version 53877 (0.0008) [2023-12-26 00:00:02,641][123091] Updated weights for policy 0, policy_version 53887 (0.0008) [2023-12-26 00:00:03,135][123090] Updated weights for policy 1, policy_version 53674 (0.0008) [2023-12-26 00:00:03,205][123090] Updated weights for policy 1, policy_version 53684 (0.0008) [2023-12-26 00:00:03,274][123090] Updated weights for policy 1, policy_version 53694 (0.0008) [2023-12-26 00:00:03,564][123091] Updated weights for policy 0, policy_version 53897 (0.0009) [2023-12-26 00:00:03,628][123091] Updated weights for policy 0, policy_version 53907 (0.0010) [2023-12-26 00:00:03,699][123091] Updated weights for policy 0, policy_version 53917 (0.0010) [2023-12-26 00:00:03,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 27549696. Throughput: 0: 8689.8, 1: 8924.2. Samples: 27558964. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-26 00:00:03,785][121949] Avg episode reward: [(0, '3849.949'), (1, '4956.997')] [2023-12-26 00:00:03,786][123008] Saving new best policy, reward=4956.997! [2023-12-26 00:00:04,088][123090] Updated weights for policy 1, policy_version 53704 (0.0009) [2023-12-26 00:00:04,164][123090] Updated weights for policy 1, policy_version 53714 (0.0009) [2023-12-26 00:00:04,245][123090] Updated weights for policy 1, policy_version 53724 (0.0010) [2023-12-26 00:00:04,593][123091] Updated weights for policy 0, policy_version 53927 (0.0010) [2023-12-26 00:00:04,657][123091] Updated weights for policy 0, policy_version 53937 (0.0010) [2023-12-26 00:00:04,730][123091] Updated weights for policy 0, policy_version 53947 (0.0009) [2023-12-26 00:00:05,115][123090] Updated weights for policy 1, policy_version 53734 (0.0009) [2023-12-26 00:00:05,182][123090] Updated weights for policy 1, policy_version 53744 (0.0010) [2023-12-26 00:00:05,246][123090] Updated weights for policy 1, policy_version 53754 (0.0009) [2023-12-26 00:00:05,598][123091] Updated weights for policy 0, policy_version 53957 (0.0010) [2023-12-26 00:00:05,662][123091] Updated weights for policy 0, policy_version 53967 (0.0010) [2023-12-26 00:00:05,728][123091] Updated weights for policy 0, policy_version 53977 (0.0010) [2023-12-26 00:00:06,094][123090] Updated weights for policy 1, policy_version 53764 (0.0010) [2023-12-26 00:00:06,171][123090] Updated weights for policy 1, policy_version 53774 (0.0010) [2023-12-26 00:00:06,246][123090] Updated weights for policy 1, policy_version 53784 (0.0009) [2023-12-26 00:00:06,729][123091] Updated weights for policy 0, policy_version 53987 (0.0009) [2023-12-26 00:00:06,799][123091] Updated weights for policy 0, policy_version 53997 (0.0009) [2023-12-26 00:00:06,870][123091] Updated weights for policy 0, policy_version 54007 (0.0011) [2023-12-26 00:00:07,080][123090] Updated weights for policy 1, policy_version 53794 (0.0010) [2023-12-26 00:00:07,148][123090] Updated weights for policy 1, policy_version 53804 (0.0010) [2023-12-26 00:00:07,214][123090] Updated weights for policy 1, policy_version 53814 (0.0010) [2023-12-26 00:00:07,276][123090] Updated weights for policy 1, policy_version 53824 (0.0010) [2023-12-26 00:00:07,708][123091] Updated weights for policy 0, policy_version 54017 (0.0010) [2023-12-26 00:00:07,784][123091] Updated weights for policy 0, policy_version 54027 (0.0010) [2023-12-26 00:00:07,854][123091] Updated weights for policy 0, policy_version 54037 (0.0010) [2023-12-26 00:00:07,927][123091] Updated weights for policy 0, policy_version 54047 (0.0010) [2023-12-26 00:00:08,153][123090] Updated weights for policy 1, policy_version 53834 (0.0010) [2023-12-26 00:00:08,225][123090] Updated weights for policy 1, policy_version 53844 (0.0010) [2023-12-26 00:00:08,297][123090] Updated weights for policy 1, policy_version 53854 (0.0009) [2023-12-26 00:00:08,781][123091] Updated weights for policy 0, policy_version 54057 (0.0009) [2023-12-26 00:00:08,784][121949] Fps is (10 sec: 15564.7, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 27623424. Throughput: 0: 8612.6, 1: 8864.1. Samples: 27606712. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-26 00:00:08,785][121949] Avg episode reward: [(0, '3963.675'), (1, '5093.668')] [2023-12-26 00:00:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000053856_13787136.pth... [2023-12-26 00:00:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000052864_13533184.pth [2023-12-26 00:00:08,799][123008] Saving new best policy, reward=5093.668! [2023-12-26 00:00:08,862][123091] Updated weights for policy 0, policy_version 54067 (0.0009) [2023-12-26 00:00:08,936][123091] Updated weights for policy 0, policy_version 54077 (0.0009) [2023-12-26 00:00:08,958][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000054080_13844480.pth... [2023-12-26 00:00:08,963][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000053088_13590528.pth [2023-12-26 00:00:09,243][123090] Updated weights for policy 1, policy_version 53864 (0.0011) [2023-12-26 00:00:09,321][123090] Updated weights for policy 1, policy_version 53874 (0.0011) [2023-12-26 00:00:09,397][123090] Updated weights for policy 1, policy_version 53884 (0.0010) [2023-12-26 00:00:09,862][123091] Updated weights for policy 0, policy_version 54087 (0.0009) [2023-12-26 00:00:09,943][123091] Updated weights for policy 0, policy_version 54097 (0.0009) [2023-12-26 00:00:10,024][123091] Updated weights for policy 0, policy_version 54107 (0.0008) [2023-12-26 00:00:10,312][123090] Updated weights for policy 1, policy_version 53894 (0.0009) [2023-12-26 00:00:10,383][123090] Updated weights for policy 1, policy_version 53904 (0.0009) [2023-12-26 00:00:10,460][123090] Updated weights for policy 1, policy_version 53914 (0.0007) [2023-12-26 00:00:10,873][123091] Updated weights for policy 0, policy_version 54117 (0.0007) [2023-12-26 00:00:10,933][123091] Updated weights for policy 0, policy_version 54127 (0.0006) [2023-12-26 00:00:10,989][123091] Updated weights for policy 0, policy_version 54137 (0.0007) [2023-12-26 00:00:11,323][123090] Updated weights for policy 1, policy_version 53924 (0.0008) [2023-12-26 00:00:11,413][123090] Updated weights for policy 1, policy_version 53934 (0.0009) [2023-12-26 00:00:11,491][123090] Updated weights for policy 1, policy_version 53944 (0.0010) [2023-12-26 00:00:11,973][123091] Updated weights for policy 0, policy_version 54147 (0.0010) [2023-12-26 00:00:12,049][123091] Updated weights for policy 0, policy_version 54157 (0.0011) [2023-12-26 00:00:12,121][123091] Updated weights for policy 0, policy_version 54167 (0.0010) [2023-12-26 00:00:12,451][123090] Updated weights for policy 1, policy_version 53954 (0.0009) [2023-12-26 00:00:12,531][123090] Updated weights for policy 1, policy_version 53964 (0.0010) [2023-12-26 00:00:12,603][123090] Updated weights for policy 1, policy_version 53974 (0.0009) [2023-12-26 00:00:12,677][123090] Updated weights for policy 1, policy_version 53984 (0.0011) [2023-12-26 00:00:12,960][123091] Updated weights for policy 0, policy_version 54177 (0.0010) [2023-12-26 00:00:13,035][123091] Updated weights for policy 0, policy_version 54187 (0.0008) [2023-12-26 00:00:13,110][123091] Updated weights for policy 0, policy_version 54197 (0.0009) [2023-12-26 00:00:13,184][123091] Updated weights for policy 0, policy_version 54207 (0.0009) [2023-12-26 00:00:13,504][123090] Updated weights for policy 1, policy_version 53994 (0.0006) [2023-12-26 00:00:13,576][123090] Updated weights for policy 1, policy_version 54004 (0.0008) [2023-12-26 00:00:13,643][123090] Updated weights for policy 1, policy_version 54014 (0.0008) [2023-12-26 00:00:13,784][121949] Fps is (10 sec: 15564.9, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 27705344. Throughput: 0: 8445.8, 1: 8662.7. Samples: 27699692. Policy #0 lag: (min: 10.0, avg: 17.5, max: 42.0) [2023-12-26 00:00:13,784][121949] Avg episode reward: [(0, '4020.510'), (1, '5108.098')] [2023-12-26 00:00:13,785][123008] Saving new best policy, reward=5108.098! [2023-12-26 00:00:14,093][123091] Updated weights for policy 0, policy_version 54217 (0.0010) [2023-12-26 00:00:14,161][123091] Updated weights for policy 0, policy_version 54227 (0.0010) [2023-12-26 00:00:14,234][123091] Updated weights for policy 0, policy_version 54237 (0.0010) [2023-12-26 00:00:14,423][123090] Updated weights for policy 1, policy_version 54024 (0.0009) [2023-12-26 00:00:14,489][123090] Updated weights for policy 1, policy_version 54034 (0.0010) [2023-12-26 00:00:14,556][123090] Updated weights for policy 1, policy_version 54044 (0.0010) [2023-12-26 00:00:15,105][123091] Updated weights for policy 0, policy_version 54247 (0.0010) [2023-12-26 00:00:15,170][123091] Updated weights for policy 0, policy_version 54257 (0.0009) [2023-12-26 00:00:15,237][123091] Updated weights for policy 0, policy_version 54267 (0.0009) [2023-12-26 00:00:15,430][123090] Updated weights for policy 1, policy_version 54054 (0.0007) [2023-12-26 00:00:15,500][123090] Updated weights for policy 1, policy_version 54064 (0.0009) [2023-12-26 00:00:15,560][123090] Updated weights for policy 1, policy_version 54074 (0.0009) [2023-12-26 00:00:16,117][123091] Updated weights for policy 0, policy_version 54277 (0.0010) [2023-12-26 00:00:16,174][123091] Updated weights for policy 0, policy_version 54287 (0.0010) [2023-12-26 00:00:16,244][123091] Updated weights for policy 0, policy_version 54297 (0.0009) [2023-12-26 00:00:16,380][123090] Updated weights for policy 1, policy_version 54084 (0.0010) [2023-12-26 00:00:16,447][123090] Updated weights for policy 1, policy_version 54094 (0.0010) [2023-12-26 00:00:16,515][123090] Updated weights for policy 1, policy_version 54104 (0.0009) [2023-12-26 00:00:17,103][123091] Updated weights for policy 0, policy_version 54307 (0.0009) [2023-12-26 00:00:17,167][123091] Updated weights for policy 0, policy_version 54317 (0.0009) [2023-12-26 00:00:17,232][123091] Updated weights for policy 0, policy_version 54327 (0.0009) [2023-12-26 00:00:17,385][123090] Updated weights for policy 1, policy_version 54114 (0.0010) [2023-12-26 00:00:17,451][123090] Updated weights for policy 1, policy_version 54124 (0.0009) [2023-12-26 00:00:17,514][123090] Updated weights for policy 1, policy_version 54134 (0.0009) [2023-12-26 00:00:17,573][123090] Updated weights for policy 1, policy_version 54144 (0.0009) [2023-12-26 00:00:18,065][123091] Updated weights for policy 0, policy_version 54337 (0.0010) [2023-12-26 00:00:18,129][123091] Updated weights for policy 0, policy_version 54347 (0.0006) [2023-12-26 00:00:18,196][123091] Updated weights for policy 0, policy_version 54357 (0.0005) [2023-12-26 00:00:18,270][123091] Updated weights for policy 0, policy_version 54367 (0.0006) [2023-12-26 00:00:18,465][123090] Updated weights for policy 1, policy_version 54154 (0.0010) [2023-12-26 00:00:18,535][123090] Updated weights for policy 1, policy_version 54164 (0.0010) [2023-12-26 00:00:18,606][123090] Updated weights for policy 1, policy_version 54174 (0.0009) [2023-12-26 00:00:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 27787264. Throughput: 0: 8374.9, 1: 8508.7. Samples: 27798036. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:18,785][121949] Avg episode reward: [(0, '4108.815'), (1, '5037.693')] [2023-12-26 00:00:19,034][123091] Updated weights for policy 0, policy_version 54377 (0.0007) [2023-12-26 00:00:19,084][123091] Updated weights for policy 0, policy_version 54387 (0.0006) [2023-12-26 00:00:19,141][123091] Updated weights for policy 0, policy_version 54397 (0.0009) [2023-12-26 00:00:19,476][123090] Updated weights for policy 1, policy_version 54184 (0.0009) [2023-12-26 00:00:19,552][123090] Updated weights for policy 1, policy_version 54194 (0.0010) [2023-12-26 00:00:19,628][123090] Updated weights for policy 1, policy_version 54204 (0.0010) [2023-12-26 00:00:20,018][123091] Updated weights for policy 0, policy_version 54407 (0.0010) [2023-12-26 00:00:20,083][123091] Updated weights for policy 0, policy_version 54417 (0.0010) [2023-12-26 00:00:20,155][123091] Updated weights for policy 0, policy_version 54427 (0.0009) [2023-12-26 00:00:20,513][123090] Updated weights for policy 1, policy_version 54214 (0.0010) [2023-12-26 00:00:20,584][123090] Updated weights for policy 1, policy_version 54224 (0.0009) [2023-12-26 00:00:20,664][123090] Updated weights for policy 1, policy_version 54234 (0.0008) [2023-12-26 00:00:21,106][123091] Updated weights for policy 0, policy_version 54437 (0.0010) [2023-12-26 00:00:21,183][123091] Updated weights for policy 0, policy_version 54447 (0.0010) [2023-12-26 00:00:21,256][123091] Updated weights for policy 0, policy_version 54457 (0.0010) [2023-12-26 00:00:21,595][123090] Updated weights for policy 1, policy_version 54244 (0.0008) [2023-12-26 00:00:21,666][123090] Updated weights for policy 1, policy_version 54254 (0.0008) [2023-12-26 00:00:21,743][123090] Updated weights for policy 1, policy_version 54264 (0.0008) [2023-12-26 00:00:22,166][123091] Updated weights for policy 0, policy_version 54467 (0.0009) [2023-12-26 00:00:22,221][123091] Updated weights for policy 0, policy_version 54477 (0.0010) [2023-12-26 00:00:22,290][123091] Updated weights for policy 0, policy_version 54487 (0.0010) [2023-12-26 00:00:22,560][123090] Updated weights for policy 1, policy_version 54274 (0.0008) [2023-12-26 00:00:22,618][123090] Updated weights for policy 1, policy_version 54284 (0.0010) [2023-12-26 00:00:22,689][123090] Updated weights for policy 1, policy_version 54294 (0.0010) [2023-12-26 00:00:22,753][123090] Updated weights for policy 1, policy_version 54304 (0.0010) [2023-12-26 00:00:23,184][123091] Updated weights for policy 0, policy_version 54497 (0.0010) [2023-12-26 00:00:23,256][123091] Updated weights for policy 0, policy_version 54507 (0.0010) [2023-12-26 00:00:23,315][123091] Updated weights for policy 0, policy_version 54517 (0.0010) [2023-12-26 00:00:23,375][123091] Updated weights for policy 0, policy_version 54527 (0.0010) [2023-12-26 00:00:23,604][123090] Updated weights for policy 1, policy_version 54314 (0.0009) [2023-12-26 00:00:23,675][123090] Updated weights for policy 1, policy_version 54324 (0.0009) [2023-12-26 00:00:23,744][123090] Updated weights for policy 1, policy_version 54334 (0.0009) [2023-12-26 00:00:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17066.7, 300 sec: 17578.1). Total num frames: 27869184. Throughput: 0: 8333.2, 1: 8435.0. Samples: 27844552. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:23,785][121949] Avg episode reward: [(0, '4134.774'), (1, '4931.874')] [2023-12-26 00:00:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000054528_13959168.pth... [2023-12-26 00:00:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000054336_13910016.pth... [2023-12-26 00:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000053600_13721600.pth [2023-12-26 00:00:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000053376_13664256.pth [2023-12-26 00:00:24,193][123091] Updated weights for policy 0, policy_version 54537 (0.0009) [2023-12-26 00:00:24,267][123091] Updated weights for policy 0, policy_version 54547 (0.0010) [2023-12-26 00:00:24,336][123091] Updated weights for policy 0, policy_version 54557 (0.0010) [2023-12-26 00:00:24,580][123090] Updated weights for policy 1, policy_version 54344 (0.0010) [2023-12-26 00:00:24,655][123090] Updated weights for policy 1, policy_version 54354 (0.0010) [2023-12-26 00:00:24,716][123090] Updated weights for policy 1, policy_version 54364 (0.0006) [2023-12-26 00:00:25,161][123091] Updated weights for policy 0, policy_version 54567 (0.0007) [2023-12-26 00:00:25,235][123091] Updated weights for policy 0, policy_version 54577 (0.0008) [2023-12-26 00:00:25,306][123091] Updated weights for policy 0, policy_version 54587 (0.0009) [2023-12-26 00:00:25,571][123090] Updated weights for policy 1, policy_version 54374 (0.0009) [2023-12-26 00:00:25,641][123090] Updated weights for policy 1, policy_version 54384 (0.0009) [2023-12-26 00:00:25,716][123090] Updated weights for policy 1, policy_version 54394 (0.0011) [2023-12-26 00:00:26,048][123091] Updated weights for policy 0, policy_version 54597 (0.0010) [2023-12-26 00:00:26,117][123091] Updated weights for policy 0, policy_version 54607 (0.0011) [2023-12-26 00:00:26,193][123091] Updated weights for policy 0, policy_version 54617 (0.0011) [2023-12-26 00:00:26,611][123090] Updated weights for policy 1, policy_version 54404 (0.0008) [2023-12-26 00:00:26,685][123090] Updated weights for policy 1, policy_version 54414 (0.0008) [2023-12-26 00:00:26,746][123090] Updated weights for policy 1, policy_version 54424 (0.0008) [2023-12-26 00:00:26,984][123091] Updated weights for policy 0, policy_version 54627 (0.0009) [2023-12-26 00:00:27,051][123091] Updated weights for policy 0, policy_version 54637 (0.0010) [2023-12-26 00:00:27,119][123091] Updated weights for policy 0, policy_version 54647 (0.0009) [2023-12-26 00:00:27,578][123090] Updated weights for policy 1, policy_version 54434 (0.0009) [2023-12-26 00:00:27,651][123090] Updated weights for policy 1, policy_version 54444 (0.0010) [2023-12-26 00:00:27,723][123090] Updated weights for policy 1, policy_version 54454 (0.0008) [2023-12-26 00:00:27,796][123090] Updated weights for policy 1, policy_version 54464 (0.0008) [2023-12-26 00:00:27,946][123091] Updated weights for policy 0, policy_version 54657 (0.0009) [2023-12-26 00:00:28,012][123091] Updated weights for policy 0, policy_version 54667 (0.0007) [2023-12-26 00:00:28,068][123091] Updated weights for policy 0, policy_version 54677 (0.0007) [2023-12-26 00:00:28,139][123091] Updated weights for policy 0, policy_version 54687 (0.0007) [2023-12-26 00:00:28,599][123090] Updated weights for policy 1, policy_version 54474 (0.0009) [2023-12-26 00:00:28,667][123090] Updated weights for policy 1, policy_version 54484 (0.0009) [2023-12-26 00:00:28,746][123090] Updated weights for policy 1, policy_version 54494 (0.0010) [2023-12-26 00:00:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16930.1, 300 sec: 17550.3). Total num frames: 27951104. Throughput: 0: 8358.7, 1: 8351.1. Samples: 27944384. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:28,785][121949] Avg episode reward: [(0, '4058.176'), (1, '5033.702')] [2023-12-26 00:00:28,961][123091] Updated weights for policy 0, policy_version 54697 (0.0010) [2023-12-26 00:00:29,027][123091] Updated weights for policy 0, policy_version 54707 (0.0010) [2023-12-26 00:00:29,098][123091] Updated weights for policy 0, policy_version 54717 (0.0010) [2023-12-26 00:00:29,648][123090] Updated weights for policy 1, policy_version 54504 (0.0011) [2023-12-26 00:00:29,718][123090] Updated weights for policy 1, policy_version 54514 (0.0007) [2023-12-26 00:00:29,789][123090] Updated weights for policy 1, policy_version 54524 (0.0007) [2023-12-26 00:00:30,013][123091] Updated weights for policy 0, policy_version 54727 (0.0009) [2023-12-26 00:00:30,084][123091] Updated weights for policy 0, policy_version 54737 (0.0010) [2023-12-26 00:00:30,156][123091] Updated weights for policy 0, policy_version 54747 (0.0010) [2023-12-26 00:00:30,594][123090] Updated weights for policy 1, policy_version 54534 (0.0007) [2023-12-26 00:00:30,667][123090] Updated weights for policy 1, policy_version 54544 (0.0006) [2023-12-26 00:00:30,728][123090] Updated weights for policy 1, policy_version 54554 (0.0006) [2023-12-26 00:00:30,969][123091] Updated weights for policy 0, policy_version 54757 (0.0008) [2023-12-26 00:00:31,030][123091] Updated weights for policy 0, policy_version 54767 (0.0007) [2023-12-26 00:00:31,096][123091] Updated weights for policy 0, policy_version 54777 (0.0009) [2023-12-26 00:00:31,518][123090] Updated weights for policy 1, policy_version 54564 (0.0008) [2023-12-26 00:00:31,584][123090] Updated weights for policy 1, policy_version 54574 (0.0010) [2023-12-26 00:00:31,666][123090] Updated weights for policy 1, policy_version 54584 (0.0011) [2023-12-26 00:00:31,955][123091] Updated weights for policy 0, policy_version 54787 (0.0010) [2023-12-26 00:00:32,026][123091] Updated weights for policy 0, policy_version 54797 (0.0009) [2023-12-26 00:00:32,097][123091] Updated weights for policy 0, policy_version 54807 (0.0010) [2023-12-26 00:00:32,505][123090] Updated weights for policy 1, policy_version 54594 (0.0009) [2023-12-26 00:00:32,571][123090] Updated weights for policy 1, policy_version 54604 (0.0011) [2023-12-26 00:00:32,636][123090] Updated weights for policy 1, policy_version 54614 (0.0011) [2023-12-26 00:00:32,701][123090] Updated weights for policy 1, policy_version 54624 (0.0011) [2023-12-26 00:00:32,963][123091] Updated weights for policy 0, policy_version 54817 (0.0009) [2023-12-26 00:00:33,030][123091] Updated weights for policy 0, policy_version 54827 (0.0007) [2023-12-26 00:00:33,100][123091] Updated weights for policy 0, policy_version 54837 (0.0008) [2023-12-26 00:00:33,158][123091] Updated weights for policy 0, policy_version 54847 (0.0009) [2023-12-26 00:00:33,521][123090] Updated weights for policy 1, policy_version 54634 (0.0010) [2023-12-26 00:00:33,572][123090] Updated weights for policy 1, policy_version 54644 (0.0010) [2023-12-26 00:00:33,625][123090] Updated weights for policy 1, policy_version 54654 (0.0010) [2023-12-26 00:00:33,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 17522.6). Total num frames: 28033024. Throughput: 0: 8266.9, 1: 8187.4. Samples: 28043708. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:33,784][121949] Avg episode reward: [(0, '4050.374'), (1, '5085.558')] [2023-12-26 00:00:33,945][123091] Updated weights for policy 0, policy_version 54857 (0.0010) [2023-12-26 00:00:34,000][123091] Updated weights for policy 0, policy_version 54867 (0.0010) [2023-12-26 00:00:34,056][123091] Updated weights for policy 0, policy_version 54878 (0.0011) [2023-12-26 00:00:34,455][123090] Updated weights for policy 1, policy_version 54664 (0.0011) [2023-12-26 00:00:34,524][123090] Updated weights for policy 1, policy_version 54674 (0.0011) [2023-12-26 00:00:34,596][123090] Updated weights for policy 1, policy_version 54684 (0.0011) [2023-12-26 00:00:34,965][123091] Updated weights for policy 0, policy_version 54888 (0.0010) [2023-12-26 00:00:35,029][123091] Updated weights for policy 0, policy_version 54898 (0.0009) [2023-12-26 00:00:35,095][123091] Updated weights for policy 0, policy_version 54908 (0.0008) [2023-12-26 00:00:35,415][123090] Updated weights for policy 1, policy_version 54694 (0.0011) [2023-12-26 00:00:35,486][123090] Updated weights for policy 1, policy_version 54704 (0.0011) [2023-12-26 00:00:35,542][123090] Updated weights for policy 1, policy_version 54714 (0.0010) [2023-12-26 00:00:35,915][123091] Updated weights for policy 0, policy_version 54918 (0.0007) [2023-12-26 00:00:35,981][123091] Updated weights for policy 0, policy_version 54928 (0.0005) [2023-12-26 00:00:36,043][123091] Updated weights for policy 0, policy_version 54938 (0.0008) [2023-12-26 00:00:36,348][123090] Updated weights for policy 1, policy_version 54724 (0.0011) [2023-12-26 00:00:36,417][123090] Updated weights for policy 1, policy_version 54734 (0.0011) [2023-12-26 00:00:36,485][123090] Updated weights for policy 1, policy_version 54744 (0.0011) [2023-12-26 00:00:36,903][123091] Updated weights for policy 0, policy_version 54948 (0.0010) [2023-12-26 00:00:36,968][123091] Updated weights for policy 0, policy_version 54958 (0.0010) [2023-12-26 00:00:37,037][123091] Updated weights for policy 0, policy_version 54968 (0.0010) [2023-12-26 00:00:37,300][123090] Updated weights for policy 1, policy_version 54754 (0.0011) [2023-12-26 00:00:37,365][123090] Updated weights for policy 1, policy_version 54764 (0.0009) [2023-12-26 00:00:37,430][123090] Updated weights for policy 1, policy_version 54774 (0.0010) [2023-12-26 00:00:37,495][123090] Updated weights for policy 1, policy_version 54784 (0.0010) [2023-12-26 00:00:37,865][123091] Updated weights for policy 0, policy_version 54978 (0.0009) [2023-12-26 00:00:37,920][123091] Updated weights for policy 0, policy_version 54988 (0.0007) [2023-12-26 00:00:37,971][123091] Updated weights for policy 0, policy_version 54998 (0.0005) [2023-12-26 00:00:38,029][123091] Updated weights for policy 0, policy_version 55008 (0.0006) [2023-12-26 00:00:38,393][123090] Updated weights for policy 1, policy_version 54794 (0.0008) [2023-12-26 00:00:38,461][123090] Updated weights for policy 1, policy_version 54804 (0.0007) [2023-12-26 00:00:38,529][123090] Updated weights for policy 1, policy_version 54814 (0.0008) [2023-12-26 00:00:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 17522.5). Total num frames: 28114944. Throughput: 0: 8249.2, 1: 8202.0. Samples: 28094016. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:38,785][121949] Avg episode reward: [(0, '4164.545'), (1, '5182.778')] [2023-12-26 00:00:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000054816_14032896.pth... [2023-12-26 00:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055008_14082048.pth... [2023-12-26 00:00:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000053856_13787136.pth [2023-12-26 00:00:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000054080_13844480.pth [2023-12-26 00:00:38,795][123008] Saving new best policy, reward=5182.778! [2023-12-26 00:00:38,888][123091] Updated weights for policy 0, policy_version 55018 (0.0010) [2023-12-26 00:00:38,958][123091] Updated weights for policy 0, policy_version 55028 (0.0008) [2023-12-26 00:00:39,019][123091] Updated weights for policy 0, policy_version 55038 (0.0009) [2023-12-26 00:00:39,432][123090] Updated weights for policy 1, policy_version 54824 (0.0009) [2023-12-26 00:00:39,498][123090] Updated weights for policy 1, policy_version 54834 (0.0009) [2023-12-26 00:00:39,574][123090] Updated weights for policy 1, policy_version 54844 (0.0009) [2023-12-26 00:00:39,898][123091] Updated weights for policy 0, policy_version 55048 (0.0010) [2023-12-26 00:00:39,978][123091] Updated weights for policy 0, policy_version 55058 (0.0010) [2023-12-26 00:00:40,050][123091] Updated weights for policy 0, policy_version 55068 (0.0009) [2023-12-26 00:00:40,450][123090] Updated weights for policy 1, policy_version 54854 (0.0010) [2023-12-26 00:00:40,507][123090] Updated weights for policy 1, policy_version 54864 (0.0011) [2023-12-26 00:00:40,576][123090] Updated weights for policy 1, policy_version 54874 (0.0011) [2023-12-26 00:00:40,905][123091] Updated weights for policy 0, policy_version 55078 (0.0010) [2023-12-26 00:00:40,968][123091] Updated weights for policy 0, policy_version 55088 (0.0009) [2023-12-26 00:00:41,038][123091] Updated weights for policy 0, policy_version 55098 (0.0009) [2023-12-26 00:00:41,397][123090] Updated weights for policy 1, policy_version 54884 (0.0008) [2023-12-26 00:00:41,470][123090] Updated weights for policy 1, policy_version 54894 (0.0009) [2023-12-26 00:00:41,545][123090] Updated weights for policy 1, policy_version 54904 (0.0009) [2023-12-26 00:00:41,974][123091] Updated weights for policy 0, policy_version 55108 (0.0010) [2023-12-26 00:00:42,047][123091] Updated weights for policy 0, policy_version 55118 (0.0010) [2023-12-26 00:00:42,119][123091] Updated weights for policy 0, policy_version 55128 (0.0010) [2023-12-26 00:00:42,419][123090] Updated weights for policy 1, policy_version 54914 (0.0009) [2023-12-26 00:00:42,483][123090] Updated weights for policy 1, policy_version 54924 (0.0008) [2023-12-26 00:00:42,545][123090] Updated weights for policy 1, policy_version 54934 (0.0008) [2023-12-26 00:00:42,606][123090] Updated weights for policy 1, policy_version 54944 (0.0008) [2023-12-26 00:00:43,039][123091] Updated weights for policy 0, policy_version 55138 (0.0010) [2023-12-26 00:00:43,102][123091] Updated weights for policy 0, policy_version 55148 (0.0010) [2023-12-26 00:00:43,168][123091] Updated weights for policy 0, policy_version 55158 (0.0010) [2023-12-26 00:00:43,224][123091] Updated weights for policy 0, policy_version 55168 (0.0010) [2023-12-26 00:00:43,442][123090] Updated weights for policy 1, policy_version 54954 (0.0011) [2023-12-26 00:00:43,508][123090] Updated weights for policy 1, policy_version 54964 (0.0010) [2023-12-26 00:00:43,568][123090] Updated weights for policy 1, policy_version 54974 (0.0010) [2023-12-26 00:00:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 17467.0). Total num frames: 28196864. Throughput: 0: 8097.4, 1: 8098.7. Samples: 28190596. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:43,785][121949] Avg episode reward: [(0, '4159.693'), (1, '5186.219')] [2023-12-26 00:00:43,785][123008] Saving new best policy, reward=5186.219! [2023-12-26 00:00:44,046][123091] Updated weights for policy 0, policy_version 55178 (0.0007) [2023-12-26 00:00:44,102][123091] Updated weights for policy 0, policy_version 55188 (0.0006) [2023-12-26 00:00:44,162][123091] Updated weights for policy 0, policy_version 55198 (0.0007) [2023-12-26 00:00:44,376][123090] Updated weights for policy 1, policy_version 54984 (0.0007) [2023-12-26 00:00:44,440][123090] Updated weights for policy 1, policy_version 54994 (0.0006) [2023-12-26 00:00:44,509][123090] Updated weights for policy 1, policy_version 55004 (0.0009) [2023-12-26 00:00:45,065][123091] Updated weights for policy 0, policy_version 55208 (0.0008) [2023-12-26 00:00:45,134][123091] Updated weights for policy 0, policy_version 55218 (0.0010) [2023-12-26 00:00:45,205][123091] Updated weights for policy 0, policy_version 55228 (0.0010) [2023-12-26 00:00:45,364][123090] Updated weights for policy 1, policy_version 55014 (0.0010) [2023-12-26 00:00:45,427][123090] Updated weights for policy 1, policy_version 55024 (0.0009) [2023-12-26 00:00:45,495][123090] Updated weights for policy 1, policy_version 55034 (0.0009) [2023-12-26 00:00:46,042][123091] Updated weights for policy 0, policy_version 55238 (0.0010) [2023-12-26 00:00:46,111][123091] Updated weights for policy 0, policy_version 55248 (0.0009) [2023-12-26 00:00:46,180][123091] Updated weights for policy 0, policy_version 55258 (0.0007) [2023-12-26 00:00:46,353][123090] Updated weights for policy 1, policy_version 55044 (0.0010) [2023-12-26 00:00:46,422][123090] Updated weights for policy 1, policy_version 55054 (0.0009) [2023-12-26 00:00:46,479][123090] Updated weights for policy 1, policy_version 55064 (0.0009) [2023-12-26 00:00:47,000][123091] Updated weights for policy 0, policy_version 55268 (0.0007) [2023-12-26 00:00:47,063][123091] Updated weights for policy 0, policy_version 55278 (0.0010) [2023-12-26 00:00:47,128][123091] Updated weights for policy 0, policy_version 55288 (0.0010) [2023-12-26 00:00:47,307][123090] Updated weights for policy 1, policy_version 55074 (0.0008) [2023-12-26 00:00:47,374][123090] Updated weights for policy 1, policy_version 55084 (0.0010) [2023-12-26 00:00:47,438][123090] Updated weights for policy 1, policy_version 55094 (0.0009) [2023-12-26 00:00:47,505][123090] Updated weights for policy 1, policy_version 55104 (0.0009) [2023-12-26 00:00:47,939][123091] Updated weights for policy 0, policy_version 55298 (0.0009) [2023-12-26 00:00:48,015][123091] Updated weights for policy 0, policy_version 55308 (0.0010) [2023-12-26 00:00:48,092][123091] Updated weights for policy 0, policy_version 55318 (0.0010) [2023-12-26 00:00:48,157][123091] Updated weights for policy 0, policy_version 55328 (0.0010) [2023-12-26 00:00:48,419][123090] Updated weights for policy 1, policy_version 55114 (0.0010) [2023-12-26 00:00:48,484][123090] Updated weights for policy 1, policy_version 55124 (0.0010) [2023-12-26 00:00:48,557][123090] Updated weights for policy 1, policy_version 55134 (0.0009) [2023-12-26 00:00:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16384.0, 300 sec: 17467.0). Total num frames: 28278784. Throughput: 0: 8131.7, 1: 8111.7. Samples: 28289912. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 00:00:48,785][121949] Avg episode reward: [(0, '4243.548'), (1, '5111.157')] [2023-12-26 00:00:49,013][123091] Updated weights for policy 0, policy_version 55338 (0.0010) [2023-12-26 00:00:49,085][123091] Updated weights for policy 0, policy_version 55348 (0.0010) [2023-12-26 00:00:49,153][123091] Updated weights for policy 0, policy_version 55358 (0.0010) [2023-12-26 00:00:49,432][123090] Updated weights for policy 1, policy_version 55144 (0.0010) [2023-12-26 00:00:49,497][123090] Updated weights for policy 1, policy_version 55154 (0.0009) [2023-12-26 00:00:49,559][123090] Updated weights for policy 1, policy_version 55164 (0.0009) [2023-12-26 00:00:50,050][123091] Updated weights for policy 0, policy_version 55368 (0.0008) [2023-12-26 00:00:50,126][123091] Updated weights for policy 0, policy_version 55378 (0.0008) [2023-12-26 00:00:50,199][123091] Updated weights for policy 0, policy_version 55388 (0.0008) [2023-12-26 00:00:50,491][123090] Updated weights for policy 1, policy_version 55174 (0.0007) [2023-12-26 00:00:50,552][123090] Updated weights for policy 1, policy_version 55184 (0.0008) [2023-12-26 00:00:50,631][123090] Updated weights for policy 1, policy_version 55194 (0.0009) [2023-12-26 00:00:51,070][123091] Updated weights for policy 0, policy_version 55398 (0.0009) [2023-12-26 00:00:51,148][123091] Updated weights for policy 0, policy_version 55408 (0.0009) [2023-12-26 00:00:51,221][123091] Updated weights for policy 0, policy_version 55418 (0.0009) [2023-12-26 00:00:51,587][123090] Updated weights for policy 1, policy_version 55204 (0.0010) [2023-12-26 00:00:51,687][123090] Updated weights for policy 1, policy_version 55214 (0.0010) [2023-12-26 00:00:51,763][123090] Updated weights for policy 1, policy_version 55224 (0.0009) [2023-12-26 00:00:52,174][123091] Updated weights for policy 0, policy_version 55428 (0.0010) [2023-12-26 00:00:52,243][123091] Updated weights for policy 0, policy_version 55438 (0.0010) [2023-12-26 00:00:52,321][123091] Updated weights for policy 0, policy_version 55448 (0.0009) [2023-12-26 00:00:52,631][123090] Updated weights for policy 1, policy_version 55234 (0.0008) [2023-12-26 00:00:52,698][123090] Updated weights for policy 1, policy_version 55244 (0.0011) [2023-12-26 00:00:52,769][123090] Updated weights for policy 1, policy_version 55254 (0.0010) [2023-12-26 00:00:52,844][123090] Updated weights for policy 1, policy_version 55264 (0.0010) [2023-12-26 00:00:53,208][123091] Updated weights for policy 0, policy_version 55458 (0.0009) [2023-12-26 00:00:53,269][123091] Updated weights for policy 0, policy_version 55468 (0.0010) [2023-12-26 00:00:53,333][123091] Updated weights for policy 0, policy_version 55478 (0.0010) [2023-12-26 00:00:53,391][123091] Updated weights for policy 0, policy_version 55488 (0.0009) [2023-12-26 00:00:53,703][123090] Updated weights for policy 1, policy_version 55274 (0.0009) [2023-12-26 00:00:53,766][123090] Updated weights for policy 1, policy_version 55284 (0.0009) [2023-12-26 00:00:53,784][121949] Fps is (10 sec: 15564.6, 60 sec: 16247.6, 300 sec: 17411.5). Total num frames: 28352512. Throughput: 0: 8115.8, 1: 8088.9. Samples: 28335924. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:00:53,785][121949] Avg episode reward: [(0, '4270.063'), (1, '5021.847')] [2023-12-26 00:00:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055488_14204928.pth... [2023-12-26 00:00:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000054528_13959168.pth [2023-12-26 00:00:53,828][123090] Updated weights for policy 1, policy_version 55294 (0.0010) [2023-12-26 00:00:53,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000055296_14155776.pth... [2023-12-26 00:00:53,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000054336_13910016.pth [2023-12-26 00:00:54,265][123091] Updated weights for policy 0, policy_version 55498 (0.0010) [2023-12-26 00:00:54,319][123091] Updated weights for policy 0, policy_version 55508 (0.0009) [2023-12-26 00:00:54,375][123091] Updated weights for policy 0, policy_version 55518 (0.0010) [2023-12-26 00:00:54,690][123090] Updated weights for policy 1, policy_version 55304 (0.0010) [2023-12-26 00:00:54,754][123090] Updated weights for policy 1, policy_version 55314 (0.0010) [2023-12-26 00:00:54,820][123090] Updated weights for policy 1, policy_version 55324 (0.0009) [2023-12-26 00:00:55,251][123091] Updated weights for policy 0, policy_version 55528 (0.0009) [2023-12-26 00:00:55,308][123091] Updated weights for policy 0, policy_version 55538 (0.0009) [2023-12-26 00:00:55,373][123091] Updated weights for policy 0, policy_version 55548 (0.0009) [2023-12-26 00:00:55,646][123090] Updated weights for policy 1, policy_version 55334 (0.0011) [2023-12-26 00:00:55,721][123090] Updated weights for policy 1, policy_version 55344 (0.0010) [2023-12-26 00:00:55,791][123090] Updated weights for policy 1, policy_version 55354 (0.0006) [2023-12-26 00:00:56,251][123091] Updated weights for policy 0, policy_version 55558 (0.0009) [2023-12-26 00:00:56,321][123091] Updated weights for policy 0, policy_version 55568 (0.0009) [2023-12-26 00:00:56,384][123091] Updated weights for policy 0, policy_version 55578 (0.0009) [2023-12-26 00:00:56,631][123090] Updated weights for policy 1, policy_version 55364 (0.0008) [2023-12-26 00:00:56,687][123090] Updated weights for policy 1, policy_version 55374 (0.0011) [2023-12-26 00:00:56,753][123090] Updated weights for policy 1, policy_version 55384 (0.0011) [2023-12-26 00:00:57,250][123091] Updated weights for policy 0, policy_version 55588 (0.0009) [2023-12-26 00:00:57,319][123091] Updated weights for policy 0, policy_version 55598 (0.0010) [2023-12-26 00:00:57,380][123091] Updated weights for policy 0, policy_version 55608 (0.0010) [2023-12-26 00:00:57,577][123090] Updated weights for policy 1, policy_version 55394 (0.0009) [2023-12-26 00:00:57,646][123090] Updated weights for policy 1, policy_version 55404 (0.0010) [2023-12-26 00:00:57,703][123090] Updated weights for policy 1, policy_version 55414 (0.0010) [2023-12-26 00:00:57,773][123090] Updated weights for policy 1, policy_version 55424 (0.0009) [2023-12-26 00:00:58,247][123091] Updated weights for policy 0, policy_version 55618 (0.0010) [2023-12-26 00:00:58,333][123091] Updated weights for policy 0, policy_version 55628 (0.0010) [2023-12-26 00:00:58,407][123091] Updated weights for policy 0, policy_version 55638 (0.0009) [2023-12-26 00:00:58,485][123091] Updated weights for policy 0, policy_version 55648 (0.0008) [2023-12-26 00:00:58,755][123090] Updated weights for policy 1, policy_version 55434 (0.0008) [2023-12-26 00:00:58,784][121949] Fps is (10 sec: 15564.8, 60 sec: 16110.9, 300 sec: 17383.7). Total num frames: 28434432. Throughput: 0: 8143.0, 1: 8160.4. Samples: 28433344. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:00:58,785][121949] Avg episode reward: [(0, '4165.729'), (1, '4987.334')] [2023-12-26 00:00:58,835][123090] Updated weights for policy 1, policy_version 55444 (0.0008) [2023-12-26 00:00:58,910][123090] Updated weights for policy 1, policy_version 55454 (0.0007) [2023-12-26 00:00:59,591][123091] Updated weights for policy 0, policy_version 55658 (0.0009) [2023-12-26 00:00:59,659][123091] Updated weights for policy 0, policy_version 55668 (0.0010) [2023-12-26 00:00:59,729][123091] Updated weights for policy 0, policy_version 55678 (0.0008) [2023-12-26 00:01:00,066][123090] Updated weights for policy 1, policy_version 55464 (0.0009) [2023-12-26 00:01:00,138][123090] Updated weights for policy 1, policy_version 55474 (0.0009) [2023-12-26 00:01:00,214][123090] Updated weights for policy 1, policy_version 55484 (0.0009) [2023-12-26 00:01:00,665][123091] Updated weights for policy 0, policy_version 55688 (0.0009) [2023-12-26 00:01:00,735][123091] Updated weights for policy 0, policy_version 55698 (0.0007) [2023-12-26 00:01:00,805][123091] Updated weights for policy 0, policy_version 55708 (0.0007) [2023-12-26 00:01:01,119][123090] Updated weights for policy 1, policy_version 55494 (0.0010) [2023-12-26 00:01:01,190][123090] Updated weights for policy 1, policy_version 55504 (0.0010) [2023-12-26 00:01:01,272][123090] Updated weights for policy 1, policy_version 55514 (0.0010) [2023-12-26 00:01:01,582][123091] Updated weights for policy 0, policy_version 55718 (0.0007) [2023-12-26 00:01:01,663][123091] Updated weights for policy 0, policy_version 55728 (0.0007) [2023-12-26 00:01:01,743][123091] Updated weights for policy 0, policy_version 55738 (0.0009) [2023-12-26 00:01:02,160][123090] Updated weights for policy 1, policy_version 55524 (0.0009) [2023-12-26 00:01:02,229][123090] Updated weights for policy 1, policy_version 55534 (0.0009) [2023-12-26 00:01:02,302][123090] Updated weights for policy 1, policy_version 55544 (0.0010) [2023-12-26 00:01:02,567][123091] Updated weights for policy 0, policy_version 55748 (0.0010) [2023-12-26 00:01:02,638][123091] Updated weights for policy 0, policy_version 55758 (0.0010) [2023-12-26 00:01:02,706][123091] Updated weights for policy 0, policy_version 55768 (0.0009) [2023-12-26 00:01:03,151][123090] Updated weights for policy 1, policy_version 55554 (0.0010) [2023-12-26 00:01:03,204][123090] Updated weights for policy 1, policy_version 55564 (0.0010) [2023-12-26 00:01:03,273][123090] Updated weights for policy 1, policy_version 55574 (0.0010) [2023-12-26 00:01:03,343][123090] Updated weights for policy 1, policy_version 55584 (0.0010) [2023-12-26 00:01:03,528][123091] Updated weights for policy 0, policy_version 55778 (0.0009) [2023-12-26 00:01:03,596][123091] Updated weights for policy 0, policy_version 55788 (0.0011) [2023-12-26 00:01:03,666][123091] Updated weights for policy 0, policy_version 55798 (0.0011) [2023-12-26 00:01:03,740][123091] Updated weights for policy 0, policy_version 55808 (0.0011) [2023-12-26 00:01:03,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16110.9, 300 sec: 17383.7). Total num frames: 28516352. Throughput: 0: 8089.7, 1: 8055.8. Samples: 28524584. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:01:03,785][121949] Avg episode reward: [(0, '4105.140'), (1, '4954.814')] [2023-12-26 00:01:04,268][123090] Updated weights for policy 1, policy_version 55594 (0.0008) [2023-12-26 00:01:04,338][123090] Updated weights for policy 1, policy_version 55604 (0.0009) [2023-12-26 00:01:04,410][123090] Updated weights for policy 1, policy_version 55614 (0.0009) [2023-12-26 00:01:04,611][123091] Updated weights for policy 0, policy_version 55818 (0.0011) [2023-12-26 00:01:04,676][123091] Updated weights for policy 0, policy_version 55828 (0.0011) [2023-12-26 00:01:04,746][123091] Updated weights for policy 0, policy_version 55838 (0.0011) [2023-12-26 00:01:05,258][123090] Updated weights for policy 1, policy_version 55624 (0.0009) [2023-12-26 00:01:05,321][123090] Updated weights for policy 1, policy_version 55634 (0.0009) [2023-12-26 00:01:05,387][123090] Updated weights for policy 1, policy_version 55644 (0.0009) [2023-12-26 00:01:05,611][123091] Updated weights for policy 0, policy_version 55848 (0.0009) [2023-12-26 00:01:05,675][123091] Updated weights for policy 0, policy_version 55858 (0.0006) [2023-12-26 00:01:05,734][123091] Updated weights for policy 0, policy_version 55868 (0.0007) [2023-12-26 00:01:06,281][123090] Updated weights for policy 1, policy_version 55654 (0.0010) [2023-12-26 00:01:06,345][123090] Updated weights for policy 1, policy_version 55664 (0.0010) [2023-12-26 00:01:06,418][123090] Updated weights for policy 1, policy_version 55674 (0.0009) [2023-12-26 00:01:06,557][123091] Updated weights for policy 0, policy_version 55878 (0.0010) [2023-12-26 00:01:06,627][123091] Updated weights for policy 0, policy_version 55888 (0.0008) [2023-12-26 00:01:06,696][123091] Updated weights for policy 0, policy_version 55898 (0.0006) [2023-12-26 00:01:07,282][123090] Updated weights for policy 1, policy_version 55684 (0.0011) [2023-12-26 00:01:07,353][123090] Updated weights for policy 1, policy_version 55694 (0.0011) [2023-12-26 00:01:07,419][123090] Updated weights for policy 1, policy_version 55704 (0.0011) [2023-12-26 00:01:07,502][123091] Updated weights for policy 0, policy_version 55908 (0.0007) [2023-12-26 00:01:07,566][123091] Updated weights for policy 0, policy_version 55918 (0.0009) [2023-12-26 00:01:07,636][123091] Updated weights for policy 0, policy_version 55928 (0.0008) [2023-12-26 00:01:08,286][123090] Updated weights for policy 1, policy_version 55714 (0.0011) [2023-12-26 00:01:08,360][123090] Updated weights for policy 1, policy_version 55724 (0.0011) [2023-12-26 00:01:08,421][123091] Updated weights for policy 0, policy_version 55938 (0.0009) [2023-12-26 00:01:08,433][123090] Updated weights for policy 1, policy_version 55734 (0.0010) [2023-12-26 00:01:08,494][123091] Updated weights for policy 0, policy_version 55948 (0.0008) [2023-12-26 00:01:08,499][123090] Updated weights for policy 1, policy_version 55744 (0.0008) [2023-12-26 00:01:08,561][123091] Updated weights for policy 0, policy_version 55958 (0.0011) [2023-12-26 00:01:08,627][123091] Updated weights for policy 0, policy_version 55968 (0.0011) [2023-12-26 00:01:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16247.5, 300 sec: 17383.7). Total num frames: 28598272. Throughput: 0: 8122.6, 1: 8065.9. Samples: 28573036. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:01:08,785][121949] Avg episode reward: [(0, '3977.162'), (1, '4998.461')] [2023-12-26 00:01:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055968_14327808.pth... [2023-12-26 00:01:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000055744_14270464.pth... [2023-12-26 00:01:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055008_14082048.pth [2023-12-26 00:01:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000054816_14032896.pth [2023-12-26 00:01:09,404][123090] Updated weights for policy 1, policy_version 55754 (0.0009) [2023-12-26 00:01:09,454][123091] Updated weights for policy 0, policy_version 55978 (0.0011) [2023-12-26 00:01:09,482][123090] Updated weights for policy 1, policy_version 55764 (0.0008) [2023-12-26 00:01:09,526][123091] Updated weights for policy 0, policy_version 55988 (0.0010) [2023-12-26 00:01:09,553][123090] Updated weights for policy 1, policy_version 55774 (0.0009) [2023-12-26 00:01:09,595][123091] Updated weights for policy 0, policy_version 55998 (0.0011) [2023-12-26 00:01:10,429][123090] Updated weights for policy 1, policy_version 55784 (0.0008) [2023-12-26 00:01:10,477][123091] Updated weights for policy 0, policy_version 56008 (0.0010) [2023-12-26 00:01:10,492][123090] Updated weights for policy 1, policy_version 55794 (0.0006) [2023-12-26 00:01:10,547][123091] Updated weights for policy 0, policy_version 56018 (0.0010) [2023-12-26 00:01:10,559][123090] Updated weights for policy 1, policy_version 55804 (0.0008) [2023-12-26 00:01:10,607][123091] Updated weights for policy 0, policy_version 56028 (0.0008) [2023-12-26 00:01:11,346][123090] Updated weights for policy 1, policy_version 55814 (0.0009) [2023-12-26 00:01:11,443][123090] Updated weights for policy 1, policy_version 55824 (0.0009) [2023-12-26 00:01:11,522][123090] Updated weights for policy 1, policy_version 55834 (0.0009) [2023-12-26 00:01:11,557][123091] Updated weights for policy 0, policy_version 56038 (0.0008) [2023-12-26 00:01:11,632][123091] Updated weights for policy 0, policy_version 56048 (0.0009) [2023-12-26 00:01:11,709][123091] Updated weights for policy 0, policy_version 56058 (0.0009) [2023-12-26 00:01:12,423][123090] Updated weights for policy 1, policy_version 55844 (0.0010) [2023-12-26 00:01:12,477][123090] Updated weights for policy 1, policy_version 55854 (0.0010) [2023-12-26 00:01:12,533][123090] Updated weights for policy 1, policy_version 55864 (0.0009) [2023-12-26 00:01:12,575][123091] Updated weights for policy 0, policy_version 56068 (0.0010) [2023-12-26 00:01:12,649][123091] Updated weights for policy 0, policy_version 56078 (0.0008) [2023-12-26 00:01:12,722][123091] Updated weights for policy 0, policy_version 56088 (0.0010) [2023-12-26 00:01:13,421][123090] Updated weights for policy 1, policy_version 55874 (0.0010) [2023-12-26 00:01:13,478][123090] Updated weights for policy 1, policy_version 55884 (0.0010) [2023-12-26 00:01:13,546][123090] Updated weights for policy 1, policy_version 55894 (0.0009) [2023-12-26 00:01:13,556][123091] Updated weights for policy 0, policy_version 56098 (0.0010) [2023-12-26 00:01:13,608][123090] Updated weights for policy 1, policy_version 55904 (0.0007) [2023-12-26 00:01:13,615][123091] Updated weights for policy 0, policy_version 56108 (0.0009) [2023-12-26 00:01:13,679][123091] Updated weights for policy 0, policy_version 56118 (0.0010) [2023-12-26 00:01:13,743][123091] Updated weights for policy 0, policy_version 56128 (0.0009) [2023-12-26 00:01:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16247.5, 300 sec: 17355.9). Total num frames: 28680192. Throughput: 0: 8074.9, 1: 8035.7. Samples: 28669356. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:01:13,785][121949] Avg episode reward: [(0, '3865.314'), (1, '5019.324')] [2023-12-26 00:01:14,480][123090] Updated weights for policy 1, policy_version 55914 (0.0009) [2023-12-26 00:01:14,546][123090] Updated weights for policy 1, policy_version 55924 (0.0009) [2023-12-26 00:01:14,612][123090] Updated weights for policy 1, policy_version 55934 (0.0008) [2023-12-26 00:01:14,616][123091] Updated weights for policy 0, policy_version 56138 (0.0009) [2023-12-26 00:01:14,684][123091] Updated weights for policy 0, policy_version 56148 (0.0010) [2023-12-26 00:01:14,750][123091] Updated weights for policy 0, policy_version 56158 (0.0009) [2023-12-26 00:01:15,516][123090] Updated weights for policy 1, policy_version 55944 (0.0009) [2023-12-26 00:01:15,569][123091] Updated weights for policy 0, policy_version 56168 (0.0008) [2023-12-26 00:01:15,580][123090] Updated weights for policy 1, policy_version 55954 (0.0009) [2023-12-26 00:01:15,633][123091] Updated weights for policy 0, policy_version 56178 (0.0008) [2023-12-26 00:01:15,659][123090] Updated weights for policy 1, policy_version 55964 (0.0008) [2023-12-26 00:01:15,705][123091] Updated weights for policy 0, policy_version 56188 (0.0008) [2023-12-26 00:01:16,518][123091] Updated weights for policy 0, policy_version 56198 (0.0009) [2023-12-26 00:01:16,541][123090] Updated weights for policy 1, policy_version 55974 (0.0010) [2023-12-26 00:01:16,583][123091] Updated weights for policy 0, policy_version 56208 (0.0009) [2023-12-26 00:01:16,609][123090] Updated weights for policy 1, policy_version 55984 (0.0006) [2023-12-26 00:01:16,644][123091] Updated weights for policy 0, policy_version 56218 (0.0008) [2023-12-26 00:01:16,685][123090] Updated weights for policy 1, policy_version 55994 (0.0006) [2023-12-26 00:01:17,397][123090] Updated weights for policy 1, policy_version 56004 (0.0006) [2023-12-26 00:01:17,466][123090] Updated weights for policy 1, policy_version 56014 (0.0008) [2023-12-26 00:01:17,530][123090] Updated weights for policy 1, policy_version 56024 (0.0009) [2023-12-26 00:01:17,563][123091] Updated weights for policy 0, policy_version 56228 (0.0008) [2023-12-26 00:01:17,621][123091] Updated weights for policy 0, policy_version 56238 (0.0009) [2023-12-26 00:01:17,689][123091] Updated weights for policy 0, policy_version 56248 (0.0010) [2023-12-26 00:01:18,308][123090] Updated weights for policy 1, policy_version 56034 (0.0010) [2023-12-26 00:01:18,395][123090] Updated weights for policy 1, policy_version 56044 (0.0009) [2023-12-26 00:01:18,463][123090] Updated weights for policy 1, policy_version 56054 (0.0010) [2023-12-26 00:01:18,534][123090] Updated weights for policy 1, policy_version 56064 (0.0009) [2023-12-26 00:01:18,591][123091] Updated weights for policy 0, policy_version 56258 (0.0010) [2023-12-26 00:01:18,650][123091] Updated weights for policy 0, policy_version 56268 (0.0010) [2023-12-26 00:01:18,711][123091] Updated weights for policy 0, policy_version 56278 (0.0010) [2023-12-26 00:01:18,782][123091] Updated weights for policy 0, policy_version 56288 (0.0010) [2023-12-26 00:01:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16247.4, 300 sec: 17355.9). Total num frames: 28762112. Throughput: 0: 8061.8, 1: 8034.6. Samples: 28768052. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:01:18,785][121949] Avg episode reward: [(0, '3866.471'), (1, '5066.457')] [2023-12-26 00:01:19,398][123090] Updated weights for policy 1, policy_version 56074 (0.0009) [2023-12-26 00:01:19,467][123090] Updated weights for policy 1, policy_version 56084 (0.0006) [2023-12-26 00:01:19,549][123090] Updated weights for policy 1, policy_version 56094 (0.0008) [2023-12-26 00:01:19,733][123091] Updated weights for policy 0, policy_version 56298 (0.0010) [2023-12-26 00:01:19,804][123091] Updated weights for policy 0, policy_version 56308 (0.0010) [2023-12-26 00:01:19,881][123091] Updated weights for policy 0, policy_version 56318 (0.0008) [2023-12-26 00:01:20,431][123090] Updated weights for policy 1, policy_version 56104 (0.0008) [2023-12-26 00:01:20,482][123090] Updated weights for policy 1, policy_version 56114 (0.0009) [2023-12-26 00:01:20,542][123090] Updated weights for policy 1, policy_version 56124 (0.0009) [2023-12-26 00:01:20,706][123091] Updated weights for policy 0, policy_version 56328 (0.0009) [2023-12-26 00:01:20,778][123091] Updated weights for policy 0, policy_version 56338 (0.0009) [2023-12-26 00:01:20,846][123091] Updated weights for policy 0, policy_version 56348 (0.0009) [2023-12-26 00:01:21,472][123090] Updated weights for policy 1, policy_version 56134 (0.0010) [2023-12-26 00:01:21,535][123090] Updated weights for policy 1, policy_version 56144 (0.0009) [2023-12-26 00:01:21,615][123090] Updated weights for policy 1, policy_version 56154 (0.0009) [2023-12-26 00:01:21,774][123091] Updated weights for policy 0, policy_version 56358 (0.0009) [2023-12-26 00:01:21,843][123091] Updated weights for policy 0, policy_version 56368 (0.0009) [2023-12-26 00:01:21,910][123091] Updated weights for policy 0, policy_version 56378 (0.0009) [2023-12-26 00:01:22,551][123090] Updated weights for policy 1, policy_version 56164 (0.0011) [2023-12-26 00:01:22,623][123090] Updated weights for policy 1, policy_version 56174 (0.0010) [2023-12-26 00:01:22,690][123090] Updated weights for policy 1, policy_version 56184 (0.0010) [2023-12-26 00:01:22,821][123091] Updated weights for policy 0, policy_version 56388 (0.0010) [2023-12-26 00:01:22,889][123091] Updated weights for policy 0, policy_version 56398 (0.0010) [2023-12-26 00:01:22,954][123091] Updated weights for policy 0, policy_version 56408 (0.0010) [2023-12-26 00:01:23,582][123090] Updated weights for policy 1, policy_version 56194 (0.0009) [2023-12-26 00:01:23,651][123090] Updated weights for policy 1, policy_version 56204 (0.0010) [2023-12-26 00:01:23,717][123090] Updated weights for policy 1, policy_version 56214 (0.0010) [2023-12-26 00:01:23,762][123091] Updated weights for policy 0, policy_version 56418 (0.0009) [2023-12-26 00:01:23,784][121949] Fps is (10 sec: 14745.4, 60 sec: 15974.4, 300 sec: 17272.6). Total num frames: 28827648. Throughput: 0: 8035.6, 1: 7992.6. Samples: 28815288. Policy #0 lag: (min: 31.0, avg: 40.4, max: 63.0) [2023-12-26 00:01:23,785][121949] Avg episode reward: [(0, '3934.962'), (1, '5048.488')] [2023-12-26 00:01:23,787][123090] Updated weights for policy 1, policy_version 56224 (0.0008) [2023-12-26 00:01:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000056224_14393344.pth... [2023-12-26 00:01:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000055296_14155776.pth [2023-12-26 00:01:23,829][123091] Updated weights for policy 0, policy_version 56428 (0.0009) [2023-12-26 00:01:23,893][123091] Updated weights for policy 0, policy_version 56438 (0.0008) [2023-12-26 00:01:23,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000056448_14450688.pth... [2023-12-26 00:01:23,964][123091] Updated weights for policy 0, policy_version 56448 (0.0006) [2023-12-26 00:01:23,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055488_14204928.pth [2023-12-26 00:01:24,637][123090] Updated weights for policy 1, policy_version 56234 (0.0009) [2023-12-26 00:01:24,703][123090] Updated weights for policy 1, policy_version 56244 (0.0009) [2023-12-26 00:01:24,765][123090] Updated weights for policy 1, policy_version 56254 (0.0008) [2023-12-26 00:01:24,771][123091] Updated weights for policy 0, policy_version 56458 (0.0009) [2023-12-26 00:01:24,834][123091] Updated weights for policy 0, policy_version 56468 (0.0009) [2023-12-26 00:01:24,900][123091] Updated weights for policy 0, policy_version 56478 (0.0009) [2023-12-26 00:01:25,591][123090] Updated weights for policy 1, policy_version 56264 (0.0009) [2023-12-26 00:01:25,657][123090] Updated weights for policy 1, policy_version 56274 (0.0010) [2023-12-26 00:01:25,726][123090] Updated weights for policy 1, policy_version 56284 (0.0010) [2023-12-26 00:01:25,755][123091] Updated weights for policy 0, policy_version 56488 (0.0007) [2023-12-26 00:01:25,814][123091] Updated weights for policy 0, policy_version 56498 (0.0010) [2023-12-26 00:01:25,883][123091] Updated weights for policy 0, policy_version 56508 (0.0010) [2023-12-26 00:01:26,580][123090] Updated weights for policy 1, policy_version 56294 (0.0010) [2023-12-26 00:01:26,649][123090] Updated weights for policy 1, policy_version 56304 (0.0010) [2023-12-26 00:01:26,716][123090] Updated weights for policy 1, policy_version 56314 (0.0009) [2023-12-26 00:01:26,727][123091] Updated weights for policy 0, policy_version 56518 (0.0009) [2023-12-26 00:01:26,790][123091] Updated weights for policy 0, policy_version 56528 (0.0009) [2023-12-26 00:01:26,854][123091] Updated weights for policy 0, policy_version 56538 (0.0010) [2023-12-26 00:01:27,546][123090] Updated weights for policy 1, policy_version 56324 (0.0008) [2023-12-26 00:01:27,609][123090] Updated weights for policy 1, policy_version 56334 (0.0010) [2023-12-26 00:01:27,667][123090] Updated weights for policy 1, policy_version 56344 (0.0010) [2023-12-26 00:01:27,704][123091] Updated weights for policy 0, policy_version 56548 (0.0009) [2023-12-26 00:01:27,763][123091] Updated weights for policy 0, policy_version 56558 (0.0006) [2023-12-26 00:01:27,818][123091] Updated weights for policy 0, policy_version 56568 (0.0006) [2023-12-26 00:01:28,589][123090] Updated weights for policy 1, policy_version 56354 (0.0009) [2023-12-26 00:01:28,611][123091] Updated weights for policy 0, policy_version 56578 (0.0007) [2023-12-26 00:01:28,663][123090] Updated weights for policy 1, policy_version 56364 (0.0008) [2023-12-26 00:01:28,682][123091] Updated weights for policy 0, policy_version 56588 (0.0010) [2023-12-26 00:01:28,733][123090] Updated weights for policy 1, policy_version 56374 (0.0007) [2023-12-26 00:01:28,749][123091] Updated weights for policy 0, policy_version 56598 (0.0009) [2023-12-26 00:01:28,784][121949] Fps is (10 sec: 14745.7, 60 sec: 15974.4, 300 sec: 17244.9). Total num frames: 28909568. Throughput: 0: 8069.1, 1: 7997.8. Samples: 28913604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:28,785][121949] Avg episode reward: [(0, '4058.138'), (1, '5050.710')] [2023-12-26 00:01:28,792][123090] Updated weights for policy 1, policy_version 56384 (0.0009) [2023-12-26 00:01:28,813][123091] Updated weights for policy 0, policy_version 56608 (0.0008) [2023-12-26 00:01:29,624][123091] Updated weights for policy 0, policy_version 56618 (0.0010) [2023-12-26 00:01:29,689][123090] Updated weights for policy 1, policy_version 56394 (0.0009) [2023-12-26 00:01:29,695][123091] Updated weights for policy 0, policy_version 56628 (0.0011) [2023-12-26 00:01:29,759][123090] Updated weights for policy 1, policy_version 56404 (0.0009) [2023-12-26 00:01:29,764][123091] Updated weights for policy 0, policy_version 56638 (0.0011) [2023-12-26 00:01:29,823][123090] Updated weights for policy 1, policy_version 56414 (0.0010) [2023-12-26 00:01:30,618][123091] Updated weights for policy 0, policy_version 56648 (0.0011) [2023-12-26 00:01:30,682][123091] Updated weights for policy 0, policy_version 56658 (0.0011) [2023-12-26 00:01:30,706][123090] Updated weights for policy 1, policy_version 56424 (0.0008) [2023-12-26 00:01:30,753][123091] Updated weights for policy 0, policy_version 56668 (0.0008) [2023-12-26 00:01:30,764][123090] Updated weights for policy 1, policy_version 56434 (0.0008) [2023-12-26 00:01:30,821][123090] Updated weights for policy 1, policy_version 56444 (0.0009) [2023-12-26 00:01:31,561][123091] Updated weights for policy 0, policy_version 56678 (0.0008) [2023-12-26 00:01:31,629][123091] Updated weights for policy 0, policy_version 56688 (0.0010) [2023-12-26 00:01:31,700][123091] Updated weights for policy 0, policy_version 56698 (0.0009) [2023-12-26 00:01:31,712][123090] Updated weights for policy 1, policy_version 56454 (0.0009) [2023-12-26 00:01:31,794][123090] Updated weights for policy 1, policy_version 56464 (0.0008) [2023-12-26 00:01:31,861][123090] Updated weights for policy 1, policy_version 56474 (0.0008) [2023-12-26 00:01:32,515][123091] Updated weights for policy 0, policy_version 56708 (0.0009) [2023-12-26 00:01:32,587][123091] Updated weights for policy 0, policy_version 56718 (0.0008) [2023-12-26 00:01:32,659][123091] Updated weights for policy 0, policy_version 56728 (0.0010) [2023-12-26 00:01:32,692][123090] Updated weights for policy 1, policy_version 56484 (0.0007) [2023-12-26 00:01:32,761][123090] Updated weights for policy 1, policy_version 56494 (0.0009) [2023-12-26 00:01:32,822][123090] Updated weights for policy 1, policy_version 56504 (0.0010) [2023-12-26 00:01:33,446][123091] Updated weights for policy 0, policy_version 56738 (0.0010) [2023-12-26 00:01:33,505][123091] Updated weights for policy 0, policy_version 56748 (0.0010) [2023-12-26 00:01:33,565][123091] Updated weights for policy 0, policy_version 56758 (0.0008) [2023-12-26 00:01:33,629][123091] Updated weights for policy 0, policy_version 56768 (0.0005) [2023-12-26 00:01:33,713][123090] Updated weights for policy 1, policy_version 56514 (0.0010) [2023-12-26 00:01:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 16110.9, 300 sec: 17244.9). Total num frames: 28999680. Throughput: 0: 8090.2, 1: 7965.5. Samples: 29012420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:33,784][123090] Updated weights for policy 1, policy_version 56524 (0.0008) [2023-12-26 00:01:33,785][121949] Avg episode reward: [(0, '4164.951'), (1, '5253.263')] [2023-12-26 00:01:33,846][123090] Updated weights for policy 1, policy_version 56534 (0.0009) [2023-12-26 00:01:33,909][123008] Saving new best policy, reward=5253.263! [2023-12-26 00:01:33,911][123090] Updated weights for policy 1, policy_version 56544 (0.0010) [2023-12-26 00:01:34,428][123091] Updated weights for policy 0, policy_version 56778 (0.0007) [2023-12-26 00:01:34,489][123091] Updated weights for policy 0, policy_version 56788 (0.0009) [2023-12-26 00:01:34,559][123091] Updated weights for policy 0, policy_version 56798 (0.0009) [2023-12-26 00:01:34,810][123090] Updated weights for policy 1, policy_version 56554 (0.0007) [2023-12-26 00:01:34,880][123090] Updated weights for policy 1, policy_version 56564 (0.0007) [2023-12-26 00:01:34,947][123090] Updated weights for policy 1, policy_version 56574 (0.0008) [2023-12-26 00:01:35,391][123091] Updated weights for policy 0, policy_version 56808 (0.0007) [2023-12-26 00:01:35,460][123091] Updated weights for policy 0, policy_version 56818 (0.0011) [2023-12-26 00:01:35,521][123091] Updated weights for policy 0, policy_version 56828 (0.0011) [2023-12-26 00:01:35,690][123090] Updated weights for policy 1, policy_version 56584 (0.0009) [2023-12-26 00:01:35,753][123090] Updated weights for policy 1, policy_version 56594 (0.0010) [2023-12-26 00:01:35,821][123090] Updated weights for policy 1, policy_version 56604 (0.0009) [2023-12-26 00:01:36,380][123091] Updated weights for policy 0, policy_version 56838 (0.0011) [2023-12-26 00:01:36,454][123091] Updated weights for policy 0, policy_version 56848 (0.0011) [2023-12-26 00:01:36,532][123091] Updated weights for policy 0, policy_version 56858 (0.0011) [2023-12-26 00:01:36,734][123090] Updated weights for policy 1, policy_version 56614 (0.0009) [2023-12-26 00:01:36,797][123090] Updated weights for policy 1, policy_version 56624 (0.0009) [2023-12-26 00:01:36,868][123090] Updated weights for policy 1, policy_version 56634 (0.0009) [2023-12-26 00:01:37,346][123091] Updated weights for policy 0, policy_version 56868 (0.0010) [2023-12-26 00:01:37,400][123091] Updated weights for policy 0, policy_version 56878 (0.0010) [2023-12-26 00:01:37,462][123091] Updated weights for policy 0, policy_version 56888 (0.0011) [2023-12-26 00:01:37,791][123090] Updated weights for policy 1, policy_version 56644 (0.0010) [2023-12-26 00:01:37,859][123090] Updated weights for policy 1, policy_version 56654 (0.0008) [2023-12-26 00:01:37,935][123090] Updated weights for policy 1, policy_version 56664 (0.0008) [2023-12-26 00:01:38,330][123091] Updated weights for policy 0, policy_version 56898 (0.0011) [2023-12-26 00:01:38,404][123091] Updated weights for policy 0, policy_version 56908 (0.0010) [2023-12-26 00:01:38,474][123091] Updated weights for policy 0, policy_version 56918 (0.0008) [2023-12-26 00:01:38,549][123091] Updated weights for policy 0, policy_version 56928 (0.0008) [2023-12-26 00:01:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 16110.9, 300 sec: 17244.9). Total num frames: 29081600. Throughput: 0: 8143.0, 1: 8006.9. Samples: 29062672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:38,785][121949] Avg episode reward: [(0, '4337.358'), (1, '5306.185')] [2023-12-26 00:01:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000056928_14573568.pth... [2023-12-26 00:01:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000056672_14508032.pth... [2023-12-26 00:01:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000055744_14270464.pth [2023-12-26 00:01:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000055968_14327808.pth [2023-12-26 00:01:38,804][123008] Saving new best policy, reward=5306.185! [2023-12-26 00:01:38,836][123090] Updated weights for policy 1, policy_version 56674 (0.0009) [2023-12-26 00:01:38,911][123090] Updated weights for policy 1, policy_version 56684 (0.0010) [2023-12-26 00:01:38,980][123090] Updated weights for policy 1, policy_version 56694 (0.0006) [2023-12-26 00:01:39,052][123090] Updated weights for policy 1, policy_version 56704 (0.0009) [2023-12-26 00:01:39,322][123091] Updated weights for policy 0, policy_version 56938 (0.0008) [2023-12-26 00:01:39,401][123091] Updated weights for policy 0, policy_version 56948 (0.0009) [2023-12-26 00:01:39,472][123091] Updated weights for policy 0, policy_version 56958 (0.0010) [2023-12-26 00:01:39,904][123090] Updated weights for policy 1, policy_version 56714 (0.0009) [2023-12-26 00:01:39,979][123090] Updated weights for policy 1, policy_version 56724 (0.0010) [2023-12-26 00:01:40,052][123090] Updated weights for policy 1, policy_version 56734 (0.0009) [2023-12-26 00:01:40,329][123091] Updated weights for policy 0, policy_version 56968 (0.0011) [2023-12-26 00:01:40,398][123091] Updated weights for policy 0, policy_version 56978 (0.0011) [2023-12-26 00:01:40,459][123091] Updated weights for policy 0, policy_version 56988 (0.0011) [2023-12-26 00:01:40,870][123090] Updated weights for policy 1, policy_version 56744 (0.0011) [2023-12-26 00:01:40,936][123090] Updated weights for policy 1, policy_version 56754 (0.0011) [2023-12-26 00:01:41,010][123090] Updated weights for policy 1, policy_version 56764 (0.0011) [2023-12-26 00:01:41,313][123091] Updated weights for policy 0, policy_version 56998 (0.0011) [2023-12-26 00:01:41,387][123091] Updated weights for policy 0, policy_version 57008 (0.0009) [2023-12-26 00:01:41,457][123091] Updated weights for policy 0, policy_version 57018 (0.0006) [2023-12-26 00:01:41,909][123090] Updated weights for policy 1, policy_version 56774 (0.0010) [2023-12-26 00:01:41,974][123090] Updated weights for policy 1, policy_version 56784 (0.0010) [2023-12-26 00:01:42,048][123090] Updated weights for policy 1, policy_version 56794 (0.0010) [2023-12-26 00:01:42,314][123091] Updated weights for policy 0, policy_version 57028 (0.0009) [2023-12-26 00:01:42,386][123091] Updated weights for policy 0, policy_version 57038 (0.0009) [2023-12-26 00:01:42,490][123091] Updated weights for policy 0, policy_version 57048 (0.0009) [2023-12-26 00:01:42,933][123090] Updated weights for policy 1, policy_version 56804 (0.0009) [2023-12-26 00:01:43,003][123090] Updated weights for policy 1, policy_version 56814 (0.0009) [2023-12-26 00:01:43,069][123090] Updated weights for policy 1, policy_version 56824 (0.0010) [2023-12-26 00:01:43,276][123091] Updated weights for policy 0, policy_version 57058 (0.0008) [2023-12-26 00:01:43,343][123091] Updated weights for policy 0, policy_version 57068 (0.0009) [2023-12-26 00:01:43,406][123091] Updated weights for policy 0, policy_version 57078 (0.0008) [2023-12-26 00:01:43,472][123091] Updated weights for policy 0, policy_version 57088 (0.0007) [2023-12-26 00:01:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16111.0, 300 sec: 17217.1). Total num frames: 29163520. Throughput: 0: 8172.7, 1: 7956.6. Samples: 29159164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:43,784][121949] Avg episode reward: [(0, '4114.788'), (1, '5232.618')] [2023-12-26 00:01:43,862][123090] Updated weights for policy 1, policy_version 56834 (0.0010) [2023-12-26 00:01:43,919][123090] Updated weights for policy 1, policy_version 56844 (0.0009) [2023-12-26 00:01:43,981][123090] Updated weights for policy 1, policy_version 56854 (0.0010) [2023-12-26 00:01:44,041][123090] Updated weights for policy 1, policy_version 56864 (0.0007) [2023-12-26 00:01:44,328][123091] Updated weights for policy 0, policy_version 57098 (0.0010) [2023-12-26 00:01:44,393][123091] Updated weights for policy 0, policy_version 57108 (0.0010) [2023-12-26 00:01:44,449][123091] Updated weights for policy 0, policy_version 57118 (0.0009) [2023-12-26 00:01:44,875][123090] Updated weights for policy 1, policy_version 56874 (0.0010) [2023-12-26 00:01:44,939][123090] Updated weights for policy 1, policy_version 56884 (0.0010) [2023-12-26 00:01:45,012][123090] Updated weights for policy 1, policy_version 56894 (0.0010) [2023-12-26 00:01:45,307][123091] Updated weights for policy 0, policy_version 57128 (0.0010) [2023-12-26 00:01:45,373][123091] Updated weights for policy 0, policy_version 57138 (0.0009) [2023-12-26 00:01:45,439][123091] Updated weights for policy 0, policy_version 57148 (0.0010) [2023-12-26 00:01:45,901][123090] Updated weights for policy 1, policy_version 56904 (0.0007) [2023-12-26 00:01:45,973][123090] Updated weights for policy 1, policy_version 56914 (0.0008) [2023-12-26 00:01:46,042][123090] Updated weights for policy 1, policy_version 56924 (0.0008) [2023-12-26 00:01:46,333][123091] Updated weights for policy 0, policy_version 57158 (0.0009) [2023-12-26 00:01:46,399][123091] Updated weights for policy 0, policy_version 57169 (0.0010) [2023-12-26 00:01:46,466][123091] Updated weights for policy 0, policy_version 57179 (0.0009) [2023-12-26 00:01:46,821][123090] Updated weights for policy 1, policy_version 56934 (0.0008) [2023-12-26 00:01:46,894][123090] Updated weights for policy 1, policy_version 56944 (0.0007) [2023-12-26 00:01:46,961][123090] Updated weights for policy 1, policy_version 56954 (0.0010) [2023-12-26 00:01:47,334][123091] Updated weights for policy 0, policy_version 57189 (0.0008) [2023-12-26 00:01:47,410][123091] Updated weights for policy 0, policy_version 57199 (0.0005) [2023-12-26 00:01:47,485][123091] Updated weights for policy 0, policy_version 57209 (0.0007) [2023-12-26 00:01:47,812][123090] Updated weights for policy 1, policy_version 56964 (0.0009) [2023-12-26 00:01:47,868][123090] Updated weights for policy 1, policy_version 56974 (0.0009) [2023-12-26 00:01:47,925][123090] Updated weights for policy 1, policy_version 56984 (0.0008) [2023-12-26 00:01:48,223][123091] Updated weights for policy 0, policy_version 57219 (0.0008) [2023-12-26 00:01:48,286][123091] Updated weights for policy 0, policy_version 57229 (0.0005) [2023-12-26 00:01:48,359][123091] Updated weights for policy 0, policy_version 57239 (0.0009) [2023-12-26 00:01:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16110.9, 300 sec: 17217.1). Total num frames: 29245440. Throughput: 0: 8243.3, 1: 8074.7. Samples: 29258892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:48,785][121949] Avg episode reward: [(0, '4064.995'), (1, '5145.765')] [2023-12-26 00:01:48,839][123090] Updated weights for policy 1, policy_version 56994 (0.0009) [2023-12-26 00:01:48,898][123090] Updated weights for policy 1, policy_version 57004 (0.0009) [2023-12-26 00:01:48,965][123090] Updated weights for policy 1, policy_version 57014 (0.0010) [2023-12-26 00:01:49,030][123090] Updated weights for policy 1, policy_version 57024 (0.0009) [2023-12-26 00:01:49,144][123091] Updated weights for policy 0, policy_version 57249 (0.0011) [2023-12-26 00:01:49,203][123091] Updated weights for policy 0, policy_version 57259 (0.0011) [2023-12-26 00:01:49,286][123091] Updated weights for policy 0, policy_version 57269 (0.0011) [2023-12-26 00:01:49,364][123091] Updated weights for policy 0, policy_version 57279 (0.0011) [2023-12-26 00:01:49,927][123090] Updated weights for policy 1, policy_version 57034 (0.0009) [2023-12-26 00:01:50,000][123090] Updated weights for policy 1, policy_version 57044 (0.0010) [2023-12-26 00:01:50,068][123090] Updated weights for policy 1, policy_version 57054 (0.0009) [2023-12-26 00:01:50,219][123091] Updated weights for policy 0, policy_version 57289 (0.0008) [2023-12-26 00:01:50,283][123091] Updated weights for policy 0, policy_version 57299 (0.0011) [2023-12-26 00:01:50,355][123091] Updated weights for policy 0, policy_version 57309 (0.0011) [2023-12-26 00:01:50,922][123090] Updated weights for policy 1, policy_version 57064 (0.0009) [2023-12-26 00:01:50,991][123090] Updated weights for policy 1, policy_version 57074 (0.0008) [2023-12-26 00:01:51,065][123090] Updated weights for policy 1, policy_version 57084 (0.0010) [2023-12-26 00:01:51,214][123091] Updated weights for policy 0, policy_version 57319 (0.0010) [2023-12-26 00:01:51,290][123091] Updated weights for policy 0, policy_version 57329 (0.0008) [2023-12-26 00:01:51,367][123091] Updated weights for policy 0, policy_version 57339 (0.0009) [2023-12-26 00:01:51,946][123090] Updated weights for policy 1, policy_version 57094 (0.0009) [2023-12-26 00:01:52,020][123090] Updated weights for policy 1, policy_version 57104 (0.0008) [2023-12-26 00:01:52,089][123090] Updated weights for policy 1, policy_version 57114 (0.0008) [2023-12-26 00:01:52,240][123091] Updated weights for policy 0, policy_version 57349 (0.0009) [2023-12-26 00:01:52,310][123091] Updated weights for policy 0, policy_version 57359 (0.0008) [2023-12-26 00:01:52,381][123091] Updated weights for policy 0, policy_version 57369 (0.0009) [2023-12-26 00:01:52,929][123090] Updated weights for policy 1, policy_version 57124 (0.0008) [2023-12-26 00:01:52,992][123090] Updated weights for policy 1, policy_version 57134 (0.0011) [2023-12-26 00:01:53,058][123090] Updated weights for policy 1, policy_version 57144 (0.0011) [2023-12-26 00:01:53,169][123091] Updated weights for policy 0, policy_version 57379 (0.0010) [2023-12-26 00:01:53,242][123091] Updated weights for policy 0, policy_version 57389 (0.0011) [2023-12-26 00:01:53,307][123091] Updated weights for policy 0, policy_version 57399 (0.0011) [2023-12-26 00:01:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16247.5, 300 sec: 17161.5). Total num frames: 29327360. Throughput: 0: 8238.0, 1: 8073.6. Samples: 29307056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:53,785][121949] Avg episode reward: [(0, '4215.258'), (1, '5090.336')] [2023-12-26 00:01:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000057408_14696448.pth... [2023-12-26 00:01:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000057152_14630912.pth... [2023-12-26 00:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000056224_14393344.pth [2023-12-26 00:01:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000056448_14450688.pth [2023-12-26 00:01:53,908][123090] Updated weights for policy 1, policy_version 57154 (0.0010) [2023-12-26 00:01:53,958][123090] Updated weights for policy 1, policy_version 57164 (0.0009) [2023-12-26 00:01:54,008][123090] Updated weights for policy 1, policy_version 57174 (0.0009) [2023-12-26 00:01:54,074][123090] Updated weights for policy 1, policy_version 57184 (0.0010) [2023-12-26 00:01:54,136][123091] Updated weights for policy 0, policy_version 57409 (0.0009) [2023-12-26 00:01:54,202][123091] Updated weights for policy 0, policy_version 57419 (0.0009) [2023-12-26 00:01:54,254][123091] Updated weights for policy 0, policy_version 57429 (0.0010) [2023-12-26 00:01:54,315][123091] Updated weights for policy 0, policy_version 57439 (0.0006) [2023-12-26 00:01:54,982][123090] Updated weights for policy 1, policy_version 57194 (0.0009) [2023-12-26 00:01:55,048][123090] Updated weights for policy 1, policy_version 57204 (0.0009) [2023-12-26 00:01:55,112][123090] Updated weights for policy 1, policy_version 57214 (0.0008) [2023-12-26 00:01:55,140][123091] Updated weights for policy 0, policy_version 57449 (0.0010) [2023-12-26 00:01:55,201][123091] Updated weights for policy 0, policy_version 57459 (0.0011) [2023-12-26 00:01:55,250][123091] Updated weights for policy 0, policy_version 57469 (0.0007) [2023-12-26 00:01:55,920][123090] Updated weights for policy 1, policy_version 57224 (0.0009) [2023-12-26 00:01:55,977][123091] Updated weights for policy 0, policy_version 57479 (0.0008) [2023-12-26 00:01:55,980][123090] Updated weights for policy 1, policy_version 57234 (0.0008) [2023-12-26 00:01:56,042][123091] Updated weights for policy 0, policy_version 57489 (0.0008) [2023-12-26 00:01:56,055][123090] Updated weights for policy 1, policy_version 57244 (0.0007) [2023-12-26 00:01:56,108][123091] Updated weights for policy 0, policy_version 57499 (0.0008) [2023-12-26 00:01:56,903][123090] Updated weights for policy 1, policy_version 57254 (0.0008) [2023-12-26 00:01:56,937][123091] Updated weights for policy 0, policy_version 57509 (0.0010) [2023-12-26 00:01:56,968][123090] Updated weights for policy 1, policy_version 57264 (0.0009) [2023-12-26 00:01:56,994][123091] Updated weights for policy 0, policy_version 57519 (0.0009) [2023-12-26 00:01:57,032][123090] Updated weights for policy 1, policy_version 57274 (0.0009) [2023-12-26 00:01:57,063][123091] Updated weights for policy 0, policy_version 57529 (0.0009) [2023-12-26 00:01:57,815][123091] Updated weights for policy 0, policy_version 57539 (0.0011) [2023-12-26 00:01:57,877][123091] Updated weights for policy 0, policy_version 57549 (0.0009) [2023-12-26 00:01:57,922][123090] Updated weights for policy 1, policy_version 57284 (0.0009) [2023-12-26 00:01:57,942][123091] Updated weights for policy 0, policy_version 57559 (0.0010) [2023-12-26 00:01:57,991][123090] Updated weights for policy 1, policy_version 57294 (0.0008) [2023-12-26 00:01:58,059][123090] Updated weights for policy 1, policy_version 57304 (0.0010) [2023-12-26 00:01:58,786][121949] Fps is (10 sec: 16381.3, 60 sec: 16247.0, 300 sec: 17133.7). Total num frames: 29409280. Throughput: 0: 8317.4, 1: 8102.3. Samples: 29408268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 00:01:58,786][121949] Avg episode reward: [(0, '4157.356'), (1, '5163.277')] [2023-12-26 00:01:58,919][123091] Updated weights for policy 0, policy_version 57569 (0.0009) [2023-12-26 00:01:58,991][123091] Updated weights for policy 0, policy_version 57579 (0.0011) [2023-12-26 00:01:59,062][123091] Updated weights for policy 0, policy_version 57589 (0.0010) [2023-12-26 00:01:59,124][123090] Updated weights for policy 1, policy_version 57314 (0.0010) [2023-12-26 00:01:59,133][123091] Updated weights for policy 0, policy_version 57599 (0.0008) [2023-12-26 00:01:59,198][123090] Updated weights for policy 1, policy_version 57324 (0.0010) [2023-12-26 00:01:59,268][123090] Updated weights for policy 1, policy_version 57334 (0.0010) [2023-12-26 00:01:59,342][123090] Updated weights for policy 1, policy_version 57344 (0.0009) [2023-12-26 00:02:00,111][123091] Updated weights for policy 0, policy_version 57609 (0.0009) [2023-12-26 00:02:00,182][123091] Updated weights for policy 0, policy_version 57619 (0.0008) [2023-12-26 00:02:00,214][123090] Updated weights for policy 1, policy_version 57354 (0.0009) [2023-12-26 00:02:00,253][123091] Updated weights for policy 0, policy_version 57629 (0.0009) [2023-12-26 00:02:00,280][123090] Updated weights for policy 1, policy_version 57364 (0.0009) [2023-12-26 00:02:00,352][123090] Updated weights for policy 1, policy_version 57374 (0.0009) [2023-12-26 00:02:00,986][123091] Updated weights for policy 0, policy_version 57639 (0.0008) [2023-12-26 00:02:01,058][123091] Updated weights for policy 0, policy_version 57649 (0.0010) [2023-12-26 00:02:01,131][123091] Updated weights for policy 0, policy_version 57659 (0.0010) [2023-12-26 00:02:01,176][123090] Updated weights for policy 1, policy_version 57384 (0.0009) [2023-12-26 00:02:01,246][123090] Updated weights for policy 1, policy_version 57394 (0.0010) [2023-12-26 00:02:01,320][123090] Updated weights for policy 1, policy_version 57404 (0.0010) [2023-12-26 00:02:01,991][123091] Updated weights for policy 0, policy_version 57670 (0.0009) [2023-12-26 00:02:02,057][123091] Updated weights for policy 0, policy_version 57680 (0.0008) [2023-12-26 00:02:02,119][123091] Updated weights for policy 0, policy_version 57690 (0.0008) [2023-12-26 00:02:02,211][123090] Updated weights for policy 1, policy_version 57414 (0.0011) [2023-12-26 00:02:02,285][123090] Updated weights for policy 1, policy_version 57424 (0.0011) [2023-12-26 00:02:02,355][123090] Updated weights for policy 1, policy_version 57434 (0.0010) [2023-12-26 00:02:02,971][123091] Updated weights for policy 0, policy_version 57700 (0.0008) [2023-12-26 00:02:03,034][123091] Updated weights for policy 0, policy_version 57710 (0.0009) [2023-12-26 00:02:03,097][123091] Updated weights for policy 0, policy_version 57720 (0.0010) [2023-12-26 00:02:03,164][123090] Updated weights for policy 1, policy_version 57444 (0.0009) [2023-12-26 00:02:03,232][123090] Updated weights for policy 1, policy_version 57454 (0.0009) [2023-12-26 00:02:03,308][123090] Updated weights for policy 1, policy_version 57464 (0.0010) [2023-12-26 00:02:03,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16247.5, 300 sec: 17106.0). Total num frames: 29491200. Throughput: 0: 8303.5, 1: 8050.1. Samples: 29503964. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:03,785][121949] Avg episode reward: [(0, '4264.772'), (1, '5155.719')] [2023-12-26 00:02:03,947][123091] Updated weights for policy 0, policy_version 57730 (0.0010) [2023-12-26 00:02:04,009][123091] Updated weights for policy 0, policy_version 57740 (0.0009) [2023-12-26 00:02:04,077][123091] Updated weights for policy 0, policy_version 57750 (0.0010) [2023-12-26 00:02:04,138][123090] Updated weights for policy 1, policy_version 57474 (0.0010) [2023-12-26 00:02:04,146][123091] Updated weights for policy 0, policy_version 57760 (0.0010) [2023-12-26 00:02:04,207][123090] Updated weights for policy 1, policy_version 57484 (0.0010) [2023-12-26 00:02:04,272][123090] Updated weights for policy 1, policy_version 57494 (0.0010) [2023-12-26 00:02:04,343][123090] Updated weights for policy 1, policy_version 57504 (0.0010) [2023-12-26 00:02:05,029][123091] Updated weights for policy 0, policy_version 57770 (0.0010) [2023-12-26 00:02:05,083][123091] Updated weights for policy 0, policy_version 57780 (0.0009) [2023-12-26 00:02:05,138][123091] Updated weights for policy 0, policy_version 57790 (0.0008) [2023-12-26 00:02:05,241][123090] Updated weights for policy 1, policy_version 57514 (0.0009) [2023-12-26 00:02:05,315][123090] Updated weights for policy 1, policy_version 57524 (0.0009) [2023-12-26 00:02:05,379][123090] Updated weights for policy 1, policy_version 57534 (0.0010) [2023-12-26 00:02:06,010][123091] Updated weights for policy 0, policy_version 57800 (0.0009) [2023-12-26 00:02:06,075][123091] Updated weights for policy 0, policy_version 57810 (0.0009) [2023-12-26 00:02:06,150][123091] Updated weights for policy 0, policy_version 57820 (0.0008) [2023-12-26 00:02:06,225][123090] Updated weights for policy 1, policy_version 57544 (0.0009) [2023-12-26 00:02:06,297][123090] Updated weights for policy 1, policy_version 57554 (0.0008) [2023-12-26 00:02:06,365][123090] Updated weights for policy 1, policy_version 57564 (0.0010) [2023-12-26 00:02:07,034][123091] Updated weights for policy 0, policy_version 57830 (0.0009) [2023-12-26 00:02:07,100][123091] Updated weights for policy 0, policy_version 57840 (0.0010) [2023-12-26 00:02:07,176][123091] Updated weights for policy 0, policy_version 57850 (0.0011) [2023-12-26 00:02:07,212][123090] Updated weights for policy 1, policy_version 57574 (0.0009) [2023-12-26 00:02:07,281][123090] Updated weights for policy 1, policy_version 57584 (0.0008) [2023-12-26 00:02:07,344][123090] Updated weights for policy 1, policy_version 57594 (0.0010) [2023-12-26 00:02:08,051][123091] Updated weights for policy 0, policy_version 57860 (0.0009) [2023-12-26 00:02:08,124][123091] Updated weights for policy 0, policy_version 57870 (0.0010) [2023-12-26 00:02:08,193][123091] Updated weights for policy 0, policy_version 57880 (0.0009) [2023-12-26 00:02:08,198][123090] Updated weights for policy 1, policy_version 57604 (0.0010) [2023-12-26 00:02:08,268][123090] Updated weights for policy 1, policy_version 57614 (0.0009) [2023-12-26 00:02:08,341][123090] Updated weights for policy 1, policy_version 57624 (0.0008) [2023-12-26 00:02:08,784][121949] Fps is (10 sec: 16386.9, 60 sec: 16247.5, 300 sec: 17078.2). Total num frames: 29573120. Throughput: 0: 8322.7, 1: 8062.4. Samples: 29552616. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:08,785][121949] Avg episode reward: [(0, '4304.649'), (1, '5101.832')] [2023-12-26 00:02:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000057888_14819328.pth... [2023-12-26 00:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000057632_14753792.pth... [2023-12-26 00:02:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000056928_14573568.pth [2023-12-26 00:02:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000056672_14508032.pth [2023-12-26 00:02:08,977][123091] Updated weights for policy 0, policy_version 57890 (0.0009) [2023-12-26 00:02:09,039][123091] Updated weights for policy 0, policy_version 57900 (0.0009) [2023-12-26 00:02:09,109][123091] Updated weights for policy 0, policy_version 57910 (0.0009) [2023-12-26 00:02:09,147][123090] Updated weights for policy 1, policy_version 57634 (0.0008) [2023-12-26 00:02:09,168][123091] Updated weights for policy 0, policy_version 57920 (0.0009) [2023-12-26 00:02:09,218][123090] Updated weights for policy 1, policy_version 57644 (0.0008) [2023-12-26 00:02:09,287][123090] Updated weights for policy 1, policy_version 57654 (0.0008) [2023-12-26 00:02:09,358][123090] Updated weights for policy 1, policy_version 57664 (0.0008) [2023-12-26 00:02:10,077][123091] Updated weights for policy 0, policy_version 57930 (0.0010) [2023-12-26 00:02:10,145][123091] Updated weights for policy 0, policy_version 57940 (0.0010) [2023-12-26 00:02:10,216][123091] Updated weights for policy 0, policy_version 57950 (0.0008) [2023-12-26 00:02:10,251][123090] Updated weights for policy 1, policy_version 57674 (0.0009) [2023-12-26 00:02:10,318][123090] Updated weights for policy 1, policy_version 57684 (0.0010) [2023-12-26 00:02:10,382][123090] Updated weights for policy 1, policy_version 57694 (0.0010) [2023-12-26 00:02:11,015][123091] Updated weights for policy 0, policy_version 57960 (0.0010) [2023-12-26 00:02:11,087][123091] Updated weights for policy 0, policy_version 57970 (0.0012) [2023-12-26 00:02:11,162][123091] Updated weights for policy 0, policy_version 57980 (0.0011) [2023-12-26 00:02:11,222][123090] Updated weights for policy 1, policy_version 57704 (0.0009) [2023-12-26 00:02:11,293][123090] Updated weights for policy 1, policy_version 57714 (0.0009) [2023-12-26 00:02:11,371][123090] Updated weights for policy 1, policy_version 57724 (0.0010) [2023-12-26 00:02:12,040][123091] Updated weights for policy 0, policy_version 57990 (0.0010) [2023-12-26 00:02:12,108][123091] Updated weights for policy 0, policy_version 58000 (0.0009) [2023-12-26 00:02:12,179][123091] Updated weights for policy 0, policy_version 58010 (0.0009) [2023-12-26 00:02:12,273][123090] Updated weights for policy 1, policy_version 57734 (0.0010) [2023-12-26 00:02:12,348][123090] Updated weights for policy 1, policy_version 57744 (0.0009) [2023-12-26 00:02:12,423][123090] Updated weights for policy 1, policy_version 57754 (0.0008) [2023-12-26 00:02:13,035][123091] Updated weights for policy 0, policy_version 58020 (0.0009) [2023-12-26 00:02:13,090][123091] Updated weights for policy 0, policy_version 58030 (0.0010) [2023-12-26 00:02:13,144][123091] Updated weights for policy 0, policy_version 58040 (0.0010) [2023-12-26 00:02:13,298][123090] Updated weights for policy 1, policy_version 57764 (0.0010) [2023-12-26 00:02:13,362][123090] Updated weights for policy 1, policy_version 57774 (0.0009) [2023-12-26 00:02:13,428][123090] Updated weights for policy 1, policy_version 57784 (0.0007) [2023-12-26 00:02:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16247.4, 300 sec: 17078.2). Total num frames: 29655040. Throughput: 0: 8298.6, 1: 8049.7. Samples: 29649280. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:13,785][121949] Avg episode reward: [(0, '4217.099'), (1, '5163.387')] [2023-12-26 00:02:14,030][123091] Updated weights for policy 0, policy_version 58050 (0.0010) [2023-12-26 00:02:14,092][123091] Updated weights for policy 0, policy_version 58060 (0.0009) [2023-12-26 00:02:14,152][123091] Updated weights for policy 0, policy_version 58070 (0.0010) [2023-12-26 00:02:14,202][123091] Updated weights for policy 0, policy_version 58080 (0.0009) [2023-12-26 00:02:14,267][123090] Updated weights for policy 1, policy_version 57794 (0.0007) [2023-12-26 00:02:14,335][123090] Updated weights for policy 1, policy_version 57804 (0.0006) [2023-12-26 00:02:14,408][123090] Updated weights for policy 1, policy_version 57814 (0.0007) [2023-12-26 00:02:14,461][123090] Updated weights for policy 1, policy_version 57824 (0.0008) [2023-12-26 00:02:15,091][123091] Updated weights for policy 0, policy_version 58090 (0.0011) [2023-12-26 00:02:15,163][123091] Updated weights for policy 0, policy_version 58100 (0.0010) [2023-12-26 00:02:15,230][123091] Updated weights for policy 0, policy_version 58110 (0.0010) [2023-12-26 00:02:15,309][123090] Updated weights for policy 1, policy_version 57834 (0.0009) [2023-12-26 00:02:15,384][123090] Updated weights for policy 1, policy_version 57844 (0.0009) [2023-12-26 00:02:15,456][123090] Updated weights for policy 1, policy_version 57854 (0.0008) [2023-12-26 00:02:16,056][123091] Updated weights for policy 0, policy_version 58120 (0.0008) [2023-12-26 00:02:16,114][123091] Updated weights for policy 0, policy_version 58130 (0.0010) [2023-12-26 00:02:16,178][123091] Updated weights for policy 0, policy_version 58140 (0.0010) [2023-12-26 00:02:16,310][123090] Updated weights for policy 1, policy_version 57864 (0.0010) [2023-12-26 00:02:16,381][123090] Updated weights for policy 1, policy_version 57874 (0.0010) [2023-12-26 00:02:16,441][123090] Updated weights for policy 1, policy_version 57884 (0.0009) [2023-12-26 00:02:16,986][123091] Updated weights for policy 0, policy_version 58150 (0.0009) [2023-12-26 00:02:17,059][123091] Updated weights for policy 0, policy_version 58160 (0.0010) [2023-12-26 00:02:17,124][123091] Updated weights for policy 0, policy_version 58170 (0.0010) [2023-12-26 00:02:17,313][123090] Updated weights for policy 1, policy_version 57894 (0.0008) [2023-12-26 00:02:17,378][123090] Updated weights for policy 1, policy_version 57904 (0.0009) [2023-12-26 00:02:17,449][123090] Updated weights for policy 1, policy_version 57914 (0.0009) [2023-12-26 00:02:17,908][123091] Updated weights for policy 0, policy_version 58180 (0.0009) [2023-12-26 00:02:17,979][123091] Updated weights for policy 0, policy_version 58190 (0.0009) [2023-12-26 00:02:18,045][123091] Updated weights for policy 0, policy_version 58200 (0.0009) [2023-12-26 00:02:18,303][123090] Updated weights for policy 1, policy_version 57924 (0.0009) [2023-12-26 00:02:18,387][123090] Updated weights for policy 1, policy_version 57934 (0.0008) [2023-12-26 00:02:18,466][123090] Updated weights for policy 1, policy_version 57944 (0.0008) [2023-12-26 00:02:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16247.5, 300 sec: 17022.7). Total num frames: 29736960. Throughput: 0: 8281.6, 1: 8078.5. Samples: 29748624. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:18,785][121949] Avg episode reward: [(0, '4216.322'), (1, '5144.422')] [2023-12-26 00:02:18,874][123091] Updated weights for policy 0, policy_version 58210 (0.0010) [2023-12-26 00:02:18,944][123091] Updated weights for policy 0, policy_version 58220 (0.0008) [2023-12-26 00:02:19,010][123091] Updated weights for policy 0, policy_version 58230 (0.0008) [2023-12-26 00:02:19,079][123091] Updated weights for policy 0, policy_version 58240 (0.0009) [2023-12-26 00:02:19,399][123090] Updated weights for policy 1, policy_version 57954 (0.0007) [2023-12-26 00:02:19,468][123090] Updated weights for policy 1, policy_version 57964 (0.0006) [2023-12-26 00:02:19,551][123090] Updated weights for policy 1, policy_version 57974 (0.0008) [2023-12-26 00:02:19,623][123090] Updated weights for policy 1, policy_version 57984 (0.0007) [2023-12-26 00:02:19,954][123091] Updated weights for policy 0, policy_version 58250 (0.0011) [2023-12-26 00:02:20,022][123091] Updated weights for policy 0, policy_version 58260 (0.0010) [2023-12-26 00:02:20,087][123091] Updated weights for policy 0, policy_version 58270 (0.0010) [2023-12-26 00:02:20,424][123090] Updated weights for policy 1, policy_version 57994 (0.0010) [2023-12-26 00:02:20,517][123090] Updated weights for policy 1, policy_version 58004 (0.0010) [2023-12-26 00:02:20,586][123090] Updated weights for policy 1, policy_version 58014 (0.0010) [2023-12-26 00:02:20,972][123091] Updated weights for policy 0, policy_version 58280 (0.0010) [2023-12-26 00:02:21,045][123091] Updated weights for policy 0, policy_version 58290 (0.0009) [2023-12-26 00:02:21,120][123091] Updated weights for policy 0, policy_version 58300 (0.0010) [2023-12-26 00:02:21,466][123090] Updated weights for policy 1, policy_version 58024 (0.0010) [2023-12-26 00:02:21,537][123090] Updated weights for policy 1, policy_version 58034 (0.0011) [2023-12-26 00:02:21,613][123090] Updated weights for policy 1, policy_version 58044 (0.0011) [2023-12-26 00:02:22,056][123091] Updated weights for policy 0, policy_version 58310 (0.0010) [2023-12-26 00:02:22,131][123091] Updated weights for policy 0, policy_version 58320 (0.0009) [2023-12-26 00:02:22,203][123091] Updated weights for policy 0, policy_version 58330 (0.0009) [2023-12-26 00:02:22,489][123090] Updated weights for policy 1, policy_version 58054 (0.0010) [2023-12-26 00:02:22,551][123090] Updated weights for policy 1, policy_version 58064 (0.0010) [2023-12-26 00:02:22,607][123090] Updated weights for policy 1, policy_version 58074 (0.0009) [2023-12-26 00:02:23,051][123091] Updated weights for policy 0, policy_version 58340 (0.0008) [2023-12-26 00:02:23,128][123091] Updated weights for policy 0, policy_version 58350 (0.0009) [2023-12-26 00:02:23,197][123091] Updated weights for policy 0, policy_version 58360 (0.0009) [2023-12-26 00:02:23,495][123090] Updated weights for policy 1, policy_version 58084 (0.0009) [2023-12-26 00:02:23,568][123090] Updated weights for policy 1, policy_version 58094 (0.0007) [2023-12-26 00:02:23,644][123090] Updated weights for policy 1, policy_version 58104 (0.0006) [2023-12-26 00:02:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 17022.7). Total num frames: 29818880. Throughput: 0: 8240.1, 1: 8048.5. Samples: 29795660. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:23,785][121949] Avg episode reward: [(0, '4271.569'), (1, '5176.071')] [2023-12-26 00:02:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000058368_14942208.pth... [2023-12-26 00:02:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000058112_14876672.pth... [2023-12-26 00:02:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000057408_14696448.pth [2023-12-26 00:02:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000057152_14630912.pth [2023-12-26 00:02:24,022][123091] Updated weights for policy 0, policy_version 58370 (0.0007) [2023-12-26 00:02:24,094][123091] Updated weights for policy 0, policy_version 58380 (0.0009) [2023-12-26 00:02:24,160][123091] Updated weights for policy 0, policy_version 58390 (0.0009) [2023-12-26 00:02:24,228][123091] Updated weights for policy 0, policy_version 58400 (0.0010) [2023-12-26 00:02:24,427][123090] Updated weights for policy 1, policy_version 58114 (0.0007) [2023-12-26 00:02:24,495][123090] Updated weights for policy 1, policy_version 58124 (0.0011) [2023-12-26 00:02:24,564][123090] Updated weights for policy 1, policy_version 58134 (0.0011) [2023-12-26 00:02:24,626][123090] Updated weights for policy 1, policy_version 58144 (0.0011) [2023-12-26 00:02:25,091][123091] Updated weights for policy 0, policy_version 58410 (0.0009) [2023-12-26 00:02:25,153][123091] Updated weights for policy 0, policy_version 58420 (0.0009) [2023-12-26 00:02:25,203][123091] Updated weights for policy 0, policy_version 58430 (0.0005) [2023-12-26 00:02:25,405][123090] Updated weights for policy 1, policy_version 58154 (0.0007) [2023-12-26 00:02:25,475][123090] Updated weights for policy 1, policy_version 58164 (0.0007) [2023-12-26 00:02:25,548][123090] Updated weights for policy 1, policy_version 58174 (0.0010) [2023-12-26 00:02:26,019][123091] Updated weights for policy 0, policy_version 58440 (0.0008) [2023-12-26 00:02:26,086][123091] Updated weights for policy 0, policy_version 58450 (0.0009) [2023-12-26 00:02:26,141][123091] Updated weights for policy 0, policy_version 58460 (0.0010) [2023-12-26 00:02:26,375][123090] Updated weights for policy 1, policy_version 58184 (0.0011) [2023-12-26 00:02:26,441][123090] Updated weights for policy 1, policy_version 58194 (0.0011) [2023-12-26 00:02:26,505][123090] Updated weights for policy 1, policy_version 58204 (0.0011) [2023-12-26 00:02:26,947][123091] Updated weights for policy 0, policy_version 58470 (0.0009) [2023-12-26 00:02:27,018][123091] Updated weights for policy 0, policy_version 58480 (0.0009) [2023-12-26 00:02:27,082][123091] Updated weights for policy 0, policy_version 58490 (0.0010) [2023-12-26 00:02:27,282][123090] Updated weights for policy 1, policy_version 58214 (0.0009) [2023-12-26 00:02:27,343][123090] Updated weights for policy 1, policy_version 58224 (0.0007) [2023-12-26 00:02:27,418][123090] Updated weights for policy 1, policy_version 58234 (0.0009) [2023-12-26 00:02:27,955][123091] Updated weights for policy 0, policy_version 58500 (0.0010) [2023-12-26 00:02:28,030][123091] Updated weights for policy 0, policy_version 58510 (0.0009) [2023-12-26 00:02:28,089][123091] Updated weights for policy 0, policy_version 58520 (0.0010) [2023-12-26 00:02:28,220][123090] Updated weights for policy 1, policy_version 58244 (0.0010) [2023-12-26 00:02:28,280][123090] Updated weights for policy 1, policy_version 58254 (0.0010) [2023-12-26 00:02:28,338][123090] Updated weights for policy 1, policy_version 58264 (0.0010) [2023-12-26 00:02:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 16967.2). Total num frames: 29900800. Throughput: 0: 8256.7, 1: 8122.1. Samples: 29896212. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:28,785][121949] Avg episode reward: [(0, '4305.551'), (1, '5214.492')] [2023-12-26 00:02:28,964][123091] Updated weights for policy 0, policy_version 58530 (0.0009) [2023-12-26 00:02:29,030][123091] Updated weights for policy 0, policy_version 58540 (0.0011) [2023-12-26 00:02:29,095][123091] Updated weights for policy 0, policy_version 58550 (0.0011) [2023-12-26 00:02:29,162][123091] Updated weights for policy 0, policy_version 58560 (0.0010) [2023-12-26 00:02:29,198][123090] Updated weights for policy 1, policy_version 58274 (0.0010) [2023-12-26 00:02:29,275][123090] Updated weights for policy 1, policy_version 58284 (0.0008) [2023-12-26 00:02:29,340][123090] Updated weights for policy 1, policy_version 58294 (0.0011) [2023-12-26 00:02:29,420][123090] Updated weights for policy 1, policy_version 58304 (0.0011) [2023-12-26 00:02:30,012][123091] Updated weights for policy 0, policy_version 58570 (0.0009) [2023-12-26 00:02:30,069][123091] Updated weights for policy 0, policy_version 58580 (0.0008) [2023-12-26 00:02:30,139][123091] Updated weights for policy 0, policy_version 58590 (0.0007) [2023-12-26 00:02:30,249][123090] Updated weights for policy 1, policy_version 58314 (0.0010) [2023-12-26 00:02:30,321][123090] Updated weights for policy 1, policy_version 58324 (0.0010) [2023-12-26 00:02:30,393][123090] Updated weights for policy 1, policy_version 58334 (0.0010) [2023-12-26 00:02:30,951][123091] Updated weights for policy 0, policy_version 58600 (0.0009) [2023-12-26 00:02:31,016][123091] Updated weights for policy 0, policy_version 58610 (0.0009) [2023-12-26 00:02:31,089][123091] Updated weights for policy 0, policy_version 58620 (0.0010) [2023-12-26 00:02:31,252][123090] Updated weights for policy 1, policy_version 58344 (0.0009) [2023-12-26 00:02:31,317][123090] Updated weights for policy 1, policy_version 58354 (0.0007) [2023-12-26 00:02:31,388][123090] Updated weights for policy 1, policy_version 58364 (0.0008) [2023-12-26 00:02:32,030][123091] Updated weights for policy 0, policy_version 58630 (0.0009) [2023-12-26 00:02:32,094][123091] Updated weights for policy 0, policy_version 58640 (0.0009) [2023-12-26 00:02:32,152][123091] Updated weights for policy 0, policy_version 58650 (0.0010) [2023-12-26 00:02:32,293][123090] Updated weights for policy 1, policy_version 58374 (0.0009) [2023-12-26 00:02:32,373][123090] Updated weights for policy 1, policy_version 58384 (0.0009) [2023-12-26 00:02:32,449][123090] Updated weights for policy 1, policy_version 58394 (0.0009) [2023-12-26 00:02:33,012][123091] Updated weights for policy 0, policy_version 58660 (0.0010) [2023-12-26 00:02:33,079][123091] Updated weights for policy 0, policy_version 58670 (0.0009) [2023-12-26 00:02:33,145][123091] Updated weights for policy 0, policy_version 58680 (0.0009) [2023-12-26 00:02:33,307][123090] Updated weights for policy 1, policy_version 58404 (0.0007) [2023-12-26 00:02:33,377][123090] Updated weights for policy 1, policy_version 58414 (0.0006) [2023-12-26 00:02:33,441][123090] Updated weights for policy 1, policy_version 58424 (0.0006) [2023-12-26 00:02:33,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16384.0, 300 sec: 16967.2). Total num frames: 29982720. Throughput: 0: 8239.1, 1: 8111.1. Samples: 29994652. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:33,785][121949] Avg episode reward: [(0, '4288.947'), (1, '5199.445')] [2023-12-26 00:02:34,009][123091] Updated weights for policy 0, policy_version 58690 (0.0008) [2023-12-26 00:02:34,078][123091] Updated weights for policy 0, policy_version 58700 (0.0008) [2023-12-26 00:02:34,104][123090] Updated weights for policy 1, policy_version 58434 (0.0006) [2023-12-26 00:02:34,146][123091] Updated weights for policy 0, policy_version 58710 (0.0007) [2023-12-26 00:02:34,175][123090] Updated weights for policy 1, policy_version 58444 (0.0009) [2023-12-26 00:02:34,218][123091] Updated weights for policy 0, policy_version 58720 (0.0008) [2023-12-26 00:02:34,246][123090] Updated weights for policy 1, policy_version 58454 (0.0009) [2023-12-26 00:02:34,315][123090] Updated weights for policy 1, policy_version 58464 (0.0009) [2023-12-26 00:02:35,024][123091] Updated weights for policy 0, policy_version 58730 (0.0010) [2023-12-26 00:02:35,089][123091] Updated weights for policy 0, policy_version 58740 (0.0009) [2023-12-26 00:02:35,148][123091] Updated weights for policy 0, policy_version 58750 (0.0009) [2023-12-26 00:02:35,168][123090] Updated weights for policy 1, policy_version 58474 (0.0006) [2023-12-26 00:02:35,235][123090] Updated weights for policy 1, policy_version 58484 (0.0006) [2023-12-26 00:02:35,298][123090] Updated weights for policy 1, policy_version 58494 (0.0007) [2023-12-26 00:02:36,005][123091] Updated weights for policy 0, policy_version 58761 (0.0010) [2023-12-26 00:02:36,063][123091] Updated weights for policy 0, policy_version 58771 (0.0009) [2023-12-26 00:02:36,066][123090] Updated weights for policy 1, policy_version 58504 (0.0007) [2023-12-26 00:02:36,134][123091] Updated weights for policy 0, policy_version 58781 (0.0007) [2023-12-26 00:02:36,144][123090] Updated weights for policy 1, policy_version 58514 (0.0009) [2023-12-26 00:02:36,212][123090] Updated weights for policy 1, policy_version 58524 (0.0008) [2023-12-26 00:02:37,067][123091] Updated weights for policy 0, policy_version 58791 (0.0008) [2023-12-26 00:02:37,074][123090] Updated weights for policy 1, policy_version 58534 (0.0009) [2023-12-26 00:02:37,133][123091] Updated weights for policy 0, policy_version 58801 (0.0008) [2023-12-26 00:02:37,143][123090] Updated weights for policy 1, policy_version 58544 (0.0011) [2023-12-26 00:02:37,203][123091] Updated weights for policy 0, policy_version 58811 (0.0007) [2023-12-26 00:02:37,213][123090] Updated weights for policy 1, policy_version 58554 (0.0011) [2023-12-26 00:02:38,055][123091] Updated weights for policy 0, policy_version 58821 (0.0009) [2023-12-26 00:02:38,079][123090] Updated weights for policy 1, policy_version 58564 (0.0011) [2023-12-26 00:02:38,117][123091] Updated weights for policy 0, policy_version 58831 (0.0007) [2023-12-26 00:02:38,149][123090] Updated weights for policy 1, policy_version 58574 (0.0011) [2023-12-26 00:02:38,184][123091] Updated weights for policy 0, policy_version 58841 (0.0006) [2023-12-26 00:02:38,213][123090] Updated weights for policy 1, policy_version 58584 (0.0011) [2023-12-26 00:02:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16384.0, 300 sec: 16967.2). Total num frames: 30064640. Throughput: 0: 8240.4, 1: 8160.4. Samples: 30045088. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 00:02:38,785][121949] Avg episode reward: [(0, '4262.284'), (1, '5274.350')] [2023-12-26 00:02:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000058848_15065088.pth... [2023-12-26 00:02:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000058592_14999552.pth... [2023-12-26 00:02:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000057632_14753792.pth [2023-12-26 00:02:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000057888_14819328.pth [2023-12-26 00:02:39,060][123090] Updated weights for policy 1, policy_version 58594 (0.0011) [2023-12-26 00:02:39,066][123091] Updated weights for policy 0, policy_version 58851 (0.0007) [2023-12-26 00:02:39,126][123090] Updated weights for policy 1, policy_version 58604 (0.0009) [2023-12-26 00:02:39,134][123091] Updated weights for policy 0, policy_version 58861 (0.0008) [2023-12-26 00:02:39,197][123090] Updated weights for policy 1, policy_version 58614 (0.0009) [2023-12-26 00:02:39,203][123091] Updated weights for policy 0, policy_version 58871 (0.0006) [2023-12-26 00:02:39,280][123090] Updated weights for policy 1, policy_version 58624 (0.0010) [2023-12-26 00:02:40,073][123091] Updated weights for policy 0, policy_version 58881 (0.0009) [2023-12-26 00:02:40,151][123091] Updated weights for policy 0, policy_version 58891 (0.0010) [2023-12-26 00:02:40,166][123090] Updated weights for policy 1, policy_version 58634 (0.0009) [2023-12-26 00:02:40,223][123091] Updated weights for policy 0, policy_version 58901 (0.0008) [2023-12-26 00:02:40,240][123090] Updated weights for policy 1, policy_version 58644 (0.0008) [2023-12-26 00:02:40,303][123091] Updated weights for policy 0, policy_version 58911 (0.0008) [2023-12-26 00:02:40,315][123090] Updated weights for policy 1, policy_version 58654 (0.0011) [2023-12-26 00:02:41,106][123091] Updated weights for policy 0, policy_version 58921 (0.0010) [2023-12-26 00:02:41,186][123091] Updated weights for policy 0, policy_version 58931 (0.0009) [2023-12-26 00:02:41,211][123090] Updated weights for policy 1, policy_version 58664 (0.0011) [2023-12-26 00:02:41,265][123091] Updated weights for policy 0, policy_version 58941 (0.0009) [2023-12-26 00:02:41,293][123090] Updated weights for policy 1, policy_version 58674 (0.0010) [2023-12-26 00:02:41,368][123090] Updated weights for policy 1, policy_version 58684 (0.0010) [2023-12-26 00:02:42,125][123091] Updated weights for policy 0, policy_version 58951 (0.0017) [2023-12-26 00:02:42,194][123091] Updated weights for policy 0, policy_version 58961 (0.0011) [2023-12-26 00:02:42,263][123091] Updated weights for policy 0, policy_version 58971 (0.0010) [2023-12-26 00:02:42,279][123090] Updated weights for policy 1, policy_version 58694 (0.0010) [2023-12-26 00:02:42,365][123090] Updated weights for policy 1, policy_version 58704 (0.0009) [2023-12-26 00:02:42,443][123090] Updated weights for policy 1, policy_version 58714 (0.0008) [2023-12-26 00:02:43,099][123091] Updated weights for policy 0, policy_version 58981 (0.0009) [2023-12-26 00:02:43,160][123091] Updated weights for policy 0, policy_version 58992 (0.0010) [2023-12-26 00:02:43,228][123091] Updated weights for policy 0, policy_version 59002 (0.0007) [2023-12-26 00:02:43,254][123090] Updated weights for policy 1, policy_version 58724 (0.0007) [2023-12-26 00:02:43,324][123090] Updated weights for policy 1, policy_version 58734 (0.0009) [2023-12-26 00:02:43,384][123090] Updated weights for policy 1, policy_version 58744 (0.0010) [2023-12-26 00:02:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16384.0, 300 sec: 16939.4). Total num frames: 30146560. Throughput: 0: 8150.5, 1: 8125.2. Samples: 30140644. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:02:43,785][121949] Avg episode reward: [(0, '4192.806'), (1, '5165.194')] [2023-12-26 00:02:44,078][123091] Updated weights for policy 0, policy_version 59012 (0.0010) [2023-12-26 00:02:44,138][123091] Updated weights for policy 0, policy_version 59022 (0.0010) [2023-12-26 00:02:44,194][123090] Updated weights for policy 1, policy_version 58754 (0.0008) [2023-12-26 00:02:44,197][123091] Updated weights for policy 0, policy_version 59032 (0.0009) [2023-12-26 00:02:44,259][123090] Updated weights for policy 1, policy_version 58764 (0.0010) [2023-12-26 00:02:44,311][123090] Updated weights for policy 1, policy_version 58774 (0.0010) [2023-12-26 00:02:44,376][123090] Updated weights for policy 1, policy_version 58784 (0.0009) [2023-12-26 00:02:45,090][123091] Updated weights for policy 0, policy_version 59042 (0.0007) [2023-12-26 00:02:45,162][123091] Updated weights for policy 0, policy_version 59052 (0.0010) [2023-12-26 00:02:45,227][123091] Updated weights for policy 0, policy_version 59062 (0.0010) [2023-12-26 00:02:45,248][123090] Updated weights for policy 1, policy_version 58794 (0.0009) [2023-12-26 00:02:45,296][123091] Updated weights for policy 0, policy_version 59072 (0.0009) [2023-12-26 00:02:45,317][123090] Updated weights for policy 1, policy_version 58804 (0.0008) [2023-12-26 00:02:45,380][123090] Updated weights for policy 1, policy_version 58814 (0.0009) [2023-12-26 00:02:46,156][123091] Updated weights for policy 0, policy_version 59082 (0.0008) [2023-12-26 00:02:46,221][123091] Updated weights for policy 0, policy_version 59092 (0.0008) [2023-12-26 00:02:46,244][123090] Updated weights for policy 1, policy_version 58824 (0.0008) [2023-12-26 00:02:46,288][123091] Updated weights for policy 0, policy_version 59102 (0.0010) [2023-12-26 00:02:46,312][123090] Updated weights for policy 1, policy_version 58834 (0.0008) [2023-12-26 00:02:46,377][123090] Updated weights for policy 1, policy_version 58844 (0.0007) [2023-12-26 00:02:47,137][123091] Updated weights for policy 0, policy_version 59112 (0.0010) [2023-12-26 00:02:47,190][123090] Updated weights for policy 1, policy_version 58854 (0.0010) [2023-12-26 00:02:47,201][123091] Updated weights for policy 0, policy_version 59122 (0.0006) [2023-12-26 00:02:47,249][123090] Updated weights for policy 1, policy_version 58864 (0.0007) [2023-12-26 00:02:47,261][123091] Updated weights for policy 0, policy_version 59132 (0.0009) [2023-12-26 00:02:47,316][123090] Updated weights for policy 1, policy_version 58874 (0.0010) [2023-12-26 00:02:48,117][123090] Updated weights for policy 1, policy_version 58884 (0.0010) [2023-12-26 00:02:48,124][123091] Updated weights for policy 0, policy_version 59142 (0.0010) [2023-12-26 00:02:48,183][123090] Updated weights for policy 1, policy_version 58894 (0.0010) [2023-12-26 00:02:48,183][123091] Updated weights for policy 0, policy_version 59152 (0.0007) [2023-12-26 00:02:48,240][123091] Updated weights for policy 0, policy_version 59162 (0.0007) [2023-12-26 00:02:48,252][123090] Updated weights for policy 1, policy_version 58904 (0.0011) [2023-12-26 00:02:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16384.0, 300 sec: 16911.6). Total num frames: 30228480. Throughput: 0: 8170.8, 1: 8176.3. Samples: 30239580. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:02:48,785][121949] Avg episode reward: [(0, '4214.460'), (1, '5128.728')] [2023-12-26 00:02:49,103][123091] Updated weights for policy 0, policy_version 59172 (0.0011) [2023-12-26 00:02:49,119][123090] Updated weights for policy 1, policy_version 58914 (0.0010) [2023-12-26 00:02:49,168][123091] Updated weights for policy 0, policy_version 59182 (0.0011) [2023-12-26 00:02:49,175][123090] Updated weights for policy 1, policy_version 58924 (0.0008) [2023-12-26 00:02:49,230][123091] Updated weights for policy 0, policy_version 59193 (0.0011) [2023-12-26 00:02:49,248][123090] Updated weights for policy 1, policy_version 58934 (0.0008) [2023-12-26 00:02:49,320][123090] Updated weights for policy 1, policy_version 58944 (0.0007) [2023-12-26 00:02:50,107][123091] Updated weights for policy 0, policy_version 59203 (0.0010) [2023-12-26 00:02:50,169][123091] Updated weights for policy 0, policy_version 59213 (0.0011) [2023-12-26 00:02:50,204][123090] Updated weights for policy 1, policy_version 58954 (0.0007) [2023-12-26 00:02:50,239][123091] Updated weights for policy 0, policy_version 59223 (0.0011) [2023-12-26 00:02:50,269][123090] Updated weights for policy 1, policy_version 58964 (0.0007) [2023-12-26 00:02:50,344][123090] Updated weights for policy 1, policy_version 58974 (0.0009) [2023-12-26 00:02:51,047][123091] Updated weights for policy 0, policy_version 59233 (0.0010) [2023-12-26 00:02:51,118][123091] Updated weights for policy 0, policy_version 59243 (0.0008) [2023-12-26 00:02:51,194][123091] Updated weights for policy 0, policy_version 59253 (0.0009) [2023-12-26 00:02:51,245][123090] Updated weights for policy 1, policy_version 58984 (0.0009) [2023-12-26 00:02:51,268][123091] Updated weights for policy 0, policy_version 59263 (0.0009) [2023-12-26 00:02:51,315][123090] Updated weights for policy 1, policy_version 58994 (0.0009) [2023-12-26 00:02:51,391][123090] Updated weights for policy 1, policy_version 59004 (0.0009) [2023-12-26 00:02:52,121][123091] Updated weights for policy 0, policy_version 59273 (0.0006) [2023-12-26 00:02:52,192][123091] Updated weights for policy 0, policy_version 59283 (0.0008) [2023-12-26 00:02:52,228][123090] Updated weights for policy 1, policy_version 59014 (0.0010) [2023-12-26 00:02:52,273][123091] Updated weights for policy 0, policy_version 59293 (0.0009) [2023-12-26 00:02:52,314][123090] Updated weights for policy 1, policy_version 59024 (0.0010) [2023-12-26 00:02:52,395][123090] Updated weights for policy 1, policy_version 59034 (0.0009) [2023-12-26 00:02:53,142][123091] Updated weights for policy 0, policy_version 59303 (0.0007) [2023-12-26 00:02:53,188][123090] Updated weights for policy 1, policy_version 59044 (0.0008) [2023-12-26 00:02:53,216][123091] Updated weights for policy 0, policy_version 59313 (0.0007) [2023-12-26 00:02:53,262][123090] Updated weights for policy 1, policy_version 59054 (0.0008) [2023-12-26 00:02:53,279][123091] Updated weights for policy 0, policy_version 59323 (0.0010) [2023-12-26 00:02:53,330][123090] Updated weights for policy 1, policy_version 59064 (0.0007) [2023-12-26 00:02:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16384.0, 300 sec: 16883.8). Total num frames: 30310400. Throughput: 0: 8185.5, 1: 8170.0. Samples: 30288616. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:02:53,785][121949] Avg episode reward: [(0, '4227.212'), (1, '5178.693')] [2023-12-26 00:02:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000059328_15187968.pth... [2023-12-26 00:02:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000059072_15122432.pth... [2023-12-26 00:02:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000058368_14942208.pth [2023-12-26 00:02:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000058112_14876672.pth [2023-12-26 00:02:54,085][123091] Updated weights for policy 0, policy_version 59333 (0.0008) [2023-12-26 00:02:54,161][123091] Updated weights for policy 0, policy_version 59343 (0.0010) [2023-12-26 00:02:54,187][123090] Updated weights for policy 1, policy_version 59074 (0.0009) [2023-12-26 00:02:54,231][123091] Updated weights for policy 0, policy_version 59353 (0.0011) [2023-12-26 00:02:54,254][123090] Updated weights for policy 1, policy_version 59084 (0.0011) [2023-12-26 00:02:54,315][123090] Updated weights for policy 1, policy_version 59094 (0.0007) [2023-12-26 00:02:54,378][123090] Updated weights for policy 1, policy_version 59104 (0.0008) [2023-12-26 00:02:55,041][123091] Updated weights for policy 0, policy_version 59363 (0.0010) [2023-12-26 00:02:55,109][123091] Updated weights for policy 0, policy_version 59373 (0.0009) [2023-12-26 00:02:55,175][123091] Updated weights for policy 0, policy_version 59383 (0.0009) [2023-12-26 00:02:55,215][123090] Updated weights for policy 1, policy_version 59114 (0.0008) [2023-12-26 00:02:55,289][123090] Updated weights for policy 1, policy_version 59124 (0.0008) [2023-12-26 00:02:55,352][123090] Updated weights for policy 1, policy_version 59134 (0.0006) [2023-12-26 00:02:55,987][123091] Updated weights for policy 0, policy_version 59393 (0.0009) [2023-12-26 00:02:56,041][123091] Updated weights for policy 0, policy_version 59403 (0.0010) [2023-12-26 00:02:56,104][123091] Updated weights for policy 0, policy_version 59413 (0.0008) [2023-12-26 00:02:56,105][123090] Updated weights for policy 1, policy_version 59144 (0.0010) [2023-12-26 00:02:56,159][123090] Updated weights for policy 1, policy_version 59154 (0.0008) [2023-12-26 00:02:56,167][123091] Updated weights for policy 0, policy_version 59423 (0.0009) [2023-12-26 00:02:56,219][123090] Updated weights for policy 1, policy_version 59164 (0.0010) [2023-12-26 00:02:57,020][123090] Updated weights for policy 1, policy_version 59174 (0.0007) [2023-12-26 00:02:57,024][123091] Updated weights for policy 0, policy_version 59433 (0.0009) [2023-12-26 00:02:57,080][123090] Updated weights for policy 1, policy_version 59184 (0.0006) [2023-12-26 00:02:57,088][123091] Updated weights for policy 0, policy_version 59443 (0.0008) [2023-12-26 00:02:57,140][123090] Updated weights for policy 1, policy_version 59194 (0.0008) [2023-12-26 00:02:57,143][123091] Updated weights for policy 0, policy_version 59453 (0.0008) [2023-12-26 00:02:57,972][123090] Updated weights for policy 1, policy_version 59204 (0.0009) [2023-12-26 00:02:57,978][123091] Updated weights for policy 0, policy_version 59463 (0.0008) [2023-12-26 00:02:58,042][123090] Updated weights for policy 1, policy_version 59214 (0.0009) [2023-12-26 00:02:58,045][123091] Updated weights for policy 0, policy_version 59473 (0.0009) [2023-12-26 00:02:58,102][123090] Updated weights for policy 1, policy_version 59224 (0.0008) [2023-12-26 00:02:58,110][123091] Updated weights for policy 0, policy_version 59483 (0.0009) [2023-12-26 00:02:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16384.5, 300 sec: 16856.1). Total num frames: 30392320. Throughput: 0: 8199.0, 1: 8240.3. Samples: 30389048. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:02:58,785][121949] Avg episode reward: [(0, '4294.040'), (1, '5305.846')] [2023-12-26 00:02:58,999][123091] Updated weights for policy 0, policy_version 59493 (0.0010) [2023-12-26 00:02:59,012][123090] Updated weights for policy 1, policy_version 59234 (0.0007) [2023-12-26 00:02:59,063][123091] Updated weights for policy 0, policy_version 59503 (0.0010) [2023-12-26 00:02:59,077][123090] Updated weights for policy 1, policy_version 59244 (0.0007) [2023-12-26 00:02:59,131][123091] Updated weights for policy 0, policy_version 59513 (0.0007) [2023-12-26 00:02:59,138][123090] Updated weights for policy 1, policy_version 59254 (0.0010) [2023-12-26 00:02:59,205][123090] Updated weights for policy 1, policy_version 59264 (0.0009) [2023-12-26 00:02:59,977][123091] Updated weights for policy 0, policy_version 59523 (0.0008) [2023-12-26 00:03:00,042][123090] Updated weights for policy 1, policy_version 59274 (0.0007) [2023-12-26 00:03:00,045][123091] Updated weights for policy 0, policy_version 59533 (0.0008) [2023-12-26 00:03:00,109][123091] Updated weights for policy 0, policy_version 59543 (0.0008) [2023-12-26 00:03:00,111][123090] Updated weights for policy 1, policy_version 59284 (0.0006) [2023-12-26 00:03:00,168][123090] Updated weights for policy 1, policy_version 59294 (0.0006) [2023-12-26 00:03:00,973][123090] Updated weights for policy 1, policy_version 59304 (0.0009) [2023-12-26 00:03:00,987][123091] Updated weights for policy 0, policy_version 59553 (0.0008) [2023-12-26 00:03:01,040][123090] Updated weights for policy 1, policy_version 59314 (0.0010) [2023-12-26 00:03:01,060][123091] Updated weights for policy 0, policy_version 59563 (0.0008) [2023-12-26 00:03:01,107][123090] Updated weights for policy 1, policy_version 59324 (0.0009) [2023-12-26 00:03:01,116][123091] Updated weights for policy 0, policy_version 59573 (0.0007) [2023-12-26 00:03:01,192][123091] Updated weights for policy 0, policy_version 59583 (0.0009) [2023-12-26 00:03:01,941][123090] Updated weights for policy 1, policy_version 59334 (0.0009) [2023-12-26 00:03:02,006][123090] Updated weights for policy 1, policy_version 59344 (0.0010) [2023-12-26 00:03:02,061][123091] Updated weights for policy 0, policy_version 59593 (0.0006) [2023-12-26 00:03:02,063][123090] Updated weights for policy 1, policy_version 59354 (0.0009) [2023-12-26 00:03:02,122][123091] Updated weights for policy 0, policy_version 59603 (0.0006) [2023-12-26 00:03:02,177][123091] Updated weights for policy 0, policy_version 59613 (0.0006) [2023-12-26 00:03:02,979][123090] Updated weights for policy 1, policy_version 59364 (0.0010) [2023-12-26 00:03:03,013][123091] Updated weights for policy 0, policy_version 59623 (0.0007) [2023-12-26 00:03:03,042][123090] Updated weights for policy 1, policy_version 59374 (0.0011) [2023-12-26 00:03:03,079][123091] Updated weights for policy 0, policy_version 59633 (0.0006) [2023-12-26 00:03:03,111][123090] Updated weights for policy 1, policy_version 59384 (0.0011) [2023-12-26 00:03:03,147][123091] Updated weights for policy 0, policy_version 59643 (0.0007) [2023-12-26 00:03:03,784][121949] Fps is (10 sec: 16383.5, 60 sec: 16383.9, 300 sec: 16828.3). Total num frames: 30474240. Throughput: 0: 8193.9, 1: 8258.6. Samples: 30488992. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:03:03,786][121949] Avg episode reward: [(0, '4317.427'), (1, '5260.031')] [2023-12-26 00:03:03,896][123090] Updated weights for policy 1, policy_version 59394 (0.0009) [2023-12-26 00:03:03,960][123090] Updated weights for policy 1, policy_version 59404 (0.0008) [2023-12-26 00:03:03,976][123091] Updated weights for policy 0, policy_version 59653 (0.0009) [2023-12-26 00:03:04,028][123090] Updated weights for policy 1, policy_version 59414 (0.0008) [2023-12-26 00:03:04,038][123091] Updated weights for policy 0, policy_version 59663 (0.0008) [2023-12-26 00:03:04,091][123090] Updated weights for policy 1, policy_version 59424 (0.0008) [2023-12-26 00:03:04,105][123091] Updated weights for policy 0, policy_version 59673 (0.0007) [2023-12-26 00:03:04,875][123090] Updated weights for policy 1, policy_version 59434 (0.0011) [2023-12-26 00:03:04,948][123090] Updated weights for policy 1, policy_version 59444 (0.0010) [2023-12-26 00:03:05,002][123091] Updated weights for policy 0, policy_version 59683 (0.0009) [2023-12-26 00:03:05,012][123090] Updated weights for policy 1, policy_version 59454 (0.0011) [2023-12-26 00:03:05,066][123091] Updated weights for policy 0, policy_version 59693 (0.0007) [2023-12-26 00:03:05,139][123091] Updated weights for policy 0, policy_version 59703 (0.0007) [2023-12-26 00:03:05,804][123090] Updated weights for policy 1, policy_version 59464 (0.0007) [2023-12-26 00:03:05,819][123091] Updated weights for policy 0, policy_version 59713 (0.0008) [2023-12-26 00:03:05,866][123090] Updated weights for policy 1, policy_version 59474 (0.0006) [2023-12-26 00:03:05,878][123091] Updated weights for policy 0, policy_version 59723 (0.0009) [2023-12-26 00:03:05,922][123090] Updated weights for policy 1, policy_version 59484 (0.0006) [2023-12-26 00:03:05,941][123091] Updated weights for policy 0, policy_version 59733 (0.0008) [2023-12-26 00:03:06,007][123091] Updated weights for policy 0, policy_version 59743 (0.0011) [2023-12-26 00:03:06,695][123090] Updated weights for policy 1, policy_version 59494 (0.0007) [2023-12-26 00:03:06,762][123090] Updated weights for policy 1, policy_version 59504 (0.0006) [2023-12-26 00:03:06,827][123090] Updated weights for policy 1, policy_version 59514 (0.0007) [2023-12-26 00:03:06,844][123091] Updated weights for policy 0, policy_version 59753 (0.0009) [2023-12-26 00:03:06,909][123091] Updated weights for policy 0, policy_version 59763 (0.0007) [2023-12-26 00:03:06,974][123091] Updated weights for policy 0, policy_version 59773 (0.0009) [2023-12-26 00:03:07,555][123090] Updated weights for policy 1, policy_version 59524 (0.0009) [2023-12-26 00:03:07,623][123090] Updated weights for policy 1, policy_version 59534 (0.0010) [2023-12-26 00:03:07,689][123090] Updated weights for policy 1, policy_version 59544 (0.0009) [2023-12-26 00:03:07,835][123091] Updated weights for policy 0, policy_version 59783 (0.0009) [2023-12-26 00:03:07,896][123091] Updated weights for policy 0, policy_version 59793 (0.0010) [2023-12-26 00:03:07,960][123091] Updated weights for policy 0, policy_version 59803 (0.0010) [2023-12-26 00:03:08,528][123090] Updated weights for policy 1, policy_version 59554 (0.0010) [2023-12-26 00:03:08,593][123090] Updated weights for policy 1, policy_version 59564 (0.0010) [2023-12-26 00:03:08,659][123090] Updated weights for policy 1, policy_version 59574 (0.0009) [2023-12-26 00:03:08,728][123090] Updated weights for policy 1, policy_version 59584 (0.0010) [2023-12-26 00:03:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16520.5, 300 sec: 16828.3). Total num frames: 30564352. Throughput: 0: 8253.1, 1: 8330.9. Samples: 30541940. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:03:08,785][121949] Avg episode reward: [(0, '4324.566'), (1, '5200.609')] [2023-12-26 00:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000059584_15253504.pth... [2023-12-26 00:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000059808_15310848.pth... [2023-12-26 00:03:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000058848_15065088.pth [2023-12-26 00:03:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000058592_14999552.pth [2023-12-26 00:03:08,871][123091] Updated weights for policy 0, policy_version 59813 (0.0010) [2023-12-26 00:03:08,921][123091] Updated weights for policy 0, policy_version 59823 (0.0010) [2023-12-26 00:03:08,985][123091] Updated weights for policy 0, policy_version 59833 (0.0008) [2023-12-26 00:03:09,601][123090] Updated weights for policy 1, policy_version 59594 (0.0010) [2023-12-26 00:03:09,674][123090] Updated weights for policy 1, policy_version 59604 (0.0010) [2023-12-26 00:03:09,751][123090] Updated weights for policy 1, policy_version 59614 (0.0011) [2023-12-26 00:03:09,793][123091] Updated weights for policy 0, policy_version 59843 (0.0008) [2023-12-26 00:03:09,864][123091] Updated weights for policy 0, policy_version 59853 (0.0009) [2023-12-26 00:03:09,934][123091] Updated weights for policy 0, policy_version 59863 (0.0009) [2023-12-26 00:03:10,607][123090] Updated weights for policy 1, policy_version 59624 (0.0010) [2023-12-26 00:03:10,665][123090] Updated weights for policy 1, policy_version 59634 (0.0009) [2023-12-26 00:03:10,722][123090] Updated weights for policy 1, policy_version 59644 (0.0010) [2023-12-26 00:03:10,744][123091] Updated weights for policy 0, policy_version 59873 (0.0009) [2023-12-26 00:03:10,797][123091] Updated weights for policy 0, policy_version 59883 (0.0009) [2023-12-26 00:03:10,855][123091] Updated weights for policy 0, policy_version 59893 (0.0008) [2023-12-26 00:03:10,923][123091] Updated weights for policy 0, policy_version 59903 (0.0006) [2023-12-26 00:03:11,598][123090] Updated weights for policy 1, policy_version 59654 (0.0010) [2023-12-26 00:03:11,661][123090] Updated weights for policy 1, policy_version 59664 (0.0009) [2023-12-26 00:03:11,728][123090] Updated weights for policy 1, policy_version 59674 (0.0009) [2023-12-26 00:03:11,776][123091] Updated weights for policy 0, policy_version 59913 (0.0009) [2023-12-26 00:03:11,848][123091] Updated weights for policy 0, policy_version 59923 (0.0010) [2023-12-26 00:03:11,913][123091] Updated weights for policy 0, policy_version 59933 (0.0009) [2023-12-26 00:03:12,597][123090] Updated weights for policy 1, policy_version 59684 (0.0009) [2023-12-26 00:03:12,667][123090] Updated weights for policy 1, policy_version 59694 (0.0009) [2023-12-26 00:03:12,737][123090] Updated weights for policy 1, policy_version 59704 (0.0009) [2023-12-26 00:03:12,797][123091] Updated weights for policy 0, policy_version 59943 (0.0011) [2023-12-26 00:03:12,855][123091] Updated weights for policy 0, policy_version 59953 (0.0011) [2023-12-26 00:03:12,911][123091] Updated weights for policy 0, policy_version 59963 (0.0011) [2023-12-26 00:03:13,582][123090] Updated weights for policy 1, policy_version 59714 (0.0008) [2023-12-26 00:03:13,653][123090] Updated weights for policy 1, policy_version 59724 (0.0010) [2023-12-26 00:03:13,713][123090] Updated weights for policy 1, policy_version 59734 (0.0010) [2023-12-26 00:03:13,761][123091] Updated weights for policy 0, policy_version 59973 (0.0008) [2023-12-26 00:03:13,767][123090] Updated weights for policy 1, policy_version 59744 (0.0009) [2023-12-26 00:03:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 16520.5, 300 sec: 16800.5). Total num frames: 30646272. Throughput: 0: 8233.2, 1: 8311.9. Samples: 30640744. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:03:13,785][121949] Avg episode reward: [(0, '4328.881'), (1, '5223.854')] [2023-12-26 00:03:13,836][123091] Updated weights for policy 0, policy_version 59983 (0.0006) [2023-12-26 00:03:13,907][123091] Updated weights for policy 0, policy_version 59993 (0.0011) [2023-12-26 00:03:14,625][123091] Updated weights for policy 0, policy_version 60003 (0.0011) [2023-12-26 00:03:14,665][123090] Updated weights for policy 1, policy_version 59754 (0.0005) [2023-12-26 00:03:14,690][123091] Updated weights for policy 0, policy_version 60013 (0.0011) [2023-12-26 00:03:14,730][123090] Updated weights for policy 1, policy_version 59764 (0.0008) [2023-12-26 00:03:14,757][123091] Updated weights for policy 0, policy_version 60023 (0.0008) [2023-12-26 00:03:14,801][123090] Updated weights for policy 1, policy_version 59774 (0.0009) [2023-12-26 00:03:15,585][123091] Updated weights for policy 0, policy_version 60033 (0.0009) [2023-12-26 00:03:15,605][123090] Updated weights for policy 1, policy_version 59784 (0.0008) [2023-12-26 00:03:15,649][123091] Updated weights for policy 0, policy_version 60043 (0.0008) [2023-12-26 00:03:15,667][123090] Updated weights for policy 1, policy_version 59794 (0.0008) [2023-12-26 00:03:15,709][123091] Updated weights for policy 0, policy_version 60053 (0.0008) [2023-12-26 00:03:15,725][123090] Updated weights for policy 1, policy_version 59804 (0.0009) [2023-12-26 00:03:15,775][123091] Updated weights for policy 0, policy_version 60063 (0.0008) [2023-12-26 00:03:16,579][123090] Updated weights for policy 1, policy_version 59814 (0.0007) [2023-12-26 00:03:16,596][123091] Updated weights for policy 0, policy_version 60073 (0.0010) [2023-12-26 00:03:16,641][123090] Updated weights for policy 1, policy_version 59824 (0.0006) [2023-12-26 00:03:16,664][123091] Updated weights for policy 0, policy_version 60083 (0.0009) [2023-12-26 00:03:16,688][123090] Updated weights for policy 1, policy_version 59834 (0.0005) [2023-12-26 00:03:16,729][123091] Updated weights for policy 0, policy_version 60093 (0.0010) [2023-12-26 00:03:17,479][123091] Updated weights for policy 0, policy_version 60103 (0.0010) [2023-12-26 00:03:17,509][123090] Updated weights for policy 1, policy_version 59844 (0.0007) [2023-12-26 00:03:17,544][123091] Updated weights for policy 0, policy_version 60113 (0.0009) [2023-12-26 00:03:17,568][123090] Updated weights for policy 1, policy_version 59854 (0.0009) [2023-12-26 00:03:17,601][123091] Updated weights for policy 0, policy_version 60123 (0.0008) [2023-12-26 00:03:17,616][123090] Updated weights for policy 1, policy_version 59864 (0.0008) [2023-12-26 00:03:18,463][123091] Updated weights for policy 0, policy_version 60133 (0.0009) [2023-12-26 00:03:18,493][123090] Updated weights for policy 1, policy_version 59874 (0.0009) [2023-12-26 00:03:18,528][123091] Updated weights for policy 0, policy_version 60143 (0.0007) [2023-12-26 00:03:18,561][123090] Updated weights for policy 1, policy_version 59884 (0.0010) [2023-12-26 00:03:18,595][123091] Updated weights for policy 0, policy_version 60153 (0.0008) [2023-12-26 00:03:18,630][123090] Updated weights for policy 1, policy_version 59894 (0.0007) [2023-12-26 00:03:18,701][123090] Updated weights for policy 1, policy_version 59904 (0.0009) [2023-12-26 00:03:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 30736384. Throughput: 0: 8291.2, 1: 8324.6. Samples: 30742364. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:18,785][121949] Avg episode reward: [(0, '4333.146'), (1, '5232.756')] [2023-12-26 00:03:19,491][123091] Updated weights for policy 0, policy_version 60163 (0.0009) [2023-12-26 00:03:19,563][123091] Updated weights for policy 0, policy_version 60173 (0.0009) [2023-12-26 00:03:19,585][123090] Updated weights for policy 1, policy_version 59914 (0.0008) [2023-12-26 00:03:19,631][123091] Updated weights for policy 0, policy_version 60183 (0.0010) [2023-12-26 00:03:19,660][123090] Updated weights for policy 1, policy_version 59924 (0.0008) [2023-12-26 00:03:19,737][123090] Updated weights for policy 1, policy_version 59934 (0.0009) [2023-12-26 00:03:20,500][123091] Updated weights for policy 0, policy_version 60193 (0.0008) [2023-12-26 00:03:20,572][123091] Updated weights for policy 0, policy_version 60203 (0.0010) [2023-12-26 00:03:20,588][123090] Updated weights for policy 1, policy_version 59944 (0.0008) [2023-12-26 00:03:20,643][123091] Updated weights for policy 0, policy_version 60213 (0.0011) [2023-12-26 00:03:20,657][123090] Updated weights for policy 1, policy_version 59954 (0.0009) [2023-12-26 00:03:20,712][123091] Updated weights for policy 0, policy_version 60223 (0.0011) [2023-12-26 00:03:20,726][123090] Updated weights for policy 1, policy_version 59964 (0.0009) [2023-12-26 00:03:21,582][123090] Updated weights for policy 1, policy_version 59974 (0.0008) [2023-12-26 00:03:21,608][123091] Updated weights for policy 0, policy_version 60233 (0.0008) [2023-12-26 00:03:21,665][123090] Updated weights for policy 1, policy_version 59984 (0.0008) [2023-12-26 00:03:21,682][123091] Updated weights for policy 0, policy_version 60243 (0.0008) [2023-12-26 00:03:21,745][123090] Updated weights for policy 1, policy_version 59994 (0.0009) [2023-12-26 00:03:21,762][123091] Updated weights for policy 0, policy_version 60253 (0.0012) [2023-12-26 00:03:22,619][123091] Updated weights for policy 0, policy_version 60263 (0.0010) [2023-12-26 00:03:22,623][123090] Updated weights for policy 1, policy_version 60004 (0.0008) [2023-12-26 00:03:22,684][123090] Updated weights for policy 1, policy_version 60014 (0.0007) [2023-12-26 00:03:22,684][123091] Updated weights for policy 0, policy_version 60273 (0.0010) [2023-12-26 00:03:22,748][123091] Updated weights for policy 0, policy_version 60283 (0.0008) [2023-12-26 00:03:22,750][123090] Updated weights for policy 1, policy_version 60024 (0.0008) [2023-12-26 00:03:23,611][123090] Updated weights for policy 1, policy_version 60034 (0.0009) [2023-12-26 00:03:23,624][123091] Updated weights for policy 0, policy_version 60293 (0.0010) [2023-12-26 00:03:23,680][123090] Updated weights for policy 1, policy_version 60044 (0.0008) [2023-12-26 00:03:23,694][123091] Updated weights for policy 0, policy_version 60303 (0.0011) [2023-12-26 00:03:23,754][123090] Updated weights for policy 1, policy_version 60054 (0.0009) [2023-12-26 00:03:23,761][123091] Updated weights for policy 0, policy_version 60313 (0.0010) [2023-12-26 00:03:23,784][121949] Fps is (10 sec: 15564.8, 60 sec: 16384.0, 300 sec: 16745.0). Total num frames: 30801920. Throughput: 0: 8270.4, 1: 8279.8. Samples: 30789848. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:23,785][121949] Avg episode reward: [(0, '4303.517'), (1, '5147.275')] [2023-12-26 00:03:23,803][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000060320_15441920.pth... [2023-12-26 00:03:23,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000059328_15187968.pth [2023-12-26 00:03:23,827][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000060064_15376384.pth... [2023-12-26 00:03:23,830][123090] Updated weights for policy 1, policy_version 60064 (0.0009) [2023-12-26 00:03:23,831][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000059072_15122432.pth [2023-12-26 00:03:24,590][123091] Updated weights for policy 0, policy_version 60323 (0.0009) [2023-12-26 00:03:24,657][123091] Updated weights for policy 0, policy_version 60333 (0.0011) [2023-12-26 00:03:24,704][123090] Updated weights for policy 1, policy_version 60074 (0.0007) [2023-12-26 00:03:24,727][123091] Updated weights for policy 0, policy_version 60343 (0.0011) [2023-12-26 00:03:24,770][123090] Updated weights for policy 1, policy_version 60084 (0.0009) [2023-12-26 00:03:24,827][123090] Updated weights for policy 1, policy_version 60094 (0.0009) [2023-12-26 00:03:25,553][123091] Updated weights for policy 0, policy_version 60353 (0.0010) [2023-12-26 00:03:25,607][123091] Updated weights for policy 0, policy_version 60363 (0.0009) [2023-12-26 00:03:25,664][123091] Updated weights for policy 0, policy_version 60373 (0.0009) [2023-12-26 00:03:25,721][123090] Updated weights for policy 1, policy_version 60104 (0.0007) [2023-12-26 00:03:25,734][123091] Updated weights for policy 0, policy_version 60383 (0.0009) [2023-12-26 00:03:25,782][123090] Updated weights for policy 1, policy_version 60114 (0.0007) [2023-12-26 00:03:25,850][123090] Updated weights for policy 1, policy_version 60124 (0.0007) [2023-12-26 00:03:26,631][123091] Updated weights for policy 0, policy_version 60393 (0.0009) [2023-12-26 00:03:26,636][123090] Updated weights for policy 1, policy_version 60134 (0.0006) [2023-12-26 00:03:26,677][123091] Updated weights for policy 0, policy_version 60403 (0.0009) [2023-12-26 00:03:26,703][123090] Updated weights for policy 1, policy_version 60144 (0.0007) [2023-12-26 00:03:26,726][123091] Updated weights for policy 0, policy_version 60413 (0.0005) [2023-12-26 00:03:26,767][123090] Updated weights for policy 1, policy_version 60154 (0.0010) [2023-12-26 00:03:27,545][123090] Updated weights for policy 1, policy_version 60164 (0.0008) [2023-12-26 00:03:27,578][123091] Updated weights for policy 0, policy_version 60423 (0.0007) [2023-12-26 00:03:27,617][123090] Updated weights for policy 1, policy_version 60174 (0.0005) [2023-12-26 00:03:27,640][123091] Updated weights for policy 0, policy_version 60433 (0.0009) [2023-12-26 00:03:27,682][123090] Updated weights for policy 1, policy_version 60184 (0.0008) [2023-12-26 00:03:27,693][123091] Updated weights for policy 0, policy_version 60443 (0.0008) [2023-12-26 00:03:28,344][123090] Updated weights for policy 1, policy_version 60194 (0.0006) [2023-12-26 00:03:28,400][123090] Updated weights for policy 1, policy_version 60204 (0.0007) [2023-12-26 00:03:28,465][123090] Updated weights for policy 1, policy_version 60214 (0.0008) [2023-12-26 00:03:28,533][123090] Updated weights for policy 1, policy_version 60224 (0.0009) [2023-12-26 00:03:28,648][123091] Updated weights for policy 0, policy_version 60453 (0.0010) [2023-12-26 00:03:28,700][123091] Updated weights for policy 0, policy_version 60463 (0.0010) [2023-12-26 00:03:28,751][123091] Updated weights for policy 0, policy_version 60473 (0.0009) [2023-12-26 00:03:28,784][121949] Fps is (10 sec: 15565.1, 60 sec: 16520.5, 300 sec: 16745.0). Total num frames: 30892032. Throughput: 0: 8296.1, 1: 8327.8. Samples: 30888720. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:28,784][121949] Avg episode reward: [(0, '4376.372'), (1, '5170.248')] [2023-12-26 00:03:28,788][123007] Saving new best policy, reward=4376.372! [2023-12-26 00:03:29,275][123090] Updated weights for policy 1, policy_version 60234 (0.0008) [2023-12-26 00:03:29,350][123090] Updated weights for policy 1, policy_version 60244 (0.0010) [2023-12-26 00:03:29,422][123090] Updated weights for policy 1, policy_version 60254 (0.0009) [2023-12-26 00:03:29,642][123091] Updated weights for policy 0, policy_version 60483 (0.0009) [2023-12-26 00:03:29,714][123091] Updated weights for policy 0, policy_version 60493 (0.0008) [2023-12-26 00:03:29,774][123091] Updated weights for policy 0, policy_version 60503 (0.0008) [2023-12-26 00:03:30,244][123090] Updated weights for policy 1, policy_version 60264 (0.0006) [2023-12-26 00:03:30,294][123090] Updated weights for policy 1, policy_version 60274 (0.0005) [2023-12-26 00:03:30,351][123090] Updated weights for policy 1, policy_version 60284 (0.0005) [2023-12-26 00:03:30,642][123091] Updated weights for policy 0, policy_version 60513 (0.0009) [2023-12-26 00:03:30,703][123091] Updated weights for policy 0, policy_version 60523 (0.0010) [2023-12-26 00:03:30,757][123091] Updated weights for policy 0, policy_version 60533 (0.0010) [2023-12-26 00:03:30,809][123091] Updated weights for policy 0, policy_version 60543 (0.0010) [2023-12-26 00:03:31,023][123090] Updated weights for policy 1, policy_version 60294 (0.0007) [2023-12-26 00:03:31,088][123090] Updated weights for policy 1, policy_version 60304 (0.0009) [2023-12-26 00:03:31,166][123090] Updated weights for policy 1, policy_version 60314 (0.0009) [2023-12-26 00:03:31,757][123091] Updated weights for policy 0, policy_version 60553 (0.0009) [2023-12-26 00:03:31,822][123091] Updated weights for policy 0, policy_version 60563 (0.0009) [2023-12-26 00:03:31,881][123091] Updated weights for policy 0, policy_version 60573 (0.0010) [2023-12-26 00:03:32,076][123090] Updated weights for policy 1, policy_version 60324 (0.0010) [2023-12-26 00:03:32,138][123090] Updated weights for policy 1, policy_version 60334 (0.0010) [2023-12-26 00:03:32,193][123090] Updated weights for policy 1, policy_version 60344 (0.0009) [2023-12-26 00:03:32,675][123091] Updated weights for policy 0, policy_version 60583 (0.0011) [2023-12-26 00:03:32,741][123091] Updated weights for policy 0, policy_version 60593 (0.0009) [2023-12-26 00:03:32,811][123091] Updated weights for policy 0, policy_version 60603 (0.0009) [2023-12-26 00:03:33,034][123090] Updated weights for policy 1, policy_version 60354 (0.0009) [2023-12-26 00:03:33,100][123090] Updated weights for policy 1, policy_version 60364 (0.0010) [2023-12-26 00:03:33,165][123090] Updated weights for policy 1, policy_version 60374 (0.0011) [2023-12-26 00:03:33,222][123090] Updated weights for policy 1, policy_version 60384 (0.0011) [2023-12-26 00:03:33,586][123091] Updated weights for policy 0, policy_version 60613 (0.0008) [2023-12-26 00:03:33,657][123091] Updated weights for policy 0, policy_version 60623 (0.0007) [2023-12-26 00:03:33,714][123091] Updated weights for policy 0, policy_version 60633 (0.0005) [2023-12-26 00:03:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 30982144. Throughput: 0: 8288.0, 1: 8411.0. Samples: 30991036. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:33,784][121949] Avg episode reward: [(0, '4432.264'), (1, '5271.528')] [2023-12-26 00:03:33,785][123007] Saving new best policy, reward=4432.264! [2023-12-26 00:03:34,015][123090] Updated weights for policy 1, policy_version 60394 (0.0011) [2023-12-26 00:03:34,084][123090] Updated weights for policy 1, policy_version 60404 (0.0010) [2023-12-26 00:03:34,158][123090] Updated weights for policy 1, policy_version 60414 (0.0011) [2023-12-26 00:03:34,452][123091] Updated weights for policy 0, policy_version 60643 (0.0007) [2023-12-26 00:03:34,526][123091] Updated weights for policy 0, policy_version 60653 (0.0009) [2023-12-26 00:03:34,595][123091] Updated weights for policy 0, policy_version 60663 (0.0009) [2023-12-26 00:03:34,999][123090] Updated weights for policy 1, policy_version 60424 (0.0010) [2023-12-26 00:03:35,063][123090] Updated weights for policy 1, policy_version 60435 (0.0010) [2023-12-26 00:03:35,130][123090] Updated weights for policy 1, policy_version 60445 (0.0009) [2023-12-26 00:03:35,443][123091] Updated weights for policy 0, policy_version 60673 (0.0008) [2023-12-26 00:03:35,502][123091] Updated weights for policy 0, policy_version 60683 (0.0009) [2023-12-26 00:03:35,563][123091] Updated weights for policy 0, policy_version 60693 (0.0009) [2023-12-26 00:03:35,618][123091] Updated weights for policy 0, policy_version 60703 (0.0009) [2023-12-26 00:03:35,979][123090] Updated weights for policy 1, policy_version 60455 (0.0010) [2023-12-26 00:03:36,031][123090] Updated weights for policy 1, policy_version 60465 (0.0009) [2023-12-26 00:03:36,115][123090] Updated weights for policy 1, policy_version 60475 (0.0010) [2023-12-26 00:03:36,499][123091] Updated weights for policy 0, policy_version 60713 (0.0009) [2023-12-26 00:03:36,557][123091] Updated weights for policy 0, policy_version 60723 (0.0010) [2023-12-26 00:03:36,633][123091] Updated weights for policy 0, policy_version 60734 (0.0009) [2023-12-26 00:03:36,953][123090] Updated weights for policy 1, policy_version 60485 (0.0009) [2023-12-26 00:03:37,021][123090] Updated weights for policy 1, policy_version 60495 (0.0009) [2023-12-26 00:03:37,081][123090] Updated weights for policy 1, policy_version 60505 (0.0008) [2023-12-26 00:03:37,524][123091] Updated weights for policy 0, policy_version 60744 (0.0010) [2023-12-26 00:03:37,583][123091] Updated weights for policy 0, policy_version 60755 (0.0010) [2023-12-26 00:03:37,647][123091] Updated weights for policy 0, policy_version 60765 (0.0009) [2023-12-26 00:03:37,799][123090] Updated weights for policy 1, policy_version 60515 (0.0010) [2023-12-26 00:03:37,873][123090] Updated weights for policy 1, policy_version 60525 (0.0009) [2023-12-26 00:03:37,938][123090] Updated weights for policy 1, policy_version 60535 (0.0010) [2023-12-26 00:03:38,483][123091] Updated weights for policy 0, policy_version 60775 (0.0009) [2023-12-26 00:03:38,551][123091] Updated weights for policy 0, policy_version 60785 (0.0010) [2023-12-26 00:03:38,620][123091] Updated weights for policy 0, policy_version 60795 (0.0011) [2023-12-26 00:03:38,765][123090] Updated weights for policy 1, policy_version 60545 (0.0010) [2023-12-26 00:03:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 16657.0, 300 sec: 16745.0). Total num frames: 31064064. Throughput: 0: 8297.9, 1: 8436.8. Samples: 31041680. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:38,785][121949] Avg episode reward: [(0, '4383.170'), (1, '5335.309')] [2023-12-26 00:03:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000060800_15564800.pth... [2023-12-26 00:03:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000059808_15310848.pth [2023-12-26 00:03:38,840][123090] Updated weights for policy 1, policy_version 60555 (0.0010) [2023-12-26 00:03:38,923][123090] Updated weights for policy 1, policy_version 60565 (0.0009) [2023-12-26 00:03:38,987][123090] Updated weights for policy 1, policy_version 60575 (0.0006) [2023-12-26 00:03:38,993][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000060576_15507456.pth... [2023-12-26 00:03:38,998][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000059584_15253504.pth [2023-12-26 00:03:38,998][123008] Saving new best policy, reward=5335.309! [2023-12-26 00:03:39,509][123091] Updated weights for policy 0, policy_version 60805 (0.0010) [2023-12-26 00:03:39,572][123091] Updated weights for policy 0, policy_version 60815 (0.0010) [2023-12-26 00:03:39,633][123091] Updated weights for policy 0, policy_version 60825 (0.0011) [2023-12-26 00:03:39,764][123090] Updated weights for policy 1, policy_version 60585 (0.0008) [2023-12-26 00:03:39,840][123090] Updated weights for policy 1, policy_version 60595 (0.0010) [2023-12-26 00:03:39,915][123090] Updated weights for policy 1, policy_version 60605 (0.0010) [2023-12-26 00:03:40,470][123091] Updated weights for policy 0, policy_version 60835 (0.0009) [2023-12-26 00:03:40,531][123091] Updated weights for policy 0, policy_version 60845 (0.0007) [2023-12-26 00:03:40,609][123091] Updated weights for policy 0, policy_version 60855 (0.0009) [2023-12-26 00:03:40,770][123090] Updated weights for policy 1, policy_version 60615 (0.0009) [2023-12-26 00:03:40,832][123090] Updated weights for policy 1, policy_version 60625 (0.0009) [2023-12-26 00:03:40,891][123090] Updated weights for policy 1, policy_version 60635 (0.0010) [2023-12-26 00:03:41,426][123091] Updated weights for policy 0, policy_version 60865 (0.0008) [2023-12-26 00:03:41,474][123091] Updated weights for policy 0, policy_version 60875 (0.0009) [2023-12-26 00:03:41,530][123091] Updated weights for policy 0, policy_version 60885 (0.0009) [2023-12-26 00:03:41,591][123091] Updated weights for policy 0, policy_version 60895 (0.0009) [2023-12-26 00:03:41,782][123090] Updated weights for policy 1, policy_version 60645 (0.0009) [2023-12-26 00:03:41,851][123090] Updated weights for policy 1, policy_version 60655 (0.0009) [2023-12-26 00:03:41,918][123090] Updated weights for policy 1, policy_version 60665 (0.0009) [2023-12-26 00:03:42,491][123091] Updated weights for policy 0, policy_version 60905 (0.0010) [2023-12-26 00:03:42,561][123091] Updated weights for policy 0, policy_version 60915 (0.0010) [2023-12-26 00:03:42,627][123091] Updated weights for policy 0, policy_version 60925 (0.0010) [2023-12-26 00:03:42,730][123090] Updated weights for policy 1, policy_version 60675 (0.0009) [2023-12-26 00:03:42,801][123090] Updated weights for policy 1, policy_version 60685 (0.0010) [2023-12-26 00:03:42,873][123090] Updated weights for policy 1, policy_version 60695 (0.0009) [2023-12-26 00:03:43,498][123091] Updated weights for policy 0, policy_version 60935 (0.0009) [2023-12-26 00:03:43,550][123091] Updated weights for policy 0, policy_version 60945 (0.0009) [2023-12-26 00:03:43,616][123091] Updated weights for policy 0, policy_version 60955 (0.0010) [2023-12-26 00:03:43,626][123090] Updated weights for policy 1, policy_version 60705 (0.0010) [2023-12-26 00:03:43,684][123090] Updated weights for policy 1, policy_version 60715 (0.0010) [2023-12-26 00:03:43,734][123090] Updated weights for policy 1, policy_version 60725 (0.0010) [2023-12-26 00:03:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 31145984. Throughput: 0: 8279.8, 1: 8431.4. Samples: 31141052. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:43,784][121949] Avg episode reward: [(0, '4377.567'), (1, '5318.149')] [2023-12-26 00:03:43,799][123090] Updated weights for policy 1, policy_version 60735 (0.0008) [2023-12-26 00:03:44,482][123091] Updated weights for policy 0, policy_version 60965 (0.0009) [2023-12-26 00:03:44,547][123091] Updated weights for policy 0, policy_version 60975 (0.0010) [2023-12-26 00:03:44,617][123091] Updated weights for policy 0, policy_version 60985 (0.0009) [2023-12-26 00:03:44,674][123090] Updated weights for policy 1, policy_version 60745 (0.0006) [2023-12-26 00:03:44,744][123090] Updated weights for policy 1, policy_version 60755 (0.0007) [2023-12-26 00:03:44,815][123090] Updated weights for policy 1, policy_version 60765 (0.0009) [2023-12-26 00:03:45,508][123091] Updated weights for policy 0, policy_version 60995 (0.0009) [2023-12-26 00:03:45,575][123091] Updated weights for policy 0, policy_version 61005 (0.0009) [2023-12-26 00:03:45,640][123091] Updated weights for policy 0, policy_version 61015 (0.0007) [2023-12-26 00:03:45,656][123090] Updated weights for policy 1, policy_version 60775 (0.0010) [2023-12-26 00:03:45,721][123090] Updated weights for policy 1, policy_version 60785 (0.0010) [2023-12-26 00:03:45,783][123090] Updated weights for policy 1, policy_version 60795 (0.0009) [2023-12-26 00:03:46,436][123091] Updated weights for policy 0, policy_version 61025 (0.0008) [2023-12-26 00:03:46,503][123091] Updated weights for policy 0, policy_version 61035 (0.0006) [2023-12-26 00:03:46,580][123091] Updated weights for policy 0, policy_version 61045 (0.0006) [2023-12-26 00:03:46,652][123091] Updated weights for policy 0, policy_version 61055 (0.0008) [2023-12-26 00:03:46,654][123090] Updated weights for policy 1, policy_version 60805 (0.0007) [2023-12-26 00:03:46,721][123090] Updated weights for policy 1, policy_version 60815 (0.0006) [2023-12-26 00:03:46,779][123090] Updated weights for policy 1, policy_version 60825 (0.0006) [2023-12-26 00:03:47,482][123091] Updated weights for policy 0, policy_version 61065 (0.0010) [2023-12-26 00:03:47,483][123090] Updated weights for policy 1, policy_version 60835 (0.0010) [2023-12-26 00:03:47,540][123090] Updated weights for policy 1, policy_version 60845 (0.0010) [2023-12-26 00:03:47,543][123091] Updated weights for policy 0, policy_version 61075 (0.0005) [2023-12-26 00:03:47,598][123090] Updated weights for policy 1, policy_version 60855 (0.0009) [2023-12-26 00:03:47,598][123091] Updated weights for policy 0, policy_version 61085 (0.0006) [2023-12-26 00:03:48,432][123091] Updated weights for policy 0, policy_version 61095 (0.0009) [2023-12-26 00:03:48,437][123090] Updated weights for policy 1, policy_version 60865 (0.0008) [2023-12-26 00:03:48,484][123091] Updated weights for policy 0, policy_version 61105 (0.0007) [2023-12-26 00:03:48,503][123090] Updated weights for policy 1, policy_version 60875 (0.0009) [2023-12-26 00:03:48,542][123091] Updated weights for policy 0, policy_version 61115 (0.0008) [2023-12-26 00:03:48,572][123090] Updated weights for policy 1, policy_version 60885 (0.0009) [2023-12-26 00:03:48,636][123090] Updated weights for policy 1, policy_version 60895 (0.0008) [2023-12-26 00:03:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16717.2). Total num frames: 31236096. Throughput: 0: 8284.9, 1: 8457.9. Samples: 31242412. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:48,785][121949] Avg episode reward: [(0, '4314.095'), (1, '5352.696')] [2023-12-26 00:03:48,786][123008] Saving new best policy, reward=5352.696! [2023-12-26 00:03:49,420][123091] Updated weights for policy 0, policy_version 61125 (0.0010) [2023-12-26 00:03:49,481][123090] Updated weights for policy 1, policy_version 60905 (0.0009) [2023-12-26 00:03:49,485][123091] Updated weights for policy 0, policy_version 61135 (0.0010) [2023-12-26 00:03:49,545][123090] Updated weights for policy 1, policy_version 60915 (0.0010) [2023-12-26 00:03:49,552][123091] Updated weights for policy 0, policy_version 61145 (0.0010) [2023-12-26 00:03:49,613][123090] Updated weights for policy 1, policy_version 60925 (0.0009) [2023-12-26 00:03:50,419][123090] Updated weights for policy 1, policy_version 60935 (0.0009) [2023-12-26 00:03:50,434][123091] Updated weights for policy 0, policy_version 61155 (0.0009) [2023-12-26 00:03:50,481][123090] Updated weights for policy 1, policy_version 60945 (0.0008) [2023-12-26 00:03:50,497][123091] Updated weights for policy 0, policy_version 61165 (0.0008) [2023-12-26 00:03:50,546][123090] Updated weights for policy 1, policy_version 60955 (0.0009) [2023-12-26 00:03:50,561][123091] Updated weights for policy 0, policy_version 61175 (0.0009) [2023-12-26 00:03:51,435][123090] Updated weights for policy 1, policy_version 60965 (0.0007) [2023-12-26 00:03:51,502][123091] Updated weights for policy 0, policy_version 61185 (0.0010) [2023-12-26 00:03:51,503][123090] Updated weights for policy 1, policy_version 60975 (0.0006) [2023-12-26 00:03:51,571][123091] Updated weights for policy 0, policy_version 61195 (0.0010) [2023-12-26 00:03:51,573][123090] Updated weights for policy 1, policy_version 60985 (0.0007) [2023-12-26 00:03:51,639][123091] Updated weights for policy 0, policy_version 61205 (0.0010) [2023-12-26 00:03:51,708][123091] Updated weights for policy 0, policy_version 61215 (0.0009) [2023-12-26 00:03:52,333][123090] Updated weights for policy 1, policy_version 60995 (0.0008) [2023-12-26 00:03:52,403][123090] Updated weights for policy 1, policy_version 61005 (0.0009) [2023-12-26 00:03:52,474][123090] Updated weights for policy 1, policy_version 61015 (0.0008) [2023-12-26 00:03:52,578][123091] Updated weights for policy 0, policy_version 61225 (0.0010) [2023-12-26 00:03:52,644][123091] Updated weights for policy 0, policy_version 61235 (0.0010) [2023-12-26 00:03:52,713][123091] Updated weights for policy 0, policy_version 61245 (0.0010) [2023-12-26 00:03:53,291][123090] Updated weights for policy 1, policy_version 61025 (0.0006) [2023-12-26 00:03:53,342][123090] Updated weights for policy 1, policy_version 61035 (0.0009) [2023-12-26 00:03:53,410][123090] Updated weights for policy 1, policy_version 61045 (0.0009) [2023-12-26 00:03:53,468][123090] Updated weights for policy 1, policy_version 61055 (0.0006) [2023-12-26 00:03:53,569][123091] Updated weights for policy 0, policy_version 61255 (0.0010) [2023-12-26 00:03:53,625][123091] Updated weights for policy 0, policy_version 61265 (0.0009) [2023-12-26 00:03:53,696][123091] Updated weights for policy 0, policy_version 61275 (0.0008) [2023-12-26 00:03:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16689.5). Total num frames: 31318016. Throughput: 0: 8235.4, 1: 8415.6. Samples: 31291232. Policy #0 lag: (min: 13.0, avg: 20.8, max: 45.0) [2023-12-26 00:03:53,785][121949] Avg episode reward: [(0, '4343.647'), (1, '5297.947')] [2023-12-26 00:03:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000061280_15687680.pth... [2023-12-26 00:03:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000061056_15630336.pth... [2023-12-26 00:03:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000060320_15441920.pth [2023-12-26 00:03:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000060064_15376384.pth [2023-12-26 00:03:54,319][123090] Updated weights for policy 1, policy_version 61065 (0.0010) [2023-12-26 00:03:54,385][123090] Updated weights for policy 1, policy_version 61075 (0.0009) [2023-12-26 00:03:54,457][123090] Updated weights for policy 1, policy_version 61085 (0.0009) [2023-12-26 00:03:54,560][123091] Updated weights for policy 0, policy_version 61285 (0.0008) [2023-12-26 00:03:54,630][123091] Updated weights for policy 0, policy_version 61295 (0.0006) [2023-12-26 00:03:54,698][123091] Updated weights for policy 0, policy_version 61305 (0.0009) [2023-12-26 00:03:55,267][123090] Updated weights for policy 1, policy_version 61095 (0.0007) [2023-12-26 00:03:55,338][123090] Updated weights for policy 1, policy_version 61105 (0.0006) [2023-12-26 00:03:55,400][123090] Updated weights for policy 1, policy_version 61115 (0.0007) [2023-12-26 00:03:55,542][123091] Updated weights for policy 0, policy_version 61315 (0.0009) [2023-12-26 00:03:55,614][123091] Updated weights for policy 0, policy_version 61325 (0.0009) [2023-12-26 00:03:55,678][123091] Updated weights for policy 0, policy_version 61335 (0.0010) [2023-12-26 00:03:56,081][123090] Updated weights for policy 1, policy_version 61125 (0.0007) [2023-12-26 00:03:56,147][123090] Updated weights for policy 1, policy_version 61135 (0.0010) [2023-12-26 00:03:56,212][123090] Updated weights for policy 1, policy_version 61145 (0.0011) [2023-12-26 00:03:56,558][123091] Updated weights for policy 0, policy_version 61345 (0.0009) [2023-12-26 00:03:56,615][123091] Updated weights for policy 0, policy_version 61355 (0.0011) [2023-12-26 00:03:56,683][123091] Updated weights for policy 0, policy_version 61365 (0.0011) [2023-12-26 00:03:56,743][123091] Updated weights for policy 0, policy_version 61375 (0.0007) [2023-12-26 00:03:56,913][123090] Updated weights for policy 1, policy_version 61155 (0.0010) [2023-12-26 00:03:56,978][123090] Updated weights for policy 1, policy_version 61165 (0.0011) [2023-12-26 00:03:57,046][123090] Updated weights for policy 1, policy_version 61175 (0.0011) [2023-12-26 00:03:57,457][123091] Updated weights for policy 0, policy_version 61385 (0.0006) [2023-12-26 00:03:57,529][123091] Updated weights for policy 0, policy_version 61395 (0.0009) [2023-12-26 00:03:57,588][123091] Updated weights for policy 0, policy_version 61405 (0.0010) [2023-12-26 00:03:57,795][123090] Updated weights for policy 1, policy_version 61185 (0.0010) [2023-12-26 00:03:57,864][123090] Updated weights for policy 1, policy_version 61195 (0.0005) [2023-12-26 00:03:57,932][123090] Updated weights for policy 1, policy_version 61205 (0.0006) [2023-12-26 00:03:57,995][123090] Updated weights for policy 1, policy_version 61215 (0.0009) [2023-12-26 00:03:58,438][123091] Updated weights for policy 0, policy_version 61415 (0.0008) [2023-12-26 00:03:58,503][123091] Updated weights for policy 0, policy_version 61425 (0.0008) [2023-12-26 00:03:58,568][123091] Updated weights for policy 0, policy_version 61435 (0.0009) [2023-12-26 00:03:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16661.7). Total num frames: 31399936. Throughput: 0: 8252.6, 1: 8511.4. Samples: 31395124. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:03:58,785][121949] Avg episode reward: [(0, '4387.502'), (1, '5224.210')] [2023-12-26 00:03:58,788][123090] Updated weights for policy 1, policy_version 61225 (0.0008) [2023-12-26 00:03:58,862][123090] Updated weights for policy 1, policy_version 61235 (0.0008) [2023-12-26 00:03:58,930][123090] Updated weights for policy 1, policy_version 61245 (0.0009) [2023-12-26 00:03:59,424][123091] Updated weights for policy 0, policy_version 61445 (0.0009) [2023-12-26 00:03:59,478][123091] Updated weights for policy 0, policy_version 61455 (0.0009) [2023-12-26 00:03:59,541][123091] Updated weights for policy 0, policy_version 61465 (0.0010) [2023-12-26 00:03:59,699][123090] Updated weights for policy 1, policy_version 61255 (0.0009) [2023-12-26 00:03:59,767][123090] Updated weights for policy 1, policy_version 61265 (0.0008) [2023-12-26 00:03:59,839][123090] Updated weights for policy 1, policy_version 61275 (0.0009) [2023-12-26 00:04:00,351][123091] Updated weights for policy 0, policy_version 61475 (0.0008) [2023-12-26 00:04:00,399][123091] Updated weights for policy 0, policy_version 61485 (0.0008) [2023-12-26 00:04:00,457][123091] Updated weights for policy 0, policy_version 61495 (0.0008) [2023-12-26 00:04:00,596][123090] Updated weights for policy 1, policy_version 61285 (0.0008) [2023-12-26 00:04:00,668][123090] Updated weights for policy 1, policy_version 61295 (0.0005) [2023-12-26 00:04:00,739][123090] Updated weights for policy 1, policy_version 61305 (0.0008) [2023-12-26 00:04:01,262][123091] Updated weights for policy 0, policy_version 61505 (0.0008) [2023-12-26 00:04:01,337][123091] Updated weights for policy 0, policy_version 61515 (0.0009) [2023-12-26 00:04:01,412][123091] Updated weights for policy 0, policy_version 61525 (0.0010) [2023-12-26 00:04:01,474][123091] Updated weights for policy 0, policy_version 61535 (0.0010) [2023-12-26 00:04:01,563][123090] Updated weights for policy 1, policy_version 61315 (0.0008) [2023-12-26 00:04:01,628][123090] Updated weights for policy 1, policy_version 61325 (0.0009) [2023-12-26 00:04:01,700][123090] Updated weights for policy 1, policy_version 61335 (0.0009) [2023-12-26 00:04:02,307][123091] Updated weights for policy 0, policy_version 61545 (0.0007) [2023-12-26 00:04:02,376][123091] Updated weights for policy 0, policy_version 61555 (0.0009) [2023-12-26 00:04:02,445][123091] Updated weights for policy 0, policy_version 61565 (0.0009) [2023-12-26 00:04:02,491][123090] Updated weights for policy 1, policy_version 61345 (0.0011) [2023-12-26 00:04:02,559][123090] Updated weights for policy 1, policy_version 61355 (0.0008) [2023-12-26 00:04:02,632][123090] Updated weights for policy 1, policy_version 61365 (0.0010) [2023-12-26 00:04:02,706][123090] Updated weights for policy 1, policy_version 61375 (0.0010) [2023-12-26 00:04:03,125][123091] Updated weights for policy 0, policy_version 61575 (0.0009) [2023-12-26 00:04:03,189][123091] Updated weights for policy 0, policy_version 61585 (0.0010) [2023-12-26 00:04:03,248][123091] Updated weights for policy 0, policy_version 61595 (0.0009) [2023-12-26 00:04:03,545][123090] Updated weights for policy 1, policy_version 61385 (0.0006) [2023-12-26 00:04:03,590][123090] Updated weights for policy 1, policy_version 61395 (0.0005) [2023-12-26 00:04:03,660][123090] Updated weights for policy 1, policy_version 61405 (0.0008) [2023-12-26 00:04:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16930.2, 300 sec: 16661.7). Total num frames: 31490048. Throughput: 0: 8252.0, 1: 8553.8. Samples: 31498624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:03,785][121949] Avg episode reward: [(0, '4417.863'), (1, '5206.061')] [2023-12-26 00:04:04,135][123091] Updated weights for policy 0, policy_version 61605 (0.0009) [2023-12-26 00:04:04,203][123091] Updated weights for policy 0, policy_version 61615 (0.0009) [2023-12-26 00:04:04,266][123091] Updated weights for policy 0, policy_version 61625 (0.0008) [2023-12-26 00:04:04,476][123090] Updated weights for policy 1, policy_version 61415 (0.0011) [2023-12-26 00:04:04,538][123090] Updated weights for policy 1, policy_version 61425 (0.0011) [2023-12-26 00:04:04,608][123090] Updated weights for policy 1, policy_version 61435 (0.0010) [2023-12-26 00:04:05,118][123091] Updated weights for policy 0, policy_version 61635 (0.0009) [2023-12-26 00:04:05,167][123091] Updated weights for policy 0, policy_version 61645 (0.0009) [2023-12-26 00:04:05,219][123091] Updated weights for policy 0, policy_version 61655 (0.0010) [2023-12-26 00:04:05,415][123090] Updated weights for policy 1, policy_version 61445 (0.0008) [2023-12-26 00:04:05,474][123090] Updated weights for policy 1, policy_version 61455 (0.0010) [2023-12-26 00:04:05,538][123090] Updated weights for policy 1, policy_version 61465 (0.0010) [2023-12-26 00:04:06,056][123091] Updated weights for policy 0, policy_version 61665 (0.0010) [2023-12-26 00:04:06,124][123091] Updated weights for policy 0, policy_version 61675 (0.0009) [2023-12-26 00:04:06,192][123091] Updated weights for policy 0, policy_version 61685 (0.0009) [2023-12-26 00:04:06,263][123091] Updated weights for policy 0, policy_version 61695 (0.0009) [2023-12-26 00:04:06,459][123090] Updated weights for policy 1, policy_version 61475 (0.0010) [2023-12-26 00:04:06,527][123090] Updated weights for policy 1, policy_version 61485 (0.0011) [2023-12-26 00:04:06,595][123090] Updated weights for policy 1, policy_version 61495 (0.0008) [2023-12-26 00:04:07,111][123091] Updated weights for policy 0, policy_version 61705 (0.0008) [2023-12-26 00:04:07,187][123091] Updated weights for policy 0, policy_version 61715 (0.0007) [2023-12-26 00:04:07,260][123091] Updated weights for policy 0, policy_version 61725 (0.0006) [2023-12-26 00:04:07,442][123090] Updated weights for policy 1, policy_version 61505 (0.0007) [2023-12-26 00:04:07,498][123090] Updated weights for policy 1, policy_version 61515 (0.0010) [2023-12-26 00:04:07,553][123090] Updated weights for policy 1, policy_version 61525 (0.0010) [2023-12-26 00:04:07,609][123090] Updated weights for policy 1, policy_version 61535 (0.0010) [2023-12-26 00:04:07,987][123091] Updated weights for policy 0, policy_version 61735 (0.0010) [2023-12-26 00:04:08,051][123091] Updated weights for policy 0, policy_version 61745 (0.0011) [2023-12-26 00:04:08,111][123091] Updated weights for policy 0, policy_version 61755 (0.0011) [2023-12-26 00:04:08,524][123090] Updated weights for policy 1, policy_version 61545 (0.0009) [2023-12-26 00:04:08,590][123090] Updated weights for policy 1, policy_version 61555 (0.0009) [2023-12-26 00:04:08,658][123090] Updated weights for policy 1, policy_version 61565 (0.0010) [2023-12-26 00:04:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16633.9). Total num frames: 31571968. Throughput: 0: 8278.7, 1: 8566.9. Samples: 31547896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:08,785][121949] Avg episode reward: [(0, '4405.428'), (1, '5214.600')] [2023-12-26 00:04:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000061760_15810560.pth... [2023-12-26 00:04:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000061568_15761408.pth... [2023-12-26 00:04:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000060800_15564800.pth [2023-12-26 00:04:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000060576_15507456.pth [2023-12-26 00:04:08,991][123091] Updated weights for policy 0, policy_version 61765 (0.0011) [2023-12-26 00:04:09,060][123091] Updated weights for policy 0, policy_version 61775 (0.0010) [2023-12-26 00:04:09,125][123091] Updated weights for policy 0, policy_version 61785 (0.0011) [2023-12-26 00:04:09,522][123090] Updated weights for policy 1, policy_version 61575 (0.0009) [2023-12-26 00:04:09,587][123090] Updated weights for policy 1, policy_version 61585 (0.0010) [2023-12-26 00:04:09,658][123090] Updated weights for policy 1, policy_version 61595 (0.0010) [2023-12-26 00:04:09,956][123091] Updated weights for policy 0, policy_version 61795 (0.0013) [2023-12-26 00:04:10,023][123091] Updated weights for policy 0, policy_version 61805 (0.0011) [2023-12-26 00:04:10,089][123091] Updated weights for policy 0, policy_version 61815 (0.0009) [2023-12-26 00:04:10,582][123090] Updated weights for policy 1, policy_version 61605 (0.0010) [2023-12-26 00:04:10,646][123090] Updated weights for policy 1, policy_version 61615 (0.0010) [2023-12-26 00:04:10,702][123090] Updated weights for policy 1, policy_version 61625 (0.0010) [2023-12-26 00:04:10,906][123091] Updated weights for policy 0, policy_version 61825 (0.0009) [2023-12-26 00:04:10,975][123091] Updated weights for policy 0, policy_version 61835 (0.0009) [2023-12-26 00:04:11,048][123091] Updated weights for policy 0, policy_version 61845 (0.0009) [2023-12-26 00:04:11,105][123091] Updated weights for policy 0, policy_version 61855 (0.0009) [2023-12-26 00:04:11,592][123090] Updated weights for policy 1, policy_version 61635 (0.0011) [2023-12-26 00:04:11,664][123090] Updated weights for policy 1, policy_version 61645 (0.0011) [2023-12-26 00:04:11,732][123090] Updated weights for policy 1, policy_version 61655 (0.0010) [2023-12-26 00:04:11,984][123091] Updated weights for policy 0, policy_version 61865 (0.0010) [2023-12-26 00:04:12,051][123091] Updated weights for policy 0, policy_version 61875 (0.0007) [2023-12-26 00:04:12,118][123091] Updated weights for policy 0, policy_version 61885 (0.0006) [2023-12-26 00:04:12,551][123090] Updated weights for policy 1, policy_version 61665 (0.0008) [2023-12-26 00:04:12,621][123090] Updated weights for policy 1, policy_version 61675 (0.0008) [2023-12-26 00:04:12,697][123090] Updated weights for policy 1, policy_version 61685 (0.0010) [2023-12-26 00:04:12,765][123090] Updated weights for policy 1, policy_version 61695 (0.0011) [2023-12-26 00:04:12,938][123091] Updated weights for policy 0, policy_version 61895 (0.0006) [2023-12-26 00:04:13,002][123091] Updated weights for policy 0, policy_version 61905 (0.0009) [2023-12-26 00:04:13,069][123091] Updated weights for policy 0, policy_version 61915 (0.0008) [2023-12-26 00:04:13,568][123090] Updated weights for policy 1, policy_version 61705 (0.0007) [2023-12-26 00:04:13,640][123090] Updated weights for policy 1, policy_version 61715 (0.0006) [2023-12-26 00:04:13,705][123090] Updated weights for policy 1, policy_version 61725 (0.0007) [2023-12-26 00:04:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16606.1). Total num frames: 31653888. Throughput: 0: 8315.8, 1: 8545.0. Samples: 31647460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:13,785][121949] Avg episode reward: [(0, '4363.986'), (1, '5158.425')] [2023-12-26 00:04:13,880][123091] Updated weights for policy 0, policy_version 61925 (0.0009) [2023-12-26 00:04:13,951][123091] Updated weights for policy 0, policy_version 61935 (0.0007) [2023-12-26 00:04:14,017][123091] Updated weights for policy 0, policy_version 61945 (0.0008) [2023-12-26 00:04:14,477][123090] Updated weights for policy 1, policy_version 61735 (0.0009) [2023-12-26 00:04:14,541][123090] Updated weights for policy 1, policy_version 61745 (0.0011) [2023-12-26 00:04:14,594][123090] Updated weights for policy 1, policy_version 61755 (0.0010) [2023-12-26 00:04:14,846][123091] Updated weights for policy 0, policy_version 61955 (0.0011) [2023-12-26 00:04:14,920][123091] Updated weights for policy 0, policy_version 61965 (0.0011) [2023-12-26 00:04:14,994][123091] Updated weights for policy 0, policy_version 61975 (0.0010) [2023-12-26 00:04:15,423][123090] Updated weights for policy 1, policy_version 61765 (0.0009) [2023-12-26 00:04:15,492][123090] Updated weights for policy 1, policy_version 61775 (0.0006) [2023-12-26 00:04:15,555][123090] Updated weights for policy 1, policy_version 61785 (0.0006) [2023-12-26 00:04:15,816][123091] Updated weights for policy 0, policy_version 61985 (0.0011) [2023-12-26 00:04:15,869][123091] Updated weights for policy 0, policy_version 61995 (0.0011) [2023-12-26 00:04:15,933][123091] Updated weights for policy 0, policy_version 62005 (0.0011) [2023-12-26 00:04:16,000][123091] Updated weights for policy 0, policy_version 62015 (0.0011) [2023-12-26 00:04:16,287][123090] Updated weights for policy 1, policy_version 61795 (0.0007) [2023-12-26 00:04:16,353][123090] Updated weights for policy 1, policy_version 61805 (0.0006) [2023-12-26 00:04:16,422][123090] Updated weights for policy 1, policy_version 61815 (0.0006) [2023-12-26 00:04:16,793][123091] Updated weights for policy 0, policy_version 62025 (0.0011) [2023-12-26 00:04:16,841][123091] Updated weights for policy 0, policy_version 62035 (0.0010) [2023-12-26 00:04:16,907][123091] Updated weights for policy 0, policy_version 62045 (0.0006) [2023-12-26 00:04:17,233][123090] Updated weights for policy 1, policy_version 61825 (0.0009) [2023-12-26 00:04:17,298][123090] Updated weights for policy 1, policy_version 61835 (0.0007) [2023-12-26 00:04:17,351][123090] Updated weights for policy 1, policy_version 61845 (0.0009) [2023-12-26 00:04:17,418][123090] Updated weights for policy 1, policy_version 61855 (0.0010) [2023-12-26 00:04:17,661][123091] Updated weights for policy 0, policy_version 62055 (0.0008) [2023-12-26 00:04:17,730][123091] Updated weights for policy 0, policy_version 62065 (0.0008) [2023-12-26 00:04:17,805][123091] Updated weights for policy 0, policy_version 62075 (0.0009) [2023-12-26 00:04:18,237][123090] Updated weights for policy 1, policy_version 61865 (0.0010) [2023-12-26 00:04:18,297][123090] Updated weights for policy 1, policy_version 61875 (0.0011) [2023-12-26 00:04:18,373][123090] Updated weights for policy 1, policy_version 61885 (0.0011) [2023-12-26 00:04:18,618][123091] Updated weights for policy 0, policy_version 62085 (0.0010) [2023-12-26 00:04:18,681][123091] Updated weights for policy 0, policy_version 62095 (0.0010) [2023-12-26 00:04:18,745][123091] Updated weights for policy 0, policy_version 62105 (0.0009) [2023-12-26 00:04:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16606.2). Total num frames: 31744000. Throughput: 0: 8394.6, 1: 8520.2. Samples: 31752204. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:18,785][121949] Avg episode reward: [(0, '4364.935'), (1, '5254.099')] [2023-12-26 00:04:19,232][123090] Updated weights for policy 1, policy_version 61895 (0.0011) [2023-12-26 00:04:19,303][123090] Updated weights for policy 1, policy_version 61905 (0.0010) [2023-12-26 00:04:19,379][123090] Updated weights for policy 1, policy_version 61915 (0.0007) [2023-12-26 00:04:19,592][123091] Updated weights for policy 0, policy_version 62115 (0.0009) [2023-12-26 00:04:19,659][123091] Updated weights for policy 0, policy_version 62125 (0.0010) [2023-12-26 00:04:19,720][123091] Updated weights for policy 0, policy_version 62135 (0.0010) [2023-12-26 00:04:20,281][123090] Updated weights for policy 1, policy_version 61925 (0.0008) [2023-12-26 00:04:20,349][123090] Updated weights for policy 1, policy_version 61935 (0.0009) [2023-12-26 00:04:20,418][123090] Updated weights for policy 1, policy_version 61945 (0.0010) [2023-12-26 00:04:20,573][123091] Updated weights for policy 0, policy_version 62145 (0.0010) [2023-12-26 00:04:20,646][123091] Updated weights for policy 0, policy_version 62155 (0.0011) [2023-12-26 00:04:20,711][123091] Updated weights for policy 0, policy_version 62165 (0.0010) [2023-12-26 00:04:20,778][123091] Updated weights for policy 0, policy_version 62175 (0.0009) [2023-12-26 00:04:21,287][123090] Updated weights for policy 1, policy_version 61955 (0.0010) [2023-12-26 00:04:21,358][123090] Updated weights for policy 1, policy_version 61965 (0.0010) [2023-12-26 00:04:21,431][123090] Updated weights for policy 1, policy_version 61975 (0.0009) [2023-12-26 00:04:21,669][123091] Updated weights for policy 0, policy_version 62185 (0.0009) [2023-12-26 00:04:21,740][123091] Updated weights for policy 0, policy_version 62195 (0.0010) [2023-12-26 00:04:21,807][123091] Updated weights for policy 0, policy_version 62205 (0.0010) [2023-12-26 00:04:22,332][123090] Updated weights for policy 1, policy_version 61985 (0.0008) [2023-12-26 00:04:22,406][123090] Updated weights for policy 1, policy_version 61995 (0.0008) [2023-12-26 00:04:22,478][123090] Updated weights for policy 1, policy_version 62005 (0.0009) [2023-12-26 00:04:22,542][123090] Updated weights for policy 1, policy_version 62015 (0.0009) [2023-12-26 00:04:22,626][123091] Updated weights for policy 0, policy_version 62215 (0.0010) [2023-12-26 00:04:22,689][123091] Updated weights for policy 0, policy_version 62225 (0.0009) [2023-12-26 00:04:22,744][123091] Updated weights for policy 0, policy_version 62235 (0.0008) [2023-12-26 00:04:23,438][123090] Updated weights for policy 1, policy_version 62025 (0.0008) [2023-12-26 00:04:23,503][123090] Updated weights for policy 1, policy_version 62035 (0.0009) [2023-12-26 00:04:23,511][123091] Updated weights for policy 0, policy_version 62245 (0.0006) [2023-12-26 00:04:23,570][123090] Updated weights for policy 1, policy_version 62045 (0.0008) [2023-12-26 00:04:23,571][123091] Updated weights for policy 0, policy_version 62255 (0.0006) [2023-12-26 00:04:23,616][123091] Updated weights for policy 0, policy_version 62265 (0.0005) [2023-12-26 00:04:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 16578.4). Total num frames: 31825920. Throughput: 0: 8369.7, 1: 8491.0. Samples: 31800408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:23,785][121949] Avg episode reward: [(0, '4430.614'), (1, '5252.395')] [2023-12-26 00:04:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000062272_15941632.pth... [2023-12-26 00:04:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000062048_15884288.pth... [2023-12-26 00:04:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000061056_15630336.pth [2023-12-26 00:04:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000061280_15687680.pth [2023-12-26 00:04:24,388][123091] Updated weights for policy 0, policy_version 62275 (0.0008) [2023-12-26 00:04:24,458][123091] Updated weights for policy 0, policy_version 62285 (0.0011) [2023-12-26 00:04:24,465][123090] Updated weights for policy 1, policy_version 62055 (0.0007) [2023-12-26 00:04:24,524][123091] Updated weights for policy 0, policy_version 62295 (0.0011) [2023-12-26 00:04:24,532][123090] Updated weights for policy 1, policy_version 62065 (0.0006) [2023-12-26 00:04:24,603][123090] Updated weights for policy 1, policy_version 62075 (0.0007) [2023-12-26 00:04:25,246][123091] Updated weights for policy 0, policy_version 62305 (0.0011) [2023-12-26 00:04:25,306][123091] Updated weights for policy 0, policy_version 62315 (0.0011) [2023-12-26 00:04:25,377][123091] Updated weights for policy 0, policy_version 62325 (0.0011) [2023-12-26 00:04:25,445][123091] Updated weights for policy 0, policy_version 62335 (0.0011) [2023-12-26 00:04:25,507][123090] Updated weights for policy 1, policy_version 62085 (0.0009) [2023-12-26 00:04:25,566][123090] Updated weights for policy 1, policy_version 62095 (0.0006) [2023-12-26 00:04:25,625][123090] Updated weights for policy 1, policy_version 62105 (0.0005) [2023-12-26 00:04:26,275][123091] Updated weights for policy 0, policy_version 62345 (0.0009) [2023-12-26 00:04:26,332][123091] Updated weights for policy 0, policy_version 62355 (0.0009) [2023-12-26 00:04:26,392][123091] Updated weights for policy 0, policy_version 62365 (0.0010) [2023-12-26 00:04:26,411][123090] Updated weights for policy 1, policy_version 62115 (0.0007) [2023-12-26 00:04:26,460][123090] Updated weights for policy 1, policy_version 62125 (0.0009) [2023-12-26 00:04:26,513][123090] Updated weights for policy 1, policy_version 62135 (0.0009) [2023-12-26 00:04:27,261][123091] Updated weights for policy 0, policy_version 62375 (0.0009) [2023-12-26 00:04:27,314][123091] Updated weights for policy 0, policy_version 62385 (0.0009) [2023-12-26 00:04:27,379][123091] Updated weights for policy 0, policy_version 62395 (0.0007) [2023-12-26 00:04:27,392][123090] Updated weights for policy 1, policy_version 62145 (0.0010) [2023-12-26 00:04:27,454][123090] Updated weights for policy 1, policy_version 62155 (0.0008) [2023-12-26 00:04:27,514][123090] Updated weights for policy 1, policy_version 62165 (0.0009) [2023-12-26 00:04:27,580][123090] Updated weights for policy 1, policy_version 62175 (0.0009) [2023-12-26 00:04:28,195][123091] Updated weights for policy 0, policy_version 62405 (0.0011) [2023-12-26 00:04:28,242][123091] Updated weights for policy 0, policy_version 62415 (0.0010) [2023-12-26 00:04:28,300][123091] Updated weights for policy 0, policy_version 62425 (0.0010) [2023-12-26 00:04:28,434][123090] Updated weights for policy 1, policy_version 62185 (0.0008) [2023-12-26 00:04:28,494][123090] Updated weights for policy 1, policy_version 62195 (0.0008) [2023-12-26 00:04:28,561][123090] Updated weights for policy 1, policy_version 62205 (0.0008) [2023-12-26 00:04:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 16550.6). Total num frames: 31907840. Throughput: 0: 8460.8, 1: 8440.7. Samples: 31901620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 00:04:28,784][121949] Avg episode reward: [(0, '4378.113'), (1, '5221.100')] [2023-12-26 00:04:29,101][123091] Updated weights for policy 0, policy_version 62435 (0.0011) [2023-12-26 00:04:29,163][123091] Updated weights for policy 0, policy_version 62445 (0.0010) [2023-12-26 00:04:29,227][123091] Updated weights for policy 0, policy_version 62455 (0.0011) [2023-12-26 00:04:29,381][123090] Updated weights for policy 1, policy_version 62215 (0.0009) [2023-12-26 00:04:29,453][123090] Updated weights for policy 1, policy_version 62225 (0.0009) [2023-12-26 00:04:29,516][123090] Updated weights for policy 1, policy_version 62235 (0.0009) [2023-12-26 00:04:30,069][123091] Updated weights for policy 0, policy_version 62465 (0.0011) [2023-12-26 00:04:30,137][123091] Updated weights for policy 0, policy_version 62475 (0.0009) [2023-12-26 00:04:30,199][123091] Updated weights for policy 0, policy_version 62485 (0.0010) [2023-12-26 00:04:30,263][123091] Updated weights for policy 0, policy_version 62495 (0.0010) [2023-12-26 00:04:30,394][123090] Updated weights for policy 1, policy_version 62245 (0.0007) [2023-12-26 00:04:30,460][123090] Updated weights for policy 1, policy_version 62255 (0.0007) [2023-12-26 00:04:30,533][123090] Updated weights for policy 1, policy_version 62265 (0.0006) [2023-12-26 00:04:31,030][123091] Updated weights for policy 0, policy_version 62505 (0.0007) [2023-12-26 00:04:31,103][123091] Updated weights for policy 0, policy_version 62515 (0.0008) [2023-12-26 00:04:31,166][123091] Updated weights for policy 0, policy_version 62525 (0.0008) [2023-12-26 00:04:31,246][123090] Updated weights for policy 1, policy_version 62275 (0.0007) [2023-12-26 00:04:31,322][123090] Updated weights for policy 1, policy_version 62285 (0.0008) [2023-12-26 00:04:31,396][123090] Updated weights for policy 1, policy_version 62295 (0.0008) [2023-12-26 00:04:32,015][123091] Updated weights for policy 0, policy_version 62535 (0.0010) [2023-12-26 00:04:32,081][123091] Updated weights for policy 0, policy_version 62545 (0.0010) [2023-12-26 00:04:32,142][123091] Updated weights for policy 0, policy_version 62555 (0.0010) [2023-12-26 00:04:32,221][123090] Updated weights for policy 1, policy_version 62305 (0.0007) [2023-12-26 00:04:32,292][123090] Updated weights for policy 1, policy_version 62315 (0.0008) [2023-12-26 00:04:32,365][123090] Updated weights for policy 1, policy_version 62325 (0.0010) [2023-12-26 00:04:32,435][123090] Updated weights for policy 1, policy_version 62335 (0.0008) [2023-12-26 00:04:33,010][123091] Updated weights for policy 0, policy_version 62565 (0.0009) [2023-12-26 00:04:33,071][123091] Updated weights for policy 0, policy_version 62575 (0.0009) [2023-12-26 00:04:33,131][123091] Updated weights for policy 0, policy_version 62585 (0.0009) [2023-12-26 00:04:33,255][123090] Updated weights for policy 1, policy_version 62345 (0.0009) [2023-12-26 00:04:33,315][123090] Updated weights for policy 1, policy_version 62355 (0.0009) [2023-12-26 00:04:33,386][123090] Updated weights for policy 1, policy_version 62365 (0.0011) [2023-12-26 00:04:33,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16550.6). Total num frames: 31989760. Throughput: 0: 8486.1, 1: 8432.8. Samples: 32003764. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:33,785][121949] Avg episode reward: [(0, '4353.241'), (1, '5142.376')] [2023-12-26 00:04:33,851][123091] Updated weights for policy 0, policy_version 62595 (0.0008) [2023-12-26 00:04:33,915][123091] Updated weights for policy 0, policy_version 62605 (0.0009) [2023-12-26 00:04:33,973][123091] Updated weights for policy 0, policy_version 62615 (0.0009) [2023-12-26 00:04:34,201][123090] Updated weights for policy 1, policy_version 62375 (0.0011) [2023-12-26 00:04:34,274][123090] Updated weights for policy 1, policy_version 62385 (0.0011) [2023-12-26 00:04:34,346][123090] Updated weights for policy 1, policy_version 62395 (0.0011) [2023-12-26 00:04:34,837][123091] Updated weights for policy 0, policy_version 62625 (0.0009) [2023-12-26 00:04:34,903][123091] Updated weights for policy 0, policy_version 62635 (0.0009) [2023-12-26 00:04:34,964][123091] Updated weights for policy 0, policy_version 62645 (0.0009) [2023-12-26 00:04:35,023][123091] Updated weights for policy 0, policy_version 62655 (0.0009) [2023-12-26 00:04:35,153][123090] Updated weights for policy 1, policy_version 62405 (0.0011) [2023-12-26 00:04:35,209][123090] Updated weights for policy 1, policy_version 62415 (0.0010) [2023-12-26 00:04:35,253][123090] Updated weights for policy 1, policy_version 62425 (0.0010) [2023-12-26 00:04:35,895][123091] Updated weights for policy 0, policy_version 62665 (0.0010) [2023-12-26 00:04:35,953][123091] Updated weights for policy 0, policy_version 62675 (0.0010) [2023-12-26 00:04:36,006][123091] Updated weights for policy 0, policy_version 62685 (0.0010) [2023-12-26 00:04:36,019][123090] Updated weights for policy 1, policy_version 62435 (0.0009) [2023-12-26 00:04:36,071][123090] Updated weights for policy 1, policy_version 62445 (0.0006) [2023-12-26 00:04:36,141][123090] Updated weights for policy 1, policy_version 62455 (0.0008) [2023-12-26 00:04:36,903][123091] Updated weights for policy 0, policy_version 62695 (0.0009) [2023-12-26 00:04:36,968][123091] Updated weights for policy 0, policy_version 62705 (0.0007) [2023-12-26 00:04:37,000][123090] Updated weights for policy 1, policy_version 62465 (0.0011) [2023-12-26 00:04:37,039][123091] Updated weights for policy 0, policy_version 62715 (0.0006) [2023-12-26 00:04:37,068][123090] Updated weights for policy 1, policy_version 62475 (0.0011) [2023-12-26 00:04:37,132][123090] Updated weights for policy 1, policy_version 62485 (0.0011) [2023-12-26 00:04:37,201][123090] Updated weights for policy 1, policy_version 62495 (0.0011) [2023-12-26 00:04:37,804][123091] Updated weights for policy 0, policy_version 62725 (0.0007) [2023-12-26 00:04:37,867][123091] Updated weights for policy 0, policy_version 62735 (0.0007) [2023-12-26 00:04:37,925][123091] Updated weights for policy 0, policy_version 62745 (0.0011) [2023-12-26 00:04:38,024][123090] Updated weights for policy 1, policy_version 62505 (0.0007) [2023-12-26 00:04:38,087][123090] Updated weights for policy 1, policy_version 62515 (0.0006) [2023-12-26 00:04:38,154][123090] Updated weights for policy 1, policy_version 62525 (0.0008) [2023-12-26 00:04:38,763][123091] Updated weights for policy 0, policy_version 62755 (0.0011) [2023-12-26 00:04:38,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 16522.9). Total num frames: 32071680. Throughput: 0: 8499.4, 1: 8466.3. Samples: 32054688. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:38,785][121949] Avg episode reward: [(0, '4336.304'), (1, '5100.916')] [2023-12-26 00:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000062528_16007168.pth... [2023-12-26 00:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000061568_15761408.pth [2023-12-26 00:04:38,835][123091] Updated weights for policy 0, policy_version 62765 (0.0011) [2023-12-26 00:04:38,897][123091] Updated weights for policy 0, policy_version 62775 (0.0010) [2023-12-26 00:04:38,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000062784_16072704.pth... [2023-12-26 00:04:38,962][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000061760_15810560.pth [2023-12-26 00:04:38,984][123090] Updated weights for policy 1, policy_version 62535 (0.0009) [2023-12-26 00:04:39,048][123090] Updated weights for policy 1, policy_version 62545 (0.0009) [2023-12-26 00:04:39,109][123090] Updated weights for policy 1, policy_version 62555 (0.0010) [2023-12-26 00:04:39,758][123091] Updated weights for policy 0, policy_version 62785 (0.0009) [2023-12-26 00:04:39,829][123091] Updated weights for policy 0, policy_version 62795 (0.0009) [2023-12-26 00:04:39,898][123091] Updated weights for policy 0, policy_version 62805 (0.0009) [2023-12-26 00:04:39,972][123091] Updated weights for policy 0, policy_version 62815 (0.0008) [2023-12-26 00:04:40,017][123090] Updated weights for policy 1, policy_version 62565 (0.0010) [2023-12-26 00:04:40,087][123090] Updated weights for policy 1, policy_version 62575 (0.0010) [2023-12-26 00:04:40,152][123090] Updated weights for policy 1, policy_version 62585 (0.0009) [2023-12-26 00:04:40,804][123091] Updated weights for policy 0, policy_version 62825 (0.0010) [2023-12-26 00:04:40,854][123091] Updated weights for policy 0, policy_version 62835 (0.0008) [2023-12-26 00:04:40,911][123091] Updated weights for policy 0, policy_version 62845 (0.0009) [2023-12-26 00:04:41,021][123090] Updated weights for policy 1, policy_version 62595 (0.0010) [2023-12-26 00:04:41,097][123090] Updated weights for policy 1, policy_version 62605 (0.0009) [2023-12-26 00:04:41,169][123090] Updated weights for policy 1, policy_version 62615 (0.0009) [2023-12-26 00:04:41,841][123091] Updated weights for policy 0, policy_version 62855 (0.0009) [2023-12-26 00:04:41,906][123091] Updated weights for policy 0, policy_version 62865 (0.0009) [2023-12-26 00:04:41,975][123091] Updated weights for policy 0, policy_version 62875 (0.0011) [2023-12-26 00:04:41,991][123090] Updated weights for policy 1, policy_version 62625 (0.0008) [2023-12-26 00:04:42,068][123090] Updated weights for policy 1, policy_version 62635 (0.0008) [2023-12-26 00:04:42,136][123090] Updated weights for policy 1, policy_version 62645 (0.0008) [2023-12-26 00:04:42,204][123090] Updated weights for policy 1, policy_version 62655 (0.0008) [2023-12-26 00:04:42,858][123091] Updated weights for policy 0, policy_version 62885 (0.0009) [2023-12-26 00:04:42,913][123091] Updated weights for policy 0, policy_version 62895 (0.0009) [2023-12-26 00:04:42,975][123091] Updated weights for policy 0, policy_version 62905 (0.0008) [2023-12-26 00:04:43,006][123090] Updated weights for policy 1, policy_version 62665 (0.0007) [2023-12-26 00:04:43,066][123090] Updated weights for policy 1, policy_version 62675 (0.0008) [2023-12-26 00:04:43,127][123090] Updated weights for policy 1, policy_version 62685 (0.0009) [2023-12-26 00:04:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16467.3). Total num frames: 32153600. Throughput: 0: 8488.3, 1: 8359.7. Samples: 32153280. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:43,785][121949] Avg episode reward: [(0, '4347.670'), (1, '5091.449')] [2023-12-26 00:04:43,827][123091] Updated weights for policy 0, policy_version 62915 (0.0010) [2023-12-26 00:04:43,876][123091] Updated weights for policy 0, policy_version 62925 (0.0010) [2023-12-26 00:04:43,935][123091] Updated weights for policy 0, policy_version 62935 (0.0005) [2023-12-26 00:04:43,953][123090] Updated weights for policy 1, policy_version 62695 (0.0009) [2023-12-26 00:04:44,025][123090] Updated weights for policy 1, policy_version 62705 (0.0010) [2023-12-26 00:04:44,093][123090] Updated weights for policy 1, policy_version 62715 (0.0011) [2023-12-26 00:04:44,712][123091] Updated weights for policy 0, policy_version 62945 (0.0006) [2023-12-26 00:04:44,793][123091] Updated weights for policy 0, policy_version 62955 (0.0010) [2023-12-26 00:04:44,865][123091] Updated weights for policy 0, policy_version 62965 (0.0009) [2023-12-26 00:04:44,907][123090] Updated weights for policy 1, policy_version 62725 (0.0010) [2023-12-26 00:04:44,923][123091] Updated weights for policy 0, policy_version 62975 (0.0008) [2023-12-26 00:04:44,980][123090] Updated weights for policy 1, policy_version 62735 (0.0009) [2023-12-26 00:04:45,049][123090] Updated weights for policy 1, policy_version 62745 (0.0010) [2023-12-26 00:04:45,719][123091] Updated weights for policy 0, policy_version 62985 (0.0006) [2023-12-26 00:04:45,772][123091] Updated weights for policy 0, policy_version 62995 (0.0005) [2023-12-26 00:04:45,832][123090] Updated weights for policy 1, policy_version 62755 (0.0008) [2023-12-26 00:04:45,840][123091] Updated weights for policy 0, policy_version 63005 (0.0006) [2023-12-26 00:04:45,907][123090] Updated weights for policy 1, policy_version 62765 (0.0009) [2023-12-26 00:04:45,984][123090] Updated weights for policy 1, policy_version 62775 (0.0007) [2023-12-26 00:04:46,552][123091] Updated weights for policy 0, policy_version 63015 (0.0009) [2023-12-26 00:04:46,624][123091] Updated weights for policy 0, policy_version 63025 (0.0010) [2023-12-26 00:04:46,707][123091] Updated weights for policy 0, policy_version 63035 (0.0010) [2023-12-26 00:04:46,825][123090] Updated weights for policy 1, policy_version 62785 (0.0008) [2023-12-26 00:04:46,885][123090] Updated weights for policy 1, policy_version 62795 (0.0009) [2023-12-26 00:04:46,954][123090] Updated weights for policy 1, policy_version 62805 (0.0009) [2023-12-26 00:04:47,021][123090] Updated weights for policy 1, policy_version 62815 (0.0009) [2023-12-26 00:04:47,492][123091] Updated weights for policy 0, policy_version 63045 (0.0009) [2023-12-26 00:04:47,563][123091] Updated weights for policy 0, policy_version 63055 (0.0009) [2023-12-26 00:04:47,624][123091] Updated weights for policy 0, policy_version 63065 (0.0010) [2023-12-26 00:04:47,891][123090] Updated weights for policy 1, policy_version 62825 (0.0009) [2023-12-26 00:04:47,952][123090] Updated weights for policy 1, policy_version 62835 (0.0010) [2023-12-26 00:04:48,009][123090] Updated weights for policy 1, policy_version 62845 (0.0009) [2023-12-26 00:04:48,456][123091] Updated weights for policy 0, policy_version 63075 (0.0009) [2023-12-26 00:04:48,527][123091] Updated weights for policy 0, policy_version 63085 (0.0009) [2023-12-26 00:04:48,593][123091] Updated weights for policy 0, policy_version 63095 (0.0010) [2023-12-26 00:04:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16495.1). Total num frames: 32243712. Throughput: 0: 8483.0, 1: 8341.7. Samples: 32255736. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:48,785][121949] Avg episode reward: [(0, '4388.906'), (1, '5079.168')] [2023-12-26 00:04:48,797][123090] Updated weights for policy 1, policy_version 62855 (0.0008) [2023-12-26 00:04:48,865][123090] Updated weights for policy 1, policy_version 62865 (0.0009) [2023-12-26 00:04:48,932][123090] Updated weights for policy 1, policy_version 62875 (0.0010) [2023-12-26 00:04:49,443][123091] Updated weights for policy 0, policy_version 63105 (0.0010) [2023-12-26 00:04:49,511][123091] Updated weights for policy 0, policy_version 63115 (0.0008) [2023-12-26 00:04:49,582][123091] Updated weights for policy 0, policy_version 63125 (0.0010) [2023-12-26 00:04:49,645][123091] Updated weights for policy 0, policy_version 63135 (0.0011) [2023-12-26 00:04:49,811][123090] Updated weights for policy 1, policy_version 62885 (0.0010) [2023-12-26 00:04:49,885][123090] Updated weights for policy 1, policy_version 62895 (0.0008) [2023-12-26 00:04:49,957][123090] Updated weights for policy 1, policy_version 62905 (0.0008) [2023-12-26 00:04:50,498][123091] Updated weights for policy 0, policy_version 63145 (0.0009) [2023-12-26 00:04:50,557][123091] Updated weights for policy 0, policy_version 63155 (0.0010) [2023-12-26 00:04:50,628][123091] Updated weights for policy 0, policy_version 63165 (0.0008) [2023-12-26 00:04:50,792][123090] Updated weights for policy 1, policy_version 62915 (0.0010) [2023-12-26 00:04:50,863][123090] Updated weights for policy 1, policy_version 62925 (0.0007) [2023-12-26 00:04:50,938][123090] Updated weights for policy 1, policy_version 62935 (0.0009) [2023-12-26 00:04:51,530][123091] Updated weights for policy 0, policy_version 63175 (0.0006) [2023-12-26 00:04:51,608][123091] Updated weights for policy 0, policy_version 63185 (0.0006) [2023-12-26 00:04:51,669][123091] Updated weights for policy 0, policy_version 63195 (0.0008) [2023-12-26 00:04:51,778][123090] Updated weights for policy 1, policy_version 62945 (0.0009) [2023-12-26 00:04:51,846][123090] Updated weights for policy 1, policy_version 62955 (0.0008) [2023-12-26 00:04:51,912][123090] Updated weights for policy 1, policy_version 62965 (0.0007) [2023-12-26 00:04:51,980][123090] Updated weights for policy 1, policy_version 62975 (0.0006) [2023-12-26 00:04:52,493][123091] Updated weights for policy 0, policy_version 63205 (0.0009) [2023-12-26 00:04:52,552][123091] Updated weights for policy 0, policy_version 63215 (0.0010) [2023-12-26 00:04:52,611][123091] Updated weights for policy 0, policy_version 63225 (0.0010) [2023-12-26 00:04:52,780][123090] Updated weights for policy 1, policy_version 62985 (0.0009) [2023-12-26 00:04:52,844][123090] Updated weights for policy 1, policy_version 62995 (0.0009) [2023-12-26 00:04:52,902][123090] Updated weights for policy 1, policy_version 63005 (0.0009) [2023-12-26 00:04:53,481][123091] Updated weights for policy 0, policy_version 63235 (0.0009) [2023-12-26 00:04:53,540][123091] Updated weights for policy 0, policy_version 63245 (0.0010) [2023-12-26 00:04:53,599][123091] Updated weights for policy 0, policy_version 63256 (0.0010) [2023-12-26 00:04:53,724][123090] Updated weights for policy 1, policy_version 63015 (0.0009) [2023-12-26 00:04:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16467.3). Total num frames: 32325632. Throughput: 0: 8482.4, 1: 8336.5. Samples: 32304744. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:53,785][121949] Avg episode reward: [(0, '4281.633'), (1, '5174.865')] [2023-12-26 00:04:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000063264_16195584.pth... [2023-12-26 00:04:53,792][123090] Updated weights for policy 1, policy_version 63025 (0.0009) [2023-12-26 00:04:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000062272_15941632.pth [2023-12-26 00:04:53,857][123090] Updated weights for policy 1, policy_version 63035 (0.0010) [2023-12-26 00:04:53,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000063040_16138240.pth... [2023-12-26 00:04:53,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000062048_15884288.pth [2023-12-26 00:04:54,443][123091] Updated weights for policy 0, policy_version 63266 (0.0010) [2023-12-26 00:04:54,504][123091] Updated weights for policy 0, policy_version 63276 (0.0009) [2023-12-26 00:04:54,567][123091] Updated weights for policy 0, policy_version 63286 (0.0009) [2023-12-26 00:04:54,632][123091] Updated weights for policy 0, policy_version 63296 (0.0008) [2023-12-26 00:04:54,705][123090] Updated weights for policy 1, policy_version 63045 (0.0010) [2023-12-26 00:04:54,774][123090] Updated weights for policy 1, policy_version 63055 (0.0011) [2023-12-26 00:04:54,851][123090] Updated weights for policy 1, policy_version 63065 (0.0011) [2023-12-26 00:04:55,450][123091] Updated weights for policy 0, policy_version 63306 (0.0009) [2023-12-26 00:04:55,514][123091] Updated weights for policy 0, policy_version 63316 (0.0009) [2023-12-26 00:04:55,570][123091] Updated weights for policy 0, policy_version 63326 (0.0009) [2023-12-26 00:04:55,683][123090] Updated weights for policy 1, policy_version 63075 (0.0011) [2023-12-26 00:04:55,739][123090] Updated weights for policy 1, policy_version 63085 (0.0010) [2023-12-26 00:04:55,799][123090] Updated weights for policy 1, policy_version 63095 (0.0010) [2023-12-26 00:04:56,394][123091] Updated weights for policy 0, policy_version 63336 (0.0009) [2023-12-26 00:04:56,459][123091] Updated weights for policy 0, policy_version 63346 (0.0009) [2023-12-26 00:04:56,524][123091] Updated weights for policy 0, policy_version 63356 (0.0009) [2023-12-26 00:04:56,643][123090] Updated weights for policy 1, policy_version 63105 (0.0010) [2023-12-26 00:04:56,697][123090] Updated weights for policy 1, policy_version 63115 (0.0010) [2023-12-26 00:04:56,754][123090] Updated weights for policy 1, policy_version 63125 (0.0010) [2023-12-26 00:04:56,817][123090] Updated weights for policy 1, policy_version 63135 (0.0010) [2023-12-26 00:04:57,352][123091] Updated weights for policy 0, policy_version 63366 (0.0009) [2023-12-26 00:04:57,412][123091] Updated weights for policy 0, policy_version 63376 (0.0009) [2023-12-26 00:04:57,476][123091] Updated weights for policy 0, policy_version 63386 (0.0009) [2023-12-26 00:04:57,681][123090] Updated weights for policy 1, policy_version 63145 (0.0010) [2023-12-26 00:04:57,749][123090] Updated weights for policy 1, policy_version 63155 (0.0010) [2023-12-26 00:04:57,817][123090] Updated weights for policy 1, policy_version 63165 (0.0011) [2023-12-26 00:04:58,319][123091] Updated weights for policy 0, policy_version 63396 (0.0009) [2023-12-26 00:04:58,397][123091] Updated weights for policy 0, policy_version 63406 (0.0010) [2023-12-26 00:04:58,477][123091] Updated weights for policy 0, policy_version 63417 (0.0008) [2023-12-26 00:04:58,672][123090] Updated weights for policy 1, policy_version 63175 (0.0008) [2023-12-26 00:04:58,750][123090] Updated weights for policy 1, policy_version 63186 (0.0009) [2023-12-26 00:04:58,784][121949] Fps is (10 sec: 16383.7, 60 sec: 16793.5, 300 sec: 16467.3). Total num frames: 32407552. Throughput: 0: 8466.8, 1: 8364.8. Samples: 32404884. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:04:58,785][121949] Avg episode reward: [(0, '4232.646'), (1, '5185.195')] [2023-12-26 00:04:58,828][123090] Updated weights for policy 1, policy_version 63196 (0.0012) [2023-12-26 00:04:59,437][123091] Updated weights for policy 0, policy_version 63427 (0.0008) [2023-12-26 00:04:59,496][123091] Updated weights for policy 0, policy_version 63437 (0.0006) [2023-12-26 00:04:59,561][123091] Updated weights for policy 0, policy_version 63447 (0.0007) [2023-12-26 00:04:59,769][123090] Updated weights for policy 1, policy_version 63206 (0.0010) [2023-12-26 00:04:59,833][123090] Updated weights for policy 1, policy_version 63216 (0.0009) [2023-12-26 00:04:59,905][123090] Updated weights for policy 1, policy_version 63226 (0.0008) [2023-12-26 00:05:00,400][123091] Updated weights for policy 0, policy_version 63457 (0.0006) [2023-12-26 00:05:00,451][123091] Updated weights for policy 0, policy_version 63467 (0.0006) [2023-12-26 00:05:00,502][123091] Updated weights for policy 0, policy_version 63477 (0.0005) [2023-12-26 00:05:00,562][123091] Updated weights for policy 0, policy_version 63487 (0.0010) [2023-12-26 00:05:00,781][123090] Updated weights for policy 1, policy_version 63236 (0.0009) [2023-12-26 00:05:00,851][123090] Updated weights for policy 1, policy_version 63246 (0.0010) [2023-12-26 00:05:00,917][123090] Updated weights for policy 1, policy_version 63256 (0.0010) [2023-12-26 00:05:01,344][123091] Updated weights for policy 0, policy_version 63497 (0.0007) [2023-12-26 00:05:01,414][123091] Updated weights for policy 0, policy_version 63507 (0.0010) [2023-12-26 00:05:01,472][123091] Updated weights for policy 0, policy_version 63517 (0.0009) [2023-12-26 00:05:01,816][123090] Updated weights for policy 1, policy_version 63266 (0.0010) [2023-12-26 00:05:01,869][123090] Updated weights for policy 1, policy_version 63276 (0.0010) [2023-12-26 00:05:01,929][123090] Updated weights for policy 1, policy_version 63286 (0.0011) [2023-12-26 00:05:01,993][123090] Updated weights for policy 1, policy_version 63296 (0.0011) [2023-12-26 00:05:02,317][123091] Updated weights for policy 0, policy_version 63527 (0.0007) [2023-12-26 00:05:02,388][123091] Updated weights for policy 0, policy_version 63537 (0.0008) [2023-12-26 00:05:02,442][123091] Updated weights for policy 0, policy_version 63547 (0.0005) [2023-12-26 00:05:02,868][123090] Updated weights for policy 1, policy_version 63306 (0.0011) [2023-12-26 00:05:02,928][123090] Updated weights for policy 1, policy_version 63316 (0.0011) [2023-12-26 00:05:02,989][123090] Updated weights for policy 1, policy_version 63326 (0.0011) [2023-12-26 00:05:03,247][123091] Updated weights for policy 0, policy_version 63557 (0.0008) [2023-12-26 00:05:03,305][123091] Updated weights for policy 0, policy_version 63567 (0.0010) [2023-12-26 00:05:03,372][123091] Updated weights for policy 0, policy_version 63577 (0.0011) [2023-12-26 00:05:03,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16657.0, 300 sec: 16495.1). Total num frames: 32489472. Throughput: 0: 8435.4, 1: 8275.6. Samples: 32504204. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:05:03,785][121949] Avg episode reward: [(0, '4359.053'), (1, '5068.991')] [2023-12-26 00:05:03,816][123090] Updated weights for policy 1, policy_version 63336 (0.0011) [2023-12-26 00:05:03,876][123090] Updated weights for policy 1, policy_version 63346 (0.0012) [2023-12-26 00:05:03,941][123090] Updated weights for policy 1, policy_version 63356 (0.0009) [2023-12-26 00:05:04,216][123091] Updated weights for policy 0, policy_version 63587 (0.0011) [2023-12-26 00:05:04,279][123091] Updated weights for policy 0, policy_version 63597 (0.0009) [2023-12-26 00:05:04,346][123091] Updated weights for policy 0, policy_version 63607 (0.0007) [2023-12-26 00:05:04,806][123090] Updated weights for policy 1, policy_version 63366 (0.0009) [2023-12-26 00:05:04,876][123090] Updated weights for policy 1, policy_version 63376 (0.0009) [2023-12-26 00:05:04,946][123090] Updated weights for policy 1, policy_version 63386 (0.0010) [2023-12-26 00:05:05,147][123091] Updated weights for policy 0, policy_version 63617 (0.0006) [2023-12-26 00:05:05,210][123091] Updated weights for policy 0, policy_version 63627 (0.0010) [2023-12-26 00:05:05,269][123091] Updated weights for policy 0, policy_version 63637 (0.0010) [2023-12-26 00:05:05,325][123091] Updated weights for policy 0, policy_version 63647 (0.0009) [2023-12-26 00:05:05,819][123090] Updated weights for policy 1, policy_version 63396 (0.0009) [2023-12-26 00:05:05,883][123090] Updated weights for policy 1, policy_version 63406 (0.0009) [2023-12-26 00:05:05,947][123090] Updated weights for policy 1, policy_version 63416 (0.0009) [2023-12-26 00:05:06,156][123091] Updated weights for policy 0, policy_version 63657 (0.0011) [2023-12-26 00:05:06,221][123091] Updated weights for policy 0, policy_version 63667 (0.0010) [2023-12-26 00:05:06,282][123091] Updated weights for policy 0, policy_version 63677 (0.0009) [2023-12-26 00:05:06,804][123090] Updated weights for policy 1, policy_version 63426 (0.0009) [2023-12-26 00:05:06,871][123090] Updated weights for policy 1, policy_version 63436 (0.0009) [2023-12-26 00:05:06,923][123090] Updated weights for policy 1, policy_version 63446 (0.0010) [2023-12-26 00:05:06,987][123090] Updated weights for policy 1, policy_version 63456 (0.0007) [2023-12-26 00:05:07,150][123091] Updated weights for policy 0, policy_version 63687 (0.0010) [2023-12-26 00:05:07,219][123091] Updated weights for policy 0, policy_version 63697 (0.0010) [2023-12-26 00:05:07,285][123091] Updated weights for policy 0, policy_version 63707 (0.0010) [2023-12-26 00:05:07,757][123090] Updated weights for policy 1, policy_version 63466 (0.0008) [2023-12-26 00:05:07,818][123090] Updated weights for policy 1, policy_version 63476 (0.0009) [2023-12-26 00:05:07,881][123090] Updated weights for policy 1, policy_version 63486 (0.0008) [2023-12-26 00:05:08,202][123091] Updated weights for policy 0, policy_version 63717 (0.0009) [2023-12-26 00:05:08,272][123091] Updated weights for policy 0, policy_version 63728 (0.0011) [2023-12-26 00:05:08,325][123091] Updated weights for policy 0, policy_version 63738 (0.0010) [2023-12-26 00:05:08,655][123090] Updated weights for policy 1, policy_version 63496 (0.0010) [2023-12-26 00:05:08,724][123090] Updated weights for policy 1, policy_version 63506 (0.0010) [2023-12-26 00:05:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16657.0, 300 sec: 16495.1). Total num frames: 32571392. Throughput: 0: 8446.3, 1: 8292.1. Samples: 32553640. Policy #0 lag: (min: 31.0, avg: 47.0, max: 63.0) [2023-12-26 00:05:08,785][121949] Avg episode reward: [(0, '4406.744'), (1, '5047.542')] [2023-12-26 00:05:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000063744_16318464.pth... [2023-12-26 00:05:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000062784_16072704.pth [2023-12-26 00:05:08,798][123090] Updated weights for policy 1, policy_version 63516 (0.0011) [2023-12-26 00:05:08,822][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000063520_16261120.pth... [2023-12-26 00:05:08,826][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000062528_16007168.pth [2023-12-26 00:05:09,237][123091] Updated weights for policy 0, policy_version 63748 (0.0010) [2023-12-26 00:05:09,300][123091] Updated weights for policy 0, policy_version 63758 (0.0010) [2023-12-26 00:05:09,377][123091] Updated weights for policy 0, policy_version 63768 (0.0010) [2023-12-26 00:05:09,636][123090] Updated weights for policy 1, policy_version 63526 (0.0010) [2023-12-26 00:05:09,703][123090] Updated weights for policy 1, policy_version 63536 (0.0010) [2023-12-26 00:05:09,772][123090] Updated weights for policy 1, policy_version 63546 (0.0007) [2023-12-26 00:05:10,319][123091] Updated weights for policy 0, policy_version 63778 (0.0010) [2023-12-26 00:05:10,388][123091] Updated weights for policy 0, policy_version 63788 (0.0010) [2023-12-26 00:05:10,446][123091] Updated weights for policy 0, policy_version 63798 (0.0009) [2023-12-26 00:05:10,514][123091] Updated weights for policy 0, policy_version 63808 (0.0009) [2023-12-26 00:05:10,575][123090] Updated weights for policy 1, policy_version 63556 (0.0009) [2023-12-26 00:05:10,636][123090] Updated weights for policy 1, policy_version 63566 (0.0010) [2023-12-26 00:05:10,700][123090] Updated weights for policy 1, policy_version 63576 (0.0009) [2023-12-26 00:05:11,424][123091] Updated weights for policy 0, policy_version 63818 (0.0010) [2023-12-26 00:05:11,492][123091] Updated weights for policy 0, policy_version 63828 (0.0009) [2023-12-26 00:05:11,560][123091] Updated weights for policy 0, policy_version 63838 (0.0010) [2023-12-26 00:05:11,590][123090] Updated weights for policy 1, policy_version 63586 (0.0010) [2023-12-26 00:05:11,663][123090] Updated weights for policy 1, policy_version 63596 (0.0008) [2023-12-26 00:05:11,741][123090] Updated weights for policy 1, policy_version 63606 (0.0009) [2023-12-26 00:05:11,821][123090] Updated weights for policy 1, policy_version 63616 (0.0008) [2023-12-26 00:05:12,464][123091] Updated weights for policy 0, policy_version 63848 (0.0009) [2023-12-26 00:05:12,529][123091] Updated weights for policy 0, policy_version 63858 (0.0007) [2023-12-26 00:05:12,591][123091] Updated weights for policy 0, policy_version 63868 (0.0006) [2023-12-26 00:05:12,687][123090] Updated weights for policy 1, policy_version 63626 (0.0009) [2023-12-26 00:05:12,749][123090] Updated weights for policy 1, policy_version 63636 (0.0009) [2023-12-26 00:05:12,815][123090] Updated weights for policy 1, policy_version 63646 (0.0009) [2023-12-26 00:05:13,382][123091] Updated weights for policy 0, policy_version 63878 (0.0009) [2023-12-26 00:05:13,435][123091] Updated weights for policy 0, policy_version 63888 (0.0009) [2023-12-26 00:05:13,489][123091] Updated weights for policy 0, policy_version 63898 (0.0007) [2023-12-26 00:05:13,654][123090] Updated weights for policy 1, policy_version 63656 (0.0007) [2023-12-26 00:05:13,714][123090] Updated weights for policy 1, policy_version 63666 (0.0006) [2023-12-26 00:05:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16657.1, 300 sec: 16495.1). Total num frames: 32653312. Throughput: 0: 8331.7, 1: 8336.7. Samples: 32651700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:13,785][121949] Avg episode reward: [(0, '4384.971'), (1, '5065.433')] [2023-12-26 00:05:13,787][123090] Updated weights for policy 1, policy_version 63676 (0.0006) [2023-12-26 00:05:14,205][123091] Updated weights for policy 0, policy_version 63908 (0.0007) [2023-12-26 00:05:14,272][123091] Updated weights for policy 0, policy_version 63918 (0.0008) [2023-12-26 00:05:14,334][123091] Updated weights for policy 0, policy_version 63928 (0.0009) [2023-12-26 00:05:14,609][123090] Updated weights for policy 1, policy_version 63686 (0.0009) [2023-12-26 00:05:14,666][123090] Updated weights for policy 1, policy_version 63696 (0.0008) [2023-12-26 00:05:14,731][123090] Updated weights for policy 1, policy_version 63706 (0.0007) [2023-12-26 00:05:15,160][123091] Updated weights for policy 0, policy_version 63938 (0.0009) [2023-12-26 00:05:15,231][123091] Updated weights for policy 0, policy_version 63948 (0.0007) [2023-12-26 00:05:15,305][123091] Updated weights for policy 0, policy_version 63958 (0.0010) [2023-12-26 00:05:15,377][123091] Updated weights for policy 0, policy_version 63968 (0.0009) [2023-12-26 00:05:15,594][123090] Updated weights for policy 1, policy_version 63716 (0.0009) [2023-12-26 00:05:15,667][123090] Updated weights for policy 1, policy_version 63726 (0.0008) [2023-12-26 00:05:15,739][123090] Updated weights for policy 1, policy_version 63736 (0.0010) [2023-12-26 00:05:16,177][123091] Updated weights for policy 0, policy_version 63978 (0.0009) [2023-12-26 00:05:16,252][123091] Updated weights for policy 0, policy_version 63988 (0.0007) [2023-12-26 00:05:16,320][123091] Updated weights for policy 0, policy_version 63998 (0.0011) [2023-12-26 00:05:16,590][123090] Updated weights for policy 1, policy_version 63746 (0.0010) [2023-12-26 00:05:16,661][123090] Updated weights for policy 1, policy_version 63756 (0.0009) [2023-12-26 00:05:16,731][123090] Updated weights for policy 1, policy_version 63766 (0.0009) [2023-12-26 00:05:16,794][123090] Updated weights for policy 1, policy_version 63776 (0.0009) [2023-12-26 00:05:17,112][123091] Updated weights for policy 0, policy_version 64008 (0.0007) [2023-12-26 00:05:17,178][123091] Updated weights for policy 0, policy_version 64018 (0.0010) [2023-12-26 00:05:17,247][123091] Updated weights for policy 0, policy_version 64028 (0.0011) [2023-12-26 00:05:17,654][123090] Updated weights for policy 1, policy_version 63786 (0.0010) [2023-12-26 00:05:17,721][123090] Updated weights for policy 1, policy_version 63796 (0.0009) [2023-12-26 00:05:17,788][123090] Updated weights for policy 1, policy_version 63806 (0.0009) [2023-12-26 00:05:18,077][123091] Updated weights for policy 0, policy_version 64038 (0.0011) [2023-12-26 00:05:18,138][123091] Updated weights for policy 0, policy_version 64048 (0.0011) [2023-12-26 00:05:18,199][123091] Updated weights for policy 0, policy_version 64058 (0.0011) [2023-12-26 00:05:18,660][123090] Updated weights for policy 1, policy_version 63816 (0.0007) [2023-12-26 00:05:18,734][123090] Updated weights for policy 1, policy_version 63826 (0.0009) [2023-12-26 00:05:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16520.5, 300 sec: 16495.1). Total num frames: 32735232. Throughput: 0: 8331.5, 1: 8298.7. Samples: 32752124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:18,785][121949] Avg episode reward: [(0, '4382.367'), (1, '5201.311')] [2023-12-26 00:05:18,804][123090] Updated weights for policy 1, policy_version 63836 (0.0009) [2023-12-26 00:05:19,051][123091] Updated weights for policy 0, policy_version 64068 (0.0011) [2023-12-26 00:05:19,114][123091] Updated weights for policy 0, policy_version 64078 (0.0009) [2023-12-26 00:05:19,169][123091] Updated weights for policy 0, policy_version 64088 (0.0009) [2023-12-26 00:05:19,665][123090] Updated weights for policy 1, policy_version 63846 (0.0009) [2023-12-26 00:05:19,732][123090] Updated weights for policy 1, policy_version 63856 (0.0009) [2023-12-26 00:05:19,803][123090] Updated weights for policy 1, policy_version 63866 (0.0009) [2023-12-26 00:05:20,039][123091] Updated weights for policy 0, policy_version 64098 (0.0011) [2023-12-26 00:05:20,116][123091] Updated weights for policy 0, policy_version 64108 (0.0011) [2023-12-26 00:05:20,189][123091] Updated weights for policy 0, policy_version 64118 (0.0010) [2023-12-26 00:05:20,258][123091] Updated weights for policy 0, policy_version 64128 (0.0010) [2023-12-26 00:05:20,685][123090] Updated weights for policy 1, policy_version 63876 (0.0008) [2023-12-26 00:05:20,758][123090] Updated weights for policy 1, policy_version 63886 (0.0008) [2023-12-26 00:05:20,828][123090] Updated weights for policy 1, policy_version 63896 (0.0008) [2023-12-26 00:05:21,175][123091] Updated weights for policy 0, policy_version 64138 (0.0009) [2023-12-26 00:05:21,251][123091] Updated weights for policy 0, policy_version 64148 (0.0009) [2023-12-26 00:05:21,322][123091] Updated weights for policy 0, policy_version 64158 (0.0009) [2023-12-26 00:05:21,729][123090] Updated weights for policy 1, policy_version 63906 (0.0008) [2023-12-26 00:05:21,806][123090] Updated weights for policy 1, policy_version 63916 (0.0010) [2023-12-26 00:05:21,879][123090] Updated weights for policy 1, policy_version 63926 (0.0010) [2023-12-26 00:05:21,947][123090] Updated weights for policy 1, policy_version 63936 (0.0009) [2023-12-26 00:05:22,196][123091] Updated weights for policy 0, policy_version 64168 (0.0010) [2023-12-26 00:05:22,258][123091] Updated weights for policy 0, policy_version 64178 (0.0011) [2023-12-26 00:05:22,322][123091] Updated weights for policy 0, policy_version 64188 (0.0011) [2023-12-26 00:05:22,820][123090] Updated weights for policy 1, policy_version 63946 (0.0009) [2023-12-26 00:05:22,887][123090] Updated weights for policy 1, policy_version 63956 (0.0009) [2023-12-26 00:05:22,950][123090] Updated weights for policy 1, policy_version 63966 (0.0009) [2023-12-26 00:05:23,163][123091] Updated weights for policy 0, policy_version 64198 (0.0011) [2023-12-26 00:05:23,228][123091] Updated weights for policy 0, policy_version 64208 (0.0011) [2023-12-26 00:05:23,289][123091] Updated weights for policy 0, policy_version 64218 (0.0011) [2023-12-26 00:05:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16520.5, 300 sec: 16495.1). Total num frames: 32817152. Throughput: 0: 8317.5, 1: 8237.6. Samples: 32799668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:23,785][121949] Avg episode reward: [(0, '4386.402'), (1, '5283.261')] [2023-12-26 00:05:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000064224_16441344.pth... [2023-12-26 00:05:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000063264_16195584.pth [2023-12-26 00:05:23,802][123090] Updated weights for policy 1, policy_version 63976 (0.0009) [2023-12-26 00:05:23,859][123090] Updated weights for policy 1, policy_version 63986 (0.0010) [2023-12-26 00:05:23,920][123090] Updated weights for policy 1, policy_version 63996 (0.0009) [2023-12-26 00:05:23,944][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064000_16384000.pth... [2023-12-26 00:05:23,950][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000063040_16138240.pth [2023-12-26 00:05:24,116][123091] Updated weights for policy 0, policy_version 64228 (0.0010) [2023-12-26 00:05:24,179][123091] Updated weights for policy 0, policy_version 64238 (0.0009) [2023-12-26 00:05:24,243][123091] Updated weights for policy 0, policy_version 64248 (0.0009) [2023-12-26 00:05:24,827][123090] Updated weights for policy 1, policy_version 64006 (0.0009) [2023-12-26 00:05:24,889][123090] Updated weights for policy 1, policy_version 64016 (0.0009) [2023-12-26 00:05:24,950][123090] Updated weights for policy 1, policy_version 64026 (0.0008) [2023-12-26 00:05:25,105][123091] Updated weights for policy 0, policy_version 64258 (0.0010) [2023-12-26 00:05:25,170][123091] Updated weights for policy 0, policy_version 64268 (0.0009) [2023-12-26 00:05:25,234][123091] Updated weights for policy 0, policy_version 64278 (0.0010) [2023-12-26 00:05:25,300][123091] Updated weights for policy 0, policy_version 64288 (0.0007) [2023-12-26 00:05:25,838][123090] Updated weights for policy 1, policy_version 64036 (0.0009) [2023-12-26 00:05:25,899][123090] Updated weights for policy 1, policy_version 64046 (0.0010) [2023-12-26 00:05:25,973][123090] Updated weights for policy 1, policy_version 64056 (0.0011) [2023-12-26 00:05:26,104][123091] Updated weights for policy 0, policy_version 64298 (0.0009) [2023-12-26 00:05:26,165][123091] Updated weights for policy 0, policy_version 64308 (0.0008) [2023-12-26 00:05:26,227][123091] Updated weights for policy 0, policy_version 64318 (0.0008) [2023-12-26 00:05:26,854][123090] Updated weights for policy 1, policy_version 64066 (0.0010) [2023-12-26 00:05:26,926][123090] Updated weights for policy 1, policy_version 64076 (0.0010) [2023-12-26 00:05:26,988][123090] Updated weights for policy 1, policy_version 64086 (0.0008) [2023-12-26 00:05:26,991][123091] Updated weights for policy 0, policy_version 64328 (0.0009) [2023-12-26 00:05:27,051][123090] Updated weights for policy 1, policy_version 64096 (0.0009) [2023-12-26 00:05:27,053][123091] Updated weights for policy 0, policy_version 64338 (0.0007) [2023-12-26 00:05:27,121][123091] Updated weights for policy 0, policy_version 64348 (0.0010) [2023-12-26 00:05:27,916][123090] Updated weights for policy 1, policy_version 64106 (0.0009) [2023-12-26 00:05:27,937][123091] Updated weights for policy 0, policy_version 64358 (0.0008) [2023-12-26 00:05:27,979][123090] Updated weights for policy 1, policy_version 64116 (0.0008) [2023-12-26 00:05:27,994][123091] Updated weights for policy 0, policy_version 64368 (0.0009) [2023-12-26 00:05:28,045][123090] Updated weights for policy 1, policy_version 64126 (0.0008) [2023-12-26 00:05:28,050][123091] Updated weights for policy 0, policy_version 64378 (0.0006) [2023-12-26 00:05:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 16495.1). Total num frames: 32899072. Throughput: 0: 8352.0, 1: 8205.6. Samples: 32898372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:28,785][121949] Avg episode reward: [(0, '4141.631'), (1, '5292.978')] [2023-12-26 00:05:28,839][123091] Updated weights for policy 0, policy_version 64388 (0.0007) [2023-12-26 00:05:28,900][123091] Updated weights for policy 0, policy_version 64398 (0.0009) [2023-12-26 00:05:28,933][123090] Updated weights for policy 1, policy_version 64136 (0.0009) [2023-12-26 00:05:28,969][123091] Updated weights for policy 0, policy_version 64408 (0.0006) [2023-12-26 00:05:28,995][123090] Updated weights for policy 1, policy_version 64146 (0.0008) [2023-12-26 00:05:29,067][123090] Updated weights for policy 1, policy_version 64156 (0.0010) [2023-12-26 00:05:29,825][123091] Updated weights for policy 0, policy_version 64418 (0.0007) [2023-12-26 00:05:29,899][123091] Updated weights for policy 0, policy_version 64428 (0.0008) [2023-12-26 00:05:29,974][123091] Updated weights for policy 0, policy_version 64438 (0.0008) [2023-12-26 00:05:29,975][123090] Updated weights for policy 1, policy_version 64166 (0.0009) [2023-12-26 00:05:30,033][123090] Updated weights for policy 1, policy_version 64176 (0.0009) [2023-12-26 00:05:30,034][123091] Updated weights for policy 0, policy_version 64448 (0.0006) [2023-12-26 00:05:30,113][123090] Updated weights for policy 1, policy_version 64186 (0.0009) [2023-12-26 00:05:30,837][123091] Updated weights for policy 0, policy_version 64458 (0.0009) [2023-12-26 00:05:30,900][123091] Updated weights for policy 0, policy_version 64468 (0.0010) [2023-12-26 00:05:30,950][123091] Updated weights for policy 0, policy_version 64478 (0.0009) [2023-12-26 00:05:30,959][123090] Updated weights for policy 1, policy_version 64196 (0.0009) [2023-12-26 00:05:31,012][123090] Updated weights for policy 1, policy_version 64206 (0.0006) [2023-12-26 00:05:31,082][123090] Updated weights for policy 1, policy_version 64216 (0.0009) [2023-12-26 00:05:31,875][123091] Updated weights for policy 0, policy_version 64488 (0.0010) [2023-12-26 00:05:31,926][123090] Updated weights for policy 1, policy_version 64226 (0.0009) [2023-12-26 00:05:31,938][123091] Updated weights for policy 0, policy_version 64498 (0.0009) [2023-12-26 00:05:31,985][123090] Updated weights for policy 1, policy_version 64236 (0.0009) [2023-12-26 00:05:32,003][123091] Updated weights for policy 0, policy_version 64508 (0.0009) [2023-12-26 00:05:32,054][123090] Updated weights for policy 1, policy_version 64246 (0.0010) [2023-12-26 00:05:32,124][123090] Updated weights for policy 1, policy_version 64256 (0.0009) [2023-12-26 00:05:32,864][123091] Updated weights for policy 0, policy_version 64518 (0.0010) [2023-12-26 00:05:32,919][123091] Updated weights for policy 0, policy_version 64528 (0.0009) [2023-12-26 00:05:32,982][123091] Updated weights for policy 0, policy_version 64538 (0.0010) [2023-12-26 00:05:32,995][123090] Updated weights for policy 1, policy_version 64266 (0.0008) [2023-12-26 00:05:33,063][123090] Updated weights for policy 1, policy_version 64276 (0.0008) [2023-12-26 00:05:33,124][123090] Updated weights for policy 1, policy_version 64286 (0.0009) [2023-12-26 00:05:33,784][121949] Fps is (10 sec: 16384.3, 60 sec: 16520.6, 300 sec: 16495.1). Total num frames: 32980992. Throughput: 0: 8338.6, 1: 8150.2. Samples: 32997732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:33,785][121949] Avg episode reward: [(0, '4070.600'), (1, '5278.208')] [2023-12-26 00:05:33,818][123091] Updated weights for policy 0, policy_version 64548 (0.0010) [2023-12-26 00:05:33,880][123091] Updated weights for policy 0, policy_version 64558 (0.0008) [2023-12-26 00:05:33,948][123091] Updated weights for policy 0, policy_version 64568 (0.0007) [2023-12-26 00:05:33,970][123090] Updated weights for policy 1, policy_version 64296 (0.0008) [2023-12-26 00:05:34,038][123090] Updated weights for policy 1, policy_version 64306 (0.0009) [2023-12-26 00:05:34,106][123090] Updated weights for policy 1, policy_version 64316 (0.0009) [2023-12-26 00:05:34,771][123091] Updated weights for policy 0, policy_version 64578 (0.0007) [2023-12-26 00:05:34,836][123091] Updated weights for policy 0, policy_version 64588 (0.0010) [2023-12-26 00:05:34,902][123091] Updated weights for policy 0, policy_version 64598 (0.0010) [2023-12-26 00:05:34,947][123090] Updated weights for policy 1, policy_version 64326 (0.0008) [2023-12-26 00:05:34,949][123091] Updated weights for policy 0, policy_version 64608 (0.0009) [2023-12-26 00:05:35,004][123090] Updated weights for policy 1, policy_version 64336 (0.0010) [2023-12-26 00:05:35,072][123090] Updated weights for policy 1, policy_version 64346 (0.0010) [2023-12-26 00:05:35,808][123091] Updated weights for policy 0, policy_version 64618 (0.0006) [2023-12-26 00:05:35,871][123091] Updated weights for policy 0, policy_version 64628 (0.0007) [2023-12-26 00:05:35,936][123090] Updated weights for policy 1, policy_version 64356 (0.0009) [2023-12-26 00:05:35,940][123091] Updated weights for policy 0, policy_version 64638 (0.0009) [2023-12-26 00:05:36,004][123090] Updated weights for policy 1, policy_version 64366 (0.0010) [2023-12-26 00:05:36,069][123090] Updated weights for policy 1, policy_version 64376 (0.0008) [2023-12-26 00:05:36,785][123091] Updated weights for policy 0, policy_version 64648 (0.0008) [2023-12-26 00:05:36,854][123091] Updated weights for policy 0, policy_version 64658 (0.0011) [2023-12-26 00:05:36,911][123091] Updated weights for policy 0, policy_version 64668 (0.0011) [2023-12-26 00:05:36,957][123090] Updated weights for policy 1, policy_version 64389 (0.0007) [2023-12-26 00:05:37,013][123090] Updated weights for policy 1, policy_version 64399 (0.0009) [2023-12-26 00:05:37,067][123090] Updated weights for policy 1, policy_version 64409 (0.0010) [2023-12-26 00:05:37,648][123091] Updated weights for policy 0, policy_version 64678 (0.0011) [2023-12-26 00:05:37,712][123091] Updated weights for policy 0, policy_version 64688 (0.0011) [2023-12-26 00:05:37,781][123091] Updated weights for policy 0, policy_version 64698 (0.0011) [2023-12-26 00:05:38,002][123090] Updated weights for policy 1, policy_version 64419 (0.0010) [2023-12-26 00:05:38,082][123090] Updated weights for policy 1, policy_version 64429 (0.0011) [2023-12-26 00:05:38,154][123090] Updated weights for policy 1, policy_version 64439 (0.0011) [2023-12-26 00:05:38,604][123091] Updated weights for policy 0, policy_version 64708 (0.0010) [2023-12-26 00:05:38,669][123091] Updated weights for policy 0, policy_version 64718 (0.0011) [2023-12-26 00:05:38,726][123091] Updated weights for policy 0, policy_version 64728 (0.0011) [2023-12-26 00:05:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 16522.8). Total num frames: 33071104. Throughput: 0: 8346.7, 1: 8158.1. Samples: 33047464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:38,785][121949] Avg episode reward: [(0, '4262.620'), (1, '5269.201')] [2023-12-26 00:05:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000064736_16572416.pth... [2023-12-26 00:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064448_16498688.pth... [2023-12-26 00:05:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000063744_16318464.pth [2023-12-26 00:05:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000063520_16261120.pth [2023-12-26 00:05:38,989][123090] Updated weights for policy 1, policy_version 64449 (0.0009) [2023-12-26 00:05:39,043][123090] Updated weights for policy 1, policy_version 64459 (0.0010) [2023-12-26 00:05:39,100][123090] Updated weights for policy 1, policy_version 64469 (0.0011) [2023-12-26 00:05:39,166][123090] Updated weights for policy 1, policy_version 64479 (0.0011) [2023-12-26 00:05:39,613][123091] Updated weights for policy 0, policy_version 64738 (0.0011) [2023-12-26 00:05:39,685][123091] Updated weights for policy 0, policy_version 64748 (0.0009) [2023-12-26 00:05:39,748][123091] Updated weights for policy 0, policy_version 64758 (0.0010) [2023-12-26 00:05:39,812][123091] Updated weights for policy 0, policy_version 64768 (0.0009) [2023-12-26 00:05:40,067][123090] Updated weights for policy 1, policy_version 64489 (0.0008) [2023-12-26 00:05:40,134][123090] Updated weights for policy 1, policy_version 64499 (0.0007) [2023-12-26 00:05:40,209][123090] Updated weights for policy 1, policy_version 64509 (0.0009) [2023-12-26 00:05:40,682][123091] Updated weights for policy 0, policy_version 64778 (0.0010) [2023-12-26 00:05:40,752][123091] Updated weights for policy 0, policy_version 64788 (0.0010) [2023-12-26 00:05:40,821][123091] Updated weights for policy 0, policy_version 64798 (0.0010) [2023-12-26 00:05:41,034][123090] Updated weights for policy 1, policy_version 64519 (0.0009) [2023-12-26 00:05:41,106][123090] Updated weights for policy 1, policy_version 64529 (0.0010) [2023-12-26 00:05:41,177][123090] Updated weights for policy 1, policy_version 64539 (0.0010) [2023-12-26 00:05:41,722][123091] Updated weights for policy 0, policy_version 64808 (0.0010) [2023-12-26 00:05:41,789][123091] Updated weights for policy 0, policy_version 64818 (0.0009) [2023-12-26 00:05:41,857][123091] Updated weights for policy 0, policy_version 64828 (0.0009) [2023-12-26 00:05:42,063][123090] Updated weights for policy 1, policy_version 64549 (0.0008) [2023-12-26 00:05:42,142][123090] Updated weights for policy 1, policy_version 64559 (0.0008) [2023-12-26 00:05:42,203][123090] Updated weights for policy 1, policy_version 64569 (0.0010) [2023-12-26 00:05:42,715][123091] Updated weights for policy 0, policy_version 64838 (0.0009) [2023-12-26 00:05:42,788][123091] Updated weights for policy 0, policy_version 64848 (0.0008) [2023-12-26 00:05:42,856][123091] Updated weights for policy 0, policy_version 64858 (0.0008) [2023-12-26 00:05:43,073][123090] Updated weights for policy 1, policy_version 64579 (0.0008) [2023-12-26 00:05:43,144][123090] Updated weights for policy 1, policy_version 64589 (0.0009) [2023-12-26 00:05:43,207][123090] Updated weights for policy 1, policy_version 64600 (0.0010) [2023-12-26 00:05:43,619][123091] Updated weights for policy 0, policy_version 64868 (0.0009) [2023-12-26 00:05:43,689][123091] Updated weights for policy 0, policy_version 64878 (0.0007) [2023-12-26 00:05:43,756][123091] Updated weights for policy 0, policy_version 64888 (0.0007) [2023-12-26 00:05:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16520.5, 300 sec: 16495.1). Total num frames: 33144832. Throughput: 0: 8327.2, 1: 8111.9. Samples: 33144644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:43,785][121949] Avg episode reward: [(0, '4298.582'), (1, '5313.000')] [2023-12-26 00:05:44,104][123090] Updated weights for policy 1, policy_version 64610 (0.0008) [2023-12-26 00:05:44,167][123090] Updated weights for policy 1, policy_version 64620 (0.0009) [2023-12-26 00:05:44,231][123090] Updated weights for policy 1, policy_version 64630 (0.0010) [2023-12-26 00:05:44,304][123090] Updated weights for policy 1, policy_version 64640 (0.0010) [2023-12-26 00:05:44,527][123091] Updated weights for policy 0, policy_version 64898 (0.0007) [2023-12-26 00:05:44,596][123091] Updated weights for policy 0, policy_version 64908 (0.0010) [2023-12-26 00:05:44,666][123091] Updated weights for policy 0, policy_version 64918 (0.0010) [2023-12-26 00:05:44,732][123091] Updated weights for policy 0, policy_version 64928 (0.0010) [2023-12-26 00:05:45,161][123090] Updated weights for policy 1, policy_version 64650 (0.0009) [2023-12-26 00:05:45,235][123090] Updated weights for policy 1, policy_version 64660 (0.0010) [2023-12-26 00:05:45,301][123090] Updated weights for policy 1, policy_version 64670 (0.0010) [2023-12-26 00:05:45,591][123091] Updated weights for policy 0, policy_version 64938 (0.0010) [2023-12-26 00:05:45,651][123091] Updated weights for policy 0, policy_version 64948 (0.0010) [2023-12-26 00:05:45,706][123091] Updated weights for policy 0, policy_version 64959 (0.0009) [2023-12-26 00:05:46,180][123090] Updated weights for policy 1, policy_version 64680 (0.0010) [2023-12-26 00:05:46,240][123090] Updated weights for policy 1, policy_version 64690 (0.0010) [2023-12-26 00:05:46,296][123090] Updated weights for policy 1, policy_version 64700 (0.0010) [2023-12-26 00:05:46,559][123091] Updated weights for policy 0, policy_version 64969 (0.0007) [2023-12-26 00:05:46,625][123091] Updated weights for policy 0, policy_version 64979 (0.0009) [2023-12-26 00:05:46,681][123091] Updated weights for policy 0, policy_version 64989 (0.0010) [2023-12-26 00:05:47,189][123090] Updated weights for policy 1, policy_version 64710 (0.0010) [2023-12-26 00:05:47,254][123090] Updated weights for policy 1, policy_version 64720 (0.0010) [2023-12-26 00:05:47,318][123090] Updated weights for policy 1, policy_version 64730 (0.0009) [2023-12-26 00:05:47,523][123091] Updated weights for policy 0, policy_version 64999 (0.0010) [2023-12-26 00:05:47,574][123091] Updated weights for policy 0, policy_version 65009 (0.0006) [2023-12-26 00:05:47,639][123091] Updated weights for policy 0, policy_version 65019 (0.0006) [2023-12-26 00:05:48,194][123090] Updated weights for policy 1, policy_version 64740 (0.0009) [2023-12-26 00:05:48,255][123090] Updated weights for policy 1, policy_version 64750 (0.0009) [2023-12-26 00:05:48,321][123090] Updated weights for policy 1, policy_version 64760 (0.0009) [2023-12-26 00:05:48,424][123091] Updated weights for policy 0, policy_version 65029 (0.0008) [2023-12-26 00:05:48,493][123091] Updated weights for policy 0, policy_version 65039 (0.0009) [2023-12-26 00:05:48,552][123091] Updated weights for policy 0, policy_version 65049 (0.0009) [2023-12-26 00:05:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 16550.6). Total num frames: 33234944. Throughput: 0: 8337.3, 1: 8104.0. Samples: 33244064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 00:05:48,785][121949] Avg episode reward: [(0, '4323.154'), (1, '5307.713')] [2023-12-26 00:05:49,199][123090] Updated weights for policy 1, policy_version 64770 (0.0009) [2023-12-26 00:05:49,275][123090] Updated weights for policy 1, policy_version 64780 (0.0009) [2023-12-26 00:05:49,344][123090] Updated weights for policy 1, policy_version 64790 (0.0011) [2023-12-26 00:05:49,422][123090] Updated weights for policy 1, policy_version 64800 (0.0009) [2023-12-26 00:05:49,429][123091] Updated weights for policy 0, policy_version 65059 (0.0009) [2023-12-26 00:05:49,485][123091] Updated weights for policy 0, policy_version 65069 (0.0009) [2023-12-26 00:05:49,553][123091] Updated weights for policy 0, policy_version 65079 (0.0010) [2023-12-26 00:05:50,355][123090] Updated weights for policy 1, policy_version 64810 (0.0009) [2023-12-26 00:05:50,395][123091] Updated weights for policy 0, policy_version 65089 (0.0008) [2023-12-26 00:05:50,426][123090] Updated weights for policy 1, policy_version 64820 (0.0008) [2023-12-26 00:05:50,455][123091] Updated weights for policy 0, policy_version 65099 (0.0007) [2023-12-26 00:05:50,492][123090] Updated weights for policy 1, policy_version 64830 (0.0008) [2023-12-26 00:05:50,521][123091] Updated weights for policy 0, policy_version 65109 (0.0008) [2023-12-26 00:05:50,593][123091] Updated weights for policy 0, policy_version 65119 (0.0010) [2023-12-26 00:05:51,389][123090] Updated weights for policy 1, policy_version 64840 (0.0008) [2023-12-26 00:05:51,464][123090] Updated weights for policy 1, policy_version 64850 (0.0010) [2023-12-26 00:05:51,474][123091] Updated weights for policy 0, policy_version 65129 (0.0008) [2023-12-26 00:05:51,531][123090] Updated weights for policy 1, policy_version 64860 (0.0009) [2023-12-26 00:05:51,534][123091] Updated weights for policy 0, policy_version 65139 (0.0007) [2023-12-26 00:05:51,608][123091] Updated weights for policy 0, policy_version 65149 (0.0008) [2023-12-26 00:05:52,405][123090] Updated weights for policy 1, policy_version 64870 (0.0009) [2023-12-26 00:05:52,464][123091] Updated weights for policy 0, policy_version 65159 (0.0008) [2023-12-26 00:05:52,474][123090] Updated weights for policy 1, policy_version 64880 (0.0010) [2023-12-26 00:05:52,536][123091] Updated weights for policy 0, policy_version 65169 (0.0009) [2023-12-26 00:05:52,541][123090] Updated weights for policy 1, policy_version 64890 (0.0009) [2023-12-26 00:05:52,600][123091] Updated weights for policy 0, policy_version 65179 (0.0009) [2023-12-26 00:05:53,401][123090] Updated weights for policy 1, policy_version 64900 (0.0008) [2023-12-26 00:05:53,437][123091] Updated weights for policy 0, policy_version 65189 (0.0010) [2023-12-26 00:05:53,474][123090] Updated weights for policy 1, policy_version 64910 (0.0006) [2023-12-26 00:05:53,502][123091] Updated weights for policy 0, policy_version 65199 (0.0011) [2023-12-26 00:05:53,537][123090] Updated weights for policy 1, policy_version 64920 (0.0006) [2023-12-26 00:05:53,563][123091] Updated weights for policy 0, policy_version 65209 (0.0011) [2023-12-26 00:05:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 16520.5, 300 sec: 16550.6). Total num frames: 33316864. Throughput: 0: 8322.3, 1: 8079.0. Samples: 33291700. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:05:53,785][121949] Avg episode reward: [(0, '4393.020'), (1, '5227.428')] [2023-12-26 00:05:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000065216_16695296.pth... [2023-12-26 00:05:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064928_16621568.pth... [2023-12-26 00:05:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064000_16384000.pth [2023-12-26 00:05:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000064224_16441344.pth [2023-12-26 00:05:54,323][123091] Updated weights for policy 0, policy_version 65219 (0.0009) [2023-12-26 00:05:54,385][123090] Updated weights for policy 1, policy_version 64930 (0.0007) [2023-12-26 00:05:54,395][123091] Updated weights for policy 0, policy_version 65229 (0.0007) [2023-12-26 00:05:54,448][123090] Updated weights for policy 1, policy_version 64940 (0.0007) [2023-12-26 00:05:54,456][123091] Updated weights for policy 0, policy_version 65239 (0.0009) [2023-12-26 00:05:54,509][123090] Updated weights for policy 1, policy_version 64950 (0.0007) [2023-12-26 00:05:54,579][123090] Updated weights for policy 1, policy_version 64960 (0.0009) [2023-12-26 00:05:55,231][123091] Updated weights for policy 0, policy_version 65249 (0.0009) [2023-12-26 00:05:55,295][123091] Updated weights for policy 0, policy_version 65259 (0.0011) [2023-12-26 00:05:55,365][123091] Updated weights for policy 0, policy_version 65269 (0.0011) [2023-12-26 00:05:55,433][123091] Updated weights for policy 0, policy_version 65279 (0.0011) [2023-12-26 00:05:55,469][123090] Updated weights for policy 1, policy_version 64970 (0.0008) [2023-12-26 00:05:55,532][123090] Updated weights for policy 1, policy_version 64980 (0.0009) [2023-12-26 00:05:55,599][123090] Updated weights for policy 1, policy_version 64990 (0.0009) [2023-12-26 00:05:56,250][123091] Updated weights for policy 0, policy_version 65289 (0.0011) [2023-12-26 00:05:56,315][123091] Updated weights for policy 0, policy_version 65299 (0.0006) [2023-12-26 00:05:56,384][123091] Updated weights for policy 0, policy_version 65309 (0.0007) [2023-12-26 00:05:56,434][123090] Updated weights for policy 1, policy_version 65000 (0.0010) [2023-12-26 00:05:56,497][123090] Updated weights for policy 1, policy_version 65010 (0.0011) [2023-12-26 00:05:56,566][123090] Updated weights for policy 1, policy_version 65020 (0.0011) [2023-12-26 00:05:57,205][123091] Updated weights for policy 0, policy_version 65319 (0.0008) [2023-12-26 00:05:57,266][123091] Updated weights for policy 0, policy_version 65329 (0.0009) [2023-12-26 00:05:57,322][123091] Updated weights for policy 0, policy_version 65339 (0.0010) [2023-12-26 00:05:57,407][123090] Updated weights for policy 1, policy_version 65030 (0.0010) [2023-12-26 00:05:57,471][123090] Updated weights for policy 1, policy_version 65040 (0.0010) [2023-12-26 00:05:57,528][123090] Updated weights for policy 1, policy_version 65050 (0.0010) [2023-12-26 00:05:58,170][123091] Updated weights for policy 0, policy_version 65349 (0.0009) [2023-12-26 00:05:58,239][123091] Updated weights for policy 0, policy_version 65359 (0.0010) [2023-12-26 00:05:58,304][123091] Updated weights for policy 0, policy_version 65369 (0.0011) [2023-12-26 00:05:58,415][123090] Updated weights for policy 1, policy_version 65060 (0.0010) [2023-12-26 00:05:58,492][123090] Updated weights for policy 1, policy_version 65070 (0.0009) [2023-12-26 00:05:58,566][123090] Updated weights for policy 1, policy_version 65080 (0.0009) [2023-12-26 00:05:58,786][121949] Fps is (10 sec: 16381.5, 60 sec: 16520.2, 300 sec: 16550.5). Total num frames: 33398784. Throughput: 0: 8395.5, 1: 8044.1. Samples: 33391508. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:05:58,786][121949] Avg episode reward: [(0, '4249.182'), (1, '5232.505')] [2023-12-26 00:05:59,318][123091] Updated weights for policy 0, policy_version 65379 (0.0010) [2023-12-26 00:05:59,398][123091] Updated weights for policy 0, policy_version 65389 (0.0009) [2023-12-26 00:05:59,469][123091] Updated weights for policy 0, policy_version 65399 (0.0009) [2023-12-26 00:05:59,498][123090] Updated weights for policy 1, policy_version 65090 (0.0008) [2023-12-26 00:05:59,567][123090] Updated weights for policy 1, policy_version 65100 (0.0010) [2023-12-26 00:05:59,638][123090] Updated weights for policy 1, policy_version 65110 (0.0009) [2023-12-26 00:05:59,713][123090] Updated weights for policy 1, policy_version 65120 (0.0009) [2023-12-26 00:06:00,263][123091] Updated weights for policy 0, policy_version 65409 (0.0008) [2023-12-26 00:06:00,338][123091] Updated weights for policy 0, policy_version 65419 (0.0008) [2023-12-26 00:06:00,395][123091] Updated weights for policy 0, policy_version 65429 (0.0011) [2023-12-26 00:06:00,456][123091] Updated weights for policy 0, policy_version 65439 (0.0011) [2023-12-26 00:06:00,493][123090] Updated weights for policy 1, policy_version 65130 (0.0008) [2023-12-26 00:06:00,545][123090] Updated weights for policy 1, policy_version 65140 (0.0009) [2023-12-26 00:06:00,600][123090] Updated weights for policy 1, policy_version 65150 (0.0008) [2023-12-26 00:06:01,229][123091] Updated weights for policy 0, policy_version 65449 (0.0011) [2023-12-26 00:06:01,287][123091] Updated weights for policy 0, policy_version 65459 (0.0010) [2023-12-26 00:06:01,349][123091] Updated weights for policy 0, policy_version 65469 (0.0011) [2023-12-26 00:06:01,532][123090] Updated weights for policy 1, policy_version 65160 (0.0006) [2023-12-26 00:06:01,591][123090] Updated weights for policy 1, policy_version 65170 (0.0010) [2023-12-26 00:06:01,660][123090] Updated weights for policy 1, policy_version 65180 (0.0008) [2023-12-26 00:06:02,197][123091] Updated weights for policy 0, policy_version 65479 (0.0010) [2023-12-26 00:06:02,257][123091] Updated weights for policy 0, policy_version 65489 (0.0009) [2023-12-26 00:06:02,325][123091] Updated weights for policy 0, policy_version 65499 (0.0009) [2023-12-26 00:06:02,464][123090] Updated weights for policy 1, policy_version 65190 (0.0008) [2023-12-26 00:06:02,521][123090] Updated weights for policy 1, policy_version 65200 (0.0008) [2023-12-26 00:06:02,594][123090] Updated weights for policy 1, policy_version 65210 (0.0010) [2023-12-26 00:06:03,198][123091] Updated weights for policy 0, policy_version 65509 (0.0009) [2023-12-26 00:06:03,265][123091] Updated weights for policy 0, policy_version 65519 (0.0008) [2023-12-26 00:06:03,331][123091] Updated weights for policy 0, policy_version 65529 (0.0007) [2023-12-26 00:06:03,450][123090] Updated weights for policy 1, policy_version 65220 (0.0011) [2023-12-26 00:06:03,510][123090] Updated weights for policy 1, policy_version 65230 (0.0010) [2023-12-26 00:06:03,571][123090] Updated weights for policy 1, policy_version 65240 (0.0011) [2023-12-26 00:06:03,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16520.6, 300 sec: 16550.6). Total num frames: 33480704. Throughput: 0: 8347.8, 1: 8030.9. Samples: 33489164. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:03,785][121949] Avg episode reward: [(0, '4189.884'), (1, '5079.429')] [2023-12-26 00:06:04,162][123091] Updated weights for policy 0, policy_version 65539 (0.0008) [2023-12-26 00:06:04,233][123091] Updated weights for policy 0, policy_version 65549 (0.0010) [2023-12-26 00:06:04,310][123091] Updated weights for policy 0, policy_version 65559 (0.0009) [2023-12-26 00:06:04,400][123090] Updated weights for policy 1, policy_version 65250 (0.0011) [2023-12-26 00:06:04,462][123090] Updated weights for policy 1, policy_version 65260 (0.0011) [2023-12-26 00:06:04,529][123090] Updated weights for policy 1, policy_version 65270 (0.0011) [2023-12-26 00:06:04,601][123090] Updated weights for policy 1, policy_version 65280 (0.0008) [2023-12-26 00:06:05,176][123091] Updated weights for policy 0, policy_version 65569 (0.0007) [2023-12-26 00:06:05,238][123091] Updated weights for policy 0, policy_version 65579 (0.0009) [2023-12-26 00:06:05,296][123091] Updated weights for policy 0, policy_version 65589 (0.0009) [2023-12-26 00:06:05,361][123091] Updated weights for policy 0, policy_version 65599 (0.0007) [2023-12-26 00:06:05,367][123090] Updated weights for policy 1, policy_version 65290 (0.0011) [2023-12-26 00:06:05,432][123090] Updated weights for policy 1, policy_version 65300 (0.0010) [2023-12-26 00:06:05,494][123090] Updated weights for policy 1, policy_version 65310 (0.0011) [2023-12-26 00:06:06,258][123091] Updated weights for policy 0, policy_version 65609 (0.0008) [2023-12-26 00:06:06,335][123091] Updated weights for policy 0, policy_version 65619 (0.0009) [2023-12-26 00:06:06,362][123090] Updated weights for policy 1, policy_version 65320 (0.0010) [2023-12-26 00:06:06,400][123091] Updated weights for policy 0, policy_version 65629 (0.0006) [2023-12-26 00:06:06,436][123090] Updated weights for policy 1, policy_version 65330 (0.0010) [2023-12-26 00:06:06,511][123090] Updated weights for policy 1, policy_version 65340 (0.0012) [2023-12-26 00:06:07,289][123091] Updated weights for policy 0, policy_version 65639 (0.0010) [2023-12-26 00:06:07,345][123090] Updated weights for policy 1, policy_version 65350 (0.0007) [2023-12-26 00:06:07,359][123091] Updated weights for policy 0, policy_version 65649 (0.0009) [2023-12-26 00:06:07,419][123090] Updated weights for policy 1, policy_version 65360 (0.0007) [2023-12-26 00:06:07,426][123091] Updated weights for policy 0, policy_version 65659 (0.0008) [2023-12-26 00:06:07,483][123090] Updated weights for policy 1, policy_version 65370 (0.0010) [2023-12-26 00:06:08,123][123091] Updated weights for policy 0, policy_version 65669 (0.0009) [2023-12-26 00:06:08,187][123091] Updated weights for policy 0, policy_version 65679 (0.0009) [2023-12-26 00:06:08,253][123091] Updated weights for policy 0, policy_version 65689 (0.0010) [2023-12-26 00:06:08,255][123090] Updated weights for policy 1, policy_version 65380 (0.0008) [2023-12-26 00:06:08,318][123090] Updated weights for policy 1, policy_version 65390 (0.0009) [2023-12-26 00:06:08,398][123090] Updated weights for policy 1, policy_version 65400 (0.0009) [2023-12-26 00:06:08,784][121949] Fps is (10 sec: 16386.4, 60 sec: 16520.5, 300 sec: 16550.6). Total num frames: 33562624. Throughput: 0: 8347.6, 1: 8068.0. Samples: 33538368. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:08,785][121949] Avg episode reward: [(0, '4201.649'), (1, '4846.379')] [2023-12-26 00:06:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000065696_16818176.pth... [2023-12-26 00:06:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000065408_16744448.pth... [2023-12-26 00:06:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064448_16498688.pth [2023-12-26 00:06:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000064736_16572416.pth [2023-12-26 00:06:09,052][123091] Updated weights for policy 0, policy_version 65699 (0.0009) [2023-12-26 00:06:09,119][123091] Updated weights for policy 0, policy_version 65709 (0.0008) [2023-12-26 00:06:09,174][123091] Updated weights for policy 0, policy_version 65719 (0.0009) [2023-12-26 00:06:09,245][123090] Updated weights for policy 1, policy_version 65410 (0.0009) [2023-12-26 00:06:09,319][123090] Updated weights for policy 1, policy_version 65420 (0.0009) [2023-12-26 00:06:09,399][123090] Updated weights for policy 1, policy_version 65430 (0.0010) [2023-12-26 00:06:09,476][123090] Updated weights for policy 1, policy_version 65440 (0.0008) [2023-12-26 00:06:10,077][123091] Updated weights for policy 0, policy_version 65729 (0.0012) [2023-12-26 00:06:10,150][123091] Updated weights for policy 0, policy_version 65739 (0.0008) [2023-12-26 00:06:10,217][123091] Updated weights for policy 0, policy_version 65749 (0.0007) [2023-12-26 00:06:10,281][123090] Updated weights for policy 1, policy_version 65450 (0.0010) [2023-12-26 00:06:10,287][123091] Updated weights for policy 0, policy_version 65759 (0.0007) [2023-12-26 00:06:10,352][123090] Updated weights for policy 1, policy_version 65460 (0.0010) [2023-12-26 00:06:10,424][123090] Updated weights for policy 1, policy_version 65470 (0.0009) [2023-12-26 00:06:11,060][123091] Updated weights for policy 0, policy_version 65769 (0.0009) [2023-12-26 00:06:11,127][123091] Updated weights for policy 0, policy_version 65779 (0.0010) [2023-12-26 00:06:11,209][123091] Updated weights for policy 0, policy_version 65789 (0.0009) [2023-12-26 00:06:11,310][123090] Updated weights for policy 1, policy_version 65480 (0.0008) [2023-12-26 00:06:11,391][123090] Updated weights for policy 1, policy_version 65490 (0.0008) [2023-12-26 00:06:11,462][123090] Updated weights for policy 1, policy_version 65500 (0.0008) [2023-12-26 00:06:12,070][123091] Updated weights for policy 0, policy_version 65799 (0.0010) [2023-12-26 00:06:12,139][123091] Updated weights for policy 0, policy_version 65809 (0.0010) [2023-12-26 00:06:12,203][123091] Updated weights for policy 0, policy_version 65819 (0.0009) [2023-12-26 00:06:12,328][123090] Updated weights for policy 1, policy_version 65510 (0.0009) [2023-12-26 00:06:12,407][123090] Updated weights for policy 1, policy_version 65520 (0.0010) [2023-12-26 00:06:12,473][123090] Updated weights for policy 1, policy_version 65530 (0.0010) [2023-12-26 00:06:13,116][123091] Updated weights for policy 0, policy_version 65829 (0.0010) [2023-12-26 00:06:13,186][123091] Updated weights for policy 0, policy_version 65839 (0.0010) [2023-12-26 00:06:13,247][123091] Updated weights for policy 0, policy_version 65849 (0.0009) [2023-12-26 00:06:13,327][123090] Updated weights for policy 1, policy_version 65540 (0.0009) [2023-12-26 00:06:13,394][123090] Updated weights for policy 1, policy_version 65550 (0.0007) [2023-12-26 00:06:13,450][123090] Updated weights for policy 1, policy_version 65560 (0.0005) [2023-12-26 00:06:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16520.6, 300 sec: 16550.6). Total num frames: 33644544. Throughput: 0: 8330.4, 1: 8108.5. Samples: 33638120. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:13,785][121949] Avg episode reward: [(0, '4162.834'), (1, '4924.605')] [2023-12-26 00:06:14,130][123091] Updated weights for policy 0, policy_version 65859 (0.0009) [2023-12-26 00:06:14,188][123091] Updated weights for policy 0, policy_version 65869 (0.0009) [2023-12-26 00:06:14,203][123090] Updated weights for policy 1, policy_version 65570 (0.0007) [2023-12-26 00:06:14,252][123091] Updated weights for policy 0, policy_version 65879 (0.0008) [2023-12-26 00:06:14,263][123090] Updated weights for policy 1, policy_version 65580 (0.0009) [2023-12-26 00:06:14,335][123090] Updated weights for policy 1, policy_version 65590 (0.0009) [2023-12-26 00:06:14,398][123090] Updated weights for policy 1, policy_version 65600 (0.0010) [2023-12-26 00:06:15,110][123091] Updated weights for policy 0, policy_version 65889 (0.0009) [2023-12-26 00:06:15,178][123091] Updated weights for policy 0, policy_version 65899 (0.0010) [2023-12-26 00:06:15,237][123090] Updated weights for policy 1, policy_version 65610 (0.0009) [2023-12-26 00:06:15,248][123091] Updated weights for policy 0, policy_version 65909 (0.0009) [2023-12-26 00:06:15,306][123090] Updated weights for policy 1, policy_version 65620 (0.0008) [2023-12-26 00:06:15,318][123091] Updated weights for policy 0, policy_version 65919 (0.0007) [2023-12-26 00:06:15,375][123090] Updated weights for policy 1, policy_version 65630 (0.0006) [2023-12-26 00:06:16,177][123091] Updated weights for policy 0, policy_version 65929 (0.0009) [2023-12-26 00:06:16,190][123090] Updated weights for policy 1, policy_version 65640 (0.0007) [2023-12-26 00:06:16,236][123091] Updated weights for policy 0, policy_version 65939 (0.0008) [2023-12-26 00:06:16,254][123090] Updated weights for policy 1, policy_version 65650 (0.0011) [2023-12-26 00:06:16,302][123091] Updated weights for policy 0, policy_version 65949 (0.0009) [2023-12-26 00:06:16,322][123090] Updated weights for policy 1, policy_version 65660 (0.0010) [2023-12-26 00:06:17,024][123090] Updated weights for policy 1, policy_version 65670 (0.0010) [2023-12-26 00:06:17,089][123090] Updated weights for policy 1, policy_version 65680 (0.0011) [2023-12-26 00:06:17,156][123090] Updated weights for policy 1, policy_version 65690 (0.0007) [2023-12-26 00:06:17,169][123091] Updated weights for policy 0, policy_version 65959 (0.0009) [2023-12-26 00:06:17,226][123091] Updated weights for policy 0, policy_version 65969 (0.0010) [2023-12-26 00:06:17,291][123091] Updated weights for policy 0, policy_version 65979 (0.0006) [2023-12-26 00:06:17,883][123090] Updated weights for policy 1, policy_version 65700 (0.0008) [2023-12-26 00:06:17,939][123090] Updated weights for policy 1, policy_version 65710 (0.0011) [2023-12-26 00:06:17,992][123090] Updated weights for policy 1, policy_version 65720 (0.0010) [2023-12-26 00:06:18,113][123091] Updated weights for policy 0, policy_version 65989 (0.0011) [2023-12-26 00:06:18,173][123091] Updated weights for policy 0, policy_version 65999 (0.0010) [2023-12-26 00:06:18,234][123091] Updated weights for policy 0, policy_version 66009 (0.0011) [2023-12-26 00:06:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 16520.6, 300 sec: 16606.2). Total num frames: 33726464. Throughput: 0: 8298.8, 1: 8213.3. Samples: 33740780. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:18,785][121949] Avg episode reward: [(0, '4282.560'), (1, '5149.201')] [2023-12-26 00:06:18,811][123090] Updated weights for policy 1, policy_version 65730 (0.0010) [2023-12-26 00:06:18,885][123090] Updated weights for policy 1, policy_version 65740 (0.0009) [2023-12-26 00:06:18,950][123090] Updated weights for policy 1, policy_version 65750 (0.0009) [2023-12-26 00:06:19,016][123090] Updated weights for policy 1, policy_version 65760 (0.0009) [2023-12-26 00:06:19,025][123091] Updated weights for policy 0, policy_version 66019 (0.0011) [2023-12-26 00:06:19,089][123091] Updated weights for policy 0, policy_version 66029 (0.0010) [2023-12-26 00:06:19,154][123091] Updated weights for policy 0, policy_version 66039 (0.0011) [2023-12-26 00:06:19,882][123090] Updated weights for policy 1, policy_version 65770 (0.0009) [2023-12-26 00:06:19,961][123090] Updated weights for policy 1, policy_version 65780 (0.0009) [2023-12-26 00:06:20,037][123090] Updated weights for policy 1, policy_version 65790 (0.0009) [2023-12-26 00:06:20,095][123091] Updated weights for policy 0, policy_version 66049 (0.0011) [2023-12-26 00:06:20,158][123091] Updated weights for policy 0, policy_version 66059 (0.0009) [2023-12-26 00:06:20,228][123091] Updated weights for policy 0, policy_version 66069 (0.0009) [2023-12-26 00:06:20,295][123091] Updated weights for policy 0, policy_version 66079 (0.0009) [2023-12-26 00:06:20,883][123090] Updated weights for policy 1, policy_version 65800 (0.0009) [2023-12-26 00:06:20,956][123090] Updated weights for policy 1, policy_version 65810 (0.0009) [2023-12-26 00:06:21,027][123090] Updated weights for policy 1, policy_version 65820 (0.0009) [2023-12-26 00:06:21,188][123091] Updated weights for policy 0, policy_version 66089 (0.0009) [2023-12-26 00:06:21,253][123091] Updated weights for policy 0, policy_version 66099 (0.0008) [2023-12-26 00:06:21,329][123091] Updated weights for policy 0, policy_version 66109 (0.0008) [2023-12-26 00:06:21,940][123090] Updated weights for policy 1, policy_version 65830 (0.0009) [2023-12-26 00:06:22,015][123090] Updated weights for policy 1, policy_version 65840 (0.0010) [2023-12-26 00:06:22,084][123090] Updated weights for policy 1, policy_version 65850 (0.0009) [2023-12-26 00:06:22,144][123091] Updated weights for policy 0, policy_version 66119 (0.0008) [2023-12-26 00:06:22,216][123091] Updated weights for policy 0, policy_version 66129 (0.0008) [2023-12-26 00:06:22,290][123091] Updated weights for policy 0, policy_version 66139 (0.0008) [2023-12-26 00:06:22,991][123090] Updated weights for policy 1, policy_version 65860 (0.0009) [2023-12-26 00:06:23,061][123090] Updated weights for policy 1, policy_version 65870 (0.0009) [2023-12-26 00:06:23,134][123090] Updated weights for policy 1, policy_version 65880 (0.0009) [2023-12-26 00:06:23,156][123091] Updated weights for policy 0, policy_version 66149 (0.0008) [2023-12-26 00:06:23,217][123091] Updated weights for policy 0, policy_version 66159 (0.0009) [2023-12-26 00:06:23,287][123091] Updated weights for policy 0, policy_version 66169 (0.0009) [2023-12-26 00:06:23,784][121949] Fps is (10 sec: 16383.5, 60 sec: 16520.5, 300 sec: 16606.1). Total num frames: 33808384. Throughput: 0: 8278.7, 1: 8196.6. Samples: 33788856. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:23,785][121949] Avg episode reward: [(0, '4240.015'), (1, '5130.753')] [2023-12-26 00:06:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000066176_16941056.pth... [2023-12-26 00:06:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000065888_16867328.pth... [2023-12-26 00:06:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000065216_16695296.pth [2023-12-26 00:06:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000064928_16621568.pth [2023-12-26 00:06:23,993][123090] Updated weights for policy 1, policy_version 65890 (0.0009) [2023-12-26 00:06:24,065][123090] Updated weights for policy 1, policy_version 65900 (0.0010) [2023-12-26 00:06:24,127][123091] Updated weights for policy 0, policy_version 66179 (0.0010) [2023-12-26 00:06:24,129][123090] Updated weights for policy 1, policy_version 65910 (0.0010) [2023-12-26 00:06:24,192][123091] Updated weights for policy 0, policy_version 66189 (0.0008) [2023-12-26 00:06:24,196][123090] Updated weights for policy 1, policy_version 65920 (0.0006) [2023-12-26 00:06:24,246][123091] Updated weights for policy 0, policy_version 66199 (0.0006) [2023-12-26 00:06:24,953][123091] Updated weights for policy 0, policy_version 66209 (0.0006) [2023-12-26 00:06:25,026][123090] Updated weights for policy 1, policy_version 65930 (0.0009) [2023-12-26 00:06:25,031][123091] Updated weights for policy 0, policy_version 66219 (0.0007) [2023-12-26 00:06:25,091][123090] Updated weights for policy 1, policy_version 65940 (0.0007) [2023-12-26 00:06:25,101][123091] Updated weights for policy 0, policy_version 66229 (0.0010) [2023-12-26 00:06:25,152][123090] Updated weights for policy 1, policy_version 65950 (0.0007) [2023-12-26 00:06:25,169][123091] Updated weights for policy 0, policy_version 66239 (0.0011) [2023-12-26 00:06:25,970][123091] Updated weights for policy 0, policy_version 66249 (0.0007) [2023-12-26 00:06:26,030][123090] Updated weights for policy 1, policy_version 65960 (0.0009) [2023-12-26 00:06:26,031][123091] Updated weights for policy 0, policy_version 66259 (0.0006) [2023-12-26 00:06:26,082][123090] Updated weights for policy 1, policy_version 65970 (0.0010) [2023-12-26 00:06:26,097][123091] Updated weights for policy 0, policy_version 66269 (0.0009) [2023-12-26 00:06:26,144][123090] Updated weights for policy 1, policy_version 65980 (0.0010) [2023-12-26 00:06:26,835][123091] Updated weights for policy 0, policy_version 66279 (0.0010) [2023-12-26 00:06:26,912][123091] Updated weights for policy 0, policy_version 66289 (0.0011) [2023-12-26 00:06:26,968][123090] Updated weights for policy 1, policy_version 65990 (0.0011) [2023-12-26 00:06:26,970][123091] Updated weights for policy 0, policy_version 66299 (0.0011) [2023-12-26 00:06:27,038][123090] Updated weights for policy 1, policy_version 66000 (0.0011) [2023-12-26 00:06:27,111][123090] Updated weights for policy 1, policy_version 66010 (0.0011) [2023-12-26 00:06:27,762][123091] Updated weights for policy 0, policy_version 66309 (0.0008) [2023-12-26 00:06:27,826][123091] Updated weights for policy 0, policy_version 66319 (0.0006) [2023-12-26 00:06:27,878][123091] Updated weights for policy 0, policy_version 66329 (0.0005) [2023-12-26 00:06:27,942][123090] Updated weights for policy 1, policy_version 66020 (0.0010) [2023-12-26 00:06:28,005][123090] Updated weights for policy 1, policy_version 66030 (0.0010) [2023-12-26 00:06:28,065][123090] Updated weights for policy 1, policy_version 66040 (0.0010) [2023-12-26 00:06:28,613][123091] Updated weights for policy 0, policy_version 66339 (0.0006) [2023-12-26 00:06:28,689][123091] Updated weights for policy 0, policy_version 66349 (0.0006) [2023-12-26 00:06:28,756][123091] Updated weights for policy 0, policy_version 66359 (0.0009) [2023-12-26 00:06:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 16578.4). Total num frames: 33890304. Throughput: 0: 8353.6, 1: 8215.5. Samples: 33890252. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 00:06:28,785][121949] Avg episode reward: [(0, '4110.261'), (1, '5120.154')] [2023-12-26 00:06:28,899][123090] Updated weights for policy 1, policy_version 66050 (0.0010) [2023-12-26 00:06:28,971][123090] Updated weights for policy 1, policy_version 66060 (0.0009) [2023-12-26 00:06:29,039][123090] Updated weights for policy 1, policy_version 66070 (0.0010) [2023-12-26 00:06:29,097][123090] Updated weights for policy 1, policy_version 66080 (0.0009) [2023-12-26 00:06:29,580][123091] Updated weights for policy 0, policy_version 66369 (0.0010) [2023-12-26 00:06:29,644][123091] Updated weights for policy 0, policy_version 66379 (0.0008) [2023-12-26 00:06:29,713][123091] Updated weights for policy 0, policy_version 66389 (0.0006) [2023-12-26 00:06:29,779][123091] Updated weights for policy 0, policy_version 66399 (0.0006) [2023-12-26 00:06:30,006][123090] Updated weights for policy 1, policy_version 66090 (0.0010) [2023-12-26 00:06:30,075][123090] Updated weights for policy 1, policy_version 66100 (0.0010) [2023-12-26 00:06:30,137][123090] Updated weights for policy 1, policy_version 66110 (0.0011) [2023-12-26 00:06:30,587][123091] Updated weights for policy 0, policy_version 66409 (0.0010) [2023-12-26 00:06:30,644][123091] Updated weights for policy 0, policy_version 66419 (0.0009) [2023-12-26 00:06:30,700][123091] Updated weights for policy 0, policy_version 66429 (0.0010) [2023-12-26 00:06:30,991][123090] Updated weights for policy 1, policy_version 66120 (0.0011) [2023-12-26 00:06:31,058][123090] Updated weights for policy 1, policy_version 66130 (0.0010) [2023-12-26 00:06:31,133][123090] Updated weights for policy 1, policy_version 66140 (0.0008) [2023-12-26 00:06:31,513][123091] Updated weights for policy 0, policy_version 66439 (0.0008) [2023-12-26 00:06:31,579][123091] Updated weights for policy 0, policy_version 66449 (0.0008) [2023-12-26 00:06:31,633][123091] Updated weights for policy 0, policy_version 66459 (0.0009) [2023-12-26 00:06:32,012][123090] Updated weights for policy 1, policy_version 66150 (0.0013) [2023-12-26 00:06:32,085][123090] Updated weights for policy 1, policy_version 66160 (0.0009) [2023-12-26 00:06:32,147][123090] Updated weights for policy 1, policy_version 66170 (0.0009) [2023-12-26 00:06:32,486][123091] Updated weights for policy 0, policy_version 66469 (0.0009) [2023-12-26 00:06:32,551][123091] Updated weights for policy 0, policy_version 66479 (0.0009) [2023-12-26 00:06:32,614][123091] Updated weights for policy 0, policy_version 66489 (0.0009) [2023-12-26 00:06:32,955][123090] Updated weights for policy 1, policy_version 66180 (0.0010) [2023-12-26 00:06:33,019][123090] Updated weights for policy 1, policy_version 66190 (0.0011) [2023-12-26 00:06:33,079][123090] Updated weights for policy 1, policy_version 66200 (0.0010) [2023-12-26 00:06:33,447][123091] Updated weights for policy 0, policy_version 66499 (0.0009) [2023-12-26 00:06:33,518][123091] Updated weights for policy 0, policy_version 66509 (0.0009) [2023-12-26 00:06:33,583][123091] Updated weights for policy 0, policy_version 66519 (0.0009) [2023-12-26 00:06:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 16657.1, 300 sec: 16606.2). Total num frames: 33980416. Throughput: 0: 8349.6, 1: 8242.9. Samples: 33990724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:33,785][121949] Avg episode reward: [(0, '4232.202'), (1, '5186.265')] [2023-12-26 00:06:33,903][123090] Updated weights for policy 1, policy_version 66210 (0.0009) [2023-12-26 00:06:33,970][123090] Updated weights for policy 1, policy_version 66220 (0.0011) [2023-12-26 00:06:34,029][123090] Updated weights for policy 1, policy_version 66230 (0.0010) [2023-12-26 00:06:34,087][123090] Updated weights for policy 1, policy_version 66240 (0.0005) [2023-12-26 00:06:34,447][123091] Updated weights for policy 0, policy_version 66529 (0.0009) [2023-12-26 00:06:34,518][123091] Updated weights for policy 0, policy_version 66539 (0.0011) [2023-12-26 00:06:34,583][123091] Updated weights for policy 0, policy_version 66549 (0.0011) [2023-12-26 00:06:34,652][123091] Updated weights for policy 0, policy_version 66559 (0.0010) [2023-12-26 00:06:34,902][123090] Updated weights for policy 1, policy_version 66250 (0.0010) [2023-12-26 00:06:34,971][123090] Updated weights for policy 1, policy_version 66260 (0.0009) [2023-12-26 00:06:35,034][123090] Updated weights for policy 1, policy_version 66270 (0.0009) [2023-12-26 00:06:35,510][123091] Updated weights for policy 0, policy_version 66569 (0.0011) [2023-12-26 00:06:35,574][123091] Updated weights for policy 0, policy_version 66579 (0.0011) [2023-12-26 00:06:35,641][123091] Updated weights for policy 0, policy_version 66589 (0.0011) [2023-12-26 00:06:35,895][123090] Updated weights for policy 1, policy_version 66280 (0.0009) [2023-12-26 00:06:35,953][123090] Updated weights for policy 1, policy_version 66290 (0.0009) [2023-12-26 00:06:36,015][123090] Updated weights for policy 1, policy_version 66300 (0.0009) [2023-12-26 00:06:36,502][123091] Updated weights for policy 0, policy_version 66599 (0.0008) [2023-12-26 00:06:36,574][123091] Updated weights for policy 0, policy_version 66609 (0.0006) [2023-12-26 00:06:36,645][123091] Updated weights for policy 0, policy_version 66619 (0.0010) [2023-12-26 00:06:36,901][123090] Updated weights for policy 1, policy_version 66310 (0.0009) [2023-12-26 00:06:36,966][123090] Updated weights for policy 1, policy_version 66320 (0.0009) [2023-12-26 00:06:37,031][123090] Updated weights for policy 1, policy_version 66330 (0.0009) [2023-12-26 00:06:37,437][123091] Updated weights for policy 0, policy_version 66629 (0.0010) [2023-12-26 00:06:37,500][123091] Updated weights for policy 0, policy_version 66639 (0.0010) [2023-12-26 00:06:37,562][123091] Updated weights for policy 0, policy_version 66649 (0.0010) [2023-12-26 00:06:37,837][123090] Updated weights for policy 1, policy_version 66340 (0.0007) [2023-12-26 00:06:37,894][123090] Updated weights for policy 1, policy_version 66350 (0.0010) [2023-12-26 00:06:37,957][123090] Updated weights for policy 1, policy_version 66360 (0.0010) [2023-12-26 00:06:38,468][123091] Updated weights for policy 0, policy_version 66659 (0.0010) [2023-12-26 00:06:38,536][123091] Updated weights for policy 0, policy_version 66669 (0.0009) [2023-12-26 00:06:38,603][123091] Updated weights for policy 0, policy_version 66679 (0.0010) [2023-12-26 00:06:38,767][123090] Updated weights for policy 1, policy_version 66370 (0.0008) [2023-12-26 00:06:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 16520.6, 300 sec: 16606.2). Total num frames: 34062336. Throughput: 0: 8358.8, 1: 8276.4. Samples: 34040280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:38,785][121949] Avg episode reward: [(0, '4220.951'), (1, '5198.236')] [2023-12-26 00:06:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000066688_17072128.pth... [2023-12-26 00:06:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000065696_16818176.pth [2023-12-26 00:06:38,831][123090] Updated weights for policy 1, policy_version 66380 (0.0008) [2023-12-26 00:06:38,896][123090] Updated weights for policy 1, policy_version 66390 (0.0011) [2023-12-26 00:06:38,965][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000066400_16998400.pth... [2023-12-26 00:06:38,966][123090] Updated weights for policy 1, policy_version 66400 (0.0007) [2023-12-26 00:06:38,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000065408_16744448.pth [2023-12-26 00:06:39,498][123091] Updated weights for policy 0, policy_version 66689 (0.0009) [2023-12-26 00:06:39,571][123091] Updated weights for policy 0, policy_version 66699 (0.0010) [2023-12-26 00:06:39,633][123091] Updated weights for policy 0, policy_version 66709 (0.0009) [2023-12-26 00:06:39,702][123091] Updated weights for policy 0, policy_version 66719 (0.0009) [2023-12-26 00:06:39,743][123090] Updated weights for policy 1, policy_version 66410 (0.0011) [2023-12-26 00:06:39,812][123090] Updated weights for policy 1, policy_version 66420 (0.0010) [2023-12-26 00:06:39,884][123090] Updated weights for policy 1, policy_version 66430 (0.0009) [2023-12-26 00:06:40,598][123091] Updated weights for policy 0, policy_version 66729 (0.0010) [2023-12-26 00:06:40,662][123091] Updated weights for policy 0, policy_version 66739 (0.0009) [2023-12-26 00:06:40,714][123090] Updated weights for policy 1, policy_version 66440 (0.0010) [2023-12-26 00:06:40,725][123091] Updated weights for policy 0, policy_version 66749 (0.0008) [2023-12-26 00:06:40,785][123090] Updated weights for policy 1, policy_version 66450 (0.0011) [2023-12-26 00:06:40,858][123090] Updated weights for policy 1, policy_version 66460 (0.0011) [2023-12-26 00:06:41,626][123091] Updated weights for policy 0, policy_version 66759 (0.0008) [2023-12-26 00:06:41,700][123091] Updated weights for policy 0, policy_version 66769 (0.0008) [2023-12-26 00:06:41,762][123090] Updated weights for policy 1, policy_version 66470 (0.0008) [2023-12-26 00:06:41,777][123091] Updated weights for policy 0, policy_version 66779 (0.0010) [2023-12-26 00:06:41,831][123090] Updated weights for policy 1, policy_version 66480 (0.0007) [2023-12-26 00:06:41,905][123090] Updated weights for policy 1, policy_version 66490 (0.0009) [2023-12-26 00:06:42,633][123091] Updated weights for policy 0, policy_version 66789 (0.0008) [2023-12-26 00:06:42,706][123091] Updated weights for policy 0, policy_version 66799 (0.0011) [2023-12-26 00:06:42,773][123091] Updated weights for policy 0, policy_version 66809 (0.0011) [2023-12-26 00:06:42,798][123090] Updated weights for policy 1, policy_version 66500 (0.0009) [2023-12-26 00:06:42,864][123090] Updated weights for policy 1, policy_version 66510 (0.0009) [2023-12-26 00:06:42,925][123090] Updated weights for policy 1, policy_version 66520 (0.0011) [2023-12-26 00:06:43,482][123091] Updated weights for policy 0, policy_version 66819 (0.0007) [2023-12-26 00:06:43,553][123091] Updated weights for policy 0, policy_version 66829 (0.0009) [2023-12-26 00:06:43,607][123091] Updated weights for policy 0, policy_version 66839 (0.0010) [2023-12-26 00:06:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 16606.2). Total num frames: 34144256. Throughput: 0: 8296.1, 1: 8291.8. Samples: 34137940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:43,785][121949] Avg episode reward: [(0, '4210.864'), (1, '5099.905')] [2023-12-26 00:06:43,872][123090] Updated weights for policy 1, policy_version 66530 (0.0010) [2023-12-26 00:06:43,939][123090] Updated weights for policy 1, policy_version 66541 (0.0011) [2023-12-26 00:06:44,004][123090] Updated weights for policy 1, policy_version 66551 (0.0010) [2023-12-26 00:06:44,398][123091] Updated weights for policy 0, policy_version 66849 (0.0006) [2023-12-26 00:06:44,455][123091] Updated weights for policy 0, policy_version 66859 (0.0007) [2023-12-26 00:06:44,514][123091] Updated weights for policy 0, policy_version 66869 (0.0007) [2023-12-26 00:06:44,580][123091] Updated weights for policy 0, policy_version 66879 (0.0007) [2023-12-26 00:06:44,905][123090] Updated weights for policy 1, policy_version 66561 (0.0009) [2023-12-26 00:06:44,968][123090] Updated weights for policy 1, policy_version 66571 (0.0010) [2023-12-26 00:06:45,039][123090] Updated weights for policy 1, policy_version 66581 (0.0010) [2023-12-26 00:06:45,108][123090] Updated weights for policy 1, policy_version 66591 (0.0010) [2023-12-26 00:06:45,392][123091] Updated weights for policy 0, policy_version 66889 (0.0008) [2023-12-26 00:06:45,459][123091] Updated weights for policy 0, policy_version 66899 (0.0010) [2023-12-26 00:06:45,523][123091] Updated weights for policy 0, policy_version 66909 (0.0010) [2023-12-26 00:06:45,998][123090] Updated weights for policy 1, policy_version 66601 (0.0010) [2023-12-26 00:06:46,062][123090] Updated weights for policy 1, policy_version 66611 (0.0008) [2023-12-26 00:06:46,135][123090] Updated weights for policy 1, policy_version 66621 (0.0007) [2023-12-26 00:06:46,368][123091] Updated weights for policy 0, policy_version 66919 (0.0008) [2023-12-26 00:06:46,432][123091] Updated weights for policy 0, policy_version 66929 (0.0010) [2023-12-26 00:06:46,495][123091] Updated weights for policy 0, policy_version 66939 (0.0009) [2023-12-26 00:06:46,848][123090] Updated weights for policy 1, policy_version 66631 (0.0010) [2023-12-26 00:06:46,913][123090] Updated weights for policy 1, policy_version 66641 (0.0011) [2023-12-26 00:06:46,982][123090] Updated weights for policy 1, policy_version 66651 (0.0011) [2023-12-26 00:06:47,338][123091] Updated weights for policy 0, policy_version 66949 (0.0008) [2023-12-26 00:06:47,400][123091] Updated weights for policy 0, policy_version 66959 (0.0006) [2023-12-26 00:06:47,451][123091] Updated weights for policy 0, policy_version 66969 (0.0006) [2023-12-26 00:06:47,826][123090] Updated weights for policy 1, policy_version 66661 (0.0011) [2023-12-26 00:06:47,886][123090] Updated weights for policy 1, policy_version 66671 (0.0011) [2023-12-26 00:06:47,958][123090] Updated weights for policy 1, policy_version 66681 (0.0011) [2023-12-26 00:06:48,195][123091] Updated weights for policy 0, policy_version 66979 (0.0007) [2023-12-26 00:06:48,260][123091] Updated weights for policy 0, policy_version 66989 (0.0009) [2023-12-26 00:06:48,325][123091] Updated weights for policy 0, policy_version 66999 (0.0009) [2023-12-26 00:06:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 34226176. Throughput: 0: 8373.8, 1: 8298.3. Samples: 34239408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:48,785][121949] Avg episode reward: [(0, '4182.788'), (1, '5108.697')] [2023-12-26 00:06:48,796][123090] Updated weights for policy 1, policy_version 66691 (0.0010) [2023-12-26 00:06:48,873][123090] Updated weights for policy 1, policy_version 66701 (0.0009) [2023-12-26 00:06:48,946][123090] Updated weights for policy 1, policy_version 66711 (0.0011) [2023-12-26 00:06:49,195][123091] Updated weights for policy 0, policy_version 67009 (0.0009) [2023-12-26 00:06:49,280][123091] Updated weights for policy 0, policy_version 67019 (0.0008) [2023-12-26 00:06:49,358][123091] Updated weights for policy 0, policy_version 67029 (0.0009) [2023-12-26 00:06:49,429][123091] Updated weights for policy 0, policy_version 67039 (0.0010) [2023-12-26 00:06:49,814][123090] Updated weights for policy 1, policy_version 66721 (0.0009) [2023-12-26 00:06:49,888][123090] Updated weights for policy 1, policy_version 66731 (0.0011) [2023-12-26 00:06:49,970][123090] Updated weights for policy 1, policy_version 66741 (0.0010) [2023-12-26 00:06:50,034][123090] Updated weights for policy 1, policy_version 66751 (0.0010) [2023-12-26 00:06:50,231][123091] Updated weights for policy 0, policy_version 67049 (0.0010) [2023-12-26 00:06:50,291][123091] Updated weights for policy 0, policy_version 67059 (0.0010) [2023-12-26 00:06:50,358][123091] Updated weights for policy 0, policy_version 67069 (0.0009) [2023-12-26 00:06:50,887][123090] Updated weights for policy 1, policy_version 66761 (0.0010) [2023-12-26 00:06:50,948][123090] Updated weights for policy 1, policy_version 66771 (0.0010) [2023-12-26 00:06:51,016][123090] Updated weights for policy 1, policy_version 66781 (0.0011) [2023-12-26 00:06:51,251][123091] Updated weights for policy 0, policy_version 67079 (0.0010) [2023-12-26 00:06:51,313][123091] Updated weights for policy 0, policy_version 67089 (0.0009) [2023-12-26 00:06:51,390][123091] Updated weights for policy 0, policy_version 67099 (0.0010) [2023-12-26 00:06:51,933][123090] Updated weights for policy 1, policy_version 66791 (0.0009) [2023-12-26 00:06:52,002][123090] Updated weights for policy 1, policy_version 66801 (0.0010) [2023-12-26 00:06:52,072][123090] Updated weights for policy 1, policy_version 66811 (0.0010) [2023-12-26 00:06:52,246][123091] Updated weights for policy 0, policy_version 67109 (0.0010) [2023-12-26 00:06:52,320][123091] Updated weights for policy 0, policy_version 67119 (0.0007) [2023-12-26 00:06:52,396][123091] Updated weights for policy 0, policy_version 67129 (0.0014) [2023-12-26 00:06:52,931][123090] Updated weights for policy 1, policy_version 66821 (0.0010) [2023-12-26 00:06:53,000][123090] Updated weights for policy 1, policy_version 66831 (0.0010) [2023-12-26 00:06:53,067][123090] Updated weights for policy 1, policy_version 66841 (0.0010) [2023-12-26 00:06:53,219][123091] Updated weights for policy 0, policy_version 67139 (0.0008) [2023-12-26 00:06:53,280][123091] Updated weights for policy 0, policy_version 67149 (0.0008) [2023-12-26 00:06:53,349][123091] Updated weights for policy 0, policy_version 67159 (0.0009) [2023-12-26 00:06:53,784][121949] Fps is (10 sec: 16383.7, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 34308096. Throughput: 0: 8379.1, 1: 8273.2. Samples: 34287724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:53,785][121949] Avg episode reward: [(0, '4204.249'), (1, '5209.203')] [2023-12-26 00:06:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000067168_17195008.pth... [2023-12-26 00:06:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000066848_17113088.pth... [2023-12-26 00:06:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000065888_16867328.pth [2023-12-26 00:06:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000066176_16941056.pth [2023-12-26 00:06:53,871][123090] Updated weights for policy 1, policy_version 66851 (0.0009) [2023-12-26 00:06:53,940][123090] Updated weights for policy 1, policy_version 66861 (0.0010) [2023-12-26 00:06:54,010][123090] Updated weights for policy 1, policy_version 66871 (0.0010) [2023-12-26 00:06:54,214][123091] Updated weights for policy 0, policy_version 67169 (0.0009) [2023-12-26 00:06:54,280][123091] Updated weights for policy 0, policy_version 67179 (0.0010) [2023-12-26 00:06:54,344][123091] Updated weights for policy 0, policy_version 67189 (0.0010) [2023-12-26 00:06:54,401][123091] Updated weights for policy 0, policy_version 67199 (0.0010) [2023-12-26 00:06:54,871][123090] Updated weights for policy 1, policy_version 66881 (0.0010) [2023-12-26 00:06:54,942][123090] Updated weights for policy 1, policy_version 66891 (0.0009) [2023-12-26 00:06:55,017][123090] Updated weights for policy 1, policy_version 66901 (0.0006) [2023-12-26 00:06:55,080][123090] Updated weights for policy 1, policy_version 66911 (0.0007) [2023-12-26 00:06:55,267][123091] Updated weights for policy 0, policy_version 67209 (0.0007) [2023-12-26 00:06:55,327][123091] Updated weights for policy 0, policy_version 67219 (0.0009) [2023-12-26 00:06:55,391][123091] Updated weights for policy 0, policy_version 67229 (0.0010) [2023-12-26 00:06:55,880][123090] Updated weights for policy 1, policy_version 66921 (0.0007) [2023-12-26 00:06:55,952][123090] Updated weights for policy 1, policy_version 66931 (0.0007) [2023-12-26 00:06:56,018][123090] Updated weights for policy 1, policy_version 66941 (0.0009) [2023-12-26 00:06:56,192][123091] Updated weights for policy 0, policy_version 67239 (0.0010) [2023-12-26 00:06:56,251][123091] Updated weights for policy 0, policy_version 67249 (0.0010) [2023-12-26 00:06:56,314][123091] Updated weights for policy 0, policy_version 67259 (0.0010) [2023-12-26 00:06:56,868][123090] Updated weights for policy 1, policy_version 66951 (0.0007) [2023-12-26 00:06:56,937][123090] Updated weights for policy 1, policy_version 66961 (0.0006) [2023-12-26 00:06:57,008][123090] Updated weights for policy 1, policy_version 66971 (0.0006) [2023-12-26 00:06:57,150][123091] Updated weights for policy 0, policy_version 67269 (0.0009) [2023-12-26 00:06:57,208][123091] Updated weights for policy 0, policy_version 67279 (0.0010) [2023-12-26 00:06:57,270][123091] Updated weights for policy 0, policy_version 67289 (0.0007) [2023-12-26 00:06:57,738][123090] Updated weights for policy 1, policy_version 66981 (0.0007) [2023-12-26 00:06:57,799][123090] Updated weights for policy 1, policy_version 66991 (0.0007) [2023-12-26 00:06:57,861][123090] Updated weights for policy 1, policy_version 67001 (0.0006) [2023-12-26 00:06:58,160][123091] Updated weights for policy 0, policy_version 67299 (0.0008) [2023-12-26 00:06:58,238][123091] Updated weights for policy 0, policy_version 67309 (0.0009) [2023-12-26 00:06:58,314][123091] Updated weights for policy 0, policy_version 67319 (0.0009) [2023-12-26 00:06:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16521.0, 300 sec: 16606.2). Total num frames: 34390016. Throughput: 0: 8387.7, 1: 8289.6. Samples: 34388600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:06:58,785][121949] Avg episode reward: [(0, '4270.224'), (1, '4952.532')] [2023-12-26 00:06:58,814][123090] Updated weights for policy 1, policy_version 67011 (0.0010) [2023-12-26 00:06:58,899][123090] Updated weights for policy 1, policy_version 67021 (0.0009) [2023-12-26 00:06:58,973][123090] Updated weights for policy 1, policy_version 67031 (0.0009) [2023-12-26 00:06:59,328][123091] Updated weights for policy 0, policy_version 67329 (0.0018) [2023-12-26 00:06:59,407][123091] Updated weights for policy 0, policy_version 67339 (0.0008) [2023-12-26 00:06:59,466][123091] Updated weights for policy 0, policy_version 67349 (0.0009) [2023-12-26 00:06:59,533][123091] Updated weights for policy 0, policy_version 67359 (0.0010) [2023-12-26 00:06:59,928][123090] Updated weights for policy 1, policy_version 67041 (0.0009) [2023-12-26 00:07:00,002][123090] Updated weights for policy 1, policy_version 67051 (0.0008) [2023-12-26 00:07:00,076][123090] Updated weights for policy 1, policy_version 67061 (0.0006) [2023-12-26 00:07:00,150][123090] Updated weights for policy 1, policy_version 67071 (0.0008) [2023-12-26 00:07:00,374][123091] Updated weights for policy 0, policy_version 67369 (0.0007) [2023-12-26 00:07:00,443][123091] Updated weights for policy 0, policy_version 67379 (0.0007) [2023-12-26 00:07:00,509][123091] Updated weights for policy 0, policy_version 67389 (0.0010) [2023-12-26 00:07:00,833][123090] Updated weights for policy 1, policy_version 67081 (0.0006) [2023-12-26 00:07:00,890][123090] Updated weights for policy 1, policy_version 67091 (0.0005) [2023-12-26 00:07:00,968][123090] Updated weights for policy 1, policy_version 67101 (0.0006) [2023-12-26 00:07:01,373][123091] Updated weights for policy 0, policy_version 67399 (0.0010) [2023-12-26 00:07:01,448][123091] Updated weights for policy 0, policy_version 67409 (0.0009) [2023-12-26 00:07:01,515][123091] Updated weights for policy 0, policy_version 67419 (0.0008) [2023-12-26 00:07:01,776][123090] Updated weights for policy 1, policy_version 67111 (0.0008) [2023-12-26 00:07:01,836][123090] Updated weights for policy 1, policy_version 67121 (0.0008) [2023-12-26 00:07:01,891][123090] Updated weights for policy 1, policy_version 67131 (0.0005) [2023-12-26 00:07:02,404][123091] Updated weights for policy 0, policy_version 67429 (0.0009) [2023-12-26 00:07:02,473][123091] Updated weights for policy 0, policy_version 67439 (0.0011) [2023-12-26 00:07:02,534][123091] Updated weights for policy 0, policy_version 67449 (0.0009) [2023-12-26 00:07:02,694][123090] Updated weights for policy 1, policy_version 67141 (0.0008) [2023-12-26 00:07:02,761][123090] Updated weights for policy 1, policy_version 67151 (0.0010) [2023-12-26 00:07:02,827][123090] Updated weights for policy 1, policy_version 67161 (0.0009) [2023-12-26 00:07:03,307][123091] Updated weights for policy 0, policy_version 67459 (0.0007) [2023-12-26 00:07:03,373][123091] Updated weights for policy 0, policy_version 67469 (0.0006) [2023-12-26 00:07:03,438][123091] Updated weights for policy 0, policy_version 67479 (0.0006) [2023-12-26 00:07:03,616][123090] Updated weights for policy 1, policy_version 67171 (0.0009) [2023-12-26 00:07:03,679][123090] Updated weights for policy 1, policy_version 67181 (0.0010) [2023-12-26 00:07:03,733][123090] Updated weights for policy 1, policy_version 67191 (0.0009) [2023-12-26 00:07:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 16657.1, 300 sec: 16633.9). Total num frames: 34480128. Throughput: 0: 8361.3, 1: 8227.2. Samples: 34487264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:07:03,785][121949] Avg episode reward: [(0, '4312.678'), (1, '4997.693')] [2023-12-26 00:07:04,162][123091] Updated weights for policy 0, policy_version 67489 (0.0007) [2023-12-26 00:07:04,236][123091] Updated weights for policy 0, policy_version 67499 (0.0007) [2023-12-26 00:07:04,308][123091] Updated weights for policy 0, policy_version 67509 (0.0006) [2023-12-26 00:07:04,373][123091] Updated weights for policy 0, policy_version 67519 (0.0007) [2023-12-26 00:07:04,671][123090] Updated weights for policy 1, policy_version 67202 (0.0010) [2023-12-26 00:07:04,743][123090] Updated weights for policy 1, policy_version 67212 (0.0010) [2023-12-26 00:07:04,805][123090] Updated weights for policy 1, policy_version 67222 (0.0010) [2023-12-26 00:07:04,869][123090] Updated weights for policy 1, policy_version 67232 (0.0009) [2023-12-26 00:07:05,089][123091] Updated weights for policy 0, policy_version 67529 (0.0005) [2023-12-26 00:07:05,141][123091] Updated weights for policy 0, policy_version 67539 (0.0006) [2023-12-26 00:07:05,206][123091] Updated weights for policy 0, policy_version 67549 (0.0011) [2023-12-26 00:07:05,788][123090] Updated weights for policy 1, policy_version 67242 (0.0010) [2023-12-26 00:07:05,851][123090] Updated weights for policy 1, policy_version 67252 (0.0009) [2023-12-26 00:07:05,876][123091] Updated weights for policy 0, policy_version 67559 (0.0008) [2023-12-26 00:07:05,916][123090] Updated weights for policy 1, policy_version 67262 (0.0009) [2023-12-26 00:07:05,936][123091] Updated weights for policy 0, policy_version 67569 (0.0009) [2023-12-26 00:07:05,992][123091] Updated weights for policy 0, policy_version 67579 (0.0009) [2023-12-26 00:07:06,836][123091] Updated weights for policy 0, policy_version 67589 (0.0009) [2023-12-26 00:07:06,847][123090] Updated weights for policy 1, policy_version 67272 (0.0007) [2023-12-26 00:07:06,902][123091] Updated weights for policy 0, policy_version 67599 (0.0008) [2023-12-26 00:07:06,910][123090] Updated weights for policy 1, policy_version 67282 (0.0009) [2023-12-26 00:07:06,961][123091] Updated weights for policy 0, policy_version 67609 (0.0008) [2023-12-26 00:07:06,967][123090] Updated weights for policy 1, policy_version 67292 (0.0007) [2023-12-26 00:07:07,729][123091] Updated weights for policy 0, policy_version 67619 (0.0008) [2023-12-26 00:07:07,801][123091] Updated weights for policy 0, policy_version 67629 (0.0010) [2023-12-26 00:07:07,829][123090] Updated weights for policy 1, policy_version 67302 (0.0009) [2023-12-26 00:07:07,869][123091] Updated weights for policy 0, policy_version 67639 (0.0008) [2023-12-26 00:07:07,897][123090] Updated weights for policy 1, policy_version 67312 (0.0009) [2023-12-26 00:07:07,967][123090] Updated weights for policy 1, policy_version 67322 (0.0008) [2023-12-26 00:07:08,732][123091] Updated weights for policy 0, policy_version 67649 (0.0009) [2023-12-26 00:07:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.6, 300 sec: 16606.2). Total num frames: 34553856. Throughput: 0: 8450.0, 1: 8206.0. Samples: 34538372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:07:08,785][121949] Avg episode reward: [(0, '4250.124'), (1, '5156.524')] [2023-12-26 00:07:08,789][123091] Updated weights for policy 0, policy_version 67659 (0.0010) [2023-12-26 00:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000067328_17235968.pth... [2023-12-26 00:07:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000066400_16998400.pth [2023-12-26 00:07:08,837][123090] Updated weights for policy 1, policy_version 67332 (0.0007) [2023-12-26 00:07:08,855][123091] Updated weights for policy 0, policy_version 67669 (0.0009) [2023-12-26 00:07:08,904][123090] Updated weights for policy 1, policy_version 67342 (0.0009) [2023-12-26 00:07:08,918][123091] Updated weights for policy 0, policy_version 67679 (0.0009) [2023-12-26 00:07:08,922][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000067680_17326080.pth... [2023-12-26 00:07:08,926][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000066688_17072128.pth [2023-12-26 00:07:08,974][123090] Updated weights for policy 1, policy_version 67352 (0.0007) [2023-12-26 00:07:09,792][123090] Updated weights for policy 1, policy_version 67362 (0.0010) [2023-12-26 00:07:09,854][123091] Updated weights for policy 0, policy_version 67689 (0.0009) [2023-12-26 00:07:09,868][123090] Updated weights for policy 1, policy_version 67372 (0.0008) [2023-12-26 00:07:09,933][123091] Updated weights for policy 0, policy_version 67699 (0.0010) [2023-12-26 00:07:09,951][123090] Updated weights for policy 1, policy_version 67382 (0.0008) [2023-12-26 00:07:10,003][123091] Updated weights for policy 0, policy_version 67709 (0.0008) [2023-12-26 00:07:10,026][123090] Updated weights for policy 1, policy_version 67392 (0.0009) [2023-12-26 00:07:10,840][123090] Updated weights for policy 1, policy_version 67402 (0.0011) [2023-12-26 00:07:10,891][123091] Updated weights for policy 0, policy_version 67719 (0.0007) [2023-12-26 00:07:10,906][123090] Updated weights for policy 1, policy_version 67412 (0.0011) [2023-12-26 00:07:10,959][123091] Updated weights for policy 0, policy_version 67729 (0.0007) [2023-12-26 00:07:10,973][123090] Updated weights for policy 1, policy_version 67422 (0.0009) [2023-12-26 00:07:11,025][123091] Updated weights for policy 0, policy_version 67739 (0.0009) [2023-12-26 00:07:11,863][123090] Updated weights for policy 1, policy_version 67432 (0.0010) [2023-12-26 00:07:11,930][123090] Updated weights for policy 1, policy_version 67442 (0.0011) [2023-12-26 00:07:11,938][123091] Updated weights for policy 0, policy_version 67749 (0.0009) [2023-12-26 00:07:12,001][123090] Updated weights for policy 1, policy_version 67452 (0.0011) [2023-12-26 00:07:12,008][123091] Updated weights for policy 0, policy_version 67759 (0.0007) [2023-12-26 00:07:12,072][123091] Updated weights for policy 0, policy_version 67769 (0.0008) [2023-12-26 00:07:12,869][123090] Updated weights for policy 1, policy_version 67462 (0.0008) [2023-12-26 00:07:12,937][123090] Updated weights for policy 1, policy_version 67472 (0.0009) [2023-12-26 00:07:12,977][123091] Updated weights for policy 0, policy_version 67779 (0.0009) [2023-12-26 00:07:13,005][123090] Updated weights for policy 1, policy_version 67482 (0.0010) [2023-12-26 00:07:13,043][123091] Updated weights for policy 0, policy_version 67789 (0.0006) [2023-12-26 00:07:13,102][123091] Updated weights for policy 0, policy_version 67799 (0.0008) [2023-12-26 00:07:13,784][121949] Fps is (10 sec: 15564.8, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 34635776. Throughput: 0: 8339.8, 1: 8203.7. Samples: 34634708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:07:13,785][121949] Avg episode reward: [(0, '4302.581'), (1, '5304.586')] [2023-12-26 00:07:13,836][123090] Updated weights for policy 1, policy_version 67492 (0.0011) [2023-12-26 00:07:13,895][123091] Updated weights for policy 0, policy_version 67809 (0.0009) [2023-12-26 00:07:13,900][123090] Updated weights for policy 1, policy_version 67502 (0.0009) [2023-12-26 00:07:13,952][123091] Updated weights for policy 0, policy_version 67819 (0.0010) [2023-12-26 00:07:13,965][123090] Updated weights for policy 1, policy_version 67512 (0.0008) [2023-12-26 00:07:14,006][123091] Updated weights for policy 0, policy_version 67829 (0.0011) [2023-12-26 00:07:14,071][123091] Updated weights for policy 0, policy_version 67839 (0.0011) [2023-12-26 00:07:14,812][123090] Updated weights for policy 1, policy_version 67522 (0.0006) [2023-12-26 00:07:14,880][123090] Updated weights for policy 1, policy_version 67532 (0.0008) [2023-12-26 00:07:14,900][123091] Updated weights for policy 0, policy_version 67849 (0.0011) [2023-12-26 00:07:14,945][123090] Updated weights for policy 1, policy_version 67542 (0.0008) [2023-12-26 00:07:14,967][123091] Updated weights for policy 0, policy_version 67859 (0.0011) [2023-12-26 00:07:15,013][123090] Updated weights for policy 1, policy_version 67552 (0.0009) [2023-12-26 00:07:15,033][123091] Updated weights for policy 0, policy_version 67869 (0.0011) [2023-12-26 00:07:15,831][123090] Updated weights for policy 1, policy_version 67562 (0.0011) [2023-12-26 00:07:15,884][123091] Updated weights for policy 0, policy_version 67879 (0.0011) [2023-12-26 00:07:15,900][123090] Updated weights for policy 1, policy_version 67572 (0.0011) [2023-12-26 00:07:15,945][123091] Updated weights for policy 0, policy_version 67889 (0.0011) [2023-12-26 00:07:15,954][123090] Updated weights for policy 1, policy_version 67582 (0.0011) [2023-12-26 00:07:15,998][123091] Updated weights for policy 0, policy_version 67899 (0.0011) [2023-12-26 00:07:16,787][123090] Updated weights for policy 1, policy_version 67592 (0.0009) [2023-12-26 00:07:16,842][123091] Updated weights for policy 0, policy_version 67909 (0.0011) [2023-12-26 00:07:16,858][123090] Updated weights for policy 1, policy_version 67602 (0.0007) [2023-12-26 00:07:16,903][123091] Updated weights for policy 0, policy_version 67919 (0.0011) [2023-12-26 00:07:16,917][123090] Updated weights for policy 1, policy_version 67612 (0.0007) [2023-12-26 00:07:16,957][123091] Updated weights for policy 0, policy_version 67929 (0.0007) [2023-12-26 00:07:17,750][123090] Updated weights for policy 1, policy_version 67622 (0.0008) [2023-12-26 00:07:17,804][123091] Updated weights for policy 0, policy_version 67939 (0.0010) [2023-12-26 00:07:17,815][123090] Updated weights for policy 1, policy_version 67632 (0.0008) [2023-12-26 00:07:17,861][123091] Updated weights for policy 0, policy_version 67949 (0.0011) [2023-12-26 00:07:17,877][123090] Updated weights for policy 1, policy_version 67642 (0.0006) [2023-12-26 00:07:17,918][123091] Updated weights for policy 0, policy_version 67959 (0.0011) [2023-12-26 00:07:18,736][123090] Updated weights for policy 1, policy_version 67652 (0.0008) [2023-12-26 00:07:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 34717696. Throughput: 0: 8327.3, 1: 8225.9. Samples: 34735620. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:18,785][121949] Avg episode reward: [(0, '4393.480'), (1, '5266.713')] [2023-12-26 00:07:18,792][123091] Updated weights for policy 0, policy_version 67969 (0.0010) [2023-12-26 00:07:18,801][123090] Updated weights for policy 1, policy_version 67662 (0.0007) [2023-12-26 00:07:18,861][123091] Updated weights for policy 0, policy_version 67979 (0.0010) [2023-12-26 00:07:18,871][123090] Updated weights for policy 1, policy_version 67672 (0.0007) [2023-12-26 00:07:18,923][123091] Updated weights for policy 0, policy_version 67989 (0.0009) [2023-12-26 00:07:18,985][123091] Updated weights for policy 0, policy_version 67999 (0.0009) [2023-12-26 00:07:19,718][123090] Updated weights for policy 1, policy_version 67682 (0.0007) [2023-12-26 00:07:19,799][123090] Updated weights for policy 1, policy_version 67692 (0.0010) [2023-12-26 00:07:19,882][123090] Updated weights for policy 1, policy_version 67702 (0.0009) [2023-12-26 00:07:19,883][123091] Updated weights for policy 0, policy_version 68009 (0.0009) [2023-12-26 00:07:19,958][123090] Updated weights for policy 1, policy_version 67712 (0.0008) [2023-12-26 00:07:19,962][123091] Updated weights for policy 0, policy_version 68019 (0.0008) [2023-12-26 00:07:20,035][123091] Updated weights for policy 0, policy_version 68029 (0.0008) [2023-12-26 00:07:20,818][123090] Updated weights for policy 1, policy_version 67722 (0.0011) [2023-12-26 00:07:20,839][123091] Updated weights for policy 0, policy_version 68039 (0.0007) [2023-12-26 00:07:20,884][123090] Updated weights for policy 1, policy_version 67732 (0.0011) [2023-12-26 00:07:20,909][123091] Updated weights for policy 0, policy_version 68049 (0.0007) [2023-12-26 00:07:20,947][123090] Updated weights for policy 1, policy_version 67742 (0.0011) [2023-12-26 00:07:20,973][123091] Updated weights for policy 0, policy_version 68059 (0.0007) [2023-12-26 00:07:21,877][123090] Updated weights for policy 1, policy_version 67752 (0.0009) [2023-12-26 00:07:21,879][123091] Updated weights for policy 0, policy_version 68069 (0.0009) [2023-12-26 00:07:21,926][123091] Updated weights for policy 0, policy_version 68079 (0.0007) [2023-12-26 00:07:21,942][123090] Updated weights for policy 1, policy_version 67762 (0.0008) [2023-12-26 00:07:21,995][123091] Updated weights for policy 0, policy_version 68089 (0.0009) [2023-12-26 00:07:22,011][123090] Updated weights for policy 1, policy_version 67772 (0.0010) [2023-12-26 00:07:22,860][123091] Updated weights for policy 0, policy_version 68099 (0.0009) [2023-12-26 00:07:22,896][123090] Updated weights for policy 1, policy_version 67782 (0.0009) [2023-12-26 00:07:22,928][123091] Updated weights for policy 0, policy_version 68109 (0.0007) [2023-12-26 00:07:22,961][123090] Updated weights for policy 1, policy_version 67792 (0.0009) [2023-12-26 00:07:23,000][123091] Updated weights for policy 0, policy_version 68119 (0.0008) [2023-12-26 00:07:23,027][123090] Updated weights for policy 1, policy_version 67802 (0.0009) [2023-12-26 00:07:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.6, 300 sec: 16606.2). Total num frames: 34799616. Throughput: 0: 8309.4, 1: 8210.6. Samples: 34783680. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:23,785][121949] Avg episode reward: [(0, '4333.928'), (1, '5314.790')] [2023-12-26 00:07:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000068128_17440768.pth... [2023-12-26 00:07:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000067168_17195008.pth [2023-12-26 00:07:23,813][123091] Updated weights for policy 0, policy_version 68129 (0.0007) [2023-12-26 00:07:23,828][123090] Updated weights for policy 1, policy_version 67812 (0.0009) [2023-12-26 00:07:23,867][123091] Updated weights for policy 0, policy_version 68139 (0.0007) [2023-12-26 00:07:23,891][123090] Updated weights for policy 1, policy_version 67822 (0.0009) [2023-12-26 00:07:23,924][123091] Updated weights for policy 0, policy_version 68149 (0.0008) [2023-12-26 00:07:23,958][123090] Updated weights for policy 1, policy_version 67832 (0.0009) [2023-12-26 00:07:23,982][123091] Updated weights for policy 0, policy_version 68159 (0.0008) [2023-12-26 00:07:24,010][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000067840_17367040.pth... [2023-12-26 00:07:24,015][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000066848_17113088.pth [2023-12-26 00:07:24,839][123090] Updated weights for policy 1, policy_version 67842 (0.0008) [2023-12-26 00:07:24,879][123091] Updated weights for policy 0, policy_version 68169 (0.0009) [2023-12-26 00:07:24,898][123090] Updated weights for policy 1, policy_version 67852 (0.0009) [2023-12-26 00:07:24,935][123091] Updated weights for policy 0, policy_version 68179 (0.0008) [2023-12-26 00:07:24,958][123090] Updated weights for policy 1, policy_version 67862 (0.0009) [2023-12-26 00:07:24,995][123091] Updated weights for policy 0, policy_version 68189 (0.0006) [2023-12-26 00:07:25,022][123090] Updated weights for policy 1, policy_version 67872 (0.0009) [2023-12-26 00:07:25,876][123091] Updated weights for policy 0, policy_version 68199 (0.0009) [2023-12-26 00:07:25,909][123090] Updated weights for policy 1, policy_version 67882 (0.0008) [2023-12-26 00:07:25,942][123091] Updated weights for policy 0, policy_version 68209 (0.0009) [2023-12-26 00:07:25,975][123090] Updated weights for policy 1, policy_version 67892 (0.0007) [2023-12-26 00:07:26,015][123091] Updated weights for policy 0, policy_version 68219 (0.0009) [2023-12-26 00:07:26,043][123090] Updated weights for policy 1, policy_version 67902 (0.0008) [2023-12-26 00:07:26,771][123090] Updated weights for policy 1, policy_version 67912 (0.0010) [2023-12-26 00:07:26,831][123090] Updated weights for policy 1, policy_version 67922 (0.0010) [2023-12-26 00:07:26,887][123091] Updated weights for policy 0, policy_version 68229 (0.0008) [2023-12-26 00:07:26,900][123090] Updated weights for policy 1, policy_version 67932 (0.0011) [2023-12-26 00:07:26,953][123091] Updated weights for policy 0, policy_version 68239 (0.0009) [2023-12-26 00:07:27,014][123091] Updated weights for policy 0, policy_version 68249 (0.0010) [2023-12-26 00:07:27,674][123090] Updated weights for policy 1, policy_version 67942 (0.0010) [2023-12-26 00:07:27,735][123090] Updated weights for policy 1, policy_version 67952 (0.0009) [2023-12-26 00:07:27,797][123090] Updated weights for policy 1, policy_version 67962 (0.0009) [2023-12-26 00:07:27,895][123091] Updated weights for policy 0, policy_version 68259 (0.0010) [2023-12-26 00:07:27,963][123091] Updated weights for policy 0, policy_version 68269 (0.0010) [2023-12-26 00:07:28,036][123091] Updated weights for policy 0, policy_version 68279 (0.0010) [2023-12-26 00:07:28,642][123090] Updated weights for policy 1, policy_version 67972 (0.0009) [2023-12-26 00:07:28,704][123090] Updated weights for policy 1, policy_version 67982 (0.0010) [2023-12-26 00:07:28,771][123090] Updated weights for policy 1, policy_version 67992 (0.0009) [2023-12-26 00:07:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 34881536. Throughput: 0: 8327.5, 1: 8217.8. Samples: 34882476. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:28,785][121949] Avg episode reward: [(0, '4249.511'), (1, '5405.614')] [2023-12-26 00:07:28,825][123008] Saving new best policy, reward=5405.614! [2023-12-26 00:07:28,890][123091] Updated weights for policy 0, policy_version 68289 (0.0009) [2023-12-26 00:07:28,961][123091] Updated weights for policy 0, policy_version 68299 (0.0011) [2023-12-26 00:07:29,034][123091] Updated weights for policy 0, policy_version 68309 (0.0010) [2023-12-26 00:07:29,100][123091] Updated weights for policy 0, policy_version 68319 (0.0009) [2023-12-26 00:07:29,675][123090] Updated weights for policy 1, policy_version 68002 (0.0009) [2023-12-26 00:07:29,732][123090] Updated weights for policy 1, policy_version 68012 (0.0009) [2023-12-26 00:07:29,797][123090] Updated weights for policy 1, policy_version 68022 (0.0008) [2023-12-26 00:07:29,870][123090] Updated weights for policy 1, policy_version 68032 (0.0009) [2023-12-26 00:07:29,962][123091] Updated weights for policy 0, policy_version 68329 (0.0009) [2023-12-26 00:07:30,027][123091] Updated weights for policy 0, policy_version 68339 (0.0008) [2023-12-26 00:07:30,088][123091] Updated weights for policy 0, policy_version 68349 (0.0008) [2023-12-26 00:07:30,752][123090] Updated weights for policy 1, policy_version 68042 (0.0009) [2023-12-26 00:07:30,814][123090] Updated weights for policy 1, policy_version 68052 (0.0009) [2023-12-26 00:07:30,881][123090] Updated weights for policy 1, policy_version 68062 (0.0010) [2023-12-26 00:07:30,915][123091] Updated weights for policy 0, policy_version 68359 (0.0008) [2023-12-26 00:07:30,970][123091] Updated weights for policy 0, policy_version 68369 (0.0010) [2023-12-26 00:07:31,033][123091] Updated weights for policy 0, policy_version 68379 (0.0010) [2023-12-26 00:07:31,732][123090] Updated weights for policy 1, policy_version 68072 (0.0008) [2023-12-26 00:07:31,804][123090] Updated weights for policy 1, policy_version 68082 (0.0008) [2023-12-26 00:07:31,871][123090] Updated weights for policy 1, policy_version 68092 (0.0008) [2023-12-26 00:07:31,933][123091] Updated weights for policy 0, policy_version 68389 (0.0009) [2023-12-26 00:07:32,005][123091] Updated weights for policy 0, policy_version 68399 (0.0010) [2023-12-26 00:07:32,061][123091] Updated weights for policy 0, policy_version 68409 (0.0009) [2023-12-26 00:07:32,640][123090] Updated weights for policy 1, policy_version 68102 (0.0010) [2023-12-26 00:07:32,704][123090] Updated weights for policy 1, policy_version 68112 (0.0010) [2023-12-26 00:07:32,772][123090] Updated weights for policy 1, policy_version 68122 (0.0010) [2023-12-26 00:07:32,917][123091] Updated weights for policy 0, policy_version 68419 (0.0009) [2023-12-26 00:07:32,975][123091] Updated weights for policy 0, policy_version 68429 (0.0009) [2023-12-26 00:07:33,038][123091] Updated weights for policy 0, policy_version 68439 (0.0009) [2023-12-26 00:07:33,593][123090] Updated weights for policy 1, policy_version 68132 (0.0010) [2023-12-26 00:07:33,654][123090] Updated weights for policy 1, policy_version 68142 (0.0009) [2023-12-26 00:07:33,721][123090] Updated weights for policy 1, policy_version 68152 (0.0010) [2023-12-26 00:07:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16520.5, 300 sec: 16633.9). Total num frames: 34971648. Throughput: 0: 8261.7, 1: 8241.1. Samples: 34982032. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:33,785][121949] Avg episode reward: [(0, '4195.314'), (1, '5350.178')] [2023-12-26 00:07:33,803][123091] Updated weights for policy 0, policy_version 68449 (0.0010) [2023-12-26 00:07:33,858][123091] Updated weights for policy 0, policy_version 68459 (0.0010) [2023-12-26 00:07:33,913][123091] Updated weights for policy 0, policy_version 68469 (0.0010) [2023-12-26 00:07:33,958][123091] Updated weights for policy 0, policy_version 68479 (0.0006) [2023-12-26 00:07:34,560][123090] Updated weights for policy 1, policy_version 68162 (0.0010) [2023-12-26 00:07:34,621][123090] Updated weights for policy 1, policy_version 68172 (0.0010) [2023-12-26 00:07:34,692][123090] Updated weights for policy 1, policy_version 68182 (0.0011) [2023-12-26 00:07:34,756][123091] Updated weights for policy 0, policy_version 68489 (0.0010) [2023-12-26 00:07:34,761][123090] Updated weights for policy 1, policy_version 68192 (0.0011) [2023-12-26 00:07:34,821][123091] Updated weights for policy 0, policy_version 68499 (0.0011) [2023-12-26 00:07:34,878][123091] Updated weights for policy 0, policy_version 68509 (0.0009) [2023-12-26 00:07:35,607][123090] Updated weights for policy 1, policy_version 68202 (0.0006) [2023-12-26 00:07:35,671][123090] Updated weights for policy 1, policy_version 68212 (0.0007) [2023-12-26 00:07:35,708][123091] Updated weights for policy 0, policy_version 68519 (0.0006) [2023-12-26 00:07:35,734][123090] Updated weights for policy 1, policy_version 68222 (0.0010) [2023-12-26 00:07:35,770][123091] Updated weights for policy 0, policy_version 68529 (0.0009) [2023-12-26 00:07:35,825][123091] Updated weights for policy 0, policy_version 68539 (0.0009) [2023-12-26 00:07:36,590][123090] Updated weights for policy 1, policy_version 68232 (0.0011) [2023-12-26 00:07:36,664][123090] Updated weights for policy 1, policy_version 68242 (0.0011) [2023-12-26 00:07:36,715][123091] Updated weights for policy 0, policy_version 68549 (0.0007) [2023-12-26 00:07:36,733][123090] Updated weights for policy 1, policy_version 68252 (0.0011) [2023-12-26 00:07:36,779][123091] Updated weights for policy 0, policy_version 68559 (0.0008) [2023-12-26 00:07:36,844][123091] Updated weights for policy 0, policy_version 68569 (0.0009) [2023-12-26 00:07:37,506][123090] Updated weights for policy 1, policy_version 68262 (0.0007) [2023-12-26 00:07:37,578][123090] Updated weights for policy 1, policy_version 68272 (0.0005) [2023-12-26 00:07:37,640][123090] Updated weights for policy 1, policy_version 68282 (0.0007) [2023-12-26 00:07:37,747][123091] Updated weights for policy 0, policy_version 68579 (0.0009) [2023-12-26 00:07:37,820][123091] Updated weights for policy 0, policy_version 68589 (0.0010) [2023-12-26 00:07:37,873][123091] Updated weights for policy 0, policy_version 68599 (0.0010) [2023-12-26 00:07:38,376][123090] Updated weights for policy 1, policy_version 68292 (0.0008) [2023-12-26 00:07:38,445][123090] Updated weights for policy 1, policy_version 68302 (0.0009) [2023-12-26 00:07:38,514][123090] Updated weights for policy 1, policy_version 68312 (0.0009) [2023-12-26 00:07:38,748][123091] Updated weights for policy 0, policy_version 68609 (0.0010) [2023-12-26 00:07:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 16520.5, 300 sec: 16633.9). Total num frames: 35053568. Throughput: 0: 8295.3, 1: 8259.9. Samples: 35032704. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:38,785][121949] Avg episode reward: [(0, '4252.654'), (1, '5315.397')] [2023-12-26 00:07:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000068320_17489920.pth... [2023-12-26 00:07:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000067328_17235968.pth [2023-12-26 00:07:38,824][123091] Updated weights for policy 0, policy_version 68619 (0.0010) [2023-12-26 00:07:38,893][123091] Updated weights for policy 0, policy_version 68629 (0.0009) [2023-12-26 00:07:38,962][123091] Updated weights for policy 0, policy_version 68639 (0.0010) [2023-12-26 00:07:38,967][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000068640_17571840.pth... [2023-12-26 00:07:38,972][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000067680_17326080.pth [2023-12-26 00:07:39,260][123090] Updated weights for policy 1, policy_version 68322 (0.0010) [2023-12-26 00:07:39,337][123090] Updated weights for policy 1, policy_version 68332 (0.0009) [2023-12-26 00:07:39,413][123090] Updated weights for policy 1, policy_version 68342 (0.0009) [2023-12-26 00:07:39,480][123090] Updated weights for policy 1, policy_version 68352 (0.0010) [2023-12-26 00:07:39,856][123091] Updated weights for policy 0, policy_version 68649 (0.0009) [2023-12-26 00:07:39,926][123091] Updated weights for policy 0, policy_version 68659 (0.0009) [2023-12-26 00:07:39,998][123091] Updated weights for policy 0, policy_version 68669 (0.0009) [2023-12-26 00:07:40,384][123090] Updated weights for policy 1, policy_version 68362 (0.0006) [2023-12-26 00:07:40,459][123090] Updated weights for policy 1, policy_version 68372 (0.0009) [2023-12-26 00:07:40,522][123090] Updated weights for policy 1, policy_version 68382 (0.0010) [2023-12-26 00:07:40,791][123091] Updated weights for policy 0, policy_version 68679 (0.0007) [2023-12-26 00:07:40,861][123091] Updated weights for policy 0, policy_version 68689 (0.0010) [2023-12-26 00:07:40,935][123091] Updated weights for policy 0, policy_version 68699 (0.0011) [2023-12-26 00:07:41,356][123090] Updated weights for policy 1, policy_version 68392 (0.0010) [2023-12-26 00:07:41,437][123090] Updated weights for policy 1, policy_version 68402 (0.0010) [2023-12-26 00:07:41,502][123090] Updated weights for policy 1, policy_version 68412 (0.0008) [2023-12-26 00:07:41,812][123091] Updated weights for policy 0, policy_version 68709 (0.0010) [2023-12-26 00:07:41,882][123091] Updated weights for policy 0, policy_version 68719 (0.0007) [2023-12-26 00:07:41,953][123091] Updated weights for policy 0, policy_version 68729 (0.0006) [2023-12-26 00:07:42,376][123090] Updated weights for policy 1, policy_version 68422 (0.0009) [2023-12-26 00:07:42,448][123090] Updated weights for policy 1, policy_version 68432 (0.0010) [2023-12-26 00:07:42,511][123090] Updated weights for policy 1, policy_version 68442 (0.0009) [2023-12-26 00:07:42,748][123091] Updated weights for policy 0, policy_version 68739 (0.0008) [2023-12-26 00:07:42,818][123091] Updated weights for policy 0, policy_version 68749 (0.0010) [2023-12-26 00:07:42,891][123091] Updated weights for policy 0, policy_version 68759 (0.0011) [2023-12-26 00:07:43,359][123090] Updated weights for policy 1, policy_version 68452 (0.0008) [2023-12-26 00:07:43,424][123090] Updated weights for policy 1, policy_version 68462 (0.0006) [2023-12-26 00:07:43,480][123090] Updated weights for policy 1, policy_version 68472 (0.0007) [2023-12-26 00:07:43,780][123091] Updated weights for policy 0, policy_version 68769 (0.0010) [2023-12-26 00:07:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16520.6, 300 sec: 16633.9). Total num frames: 35135488. Throughput: 0: 8249.1, 1: 8258.4. Samples: 35131436. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:43,785][121949] Avg episode reward: [(0, '4269.638'), (1, '5367.750')] [2023-12-26 00:07:43,841][123091] Updated weights for policy 0, policy_version 68779 (0.0010) [2023-12-26 00:07:43,909][123091] Updated weights for policy 0, policy_version 68789 (0.0009) [2023-12-26 00:07:43,978][123091] Updated weights for policy 0, policy_version 68799 (0.0009) [2023-12-26 00:07:44,319][123090] Updated weights for policy 1, policy_version 68482 (0.0009) [2023-12-26 00:07:44,375][123090] Updated weights for policy 1, policy_version 68492 (0.0010) [2023-12-26 00:07:44,430][123090] Updated weights for policy 1, policy_version 68502 (0.0010) [2023-12-26 00:07:44,809][123091] Updated weights for policy 0, policy_version 68809 (0.0010) [2023-12-26 00:07:44,880][123091] Updated weights for policy 0, policy_version 68819 (0.0010) [2023-12-26 00:07:44,947][123091] Updated weights for policy 0, policy_version 68829 (0.0010) [2023-12-26 00:07:45,343][123090] Updated weights for policy 1, policy_version 68513 (0.0010) [2023-12-26 00:07:45,406][123090] Updated weights for policy 1, policy_version 68523 (0.0010) [2023-12-26 00:07:45,477][123090] Updated weights for policy 1, policy_version 68533 (0.0010) [2023-12-26 00:07:45,542][123090] Updated weights for policy 1, policy_version 68543 (0.0010) [2023-12-26 00:07:45,819][123091] Updated weights for policy 0, policy_version 68839 (0.0009) [2023-12-26 00:07:45,891][123091] Updated weights for policy 0, policy_version 68849 (0.0010) [2023-12-26 00:07:45,959][123091] Updated weights for policy 0, policy_version 68859 (0.0008) [2023-12-26 00:07:46,348][123090] Updated weights for policy 1, policy_version 68553 (0.0010) [2023-12-26 00:07:46,402][123090] Updated weights for policy 1, policy_version 68563 (0.0009) [2023-12-26 00:07:46,464][123090] Updated weights for policy 1, policy_version 68573 (0.0009) [2023-12-26 00:07:46,796][123091] Updated weights for policy 0, policy_version 68869 (0.0008) [2023-12-26 00:07:46,859][123091] Updated weights for policy 0, policy_version 68879 (0.0010) [2023-12-26 00:07:46,917][123091] Updated weights for policy 0, policy_version 68889 (0.0010) [2023-12-26 00:07:47,303][123090] Updated weights for policy 1, policy_version 68583 (0.0010) [2023-12-26 00:07:47,357][123090] Updated weights for policy 1, policy_version 68593 (0.0009) [2023-12-26 00:07:47,412][123090] Updated weights for policy 1, policy_version 68603 (0.0009) [2023-12-26 00:07:47,789][123091] Updated weights for policy 0, policy_version 68899 (0.0010) [2023-12-26 00:07:47,859][123091] Updated weights for policy 0, policy_version 68909 (0.0010) [2023-12-26 00:07:47,924][123091] Updated weights for policy 0, policy_version 68919 (0.0010) [2023-12-26 00:07:48,246][123090] Updated weights for policy 1, policy_version 68613 (0.0010) [2023-12-26 00:07:48,306][123090] Updated weights for policy 1, policy_version 68623 (0.0010) [2023-12-26 00:07:48,372][123090] Updated weights for policy 1, policy_version 68633 (0.0010) [2023-12-26 00:07:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16520.6, 300 sec: 16633.9). Total num frames: 35217408. Throughput: 0: 8263.0, 1: 8257.4. Samples: 35230684. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:48,785][121949] Avg episode reward: [(0, '4264.705'), (1, '5451.754')] [2023-12-26 00:07:48,786][123008] Saving new best policy, reward=5451.754! [2023-12-26 00:07:48,816][123091] Updated weights for policy 0, policy_version 68929 (0.0007) [2023-12-26 00:07:48,882][123091] Updated weights for policy 0, policy_version 68939 (0.0010) [2023-12-26 00:07:48,946][123091] Updated weights for policy 0, policy_version 68949 (0.0010) [2023-12-26 00:07:49,011][123091] Updated weights for policy 0, policy_version 68959 (0.0010) [2023-12-26 00:07:49,252][123090] Updated weights for policy 1, policy_version 68643 (0.0009) [2023-12-26 00:07:49,320][123090] Updated weights for policy 1, policy_version 68653 (0.0010) [2023-12-26 00:07:49,391][123090] Updated weights for policy 1, policy_version 68663 (0.0009) [2023-12-26 00:07:49,900][123091] Updated weights for policy 0, policy_version 68969 (0.0010) [2023-12-26 00:07:49,978][123091] Updated weights for policy 0, policy_version 68979 (0.0008) [2023-12-26 00:07:50,045][123091] Updated weights for policy 0, policy_version 68989 (0.0006) [2023-12-26 00:07:50,289][123090] Updated weights for policy 1, policy_version 68673 (0.0010) [2023-12-26 00:07:50,358][123090] Updated weights for policy 1, policy_version 68683 (0.0007) [2023-12-26 00:07:50,429][123090] Updated weights for policy 1, policy_version 68693 (0.0010) [2023-12-26 00:07:50,501][123090] Updated weights for policy 1, policy_version 68703 (0.0009) [2023-12-26 00:07:50,839][123091] Updated weights for policy 0, policy_version 68999 (0.0008) [2023-12-26 00:07:50,908][123091] Updated weights for policy 0, policy_version 69009 (0.0010) [2023-12-26 00:07:51,006][123091] Updated weights for policy 0, policy_version 69019 (0.0010) [2023-12-26 00:07:51,380][123090] Updated weights for policy 1, policy_version 68713 (0.0008) [2023-12-26 00:07:51,444][123090] Updated weights for policy 1, policy_version 68723 (0.0009) [2023-12-26 00:07:51,510][123090] Updated weights for policy 1, policy_version 68733 (0.0010) [2023-12-26 00:07:51,930][123091] Updated weights for policy 0, policy_version 69029 (0.0011) [2023-12-26 00:07:51,999][123091] Updated weights for policy 0, policy_version 69039 (0.0010) [2023-12-26 00:07:52,063][123091] Updated weights for policy 0, policy_version 69049 (0.0009) [2023-12-26 00:07:52,321][123090] Updated weights for policy 1, policy_version 68743 (0.0010) [2023-12-26 00:07:52,403][123090] Updated weights for policy 1, policy_version 68753 (0.0010) [2023-12-26 00:07:52,471][123090] Updated weights for policy 1, policy_version 68763 (0.0010) [2023-12-26 00:07:52,933][123091] Updated weights for policy 0, policy_version 69059 (0.0010) [2023-12-26 00:07:52,990][123091] Updated weights for policy 0, policy_version 69069 (0.0010) [2023-12-26 00:07:53,042][123091] Updated weights for policy 0, policy_version 69079 (0.0010) [2023-12-26 00:07:53,304][123090] Updated weights for policy 1, policy_version 68773 (0.0009) [2023-12-26 00:07:53,369][123090] Updated weights for policy 1, policy_version 68783 (0.0010) [2023-12-26 00:07:53,434][123090] Updated weights for policy 1, policy_version 68793 (0.0011) [2023-12-26 00:07:53,784][121949] Fps is (10 sec: 16383.7, 60 sec: 16520.5, 300 sec: 16633.9). Total num frames: 35299328. Throughput: 0: 8174.8, 1: 8284.2. Samples: 35279032. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:53,785][121949] Avg episode reward: [(0, '4224.530'), (1, '5443.004')] [2023-12-26 00:07:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000069088_17686528.pth... [2023-12-26 00:07:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000068800_17612800.pth... [2023-12-26 00:07:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000068128_17440768.pth [2023-12-26 00:07:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000067840_17367040.pth [2023-12-26 00:07:53,925][123091] Updated weights for policy 0, policy_version 69089 (0.0009) [2023-12-26 00:07:53,991][123091] Updated weights for policy 0, policy_version 69099 (0.0010) [2023-12-26 00:07:54,053][123091] Updated weights for policy 0, policy_version 69109 (0.0010) [2023-12-26 00:07:54,116][123091] Updated weights for policy 0, policy_version 69119 (0.0010) [2023-12-26 00:07:54,285][123090] Updated weights for policy 1, policy_version 68803 (0.0010) [2023-12-26 00:07:54,350][123090] Updated weights for policy 1, policy_version 68813 (0.0009) [2023-12-26 00:07:54,417][123090] Updated weights for policy 1, policy_version 68823 (0.0006) [2023-12-26 00:07:54,967][123091] Updated weights for policy 0, policy_version 69129 (0.0010) [2023-12-26 00:07:55,031][123091] Updated weights for policy 0, policy_version 69139 (0.0009) [2023-12-26 00:07:55,096][123091] Updated weights for policy 0, policy_version 69149 (0.0009) [2023-12-26 00:07:55,252][123090] Updated weights for policy 1, policy_version 68833 (0.0008) [2023-12-26 00:07:55,307][123090] Updated weights for policy 1, policy_version 68843 (0.0010) [2023-12-26 00:07:55,361][123090] Updated weights for policy 1, policy_version 68853 (0.0009) [2023-12-26 00:07:55,415][123090] Updated weights for policy 1, policy_version 68863 (0.0010) [2023-12-26 00:07:55,876][123091] Updated weights for policy 0, policy_version 69159 (0.0009) [2023-12-26 00:07:55,946][123091] Updated weights for policy 0, policy_version 69169 (0.0007) [2023-12-26 00:07:56,014][123091] Updated weights for policy 0, policy_version 69179 (0.0008) [2023-12-26 00:07:56,359][123090] Updated weights for policy 1, policy_version 68873 (0.0009) [2023-12-26 00:07:56,421][123090] Updated weights for policy 1, policy_version 68883 (0.0009) [2023-12-26 00:07:56,489][123090] Updated weights for policy 1, policy_version 68893 (0.0010) [2023-12-26 00:07:56,815][123091] Updated weights for policy 0, policy_version 69189 (0.0008) [2023-12-26 00:07:56,875][123091] Updated weights for policy 0, policy_version 69199 (0.0010) [2023-12-26 00:07:56,934][123091] Updated weights for policy 0, policy_version 69209 (0.0010) [2023-12-26 00:07:57,320][123090] Updated weights for policy 1, policy_version 68903 (0.0009) [2023-12-26 00:07:57,380][123090] Updated weights for policy 1, policy_version 68913 (0.0009) [2023-12-26 00:07:57,440][123090] Updated weights for policy 1, policy_version 68923 (0.0010) [2023-12-26 00:07:57,821][123091] Updated weights for policy 0, policy_version 69219 (0.0010) [2023-12-26 00:07:57,887][123091] Updated weights for policy 0, policy_version 69229 (0.0009) [2023-12-26 00:07:57,953][123091] Updated weights for policy 0, policy_version 69239 (0.0007) [2023-12-26 00:07:58,364][123090] Updated weights for policy 1, policy_version 68933 (0.0010) [2023-12-26 00:07:58,430][123090] Updated weights for policy 1, policy_version 68943 (0.0009) [2023-12-26 00:07:58,507][123090] Updated weights for policy 1, policy_version 68953 (0.0008) [2023-12-26 00:07:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 16633.9). Total num frames: 35381248. Throughput: 0: 8222.4, 1: 8294.2. Samples: 35377956. Policy #0 lag: (min: 10.0, avg: 35.9, max: 42.0) [2023-12-26 00:07:58,785][121949] Avg episode reward: [(0, '4228.776'), (1, '5431.280')] [2023-12-26 00:07:58,843][123091] Updated weights for policy 0, policy_version 69249 (0.0008) [2023-12-26 00:07:58,913][123091] Updated weights for policy 0, policy_version 69259 (0.0011) [2023-12-26 00:07:58,983][123091] Updated weights for policy 0, policy_version 69269 (0.0009) [2023-12-26 00:07:59,050][123091] Updated weights for policy 0, policy_version 69279 (0.0008) [2023-12-26 00:07:59,385][123090] Updated weights for policy 1, policy_version 68963 (0.0008) [2023-12-26 00:07:59,454][123090] Updated weights for policy 1, policy_version 68973 (0.0011) [2023-12-26 00:07:59,519][123090] Updated weights for policy 1, policy_version 68983 (0.0010) [2023-12-26 00:07:59,914][123091] Updated weights for policy 0, policy_version 69289 (0.0008) [2023-12-26 00:07:59,980][123091] Updated weights for policy 0, policy_version 69299 (0.0008) [2023-12-26 00:08:00,048][123091] Updated weights for policy 0, policy_version 69309 (0.0006) [2023-12-26 00:08:00,469][123090] Updated weights for policy 1, policy_version 68993 (0.0009) [2023-12-26 00:08:00,537][123090] Updated weights for policy 1, policy_version 69003 (0.0009) [2023-12-26 00:08:00,602][123090] Updated weights for policy 1, policy_version 69013 (0.0009) [2023-12-26 00:08:00,666][123090] Updated weights for policy 1, policy_version 69023 (0.0009) [2023-12-26 00:08:00,851][123091] Updated weights for policy 0, policy_version 69319 (0.0009) [2023-12-26 00:08:00,910][123091] Updated weights for policy 0, policy_version 69329 (0.0008) [2023-12-26 00:08:00,995][123091] Updated weights for policy 0, policy_version 69339 (0.0008) [2023-12-26 00:08:01,578][123090] Updated weights for policy 1, policy_version 69033 (0.0009) [2023-12-26 00:08:01,649][123090] Updated weights for policy 1, policy_version 69043 (0.0010) [2023-12-26 00:08:01,715][123090] Updated weights for policy 1, policy_version 69053 (0.0009) [2023-12-26 00:08:01,883][123091] Updated weights for policy 0, policy_version 69349 (0.0008) [2023-12-26 00:08:01,954][123091] Updated weights for policy 0, policy_version 69360 (0.0010) [2023-12-26 00:08:02,019][123091] Updated weights for policy 0, policy_version 69370 (0.0010) [2023-12-26 00:08:02,489][123090] Updated weights for policy 1, policy_version 69063 (0.0009) [2023-12-26 00:08:02,552][123090] Updated weights for policy 1, policy_version 69073 (0.0009) [2023-12-26 00:08:02,615][123090] Updated weights for policy 1, policy_version 69083 (0.0009) [2023-12-26 00:08:02,847][123091] Updated weights for policy 0, policy_version 69380 (0.0009) [2023-12-26 00:08:02,911][123091] Updated weights for policy 0, policy_version 69390 (0.0009) [2023-12-26 00:08:02,983][123091] Updated weights for policy 0, policy_version 69400 (0.0007) [2023-12-26 00:08:03,469][123090] Updated weights for policy 1, policy_version 69093 (0.0009) [2023-12-26 00:08:03,523][123090] Updated weights for policy 1, policy_version 69103 (0.0010) [2023-12-26 00:08:03,577][123090] Updated weights for policy 1, policy_version 69113 (0.0010) [2023-12-26 00:08:03,670][123091] Updated weights for policy 0, policy_version 69410 (0.0009) [2023-12-26 00:08:03,725][123091] Updated weights for policy 0, policy_version 69420 (0.0005) [2023-12-26 00:08:03,784][121949] Fps is (10 sec: 16384.2, 60 sec: 16384.0, 300 sec: 16606.2). Total num frames: 35463168. Throughput: 0: 8212.4, 1: 8237.8. Samples: 35475876. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:03,785][121949] Avg episode reward: [(0, '4368.725'), (1, '5396.097')] [2023-12-26 00:08:03,786][123091] Updated weights for policy 0, policy_version 69430 (0.0005) [2023-12-26 00:08:03,848][123091] Updated weights for policy 0, policy_version 69440 (0.0009) [2023-12-26 00:08:04,480][123090] Updated weights for policy 1, policy_version 69123 (0.0009) [2023-12-26 00:08:04,553][123090] Updated weights for policy 1, policy_version 69133 (0.0009) [2023-12-26 00:08:04,625][123090] Updated weights for policy 1, policy_version 69143 (0.0008) [2023-12-26 00:08:04,695][123091] Updated weights for policy 0, policy_version 69450 (0.0008) [2023-12-26 00:08:04,757][123091] Updated weights for policy 0, policy_version 69460 (0.0008) [2023-12-26 00:08:04,819][123091] Updated weights for policy 0, policy_version 69470 (0.0007) [2023-12-26 00:08:05,500][123090] Updated weights for policy 1, policy_version 69153 (0.0009) [2023-12-26 00:08:05,518][123091] Updated weights for policy 0, policy_version 69480 (0.0009) [2023-12-26 00:08:05,567][123090] Updated weights for policy 1, policy_version 69163 (0.0007) [2023-12-26 00:08:05,578][123091] Updated weights for policy 0, policy_version 69490 (0.0011) [2023-12-26 00:08:05,628][123090] Updated weights for policy 1, policy_version 69173 (0.0006) [2023-12-26 00:08:05,634][123091] Updated weights for policy 0, policy_version 69500 (0.0011) [2023-12-26 00:08:05,686][123090] Updated weights for policy 1, policy_version 69183 (0.0007) [2023-12-26 00:08:06,368][123091] Updated weights for policy 0, policy_version 69510 (0.0011) [2023-12-26 00:08:06,419][123091] Updated weights for policy 0, policy_version 69520 (0.0010) [2023-12-26 00:08:06,478][123091] Updated weights for policy 0, policy_version 69530 (0.0006) [2023-12-26 00:08:06,568][123090] Updated weights for policy 1, policy_version 69193 (0.0010) [2023-12-26 00:08:06,628][123090] Updated weights for policy 1, policy_version 69203 (0.0010) [2023-12-26 00:08:06,693][123090] Updated weights for policy 1, policy_version 69213 (0.0009) [2023-12-26 00:08:07,265][123091] Updated weights for policy 0, policy_version 69540 (0.0006) [2023-12-26 00:08:07,336][123091] Updated weights for policy 0, policy_version 69550 (0.0007) [2023-12-26 00:08:07,408][123091] Updated weights for policy 0, policy_version 69560 (0.0008) [2023-12-26 00:08:07,618][123090] Updated weights for policy 1, policy_version 69223 (0.0009) [2023-12-26 00:08:07,676][123090] Updated weights for policy 1, policy_version 69233 (0.0010) [2023-12-26 00:08:07,742][123090] Updated weights for policy 1, policy_version 69243 (0.0010) [2023-12-26 00:08:08,019][123091] Updated weights for policy 0, policy_version 69570 (0.0009) [2023-12-26 00:08:08,077][123091] Updated weights for policy 0, policy_version 69580 (0.0007) [2023-12-26 00:08:08,142][123091] Updated weights for policy 0, policy_version 69590 (0.0009) [2023-12-26 00:08:08,210][123091] Updated weights for policy 0, policy_version 69600 (0.0008) [2023-12-26 00:08:08,636][123090] Updated weights for policy 1, policy_version 69253 (0.0009) [2023-12-26 00:08:08,697][123090] Updated weights for policy 1, policy_version 69263 (0.0008) [2023-12-26 00:08:08,753][123090] Updated weights for policy 1, policy_version 69273 (0.0008) [2023-12-26 00:08:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 16606.2). Total num frames: 35545088. Throughput: 0: 8277.0, 1: 8240.9. Samples: 35526988. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:08,785][121949] Avg episode reward: [(0, '4349.312'), (1, '5383.991')] [2023-12-26 00:08:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000069600_17817600.pth... [2023-12-26 00:08:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000068640_17571840.pth [2023-12-26 00:08:08,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000069280_17735680.pth... [2023-12-26 00:08:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000068320_17489920.pth [2023-12-26 00:08:08,955][123091] Updated weights for policy 0, policy_version 69610 (0.0008) [2023-12-26 00:08:09,021][123091] Updated weights for policy 0, policy_version 69620 (0.0011) [2023-12-26 00:08:09,085][123091] Updated weights for policy 0, policy_version 69630 (0.0009) [2023-12-26 00:08:09,671][123090] Updated weights for policy 1, policy_version 69283 (0.0008) [2023-12-26 00:08:09,739][123090] Updated weights for policy 1, policy_version 69293 (0.0008) [2023-12-26 00:08:09,807][123090] Updated weights for policy 1, policy_version 69303 (0.0008) [2023-12-26 00:08:09,993][123091] Updated weights for policy 0, policy_version 69640 (0.0010) [2023-12-26 00:08:10,049][123091] Updated weights for policy 0, policy_version 69650 (0.0010) [2023-12-26 00:08:10,109][123091] Updated weights for policy 0, policy_version 69660 (0.0009) [2023-12-26 00:08:10,624][123090] Updated weights for policy 1, policy_version 69313 (0.0009) [2023-12-26 00:08:10,684][123090] Updated weights for policy 1, policy_version 69323 (0.0010) [2023-12-26 00:08:10,737][123090] Updated weights for policy 1, policy_version 69333 (0.0010) [2023-12-26 00:08:10,791][123090] Updated weights for policy 1, policy_version 69343 (0.0010) [2023-12-26 00:08:10,920][123091] Updated weights for policy 0, policy_version 69670 (0.0007) [2023-12-26 00:08:10,981][123091] Updated weights for policy 0, policy_version 69680 (0.0007) [2023-12-26 00:08:11,060][123091] Updated weights for policy 0, policy_version 69690 (0.0010) [2023-12-26 00:08:11,770][123090] Updated weights for policy 1, policy_version 69353 (0.0009) [2023-12-26 00:08:11,839][123090] Updated weights for policy 1, policy_version 69363 (0.0009) [2023-12-26 00:08:11,853][123091] Updated weights for policy 0, policy_version 69700 (0.0010) [2023-12-26 00:08:11,897][123090] Updated weights for policy 1, policy_version 69373 (0.0009) [2023-12-26 00:08:11,921][123091] Updated weights for policy 0, policy_version 69710 (0.0008) [2023-12-26 00:08:11,993][123091] Updated weights for policy 0, policy_version 69720 (0.0010) [2023-12-26 00:08:12,820][123090] Updated weights for policy 1, policy_version 69383 (0.0008) [2023-12-26 00:08:12,873][123091] Updated weights for policy 0, policy_version 69730 (0.0009) [2023-12-26 00:08:12,879][123090] Updated weights for policy 1, policy_version 69393 (0.0009) [2023-12-26 00:08:12,936][123091] Updated weights for policy 0, policy_version 69740 (0.0008) [2023-12-26 00:08:12,939][123090] Updated weights for policy 1, policy_version 69403 (0.0007) [2023-12-26 00:08:13,007][123091] Updated weights for policy 0, policy_version 69750 (0.0009) [2023-12-26 00:08:13,074][123091] Updated weights for policy 0, policy_version 69760 (0.0008) [2023-12-26 00:08:13,763][123090] Updated weights for policy 1, policy_version 69413 (0.0009) [2023-12-26 00:08:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 16578.4). Total num frames: 35627008. Throughput: 0: 8368.8, 1: 8188.8. Samples: 35627568. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:13,784][121949] Avg episode reward: [(0, '4305.479'), (1, '5403.728')] [2023-12-26 00:08:13,787][123091] Updated weights for policy 0, policy_version 69770 (0.0009) [2023-12-26 00:08:13,821][123090] Updated weights for policy 1, policy_version 69423 (0.0007) [2023-12-26 00:08:13,854][123091] Updated weights for policy 0, policy_version 69780 (0.0009) [2023-12-26 00:08:13,880][123090] Updated weights for policy 1, policy_version 69433 (0.0010) [2023-12-26 00:08:13,913][123091] Updated weights for policy 0, policy_version 69790 (0.0007) [2023-12-26 00:08:14,666][123090] Updated weights for policy 1, policy_version 69443 (0.0010) [2023-12-26 00:08:14,732][123090] Updated weights for policy 1, policy_version 69453 (0.0009) [2023-12-26 00:08:14,780][123091] Updated weights for policy 0, policy_version 69800 (0.0007) [2023-12-26 00:08:14,806][123090] Updated weights for policy 1, policy_version 69463 (0.0009) [2023-12-26 00:08:14,845][123091] Updated weights for policy 0, policy_version 69810 (0.0008) [2023-12-26 00:08:14,914][123091] Updated weights for policy 0, policy_version 69820 (0.0007) [2023-12-26 00:08:15,678][123090] Updated weights for policy 1, policy_version 69473 (0.0010) [2023-12-26 00:08:15,731][123090] Updated weights for policy 1, policy_version 69483 (0.0009) [2023-12-26 00:08:15,757][123091] Updated weights for policy 0, policy_version 69830 (0.0007) [2023-12-26 00:08:15,791][123090] Updated weights for policy 1, policy_version 69493 (0.0009) [2023-12-26 00:08:15,820][123091] Updated weights for policy 0, policy_version 69840 (0.0009) [2023-12-26 00:08:15,856][123090] Updated weights for policy 1, policy_version 69503 (0.0009) [2023-12-26 00:08:15,884][123091] Updated weights for policy 0, policy_version 69850 (0.0009) [2023-12-26 00:08:16,721][123090] Updated weights for policy 1, policy_version 69513 (0.0010) [2023-12-26 00:08:16,731][123091] Updated weights for policy 0, policy_version 69860 (0.0009) [2023-12-26 00:08:16,773][123090] Updated weights for policy 1, policy_version 69523 (0.0010) [2023-12-26 00:08:16,777][123091] Updated weights for policy 0, policy_version 69870 (0.0007) [2023-12-26 00:08:16,827][123090] Updated weights for policy 1, policy_version 69533 (0.0009) [2023-12-26 00:08:16,830][123091] Updated weights for policy 0, policy_version 69880 (0.0009) [2023-12-26 00:08:17,615][123091] Updated weights for policy 0, policy_version 69890 (0.0007) [2023-12-26 00:08:17,660][123091] Updated weights for policy 0, policy_version 69900 (0.0010) [2023-12-26 00:08:17,661][123090] Updated weights for policy 1, policy_version 69543 (0.0007) [2023-12-26 00:08:17,713][123091] Updated weights for policy 0, policy_version 69910 (0.0010) [2023-12-26 00:08:17,725][123090] Updated weights for policy 1, policy_version 69553 (0.0010) [2023-12-26 00:08:17,769][123091] Updated weights for policy 0, policy_version 69920 (0.0010) [2023-12-26 00:08:17,778][123090] Updated weights for policy 1, policy_version 69563 (0.0011) [2023-12-26 00:08:18,568][123091] Updated weights for policy 0, policy_version 69930 (0.0010) [2023-12-26 00:08:18,614][123090] Updated weights for policy 1, policy_version 69573 (0.0011) [2023-12-26 00:08:18,632][123091] Updated weights for policy 0, policy_version 69940 (0.0010) [2023-12-26 00:08:18,676][123090] Updated weights for policy 1, policy_version 69583 (0.0011) [2023-12-26 00:08:18,694][123091] Updated weights for policy 0, policy_version 69950 (0.0008) [2023-12-26 00:08:18,733][123090] Updated weights for policy 1, policy_version 69593 (0.0010) [2023-12-26 00:08:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 16793.6, 300 sec: 16689.5). Total num frames: 35725312. Throughput: 0: 8424.2, 1: 8211.1. Samples: 35730620. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:18,785][121949] Avg episode reward: [(0, '4382.236'), (1, '5345.455')] [2023-12-26 00:08:19,545][123090] Updated weights for policy 1, policy_version 69603 (0.0009) [2023-12-26 00:08:19,609][123091] Updated weights for policy 0, policy_version 69960 (0.0009) [2023-12-26 00:08:19,616][123090] Updated weights for policy 1, policy_version 69613 (0.0006) [2023-12-26 00:08:19,677][123091] Updated weights for policy 0, policy_version 69970 (0.0009) [2023-12-26 00:08:19,685][123090] Updated weights for policy 1, policy_version 69623 (0.0008) [2023-12-26 00:08:19,743][123091] Updated weights for policy 0, policy_version 69980 (0.0008) [2023-12-26 00:08:20,450][123090] Updated weights for policy 1, policy_version 69633 (0.0009) [2023-12-26 00:08:20,517][123090] Updated weights for policy 1, policy_version 69643 (0.0009) [2023-12-26 00:08:20,596][123090] Updated weights for policy 1, policy_version 69653 (0.0010) [2023-12-26 00:08:20,618][123091] Updated weights for policy 0, policy_version 69990 (0.0008) [2023-12-26 00:08:20,666][123090] Updated weights for policy 1, policy_version 69663 (0.0008) [2023-12-26 00:08:20,685][123091] Updated weights for policy 0, policy_version 70000 (0.0010) [2023-12-26 00:08:20,749][123091] Updated weights for policy 0, policy_version 70010 (0.0009) [2023-12-26 00:08:21,557][123090] Updated weights for policy 1, policy_version 69673 (0.0007) [2023-12-26 00:08:21,620][123091] Updated weights for policy 0, policy_version 70020 (0.0010) [2023-12-26 00:08:21,627][123090] Updated weights for policy 1, policy_version 69683 (0.0008) [2023-12-26 00:08:21,695][123091] Updated weights for policy 0, policy_version 70030 (0.0010) [2023-12-26 00:08:21,695][123090] Updated weights for policy 1, policy_version 69693 (0.0009) [2023-12-26 00:08:21,768][123091] Updated weights for policy 0, policy_version 70040 (0.0010) [2023-12-26 00:08:22,489][123090] Updated weights for policy 1, policy_version 69703 (0.0007) [2023-12-26 00:08:22,558][123090] Updated weights for policy 1, policy_version 69713 (0.0007) [2023-12-26 00:08:22,625][123090] Updated weights for policy 1, policy_version 69723 (0.0009) [2023-12-26 00:08:22,632][123091] Updated weights for policy 0, policy_version 70050 (0.0008) [2023-12-26 00:08:22,694][123091] Updated weights for policy 0, policy_version 70060 (0.0009) [2023-12-26 00:08:22,764][123091] Updated weights for policy 0, policy_version 70070 (0.0010) [2023-12-26 00:08:22,828][123091] Updated weights for policy 0, policy_version 70080 (0.0010) [2023-12-26 00:08:23,472][123090] Updated weights for policy 1, policy_version 69733 (0.0007) [2023-12-26 00:08:23,528][123090] Updated weights for policy 1, policy_version 69743 (0.0006) [2023-12-26 00:08:23,585][123090] Updated weights for policy 1, policy_version 69753 (0.0009) [2023-12-26 00:08:23,600][123091] Updated weights for policy 0, policy_version 70090 (0.0007) [2023-12-26 00:08:23,667][123091] Updated weights for policy 0, policy_version 70100 (0.0010) [2023-12-26 00:08:23,726][123091] Updated weights for policy 0, policy_version 70110 (0.0008) [2023-12-26 00:08:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 16793.6, 300 sec: 16661.7). Total num frames: 35807232. Throughput: 0: 8381.3, 1: 8219.4. Samples: 35779736. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:23,785][121949] Avg episode reward: [(0, '4437.925'), (1, '5366.363')] [2023-12-26 00:08:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000070112_17948672.pth... [2023-12-26 00:08:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000069760_17858560.pth... [2023-12-26 00:08:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000069088_17686528.pth [2023-12-26 00:08:23,794][123007] Saving new best policy, reward=4437.925! [2023-12-26 00:08:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000068800_17612800.pth [2023-12-26 00:08:24,405][123090] Updated weights for policy 1, policy_version 69763 (0.0007) [2023-12-26 00:08:24,462][123090] Updated weights for policy 1, policy_version 69773 (0.0010) [2023-12-26 00:08:24,509][123091] Updated weights for policy 0, policy_version 70120 (0.0006) [2023-12-26 00:08:24,523][123090] Updated weights for policy 1, policy_version 69783 (0.0010) [2023-12-26 00:08:24,567][123091] Updated weights for policy 0, policy_version 70130 (0.0009) [2023-12-26 00:08:24,624][123091] Updated weights for policy 0, policy_version 70140 (0.0010) [2023-12-26 00:08:25,354][123090] Updated weights for policy 1, policy_version 69793 (0.0010) [2023-12-26 00:08:25,403][123090] Updated weights for policy 1, policy_version 69803 (0.0010) [2023-12-26 00:08:25,436][123091] Updated weights for policy 0, policy_version 70150 (0.0007) [2023-12-26 00:08:25,455][123090] Updated weights for policy 1, policy_version 69813 (0.0011) [2023-12-26 00:08:25,497][123091] Updated weights for policy 0, policy_version 70160 (0.0006) [2023-12-26 00:08:25,515][123090] Updated weights for policy 1, policy_version 69823 (0.0011) [2023-12-26 00:08:25,556][123091] Updated weights for policy 0, policy_version 70170 (0.0008) [2023-12-26 00:08:26,366][123090] Updated weights for policy 1, policy_version 69833 (0.0010) [2023-12-26 00:08:26,425][123090] Updated weights for policy 1, policy_version 69843 (0.0009) [2023-12-26 00:08:26,427][123091] Updated weights for policy 0, policy_version 70180 (0.0009) [2023-12-26 00:08:26,486][123091] Updated weights for policy 0, policy_version 70190 (0.0007) [2023-12-26 00:08:26,489][123090] Updated weights for policy 1, policy_version 69853 (0.0010) [2023-12-26 00:08:26,544][123091] Updated weights for policy 0, policy_version 70200 (0.0009) [2023-12-26 00:08:27,327][123090] Updated weights for policy 1, policy_version 69863 (0.0009) [2023-12-26 00:08:27,392][123090] Updated weights for policy 1, policy_version 69873 (0.0010) [2023-12-26 00:08:27,398][123091] Updated weights for policy 0, policy_version 70210 (0.0010) [2023-12-26 00:08:27,454][123090] Updated weights for policy 1, policy_version 69883 (0.0007) [2023-12-26 00:08:27,465][123091] Updated weights for policy 0, policy_version 70220 (0.0008) [2023-12-26 00:08:27,518][123091] Updated weights for policy 0, policy_version 70230 (0.0008) [2023-12-26 00:08:27,572][123091] Updated weights for policy 0, policy_version 70240 (0.0009) [2023-12-26 00:08:28,324][123090] Updated weights for policy 1, policy_version 69893 (0.0010) [2023-12-26 00:08:28,392][123090] Updated weights for policy 1, policy_version 69903 (0.0009) [2023-12-26 00:08:28,454][123091] Updated weights for policy 0, policy_version 70250 (0.0010) [2023-12-26 00:08:28,456][123090] Updated weights for policy 1, policy_version 69913 (0.0007) [2023-12-26 00:08:28,512][123091] Updated weights for policy 0, policy_version 70260 (0.0008) [2023-12-26 00:08:28,581][123091] Updated weights for policy 0, policy_version 70270 (0.0010) [2023-12-26 00:08:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16633.9). Total num frames: 35889152. Throughput: 0: 8440.9, 1: 8221.7. Samples: 35881252. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:28,785][121949] Avg episode reward: [(0, '4415.387'), (1, '5381.373')] [2023-12-26 00:08:29,273][123090] Updated weights for policy 1, policy_version 69923 (0.0009) [2023-12-26 00:08:29,344][123090] Updated weights for policy 1, policy_version 69933 (0.0007) [2023-12-26 00:08:29,414][123090] Updated weights for policy 1, policy_version 69943 (0.0011) [2023-12-26 00:08:29,457][123091] Updated weights for policy 0, policy_version 70280 (0.0009) [2023-12-26 00:08:29,524][123091] Updated weights for policy 0, policy_version 70290 (0.0009) [2023-12-26 00:08:29,590][123091] Updated weights for policy 0, policy_version 70300 (0.0010) [2023-12-26 00:08:30,274][123090] Updated weights for policy 1, policy_version 69953 (0.0009) [2023-12-26 00:08:30,338][123090] Updated weights for policy 1, policy_version 69963 (0.0010) [2023-12-26 00:08:30,401][123090] Updated weights for policy 1, policy_version 69973 (0.0009) [2023-12-26 00:08:30,452][123091] Updated weights for policy 0, policy_version 70310 (0.0008) [2023-12-26 00:08:30,467][123090] Updated weights for policy 1, policy_version 69983 (0.0009) [2023-12-26 00:08:30,519][123091] Updated weights for policy 0, policy_version 70320 (0.0008) [2023-12-26 00:08:30,589][123091] Updated weights for policy 0, policy_version 70330 (0.0009) [2023-12-26 00:08:31,283][123091] Updated weights for policy 0, policy_version 70340 (0.0009) [2023-12-26 00:08:31,347][123091] Updated weights for policy 0, policy_version 70350 (0.0008) [2023-12-26 00:08:31,357][123090] Updated weights for policy 1, policy_version 69993 (0.0008) [2023-12-26 00:08:31,422][123091] Updated weights for policy 0, policy_version 70360 (0.0008) [2023-12-26 00:08:31,429][123090] Updated weights for policy 1, policy_version 70003 (0.0009) [2023-12-26 00:08:31,498][123090] Updated weights for policy 1, policy_version 70013 (0.0005) [2023-12-26 00:08:32,208][123091] Updated weights for policy 0, policy_version 70370 (0.0009) [2023-12-26 00:08:32,272][123091] Updated weights for policy 0, policy_version 70380 (0.0010) [2023-12-26 00:08:32,336][123091] Updated weights for policy 0, policy_version 70390 (0.0009) [2023-12-26 00:08:32,374][123090] Updated weights for policy 1, policy_version 70023 (0.0007) [2023-12-26 00:08:32,408][123091] Updated weights for policy 0, policy_version 70400 (0.0008) [2023-12-26 00:08:32,444][123090] Updated weights for policy 1, policy_version 70033 (0.0008) [2023-12-26 00:08:32,507][123090] Updated weights for policy 1, policy_version 70043 (0.0008) [2023-12-26 00:08:33,262][123091] Updated weights for policy 0, policy_version 70410 (0.0009) [2023-12-26 00:08:33,313][123090] Updated weights for policy 1, policy_version 70053 (0.0008) [2023-12-26 00:08:33,317][123091] Updated weights for policy 0, policy_version 70420 (0.0009) [2023-12-26 00:08:33,371][123091] Updated weights for policy 0, policy_version 70430 (0.0009) [2023-12-26 00:08:33,376][123090] Updated weights for policy 1, policy_version 70063 (0.0008) [2023-12-26 00:08:33,440][123090] Updated weights for policy 1, policy_version 70073 (0.0009) [2023-12-26 00:08:33,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16633.9). Total num frames: 35971072. Throughput: 0: 8477.6, 1: 8202.2. Samples: 35981276. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:33,784][121949] Avg episode reward: [(0, '4310.768'), (1, '5430.957')] [2023-12-26 00:08:34,227][123091] Updated weights for policy 0, policy_version 70440 (0.0010) [2023-12-26 00:08:34,267][123090] Updated weights for policy 1, policy_version 70083 (0.0009) [2023-12-26 00:08:34,301][123091] Updated weights for policy 0, policy_version 70450 (0.0008) [2023-12-26 00:08:34,337][123090] Updated weights for policy 1, policy_version 70093 (0.0009) [2023-12-26 00:08:34,359][123091] Updated weights for policy 0, policy_version 70460 (0.0008) [2023-12-26 00:08:34,403][123090] Updated weights for policy 1, policy_version 70103 (0.0009) [2023-12-26 00:08:35,124][123090] Updated weights for policy 1, policy_version 70113 (0.0009) [2023-12-26 00:08:35,184][123090] Updated weights for policy 1, policy_version 70123 (0.0008) [2023-12-26 00:08:35,223][123091] Updated weights for policy 0, policy_version 70470 (0.0007) [2023-12-26 00:08:35,242][123090] Updated weights for policy 1, policy_version 70133 (0.0009) [2023-12-26 00:08:35,284][123091] Updated weights for policy 0, policy_version 70480 (0.0007) [2023-12-26 00:08:35,301][123090] Updated weights for policy 1, policy_version 70143 (0.0009) [2023-12-26 00:08:35,347][123091] Updated weights for policy 0, policy_version 70490 (0.0010) [2023-12-26 00:08:36,131][123090] Updated weights for policy 1, policy_version 70153 (0.0010) [2023-12-26 00:08:36,185][123091] Updated weights for policy 0, policy_version 70500 (0.0008) [2023-12-26 00:08:36,204][123090] Updated weights for policy 1, policy_version 70163 (0.0010) [2023-12-26 00:08:36,248][123091] Updated weights for policy 0, policy_version 70510 (0.0010) [2023-12-26 00:08:36,271][123090] Updated weights for policy 1, policy_version 70173 (0.0009) [2023-12-26 00:08:36,316][123091] Updated weights for policy 0, policy_version 70520 (0.0009) [2023-12-26 00:08:37,103][123090] Updated weights for policy 1, policy_version 70183 (0.0006) [2023-12-26 00:08:37,130][123091] Updated weights for policy 0, policy_version 70530 (0.0010) [2023-12-26 00:08:37,169][123090] Updated weights for policy 1, policy_version 70193 (0.0008) [2023-12-26 00:08:37,195][123091] Updated weights for policy 0, policy_version 70540 (0.0008) [2023-12-26 00:08:37,227][123090] Updated weights for policy 1, policy_version 70203 (0.0007) [2023-12-26 00:08:37,254][123091] Updated weights for policy 0, policy_version 70550 (0.0009) [2023-12-26 00:08:37,310][123091] Updated weights for policy 0, policy_version 70560 (0.0010) [2023-12-26 00:08:38,061][123090] Updated weights for policy 1, policy_version 70213 (0.0008) [2023-12-26 00:08:38,125][123090] Updated weights for policy 1, policy_version 70223 (0.0010) [2023-12-26 00:08:38,147][123091] Updated weights for policy 0, policy_version 70570 (0.0009) [2023-12-26 00:08:38,190][123090] Updated weights for policy 1, policy_version 70233 (0.0008) [2023-12-26 00:08:38,202][123091] Updated weights for policy 0, policy_version 70580 (0.0009) [2023-12-26 00:08:38,274][123091] Updated weights for policy 0, policy_version 70590 (0.0008) [2023-12-26 00:08:38,784][121949] Fps is (10 sec: 16383.6, 60 sec: 16657.0, 300 sec: 16633.9). Total num frames: 36052992. Throughput: 0: 8489.4, 1: 8238.5. Samples: 36031788. Policy #0 lag: (min: 31.0, avg: 31.5, max: 48.0) [2023-12-26 00:08:38,785][121949] Avg episode reward: [(0, '4386.633'), (1, '5302.910')] [2023-12-26 00:08:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000070592_18071552.pth... [2023-12-26 00:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000070240_17981440.pth... [2023-12-26 00:08:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000069600_17817600.pth [2023-12-26 00:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000069280_17735680.pth [2023-12-26 00:08:39,049][123090] Updated weights for policy 1, policy_version 70243 (0.0010) [2023-12-26 00:08:39,118][123090] Updated weights for policy 1, policy_version 70253 (0.0009) [2023-12-26 00:08:39,128][123091] Updated weights for policy 0, policy_version 70600 (0.0009) [2023-12-26 00:08:39,181][123090] Updated weights for policy 1, policy_version 70263 (0.0009) [2023-12-26 00:08:39,186][123091] Updated weights for policy 0, policy_version 70610 (0.0007) [2023-12-26 00:08:39,259][123091] Updated weights for policy 0, policy_version 70620 (0.0008) [2023-12-26 00:08:40,050][123090] Updated weights for policy 1, policy_version 70273 (0.0008) [2023-12-26 00:08:40,100][123091] Updated weights for policy 0, policy_version 70630 (0.0010) [2023-12-26 00:08:40,122][123090] Updated weights for policy 1, policy_version 70283 (0.0009) [2023-12-26 00:08:40,172][123091] Updated weights for policy 0, policy_version 70640 (0.0011) [2023-12-26 00:08:40,197][123090] Updated weights for policy 1, policy_version 70293 (0.0007) [2023-12-26 00:08:40,235][123091] Updated weights for policy 0, policy_version 70650 (0.0011) [2023-12-26 00:08:40,260][123090] Updated weights for policy 1, policy_version 70303 (0.0006) [2023-12-26 00:08:41,098][123091] Updated weights for policy 0, policy_version 70660 (0.0011) [2023-12-26 00:08:41,105][123090] Updated weights for policy 1, policy_version 70313 (0.0007) [2023-12-26 00:08:41,178][123091] Updated weights for policy 0, policy_version 70670 (0.0013) [2023-12-26 00:08:41,182][123090] Updated weights for policy 1, policy_version 70323 (0.0009) [2023-12-26 00:08:41,245][123091] Updated weights for policy 0, policy_version 70680 (0.0010) [2023-12-26 00:08:41,249][123090] Updated weights for policy 1, policy_version 70333 (0.0011) [2023-12-26 00:08:42,096][123090] Updated weights for policy 1, policy_version 70343 (0.0008) [2023-12-26 00:08:42,108][123091] Updated weights for policy 0, policy_version 70690 (0.0010) [2023-12-26 00:08:42,169][123090] Updated weights for policy 1, policy_version 70353 (0.0009) [2023-12-26 00:08:42,175][123091] Updated weights for policy 0, policy_version 70700 (0.0010) [2023-12-26 00:08:42,235][123090] Updated weights for policy 1, policy_version 70363 (0.0009) [2023-12-26 00:08:42,243][123091] Updated weights for policy 0, policy_version 70710 (0.0008) [2023-12-26 00:08:42,321][123091] Updated weights for policy 0, policy_version 70720 (0.0010) [2023-12-26 00:08:43,088][123090] Updated weights for policy 1, policy_version 70373 (0.0010) [2023-12-26 00:08:43,111][123091] Updated weights for policy 0, policy_version 70730 (0.0011) [2023-12-26 00:08:43,158][123090] Updated weights for policy 1, policy_version 70383 (0.0010) [2023-12-26 00:08:43,180][123091] Updated weights for policy 0, policy_version 70740 (0.0006) [2023-12-26 00:08:43,217][123090] Updated weights for policy 1, policy_version 70393 (0.0007) [2023-12-26 00:08:43,253][123091] Updated weights for policy 0, policy_version 70750 (0.0009) [2023-12-26 00:08:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 16657.0, 300 sec: 16606.2). Total num frames: 36134912. Throughput: 0: 8485.0, 1: 8234.7. Samples: 36130344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:08:43,785][121949] Avg episode reward: [(0, '4391.968'), (1, '5327.333')] [2023-12-26 00:08:43,949][123091] Updated weights for policy 0, policy_version 70760 (0.0006) [2023-12-26 00:08:43,977][123090] Updated weights for policy 1, policy_version 70403 (0.0006) [2023-12-26 00:08:44,019][123091] Updated weights for policy 0, policy_version 70770 (0.0006) [2023-12-26 00:08:44,036][123090] Updated weights for policy 1, policy_version 70413 (0.0006) [2023-12-26 00:08:44,080][123091] Updated weights for policy 0, policy_version 70780 (0.0009) [2023-12-26 00:08:44,096][123090] Updated weights for policy 1, policy_version 70423 (0.0006) [2023-12-26 00:08:44,776][123090] Updated weights for policy 1, policy_version 70433 (0.0006) [2023-12-26 00:08:44,840][123090] Updated weights for policy 1, policy_version 70443 (0.0008) [2023-12-26 00:08:44,900][123090] Updated weights for policy 1, policy_version 70453 (0.0008) [2023-12-26 00:08:44,952][123091] Updated weights for policy 0, policy_version 70790 (0.0008) [2023-12-26 00:08:44,961][123090] Updated weights for policy 1, policy_version 70463 (0.0008) [2023-12-26 00:08:45,019][123091] Updated weights for policy 0, policy_version 70800 (0.0008) [2023-12-26 00:08:45,092][123091] Updated weights for policy 0, policy_version 70810 (0.0009) [2023-12-26 00:08:45,776][123090] Updated weights for policy 1, policy_version 70473 (0.0010) [2023-12-26 00:08:45,833][123090] Updated weights for policy 1, policy_version 70484 (0.0010) [2023-12-26 00:08:45,897][123090] Updated weights for policy 1, policy_version 70494 (0.0009) [2023-12-26 00:08:45,917][123091] Updated weights for policy 0, policy_version 70820 (0.0008) [2023-12-26 00:08:45,974][123091] Updated weights for policy 0, policy_version 70830 (0.0009) [2023-12-26 00:08:46,031][123091] Updated weights for policy 0, policy_version 70840 (0.0010) [2023-12-26 00:08:46,779][123090] Updated weights for policy 1, policy_version 70504 (0.0008) [2023-12-26 00:08:46,837][123090] Updated weights for policy 1, policy_version 70514 (0.0009) [2023-12-26 00:08:46,865][123091] Updated weights for policy 0, policy_version 70850 (0.0009) [2023-12-26 00:08:46,885][123090] Updated weights for policy 1, policy_version 70524 (0.0009) [2023-12-26 00:08:46,935][123091] Updated weights for policy 0, policy_version 70860 (0.0009) [2023-12-26 00:08:47,005][123091] Updated weights for policy 0, policy_version 70870 (0.0011) [2023-12-26 00:08:47,077][123091] Updated weights for policy 0, policy_version 70880 (0.0009) [2023-12-26 00:08:47,816][123090] Updated weights for policy 1, policy_version 70534 (0.0009) [2023-12-26 00:08:47,840][123091] Updated weights for policy 0, policy_version 70890 (0.0006) [2023-12-26 00:08:47,881][123090] Updated weights for policy 1, policy_version 70544 (0.0008) [2023-12-26 00:08:47,903][123091] Updated weights for policy 0, policy_version 70900 (0.0006) [2023-12-26 00:08:47,938][123090] Updated weights for policy 1, policy_version 70554 (0.0010) [2023-12-26 00:08:47,959][123091] Updated weights for policy 0, policy_version 70910 (0.0009) [2023-12-26 00:08:48,664][123091] Updated weights for policy 0, policy_version 70920 (0.0007) [2023-12-26 00:08:48,728][123091] Updated weights for policy 0, policy_version 70930 (0.0007) [2023-12-26 00:08:48,764][123090] Updated weights for policy 1, policy_version 70564 (0.0008) [2023-12-26 00:08:48,784][121949] Fps is (10 sec: 16384.5, 60 sec: 16657.1, 300 sec: 16606.2). Total num frames: 36216832. Throughput: 0: 8570.1, 1: 8328.5. Samples: 36236316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:08:48,785][121949] Avg episode reward: [(0, '4374.701'), (1, '5334.899')] [2023-12-26 00:08:48,785][123091] Updated weights for policy 0, policy_version 70940 (0.0008) [2023-12-26 00:08:48,829][123090] Updated weights for policy 1, policy_version 70574 (0.0010) [2023-12-26 00:08:48,888][123090] Updated weights for policy 1, policy_version 70584 (0.0010) [2023-12-26 00:08:49,486][123091] Updated weights for policy 0, policy_version 70950 (0.0007) [2023-12-26 00:08:49,558][123091] Updated weights for policy 0, policy_version 70960 (0.0007) [2023-12-26 00:08:49,637][123091] Updated weights for policy 0, policy_version 70970 (0.0007) [2023-12-26 00:08:49,672][123090] Updated weights for policy 1, policy_version 70594 (0.0010) [2023-12-26 00:08:49,741][123090] Updated weights for policy 1, policy_version 70604 (0.0011) [2023-12-26 00:08:49,803][123090] Updated weights for policy 1, policy_version 70614 (0.0009) [2023-12-26 00:08:49,878][123090] Updated weights for policy 1, policy_version 70624 (0.0007) [2023-12-26 00:08:50,388][123091] Updated weights for policy 0, policy_version 70980 (0.0009) [2023-12-26 00:08:50,451][123091] Updated weights for policy 0, policy_version 70990 (0.0011) [2023-12-26 00:08:50,515][123091] Updated weights for policy 0, policy_version 71000 (0.0011) [2023-12-26 00:08:50,747][123090] Updated weights for policy 1, policy_version 70634 (0.0009) [2023-12-26 00:08:50,820][123090] Updated weights for policy 1, policy_version 70644 (0.0010) [2023-12-26 00:08:50,885][123090] Updated weights for policy 1, policy_version 70654 (0.0009) [2023-12-26 00:08:51,335][123091] Updated weights for policy 0, policy_version 71010 (0.0011) [2023-12-26 00:08:51,415][123091] Updated weights for policy 0, policy_version 71020 (0.0010) [2023-12-26 00:08:51,487][123091] Updated weights for policy 0, policy_version 71030 (0.0011) [2023-12-26 00:08:51,552][123091] Updated weights for policy 0, policy_version 71040 (0.0007) [2023-12-26 00:08:51,810][123090] Updated weights for policy 1, policy_version 70664 (0.0009) [2023-12-26 00:08:51,891][123090] Updated weights for policy 1, policy_version 70674 (0.0006) [2023-12-26 00:08:51,958][123090] Updated weights for policy 1, policy_version 70684 (0.0010) [2023-12-26 00:08:52,360][123091] Updated weights for policy 0, policy_version 71050 (0.0011) [2023-12-26 00:08:52,436][123091] Updated weights for policy 0, policy_version 71060 (0.0009) [2023-12-26 00:08:52,501][123091] Updated weights for policy 0, policy_version 71070 (0.0009) [2023-12-26 00:08:52,821][123090] Updated weights for policy 1, policy_version 70694 (0.0008) [2023-12-26 00:08:52,896][123090] Updated weights for policy 1, policy_version 70704 (0.0008) [2023-12-26 00:08:52,968][123090] Updated weights for policy 1, policy_version 70714 (0.0009) [2023-12-26 00:08:53,256][123091] Updated weights for policy 0, policy_version 71080 (0.0007) [2023-12-26 00:08:53,312][123091] Updated weights for policy 0, policy_version 71090 (0.0007) [2023-12-26 00:08:53,379][123091] Updated weights for policy 0, policy_version 71100 (0.0006) [2023-12-26 00:08:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16633.9). Total num frames: 36306944. Throughput: 0: 8566.5, 1: 8345.1. Samples: 36288008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:08:53,785][121949] Avg episode reward: [(0, '4393.106'), (1, '5438.450')] [2023-12-26 00:08:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000071104_18202624.pth... [2023-12-26 00:08:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000070112_17948672.pth [2023-12-26 00:08:53,794][123090] Updated weights for policy 1, policy_version 70724 (0.0010) [2023-12-26 00:08:53,855][123090] Updated weights for policy 1, policy_version 70734 (0.0011) [2023-12-26 00:08:53,907][123090] Updated weights for policy 1, policy_version 70744 (0.0010) [2023-12-26 00:08:53,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000070752_18112512.pth... [2023-12-26 00:08:53,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000069760_17858560.pth [2023-12-26 00:08:54,029][123091] Updated weights for policy 0, policy_version 71110 (0.0006) [2023-12-26 00:08:54,094][123091] Updated weights for policy 0, policy_version 71120 (0.0006) [2023-12-26 00:08:54,149][123091] Updated weights for policy 0, policy_version 71130 (0.0007) [2023-12-26 00:08:54,749][123090] Updated weights for policy 1, policy_version 70754 (0.0011) [2023-12-26 00:08:54,802][123090] Updated weights for policy 1, policy_version 70764 (0.0010) [2023-12-26 00:08:54,870][123090] Updated weights for policy 1, policy_version 70774 (0.0011) [2023-12-26 00:08:54,910][123091] Updated weights for policy 0, policy_version 71140 (0.0009) [2023-12-26 00:08:54,942][123090] Updated weights for policy 1, policy_version 70784 (0.0011) [2023-12-26 00:08:54,976][123091] Updated weights for policy 0, policy_version 71150 (0.0007) [2023-12-26 00:08:55,041][123091] Updated weights for policy 0, policy_version 71160 (0.0006) [2023-12-26 00:08:55,768][123090] Updated weights for policy 1, policy_version 70794 (0.0006) [2023-12-26 00:08:55,828][123090] Updated weights for policy 1, policy_version 70804 (0.0005) [2023-12-26 00:08:55,861][123091] Updated weights for policy 0, policy_version 71170 (0.0007) [2023-12-26 00:08:55,899][123090] Updated weights for policy 1, policy_version 70814 (0.0006) [2023-12-26 00:08:55,927][123091] Updated weights for policy 0, policy_version 71180 (0.0006) [2023-12-26 00:08:55,989][123091] Updated weights for policy 0, policy_version 71190 (0.0006) [2023-12-26 00:08:56,050][123091] Updated weights for policy 0, policy_version 71200 (0.0006) [2023-12-26 00:08:56,655][123090] Updated weights for policy 1, policy_version 70824 (0.0009) [2023-12-26 00:08:56,719][123090] Updated weights for policy 1, policy_version 70834 (0.0009) [2023-12-26 00:08:56,784][123090] Updated weights for policy 1, policy_version 70844 (0.0009) [2023-12-26 00:08:56,859][123091] Updated weights for policy 0, policy_version 71210 (0.0008) [2023-12-26 00:08:56,926][123091] Updated weights for policy 0, policy_version 71220 (0.0010) [2023-12-26 00:08:56,986][123091] Updated weights for policy 0, policy_version 71230 (0.0009) [2023-12-26 00:08:57,672][123090] Updated weights for policy 1, policy_version 70854 (0.0010) [2023-12-26 00:08:57,736][123090] Updated weights for policy 1, policy_version 70864 (0.0007) [2023-12-26 00:08:57,742][123091] Updated weights for policy 0, policy_version 71240 (0.0011) [2023-12-26 00:08:57,800][123090] Updated weights for policy 1, policy_version 70874 (0.0006) [2023-12-26 00:08:57,805][123091] Updated weights for policy 0, policy_version 71250 (0.0010) [2023-12-26 00:08:57,857][123091] Updated weights for policy 0, policy_version 71260 (0.0010) [2023-12-26 00:08:58,682][123090] Updated weights for policy 1, policy_version 70884 (0.0010) [2023-12-26 00:08:58,686][123091] Updated weights for policy 0, policy_version 71271 (0.0012) [2023-12-26 00:08:58,761][123090] Updated weights for policy 1, policy_version 70894 (0.0009) [2023-12-26 00:08:58,768][123091] Updated weights for policy 0, policy_version 71281 (0.0010) [2023-12-26 00:08:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16606.2). Total num frames: 36388864. Throughput: 0: 8593.2, 1: 8394.3. Samples: 36392004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:08:58,785][121949] Avg episode reward: [(0, '4429.094'), (1, '5382.119')] [2023-12-26 00:08:58,842][123090] Updated weights for policy 1, policy_version 70904 (0.0010) [2023-12-26 00:08:58,842][123091] Updated weights for policy 0, policy_version 71291 (0.0009) [2023-12-26 00:08:59,617][123090] Updated weights for policy 1, policy_version 70914 (0.0010) [2023-12-26 00:08:59,674][123090] Updated weights for policy 1, policy_version 70924 (0.0005) [2023-12-26 00:08:59,736][123090] Updated weights for policy 1, policy_version 70934 (0.0009) [2023-12-26 00:08:59,757][123091] Updated weights for policy 0, policy_version 71301 (0.0008) [2023-12-26 00:08:59,794][123090] Updated weights for policy 1, policy_version 70944 (0.0010) [2023-12-26 00:08:59,818][123091] Updated weights for policy 0, policy_version 71311 (0.0006) [2023-12-26 00:08:59,887][123091] Updated weights for policy 0, policy_version 71321 (0.0009) [2023-12-26 00:09:00,556][123090] Updated weights for policy 1, policy_version 70954 (0.0006) [2023-12-26 00:09:00,621][123090] Updated weights for policy 1, policy_version 70964 (0.0008) [2023-12-26 00:09:00,678][123090] Updated weights for policy 1, policy_version 70974 (0.0011) [2023-12-26 00:09:00,766][123091] Updated weights for policy 0, policy_version 71331 (0.0009) [2023-12-26 00:09:00,815][123091] Updated weights for policy 0, policy_version 71341 (0.0009) [2023-12-26 00:09:00,876][123091] Updated weights for policy 0, policy_version 71351 (0.0009) [2023-12-26 00:09:01,504][123090] Updated weights for policy 1, policy_version 70984 (0.0010) [2023-12-26 00:09:01,564][123090] Updated weights for policy 1, policy_version 70994 (0.0010) [2023-12-26 00:09:01,629][123090] Updated weights for policy 1, policy_version 71004 (0.0010) [2023-12-26 00:09:01,737][123091] Updated weights for policy 0, policy_version 71361 (0.0009) [2023-12-26 00:09:01,795][123091] Updated weights for policy 0, policy_version 71371 (0.0010) [2023-12-26 00:09:01,852][123091] Updated weights for policy 0, policy_version 71381 (0.0005) [2023-12-26 00:09:01,915][123091] Updated weights for policy 0, policy_version 71391 (0.0005) [2023-12-26 00:09:02,466][123090] Updated weights for policy 1, policy_version 71014 (0.0006) [2023-12-26 00:09:02,527][123090] Updated weights for policy 1, policy_version 71024 (0.0005) [2023-12-26 00:09:02,591][123090] Updated weights for policy 1, policy_version 71034 (0.0005) [2023-12-26 00:09:02,616][123091] Updated weights for policy 0, policy_version 71401 (0.0010) [2023-12-26 00:09:02,680][123091] Updated weights for policy 0, policy_version 71411 (0.0011) [2023-12-26 00:09:02,745][123091] Updated weights for policy 0, policy_version 71421 (0.0010) [2023-12-26 00:09:03,221][123090] Updated weights for policy 1, policy_version 71044 (0.0007) [2023-12-26 00:09:03,271][123090] Updated weights for policy 1, policy_version 71054 (0.0005) [2023-12-26 00:09:03,325][123090] Updated weights for policy 1, policy_version 71064 (0.0005) [2023-12-26 00:09:03,541][123091] Updated weights for policy 0, policy_version 71431 (0.0010) [2023-12-26 00:09:03,603][123091] Updated weights for policy 0, policy_version 71441 (0.0010) [2023-12-26 00:09:03,649][123091] Updated weights for policy 0, policy_version 71451 (0.0010) [2023-12-26 00:09:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17066.6, 300 sec: 16661.7). Total num frames: 36487168. Throughput: 0: 8558.4, 1: 8449.1. Samples: 36495964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:09:03,785][121949] Avg episode reward: [(0, '4433.027'), (1, '5357.591')] [2023-12-26 00:09:03,934][123090] Updated weights for policy 1, policy_version 71074 (0.0007) [2023-12-26 00:09:04,006][123090] Updated weights for policy 1, policy_version 71084 (0.0006) [2023-12-26 00:09:04,073][123090] Updated weights for policy 1, policy_version 71094 (0.0006) [2023-12-26 00:09:04,154][123090] Updated weights for policy 1, policy_version 71104 (0.0006) [2023-12-26 00:09:04,406][123091] Updated weights for policy 0, policy_version 71461 (0.0010) [2023-12-26 00:09:04,459][123091] Updated weights for policy 0, policy_version 71471 (0.0008) [2023-12-26 00:09:04,510][123091] Updated weights for policy 0, policy_version 71481 (0.0006) [2023-12-26 00:09:04,828][123090] Updated weights for policy 1, policy_version 71114 (0.0010) [2023-12-26 00:09:04,882][123090] Updated weights for policy 1, policy_version 71125 (0.0010) [2023-12-26 00:09:04,935][123090] Updated weights for policy 1, policy_version 71135 (0.0009) [2023-12-26 00:09:05,214][123091] Updated weights for policy 0, policy_version 71491 (0.0008) [2023-12-26 00:09:05,280][123091] Updated weights for policy 0, policy_version 71501 (0.0010) [2023-12-26 00:09:05,348][123091] Updated weights for policy 0, policy_version 71511 (0.0006) [2023-12-26 00:09:05,784][123090] Updated weights for policy 1, policy_version 71145 (0.0006) [2023-12-26 00:09:05,835][123090] Updated weights for policy 1, policy_version 71155 (0.0005) [2023-12-26 00:09:05,892][123090] Updated weights for policy 1, policy_version 71165 (0.0005) [2023-12-26 00:09:06,004][123091] Updated weights for policy 0, policy_version 71521 (0.0005) [2023-12-26 00:09:06,055][123091] Updated weights for policy 0, policy_version 71531 (0.0007) [2023-12-26 00:09:06,102][123091] Updated weights for policy 0, policy_version 71541 (0.0012) [2023-12-26 00:09:06,165][123091] Updated weights for policy 0, policy_version 71552 (0.0007) [2023-12-26 00:09:06,615][123090] Updated weights for policy 1, policy_version 71175 (0.0006) [2023-12-26 00:09:06,675][123090] Updated weights for policy 1, policy_version 71185 (0.0006) [2023-12-26 00:09:06,742][123090] Updated weights for policy 1, policy_version 71195 (0.0006) [2023-12-26 00:09:06,972][123091] Updated weights for policy 0, policy_version 71562 (0.0005) [2023-12-26 00:09:07,036][123091] Updated weights for policy 0, policy_version 71572 (0.0007) [2023-12-26 00:09:07,099][123091] Updated weights for policy 0, policy_version 71582 (0.0005) [2023-12-26 00:09:07,452][123090] Updated weights for policy 1, policy_version 71205 (0.0006) [2023-12-26 00:09:07,506][123090] Updated weights for policy 1, policy_version 71215 (0.0005) [2023-12-26 00:09:07,559][123090] Updated weights for policy 1, policy_version 71225 (0.0005) [2023-12-26 00:09:07,769][123091] Updated weights for policy 0, policy_version 71592 (0.0009) [2023-12-26 00:09:07,822][123091] Updated weights for policy 0, policy_version 71602 (0.0010) [2023-12-26 00:09:07,873][123091] Updated weights for policy 0, policy_version 71612 (0.0010) [2023-12-26 00:09:08,307][123090] Updated weights for policy 1, policy_version 71235 (0.0007) [2023-12-26 00:09:08,378][123090] Updated weights for policy 1, policy_version 71245 (0.0011) [2023-12-26 00:09:08,442][123090] Updated weights for policy 1, policy_version 71255 (0.0011) [2023-12-26 00:09:08,754][123091] Updated weights for policy 0, policy_version 71622 (0.0010) [2023-12-26 00:09:08,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17203.2, 300 sec: 16689.5). Total num frames: 36577280. Throughput: 0: 8686.2, 1: 8509.4. Samples: 36553540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:09:08,785][121949] Avg episode reward: [(0, '4412.029'), (1, '5295.533')] [2023-12-26 00:09:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000071264_18243584.pth... [2023-12-26 00:09:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000070240_17981440.pth [2023-12-26 00:09:08,821][123091] Updated weights for policy 0, policy_version 71632 (0.0011) [2023-12-26 00:09:08,896][123091] Updated weights for policy 0, policy_version 71642 (0.0011) [2023-12-26 00:09:08,942][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000071648_18341888.pth... [2023-12-26 00:09:08,947][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000070592_18071552.pth [2023-12-26 00:09:09,104][123090] Updated weights for policy 1, policy_version 71265 (0.0006) [2023-12-26 00:09:09,163][123090] Updated weights for policy 1, policy_version 71275 (0.0011) [2023-12-26 00:09:09,212][123090] Updated weights for policy 1, policy_version 71285 (0.0010) [2023-12-26 00:09:09,282][123090] Updated weights for policy 1, policy_version 71295 (0.0011) [2023-12-26 00:09:09,723][123091] Updated weights for policy 0, policy_version 71652 (0.0010) [2023-12-26 00:09:09,783][123091] Updated weights for policy 0, policy_version 71662 (0.0007) [2023-12-26 00:09:09,848][123091] Updated weights for policy 0, policy_version 71672 (0.0007) [2023-12-26 00:09:10,159][123090] Updated weights for policy 1, policy_version 71305 (0.0009) [2023-12-26 00:09:10,221][123090] Updated weights for policy 1, policy_version 71315 (0.0007) [2023-12-26 00:09:10,295][123090] Updated weights for policy 1, policy_version 71325 (0.0005) [2023-12-26 00:09:10,643][123091] Updated weights for policy 0, policy_version 71682 (0.0009) [2023-12-26 00:09:10,706][123091] Updated weights for policy 0, policy_version 71692 (0.0010) [2023-12-26 00:09:10,771][123091] Updated weights for policy 0, policy_version 71702 (0.0009) [2023-12-26 00:09:10,825][123091] Updated weights for policy 0, policy_version 71712 (0.0009) [2023-12-26 00:09:11,107][123090] Updated weights for policy 1, policy_version 71335 (0.0007) [2023-12-26 00:09:11,180][123090] Updated weights for policy 1, policy_version 71345 (0.0007) [2023-12-26 00:09:11,245][123090] Updated weights for policy 1, policy_version 71355 (0.0010) [2023-12-26 00:09:11,745][123091] Updated weights for policy 0, policy_version 71722 (0.0006) [2023-12-26 00:09:11,814][123091] Updated weights for policy 0, policy_version 71732 (0.0009) [2023-12-26 00:09:11,885][123091] Updated weights for policy 0, policy_version 71742 (0.0009) [2023-12-26 00:09:12,030][123090] Updated weights for policy 1, policy_version 71365 (0.0011) [2023-12-26 00:09:12,082][123090] Updated weights for policy 1, policy_version 71375 (0.0010) [2023-12-26 00:09:12,130][123090] Updated weights for policy 1, policy_version 71385 (0.0010) [2023-12-26 00:09:12,655][123091] Updated weights for policy 0, policy_version 71752 (0.0006) [2023-12-26 00:09:12,708][123091] Updated weights for policy 0, policy_version 71762 (0.0009) [2023-12-26 00:09:12,764][123091] Updated weights for policy 0, policy_version 71772 (0.0008) [2023-12-26 00:09:13,037][123090] Updated weights for policy 1, policy_version 71395 (0.0010) [2023-12-26 00:09:13,113][123090] Updated weights for policy 1, policy_version 71405 (0.0006) [2023-12-26 00:09:13,189][123090] Updated weights for policy 1, policy_version 71415 (0.0005) [2023-12-26 00:09:13,421][123091] Updated weights for policy 0, policy_version 71782 (0.0006) [2023-12-26 00:09:13,486][123091] Updated weights for policy 0, policy_version 71792 (0.0006) [2023-12-26 00:09:13,549][123091] Updated weights for policy 0, policy_version 71802 (0.0006) [2023-12-26 00:09:13,783][123090] Updated weights for policy 1, policy_version 71425 (0.0005) [2023-12-26 00:09:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17339.7, 300 sec: 16689.5). Total num frames: 36667392. Throughput: 0: 8709.2, 1: 8606.3. Samples: 36660448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:09:13,785][121949] Avg episode reward: [(0, '4345.970'), (1, '4997.748')] [2023-12-26 00:09:13,850][123090] Updated weights for policy 1, policy_version 71435 (0.0008) [2023-12-26 00:09:13,920][123090] Updated weights for policy 1, policy_version 71445 (0.0010) [2023-12-26 00:09:13,982][123090] Updated weights for policy 1, policy_version 71455 (0.0010) [2023-12-26 00:09:14,180][123091] Updated weights for policy 0, policy_version 71812 (0.0008) [2023-12-26 00:09:14,227][123091] Updated weights for policy 0, policy_version 71822 (0.0010) [2023-12-26 00:09:14,279][123091] Updated weights for policy 0, policy_version 71832 (0.0011) [2023-12-26 00:09:14,662][123090] Updated weights for policy 1, policy_version 71465 (0.0011) [2023-12-26 00:09:14,732][123090] Updated weights for policy 1, policy_version 71475 (0.0007) [2023-12-26 00:09:14,808][123090] Updated weights for policy 1, policy_version 71485 (0.0007) [2023-12-26 00:09:15,080][123091] Updated weights for policy 0, policy_version 71842 (0.0010) [2023-12-26 00:09:15,157][123091] Updated weights for policy 0, policy_version 71852 (0.0006) [2023-12-26 00:09:15,219][123091] Updated weights for policy 0, policy_version 71862 (0.0006) [2023-12-26 00:09:15,287][123091] Updated weights for policy 0, policy_version 71872 (0.0006) [2023-12-26 00:09:15,574][123090] Updated weights for policy 1, policy_version 71495 (0.0008) [2023-12-26 00:09:15,644][123090] Updated weights for policy 1, policy_version 71505 (0.0007) [2023-12-26 00:09:15,707][123090] Updated weights for policy 1, policy_version 71515 (0.0005) [2023-12-26 00:09:15,985][123091] Updated weights for policy 0, policy_version 71882 (0.0005) [2023-12-26 00:09:16,067][123091] Updated weights for policy 0, policy_version 71892 (0.0005) [2023-12-26 00:09:16,130][123091] Updated weights for policy 0, policy_version 71902 (0.0006) [2023-12-26 00:09:16,338][123090] Updated weights for policy 1, policy_version 71525 (0.0005) [2023-12-26 00:09:16,400][123090] Updated weights for policy 1, policy_version 71535 (0.0006) [2023-12-26 00:09:16,461][123090] Updated weights for policy 1, policy_version 71545 (0.0006) [2023-12-26 00:09:16,804][123091] Updated weights for policy 0, policy_version 71912 (0.0009) [2023-12-26 00:09:16,866][123091] Updated weights for policy 0, policy_version 71922 (0.0006) [2023-12-26 00:09:16,927][123091] Updated weights for policy 0, policy_version 71932 (0.0005) [2023-12-26 00:09:17,164][123090] Updated weights for policy 1, policy_version 71555 (0.0005) [2023-12-26 00:09:17,211][123090] Updated weights for policy 1, policy_version 71565 (0.0005) [2023-12-26 00:09:17,270][123090] Updated weights for policy 1, policy_version 71575 (0.0007) [2023-12-26 00:09:17,582][123091] Updated weights for policy 0, policy_version 71942 (0.0008) [2023-12-26 00:09:17,639][123091] Updated weights for policy 0, policy_version 71952 (0.0009) [2023-12-26 00:09:17,694][123091] Updated weights for policy 0, policy_version 71962 (0.0009) [2023-12-26 00:09:17,827][123090] Updated weights for policy 1, policy_version 71585 (0.0008) [2023-12-26 00:09:17,878][123090] Updated weights for policy 1, policy_version 71595 (0.0005) [2023-12-26 00:09:17,925][123090] Updated weights for policy 1, policy_version 71605 (0.0005) [2023-12-26 00:09:17,975][123090] Updated weights for policy 1, policy_version 71615 (0.0006) [2023-12-26 00:09:18,583][123091] Updated weights for policy 0, policy_version 71972 (0.0009) [2023-12-26 00:09:18,651][123091] Updated weights for policy 0, policy_version 71982 (0.0008) [2023-12-26 00:09:18,715][123091] Updated weights for policy 0, policy_version 71992 (0.0009) [2023-12-26 00:09:18,749][123090] Updated weights for policy 1, policy_version 71625 (0.0010) [2023-12-26 00:09:18,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17339.7, 300 sec: 16745.0). Total num frames: 36765696. Throughput: 0: 8860.8, 1: 8835.3. Samples: 36777600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:09:18,785][121949] Avg episode reward: [(0, '4431.850'), (1, '4911.587')] [2023-12-26 00:09:18,818][123090] Updated weights for policy 1, policy_version 71635 (0.0011) [2023-12-26 00:09:18,886][123090] Updated weights for policy 1, policy_version 71645 (0.0011) [2023-12-26 00:09:19,548][123091] Updated weights for policy 0, policy_version 72002 (0.0010) [2023-12-26 00:09:19,597][123091] Updated weights for policy 0, policy_version 72012 (0.0009) [2023-12-26 00:09:19,658][123091] Updated weights for policy 0, policy_version 72022 (0.0009) [2023-12-26 00:09:19,697][123090] Updated weights for policy 1, policy_version 71655 (0.0009) [2023-12-26 00:09:19,714][123091] Updated weights for policy 0, policy_version 72032 (0.0010) [2023-12-26 00:09:19,753][123090] Updated weights for policy 1, policy_version 71665 (0.0010) [2023-12-26 00:09:19,805][123090] Updated weights for policy 1, policy_version 71675 (0.0010) [2023-12-26 00:09:20,602][123091] Updated weights for policy 0, policy_version 72042 (0.0011) [2023-12-26 00:09:20,656][123090] Updated weights for policy 1, policy_version 71685 (0.0011) [2023-12-26 00:09:20,663][123091] Updated weights for policy 0, policy_version 72052 (0.0011) [2023-12-26 00:09:20,721][123090] Updated weights for policy 1, policy_version 71695 (0.0011) [2023-12-26 00:09:20,730][123091] Updated weights for policy 0, policy_version 72062 (0.0011) [2023-12-26 00:09:20,778][123090] Updated weights for policy 1, policy_version 71705 (0.0010) [2023-12-26 00:09:21,554][123091] Updated weights for policy 0, policy_version 72072 (0.0011) [2023-12-26 00:09:21,620][123091] Updated weights for policy 0, policy_version 72082 (0.0009) [2023-12-26 00:09:21,646][123090] Updated weights for policy 1, policy_version 71715 (0.0011) [2023-12-26 00:09:21,681][123091] Updated weights for policy 0, policy_version 72092 (0.0007) [2023-12-26 00:09:21,705][123090] Updated weights for policy 1, policy_version 71725 (0.0010) [2023-12-26 00:09:21,773][123090] Updated weights for policy 1, policy_version 71735 (0.0013) [2023-12-26 00:09:22,452][123091] Updated weights for policy 0, policy_version 72102 (0.0006) [2023-12-26 00:09:22,528][123091] Updated weights for policy 0, policy_version 72112 (0.0005) [2023-12-26 00:09:22,601][123091] Updated weights for policy 0, policy_version 72122 (0.0006) [2023-12-26 00:09:22,610][123090] Updated weights for policy 1, policy_version 71745 (0.0010) [2023-12-26 00:09:22,666][123090] Updated weights for policy 1, policy_version 71755 (0.0008) [2023-12-26 00:09:22,741][123090] Updated weights for policy 1, policy_version 71765 (0.0009) [2023-12-26 00:09:22,809][123090] Updated weights for policy 1, policy_version 71775 (0.0009) [2023-12-26 00:09:23,355][123091] Updated weights for policy 0, policy_version 72132 (0.0008) [2023-12-26 00:09:23,422][123091] Updated weights for policy 0, policy_version 72142 (0.0011) [2023-12-26 00:09:23,484][123091] Updated weights for policy 0, policy_version 72152 (0.0011) [2023-12-26 00:09:23,632][123090] Updated weights for policy 1, policy_version 71785 (0.0009) [2023-12-26 00:09:23,681][123090] Updated weights for policy 1, policy_version 71795 (0.0009) [2023-12-26 00:09:23,733][123090] Updated weights for policy 1, policy_version 71805 (0.0009) [2023-12-26 00:09:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.2, 300 sec: 16772.8). Total num frames: 36855808. Throughput: 0: 8862.5, 1: 8815.7. Samples: 36827304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:09:23,785][121949] Avg episode reward: [(0, '4437.721'), (1, '5252.541')] [2023-12-26 00:09:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000071808_18382848.pth... [2023-12-26 00:09:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000072160_18472960.pth... [2023-12-26 00:09:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000071104_18202624.pth [2023-12-26 00:09:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000070752_18112512.pth [2023-12-26 00:09:24,172][123091] Updated weights for policy 0, policy_version 72162 (0.0010) [2023-12-26 00:09:24,238][123091] Updated weights for policy 0, policy_version 72172 (0.0009) [2023-12-26 00:09:24,296][123091] Updated weights for policy 0, policy_version 72182 (0.0011) [2023-12-26 00:09:24,365][123091] Updated weights for policy 0, policy_version 72192 (0.0010) [2023-12-26 00:09:24,646][123090] Updated weights for policy 1, policy_version 71815 (0.0009) [2023-12-26 00:09:24,703][123090] Updated weights for policy 1, policy_version 71825 (0.0008) [2023-12-26 00:09:24,762][123090] Updated weights for policy 1, policy_version 71835 (0.0009) [2023-12-26 00:09:25,090][123091] Updated weights for policy 0, policy_version 72202 (0.0009) [2023-12-26 00:09:25,145][123091] Updated weights for policy 0, policy_version 72212 (0.0011) [2023-12-26 00:09:25,192][123091] Updated weights for policy 0, policy_version 72222 (0.0011) [2023-12-26 00:09:25,591][123090] Updated weights for policy 1, policy_version 71845 (0.0009) [2023-12-26 00:09:25,648][123090] Updated weights for policy 1, policy_version 71855 (0.0009) [2023-12-26 00:09:25,705][123090] Updated weights for policy 1, policy_version 71865 (0.0010) [2023-12-26 00:09:25,973][123091] Updated weights for policy 0, policy_version 72232 (0.0006) [2023-12-26 00:09:26,023][123091] Updated weights for policy 0, policy_version 72242 (0.0005) [2023-12-26 00:09:26,087][123091] Updated weights for policy 0, policy_version 72252 (0.0005) [2023-12-26 00:09:26,563][123090] Updated weights for policy 1, policy_version 71875 (0.0010) [2023-12-26 00:09:26,611][123090] Updated weights for policy 1, policy_version 71885 (0.0009) [2023-12-26 00:09:26,665][123090] Updated weights for policy 1, policy_version 71895 (0.0009) [2023-12-26 00:09:26,793][123091] Updated weights for policy 0, policy_version 72262 (0.0008) [2023-12-26 00:09:26,856][123091] Updated weights for policy 0, policy_version 72272 (0.0008) [2023-12-26 00:09:26,919][123091] Updated weights for policy 0, policy_version 72282 (0.0009) [2023-12-26 00:09:27,517][123090] Updated weights for policy 1, policy_version 71905 (0.0010) [2023-12-26 00:09:27,565][123090] Updated weights for policy 1, policy_version 71916 (0.0010) [2023-12-26 00:09:27,615][123090] Updated weights for policy 1, policy_version 71926 (0.0009) [2023-12-26 00:09:27,663][123090] Updated weights for policy 1, policy_version 71936 (0.0009) [2023-12-26 00:09:27,701][123091] Updated weights for policy 0, policy_version 72292 (0.0009) [2023-12-26 00:09:27,769][123091] Updated weights for policy 0, policy_version 72302 (0.0007) [2023-12-26 00:09:27,831][123091] Updated weights for policy 0, policy_version 72312 (0.0009) [2023-12-26 00:09:28,555][123090] Updated weights for policy 1, policy_version 71946 (0.0010) [2023-12-26 00:09:28,573][123091] Updated weights for policy 0, policy_version 72322 (0.0009) [2023-12-26 00:09:28,622][123090] Updated weights for policy 1, policy_version 71956 (0.0007) [2023-12-26 00:09:28,629][123091] Updated weights for policy 0, policy_version 72332 (0.0009) [2023-12-26 00:09:28,680][123091] Updated weights for policy 0, policy_version 72342 (0.0009) [2023-12-26 00:09:28,683][123090] Updated weights for policy 1, policy_version 71966 (0.0008) [2023-12-26 00:09:28,747][123091] Updated weights for policy 0, policy_version 72352 (0.0010) [2023-12-26 00:09:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 16800.5). Total num frames: 36945920. Throughput: 0: 9018.8, 1: 8839.0. Samples: 36933944. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:28,785][121949] Avg episode reward: [(0, '4464.579'), (1, '5321.109')] [2023-12-26 00:09:28,785][123007] Saving new best policy, reward=4464.579! [2023-12-26 00:09:29,523][123091] Updated weights for policy 0, policy_version 72362 (0.0008) [2023-12-26 00:09:29,526][123090] Updated weights for policy 1, policy_version 71976 (0.0007) [2023-12-26 00:09:29,578][123091] Updated weights for policy 0, policy_version 72372 (0.0006) [2023-12-26 00:09:29,587][123090] Updated weights for policy 1, policy_version 71986 (0.0008) [2023-12-26 00:09:29,636][123091] Updated weights for policy 0, policy_version 72382 (0.0006) [2023-12-26 00:09:29,651][123090] Updated weights for policy 1, policy_version 71996 (0.0009) [2023-12-26 00:09:30,365][123091] Updated weights for policy 0, policy_version 72392 (0.0006) [2023-12-26 00:09:30,419][123091] Updated weights for policy 0, policy_version 72402 (0.0005) [2023-12-26 00:09:30,478][123091] Updated weights for policy 0, policy_version 72412 (0.0005) [2023-12-26 00:09:30,564][123090] Updated weights for policy 1, policy_version 72006 (0.0010) [2023-12-26 00:09:30,623][123090] Updated weights for policy 1, policy_version 72017 (0.0010) [2023-12-26 00:09:30,677][123090] Updated weights for policy 1, policy_version 72027 (0.0010) [2023-12-26 00:09:31,164][123091] Updated weights for policy 0, policy_version 72422 (0.0008) [2023-12-26 00:09:31,230][123091] Updated weights for policy 0, policy_version 72432 (0.0010) [2023-12-26 00:09:31,299][123091] Updated weights for policy 0, policy_version 72442 (0.0010) [2023-12-26 00:09:31,577][123090] Updated weights for policy 1, policy_version 72037 (0.0010) [2023-12-26 00:09:31,636][123090] Updated weights for policy 1, policy_version 72047 (0.0010) [2023-12-26 00:09:31,704][123090] Updated weights for policy 1, policy_version 72057 (0.0009) [2023-12-26 00:09:32,138][123091] Updated weights for policy 0, policy_version 72452 (0.0009) [2023-12-26 00:09:32,195][123091] Updated weights for policy 0, policy_version 72462 (0.0007) [2023-12-26 00:09:32,244][123091] Updated weights for policy 0, policy_version 72472 (0.0009) [2023-12-26 00:09:32,563][123090] Updated weights for policy 1, policy_version 72067 (0.0008) [2023-12-26 00:09:32,632][123090] Updated weights for policy 1, policy_version 72077 (0.0005) [2023-12-26 00:09:32,702][123090] Updated weights for policy 1, policy_version 72087 (0.0005) [2023-12-26 00:09:32,942][123091] Updated weights for policy 0, policy_version 72482 (0.0007) [2023-12-26 00:09:33,014][123091] Updated weights for policy 0, policy_version 72492 (0.0005) [2023-12-26 00:09:33,088][123091] Updated weights for policy 0, policy_version 72502 (0.0005) [2023-12-26 00:09:33,158][123091] Updated weights for policy 0, policy_version 72512 (0.0006) [2023-12-26 00:09:33,411][123090] Updated weights for policy 1, policy_version 72097 (0.0009) [2023-12-26 00:09:33,464][123090] Updated weights for policy 1, policy_version 72107 (0.0010) [2023-12-26 00:09:33,526][123090] Updated weights for policy 1, policy_version 72117 (0.0010) [2023-12-26 00:09:33,601][123090] Updated weights for policy 1, policy_version 72127 (0.0010) [2023-12-26 00:09:33,692][123091] Updated weights for policy 0, policy_version 72522 (0.0009) [2023-12-26 00:09:33,752][123091] Updated weights for policy 0, policy_version 72532 (0.0009) [2023-12-26 00:09:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 16800.6). Total num frames: 37027840. Throughput: 0: 9074.2, 1: 8789.0. Samples: 37040160. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:33,784][121949] Avg episode reward: [(0, '4539.546'), (1, '5310.158')] [2023-12-26 00:09:33,812][123091] Updated weights for policy 0, policy_version 72542 (0.0009) [2023-12-26 00:09:33,820][123007] Saving new best policy, reward=4539.546! [2023-12-26 00:09:34,357][123090] Updated weights for policy 1, policy_version 72137 (0.0009) [2023-12-26 00:09:34,414][123090] Updated weights for policy 1, policy_version 72147 (0.0009) [2023-12-26 00:09:34,482][123090] Updated weights for policy 1, policy_version 72157 (0.0010) [2023-12-26 00:09:34,602][123091] Updated weights for policy 0, policy_version 72552 (0.0010) [2023-12-26 00:09:34,656][123091] Updated weights for policy 0, policy_version 72562 (0.0009) [2023-12-26 00:09:34,716][123091] Updated weights for policy 0, policy_version 72572 (0.0010) [2023-12-26 00:09:35,319][123090] Updated weights for policy 1, policy_version 72167 (0.0010) [2023-12-26 00:09:35,370][123090] Updated weights for policy 1, policy_version 72177 (0.0010) [2023-12-26 00:09:35,421][123090] Updated weights for policy 1, policy_version 72187 (0.0010) [2023-12-26 00:09:35,522][123091] Updated weights for policy 0, policy_version 72582 (0.0009) [2023-12-26 00:09:35,581][123091] Updated weights for policy 0, policy_version 72592 (0.0009) [2023-12-26 00:09:35,640][123091] Updated weights for policy 0, policy_version 72602 (0.0009) [2023-12-26 00:09:36,217][123090] Updated weights for policy 1, policy_version 72197 (0.0009) [2023-12-26 00:09:36,288][123090] Updated weights for policy 1, policy_version 72207 (0.0007) [2023-12-26 00:09:36,359][123090] Updated weights for policy 1, policy_version 72217 (0.0006) [2023-12-26 00:09:36,407][123091] Updated weights for policy 0, policy_version 72612 (0.0009) [2023-12-26 00:09:36,465][123091] Updated weights for policy 0, policy_version 72622 (0.0010) [2023-12-26 00:09:36,520][123091] Updated weights for policy 0, policy_version 72632 (0.0010) [2023-12-26 00:09:37,048][123090] Updated weights for policy 1, policy_version 72227 (0.0007) [2023-12-26 00:09:37,120][123090] Updated weights for policy 1, policy_version 72237 (0.0006) [2023-12-26 00:09:37,190][123090] Updated weights for policy 1, policy_version 72247 (0.0005) [2023-12-26 00:09:37,435][123091] Updated weights for policy 0, policy_version 72642 (0.0008) [2023-12-26 00:09:37,503][123091] Updated weights for policy 0, policy_version 72652 (0.0006) [2023-12-26 00:09:37,561][123091] Updated weights for policy 0, policy_version 72662 (0.0010) [2023-12-26 00:09:37,612][123091] Updated weights for policy 0, policy_version 72672 (0.0010) [2023-12-26 00:09:37,901][123090] Updated weights for policy 1, policy_version 72257 (0.0005) [2023-12-26 00:09:37,968][123090] Updated weights for policy 1, policy_version 72267 (0.0006) [2023-12-26 00:09:38,026][123090] Updated weights for policy 1, policy_version 72277 (0.0005) [2023-12-26 00:09:38,091][123090] Updated weights for policy 1, policy_version 72287 (0.0007) [2023-12-26 00:09:38,291][123091] Updated weights for policy 0, policy_version 72682 (0.0005) [2023-12-26 00:09:38,359][123091] Updated weights for policy 0, policy_version 72693 (0.0007) [2023-12-26 00:09:38,432][123091] Updated weights for policy 0, policy_version 72703 (0.0006) [2023-12-26 00:09:38,730][123090] Updated weights for policy 1, policy_version 72297 (0.0006) [2023-12-26 00:09:38,785][121949] Fps is (10 sec: 17202.3, 60 sec: 17749.3, 300 sec: 16828.3). Total num frames: 37117952. Throughput: 0: 9070.0, 1: 8835.0. Samples: 37093744. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:38,785][121949] Avg episode reward: [(0, '4515.647'), (1, '5151.712')] [2023-12-26 00:09:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000072704_18612224.pth... [2023-12-26 00:09:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000071648_18341888.pth [2023-12-26 00:09:38,799][123090] Updated weights for policy 1, policy_version 72307 (0.0006) [2023-12-26 00:09:38,864][123090] Updated weights for policy 1, policy_version 72317 (0.0009) [2023-12-26 00:09:38,880][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000072320_18513920.pth... [2023-12-26 00:09:38,883][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000071264_18243584.pth [2023-12-26 00:09:39,210][123091] Updated weights for policy 0, policy_version 72713 (0.0010) [2023-12-26 00:09:39,281][123091] Updated weights for policy 0, policy_version 72723 (0.0011) [2023-12-26 00:09:39,333][123091] Updated weights for policy 0, policy_version 72733 (0.0011) [2023-12-26 00:09:39,590][123090] Updated weights for policy 1, policy_version 72327 (0.0007) [2023-12-26 00:09:39,660][123090] Updated weights for policy 1, policy_version 72337 (0.0006) [2023-12-26 00:09:39,712][123090] Updated weights for policy 1, policy_version 72347 (0.0010) [2023-12-26 00:09:40,222][123091] Updated weights for policy 0, policy_version 72743 (0.0010) [2023-12-26 00:09:40,280][123091] Updated weights for policy 0, policy_version 72753 (0.0010) [2023-12-26 00:09:40,343][123091] Updated weights for policy 0, policy_version 72763 (0.0010) [2023-12-26 00:09:40,450][123090] Updated weights for policy 1, policy_version 72357 (0.0008) [2023-12-26 00:09:40,522][123090] Updated weights for policy 1, policy_version 72367 (0.0006) [2023-12-26 00:09:40,589][123090] Updated weights for policy 1, policy_version 72377 (0.0010) [2023-12-26 00:09:41,280][123091] Updated weights for policy 0, policy_version 72773 (0.0010) [2023-12-26 00:09:41,349][123091] Updated weights for policy 0, policy_version 72783 (0.0009) [2023-12-26 00:09:41,374][123090] Updated weights for policy 1, policy_version 72387 (0.0010) [2023-12-26 00:09:41,420][123091] Updated weights for policy 0, policy_version 72793 (0.0009) [2023-12-26 00:09:41,447][123090] Updated weights for policy 1, policy_version 72397 (0.0011) [2023-12-26 00:09:41,523][123090] Updated weights for policy 1, policy_version 72407 (0.0010) [2023-12-26 00:09:42,281][123090] Updated weights for policy 1, policy_version 72417 (0.0006) [2023-12-26 00:09:42,300][123091] Updated weights for policy 0, policy_version 72803 (0.0008) [2023-12-26 00:09:42,348][123090] Updated weights for policy 1, policy_version 72427 (0.0008) [2023-12-26 00:09:42,372][123091] Updated weights for policy 0, policy_version 72813 (0.0009) [2023-12-26 00:09:42,416][123090] Updated weights for policy 1, policy_version 72437 (0.0008) [2023-12-26 00:09:42,430][123091] Updated weights for policy 0, policy_version 72823 (0.0010) [2023-12-26 00:09:42,477][123090] Updated weights for policy 1, policy_version 72447 (0.0008) [2023-12-26 00:09:43,260][123090] Updated weights for policy 1, policy_version 72457 (0.0008) [2023-12-26 00:09:43,287][123091] Updated weights for policy 0, policy_version 72833 (0.0008) [2023-12-26 00:09:43,325][123090] Updated weights for policy 1, policy_version 72467 (0.0009) [2023-12-26 00:09:43,344][123091] Updated weights for policy 0, policy_version 72843 (0.0009) [2023-12-26 00:09:43,380][123090] Updated weights for policy 1, policy_version 72477 (0.0008) [2023-12-26 00:09:43,408][123091] Updated weights for policy 0, policy_version 72853 (0.0009) [2023-12-26 00:09:43,476][123091] Updated weights for policy 0, policy_version 72863 (0.0009) [2023-12-26 00:09:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 16828.3). Total num frames: 37208064. Throughput: 0: 8987.2, 1: 8984.1. Samples: 37200712. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:43,785][121949] Avg episode reward: [(0, '4462.022'), (1, '5189.478')] [2023-12-26 00:09:44,078][123090] Updated weights for policy 1, policy_version 72487 (0.0007) [2023-12-26 00:09:44,137][123090] Updated weights for policy 1, policy_version 72497 (0.0007) [2023-12-26 00:09:44,171][123091] Updated weights for policy 0, policy_version 72873 (0.0009) [2023-12-26 00:09:44,202][123090] Updated weights for policy 1, policy_version 72507 (0.0005) [2023-12-26 00:09:44,238][123091] Updated weights for policy 0, policy_version 72883 (0.0010) [2023-12-26 00:09:44,291][123091] Updated weights for policy 0, policy_version 72893 (0.0009) [2023-12-26 00:09:44,895][123090] Updated weights for policy 1, policy_version 72517 (0.0007) [2023-12-26 00:09:44,965][123090] Updated weights for policy 1, policy_version 72527 (0.0010) [2023-12-26 00:09:45,028][123090] Updated weights for policy 1, policy_version 72537 (0.0008) [2023-12-26 00:09:45,052][123091] Updated weights for policy 0, policy_version 72903 (0.0010) [2023-12-26 00:09:45,113][123091] Updated weights for policy 0, policy_version 72913 (0.0009) [2023-12-26 00:09:45,181][123091] Updated weights for policy 0, policy_version 72923 (0.0009) [2023-12-26 00:09:45,846][123090] Updated weights for policy 1, policy_version 72547 (0.0008) [2023-12-26 00:09:45,899][123090] Updated weights for policy 1, policy_version 72557 (0.0009) [2023-12-26 00:09:45,950][123090] Updated weights for policy 1, policy_version 72567 (0.0009) [2023-12-26 00:09:46,030][123091] Updated weights for policy 0, policy_version 72933 (0.0009) [2023-12-26 00:09:46,089][123091] Updated weights for policy 0, policy_version 72943 (0.0009) [2023-12-26 00:09:46,149][123091] Updated weights for policy 0, policy_version 72953 (0.0008) [2023-12-26 00:09:46,800][123090] Updated weights for policy 1, policy_version 72577 (0.0009) [2023-12-26 00:09:46,848][123090] Updated weights for policy 1, policy_version 72587 (0.0009) [2023-12-26 00:09:46,904][123090] Updated weights for policy 1, policy_version 72597 (0.0009) [2023-12-26 00:09:46,956][123090] Updated weights for policy 1, policy_version 72607 (0.0009) [2023-12-26 00:09:46,984][123091] Updated weights for policy 0, policy_version 72963 (0.0009) [2023-12-26 00:09:47,050][123091] Updated weights for policy 0, policy_version 72973 (0.0009) [2023-12-26 00:09:47,114][123091] Updated weights for policy 0, policy_version 72983 (0.0009) [2023-12-26 00:09:47,732][123090] Updated weights for policy 1, policy_version 72617 (0.0006) [2023-12-26 00:09:47,790][123090] Updated weights for policy 1, policy_version 72627 (0.0005) [2023-12-26 00:09:47,850][123090] Updated weights for policy 1, policy_version 72637 (0.0005) [2023-12-26 00:09:47,867][123091] Updated weights for policy 0, policy_version 72993 (0.0010) [2023-12-26 00:09:47,917][123091] Updated weights for policy 0, policy_version 73003 (0.0009) [2023-12-26 00:09:47,973][123091] Updated weights for policy 0, policy_version 73013 (0.0009) [2023-12-26 00:09:48,020][123091] Updated weights for policy 0, policy_version 73023 (0.0008) [2023-12-26 00:09:48,532][123090] Updated weights for policy 1, policy_version 72647 (0.0006) [2023-12-26 00:09:48,588][123090] Updated weights for policy 1, policy_version 72657 (0.0009) [2023-12-26 00:09:48,654][123090] Updated weights for policy 1, policy_version 72667 (0.0008) [2023-12-26 00:09:48,784][121949] Fps is (10 sec: 18023.4, 60 sec: 18022.4, 300 sec: 16856.1). Total num frames: 37298176. Throughput: 0: 9048.1, 1: 9025.0. Samples: 37309248. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:48,785][121949] Avg episode reward: [(0, '4554.555'), (1, '5166.924')] [2023-12-26 00:09:48,785][123007] Saving new best policy, reward=4554.555! [2023-12-26 00:09:48,895][123091] Updated weights for policy 0, policy_version 73033 (0.0010) [2023-12-26 00:09:48,961][123091] Updated weights for policy 0, policy_version 73043 (0.0010) [2023-12-26 00:09:49,021][123091] Updated weights for policy 0, policy_version 73053 (0.0009) [2023-12-26 00:09:49,477][123090] Updated weights for policy 1, policy_version 72677 (0.0007) [2023-12-26 00:09:49,541][123090] Updated weights for policy 1, policy_version 72687 (0.0006) [2023-12-26 00:09:49,609][123090] Updated weights for policy 1, policy_version 72697 (0.0005) [2023-12-26 00:09:49,870][123091] Updated weights for policy 0, policy_version 73063 (0.0010) [2023-12-26 00:09:49,935][123091] Updated weights for policy 0, policy_version 73073 (0.0010) [2023-12-26 00:09:50,004][123091] Updated weights for policy 0, policy_version 73083 (0.0009) [2023-12-26 00:09:50,436][123090] Updated weights for policy 1, policy_version 72707 (0.0007) [2023-12-26 00:09:50,490][123090] Updated weights for policy 1, policy_version 72717 (0.0010) [2023-12-26 00:09:50,549][123090] Updated weights for policy 1, policy_version 72727 (0.0010) [2023-12-26 00:09:50,690][123091] Updated weights for policy 0, policy_version 73093 (0.0007) [2023-12-26 00:09:50,751][123091] Updated weights for policy 0, policy_version 73103 (0.0006) [2023-12-26 00:09:50,817][123091] Updated weights for policy 0, policy_version 73113 (0.0005) [2023-12-26 00:09:51,333][123090] Updated weights for policy 1, policy_version 72737 (0.0007) [2023-12-26 00:09:51,407][123090] Updated weights for policy 1, policy_version 72747 (0.0008) [2023-12-26 00:09:51,471][123090] Updated weights for policy 1, policy_version 72757 (0.0007) [2023-12-26 00:09:51,532][123090] Updated weights for policy 1, policy_version 72767 (0.0007) [2023-12-26 00:09:51,599][123091] Updated weights for policy 0, policy_version 73123 (0.0007) [2023-12-26 00:09:51,674][123091] Updated weights for policy 0, policy_version 73133 (0.0011) [2023-12-26 00:09:51,736][123091] Updated weights for policy 0, policy_version 73143 (0.0010) [2023-12-26 00:09:52,331][123090] Updated weights for policy 1, policy_version 72777 (0.0009) [2023-12-26 00:09:52,404][123090] Updated weights for policy 1, policy_version 72787 (0.0010) [2023-12-26 00:09:52,407][123091] Updated weights for policy 0, policy_version 73153 (0.0009) [2023-12-26 00:09:52,461][123091] Updated weights for policy 0, policy_version 73163 (0.0005) [2023-12-26 00:09:52,474][123090] Updated weights for policy 1, policy_version 72797 (0.0009) [2023-12-26 00:09:52,519][123091] Updated weights for policy 0, policy_version 73173 (0.0005) [2023-12-26 00:09:52,588][123091] Updated weights for policy 0, policy_version 73183 (0.0007) [2023-12-26 00:09:53,234][123090] Updated weights for policy 1, policy_version 72807 (0.0009) [2023-12-26 00:09:53,283][123090] Updated weights for policy 1, policy_version 72817 (0.0009) [2023-12-26 00:09:53,334][123090] Updated weights for policy 1, policy_version 72827 (0.0008) [2023-12-26 00:09:53,372][123091] Updated weights for policy 0, policy_version 73193 (0.0010) [2023-12-26 00:09:53,433][123091] Updated weights for policy 0, policy_version 73203 (0.0010) [2023-12-26 00:09:53,491][123091] Updated weights for policy 0, policy_version 73213 (0.0010) [2023-12-26 00:09:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 16883.9). Total num frames: 37388288. Throughput: 0: 8997.8, 1: 8984.0. Samples: 37362724. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:53,785][121949] Avg episode reward: [(0, '4508.138'), (1, '5209.129')] [2023-12-26 00:09:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000073216_18743296.pth... [2023-12-26 00:09:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000072832_18644992.pth... [2023-12-26 00:09:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000071808_18382848.pth [2023-12-26 00:09:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000072160_18472960.pth [2023-12-26 00:09:54,129][123090] Updated weights for policy 1, policy_version 72837 (0.0008) [2023-12-26 00:09:54,184][123090] Updated weights for policy 1, policy_version 72847 (0.0006) [2023-12-26 00:09:54,239][123090] Updated weights for policy 1, policy_version 72857 (0.0009) [2023-12-26 00:09:54,321][123091] Updated weights for policy 0, policy_version 73223 (0.0010) [2023-12-26 00:09:54,379][123091] Updated weights for policy 0, policy_version 73233 (0.0010) [2023-12-26 00:09:54,447][123091] Updated weights for policy 0, policy_version 73243 (0.0010) [2023-12-26 00:09:55,026][123090] Updated weights for policy 1, policy_version 72867 (0.0009) [2023-12-26 00:09:55,086][123090] Updated weights for policy 1, policy_version 72877 (0.0009) [2023-12-26 00:09:55,137][123090] Updated weights for policy 1, policy_version 72887 (0.0009) [2023-12-26 00:09:55,256][123091] Updated weights for policy 0, policy_version 73253 (0.0010) [2023-12-26 00:09:55,318][123091] Updated weights for policy 0, policy_version 73263 (0.0010) [2023-12-26 00:09:55,391][123091] Updated weights for policy 0, policy_version 73273 (0.0011) [2023-12-26 00:09:55,973][123090] Updated weights for policy 1, policy_version 72897 (0.0009) [2023-12-26 00:09:56,044][123090] Updated weights for policy 1, policy_version 72907 (0.0008) [2023-12-26 00:09:56,108][123090] Updated weights for policy 1, policy_version 72917 (0.0009) [2023-12-26 00:09:56,172][123090] Updated weights for policy 1, policy_version 72927 (0.0009) [2023-12-26 00:09:56,190][123091] Updated weights for policy 0, policy_version 73283 (0.0010) [2023-12-26 00:09:56,237][123091] Updated weights for policy 0, policy_version 73293 (0.0010) [2023-12-26 00:09:56,284][123091] Updated weights for policy 0, policy_version 73303 (0.0010) [2023-12-26 00:09:57,005][123090] Updated weights for policy 1, policy_version 72937 (0.0008) [2023-12-26 00:09:57,071][123090] Updated weights for policy 1, policy_version 72947 (0.0009) [2023-12-26 00:09:57,121][123091] Updated weights for policy 0, policy_version 73313 (0.0010) [2023-12-26 00:09:57,130][123090] Updated weights for policy 1, policy_version 72957 (0.0009) [2023-12-26 00:09:57,179][123091] Updated weights for policy 0, policy_version 73323 (0.0010) [2023-12-26 00:09:57,241][123091] Updated weights for policy 0, policy_version 73333 (0.0010) [2023-12-26 00:09:57,303][123091] Updated weights for policy 0, policy_version 73343 (0.0010) [2023-12-26 00:09:58,025][123091] Updated weights for policy 0, policy_version 73353 (0.0009) [2023-12-26 00:09:58,054][123090] Updated weights for policy 1, policy_version 72967 (0.0009) [2023-12-26 00:09:58,088][123091] Updated weights for policy 0, policy_version 73363 (0.0009) [2023-12-26 00:09:58,125][123090] Updated weights for policy 1, policy_version 72977 (0.0007) [2023-12-26 00:09:58,151][123091] Updated weights for policy 0, policy_version 73373 (0.0010) [2023-12-26 00:09:58,191][123090] Updated weights for policy 1, policy_version 72987 (0.0007) [2023-12-26 00:09:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 16883.9). Total num frames: 37470208. Throughput: 0: 9021.9, 1: 8915.2. Samples: 37467616. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:09:58,784][121949] Avg episode reward: [(0, '4407.975'), (1, '5378.515')] [2023-12-26 00:09:59,035][123090] Updated weights for policy 1, policy_version 72997 (0.0009) [2023-12-26 00:09:59,047][123091] Updated weights for policy 0, policy_version 73383 (0.0008) [2023-12-26 00:09:59,100][123090] Updated weights for policy 1, policy_version 73007 (0.0009) [2023-12-26 00:09:59,106][123091] Updated weights for policy 0, policy_version 73393 (0.0008) [2023-12-26 00:09:59,158][123090] Updated weights for policy 1, policy_version 73017 (0.0005) [2023-12-26 00:09:59,164][123091] Updated weights for policy 0, policy_version 73403 (0.0007) [2023-12-26 00:09:59,969][123091] Updated weights for policy 0, policy_version 73413 (0.0009) [2023-12-26 00:10:00,004][123090] Updated weights for policy 1, policy_version 73027 (0.0009) [2023-12-26 00:10:00,033][123091] Updated weights for policy 0, policy_version 73423 (0.0010) [2023-12-26 00:10:00,066][123090] Updated weights for policy 1, policy_version 73037 (0.0007) [2023-12-26 00:10:00,092][123091] Updated weights for policy 0, policy_version 73433 (0.0010) [2023-12-26 00:10:00,127][123090] Updated weights for policy 1, policy_version 73047 (0.0010) [2023-12-26 00:10:00,712][123091] Updated weights for policy 0, policy_version 73443 (0.0009) [2023-12-26 00:10:00,767][123091] Updated weights for policy 0, policy_version 73453 (0.0005) [2023-12-26 00:10:00,816][123091] Updated weights for policy 0, policy_version 73463 (0.0010) [2023-12-26 00:10:00,979][123090] Updated weights for policy 1, policy_version 73057 (0.0009) [2023-12-26 00:10:01,043][123090] Updated weights for policy 1, policy_version 73067 (0.0009) [2023-12-26 00:10:01,096][123090] Updated weights for policy 1, policy_version 73077 (0.0009) [2023-12-26 00:10:01,160][123090] Updated weights for policy 1, policy_version 73087 (0.0009) [2023-12-26 00:10:01,513][123091] Updated weights for policy 0, policy_version 73473 (0.0010) [2023-12-26 00:10:01,573][123091] Updated weights for policy 0, policy_version 73483 (0.0005) [2023-12-26 00:10:01,639][123091] Updated weights for policy 0, policy_version 73493 (0.0007) [2023-12-26 00:10:01,701][123091] Updated weights for policy 0, policy_version 73503 (0.0010) [2023-12-26 00:10:02,096][123090] Updated weights for policy 1, policy_version 73097 (0.0009) [2023-12-26 00:10:02,152][123090] Updated weights for policy 1, policy_version 73107 (0.0010) [2023-12-26 00:10:02,221][123090] Updated weights for policy 1, policy_version 73117 (0.0009) [2023-12-26 00:10:02,381][123091] Updated weights for policy 0, policy_version 73513 (0.0011) [2023-12-26 00:10:02,445][123091] Updated weights for policy 0, policy_version 73523 (0.0011) [2023-12-26 00:10:02,516][123091] Updated weights for policy 0, policy_version 73533 (0.0011) [2023-12-26 00:10:03,085][123090] Updated weights for policy 1, policy_version 73127 (0.0006) [2023-12-26 00:10:03,151][123091] Updated weights for policy 0, policy_version 73543 (0.0007) [2023-12-26 00:10:03,152][123090] Updated weights for policy 1, policy_version 73137 (0.0006) [2023-12-26 00:10:03,201][123091] Updated weights for policy 0, policy_version 73553 (0.0005) [2023-12-26 00:10:03,211][123090] Updated weights for policy 1, policy_version 73147 (0.0009) [2023-12-26 00:10:03,249][123091] Updated weights for policy 0, policy_version 73563 (0.0005) [2023-12-26 00:10:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 16911.6). Total num frames: 37560320. Throughput: 0: 9014.6, 1: 8671.5. Samples: 37573472. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:10:03,784][121949] Avg episode reward: [(0, '4449.365'), (1, '5423.814')] [2023-12-26 00:10:03,974][123091] Updated weights for policy 0, policy_version 73573 (0.0008) [2023-12-26 00:10:04,033][123091] Updated weights for policy 0, policy_version 73583 (0.0011) [2023-12-26 00:10:04,033][123090] Updated weights for policy 1, policy_version 73157 (0.0009) [2023-12-26 00:10:04,093][123091] Updated weights for policy 0, policy_version 73593 (0.0011) [2023-12-26 00:10:04,096][123090] Updated weights for policy 1, policy_version 73167 (0.0007) [2023-12-26 00:10:04,158][123090] Updated weights for policy 1, policy_version 73177 (0.0008) [2023-12-26 00:10:04,909][123091] Updated weights for policy 0, policy_version 73603 (0.0009) [2023-12-26 00:10:04,956][123091] Updated weights for policy 0, policy_version 73613 (0.0005) [2023-12-26 00:10:05,013][123091] Updated weights for policy 0, policy_version 73623 (0.0006) [2023-12-26 00:10:05,023][123090] Updated weights for policy 1, policy_version 73187 (0.0008) [2023-12-26 00:10:05,087][123090] Updated weights for policy 1, policy_version 73197 (0.0009) [2023-12-26 00:10:05,145][123090] Updated weights for policy 1, policy_version 73207 (0.0010) [2023-12-26 00:10:05,663][123091] Updated weights for policy 0, policy_version 73633 (0.0005) [2023-12-26 00:10:05,716][123091] Updated weights for policy 0, policy_version 73643 (0.0005) [2023-12-26 00:10:05,767][123091] Updated weights for policy 0, policy_version 73653 (0.0005) [2023-12-26 00:10:05,819][123091] Updated weights for policy 0, policy_version 73663 (0.0005) [2023-12-26 00:10:06,002][123090] Updated weights for policy 1, policy_version 73217 (0.0009) [2023-12-26 00:10:06,054][123090] Updated weights for policy 1, policy_version 73227 (0.0005) [2023-12-26 00:10:06,115][123090] Updated weights for policy 1, policy_version 73237 (0.0006) [2023-12-26 00:10:06,188][123090] Updated weights for policy 1, policy_version 73247 (0.0008) [2023-12-26 00:10:06,541][123091] Updated weights for policy 0, policy_version 73673 (0.0006) [2023-12-26 00:10:06,613][123091] Updated weights for policy 0, policy_version 73683 (0.0007) [2023-12-26 00:10:06,678][123091] Updated weights for policy 0, policy_version 73693 (0.0009) [2023-12-26 00:10:07,021][123090] Updated weights for policy 1, policy_version 73257 (0.0009) [2023-12-26 00:10:07,085][123090] Updated weights for policy 1, policy_version 73267 (0.0009) [2023-12-26 00:10:07,145][123090] Updated weights for policy 1, policy_version 73277 (0.0009) [2023-12-26 00:10:07,465][123091] Updated weights for policy 0, policy_version 73703 (0.0011) [2023-12-26 00:10:07,527][123091] Updated weights for policy 0, policy_version 73713 (0.0006) [2023-12-26 00:10:07,589][123091] Updated weights for policy 0, policy_version 73723 (0.0006) [2023-12-26 00:10:08,001][123090] Updated weights for policy 1, policy_version 73287 (0.0009) [2023-12-26 00:10:08,066][123090] Updated weights for policy 1, policy_version 73297 (0.0009) [2023-12-26 00:10:08,132][123090] Updated weights for policy 1, policy_version 73307 (0.0009) [2023-12-26 00:10:08,326][123091] Updated weights for policy 0, policy_version 73733 (0.0008) [2023-12-26 00:10:08,388][123091] Updated weights for policy 0, policy_version 73743 (0.0011) [2023-12-26 00:10:08,451][123091] Updated weights for policy 0, policy_version 73753 (0.0011) [2023-12-26 00:10:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 16939.4). Total num frames: 37650432. Throughput: 0: 9112.3, 1: 8670.7. Samples: 37627544. Policy #0 lag: (min: 31.0, avg: 32.3, max: 58.0) [2023-12-26 00:10:08,785][121949] Avg episode reward: [(0, '4548.427'), (1, '5390.953')] [2023-12-26 00:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000073760_18882560.pth... [2023-12-26 00:10:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000073312_18767872.pth... [2023-12-26 00:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000072704_18612224.pth [2023-12-26 00:10:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000072320_18513920.pth [2023-12-26 00:10:09,014][123090] Updated weights for policy 1, policy_version 73317 (0.0010) [2023-12-26 00:10:09,074][123090] Updated weights for policy 1, policy_version 73327 (0.0010) [2023-12-26 00:10:09,137][123090] Updated weights for policy 1, policy_version 73337 (0.0010) [2023-12-26 00:10:09,171][123091] Updated weights for policy 0, policy_version 73763 (0.0009) [2023-12-26 00:10:09,237][123091] Updated weights for policy 0, policy_version 73773 (0.0007) [2023-12-26 00:10:09,302][123091] Updated weights for policy 0, policy_version 73783 (0.0006) [2023-12-26 00:10:10,020][123090] Updated weights for policy 1, policy_version 73347 (0.0010) [2023-12-26 00:10:10,088][123090] Updated weights for policy 1, policy_version 73357 (0.0010) [2023-12-26 00:10:10,120][123091] Updated weights for policy 0, policy_version 73793 (0.0007) [2023-12-26 00:10:10,156][123090] Updated weights for policy 1, policy_version 73367 (0.0010) [2023-12-26 00:10:10,181][123091] Updated weights for policy 0, policy_version 73803 (0.0008) [2023-12-26 00:10:10,248][123091] Updated weights for policy 0, policy_version 73813 (0.0008) [2023-12-26 00:10:10,316][123091] Updated weights for policy 0, policy_version 73823 (0.0009) [2023-12-26 00:10:10,930][123090] Updated weights for policy 1, policy_version 73377 (0.0010) [2023-12-26 00:10:10,997][123090] Updated weights for policy 1, policy_version 73387 (0.0008) [2023-12-26 00:10:11,071][123090] Updated weights for policy 1, policy_version 73397 (0.0008) [2023-12-26 00:10:11,088][123091] Updated weights for policy 0, policy_version 73833 (0.0007) [2023-12-26 00:10:11,120][123090] Updated weights for policy 1, policy_version 73407 (0.0008) [2023-12-26 00:10:11,152][123091] Updated weights for policy 0, policy_version 73843 (0.0008) [2023-12-26 00:10:11,214][123091] Updated weights for policy 0, policy_version 73853 (0.0009) [2023-12-26 00:10:11,931][123090] Updated weights for policy 1, policy_version 73417 (0.0010) [2023-12-26 00:10:12,003][123090] Updated weights for policy 1, policy_version 73427 (0.0010) [2023-12-26 00:10:12,071][123090] Updated weights for policy 1, policy_version 73437 (0.0006) [2023-12-26 00:10:12,089][123091] Updated weights for policy 0, policy_version 73863 (0.0010) [2023-12-26 00:10:12,156][123091] Updated weights for policy 0, policy_version 73873 (0.0010) [2023-12-26 00:10:12,215][123091] Updated weights for policy 0, policy_version 73883 (0.0009) [2023-12-26 00:10:12,859][123090] Updated weights for policy 1, policy_version 73447 (0.0006) [2023-12-26 00:10:12,934][123090] Updated weights for policy 1, policy_version 73457 (0.0005) [2023-12-26 00:10:13,010][123090] Updated weights for policy 1, policy_version 73467 (0.0006) [2023-12-26 00:10:13,086][123091] Updated weights for policy 0, policy_version 73893 (0.0009) [2023-12-26 00:10:13,139][123091] Updated weights for policy 0, policy_version 73903 (0.0010) [2023-12-26 00:10:13,195][123091] Updated weights for policy 0, policy_version 73913 (0.0010) [2023-12-26 00:10:13,716][123090] Updated weights for policy 1, policy_version 73477 (0.0008) [2023-12-26 00:10:13,774][123090] Updated weights for policy 1, policy_version 73487 (0.0009) [2023-12-26 00:10:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 16939.4). Total num frames: 37732352. Throughput: 0: 9033.2, 1: 8671.2. Samples: 37730644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:13,785][121949] Avg episode reward: [(0, '4472.948'), (1, '5312.605')] [2023-12-26 00:10:13,837][123090] Updated weights for policy 1, policy_version 73497 (0.0009) [2023-12-26 00:10:14,039][123091] Updated weights for policy 0, policy_version 73923 (0.0010) [2023-12-26 00:10:14,093][123091] Updated weights for policy 0, policy_version 73933 (0.0009) [2023-12-26 00:10:14,155][123091] Updated weights for policy 0, policy_version 73943 (0.0009) [2023-12-26 00:10:14,599][123090] Updated weights for policy 1, policy_version 73507 (0.0009) [2023-12-26 00:10:14,657][123090] Updated weights for policy 1, policy_version 73517 (0.0009) [2023-12-26 00:10:14,707][123090] Updated weights for policy 1, policy_version 73527 (0.0009) [2023-12-26 00:10:15,028][123091] Updated weights for policy 0, policy_version 73953 (0.0009) [2023-12-26 00:10:15,094][123091] Updated weights for policy 0, policy_version 73963 (0.0009) [2023-12-26 00:10:15,163][123091] Updated weights for policy 0, policy_version 73973 (0.0010) [2023-12-26 00:10:15,228][123091] Updated weights for policy 0, policy_version 73983 (0.0009) [2023-12-26 00:10:15,536][123090] Updated weights for policy 1, policy_version 73537 (0.0009) [2023-12-26 00:10:15,586][123090] Updated weights for policy 1, policy_version 73547 (0.0005) [2023-12-26 00:10:15,632][123090] Updated weights for policy 1, policy_version 73557 (0.0005) [2023-12-26 00:10:15,679][123090] Updated weights for policy 1, policy_version 73567 (0.0005) [2023-12-26 00:10:16,098][123091] Updated weights for policy 0, policy_version 73993 (0.0009) [2023-12-26 00:10:16,156][123091] Updated weights for policy 0, policy_version 74003 (0.0009) [2023-12-26 00:10:16,210][123091] Updated weights for policy 0, policy_version 74013 (0.0008) [2023-12-26 00:10:16,456][123090] Updated weights for policy 1, policy_version 73577 (0.0005) [2023-12-26 00:10:16,532][123090] Updated weights for policy 1, policy_version 73587 (0.0005) [2023-12-26 00:10:16,612][123090] Updated weights for policy 1, policy_version 73597 (0.0006) [2023-12-26 00:10:17,119][123091] Updated weights for policy 0, policy_version 74023 (0.0009) [2023-12-26 00:10:17,177][123091] Updated weights for policy 0, policy_version 74033 (0.0010) [2023-12-26 00:10:17,226][123090] Updated weights for policy 1, policy_version 73607 (0.0007) [2023-12-26 00:10:17,232][123091] Updated weights for policy 0, policy_version 74043 (0.0009) [2023-12-26 00:10:17,282][123090] Updated weights for policy 1, policy_version 73617 (0.0009) [2023-12-26 00:10:17,330][123090] Updated weights for policy 1, policy_version 73627 (0.0009) [2023-12-26 00:10:18,102][123091] Updated weights for policy 0, policy_version 74053 (0.0009) [2023-12-26 00:10:18,147][123090] Updated weights for policy 1, policy_version 73637 (0.0007) [2023-12-26 00:10:18,152][123091] Updated weights for policy 0, policy_version 74063 (0.0009) [2023-12-26 00:10:18,201][123090] Updated weights for policy 1, policy_version 73647 (0.0005) [2023-12-26 00:10:18,206][123091] Updated weights for policy 0, policy_version 74075 (0.0010) [2023-12-26 00:10:18,260][123090] Updated weights for policy 1, policy_version 73657 (0.0005) [2023-12-26 00:10:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 16967.2). Total num frames: 37822464. Throughput: 0: 8861.8, 1: 8815.9. Samples: 37835656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:18,785][121949] Avg episode reward: [(0, '4520.644'), (1, '5382.955')] [2023-12-26 00:10:19,020][123090] Updated weights for policy 1, policy_version 73667 (0.0005) [2023-12-26 00:10:19,081][123090] Updated weights for policy 1, policy_version 73677 (0.0005) [2023-12-26 00:10:19,116][123091] Updated weights for policy 0, policy_version 74085 (0.0009) [2023-12-26 00:10:19,144][123090] Updated weights for policy 1, policy_version 73687 (0.0005) [2023-12-26 00:10:19,163][123091] Updated weights for policy 0, policy_version 74095 (0.0008) [2023-12-26 00:10:19,221][123091] Updated weights for policy 0, policy_version 74105 (0.0010) [2023-12-26 00:10:19,996][123090] Updated weights for policy 1, policy_version 73697 (0.0008) [2023-12-26 00:10:20,027][123091] Updated weights for policy 0, policy_version 74115 (0.0007) [2023-12-26 00:10:20,059][123090] Updated weights for policy 1, policy_version 73707 (0.0009) [2023-12-26 00:10:20,088][123091] Updated weights for policy 0, policy_version 74125 (0.0007) [2023-12-26 00:10:20,124][123090] Updated weights for policy 1, policy_version 73717 (0.0009) [2023-12-26 00:10:20,148][123091] Updated weights for policy 0, policy_version 74135 (0.0007) [2023-12-26 00:10:20,184][123090] Updated weights for policy 1, policy_version 73727 (0.0008) [2023-12-26 00:10:20,978][123091] Updated weights for policy 0, policy_version 74145 (0.0008) [2023-12-26 00:10:21,044][123091] Updated weights for policy 0, policy_version 74155 (0.0010) [2023-12-26 00:10:21,059][123090] Updated weights for policy 1, policy_version 73737 (0.0008) [2023-12-26 00:10:21,109][123091] Updated weights for policy 0, policy_version 74165 (0.0009) [2023-12-26 00:10:21,124][123090] Updated weights for policy 1, policy_version 73747 (0.0006) [2023-12-26 00:10:21,175][123091] Updated weights for policy 0, policy_version 74175 (0.0008) [2023-12-26 00:10:21,187][123090] Updated weights for policy 1, policy_version 73757 (0.0009) [2023-12-26 00:10:21,980][123090] Updated weights for policy 1, policy_version 73767 (0.0010) [2023-12-26 00:10:22,046][123091] Updated weights for policy 0, policy_version 74185 (0.0009) [2023-12-26 00:10:22,048][123090] Updated weights for policy 1, policy_version 73777 (0.0008) [2023-12-26 00:10:22,116][123091] Updated weights for policy 0, policy_version 74195 (0.0007) [2023-12-26 00:10:22,119][123090] Updated weights for policy 1, policy_version 73787 (0.0008) [2023-12-26 00:10:22,176][123091] Updated weights for policy 0, policy_version 74205 (0.0010) [2023-12-26 00:10:22,900][123090] Updated weights for policy 1, policy_version 73797 (0.0007) [2023-12-26 00:10:22,949][123090] Updated weights for policy 1, policy_version 73807 (0.0005) [2023-12-26 00:10:23,006][123090] Updated weights for policy 1, policy_version 73817 (0.0006) [2023-12-26 00:10:23,036][123091] Updated weights for policy 0, policy_version 74216 (0.0009) [2023-12-26 00:10:23,100][123091] Updated weights for policy 0, policy_version 74226 (0.0005) [2023-12-26 00:10:23,163][123091] Updated weights for policy 0, policy_version 74236 (0.0006) [2023-12-26 00:10:23,676][123090] Updated weights for policy 1, policy_version 73827 (0.0006) [2023-12-26 00:10:23,746][123090] Updated weights for policy 1, policy_version 73837 (0.0005) [2023-12-26 00:10:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 16967.2). Total num frames: 37904384. Throughput: 0: 8835.9, 1: 8776.5. Samples: 37886296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:23,785][121949] Avg episode reward: [(0, '4523.014'), (1, '5497.116')] [2023-12-26 00:10:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000074240_19005440.pth... [2023-12-26 00:10:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000073216_18743296.pth [2023-12-26 00:10:23,819][123090] Updated weights for policy 1, policy_version 73847 (0.0005) [2023-12-26 00:10:23,879][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000073856_18907136.pth... [2023-12-26 00:10:23,883][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000072832_18644992.pth [2023-12-26 00:10:23,884][123008] Saving new best policy, reward=5497.116! [2023-12-26 00:10:23,984][123091] Updated weights for policy 0, policy_version 74246 (0.0009) [2023-12-26 00:10:24,048][123091] Updated weights for policy 0, policy_version 74256 (0.0009) [2023-12-26 00:10:24,115][123091] Updated weights for policy 0, policy_version 74266 (0.0010) [2023-12-26 00:10:24,495][123090] Updated weights for policy 1, policy_version 73857 (0.0008) [2023-12-26 00:10:24,568][123090] Updated weights for policy 1, policy_version 73867 (0.0005) [2023-12-26 00:10:24,634][123090] Updated weights for policy 1, policy_version 73877 (0.0010) [2023-12-26 00:10:24,692][123090] Updated weights for policy 1, policy_version 73887 (0.0010) [2023-12-26 00:10:24,983][123091] Updated weights for policy 0, policy_version 74276 (0.0010) [2023-12-26 00:10:25,041][123091] Updated weights for policy 0, policy_version 74286 (0.0007) [2023-12-26 00:10:25,105][123091] Updated weights for policy 0, policy_version 74296 (0.0006) [2023-12-26 00:10:25,471][123090] Updated weights for policy 1, policy_version 73897 (0.0010) [2023-12-26 00:10:25,519][123090] Updated weights for policy 1, policy_version 73907 (0.0010) [2023-12-26 00:10:25,566][123090] Updated weights for policy 1, policy_version 73917 (0.0010) [2023-12-26 00:10:25,871][123091] Updated weights for policy 0, policy_version 74306 (0.0008) [2023-12-26 00:10:25,928][123091] Updated weights for policy 0, policy_version 74317 (0.0010) [2023-12-26 00:10:25,980][123091] Updated weights for policy 0, policy_version 74327 (0.0009) [2023-12-26 00:10:26,303][123090] Updated weights for policy 1, policy_version 73927 (0.0007) [2023-12-26 00:10:26,359][123090] Updated weights for policy 1, policy_version 73937 (0.0005) [2023-12-26 00:10:26,417][123090] Updated weights for policy 1, policy_version 73947 (0.0005) [2023-12-26 00:10:26,870][123091] Updated weights for policy 0, policy_version 74337 (0.0009) [2023-12-26 00:10:26,930][123091] Updated weights for policy 0, policy_version 74347 (0.0009) [2023-12-26 00:10:26,991][123091] Updated weights for policy 0, policy_version 74357 (0.0009) [2023-12-26 00:10:27,046][123091] Updated weights for policy 0, policy_version 74367 (0.0009) [2023-12-26 00:10:27,210][123090] Updated weights for policy 1, policy_version 73957 (0.0009) [2023-12-26 00:10:27,276][123090] Updated weights for policy 1, policy_version 73967 (0.0010) [2023-12-26 00:10:27,341][123090] Updated weights for policy 1, policy_version 73977 (0.0010) [2023-12-26 00:10:27,889][123091] Updated weights for policy 0, policy_version 74377 (0.0009) [2023-12-26 00:10:27,951][123091] Updated weights for policy 0, policy_version 74387 (0.0009) [2023-12-26 00:10:28,009][123091] Updated weights for policy 0, policy_version 74397 (0.0010) [2023-12-26 00:10:28,147][123090] Updated weights for policy 1, policy_version 73987 (0.0009) [2023-12-26 00:10:28,215][123090] Updated weights for policy 1, policy_version 73997 (0.0005) [2023-12-26 00:10:28,281][123090] Updated weights for policy 1, policy_version 74007 (0.0005) [2023-12-26 00:10:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 16994.9). Total num frames: 37994496. Throughput: 0: 8832.5, 1: 8754.6. Samples: 37992132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:28,785][121949] Avg episode reward: [(0, '4384.005'), (1, '5482.241')] [2023-12-26 00:10:28,918][123091] Updated weights for policy 0, policy_version 74407 (0.0009) [2023-12-26 00:10:28,969][123091] Updated weights for policy 0, policy_version 74417 (0.0009) [2023-12-26 00:10:29,014][123090] Updated weights for policy 1, policy_version 74017 (0.0008) [2023-12-26 00:10:29,024][123091] Updated weights for policy 0, policy_version 74427 (0.0009) [2023-12-26 00:10:29,077][123090] Updated weights for policy 1, policy_version 74027 (0.0010) [2023-12-26 00:10:29,134][123090] Updated weights for policy 1, policy_version 74037 (0.0010) [2023-12-26 00:10:29,178][123090] Updated weights for policy 1, policy_version 74047 (0.0010) [2023-12-26 00:10:29,860][123091] Updated weights for policy 0, policy_version 74437 (0.0006) [2023-12-26 00:10:29,923][123091] Updated weights for policy 0, policy_version 74447 (0.0008) [2023-12-26 00:10:29,984][123091] Updated weights for policy 0, policy_version 74457 (0.0008) [2023-12-26 00:10:30,029][123090] Updated weights for policy 1, policy_version 74057 (0.0006) [2023-12-26 00:10:30,101][123090] Updated weights for policy 1, policy_version 74067 (0.0009) [2023-12-26 00:10:30,175][123090] Updated weights for policy 1, policy_version 74077 (0.0006) [2023-12-26 00:10:30,782][123091] Updated weights for policy 0, policy_version 74467 (0.0008) [2023-12-26 00:10:30,836][123091] Updated weights for policy 0, policy_version 74477 (0.0005) [2023-12-26 00:10:30,878][123090] Updated weights for policy 1, policy_version 74087 (0.0009) [2023-12-26 00:10:30,894][123091] Updated weights for policy 0, policy_version 74487 (0.0005) [2023-12-26 00:10:30,943][123090] Updated weights for policy 1, policy_version 74097 (0.0010) [2023-12-26 00:10:30,994][123090] Updated weights for policy 1, policy_version 74107 (0.0010) [2023-12-26 00:10:31,580][123091] Updated weights for policy 0, policy_version 74497 (0.0005) [2023-12-26 00:10:31,642][123091] Updated weights for policy 0, policy_version 74507 (0.0007) [2023-12-26 00:10:31,711][123091] Updated weights for policy 0, policy_version 74517 (0.0008) [2023-12-26 00:10:31,783][123091] Updated weights for policy 0, policy_version 74527 (0.0007) [2023-12-26 00:10:31,839][123090] Updated weights for policy 1, policy_version 74117 (0.0010) [2023-12-26 00:10:31,909][123090] Updated weights for policy 1, policy_version 74127 (0.0010) [2023-12-26 00:10:31,972][123090] Updated weights for policy 1, policy_version 74137 (0.0011) [2023-12-26 00:10:32,572][123091] Updated weights for policy 0, policy_version 74537 (0.0009) [2023-12-26 00:10:32,624][123091] Updated weights for policy 0, policy_version 74547 (0.0009) [2023-12-26 00:10:32,676][123091] Updated weights for policy 0, policy_version 74557 (0.0008) [2023-12-26 00:10:32,790][123090] Updated weights for policy 1, policy_version 74147 (0.0011) [2023-12-26 00:10:32,837][123090] Updated weights for policy 1, policy_version 74157 (0.0010) [2023-12-26 00:10:32,889][123090] Updated weights for policy 1, policy_version 74167 (0.0010) [2023-12-26 00:10:33,535][123091] Updated weights for policy 0, policy_version 74567 (0.0009) [2023-12-26 00:10:33,594][123091] Updated weights for policy 0, policy_version 74577 (0.0006) [2023-12-26 00:10:33,654][123091] Updated weights for policy 0, policy_version 74587 (0.0005) [2023-12-26 00:10:33,731][123090] Updated weights for policy 1, policy_version 74177 (0.0011) [2023-12-26 00:10:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 16994.9). Total num frames: 38084608. Throughput: 0: 8796.8, 1: 8698.8. Samples: 38096548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:33,784][121949] Avg episode reward: [(0, '4250.694'), (1, '5486.155')] [2023-12-26 00:10:33,803][123090] Updated weights for policy 1, policy_version 74187 (0.0010) [2023-12-26 00:10:33,866][123090] Updated weights for policy 1, policy_version 74197 (0.0010) [2023-12-26 00:10:33,930][123090] Updated weights for policy 1, policy_version 74207 (0.0010) [2023-12-26 00:10:34,363][123091] Updated weights for policy 0, policy_version 74597 (0.0007) [2023-12-26 00:10:34,417][123091] Updated weights for policy 0, policy_version 74607 (0.0009) [2023-12-26 00:10:34,471][123091] Updated weights for policy 0, policy_version 74617 (0.0010) [2023-12-26 00:10:34,663][123090] Updated weights for policy 1, policy_version 74217 (0.0006) [2023-12-26 00:10:34,735][123090] Updated weights for policy 1, policy_version 74227 (0.0005) [2023-12-26 00:10:34,813][123090] Updated weights for policy 1, policy_version 74237 (0.0006) [2023-12-26 00:10:35,274][123091] Updated weights for policy 0, policy_version 74627 (0.0008) [2023-12-26 00:10:35,349][123091] Updated weights for policy 0, policy_version 74637 (0.0005) [2023-12-26 00:10:35,422][123091] Updated weights for policy 0, policy_version 74647 (0.0006) [2023-12-26 00:10:35,443][123090] Updated weights for policy 1, policy_version 74247 (0.0006) [2023-12-26 00:10:35,495][123090] Updated weights for policy 1, policy_version 74257 (0.0005) [2023-12-26 00:10:35,548][123090] Updated weights for policy 1, policy_version 74267 (0.0005) [2023-12-26 00:10:36,033][123091] Updated weights for policy 0, policy_version 74657 (0.0005) [2023-12-26 00:10:36,086][123091] Updated weights for policy 0, policy_version 74667 (0.0006) [2023-12-26 00:10:36,154][123091] Updated weights for policy 0, policy_version 74677 (0.0008) [2023-12-26 00:10:36,222][123091] Updated weights for policy 0, policy_version 74687 (0.0009) [2023-12-26 00:10:36,224][123090] Updated weights for policy 1, policy_version 74277 (0.0007) [2023-12-26 00:10:36,288][123090] Updated weights for policy 1, policy_version 74287 (0.0011) [2023-12-26 00:10:36,360][123090] Updated weights for policy 1, policy_version 74297 (0.0011) [2023-12-26 00:10:37,024][123091] Updated weights for policy 0, policy_version 74697 (0.0010) [2023-12-26 00:10:37,063][123090] Updated weights for policy 1, policy_version 74307 (0.0009) [2023-12-26 00:10:37,087][123091] Updated weights for policy 0, policy_version 74707 (0.0009) [2023-12-26 00:10:37,117][123090] Updated weights for policy 1, policy_version 74317 (0.0005) [2023-12-26 00:10:37,144][123091] Updated weights for policy 0, policy_version 74717 (0.0009) [2023-12-26 00:10:37,169][123090] Updated weights for policy 1, policy_version 74327 (0.0005) [2023-12-26 00:10:37,790][123090] Updated weights for policy 1, policy_version 74337 (0.0006) [2023-12-26 00:10:37,855][123090] Updated weights for policy 1, policy_version 74347 (0.0006) [2023-12-26 00:10:37,912][123090] Updated weights for policy 1, policy_version 74357 (0.0009) [2023-12-26 00:10:37,962][123090] Updated weights for policy 1, policy_version 74367 (0.0009) [2023-12-26 00:10:38,041][123091] Updated weights for policy 0, policy_version 74727 (0.0009) [2023-12-26 00:10:38,090][123091] Updated weights for policy 0, policy_version 74737 (0.0009) [2023-12-26 00:10:38,158][123091] Updated weights for policy 0, policy_version 74747 (0.0010) [2023-12-26 00:10:38,747][123090] Updated weights for policy 1, policy_version 74377 (0.0010) [2023-12-26 00:10:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17050.5). Total num frames: 38174720. Throughput: 0: 8824.1, 1: 8764.8. Samples: 38154224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:38,785][121949] Avg episode reward: [(0, '4293.840'), (1, '5318.916')] [2023-12-26 00:10:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000074752_19136512.pth... [2023-12-26 00:10:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000073760_18882560.pth [2023-12-26 00:10:38,815][123090] Updated weights for policy 1, policy_version 74387 (0.0006) [2023-12-26 00:10:38,870][123090] Updated weights for policy 1, policy_version 74397 (0.0005) [2023-12-26 00:10:38,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000074400_19046400.pth... [2023-12-26 00:10:38,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000073312_18767872.pth [2023-12-26 00:10:39,011][123091] Updated weights for policy 0, policy_version 74757 (0.0008) [2023-12-26 00:10:39,078][123091] Updated weights for policy 0, policy_version 74767 (0.0005) [2023-12-26 00:10:39,144][123091] Updated weights for policy 0, policy_version 74777 (0.0005) [2023-12-26 00:10:39,629][123090] Updated weights for policy 1, policy_version 74407 (0.0007) [2023-12-26 00:10:39,694][123090] Updated weights for policy 1, policy_version 74417 (0.0008) [2023-12-26 00:10:39,753][123090] Updated weights for policy 1, policy_version 74427 (0.0008) [2023-12-26 00:10:39,852][123091] Updated weights for policy 0, policy_version 74787 (0.0006) [2023-12-26 00:10:39,928][123091] Updated weights for policy 0, policy_version 74797 (0.0007) [2023-12-26 00:10:39,994][123091] Updated weights for policy 0, policy_version 74807 (0.0010) [2023-12-26 00:10:40,546][123090] Updated weights for policy 1, policy_version 74437 (0.0009) [2023-12-26 00:10:40,608][123090] Updated weights for policy 1, policy_version 74447 (0.0010) [2023-12-26 00:10:40,670][123090] Updated weights for policy 1, policy_version 74457 (0.0010) [2023-12-26 00:10:40,792][123091] Updated weights for policy 0, policy_version 74817 (0.0011) [2023-12-26 00:10:40,858][123091] Updated weights for policy 0, policy_version 74827 (0.0011) [2023-12-26 00:10:40,921][123091] Updated weights for policy 0, policy_version 74837 (0.0011) [2023-12-26 00:10:40,991][123091] Updated weights for policy 0, policy_version 74847 (0.0009) [2023-12-26 00:10:41,524][123090] Updated weights for policy 1, policy_version 74467 (0.0010) [2023-12-26 00:10:41,590][123090] Updated weights for policy 1, policy_version 74477 (0.0010) [2023-12-26 00:10:41,658][123090] Updated weights for policy 1, policy_version 74487 (0.0011) [2023-12-26 00:10:41,743][123091] Updated weights for policy 0, policy_version 74857 (0.0010) [2023-12-26 00:10:41,806][123091] Updated weights for policy 0, policy_version 74867 (0.0009) [2023-12-26 00:10:41,866][123091] Updated weights for policy 0, policy_version 74877 (0.0008) [2023-12-26 00:10:42,442][123090] Updated weights for policy 1, policy_version 74497 (0.0010) [2023-12-26 00:10:42,511][123090] Updated weights for policy 1, policy_version 74507 (0.0008) [2023-12-26 00:10:42,578][123090] Updated weights for policy 1, policy_version 74517 (0.0008) [2023-12-26 00:10:42,646][123090] Updated weights for policy 1, policy_version 74527 (0.0008) [2023-12-26 00:10:42,688][123091] Updated weights for policy 0, policy_version 74887 (0.0008) [2023-12-26 00:10:42,757][123091] Updated weights for policy 0, policy_version 74897 (0.0007) [2023-12-26 00:10:42,823][123091] Updated weights for policy 0, policy_version 74907 (0.0008) [2023-12-26 00:10:43,376][123090] Updated weights for policy 1, policy_version 74537 (0.0006) [2023-12-26 00:10:43,442][123090] Updated weights for policy 1, policy_version 74547 (0.0005) [2023-12-26 00:10:43,506][123090] Updated weights for policy 1, policy_version 74557 (0.0009) [2023-12-26 00:10:43,574][123091] Updated weights for policy 0, policy_version 74917 (0.0009) [2023-12-26 00:10:43,624][123091] Updated weights for policy 0, policy_version 74927 (0.0009) [2023-12-26 00:10:43,674][123091] Updated weights for policy 0, policy_version 74937 (0.0009) [2023-12-26 00:10:43,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17078.2). Total num frames: 38273024. Throughput: 0: 8788.5, 1: 8836.2. Samples: 38260728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:43,785][121949] Avg episode reward: [(0, '4226.226'), (1, '5037.919')] [2023-12-26 00:10:44,298][123090] Updated weights for policy 1, policy_version 74567 (0.0010) [2023-12-26 00:10:44,357][123090] Updated weights for policy 1, policy_version 74577 (0.0010) [2023-12-26 00:10:44,375][123091] Updated weights for policy 0, policy_version 74947 (0.0010) [2023-12-26 00:10:44,423][123090] Updated weights for policy 1, policy_version 74587 (0.0010) [2023-12-26 00:10:44,435][123091] Updated weights for policy 0, policy_version 74957 (0.0007) [2023-12-26 00:10:44,494][123091] Updated weights for policy 0, policy_version 74967 (0.0009) [2023-12-26 00:10:45,217][123090] Updated weights for policy 1, policy_version 74597 (0.0008) [2023-12-26 00:10:45,289][123090] Updated weights for policy 1, policy_version 74607 (0.0006) [2023-12-26 00:10:45,361][123090] Updated weights for policy 1, policy_version 74617 (0.0005) [2023-12-26 00:10:45,385][123091] Updated weights for policy 0, policy_version 74977 (0.0009) [2023-12-26 00:10:45,442][123091] Updated weights for policy 0, policy_version 74987 (0.0009) [2023-12-26 00:10:45,509][123091] Updated weights for policy 0, policy_version 74997 (0.0009) [2023-12-26 00:10:45,568][123091] Updated weights for policy 0, policy_version 75007 (0.0009) [2023-12-26 00:10:46,130][123090] Updated weights for policy 1, policy_version 74627 (0.0007) [2023-12-26 00:10:46,192][123090] Updated weights for policy 1, policy_version 74637 (0.0010) [2023-12-26 00:10:46,262][123090] Updated weights for policy 1, policy_version 74647 (0.0010) [2023-12-26 00:10:46,419][123091] Updated weights for policy 0, policy_version 75017 (0.0009) [2023-12-26 00:10:46,471][123091] Updated weights for policy 0, policy_version 75027 (0.0009) [2023-12-26 00:10:46,521][123091] Updated weights for policy 0, policy_version 75038 (0.0009) [2023-12-26 00:10:47,074][123090] Updated weights for policy 1, policy_version 74657 (0.0010) [2023-12-26 00:10:47,128][123090] Updated weights for policy 1, policy_version 74667 (0.0010) [2023-12-26 00:10:47,176][123090] Updated weights for policy 1, policy_version 74677 (0.0010) [2023-12-26 00:10:47,229][123090] Updated weights for policy 1, policy_version 74687 (0.0005) [2023-12-26 00:10:47,323][123091] Updated weights for policy 0, policy_version 75048 (0.0009) [2023-12-26 00:10:47,376][123091] Updated weights for policy 0, policy_version 75058 (0.0010) [2023-12-26 00:10:47,419][123091] Updated weights for policy 0, policy_version 75068 (0.0005) [2023-12-26 00:10:47,952][123090] Updated weights for policy 1, policy_version 74697 (0.0005) [2023-12-26 00:10:48,023][123090] Updated weights for policy 1, policy_version 74707 (0.0005) [2023-12-26 00:10:48,097][123090] Updated weights for policy 1, policy_version 74717 (0.0005) [2023-12-26 00:10:48,159][123091] Updated weights for policy 0, policy_version 75078 (0.0005) [2023-12-26 00:10:48,233][123091] Updated weights for policy 0, policy_version 75088 (0.0008) [2023-12-26 00:10:48,295][123091] Updated weights for policy 0, policy_version 75098 (0.0010) [2023-12-26 00:10:48,742][123090] Updated weights for policy 1, policy_version 74727 (0.0005) [2023-12-26 00:10:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17078.2). Total num frames: 38354944. Throughput: 0: 8703.6, 1: 8980.0. Samples: 38369236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:48,784][121949] Avg episode reward: [(0, '4221.351'), (1, '5096.179')] [2023-12-26 00:10:48,805][123090] Updated weights for policy 1, policy_version 74737 (0.0005) [2023-12-26 00:10:48,876][123090] Updated weights for policy 1, policy_version 74747 (0.0005) [2023-12-26 00:10:49,203][123091] Updated weights for policy 0, policy_version 75108 (0.0010) [2023-12-26 00:10:49,273][123091] Updated weights for policy 0, policy_version 75118 (0.0009) [2023-12-26 00:10:49,333][123091] Updated weights for policy 0, policy_version 75128 (0.0009) [2023-12-26 00:10:49,611][123090] Updated weights for policy 1, policy_version 74757 (0.0009) [2023-12-26 00:10:49,664][123090] Updated weights for policy 1, policy_version 74767 (0.0010) [2023-12-26 00:10:49,723][123090] Updated weights for policy 1, policy_version 74777 (0.0010) [2023-12-26 00:10:50,192][123091] Updated weights for policy 0, policy_version 75138 (0.0010) [2023-12-26 00:10:50,252][123091] Updated weights for policy 0, policy_version 75148 (0.0008) [2023-12-26 00:10:50,312][123091] Updated weights for policy 0, policy_version 75158 (0.0009) [2023-12-26 00:10:50,368][123091] Updated weights for policy 0, policy_version 75168 (0.0009) [2023-12-26 00:10:50,595][123090] Updated weights for policy 1, policy_version 74787 (0.0010) [2023-12-26 00:10:50,655][123090] Updated weights for policy 1, policy_version 74797 (0.0006) [2023-12-26 00:10:50,718][123090] Updated weights for policy 1, policy_version 74807 (0.0009) [2023-12-26 00:10:51,245][123091] Updated weights for policy 0, policy_version 75178 (0.0010) [2023-12-26 00:10:51,307][123091] Updated weights for policy 0, policy_version 75188 (0.0009) [2023-12-26 00:10:51,373][123091] Updated weights for policy 0, policy_version 75198 (0.0010) [2023-12-26 00:10:51,573][123090] Updated weights for policy 1, policy_version 74817 (0.0009) [2023-12-26 00:10:51,641][123090] Updated weights for policy 1, policy_version 74827 (0.0009) [2023-12-26 00:10:51,714][123090] Updated weights for policy 1, policy_version 74837 (0.0010) [2023-12-26 00:10:51,781][123090] Updated weights for policy 1, policy_version 74847 (0.0009) [2023-12-26 00:10:52,223][123091] Updated weights for policy 0, policy_version 75208 (0.0010) [2023-12-26 00:10:52,286][123091] Updated weights for policy 0, policy_version 75218 (0.0007) [2023-12-26 00:10:52,341][123091] Updated weights for policy 0, policy_version 75228 (0.0006) [2023-12-26 00:10:52,652][123090] Updated weights for policy 1, policy_version 74857 (0.0010) [2023-12-26 00:10:52,715][123090] Updated weights for policy 1, policy_version 74867 (0.0010) [2023-12-26 00:10:52,770][123090] Updated weights for policy 1, policy_version 74877 (0.0010) [2023-12-26 00:10:53,045][123091] Updated weights for policy 0, policy_version 75238 (0.0011) [2023-12-26 00:10:53,096][123091] Updated weights for policy 0, policy_version 75248 (0.0010) [2023-12-26 00:10:53,147][123091] Updated weights for policy 0, policy_version 75258 (0.0010) [2023-12-26 00:10:53,599][123090] Updated weights for policy 1, policy_version 74887 (0.0010) [2023-12-26 00:10:53,661][123090] Updated weights for policy 1, policy_version 74897 (0.0010) [2023-12-26 00:10:53,727][123090] Updated weights for policy 1, policy_version 74907 (0.0010) [2023-12-26 00:10:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17106.1). Total num frames: 38445056. Throughput: 0: 8601.5, 1: 9010.3. Samples: 38420076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:10:53,785][121949] Avg episode reward: [(0, '4172.242'), (1, '5241.514')] [2023-12-26 00:10:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000075264_19267584.pth... [2023-12-26 00:10:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000074912_19177472.pth... [2023-12-26 00:10:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000073856_18907136.pth [2023-12-26 00:10:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000074240_19005440.pth [2023-12-26 00:10:53,877][123091] Updated weights for policy 0, policy_version 75268 (0.0009) [2023-12-26 00:10:53,921][123091] Updated weights for policy 0, policy_version 75278 (0.0005) [2023-12-26 00:10:53,981][123091] Updated weights for policy 0, policy_version 75288 (0.0007) [2023-12-26 00:10:54,481][123090] Updated weights for policy 1, policy_version 74917 (0.0008) [2023-12-26 00:10:54,545][123090] Updated weights for policy 1, policy_version 74927 (0.0008) [2023-12-26 00:10:54,608][123090] Updated weights for policy 1, policy_version 74937 (0.0010) [2023-12-26 00:10:54,667][123091] Updated weights for policy 0, policy_version 75298 (0.0008) [2023-12-26 00:10:54,730][123091] Updated weights for policy 0, policy_version 75308 (0.0005) [2023-12-26 00:10:54,796][123091] Updated weights for policy 0, policy_version 75318 (0.0005) [2023-12-26 00:10:54,871][123091] Updated weights for policy 0, policy_version 75328 (0.0005) [2023-12-26 00:10:55,353][123090] Updated weights for policy 1, policy_version 74947 (0.0009) [2023-12-26 00:10:55,407][123090] Updated weights for policy 1, policy_version 74957 (0.0005) [2023-12-26 00:10:55,462][123090] Updated weights for policy 1, policy_version 74967 (0.0009) [2023-12-26 00:10:55,519][123091] Updated weights for policy 0, policy_version 75338 (0.0007) [2023-12-26 00:10:55,566][123091] Updated weights for policy 0, policy_version 75348 (0.0009) [2023-12-26 00:10:55,614][123091] Updated weights for policy 0, policy_version 75358 (0.0009) [2023-12-26 00:10:56,268][123090] Updated weights for policy 1, policy_version 74977 (0.0010) [2023-12-26 00:10:56,328][123090] Updated weights for policy 1, policy_version 74987 (0.0010) [2023-12-26 00:10:56,393][123090] Updated weights for policy 1, policy_version 74997 (0.0010) [2023-12-26 00:10:56,454][123090] Updated weights for policy 1, policy_version 75007 (0.0010) [2023-12-26 00:10:56,470][123091] Updated weights for policy 0, policy_version 75368 (0.0010) [2023-12-26 00:10:56,523][123091] Updated weights for policy 0, policy_version 75378 (0.0010) [2023-12-26 00:10:56,596][123091] Updated weights for policy 0, policy_version 75388 (0.0007) [2023-12-26 00:10:57,139][123090] Updated weights for policy 1, policy_version 75017 (0.0010) [2023-12-26 00:10:57,186][123090] Updated weights for policy 1, policy_version 75027 (0.0010) [2023-12-26 00:10:57,237][123090] Updated weights for policy 1, policy_version 75037 (0.0010) [2023-12-26 00:10:57,265][123091] Updated weights for policy 0, policy_version 75398 (0.0005) [2023-12-26 00:10:57,315][123091] Updated weights for policy 0, policy_version 75408 (0.0005) [2023-12-26 00:10:57,364][123091] Updated weights for policy 0, policy_version 75418 (0.0009) [2023-12-26 00:10:57,966][123090] Updated weights for policy 1, policy_version 75047 (0.0010) [2023-12-26 00:10:58,039][123090] Updated weights for policy 1, policy_version 75057 (0.0008) [2023-12-26 00:10:58,062][123091] Updated weights for policy 0, policy_version 75428 (0.0010) [2023-12-26 00:10:58,113][123090] Updated weights for policy 1, policy_version 75067 (0.0008) [2023-12-26 00:10:58,136][123091] Updated weights for policy 0, policy_version 75438 (0.0008) [2023-12-26 00:10:58,208][123091] Updated weights for policy 0, policy_version 75448 (0.0007) [2023-12-26 00:10:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17133.8). Total num frames: 38535168. Throughput: 0: 8707.8, 1: 9090.6. Samples: 38531576. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:10:58,785][121949] Avg episode reward: [(0, '4218.040'), (1, '5082.679')] [2023-12-26 00:10:58,919][123090] Updated weights for policy 1, policy_version 75077 (0.0010) [2023-12-26 00:10:58,992][123090] Updated weights for policy 1, policy_version 75087 (0.0010) [2023-12-26 00:10:59,068][123090] Updated weights for policy 1, policy_version 75097 (0.0009) [2023-12-26 00:10:59,123][123091] Updated weights for policy 0, policy_version 75458 (0.0009) [2023-12-26 00:10:59,189][123091] Updated weights for policy 0, policy_version 75468 (0.0008) [2023-12-26 00:10:59,260][123091] Updated weights for policy 0, policy_version 75478 (0.0009) [2023-12-26 00:10:59,322][123091] Updated weights for policy 0, policy_version 75488 (0.0010) [2023-12-26 00:10:59,892][123090] Updated weights for policy 1, policy_version 75107 (0.0010) [2023-12-26 00:10:59,962][123090] Updated weights for policy 1, policy_version 75117 (0.0010) [2023-12-26 00:11:00,022][123090] Updated weights for policy 1, policy_version 75127 (0.0009) [2023-12-26 00:11:00,087][123091] Updated weights for policy 0, policy_version 75498 (0.0006) [2023-12-26 00:11:00,147][123091] Updated weights for policy 0, policy_version 75508 (0.0005) [2023-12-26 00:11:00,206][123091] Updated weights for policy 0, policy_version 75518 (0.0005) [2023-12-26 00:11:00,916][123091] Updated weights for policy 0, policy_version 75528 (0.0008) [2023-12-26 00:11:00,925][123090] Updated weights for policy 1, policy_version 75137 (0.0008) [2023-12-26 00:11:00,967][123091] Updated weights for policy 0, policy_version 75538 (0.0007) [2023-12-26 00:11:00,980][123090] Updated weights for policy 1, policy_version 75147 (0.0009) [2023-12-26 00:11:01,038][123091] Updated weights for policy 0, policy_version 75548 (0.0006) [2023-12-26 00:11:01,039][123090] Updated weights for policy 1, policy_version 75157 (0.0008) [2023-12-26 00:11:01,103][123090] Updated weights for policy 1, policy_version 75167 (0.0009) [2023-12-26 00:11:01,765][123091] Updated weights for policy 0, policy_version 75558 (0.0009) [2023-12-26 00:11:01,826][123091] Updated weights for policy 0, policy_version 75568 (0.0009) [2023-12-26 00:11:01,880][123091] Updated weights for policy 0, policy_version 75578 (0.0009) [2023-12-26 00:11:01,894][123090] Updated weights for policy 1, policy_version 75177 (0.0008) [2023-12-26 00:11:01,955][123090] Updated weights for policy 1, policy_version 75187 (0.0008) [2023-12-26 00:11:02,030][123090] Updated weights for policy 1, policy_version 75197 (0.0009) [2023-12-26 00:11:02,736][123090] Updated weights for policy 1, policy_version 75207 (0.0009) [2023-12-26 00:11:02,782][123091] Updated weights for policy 0, policy_version 75588 (0.0009) [2023-12-26 00:11:02,802][123090] Updated weights for policy 1, policy_version 75217 (0.0010) [2023-12-26 00:11:02,831][123091] Updated weights for policy 0, policy_version 75598 (0.0007) [2023-12-26 00:11:02,861][123090] Updated weights for policy 1, policy_version 75227 (0.0010) [2023-12-26 00:11:02,885][123091] Updated weights for policy 0, policy_version 75608 (0.0008) [2023-12-26 00:11:03,624][123090] Updated weights for policy 1, policy_version 75237 (0.0008) [2023-12-26 00:11:03,671][123090] Updated weights for policy 1, policy_version 75247 (0.0005) [2023-12-26 00:11:03,718][123090] Updated weights for policy 1, policy_version 75257 (0.0005) [2023-12-26 00:11:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17161.6). Total num frames: 38625280. Throughput: 0: 8803.7, 1: 8997.0. Samples: 38636688. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:03,784][121949] Avg episode reward: [(0, '4376.610'), (1, '5166.815')] [2023-12-26 00:11:03,786][123091] Updated weights for policy 0, policy_version 75618 (0.0009) [2023-12-26 00:11:03,840][123091] Updated weights for policy 0, policy_version 75628 (0.0010) [2023-12-26 00:11:03,907][123091] Updated weights for policy 0, policy_version 75638 (0.0009) [2023-12-26 00:11:03,966][123091] Updated weights for policy 0, policy_version 75648 (0.0009) [2023-12-26 00:11:04,494][123090] Updated weights for policy 1, policy_version 75267 (0.0006) [2023-12-26 00:11:04,559][123090] Updated weights for policy 1, policy_version 75277 (0.0006) [2023-12-26 00:11:04,620][123090] Updated weights for policy 1, policy_version 75287 (0.0006) [2023-12-26 00:11:04,894][123091] Updated weights for policy 0, policy_version 75658 (0.0009) [2023-12-26 00:11:04,952][123091] Updated weights for policy 0, policy_version 75668 (0.0009) [2023-12-26 00:11:05,004][123091] Updated weights for policy 0, policy_version 75678 (0.0009) [2023-12-26 00:11:05,352][123090] Updated weights for policy 1, policy_version 75297 (0.0010) [2023-12-26 00:11:05,403][123090] Updated weights for policy 1, policy_version 75307 (0.0010) [2023-12-26 00:11:05,465][123090] Updated weights for policy 1, policy_version 75318 (0.0010) [2023-12-26 00:11:05,519][123090] Updated weights for policy 1, policy_version 75328 (0.0006) [2023-12-26 00:11:05,912][123091] Updated weights for policy 0, policy_version 75688 (0.0010) [2023-12-26 00:11:05,967][123091] Updated weights for policy 0, policy_version 75698 (0.0010) [2023-12-26 00:11:06,025][123091] Updated weights for policy 0, policy_version 75708 (0.0010) [2023-12-26 00:11:06,214][123090] Updated weights for policy 1, policy_version 75338 (0.0008) [2023-12-26 00:11:06,280][123090] Updated weights for policy 1, policy_version 75348 (0.0008) [2023-12-26 00:11:06,342][123090] Updated weights for policy 1, policy_version 75358 (0.0008) [2023-12-26 00:11:06,963][123091] Updated weights for policy 0, policy_version 75718 (0.0010) [2023-12-26 00:11:07,025][123091] Updated weights for policy 0, policy_version 75728 (0.0009) [2023-12-26 00:11:07,028][123090] Updated weights for policy 1, policy_version 75368 (0.0007) [2023-12-26 00:11:07,087][123091] Updated weights for policy 0, policy_version 75738 (0.0008) [2023-12-26 00:11:07,093][123090] Updated weights for policy 1, policy_version 75378 (0.0009) [2023-12-26 00:11:07,158][123090] Updated weights for policy 1, policy_version 75388 (0.0007) [2023-12-26 00:11:07,843][123090] Updated weights for policy 1, policy_version 75398 (0.0006) [2023-12-26 00:11:07,866][123091] Updated weights for policy 0, policy_version 75748 (0.0008) [2023-12-26 00:11:07,907][123090] Updated weights for policy 1, policy_version 75408 (0.0007) [2023-12-26 00:11:07,919][123091] Updated weights for policy 0, policy_version 75758 (0.0008) [2023-12-26 00:11:07,959][123090] Updated weights for policy 1, policy_version 75418 (0.0010) [2023-12-26 00:11:07,971][123091] Updated weights for policy 0, policy_version 75768 (0.0007) [2023-12-26 00:11:08,665][123090] Updated weights for policy 1, policy_version 75428 (0.0008) [2023-12-26 00:11:08,759][123090] Updated weights for policy 1, policy_version 75438 (0.0009) [2023-12-26 00:11:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17161.5). Total num frames: 38707200. Throughput: 0: 8760.6, 1: 9093.4. Samples: 38689720. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:08,785][121949] Avg episode reward: [(0, '4489.125'), (1, '5334.629')] [2023-12-26 00:11:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000075776_19398656.pth... [2023-12-26 00:11:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000074752_19136512.pth [2023-12-26 00:11:08,819][123090] Updated weights for policy 1, policy_version 75448 (0.0010) [2023-12-26 00:11:08,865][123091] Updated weights for policy 0, policy_version 75778 (0.0007) [2023-12-26 00:11:08,875][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000075456_19316736.pth... [2023-12-26 00:11:08,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000074400_19046400.pth [2023-12-26 00:11:08,917][123091] Updated weights for policy 0, policy_version 75788 (0.0009) [2023-12-26 00:11:08,974][123091] Updated weights for policy 0, policy_version 75798 (0.0010) [2023-12-26 00:11:09,044][123091] Updated weights for policy 0, policy_version 75808 (0.0010) [2023-12-26 00:11:09,388][123090] Updated weights for policy 1, policy_version 75458 (0.0006) [2023-12-26 00:11:09,456][123090] Updated weights for policy 1, policy_version 75468 (0.0010) [2023-12-26 00:11:09,520][123090] Updated weights for policy 1, policy_version 75478 (0.0010) [2023-12-26 00:11:09,587][123090] Updated weights for policy 1, policy_version 75488 (0.0007) [2023-12-26 00:11:09,913][123091] Updated weights for policy 0, policy_version 75818 (0.0010) [2023-12-26 00:11:09,988][123091] Updated weights for policy 0, policy_version 75828 (0.0009) [2023-12-26 00:11:10,057][123091] Updated weights for policy 0, policy_version 75838 (0.0010) [2023-12-26 00:11:10,414][123090] Updated weights for policy 1, policy_version 75498 (0.0009) [2023-12-26 00:11:10,464][123090] Updated weights for policy 1, policy_version 75508 (0.0009) [2023-12-26 00:11:10,519][123090] Updated weights for policy 1, policy_version 75518 (0.0007) [2023-12-26 00:11:10,883][123091] Updated weights for policy 0, policy_version 75848 (0.0008) [2023-12-26 00:11:10,946][123091] Updated weights for policy 0, policy_version 75858 (0.0009) [2023-12-26 00:11:11,011][123091] Updated weights for policy 0, policy_version 75868 (0.0010) [2023-12-26 00:11:11,310][123090] Updated weights for policy 1, policy_version 75528 (0.0010) [2023-12-26 00:11:11,381][123090] Updated weights for policy 1, policy_version 75538 (0.0010) [2023-12-26 00:11:11,448][123090] Updated weights for policy 1, policy_version 75548 (0.0008) [2023-12-26 00:11:11,771][123091] Updated weights for policy 0, policy_version 75878 (0.0010) [2023-12-26 00:11:11,823][123091] Updated weights for policy 0, policy_version 75888 (0.0011) [2023-12-26 00:11:11,875][123091] Updated weights for policy 0, policy_version 75898 (0.0011) [2023-12-26 00:11:12,211][123090] Updated weights for policy 1, policy_version 75558 (0.0007) [2023-12-26 00:11:12,282][123090] Updated weights for policy 1, policy_version 75568 (0.0007) [2023-12-26 00:11:12,346][123090] Updated weights for policy 1, policy_version 75578 (0.0006) [2023-12-26 00:11:12,708][123091] Updated weights for policy 0, policy_version 75908 (0.0011) [2023-12-26 00:11:12,771][123091] Updated weights for policy 0, policy_version 75918 (0.0011) [2023-12-26 00:11:12,835][123091] Updated weights for policy 0, policy_version 75928 (0.0011) [2023-12-26 00:11:13,142][123090] Updated weights for policy 1, policy_version 75588 (0.0008) [2023-12-26 00:11:13,202][123090] Updated weights for policy 1, policy_version 75598 (0.0010) [2023-12-26 00:11:13,262][123090] Updated weights for policy 1, policy_version 75608 (0.0010) [2023-12-26 00:11:13,519][123091] Updated weights for policy 0, policy_version 75938 (0.0009) [2023-12-26 00:11:13,592][123091] Updated weights for policy 0, policy_version 75948 (0.0006) [2023-12-26 00:11:13,666][123091] Updated weights for policy 0, policy_version 75958 (0.0011) [2023-12-26 00:11:13,714][123091] Updated weights for policy 0, policy_version 75968 (0.0010) [2023-12-26 00:11:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17217.1). Total num frames: 38805504. Throughput: 0: 8774.8, 1: 9106.6. Samples: 38796796. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:13,785][121949] Avg episode reward: [(0, '4387.973'), (1, '5258.268')] [2023-12-26 00:11:13,892][123090] Updated weights for policy 1, policy_version 75618 (0.0009) [2023-12-26 00:11:13,939][123090] Updated weights for policy 1, policy_version 75628 (0.0005) [2023-12-26 00:11:13,993][123090] Updated weights for policy 1, policy_version 75638 (0.0005) [2023-12-26 00:11:14,050][123090] Updated weights for policy 1, policy_version 75648 (0.0005) [2023-12-26 00:11:14,509][123091] Updated weights for policy 0, policy_version 75978 (0.0011) [2023-12-26 00:11:14,572][123091] Updated weights for policy 0, policy_version 75988 (0.0011) [2023-12-26 00:11:14,636][123091] Updated weights for policy 0, policy_version 75998 (0.0010) [2023-12-26 00:11:14,704][123090] Updated weights for policy 1, policy_version 75658 (0.0009) [2023-12-26 00:11:14,760][123090] Updated weights for policy 1, policy_version 75668 (0.0009) [2023-12-26 00:11:14,827][123090] Updated weights for policy 1, policy_version 75678 (0.0008) [2023-12-26 00:11:15,463][123091] Updated weights for policy 0, policy_version 76008 (0.0009) [2023-12-26 00:11:15,535][123091] Updated weights for policy 0, policy_version 76018 (0.0011) [2023-12-26 00:11:15,608][123091] Updated weights for policy 0, policy_version 76028 (0.0011) [2023-12-26 00:11:15,688][123090] Updated weights for policy 1, policy_version 75688 (0.0009) [2023-12-26 00:11:15,754][123090] Updated weights for policy 1, policy_version 75698 (0.0009) [2023-12-26 00:11:15,806][123090] Updated weights for policy 1, policy_version 75708 (0.0009) [2023-12-26 00:11:16,405][123091] Updated weights for policy 0, policy_version 76038 (0.0011) [2023-12-26 00:11:16,460][123091] Updated weights for policy 0, policy_version 76048 (0.0010) [2023-12-26 00:11:16,510][123091] Updated weights for policy 0, policy_version 76058 (0.0010) [2023-12-26 00:11:16,637][123090] Updated weights for policy 1, policy_version 75718 (0.0008) [2023-12-26 00:11:16,704][123090] Updated weights for policy 1, policy_version 75728 (0.0009) [2023-12-26 00:11:16,767][123090] Updated weights for policy 1, policy_version 75738 (0.0010) [2023-12-26 00:11:17,335][123091] Updated weights for policy 0, policy_version 76068 (0.0010) [2023-12-26 00:11:17,390][123091] Updated weights for policy 0, policy_version 76078 (0.0010) [2023-12-26 00:11:17,445][123091] Updated weights for policy 0, policy_version 76088 (0.0010) [2023-12-26 00:11:17,493][123090] Updated weights for policy 1, policy_version 75748 (0.0007) [2023-12-26 00:11:17,555][123090] Updated weights for policy 1, policy_version 75758 (0.0006) [2023-12-26 00:11:17,608][123090] Updated weights for policy 1, policy_version 75768 (0.0010) [2023-12-26 00:11:18,265][123091] Updated weights for policy 0, policy_version 76098 (0.0010) [2023-12-26 00:11:18,312][123091] Updated weights for policy 0, policy_version 76108 (0.0010) [2023-12-26 00:11:18,374][123090] Updated weights for policy 1, policy_version 75778 (0.0010) [2023-12-26 00:11:18,382][123091] Updated weights for policy 0, policy_version 76118 (0.0007) [2023-12-26 00:11:18,432][123090] Updated weights for policy 1, policy_version 75788 (0.0010) [2023-12-26 00:11:18,445][123091] Updated weights for policy 0, policy_version 76128 (0.0006) [2023-12-26 00:11:18,492][123090] Updated weights for policy 1, policy_version 75798 (0.0011) [2023-12-26 00:11:18,564][123090] Updated weights for policy 1, policy_version 75808 (0.0011) [2023-12-26 00:11:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17244.9). Total num frames: 38895616. Throughput: 0: 8794.8, 1: 9143.0. Samples: 38903752. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:18,785][121949] Avg episode reward: [(0, '4398.884'), (1, '5213.970')] [2023-12-26 00:11:19,154][123091] Updated weights for policy 0, policy_version 76138 (0.0005) [2023-12-26 00:11:19,210][123091] Updated weights for policy 0, policy_version 76148 (0.0006) [2023-12-26 00:11:19,281][123091] Updated weights for policy 0, policy_version 76158 (0.0008) [2023-12-26 00:11:19,314][123090] Updated weights for policy 1, policy_version 75818 (0.0010) [2023-12-26 00:11:19,386][123090] Updated weights for policy 1, policy_version 75828 (0.0011) [2023-12-26 00:11:19,438][123090] Updated weights for policy 1, policy_version 75838 (0.0010) [2023-12-26 00:11:20,116][123091] Updated weights for policy 0, policy_version 76168 (0.0006) [2023-12-26 00:11:20,173][123091] Updated weights for policy 0, policy_version 76178 (0.0006) [2023-12-26 00:11:20,226][123090] Updated weights for policy 1, policy_version 75848 (0.0007) [2023-12-26 00:11:20,241][123091] Updated weights for policy 0, policy_version 76188 (0.0006) [2023-12-26 00:11:20,298][123090] Updated weights for policy 1, policy_version 75858 (0.0006) [2023-12-26 00:11:20,358][123090] Updated weights for policy 1, policy_version 75868 (0.0005) [2023-12-26 00:11:21,082][123091] Updated weights for policy 0, policy_version 76198 (0.0008) [2023-12-26 00:11:21,134][123090] Updated weights for policy 1, policy_version 75878 (0.0009) [2023-12-26 00:11:21,152][123091] Updated weights for policy 0, policy_version 76208 (0.0009) [2023-12-26 00:11:21,204][123090] Updated weights for policy 1, policy_version 75888 (0.0008) [2023-12-26 00:11:21,218][123091] Updated weights for policy 0, policy_version 76218 (0.0009) [2023-12-26 00:11:21,272][123090] Updated weights for policy 1, policy_version 75898 (0.0009) [2023-12-26 00:11:22,069][123091] Updated weights for policy 0, policy_version 76228 (0.0009) [2023-12-26 00:11:22,093][123090] Updated weights for policy 1, policy_version 75908 (0.0011) [2023-12-26 00:11:22,130][123091] Updated weights for policy 0, policy_version 76238 (0.0006) [2023-12-26 00:11:22,153][123090] Updated weights for policy 1, policy_version 75918 (0.0011) [2023-12-26 00:11:22,186][123091] Updated weights for policy 0, policy_version 76248 (0.0006) [2023-12-26 00:11:22,213][123090] Updated weights for policy 1, policy_version 75928 (0.0010) [2023-12-26 00:11:22,993][123090] Updated weights for policy 1, policy_version 75938 (0.0007) [2023-12-26 00:11:23,058][123090] Updated weights for policy 1, policy_version 75948 (0.0006) [2023-12-26 00:11:23,099][123091] Updated weights for policy 0, policy_version 76258 (0.0008) [2023-12-26 00:11:23,122][123090] Updated weights for policy 1, policy_version 75958 (0.0006) [2023-12-26 00:11:23,164][123091] Updated weights for policy 0, policy_version 76268 (0.0009) [2023-12-26 00:11:23,194][123090] Updated weights for policy 1, policy_version 75968 (0.0005) [2023-12-26 00:11:23,227][123091] Updated weights for policy 0, policy_version 76278 (0.0009) [2023-12-26 00:11:23,294][123091] Updated weights for policy 0, policy_version 76288 (0.0010) [2023-12-26 00:11:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17244.9). Total num frames: 38977536. Throughput: 0: 8739.3, 1: 9103.8. Samples: 38957160. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:23,785][121949] Avg episode reward: [(0, '4426.860'), (1, '5254.507')] [2023-12-26 00:11:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000076288_19529728.pth... [2023-12-26 00:11:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000075264_19267584.pth [2023-12-26 00:11:23,851][123090] Updated weights for policy 1, policy_version 75978 (0.0007) [2023-12-26 00:11:23,914][123090] Updated weights for policy 1, policy_version 75988 (0.0008) [2023-12-26 00:11:23,982][123090] Updated weights for policy 1, policy_version 75998 (0.0010) [2023-12-26 00:11:23,995][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000076000_19456000.pth... [2023-12-26 00:11:23,999][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000074912_19177472.pth [2023-12-26 00:11:24,129][123091] Updated weights for policy 0, policy_version 76298 (0.0005) [2023-12-26 00:11:24,197][123091] Updated weights for policy 0, policy_version 76308 (0.0005) [2023-12-26 00:11:24,255][123091] Updated weights for policy 0, policy_version 76318 (0.0009) [2023-12-26 00:11:24,834][123090] Updated weights for policy 1, policy_version 76009 (0.0009) [2023-12-26 00:11:24,887][123090] Updated weights for policy 1, policy_version 76019 (0.0008) [2023-12-26 00:11:24,940][123090] Updated weights for policy 1, policy_version 76029 (0.0008) [2023-12-26 00:11:24,955][123091] Updated weights for policy 0, policy_version 76328 (0.0009) [2023-12-26 00:11:25,017][123091] Updated weights for policy 0, policy_version 76338 (0.0010) [2023-12-26 00:11:25,090][123091] Updated weights for policy 0, policy_version 76348 (0.0010) [2023-12-26 00:11:25,636][123090] Updated weights for policy 1, policy_version 76039 (0.0006) [2023-12-26 00:11:25,708][123090] Updated weights for policy 1, policy_version 76049 (0.0008) [2023-12-26 00:11:25,780][123090] Updated weights for policy 1, policy_version 76059 (0.0010) [2023-12-26 00:11:25,847][123091] Updated weights for policy 0, policy_version 76358 (0.0010) [2023-12-26 00:11:25,902][123091] Updated weights for policy 0, policy_version 76368 (0.0010) [2023-12-26 00:11:25,950][123091] Updated weights for policy 0, policy_version 76378 (0.0010) [2023-12-26 00:11:26,552][123090] Updated weights for policy 1, policy_version 76069 (0.0007) [2023-12-26 00:11:26,609][123090] Updated weights for policy 1, policy_version 76079 (0.0005) [2023-12-26 00:11:26,656][123090] Updated weights for policy 1, policy_version 76089 (0.0005) [2023-12-26 00:11:26,666][123091] Updated weights for policy 0, policy_version 76388 (0.0011) [2023-12-26 00:11:26,714][123091] Updated weights for policy 0, policy_version 76398 (0.0010) [2023-12-26 00:11:26,762][123091] Updated weights for policy 0, policy_version 76408 (0.0010) [2023-12-26 00:11:27,451][123091] Updated weights for policy 0, policy_version 76418 (0.0008) [2023-12-26 00:11:27,469][123090] Updated weights for policy 1, policy_version 76099 (0.0006) [2023-12-26 00:11:27,512][123091] Updated weights for policy 0, policy_version 76428 (0.0008) [2023-12-26 00:11:27,528][123090] Updated weights for policy 1, policy_version 76109 (0.0009) [2023-12-26 00:11:27,574][123091] Updated weights for policy 0, policy_version 76438 (0.0007) [2023-12-26 00:11:27,592][123090] Updated weights for policy 1, policy_version 76119 (0.0008) [2023-12-26 00:11:27,633][123091] Updated weights for policy 0, policy_version 76448 (0.0006) [2023-12-26 00:11:28,403][123090] Updated weights for policy 1, policy_version 76129 (0.0009) [2023-12-26 00:11:28,426][123091] Updated weights for policy 0, policy_version 76458 (0.0011) [2023-12-26 00:11:28,467][123090] Updated weights for policy 1, policy_version 76139 (0.0007) [2023-12-26 00:11:28,485][123091] Updated weights for policy 0, policy_version 76468 (0.0010) [2023-12-26 00:11:28,535][123090] Updated weights for policy 1, policy_version 76149 (0.0008) [2023-12-26 00:11:28,536][123091] Updated weights for policy 0, policy_version 76478 (0.0010) [2023-12-26 00:11:28,602][123090] Updated weights for policy 1, policy_version 76159 (0.0008) [2023-12-26 00:11:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17272.6). Total num frames: 39075840. Throughput: 0: 8794.6, 1: 9092.4. Samples: 39065644. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:28,785][121949] Avg episode reward: [(0, '4332.272'), (1, '5327.629')] [2023-12-26 00:11:29,322][123090] Updated weights for policy 1, policy_version 76169 (0.0010) [2023-12-26 00:11:29,339][123091] Updated weights for policy 0, policy_version 76488 (0.0011) [2023-12-26 00:11:29,387][123090] Updated weights for policy 1, policy_version 76179 (0.0011) [2023-12-26 00:11:29,406][123091] Updated weights for policy 0, policy_version 76498 (0.0010) [2023-12-26 00:11:29,450][123090] Updated weights for policy 1, policy_version 76189 (0.0011) [2023-12-26 00:11:29,468][123091] Updated weights for policy 0, policy_version 76508 (0.0009) [2023-12-26 00:11:30,218][123091] Updated weights for policy 0, policy_version 76518 (0.0008) [2023-12-26 00:11:30,235][123090] Updated weights for policy 1, policy_version 76199 (0.0007) [2023-12-26 00:11:30,280][123091] Updated weights for policy 0, policy_version 76528 (0.0009) [2023-12-26 00:11:30,299][123090] Updated weights for policy 1, policy_version 76209 (0.0006) [2023-12-26 00:11:30,344][123091] Updated weights for policy 0, policy_version 76538 (0.0008) [2023-12-26 00:11:30,355][123090] Updated weights for policy 1, policy_version 76219 (0.0005) [2023-12-26 00:11:31,134][123090] Updated weights for policy 1, policy_version 76229 (0.0008) [2023-12-26 00:11:31,169][123091] Updated weights for policy 0, policy_version 76548 (0.0008) [2023-12-26 00:11:31,202][123090] Updated weights for policy 1, policy_version 76239 (0.0010) [2023-12-26 00:11:31,235][123091] Updated weights for policy 0, policy_version 76558 (0.0008) [2023-12-26 00:11:31,258][123090] Updated weights for policy 1, policy_version 76249 (0.0010) [2023-12-26 00:11:31,299][123091] Updated weights for policy 0, policy_version 76568 (0.0009) [2023-12-26 00:11:32,018][123090] Updated weights for policy 1, policy_version 76259 (0.0011) [2023-12-26 00:11:32,077][123090] Updated weights for policy 1, policy_version 76269 (0.0007) [2023-12-26 00:11:32,135][123090] Updated weights for policy 1, policy_version 76279 (0.0005) [2023-12-26 00:11:32,148][123091] Updated weights for policy 0, policy_version 76578 (0.0009) [2023-12-26 00:11:32,211][123091] Updated weights for policy 0, policy_version 76588 (0.0010) [2023-12-26 00:11:32,281][123091] Updated weights for policy 0, policy_version 76598 (0.0011) [2023-12-26 00:11:32,349][123091] Updated weights for policy 0, policy_version 76608 (0.0007) [2023-12-26 00:11:32,830][123090] Updated weights for policy 1, policy_version 76289 (0.0005) [2023-12-26 00:11:32,883][123090] Updated weights for policy 1, policy_version 76299 (0.0005) [2023-12-26 00:11:32,934][123090] Updated weights for policy 1, policy_version 76309 (0.0005) [2023-12-26 00:11:32,983][123090] Updated weights for policy 1, policy_version 76319 (0.0005) [2023-12-26 00:11:33,058][123091] Updated weights for policy 0, policy_version 76618 (0.0005) [2023-12-26 00:11:33,119][123091] Updated weights for policy 0, policy_version 76628 (0.0005) [2023-12-26 00:11:33,170][123091] Updated weights for policy 0, policy_version 76638 (0.0006) [2023-12-26 00:11:33,692][123090] Updated weights for policy 1, policy_version 76329 (0.0010) [2023-12-26 00:11:33,754][123090] Updated weights for policy 1, policy_version 76339 (0.0010) [2023-12-26 00:11:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17272.6). Total num frames: 39157760. Throughput: 0: 8822.6, 1: 9126.9. Samples: 39176964. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:33,785][121949] Avg episode reward: [(0, '4349.525'), (1, '5442.449')] [2023-12-26 00:11:33,793][123091] Updated weights for policy 0, policy_version 76648 (0.0005) [2023-12-26 00:11:33,821][123090] Updated weights for policy 1, policy_version 76349 (0.0010) [2023-12-26 00:11:33,857][123091] Updated weights for policy 0, policy_version 76658 (0.0005) [2023-12-26 00:11:33,929][123091] Updated weights for policy 0, policy_version 76668 (0.0005) [2023-12-26 00:11:34,664][123090] Updated weights for policy 1, policy_version 76359 (0.0011) [2023-12-26 00:11:34,669][123091] Updated weights for policy 0, policy_version 76678 (0.0008) [2023-12-26 00:11:34,725][123091] Updated weights for policy 0, policy_version 76688 (0.0010) [2023-12-26 00:11:34,728][123090] Updated weights for policy 1, policy_version 76369 (0.0011) [2023-12-26 00:11:34,784][123091] Updated weights for policy 0, policy_version 76698 (0.0010) [2023-12-26 00:11:34,791][123090] Updated weights for policy 1, policy_version 76379 (0.0010) [2023-12-26 00:11:35,486][123091] Updated weights for policy 0, policy_version 76708 (0.0008) [2023-12-26 00:11:35,552][123091] Updated weights for policy 0, policy_version 76718 (0.0005) [2023-12-26 00:11:35,600][123090] Updated weights for policy 1, policy_version 76389 (0.0010) [2023-12-26 00:11:35,627][123091] Updated weights for policy 0, policy_version 76728 (0.0005) [2023-12-26 00:11:35,663][123090] Updated weights for policy 1, policy_version 76399 (0.0011) [2023-12-26 00:11:35,726][123090] Updated weights for policy 1, policy_version 76409 (0.0010) [2023-12-26 00:11:36,347][123091] Updated weights for policy 0, policy_version 76738 (0.0008) [2023-12-26 00:11:36,410][123091] Updated weights for policy 0, policy_version 76748 (0.0011) [2023-12-26 00:11:36,475][123091] Updated weights for policy 0, policy_version 76758 (0.0011) [2023-12-26 00:11:36,544][123091] Updated weights for policy 0, policy_version 76768 (0.0011) [2023-12-26 00:11:36,557][123090] Updated weights for policy 1, policy_version 76419 (0.0011) [2023-12-26 00:11:36,629][123090] Updated weights for policy 1, policy_version 76429 (0.0011) [2023-12-26 00:11:36,702][123090] Updated weights for policy 1, policy_version 76439 (0.0011) [2023-12-26 00:11:37,294][123091] Updated weights for policy 0, policy_version 76778 (0.0005) [2023-12-26 00:11:37,364][123091] Updated weights for policy 0, policy_version 76788 (0.0005) [2023-12-26 00:11:37,436][123091] Updated weights for policy 0, policy_version 76798 (0.0005) [2023-12-26 00:11:37,506][123090] Updated weights for policy 1, policy_version 76449 (0.0011) [2023-12-26 00:11:37,569][123090] Updated weights for policy 1, policy_version 76459 (0.0010) [2023-12-26 00:11:37,632][123090] Updated weights for policy 1, policy_version 76469 (0.0010) [2023-12-26 00:11:37,694][123090] Updated weights for policy 1, policy_version 76479 (0.0011) [2023-12-26 00:11:38,010][123091] Updated weights for policy 0, policy_version 76808 (0.0005) [2023-12-26 00:11:38,073][123091] Updated weights for policy 0, policy_version 76818 (0.0006) [2023-12-26 00:11:38,146][123091] Updated weights for policy 0, policy_version 76828 (0.0006) [2023-12-26 00:11:38,467][123090] Updated weights for policy 1, policy_version 76489 (0.0009) [2023-12-26 00:11:38,524][123090] Updated weights for policy 1, policy_version 76499 (0.0008) [2023-12-26 00:11:38,588][123090] Updated weights for policy 1, policy_version 76509 (0.0009) [2023-12-26 00:11:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17328.2). Total num frames: 39256064. Throughput: 0: 8898.4, 1: 9108.5. Samples: 39230384. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:38,785][121949] Avg episode reward: [(0, '4394.412'), (1, '5408.596')] [2023-12-26 00:11:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000076832_19668992.pth... [2023-12-26 00:11:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000076512_19587072.pth... [2023-12-26 00:11:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000075776_19398656.pth [2023-12-26 00:11:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000075456_19316736.pth [2023-12-26 00:11:38,893][123091] Updated weights for policy 0, policy_version 76838 (0.0008) [2023-12-26 00:11:38,962][123091] Updated weights for policy 0, policy_version 76848 (0.0009) [2023-12-26 00:11:39,019][123091] Updated weights for policy 0, policy_version 76858 (0.0010) [2023-12-26 00:11:39,324][123090] Updated weights for policy 1, policy_version 76519 (0.0010) [2023-12-26 00:11:39,397][123090] Updated weights for policy 1, policy_version 76529 (0.0009) [2023-12-26 00:11:39,477][123090] Updated weights for policy 1, policy_version 76539 (0.0010) [2023-12-26 00:11:39,805][123091] Updated weights for policy 0, policy_version 76868 (0.0009) [2023-12-26 00:11:39,873][123091] Updated weights for policy 0, policy_version 76878 (0.0009) [2023-12-26 00:11:39,948][123091] Updated weights for policy 0, policy_version 76888 (0.0010) [2023-12-26 00:11:40,353][123090] Updated weights for policy 1, policy_version 76549 (0.0008) [2023-12-26 00:11:40,421][123090] Updated weights for policy 1, policy_version 76559 (0.0005) [2023-12-26 00:11:40,493][123090] Updated weights for policy 1, policy_version 76569 (0.0006) [2023-12-26 00:11:40,660][123091] Updated weights for policy 0, policy_version 76898 (0.0008) [2023-12-26 00:11:40,723][123091] Updated weights for policy 0, policy_version 76908 (0.0008) [2023-12-26 00:11:40,782][123091] Updated weights for policy 0, policy_version 76918 (0.0010) [2023-12-26 00:11:40,839][123091] Updated weights for policy 0, policy_version 76928 (0.0010) [2023-12-26 00:11:41,231][123090] Updated weights for policy 1, policy_version 76579 (0.0009) [2023-12-26 00:11:41,303][123090] Updated weights for policy 1, policy_version 76589 (0.0010) [2023-12-26 00:11:41,375][123090] Updated weights for policy 1, policy_version 76599 (0.0009) [2023-12-26 00:11:41,720][123091] Updated weights for policy 0, policy_version 76938 (0.0010) [2023-12-26 00:11:41,778][123091] Updated weights for policy 0, policy_version 76948 (0.0010) [2023-12-26 00:11:41,836][123091] Updated weights for policy 0, policy_version 76958 (0.0009) [2023-12-26 00:11:42,231][123090] Updated weights for policy 1, policy_version 76609 (0.0009) [2023-12-26 00:11:42,308][123090] Updated weights for policy 1, policy_version 76619 (0.0010) [2023-12-26 00:11:42,377][123090] Updated weights for policy 1, policy_version 76629 (0.0009) [2023-12-26 00:11:42,439][123090] Updated weights for policy 1, policy_version 76639 (0.0009) [2023-12-26 00:11:42,700][123091] Updated weights for policy 0, policy_version 76968 (0.0010) [2023-12-26 00:11:42,752][123091] Updated weights for policy 0, policy_version 76978 (0.0010) [2023-12-26 00:11:42,815][123091] Updated weights for policy 0, policy_version 76988 (0.0010) [2023-12-26 00:11:43,275][123090] Updated weights for policy 1, policy_version 76649 (0.0010) [2023-12-26 00:11:43,337][123090] Updated weights for policy 1, policy_version 76659 (0.0008) [2023-12-26 00:11:43,403][123090] Updated weights for policy 1, policy_version 76669 (0.0009) [2023-12-26 00:11:43,618][123091] Updated weights for policy 0, policy_version 76998 (0.0010) [2023-12-26 00:11:43,678][123091] Updated weights for policy 0, policy_version 77008 (0.0008) [2023-12-26 00:11:43,730][123091] Updated weights for policy 0, policy_version 77018 (0.0011) [2023-12-26 00:11:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17355.9). Total num frames: 39346176. Throughput: 0: 8822.8, 1: 9056.1. Samples: 39336124. Policy #0 lag: (min: 6.0, avg: 12.3, max: 38.0) [2023-12-26 00:11:43,785][121949] Avg episode reward: [(0, '4478.681'), (1, '5314.944')] [2023-12-26 00:11:44,226][123090] Updated weights for policy 1, policy_version 76679 (0.0010) [2023-12-26 00:11:44,292][123090] Updated weights for policy 1, policy_version 76689 (0.0008) [2023-12-26 00:11:44,356][123090] Updated weights for policy 1, policy_version 76699 (0.0009) [2023-12-26 00:11:44,543][123091] Updated weights for policy 0, policy_version 77028 (0.0009) [2023-12-26 00:11:44,604][123091] Updated weights for policy 0, policy_version 77038 (0.0010) [2023-12-26 00:11:44,668][123091] Updated weights for policy 0, policy_version 77048 (0.0009) [2023-12-26 00:11:45,210][123090] Updated weights for policy 1, policy_version 76709 (0.0008) [2023-12-26 00:11:45,279][123090] Updated weights for policy 1, policy_version 76719 (0.0009) [2023-12-26 00:11:45,337][123090] Updated weights for policy 1, policy_version 76729 (0.0010) [2023-12-26 00:11:45,412][123091] Updated weights for policy 0, policy_version 77058 (0.0008) [2023-12-26 00:11:45,466][123091] Updated weights for policy 0, policy_version 77068 (0.0007) [2023-12-26 00:11:45,534][123091] Updated weights for policy 0, policy_version 77078 (0.0009) [2023-12-26 00:11:45,592][123091] Updated weights for policy 0, policy_version 77088 (0.0008) [2023-12-26 00:11:46,179][123090] Updated weights for policy 1, policy_version 76739 (0.0009) [2023-12-26 00:11:46,238][123090] Updated weights for policy 1, policy_version 76749 (0.0006) [2023-12-26 00:11:46,284][123091] Updated weights for policy 0, policy_version 77098 (0.0008) [2023-12-26 00:11:46,289][123090] Updated weights for policy 1, policy_version 76759 (0.0006) [2023-12-26 00:11:46,336][123091] Updated weights for policy 0, policy_version 77108 (0.0008) [2023-12-26 00:11:46,386][123091] Updated weights for policy 0, policy_version 77118 (0.0009) [2023-12-26 00:11:47,083][123090] Updated weights for policy 1, policy_version 76769 (0.0008) [2023-12-26 00:11:47,142][123090] Updated weights for policy 1, policy_version 76779 (0.0010) [2023-12-26 00:11:47,199][123090] Updated weights for policy 1, policy_version 76789 (0.0008) [2023-12-26 00:11:47,206][123091] Updated weights for policy 0, policy_version 77128 (0.0009) [2023-12-26 00:11:47,259][123090] Updated weights for policy 1, policy_version 76799 (0.0009) [2023-12-26 00:11:47,267][123091] Updated weights for policy 0, policy_version 77138 (0.0007) [2023-12-26 00:11:47,324][123091] Updated weights for policy 0, policy_version 77148 (0.0010) [2023-12-26 00:11:48,030][123090] Updated weights for policy 1, policy_version 76809 (0.0010) [2023-12-26 00:11:48,084][123090] Updated weights for policy 1, policy_version 76819 (0.0010) [2023-12-26 00:11:48,133][123091] Updated weights for policy 0, policy_version 77158 (0.0010) [2023-12-26 00:11:48,137][123090] Updated weights for policy 1, policy_version 76829 (0.0007) [2023-12-26 00:11:48,185][123091] Updated weights for policy 0, policy_version 77168 (0.0009) [2023-12-26 00:11:48,234][123091] Updated weights for policy 0, policy_version 77178 (0.0009) [2023-12-26 00:11:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17355.9). Total num frames: 39428096. Throughput: 0: 8844.0, 1: 9040.3. Samples: 39441488. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:11:48,786][121949] Avg episode reward: [(0, '4347.169'), (1, '5342.891')] [2023-12-26 00:11:49,004][123090] Updated weights for policy 1, policy_version 76839 (0.0009) [2023-12-26 00:11:49,062][123090] Updated weights for policy 1, policy_version 76849 (0.0009) [2023-12-26 00:11:49,082][123091] Updated weights for policy 0, policy_version 77188 (0.0009) [2023-12-26 00:11:49,123][123090] Updated weights for policy 1, policy_version 76859 (0.0009) [2023-12-26 00:11:49,144][123091] Updated weights for policy 0, policy_version 77198 (0.0007) [2023-12-26 00:11:49,207][123091] Updated weights for policy 0, policy_version 77208 (0.0008) [2023-12-26 00:11:49,945][123090] Updated weights for policy 1, policy_version 76869 (0.0009) [2023-12-26 00:11:50,004][123090] Updated weights for policy 1, policy_version 76879 (0.0009) [2023-12-26 00:11:50,062][123090] Updated weights for policy 1, policy_version 76889 (0.0010) [2023-12-26 00:11:50,103][123091] Updated weights for policy 0, policy_version 77218 (0.0009) [2023-12-26 00:11:50,173][123091] Updated weights for policy 0, policy_version 77228 (0.0009) [2023-12-26 00:11:50,243][123091] Updated weights for policy 0, policy_version 77238 (0.0010) [2023-12-26 00:11:50,298][123091] Updated weights for policy 0, policy_version 77248 (0.0010) [2023-12-26 00:11:50,850][123090] Updated weights for policy 1, policy_version 76899 (0.0008) [2023-12-26 00:11:50,909][123090] Updated weights for policy 1, policy_version 76909 (0.0010) [2023-12-26 00:11:50,964][123090] Updated weights for policy 1, policy_version 76919 (0.0010) [2023-12-26 00:11:51,154][123091] Updated weights for policy 0, policy_version 77258 (0.0010) [2023-12-26 00:11:51,215][123091] Updated weights for policy 0, policy_version 77268 (0.0009) [2023-12-26 00:11:51,283][123091] Updated weights for policy 0, policy_version 77278 (0.0009) [2023-12-26 00:11:51,848][123090] Updated weights for policy 1, policy_version 76929 (0.0010) [2023-12-26 00:11:51,911][123090] Updated weights for policy 1, policy_version 76939 (0.0010) [2023-12-26 00:11:51,966][123090] Updated weights for policy 1, policy_version 76949 (0.0010) [2023-12-26 00:11:52,030][123090] Updated weights for policy 1, policy_version 76959 (0.0010) [2023-12-26 00:11:52,163][123091] Updated weights for policy 0, policy_version 77288 (0.0009) [2023-12-26 00:11:52,216][123091] Updated weights for policy 0, policy_version 77298 (0.0009) [2023-12-26 00:11:52,278][123091] Updated weights for policy 0, policy_version 77308 (0.0009) [2023-12-26 00:11:52,836][123090] Updated weights for policy 1, policy_version 76969 (0.0010) [2023-12-26 00:11:52,888][123090] Updated weights for policy 1, policy_version 76979 (0.0009) [2023-12-26 00:11:52,953][123090] Updated weights for policy 1, policy_version 76989 (0.0009) [2023-12-26 00:11:53,119][123091] Updated weights for policy 0, policy_version 77318 (0.0009) [2023-12-26 00:11:53,187][123091] Updated weights for policy 0, policy_version 77328 (0.0009) [2023-12-26 00:11:53,255][123091] Updated weights for policy 0, policy_version 77338 (0.0009) [2023-12-26 00:11:53,784][121949] Fps is (10 sec: 16383.4, 60 sec: 17749.3, 300 sec: 17355.9). Total num frames: 39510016. Throughput: 0: 8868.1, 1: 8947.9. Samples: 39491448. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:11:53,786][121949] Avg episode reward: [(0, '4203.891'), (1, '5414.815')] [2023-12-26 00:11:53,789][123090] Updated weights for policy 1, policy_version 76999 (0.0010) [2023-12-26 00:11:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000077344_19800064.pth... [2023-12-26 00:11:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000076288_19529728.pth [2023-12-26 00:11:53,858][123090] Updated weights for policy 1, policy_version 77009 (0.0009) [2023-12-26 00:11:53,922][123090] Updated weights for policy 1, policy_version 77019 (0.0009) [2023-12-26 00:11:53,944][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000077024_19718144.pth... [2023-12-26 00:11:53,948][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000076000_19456000.pth [2023-12-26 00:11:53,996][123091] Updated weights for policy 0, policy_version 77348 (0.0009) [2023-12-26 00:11:54,060][123091] Updated weights for policy 0, policy_version 77358 (0.0010) [2023-12-26 00:11:54,121][123091] Updated weights for policy 0, policy_version 77368 (0.0006) [2023-12-26 00:11:54,726][123090] Updated weights for policy 1, policy_version 77029 (0.0008) [2023-12-26 00:11:54,792][123090] Updated weights for policy 1, policy_version 77039 (0.0006) [2023-12-26 00:11:54,818][123091] Updated weights for policy 0, policy_version 77378 (0.0007) [2023-12-26 00:11:54,845][123090] Updated weights for policy 1, policy_version 77049 (0.0005) [2023-12-26 00:11:54,882][123091] Updated weights for policy 0, policy_version 77388 (0.0006) [2023-12-26 00:11:54,938][123091] Updated weights for policy 0, policy_version 77398 (0.0008) [2023-12-26 00:11:54,990][123091] Updated weights for policy 0, policy_version 77408 (0.0009) [2023-12-26 00:11:55,586][123090] Updated weights for policy 1, policy_version 77059 (0.0006) [2023-12-26 00:11:55,641][123090] Updated weights for policy 1, policy_version 77069 (0.0009) [2023-12-26 00:11:55,698][123090] Updated weights for policy 1, policy_version 77079 (0.0008) [2023-12-26 00:11:55,815][123091] Updated weights for policy 0, policy_version 77418 (0.0006) [2023-12-26 00:11:55,877][123091] Updated weights for policy 0, policy_version 77428 (0.0008) [2023-12-26 00:11:55,924][123091] Updated weights for policy 0, policy_version 77438 (0.0010) [2023-12-26 00:11:56,473][123090] Updated weights for policy 1, policy_version 77089 (0.0007) [2023-12-26 00:11:56,544][123090] Updated weights for policy 1, policy_version 77099 (0.0010) [2023-12-26 00:11:56,611][123090] Updated weights for policy 1, policy_version 77109 (0.0010) [2023-12-26 00:11:56,655][123091] Updated weights for policy 0, policy_version 77448 (0.0006) [2023-12-26 00:11:56,677][123090] Updated weights for policy 1, policy_version 77119 (0.0009) [2023-12-26 00:11:56,708][123091] Updated weights for policy 0, policy_version 77458 (0.0007) [2023-12-26 00:11:56,757][123091] Updated weights for policy 0, policy_version 77468 (0.0008) [2023-12-26 00:11:57,514][123090] Updated weights for policy 1, policy_version 77129 (0.0010) [2023-12-26 00:11:57,534][123091] Updated weights for policy 0, policy_version 77478 (0.0009) [2023-12-26 00:11:57,572][123090] Updated weights for policy 1, policy_version 77139 (0.0008) [2023-12-26 00:11:57,587][123091] Updated weights for policy 0, policy_version 77488 (0.0009) [2023-12-26 00:11:57,636][123090] Updated weights for policy 1, policy_version 77149 (0.0007) [2023-12-26 00:11:57,638][123091] Updated weights for policy 0, policy_version 77498 (0.0008) [2023-12-26 00:11:58,513][123090] Updated weights for policy 1, policy_version 77159 (0.0008) [2023-12-26 00:11:58,552][123091] Updated weights for policy 0, policy_version 77508 (0.0009) [2023-12-26 00:11:58,578][123090] Updated weights for policy 1, policy_version 77169 (0.0009) [2023-12-26 00:11:58,622][123091] Updated weights for policy 0, policy_version 77518 (0.0008) [2023-12-26 00:11:58,651][123090] Updated weights for policy 1, policy_version 77179 (0.0007) [2023-12-26 00:11:58,691][123091] Updated weights for policy 0, policy_version 77528 (0.0008) [2023-12-26 00:11:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17383.7). Total num frames: 39608320. Throughput: 0: 8944.0, 1: 8854.9. Samples: 39597744. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:11:58,785][121949] Avg episode reward: [(0, '4267.584'), (1, '5247.828')] [2023-12-26 00:11:59,499][123090] Updated weights for policy 1, policy_version 77189 (0.0008) [2023-12-26 00:11:59,566][123090] Updated weights for policy 1, policy_version 77199 (0.0005) [2023-12-26 00:11:59,617][123091] Updated weights for policy 0, policy_version 77539 (0.0008) [2023-12-26 00:11:59,632][123090] Updated weights for policy 1, policy_version 77209 (0.0009) [2023-12-26 00:11:59,678][123091] Updated weights for policy 0, policy_version 77549 (0.0009) [2023-12-26 00:11:59,735][123091] Updated weights for policy 0, policy_version 77559 (0.0009) [2023-12-26 00:12:00,367][123090] Updated weights for policy 1, policy_version 77219 (0.0006) [2023-12-26 00:12:00,424][123090] Updated weights for policy 1, policy_version 77229 (0.0006) [2023-12-26 00:12:00,478][123090] Updated weights for policy 1, policy_version 77239 (0.0005) [2023-12-26 00:12:00,637][123091] Updated weights for policy 0, policy_version 77569 (0.0010) [2023-12-26 00:12:00,697][123091] Updated weights for policy 0, policy_version 77579 (0.0010) [2023-12-26 00:12:00,750][123091] Updated weights for policy 0, policy_version 77589 (0.0010) [2023-12-26 00:12:00,802][123091] Updated weights for policy 0, policy_version 77599 (0.0009) [2023-12-26 00:12:01,177][123090] Updated weights for policy 1, policy_version 77249 (0.0007) [2023-12-26 00:12:01,242][123090] Updated weights for policy 1, policy_version 77259 (0.0009) [2023-12-26 00:12:01,314][123090] Updated weights for policy 1, policy_version 77269 (0.0010) [2023-12-26 00:12:01,377][123090] Updated weights for policy 1, policy_version 77279 (0.0010) [2023-12-26 00:12:01,719][123091] Updated weights for policy 0, policy_version 77609 (0.0009) [2023-12-26 00:12:01,782][123091] Updated weights for policy 0, policy_version 77619 (0.0008) [2023-12-26 00:12:01,847][123091] Updated weights for policy 0, policy_version 77629 (0.0008) [2023-12-26 00:12:02,192][123090] Updated weights for policy 1, policy_version 77289 (0.0010) [2023-12-26 00:12:02,248][123090] Updated weights for policy 1, policy_version 77299 (0.0010) [2023-12-26 00:12:02,312][123090] Updated weights for policy 1, policy_version 77309 (0.0011) [2023-12-26 00:12:02,553][123091] Updated weights for policy 0, policy_version 77639 (0.0006) [2023-12-26 00:12:02,619][123091] Updated weights for policy 0, policy_version 77649 (0.0005) [2023-12-26 00:12:02,674][123091] Updated weights for policy 0, policy_version 77659 (0.0006) [2023-12-26 00:12:03,148][123090] Updated weights for policy 1, policy_version 77319 (0.0007) [2023-12-26 00:12:03,206][123090] Updated weights for policy 1, policy_version 77329 (0.0005) [2023-12-26 00:12:03,267][123090] Updated weights for policy 1, policy_version 77339 (0.0005) [2023-12-26 00:12:03,323][123091] Updated weights for policy 0, policy_version 77669 (0.0005) [2023-12-26 00:12:03,399][123091] Updated weights for policy 0, policy_version 77679 (0.0005) [2023-12-26 00:12:03,466][123091] Updated weights for policy 0, policy_version 77689 (0.0005) [2023-12-26 00:12:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.2, 300 sec: 17411.5). Total num frames: 39690240. Throughput: 0: 8916.0, 1: 8833.7. Samples: 39702496. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:03,785][121949] Avg episode reward: [(0, '4345.005'), (1, '5179.308')] [2023-12-26 00:12:03,913][123090] Updated weights for policy 1, policy_version 77349 (0.0007) [2023-12-26 00:12:03,980][123090] Updated weights for policy 1, policy_version 77359 (0.0008) [2023-12-26 00:12:04,046][123090] Updated weights for policy 1, policy_version 77369 (0.0009) [2023-12-26 00:12:04,094][123091] Updated weights for policy 0, policy_version 77699 (0.0007) [2023-12-26 00:12:04,159][123091] Updated weights for policy 0, policy_version 77709 (0.0010) [2023-12-26 00:12:04,224][123091] Updated weights for policy 0, policy_version 77719 (0.0009) [2023-12-26 00:12:04,878][123090] Updated weights for policy 1, policy_version 77379 (0.0009) [2023-12-26 00:12:04,937][123090] Updated weights for policy 1, policy_version 77389 (0.0008) [2023-12-26 00:12:04,983][123090] Updated weights for policy 1, policy_version 77399 (0.0006) [2023-12-26 00:12:05,084][123091] Updated weights for policy 0, policy_version 77729 (0.0009) [2023-12-26 00:12:05,147][123091] Updated weights for policy 0, policy_version 77739 (0.0010) [2023-12-26 00:12:05,197][123091] Updated weights for policy 0, policy_version 77749 (0.0010) [2023-12-26 00:12:05,255][123091] Updated weights for policy 0, policy_version 77759 (0.0010) [2023-12-26 00:12:05,743][123090] Updated weights for policy 1, policy_version 77409 (0.0007) [2023-12-26 00:12:05,805][123090] Updated weights for policy 1, policy_version 77419 (0.0009) [2023-12-26 00:12:05,852][123090] Updated weights for policy 1, policy_version 77429 (0.0005) [2023-12-26 00:12:05,903][123090] Updated weights for policy 1, policy_version 77439 (0.0005) [2023-12-26 00:12:06,164][123091] Updated weights for policy 0, policy_version 77769 (0.0007) [2023-12-26 00:12:06,233][123091] Updated weights for policy 0, policy_version 77779 (0.0006) [2023-12-26 00:12:06,304][123091] Updated weights for policy 0, policy_version 77789 (0.0005) [2023-12-26 00:12:06,755][123090] Updated weights for policy 1, policy_version 77449 (0.0010) [2023-12-26 00:12:06,826][123090] Updated weights for policy 1, policy_version 77459 (0.0011) [2023-12-26 00:12:06,899][123090] Updated weights for policy 1, policy_version 77469 (0.0010) [2023-12-26 00:12:07,053][123091] Updated weights for policy 0, policy_version 77799 (0.0007) [2023-12-26 00:12:07,116][123091] Updated weights for policy 0, policy_version 77809 (0.0009) [2023-12-26 00:12:07,171][123091] Updated weights for policy 0, policy_version 77819 (0.0009) [2023-12-26 00:12:07,648][123090] Updated weights for policy 1, policy_version 77479 (0.0007) [2023-12-26 00:12:07,702][123090] Updated weights for policy 1, policy_version 77489 (0.0005) [2023-12-26 00:12:07,764][123090] Updated weights for policy 1, policy_version 77499 (0.0006) [2023-12-26 00:12:08,010][123091] Updated weights for policy 0, policy_version 77829 (0.0008) [2023-12-26 00:12:08,074][123091] Updated weights for policy 0, policy_version 77839 (0.0006) [2023-12-26 00:12:08,145][123091] Updated weights for policy 0, policy_version 77849 (0.0006) [2023-12-26 00:12:08,540][123090] Updated weights for policy 1, policy_version 77509 (0.0008) [2023-12-26 00:12:08,610][123090] Updated weights for policy 1, policy_version 77519 (0.0011) [2023-12-26 00:12:08,681][123090] Updated weights for policy 1, policy_version 77529 (0.0011) [2023-12-26 00:12:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17439.2). Total num frames: 39780352. Throughput: 0: 8914.8, 1: 8827.8. Samples: 39755580. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:08,785][121949] Avg episode reward: [(0, '4372.354'), (1, '5208.382')] [2023-12-26 00:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000077856_19931136.pth... [2023-12-26 00:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000077536_19849216.pth... [2023-12-26 00:12:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000076832_19668992.pth [2023-12-26 00:12:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000076512_19587072.pth [2023-12-26 00:12:08,901][123091] Updated weights for policy 0, policy_version 77859 (0.0009) [2023-12-26 00:12:08,960][123091] Updated weights for policy 0, policy_version 77869 (0.0009) [2023-12-26 00:12:09,015][123091] Updated weights for policy 0, policy_version 77879 (0.0010) [2023-12-26 00:12:09,495][123090] Updated weights for policy 1, policy_version 77539 (0.0011) [2023-12-26 00:12:09,561][123090] Updated weights for policy 1, policy_version 77549 (0.0009) [2023-12-26 00:12:09,627][123090] Updated weights for policy 1, policy_version 77559 (0.0010) [2023-12-26 00:12:09,928][123091] Updated weights for policy 0, policy_version 77889 (0.0009) [2023-12-26 00:12:09,998][123091] Updated weights for policy 0, policy_version 77899 (0.0009) [2023-12-26 00:12:10,069][123091] Updated weights for policy 0, policy_version 77909 (0.0009) [2023-12-26 00:12:10,134][123091] Updated weights for policy 0, policy_version 77919 (0.0010) [2023-12-26 00:12:10,498][123090] Updated weights for policy 1, policy_version 77569 (0.0009) [2023-12-26 00:12:10,549][123090] Updated weights for policy 1, policy_version 77579 (0.0009) [2023-12-26 00:12:10,610][123090] Updated weights for policy 1, policy_version 77589 (0.0008) [2023-12-26 00:12:10,673][123090] Updated weights for policy 1, policy_version 77599 (0.0009) [2023-12-26 00:12:10,956][123091] Updated weights for policy 0, policy_version 77929 (0.0010) [2023-12-26 00:12:11,018][123091] Updated weights for policy 0, policy_version 77939 (0.0010) [2023-12-26 00:12:11,085][123091] Updated weights for policy 0, policy_version 77949 (0.0011) [2023-12-26 00:12:11,504][123090] Updated weights for policy 1, policy_version 77609 (0.0009) [2023-12-26 00:12:11,570][123090] Updated weights for policy 1, policy_version 77619 (0.0009) [2023-12-26 00:12:11,644][123090] Updated weights for policy 1, policy_version 77629 (0.0009) [2023-12-26 00:12:12,021][123091] Updated weights for policy 0, policy_version 77959 (0.0009) [2023-12-26 00:12:12,075][123091] Updated weights for policy 0, policy_version 77969 (0.0009) [2023-12-26 00:12:12,124][123091] Updated weights for policy 0, policy_version 77979 (0.0009) [2023-12-26 00:12:12,501][123090] Updated weights for policy 1, policy_version 77639 (0.0009) [2023-12-26 00:12:12,565][123090] Updated weights for policy 1, policy_version 77649 (0.0011) [2023-12-26 00:12:12,635][123090] Updated weights for policy 1, policy_version 77659 (0.0011) [2023-12-26 00:12:13,002][123091] Updated weights for policy 0, policy_version 77989 (0.0008) [2023-12-26 00:12:13,078][123091] Updated weights for policy 0, policy_version 77999 (0.0005) [2023-12-26 00:12:13,146][123091] Updated weights for policy 0, policy_version 78009 (0.0009) [2023-12-26 00:12:13,446][123090] Updated weights for policy 1, policy_version 77669 (0.0008) [2023-12-26 00:12:13,514][123090] Updated weights for policy 1, policy_version 77679 (0.0006) [2023-12-26 00:12:13,569][123090] Updated weights for policy 1, policy_version 77689 (0.0010) [2023-12-26 00:12:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 39862272. Throughput: 0: 8821.9, 1: 8754.2. Samples: 39856568. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:13,785][121949] Avg episode reward: [(0, '4415.622'), (1, '5035.663')] [2023-12-26 00:12:13,961][123091] Updated weights for policy 0, policy_version 78019 (0.0008) [2023-12-26 00:12:14,027][123091] Updated weights for policy 0, policy_version 78029 (0.0009) [2023-12-26 00:12:14,091][123091] Updated weights for policy 0, policy_version 78039 (0.0009) [2023-12-26 00:12:14,297][123090] Updated weights for policy 1, policy_version 77699 (0.0009) [2023-12-26 00:12:14,364][123090] Updated weights for policy 1, policy_version 77709 (0.0008) [2023-12-26 00:12:14,425][123090] Updated weights for policy 1, policy_version 77719 (0.0008) [2023-12-26 00:12:14,885][123091] Updated weights for policy 0, policy_version 78049 (0.0006) [2023-12-26 00:12:14,949][123091] Updated weights for policy 0, policy_version 78059 (0.0009) [2023-12-26 00:12:15,023][123091] Updated weights for policy 0, policy_version 78069 (0.0009) [2023-12-26 00:12:15,088][123091] Updated weights for policy 0, policy_version 78079 (0.0009) [2023-12-26 00:12:15,284][123090] Updated weights for policy 1, policy_version 77729 (0.0009) [2023-12-26 00:12:15,355][123090] Updated weights for policy 1, policy_version 77739 (0.0010) [2023-12-26 00:12:15,414][123090] Updated weights for policy 1, policy_version 77749 (0.0010) [2023-12-26 00:12:15,474][123090] Updated weights for policy 1, policy_version 77759 (0.0010) [2023-12-26 00:12:15,873][123091] Updated weights for policy 0, policy_version 78089 (0.0009) [2023-12-26 00:12:15,927][123091] Updated weights for policy 0, policy_version 78099 (0.0009) [2023-12-26 00:12:15,989][123091] Updated weights for policy 0, policy_version 78109 (0.0009) [2023-12-26 00:12:16,288][123090] Updated weights for policy 1, policy_version 77769 (0.0010) [2023-12-26 00:12:16,335][123090] Updated weights for policy 1, policy_version 77779 (0.0010) [2023-12-26 00:12:16,394][123090] Updated weights for policy 1, policy_version 77789 (0.0010) [2023-12-26 00:12:16,805][123091] Updated weights for policy 0, policy_version 78119 (0.0009) [2023-12-26 00:12:16,872][123091] Updated weights for policy 0, policy_version 78129 (0.0008) [2023-12-26 00:12:16,938][123091] Updated weights for policy 0, policy_version 78139 (0.0009) [2023-12-26 00:12:17,217][123090] Updated weights for policy 1, policy_version 77799 (0.0010) [2023-12-26 00:12:17,273][123090] Updated weights for policy 1, policy_version 77809 (0.0009) [2023-12-26 00:12:17,325][123090] Updated weights for policy 1, policy_version 77819 (0.0005) [2023-12-26 00:12:17,771][123091] Updated weights for policy 0, policy_version 78149 (0.0009) [2023-12-26 00:12:17,832][123091] Updated weights for policy 0, policy_version 78159 (0.0009) [2023-12-26 00:12:17,885][123091] Updated weights for policy 0, policy_version 78170 (0.0010) [2023-12-26 00:12:17,957][123090] Updated weights for policy 1, policy_version 77829 (0.0005) [2023-12-26 00:12:18,013][123090] Updated weights for policy 1, policy_version 77839 (0.0006) [2023-12-26 00:12:18,081][123090] Updated weights for policy 1, policy_version 77849 (0.0009) [2023-12-26 00:12:18,766][123091] Updated weights for policy 0, policy_version 78181 (0.0009) [2023-12-26 00:12:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 39944192. Throughput: 0: 8752.0, 1: 8682.0. Samples: 39961496. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:18,785][121949] Avg episode reward: [(0, '4294.842'), (1, '4809.396')] [2023-12-26 00:12:18,832][123091] Updated weights for policy 0, policy_version 78191 (0.0010) [2023-12-26 00:12:18,855][123090] Updated weights for policy 1, policy_version 77859 (0.0007) [2023-12-26 00:12:18,903][123091] Updated weights for policy 0, policy_version 78201 (0.0007) [2023-12-26 00:12:18,920][123090] Updated weights for policy 1, policy_version 77869 (0.0009) [2023-12-26 00:12:18,985][123090] Updated weights for policy 1, policy_version 77879 (0.0010) [2023-12-26 00:12:19,719][123091] Updated weights for policy 0, policy_version 78211 (0.0009) [2023-12-26 00:12:19,780][123091] Updated weights for policy 0, policy_version 78221 (0.0009) [2023-12-26 00:12:19,817][123090] Updated weights for policy 1, policy_version 77889 (0.0010) [2023-12-26 00:12:19,846][123091] Updated weights for policy 0, policy_version 78231 (0.0010) [2023-12-26 00:12:19,880][123090] Updated weights for policy 1, policy_version 77899 (0.0008) [2023-12-26 00:12:19,953][123090] Updated weights for policy 1, policy_version 77909 (0.0009) [2023-12-26 00:12:20,016][123090] Updated weights for policy 1, policy_version 77919 (0.0010) [2023-12-26 00:12:20,636][123091] Updated weights for policy 0, policy_version 78241 (0.0008) [2023-12-26 00:12:20,707][123091] Updated weights for policy 0, policy_version 78251 (0.0010) [2023-12-26 00:12:20,759][123091] Updated weights for policy 0, policy_version 78261 (0.0010) [2023-12-26 00:12:20,822][123091] Updated weights for policy 0, policy_version 78271 (0.0010) [2023-12-26 00:12:20,866][123090] Updated weights for policy 1, policy_version 77929 (0.0009) [2023-12-26 00:12:20,931][123090] Updated weights for policy 1, policy_version 77939 (0.0010) [2023-12-26 00:12:21,002][123090] Updated weights for policy 1, policy_version 77949 (0.0010) [2023-12-26 00:12:21,692][123091] Updated weights for policy 0, policy_version 78281 (0.0010) [2023-12-26 00:12:21,764][123091] Updated weights for policy 0, policy_version 78291 (0.0010) [2023-12-26 00:12:21,835][123091] Updated weights for policy 0, policy_version 78301 (0.0011) [2023-12-26 00:12:21,845][123090] Updated weights for policy 1, policy_version 77959 (0.0010) [2023-12-26 00:12:21,909][123090] Updated weights for policy 1, policy_version 77969 (0.0011) [2023-12-26 00:12:21,977][123090] Updated weights for policy 1, policy_version 77979 (0.0011) [2023-12-26 00:12:22,536][123091] Updated weights for policy 0, policy_version 78311 (0.0010) [2023-12-26 00:12:22,589][123091] Updated weights for policy 0, policy_version 78321 (0.0009) [2023-12-26 00:12:22,649][123091] Updated weights for policy 0, policy_version 78331 (0.0009) [2023-12-26 00:12:22,823][123090] Updated weights for policy 1, policy_version 77989 (0.0011) [2023-12-26 00:12:22,892][123090] Updated weights for policy 1, policy_version 77999 (0.0012) [2023-12-26 00:12:22,955][123090] Updated weights for policy 1, policy_version 78009 (0.0010) [2023-12-26 00:12:23,466][123091] Updated weights for policy 0, policy_version 78341 (0.0008) [2023-12-26 00:12:23,529][123091] Updated weights for policy 0, policy_version 78351 (0.0008) [2023-12-26 00:12:23,605][123091] Updated weights for policy 0, policy_version 78361 (0.0005) [2023-12-26 00:12:23,772][123090] Updated weights for policy 1, policy_version 78019 (0.0010) [2023-12-26 00:12:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 40034304. Throughput: 0: 8689.2, 1: 8680.8. Samples: 40012032. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:23,785][121949] Avg episode reward: [(0, '4138.792'), (1, '4829.352')] [2023-12-26 00:12:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000078368_20062208.pth... [2023-12-26 00:12:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000077344_19800064.pth [2023-12-26 00:12:23,828][123090] Updated weights for policy 1, policy_version 78029 (0.0010) [2023-12-26 00:12:23,882][123090] Updated weights for policy 1, policy_version 78039 (0.0010) [2023-12-26 00:12:23,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000078048_19980288.pth... [2023-12-26 00:12:23,932][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000077024_19718144.pth [2023-12-26 00:12:24,338][123091] Updated weights for policy 0, policy_version 78371 (0.0005) [2023-12-26 00:12:24,393][123091] Updated weights for policy 0, policy_version 78381 (0.0006) [2023-12-26 00:12:24,462][123091] Updated weights for policy 0, policy_version 78391 (0.0005) [2023-12-26 00:12:24,678][123090] Updated weights for policy 1, policy_version 78049 (0.0010) [2023-12-26 00:12:24,733][123090] Updated weights for policy 1, policy_version 78059 (0.0006) [2023-12-26 00:12:24,797][123090] Updated weights for policy 1, policy_version 78069 (0.0007) [2023-12-26 00:12:24,852][123090] Updated weights for policy 1, policy_version 78080 (0.0009) [2023-12-26 00:12:25,161][123091] Updated weights for policy 0, policy_version 78401 (0.0007) [2023-12-26 00:12:25,214][123091] Updated weights for policy 0, policy_version 78411 (0.0005) [2023-12-26 00:12:25,263][123091] Updated weights for policy 0, policy_version 78421 (0.0005) [2023-12-26 00:12:25,334][123091] Updated weights for policy 0, policy_version 78431 (0.0007) [2023-12-26 00:12:25,692][123090] Updated weights for policy 1, policy_version 78090 (0.0009) [2023-12-26 00:12:25,740][123090] Updated weights for policy 1, policy_version 78100 (0.0009) [2023-12-26 00:12:25,794][123090] Updated weights for policy 1, policy_version 78110 (0.0010) [2023-12-26 00:12:26,126][123091] Updated weights for policy 0, policy_version 78441 (0.0006) [2023-12-26 00:12:26,178][123091] Updated weights for policy 0, policy_version 78451 (0.0005) [2023-12-26 00:12:26,232][123091] Updated weights for policy 0, policy_version 78461 (0.0005) [2023-12-26 00:12:26,689][123090] Updated weights for policy 1, policy_version 78120 (0.0010) [2023-12-26 00:12:26,759][123090] Updated weights for policy 1, policy_version 78130 (0.0009) [2023-12-26 00:12:26,829][123090] Updated weights for policy 1, policy_version 78140 (0.0010) [2023-12-26 00:12:26,866][123091] Updated weights for policy 0, policy_version 78471 (0.0006) [2023-12-26 00:12:26,924][123091] Updated weights for policy 0, policy_version 78481 (0.0006) [2023-12-26 00:12:26,977][123091] Updated weights for policy 0, policy_version 78491 (0.0006) [2023-12-26 00:12:27,580][123091] Updated weights for policy 0, policy_version 78501 (0.0006) [2023-12-26 00:12:27,639][123091] Updated weights for policy 0, policy_version 78511 (0.0006) [2023-12-26 00:12:27,692][123091] Updated weights for policy 0, policy_version 78521 (0.0006) [2023-12-26 00:12:27,723][123090] Updated weights for policy 1, policy_version 78150 (0.0009) [2023-12-26 00:12:27,776][123090] Updated weights for policy 1, policy_version 78160 (0.0009) [2023-12-26 00:12:27,826][123090] Updated weights for policy 1, policy_version 78171 (0.0009) [2023-12-26 00:12:28,269][123091] Updated weights for policy 0, policy_version 78531 (0.0006) [2023-12-26 00:12:28,332][123091] Updated weights for policy 0, policy_version 78541 (0.0008) [2023-12-26 00:12:28,408][123091] Updated weights for policy 0, policy_version 78551 (0.0009) [2023-12-26 00:12:28,760][123090] Updated weights for policy 1, policy_version 78181 (0.0009) [2023-12-26 00:12:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 40124416. Throughput: 0: 8772.5, 1: 8660.0. Samples: 40120588. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:28,785][121949] Avg episode reward: [(0, '4223.420'), (1, '5051.614')] [2023-12-26 00:12:28,826][123090] Updated weights for policy 1, policy_version 78191 (0.0009) [2023-12-26 00:12:28,882][123090] Updated weights for policy 1, policy_version 78201 (0.0009) [2023-12-26 00:12:29,080][123091] Updated weights for policy 0, policy_version 78561 (0.0007) [2023-12-26 00:12:29,141][123091] Updated weights for policy 0, policy_version 78571 (0.0009) [2023-12-26 00:12:29,202][123091] Updated weights for policy 0, policy_version 78581 (0.0010) [2023-12-26 00:12:29,268][123091] Updated weights for policy 0, policy_version 78591 (0.0009) [2023-12-26 00:12:29,635][123090] Updated weights for policy 1, policy_version 78211 (0.0008) [2023-12-26 00:12:29,695][123090] Updated weights for policy 1, policy_version 78221 (0.0008) [2023-12-26 00:12:29,756][123090] Updated weights for policy 1, policy_version 78231 (0.0009) [2023-12-26 00:12:30,004][123091] Updated weights for policy 0, policy_version 78601 (0.0009) [2023-12-26 00:12:30,069][123091] Updated weights for policy 0, policy_version 78611 (0.0010) [2023-12-26 00:12:30,140][123091] Updated weights for policy 0, policy_version 78621 (0.0009) [2023-12-26 00:12:30,468][123090] Updated weights for policy 1, policy_version 78241 (0.0009) [2023-12-26 00:12:30,527][123090] Updated weights for policy 1, policy_version 78251 (0.0010) [2023-12-26 00:12:30,577][123090] Updated weights for policy 1, policy_version 78261 (0.0010) [2023-12-26 00:12:30,635][123090] Updated weights for policy 1, policy_version 78272 (0.0009) [2023-12-26 00:12:30,913][123091] Updated weights for policy 0, policy_version 78631 (0.0006) [2023-12-26 00:12:30,960][123091] Updated weights for policy 0, policy_version 78641 (0.0005) [2023-12-26 00:12:31,006][123091] Updated weights for policy 0, policy_version 78651 (0.0006) [2023-12-26 00:12:31,482][123090] Updated weights for policy 1, policy_version 78282 (0.0006) [2023-12-26 00:12:31,531][123090] Updated weights for policy 1, policy_version 78292 (0.0008) [2023-12-26 00:12:31,590][123090] Updated weights for policy 1, policy_version 78302 (0.0008) [2023-12-26 00:12:31,850][123091] Updated weights for policy 0, policy_version 78661 (0.0008) [2023-12-26 00:12:31,908][123091] Updated weights for policy 0, policy_version 78671 (0.0009) [2023-12-26 00:12:31,956][123091] Updated weights for policy 0, policy_version 78681 (0.0010) [2023-12-26 00:12:32,411][123090] Updated weights for policy 1, policy_version 78312 (0.0007) [2023-12-26 00:12:32,467][123090] Updated weights for policy 1, policy_version 78322 (0.0005) [2023-12-26 00:12:32,524][123090] Updated weights for policy 1, policy_version 78332 (0.0005) [2023-12-26 00:12:32,766][123091] Updated weights for policy 0, policy_version 78691 (0.0010) [2023-12-26 00:12:32,840][123091] Updated weights for policy 0, policy_version 78701 (0.0006) [2023-12-26 00:12:32,904][123091] Updated weights for policy 0, policy_version 78711 (0.0005) [2023-12-26 00:12:33,141][123090] Updated weights for policy 1, policy_version 78342 (0.0008) [2023-12-26 00:12:33,189][123090] Updated weights for policy 1, policy_version 78352 (0.0009) [2023-12-26 00:12:33,246][123090] Updated weights for policy 1, policy_version 78362 (0.0010) [2023-12-26 00:12:33,623][123091] Updated weights for policy 0, policy_version 78721 (0.0007) [2023-12-26 00:12:33,689][123091] Updated weights for policy 0, policy_version 78731 (0.0006) [2023-12-26 00:12:33,737][123091] Updated weights for policy 0, policy_version 78741 (0.0005) [2023-12-26 00:12:33,782][123091] Updated weights for policy 0, policy_version 78751 (0.0005) [2023-12-26 00:12:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 40214528. Throughput: 0: 8815.1, 1: 8699.2. Samples: 40229624. Policy #0 lag: (min: 17.0, avg: 36.6, max: 49.0) [2023-12-26 00:12:33,785][121949] Avg episode reward: [(0, '4231.007'), (1, '5171.660')] [2023-12-26 00:12:33,980][123090] Updated weights for policy 1, policy_version 78372 (0.0008) [2023-12-26 00:12:34,027][123090] Updated weights for policy 1, policy_version 78382 (0.0005) [2023-12-26 00:12:34,083][123090] Updated weights for policy 1, policy_version 78392 (0.0005) [2023-12-26 00:12:34,433][123091] Updated weights for policy 0, policy_version 78761 (0.0008) [2023-12-26 00:12:34,500][123091] Updated weights for policy 0, policy_version 78771 (0.0010) [2023-12-26 00:12:34,559][123091] Updated weights for policy 0, policy_version 78781 (0.0010) [2023-12-26 00:12:34,889][123090] Updated weights for policy 1, policy_version 78402 (0.0005) [2023-12-26 00:12:34,958][123090] Updated weights for policy 1, policy_version 78412 (0.0007) [2023-12-26 00:12:35,015][123090] Updated weights for policy 1, policy_version 78422 (0.0009) [2023-12-26 00:12:35,067][123090] Updated weights for policy 1, policy_version 78432 (0.0010) [2023-12-26 00:12:35,297][123091] Updated weights for policy 0, policy_version 78791 (0.0007) [2023-12-26 00:12:35,356][123091] Updated weights for policy 0, policy_version 78801 (0.0006) [2023-12-26 00:12:35,424][123091] Updated weights for policy 0, policy_version 78811 (0.0008) [2023-12-26 00:12:35,964][123090] Updated weights for policy 1, policy_version 78442 (0.0010) [2023-12-26 00:12:36,026][123090] Updated weights for policy 1, policy_version 78452 (0.0009) [2023-12-26 00:12:36,096][123090] Updated weights for policy 1, policy_version 78462 (0.0009) [2023-12-26 00:12:36,136][123091] Updated weights for policy 0, policy_version 78821 (0.0009) [2023-12-26 00:12:36,202][123091] Updated weights for policy 0, policy_version 78831 (0.0008) [2023-12-26 00:12:36,265][123091] Updated weights for policy 0, policy_version 78841 (0.0010) [2023-12-26 00:12:36,973][123090] Updated weights for policy 1, policy_version 78472 (0.0008) [2023-12-26 00:12:37,034][123090] Updated weights for policy 1, policy_version 78482 (0.0009) [2023-12-26 00:12:37,085][123090] Updated weights for policy 1, policy_version 78492 (0.0009) [2023-12-26 00:12:37,113][123091] Updated weights for policy 0, policy_version 78851 (0.0008) [2023-12-26 00:12:37,173][123091] Updated weights for policy 0, policy_version 78861 (0.0009) [2023-12-26 00:12:37,243][123091] Updated weights for policy 0, policy_version 78871 (0.0009) [2023-12-26 00:12:37,949][123090] Updated weights for policy 1, policy_version 78502 (0.0007) [2023-12-26 00:12:38,005][123090] Updated weights for policy 1, policy_version 78512 (0.0007) [2023-12-26 00:12:38,058][123090] Updated weights for policy 1, policy_version 78522 (0.0010) [2023-12-26 00:12:38,090][123091] Updated weights for policy 0, policy_version 78881 (0.0009) [2023-12-26 00:12:38,141][123091] Updated weights for policy 0, policy_version 78891 (0.0008) [2023-12-26 00:12:38,192][123091] Updated weights for policy 0, policy_version 78901 (0.0008) [2023-12-26 00:12:38,240][123091] Updated weights for policy 0, policy_version 78911 (0.0009) [2023-12-26 00:12:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 40304640. Throughput: 0: 8898.4, 1: 8714.9. Samples: 40284040. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:12:38,785][121949] Avg episode reward: [(0, '4139.597'), (1, '5329.023')] [2023-12-26 00:12:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000078912_20201472.pth... [2023-12-26 00:12:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000078528_20103168.pth... [2023-12-26 00:12:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000077856_19931136.pth [2023-12-26 00:12:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000077536_19849216.pth [2023-12-26 00:12:38,828][123090] Updated weights for policy 1, policy_version 78532 (0.0008) [2023-12-26 00:12:38,895][123090] Updated weights for policy 1, policy_version 78542 (0.0005) [2023-12-26 00:12:38,949][123090] Updated weights for policy 1, policy_version 78552 (0.0006) [2023-12-26 00:12:38,999][123091] Updated weights for policy 0, policy_version 78921 (0.0006) [2023-12-26 00:12:39,057][123091] Updated weights for policy 0, policy_version 78931 (0.0010) [2023-12-26 00:12:39,120][123091] Updated weights for policy 0, policy_version 78941 (0.0010) [2023-12-26 00:12:39,690][123090] Updated weights for policy 1, policy_version 78562 (0.0010) [2023-12-26 00:12:39,756][123090] Updated weights for policy 1, policy_version 78572 (0.0009) [2023-12-26 00:12:39,813][123090] Updated weights for policy 1, policy_version 78582 (0.0011) [2023-12-26 00:12:39,876][123090] Updated weights for policy 1, policy_version 78592 (0.0010) [2023-12-26 00:12:40,094][123091] Updated weights for policy 0, policy_version 78951 (0.0009) [2023-12-26 00:12:40,157][123091] Updated weights for policy 0, policy_version 78961 (0.0008) [2023-12-26 00:12:40,226][123091] Updated weights for policy 0, policy_version 78971 (0.0007) [2023-12-26 00:12:40,696][123090] Updated weights for policy 1, policy_version 78602 (0.0010) [2023-12-26 00:12:40,755][123090] Updated weights for policy 1, policy_version 78612 (0.0010) [2023-12-26 00:12:40,822][123090] Updated weights for policy 1, policy_version 78622 (0.0010) [2023-12-26 00:12:41,012][123091] Updated weights for policy 0, policy_version 78981 (0.0007) [2023-12-26 00:12:41,082][123091] Updated weights for policy 0, policy_version 78991 (0.0010) [2023-12-26 00:12:41,147][123091] Updated weights for policy 0, policy_version 79001 (0.0009) [2023-12-26 00:12:41,672][123090] Updated weights for policy 1, policy_version 78632 (0.0010) [2023-12-26 00:12:41,740][123090] Updated weights for policy 1, policy_version 78642 (0.0008) [2023-12-26 00:12:41,809][123090] Updated weights for policy 1, policy_version 78652 (0.0010) [2023-12-26 00:12:42,015][123091] Updated weights for policy 0, policy_version 79011 (0.0010) [2023-12-26 00:12:42,065][123091] Updated weights for policy 0, policy_version 79021 (0.0009) [2023-12-26 00:12:42,119][123091] Updated weights for policy 0, policy_version 79031 (0.0010) [2023-12-26 00:12:42,684][123090] Updated weights for policy 1, policy_version 78662 (0.0009) [2023-12-26 00:12:42,737][123090] Updated weights for policy 1, policy_version 78672 (0.0010) [2023-12-26 00:12:42,805][123090] Updated weights for policy 1, policy_version 78682 (0.0009) [2023-12-26 00:12:42,962][123091] Updated weights for policy 0, policy_version 79041 (0.0010) [2023-12-26 00:12:43,027][123091] Updated weights for policy 0, policy_version 79051 (0.0009) [2023-12-26 00:12:43,085][123091] Updated weights for policy 0, policy_version 79061 (0.0010) [2023-12-26 00:12:43,138][123091] Updated weights for policy 0, policy_version 79071 (0.0010) [2023-12-26 00:12:43,651][123090] Updated weights for policy 1, policy_version 78692 (0.0009) [2023-12-26 00:12:43,717][123090] Updated weights for policy 1, policy_version 78702 (0.0009) [2023-12-26 00:12:43,778][123090] Updated weights for policy 1, policy_version 78712 (0.0010) [2023-12-26 00:12:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 40386560. Throughput: 0: 8836.5, 1: 8706.6. Samples: 40387180. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:12:43,785][121949] Avg episode reward: [(0, '4272.486'), (1, '5215.062')] [2023-12-26 00:12:43,845][123091] Updated weights for policy 0, policy_version 79081 (0.0009) [2023-12-26 00:12:43,911][123091] Updated weights for policy 0, policy_version 79091 (0.0009) [2023-12-26 00:12:43,963][123091] Updated weights for policy 0, policy_version 79101 (0.0009) [2023-12-26 00:12:44,503][123090] Updated weights for policy 1, policy_version 78722 (0.0008) [2023-12-26 00:12:44,571][123090] Updated weights for policy 1, policy_version 78732 (0.0007) [2023-12-26 00:12:44,623][123090] Updated weights for policy 1, policy_version 78742 (0.0006) [2023-12-26 00:12:44,678][123090] Updated weights for policy 1, policy_version 78752 (0.0005) [2023-12-26 00:12:44,826][123091] Updated weights for policy 0, policy_version 79111 (0.0010) [2023-12-26 00:12:44,899][123091] Updated weights for policy 0, policy_version 79121 (0.0011) [2023-12-26 00:12:44,970][123091] Updated weights for policy 0, policy_version 79131 (0.0010) [2023-12-26 00:12:45,492][123090] Updated weights for policy 1, policy_version 78762 (0.0009) [2023-12-26 00:12:45,559][123090] Updated weights for policy 1, policy_version 78772 (0.0009) [2023-12-26 00:12:45,619][123090] Updated weights for policy 1, policy_version 78782 (0.0009) [2023-12-26 00:12:45,835][123091] Updated weights for policy 0, policy_version 79141 (0.0007) [2023-12-26 00:12:45,897][123091] Updated weights for policy 0, policy_version 79151 (0.0008) [2023-12-26 00:12:45,961][123091] Updated weights for policy 0, policy_version 79161 (0.0008) [2023-12-26 00:12:46,391][123090] Updated weights for policy 1, policy_version 78792 (0.0006) [2023-12-26 00:12:46,445][123090] Updated weights for policy 1, policy_version 78802 (0.0005) [2023-12-26 00:12:46,502][123090] Updated weights for policy 1, policy_version 78812 (0.0005) [2023-12-26 00:12:46,601][123091] Updated weights for policy 0, policy_version 79171 (0.0005) [2023-12-26 00:12:46,666][123091] Updated weights for policy 0, policy_version 79181 (0.0006) [2023-12-26 00:12:46,726][123091] Updated weights for policy 0, policy_version 79191 (0.0010) [2023-12-26 00:12:47,172][123090] Updated weights for policy 1, policy_version 78822 (0.0005) [2023-12-26 00:12:47,229][123090] Updated weights for policy 1, policy_version 78832 (0.0005) [2023-12-26 00:12:47,286][123090] Updated weights for policy 1, policy_version 78842 (0.0005) [2023-12-26 00:12:47,454][123091] Updated weights for policy 0, policy_version 79201 (0.0009) [2023-12-26 00:12:47,512][123091] Updated weights for policy 0, policy_version 79211 (0.0005) [2023-12-26 00:12:47,574][123091] Updated weights for policy 0, policy_version 79221 (0.0006) [2023-12-26 00:12:47,646][123091] Updated weights for policy 0, policy_version 79231 (0.0010) [2023-12-26 00:12:48,048][123090] Updated weights for policy 1, policy_version 78852 (0.0007) [2023-12-26 00:12:48,103][123090] Updated weights for policy 1, policy_version 78863 (0.0010) [2023-12-26 00:12:48,157][123090] Updated weights for policy 1, policy_version 78873 (0.0010) [2023-12-26 00:12:48,341][123091] Updated weights for policy 0, policy_version 79241 (0.0010) [2023-12-26 00:12:48,405][123091] Updated weights for policy 0, policy_version 79251 (0.0009) [2023-12-26 00:12:48,468][123091] Updated weights for policy 0, policy_version 79261 (0.0009) [2023-12-26 00:12:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 40484864. Throughput: 0: 8902.5, 1: 8720.7. Samples: 40495536. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:12:48,785][121949] Avg episode reward: [(0, '4365.022'), (1, '5007.794')] [2023-12-26 00:12:49,034][123090] Updated weights for policy 1, policy_version 78883 (0.0010) [2023-12-26 00:12:49,093][123090] Updated weights for policy 1, policy_version 78893 (0.0010) [2023-12-26 00:12:49,162][123090] Updated weights for policy 1, policy_version 78903 (0.0011) [2023-12-26 00:12:49,299][123091] Updated weights for policy 0, policy_version 79271 (0.0009) [2023-12-26 00:12:49,355][123091] Updated weights for policy 0, policy_version 79281 (0.0009) [2023-12-26 00:12:49,423][123091] Updated weights for policy 0, policy_version 79291 (0.0009) [2023-12-26 00:12:49,989][123090] Updated weights for policy 1, policy_version 78913 (0.0010) [2023-12-26 00:12:50,046][123090] Updated weights for policy 1, policy_version 78923 (0.0010) [2023-12-26 00:12:50,110][123090] Updated weights for policy 1, policy_version 78933 (0.0010) [2023-12-26 00:12:50,173][123090] Updated weights for policy 1, policy_version 78943 (0.0010) [2023-12-26 00:12:50,264][123091] Updated weights for policy 0, policy_version 79301 (0.0009) [2023-12-26 00:12:50,323][123091] Updated weights for policy 0, policy_version 79311 (0.0010) [2023-12-26 00:12:50,384][123091] Updated weights for policy 0, policy_version 79321 (0.0009) [2023-12-26 00:12:50,926][123090] Updated weights for policy 1, policy_version 78953 (0.0008) [2023-12-26 00:12:50,975][123090] Updated weights for policy 1, policy_version 78963 (0.0005) [2023-12-26 00:12:51,034][123090] Updated weights for policy 1, policy_version 78973 (0.0006) [2023-12-26 00:12:51,327][123091] Updated weights for policy 0, policy_version 79331 (0.0009) [2023-12-26 00:12:51,385][123091] Updated weights for policy 0, policy_version 79341 (0.0009) [2023-12-26 00:12:51,463][123091] Updated weights for policy 0, policy_version 79351 (0.0007) [2023-12-26 00:12:51,864][123090] Updated weights for policy 1, policy_version 78983 (0.0006) [2023-12-26 00:12:51,933][123090] Updated weights for policy 1, policy_version 78993 (0.0005) [2023-12-26 00:12:52,000][123090] Updated weights for policy 1, policy_version 79003 (0.0008) [2023-12-26 00:12:52,311][123091] Updated weights for policy 0, policy_version 79361 (0.0007) [2023-12-26 00:12:52,379][123091] Updated weights for policy 0, policy_version 79371 (0.0008) [2023-12-26 00:12:52,443][123091] Updated weights for policy 0, policy_version 79381 (0.0009) [2023-12-26 00:12:52,507][123091] Updated weights for policy 0, policy_version 79391 (0.0009) [2023-12-26 00:12:52,754][123090] Updated weights for policy 1, policy_version 79013 (0.0008) [2023-12-26 00:12:52,813][123090] Updated weights for policy 1, policy_version 79023 (0.0009) [2023-12-26 00:12:52,876][123090] Updated weights for policy 1, policy_version 79033 (0.0010) [2023-12-26 00:12:53,355][123091] Updated weights for policy 0, policy_version 79401 (0.0009) [2023-12-26 00:12:53,406][123091] Updated weights for policy 0, policy_version 79411 (0.0009) [2023-12-26 00:12:53,462][123091] Updated weights for policy 0, policy_version 79421 (0.0009) [2023-12-26 00:12:53,675][123090] Updated weights for policy 1, policy_version 79043 (0.0010) [2023-12-26 00:12:53,719][123090] Updated weights for policy 1, policy_version 79053 (0.0007) [2023-12-26 00:12:53,768][123090] Updated weights for policy 1, policy_version 79063 (0.0005) [2023-12-26 00:12:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 40566784. Throughput: 0: 8872.8, 1: 8712.2. Samples: 40546904. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:12:53,785][121949] Avg episode reward: [(0, '4256.125'), (1, '4896.228')] [2023-12-26 00:12:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000079424_20332544.pth... [2023-12-26 00:12:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000078368_20062208.pth [2023-12-26 00:12:53,820][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000079072_20242432.pth... [2023-12-26 00:12:53,826][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000078048_19980288.pth [2023-12-26 00:12:54,294][123091] Updated weights for policy 0, policy_version 79431 (0.0008) [2023-12-26 00:12:54,358][123091] Updated weights for policy 0, policy_version 79441 (0.0008) [2023-12-26 00:12:54,414][123091] Updated weights for policy 0, policy_version 79451 (0.0009) [2023-12-26 00:12:54,606][123090] Updated weights for policy 1, policy_version 79073 (0.0006) [2023-12-26 00:12:54,657][123090] Updated weights for policy 1, policy_version 79083 (0.0010) [2023-12-26 00:12:54,711][123090] Updated weights for policy 1, policy_version 79093 (0.0010) [2023-12-26 00:12:54,775][123090] Updated weights for policy 1, policy_version 79103 (0.0010) [2023-12-26 00:12:55,207][123091] Updated weights for policy 0, policy_version 79461 (0.0009) [2023-12-26 00:12:55,261][123091] Updated weights for policy 0, policy_version 79471 (0.0007) [2023-12-26 00:12:55,321][123091] Updated weights for policy 0, policy_version 79481 (0.0005) [2023-12-26 00:12:55,587][123090] Updated weights for policy 1, policy_version 79113 (0.0009) [2023-12-26 00:12:55,643][123090] Updated weights for policy 1, policy_version 79123 (0.0010) [2023-12-26 00:12:55,697][123090] Updated weights for policy 1, policy_version 79133 (0.0010) [2023-12-26 00:12:56,046][123091] Updated weights for policy 0, policy_version 79491 (0.0005) [2023-12-26 00:12:56,108][123091] Updated weights for policy 0, policy_version 79501 (0.0006) [2023-12-26 00:12:56,166][123091] Updated weights for policy 0, policy_version 79511 (0.0009) [2023-12-26 00:12:56,486][123090] Updated weights for policy 1, policy_version 79143 (0.0007) [2023-12-26 00:12:56,540][123090] Updated weights for policy 1, policy_version 79153 (0.0005) [2023-12-26 00:12:56,599][123090] Updated weights for policy 1, policy_version 79163 (0.0009) [2023-12-26 00:12:56,988][123091] Updated weights for policy 0, policy_version 79521 (0.0010) [2023-12-26 00:12:57,054][123091] Updated weights for policy 0, policy_version 79531 (0.0010) [2023-12-26 00:12:57,115][123091] Updated weights for policy 0, policy_version 79541 (0.0007) [2023-12-26 00:12:57,163][123091] Updated weights for policy 0, policy_version 79551 (0.0005) [2023-12-26 00:12:57,354][123090] Updated weights for policy 1, policy_version 79173 (0.0009) [2023-12-26 00:12:57,419][123090] Updated weights for policy 1, policy_version 79183 (0.0009) [2023-12-26 00:12:57,471][123090] Updated weights for policy 1, policy_version 79193 (0.0006) [2023-12-26 00:12:57,927][123091] Updated weights for policy 0, policy_version 79561 (0.0008) [2023-12-26 00:12:57,990][123091] Updated weights for policy 0, policy_version 79571 (0.0009) [2023-12-26 00:12:58,059][123091] Updated weights for policy 0, policy_version 79581 (0.0010) [2023-12-26 00:12:58,269][123090] Updated weights for policy 1, policy_version 79203 (0.0006) [2023-12-26 00:12:58,338][123090] Updated weights for policy 1, policy_version 79213 (0.0009) [2023-12-26 00:12:58,405][123090] Updated weights for policy 1, policy_version 79223 (0.0008) [2023-12-26 00:12:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 40656896. Throughput: 0: 8938.7, 1: 8756.8. Samples: 40652868. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:12:58,785][121949] Avg episode reward: [(0, '4090.958'), (1, '5064.687')] [2023-12-26 00:12:58,966][123091] Updated weights for policy 0, policy_version 79591 (0.0007) [2023-12-26 00:12:59,023][123091] Updated weights for policy 0, policy_version 79601 (0.0009) [2023-12-26 00:12:59,081][123091] Updated weights for policy 0, policy_version 79611 (0.0010) [2023-12-26 00:12:59,248][123090] Updated weights for policy 1, policy_version 79233 (0.0009) [2023-12-26 00:12:59,302][123090] Updated weights for policy 1, policy_version 79243 (0.0010) [2023-12-26 00:12:59,368][123090] Updated weights for policy 1, policy_version 79253 (0.0010) [2023-12-26 00:12:59,435][123090] Updated weights for policy 1, policy_version 79263 (0.0009) [2023-12-26 00:12:59,807][123091] Updated weights for policy 0, policy_version 79621 (0.0008) [2023-12-26 00:12:59,870][123091] Updated weights for policy 0, policy_version 79631 (0.0008) [2023-12-26 00:12:59,941][123091] Updated weights for policy 0, policy_version 79641 (0.0007) [2023-12-26 00:13:00,340][123090] Updated weights for policy 1, policy_version 79273 (0.0010) [2023-12-26 00:13:00,389][123090] Updated weights for policy 1, policy_version 79283 (0.0009) [2023-12-26 00:13:00,444][123090] Updated weights for policy 1, policy_version 79295 (0.0011) [2023-12-26 00:13:00,564][123091] Updated weights for policy 0, policy_version 79652 (0.0008) [2023-12-26 00:13:00,624][123091] Updated weights for policy 0, policy_version 79662 (0.0005) [2023-12-26 00:13:00,695][123091] Updated weights for policy 0, policy_version 79672 (0.0008) [2023-12-26 00:13:01,369][123090] Updated weights for policy 1, policy_version 79305 (0.0009) [2023-12-26 00:13:01,428][123090] Updated weights for policy 1, policy_version 79315 (0.0010) [2023-12-26 00:13:01,482][123090] Updated weights for policy 1, policy_version 79325 (0.0009) [2023-12-26 00:13:01,484][123091] Updated weights for policy 0, policy_version 79682 (0.0008) [2023-12-26 00:13:01,545][123091] Updated weights for policy 0, policy_version 79692 (0.0010) [2023-12-26 00:13:01,612][123091] Updated weights for policy 0, policy_version 79702 (0.0009) [2023-12-26 00:13:01,685][123091] Updated weights for policy 0, policy_version 79712 (0.0010) [2023-12-26 00:13:02,345][123090] Updated weights for policy 1, policy_version 79335 (0.0008) [2023-12-26 00:13:02,401][123091] Updated weights for policy 0, policy_version 79722 (0.0008) [2023-12-26 00:13:02,412][123090] Updated weights for policy 1, policy_version 79345 (0.0008) [2023-12-26 00:13:02,456][123091] Updated weights for policy 0, policy_version 79732 (0.0006) [2023-12-26 00:13:02,469][123090] Updated weights for policy 1, policy_version 79355 (0.0009) [2023-12-26 00:13:02,512][123091] Updated weights for policy 0, policy_version 79742 (0.0007) [2023-12-26 00:13:03,233][123091] Updated weights for policy 0, policy_version 79752 (0.0009) [2023-12-26 00:13:03,236][123090] Updated weights for policy 1, policy_version 79365 (0.0009) [2023-12-26 00:13:03,278][123091] Updated weights for policy 0, policy_version 79762 (0.0007) [2023-12-26 00:13:03,298][123090] Updated weights for policy 1, policy_version 79375 (0.0010) [2023-12-26 00:13:03,330][123091] Updated weights for policy 0, policy_version 79772 (0.0007) [2023-12-26 00:13:03,356][123090] Updated weights for policy 1, policy_version 79385 (0.0010) [2023-12-26 00:13:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 40747008. Throughput: 0: 9009.7, 1: 8675.6. Samples: 40757336. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:13:03,785][121949] Avg episode reward: [(0, '4017.133'), (1, '5259.686')] [2023-12-26 00:13:04,090][123090] Updated weights for policy 1, policy_version 79395 (0.0011) [2023-12-26 00:13:04,152][123090] Updated weights for policy 1, policy_version 79405 (0.0010) [2023-12-26 00:13:04,169][123091] Updated weights for policy 0, policy_version 79782 (0.0009) [2023-12-26 00:13:04,212][123090] Updated weights for policy 1, policy_version 79415 (0.0009) [2023-12-26 00:13:04,229][123091] Updated weights for policy 0, policy_version 79792 (0.0009) [2023-12-26 00:13:04,291][123091] Updated weights for policy 0, policy_version 79802 (0.0009) [2023-12-26 00:13:04,936][123090] Updated weights for policy 1, policy_version 79425 (0.0008) [2023-12-26 00:13:04,993][123090] Updated weights for policy 1, policy_version 79435 (0.0006) [2023-12-26 00:13:05,018][123091] Updated weights for policy 0, policy_version 79812 (0.0008) [2023-12-26 00:13:05,053][123090] Updated weights for policy 1, policy_version 79445 (0.0005) [2023-12-26 00:13:05,070][123091] Updated weights for policy 0, policy_version 79822 (0.0005) [2023-12-26 00:13:05,114][123090] Updated weights for policy 1, policy_version 79455 (0.0006) [2023-12-26 00:13:05,132][123091] Updated weights for policy 0, policy_version 79832 (0.0005) [2023-12-26 00:13:05,767][123090] Updated weights for policy 1, policy_version 79465 (0.0005) [2023-12-26 00:13:05,823][123090] Updated weights for policy 1, policy_version 79475 (0.0005) [2023-12-26 00:13:05,857][123091] Updated weights for policy 0, policy_version 79842 (0.0006) [2023-12-26 00:13:05,877][123090] Updated weights for policy 1, policy_version 79485 (0.0005) [2023-12-26 00:13:05,914][123091] Updated weights for policy 0, policy_version 79852 (0.0010) [2023-12-26 00:13:05,968][123091] Updated weights for policy 0, policy_version 79862 (0.0005) [2023-12-26 00:13:06,022][123091] Updated weights for policy 0, policy_version 79872 (0.0005) [2023-12-26 00:13:06,644][123090] Updated weights for policy 1, policy_version 79495 (0.0009) [2023-12-26 00:13:06,707][123090] Updated weights for policy 1, policy_version 79505 (0.0010) [2023-12-26 00:13:06,774][123090] Updated weights for policy 1, policy_version 79515 (0.0011) [2023-12-26 00:13:06,819][123091] Updated weights for policy 0, policy_version 79882 (0.0011) [2023-12-26 00:13:06,871][123091] Updated weights for policy 0, policy_version 79892 (0.0010) [2023-12-26 00:13:06,934][123091] Updated weights for policy 0, policy_version 79902 (0.0011) [2023-12-26 00:13:07,502][123090] Updated weights for policy 1, policy_version 79525 (0.0008) [2023-12-26 00:13:07,549][123090] Updated weights for policy 1, policy_version 79535 (0.0005) [2023-12-26 00:13:07,607][123090] Updated weights for policy 1, policy_version 79545 (0.0005) [2023-12-26 00:13:07,767][123091] Updated weights for policy 0, policy_version 79912 (0.0006) [2023-12-26 00:13:07,826][123091] Updated weights for policy 0, policy_version 79922 (0.0005) [2023-12-26 00:13:07,887][123091] Updated weights for policy 0, policy_version 79932 (0.0010) [2023-12-26 00:13:08,419][123090] Updated weights for policy 1, policy_version 79555 (0.0009) [2023-12-26 00:13:08,486][123090] Updated weights for policy 1, policy_version 79565 (0.0009) [2023-12-26 00:13:08,536][123090] Updated weights for policy 1, policy_version 79575 (0.0009) [2023-12-26 00:13:08,632][123091] Updated weights for policy 0, policy_version 79942 (0.0010) [2023-12-26 00:13:08,703][123091] Updated weights for policy 0, policy_version 79952 (0.0011) [2023-12-26 00:13:08,765][123091] Updated weights for policy 0, policy_version 79962 (0.0011) [2023-12-26 00:13:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 40837120. Throughput: 0: 9084.7, 1: 8772.0. Samples: 40815584. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:13:08,785][121949] Avg episode reward: [(0, '3834.617'), (1, '5286.084')] [2023-12-26 00:13:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000079584_20373504.pth... [2023-12-26 00:13:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000078528_20103168.pth [2023-12-26 00:13:08,802][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000079968_20471808.pth... [2023-12-26 00:13:08,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000078912_20201472.pth [2023-12-26 00:13:09,394][123090] Updated weights for policy 1, policy_version 79585 (0.0007) [2023-12-26 00:13:09,467][123090] Updated weights for policy 1, policy_version 79595 (0.0010) [2023-12-26 00:13:09,535][123090] Updated weights for policy 1, policy_version 79605 (0.0009) [2023-12-26 00:13:09,555][123091] Updated weights for policy 0, policy_version 79972 (0.0010) [2023-12-26 00:13:09,586][123090] Updated weights for policy 1, policy_version 79615 (0.0006) [2023-12-26 00:13:09,620][123091] Updated weights for policy 0, policy_version 79982 (0.0009) [2023-12-26 00:13:09,680][123091] Updated weights for policy 0, policy_version 79992 (0.0009) [2023-12-26 00:13:10,428][123090] Updated weights for policy 1, policy_version 79625 (0.0010) [2023-12-26 00:13:10,491][123090] Updated weights for policy 1, policy_version 79635 (0.0011) [2023-12-26 00:13:10,548][123091] Updated weights for policy 0, policy_version 80002 (0.0008) [2023-12-26 00:13:10,555][123090] Updated weights for policy 1, policy_version 79645 (0.0011) [2023-12-26 00:13:10,598][123091] Updated weights for policy 0, policy_version 80012 (0.0005) [2023-12-26 00:13:10,650][123091] Updated weights for policy 0, policy_version 80022 (0.0005) [2023-12-26 00:13:10,699][123091] Updated weights for policy 0, policy_version 80032 (0.0005) [2023-12-26 00:13:11,375][123090] Updated weights for policy 1, policy_version 79655 (0.0010) [2023-12-26 00:13:11,434][123090] Updated weights for policy 1, policy_version 79665 (0.0010) [2023-12-26 00:13:11,495][123090] Updated weights for policy 1, policy_version 79675 (0.0008) [2023-12-26 00:13:11,531][123091] Updated weights for policy 0, policy_version 80042 (0.0009) [2023-12-26 00:13:11,591][123091] Updated weights for policy 0, policy_version 80052 (0.0009) [2023-12-26 00:13:11,669][123091] Updated weights for policy 0, policy_version 80062 (0.0011) [2023-12-26 00:13:12,336][123090] Updated weights for policy 1, policy_version 79685 (0.0008) [2023-12-26 00:13:12,408][123090] Updated weights for policy 1, policy_version 79695 (0.0011) [2023-12-26 00:13:12,471][123090] Updated weights for policy 1, policy_version 79705 (0.0011) [2023-12-26 00:13:12,560][123091] Updated weights for policy 0, policy_version 80072 (0.0008) [2023-12-26 00:13:12,624][123091] Updated weights for policy 0, policy_version 80082 (0.0009) [2023-12-26 00:13:12,691][123091] Updated weights for policy 0, policy_version 80092 (0.0008) [2023-12-26 00:13:13,257][123090] Updated weights for policy 1, policy_version 79715 (0.0011) [2023-12-26 00:13:13,324][123090] Updated weights for policy 1, policy_version 79725 (0.0010) [2023-12-26 00:13:13,389][123090] Updated weights for policy 1, policy_version 79735 (0.0010) [2023-12-26 00:13:13,523][123091] Updated weights for policy 0, policy_version 80102 (0.0009) [2023-12-26 00:13:13,585][123091] Updated weights for policy 0, policy_version 80112 (0.0009) [2023-12-26 00:13:13,638][123091] Updated weights for policy 0, policy_version 80122 (0.0010) [2023-12-26 00:13:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 40927232. Throughput: 0: 8930.1, 1: 8800.4. Samples: 40918460. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:13:13,785][121949] Avg episode reward: [(0, '3750.335'), (1, '5248.664')] [2023-12-26 00:13:14,121][123090] Updated weights for policy 1, policy_version 79745 (0.0010) [2023-12-26 00:13:14,186][123090] Updated weights for policy 1, policy_version 79755 (0.0005) [2023-12-26 00:13:14,258][123090] Updated weights for policy 1, policy_version 79765 (0.0006) [2023-12-26 00:13:14,327][123090] Updated weights for policy 1, policy_version 79775 (0.0007) [2023-12-26 00:13:14,446][123091] Updated weights for policy 0, policy_version 80132 (0.0010) [2023-12-26 00:13:14,506][123091] Updated weights for policy 0, policy_version 80142 (0.0010) [2023-12-26 00:13:14,567][123091] Updated weights for policy 0, policy_version 80152 (0.0010) [2023-12-26 00:13:14,928][123090] Updated weights for policy 1, policy_version 79785 (0.0010) [2023-12-26 00:13:14,985][123090] Updated weights for policy 1, policy_version 79795 (0.0010) [2023-12-26 00:13:15,046][123090] Updated weights for policy 1, policy_version 79805 (0.0011) [2023-12-26 00:13:15,429][123091] Updated weights for policy 0, policy_version 80162 (0.0010) [2023-12-26 00:13:15,490][123091] Updated weights for policy 0, policy_version 80172 (0.0009) [2023-12-26 00:13:15,554][123091] Updated weights for policy 0, policy_version 80182 (0.0009) [2023-12-26 00:13:15,616][123091] Updated weights for policy 0, policy_version 80192 (0.0006) [2023-12-26 00:13:15,854][123090] Updated weights for policy 1, policy_version 79815 (0.0007) [2023-12-26 00:13:15,916][123090] Updated weights for policy 1, policy_version 79825 (0.0006) [2023-12-26 00:13:15,981][123090] Updated weights for policy 1, policy_version 79835 (0.0007) [2023-12-26 00:13:16,487][123091] Updated weights for policy 0, policy_version 80202 (0.0008) [2023-12-26 00:13:16,545][123091] Updated weights for policy 0, policy_version 80212 (0.0010) [2023-12-26 00:13:16,610][123091] Updated weights for policy 0, policy_version 80223 (0.0010) [2023-12-26 00:13:16,650][123090] Updated weights for policy 1, policy_version 79845 (0.0007) [2023-12-26 00:13:16,703][123090] Updated weights for policy 1, policy_version 79855 (0.0005) [2023-12-26 00:13:16,762][123090] Updated weights for policy 1, policy_version 79865 (0.0005) [2023-12-26 00:13:17,477][123091] Updated weights for policy 0, policy_version 80233 (0.0009) [2023-12-26 00:13:17,525][123091] Updated weights for policy 0, policy_version 80243 (0.0009) [2023-12-26 00:13:17,541][123090] Updated weights for policy 1, policy_version 79875 (0.0007) [2023-12-26 00:13:17,570][123091] Updated weights for policy 0, policy_version 80253 (0.0007) [2023-12-26 00:13:17,604][123090] Updated weights for policy 1, policy_version 79885 (0.0010) [2023-12-26 00:13:17,659][123090] Updated weights for policy 1, policy_version 79895 (0.0010) [2023-12-26 00:13:18,344][123091] Updated weights for policy 0, policy_version 80263 (0.0008) [2023-12-26 00:13:18,405][123091] Updated weights for policy 0, policy_version 80273 (0.0008) [2023-12-26 00:13:18,466][123090] Updated weights for policy 1, policy_version 79905 (0.0010) [2023-12-26 00:13:18,467][123091] Updated weights for policy 0, policy_version 80283 (0.0008) [2023-12-26 00:13:18,521][123090] Updated weights for policy 1, policy_version 79915 (0.0005) [2023-12-26 00:13:18,572][123090] Updated weights for policy 1, policy_version 79925 (0.0006) [2023-12-26 00:13:18,627][123090] Updated weights for policy 1, policy_version 79935 (0.0005) [2023-12-26 00:13:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 41017344. Throughput: 0: 8821.7, 1: 8872.6. Samples: 41025872. Policy #0 lag: (min: 31.0, avg: 35.6, max: 63.0) [2023-12-26 00:13:18,785][121949] Avg episode reward: [(0, '4029.940'), (1, '5107.903')] [2023-12-26 00:13:19,273][123091] Updated weights for policy 0, policy_version 80293 (0.0009) [2023-12-26 00:13:19,334][123090] Updated weights for policy 1, policy_version 79945 (0.0007) [2023-12-26 00:13:19,339][123091] Updated weights for policy 0, policy_version 80303 (0.0010) [2023-12-26 00:13:19,403][123090] Updated weights for policy 1, policy_version 79955 (0.0009) [2023-12-26 00:13:19,410][123091] Updated weights for policy 0, policy_version 80313 (0.0008) [2023-12-26 00:13:19,465][123090] Updated weights for policy 1, policy_version 79965 (0.0008) [2023-12-26 00:13:20,223][123091] Updated weights for policy 0, policy_version 80323 (0.0009) [2023-12-26 00:13:20,272][123091] Updated weights for policy 0, policy_version 80333 (0.0009) [2023-12-26 00:13:20,287][123090] Updated weights for policy 1, policy_version 79975 (0.0009) [2023-12-26 00:13:20,325][123091] Updated weights for policy 0, policy_version 80343 (0.0007) [2023-12-26 00:13:20,348][123090] Updated weights for policy 1, policy_version 79985 (0.0008) [2023-12-26 00:13:20,414][123090] Updated weights for policy 1, policy_version 79995 (0.0009) [2023-12-26 00:13:21,181][123091] Updated weights for policy 0, policy_version 80353 (0.0009) [2023-12-26 00:13:21,243][123091] Updated weights for policy 0, policy_version 80363 (0.0009) [2023-12-26 00:13:21,288][123090] Updated weights for policy 1, policy_version 80005 (0.0009) [2023-12-26 00:13:21,305][123091] Updated weights for policy 0, policy_version 80373 (0.0009) [2023-12-26 00:13:21,361][123090] Updated weights for policy 1, policy_version 80015 (0.0008) [2023-12-26 00:13:21,380][123091] Updated weights for policy 0, policy_version 80383 (0.0009) [2023-12-26 00:13:21,434][123090] Updated weights for policy 1, policy_version 80025 (0.0008) [2023-12-26 00:13:22,246][123090] Updated weights for policy 1, policy_version 80035 (0.0009) [2023-12-26 00:13:22,280][123091] Updated weights for policy 0, policy_version 80393 (0.0008) [2023-12-26 00:13:22,320][123090] Updated weights for policy 1, policy_version 80045 (0.0010) [2023-12-26 00:13:22,341][123091] Updated weights for policy 0, policy_version 80403 (0.0008) [2023-12-26 00:13:22,394][123090] Updated weights for policy 1, policy_version 80055 (0.0008) [2023-12-26 00:13:22,407][123091] Updated weights for policy 0, policy_version 80413 (0.0009) [2023-12-26 00:13:23,139][123090] Updated weights for policy 1, policy_version 80065 (0.0008) [2023-12-26 00:13:23,197][123090] Updated weights for policy 1, policy_version 80075 (0.0009) [2023-12-26 00:13:23,253][123090] Updated weights for policy 1, policy_version 80085 (0.0010) [2023-12-26 00:13:23,282][123091] Updated weights for policy 0, policy_version 80423 (0.0008) [2023-12-26 00:13:23,320][123090] Updated weights for policy 1, policy_version 80095 (0.0010) [2023-12-26 00:13:23,351][123091] Updated weights for policy 0, policy_version 80433 (0.0007) [2023-12-26 00:13:23,413][123091] Updated weights for policy 0, policy_version 80443 (0.0010) [2023-12-26 00:13:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 41099264. Throughput: 0: 8752.0, 1: 8876.0. Samples: 41077308. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:23,785][121949] Avg episode reward: [(0, '4117.373'), (1, '5188.623')] [2023-12-26 00:13:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000080448_20594688.pth... [2023-12-26 00:13:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000080096_20504576.pth... [2023-12-26 00:13:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000079424_20332544.pth [2023-12-26 00:13:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000079072_20242432.pth [2023-12-26 00:13:24,117][123091] Updated weights for policy 0, policy_version 80453 (0.0010) [2023-12-26 00:13:24,166][123091] Updated weights for policy 0, policy_version 80463 (0.0010) [2023-12-26 00:13:24,202][123090] Updated weights for policy 1, policy_version 80105 (0.0008) [2023-12-26 00:13:24,209][123091] Updated weights for policy 0, policy_version 80473 (0.0010) [2023-12-26 00:13:24,260][123090] Updated weights for policy 1, policy_version 80115 (0.0007) [2023-12-26 00:13:24,323][123090] Updated weights for policy 1, policy_version 80125 (0.0010) [2023-12-26 00:13:25,022][123091] Updated weights for policy 0, policy_version 80483 (0.0008) [2023-12-26 00:13:25,076][123091] Updated weights for policy 0, policy_version 80493 (0.0005) [2023-12-26 00:13:25,123][123091] Updated weights for policy 0, policy_version 80503 (0.0005) [2023-12-26 00:13:25,193][123090] Updated weights for policy 1, policy_version 80135 (0.0010) [2023-12-26 00:13:25,259][123090] Updated weights for policy 1, policy_version 80145 (0.0010) [2023-12-26 00:13:25,321][123090] Updated weights for policy 1, policy_version 80155 (0.0010) [2023-12-26 00:13:25,672][123091] Updated weights for policy 0, policy_version 80513 (0.0005) [2023-12-26 00:13:25,725][123091] Updated weights for policy 0, policy_version 80523 (0.0005) [2023-12-26 00:13:25,776][123091] Updated weights for policy 0, policy_version 80533 (0.0005) [2023-12-26 00:13:25,824][123091] Updated weights for policy 0, policy_version 80543 (0.0005) [2023-12-26 00:13:26,250][123090] Updated weights for policy 1, policy_version 80165 (0.0010) [2023-12-26 00:13:26,322][123090] Updated weights for policy 1, policy_version 80175 (0.0010) [2023-12-26 00:13:26,389][123090] Updated weights for policy 1, policy_version 80185 (0.0010) [2023-12-26 00:13:26,453][123091] Updated weights for policy 0, policy_version 80553 (0.0009) [2023-12-26 00:13:26,523][123091] Updated weights for policy 0, policy_version 80563 (0.0011) [2023-12-26 00:13:26,581][123091] Updated weights for policy 0, policy_version 80573 (0.0010) [2023-12-26 00:13:27,216][123090] Updated weights for policy 1, policy_version 80195 (0.0008) [2023-12-26 00:13:27,271][123090] Updated weights for policy 1, policy_version 80206 (0.0010) [2023-12-26 00:13:27,329][123090] Updated weights for policy 1, policy_version 80216 (0.0008) [2023-12-26 00:13:27,385][123091] Updated weights for policy 0, policy_version 80583 (0.0009) [2023-12-26 00:13:27,443][123091] Updated weights for policy 0, policy_version 80593 (0.0005) [2023-12-26 00:13:27,502][123091] Updated weights for policy 0, policy_version 80603 (0.0005) [2023-12-26 00:13:28,054][123090] Updated weights for policy 1, policy_version 80226 (0.0008) [2023-12-26 00:13:28,110][123090] Updated weights for policy 1, policy_version 80236 (0.0005) [2023-12-26 00:13:28,142][123091] Updated weights for policy 0, policy_version 80613 (0.0005) [2023-12-26 00:13:28,170][123090] Updated weights for policy 1, policy_version 80246 (0.0005) [2023-12-26 00:13:28,196][123091] Updated weights for policy 0, policy_version 80623 (0.0009) [2023-12-26 00:13:28,232][123090] Updated weights for policy 1, policy_version 80256 (0.0005) [2023-12-26 00:13:28,244][123091] Updated weights for policy 0, policy_version 80633 (0.0010) [2023-12-26 00:13:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 41189376. Throughput: 0: 8850.3, 1: 8835.3. Samples: 41183032. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:28,785][121949] Avg episode reward: [(0, '4240.902'), (1, '5145.650')] [2023-12-26 00:13:28,943][123090] Updated weights for policy 1, policy_version 80266 (0.0011) [2023-12-26 00:13:28,988][123091] Updated weights for policy 0, policy_version 80643 (0.0010) [2023-12-26 00:13:28,999][123090] Updated weights for policy 1, policy_version 80276 (0.0010) [2023-12-26 00:13:29,043][123091] Updated weights for policy 0, policy_version 80653 (0.0010) [2023-12-26 00:13:29,047][123090] Updated weights for policy 1, policy_version 80286 (0.0010) [2023-12-26 00:13:29,101][123091] Updated weights for policy 0, policy_version 80663 (0.0008) [2023-12-26 00:13:29,841][123090] Updated weights for policy 1, policy_version 80296 (0.0007) [2023-12-26 00:13:29,873][123091] Updated weights for policy 0, policy_version 80673 (0.0007) [2023-12-26 00:13:29,922][123090] Updated weights for policy 1, policy_version 80306 (0.0007) [2023-12-26 00:13:29,947][123091] Updated weights for policy 0, policy_version 80683 (0.0009) [2023-12-26 00:13:29,985][123090] Updated weights for policy 1, policy_version 80316 (0.0010) [2023-12-26 00:13:30,004][123091] Updated weights for policy 0, policy_version 80693 (0.0006) [2023-12-26 00:13:30,068][123091] Updated weights for policy 0, policy_version 80703 (0.0005) [2023-12-26 00:13:30,690][123090] Updated weights for policy 1, policy_version 80326 (0.0008) [2023-12-26 00:13:30,745][123090] Updated weights for policy 1, policy_version 80336 (0.0005) [2023-12-26 00:13:30,793][123091] Updated weights for policy 0, policy_version 80713 (0.0005) [2023-12-26 00:13:30,794][123090] Updated weights for policy 1, policy_version 80346 (0.0005) [2023-12-26 00:13:30,849][123091] Updated weights for policy 0, policy_version 80723 (0.0005) [2023-12-26 00:13:30,911][123091] Updated weights for policy 0, policy_version 80733 (0.0005) [2023-12-26 00:13:31,471][123090] Updated weights for policy 1, policy_version 80356 (0.0007) [2023-12-26 00:13:31,543][123090] Updated weights for policy 1, policy_version 80366 (0.0008) [2023-12-26 00:13:31,591][123090] Updated weights for policy 1, policy_version 80376 (0.0008) [2023-12-26 00:13:31,656][123091] Updated weights for policy 0, policy_version 80743 (0.0009) [2023-12-26 00:13:31,720][123091] Updated weights for policy 0, policy_version 80753 (0.0011) [2023-12-26 00:13:31,786][123091] Updated weights for policy 0, policy_version 80763 (0.0011) [2023-12-26 00:13:32,413][123090] Updated weights for policy 1, policy_version 80386 (0.0010) [2023-12-26 00:13:32,478][123090] Updated weights for policy 1, policy_version 80396 (0.0008) [2023-12-26 00:13:32,511][123091] Updated weights for policy 0, policy_version 80773 (0.0005) [2023-12-26 00:13:32,541][123090] Updated weights for policy 1, policy_version 80406 (0.0008) [2023-12-26 00:13:32,569][123091] Updated weights for policy 0, policy_version 80783 (0.0005) [2023-12-26 00:13:32,595][123090] Updated weights for policy 1, policy_version 80416 (0.0005) [2023-12-26 00:13:32,632][123091] Updated weights for policy 0, policy_version 80793 (0.0005) [2023-12-26 00:13:33,277][123090] Updated weights for policy 1, policy_version 80426 (0.0005) [2023-12-26 00:13:33,330][123090] Updated weights for policy 1, policy_version 80436 (0.0005) [2023-12-26 00:13:33,392][123090] Updated weights for policy 1, policy_version 80446 (0.0005) [2023-12-26 00:13:33,423][123091] Updated weights for policy 0, policy_version 80803 (0.0010) [2023-12-26 00:13:33,477][123091] Updated weights for policy 0, policy_version 80813 (0.0010) [2023-12-26 00:13:33,530][123091] Updated weights for policy 0, policy_version 80823 (0.0010) [2023-12-26 00:13:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 41287680. Throughput: 0: 8900.3, 1: 8919.6. Samples: 41297428. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:33,784][121949] Avg episode reward: [(0, '4308.382'), (1, '5137.948')] [2023-12-26 00:13:34,150][123090] Updated weights for policy 1, policy_version 80456 (0.0010) [2023-12-26 00:13:34,210][123090] Updated weights for policy 1, policy_version 80466 (0.0010) [2023-12-26 00:13:34,262][123090] Updated weights for policy 1, policy_version 80476 (0.0010) [2023-12-26 00:13:34,301][123091] Updated weights for policy 0, policy_version 80833 (0.0007) [2023-12-26 00:13:34,376][123091] Updated weights for policy 0, policy_version 80843 (0.0010) [2023-12-26 00:13:34,446][123091] Updated weights for policy 0, policy_version 80853 (0.0011) [2023-12-26 00:13:34,515][123091] Updated weights for policy 0, policy_version 80863 (0.0008) [2023-12-26 00:13:35,098][123090] Updated weights for policy 1, policy_version 80486 (0.0007) [2023-12-26 00:13:35,153][123090] Updated weights for policy 1, policy_version 80496 (0.0005) [2023-12-26 00:13:35,199][123090] Updated weights for policy 1, policy_version 80506 (0.0005) [2023-12-26 00:13:35,300][123091] Updated weights for policy 0, policy_version 80873 (0.0007) [2023-12-26 00:13:35,365][123091] Updated weights for policy 0, policy_version 80883 (0.0007) [2023-12-26 00:13:35,420][123091] Updated weights for policy 0, policy_version 80893 (0.0010) [2023-12-26 00:13:35,840][123090] Updated weights for policy 1, policy_version 80516 (0.0005) [2023-12-26 00:13:35,890][123090] Updated weights for policy 1, policy_version 80526 (0.0005) [2023-12-26 00:13:35,949][123090] Updated weights for policy 1, policy_version 80536 (0.0006) [2023-12-26 00:13:36,222][123091] Updated weights for policy 0, policy_version 80903 (0.0011) [2023-12-26 00:13:36,289][123091] Updated weights for policy 0, policy_version 80913 (0.0011) [2023-12-26 00:13:36,357][123091] Updated weights for policy 0, policy_version 80923 (0.0011) [2023-12-26 00:13:36,679][123090] Updated weights for policy 1, policy_version 80546 (0.0006) [2023-12-26 00:13:36,743][123090] Updated weights for policy 1, policy_version 80556 (0.0009) [2023-12-26 00:13:36,809][123090] Updated weights for policy 1, policy_version 80566 (0.0005) [2023-12-26 00:13:36,874][123090] Updated weights for policy 1, policy_version 80576 (0.0005) [2023-12-26 00:13:37,114][123091] Updated weights for policy 0, policy_version 80933 (0.0011) [2023-12-26 00:13:37,180][123091] Updated weights for policy 0, policy_version 80943 (0.0011) [2023-12-26 00:13:37,246][123091] Updated weights for policy 0, policy_version 80953 (0.0008) [2023-12-26 00:13:37,513][123090] Updated weights for policy 1, policy_version 80586 (0.0005) [2023-12-26 00:13:37,566][123090] Updated weights for policy 1, policy_version 80596 (0.0005) [2023-12-26 00:13:37,615][123090] Updated weights for policy 1, policy_version 80606 (0.0005) [2023-12-26 00:13:37,923][123091] Updated weights for policy 0, policy_version 80963 (0.0005) [2023-12-26 00:13:37,995][123091] Updated weights for policy 0, policy_version 80973 (0.0005) [2023-12-26 00:13:38,047][123091] Updated weights for policy 0, policy_version 80983 (0.0005) [2023-12-26 00:13:38,327][123090] Updated weights for policy 1, policy_version 80616 (0.0009) [2023-12-26 00:13:38,400][123090] Updated weights for policy 1, policy_version 80626 (0.0010) [2023-12-26 00:13:38,464][123090] Updated weights for policy 1, policy_version 80636 (0.0011) [2023-12-26 00:13:38,774][123091] Updated weights for policy 0, policy_version 80993 (0.0006) [2023-12-26 00:13:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 41377792. Throughput: 0: 8968.7, 1: 8957.4. Samples: 41353580. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:38,785][121949] Avg episode reward: [(0, '4078.026'), (1, '5259.791')] [2023-12-26 00:13:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000080640_20643840.pth... [2023-12-26 00:13:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000079584_20373504.pth [2023-12-26 00:13:38,876][123091] Updated weights for policy 0, policy_version 81003 (0.0006) [2023-12-26 00:13:38,957][123091] Updated weights for policy 0, policy_version 81013 (0.0006) [2023-12-26 00:13:39,027][123091] Updated weights for policy 0, policy_version 81023 (0.0008) [2023-12-26 00:13:39,030][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000081024_20742144.pth... [2023-12-26 00:13:39,034][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000079968_20471808.pth [2023-12-26 00:13:39,220][123090] Updated weights for policy 1, policy_version 80646 (0.0011) [2023-12-26 00:13:39,296][123090] Updated weights for policy 1, policy_version 80656 (0.0011) [2023-12-26 00:13:39,358][123090] Updated weights for policy 1, policy_version 80666 (0.0010) [2023-12-26 00:13:39,786][123091] Updated weights for policy 0, policy_version 81033 (0.0009) [2023-12-26 00:13:39,851][123091] Updated weights for policy 0, policy_version 81043 (0.0009) [2023-12-26 00:13:39,911][123091] Updated weights for policy 0, policy_version 81053 (0.0009) [2023-12-26 00:13:40,167][123090] Updated weights for policy 1, policy_version 80676 (0.0008) [2023-12-26 00:13:40,240][123090] Updated weights for policy 1, policy_version 80686 (0.0005) [2023-12-26 00:13:40,298][123090] Updated weights for policy 1, policy_version 80696 (0.0005) [2023-12-26 00:13:40,770][123091] Updated weights for policy 0, policy_version 81063 (0.0006) [2023-12-26 00:13:40,839][123091] Updated weights for policy 0, policy_version 81073 (0.0006) [2023-12-26 00:13:40,895][123091] Updated weights for policy 0, policy_version 81083 (0.0005) [2023-12-26 00:13:41,056][123090] Updated weights for policy 1, policy_version 80706 (0.0007) [2023-12-26 00:13:41,122][123090] Updated weights for policy 1, policy_version 80716 (0.0010) [2023-12-26 00:13:41,180][123090] Updated weights for policy 1, policy_version 80726 (0.0008) [2023-12-26 00:13:41,247][123090] Updated weights for policy 1, policy_version 80736 (0.0006) [2023-12-26 00:13:41,638][123091] Updated weights for policy 0, policy_version 81093 (0.0007) [2023-12-26 00:13:41,697][123091] Updated weights for policy 0, policy_version 81103 (0.0008) [2023-12-26 00:13:41,766][123091] Updated weights for policy 0, policy_version 81113 (0.0008) [2023-12-26 00:13:42,051][123090] Updated weights for policy 1, policy_version 80746 (0.0011) [2023-12-26 00:13:42,123][123090] Updated weights for policy 1, policy_version 80756 (0.0011) [2023-12-26 00:13:42,182][123090] Updated weights for policy 1, policy_version 80766 (0.0010) [2023-12-26 00:13:42,528][123091] Updated weights for policy 0, policy_version 81123 (0.0008) [2023-12-26 00:13:42,588][123091] Updated weights for policy 0, policy_version 81133 (0.0011) [2023-12-26 00:13:42,658][123091] Updated weights for policy 0, policy_version 81143 (0.0009) [2023-12-26 00:13:42,988][123090] Updated weights for policy 1, policy_version 80776 (0.0010) [2023-12-26 00:13:43,052][123090] Updated weights for policy 1, policy_version 80786 (0.0009) [2023-12-26 00:13:43,112][123090] Updated weights for policy 1, policy_version 80796 (0.0009) [2023-12-26 00:13:43,456][123091] Updated weights for policy 0, policy_version 81153 (0.0009) [2023-12-26 00:13:43,504][123091] Updated weights for policy 0, policy_version 81163 (0.0005) [2023-12-26 00:13:43,558][123091] Updated weights for policy 0, policy_version 81173 (0.0008) [2023-12-26 00:13:43,623][123091] Updated weights for policy 0, policy_version 81183 (0.0006) [2023-12-26 00:13:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 41467904. Throughput: 0: 9002.0, 1: 8997.4. Samples: 41462840. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:43,784][121949] Avg episode reward: [(0, '4028.671'), (1, '5169.967')] [2023-12-26 00:13:43,982][123090] Updated weights for policy 1, policy_version 80806 (0.0008) [2023-12-26 00:13:44,051][123090] Updated weights for policy 1, policy_version 80816 (0.0006) [2023-12-26 00:13:44,116][123090] Updated weights for policy 1, policy_version 80826 (0.0007) [2023-12-26 00:13:44,312][123091] Updated weights for policy 0, policy_version 81193 (0.0009) [2023-12-26 00:13:44,375][123091] Updated weights for policy 0, policy_version 81203 (0.0009) [2023-12-26 00:13:44,441][123091] Updated weights for policy 0, policy_version 81213 (0.0007) [2023-12-26 00:13:44,932][123090] Updated weights for policy 1, policy_version 80836 (0.0010) [2023-12-26 00:13:44,997][123090] Updated weights for policy 1, policy_version 80846 (0.0009) [2023-12-26 00:13:45,061][123090] Updated weights for policy 1, policy_version 80856 (0.0009) [2023-12-26 00:13:45,097][123091] Updated weights for policy 0, policy_version 81223 (0.0009) [2023-12-26 00:13:45,150][123091] Updated weights for policy 0, policy_version 81233 (0.0011) [2023-12-26 00:13:45,217][123091] Updated weights for policy 0, policy_version 81243 (0.0009) [2023-12-26 00:13:45,938][123090] Updated weights for policy 1, policy_version 80866 (0.0007) [2023-12-26 00:13:45,963][123091] Updated weights for policy 0, policy_version 81253 (0.0008) [2023-12-26 00:13:46,000][123090] Updated weights for policy 1, policy_version 80876 (0.0009) [2023-12-26 00:13:46,029][123091] Updated weights for policy 0, policy_version 81263 (0.0006) [2023-12-26 00:13:46,057][123090] Updated weights for policy 1, policy_version 80886 (0.0009) [2023-12-26 00:13:46,095][123091] Updated weights for policy 0, policy_version 81273 (0.0006) [2023-12-26 00:13:46,125][123090] Updated weights for policy 1, policy_version 80896 (0.0009) [2023-12-26 00:13:46,762][123091] Updated weights for policy 0, policy_version 81283 (0.0007) [2023-12-26 00:13:46,821][123091] Updated weights for policy 0, policy_version 81293 (0.0011) [2023-12-26 00:13:46,873][123091] Updated weights for policy 0, policy_version 81303 (0.0010) [2023-12-26 00:13:47,016][123090] Updated weights for policy 1, policy_version 80906 (0.0008) [2023-12-26 00:13:47,072][123090] Updated weights for policy 1, policy_version 80916 (0.0007) [2023-12-26 00:13:47,125][123090] Updated weights for policy 1, policy_version 80926 (0.0009) [2023-12-26 00:13:47,708][123091] Updated weights for policy 0, policy_version 81313 (0.0011) [2023-12-26 00:13:47,761][123091] Updated weights for policy 0, policy_version 81323 (0.0010) [2023-12-26 00:13:47,816][123091] Updated weights for policy 0, policy_version 81333 (0.0010) [2023-12-26 00:13:47,867][123091] Updated weights for policy 0, policy_version 81343 (0.0010) [2023-12-26 00:13:47,954][123090] Updated weights for policy 1, policy_version 80936 (0.0009) [2023-12-26 00:13:48,012][123090] Updated weights for policy 1, policy_version 80946 (0.0010) [2023-12-26 00:13:48,075][123090] Updated weights for policy 1, policy_version 80956 (0.0010) [2023-12-26 00:13:48,621][123091] Updated weights for policy 0, policy_version 81353 (0.0007) [2023-12-26 00:13:48,679][123091] Updated weights for policy 0, policy_version 81363 (0.0006) [2023-12-26 00:13:48,735][123091] Updated weights for policy 0, policy_version 81373 (0.0006) [2023-12-26 00:13:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 41558016. Throughput: 0: 9036.0, 1: 8973.6. Samples: 41567768. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:48,784][121949] Avg episode reward: [(0, '4211.480'), (1, '4949.471')] [2023-12-26 00:13:48,992][123090] Updated weights for policy 1, policy_version 80966 (0.0010) [2023-12-26 00:13:49,048][123090] Updated weights for policy 1, policy_version 80976 (0.0009) [2023-12-26 00:13:49,094][123090] Updated weights for policy 1, policy_version 80986 (0.0008) [2023-12-26 00:13:49,507][123091] Updated weights for policy 0, policy_version 81383 (0.0009) [2023-12-26 00:13:49,559][123091] Updated weights for policy 0, policy_version 81393 (0.0011) [2023-12-26 00:13:49,607][123091] Updated weights for policy 0, policy_version 81403 (0.0009) [2023-12-26 00:13:49,912][123090] Updated weights for policy 1, policy_version 80996 (0.0010) [2023-12-26 00:13:49,987][123090] Updated weights for policy 1, policy_version 81006 (0.0009) [2023-12-26 00:13:50,048][123090] Updated weights for policy 1, policy_version 81016 (0.0009) [2023-12-26 00:13:50,409][123091] Updated weights for policy 0, policy_version 81413 (0.0008) [2023-12-26 00:13:50,465][123091] Updated weights for policy 0, policy_version 81423 (0.0005) [2023-12-26 00:13:50,520][123091] Updated weights for policy 0, policy_version 81433 (0.0010) [2023-12-26 00:13:50,743][123090] Updated weights for policy 1, policy_version 81026 (0.0009) [2023-12-26 00:13:50,812][123090] Updated weights for policy 1, policy_version 81036 (0.0009) [2023-12-26 00:13:50,875][123090] Updated weights for policy 1, policy_version 81046 (0.0009) [2023-12-26 00:13:50,942][123090] Updated weights for policy 1, policy_version 81056 (0.0010) [2023-12-26 00:13:51,301][123091] Updated weights for policy 0, policy_version 81443 (0.0010) [2023-12-26 00:13:51,377][123091] Updated weights for policy 0, policy_version 81453 (0.0009) [2023-12-26 00:13:51,453][123091] Updated weights for policy 0, policy_version 81463 (0.0006) [2023-12-26 00:13:51,829][123090] Updated weights for policy 1, policy_version 81066 (0.0009) [2023-12-26 00:13:51,894][123090] Updated weights for policy 1, policy_version 81076 (0.0009) [2023-12-26 00:13:51,964][123090] Updated weights for policy 1, policy_version 81086 (0.0009) [2023-12-26 00:13:52,236][123091] Updated weights for policy 0, policy_version 81473 (0.0006) [2023-12-26 00:13:52,304][123091] Updated weights for policy 0, policy_version 81483 (0.0009) [2023-12-26 00:13:52,375][123091] Updated weights for policy 0, policy_version 81493 (0.0007) [2023-12-26 00:13:52,440][123091] Updated weights for policy 0, policy_version 81503 (0.0005) [2023-12-26 00:13:52,833][123090] Updated weights for policy 1, policy_version 81096 (0.0010) [2023-12-26 00:13:52,887][123090] Updated weights for policy 1, policy_version 81106 (0.0009) [2023-12-26 00:13:52,940][123090] Updated weights for policy 1, policy_version 81117 (0.0009) [2023-12-26 00:13:53,216][123091] Updated weights for policy 0, policy_version 81513 (0.0009) [2023-12-26 00:13:53,278][123091] Updated weights for policy 0, policy_version 81523 (0.0009) [2023-12-26 00:13:53,334][123091] Updated weights for policy 0, policy_version 81533 (0.0009) [2023-12-26 00:13:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 41639936. Throughput: 0: 9011.9, 1: 8889.9. Samples: 41621168. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:53,785][121949] Avg episode reward: [(0, '4316.788'), (1, '4907.132')] [2023-12-26 00:13:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000081536_20873216.pth... [2023-12-26 00:13:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000080448_20594688.pth [2023-12-26 00:13:53,802][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000081536_20873216.pth [2023-12-26 00:13:53,809][123090] Updated weights for policy 1, policy_version 81127 (0.0010) [2023-12-26 00:13:53,879][123090] Updated weights for policy 1, policy_version 81137 (0.0010) [2023-12-26 00:13:53,932][123091] Updated weights for policy 0, policy_version 81543 (0.0007) [2023-12-26 00:13:53,950][123090] Updated weights for policy 1, policy_version 81147 (0.0009) [2023-12-26 00:13:53,978][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000081152_20774912.pth... [2023-12-26 00:13:53,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000080096_20504576.pth [2023-12-26 00:13:53,983][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000081152_20774912.pth [2023-12-26 00:13:53,988][123091] Updated weights for policy 0, policy_version 81553 (0.0008) [2023-12-26 00:13:54,043][123091] Updated weights for policy 0, policy_version 81563 (0.0010) [2023-12-26 00:13:54,719][123090] Updated weights for policy 1, policy_version 81157 (0.0008) [2023-12-26 00:13:54,784][123090] Updated weights for policy 1, policy_version 81167 (0.0008) [2023-12-26 00:13:54,836][123090] Updated weights for policy 1, policy_version 81178 (0.0010) [2023-12-26 00:13:54,850][123091] Updated weights for policy 0, policy_version 81573 (0.0007) [2023-12-26 00:13:54,900][123091] Updated weights for policy 0, policy_version 81583 (0.0009) [2023-12-26 00:13:54,967][123091] Updated weights for policy 0, policy_version 81593 (0.0009) [2023-12-26 00:13:55,577][123090] Updated weights for policy 1, policy_version 81188 (0.0008) [2023-12-26 00:13:55,635][123090] Updated weights for policy 1, policy_version 81199 (0.0010) [2023-12-26 00:13:55,689][123090] Updated weights for policy 1, policy_version 81209 (0.0010) [2023-12-26 00:13:55,724][123091] Updated weights for policy 0, policy_version 81603 (0.0008) [2023-12-26 00:13:55,783][123091] Updated weights for policy 0, policy_version 81613 (0.0006) [2023-12-26 00:13:55,827][123091] Updated weights for policy 0, policy_version 81623 (0.0005) [2023-12-26 00:13:56,473][123090] Updated weights for policy 1, policy_version 81219 (0.0009) [2023-12-26 00:13:56,527][123090] Updated weights for policy 1, policy_version 81229 (0.0010) [2023-12-26 00:13:56,539][123091] Updated weights for policy 0, policy_version 81633 (0.0006) [2023-12-26 00:13:56,593][123090] Updated weights for policy 1, policy_version 81239 (0.0010) [2023-12-26 00:13:56,607][123091] Updated weights for policy 0, policy_version 81643 (0.0007) [2023-12-26 00:13:56,663][123091] Updated weights for policy 0, policy_version 81653 (0.0007) [2023-12-26 00:13:56,718][123091] Updated weights for policy 0, policy_version 81663 (0.0008) [2023-12-26 00:13:57,398][123090] Updated weights for policy 1, policy_version 81249 (0.0010) [2023-12-26 00:13:57,452][123090] Updated weights for policy 1, policy_version 81259 (0.0010) [2023-12-26 00:13:57,492][123091] Updated weights for policy 0, policy_version 81673 (0.0006) [2023-12-26 00:13:57,503][123090] Updated weights for policy 1, policy_version 81269 (0.0010) [2023-12-26 00:13:57,539][123091] Updated weights for policy 0, policy_version 81683 (0.0005) [2023-12-26 00:13:57,550][123090] Updated weights for policy 1, policy_version 81279 (0.0010) [2023-12-26 00:13:57,589][123091] Updated weights for policy 0, policy_version 81693 (0.0007) [2023-12-26 00:13:58,406][123090] Updated weights for policy 1, policy_version 81289 (0.0009) [2023-12-26 00:13:58,439][123091] Updated weights for policy 0, policy_version 81703 (0.0007) [2023-12-26 00:13:58,467][123090] Updated weights for policy 1, policy_version 81299 (0.0009) [2023-12-26 00:13:58,505][123091] Updated weights for policy 0, policy_version 81713 (0.0009) [2023-12-26 00:13:58,535][123090] Updated weights for policy 1, policy_version 81309 (0.0008) [2023-12-26 00:13:58,566][123091] Updated weights for policy 0, policy_version 81723 (0.0009) [2023-12-26 00:13:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 41738240. Throughput: 0: 9103.3, 1: 8902.5. Samples: 41728724. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:13:58,785][121949] Avg episode reward: [(0, '4380.749'), (1, '4955.925')] [2023-12-26 00:13:59,471][123090] Updated weights for policy 1, policy_version 81319 (0.0009) [2023-12-26 00:13:59,532][123091] Updated weights for policy 0, policy_version 81733 (0.0008) [2023-12-26 00:13:59,545][123090] Updated weights for policy 1, policy_version 81329 (0.0010) [2023-12-26 00:13:59,585][123091] Updated weights for policy 0, policy_version 81743 (0.0010) [2023-12-26 00:13:59,600][123090] Updated weights for policy 1, policy_version 81339 (0.0007) [2023-12-26 00:13:59,637][123091] Updated weights for policy 0, policy_version 81753 (0.0008) [2023-12-26 00:14:00,414][123090] Updated weights for policy 1, policy_version 81349 (0.0007) [2023-12-26 00:14:00,422][123091] Updated weights for policy 0, policy_version 81763 (0.0009) [2023-12-26 00:14:00,462][123090] Updated weights for policy 1, policy_version 81359 (0.0008) [2023-12-26 00:14:00,483][123091] Updated weights for policy 0, policy_version 81773 (0.0007) [2023-12-26 00:14:00,511][123090] Updated weights for policy 1, policy_version 81369 (0.0007) [2023-12-26 00:14:00,545][123091] Updated weights for policy 0, policy_version 81783 (0.0010) [2023-12-26 00:14:01,284][123090] Updated weights for policy 1, policy_version 81379 (0.0007) [2023-12-26 00:14:01,359][123090] Updated weights for policy 1, policy_version 81389 (0.0006) [2023-12-26 00:14:01,416][123091] Updated weights for policy 0, policy_version 81793 (0.0009) [2023-12-26 00:14:01,424][123090] Updated weights for policy 1, policy_version 81399 (0.0006) [2023-12-26 00:14:01,470][123091] Updated weights for policy 0, policy_version 81803 (0.0010) [2023-12-26 00:14:01,540][123091] Updated weights for policy 0, policy_version 81813 (0.0006) [2023-12-26 00:14:01,595][123091] Updated weights for policy 0, policy_version 81823 (0.0005) [2023-12-26 00:14:02,124][123090] Updated weights for policy 1, policy_version 81409 (0.0007) [2023-12-26 00:14:02,230][123090] Updated weights for policy 1, policy_version 81419 (0.0009) [2023-12-26 00:14:02,304][123090] Updated weights for policy 1, policy_version 81429 (0.0010) [2023-12-26 00:14:02,356][123091] Updated weights for policy 0, policy_version 81833 (0.0007) [2023-12-26 00:14:02,365][123090] Updated weights for policy 1, policy_version 81439 (0.0008) [2023-12-26 00:14:02,429][123091] Updated weights for policy 0, policy_version 81843 (0.0007) [2023-12-26 00:14:02,502][123091] Updated weights for policy 0, policy_version 81853 (0.0006) [2023-12-26 00:14:03,012][123090] Updated weights for policy 1, policy_version 81449 (0.0006) [2023-12-26 00:14:03,064][123090] Updated weights for policy 1, policy_version 81459 (0.0009) [2023-12-26 00:14:03,123][123090] Updated weights for policy 1, policy_version 81470 (0.0010) [2023-12-26 00:14:03,155][123091] Updated weights for policy 0, policy_version 81863 (0.0005) [2023-12-26 00:14:03,205][123091] Updated weights for policy 0, policy_version 81873 (0.0006) [2023-12-26 00:14:03,270][123091] Updated weights for policy 0, policy_version 81883 (0.0005) [2023-12-26 00:14:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 41820160. Throughput: 0: 9151.6, 1: 8843.6. Samples: 41835652. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:14:03,785][121949] Avg episode reward: [(0, '4484.660'), (1, '5038.443')] [2023-12-26 00:14:03,848][123091] Updated weights for policy 0, policy_version 81893 (0.0007) [2023-12-26 00:14:03,866][123090] Updated weights for policy 1, policy_version 81480 (0.0008) [2023-12-26 00:14:03,916][123091] Updated weights for policy 0, policy_version 81903 (0.0009) [2023-12-26 00:14:03,920][123090] Updated weights for policy 1, policy_version 81490 (0.0008) [2023-12-26 00:14:03,975][123090] Updated weights for policy 1, policy_version 81500 (0.0009) [2023-12-26 00:14:03,980][123091] Updated weights for policy 0, policy_version 81913 (0.0008) [2023-12-26 00:14:04,791][123091] Updated weights for policy 0, policy_version 81923 (0.0009) [2023-12-26 00:14:04,837][123090] Updated weights for policy 1, policy_version 81510 (0.0008) [2023-12-26 00:14:04,851][123091] Updated weights for policy 0, policy_version 81933 (0.0011) [2023-12-26 00:14:04,898][123090] Updated weights for policy 1, policy_version 81520 (0.0008) [2023-12-26 00:14:04,916][123091] Updated weights for policy 0, policy_version 81943 (0.0010) [2023-12-26 00:14:04,960][123090] Updated weights for policy 1, policy_version 81530 (0.0008) [2023-12-26 00:14:05,523][123091] Updated weights for policy 0, policy_version 81953 (0.0005) [2023-12-26 00:14:05,583][123091] Updated weights for policy 0, policy_version 81963 (0.0005) [2023-12-26 00:14:05,635][123091] Updated weights for policy 0, policy_version 81973 (0.0010) [2023-12-26 00:14:05,686][123091] Updated weights for policy 0, policy_version 81983 (0.0010) [2023-12-26 00:14:05,857][123090] Updated weights for policy 1, policy_version 81540 (0.0009) [2023-12-26 00:14:05,908][123090] Updated weights for policy 1, policy_version 81551 (0.0010) [2023-12-26 00:14:05,960][123090] Updated weights for policy 1, policy_version 81561 (0.0009) [2023-12-26 00:14:06,413][123091] Updated weights for policy 0, policy_version 81993 (0.0010) [2023-12-26 00:14:06,476][123091] Updated weights for policy 0, policy_version 82003 (0.0009) [2023-12-26 00:14:06,542][123091] Updated weights for policy 0, policy_version 82013 (0.0007) [2023-12-26 00:14:06,860][123090] Updated weights for policy 1, policy_version 81571 (0.0010) [2023-12-26 00:14:06,931][123090] Updated weights for policy 1, policy_version 81581 (0.0009) [2023-12-26 00:14:06,988][123090] Updated weights for policy 1, policy_version 81591 (0.0010) [2023-12-26 00:14:07,383][123091] Updated weights for policy 0, policy_version 82023 (0.0005) [2023-12-26 00:14:07,444][123091] Updated weights for policy 0, policy_version 82033 (0.0005) [2023-12-26 00:14:07,491][123091] Updated weights for policy 0, policy_version 82043 (0.0005) [2023-12-26 00:14:07,873][123090] Updated weights for policy 1, policy_version 81601 (0.0007) [2023-12-26 00:14:07,924][123090] Updated weights for policy 1, policy_version 81611 (0.0009) [2023-12-26 00:14:07,977][123090] Updated weights for policy 1, policy_version 81622 (0.0010) [2023-12-26 00:14:08,035][123090] Updated weights for policy 1, policy_version 81632 (0.0010) [2023-12-26 00:14:08,071][123091] Updated weights for policy 0, policy_version 82053 (0.0008) [2023-12-26 00:14:08,127][123091] Updated weights for policy 0, policy_version 82063 (0.0007) [2023-12-26 00:14:08,185][123091] Updated weights for policy 0, policy_version 82074 (0.0006) [2023-12-26 00:14:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 41910272. Throughput: 0: 9235.3, 1: 8808.0. Samples: 41889252. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:14:08,785][121949] Avg episode reward: [(0, '4439.506'), (1, '5181.715')] [2023-12-26 00:14:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000082080_21012480.pth... [2023-12-26 00:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000081632_20897792.pth... [2023-12-26 00:14:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000081024_20742144.pth [2023-12-26 00:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000080640_20643840.pth [2023-12-26 00:14:08,931][123090] Updated weights for policy 1, policy_version 81642 (0.0009) [2023-12-26 00:14:08,995][123090] Updated weights for policy 1, policy_version 81652 (0.0009) [2023-12-26 00:14:09,003][123091] Updated weights for policy 0, policy_version 82084 (0.0007) [2023-12-26 00:14:09,053][123090] Updated weights for policy 1, policy_version 81662 (0.0008) [2023-12-26 00:14:09,068][123091] Updated weights for policy 0, policy_version 82094 (0.0009) [2023-12-26 00:14:09,134][123091] Updated weights for policy 0, policy_version 82105 (0.0009) [2023-12-26 00:14:09,882][123090] Updated weights for policy 1, policy_version 81672 (0.0008) [2023-12-26 00:14:09,958][123090] Updated weights for policy 1, policy_version 81682 (0.0009) [2023-12-26 00:14:10,002][123091] Updated weights for policy 0, policy_version 82115 (0.0010) [2023-12-26 00:14:10,025][123090] Updated weights for policy 1, policy_version 81692 (0.0007) [2023-12-26 00:14:10,071][123091] Updated weights for policy 0, policy_version 82125 (0.0009) [2023-12-26 00:14:10,144][123091] Updated weights for policy 0, policy_version 82135 (0.0008) [2023-12-26 00:14:10,847][123091] Updated weights for policy 0, policy_version 82145 (0.0006) [2023-12-26 00:14:10,900][123091] Updated weights for policy 0, policy_version 82155 (0.0007) [2023-12-26 00:14:10,905][123090] Updated weights for policy 1, policy_version 81702 (0.0009) [2023-12-26 00:14:10,952][123091] Updated weights for policy 0, policy_version 82165 (0.0010) [2023-12-26 00:14:10,968][123090] Updated weights for policy 1, policy_version 81712 (0.0006) [2023-12-26 00:14:11,009][123091] Updated weights for policy 0, policy_version 82175 (0.0008) [2023-12-26 00:14:11,036][123090] Updated weights for policy 1, policy_version 81722 (0.0009) [2023-12-26 00:14:11,876][123090] Updated weights for policy 1, policy_version 81732 (0.0009) [2023-12-26 00:14:11,918][123091] Updated weights for policy 0, policy_version 82185 (0.0008) [2023-12-26 00:14:11,934][123090] Updated weights for policy 1, policy_version 81742 (0.0009) [2023-12-26 00:14:11,981][123091] Updated weights for policy 0, policy_version 82195 (0.0008) [2023-12-26 00:14:11,988][123090] Updated weights for policy 1, policy_version 81752 (0.0008) [2023-12-26 00:14:12,044][123091] Updated weights for policy 0, policy_version 82205 (0.0007) [2023-12-26 00:14:12,844][123090] Updated weights for policy 1, policy_version 81762 (0.0010) [2023-12-26 00:14:12,866][123091] Updated weights for policy 0, policy_version 82215 (0.0009) [2023-12-26 00:14:12,902][123090] Updated weights for policy 1, policy_version 81772 (0.0009) [2023-12-26 00:14:12,916][123091] Updated weights for policy 0, policy_version 82225 (0.0009) [2023-12-26 00:14:12,966][123090] Updated weights for policy 1, policy_version 81782 (0.0008) [2023-12-26 00:14:12,977][123091] Updated weights for policy 0, policy_version 82235 (0.0009) [2023-12-26 00:14:13,032][123090] Updated weights for policy 1, policy_version 81792 (0.0009) [2023-12-26 00:14:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 41992192. Throughput: 0: 9197.9, 1: 8806.2. Samples: 41993216. Policy #0 lag: (min: 10.0, avg: 17.2, max: 42.0) [2023-12-26 00:14:13,785][121949] Avg episode reward: [(0, '4281.434'), (1, '5231.234')] [2023-12-26 00:14:13,785][123091] Updated weights for policy 0, policy_version 82245 (0.0008) [2023-12-26 00:14:13,836][123091] Updated weights for policy 0, policy_version 82255 (0.0009) [2023-12-26 00:14:13,860][123090] Updated weights for policy 1, policy_version 81802 (0.0007) [2023-12-26 00:14:13,898][123091] Updated weights for policy 0, policy_version 82265 (0.0009) [2023-12-26 00:14:13,914][123090] Updated weights for policy 1, policy_version 81812 (0.0008) [2023-12-26 00:14:13,980][123090] Updated weights for policy 1, policy_version 81822 (0.0008) [2023-12-26 00:14:14,752][123091] Updated weights for policy 0, policy_version 82275 (0.0009) [2023-12-26 00:14:14,816][123091] Updated weights for policy 0, policy_version 82285 (0.0009) [2023-12-26 00:14:14,846][123090] Updated weights for policy 1, policy_version 81832 (0.0009) [2023-12-26 00:14:14,872][123091] Updated weights for policy 0, policy_version 82295 (0.0010) [2023-12-26 00:14:14,905][123090] Updated weights for policy 1, policy_version 81842 (0.0010) [2023-12-26 00:14:14,968][123090] Updated weights for policy 1, policy_version 81852 (0.0007) [2023-12-26 00:14:15,740][123091] Updated weights for policy 0, policy_version 82305 (0.0009) [2023-12-26 00:14:15,750][123090] Updated weights for policy 1, policy_version 81862 (0.0005) [2023-12-26 00:14:15,794][123091] Updated weights for policy 0, policy_version 82316 (0.0009) [2023-12-26 00:14:15,808][123090] Updated weights for policy 1, policy_version 81872 (0.0006) [2023-12-26 00:14:15,852][123091] Updated weights for policy 0, policy_version 82326 (0.0009) [2023-12-26 00:14:15,878][123090] Updated weights for policy 1, policy_version 81882 (0.0005) [2023-12-26 00:14:15,905][123091] Updated weights for policy 0, policy_version 82336 (0.0008) [2023-12-26 00:14:16,547][123090] Updated weights for policy 1, policy_version 81892 (0.0007) [2023-12-26 00:14:16,606][123090] Updated weights for policy 1, policy_version 81902 (0.0005) [2023-12-26 00:14:16,669][123090] Updated weights for policy 1, policy_version 81912 (0.0005) [2023-12-26 00:14:16,839][123091] Updated weights for policy 0, policy_version 82346 (0.0010) [2023-12-26 00:14:16,898][123091] Updated weights for policy 0, policy_version 82356 (0.0015) [2023-12-26 00:14:16,965][123091] Updated weights for policy 0, policy_version 82366 (0.0009) [2023-12-26 00:14:17,305][123090] Updated weights for policy 1, policy_version 81922 (0.0005) [2023-12-26 00:14:17,368][123090] Updated weights for policy 1, policy_version 81932 (0.0006) [2023-12-26 00:14:17,430][123090] Updated weights for policy 1, policy_version 81942 (0.0006) [2023-12-26 00:14:17,496][123090] Updated weights for policy 1, policy_version 81952 (0.0005) [2023-12-26 00:14:17,848][123091] Updated weights for policy 0, policy_version 82376 (0.0009) [2023-12-26 00:14:17,910][123091] Updated weights for policy 0, policy_version 82386 (0.0009) [2023-12-26 00:14:17,972][123091] Updated weights for policy 0, policy_version 82396 (0.0009) [2023-12-26 00:14:18,185][123090] Updated weights for policy 1, policy_version 81962 (0.0005) [2023-12-26 00:14:18,240][123090] Updated weights for policy 1, policy_version 81972 (0.0005) [2023-12-26 00:14:18,291][123090] Updated weights for policy 1, policy_version 81982 (0.0005) [2023-12-26 00:14:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 42082304. Throughput: 0: 9040.5, 1: 8756.0. Samples: 42098272. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:18,785][121949] Avg episode reward: [(0, '4267.761'), (1, '5337.307')] [2023-12-26 00:14:18,865][123091] Updated weights for policy 0, policy_version 82406 (0.0009) [2023-12-26 00:14:18,929][123091] Updated weights for policy 0, policy_version 82416 (0.0009) [2023-12-26 00:14:18,999][123091] Updated weights for policy 0, policy_version 82426 (0.0009) [2023-12-26 00:14:19,034][123090] Updated weights for policy 1, policy_version 81992 (0.0007) [2023-12-26 00:14:19,088][123090] Updated weights for policy 1, policy_version 82002 (0.0006) [2023-12-26 00:14:19,146][123090] Updated weights for policy 1, policy_version 82012 (0.0007) [2023-12-26 00:14:19,886][123091] Updated weights for policy 0, policy_version 82436 (0.0008) [2023-12-26 00:14:19,938][123090] Updated weights for policy 1, policy_version 82022 (0.0008) [2023-12-26 00:14:19,953][123091] Updated weights for policy 0, policy_version 82446 (0.0009) [2023-12-26 00:14:19,999][123090] Updated weights for policy 1, policy_version 82032 (0.0008) [2023-12-26 00:14:20,016][123091] Updated weights for policy 0, policy_version 82456 (0.0008) [2023-12-26 00:14:20,065][123090] Updated weights for policy 1, policy_version 82042 (0.0008) [2023-12-26 00:14:20,805][123091] Updated weights for policy 0, policy_version 82466 (0.0009) [2023-12-26 00:14:20,865][123091] Updated weights for policy 0, policy_version 82476 (0.0011) [2023-12-26 00:14:20,873][123090] Updated weights for policy 1, policy_version 82052 (0.0008) [2023-12-26 00:14:20,933][123090] Updated weights for policy 1, policy_version 82062 (0.0008) [2023-12-26 00:14:20,934][123091] Updated weights for policy 0, policy_version 82486 (0.0011) [2023-12-26 00:14:20,986][123091] Updated weights for policy 0, policy_version 82496 (0.0011) [2023-12-26 00:14:20,996][123090] Updated weights for policy 1, policy_version 82072 (0.0006) [2023-12-26 00:14:21,769][123090] Updated weights for policy 1, policy_version 82082 (0.0008) [2023-12-26 00:14:21,821][123090] Updated weights for policy 1, policy_version 82092 (0.0010) [2023-12-26 00:14:21,850][123091] Updated weights for policy 0, policy_version 82506 (0.0006) [2023-12-26 00:14:21,880][123090] Updated weights for policy 1, policy_version 82102 (0.0008) [2023-12-26 00:14:21,902][123091] Updated weights for policy 0, policy_version 82516 (0.0005) [2023-12-26 00:14:21,953][123090] Updated weights for policy 1, policy_version 82112 (0.0008) [2023-12-26 00:14:21,956][123091] Updated weights for policy 0, policy_version 82526 (0.0006) [2023-12-26 00:14:22,605][123091] Updated weights for policy 0, policy_version 82536 (0.0006) [2023-12-26 00:14:22,662][123091] Updated weights for policy 0, policy_version 82546 (0.0006) [2023-12-26 00:14:22,723][123091] Updated weights for policy 0, policy_version 82556 (0.0006) [2023-12-26 00:14:22,739][123090] Updated weights for policy 1, policy_version 82122 (0.0011) [2023-12-26 00:14:22,795][123090] Updated weights for policy 1, policy_version 82132 (0.0010) [2023-12-26 00:14:22,847][123090] Updated weights for policy 1, policy_version 82142 (0.0010) [2023-12-26 00:14:23,337][123091] Updated weights for policy 0, policy_version 82566 (0.0006) [2023-12-26 00:14:23,386][123091] Updated weights for policy 0, policy_version 82576 (0.0005) [2023-12-26 00:14:23,444][123091] Updated weights for policy 0, policy_version 82586 (0.0005) [2023-12-26 00:14:23,692][123090] Updated weights for policy 1, policy_version 82152 (0.0010) [2023-12-26 00:14:23,743][123090] Updated weights for policy 1, policy_version 82162 (0.0010) [2023-12-26 00:14:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 42172416. Throughput: 0: 8984.2, 1: 8712.2. Samples: 42149920. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:23,785][121949] Avg episode reward: [(0, '4223.394'), (1, '5319.375')] [2023-12-26 00:14:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000082592_21143552.pth... [2023-12-26 00:14:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000081536_20873216.pth [2023-12-26 00:14:23,802][123090] Updated weights for policy 1, policy_version 82172 (0.0010) [2023-12-26 00:14:23,818][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000082176_21037056.pth... [2023-12-26 00:14:23,821][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000081152_20774912.pth [2023-12-26 00:14:24,043][123091] Updated weights for policy 0, policy_version 82596 (0.0006) [2023-12-26 00:14:24,116][123091] Updated weights for policy 0, policy_version 82606 (0.0006) [2023-12-26 00:14:24,176][123091] Updated weights for policy 0, policy_version 82616 (0.0008) [2023-12-26 00:14:24,634][123090] Updated weights for policy 1, policy_version 82182 (0.0010) [2023-12-26 00:14:24,697][123090] Updated weights for policy 1, policy_version 82192 (0.0010) [2023-12-26 00:14:24,762][123090] Updated weights for policy 1, policy_version 82202 (0.0010) [2023-12-26 00:14:24,972][123091] Updated weights for policy 0, policy_version 82626 (0.0008) [2023-12-26 00:14:25,040][123091] Updated weights for policy 0, policy_version 82636 (0.0009) [2023-12-26 00:14:25,111][123091] Updated weights for policy 0, policy_version 82646 (0.0009) [2023-12-26 00:14:25,183][123091] Updated weights for policy 0, policy_version 82656 (0.0010) [2023-12-26 00:14:25,549][123090] Updated weights for policy 1, policy_version 82212 (0.0010) [2023-12-26 00:14:25,609][123090] Updated weights for policy 1, policy_version 82222 (0.0009) [2023-12-26 00:14:25,666][123090] Updated weights for policy 1, policy_version 82232 (0.0009) [2023-12-26 00:14:26,038][123091] Updated weights for policy 0, policy_version 82666 (0.0009) [2023-12-26 00:14:26,110][123091] Updated weights for policy 0, policy_version 82676 (0.0010) [2023-12-26 00:14:26,168][123091] Updated weights for policy 0, policy_version 82686 (0.0010) [2023-12-26 00:14:26,342][123090] Updated weights for policy 1, policy_version 82242 (0.0008) [2023-12-26 00:14:26,410][123090] Updated weights for policy 1, policy_version 82252 (0.0005) [2023-12-26 00:14:26,469][123090] Updated weights for policy 1, policy_version 82262 (0.0005) [2023-12-26 00:14:26,518][123090] Updated weights for policy 1, policy_version 82272 (0.0005) [2023-12-26 00:14:27,040][123091] Updated weights for policy 0, policy_version 82696 (0.0010) [2023-12-26 00:14:27,096][123091] Updated weights for policy 0, policy_version 82706 (0.0009) [2023-12-26 00:14:27,152][123091] Updated weights for policy 0, policy_version 82716 (0.0010) [2023-12-26 00:14:27,229][123090] Updated weights for policy 1, policy_version 82282 (0.0008) [2023-12-26 00:14:27,276][123090] Updated weights for policy 1, policy_version 82292 (0.0008) [2023-12-26 00:14:27,330][123090] Updated weights for policy 1, policy_version 82302 (0.0009) [2023-12-26 00:14:28,006][123091] Updated weights for policy 0, policy_version 82726 (0.0010) [2023-12-26 00:14:28,038][123090] Updated weights for policy 1, policy_version 82312 (0.0006) [2023-12-26 00:14:28,052][123091] Updated weights for policy 0, policy_version 82736 (0.0008) [2023-12-26 00:14:28,106][123090] Updated weights for policy 1, policy_version 82322 (0.0005) [2023-12-26 00:14:28,108][123091] Updated weights for policy 0, policy_version 82746 (0.0008) [2023-12-26 00:14:28,171][123090] Updated weights for policy 1, policy_version 82332 (0.0005) [2023-12-26 00:14:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 42262528. Throughput: 0: 8993.4, 1: 8699.6. Samples: 42259028. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:28,785][121949] Avg episode reward: [(0, '4128.928'), (1, '5455.652')] [2023-12-26 00:14:28,822][123090] Updated weights for policy 1, policy_version 82342 (0.0006) [2023-12-26 00:14:28,893][123090] Updated weights for policy 1, policy_version 82352 (0.0006) [2023-12-26 00:14:28,946][123090] Updated weights for policy 1, policy_version 82362 (0.0005) [2023-12-26 00:14:29,044][123091] Updated weights for policy 0, policy_version 82756 (0.0009) [2023-12-26 00:14:29,105][123091] Updated weights for policy 0, policy_version 82766 (0.0010) [2023-12-26 00:14:29,159][123091] Updated weights for policy 0, policy_version 82777 (0.0010) [2023-12-26 00:14:29,682][123090] Updated weights for policy 1, policy_version 82372 (0.0007) [2023-12-26 00:14:29,747][123090] Updated weights for policy 1, policy_version 82382 (0.0009) [2023-12-26 00:14:29,806][123090] Updated weights for policy 1, policy_version 82392 (0.0010) [2023-12-26 00:14:29,989][123091] Updated weights for policy 0, policy_version 82788 (0.0010) [2023-12-26 00:14:30,048][123091] Updated weights for policy 0, policy_version 82798 (0.0009) [2023-12-26 00:14:30,103][123091] Updated weights for policy 0, policy_version 82808 (0.0010) [2023-12-26 00:14:30,626][123090] Updated weights for policy 1, policy_version 82402 (0.0010) [2023-12-26 00:14:30,682][123090] Updated weights for policy 1, policy_version 82412 (0.0010) [2023-12-26 00:14:30,745][123090] Updated weights for policy 1, policy_version 82422 (0.0010) [2023-12-26 00:14:30,799][123090] Updated weights for policy 1, policy_version 82432 (0.0008) [2023-12-26 00:14:30,956][123091] Updated weights for policy 0, policy_version 82818 (0.0009) [2023-12-26 00:14:31,014][123091] Updated weights for policy 0, policy_version 82828 (0.0009) [2023-12-26 00:14:31,074][123091] Updated weights for policy 0, policy_version 82838 (0.0009) [2023-12-26 00:14:31,135][123091] Updated weights for policy 0, policy_version 82848 (0.0010) [2023-12-26 00:14:31,540][123090] Updated weights for policy 1, policy_version 82442 (0.0010) [2023-12-26 00:14:31,600][123090] Updated weights for policy 1, policy_version 82452 (0.0009) [2023-12-26 00:14:31,661][123090] Updated weights for policy 1, policy_version 82462 (0.0009) [2023-12-26 00:14:32,051][123091] Updated weights for policy 0, policy_version 82858 (0.0009) [2023-12-26 00:14:32,104][123091] Updated weights for policy 0, policy_version 82868 (0.0009) [2023-12-26 00:14:32,153][123091] Updated weights for policy 0, policy_version 82878 (0.0009) [2023-12-26 00:14:32,482][123090] Updated weights for policy 1, policy_version 82472 (0.0009) [2023-12-26 00:14:32,533][123090] Updated weights for policy 1, policy_version 82482 (0.0010) [2023-12-26 00:14:32,592][123090] Updated weights for policy 1, policy_version 82492 (0.0010) [2023-12-26 00:14:33,024][123091] Updated weights for policy 0, policy_version 82888 (0.0010) [2023-12-26 00:14:33,077][123091] Updated weights for policy 0, policy_version 82898 (0.0009) [2023-12-26 00:14:33,125][123091] Updated weights for policy 0, policy_version 82908 (0.0009) [2023-12-26 00:14:33,367][123090] Updated weights for policy 1, policy_version 82503 (0.0010) [2023-12-26 00:14:33,422][123090] Updated weights for policy 1, policy_version 82514 (0.0009) [2023-12-26 00:14:33,479][123090] Updated weights for policy 1, policy_version 82524 (0.0009) [2023-12-26 00:14:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 42352640. Throughput: 0: 8857.4, 1: 8833.7. Samples: 42363868. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:33,784][121949] Avg episode reward: [(0, '4115.373'), (1, '5525.569')] [2023-12-26 00:14:33,785][123008] Saving new best policy, reward=5525.569! [2023-12-26 00:14:33,950][123091] Updated weights for policy 0, policy_version 82919 (0.0007) [2023-12-26 00:14:34,010][123091] Updated weights for policy 0, policy_version 82929 (0.0006) [2023-12-26 00:14:34,073][123091] Updated weights for policy 0, policy_version 82939 (0.0005) [2023-12-26 00:14:34,366][123090] Updated weights for policy 1, policy_version 82534 (0.0008) [2023-12-26 00:14:34,418][123090] Updated weights for policy 1, policy_version 82544 (0.0010) [2023-12-26 00:14:34,476][123090] Updated weights for policy 1, policy_version 82554 (0.0009) [2023-12-26 00:14:34,822][123091] Updated weights for policy 0, policy_version 82949 (0.0009) [2023-12-26 00:14:34,891][123091] Updated weights for policy 0, policy_version 82959 (0.0010) [2023-12-26 00:14:34,957][123091] Updated weights for policy 0, policy_version 82969 (0.0009) [2023-12-26 00:14:35,311][123090] Updated weights for policy 1, policy_version 82564 (0.0009) [2023-12-26 00:14:35,359][123090] Updated weights for policy 1, policy_version 82574 (0.0009) [2023-12-26 00:14:35,412][123090] Updated weights for policy 1, policy_version 82584 (0.0010) [2023-12-26 00:14:35,793][123091] Updated weights for policy 0, policy_version 82979 (0.0009) [2023-12-26 00:14:35,852][123091] Updated weights for policy 0, policy_version 82989 (0.0005) [2023-12-26 00:14:35,908][123091] Updated weights for policy 0, policy_version 82999 (0.0007) [2023-12-26 00:14:36,278][123090] Updated weights for policy 1, policy_version 82594 (0.0008) [2023-12-26 00:14:36,343][123090] Updated weights for policy 1, policy_version 82604 (0.0006) [2023-12-26 00:14:36,416][123090] Updated weights for policy 1, policy_version 82614 (0.0006) [2023-12-26 00:14:36,475][123090] Updated weights for policy 1, policy_version 82624 (0.0008) [2023-12-26 00:14:36,746][123091] Updated weights for policy 0, policy_version 83009 (0.0008) [2023-12-26 00:14:36,803][123091] Updated weights for policy 0, policy_version 83019 (0.0010) [2023-12-26 00:14:36,860][123091] Updated weights for policy 0, policy_version 83029 (0.0009) [2023-12-26 00:14:36,913][123091] Updated weights for policy 0, policy_version 83039 (0.0010) [2023-12-26 00:14:37,110][123090] Updated weights for policy 1, policy_version 82634 (0.0006) [2023-12-26 00:14:37,174][123090] Updated weights for policy 1, policy_version 82644 (0.0007) [2023-12-26 00:14:37,226][123090] Updated weights for policy 1, policy_version 82654 (0.0009) [2023-12-26 00:14:37,788][123091] Updated weights for policy 0, policy_version 83049 (0.0011) [2023-12-26 00:14:37,851][123091] Updated weights for policy 0, policy_version 83059 (0.0011) [2023-12-26 00:14:37,875][123090] Updated weights for policy 1, policy_version 82664 (0.0006) [2023-12-26 00:14:37,918][123091] Updated weights for policy 0, policy_version 83069 (0.0011) [2023-12-26 00:14:37,937][123090] Updated weights for policy 1, policy_version 82674 (0.0006) [2023-12-26 00:14:38,002][123090] Updated weights for policy 1, policy_version 82684 (0.0005) [2023-12-26 00:14:38,727][123091] Updated weights for policy 0, policy_version 83079 (0.0008) [2023-12-26 00:14:38,784][123091] Updated weights for policy 0, policy_version 83089 (0.0006) [2023-12-26 00:14:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 42434560. Throughput: 0: 8846.0, 1: 8834.1. Samples: 42416776. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:38,785][121949] Avg episode reward: [(0, '4208.503'), (1, '5562.184')] [2023-12-26 00:14:38,790][123090] Updated weights for policy 1, policy_version 82694 (0.0007) [2023-12-26 00:14:38,848][123091] Updated weights for policy 0, policy_version 83099 (0.0006) [2023-12-26 00:14:38,853][123090] Updated weights for policy 1, policy_version 82704 (0.0006) [2023-12-26 00:14:38,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000083104_21274624.pth... [2023-12-26 00:14:38,878][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000082080_21012480.pth [2023-12-26 00:14:38,928][123090] Updated weights for policy 1, policy_version 82714 (0.0005) [2023-12-26 00:14:38,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000082720_21176320.pth... [2023-12-26 00:14:38,972][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000081632_20897792.pth [2023-12-26 00:14:38,972][123008] Saving new best policy, reward=5562.184! [2023-12-26 00:14:39,571][123091] Updated weights for policy 0, policy_version 83109 (0.0007) [2023-12-26 00:14:39,644][123091] Updated weights for policy 0, policy_version 83119 (0.0006) [2023-12-26 00:14:39,700][123090] Updated weights for policy 1, policy_version 82724 (0.0010) [2023-12-26 00:14:39,710][123091] Updated weights for policy 0, policy_version 83129 (0.0006) [2023-12-26 00:14:39,768][123090] Updated weights for policy 1, policy_version 82734 (0.0006) [2023-12-26 00:14:39,841][123090] Updated weights for policy 1, policy_version 82744 (0.0009) [2023-12-26 00:14:40,514][123091] Updated weights for policy 0, policy_version 83139 (0.0011) [2023-12-26 00:14:40,576][123091] Updated weights for policy 0, policy_version 83149 (0.0005) [2023-12-26 00:14:40,626][123091] Updated weights for policy 0, policy_version 83159 (0.0007) [2023-12-26 00:14:40,656][123090] Updated weights for policy 1, policy_version 82754 (0.0008) [2023-12-26 00:14:40,716][123090] Updated weights for policy 1, policy_version 82764 (0.0011) [2023-12-26 00:14:40,773][123090] Updated weights for policy 1, policy_version 82774 (0.0010) [2023-12-26 00:14:40,836][123090] Updated weights for policy 1, policy_version 82784 (0.0011) [2023-12-26 00:14:41,417][123091] Updated weights for policy 0, policy_version 83169 (0.0009) [2023-12-26 00:14:41,466][123091] Updated weights for policy 0, policy_version 83179 (0.0006) [2023-12-26 00:14:41,526][123091] Updated weights for policy 0, policy_version 83189 (0.0007) [2023-12-26 00:14:41,578][123091] Updated weights for policy 0, policy_version 83199 (0.0010) [2023-12-26 00:14:41,719][123090] Updated weights for policy 1, policy_version 82794 (0.0011) [2023-12-26 00:14:41,776][123090] Updated weights for policy 1, policy_version 82804 (0.0011) [2023-12-26 00:14:41,833][123090] Updated weights for policy 1, policy_version 82814 (0.0011) [2023-12-26 00:14:42,430][123091] Updated weights for policy 0, policy_version 83209 (0.0011) [2023-12-26 00:14:42,490][123091] Updated weights for policy 0, policy_version 83219 (0.0006) [2023-12-26 00:14:42,551][123091] Updated weights for policy 0, policy_version 83229 (0.0010) [2023-12-26 00:14:42,674][123090] Updated weights for policy 1, policy_version 82824 (0.0007) [2023-12-26 00:14:42,747][123090] Updated weights for policy 1, policy_version 82834 (0.0009) [2023-12-26 00:14:42,818][123090] Updated weights for policy 1, policy_version 82844 (0.0011) [2023-12-26 00:14:43,319][123091] Updated weights for policy 0, policy_version 83239 (0.0008) [2023-12-26 00:14:43,369][123091] Updated weights for policy 0, policy_version 83249 (0.0009) [2023-12-26 00:14:43,431][123091] Updated weights for policy 0, policy_version 83259 (0.0008) [2023-12-26 00:14:43,574][123090] Updated weights for policy 1, policy_version 82854 (0.0008) [2023-12-26 00:14:43,625][123090] Updated weights for policy 1, policy_version 82864 (0.0005) [2023-12-26 00:14:43,691][123090] Updated weights for policy 1, policy_version 82874 (0.0005) [2023-12-26 00:14:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 42532864. Throughput: 0: 8760.5, 1: 8874.4. Samples: 42522292. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:43,785][121949] Avg episode reward: [(0, '4376.150'), (1, '5549.371')] [2023-12-26 00:14:44,131][123091] Updated weights for policy 0, policy_version 83269 (0.0009) [2023-12-26 00:14:44,200][123091] Updated weights for policy 0, policy_version 83279 (0.0009) [2023-12-26 00:14:44,253][123091] Updated weights for policy 0, policy_version 83289 (0.0010) [2023-12-26 00:14:44,336][123090] Updated weights for policy 1, policy_version 82884 (0.0007) [2023-12-26 00:14:44,390][123090] Updated weights for policy 1, policy_version 82894 (0.0010) [2023-12-26 00:14:44,455][123090] Updated weights for policy 1, policy_version 82904 (0.0007) [2023-12-26 00:14:45,098][123091] Updated weights for policy 0, policy_version 83299 (0.0009) [2023-12-26 00:14:45,166][123091] Updated weights for policy 0, policy_version 83309 (0.0009) [2023-12-26 00:14:45,226][123091] Updated weights for policy 0, policy_version 83319 (0.0010) [2023-12-26 00:14:45,259][123090] Updated weights for policy 1, policy_version 82914 (0.0010) [2023-12-26 00:14:45,311][123090] Updated weights for policy 1, policy_version 82924 (0.0006) [2023-12-26 00:14:45,371][123090] Updated weights for policy 1, policy_version 82934 (0.0005) [2023-12-26 00:14:45,428][123090] Updated weights for policy 1, policy_version 82944 (0.0006) [2023-12-26 00:14:46,083][123091] Updated weights for policy 0, policy_version 83329 (0.0010) [2023-12-26 00:14:46,140][123091] Updated weights for policy 0, policy_version 83339 (0.0009) [2023-12-26 00:14:46,197][123091] Updated weights for policy 0, policy_version 83349 (0.0006) [2023-12-26 00:14:46,215][123090] Updated weights for policy 1, policy_version 82954 (0.0010) [2023-12-26 00:14:46,256][123091] Updated weights for policy 0, policy_version 83359 (0.0006) [2023-12-26 00:14:46,269][123090] Updated weights for policy 1, policy_version 82964 (0.0010) [2023-12-26 00:14:46,324][123090] Updated weights for policy 1, policy_version 82974 (0.0010) [2023-12-26 00:14:47,042][123091] Updated weights for policy 0, policy_version 83369 (0.0006) [2023-12-26 00:14:47,106][123091] Updated weights for policy 0, policy_version 83379 (0.0009) [2023-12-26 00:14:47,106][123090] Updated weights for policy 1, policy_version 82984 (0.0007) [2023-12-26 00:14:47,165][123090] Updated weights for policy 1, policy_version 82994 (0.0005) [2023-12-26 00:14:47,167][123091] Updated weights for policy 0, policy_version 83389 (0.0010) [2023-12-26 00:14:47,222][123090] Updated weights for policy 1, policy_version 83004 (0.0005) [2023-12-26 00:14:47,974][123091] Updated weights for policy 0, policy_version 83399 (0.0009) [2023-12-26 00:14:47,987][123090] Updated weights for policy 1, policy_version 83014 (0.0008) [2023-12-26 00:14:48,030][123091] Updated weights for policy 0, policy_version 83409 (0.0010) [2023-12-26 00:14:48,050][123090] Updated weights for policy 1, policy_version 83024 (0.0007) [2023-12-26 00:14:48,096][123091] Updated weights for policy 0, policy_version 83419 (0.0009) [2023-12-26 00:14:48,107][123090] Updated weights for policy 1, policy_version 83034 (0.0009) [2023-12-26 00:14:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 42614784. Throughput: 0: 8758.2, 1: 8914.5. Samples: 42630924. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:48,784][121949] Avg episode reward: [(0, '4398.391'), (1, '5541.884')] [2023-12-26 00:14:48,889][123091] Updated weights for policy 0, policy_version 83429 (0.0009) [2023-12-26 00:14:48,943][123090] Updated weights for policy 1, policy_version 83044 (0.0006) [2023-12-26 00:14:48,959][123091] Updated weights for policy 0, policy_version 83439 (0.0008) [2023-12-26 00:14:49,009][123090] Updated weights for policy 1, policy_version 83054 (0.0006) [2023-12-26 00:14:49,024][123091] Updated weights for policy 0, policy_version 83449 (0.0009) [2023-12-26 00:14:49,078][123090] Updated weights for policy 1, policy_version 83064 (0.0011) [2023-12-26 00:14:49,696][123091] Updated weights for policy 0, policy_version 83459 (0.0006) [2023-12-26 00:14:49,759][123091] Updated weights for policy 0, policy_version 83469 (0.0011) [2023-12-26 00:14:49,825][123091] Updated weights for policy 0, policy_version 83479 (0.0010) [2023-12-26 00:14:49,834][123090] Updated weights for policy 1, policy_version 83074 (0.0011) [2023-12-26 00:14:49,899][123090] Updated weights for policy 1, policy_version 83084 (0.0010) [2023-12-26 00:14:49,958][123090] Updated weights for policy 1, policy_version 83094 (0.0010) [2023-12-26 00:14:50,023][123090] Updated weights for policy 1, policy_version 83104 (0.0010) [2023-12-26 00:14:50,581][123091] Updated weights for policy 0, policy_version 83489 (0.0014) [2023-12-26 00:14:50,642][123091] Updated weights for policy 0, policy_version 83499 (0.0006) [2023-12-26 00:14:50,698][123091] Updated weights for policy 0, policy_version 83509 (0.0011) [2023-12-26 00:14:50,766][123091] Updated weights for policy 0, policy_version 83519 (0.0011) [2023-12-26 00:14:50,858][123090] Updated weights for policy 1, policy_version 83114 (0.0011) [2023-12-26 00:14:50,914][123090] Updated weights for policy 1, policy_version 83124 (0.0010) [2023-12-26 00:14:50,967][123090] Updated weights for policy 1, policy_version 83134 (0.0011) [2023-12-26 00:14:51,584][123091] Updated weights for policy 0, policy_version 83529 (0.0009) [2023-12-26 00:14:51,654][123091] Updated weights for policy 0, policy_version 83539 (0.0009) [2023-12-26 00:14:51,715][123091] Updated weights for policy 0, policy_version 83549 (0.0009) [2023-12-26 00:14:51,816][123090] Updated weights for policy 1, policy_version 83144 (0.0010) [2023-12-26 00:14:51,874][123090] Updated weights for policy 1, policy_version 83154 (0.0009) [2023-12-26 00:14:51,937][123090] Updated weights for policy 1, policy_version 83164 (0.0009) [2023-12-26 00:14:52,517][123091] Updated weights for policy 0, policy_version 83559 (0.0010) [2023-12-26 00:14:52,571][123091] Updated weights for policy 0, policy_version 83569 (0.0007) [2023-12-26 00:14:52,618][123091] Updated weights for policy 0, policy_version 83579 (0.0005) [2023-12-26 00:14:52,809][123090] Updated weights for policy 1, policy_version 83174 (0.0007) [2023-12-26 00:14:52,872][123090] Updated weights for policy 1, policy_version 83184 (0.0005) [2023-12-26 00:14:52,941][123090] Updated weights for policy 1, policy_version 83194 (0.0008) [2023-12-26 00:14:53,263][123091] Updated weights for policy 0, policy_version 83589 (0.0008) [2023-12-26 00:14:53,314][123091] Updated weights for policy 0, policy_version 83599 (0.0010) [2023-12-26 00:14:53,362][123091] Updated weights for policy 0, policy_version 83609 (0.0006) [2023-12-26 00:14:53,725][123090] Updated weights for policy 1, policy_version 83204 (0.0010) [2023-12-26 00:14:53,785][123090] Updated weights for policy 1, policy_version 83214 (0.0010) [2023-12-26 00:14:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 42704896. Throughput: 0: 8708.5, 1: 8939.4. Samples: 42683412. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:53,785][121949] Avg episode reward: [(0, '4329.389'), (1, '5545.554')] [2023-12-26 00:14:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000083616_21405696.pth... [2023-12-26 00:14:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000082592_21143552.pth [2023-12-26 00:14:53,847][123090] Updated weights for policy 1, policy_version 83224 (0.0010) [2023-12-26 00:14:53,900][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000083232_21307392.pth... [2023-12-26 00:14:53,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000082176_21037056.pth [2023-12-26 00:14:54,091][123091] Updated weights for policy 0, policy_version 83619 (0.0007) [2023-12-26 00:14:54,156][123091] Updated weights for policy 0, policy_version 83629 (0.0009) [2023-12-26 00:14:54,223][123091] Updated weights for policy 0, policy_version 83639 (0.0008) [2023-12-26 00:14:54,549][123090] Updated weights for policy 1, policy_version 83234 (0.0009) [2023-12-26 00:14:54,600][123090] Updated weights for policy 1, policy_version 83244 (0.0005) [2023-12-26 00:14:54,649][123090] Updated weights for policy 1, policy_version 83254 (0.0005) [2023-12-26 00:14:54,704][123090] Updated weights for policy 1, policy_version 83264 (0.0005) [2023-12-26 00:14:55,022][123091] Updated weights for policy 0, policy_version 83649 (0.0009) [2023-12-26 00:14:55,084][123091] Updated weights for policy 0, policy_version 83659 (0.0009) [2023-12-26 00:14:55,144][123091] Updated weights for policy 0, policy_version 83669 (0.0007) [2023-12-26 00:14:55,213][123091] Updated weights for policy 0, policy_version 83679 (0.0005) [2023-12-26 00:14:55,413][123090] Updated weights for policy 1, policy_version 83274 (0.0005) [2023-12-26 00:14:55,464][123090] Updated weights for policy 1, policy_version 83284 (0.0006) [2023-12-26 00:14:55,520][123090] Updated weights for policy 1, policy_version 83294 (0.0009) [2023-12-26 00:14:55,865][123091] Updated weights for policy 0, policy_version 83689 (0.0008) [2023-12-26 00:14:55,938][123091] Updated weights for policy 0, policy_version 83699 (0.0008) [2023-12-26 00:14:56,008][123091] Updated weights for policy 0, policy_version 83709 (0.0010) [2023-12-26 00:14:56,204][123090] Updated weights for policy 1, policy_version 83304 (0.0010) [2023-12-26 00:14:56,265][123090] Updated weights for policy 1, policy_version 83314 (0.0010) [2023-12-26 00:14:56,327][123090] Updated weights for policy 1, policy_version 83324 (0.0009) [2023-12-26 00:14:56,693][123091] Updated weights for policy 0, policy_version 83719 (0.0007) [2023-12-26 00:14:56,761][123091] Updated weights for policy 0, policy_version 83729 (0.0006) [2023-12-26 00:14:56,822][123091] Updated weights for policy 0, policy_version 83739 (0.0005) [2023-12-26 00:14:57,241][123090] Updated weights for policy 1, policy_version 83334 (0.0010) [2023-12-26 00:14:57,294][123090] Updated weights for policy 1, policy_version 83344 (0.0009) [2023-12-26 00:14:57,350][123090] Updated weights for policy 1, policy_version 83354 (0.0009) [2023-12-26 00:14:57,416][123091] Updated weights for policy 0, policy_version 83749 (0.0007) [2023-12-26 00:14:57,468][123091] Updated weights for policy 0, policy_version 83759 (0.0009) [2023-12-26 00:14:57,515][123091] Updated weights for policy 0, policy_version 83769 (0.0009) [2023-12-26 00:14:58,061][123090] Updated weights for policy 1, policy_version 83364 (0.0009) [2023-12-26 00:14:58,120][123090] Updated weights for policy 1, policy_version 83374 (0.0007) [2023-12-26 00:14:58,178][123090] Updated weights for policy 1, policy_version 83384 (0.0007) [2023-12-26 00:14:58,463][123091] Updated weights for policy 0, policy_version 83779 (0.0009) [2023-12-26 00:14:58,529][123091] Updated weights for policy 0, policy_version 83789 (0.0010) [2023-12-26 00:14:58,585][123091] Updated weights for policy 0, policy_version 83799 (0.0009) [2023-12-26 00:14:58,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 42803200. Throughput: 0: 8806.2, 1: 9015.8. Samples: 42795208. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:14:58,785][121949] Avg episode reward: [(0, '4347.865'), (1, '5502.925')] [2023-12-26 00:14:58,920][123090] Updated weights for policy 1, policy_version 83394 (0.0007) [2023-12-26 00:14:58,975][123090] Updated weights for policy 1, policy_version 83404 (0.0005) [2023-12-26 00:14:59,024][123090] Updated weights for policy 1, policy_version 83414 (0.0008) [2023-12-26 00:14:59,076][123090] Updated weights for policy 1, policy_version 83424 (0.0009) [2023-12-26 00:14:59,486][123091] Updated weights for policy 0, policy_version 83809 (0.0010) [2023-12-26 00:14:59,539][123091] Updated weights for policy 0, policy_version 83819 (0.0009) [2023-12-26 00:14:59,608][123091] Updated weights for policy 0, policy_version 83829 (0.0009) [2023-12-26 00:14:59,673][123091] Updated weights for policy 0, policy_version 83839 (0.0010) [2023-12-26 00:14:59,852][123090] Updated weights for policy 1, policy_version 83434 (0.0010) [2023-12-26 00:14:59,912][123090] Updated weights for policy 1, policy_version 83444 (0.0009) [2023-12-26 00:14:59,980][123090] Updated weights for policy 1, policy_version 83454 (0.0007) [2023-12-26 00:15:00,481][123091] Updated weights for policy 0, policy_version 83849 (0.0009) [2023-12-26 00:15:00,536][123091] Updated weights for policy 0, policy_version 83859 (0.0010) [2023-12-26 00:15:00,597][123091] Updated weights for policy 0, policy_version 83869 (0.0008) [2023-12-26 00:15:00,782][123090] Updated weights for policy 1, policy_version 83464 (0.0005) [2023-12-26 00:15:00,839][123090] Updated weights for policy 1, policy_version 83474 (0.0005) [2023-12-26 00:15:00,889][123090] Updated weights for policy 1, policy_version 83484 (0.0005) [2023-12-26 00:15:01,443][123091] Updated weights for policy 0, policy_version 83879 (0.0008) [2023-12-26 00:15:01,500][123091] Updated weights for policy 0, policy_version 83889 (0.0009) [2023-12-26 00:15:01,557][123091] Updated weights for policy 0, policy_version 83899 (0.0009) [2023-12-26 00:15:01,567][123090] Updated weights for policy 1, policy_version 83494 (0.0007) [2023-12-26 00:15:01,637][123090] Updated weights for policy 1, policy_version 83504 (0.0008) [2023-12-26 00:15:01,709][123090] Updated weights for policy 1, policy_version 83514 (0.0007) [2023-12-26 00:15:02,416][123091] Updated weights for policy 0, policy_version 83909 (0.0009) [2023-12-26 00:15:02,477][123091] Updated weights for policy 0, policy_version 83919 (0.0009) [2023-12-26 00:15:02,493][123090] Updated weights for policy 1, policy_version 83524 (0.0009) [2023-12-26 00:15:02,534][123091] Updated weights for policy 0, policy_version 83929 (0.0009) [2023-12-26 00:15:02,544][123090] Updated weights for policy 1, policy_version 83534 (0.0008) [2023-12-26 00:15:02,606][123090] Updated weights for policy 1, policy_version 83544 (0.0010) [2023-12-26 00:15:03,379][123090] Updated weights for policy 1, policy_version 83554 (0.0009) [2023-12-26 00:15:03,418][123091] Updated weights for policy 0, policy_version 83939 (0.0006) [2023-12-26 00:15:03,443][123090] Updated weights for policy 1, policy_version 83564 (0.0009) [2023-12-26 00:15:03,468][123091] Updated weights for policy 0, policy_version 83949 (0.0008) [2023-12-26 00:15:03,494][123090] Updated weights for policy 1, policy_version 83574 (0.0007) [2023-12-26 00:15:03,519][123091] Updated weights for policy 0, policy_version 83959 (0.0010) [2023-12-26 00:15:03,557][123090] Updated weights for policy 1, policy_version 83584 (0.0009) [2023-12-26 00:15:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 42893312. Throughput: 0: 8798.6, 1: 9025.3. Samples: 42900348. Policy #0 lag: (min: 9.0, avg: 36.7, max: 41.0) [2023-12-26 00:15:03,785][121949] Avg episode reward: [(0, '4329.811'), (1, '5551.230')] [2023-12-26 00:15:04,370][123091] Updated weights for policy 0, policy_version 83969 (0.0008) [2023-12-26 00:15:04,387][123090] Updated weights for policy 1, policy_version 83594 (0.0006) [2023-12-26 00:15:04,433][123091] Updated weights for policy 0, policy_version 83979 (0.0009) [2023-12-26 00:15:04,449][123090] Updated weights for policy 1, policy_version 83604 (0.0007) [2023-12-26 00:15:04,497][123091] Updated weights for policy 0, policy_version 83989 (0.0008) [2023-12-26 00:15:04,506][123090] Updated weights for policy 1, policy_version 83614 (0.0007) [2023-12-26 00:15:04,555][123091] Updated weights for policy 0, policy_version 83999 (0.0006) [2023-12-26 00:15:05,218][123090] Updated weights for policy 1, policy_version 83624 (0.0006) [2023-12-26 00:15:05,278][123090] Updated weights for policy 1, policy_version 83634 (0.0007) [2023-12-26 00:15:05,337][123090] Updated weights for policy 1, policy_version 83644 (0.0010) [2023-12-26 00:15:05,406][123091] Updated weights for policy 0, policy_version 84009 (0.0008) [2023-12-26 00:15:05,454][123091] Updated weights for policy 0, policy_version 84019 (0.0008) [2023-12-26 00:15:05,506][123091] Updated weights for policy 0, policy_version 84029 (0.0008) [2023-12-26 00:15:06,155][123090] Updated weights for policy 1, policy_version 83654 (0.0010) [2023-12-26 00:15:06,220][123090] Updated weights for policy 1, policy_version 83664 (0.0007) [2023-12-26 00:15:06,280][123090] Updated weights for policy 1, policy_version 83674 (0.0011) [2023-12-26 00:15:06,370][123091] Updated weights for policy 0, policy_version 84039 (0.0009) [2023-12-26 00:15:06,438][123091] Updated weights for policy 0, policy_version 84049 (0.0009) [2023-12-26 00:15:06,506][123091] Updated weights for policy 0, policy_version 84059 (0.0009) [2023-12-26 00:15:07,120][123090] Updated weights for policy 1, policy_version 83684 (0.0011) [2023-12-26 00:15:07,180][123090] Updated weights for policy 1, policy_version 83694 (0.0011) [2023-12-26 00:15:07,239][123090] Updated weights for policy 1, policy_version 83704 (0.0010) [2023-12-26 00:15:07,331][123091] Updated weights for policy 0, policy_version 84069 (0.0009) [2023-12-26 00:15:07,390][123091] Updated weights for policy 0, policy_version 84079 (0.0008) [2023-12-26 00:15:07,446][123091] Updated weights for policy 0, policy_version 84089 (0.0009) [2023-12-26 00:15:08,070][123090] Updated weights for policy 1, policy_version 83714 (0.0010) [2023-12-26 00:15:08,133][123090] Updated weights for policy 1, policy_version 83724 (0.0011) [2023-12-26 00:15:08,204][123090] Updated weights for policy 1, policy_version 83734 (0.0011) [2023-12-26 00:15:08,237][123091] Updated weights for policy 0, policy_version 84099 (0.0008) [2023-12-26 00:15:08,276][123090] Updated weights for policy 1, policy_version 83744 (0.0011) [2023-12-26 00:15:08,288][123091] Updated weights for policy 0, policy_version 84109 (0.0005) [2023-12-26 00:15:08,358][123091] Updated weights for policy 0, policy_version 84119 (0.0007) [2023-12-26 00:15:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 42975232. Throughput: 0: 8794.2, 1: 9035.4. Samples: 42952256. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:08,786][121949] Avg episode reward: [(0, '4457.451'), (1, '5566.530')] [2023-12-26 00:15:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000084128_21536768.pth... [2023-12-26 00:15:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000083744_21438464.pth... [2023-12-26 00:15:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000083104_21274624.pth [2023-12-26 00:15:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000082720_21176320.pth [2023-12-26 00:15:08,799][123008] Saving new best policy, reward=5566.530! [2023-12-26 00:15:09,069][123090] Updated weights for policy 1, policy_version 83754 (0.0010) [2023-12-26 00:15:09,122][123090] Updated weights for policy 1, policy_version 83764 (0.0009) [2023-12-26 00:15:09,161][123091] Updated weights for policy 0, policy_version 84129 (0.0009) [2023-12-26 00:15:09,176][123090] Updated weights for policy 1, policy_version 83774 (0.0008) [2023-12-26 00:15:09,232][123091] Updated weights for policy 0, policy_version 84139 (0.0009) [2023-12-26 00:15:09,300][123091] Updated weights for policy 0, policy_version 84149 (0.0009) [2023-12-26 00:15:09,371][123091] Updated weights for policy 0, policy_version 84159 (0.0010) [2023-12-26 00:15:10,054][123090] Updated weights for policy 1, policy_version 83784 (0.0011) [2023-12-26 00:15:10,122][123090] Updated weights for policy 1, policy_version 83794 (0.0011) [2023-12-26 00:15:10,194][123090] Updated weights for policy 1, policy_version 83804 (0.0011) [2023-12-26 00:15:10,220][123091] Updated weights for policy 0, policy_version 84170 (0.0008) [2023-12-26 00:15:10,286][123091] Updated weights for policy 0, policy_version 84180 (0.0007) [2023-12-26 00:15:10,346][123091] Updated weights for policy 0, policy_version 84190 (0.0006) [2023-12-26 00:15:10,970][123090] Updated weights for policy 1, policy_version 83814 (0.0011) [2023-12-26 00:15:11,032][123090] Updated weights for policy 1, policy_version 83824 (0.0007) [2023-12-26 00:15:11,102][123090] Updated weights for policy 1, policy_version 83834 (0.0009) [2023-12-26 00:15:11,150][123091] Updated weights for policy 0, policy_version 84200 (0.0008) [2023-12-26 00:15:11,207][123091] Updated weights for policy 0, policy_version 84210 (0.0008) [2023-12-26 00:15:11,269][123091] Updated weights for policy 0, policy_version 84220 (0.0009) [2023-12-26 00:15:11,956][123090] Updated weights for policy 1, policy_version 83844 (0.0012) [2023-12-26 00:15:12,030][123090] Updated weights for policy 1, policy_version 83854 (0.0010) [2023-12-26 00:15:12,100][123090] Updated weights for policy 1, policy_version 83864 (0.0009) [2023-12-26 00:15:12,139][123091] Updated weights for policy 0, policy_version 84230 (0.0010) [2023-12-26 00:15:12,195][123091] Updated weights for policy 0, policy_version 84240 (0.0009) [2023-12-26 00:15:12,263][123091] Updated weights for policy 0, policy_version 84250 (0.0009) [2023-12-26 00:15:12,940][123090] Updated weights for policy 1, policy_version 83874 (0.0009) [2023-12-26 00:15:12,995][123090] Updated weights for policy 1, policy_version 83884 (0.0010) [2023-12-26 00:15:13,063][123090] Updated weights for policy 1, policy_version 83894 (0.0009) [2023-12-26 00:15:13,115][123091] Updated weights for policy 0, policy_version 84260 (0.0009) [2023-12-26 00:15:13,126][123090] Updated weights for policy 1, policy_version 83904 (0.0009) [2023-12-26 00:15:13,168][123091] Updated weights for policy 0, policy_version 84270 (0.0009) [2023-12-26 00:15:13,229][123091] Updated weights for policy 0, policy_version 84280 (0.0010) [2023-12-26 00:15:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 43057152. Throughput: 0: 8705.6, 1: 8946.8. Samples: 43053388. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:13,785][121949] Avg episode reward: [(0, '4504.438'), (1, '5564.683')] [2023-12-26 00:15:13,896][123090] Updated weights for policy 1, policy_version 83914 (0.0005) [2023-12-26 00:15:13,940][123090] Updated weights for policy 1, policy_version 83924 (0.0005) [2023-12-26 00:15:13,989][123090] Updated weights for policy 1, policy_version 83934 (0.0005) [2023-12-26 00:15:14,146][123091] Updated weights for policy 0, policy_version 84290 (0.0010) [2023-12-26 00:15:14,193][123091] Updated weights for policy 0, policy_version 84300 (0.0009) [2023-12-26 00:15:14,244][123091] Updated weights for policy 0, policy_version 84310 (0.0008) [2023-12-26 00:15:14,307][123091] Updated weights for policy 0, policy_version 84320 (0.0009) [2023-12-26 00:15:14,764][123090] Updated weights for policy 1, policy_version 83944 (0.0009) [2023-12-26 00:15:14,840][123090] Updated weights for policy 1, policy_version 83954 (0.0008) [2023-12-26 00:15:14,915][123090] Updated weights for policy 1, policy_version 83964 (0.0009) [2023-12-26 00:15:15,126][123091] Updated weights for policy 0, policy_version 84330 (0.0006) [2023-12-26 00:15:15,178][123091] Updated weights for policy 0, policy_version 84340 (0.0006) [2023-12-26 00:15:15,238][123091] Updated weights for policy 0, policy_version 84350 (0.0006) [2023-12-26 00:15:15,582][123090] Updated weights for policy 1, policy_version 83974 (0.0007) [2023-12-26 00:15:15,634][123090] Updated weights for policy 1, policy_version 83984 (0.0006) [2023-12-26 00:15:15,698][123090] Updated weights for policy 1, policy_version 83994 (0.0010) [2023-12-26 00:15:15,951][123091] Updated weights for policy 0, policy_version 84360 (0.0008) [2023-12-26 00:15:16,000][123091] Updated weights for policy 0, policy_version 84370 (0.0006) [2023-12-26 00:15:16,052][123091] Updated weights for policy 0, policy_version 84380 (0.0005) [2023-12-26 00:15:16,523][123090] Updated weights for policy 1, policy_version 84004 (0.0011) [2023-12-26 00:15:16,582][123090] Updated weights for policy 1, policy_version 84014 (0.0010) [2023-12-26 00:15:16,648][123090] Updated weights for policy 1, policy_version 84024 (0.0011) [2023-12-26 00:15:16,848][123091] Updated weights for policy 0, policy_version 84390 (0.0007) [2023-12-26 00:15:16,902][123091] Updated weights for policy 0, policy_version 84400 (0.0006) [2023-12-26 00:15:16,960][123091] Updated weights for policy 0, policy_version 84410 (0.0006) [2023-12-26 00:15:17,355][123090] Updated weights for policy 1, policy_version 84034 (0.0009) [2023-12-26 00:15:17,404][123090] Updated weights for policy 1, policy_version 84044 (0.0005) [2023-12-26 00:15:17,455][123090] Updated weights for policy 1, policy_version 84054 (0.0009) [2023-12-26 00:15:17,509][123090] Updated weights for policy 1, policy_version 84064 (0.0010) [2023-12-26 00:15:17,669][123091] Updated weights for policy 0, policy_version 84420 (0.0008) [2023-12-26 00:15:17,723][123091] Updated weights for policy 0, policy_version 84430 (0.0010) [2023-12-26 00:15:17,777][123091] Updated weights for policy 0, policy_version 84441 (0.0011) [2023-12-26 00:15:18,233][123090] Updated weights for policy 1, policy_version 84074 (0.0005) [2023-12-26 00:15:18,282][123090] Updated weights for policy 1, policy_version 84084 (0.0005) [2023-12-26 00:15:18,344][123090] Updated weights for policy 1, policy_version 84094 (0.0006) [2023-12-26 00:15:18,697][123091] Updated weights for policy 0, policy_version 84452 (0.0009) [2023-12-26 00:15:18,764][123091] Updated weights for policy 0, policy_version 84462 (0.0010) [2023-12-26 00:15:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 43147264. Throughput: 0: 8784.1, 1: 8972.9. Samples: 43162936. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:18,785][121949] Avg episode reward: [(0, '4402.354'), (1, '5427.145')] [2023-12-26 00:15:18,843][123091] Updated weights for policy 0, policy_version 84472 (0.0010) [2023-12-26 00:15:19,121][123090] Updated weights for policy 1, policy_version 84104 (0.0006) [2023-12-26 00:15:19,198][123090] Updated weights for policy 1, policy_version 84114 (0.0007) [2023-12-26 00:15:19,265][123090] Updated weights for policy 1, policy_version 84124 (0.0011) [2023-12-26 00:15:19,687][123091] Updated weights for policy 0, policy_version 84482 (0.0009) [2023-12-26 00:15:19,753][123091] Updated weights for policy 0, policy_version 84492 (0.0009) [2023-12-26 00:15:19,816][123091] Updated weights for policy 0, policy_version 84502 (0.0010) [2023-12-26 00:15:19,890][123091] Updated weights for policy 0, policy_version 84512 (0.0010) [2023-12-26 00:15:20,037][123090] Updated weights for policy 1, policy_version 84134 (0.0010) [2023-12-26 00:15:20,103][123090] Updated weights for policy 1, policy_version 84144 (0.0008) [2023-12-26 00:15:20,171][123090] Updated weights for policy 1, policy_version 84154 (0.0008) [2023-12-26 00:15:20,768][123091] Updated weights for policy 0, policy_version 84522 (0.0008) [2023-12-26 00:15:20,838][123091] Updated weights for policy 0, policy_version 84532 (0.0008) [2023-12-26 00:15:20,883][123090] Updated weights for policy 1, policy_version 84164 (0.0007) [2023-12-26 00:15:20,908][123091] Updated weights for policy 0, policy_version 84542 (0.0008) [2023-12-26 00:15:20,945][123090] Updated weights for policy 1, policy_version 84174 (0.0009) [2023-12-26 00:15:21,005][123090] Updated weights for policy 1, policy_version 84184 (0.0010) [2023-12-26 00:15:21,697][123091] Updated weights for policy 0, policy_version 84552 (0.0010) [2023-12-26 00:15:21,763][123091] Updated weights for policy 0, policy_version 84562 (0.0011) [2023-12-26 00:15:21,822][123091] Updated weights for policy 0, policy_version 84572 (0.0007) [2023-12-26 00:15:21,862][123090] Updated weights for policy 1, policy_version 84194 (0.0009) [2023-12-26 00:15:21,925][123090] Updated weights for policy 1, policy_version 84204 (0.0009) [2023-12-26 00:15:21,990][123090] Updated weights for policy 1, policy_version 84214 (0.0009) [2023-12-26 00:15:22,050][123090] Updated weights for policy 1, policy_version 84224 (0.0011) [2023-12-26 00:15:22,640][123091] Updated weights for policy 0, policy_version 84582 (0.0008) [2023-12-26 00:15:22,690][123091] Updated weights for policy 0, policy_version 84592 (0.0009) [2023-12-26 00:15:22,758][123091] Updated weights for policy 0, policy_version 84602 (0.0008) [2023-12-26 00:15:22,917][123090] Updated weights for policy 1, policy_version 84234 (0.0011) [2023-12-26 00:15:22,987][123090] Updated weights for policy 1, policy_version 84244 (0.0011) [2023-12-26 00:15:23,053][123090] Updated weights for policy 1, policy_version 84254 (0.0010) [2023-12-26 00:15:23,468][123091] Updated weights for policy 0, policy_version 84612 (0.0007) [2023-12-26 00:15:23,538][123091] Updated weights for policy 0, policy_version 84622 (0.0009) [2023-12-26 00:15:23,605][123091] Updated weights for policy 0, policy_version 84632 (0.0010) [2023-12-26 00:15:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 43237376. Throughput: 0: 8738.7, 1: 8996.5. Samples: 43214864. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:23,785][121949] Avg episode reward: [(0, '4426.700'), (1, '5276.941')] [2023-12-26 00:15:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000084640_21667840.pth... [2023-12-26 00:15:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000084256_21569536.pth... [2023-12-26 00:15:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000083232_21307392.pth [2023-12-26 00:15:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000083616_21405696.pth [2023-12-26 00:15:23,842][123090] Updated weights for policy 1, policy_version 84264 (0.0010) [2023-12-26 00:15:23,888][123090] Updated weights for policy 1, policy_version 84274 (0.0009) [2023-12-26 00:15:23,952][123090] Updated weights for policy 1, policy_version 84284 (0.0005) [2023-12-26 00:15:24,375][123091] Updated weights for policy 0, policy_version 84642 (0.0010) [2023-12-26 00:15:24,420][123091] Updated weights for policy 0, policy_version 84652 (0.0005) [2023-12-26 00:15:24,467][123091] Updated weights for policy 0, policy_version 84662 (0.0005) [2023-12-26 00:15:24,519][123091] Updated weights for policy 0, policy_version 84672 (0.0005) [2023-12-26 00:15:24,710][123090] Updated weights for policy 1, policy_version 84294 (0.0005) [2023-12-26 00:15:24,786][123090] Updated weights for policy 1, policy_version 84304 (0.0005) [2023-12-26 00:15:24,851][123090] Updated weights for policy 1, policy_version 84314 (0.0005) [2023-12-26 00:15:25,227][123091] Updated weights for policy 0, policy_version 84682 (0.0005) [2023-12-26 00:15:25,295][123091] Updated weights for policy 0, policy_version 84692 (0.0005) [2023-12-26 00:15:25,359][123091] Updated weights for policy 0, policy_version 84702 (0.0009) [2023-12-26 00:15:25,565][123090] Updated weights for policy 1, policy_version 84324 (0.0007) [2023-12-26 00:15:25,624][123090] Updated weights for policy 1, policy_version 84334 (0.0009) [2023-12-26 00:15:25,683][123090] Updated weights for policy 1, policy_version 84344 (0.0010) [2023-12-26 00:15:26,007][123091] Updated weights for policy 0, policy_version 84712 (0.0008) [2023-12-26 00:15:26,077][123091] Updated weights for policy 0, policy_version 84722 (0.0008) [2023-12-26 00:15:26,133][123091] Updated weights for policy 0, policy_version 84732 (0.0009) [2023-12-26 00:15:26,388][123090] Updated weights for policy 1, policy_version 84354 (0.0010) [2023-12-26 00:15:26,435][123090] Updated weights for policy 1, policy_version 84364 (0.0007) [2023-12-26 00:15:26,480][123090] Updated weights for policy 1, policy_version 84374 (0.0005) [2023-12-26 00:15:26,527][123090] Updated weights for policy 1, policy_version 84384 (0.0005) [2023-12-26 00:15:26,866][123091] Updated weights for policy 0, policy_version 84742 (0.0007) [2023-12-26 00:15:26,916][123091] Updated weights for policy 0, policy_version 84752 (0.0007) [2023-12-26 00:15:26,984][123091] Updated weights for policy 0, policy_version 84762 (0.0009) [2023-12-26 00:15:27,334][123090] Updated weights for policy 1, policy_version 84394 (0.0010) [2023-12-26 00:15:27,392][123090] Updated weights for policy 1, policy_version 84404 (0.0010) [2023-12-26 00:15:27,462][123090] Updated weights for policy 1, policy_version 84414 (0.0010) [2023-12-26 00:15:27,780][123091] Updated weights for policy 0, policy_version 84772 (0.0009) [2023-12-26 00:15:27,839][123091] Updated weights for policy 0, policy_version 84782 (0.0009) [2023-12-26 00:15:27,901][123091] Updated weights for policy 0, policy_version 84792 (0.0008) [2023-12-26 00:15:28,276][123090] Updated weights for policy 1, policy_version 84424 (0.0010) [2023-12-26 00:15:28,330][123090] Updated weights for policy 1, policy_version 84434 (0.0010) [2023-12-26 00:15:28,386][123090] Updated weights for policy 1, policy_version 84444 (0.0010) [2023-12-26 00:15:28,718][123091] Updated weights for policy 0, policy_version 84802 (0.0009) [2023-12-26 00:15:28,781][123091] Updated weights for policy 0, policy_version 84812 (0.0008) [2023-12-26 00:15:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 43327488. Throughput: 0: 8842.4, 1: 8985.9. Samples: 43324564. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:28,785][121949] Avg episode reward: [(0, '4382.753'), (1, '5361.615')] [2023-12-26 00:15:28,845][123091] Updated weights for policy 0, policy_version 84822 (0.0009) [2023-12-26 00:15:28,901][123091] Updated weights for policy 0, policy_version 84832 (0.0009) [2023-12-26 00:15:29,220][123090] Updated weights for policy 1, policy_version 84455 (0.0009) [2023-12-26 00:15:29,289][123090] Updated weights for policy 1, policy_version 84465 (0.0007) [2023-12-26 00:15:29,372][123090] Updated weights for policy 1, policy_version 84475 (0.0008) [2023-12-26 00:15:29,743][123091] Updated weights for policy 0, policy_version 84842 (0.0008) [2023-12-26 00:15:29,799][123091] Updated weights for policy 0, policy_version 84852 (0.0005) [2023-12-26 00:15:29,869][123091] Updated weights for policy 0, policy_version 84862 (0.0009) [2023-12-26 00:15:30,130][123090] Updated weights for policy 1, policy_version 84485 (0.0008) [2023-12-26 00:15:30,190][123090] Updated weights for policy 1, policy_version 84495 (0.0009) [2023-12-26 00:15:30,254][123090] Updated weights for policy 1, policy_version 84505 (0.0008) [2023-12-26 00:15:30,638][123091] Updated weights for policy 0, policy_version 84872 (0.0007) [2023-12-26 00:15:30,692][123091] Updated weights for policy 0, policy_version 84882 (0.0006) [2023-12-26 00:15:30,755][123091] Updated weights for policy 0, policy_version 84892 (0.0006) [2023-12-26 00:15:31,007][123090] Updated weights for policy 1, policy_version 84515 (0.0008) [2023-12-26 00:15:31,076][123090] Updated weights for policy 1, policy_version 84525 (0.0006) [2023-12-26 00:15:31,132][123090] Updated weights for policy 1, policy_version 84535 (0.0007) [2023-12-26 00:15:31,525][123091] Updated weights for policy 0, policy_version 84902 (0.0008) [2023-12-26 00:15:31,586][123091] Updated weights for policy 0, policy_version 84912 (0.0009) [2023-12-26 00:15:31,651][123091] Updated weights for policy 0, policy_version 84922 (0.0009) [2023-12-26 00:15:31,936][123090] Updated weights for policy 1, policy_version 84545 (0.0007) [2023-12-26 00:15:31,998][123090] Updated weights for policy 1, policy_version 84555 (0.0008) [2023-12-26 00:15:32,066][123090] Updated weights for policy 1, policy_version 84565 (0.0008) [2023-12-26 00:15:32,122][123090] Updated weights for policy 1, policy_version 84575 (0.0005) [2023-12-26 00:15:32,462][123091] Updated weights for policy 0, policy_version 84932 (0.0008) [2023-12-26 00:15:32,518][123091] Updated weights for policy 0, policy_version 84942 (0.0008) [2023-12-26 00:15:32,586][123091] Updated weights for policy 0, policy_version 84952 (0.0005) [2023-12-26 00:15:32,856][123090] Updated weights for policy 1, policy_version 84585 (0.0008) [2023-12-26 00:15:32,905][123090] Updated weights for policy 1, policy_version 84595 (0.0009) [2023-12-26 00:15:32,961][123090] Updated weights for policy 1, policy_version 84606 (0.0010) [2023-12-26 00:15:33,339][123091] Updated weights for policy 0, policy_version 84962 (0.0006) [2023-12-26 00:15:33,405][123091] Updated weights for policy 0, policy_version 84972 (0.0010) [2023-12-26 00:15:33,458][123091] Updated weights for policy 0, policy_version 84982 (0.0010) [2023-12-26 00:15:33,521][123091] Updated weights for policy 0, policy_version 84992 (0.0010) [2023-12-26 00:15:33,711][123090] Updated weights for policy 1, policy_version 84616 (0.0006) [2023-12-26 00:15:33,767][123090] Updated weights for policy 1, policy_version 84626 (0.0006) [2023-12-26 00:15:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 43417600. Throughput: 0: 8819.5, 1: 8967.6. Samples: 43431344. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:33,784][121949] Avg episode reward: [(0, '4312.284'), (1, '5351.275')] [2023-12-26 00:15:33,815][123090] Updated weights for policy 1, policy_version 84636 (0.0008) [2023-12-26 00:15:34,402][123091] Updated weights for policy 0, policy_version 85002 (0.0008) [2023-12-26 00:15:34,469][123091] Updated weights for policy 0, policy_version 85012 (0.0009) [2023-12-26 00:15:34,540][123091] Updated weights for policy 0, policy_version 85022 (0.0008) [2023-12-26 00:15:34,650][123090] Updated weights for policy 1, policy_version 84646 (0.0008) [2023-12-26 00:15:34,722][123090] Updated weights for policy 1, policy_version 84656 (0.0006) [2023-12-26 00:15:34,801][123090] Updated weights for policy 1, policy_version 84666 (0.0006) [2023-12-26 00:15:35,293][123091] Updated weights for policy 0, policy_version 85032 (0.0010) [2023-12-26 00:15:35,344][123091] Updated weights for policy 0, policy_version 85042 (0.0010) [2023-12-26 00:15:35,388][123091] Updated weights for policy 0, policy_version 85052 (0.0010) [2023-12-26 00:15:35,442][123090] Updated weights for policy 1, policy_version 84676 (0.0006) [2023-12-26 00:15:35,499][123090] Updated weights for policy 1, policy_version 84686 (0.0006) [2023-12-26 00:15:35,555][123090] Updated weights for policy 1, policy_version 84696 (0.0006) [2023-12-26 00:15:36,194][123091] Updated weights for policy 0, policy_version 85062 (0.0007) [2023-12-26 00:15:36,232][123090] Updated weights for policy 1, policy_version 84706 (0.0006) [2023-12-26 00:15:36,256][123091] Updated weights for policy 0, policy_version 85072 (0.0006) [2023-12-26 00:15:36,292][123090] Updated weights for policy 1, policy_version 84716 (0.0006) [2023-12-26 00:15:36,325][123091] Updated weights for policy 0, policy_version 85082 (0.0005) [2023-12-26 00:15:36,360][123090] Updated weights for policy 1, policy_version 84726 (0.0006) [2023-12-26 00:15:36,431][123090] Updated weights for policy 1, policy_version 84736 (0.0005) [2023-12-26 00:15:37,005][123091] Updated weights for policy 0, policy_version 85092 (0.0005) [2023-12-26 00:15:37,063][123090] Updated weights for policy 1, policy_version 84746 (0.0006) [2023-12-26 00:15:37,066][123091] Updated weights for policy 0, policy_version 85102 (0.0008) [2023-12-26 00:15:37,123][123090] Updated weights for policy 1, policy_version 84756 (0.0007) [2023-12-26 00:15:37,129][123091] Updated weights for policy 0, policy_version 85112 (0.0008) [2023-12-26 00:15:37,179][123090] Updated weights for policy 1, policy_version 84766 (0.0009) [2023-12-26 00:15:37,750][123091] Updated weights for policy 0, policy_version 85122 (0.0006) [2023-12-26 00:15:37,817][123091] Updated weights for policy 0, policy_version 85132 (0.0006) [2023-12-26 00:15:37,881][123091] Updated weights for policy 0, policy_version 85142 (0.0005) [2023-12-26 00:15:37,930][123090] Updated weights for policy 1, policy_version 84776 (0.0006) [2023-12-26 00:15:37,932][123091] Updated weights for policy 0, policy_version 85152 (0.0006) [2023-12-26 00:15:37,995][123090] Updated weights for policy 1, policy_version 84786 (0.0006) [2023-12-26 00:15:38,073][123090] Updated weights for policy 1, policy_version 84796 (0.0005) [2023-12-26 00:15:38,624][123091] Updated weights for policy 0, policy_version 85162 (0.0009) [2023-12-26 00:15:38,672][123091] Updated weights for policy 0, policy_version 85172 (0.0009) [2023-12-26 00:15:38,721][123091] Updated weights for policy 0, policy_version 85182 (0.0009) [2023-12-26 00:15:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 43515904. Throughput: 0: 8832.5, 1: 9033.8. Samples: 43487392. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:38,785][121949] Avg episode reward: [(0, '4471.652'), (1, '5401.214')] [2023-12-26 00:15:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000085184_21807104.pth... [2023-12-26 00:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000084800_21708800.pth... [2023-12-26 00:15:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000083744_21438464.pth [2023-12-26 00:15:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000084128_21536768.pth [2023-12-26 00:15:38,863][123090] Updated weights for policy 1, policy_version 84806 (0.0011) [2023-12-26 00:15:38,929][123090] Updated weights for policy 1, policy_version 84816 (0.0011) [2023-12-26 00:15:38,989][123090] Updated weights for policy 1, policy_version 84826 (0.0011) [2023-12-26 00:15:39,584][123091] Updated weights for policy 0, policy_version 85192 (0.0006) [2023-12-26 00:15:39,660][123091] Updated weights for policy 0, policy_version 85202 (0.0007) [2023-12-26 00:15:39,724][123091] Updated weights for policy 0, policy_version 85212 (0.0011) [2023-12-26 00:15:39,796][123090] Updated weights for policy 1, policy_version 84836 (0.0009) [2023-12-26 00:15:39,872][123090] Updated weights for policy 1, policy_version 84846 (0.0009) [2023-12-26 00:15:39,943][123090] Updated weights for policy 1, policy_version 84856 (0.0010) [2023-12-26 00:15:40,493][123091] Updated weights for policy 0, policy_version 85222 (0.0008) [2023-12-26 00:15:40,544][123091] Updated weights for policy 0, policy_version 85232 (0.0005) [2023-12-26 00:15:40,600][123091] Updated weights for policy 0, policy_version 85242 (0.0006) [2023-12-26 00:15:40,744][123090] Updated weights for policy 1, policy_version 84866 (0.0008) [2023-12-26 00:15:40,814][123090] Updated weights for policy 1, policy_version 84876 (0.0005) [2023-12-26 00:15:40,889][123090] Updated weights for policy 1, policy_version 84886 (0.0005) [2023-12-26 00:15:40,951][123090] Updated weights for policy 1, policy_version 84896 (0.0005) [2023-12-26 00:15:41,291][123091] Updated weights for policy 0, policy_version 85252 (0.0006) [2023-12-26 00:15:41,354][123091] Updated weights for policy 0, policy_version 85262 (0.0011) [2023-12-26 00:15:41,419][123091] Updated weights for policy 0, policy_version 85272 (0.0011) [2023-12-26 00:15:41,690][123090] Updated weights for policy 1, policy_version 84906 (0.0007) [2023-12-26 00:15:41,768][123090] Updated weights for policy 1, policy_version 84916 (0.0008) [2023-12-26 00:15:41,831][123090] Updated weights for policy 1, policy_version 84926 (0.0010) [2023-12-26 00:15:42,225][123091] Updated weights for policy 0, policy_version 85282 (0.0009) [2023-12-26 00:15:42,285][123091] Updated weights for policy 0, policy_version 85292 (0.0008) [2023-12-26 00:15:42,358][123091] Updated weights for policy 0, policy_version 85302 (0.0011) [2023-12-26 00:15:42,438][123091] Updated weights for policy 0, policy_version 85312 (0.0009) [2023-12-26 00:15:42,642][123090] Updated weights for policy 1, policy_version 84936 (0.0008) [2023-12-26 00:15:42,695][123090] Updated weights for policy 1, policy_version 84946 (0.0009) [2023-12-26 00:15:42,754][123090] Updated weights for policy 1, policy_version 84956 (0.0010) [2023-12-26 00:15:43,206][123091] Updated weights for policy 0, policy_version 85322 (0.0010) [2023-12-26 00:15:43,260][123091] Updated weights for policy 0, policy_version 85332 (0.0010) [2023-12-26 00:15:43,319][123091] Updated weights for policy 0, policy_version 85342 (0.0010) [2023-12-26 00:15:43,569][123090] Updated weights for policy 1, policy_version 84966 (0.0009) [2023-12-26 00:15:43,619][123090] Updated weights for policy 1, policy_version 84976 (0.0009) [2023-12-26 00:15:43,672][123090] Updated weights for policy 1, policy_version 84986 (0.0009) [2023-12-26 00:15:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 43606016. Throughput: 0: 8779.0, 1: 9045.3. Samples: 43597296. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:43,785][121949] Avg episode reward: [(0, '4451.251'), (1, '5399.540')] [2023-12-26 00:15:44,147][123091] Updated weights for policy 0, policy_version 85352 (0.0006) [2023-12-26 00:15:44,195][123091] Updated weights for policy 0, policy_version 85362 (0.0005) [2023-12-26 00:15:44,243][123091] Updated weights for policy 0, policy_version 85372 (0.0005) [2023-12-26 00:15:44,467][123090] Updated weights for policy 1, policy_version 84996 (0.0007) [2023-12-26 00:15:44,519][123090] Updated weights for policy 1, policy_version 85006 (0.0005) [2023-12-26 00:15:44,565][123090] Updated weights for policy 1, policy_version 85016 (0.0005) [2023-12-26 00:15:45,037][123091] Updated weights for policy 0, policy_version 85382 (0.0008) [2023-12-26 00:15:45,093][123091] Updated weights for policy 0, policy_version 85392 (0.0010) [2023-12-26 00:15:45,160][123091] Updated weights for policy 0, policy_version 85402 (0.0011) [2023-12-26 00:15:45,378][123090] Updated weights for policy 1, policy_version 85026 (0.0006) [2023-12-26 00:15:45,439][123090] Updated weights for policy 1, policy_version 85036 (0.0009) [2023-12-26 00:15:45,496][123090] Updated weights for policy 1, policy_version 85046 (0.0008) [2023-12-26 00:15:45,551][123090] Updated weights for policy 1, policy_version 85056 (0.0009) [2023-12-26 00:15:45,931][123091] Updated weights for policy 0, policy_version 85412 (0.0011) [2023-12-26 00:15:45,978][123091] Updated weights for policy 0, policy_version 85422 (0.0010) [2023-12-26 00:15:46,030][123091] Updated weights for policy 0, policy_version 85432 (0.0011) [2023-12-26 00:15:46,472][123090] Updated weights for policy 1, policy_version 85066 (0.0009) [2023-12-26 00:15:46,537][123090] Updated weights for policy 1, policy_version 85076 (0.0009) [2023-12-26 00:15:46,602][123090] Updated weights for policy 1, policy_version 85086 (0.0010) [2023-12-26 00:15:46,833][123091] Updated weights for policy 0, policy_version 85442 (0.0010) [2023-12-26 00:15:46,888][123091] Updated weights for policy 0, policy_version 85452 (0.0005) [2023-12-26 00:15:46,937][123091] Updated weights for policy 0, policy_version 85462 (0.0005) [2023-12-26 00:15:46,986][123091] Updated weights for policy 0, policy_version 85472 (0.0007) [2023-12-26 00:15:47,434][123090] Updated weights for policy 1, policy_version 85096 (0.0009) [2023-12-26 00:15:47,487][123090] Updated weights for policy 1, policy_version 85106 (0.0009) [2023-12-26 00:15:47,546][123090] Updated weights for policy 1, policy_version 85116 (0.0008) [2023-12-26 00:15:47,803][123091] Updated weights for policy 0, policy_version 85482 (0.0011) [2023-12-26 00:15:47,858][123091] Updated weights for policy 0, policy_version 85492 (0.0010) [2023-12-26 00:15:47,913][123091] Updated weights for policy 0, policy_version 85502 (0.0010) [2023-12-26 00:15:48,428][123090] Updated weights for policy 1, policy_version 85126 (0.0009) [2023-12-26 00:15:48,491][123090] Updated weights for policy 1, policy_version 85136 (0.0009) [2023-12-26 00:15:48,560][123090] Updated weights for policy 1, policy_version 85146 (0.0009) [2023-12-26 00:15:48,731][123091] Updated weights for policy 0, policy_version 85512 (0.0011) [2023-12-26 00:15:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 43687936. Throughput: 0: 8896.6, 1: 8928.9. Samples: 43702492. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:48,785][121949] Avg episode reward: [(0, '4292.223'), (1, '5473.592')] [2023-12-26 00:15:48,799][123091] Updated weights for policy 0, policy_version 85522 (0.0011) [2023-12-26 00:15:48,869][123091] Updated weights for policy 0, policy_version 85532 (0.0011) [2023-12-26 00:15:49,436][123090] Updated weights for policy 1, policy_version 85156 (0.0009) [2023-12-26 00:15:49,490][123090] Updated weights for policy 1, policy_version 85166 (0.0009) [2023-12-26 00:15:49,559][123090] Updated weights for policy 1, policy_version 85176 (0.0008) [2023-12-26 00:15:49,678][123091] Updated weights for policy 0, policy_version 85542 (0.0011) [2023-12-26 00:15:49,750][123091] Updated weights for policy 0, policy_version 85552 (0.0011) [2023-12-26 00:15:49,821][123091] Updated weights for policy 0, policy_version 85562 (0.0011) [2023-12-26 00:15:50,388][123090] Updated weights for policy 1, policy_version 85186 (0.0009) [2023-12-26 00:15:50,461][123090] Updated weights for policy 1, policy_version 85196 (0.0010) [2023-12-26 00:15:50,532][123090] Updated weights for policy 1, policy_version 85206 (0.0009) [2023-12-26 00:15:50,605][123090] Updated weights for policy 1, policy_version 85216 (0.0008) [2023-12-26 00:15:50,638][123091] Updated weights for policy 0, policy_version 85572 (0.0011) [2023-12-26 00:15:50,703][123091] Updated weights for policy 0, policy_version 85582 (0.0011) [2023-12-26 00:15:50,780][123091] Updated weights for policy 0, policy_version 85592 (0.0011) [2023-12-26 00:15:51,500][123090] Updated weights for policy 1, policy_version 85226 (0.0010) [2023-12-26 00:15:51,546][123091] Updated weights for policy 0, policy_version 85602 (0.0010) [2023-12-26 00:15:51,558][123090] Updated weights for policy 1, policy_version 85236 (0.0009) [2023-12-26 00:15:51,615][123091] Updated weights for policy 0, policy_version 85612 (0.0008) [2023-12-26 00:15:51,637][123090] Updated weights for policy 1, policy_version 85246 (0.0010) [2023-12-26 00:15:51,682][123091] Updated weights for policy 0, policy_version 85622 (0.0007) [2023-12-26 00:15:51,755][123091] Updated weights for policy 0, policy_version 85632 (0.0010) [2023-12-26 00:15:52,474][123091] Updated weights for policy 0, policy_version 85642 (0.0009) [2023-12-26 00:15:52,527][123090] Updated weights for policy 1, policy_version 85256 (0.0007) [2023-12-26 00:15:52,545][123091] Updated weights for policy 0, policy_version 85652 (0.0007) [2023-12-26 00:15:52,591][123090] Updated weights for policy 1, policy_version 85266 (0.0010) [2023-12-26 00:15:52,613][123091] Updated weights for policy 0, policy_version 85662 (0.0007) [2023-12-26 00:15:52,659][123090] Updated weights for policy 1, policy_version 85276 (0.0009) [2023-12-26 00:15:53,350][123091] Updated weights for policy 0, policy_version 85672 (0.0006) [2023-12-26 00:15:53,412][123091] Updated weights for policy 0, policy_version 85682 (0.0006) [2023-12-26 00:15:53,480][123091] Updated weights for policy 0, policy_version 85692 (0.0008) [2023-12-26 00:15:53,492][123090] Updated weights for policy 1, policy_version 85286 (0.0008) [2023-12-26 00:15:53,547][123090] Updated weights for policy 1, policy_version 85296 (0.0009) [2023-12-26 00:15:53,599][123090] Updated weights for policy 1, policy_version 85306 (0.0009) [2023-12-26 00:15:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 43778048. Throughput: 0: 8912.4, 1: 8860.5. Samples: 43752032. Policy #0 lag: (min: 22.0, avg: 22.7, max: 44.0) [2023-12-26 00:15:53,785][121949] Avg episode reward: [(0, '4437.867'), (1, '5514.060')] [2023-12-26 00:15:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000085696_21938176.pth... [2023-12-26 00:15:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000085312_21839872.pth... [2023-12-26 00:15:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000084256_21569536.pth [2023-12-26 00:15:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000084640_21667840.pth [2023-12-26 00:15:54,148][123091] Updated weights for policy 0, policy_version 85702 (0.0007) [2023-12-26 00:15:54,214][123091] Updated weights for policy 0, policy_version 85712 (0.0007) [2023-12-26 00:15:54,265][123091] Updated weights for policy 0, policy_version 85722 (0.0009) [2023-12-26 00:15:54,506][123090] Updated weights for policy 1, policy_version 85316 (0.0010) [2023-12-26 00:15:54,565][123090] Updated weights for policy 1, policy_version 85326 (0.0010) [2023-12-26 00:15:54,626][123090] Updated weights for policy 1, policy_version 85336 (0.0010) [2023-12-26 00:15:55,007][123091] Updated weights for policy 0, policy_version 85732 (0.0010) [2023-12-26 00:15:55,075][123091] Updated weights for policy 0, policy_version 85742 (0.0009) [2023-12-26 00:15:55,136][123091] Updated weights for policy 0, policy_version 85752 (0.0009) [2023-12-26 00:15:55,451][123090] Updated weights for policy 1, policy_version 85346 (0.0008) [2023-12-26 00:15:55,504][123090] Updated weights for policy 1, policy_version 85356 (0.0005) [2023-12-26 00:15:55,563][123090] Updated weights for policy 1, policy_version 85366 (0.0005) [2023-12-26 00:15:55,626][123090] Updated weights for policy 1, policy_version 85376 (0.0008) [2023-12-26 00:15:56,000][123091] Updated weights for policy 0, policy_version 85762 (0.0010) [2023-12-26 00:15:56,053][123091] Updated weights for policy 0, policy_version 85772 (0.0010) [2023-12-26 00:15:56,118][123091] Updated weights for policy 0, policy_version 85782 (0.0010) [2023-12-26 00:15:56,186][123091] Updated weights for policy 0, policy_version 85792 (0.0009) [2023-12-26 00:15:56,353][123090] Updated weights for policy 1, policy_version 85386 (0.0006) [2023-12-26 00:15:56,421][123090] Updated weights for policy 1, policy_version 85396 (0.0006) [2023-12-26 00:15:56,473][123090] Updated weights for policy 1, policy_version 85406 (0.0005) [2023-12-26 00:15:57,000][123091] Updated weights for policy 0, policy_version 85802 (0.0011) [2023-12-26 00:15:57,051][123091] Updated weights for policy 0, policy_version 85812 (0.0010) [2023-12-26 00:15:57,107][123091] Updated weights for policy 0, policy_version 85822 (0.0011) [2023-12-26 00:15:57,159][123090] Updated weights for policy 1, policy_version 85416 (0.0009) [2023-12-26 00:15:57,206][123090] Updated weights for policy 1, policy_version 85426 (0.0010) [2023-12-26 00:15:57,257][123090] Updated weights for policy 1, policy_version 85436 (0.0010) [2023-12-26 00:15:57,870][123091] Updated weights for policy 0, policy_version 85832 (0.0006) [2023-12-26 00:15:57,917][123091] Updated weights for policy 0, policy_version 85842 (0.0005) [2023-12-26 00:15:57,978][123091] Updated weights for policy 0, policy_version 85852 (0.0006) [2023-12-26 00:15:58,060][123090] Updated weights for policy 1, policy_version 85446 (0.0010) [2023-12-26 00:15:58,124][123090] Updated weights for policy 1, policy_version 85456 (0.0008) [2023-12-26 00:15:58,203][123090] Updated weights for policy 1, policy_version 85466 (0.0008) [2023-12-26 00:15:58,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 43859968. Throughput: 0: 8985.9, 1: 8888.3. Samples: 43857732. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:15:58,786][121949] Avg episode reward: [(0, '4497.877'), (1, '5387.255')] [2023-12-26 00:15:58,846][123091] Updated weights for policy 0, policy_version 85862 (0.0009) [2023-12-26 00:15:58,913][123091] Updated weights for policy 0, policy_version 85872 (0.0009) [2023-12-26 00:15:58,979][123091] Updated weights for policy 0, policy_version 85882 (0.0009) [2023-12-26 00:15:59,067][123090] Updated weights for policy 1, policy_version 85476 (0.0007) [2023-12-26 00:15:59,129][123090] Updated weights for policy 1, policy_version 85486 (0.0006) [2023-12-26 00:15:59,197][123090] Updated weights for policy 1, policy_version 85496 (0.0008) [2023-12-26 00:15:59,757][123091] Updated weights for policy 0, policy_version 85892 (0.0007) [2023-12-26 00:15:59,826][123091] Updated weights for policy 0, policy_version 85902 (0.0006) [2023-12-26 00:15:59,891][123091] Updated weights for policy 0, policy_version 85912 (0.0009) [2023-12-26 00:15:59,974][123090] Updated weights for policy 1, policy_version 85506 (0.0010) [2023-12-26 00:16:00,037][123090] Updated weights for policy 1, policy_version 85516 (0.0010) [2023-12-26 00:16:00,094][123090] Updated weights for policy 1, policy_version 85526 (0.0009) [2023-12-26 00:16:00,158][123090] Updated weights for policy 1, policy_version 85536 (0.0008) [2023-12-26 00:16:00,671][123091] Updated weights for policy 0, policy_version 85922 (0.0009) [2023-12-26 00:16:00,723][123091] Updated weights for policy 0, policy_version 85932 (0.0005) [2023-12-26 00:16:00,793][123091] Updated weights for policy 0, policy_version 85942 (0.0005) [2023-12-26 00:16:00,855][123091] Updated weights for policy 0, policy_version 85952 (0.0005) [2023-12-26 00:16:01,017][123090] Updated weights for policy 1, policy_version 85546 (0.0010) [2023-12-26 00:16:01,085][123090] Updated weights for policy 1, policy_version 85556 (0.0009) [2023-12-26 00:16:01,148][123090] Updated weights for policy 1, policy_version 85566 (0.0009) [2023-12-26 00:16:01,558][123091] Updated weights for policy 0, policy_version 85962 (0.0007) [2023-12-26 00:16:01,628][123091] Updated weights for policy 0, policy_version 85972 (0.0006) [2023-12-26 00:16:01,694][123091] Updated weights for policy 0, policy_version 85982 (0.0007) [2023-12-26 00:16:02,011][123090] Updated weights for policy 1, policy_version 85576 (0.0009) [2023-12-26 00:16:02,059][123090] Updated weights for policy 1, policy_version 85586 (0.0009) [2023-12-26 00:16:02,109][123090] Updated weights for policy 1, policy_version 85596 (0.0008) [2023-12-26 00:16:02,467][123091] Updated weights for policy 0, policy_version 85992 (0.0010) [2023-12-26 00:16:02,529][123091] Updated weights for policy 0, policy_version 86002 (0.0011) [2023-12-26 00:16:02,588][123091] Updated weights for policy 0, policy_version 86012 (0.0011) [2023-12-26 00:16:02,954][123090] Updated weights for policy 1, policy_version 85606 (0.0009) [2023-12-26 00:16:03,009][123090] Updated weights for policy 1, policy_version 85616 (0.0010) [2023-12-26 00:16:03,062][123090] Updated weights for policy 1, policy_version 85626 (0.0010) [2023-12-26 00:16:03,314][123091] Updated weights for policy 0, policy_version 86022 (0.0010) [2023-12-26 00:16:03,357][123091] Updated weights for policy 0, policy_version 86032 (0.0010) [2023-12-26 00:16:03,404][123091] Updated weights for policy 0, policy_version 86042 (0.0010) [2023-12-26 00:16:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 43950080. Throughput: 0: 8994.0, 1: 8766.1. Samples: 43962140. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:03,785][121949] Avg episode reward: [(0, '4544.629'), (1, '5377.569')] [2023-12-26 00:16:03,934][123090] Updated weights for policy 1, policy_version 85637 (0.0010) [2023-12-26 00:16:03,993][123090] Updated weights for policy 1, policy_version 85647 (0.0009) [2023-12-26 00:16:04,060][123090] Updated weights for policy 1, policy_version 85657 (0.0010) [2023-12-26 00:16:04,276][123091] Updated weights for policy 0, policy_version 86052 (0.0009) [2023-12-26 00:16:04,350][123091] Updated weights for policy 0, policy_version 86062 (0.0011) [2023-12-26 00:16:04,412][123091] Updated weights for policy 0, policy_version 86072 (0.0011) [2023-12-26 00:16:04,974][123090] Updated weights for policy 1, policy_version 85667 (0.0010) [2023-12-26 00:16:05,038][123090] Updated weights for policy 1, policy_version 85677 (0.0009) [2023-12-26 00:16:05,087][123090] Updated weights for policy 1, policy_version 85687 (0.0009) [2023-12-26 00:16:05,130][123091] Updated weights for policy 0, policy_version 86082 (0.0011) [2023-12-26 00:16:05,193][123091] Updated weights for policy 0, policy_version 86092 (0.0010) [2023-12-26 00:16:05,244][123091] Updated weights for policy 0, policy_version 86102 (0.0010) [2023-12-26 00:16:05,303][123091] Updated weights for policy 0, policy_version 86112 (0.0010) [2023-12-26 00:16:05,878][123090] Updated weights for policy 1, policy_version 85697 (0.0008) [2023-12-26 00:16:05,937][123090] Updated weights for policy 1, policy_version 85707 (0.0009) [2023-12-26 00:16:05,988][123090] Updated weights for policy 1, policy_version 85717 (0.0008) [2023-12-26 00:16:06,052][123090] Updated weights for policy 1, policy_version 85727 (0.0008) [2023-12-26 00:16:06,150][123091] Updated weights for policy 0, policy_version 86122 (0.0008) [2023-12-26 00:16:06,215][123091] Updated weights for policy 0, policy_version 86132 (0.0006) [2023-12-26 00:16:06,284][123091] Updated weights for policy 0, policy_version 86142 (0.0006) [2023-12-26 00:16:06,842][123091] Updated weights for policy 0, policy_version 86152 (0.0006) [2023-12-26 00:16:06,907][123091] Updated weights for policy 0, policy_version 86162 (0.0005) [2023-12-26 00:16:06,963][123090] Updated weights for policy 1, policy_version 85737 (0.0008) [2023-12-26 00:16:06,972][123091] Updated weights for policy 0, policy_version 86172 (0.0007) [2023-12-26 00:16:07,010][123090] Updated weights for policy 1, policy_version 85747 (0.0010) [2023-12-26 00:16:07,062][123090] Updated weights for policy 1, policy_version 85757 (0.0009) [2023-12-26 00:16:07,711][123091] Updated weights for policy 0, policy_version 86182 (0.0006) [2023-12-26 00:16:07,768][123091] Updated weights for policy 0, policy_version 86192 (0.0005) [2023-12-26 00:16:07,845][123091] Updated weights for policy 0, policy_version 86202 (0.0005) [2023-12-26 00:16:07,940][123090] Updated weights for policy 1, policy_version 85768 (0.0010) [2023-12-26 00:16:07,998][123090] Updated weights for policy 1, policy_version 85779 (0.0011) [2023-12-26 00:16:08,057][123090] Updated weights for policy 1, policy_version 85789 (0.0010) [2023-12-26 00:16:08,547][123091] Updated weights for policy 0, policy_version 86212 (0.0005) [2023-12-26 00:16:08,609][123091] Updated weights for policy 0, policy_version 86222 (0.0006) [2023-12-26 00:16:08,677][123091] Updated weights for policy 0, policy_version 86232 (0.0006) [2023-12-26 00:16:08,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 44040192. Throughput: 0: 9050.1, 1: 8718.9. Samples: 44014464. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:08,785][121949] Avg episode reward: [(0, '4665.032'), (1, '5334.976')] [2023-12-26 00:16:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000086240_22077440.pth... [2023-12-26 00:16:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000085792_21962752.pth... [2023-12-26 00:16:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000085184_21807104.pth [2023-12-26 00:16:08,794][123007] Saving new best policy, reward=4665.032! [2023-12-26 00:16:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000084800_21708800.pth [2023-12-26 00:16:08,947][123090] Updated weights for policy 1, policy_version 85799 (0.0009) [2023-12-26 00:16:09,003][123090] Updated weights for policy 1, policy_version 85809 (0.0010) [2023-12-26 00:16:09,069][123090] Updated weights for policy 1, policy_version 85819 (0.0008) [2023-12-26 00:16:09,409][123091] Updated weights for policy 0, policy_version 86242 (0.0007) [2023-12-26 00:16:09,479][123091] Updated weights for policy 0, policy_version 86252 (0.0010) [2023-12-26 00:16:09,541][123091] Updated weights for policy 0, policy_version 86262 (0.0009) [2023-12-26 00:16:09,605][123091] Updated weights for policy 0, policy_version 86272 (0.0009) [2023-12-26 00:16:09,958][123090] Updated weights for policy 1, policy_version 85829 (0.0009) [2023-12-26 00:16:10,031][123090] Updated weights for policy 1, policy_version 85839 (0.0007) [2023-12-26 00:16:10,093][123090] Updated weights for policy 1, policy_version 85849 (0.0008) [2023-12-26 00:16:10,439][123091] Updated weights for policy 0, policy_version 86282 (0.0006) [2023-12-26 00:16:10,508][123091] Updated weights for policy 0, policy_version 86292 (0.0006) [2023-12-26 00:16:10,578][123091] Updated weights for policy 0, policy_version 86302 (0.0006) [2023-12-26 00:16:10,924][123090] Updated weights for policy 1, policy_version 85859 (0.0007) [2023-12-26 00:16:10,978][123090] Updated weights for policy 1, policy_version 85869 (0.0008) [2023-12-26 00:16:11,040][123090] Updated weights for policy 1, policy_version 85879 (0.0008) [2023-12-26 00:16:11,334][123091] Updated weights for policy 0, policy_version 86312 (0.0009) [2023-12-26 00:16:11,407][123091] Updated weights for policy 0, policy_version 86322 (0.0009) [2023-12-26 00:16:11,466][123091] Updated weights for policy 0, policy_version 86332 (0.0008) [2023-12-26 00:16:11,906][123090] Updated weights for policy 1, policy_version 85889 (0.0009) [2023-12-26 00:16:11,976][123090] Updated weights for policy 1, policy_version 85899 (0.0008) [2023-12-26 00:16:12,036][123090] Updated weights for policy 1, policy_version 85909 (0.0009) [2023-12-26 00:16:12,096][123090] Updated weights for policy 1, policy_version 85919 (0.0010) [2023-12-26 00:16:12,253][123091] Updated weights for policy 0, policy_version 86342 (0.0008) [2023-12-26 00:16:12,334][123091] Updated weights for policy 0, policy_version 86352 (0.0009) [2023-12-26 00:16:12,403][123091] Updated weights for policy 0, policy_version 86362 (0.0008) [2023-12-26 00:16:12,946][123090] Updated weights for policy 1, policy_version 85929 (0.0011) [2023-12-26 00:16:13,009][123090] Updated weights for policy 1, policy_version 85939 (0.0011) [2023-12-26 00:16:13,076][123090] Updated weights for policy 1, policy_version 85949 (0.0011) [2023-12-26 00:16:13,110][123091] Updated weights for policy 0, policy_version 86372 (0.0008) [2023-12-26 00:16:13,170][123091] Updated weights for policy 0, policy_version 86382 (0.0009) [2023-12-26 00:16:13,218][123091] Updated weights for policy 0, policy_version 86392 (0.0008) [2023-12-26 00:16:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 44122112. Throughput: 0: 9005.2, 1: 8635.0. Samples: 44118372. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:13,785][121949] Avg episode reward: [(0, '4694.876'), (1, '5448.857')] [2023-12-26 00:16:13,786][123007] Saving new best policy, reward=4694.876! [2023-12-26 00:16:13,835][123090] Updated weights for policy 1, policy_version 85959 (0.0007) [2023-12-26 00:16:13,905][123090] Updated weights for policy 1, policy_version 85969 (0.0005) [2023-12-26 00:16:13,949][123091] Updated weights for policy 0, policy_version 86402 (0.0008) [2023-12-26 00:16:13,973][123090] Updated weights for policy 1, policy_version 85979 (0.0006) [2023-12-26 00:16:14,009][123091] Updated weights for policy 0, policy_version 86412 (0.0008) [2023-12-26 00:16:14,066][123091] Updated weights for policy 0, policy_version 86422 (0.0010) [2023-12-26 00:16:14,126][123091] Updated weights for policy 0, policy_version 86432 (0.0010) [2023-12-26 00:16:14,586][123090] Updated weights for policy 1, policy_version 85989 (0.0008) [2023-12-26 00:16:14,636][123090] Updated weights for policy 1, policy_version 85999 (0.0010) [2023-12-26 00:16:14,688][123090] Updated weights for policy 1, policy_version 86009 (0.0010) [2023-12-26 00:16:14,963][123091] Updated weights for policy 0, policy_version 86442 (0.0010) [2023-12-26 00:16:15,026][123091] Updated weights for policy 0, policy_version 86452 (0.0010) [2023-12-26 00:16:15,091][123091] Updated weights for policy 0, policy_version 86462 (0.0010) [2023-12-26 00:16:15,523][123090] Updated weights for policy 1, policy_version 86019 (0.0010) [2023-12-26 00:16:15,586][123090] Updated weights for policy 1, policy_version 86029 (0.0010) [2023-12-26 00:16:15,649][123090] Updated weights for policy 1, policy_version 86039 (0.0010) [2023-12-26 00:16:15,913][123091] Updated weights for policy 0, policy_version 86472 (0.0010) [2023-12-26 00:16:15,968][123091] Updated weights for policy 0, policy_version 86482 (0.0010) [2023-12-26 00:16:16,021][123091] Updated weights for policy 0, policy_version 86492 (0.0010) [2023-12-26 00:16:16,466][123090] Updated weights for policy 1, policy_version 86049 (0.0010) [2023-12-26 00:16:16,528][123090] Updated weights for policy 1, policy_version 86059 (0.0010) [2023-12-26 00:16:16,585][123090] Updated weights for policy 1, policy_version 86069 (0.0009) [2023-12-26 00:16:16,645][123090] Updated weights for policy 1, policy_version 86079 (0.0010) [2023-12-26 00:16:16,748][123091] Updated weights for policy 0, policy_version 86502 (0.0009) [2023-12-26 00:16:16,812][123091] Updated weights for policy 0, policy_version 86512 (0.0010) [2023-12-26 00:16:16,866][123091] Updated weights for policy 0, policy_version 86522 (0.0006) [2023-12-26 00:16:17,411][123090] Updated weights for policy 1, policy_version 86089 (0.0006) [2023-12-26 00:16:17,461][123090] Updated weights for policy 1, policy_version 86099 (0.0005) [2023-12-26 00:16:17,524][123090] Updated weights for policy 1, policy_version 86109 (0.0008) [2023-12-26 00:16:17,527][123091] Updated weights for policy 0, policy_version 86532 (0.0005) [2023-12-26 00:16:17,574][123091] Updated weights for policy 0, policy_version 86542 (0.0005) [2023-12-26 00:16:17,631][123091] Updated weights for policy 0, policy_version 86552 (0.0005) [2023-12-26 00:16:18,164][123090] Updated weights for policy 1, policy_version 86119 (0.0007) [2023-12-26 00:16:18,235][123090] Updated weights for policy 1, policy_version 86129 (0.0006) [2023-12-26 00:16:18,299][123091] Updated weights for policy 0, policy_version 86562 (0.0005) [2023-12-26 00:16:18,305][123090] Updated weights for policy 1, policy_version 86139 (0.0007) [2023-12-26 00:16:18,363][123091] Updated weights for policy 0, policy_version 86572 (0.0006) [2023-12-26 00:16:18,431][123091] Updated weights for policy 0, policy_version 86582 (0.0006) [2023-12-26 00:16:18,506][123091] Updated weights for policy 0, policy_version 86592 (0.0006) [2023-12-26 00:16:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 44220416. Throughput: 0: 9119.5, 1: 8669.9. Samples: 44231868. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:18,785][121949] Avg episode reward: [(0, '4541.863'), (1, '5530.290')] [2023-12-26 00:16:18,964][123090] Updated weights for policy 1, policy_version 86149 (0.0009) [2023-12-26 00:16:19,021][123090] Updated weights for policy 1, policy_version 86159 (0.0009) [2023-12-26 00:16:19,077][123090] Updated weights for policy 1, policy_version 86170 (0.0010) [2023-12-26 00:16:19,173][123091] Updated weights for policy 0, policy_version 86602 (0.0009) [2023-12-26 00:16:19,230][123091] Updated weights for policy 0, policy_version 86612 (0.0009) [2023-12-26 00:16:19,290][123091] Updated weights for policy 0, policy_version 86622 (0.0009) [2023-12-26 00:16:19,956][123090] Updated weights for policy 1, policy_version 86180 (0.0007) [2023-12-26 00:16:20,023][123090] Updated weights for policy 1, policy_version 86190 (0.0008) [2023-12-26 00:16:20,098][123090] Updated weights for policy 1, policy_version 86200 (0.0008) [2023-12-26 00:16:20,170][123091] Updated weights for policy 0, policy_version 86632 (0.0008) [2023-12-26 00:16:20,242][123091] Updated weights for policy 0, policy_version 86642 (0.0008) [2023-12-26 00:16:20,314][123091] Updated weights for policy 0, policy_version 86652 (0.0007) [2023-12-26 00:16:20,931][123090] Updated weights for policy 1, policy_version 86210 (0.0008) [2023-12-26 00:16:21,005][123090] Updated weights for policy 1, policy_version 86220 (0.0007) [2023-12-26 00:16:21,061][123091] Updated weights for policy 0, policy_version 86662 (0.0007) [2023-12-26 00:16:21,080][123090] Updated weights for policy 1, policy_version 86230 (0.0008) [2023-12-26 00:16:21,131][123091] Updated weights for policy 0, policy_version 86672 (0.0009) [2023-12-26 00:16:21,142][123090] Updated weights for policy 1, policy_version 86240 (0.0007) [2023-12-26 00:16:21,207][123091] Updated weights for policy 0, policy_version 86682 (0.0008) [2023-12-26 00:16:21,917][123090] Updated weights for policy 1, policy_version 86250 (0.0008) [2023-12-26 00:16:21,975][123090] Updated weights for policy 1, policy_version 86260 (0.0009) [2023-12-26 00:16:22,007][123091] Updated weights for policy 0, policy_version 86692 (0.0009) [2023-12-26 00:16:22,029][123090] Updated weights for policy 1, policy_version 86270 (0.0010) [2023-12-26 00:16:22,067][123091] Updated weights for policy 0, policy_version 86702 (0.0011) [2023-12-26 00:16:22,135][123091] Updated weights for policy 0, policy_version 86712 (0.0011) [2023-12-26 00:16:22,774][123090] Updated weights for policy 1, policy_version 86280 (0.0006) [2023-12-26 00:16:22,829][123090] Updated weights for policy 1, policy_version 86290 (0.0005) [2023-12-26 00:16:22,884][123090] Updated weights for policy 1, policy_version 86300 (0.0006) [2023-12-26 00:16:23,032][123091] Updated weights for policy 0, policy_version 86722 (0.0010) [2023-12-26 00:16:23,095][123091] Updated weights for policy 0, policy_version 86732 (0.0010) [2023-12-26 00:16:23,160][123091] Updated weights for policy 0, policy_version 86742 (0.0008) [2023-12-26 00:16:23,219][123091] Updated weights for policy 0, policy_version 86752 (0.0006) [2023-12-26 00:16:23,607][123090] Updated weights for policy 1, policy_version 86310 (0.0008) [2023-12-26 00:16:23,661][123090] Updated weights for policy 1, policy_version 86321 (0.0010) [2023-12-26 00:16:23,714][123090] Updated weights for policy 1, policy_version 86332 (0.0010) [2023-12-26 00:16:23,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 44310528. Throughput: 0: 9094.2, 1: 8613.0. Samples: 44284220. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:23,785][121949] Avg episode reward: [(0, '4521.443'), (1, '5332.909')] [2023-12-26 00:16:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000086752_22208512.pth... [2023-12-26 00:16:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000086336_22102016.pth... [2023-12-26 00:16:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000085312_21839872.pth [2023-12-26 00:16:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000085696_21938176.pth [2023-12-26 00:16:23,925][123091] Updated weights for policy 0, policy_version 86762 (0.0006) [2023-12-26 00:16:23,980][123091] Updated weights for policy 0, policy_version 86772 (0.0008) [2023-12-26 00:16:24,028][123091] Updated weights for policy 0, policy_version 86782 (0.0008) [2023-12-26 00:16:24,619][123090] Updated weights for policy 1, policy_version 86343 (0.0008) [2023-12-26 00:16:24,686][123090] Updated weights for policy 1, policy_version 86353 (0.0009) [2023-12-26 00:16:24,737][123090] Updated weights for policy 1, policy_version 86363 (0.0009) [2023-12-26 00:16:24,762][123091] Updated weights for policy 0, policy_version 86792 (0.0007) [2023-12-26 00:16:24,819][123091] Updated weights for policy 0, policy_version 86802 (0.0009) [2023-12-26 00:16:24,891][123091] Updated weights for policy 0, policy_version 86812 (0.0010) [2023-12-26 00:16:25,471][123090] Updated weights for policy 1, policy_version 86373 (0.0009) [2023-12-26 00:16:25,527][123090] Updated weights for policy 1, policy_version 86383 (0.0008) [2023-12-26 00:16:25,588][123090] Updated weights for policy 1, policy_version 86393 (0.0009) [2023-12-26 00:16:25,622][123091] Updated weights for policy 0, policy_version 86822 (0.0010) [2023-12-26 00:16:25,677][123091] Updated weights for policy 0, policy_version 86832 (0.0010) [2023-12-26 00:16:25,743][123091] Updated weights for policy 0, policy_version 86842 (0.0011) [2023-12-26 00:16:26,451][123090] Updated weights for policy 1, policy_version 86403 (0.0007) [2023-12-26 00:16:26,470][123091] Updated weights for policy 0, policy_version 86852 (0.0011) [2023-12-26 00:16:26,507][123090] Updated weights for policy 1, policy_version 86413 (0.0007) [2023-12-26 00:16:26,532][123091] Updated weights for policy 0, policy_version 86862 (0.0010) [2023-12-26 00:16:26,563][123090] Updated weights for policy 1, policy_version 86423 (0.0008) [2023-12-26 00:16:26,594][123091] Updated weights for policy 0, policy_version 86872 (0.0011) [2023-12-26 00:16:27,339][123091] Updated weights for policy 0, policy_version 86882 (0.0011) [2023-12-26 00:16:27,399][123091] Updated weights for policy 0, policy_version 86892 (0.0010) [2023-12-26 00:16:27,411][123090] Updated weights for policy 1, policy_version 86433 (0.0005) [2023-12-26 00:16:27,456][123091] Updated weights for policy 0, policy_version 86902 (0.0005) [2023-12-26 00:16:27,464][123090] Updated weights for policy 1, policy_version 86443 (0.0010) [2023-12-26 00:16:27,516][123091] Updated weights for policy 0, policy_version 86912 (0.0005) [2023-12-26 00:16:27,518][123090] Updated weights for policy 1, policy_version 86453 (0.0008) [2023-12-26 00:16:27,574][123090] Updated weights for policy 1, policy_version 86463 (0.0009) [2023-12-26 00:16:28,184][123091] Updated weights for policy 0, policy_version 86922 (0.0005) [2023-12-26 00:16:28,243][123091] Updated weights for policy 0, policy_version 86932 (0.0005) [2023-12-26 00:16:28,308][123091] Updated weights for policy 0, policy_version 86942 (0.0005) [2023-12-26 00:16:28,517][123090] Updated weights for policy 1, policy_version 86473 (0.0010) [2023-12-26 00:16:28,568][123090] Updated weights for policy 1, policy_version 86483 (0.0009) [2023-12-26 00:16:28,621][123090] Updated weights for policy 1, policy_version 86493 (0.0009) [2023-12-26 00:16:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 44400640. Throughput: 0: 9085.1, 1: 8571.3. Samples: 44391836. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:28,785][121949] Avg episode reward: [(0, '4621.697'), (1, '5317.207')] [2023-12-26 00:16:29,019][123091] Updated weights for policy 0, policy_version 86952 (0.0009) [2023-12-26 00:16:29,071][123091] Updated weights for policy 0, policy_version 86963 (0.0010) [2023-12-26 00:16:29,127][123091] Updated weights for policy 0, policy_version 86973 (0.0009) [2023-12-26 00:16:29,500][123090] Updated weights for policy 1, policy_version 86503 (0.0010) [2023-12-26 00:16:29,563][123090] Updated weights for policy 1, policy_version 86513 (0.0008) [2023-12-26 00:16:29,622][123090] Updated weights for policy 1, policy_version 86523 (0.0009) [2023-12-26 00:16:29,954][123091] Updated weights for policy 0, policy_version 86983 (0.0009) [2023-12-26 00:16:30,041][123091] Updated weights for policy 0, policy_version 86993 (0.0010) [2023-12-26 00:16:30,107][123091] Updated weights for policy 0, policy_version 87003 (0.0010) [2023-12-26 00:16:30,507][123090] Updated weights for policy 1, policy_version 86533 (0.0009) [2023-12-26 00:16:30,569][123090] Updated weights for policy 1, policy_version 86543 (0.0009) [2023-12-26 00:16:30,634][123090] Updated weights for policy 1, policy_version 86553 (0.0010) [2023-12-26 00:16:30,780][123091] Updated weights for policy 0, policy_version 87013 (0.0009) [2023-12-26 00:16:30,840][123091] Updated weights for policy 0, policy_version 87023 (0.0009) [2023-12-26 00:16:30,902][123091] Updated weights for policy 0, policy_version 87033 (0.0008) [2023-12-26 00:16:31,470][123090] Updated weights for policy 1, policy_version 86563 (0.0010) [2023-12-26 00:16:31,533][123090] Updated weights for policy 1, policy_version 86573 (0.0010) [2023-12-26 00:16:31,591][123090] Updated weights for policy 1, policy_version 86583 (0.0009) [2023-12-26 00:16:31,701][123091] Updated weights for policy 0, policy_version 87043 (0.0009) [2023-12-26 00:16:31,764][123091] Updated weights for policy 0, policy_version 87053 (0.0010) [2023-12-26 00:16:31,812][123091] Updated weights for policy 0, policy_version 87063 (0.0009) [2023-12-26 00:16:32,405][123090] Updated weights for policy 1, policy_version 86593 (0.0008) [2023-12-26 00:16:32,460][123090] Updated weights for policy 1, policy_version 86603 (0.0005) [2023-12-26 00:16:32,521][123090] Updated weights for policy 1, policy_version 86613 (0.0005) [2023-12-26 00:16:32,587][123090] Updated weights for policy 1, policy_version 86623 (0.0006) [2023-12-26 00:16:32,690][123091] Updated weights for policy 0, policy_version 87073 (0.0008) [2023-12-26 00:16:32,744][123091] Updated weights for policy 0, policy_version 87083 (0.0009) [2023-12-26 00:16:32,797][123091] Updated weights for policy 0, policy_version 87093 (0.0009) [2023-12-26 00:16:32,863][123091] Updated weights for policy 0, policy_version 87103 (0.0010) [2023-12-26 00:16:33,291][123090] Updated weights for policy 1, policy_version 86633 (0.0009) [2023-12-26 00:16:33,347][123090] Updated weights for policy 1, policy_version 86643 (0.0009) [2023-12-26 00:16:33,410][123090] Updated weights for policy 1, policy_version 86653 (0.0009) [2023-12-26 00:16:33,696][123091] Updated weights for policy 0, policy_version 87113 (0.0006) [2023-12-26 00:16:33,757][123091] Updated weights for policy 0, policy_version 87123 (0.0005) [2023-12-26 00:16:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 44482560. Throughput: 0: 9085.5, 1: 8571.4. Samples: 44497052. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:33,785][121949] Avg episode reward: [(0, '4655.009'), (1, '5353.449')] [2023-12-26 00:16:33,812][123091] Updated weights for policy 0, policy_version 87133 (0.0005) [2023-12-26 00:16:34,293][123090] Updated weights for policy 1, policy_version 86663 (0.0010) [2023-12-26 00:16:34,349][123090] Updated weights for policy 1, policy_version 86673 (0.0009) [2023-12-26 00:16:34,410][123090] Updated weights for policy 1, policy_version 86683 (0.0009) [2023-12-26 00:16:34,494][123091] Updated weights for policy 0, policy_version 87143 (0.0008) [2023-12-26 00:16:34,551][123091] Updated weights for policy 0, policy_version 87153 (0.0009) [2023-12-26 00:16:34,607][123091] Updated weights for policy 0, policy_version 87163 (0.0009) [2023-12-26 00:16:35,279][123090] Updated weights for policy 1, policy_version 86693 (0.0010) [2023-12-26 00:16:35,333][123090] Updated weights for policy 1, policy_version 86703 (0.0009) [2023-12-26 00:16:35,396][123090] Updated weights for policy 1, policy_version 86713 (0.0009) [2023-12-26 00:16:35,429][123091] Updated weights for policy 0, policy_version 87173 (0.0009) [2023-12-26 00:16:35,476][123091] Updated weights for policy 0, policy_version 87183 (0.0009) [2023-12-26 00:16:35,525][123091] Updated weights for policy 0, policy_version 87193 (0.0009) [2023-12-26 00:16:36,264][123090] Updated weights for policy 1, policy_version 86723 (0.0009) [2023-12-26 00:16:36,338][123090] Updated weights for policy 1, policy_version 86733 (0.0009) [2023-12-26 00:16:36,382][123091] Updated weights for policy 0, policy_version 87203 (0.0008) [2023-12-26 00:16:36,407][123090] Updated weights for policy 1, policy_version 86743 (0.0008) [2023-12-26 00:16:36,439][123091] Updated weights for policy 0, policy_version 87213 (0.0006) [2023-12-26 00:16:36,511][123091] Updated weights for policy 0, policy_version 87223 (0.0007) [2023-12-26 00:16:37,219][123090] Updated weights for policy 1, policy_version 86753 (0.0009) [2023-12-26 00:16:37,278][123090] Updated weights for policy 1, policy_version 86763 (0.0009) [2023-12-26 00:16:37,314][123091] Updated weights for policy 0, policy_version 87233 (0.0009) [2023-12-26 00:16:37,342][123090] Updated weights for policy 1, policy_version 86773 (0.0009) [2023-12-26 00:16:37,363][123091] Updated weights for policy 0, policy_version 87243 (0.0008) [2023-12-26 00:16:37,404][123090] Updated weights for policy 1, policy_version 86783 (0.0008) [2023-12-26 00:16:37,416][123091] Updated weights for policy 0, policy_version 87253 (0.0009) [2023-12-26 00:16:37,481][123091] Updated weights for policy 0, policy_version 87263 (0.0010) [2023-12-26 00:16:38,224][123090] Updated weights for policy 1, policy_version 86793 (0.0009) [2023-12-26 00:16:38,276][123090] Updated weights for policy 1, policy_version 86803 (0.0010) [2023-12-26 00:16:38,301][123091] Updated weights for policy 0, policy_version 87273 (0.0007) [2023-12-26 00:16:38,341][123090] Updated weights for policy 1, policy_version 86813 (0.0009) [2023-12-26 00:16:38,369][123091] Updated weights for policy 0, policy_version 87283 (0.0009) [2023-12-26 00:16:38,434][123091] Updated weights for policy 0, policy_version 87293 (0.0010) [2023-12-26 00:16:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 44572672. Throughput: 0: 9123.7, 1: 8592.5. Samples: 44549256. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:38,784][121949] Avg episode reward: [(0, '4629.224'), (1, '5462.525')] [2023-12-26 00:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000087296_22347776.pth... [2023-12-26 00:16:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000086816_22224896.pth... [2023-12-26 00:16:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000086240_22077440.pth [2023-12-26 00:16:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000085792_21962752.pth [2023-12-26 00:16:39,201][123091] Updated weights for policy 0, policy_version 87303 (0.0007) [2023-12-26 00:16:39,232][123090] Updated weights for policy 1, policy_version 86823 (0.0009) [2023-12-26 00:16:39,274][123091] Updated weights for policy 0, policy_version 87313 (0.0008) [2023-12-26 00:16:39,296][123090] Updated weights for policy 1, policy_version 86833 (0.0009) [2023-12-26 00:16:39,344][123091] Updated weights for policy 0, policy_version 87323 (0.0009) [2023-12-26 00:16:39,360][123090] Updated weights for policy 1, policy_version 86843 (0.0009) [2023-12-26 00:16:40,152][123091] Updated weights for policy 0, policy_version 87333 (0.0007) [2023-12-26 00:16:40,222][123091] Updated weights for policy 0, policy_version 87343 (0.0008) [2023-12-26 00:16:40,224][123090] Updated weights for policy 1, policy_version 86853 (0.0009) [2023-12-26 00:16:40,288][123091] Updated weights for policy 0, policy_version 87353 (0.0009) [2023-12-26 00:16:40,290][123090] Updated weights for policy 1, policy_version 86863 (0.0008) [2023-12-26 00:16:40,359][123090] Updated weights for policy 1, policy_version 86873 (0.0009) [2023-12-26 00:16:41,088][123091] Updated weights for policy 0, policy_version 87363 (0.0009) [2023-12-26 00:16:41,150][123091] Updated weights for policy 0, policy_version 87373 (0.0010) [2023-12-26 00:16:41,224][123091] Updated weights for policy 0, policy_version 87383 (0.0007) [2023-12-26 00:16:41,305][123090] Updated weights for policy 1, policy_version 86883 (0.0009) [2023-12-26 00:16:41,375][123090] Updated weights for policy 1, policy_version 86893 (0.0010) [2023-12-26 00:16:41,442][123090] Updated weights for policy 1, policy_version 86903 (0.0009) [2023-12-26 00:16:42,092][123091] Updated weights for policy 0, policy_version 87393 (0.0010) [2023-12-26 00:16:42,152][123091] Updated weights for policy 0, policy_version 87403 (0.0010) [2023-12-26 00:16:42,216][123091] Updated weights for policy 0, policy_version 87413 (0.0009) [2023-12-26 00:16:42,282][123090] Updated weights for policy 1, policy_version 86913 (0.0009) [2023-12-26 00:16:42,285][123091] Updated weights for policy 0, policy_version 87423 (0.0011) [2023-12-26 00:16:42,341][123090] Updated weights for policy 1, policy_version 86923 (0.0009) [2023-12-26 00:16:42,408][123090] Updated weights for policy 1, policy_version 86933 (0.0009) [2023-12-26 00:16:42,467][123090] Updated weights for policy 1, policy_version 86943 (0.0008) [2023-12-26 00:16:43,103][123091] Updated weights for policy 0, policy_version 87433 (0.0011) [2023-12-26 00:16:43,164][123091] Updated weights for policy 0, policy_version 87443 (0.0010) [2023-12-26 00:16:43,227][123091] Updated weights for policy 0, policy_version 87453 (0.0011) [2023-12-26 00:16:43,283][123090] Updated weights for policy 1, policy_version 86953 (0.0008) [2023-12-26 00:16:43,346][123090] Updated weights for policy 1, policy_version 86963 (0.0008) [2023-12-26 00:16:43,410][123090] Updated weights for policy 1, policy_version 86973 (0.0009) [2023-12-26 00:16:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 44654592. Throughput: 0: 9070.4, 1: 8533.0. Samples: 44649880. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:43,785][121949] Avg episode reward: [(0, '4628.052'), (1, '5465.040')] [2023-12-26 00:16:43,941][123091] Updated weights for policy 0, policy_version 87463 (0.0009) [2023-12-26 00:16:43,989][123091] Updated weights for policy 0, policy_version 87473 (0.0009) [2023-12-26 00:16:44,037][123091] Updated weights for policy 0, policy_version 87483 (0.0009) [2023-12-26 00:16:44,210][123090] Updated weights for policy 1, policy_version 86983 (0.0009) [2023-12-26 00:16:44,278][123090] Updated weights for policy 1, policy_version 86993 (0.0010) [2023-12-26 00:16:44,345][123090] Updated weights for policy 1, policy_version 87003 (0.0008) [2023-12-26 00:16:44,946][123091] Updated weights for policy 0, policy_version 87493 (0.0007) [2023-12-26 00:16:45,002][123091] Updated weights for policy 0, policy_version 87503 (0.0010) [2023-12-26 00:16:45,059][123091] Updated weights for policy 0, policy_version 87513 (0.0010) [2023-12-26 00:16:45,080][123090] Updated weights for policy 1, policy_version 87013 (0.0007) [2023-12-26 00:16:45,146][123090] Updated weights for policy 1, policy_version 87023 (0.0007) [2023-12-26 00:16:45,216][123090] Updated weights for policy 1, policy_version 87033 (0.0006) [2023-12-26 00:16:45,896][123091] Updated weights for policy 0, policy_version 87523 (0.0008) [2023-12-26 00:16:45,957][123091] Updated weights for policy 0, policy_version 87533 (0.0005) [2023-12-26 00:16:45,985][123090] Updated weights for policy 1, policy_version 87043 (0.0009) [2023-12-26 00:16:46,019][123091] Updated weights for policy 0, policy_version 87543 (0.0008) [2023-12-26 00:16:46,055][123090] Updated weights for policy 1, policy_version 87053 (0.0005) [2023-12-26 00:16:46,120][123090] Updated weights for policy 1, policy_version 87063 (0.0005) [2023-12-26 00:16:46,795][123091] Updated weights for policy 0, policy_version 87553 (0.0008) [2023-12-26 00:16:46,843][123091] Updated weights for policy 0, policy_version 87563 (0.0009) [2023-12-26 00:16:46,853][123090] Updated weights for policy 1, policy_version 87073 (0.0006) [2023-12-26 00:16:46,892][123091] Updated weights for policy 0, policy_version 87573 (0.0009) [2023-12-26 00:16:46,905][123090] Updated weights for policy 1, policy_version 87083 (0.0010) [2023-12-26 00:16:46,950][123091] Updated weights for policy 0, policy_version 87583 (0.0009) [2023-12-26 00:16:46,961][123090] Updated weights for policy 1, policy_version 87093 (0.0010) [2023-12-26 00:16:47,017][123090] Updated weights for policy 1, policy_version 87103 (0.0010) [2023-12-26 00:16:47,809][123091] Updated weights for policy 0, policy_version 87593 (0.0009) [2023-12-26 00:16:47,834][123090] Updated weights for policy 1, policy_version 87113 (0.0010) [2023-12-26 00:16:47,867][123091] Updated weights for policy 0, policy_version 87603 (0.0006) [2023-12-26 00:16:47,889][123090] Updated weights for policy 1, policy_version 87123 (0.0010) [2023-12-26 00:16:47,926][123091] Updated weights for policy 0, policy_version 87613 (0.0010) [2023-12-26 00:16:47,947][123090] Updated weights for policy 1, policy_version 87133 (0.0010) [2023-12-26 00:16:48,622][123091] Updated weights for policy 0, policy_version 87623 (0.0007) [2023-12-26 00:16:48,691][123091] Updated weights for policy 0, policy_version 87633 (0.0008) [2023-12-26 00:16:48,754][123091] Updated weights for policy 0, policy_version 87643 (0.0009) [2023-12-26 00:16:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 44744704. Throughput: 0: 9054.6, 1: 8600.0. Samples: 44756596. Policy #0 lag: (min: 20.0, avg: 22.4, max: 52.0) [2023-12-26 00:16:48,785][121949] Avg episode reward: [(0, '4536.242'), (1, '5549.525')] [2023-12-26 00:16:48,806][123090] Updated weights for policy 1, policy_version 87143 (0.0010) [2023-12-26 00:16:48,876][123090] Updated weights for policy 1, policy_version 87153 (0.0010) [2023-12-26 00:16:48,942][123090] Updated weights for policy 1, policy_version 87163 (0.0010) [2023-12-26 00:16:49,519][123091] Updated weights for policy 0, policy_version 87653 (0.0007) [2023-12-26 00:16:49,575][123091] Updated weights for policy 0, policy_version 87663 (0.0005) [2023-12-26 00:16:49,626][123091] Updated weights for policy 0, policy_version 87673 (0.0005) [2023-12-26 00:16:49,768][123090] Updated weights for policy 1, policy_version 87173 (0.0010) [2023-12-26 00:16:49,824][123090] Updated weights for policy 1, policy_version 87183 (0.0010) [2023-12-26 00:16:49,892][123090] Updated weights for policy 1, policy_version 87193 (0.0010) [2023-12-26 00:16:50,460][123091] Updated weights for policy 0, policy_version 87683 (0.0008) [2023-12-26 00:16:50,516][123091] Updated weights for policy 0, policy_version 87693 (0.0009) [2023-12-26 00:16:50,577][123091] Updated weights for policy 0, policy_version 87703 (0.0009) [2023-12-26 00:16:50,748][123090] Updated weights for policy 1, policy_version 87203 (0.0010) [2023-12-26 00:16:50,801][123090] Updated weights for policy 1, policy_version 87213 (0.0011) [2023-12-26 00:16:50,866][123090] Updated weights for policy 1, policy_version 87223 (0.0011) [2023-12-26 00:16:51,467][123091] Updated weights for policy 0, policy_version 87713 (0.0010) [2023-12-26 00:16:51,527][123091] Updated weights for policy 0, policy_version 87723 (0.0009) [2023-12-26 00:16:51,585][123091] Updated weights for policy 0, policy_version 87733 (0.0008) [2023-12-26 00:16:51,651][123091] Updated weights for policy 0, policy_version 87743 (0.0010) [2023-12-26 00:16:51,752][123090] Updated weights for policy 1, policy_version 87233 (0.0010) [2023-12-26 00:16:51,819][123090] Updated weights for policy 1, policy_version 87243 (0.0010) [2023-12-26 00:16:51,889][123090] Updated weights for policy 1, policy_version 87253 (0.0008) [2023-12-26 00:16:51,955][123090] Updated weights for policy 1, policy_version 87263 (0.0011) [2023-12-26 00:16:52,489][123091] Updated weights for policy 0, policy_version 87753 (0.0006) [2023-12-26 00:16:52,546][123091] Updated weights for policy 0, policy_version 87763 (0.0008) [2023-12-26 00:16:52,600][123091] Updated weights for policy 0, policy_version 87774 (0.0010) [2023-12-26 00:16:52,752][123090] Updated weights for policy 1, policy_version 87273 (0.0008) [2023-12-26 00:16:52,822][123090] Updated weights for policy 1, policy_version 87283 (0.0010) [2023-12-26 00:16:52,892][123090] Updated weights for policy 1, policy_version 87293 (0.0011) [2023-12-26 00:16:53,421][123091] Updated weights for policy 0, policy_version 87784 (0.0010) [2023-12-26 00:16:53,479][123091] Updated weights for policy 0, policy_version 87794 (0.0010) [2023-12-26 00:16:53,533][123091] Updated weights for policy 0, policy_version 87805 (0.0010) [2023-12-26 00:16:53,634][123090] Updated weights for policy 1, policy_version 87303 (0.0010) [2023-12-26 00:16:53,707][123090] Updated weights for policy 1, policy_version 87313 (0.0011) [2023-12-26 00:16:53,758][123090] Updated weights for policy 1, policy_version 87323 (0.0010) [2023-12-26 00:16:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 44834816. Throughput: 0: 9008.1, 1: 8602.3. Samples: 44806932. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:16:53,785][121949] Avg episode reward: [(0, '4601.815'), (1, '5477.753')] [2023-12-26 00:16:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000087808_22478848.pth... [2023-12-26 00:16:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000087328_22355968.pth... [2023-12-26 00:16:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000086336_22102016.pth [2023-12-26 00:16:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000086752_22208512.pth [2023-12-26 00:16:54,376][123091] Updated weights for policy 0, policy_version 87816 (0.0010) [2023-12-26 00:16:54,437][123091] Updated weights for policy 0, policy_version 87826 (0.0010) [2023-12-26 00:16:54,490][123091] Updated weights for policy 0, policy_version 87836 (0.0010) [2023-12-26 00:16:54,510][123090] Updated weights for policy 1, policy_version 87333 (0.0008) [2023-12-26 00:16:54,585][123090] Updated weights for policy 1, policy_version 87343 (0.0005) [2023-12-26 00:16:54,653][123090] Updated weights for policy 1, policy_version 87353 (0.0005) [2023-12-26 00:16:55,240][123091] Updated weights for policy 0, policy_version 87846 (0.0007) [2023-12-26 00:16:55,288][123091] Updated weights for policy 0, policy_version 87856 (0.0006) [2023-12-26 00:16:55,289][123090] Updated weights for policy 1, policy_version 87363 (0.0006) [2023-12-26 00:16:55,335][123091] Updated weights for policy 0, policy_version 87866 (0.0006) [2023-12-26 00:16:55,351][123090] Updated weights for policy 1, policy_version 87373 (0.0006) [2023-12-26 00:16:55,412][123090] Updated weights for policy 1, policy_version 87383 (0.0009) [2023-12-26 00:16:56,087][123090] Updated weights for policy 1, policy_version 87393 (0.0008) [2023-12-26 00:16:56,153][123090] Updated weights for policy 1, policy_version 87403 (0.0005) [2023-12-26 00:16:56,159][123091] Updated weights for policy 0, policy_version 87876 (0.0007) [2023-12-26 00:16:56,200][123090] Updated weights for policy 1, policy_version 87413 (0.0006) [2023-12-26 00:16:56,218][123091] Updated weights for policy 0, policy_version 87886 (0.0008) [2023-12-26 00:16:56,249][123090] Updated weights for policy 1, policy_version 87423 (0.0006) [2023-12-26 00:16:56,270][123091] Updated weights for policy 0, policy_version 87896 (0.0008) [2023-12-26 00:16:56,922][123090] Updated weights for policy 1, policy_version 87433 (0.0005) [2023-12-26 00:16:56,980][123090] Updated weights for policy 1, policy_version 87443 (0.0005) [2023-12-26 00:16:56,994][123091] Updated weights for policy 0, policy_version 87906 (0.0008) [2023-12-26 00:16:57,036][123090] Updated weights for policy 1, policy_version 87453 (0.0006) [2023-12-26 00:16:57,061][123091] Updated weights for policy 0, policy_version 87916 (0.0006) [2023-12-26 00:16:57,119][123091] Updated weights for policy 0, policy_version 87926 (0.0005) [2023-12-26 00:16:57,166][123091] Updated weights for policy 0, policy_version 87936 (0.0006) [2023-12-26 00:16:57,706][123090] Updated weights for policy 1, policy_version 87463 (0.0006) [2023-12-26 00:16:57,768][123090] Updated weights for policy 1, policy_version 87473 (0.0005) [2023-12-26 00:16:57,818][123090] Updated weights for policy 1, policy_version 87483 (0.0005) [2023-12-26 00:16:57,832][123091] Updated weights for policy 0, policy_version 87946 (0.0005) [2023-12-26 00:16:57,878][123091] Updated weights for policy 0, policy_version 87956 (0.0005) [2023-12-26 00:16:57,921][123091] Updated weights for policy 0, policy_version 87966 (0.0005) [2023-12-26 00:16:58,617][123090] Updated weights for policy 1, policy_version 87493 (0.0007) [2023-12-26 00:16:58,698][123090] Updated weights for policy 1, policy_version 87503 (0.0011) [2023-12-26 00:16:58,761][123090] Updated weights for policy 1, policy_version 87513 (0.0007) [2023-12-26 00:16:58,763][123091] Updated weights for policy 0, policy_version 87976 (0.0010) [2023-12-26 00:16:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 44916736. Throughput: 0: 9005.0, 1: 8783.1. Samples: 44918840. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:16:58,785][121949] Avg episode reward: [(0, '4715.099'), (1, '5486.248')] [2023-12-26 00:16:58,819][123091] Updated weights for policy 0, policy_version 87986 (0.0011) [2023-12-26 00:16:58,879][123091] Updated weights for policy 0, policy_version 87996 (0.0011) [2023-12-26 00:16:58,898][123007] Saving new best policy, reward=4715.099! [2023-12-26 00:16:59,621][123090] Updated weights for policy 1, policy_version 87523 (0.0007) [2023-12-26 00:16:59,667][123091] Updated weights for policy 0, policy_version 88006 (0.0010) [2023-12-26 00:16:59,683][123090] Updated weights for policy 1, policy_version 87533 (0.0005) [2023-12-26 00:16:59,729][123091] Updated weights for policy 0, policy_version 88016 (0.0009) [2023-12-26 00:16:59,746][123090] Updated weights for policy 1, policy_version 87543 (0.0006) [2023-12-26 00:16:59,787][123091] Updated weights for policy 0, policy_version 88026 (0.0010) [2023-12-26 00:17:00,473][123090] Updated weights for policy 1, policy_version 87553 (0.0006) [2023-12-26 00:17:00,548][123090] Updated weights for policy 1, policy_version 87563 (0.0010) [2023-12-26 00:17:00,605][123091] Updated weights for policy 0, policy_version 88036 (0.0006) [2023-12-26 00:17:00,618][123090] Updated weights for policy 1, policy_version 87573 (0.0009) [2023-12-26 00:17:00,659][123091] Updated weights for policy 0, policy_version 88046 (0.0006) [2023-12-26 00:17:00,683][123090] Updated weights for policy 1, policy_version 87583 (0.0009) [2023-12-26 00:17:00,725][123091] Updated weights for policy 0, policy_version 88056 (0.0008) [2023-12-26 00:17:01,436][123090] Updated weights for policy 1, policy_version 87593 (0.0006) [2023-12-26 00:17:01,491][123090] Updated weights for policy 1, policy_version 87603 (0.0005) [2023-12-26 00:17:01,543][123091] Updated weights for policy 0, policy_version 88066 (0.0009) [2023-12-26 00:17:01,558][123090] Updated weights for policy 1, policy_version 87613 (0.0005) [2023-12-26 00:17:01,603][123091] Updated weights for policy 0, policy_version 88076 (0.0009) [2023-12-26 00:17:01,674][123091] Updated weights for policy 0, policy_version 88086 (0.0009) [2023-12-26 00:17:01,739][123091] Updated weights for policy 0, policy_version 88096 (0.0009) [2023-12-26 00:17:02,324][123090] Updated weights for policy 1, policy_version 87623 (0.0008) [2023-12-26 00:17:02,387][123090] Updated weights for policy 1, policy_version 87633 (0.0009) [2023-12-26 00:17:02,456][123090] Updated weights for policy 1, policy_version 87643 (0.0010) [2023-12-26 00:17:02,573][123091] Updated weights for policy 0, policy_version 88106 (0.0009) [2023-12-26 00:17:02,636][123091] Updated weights for policy 0, policy_version 88116 (0.0009) [2023-12-26 00:17:02,699][123091] Updated weights for policy 0, policy_version 88126 (0.0009) [2023-12-26 00:17:03,271][123090] Updated weights for policy 1, policy_version 87653 (0.0008) [2023-12-26 00:17:03,335][123090] Updated weights for policy 1, policy_version 87663 (0.0009) [2023-12-26 00:17:03,403][123090] Updated weights for policy 1, policy_version 87673 (0.0010) [2023-12-26 00:17:03,515][123091] Updated weights for policy 0, policy_version 88136 (0.0008) [2023-12-26 00:17:03,583][123091] Updated weights for policy 0, policy_version 88146 (0.0010) [2023-12-26 00:17:03,649][123091] Updated weights for policy 0, policy_version 88156 (0.0009) [2023-12-26 00:17:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 45015040. Throughput: 0: 8904.2, 1: 8699.0. Samples: 45024016. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:03,785][121949] Avg episode reward: [(0, '4687.942'), (1, '5598.233')] [2023-12-26 00:17:03,787][123008] Saving new best policy, reward=5598.233! [2023-12-26 00:17:04,183][123090] Updated weights for policy 1, policy_version 87683 (0.0008) [2023-12-26 00:17:04,252][123090] Updated weights for policy 1, policy_version 87693 (0.0009) [2023-12-26 00:17:04,324][123090] Updated weights for policy 1, policy_version 87703 (0.0010) [2023-12-26 00:17:04,505][123091] Updated weights for policy 0, policy_version 88166 (0.0010) [2023-12-26 00:17:04,569][123091] Updated weights for policy 0, policy_version 88176 (0.0009) [2023-12-26 00:17:04,640][123091] Updated weights for policy 0, policy_version 88186 (0.0009) [2023-12-26 00:17:05,082][123090] Updated weights for policy 1, policy_version 87713 (0.0009) [2023-12-26 00:17:05,157][123090] Updated weights for policy 1, policy_version 87723 (0.0005) [2023-12-26 00:17:05,215][123090] Updated weights for policy 1, policy_version 87733 (0.0008) [2023-12-26 00:17:05,277][123090] Updated weights for policy 1, policy_version 87743 (0.0006) [2023-12-26 00:17:05,406][123091] Updated weights for policy 0, policy_version 88196 (0.0010) [2023-12-26 00:17:05,471][123091] Updated weights for policy 0, policy_version 88206 (0.0010) [2023-12-26 00:17:05,532][123091] Updated weights for policy 0, policy_version 88216 (0.0009) [2023-12-26 00:17:05,838][123090] Updated weights for policy 1, policy_version 87753 (0.0005) [2023-12-26 00:17:05,902][123090] Updated weights for policy 1, policy_version 87763 (0.0005) [2023-12-26 00:17:05,968][123090] Updated weights for policy 1, policy_version 87773 (0.0005) [2023-12-26 00:17:06,457][123091] Updated weights for policy 0, policy_version 88226 (0.0010) [2023-12-26 00:17:06,525][123091] Updated weights for policy 0, policy_version 88236 (0.0009) [2023-12-26 00:17:06,591][123091] Updated weights for policy 0, policy_version 88246 (0.0010) [2023-12-26 00:17:06,660][123091] Updated weights for policy 0, policy_version 88256 (0.0009) [2023-12-26 00:17:06,690][123090] Updated weights for policy 1, policy_version 87783 (0.0007) [2023-12-26 00:17:06,757][123090] Updated weights for policy 1, policy_version 87793 (0.0009) [2023-12-26 00:17:06,822][123090] Updated weights for policy 1, policy_version 87803 (0.0007) [2023-12-26 00:17:07,342][123091] Updated weights for policy 0, policy_version 88266 (0.0005) [2023-12-26 00:17:07,398][123091] Updated weights for policy 0, policy_version 88276 (0.0006) [2023-12-26 00:17:07,455][123091] Updated weights for policy 0, policy_version 88286 (0.0006) [2023-12-26 00:17:07,458][123090] Updated weights for policy 1, policy_version 87813 (0.0006) [2023-12-26 00:17:07,521][123090] Updated weights for policy 1, policy_version 87824 (0.0010) [2023-12-26 00:17:07,580][123090] Updated weights for policy 1, policy_version 87834 (0.0010) [2023-12-26 00:17:08,241][123091] Updated weights for policy 0, policy_version 88296 (0.0006) [2023-12-26 00:17:08,312][123091] Updated weights for policy 0, policy_version 88306 (0.0008) [2023-12-26 00:17:08,378][123091] Updated weights for policy 0, policy_version 88316 (0.0008) [2023-12-26 00:17:08,440][123090] Updated weights for policy 1, policy_version 87844 (0.0008) [2023-12-26 00:17:08,487][123090] Updated weights for policy 1, policy_version 87854 (0.0008) [2023-12-26 00:17:08,531][123090] Updated weights for policy 1, policy_version 87864 (0.0008) [2023-12-26 00:17:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 45105152. Throughput: 0: 8876.5, 1: 8761.1. Samples: 45077908. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:08,785][121949] Avg episode reward: [(0, '4542.769'), (1, '5514.114')] [2023-12-26 00:17:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000088320_22609920.pth... [2023-12-26 00:17:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000087872_22495232.pth... [2023-12-26 00:17:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000087296_22347776.pth [2023-12-26 00:17:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000086816_22224896.pth [2023-12-26 00:17:09,140][123091] Updated weights for policy 0, policy_version 88326 (0.0009) [2023-12-26 00:17:09,194][123091] Updated weights for policy 0, policy_version 88336 (0.0010) [2023-12-26 00:17:09,273][123091] Updated weights for policy 0, policy_version 88346 (0.0010) [2023-12-26 00:17:09,362][123090] Updated weights for policy 1, policy_version 87874 (0.0008) [2023-12-26 00:17:09,430][123090] Updated weights for policy 1, policy_version 87884 (0.0008) [2023-12-26 00:17:09,486][123090] Updated weights for policy 1, policy_version 87894 (0.0008) [2023-12-26 00:17:09,551][123090] Updated weights for policy 1, policy_version 87904 (0.0008) [2023-12-26 00:17:10,183][123091] Updated weights for policy 0, policy_version 88356 (0.0010) [2023-12-26 00:17:10,249][123091] Updated weights for policy 0, policy_version 88366 (0.0009) [2023-12-26 00:17:10,313][123091] Updated weights for policy 0, policy_version 88376 (0.0009) [2023-12-26 00:17:10,372][123090] Updated weights for policy 1, policy_version 87914 (0.0010) [2023-12-26 00:17:10,439][123090] Updated weights for policy 1, policy_version 87924 (0.0010) [2023-12-26 00:17:10,511][123090] Updated weights for policy 1, policy_version 87934 (0.0011) [2023-12-26 00:17:11,033][123091] Updated weights for policy 0, policy_version 88386 (0.0007) [2023-12-26 00:17:11,106][123091] Updated weights for policy 0, policy_version 88396 (0.0008) [2023-12-26 00:17:11,176][123091] Updated weights for policy 0, policy_version 88406 (0.0008) [2023-12-26 00:17:11,242][123091] Updated weights for policy 0, policy_version 88416 (0.0009) [2023-12-26 00:17:11,246][123090] Updated weights for policy 1, policy_version 87944 (0.0009) [2023-12-26 00:17:11,312][123090] Updated weights for policy 1, policy_version 87954 (0.0010) [2023-12-26 00:17:11,383][123090] Updated weights for policy 1, policy_version 87964 (0.0009) [2023-12-26 00:17:12,102][123091] Updated weights for policy 0, policy_version 88426 (0.0010) [2023-12-26 00:17:12,167][123091] Updated weights for policy 0, policy_version 88436 (0.0009) [2023-12-26 00:17:12,225][123090] Updated weights for policy 1, policy_version 87974 (0.0009) [2023-12-26 00:17:12,230][123091] Updated weights for policy 0, policy_version 88446 (0.0005) [2023-12-26 00:17:12,288][123090] Updated weights for policy 1, policy_version 87984 (0.0008) [2023-12-26 00:17:12,355][123090] Updated weights for policy 1, policy_version 87994 (0.0009) [2023-12-26 00:17:13,071][123091] Updated weights for policy 0, policy_version 88456 (0.0007) [2023-12-26 00:17:13,114][123090] Updated weights for policy 1, policy_version 88004 (0.0007) [2023-12-26 00:17:13,118][123091] Updated weights for policy 0, policy_version 88466 (0.0008) [2023-12-26 00:17:13,167][123091] Updated weights for policy 0, policy_version 88476 (0.0009) [2023-12-26 00:17:13,175][123090] Updated weights for policy 1, policy_version 88014 (0.0005) [2023-12-26 00:17:13,226][123090] Updated weights for policy 1, policy_version 88024 (0.0010) [2023-12-26 00:17:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 45187072. Throughput: 0: 8798.3, 1: 8780.6. Samples: 45182888. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:13,785][121949] Avg episode reward: [(0, '4653.934'), (1, '5534.040')] [2023-12-26 00:17:13,842][123090] Updated weights for policy 1, policy_version 88034 (0.0009) [2023-12-26 00:17:13,915][123090] Updated weights for policy 1, policy_version 88044 (0.0008) [2023-12-26 00:17:13,978][123090] Updated weights for policy 1, policy_version 88054 (0.0011) [2023-12-26 00:17:14,045][123090] Updated weights for policy 1, policy_version 88064 (0.0011) [2023-12-26 00:17:14,078][123091] Updated weights for policy 0, policy_version 88487 (0.0009) [2023-12-26 00:17:14,139][123091] Updated weights for policy 0, policy_version 88497 (0.0009) [2023-12-26 00:17:14,199][123091] Updated weights for policy 0, policy_version 88507 (0.0009) [2023-12-26 00:17:14,799][123090] Updated weights for policy 1, policy_version 88075 (0.0007) [2023-12-26 00:17:14,861][123090] Updated weights for policy 1, policy_version 88085 (0.0008) [2023-12-26 00:17:14,930][123090] Updated weights for policy 1, policy_version 88095 (0.0008) [2023-12-26 00:17:15,058][123091] Updated weights for policy 0, policy_version 88517 (0.0009) [2023-12-26 00:17:15,126][123091] Updated weights for policy 0, policy_version 88527 (0.0010) [2023-12-26 00:17:15,190][123091] Updated weights for policy 0, policy_version 88537 (0.0009) [2023-12-26 00:17:15,672][123090] Updated weights for policy 1, policy_version 88105 (0.0006) [2023-12-26 00:17:15,726][123090] Updated weights for policy 1, policy_version 88115 (0.0006) [2023-12-26 00:17:15,792][123090] Updated weights for policy 1, policy_version 88125 (0.0008) [2023-12-26 00:17:16,078][123091] Updated weights for policy 0, policy_version 88547 (0.0010) [2023-12-26 00:17:16,137][123091] Updated weights for policy 0, policy_version 88558 (0.0010) [2023-12-26 00:17:16,189][123091] Updated weights for policy 0, policy_version 88569 (0.0008) [2023-12-26 00:17:16,553][123090] Updated weights for policy 1, policy_version 88135 (0.0007) [2023-12-26 00:17:16,626][123090] Updated weights for policy 1, policy_version 88145 (0.0007) [2023-12-26 00:17:16,693][123090] Updated weights for policy 1, policy_version 88155 (0.0010) [2023-12-26 00:17:16,939][123091] Updated weights for policy 0, policy_version 88579 (0.0005) [2023-12-26 00:17:17,012][123091] Updated weights for policy 0, policy_version 88589 (0.0005) [2023-12-26 00:17:17,060][123091] Updated weights for policy 0, policy_version 88599 (0.0005) [2023-12-26 00:17:17,458][123090] Updated weights for policy 1, policy_version 88165 (0.0007) [2023-12-26 00:17:17,512][123090] Updated weights for policy 1, policy_version 88175 (0.0005) [2023-12-26 00:17:17,569][123090] Updated weights for policy 1, policy_version 88185 (0.0005) [2023-12-26 00:17:17,670][123091] Updated weights for policy 0, policy_version 88609 (0.0006) [2023-12-26 00:17:17,731][123091] Updated weights for policy 0, policy_version 88619 (0.0006) [2023-12-26 00:17:17,784][123091] Updated weights for policy 0, policy_version 88629 (0.0005) [2023-12-26 00:17:17,848][123091] Updated weights for policy 0, policy_version 88639 (0.0008) [2023-12-26 00:17:18,178][123090] Updated weights for policy 1, policy_version 88195 (0.0005) [2023-12-26 00:17:18,235][123090] Updated weights for policy 1, policy_version 88205 (0.0005) [2023-12-26 00:17:18,290][123090] Updated weights for policy 1, policy_version 88215 (0.0005) [2023-12-26 00:17:18,515][123091] Updated weights for policy 0, policy_version 88649 (0.0009) [2023-12-26 00:17:18,564][123091] Updated weights for policy 0, policy_version 88659 (0.0008) [2023-12-26 00:17:18,614][123091] Updated weights for policy 0, policy_version 88669 (0.0009) [2023-12-26 00:17:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 45285376. Throughput: 0: 8769.8, 1: 8931.1. Samples: 45293592. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:18,785][121949] Avg episode reward: [(0, '4595.667'), (1, '5539.850')] [2023-12-26 00:17:19,133][123090] Updated weights for policy 1, policy_version 88225 (0.0009) [2023-12-26 00:17:19,196][123090] Updated weights for policy 1, policy_version 88235 (0.0011) [2023-12-26 00:17:19,268][123090] Updated weights for policy 1, policy_version 88245 (0.0011) [2023-12-26 00:17:19,339][123090] Updated weights for policy 1, policy_version 88255 (0.0011) [2023-12-26 00:17:19,487][123091] Updated weights for policy 0, policy_version 88679 (0.0009) [2023-12-26 00:17:19,546][123091] Updated weights for policy 0, policy_version 88689 (0.0009) [2023-12-26 00:17:19,602][123091] Updated weights for policy 0, policy_version 88699 (0.0009) [2023-12-26 00:17:20,189][123090] Updated weights for policy 1, policy_version 88265 (0.0011) [2023-12-26 00:17:20,256][123090] Updated weights for policy 1, policy_version 88275 (0.0010) [2023-12-26 00:17:20,328][123090] Updated weights for policy 1, policy_version 88285 (0.0011) [2023-12-26 00:17:20,458][123091] Updated weights for policy 0, policy_version 88709 (0.0009) [2023-12-26 00:17:20,526][123091] Updated weights for policy 0, policy_version 88719 (0.0010) [2023-12-26 00:17:20,597][123091] Updated weights for policy 0, policy_version 88729 (0.0009) [2023-12-26 00:17:21,067][123090] Updated weights for policy 1, policy_version 88295 (0.0011) [2023-12-26 00:17:21,136][123090] Updated weights for policy 1, policy_version 88305 (0.0010) [2023-12-26 00:17:21,206][123090] Updated weights for policy 1, policy_version 88315 (0.0009) [2023-12-26 00:17:21,374][123091] Updated weights for policy 0, policy_version 88739 (0.0007) [2023-12-26 00:17:21,452][123091] Updated weights for policy 0, policy_version 88749 (0.0009) [2023-12-26 00:17:21,512][123091] Updated weights for policy 0, policy_version 88759 (0.0009) [2023-12-26 00:17:22,066][123090] Updated weights for policy 1, policy_version 88325 (0.0007) [2023-12-26 00:17:22,117][123090] Updated weights for policy 1, policy_version 88335 (0.0009) [2023-12-26 00:17:22,173][123090] Updated weights for policy 1, policy_version 88345 (0.0009) [2023-12-26 00:17:22,384][123091] Updated weights for policy 0, policy_version 88769 (0.0009) [2023-12-26 00:17:22,448][123091] Updated weights for policy 0, policy_version 88779 (0.0010) [2023-12-26 00:17:22,508][123091] Updated weights for policy 0, policy_version 88789 (0.0011) [2023-12-26 00:17:22,564][123091] Updated weights for policy 0, policy_version 88799 (0.0011) [2023-12-26 00:17:23,043][123090] Updated weights for policy 1, policy_version 88355 (0.0009) [2023-12-26 00:17:23,091][123090] Updated weights for policy 1, policy_version 88365 (0.0010) [2023-12-26 00:17:23,140][123090] Updated weights for policy 1, policy_version 88375 (0.0010) [2023-12-26 00:17:23,385][123091] Updated weights for policy 0, policy_version 88809 (0.0010) [2023-12-26 00:17:23,440][123091] Updated weights for policy 0, policy_version 88819 (0.0010) [2023-12-26 00:17:23,487][123091] Updated weights for policy 0, policy_version 88829 (0.0010) [2023-12-26 00:17:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 45367296. Throughput: 0: 8719.8, 1: 8935.2. Samples: 45343732. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:23,784][121949] Avg episode reward: [(0, '4578.046'), (1, '5358.414')] [2023-12-26 00:17:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000088832_22740992.pth... [2023-12-26 00:17:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000088384_22626304.pth... [2023-12-26 00:17:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000087808_22478848.pth [2023-12-26 00:17:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000087328_22355968.pth [2023-12-26 00:17:23,971][123090] Updated weights for policy 1, policy_version 88385 (0.0010) [2023-12-26 00:17:24,020][123090] Updated weights for policy 1, policy_version 88395 (0.0005) [2023-12-26 00:17:24,077][123090] Updated weights for policy 1, policy_version 88405 (0.0005) [2023-12-26 00:17:24,145][123090] Updated weights for policy 1, policy_version 88415 (0.0005) [2023-12-26 00:17:24,316][123091] Updated weights for policy 0, policy_version 88839 (0.0010) [2023-12-26 00:17:24,370][123091] Updated weights for policy 0, policy_version 88849 (0.0010) [2023-12-26 00:17:24,417][123091] Updated weights for policy 0, policy_version 88859 (0.0010) [2023-12-26 00:17:24,818][123090] Updated weights for policy 1, policy_version 88425 (0.0005) [2023-12-26 00:17:24,870][123090] Updated weights for policy 1, policy_version 88435 (0.0008) [2023-12-26 00:17:24,929][123090] Updated weights for policy 1, policy_version 88445 (0.0010) [2023-12-26 00:17:25,256][123091] Updated weights for policy 0, policy_version 88869 (0.0010) [2023-12-26 00:17:25,308][123091] Updated weights for policy 0, policy_version 88879 (0.0009) [2023-12-26 00:17:25,356][123091] Updated weights for policy 0, policy_version 88889 (0.0009) [2023-12-26 00:17:25,754][123090] Updated weights for policy 1, policy_version 88455 (0.0011) [2023-12-26 00:17:25,813][123090] Updated weights for policy 1, policy_version 88465 (0.0010) [2023-12-26 00:17:25,871][123090] Updated weights for policy 1, policy_version 88475 (0.0010) [2023-12-26 00:17:26,204][123091] Updated weights for policy 0, policy_version 88899 (0.0009) [2023-12-26 00:17:26,272][123091] Updated weights for policy 0, policy_version 88909 (0.0005) [2023-12-26 00:17:26,336][123091] Updated weights for policy 0, policy_version 88919 (0.0005) [2023-12-26 00:17:26,690][123090] Updated weights for policy 1, policy_version 88485 (0.0010) [2023-12-26 00:17:26,742][123090] Updated weights for policy 1, policy_version 88495 (0.0010) [2023-12-26 00:17:26,793][123090] Updated weights for policy 1, policy_version 88505 (0.0010) [2023-12-26 00:17:27,007][123091] Updated weights for policy 0, policy_version 88929 (0.0006) [2023-12-26 00:17:27,054][123091] Updated weights for policy 0, policy_version 88939 (0.0010) [2023-12-26 00:17:27,104][123091] Updated weights for policy 0, policy_version 88949 (0.0010) [2023-12-26 00:17:27,152][123091] Updated weights for policy 0, policy_version 88959 (0.0010) [2023-12-26 00:17:27,509][123090] Updated weights for policy 1, policy_version 88515 (0.0008) [2023-12-26 00:17:27,561][123090] Updated weights for policy 1, policy_version 88525 (0.0005) [2023-12-26 00:17:27,608][123090] Updated weights for policy 1, policy_version 88535 (0.0005) [2023-12-26 00:17:27,839][123091] Updated weights for policy 0, policy_version 88969 (0.0006) [2023-12-26 00:17:27,905][123091] Updated weights for policy 0, policy_version 88979 (0.0005) [2023-12-26 00:17:27,981][123091] Updated weights for policy 0, policy_version 88989 (0.0005) [2023-12-26 00:17:28,284][123090] Updated weights for policy 1, policy_version 88545 (0.0006) [2023-12-26 00:17:28,344][123090] Updated weights for policy 1, policy_version 88555 (0.0010) [2023-12-26 00:17:28,415][123090] Updated weights for policy 1, policy_version 88565 (0.0011) [2023-12-26 00:17:28,489][123090] Updated weights for policy 1, policy_version 88575 (0.0010) [2023-12-26 00:17:28,546][123091] Updated weights for policy 0, policy_version 88999 (0.0006) [2023-12-26 00:17:28,607][123091] Updated weights for policy 0, policy_version 89009 (0.0005) [2023-12-26 00:17:28,678][123091] Updated weights for policy 0, policy_version 89019 (0.0005) [2023-12-26 00:17:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 45465600. Throughput: 0: 8761.4, 1: 9064.8. Samples: 45452060. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:28,784][121949] Avg episode reward: [(0, '4500.320'), (1, '5364.661')] [2023-12-26 00:17:29,294][123090] Updated weights for policy 1, policy_version 88585 (0.0010) [2023-12-26 00:17:29,352][123090] Updated weights for policy 1, policy_version 88595 (0.0012) [2023-12-26 00:17:29,415][123090] Updated weights for policy 1, policy_version 88605 (0.0011) [2023-12-26 00:17:29,462][123091] Updated weights for policy 0, policy_version 89029 (0.0008) [2023-12-26 00:17:29,509][123091] Updated weights for policy 0, policy_version 89039 (0.0010) [2023-12-26 00:17:29,568][123091] Updated weights for policy 0, policy_version 89049 (0.0011) [2023-12-26 00:17:30,204][123090] Updated weights for policy 1, policy_version 88615 (0.0010) [2023-12-26 00:17:30,270][123090] Updated weights for policy 1, policy_version 88625 (0.0010) [2023-12-26 00:17:30,322][123090] Updated weights for policy 1, policy_version 88635 (0.0010) [2023-12-26 00:17:30,402][123091] Updated weights for policy 0, policy_version 89059 (0.0010) [2023-12-26 00:17:30,460][123091] Updated weights for policy 0, policy_version 89069 (0.0008) [2023-12-26 00:17:30,526][123091] Updated weights for policy 0, policy_version 89079 (0.0005) [2023-12-26 00:17:31,154][123090] Updated weights for policy 1, policy_version 88645 (0.0010) [2023-12-26 00:17:31,213][123090] Updated weights for policy 1, policy_version 88655 (0.0009) [2023-12-26 00:17:31,238][123091] Updated weights for policy 0, policy_version 89089 (0.0005) [2023-12-26 00:17:31,279][123090] Updated weights for policy 1, policy_version 88665 (0.0008) [2023-12-26 00:17:31,300][123091] Updated weights for policy 0, policy_version 89099 (0.0010) [2023-12-26 00:17:31,372][123091] Updated weights for policy 0, policy_version 89109 (0.0009) [2023-12-26 00:17:31,426][123091] Updated weights for policy 0, policy_version 89119 (0.0009) [2023-12-26 00:17:32,093][123090] Updated weights for policy 1, policy_version 88675 (0.0006) [2023-12-26 00:17:32,152][123090] Updated weights for policy 1, policy_version 88685 (0.0005) [2023-12-26 00:17:32,219][123090] Updated weights for policy 1, policy_version 88695 (0.0005) [2023-12-26 00:17:32,275][123091] Updated weights for policy 0, policy_version 89129 (0.0011) [2023-12-26 00:17:32,339][123091] Updated weights for policy 0, policy_version 89139 (0.0011) [2023-12-26 00:17:32,418][123091] Updated weights for policy 0, policy_version 89149 (0.0011) [2023-12-26 00:17:33,002][123090] Updated weights for policy 1, policy_version 88705 (0.0007) [2023-12-26 00:17:33,067][123090] Updated weights for policy 1, policy_version 88715 (0.0010) [2023-12-26 00:17:33,136][123090] Updated weights for policy 1, policy_version 88725 (0.0010) [2023-12-26 00:17:33,144][123091] Updated weights for policy 0, policy_version 89159 (0.0010) [2023-12-26 00:17:33,198][123091] Updated weights for policy 0, policy_version 89169 (0.0010) [2023-12-26 00:17:33,198][123090] Updated weights for policy 1, policy_version 88735 (0.0010) [2023-12-26 00:17:33,245][123091] Updated weights for policy 0, policy_version 89179 (0.0010) [2023-12-26 00:17:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 45547520. Throughput: 0: 8814.8, 1: 9068.1. Samples: 45561324. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:33,785][121949] Avg episode reward: [(0, '4648.482'), (1, '5443.161')] [2023-12-26 00:17:33,918][123090] Updated weights for policy 1, policy_version 88745 (0.0010) [2023-12-26 00:17:33,960][123091] Updated weights for policy 0, policy_version 89189 (0.0008) [2023-12-26 00:17:33,988][123090] Updated weights for policy 1, policy_version 88755 (0.0010) [2023-12-26 00:17:34,011][123091] Updated weights for policy 0, policy_version 89199 (0.0006) [2023-12-26 00:17:34,042][123090] Updated weights for policy 1, policy_version 88765 (0.0010) [2023-12-26 00:17:34,062][123091] Updated weights for policy 0, policy_version 89209 (0.0005) [2023-12-26 00:17:34,822][123090] Updated weights for policy 1, policy_version 88775 (0.0007) [2023-12-26 00:17:34,875][123091] Updated weights for policy 0, policy_version 89219 (0.0010) [2023-12-26 00:17:34,878][123090] Updated weights for policy 1, policy_version 88785 (0.0005) [2023-12-26 00:17:34,928][123090] Updated weights for policy 1, policy_version 88795 (0.0010) [2023-12-26 00:17:34,933][123091] Updated weights for policy 0, policy_version 89229 (0.0010) [2023-12-26 00:17:34,987][123091] Updated weights for policy 0, policy_version 89239 (0.0010) [2023-12-26 00:17:35,623][123090] Updated weights for policy 1, policy_version 88805 (0.0008) [2023-12-26 00:17:35,685][123090] Updated weights for policy 1, policy_version 88815 (0.0009) [2023-12-26 00:17:35,745][123091] Updated weights for policy 0, policy_version 89249 (0.0008) [2023-12-26 00:17:35,752][123090] Updated weights for policy 1, policy_version 88825 (0.0010) [2023-12-26 00:17:35,817][123091] Updated weights for policy 0, policy_version 89259 (0.0007) [2023-12-26 00:17:35,879][123091] Updated weights for policy 0, policy_version 89269 (0.0008) [2023-12-26 00:17:35,939][123091] Updated weights for policy 0, policy_version 89279 (0.0009) [2023-12-26 00:17:36,558][123090] Updated weights for policy 1, policy_version 88835 (0.0010) [2023-12-26 00:17:36,630][123090] Updated weights for policy 1, policy_version 88845 (0.0009) [2023-12-26 00:17:36,696][123090] Updated weights for policy 1, policy_version 88855 (0.0009) [2023-12-26 00:17:36,806][123091] Updated weights for policy 0, policy_version 89289 (0.0009) [2023-12-26 00:17:36,867][123091] Updated weights for policy 0, policy_version 89299 (0.0009) [2023-12-26 00:17:36,918][123091] Updated weights for policy 0, policy_version 89309 (0.0006) [2023-12-26 00:17:37,526][123090] Updated weights for policy 1, policy_version 88865 (0.0009) [2023-12-26 00:17:37,578][123090] Updated weights for policy 1, policy_version 88875 (0.0009) [2023-12-26 00:17:37,640][123090] Updated weights for policy 1, policy_version 88885 (0.0005) [2023-12-26 00:17:37,701][123090] Updated weights for policy 1, policy_version 88895 (0.0005) [2023-12-26 00:17:37,764][123091] Updated weights for policy 0, policy_version 89319 (0.0008) [2023-12-26 00:17:37,822][123091] Updated weights for policy 0, policy_version 89329 (0.0010) [2023-12-26 00:17:37,876][123091] Updated weights for policy 0, policy_version 89340 (0.0010) [2023-12-26 00:17:38,431][123090] Updated weights for policy 1, policy_version 88905 (0.0010) [2023-12-26 00:17:38,485][123090] Updated weights for policy 1, policy_version 88915 (0.0009) [2023-12-26 00:17:38,553][123090] Updated weights for policy 1, policy_version 88925 (0.0006) [2023-12-26 00:17:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 45637632. Throughput: 0: 8855.2, 1: 9134.2. Samples: 45616448. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:38,785][121949] Avg episode reward: [(0, '4539.294'), (1, '5311.935')] [2023-12-26 00:17:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000088928_22765568.pth... [2023-12-26 00:17:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000087872_22495232.pth [2023-12-26 00:17:38,803][123091] Updated weights for policy 0, policy_version 89351 (0.0010) [2023-12-26 00:17:38,869][123091] Updated weights for policy 0, policy_version 89361 (0.0010) [2023-12-26 00:17:38,943][123091] Updated weights for policy 0, policy_version 89371 (0.0009) [2023-12-26 00:17:38,977][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000089376_22880256.pth... [2023-12-26 00:17:38,981][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000088320_22609920.pth [2023-12-26 00:17:39,118][123090] Updated weights for policy 1, policy_version 88935 (0.0008) [2023-12-26 00:17:39,190][123090] Updated weights for policy 1, policy_version 88945 (0.0007) [2023-12-26 00:17:39,264][123090] Updated weights for policy 1, policy_version 88955 (0.0009) [2023-12-26 00:17:39,836][123091] Updated weights for policy 0, policy_version 89381 (0.0009) [2023-12-26 00:17:39,902][123091] Updated weights for policy 0, policy_version 89391 (0.0010) [2023-12-26 00:17:39,968][123091] Updated weights for policy 0, policy_version 89401 (0.0009) [2023-12-26 00:17:40,011][123090] Updated weights for policy 1, policy_version 88965 (0.0009) [2023-12-26 00:17:40,077][123090] Updated weights for policy 1, policy_version 88975 (0.0008) [2023-12-26 00:17:40,148][123090] Updated weights for policy 1, policy_version 88985 (0.0007) [2023-12-26 00:17:40,731][123091] Updated weights for policy 0, policy_version 89411 (0.0008) [2023-12-26 00:17:40,789][123091] Updated weights for policy 0, policy_version 89421 (0.0010) [2023-12-26 00:17:40,847][123091] Updated weights for policy 0, policy_version 89431 (0.0010) [2023-12-26 00:17:40,857][123090] Updated weights for policy 1, policy_version 88995 (0.0007) [2023-12-26 00:17:40,921][123090] Updated weights for policy 1, policy_version 89005 (0.0005) [2023-12-26 00:17:40,979][123090] Updated weights for policy 1, policy_version 89015 (0.0005) [2023-12-26 00:17:41,701][123091] Updated weights for policy 0, policy_version 89441 (0.0007) [2023-12-26 00:17:41,771][123091] Updated weights for policy 0, policy_version 89451 (0.0009) [2023-12-26 00:17:41,820][123091] Updated weights for policy 0, policy_version 89461 (0.0009) [2023-12-26 00:17:41,875][123090] Updated weights for policy 1, policy_version 89025 (0.0008) [2023-12-26 00:17:41,882][123091] Updated weights for policy 0, policy_version 89471 (0.0009) [2023-12-26 00:17:41,945][123090] Updated weights for policy 1, policy_version 89035 (0.0009) [2023-12-26 00:17:42,007][123090] Updated weights for policy 1, policy_version 89045 (0.0009) [2023-12-26 00:17:42,073][123090] Updated weights for policy 1, policy_version 89055 (0.0009) [2023-12-26 00:17:42,762][123091] Updated weights for policy 0, policy_version 89481 (0.0006) [2023-12-26 00:17:42,821][123091] Updated weights for policy 0, policy_version 89491 (0.0006) [2023-12-26 00:17:42,883][123091] Updated weights for policy 0, policy_version 89501 (0.0006) [2023-12-26 00:17:42,922][123090] Updated weights for policy 1, policy_version 89065 (0.0006) [2023-12-26 00:17:42,990][123090] Updated weights for policy 1, policy_version 89075 (0.0006) [2023-12-26 00:17:43,054][123090] Updated weights for policy 1, policy_version 89085 (0.0010) [2023-12-26 00:17:43,599][123091] Updated weights for policy 0, policy_version 89511 (0.0009) [2023-12-26 00:17:43,662][123091] Updated weights for policy 0, policy_version 89522 (0.0010) [2023-12-26 00:17:43,716][123091] Updated weights for policy 0, policy_version 89532 (0.0009) [2023-12-26 00:17:43,730][123090] Updated weights for policy 1, policy_version 89095 (0.0006) [2023-12-26 00:17:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 45727744. Throughput: 0: 8749.3, 1: 9048.2. Samples: 45719724. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 00:17:43,785][121949] Avg episode reward: [(0, '4556.240'), (1, '5330.957')] [2023-12-26 00:17:43,787][123090] Updated weights for policy 1, policy_version 89105 (0.0005) [2023-12-26 00:17:43,846][123090] Updated weights for policy 1, policy_version 89115 (0.0005) [2023-12-26 00:17:44,534][123091] Updated weights for policy 0, policy_version 89542 (0.0008) [2023-12-26 00:17:44,589][123091] Updated weights for policy 0, policy_version 89552 (0.0010) [2023-12-26 00:17:44,652][123091] Updated weights for policy 0, policy_version 89562 (0.0009) [2023-12-26 00:17:44,659][123090] Updated weights for policy 1, policy_version 89125 (0.0006) [2023-12-26 00:17:44,715][123090] Updated weights for policy 1, policy_version 89135 (0.0005) [2023-12-26 00:17:44,778][123090] Updated weights for policy 1, policy_version 89145 (0.0006) [2023-12-26 00:17:45,451][123091] Updated weights for policy 0, policy_version 89572 (0.0008) [2023-12-26 00:17:45,453][123090] Updated weights for policy 1, policy_version 89155 (0.0007) [2023-12-26 00:17:45,507][123091] Updated weights for policy 0, policy_version 89582 (0.0011) [2023-12-26 00:17:45,514][123090] Updated weights for policy 1, policy_version 89165 (0.0006) [2023-12-26 00:17:45,567][123091] Updated weights for policy 0, policy_version 89592 (0.0011) [2023-12-26 00:17:45,578][123090] Updated weights for policy 1, policy_version 89175 (0.0006) [2023-12-26 00:17:46,389][123091] Updated weights for policy 0, policy_version 89602 (0.0011) [2023-12-26 00:17:46,412][123090] Updated weights for policy 1, policy_version 89185 (0.0009) [2023-12-26 00:17:46,456][123091] Updated weights for policy 0, policy_version 89612 (0.0011) [2023-12-26 00:17:46,464][123090] Updated weights for policy 1, policy_version 89195 (0.0010) [2023-12-26 00:17:46,516][123090] Updated weights for policy 1, policy_version 89205 (0.0010) [2023-12-26 00:17:46,523][123091] Updated weights for policy 0, policy_version 89622 (0.0010) [2023-12-26 00:17:46,578][123091] Updated weights for policy 0, policy_version 89632 (0.0008) [2023-12-26 00:17:46,580][123090] Updated weights for policy 1, policy_version 89215 (0.0010) [2023-12-26 00:17:47,280][123091] Updated weights for policy 0, policy_version 89642 (0.0006) [2023-12-26 00:17:47,345][123091] Updated weights for policy 0, policy_version 89652 (0.0006) [2023-12-26 00:17:47,412][123091] Updated weights for policy 0, policy_version 89662 (0.0006) [2023-12-26 00:17:47,422][123090] Updated weights for policy 1, policy_version 89225 (0.0011) [2023-12-26 00:17:47,477][123090] Updated weights for policy 1, policy_version 89235 (0.0010) [2023-12-26 00:17:47,532][123090] Updated weights for policy 1, policy_version 89245 (0.0010) [2023-12-26 00:17:48,152][123091] Updated weights for policy 0, policy_version 89672 (0.0006) [2023-12-26 00:17:48,198][123091] Updated weights for policy 0, policy_version 89682 (0.0005) [2023-12-26 00:17:48,252][123091] Updated weights for policy 0, policy_version 89692 (0.0009) [2023-12-26 00:17:48,381][123090] Updated weights for policy 1, policy_version 89255 (0.0011) [2023-12-26 00:17:48,435][123090] Updated weights for policy 1, policy_version 89266 (0.0010) [2023-12-26 00:17:48,483][123090] Updated weights for policy 1, policy_version 89276 (0.0010) [2023-12-26 00:17:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 45817856. Throughput: 0: 8797.0, 1: 9071.9. Samples: 45828116. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:17:48,784][121949] Avg episode reward: [(0, '4558.628'), (1, '5464.994')] [2023-12-26 00:17:49,045][123091] Updated weights for policy 0, policy_version 89702 (0.0009) [2023-12-26 00:17:49,094][123091] Updated weights for policy 0, policy_version 89712 (0.0007) [2023-12-26 00:17:49,156][123091] Updated weights for policy 0, policy_version 89722 (0.0007) [2023-12-26 00:17:49,332][123090] Updated weights for policy 1, policy_version 89286 (0.0011) [2023-12-26 00:17:49,402][123090] Updated weights for policy 1, policy_version 89296 (0.0009) [2023-12-26 00:17:49,465][123090] Updated weights for policy 1, policy_version 89306 (0.0006) [2023-12-26 00:17:50,015][123091] Updated weights for policy 0, policy_version 89732 (0.0009) [2023-12-26 00:17:50,087][123091] Updated weights for policy 0, policy_version 89742 (0.0009) [2023-12-26 00:17:50,144][123090] Updated weights for policy 1, policy_version 89316 (0.0005) [2023-12-26 00:17:50,148][123091] Updated weights for policy 0, policy_version 89752 (0.0009) [2023-12-26 00:17:50,203][123090] Updated weights for policy 1, policy_version 89326 (0.0007) [2023-12-26 00:17:50,266][123090] Updated weights for policy 1, policy_version 89336 (0.0007) [2023-12-26 00:17:50,989][123091] Updated weights for policy 0, policy_version 89762 (0.0008) [2023-12-26 00:17:51,060][123091] Updated weights for policy 0, policy_version 89772 (0.0010) [2023-12-26 00:17:51,074][123090] Updated weights for policy 1, policy_version 89346 (0.0008) [2023-12-26 00:17:51,113][123091] Updated weights for policy 0, policy_version 89782 (0.0009) [2023-12-26 00:17:51,142][123090] Updated weights for policy 1, policy_version 89356 (0.0008) [2023-12-26 00:17:51,180][123091] Updated weights for policy 0, policy_version 89792 (0.0007) [2023-12-26 00:17:51,198][123090] Updated weights for policy 1, policy_version 89366 (0.0008) [2023-12-26 00:17:51,256][123090] Updated weights for policy 1, policy_version 89376 (0.0008) [2023-12-26 00:17:52,066][123090] Updated weights for policy 1, policy_version 89386 (0.0009) [2023-12-26 00:17:52,072][123091] Updated weights for policy 0, policy_version 89802 (0.0008) [2023-12-26 00:17:52,129][123090] Updated weights for policy 1, policy_version 89396 (0.0008) [2023-12-26 00:17:52,142][123091] Updated weights for policy 0, policy_version 89812 (0.0009) [2023-12-26 00:17:52,189][123090] Updated weights for policy 1, policy_version 89406 (0.0009) [2023-12-26 00:17:52,212][123091] Updated weights for policy 0, policy_version 89822 (0.0008) [2023-12-26 00:17:52,926][123090] Updated weights for policy 1, policy_version 89416 (0.0007) [2023-12-26 00:17:52,988][123090] Updated weights for policy 1, policy_version 89426 (0.0006) [2023-12-26 00:17:53,054][123090] Updated weights for policy 1, policy_version 89436 (0.0006) [2023-12-26 00:17:53,105][123091] Updated weights for policy 0, policy_version 89832 (0.0009) [2023-12-26 00:17:53,164][123091] Updated weights for policy 0, policy_version 89842 (0.0009) [2023-12-26 00:17:53,220][123091] Updated weights for policy 0, policy_version 89852 (0.0009) [2023-12-26 00:17:53,762][123090] Updated weights for policy 1, policy_version 89446 (0.0006) [2023-12-26 00:17:53,785][121949] Fps is (10 sec: 17202.4, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 45899776. Throughput: 0: 8799.1, 1: 9040.6. Samples: 45880704. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:17:53,786][121949] Avg episode reward: [(0, '4629.466'), (1, '5466.178')] [2023-12-26 00:17:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000089856_23003136.pth... [2023-12-26 00:17:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000088832_22740992.pth [2023-12-26 00:17:53,814][123090] Updated weights for policy 1, policy_version 89456 (0.0007) [2023-12-26 00:17:53,884][123090] Updated weights for policy 1, policy_version 89466 (0.0010) [2023-12-26 00:17:53,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000089472_22904832.pth... [2023-12-26 00:17:53,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000088384_22626304.pth [2023-12-26 00:17:54,042][123091] Updated weights for policy 0, policy_version 89862 (0.0007) [2023-12-26 00:17:54,101][123091] Updated weights for policy 0, policy_version 89872 (0.0006) [2023-12-26 00:17:54,167][123091] Updated weights for policy 0, policy_version 89882 (0.0008) [2023-12-26 00:17:54,640][123090] Updated weights for policy 1, policy_version 89477 (0.0008) [2023-12-26 00:17:54,701][123090] Updated weights for policy 1, policy_version 89487 (0.0005) [2023-12-26 00:17:54,771][123090] Updated weights for policy 1, policy_version 89497 (0.0005) [2023-12-26 00:17:54,989][123091] Updated weights for policy 0, policy_version 89893 (0.0010) [2023-12-26 00:17:55,043][123091] Updated weights for policy 0, policy_version 89903 (0.0010) [2023-12-26 00:17:55,093][123091] Updated weights for policy 0, policy_version 89913 (0.0009) [2023-12-26 00:17:55,375][123090] Updated weights for policy 1, policy_version 89507 (0.0005) [2023-12-26 00:17:55,442][123090] Updated weights for policy 1, policy_version 89517 (0.0005) [2023-12-26 00:17:55,503][123090] Updated weights for policy 1, policy_version 89527 (0.0005) [2023-12-26 00:17:55,999][123091] Updated weights for policy 0, policy_version 89923 (0.0009) [2023-12-26 00:17:56,052][123091] Updated weights for policy 0, policy_version 89933 (0.0009) [2023-12-26 00:17:56,115][123091] Updated weights for policy 0, policy_version 89943 (0.0010) [2023-12-26 00:17:56,231][123090] Updated weights for policy 1, policy_version 89537 (0.0005) [2023-12-26 00:17:56,291][123090] Updated weights for policy 1, policy_version 89547 (0.0005) [2023-12-26 00:17:56,346][123090] Updated weights for policy 1, policy_version 89557 (0.0005) [2023-12-26 00:17:56,394][123090] Updated weights for policy 1, policy_version 89567 (0.0005) [2023-12-26 00:17:56,853][123091] Updated weights for policy 0, policy_version 89953 (0.0010) [2023-12-26 00:17:56,906][123091] Updated weights for policy 0, policy_version 89963 (0.0009) [2023-12-26 00:17:56,961][123091] Updated weights for policy 0, policy_version 89973 (0.0010) [2023-12-26 00:17:57,013][123091] Updated weights for policy 0, policy_version 89983 (0.0010) [2023-12-26 00:17:57,075][123090] Updated weights for policy 1, policy_version 89577 (0.0009) [2023-12-26 00:17:57,145][123090] Updated weights for policy 1, policy_version 89587 (0.0010) [2023-12-26 00:17:57,203][123090] Updated weights for policy 1, policy_version 89597 (0.0010) [2023-12-26 00:17:57,673][123091] Updated weights for policy 0, policy_version 89993 (0.0005) [2023-12-26 00:17:57,731][123091] Updated weights for policy 0, policy_version 90003 (0.0005) [2023-12-26 00:17:57,795][123091] Updated weights for policy 0, policy_version 90013 (0.0008) [2023-12-26 00:17:57,957][123090] Updated weights for policy 1, policy_version 89607 (0.0010) [2023-12-26 00:17:58,019][123090] Updated weights for policy 1, policy_version 89617 (0.0010) [2023-12-26 00:17:58,082][123090] Updated weights for policy 1, policy_version 89627 (0.0011) [2023-12-26 00:17:58,587][123091] Updated weights for policy 0, policy_version 90023 (0.0010) [2023-12-26 00:17:58,652][123091] Updated weights for policy 0, policy_version 90033 (0.0008) [2023-12-26 00:17:58,726][123091] Updated weights for policy 0, policy_version 90043 (0.0009) [2023-12-26 00:17:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 45998080. Throughput: 0: 8799.7, 1: 9156.9. Samples: 45990936. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:17:58,785][121949] Avg episode reward: [(0, '4597.774'), (1, '5527.264')] [2023-12-26 00:17:59,019][123090] Updated weights for policy 1, policy_version 89637 (0.0010) [2023-12-26 00:17:59,091][123090] Updated weights for policy 1, policy_version 89647 (0.0010) [2023-12-26 00:17:59,160][123090] Updated weights for policy 1, policy_version 89657 (0.0009) [2023-12-26 00:17:59,572][123091] Updated weights for policy 0, policy_version 90053 (0.0009) [2023-12-26 00:17:59,620][123091] Updated weights for policy 0, policy_version 90063 (0.0010) [2023-12-26 00:17:59,668][123091] Updated weights for policy 0, policy_version 90073 (0.0011) [2023-12-26 00:18:00,022][123090] Updated weights for policy 1, policy_version 89667 (0.0009) [2023-12-26 00:18:00,092][123090] Updated weights for policy 1, policy_version 89677 (0.0007) [2023-12-26 00:18:00,155][123090] Updated weights for policy 1, policy_version 89687 (0.0008) [2023-12-26 00:18:00,496][123091] Updated weights for policy 0, policy_version 90083 (0.0010) [2023-12-26 00:18:00,566][123091] Updated weights for policy 0, policy_version 90093 (0.0005) [2023-12-26 00:18:00,625][123091] Updated weights for policy 0, policy_version 90103 (0.0005) [2023-12-26 00:18:00,872][123090] Updated weights for policy 1, policy_version 89697 (0.0006) [2023-12-26 00:18:00,929][123090] Updated weights for policy 1, policy_version 89707 (0.0007) [2023-12-26 00:18:00,980][123090] Updated weights for policy 1, policy_version 89717 (0.0005) [2023-12-26 00:18:01,038][123090] Updated weights for policy 1, policy_version 89727 (0.0007) [2023-12-26 00:18:01,399][123091] Updated weights for policy 0, policy_version 90113 (0.0009) [2023-12-26 00:18:01,467][123091] Updated weights for policy 0, policy_version 90123 (0.0008) [2023-12-26 00:18:01,533][123091] Updated weights for policy 0, policy_version 90133 (0.0006) [2023-12-26 00:18:01,594][123091] Updated weights for policy 0, policy_version 90143 (0.0005) [2023-12-26 00:18:01,818][123090] Updated weights for policy 1, policy_version 89737 (0.0006) [2023-12-26 00:18:01,892][123090] Updated weights for policy 1, policy_version 89747 (0.0005) [2023-12-26 00:18:01,959][123090] Updated weights for policy 1, policy_version 89757 (0.0006) [2023-12-26 00:18:02,357][123091] Updated weights for policy 0, policy_version 90153 (0.0008) [2023-12-26 00:18:02,411][123091] Updated weights for policy 0, policy_version 90163 (0.0009) [2023-12-26 00:18:02,460][123091] Updated weights for policy 0, policy_version 90173 (0.0009) [2023-12-26 00:18:02,660][123090] Updated weights for policy 1, policy_version 89767 (0.0008) [2023-12-26 00:18:02,718][123090] Updated weights for policy 1, policy_version 89777 (0.0009) [2023-12-26 00:18:02,780][123090] Updated weights for policy 1, policy_version 89787 (0.0006) [2023-12-26 00:18:03,353][123091] Updated weights for policy 0, policy_version 90183 (0.0009) [2023-12-26 00:18:03,404][123091] Updated weights for policy 0, policy_version 90193 (0.0009) [2023-12-26 00:18:03,461][123091] Updated weights for policy 0, policy_version 90203 (0.0009) [2023-12-26 00:18:03,516][123090] Updated weights for policy 1, policy_version 89797 (0.0007) [2023-12-26 00:18:03,569][123090] Updated weights for policy 1, policy_version 89807 (0.0009) [2023-12-26 00:18:03,626][123090] Updated weights for policy 1, policy_version 89818 (0.0010) [2023-12-26 00:18:03,784][121949] Fps is (10 sec: 18842.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 46088192. Throughput: 0: 8760.9, 1: 9051.2. Samples: 46095136. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:03,785][121949] Avg episode reward: [(0, '4461.090'), (1, '5502.729')] [2023-12-26 00:18:04,254][123091] Updated weights for policy 0, policy_version 90213 (0.0010) [2023-12-26 00:18:04,316][123091] Updated weights for policy 0, policy_version 90223 (0.0010) [2023-12-26 00:18:04,381][123091] Updated weights for policy 0, policy_version 90233 (0.0009) [2023-12-26 00:18:04,491][123090] Updated weights for policy 1, policy_version 89828 (0.0009) [2023-12-26 00:18:04,547][123090] Updated weights for policy 1, policy_version 89838 (0.0009) [2023-12-26 00:18:04,601][123090] Updated weights for policy 1, policy_version 89848 (0.0009) [2023-12-26 00:18:05,186][123091] Updated weights for policy 0, policy_version 90243 (0.0008) [2023-12-26 00:18:05,237][123091] Updated weights for policy 0, policy_version 90253 (0.0005) [2023-12-26 00:18:05,299][123091] Updated weights for policy 0, policy_version 90263 (0.0005) [2023-12-26 00:18:05,429][123090] Updated weights for policy 1, policy_version 89858 (0.0008) [2023-12-26 00:18:05,478][123090] Updated weights for policy 1, policy_version 89868 (0.0005) [2023-12-26 00:18:05,532][123090] Updated weights for policy 1, policy_version 89878 (0.0005) [2023-12-26 00:18:05,585][123090] Updated weights for policy 1, policy_version 89888 (0.0005) [2023-12-26 00:18:05,948][123091] Updated weights for policy 0, policy_version 90273 (0.0006) [2023-12-26 00:18:06,006][123091] Updated weights for policy 0, policy_version 90283 (0.0010) [2023-12-26 00:18:06,060][123091] Updated weights for policy 0, policy_version 90293 (0.0010) [2023-12-26 00:18:06,118][123091] Updated weights for policy 0, policy_version 90304 (0.0010) [2023-12-26 00:18:06,246][123090] Updated weights for policy 1, policy_version 89898 (0.0007) [2023-12-26 00:18:06,307][123090] Updated weights for policy 1, policy_version 89908 (0.0008) [2023-12-26 00:18:06,372][123090] Updated weights for policy 1, policy_version 89918 (0.0009) [2023-12-26 00:18:07,021][123091] Updated weights for policy 0, policy_version 90314 (0.0008) [2023-12-26 00:18:07,084][123091] Updated weights for policy 0, policy_version 90324 (0.0006) [2023-12-26 00:18:07,153][123091] Updated weights for policy 0, policy_version 90334 (0.0007) [2023-12-26 00:18:07,216][123090] Updated weights for policy 1, policy_version 89928 (0.0009) [2023-12-26 00:18:07,289][123090] Updated weights for policy 1, policy_version 89938 (0.0009) [2023-12-26 00:18:07,350][123090] Updated weights for policy 1, policy_version 89948 (0.0009) [2023-12-26 00:18:07,832][123091] Updated weights for policy 0, policy_version 90344 (0.0006) [2023-12-26 00:18:07,891][123091] Updated weights for policy 0, policy_version 90354 (0.0006) [2023-12-26 00:18:07,950][123091] Updated weights for policy 0, policy_version 90364 (0.0008) [2023-12-26 00:18:08,238][123090] Updated weights for policy 1, policy_version 89958 (0.0009) [2023-12-26 00:18:08,286][123090] Updated weights for policy 1, policy_version 89968 (0.0008) [2023-12-26 00:18:08,348][123090] Updated weights for policy 1, policy_version 89978 (0.0009) [2023-12-26 00:18:08,666][123091] Updated weights for policy 0, policy_version 90374 (0.0009) [2023-12-26 00:18:08,729][123091] Updated weights for policy 0, policy_version 90384 (0.0011) [2023-12-26 00:18:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 46170112. Throughput: 0: 8816.9, 1: 9101.2. Samples: 46150044. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:08,785][121949] Avg episode reward: [(0, '4325.461'), (1, '5533.261')] [2023-12-26 00:18:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000089984_23035904.pth... [2023-12-26 00:18:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000088928_22765568.pth [2023-12-26 00:18:08,799][123091] Updated weights for policy 0, policy_version 90395 (0.0009) [2023-12-26 00:18:08,832][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000090400_23142400.pth... [2023-12-26 00:18:08,835][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000089376_22880256.pth [2023-12-26 00:18:09,219][123090] Updated weights for policy 1, policy_version 89988 (0.0009) [2023-12-26 00:18:09,280][123090] Updated weights for policy 1, policy_version 89998 (0.0009) [2023-12-26 00:18:09,340][123090] Updated weights for policy 1, policy_version 90008 (0.0009) [2023-12-26 00:18:09,671][123091] Updated weights for policy 0, policy_version 90405 (0.0009) [2023-12-26 00:18:09,734][123091] Updated weights for policy 0, policy_version 90415 (0.0010) [2023-12-26 00:18:09,799][123091] Updated weights for policy 0, policy_version 90425 (0.0009) [2023-12-26 00:18:10,195][123090] Updated weights for policy 1, policy_version 90018 (0.0009) [2023-12-26 00:18:10,249][123090] Updated weights for policy 1, policy_version 90028 (0.0009) [2023-12-26 00:18:10,298][123090] Updated weights for policy 1, policy_version 90038 (0.0009) [2023-12-26 00:18:10,346][123090] Updated weights for policy 1, policy_version 90048 (0.0009) [2023-12-26 00:18:10,623][123091] Updated weights for policy 0, policy_version 90435 (0.0010) [2023-12-26 00:18:10,680][123091] Updated weights for policy 0, policy_version 90445 (0.0010) [2023-12-26 00:18:10,745][123091] Updated weights for policy 0, policy_version 90455 (0.0009) [2023-12-26 00:18:11,180][123090] Updated weights for policy 1, policy_version 90058 (0.0009) [2023-12-26 00:18:11,245][123090] Updated weights for policy 1, policy_version 90068 (0.0007) [2023-12-26 00:18:11,311][123090] Updated weights for policy 1, policy_version 90078 (0.0009) [2023-12-26 00:18:11,587][123091] Updated weights for policy 0, policy_version 90465 (0.0009) [2023-12-26 00:18:11,651][123091] Updated weights for policy 0, policy_version 90475 (0.0008) [2023-12-26 00:18:11,728][123091] Updated weights for policy 0, policy_version 90485 (0.0010) [2023-12-26 00:18:11,796][123091] Updated weights for policy 0, policy_version 90495 (0.0009) [2023-12-26 00:18:12,114][123090] Updated weights for policy 1, policy_version 90088 (0.0010) [2023-12-26 00:18:12,178][123090] Updated weights for policy 1, policy_version 90098 (0.0009) [2023-12-26 00:18:12,236][123090] Updated weights for policy 1, policy_version 90108 (0.0008) [2023-12-26 00:18:12,633][123091] Updated weights for policy 0, policy_version 90505 (0.0009) [2023-12-26 00:18:12,704][123091] Updated weights for policy 0, policy_version 90515 (0.0009) [2023-12-26 00:18:12,765][123091] Updated weights for policy 0, policy_version 90525 (0.0010) [2023-12-26 00:18:13,080][123090] Updated weights for policy 1, policy_version 90118 (0.0009) [2023-12-26 00:18:13,141][123090] Updated weights for policy 1, policy_version 90128 (0.0009) [2023-12-26 00:18:13,204][123090] Updated weights for policy 1, policy_version 90138 (0.0010) [2023-12-26 00:18:13,614][123091] Updated weights for policy 0, policy_version 90535 (0.0010) [2023-12-26 00:18:13,671][123091] Updated weights for policy 0, policy_version 90545 (0.0009) [2023-12-26 00:18:13,723][123091] Updated weights for policy 0, policy_version 90555 (0.0008) [2023-12-26 00:18:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 46260224. Throughput: 0: 8781.8, 1: 8980.3. Samples: 46251360. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:13,785][121949] Avg episode reward: [(0, '4359.928'), (1, '5561.134')] [2023-12-26 00:18:13,977][123090] Updated weights for policy 1, policy_version 90148 (0.0011) [2023-12-26 00:18:14,025][123090] Updated weights for policy 1, policy_version 90158 (0.0010) [2023-12-26 00:18:14,083][123090] Updated weights for policy 1, policy_version 90168 (0.0010) [2023-12-26 00:18:14,548][123091] Updated weights for policy 0, policy_version 90565 (0.0007) [2023-12-26 00:18:14,605][123091] Updated weights for policy 0, policy_version 90575 (0.0009) [2023-12-26 00:18:14,657][123091] Updated weights for policy 0, policy_version 90585 (0.0010) [2023-12-26 00:18:14,914][123090] Updated weights for policy 1, policy_version 90178 (0.0010) [2023-12-26 00:18:14,984][123090] Updated weights for policy 1, policy_version 90188 (0.0008) [2023-12-26 00:18:15,049][123090] Updated weights for policy 1, policy_version 90198 (0.0009) [2023-12-26 00:18:15,118][123090] Updated weights for policy 1, policy_version 90208 (0.0010) [2023-12-26 00:18:15,520][123091] Updated weights for policy 0, policy_version 90597 (0.0010) [2023-12-26 00:18:15,581][123091] Updated weights for policy 0, policy_version 90607 (0.0009) [2023-12-26 00:18:15,641][123091] Updated weights for policy 0, policy_version 90618 (0.0010) [2023-12-26 00:18:15,911][123090] Updated weights for policy 1, policy_version 90218 (0.0005) [2023-12-26 00:18:15,960][123090] Updated weights for policy 1, policy_version 90228 (0.0005) [2023-12-26 00:18:16,008][123090] Updated weights for policy 1, policy_version 90238 (0.0005) [2023-12-26 00:18:16,535][123091] Updated weights for policy 0, policy_version 90629 (0.0010) [2023-12-26 00:18:16,587][123091] Updated weights for policy 0, policy_version 90639 (0.0009) [2023-12-26 00:18:16,641][123091] Updated weights for policy 0, policy_version 90649 (0.0009) [2023-12-26 00:18:16,813][123090] Updated weights for policy 1, policy_version 90248 (0.0009) [2023-12-26 00:18:16,873][123090] Updated weights for policy 1, policy_version 90258 (0.0010) [2023-12-26 00:18:16,931][123090] Updated weights for policy 1, policy_version 90268 (0.0009) [2023-12-26 00:18:17,491][123091] Updated weights for policy 0, policy_version 90659 (0.0008) [2023-12-26 00:18:17,551][123091] Updated weights for policy 0, policy_version 90669 (0.0010) [2023-12-26 00:18:17,609][123091] Updated weights for policy 0, policy_version 90679 (0.0009) [2023-12-26 00:18:17,770][123090] Updated weights for policy 1, policy_version 90278 (0.0009) [2023-12-26 00:18:17,816][123090] Updated weights for policy 1, policy_version 90288 (0.0008) [2023-12-26 00:18:17,883][123090] Updated weights for policy 1, policy_version 90298 (0.0010) [2023-12-26 00:18:18,483][123091] Updated weights for policy 0, policy_version 90689 (0.0009) [2023-12-26 00:18:18,543][123091] Updated weights for policy 0, policy_version 90699 (0.0009) [2023-12-26 00:18:18,608][123091] Updated weights for policy 0, policy_version 90709 (0.0009) [2023-12-26 00:18:18,673][123091] Updated weights for policy 0, policy_version 90719 (0.0007) [2023-12-26 00:18:18,717][123090] Updated weights for policy 1, policy_version 90308 (0.0009) [2023-12-26 00:18:18,779][123090] Updated weights for policy 1, policy_version 90318 (0.0008) [2023-12-26 00:18:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 46342144. Throughput: 0: 8660.2, 1: 8959.8. Samples: 46354224. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:18,785][121949] Avg episode reward: [(0, '4425.163'), (1, '5505.058')] [2023-12-26 00:18:18,832][123090] Updated weights for policy 1, policy_version 90328 (0.0008) [2023-12-26 00:18:19,569][123091] Updated weights for policy 0, policy_version 90729 (0.0009) [2023-12-26 00:18:19,584][123090] Updated weights for policy 1, policy_version 90338 (0.0008) [2023-12-26 00:18:19,639][123091] Updated weights for policy 0, policy_version 90739 (0.0009) [2023-12-26 00:18:19,650][123090] Updated weights for policy 1, policy_version 90348 (0.0008) [2023-12-26 00:18:19,702][123091] Updated weights for policy 0, policy_version 90749 (0.0009) [2023-12-26 00:18:19,717][123090] Updated weights for policy 1, policy_version 90358 (0.0006) [2023-12-26 00:18:19,788][123090] Updated weights for policy 1, policy_version 90368 (0.0005) [2023-12-26 00:18:20,538][123090] Updated weights for policy 1, policy_version 90378 (0.0008) [2023-12-26 00:18:20,574][123091] Updated weights for policy 0, policy_version 90759 (0.0009) [2023-12-26 00:18:20,608][123090] Updated weights for policy 1, policy_version 90388 (0.0008) [2023-12-26 00:18:20,636][123091] Updated weights for policy 0, policy_version 90769 (0.0008) [2023-12-26 00:18:20,676][123090] Updated weights for policy 1, policy_version 90398 (0.0007) [2023-12-26 00:18:20,700][123091] Updated weights for policy 0, policy_version 90779 (0.0009) [2023-12-26 00:18:21,416][123090] Updated weights for policy 1, policy_version 90408 (0.0010) [2023-12-26 00:18:21,471][123090] Updated weights for policy 1, policy_version 90418 (0.0010) [2023-12-26 00:18:21,529][123090] Updated weights for policy 1, policy_version 90428 (0.0010) [2023-12-26 00:18:21,604][123091] Updated weights for policy 0, policy_version 90789 (0.0010) [2023-12-26 00:18:21,678][123091] Updated weights for policy 0, policy_version 90799 (0.0009) [2023-12-26 00:18:21,748][123091] Updated weights for policy 0, policy_version 90809 (0.0010) [2023-12-26 00:18:22,416][123090] Updated weights for policy 1, policy_version 90438 (0.0010) [2023-12-26 00:18:22,492][123090] Updated weights for policy 1, policy_version 90448 (0.0009) [2023-12-26 00:18:22,566][123090] Updated weights for policy 1, policy_version 90458 (0.0009) [2023-12-26 00:18:22,603][123091] Updated weights for policy 0, policy_version 90819 (0.0009) [2023-12-26 00:18:22,671][123091] Updated weights for policy 0, policy_version 90829 (0.0006) [2023-12-26 00:18:22,741][123091] Updated weights for policy 0, policy_version 90839 (0.0010) [2023-12-26 00:18:23,395][123090] Updated weights for policy 1, policy_version 90468 (0.0010) [2023-12-26 00:18:23,456][123090] Updated weights for policy 1, policy_version 90478 (0.0007) [2023-12-26 00:18:23,528][123090] Updated weights for policy 1, policy_version 90488 (0.0009) [2023-12-26 00:18:23,540][123091] Updated weights for policy 0, policy_version 90849 (0.0010) [2023-12-26 00:18:23,607][123091] Updated weights for policy 0, policy_version 90859 (0.0007) [2023-12-26 00:18:23,681][123091] Updated weights for policy 0, policy_version 90869 (0.0005) [2023-12-26 00:18:23,753][123091] Updated weights for policy 0, policy_version 90879 (0.0010) [2023-12-26 00:18:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 46432256. Throughput: 0: 8591.4, 1: 8928.8. Samples: 46404860. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:23,785][121949] Avg episode reward: [(0, '4419.751'), (1, '5538.604')] [2023-12-26 00:18:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000090880_23265280.pth... [2023-12-26 00:18:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000090496_23166976.pth... [2023-12-26 00:18:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000089856_23003136.pth [2023-12-26 00:18:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000089472_22904832.pth [2023-12-26 00:18:24,387][123090] Updated weights for policy 1, policy_version 90498 (0.0009) [2023-12-26 00:18:24,441][123090] Updated weights for policy 1, policy_version 90508 (0.0009) [2023-12-26 00:18:24,485][123091] Updated weights for policy 0, policy_version 90889 (0.0008) [2023-12-26 00:18:24,487][123090] Updated weights for policy 1, policy_version 90518 (0.0008) [2023-12-26 00:18:24,531][123091] Updated weights for policy 0, policy_version 90899 (0.0006) [2023-12-26 00:18:24,534][123090] Updated weights for policy 1, policy_version 90528 (0.0007) [2023-12-26 00:18:24,595][123091] Updated weights for policy 0, policy_version 90909 (0.0010) [2023-12-26 00:18:25,365][123091] Updated weights for policy 0, policy_version 90919 (0.0009) [2023-12-26 00:18:25,376][123090] Updated weights for policy 1, policy_version 90538 (0.0008) [2023-12-26 00:18:25,426][123091] Updated weights for policy 0, policy_version 90929 (0.0007) [2023-12-26 00:18:25,428][123090] Updated weights for policy 1, policy_version 90548 (0.0008) [2023-12-26 00:18:25,480][123091] Updated weights for policy 0, policy_version 90939 (0.0006) [2023-12-26 00:18:25,487][123090] Updated weights for policy 1, policy_version 90558 (0.0010) [2023-12-26 00:18:26,122][123091] Updated weights for policy 0, policy_version 90949 (0.0005) [2023-12-26 00:18:26,173][123091] Updated weights for policy 0, policy_version 90959 (0.0006) [2023-12-26 00:18:26,240][123091] Updated weights for policy 0, policy_version 90969 (0.0008) [2023-12-26 00:18:26,404][123090] Updated weights for policy 1, policy_version 90568 (0.0009) [2023-12-26 00:18:26,457][123090] Updated weights for policy 1, policy_version 90578 (0.0010) [2023-12-26 00:18:26,512][123090] Updated weights for policy 1, policy_version 90588 (0.0011) [2023-12-26 00:18:26,912][123091] Updated weights for policy 0, policy_version 90979 (0.0007) [2023-12-26 00:18:26,964][123091] Updated weights for policy 0, policy_version 90989 (0.0005) [2023-12-26 00:18:27,016][123091] Updated weights for policy 0, policy_version 90999 (0.0005) [2023-12-26 00:18:27,468][123090] Updated weights for policy 1, policy_version 90598 (0.0010) [2023-12-26 00:18:27,525][123090] Updated weights for policy 1, policy_version 90609 (0.0010) [2023-12-26 00:18:27,577][123090] Updated weights for policy 1, policy_version 90619 (0.0009) [2023-12-26 00:18:27,649][123091] Updated weights for policy 0, policy_version 91009 (0.0005) [2023-12-26 00:18:27,699][123091] Updated weights for policy 0, policy_version 91019 (0.0006) [2023-12-26 00:18:27,759][123091] Updated weights for policy 0, policy_version 91029 (0.0006) [2023-12-26 00:18:27,827][123091] Updated weights for policy 0, policy_version 91039 (0.0005) [2023-12-26 00:18:28,376][123090] Updated weights for policy 1, policy_version 90630 (0.0009) [2023-12-26 00:18:28,430][123090] Updated weights for policy 1, policy_version 90640 (0.0010) [2023-12-26 00:18:28,484][123090] Updated weights for policy 1, policy_version 90650 (0.0009) [2023-12-26 00:18:28,494][123091] Updated weights for policy 0, policy_version 91049 (0.0006) [2023-12-26 00:18:28,558][123091] Updated weights for policy 0, policy_version 91059 (0.0006) [2023-12-26 00:18:28,625][123091] Updated weights for policy 0, policy_version 91069 (0.0005) [2023-12-26 00:18:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 46522368. Throughput: 0: 8756.0, 1: 8809.7. Samples: 46510180. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:28,785][121949] Avg episode reward: [(0, '4540.888'), (1, '5635.528')] [2023-12-26 00:18:28,785][123008] Saving new best policy, reward=5635.528! [2023-12-26 00:18:29,289][123091] Updated weights for policy 0, policy_version 91079 (0.0009) [2023-12-26 00:18:29,355][123091] Updated weights for policy 0, policy_version 91089 (0.0007) [2023-12-26 00:18:29,414][123091] Updated weights for policy 0, policy_version 91099 (0.0008) [2023-12-26 00:18:29,415][123090] Updated weights for policy 1, policy_version 90660 (0.0006) [2023-12-26 00:18:29,480][123090] Updated weights for policy 1, policy_version 90670 (0.0007) [2023-12-26 00:18:29,531][123090] Updated weights for policy 1, policy_version 90680 (0.0009) [2023-12-26 00:18:30,129][123091] Updated weights for policy 0, policy_version 91109 (0.0007) [2023-12-26 00:18:30,194][123091] Updated weights for policy 0, policy_version 91119 (0.0011) [2023-12-26 00:18:30,257][123091] Updated weights for policy 0, policy_version 91129 (0.0011) [2023-12-26 00:18:30,341][123090] Updated weights for policy 1, policy_version 90690 (0.0009) [2023-12-26 00:18:30,396][123090] Updated weights for policy 1, policy_version 90700 (0.0009) [2023-12-26 00:18:30,454][123090] Updated weights for policy 1, policy_version 90710 (0.0005) [2023-12-26 00:18:30,520][123090] Updated weights for policy 1, policy_version 90720 (0.0008) [2023-12-26 00:18:31,054][123091] Updated weights for policy 0, policy_version 91139 (0.0011) [2023-12-26 00:18:31,118][123091] Updated weights for policy 0, policy_version 91149 (0.0011) [2023-12-26 00:18:31,188][123091] Updated weights for policy 0, policy_version 91159 (0.0010) [2023-12-26 00:18:31,311][123090] Updated weights for policy 1, policy_version 90730 (0.0009) [2023-12-26 00:18:31,380][123090] Updated weights for policy 1, policy_version 90740 (0.0009) [2023-12-26 00:18:31,440][123090] Updated weights for policy 1, policy_version 90750 (0.0008) [2023-12-26 00:18:31,969][123091] Updated weights for policy 0, policy_version 91169 (0.0011) [2023-12-26 00:18:32,027][123091] Updated weights for policy 0, policy_version 91180 (0.0010) [2023-12-26 00:18:32,083][123091] Updated weights for policy 0, policy_version 91191 (0.0010) [2023-12-26 00:18:32,269][123090] Updated weights for policy 1, policy_version 90760 (0.0010) [2023-12-26 00:18:32,332][123090] Updated weights for policy 1, policy_version 90770 (0.0009) [2023-12-26 00:18:32,399][123090] Updated weights for policy 1, policy_version 90780 (0.0009) [2023-12-26 00:18:32,917][123091] Updated weights for policy 0, policy_version 91201 (0.0009) [2023-12-26 00:18:32,988][123091] Updated weights for policy 0, policy_version 91211 (0.0005) [2023-12-26 00:18:33,047][123091] Updated weights for policy 0, policy_version 91221 (0.0007) [2023-12-26 00:18:33,104][123091] Updated weights for policy 0, policy_version 91231 (0.0009) [2023-12-26 00:18:33,266][123090] Updated weights for policy 1, policy_version 90790 (0.0009) [2023-12-26 00:18:33,315][123090] Updated weights for policy 1, policy_version 90800 (0.0009) [2023-12-26 00:18:33,372][123090] Updated weights for policy 1, policy_version 90810 (0.0009) [2023-12-26 00:18:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 46604288. Throughput: 0: 8787.3, 1: 8767.7. Samples: 46618092. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:33,784][121949] Avg episode reward: [(0, '4664.937'), (1, '5508.266')] [2023-12-26 00:18:33,812][123091] Updated weights for policy 0, policy_version 91241 (0.0009) [2023-12-26 00:18:33,864][123091] Updated weights for policy 0, policy_version 91251 (0.0009) [2023-12-26 00:18:33,921][123091] Updated weights for policy 0, policy_version 91261 (0.0008) [2023-12-26 00:18:34,198][123090] Updated weights for policy 1, policy_version 90820 (0.0008) [2023-12-26 00:18:34,262][123090] Updated weights for policy 1, policy_version 90830 (0.0008) [2023-12-26 00:18:34,315][123090] Updated weights for policy 1, policy_version 90840 (0.0009) [2023-12-26 00:18:34,688][123091] Updated weights for policy 0, policy_version 91271 (0.0009) [2023-12-26 00:18:34,737][123091] Updated weights for policy 0, policy_version 91281 (0.0010) [2023-12-26 00:18:34,785][123091] Updated weights for policy 0, policy_version 91291 (0.0010) [2023-12-26 00:18:35,159][123090] Updated weights for policy 1, policy_version 90850 (0.0007) [2023-12-26 00:18:35,234][123090] Updated weights for policy 1, policy_version 90860 (0.0005) [2023-12-26 00:18:35,290][123090] Updated weights for policy 1, policy_version 90870 (0.0006) [2023-12-26 00:18:35,350][123090] Updated weights for policy 1, policy_version 90880 (0.0006) [2023-12-26 00:18:35,534][123091] Updated weights for policy 0, policy_version 91301 (0.0007) [2023-12-26 00:18:35,608][123091] Updated weights for policy 0, policy_version 91311 (0.0005) [2023-12-26 00:18:35,671][123091] Updated weights for policy 0, policy_version 91321 (0.0006) [2023-12-26 00:18:35,958][123090] Updated weights for policy 1, policy_version 90890 (0.0005) [2023-12-26 00:18:36,014][123090] Updated weights for policy 1, policy_version 90900 (0.0005) [2023-12-26 00:18:36,081][123090] Updated weights for policy 1, policy_version 90910 (0.0009) [2023-12-26 00:18:36,269][123091] Updated weights for policy 0, policy_version 91331 (0.0006) [2023-12-26 00:18:36,329][123091] Updated weights for policy 0, policy_version 91341 (0.0006) [2023-12-26 00:18:36,387][123091] Updated weights for policy 0, policy_version 91351 (0.0005) [2023-12-26 00:18:36,881][123090] Updated weights for policy 1, policy_version 90920 (0.0009) [2023-12-26 00:18:36,935][123090] Updated weights for policy 1, policy_version 90931 (0.0010) [2023-12-26 00:18:36,990][123090] Updated weights for policy 1, policy_version 90942 (0.0010) [2023-12-26 00:18:37,110][123091] Updated weights for policy 0, policy_version 91361 (0.0007) [2023-12-26 00:18:37,184][123091] Updated weights for policy 0, policy_version 91371 (0.0006) [2023-12-26 00:18:37,248][123091] Updated weights for policy 0, policy_version 91381 (0.0007) [2023-12-26 00:18:37,307][123091] Updated weights for policy 0, policy_version 91391 (0.0006) [2023-12-26 00:18:37,887][123090] Updated weights for policy 1, policy_version 90952 (0.0007) [2023-12-26 00:18:37,949][123090] Updated weights for policy 1, policy_version 90962 (0.0005) [2023-12-26 00:18:37,985][123091] Updated weights for policy 0, policy_version 91401 (0.0006) [2023-12-26 00:18:38,016][123090] Updated weights for policy 1, policy_version 90972 (0.0006) [2023-12-26 00:18:38,051][123091] Updated weights for policy 0, policy_version 91411 (0.0005) [2023-12-26 00:18:38,129][123091] Updated weights for policy 0, policy_version 91421 (0.0005) [2023-12-26 00:18:38,638][123090] Updated weights for policy 1, policy_version 90982 (0.0006) [2023-12-26 00:18:38,709][123090] Updated weights for policy 1, policy_version 90992 (0.0005) [2023-12-26 00:18:38,777][123090] Updated weights for policy 1, policy_version 91002 (0.0008) [2023-12-26 00:18:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 46694400. Throughput: 0: 8884.4, 1: 8766.3. Samples: 46674980. Policy #0 lag: (min: 7.0, avg: 10.8, max: 39.0) [2023-12-26 00:18:38,786][121949] Avg episode reward: [(0, '4748.630'), (1, '5499.803')] [2023-12-26 00:18:38,812][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000091008_23298048.pth... [2023-12-26 00:18:38,817][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000089984_23035904.pth [2023-12-26 00:18:38,833][123091] Updated weights for policy 0, policy_version 91431 (0.0006) [2023-12-26 00:18:38,889][123091] Updated weights for policy 0, policy_version 91441 (0.0005) [2023-12-26 00:18:38,960][123091] Updated weights for policy 0, policy_version 91451 (0.0006) [2023-12-26 00:18:38,988][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000091456_23412736.pth... [2023-12-26 00:18:38,993][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000090400_23142400.pth [2023-12-26 00:18:38,993][123007] Saving new best policy, reward=4748.630! [2023-12-26 00:18:39,559][123090] Updated weights for policy 1, policy_version 91012 (0.0008) [2023-12-26 00:18:39,633][123090] Updated weights for policy 1, policy_version 91022 (0.0007) [2023-12-26 00:18:39,660][123091] Updated weights for policy 0, policy_version 91461 (0.0008) [2023-12-26 00:18:39,704][123090] Updated weights for policy 1, policy_version 91032 (0.0010) [2023-12-26 00:18:39,725][123091] Updated weights for policy 0, policy_version 91471 (0.0006) [2023-12-26 00:18:39,787][123091] Updated weights for policy 0, policy_version 91481 (0.0006) [2023-12-26 00:18:40,451][123090] Updated weights for policy 1, policy_version 91042 (0.0010) [2023-12-26 00:18:40,519][123090] Updated weights for policy 1, policy_version 91052 (0.0005) [2023-12-26 00:18:40,577][123090] Updated weights for policy 1, policy_version 91062 (0.0006) [2023-12-26 00:18:40,578][123091] Updated weights for policy 0, policy_version 91491 (0.0007) [2023-12-26 00:18:40,627][123090] Updated weights for policy 1, policy_version 91072 (0.0008) [2023-12-26 00:18:40,642][123091] Updated weights for policy 0, policy_version 91501 (0.0006) [2023-12-26 00:18:40,691][123091] Updated weights for policy 0, policy_version 91511 (0.0009) [2023-12-26 00:18:41,450][123091] Updated weights for policy 0, policy_version 91521 (0.0009) [2023-12-26 00:18:41,509][123091] Updated weights for policy 0, policy_version 91531 (0.0008) [2023-12-26 00:18:41,524][123090] Updated weights for policy 1, policy_version 91082 (0.0007) [2023-12-26 00:18:41,566][123091] Updated weights for policy 0, policy_version 91541 (0.0007) [2023-12-26 00:18:41,585][123090] Updated weights for policy 1, policy_version 91092 (0.0009) [2023-12-26 00:18:41,625][123091] Updated weights for policy 0, policy_version 91551 (0.0008) [2023-12-26 00:18:41,657][123090] Updated weights for policy 1, policy_version 91102 (0.0009) [2023-12-26 00:18:42,457][123090] Updated weights for policy 1, policy_version 91112 (0.0008) [2023-12-26 00:18:42,483][123091] Updated weights for policy 0, policy_version 91561 (0.0006) [2023-12-26 00:18:42,516][123090] Updated weights for policy 1, policy_version 91122 (0.0008) [2023-12-26 00:18:42,543][123091] Updated weights for policy 0, policy_version 91571 (0.0005) [2023-12-26 00:18:42,582][123090] Updated weights for policy 1, policy_version 91132 (0.0008) [2023-12-26 00:18:42,609][123091] Updated weights for policy 0, policy_version 91581 (0.0005) [2023-12-26 00:18:43,238][123091] Updated weights for policy 0, policy_version 91591 (0.0009) [2023-12-26 00:18:43,288][123091] Updated weights for policy 0, policy_version 91601 (0.0010) [2023-12-26 00:18:43,351][123091] Updated weights for policy 0, policy_version 91611 (0.0011) [2023-12-26 00:18:43,384][123090] Updated weights for policy 1, policy_version 91142 (0.0006) [2023-12-26 00:18:43,438][123090] Updated weights for policy 1, policy_version 91152 (0.0009) [2023-12-26 00:18:43,506][123090] Updated weights for policy 1, policy_version 91162 (0.0009) [2023-12-26 00:18:43,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 46792704. Throughput: 0: 8959.4, 1: 8644.3. Samples: 46783100. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:18:43,785][121949] Avg episode reward: [(0, '4708.299'), (1, '5635.253')] [2023-12-26 00:18:44,201][123091] Updated weights for policy 0, policy_version 91621 (0.0010) [2023-12-26 00:18:44,254][123091] Updated weights for policy 0, policy_version 91631 (0.0010) [2023-12-26 00:18:44,309][123091] Updated weights for policy 0, policy_version 91641 (0.0005) [2023-12-26 00:18:44,321][123090] Updated weights for policy 1, policy_version 91172 (0.0010) [2023-12-26 00:18:44,376][123090] Updated weights for policy 1, policy_version 91182 (0.0010) [2023-12-26 00:18:44,443][123090] Updated weights for policy 1, policy_version 91192 (0.0010) [2023-12-26 00:18:45,053][123091] Updated weights for policy 0, policy_version 91651 (0.0007) [2023-12-26 00:18:45,118][123091] Updated weights for policy 0, policy_version 91661 (0.0009) [2023-12-26 00:18:45,170][123091] Updated weights for policy 0, policy_version 91671 (0.0010) [2023-12-26 00:18:45,248][123090] Updated weights for policy 1, policy_version 91202 (0.0010) [2023-12-26 00:18:45,311][123090] Updated weights for policy 1, policy_version 91212 (0.0009) [2023-12-26 00:18:45,377][123090] Updated weights for policy 1, policy_version 91222 (0.0008) [2023-12-26 00:18:45,442][123090] Updated weights for policy 1, policy_version 91232 (0.0011) [2023-12-26 00:18:46,066][123091] Updated weights for policy 0, policy_version 91681 (0.0010) [2023-12-26 00:18:46,120][123091] Updated weights for policy 0, policy_version 91691 (0.0008) [2023-12-26 00:18:46,151][123090] Updated weights for policy 1, policy_version 91242 (0.0009) [2023-12-26 00:18:46,179][123091] Updated weights for policy 0, policy_version 91701 (0.0006) [2023-12-26 00:18:46,195][123090] Updated weights for policy 1, policy_version 91252 (0.0008) [2023-12-26 00:18:46,235][123091] Updated weights for policy 0, policy_version 91711 (0.0010) [2023-12-26 00:18:46,242][123090] Updated weights for policy 1, policy_version 91262 (0.0006) [2023-12-26 00:18:47,088][123091] Updated weights for policy 0, policy_version 91721 (0.0008) [2023-12-26 00:18:47,101][123090] Updated weights for policy 1, policy_version 91272 (0.0009) [2023-12-26 00:18:47,152][123091] Updated weights for policy 0, policy_version 91731 (0.0008) [2023-12-26 00:18:47,168][123090] Updated weights for policy 1, policy_version 91282 (0.0009) [2023-12-26 00:18:47,209][123091] Updated weights for policy 0, policy_version 91741 (0.0007) [2023-12-26 00:18:47,234][123090] Updated weights for policy 1, policy_version 91292 (0.0007) [2023-12-26 00:18:48,036][123091] Updated weights for policy 0, policy_version 91751 (0.0010) [2023-12-26 00:18:48,047][123090] Updated weights for policy 1, policy_version 91302 (0.0010) [2023-12-26 00:18:48,092][123091] Updated weights for policy 0, policy_version 91761 (0.0006) [2023-12-26 00:18:48,106][123090] Updated weights for policy 1, policy_version 91312 (0.0010) [2023-12-26 00:18:48,144][123091] Updated weights for policy 0, policy_version 91771 (0.0009) [2023-12-26 00:18:48,176][123090] Updated weights for policy 1, policy_version 91322 (0.0010) [2023-12-26 00:18:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 46874624. Throughput: 0: 8976.8, 1: 8658.8. Samples: 46888736. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:18:48,785][121949] Avg episode reward: [(0, '4774.392'), (1, '5518.469')] [2023-12-26 00:18:48,786][123007] Saving new best policy, reward=4774.392! [2023-12-26 00:18:48,906][123090] Updated weights for policy 1, policy_version 91332 (0.0009) [2023-12-26 00:18:48,967][123090] Updated weights for policy 1, policy_version 91342 (0.0006) [2023-12-26 00:18:49,018][123091] Updated weights for policy 0, policy_version 91781 (0.0007) [2023-12-26 00:18:49,027][123090] Updated weights for policy 1, policy_version 91352 (0.0009) [2023-12-26 00:18:49,061][123091] Updated weights for policy 0, policy_version 91791 (0.0009) [2023-12-26 00:18:49,114][123091] Updated weights for policy 0, policy_version 91801 (0.0009) [2023-12-26 00:18:49,854][123090] Updated weights for policy 1, policy_version 91362 (0.0009) [2023-12-26 00:18:49,927][123090] Updated weights for policy 1, policy_version 91372 (0.0009) [2023-12-26 00:18:49,991][123090] Updated weights for policy 1, policy_version 91382 (0.0008) [2023-12-26 00:18:49,994][123091] Updated weights for policy 0, policy_version 91811 (0.0008) [2023-12-26 00:18:50,048][123091] Updated weights for policy 0, policy_version 91821 (0.0007) [2023-12-26 00:18:50,053][123090] Updated weights for policy 1, policy_version 91392 (0.0008) [2023-12-26 00:18:50,107][123091] Updated weights for policy 0, policy_version 91831 (0.0008) [2023-12-26 00:18:50,832][123090] Updated weights for policy 1, policy_version 91402 (0.0008) [2023-12-26 00:18:50,902][123090] Updated weights for policy 1, policy_version 91412 (0.0009) [2023-12-26 00:18:50,967][123090] Updated weights for policy 1, policy_version 91422 (0.0010) [2023-12-26 00:18:50,991][123091] Updated weights for policy 0, policy_version 91841 (0.0009) [2023-12-26 00:18:51,076][123091] Updated weights for policy 0, policy_version 91851 (0.0010) [2023-12-26 00:18:51,146][123091] Updated weights for policy 0, policy_version 91861 (0.0010) [2023-12-26 00:18:51,219][123091] Updated weights for policy 0, policy_version 91871 (0.0011) [2023-12-26 00:18:51,826][123090] Updated weights for policy 1, policy_version 91432 (0.0009) [2023-12-26 00:18:51,880][123090] Updated weights for policy 1, policy_version 91442 (0.0008) [2023-12-26 00:18:51,945][123090] Updated weights for policy 1, policy_version 91452 (0.0010) [2023-12-26 00:18:52,007][123091] Updated weights for policy 0, policy_version 91881 (0.0009) [2023-12-26 00:18:52,072][123091] Updated weights for policy 0, policy_version 91891 (0.0010) [2023-12-26 00:18:52,139][123091] Updated weights for policy 0, policy_version 91901 (0.0011) [2023-12-26 00:18:52,769][123090] Updated weights for policy 1, policy_version 91462 (0.0010) [2023-12-26 00:18:52,843][123090] Updated weights for policy 1, policy_version 91472 (0.0011) [2023-12-26 00:18:52,878][123091] Updated weights for policy 0, policy_version 91911 (0.0007) [2023-12-26 00:18:52,910][123090] Updated weights for policy 1, policy_version 91482 (0.0005) [2023-12-26 00:18:52,946][123091] Updated weights for policy 0, policy_version 91921 (0.0007) [2023-12-26 00:18:53,005][123091] Updated weights for policy 0, policy_version 91931 (0.0010) [2023-12-26 00:18:53,603][123090] Updated weights for policy 1, policy_version 91492 (0.0005) [2023-12-26 00:18:53,669][123090] Updated weights for policy 1, policy_version 91502 (0.0008) [2023-12-26 00:18:53,730][123091] Updated weights for policy 0, policy_version 91941 (0.0008) [2023-12-26 00:18:53,740][123090] Updated weights for policy 1, policy_version 91512 (0.0011) [2023-12-26 00:18:53,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17613.0, 300 sec: 17689.2). Total num frames: 46956544. Throughput: 0: 8913.2, 1: 8629.2. Samples: 46939448. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:18:53,784][121949] Avg episode reward: [(0, '4692.983'), (1, '5354.757')] [2023-12-26 00:18:53,787][123091] Updated weights for policy 0, policy_version 91951 (0.0008) [2023-12-26 00:18:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000091520_23429120.pth... [2023-12-26 00:18:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000090496_23166976.pth [2023-12-26 00:18:53,846][123091] Updated weights for policy 0, policy_version 91961 (0.0011) [2023-12-26 00:18:53,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000091968_23543808.pth... [2023-12-26 00:18:53,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000090880_23265280.pth [2023-12-26 00:18:54,494][123090] Updated weights for policy 1, policy_version 91522 (0.0011) [2023-12-26 00:18:54,561][123090] Updated weights for policy 1, policy_version 91532 (0.0010) [2023-12-26 00:18:54,614][123090] Updated weights for policy 1, policy_version 91542 (0.0010) [2023-12-26 00:18:54,634][123091] Updated weights for policy 0, policy_version 91971 (0.0009) [2023-12-26 00:18:54,671][123090] Updated weights for policy 1, policy_version 91552 (0.0007) [2023-12-26 00:18:54,687][123091] Updated weights for policy 0, policy_version 91981 (0.0006) [2023-12-26 00:18:54,748][123091] Updated weights for policy 0, policy_version 91991 (0.0009) [2023-12-26 00:18:55,468][123091] Updated weights for policy 0, policy_version 92001 (0.0009) [2023-12-26 00:18:55,477][123090] Updated weights for policy 1, policy_version 91562 (0.0008) [2023-12-26 00:18:55,518][123091] Updated weights for policy 0, policy_version 92011 (0.0006) [2023-12-26 00:18:55,538][123090] Updated weights for policy 1, policy_version 91572 (0.0008) [2023-12-26 00:18:55,569][123091] Updated weights for policy 0, policy_version 92021 (0.0006) [2023-12-26 00:18:55,601][123090] Updated weights for policy 1, policy_version 91582 (0.0009) [2023-12-26 00:18:55,623][123091] Updated weights for policy 0, policy_version 92031 (0.0005) [2023-12-26 00:18:56,294][123091] Updated weights for policy 0, policy_version 92041 (0.0006) [2023-12-26 00:18:56,358][123091] Updated weights for policy 0, policy_version 92051 (0.0005) [2023-12-26 00:18:56,424][123091] Updated weights for policy 0, policy_version 92061 (0.0006) [2023-12-26 00:18:56,449][123090] Updated weights for policy 1, policy_version 91592 (0.0008) [2023-12-26 00:18:56,514][123090] Updated weights for policy 1, policy_version 91602 (0.0009) [2023-12-26 00:18:56,575][123090] Updated weights for policy 1, policy_version 91612 (0.0009) [2023-12-26 00:18:57,046][123091] Updated weights for policy 0, policy_version 92071 (0.0007) [2023-12-26 00:18:57,090][123091] Updated weights for policy 0, policy_version 92081 (0.0005) [2023-12-26 00:18:57,139][123091] Updated weights for policy 0, policy_version 92091 (0.0005) [2023-12-26 00:18:57,511][123090] Updated weights for policy 1, policy_version 91622 (0.0010) [2023-12-26 00:18:57,568][123090] Updated weights for policy 1, policy_version 91632 (0.0009) [2023-12-26 00:18:57,622][123090] Updated weights for policy 1, policy_version 91642 (0.0010) [2023-12-26 00:18:57,729][123091] Updated weights for policy 0, policy_version 92101 (0.0005) [2023-12-26 00:18:57,774][123091] Updated weights for policy 0, policy_version 92111 (0.0005) [2023-12-26 00:18:57,828][123091] Updated weights for policy 0, policy_version 92121 (0.0005) [2023-12-26 00:18:58,564][123090] Updated weights for policy 1, policy_version 91652 (0.0010) [2023-12-26 00:18:58,571][123091] Updated weights for policy 0, policy_version 92131 (0.0006) [2023-12-26 00:18:58,626][123090] Updated weights for policy 1, policy_version 91662 (0.0008) [2023-12-26 00:18:58,645][123091] Updated weights for policy 0, policy_version 92141 (0.0008) [2023-12-26 00:18:58,704][123090] Updated weights for policy 1, policy_version 91672 (0.0009) [2023-12-26 00:18:58,717][123091] Updated weights for policy 0, policy_version 92151 (0.0008) [2023-12-26 00:18:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 47063040. Throughput: 0: 9076.9, 1: 8672.8. Samples: 47050096. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:18:58,785][121949] Avg episode reward: [(0, '4678.139'), (1, '5364.368')] [2023-12-26 00:18:59,532][123091] Updated weights for policy 0, policy_version 92161 (0.0008) [2023-12-26 00:18:59,595][123091] Updated weights for policy 0, policy_version 92171 (0.0009) [2023-12-26 00:18:59,602][123090] Updated weights for policy 1, policy_version 91682 (0.0008) [2023-12-26 00:18:59,661][123090] Updated weights for policy 1, policy_version 91692 (0.0005) [2023-12-26 00:18:59,662][123091] Updated weights for policy 0, policy_version 92181 (0.0010) [2023-12-26 00:18:59,709][123091] Updated weights for policy 0, policy_version 92191 (0.0008) [2023-12-26 00:18:59,719][123090] Updated weights for policy 1, policy_version 91702 (0.0006) [2023-12-26 00:18:59,778][123090] Updated weights for policy 1, policy_version 91712 (0.0009) [2023-12-26 00:19:00,542][123090] Updated weights for policy 1, policy_version 91722 (0.0005) [2023-12-26 00:19:00,594][123091] Updated weights for policy 0, policy_version 92201 (0.0006) [2023-12-26 00:19:00,595][123090] Updated weights for policy 1, policy_version 91732 (0.0005) [2023-12-26 00:19:00,649][123090] Updated weights for policy 1, policy_version 91742 (0.0009) [2023-12-26 00:19:00,658][123091] Updated weights for policy 0, policy_version 92211 (0.0005) [2023-12-26 00:19:00,719][123091] Updated weights for policy 0, policy_version 92221 (0.0006) [2023-12-26 00:19:01,368][123090] Updated weights for policy 1, policy_version 91752 (0.0007) [2023-12-26 00:19:01,437][123090] Updated weights for policy 1, policy_version 91762 (0.0006) [2023-12-26 00:19:01,505][123090] Updated weights for policy 1, policy_version 91772 (0.0005) [2023-12-26 00:19:01,536][123091] Updated weights for policy 0, policy_version 92231 (0.0008) [2023-12-26 00:19:01,592][123091] Updated weights for policy 0, policy_version 92241 (0.0010) [2023-12-26 00:19:01,658][123091] Updated weights for policy 0, policy_version 92251 (0.0008) [2023-12-26 00:19:02,186][123090] Updated weights for policy 1, policy_version 91782 (0.0008) [2023-12-26 00:19:02,249][123090] Updated weights for policy 1, policy_version 91792 (0.0010) [2023-12-26 00:19:02,316][123090] Updated weights for policy 1, policy_version 91802 (0.0011) [2023-12-26 00:19:02,542][123091] Updated weights for policy 0, policy_version 92261 (0.0008) [2023-12-26 00:19:02,600][123091] Updated weights for policy 0, policy_version 92271 (0.0008) [2023-12-26 00:19:02,666][123091] Updated weights for policy 0, policy_version 92281 (0.0009) [2023-12-26 00:19:02,982][123090] Updated weights for policy 1, policy_version 91812 (0.0008) [2023-12-26 00:19:03,029][123090] Updated weights for policy 1, policy_version 91822 (0.0005) [2023-12-26 00:19:03,077][123090] Updated weights for policy 1, policy_version 91832 (0.0005) [2023-12-26 00:19:03,505][123091] Updated weights for policy 0, policy_version 92291 (0.0010) [2023-12-26 00:19:03,558][123091] Updated weights for policy 0, policy_version 92302 (0.0010) [2023-12-26 00:19:03,611][123091] Updated weights for policy 0, policy_version 92313 (0.0009) [2023-12-26 00:19:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 47144960. Throughput: 0: 9096.0, 1: 8705.9. Samples: 47155308. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:03,785][121949] Avg episode reward: [(0, '4915.180'), (1, '5573.330')] [2023-12-26 00:19:03,785][123007] Saving new best policy, reward=4915.180! [2023-12-26 00:19:03,807][123090] Updated weights for policy 1, policy_version 91842 (0.0006) [2023-12-26 00:19:03,876][123090] Updated weights for policy 1, policy_version 91852 (0.0009) [2023-12-26 00:19:03,946][123090] Updated weights for policy 1, policy_version 91862 (0.0010) [2023-12-26 00:19:04,014][123090] Updated weights for policy 1, policy_version 91872 (0.0007) [2023-12-26 00:19:04,443][123091] Updated weights for policy 0, policy_version 92323 (0.0008) [2023-12-26 00:19:04,500][123091] Updated weights for policy 0, policy_version 92333 (0.0010) [2023-12-26 00:19:04,565][123091] Updated weights for policy 0, policy_version 92343 (0.0006) [2023-12-26 00:19:04,818][123090] Updated weights for policy 1, policy_version 91882 (0.0005) [2023-12-26 00:19:04,880][123090] Updated weights for policy 1, policy_version 91892 (0.0006) [2023-12-26 00:19:04,936][123090] Updated weights for policy 1, policy_version 91902 (0.0005) [2023-12-26 00:19:05,263][123091] Updated weights for policy 0, policy_version 92353 (0.0005) [2023-12-26 00:19:05,329][123091] Updated weights for policy 0, policy_version 92363 (0.0008) [2023-12-26 00:19:05,382][123091] Updated weights for policy 0, policy_version 92373 (0.0008) [2023-12-26 00:19:05,429][123091] Updated weights for policy 0, policy_version 92383 (0.0010) [2023-12-26 00:19:05,609][123090] Updated weights for policy 1, policy_version 91912 (0.0008) [2023-12-26 00:19:05,669][123090] Updated weights for policy 1, policy_version 91922 (0.0009) [2023-12-26 00:19:05,733][123090] Updated weights for policy 1, policy_version 91932 (0.0009) [2023-12-26 00:19:06,253][123091] Updated weights for policy 0, policy_version 92393 (0.0010) [2023-12-26 00:19:06,320][123091] Updated weights for policy 0, policy_version 92403 (0.0008) [2023-12-26 00:19:06,377][123091] Updated weights for policy 0, policy_version 92413 (0.0007) [2023-12-26 00:19:06,607][123090] Updated weights for policy 1, policy_version 91942 (0.0010) [2023-12-26 00:19:06,675][123090] Updated weights for policy 1, policy_version 91952 (0.0009) [2023-12-26 00:19:06,750][123090] Updated weights for policy 1, policy_version 91962 (0.0010) [2023-12-26 00:19:07,170][123091] Updated weights for policy 0, policy_version 92423 (0.0007) [2023-12-26 00:19:07,225][123091] Updated weights for policy 0, policy_version 92433 (0.0005) [2023-12-26 00:19:07,278][123091] Updated weights for policy 0, policy_version 92443 (0.0005) [2023-12-26 00:19:07,581][123090] Updated weights for policy 1, policy_version 91972 (0.0009) [2023-12-26 00:19:07,631][123090] Updated weights for policy 1, policy_version 91982 (0.0009) [2023-12-26 00:19:07,682][123090] Updated weights for policy 1, policy_version 91993 (0.0010) [2023-12-26 00:19:08,095][123091] Updated weights for policy 0, policy_version 92453 (0.0010) [2023-12-26 00:19:08,154][123091] Updated weights for policy 0, policy_version 92463 (0.0010) [2023-12-26 00:19:08,211][123091] Updated weights for policy 0, policy_version 92473 (0.0010) [2023-12-26 00:19:08,555][123090] Updated weights for policy 1, policy_version 92004 (0.0010) [2023-12-26 00:19:08,618][123090] Updated weights for policy 1, policy_version 92014 (0.0009) [2023-12-26 00:19:08,682][123090] Updated weights for policy 1, policy_version 92024 (0.0010) [2023-12-26 00:19:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 47235072. Throughput: 0: 9171.6, 1: 8714.8. Samples: 47209744. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:08,785][121949] Avg episode reward: [(0, '4776.189'), (1, '5597.439')] [2023-12-26 00:19:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000092480_23674880.pth... [2023-12-26 00:19:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000092032_23560192.pth... [2023-12-26 00:19:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000091456_23412736.pth [2023-12-26 00:19:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000091008_23298048.pth [2023-12-26 00:19:09,065][123091] Updated weights for policy 0, policy_version 92483 (0.0009) [2023-12-26 00:19:09,127][123091] Updated weights for policy 0, policy_version 92493 (0.0006) [2023-12-26 00:19:09,194][123091] Updated weights for policy 0, policy_version 92503 (0.0008) [2023-12-26 00:19:09,521][123090] Updated weights for policy 1, policy_version 92034 (0.0009) [2023-12-26 00:19:09,589][123090] Updated weights for policy 1, policy_version 92044 (0.0009) [2023-12-26 00:19:09,656][123090] Updated weights for policy 1, policy_version 92054 (0.0009) [2023-12-26 00:19:09,725][123090] Updated weights for policy 1, policy_version 92064 (0.0008) [2023-12-26 00:19:10,036][123091] Updated weights for policy 0, policy_version 92513 (0.0010) [2023-12-26 00:19:10,092][123091] Updated weights for policy 0, policy_version 92523 (0.0008) [2023-12-26 00:19:10,154][123091] Updated weights for policy 0, policy_version 92533 (0.0008) [2023-12-26 00:19:10,221][123091] Updated weights for policy 0, policy_version 92543 (0.0008) [2023-12-26 00:19:10,577][123090] Updated weights for policy 1, policy_version 92074 (0.0009) [2023-12-26 00:19:10,638][123090] Updated weights for policy 1, policy_version 92084 (0.0010) [2023-12-26 00:19:10,695][123090] Updated weights for policy 1, policy_version 92094 (0.0010) [2023-12-26 00:19:10,933][123091] Updated weights for policy 0, policy_version 92553 (0.0006) [2023-12-26 00:19:10,991][123091] Updated weights for policy 0, policy_version 92563 (0.0005) [2023-12-26 00:19:11,051][123091] Updated weights for policy 0, policy_version 92573 (0.0008) [2023-12-26 00:19:11,618][123090] Updated weights for policy 1, policy_version 92104 (0.0009) [2023-12-26 00:19:11,682][123090] Updated weights for policy 1, policy_version 92114 (0.0008) [2023-12-26 00:19:11,748][123090] Updated weights for policy 1, policy_version 92124 (0.0010) [2023-12-26 00:19:11,855][123091] Updated weights for policy 0, policy_version 92583 (0.0009) [2023-12-26 00:19:11,920][123091] Updated weights for policy 0, policy_version 92593 (0.0008) [2023-12-26 00:19:11,996][123091] Updated weights for policy 0, policy_version 92603 (0.0007) [2023-12-26 00:19:12,589][123090] Updated weights for policy 1, policy_version 92134 (0.0007) [2023-12-26 00:19:12,662][123090] Updated weights for policy 1, policy_version 92144 (0.0007) [2023-12-26 00:19:12,724][123090] Updated weights for policy 1, policy_version 92154 (0.0009) [2023-12-26 00:19:12,744][123091] Updated weights for policy 0, policy_version 92613 (0.0009) [2023-12-26 00:19:12,808][123091] Updated weights for policy 0, policy_version 92623 (0.0009) [2023-12-26 00:19:12,856][123091] Updated weights for policy 0, policy_version 92633 (0.0009) [2023-12-26 00:19:13,563][123090] Updated weights for policy 1, policy_version 92164 (0.0009) [2023-12-26 00:19:13,588][123091] Updated weights for policy 0, policy_version 92643 (0.0008) [2023-12-26 00:19:13,628][123090] Updated weights for policy 1, policy_version 92174 (0.0008) [2023-12-26 00:19:13,649][123091] Updated weights for policy 0, policy_version 92653 (0.0005) [2023-12-26 00:19:13,692][123090] Updated weights for policy 1, policy_version 92184 (0.0009) [2023-12-26 00:19:13,713][123091] Updated weights for policy 0, policy_version 92663 (0.0006) [2023-12-26 00:19:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 47325184. Throughput: 0: 9095.8, 1: 8723.6. Samples: 47312056. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:13,785][121949] Avg episode reward: [(0, '4769.639'), (1, '5672.216')] [2023-12-26 00:19:13,787][123008] Saving new best policy, reward=5672.216! [2023-12-26 00:19:14,494][123091] Updated weights for policy 0, policy_version 92673 (0.0006) [2023-12-26 00:19:14,550][123091] Updated weights for policy 0, policy_version 92683 (0.0011) [2023-12-26 00:19:14,551][123090] Updated weights for policy 1, policy_version 92195 (0.0009) [2023-12-26 00:19:14,604][123091] Updated weights for policy 0, policy_version 92693 (0.0010) [2023-12-26 00:19:14,615][123090] Updated weights for policy 1, policy_version 92205 (0.0007) [2023-12-26 00:19:14,670][123091] Updated weights for policy 0, policy_version 92703 (0.0011) [2023-12-26 00:19:14,675][123090] Updated weights for policy 1, policy_version 92215 (0.0008) [2023-12-26 00:19:15,509][123090] Updated weights for policy 1, policy_version 92225 (0.0008) [2023-12-26 00:19:15,516][123091] Updated weights for policy 0, policy_version 92713 (0.0011) [2023-12-26 00:19:15,570][123090] Updated weights for policy 1, policy_version 92235 (0.0007) [2023-12-26 00:19:15,578][123091] Updated weights for policy 0, policy_version 92723 (0.0010) [2023-12-26 00:19:15,624][123090] Updated weights for policy 1, policy_version 92245 (0.0008) [2023-12-26 00:19:15,638][123091] Updated weights for policy 0, policy_version 92733 (0.0011) [2023-12-26 00:19:15,672][123090] Updated weights for policy 1, policy_version 92255 (0.0009) [2023-12-26 00:19:16,439][123091] Updated weights for policy 0, policy_version 92743 (0.0011) [2023-12-26 00:19:16,501][123091] Updated weights for policy 0, policy_version 92753 (0.0011) [2023-12-26 00:19:16,534][123090] Updated weights for policy 1, policy_version 92265 (0.0008) [2023-12-26 00:19:16,552][123091] Updated weights for policy 0, policy_version 92763 (0.0010) [2023-12-26 00:19:16,587][123090] Updated weights for policy 1, policy_version 92275 (0.0008) [2023-12-26 00:19:16,637][123090] Updated weights for policy 1, policy_version 92285 (0.0009) [2023-12-26 00:19:17,373][123091] Updated weights for policy 0, policy_version 92773 (0.0010) [2023-12-26 00:19:17,435][123091] Updated weights for policy 0, policy_version 92783 (0.0011) [2023-12-26 00:19:17,494][123091] Updated weights for policy 0, policy_version 92793 (0.0011) [2023-12-26 00:19:17,510][123090] Updated weights for policy 1, policy_version 92295 (0.0008) [2023-12-26 00:19:17,578][123090] Updated weights for policy 1, policy_version 92305 (0.0009) [2023-12-26 00:19:17,641][123090] Updated weights for policy 1, policy_version 92315 (0.0010) [2023-12-26 00:19:18,255][123091] Updated weights for policy 0, policy_version 92803 (0.0009) [2023-12-26 00:19:18,303][123091] Updated weights for policy 0, policy_version 92813 (0.0005) [2023-12-26 00:19:18,362][123091] Updated weights for policy 0, policy_version 92823 (0.0007) [2023-12-26 00:19:18,495][123090] Updated weights for policy 1, policy_version 92325 (0.0010) [2023-12-26 00:19:18,543][123090] Updated weights for policy 1, policy_version 92335 (0.0010) [2023-12-26 00:19:18,598][123090] Updated weights for policy 1, policy_version 92345 (0.0007) [2023-12-26 00:19:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 47407104. Throughput: 0: 9034.1, 1: 8682.5. Samples: 47415340. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:18,785][121949] Avg episode reward: [(0, '4801.408'), (1, '5644.692')] [2023-12-26 00:19:19,142][123091] Updated weights for policy 0, policy_version 92833 (0.0008) [2023-12-26 00:19:19,195][123091] Updated weights for policy 0, policy_version 92843 (0.0009) [2023-12-26 00:19:19,276][123091] Updated weights for policy 0, policy_version 92853 (0.0009) [2023-12-26 00:19:19,345][123091] Updated weights for policy 0, policy_version 92863 (0.0009) [2023-12-26 00:19:19,508][123090] Updated weights for policy 1, policy_version 92355 (0.0011) [2023-12-26 00:19:19,576][123090] Updated weights for policy 1, policy_version 92365 (0.0011) [2023-12-26 00:19:19,650][123090] Updated weights for policy 1, policy_version 92375 (0.0010) [2023-12-26 00:19:20,275][123091] Updated weights for policy 0, policy_version 92873 (0.0009) [2023-12-26 00:19:20,347][123091] Updated weights for policy 0, policy_version 92883 (0.0010) [2023-12-26 00:19:20,419][123091] Updated weights for policy 0, policy_version 92893 (0.0010) [2023-12-26 00:19:20,436][123090] Updated weights for policy 1, policy_version 92385 (0.0007) [2023-12-26 00:19:20,494][123090] Updated weights for policy 1, policy_version 92395 (0.0005) [2023-12-26 00:19:20,552][123090] Updated weights for policy 1, policy_version 92405 (0.0008) [2023-12-26 00:19:20,615][123090] Updated weights for policy 1, policy_version 92415 (0.0007) [2023-12-26 00:19:21,234][123091] Updated weights for policy 0, policy_version 92903 (0.0009) [2023-12-26 00:19:21,295][123091] Updated weights for policy 0, policy_version 92913 (0.0009) [2023-12-26 00:19:21,345][123091] Updated weights for policy 0, policy_version 92923 (0.0008) [2023-12-26 00:19:21,391][123090] Updated weights for policy 1, policy_version 92425 (0.0008) [2023-12-26 00:19:21,458][123090] Updated weights for policy 1, policy_version 92435 (0.0008) [2023-12-26 00:19:21,520][123090] Updated weights for policy 1, policy_version 92445 (0.0008) [2023-12-26 00:19:22,240][123091] Updated weights for policy 0, policy_version 92933 (0.0009) [2023-12-26 00:19:22,301][123091] Updated weights for policy 0, policy_version 92943 (0.0010) [2023-12-26 00:19:22,342][123090] Updated weights for policy 1, policy_version 92455 (0.0008) [2023-12-26 00:19:22,368][123091] Updated weights for policy 0, policy_version 92953 (0.0008) [2023-12-26 00:19:22,406][123090] Updated weights for policy 1, policy_version 92465 (0.0010) [2023-12-26 00:19:22,469][123090] Updated weights for policy 1, policy_version 92475 (0.0009) [2023-12-26 00:19:23,243][123091] Updated weights for policy 0, policy_version 92963 (0.0009) [2023-12-26 00:19:23,286][123090] Updated weights for policy 1, policy_version 92485 (0.0010) [2023-12-26 00:19:23,336][123091] Updated weights for policy 0, policy_version 92973 (0.0009) [2023-12-26 00:19:23,342][123090] Updated weights for policy 1, policy_version 92495 (0.0008) [2023-12-26 00:19:23,393][123090] Updated weights for policy 1, policy_version 92505 (0.0007) [2023-12-26 00:19:23,403][123091] Updated weights for policy 0, policy_version 92983 (0.0009) [2023-12-26 00:19:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 47489024. Throughput: 0: 8921.2, 1: 8653.9. Samples: 47465856. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:23,785][121949] Avg episode reward: [(0, '4714.403'), (1, '5500.611')] [2023-12-26 00:19:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000092512_23683072.pth... [2023-12-26 00:19:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000092992_23805952.pth... [2023-12-26 00:19:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000091520_23429120.pth [2023-12-26 00:19:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000091968_23543808.pth [2023-12-26 00:19:24,193][123091] Updated weights for policy 0, policy_version 92993 (0.0008) [2023-12-26 00:19:24,234][123090] Updated weights for policy 1, policy_version 92515 (0.0007) [2023-12-26 00:19:24,245][123091] Updated weights for policy 0, policy_version 93003 (0.0009) [2023-12-26 00:19:24,305][123090] Updated weights for policy 1, policy_version 92525 (0.0010) [2023-12-26 00:19:24,318][123091] Updated weights for policy 0, policy_version 93013 (0.0007) [2023-12-26 00:19:24,374][123090] Updated weights for policy 1, policy_version 92535 (0.0009) [2023-12-26 00:19:24,392][123091] Updated weights for policy 0, policy_version 93023 (0.0006) [2023-12-26 00:19:25,194][123091] Updated weights for policy 0, policy_version 93033 (0.0010) [2023-12-26 00:19:25,207][123090] Updated weights for policy 1, policy_version 92545 (0.0009) [2023-12-26 00:19:25,253][123091] Updated weights for policy 0, policy_version 93043 (0.0008) [2023-12-26 00:19:25,260][123090] Updated weights for policy 1, policy_version 92555 (0.0008) [2023-12-26 00:19:25,306][123091] Updated weights for policy 0, policy_version 93053 (0.0006) [2023-12-26 00:19:25,320][123090] Updated weights for policy 1, policy_version 92565 (0.0010) [2023-12-26 00:19:25,374][123090] Updated weights for policy 1, policy_version 92575 (0.0009) [2023-12-26 00:19:26,131][123091] Updated weights for policy 0, policy_version 93063 (0.0008) [2023-12-26 00:19:26,179][123091] Updated weights for policy 0, policy_version 93073 (0.0009) [2023-12-26 00:19:26,192][123090] Updated weights for policy 1, policy_version 92585 (0.0006) [2023-12-26 00:19:26,241][123090] Updated weights for policy 1, policy_version 92595 (0.0007) [2023-12-26 00:19:26,242][123091] Updated weights for policy 0, policy_version 93083 (0.0010) [2023-12-26 00:19:26,310][123090] Updated weights for policy 1, policy_version 92605 (0.0008) [2023-12-26 00:19:26,961][123091] Updated weights for policy 0, policy_version 93093 (0.0010) [2023-12-26 00:19:27,012][123091] Updated weights for policy 0, policy_version 93103 (0.0010) [2023-12-26 00:19:27,055][123091] Updated weights for policy 0, policy_version 93113 (0.0010) [2023-12-26 00:19:27,159][123090] Updated weights for policy 1, policy_version 92615 (0.0009) [2023-12-26 00:19:27,210][123090] Updated weights for policy 1, policy_version 92625 (0.0009) [2023-12-26 00:19:27,268][123090] Updated weights for policy 1, policy_version 92635 (0.0009) [2023-12-26 00:19:27,818][123091] Updated weights for policy 0, policy_version 93123 (0.0009) [2023-12-26 00:19:27,868][123091] Updated weights for policy 0, policy_version 93133 (0.0005) [2023-12-26 00:19:27,919][123091] Updated weights for policy 0, policy_version 93143 (0.0005) [2023-12-26 00:19:28,172][123090] Updated weights for policy 1, policy_version 92645 (0.0009) [2023-12-26 00:19:28,223][123090] Updated weights for policy 1, policy_version 92655 (0.0009) [2023-12-26 00:19:28,278][123090] Updated weights for policy 1, policy_version 92665 (0.0009) [2023-12-26 00:19:28,624][123091] Updated weights for policy 0, policy_version 93153 (0.0006) [2023-12-26 00:19:28,674][123091] Updated weights for policy 0, policy_version 93163 (0.0009) [2023-12-26 00:19:28,721][123091] Updated weights for policy 0, policy_version 93173 (0.0008) [2023-12-26 00:19:28,769][123091] Updated weights for policy 0, policy_version 93183 (0.0009) [2023-12-26 00:19:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 47579136. Throughput: 0: 8855.0, 1: 8617.6. Samples: 47569368. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:28,784][121949] Avg episode reward: [(0, '4749.781'), (1, '5431.017')] [2023-12-26 00:19:29,105][123090] Updated weights for policy 1, policy_version 92675 (0.0008) [2023-12-26 00:19:29,168][123090] Updated weights for policy 1, policy_version 92685 (0.0005) [2023-12-26 00:19:29,232][123090] Updated weights for policy 1, policy_version 92695 (0.0007) [2023-12-26 00:19:29,705][123091] Updated weights for policy 0, policy_version 93193 (0.0009) [2023-12-26 00:19:29,754][123091] Updated weights for policy 0, policy_version 93203 (0.0009) [2023-12-26 00:19:29,802][123091] Updated weights for policy 0, policy_version 93213 (0.0009) [2023-12-26 00:19:29,996][123090] Updated weights for policy 1, policy_version 92705 (0.0008) [2023-12-26 00:19:30,058][123090] Updated weights for policy 1, policy_version 92715 (0.0009) [2023-12-26 00:19:30,121][123090] Updated weights for policy 1, policy_version 92725 (0.0007) [2023-12-26 00:19:30,188][123090] Updated weights for policy 1, policy_version 92735 (0.0005) [2023-12-26 00:19:30,618][123091] Updated weights for policy 0, policy_version 93223 (0.0006) [2023-12-26 00:19:30,671][123091] Updated weights for policy 0, policy_version 93233 (0.0005) [2023-12-26 00:19:30,728][123091] Updated weights for policy 0, policy_version 93243 (0.0006) [2023-12-26 00:19:30,995][123090] Updated weights for policy 1, policy_version 92745 (0.0009) [2023-12-26 00:19:31,063][123090] Updated weights for policy 1, policy_version 92755 (0.0009) [2023-12-26 00:19:31,119][123090] Updated weights for policy 1, policy_version 92765 (0.0009) [2023-12-26 00:19:31,346][123091] Updated weights for policy 0, policy_version 93253 (0.0006) [2023-12-26 00:19:31,421][123091] Updated weights for policy 0, policy_version 93263 (0.0010) [2023-12-26 00:19:31,488][123091] Updated weights for policy 0, policy_version 93273 (0.0011) [2023-12-26 00:19:31,964][123090] Updated weights for policy 1, policy_version 92775 (0.0008) [2023-12-26 00:19:32,024][123090] Updated weights for policy 1, policy_version 92785 (0.0010) [2023-12-26 00:19:32,081][123090] Updated weights for policy 1, policy_version 92795 (0.0009) [2023-12-26 00:19:32,265][123091] Updated weights for policy 0, policy_version 93283 (0.0010) [2023-12-26 00:19:32,323][123091] Updated weights for policy 0, policy_version 93293 (0.0010) [2023-12-26 00:19:32,388][123091] Updated weights for policy 0, policy_version 93303 (0.0009) [2023-12-26 00:19:32,903][123090] Updated weights for policy 1, policy_version 92805 (0.0010) [2023-12-26 00:19:32,964][123090] Updated weights for policy 1, policy_version 92815 (0.0009) [2023-12-26 00:19:33,019][123090] Updated weights for policy 1, policy_version 92825 (0.0009) [2023-12-26 00:19:33,157][123091] Updated weights for policy 0, policy_version 93313 (0.0009) [2023-12-26 00:19:33,217][123091] Updated weights for policy 0, policy_version 93323 (0.0005) [2023-12-26 00:19:33,273][123091] Updated weights for policy 0, policy_version 93333 (0.0005) [2023-12-26 00:19:33,329][123091] Updated weights for policy 0, policy_version 93343 (0.0006) [2023-12-26 00:19:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 47661056. Throughput: 0: 8919.2, 1: 8566.8. Samples: 47675608. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:33,785][121949] Avg episode reward: [(0, '4792.138'), (1, '5399.741')] [2023-12-26 00:19:33,911][123090] Updated weights for policy 1, policy_version 92835 (0.0008) [2023-12-26 00:19:33,972][123091] Updated weights for policy 0, policy_version 93353 (0.0010) [2023-12-26 00:19:33,975][123090] Updated weights for policy 1, policy_version 92845 (0.0006) [2023-12-26 00:19:34,034][123091] Updated weights for policy 0, policy_version 93363 (0.0010) [2023-12-26 00:19:34,041][123090] Updated weights for policy 1, policy_version 92855 (0.0005) [2023-12-26 00:19:34,093][123091] Updated weights for policy 0, policy_version 93373 (0.0010) [2023-12-26 00:19:34,856][123091] Updated weights for policy 0, policy_version 93383 (0.0007) [2023-12-26 00:19:34,903][123090] Updated weights for policy 1, policy_version 92865 (0.0006) [2023-12-26 00:19:34,916][123091] Updated weights for policy 0, policy_version 93393 (0.0005) [2023-12-26 00:19:34,955][123090] Updated weights for policy 1, policy_version 92875 (0.0009) [2023-12-26 00:19:34,991][123091] Updated weights for policy 0, policy_version 93403 (0.0006) [2023-12-26 00:19:35,016][123090] Updated weights for policy 1, policy_version 92885 (0.0008) [2023-12-26 00:19:35,077][123090] Updated weights for policy 1, policy_version 92895 (0.0009) [2023-12-26 00:19:35,721][123091] Updated weights for policy 0, policy_version 93413 (0.0010) [2023-12-26 00:19:35,775][123091] Updated weights for policy 0, policy_version 93423 (0.0010) [2023-12-26 00:19:35,823][123091] Updated weights for policy 0, policy_version 93433 (0.0010) [2023-12-26 00:19:35,881][123090] Updated weights for policy 1, policy_version 92905 (0.0008) [2023-12-26 00:19:35,949][123090] Updated weights for policy 1, policy_version 92915 (0.0009) [2023-12-26 00:19:36,019][123090] Updated weights for policy 1, policy_version 92925 (0.0009) [2023-12-26 00:19:36,677][123091] Updated weights for policy 0, policy_version 93443 (0.0010) [2023-12-26 00:19:36,745][123091] Updated weights for policy 0, policy_version 93453 (0.0011) [2023-12-26 00:19:36,812][123091] Updated weights for policy 0, policy_version 93463 (0.0011) [2023-12-26 00:19:36,836][123090] Updated weights for policy 1, policy_version 92935 (0.0008) [2023-12-26 00:19:36,900][123090] Updated weights for policy 1, policy_version 92945 (0.0008) [2023-12-26 00:19:36,964][123090] Updated weights for policy 1, policy_version 92955 (0.0009) [2023-12-26 00:19:37,579][123091] Updated weights for policy 0, policy_version 93473 (0.0011) [2023-12-26 00:19:37,642][123091] Updated weights for policy 0, policy_version 93483 (0.0007) [2023-12-26 00:19:37,699][123091] Updated weights for policy 0, policy_version 93493 (0.0006) [2023-12-26 00:19:37,751][123091] Updated weights for policy 0, policy_version 93503 (0.0005) [2023-12-26 00:19:37,779][123090] Updated weights for policy 1, policy_version 92965 (0.0008) [2023-12-26 00:19:37,846][123090] Updated weights for policy 1, policy_version 92975 (0.0006) [2023-12-26 00:19:37,908][123090] Updated weights for policy 1, policy_version 92985 (0.0011) [2023-12-26 00:19:38,482][123091] Updated weights for policy 0, policy_version 93513 (0.0010) [2023-12-26 00:19:38,545][123091] Updated weights for policy 0, policy_version 93523 (0.0011) [2023-12-26 00:19:38,604][123091] Updated weights for policy 0, policy_version 93533 (0.0011) [2023-12-26 00:19:38,749][123090] Updated weights for policy 1, policy_version 92995 (0.0010) [2023-12-26 00:19:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 47751168. Throughput: 0: 8983.7, 1: 8557.2. Samples: 47728788. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 00:19:38,785][121949] Avg episode reward: [(0, '4682.440'), (1, '5289.574')] [2023-12-26 00:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000093536_23945216.pth... [2023-12-26 00:19:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000092480_23674880.pth [2023-12-26 00:19:38,809][123090] Updated weights for policy 1, policy_version 93005 (0.0008) [2023-12-26 00:19:38,874][123090] Updated weights for policy 1, policy_version 93015 (0.0009) [2023-12-26 00:19:38,931][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000093024_23814144.pth... [2023-12-26 00:19:38,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000092032_23560192.pth [2023-12-26 00:19:39,439][123091] Updated weights for policy 0, policy_version 93543 (0.0010) [2023-12-26 00:19:39,504][123091] Updated weights for policy 0, policy_version 93553 (0.0009) [2023-12-26 00:19:39,556][123091] Updated weights for policy 0, policy_version 93563 (0.0009) [2023-12-26 00:19:39,717][123090] Updated weights for policy 1, policy_version 93025 (0.0009) [2023-12-26 00:19:39,786][123090] Updated weights for policy 1, policy_version 93035 (0.0010) [2023-12-26 00:19:39,862][123090] Updated weights for policy 1, policy_version 93045 (0.0010) [2023-12-26 00:19:39,926][123090] Updated weights for policy 1, policy_version 93055 (0.0009) [2023-12-26 00:19:40,384][123091] Updated weights for policy 0, policy_version 93573 (0.0010) [2023-12-26 00:19:40,451][123091] Updated weights for policy 0, policy_version 93583 (0.0010) [2023-12-26 00:19:40,512][123091] Updated weights for policy 0, policy_version 93593 (0.0010) [2023-12-26 00:19:40,710][123090] Updated weights for policy 1, policy_version 93065 (0.0006) [2023-12-26 00:19:40,781][123090] Updated weights for policy 1, policy_version 93075 (0.0008) [2023-12-26 00:19:40,846][123090] Updated weights for policy 1, policy_version 93085 (0.0009) [2023-12-26 00:19:41,321][123091] Updated weights for policy 0, policy_version 93603 (0.0007) [2023-12-26 00:19:41,388][123091] Updated weights for policy 0, policy_version 93613 (0.0009) [2023-12-26 00:19:41,442][123091] Updated weights for policy 0, policy_version 93623 (0.0009) [2023-12-26 00:19:41,669][123090] Updated weights for policy 1, policy_version 93095 (0.0009) [2023-12-26 00:19:41,739][123090] Updated weights for policy 1, policy_version 93105 (0.0009) [2023-12-26 00:19:41,797][123090] Updated weights for policy 1, policy_version 93115 (0.0009) [2023-12-26 00:19:42,322][123091] Updated weights for policy 0, policy_version 93633 (0.0009) [2023-12-26 00:19:42,385][123091] Updated weights for policy 0, policy_version 93643 (0.0009) [2023-12-26 00:19:42,443][123091] Updated weights for policy 0, policy_version 93653 (0.0010) [2023-12-26 00:19:42,497][123091] Updated weights for policy 0, policy_version 93663 (0.0010) [2023-12-26 00:19:42,633][123090] Updated weights for policy 1, policy_version 93125 (0.0007) [2023-12-26 00:19:42,705][123090] Updated weights for policy 1, policy_version 93135 (0.0005) [2023-12-26 00:19:42,777][123090] Updated weights for policy 1, policy_version 93145 (0.0005) [2023-12-26 00:19:43,374][123091] Updated weights for policy 0, policy_version 93673 (0.0011) [2023-12-26 00:19:43,418][123091] Updated weights for policy 0, policy_version 93683 (0.0010) [2023-12-26 00:19:43,466][123091] Updated weights for policy 0, policy_version 93693 (0.0010) [2023-12-26 00:19:43,521][123090] Updated weights for policy 1, policy_version 93155 (0.0009) [2023-12-26 00:19:43,569][123090] Updated weights for policy 1, policy_version 93165 (0.0008) [2023-12-26 00:19:43,616][123090] Updated weights for policy 1, policy_version 93175 (0.0008) [2023-12-26 00:19:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 47841280. Throughput: 0: 8808.9, 1: 8553.3. Samples: 47831396. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:19:43,785][121949] Avg episode reward: [(0, '4675.662'), (1, '5390.024')] [2023-12-26 00:19:44,328][123091] Updated weights for policy 0, policy_version 93703 (0.0010) [2023-12-26 00:19:44,391][123091] Updated weights for policy 0, policy_version 93713 (0.0011) [2023-12-26 00:19:44,434][123091] Updated weights for policy 0, policy_version 93723 (0.0010) [2023-12-26 00:19:44,465][123090] Updated weights for policy 1, policy_version 93185 (0.0009) [2023-12-26 00:19:44,516][123090] Updated weights for policy 1, policy_version 93195 (0.0008) [2023-12-26 00:19:44,577][123090] Updated weights for policy 1, policy_version 93205 (0.0008) [2023-12-26 00:19:44,637][123090] Updated weights for policy 1, policy_version 93215 (0.0009) [2023-12-26 00:19:45,280][123091] Updated weights for policy 0, policy_version 93733 (0.0011) [2023-12-26 00:19:45,332][123091] Updated weights for policy 0, policy_version 93743 (0.0011) [2023-12-26 00:19:45,385][123091] Updated weights for policy 0, policy_version 93753 (0.0011) [2023-12-26 00:19:45,485][123090] Updated weights for policy 1, policy_version 93225 (0.0008) [2023-12-26 00:19:45,544][123090] Updated weights for policy 1, policy_version 93235 (0.0009) [2023-12-26 00:19:45,605][123090] Updated weights for policy 1, policy_version 93245 (0.0010) [2023-12-26 00:19:46,249][123091] Updated weights for policy 0, policy_version 93763 (0.0011) [2023-12-26 00:19:46,300][123091] Updated weights for policy 0, policy_version 93773 (0.0010) [2023-12-26 00:19:46,332][123090] Updated weights for policy 1, policy_version 93255 (0.0010) [2023-12-26 00:19:46,348][123091] Updated weights for policy 0, policy_version 93783 (0.0010) [2023-12-26 00:19:46,398][123090] Updated weights for policy 1, policy_version 93265 (0.0008) [2023-12-26 00:19:46,458][123090] Updated weights for policy 1, policy_version 93275 (0.0009) [2023-12-26 00:19:47,206][123091] Updated weights for policy 0, policy_version 93793 (0.0010) [2023-12-26 00:19:47,213][123090] Updated weights for policy 1, policy_version 93285 (0.0009) [2023-12-26 00:19:47,274][123091] Updated weights for policy 0, policy_version 93803 (0.0005) [2023-12-26 00:19:47,277][123090] Updated weights for policy 1, policy_version 93295 (0.0008) [2023-12-26 00:19:47,341][123091] Updated weights for policy 0, policy_version 93813 (0.0006) [2023-12-26 00:19:47,343][123090] Updated weights for policy 1, policy_version 93305 (0.0008) [2023-12-26 00:19:47,414][123091] Updated weights for policy 0, policy_version 93823 (0.0010) [2023-12-26 00:19:48,062][123091] Updated weights for policy 0, policy_version 93833 (0.0006) [2023-12-26 00:19:48,113][123090] Updated weights for policy 1, policy_version 93315 (0.0005) [2023-12-26 00:19:48,135][123091] Updated weights for policy 0, policy_version 93843 (0.0006) [2023-12-26 00:19:48,171][123090] Updated weights for policy 1, policy_version 93325 (0.0005) [2023-12-26 00:19:48,206][123091] Updated weights for policy 0, policy_version 93853 (0.0006) [2023-12-26 00:19:48,226][123090] Updated weights for policy 1, policy_version 93335 (0.0006) [2023-12-26 00:19:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 47923200. Throughput: 0: 8836.6, 1: 8547.3. Samples: 47937584. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:19:48,785][121949] Avg episode reward: [(0, '4757.477'), (1, '5497.787')] [2023-12-26 00:19:48,934][123090] Updated weights for policy 1, policy_version 93345 (0.0006) [2023-12-26 00:19:49,002][123090] Updated weights for policy 1, policy_version 93355 (0.0009) [2023-12-26 00:19:49,017][123091] Updated weights for policy 0, policy_version 93863 (0.0009) [2023-12-26 00:19:49,056][123090] Updated weights for policy 1, policy_version 93365 (0.0008) [2023-12-26 00:19:49,074][123091] Updated weights for policy 0, policy_version 93873 (0.0011) [2023-12-26 00:19:49,116][123090] Updated weights for policy 1, policy_version 93375 (0.0009) [2023-12-26 00:19:49,125][123091] Updated weights for policy 0, policy_version 93883 (0.0010) [2023-12-26 00:19:49,891][123091] Updated weights for policy 0, policy_version 93893 (0.0009) [2023-12-26 00:19:49,958][123091] Updated weights for policy 0, policy_version 93903 (0.0008) [2023-12-26 00:19:49,991][123090] Updated weights for policy 1, policy_version 93385 (0.0009) [2023-12-26 00:19:50,014][123091] Updated weights for policy 0, policy_version 93913 (0.0009) [2023-12-26 00:19:50,056][123090] Updated weights for policy 1, policy_version 93395 (0.0008) [2023-12-26 00:19:50,110][123090] Updated weights for policy 1, policy_version 93405 (0.0009) [2023-12-26 00:19:50,809][123091] Updated weights for policy 0, policy_version 93923 (0.0009) [2023-12-26 00:19:50,872][123091] Updated weights for policy 0, policy_version 93933 (0.0009) [2023-12-26 00:19:50,927][123091] Updated weights for policy 0, policy_version 93943 (0.0010) [2023-12-26 00:19:50,967][123090] Updated weights for policy 1, policy_version 93415 (0.0009) [2023-12-26 00:19:51,037][123090] Updated weights for policy 1, policy_version 93425 (0.0010) [2023-12-26 00:19:51,109][123090] Updated weights for policy 1, policy_version 93435 (0.0007) [2023-12-26 00:19:51,712][123091] Updated weights for policy 0, policy_version 93953 (0.0007) [2023-12-26 00:19:51,782][123091] Updated weights for policy 0, policy_version 93963 (0.0011) [2023-12-26 00:19:51,853][123091] Updated weights for policy 0, policy_version 93973 (0.0010) [2023-12-26 00:19:51,885][123090] Updated weights for policy 1, policy_version 93445 (0.0007) [2023-12-26 00:19:51,922][123091] Updated weights for policy 0, policy_version 93983 (0.0011) [2023-12-26 00:19:51,947][123090] Updated weights for policy 1, policy_version 93455 (0.0007) [2023-12-26 00:19:52,018][123090] Updated weights for policy 1, policy_version 93465 (0.0009) [2023-12-26 00:19:52,766][123091] Updated weights for policy 0, policy_version 93993 (0.0006) [2023-12-26 00:19:52,827][123091] Updated weights for policy 0, policy_version 94003 (0.0005) [2023-12-26 00:19:52,882][123090] Updated weights for policy 1, policy_version 93475 (0.0009) [2023-12-26 00:19:52,888][123091] Updated weights for policy 0, policy_version 94013 (0.0006) [2023-12-26 00:19:52,947][123090] Updated weights for policy 1, policy_version 93485 (0.0010) [2023-12-26 00:19:53,002][123090] Updated weights for policy 1, policy_version 93496 (0.0010) [2023-12-26 00:19:53,557][123091] Updated weights for policy 0, policy_version 94023 (0.0005) [2023-12-26 00:19:53,622][123091] Updated weights for policy 0, policy_version 94033 (0.0005) [2023-12-26 00:19:53,686][123091] Updated weights for policy 0, policy_version 94043 (0.0005) [2023-12-26 00:19:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 48013312. Throughput: 0: 8814.4, 1: 8506.4. Samples: 47989180. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:19:53,785][121949] Avg episode reward: [(0, '4824.132'), (1, '5604.479')] [2023-12-26 00:19:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000094048_24076288.pth... [2023-12-26 00:19:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000093504_23937024.pth... [2023-12-26 00:19:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000092512_23683072.pth [2023-12-26 00:19:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000092992_23805952.pth [2023-12-26 00:19:53,843][123090] Updated weights for policy 1, policy_version 93507 (0.0011) [2023-12-26 00:19:53,910][123090] Updated weights for policy 1, policy_version 93517 (0.0009) [2023-12-26 00:19:53,973][123090] Updated weights for policy 1, policy_version 93527 (0.0010) [2023-12-26 00:19:54,377][123091] Updated weights for policy 0, policy_version 94053 (0.0007) [2023-12-26 00:19:54,426][123091] Updated weights for policy 0, policy_version 94063 (0.0009) [2023-12-26 00:19:54,482][123091] Updated weights for policy 0, policy_version 94073 (0.0009) [2023-12-26 00:19:54,818][123090] Updated weights for policy 1, policy_version 93537 (0.0010) [2023-12-26 00:19:54,879][123090] Updated weights for policy 1, policy_version 93547 (0.0009) [2023-12-26 00:19:54,945][123090] Updated weights for policy 1, policy_version 93557 (0.0008) [2023-12-26 00:19:55,024][123090] Updated weights for policy 1, policy_version 93567 (0.0006) [2023-12-26 00:19:55,343][123091] Updated weights for policy 0, policy_version 94083 (0.0010) [2023-12-26 00:19:55,404][123091] Updated weights for policy 0, policy_version 94093 (0.0010) [2023-12-26 00:19:55,448][123091] Updated weights for policy 0, policy_version 94103 (0.0010) [2023-12-26 00:19:55,761][123090] Updated weights for policy 1, policy_version 93577 (0.0008) [2023-12-26 00:19:55,810][123090] Updated weights for policy 1, policy_version 93587 (0.0009) [2023-12-26 00:19:55,862][123090] Updated weights for policy 1, policy_version 93597 (0.0008) [2023-12-26 00:19:56,248][123091] Updated weights for policy 0, policy_version 94113 (0.0010) [2023-12-26 00:19:56,303][123091] Updated weights for policy 0, policy_version 94123 (0.0005) [2023-12-26 00:19:56,362][123091] Updated weights for policy 0, policy_version 94133 (0.0005) [2023-12-26 00:19:56,406][123091] Updated weights for policy 0, policy_version 94143 (0.0005) [2023-12-26 00:19:56,790][123090] Updated weights for policy 1, policy_version 93607 (0.0009) [2023-12-26 00:19:56,845][123090] Updated weights for policy 1, policy_version 93617 (0.0009) [2023-12-26 00:19:56,902][123090] Updated weights for policy 1, policy_version 93627 (0.0009) [2023-12-26 00:19:57,029][123091] Updated weights for policy 0, policy_version 94153 (0.0009) [2023-12-26 00:19:57,083][123091] Updated weights for policy 0, policy_version 94163 (0.0008) [2023-12-26 00:19:57,135][123091] Updated weights for policy 0, policy_version 94173 (0.0009) [2023-12-26 00:19:57,714][123090] Updated weights for policy 1, policy_version 93637 (0.0009) [2023-12-26 00:19:57,774][123090] Updated weights for policy 1, policy_version 93647 (0.0009) [2023-12-26 00:19:57,831][123090] Updated weights for policy 1, policy_version 93657 (0.0009) [2023-12-26 00:19:57,900][123091] Updated weights for policy 0, policy_version 94183 (0.0005) [2023-12-26 00:19:57,960][123091] Updated weights for policy 0, policy_version 94193 (0.0005) [2023-12-26 00:19:58,027][123091] Updated weights for policy 0, policy_version 94203 (0.0010) [2023-12-26 00:19:58,713][123090] Updated weights for policy 1, policy_version 93667 (0.0009) [2023-12-26 00:19:58,780][123090] Updated weights for policy 1, policy_version 93677 (0.0009) [2023-12-26 00:19:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17633.6). Total num frames: 48095232. Throughput: 0: 8875.2, 1: 8541.6. Samples: 48095812. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:19:58,785][121949] Avg episode reward: [(0, '4793.323'), (1, '5625.053')] [2023-12-26 00:19:58,809][123091] Updated weights for policy 0, policy_version 94213 (0.0010) [2023-12-26 00:19:58,834][123090] Updated weights for policy 1, policy_version 93687 (0.0008) [2023-12-26 00:19:58,870][123091] Updated weights for policy 0, policy_version 94223 (0.0009) [2023-12-26 00:19:58,920][123091] Updated weights for policy 0, policy_version 94233 (0.0008) [2023-12-26 00:19:59,667][123091] Updated weights for policy 0, policy_version 94243 (0.0008) [2023-12-26 00:19:59,702][123090] Updated weights for policy 1, policy_version 93697 (0.0006) [2023-12-26 00:19:59,733][123091] Updated weights for policy 0, policy_version 94253 (0.0010) [2023-12-26 00:19:59,766][123090] Updated weights for policy 1, policy_version 93707 (0.0007) [2023-12-26 00:19:59,794][123091] Updated weights for policy 0, policy_version 94263 (0.0007) [2023-12-26 00:19:59,834][123090] Updated weights for policy 1, policy_version 93717 (0.0010) [2023-12-26 00:19:59,906][123090] Updated weights for policy 1, policy_version 93727 (0.0009) [2023-12-26 00:20:00,520][123091] Updated weights for policy 0, policy_version 94273 (0.0007) [2023-12-26 00:20:00,566][123091] Updated weights for policy 0, policy_version 94283 (0.0005) [2023-12-26 00:20:00,619][123091] Updated weights for policy 0, policy_version 94293 (0.0005) [2023-12-26 00:20:00,665][123091] Updated weights for policy 0, policy_version 94303 (0.0005) [2023-12-26 00:20:00,782][123090] Updated weights for policy 1, policy_version 93737 (0.0010) [2023-12-26 00:20:00,835][123090] Updated weights for policy 1, policy_version 93747 (0.0009) [2023-12-26 00:20:00,888][123090] Updated weights for policy 1, policy_version 93757 (0.0010) [2023-12-26 00:20:01,410][123091] Updated weights for policy 0, policy_version 94313 (0.0008) [2023-12-26 00:20:01,456][123091] Updated weights for policy 0, policy_version 94323 (0.0008) [2023-12-26 00:20:01,500][123091] Updated weights for policy 0, policy_version 94333 (0.0008) [2023-12-26 00:20:01,820][123090] Updated weights for policy 1, policy_version 93767 (0.0010) [2023-12-26 00:20:01,875][123090] Updated weights for policy 1, policy_version 93777 (0.0010) [2023-12-26 00:20:01,935][123090] Updated weights for policy 1, policy_version 93787 (0.0010) [2023-12-26 00:20:02,305][123091] Updated weights for policy 0, policy_version 94343 (0.0009) [2023-12-26 00:20:02,360][123091] Updated weights for policy 0, policy_version 94353 (0.0009) [2023-12-26 00:20:02,409][123091] Updated weights for policy 0, policy_version 94364 (0.0010) [2023-12-26 00:20:02,787][123090] Updated weights for policy 1, policy_version 93797 (0.0009) [2023-12-26 00:20:02,846][123090] Updated weights for policy 1, policy_version 93807 (0.0009) [2023-12-26 00:20:02,903][123090] Updated weights for policy 1, policy_version 93817 (0.0009) [2023-12-26 00:20:03,233][123091] Updated weights for policy 0, policy_version 94374 (0.0010) [2023-12-26 00:20:03,293][123091] Updated weights for policy 0, policy_version 94384 (0.0009) [2023-12-26 00:20:03,351][123091] Updated weights for policy 0, policy_version 94394 (0.0009) [2023-12-26 00:20:03,720][123090] Updated weights for policy 1, policy_version 93827 (0.0010) [2023-12-26 00:20:03,768][123090] Updated weights for policy 1, policy_version 93837 (0.0009) [2023-12-26 00:20:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 48185344. Throughput: 0: 8913.6, 1: 8522.3. Samples: 48199956. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:03,784][121949] Avg episode reward: [(0, '4797.989'), (1, '5437.672')] [2023-12-26 00:20:03,816][123090] Updated weights for policy 1, policy_version 93847 (0.0009) [2023-12-26 00:20:04,198][123091] Updated weights for policy 0, policy_version 94404 (0.0009) [2023-12-26 00:20:04,250][123091] Updated weights for policy 0, policy_version 94414 (0.0009) [2023-12-26 00:20:04,312][123091] Updated weights for policy 0, policy_version 94424 (0.0010) [2023-12-26 00:20:04,667][123090] Updated weights for policy 1, policy_version 93857 (0.0007) [2023-12-26 00:20:04,721][123090] Updated weights for policy 1, policy_version 93867 (0.0008) [2023-12-26 00:20:04,770][123090] Updated weights for policy 1, policy_version 93877 (0.0009) [2023-12-26 00:20:04,824][123090] Updated weights for policy 1, policy_version 93887 (0.0009) [2023-12-26 00:20:05,190][123091] Updated weights for policy 0, policy_version 94434 (0.0009) [2023-12-26 00:20:05,244][123091] Updated weights for policy 0, policy_version 94444 (0.0010) [2023-12-26 00:20:05,311][123091] Updated weights for policy 0, policy_version 94454 (0.0009) [2023-12-26 00:20:05,362][123091] Updated weights for policy 0, policy_version 94464 (0.0009) [2023-12-26 00:20:05,585][123090] Updated weights for policy 1, policy_version 93897 (0.0005) [2023-12-26 00:20:05,638][123090] Updated weights for policy 1, policy_version 93907 (0.0005) [2023-12-26 00:20:05,691][123090] Updated weights for policy 1, policy_version 93917 (0.0006) [2023-12-26 00:20:06,269][123091] Updated weights for policy 0, policy_version 94474 (0.0010) [2023-12-26 00:20:06,328][123091] Updated weights for policy 0, policy_version 94484 (0.0010) [2023-12-26 00:20:06,391][123091] Updated weights for policy 0, policy_version 94494 (0.0010) [2023-12-26 00:20:06,439][123090] Updated weights for policy 1, policy_version 93927 (0.0008) [2023-12-26 00:20:06,499][123090] Updated weights for policy 1, policy_version 93937 (0.0009) [2023-12-26 00:20:06,570][123090] Updated weights for policy 1, policy_version 93948 (0.0010) [2023-12-26 00:20:07,238][123091] Updated weights for policy 0, policy_version 94504 (0.0009) [2023-12-26 00:20:07,290][123091] Updated weights for policy 0, policy_version 94514 (0.0010) [2023-12-26 00:20:07,355][123091] Updated weights for policy 0, policy_version 94524 (0.0009) [2023-12-26 00:20:07,363][123090] Updated weights for policy 1, policy_version 93958 (0.0008) [2023-12-26 00:20:07,415][123090] Updated weights for policy 1, policy_version 93968 (0.0009) [2023-12-26 00:20:07,464][123090] Updated weights for policy 1, policy_version 93978 (0.0007) [2023-12-26 00:20:08,209][123091] Updated weights for policy 0, policy_version 94535 (0.0010) [2023-12-26 00:20:08,260][123091] Updated weights for policy 0, policy_version 94545 (0.0009) [2023-12-26 00:20:08,276][123090] Updated weights for policy 1, policy_version 93988 (0.0007) [2023-12-26 00:20:08,316][123091] Updated weights for policy 0, policy_version 94555 (0.0008) [2023-12-26 00:20:08,343][123090] Updated weights for policy 1, policy_version 93998 (0.0010) [2023-12-26 00:20:08,412][123090] Updated weights for policy 1, policy_version 94008 (0.0009) [2023-12-26 00:20:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 48275456. Throughput: 0: 8917.9, 1: 8546.5. Samples: 48251756. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:08,785][121949] Avg episode reward: [(0, '4798.603'), (1, '5428.114')] [2023-12-26 00:20:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000094560_24207360.pth... [2023-12-26 00:20:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000094016_24068096.pth... [2023-12-26 00:20:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000093536_23945216.pth [2023-12-26 00:20:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000093024_23814144.pth [2023-12-26 00:20:09,147][123091] Updated weights for policy 0, policy_version 94565 (0.0009) [2023-12-26 00:20:09,206][123091] Updated weights for policy 0, policy_version 94575 (0.0008) [2023-12-26 00:20:09,249][123090] Updated weights for policy 1, policy_version 94018 (0.0009) [2023-12-26 00:20:09,274][123091] Updated weights for policy 0, policy_version 94585 (0.0009) [2023-12-26 00:20:09,312][123090] Updated weights for policy 1, policy_version 94028 (0.0009) [2023-12-26 00:20:09,383][123090] Updated weights for policy 1, policy_version 94038 (0.0010) [2023-12-26 00:20:09,456][123090] Updated weights for policy 1, policy_version 94048 (0.0010) [2023-12-26 00:20:10,118][123091] Updated weights for policy 0, policy_version 94595 (0.0008) [2023-12-26 00:20:10,183][123091] Updated weights for policy 0, policy_version 94605 (0.0006) [2023-12-26 00:20:10,236][123091] Updated weights for policy 0, policy_version 94615 (0.0005) [2023-12-26 00:20:10,244][123090] Updated weights for policy 1, policy_version 94058 (0.0011) [2023-12-26 00:20:10,313][123090] Updated weights for policy 1, policy_version 94068 (0.0011) [2023-12-26 00:20:10,374][123090] Updated weights for policy 1, policy_version 94078 (0.0010) [2023-12-26 00:20:10,981][123091] Updated weights for policy 0, policy_version 94625 (0.0007) [2023-12-26 00:20:11,052][123091] Updated weights for policy 0, policy_version 94635 (0.0009) [2023-12-26 00:20:11,126][123091] Updated weights for policy 0, policy_version 94645 (0.0009) [2023-12-26 00:20:11,186][123091] Updated weights for policy 0, policy_version 94655 (0.0010) [2023-12-26 00:20:11,211][123090] Updated weights for policy 1, policy_version 94088 (0.0011) [2023-12-26 00:20:11,275][123090] Updated weights for policy 1, policy_version 94098 (0.0011) [2023-12-26 00:20:11,341][123090] Updated weights for policy 1, policy_version 94108 (0.0010) [2023-12-26 00:20:12,047][123091] Updated weights for policy 0, policy_version 94665 (0.0008) [2023-12-26 00:20:12,110][123091] Updated weights for policy 0, policy_version 94675 (0.0008) [2023-12-26 00:20:12,166][123091] Updated weights for policy 0, policy_version 94685 (0.0008) [2023-12-26 00:20:12,225][123090] Updated weights for policy 1, policy_version 94118 (0.0009) [2023-12-26 00:20:12,294][123090] Updated weights for policy 1, policy_version 94128 (0.0009) [2023-12-26 00:20:12,369][123090] Updated weights for policy 1, policy_version 94138 (0.0009) [2023-12-26 00:20:12,978][123091] Updated weights for policy 0, policy_version 94695 (0.0009) [2023-12-26 00:20:13,042][123091] Updated weights for policy 0, policy_version 94705 (0.0009) [2023-12-26 00:20:13,099][123091] Updated weights for policy 0, policy_version 94715 (0.0010) [2023-12-26 00:20:13,181][123090] Updated weights for policy 1, policy_version 94148 (0.0009) [2023-12-26 00:20:13,244][123090] Updated weights for policy 1, policy_version 94158 (0.0009) [2023-12-26 00:20:13,308][123090] Updated weights for policy 1, policy_version 94168 (0.0009) [2023-12-26 00:20:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 48357376. Throughput: 0: 8887.9, 1: 8545.7. Samples: 48353884. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:13,785][121949] Avg episode reward: [(0, '4695.418'), (1, '5496.098')] [2023-12-26 00:20:13,831][123091] Updated weights for policy 0, policy_version 94725 (0.0009) [2023-12-26 00:20:13,887][123091] Updated weights for policy 0, policy_version 94735 (0.0009) [2023-12-26 00:20:13,942][123091] Updated weights for policy 0, policy_version 94745 (0.0009) [2023-12-26 00:20:14,159][123090] Updated weights for policy 1, policy_version 94178 (0.0009) [2023-12-26 00:20:14,207][123090] Updated weights for policy 1, policy_version 94188 (0.0008) [2023-12-26 00:20:14,279][123090] Updated weights for policy 1, policy_version 94198 (0.0009) [2023-12-26 00:20:14,348][123090] Updated weights for policy 1, policy_version 94208 (0.0009) [2023-12-26 00:20:14,756][123091] Updated weights for policy 0, policy_version 94755 (0.0006) [2023-12-26 00:20:14,820][123091] Updated weights for policy 0, policy_version 94765 (0.0008) [2023-12-26 00:20:14,875][123091] Updated weights for policy 0, policy_version 94775 (0.0008) [2023-12-26 00:20:15,218][123090] Updated weights for policy 1, policy_version 94218 (0.0009) [2023-12-26 00:20:15,285][123090] Updated weights for policy 1, policy_version 94228 (0.0009) [2023-12-26 00:20:15,357][123090] Updated weights for policy 1, policy_version 94238 (0.0009) [2023-12-26 00:20:15,628][123091] Updated weights for policy 0, policy_version 94785 (0.0008) [2023-12-26 00:20:15,688][123091] Updated weights for policy 0, policy_version 94795 (0.0006) [2023-12-26 00:20:15,744][123091] Updated weights for policy 0, policy_version 94805 (0.0006) [2023-12-26 00:20:15,813][123091] Updated weights for policy 0, policy_version 94815 (0.0006) [2023-12-26 00:20:16,254][123090] Updated weights for policy 1, policy_version 94248 (0.0009) [2023-12-26 00:20:16,312][123090] Updated weights for policy 1, policy_version 94258 (0.0010) [2023-12-26 00:20:16,371][123090] Updated weights for policy 1, policy_version 94268 (0.0008) [2023-12-26 00:20:16,435][123091] Updated weights for policy 0, policy_version 94825 (0.0005) [2023-12-26 00:20:16,508][123091] Updated weights for policy 0, policy_version 94835 (0.0005) [2023-12-26 00:20:16,560][123091] Updated weights for policy 0, policy_version 94845 (0.0005) [2023-12-26 00:20:17,211][123091] Updated weights for policy 0, policy_version 94855 (0.0005) [2023-12-26 00:20:17,250][123090] Updated weights for policy 1, policy_version 94278 (0.0007) [2023-12-26 00:20:17,275][123091] Updated weights for policy 0, policy_version 94865 (0.0005) [2023-12-26 00:20:17,325][123090] Updated weights for policy 1, policy_version 94288 (0.0009) [2023-12-26 00:20:17,340][123091] Updated weights for policy 0, policy_version 94875 (0.0006) [2023-12-26 00:20:17,392][123090] Updated weights for policy 1, policy_version 94298 (0.0009) [2023-12-26 00:20:17,997][123091] Updated weights for policy 0, policy_version 94885 (0.0007) [2023-12-26 00:20:18,065][123091] Updated weights for policy 0, policy_version 94895 (0.0010) [2023-12-26 00:20:18,141][123091] Updated weights for policy 0, policy_version 94905 (0.0011) [2023-12-26 00:20:18,228][123090] Updated weights for policy 1, policy_version 94308 (0.0009) [2023-12-26 00:20:18,286][123090] Updated weights for policy 1, policy_version 94318 (0.0009) [2023-12-26 00:20:18,348][123090] Updated weights for policy 1, policy_version 94328 (0.0009) [2023-12-26 00:20:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 48447488. Throughput: 0: 8953.2, 1: 8492.9. Samples: 48460684. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:18,785][121949] Avg episode reward: [(0, '4801.696'), (1, '5351.392')] [2023-12-26 00:20:18,946][123091] Updated weights for policy 0, policy_version 94915 (0.0011) [2023-12-26 00:20:19,006][123091] Updated weights for policy 0, policy_version 94925 (0.0011) [2023-12-26 00:20:19,064][123091] Updated weights for policy 0, policy_version 94935 (0.0010) [2023-12-26 00:20:19,195][123090] Updated weights for policy 1, policy_version 94338 (0.0009) [2023-12-26 00:20:19,275][123090] Updated weights for policy 1, policy_version 94348 (0.0009) [2023-12-26 00:20:19,340][123090] Updated weights for policy 1, policy_version 94358 (0.0009) [2023-12-26 00:20:19,406][123090] Updated weights for policy 1, policy_version 94368 (0.0009) [2023-12-26 00:20:19,881][123091] Updated weights for policy 0, policy_version 94945 (0.0010) [2023-12-26 00:20:19,951][123091] Updated weights for policy 0, policy_version 94955 (0.0009) [2023-12-26 00:20:20,023][123091] Updated weights for policy 0, policy_version 94965 (0.0010) [2023-12-26 00:20:20,093][123091] Updated weights for policy 0, policy_version 94975 (0.0006) [2023-12-26 00:20:20,276][123090] Updated weights for policy 1, policy_version 94378 (0.0009) [2023-12-26 00:20:20,337][123090] Updated weights for policy 1, policy_version 94388 (0.0008) [2023-12-26 00:20:20,411][123090] Updated weights for policy 1, policy_version 94398 (0.0009) [2023-12-26 00:20:20,840][123091] Updated weights for policy 0, policy_version 94985 (0.0010) [2023-12-26 00:20:20,907][123091] Updated weights for policy 0, policy_version 94995 (0.0011) [2023-12-26 00:20:20,974][123091] Updated weights for policy 0, policy_version 95005 (0.0011) [2023-12-26 00:20:21,266][123090] Updated weights for policy 1, policy_version 94408 (0.0010) [2023-12-26 00:20:21,336][123090] Updated weights for policy 1, policy_version 94418 (0.0009) [2023-12-26 00:20:21,404][123090] Updated weights for policy 1, policy_version 94428 (0.0010) [2023-12-26 00:20:21,811][123091] Updated weights for policy 0, policy_version 95015 (0.0008) [2023-12-26 00:20:21,880][123091] Updated weights for policy 0, policy_version 95025 (0.0010) [2023-12-26 00:20:21,953][123091] Updated weights for policy 0, policy_version 95035 (0.0007) [2023-12-26 00:20:22,200][123090] Updated weights for policy 1, policy_version 94438 (0.0008) [2023-12-26 00:20:22,259][123090] Updated weights for policy 1, policy_version 94448 (0.0008) [2023-12-26 00:20:22,335][123090] Updated weights for policy 1, policy_version 94458 (0.0009) [2023-12-26 00:20:22,705][123091] Updated weights for policy 0, policy_version 95045 (0.0007) [2023-12-26 00:20:22,779][123091] Updated weights for policy 0, policy_version 95055 (0.0006) [2023-12-26 00:20:22,842][123091] Updated weights for policy 0, policy_version 95065 (0.0009) [2023-12-26 00:20:23,130][123090] Updated weights for policy 1, policy_version 94468 (0.0007) [2023-12-26 00:20:23,189][123090] Updated weights for policy 1, policy_version 94478 (0.0005) [2023-12-26 00:20:23,258][123090] Updated weights for policy 1, policy_version 94488 (0.0006) [2023-12-26 00:20:23,539][123091] Updated weights for policy 0, policy_version 95075 (0.0008) [2023-12-26 00:20:23,586][123091] Updated weights for policy 0, policy_version 95085 (0.0005) [2023-12-26 00:20:23,636][123091] Updated weights for policy 0, policy_version 95095 (0.0005) [2023-12-26 00:20:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 48537600. Throughput: 0: 8907.5, 1: 8468.0. Samples: 48510692. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:23,785][121949] Avg episode reward: [(0, '4842.580'), (1, '5479.229')] [2023-12-26 00:20:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000094496_24190976.pth... [2023-12-26 00:20:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000095104_24346624.pth... [2023-12-26 00:20:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000093504_23937024.pth [2023-12-26 00:20:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000094048_24076288.pth [2023-12-26 00:20:23,940][123090] Updated weights for policy 1, policy_version 94498 (0.0005) [2023-12-26 00:20:23,995][123090] Updated weights for policy 1, policy_version 94508 (0.0005) [2023-12-26 00:20:24,052][123090] Updated weights for policy 1, policy_version 94518 (0.0005) [2023-12-26 00:20:24,108][123090] Updated weights for policy 1, policy_version 94528 (0.0005) [2023-12-26 00:20:24,359][123091] Updated weights for policy 0, policy_version 95105 (0.0006) [2023-12-26 00:20:24,420][123091] Updated weights for policy 0, policy_version 95115 (0.0005) [2023-12-26 00:20:24,478][123091] Updated weights for policy 0, policy_version 95125 (0.0005) [2023-12-26 00:20:24,530][123091] Updated weights for policy 0, policy_version 95135 (0.0005) [2023-12-26 00:20:24,816][123090] Updated weights for policy 1, policy_version 94538 (0.0010) [2023-12-26 00:20:24,870][123090] Updated weights for policy 1, policy_version 94548 (0.0010) [2023-12-26 00:20:24,924][123090] Updated weights for policy 1, policy_version 94558 (0.0010) [2023-12-26 00:20:25,127][123091] Updated weights for policy 0, policy_version 95145 (0.0005) [2023-12-26 00:20:25,198][123091] Updated weights for policy 0, policy_version 95155 (0.0007) [2023-12-26 00:20:25,271][123091] Updated weights for policy 0, policy_version 95165 (0.0005) [2023-12-26 00:20:25,702][123090] Updated weights for policy 1, policy_version 94568 (0.0007) [2023-12-26 00:20:25,758][123090] Updated weights for policy 1, policy_version 94578 (0.0010) [2023-12-26 00:20:25,810][123090] Updated weights for policy 1, policy_version 94588 (0.0010) [2023-12-26 00:20:25,988][123091] Updated weights for policy 0, policy_version 95175 (0.0006) [2023-12-26 00:20:26,057][123091] Updated weights for policy 0, policy_version 95185 (0.0006) [2023-12-26 00:20:26,126][123091] Updated weights for policy 0, policy_version 95195 (0.0005) [2023-12-26 00:20:26,474][123090] Updated weights for policy 1, policy_version 94598 (0.0008) [2023-12-26 00:20:26,521][123090] Updated weights for policy 1, policy_version 94608 (0.0005) [2023-12-26 00:20:26,573][123090] Updated weights for policy 1, policy_version 94618 (0.0005) [2023-12-26 00:20:26,892][123091] Updated weights for policy 0, policy_version 95205 (0.0006) [2023-12-26 00:20:26,945][123091] Updated weights for policy 0, policy_version 95215 (0.0005) [2023-12-26 00:20:27,003][123091] Updated weights for policy 0, policy_version 95225 (0.0005) [2023-12-26 00:20:27,270][123090] Updated weights for policy 1, policy_version 94628 (0.0005) [2023-12-26 00:20:27,328][123090] Updated weights for policy 1, policy_version 94638 (0.0010) [2023-12-26 00:20:27,378][123090] Updated weights for policy 1, policy_version 94648 (0.0010) [2023-12-26 00:20:27,655][123091] Updated weights for policy 0, policy_version 95235 (0.0007) [2023-12-26 00:20:27,716][123091] Updated weights for policy 0, policy_version 95245 (0.0010) [2023-12-26 00:20:27,777][123091] Updated weights for policy 0, policy_version 95255 (0.0010) [2023-12-26 00:20:28,108][123090] Updated weights for policy 1, policy_version 94658 (0.0009) [2023-12-26 00:20:28,169][123090] Updated weights for policy 1, policy_version 94668 (0.0005) [2023-12-26 00:20:28,217][123090] Updated weights for policy 1, policy_version 94678 (0.0005) [2023-12-26 00:20:28,262][123090] Updated weights for policy 1, policy_version 94688 (0.0005) [2023-12-26 00:20:28,575][123091] Updated weights for policy 0, policy_version 95265 (0.0010) [2023-12-26 00:20:28,633][123091] Updated weights for policy 0, policy_version 95275 (0.0005) [2023-12-26 00:20:28,685][123091] Updated weights for policy 0, policy_version 95285 (0.0005) [2023-12-26 00:20:28,741][123091] Updated weights for policy 0, policy_version 95295 (0.0005) [2023-12-26 00:20:28,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 48635904. Throughput: 0: 9059.2, 1: 8609.8. Samples: 48626496. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:28,784][121949] Avg episode reward: [(0, '4898.244'), (1, '5558.836')] [2023-12-26 00:20:28,952][123090] Updated weights for policy 1, policy_version 94698 (0.0005) [2023-12-26 00:20:29,006][123090] Updated weights for policy 1, policy_version 94708 (0.0005) [2023-12-26 00:20:29,079][123090] Updated weights for policy 1, policy_version 94718 (0.0005) [2023-12-26 00:20:29,493][123091] Updated weights for policy 0, policy_version 95305 (0.0010) [2023-12-26 00:20:29,562][123091] Updated weights for policy 0, policy_version 95315 (0.0010) [2023-12-26 00:20:29,624][123091] Updated weights for policy 0, policy_version 95325 (0.0010) [2023-12-26 00:20:29,822][123090] Updated weights for policy 1, policy_version 94728 (0.0009) [2023-12-26 00:20:29,888][123090] Updated weights for policy 1, policy_version 94738 (0.0011) [2023-12-26 00:20:29,958][123090] Updated weights for policy 1, policy_version 94748 (0.0011) [2023-12-26 00:20:30,436][123091] Updated weights for policy 0, policy_version 95335 (0.0010) [2023-12-26 00:20:30,498][123091] Updated weights for policy 0, policy_version 95345 (0.0010) [2023-12-26 00:20:30,556][123091] Updated weights for policy 0, policy_version 95355 (0.0010) [2023-12-26 00:20:30,760][123090] Updated weights for policy 1, policy_version 94758 (0.0011) [2023-12-26 00:20:30,823][123090] Updated weights for policy 1, policy_version 94768 (0.0010) [2023-12-26 00:20:30,893][123090] Updated weights for policy 1, policy_version 94778 (0.0010) [2023-12-26 00:20:31,266][123091] Updated weights for policy 0, policy_version 95365 (0.0007) [2023-12-26 00:20:31,326][123091] Updated weights for policy 0, policy_version 95375 (0.0007) [2023-12-26 00:20:31,402][123091] Updated weights for policy 0, policy_version 95385 (0.0008) [2023-12-26 00:20:31,659][123090] Updated weights for policy 1, policy_version 94788 (0.0010) [2023-12-26 00:20:31,726][123090] Updated weights for policy 1, policy_version 94798 (0.0011) [2023-12-26 00:20:31,784][123090] Updated weights for policy 1, policy_version 94808 (0.0009) [2023-12-26 00:20:32,126][123091] Updated weights for policy 0, policy_version 95395 (0.0007) [2023-12-26 00:20:32,180][123091] Updated weights for policy 0, policy_version 95405 (0.0006) [2023-12-26 00:20:32,251][123091] Updated weights for policy 0, policy_version 95415 (0.0006) [2023-12-26 00:20:32,581][123090] Updated weights for policy 1, policy_version 94818 (0.0007) [2023-12-26 00:20:32,635][123090] Updated weights for policy 1, policy_version 94828 (0.0006) [2023-12-26 00:20:32,682][123090] Updated weights for policy 1, policy_version 94838 (0.0010) [2023-12-26 00:20:32,733][123090] Updated weights for policy 1, policy_version 94848 (0.0010) [2023-12-26 00:20:32,956][123091] Updated weights for policy 0, policy_version 95425 (0.0007) [2023-12-26 00:20:33,017][123091] Updated weights for policy 0, policy_version 95435 (0.0009) [2023-12-26 00:20:33,072][123091] Updated weights for policy 0, policy_version 95445 (0.0009) [2023-12-26 00:20:33,124][123091] Updated weights for policy 0, policy_version 95455 (0.0008) [2023-12-26 00:20:33,446][123090] Updated weights for policy 1, policy_version 94858 (0.0005) [2023-12-26 00:20:33,501][123090] Updated weights for policy 1, policy_version 94868 (0.0006) [2023-12-26 00:20:33,563][123090] Updated weights for policy 1, policy_version 94878 (0.0006) [2023-12-26 00:20:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 48726016. Throughput: 0: 9099.7, 1: 8660.0. Samples: 48736768. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 00:20:33,785][121949] Avg episode reward: [(0, '4885.289'), (1, '5531.105')] [2023-12-26 00:20:34,027][123091] Updated weights for policy 0, policy_version 95465 (0.0010) [2023-12-26 00:20:34,088][123091] Updated weights for policy 0, policy_version 95475 (0.0010) [2023-12-26 00:20:34,148][123091] Updated weights for policy 0, policy_version 95485 (0.0010) [2023-12-26 00:20:34,232][123090] Updated weights for policy 1, policy_version 94888 (0.0009) [2023-12-26 00:20:34,309][123090] Updated weights for policy 1, policy_version 94898 (0.0009) [2023-12-26 00:20:34,378][123090] Updated weights for policy 1, policy_version 94908 (0.0011) [2023-12-26 00:20:34,949][123091] Updated weights for policy 0, policy_version 95495 (0.0006) [2023-12-26 00:20:35,006][123091] Updated weights for policy 0, policy_version 95505 (0.0009) [2023-12-26 00:20:35,056][123090] Updated weights for policy 1, policy_version 94918 (0.0010) [2023-12-26 00:20:35,075][123091] Updated weights for policy 0, policy_version 95515 (0.0007) [2023-12-26 00:20:35,125][123090] Updated weights for policy 1, policy_version 94928 (0.0010) [2023-12-26 00:20:35,194][123090] Updated weights for policy 1, policy_version 94938 (0.0010) [2023-12-26 00:20:35,919][123091] Updated weights for policy 0, policy_version 95525 (0.0009) [2023-12-26 00:20:35,939][123090] Updated weights for policy 1, policy_version 94948 (0.0008) [2023-12-26 00:20:35,972][123091] Updated weights for policy 0, policy_version 95535 (0.0008) [2023-12-26 00:20:36,000][123090] Updated weights for policy 1, policy_version 94958 (0.0006) [2023-12-26 00:20:36,030][123091] Updated weights for policy 0, policy_version 95545 (0.0008) [2023-12-26 00:20:36,052][123090] Updated weights for policy 1, policy_version 94968 (0.0007) [2023-12-26 00:20:36,751][123090] Updated weights for policy 1, policy_version 94978 (0.0007) [2023-12-26 00:20:36,803][123090] Updated weights for policy 1, policy_version 94988 (0.0010) [2023-12-26 00:20:36,866][123090] Updated weights for policy 1, policy_version 94998 (0.0010) [2023-12-26 00:20:36,930][123090] Updated weights for policy 1, policy_version 95008 (0.0010) [2023-12-26 00:20:36,935][123091] Updated weights for policy 0, policy_version 95555 (0.0010) [2023-12-26 00:20:36,992][123091] Updated weights for policy 0, policy_version 95565 (0.0010) [2023-12-26 00:20:37,060][123091] Updated weights for policy 0, policy_version 95575 (0.0011) [2023-12-26 00:20:37,724][123090] Updated weights for policy 1, policy_version 95018 (0.0009) [2023-12-26 00:20:37,778][123090] Updated weights for policy 1, policy_version 95028 (0.0009) [2023-12-26 00:20:37,832][123090] Updated weights for policy 1, policy_version 95038 (0.0009) [2023-12-26 00:20:37,902][123091] Updated weights for policy 0, policy_version 95585 (0.0011) [2023-12-26 00:20:37,971][123091] Updated weights for policy 0, policy_version 95595 (0.0008) [2023-12-26 00:20:38,033][123091] Updated weights for policy 0, policy_version 95605 (0.0007) [2023-12-26 00:20:38,080][123091] Updated weights for policy 0, policy_version 95615 (0.0005) [2023-12-26 00:20:38,574][123090] Updated weights for policy 1, policy_version 95048 (0.0006) [2023-12-26 00:20:38,650][123090] Updated weights for policy 1, policy_version 95058 (0.0005) [2023-12-26 00:20:38,721][123090] Updated weights for policy 1, policy_version 95068 (0.0006) [2023-12-26 00:20:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 48816128. Throughput: 0: 9069.3, 1: 8760.9. Samples: 48791536. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:20:38,785][121949] Avg episode reward: [(0, '4789.659'), (1, '5600.368')] [2023-12-26 00:20:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000095072_24338432.pth... [2023-12-26 00:20:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000094016_24068096.pth [2023-12-26 00:20:38,810][123091] Updated weights for policy 0, policy_version 95625 (0.0010) [2023-12-26 00:20:38,870][123091] Updated weights for policy 0, policy_version 95635 (0.0011) [2023-12-26 00:20:38,923][123091] Updated weights for policy 0, policy_version 95645 (0.0011) [2023-12-26 00:20:38,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000095648_24485888.pth... [2023-12-26 00:20:38,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000094560_24207360.pth [2023-12-26 00:20:39,472][123090] Updated weights for policy 1, policy_version 95078 (0.0010) [2023-12-26 00:20:39,532][123090] Updated weights for policy 1, policy_version 95088 (0.0011) [2023-12-26 00:20:39,603][123090] Updated weights for policy 1, policy_version 95098 (0.0011) [2023-12-26 00:20:39,736][123091] Updated weights for policy 0, policy_version 95655 (0.0009) [2023-12-26 00:20:39,799][123091] Updated weights for policy 0, policy_version 95665 (0.0009) [2023-12-26 00:20:39,868][123091] Updated weights for policy 0, policy_version 95675 (0.0010) [2023-12-26 00:20:40,348][123090] Updated weights for policy 1, policy_version 95108 (0.0009) [2023-12-26 00:20:40,418][123090] Updated weights for policy 1, policy_version 95118 (0.0007) [2023-12-26 00:20:40,478][123090] Updated weights for policy 1, policy_version 95128 (0.0006) [2023-12-26 00:20:40,716][123091] Updated weights for policy 0, policy_version 95685 (0.0007) [2023-12-26 00:20:40,783][123091] Updated weights for policy 0, policy_version 95695 (0.0006) [2023-12-26 00:20:40,853][123091] Updated weights for policy 0, policy_version 95705 (0.0007) [2023-12-26 00:20:41,150][123090] Updated weights for policy 1, policy_version 95138 (0.0007) [2023-12-26 00:20:41,218][123090] Updated weights for policy 1, policy_version 95148 (0.0011) [2023-12-26 00:20:41,287][123090] Updated weights for policy 1, policy_version 95158 (0.0011) [2023-12-26 00:20:41,362][123090] Updated weights for policy 1, policy_version 95168 (0.0009) [2023-12-26 00:20:41,738][123091] Updated weights for policy 0, policy_version 95715 (0.0007) [2023-12-26 00:20:41,804][123091] Updated weights for policy 0, policy_version 95725 (0.0010) [2023-12-26 00:20:41,866][123091] Updated weights for policy 0, policy_version 95735 (0.0010) [2023-12-26 00:20:42,131][123090] Updated weights for policy 1, policy_version 95178 (0.0005) [2023-12-26 00:20:42,198][123090] Updated weights for policy 1, policy_version 95188 (0.0005) [2023-12-26 00:20:42,263][123090] Updated weights for policy 1, policy_version 95198 (0.0011) [2023-12-26 00:20:42,715][123091] Updated weights for policy 0, policy_version 95745 (0.0010) [2023-12-26 00:20:42,774][123091] Updated weights for policy 0, policy_version 95755 (0.0005) [2023-12-26 00:20:42,830][123091] Updated weights for policy 0, policy_version 95765 (0.0008) [2023-12-26 00:20:42,886][123091] Updated weights for policy 0, policy_version 95775 (0.0009) [2023-12-26 00:20:42,998][123090] Updated weights for policy 1, policy_version 95208 (0.0007) [2023-12-26 00:20:43,064][123090] Updated weights for policy 1, policy_version 95218 (0.0008) [2023-12-26 00:20:43,123][123090] Updated weights for policy 1, policy_version 95228 (0.0006) [2023-12-26 00:20:43,658][123091] Updated weights for policy 0, policy_version 95785 (0.0006) [2023-12-26 00:20:43,713][123091] Updated weights for policy 0, policy_version 95795 (0.0005) [2023-12-26 00:20:43,761][123091] Updated weights for policy 0, policy_version 95805 (0.0005) [2023-12-26 00:20:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 48906240. Throughput: 0: 8964.9, 1: 8861.0. Samples: 48897976. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:20:43,785][121949] Avg episode reward: [(0, '4815.036'), (1, '5511.666')] [2023-12-26 00:20:43,891][123090] Updated weights for policy 1, policy_version 95238 (0.0008) [2023-12-26 00:20:43,940][123090] Updated weights for policy 1, policy_version 95248 (0.0009) [2023-12-26 00:20:43,995][123090] Updated weights for policy 1, policy_version 95258 (0.0009) [2023-12-26 00:20:44,498][123091] Updated weights for policy 0, policy_version 95815 (0.0005) [2023-12-26 00:20:44,547][123091] Updated weights for policy 0, policy_version 95825 (0.0005) [2023-12-26 00:20:44,608][123091] Updated weights for policy 0, policy_version 95835 (0.0005) [2023-12-26 00:20:44,910][123090] Updated weights for policy 1, policy_version 95268 (0.0010) [2023-12-26 00:20:44,976][123090] Updated weights for policy 1, policy_version 95278 (0.0009) [2023-12-26 00:20:45,038][123090] Updated weights for policy 1, policy_version 95288 (0.0010) [2023-12-26 00:20:45,374][123091] Updated weights for policy 0, policy_version 95845 (0.0007) [2023-12-26 00:20:45,432][123091] Updated weights for policy 0, policy_version 95855 (0.0010) [2023-12-26 00:20:45,483][123091] Updated weights for policy 0, policy_version 95866 (0.0008) [2023-12-26 00:20:45,899][123090] Updated weights for policy 1, policy_version 95298 (0.0009) [2023-12-26 00:20:45,953][123090] Updated weights for policy 1, policy_version 95308 (0.0010) [2023-12-26 00:20:46,013][123090] Updated weights for policy 1, policy_version 95318 (0.0009) [2023-12-26 00:20:46,071][123090] Updated weights for policy 1, policy_version 95328 (0.0010) [2023-12-26 00:20:46,311][123091] Updated weights for policy 0, policy_version 95876 (0.0010) [2023-12-26 00:20:46,363][123091] Updated weights for policy 0, policy_version 95886 (0.0009) [2023-12-26 00:20:46,413][123091] Updated weights for policy 0, policy_version 95896 (0.0009) [2023-12-26 00:20:46,918][123090] Updated weights for policy 1, policy_version 95338 (0.0010) [2023-12-26 00:20:46,970][123090] Updated weights for policy 1, policy_version 95349 (0.0009) [2023-12-26 00:20:47,024][123090] Updated weights for policy 1, policy_version 95359 (0.0010) [2023-12-26 00:20:47,192][123091] Updated weights for policy 0, policy_version 95907 (0.0008) [2023-12-26 00:20:47,245][123091] Updated weights for policy 0, policy_version 95917 (0.0010) [2023-12-26 00:20:47,301][123091] Updated weights for policy 0, policy_version 95927 (0.0007) [2023-12-26 00:20:47,916][123090] Updated weights for policy 1, policy_version 95369 (0.0009) [2023-12-26 00:20:47,981][123090] Updated weights for policy 1, policy_version 95379 (0.0010) [2023-12-26 00:20:48,052][123090] Updated weights for policy 1, policy_version 95389 (0.0010) [2023-12-26 00:20:48,098][123091] Updated weights for policy 0, policy_version 95937 (0.0010) [2023-12-26 00:20:48,165][123091] Updated weights for policy 0, policy_version 95947 (0.0009) [2023-12-26 00:20:48,227][123091] Updated weights for policy 0, policy_version 95957 (0.0009) [2023-12-26 00:20:48,296][123091] Updated weights for policy 0, policy_version 95967 (0.0005) [2023-12-26 00:20:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 48988160. Throughput: 0: 8948.2, 1: 8907.8. Samples: 49003480. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:20:48,785][121949] Avg episode reward: [(0, '4850.930'), (1, '5595.013')] [2023-12-26 00:20:48,867][123090] Updated weights for policy 1, policy_version 95399 (0.0009) [2023-12-26 00:20:48,923][123090] Updated weights for policy 1, policy_version 95409 (0.0009) [2023-12-26 00:20:48,979][123090] Updated weights for policy 1, policy_version 95419 (0.0008) [2023-12-26 00:20:49,122][123091] Updated weights for policy 0, policy_version 95977 (0.0010) [2023-12-26 00:20:49,177][123091] Updated weights for policy 0, policy_version 95987 (0.0011) [2023-12-26 00:20:49,235][123091] Updated weights for policy 0, policy_version 95997 (0.0010) [2023-12-26 00:20:49,647][123090] Updated weights for policy 1, policy_version 95429 (0.0006) [2023-12-26 00:20:49,714][123090] Updated weights for policy 1, policy_version 95439 (0.0005) [2023-12-26 00:20:49,769][123090] Updated weights for policy 1, policy_version 95449 (0.0005) [2023-12-26 00:20:50,029][123091] Updated weights for policy 0, policy_version 96007 (0.0011) [2023-12-26 00:20:50,093][123091] Updated weights for policy 0, policy_version 96017 (0.0010) [2023-12-26 00:20:50,141][123091] Updated weights for policy 0, policy_version 96027 (0.0010) [2023-12-26 00:20:50,503][123090] Updated weights for policy 1, policy_version 95459 (0.0007) [2023-12-26 00:20:50,570][123090] Updated weights for policy 1, policy_version 95469 (0.0009) [2023-12-26 00:20:50,638][123090] Updated weights for policy 1, policy_version 95479 (0.0009) [2023-12-26 00:20:50,922][123091] Updated weights for policy 0, policy_version 96037 (0.0008) [2023-12-26 00:20:50,971][123091] Updated weights for policy 0, policy_version 96047 (0.0005) [2023-12-26 00:20:51,031][123091] Updated weights for policy 0, policy_version 96057 (0.0007) [2023-12-26 00:20:51,475][123090] Updated weights for policy 1, policy_version 95489 (0.0009) [2023-12-26 00:20:51,542][123090] Updated weights for policy 1, policy_version 95499 (0.0010) [2023-12-26 00:20:51,614][123090] Updated weights for policy 1, policy_version 95509 (0.0011) [2023-12-26 00:20:51,687][123090] Updated weights for policy 1, policy_version 95519 (0.0011) [2023-12-26 00:20:51,795][123091] Updated weights for policy 0, policy_version 96067 (0.0008) [2023-12-26 00:20:51,859][123091] Updated weights for policy 0, policy_version 96077 (0.0009) [2023-12-26 00:20:51,924][123091] Updated weights for policy 0, policy_version 96087 (0.0009) [2023-12-26 00:20:52,526][123090] Updated weights for policy 1, policy_version 95529 (0.0010) [2023-12-26 00:20:52,576][123090] Updated weights for policy 1, policy_version 95539 (0.0007) [2023-12-26 00:20:52,632][123090] Updated weights for policy 1, policy_version 95549 (0.0005) [2023-12-26 00:20:52,764][123091] Updated weights for policy 0, policy_version 96097 (0.0009) [2023-12-26 00:20:52,828][123091] Updated weights for policy 0, policy_version 96107 (0.0010) [2023-12-26 00:20:52,895][123091] Updated weights for policy 0, policy_version 96117 (0.0010) [2023-12-26 00:20:52,964][123091] Updated weights for policy 0, policy_version 96127 (0.0008) [2023-12-26 00:20:53,396][123090] Updated weights for policy 1, policy_version 95559 (0.0008) [2023-12-26 00:20:53,450][123090] Updated weights for policy 1, policy_version 95569 (0.0010) [2023-12-26 00:20:53,509][123090] Updated weights for policy 1, policy_version 95579 (0.0011) [2023-12-26 00:20:53,719][123091] Updated weights for policy 0, policy_version 96137 (0.0006) [2023-12-26 00:20:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 49078272. Throughput: 0: 9007.3, 1: 8897.8. Samples: 49057484. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:20:53,785][121949] Avg episode reward: [(0, '4877.890'), (1, '5695.166')] [2023-12-26 00:20:53,786][123091] Updated weights for policy 0, policy_version 96147 (0.0006) [2023-12-26 00:20:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000095584_24469504.pth... [2023-12-26 00:20:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000094496_24190976.pth [2023-12-26 00:20:53,795][123008] Saving new best policy, reward=5695.166! [2023-12-26 00:20:53,851][123091] Updated weights for policy 0, policy_version 96157 (0.0005) [2023-12-26 00:20:53,871][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000096160_24616960.pth... [2023-12-26 00:20:53,876][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000095104_24346624.pth [2023-12-26 00:20:54,315][123090] Updated weights for policy 1, policy_version 95590 (0.0008) [2023-12-26 00:20:54,378][123090] Updated weights for policy 1, policy_version 95600 (0.0005) [2023-12-26 00:20:54,432][123090] Updated weights for policy 1, policy_version 95610 (0.0005) [2023-12-26 00:20:54,532][123091] Updated weights for policy 0, policy_version 96167 (0.0008) [2023-12-26 00:20:54,593][123091] Updated weights for policy 0, policy_version 96177 (0.0010) [2023-12-26 00:20:54,652][123091] Updated weights for policy 0, policy_version 96187 (0.0009) [2023-12-26 00:20:55,160][123090] Updated weights for policy 1, policy_version 95620 (0.0005) [2023-12-26 00:20:55,207][123090] Updated weights for policy 1, policy_version 95630 (0.0005) [2023-12-26 00:20:55,259][123090] Updated weights for policy 1, policy_version 95640 (0.0005) [2023-12-26 00:20:55,532][123091] Updated weights for policy 0, policy_version 96197 (0.0008) [2023-12-26 00:20:55,585][123091] Updated weights for policy 0, policy_version 96207 (0.0005) [2023-12-26 00:20:55,647][123091] Updated weights for policy 0, policy_version 96217 (0.0005) [2023-12-26 00:20:55,892][123090] Updated weights for policy 1, policy_version 95650 (0.0005) [2023-12-26 00:20:55,942][123090] Updated weights for policy 1, policy_version 95660 (0.0007) [2023-12-26 00:20:56,000][123090] Updated weights for policy 1, policy_version 95670 (0.0009) [2023-12-26 00:20:56,049][123090] Updated weights for policy 1, policy_version 95680 (0.0009) [2023-12-26 00:20:56,392][123091] Updated weights for policy 0, policy_version 96227 (0.0008) [2023-12-26 00:20:56,457][123091] Updated weights for policy 0, policy_version 96237 (0.0009) [2023-12-26 00:20:56,523][123091] Updated weights for policy 0, policy_version 96247 (0.0010) [2023-12-26 00:20:56,879][123090] Updated weights for policy 1, policy_version 95690 (0.0005) [2023-12-26 00:20:56,926][123090] Updated weights for policy 1, policy_version 95700 (0.0005) [2023-12-26 00:20:56,976][123090] Updated weights for policy 1, policy_version 95710 (0.0005) [2023-12-26 00:20:57,160][123091] Updated weights for policy 0, policy_version 96257 (0.0010) [2023-12-26 00:20:57,219][123091] Updated weights for policy 0, policy_version 96267 (0.0005) [2023-12-26 00:20:57,274][123091] Updated weights for policy 0, policy_version 96277 (0.0005) [2023-12-26 00:20:57,329][123091] Updated weights for policy 0, policy_version 96287 (0.0006) [2023-12-26 00:20:57,803][123090] Updated weights for policy 1, policy_version 95720 (0.0009) [2023-12-26 00:20:57,857][123090] Updated weights for policy 1, policy_version 95730 (0.0010) [2023-12-26 00:20:57,915][123090] Updated weights for policy 1, policy_version 95740 (0.0009) [2023-12-26 00:20:57,933][123091] Updated weights for policy 0, policy_version 96297 (0.0005) [2023-12-26 00:20:58,002][123091] Updated weights for policy 0, policy_version 96307 (0.0007) [2023-12-26 00:20:58,072][123091] Updated weights for policy 0, policy_version 96317 (0.0008) [2023-12-26 00:20:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 49168384. Throughput: 0: 9092.5, 1: 9010.9. Samples: 49168532. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:20:58,785][121949] Avg episode reward: [(0, '4805.045'), (1, '5707.574')] [2023-12-26 00:20:58,821][123090] Updated weights for policy 1, policy_version 95750 (0.0008) [2023-12-26 00:20:58,826][123091] Updated weights for policy 0, policy_version 96327 (0.0009) [2023-12-26 00:20:58,880][123090] Updated weights for policy 1, policy_version 95760 (0.0006) [2023-12-26 00:20:58,888][123091] Updated weights for policy 0, policy_version 96337 (0.0006) [2023-12-26 00:20:58,949][123091] Updated weights for policy 0, policy_version 96347 (0.0005) [2023-12-26 00:20:58,954][123090] Updated weights for policy 1, policy_version 95770 (0.0008) [2023-12-26 00:20:58,993][123008] Saving new best policy, reward=5707.574! [2023-12-26 00:20:59,713][123090] Updated weights for policy 1, policy_version 95780 (0.0007) [2023-12-26 00:20:59,752][123091] Updated weights for policy 0, policy_version 96357 (0.0010) [2023-12-26 00:20:59,764][123090] Updated weights for policy 1, policy_version 95790 (0.0006) [2023-12-26 00:20:59,811][123091] Updated weights for policy 0, policy_version 96367 (0.0010) [2023-12-26 00:20:59,819][123090] Updated weights for policy 1, policy_version 95800 (0.0007) [2023-12-26 00:20:59,878][123091] Updated weights for policy 0, policy_version 96377 (0.0011) [2023-12-26 00:21:00,583][123090] Updated weights for policy 1, policy_version 95810 (0.0008) [2023-12-26 00:21:00,644][123090] Updated weights for policy 1, policy_version 95820 (0.0009) [2023-12-26 00:21:00,665][123091] Updated weights for policy 0, policy_version 96387 (0.0009) [2023-12-26 00:21:00,703][123090] Updated weights for policy 1, policy_version 95830 (0.0007) [2023-12-26 00:21:00,722][123091] Updated weights for policy 0, policy_version 96397 (0.0005) [2023-12-26 00:21:00,749][123090] Updated weights for policy 1, policy_version 95840 (0.0005) [2023-12-26 00:21:00,790][123091] Updated weights for policy 0, policy_version 96407 (0.0005) [2023-12-26 00:21:01,460][123091] Updated weights for policy 0, policy_version 96417 (0.0006) [2023-12-26 00:21:01,488][123090] Updated weights for policy 1, policy_version 95850 (0.0005) [2023-12-26 00:21:01,516][123091] Updated weights for policy 0, policy_version 96427 (0.0008) [2023-12-26 00:21:01,538][123090] Updated weights for policy 1, policy_version 95860 (0.0005) [2023-12-26 00:21:01,577][123091] Updated weights for policy 0, policy_version 96437 (0.0008) [2023-12-26 00:21:01,597][123090] Updated weights for policy 1, policy_version 95870 (0.0007) [2023-12-26 00:21:01,645][123091] Updated weights for policy 0, policy_version 96447 (0.0009) [2023-12-26 00:21:02,378][123090] Updated weights for policy 1, policy_version 95880 (0.0010) [2023-12-26 00:21:02,415][123091] Updated weights for policy 0, policy_version 96457 (0.0008) [2023-12-26 00:21:02,442][123090] Updated weights for policy 1, policy_version 95890 (0.0009) [2023-12-26 00:21:02,480][123091] Updated weights for policy 0, policy_version 96467 (0.0008) [2023-12-26 00:21:02,504][123090] Updated weights for policy 1, policy_version 95900 (0.0009) [2023-12-26 00:21:02,539][123091] Updated weights for policy 0, policy_version 96477 (0.0007) [2023-12-26 00:21:03,278][123090] Updated weights for policy 1, policy_version 95910 (0.0009) [2023-12-26 00:21:03,336][123090] Updated weights for policy 1, policy_version 95920 (0.0009) [2023-12-26 00:21:03,365][123091] Updated weights for policy 0, policy_version 96487 (0.0008) [2023-12-26 00:21:03,397][123090] Updated weights for policy 1, policy_version 95930 (0.0008) [2023-12-26 00:21:03,410][123091] Updated weights for policy 0, policy_version 96497 (0.0009) [2023-12-26 00:21:03,462][123091] Updated weights for policy 0, policy_version 96507 (0.0007) [2023-12-26 00:21:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 49266688. Throughput: 0: 9001.7, 1: 9111.6. Samples: 49275780. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:03,785][121949] Avg episode reward: [(0, '4798.700'), (1, '5710.936')] [2023-12-26 00:21:03,787][123008] Saving new best policy, reward=5710.936! [2023-12-26 00:21:04,194][123090] Updated weights for policy 1, policy_version 95940 (0.0009) [2023-12-26 00:21:04,254][123090] Updated weights for policy 1, policy_version 95950 (0.0011) [2023-12-26 00:21:04,319][123091] Updated weights for policy 0, policy_version 96517 (0.0009) [2023-12-26 00:21:04,319][123090] Updated weights for policy 1, policy_version 95960 (0.0011) [2023-12-26 00:21:04,384][123091] Updated weights for policy 0, policy_version 96527 (0.0007) [2023-12-26 00:21:04,448][123091] Updated weights for policy 0, policy_version 96537 (0.0010) [2023-12-26 00:21:05,154][123090] Updated weights for policy 1, policy_version 95970 (0.0011) [2023-12-26 00:21:05,213][123090] Updated weights for policy 1, policy_version 95980 (0.0010) [2023-12-26 00:21:05,222][123091] Updated weights for policy 0, policy_version 96547 (0.0010) [2023-12-26 00:21:05,272][123090] Updated weights for policy 1, policy_version 95990 (0.0010) [2023-12-26 00:21:05,286][123091] Updated weights for policy 0, policy_version 96557 (0.0006) [2023-12-26 00:21:05,335][123090] Updated weights for policy 1, policy_version 96000 (0.0010) [2023-12-26 00:21:05,351][123091] Updated weights for policy 0, policy_version 96567 (0.0006) [2023-12-26 00:21:05,991][123091] Updated weights for policy 0, policy_version 96577 (0.0010) [2023-12-26 00:21:06,046][123091] Updated weights for policy 0, policy_version 96587 (0.0011) [2023-12-26 00:21:06,118][123091] Updated weights for policy 0, policy_version 96597 (0.0010) [2023-12-26 00:21:06,142][123090] Updated weights for policy 1, policy_version 96010 (0.0011) [2023-12-26 00:21:06,186][123091] Updated weights for policy 0, policy_version 96607 (0.0007) [2023-12-26 00:21:06,198][123090] Updated weights for policy 1, policy_version 96020 (0.0011) [2023-12-26 00:21:06,255][123090] Updated weights for policy 1, policy_version 96030 (0.0011) [2023-12-26 00:21:06,902][123091] Updated weights for policy 0, policy_version 96617 (0.0006) [2023-12-26 00:21:06,976][123091] Updated weights for policy 0, policy_version 96627 (0.0006) [2023-12-26 00:21:07,045][123091] Updated weights for policy 0, policy_version 96637 (0.0006) [2023-12-26 00:21:07,160][123090] Updated weights for policy 1, policy_version 96040 (0.0010) [2023-12-26 00:21:07,214][123090] Updated weights for policy 1, policy_version 96050 (0.0010) [2023-12-26 00:21:07,269][123090] Updated weights for policy 1, policy_version 96061 (0.0010) [2023-12-26 00:21:07,671][123091] Updated weights for policy 0, policy_version 96647 (0.0006) [2023-12-26 00:21:07,739][123091] Updated weights for policy 0, policy_version 96657 (0.0006) [2023-12-26 00:21:07,800][123091] Updated weights for policy 0, policy_version 96667 (0.0006) [2023-12-26 00:21:08,125][123090] Updated weights for policy 1, policy_version 96071 (0.0010) [2023-12-26 00:21:08,179][123090] Updated weights for policy 1, policy_version 96081 (0.0010) [2023-12-26 00:21:08,235][123090] Updated weights for policy 1, policy_version 96091 (0.0011) [2023-12-26 00:21:08,548][123091] Updated weights for policy 0, policy_version 96677 (0.0009) [2023-12-26 00:21:08,600][123091] Updated weights for policy 0, policy_version 96687 (0.0010) [2023-12-26 00:21:08,648][123091] Updated weights for policy 0, policy_version 96697 (0.0010) [2023-12-26 00:21:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 49356800. Throughput: 0: 9061.3, 1: 9150.0. Samples: 49330196. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:08,785][121949] Avg episode reward: [(0, '4839.559'), (1, '5715.911')] [2023-12-26 00:21:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000096704_24756224.pth... [2023-12-26 00:21:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000096096_24600576.pth... [2023-12-26 00:21:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000095648_24485888.pth [2023-12-26 00:21:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000095072_24338432.pth [2023-12-26 00:21:08,798][123008] Saving new best policy, reward=5715.911! [2023-12-26 00:21:08,986][123090] Updated weights for policy 1, policy_version 96101 (0.0007) [2023-12-26 00:21:09,059][123090] Updated weights for policy 1, policy_version 96111 (0.0010) [2023-12-26 00:21:09,128][123090] Updated weights for policy 1, policy_version 96121 (0.0007) [2023-12-26 00:21:09,522][123091] Updated weights for policy 0, policy_version 96707 (0.0010) [2023-12-26 00:21:09,593][123091] Updated weights for policy 0, policy_version 96717 (0.0010) [2023-12-26 00:21:09,663][123091] Updated weights for policy 0, policy_version 96727 (0.0007) [2023-12-26 00:21:09,913][123090] Updated weights for policy 1, policy_version 96131 (0.0007) [2023-12-26 00:21:09,994][123090] Updated weights for policy 1, policy_version 96141 (0.0011) [2023-12-26 00:21:10,058][123090] Updated weights for policy 1, policy_version 96151 (0.0011) [2023-12-26 00:21:10,410][123091] Updated weights for policy 0, policy_version 96737 (0.0006) [2023-12-26 00:21:10,488][123091] Updated weights for policy 0, policy_version 96747 (0.0006) [2023-12-26 00:21:10,558][123091] Updated weights for policy 0, policy_version 96757 (0.0006) [2023-12-26 00:21:10,629][123091] Updated weights for policy 0, policy_version 96767 (0.0006) [2023-12-26 00:21:10,788][123090] Updated weights for policy 1, policy_version 96161 (0.0011) [2023-12-26 00:21:10,840][123090] Updated weights for policy 1, policy_version 96171 (0.0010) [2023-12-26 00:21:10,888][123090] Updated weights for policy 1, policy_version 96181 (0.0011) [2023-12-26 00:21:10,945][123090] Updated weights for policy 1, policy_version 96191 (0.0011) [2023-12-26 00:21:11,322][123091] Updated weights for policy 0, policy_version 96777 (0.0009) [2023-12-26 00:21:11,393][123091] Updated weights for policy 0, policy_version 96787 (0.0009) [2023-12-26 00:21:11,452][123091] Updated weights for policy 0, policy_version 96797 (0.0007) [2023-12-26 00:21:11,845][123090] Updated weights for policy 1, policy_version 96201 (0.0009) [2023-12-26 00:21:11,914][123090] Updated weights for policy 1, policy_version 96211 (0.0008) [2023-12-26 00:21:11,985][123090] Updated weights for policy 1, policy_version 96221 (0.0010) [2023-12-26 00:21:12,252][123091] Updated weights for policy 0, policy_version 96807 (0.0009) [2023-12-26 00:21:12,325][123091] Updated weights for policy 0, policy_version 96817 (0.0010) [2023-12-26 00:21:12,399][123091] Updated weights for policy 0, policy_version 96827 (0.0009) [2023-12-26 00:21:12,786][123090] Updated weights for policy 1, policy_version 96231 (0.0010) [2023-12-26 00:21:12,854][123090] Updated weights for policy 1, policy_version 96241 (0.0010) [2023-12-26 00:21:12,915][123090] Updated weights for policy 1, policy_version 96251 (0.0010) [2023-12-26 00:21:13,180][123091] Updated weights for policy 0, policy_version 96837 (0.0009) [2023-12-26 00:21:13,232][123091] Updated weights for policy 0, policy_version 96847 (0.0009) [2023-12-26 00:21:13,290][123091] Updated weights for policy 0, policy_version 96857 (0.0008) [2023-12-26 00:21:13,771][123090] Updated weights for policy 1, policy_version 96261 (0.0008) [2023-12-26 00:21:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 49438720. Throughput: 0: 8982.4, 1: 9014.2. Samples: 49436344. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:13,785][121949] Avg episode reward: [(0, '4910.243'), (1, '5668.712')] [2023-12-26 00:21:13,840][123090] Updated weights for policy 1, policy_version 96271 (0.0009) [2023-12-26 00:21:13,902][123090] Updated weights for policy 1, policy_version 96281 (0.0006) [2023-12-26 00:21:14,169][123091] Updated weights for policy 0, policy_version 96867 (0.0010) [2023-12-26 00:21:14,234][123091] Updated weights for policy 0, policy_version 96877 (0.0009) [2023-12-26 00:21:14,301][123091] Updated weights for policy 0, policy_version 96887 (0.0010) [2023-12-26 00:21:14,510][123090] Updated weights for policy 1, policy_version 96291 (0.0006) [2023-12-26 00:21:14,585][123090] Updated weights for policy 1, policy_version 96301 (0.0005) [2023-12-26 00:21:14,653][123090] Updated weights for policy 1, policy_version 96311 (0.0009) [2023-12-26 00:21:15,154][123091] Updated weights for policy 0, policy_version 96897 (0.0010) [2023-12-26 00:21:15,214][123091] Updated weights for policy 0, policy_version 96907 (0.0009) [2023-12-26 00:21:15,270][123091] Updated weights for policy 0, policy_version 96917 (0.0009) [2023-12-26 00:21:15,328][123091] Updated weights for policy 0, policy_version 96927 (0.0009) [2023-12-26 00:21:15,404][123090] Updated weights for policy 1, policy_version 96321 (0.0008) [2023-12-26 00:21:15,467][123090] Updated weights for policy 1, policy_version 96331 (0.0007) [2023-12-26 00:21:15,530][123090] Updated weights for policy 1, policy_version 96341 (0.0008) [2023-12-26 00:21:15,599][123090] Updated weights for policy 1, policy_version 96351 (0.0011) [2023-12-26 00:21:16,183][123091] Updated weights for policy 0, policy_version 96937 (0.0009) [2023-12-26 00:21:16,242][123091] Updated weights for policy 0, policy_version 96947 (0.0009) [2023-12-26 00:21:16,297][123091] Updated weights for policy 0, policy_version 96957 (0.0008) [2023-12-26 00:21:16,374][123090] Updated weights for policy 1, policy_version 96361 (0.0010) [2023-12-26 00:21:16,444][123090] Updated weights for policy 1, policy_version 96371 (0.0010) [2023-12-26 00:21:16,491][123090] Updated weights for policy 1, policy_version 96381 (0.0010) [2023-12-26 00:21:17,100][123091] Updated weights for policy 0, policy_version 96967 (0.0007) [2023-12-26 00:21:17,161][123091] Updated weights for policy 0, policy_version 96977 (0.0006) [2023-12-26 00:21:17,217][123091] Updated weights for policy 0, policy_version 96987 (0.0005) [2023-12-26 00:21:17,222][123090] Updated weights for policy 1, policy_version 96391 (0.0007) [2023-12-26 00:21:17,276][123090] Updated weights for policy 1, policy_version 96401 (0.0006) [2023-12-26 00:21:17,344][123090] Updated weights for policy 1, policy_version 96411 (0.0005) [2023-12-26 00:21:18,011][123090] Updated weights for policy 1, policy_version 96421 (0.0007) [2023-12-26 00:21:18,061][123091] Updated weights for policy 0, policy_version 96997 (0.0008) [2023-12-26 00:21:18,074][123090] Updated weights for policy 1, policy_version 96431 (0.0007) [2023-12-26 00:21:18,119][123091] Updated weights for policy 0, policy_version 97007 (0.0009) [2023-12-26 00:21:18,151][123090] Updated weights for policy 1, policy_version 96441 (0.0005) [2023-12-26 00:21:18,175][123091] Updated weights for policy 0, policy_version 97017 (0.0008) [2023-12-26 00:21:18,784][121949] Fps is (10 sec: 17202.4, 60 sec: 18022.3, 300 sec: 17689.2). Total num frames: 49528832. Throughput: 0: 8922.2, 1: 8997.4. Samples: 49543160. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:18,786][121949] Avg episode reward: [(0, '4837.198'), (1, '5656.909')] [2023-12-26 00:21:18,960][123091] Updated weights for policy 0, policy_version 97027 (0.0007) [2023-12-26 00:21:19,015][123091] Updated weights for policy 0, policy_version 97037 (0.0009) [2023-12-26 00:21:19,024][123090] Updated weights for policy 1, policy_version 96451 (0.0009) [2023-12-26 00:21:19,074][123091] Updated weights for policy 0, policy_version 97047 (0.0008) [2023-12-26 00:21:19,084][123090] Updated weights for policy 1, policy_version 96461 (0.0009) [2023-12-26 00:21:19,137][123090] Updated weights for policy 1, policy_version 96471 (0.0006) [2023-12-26 00:21:19,932][123091] Updated weights for policy 0, policy_version 97057 (0.0009) [2023-12-26 00:21:19,976][123090] Updated weights for policy 1, policy_version 96481 (0.0010) [2023-12-26 00:21:19,996][123091] Updated weights for policy 0, policy_version 97067 (0.0008) [2023-12-26 00:21:20,042][123090] Updated weights for policy 1, policy_version 96491 (0.0011) [2023-12-26 00:21:20,063][123091] Updated weights for policy 0, policy_version 97077 (0.0007) [2023-12-26 00:21:20,102][123090] Updated weights for policy 1, policy_version 96501 (0.0010) [2023-12-26 00:21:20,131][123091] Updated weights for policy 0, policy_version 97087 (0.0007) [2023-12-26 00:21:20,167][123090] Updated weights for policy 1, policy_version 96511 (0.0010) [2023-12-26 00:21:20,859][123090] Updated weights for policy 1, policy_version 96521 (0.0011) [2023-12-26 00:21:20,878][123091] Updated weights for policy 0, policy_version 97097 (0.0007) [2023-12-26 00:21:20,927][123090] Updated weights for policy 1, policy_version 96531 (0.0011) [2023-12-26 00:21:20,942][123091] Updated weights for policy 0, policy_version 97107 (0.0007) [2023-12-26 00:21:21,010][123090] Updated weights for policy 1, policy_version 96541 (0.0006) [2023-12-26 00:21:21,012][123091] Updated weights for policy 0, policy_version 97117 (0.0010) [2023-12-26 00:21:21,767][123090] Updated weights for policy 1, policy_version 96551 (0.0007) [2023-12-26 00:21:21,771][123091] Updated weights for policy 0, policy_version 97127 (0.0008) [2023-12-26 00:21:21,834][123091] Updated weights for policy 0, policy_version 97137 (0.0009) [2023-12-26 00:21:21,834][123090] Updated weights for policy 1, policy_version 96561 (0.0007) [2023-12-26 00:21:21,895][123090] Updated weights for policy 1, policy_version 96571 (0.0008) [2023-12-26 00:21:21,898][123091] Updated weights for policy 0, policy_version 97147 (0.0007) [2023-12-26 00:21:22,696][123090] Updated weights for policy 1, policy_version 96581 (0.0009) [2023-12-26 00:21:22,758][123090] Updated weights for policy 1, policy_version 96591 (0.0009) [2023-12-26 00:21:22,784][123091] Updated weights for policy 0, policy_version 97157 (0.0009) [2023-12-26 00:21:22,822][123090] Updated weights for policy 1, policy_version 96601 (0.0009) [2023-12-26 00:21:22,838][123091] Updated weights for policy 0, policy_version 97167 (0.0009) [2023-12-26 00:21:22,893][123091] Updated weights for policy 0, policy_version 97177 (0.0009) [2023-12-26 00:21:23,583][123090] Updated weights for policy 1, policy_version 96611 (0.0006) [2023-12-26 00:21:23,652][123090] Updated weights for policy 1, policy_version 96621 (0.0006) [2023-12-26 00:21:23,703][123090] Updated weights for policy 1, policy_version 96631 (0.0008) [2023-12-26 00:21:23,743][123091] Updated weights for policy 0, policy_version 97187 (0.0009) [2023-12-26 00:21:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 49618944. Throughput: 0: 8957.6, 1: 8913.8. Samples: 49595756. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:23,785][121949] Avg episode reward: [(0, '4856.666'), (1, '5553.931')] [2023-12-26 00:21:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000096640_24739840.pth... [2023-12-26 00:21:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000095584_24469504.pth [2023-12-26 00:21:23,800][123091] Updated weights for policy 0, policy_version 97198 (0.0009) [2023-12-26 00:21:23,852][123091] Updated weights for policy 0, policy_version 97208 (0.0009) [2023-12-26 00:21:23,894][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000097216_24887296.pth... [2023-12-26 00:21:23,897][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000096160_24616960.pth [2023-12-26 00:21:24,379][123090] Updated weights for policy 1, policy_version 96641 (0.0008) [2023-12-26 00:21:24,443][123090] Updated weights for policy 1, policy_version 96651 (0.0008) [2023-12-26 00:21:24,500][123090] Updated weights for policy 1, policy_version 96661 (0.0009) [2023-12-26 00:21:24,561][123090] Updated weights for policy 1, policy_version 96672 (0.0010) [2023-12-26 00:21:24,725][123091] Updated weights for policy 0, policy_version 97218 (0.0009) [2023-12-26 00:21:24,784][123091] Updated weights for policy 0, policy_version 97228 (0.0006) [2023-12-26 00:21:24,829][123091] Updated weights for policy 0, policy_version 97238 (0.0005) [2023-12-26 00:21:24,875][123091] Updated weights for policy 0, policy_version 97248 (0.0005) [2023-12-26 00:21:25,434][123090] Updated weights for policy 1, policy_version 96682 (0.0005) [2023-12-26 00:21:25,498][123090] Updated weights for policy 1, policy_version 96692 (0.0005) [2023-12-26 00:21:25,558][123090] Updated weights for policy 1, policy_version 96702 (0.0005) [2023-12-26 00:21:25,642][123091] Updated weights for policy 0, policy_version 97258 (0.0010) [2023-12-26 00:21:25,707][123091] Updated weights for policy 0, policy_version 97268 (0.0010) [2023-12-26 00:21:25,764][123091] Updated weights for policy 0, policy_version 97278 (0.0009) [2023-12-26 00:21:26,152][123090] Updated weights for policy 1, policy_version 96712 (0.0009) [2023-12-26 00:21:26,206][123090] Updated weights for policy 1, policy_version 96722 (0.0009) [2023-12-26 00:21:26,258][123090] Updated weights for policy 1, policy_version 96732 (0.0008) [2023-12-26 00:21:26,621][123091] Updated weights for policy 0, policy_version 97288 (0.0010) [2023-12-26 00:21:26,690][123091] Updated weights for policy 0, policy_version 97298 (0.0009) [2023-12-26 00:21:26,761][123091] Updated weights for policy 0, policy_version 97308 (0.0010) [2023-12-26 00:21:27,066][123090] Updated weights for policy 1, policy_version 96742 (0.0007) [2023-12-26 00:21:27,124][123090] Updated weights for policy 1, policy_version 96752 (0.0005) [2023-12-26 00:21:27,182][123090] Updated weights for policy 1, policy_version 96762 (0.0009) [2023-12-26 00:21:27,654][123091] Updated weights for policy 0, policy_version 97318 (0.0010) [2023-12-26 00:21:27,707][123091] Updated weights for policy 0, policy_version 97328 (0.0009) [2023-12-26 00:21:27,754][123091] Updated weights for policy 0, policy_version 97338 (0.0008) [2023-12-26 00:21:27,896][123090] Updated weights for policy 1, policy_version 96772 (0.0009) [2023-12-26 00:21:27,950][123090] Updated weights for policy 1, policy_version 96782 (0.0005) [2023-12-26 00:21:28,004][123090] Updated weights for policy 1, policy_version 96792 (0.0006) [2023-12-26 00:21:28,642][123091] Updated weights for policy 0, policy_version 97348 (0.0009) [2023-12-26 00:21:28,699][123091] Updated weights for policy 0, policy_version 97358 (0.0009) [2023-12-26 00:21:28,761][123091] Updated weights for policy 0, policy_version 97368 (0.0009) [2023-12-26 00:21:28,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 49700864. Throughput: 0: 8930.1, 1: 8931.3. Samples: 49701740. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:28,785][121949] Avg episode reward: [(0, '4915.885'), (1, '5431.643')] [2023-12-26 00:21:28,809][123090] Updated weights for policy 1, policy_version 96802 (0.0007) [2023-12-26 00:21:28,810][123007] Saving new best policy, reward=4915.885! [2023-12-26 00:21:28,877][123090] Updated weights for policy 1, policy_version 96812 (0.0009) [2023-12-26 00:21:28,947][123090] Updated weights for policy 1, policy_version 96822 (0.0010) [2023-12-26 00:21:29,008][123090] Updated weights for policy 1, policy_version 96832 (0.0009) [2023-12-26 00:21:29,624][123091] Updated weights for policy 0, policy_version 97378 (0.0009) [2023-12-26 00:21:29,681][123091] Updated weights for policy 0, policy_version 97388 (0.0009) [2023-12-26 00:21:29,737][123091] Updated weights for policy 0, policy_version 97398 (0.0008) [2023-12-26 00:21:29,801][123091] Updated weights for policy 0, policy_version 97408 (0.0008) [2023-12-26 00:21:29,857][123090] Updated weights for policy 1, policy_version 96842 (0.0009) [2023-12-26 00:21:29,914][123090] Updated weights for policy 1, policy_version 96852 (0.0009) [2023-12-26 00:21:29,984][123090] Updated weights for policy 1, policy_version 96862 (0.0009) [2023-12-26 00:21:30,601][123091] Updated weights for policy 0, policy_version 97418 (0.0009) [2023-12-26 00:21:30,655][123091] Updated weights for policy 0, policy_version 97428 (0.0010) [2023-12-26 00:21:30,703][123091] Updated weights for policy 0, policy_version 97438 (0.0009) [2023-12-26 00:21:30,798][123090] Updated weights for policy 1, policy_version 96872 (0.0008) [2023-12-26 00:21:30,851][123090] Updated weights for policy 1, policy_version 96882 (0.0005) [2023-12-26 00:21:30,895][123090] Updated weights for policy 1, policy_version 96892 (0.0005) [2023-12-26 00:21:31,457][123091] Updated weights for policy 0, policy_version 97448 (0.0009) [2023-12-26 00:21:31,514][123091] Updated weights for policy 0, policy_version 97458 (0.0009) [2023-12-26 00:21:31,577][123091] Updated weights for policy 0, policy_version 97468 (0.0009) [2023-12-26 00:21:31,683][123090] Updated weights for policy 1, policy_version 96902 (0.0007) [2023-12-26 00:21:31,750][123090] Updated weights for policy 1, policy_version 96912 (0.0009) [2023-12-26 00:21:31,806][123090] Updated weights for policy 1, policy_version 96922 (0.0009) [2023-12-26 00:21:32,425][123091] Updated weights for policy 0, policy_version 97478 (0.0007) [2023-12-26 00:21:32,485][123091] Updated weights for policy 0, policy_version 97488 (0.0005) [2023-12-26 00:21:32,515][123090] Updated weights for policy 1, policy_version 96932 (0.0008) [2023-12-26 00:21:32,544][123091] Updated weights for policy 0, policy_version 97498 (0.0006) [2023-12-26 00:21:32,583][123090] Updated weights for policy 1, policy_version 96942 (0.0007) [2023-12-26 00:21:32,648][123090] Updated weights for policy 1, policy_version 96952 (0.0005) [2023-12-26 00:21:33,228][123091] Updated weights for policy 0, policy_version 97508 (0.0007) [2023-12-26 00:21:33,283][123091] Updated weights for policy 0, policy_version 97518 (0.0010) [2023-12-26 00:21:33,299][123090] Updated weights for policy 1, policy_version 96962 (0.0006) [2023-12-26 00:21:33,332][123091] Updated weights for policy 0, policy_version 97528 (0.0010) [2023-12-26 00:21:33,357][123090] Updated weights for policy 1, policy_version 96972 (0.0008) [2023-12-26 00:21:33,414][123090] Updated weights for policy 1, policy_version 96982 (0.0009) [2023-12-26 00:21:33,470][123090] Updated weights for policy 1, policy_version 96992 (0.0009) [2023-12-26 00:21:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 49799168. Throughput: 0: 8891.0, 1: 8998.3. Samples: 49808496. Policy #0 lag: (min: 20.0, avg: 30.3, max: 52.0) [2023-12-26 00:21:33,785][121949] Avg episode reward: [(0, '4877.835'), (1, '5392.009')] [2023-12-26 00:21:34,126][123091] Updated weights for policy 0, policy_version 97538 (0.0009) [2023-12-26 00:21:34,195][123091] Updated weights for policy 0, policy_version 97548 (0.0010) [2023-12-26 00:21:34,263][123091] Updated weights for policy 0, policy_version 97558 (0.0011) [2023-12-26 00:21:34,335][123091] Updated weights for policy 0, policy_version 97568 (0.0011) [2023-12-26 00:21:34,342][123090] Updated weights for policy 1, policy_version 97002 (0.0008) [2023-12-26 00:21:34,408][123090] Updated weights for policy 1, policy_version 97012 (0.0008) [2023-12-26 00:21:34,474][123090] Updated weights for policy 1, policy_version 97022 (0.0006) [2023-12-26 00:21:35,040][123091] Updated weights for policy 0, policy_version 97578 (0.0011) [2023-12-26 00:21:35,088][123091] Updated weights for policy 0, policy_version 97588 (0.0010) [2023-12-26 00:21:35,150][123091] Updated weights for policy 0, policy_version 97598 (0.0011) [2023-12-26 00:21:35,186][123090] Updated weights for policy 1, policy_version 97032 (0.0006) [2023-12-26 00:21:35,234][123090] Updated weights for policy 1, policy_version 97042 (0.0005) [2023-12-26 00:21:35,292][123090] Updated weights for policy 1, policy_version 97052 (0.0007) [2023-12-26 00:21:35,927][123091] Updated weights for policy 0, policy_version 97608 (0.0006) [2023-12-26 00:21:35,998][123091] Updated weights for policy 0, policy_version 97618 (0.0005) [2023-12-26 00:21:36,053][123090] Updated weights for policy 1, policy_version 97062 (0.0009) [2023-12-26 00:21:36,063][123091] Updated weights for policy 0, policy_version 97628 (0.0005) [2023-12-26 00:21:36,110][123090] Updated weights for policy 1, policy_version 97072 (0.0009) [2023-12-26 00:21:36,172][123090] Updated weights for policy 1, policy_version 97082 (0.0010) [2023-12-26 00:21:36,745][123091] Updated weights for policy 0, policy_version 97638 (0.0008) [2023-12-26 00:21:36,802][123091] Updated weights for policy 0, policy_version 97648 (0.0011) [2023-12-26 00:21:36,858][123091] Updated weights for policy 0, policy_version 97658 (0.0011) [2023-12-26 00:21:37,071][123090] Updated weights for policy 1, policy_version 97093 (0.0011) [2023-12-26 00:21:37,137][123090] Updated weights for policy 1, policy_version 97103 (0.0010) [2023-12-26 00:21:37,189][123090] Updated weights for policy 1, policy_version 97113 (0.0007) [2023-12-26 00:21:37,690][123091] Updated weights for policy 0, policy_version 97668 (0.0010) [2023-12-26 00:21:37,754][123091] Updated weights for policy 0, policy_version 97678 (0.0009) [2023-12-26 00:21:37,822][123091] Updated weights for policy 0, policy_version 97688 (0.0008) [2023-12-26 00:21:37,920][123090] Updated weights for policy 1, policy_version 97123 (0.0010) [2023-12-26 00:21:37,977][123090] Updated weights for policy 1, policy_version 97134 (0.0010) [2023-12-26 00:21:38,033][123090] Updated weights for policy 1, policy_version 97144 (0.0009) [2023-12-26 00:21:38,599][123091] Updated weights for policy 0, policy_version 97698 (0.0008) [2023-12-26 00:21:38,658][123091] Updated weights for policy 0, policy_version 97708 (0.0006) [2023-12-26 00:21:38,727][123091] Updated weights for policy 0, policy_version 97718 (0.0006) [2023-12-26 00:21:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 49881088. Throughput: 0: 8926.8, 1: 8998.0. Samples: 49864096. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:21:38,785][121949] Avg episode reward: [(0, '4829.193'), (1, '5510.404')] [2023-12-26 00:21:38,790][123091] Updated weights for policy 0, policy_version 97728 (0.0009) [2023-12-26 00:21:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000097728_25018368.pth... [2023-12-26 00:21:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000097152_24870912.pth... [2023-12-26 00:21:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000096704_24756224.pth [2023-12-26 00:21:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000096096_24600576.pth [2023-12-26 00:21:38,891][123090] Updated weights for policy 1, policy_version 97154 (0.0009) [2023-12-26 00:21:38,952][123090] Updated weights for policy 1, policy_version 97164 (0.0006) [2023-12-26 00:21:39,021][123090] Updated weights for policy 1, policy_version 97174 (0.0005) [2023-12-26 00:21:39,090][123090] Updated weights for policy 1, policy_version 97184 (0.0005) [2023-12-26 00:21:39,568][123091] Updated weights for policy 0, policy_version 97738 (0.0011) [2023-12-26 00:21:39,633][123091] Updated weights for policy 0, policy_version 97748 (0.0011) [2023-12-26 00:21:39,687][123091] Updated weights for policy 0, policy_version 97758 (0.0011) [2023-12-26 00:21:39,806][123090] Updated weights for policy 1, policy_version 97194 (0.0008) [2023-12-26 00:21:39,873][123090] Updated weights for policy 1, policy_version 97204 (0.0008) [2023-12-26 00:21:39,945][123090] Updated weights for policy 1, policy_version 97214 (0.0009) [2023-12-26 00:21:40,430][123091] Updated weights for policy 0, policy_version 97768 (0.0010) [2023-12-26 00:21:40,484][123091] Updated weights for policy 0, policy_version 97778 (0.0006) [2023-12-26 00:21:40,549][123091] Updated weights for policy 0, policy_version 97788 (0.0006) [2023-12-26 00:21:40,866][123090] Updated weights for policy 1, policy_version 97224 (0.0010) [2023-12-26 00:21:40,919][123090] Updated weights for policy 1, policy_version 97234 (0.0010) [2023-12-26 00:21:40,978][123090] Updated weights for policy 1, policy_version 97244 (0.0009) [2023-12-26 00:21:41,297][123091] Updated weights for policy 0, policy_version 97798 (0.0007) [2023-12-26 00:21:41,367][123091] Updated weights for policy 0, policy_version 97808 (0.0010) [2023-12-26 00:21:41,436][123091] Updated weights for policy 0, policy_version 97818 (0.0010) [2023-12-26 00:21:41,875][123090] Updated weights for policy 1, policy_version 97254 (0.0008) [2023-12-26 00:21:41,939][123090] Updated weights for policy 1, policy_version 97264 (0.0009) [2023-12-26 00:21:42,002][123090] Updated weights for policy 1, policy_version 97274 (0.0010) [2023-12-26 00:21:42,161][123091] Updated weights for policy 0, policy_version 97828 (0.0010) [2023-12-26 00:21:42,226][123091] Updated weights for policy 0, policy_version 97838 (0.0006) [2023-12-26 00:21:42,293][123091] Updated weights for policy 0, policy_version 97848 (0.0008) [2023-12-26 00:21:42,860][123090] Updated weights for policy 1, policy_version 97284 (0.0010) [2023-12-26 00:21:42,922][123090] Updated weights for policy 1, policy_version 97294 (0.0010) [2023-12-26 00:21:42,989][123090] Updated weights for policy 1, policy_version 97304 (0.0010) [2023-12-26 00:21:43,144][123091] Updated weights for policy 0, policy_version 97858 (0.0009) [2023-12-26 00:21:43,214][123091] Updated weights for policy 0, policy_version 97868 (0.0009) [2023-12-26 00:21:43,277][123091] Updated weights for policy 0, policy_version 97878 (0.0010) [2023-12-26 00:21:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 49971200. Throughput: 0: 8898.3, 1: 8882.2. Samples: 49968656. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:21:43,785][121949] Avg episode reward: [(0, '4924.099'), (1, '5584.430')] [2023-12-26 00:21:43,786][123007] Saving new best policy, reward=4924.099! [2023-12-26 00:21:43,812][123090] Updated weights for policy 1, policy_version 97314 (0.0009) [2023-12-26 00:21:43,866][123090] Updated weights for policy 1, policy_version 97324 (0.0008) [2023-12-26 00:21:43,916][123090] Updated weights for policy 1, policy_version 97334 (0.0009) [2023-12-26 00:21:43,964][123090] Updated weights for policy 1, policy_version 97344 (0.0009) [2023-12-26 00:21:44,100][123091] Updated weights for policy 0, policy_version 97889 (0.0011) [2023-12-26 00:21:44,162][123091] Updated weights for policy 0, policy_version 97899 (0.0010) [2023-12-26 00:21:44,219][123091] Updated weights for policy 0, policy_version 97909 (0.0009) [2023-12-26 00:21:44,286][123091] Updated weights for policy 0, policy_version 97919 (0.0009) [2023-12-26 00:21:44,809][123090] Updated weights for policy 1, policy_version 97354 (0.0009) [2023-12-26 00:21:44,869][123090] Updated weights for policy 1, policy_version 97364 (0.0010) [2023-12-26 00:21:44,938][123090] Updated weights for policy 1, policy_version 97374 (0.0009) [2023-12-26 00:21:45,141][123091] Updated weights for policy 0, policy_version 97929 (0.0010) [2023-12-26 00:21:45,212][123091] Updated weights for policy 0, policy_version 97939 (0.0009) [2023-12-26 00:21:45,278][123091] Updated weights for policy 0, policy_version 97949 (0.0010) [2023-12-26 00:21:45,858][123090] Updated weights for policy 1, policy_version 97384 (0.0010) [2023-12-26 00:21:45,910][123090] Updated weights for policy 1, policy_version 97394 (0.0009) [2023-12-26 00:21:45,965][123091] Updated weights for policy 0, policy_version 97959 (0.0008) [2023-12-26 00:21:45,973][123090] Updated weights for policy 1, policy_version 97404 (0.0008) [2023-12-26 00:21:46,028][123091] Updated weights for policy 0, policy_version 97969 (0.0010) [2023-12-26 00:21:46,091][123091] Updated weights for policy 0, policy_version 97979 (0.0008) [2023-12-26 00:21:46,711][123090] Updated weights for policy 1, policy_version 97414 (0.0006) [2023-12-26 00:21:46,718][123091] Updated weights for policy 0, policy_version 97989 (0.0007) [2023-12-26 00:21:46,782][123091] Updated weights for policy 0, policy_version 97999 (0.0005) [2023-12-26 00:21:46,782][123090] Updated weights for policy 1, policy_version 97424 (0.0005) [2023-12-26 00:21:46,837][123091] Updated weights for policy 0, policy_version 98009 (0.0005) [2023-12-26 00:21:46,855][123090] Updated weights for policy 1, policy_version 97434 (0.0008) [2023-12-26 00:21:47,533][123091] Updated weights for policy 0, policy_version 98019 (0.0005) [2023-12-26 00:21:47,559][123090] Updated weights for policy 1, policy_version 97444 (0.0006) [2023-12-26 00:21:47,594][123091] Updated weights for policy 0, policy_version 98029 (0.0005) [2023-12-26 00:21:47,609][123090] Updated weights for policy 1, policy_version 97454 (0.0009) [2023-12-26 00:21:47,649][123091] Updated weights for policy 0, policy_version 98039 (0.0005) [2023-12-26 00:21:47,670][123090] Updated weights for policy 1, policy_version 97464 (0.0008) [2023-12-26 00:21:48,366][123091] Updated weights for policy 0, policy_version 98049 (0.0006) [2023-12-26 00:21:48,418][123090] Updated weights for policy 1, policy_version 97474 (0.0009) [2023-12-26 00:21:48,431][123091] Updated weights for policy 0, policy_version 98059 (0.0010) [2023-12-26 00:21:48,480][123090] Updated weights for policy 1, policy_version 97484 (0.0008) [2023-12-26 00:21:48,488][123091] Updated weights for policy 0, policy_version 98069 (0.0008) [2023-12-26 00:21:48,544][123090] Updated weights for policy 1, policy_version 97494 (0.0008) [2023-12-26 00:21:48,550][123091] Updated weights for policy 0, policy_version 98079 (0.0009) [2023-12-26 00:21:48,607][123090] Updated weights for policy 1, policy_version 97504 (0.0009) [2023-12-26 00:21:48,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 50069504. Throughput: 0: 8936.4, 1: 8880.9. Samples: 50077560. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:21:48,785][121949] Avg episode reward: [(0, '5005.647'), (1, '5512.812')] [2023-12-26 00:21:48,787][123007] Saving new best policy, reward=5005.647! [2023-12-26 00:21:49,393][123091] Updated weights for policy 0, policy_version 98089 (0.0008) [2023-12-26 00:21:49,447][123090] Updated weights for policy 1, policy_version 97514 (0.0008) [2023-12-26 00:21:49,451][123091] Updated weights for policy 0, policy_version 98099 (0.0007) [2023-12-26 00:21:49,506][123091] Updated weights for policy 0, policy_version 98109 (0.0008) [2023-12-26 00:21:49,508][123090] Updated weights for policy 1, policy_version 97524 (0.0008) [2023-12-26 00:21:49,566][123090] Updated weights for policy 1, policy_version 97534 (0.0009) [2023-12-26 00:21:50,302][123091] Updated weights for policy 0, policy_version 98119 (0.0009) [2023-12-26 00:21:50,354][123091] Updated weights for policy 0, policy_version 98129 (0.0010) [2023-12-26 00:21:50,383][123090] Updated weights for policy 1, policy_version 97544 (0.0008) [2023-12-26 00:21:50,406][123091] Updated weights for policy 0, policy_version 98139 (0.0010) [2023-12-26 00:21:50,438][123090] Updated weights for policy 1, policy_version 97554 (0.0006) [2023-12-26 00:21:50,495][123090] Updated weights for policy 1, policy_version 97564 (0.0008) [2023-12-26 00:21:51,285][123091] Updated weights for policy 0, policy_version 98149 (0.0010) [2023-12-26 00:21:51,345][123091] Updated weights for policy 0, policy_version 98159 (0.0008) [2023-12-26 00:21:51,371][123090] Updated weights for policy 1, policy_version 97574 (0.0008) [2023-12-26 00:21:51,420][123091] Updated weights for policy 0, policy_version 98169 (0.0008) [2023-12-26 00:21:51,435][123090] Updated weights for policy 1, policy_version 97584 (0.0009) [2023-12-26 00:21:51,494][123090] Updated weights for policy 1, policy_version 97594 (0.0008) [2023-12-26 00:21:52,188][123091] Updated weights for policy 0, policy_version 98179 (0.0007) [2023-12-26 00:21:52,252][123091] Updated weights for policy 0, policy_version 98189 (0.0007) [2023-12-26 00:21:52,262][123090] Updated weights for policy 1, policy_version 97604 (0.0009) [2023-12-26 00:21:52,318][123091] Updated weights for policy 0, policy_version 98199 (0.0009) [2023-12-26 00:21:52,328][123090] Updated weights for policy 1, policy_version 97614 (0.0009) [2023-12-26 00:21:52,397][123090] Updated weights for policy 1, policy_version 97624 (0.0009) [2023-12-26 00:21:53,096][123090] Updated weights for policy 1, policy_version 97634 (0.0009) [2023-12-26 00:21:53,126][123091] Updated weights for policy 0, policy_version 98209 (0.0009) [2023-12-26 00:21:53,153][123090] Updated weights for policy 1, policy_version 97644 (0.0010) [2023-12-26 00:21:53,182][123091] Updated weights for policy 0, policy_version 98219 (0.0007) [2023-12-26 00:21:53,220][123090] Updated weights for policy 1, policy_version 97654 (0.0010) [2023-12-26 00:21:53,242][123091] Updated weights for policy 0, policy_version 98229 (0.0009) [2023-12-26 00:21:53,283][123090] Updated weights for policy 1, policy_version 97664 (0.0010) [2023-12-26 00:21:53,304][123091] Updated weights for policy 0, policy_version 98239 (0.0006) [2023-12-26 00:21:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 50151424. Throughput: 0: 8869.8, 1: 8857.3. Samples: 50127920. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:21:53,785][121949] Avg episode reward: [(0, '4947.141'), (1, '5419.029')] [2023-12-26 00:21:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000098240_25149440.pth... [2023-12-26 00:21:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000097664_25001984.pth... [2023-12-26 00:21:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000097216_24887296.pth [2023-12-26 00:21:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000096640_24739840.pth [2023-12-26 00:21:54,014][123091] Updated weights for policy 0, policy_version 98249 (0.0010) [2023-12-26 00:21:54,021][123090] Updated weights for policy 1, policy_version 97674 (0.0005) [2023-12-26 00:21:54,065][123091] Updated weights for policy 0, policy_version 98259 (0.0010) [2023-12-26 00:21:54,086][123090] Updated weights for policy 1, policy_version 97684 (0.0005) [2023-12-26 00:21:54,124][123091] Updated weights for policy 0, policy_version 98269 (0.0011) [2023-12-26 00:21:54,143][123090] Updated weights for policy 1, policy_version 97694 (0.0008) [2023-12-26 00:21:54,827][123090] Updated weights for policy 1, policy_version 97704 (0.0009) [2023-12-26 00:21:54,873][123090] Updated weights for policy 1, policy_version 97714 (0.0008) [2023-12-26 00:21:54,920][123091] Updated weights for policy 0, policy_version 98279 (0.0011) [2023-12-26 00:21:54,933][123090] Updated weights for policy 1, policy_version 97724 (0.0007) [2023-12-26 00:21:54,979][123091] Updated weights for policy 0, policy_version 98289 (0.0011) [2023-12-26 00:21:55,038][123091] Updated weights for policy 0, policy_version 98299 (0.0011) [2023-12-26 00:21:55,607][123090] Updated weights for policy 1, policy_version 97734 (0.0007) [2023-12-26 00:21:55,662][123090] Updated weights for policy 1, policy_version 97744 (0.0009) [2023-12-26 00:21:55,722][123090] Updated weights for policy 1, policy_version 97754 (0.0009) [2023-12-26 00:21:55,750][123091] Updated weights for policy 0, policy_version 98309 (0.0008) [2023-12-26 00:21:55,825][123091] Updated weights for policy 0, policy_version 98319 (0.0005) [2023-12-26 00:21:55,893][123091] Updated weights for policy 0, policy_version 98329 (0.0005) [2023-12-26 00:21:56,550][123091] Updated weights for policy 0, policy_version 98339 (0.0007) [2023-12-26 00:21:56,598][123090] Updated weights for policy 1, policy_version 97764 (0.0008) [2023-12-26 00:21:56,601][123091] Updated weights for policy 0, policy_version 98349 (0.0006) [2023-12-26 00:21:56,651][123090] Updated weights for policy 1, policy_version 97774 (0.0010) [2023-12-26 00:21:56,657][123091] Updated weights for policy 0, policy_version 98359 (0.0005) [2023-12-26 00:21:56,707][123090] Updated weights for policy 1, policy_version 97784 (0.0008) [2023-12-26 00:21:57,257][123091] Updated weights for policy 0, policy_version 98369 (0.0005) [2023-12-26 00:21:57,328][123091] Updated weights for policy 0, policy_version 98379 (0.0008) [2023-12-26 00:21:57,398][123091] Updated weights for policy 0, policy_version 98389 (0.0005) [2023-12-26 00:21:57,464][123091] Updated weights for policy 0, policy_version 98399 (0.0008) [2023-12-26 00:21:57,502][123090] Updated weights for policy 1, policy_version 97794 (0.0009) [2023-12-26 00:21:57,557][123090] Updated weights for policy 1, policy_version 97804 (0.0005) [2023-12-26 00:21:57,623][123090] Updated weights for policy 1, policy_version 97814 (0.0006) [2023-12-26 00:21:57,678][123090] Updated weights for policy 1, policy_version 97824 (0.0005) [2023-12-26 00:21:58,202][123091] Updated weights for policy 0, policy_version 98409 (0.0008) [2023-12-26 00:21:58,276][123091] Updated weights for policy 0, policy_version 98419 (0.0007) [2023-12-26 00:21:58,334][123091] Updated weights for policy 0, policy_version 98429 (0.0009) [2023-12-26 00:21:58,372][123090] Updated weights for policy 1, policy_version 97834 (0.0008) [2023-12-26 00:21:58,440][123090] Updated weights for policy 1, policy_version 97844 (0.0009) [2023-12-26 00:21:58,513][123090] Updated weights for policy 1, policy_version 97854 (0.0010) [2023-12-26 00:21:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 50249728. Throughput: 0: 8936.0, 1: 8962.0. Samples: 50241752. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:21:58,785][121949] Avg episode reward: [(0, '4921.775'), (1, '5486.846')] [2023-12-26 00:21:59,157][123091] Updated weights for policy 0, policy_version 98439 (0.0007) [2023-12-26 00:21:59,229][123091] Updated weights for policy 0, policy_version 98449 (0.0010) [2023-12-26 00:21:59,299][123091] Updated weights for policy 0, policy_version 98459 (0.0009) [2023-12-26 00:21:59,402][123090] Updated weights for policy 1, policy_version 97864 (0.0008) [2023-12-26 00:21:59,453][123090] Updated weights for policy 1, policy_version 97874 (0.0008) [2023-12-26 00:21:59,504][123090] Updated weights for policy 1, policy_version 97884 (0.0008) [2023-12-26 00:22:00,042][123091] Updated weights for policy 0, policy_version 98469 (0.0009) [2023-12-26 00:22:00,104][123091] Updated weights for policy 0, policy_version 98479 (0.0010) [2023-12-26 00:22:00,162][123091] Updated weights for policy 0, policy_version 98489 (0.0010) [2023-12-26 00:22:00,267][123090] Updated weights for policy 1, policy_version 97894 (0.0007) [2023-12-26 00:22:00,338][123090] Updated weights for policy 1, policy_version 97904 (0.0005) [2023-12-26 00:22:00,401][123090] Updated weights for policy 1, policy_version 97914 (0.0005) [2023-12-26 00:22:00,993][123091] Updated weights for policy 0, policy_version 98499 (0.0010) [2023-12-26 00:22:01,046][123091] Updated weights for policy 0, policy_version 98509 (0.0010) [2023-12-26 00:22:01,065][123090] Updated weights for policy 1, policy_version 97924 (0.0006) [2023-12-26 00:22:01,114][123090] Updated weights for policy 1, policy_version 97934 (0.0005) [2023-12-26 00:22:01,118][123091] Updated weights for policy 0, policy_version 98519 (0.0010) [2023-12-26 00:22:01,179][123090] Updated weights for policy 1, policy_version 97944 (0.0007) [2023-12-26 00:22:01,932][123091] Updated weights for policy 0, policy_version 98529 (0.0010) [2023-12-26 00:22:01,936][123090] Updated weights for policy 1, policy_version 97954 (0.0006) [2023-12-26 00:22:02,001][123091] Updated weights for policy 0, policy_version 98539 (0.0008) [2023-12-26 00:22:02,007][123090] Updated weights for policy 1, policy_version 97964 (0.0007) [2023-12-26 00:22:02,076][123091] Updated weights for policy 0, policy_version 98549 (0.0007) [2023-12-26 00:22:02,079][123090] Updated weights for policy 1, policy_version 97974 (0.0005) [2023-12-26 00:22:02,137][123090] Updated weights for policy 1, policy_version 97984 (0.0006) [2023-12-26 00:22:02,137][123091] Updated weights for policy 0, policy_version 98559 (0.0009) [2023-12-26 00:22:02,815][123091] Updated weights for policy 0, policy_version 98569 (0.0006) [2023-12-26 00:22:02,816][123090] Updated weights for policy 1, policy_version 97994 (0.0005) [2023-12-26 00:22:02,868][123091] Updated weights for policy 0, policy_version 98579 (0.0005) [2023-12-26 00:22:02,880][123090] Updated weights for policy 1, policy_version 98004 (0.0008) [2023-12-26 00:22:02,920][123091] Updated weights for policy 0, policy_version 98589 (0.0005) [2023-12-26 00:22:02,942][123090] Updated weights for policy 1, policy_version 98014 (0.0007) [2023-12-26 00:22:03,577][123091] Updated weights for policy 0, policy_version 98599 (0.0009) [2023-12-26 00:22:03,630][123091] Updated weights for policy 0, policy_version 98609 (0.0010) [2023-12-26 00:22:03,636][123090] Updated weights for policy 1, policy_version 98024 (0.0005) [2023-12-26 00:22:03,681][123091] Updated weights for policy 0, policy_version 98619 (0.0007) [2023-12-26 00:22:03,688][123090] Updated weights for policy 1, policy_version 98034 (0.0005) [2023-12-26 00:22:03,743][123090] Updated weights for policy 1, policy_version 98044 (0.0005) [2023-12-26 00:22:03,784][121949] Fps is (10 sec: 19661.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 50348032. Throughput: 0: 8993.0, 1: 8990.0. Samples: 50352388. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:03,785][121949] Avg episode reward: [(0, '4858.637'), (1, '5332.569')] [2023-12-26 00:22:04,442][123091] Updated weights for policy 0, policy_version 98629 (0.0005) [2023-12-26 00:22:04,446][123090] Updated weights for policy 1, policy_version 98054 (0.0008) [2023-12-26 00:22:04,503][123091] Updated weights for policy 0, policy_version 98639 (0.0005) [2023-12-26 00:22:04,507][123090] Updated weights for policy 1, policy_version 98064 (0.0011) [2023-12-26 00:22:04,562][123090] Updated weights for policy 1, policy_version 98074 (0.0006) [2023-12-26 00:22:04,575][123091] Updated weights for policy 0, policy_version 98649 (0.0008) [2023-12-26 00:22:05,263][123090] Updated weights for policy 1, policy_version 98084 (0.0007) [2023-12-26 00:22:05,317][123090] Updated weights for policy 1, policy_version 98094 (0.0009) [2023-12-26 00:22:05,341][123091] Updated weights for policy 0, policy_version 98659 (0.0008) [2023-12-26 00:22:05,370][123090] Updated weights for policy 1, policy_version 98104 (0.0009) [2023-12-26 00:22:05,389][123091] Updated weights for policy 0, policy_version 98669 (0.0009) [2023-12-26 00:22:05,445][123091] Updated weights for policy 0, policy_version 98679 (0.0010) [2023-12-26 00:22:06,194][123090] Updated weights for policy 1, policy_version 98114 (0.0007) [2023-12-26 00:22:06,265][123090] Updated weights for policy 1, policy_version 98124 (0.0008) [2023-12-26 00:22:06,278][123091] Updated weights for policy 0, policy_version 98689 (0.0011) [2023-12-26 00:22:06,328][123090] Updated weights for policy 1, policy_version 98134 (0.0008) [2023-12-26 00:22:06,342][123091] Updated weights for policy 0, policy_version 98699 (0.0011) [2023-12-26 00:22:06,391][123090] Updated weights for policy 1, policy_version 98144 (0.0008) [2023-12-26 00:22:06,398][123091] Updated weights for policy 0, policy_version 98709 (0.0010) [2023-12-26 00:22:06,466][123091] Updated weights for policy 0, policy_version 98719 (0.0011) [2023-12-26 00:22:07,148][123090] Updated weights for policy 1, policy_version 98154 (0.0005) [2023-12-26 00:22:07,204][123090] Updated weights for policy 1, policy_version 98164 (0.0005) [2023-12-26 00:22:07,216][123091] Updated weights for policy 0, policy_version 98729 (0.0008) [2023-12-26 00:22:07,262][123090] Updated weights for policy 1, policy_version 98174 (0.0005) [2023-12-26 00:22:07,264][123091] Updated weights for policy 0, policy_version 98739 (0.0010) [2023-12-26 00:22:07,327][123091] Updated weights for policy 0, policy_version 98749 (0.0011) [2023-12-26 00:22:07,959][123090] Updated weights for policy 1, policy_version 98184 (0.0010) [2023-12-26 00:22:08,022][123090] Updated weights for policy 1, policy_version 98194 (0.0010) [2023-12-26 00:22:08,047][123091] Updated weights for policy 0, policy_version 98759 (0.0010) [2023-12-26 00:22:08,081][123090] Updated weights for policy 1, policy_version 98204 (0.0010) [2023-12-26 00:22:08,109][123091] Updated weights for policy 0, policy_version 98769 (0.0010) [2023-12-26 00:22:08,170][123091] Updated weights for policy 0, policy_version 98779 (0.0010) [2023-12-26 00:22:08,785][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.7, 300 sec: 17772.5). Total num frames: 50429952. Throughput: 0: 8988.7, 1: 9058.6. Samples: 50407888. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:08,786][121949] Avg episode reward: [(0, '4925.467'), (1, '5328.027')] [2023-12-26 00:22:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000098784_25288704.pth... [2023-12-26 00:22:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000098208_25141248.pth... [2023-12-26 00:22:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000097728_25018368.pth [2023-12-26 00:22:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000097152_24870912.pth [2023-12-26 00:22:08,899][123090] Updated weights for policy 1, policy_version 98214 (0.0009) [2023-12-26 00:22:08,952][123090] Updated weights for policy 1, policy_version 98224 (0.0009) [2023-12-26 00:22:08,993][123091] Updated weights for policy 0, policy_version 98789 (0.0011) [2023-12-26 00:22:09,013][123090] Updated weights for policy 1, policy_version 98234 (0.0007) [2023-12-26 00:22:09,056][123091] Updated weights for policy 0, policy_version 98799 (0.0011) [2023-12-26 00:22:09,115][123091] Updated weights for policy 0, policy_version 98809 (0.0011) [2023-12-26 00:22:09,831][123090] Updated weights for policy 1, policy_version 98244 (0.0010) [2023-12-26 00:22:09,906][123090] Updated weights for policy 1, policy_version 98254 (0.0009) [2023-12-26 00:22:09,979][123090] Updated weights for policy 1, policy_version 98264 (0.0010) [2023-12-26 00:22:10,000][123091] Updated weights for policy 0, policy_version 98819 (0.0009) [2023-12-26 00:22:10,065][123091] Updated weights for policy 0, policy_version 98829 (0.0008) [2023-12-26 00:22:10,134][123091] Updated weights for policy 0, policy_version 98839 (0.0009) [2023-12-26 00:22:10,681][123090] Updated weights for policy 1, policy_version 98274 (0.0009) [2023-12-26 00:22:10,741][123090] Updated weights for policy 1, policy_version 98284 (0.0009) [2023-12-26 00:22:10,797][123090] Updated weights for policy 1, policy_version 98294 (0.0009) [2023-12-26 00:22:10,862][123090] Updated weights for policy 1, policy_version 98304 (0.0010) [2023-12-26 00:22:10,986][123091] Updated weights for policy 0, policy_version 98849 (0.0010) [2023-12-26 00:22:11,044][123091] Updated weights for policy 0, policy_version 98859 (0.0009) [2023-12-26 00:22:11,111][123091] Updated weights for policy 0, policy_version 98869 (0.0009) [2023-12-26 00:22:11,172][123091] Updated weights for policy 0, policy_version 98879 (0.0008) [2023-12-26 00:22:11,726][123090] Updated weights for policy 1, policy_version 98314 (0.0010) [2023-12-26 00:22:11,788][123090] Updated weights for policy 1, policy_version 98324 (0.0009) [2023-12-26 00:22:11,852][123090] Updated weights for policy 1, policy_version 98334 (0.0008) [2023-12-26 00:22:12,005][123091] Updated weights for policy 0, policy_version 98889 (0.0006) [2023-12-26 00:22:12,086][123091] Updated weights for policy 0, policy_version 98899 (0.0010) [2023-12-26 00:22:12,168][123091] Updated weights for policy 0, policy_version 98909 (0.0008) [2023-12-26 00:22:12,635][123090] Updated weights for policy 1, policy_version 98344 (0.0009) [2023-12-26 00:22:12,699][123090] Updated weights for policy 1, policy_version 98354 (0.0009) [2023-12-26 00:22:12,758][123090] Updated weights for policy 1, policy_version 98364 (0.0010) [2023-12-26 00:22:12,962][123091] Updated weights for policy 0, policy_version 98919 (0.0010) [2023-12-26 00:22:13,027][123091] Updated weights for policy 0, policy_version 98929 (0.0010) [2023-12-26 00:22:13,090][123091] Updated weights for policy 0, policy_version 98939 (0.0009) [2023-12-26 00:22:13,591][123090] Updated weights for policy 1, policy_version 98374 (0.0009) [2023-12-26 00:22:13,649][123090] Updated weights for policy 1, policy_version 98384 (0.0009) [2023-12-26 00:22:13,710][123090] Updated weights for policy 1, policy_version 98394 (0.0009) [2023-12-26 00:22:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 50520064. Throughput: 0: 9021.2, 1: 8991.2. Samples: 50512300. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:13,785][121949] Avg episode reward: [(0, '4972.514'), (1, '5322.214')] [2023-12-26 00:22:13,916][123091] Updated weights for policy 0, policy_version 98950 (0.0010) [2023-12-26 00:22:13,977][123091] Updated weights for policy 0, policy_version 98960 (0.0009) [2023-12-26 00:22:14,041][123091] Updated weights for policy 0, policy_version 98970 (0.0010) [2023-12-26 00:22:14,504][123090] Updated weights for policy 1, policy_version 98404 (0.0009) [2023-12-26 00:22:14,554][123090] Updated weights for policy 1, policy_version 98414 (0.0009) [2023-12-26 00:22:14,615][123090] Updated weights for policy 1, policy_version 98424 (0.0009) [2023-12-26 00:22:14,881][123091] Updated weights for policy 0, policy_version 98980 (0.0009) [2023-12-26 00:22:14,936][123091] Updated weights for policy 0, policy_version 98990 (0.0009) [2023-12-26 00:22:15,001][123091] Updated weights for policy 0, policy_version 99000 (0.0009) [2023-12-26 00:22:15,499][123090] Updated weights for policy 1, policy_version 98434 (0.0008) [2023-12-26 00:22:15,560][123090] Updated weights for policy 1, policy_version 98444 (0.0009) [2023-12-26 00:22:15,625][123090] Updated weights for policy 1, policy_version 98454 (0.0009) [2023-12-26 00:22:15,678][123090] Updated weights for policy 1, policy_version 98464 (0.0009) [2023-12-26 00:22:15,841][123091] Updated weights for policy 0, policy_version 99010 (0.0008) [2023-12-26 00:22:15,898][123091] Updated weights for policy 0, policy_version 99020 (0.0005) [2023-12-26 00:22:15,964][123091] Updated weights for policy 0, policy_version 99030 (0.0005) [2023-12-26 00:22:16,018][123091] Updated weights for policy 0, policy_version 99040 (0.0010) [2023-12-26 00:22:16,528][123090] Updated weights for policy 1, policy_version 98474 (0.0009) [2023-12-26 00:22:16,581][123090] Updated weights for policy 1, policy_version 98484 (0.0009) [2023-12-26 00:22:16,646][123090] Updated weights for policy 1, policy_version 98494 (0.0009) [2023-12-26 00:22:16,820][123091] Updated weights for policy 0, policy_version 99050 (0.0011) [2023-12-26 00:22:16,878][123091] Updated weights for policy 0, policy_version 99060 (0.0010) [2023-12-26 00:22:16,933][123091] Updated weights for policy 0, policy_version 99070 (0.0010) [2023-12-26 00:22:17,474][123090] Updated weights for policy 1, policy_version 98504 (0.0009) [2023-12-26 00:22:17,532][123090] Updated weights for policy 1, policy_version 98514 (0.0009) [2023-12-26 00:22:17,588][123090] Updated weights for policy 1, policy_version 98524 (0.0009) [2023-12-26 00:22:17,748][123091] Updated weights for policy 0, policy_version 99080 (0.0010) [2023-12-26 00:22:17,795][123091] Updated weights for policy 0, policy_version 99090 (0.0010) [2023-12-26 00:22:17,863][123091] Updated weights for policy 0, policy_version 99100 (0.0010) [2023-12-26 00:22:18,447][123090] Updated weights for policy 1, policy_version 98534 (0.0009) [2023-12-26 00:22:18,515][123090] Updated weights for policy 1, policy_version 98544 (0.0010) [2023-12-26 00:22:18,582][123090] Updated weights for policy 1, policy_version 98554 (0.0009) [2023-12-26 00:22:18,661][123091] Updated weights for policy 0, policy_version 99110 (0.0009) [2023-12-26 00:22:18,727][123091] Updated weights for policy 0, policy_version 99120 (0.0007) [2023-12-26 00:22:18,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 50601984. Throughput: 0: 9003.8, 1: 8908.2. Samples: 50614536. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:18,784][121949] Avg episode reward: [(0, '4974.213'), (1, '5312.959')] [2023-12-26 00:22:18,785][123091] Updated weights for policy 0, policy_version 99130 (0.0009) [2023-12-26 00:22:19,494][123090] Updated weights for policy 1, policy_version 98564 (0.0009) [2023-12-26 00:22:19,509][123091] Updated weights for policy 0, policy_version 99140 (0.0007) [2023-12-26 00:22:19,562][123090] Updated weights for policy 1, policy_version 98574 (0.0010) [2023-12-26 00:22:19,574][123091] Updated weights for policy 0, policy_version 99150 (0.0008) [2023-12-26 00:22:19,632][123090] Updated weights for policy 1, policy_version 98584 (0.0009) [2023-12-26 00:22:19,639][123091] Updated weights for policy 0, policy_version 99160 (0.0007) [2023-12-26 00:22:20,394][123091] Updated weights for policy 0, policy_version 99170 (0.0006) [2023-12-26 00:22:20,459][123091] Updated weights for policy 0, policy_version 99180 (0.0006) [2023-12-26 00:22:20,537][123091] Updated weights for policy 0, policy_version 99190 (0.0006) [2023-12-26 00:22:20,565][123090] Updated weights for policy 1, policy_version 98594 (0.0008) [2023-12-26 00:22:20,602][123091] Updated weights for policy 0, policy_version 99200 (0.0008) [2023-12-26 00:22:20,635][123090] Updated weights for policy 1, policy_version 98604 (0.0009) [2023-12-26 00:22:20,703][123090] Updated weights for policy 1, policy_version 98614 (0.0010) [2023-12-26 00:22:20,779][123090] Updated weights for policy 1, policy_version 98624 (0.0010) [2023-12-26 00:22:21,432][123091] Updated weights for policy 0, policy_version 99210 (0.0007) [2023-12-26 00:22:21,502][123091] Updated weights for policy 0, policy_version 99220 (0.0007) [2023-12-26 00:22:21,571][123091] Updated weights for policy 0, policy_version 99230 (0.0010) [2023-12-26 00:22:21,578][123090] Updated weights for policy 1, policy_version 98634 (0.0007) [2023-12-26 00:22:21,644][123090] Updated weights for policy 1, policy_version 98644 (0.0007) [2023-12-26 00:22:21,708][123090] Updated weights for policy 1, policy_version 98654 (0.0010) [2023-12-26 00:22:22,376][123091] Updated weights for policy 0, policy_version 99240 (0.0009) [2023-12-26 00:22:22,439][123091] Updated weights for policy 0, policy_version 99250 (0.0010) [2023-12-26 00:22:22,497][123091] Updated weights for policy 0, policy_version 99260 (0.0009) [2023-12-26 00:22:22,562][123090] Updated weights for policy 1, policy_version 98664 (0.0006) [2023-12-26 00:22:22,627][123090] Updated weights for policy 1, policy_version 98674 (0.0008) [2023-12-26 00:22:22,691][123090] Updated weights for policy 1, policy_version 98684 (0.0009) [2023-12-26 00:22:23,351][123091] Updated weights for policy 0, policy_version 99270 (0.0010) [2023-12-26 00:22:23,414][123091] Updated weights for policy 0, policy_version 99280 (0.0010) [2023-12-26 00:22:23,456][123090] Updated weights for policy 1, policy_version 98694 (0.0010) [2023-12-26 00:22:23,472][123091] Updated weights for policy 0, policy_version 99290 (0.0010) [2023-12-26 00:22:23,514][123090] Updated weights for policy 1, policy_version 98704 (0.0010) [2023-12-26 00:22:23,566][123090] Updated weights for policy 1, policy_version 98714 (0.0009) [2023-12-26 00:22:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 50692096. Throughput: 0: 8972.6, 1: 8837.0. Samples: 50665524. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:23,785][121949] Avg episode reward: [(0, '4985.261'), (1, '5419.521')] [2023-12-26 00:22:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000099296_25419776.pth... [2023-12-26 00:22:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000098720_25272320.pth... [2023-12-26 00:22:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000097664_25001984.pth [2023-12-26 00:22:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000098240_25149440.pth [2023-12-26 00:22:24,279][123091] Updated weights for policy 0, policy_version 99300 (0.0008) [2023-12-26 00:22:24,334][123091] Updated weights for policy 0, policy_version 99311 (0.0009) [2023-12-26 00:22:24,353][123090] Updated weights for policy 1, policy_version 98724 (0.0007) [2023-12-26 00:22:24,396][123091] Updated weights for policy 0, policy_version 99321 (0.0008) [2023-12-26 00:22:24,419][123090] Updated weights for policy 1, policy_version 98734 (0.0009) [2023-12-26 00:22:24,490][123090] Updated weights for policy 1, policy_version 98744 (0.0009) [2023-12-26 00:22:25,203][123090] Updated weights for policy 1, policy_version 98754 (0.0010) [2023-12-26 00:22:25,263][123090] Updated weights for policy 1, policy_version 98765 (0.0009) [2023-12-26 00:22:25,270][123091] Updated weights for policy 0, policy_version 99331 (0.0006) [2023-12-26 00:22:25,316][123090] Updated weights for policy 1, policy_version 98775 (0.0008) [2023-12-26 00:22:25,329][123091] Updated weights for policy 0, policy_version 99341 (0.0007) [2023-12-26 00:22:25,390][123091] Updated weights for policy 0, policy_version 99351 (0.0008) [2023-12-26 00:22:26,107][123090] Updated weights for policy 1, policy_version 98785 (0.0009) [2023-12-26 00:22:26,154][123090] Updated weights for policy 1, policy_version 98795 (0.0006) [2023-12-26 00:22:26,200][123090] Updated weights for policy 1, policy_version 98805 (0.0005) [2023-12-26 00:22:26,224][123091] Updated weights for policy 0, policy_version 99361 (0.0009) [2023-12-26 00:22:26,249][123090] Updated weights for policy 1, policy_version 98815 (0.0005) [2023-12-26 00:22:26,279][123091] Updated weights for policy 0, policy_version 99371 (0.0009) [2023-12-26 00:22:26,342][123091] Updated weights for policy 0, policy_version 99381 (0.0010) [2023-12-26 00:22:26,398][123091] Updated weights for policy 0, policy_version 99391 (0.0010) [2023-12-26 00:22:27,011][123090] Updated weights for policy 1, policy_version 98825 (0.0010) [2023-12-26 00:22:27,077][123090] Updated weights for policy 1, policy_version 98835 (0.0010) [2023-12-26 00:22:27,140][123090] Updated weights for policy 1, policy_version 98845 (0.0010) [2023-12-26 00:22:27,260][123091] Updated weights for policy 0, policy_version 99401 (0.0006) [2023-12-26 00:22:27,320][123091] Updated weights for policy 0, policy_version 99411 (0.0008) [2023-12-26 00:22:27,387][123091] Updated weights for policy 0, policy_version 99421 (0.0007) [2023-12-26 00:22:27,924][123091] Updated weights for policy 0, policy_version 99431 (0.0005) [2023-12-26 00:22:27,973][123090] Updated weights for policy 1, policy_version 98855 (0.0010) [2023-12-26 00:22:27,975][123091] Updated weights for policy 0, policy_version 99441 (0.0005) [2023-12-26 00:22:28,025][123090] Updated weights for policy 1, policy_version 98865 (0.0010) [2023-12-26 00:22:28,035][123091] Updated weights for policy 0, policy_version 99451 (0.0006) [2023-12-26 00:22:28,084][123090] Updated weights for policy 1, policy_version 98875 (0.0010) [2023-12-26 00:22:28,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 50774016. Throughput: 0: 8922.4, 1: 8907.0. Samples: 50770980. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:28,785][121949] Avg episode reward: [(0, '4975.553'), (1, '5416.239')] [2023-12-26 00:22:28,829][123091] Updated weights for policy 0, policy_version 99461 (0.0008) [2023-12-26 00:22:28,889][123091] Updated weights for policy 0, policy_version 99471 (0.0009) [2023-12-26 00:22:28,936][123090] Updated weights for policy 1, policy_version 98885 (0.0010) [2023-12-26 00:22:28,951][123091] Updated weights for policy 0, policy_version 99481 (0.0009) [2023-12-26 00:22:28,988][123090] Updated weights for policy 1, policy_version 98895 (0.0010) [2023-12-26 00:22:29,035][123090] Updated weights for policy 1, policy_version 98905 (0.0010) [2023-12-26 00:22:29,768][123091] Updated weights for policy 0, policy_version 99491 (0.0007) [2023-12-26 00:22:29,844][123091] Updated weights for policy 0, policy_version 99501 (0.0008) [2023-12-26 00:22:29,908][123091] Updated weights for policy 0, policy_version 99511 (0.0007) [2023-12-26 00:22:29,928][123090] Updated weights for policy 1, policy_version 98915 (0.0010) [2023-12-26 00:22:29,994][123090] Updated weights for policy 1, policy_version 98925 (0.0009) [2023-12-26 00:22:30,060][123090] Updated weights for policy 1, policy_version 98935 (0.0010) [2023-12-26 00:22:30,691][123091] Updated weights for policy 0, policy_version 99521 (0.0007) [2023-12-26 00:22:30,749][123091] Updated weights for policy 0, policy_version 99531 (0.0009) [2023-12-26 00:22:30,804][123091] Updated weights for policy 0, policy_version 99541 (0.0008) [2023-12-26 00:22:30,851][123090] Updated weights for policy 1, policy_version 98945 (0.0008) [2023-12-26 00:22:30,853][123091] Updated weights for policy 0, policy_version 99551 (0.0009) [2023-12-26 00:22:30,901][123090] Updated weights for policy 1, policy_version 98955 (0.0008) [2023-12-26 00:22:30,951][123090] Updated weights for policy 1, policy_version 98966 (0.0009) [2023-12-26 00:22:30,997][123090] Updated weights for policy 1, policy_version 98976 (0.0008) [2023-12-26 00:22:31,707][123091] Updated weights for policy 0, policy_version 99561 (0.0007) [2023-12-26 00:22:31,768][123091] Updated weights for policy 0, policy_version 99571 (0.0006) [2023-12-26 00:22:31,823][123091] Updated weights for policy 0, policy_version 99581 (0.0005) [2023-12-26 00:22:31,934][123090] Updated weights for policy 1, policy_version 98986 (0.0009) [2023-12-26 00:22:31,985][123090] Updated weights for policy 1, policy_version 98997 (0.0009) [2023-12-26 00:22:32,032][123090] Updated weights for policy 1, policy_version 99007 (0.0008) [2023-12-26 00:22:32,616][123091] Updated weights for policy 0, policy_version 99591 (0.0008) [2023-12-26 00:22:32,665][123091] Updated weights for policy 0, policy_version 99601 (0.0009) [2023-12-26 00:22:32,714][123091] Updated weights for policy 0, policy_version 99611 (0.0009) [2023-12-26 00:22:32,868][123090] Updated weights for policy 1, policy_version 99017 (0.0009) [2023-12-26 00:22:32,924][123090] Updated weights for policy 1, policy_version 99027 (0.0009) [2023-12-26 00:22:32,995][123090] Updated weights for policy 1, policy_version 99037 (0.0009) [2023-12-26 00:22:33,572][123091] Updated weights for policy 0, policy_version 99621 (0.0009) [2023-12-26 00:22:33,631][123091] Updated weights for policy 0, policy_version 99631 (0.0009) [2023-12-26 00:22:33,682][123091] Updated weights for policy 0, policy_version 99641 (0.0009) [2023-12-26 00:22:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 50864128. Throughput: 0: 8875.4, 1: 8849.3. Samples: 50875168. Policy #0 lag: (min: 31.0, avg: 32.0, max: 52.0) [2023-12-26 00:22:33,785][121949] Avg episode reward: [(0, '4941.666'), (1, '5446.699')] [2023-12-26 00:22:33,800][123090] Updated weights for policy 1, policy_version 99047 (0.0010) [2023-12-26 00:22:33,870][123090] Updated weights for policy 1, policy_version 99057 (0.0009) [2023-12-26 00:22:33,939][123090] Updated weights for policy 1, policy_version 99067 (0.0009) [2023-12-26 00:22:34,534][123091] Updated weights for policy 0, policy_version 99651 (0.0009) [2023-12-26 00:22:34,596][123091] Updated weights for policy 0, policy_version 99661 (0.0007) [2023-12-26 00:22:34,646][123091] Updated weights for policy 0, policy_version 99671 (0.0008) [2023-12-26 00:22:34,776][123090] Updated weights for policy 1, policy_version 99077 (0.0009) [2023-12-26 00:22:34,839][123090] Updated weights for policy 1, policy_version 99087 (0.0008) [2023-12-26 00:22:34,903][123090] Updated weights for policy 1, policy_version 99097 (0.0010) [2023-12-26 00:22:35,374][123091] Updated weights for policy 0, policy_version 99681 (0.0009) [2023-12-26 00:22:35,440][123091] Updated weights for policy 0, policy_version 99691 (0.0009) [2023-12-26 00:22:35,487][123091] Updated weights for policy 0, policy_version 99701 (0.0009) [2023-12-26 00:22:35,539][123091] Updated weights for policy 0, policy_version 99711 (0.0010) [2023-12-26 00:22:35,756][123090] Updated weights for policy 1, policy_version 99107 (0.0010) [2023-12-26 00:22:35,817][123090] Updated weights for policy 1, policy_version 99117 (0.0010) [2023-12-26 00:22:35,883][123090] Updated weights for policy 1, policy_version 99127 (0.0008) [2023-12-26 00:22:36,328][123091] Updated weights for policy 0, policy_version 99721 (0.0009) [2023-12-26 00:22:36,379][123091] Updated weights for policy 0, policy_version 99731 (0.0010) [2023-12-26 00:22:36,442][123091] Updated weights for policy 0, policy_version 99741 (0.0010) [2023-12-26 00:22:36,755][123090] Updated weights for policy 1, policy_version 99137 (0.0010) [2023-12-26 00:22:36,825][123090] Updated weights for policy 1, policy_version 99147 (0.0009) [2023-12-26 00:22:36,897][123090] Updated weights for policy 1, policy_version 99157 (0.0009) [2023-12-26 00:22:36,962][123090] Updated weights for policy 1, policy_version 99167 (0.0010) [2023-12-26 00:22:37,278][123091] Updated weights for policy 0, policy_version 99751 (0.0009) [2023-12-26 00:22:37,331][123091] Updated weights for policy 0, policy_version 99761 (0.0010) [2023-12-26 00:22:37,378][123091] Updated weights for policy 0, policy_version 99771 (0.0009) [2023-12-26 00:22:37,760][123090] Updated weights for policy 1, policy_version 99177 (0.0010) [2023-12-26 00:22:37,812][123090] Updated weights for policy 1, policy_version 99187 (0.0010) [2023-12-26 00:22:37,873][123090] Updated weights for policy 1, policy_version 99197 (0.0010) [2023-12-26 00:22:38,265][123091] Updated weights for policy 0, policy_version 99781 (0.0010) [2023-12-26 00:22:38,330][123091] Updated weights for policy 0, policy_version 99791 (0.0009) [2023-12-26 00:22:38,389][123091] Updated weights for policy 0, policy_version 99801 (0.0009) [2023-12-26 00:22:38,783][123090] Updated weights for policy 1, policy_version 99207 (0.0009) [2023-12-26 00:22:38,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 50946048. Throughput: 0: 8918.1, 1: 8851.5. Samples: 50927548. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:22:38,785][121949] Avg episode reward: [(0, '4933.803'), (1, '5505.369')] [2023-12-26 00:22:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000099808_25550848.pth... [2023-12-26 00:22:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000098784_25288704.pth [2023-12-26 00:22:38,839][123090] Updated weights for policy 1, policy_version 99217 (0.0009) [2023-12-26 00:22:38,895][123090] Updated weights for policy 1, policy_version 99227 (0.0009) [2023-12-26 00:22:38,922][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000099232_25403392.pth... [2023-12-26 00:22:38,925][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000098208_25141248.pth [2023-12-26 00:22:39,103][123091] Updated weights for policy 0, policy_version 99811 (0.0009) [2023-12-26 00:22:39,150][123091] Updated weights for policy 0, policy_version 99821 (0.0009) [2023-12-26 00:22:39,202][123091] Updated weights for policy 0, policy_version 99831 (0.0009) [2023-12-26 00:22:39,757][123090] Updated weights for policy 1, policy_version 99237 (0.0010) [2023-12-26 00:22:39,828][123090] Updated weights for policy 1, policy_version 99247 (0.0009) [2023-12-26 00:22:39,897][123090] Updated weights for policy 1, policy_version 99257 (0.0006) [2023-12-26 00:22:40,076][123091] Updated weights for policy 0, policy_version 99841 (0.0010) [2023-12-26 00:22:40,145][123091] Updated weights for policy 0, policy_version 99851 (0.0010) [2023-12-26 00:22:40,212][123091] Updated weights for policy 0, policy_version 99861 (0.0009) [2023-12-26 00:22:40,285][123091] Updated weights for policy 0, policy_version 99871 (0.0010) [2023-12-26 00:22:40,662][123090] Updated weights for policy 1, policy_version 99267 (0.0008) [2023-12-26 00:22:40,717][123090] Updated weights for policy 1, policy_version 99277 (0.0009) [2023-12-26 00:22:40,772][123090] Updated weights for policy 1, policy_version 99287 (0.0009) [2023-12-26 00:22:41,089][123091] Updated weights for policy 0, policy_version 99881 (0.0009) [2023-12-26 00:22:41,153][123091] Updated weights for policy 0, policy_version 99891 (0.0010) [2023-12-26 00:22:41,219][123091] Updated weights for policy 0, policy_version 99901 (0.0010) [2023-12-26 00:22:41,636][123090] Updated weights for policy 1, policy_version 99297 (0.0009) [2023-12-26 00:22:41,700][123090] Updated weights for policy 1, policy_version 99307 (0.0010) [2023-12-26 00:22:41,760][123090] Updated weights for policy 1, policy_version 99317 (0.0010) [2023-12-26 00:22:41,811][123090] Updated weights for policy 1, policy_version 99327 (0.0009) [2023-12-26 00:22:42,046][123091] Updated weights for policy 0, policy_version 99911 (0.0009) [2023-12-26 00:22:42,108][123091] Updated weights for policy 0, policy_version 99921 (0.0009) [2023-12-26 00:22:42,172][123091] Updated weights for policy 0, policy_version 99931 (0.0009) [2023-12-26 00:22:42,666][123090] Updated weights for policy 1, policy_version 99337 (0.0010) [2023-12-26 00:22:42,715][123090] Updated weights for policy 1, policy_version 99347 (0.0009) [2023-12-26 00:22:42,772][123090] Updated weights for policy 1, policy_version 99357 (0.0009) [2023-12-26 00:22:43,000][123091] Updated weights for policy 0, policy_version 99941 (0.0009) [2023-12-26 00:22:43,055][123091] Updated weights for policy 0, policy_version 99951 (0.0010) [2023-12-26 00:22:43,113][123091] Updated weights for policy 0, policy_version 99961 (0.0009) [2023-12-26 00:22:43,564][123090] Updated weights for policy 1, policy_version 99367 (0.0006) [2023-12-26 00:22:43,621][123090] Updated weights for policy 1, policy_version 99377 (0.0007) [2023-12-26 00:22:43,675][123090] Updated weights for policy 1, policy_version 99387 (0.0010) [2023-12-26 00:22:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 51036160. Throughput: 0: 8760.5, 1: 8728.8. Samples: 51028772. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:22:43,785][121949] Avg episode reward: [(0, '4874.836'), (1, '5488.193')] [2023-12-26 00:22:43,974][123091] Updated weights for policy 0, policy_version 99971 (0.0009) [2023-12-26 00:22:44,032][123091] Updated weights for policy 0, policy_version 99981 (0.0010) [2023-12-26 00:22:44,080][123091] Updated weights for policy 0, policy_version 99991 (0.0009) [2023-12-26 00:22:44,464][123090] Updated weights for policy 1, policy_version 99397 (0.0009) [2023-12-26 00:22:44,517][123090] Updated weights for policy 1, policy_version 99407 (0.0009) [2023-12-26 00:22:44,570][123090] Updated weights for policy 1, policy_version 99417 (0.0009) [2023-12-26 00:22:44,944][123091] Updated weights for policy 0, policy_version 100001 (0.0010) [2023-12-26 00:22:45,006][123091] Updated weights for policy 0, policy_version 100011 (0.0009) [2023-12-26 00:22:45,064][123091] Updated weights for policy 0, policy_version 100021 (0.0010) [2023-12-26 00:22:45,122][123091] Updated weights for policy 0, policy_version 100031 (0.0009) [2023-12-26 00:22:45,444][123090] Updated weights for policy 1, policy_version 99427 (0.0009) [2023-12-26 00:22:45,497][123090] Updated weights for policy 1, policy_version 99437 (0.0009) [2023-12-26 00:22:45,550][123090] Updated weights for policy 1, policy_version 99447 (0.0008) [2023-12-26 00:22:45,981][123091] Updated weights for policy 0, policy_version 100041 (0.0010) [2023-12-26 00:22:46,027][123091] Updated weights for policy 0, policy_version 100051 (0.0009) [2023-12-26 00:22:46,089][123091] Updated weights for policy 0, policy_version 100061 (0.0010) [2023-12-26 00:22:46,395][123090] Updated weights for policy 1, policy_version 99457 (0.0009) [2023-12-26 00:22:46,457][123090] Updated weights for policy 1, policy_version 99467 (0.0009) [2023-12-26 00:22:46,508][123090] Updated weights for policy 1, policy_version 99477 (0.0009) [2023-12-26 00:22:46,573][123090] Updated weights for policy 1, policy_version 99487 (0.0009) [2023-12-26 00:22:46,887][123091] Updated weights for policy 0, policy_version 100071 (0.0009) [2023-12-26 00:22:46,936][123091] Updated weights for policy 0, policy_version 100081 (0.0009) [2023-12-26 00:22:46,992][123091] Updated weights for policy 0, policy_version 100091 (0.0009) [2023-12-26 00:22:47,403][123090] Updated weights for policy 1, policy_version 99497 (0.0010) [2023-12-26 00:22:47,465][123090] Updated weights for policy 1, policy_version 99507 (0.0009) [2023-12-26 00:22:47,526][123090] Updated weights for policy 1, policy_version 99517 (0.0009) [2023-12-26 00:22:47,851][123091] Updated weights for policy 0, policy_version 100101 (0.0010) [2023-12-26 00:22:47,922][123091] Updated weights for policy 0, policy_version 100111 (0.0008) [2023-12-26 00:22:47,984][123091] Updated weights for policy 0, policy_version 100121 (0.0009) [2023-12-26 00:22:48,307][123090] Updated weights for policy 1, policy_version 99527 (0.0007) [2023-12-26 00:22:48,372][123090] Updated weights for policy 1, policy_version 99537 (0.0010) [2023-12-26 00:22:48,434][123090] Updated weights for policy 1, policy_version 99547 (0.0010) [2023-12-26 00:22:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 51118080. Throughput: 0: 8685.7, 1: 8610.6. Samples: 51130720. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:22:48,785][121949] Avg episode reward: [(0, '4920.556'), (1, '5478.263')] [2023-12-26 00:22:48,843][123091] Updated weights for policy 0, policy_version 100131 (0.0008) [2023-12-26 00:22:48,918][123091] Updated weights for policy 0, policy_version 100141 (0.0005) [2023-12-26 00:22:48,991][123091] Updated weights for policy 0, policy_version 100151 (0.0006) [2023-12-26 00:22:49,257][123090] Updated weights for policy 1, policy_version 99557 (0.0009) [2023-12-26 00:22:49,334][123090] Updated weights for policy 1, policy_version 99567 (0.0008) [2023-12-26 00:22:49,405][123090] Updated weights for policy 1, policy_version 99577 (0.0010) [2023-12-26 00:22:49,658][123091] Updated weights for policy 0, policy_version 100161 (0.0006) [2023-12-26 00:22:49,729][123091] Updated weights for policy 0, policy_version 100171 (0.0010) [2023-12-26 00:22:49,795][123091] Updated weights for policy 0, policy_version 100181 (0.0010) [2023-12-26 00:22:49,867][123091] Updated weights for policy 0, policy_version 100191 (0.0010) [2023-12-26 00:22:50,144][123090] Updated weights for policy 1, policy_version 99587 (0.0009) [2023-12-26 00:22:50,213][123090] Updated weights for policy 1, policy_version 99597 (0.0008) [2023-12-26 00:22:50,284][123090] Updated weights for policy 1, policy_version 99607 (0.0007) [2023-12-26 00:22:50,825][123091] Updated weights for policy 0, policy_version 100201 (0.0010) [2023-12-26 00:22:50,889][123091] Updated weights for policy 0, policy_version 100211 (0.0010) [2023-12-26 00:22:50,941][123090] Updated weights for policy 1, policy_version 99617 (0.0005) [2023-12-26 00:22:50,966][123091] Updated weights for policy 0, policy_version 100221 (0.0009) [2023-12-26 00:22:51,011][123090] Updated weights for policy 1, policy_version 99627 (0.0006) [2023-12-26 00:22:51,081][123090] Updated weights for policy 1, policy_version 99637 (0.0008) [2023-12-26 00:22:51,144][123090] Updated weights for policy 1, policy_version 99647 (0.0007) [2023-12-26 00:22:51,843][123091] Updated weights for policy 0, policy_version 100231 (0.0010) [2023-12-26 00:22:51,891][123090] Updated weights for policy 1, policy_version 99657 (0.0007) [2023-12-26 00:22:51,903][123091] Updated weights for policy 0, policy_version 100241 (0.0010) [2023-12-26 00:22:51,943][123090] Updated weights for policy 1, policy_version 99667 (0.0007) [2023-12-26 00:22:51,964][123091] Updated weights for policy 0, policy_version 100251 (0.0009) [2023-12-26 00:22:52,000][123090] Updated weights for policy 1, policy_version 99677 (0.0008) [2023-12-26 00:22:52,699][123090] Updated weights for policy 1, policy_version 99687 (0.0006) [2023-12-26 00:22:52,762][123090] Updated weights for policy 1, policy_version 99697 (0.0005) [2023-12-26 00:22:52,821][123090] Updated weights for policy 1, policy_version 99707 (0.0005) [2023-12-26 00:22:52,859][123091] Updated weights for policy 0, policy_version 100261 (0.0010) [2023-12-26 00:22:52,914][123091] Updated weights for policy 0, policy_version 100271 (0.0010) [2023-12-26 00:22:52,958][123091] Updated weights for policy 0, policy_version 100281 (0.0010) [2023-12-26 00:22:53,483][123090] Updated weights for policy 1, policy_version 99717 (0.0005) [2023-12-26 00:22:53,543][123090] Updated weights for policy 1, policy_version 99727 (0.0008) [2023-12-26 00:22:53,603][123090] Updated weights for policy 1, policy_version 99737 (0.0007) [2023-12-26 00:22:53,758][123091] Updated weights for policy 0, policy_version 100291 (0.0010) [2023-12-26 00:22:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 51208192. Throughput: 0: 8645.5, 1: 8586.8. Samples: 51183336. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:22:53,785][121949] Avg episode reward: [(0, '4936.414'), (1, '5427.911')] [2023-12-26 00:22:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000099744_25534464.pth... [2023-12-26 00:22:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000098720_25272320.pth [2023-12-26 00:22:53,814][123091] Updated weights for policy 0, policy_version 100301 (0.0007) [2023-12-26 00:22:53,867][123091] Updated weights for policy 0, policy_version 100311 (0.0005) [2023-12-26 00:22:53,907][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000100320_25681920.pth... [2023-12-26 00:22:53,910][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000099296_25419776.pth [2023-12-26 00:22:54,372][123090] Updated weights for policy 1, policy_version 99747 (0.0007) [2023-12-26 00:22:54,428][123090] Updated weights for policy 1, policy_version 99757 (0.0010) [2023-12-26 00:22:54,485][123090] Updated weights for policy 1, policy_version 99768 (0.0010) [2023-12-26 00:22:54,541][123091] Updated weights for policy 0, policy_version 100321 (0.0005) [2023-12-26 00:22:54,606][123091] Updated weights for policy 0, policy_version 100331 (0.0005) [2023-12-26 00:22:54,674][123091] Updated weights for policy 0, policy_version 100341 (0.0005) [2023-12-26 00:22:54,741][123091] Updated weights for policy 0, policy_version 100351 (0.0005) [2023-12-26 00:22:55,337][123090] Updated weights for policy 1, policy_version 99778 (0.0011) [2023-12-26 00:22:55,386][123090] Updated weights for policy 1, policy_version 99788 (0.0007) [2023-12-26 00:22:55,400][123091] Updated weights for policy 0, policy_version 100361 (0.0010) [2023-12-26 00:22:55,436][123090] Updated weights for policy 1, policy_version 99798 (0.0006) [2023-12-26 00:22:55,459][123091] Updated weights for policy 0, policy_version 100371 (0.0010) [2023-12-26 00:22:55,495][123090] Updated weights for policy 1, policy_version 99808 (0.0006) [2023-12-26 00:22:55,520][123091] Updated weights for policy 0, policy_version 100381 (0.0010) [2023-12-26 00:22:56,222][123091] Updated weights for policy 0, policy_version 100391 (0.0010) [2023-12-26 00:22:56,225][123090] Updated weights for policy 1, policy_version 99818 (0.0007) [2023-12-26 00:22:56,276][123090] Updated weights for policy 1, policy_version 99828 (0.0006) [2023-12-26 00:22:56,277][123091] Updated weights for policy 0, policy_version 100401 (0.0010) [2023-12-26 00:22:56,325][123091] Updated weights for policy 0, policy_version 100411 (0.0010) [2023-12-26 00:22:56,331][123090] Updated weights for policy 1, policy_version 99838 (0.0005) [2023-12-26 00:22:57,044][123090] Updated weights for policy 1, policy_version 99848 (0.0005) [2023-12-26 00:22:57,092][123090] Updated weights for policy 1, policy_version 99858 (0.0005) [2023-12-26 00:22:57,148][123090] Updated weights for policy 1, policy_version 99868 (0.0006) [2023-12-26 00:22:57,157][123091] Updated weights for policy 0, policy_version 100421 (0.0010) [2023-12-26 00:22:57,215][123091] Updated weights for policy 0, policy_version 100431 (0.0010) [2023-12-26 00:22:57,262][123091] Updated weights for policy 0, policy_version 100441 (0.0010) [2023-12-26 00:22:57,933][123090] Updated weights for policy 1, policy_version 99878 (0.0005) [2023-12-26 00:22:58,001][123090] Updated weights for policy 1, policy_version 99888 (0.0007) [2023-12-26 00:22:58,029][123091] Updated weights for policy 0, policy_version 100451 (0.0010) [2023-12-26 00:22:58,064][123090] Updated weights for policy 1, policy_version 99898 (0.0010) [2023-12-26 00:22:58,080][123091] Updated weights for policy 0, policy_version 100461 (0.0010) [2023-12-26 00:22:58,135][123091] Updated weights for policy 0, policy_version 100471 (0.0010) [2023-12-26 00:22:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 51298304. Throughput: 0: 8720.9, 1: 8657.0. Samples: 51294304. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:22:58,785][121949] Avg episode reward: [(0, '4843.175'), (1, '5528.975')] [2023-12-26 00:22:59,059][123090] Updated weights for policy 1, policy_version 99908 (0.0010) [2023-12-26 00:22:59,125][123090] Updated weights for policy 1, policy_version 99918 (0.0008) [2023-12-26 00:22:59,133][123091] Updated weights for policy 0, policy_version 100481 (0.0010) [2023-12-26 00:22:59,192][123090] Updated weights for policy 1, policy_version 99928 (0.0008) [2023-12-26 00:22:59,200][123091] Updated weights for policy 0, policy_version 100491 (0.0011) [2023-12-26 00:22:59,276][123091] Updated weights for policy 0, policy_version 100501 (0.0011) [2023-12-26 00:22:59,344][123091] Updated weights for policy 0, policy_version 100511 (0.0010) [2023-12-26 00:23:00,031][123090] Updated weights for policy 1, policy_version 99938 (0.0008) [2023-12-26 00:23:00,084][123090] Updated weights for policy 1, policy_version 99948 (0.0009) [2023-12-26 00:23:00,132][123090] Updated weights for policy 1, policy_version 99958 (0.0009) [2023-12-26 00:23:00,183][123091] Updated weights for policy 0, policy_version 100521 (0.0008) [2023-12-26 00:23:00,193][123090] Updated weights for policy 1, policy_version 99968 (0.0009) [2023-12-26 00:23:00,237][123091] Updated weights for policy 0, policy_version 100531 (0.0010) [2023-12-26 00:23:00,293][123091] Updated weights for policy 0, policy_version 100541 (0.0009) [2023-12-26 00:23:01,063][123090] Updated weights for policy 1, policy_version 99978 (0.0006) [2023-12-26 00:23:01,130][123090] Updated weights for policy 1, policy_version 99988 (0.0008) [2023-12-26 00:23:01,135][123091] Updated weights for policy 0, policy_version 100551 (0.0009) [2023-12-26 00:23:01,188][123091] Updated weights for policy 0, policy_version 100561 (0.0006) [2023-12-26 00:23:01,197][123090] Updated weights for policy 1, policy_version 99998 (0.0009) [2023-12-26 00:23:01,244][123091] Updated weights for policy 0, policy_version 100571 (0.0009) [2023-12-26 00:23:02,016][123090] Updated weights for policy 1, policy_version 100008 (0.0008) [2023-12-26 00:23:02,030][123091] Updated weights for policy 0, policy_version 100581 (0.0009) [2023-12-26 00:23:02,060][123090] Updated weights for policy 1, policy_version 100018 (0.0007) [2023-12-26 00:23:02,081][123091] Updated weights for policy 0, policy_version 100591 (0.0008) [2023-12-26 00:23:02,123][123090] Updated weights for policy 1, policy_version 100028 (0.0007) [2023-12-26 00:23:02,130][123091] Updated weights for policy 0, policy_version 100601 (0.0008) [2023-12-26 00:23:02,957][123090] Updated weights for policy 1, policy_version 100038 (0.0007) [2023-12-26 00:23:03,010][123091] Updated weights for policy 0, policy_version 100611 (0.0010) [2023-12-26 00:23:03,019][123090] Updated weights for policy 1, policy_version 100048 (0.0008) [2023-12-26 00:23:03,056][123091] Updated weights for policy 0, policy_version 100621 (0.0009) [2023-12-26 00:23:03,086][123090] Updated weights for policy 1, policy_version 100058 (0.0008) [2023-12-26 00:23:03,103][123091] Updated weights for policy 0, policy_version 100631 (0.0008) [2023-12-26 00:23:03,741][123090] Updated weights for policy 1, policy_version 100068 (0.0006) [2023-12-26 00:23:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 51380224. Throughput: 0: 8676.3, 1: 8679.3. Samples: 51395540. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:03,785][121949] Avg episode reward: [(0, '4830.390'), (1, '5511.538')] [2023-12-26 00:23:03,809][123090] Updated weights for policy 1, policy_version 100078 (0.0008) [2023-12-26 00:23:03,869][123090] Updated weights for policy 1, policy_version 100089 (0.0009) [2023-12-26 00:23:04,009][123091] Updated weights for policy 0, policy_version 100642 (0.0009) [2023-12-26 00:23:04,073][123091] Updated weights for policy 0, policy_version 100652 (0.0008) [2023-12-26 00:23:04,139][123091] Updated weights for policy 0, policy_version 100662 (0.0007) [2023-12-26 00:23:04,206][123091] Updated weights for policy 0, policy_version 100672 (0.0009) [2023-12-26 00:23:04,688][123090] Updated weights for policy 1, policy_version 100099 (0.0008) [2023-12-26 00:23:04,751][123090] Updated weights for policy 1, policy_version 100109 (0.0006) [2023-12-26 00:23:04,808][123090] Updated weights for policy 1, policy_version 100119 (0.0005) [2023-12-26 00:23:04,838][123091] Updated weights for policy 0, policy_version 100682 (0.0009) [2023-12-26 00:23:04,889][123091] Updated weights for policy 0, policy_version 100692 (0.0009) [2023-12-26 00:23:04,938][123091] Updated weights for policy 0, policy_version 100703 (0.0007) [2023-12-26 00:23:05,421][123090] Updated weights for policy 1, policy_version 100129 (0.0005) [2023-12-26 00:23:05,480][123090] Updated weights for policy 1, policy_version 100139 (0.0005) [2023-12-26 00:23:05,535][123090] Updated weights for policy 1, policy_version 100149 (0.0005) [2023-12-26 00:23:05,587][123090] Updated weights for policy 1, policy_version 100159 (0.0005) [2023-12-26 00:23:05,642][123091] Updated weights for policy 0, policy_version 100713 (0.0005) [2023-12-26 00:23:05,695][123091] Updated weights for policy 0, policy_version 100723 (0.0005) [2023-12-26 00:23:05,754][123091] Updated weights for policy 0, policy_version 100733 (0.0005) [2023-12-26 00:23:06,318][123090] Updated weights for policy 1, policy_version 100169 (0.0009) [2023-12-26 00:23:06,388][123090] Updated weights for policy 1, policy_version 100179 (0.0010) [2023-12-26 00:23:06,458][123090] Updated weights for policy 1, policy_version 100189 (0.0011) [2023-12-26 00:23:06,484][123091] Updated weights for policy 0, policy_version 100743 (0.0006) [2023-12-26 00:23:06,547][123091] Updated weights for policy 0, policy_version 100753 (0.0011) [2023-12-26 00:23:06,603][123091] Updated weights for policy 0, policy_version 100763 (0.0010) [2023-12-26 00:23:07,247][123090] Updated weights for policy 1, policy_version 100199 (0.0010) [2023-12-26 00:23:07,294][123090] Updated weights for policy 1, policy_version 100209 (0.0010) [2023-12-26 00:23:07,342][123090] Updated weights for policy 1, policy_version 100219 (0.0010) [2023-12-26 00:23:07,412][123091] Updated weights for policy 0, policy_version 100773 (0.0010) [2023-12-26 00:23:07,475][123091] Updated weights for policy 0, policy_version 100783 (0.0010) [2023-12-26 00:23:07,533][123091] Updated weights for policy 0, policy_version 100793 (0.0010) [2023-12-26 00:23:08,123][123090] Updated weights for policy 1, policy_version 100229 (0.0010) [2023-12-26 00:23:08,170][123090] Updated weights for policy 1, policy_version 100239 (0.0010) [2023-12-26 00:23:08,233][123090] Updated weights for policy 1, policy_version 100249 (0.0010) [2023-12-26 00:23:08,301][123091] Updated weights for policy 0, policy_version 100803 (0.0010) [2023-12-26 00:23:08,365][123091] Updated weights for policy 0, policy_version 100813 (0.0009) [2023-12-26 00:23:08,415][123091] Updated weights for policy 0, policy_version 100823 (0.0005) [2023-12-26 00:23:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 51478528. Throughput: 0: 8714.1, 1: 8777.0. Samples: 51452628. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:08,785][121949] Avg episode reward: [(0, '4909.778'), (1, '5510.869')] [2023-12-26 00:23:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000100832_25812992.pth... [2023-12-26 00:23:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000100256_25665536.pth... [2023-12-26 00:23:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000099808_25550848.pth [2023-12-26 00:23:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000099232_25403392.pth [2023-12-26 00:23:09,050][123090] Updated weights for policy 1, policy_version 100259 (0.0010) [2023-12-26 00:23:09,101][123090] Updated weights for policy 1, policy_version 100269 (0.0010) [2023-12-26 00:23:09,153][123090] Updated weights for policy 1, policy_version 100279 (0.0009) [2023-12-26 00:23:09,241][123091] Updated weights for policy 0, policy_version 100833 (0.0010) [2023-12-26 00:23:09,312][123091] Updated weights for policy 0, policy_version 100843 (0.0011) [2023-12-26 00:23:09,382][123091] Updated weights for policy 0, policy_version 100853 (0.0008) [2023-12-26 00:23:09,445][123091] Updated weights for policy 0, policy_version 100863 (0.0010) [2023-12-26 00:23:10,021][123090] Updated weights for policy 1, policy_version 100289 (0.0009) [2023-12-26 00:23:10,093][123090] Updated weights for policy 1, policy_version 100299 (0.0010) [2023-12-26 00:23:10,157][123090] Updated weights for policy 1, policy_version 100309 (0.0009) [2023-12-26 00:23:10,221][123090] Updated weights for policy 1, policy_version 100319 (0.0010) [2023-12-26 00:23:10,313][123091] Updated weights for policy 0, policy_version 100873 (0.0009) [2023-12-26 00:23:10,370][123091] Updated weights for policy 0, policy_version 100883 (0.0009) [2023-12-26 00:23:10,420][123091] Updated weights for policy 0, policy_version 100893 (0.0009) [2023-12-26 00:23:11,065][123090] Updated weights for policy 1, policy_version 100329 (0.0009) [2023-12-26 00:23:11,140][123090] Updated weights for policy 1, policy_version 100339 (0.0008) [2023-12-26 00:23:11,197][123090] Updated weights for policy 1, policy_version 100349 (0.0007) [2023-12-26 00:23:11,264][123091] Updated weights for policy 0, policy_version 100903 (0.0008) [2023-12-26 00:23:11,323][123091] Updated weights for policy 0, policy_version 100913 (0.0009) [2023-12-26 00:23:11,388][123091] Updated weights for policy 0, policy_version 100923 (0.0009) [2023-12-26 00:23:12,041][123090] Updated weights for policy 1, policy_version 100359 (0.0009) [2023-12-26 00:23:12,111][123090] Updated weights for policy 1, policy_version 100369 (0.0009) [2023-12-26 00:23:12,177][123090] Updated weights for policy 1, policy_version 100379 (0.0008) [2023-12-26 00:23:12,252][123091] Updated weights for policy 0, policy_version 100933 (0.0010) [2023-12-26 00:23:12,320][123091] Updated weights for policy 0, policy_version 100943 (0.0007) [2023-12-26 00:23:12,390][123091] Updated weights for policy 0, policy_version 100953 (0.0009) [2023-12-26 00:23:13,021][123090] Updated weights for policy 1, policy_version 100389 (0.0010) [2023-12-26 00:23:13,074][123090] Updated weights for policy 1, policy_version 100399 (0.0010) [2023-12-26 00:23:13,127][123090] Updated weights for policy 1, policy_version 100409 (0.0010) [2023-12-26 00:23:13,190][123091] Updated weights for policy 0, policy_version 100963 (0.0010) [2023-12-26 00:23:13,254][123091] Updated weights for policy 0, policy_version 100973 (0.0009) [2023-12-26 00:23:13,302][123091] Updated weights for policy 0, policy_version 100983 (0.0009) [2023-12-26 00:23:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 51560448. Throughput: 0: 8697.2, 1: 8721.9. Samples: 51554836. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:13,785][121949] Avg episode reward: [(0, '4843.812'), (1, '5464.258')] [2023-12-26 00:23:13,965][123090] Updated weights for policy 1, policy_version 100419 (0.0009) [2023-12-26 00:23:14,016][123090] Updated weights for policy 1, policy_version 100429 (0.0006) [2023-12-26 00:23:14,063][123090] Updated weights for policy 1, policy_version 100439 (0.0006) [2023-12-26 00:23:14,079][123091] Updated weights for policy 0, policy_version 100993 (0.0008) [2023-12-26 00:23:14,133][123091] Updated weights for policy 0, policy_version 101003 (0.0006) [2023-12-26 00:23:14,189][123091] Updated weights for policy 0, policy_version 101013 (0.0006) [2023-12-26 00:23:14,243][123091] Updated weights for policy 0, policy_version 101023 (0.0006) [2023-12-26 00:23:14,821][123090] Updated weights for policy 1, policy_version 100449 (0.0010) [2023-12-26 00:23:14,886][123090] Updated weights for policy 1, policy_version 100459 (0.0009) [2023-12-26 00:23:14,947][123090] Updated weights for policy 1, policy_version 100469 (0.0011) [2023-12-26 00:23:15,016][123090] Updated weights for policy 1, policy_version 100479 (0.0011) [2023-12-26 00:23:15,033][123091] Updated weights for policy 0, policy_version 101033 (0.0007) [2023-12-26 00:23:15,098][123091] Updated weights for policy 0, policy_version 101043 (0.0009) [2023-12-26 00:23:15,162][123091] Updated weights for policy 0, policy_version 101053 (0.0010) [2023-12-26 00:23:15,779][123090] Updated weights for policy 1, policy_version 100489 (0.0010) [2023-12-26 00:23:15,848][123090] Updated weights for policy 1, policy_version 100499 (0.0009) [2023-12-26 00:23:15,919][123090] Updated weights for policy 1, policy_version 100509 (0.0009) [2023-12-26 00:23:16,044][123091] Updated weights for policy 0, policy_version 101063 (0.0010) [2023-12-26 00:23:16,093][123091] Updated weights for policy 0, policy_version 101073 (0.0010) [2023-12-26 00:23:16,154][123091] Updated weights for policy 0, policy_version 101083 (0.0009) [2023-12-26 00:23:16,651][123090] Updated weights for policy 1, policy_version 100519 (0.0007) [2023-12-26 00:23:16,719][123090] Updated weights for policy 1, policy_version 100529 (0.0005) [2023-12-26 00:23:16,780][123090] Updated weights for policy 1, policy_version 100539 (0.0005) [2023-12-26 00:23:17,027][123091] Updated weights for policy 0, policy_version 101093 (0.0008) [2023-12-26 00:23:17,081][123091] Updated weights for policy 0, policy_version 101103 (0.0005) [2023-12-26 00:23:17,130][123091] Updated weights for policy 0, policy_version 101113 (0.0005) [2023-12-26 00:23:17,510][123090] Updated weights for policy 1, policy_version 100549 (0.0009) [2023-12-26 00:23:17,571][123090] Updated weights for policy 1, policy_version 100559 (0.0010) [2023-12-26 00:23:17,626][123090] Updated weights for policy 1, policy_version 100569 (0.0010) [2023-12-26 00:23:17,857][123091] Updated weights for policy 0, policy_version 101123 (0.0005) [2023-12-26 00:23:17,919][123091] Updated weights for policy 0, policy_version 101133 (0.0005) [2023-12-26 00:23:17,982][123091] Updated weights for policy 0, policy_version 101143 (0.0007) [2023-12-26 00:23:18,465][123090] Updated weights for policy 1, policy_version 100579 (0.0010) [2023-12-26 00:23:18,536][123090] Updated weights for policy 1, policy_version 100589 (0.0011) [2023-12-26 00:23:18,593][123090] Updated weights for policy 1, policy_version 100599 (0.0006) [2023-12-26 00:23:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 51650560. Throughput: 0: 8685.3, 1: 8786.7. Samples: 51661412. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:18,785][121949] Avg episode reward: [(0, '4784.691'), (1, '5383.700')] [2023-12-26 00:23:18,792][123091] Updated weights for policy 0, policy_version 101153 (0.0009) [2023-12-26 00:23:18,870][123091] Updated weights for policy 0, policy_version 101163 (0.0006) [2023-12-26 00:23:18,942][123091] Updated weights for policy 0, policy_version 101173 (0.0007) [2023-12-26 00:23:19,012][123091] Updated weights for policy 0, policy_version 101183 (0.0006) [2023-12-26 00:23:19,396][123090] Updated weights for policy 1, policy_version 100609 (0.0006) [2023-12-26 00:23:19,464][123090] Updated weights for policy 1, policy_version 100619 (0.0009) [2023-12-26 00:23:19,527][123090] Updated weights for policy 1, policy_version 100629 (0.0009) [2023-12-26 00:23:19,593][123090] Updated weights for policy 1, policy_version 100639 (0.0008) [2023-12-26 00:23:19,754][123091] Updated weights for policy 0, policy_version 101193 (0.0008) [2023-12-26 00:23:19,825][123091] Updated weights for policy 0, policy_version 101203 (0.0008) [2023-12-26 00:23:19,898][123091] Updated weights for policy 0, policy_version 101213 (0.0008) [2023-12-26 00:23:20,480][123090] Updated weights for policy 1, policy_version 100649 (0.0008) [2023-12-26 00:23:20,528][123090] Updated weights for policy 1, policy_version 100659 (0.0009) [2023-12-26 00:23:20,586][123090] Updated weights for policy 1, policy_version 100669 (0.0008) [2023-12-26 00:23:20,744][123091] Updated weights for policy 0, policy_version 101223 (0.0010) [2023-12-26 00:23:20,808][123091] Updated weights for policy 0, policy_version 101233 (0.0010) [2023-12-26 00:23:20,867][123091] Updated weights for policy 0, policy_version 101243 (0.0010) [2023-12-26 00:23:21,396][123090] Updated weights for policy 1, policy_version 100679 (0.0009) [2023-12-26 00:23:21,453][123090] Updated weights for policy 1, policy_version 100689 (0.0011) [2023-12-26 00:23:21,506][123090] Updated weights for policy 1, policy_version 100699 (0.0011) [2023-12-26 00:23:21,791][123091] Updated weights for policy 0, policy_version 101253 (0.0011) [2023-12-26 00:23:21,848][123091] Updated weights for policy 0, policy_version 101263 (0.0009) [2023-12-26 00:23:21,904][123091] Updated weights for policy 0, policy_version 101273 (0.0010) [2023-12-26 00:23:22,312][123090] Updated weights for policy 1, policy_version 100709 (0.0010) [2023-12-26 00:23:22,381][123090] Updated weights for policy 1, policy_version 100719 (0.0009) [2023-12-26 00:23:22,453][123090] Updated weights for policy 1, policy_version 100729 (0.0008) [2023-12-26 00:23:22,799][123091] Updated weights for policy 0, policy_version 101283 (0.0010) [2023-12-26 00:23:22,873][123091] Updated weights for policy 0, policy_version 101293 (0.0006) [2023-12-26 00:23:22,936][123091] Updated weights for policy 0, policy_version 101303 (0.0007) [2023-12-26 00:23:23,291][123090] Updated weights for policy 1, policy_version 100739 (0.0010) [2023-12-26 00:23:23,349][123090] Updated weights for policy 1, policy_version 100749 (0.0010) [2023-12-26 00:23:23,420][123090] Updated weights for policy 1, policy_version 100759 (0.0010) [2023-12-26 00:23:23,634][123091] Updated weights for policy 0, policy_version 101313 (0.0006) [2023-12-26 00:23:23,688][123091] Updated weights for policy 0, policy_version 101323 (0.0005) [2023-12-26 00:23:23,741][123091] Updated weights for policy 0, policy_version 101333 (0.0010) [2023-12-26 00:23:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 51732480. Throughput: 0: 8639.4, 1: 8797.7. Samples: 51712220. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:23,785][121949] Avg episode reward: [(0, '4914.402'), (1, '5454.134')] [2023-12-26 00:23:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000100768_25796608.pth... [2023-12-26 00:23:23,792][123091] Updated weights for policy 0, policy_version 101343 (0.0010) [2023-12-26 00:23:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000099744_25534464.pth [2023-12-26 00:23:23,798][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000101344_25944064.pth... [2023-12-26 00:23:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000100320_25681920.pth [2023-12-26 00:23:24,298][123090] Updated weights for policy 1, policy_version 100769 (0.0010) [2023-12-26 00:23:24,365][123090] Updated weights for policy 1, policy_version 100779 (0.0009) [2023-12-26 00:23:24,433][123090] Updated weights for policy 1, policy_version 100789 (0.0009) [2023-12-26 00:23:24,500][123090] Updated weights for policy 1, policy_version 100799 (0.0008) [2023-12-26 00:23:24,521][123091] Updated weights for policy 0, policy_version 101353 (0.0007) [2023-12-26 00:23:24,582][123091] Updated weights for policy 0, policy_version 101363 (0.0005) [2023-12-26 00:23:24,652][123091] Updated weights for policy 0, policy_version 101373 (0.0008) [2023-12-26 00:23:25,311][123091] Updated weights for policy 0, policy_version 101383 (0.0010) [2023-12-26 00:23:25,344][123090] Updated weights for policy 1, policy_version 100809 (0.0008) [2023-12-26 00:23:25,371][123091] Updated weights for policy 0, policy_version 101393 (0.0009) [2023-12-26 00:23:25,418][123090] Updated weights for policy 1, policy_version 100819 (0.0008) [2023-12-26 00:23:25,443][123091] Updated weights for policy 0, policy_version 101403 (0.0006) [2023-12-26 00:23:25,471][123090] Updated weights for policy 1, policy_version 100829 (0.0007) [2023-12-26 00:23:26,172][123091] Updated weights for policy 0, policy_version 101413 (0.0008) [2023-12-26 00:23:26,235][123091] Updated weights for policy 0, policy_version 101423 (0.0005) [2023-12-26 00:23:26,269][123090] Updated weights for policy 1, policy_version 100839 (0.0007) [2023-12-26 00:23:26,285][123091] Updated weights for policy 0, policy_version 101433 (0.0009) [2023-12-26 00:23:26,333][123090] Updated weights for policy 1, policy_version 100849 (0.0008) [2023-12-26 00:23:26,387][123090] Updated weights for policy 1, policy_version 100859 (0.0010) [2023-12-26 00:23:26,946][123091] Updated weights for policy 0, policy_version 101443 (0.0008) [2023-12-26 00:23:26,999][123091] Updated weights for policy 0, policy_version 101453 (0.0005) [2023-12-26 00:23:27,055][123091] Updated weights for policy 0, policy_version 101463 (0.0005) [2023-12-26 00:23:27,298][123090] Updated weights for policy 1, policy_version 100869 (0.0009) [2023-12-26 00:23:27,353][123090] Updated weights for policy 1, policy_version 100879 (0.0009) [2023-12-26 00:23:27,406][123090] Updated weights for policy 1, policy_version 100890 (0.0010) [2023-12-26 00:23:27,702][123091] Updated weights for policy 0, policy_version 101473 (0.0005) [2023-12-26 00:23:27,754][123091] Updated weights for policy 0, policy_version 101483 (0.0005) [2023-12-26 00:23:27,803][123091] Updated weights for policy 0, policy_version 101493 (0.0005) [2023-12-26 00:23:27,859][123091] Updated weights for policy 0, policy_version 101503 (0.0005) [2023-12-26 00:23:28,234][123090] Updated weights for policy 1, policy_version 100901 (0.0010) [2023-12-26 00:23:28,305][123090] Updated weights for policy 1, policy_version 100911 (0.0010) [2023-12-26 00:23:28,374][123090] Updated weights for policy 1, policy_version 100921 (0.0009) [2023-12-26 00:23:28,595][123091] Updated weights for policy 0, policy_version 101513 (0.0009) [2023-12-26 00:23:28,657][123091] Updated weights for policy 0, policy_version 101523 (0.0009) [2023-12-26 00:23:28,716][123091] Updated weights for policy 0, policy_version 101533 (0.0009) [2023-12-26 00:23:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 51830784. Throughput: 0: 8802.7, 1: 8797.4. Samples: 51820772. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:28,784][121949] Avg episode reward: [(0, '4963.037'), (1, '5459.248')] [2023-12-26 00:23:29,196][123090] Updated weights for policy 1, policy_version 100931 (0.0008) [2023-12-26 00:23:29,258][123090] Updated weights for policy 1, policy_version 100941 (0.0009) [2023-12-26 00:23:29,313][123090] Updated weights for policy 1, policy_version 100951 (0.0009) [2023-12-26 00:23:29,489][123091] Updated weights for policy 0, policy_version 101543 (0.0008) [2023-12-26 00:23:29,543][123091] Updated weights for policy 0, policy_version 101553 (0.0010) [2023-12-26 00:23:29,598][123091] Updated weights for policy 0, policy_version 101563 (0.0010) [2023-12-26 00:23:30,200][123090] Updated weights for policy 1, policy_version 100961 (0.0009) [2023-12-26 00:23:30,269][123090] Updated weights for policy 1, policy_version 100971 (0.0010) [2023-12-26 00:23:30,334][123090] Updated weights for policy 1, policy_version 100981 (0.0010) [2023-12-26 00:23:30,388][123090] Updated weights for policy 1, policy_version 100991 (0.0009) [2023-12-26 00:23:30,424][123091] Updated weights for policy 0, policy_version 101573 (0.0011) [2023-12-26 00:23:30,475][123091] Updated weights for policy 0, policy_version 101583 (0.0010) [2023-12-26 00:23:30,530][123091] Updated weights for policy 0, policy_version 101593 (0.0010) [2023-12-26 00:23:31,199][123090] Updated weights for policy 1, policy_version 101001 (0.0008) [2023-12-26 00:23:31,261][123090] Updated weights for policy 1, policy_version 101011 (0.0009) [2023-12-26 00:23:31,329][123090] Updated weights for policy 1, policy_version 101021 (0.0009) [2023-12-26 00:23:31,441][123091] Updated weights for policy 0, policy_version 101603 (0.0009) [2023-12-26 00:23:31,496][123091] Updated weights for policy 0, policy_version 101613 (0.0009) [2023-12-26 00:23:31,553][123091] Updated weights for policy 0, policy_version 101623 (0.0007) [2023-12-26 00:23:32,153][123090] Updated weights for policy 1, policy_version 101031 (0.0009) [2023-12-26 00:23:32,215][123090] Updated weights for policy 1, policy_version 101041 (0.0009) [2023-12-26 00:23:32,277][123090] Updated weights for policy 1, policy_version 101051 (0.0008) [2023-12-26 00:23:32,385][123091] Updated weights for policy 0, policy_version 101633 (0.0007) [2023-12-26 00:23:32,441][123091] Updated weights for policy 0, policy_version 101643 (0.0009) [2023-12-26 00:23:32,502][123091] Updated weights for policy 0, policy_version 101653 (0.0009) [2023-12-26 00:23:32,564][123091] Updated weights for policy 0, policy_version 101663 (0.0008) [2023-12-26 00:23:33,029][123090] Updated weights for policy 1, policy_version 101061 (0.0007) [2023-12-26 00:23:33,081][123090] Updated weights for policy 1, policy_version 101071 (0.0005) [2023-12-26 00:23:33,131][123090] Updated weights for policy 1, policy_version 101081 (0.0005) [2023-12-26 00:23:33,332][123091] Updated weights for policy 0, policy_version 101673 (0.0005) [2023-12-26 00:23:33,397][123091] Updated weights for policy 0, policy_version 101683 (0.0005) [2023-12-26 00:23:33,446][123091] Updated weights for policy 0, policy_version 101693 (0.0005) [2023-12-26 00:23:33,757][123090] Updated weights for policy 1, policy_version 101091 (0.0007) [2023-12-26 00:23:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 51912704. Throughput: 0: 8881.0, 1: 8821.9. Samples: 51927348. Policy #0 lag: (min: 5.0, avg: 13.0, max: 37.0) [2023-12-26 00:23:33,785][121949] Avg episode reward: [(0, '4997.657'), (1, '5413.902')] [2023-12-26 00:23:33,811][123090] Updated weights for policy 1, policy_version 101101 (0.0010) [2023-12-26 00:23:33,865][123090] Updated weights for policy 1, policy_version 101112 (0.0009) [2023-12-26 00:23:34,149][123091] Updated weights for policy 0, policy_version 101703 (0.0008) [2023-12-26 00:23:34,214][123091] Updated weights for policy 0, policy_version 101713 (0.0009) [2023-12-26 00:23:34,274][123091] Updated weights for policy 0, policy_version 101723 (0.0009) [2023-12-26 00:23:34,714][123090] Updated weights for policy 1, policy_version 101122 (0.0008) [2023-12-26 00:23:34,789][123090] Updated weights for policy 1, policy_version 101132 (0.0006) [2023-12-26 00:23:34,860][123090] Updated weights for policy 1, policy_version 101142 (0.0009) [2023-12-26 00:23:34,925][123090] Updated weights for policy 1, policy_version 101152 (0.0009) [2023-12-26 00:23:35,158][123091] Updated weights for policy 0, policy_version 101733 (0.0011) [2023-12-26 00:23:35,232][123091] Updated weights for policy 0, policy_version 101743 (0.0011) [2023-12-26 00:23:35,286][123091] Updated weights for policy 0, policy_version 101753 (0.0010) [2023-12-26 00:23:35,571][123090] Updated weights for policy 1, policy_version 101162 (0.0009) [2023-12-26 00:23:35,624][123090] Updated weights for policy 1, policy_version 101172 (0.0009) [2023-12-26 00:23:35,667][123090] Updated weights for policy 1, policy_version 101182 (0.0005) [2023-12-26 00:23:36,088][123091] Updated weights for policy 0, policy_version 101763 (0.0011) [2023-12-26 00:23:36,160][123091] Updated weights for policy 0, policy_version 101773 (0.0011) [2023-12-26 00:23:36,231][123091] Updated weights for policy 0, policy_version 101783 (0.0010) [2023-12-26 00:23:36,423][123090] Updated weights for policy 1, policy_version 101192 (0.0009) [2023-12-26 00:23:36,474][123090] Updated weights for policy 1, policy_version 101202 (0.0008) [2023-12-26 00:23:36,535][123090] Updated weights for policy 1, policy_version 101212 (0.0005) [2023-12-26 00:23:36,967][123091] Updated weights for policy 0, policy_version 101793 (0.0011) [2023-12-26 00:23:37,035][123091] Updated weights for policy 0, policy_version 101803 (0.0011) [2023-12-26 00:23:37,094][123091] Updated weights for policy 0, policy_version 101813 (0.0010) [2023-12-26 00:23:37,149][123091] Updated weights for policy 0, policy_version 101823 (0.0010) [2023-12-26 00:23:37,247][123090] Updated weights for policy 1, policy_version 101222 (0.0009) [2023-12-26 00:23:37,307][123090] Updated weights for policy 1, policy_version 101232 (0.0010) [2023-12-26 00:23:37,358][123090] Updated weights for policy 1, policy_version 101242 (0.0010) [2023-12-26 00:23:37,973][123091] Updated weights for policy 0, policy_version 101833 (0.0010) [2023-12-26 00:23:38,031][123091] Updated weights for policy 0, policy_version 101843 (0.0011) [2023-12-26 00:23:38,098][123091] Updated weights for policy 0, policy_version 101853 (0.0010) [2023-12-26 00:23:38,117][123090] Updated weights for policy 1, policy_version 101252 (0.0008) [2023-12-26 00:23:38,167][123090] Updated weights for policy 1, policy_version 101262 (0.0005) [2023-12-26 00:23:38,225][123090] Updated weights for policy 1, policy_version 101272 (0.0005) [2023-12-26 00:23:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 52002816. Throughput: 0: 8912.4, 1: 8815.5. Samples: 51981088. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:23:38,785][121949] Avg episode reward: [(0, '4992.512'), (1, '5459.158')] [2023-12-26 00:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000101280_25927680.pth... [2023-12-26 00:23:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000101856_26075136.pth... [2023-12-26 00:23:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000100256_25665536.pth [2023-12-26 00:23:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000100832_25812992.pth [2023-12-26 00:23:38,916][123091] Updated weights for policy 0, policy_version 101863 (0.0008) [2023-12-26 00:23:38,936][123090] Updated weights for policy 1, policy_version 101282 (0.0006) [2023-12-26 00:23:38,975][123091] Updated weights for policy 0, policy_version 101873 (0.0005) [2023-12-26 00:23:38,991][123090] Updated weights for policy 1, policy_version 101292 (0.0006) [2023-12-26 00:23:39,021][123091] Updated weights for policy 0, policy_version 101883 (0.0009) [2023-12-26 00:23:39,046][123090] Updated weights for policy 1, policy_version 101302 (0.0005) [2023-12-26 00:23:39,107][123090] Updated weights for policy 1, policy_version 101312 (0.0006) [2023-12-26 00:23:39,646][123091] Updated weights for policy 0, policy_version 101893 (0.0008) [2023-12-26 00:23:39,717][123091] Updated weights for policy 0, policy_version 101903 (0.0007) [2023-12-26 00:23:39,787][123091] Updated weights for policy 0, policy_version 101913 (0.0008) [2023-12-26 00:23:39,914][123090] Updated weights for policy 1, policy_version 101322 (0.0010) [2023-12-26 00:23:39,978][123090] Updated weights for policy 1, policy_version 101332 (0.0010) [2023-12-26 00:23:40,030][123090] Updated weights for policy 1, policy_version 101342 (0.0010) [2023-12-26 00:23:40,518][123091] Updated weights for policy 0, policy_version 101923 (0.0008) [2023-12-26 00:23:40,583][123091] Updated weights for policy 0, policy_version 101933 (0.0009) [2023-12-26 00:23:40,646][123091] Updated weights for policy 0, policy_version 101943 (0.0009) [2023-12-26 00:23:40,921][123090] Updated weights for policy 1, policy_version 101352 (0.0010) [2023-12-26 00:23:40,989][123090] Updated weights for policy 1, policy_version 101362 (0.0009) [2023-12-26 00:23:41,058][123090] Updated weights for policy 1, policy_version 101372 (0.0009) [2023-12-26 00:23:41,505][123091] Updated weights for policy 0, policy_version 101953 (0.0009) [2023-12-26 00:23:41,575][123091] Updated weights for policy 0, policy_version 101963 (0.0011) [2023-12-26 00:23:41,646][123091] Updated weights for policy 0, policy_version 101973 (0.0010) [2023-12-26 00:23:41,710][123091] Updated weights for policy 0, policy_version 101983 (0.0009) [2023-12-26 00:23:41,962][123090] Updated weights for policy 1, policy_version 101382 (0.0010) [2023-12-26 00:23:42,027][123090] Updated weights for policy 1, policy_version 101392 (0.0009) [2023-12-26 00:23:42,090][123090] Updated weights for policy 1, policy_version 101402 (0.0010) [2023-12-26 00:23:42,451][123091] Updated weights for policy 0, policy_version 101993 (0.0010) [2023-12-26 00:23:42,526][123091] Updated weights for policy 0, policy_version 102003 (0.0010) [2023-12-26 00:23:42,581][123091] Updated weights for policy 0, policy_version 102013 (0.0010) [2023-12-26 00:23:43,001][123090] Updated weights for policy 1, policy_version 101412 (0.0009) [2023-12-26 00:23:43,057][123090] Updated weights for policy 1, policy_version 101422 (0.0009) [2023-12-26 00:23:43,115][123090] Updated weights for policy 1, policy_version 101432 (0.0010) [2023-12-26 00:23:43,231][123091] Updated weights for policy 0, policy_version 102023 (0.0008) [2023-12-26 00:23:43,288][123091] Updated weights for policy 0, policy_version 102033 (0.0007) [2023-12-26 00:23:43,350][123091] Updated weights for policy 0, policy_version 102043 (0.0010) [2023-12-26 00:23:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 52092928. Throughput: 0: 8890.3, 1: 8750.5. Samples: 52088144. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:23:43,785][121949] Avg episode reward: [(0, '4981.338'), (1, '5367.561')] [2023-12-26 00:23:43,901][123090] Updated weights for policy 1, policy_version 101442 (0.0009) [2023-12-26 00:23:43,952][123090] Updated weights for policy 1, policy_version 101452 (0.0005) [2023-12-26 00:23:44,009][123090] Updated weights for policy 1, policy_version 101462 (0.0005) [2023-12-26 00:23:44,067][123090] Updated weights for policy 1, policy_version 101472 (0.0005) [2023-12-26 00:23:44,124][123091] Updated weights for policy 0, policy_version 102053 (0.0009) [2023-12-26 00:23:44,178][123091] Updated weights for policy 0, policy_version 102064 (0.0011) [2023-12-26 00:23:44,230][123091] Updated weights for policy 0, policy_version 102074 (0.0010) [2023-12-26 00:23:44,723][123090] Updated weights for policy 1, policy_version 101482 (0.0008) [2023-12-26 00:23:44,780][123090] Updated weights for policy 1, policy_version 101492 (0.0008) [2023-12-26 00:23:44,849][123090] Updated weights for policy 1, policy_version 101502 (0.0009) [2023-12-26 00:23:45,092][123091] Updated weights for policy 0, policy_version 102084 (0.0010) [2023-12-26 00:23:45,161][123091] Updated weights for policy 0, policy_version 102094 (0.0011) [2023-12-26 00:23:45,222][123091] Updated weights for policy 0, policy_version 102104 (0.0011) [2023-12-26 00:23:45,756][123090] Updated weights for policy 1, policy_version 101512 (0.0009) [2023-12-26 00:23:45,819][123090] Updated weights for policy 1, policy_version 101522 (0.0009) [2023-12-26 00:23:45,867][123090] Updated weights for policy 1, policy_version 101532 (0.0008) [2023-12-26 00:23:46,009][123091] Updated weights for policy 0, policy_version 102114 (0.0008) [2023-12-26 00:23:46,067][123091] Updated weights for policy 0, policy_version 102124 (0.0011) [2023-12-26 00:23:46,115][123091] Updated weights for policy 0, policy_version 102134 (0.0010) [2023-12-26 00:23:46,162][123091] Updated weights for policy 0, policy_version 102144 (0.0010) [2023-12-26 00:23:46,613][123090] Updated weights for policy 1, policy_version 101542 (0.0008) [2023-12-26 00:23:46,684][123090] Updated weights for policy 1, policy_version 101552 (0.0011) [2023-12-26 00:23:46,748][123090] Updated weights for policy 1, policy_version 101562 (0.0011) [2023-12-26 00:23:46,898][123091] Updated weights for policy 0, policy_version 102154 (0.0005) [2023-12-26 00:23:46,945][123091] Updated weights for policy 0, policy_version 102164 (0.0005) [2023-12-26 00:23:46,996][123091] Updated weights for policy 0, policy_version 102174 (0.0005) [2023-12-26 00:23:47,575][123090] Updated weights for policy 1, policy_version 101572 (0.0010) [2023-12-26 00:23:47,645][123090] Updated weights for policy 1, policy_version 101582 (0.0010) [2023-12-26 00:23:47,674][123091] Updated weights for policy 0, policy_version 102184 (0.0007) [2023-12-26 00:23:47,708][123090] Updated weights for policy 1, policy_version 101592 (0.0011) [2023-12-26 00:23:47,732][123091] Updated weights for policy 0, policy_version 102194 (0.0009) [2023-12-26 00:23:47,795][123091] Updated weights for policy 0, policy_version 102204 (0.0011) [2023-12-26 00:23:48,486][123090] Updated weights for policy 1, policy_version 101602 (0.0011) [2023-12-26 00:23:48,548][123091] Updated weights for policy 0, policy_version 102214 (0.0008) [2023-12-26 00:23:48,553][123090] Updated weights for policy 1, policy_version 101612 (0.0010) [2023-12-26 00:23:48,607][123090] Updated weights for policy 1, policy_version 101622 (0.0007) [2023-12-26 00:23:48,610][123091] Updated weights for policy 0, policy_version 102224 (0.0007) [2023-12-26 00:23:48,663][123090] Updated weights for policy 1, policy_version 101632 (0.0009) [2023-12-26 00:23:48,682][123091] Updated weights for policy 0, policy_version 102234 (0.0007) [2023-12-26 00:23:48,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 52191232. Throughput: 0: 9016.4, 1: 8786.5. Samples: 52196672. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:23:48,785][121949] Avg episode reward: [(0, '5064.953'), (1, '5312.819')] [2023-12-26 00:23:48,785][123007] Saving new best policy, reward=5064.953! [2023-12-26 00:23:49,441][123091] Updated weights for policy 0, policy_version 102244 (0.0006) [2023-12-26 00:23:49,505][123091] Updated weights for policy 0, policy_version 102254 (0.0006) [2023-12-26 00:23:49,565][123091] Updated weights for policy 0, policy_version 102264 (0.0006) [2023-12-26 00:23:49,576][123090] Updated weights for policy 1, policy_version 101642 (0.0008) [2023-12-26 00:23:49,649][123090] Updated weights for policy 1, policy_version 101652 (0.0010) [2023-12-26 00:23:49,713][123090] Updated weights for policy 1, policy_version 101662 (0.0009) [2023-12-26 00:23:50,274][123091] Updated weights for policy 0, policy_version 102274 (0.0005) [2023-12-26 00:23:50,336][123091] Updated weights for policy 0, policy_version 102284 (0.0006) [2023-12-26 00:23:50,388][123091] Updated weights for policy 0, policy_version 102294 (0.0010) [2023-12-26 00:23:50,446][123091] Updated weights for policy 0, policy_version 102304 (0.0010) [2023-12-26 00:23:50,587][123090] Updated weights for policy 1, policy_version 101672 (0.0010) [2023-12-26 00:23:50,654][123090] Updated weights for policy 1, policy_version 101682 (0.0009) [2023-12-26 00:23:50,721][123090] Updated weights for policy 1, policy_version 101692 (0.0008) [2023-12-26 00:23:51,246][123091] Updated weights for policy 0, policy_version 102314 (0.0006) [2023-12-26 00:23:51,310][123091] Updated weights for policy 0, policy_version 102324 (0.0008) [2023-12-26 00:23:51,383][123091] Updated weights for policy 0, policy_version 102334 (0.0009) [2023-12-26 00:23:51,500][123090] Updated weights for policy 1, policy_version 101702 (0.0009) [2023-12-26 00:23:51,552][123090] Updated weights for policy 1, policy_version 101712 (0.0008) [2023-12-26 00:23:51,600][123090] Updated weights for policy 1, policy_version 101722 (0.0008) [2023-12-26 00:23:52,183][123091] Updated weights for policy 0, policy_version 102344 (0.0010) [2023-12-26 00:23:52,246][123091] Updated weights for policy 0, policy_version 102354 (0.0010) [2023-12-26 00:23:52,312][123091] Updated weights for policy 0, policy_version 102364 (0.0010) [2023-12-26 00:23:52,333][123090] Updated weights for policy 1, policy_version 101732 (0.0008) [2023-12-26 00:23:52,403][123090] Updated weights for policy 1, policy_version 101742 (0.0009) [2023-12-26 00:23:52,454][123090] Updated weights for policy 1, policy_version 101752 (0.0010) [2023-12-26 00:23:53,142][123091] Updated weights for policy 0, policy_version 102374 (0.0009) [2023-12-26 00:23:53,205][123091] Updated weights for policy 0, policy_version 102384 (0.0009) [2023-12-26 00:23:53,261][123091] Updated weights for policy 0, policy_version 102394 (0.0009) [2023-12-26 00:23:53,322][123090] Updated weights for policy 1, policy_version 101762 (0.0010) [2023-12-26 00:23:53,381][123090] Updated weights for policy 1, policy_version 101772 (0.0009) [2023-12-26 00:23:53,436][123090] Updated weights for policy 1, policy_version 101782 (0.0008) [2023-12-26 00:23:53,488][123090] Updated weights for policy 1, policy_version 101792 (0.0010) [2023-12-26 00:23:53,785][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 52273152. Throughput: 0: 8989.5, 1: 8702.1. Samples: 52248760. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:23:53,786][121949] Avg episode reward: [(0, '5090.234'), (1, '5305.241')] [2023-12-26 00:23:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000102400_26214400.pth... [2023-12-26 00:23:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000101792_26058752.pth... [2023-12-26 00:23:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000101344_25944064.pth [2023-12-26 00:23:53,798][123007] Saving new best policy, reward=5090.234! [2023-12-26 00:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000100768_25796608.pth [2023-12-26 00:23:54,069][123091] Updated weights for policy 0, policy_version 102404 (0.0010) [2023-12-26 00:23:54,122][123091] Updated weights for policy 0, policy_version 102414 (0.0009) [2023-12-26 00:23:54,172][123091] Updated weights for policy 0, policy_version 102424 (0.0010) [2023-12-26 00:23:54,335][123090] Updated weights for policy 1, policy_version 101802 (0.0005) [2023-12-26 00:23:54,391][123090] Updated weights for policy 1, policy_version 101812 (0.0005) [2023-12-26 00:23:54,462][123090] Updated weights for policy 1, policy_version 101822 (0.0005) [2023-12-26 00:23:55,082][123090] Updated weights for policy 1, policy_version 101832 (0.0007) [2023-12-26 00:23:55,104][123091] Updated weights for policy 0, policy_version 102435 (0.0008) [2023-12-26 00:23:55,133][123090] Updated weights for policy 1, policy_version 101842 (0.0008) [2023-12-26 00:23:55,161][123091] Updated weights for policy 0, policy_version 102445 (0.0009) [2023-12-26 00:23:55,182][123090] Updated weights for policy 1, policy_version 101852 (0.0006) [2023-12-26 00:23:55,210][123091] Updated weights for policy 0, policy_version 102456 (0.0009) [2023-12-26 00:23:55,881][123090] Updated weights for policy 1, policy_version 101862 (0.0005) [2023-12-26 00:23:55,934][123090] Updated weights for policy 1, policy_version 101872 (0.0005) [2023-12-26 00:23:55,986][123090] Updated weights for policy 1, policy_version 101882 (0.0005) [2023-12-26 00:23:56,084][123091] Updated weights for policy 0, policy_version 102466 (0.0010) [2023-12-26 00:23:56,145][123091] Updated weights for policy 0, policy_version 102476 (0.0010) [2023-12-26 00:23:56,203][123091] Updated weights for policy 0, policy_version 102486 (0.0010) [2023-12-26 00:23:56,262][123091] Updated weights for policy 0, policy_version 102496 (0.0010) [2023-12-26 00:23:56,624][123090] Updated weights for policy 1, policy_version 101892 (0.0005) [2023-12-26 00:23:56,679][123090] Updated weights for policy 1, policy_version 101902 (0.0006) [2023-12-26 00:23:56,733][123090] Updated weights for policy 1, policy_version 101912 (0.0005) [2023-12-26 00:23:57,168][123091] Updated weights for policy 0, policy_version 102506 (0.0010) [2023-12-26 00:23:57,221][123091] Updated weights for policy 0, policy_version 102516 (0.0010) [2023-12-26 00:23:57,273][123091] Updated weights for policy 0, policy_version 102526 (0.0009) [2023-12-26 00:23:57,393][123090] Updated weights for policy 1, policy_version 101922 (0.0006) [2023-12-26 00:23:57,440][123090] Updated weights for policy 1, policy_version 101932 (0.0005) [2023-12-26 00:23:57,487][123090] Updated weights for policy 1, policy_version 101942 (0.0005) [2023-12-26 00:23:57,530][123090] Updated weights for policy 1, policy_version 101952 (0.0005) [2023-12-26 00:23:58,208][123091] Updated weights for policy 0, policy_version 102536 (0.0009) [2023-12-26 00:23:58,268][123091] Updated weights for policy 0, policy_version 102546 (0.0008) [2023-12-26 00:23:58,288][123090] Updated weights for policy 1, policy_version 101962 (0.0009) [2023-12-26 00:23:58,330][123091] Updated weights for policy 0, policy_version 102556 (0.0007) [2023-12-26 00:23:58,354][123090] Updated weights for policy 1, policy_version 101972 (0.0008) [2023-12-26 00:23:58,421][123090] Updated weights for policy 1, policy_version 101982 (0.0006) [2023-12-26 00:23:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 52363264. Throughput: 0: 8955.8, 1: 8863.3. Samples: 52356696. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:23:58,785][121949] Avg episode reward: [(0, '5048.549'), (1, '5436.426')] [2023-12-26 00:23:59,224][123091] Updated weights for policy 0, policy_version 102566 (0.0010) [2023-12-26 00:23:59,278][123090] Updated weights for policy 1, policy_version 101992 (0.0008) [2023-12-26 00:23:59,289][123091] Updated weights for policy 0, policy_version 102576 (0.0008) [2023-12-26 00:23:59,345][123090] Updated weights for policy 1, policy_version 102002 (0.0008) [2023-12-26 00:23:59,351][123091] Updated weights for policy 0, policy_version 102586 (0.0007) [2023-12-26 00:23:59,415][123090] Updated weights for policy 1, policy_version 102012 (0.0008) [2023-12-26 00:24:00,142][123090] Updated weights for policy 1, policy_version 102022 (0.0007) [2023-12-26 00:24:00,207][123090] Updated weights for policy 1, policy_version 102032 (0.0006) [2023-12-26 00:24:00,256][123091] Updated weights for policy 0, policy_version 102596 (0.0008) [2023-12-26 00:24:00,273][123090] Updated weights for policy 1, policy_version 102042 (0.0005) [2023-12-26 00:24:00,322][123091] Updated weights for policy 0, policy_version 102606 (0.0010) [2023-12-26 00:24:00,383][123091] Updated weights for policy 0, policy_version 102616 (0.0010) [2023-12-26 00:24:01,037][123090] Updated weights for policy 1, policy_version 102052 (0.0007) [2023-12-26 00:24:01,106][123090] Updated weights for policy 1, policy_version 102062 (0.0011) [2023-12-26 00:24:01,183][123090] Updated weights for policy 1, policy_version 102072 (0.0009) [2023-12-26 00:24:01,221][123091] Updated weights for policy 0, policy_version 102626 (0.0009) [2023-12-26 00:24:01,282][123091] Updated weights for policy 0, policy_version 102636 (0.0009) [2023-12-26 00:24:01,332][123091] Updated weights for policy 0, policy_version 102646 (0.0009) [2023-12-26 00:24:01,404][123091] Updated weights for policy 0, policy_version 102656 (0.0010) [2023-12-26 00:24:01,980][123090] Updated weights for policy 1, policy_version 102082 (0.0009) [2023-12-26 00:24:02,045][123090] Updated weights for policy 1, policy_version 102092 (0.0009) [2023-12-26 00:24:02,116][123090] Updated weights for policy 1, policy_version 102102 (0.0009) [2023-12-26 00:24:02,168][123090] Updated weights for policy 1, policy_version 102112 (0.0009) [2023-12-26 00:24:02,217][123091] Updated weights for policy 0, policy_version 102666 (0.0008) [2023-12-26 00:24:02,276][123091] Updated weights for policy 0, policy_version 102676 (0.0010) [2023-12-26 00:24:02,335][123091] Updated weights for policy 0, policy_version 102686 (0.0011) [2023-12-26 00:24:03,026][123090] Updated weights for policy 1, policy_version 102122 (0.0009) [2023-12-26 00:24:03,087][123090] Updated weights for policy 1, policy_version 102132 (0.0008) [2023-12-26 00:24:03,141][123090] Updated weights for policy 1, policy_version 102142 (0.0008) [2023-12-26 00:24:03,171][123091] Updated weights for policy 0, policy_version 102696 (0.0008) [2023-12-26 00:24:03,223][123091] Updated weights for policy 0, policy_version 102706 (0.0010) [2023-12-26 00:24:03,300][123091] Updated weights for policy 0, policy_version 102716 (0.0008) [2023-12-26 00:24:03,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 52445184. Throughput: 0: 8890.4, 1: 8842.0. Samples: 52459368. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:03,785][121949] Avg episode reward: [(0, '5010.525'), (1, '5540.540')] [2023-12-26 00:24:03,985][123091] Updated weights for policy 0, policy_version 102726 (0.0005) [2023-12-26 00:24:04,026][123090] Updated weights for policy 1, policy_version 102152 (0.0009) [2023-12-26 00:24:04,039][123091] Updated weights for policy 0, policy_version 102736 (0.0005) [2023-12-26 00:24:04,089][123090] Updated weights for policy 1, policy_version 102162 (0.0007) [2023-12-26 00:24:04,104][123091] Updated weights for policy 0, policy_version 102746 (0.0008) [2023-12-26 00:24:04,158][123090] Updated weights for policy 1, policy_version 102172 (0.0009) [2023-12-26 00:24:04,853][123091] Updated weights for policy 0, policy_version 102756 (0.0011) [2023-12-26 00:24:04,905][123091] Updated weights for policy 0, policy_version 102766 (0.0010) [2023-12-26 00:24:04,956][123091] Updated weights for policy 0, policy_version 102776 (0.0010) [2023-12-26 00:24:05,024][123090] Updated weights for policy 1, policy_version 102182 (0.0010) [2023-12-26 00:24:05,082][123090] Updated weights for policy 1, policy_version 102193 (0.0010) [2023-12-26 00:24:05,140][123090] Updated weights for policy 1, policy_version 102203 (0.0010) [2023-12-26 00:24:05,632][123091] Updated weights for policy 0, policy_version 102786 (0.0009) [2023-12-26 00:24:05,683][123091] Updated weights for policy 0, policy_version 102796 (0.0005) [2023-12-26 00:24:05,733][123091] Updated weights for policy 0, policy_version 102806 (0.0006) [2023-12-26 00:24:05,788][123091] Updated weights for policy 0, policy_version 102816 (0.0005) [2023-12-26 00:24:06,075][123090] Updated weights for policy 1, policy_version 102213 (0.0009) [2023-12-26 00:24:06,140][123090] Updated weights for policy 1, policy_version 102223 (0.0010) [2023-12-26 00:24:06,202][123090] Updated weights for policy 1, policy_version 102233 (0.0010) [2023-12-26 00:24:06,419][123091] Updated weights for policy 0, policy_version 102826 (0.0006) [2023-12-26 00:24:06,484][123091] Updated weights for policy 0, policy_version 102836 (0.0009) [2023-12-26 00:24:06,542][123091] Updated weights for policy 0, policy_version 102846 (0.0011) [2023-12-26 00:24:07,036][123090] Updated weights for policy 1, policy_version 102243 (0.0009) [2023-12-26 00:24:07,098][123090] Updated weights for policy 1, policy_version 102253 (0.0005) [2023-12-26 00:24:07,160][123090] Updated weights for policy 1, policy_version 102263 (0.0005) [2023-12-26 00:24:07,294][123091] Updated weights for policy 0, policy_version 102856 (0.0009) [2023-12-26 00:24:07,346][123091] Updated weights for policy 0, policy_version 102866 (0.0009) [2023-12-26 00:24:07,396][123091] Updated weights for policy 0, policy_version 102876 (0.0009) [2023-12-26 00:24:07,945][123090] Updated weights for policy 1, policy_version 102273 (0.0008) [2023-12-26 00:24:08,009][123090] Updated weights for policy 1, policy_version 102283 (0.0008) [2023-12-26 00:24:08,070][123090] Updated weights for policy 1, policy_version 102293 (0.0009) [2023-12-26 00:24:08,133][123090] Updated weights for policy 1, policy_version 102303 (0.0008) [2023-12-26 00:24:08,190][123091] Updated weights for policy 0, policy_version 102886 (0.0010) [2023-12-26 00:24:08,244][123091] Updated weights for policy 0, policy_version 102896 (0.0010) [2023-12-26 00:24:08,307][123091] Updated weights for policy 0, policy_version 102906 (0.0010) [2023-12-26 00:24:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 52535296. Throughput: 0: 8996.2, 1: 8797.2. Samples: 52512924. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:08,785][121949] Avg episode reward: [(0, '4940.115'), (1, '5573.355')] [2023-12-26 00:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000102912_26345472.pth... [2023-12-26 00:24:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000102304_26189824.pth... [2023-12-26 00:24:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000101280_25927680.pth [2023-12-26 00:24:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000101856_26075136.pth [2023-12-26 00:24:09,001][123090] Updated weights for policy 1, policy_version 102313 (0.0009) [2023-12-26 00:24:09,065][123090] Updated weights for policy 1, policy_version 102323 (0.0009) [2023-12-26 00:24:09,124][123090] Updated weights for policy 1, policy_version 102333 (0.0008) [2023-12-26 00:24:09,131][123091] Updated weights for policy 0, policy_version 102916 (0.0011) [2023-12-26 00:24:09,178][123091] Updated weights for policy 0, policy_version 102926 (0.0010) [2023-12-26 00:24:09,238][123091] Updated weights for policy 0, policy_version 102936 (0.0011) [2023-12-26 00:24:09,981][123090] Updated weights for policy 1, policy_version 102343 (0.0009) [2023-12-26 00:24:10,049][123090] Updated weights for policy 1, policy_version 102353 (0.0010) [2023-12-26 00:24:10,110][123091] Updated weights for policy 0, policy_version 102946 (0.0009) [2023-12-26 00:24:10,116][123090] Updated weights for policy 1, policy_version 102363 (0.0009) [2023-12-26 00:24:10,164][123091] Updated weights for policy 0, policy_version 102956 (0.0008) [2023-12-26 00:24:10,222][123091] Updated weights for policy 0, policy_version 102966 (0.0009) [2023-12-26 00:24:10,291][123091] Updated weights for policy 0, policy_version 102976 (0.0009) [2023-12-26 00:24:10,904][123090] Updated weights for policy 1, policy_version 102373 (0.0009) [2023-12-26 00:24:10,964][123090] Updated weights for policy 1, policy_version 102383 (0.0009) [2023-12-26 00:24:11,012][123090] Updated weights for policy 1, policy_version 102393 (0.0008) [2023-12-26 00:24:11,115][123091] Updated weights for policy 0, policy_version 102986 (0.0010) [2023-12-26 00:24:11,182][123091] Updated weights for policy 0, policy_version 102996 (0.0009) [2023-12-26 00:24:11,250][123091] Updated weights for policy 0, policy_version 103006 (0.0009) [2023-12-26 00:24:11,874][123090] Updated weights for policy 1, policy_version 102403 (0.0009) [2023-12-26 00:24:11,922][123090] Updated weights for policy 1, policy_version 102413 (0.0009) [2023-12-26 00:24:11,977][123090] Updated weights for policy 1, policy_version 102423 (0.0009) [2023-12-26 00:24:12,133][123091] Updated weights for policy 0, policy_version 103016 (0.0010) [2023-12-26 00:24:12,189][123091] Updated weights for policy 0, policy_version 103026 (0.0009) [2023-12-26 00:24:12,248][123091] Updated weights for policy 0, policy_version 103036 (0.0008) [2023-12-26 00:24:12,847][123090] Updated weights for policy 1, policy_version 102433 (0.0009) [2023-12-26 00:24:12,904][123090] Updated weights for policy 1, policy_version 102443 (0.0005) [2023-12-26 00:24:12,968][123090] Updated weights for policy 1, policy_version 102453 (0.0007) [2023-12-26 00:24:13,007][123091] Updated weights for policy 0, policy_version 103046 (0.0009) [2023-12-26 00:24:13,030][123090] Updated weights for policy 1, policy_version 102463 (0.0008) [2023-12-26 00:24:13,076][123091] Updated weights for policy 0, policy_version 103056 (0.0008) [2023-12-26 00:24:13,141][123091] Updated weights for policy 0, policy_version 103066 (0.0010) [2023-12-26 00:24:13,740][123090] Updated weights for policy 1, policy_version 102473 (0.0006) [2023-12-26 00:24:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 52617216. Throughput: 0: 8840.5, 1: 8805.9. Samples: 52614860. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:13,785][121949] Avg episode reward: [(0, '4971.181'), (1, '5481.498')] [2023-12-26 00:24:13,811][123090] Updated weights for policy 1, policy_version 102483 (0.0005) [2023-12-26 00:24:13,878][123090] Updated weights for policy 1, policy_version 102493 (0.0005) [2023-12-26 00:24:13,969][123091] Updated weights for policy 0, policy_version 103076 (0.0010) [2023-12-26 00:24:14,030][123091] Updated weights for policy 0, policy_version 103086 (0.0010) [2023-12-26 00:24:14,083][123091] Updated weights for policy 0, policy_version 103096 (0.0010) [2023-12-26 00:24:14,473][123090] Updated weights for policy 1, policy_version 102503 (0.0005) [2023-12-26 00:24:14,520][123090] Updated weights for policy 1, policy_version 102513 (0.0005) [2023-12-26 00:24:14,597][123090] Updated weights for policy 1, policy_version 102523 (0.0005) [2023-12-26 00:24:14,939][123091] Updated weights for policy 0, policy_version 103106 (0.0009) [2023-12-26 00:24:15,000][123091] Updated weights for policy 0, policy_version 103116 (0.0009) [2023-12-26 00:24:15,053][123091] Updated weights for policy 0, policy_version 103126 (0.0009) [2023-12-26 00:24:15,115][123091] Updated weights for policy 0, policy_version 103136 (0.0009) [2023-12-26 00:24:15,305][123090] Updated weights for policy 1, policy_version 102533 (0.0006) [2023-12-26 00:24:15,371][123090] Updated weights for policy 1, policy_version 102543 (0.0007) [2023-12-26 00:24:15,436][123090] Updated weights for policy 1, policy_version 102553 (0.0010) [2023-12-26 00:24:15,919][123091] Updated weights for policy 0, policy_version 103146 (0.0006) [2023-12-26 00:24:15,977][123091] Updated weights for policy 0, policy_version 103156 (0.0005) [2023-12-26 00:24:16,042][123091] Updated weights for policy 0, policy_version 103166 (0.0005) [2023-12-26 00:24:16,137][123090] Updated weights for policy 1, policy_version 102563 (0.0011) [2023-12-26 00:24:16,215][123090] Updated weights for policy 1, policy_version 102573 (0.0011) [2023-12-26 00:24:16,281][123090] Updated weights for policy 1, policy_version 102583 (0.0010) [2023-12-26 00:24:16,703][123091] Updated weights for policy 0, policy_version 103176 (0.0007) [2023-12-26 00:24:16,755][123091] Updated weights for policy 0, policy_version 103186 (0.0005) [2023-12-26 00:24:16,819][123091] Updated weights for policy 0, policy_version 103196 (0.0008) [2023-12-26 00:24:17,079][123090] Updated weights for policy 1, policy_version 102593 (0.0010) [2023-12-26 00:24:17,142][123090] Updated weights for policy 1, policy_version 102603 (0.0005) [2023-12-26 00:24:17,199][123090] Updated weights for policy 1, policy_version 102613 (0.0005) [2023-12-26 00:24:17,269][123090] Updated weights for policy 1, policy_version 102623 (0.0005) [2023-12-26 00:24:17,541][123091] Updated weights for policy 0, policy_version 103206 (0.0008) [2023-12-26 00:24:17,601][123091] Updated weights for policy 0, policy_version 103216 (0.0006) [2023-12-26 00:24:17,657][123091] Updated weights for policy 0, policy_version 103226 (0.0006) [2023-12-26 00:24:18,016][123090] Updated weights for policy 1, policy_version 102633 (0.0010) [2023-12-26 00:24:18,075][123090] Updated weights for policy 1, policy_version 102643 (0.0010) [2023-12-26 00:24:18,141][123090] Updated weights for policy 1, policy_version 102653 (0.0010) [2023-12-26 00:24:18,330][123091] Updated weights for policy 0, policy_version 103236 (0.0006) [2023-12-26 00:24:18,392][123091] Updated weights for policy 0, policy_version 103246 (0.0009) [2023-12-26 00:24:18,448][123091] Updated weights for policy 0, policy_version 103256 (0.0009) [2023-12-26 00:24:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 52715520. Throughput: 0: 8875.5, 1: 8898.0. Samples: 52727156. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:18,785][121949] Avg episode reward: [(0, '4939.439'), (1, '5397.375')] [2023-12-26 00:24:18,951][123090] Updated weights for policy 1, policy_version 102663 (0.0011) [2023-12-26 00:24:19,012][123090] Updated weights for policy 1, policy_version 102673 (0.0010) [2023-12-26 00:24:19,071][123090] Updated weights for policy 1, policy_version 102683 (0.0010) [2023-12-26 00:24:19,304][123091] Updated weights for policy 0, policy_version 103266 (0.0008) [2023-12-26 00:24:19,393][123091] Updated weights for policy 0, policy_version 103276 (0.0009) [2023-12-26 00:24:19,467][123091] Updated weights for policy 0, policy_version 103286 (0.0010) [2023-12-26 00:24:19,541][123091] Updated weights for policy 0, policy_version 103296 (0.0010) [2023-12-26 00:24:19,861][123090] Updated weights for policy 1, policy_version 102693 (0.0009) [2023-12-26 00:24:19,928][123090] Updated weights for policy 1, policy_version 102703 (0.0008) [2023-12-26 00:24:19,994][123090] Updated weights for policy 1, policy_version 102713 (0.0008) [2023-12-26 00:24:20,341][123091] Updated weights for policy 0, policy_version 103306 (0.0009) [2023-12-26 00:24:20,408][123091] Updated weights for policy 0, policy_version 103316 (0.0009) [2023-12-26 00:24:20,465][123091] Updated weights for policy 0, policy_version 103326 (0.0009) [2023-12-26 00:24:20,823][123090] Updated weights for policy 1, policy_version 102723 (0.0009) [2023-12-26 00:24:20,895][123090] Updated weights for policy 1, policy_version 102733 (0.0011) [2023-12-26 00:24:20,964][123090] Updated weights for policy 1, policy_version 102743 (0.0011) [2023-12-26 00:24:21,319][123091] Updated weights for policy 0, policy_version 103336 (0.0009) [2023-12-26 00:24:21,388][123091] Updated weights for policy 0, policy_version 103346 (0.0010) [2023-12-26 00:24:21,455][123091] Updated weights for policy 0, policy_version 103356 (0.0009) [2023-12-26 00:24:21,764][123090] Updated weights for policy 1, policy_version 102753 (0.0008) [2023-12-26 00:24:21,831][123090] Updated weights for policy 1, policy_version 102763 (0.0008) [2023-12-26 00:24:21,883][123090] Updated weights for policy 1, policy_version 102773 (0.0009) [2023-12-26 00:24:21,939][123090] Updated weights for policy 1, policy_version 102783 (0.0008) [2023-12-26 00:24:22,373][123091] Updated weights for policy 0, policy_version 103366 (0.0010) [2023-12-26 00:24:22,444][123091] Updated weights for policy 0, policy_version 103376 (0.0009) [2023-12-26 00:24:22,511][123091] Updated weights for policy 0, policy_version 103386 (0.0010) [2023-12-26 00:24:22,707][123090] Updated weights for policy 1, policy_version 102793 (0.0009) [2023-12-26 00:24:22,786][123090] Updated weights for policy 1, policy_version 102803 (0.0005) [2023-12-26 00:24:22,853][123090] Updated weights for policy 1, policy_version 102813 (0.0007) [2023-12-26 00:24:23,408][123091] Updated weights for policy 0, policy_version 103396 (0.0008) [2023-12-26 00:24:23,469][123091] Updated weights for policy 0, policy_version 103406 (0.0009) [2023-12-26 00:24:23,520][123090] Updated weights for policy 1, policy_version 102823 (0.0009) [2023-12-26 00:24:23,531][123091] Updated weights for policy 0, policy_version 103416 (0.0007) [2023-12-26 00:24:23,583][123090] Updated weights for policy 1, policy_version 102833 (0.0010) [2023-12-26 00:24:23,647][123090] Updated weights for policy 1, policy_version 102843 (0.0011) [2023-12-26 00:24:23,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 52805632. Throughput: 0: 8839.0, 1: 8859.2. Samples: 52777512. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:23,785][121949] Avg episode reward: [(0, '4907.756'), (1, '5367.103')] [2023-12-26 00:24:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000103424_26476544.pth... [2023-12-26 00:24:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000102848_26329088.pth... [2023-12-26 00:24:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000102400_26214400.pth [2023-12-26 00:24:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000101792_26058752.pth [2023-12-26 00:24:24,364][123091] Updated weights for policy 0, policy_version 103426 (0.0008) [2023-12-26 00:24:24,426][123091] Updated weights for policy 0, policy_version 103436 (0.0005) [2023-12-26 00:24:24,433][123090] Updated weights for policy 1, policy_version 102853 (0.0011) [2023-12-26 00:24:24,478][123091] Updated weights for policy 0, policy_version 103446 (0.0005) [2023-12-26 00:24:24,500][123090] Updated weights for policy 1, policy_version 102863 (0.0010) [2023-12-26 00:24:24,537][123091] Updated weights for policy 0, policy_version 103456 (0.0005) [2023-12-26 00:24:24,560][123090] Updated weights for policy 1, policy_version 102873 (0.0010) [2023-12-26 00:24:25,210][123091] Updated weights for policy 0, policy_version 103466 (0.0006) [2023-12-26 00:24:25,272][123091] Updated weights for policy 0, policy_version 103476 (0.0006) [2023-12-26 00:24:25,340][123091] Updated weights for policy 0, policy_version 103486 (0.0005) [2023-12-26 00:24:25,378][123090] Updated weights for policy 1, policy_version 102883 (0.0010) [2023-12-26 00:24:25,429][123090] Updated weights for policy 1, policy_version 102893 (0.0010) [2023-12-26 00:24:25,477][123090] Updated weights for policy 1, policy_version 102903 (0.0010) [2023-12-26 00:24:26,040][123091] Updated weights for policy 0, policy_version 103496 (0.0007) [2023-12-26 00:24:26,104][123091] Updated weights for policy 0, policy_version 103506 (0.0006) [2023-12-26 00:24:26,159][123091] Updated weights for policy 0, policy_version 103516 (0.0005) [2023-12-26 00:24:26,280][123090] Updated weights for policy 1, policy_version 102913 (0.0010) [2023-12-26 00:24:26,335][123090] Updated weights for policy 1, policy_version 102923 (0.0010) [2023-12-26 00:24:26,390][123090] Updated weights for policy 1, policy_version 102933 (0.0010) [2023-12-26 00:24:26,450][123090] Updated weights for policy 1, policy_version 102943 (0.0010) [2023-12-26 00:24:26,888][123091] Updated weights for policy 0, policy_version 103526 (0.0008) [2023-12-26 00:24:26,946][123091] Updated weights for policy 0, policy_version 103537 (0.0010) [2023-12-26 00:24:27,000][123091] Updated weights for policy 0, policy_version 103548 (0.0010) [2023-12-26 00:24:27,098][123090] Updated weights for policy 1, policy_version 102953 (0.0006) [2023-12-26 00:24:27,148][123090] Updated weights for policy 1, policy_version 102963 (0.0005) [2023-12-26 00:24:27,203][123090] Updated weights for policy 1, policy_version 102973 (0.0010) [2023-12-26 00:24:27,831][123091] Updated weights for policy 0, policy_version 103559 (0.0009) [2023-12-26 00:24:27,888][123091] Updated weights for policy 0, policy_version 103569 (0.0009) [2023-12-26 00:24:27,943][123091] Updated weights for policy 0, policy_version 103579 (0.0010) [2023-12-26 00:24:27,990][123090] Updated weights for policy 1, policy_version 102983 (0.0010) [2023-12-26 00:24:28,053][123090] Updated weights for policy 1, policy_version 102993 (0.0009) [2023-12-26 00:24:28,104][123090] Updated weights for policy 1, policy_version 103003 (0.0009) [2023-12-26 00:24:28,652][123091] Updated weights for policy 0, policy_version 103589 (0.0007) [2023-12-26 00:24:28,706][123091] Updated weights for policy 0, policy_version 103599 (0.0008) [2023-12-26 00:24:28,766][123091] Updated weights for policy 0, policy_version 103609 (0.0010) [2023-12-26 00:24:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 52887552. Throughput: 0: 8839.9, 1: 8902.1. Samples: 52886528. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:28,785][121949] Avg episode reward: [(0, '4999.792'), (1, '5258.129')] [2023-12-26 00:24:28,965][123090] Updated weights for policy 1, policy_version 103013 (0.0008) [2023-12-26 00:24:29,022][123090] Updated weights for policy 1, policy_version 103023 (0.0005) [2023-12-26 00:24:29,071][123090] Updated weights for policy 1, policy_version 103033 (0.0005) [2023-12-26 00:24:29,657][123091] Updated weights for policy 0, policy_version 103619 (0.0010) [2023-12-26 00:24:29,734][123091] Updated weights for policy 0, policy_version 103629 (0.0010) [2023-12-26 00:24:29,800][123091] Updated weights for policy 0, policy_version 103639 (0.0006) [2023-12-26 00:24:29,868][123090] Updated weights for policy 1, policy_version 103043 (0.0006) [2023-12-26 00:24:29,932][123090] Updated weights for policy 1, policy_version 103053 (0.0009) [2023-12-26 00:24:29,995][123090] Updated weights for policy 1, policy_version 103063 (0.0009) [2023-12-26 00:24:30,585][123091] Updated weights for policy 0, policy_version 103649 (0.0008) [2023-12-26 00:24:30,642][123091] Updated weights for policy 0, policy_version 103659 (0.0005) [2023-12-26 00:24:30,688][123091] Updated weights for policy 0, policy_version 103669 (0.0005) [2023-12-26 00:24:30,736][123091] Updated weights for policy 0, policy_version 103679 (0.0006) [2023-12-26 00:24:30,855][123090] Updated weights for policy 1, policy_version 103073 (0.0010) [2023-12-26 00:24:30,908][123090] Updated weights for policy 1, policy_version 103083 (0.0010) [2023-12-26 00:24:30,965][123090] Updated weights for policy 1, policy_version 103093 (0.0009) [2023-12-26 00:24:31,021][123090] Updated weights for policy 1, policy_version 103103 (0.0009) [2023-12-26 00:24:31,489][123091] Updated weights for policy 0, policy_version 103689 (0.0006) [2023-12-26 00:24:31,564][123091] Updated weights for policy 0, policy_version 103699 (0.0005) [2023-12-26 00:24:31,643][123091] Updated weights for policy 0, policy_version 103709 (0.0007) [2023-12-26 00:24:31,971][123090] Updated weights for policy 1, policy_version 103113 (0.0010) [2023-12-26 00:24:32,029][123090] Updated weights for policy 1, policy_version 103123 (0.0010) [2023-12-26 00:24:32,101][123090] Updated weights for policy 1, policy_version 103133 (0.0010) [2023-12-26 00:24:32,306][123091] Updated weights for policy 0, policy_version 103719 (0.0006) [2023-12-26 00:24:32,373][123091] Updated weights for policy 0, policy_version 103729 (0.0009) [2023-12-26 00:24:32,441][123091] Updated weights for policy 0, policy_version 103739 (0.0005) [2023-12-26 00:24:32,899][123090] Updated weights for policy 1, policy_version 103143 (0.0007) [2023-12-26 00:24:32,955][123090] Updated weights for policy 1, policy_version 103153 (0.0005) [2023-12-26 00:24:33,006][123090] Updated weights for policy 1, policy_version 103163 (0.0005) [2023-12-26 00:24:33,135][123091] Updated weights for policy 0, policy_version 103749 (0.0008) [2023-12-26 00:24:33,186][123091] Updated weights for policy 0, policy_version 103759 (0.0010) [2023-12-26 00:24:33,255][123091] Updated weights for policy 0, policy_version 103769 (0.0010) [2023-12-26 00:24:33,762][123090] Updated weights for policy 1, policy_version 103173 (0.0008) [2023-12-26 00:24:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 52977664. Throughput: 0: 8825.7, 1: 8891.0. Samples: 52993924. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:33,785][121949] Avg episode reward: [(0, '4975.291'), (1, '5337.464')] [2023-12-26 00:24:33,817][123090] Updated weights for policy 1, policy_version 103183 (0.0009) [2023-12-26 00:24:33,876][123090] Updated weights for policy 1, policy_version 103193 (0.0009) [2023-12-26 00:24:34,049][123091] Updated weights for policy 0, policy_version 103779 (0.0010) [2023-12-26 00:24:34,101][123091] Updated weights for policy 0, policy_version 103789 (0.0010) [2023-12-26 00:24:34,162][123091] Updated weights for policy 0, policy_version 103799 (0.0010) [2023-12-26 00:24:34,668][123090] Updated weights for policy 1, policy_version 103203 (0.0008) [2023-12-26 00:24:34,732][123090] Updated weights for policy 1, policy_version 103213 (0.0009) [2023-12-26 00:24:34,793][123090] Updated weights for policy 1, policy_version 103223 (0.0008) [2023-12-26 00:24:35,028][123091] Updated weights for policy 0, policy_version 103809 (0.0011) [2023-12-26 00:24:35,076][123091] Updated weights for policy 0, policy_version 103819 (0.0010) [2023-12-26 00:24:35,124][123091] Updated weights for policy 0, policy_version 103829 (0.0010) [2023-12-26 00:24:35,176][123091] Updated weights for policy 0, policy_version 103839 (0.0010) [2023-12-26 00:24:35,674][123090] Updated weights for policy 1, policy_version 103233 (0.0009) [2023-12-26 00:24:35,748][123090] Updated weights for policy 1, policy_version 103243 (0.0009) [2023-12-26 00:24:35,826][123090] Updated weights for policy 1, policy_version 103253 (0.0009) [2023-12-26 00:24:35,853][123091] Updated weights for policy 0, policy_version 103849 (0.0006) [2023-12-26 00:24:35,894][123090] Updated weights for policy 1, policy_version 103263 (0.0006) [2023-12-26 00:24:35,911][123091] Updated weights for policy 0, policy_version 103859 (0.0008) [2023-12-26 00:24:35,960][123091] Updated weights for policy 0, policy_version 103869 (0.0006) [2023-12-26 00:24:36,552][123090] Updated weights for policy 1, policy_version 103273 (0.0008) [2023-12-26 00:24:36,613][123090] Updated weights for policy 1, policy_version 103283 (0.0009) [2023-12-26 00:24:36,682][123090] Updated weights for policy 1, policy_version 103293 (0.0009) [2023-12-26 00:24:36,757][123091] Updated weights for policy 0, policy_version 103879 (0.0010) [2023-12-26 00:24:36,820][123091] Updated weights for policy 0, policy_version 103889 (0.0010) [2023-12-26 00:24:36,876][123091] Updated weights for policy 0, policy_version 103899 (0.0011) [2023-12-26 00:24:37,504][123090] Updated weights for policy 1, policy_version 103303 (0.0009) [2023-12-26 00:24:37,561][123090] Updated weights for policy 1, policy_version 103313 (0.0009) [2023-12-26 00:24:37,609][123090] Updated weights for policy 1, policy_version 103323 (0.0007) [2023-12-26 00:24:37,715][123091] Updated weights for policy 0, policy_version 103909 (0.0011) [2023-12-26 00:24:37,781][123091] Updated weights for policy 0, policy_version 103919 (0.0010) [2023-12-26 00:24:37,843][123091] Updated weights for policy 0, policy_version 103929 (0.0010) [2023-12-26 00:24:38,314][123090] Updated weights for policy 1, policy_version 103333 (0.0006) [2023-12-26 00:24:38,390][123090] Updated weights for policy 1, policy_version 103343 (0.0008) [2023-12-26 00:24:38,453][123090] Updated weights for policy 1, policy_version 103353 (0.0008) [2023-12-26 00:24:38,672][123091] Updated weights for policy 0, policy_version 103939 (0.0009) [2023-12-26 00:24:38,745][123091] Updated weights for policy 0, policy_version 103949 (0.0007) [2023-12-26 00:24:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 53067776. Throughput: 0: 8808.1, 1: 8925.5. Samples: 53046764. Policy #0 lag: (min: 1.0, avg: 25.0, max: 33.0) [2023-12-26 00:24:38,785][121949] Avg episode reward: [(0, '4918.148'), (1, '5436.830')] [2023-12-26 00:24:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000103360_26460160.pth... [2023-12-26 00:24:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000102304_26189824.pth [2023-12-26 00:24:38,807][123091] Updated weights for policy 0, policy_version 103959 (0.0011) [2023-12-26 00:24:38,865][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000103968_26615808.pth... [2023-12-26 00:24:38,870][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000102912_26345472.pth [2023-12-26 00:24:39,263][123090] Updated weights for policy 1, policy_version 103363 (0.0008) [2023-12-26 00:24:39,332][123090] Updated weights for policy 1, policy_version 103373 (0.0010) [2023-12-26 00:24:39,408][123090] Updated weights for policy 1, policy_version 103383 (0.0008) [2023-12-26 00:24:39,610][123091] Updated weights for policy 0, policy_version 103969 (0.0010) [2023-12-26 00:24:39,666][123091] Updated weights for policy 0, policy_version 103979 (0.0011) [2023-12-26 00:24:39,733][123091] Updated weights for policy 0, policy_version 103989 (0.0011) [2023-12-26 00:24:39,788][123091] Updated weights for policy 0, policy_version 103999 (0.0011) [2023-12-26 00:24:40,246][123090] Updated weights for policy 1, policy_version 103393 (0.0007) [2023-12-26 00:24:40,299][123090] Updated weights for policy 1, policy_version 103403 (0.0009) [2023-12-26 00:24:40,356][123090] Updated weights for policy 1, policy_version 103413 (0.0009) [2023-12-26 00:24:40,412][123090] Updated weights for policy 1, policy_version 103423 (0.0008) [2023-12-26 00:24:40,639][123091] Updated weights for policy 0, policy_version 104009 (0.0006) [2023-12-26 00:24:40,694][123091] Updated weights for policy 0, policy_version 104019 (0.0005) [2023-12-26 00:24:40,748][123091] Updated weights for policy 0, policy_version 104029 (0.0005) [2023-12-26 00:24:41,205][123090] Updated weights for policy 1, policy_version 103433 (0.0008) [2023-12-26 00:24:41,275][123090] Updated weights for policy 1, policy_version 103443 (0.0008) [2023-12-26 00:24:41,337][123090] Updated weights for policy 1, policy_version 103453 (0.0009) [2023-12-26 00:24:41,444][123091] Updated weights for policy 0, policy_version 104039 (0.0009) [2023-12-26 00:24:41,511][123091] Updated weights for policy 0, policy_version 104049 (0.0011) [2023-12-26 00:24:41,574][123091] Updated weights for policy 0, policy_version 104059 (0.0011) [2023-12-26 00:24:42,148][123090] Updated weights for policy 1, policy_version 103463 (0.0007) [2023-12-26 00:24:42,204][123090] Updated weights for policy 1, policy_version 103473 (0.0005) [2023-12-26 00:24:42,269][123090] Updated weights for policy 1, policy_version 103483 (0.0006) [2023-12-26 00:24:42,431][123091] Updated weights for policy 0, policy_version 104069 (0.0011) [2023-12-26 00:24:42,491][123091] Updated weights for policy 0, policy_version 104079 (0.0011) [2023-12-26 00:24:42,556][123091] Updated weights for policy 0, policy_version 104089 (0.0011) [2023-12-26 00:24:43,022][123090] Updated weights for policy 1, policy_version 103493 (0.0008) [2023-12-26 00:24:43,078][123090] Updated weights for policy 1, policy_version 103503 (0.0009) [2023-12-26 00:24:43,142][123090] Updated weights for policy 1, policy_version 103513 (0.0008) [2023-12-26 00:24:43,393][123091] Updated weights for policy 0, policy_version 104099 (0.0011) [2023-12-26 00:24:43,456][123091] Updated weights for policy 0, policy_version 104109 (0.0011) [2023-12-26 00:24:43,519][123091] Updated weights for policy 0, policy_version 104119 (0.0011) [2023-12-26 00:24:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 53157888. Throughput: 0: 8861.1, 1: 8801.3. Samples: 53151500. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:24:43,784][121949] Avg episode reward: [(0, '4940.780'), (1, '5283.274')] [2023-12-26 00:24:43,980][123090] Updated weights for policy 1, policy_version 103523 (0.0009) [2023-12-26 00:24:44,040][123090] Updated weights for policy 1, policy_version 103533 (0.0009) [2023-12-26 00:24:44,104][123090] Updated weights for policy 1, policy_version 103543 (0.0009) [2023-12-26 00:24:44,269][123091] Updated weights for policy 0, policy_version 104129 (0.0010) [2023-12-26 00:24:44,331][123091] Updated weights for policy 0, policy_version 104139 (0.0010) [2023-12-26 00:24:44,394][123091] Updated weights for policy 0, policy_version 104149 (0.0010) [2023-12-26 00:24:44,443][123091] Updated weights for policy 0, policy_version 104159 (0.0010) [2023-12-26 00:24:44,893][123090] Updated weights for policy 1, policy_version 103553 (0.0010) [2023-12-26 00:24:44,962][123090] Updated weights for policy 1, policy_version 103563 (0.0006) [2023-12-26 00:24:45,022][123090] Updated weights for policy 1, policy_version 103573 (0.0006) [2023-12-26 00:24:45,097][123090] Updated weights for policy 1, policy_version 103583 (0.0006) [2023-12-26 00:24:45,292][123091] Updated weights for policy 0, policy_version 104169 (0.0006) [2023-12-26 00:24:45,363][123091] Updated weights for policy 0, policy_version 104179 (0.0006) [2023-12-26 00:24:45,437][123091] Updated weights for policy 0, policy_version 104189 (0.0006) [2023-12-26 00:24:45,743][123090] Updated weights for policy 1, policy_version 103593 (0.0007) [2023-12-26 00:24:45,806][123090] Updated weights for policy 1, policy_version 103603 (0.0005) [2023-12-26 00:24:45,862][123090] Updated weights for policy 1, policy_version 103613 (0.0008) [2023-12-26 00:24:46,174][123091] Updated weights for policy 0, policy_version 104199 (0.0007) [2023-12-26 00:24:46,245][123091] Updated weights for policy 0, policy_version 104209 (0.0005) [2023-12-26 00:24:46,320][123091] Updated weights for policy 0, policy_version 104219 (0.0005) [2023-12-26 00:24:46,568][123090] Updated weights for policy 1, policy_version 103623 (0.0010) [2023-12-26 00:24:46,619][123090] Updated weights for policy 1, policy_version 103633 (0.0010) [2023-12-26 00:24:46,671][123090] Updated weights for policy 1, policy_version 103643 (0.0009) [2023-12-26 00:24:46,969][123091] Updated weights for policy 0, policy_version 104229 (0.0005) [2023-12-26 00:24:47,027][123091] Updated weights for policy 0, policy_version 104239 (0.0005) [2023-12-26 00:24:47,081][123091] Updated weights for policy 0, policy_version 104249 (0.0005) [2023-12-26 00:24:47,447][123090] Updated weights for policy 1, policy_version 103653 (0.0007) [2023-12-26 00:24:47,512][123090] Updated weights for policy 1, policy_version 103663 (0.0007) [2023-12-26 00:24:47,580][123090] Updated weights for policy 1, policy_version 103673 (0.0007) [2023-12-26 00:24:47,757][123091] Updated weights for policy 0, policy_version 104259 (0.0005) [2023-12-26 00:24:47,815][123091] Updated weights for policy 0, policy_version 104269 (0.0006) [2023-12-26 00:24:47,871][123091] Updated weights for policy 0, policy_version 104279 (0.0005) [2023-12-26 00:24:48,281][123090] Updated weights for policy 1, policy_version 103683 (0.0007) [2023-12-26 00:24:48,355][123090] Updated weights for policy 1, policy_version 103693 (0.0011) [2023-12-26 00:24:48,415][123090] Updated weights for policy 1, policy_version 103703 (0.0011) [2023-12-26 00:24:48,490][123091] Updated weights for policy 0, policy_version 104289 (0.0005) [2023-12-26 00:24:48,548][123091] Updated weights for policy 0, policy_version 104299 (0.0006) [2023-12-26 00:24:48,606][123091] Updated weights for policy 0, policy_version 104309 (0.0010) [2023-12-26 00:24:48,664][123091] Updated weights for policy 0, policy_version 104319 (0.0011) [2023-12-26 00:24:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 53256192. Throughput: 0: 9024.8, 1: 8851.0. Samples: 53263780. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:24:48,784][121949] Avg episode reward: [(0, '4937.261'), (1, '5327.159')] [2023-12-26 00:24:49,192][123090] Updated weights for policy 1, policy_version 103713 (0.0010) [2023-12-26 00:24:49,266][123090] Updated weights for policy 1, policy_version 103723 (0.0007) [2023-12-26 00:24:49,336][123090] Updated weights for policy 1, policy_version 103733 (0.0008) [2023-12-26 00:24:49,407][123090] Updated weights for policy 1, policy_version 103743 (0.0011) [2023-12-26 00:24:49,453][123091] Updated weights for policy 0, policy_version 104329 (0.0009) [2023-12-26 00:24:49,515][123091] Updated weights for policy 0, policy_version 104339 (0.0011) [2023-12-26 00:24:49,577][123091] Updated weights for policy 0, policy_version 104349 (0.0010) [2023-12-26 00:24:50,231][123090] Updated weights for policy 1, policy_version 103753 (0.0006) [2023-12-26 00:24:50,296][123090] Updated weights for policy 1, policy_version 103763 (0.0006) [2023-12-26 00:24:50,358][123090] Updated weights for policy 1, policy_version 103773 (0.0005) [2023-12-26 00:24:50,410][123091] Updated weights for policy 0, policy_version 104359 (0.0008) [2023-12-26 00:24:50,460][123091] Updated weights for policy 0, policy_version 104369 (0.0006) [2023-12-26 00:24:50,523][123091] Updated weights for policy 0, policy_version 104379 (0.0006) [2023-12-26 00:24:51,121][123090] Updated weights for policy 1, policy_version 103783 (0.0009) [2023-12-26 00:24:51,192][123090] Updated weights for policy 1, policy_version 103793 (0.0008) [2023-12-26 00:24:51,262][123090] Updated weights for policy 1, policy_version 103803 (0.0007) [2023-12-26 00:24:51,349][123091] Updated weights for policy 0, policy_version 104389 (0.0009) [2023-12-26 00:24:51,419][123091] Updated weights for policy 0, policy_version 104399 (0.0010) [2023-12-26 00:24:51,488][123091] Updated weights for policy 0, policy_version 104409 (0.0011) [2023-12-26 00:24:52,169][123090] Updated weights for policy 1, policy_version 103813 (0.0009) [2023-12-26 00:24:52,223][123090] Updated weights for policy 1, policy_version 103824 (0.0010) [2023-12-26 00:24:52,265][123091] Updated weights for policy 0, policy_version 104419 (0.0010) [2023-12-26 00:24:52,281][123090] Updated weights for policy 1, policy_version 103834 (0.0009) [2023-12-26 00:24:52,328][123091] Updated weights for policy 0, policy_version 104429 (0.0008) [2023-12-26 00:24:52,401][123091] Updated weights for policy 0, policy_version 104439 (0.0009) [2023-12-26 00:24:53,114][123090] Updated weights for policy 1, policy_version 103844 (0.0008) [2023-12-26 00:24:53,170][123090] Updated weights for policy 1, policy_version 103854 (0.0009) [2023-12-26 00:24:53,233][123090] Updated weights for policy 1, policy_version 103864 (0.0010) [2023-12-26 00:24:53,266][123091] Updated weights for policy 0, policy_version 104449 (0.0009) [2023-12-26 00:24:53,323][123091] Updated weights for policy 0, policy_version 104459 (0.0009) [2023-12-26 00:24:53,377][123091] Updated weights for policy 0, policy_version 104469 (0.0010) [2023-12-26 00:24:53,435][123091] Updated weights for policy 0, policy_version 104479 (0.0009) [2023-12-26 00:24:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 53338112. Throughput: 0: 8920.5, 1: 8898.0. Samples: 53314756. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:24:53,785][121949] Avg episode reward: [(0, '5041.235'), (1, '5389.928')] [2023-12-26 00:24:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000103872_26591232.pth... [2023-12-26 00:24:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000104480_26746880.pth... [2023-12-26 00:24:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000103424_26476544.pth [2023-12-26 00:24:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000102848_26329088.pth [2023-12-26 00:24:53,962][123090] Updated weights for policy 1, policy_version 103874 (0.0009) [2023-12-26 00:24:54,035][123090] Updated weights for policy 1, policy_version 103884 (0.0007) [2023-12-26 00:24:54,087][123090] Updated weights for policy 1, policy_version 103894 (0.0009) [2023-12-26 00:24:54,147][123090] Updated weights for policy 1, policy_version 103904 (0.0009) [2023-12-26 00:24:54,166][123091] Updated weights for policy 0, policy_version 104489 (0.0008) [2023-12-26 00:24:54,222][123091] Updated weights for policy 0, policy_version 104499 (0.0007) [2023-12-26 00:24:54,274][123091] Updated weights for policy 0, policy_version 104509 (0.0005) [2023-12-26 00:24:54,930][123091] Updated weights for policy 0, policy_version 104519 (0.0006) [2023-12-26 00:24:55,001][123091] Updated weights for policy 0, policy_version 104529 (0.0006) [2023-12-26 00:24:55,044][123090] Updated weights for policy 1, policy_version 103914 (0.0008) [2023-12-26 00:24:55,064][123091] Updated weights for policy 0, policy_version 104539 (0.0011) [2023-12-26 00:24:55,094][123090] Updated weights for policy 1, policy_version 103924 (0.0007) [2023-12-26 00:24:55,150][123090] Updated weights for policy 1, policy_version 103934 (0.0008) [2023-12-26 00:24:55,745][123091] Updated weights for policy 0, policy_version 104549 (0.0008) [2023-12-26 00:24:55,794][123091] Updated weights for policy 0, policy_version 104559 (0.0005) [2023-12-26 00:24:55,842][123091] Updated weights for policy 0, policy_version 104569 (0.0005) [2023-12-26 00:24:55,937][123090] Updated weights for policy 1, policy_version 103944 (0.0010) [2023-12-26 00:24:56,003][123090] Updated weights for policy 1, policy_version 103954 (0.0009) [2023-12-26 00:24:56,064][123090] Updated weights for policy 1, policy_version 103964 (0.0010) [2023-12-26 00:24:56,521][123091] Updated weights for policy 0, policy_version 104579 (0.0007) [2023-12-26 00:24:56,568][123091] Updated weights for policy 0, policy_version 104589 (0.0011) [2023-12-26 00:24:56,618][123091] Updated weights for policy 0, policy_version 104599 (0.0010) [2023-12-26 00:24:56,822][123090] Updated weights for policy 1, policy_version 103974 (0.0008) [2023-12-26 00:24:56,870][123090] Updated weights for policy 1, policy_version 103984 (0.0005) [2023-12-26 00:24:56,919][123090] Updated weights for policy 1, policy_version 103994 (0.0005) [2023-12-26 00:24:57,454][123091] Updated weights for policy 0, policy_version 104609 (0.0010) [2023-12-26 00:24:57,515][123091] Updated weights for policy 0, policy_version 104619 (0.0009) [2023-12-26 00:24:57,565][123091] Updated weights for policy 0, policy_version 104629 (0.0010) [2023-12-26 00:24:57,582][123090] Updated weights for policy 1, policy_version 104004 (0.0006) [2023-12-26 00:24:57,609][123091] Updated weights for policy 0, policy_version 104639 (0.0010) [2023-12-26 00:24:57,634][123090] Updated weights for policy 1, policy_version 104014 (0.0005) [2023-12-26 00:24:57,682][123090] Updated weights for policy 1, policy_version 104024 (0.0005) [2023-12-26 00:24:58,422][123090] Updated weights for policy 1, policy_version 104034 (0.0006) [2023-12-26 00:24:58,478][123091] Updated weights for policy 0, policy_version 104649 (0.0008) [2023-12-26 00:24:58,492][123090] Updated weights for policy 1, policy_version 104044 (0.0008) [2023-12-26 00:24:58,555][123091] Updated weights for policy 0, policy_version 104660 (0.0008) [2023-12-26 00:24:58,558][123090] Updated weights for policy 1, policy_version 104054 (0.0007) [2023-12-26 00:24:58,632][123091] Updated weights for policy 0, policy_version 104670 (0.0007) [2023-12-26 00:24:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 53436416. Throughput: 0: 9042.5, 1: 8960.3. Samples: 53424984. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:24:58,784][121949] Avg episode reward: [(0, '4952.322'), (1, '5471.137')] [2023-12-26 00:24:59,428][123091] Updated weights for policy 0, policy_version 104680 (0.0007) [2023-12-26 00:24:59,481][123090] Updated weights for policy 1, policy_version 104065 (0.0010) [2023-12-26 00:24:59,487][123091] Updated weights for policy 0, policy_version 104690 (0.0007) [2023-12-26 00:24:59,533][123090] Updated weights for policy 1, policy_version 104075 (0.0008) [2023-12-26 00:24:59,541][123091] Updated weights for policy 0, policy_version 104700 (0.0008) [2023-12-26 00:24:59,591][123090] Updated weights for policy 1, policy_version 104085 (0.0007) [2023-12-26 00:24:59,644][123090] Updated weights for policy 1, policy_version 104095 (0.0007) [2023-12-26 00:25:00,364][123091] Updated weights for policy 0, policy_version 104710 (0.0009) [2023-12-26 00:25:00,424][123091] Updated weights for policy 0, policy_version 104720 (0.0009) [2023-12-26 00:25:00,435][123090] Updated weights for policy 1, policy_version 104105 (0.0008) [2023-12-26 00:25:00,486][123091] Updated weights for policy 0, policy_version 104730 (0.0008) [2023-12-26 00:25:00,497][123090] Updated weights for policy 1, policy_version 104115 (0.0009) [2023-12-26 00:25:00,553][123090] Updated weights for policy 1, policy_version 104125 (0.0009) [2023-12-26 00:25:01,310][123091] Updated weights for policy 0, policy_version 104740 (0.0009) [2023-12-26 00:25:01,364][123091] Updated weights for policy 0, policy_version 104750 (0.0006) [2023-12-26 00:25:01,422][123090] Updated weights for policy 1, policy_version 104135 (0.0009) [2023-12-26 00:25:01,427][123091] Updated weights for policy 0, policy_version 104760 (0.0008) [2023-12-26 00:25:01,478][123090] Updated weights for policy 1, policy_version 104145 (0.0008) [2023-12-26 00:25:01,538][123090] Updated weights for policy 1, policy_version 104155 (0.0009) [2023-12-26 00:25:02,301][123090] Updated weights for policy 1, policy_version 104165 (0.0008) [2023-12-26 00:25:02,323][123091] Updated weights for policy 0, policy_version 104770 (0.0007) [2023-12-26 00:25:02,365][123090] Updated weights for policy 1, policy_version 104175 (0.0009) [2023-12-26 00:25:02,403][123091] Updated weights for policy 0, policy_version 104780 (0.0008) [2023-12-26 00:25:02,438][123090] Updated weights for policy 1, policy_version 104185 (0.0007) [2023-12-26 00:25:02,469][123091] Updated weights for policy 0, policy_version 104790 (0.0010) [2023-12-26 00:25:02,529][123091] Updated weights for policy 0, policy_version 104800 (0.0009) [2023-12-26 00:25:03,144][123090] Updated weights for policy 1, policy_version 104195 (0.0008) [2023-12-26 00:25:03,210][123090] Updated weights for policy 1, policy_version 104205 (0.0008) [2023-12-26 00:25:03,228][123091] Updated weights for policy 0, policy_version 104810 (0.0005) [2023-12-26 00:25:03,278][123090] Updated weights for policy 1, policy_version 104215 (0.0007) [2023-12-26 00:25:03,284][123091] Updated weights for policy 0, policy_version 104820 (0.0005) [2023-12-26 00:25:03,331][123091] Updated weights for policy 0, policy_version 104830 (0.0005) [2023-12-26 00:25:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 53518336. Throughput: 0: 8979.4, 1: 8889.9. Samples: 53531272. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:03,785][121949] Avg episode reward: [(0, '4925.541'), (1, '5460.996')] [2023-12-26 00:25:03,959][123090] Updated weights for policy 1, policy_version 104225 (0.0005) [2023-12-26 00:25:03,987][123091] Updated weights for policy 0, policy_version 104840 (0.0008) [2023-12-26 00:25:04,023][123090] Updated weights for policy 1, policy_version 104235 (0.0005) [2023-12-26 00:25:04,055][123091] Updated weights for policy 0, policy_version 104850 (0.0009) [2023-12-26 00:25:04,088][123090] Updated weights for policy 1, policy_version 104245 (0.0005) [2023-12-26 00:25:04,121][123091] Updated weights for policy 0, policy_version 104860 (0.0010) [2023-12-26 00:25:04,156][123090] Updated weights for policy 1, policy_version 104255 (0.0006) [2023-12-26 00:25:04,859][123090] Updated weights for policy 1, policy_version 104265 (0.0008) [2023-12-26 00:25:04,923][123090] Updated weights for policy 1, policy_version 104275 (0.0009) [2023-12-26 00:25:04,985][123090] Updated weights for policy 1, policy_version 104285 (0.0008) [2023-12-26 00:25:05,007][123091] Updated weights for policy 0, policy_version 104870 (0.0009) [2023-12-26 00:25:05,063][123091] Updated weights for policy 0, policy_version 104880 (0.0009) [2023-12-26 00:25:05,118][123091] Updated weights for policy 0, policy_version 104890 (0.0009) [2023-12-26 00:25:05,823][123090] Updated weights for policy 1, policy_version 104295 (0.0007) [2023-12-26 00:25:05,884][123090] Updated weights for policy 1, policy_version 104305 (0.0008) [2023-12-26 00:25:05,940][123090] Updated weights for policy 1, policy_version 104315 (0.0009) [2023-12-26 00:25:05,947][123091] Updated weights for policy 0, policy_version 104900 (0.0008) [2023-12-26 00:25:06,008][123091] Updated weights for policy 0, policy_version 104910 (0.0009) [2023-12-26 00:25:06,066][123091] Updated weights for policy 0, policy_version 104920 (0.0010) [2023-12-26 00:25:06,678][123090] Updated weights for policy 1, policy_version 104325 (0.0009) [2023-12-26 00:25:06,738][123090] Updated weights for policy 1, policy_version 104335 (0.0010) [2023-12-26 00:25:06,800][123090] Updated weights for policy 1, policy_version 104345 (0.0009) [2023-12-26 00:25:06,944][123091] Updated weights for policy 0, policy_version 104930 (0.0010) [2023-12-26 00:25:07,012][123091] Updated weights for policy 0, policy_version 104940 (0.0010) [2023-12-26 00:25:07,069][123091] Updated weights for policy 0, policy_version 104950 (0.0009) [2023-12-26 00:25:07,128][123091] Updated weights for policy 0, policy_version 104960 (0.0010) [2023-12-26 00:25:07,619][123090] Updated weights for policy 1, policy_version 104355 (0.0009) [2023-12-26 00:25:07,687][123090] Updated weights for policy 1, policy_version 104365 (0.0008) [2023-12-26 00:25:07,747][123090] Updated weights for policy 1, policy_version 104375 (0.0007) [2023-12-26 00:25:07,934][123091] Updated weights for policy 0, policy_version 104970 (0.0009) [2023-12-26 00:25:07,987][123091] Updated weights for policy 0, policy_version 104981 (0.0009) [2023-12-26 00:25:08,040][123091] Updated weights for policy 0, policy_version 104992 (0.0010) [2023-12-26 00:25:08,328][123090] Updated weights for policy 1, policy_version 104385 (0.0006) [2023-12-26 00:25:08,392][123090] Updated weights for policy 1, policy_version 104395 (0.0009) [2023-12-26 00:25:08,467][123090] Updated weights for policy 1, policy_version 104405 (0.0009) [2023-12-26 00:25:08,539][123090] Updated weights for policy 1, policy_version 104415 (0.0010) [2023-12-26 00:25:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 53608448. Throughput: 0: 8991.4, 1: 8941.4. Samples: 53584488. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:08,785][121949] Avg episode reward: [(0, '4835.959'), (1, '5374.004')] [2023-12-26 00:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000104992_26877952.pth... [2023-12-26 00:25:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000104416_26730496.pth... [2023-12-26 00:25:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000103360_26460160.pth [2023-12-26 00:25:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000103968_26615808.pth [2023-12-26 00:25:08,940][123091] Updated weights for policy 0, policy_version 105002 (0.0010) [2023-12-26 00:25:09,008][123091] Updated weights for policy 0, policy_version 105012 (0.0009) [2023-12-26 00:25:09,073][123091] Updated weights for policy 0, policy_version 105022 (0.0010) [2023-12-26 00:25:09,308][123090] Updated weights for policy 1, policy_version 104425 (0.0010) [2023-12-26 00:25:09,376][123090] Updated weights for policy 1, policy_version 104435 (0.0009) [2023-12-26 00:25:09,450][123090] Updated weights for policy 1, policy_version 104445 (0.0009) [2023-12-26 00:25:09,918][123091] Updated weights for policy 0, policy_version 105032 (0.0009) [2023-12-26 00:25:09,984][123091] Updated weights for policy 0, policy_version 105042 (0.0009) [2023-12-26 00:25:10,041][123091] Updated weights for policy 0, policy_version 105052 (0.0009) [2023-12-26 00:25:10,297][123090] Updated weights for policy 1, policy_version 104455 (0.0010) [2023-12-26 00:25:10,352][123090] Updated weights for policy 1, policy_version 104465 (0.0009) [2023-12-26 00:25:10,421][123090] Updated weights for policy 1, policy_version 104475 (0.0005) [2023-12-26 00:25:10,937][123091] Updated weights for policy 0, policy_version 105062 (0.0009) [2023-12-26 00:25:10,990][123091] Updated weights for policy 0, policy_version 105072 (0.0010) [2023-12-26 00:25:11,057][123091] Updated weights for policy 0, policy_version 105082 (0.0010) [2023-12-26 00:25:11,101][123090] Updated weights for policy 1, policy_version 104485 (0.0007) [2023-12-26 00:25:11,174][123090] Updated weights for policy 1, policy_version 104495 (0.0008) [2023-12-26 00:25:11,249][123090] Updated weights for policy 1, policy_version 104505 (0.0009) [2023-12-26 00:25:11,921][123091] Updated weights for policy 0, policy_version 105092 (0.0007) [2023-12-26 00:25:11,983][123091] Updated weights for policy 0, policy_version 105102 (0.0006) [2023-12-26 00:25:12,044][123091] Updated weights for policy 0, policy_version 105112 (0.0008) [2023-12-26 00:25:12,106][123090] Updated weights for policy 1, policy_version 104515 (0.0008) [2023-12-26 00:25:12,168][123090] Updated weights for policy 1, policy_version 104525 (0.0005) [2023-12-26 00:25:12,227][123090] Updated weights for policy 1, policy_version 104535 (0.0005) [2023-12-26 00:25:12,845][123091] Updated weights for policy 0, policy_version 105122 (0.0009) [2023-12-26 00:25:12,896][123091] Updated weights for policy 0, policy_version 105132 (0.0010) [2023-12-26 00:25:12,949][123091] Updated weights for policy 0, policy_version 105142 (0.0010) [2023-12-26 00:25:13,005][123091] Updated weights for policy 0, policy_version 105152 (0.0009) [2023-12-26 00:25:13,009][123090] Updated weights for policy 1, policy_version 104545 (0.0006) [2023-12-26 00:25:13,061][123090] Updated weights for policy 1, policy_version 104555 (0.0009) [2023-12-26 00:25:13,123][123090] Updated weights for policy 1, policy_version 104565 (0.0008) [2023-12-26 00:25:13,182][123090] Updated weights for policy 1, policy_version 104575 (0.0009) [2023-12-26 00:25:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 53690368. Throughput: 0: 8905.1, 1: 8898.8. Samples: 53687708. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:13,785][121949] Avg episode reward: [(0, '4774.995'), (1, '5284.832')] [2023-12-26 00:25:13,911][123090] Updated weights for policy 1, policy_version 104585 (0.0007) [2023-12-26 00:25:13,933][123091] Updated weights for policy 0, policy_version 105162 (0.0009) [2023-12-26 00:25:13,971][123090] Updated weights for policy 1, policy_version 104595 (0.0005) [2023-12-26 00:25:13,994][123091] Updated weights for policy 0, policy_version 105172 (0.0008) [2023-12-26 00:25:14,036][123090] Updated weights for policy 1, policy_version 104605 (0.0005) [2023-12-26 00:25:14,055][123091] Updated weights for policy 0, policy_version 105182 (0.0009) [2023-12-26 00:25:14,799][123091] Updated weights for policy 0, policy_version 105192 (0.0009) [2023-12-26 00:25:14,812][123090] Updated weights for policy 1, policy_version 104615 (0.0008) [2023-12-26 00:25:14,861][123091] Updated weights for policy 0, policy_version 105202 (0.0007) [2023-12-26 00:25:14,875][123090] Updated weights for policy 1, policy_version 104625 (0.0010) [2023-12-26 00:25:14,930][123091] Updated weights for policy 0, policy_version 105212 (0.0009) [2023-12-26 00:25:14,939][123090] Updated weights for policy 1, policy_version 104635 (0.0011) [2023-12-26 00:25:15,705][123090] Updated weights for policy 1, policy_version 104645 (0.0008) [2023-12-26 00:25:15,723][123091] Updated weights for policy 0, policy_version 105222 (0.0009) [2023-12-26 00:25:15,766][123090] Updated weights for policy 1, policy_version 104655 (0.0006) [2023-12-26 00:25:15,782][123091] Updated weights for policy 0, policy_version 105232 (0.0009) [2023-12-26 00:25:15,828][123090] Updated weights for policy 1, policy_version 104665 (0.0006) [2023-12-26 00:25:15,850][123091] Updated weights for policy 0, policy_version 105242 (0.0009) [2023-12-26 00:25:16,563][123090] Updated weights for policy 1, policy_version 104675 (0.0007) [2023-12-26 00:25:16,597][123091] Updated weights for policy 0, policy_version 105252 (0.0010) [2023-12-26 00:25:16,635][123090] Updated weights for policy 1, policy_version 104685 (0.0006) [2023-12-26 00:25:16,656][123091] Updated weights for policy 0, policy_version 105262 (0.0010) [2023-12-26 00:25:16,693][123090] Updated weights for policy 1, policy_version 104695 (0.0008) [2023-12-26 00:25:16,705][123091] Updated weights for policy 0, policy_version 105272 (0.0010) [2023-12-26 00:25:17,425][123090] Updated weights for policy 1, policy_version 104705 (0.0009) [2023-12-26 00:25:17,480][123090] Updated weights for policy 1, policy_version 104715 (0.0010) [2023-12-26 00:25:17,534][123090] Updated weights for policy 1, policy_version 104725 (0.0010) [2023-12-26 00:25:17,543][123091] Updated weights for policy 0, policy_version 105282 (0.0010) [2023-12-26 00:25:17,593][123090] Updated weights for policy 1, policy_version 104735 (0.0010) [2023-12-26 00:25:17,601][123091] Updated weights for policy 0, policy_version 105292 (0.0010) [2023-12-26 00:25:17,666][123091] Updated weights for policy 0, policy_version 105302 (0.0010) [2023-12-26 00:25:17,728][123091] Updated weights for policy 0, policy_version 105312 (0.0010) [2023-12-26 00:25:18,363][123090] Updated weights for policy 1, policy_version 104745 (0.0006) [2023-12-26 00:25:18,433][123090] Updated weights for policy 1, policy_version 104755 (0.0006) [2023-12-26 00:25:18,437][123091] Updated weights for policy 0, policy_version 105322 (0.0008) [2023-12-26 00:25:18,493][123090] Updated weights for policy 1, policy_version 104765 (0.0005) [2023-12-26 00:25:18,503][123091] Updated weights for policy 0, policy_version 105332 (0.0008) [2023-12-26 00:25:18,573][123091] Updated weights for policy 0, policy_version 105342 (0.0008) [2023-12-26 00:25:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 53788672. Throughput: 0: 8855.2, 1: 8975.1. Samples: 53796288. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:18,785][121949] Avg episode reward: [(0, '4813.214'), (1, '5282.268')] [2023-12-26 00:25:19,198][123090] Updated weights for policy 1, policy_version 104775 (0.0006) [2023-12-26 00:25:19,279][123090] Updated weights for policy 1, policy_version 104785 (0.0006) [2023-12-26 00:25:19,345][123090] Updated weights for policy 1, policy_version 104795 (0.0011) [2023-12-26 00:25:19,424][123091] Updated weights for policy 0, policy_version 105352 (0.0009) [2023-12-26 00:25:19,489][123091] Updated weights for policy 0, policy_version 105362 (0.0009) [2023-12-26 00:25:19,549][123091] Updated weights for policy 0, policy_version 105372 (0.0009) [2023-12-26 00:25:20,160][123090] Updated weights for policy 1, policy_version 104805 (0.0011) [2023-12-26 00:25:20,222][123090] Updated weights for policy 1, policy_version 104815 (0.0006) [2023-12-26 00:25:20,291][123090] Updated weights for policy 1, policy_version 104825 (0.0005) [2023-12-26 00:25:20,405][123091] Updated weights for policy 0, policy_version 105382 (0.0009) [2023-12-26 00:25:20,466][123091] Updated weights for policy 0, policy_version 105392 (0.0010) [2023-12-26 00:25:20,532][123091] Updated weights for policy 0, policy_version 105403 (0.0009) [2023-12-26 00:25:21,083][123090] Updated weights for policy 1, policy_version 104835 (0.0007) [2023-12-26 00:25:21,155][123090] Updated weights for policy 1, policy_version 104845 (0.0010) [2023-12-26 00:25:21,216][123090] Updated weights for policy 1, policy_version 104855 (0.0009) [2023-12-26 00:25:21,410][123091] Updated weights for policy 0, policy_version 105413 (0.0009) [2023-12-26 00:25:21,464][123091] Updated weights for policy 0, policy_version 105423 (0.0010) [2023-12-26 00:25:21,524][123091] Updated weights for policy 0, policy_version 105433 (0.0009) [2023-12-26 00:25:22,088][123090] Updated weights for policy 1, policy_version 104865 (0.0010) [2023-12-26 00:25:22,151][123090] Updated weights for policy 1, policy_version 104875 (0.0010) [2023-12-26 00:25:22,206][123090] Updated weights for policy 1, policy_version 104885 (0.0009) [2023-12-26 00:25:22,273][123090] Updated weights for policy 1, policy_version 104895 (0.0009) [2023-12-26 00:25:22,466][123091] Updated weights for policy 0, policy_version 105443 (0.0009) [2023-12-26 00:25:22,541][123091] Updated weights for policy 0, policy_version 105453 (0.0010) [2023-12-26 00:25:22,615][123091] Updated weights for policy 0, policy_version 105463 (0.0008) [2023-12-26 00:25:23,121][123090] Updated weights for policy 1, policy_version 104905 (0.0010) [2023-12-26 00:25:23,187][123090] Updated weights for policy 1, policy_version 104915 (0.0010) [2023-12-26 00:25:23,242][123090] Updated weights for policy 1, policy_version 104925 (0.0009) [2023-12-26 00:25:23,435][123091] Updated weights for policy 0, policy_version 105473 (0.0010) [2023-12-26 00:25:23,488][123091] Updated weights for policy 0, policy_version 105483 (0.0009) [2023-12-26 00:25:23,546][123091] Updated weights for policy 0, policy_version 105493 (0.0009) [2023-12-26 00:25:23,609][123091] Updated weights for policy 0, policy_version 105503 (0.0009) [2023-12-26 00:25:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 53870592. Throughput: 0: 8799.1, 1: 8981.4. Samples: 53846892. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:23,785][121949] Avg episode reward: [(0, '4915.807'), (1, '5309.727')] [2023-12-26 00:25:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000104928_26861568.pth... [2023-12-26 00:25:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000105504_27009024.pth... [2023-12-26 00:25:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000103872_26591232.pth [2023-12-26 00:25:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000104480_26746880.pth [2023-12-26 00:25:24,019][123090] Updated weights for policy 1, policy_version 104935 (0.0010) [2023-12-26 00:25:24,078][123090] Updated weights for policy 1, policy_version 104945 (0.0010) [2023-12-26 00:25:24,140][123090] Updated weights for policy 1, policy_version 104955 (0.0007) [2023-12-26 00:25:24,496][123091] Updated weights for policy 0, policy_version 105513 (0.0010) [2023-12-26 00:25:24,555][123091] Updated weights for policy 0, policy_version 105523 (0.0010) [2023-12-26 00:25:24,614][123091] Updated weights for policy 0, policy_version 105533 (0.0009) [2023-12-26 00:25:24,860][123090] Updated weights for policy 1, policy_version 104965 (0.0006) [2023-12-26 00:25:24,920][123090] Updated weights for policy 1, policy_version 104975 (0.0005) [2023-12-26 00:25:24,988][123090] Updated weights for policy 1, policy_version 104985 (0.0006) [2023-12-26 00:25:25,389][123091] Updated weights for policy 0, policy_version 105543 (0.0006) [2023-12-26 00:25:25,452][123091] Updated weights for policy 0, policy_version 105553 (0.0005) [2023-12-26 00:25:25,518][123091] Updated weights for policy 0, policy_version 105563 (0.0005) [2023-12-26 00:25:25,580][123090] Updated weights for policy 1, policy_version 104995 (0.0006) [2023-12-26 00:25:25,637][123090] Updated weights for policy 1, policy_version 105005 (0.0005) [2023-12-26 00:25:25,694][123090] Updated weights for policy 1, policy_version 105015 (0.0005) [2023-12-26 00:25:26,213][123091] Updated weights for policy 0, policy_version 105573 (0.0007) [2023-12-26 00:25:26,277][123091] Updated weights for policy 0, policy_version 105584 (0.0011) [2023-12-26 00:25:26,339][123091] Updated weights for policy 0, policy_version 105594 (0.0010) [2023-12-26 00:25:26,349][123090] Updated weights for policy 1, policy_version 105025 (0.0005) [2023-12-26 00:25:26,404][123090] Updated weights for policy 1, policy_version 105035 (0.0005) [2023-12-26 00:25:26,461][123090] Updated weights for policy 1, policy_version 105045 (0.0008) [2023-12-26 00:25:26,512][123090] Updated weights for policy 1, policy_version 105055 (0.0010) [2023-12-26 00:25:27,147][123091] Updated weights for policy 0, policy_version 105604 (0.0009) [2023-12-26 00:25:27,208][123091] Updated weights for policy 0, policy_version 105614 (0.0009) [2023-12-26 00:25:27,242][123090] Updated weights for policy 1, policy_version 105065 (0.0008) [2023-12-26 00:25:27,261][123091] Updated weights for policy 0, policy_version 105624 (0.0008) [2023-12-26 00:25:27,302][123090] Updated weights for policy 1, policy_version 105075 (0.0008) [2023-12-26 00:25:27,365][123090] Updated weights for policy 1, policy_version 105085 (0.0009) [2023-12-26 00:25:28,111][123091] Updated weights for policy 0, policy_version 105634 (0.0007) [2023-12-26 00:25:28,143][123090] Updated weights for policy 1, policy_version 105095 (0.0009) [2023-12-26 00:25:28,167][123091] Updated weights for policy 0, policy_version 105644 (0.0008) [2023-12-26 00:25:28,209][123090] Updated weights for policy 1, policy_version 105105 (0.0007) [2023-12-26 00:25:28,231][123091] Updated weights for policy 0, policy_version 105654 (0.0009) [2023-12-26 00:25:28,263][123090] Updated weights for policy 1, policy_version 105115 (0.0005) [2023-12-26 00:25:28,293][123091] Updated weights for policy 0, policy_version 105664 (0.0009) [2023-12-26 00:25:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 53960704. Throughput: 0: 8798.9, 1: 9057.2. Samples: 53955028. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:28,785][121949] Avg episode reward: [(0, '4983.344'), (1, '5298.921')] [2023-12-26 00:25:28,930][123090] Updated weights for policy 1, policy_version 105125 (0.0008) [2023-12-26 00:25:28,982][123090] Updated weights for policy 1, policy_version 105135 (0.0009) [2023-12-26 00:25:29,048][123090] Updated weights for policy 1, policy_version 105145 (0.0009) [2023-12-26 00:25:29,140][123091] Updated weights for policy 0, policy_version 105674 (0.0008) [2023-12-26 00:25:29,189][123091] Updated weights for policy 0, policy_version 105684 (0.0009) [2023-12-26 00:25:29,257][123091] Updated weights for policy 0, policy_version 105694 (0.0009) [2023-12-26 00:25:29,897][123090] Updated weights for policy 1, policy_version 105155 (0.0010) [2023-12-26 00:25:29,964][123090] Updated weights for policy 1, policy_version 105165 (0.0010) [2023-12-26 00:25:30,014][123090] Updated weights for policy 1, policy_version 105175 (0.0009) [2023-12-26 00:25:30,095][123091] Updated weights for policy 0, policy_version 105704 (0.0007) [2023-12-26 00:25:30,149][123091] Updated weights for policy 0, policy_version 105714 (0.0010) [2023-12-26 00:25:30,196][123091] Updated weights for policy 0, policy_version 105724 (0.0008) [2023-12-26 00:25:30,837][123090] Updated weights for policy 1, policy_version 105185 (0.0009) [2023-12-26 00:25:30,903][123090] Updated weights for policy 1, policy_version 105195 (0.0008) [2023-12-26 00:25:30,957][123090] Updated weights for policy 1, policy_version 105205 (0.0005) [2023-12-26 00:25:31,011][123090] Updated weights for policy 1, policy_version 105215 (0.0006) [2023-12-26 00:25:31,052][123091] Updated weights for policy 0, policy_version 105734 (0.0008) [2023-12-26 00:25:31,118][123091] Updated weights for policy 0, policy_version 105744 (0.0009) [2023-12-26 00:25:31,183][123091] Updated weights for policy 0, policy_version 105754 (0.0010) [2023-12-26 00:25:31,812][123090] Updated weights for policy 1, policy_version 105225 (0.0009) [2023-12-26 00:25:31,869][123090] Updated weights for policy 1, policy_version 105235 (0.0009) [2023-12-26 00:25:31,917][123090] Updated weights for policy 1, policy_version 105245 (0.0009) [2023-12-26 00:25:32,011][123091] Updated weights for policy 0, policy_version 105764 (0.0009) [2023-12-26 00:25:32,067][123091] Updated weights for policy 0, policy_version 105774 (0.0009) [2023-12-26 00:25:32,128][123091] Updated weights for policy 0, policy_version 105784 (0.0009) [2023-12-26 00:25:32,777][123090] Updated weights for policy 1, policy_version 105255 (0.0009) [2023-12-26 00:25:32,836][123090] Updated weights for policy 1, policy_version 105265 (0.0009) [2023-12-26 00:25:32,895][123090] Updated weights for policy 1, policy_version 105275 (0.0010) [2023-12-26 00:25:32,965][123091] Updated weights for policy 0, policy_version 105794 (0.0010) [2023-12-26 00:25:33,020][123091] Updated weights for policy 0, policy_version 105804 (0.0011) [2023-12-26 00:25:33,068][123091] Updated weights for policy 0, policy_version 105814 (0.0010) [2023-12-26 00:25:33,128][123091] Updated weights for policy 0, policy_version 105824 (0.0011) [2023-12-26 00:25:33,734][123090] Updated weights for policy 1, policy_version 105285 (0.0009) [2023-12-26 00:25:33,782][123090] Updated weights for policy 1, policy_version 105295 (0.0009) [2023-12-26 00:25:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 54042624. Throughput: 0: 8640.2, 1: 9034.0. Samples: 54059120. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:33,785][121949] Avg episode reward: [(0, '4887.063'), (1, '5531.460')] [2023-12-26 00:25:33,829][123090] Updated weights for policy 1, policy_version 105305 (0.0008) [2023-12-26 00:25:33,970][123091] Updated weights for policy 0, policy_version 105834 (0.0009) [2023-12-26 00:25:34,032][123091] Updated weights for policy 0, policy_version 105844 (0.0005) [2023-12-26 00:25:34,095][123091] Updated weights for policy 0, policy_version 105854 (0.0005) [2023-12-26 00:25:34,575][123090] Updated weights for policy 1, policy_version 105315 (0.0009) [2023-12-26 00:25:34,633][123090] Updated weights for policy 1, policy_version 105325 (0.0005) [2023-12-26 00:25:34,691][123090] Updated weights for policy 1, policy_version 105335 (0.0005) [2023-12-26 00:25:34,933][123091] Updated weights for policy 0, policy_version 105864 (0.0009) [2023-12-26 00:25:34,991][123091] Updated weights for policy 0, policy_version 105874 (0.0009) [2023-12-26 00:25:35,050][123091] Updated weights for policy 0, policy_version 105884 (0.0010) [2023-12-26 00:25:35,441][123090] Updated weights for policy 1, policy_version 105345 (0.0007) [2023-12-26 00:25:35,509][123090] Updated weights for policy 1, policy_version 105355 (0.0007) [2023-12-26 00:25:35,558][123090] Updated weights for policy 1, policy_version 105365 (0.0005) [2023-12-26 00:25:35,608][123090] Updated weights for policy 1, policy_version 105375 (0.0005) [2023-12-26 00:25:35,894][123091] Updated weights for policy 0, policy_version 105894 (0.0010) [2023-12-26 00:25:35,949][123091] Updated weights for policy 0, policy_version 105904 (0.0010) [2023-12-26 00:25:35,992][123091] Updated weights for policy 0, policy_version 105914 (0.0010) [2023-12-26 00:25:36,318][123090] Updated weights for policy 1, policy_version 105385 (0.0009) [2023-12-26 00:25:36,382][123090] Updated weights for policy 1, policy_version 105395 (0.0010) [2023-12-26 00:25:36,452][123090] Updated weights for policy 1, policy_version 105405 (0.0010) [2023-12-26 00:25:36,744][123091] Updated weights for policy 0, policy_version 105924 (0.0010) [2023-12-26 00:25:36,807][123091] Updated weights for policy 0, policy_version 105934 (0.0010) [2023-12-26 00:25:36,869][123091] Updated weights for policy 0, policy_version 105944 (0.0011) [2023-12-26 00:25:37,347][123090] Updated weights for policy 1, policy_version 105415 (0.0010) [2023-12-26 00:25:37,408][123090] Updated weights for policy 1, policy_version 105425 (0.0005) [2023-12-26 00:25:37,464][123090] Updated weights for policy 1, policy_version 105435 (0.0005) [2023-12-26 00:25:37,601][123091] Updated weights for policy 0, policy_version 105954 (0.0010) [2023-12-26 00:25:37,652][123091] Updated weights for policy 0, policy_version 105964 (0.0005) [2023-12-26 00:25:37,712][123091] Updated weights for policy 0, policy_version 105974 (0.0009) [2023-12-26 00:25:37,765][123091] Updated weights for policy 0, policy_version 105984 (0.0007) [2023-12-26 00:25:38,167][123090] Updated weights for policy 1, policy_version 105445 (0.0007) [2023-12-26 00:25:38,237][123090] Updated weights for policy 1, policy_version 105455 (0.0010) [2023-12-26 00:25:38,309][123090] Updated weights for policy 1, policy_version 105465 (0.0006) [2023-12-26 00:25:38,576][123091] Updated weights for policy 0, policy_version 105994 (0.0011) [2023-12-26 00:25:38,635][123091] Updated weights for policy 0, policy_version 106004 (0.0011) [2023-12-26 00:25:38,683][123091] Updated weights for policy 0, policy_version 106014 (0.0011) [2023-12-26 00:25:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 54140928. Throughput: 0: 8661.7, 1: 9079.1. Samples: 54113092. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 00:25:38,785][121949] Avg episode reward: [(0, '4833.738'), (1, '5683.523')] [2023-12-26 00:25:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000106016_27140096.pth... [2023-12-26 00:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000105472_27000832.pth... [2023-12-26 00:25:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000104992_26877952.pth [2023-12-26 00:25:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000104416_26730496.pth [2023-12-26 00:25:39,045][123090] Updated weights for policy 1, policy_version 105475 (0.0007) [2023-12-26 00:25:39,115][123090] Updated weights for policy 1, policy_version 105485 (0.0008) [2023-12-26 00:25:39,185][123090] Updated weights for policy 1, policy_version 105495 (0.0007) [2023-12-26 00:25:39,501][123091] Updated weights for policy 0, policy_version 106024 (0.0010) [2023-12-26 00:25:39,575][123091] Updated weights for policy 0, policy_version 106034 (0.0007) [2023-12-26 00:25:39,649][123091] Updated weights for policy 0, policy_version 106044 (0.0009) [2023-12-26 00:25:39,919][123090] Updated weights for policy 1, policy_version 105505 (0.0008) [2023-12-26 00:25:39,975][123090] Updated weights for policy 1, policy_version 105515 (0.0008) [2023-12-26 00:25:40,031][123090] Updated weights for policy 1, policy_version 105525 (0.0008) [2023-12-26 00:25:40,090][123090] Updated weights for policy 1, policy_version 105535 (0.0008) [2023-12-26 00:25:40,530][123091] Updated weights for policy 0, policy_version 106054 (0.0009) [2023-12-26 00:25:40,590][123091] Updated weights for policy 0, policy_version 106064 (0.0009) [2023-12-26 00:25:40,639][123091] Updated weights for policy 0, policy_version 106074 (0.0009) [2023-12-26 00:25:40,889][123090] Updated weights for policy 1, policy_version 105545 (0.0010) [2023-12-26 00:25:40,947][123090] Updated weights for policy 1, policy_version 105555 (0.0009) [2023-12-26 00:25:41,008][123090] Updated weights for policy 1, policy_version 105565 (0.0009) [2023-12-26 00:25:41,515][123091] Updated weights for policy 0, policy_version 106084 (0.0008) [2023-12-26 00:25:41,567][123091] Updated weights for policy 0, policy_version 106094 (0.0005) [2023-12-26 00:25:41,627][123091] Updated weights for policy 0, policy_version 106104 (0.0006) [2023-12-26 00:25:41,882][123090] Updated weights for policy 1, policy_version 105575 (0.0008) [2023-12-26 00:25:41,951][123090] Updated weights for policy 1, policy_version 105585 (0.0008) [2023-12-26 00:25:42,011][123090] Updated weights for policy 1, policy_version 105595 (0.0010) [2023-12-26 00:25:42,337][123091] Updated weights for policy 0, policy_version 106114 (0.0008) [2023-12-26 00:25:42,402][123091] Updated weights for policy 0, policy_version 106124 (0.0009) [2023-12-26 00:25:42,457][123091] Updated weights for policy 0, policy_version 106134 (0.0008) [2023-12-26 00:25:42,521][123091] Updated weights for policy 0, policy_version 106144 (0.0009) [2023-12-26 00:25:42,835][123090] Updated weights for policy 1, policy_version 105605 (0.0010) [2023-12-26 00:25:42,886][123090] Updated weights for policy 1, policy_version 105615 (0.0010) [2023-12-26 00:25:42,943][123090] Updated weights for policy 1, policy_version 105625 (0.0010) [2023-12-26 00:25:43,363][123091] Updated weights for policy 0, policy_version 106154 (0.0009) [2023-12-26 00:25:43,417][123091] Updated weights for policy 0, policy_version 106165 (0.0010) [2023-12-26 00:25:43,470][123091] Updated weights for policy 0, policy_version 106176 (0.0010) [2023-12-26 00:25:43,620][123090] Updated weights for policy 1, policy_version 105635 (0.0009) [2023-12-26 00:25:43,666][123090] Updated weights for policy 1, policy_version 105645 (0.0005) [2023-12-26 00:25:43,713][123090] Updated weights for policy 1, policy_version 105655 (0.0005) [2023-12-26 00:25:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 54231040. Throughput: 0: 8571.0, 1: 9068.7. Samples: 54218772. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:25:43,785][121949] Avg episode reward: [(0, '4858.359'), (1, '5684.834')] [2023-12-26 00:25:44,253][123091] Updated weights for policy 0, policy_version 106186 (0.0006) [2023-12-26 00:25:44,309][123091] Updated weights for policy 0, policy_version 106196 (0.0008) [2023-12-26 00:25:44,356][123091] Updated weights for policy 0, policy_version 106206 (0.0007) [2023-12-26 00:25:44,494][123090] Updated weights for policy 1, policy_version 105665 (0.0008) [2023-12-26 00:25:44,553][123090] Updated weights for policy 1, policy_version 105675 (0.0010) [2023-12-26 00:25:44,607][123090] Updated weights for policy 1, policy_version 105685 (0.0010) [2023-12-26 00:25:44,662][123090] Updated weights for policy 1, policy_version 105695 (0.0010) [2023-12-26 00:25:45,146][123091] Updated weights for policy 0, policy_version 106216 (0.0005) [2023-12-26 00:25:45,201][123091] Updated weights for policy 0, policy_version 106226 (0.0006) [2023-12-26 00:25:45,255][123091] Updated weights for policy 0, policy_version 106236 (0.0006) [2023-12-26 00:25:45,485][123090] Updated weights for policy 1, policy_version 105705 (0.0010) [2023-12-26 00:25:45,546][123090] Updated weights for policy 1, policy_version 105715 (0.0011) [2023-12-26 00:25:45,614][123090] Updated weights for policy 1, policy_version 105725 (0.0011) [2023-12-26 00:25:45,870][123091] Updated weights for policy 0, policy_version 106246 (0.0007) [2023-12-26 00:25:45,927][123091] Updated weights for policy 0, policy_version 106256 (0.0005) [2023-12-26 00:25:45,999][123091] Updated weights for policy 0, policy_version 106266 (0.0005) [2023-12-26 00:25:46,347][123090] Updated weights for policy 1, policy_version 105735 (0.0007) [2023-12-26 00:25:46,408][123090] Updated weights for policy 1, policy_version 105745 (0.0005) [2023-12-26 00:25:46,479][123090] Updated weights for policy 1, policy_version 105755 (0.0005) [2023-12-26 00:25:46,667][123091] Updated weights for policy 0, policy_version 106276 (0.0005) [2023-12-26 00:25:46,716][123091] Updated weights for policy 0, policy_version 106286 (0.0005) [2023-12-26 00:25:46,777][123091] Updated weights for policy 0, policy_version 106296 (0.0006) [2023-12-26 00:25:47,085][123090] Updated weights for policy 1, policy_version 105765 (0.0005) [2023-12-26 00:25:47,145][123090] Updated weights for policy 1, policy_version 105775 (0.0005) [2023-12-26 00:25:47,203][123090] Updated weights for policy 1, policy_version 105785 (0.0005) [2023-12-26 00:25:47,543][123091] Updated weights for policy 0, policy_version 106306 (0.0006) [2023-12-26 00:25:47,595][123091] Updated weights for policy 0, policy_version 106316 (0.0009) [2023-12-26 00:25:47,648][123091] Updated weights for policy 0, policy_version 106326 (0.0009) [2023-12-26 00:25:47,707][123091] Updated weights for policy 0, policy_version 106336 (0.0010) [2023-12-26 00:25:47,986][123090] Updated weights for policy 1, policy_version 105795 (0.0008) [2023-12-26 00:25:48,068][123090] Updated weights for policy 1, policy_version 105805 (0.0009) [2023-12-26 00:25:48,121][123090] Updated weights for policy 1, policy_version 105815 (0.0009) [2023-12-26 00:25:48,525][123091] Updated weights for policy 0, policy_version 106346 (0.0010) [2023-12-26 00:25:48,582][123091] Updated weights for policy 0, policy_version 106356 (0.0010) [2023-12-26 00:25:48,638][123091] Updated weights for policy 0, policy_version 106366 (0.0010) [2023-12-26 00:25:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 54321152. Throughput: 0: 8643.5, 1: 9121.3. Samples: 54330688. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:25:48,785][121949] Avg episode reward: [(0, '4885.426'), (1, '5637.364')] [2023-12-26 00:25:48,869][123090] Updated weights for policy 1, policy_version 105826 (0.0009) [2023-12-26 00:25:48,943][123090] Updated weights for policy 1, policy_version 105836 (0.0005) [2023-12-26 00:25:49,018][123090] Updated weights for policy 1, policy_version 105846 (0.0005) [2023-12-26 00:25:49,091][123090] Updated weights for policy 1, policy_version 105856 (0.0005) [2023-12-26 00:25:49,519][123091] Updated weights for policy 0, policy_version 106376 (0.0010) [2023-12-26 00:25:49,588][123091] Updated weights for policy 0, policy_version 106386 (0.0009) [2023-12-26 00:25:49,651][123091] Updated weights for policy 0, policy_version 106396 (0.0009) [2023-12-26 00:25:49,718][123090] Updated weights for policy 1, policy_version 105866 (0.0011) [2023-12-26 00:25:49,781][123090] Updated weights for policy 1, policy_version 105876 (0.0010) [2023-12-26 00:25:49,853][123090] Updated weights for policy 1, policy_version 105886 (0.0010) [2023-12-26 00:25:50,469][123091] Updated weights for policy 0, policy_version 106406 (0.0007) [2023-12-26 00:25:50,533][123091] Updated weights for policy 0, policy_version 106416 (0.0008) [2023-12-26 00:25:50,604][123091] Updated weights for policy 0, policy_version 106426 (0.0009) [2023-12-26 00:25:50,643][123090] Updated weights for policy 1, policy_version 105896 (0.0007) [2023-12-26 00:25:50,709][123090] Updated weights for policy 1, policy_version 105906 (0.0005) [2023-12-26 00:25:50,777][123090] Updated weights for policy 1, policy_version 105916 (0.0005) [2023-12-26 00:25:51,430][123091] Updated weights for policy 0, policy_version 106436 (0.0010) [2023-12-26 00:25:51,487][123091] Updated weights for policy 0, policy_version 106446 (0.0009) [2023-12-26 00:25:51,539][123091] Updated weights for policy 0, policy_version 106456 (0.0009) [2023-12-26 00:25:51,544][123090] Updated weights for policy 1, policy_version 105926 (0.0008) [2023-12-26 00:25:51,607][123090] Updated weights for policy 1, policy_version 105936 (0.0009) [2023-12-26 00:25:51,673][123090] Updated weights for policy 1, policy_version 105946 (0.0010) [2023-12-26 00:25:52,423][123091] Updated weights for policy 0, policy_version 106466 (0.0008) [2023-12-26 00:25:52,480][123091] Updated weights for policy 0, policy_version 106476 (0.0009) [2023-12-26 00:25:52,501][123090] Updated weights for policy 1, policy_version 105956 (0.0009) [2023-12-26 00:25:52,538][123091] Updated weights for policy 0, policy_version 106486 (0.0007) [2023-12-26 00:25:52,575][123090] Updated weights for policy 1, policy_version 105966 (0.0010) [2023-12-26 00:25:52,606][123091] Updated weights for policy 0, policy_version 106496 (0.0006) [2023-12-26 00:25:52,640][123090] Updated weights for policy 1, policy_version 105976 (0.0010) [2023-12-26 00:25:53,420][123091] Updated weights for policy 0, policy_version 106506 (0.0011) [2023-12-26 00:25:53,452][123090] Updated weights for policy 1, policy_version 105986 (0.0009) [2023-12-26 00:25:53,470][123091] Updated weights for policy 0, policy_version 106516 (0.0009) [2023-12-26 00:25:53,516][123090] Updated weights for policy 1, policy_version 105996 (0.0008) [2023-12-26 00:25:53,525][123091] Updated weights for policy 0, policy_version 106526 (0.0010) [2023-12-26 00:25:53,585][123090] Updated weights for policy 1, policy_version 106006 (0.0007) [2023-12-26 00:25:53,643][123090] Updated weights for policy 1, policy_version 106016 (0.0005) [2023-12-26 00:25:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 54411264. Throughput: 0: 8641.2, 1: 9108.2. Samples: 54383216. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:25:53,785][121949] Avg episode reward: [(0, '5012.065'), (1, '5610.837')] [2023-12-26 00:25:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000106016_27140096.pth... [2023-12-26 00:25:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000106528_27271168.pth... [2023-12-26 00:25:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000104928_26861568.pth [2023-12-26 00:25:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000105504_27009024.pth [2023-12-26 00:25:54,400][123091] Updated weights for policy 0, policy_version 106536 (0.0009) [2023-12-26 00:25:54,431][123090] Updated weights for policy 1, policy_version 106026 (0.0005) [2023-12-26 00:25:54,452][123091] Updated weights for policy 0, policy_version 106546 (0.0009) [2023-12-26 00:25:54,494][123090] Updated weights for policy 1, policy_version 106036 (0.0006) [2023-12-26 00:25:54,500][123091] Updated weights for policy 0, policy_version 106556 (0.0009) [2023-12-26 00:25:54,561][123090] Updated weights for policy 1, policy_version 106046 (0.0008) [2023-12-26 00:25:55,354][123090] Updated weights for policy 1, policy_version 106056 (0.0009) [2023-12-26 00:25:55,374][123091] Updated weights for policy 0, policy_version 106566 (0.0010) [2023-12-26 00:25:55,406][123090] Updated weights for policy 1, policy_version 106066 (0.0006) [2023-12-26 00:25:55,440][123091] Updated weights for policy 0, policy_version 106576 (0.0009) [2023-12-26 00:25:55,457][123090] Updated weights for policy 1, policy_version 106076 (0.0009) [2023-12-26 00:25:55,518][123091] Updated weights for policy 0, policy_version 106586 (0.0006) [2023-12-26 00:25:56,245][123091] Updated weights for policy 0, policy_version 106596 (0.0006) [2023-12-26 00:25:56,263][123090] Updated weights for policy 1, policy_version 106086 (0.0007) [2023-12-26 00:25:56,291][123091] Updated weights for policy 0, policy_version 106606 (0.0005) [2023-12-26 00:25:56,329][123090] Updated weights for policy 1, policy_version 106096 (0.0007) [2023-12-26 00:25:56,339][123091] Updated weights for policy 0, policy_version 106616 (0.0009) [2023-12-26 00:25:56,393][123090] Updated weights for policy 1, policy_version 106106 (0.0008) [2023-12-26 00:25:56,921][123091] Updated weights for policy 0, policy_version 106626 (0.0009) [2023-12-26 00:25:56,976][123091] Updated weights for policy 0, policy_version 106636 (0.0005) [2023-12-26 00:25:57,031][123091] Updated weights for policy 0, policy_version 106646 (0.0006) [2023-12-26 00:25:57,046][123090] Updated weights for policy 1, policy_version 106116 (0.0010) [2023-12-26 00:25:57,098][123091] Updated weights for policy 0, policy_version 106656 (0.0006) [2023-12-26 00:25:57,104][123090] Updated weights for policy 1, policy_version 106126 (0.0010) [2023-12-26 00:25:57,163][123090] Updated weights for policy 1, policy_version 106136 (0.0010) [2023-12-26 00:25:57,788][123091] Updated weights for policy 0, policy_version 106666 (0.0005) [2023-12-26 00:25:57,858][123091] Updated weights for policy 0, policy_version 106676 (0.0005) [2023-12-26 00:25:57,872][123090] Updated weights for policy 1, policy_version 106146 (0.0010) [2023-12-26 00:25:57,911][123091] Updated weights for policy 0, policy_version 106686 (0.0005) [2023-12-26 00:25:57,930][123090] Updated weights for policy 1, policy_version 106156 (0.0010) [2023-12-26 00:25:57,997][123090] Updated weights for policy 1, policy_version 106166 (0.0010) [2023-12-26 00:25:58,061][123090] Updated weights for policy 1, policy_version 106176 (0.0011) [2023-12-26 00:25:58,686][123091] Updated weights for policy 0, policy_version 106696 (0.0007) [2023-12-26 00:25:58,766][123091] Updated weights for policy 0, policy_version 106706 (0.0008) [2023-12-26 00:25:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 54493184. Throughput: 0: 8743.9, 1: 9138.3. Samples: 54492404. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:25:58,785][121949] Avg episode reward: [(0, '4934.179'), (1, '5710.313')] [2023-12-26 00:25:58,836][123091] Updated weights for policy 0, policy_version 106716 (0.0009) [2023-12-26 00:25:58,891][123090] Updated weights for policy 1, policy_version 106186 (0.0006) [2023-12-26 00:25:58,962][123090] Updated weights for policy 1, policy_version 106196 (0.0008) [2023-12-26 00:25:59,029][123090] Updated weights for policy 1, policy_version 106206 (0.0007) [2023-12-26 00:25:59,694][123091] Updated weights for policy 0, policy_version 106726 (0.0009) [2023-12-26 00:25:59,745][123091] Updated weights for policy 0, policy_version 106736 (0.0009) [2023-12-26 00:25:59,805][123090] Updated weights for policy 1, policy_version 106216 (0.0007) [2023-12-26 00:25:59,808][123091] Updated weights for policy 0, policy_version 106746 (0.0008) [2023-12-26 00:25:59,875][123090] Updated weights for policy 1, policy_version 106226 (0.0010) [2023-12-26 00:25:59,939][123090] Updated weights for policy 1, policy_version 106236 (0.0009) [2023-12-26 00:26:00,649][123091] Updated weights for policy 0, policy_version 106756 (0.0009) [2023-12-26 00:26:00,702][123090] Updated weights for policy 1, policy_version 106246 (0.0008) [2023-12-26 00:26:00,705][123091] Updated weights for policy 0, policy_version 106766 (0.0008) [2023-12-26 00:26:00,758][123090] Updated weights for policy 1, policy_version 106256 (0.0008) [2023-12-26 00:26:00,765][123091] Updated weights for policy 0, policy_version 106776 (0.0009) [2023-12-26 00:26:00,817][123090] Updated weights for policy 1, policy_version 106266 (0.0010) [2023-12-26 00:26:01,581][123091] Updated weights for policy 0, policy_version 106786 (0.0007) [2023-12-26 00:26:01,639][123090] Updated weights for policy 1, policy_version 106276 (0.0009) [2023-12-26 00:26:01,646][123091] Updated weights for policy 0, policy_version 106796 (0.0009) [2023-12-26 00:26:01,701][123090] Updated weights for policy 1, policy_version 106286 (0.0009) [2023-12-26 00:26:01,714][123091] Updated weights for policy 0, policy_version 106806 (0.0009) [2023-12-26 00:26:01,765][123091] Updated weights for policy 0, policy_version 106816 (0.0010) [2023-12-26 00:26:01,767][123090] Updated weights for policy 1, policy_version 106296 (0.0007) [2023-12-26 00:26:02,509][123090] Updated weights for policy 1, policy_version 106306 (0.0006) [2023-12-26 00:26:02,553][123091] Updated weights for policy 0, policy_version 106826 (0.0006) [2023-12-26 00:26:02,571][123090] Updated weights for policy 1, policy_version 106316 (0.0008) [2023-12-26 00:26:02,617][123091] Updated weights for policy 0, policy_version 106836 (0.0006) [2023-12-26 00:26:02,630][123090] Updated weights for policy 1, policy_version 106326 (0.0008) [2023-12-26 00:26:02,685][123091] Updated weights for policy 0, policy_version 106846 (0.0006) [2023-12-26 00:26:02,695][123090] Updated weights for policy 1, policy_version 106336 (0.0006) [2023-12-26 00:26:03,396][123090] Updated weights for policy 1, policy_version 106346 (0.0005) [2023-12-26 00:26:03,461][123090] Updated weights for policy 1, policy_version 106356 (0.0005) [2023-12-26 00:26:03,470][123091] Updated weights for policy 0, policy_version 106856 (0.0010) [2023-12-26 00:26:03,523][123090] Updated weights for policy 1, policy_version 106366 (0.0006) [2023-12-26 00:26:03,530][123091] Updated weights for policy 0, policy_version 106866 (0.0011) [2023-12-26 00:26:03,594][123091] Updated weights for policy 0, policy_version 106876 (0.0011) [2023-12-26 00:26:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 54591488. Throughput: 0: 8729.1, 1: 9104.6. Samples: 54598800. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:03,785][121949] Avg episode reward: [(0, '4951.501'), (1, '5693.540')] [2023-12-26 00:26:04,246][123090] Updated weights for policy 1, policy_version 106376 (0.0009) [2023-12-26 00:26:04,310][123090] Updated weights for policy 1, policy_version 106386 (0.0006) [2023-12-26 00:26:04,378][123090] Updated weights for policy 1, policy_version 106396 (0.0006) [2023-12-26 00:26:04,439][123091] Updated weights for policy 0, policy_version 106886 (0.0011) [2023-12-26 00:26:04,507][123091] Updated weights for policy 0, policy_version 106896 (0.0011) [2023-12-26 00:26:04,575][123091] Updated weights for policy 0, policy_version 106907 (0.0011) [2023-12-26 00:26:05,202][123090] Updated weights for policy 1, policy_version 106406 (0.0008) [2023-12-26 00:26:05,262][123090] Updated weights for policy 1, policy_version 106416 (0.0009) [2023-12-26 00:26:05,326][123090] Updated weights for policy 1, policy_version 106426 (0.0009) [2023-12-26 00:26:05,348][123091] Updated weights for policy 0, policy_version 106917 (0.0010) [2023-12-26 00:26:05,401][123091] Updated weights for policy 0, policy_version 106927 (0.0010) [2023-12-26 00:26:05,462][123091] Updated weights for policy 0, policy_version 106937 (0.0009) [2023-12-26 00:26:06,164][123090] Updated weights for policy 1, policy_version 106436 (0.0010) [2023-12-26 00:26:06,219][123090] Updated weights for policy 1, policy_version 106446 (0.0009) [2023-12-26 00:26:06,268][123090] Updated weights for policy 1, policy_version 106456 (0.0009) [2023-12-26 00:26:06,330][123091] Updated weights for policy 0, policy_version 106947 (0.0009) [2023-12-26 00:26:06,393][123091] Updated weights for policy 0, policy_version 106957 (0.0011) [2023-12-26 00:26:06,464][123091] Updated weights for policy 0, policy_version 106967 (0.0011) [2023-12-26 00:26:07,136][123090] Updated weights for policy 1, policy_version 106466 (0.0009) [2023-12-26 00:26:07,190][123090] Updated weights for policy 1, policy_version 106476 (0.0010) [2023-12-26 00:26:07,241][123090] Updated weights for policy 1, policy_version 106486 (0.0009) [2023-12-26 00:26:07,277][123091] Updated weights for policy 0, policy_version 106977 (0.0011) [2023-12-26 00:26:07,288][123090] Updated weights for policy 1, policy_version 106496 (0.0007) [2023-12-26 00:26:07,324][123091] Updated weights for policy 0, policy_version 106987 (0.0010) [2023-12-26 00:26:07,382][123091] Updated weights for policy 0, policy_version 106997 (0.0010) [2023-12-26 00:26:07,447][123091] Updated weights for policy 0, policy_version 107007 (0.0010) [2023-12-26 00:26:08,092][123091] Updated weights for policy 0, policy_version 107017 (0.0006) [2023-12-26 00:26:08,154][123091] Updated weights for policy 0, policy_version 107027 (0.0006) [2023-12-26 00:26:08,213][123091] Updated weights for policy 0, policy_version 107037 (0.0005) [2023-12-26 00:26:08,217][123090] Updated weights for policy 1, policy_version 106506 (0.0009) [2023-12-26 00:26:08,293][123090] Updated weights for policy 1, policy_version 106516 (0.0009) [2023-12-26 00:26:08,374][123090] Updated weights for policy 1, policy_version 106526 (0.0009) [2023-12-26 00:26:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 54673408. Throughput: 0: 8759.1, 1: 9094.2. Samples: 54650292. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:08,785][121949] Avg episode reward: [(0, '4990.891'), (1, '5477.454')] [2023-12-26 00:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000107040_27402240.pth... [2023-12-26 00:26:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000106528_27271168.pth... [2023-12-26 00:26:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000106016_27140096.pth [2023-12-26 00:26:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000105472_27000832.pth [2023-12-26 00:26:08,979][123091] Updated weights for policy 0, policy_version 107047 (0.0009) [2023-12-26 00:26:09,043][123091] Updated weights for policy 0, policy_version 107057 (0.0011) [2023-12-26 00:26:09,110][123091] Updated weights for policy 0, policy_version 107067 (0.0011) [2023-12-26 00:26:09,221][123090] Updated weights for policy 1, policy_version 106536 (0.0009) [2023-12-26 00:26:09,281][123090] Updated weights for policy 1, policy_version 106546 (0.0008) [2023-12-26 00:26:09,348][123090] Updated weights for policy 1, policy_version 106556 (0.0009) [2023-12-26 00:26:10,029][123091] Updated weights for policy 0, policy_version 107077 (0.0011) [2023-12-26 00:26:10,101][123091] Updated weights for policy 0, policy_version 107087 (0.0011) [2023-12-26 00:26:10,169][123091] Updated weights for policy 0, policy_version 107097 (0.0011) [2023-12-26 00:26:10,190][123090] Updated weights for policy 1, policy_version 106566 (0.0007) [2023-12-26 00:26:10,238][123090] Updated weights for policy 1, policy_version 106576 (0.0009) [2023-12-26 00:26:10,287][123090] Updated weights for policy 1, policy_version 106586 (0.0009) [2023-12-26 00:26:10,983][123091] Updated weights for policy 0, policy_version 107107 (0.0011) [2023-12-26 00:26:11,043][123091] Updated weights for policy 0, policy_version 107117 (0.0011) [2023-12-26 00:26:11,115][123091] Updated weights for policy 0, policy_version 107127 (0.0011) [2023-12-26 00:26:11,184][123090] Updated weights for policy 1, policy_version 106597 (0.0008) [2023-12-26 00:26:11,238][123090] Updated weights for policy 1, policy_version 106607 (0.0009) [2023-12-26 00:26:11,295][123090] Updated weights for policy 1, policy_version 106617 (0.0009) [2023-12-26 00:26:11,951][123091] Updated weights for policy 0, policy_version 107137 (0.0011) [2023-12-26 00:26:12,016][123091] Updated weights for policy 0, policy_version 107147 (0.0008) [2023-12-26 00:26:12,073][123091] Updated weights for policy 0, policy_version 107157 (0.0005) [2023-12-26 00:26:12,133][123091] Updated weights for policy 0, policy_version 107167 (0.0005) [2023-12-26 00:26:12,212][123090] Updated weights for policy 1, policy_version 106627 (0.0010) [2023-12-26 00:26:12,283][123090] Updated weights for policy 1, policy_version 106638 (0.0011) [2023-12-26 00:26:12,350][123090] Updated weights for policy 1, policy_version 106648 (0.0009) [2023-12-26 00:26:12,860][123091] Updated weights for policy 0, policy_version 107177 (0.0010) [2023-12-26 00:26:12,926][123091] Updated weights for policy 0, policy_version 107187 (0.0010) [2023-12-26 00:26:12,988][123091] Updated weights for policy 0, policy_version 107197 (0.0010) [2023-12-26 00:26:13,223][123090] Updated weights for policy 1, policy_version 106658 (0.0009) [2023-12-26 00:26:13,284][123090] Updated weights for policy 1, policy_version 106668 (0.0010) [2023-12-26 00:26:13,340][123090] Updated weights for policy 1, policy_version 106678 (0.0006) [2023-12-26 00:26:13,404][123090] Updated weights for policy 1, policy_version 106688 (0.0008) [2023-12-26 00:26:13,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 54755328. Throughput: 0: 8800.4, 1: 8915.1. Samples: 54752228. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:13,786][121949] Avg episode reward: [(0, '4972.907'), (1, '5500.772')] [2023-12-26 00:26:13,800][123091] Updated weights for policy 0, policy_version 107207 (0.0010) [2023-12-26 00:26:13,858][123091] Updated weights for policy 0, policy_version 107217 (0.0010) [2023-12-26 00:26:13,926][123091] Updated weights for policy 0, policy_version 107227 (0.0010) [2023-12-26 00:26:14,099][123090] Updated weights for policy 1, policy_version 106698 (0.0010) [2023-12-26 00:26:14,161][123090] Updated weights for policy 1, policy_version 106708 (0.0010) [2023-12-26 00:26:14,212][123090] Updated weights for policy 1, policy_version 106718 (0.0010) [2023-12-26 00:26:14,725][123091] Updated weights for policy 0, policy_version 107237 (0.0010) [2023-12-26 00:26:14,788][123091] Updated weights for policy 0, policy_version 107247 (0.0011) [2023-12-26 00:26:14,856][123091] Updated weights for policy 0, policy_version 107257 (0.0011) [2023-12-26 00:26:14,952][123090] Updated weights for policy 1, policy_version 106728 (0.0006) [2023-12-26 00:26:15,015][123090] Updated weights for policy 1, policy_version 106738 (0.0007) [2023-12-26 00:26:15,079][123090] Updated weights for policy 1, policy_version 106748 (0.0011) [2023-12-26 00:26:15,622][123091] Updated weights for policy 0, policy_version 107267 (0.0011) [2023-12-26 00:26:15,685][123091] Updated weights for policy 0, policy_version 107277 (0.0011) [2023-12-26 00:26:15,740][123091] Updated weights for policy 0, policy_version 107287 (0.0010) [2023-12-26 00:26:15,753][123090] Updated weights for policy 1, policy_version 106758 (0.0007) [2023-12-26 00:26:15,810][123090] Updated weights for policy 1, policy_version 106768 (0.0006) [2023-12-26 00:26:15,870][123090] Updated weights for policy 1, policy_version 106778 (0.0005) [2023-12-26 00:26:16,540][123090] Updated weights for policy 1, policy_version 106788 (0.0005) [2023-12-26 00:26:16,562][123091] Updated weights for policy 0, policy_version 107297 (0.0011) [2023-12-26 00:26:16,592][123090] Updated weights for policy 1, policy_version 106798 (0.0007) [2023-12-26 00:26:16,625][123091] Updated weights for policy 0, policy_version 107307 (0.0010) [2023-12-26 00:26:16,647][123090] Updated weights for policy 1, policy_version 106808 (0.0010) [2023-12-26 00:26:16,672][123091] Updated weights for policy 0, policy_version 107317 (0.0010) [2023-12-26 00:26:16,727][123091] Updated weights for policy 0, policy_version 107327 (0.0010) [2023-12-26 00:26:17,453][123090] Updated weights for policy 1, policy_version 106818 (0.0010) [2023-12-26 00:26:17,455][123091] Updated weights for policy 0, policy_version 107337 (0.0006) [2023-12-26 00:26:17,506][123090] Updated weights for policy 1, policy_version 106828 (0.0007) [2023-12-26 00:26:17,514][123091] Updated weights for policy 0, policy_version 107347 (0.0010) [2023-12-26 00:26:17,555][123090] Updated weights for policy 1, policy_version 106838 (0.0007) [2023-12-26 00:26:17,579][123091] Updated weights for policy 0, policy_version 107357 (0.0010) [2023-12-26 00:26:17,606][123090] Updated weights for policy 1, policy_version 106848 (0.0005) [2023-12-26 00:26:18,318][123091] Updated weights for policy 0, policy_version 107367 (0.0011) [2023-12-26 00:26:18,384][123091] Updated weights for policy 0, policy_version 107377 (0.0009) [2023-12-26 00:26:18,443][123091] Updated weights for policy 0, policy_version 107387 (0.0010) [2023-12-26 00:26:18,472][123090] Updated weights for policy 1, policy_version 106858 (0.0007) [2023-12-26 00:26:18,538][123090] Updated weights for policy 1, policy_version 106868 (0.0009) [2023-12-26 00:26:18,599][123090] Updated weights for policy 1, policy_version 106878 (0.0009) [2023-12-26 00:26:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 54853632. Throughput: 0: 8863.1, 1: 8973.5. Samples: 54861768. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:18,785][121949] Avg episode reward: [(0, '4933.583'), (1, '5438.295')] [2023-12-26 00:26:19,271][123091] Updated weights for policy 0, policy_version 107397 (0.0011) [2023-12-26 00:26:19,334][123091] Updated weights for policy 0, policy_version 107407 (0.0011) [2023-12-26 00:26:19,411][123091] Updated weights for policy 0, policy_version 107417 (0.0010) [2023-12-26 00:26:19,447][123090] Updated weights for policy 1, policy_version 106888 (0.0008) [2023-12-26 00:26:19,514][123090] Updated weights for policy 1, policy_version 106898 (0.0008) [2023-12-26 00:26:19,574][123090] Updated weights for policy 1, policy_version 106908 (0.0009) [2023-12-26 00:26:20,256][123091] Updated weights for policy 0, policy_version 107427 (0.0011) [2023-12-26 00:26:20,312][123091] Updated weights for policy 0, policy_version 107437 (0.0011) [2023-12-26 00:26:20,372][123091] Updated weights for policy 0, policy_version 107447 (0.0010) [2023-12-26 00:26:20,423][123090] Updated weights for policy 1, policy_version 106918 (0.0008) [2023-12-26 00:26:20,487][123090] Updated weights for policy 1, policy_version 106928 (0.0008) [2023-12-26 00:26:20,540][123090] Updated weights for policy 1, policy_version 106938 (0.0009) [2023-12-26 00:26:21,223][123091] Updated weights for policy 0, policy_version 107457 (0.0011) [2023-12-26 00:26:21,289][123091] Updated weights for policy 0, policy_version 107467 (0.0011) [2023-12-26 00:26:21,353][123091] Updated weights for policy 0, policy_version 107477 (0.0011) [2023-12-26 00:26:21,416][123090] Updated weights for policy 1, policy_version 106948 (0.0008) [2023-12-26 00:26:21,428][123091] Updated weights for policy 0, policy_version 107487 (0.0010) [2023-12-26 00:26:21,481][123090] Updated weights for policy 1, policy_version 106958 (0.0010) [2023-12-26 00:26:21,543][123090] Updated weights for policy 1, policy_version 106968 (0.0009) [2023-12-26 00:26:22,228][123091] Updated weights for policy 0, policy_version 107497 (0.0006) [2023-12-26 00:26:22,299][123091] Updated weights for policy 0, policy_version 107507 (0.0009) [2023-12-26 00:26:22,343][123090] Updated weights for policy 1, policy_version 106978 (0.0007) [2023-12-26 00:26:22,366][123091] Updated weights for policy 0, policy_version 107517 (0.0009) [2023-12-26 00:26:22,413][123090] Updated weights for policy 1, policy_version 106988 (0.0011) [2023-12-26 00:26:22,469][123090] Updated weights for policy 1, policy_version 106998 (0.0010) [2023-12-26 00:26:22,533][123090] Updated weights for policy 1, policy_version 107008 (0.0010) [2023-12-26 00:26:23,098][123091] Updated weights for policy 0, policy_version 107527 (0.0008) [2023-12-26 00:26:23,166][123091] Updated weights for policy 0, policy_version 107537 (0.0007) [2023-12-26 00:26:23,241][123091] Updated weights for policy 0, policy_version 107547 (0.0005) [2023-12-26 00:26:23,344][123090] Updated weights for policy 1, policy_version 107018 (0.0008) [2023-12-26 00:26:23,412][123090] Updated weights for policy 1, policy_version 107028 (0.0005) [2023-12-26 00:26:23,481][123090] Updated weights for policy 1, policy_version 107038 (0.0006) [2023-12-26 00:26:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 54935552. Throughput: 0: 8832.9, 1: 8904.2. Samples: 54911260. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:23,785][121949] Avg episode reward: [(0, '4987.177'), (1, '5257.456')] [2023-12-26 00:26:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000107552_27533312.pth... [2023-12-26 00:26:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000107040_27402240.pth... [2023-12-26 00:26:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000106528_27271168.pth [2023-12-26 00:26:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000106016_27140096.pth [2023-12-26 00:26:23,883][123091] Updated weights for policy 0, policy_version 107557 (0.0007) [2023-12-26 00:26:23,933][123091] Updated weights for policy 0, policy_version 107567 (0.0009) [2023-12-26 00:26:23,982][123091] Updated weights for policy 0, policy_version 107577 (0.0009) [2023-12-26 00:26:24,246][123090] Updated weights for policy 1, policy_version 107048 (0.0005) [2023-12-26 00:26:24,310][123090] Updated weights for policy 1, policy_version 107058 (0.0006) [2023-12-26 00:26:24,370][123090] Updated weights for policy 1, policy_version 107068 (0.0006) [2023-12-26 00:26:24,835][123091] Updated weights for policy 0, policy_version 107587 (0.0008) [2023-12-26 00:26:24,895][123091] Updated weights for policy 0, policy_version 107597 (0.0005) [2023-12-26 00:26:24,963][123091] Updated weights for policy 0, policy_version 107607 (0.0006) [2023-12-26 00:26:25,027][123090] Updated weights for policy 1, policy_version 107078 (0.0006) [2023-12-26 00:26:25,086][123090] Updated weights for policy 1, policy_version 107088 (0.0006) [2023-12-26 00:26:25,158][123090] Updated weights for policy 1, policy_version 107098 (0.0006) [2023-12-26 00:26:25,805][123091] Updated weights for policy 0, policy_version 107617 (0.0006) [2023-12-26 00:26:25,818][123090] Updated weights for policy 1, policy_version 107108 (0.0007) [2023-12-26 00:26:25,870][123091] Updated weights for policy 0, policy_version 107627 (0.0009) [2023-12-26 00:26:25,882][123090] Updated weights for policy 1, policy_version 107118 (0.0008) [2023-12-26 00:26:25,940][123091] Updated weights for policy 0, policy_version 107637 (0.0006) [2023-12-26 00:26:25,948][123090] Updated weights for policy 1, policy_version 107128 (0.0009) [2023-12-26 00:26:26,004][123091] Updated weights for policy 0, policy_version 107647 (0.0006) [2023-12-26 00:26:26,653][123091] Updated weights for policy 0, policy_version 107657 (0.0007) [2023-12-26 00:26:26,697][123091] Updated weights for policy 0, policy_version 107667 (0.0007) [2023-12-26 00:26:26,743][123090] Updated weights for policy 1, policy_version 107138 (0.0008) [2023-12-26 00:26:26,750][123091] Updated weights for policy 0, policy_version 107677 (0.0005) [2023-12-26 00:26:26,806][123090] Updated weights for policy 1, policy_version 107148 (0.0010) [2023-12-26 00:26:26,853][123090] Updated weights for policy 1, policy_version 107158 (0.0010) [2023-12-26 00:26:26,900][123090] Updated weights for policy 1, policy_version 107168 (0.0010) [2023-12-26 00:26:27,439][123091] Updated weights for policy 0, policy_version 107687 (0.0005) [2023-12-26 00:26:27,494][123091] Updated weights for policy 0, policy_version 107697 (0.0005) [2023-12-26 00:26:27,543][123091] Updated weights for policy 0, policy_version 107707 (0.0005) [2023-12-26 00:26:27,669][123090] Updated weights for policy 1, policy_version 107178 (0.0005) [2023-12-26 00:26:27,722][123090] Updated weights for policy 1, policy_version 107188 (0.0005) [2023-12-26 00:26:27,767][123090] Updated weights for policy 1, policy_version 107198 (0.0005) [2023-12-26 00:26:28,180][123091] Updated weights for policy 0, policy_version 107717 (0.0005) [2023-12-26 00:26:28,226][123091] Updated weights for policy 0, policy_version 107727 (0.0005) [2023-12-26 00:26:28,278][123091] Updated weights for policy 0, policy_version 107737 (0.0005) [2023-12-26 00:26:28,423][123090] Updated weights for policy 1, policy_version 107208 (0.0009) [2023-12-26 00:26:28,490][123090] Updated weights for policy 1, policy_version 107218 (0.0005) [2023-12-26 00:26:28,553][123090] Updated weights for policy 1, policy_version 107228 (0.0005) [2023-12-26 00:26:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 55033856. Throughput: 0: 8916.6, 1: 8959.5. Samples: 55023196. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:28,785][121949] Avg episode reward: [(0, '5078.937'), (1, '5206.734')] [2023-12-26 00:26:29,085][123091] Updated weights for policy 0, policy_version 107747 (0.0006) [2023-12-26 00:26:29,139][123091] Updated weights for policy 0, policy_version 107758 (0.0009) [2023-12-26 00:26:29,187][123090] Updated weights for policy 1, policy_version 107238 (0.0005) [2023-12-26 00:26:29,188][123091] Updated weights for policy 0, policy_version 107768 (0.0009) [2023-12-26 00:26:29,251][123090] Updated weights for policy 1, policy_version 107248 (0.0008) [2023-12-26 00:26:29,316][123090] Updated weights for policy 1, policy_version 107258 (0.0009) [2023-12-26 00:26:29,932][123091] Updated weights for policy 0, policy_version 107778 (0.0009) [2023-12-26 00:26:30,009][123091] Updated weights for policy 0, policy_version 107788 (0.0007) [2023-12-26 00:26:30,072][123091] Updated weights for policy 0, policy_version 107798 (0.0010) [2023-12-26 00:26:30,146][123091] Updated weights for policy 0, policy_version 107808 (0.0010) [2023-12-26 00:26:30,160][123090] Updated weights for policy 1, policy_version 107268 (0.0009) [2023-12-26 00:26:30,224][123090] Updated weights for policy 1, policy_version 107278 (0.0009) [2023-12-26 00:26:30,288][123090] Updated weights for policy 1, policy_version 107288 (0.0009) [2023-12-26 00:26:30,953][123091] Updated weights for policy 0, policy_version 107818 (0.0009) [2023-12-26 00:26:31,006][123091] Updated weights for policy 0, policy_version 107828 (0.0009) [2023-12-26 00:26:31,068][123091] Updated weights for policy 0, policy_version 107838 (0.0010) [2023-12-26 00:26:31,107][123090] Updated weights for policy 1, policy_version 107298 (0.0009) [2023-12-26 00:26:31,169][123090] Updated weights for policy 1, policy_version 107308 (0.0010) [2023-12-26 00:26:31,225][123090] Updated weights for policy 1, policy_version 107318 (0.0009) [2023-12-26 00:26:31,283][123090] Updated weights for policy 1, policy_version 107328 (0.0009) [2023-12-26 00:26:31,876][123091] Updated weights for policy 0, policy_version 107848 (0.0010) [2023-12-26 00:26:31,932][123091] Updated weights for policy 0, policy_version 107858 (0.0009) [2023-12-26 00:26:31,980][123091] Updated weights for policy 0, policy_version 107868 (0.0009) [2023-12-26 00:26:32,012][123090] Updated weights for policy 1, policy_version 107338 (0.0008) [2023-12-26 00:26:32,072][123090] Updated weights for policy 1, policy_version 107348 (0.0007) [2023-12-26 00:26:32,132][123090] Updated weights for policy 1, policy_version 107358 (0.0005) [2023-12-26 00:26:32,805][123091] Updated weights for policy 0, policy_version 107878 (0.0010) [2023-12-26 00:26:32,826][123090] Updated weights for policy 1, policy_version 107368 (0.0005) [2023-12-26 00:26:32,863][123091] Updated weights for policy 0, policy_version 107888 (0.0010) [2023-12-26 00:26:32,885][123090] Updated weights for policy 1, policy_version 107378 (0.0006) [2023-12-26 00:26:32,914][123091] Updated weights for policy 0, policy_version 107898 (0.0010) [2023-12-26 00:26:32,951][123090] Updated weights for policy 1, policy_version 107388 (0.0005) [2023-12-26 00:26:33,596][123090] Updated weights for policy 1, policy_version 107398 (0.0005) [2023-12-26 00:26:33,645][123090] Updated weights for policy 1, policy_version 107408 (0.0005) [2023-12-26 00:26:33,668][123091] Updated weights for policy 0, policy_version 107908 (0.0009) [2023-12-26 00:26:33,701][123090] Updated weights for policy 1, policy_version 107418 (0.0005) [2023-12-26 00:26:33,732][123091] Updated weights for policy 0, policy_version 107918 (0.0006) [2023-12-26 00:26:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 55123968. Throughput: 0: 8895.7, 1: 8991.1. Samples: 55135592. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:33,785][121949] Avg episode reward: [(0, '4994.673'), (1, '5126.518')] [2023-12-26 00:26:33,799][123091] Updated weights for policy 0, policy_version 107928 (0.0006) [2023-12-26 00:26:34,414][123091] Updated weights for policy 0, policy_version 107938 (0.0006) [2023-12-26 00:26:34,450][123090] Updated weights for policy 1, policy_version 107428 (0.0005) [2023-12-26 00:26:34,482][123091] Updated weights for policy 0, policy_version 107948 (0.0011) [2023-12-26 00:26:34,515][123090] Updated weights for policy 1, policy_version 107438 (0.0006) [2023-12-26 00:26:34,554][123091] Updated weights for policy 0, policy_version 107958 (0.0011) [2023-12-26 00:26:34,584][123090] Updated weights for policy 1, policy_version 107448 (0.0005) [2023-12-26 00:26:34,606][123091] Updated weights for policy 0, policy_version 107968 (0.0011) [2023-12-26 00:26:35,229][123090] Updated weights for policy 1, policy_version 107458 (0.0006) [2023-12-26 00:26:35,284][123090] Updated weights for policy 1, policy_version 107468 (0.0005) [2023-12-26 00:26:35,338][123090] Updated weights for policy 1, policy_version 107478 (0.0005) [2023-12-26 00:26:35,400][123090] Updated weights for policy 1, policy_version 107488 (0.0009) [2023-12-26 00:26:35,416][123091] Updated weights for policy 0, policy_version 107978 (0.0011) [2023-12-26 00:26:35,463][123091] Updated weights for policy 0, policy_version 107988 (0.0010) [2023-12-26 00:26:35,511][123091] Updated weights for policy 0, policy_version 107998 (0.0010) [2023-12-26 00:26:36,196][123090] Updated weights for policy 1, policy_version 107498 (0.0009) [2023-12-26 00:26:36,261][123090] Updated weights for policy 1, policy_version 107508 (0.0010) [2023-12-26 00:26:36,319][123090] Updated weights for policy 1, policy_version 107518 (0.0008) [2023-12-26 00:26:36,333][123091] Updated weights for policy 0, policy_version 108008 (0.0010) [2023-12-26 00:26:36,398][123091] Updated weights for policy 0, policy_version 108018 (0.0009) [2023-12-26 00:26:36,468][123091] Updated weights for policy 0, policy_version 108028 (0.0009) [2023-12-26 00:26:37,167][123090] Updated weights for policy 1, policy_version 107528 (0.0009) [2023-12-26 00:26:37,218][123090] Updated weights for policy 1, policy_version 107538 (0.0010) [2023-12-26 00:26:37,282][123090] Updated weights for policy 1, policy_version 107548 (0.0008) [2023-12-26 00:26:37,291][123091] Updated weights for policy 0, policy_version 108038 (0.0011) [2023-12-26 00:26:37,344][123091] Updated weights for policy 0, policy_version 108048 (0.0008) [2023-12-26 00:26:37,397][123091] Updated weights for policy 0, policy_version 108058 (0.0009) [2023-12-26 00:26:38,036][123090] Updated weights for policy 1, policy_version 107558 (0.0007) [2023-12-26 00:26:38,107][123090] Updated weights for policy 1, policy_version 107568 (0.0010) [2023-12-26 00:26:38,178][123090] Updated weights for policy 1, policy_version 107578 (0.0010) [2023-12-26 00:26:38,264][123091] Updated weights for policy 0, policy_version 108068 (0.0010) [2023-12-26 00:26:38,326][123091] Updated weights for policy 0, policy_version 108078 (0.0015) [2023-12-26 00:26:38,395][123091] Updated weights for policy 0, policy_version 108088 (0.0007) [2023-12-26 00:26:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 55214080. Throughput: 0: 8938.1, 1: 8993.3. Samples: 55190124. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 00:26:38,785][121949] Avg episode reward: [(0, '4829.993'), (1, '4853.987')] [2023-12-26 00:26:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000108096_27672576.pth... [2023-12-26 00:26:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000107584_27541504.pth... [2023-12-26 00:26:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000106528_27271168.pth [2023-12-26 00:26:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000107040_27402240.pth [2023-12-26 00:26:38,934][123090] Updated weights for policy 1, policy_version 107588 (0.0010) [2023-12-26 00:26:38,990][123090] Updated weights for policy 1, policy_version 107598 (0.0010) [2023-12-26 00:26:39,041][123090] Updated weights for policy 1, policy_version 107608 (0.0010) [2023-12-26 00:26:39,186][123091] Updated weights for policy 0, policy_version 108098 (0.0006) [2023-12-26 00:26:39,252][123091] Updated weights for policy 0, policy_version 108108 (0.0010) [2023-12-26 00:26:39,318][123091] Updated weights for policy 0, policy_version 108118 (0.0010) [2023-12-26 00:26:39,382][123091] Updated weights for policy 0, policy_version 108128 (0.0010) [2023-12-26 00:26:39,858][123090] Updated weights for policy 1, policy_version 107618 (0.0009) [2023-12-26 00:26:39,926][123090] Updated weights for policy 1, policy_version 107628 (0.0011) [2023-12-26 00:26:40,002][123090] Updated weights for policy 1, policy_version 107638 (0.0011) [2023-12-26 00:26:40,069][123090] Updated weights for policy 1, policy_version 107648 (0.0010) [2023-12-26 00:26:40,234][123091] Updated weights for policy 0, policy_version 108138 (0.0006) [2023-12-26 00:26:40,299][123091] Updated weights for policy 0, policy_version 108148 (0.0010) [2023-12-26 00:26:40,366][123091] Updated weights for policy 0, policy_version 108158 (0.0011) [2023-12-26 00:26:40,884][123090] Updated weights for policy 1, policy_version 107658 (0.0010) [2023-12-26 00:26:40,943][123090] Updated weights for policy 1, policy_version 107668 (0.0010) [2023-12-26 00:26:41,010][123090] Updated weights for policy 1, policy_version 107678 (0.0010) [2023-12-26 00:26:41,234][123091] Updated weights for policy 0, policy_version 108168 (0.0007) [2023-12-26 00:26:41,305][123091] Updated weights for policy 0, policy_version 108178 (0.0008) [2023-12-26 00:26:41,377][123091] Updated weights for policy 0, policy_version 108188 (0.0009) [2023-12-26 00:26:41,891][123090] Updated weights for policy 1, policy_version 107688 (0.0011) [2023-12-26 00:26:41,958][123090] Updated weights for policy 1, policy_version 107698 (0.0010) [2023-12-26 00:26:42,022][123090] Updated weights for policy 1, policy_version 107708 (0.0010) [2023-12-26 00:26:42,114][123091] Updated weights for policy 0, policy_version 108198 (0.0009) [2023-12-26 00:26:42,176][123091] Updated weights for policy 0, policy_version 108208 (0.0009) [2023-12-26 00:26:42,241][123091] Updated weights for policy 0, policy_version 108218 (0.0008) [2023-12-26 00:26:42,825][123090] Updated weights for policy 1, policy_version 107718 (0.0010) [2023-12-26 00:26:42,888][123090] Updated weights for policy 1, policy_version 107728 (0.0011) [2023-12-26 00:26:42,940][123090] Updated weights for policy 1, policy_version 107738 (0.0010) [2023-12-26 00:26:43,064][123091] Updated weights for policy 0, policy_version 108228 (0.0008) [2023-12-26 00:26:43,121][123091] Updated weights for policy 0, policy_version 108238 (0.0009) [2023-12-26 00:26:43,182][123091] Updated weights for policy 0, policy_version 108248 (0.0010) [2023-12-26 00:26:43,637][123090] Updated weights for policy 1, policy_version 107748 (0.0008) [2023-12-26 00:26:43,702][123090] Updated weights for policy 1, policy_version 107758 (0.0005) [2023-12-26 00:26:43,770][123090] Updated weights for policy 1, policy_version 107768 (0.0006) [2023-12-26 00:26:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 55296000. Throughput: 0: 8861.5, 1: 8939.0. Samples: 55293428. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:26:43,785][121949] Avg episode reward: [(0, '4806.053'), (1, '4764.300')] [2023-12-26 00:26:44,062][123091] Updated weights for policy 0, policy_version 108258 (0.0010) [2023-12-26 00:26:44,119][123091] Updated weights for policy 0, policy_version 108268 (0.0010) [2023-12-26 00:26:44,176][123091] Updated weights for policy 0, policy_version 108279 (0.0010) [2023-12-26 00:26:44,451][123090] Updated weights for policy 1, policy_version 107778 (0.0006) [2023-12-26 00:26:44,495][123090] Updated weights for policy 1, policy_version 107788 (0.0006) [2023-12-26 00:26:44,549][123090] Updated weights for policy 1, policy_version 107798 (0.0005) [2023-12-26 00:26:44,596][123090] Updated weights for policy 1, policy_version 107808 (0.0005) [2023-12-26 00:26:45,044][123091] Updated weights for policy 0, policy_version 108289 (0.0010) [2023-12-26 00:26:45,114][123091] Updated weights for policy 0, policy_version 108299 (0.0010) [2023-12-26 00:26:45,181][123091] Updated weights for policy 0, policy_version 108309 (0.0010) [2023-12-26 00:26:45,245][123091] Updated weights for policy 0, policy_version 108319 (0.0008) [2023-12-26 00:26:45,410][123090] Updated weights for policy 1, policy_version 107818 (0.0009) [2023-12-26 00:26:45,484][123090] Updated weights for policy 1, policy_version 107828 (0.0006) [2023-12-26 00:26:45,548][123090] Updated weights for policy 1, policy_version 107838 (0.0009) [2023-12-26 00:26:46,021][123091] Updated weights for policy 0, policy_version 108329 (0.0010) [2023-12-26 00:26:46,079][123091] Updated weights for policy 0, policy_version 108339 (0.0010) [2023-12-26 00:26:46,126][123091] Updated weights for policy 0, policy_version 108349 (0.0010) [2023-12-26 00:26:46,352][123090] Updated weights for policy 1, policy_version 107848 (0.0008) [2023-12-26 00:26:46,398][123090] Updated weights for policy 1, policy_version 107858 (0.0008) [2023-12-26 00:26:46,455][123090] Updated weights for policy 1, policy_version 107868 (0.0008) [2023-12-26 00:26:46,960][123091] Updated weights for policy 0, policy_version 108359 (0.0010) [2023-12-26 00:26:47,026][123091] Updated weights for policy 0, policy_version 108369 (0.0010) [2023-12-26 00:26:47,084][123091] Updated weights for policy 0, policy_version 108379 (0.0010) [2023-12-26 00:26:47,232][123090] Updated weights for policy 1, policy_version 107878 (0.0007) [2023-12-26 00:26:47,287][123090] Updated weights for policy 1, policy_version 107888 (0.0006) [2023-12-26 00:26:47,340][123090] Updated weights for policy 1, policy_version 107898 (0.0005) [2023-12-26 00:26:47,837][123091] Updated weights for policy 0, policy_version 108389 (0.0010) [2023-12-26 00:26:47,882][123091] Updated weights for policy 0, policy_version 108399 (0.0006) [2023-12-26 00:26:47,936][123091] Updated weights for policy 0, policy_version 108409 (0.0010) [2023-12-26 00:26:47,981][123090] Updated weights for policy 1, policy_version 107908 (0.0006) [2023-12-26 00:26:48,041][123090] Updated weights for policy 1, policy_version 107918 (0.0009) [2023-12-26 00:26:48,105][123090] Updated weights for policy 1, policy_version 107928 (0.0009) [2023-12-26 00:26:48,775][123091] Updated weights for policy 0, policy_version 108419 (0.0010) [2023-12-26 00:26:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 55386112. Throughput: 0: 8860.1, 1: 8988.9. Samples: 55402004. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:26:48,785][121949] Avg episode reward: [(0, '4888.449'), (1, '4731.875')] [2023-12-26 00:26:48,839][123091] Updated weights for policy 0, policy_version 108429 (0.0009) [2023-12-26 00:26:48,900][123091] Updated weights for policy 0, policy_version 108439 (0.0010) [2023-12-26 00:26:48,941][123090] Updated weights for policy 1, policy_version 107938 (0.0008) [2023-12-26 00:26:48,998][123090] Updated weights for policy 1, policy_version 107948 (0.0008) [2023-12-26 00:26:49,053][123090] Updated weights for policy 1, policy_version 107958 (0.0009) [2023-12-26 00:26:49,110][123090] Updated weights for policy 1, policy_version 107968 (0.0009) [2023-12-26 00:26:49,747][123091] Updated weights for policy 0, policy_version 108449 (0.0010) [2023-12-26 00:26:49,799][123091] Updated weights for policy 0, policy_version 108459 (0.0010) [2023-12-26 00:26:49,864][123091] Updated weights for policy 0, policy_version 108469 (0.0009) [2023-12-26 00:26:49,934][123091] Updated weights for policy 0, policy_version 108479 (0.0009) [2023-12-26 00:26:49,947][123090] Updated weights for policy 1, policy_version 107978 (0.0007) [2023-12-26 00:26:50,011][123090] Updated weights for policy 1, policy_version 107988 (0.0006) [2023-12-26 00:26:50,075][123090] Updated weights for policy 1, policy_version 107998 (0.0011) [2023-12-26 00:26:50,783][123091] Updated weights for policy 0, policy_version 108489 (0.0006) [2023-12-26 00:26:50,859][123091] Updated weights for policy 0, policy_version 108499 (0.0007) [2023-12-26 00:26:50,890][123090] Updated weights for policy 1, policy_version 108008 (0.0010) [2023-12-26 00:26:50,918][123091] Updated weights for policy 0, policy_version 108509 (0.0006) [2023-12-26 00:26:50,953][123090] Updated weights for policy 1, policy_version 108018 (0.0009) [2023-12-26 00:26:51,015][123090] Updated weights for policy 1, policy_version 108028 (0.0010) [2023-12-26 00:26:51,660][123091] Updated weights for policy 0, policy_version 108519 (0.0007) [2023-12-26 00:26:51,729][123091] Updated weights for policy 0, policy_version 108529 (0.0008) [2023-12-26 00:26:51,804][123091] Updated weights for policy 0, policy_version 108539 (0.0009) [2023-12-26 00:26:51,913][123090] Updated weights for policy 1, policy_version 108038 (0.0010) [2023-12-26 00:26:51,977][123090] Updated weights for policy 1, policy_version 108048 (0.0010) [2023-12-26 00:26:52,046][123090] Updated weights for policy 1, policy_version 108058 (0.0010) [2023-12-26 00:26:52,642][123091] Updated weights for policy 0, policy_version 108549 (0.0011) [2023-12-26 00:26:52,710][123091] Updated weights for policy 0, policy_version 108559 (0.0009) [2023-12-26 00:26:52,772][123091] Updated weights for policy 0, policy_version 108569 (0.0010) [2023-12-26 00:26:52,863][123090] Updated weights for policy 1, policy_version 108068 (0.0007) [2023-12-26 00:26:52,930][123090] Updated weights for policy 1, policy_version 108078 (0.0010) [2023-12-26 00:26:52,999][123090] Updated weights for policy 1, policy_version 108088 (0.0006) [2023-12-26 00:26:53,615][123091] Updated weights for policy 0, policy_version 108579 (0.0009) [2023-12-26 00:26:53,625][123090] Updated weights for policy 1, policy_version 108098 (0.0006) [2023-12-26 00:26:53,679][123090] Updated weights for policy 1, policy_version 108108 (0.0006) [2023-12-26 00:26:53,680][123091] Updated weights for policy 0, policy_version 108589 (0.0005) [2023-12-26 00:26:53,737][123090] Updated weights for policy 1, policy_version 108118 (0.0006) [2023-12-26 00:26:53,742][123091] Updated weights for policy 0, policy_version 108599 (0.0006) [2023-12-26 00:26:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 55468032. Throughput: 0: 8862.9, 1: 8985.1. Samples: 55453448. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:26:53,785][121949] Avg episode reward: [(0, '4993.405'), (1, '4873.373')] [2023-12-26 00:26:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000108608_27803648.pth... [2023-12-26 00:26:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000107552_27533312.pth [2023-12-26 00:26:53,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000108128_27680768.pth... [2023-12-26 00:26:53,798][123090] Updated weights for policy 1, policy_version 108128 (0.0005) [2023-12-26 00:26:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000107040_27402240.pth [2023-12-26 00:26:54,415][123091] Updated weights for policy 0, policy_version 108609 (0.0008) [2023-12-26 00:26:54,474][123091] Updated weights for policy 0, policy_version 108619 (0.0006) [2023-12-26 00:26:54,525][123091] Updated weights for policy 0, policy_version 108629 (0.0005) [2023-12-26 00:26:54,525][123090] Updated weights for policy 1, policy_version 108138 (0.0008) [2023-12-26 00:26:54,570][123090] Updated weights for policy 1, policy_version 108148 (0.0006) [2023-12-26 00:26:54,575][123091] Updated weights for policy 0, policy_version 108639 (0.0008) [2023-12-26 00:26:54,618][123090] Updated weights for policy 1, policy_version 108158 (0.0009) [2023-12-26 00:26:55,319][123091] Updated weights for policy 0, policy_version 108649 (0.0006) [2023-12-26 00:26:55,384][123091] Updated weights for policy 0, policy_version 108659 (0.0005) [2023-12-26 00:26:55,452][123091] Updated weights for policy 0, policy_version 108669 (0.0010) [2023-12-26 00:26:55,524][123090] Updated weights for policy 1, policy_version 108168 (0.0008) [2023-12-26 00:26:55,579][123090] Updated weights for policy 1, policy_version 108178 (0.0009) [2023-12-26 00:26:55,630][123090] Updated weights for policy 1, policy_version 108188 (0.0008) [2023-12-26 00:26:56,194][123091] Updated weights for policy 0, policy_version 108679 (0.0011) [2023-12-26 00:26:56,249][123091] Updated weights for policy 0, policy_version 108689 (0.0010) [2023-12-26 00:26:56,337][123091] Updated weights for policy 0, policy_version 108699 (0.0011) [2023-12-26 00:26:56,428][123090] Updated weights for policy 1, policy_version 108198 (0.0009) [2023-12-26 00:26:56,498][123090] Updated weights for policy 1, policy_version 108208 (0.0009) [2023-12-26 00:26:56,565][123090] Updated weights for policy 1, policy_version 108218 (0.0009) [2023-12-26 00:26:57,151][123091] Updated weights for policy 0, policy_version 108709 (0.0011) [2023-12-26 00:26:57,190][123090] Updated weights for policy 1, policy_version 108228 (0.0006) [2023-12-26 00:26:57,211][123091] Updated weights for policy 0, policy_version 108719 (0.0011) [2023-12-26 00:26:57,248][123090] Updated weights for policy 1, policy_version 108238 (0.0006) [2023-12-26 00:26:57,266][123091] Updated weights for policy 0, policy_version 108729 (0.0010) [2023-12-26 00:26:57,308][123090] Updated weights for policy 1, policy_version 108248 (0.0006) [2023-12-26 00:26:58,023][123090] Updated weights for policy 1, policy_version 108258 (0.0006) [2023-12-26 00:26:58,082][123090] Updated weights for policy 1, policy_version 108268 (0.0007) [2023-12-26 00:26:58,090][123091] Updated weights for policy 0, policy_version 108739 (0.0011) [2023-12-26 00:26:58,147][123090] Updated weights for policy 1, policy_version 108278 (0.0007) [2023-12-26 00:26:58,157][123091] Updated weights for policy 0, policy_version 108749 (0.0011) [2023-12-26 00:26:58,210][123090] Updated weights for policy 1, policy_version 108288 (0.0008) [2023-12-26 00:26:58,217][123091] Updated weights for policy 0, policy_version 108759 (0.0009) [2023-12-26 00:26:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 55566336. Throughput: 0: 8860.5, 1: 9125.5. Samples: 55561592. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:26:58,784][121949] Avg episode reward: [(0, '5116.436'), (1, '5058.243')] [2023-12-26 00:26:58,785][123007] Saving new best policy, reward=5116.436! [2023-12-26 00:26:58,988][123090] Updated weights for policy 1, policy_version 108298 (0.0005) [2023-12-26 00:26:59,034][123090] Updated weights for policy 1, policy_version 108308 (0.0005) [2023-12-26 00:26:59,083][123091] Updated weights for policy 0, policy_version 108769 (0.0006) [2023-12-26 00:26:59,084][123090] Updated weights for policy 1, policy_version 108318 (0.0006) [2023-12-26 00:26:59,138][123091] Updated weights for policy 0, policy_version 108779 (0.0009) [2023-12-26 00:26:59,198][123091] Updated weights for policy 0, policy_version 108789 (0.0009) [2023-12-26 00:26:59,264][123091] Updated weights for policy 0, policy_version 108799 (0.0007) [2023-12-26 00:26:59,866][123090] Updated weights for policy 1, policy_version 108328 (0.0009) [2023-12-26 00:26:59,931][123090] Updated weights for policy 1, policy_version 108338 (0.0009) [2023-12-26 00:27:00,001][123090] Updated weights for policy 1, policy_version 108348 (0.0009) [2023-12-26 00:27:00,049][123091] Updated weights for policy 0, policy_version 108809 (0.0009) [2023-12-26 00:27:00,110][123091] Updated weights for policy 0, policy_version 108819 (0.0010) [2023-12-26 00:27:00,158][123091] Updated weights for policy 0, policy_version 108829 (0.0005) [2023-12-26 00:27:00,790][123090] Updated weights for policy 1, policy_version 108358 (0.0006) [2023-12-26 00:27:00,844][123090] Updated weights for policy 1, policy_version 108368 (0.0005) [2023-12-26 00:27:00,897][123090] Updated weights for policy 1, policy_version 108378 (0.0005) [2023-12-26 00:27:00,989][123091] Updated weights for policy 0, policy_version 108839 (0.0010) [2023-12-26 00:27:01,043][123091] Updated weights for policy 0, policy_version 108849 (0.0009) [2023-12-26 00:27:01,099][123091] Updated weights for policy 0, policy_version 108859 (0.0008) [2023-12-26 00:27:01,740][123090] Updated weights for policy 1, policy_version 108388 (0.0006) [2023-12-26 00:27:01,799][123090] Updated weights for policy 1, policy_version 108398 (0.0009) [2023-12-26 00:27:01,858][123090] Updated weights for policy 1, policy_version 108408 (0.0009) [2023-12-26 00:27:01,910][123091] Updated weights for policy 0, policy_version 108869 (0.0008) [2023-12-26 00:27:01,978][123091] Updated weights for policy 0, policy_version 108879 (0.0005) [2023-12-26 00:27:02,051][123091] Updated weights for policy 0, policy_version 108889 (0.0005) [2023-12-26 00:27:02,757][123090] Updated weights for policy 1, policy_version 108418 (0.0009) [2023-12-26 00:27:02,788][123091] Updated weights for policy 0, policy_version 108899 (0.0005) [2023-12-26 00:27:02,806][123090] Updated weights for policy 1, policy_version 108428 (0.0009) [2023-12-26 00:27:02,853][123091] Updated weights for policy 0, policy_version 108909 (0.0008) [2023-12-26 00:27:02,864][123090] Updated weights for policy 1, policy_version 108438 (0.0007) [2023-12-26 00:27:02,915][123090] Updated weights for policy 1, policy_version 108448 (0.0010) [2023-12-26 00:27:02,916][123091] Updated weights for policy 0, policy_version 108919 (0.0008) [2023-12-26 00:27:03,671][123091] Updated weights for policy 0, policy_version 108929 (0.0010) [2023-12-26 00:27:03,738][123091] Updated weights for policy 0, policy_version 108939 (0.0005) [2023-12-26 00:27:03,769][123090] Updated weights for policy 1, policy_version 108458 (0.0009) [2023-12-26 00:27:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 55648256. Throughput: 0: 8851.0, 1: 9039.2. Samples: 55666828. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:03,785][121949] Avg episode reward: [(0, '5008.712'), (1, '5059.819')] [2023-12-26 00:27:03,806][123091] Updated weights for policy 0, policy_version 108949 (0.0005) [2023-12-26 00:27:03,825][123090] Updated weights for policy 1, policy_version 108468 (0.0009) [2023-12-26 00:27:03,874][123091] Updated weights for policy 0, policy_version 108959 (0.0006) [2023-12-26 00:27:03,890][123090] Updated weights for policy 1, policy_version 108478 (0.0009) [2023-12-26 00:27:04,539][123091] Updated weights for policy 0, policy_version 108969 (0.0009) [2023-12-26 00:27:04,598][123091] Updated weights for policy 0, policy_version 108979 (0.0009) [2023-12-26 00:27:04,651][123091] Updated weights for policy 0, policy_version 108989 (0.0009) [2023-12-26 00:27:04,676][123090] Updated weights for policy 1, policy_version 108488 (0.0007) [2023-12-26 00:27:04,734][123090] Updated weights for policy 1, policy_version 108498 (0.0010) [2023-12-26 00:27:04,782][123090] Updated weights for policy 1, policy_version 108508 (0.0009) [2023-12-26 00:27:05,490][123091] Updated weights for policy 0, policy_version 108999 (0.0009) [2023-12-26 00:27:05,539][123091] Updated weights for policy 0, policy_version 109009 (0.0009) [2023-12-26 00:27:05,601][123091] Updated weights for policy 0, policy_version 109019 (0.0006) [2023-12-26 00:27:05,637][123090] Updated weights for policy 1, policy_version 108518 (0.0008) [2023-12-26 00:27:05,702][123090] Updated weights for policy 1, policy_version 108528 (0.0009) [2023-12-26 00:27:05,766][123090] Updated weights for policy 1, policy_version 108538 (0.0009) [2023-12-26 00:27:06,474][123091] Updated weights for policy 0, policy_version 109029 (0.0008) [2023-12-26 00:27:06,516][123090] Updated weights for policy 1, policy_version 108548 (0.0008) [2023-12-26 00:27:06,543][123091] Updated weights for policy 0, policy_version 109039 (0.0009) [2023-12-26 00:27:06,587][123090] Updated weights for policy 1, policy_version 108558 (0.0007) [2023-12-26 00:27:06,613][123091] Updated weights for policy 0, policy_version 109049 (0.0009) [2023-12-26 00:27:06,653][123090] Updated weights for policy 1, policy_version 108568 (0.0008) [2023-12-26 00:27:07,431][123090] Updated weights for policy 1, policy_version 108578 (0.0010) [2023-12-26 00:27:07,453][123091] Updated weights for policy 0, policy_version 109059 (0.0008) [2023-12-26 00:27:07,492][123090] Updated weights for policy 1, policy_version 108588 (0.0009) [2023-12-26 00:27:07,502][123091] Updated weights for policy 0, policy_version 109069 (0.0009) [2023-12-26 00:27:07,547][123090] Updated weights for policy 1, policy_version 108598 (0.0008) [2023-12-26 00:27:07,562][123091] Updated weights for policy 0, policy_version 109079 (0.0008) [2023-12-26 00:27:07,610][123090] Updated weights for policy 1, policy_version 108608 (0.0010) [2023-12-26 00:27:08,453][123090] Updated weights for policy 1, policy_version 108618 (0.0008) [2023-12-26 00:27:08,453][123091] Updated weights for policy 0, policy_version 109089 (0.0010) [2023-12-26 00:27:08,512][123091] Updated weights for policy 0, policy_version 109099 (0.0009) [2023-12-26 00:27:08,512][123090] Updated weights for policy 1, policy_version 108628 (0.0008) [2023-12-26 00:27:08,578][123090] Updated weights for policy 1, policy_version 108638 (0.0009) [2023-12-26 00:27:08,580][123091] Updated weights for policy 0, policy_version 109109 (0.0008) [2023-12-26 00:27:08,644][123091] Updated weights for policy 0, policy_version 109119 (0.0009) [2023-12-26 00:27:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 55746560. Throughput: 0: 8878.3, 1: 9077.0. Samples: 55719248. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:08,784][121949] Avg episode reward: [(0, '5048.985'), (1, '5084.989')] [2023-12-26 00:27:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000109120_27934720.pth... [2023-12-26 00:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000108640_27811840.pth... [2023-12-26 00:27:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000108096_27672576.pth [2023-12-26 00:27:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000107584_27541504.pth [2023-12-26 00:27:09,405][123090] Updated weights for policy 1, policy_version 108648 (0.0009) [2023-12-26 00:27:09,471][123090] Updated weights for policy 1, policy_version 108658 (0.0007) [2023-12-26 00:27:09,474][123091] Updated weights for policy 0, policy_version 109129 (0.0009) [2023-12-26 00:27:09,530][123091] Updated weights for policy 0, policy_version 109139 (0.0009) [2023-12-26 00:27:09,534][123090] Updated weights for policy 1, policy_version 108668 (0.0009) [2023-12-26 00:27:09,582][123091] Updated weights for policy 0, policy_version 109149 (0.0010) [2023-12-26 00:27:10,306][123091] Updated weights for policy 0, policy_version 109159 (0.0009) [2023-12-26 00:27:10,359][123091] Updated weights for policy 0, policy_version 109169 (0.0009) [2023-12-26 00:27:10,388][123090] Updated weights for policy 1, policy_version 108678 (0.0007) [2023-12-26 00:27:10,421][123091] Updated weights for policy 0, policy_version 109179 (0.0008) [2023-12-26 00:27:10,445][123090] Updated weights for policy 1, policy_version 108688 (0.0007) [2023-12-26 00:27:10,512][123090] Updated weights for policy 1, policy_version 108698 (0.0008) [2023-12-26 00:27:11,289][123091] Updated weights for policy 0, policy_version 109189 (0.0009) [2023-12-26 00:27:11,322][123090] Updated weights for policy 1, policy_version 108708 (0.0008) [2023-12-26 00:27:11,374][123091] Updated weights for policy 0, policy_version 109199 (0.0009) [2023-12-26 00:27:11,388][123090] Updated weights for policy 1, policy_version 108718 (0.0008) [2023-12-26 00:27:11,442][123091] Updated weights for policy 0, policy_version 109209 (0.0008) [2023-12-26 00:27:11,461][123090] Updated weights for policy 1, policy_version 108728 (0.0011) [2023-12-26 00:27:12,253][123091] Updated weights for policy 0, policy_version 109219 (0.0007) [2023-12-26 00:27:12,314][123091] Updated weights for policy 0, policy_version 109229 (0.0009) [2023-12-26 00:27:12,314][123090] Updated weights for policy 1, policy_version 108738 (0.0007) [2023-12-26 00:27:12,378][123091] Updated weights for policy 0, policy_version 109239 (0.0009) [2023-12-26 00:27:12,380][123090] Updated weights for policy 1, policy_version 108748 (0.0010) [2023-12-26 00:27:12,439][123090] Updated weights for policy 1, policy_version 108758 (0.0010) [2023-12-26 00:27:12,503][123090] Updated weights for policy 1, policy_version 108768 (0.0010) [2023-12-26 00:27:13,197][123091] Updated weights for policy 0, policy_version 109249 (0.0008) [2023-12-26 00:27:13,239][123090] Updated weights for policy 1, policy_version 108778 (0.0009) [2023-12-26 00:27:13,255][123091] Updated weights for policy 0, policy_version 109259 (0.0007) [2023-12-26 00:27:13,292][123090] Updated weights for policy 1, policy_version 108788 (0.0008) [2023-12-26 00:27:13,311][123091] Updated weights for policy 0, policy_version 109269 (0.0008) [2023-12-26 00:27:13,352][123090] Updated weights for policy 1, policy_version 108798 (0.0007) [2023-12-26 00:27:13,366][123091] Updated weights for policy 0, policy_version 109279 (0.0008) [2023-12-26 00:27:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 55828480. Throughput: 0: 8768.3, 1: 8962.7. Samples: 55821088. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:13,785][121949] Avg episode reward: [(0, '5186.275'), (1, '4879.857')] [2023-12-26 00:27:13,786][123007] Saving new best policy, reward=5186.275! [2023-12-26 00:27:14,081][123090] Updated weights for policy 1, policy_version 108808 (0.0006) [2023-12-26 00:27:14,126][123090] Updated weights for policy 1, policy_version 108818 (0.0005) [2023-12-26 00:27:14,175][123090] Updated weights for policy 1, policy_version 108828 (0.0005) [2023-12-26 00:27:14,284][123091] Updated weights for policy 0, policy_version 109289 (0.0010) [2023-12-26 00:27:14,349][123091] Updated weights for policy 0, policy_version 109299 (0.0010) [2023-12-26 00:27:14,414][123091] Updated weights for policy 0, policy_version 109309 (0.0010) [2023-12-26 00:27:14,856][123090] Updated weights for policy 1, policy_version 108838 (0.0007) [2023-12-26 00:27:14,922][123090] Updated weights for policy 1, policy_version 108848 (0.0008) [2023-12-26 00:27:14,992][123090] Updated weights for policy 1, policy_version 108858 (0.0008) [2023-12-26 00:27:15,302][123091] Updated weights for policy 0, policy_version 109319 (0.0010) [2023-12-26 00:27:15,369][123091] Updated weights for policy 0, policy_version 109329 (0.0010) [2023-12-26 00:27:15,425][123091] Updated weights for policy 0, policy_version 109339 (0.0010) [2023-12-26 00:27:15,760][123090] Updated weights for policy 1, policy_version 108868 (0.0009) [2023-12-26 00:27:15,811][123090] Updated weights for policy 1, policy_version 108878 (0.0009) [2023-12-26 00:27:15,875][123090] Updated weights for policy 1, policy_version 108888 (0.0009) [2023-12-26 00:27:16,269][123091] Updated weights for policy 0, policy_version 109349 (0.0010) [2023-12-26 00:27:16,331][123091] Updated weights for policy 0, policy_version 109359 (0.0010) [2023-12-26 00:27:16,385][123091] Updated weights for policy 0, policy_version 109369 (0.0009) [2023-12-26 00:27:16,614][123090] Updated weights for policy 1, policy_version 108898 (0.0008) [2023-12-26 00:27:16,680][123090] Updated weights for policy 1, policy_version 108908 (0.0005) [2023-12-26 00:27:16,752][123090] Updated weights for policy 1, policy_version 108918 (0.0006) [2023-12-26 00:27:16,823][123090] Updated weights for policy 1, policy_version 108928 (0.0005) [2023-12-26 00:27:17,305][123091] Updated weights for policy 0, policy_version 109380 (0.0009) [2023-12-26 00:27:17,350][123090] Updated weights for policy 1, policy_version 108938 (0.0005) [2023-12-26 00:27:17,372][123091] Updated weights for policy 0, policy_version 109390 (0.0010) [2023-12-26 00:27:17,395][123090] Updated weights for policy 1, policy_version 108948 (0.0005) [2023-12-26 00:27:17,435][123091] Updated weights for policy 0, policy_version 109400 (0.0008) [2023-12-26 00:27:17,450][123090] Updated weights for policy 1, policy_version 108958 (0.0005) [2023-12-26 00:27:18,160][123090] Updated weights for policy 1, policy_version 108968 (0.0008) [2023-12-26 00:27:18,217][123090] Updated weights for policy 1, policy_version 108978 (0.0006) [2023-12-26 00:27:18,268][123090] Updated weights for policy 1, policy_version 108988 (0.0005) [2023-12-26 00:27:18,336][123091] Updated weights for policy 0, policy_version 109410 (0.0009) [2023-12-26 00:27:18,394][123091] Updated weights for policy 0, policy_version 109420 (0.0010) [2023-12-26 00:27:18,446][123091] Updated weights for policy 0, policy_version 109430 (0.0010) [2023-12-26 00:27:18,502][123091] Updated weights for policy 0, policy_version 109440 (0.0009) [2023-12-26 00:27:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 55918592. Throughput: 0: 8616.2, 1: 8999.0. Samples: 55928276. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:18,785][121949] Avg episode reward: [(0, '5123.967'), (1, '5001.036')] [2023-12-26 00:27:19,024][123090] Updated weights for policy 1, policy_version 108998 (0.0005) [2023-12-26 00:27:19,080][123090] Updated weights for policy 1, policy_version 109008 (0.0009) [2023-12-26 00:27:19,137][123090] Updated weights for policy 1, policy_version 109018 (0.0009) [2023-12-26 00:27:19,400][123091] Updated weights for policy 0, policy_version 109450 (0.0009) [2023-12-26 00:27:19,468][123091] Updated weights for policy 0, policy_version 109460 (0.0010) [2023-12-26 00:27:19,535][123091] Updated weights for policy 0, policy_version 109470 (0.0008) [2023-12-26 00:27:20,099][123090] Updated weights for policy 1, policy_version 109028 (0.0010) [2023-12-26 00:27:20,159][123090] Updated weights for policy 1, policy_version 109038 (0.0010) [2023-12-26 00:27:20,225][123090] Updated weights for policy 1, policy_version 109048 (0.0010) [2023-12-26 00:27:20,391][123091] Updated weights for policy 0, policy_version 109480 (0.0009) [2023-12-26 00:27:20,460][123091] Updated weights for policy 0, policy_version 109490 (0.0009) [2023-12-26 00:27:20,516][123091] Updated weights for policy 0, policy_version 109500 (0.0008) [2023-12-26 00:27:21,089][123090] Updated weights for policy 1, policy_version 109058 (0.0011) [2023-12-26 00:27:21,156][123090] Updated weights for policy 1, policy_version 109068 (0.0009) [2023-12-26 00:27:21,224][123090] Updated weights for policy 1, policy_version 109078 (0.0011) [2023-12-26 00:27:21,294][123090] Updated weights for policy 1, policy_version 109088 (0.0011) [2023-12-26 00:27:21,356][123091] Updated weights for policy 0, policy_version 109510 (0.0008) [2023-12-26 00:27:21,423][123091] Updated weights for policy 0, policy_version 109520 (0.0008) [2023-12-26 00:27:21,492][123091] Updated weights for policy 0, policy_version 109530 (0.0007) [2023-12-26 00:27:22,170][123090] Updated weights for policy 1, policy_version 109098 (0.0005) [2023-12-26 00:27:22,237][123090] Updated weights for policy 1, policy_version 109108 (0.0005) [2023-12-26 00:27:22,297][123091] Updated weights for policy 0, policy_version 109540 (0.0008) [2023-12-26 00:27:22,308][123090] Updated weights for policy 1, policy_version 109118 (0.0007) [2023-12-26 00:27:22,357][123091] Updated weights for policy 0, policy_version 109550 (0.0006) [2023-12-26 00:27:22,412][123091] Updated weights for policy 0, policy_version 109560 (0.0009) [2023-12-26 00:27:22,991][123090] Updated weights for policy 1, policy_version 109128 (0.0009) [2023-12-26 00:27:23,058][123090] Updated weights for policy 1, policy_version 109138 (0.0008) [2023-12-26 00:27:23,119][123090] Updated weights for policy 1, policy_version 109148 (0.0009) [2023-12-26 00:27:23,275][123091] Updated weights for policy 0, policy_version 109570 (0.0009) [2023-12-26 00:27:23,340][123091] Updated weights for policy 0, policy_version 109580 (0.0009) [2023-12-26 00:27:23,393][123091] Updated weights for policy 0, policy_version 109590 (0.0009) [2023-12-26 00:27:23,451][123091] Updated weights for policy 0, policy_version 109600 (0.0009) [2023-12-26 00:27:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 56000512. Throughput: 0: 8578.0, 1: 8940.5. Samples: 55978452. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:23,785][121949] Avg episode reward: [(0, '5052.425'), (1, '5272.946')] [2023-12-26 00:27:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000109600_28057600.pth... [2023-12-26 00:27:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000109152_27942912.pth... [2023-12-26 00:27:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000108608_27803648.pth [2023-12-26 00:27:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000108128_27680768.pth [2023-12-26 00:27:23,925][123090] Updated weights for policy 1, policy_version 109158 (0.0010) [2023-12-26 00:27:23,991][123090] Updated weights for policy 1, policy_version 109168 (0.0010) [2023-12-26 00:27:24,047][123090] Updated weights for policy 1, policy_version 109178 (0.0005) [2023-12-26 00:27:24,320][123091] Updated weights for policy 0, policy_version 109610 (0.0010) [2023-12-26 00:27:24,376][123091] Updated weights for policy 0, policy_version 109620 (0.0010) [2023-12-26 00:27:24,448][123091] Updated weights for policy 0, policy_version 109630 (0.0009) [2023-12-26 00:27:24,746][123090] Updated weights for policy 1, policy_version 109188 (0.0005) [2023-12-26 00:27:24,802][123090] Updated weights for policy 1, policy_version 109198 (0.0005) [2023-12-26 00:27:24,856][123090] Updated weights for policy 1, policy_version 109208 (0.0005) [2023-12-26 00:27:25,318][123091] Updated weights for policy 0, policy_version 109640 (0.0008) [2023-12-26 00:27:25,371][123091] Updated weights for policy 0, policy_version 109651 (0.0010) [2023-12-26 00:27:25,437][123091] Updated weights for policy 0, policy_version 109661 (0.0009) [2023-12-26 00:27:25,505][123090] Updated weights for policy 1, policy_version 109218 (0.0006) [2023-12-26 00:27:25,578][123090] Updated weights for policy 1, policy_version 109228 (0.0006) [2023-12-26 00:27:25,651][123090] Updated weights for policy 1, policy_version 109238 (0.0005) [2023-12-26 00:27:25,703][123090] Updated weights for policy 1, policy_version 109248 (0.0005) [2023-12-26 00:27:26,347][123090] Updated weights for policy 1, policy_version 109258 (0.0005) [2023-12-26 00:27:26,374][123091] Updated weights for policy 0, policy_version 109671 (0.0010) [2023-12-26 00:27:26,410][123090] Updated weights for policy 1, policy_version 109268 (0.0005) [2023-12-26 00:27:26,422][123091] Updated weights for policy 0, policy_version 109681 (0.0009) [2023-12-26 00:27:26,463][123090] Updated weights for policy 1, policy_version 109278 (0.0005) [2023-12-26 00:27:26,477][123091] Updated weights for policy 0, policy_version 109691 (0.0009) [2023-12-26 00:27:27,098][123090] Updated weights for policy 1, policy_version 109288 (0.0009) [2023-12-26 00:27:27,151][123090] Updated weights for policy 1, policy_version 109298 (0.0009) [2023-12-26 00:27:27,203][123090] Updated weights for policy 1, policy_version 109308 (0.0009) [2023-12-26 00:27:27,390][123091] Updated weights for policy 0, policy_version 109701 (0.0010) [2023-12-26 00:27:27,448][123091] Updated weights for policy 0, policy_version 109712 (0.0010) [2023-12-26 00:27:27,501][123091] Updated weights for policy 0, policy_version 109722 (0.0009) [2023-12-26 00:27:27,993][123090] Updated weights for policy 1, policy_version 109318 (0.0009) [2023-12-26 00:27:28,066][123090] Updated weights for policy 1, policy_version 109328 (0.0008) [2023-12-26 00:27:28,120][123090] Updated weights for policy 1, policy_version 109338 (0.0009) [2023-12-26 00:27:28,350][123091] Updated weights for policy 0, policy_version 109732 (0.0010) [2023-12-26 00:27:28,405][123091] Updated weights for policy 0, policy_version 109742 (0.0009) [2023-12-26 00:27:28,468][123091] Updated weights for policy 0, policy_version 109752 (0.0006) [2023-12-26 00:27:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 56090624. Throughput: 0: 8521.2, 1: 9078.4. Samples: 56085408. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:28,785][121949] Avg episode reward: [(0, '5069.132'), (1, '5381.984')] [2023-12-26 00:27:28,997][123090] Updated weights for policy 1, policy_version 109348 (0.0010) [2023-12-26 00:27:29,049][123090] Updated weights for policy 1, policy_version 109358 (0.0010) [2023-12-26 00:27:29,102][123090] Updated weights for policy 1, policy_version 109368 (0.0010) [2023-12-26 00:27:29,107][123091] Updated weights for policy 0, policy_version 109762 (0.0006) [2023-12-26 00:27:29,162][123091] Updated weights for policy 0, policy_version 109772 (0.0005) [2023-12-26 00:27:29,225][123091] Updated weights for policy 0, policy_version 109782 (0.0006) [2023-12-26 00:27:29,289][123091] Updated weights for policy 0, policy_version 109792 (0.0009) [2023-12-26 00:27:29,970][123090] Updated weights for policy 1, policy_version 109378 (0.0009) [2023-12-26 00:27:30,022][123090] Updated weights for policy 1, policy_version 109388 (0.0009) [2023-12-26 00:27:30,085][123090] Updated weights for policy 1, policy_version 109398 (0.0009) [2023-12-26 00:27:30,105][123091] Updated weights for policy 0, policy_version 109802 (0.0006) [2023-12-26 00:27:30,150][123090] Updated weights for policy 1, policy_version 109408 (0.0008) [2023-12-26 00:27:30,156][123091] Updated weights for policy 0, policy_version 109812 (0.0008) [2023-12-26 00:27:30,214][123091] Updated weights for policy 0, policy_version 109822 (0.0009) [2023-12-26 00:27:31,024][123090] Updated weights for policy 1, policy_version 109418 (0.0008) [2023-12-26 00:27:31,035][123091] Updated weights for policy 0, policy_version 109832 (0.0008) [2023-12-26 00:27:31,090][123090] Updated weights for policy 1, policy_version 109428 (0.0008) [2023-12-26 00:27:31,100][123091] Updated weights for policy 0, policy_version 109842 (0.0010) [2023-12-26 00:27:31,157][123090] Updated weights for policy 1, policy_version 109438 (0.0008) [2023-12-26 00:27:31,162][123091] Updated weights for policy 0, policy_version 109852 (0.0011) [2023-12-26 00:27:31,968][123090] Updated weights for policy 1, policy_version 109448 (0.0009) [2023-12-26 00:27:31,971][123091] Updated weights for policy 0, policy_version 109862 (0.0008) [2023-12-26 00:27:32,029][123090] Updated weights for policy 1, policy_version 109458 (0.0009) [2023-12-26 00:27:32,034][123091] Updated weights for policy 0, policy_version 109872 (0.0007) [2023-12-26 00:27:32,090][123090] Updated weights for policy 1, policy_version 109468 (0.0008) [2023-12-26 00:27:32,100][123091] Updated weights for policy 0, policy_version 109882 (0.0006) [2023-12-26 00:27:32,811][123091] Updated weights for policy 0, policy_version 109892 (0.0007) [2023-12-26 00:27:32,869][123091] Updated weights for policy 0, policy_version 109902 (0.0008) [2023-12-26 00:27:32,919][123091] Updated weights for policy 0, policy_version 109912 (0.0009) [2023-12-26 00:27:32,986][123090] Updated weights for policy 1, policy_version 109478 (0.0008) [2023-12-26 00:27:33,045][123090] Updated weights for policy 1, policy_version 109488 (0.0010) [2023-12-26 00:27:33,110][123090] Updated weights for policy 1, policy_version 109498 (0.0009) [2023-12-26 00:27:33,551][123091] Updated weights for policy 0, policy_version 109922 (0.0009) [2023-12-26 00:27:33,608][123091] Updated weights for policy 0, policy_version 109932 (0.0005) [2023-12-26 00:27:33,660][123091] Updated weights for policy 0, policy_version 109942 (0.0005) [2023-12-26 00:27:33,712][123091] Updated weights for policy 0, policy_version 109952 (0.0007) [2023-12-26 00:27:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 56180736. Throughput: 0: 8604.8, 1: 8916.4. Samples: 56190460. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:33,785][121949] Avg episode reward: [(0, '5162.243'), (1, '5309.771')] [2023-12-26 00:27:34,002][123090] Updated weights for policy 1, policy_version 109508 (0.0010) [2023-12-26 00:27:34,066][123090] Updated weights for policy 1, policy_version 109518 (0.0008) [2023-12-26 00:27:34,131][123090] Updated weights for policy 1, policy_version 109528 (0.0009) [2023-12-26 00:27:34,378][123091] Updated weights for policy 0, policy_version 109962 (0.0006) [2023-12-26 00:27:34,429][123091] Updated weights for policy 0, policy_version 109972 (0.0005) [2023-12-26 00:27:34,492][123091] Updated weights for policy 0, policy_version 109982 (0.0006) [2023-12-26 00:27:35,050][123090] Updated weights for policy 1, policy_version 109538 (0.0008) [2023-12-26 00:27:35,106][123090] Updated weights for policy 1, policy_version 109549 (0.0010) [2023-12-26 00:27:35,132][123091] Updated weights for policy 0, policy_version 109992 (0.0005) [2023-12-26 00:27:35,164][123090] Updated weights for policy 1, policy_version 109559 (0.0009) [2023-12-26 00:27:35,183][123091] Updated weights for policy 0, policy_version 110002 (0.0006) [2023-12-26 00:27:35,237][123091] Updated weights for policy 0, policy_version 110012 (0.0005) [2023-12-26 00:27:35,948][123090] Updated weights for policy 1, policy_version 109569 (0.0010) [2023-12-26 00:27:35,988][123091] Updated weights for policy 0, policy_version 110022 (0.0007) [2023-12-26 00:27:36,002][123090] Updated weights for policy 1, policy_version 109579 (0.0008) [2023-12-26 00:27:36,039][123091] Updated weights for policy 0, policy_version 110032 (0.0009) [2023-12-26 00:27:36,061][123090] Updated weights for policy 1, policy_version 109589 (0.0007) [2023-12-26 00:27:36,089][123091] Updated weights for policy 0, policy_version 110042 (0.0008) [2023-12-26 00:27:36,119][123090] Updated weights for policy 1, policy_version 109599 (0.0006) [2023-12-26 00:27:36,824][123091] Updated weights for policy 0, policy_version 110052 (0.0006) [2023-12-26 00:27:36,881][123091] Updated weights for policy 0, policy_version 110062 (0.0006) [2023-12-26 00:27:36,937][123091] Updated weights for policy 0, policy_version 110072 (0.0007) [2023-12-26 00:27:37,000][123090] Updated weights for policy 1, policy_version 109609 (0.0010) [2023-12-26 00:27:37,070][123090] Updated weights for policy 1, policy_version 109619 (0.0009) [2023-12-26 00:27:37,131][123090] Updated weights for policy 1, policy_version 109629 (0.0010) [2023-12-26 00:27:37,760][123091] Updated weights for policy 0, policy_version 110082 (0.0007) [2023-12-26 00:27:37,824][123091] Updated weights for policy 0, policy_version 110092 (0.0011) [2023-12-26 00:27:37,879][123091] Updated weights for policy 0, policy_version 110102 (0.0011) [2023-12-26 00:27:37,914][123090] Updated weights for policy 1, policy_version 109639 (0.0010) [2023-12-26 00:27:37,935][123091] Updated weights for policy 0, policy_version 110112 (0.0011) [2023-12-26 00:27:37,965][123090] Updated weights for policy 1, policy_version 109649 (0.0009) [2023-12-26 00:27:38,014][123090] Updated weights for policy 1, policy_version 109659 (0.0009) [2023-12-26 00:27:38,717][123091] Updated weights for policy 0, policy_version 110122 (0.0011) [2023-12-26 00:27:38,776][123091] Updated weights for policy 0, policy_version 110132 (0.0011) [2023-12-26 00:27:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 56262656. Throughput: 0: 8688.3, 1: 8889.1. Samples: 56244432. Policy #0 lag: (min: 7.0, avg: 15.0, max: 39.0) [2023-12-26 00:27:38,785][121949] Avg episode reward: [(0, '5112.842'), (1, '5165.127')] [2023-12-26 00:27:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000109664_28073984.pth... [2023-12-26 00:27:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000108640_27811840.pth [2023-12-26 00:27:38,836][123091] Updated weights for policy 0, policy_version 110142 (0.0011) [2023-12-26 00:27:38,847][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000110144_28196864.pth... [2023-12-26 00:27:38,848][123090] Updated weights for policy 1, policy_version 109669 (0.0008) [2023-12-26 00:27:38,852][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000109120_27934720.pth [2023-12-26 00:27:38,921][123090] Updated weights for policy 1, policy_version 109679 (0.0009) [2023-12-26 00:27:38,982][123090] Updated weights for policy 1, policy_version 109689 (0.0009) [2023-12-26 00:27:39,695][123091] Updated weights for policy 0, policy_version 110152 (0.0011) [2023-12-26 00:27:39,754][123091] Updated weights for policy 0, policy_version 110162 (0.0011) [2023-12-26 00:27:39,810][123091] Updated weights for policy 0, policy_version 110172 (0.0010) [2023-12-26 00:27:39,860][123090] Updated weights for policy 1, policy_version 109699 (0.0010) [2023-12-26 00:27:39,918][123090] Updated weights for policy 1, policy_version 109709 (0.0009) [2023-12-26 00:27:39,974][123090] Updated weights for policy 1, policy_version 109719 (0.0009) [2023-12-26 00:27:40,614][123091] Updated weights for policy 0, policy_version 110182 (0.0008) [2023-12-26 00:27:40,682][123091] Updated weights for policy 0, policy_version 110192 (0.0006) [2023-12-26 00:27:40,755][123091] Updated weights for policy 0, policy_version 110202 (0.0007) [2023-12-26 00:27:40,919][123090] Updated weights for policy 1, policy_version 109729 (0.0009) [2023-12-26 00:27:40,987][123090] Updated weights for policy 1, policy_version 109739 (0.0009) [2023-12-26 00:27:41,054][123090] Updated weights for policy 1, policy_version 109749 (0.0008) [2023-12-26 00:27:41,120][123090] Updated weights for policy 1, policy_version 109759 (0.0010) [2023-12-26 00:27:41,495][123091] Updated weights for policy 0, policy_version 110212 (0.0007) [2023-12-26 00:27:41,543][123091] Updated weights for policy 0, policy_version 110222 (0.0008) [2023-12-26 00:27:41,599][123091] Updated weights for policy 0, policy_version 110232 (0.0008) [2023-12-26 00:27:42,024][123090] Updated weights for policy 1, policy_version 109769 (0.0009) [2023-12-26 00:27:42,085][123090] Updated weights for policy 1, policy_version 109779 (0.0009) [2023-12-26 00:27:42,139][123090] Updated weights for policy 1, policy_version 109789 (0.0009) [2023-12-26 00:27:42,439][123091] Updated weights for policy 0, policy_version 110242 (0.0009) [2023-12-26 00:27:42,498][123091] Updated weights for policy 0, policy_version 110252 (0.0010) [2023-12-26 00:27:42,555][123091] Updated weights for policy 0, policy_version 110262 (0.0009) [2023-12-26 00:27:42,614][123091] Updated weights for policy 0, policy_version 110272 (0.0008) [2023-12-26 00:27:43,064][123090] Updated weights for policy 1, policy_version 109799 (0.0009) [2023-12-26 00:27:43,136][123090] Updated weights for policy 1, policy_version 109809 (0.0005) [2023-12-26 00:27:43,206][123090] Updated weights for policy 1, policy_version 109819 (0.0006) [2023-12-26 00:27:43,408][123091] Updated weights for policy 0, policy_version 110282 (0.0010) [2023-12-26 00:27:43,474][123091] Updated weights for policy 0, policy_version 110292 (0.0010) [2023-12-26 00:27:43,536][123091] Updated weights for policy 0, policy_version 110302 (0.0010) [2023-12-26 00:27:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 56352768. Throughput: 0: 8672.1, 1: 8777.0. Samples: 56346804. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:27:43,785][121949] Avg episode reward: [(0, '5097.837'), (1, '5307.322')] [2023-12-26 00:27:43,988][123090] Updated weights for policy 1, policy_version 109829 (0.0009) [2023-12-26 00:27:44,045][123090] Updated weights for policy 1, policy_version 109839 (0.0009) [2023-12-26 00:27:44,098][123090] Updated weights for policy 1, policy_version 109849 (0.0009) [2023-12-26 00:27:44,323][123091] Updated weights for policy 0, policy_version 110312 (0.0007) [2023-12-26 00:27:44,397][123091] Updated weights for policy 0, policy_version 110322 (0.0006) [2023-12-26 00:27:44,458][123091] Updated weights for policy 0, policy_version 110332 (0.0006) [2023-12-26 00:27:45,036][123090] Updated weights for policy 1, policy_version 109859 (0.0009) [2023-12-26 00:27:45,085][123090] Updated weights for policy 1, policy_version 109869 (0.0009) [2023-12-26 00:27:45,147][123090] Updated weights for policy 1, policy_version 109879 (0.0009) [2023-12-26 00:27:45,179][123091] Updated weights for policy 0, policy_version 110342 (0.0007) [2023-12-26 00:27:45,238][123091] Updated weights for policy 0, policy_version 110352 (0.0006) [2023-12-26 00:27:45,310][123091] Updated weights for policy 0, policy_version 110362 (0.0006) [2023-12-26 00:27:45,995][123090] Updated weights for policy 1, policy_version 109889 (0.0009) [2023-12-26 00:27:46,049][123090] Updated weights for policy 1, policy_version 109899 (0.0007) [2023-12-26 00:27:46,076][123091] Updated weights for policy 0, policy_version 110372 (0.0007) [2023-12-26 00:27:46,095][123090] Updated weights for policy 1, policy_version 109909 (0.0005) [2023-12-26 00:27:46,129][123091] Updated weights for policy 0, policy_version 110382 (0.0008) [2023-12-26 00:27:46,144][123090] Updated weights for policy 1, policy_version 109919 (0.0005) [2023-12-26 00:27:46,197][123091] Updated weights for policy 0, policy_version 110392 (0.0010) [2023-12-26 00:27:46,739][123090] Updated weights for policy 1, policy_version 109929 (0.0005) [2023-12-26 00:27:46,786][123090] Updated weights for policy 1, policy_version 109939 (0.0005) [2023-12-26 00:27:46,835][123090] Updated weights for policy 1, policy_version 109949 (0.0005) [2023-12-26 00:27:46,914][123091] Updated weights for policy 0, policy_version 110402 (0.0006) [2023-12-26 00:27:46,970][123091] Updated weights for policy 0, policy_version 110412 (0.0005) [2023-12-26 00:27:47,036][123091] Updated weights for policy 0, policy_version 110422 (0.0006) [2023-12-26 00:27:47,609][123090] Updated weights for policy 1, policy_version 109959 (0.0007) [2023-12-26 00:27:47,674][123090] Updated weights for policy 1, policy_version 109969 (0.0006) [2023-12-26 00:27:47,679][123091] Updated weights for policy 0, policy_version 110433 (0.0009) [2023-12-26 00:27:47,731][123091] Updated weights for policy 0, policy_version 110443 (0.0007) [2023-12-26 00:27:47,742][123090] Updated weights for policy 1, policy_version 109979 (0.0007) [2023-12-26 00:27:47,785][123091] Updated weights for policy 0, policy_version 110453 (0.0006) [2023-12-26 00:27:47,844][123091] Updated weights for policy 0, policy_version 110463 (0.0005) [2023-12-26 00:27:48,398][123090] Updated weights for policy 1, policy_version 109989 (0.0007) [2023-12-26 00:27:48,468][123090] Updated weights for policy 1, policy_version 109999 (0.0008) [2023-12-26 00:27:48,530][123090] Updated weights for policy 1, policy_version 110009 (0.0009) [2023-12-26 00:27:48,612][123091] Updated weights for policy 0, policy_version 110473 (0.0009) [2023-12-26 00:27:48,680][123091] Updated weights for policy 0, policy_version 110483 (0.0008) [2023-12-26 00:27:48,748][123091] Updated weights for policy 0, policy_version 110493 (0.0010) [2023-12-26 00:27:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 56451072. Throughput: 0: 8750.5, 1: 8802.8. Samples: 56456724. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:27:48,785][121949] Avg episode reward: [(0, '5145.776'), (1, '5368.806')] [2023-12-26 00:27:49,340][123090] Updated weights for policy 1, policy_version 110019 (0.0010) [2023-12-26 00:27:49,415][123090] Updated weights for policy 1, policy_version 110029 (0.0010) [2023-12-26 00:27:49,474][123090] Updated weights for policy 1, policy_version 110039 (0.0009) [2023-12-26 00:27:49,559][123091] Updated weights for policy 0, policy_version 110503 (0.0008) [2023-12-26 00:27:49,608][123091] Updated weights for policy 0, policy_version 110513 (0.0009) [2023-12-26 00:27:49,660][123091] Updated weights for policy 0, policy_version 110523 (0.0009) [2023-12-26 00:27:50,322][123090] Updated weights for policy 1, policy_version 110049 (0.0009) [2023-12-26 00:27:50,390][123090] Updated weights for policy 1, policy_version 110059 (0.0009) [2023-12-26 00:27:50,456][123090] Updated weights for policy 1, policy_version 110069 (0.0010) [2023-12-26 00:27:50,458][123091] Updated weights for policy 0, policy_version 110533 (0.0007) [2023-12-26 00:27:50,509][123091] Updated weights for policy 0, policy_version 110543 (0.0008) [2023-12-26 00:27:50,516][123090] Updated weights for policy 1, policy_version 110079 (0.0009) [2023-12-26 00:27:50,567][123091] Updated weights for policy 0, policy_version 110553 (0.0009) [2023-12-26 00:27:51,290][123091] Updated weights for policy 0, policy_version 110563 (0.0008) [2023-12-26 00:27:51,316][123090] Updated weights for policy 1, policy_version 110089 (0.0010) [2023-12-26 00:27:51,358][123091] Updated weights for policy 0, policy_version 110573 (0.0008) [2023-12-26 00:27:51,387][123090] Updated weights for policy 1, policy_version 110099 (0.0010) [2023-12-26 00:27:51,429][123091] Updated weights for policy 0, policy_version 110583 (0.0010) [2023-12-26 00:27:51,444][123090] Updated weights for policy 1, policy_version 110109 (0.0007) [2023-12-26 00:27:52,235][123090] Updated weights for policy 1, policy_version 110119 (0.0007) [2023-12-26 00:27:52,247][123091] Updated weights for policy 0, policy_version 110593 (0.0008) [2023-12-26 00:27:52,301][123090] Updated weights for policy 1, policy_version 110129 (0.0007) [2023-12-26 00:27:52,315][123091] Updated weights for policy 0, policy_version 110603 (0.0010) [2023-12-26 00:27:52,367][123090] Updated weights for policy 1, policy_version 110139 (0.0007) [2023-12-26 00:27:52,377][123091] Updated weights for policy 0, policy_version 110613 (0.0008) [2023-12-26 00:27:52,439][123091] Updated weights for policy 0, policy_version 110623 (0.0008) [2023-12-26 00:27:53,082][123090] Updated weights for policy 1, policy_version 110149 (0.0008) [2023-12-26 00:27:53,152][123090] Updated weights for policy 1, policy_version 110159 (0.0006) [2023-12-26 00:27:53,216][123090] Updated weights for policy 1, policy_version 110169 (0.0008) [2023-12-26 00:27:53,302][123091] Updated weights for policy 0, policy_version 110633 (0.0008) [2023-12-26 00:27:53,364][123091] Updated weights for policy 0, policy_version 110643 (0.0009) [2023-12-26 00:27:53,434][123091] Updated weights for policy 0, policy_version 110653 (0.0009) [2023-12-26 00:27:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 56532992. Throughput: 0: 8757.5, 1: 8783.1. Samples: 56508576. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:27:53,785][121949] Avg episode reward: [(0, '5156.658'), (1, '5455.629')] [2023-12-26 00:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000110656_28327936.pth... [2023-12-26 00:27:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000110176_28205056.pth... [2023-12-26 00:27:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000109600_28057600.pth [2023-12-26 00:27:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000109152_27942912.pth [2023-12-26 00:27:53,908][123090] Updated weights for policy 1, policy_version 110179 (0.0008) [2023-12-26 00:27:53,957][123090] Updated weights for policy 1, policy_version 110189 (0.0005) [2023-12-26 00:27:54,016][123090] Updated weights for policy 1, policy_version 110199 (0.0005) [2023-12-26 00:27:54,300][123091] Updated weights for policy 0, policy_version 110663 (0.0009) [2023-12-26 00:27:54,360][123091] Updated weights for policy 0, policy_version 110673 (0.0010) [2023-12-26 00:27:54,417][123091] Updated weights for policy 0, policy_version 110683 (0.0009) [2023-12-26 00:27:54,620][123090] Updated weights for policy 1, policy_version 110209 (0.0006) [2023-12-26 00:27:54,688][123090] Updated weights for policy 1, policy_version 110219 (0.0005) [2023-12-26 00:27:54,742][123090] Updated weights for policy 1, policy_version 110229 (0.0009) [2023-12-26 00:27:54,796][123090] Updated weights for policy 1, policy_version 110239 (0.0010) [2023-12-26 00:27:55,339][123091] Updated weights for policy 0, policy_version 110693 (0.0010) [2023-12-26 00:27:55,397][123091] Updated weights for policy 0, policy_version 110703 (0.0010) [2023-12-26 00:27:55,463][123091] Updated weights for policy 0, policy_version 110713 (0.0009) [2023-12-26 00:27:55,514][123090] Updated weights for policy 1, policy_version 110249 (0.0010) [2023-12-26 00:27:55,570][123090] Updated weights for policy 1, policy_version 110259 (0.0010) [2023-12-26 00:27:55,625][123090] Updated weights for policy 1, policy_version 110269 (0.0010) [2023-12-26 00:27:56,276][123090] Updated weights for policy 1, policy_version 110279 (0.0005) [2023-12-26 00:27:56,323][123090] Updated weights for policy 1, policy_version 110289 (0.0005) [2023-12-26 00:27:56,363][123091] Updated weights for policy 0, policy_version 110723 (0.0009) [2023-12-26 00:27:56,381][123090] Updated weights for policy 1, policy_version 110299 (0.0005) [2023-12-26 00:27:56,425][123091] Updated weights for policy 0, policy_version 110733 (0.0010) [2023-12-26 00:27:56,487][123091] Updated weights for policy 0, policy_version 110743 (0.0011) [2023-12-26 00:27:57,048][123090] Updated weights for policy 1, policy_version 110309 (0.0008) [2023-12-26 00:27:57,106][123090] Updated weights for policy 1, policy_version 110319 (0.0010) [2023-12-26 00:27:57,132][123091] Updated weights for policy 0, policy_version 110753 (0.0010) [2023-12-26 00:27:57,169][123090] Updated weights for policy 1, policy_version 110329 (0.0010) [2023-12-26 00:27:57,200][123091] Updated weights for policy 0, policy_version 110763 (0.0007) [2023-12-26 00:27:57,257][123091] Updated weights for policy 0, policy_version 110773 (0.0005) [2023-12-26 00:27:57,304][123091] Updated weights for policy 0, policy_version 110783 (0.0006) [2023-12-26 00:27:57,904][123090] Updated weights for policy 1, policy_version 110339 (0.0010) [2023-12-26 00:27:57,952][123090] Updated weights for policy 1, policy_version 110349 (0.0009) [2023-12-26 00:27:58,014][123090] Updated weights for policy 1, policy_version 110359 (0.0008) [2023-12-26 00:27:58,034][123091] Updated weights for policy 0, policy_version 110793 (0.0008) [2023-12-26 00:27:58,091][123091] Updated weights for policy 0, policy_version 110803 (0.0009) [2023-12-26 00:27:58,151][123091] Updated weights for policy 0, policy_version 110813 (0.0010) [2023-12-26 00:27:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 56623104. Throughput: 0: 8766.0, 1: 8998.6. Samples: 56620492. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:27:58,784][121949] Avg episode reward: [(0, '5095.097'), (1, '5554.787')] [2023-12-26 00:27:58,980][123090] Updated weights for policy 1, policy_version 110369 (0.0009) [2023-12-26 00:27:59,040][123090] Updated weights for policy 1, policy_version 110379 (0.0011) [2023-12-26 00:27:59,049][123091] Updated weights for policy 0, policy_version 110823 (0.0008) [2023-12-26 00:27:59,104][123090] Updated weights for policy 1, policy_version 110389 (0.0011) [2023-12-26 00:27:59,108][123091] Updated weights for policy 0, policy_version 110833 (0.0007) [2023-12-26 00:27:59,167][123091] Updated weights for policy 0, policy_version 110843 (0.0006) [2023-12-26 00:27:59,168][123090] Updated weights for policy 1, policy_version 110399 (0.0011) [2023-12-26 00:27:59,954][123091] Updated weights for policy 0, policy_version 110853 (0.0010) [2023-12-26 00:28:00,010][123091] Updated weights for policy 0, policy_version 110863 (0.0009) [2023-12-26 00:28:00,015][123090] Updated weights for policy 1, policy_version 110409 (0.0008) [2023-12-26 00:28:00,072][123091] Updated weights for policy 0, policy_version 110873 (0.0009) [2023-12-26 00:28:00,072][123090] Updated weights for policy 1, policy_version 110419 (0.0005) [2023-12-26 00:28:00,133][123090] Updated weights for policy 1, policy_version 110429 (0.0006) [2023-12-26 00:28:00,894][123091] Updated weights for policy 0, policy_version 110883 (0.0007) [2023-12-26 00:28:00,951][123091] Updated weights for policy 0, policy_version 110893 (0.0006) [2023-12-26 00:28:00,958][123090] Updated weights for policy 1, policy_version 110439 (0.0008) [2023-12-26 00:28:00,996][123091] Updated weights for policy 0, policy_version 110903 (0.0009) [2023-12-26 00:28:01,004][123090] Updated weights for policy 1, policy_version 110449 (0.0005) [2023-12-26 00:28:01,069][123090] Updated weights for policy 1, policy_version 110459 (0.0007) [2023-12-26 00:28:01,795][123091] Updated weights for policy 0, policy_version 110913 (0.0007) [2023-12-26 00:28:01,862][123091] Updated weights for policy 0, policy_version 110923 (0.0005) [2023-12-26 00:28:01,877][123090] Updated weights for policy 1, policy_version 110469 (0.0007) [2023-12-26 00:28:01,924][123091] Updated weights for policy 0, policy_version 110933 (0.0007) [2023-12-26 00:28:01,939][123090] Updated weights for policy 1, policy_version 110479 (0.0008) [2023-12-26 00:28:01,981][123091] Updated weights for policy 0, policy_version 110943 (0.0006) [2023-12-26 00:28:02,006][123090] Updated weights for policy 1, policy_version 110489 (0.0009) [2023-12-26 00:28:02,710][123091] Updated weights for policy 0, policy_version 110953 (0.0006) [2023-12-26 00:28:02,770][123091] Updated weights for policy 0, policy_version 110963 (0.0010) [2023-12-26 00:28:02,839][123091] Updated weights for policy 0, policy_version 110973 (0.0010) [2023-12-26 00:28:02,845][123090] Updated weights for policy 1, policy_version 110499 (0.0008) [2023-12-26 00:28:02,904][123090] Updated weights for policy 1, policy_version 110509 (0.0006) [2023-12-26 00:28:02,963][123090] Updated weights for policy 1, policy_version 110519 (0.0006) [2023-12-26 00:28:03,456][123091] Updated weights for policy 0, policy_version 110983 (0.0007) [2023-12-26 00:28:03,507][123091] Updated weights for policy 0, policy_version 110993 (0.0009) [2023-12-26 00:28:03,550][123091] Updated weights for policy 0, policy_version 111003 (0.0010) [2023-12-26 00:28:03,742][123090] Updated weights for policy 1, policy_version 110529 (0.0007) [2023-12-26 00:28:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 56713216. Throughput: 0: 8911.3, 1: 8810.7. Samples: 56725772. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:03,785][121949] Avg episode reward: [(0, '5044.138'), (1, '5505.305')] [2023-12-26 00:28:03,792][123090] Updated weights for policy 1, policy_version 110539 (0.0010) [2023-12-26 00:28:03,854][123090] Updated weights for policy 1, policy_version 110549 (0.0008) [2023-12-26 00:28:03,926][123090] Updated weights for policy 1, policy_version 110559 (0.0006) [2023-12-26 00:28:04,371][123091] Updated weights for policy 0, policy_version 111013 (0.0009) [2023-12-26 00:28:04,429][123091] Updated weights for policy 0, policy_version 111023 (0.0009) [2023-12-26 00:28:04,486][123091] Updated weights for policy 0, policy_version 111033 (0.0009) [2023-12-26 00:28:04,651][123090] Updated weights for policy 1, policy_version 110569 (0.0010) [2023-12-26 00:28:04,707][123090] Updated weights for policy 1, policy_version 110579 (0.0010) [2023-12-26 00:28:04,755][123090] Updated weights for policy 1, policy_version 110589 (0.0010) [2023-12-26 00:28:05,315][123091] Updated weights for policy 0, policy_version 111043 (0.0009) [2023-12-26 00:28:05,381][123091] Updated weights for policy 0, policy_version 111053 (0.0009) [2023-12-26 00:28:05,431][123091] Updated weights for policy 0, policy_version 111063 (0.0005) [2023-12-26 00:28:05,544][123090] Updated weights for policy 1, policy_version 110599 (0.0010) [2023-12-26 00:28:05,599][123090] Updated weights for policy 1, policy_version 110609 (0.0010) [2023-12-26 00:28:05,661][123090] Updated weights for policy 1, policy_version 110619 (0.0010) [2023-12-26 00:28:06,260][123091] Updated weights for policy 0, policy_version 111073 (0.0007) [2023-12-26 00:28:06,328][123091] Updated weights for policy 0, policy_version 111083 (0.0009) [2023-12-26 00:28:06,402][123091] Updated weights for policy 0, policy_version 111093 (0.0010) [2023-12-26 00:28:06,466][123091] Updated weights for policy 0, policy_version 111103 (0.0010) [2023-12-26 00:28:06,534][123090] Updated weights for policy 1, policy_version 110629 (0.0011) [2023-12-26 00:28:06,596][123090] Updated weights for policy 1, policy_version 110639 (0.0011) [2023-12-26 00:28:06,663][123090] Updated weights for policy 1, policy_version 110649 (0.0011) [2023-12-26 00:28:07,290][123091] Updated weights for policy 0, policy_version 111113 (0.0005) [2023-12-26 00:28:07,358][123091] Updated weights for policy 0, policy_version 111123 (0.0005) [2023-12-26 00:28:07,429][123091] Updated weights for policy 0, policy_version 111133 (0.0009) [2023-12-26 00:28:07,478][123090] Updated weights for policy 1, policy_version 110659 (0.0010) [2023-12-26 00:28:07,545][123090] Updated weights for policy 1, policy_version 110669 (0.0009) [2023-12-26 00:28:07,597][123090] Updated weights for policy 1, policy_version 110680 (0.0009) [2023-12-26 00:28:08,208][123091] Updated weights for policy 0, policy_version 111143 (0.0010) [2023-12-26 00:28:08,260][123091] Updated weights for policy 0, policy_version 111153 (0.0010) [2023-12-26 00:28:08,314][123091] Updated weights for policy 0, policy_version 111164 (0.0010) [2023-12-26 00:28:08,347][123090] Updated weights for policy 1, policy_version 110690 (0.0010) [2023-12-26 00:28:08,403][123090] Updated weights for policy 1, policy_version 110700 (0.0008) [2023-12-26 00:28:08,480][123090] Updated weights for policy 1, policy_version 110710 (0.0005) [2023-12-26 00:28:08,555][123090] Updated weights for policy 1, policy_version 110720 (0.0007) [2023-12-26 00:28:08,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 56803328. Throughput: 0: 8920.6, 1: 8848.6. Samples: 56778076. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:08,785][121949] Avg episode reward: [(0, '5112.121'), (1, '5295.061')] [2023-12-26 00:28:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000111168_28459008.pth... [2023-12-26 00:28:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000110720_28344320.pth... [2023-12-26 00:28:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000109664_28073984.pth [2023-12-26 00:28:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000110144_28196864.pth [2023-12-26 00:28:09,073][123091] Updated weights for policy 0, policy_version 111174 (0.0007) [2023-12-26 00:28:09,144][123091] Updated weights for policy 0, policy_version 111184 (0.0006) [2023-12-26 00:28:09,203][123091] Updated weights for policy 0, policy_version 111194 (0.0006) [2023-12-26 00:28:09,352][123090] Updated weights for policy 1, policy_version 110730 (0.0009) [2023-12-26 00:28:09,427][123090] Updated weights for policy 1, policy_version 110740 (0.0010) [2023-12-26 00:28:09,492][123090] Updated weights for policy 1, policy_version 110750 (0.0010) [2023-12-26 00:28:10,013][123091] Updated weights for policy 0, policy_version 111204 (0.0009) [2023-12-26 00:28:10,084][123091] Updated weights for policy 0, policy_version 111214 (0.0009) [2023-12-26 00:28:10,150][123091] Updated weights for policy 0, policy_version 111224 (0.0009) [2023-12-26 00:28:10,334][123090] Updated weights for policy 1, policy_version 110760 (0.0009) [2023-12-26 00:28:10,396][123090] Updated weights for policy 1, policy_version 110770 (0.0008) [2023-12-26 00:28:10,457][123090] Updated weights for policy 1, policy_version 110780 (0.0009) [2023-12-26 00:28:10,941][123091] Updated weights for policy 0, policy_version 111234 (0.0008) [2023-12-26 00:28:11,014][123091] Updated weights for policy 0, policy_version 111244 (0.0006) [2023-12-26 00:28:11,080][123091] Updated weights for policy 0, policy_version 111254 (0.0009) [2023-12-26 00:28:11,136][123091] Updated weights for policy 0, policy_version 111264 (0.0009) [2023-12-26 00:28:11,343][123090] Updated weights for policy 1, policy_version 110790 (0.0009) [2023-12-26 00:28:11,418][123090] Updated weights for policy 1, policy_version 110800 (0.0008) [2023-12-26 00:28:11,492][123090] Updated weights for policy 1, policy_version 110810 (0.0007) [2023-12-26 00:28:11,942][123091] Updated weights for policy 0, policy_version 111274 (0.0010) [2023-12-26 00:28:12,003][123091] Updated weights for policy 0, policy_version 111284 (0.0010) [2023-12-26 00:28:12,055][123091] Updated weights for policy 0, policy_version 111294 (0.0009) [2023-12-26 00:28:12,248][123090] Updated weights for policy 1, policy_version 110820 (0.0009) [2023-12-26 00:28:12,319][123090] Updated weights for policy 1, policy_version 110830 (0.0009) [2023-12-26 00:28:12,393][123090] Updated weights for policy 1, policy_version 110840 (0.0008) [2023-12-26 00:28:12,944][123091] Updated weights for policy 0, policy_version 111304 (0.0010) [2023-12-26 00:28:12,999][123091] Updated weights for policy 0, policy_version 111314 (0.0009) [2023-12-26 00:28:13,056][123091] Updated weights for policy 0, policy_version 111324 (0.0009) [2023-12-26 00:28:13,235][123090] Updated weights for policy 1, policy_version 110850 (0.0009) [2023-12-26 00:28:13,294][123090] Updated weights for policy 1, policy_version 110860 (0.0009) [2023-12-26 00:28:13,355][123090] Updated weights for policy 1, policy_version 110870 (0.0009) [2023-12-26 00:28:13,422][123090] Updated weights for policy 1, policy_version 110880 (0.0009) [2023-12-26 00:28:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 56885248. Throughput: 0: 9004.4, 1: 8685.2. Samples: 56881436. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:13,784][121949] Avg episode reward: [(0, '5238.612'), (1, '5248.350')] [2023-12-26 00:28:13,785][123007] Saving new best policy, reward=5238.612! [2023-12-26 00:28:13,905][123091] Updated weights for policy 0, policy_version 111334 (0.0010) [2023-12-26 00:28:13,977][123091] Updated weights for policy 0, policy_version 111344 (0.0009) [2023-12-26 00:28:14,044][123091] Updated weights for policy 0, policy_version 111354 (0.0010) [2023-12-26 00:28:14,179][123090] Updated weights for policy 1, policy_version 110890 (0.0009) [2023-12-26 00:28:14,235][123090] Updated weights for policy 1, policy_version 110900 (0.0008) [2023-12-26 00:28:14,286][123090] Updated weights for policy 1, policy_version 110910 (0.0007) [2023-12-26 00:28:14,877][123091] Updated weights for policy 0, policy_version 111364 (0.0008) [2023-12-26 00:28:14,950][123091] Updated weights for policy 0, policy_version 111374 (0.0007) [2023-12-26 00:28:15,020][123091] Updated weights for policy 0, policy_version 111384 (0.0009) [2023-12-26 00:28:15,139][123090] Updated weights for policy 1, policy_version 110920 (0.0010) [2023-12-26 00:28:15,196][123090] Updated weights for policy 1, policy_version 110930 (0.0009) [2023-12-26 00:28:15,249][123090] Updated weights for policy 1, policy_version 110940 (0.0010) [2023-12-26 00:28:15,790][123091] Updated weights for policy 0, policy_version 111394 (0.0010) [2023-12-26 00:28:15,848][123091] Updated weights for policy 0, policy_version 111404 (0.0008) [2023-12-26 00:28:15,907][123091] Updated weights for policy 0, policy_version 111414 (0.0009) [2023-12-26 00:28:15,960][123091] Updated weights for policy 0, policy_version 111424 (0.0010) [2023-12-26 00:28:16,077][123090] Updated weights for policy 1, policy_version 110950 (0.0007) [2023-12-26 00:28:16,143][123090] Updated weights for policy 1, policy_version 110960 (0.0006) [2023-12-26 00:28:16,206][123090] Updated weights for policy 1, policy_version 110970 (0.0010) [2023-12-26 00:28:16,835][123091] Updated weights for policy 0, policy_version 111434 (0.0009) [2023-12-26 00:28:16,893][123091] Updated weights for policy 0, policy_version 111444 (0.0007) [2023-12-26 00:28:16,921][123090] Updated weights for policy 1, policy_version 110980 (0.0010) [2023-12-26 00:28:16,957][123091] Updated weights for policy 0, policy_version 111454 (0.0006) [2023-12-26 00:28:16,972][123090] Updated weights for policy 1, policy_version 110990 (0.0010) [2023-12-26 00:28:17,020][123090] Updated weights for policy 1, policy_version 111000 (0.0010) [2023-12-26 00:28:17,727][123090] Updated weights for policy 1, policy_version 111010 (0.0009) [2023-12-26 00:28:17,784][123090] Updated weights for policy 1, policy_version 111020 (0.0005) [2023-12-26 00:28:17,824][123091] Updated weights for policy 0, policy_version 111464 (0.0007) [2023-12-26 00:28:17,846][123090] Updated weights for policy 1, policy_version 111030 (0.0008) [2023-12-26 00:28:17,881][123091] Updated weights for policy 0, policy_version 111474 (0.0009) [2023-12-26 00:28:17,896][123090] Updated weights for policy 1, policy_version 111040 (0.0006) [2023-12-26 00:28:17,940][123091] Updated weights for policy 0, policy_version 111484 (0.0008) [2023-12-26 00:28:18,656][123090] Updated weights for policy 1, policy_version 111050 (0.0009) [2023-12-26 00:28:18,716][123090] Updated weights for policy 1, policy_version 111060 (0.0008) [2023-12-26 00:28:18,777][123090] Updated weights for policy 1, policy_version 111070 (0.0009) [2023-12-26 00:28:18,784][121949] Fps is (10 sec: 16384.6, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 56967168. Throughput: 0: 8883.5, 1: 8800.0. Samples: 56986216. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:18,784][121949] Avg episode reward: [(0, '5200.588'), (1, '5407.073')] [2023-12-26 00:28:18,793][123091] Updated weights for policy 0, policy_version 111494 (0.0008) [2023-12-26 00:28:18,860][123091] Updated weights for policy 0, policy_version 111504 (0.0010) [2023-12-26 00:28:18,928][123091] Updated weights for policy 0, policy_version 111514 (0.0009) [2023-12-26 00:28:19,640][123090] Updated weights for policy 1, policy_version 111080 (0.0009) [2023-12-26 00:28:19,713][123090] Updated weights for policy 1, policy_version 111090 (0.0010) [2023-12-26 00:28:19,745][123091] Updated weights for policy 0, policy_version 111524 (0.0008) [2023-12-26 00:28:19,777][123090] Updated weights for policy 1, policy_version 111100 (0.0009) [2023-12-26 00:28:19,807][123091] Updated weights for policy 0, policy_version 111534 (0.0009) [2023-12-26 00:28:19,881][123091] Updated weights for policy 0, policy_version 111544 (0.0008) [2023-12-26 00:28:20,645][123091] Updated weights for policy 0, policy_version 111554 (0.0008) [2023-12-26 00:28:20,657][123090] Updated weights for policy 1, policy_version 111110 (0.0008) [2023-12-26 00:28:20,710][123091] Updated weights for policy 0, policy_version 111564 (0.0008) [2023-12-26 00:28:20,722][123090] Updated weights for policy 1, policy_version 111120 (0.0009) [2023-12-26 00:28:20,778][123091] Updated weights for policy 0, policy_version 111574 (0.0008) [2023-12-26 00:28:20,786][123090] Updated weights for policy 1, policy_version 111130 (0.0008) [2023-12-26 00:28:20,834][123091] Updated weights for policy 0, policy_version 111584 (0.0008) [2023-12-26 00:28:21,628][123090] Updated weights for policy 1, policy_version 111140 (0.0009) [2023-12-26 00:28:21,636][123091] Updated weights for policy 0, policy_version 111594 (0.0010) [2023-12-26 00:28:21,689][123090] Updated weights for policy 1, policy_version 111150 (0.0009) [2023-12-26 00:28:21,696][123091] Updated weights for policy 0, policy_version 111604 (0.0007) [2023-12-26 00:28:21,762][123090] Updated weights for policy 1, policy_version 111160 (0.0009) [2023-12-26 00:28:21,770][123091] Updated weights for policy 0, policy_version 111614 (0.0008) [2023-12-26 00:28:22,621][123091] Updated weights for policy 0, policy_version 111624 (0.0009) [2023-12-26 00:28:22,629][123090] Updated weights for policy 1, policy_version 111170 (0.0010) [2023-12-26 00:28:22,674][123091] Updated weights for policy 0, policy_version 111634 (0.0009) [2023-12-26 00:28:22,694][123090] Updated weights for policy 1, policy_version 111180 (0.0007) [2023-12-26 00:28:22,737][123091] Updated weights for policy 0, policy_version 111644 (0.0009) [2023-12-26 00:28:22,758][123090] Updated weights for policy 1, policy_version 111190 (0.0008) [2023-12-26 00:28:22,822][123090] Updated weights for policy 1, policy_version 111200 (0.0009) [2023-12-26 00:28:23,575][123091] Updated weights for policy 0, policy_version 111654 (0.0011) [2023-12-26 00:28:23,629][123091] Updated weights for policy 0, policy_version 111664 (0.0010) [2023-12-26 00:28:23,643][123090] Updated weights for policy 1, policy_version 111210 (0.0009) [2023-12-26 00:28:23,683][123091] Updated weights for policy 0, policy_version 111674 (0.0010) [2023-12-26 00:28:23,708][123090] Updated weights for policy 1, policy_version 111220 (0.0008) [2023-12-26 00:28:23,763][123090] Updated weights for policy 1, policy_version 111230 (0.0010) [2023-12-26 00:28:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 57065472. Throughput: 0: 8803.1, 1: 8803.9. Samples: 57036748. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:23,785][121949] Avg episode reward: [(0, '5199.592'), (1, '5379.992')] [2023-12-26 00:28:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000111680_28590080.pth... [2023-12-26 00:28:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000111232_28475392.pth... [2023-12-26 00:28:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000110656_28327936.pth [2023-12-26 00:28:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000110176_28205056.pth [2023-12-26 00:28:24,329][123091] Updated weights for policy 0, policy_version 111684 (0.0008) [2023-12-26 00:28:24,388][123091] Updated weights for policy 0, policy_version 111694 (0.0005) [2023-12-26 00:28:24,443][123091] Updated weights for policy 0, policy_version 111704 (0.0005) [2023-12-26 00:28:24,536][123090] Updated weights for policy 1, policy_version 111241 (0.0010) [2023-12-26 00:28:24,591][123090] Updated weights for policy 1, policy_version 111252 (0.0010) [2023-12-26 00:28:24,646][123090] Updated weights for policy 1, policy_version 111262 (0.0010) [2023-12-26 00:28:25,236][123091] Updated weights for policy 0, policy_version 111714 (0.0006) [2023-12-26 00:28:25,299][123091] Updated weights for policy 0, policy_version 111724 (0.0006) [2023-12-26 00:28:25,367][123091] Updated weights for policy 0, policy_version 111734 (0.0006) [2023-12-26 00:28:25,412][123090] Updated weights for policy 1, policy_version 111272 (0.0009) [2023-12-26 00:28:25,427][123091] Updated weights for policy 0, policy_version 111744 (0.0007) [2023-12-26 00:28:25,475][123090] Updated weights for policy 1, policy_version 111282 (0.0005) [2023-12-26 00:28:25,538][123090] Updated weights for policy 1, policy_version 111292 (0.0009) [2023-12-26 00:28:26,122][123091] Updated weights for policy 0, policy_version 111754 (0.0005) [2023-12-26 00:28:26,177][123091] Updated weights for policy 0, policy_version 111764 (0.0005) [2023-12-26 00:28:26,226][123091] Updated weights for policy 0, policy_version 111774 (0.0006) [2023-12-26 00:28:26,303][123090] Updated weights for policy 1, policy_version 111302 (0.0007) [2023-12-26 00:28:26,350][123090] Updated weights for policy 1, policy_version 111312 (0.0005) [2023-12-26 00:28:26,405][123090] Updated weights for policy 1, policy_version 111322 (0.0005) [2023-12-26 00:28:26,934][123091] Updated weights for policy 0, policy_version 111784 (0.0006) [2023-12-26 00:28:26,985][123091] Updated weights for policy 0, policy_version 111794 (0.0005) [2023-12-26 00:28:27,034][123091] Updated weights for policy 0, policy_version 111804 (0.0006) [2023-12-26 00:28:27,087][123090] Updated weights for policy 1, policy_version 111332 (0.0005) [2023-12-26 00:28:27,156][123090] Updated weights for policy 1, policy_version 111342 (0.0005) [2023-12-26 00:28:27,208][123090] Updated weights for policy 1, policy_version 111352 (0.0005) [2023-12-26 00:28:27,722][123091] Updated weights for policy 0, policy_version 111814 (0.0009) [2023-12-26 00:28:27,769][123091] Updated weights for policy 0, policy_version 111824 (0.0009) [2023-12-26 00:28:27,819][123091] Updated weights for policy 0, policy_version 111834 (0.0010) [2023-12-26 00:28:27,873][123090] Updated weights for policy 1, policy_version 111362 (0.0005) [2023-12-26 00:28:27,924][123090] Updated weights for policy 1, policy_version 111372 (0.0006) [2023-12-26 00:28:27,979][123090] Updated weights for policy 1, policy_version 111382 (0.0006) [2023-12-26 00:28:28,043][123090] Updated weights for policy 1, policy_version 111392 (0.0006) [2023-12-26 00:28:28,566][123091] Updated weights for policy 0, policy_version 111844 (0.0010) [2023-12-26 00:28:28,613][123091] Updated weights for policy 0, policy_version 111854 (0.0010) [2023-12-26 00:28:28,664][123091] Updated weights for policy 0, policy_version 111864 (0.0010) [2023-12-26 00:28:28,730][123090] Updated weights for policy 1, policy_version 111402 (0.0005) [2023-12-26 00:28:28,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 57155584. Throughput: 0: 8891.2, 1: 8917.8. Samples: 57148212. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:28,785][121949] Avg episode reward: [(0, '5195.463'), (1, '5498.994')] [2023-12-26 00:28:28,809][123090] Updated weights for policy 1, policy_version 111412 (0.0009) [2023-12-26 00:28:28,878][123090] Updated weights for policy 1, policy_version 111422 (0.0010) [2023-12-26 00:28:29,469][123091] Updated weights for policy 0, policy_version 111874 (0.0007) [2023-12-26 00:28:29,519][123091] Updated weights for policy 0, policy_version 111884 (0.0005) [2023-12-26 00:28:29,584][123091] Updated weights for policy 0, policy_version 111894 (0.0006) [2023-12-26 00:28:29,627][123090] Updated weights for policy 1, policy_version 111432 (0.0006) [2023-12-26 00:28:29,651][123091] Updated weights for policy 0, policy_version 111904 (0.0006) [2023-12-26 00:28:29,698][123090] Updated weights for policy 1, policy_version 111442 (0.0006) [2023-12-26 00:28:29,752][123090] Updated weights for policy 1, policy_version 111452 (0.0006) [2023-12-26 00:28:30,344][123091] Updated weights for policy 0, policy_version 111914 (0.0005) [2023-12-26 00:28:30,410][123091] Updated weights for policy 0, policy_version 111924 (0.0005) [2023-12-26 00:28:30,470][123091] Updated weights for policy 0, policy_version 111934 (0.0005) [2023-12-26 00:28:30,566][123090] Updated weights for policy 1, policy_version 111462 (0.0009) [2023-12-26 00:28:30,632][123090] Updated weights for policy 1, policy_version 111472 (0.0010) [2023-12-26 00:28:30,685][123090] Updated weights for policy 1, policy_version 111482 (0.0010) [2023-12-26 00:28:31,101][123091] Updated weights for policy 0, policy_version 111944 (0.0006) [2023-12-26 00:28:31,170][123091] Updated weights for policy 0, policy_version 111954 (0.0008) [2023-12-26 00:28:31,240][123091] Updated weights for policy 0, policy_version 111964 (0.0006) [2023-12-26 00:28:31,593][123090] Updated weights for policy 1, policy_version 111492 (0.0008) [2023-12-26 00:28:31,659][123090] Updated weights for policy 1, policy_version 111502 (0.0008) [2023-12-26 00:28:31,728][123090] Updated weights for policy 1, policy_version 111512 (0.0008) [2023-12-26 00:28:32,035][123091] Updated weights for policy 0, policy_version 111974 (0.0010) [2023-12-26 00:28:32,084][123091] Updated weights for policy 0, policy_version 111984 (0.0009) [2023-12-26 00:28:32,142][123091] Updated weights for policy 0, policy_version 111994 (0.0009) [2023-12-26 00:28:32,517][123090] Updated weights for policy 1, policy_version 111522 (0.0006) [2023-12-26 00:28:32,575][123090] Updated weights for policy 1, policy_version 111532 (0.0008) [2023-12-26 00:28:32,641][123090] Updated weights for policy 1, policy_version 111542 (0.0008) [2023-12-26 00:28:32,701][123090] Updated weights for policy 1, policy_version 111552 (0.0008) [2023-12-26 00:28:33,058][123091] Updated weights for policy 0, policy_version 112004 (0.0009) [2023-12-26 00:28:33,121][123091] Updated weights for policy 0, policy_version 112014 (0.0008) [2023-12-26 00:28:33,185][123091] Updated weights for policy 0, policy_version 112024 (0.0008) [2023-12-26 00:28:33,349][123090] Updated weights for policy 1, policy_version 111562 (0.0009) [2023-12-26 00:28:33,399][123090] Updated weights for policy 1, policy_version 111572 (0.0009) [2023-12-26 00:28:33,458][123090] Updated weights for policy 1, policy_version 111582 (0.0009) [2023-12-26 00:28:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 57245696. Throughput: 0: 8852.9, 1: 8949.5. Samples: 57257832. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:33,785][121949] Avg episode reward: [(0, '5141.095'), (1, '5516.692')] [2023-12-26 00:28:34,041][123091] Updated weights for policy 0, policy_version 112034 (0.0010) [2023-12-26 00:28:34,113][123091] Updated weights for policy 0, policy_version 112044 (0.0009) [2023-12-26 00:28:34,132][123090] Updated weights for policy 1, policy_version 111592 (0.0007) [2023-12-26 00:28:34,184][123091] Updated weights for policy 0, policy_version 112054 (0.0008) [2023-12-26 00:28:34,203][123090] Updated weights for policy 1, policy_version 111602 (0.0008) [2023-12-26 00:28:34,255][123091] Updated weights for policy 0, policy_version 112064 (0.0006) [2023-12-26 00:28:34,272][123090] Updated weights for policy 1, policy_version 111612 (0.0010) [2023-12-26 00:28:35,029][123091] Updated weights for policy 0, policy_version 112074 (0.0009) [2023-12-26 00:28:35,036][123090] Updated weights for policy 1, policy_version 111622 (0.0011) [2023-12-26 00:28:35,078][123091] Updated weights for policy 0, policy_version 112084 (0.0006) [2023-12-26 00:28:35,088][123090] Updated weights for policy 1, policy_version 111632 (0.0010) [2023-12-26 00:28:35,128][123091] Updated weights for policy 0, policy_version 112094 (0.0010) [2023-12-26 00:28:35,139][123090] Updated weights for policy 1, policy_version 111642 (0.0010) [2023-12-26 00:28:35,849][123090] Updated weights for policy 1, policy_version 111652 (0.0010) [2023-12-26 00:28:35,900][123090] Updated weights for policy 1, policy_version 111662 (0.0010) [2023-12-26 00:28:35,959][123090] Updated weights for policy 1, policy_version 111672 (0.0010) [2023-12-26 00:28:36,020][123091] Updated weights for policy 0, policy_version 112104 (0.0008) [2023-12-26 00:28:36,076][123091] Updated weights for policy 0, policy_version 112114 (0.0009) [2023-12-26 00:28:36,135][123091] Updated weights for policy 0, policy_version 112124 (0.0010) [2023-12-26 00:28:36,792][123090] Updated weights for policy 1, policy_version 111682 (0.0008) [2023-12-26 00:28:36,853][123090] Updated weights for policy 1, policy_version 111693 (0.0010) [2023-12-26 00:28:36,918][123090] Updated weights for policy 1, policy_version 111703 (0.0011) [2023-12-26 00:28:37,053][123091] Updated weights for policy 0, policy_version 112134 (0.0010) [2023-12-26 00:28:37,098][123091] Updated weights for policy 0, policy_version 112144 (0.0010) [2023-12-26 00:28:37,148][123091] Updated weights for policy 0, policy_version 112154 (0.0008) [2023-12-26 00:28:37,767][123090] Updated weights for policy 1, policy_version 111713 (0.0011) [2023-12-26 00:28:37,820][123090] Updated weights for policy 1, policy_version 111723 (0.0010) [2023-12-26 00:28:37,876][123090] Updated weights for policy 1, policy_version 111733 (0.0010) [2023-12-26 00:28:37,913][123091] Updated weights for policy 0, policy_version 112164 (0.0005) [2023-12-26 00:28:37,935][123090] Updated weights for policy 1, policy_version 111743 (0.0010) [2023-12-26 00:28:37,982][123091] Updated weights for policy 0, policy_version 112174 (0.0010) [2023-12-26 00:28:38,044][123091] Updated weights for policy 0, policy_version 112184 (0.0011) [2023-12-26 00:28:38,770][123090] Updated weights for policy 1, policy_version 111753 (0.0006) [2023-12-26 00:28:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 57327616. Throughput: 0: 8817.0, 1: 9002.4. Samples: 57310444. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 00:28:38,785][121949] Avg episode reward: [(0, '5131.288'), (1, '5546.536')] [2023-12-26 00:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000112192_28721152.pth... [2023-12-26 00:28:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000111168_28459008.pth [2023-12-26 00:28:38,833][123091] Updated weights for policy 0, policy_version 112194 (0.0011) [2023-12-26 00:28:38,834][123090] Updated weights for policy 1, policy_version 111763 (0.0008) [2023-12-26 00:28:38,889][123091] Updated weights for policy 0, policy_version 112204 (0.0011) [2023-12-26 00:28:38,896][123090] Updated weights for policy 1, policy_version 111773 (0.0008) [2023-12-26 00:28:38,913][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000111776_28614656.pth... [2023-12-26 00:28:38,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000110720_28344320.pth [2023-12-26 00:28:38,949][123091] Updated weights for policy 0, policy_version 112214 (0.0011) [2023-12-26 00:28:39,011][123091] Updated weights for policy 0, policy_version 112224 (0.0011) [2023-12-26 00:28:39,653][123090] Updated weights for policy 1, policy_version 111783 (0.0007) [2023-12-26 00:28:39,712][123090] Updated weights for policy 1, policy_version 111793 (0.0010) [2023-12-26 00:28:39,765][123090] Updated weights for policy 1, policy_version 111803 (0.0010) [2023-12-26 00:28:39,823][123091] Updated weights for policy 0, policy_version 112234 (0.0006) [2023-12-26 00:28:39,893][123091] Updated weights for policy 0, policy_version 112244 (0.0009) [2023-12-26 00:28:39,968][123091] Updated weights for policy 0, policy_version 112254 (0.0007) [2023-12-26 00:28:40,498][123090] Updated weights for policy 1, policy_version 111813 (0.0008) [2023-12-26 00:28:40,572][123090] Updated weights for policy 1, policy_version 111823 (0.0006) [2023-12-26 00:28:40,644][123090] Updated weights for policy 1, policy_version 111833 (0.0006) [2023-12-26 00:28:40,765][123091] Updated weights for policy 0, policy_version 112264 (0.0006) [2023-12-26 00:28:40,819][123091] Updated weights for policy 0, policy_version 112274 (0.0006) [2023-12-26 00:28:40,878][123091] Updated weights for policy 0, policy_version 112284 (0.0007) [2023-12-26 00:28:41,416][123090] Updated weights for policy 1, policy_version 111843 (0.0007) [2023-12-26 00:28:41,482][123090] Updated weights for policy 1, policy_version 111853 (0.0008) [2023-12-26 00:28:41,550][123090] Updated weights for policy 1, policy_version 111863 (0.0007) [2023-12-26 00:28:41,702][123091] Updated weights for policy 0, policy_version 112294 (0.0009) [2023-12-26 00:28:41,764][123091] Updated weights for policy 0, policy_version 112304 (0.0008) [2023-12-26 00:28:41,831][123091] Updated weights for policy 0, policy_version 112314 (0.0008) [2023-12-26 00:28:42,325][123090] Updated weights for policy 1, policy_version 111873 (0.0007) [2023-12-26 00:28:42,396][123090] Updated weights for policy 1, policy_version 111883 (0.0009) [2023-12-26 00:28:42,458][123090] Updated weights for policy 1, policy_version 111893 (0.0009) [2023-12-26 00:28:42,528][123090] Updated weights for policy 1, policy_version 111903 (0.0009) [2023-12-26 00:28:42,593][123091] Updated weights for policy 0, policy_version 112324 (0.0008) [2023-12-26 00:28:42,661][123091] Updated weights for policy 0, policy_version 112334 (0.0005) [2023-12-26 00:28:42,721][123091] Updated weights for policy 0, policy_version 112344 (0.0007) [2023-12-26 00:28:43,354][123090] Updated weights for policy 1, policy_version 111913 (0.0008) [2023-12-26 00:28:43,419][123090] Updated weights for policy 1, policy_version 111923 (0.0006) [2023-12-26 00:28:43,479][123090] Updated weights for policy 1, policy_version 111933 (0.0006) [2023-12-26 00:28:43,519][123091] Updated weights for policy 0, policy_version 112354 (0.0010) [2023-12-26 00:28:43,574][123091] Updated weights for policy 0, policy_version 112364 (0.0010) [2023-12-26 00:28:43,629][123091] Updated weights for policy 0, policy_version 112374 (0.0010) [2023-12-26 00:28:43,682][123091] Updated weights for policy 0, policy_version 112384 (0.0010) [2023-12-26 00:28:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 57425920. Throughput: 0: 8841.6, 1: 8829.4. Samples: 57415688. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:28:43,785][121949] Avg episode reward: [(0, '5107.572'), (1, '5578.167')] [2023-12-26 00:28:44,196][123090] Updated weights for policy 1, policy_version 111943 (0.0007) [2023-12-26 00:28:44,262][123090] Updated weights for policy 1, policy_version 111953 (0.0007) [2023-12-26 00:28:44,335][123090] Updated weights for policy 1, policy_version 111963 (0.0006) [2023-12-26 00:28:44,567][123091] Updated weights for policy 0, policy_version 112394 (0.0005) [2023-12-26 00:28:44,615][123091] Updated weights for policy 0, policy_version 112404 (0.0005) [2023-12-26 00:28:44,661][123091] Updated weights for policy 0, policy_version 112414 (0.0010) [2023-12-26 00:28:45,064][123090] Updated weights for policy 1, policy_version 111973 (0.0008) [2023-12-26 00:28:45,128][123090] Updated weights for policy 1, policy_version 111983 (0.0011) [2023-12-26 00:28:45,196][123090] Updated weights for policy 1, policy_version 111993 (0.0010) [2023-12-26 00:28:45,454][123091] Updated weights for policy 0, policy_version 112424 (0.0011) [2023-12-26 00:28:45,521][123091] Updated weights for policy 0, policy_version 112434 (0.0011) [2023-12-26 00:28:45,585][123091] Updated weights for policy 0, policy_version 112444 (0.0011) [2023-12-26 00:28:46,024][123090] Updated weights for policy 1, policy_version 112003 (0.0011) [2023-12-26 00:28:46,077][123090] Updated weights for policy 1, policy_version 112013 (0.0006) [2023-12-26 00:28:46,154][123090] Updated weights for policy 1, policy_version 112023 (0.0006) [2023-12-26 00:28:46,245][123091] Updated weights for policy 0, policy_version 112454 (0.0008) [2023-12-26 00:28:46,293][123091] Updated weights for policy 0, policy_version 112464 (0.0006) [2023-12-26 00:28:46,340][123091] Updated weights for policy 0, policy_version 112474 (0.0005) [2023-12-26 00:28:46,868][123090] Updated weights for policy 1, policy_version 112033 (0.0005) [2023-12-26 00:28:46,928][123090] Updated weights for policy 1, policy_version 112043 (0.0005) [2023-12-26 00:28:46,978][123090] Updated weights for policy 1, policy_version 112053 (0.0006) [2023-12-26 00:28:46,981][123091] Updated weights for policy 0, policy_version 112484 (0.0005) [2023-12-26 00:28:47,031][123090] Updated weights for policy 1, policy_version 112063 (0.0006) [2023-12-26 00:28:47,045][123091] Updated weights for policy 0, policy_version 112494 (0.0005) [2023-12-26 00:28:47,094][123091] Updated weights for policy 0, policy_version 112504 (0.0005) [2023-12-26 00:28:47,725][123090] Updated weights for policy 1, policy_version 112073 (0.0005) [2023-12-26 00:28:47,751][123091] Updated weights for policy 0, policy_version 112514 (0.0005) [2023-12-26 00:28:47,779][123090] Updated weights for policy 1, policy_version 112083 (0.0005) [2023-12-26 00:28:47,805][123091] Updated weights for policy 0, policy_version 112524 (0.0005) [2023-12-26 00:28:47,829][123090] Updated weights for policy 1, policy_version 112093 (0.0005) [2023-12-26 00:28:47,864][123091] Updated weights for policy 0, policy_version 112534 (0.0008) [2023-12-26 00:28:47,912][123091] Updated weights for policy 0, policy_version 112544 (0.0010) [2023-12-26 00:28:48,489][123090] Updated weights for policy 1, policy_version 112103 (0.0006) [2023-12-26 00:28:48,548][123090] Updated weights for policy 1, policy_version 112113 (0.0006) [2023-12-26 00:28:48,611][123090] Updated weights for policy 1, policy_version 112123 (0.0007) [2023-12-26 00:28:48,672][123091] Updated weights for policy 0, policy_version 112554 (0.0011) [2023-12-26 00:28:48,728][123091] Updated weights for policy 0, policy_version 112564 (0.0009) [2023-12-26 00:28:48,782][123091] Updated weights for policy 0, policy_version 112574 (0.0005) [2023-12-26 00:28:48,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 57516032. Throughput: 0: 8884.9, 1: 8976.5. Samples: 57529532. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:28:48,785][121949] Avg episode reward: [(0, '5011.354'), (1, '5626.317')] [2023-12-26 00:28:49,337][123090] Updated weights for policy 1, policy_version 112133 (0.0010) [2023-12-26 00:28:49,406][123090] Updated weights for policy 1, policy_version 112143 (0.0007) [2023-12-26 00:28:49,473][123090] Updated weights for policy 1, policy_version 112153 (0.0008) [2023-12-26 00:28:49,564][123091] Updated weights for policy 0, policy_version 112584 (0.0007) [2023-12-26 00:28:49,627][123091] Updated weights for policy 0, policy_version 112594 (0.0009) [2023-12-26 00:28:49,691][123091] Updated weights for policy 0, policy_version 112604 (0.0009) [2023-12-26 00:28:50,268][123090] Updated weights for policy 1, policy_version 112163 (0.0011) [2023-12-26 00:28:50,345][123090] Updated weights for policy 1, policy_version 112173 (0.0009) [2023-12-26 00:28:50,406][123091] Updated weights for policy 0, policy_version 112614 (0.0010) [2023-12-26 00:28:50,415][123090] Updated weights for policy 1, policy_version 112183 (0.0007) [2023-12-26 00:28:50,465][123091] Updated weights for policy 0, policy_version 112624 (0.0008) [2023-12-26 00:28:50,534][123091] Updated weights for policy 0, policy_version 112634 (0.0010) [2023-12-26 00:28:51,146][123090] Updated weights for policy 1, policy_version 112193 (0.0009) [2023-12-26 00:28:51,218][123090] Updated weights for policy 1, policy_version 112203 (0.0006) [2023-12-26 00:28:51,254][123091] Updated weights for policy 0, policy_version 112644 (0.0009) [2023-12-26 00:28:51,283][123090] Updated weights for policy 1, policy_version 112213 (0.0009) [2023-12-26 00:28:51,320][123091] Updated weights for policy 0, policy_version 112654 (0.0008) [2023-12-26 00:28:51,348][123090] Updated weights for policy 1, policy_version 112223 (0.0008) [2023-12-26 00:28:51,393][123091] Updated weights for policy 0, policy_version 112664 (0.0009) [2023-12-26 00:28:52,189][123091] Updated weights for policy 0, policy_version 112674 (0.0008) [2023-12-26 00:28:52,192][123090] Updated weights for policy 1, policy_version 112233 (0.0010) [2023-12-26 00:28:52,258][123090] Updated weights for policy 1, policy_version 112243 (0.0009) [2023-12-26 00:28:52,262][123091] Updated weights for policy 0, policy_version 112684 (0.0011) [2023-12-26 00:28:52,313][123090] Updated weights for policy 1, policy_version 112253 (0.0006) [2023-12-26 00:28:52,326][123091] Updated weights for policy 0, policy_version 112694 (0.0011) [2023-12-26 00:28:52,395][123091] Updated weights for policy 0, policy_version 112704 (0.0010) [2023-12-26 00:28:52,939][123090] Updated weights for policy 1, policy_version 112263 (0.0006) [2023-12-26 00:28:53,011][123090] Updated weights for policy 1, policy_version 112273 (0.0006) [2023-12-26 00:28:53,081][123090] Updated weights for policy 1, policy_version 112283 (0.0005) [2023-12-26 00:28:53,202][123091] Updated weights for policy 0, policy_version 112714 (0.0010) [2023-12-26 00:28:53,256][123091] Updated weights for policy 0, policy_version 112724 (0.0009) [2023-12-26 00:28:53,305][123091] Updated weights for policy 0, policy_version 112734 (0.0009) [2023-12-26 00:28:53,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17885.8, 300 sec: 17772.4). Total num frames: 57606144. Throughput: 0: 8918.4, 1: 8990.7. Samples: 57583988. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:28:53,786][121949] Avg episode reward: [(0, '5081.861'), (1, '5701.259')] [2023-12-26 00:28:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000112736_28860416.pth... [2023-12-26 00:28:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000111680_28590080.pth [2023-12-26 00:28:53,819][123090] Updated weights for policy 1, policy_version 112293 (0.0008) [2023-12-26 00:28:53,873][123090] Updated weights for policy 1, policy_version 112303 (0.0010) [2023-12-26 00:28:53,924][123090] Updated weights for policy 1, policy_version 112313 (0.0010) [2023-12-26 00:28:53,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000112320_28753920.pth... [2023-12-26 00:28:53,976][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000111232_28475392.pth [2023-12-26 00:28:54,162][123091] Updated weights for policy 0, policy_version 112744 (0.0010) [2023-12-26 00:28:54,207][123091] Updated weights for policy 0, policy_version 112754 (0.0008) [2023-12-26 00:28:54,260][123091] Updated weights for policy 0, policy_version 112764 (0.0008) [2023-12-26 00:28:54,788][123090] Updated weights for policy 1, policy_version 112323 (0.0009) [2023-12-26 00:28:54,856][123090] Updated weights for policy 1, policy_version 112333 (0.0005) [2023-12-26 00:28:54,920][123090] Updated weights for policy 1, policy_version 112343 (0.0006) [2023-12-26 00:28:55,065][123091] Updated weights for policy 0, policy_version 112774 (0.0010) [2023-12-26 00:28:55,127][123091] Updated weights for policy 0, policy_version 112784 (0.0010) [2023-12-26 00:28:55,181][123091] Updated weights for policy 0, policy_version 112795 (0.0010) [2023-12-26 00:28:55,540][123090] Updated weights for policy 1, policy_version 112353 (0.0006) [2023-12-26 00:28:55,596][123090] Updated weights for policy 1, policy_version 112363 (0.0010) [2023-12-26 00:28:55,643][123090] Updated weights for policy 1, policy_version 112373 (0.0010) [2023-12-26 00:28:55,691][123090] Updated weights for policy 1, policy_version 112383 (0.0010) [2023-12-26 00:28:55,975][123091] Updated weights for policy 0, policy_version 112806 (0.0007) [2023-12-26 00:28:56,025][123091] Updated weights for policy 0, policy_version 112816 (0.0005) [2023-12-26 00:28:56,081][123091] Updated weights for policy 0, policy_version 112826 (0.0005) [2023-12-26 00:28:56,542][123090] Updated weights for policy 1, policy_version 112393 (0.0010) [2023-12-26 00:28:56,601][123090] Updated weights for policy 1, policy_version 112403 (0.0010) [2023-12-26 00:28:56,653][123090] Updated weights for policy 1, policy_version 112413 (0.0010) [2023-12-26 00:28:56,755][123091] Updated weights for policy 0, policy_version 112836 (0.0005) [2023-12-26 00:28:56,809][123091] Updated weights for policy 0, policy_version 112846 (0.0010) [2023-12-26 00:28:56,864][123091] Updated weights for policy 0, policy_version 112856 (0.0010) [2023-12-26 00:28:57,421][123090] Updated weights for policy 1, policy_version 112423 (0.0007) [2023-12-26 00:28:57,479][123090] Updated weights for policy 1, policy_version 112433 (0.0006) [2023-12-26 00:28:57,536][123090] Updated weights for policy 1, policy_version 112443 (0.0006) [2023-12-26 00:28:57,587][123091] Updated weights for policy 0, policy_version 112866 (0.0009) [2023-12-26 00:28:57,644][123091] Updated weights for policy 0, policy_version 112876 (0.0006) [2023-12-26 00:28:57,691][123091] Updated weights for policy 0, policy_version 112886 (0.0010) [2023-12-26 00:28:57,742][123091] Updated weights for policy 0, policy_version 112896 (0.0010) [2023-12-26 00:28:58,230][123090] Updated weights for policy 1, policy_version 112453 (0.0008) [2023-12-26 00:28:58,286][123090] Updated weights for policy 1, policy_version 112463 (0.0010) [2023-12-26 00:28:58,348][123090] Updated weights for policy 1, policy_version 112473 (0.0010) [2023-12-26 00:28:58,596][123091] Updated weights for policy 0, policy_version 112906 (0.0011) [2023-12-26 00:28:58,652][123091] Updated weights for policy 0, policy_version 112916 (0.0010) [2023-12-26 00:28:58,720][123091] Updated weights for policy 0, policy_version 112926 (0.0009) [2023-12-26 00:28:58,784][121949] Fps is (10 sec: 18840.9, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 57704448. Throughput: 0: 8979.4, 1: 9081.3. Samples: 57694172. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:28:58,785][121949] Avg episode reward: [(0, '5124.987'), (1, '5732.773')] [2023-12-26 00:28:58,786][123008] Saving new best policy, reward=5732.773! [2023-12-26 00:28:59,191][123090] Updated weights for policy 1, policy_version 112483 (0.0008) [2023-12-26 00:28:59,258][123090] Updated weights for policy 1, policy_version 112493 (0.0011) [2023-12-26 00:28:59,325][123090] Updated weights for policy 1, policy_version 112503 (0.0010) [2023-12-26 00:28:59,556][123091] Updated weights for policy 0, policy_version 112936 (0.0010) [2023-12-26 00:28:59,624][123091] Updated weights for policy 0, policy_version 112946 (0.0008) [2023-12-26 00:28:59,690][123091] Updated weights for policy 0, policy_version 112956 (0.0009) [2023-12-26 00:29:00,198][123090] Updated weights for policy 1, policy_version 112513 (0.0008) [2023-12-26 00:29:00,270][123090] Updated weights for policy 1, policy_version 112523 (0.0005) [2023-12-26 00:29:00,337][123090] Updated weights for policy 1, policy_version 112533 (0.0005) [2023-12-26 00:29:00,416][123090] Updated weights for policy 1, policy_version 112543 (0.0006) [2023-12-26 00:29:00,456][123091] Updated weights for policy 0, policy_version 112966 (0.0009) [2023-12-26 00:29:00,521][123091] Updated weights for policy 0, policy_version 112976 (0.0010) [2023-12-26 00:29:00,585][123091] Updated weights for policy 0, policy_version 112986 (0.0010) [2023-12-26 00:29:01,108][123090] Updated weights for policy 1, policy_version 112553 (0.0006) [2023-12-26 00:29:01,177][123090] Updated weights for policy 1, policy_version 112563 (0.0010) [2023-12-26 00:29:01,243][123090] Updated weights for policy 1, policy_version 112573 (0.0010) [2023-12-26 00:29:01,447][123091] Updated weights for policy 0, policy_version 112996 (0.0009) [2023-12-26 00:29:01,510][123091] Updated weights for policy 0, policy_version 113006 (0.0009) [2023-12-26 00:29:01,572][123091] Updated weights for policy 0, policy_version 113016 (0.0009) [2023-12-26 00:29:02,058][123090] Updated weights for policy 1, policy_version 112583 (0.0010) [2023-12-26 00:29:02,114][123090] Updated weights for policy 1, policy_version 112593 (0.0010) [2023-12-26 00:29:02,165][123090] Updated weights for policy 1, policy_version 112603 (0.0010) [2023-12-26 00:29:02,409][123091] Updated weights for policy 0, policy_version 113026 (0.0009) [2023-12-26 00:29:02,460][123091] Updated weights for policy 0, policy_version 113036 (0.0008) [2023-12-26 00:29:02,519][123091] Updated weights for policy 0, policy_version 113046 (0.0009) [2023-12-26 00:29:03,009][123090] Updated weights for policy 1, policy_version 112613 (0.0010) [2023-12-26 00:29:03,067][123090] Updated weights for policy 1, policy_version 112623 (0.0010) [2023-12-26 00:29:03,129][123090] Updated weights for policy 1, policy_version 112633 (0.0010) [2023-12-26 00:29:03,376][123091] Updated weights for policy 0, policy_version 113057 (0.0009) [2023-12-26 00:29:03,445][123091] Updated weights for policy 0, policy_version 113067 (0.0009) [2023-12-26 00:29:03,498][123091] Updated weights for policy 0, policy_version 113077 (0.0010) [2023-12-26 00:29:03,552][123091] Updated weights for policy 0, policy_version 113087 (0.0010) [2023-12-26 00:29:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 57786368. Throughput: 0: 8974.4, 1: 9059.2. Samples: 57797732. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:03,785][121949] Avg episode reward: [(0, '5073.586'), (1, '5695.416')] [2023-12-26 00:29:03,862][123090] Updated weights for policy 1, policy_version 112643 (0.0010) [2023-12-26 00:29:03,926][123090] Updated weights for policy 1, policy_version 112653 (0.0011) [2023-12-26 00:29:03,995][123090] Updated weights for policy 1, policy_version 112663 (0.0007) [2023-12-26 00:29:04,455][123091] Updated weights for policy 0, policy_version 113097 (0.0009) [2023-12-26 00:29:04,519][123091] Updated weights for policy 0, policy_version 113107 (0.0009) [2023-12-26 00:29:04,583][123091] Updated weights for policy 0, policy_version 113117 (0.0009) [2023-12-26 00:29:04,805][123090] Updated weights for policy 1, policy_version 112673 (0.0006) [2023-12-26 00:29:04,864][123090] Updated weights for policy 1, policy_version 112683 (0.0010) [2023-12-26 00:29:04,911][123090] Updated weights for policy 1, policy_version 112693 (0.0010) [2023-12-26 00:29:04,959][123090] Updated weights for policy 1, policy_version 112703 (0.0010) [2023-12-26 00:29:05,320][123091] Updated weights for policy 0, policy_version 113127 (0.0007) [2023-12-26 00:29:05,368][123091] Updated weights for policy 0, policy_version 113137 (0.0005) [2023-12-26 00:29:05,417][123091] Updated weights for policy 0, policy_version 113147 (0.0006) [2023-12-26 00:29:05,707][123090] Updated weights for policy 1, policy_version 112713 (0.0010) [2023-12-26 00:29:05,762][123090] Updated weights for policy 1, policy_version 112723 (0.0005) [2023-12-26 00:29:05,825][123090] Updated weights for policy 1, policy_version 112733 (0.0007) [2023-12-26 00:29:06,154][123091] Updated weights for policy 0, policy_version 113157 (0.0008) [2023-12-26 00:29:06,216][123091] Updated weights for policy 0, policy_version 113167 (0.0005) [2023-12-26 00:29:06,282][123091] Updated weights for policy 0, policy_version 113177 (0.0006) [2023-12-26 00:29:06,547][123090] Updated weights for policy 1, policy_version 112743 (0.0008) [2023-12-26 00:29:06,614][123090] Updated weights for policy 1, policy_version 112753 (0.0008) [2023-12-26 00:29:06,677][123090] Updated weights for policy 1, policy_version 112763 (0.0008) [2023-12-26 00:29:07,006][123091] Updated weights for policy 0, policy_version 113187 (0.0006) [2023-12-26 00:29:07,075][123091] Updated weights for policy 0, policy_version 113197 (0.0008) [2023-12-26 00:29:07,135][123091] Updated weights for policy 0, policy_version 113207 (0.0009) [2023-12-26 00:29:07,412][123090] Updated weights for policy 1, policy_version 112773 (0.0008) [2023-12-26 00:29:07,482][123090] Updated weights for policy 1, policy_version 112783 (0.0009) [2023-12-26 00:29:07,551][123090] Updated weights for policy 1, policy_version 112793 (0.0009) [2023-12-26 00:29:07,975][123091] Updated weights for policy 0, policy_version 113217 (0.0009) [2023-12-26 00:29:08,034][123091] Updated weights for policy 0, policy_version 113227 (0.0010) [2023-12-26 00:29:08,082][123091] Updated weights for policy 0, policy_version 113237 (0.0010) [2023-12-26 00:29:08,143][123091] Updated weights for policy 0, policy_version 113247 (0.0007) [2023-12-26 00:29:08,319][123090] Updated weights for policy 1, policy_version 112803 (0.0011) [2023-12-26 00:29:08,399][123090] Updated weights for policy 1, policy_version 112813 (0.0007) [2023-12-26 00:29:08,469][123090] Updated weights for policy 1, policy_version 112823 (0.0010) [2023-12-26 00:29:08,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 57876480. Throughput: 0: 9018.5, 1: 9125.0. Samples: 57853204. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:08,785][121949] Avg episode reward: [(0, '5161.098'), (1, '5573.029')] [2023-12-26 00:29:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000113248_28991488.pth... [2023-12-26 00:29:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000112832_28884992.pth... [2023-12-26 00:29:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000111776_28614656.pth [2023-12-26 00:29:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000112192_28721152.pth [2023-12-26 00:29:08,865][123091] Updated weights for policy 0, policy_version 113257 (0.0005) [2023-12-26 00:29:08,927][123091] Updated weights for policy 0, policy_version 113267 (0.0008) [2023-12-26 00:29:09,003][123091] Updated weights for policy 0, policy_version 113277 (0.0006) [2023-12-26 00:29:09,286][123090] Updated weights for policy 1, policy_version 112833 (0.0011) [2023-12-26 00:29:09,359][123090] Updated weights for policy 1, policy_version 112843 (0.0011) [2023-12-26 00:29:09,433][123090] Updated weights for policy 1, policy_version 112853 (0.0013) [2023-12-26 00:29:09,505][123090] Updated weights for policy 1, policy_version 112863 (0.0010) [2023-12-26 00:29:09,782][123091] Updated weights for policy 0, policy_version 113287 (0.0007) [2023-12-26 00:29:09,856][123091] Updated weights for policy 0, policy_version 113297 (0.0008) [2023-12-26 00:29:09,921][123091] Updated weights for policy 0, policy_version 113307 (0.0010) [2023-12-26 00:29:10,341][123090] Updated weights for policy 1, policy_version 112873 (0.0009) [2023-12-26 00:29:10,399][123090] Updated weights for policy 1, policy_version 112883 (0.0007) [2023-12-26 00:29:10,458][123090] Updated weights for policy 1, policy_version 112893 (0.0009) [2023-12-26 00:29:10,716][123091] Updated weights for policy 0, policy_version 113317 (0.0011) [2023-12-26 00:29:10,779][123091] Updated weights for policy 0, policy_version 113327 (0.0011) [2023-12-26 00:29:10,853][123091] Updated weights for policy 0, policy_version 113337 (0.0011) [2023-12-26 00:29:11,274][123090] Updated weights for policy 1, policy_version 112903 (0.0008) [2023-12-26 00:29:11,342][123090] Updated weights for policy 1, policy_version 112913 (0.0009) [2023-12-26 00:29:11,424][123090] Updated weights for policy 1, policy_version 112923 (0.0007) [2023-12-26 00:29:11,701][123091] Updated weights for policy 0, policy_version 113347 (0.0010) [2023-12-26 00:29:11,766][123091] Updated weights for policy 0, policy_version 113357 (0.0010) [2023-12-26 00:29:11,829][123091] Updated weights for policy 0, policy_version 113367 (0.0010) [2023-12-26 00:29:12,251][123090] Updated weights for policy 1, policy_version 112933 (0.0009) [2023-12-26 00:29:12,317][123090] Updated weights for policy 1, policy_version 112943 (0.0009) [2023-12-26 00:29:12,380][123090] Updated weights for policy 1, policy_version 112953 (0.0009) [2023-12-26 00:29:12,596][123091] Updated weights for policy 0, policy_version 113377 (0.0009) [2023-12-26 00:29:12,665][123091] Updated weights for policy 0, policy_version 113387 (0.0005) [2023-12-26 00:29:12,716][123091] Updated weights for policy 0, policy_version 113397 (0.0006) [2023-12-26 00:29:12,782][123091] Updated weights for policy 0, policy_version 113407 (0.0008) [2023-12-26 00:29:13,315][123090] Updated weights for policy 1, policy_version 112963 (0.0009) [2023-12-26 00:29:13,382][123090] Updated weights for policy 1, policy_version 112973 (0.0009) [2023-12-26 00:29:13,440][123091] Updated weights for policy 0, policy_version 113417 (0.0009) [2023-12-26 00:29:13,447][123090] Updated weights for policy 1, policy_version 112983 (0.0007) [2023-12-26 00:29:13,496][123091] Updated weights for policy 0, policy_version 113427 (0.0009) [2023-12-26 00:29:13,543][123091] Updated weights for policy 0, policy_version 113437 (0.0010) [2023-12-26 00:29:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 57966592. Throughput: 0: 8928.9, 1: 9044.9. Samples: 57957032. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:13,785][121949] Avg episode reward: [(0, '5246.430'), (1, '5634.303')] [2023-12-26 00:29:13,785][123007] Saving new best policy, reward=5246.430! [2023-12-26 00:29:14,247][123091] Updated weights for policy 0, policy_version 113447 (0.0009) [2023-12-26 00:29:14,314][123091] Updated weights for policy 0, policy_version 113457 (0.0009) [2023-12-26 00:29:14,323][123090] Updated weights for policy 1, policy_version 112993 (0.0008) [2023-12-26 00:29:14,372][123091] Updated weights for policy 0, policy_version 113467 (0.0009) [2023-12-26 00:29:14,378][123090] Updated weights for policy 1, policy_version 113003 (0.0007) [2023-12-26 00:29:14,440][123090] Updated weights for policy 1, policy_version 113013 (0.0008) [2023-12-26 00:29:14,502][123090] Updated weights for policy 1, policy_version 113023 (0.0009) [2023-12-26 00:29:15,093][123091] Updated weights for policy 0, policy_version 113477 (0.0009) [2023-12-26 00:29:15,152][123091] Updated weights for policy 0, policy_version 113487 (0.0011) [2023-12-26 00:29:15,215][123091] Updated weights for policy 0, policy_version 113497 (0.0011) [2023-12-26 00:29:15,363][123090] Updated weights for policy 1, policy_version 113033 (0.0006) [2023-12-26 00:29:15,420][123090] Updated weights for policy 1, policy_version 113043 (0.0005) [2023-12-26 00:29:15,485][123090] Updated weights for policy 1, policy_version 113053 (0.0009) [2023-12-26 00:29:15,986][123091] Updated weights for policy 0, policy_version 113507 (0.0011) [2023-12-26 00:29:16,059][123091] Updated weights for policy 0, policy_version 113517 (0.0010) [2023-12-26 00:29:16,118][123091] Updated weights for policy 0, policy_version 113527 (0.0010) [2023-12-26 00:29:16,263][123090] Updated weights for policy 1, policy_version 113063 (0.0010) [2023-12-26 00:29:16,319][123090] Updated weights for policy 1, policy_version 113073 (0.0009) [2023-12-26 00:29:16,372][123090] Updated weights for policy 1, policy_version 113083 (0.0009) [2023-12-26 00:29:16,927][123091] Updated weights for policy 0, policy_version 113537 (0.0009) [2023-12-26 00:29:16,984][123091] Updated weights for policy 0, policy_version 113547 (0.0009) [2023-12-26 00:29:17,041][123091] Updated weights for policy 0, policy_version 113557 (0.0009) [2023-12-26 00:29:17,096][123091] Updated weights for policy 0, policy_version 113567 (0.0009) [2023-12-26 00:29:17,147][123090] Updated weights for policy 1, policy_version 113093 (0.0008) [2023-12-26 00:29:17,197][123090] Updated weights for policy 1, policy_version 113103 (0.0005) [2023-12-26 00:29:17,263][123090] Updated weights for policy 1, policy_version 113113 (0.0005) [2023-12-26 00:29:17,926][123090] Updated weights for policy 1, policy_version 113123 (0.0007) [2023-12-26 00:29:17,979][123090] Updated weights for policy 1, policy_version 113133 (0.0007) [2023-12-26 00:29:17,999][123091] Updated weights for policy 0, policy_version 113577 (0.0008) [2023-12-26 00:29:18,029][123090] Updated weights for policy 1, policy_version 113143 (0.0007) [2023-12-26 00:29:18,049][123091] Updated weights for policy 0, policy_version 113587 (0.0009) [2023-12-26 00:29:18,094][123091] Updated weights for policy 0, policy_version 113597 (0.0009) [2023-12-26 00:29:18,782][123090] Updated weights for policy 1, policy_version 113153 (0.0007) [2023-12-26 00:29:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 58048512. Throughput: 0: 8923.1, 1: 9001.5. Samples: 58064436. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:18,785][121949] Avg episode reward: [(0, '5200.590'), (1, '5735.929')] [2023-12-26 00:29:18,836][123090] Updated weights for policy 1, policy_version 113163 (0.0005) [2023-12-26 00:29:18,885][123090] Updated weights for policy 1, policy_version 113173 (0.0005) [2023-12-26 00:29:18,933][123090] Updated weights for policy 1, policy_version 113183 (0.0008) [2023-12-26 00:29:18,935][123008] Saving new best policy, reward=5735.929! [2023-12-26 00:29:19,003][123091] Updated weights for policy 0, policy_version 113607 (0.0010) [2023-12-26 00:29:19,057][123091] Updated weights for policy 0, policy_version 113617 (0.0010) [2023-12-26 00:29:19,111][123091] Updated weights for policy 0, policy_version 113627 (0.0010) [2023-12-26 00:29:19,727][123090] Updated weights for policy 1, policy_version 113193 (0.0009) [2023-12-26 00:29:19,785][123090] Updated weights for policy 1, policy_version 113203 (0.0009) [2023-12-26 00:29:19,860][123090] Updated weights for policy 1, policy_version 113213 (0.0008) [2023-12-26 00:29:19,972][123091] Updated weights for policy 0, policy_version 113637 (0.0010) [2023-12-26 00:29:20,036][123091] Updated weights for policy 0, policy_version 113647 (0.0010) [2023-12-26 00:29:20,102][123091] Updated weights for policy 0, policy_version 113657 (0.0010) [2023-12-26 00:29:20,621][123090] Updated weights for policy 1, policy_version 113223 (0.0008) [2023-12-26 00:29:20,688][123090] Updated weights for policy 1, policy_version 113233 (0.0009) [2023-12-26 00:29:20,750][123090] Updated weights for policy 1, policy_version 113243 (0.0009) [2023-12-26 00:29:20,977][123091] Updated weights for policy 0, policy_version 113667 (0.0010) [2023-12-26 00:29:21,048][123091] Updated weights for policy 0, policy_version 113677 (0.0010) [2023-12-26 00:29:21,110][123091] Updated weights for policy 0, policy_version 113687 (0.0009) [2023-12-26 00:29:21,582][123090] Updated weights for policy 1, policy_version 113253 (0.0009) [2023-12-26 00:29:21,656][123090] Updated weights for policy 1, policy_version 113263 (0.0008) [2023-12-26 00:29:21,741][123090] Updated weights for policy 1, policy_version 113273 (0.0008) [2023-12-26 00:29:22,033][123091] Updated weights for policy 0, policy_version 113697 (0.0010) [2023-12-26 00:29:22,092][123091] Updated weights for policy 0, policy_version 113707 (0.0009) [2023-12-26 00:29:22,150][123091] Updated weights for policy 0, policy_version 113717 (0.0010) [2023-12-26 00:29:22,211][123091] Updated weights for policy 0, policy_version 113727 (0.0010) [2023-12-26 00:29:22,494][123090] Updated weights for policy 1, policy_version 113283 (0.0007) [2023-12-26 00:29:22,556][123090] Updated weights for policy 1, policy_version 113293 (0.0007) [2023-12-26 00:29:22,621][123090] Updated weights for policy 1, policy_version 113303 (0.0006) [2023-12-26 00:29:23,102][123091] Updated weights for policy 0, policy_version 113737 (0.0007) [2023-12-26 00:29:23,159][123091] Updated weights for policy 0, policy_version 113747 (0.0007) [2023-12-26 00:29:23,220][123091] Updated weights for policy 0, policy_version 113757 (0.0011) [2023-12-26 00:29:23,381][123090] Updated weights for policy 1, policy_version 113313 (0.0006) [2023-12-26 00:29:23,442][123090] Updated weights for policy 1, policy_version 113323 (0.0009) [2023-12-26 00:29:23,500][123090] Updated weights for policy 1, policy_version 113333 (0.0010) [2023-12-26 00:29:23,563][123090] Updated weights for policy 1, policy_version 113343 (0.0010) [2023-12-26 00:29:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 58138624. Throughput: 0: 8907.8, 1: 8981.4. Samples: 58115452. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:23,785][121949] Avg episode reward: [(0, '5196.928'), (1, '5734.556')] [2023-12-26 00:29:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000113760_29122560.pth... [2023-12-26 00:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000113344_29016064.pth... [2023-12-26 00:29:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000112320_28753920.pth [2023-12-26 00:29:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000112736_28860416.pth [2023-12-26 00:29:24,019][123091] Updated weights for policy 0, policy_version 113767 (0.0010) [2023-12-26 00:29:24,081][123091] Updated weights for policy 0, policy_version 113777 (0.0009) [2023-12-26 00:29:24,141][123091] Updated weights for policy 0, policy_version 113787 (0.0009) [2023-12-26 00:29:24,250][123090] Updated weights for policy 1, policy_version 113353 (0.0010) [2023-12-26 00:29:24,312][123090] Updated weights for policy 1, policy_version 113363 (0.0010) [2023-12-26 00:29:24,379][123090] Updated weights for policy 1, policy_version 113373 (0.0011) [2023-12-26 00:29:24,938][123091] Updated weights for policy 0, policy_version 113797 (0.0009) [2023-12-26 00:29:24,986][123091] Updated weights for policy 0, policy_version 113807 (0.0010) [2023-12-26 00:29:25,037][123091] Updated weights for policy 0, policy_version 113817 (0.0010) [2023-12-26 00:29:25,151][123090] Updated weights for policy 1, policy_version 113383 (0.0009) [2023-12-26 00:29:25,201][123090] Updated weights for policy 1, policy_version 113393 (0.0009) [2023-12-26 00:29:25,257][123090] Updated weights for policy 1, policy_version 113403 (0.0011) [2023-12-26 00:29:25,880][123091] Updated weights for policy 0, policy_version 113827 (0.0009) [2023-12-26 00:29:25,942][123091] Updated weights for policy 0, policy_version 113837 (0.0009) [2023-12-26 00:29:25,997][123091] Updated weights for policy 0, policy_version 113847 (0.0010) [2023-12-26 00:29:25,997][123090] Updated weights for policy 1, policy_version 113413 (0.0008) [2023-12-26 00:29:26,049][123090] Updated weights for policy 1, policy_version 113423 (0.0005) [2023-12-26 00:29:26,102][123090] Updated weights for policy 1, policy_version 113433 (0.0006) [2023-12-26 00:29:26,776][123091] Updated weights for policy 0, policy_version 113857 (0.0008) [2023-12-26 00:29:26,833][123091] Updated weights for policy 0, policy_version 113867 (0.0008) [2023-12-26 00:29:26,843][123090] Updated weights for policy 1, policy_version 113443 (0.0006) [2023-12-26 00:29:26,891][123091] Updated weights for policy 0, policy_version 113877 (0.0008) [2023-12-26 00:29:26,899][123090] Updated weights for policy 1, policy_version 113453 (0.0008) [2023-12-26 00:29:26,950][123091] Updated weights for policy 0, policy_version 113887 (0.0007) [2023-12-26 00:29:26,962][123090] Updated weights for policy 1, policy_version 113463 (0.0009) [2023-12-26 00:29:27,667][123091] Updated weights for policy 0, policy_version 113897 (0.0005) [2023-12-26 00:29:27,729][123090] Updated weights for policy 1, policy_version 113473 (0.0009) [2023-12-26 00:29:27,729][123091] Updated weights for policy 0, policy_version 113907 (0.0009) [2023-12-26 00:29:27,778][123091] Updated weights for policy 0, policy_version 113917 (0.0008) [2023-12-26 00:29:27,789][123090] Updated weights for policy 1, policy_version 113483 (0.0008) [2023-12-26 00:29:27,845][123090] Updated weights for policy 1, policy_version 113493 (0.0009) [2023-12-26 00:29:27,898][123090] Updated weights for policy 1, policy_version 113503 (0.0010) [2023-12-26 00:29:28,570][123091] Updated weights for policy 0, policy_version 113927 (0.0006) [2023-12-26 00:29:28,623][123091] Updated weights for policy 0, policy_version 113937 (0.0006) [2023-12-26 00:29:28,680][123090] Updated weights for policy 1, policy_version 113513 (0.0006) [2023-12-26 00:29:28,689][123091] Updated weights for policy 0, policy_version 113947 (0.0005) [2023-12-26 00:29:28,744][123090] Updated weights for policy 1, policy_version 113523 (0.0006) [2023-12-26 00:29:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 58228736. Throughput: 0: 8902.9, 1: 9051.2. Samples: 58223620. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:28,785][121949] Avg episode reward: [(0, '5134.693'), (1, '5703.053')] [2023-12-26 00:29:28,811][123090] Updated weights for policy 1, policy_version 113533 (0.0005) [2023-12-26 00:29:29,346][123091] Updated weights for policy 0, policy_version 113957 (0.0008) [2023-12-26 00:29:29,412][123091] Updated weights for policy 0, policy_version 113967 (0.0009) [2023-12-26 00:29:29,483][123091] Updated weights for policy 0, policy_version 113977 (0.0009) [2023-12-26 00:29:29,525][123090] Updated weights for policy 1, policy_version 113543 (0.0009) [2023-12-26 00:29:29,574][123090] Updated weights for policy 1, policy_version 113553 (0.0007) [2023-12-26 00:29:29,641][123090] Updated weights for policy 1, policy_version 113563 (0.0005) [2023-12-26 00:29:30,273][123091] Updated weights for policy 0, policy_version 113987 (0.0007) [2023-12-26 00:29:30,348][123091] Updated weights for policy 0, policy_version 113997 (0.0005) [2023-12-26 00:29:30,407][123091] Updated weights for policy 0, policy_version 114007 (0.0006) [2023-12-26 00:29:30,457][123090] Updated weights for policy 1, policy_version 113573 (0.0008) [2023-12-26 00:29:30,522][123090] Updated weights for policy 1, policy_version 113583 (0.0009) [2023-12-26 00:29:30,586][123090] Updated weights for policy 1, policy_version 113593 (0.0009) [2023-12-26 00:29:31,019][123091] Updated weights for policy 0, policy_version 114017 (0.0006) [2023-12-26 00:29:31,092][123091] Updated weights for policy 0, policy_version 114027 (0.0009) [2023-12-26 00:29:31,151][123091] Updated weights for policy 0, policy_version 114037 (0.0010) [2023-12-26 00:29:31,207][123091] Updated weights for policy 0, policy_version 114047 (0.0009) [2023-12-26 00:29:31,442][123090] Updated weights for policy 1, policy_version 113603 (0.0010) [2023-12-26 00:29:31,499][123090] Updated weights for policy 1, policy_version 113613 (0.0009) [2023-12-26 00:29:31,559][123090] Updated weights for policy 1, policy_version 113623 (0.0009) [2023-12-26 00:29:32,046][123091] Updated weights for policy 0, policy_version 114057 (0.0010) [2023-12-26 00:29:32,108][123091] Updated weights for policy 0, policy_version 114067 (0.0009) [2023-12-26 00:29:32,161][123091] Updated weights for policy 0, policy_version 114077 (0.0009) [2023-12-26 00:29:32,371][123090] Updated weights for policy 1, policy_version 113633 (0.0009) [2023-12-26 00:29:32,423][123090] Updated weights for policy 1, policy_version 113643 (0.0009) [2023-12-26 00:29:32,479][123090] Updated weights for policy 1, policy_version 113653 (0.0009) [2023-12-26 00:29:32,533][123090] Updated weights for policy 1, policy_version 113663 (0.0010) [2023-12-26 00:29:33,007][123091] Updated weights for policy 0, policy_version 114087 (0.0010) [2023-12-26 00:29:33,059][123091] Updated weights for policy 0, policy_version 114097 (0.0009) [2023-12-26 00:29:33,106][123091] Updated weights for policy 0, policy_version 114107 (0.0009) [2023-12-26 00:29:33,324][123090] Updated weights for policy 1, policy_version 113673 (0.0009) [2023-12-26 00:29:33,376][123090] Updated weights for policy 1, policy_version 113684 (0.0009) [2023-12-26 00:29:33,427][123090] Updated weights for policy 1, policy_version 113694 (0.0009) [2023-12-26 00:29:33,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 58318848. Throughput: 0: 8856.6, 1: 8951.0. Samples: 58330880. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:33,786][121949] Avg episode reward: [(0, '5156.034'), (1, '5628.605')] [2023-12-26 00:29:33,939][123091] Updated weights for policy 0, policy_version 114117 (0.0009) [2023-12-26 00:29:33,989][123091] Updated weights for policy 0, policy_version 114127 (0.0009) [2023-12-26 00:29:34,039][123091] Updated weights for policy 0, policy_version 114137 (0.0009) [2023-12-26 00:29:34,280][123090] Updated weights for policy 1, policy_version 113704 (0.0009) [2023-12-26 00:29:34,351][123090] Updated weights for policy 1, policy_version 113714 (0.0010) [2023-12-26 00:29:34,425][123090] Updated weights for policy 1, policy_version 113724 (0.0009) [2023-12-26 00:29:34,828][123091] Updated weights for policy 0, policy_version 114147 (0.0009) [2023-12-26 00:29:34,894][123091] Updated weights for policy 0, policy_version 114157 (0.0010) [2023-12-26 00:29:34,964][123091] Updated weights for policy 0, policy_version 114167 (0.0010) [2023-12-26 00:29:35,240][123090] Updated weights for policy 1, policy_version 113734 (0.0010) [2023-12-26 00:29:35,292][123090] Updated weights for policy 1, policy_version 113744 (0.0009) [2023-12-26 00:29:35,360][123090] Updated weights for policy 1, policy_version 113754 (0.0008) [2023-12-26 00:29:35,815][123091] Updated weights for policy 0, policy_version 114177 (0.0010) [2023-12-26 00:29:35,864][123091] Updated weights for policy 0, policy_version 114187 (0.0009) [2023-12-26 00:29:35,915][123091] Updated weights for policy 0, policy_version 114197 (0.0010) [2023-12-26 00:29:35,972][123091] Updated weights for policy 0, policy_version 114207 (0.0009) [2023-12-26 00:29:36,175][123090] Updated weights for policy 1, policy_version 113764 (0.0007) [2023-12-26 00:29:36,234][123090] Updated weights for policy 1, policy_version 113774 (0.0010) [2023-12-26 00:29:36,297][123090] Updated weights for policy 1, policy_version 113784 (0.0010) [2023-12-26 00:29:36,817][123091] Updated weights for policy 0, policy_version 114217 (0.0010) [2023-12-26 00:29:36,873][123091] Updated weights for policy 0, policy_version 114227 (0.0009) [2023-12-26 00:29:36,924][123091] Updated weights for policy 0, policy_version 114237 (0.0007) [2023-12-26 00:29:37,088][123090] Updated weights for policy 1, policy_version 113794 (0.0008) [2023-12-26 00:29:37,142][123090] Updated weights for policy 1, policy_version 113804 (0.0007) [2023-12-26 00:29:37,195][123090] Updated weights for policy 1, policy_version 113814 (0.0006) [2023-12-26 00:29:37,264][123090] Updated weights for policy 1, policy_version 113824 (0.0009) [2023-12-26 00:29:37,773][123091] Updated weights for policy 0, policy_version 114247 (0.0009) [2023-12-26 00:29:37,833][123091] Updated weights for policy 0, policy_version 114257 (0.0009) [2023-12-26 00:29:37,885][123091] Updated weights for policy 0, policy_version 114267 (0.0010) [2023-12-26 00:29:38,044][123090] Updated weights for policy 1, policy_version 113834 (0.0006) [2023-12-26 00:29:38,123][123090] Updated weights for policy 1, policy_version 113844 (0.0006) [2023-12-26 00:29:38,188][123090] Updated weights for policy 1, policy_version 113854 (0.0006) [2023-12-26 00:29:38,785][121949] Fps is (10 sec: 17202.3, 60 sec: 17885.7, 300 sec: 17772.4). Total num frames: 58400768. Throughput: 0: 8834.9, 1: 8911.3. Samples: 58382568. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:38,786][121949] Avg episode reward: [(0, '5070.267'), (1, '5665.616')] [2023-12-26 00:29:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000113856_29147136.pth... [2023-12-26 00:29:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000112832_28884992.pth [2023-12-26 00:29:38,818][123091] Updated weights for policy 0, policy_version 114277 (0.0008) [2023-12-26 00:29:38,877][123091] Updated weights for policy 0, policy_version 114287 (0.0010) [2023-12-26 00:29:38,910][123090] Updated weights for policy 1, policy_version 113864 (0.0008) [2023-12-26 00:29:38,944][123091] Updated weights for policy 0, policy_version 114297 (0.0009) [2023-12-26 00:29:38,981][123090] Updated weights for policy 1, policy_version 113874 (0.0010) [2023-12-26 00:29:38,990][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000114304_29261824.pth... [2023-12-26 00:29:38,995][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000113248_28991488.pth [2023-12-26 00:29:39,053][123090] Updated weights for policy 1, policy_version 113884 (0.0009) [2023-12-26 00:29:39,812][123091] Updated weights for policy 0, policy_version 114307 (0.0008) [2023-12-26 00:29:39,879][123090] Updated weights for policy 1, policy_version 113894 (0.0010) [2023-12-26 00:29:39,881][123091] Updated weights for policy 0, policy_version 114317 (0.0008) [2023-12-26 00:29:39,946][123091] Updated weights for policy 0, policy_version 114327 (0.0009) [2023-12-26 00:29:39,951][123090] Updated weights for policy 1, policy_version 113904 (0.0007) [2023-12-26 00:29:40,014][123090] Updated weights for policy 1, policy_version 113914 (0.0009) [2023-12-26 00:29:40,755][123091] Updated weights for policy 0, policy_version 114337 (0.0008) [2023-12-26 00:29:40,814][123091] Updated weights for policy 0, policy_version 114347 (0.0011) [2023-12-26 00:29:40,825][123090] Updated weights for policy 1, policy_version 113924 (0.0009) [2023-12-26 00:29:40,870][123090] Updated weights for policy 1, policy_version 113934 (0.0007) [2023-12-26 00:29:40,874][123091] Updated weights for policy 0, policy_version 114357 (0.0010) [2023-12-26 00:29:40,928][123090] Updated weights for policy 1, policy_version 113944 (0.0009) [2023-12-26 00:29:40,929][123091] Updated weights for policy 0, policy_version 114367 (0.0010) [2023-12-26 00:29:41,809][123091] Updated weights for policy 0, policy_version 114377 (0.0011) [2023-12-26 00:29:41,845][123090] Updated weights for policy 1, policy_version 113954 (0.0008) [2023-12-26 00:29:41,865][123091] Updated weights for policy 0, policy_version 114387 (0.0011) [2023-12-26 00:29:41,907][123090] Updated weights for policy 1, policy_version 113964 (0.0006) [2023-12-26 00:29:41,925][123091] Updated weights for policy 0, policy_version 114397 (0.0008) [2023-12-26 00:29:41,967][123090] Updated weights for policy 1, policy_version 113974 (0.0009) [2023-12-26 00:29:42,021][123090] Updated weights for policy 1, policy_version 113984 (0.0010) [2023-12-26 00:29:42,630][123091] Updated weights for policy 0, policy_version 114407 (0.0009) [2023-12-26 00:29:42,678][123091] Updated weights for policy 0, policy_version 114417 (0.0006) [2023-12-26 00:29:42,728][123091] Updated weights for policy 0, policy_version 114427 (0.0005) [2023-12-26 00:29:42,948][123090] Updated weights for policy 1, policy_version 113994 (0.0009) [2023-12-26 00:29:43,007][123090] Updated weights for policy 1, policy_version 114004 (0.0010) [2023-12-26 00:29:43,070][123090] Updated weights for policy 1, policy_version 114014 (0.0010) [2023-12-26 00:29:43,505][123091] Updated weights for policy 0, policy_version 114437 (0.0008) [2023-12-26 00:29:43,568][123091] Updated weights for policy 0, policy_version 114447 (0.0009) [2023-12-26 00:29:43,631][123091] Updated weights for policy 0, policy_version 114457 (0.0009) [2023-12-26 00:29:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 58490880. Throughput: 0: 8727.5, 1: 8831.6. Samples: 58484328. Policy #0 lag: (min: 31.0, avg: 33.0, max: 63.0) [2023-12-26 00:29:43,785][121949] Avg episode reward: [(0, '5067.506'), (1, '5682.359')] [2023-12-26 00:29:43,881][123090] Updated weights for policy 1, policy_version 114024 (0.0009) [2023-12-26 00:29:43,935][123090] Updated weights for policy 1, policy_version 114034 (0.0009) [2023-12-26 00:29:43,993][123090] Updated weights for policy 1, policy_version 114044 (0.0010) [2023-12-26 00:29:44,404][123091] Updated weights for policy 0, policy_version 114467 (0.0009) [2023-12-26 00:29:44,458][123091] Updated weights for policy 0, policy_version 114477 (0.0009) [2023-12-26 00:29:44,518][123091] Updated weights for policy 0, policy_version 114487 (0.0009) [2023-12-26 00:29:44,810][123090] Updated weights for policy 1, policy_version 114054 (0.0008) [2023-12-26 00:29:44,882][123090] Updated weights for policy 1, policy_version 114064 (0.0005) [2023-12-26 00:29:44,954][123090] Updated weights for policy 1, policy_version 114074 (0.0005) [2023-12-26 00:29:45,354][123091] Updated weights for policy 0, policy_version 114497 (0.0008) [2023-12-26 00:29:45,408][123091] Updated weights for policy 0, policy_version 114507 (0.0010) [2023-12-26 00:29:45,463][123091] Updated weights for policy 0, policy_version 114517 (0.0009) [2023-12-26 00:29:45,513][123091] Updated weights for policy 0, policy_version 114527 (0.0009) [2023-12-26 00:29:45,701][123090] Updated weights for policy 1, policy_version 114084 (0.0009) [2023-12-26 00:29:45,754][123090] Updated weights for policy 1, policy_version 114094 (0.0009) [2023-12-26 00:29:45,807][123090] Updated weights for policy 1, policy_version 114104 (0.0009) [2023-12-26 00:29:46,358][123091] Updated weights for policy 0, policy_version 114537 (0.0009) [2023-12-26 00:29:46,408][123091] Updated weights for policy 0, policy_version 114547 (0.0009) [2023-12-26 00:29:46,465][123091] Updated weights for policy 0, policy_version 114557 (0.0010) [2023-12-26 00:29:46,630][123090] Updated weights for policy 1, policy_version 114114 (0.0008) [2023-12-26 00:29:46,697][123090] Updated weights for policy 1, policy_version 114124 (0.0009) [2023-12-26 00:29:46,761][123090] Updated weights for policy 1, policy_version 114134 (0.0009) [2023-12-26 00:29:46,825][123090] Updated weights for policy 1, policy_version 114144 (0.0009) [2023-12-26 00:29:47,289][123091] Updated weights for policy 0, policy_version 114568 (0.0010) [2023-12-26 00:29:47,342][123091] Updated weights for policy 0, policy_version 114578 (0.0009) [2023-12-26 00:29:47,398][123091] Updated weights for policy 0, policy_version 114588 (0.0009) [2023-12-26 00:29:47,654][123090] Updated weights for policy 1, policy_version 114154 (0.0010) [2023-12-26 00:29:47,712][123090] Updated weights for policy 1, policy_version 114164 (0.0010) [2023-12-26 00:29:47,760][123090] Updated weights for policy 1, policy_version 114174 (0.0008) [2023-12-26 00:29:48,265][123091] Updated weights for policy 0, policy_version 114598 (0.0010) [2023-12-26 00:29:48,322][123091] Updated weights for policy 0, policy_version 114608 (0.0010) [2023-12-26 00:29:48,391][123091] Updated weights for policy 0, policy_version 114618 (0.0008) [2023-12-26 00:29:48,520][123090] Updated weights for policy 1, policy_version 114184 (0.0009) [2023-12-26 00:29:48,571][123090] Updated weights for policy 1, policy_version 114194 (0.0009) [2023-12-26 00:29:48,628][123090] Updated weights for policy 1, policy_version 114204 (0.0009) [2023-12-26 00:29:48,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 58580992. Throughput: 0: 8767.0, 1: 8816.0. Samples: 58588964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:29:48,785][121949] Avg episode reward: [(0, '5089.898'), (1, '5608.567')] [2023-12-26 00:29:49,268][123091] Updated weights for policy 0, policy_version 114628 (0.0010) [2023-12-26 00:29:49,322][123091] Updated weights for policy 0, policy_version 114638 (0.0009) [2023-12-26 00:29:49,388][123091] Updated weights for policy 0, policy_version 114648 (0.0010) [2023-12-26 00:29:49,459][123090] Updated weights for policy 1, policy_version 114214 (0.0009) [2023-12-26 00:29:49,525][123090] Updated weights for policy 1, policy_version 114224 (0.0008) [2023-12-26 00:29:49,595][123090] Updated weights for policy 1, policy_version 114234 (0.0008) [2023-12-26 00:29:50,232][123091] Updated weights for policy 0, policy_version 114658 (0.0009) [2023-12-26 00:29:50,291][123091] Updated weights for policy 0, policy_version 114668 (0.0009) [2023-12-26 00:29:50,350][123091] Updated weights for policy 0, policy_version 114678 (0.0009) [2023-12-26 00:29:50,443][123091] Updated weights for policy 0, policy_version 114688 (0.0010) [2023-12-26 00:29:50,451][123090] Updated weights for policy 1, policy_version 114244 (0.0009) [2023-12-26 00:29:50,514][123090] Updated weights for policy 1, policy_version 114254 (0.0009) [2023-12-26 00:29:50,578][123090] Updated weights for policy 1, policy_version 114264 (0.0010) [2023-12-26 00:29:51,223][123091] Updated weights for policy 0, policy_version 114698 (0.0008) [2023-12-26 00:29:51,282][123091] Updated weights for policy 0, policy_version 114708 (0.0008) [2023-12-26 00:29:51,344][123091] Updated weights for policy 0, policy_version 114718 (0.0009) [2023-12-26 00:29:51,469][123090] Updated weights for policy 1, policy_version 114274 (0.0010) [2023-12-26 00:29:51,532][123090] Updated weights for policy 1, policy_version 114284 (0.0009) [2023-12-26 00:29:51,597][123090] Updated weights for policy 1, policy_version 114294 (0.0009) [2023-12-26 00:29:51,672][123090] Updated weights for policy 1, policy_version 114304 (0.0010) [2023-12-26 00:29:52,206][123091] Updated weights for policy 0, policy_version 114728 (0.0007) [2023-12-26 00:29:52,277][123091] Updated weights for policy 0, policy_version 114738 (0.0008) [2023-12-26 00:29:52,346][123091] Updated weights for policy 0, policy_version 114748 (0.0010) [2023-12-26 00:29:52,438][123090] Updated weights for policy 1, policy_version 114314 (0.0009) [2023-12-26 00:29:52,492][123090] Updated weights for policy 1, policy_version 114324 (0.0009) [2023-12-26 00:29:52,545][123090] Updated weights for policy 1, policy_version 114334 (0.0009) [2023-12-26 00:29:53,144][123091] Updated weights for policy 0, policy_version 114758 (0.0010) [2023-12-26 00:29:53,199][123091] Updated weights for policy 0, policy_version 114769 (0.0011) [2023-12-26 00:29:53,253][123091] Updated weights for policy 0, policy_version 114781 (0.0010) [2023-12-26 00:29:53,365][123090] Updated weights for policy 1, policy_version 114344 (0.0009) [2023-12-26 00:29:53,422][123090] Updated weights for policy 1, policy_version 114354 (0.0009) [2023-12-26 00:29:53,470][123090] Updated weights for policy 1, policy_version 114364 (0.0007) [2023-12-26 00:29:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 58662912. Throughput: 0: 8707.2, 1: 8760.9. Samples: 58639268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:29:53,785][121949] Avg episode reward: [(0, '5146.004'), (1, '5559.964')] [2023-12-26 00:29:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000114784_29384704.pth... [2023-12-26 00:29:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000114368_29278208.pth... [2023-12-26 00:29:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000113760_29122560.pth [2023-12-26 00:29:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000113344_29016064.pth [2023-12-26 00:29:54,128][123091] Updated weights for policy 0, policy_version 114791 (0.0010) [2023-12-26 00:29:54,189][123091] Updated weights for policy 0, policy_version 114801 (0.0009) [2023-12-26 00:29:54,255][123090] Updated weights for policy 1, policy_version 114374 (0.0006) [2023-12-26 00:29:54,260][123091] Updated weights for policy 0, policy_version 114811 (0.0009) [2023-12-26 00:29:54,305][123090] Updated weights for policy 1, policy_version 114384 (0.0006) [2023-12-26 00:29:54,371][123090] Updated weights for policy 1, policy_version 114394 (0.0005) [2023-12-26 00:29:55,089][123091] Updated weights for policy 0, policy_version 114821 (0.0009) [2023-12-26 00:29:55,149][123091] Updated weights for policy 0, policy_version 114831 (0.0010) [2023-12-26 00:29:55,164][123090] Updated weights for policy 1, policy_version 114404 (0.0006) [2023-12-26 00:29:55,210][123091] Updated weights for policy 0, policy_version 114841 (0.0009) [2023-12-26 00:29:55,220][123090] Updated weights for policy 1, policy_version 114414 (0.0005) [2023-12-26 00:29:55,284][123090] Updated weights for policy 1, policy_version 114424 (0.0007) [2023-12-26 00:29:55,887][123090] Updated weights for policy 1, policy_version 114434 (0.0005) [2023-12-26 00:29:55,951][123090] Updated weights for policy 1, policy_version 114444 (0.0005) [2023-12-26 00:29:56,024][123090] Updated weights for policy 1, policy_version 114454 (0.0005) [2023-12-26 00:29:56,077][123090] Updated weights for policy 1, policy_version 114464 (0.0005) [2023-12-26 00:29:56,112][123091] Updated weights for policy 0, policy_version 114851 (0.0008) [2023-12-26 00:29:56,170][123091] Updated weights for policy 0, policy_version 114861 (0.0009) [2023-12-26 00:29:56,229][123091] Updated weights for policy 0, policy_version 114871 (0.0009) [2023-12-26 00:29:56,722][123090] Updated weights for policy 1, policy_version 114474 (0.0010) [2023-12-26 00:29:56,770][123090] Updated weights for policy 1, policy_version 114484 (0.0010) [2023-12-26 00:29:56,821][123090] Updated weights for policy 1, policy_version 114494 (0.0007) [2023-12-26 00:29:57,126][123091] Updated weights for policy 0, policy_version 114881 (0.0009) [2023-12-26 00:29:57,179][123091] Updated weights for policy 0, policy_version 114891 (0.0010) [2023-12-26 00:29:57,234][123091] Updated weights for policy 0, policy_version 114901 (0.0011) [2023-12-26 00:29:57,284][123091] Updated weights for policy 0, policy_version 114911 (0.0010) [2023-12-26 00:29:57,540][123090] Updated weights for policy 1, policy_version 114504 (0.0005) [2023-12-26 00:29:57,587][123090] Updated weights for policy 1, policy_version 114514 (0.0007) [2023-12-26 00:29:57,633][123090] Updated weights for policy 1, policy_version 114524 (0.0005) [2023-12-26 00:29:58,227][123091] Updated weights for policy 0, policy_version 114921 (0.0008) [2023-12-26 00:29:58,297][123091] Updated weights for policy 0, policy_version 114931 (0.0009) [2023-12-26 00:29:58,367][123091] Updated weights for policy 0, policy_version 114941 (0.0009) [2023-12-26 00:29:58,423][123090] Updated weights for policy 1, policy_version 114534 (0.0007) [2023-12-26 00:29:58,488][123090] Updated weights for policy 1, policy_version 114544 (0.0009) [2023-12-26 00:29:58,559][123090] Updated weights for policy 1, policy_version 114554 (0.0008) [2023-12-26 00:29:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17744.7). Total num frames: 58753024. Throughput: 0: 8632.4, 1: 8895.6. Samples: 58745792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:29:58,785][121949] Avg episode reward: [(0, '5128.874'), (1, '5683.122')] [2023-12-26 00:29:59,267][123091] Updated weights for policy 0, policy_version 114951 (0.0008) [2023-12-26 00:29:59,342][123091] Updated weights for policy 0, policy_version 114961 (0.0007) [2023-12-26 00:29:59,413][123091] Updated weights for policy 0, policy_version 114971 (0.0008) [2023-12-26 00:29:59,488][123090] Updated weights for policy 1, policy_version 114564 (0.0007) [2023-12-26 00:29:59,538][123090] Updated weights for policy 1, policy_version 114574 (0.0007) [2023-12-26 00:29:59,597][123090] Updated weights for policy 1, policy_version 114584 (0.0005) [2023-12-26 00:30:00,129][123091] Updated weights for policy 0, policy_version 114981 (0.0009) [2023-12-26 00:30:00,197][123091] Updated weights for policy 0, policy_version 114991 (0.0010) [2023-12-26 00:30:00,252][123091] Updated weights for policy 0, policy_version 115001 (0.0010) [2023-12-26 00:30:00,452][123090] Updated weights for policy 1, policy_version 114594 (0.0009) [2023-12-26 00:30:00,506][123090] Updated weights for policy 1, policy_version 114604 (0.0009) [2023-12-26 00:30:00,557][123090] Updated weights for policy 1, policy_version 114615 (0.0010) [2023-12-26 00:30:00,961][123091] Updated weights for policy 0, policy_version 115011 (0.0010) [2023-12-26 00:30:01,018][123091] Updated weights for policy 0, policy_version 115021 (0.0009) [2023-12-26 00:30:01,084][123091] Updated weights for policy 0, policy_version 115031 (0.0010) [2023-12-26 00:30:01,414][123090] Updated weights for policy 1, policy_version 114626 (0.0009) [2023-12-26 00:30:01,477][123090] Updated weights for policy 1, policy_version 114636 (0.0007) [2023-12-26 00:30:01,542][123090] Updated weights for policy 1, policy_version 114646 (0.0010) [2023-12-26 00:30:01,604][123090] Updated weights for policy 1, policy_version 114656 (0.0010) [2023-12-26 00:30:01,893][123091] Updated weights for policy 0, policy_version 115041 (0.0010) [2023-12-26 00:30:01,945][123091] Updated weights for policy 0, policy_version 115051 (0.0005) [2023-12-26 00:30:02,003][123091] Updated weights for policy 0, policy_version 115061 (0.0009) [2023-12-26 00:30:02,056][123091] Updated weights for policy 0, policy_version 115072 (0.0010) [2023-12-26 00:30:02,358][123090] Updated weights for policy 1, policy_version 114666 (0.0010) [2023-12-26 00:30:02,430][123090] Updated weights for policy 1, policy_version 114676 (0.0008) [2023-12-26 00:30:02,495][123090] Updated weights for policy 1, policy_version 114686 (0.0006) [2023-12-26 00:30:02,842][123091] Updated weights for policy 0, policy_version 115082 (0.0009) [2023-12-26 00:30:02,907][123091] Updated weights for policy 0, policy_version 115092 (0.0010) [2023-12-26 00:30:02,970][123091] Updated weights for policy 0, policy_version 115102 (0.0009) [2023-12-26 00:30:03,328][123090] Updated weights for policy 1, policy_version 114696 (0.0008) [2023-12-26 00:30:03,387][123090] Updated weights for policy 1, policy_version 114706 (0.0008) [2023-12-26 00:30:03,449][123090] Updated weights for policy 1, policy_version 114716 (0.0009) [2023-12-26 00:30:03,771][123091] Updated weights for policy 0, policy_version 115112 (0.0010) [2023-12-26 00:30:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 58834944. Throughput: 0: 8590.5, 1: 8840.3. Samples: 58848820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:03,785][121949] Avg episode reward: [(0, '5100.454'), (1, '5763.304')] [2023-12-26 00:30:03,786][123008] Saving new best policy, reward=5763.304! [2023-12-26 00:30:03,825][123091] Updated weights for policy 0, policy_version 115122 (0.0008) [2023-12-26 00:30:03,889][123091] Updated weights for policy 0, policy_version 115132 (0.0009) [2023-12-26 00:30:04,268][123090] Updated weights for policy 1, policy_version 114726 (0.0009) [2023-12-26 00:30:04,335][123090] Updated weights for policy 1, policy_version 114736 (0.0009) [2023-12-26 00:30:04,408][123090] Updated weights for policy 1, policy_version 114746 (0.0008) [2023-12-26 00:30:04,758][123091] Updated weights for policy 0, policy_version 115142 (0.0009) [2023-12-26 00:30:04,824][123091] Updated weights for policy 0, policy_version 115152 (0.0008) [2023-12-26 00:30:04,888][123091] Updated weights for policy 0, policy_version 115162 (0.0008) [2023-12-26 00:30:05,173][123090] Updated weights for policy 1, policy_version 114756 (0.0010) [2023-12-26 00:30:05,235][123090] Updated weights for policy 1, policy_version 114766 (0.0010) [2023-12-26 00:30:05,297][123090] Updated weights for policy 1, policy_version 114776 (0.0010) [2023-12-26 00:30:05,712][123091] Updated weights for policy 0, policy_version 115172 (0.0009) [2023-12-26 00:30:05,764][123091] Updated weights for policy 0, policy_version 115182 (0.0009) [2023-12-26 00:30:05,816][123091] Updated weights for policy 0, policy_version 115192 (0.0009) [2023-12-26 00:30:06,112][123090] Updated weights for policy 1, policy_version 114786 (0.0010) [2023-12-26 00:30:06,180][123090] Updated weights for policy 1, policy_version 114796 (0.0007) [2023-12-26 00:30:06,246][123090] Updated weights for policy 1, policy_version 114806 (0.0007) [2023-12-26 00:30:06,315][123090] Updated weights for policy 1, policy_version 114816 (0.0011) [2023-12-26 00:30:06,708][123091] Updated weights for policy 0, policy_version 115202 (0.0009) [2023-12-26 00:30:06,769][123091] Updated weights for policy 0, policy_version 115212 (0.0010) [2023-12-26 00:30:06,825][123091] Updated weights for policy 0, policy_version 115222 (0.0009) [2023-12-26 00:30:06,893][123091] Updated weights for policy 0, policy_version 115232 (0.0009) [2023-12-26 00:30:07,059][123090] Updated weights for policy 1, policy_version 114826 (0.0006) [2023-12-26 00:30:07,111][123090] Updated weights for policy 1, policy_version 114836 (0.0005) [2023-12-26 00:30:07,169][123090] Updated weights for policy 1, policy_version 114846 (0.0005) [2023-12-26 00:30:07,765][123091] Updated weights for policy 0, policy_version 115242 (0.0010) [2023-12-26 00:30:07,829][123091] Updated weights for policy 0, policy_version 115252 (0.0009) [2023-12-26 00:30:07,893][123091] Updated weights for policy 0, policy_version 115262 (0.0009) [2023-12-26 00:30:07,941][123090] Updated weights for policy 1, policy_version 114856 (0.0009) [2023-12-26 00:30:07,994][123090] Updated weights for policy 1, policy_version 114866 (0.0009) [2023-12-26 00:30:08,062][123090] Updated weights for policy 1, policy_version 114876 (0.0010) [2023-12-26 00:30:08,740][123091] Updated weights for policy 0, policy_version 115272 (0.0010) [2023-12-26 00:30:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17716.9). Total num frames: 58916864. Throughput: 0: 8610.1, 1: 8829.6. Samples: 58900240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:08,785][121949] Avg episode reward: [(0, '5179.763'), (1, '5771.107')] [2023-12-26 00:30:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000114880_29409280.pth... [2023-12-26 00:30:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000113856_29147136.pth [2023-12-26 00:30:08,794][123008] Saving new best policy, reward=5771.107! [2023-12-26 00:30:08,798][123091] Updated weights for policy 0, policy_version 115282 (0.0009) [2023-12-26 00:30:08,861][123091] Updated weights for policy 0, policy_version 115292 (0.0010) [2023-12-26 00:30:08,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000115296_29515776.pth... [2023-12-26 00:30:08,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000114304_29261824.pth [2023-12-26 00:30:08,893][123090] Updated weights for policy 1, policy_version 114886 (0.0008) [2023-12-26 00:30:08,953][123090] Updated weights for policy 1, policy_version 114896 (0.0009) [2023-12-26 00:30:09,018][123090] Updated weights for policy 1, policy_version 114906 (0.0009) [2023-12-26 00:30:09,742][123091] Updated weights for policy 0, policy_version 115302 (0.0010) [2023-12-26 00:30:09,802][123091] Updated weights for policy 0, policy_version 115312 (0.0009) [2023-12-26 00:30:09,845][123090] Updated weights for policy 1, policy_version 114916 (0.0009) [2023-12-26 00:30:09,866][123091] Updated weights for policy 0, policy_version 115322 (0.0009) [2023-12-26 00:30:09,908][123090] Updated weights for policy 1, policy_version 114926 (0.0009) [2023-12-26 00:30:09,973][123090] Updated weights for policy 1, policy_version 114936 (0.0009) [2023-12-26 00:30:10,717][123091] Updated weights for policy 0, policy_version 115332 (0.0009) [2023-12-26 00:30:10,749][123090] Updated weights for policy 1, policy_version 114946 (0.0008) [2023-12-26 00:30:10,772][123091] Updated weights for policy 0, policy_version 115342 (0.0008) [2023-12-26 00:30:10,809][123090] Updated weights for policy 1, policy_version 114956 (0.0008) [2023-12-26 00:30:10,818][123091] Updated weights for policy 0, policy_version 115352 (0.0009) [2023-12-26 00:30:10,873][123090] Updated weights for policy 1, policy_version 114966 (0.0009) [2023-12-26 00:30:10,942][123090] Updated weights for policy 1, policy_version 114976 (0.0009) [2023-12-26 00:30:11,706][123091] Updated weights for policy 0, policy_version 115362 (0.0009) [2023-12-26 00:30:11,764][123090] Updated weights for policy 1, policy_version 114986 (0.0010) [2023-12-26 00:30:11,771][123091] Updated weights for policy 0, policy_version 115372 (0.0008) [2023-12-26 00:30:11,824][123090] Updated weights for policy 1, policy_version 114996 (0.0006) [2023-12-26 00:30:11,840][123091] Updated weights for policy 0, policy_version 115382 (0.0009) [2023-12-26 00:30:11,893][123090] Updated weights for policy 1, policy_version 115006 (0.0006) [2023-12-26 00:30:11,902][123091] Updated weights for policy 0, policy_version 115392 (0.0009) [2023-12-26 00:30:12,703][123090] Updated weights for policy 1, policy_version 115016 (0.0009) [2023-12-26 00:30:12,755][123090] Updated weights for policy 1, policy_version 115026 (0.0008) [2023-12-26 00:30:12,777][123091] Updated weights for policy 0, policy_version 115402 (0.0011) [2023-12-26 00:30:12,815][123090] Updated weights for policy 1, policy_version 115036 (0.0008) [2023-12-26 00:30:12,833][123091] Updated weights for policy 0, policy_version 115412 (0.0011) [2023-12-26 00:30:12,888][123091] Updated weights for policy 0, policy_version 115422 (0.0010) [2023-12-26 00:30:13,663][123090] Updated weights for policy 1, policy_version 115046 (0.0010) [2023-12-26 00:30:13,711][123091] Updated weights for policy 0, policy_version 115432 (0.0007) [2023-12-26 00:30:13,715][123090] Updated weights for policy 1, policy_version 115056 (0.0009) [2023-12-26 00:30:13,769][123091] Updated weights for policy 0, policy_version 115442 (0.0006) [2023-12-26 00:30:13,773][123090] Updated weights for policy 1, policy_version 115066 (0.0010) [2023-12-26 00:30:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 58998784. Throughput: 0: 8532.4, 1: 8758.9. Samples: 59001728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:13,784][121949] Avg episode reward: [(0, '5200.689'), (1, '5778.570')] [2023-12-26 00:30:13,808][123008] Saving new best policy, reward=5778.570! [2023-12-26 00:30:13,815][123091] Updated weights for policy 0, policy_version 115452 (0.0006) [2023-12-26 00:30:14,560][123091] Updated weights for policy 0, policy_version 115462 (0.0008) [2023-12-26 00:30:14,610][123090] Updated weights for policy 1, policy_version 115076 (0.0009) [2023-12-26 00:30:14,616][123091] Updated weights for policy 0, policy_version 115473 (0.0009) [2023-12-26 00:30:14,672][123091] Updated weights for policy 0, policy_version 115483 (0.0008) [2023-12-26 00:30:14,675][123090] Updated weights for policy 1, policy_version 115086 (0.0008) [2023-12-26 00:30:14,729][123090] Updated weights for policy 1, policy_version 115096 (0.0007) [2023-12-26 00:30:15,533][123091] Updated weights for policy 0, policy_version 115493 (0.0010) [2023-12-26 00:30:15,588][123091] Updated weights for policy 0, policy_version 115503 (0.0009) [2023-12-26 00:30:15,591][123090] Updated weights for policy 1, policy_version 115106 (0.0009) [2023-12-26 00:30:15,647][123091] Updated weights for policy 0, policy_version 115513 (0.0007) [2023-12-26 00:30:15,652][123090] Updated weights for policy 1, policy_version 115116 (0.0010) [2023-12-26 00:30:15,718][123090] Updated weights for policy 1, policy_version 115126 (0.0007) [2023-12-26 00:30:15,786][123090] Updated weights for policy 1, policy_version 115136 (0.0010) [2023-12-26 00:30:16,440][123090] Updated weights for policy 1, policy_version 115146 (0.0007) [2023-12-26 00:30:16,493][123091] Updated weights for policy 0, policy_version 115523 (0.0008) [2023-12-26 00:30:16,500][123090] Updated weights for policy 1, policy_version 115156 (0.0008) [2023-12-26 00:30:16,553][123091] Updated weights for policy 0, policy_version 115533 (0.0010) [2023-12-26 00:30:16,564][123090] Updated weights for policy 1, policy_version 115166 (0.0007) [2023-12-26 00:30:16,610][123091] Updated weights for policy 0, policy_version 115543 (0.0009) [2023-12-26 00:30:17,351][123090] Updated weights for policy 1, policy_version 115176 (0.0009) [2023-12-26 00:30:17,406][123090] Updated weights for policy 1, policy_version 115186 (0.0010) [2023-12-26 00:30:17,413][123091] Updated weights for policy 0, policy_version 115553 (0.0009) [2023-12-26 00:30:17,461][123090] Updated weights for policy 1, policy_version 115196 (0.0010) [2023-12-26 00:30:17,472][123091] Updated weights for policy 0, policy_version 115563 (0.0005) [2023-12-26 00:30:17,522][123091] Updated weights for policy 0, policy_version 115573 (0.0009) [2023-12-26 00:30:17,573][123091] Updated weights for policy 0, policy_version 115583 (0.0009) [2023-12-26 00:30:18,235][123090] Updated weights for policy 1, policy_version 115206 (0.0010) [2023-12-26 00:30:18,291][123090] Updated weights for policy 1, policy_version 115216 (0.0010) [2023-12-26 00:30:18,363][123091] Updated weights for policy 0, policy_version 115593 (0.0009) [2023-12-26 00:30:18,377][123090] Updated weights for policy 1, policy_version 115226 (0.0011) [2023-12-26 00:30:18,427][123091] Updated weights for policy 0, policy_version 115603 (0.0008) [2023-12-26 00:30:18,493][123091] Updated weights for policy 0, policy_version 115613 (0.0006) [2023-12-26 00:30:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 59097088. Throughput: 0: 8492.8, 1: 8741.4. Samples: 59106412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:18,785][121949] Avg episode reward: [(0, '5167.959'), (1, '5797.722')] [2023-12-26 00:30:18,786][123008] Saving new best policy, reward=5797.722! [2023-12-26 00:30:19,044][123090] Updated weights for policy 1, policy_version 115236 (0.0009) [2023-12-26 00:30:19,104][123090] Updated weights for policy 1, policy_version 115246 (0.0008) [2023-12-26 00:30:19,152][123090] Updated weights for policy 1, policy_version 115256 (0.0010) [2023-12-26 00:30:19,159][123091] Updated weights for policy 0, policy_version 115623 (0.0006) [2023-12-26 00:30:19,228][123091] Updated weights for policy 0, policy_version 115633 (0.0008) [2023-12-26 00:30:19,291][123091] Updated weights for policy 0, policy_version 115643 (0.0007) [2023-12-26 00:30:19,984][123091] Updated weights for policy 0, policy_version 115653 (0.0007) [2023-12-26 00:30:20,031][123090] Updated weights for policy 1, policy_version 115266 (0.0010) [2023-12-26 00:30:20,045][123091] Updated weights for policy 0, policy_version 115663 (0.0008) [2023-12-26 00:30:20,096][123090] Updated weights for policy 1, policy_version 115276 (0.0009) [2023-12-26 00:30:20,110][123091] Updated weights for policy 0, policy_version 115673 (0.0008) [2023-12-26 00:30:20,171][123090] Updated weights for policy 1, policy_version 115286 (0.0009) [2023-12-26 00:30:20,239][123090] Updated weights for policy 1, policy_version 115296 (0.0010) [2023-12-26 00:30:20,900][123091] Updated weights for policy 0, policy_version 115683 (0.0007) [2023-12-26 00:30:20,969][123091] Updated weights for policy 0, policy_version 115693 (0.0009) [2023-12-26 00:30:21,042][123091] Updated weights for policy 0, policy_version 115703 (0.0009) [2023-12-26 00:30:21,105][123090] Updated weights for policy 1, policy_version 115306 (0.0009) [2023-12-26 00:30:21,176][123090] Updated weights for policy 1, policy_version 115316 (0.0010) [2023-12-26 00:30:21,237][123090] Updated weights for policy 1, policy_version 115326 (0.0009) [2023-12-26 00:30:21,854][123091] Updated weights for policy 0, policy_version 115713 (0.0007) [2023-12-26 00:30:21,906][123091] Updated weights for policy 0, policy_version 115723 (0.0008) [2023-12-26 00:30:21,969][123091] Updated weights for policy 0, policy_version 115733 (0.0008) [2023-12-26 00:30:22,041][123091] Updated weights for policy 0, policy_version 115743 (0.0009) [2023-12-26 00:30:22,122][123090] Updated weights for policy 1, policy_version 115336 (0.0007) [2023-12-26 00:30:22,188][123090] Updated weights for policy 1, policy_version 115346 (0.0006) [2023-12-26 00:30:22,237][123090] Updated weights for policy 1, policy_version 115356 (0.0006) [2023-12-26 00:30:22,882][123091] Updated weights for policy 0, policy_version 115753 (0.0008) [2023-12-26 00:30:22,945][123091] Updated weights for policy 0, policy_version 115763 (0.0009) [2023-12-26 00:30:22,976][123090] Updated weights for policy 1, policy_version 115366 (0.0007) [2023-12-26 00:30:23,001][123091] Updated weights for policy 0, policy_version 115773 (0.0010) [2023-12-26 00:30:23,037][123090] Updated weights for policy 1, policy_version 115376 (0.0008) [2023-12-26 00:30:23,104][123090] Updated weights for policy 1, policy_version 115386 (0.0010) [2023-12-26 00:30:23,707][123091] Updated weights for policy 0, policy_version 115783 (0.0007) [2023-12-26 00:30:23,755][123091] Updated weights for policy 0, policy_version 115793 (0.0005) [2023-12-26 00:30:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 59179008. Throughput: 0: 8528.9, 1: 8731.2. Samples: 59159264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:23,784][121949] Avg episode reward: [(0, '5085.152'), (1, '5828.012')] [2023-12-26 00:30:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000115392_29540352.pth... [2023-12-26 00:30:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000114368_29278208.pth [2023-12-26 00:30:23,794][123008] Saving new best policy, reward=5828.012! [2023-12-26 00:30:23,819][123091] Updated weights for policy 0, policy_version 115803 (0.0006) [2023-12-26 00:30:23,838][123090] Updated weights for policy 1, policy_version 115396 (0.0008) [2023-12-26 00:30:23,845][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000115808_29646848.pth... [2023-12-26 00:30:23,848][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000114784_29384704.pth [2023-12-26 00:30:23,908][123090] Updated weights for policy 1, policy_version 115406 (0.0006) [2023-12-26 00:30:23,964][123090] Updated weights for policy 1, policy_version 115416 (0.0009) [2023-12-26 00:30:24,637][123091] Updated weights for policy 0, policy_version 115813 (0.0010) [2023-12-26 00:30:24,684][123091] Updated weights for policy 0, policy_version 115823 (0.0010) [2023-12-26 00:30:24,743][123091] Updated weights for policy 0, policy_version 115833 (0.0010) [2023-12-26 00:30:24,761][123090] Updated weights for policy 1, policy_version 115426 (0.0009) [2023-12-26 00:30:24,819][123090] Updated weights for policy 1, policy_version 115436 (0.0008) [2023-12-26 00:30:24,868][123090] Updated weights for policy 1, policy_version 115446 (0.0009) [2023-12-26 00:30:25,575][123091] Updated weights for policy 0, policy_version 115843 (0.0010) [2023-12-26 00:30:25,626][123091] Updated weights for policy 0, policy_version 115853 (0.0010) [2023-12-26 00:30:25,669][123091] Updated weights for policy 0, policy_version 115863 (0.0010) [2023-12-26 00:30:25,710][123090] Updated weights for policy 1, policy_version 115457 (0.0009) [2023-12-26 00:30:25,774][123090] Updated weights for policy 1, policy_version 115467 (0.0009) [2023-12-26 00:30:25,829][123090] Updated weights for policy 1, policy_version 115477 (0.0009) [2023-12-26 00:30:25,897][123090] Updated weights for policy 1, policy_version 115487 (0.0009) [2023-12-26 00:30:26,515][123091] Updated weights for policy 0, policy_version 115873 (0.0010) [2023-12-26 00:30:26,580][123091] Updated weights for policy 0, policy_version 115883 (0.0011) [2023-12-26 00:30:26,656][123091] Updated weights for policy 0, policy_version 115893 (0.0011) [2023-12-26 00:30:26,718][123091] Updated weights for policy 0, policy_version 115903 (0.0010) [2023-12-26 00:30:26,751][123090] Updated weights for policy 1, policy_version 115497 (0.0008) [2023-12-26 00:30:26,803][123090] Updated weights for policy 1, policy_version 115507 (0.0009) [2023-12-26 00:30:26,850][123090] Updated weights for policy 1, policy_version 115517 (0.0008) [2023-12-26 00:30:27,473][123091] Updated weights for policy 0, policy_version 115913 (0.0009) [2023-12-26 00:30:27,525][123091] Updated weights for policy 0, policy_version 115923 (0.0009) [2023-12-26 00:30:27,579][123091] Updated weights for policy 0, policy_version 115933 (0.0010) [2023-12-26 00:30:27,661][123090] Updated weights for policy 1, policy_version 115527 (0.0008) [2023-12-26 00:30:27,720][123090] Updated weights for policy 1, policy_version 115537 (0.0009) [2023-12-26 00:30:27,767][123090] Updated weights for policy 1, policy_version 115547 (0.0008) [2023-12-26 00:30:28,399][123091] Updated weights for policy 0, policy_version 115943 (0.0008) [2023-12-26 00:30:28,463][123091] Updated weights for policy 0, policy_version 115953 (0.0006) [2023-12-26 00:30:28,533][123091] Updated weights for policy 0, policy_version 115963 (0.0007) [2023-12-26 00:30:28,674][123090] Updated weights for policy 1, policy_version 115557 (0.0009) [2023-12-26 00:30:28,731][123090] Updated weights for policy 1, policy_version 115567 (0.0009) [2023-12-26 00:30:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 59269120. Throughput: 0: 8582.5, 1: 8761.3. Samples: 59264796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:28,785][121949] Avg episode reward: [(0, '5074.801'), (1, '5801.254')] [2023-12-26 00:30:28,797][123090] Updated weights for policy 1, policy_version 115577 (0.0009) [2023-12-26 00:30:29,246][123091] Updated weights for policy 0, policy_version 115973 (0.0007) [2023-12-26 00:30:29,312][123091] Updated weights for policy 0, policy_version 115983 (0.0006) [2023-12-26 00:30:29,391][123091] Updated weights for policy 0, policy_version 115993 (0.0007) [2023-12-26 00:30:29,735][123090] Updated weights for policy 1, policy_version 115587 (0.0010) [2023-12-26 00:30:29,792][123090] Updated weights for policy 1, policy_version 115597 (0.0009) [2023-12-26 00:30:29,858][123090] Updated weights for policy 1, policy_version 115607 (0.0010) [2023-12-26 00:30:30,111][123091] Updated weights for policy 0, policy_version 116003 (0.0007) [2023-12-26 00:30:30,177][123091] Updated weights for policy 0, policy_version 116013 (0.0010) [2023-12-26 00:30:30,238][123091] Updated weights for policy 0, policy_version 116023 (0.0009) [2023-12-26 00:30:30,718][123090] Updated weights for policy 1, policy_version 115617 (0.0009) [2023-12-26 00:30:30,770][123090] Updated weights for policy 1, policy_version 115627 (0.0010) [2023-12-26 00:30:30,827][123090] Updated weights for policy 1, policy_version 115637 (0.0010) [2023-12-26 00:30:30,881][123090] Updated weights for policy 1, policy_version 115647 (0.0008) [2023-12-26 00:30:31,006][123091] Updated weights for policy 0, policy_version 116033 (0.0009) [2023-12-26 00:30:31,069][123091] Updated weights for policy 0, policy_version 116043 (0.0006) [2023-12-26 00:30:31,149][123091] Updated weights for policy 0, policy_version 116053 (0.0007) [2023-12-26 00:30:31,217][123091] Updated weights for policy 0, policy_version 116063 (0.0007) [2023-12-26 00:30:31,683][123090] Updated weights for policy 1, policy_version 115657 (0.0006) [2023-12-26 00:30:31,743][123090] Updated weights for policy 1, policy_version 115667 (0.0007) [2023-12-26 00:30:31,799][123090] Updated weights for policy 1, policy_version 115677 (0.0006) [2023-12-26 00:30:31,964][123091] Updated weights for policy 0, policy_version 116073 (0.0010) [2023-12-26 00:30:32,027][123091] Updated weights for policy 0, policy_version 116083 (0.0010) [2023-12-26 00:30:32,092][123091] Updated weights for policy 0, policy_version 116093 (0.0010) [2023-12-26 00:30:32,473][123090] Updated weights for policy 1, policy_version 115687 (0.0008) [2023-12-26 00:30:32,531][123090] Updated weights for policy 1, policy_version 115697 (0.0005) [2023-12-26 00:30:32,594][123090] Updated weights for policy 1, policy_version 115707 (0.0007) [2023-12-26 00:30:32,890][123091] Updated weights for policy 0, policy_version 116103 (0.0010) [2023-12-26 00:30:32,952][123091] Updated weights for policy 0, policy_version 116113 (0.0010) [2023-12-26 00:30:33,015][123091] Updated weights for policy 0, policy_version 116123 (0.0010) [2023-12-26 00:30:33,420][123090] Updated weights for policy 1, policy_version 115717 (0.0009) [2023-12-26 00:30:33,472][123090] Updated weights for policy 1, policy_version 115727 (0.0009) [2023-12-26 00:30:33,529][123090] Updated weights for policy 1, policy_version 115737 (0.0010) [2023-12-26 00:30:33,745][123091] Updated weights for policy 0, policy_version 116133 (0.0007) [2023-12-26 00:30:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 59359232. Throughput: 0: 8656.9, 1: 8718.0. Samples: 59370832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:33,785][121949] Avg episode reward: [(0, '5213.074'), (1, '5626.849')] [2023-12-26 00:30:33,805][123091] Updated weights for policy 0, policy_version 116143 (0.0005) [2023-12-26 00:30:33,873][123091] Updated weights for policy 0, policy_version 116153 (0.0006) [2023-12-26 00:30:34,466][123090] Updated weights for policy 1, policy_version 115748 (0.0010) [2023-12-26 00:30:34,503][123091] Updated weights for policy 0, policy_version 116163 (0.0006) [2023-12-26 00:30:34,528][123090] Updated weights for policy 1, policy_version 115758 (0.0007) [2023-12-26 00:30:34,567][123091] Updated weights for policy 0, policy_version 116173 (0.0010) [2023-12-26 00:30:34,594][123090] Updated weights for policy 1, policy_version 115768 (0.0006) [2023-12-26 00:30:34,635][123091] Updated weights for policy 0, policy_version 116183 (0.0007) [2023-12-26 00:30:35,407][123091] Updated weights for policy 0, policy_version 116193 (0.0007) [2023-12-26 00:30:35,425][123090] Updated weights for policy 1, policy_version 115778 (0.0008) [2023-12-26 00:30:35,459][123091] Updated weights for policy 0, policy_version 116203 (0.0005) [2023-12-26 00:30:35,485][123090] Updated weights for policy 1, policy_version 115788 (0.0009) [2023-12-26 00:30:35,504][123091] Updated weights for policy 0, policy_version 116213 (0.0006) [2023-12-26 00:30:35,540][123090] Updated weights for policy 1, policy_version 115798 (0.0010) [2023-12-26 00:30:35,563][123091] Updated weights for policy 0, policy_version 116223 (0.0005) [2023-12-26 00:30:35,600][123090] Updated weights for policy 1, policy_version 115808 (0.0010) [2023-12-26 00:30:36,352][123091] Updated weights for policy 0, policy_version 116233 (0.0006) [2023-12-26 00:30:36,421][123091] Updated weights for policy 0, policy_version 116243 (0.0006) [2023-12-26 00:30:36,488][123091] Updated weights for policy 0, policy_version 116253 (0.0008) [2023-12-26 00:30:36,499][123090] Updated weights for policy 1, policy_version 115818 (0.0008) [2023-12-26 00:30:36,562][123090] Updated weights for policy 1, policy_version 115828 (0.0009) [2023-12-26 00:30:36,633][123090] Updated weights for policy 1, policy_version 115838 (0.0009) [2023-12-26 00:30:37,229][123091] Updated weights for policy 0, policy_version 116263 (0.0006) [2023-12-26 00:30:37,304][123091] Updated weights for policy 0, policy_version 116273 (0.0005) [2023-12-26 00:30:37,376][123091] Updated weights for policy 0, policy_version 116283 (0.0005) [2023-12-26 00:30:37,476][123090] Updated weights for policy 1, policy_version 115848 (0.0011) [2023-12-26 00:30:37,540][123090] Updated weights for policy 1, policy_version 115858 (0.0011) [2023-12-26 00:30:37,608][123090] Updated weights for policy 1, policy_version 115868 (0.0011) [2023-12-26 00:30:38,022][123091] Updated weights for policy 0, policy_version 116293 (0.0006) [2023-12-26 00:30:38,091][123091] Updated weights for policy 0, policy_version 116303 (0.0006) [2023-12-26 00:30:38,164][123091] Updated weights for policy 0, policy_version 116313 (0.0005) [2023-12-26 00:30:38,499][123090] Updated weights for policy 1, policy_version 115878 (0.0010) [2023-12-26 00:30:38,549][123090] Updated weights for policy 1, policy_version 115888 (0.0009) [2023-12-26 00:30:38,617][123090] Updated weights for policy 1, policy_version 115898 (0.0010) [2023-12-26 00:30:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 59449344. Throughput: 0: 8727.4, 1: 8713.8. Samples: 59424120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:38,785][121949] Avg episode reward: [(0, '5317.507'), (1, '5615.674')] [2023-12-26 00:30:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000116320_29777920.pth... [2023-12-26 00:30:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000115904_29671424.pth... [2023-12-26 00:30:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000115296_29515776.pth [2023-12-26 00:30:38,802][123007] Saving new best policy, reward=5317.507! [2023-12-26 00:30:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000114880_29409280.pth [2023-12-26 00:30:38,956][123091] Updated weights for policy 0, policy_version 116323 (0.0007) [2023-12-26 00:30:39,022][123091] Updated weights for policy 0, policy_version 116333 (0.0009) [2023-12-26 00:30:39,074][123091] Updated weights for policy 0, policy_version 116343 (0.0009) [2023-12-26 00:30:39,500][123090] Updated weights for policy 1, policy_version 115908 (0.0011) [2023-12-26 00:30:39,565][123090] Updated weights for policy 1, policy_version 115918 (0.0011) [2023-12-26 00:30:39,630][123090] Updated weights for policy 1, policy_version 115928 (0.0011) [2023-12-26 00:30:39,980][123091] Updated weights for policy 0, policy_version 116353 (0.0009) [2023-12-26 00:30:40,048][123091] Updated weights for policy 0, policy_version 116363 (0.0009) [2023-12-26 00:30:40,105][123091] Updated weights for policy 0, policy_version 116373 (0.0009) [2023-12-26 00:30:40,162][123091] Updated weights for policy 0, policy_version 116383 (0.0009) [2023-12-26 00:30:40,465][123090] Updated weights for policy 1, policy_version 115938 (0.0011) [2023-12-26 00:30:40,537][123090] Updated weights for policy 1, policy_version 115948 (0.0011) [2023-12-26 00:30:40,585][123090] Updated weights for policy 1, policy_version 115958 (0.0010) [2023-12-26 00:30:40,640][123090] Updated weights for policy 1, policy_version 115968 (0.0010) [2023-12-26 00:30:41,003][123091] Updated weights for policy 0, policy_version 116393 (0.0008) [2023-12-26 00:30:41,069][123091] Updated weights for policy 0, policy_version 116403 (0.0009) [2023-12-26 00:30:41,133][123091] Updated weights for policy 0, policy_version 116413 (0.0008) [2023-12-26 00:30:41,530][123090] Updated weights for policy 1, policy_version 115978 (0.0009) [2023-12-26 00:30:41,605][123090] Updated weights for policy 1, policy_version 115988 (0.0009) [2023-12-26 00:30:41,668][123090] Updated weights for policy 1, policy_version 115998 (0.0007) [2023-12-26 00:30:41,977][123091] Updated weights for policy 0, policy_version 116423 (0.0010) [2023-12-26 00:30:42,044][123091] Updated weights for policy 0, policy_version 116433 (0.0009) [2023-12-26 00:30:42,120][123091] Updated weights for policy 0, policy_version 116443 (0.0008) [2023-12-26 00:30:42,453][123090] Updated weights for policy 1, policy_version 116008 (0.0008) [2023-12-26 00:30:42,508][123090] Updated weights for policy 1, policy_version 116018 (0.0008) [2023-12-26 00:30:42,560][123090] Updated weights for policy 1, policy_version 116028 (0.0008) [2023-12-26 00:30:42,954][123091] Updated weights for policy 0, policy_version 116453 (0.0009) [2023-12-26 00:30:43,020][123091] Updated weights for policy 0, policy_version 116463 (0.0009) [2023-12-26 00:30:43,078][123091] Updated weights for policy 0, policy_version 116473 (0.0009) [2023-12-26 00:30:43,366][123090] Updated weights for policy 1, policy_version 116038 (0.0009) [2023-12-26 00:30:43,421][123090] Updated weights for policy 1, policy_version 116048 (0.0009) [2023-12-26 00:30:43,469][123090] Updated weights for policy 1, policy_version 116058 (0.0009) [2023-12-26 00:30:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 59531264. Throughput: 0: 8787.5, 1: 8547.7. Samples: 59525880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:30:43,785][121949] Avg episode reward: [(0, '5247.711'), (1, '5750.557')] [2023-12-26 00:30:43,920][123091] Updated weights for policy 0, policy_version 116483 (0.0010) [2023-12-26 00:30:43,968][123091] Updated weights for policy 0, policy_version 116493 (0.0009) [2023-12-26 00:30:44,021][123091] Updated weights for policy 0, policy_version 116503 (0.0009) [2023-12-26 00:30:44,322][123090] Updated weights for policy 1, policy_version 116068 (0.0010) [2023-12-26 00:30:44,369][123090] Updated weights for policy 1, policy_version 116078 (0.0009) [2023-12-26 00:30:44,423][123090] Updated weights for policy 1, policy_version 116088 (0.0009) [2023-12-26 00:30:44,845][123091] Updated weights for policy 0, policy_version 116513 (0.0009) [2023-12-26 00:30:44,915][123091] Updated weights for policy 0, policy_version 116523 (0.0010) [2023-12-26 00:30:44,984][123091] Updated weights for policy 0, policy_version 116533 (0.0009) [2023-12-26 00:30:45,042][123091] Updated weights for policy 0, policy_version 116543 (0.0008) [2023-12-26 00:30:45,248][123090] Updated weights for policy 1, policy_version 116098 (0.0006) [2023-12-26 00:30:45,314][123090] Updated weights for policy 1, policy_version 116108 (0.0008) [2023-12-26 00:30:45,379][123090] Updated weights for policy 1, policy_version 116118 (0.0009) [2023-12-26 00:30:45,458][123090] Updated weights for policy 1, policy_version 116128 (0.0010) [2023-12-26 00:30:45,801][123091] Updated weights for policy 0, policy_version 116553 (0.0009) [2023-12-26 00:30:45,857][123091] Updated weights for policy 0, policy_version 116563 (0.0009) [2023-12-26 00:30:45,916][123091] Updated weights for policy 0, policy_version 116573 (0.0009) [2023-12-26 00:30:46,274][123090] Updated weights for policy 1, policy_version 116138 (0.0009) [2023-12-26 00:30:46,331][123090] Updated weights for policy 1, policy_version 116148 (0.0009) [2023-12-26 00:30:46,397][123090] Updated weights for policy 1, policy_version 116158 (0.0009) [2023-12-26 00:30:46,703][123091] Updated weights for policy 0, policy_version 116583 (0.0007) [2023-12-26 00:30:46,773][123091] Updated weights for policy 0, policy_version 116593 (0.0006) [2023-12-26 00:30:46,845][123091] Updated weights for policy 0, policy_version 116603 (0.0008) [2023-12-26 00:30:47,233][123090] Updated weights for policy 1, policy_version 116168 (0.0010) [2023-12-26 00:30:47,293][123090] Updated weights for policy 1, policy_version 116178 (0.0010) [2023-12-26 00:30:47,356][123090] Updated weights for policy 1, policy_version 116188 (0.0010) [2023-12-26 00:30:47,559][123091] Updated weights for policy 0, policy_version 116613 (0.0008) [2023-12-26 00:30:47,628][123091] Updated weights for policy 0, policy_version 116623 (0.0006) [2023-12-26 00:30:47,700][123091] Updated weights for policy 0, policy_version 116633 (0.0005) [2023-12-26 00:30:48,222][123090] Updated weights for policy 1, policy_version 116198 (0.0010) [2023-12-26 00:30:48,269][123090] Updated weights for policy 1, policy_version 116208 (0.0007) [2023-12-26 00:30:48,346][123090] Updated weights for policy 1, policy_version 116218 (0.0006) [2023-12-26 00:30:48,451][123091] Updated weights for policy 0, policy_version 116643 (0.0009) [2023-12-26 00:30:48,501][123091] Updated weights for policy 0, policy_version 116653 (0.0009) [2023-12-26 00:30:48,551][123091] Updated weights for policy 0, policy_version 116663 (0.0010) [2023-12-26 00:30:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 59621376. Throughput: 0: 8801.3, 1: 8567.6. Samples: 59630424. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:30:48,785][121949] Avg episode reward: [(0, '5199.250'), (1, '5763.534')] [2023-12-26 00:30:49,125][123090] Updated weights for policy 1, policy_version 116228 (0.0007) [2023-12-26 00:30:49,171][123090] Updated weights for policy 1, policy_version 116238 (0.0008) [2023-12-26 00:30:49,224][123090] Updated weights for policy 1, policy_version 116248 (0.0007) [2023-12-26 00:30:49,457][123091] Updated weights for policy 0, policy_version 116673 (0.0009) [2023-12-26 00:30:49,530][123091] Updated weights for policy 0, policy_version 116683 (0.0008) [2023-12-26 00:30:49,584][123091] Updated weights for policy 0, policy_version 116693 (0.0008) [2023-12-26 00:30:49,639][123091] Updated weights for policy 0, policy_version 116703 (0.0008) [2023-12-26 00:30:50,085][123090] Updated weights for policy 1, policy_version 116258 (0.0008) [2023-12-26 00:30:50,142][123090] Updated weights for policy 1, policy_version 116268 (0.0009) [2023-12-26 00:30:50,205][123090] Updated weights for policy 1, policy_version 116278 (0.0008) [2023-12-26 00:30:50,259][123090] Updated weights for policy 1, policy_version 116288 (0.0005) [2023-12-26 00:30:50,459][123091] Updated weights for policy 0, policy_version 116713 (0.0009) [2023-12-26 00:30:50,518][123091] Updated weights for policy 0, policy_version 116723 (0.0010) [2023-12-26 00:30:50,581][123091] Updated weights for policy 0, policy_version 116733 (0.0009) [2023-12-26 00:30:51,013][123090] Updated weights for policy 1, policy_version 116298 (0.0010) [2023-12-26 00:30:51,084][123090] Updated weights for policy 1, policy_version 116308 (0.0009) [2023-12-26 00:30:51,155][123090] Updated weights for policy 1, policy_version 116318 (0.0007) [2023-12-26 00:30:51,453][123091] Updated weights for policy 0, policy_version 116743 (0.0009) [2023-12-26 00:30:51,530][123091] Updated weights for policy 0, policy_version 116753 (0.0006) [2023-12-26 00:30:51,583][123091] Updated weights for policy 0, policy_version 116763 (0.0009) [2023-12-26 00:30:51,940][123090] Updated weights for policy 1, policy_version 116328 (0.0008) [2023-12-26 00:30:52,001][123090] Updated weights for policy 1, policy_version 116338 (0.0009) [2023-12-26 00:30:52,060][123090] Updated weights for policy 1, policy_version 116348 (0.0008) [2023-12-26 00:30:52,395][123091] Updated weights for policy 0, policy_version 116773 (0.0010) [2023-12-26 00:30:52,458][123091] Updated weights for policy 0, policy_version 116783 (0.0011) [2023-12-26 00:30:52,516][123091] Updated weights for policy 0, policy_version 116793 (0.0007) [2023-12-26 00:30:52,861][123090] Updated weights for policy 1, policy_version 116358 (0.0008) [2023-12-26 00:30:52,932][123090] Updated weights for policy 1, policy_version 116368 (0.0010) [2023-12-26 00:30:52,998][123090] Updated weights for policy 1, policy_version 116378 (0.0009) [2023-12-26 00:30:53,235][123091] Updated weights for policy 0, policy_version 116803 (0.0007) [2023-12-26 00:30:53,284][123091] Updated weights for policy 0, policy_version 116813 (0.0009) [2023-12-26 00:30:53,332][123091] Updated weights for policy 0, policy_version 116823 (0.0009) [2023-12-26 00:30:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 59703296. Throughput: 0: 8799.7, 1: 8579.0. Samples: 59682284. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:30:53,785][121949] Avg episode reward: [(0, '5206.477'), (1, '5763.727')] [2023-12-26 00:30:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000116832_29908992.pth... [2023-12-26 00:30:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000116384_29794304.pth... [2023-12-26 00:30:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000115808_29646848.pth [2023-12-26 00:30:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000115392_29540352.pth [2023-12-26 00:30:53,855][123090] Updated weights for policy 1, policy_version 116388 (0.0009) [2023-12-26 00:30:53,901][123090] Updated weights for policy 1, policy_version 116398 (0.0008) [2023-12-26 00:30:53,964][123090] Updated weights for policy 1, policy_version 116408 (0.0009) [2023-12-26 00:30:54,155][123091] Updated weights for policy 0, policy_version 116833 (0.0008) [2023-12-26 00:30:54,227][123091] Updated weights for policy 0, policy_version 116843 (0.0008) [2023-12-26 00:30:54,288][123091] Updated weights for policy 0, policy_version 116853 (0.0007) [2023-12-26 00:30:54,350][123091] Updated weights for policy 0, policy_version 116863 (0.0006) [2023-12-26 00:30:54,889][123090] Updated weights for policy 1, policy_version 116418 (0.0010) [2023-12-26 00:30:54,961][123090] Updated weights for policy 1, policy_version 116428 (0.0009) [2023-12-26 00:30:54,968][123091] Updated weights for policy 0, policy_version 116873 (0.0009) [2023-12-26 00:30:55,028][123090] Updated weights for policy 1, policy_version 116438 (0.0010) [2023-12-26 00:30:55,030][123091] Updated weights for policy 0, policy_version 116883 (0.0006) [2023-12-26 00:30:55,087][123091] Updated weights for policy 0, policy_version 116893 (0.0009) [2023-12-26 00:30:55,094][123090] Updated weights for policy 1, policy_version 116448 (0.0008) [2023-12-26 00:30:55,907][123090] Updated weights for policy 1, policy_version 116458 (0.0008) [2023-12-26 00:30:55,921][123091] Updated weights for policy 0, policy_version 116903 (0.0009) [2023-12-26 00:30:55,960][123090] Updated weights for policy 1, policy_version 116468 (0.0007) [2023-12-26 00:30:55,976][123091] Updated weights for policy 0, policy_version 116913 (0.0009) [2023-12-26 00:30:56,013][123090] Updated weights for policy 1, policy_version 116478 (0.0008) [2023-12-26 00:30:56,040][123091] Updated weights for policy 0, policy_version 116923 (0.0010) [2023-12-26 00:30:56,862][123090] Updated weights for policy 1, policy_version 116488 (0.0009) [2023-12-26 00:30:56,874][123091] Updated weights for policy 0, policy_version 116933 (0.0009) [2023-12-26 00:30:56,924][123090] Updated weights for policy 1, policy_version 116498 (0.0009) [2023-12-26 00:30:56,939][123091] Updated weights for policy 0, policy_version 116943 (0.0009) [2023-12-26 00:30:56,985][123090] Updated weights for policy 1, policy_version 116508 (0.0006) [2023-12-26 00:30:56,999][123091] Updated weights for policy 0, policy_version 116953 (0.0009) [2023-12-26 00:30:57,763][123091] Updated weights for policy 0, policy_version 116963 (0.0010) [2023-12-26 00:30:57,817][123090] Updated weights for policy 1, policy_version 116518 (0.0006) [2023-12-26 00:30:57,820][123091] Updated weights for policy 0, policy_version 116973 (0.0009) [2023-12-26 00:30:57,866][123090] Updated weights for policy 1, policy_version 116528 (0.0008) [2023-12-26 00:30:57,880][123091] Updated weights for policy 0, policy_version 116983 (0.0009) [2023-12-26 00:30:57,930][123090] Updated weights for policy 1, policy_version 116538 (0.0009) [2023-12-26 00:30:58,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 59785216. Throughput: 0: 8906.0, 1: 8529.8. Samples: 59786340. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:30:58,785][121949] Avg episode reward: [(0, '5262.915'), (1, '5738.190')] [2023-12-26 00:30:58,905][123091] Updated weights for policy 0, policy_version 116993 (0.0009) [2023-12-26 00:30:58,962][123090] Updated weights for policy 1, policy_version 116548 (0.0009) [2023-12-26 00:30:58,981][123091] Updated weights for policy 0, policy_version 117003 (0.0008) [2023-12-26 00:30:59,029][123090] Updated weights for policy 1, policy_version 116558 (0.0008) [2023-12-26 00:30:59,053][123091] Updated weights for policy 0, policy_version 117013 (0.0008) [2023-12-26 00:30:59,106][123090] Updated weights for policy 1, policy_version 116568 (0.0008) [2023-12-26 00:30:59,119][123091] Updated weights for policy 0, policy_version 117023 (0.0008) [2023-12-26 00:30:59,895][123090] Updated weights for policy 1, policy_version 116578 (0.0008) [2023-12-26 00:30:59,964][123090] Updated weights for policy 1, policy_version 116588 (0.0009) [2023-12-26 00:30:59,988][123091] Updated weights for policy 0, policy_version 117033 (0.0008) [2023-12-26 00:31:00,031][123090] Updated weights for policy 1, policy_version 116598 (0.0009) [2023-12-26 00:31:00,056][123091] Updated weights for policy 0, policy_version 117043 (0.0008) [2023-12-26 00:31:00,093][123090] Updated weights for policy 1, policy_version 116608 (0.0010) [2023-12-26 00:31:00,118][123091] Updated weights for policy 0, policy_version 117053 (0.0007) [2023-12-26 00:31:00,910][123090] Updated weights for policy 1, policy_version 116618 (0.0010) [2023-12-26 00:31:00,947][123091] Updated weights for policy 0, policy_version 117063 (0.0010) [2023-12-26 00:31:00,965][123090] Updated weights for policy 1, policy_version 116628 (0.0008) [2023-12-26 00:31:01,008][123091] Updated weights for policy 0, policy_version 117073 (0.0008) [2023-12-26 00:31:01,033][123090] Updated weights for policy 1, policy_version 116638 (0.0008) [2023-12-26 00:31:01,080][123091] Updated weights for policy 0, policy_version 117083 (0.0009) [2023-12-26 00:31:01,869][123090] Updated weights for policy 1, policy_version 116648 (0.0010) [2023-12-26 00:31:01,939][123091] Updated weights for policy 0, policy_version 117093 (0.0008) [2023-12-26 00:31:01,942][123090] Updated weights for policy 1, policy_version 116658 (0.0008) [2023-12-26 00:31:02,001][123091] Updated weights for policy 0, policy_version 117103 (0.0008) [2023-12-26 00:31:02,011][123090] Updated weights for policy 1, policy_version 116668 (0.0010) [2023-12-26 00:31:02,066][123091] Updated weights for policy 0, policy_version 117113 (0.0006) [2023-12-26 00:31:02,796][123090] Updated weights for policy 1, policy_version 116678 (0.0009) [2023-12-26 00:31:02,854][123090] Updated weights for policy 1, policy_version 116688 (0.0010) [2023-12-26 00:31:02,865][123091] Updated weights for policy 0, policy_version 117123 (0.0007) [2023-12-26 00:31:02,915][123090] Updated weights for policy 1, policy_version 116698 (0.0007) [2023-12-26 00:31:02,928][123091] Updated weights for policy 0, policy_version 117133 (0.0009) [2023-12-26 00:31:02,993][123091] Updated weights for policy 0, policy_version 117143 (0.0009) [2023-12-26 00:31:03,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 59867136. Throughput: 0: 8840.5, 1: 8465.1. Samples: 59885164. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:03,785][123090] Updated weights for policy 1, policy_version 116708 (0.0008) [2023-12-26 00:31:03,785][121949] Avg episode reward: [(0, '5307.915'), (1, '5689.322')] [2023-12-26 00:31:03,792][123091] Updated weights for policy 0, policy_version 117153 (0.0009) [2023-12-26 00:31:03,856][123090] Updated weights for policy 1, policy_version 116718 (0.0007) [2023-12-26 00:31:03,858][123091] Updated weights for policy 0, policy_version 117163 (0.0009) [2023-12-26 00:31:03,915][123091] Updated weights for policy 0, policy_version 117173 (0.0009) [2023-12-26 00:31:03,921][123090] Updated weights for policy 1, policy_version 116728 (0.0006) [2023-12-26 00:31:03,973][123091] Updated weights for policy 0, policy_version 117183 (0.0009) [2023-12-26 00:31:04,619][123090] Updated weights for policy 1, policy_version 116738 (0.0007) [2023-12-26 00:31:04,676][123090] Updated weights for policy 1, policy_version 116748 (0.0010) [2023-12-26 00:31:04,743][123090] Updated weights for policy 1, policy_version 116758 (0.0009) [2023-12-26 00:31:04,814][123090] Updated weights for policy 1, policy_version 116768 (0.0009) [2023-12-26 00:31:04,823][123091] Updated weights for policy 0, policy_version 117193 (0.0008) [2023-12-26 00:31:04,892][123091] Updated weights for policy 0, policy_version 117203 (0.0009) [2023-12-26 00:31:04,957][123091] Updated weights for policy 0, policy_version 117213 (0.0009) [2023-12-26 00:31:05,567][123090] Updated weights for policy 1, policy_version 116778 (0.0009) [2023-12-26 00:31:05,617][123090] Updated weights for policy 1, policy_version 116788 (0.0008) [2023-12-26 00:31:05,673][123090] Updated weights for policy 1, policy_version 116798 (0.0005) [2023-12-26 00:31:05,760][123091] Updated weights for policy 0, policy_version 117223 (0.0010) [2023-12-26 00:31:05,821][123091] Updated weights for policy 0, policy_version 117233 (0.0009) [2023-12-26 00:31:05,877][123091] Updated weights for policy 0, policy_version 117243 (0.0010) [2023-12-26 00:31:06,479][123090] Updated weights for policy 1, policy_version 116808 (0.0006) [2023-12-26 00:31:06,549][123090] Updated weights for policy 1, policy_version 116818 (0.0006) [2023-12-26 00:31:06,621][123090] Updated weights for policy 1, policy_version 116828 (0.0007) [2023-12-26 00:31:06,637][123091] Updated weights for policy 0, policy_version 117253 (0.0010) [2023-12-26 00:31:06,709][123091] Updated weights for policy 0, policy_version 117263 (0.0007) [2023-12-26 00:31:06,773][123091] Updated weights for policy 0, policy_version 117273 (0.0009) [2023-12-26 00:31:07,314][123090] Updated weights for policy 1, policy_version 116838 (0.0011) [2023-12-26 00:31:07,390][123090] Updated weights for policy 1, policy_version 116848 (0.0011) [2023-12-26 00:31:07,462][123090] Updated weights for policy 1, policy_version 116858 (0.0011) [2023-12-26 00:31:07,473][123091] Updated weights for policy 0, policy_version 117283 (0.0008) [2023-12-26 00:31:07,532][123091] Updated weights for policy 0, policy_version 117293 (0.0008) [2023-12-26 00:31:07,595][123091] Updated weights for policy 0, policy_version 117303 (0.0008) [2023-12-26 00:31:08,272][123090] Updated weights for policy 1, policy_version 116868 (0.0011) [2023-12-26 00:31:08,342][123090] Updated weights for policy 1, policy_version 116878 (0.0009) [2023-12-26 00:31:08,414][123090] Updated weights for policy 1, policy_version 116888 (0.0006) [2023-12-26 00:31:08,415][123091] Updated weights for policy 0, policy_version 117313 (0.0009) [2023-12-26 00:31:08,472][123091] Updated weights for policy 0, policy_version 117323 (0.0009) [2023-12-26 00:31:08,533][123091] Updated weights for policy 0, policy_version 117333 (0.0009) [2023-12-26 00:31:08,586][123091] Updated weights for policy 0, policy_version 117343 (0.0010) [2023-12-26 00:31:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 59965440. Throughput: 0: 8801.0, 1: 8510.1. Samples: 59938268. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:08,785][121949] Avg episode reward: [(0, '5279.172'), (1, '5680.427')] [2023-12-26 00:31:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000116896_29925376.pth... [2023-12-26 00:31:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000117344_30040064.pth... [2023-12-26 00:31:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000115904_29671424.pth [2023-12-26 00:31:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000116320_29777920.pth [2023-12-26 00:31:09,156][123090] Updated weights for policy 1, policy_version 116898 (0.0006) [2023-12-26 00:31:09,212][123090] Updated weights for policy 1, policy_version 116908 (0.0010) [2023-12-26 00:31:09,277][123090] Updated weights for policy 1, policy_version 116918 (0.0011) [2023-12-26 00:31:09,346][123090] Updated weights for policy 1, policy_version 116928 (0.0011) [2023-12-26 00:31:09,415][123091] Updated weights for policy 0, policy_version 117353 (0.0009) [2023-12-26 00:31:09,485][123091] Updated weights for policy 0, policy_version 117363 (0.0008) [2023-12-26 00:31:09,544][123091] Updated weights for policy 0, policy_version 117373 (0.0010) [2023-12-26 00:31:10,181][123090] Updated weights for policy 1, policy_version 116938 (0.0010) [2023-12-26 00:31:10,250][123090] Updated weights for policy 1, policy_version 116948 (0.0010) [2023-12-26 00:31:10,315][123090] Updated weights for policy 1, policy_version 116958 (0.0009) [2023-12-26 00:31:10,451][123091] Updated weights for policy 0, policy_version 117383 (0.0010) [2023-12-26 00:31:10,517][123091] Updated weights for policy 0, policy_version 117393 (0.0010) [2023-12-26 00:31:10,578][123091] Updated weights for policy 0, policy_version 117403 (0.0009) [2023-12-26 00:31:11,146][123090] Updated weights for policy 1, policy_version 116968 (0.0010) [2023-12-26 00:31:11,225][123090] Updated weights for policy 1, policy_version 116978 (0.0010) [2023-12-26 00:31:11,293][123090] Updated weights for policy 1, policy_version 116988 (0.0010) [2023-12-26 00:31:11,454][123091] Updated weights for policy 0, policy_version 117413 (0.0009) [2023-12-26 00:31:11,507][123091] Updated weights for policy 0, policy_version 117423 (0.0009) [2023-12-26 00:31:11,564][123091] Updated weights for policy 0, policy_version 117433 (0.0009) [2023-12-26 00:31:12,068][123090] Updated weights for policy 1, policy_version 116998 (0.0007) [2023-12-26 00:31:12,131][123090] Updated weights for policy 1, policy_version 117008 (0.0008) [2023-12-26 00:31:12,203][123090] Updated weights for policy 1, policy_version 117018 (0.0007) [2023-12-26 00:31:12,484][123091] Updated weights for policy 0, policy_version 117443 (0.0009) [2023-12-26 00:31:12,549][123091] Updated weights for policy 0, policy_version 117454 (0.0011) [2023-12-26 00:31:12,618][123091] Updated weights for policy 0, policy_version 117464 (0.0010) [2023-12-26 00:31:12,960][123090] Updated weights for policy 1, policy_version 117028 (0.0006) [2023-12-26 00:31:13,025][123090] Updated weights for policy 1, policy_version 117038 (0.0005) [2023-12-26 00:31:13,091][123090] Updated weights for policy 1, policy_version 117048 (0.0005) [2023-12-26 00:31:13,449][123091] Updated weights for policy 0, policy_version 117474 (0.0011) [2023-12-26 00:31:13,516][123091] Updated weights for policy 0, policy_version 117484 (0.0008) [2023-12-26 00:31:13,581][123091] Updated weights for policy 0, policy_version 117494 (0.0005) [2023-12-26 00:31:13,642][123091] Updated weights for policy 0, policy_version 117504 (0.0005) [2023-12-26 00:31:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 60047360. Throughput: 0: 8737.7, 1: 8505.0. Samples: 60040716. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:13,785][121949] Avg episode reward: [(0, '5248.588'), (1, '5652.453')] [2023-12-26 00:31:13,811][123090] Updated weights for policy 1, policy_version 117058 (0.0006) [2023-12-26 00:31:13,866][123090] Updated weights for policy 1, policy_version 117068 (0.0010) [2023-12-26 00:31:13,920][123090] Updated weights for policy 1, policy_version 117078 (0.0010) [2023-12-26 00:31:13,975][123090] Updated weights for policy 1, policy_version 117088 (0.0010) [2023-12-26 00:31:14,292][123091] Updated weights for policy 0, policy_version 117514 (0.0005) [2023-12-26 00:31:14,344][123091] Updated weights for policy 0, policy_version 117524 (0.0006) [2023-12-26 00:31:14,408][123091] Updated weights for policy 0, policy_version 117534 (0.0006) [2023-12-26 00:31:14,821][123090] Updated weights for policy 1, policy_version 117098 (0.0010) [2023-12-26 00:31:14,878][123090] Updated weights for policy 1, policy_version 117108 (0.0009) [2023-12-26 00:31:14,934][123090] Updated weights for policy 1, policy_version 117118 (0.0010) [2023-12-26 00:31:15,096][123091] Updated weights for policy 0, policy_version 117544 (0.0010) [2023-12-26 00:31:15,170][123091] Updated weights for policy 0, policy_version 117554 (0.0011) [2023-12-26 00:31:15,234][123091] Updated weights for policy 0, policy_version 117564 (0.0011) [2023-12-26 00:31:15,804][123090] Updated weights for policy 1, policy_version 117128 (0.0011) [2023-12-26 00:31:15,856][123090] Updated weights for policy 1, policy_version 117138 (0.0010) [2023-12-26 00:31:15,907][123090] Updated weights for policy 1, policy_version 117148 (0.0010) [2023-12-26 00:31:15,935][123091] Updated weights for policy 0, policy_version 117574 (0.0008) [2023-12-26 00:31:15,988][123091] Updated weights for policy 0, policy_version 117584 (0.0008) [2023-12-26 00:31:16,038][123091] Updated weights for policy 0, policy_version 117594 (0.0005) [2023-12-26 00:31:16,718][123090] Updated weights for policy 1, policy_version 117158 (0.0007) [2023-12-26 00:31:16,781][123090] Updated weights for policy 1, policy_version 117168 (0.0005) [2023-12-26 00:31:16,793][123091] Updated weights for policy 0, policy_version 117604 (0.0005) [2023-12-26 00:31:16,844][123091] Updated weights for policy 0, policy_version 117614 (0.0005) [2023-12-26 00:31:16,845][123090] Updated weights for policy 1, policy_version 117178 (0.0010) [2023-12-26 00:31:16,898][123091] Updated weights for policy 0, policy_version 117624 (0.0005) [2023-12-26 00:31:17,487][123091] Updated weights for policy 0, policy_version 117634 (0.0005) [2023-12-26 00:31:17,558][123091] Updated weights for policy 0, policy_version 117644 (0.0005) [2023-12-26 00:31:17,568][123090] Updated weights for policy 1, policy_version 117188 (0.0009) [2023-12-26 00:31:17,631][123091] Updated weights for policy 0, policy_version 117654 (0.0005) [2023-12-26 00:31:17,633][123090] Updated weights for policy 1, policy_version 117198 (0.0006) [2023-12-26 00:31:17,697][123090] Updated weights for policy 1, policy_version 117208 (0.0005) [2023-12-26 00:31:17,704][123091] Updated weights for policy 0, policy_version 117664 (0.0007) [2023-12-26 00:31:18,303][123091] Updated weights for policy 0, policy_version 117674 (0.0005) [2023-12-26 00:31:18,365][123091] Updated weights for policy 0, policy_version 117684 (0.0007) [2023-12-26 00:31:18,424][123091] Updated weights for policy 0, policy_version 117694 (0.0006) [2023-12-26 00:31:18,498][123090] Updated weights for policy 1, policy_version 117218 (0.0007) [2023-12-26 00:31:18,562][123090] Updated weights for policy 1, policy_version 117228 (0.0011) [2023-12-26 00:31:18,627][123090] Updated weights for policy 1, policy_version 117238 (0.0011) [2023-12-26 00:31:18,694][123090] Updated weights for policy 1, policy_version 117248 (0.0011) [2023-12-26 00:31:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 60145664. Throughput: 0: 8828.6, 1: 8563.8. Samples: 60153492. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:18,785][121949] Avg episode reward: [(0, '5245.380'), (1, '5634.667')] [2023-12-26 00:31:19,212][123091] Updated weights for policy 0, policy_version 117704 (0.0008) [2023-12-26 00:31:19,282][123091] Updated weights for policy 0, policy_version 117715 (0.0007) [2023-12-26 00:31:19,346][123091] Updated weights for policy 0, policy_version 117725 (0.0007) [2023-12-26 00:31:19,517][123090] Updated weights for policy 1, policy_version 117258 (0.0008) [2023-12-26 00:31:19,576][123090] Updated weights for policy 1, policy_version 117268 (0.0008) [2023-12-26 00:31:19,629][123090] Updated weights for policy 1, policy_version 117278 (0.0008) [2023-12-26 00:31:20,204][123091] Updated weights for policy 0, policy_version 117735 (0.0009) [2023-12-26 00:31:20,286][123091] Updated weights for policy 0, policy_version 117745 (0.0009) [2023-12-26 00:31:20,354][123091] Updated weights for policy 0, policy_version 117755 (0.0009) [2023-12-26 00:31:20,404][123090] Updated weights for policy 1, policy_version 117288 (0.0009) [2023-12-26 00:31:20,463][123090] Updated weights for policy 1, policy_version 117298 (0.0009) [2023-12-26 00:31:20,520][123090] Updated weights for policy 1, policy_version 117308 (0.0009) [2023-12-26 00:31:21,201][123091] Updated weights for policy 0, policy_version 117765 (0.0008) [2023-12-26 00:31:21,254][123090] Updated weights for policy 1, policy_version 117318 (0.0008) [2023-12-26 00:31:21,271][123091] Updated weights for policy 0, policy_version 117775 (0.0009) [2023-12-26 00:31:21,323][123090] Updated weights for policy 1, policy_version 117328 (0.0006) [2023-12-26 00:31:21,340][123091] Updated weights for policy 0, policy_version 117785 (0.0008) [2023-12-26 00:31:21,399][123090] Updated weights for policy 1, policy_version 117338 (0.0008) [2023-12-26 00:31:22,186][123090] Updated weights for policy 1, policy_version 117348 (0.0008) [2023-12-26 00:31:22,212][123091] Updated weights for policy 0, policy_version 117795 (0.0009) [2023-12-26 00:31:22,252][123090] Updated weights for policy 1, policy_version 117358 (0.0008) [2023-12-26 00:31:22,270][123091] Updated weights for policy 0, policy_version 117805 (0.0010) [2023-12-26 00:31:22,324][123090] Updated weights for policy 1, policy_version 117368 (0.0006) [2023-12-26 00:31:22,331][123091] Updated weights for policy 0, policy_version 117815 (0.0008) [2023-12-26 00:31:23,137][123090] Updated weights for policy 1, policy_version 117378 (0.0010) [2023-12-26 00:31:23,191][123091] Updated weights for policy 0, policy_version 117825 (0.0009) [2023-12-26 00:31:23,203][123090] Updated weights for policy 1, policy_version 117388 (0.0009) [2023-12-26 00:31:23,257][123091] Updated weights for policy 0, policy_version 117835 (0.0010) [2023-12-26 00:31:23,264][123090] Updated weights for policy 1, policy_version 117398 (0.0007) [2023-12-26 00:31:23,319][123091] Updated weights for policy 0, policy_version 117845 (0.0008) [2023-12-26 00:31:23,321][123090] Updated weights for policy 1, policy_version 117408 (0.0008) [2023-12-26 00:31:23,377][123091] Updated weights for policy 0, policy_version 117855 (0.0010) [2023-12-26 00:31:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 60227584. Throughput: 0: 8738.9, 1: 8609.4. Samples: 60204796. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:23,785][121949] Avg episode reward: [(0, '5247.983'), (1, '5685.970')] [2023-12-26 00:31:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000117408_30056448.pth... [2023-12-26 00:31:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000117856_30171136.pth... [2023-12-26 00:31:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000116384_29794304.pth [2023-12-26 00:31:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000116832_29908992.pth [2023-12-26 00:31:24,152][123090] Updated weights for policy 1, policy_version 117418 (0.0009) [2023-12-26 00:31:24,194][123091] Updated weights for policy 0, policy_version 117865 (0.0007) [2023-12-26 00:31:24,205][123090] Updated weights for policy 1, policy_version 117428 (0.0008) [2023-12-26 00:31:24,248][123091] Updated weights for policy 0, policy_version 117875 (0.0007) [2023-12-26 00:31:24,254][123090] Updated weights for policy 1, policy_version 117438 (0.0010) [2023-12-26 00:31:24,313][123091] Updated weights for policy 0, policy_version 117885 (0.0010) [2023-12-26 00:31:25,049][123090] Updated weights for policy 1, policy_version 117448 (0.0007) [2023-12-26 00:31:25,105][123090] Updated weights for policy 1, policy_version 117458 (0.0005) [2023-12-26 00:31:25,143][123091] Updated weights for policy 0, policy_version 117895 (0.0006) [2023-12-26 00:31:25,164][123090] Updated weights for policy 1, policy_version 117468 (0.0008) [2023-12-26 00:31:25,204][123091] Updated weights for policy 0, policy_version 117905 (0.0009) [2023-12-26 00:31:25,271][123091] Updated weights for policy 0, policy_version 117915 (0.0011) [2023-12-26 00:31:25,989][123090] Updated weights for policy 1, policy_version 117478 (0.0008) [2023-12-26 00:31:26,011][123091] Updated weights for policy 0, policy_version 117925 (0.0010) [2023-12-26 00:31:26,053][123090] Updated weights for policy 1, policy_version 117488 (0.0007) [2023-12-26 00:31:26,074][123091] Updated weights for policy 0, policy_version 117935 (0.0009) [2023-12-26 00:31:26,113][123090] Updated weights for policy 1, policy_version 117498 (0.0010) [2023-12-26 00:31:26,140][123091] Updated weights for policy 0, policy_version 117945 (0.0011) [2023-12-26 00:31:26,850][123091] Updated weights for policy 0, policy_version 117955 (0.0009) [2023-12-26 00:31:26,900][123091] Updated weights for policy 0, policy_version 117965 (0.0005) [2023-12-26 00:31:26,949][123091] Updated weights for policy 0, policy_version 117975 (0.0005) [2023-12-26 00:31:26,966][123090] Updated weights for policy 1, policy_version 117508 (0.0007) [2023-12-26 00:31:27,021][123090] Updated weights for policy 1, policy_version 117519 (0.0009) [2023-12-26 00:31:27,075][123090] Updated weights for policy 1, policy_version 117529 (0.0009) [2023-12-26 00:31:27,730][123091] Updated weights for policy 0, policy_version 117985 (0.0006) [2023-12-26 00:31:27,791][123091] Updated weights for policy 0, policy_version 117995 (0.0010) [2023-12-26 00:31:27,845][123091] Updated weights for policy 0, policy_version 118005 (0.0010) [2023-12-26 00:31:27,896][123091] Updated weights for policy 0, policy_version 118015 (0.0010) [2023-12-26 00:31:27,935][123090] Updated weights for policy 1, policy_version 117539 (0.0009) [2023-12-26 00:31:27,991][123090] Updated weights for policy 1, policy_version 117550 (0.0009) [2023-12-26 00:31:28,043][123090] Updated weights for policy 1, policy_version 117560 (0.0006) [2023-12-26 00:31:28,666][123091] Updated weights for policy 0, policy_version 118025 (0.0006) [2023-12-26 00:31:28,728][123091] Updated weights for policy 0, policy_version 118035 (0.0006) [2023-12-26 00:31:28,782][123091] Updated weights for policy 0, policy_version 118045 (0.0006) [2023-12-26 00:31:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 60309504. Throughput: 0: 8758.1, 1: 8643.4. Samples: 60308948. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:28,785][121949] Avg episode reward: [(0, '5252.344'), (1, '5735.704')] [2023-12-26 00:31:28,915][123090] Updated weights for policy 1, policy_version 117570 (0.0006) [2023-12-26 00:31:28,986][123090] Updated weights for policy 1, policy_version 117580 (0.0009) [2023-12-26 00:31:29,039][123090] Updated weights for policy 1, policy_version 117590 (0.0008) [2023-12-26 00:31:29,086][123090] Updated weights for policy 1, policy_version 117600 (0.0008) [2023-12-26 00:31:29,573][123091] Updated weights for policy 0, policy_version 118055 (0.0010) [2023-12-26 00:31:29,621][123091] Updated weights for policy 0, policy_version 118065 (0.0010) [2023-12-26 00:31:29,682][123091] Updated weights for policy 0, policy_version 118075 (0.0011) [2023-12-26 00:31:29,959][123090] Updated weights for policy 1, policy_version 117610 (0.0009) [2023-12-26 00:31:30,015][123090] Updated weights for policy 1, policy_version 117620 (0.0009) [2023-12-26 00:31:30,063][123090] Updated weights for policy 1, policy_version 117630 (0.0009) [2023-12-26 00:31:30,523][123091] Updated weights for policy 0, policy_version 118085 (0.0008) [2023-12-26 00:31:30,570][123091] Updated weights for policy 0, policy_version 118095 (0.0005) [2023-12-26 00:31:30,615][123091] Updated weights for policy 0, policy_version 118105 (0.0005) [2023-12-26 00:31:30,951][123090] Updated weights for policy 1, policy_version 117640 (0.0009) [2023-12-26 00:31:31,011][123090] Updated weights for policy 1, policy_version 117650 (0.0008) [2023-12-26 00:31:31,074][123090] Updated weights for policy 1, policy_version 117660 (0.0008) [2023-12-26 00:31:31,415][123091] Updated weights for policy 0, policy_version 118115 (0.0007) [2023-12-26 00:31:31,479][123091] Updated weights for policy 0, policy_version 118125 (0.0010) [2023-12-26 00:31:31,540][123091] Updated weights for policy 0, policy_version 118135 (0.0008) [2023-12-26 00:31:31,923][123090] Updated weights for policy 1, policy_version 117671 (0.0009) [2023-12-26 00:31:31,987][123090] Updated weights for policy 1, policy_version 117681 (0.0009) [2023-12-26 00:31:32,059][123090] Updated weights for policy 1, policy_version 117691 (0.0010) [2023-12-26 00:31:32,300][123091] Updated weights for policy 0, policy_version 118145 (0.0009) [2023-12-26 00:31:32,368][123091] Updated weights for policy 0, policy_version 118155 (0.0007) [2023-12-26 00:31:32,438][123091] Updated weights for policy 0, policy_version 118165 (0.0011) [2023-12-26 00:31:32,508][123091] Updated weights for policy 0, policy_version 118175 (0.0011) [2023-12-26 00:31:32,868][123090] Updated weights for policy 1, policy_version 117701 (0.0007) [2023-12-26 00:31:32,924][123090] Updated weights for policy 1, policy_version 117711 (0.0005) [2023-12-26 00:31:32,995][123090] Updated weights for policy 1, policy_version 117721 (0.0008) [2023-12-26 00:31:33,263][123091] Updated weights for policy 0, policy_version 118185 (0.0008) [2023-12-26 00:31:33,329][123091] Updated weights for policy 0, policy_version 118195 (0.0007) [2023-12-26 00:31:33,390][123091] Updated weights for policy 0, policy_version 118205 (0.0006) [2023-12-26 00:31:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 60399616. Throughput: 0: 8796.2, 1: 8619.3. Samples: 60414120. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:33,784][121949] Avg episode reward: [(0, '5280.020'), (1, '5722.362')] [2023-12-26 00:31:33,822][123090] Updated weights for policy 1, policy_version 117731 (0.0009) [2023-12-26 00:31:33,885][123090] Updated weights for policy 1, policy_version 117741 (0.0010) [2023-12-26 00:31:33,943][123090] Updated weights for policy 1, policy_version 117752 (0.0010) [2023-12-26 00:31:34,065][123091] Updated weights for policy 0, policy_version 118215 (0.0007) [2023-12-26 00:31:34,126][123091] Updated weights for policy 0, policy_version 118225 (0.0008) [2023-12-26 00:31:34,188][123091] Updated weights for policy 0, policy_version 118235 (0.0009) [2023-12-26 00:31:34,795][123090] Updated weights for policy 1, policy_version 117762 (0.0010) [2023-12-26 00:31:34,862][123090] Updated weights for policy 1, policy_version 117772 (0.0009) [2023-12-26 00:31:34,928][123090] Updated weights for policy 1, policy_version 117782 (0.0009) [2023-12-26 00:31:35,000][123090] Updated weights for policy 1, policy_version 117792 (0.0009) [2023-12-26 00:31:35,019][123091] Updated weights for policy 0, policy_version 118245 (0.0007) [2023-12-26 00:31:35,084][123091] Updated weights for policy 0, policy_version 118255 (0.0010) [2023-12-26 00:31:35,148][123091] Updated weights for policy 0, policy_version 118265 (0.0010) [2023-12-26 00:31:35,795][123091] Updated weights for policy 0, policy_version 118275 (0.0008) [2023-12-26 00:31:35,846][123091] Updated weights for policy 0, policy_version 118285 (0.0005) [2023-12-26 00:31:35,855][123090] Updated weights for policy 1, policy_version 117802 (0.0009) [2023-12-26 00:31:35,893][123091] Updated weights for policy 0, policy_version 118295 (0.0005) [2023-12-26 00:31:35,910][123090] Updated weights for policy 1, policy_version 117812 (0.0008) [2023-12-26 00:31:35,976][123090] Updated weights for policy 1, policy_version 117822 (0.0010) [2023-12-26 00:31:36,632][123091] Updated weights for policy 0, policy_version 118305 (0.0005) [2023-12-26 00:31:36,695][123091] Updated weights for policy 0, policy_version 118315 (0.0008) [2023-12-26 00:31:36,763][123091] Updated weights for policy 0, policy_version 118325 (0.0008) [2023-12-26 00:31:36,814][123090] Updated weights for policy 1, policy_version 117832 (0.0010) [2023-12-26 00:31:36,816][123091] Updated weights for policy 0, policy_version 118335 (0.0006) [2023-12-26 00:31:36,870][123090] Updated weights for policy 1, policy_version 117842 (0.0011) [2023-12-26 00:31:36,933][123090] Updated weights for policy 1, policy_version 117852 (0.0010) [2023-12-26 00:31:37,674][123091] Updated weights for policy 0, policy_version 118345 (0.0009) [2023-12-26 00:31:37,677][123090] Updated weights for policy 1, policy_version 117862 (0.0008) [2023-12-26 00:31:37,740][123090] Updated weights for policy 1, policy_version 117872 (0.0009) [2023-12-26 00:31:37,741][123091] Updated weights for policy 0, policy_version 118355 (0.0008) [2023-12-26 00:31:37,802][123090] Updated weights for policy 1, policy_version 117882 (0.0009) [2023-12-26 00:31:37,807][123091] Updated weights for policy 0, policy_version 118365 (0.0009) [2023-12-26 00:31:38,596][123091] Updated weights for policy 0, policy_version 118375 (0.0006) [2023-12-26 00:31:38,616][123090] Updated weights for policy 1, policy_version 117892 (0.0009) [2023-12-26 00:31:38,660][123091] Updated weights for policy 0, policy_version 118385 (0.0007) [2023-12-26 00:31:38,686][123090] Updated weights for policy 1, policy_version 117902 (0.0009) [2023-12-26 00:31:38,725][123091] Updated weights for policy 0, policy_version 118395 (0.0008) [2023-12-26 00:31:38,750][123090] Updated weights for policy 1, policy_version 117912 (0.0009) [2023-12-26 00:31:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 60489728. Throughput: 0: 8887.6, 1: 8569.0. Samples: 60467832. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:38,785][121949] Avg episode reward: [(0, '5261.863'), (1, '5660.549')] [2023-12-26 00:31:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000118400_30310400.pth... [2023-12-26 00:31:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000117344_30040064.pth [2023-12-26 00:31:38,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000117920_30187520.pth... [2023-12-26 00:31:38,808][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000116896_29925376.pth [2023-12-26 00:31:39,523][123091] Updated weights for policy 0, policy_version 118405 (0.0008) [2023-12-26 00:31:39,555][123090] Updated weights for policy 1, policy_version 117922 (0.0008) [2023-12-26 00:31:39,589][123091] Updated weights for policy 0, policy_version 118415 (0.0008) [2023-12-26 00:31:39,617][123090] Updated weights for policy 1, policy_version 117932 (0.0009) [2023-12-26 00:31:39,657][123091] Updated weights for policy 0, policy_version 118425 (0.0009) [2023-12-26 00:31:39,678][123090] Updated weights for policy 1, policy_version 117942 (0.0009) [2023-12-26 00:31:39,741][123090] Updated weights for policy 1, policy_version 117952 (0.0007) [2023-12-26 00:31:40,486][123091] Updated weights for policy 0, policy_version 118435 (0.0011) [2023-12-26 00:31:40,546][123091] Updated weights for policy 0, policy_version 118445 (0.0011) [2023-12-26 00:31:40,579][123090] Updated weights for policy 1, policy_version 117962 (0.0006) [2023-12-26 00:31:40,611][123091] Updated weights for policy 0, policy_version 118455 (0.0011) [2023-12-26 00:31:40,639][123090] Updated weights for policy 1, policy_version 117972 (0.0007) [2023-12-26 00:31:40,705][123090] Updated weights for policy 1, policy_version 117982 (0.0006) [2023-12-26 00:31:41,441][123090] Updated weights for policy 1, policy_version 117992 (0.0008) [2023-12-26 00:31:41,503][123091] Updated weights for policy 0, policy_version 118465 (0.0011) [2023-12-26 00:31:41,506][123090] Updated weights for policy 1, policy_version 118002 (0.0009) [2023-12-26 00:31:41,565][123090] Updated weights for policy 1, policy_version 118012 (0.0007) [2023-12-26 00:31:41,566][123091] Updated weights for policy 0, policy_version 118475 (0.0011) [2023-12-26 00:31:41,649][123091] Updated weights for policy 0, policy_version 118485 (0.0011) [2023-12-26 00:31:41,714][123091] Updated weights for policy 0, policy_version 118495 (0.0011) [2023-12-26 00:31:42,433][123090] Updated weights for policy 1, policy_version 118022 (0.0007) [2023-12-26 00:31:42,500][123090] Updated weights for policy 1, policy_version 118032 (0.0009) [2023-12-26 00:31:42,541][123091] Updated weights for policy 0, policy_version 118505 (0.0011) [2023-12-26 00:31:42,565][123090] Updated weights for policy 1, policy_version 118042 (0.0009) [2023-12-26 00:31:42,606][123091] Updated weights for policy 0, policy_version 118515 (0.0011) [2023-12-26 00:31:42,674][123091] Updated weights for policy 0, policy_version 118525 (0.0011) [2023-12-26 00:31:43,424][123091] Updated weights for policy 0, policy_version 118535 (0.0007) [2023-12-26 00:31:43,425][123090] Updated weights for policy 1, policy_version 118052 (0.0008) [2023-12-26 00:31:43,476][123090] Updated weights for policy 1, policy_version 118062 (0.0006) [2023-12-26 00:31:43,485][123091] Updated weights for policy 0, policy_version 118545 (0.0011) [2023-12-26 00:31:43,527][123090] Updated weights for policy 1, policy_version 118072 (0.0009) [2023-12-26 00:31:43,534][123091] Updated weights for policy 0, policy_version 118555 (0.0005) [2023-12-26 00:31:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 60579840. Throughput: 0: 8811.4, 1: 8614.5. Samples: 60570504. Policy #0 lag: (min: 31.0, avg: 36.3, max: 63.0) [2023-12-26 00:31:43,785][121949] Avg episode reward: [(0, '5211.839'), (1, '5533.021')] [2023-12-26 00:31:44,164][123091] Updated weights for policy 0, policy_version 118565 (0.0006) [2023-12-26 00:31:44,221][123091] Updated weights for policy 0, policy_version 118575 (0.0010) [2023-12-26 00:31:44,271][123091] Updated weights for policy 0, policy_version 118585 (0.0010) [2023-12-26 00:31:44,427][123090] Updated weights for policy 1, policy_version 118082 (0.0009) [2023-12-26 00:31:44,490][123090] Updated weights for policy 1, policy_version 118092 (0.0007) [2023-12-26 00:31:44,553][123090] Updated weights for policy 1, policy_version 118102 (0.0009) [2023-12-26 00:31:44,606][123090] Updated weights for policy 1, policy_version 118112 (0.0008) [2023-12-26 00:31:45,038][123091] Updated weights for policy 0, policy_version 118595 (0.0009) [2023-12-26 00:31:45,107][123091] Updated weights for policy 0, policy_version 118605 (0.0011) [2023-12-26 00:31:45,170][123091] Updated weights for policy 0, policy_version 118615 (0.0010) [2023-12-26 00:31:45,357][123090] Updated weights for policy 1, policy_version 118122 (0.0006) [2023-12-26 00:31:45,411][123090] Updated weights for policy 1, policy_version 118132 (0.0008) [2023-12-26 00:31:45,468][123090] Updated weights for policy 1, policy_version 118142 (0.0007) [2023-12-26 00:31:45,984][123091] Updated weights for policy 0, policy_version 118625 (0.0011) [2023-12-26 00:31:46,039][123091] Updated weights for policy 0, policy_version 118635 (0.0010) [2023-12-26 00:31:46,099][123091] Updated weights for policy 0, policy_version 118645 (0.0011) [2023-12-26 00:31:46,105][123090] Updated weights for policy 1, policy_version 118152 (0.0006) [2023-12-26 00:31:46,165][123091] Updated weights for policy 0, policy_version 118655 (0.0010) [2023-12-26 00:31:46,168][123090] Updated weights for policy 1, policy_version 118162 (0.0005) [2023-12-26 00:31:46,231][123090] Updated weights for policy 1, policy_version 118172 (0.0009) [2023-12-26 00:31:46,956][123091] Updated weights for policy 0, policy_version 118665 (0.0006) [2023-12-26 00:31:46,987][123090] Updated weights for policy 1, policy_version 118182 (0.0007) [2023-12-26 00:31:47,021][123091] Updated weights for policy 0, policy_version 118675 (0.0007) [2023-12-26 00:31:47,049][123090] Updated weights for policy 1, policy_version 118192 (0.0007) [2023-12-26 00:31:47,076][123091] Updated weights for policy 0, policy_version 118685 (0.0011) [2023-12-26 00:31:47,118][123090] Updated weights for policy 1, policy_version 118202 (0.0005) [2023-12-26 00:31:47,737][123091] Updated weights for policy 0, policy_version 118695 (0.0007) [2023-12-26 00:31:47,793][123091] Updated weights for policy 0, policy_version 118705 (0.0005) [2023-12-26 00:31:47,850][123091] Updated weights for policy 0, policy_version 118715 (0.0006) [2023-12-26 00:31:47,927][123090] Updated weights for policy 1, policy_version 118212 (0.0005) [2023-12-26 00:31:47,972][123090] Updated weights for policy 1, policy_version 118222 (0.0005) [2023-12-26 00:31:48,022][123090] Updated weights for policy 1, policy_version 118232 (0.0005) [2023-12-26 00:31:48,539][123091] Updated weights for policy 0, policy_version 118725 (0.0005) [2023-12-26 00:31:48,613][123091] Updated weights for policy 0, policy_version 118735 (0.0005) [2023-12-26 00:31:48,686][123091] Updated weights for policy 0, policy_version 118745 (0.0006) [2023-12-26 00:31:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 60669952. Throughput: 0: 8959.6, 1: 8726.8. Samples: 60681052. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:31:48,785][121949] Avg episode reward: [(0, '5225.078'), (1, '5606.872')] [2023-12-26 00:31:48,821][123090] Updated weights for policy 1, policy_version 118242 (0.0006) [2023-12-26 00:31:48,889][123090] Updated weights for policy 1, policy_version 118252 (0.0008) [2023-12-26 00:31:48,950][123090] Updated weights for policy 1, policy_version 118262 (0.0009) [2023-12-26 00:31:49,010][123090] Updated weights for policy 1, policy_version 118272 (0.0009) [2023-12-26 00:31:49,435][123091] Updated weights for policy 0, policy_version 118755 (0.0007) [2023-12-26 00:31:49,500][123091] Updated weights for policy 0, policy_version 118765 (0.0011) [2023-12-26 00:31:49,563][123091] Updated weights for policy 0, policy_version 118775 (0.0009) [2023-12-26 00:31:49,820][123090] Updated weights for policy 1, policy_version 118282 (0.0006) [2023-12-26 00:31:49,887][123090] Updated weights for policy 1, policy_version 118292 (0.0007) [2023-12-26 00:31:49,961][123090] Updated weights for policy 1, policy_version 118302 (0.0007) [2023-12-26 00:31:50,378][123091] Updated weights for policy 0, policy_version 118785 (0.0006) [2023-12-26 00:31:50,450][123091] Updated weights for policy 0, policy_version 118795 (0.0005) [2023-12-26 00:31:50,522][123091] Updated weights for policy 0, policy_version 118805 (0.0005) [2023-12-26 00:31:50,594][123091] Updated weights for policy 0, policy_version 118815 (0.0007) [2023-12-26 00:31:50,712][123090] Updated weights for policy 1, policy_version 118312 (0.0007) [2023-12-26 00:31:50,761][123090] Updated weights for policy 1, policy_version 118322 (0.0005) [2023-12-26 00:31:50,821][123090] Updated weights for policy 1, policy_version 118332 (0.0005) [2023-12-26 00:31:51,338][123091] Updated weights for policy 0, policy_version 118825 (0.0007) [2023-12-26 00:31:51,411][123091] Updated weights for policy 0, policy_version 118835 (0.0010) [2023-12-26 00:31:51,472][123091] Updated weights for policy 0, policy_version 118845 (0.0010) [2023-12-26 00:31:51,646][123090] Updated weights for policy 1, policy_version 118342 (0.0010) [2023-12-26 00:31:51,710][123090] Updated weights for policy 1, policy_version 118353 (0.0010) [2023-12-26 00:31:51,777][123090] Updated weights for policy 1, policy_version 118363 (0.0010) [2023-12-26 00:31:52,253][123091] Updated weights for policy 0, policy_version 118855 (0.0010) [2023-12-26 00:31:52,322][123091] Updated weights for policy 0, policy_version 118865 (0.0008) [2023-12-26 00:31:52,389][123091] Updated weights for policy 0, policy_version 118875 (0.0010) [2023-12-26 00:31:52,655][123090] Updated weights for policy 1, policy_version 118373 (0.0009) [2023-12-26 00:31:52,723][123090] Updated weights for policy 1, policy_version 118383 (0.0009) [2023-12-26 00:31:52,794][123090] Updated weights for policy 1, policy_version 118393 (0.0008) [2023-12-26 00:31:53,089][123091] Updated weights for policy 0, policy_version 118885 (0.0007) [2023-12-26 00:31:53,142][123091] Updated weights for policy 0, policy_version 118895 (0.0006) [2023-12-26 00:31:53,196][123091] Updated weights for policy 0, policy_version 118905 (0.0005) [2023-12-26 00:31:53,588][123090] Updated weights for policy 1, policy_version 118403 (0.0010) [2023-12-26 00:31:53,652][123090] Updated weights for policy 1, policy_version 118413 (0.0009) [2023-12-26 00:31:53,710][123090] Updated weights for policy 1, policy_version 118423 (0.0009) [2023-12-26 00:31:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 60760064. Throughput: 0: 8970.6, 1: 8712.2. Samples: 60733992. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:31:53,785][121949] Avg episode reward: [(0, '5222.532'), (1, '5636.098')] [2023-12-26 00:31:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000118912_30441472.pth... [2023-12-26 00:31:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000118432_30318592.pth... [2023-12-26 00:31:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000117856_30171136.pth [2023-12-26 00:31:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000117408_30056448.pth [2023-12-26 00:31:53,935][123091] Updated weights for policy 0, policy_version 118915 (0.0007) [2023-12-26 00:31:53,986][123091] Updated weights for policy 0, policy_version 118925 (0.0009) [2023-12-26 00:31:54,035][123091] Updated weights for policy 0, policy_version 118935 (0.0009) [2023-12-26 00:31:54,581][123090] Updated weights for policy 1, policy_version 118433 (0.0010) [2023-12-26 00:31:54,635][123090] Updated weights for policy 1, policy_version 118443 (0.0010) [2023-12-26 00:31:54,688][123090] Updated weights for policy 1, policy_version 118453 (0.0009) [2023-12-26 00:31:54,749][123090] Updated weights for policy 1, policy_version 118463 (0.0008) [2023-12-26 00:31:54,874][123091] Updated weights for policy 0, policy_version 118945 (0.0009) [2023-12-26 00:31:54,930][123091] Updated weights for policy 0, policy_version 118955 (0.0010) [2023-12-26 00:31:54,981][123091] Updated weights for policy 0, policy_version 118965 (0.0010) [2023-12-26 00:31:55,033][123091] Updated weights for policy 0, policy_version 118975 (0.0011) [2023-12-26 00:31:55,503][123090] Updated weights for policy 1, policy_version 118473 (0.0006) [2023-12-26 00:31:55,552][123090] Updated weights for policy 1, policy_version 118483 (0.0005) [2023-12-26 00:31:55,603][123090] Updated weights for policy 1, policy_version 118493 (0.0005) [2023-12-26 00:31:55,866][123091] Updated weights for policy 0, policy_version 118985 (0.0008) [2023-12-26 00:31:55,914][123091] Updated weights for policy 0, policy_version 118995 (0.0005) [2023-12-26 00:31:55,962][123091] Updated weights for policy 0, policy_version 119005 (0.0005) [2023-12-26 00:31:56,299][123090] Updated weights for policy 1, policy_version 118503 (0.0005) [2023-12-26 00:31:56,347][123090] Updated weights for policy 1, policy_version 118513 (0.0005) [2023-12-26 00:31:56,403][123090] Updated weights for policy 1, policy_version 118523 (0.0005) [2023-12-26 00:31:56,758][123091] Updated weights for policy 0, policy_version 119015 (0.0009) [2023-12-26 00:31:56,811][123091] Updated weights for policy 0, policy_version 119025 (0.0010) [2023-12-26 00:31:56,861][123091] Updated weights for policy 0, policy_version 119035 (0.0010) [2023-12-26 00:31:57,044][123090] Updated weights for policy 1, policy_version 118533 (0.0005) [2023-12-26 00:31:57,101][123090] Updated weights for policy 1, policy_version 118543 (0.0006) [2023-12-26 00:31:57,172][123090] Updated weights for policy 1, policy_version 118553 (0.0005) [2023-12-26 00:31:57,617][123091] Updated weights for policy 0, policy_version 119045 (0.0008) [2023-12-26 00:31:57,663][123091] Updated weights for policy 0, policy_version 119055 (0.0005) [2023-12-26 00:31:57,717][123091] Updated weights for policy 0, policy_version 119065 (0.0006) [2023-12-26 00:31:57,925][123090] Updated weights for policy 1, policy_version 118563 (0.0007) [2023-12-26 00:31:57,985][123090] Updated weights for policy 1, policy_version 118573 (0.0009) [2023-12-26 00:31:58,054][123090] Updated weights for policy 1, policy_version 118583 (0.0007) [2023-12-26 00:31:58,434][123091] Updated weights for policy 0, policy_version 119075 (0.0007) [2023-12-26 00:31:58,506][123091] Updated weights for policy 0, policy_version 119085 (0.0011) [2023-12-26 00:31:58,571][123091] Updated weights for policy 0, policy_version 119095 (0.0011) [2023-12-26 00:31:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 60850176. Throughput: 0: 9096.7, 1: 8760.2. Samples: 60844280. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:31:58,785][121949] Avg episode reward: [(0, '5242.914'), (1, '5546.987')] [2023-12-26 00:31:58,920][123090] Updated weights for policy 1, policy_version 118593 (0.0008) [2023-12-26 00:31:58,988][123090] Updated weights for policy 1, policy_version 118603 (0.0008) [2023-12-26 00:31:59,067][123090] Updated weights for policy 1, policy_version 118613 (0.0008) [2023-12-26 00:31:59,131][123090] Updated weights for policy 1, policy_version 118623 (0.0008) [2023-12-26 00:31:59,398][123091] Updated weights for policy 0, policy_version 119105 (0.0011) [2023-12-26 00:31:59,457][123091] Updated weights for policy 0, policy_version 119115 (0.0010) [2023-12-26 00:31:59,516][123091] Updated weights for policy 0, policy_version 119125 (0.0009) [2023-12-26 00:31:59,579][123091] Updated weights for policy 0, policy_version 119135 (0.0009) [2023-12-26 00:31:59,934][123090] Updated weights for policy 1, policy_version 118633 (0.0009) [2023-12-26 00:32:00,001][123090] Updated weights for policy 1, policy_version 118643 (0.0010) [2023-12-26 00:32:00,061][123090] Updated weights for policy 1, policy_version 118653 (0.0009) [2023-12-26 00:32:00,414][123091] Updated weights for policy 0, policy_version 119145 (0.0010) [2023-12-26 00:32:00,481][123091] Updated weights for policy 0, policy_version 119155 (0.0010) [2023-12-26 00:32:00,553][123091] Updated weights for policy 0, policy_version 119165 (0.0010) [2023-12-26 00:32:00,869][123090] Updated weights for policy 1, policy_version 118663 (0.0006) [2023-12-26 00:32:00,934][123090] Updated weights for policy 1, policy_version 118673 (0.0005) [2023-12-26 00:32:01,001][123090] Updated weights for policy 1, policy_version 118683 (0.0005) [2023-12-26 00:32:01,235][123091] Updated weights for policy 0, policy_version 119175 (0.0009) [2023-12-26 00:32:01,302][123091] Updated weights for policy 0, policy_version 119185 (0.0011) [2023-12-26 00:32:01,371][123091] Updated weights for policy 0, policy_version 119195 (0.0009) [2023-12-26 00:32:01,791][123090] Updated weights for policy 1, policy_version 118693 (0.0007) [2023-12-26 00:32:01,855][123090] Updated weights for policy 1, policy_version 118703 (0.0005) [2023-12-26 00:32:01,925][123090] Updated weights for policy 1, policy_version 118713 (0.0005) [2023-12-26 00:32:02,166][123091] Updated weights for policy 0, policy_version 119205 (0.0008) [2023-12-26 00:32:02,229][123091] Updated weights for policy 0, policy_version 119215 (0.0011) [2023-12-26 00:32:02,289][123091] Updated weights for policy 0, policy_version 119225 (0.0011) [2023-12-26 00:32:02,685][123090] Updated weights for policy 1, policy_version 118723 (0.0007) [2023-12-26 00:32:02,737][123090] Updated weights for policy 1, policy_version 118733 (0.0008) [2023-12-26 00:32:02,798][123090] Updated weights for policy 1, policy_version 118743 (0.0008) [2023-12-26 00:32:03,088][123091] Updated weights for policy 0, policy_version 119235 (0.0011) [2023-12-26 00:32:03,147][123091] Updated weights for policy 0, policy_version 119245 (0.0010) [2023-12-26 00:32:03,209][123091] Updated weights for policy 0, policy_version 119255 (0.0011) [2023-12-26 00:32:03,643][123090] Updated weights for policy 1, policy_version 118753 (0.0009) [2023-12-26 00:32:03,696][123090] Updated weights for policy 1, policy_version 118763 (0.0010) [2023-12-26 00:32:03,749][123090] Updated weights for policy 1, policy_version 118773 (0.0009) [2023-12-26 00:32:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 60932096. Throughput: 0: 8982.3, 1: 8730.1. Samples: 60950548. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:03,784][121949] Avg episode reward: [(0, '5228.841'), (1, '5606.094')] [2023-12-26 00:32:03,802][123090] Updated weights for policy 1, policy_version 118784 (0.0010) [2023-12-26 00:32:03,831][123091] Updated weights for policy 0, policy_version 119265 (0.0009) [2023-12-26 00:32:03,902][123091] Updated weights for policy 0, policy_version 119275 (0.0011) [2023-12-26 00:32:03,957][123091] Updated weights for policy 0, policy_version 119285 (0.0010) [2023-12-26 00:32:04,027][123091] Updated weights for policy 0, policy_version 119295 (0.0011) [2023-12-26 00:32:04,684][123090] Updated weights for policy 1, policy_version 118794 (0.0010) [2023-12-26 00:32:04,735][123090] Updated weights for policy 1, policy_version 118804 (0.0010) [2023-12-26 00:32:04,791][123090] Updated weights for policy 1, policy_version 118814 (0.0010) [2023-12-26 00:32:04,830][123091] Updated weights for policy 0, policy_version 119305 (0.0008) [2023-12-26 00:32:04,902][123091] Updated weights for policy 0, policy_version 119315 (0.0009) [2023-12-26 00:32:04,962][123091] Updated weights for policy 0, policy_version 119325 (0.0009) [2023-12-26 00:32:05,623][123090] Updated weights for policy 1, policy_version 118824 (0.0010) [2023-12-26 00:32:05,673][123090] Updated weights for policy 1, policy_version 118834 (0.0010) [2023-12-26 00:32:05,712][123091] Updated weights for policy 0, policy_version 119335 (0.0007) [2023-12-26 00:32:05,724][123090] Updated weights for policy 1, policy_version 118844 (0.0010) [2023-12-26 00:32:05,786][123091] Updated weights for policy 0, policy_version 119345 (0.0006) [2023-12-26 00:32:05,847][123091] Updated weights for policy 0, policy_version 119355 (0.0005) [2023-12-26 00:32:06,540][123091] Updated weights for policy 0, policy_version 119365 (0.0008) [2023-12-26 00:32:06,553][123090] Updated weights for policy 1, policy_version 118854 (0.0009) [2023-12-26 00:32:06,601][123091] Updated weights for policy 0, policy_version 119375 (0.0011) [2023-12-26 00:32:06,618][123090] Updated weights for policy 1, policy_version 118864 (0.0008) [2023-12-26 00:32:06,669][123091] Updated weights for policy 0, policy_version 119385 (0.0011) [2023-12-26 00:32:06,686][123090] Updated weights for policy 1, policy_version 118874 (0.0008) [2023-12-26 00:32:07,295][123090] Updated weights for policy 1, policy_version 118884 (0.0007) [2023-12-26 00:32:07,363][123090] Updated weights for policy 1, policy_version 118894 (0.0011) [2023-12-26 00:32:07,430][123090] Updated weights for policy 1, policy_version 118904 (0.0010) [2023-12-26 00:32:07,461][123091] Updated weights for policy 0, policy_version 119395 (0.0010) [2023-12-26 00:32:07,520][123091] Updated weights for policy 0, policy_version 119405 (0.0009) [2023-12-26 00:32:07,574][123091] Updated weights for policy 0, policy_version 119415 (0.0008) [2023-12-26 00:32:08,127][123090] Updated weights for policy 1, policy_version 118914 (0.0010) [2023-12-26 00:32:08,174][123090] Updated weights for policy 1, policy_version 118924 (0.0005) [2023-12-26 00:32:08,218][123090] Updated weights for policy 1, policy_version 118934 (0.0005) [2023-12-26 00:32:08,268][123090] Updated weights for policy 1, policy_version 118944 (0.0005) [2023-12-26 00:32:08,343][123091] Updated weights for policy 0, policy_version 119425 (0.0006) [2023-12-26 00:32:08,412][123091] Updated weights for policy 0, policy_version 119435 (0.0009) [2023-12-26 00:32:08,471][123091] Updated weights for policy 0, policy_version 119445 (0.0006) [2023-12-26 00:32:08,537][123091] Updated weights for policy 0, policy_version 119455 (0.0005) [2023-12-26 00:32:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 61030400. Throughput: 0: 9054.7, 1: 8698.9. Samples: 61003704. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:08,785][121949] Avg episode reward: [(0, '5160.988'), (1, '5745.896')] [2023-12-26 00:32:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000119456_30580736.pth... [2023-12-26 00:32:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000118944_30449664.pth... [2023-12-26 00:32:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000118400_30310400.pth [2023-12-26 00:32:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000117920_30187520.pth [2023-12-26 00:32:09,029][123090] Updated weights for policy 1, policy_version 118954 (0.0010) [2023-12-26 00:32:09,089][123090] Updated weights for policy 1, policy_version 118964 (0.0010) [2023-12-26 00:32:09,141][123090] Updated weights for policy 1, policy_version 118974 (0.0010) [2023-12-26 00:32:09,366][123091] Updated weights for policy 0, policy_version 119465 (0.0009) [2023-12-26 00:32:09,438][123091] Updated weights for policy 0, policy_version 119475 (0.0009) [2023-12-26 00:32:09,498][123091] Updated weights for policy 0, policy_version 119485 (0.0008) [2023-12-26 00:32:09,969][123090] Updated weights for policy 1, policy_version 118984 (0.0010) [2023-12-26 00:32:10,039][123090] Updated weights for policy 1, policy_version 118994 (0.0009) [2023-12-26 00:32:10,099][123090] Updated weights for policy 1, policy_version 119004 (0.0010) [2023-12-26 00:32:10,290][123091] Updated weights for policy 0, policy_version 119495 (0.0006) [2023-12-26 00:32:10,354][123091] Updated weights for policy 0, policy_version 119505 (0.0006) [2023-12-26 00:32:10,424][123091] Updated weights for policy 0, policy_version 119515 (0.0005) [2023-12-26 00:32:10,924][123090] Updated weights for policy 1, policy_version 119014 (0.0007) [2023-12-26 00:32:10,990][123090] Updated weights for policy 1, policy_version 119024 (0.0005) [2023-12-26 00:32:11,063][123090] Updated weights for policy 1, policy_version 119034 (0.0007) [2023-12-26 00:32:11,064][123091] Updated weights for policy 0, policy_version 119525 (0.0007) [2023-12-26 00:32:11,152][123091] Updated weights for policy 0, policy_version 119535 (0.0009) [2023-12-26 00:32:11,214][123091] Updated weights for policy 0, policy_version 119545 (0.0010) [2023-12-26 00:32:11,885][123090] Updated weights for policy 1, policy_version 119044 (0.0008) [2023-12-26 00:32:11,941][123090] Updated weights for policy 1, policy_version 119054 (0.0009) [2023-12-26 00:32:12,004][123090] Updated weights for policy 1, policy_version 119064 (0.0010) [2023-12-26 00:32:12,075][123091] Updated weights for policy 0, policy_version 119555 (0.0008) [2023-12-26 00:32:12,128][123091] Updated weights for policy 0, policy_version 119565 (0.0009) [2023-12-26 00:32:12,180][123091] Updated weights for policy 0, policy_version 119576 (0.0010) [2023-12-26 00:32:12,863][123090] Updated weights for policy 1, policy_version 119074 (0.0010) [2023-12-26 00:32:12,917][123091] Updated weights for policy 0, policy_version 119586 (0.0006) [2023-12-26 00:32:12,932][123090] Updated weights for policy 1, policy_version 119084 (0.0011) [2023-12-26 00:32:12,978][123091] Updated weights for policy 0, policy_version 119596 (0.0006) [2023-12-26 00:32:12,992][123090] Updated weights for policy 1, policy_version 119094 (0.0010) [2023-12-26 00:32:13,042][123091] Updated weights for policy 0, policy_version 119606 (0.0006) [2023-12-26 00:32:13,060][123090] Updated weights for policy 1, policy_version 119104 (0.0011) [2023-12-26 00:32:13,110][123091] Updated weights for policy 0, policy_version 119616 (0.0006) [2023-12-26 00:32:13,776][123091] Updated weights for policy 0, policy_version 119626 (0.0006) [2023-12-26 00:32:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 61112320. Throughput: 0: 9058.1, 1: 8751.5. Samples: 61110384. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:13,785][121949] Avg episode reward: [(0, '5209.773'), (1, '5761.672')] [2023-12-26 00:32:13,833][123091] Updated weights for policy 0, policy_version 119636 (0.0006) [2023-12-26 00:32:13,853][123090] Updated weights for policy 1, policy_version 119114 (0.0005) [2023-12-26 00:32:13,900][123091] Updated weights for policy 0, policy_version 119646 (0.0009) [2023-12-26 00:32:13,901][123090] Updated weights for policy 1, policy_version 119124 (0.0005) [2023-12-26 00:32:13,964][123090] Updated weights for policy 1, policy_version 119134 (0.0005) [2023-12-26 00:32:14,623][123090] Updated weights for policy 1, policy_version 119144 (0.0005) [2023-12-26 00:32:14,663][123091] Updated weights for policy 0, policy_version 119656 (0.0006) [2023-12-26 00:32:14,685][123090] Updated weights for policy 1, policy_version 119154 (0.0006) [2023-12-26 00:32:14,735][123091] Updated weights for policy 0, policy_version 119666 (0.0006) [2023-12-26 00:32:14,747][123090] Updated weights for policy 1, policy_version 119164 (0.0010) [2023-12-26 00:32:14,805][123091] Updated weights for policy 0, policy_version 119676 (0.0008) [2023-12-26 00:32:15,493][123090] Updated weights for policy 1, policy_version 119174 (0.0009) [2023-12-26 00:32:15,538][123091] Updated weights for policy 0, policy_version 119686 (0.0006) [2023-12-26 00:32:15,572][123090] Updated weights for policy 1, policy_version 119184 (0.0009) [2023-12-26 00:32:15,616][123091] Updated weights for policy 0, policy_version 119696 (0.0006) [2023-12-26 00:32:15,647][123090] Updated weights for policy 1, policy_version 119194 (0.0009) [2023-12-26 00:32:15,689][123091] Updated weights for policy 0, policy_version 119706 (0.0005) [2023-12-26 00:32:16,376][123091] Updated weights for policy 0, policy_version 119716 (0.0007) [2023-12-26 00:32:16,427][123091] Updated weights for policy 0, policy_version 119726 (0.0010) [2023-12-26 00:32:16,430][123090] Updated weights for policy 1, policy_version 119204 (0.0006) [2023-12-26 00:32:16,475][123091] Updated weights for policy 0, policy_version 119736 (0.0009) [2023-12-26 00:32:16,490][123090] Updated weights for policy 1, policy_version 119214 (0.0008) [2023-12-26 00:32:16,540][123090] Updated weights for policy 1, policy_version 119224 (0.0007) [2023-12-26 00:32:17,219][123090] Updated weights for policy 1, policy_version 119234 (0.0008) [2023-12-26 00:32:17,271][123090] Updated weights for policy 1, policy_version 119244 (0.0009) [2023-12-26 00:32:17,333][123090] Updated weights for policy 1, policy_version 119254 (0.0010) [2023-12-26 00:32:17,348][123091] Updated weights for policy 0, policy_version 119746 (0.0008) [2023-12-26 00:32:17,397][123090] Updated weights for policy 1, policy_version 119264 (0.0008) [2023-12-26 00:32:17,416][123091] Updated weights for policy 0, policy_version 119756 (0.0010) [2023-12-26 00:32:17,472][123091] Updated weights for policy 0, policy_version 119766 (0.0009) [2023-12-26 00:32:17,529][123091] Updated weights for policy 0, policy_version 119776 (0.0008) [2023-12-26 00:32:18,223][123090] Updated weights for policy 1, policy_version 119274 (0.0008) [2023-12-26 00:32:18,286][123090] Updated weights for policy 1, policy_version 119284 (0.0005) [2023-12-26 00:32:18,350][123090] Updated weights for policy 1, policy_version 119294 (0.0006) [2023-12-26 00:32:18,368][123091] Updated weights for policy 0, policy_version 119786 (0.0009) [2023-12-26 00:32:18,424][123091] Updated weights for policy 0, policy_version 119796 (0.0008) [2023-12-26 00:32:18,479][123091] Updated weights for policy 0, policy_version 119806 (0.0008) [2023-12-26 00:32:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 61210624. Throughput: 0: 9066.8, 1: 8860.4. Samples: 61220844. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:18,785][121949] Avg episode reward: [(0, '5245.440'), (1, '5711.029')] [2023-12-26 00:32:19,183][123090] Updated weights for policy 1, policy_version 119304 (0.0007) [2023-12-26 00:32:19,195][123091] Updated weights for policy 0, policy_version 119816 (0.0006) [2023-12-26 00:32:19,254][123090] Updated weights for policy 1, policy_version 119314 (0.0007) [2023-12-26 00:32:19,260][123091] Updated weights for policy 0, policy_version 119826 (0.0009) [2023-12-26 00:32:19,319][123091] Updated weights for policy 0, policy_version 119836 (0.0009) [2023-12-26 00:32:19,322][123090] Updated weights for policy 1, policy_version 119324 (0.0007) [2023-12-26 00:32:20,107][123091] Updated weights for policy 0, policy_version 119846 (0.0008) [2023-12-26 00:32:20,109][123090] Updated weights for policy 1, policy_version 119334 (0.0009) [2023-12-26 00:32:20,170][123091] Updated weights for policy 0, policy_version 119856 (0.0009) [2023-12-26 00:32:20,172][123090] Updated weights for policy 1, policy_version 119344 (0.0007) [2023-12-26 00:32:20,237][123091] Updated weights for policy 0, policy_version 119866 (0.0008) [2023-12-26 00:32:20,237][123090] Updated weights for policy 1, policy_version 119354 (0.0009) [2023-12-26 00:32:21,069][123091] Updated weights for policy 0, policy_version 119876 (0.0009) [2023-12-26 00:32:21,090][123090] Updated weights for policy 1, policy_version 119364 (0.0009) [2023-12-26 00:32:21,131][123091] Updated weights for policy 0, policy_version 119886 (0.0008) [2023-12-26 00:32:21,156][123090] Updated weights for policy 1, policy_version 119374 (0.0009) [2023-12-26 00:32:21,197][123091] Updated weights for policy 0, policy_version 119896 (0.0008) [2023-12-26 00:32:21,227][123090] Updated weights for policy 1, policy_version 119384 (0.0009) [2023-12-26 00:32:21,927][123091] Updated weights for policy 0, policy_version 119906 (0.0009) [2023-12-26 00:32:21,987][123091] Updated weights for policy 0, policy_version 119916 (0.0006) [2023-12-26 00:32:22,040][123091] Updated weights for policy 0, policy_version 119926 (0.0005) [2023-12-26 00:32:22,087][123091] Updated weights for policy 0, policy_version 119936 (0.0005) [2023-12-26 00:32:22,179][123090] Updated weights for policy 1, policy_version 119394 (0.0009) [2023-12-26 00:32:22,247][123090] Updated weights for policy 1, policy_version 119404 (0.0009) [2023-12-26 00:32:22,322][123090] Updated weights for policy 1, policy_version 119414 (0.0010) [2023-12-26 00:32:22,396][123090] Updated weights for policy 1, policy_version 119424 (0.0009) [2023-12-26 00:32:22,814][123091] Updated weights for policy 0, policy_version 119946 (0.0005) [2023-12-26 00:32:22,891][123091] Updated weights for policy 0, policy_version 119956 (0.0006) [2023-12-26 00:32:22,959][123091] Updated weights for policy 0, policy_version 119966 (0.0006) [2023-12-26 00:32:23,270][123090] Updated weights for policy 1, policy_version 119434 (0.0009) [2023-12-26 00:32:23,317][123090] Updated weights for policy 1, policy_version 119444 (0.0008) [2023-12-26 00:32:23,365][123090] Updated weights for policy 1, policy_version 119454 (0.0008) [2023-12-26 00:32:23,704][123091] Updated weights for policy 0, policy_version 119976 (0.0009) [2023-12-26 00:32:23,763][123091] Updated weights for policy 0, policy_version 119986 (0.0009) [2023-12-26 00:32:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 61292544. Throughput: 0: 9014.8, 1: 8864.2. Samples: 61272384. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:23,785][121949] Avg episode reward: [(0, '5218.973'), (1, '5714.353')] [2023-12-26 00:32:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000119456_30580736.pth... [2023-12-26 00:32:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000118432_30318592.pth [2023-12-26 00:32:23,833][123091] Updated weights for policy 0, policy_version 119996 (0.0009) [2023-12-26 00:32:23,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000120000_30720000.pth... [2023-12-26 00:32:23,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000118912_30441472.pth [2023-12-26 00:32:24,216][123090] Updated weights for policy 1, policy_version 119464 (0.0008) [2023-12-26 00:32:24,281][123090] Updated weights for policy 1, policy_version 119474 (0.0010) [2023-12-26 00:32:24,333][123090] Updated weights for policy 1, policy_version 119484 (0.0010) [2023-12-26 00:32:24,728][123091] Updated weights for policy 0, policy_version 120006 (0.0009) [2023-12-26 00:32:24,785][123091] Updated weights for policy 0, policy_version 120016 (0.0009) [2023-12-26 00:32:24,834][123091] Updated weights for policy 0, policy_version 120026 (0.0009) [2023-12-26 00:32:25,104][123090] Updated weights for policy 1, policy_version 119494 (0.0007) [2023-12-26 00:32:25,156][123090] Updated weights for policy 1, policy_version 119504 (0.0005) [2023-12-26 00:32:25,211][123090] Updated weights for policy 1, policy_version 119514 (0.0005) [2023-12-26 00:32:25,702][123091] Updated weights for policy 0, policy_version 120036 (0.0008) [2023-12-26 00:32:25,748][123091] Updated weights for policy 0, policy_version 120046 (0.0005) [2023-12-26 00:32:25,802][123091] Updated weights for policy 0, policy_version 120056 (0.0005) [2023-12-26 00:32:25,989][123090] Updated weights for policy 1, policy_version 119524 (0.0008) [2023-12-26 00:32:26,040][123090] Updated weights for policy 1, policy_version 119534 (0.0006) [2023-12-26 00:32:26,095][123090] Updated weights for policy 1, policy_version 119544 (0.0005) [2023-12-26 00:32:26,471][123091] Updated weights for policy 0, policy_version 120066 (0.0005) [2023-12-26 00:32:26,539][123091] Updated weights for policy 0, policy_version 120076 (0.0006) [2023-12-26 00:32:26,607][123091] Updated weights for policy 0, policy_version 120086 (0.0005) [2023-12-26 00:32:26,670][123091] Updated weights for policy 0, policy_version 120096 (0.0005) [2023-12-26 00:32:26,786][123090] Updated weights for policy 1, policy_version 119554 (0.0007) [2023-12-26 00:32:26,849][123090] Updated weights for policy 1, policy_version 119564 (0.0006) [2023-12-26 00:32:26,919][123090] Updated weights for policy 1, policy_version 119574 (0.0005) [2023-12-26 00:32:26,989][123090] Updated weights for policy 1, policy_version 119584 (0.0006) [2023-12-26 00:32:27,361][123091] Updated weights for policy 0, policy_version 120106 (0.0010) [2023-12-26 00:32:27,417][123091] Updated weights for policy 0, policy_version 120116 (0.0009) [2023-12-26 00:32:27,465][123091] Updated weights for policy 0, policy_version 120127 (0.0009) [2023-12-26 00:32:27,637][123090] Updated weights for policy 1, policy_version 119595 (0.0009) [2023-12-26 00:32:27,686][123090] Updated weights for policy 1, policy_version 119605 (0.0009) [2023-12-26 00:32:27,738][123090] Updated weights for policy 1, policy_version 119615 (0.0009) [2023-12-26 00:32:28,297][123091] Updated weights for policy 0, policy_version 120137 (0.0010) [2023-12-26 00:32:28,364][123091] Updated weights for policy 0, policy_version 120147 (0.0010) [2023-12-26 00:32:28,424][123091] Updated weights for policy 0, policy_version 120157 (0.0011) [2023-12-26 00:32:28,544][123090] Updated weights for policy 1, policy_version 119625 (0.0010) [2023-12-26 00:32:28,595][123090] Updated weights for policy 1, policy_version 119635 (0.0010) [2023-12-26 00:32:28,646][123090] Updated weights for policy 1, policy_version 119645 (0.0010) [2023-12-26 00:32:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 61390848. Throughput: 0: 9112.4, 1: 8894.8. Samples: 61380832. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:28,785][121949] Avg episode reward: [(0, '5172.248'), (1, '5616.542')] [2023-12-26 00:32:29,281][123091] Updated weights for policy 0, policy_version 120167 (0.0008) [2023-12-26 00:32:29,339][123091] Updated weights for policy 0, policy_version 120177 (0.0005) [2023-12-26 00:32:29,409][123091] Updated weights for policy 0, policy_version 120187 (0.0007) [2023-12-26 00:32:29,451][123090] Updated weights for policy 1, policy_version 119655 (0.0010) [2023-12-26 00:32:29,517][123090] Updated weights for policy 1, policy_version 119665 (0.0010) [2023-12-26 00:32:29,564][123090] Updated weights for policy 1, policy_version 119675 (0.0010) [2023-12-26 00:32:30,078][123091] Updated weights for policy 0, policy_version 120197 (0.0005) [2023-12-26 00:32:30,125][123091] Updated weights for policy 0, policy_version 120207 (0.0005) [2023-12-26 00:32:30,194][123091] Updated weights for policy 0, policy_version 120217 (0.0005) [2023-12-26 00:32:30,410][123090] Updated weights for policy 1, policy_version 119685 (0.0010) [2023-12-26 00:32:30,463][123090] Updated weights for policy 1, policy_version 119695 (0.0009) [2023-12-26 00:32:30,526][123090] Updated weights for policy 1, policy_version 119705 (0.0010) [2023-12-26 00:32:30,788][123091] Updated weights for policy 0, policy_version 120227 (0.0005) [2023-12-26 00:32:30,842][123091] Updated weights for policy 0, policy_version 120237 (0.0005) [2023-12-26 00:32:30,892][123091] Updated weights for policy 0, policy_version 120247 (0.0005) [2023-12-26 00:32:31,436][123090] Updated weights for policy 1, policy_version 119715 (0.0010) [2023-12-26 00:32:31,484][123090] Updated weights for policy 1, policy_version 119725 (0.0008) [2023-12-26 00:32:31,532][123090] Updated weights for policy 1, policy_version 119735 (0.0008) [2023-12-26 00:32:31,687][123091] Updated weights for policy 0, policy_version 120257 (0.0006) [2023-12-26 00:32:31,752][123091] Updated weights for policy 0, policy_version 120267 (0.0010) [2023-12-26 00:32:31,800][123091] Updated weights for policy 0, policy_version 120277 (0.0010) [2023-12-26 00:32:31,844][123091] Updated weights for policy 0, policy_version 120287 (0.0010) [2023-12-26 00:32:32,414][123090] Updated weights for policy 1, policy_version 119745 (0.0008) [2023-12-26 00:32:32,482][123090] Updated weights for policy 1, policy_version 119755 (0.0008) [2023-12-26 00:32:32,545][123090] Updated weights for policy 1, policy_version 119765 (0.0009) [2023-12-26 00:32:32,603][123090] Updated weights for policy 1, policy_version 119775 (0.0008) [2023-12-26 00:32:32,695][123091] Updated weights for policy 0, policy_version 120297 (0.0010) [2023-12-26 00:32:32,754][123091] Updated weights for policy 0, policy_version 120307 (0.0010) [2023-12-26 00:32:32,816][123091] Updated weights for policy 0, policy_version 120317 (0.0010) [2023-12-26 00:32:33,266][123090] Updated weights for policy 1, policy_version 119785 (0.0005) [2023-12-26 00:32:33,343][123090] Updated weights for policy 1, policy_version 119795 (0.0006) [2023-12-26 00:32:33,419][123090] Updated weights for policy 1, policy_version 119805 (0.0005) [2023-12-26 00:32:33,639][123091] Updated weights for policy 0, policy_version 120327 (0.0010) [2023-12-26 00:32:33,699][123091] Updated weights for policy 0, policy_version 120337 (0.0010) [2023-12-26 00:32:33,769][123091] Updated weights for policy 0, policy_version 120347 (0.0005) [2023-12-26 00:32:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 61472768. Throughput: 0: 9070.5, 1: 8855.5. Samples: 61487728. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:33,785][121949] Avg episode reward: [(0, '5158.125'), (1, '5594.933')] [2023-12-26 00:32:34,072][123090] Updated weights for policy 1, policy_version 119815 (0.0006) [2023-12-26 00:32:34,135][123090] Updated weights for policy 1, policy_version 119825 (0.0006) [2023-12-26 00:32:34,204][123090] Updated weights for policy 1, policy_version 119835 (0.0009) [2023-12-26 00:32:34,441][123091] Updated weights for policy 0, policy_version 120357 (0.0006) [2023-12-26 00:32:34,508][123091] Updated weights for policy 0, policy_version 120367 (0.0011) [2023-12-26 00:32:34,576][123091] Updated weights for policy 0, policy_version 120377 (0.0006) [2023-12-26 00:32:35,013][123090] Updated weights for policy 1, policy_version 119845 (0.0010) [2023-12-26 00:32:35,066][123090] Updated weights for policy 1, policy_version 119855 (0.0009) [2023-12-26 00:32:35,115][123090] Updated weights for policy 1, policy_version 119865 (0.0009) [2023-12-26 00:32:35,330][123091] Updated weights for policy 0, policy_version 120387 (0.0008) [2023-12-26 00:32:35,380][123091] Updated weights for policy 0, policy_version 120397 (0.0005) [2023-12-26 00:32:35,428][123091] Updated weights for policy 0, policy_version 120407 (0.0007) [2023-12-26 00:32:35,996][123090] Updated weights for policy 1, policy_version 119875 (0.0010) [2023-12-26 00:32:36,040][123090] Updated weights for policy 1, policy_version 119885 (0.0010) [2023-12-26 00:32:36,094][123090] Updated weights for policy 1, policy_version 119895 (0.0010) [2023-12-26 00:32:36,245][123091] Updated weights for policy 0, policy_version 120417 (0.0009) [2023-12-26 00:32:36,312][123091] Updated weights for policy 0, policy_version 120427 (0.0009) [2023-12-26 00:32:36,379][123091] Updated weights for policy 0, policy_version 120437 (0.0009) [2023-12-26 00:32:36,443][123091] Updated weights for policy 0, policy_version 120447 (0.0009) [2023-12-26 00:32:36,955][123090] Updated weights for policy 1, policy_version 119905 (0.0010) [2023-12-26 00:32:37,021][123090] Updated weights for policy 1, policy_version 119915 (0.0009) [2023-12-26 00:32:37,076][123090] Updated weights for policy 1, policy_version 119925 (0.0008) [2023-12-26 00:32:37,132][123090] Updated weights for policy 1, policy_version 119935 (0.0005) [2023-12-26 00:32:37,260][123091] Updated weights for policy 0, policy_version 120457 (0.0009) [2023-12-26 00:32:37,318][123091] Updated weights for policy 0, policy_version 120467 (0.0006) [2023-12-26 00:32:37,366][123091] Updated weights for policy 0, policy_version 120477 (0.0005) [2023-12-26 00:32:38,019][123090] Updated weights for policy 1, policy_version 119945 (0.0008) [2023-12-26 00:32:38,071][123090] Updated weights for policy 1, policy_version 119955 (0.0006) [2023-12-26 00:32:38,118][123091] Updated weights for policy 0, policy_version 120487 (0.0008) [2023-12-26 00:32:38,126][123090] Updated weights for policy 1, policy_version 119965 (0.0006) [2023-12-26 00:32:38,175][123091] Updated weights for policy 0, policy_version 120497 (0.0006) [2023-12-26 00:32:38,231][123091] Updated weights for policy 0, policy_version 120507 (0.0005) [2023-12-26 00:32:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 61562880. Throughput: 0: 9094.1, 1: 8843.0. Samples: 61541164. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:38,785][121949] Avg episode reward: [(0, '5197.822'), (1, '5479.317')] [2023-12-26 00:32:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000119968_30711808.pth... [2023-12-26 00:32:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000120512_30851072.pth... [2023-12-26 00:32:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000118944_30449664.pth [2023-12-26 00:32:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000119456_30580736.pth [2023-12-26 00:32:38,963][123091] Updated weights for policy 0, policy_version 120517 (0.0007) [2023-12-26 00:32:38,992][123090] Updated weights for policy 1, policy_version 119975 (0.0010) [2023-12-26 00:32:39,030][123091] Updated weights for policy 0, policy_version 120527 (0.0008) [2023-12-26 00:32:39,061][123090] Updated weights for policy 1, policy_version 119985 (0.0009) [2023-12-26 00:32:39,089][123091] Updated weights for policy 0, policy_version 120537 (0.0009) [2023-12-26 00:32:39,131][123090] Updated weights for policy 1, policy_version 119995 (0.0006) [2023-12-26 00:32:39,846][123090] Updated weights for policy 1, policy_version 120005 (0.0007) [2023-12-26 00:32:39,914][123090] Updated weights for policy 1, policy_version 120015 (0.0007) [2023-12-26 00:32:39,982][123090] Updated weights for policy 1, policy_version 120025 (0.0007) [2023-12-26 00:32:39,994][123091] Updated weights for policy 0, policy_version 120547 (0.0010) [2023-12-26 00:32:40,055][123091] Updated weights for policy 0, policy_version 120557 (0.0010) [2023-12-26 00:32:40,110][123091] Updated weights for policy 0, policy_version 120568 (0.0011) [2023-12-26 00:32:40,719][123090] Updated weights for policy 1, policy_version 120035 (0.0007) [2023-12-26 00:32:40,791][123090] Updated weights for policy 1, policy_version 120045 (0.0009) [2023-12-26 00:32:40,849][123090] Updated weights for policy 1, policy_version 120055 (0.0009) [2023-12-26 00:32:40,998][123091] Updated weights for policy 0, policy_version 120578 (0.0010) [2023-12-26 00:32:41,061][123091] Updated weights for policy 0, policy_version 120588 (0.0010) [2023-12-26 00:32:41,129][123091] Updated weights for policy 0, policy_version 120598 (0.0009) [2023-12-26 00:32:41,199][123091] Updated weights for policy 0, policy_version 120608 (0.0010) [2023-12-26 00:32:41,749][123090] Updated weights for policy 1, policy_version 120065 (0.0009) [2023-12-26 00:32:41,815][123090] Updated weights for policy 1, policy_version 120075 (0.0010) [2023-12-26 00:32:41,883][123090] Updated weights for policy 1, policy_version 120085 (0.0009) [2023-12-26 00:32:41,955][123090] Updated weights for policy 1, policy_version 120095 (0.0009) [2023-12-26 00:32:42,097][123091] Updated weights for policy 0, policy_version 120618 (0.0009) [2023-12-26 00:32:42,160][123091] Updated weights for policy 0, policy_version 120628 (0.0010) [2023-12-26 00:32:42,231][123091] Updated weights for policy 0, policy_version 120638 (0.0009) [2023-12-26 00:32:42,795][123090] Updated weights for policy 1, policy_version 120105 (0.0009) [2023-12-26 00:32:42,851][123090] Updated weights for policy 1, policy_version 120115 (0.0009) [2023-12-26 00:32:42,913][123090] Updated weights for policy 1, policy_version 120125 (0.0009) [2023-12-26 00:32:43,074][123091] Updated weights for policy 0, policy_version 120648 (0.0008) [2023-12-26 00:32:43,131][123091] Updated weights for policy 0, policy_version 120658 (0.0007) [2023-12-26 00:32:43,207][123091] Updated weights for policy 0, policy_version 120668 (0.0005) [2023-12-26 00:32:43,582][123090] Updated weights for policy 1, policy_version 120135 (0.0007) [2023-12-26 00:32:43,638][123090] Updated weights for policy 1, policy_version 120145 (0.0005) [2023-12-26 00:32:43,698][123090] Updated weights for policy 1, policy_version 120156 (0.0008) [2023-12-26 00:32:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 61652992. Throughput: 0: 8998.8, 1: 8771.9. Samples: 61643964. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:43,785][121949] Avg episode reward: [(0, '5255.719'), (1, '5650.909')] [2023-12-26 00:32:43,870][123091] Updated weights for policy 0, policy_version 120678 (0.0006) [2023-12-26 00:32:43,934][123091] Updated weights for policy 0, policy_version 120688 (0.0005) [2023-12-26 00:32:43,991][123091] Updated weights for policy 0, policy_version 120698 (0.0005) [2023-12-26 00:32:44,545][123090] Updated weights for policy 1, policy_version 120166 (0.0009) [2023-12-26 00:32:44,606][123090] Updated weights for policy 1, policy_version 120176 (0.0009) [2023-12-26 00:32:44,666][123090] Updated weights for policy 1, policy_version 120186 (0.0009) [2023-12-26 00:32:44,769][123091] Updated weights for policy 0, policy_version 120708 (0.0008) [2023-12-26 00:32:44,833][123091] Updated weights for policy 0, policy_version 120718 (0.0010) [2023-12-26 00:32:44,903][123091] Updated weights for policy 0, policy_version 120728 (0.0009) [2023-12-26 00:32:45,511][123090] Updated weights for policy 1, policy_version 120196 (0.0009) [2023-12-26 00:32:45,568][123090] Updated weights for policy 1, policy_version 120206 (0.0009) [2023-12-26 00:32:45,618][123090] Updated weights for policy 1, policy_version 120216 (0.0009) [2023-12-26 00:32:45,712][123091] Updated weights for policy 0, policy_version 120738 (0.0011) [2023-12-26 00:32:45,769][123091] Updated weights for policy 0, policy_version 120748 (0.0010) [2023-12-26 00:32:45,817][123091] Updated weights for policy 0, policy_version 120758 (0.0010) [2023-12-26 00:32:45,864][123091] Updated weights for policy 0, policy_version 120768 (0.0010) [2023-12-26 00:32:46,555][123090] Updated weights for policy 1, policy_version 120226 (0.0009) [2023-12-26 00:32:46,604][123091] Updated weights for policy 0, policy_version 120778 (0.0010) [2023-12-26 00:32:46,615][123090] Updated weights for policy 1, policy_version 120236 (0.0006) [2023-12-26 00:32:46,651][123091] Updated weights for policy 0, policy_version 120788 (0.0010) [2023-12-26 00:32:46,667][123090] Updated weights for policy 1, policy_version 120246 (0.0006) [2023-12-26 00:32:46,702][123091] Updated weights for policy 0, policy_version 120798 (0.0007) [2023-12-26 00:32:46,733][123090] Updated weights for policy 1, policy_version 120256 (0.0009) [2023-12-26 00:32:47,518][123091] Updated weights for policy 0, policy_version 120808 (0.0010) [2023-12-26 00:32:47,580][123091] Updated weights for policy 0, policy_version 120818 (0.0010) [2023-12-26 00:32:47,587][123090] Updated weights for policy 1, policy_version 120266 (0.0006) [2023-12-26 00:32:47,642][123091] Updated weights for policy 0, policy_version 120828 (0.0010) [2023-12-26 00:32:47,644][123090] Updated weights for policy 1, policy_version 120276 (0.0009) [2023-12-26 00:32:47,714][123090] Updated weights for policy 1, policy_version 120286 (0.0008) [2023-12-26 00:32:48,371][123091] Updated weights for policy 0, policy_version 120838 (0.0009) [2023-12-26 00:32:48,439][123091] Updated weights for policy 0, policy_version 120848 (0.0005) [2023-12-26 00:32:48,502][123091] Updated weights for policy 0, policy_version 120858 (0.0005) [2023-12-26 00:32:48,576][123090] Updated weights for policy 1, policy_version 120296 (0.0009) [2023-12-26 00:32:48,629][123090] Updated weights for policy 1, policy_version 120307 (0.0009) [2023-12-26 00:32:48,686][123090] Updated weights for policy 1, policy_version 120317 (0.0009) [2023-12-26 00:32:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 61743104. Throughput: 0: 9038.7, 1: 8745.5. Samples: 61750836. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 00:32:48,785][121949] Avg episode reward: [(0, '5363.783'), (1, '5624.142')] [2023-12-26 00:32:48,786][123007] Saving new best policy, reward=5363.783! [2023-12-26 00:32:49,216][123091] Updated weights for policy 0, policy_version 120868 (0.0006) [2023-12-26 00:32:49,280][123091] Updated weights for policy 0, policy_version 120878 (0.0007) [2023-12-26 00:32:49,343][123091] Updated weights for policy 0, policy_version 120888 (0.0007) [2023-12-26 00:32:49,600][123090] Updated weights for policy 1, policy_version 120327 (0.0010) [2023-12-26 00:32:49,668][123090] Updated weights for policy 1, policy_version 120337 (0.0011) [2023-12-26 00:32:49,742][123090] Updated weights for policy 1, policy_version 120347 (0.0011) [2023-12-26 00:32:50,015][123091] Updated weights for policy 0, policy_version 120898 (0.0008) [2023-12-26 00:32:50,078][123091] Updated weights for policy 0, policy_version 120908 (0.0011) [2023-12-26 00:32:50,146][123091] Updated weights for policy 0, policy_version 120918 (0.0009) [2023-12-26 00:32:50,203][123091] Updated weights for policy 0, policy_version 120928 (0.0005) [2023-12-26 00:32:50,512][123090] Updated weights for policy 1, policy_version 120357 (0.0008) [2023-12-26 00:32:50,579][123090] Updated weights for policy 1, policy_version 120367 (0.0006) [2023-12-26 00:32:50,634][123090] Updated weights for policy 1, policy_version 120377 (0.0009) [2023-12-26 00:32:51,029][123091] Updated weights for policy 0, policy_version 120938 (0.0011) [2023-12-26 00:32:51,092][123091] Updated weights for policy 0, policy_version 120948 (0.0011) [2023-12-26 00:32:51,157][123091] Updated weights for policy 0, policy_version 120958 (0.0011) [2023-12-26 00:32:51,467][123090] Updated weights for policy 1, policy_version 120387 (0.0009) [2023-12-26 00:32:51,519][123090] Updated weights for policy 1, policy_version 120397 (0.0009) [2023-12-26 00:32:51,580][123090] Updated weights for policy 1, policy_version 120407 (0.0009) [2023-12-26 00:32:52,005][123091] Updated weights for policy 0, policy_version 120968 (0.0009) [2023-12-26 00:32:52,062][123091] Updated weights for policy 0, policy_version 120978 (0.0009) [2023-12-26 00:32:52,119][123091] Updated weights for policy 0, policy_version 120988 (0.0010) [2023-12-26 00:32:52,344][123090] Updated weights for policy 1, policy_version 120417 (0.0008) [2023-12-26 00:32:52,407][123090] Updated weights for policy 1, policy_version 120427 (0.0009) [2023-12-26 00:32:52,463][123090] Updated weights for policy 1, policy_version 120437 (0.0009) [2023-12-26 00:32:52,521][123090] Updated weights for policy 1, policy_version 120447 (0.0009) [2023-12-26 00:32:52,998][123091] Updated weights for policy 0, policy_version 120998 (0.0007) [2023-12-26 00:32:53,054][123091] Updated weights for policy 0, policy_version 121008 (0.0009) [2023-12-26 00:32:53,110][123091] Updated weights for policy 0, policy_version 121018 (0.0008) [2023-12-26 00:32:53,402][123090] Updated weights for policy 1, policy_version 120457 (0.0009) [2023-12-26 00:32:53,464][123090] Updated weights for policy 1, policy_version 120467 (0.0009) [2023-12-26 00:32:53,529][123090] Updated weights for policy 1, policy_version 120477 (0.0009) [2023-12-26 00:32:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 61825024. Throughput: 0: 9024.1, 1: 8738.8. Samples: 61803036. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:32:53,785][121949] Avg episode reward: [(0, '5316.481'), (1, '5588.312')] [2023-12-26 00:32:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000121024_30982144.pth... [2023-12-26 00:32:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000120480_30842880.pth... [2023-12-26 00:32:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000120000_30720000.pth [2023-12-26 00:32:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000119456_30580736.pth [2023-12-26 00:32:53,881][123091] Updated weights for policy 0, policy_version 121028 (0.0006) [2023-12-26 00:32:53,942][123091] Updated weights for policy 0, policy_version 121038 (0.0005) [2023-12-26 00:32:54,007][123091] Updated weights for policy 0, policy_version 121048 (0.0007) [2023-12-26 00:32:54,426][123090] Updated weights for policy 1, policy_version 120487 (0.0009) [2023-12-26 00:32:54,495][123090] Updated weights for policy 1, policy_version 120497 (0.0005) [2023-12-26 00:32:54,563][123090] Updated weights for policy 1, policy_version 120507 (0.0008) [2023-12-26 00:32:54,784][123091] Updated weights for policy 0, policy_version 121058 (0.0009) [2023-12-26 00:32:54,847][123091] Updated weights for policy 0, policy_version 121068 (0.0011) [2023-12-26 00:32:54,913][123091] Updated weights for policy 0, policy_version 121078 (0.0010) [2023-12-26 00:32:54,982][123091] Updated weights for policy 0, policy_version 121088 (0.0009) [2023-12-26 00:32:55,390][123090] Updated weights for policy 1, policy_version 120517 (0.0010) [2023-12-26 00:32:55,449][123090] Updated weights for policy 1, policy_version 120527 (0.0010) [2023-12-26 00:32:55,499][123090] Updated weights for policy 1, policy_version 120537 (0.0009) [2023-12-26 00:32:55,724][123091] Updated weights for policy 0, policy_version 121098 (0.0009) [2023-12-26 00:32:55,774][123091] Updated weights for policy 0, policy_version 121108 (0.0010) [2023-12-26 00:32:55,821][123091] Updated weights for policy 0, policy_version 121118 (0.0010) [2023-12-26 00:32:56,354][123090] Updated weights for policy 1, policy_version 120547 (0.0008) [2023-12-26 00:32:56,425][123090] Updated weights for policy 1, policy_version 120557 (0.0005) [2023-12-26 00:32:56,448][123091] Updated weights for policy 0, policy_version 121128 (0.0006) [2023-12-26 00:32:56,487][123090] Updated weights for policy 1, policy_version 120567 (0.0005) [2023-12-26 00:32:56,511][123091] Updated weights for policy 0, policy_version 121138 (0.0005) [2023-12-26 00:32:56,587][123091] Updated weights for policy 0, policy_version 121148 (0.0006) [2023-12-26 00:32:57,215][123091] Updated weights for policy 0, policy_version 121158 (0.0008) [2023-12-26 00:32:57,277][123091] Updated weights for policy 0, policy_version 121168 (0.0009) [2023-12-26 00:32:57,282][123090] Updated weights for policy 1, policy_version 120577 (0.0007) [2023-12-26 00:32:57,342][123091] Updated weights for policy 0, policy_version 121178 (0.0009) [2023-12-26 00:32:57,342][123090] Updated weights for policy 1, policy_version 120587 (0.0007) [2023-12-26 00:32:57,397][123090] Updated weights for policy 1, policy_version 120597 (0.0009) [2023-12-26 00:32:57,453][123090] Updated weights for policy 1, policy_version 120607 (0.0010) [2023-12-26 00:32:58,084][123091] Updated weights for policy 0, policy_version 121188 (0.0009) [2023-12-26 00:32:58,143][123091] Updated weights for policy 0, policy_version 121198 (0.0011) [2023-12-26 00:32:58,207][123091] Updated weights for policy 0, policy_version 121208 (0.0011) [2023-12-26 00:32:58,308][123090] Updated weights for policy 1, policy_version 120617 (0.0008) [2023-12-26 00:32:58,378][123090] Updated weights for policy 1, policy_version 120627 (0.0007) [2023-12-26 00:32:58,445][123090] Updated weights for policy 1, policy_version 120637 (0.0006) [2023-12-26 00:32:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 61915136. Throughput: 0: 9081.6, 1: 8675.7. Samples: 61909460. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:32:58,784][121949] Avg episode reward: [(0, '5228.389'), (1, '5380.832')] [2023-12-26 00:32:59,084][123091] Updated weights for policy 0, policy_version 121218 (0.0010) [2023-12-26 00:32:59,140][123091] Updated weights for policy 0, policy_version 121228 (0.0010) [2023-12-26 00:32:59,195][123091] Updated weights for policy 0, policy_version 121238 (0.0006) [2023-12-26 00:32:59,261][123091] Updated weights for policy 0, policy_version 121248 (0.0008) [2023-12-26 00:32:59,303][123090] Updated weights for policy 1, policy_version 120647 (0.0007) [2023-12-26 00:32:59,371][123090] Updated weights for policy 1, policy_version 120657 (0.0006) [2023-12-26 00:32:59,445][123090] Updated weights for policy 1, policy_version 120667 (0.0006) [2023-12-26 00:33:00,098][123091] Updated weights for policy 0, policy_version 121258 (0.0010) [2023-12-26 00:33:00,149][123091] Updated weights for policy 0, policy_version 121268 (0.0010) [2023-12-26 00:33:00,182][123090] Updated weights for policy 1, policy_version 120677 (0.0006) [2023-12-26 00:33:00,205][123091] Updated weights for policy 0, policy_version 121278 (0.0011) [2023-12-26 00:33:00,243][123090] Updated weights for policy 1, policy_version 120687 (0.0007) [2023-12-26 00:33:00,294][123090] Updated weights for policy 1, policy_version 120697 (0.0009) [2023-12-26 00:33:00,987][123091] Updated weights for policy 0, policy_version 121288 (0.0006) [2023-12-26 00:33:01,062][123091] Updated weights for policy 0, policy_version 121298 (0.0009) [2023-12-26 00:33:01,130][123091] Updated weights for policy 0, policy_version 121308 (0.0010) [2023-12-26 00:33:01,145][123090] Updated weights for policy 1, policy_version 120707 (0.0009) [2023-12-26 00:33:01,199][123090] Updated weights for policy 1, policy_version 120717 (0.0009) [2023-12-26 00:33:01,274][123090] Updated weights for policy 1, policy_version 120727 (0.0010) [2023-12-26 00:33:01,924][123091] Updated weights for policy 0, policy_version 121318 (0.0009) [2023-12-26 00:33:01,972][123091] Updated weights for policy 0, policy_version 121328 (0.0009) [2023-12-26 00:33:02,031][123091] Updated weights for policy 0, policy_version 121338 (0.0009) [2023-12-26 00:33:02,137][123090] Updated weights for policy 1, policy_version 120737 (0.0010) [2023-12-26 00:33:02,202][123090] Updated weights for policy 1, policy_version 120747 (0.0010) [2023-12-26 00:33:02,253][123090] Updated weights for policy 1, policy_version 120757 (0.0009) [2023-12-26 00:33:02,310][123090] Updated weights for policy 1, policy_version 120767 (0.0008) [2023-12-26 00:33:02,864][123091] Updated weights for policy 0, policy_version 121348 (0.0009) [2023-12-26 00:33:02,925][123091] Updated weights for policy 0, policy_version 121358 (0.0009) [2023-12-26 00:33:02,973][123091] Updated weights for policy 0, policy_version 121368 (0.0009) [2023-12-26 00:33:03,162][123090] Updated weights for policy 1, policy_version 120777 (0.0009) [2023-12-26 00:33:03,224][123090] Updated weights for policy 1, policy_version 120787 (0.0010) [2023-12-26 00:33:03,279][123090] Updated weights for policy 1, policy_version 120797 (0.0008) [2023-12-26 00:33:03,771][123091] Updated weights for policy 0, policy_version 121378 (0.0006) [2023-12-26 00:33:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 61997056. Throughput: 0: 9020.2, 1: 8576.6. Samples: 62012700. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:03,785][121949] Avg episode reward: [(0, '5343.643'), (1, '5479.852')] [2023-12-26 00:33:03,822][123091] Updated weights for policy 0, policy_version 121388 (0.0005) [2023-12-26 00:33:03,882][123091] Updated weights for policy 0, policy_version 121398 (0.0008) [2023-12-26 00:33:03,939][123091] Updated weights for policy 0, policy_version 121408 (0.0010) [2023-12-26 00:33:04,129][123090] Updated weights for policy 1, policy_version 120807 (0.0010) [2023-12-26 00:33:04,190][123090] Updated weights for policy 1, policy_version 120817 (0.0008) [2023-12-26 00:33:04,257][123090] Updated weights for policy 1, policy_version 120827 (0.0010) [2023-12-26 00:33:04,779][123091] Updated weights for policy 0, policy_version 121418 (0.0009) [2023-12-26 00:33:04,829][123091] Updated weights for policy 0, policy_version 121428 (0.0009) [2023-12-26 00:33:04,886][123091] Updated weights for policy 0, policy_version 121438 (0.0010) [2023-12-26 00:33:05,059][123090] Updated weights for policy 1, policy_version 120837 (0.0009) [2023-12-26 00:33:05,122][123090] Updated weights for policy 1, policy_version 120847 (0.0009) [2023-12-26 00:33:05,178][123090] Updated weights for policy 1, policy_version 120857 (0.0008) [2023-12-26 00:33:05,661][123091] Updated weights for policy 0, policy_version 121448 (0.0010) [2023-12-26 00:33:05,717][123091] Updated weights for policy 0, policy_version 121458 (0.0010) [2023-12-26 00:33:05,772][123091] Updated weights for policy 0, policy_version 121468 (0.0009) [2023-12-26 00:33:05,883][123090] Updated weights for policy 1, policy_version 120867 (0.0007) [2023-12-26 00:33:05,941][123090] Updated weights for policy 1, policy_version 120877 (0.0010) [2023-12-26 00:33:06,004][123090] Updated weights for policy 1, policy_version 120889 (0.0010) [2023-12-26 00:33:06,515][123091] Updated weights for policy 0, policy_version 121478 (0.0009) [2023-12-26 00:33:06,570][123091] Updated weights for policy 0, policy_version 121488 (0.0010) [2023-12-26 00:33:06,621][123091] Updated weights for policy 0, policy_version 121498 (0.0006) [2023-12-26 00:33:06,890][123090] Updated weights for policy 1, policy_version 120900 (0.0009) [2023-12-26 00:33:06,957][123090] Updated weights for policy 1, policy_version 120910 (0.0005) [2023-12-26 00:33:07,024][123090] Updated weights for policy 1, policy_version 120920 (0.0009) [2023-12-26 00:33:07,430][123091] Updated weights for policy 0, policy_version 121508 (0.0007) [2023-12-26 00:33:07,485][123091] Updated weights for policy 0, policy_version 121518 (0.0010) [2023-12-26 00:33:07,538][123091] Updated weights for policy 0, policy_version 121528 (0.0009) [2023-12-26 00:33:07,829][123090] Updated weights for policy 1, policy_version 120930 (0.0010) [2023-12-26 00:33:07,880][123090] Updated weights for policy 1, policy_version 120940 (0.0010) [2023-12-26 00:33:07,933][123090] Updated weights for policy 1, policy_version 120950 (0.0009) [2023-12-26 00:33:08,301][123091] Updated weights for policy 0, policy_version 121538 (0.0009) [2023-12-26 00:33:08,367][123091] Updated weights for policy 0, policy_version 121548 (0.0008) [2023-12-26 00:33:08,430][123091] Updated weights for policy 0, policy_version 121558 (0.0006) [2023-12-26 00:33:08,481][123091] Updated weights for policy 0, policy_version 121568 (0.0005) [2023-12-26 00:33:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 62087168. Throughput: 0: 9024.2, 1: 8606.8. Samples: 62065784. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:08,785][121949] Avg episode reward: [(0, '5418.080'), (1, '5623.942')] [2023-12-26 00:33:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000121568_31121408.pth... [2023-12-26 00:33:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000120960_30965760.pth... [2023-12-26 00:33:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000120512_30851072.pth [2023-12-26 00:33:08,796][123007] Saving new best policy, reward=5418.080! [2023-12-26 00:33:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000119968_30711808.pth [2023-12-26 00:33:08,865][123090] Updated weights for policy 1, policy_version 120961 (0.0009) [2023-12-26 00:33:08,920][123090] Updated weights for policy 1, policy_version 120971 (0.0010) [2023-12-26 00:33:08,980][123090] Updated weights for policy 1, policy_version 120981 (0.0009) [2023-12-26 00:33:09,036][123090] Updated weights for policy 1, policy_version 120991 (0.0009) [2023-12-26 00:33:09,228][123091] Updated weights for policy 0, policy_version 121578 (0.0008) [2023-12-26 00:33:09,301][123091] Updated weights for policy 0, policy_version 121588 (0.0008) [2023-12-26 00:33:09,373][123091] Updated weights for policy 0, policy_version 121598 (0.0008) [2023-12-26 00:33:09,894][123090] Updated weights for policy 1, policy_version 121001 (0.0010) [2023-12-26 00:33:09,967][123090] Updated weights for policy 1, policy_version 121011 (0.0010) [2023-12-26 00:33:10,035][123090] Updated weights for policy 1, policy_version 121021 (0.0010) [2023-12-26 00:33:10,157][123091] Updated weights for policy 0, policy_version 121608 (0.0010) [2023-12-26 00:33:10,227][123091] Updated weights for policy 0, policy_version 121618 (0.0009) [2023-12-26 00:33:10,299][123091] Updated weights for policy 0, policy_version 121628 (0.0010) [2023-12-26 00:33:10,861][123090] Updated weights for policy 1, policy_version 121031 (0.0009) [2023-12-26 00:33:10,936][123090] Updated weights for policy 1, policy_version 121041 (0.0009) [2023-12-26 00:33:10,993][123090] Updated weights for policy 1, policy_version 121051 (0.0009) [2023-12-26 00:33:11,079][123091] Updated weights for policy 0, policy_version 121638 (0.0008) [2023-12-26 00:33:11,141][123091] Updated weights for policy 0, policy_version 121648 (0.0009) [2023-12-26 00:33:11,215][123091] Updated weights for policy 0, policy_version 121658 (0.0008) [2023-12-26 00:33:11,861][123090] Updated weights for policy 1, policy_version 121061 (0.0010) [2023-12-26 00:33:11,930][123090] Updated weights for policy 1, policy_version 121071 (0.0010) [2023-12-26 00:33:11,992][123090] Updated weights for policy 1, policy_version 121081 (0.0009) [2023-12-26 00:33:11,999][123091] Updated weights for policy 0, policy_version 121668 (0.0009) [2023-12-26 00:33:12,064][123091] Updated weights for policy 0, policy_version 121678 (0.0008) [2023-12-26 00:33:12,124][123091] Updated weights for policy 0, policy_version 121688 (0.0009) [2023-12-26 00:33:12,728][123090] Updated weights for policy 1, policy_version 121091 (0.0006) [2023-12-26 00:33:12,791][123090] Updated weights for policy 1, policy_version 121101 (0.0006) [2023-12-26 00:33:12,857][123090] Updated weights for policy 1, policy_version 121111 (0.0006) [2023-12-26 00:33:13,000][123091] Updated weights for policy 0, policy_version 121698 (0.0010) [2023-12-26 00:33:13,058][123091] Updated weights for policy 0, policy_version 121708 (0.0010) [2023-12-26 00:33:13,114][123091] Updated weights for policy 0, policy_version 121718 (0.0009) [2023-12-26 00:33:13,175][123091] Updated weights for policy 0, policy_version 121728 (0.0009) [2023-12-26 00:33:13,681][123090] Updated weights for policy 1, policy_version 121121 (0.0010) [2023-12-26 00:33:13,745][123090] Updated weights for policy 1, policy_version 121131 (0.0009) [2023-12-26 00:33:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 62169088. Throughput: 0: 8976.9, 1: 8527.7. Samples: 62168536. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:13,785][121949] Avg episode reward: [(0, '5470.337'), (1, '5681.169')] [2023-12-26 00:33:13,785][123007] Saving new best policy, reward=5470.337! [2023-12-26 00:33:13,798][123090] Updated weights for policy 1, policy_version 121141 (0.0009) [2023-12-26 00:33:13,854][123090] Updated weights for policy 1, policy_version 121152 (0.0008) [2023-12-26 00:33:14,016][123091] Updated weights for policy 0, policy_version 121738 (0.0009) [2023-12-26 00:33:14,072][123091] Updated weights for policy 0, policy_version 121748 (0.0010) [2023-12-26 00:33:14,130][123091] Updated weights for policy 0, policy_version 121758 (0.0010) [2023-12-26 00:33:14,699][123090] Updated weights for policy 1, policy_version 121162 (0.0011) [2023-12-26 00:33:14,758][123090] Updated weights for policy 1, policy_version 121172 (0.0010) [2023-12-26 00:33:14,827][123090] Updated weights for policy 1, policy_version 121182 (0.0009) [2023-12-26 00:33:14,857][123091] Updated weights for policy 0, policy_version 121769 (0.0009) [2023-12-26 00:33:14,916][123091] Updated weights for policy 0, policy_version 121779 (0.0009) [2023-12-26 00:33:14,984][123091] Updated weights for policy 0, policy_version 121789 (0.0010) [2023-12-26 00:33:15,563][123090] Updated weights for policy 1, policy_version 121192 (0.0006) [2023-12-26 00:33:15,620][123090] Updated weights for policy 1, policy_version 121202 (0.0006) [2023-12-26 00:33:15,680][123090] Updated weights for policy 1, policy_version 121212 (0.0010) [2023-12-26 00:33:15,899][123091] Updated weights for policy 0, policy_version 121799 (0.0009) [2023-12-26 00:33:15,962][123091] Updated weights for policy 0, policy_version 121809 (0.0009) [2023-12-26 00:33:16,023][123091] Updated weights for policy 0, policy_version 121819 (0.0009) [2023-12-26 00:33:16,418][123090] Updated weights for policy 1, policy_version 121222 (0.0010) [2023-12-26 00:33:16,466][123090] Updated weights for policy 1, policy_version 121232 (0.0006) [2023-12-26 00:33:16,516][123090] Updated weights for policy 1, policy_version 121242 (0.0009) [2023-12-26 00:33:16,947][123091] Updated weights for policy 0, policy_version 121829 (0.0009) [2023-12-26 00:33:17,015][123091] Updated weights for policy 0, policy_version 121839 (0.0009) [2023-12-26 00:33:17,066][123091] Updated weights for policy 0, policy_version 121849 (0.0008) [2023-12-26 00:33:17,245][123090] Updated weights for policy 1, policy_version 121252 (0.0007) [2023-12-26 00:33:17,291][123090] Updated weights for policy 1, policy_version 121262 (0.0005) [2023-12-26 00:33:17,340][123090] Updated weights for policy 1, policy_version 121272 (0.0005) [2023-12-26 00:33:17,763][123091] Updated weights for policy 0, policy_version 121859 (0.0005) [2023-12-26 00:33:17,816][123091] Updated weights for policy 0, policy_version 121869 (0.0005) [2023-12-26 00:33:17,866][123091] Updated weights for policy 0, policy_version 121879 (0.0010) [2023-12-26 00:33:17,991][123090] Updated weights for policy 1, policy_version 121282 (0.0005) [2023-12-26 00:33:18,054][123090] Updated weights for policy 1, policy_version 121292 (0.0006) [2023-12-26 00:33:18,125][123090] Updated weights for policy 1, policy_version 121302 (0.0005) [2023-12-26 00:33:18,190][123090] Updated weights for policy 1, policy_version 121312 (0.0010) [2023-12-26 00:33:18,673][123091] Updated weights for policy 0, policy_version 121889 (0.0010) [2023-12-26 00:33:18,733][123091] Updated weights for policy 0, policy_version 121899 (0.0010) [2023-12-26 00:33:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 62259200. Throughput: 0: 8923.2, 1: 8604.7. Samples: 62276476. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:18,785][121949] Avg episode reward: [(0, '5401.223'), (1, '5696.842')] [2023-12-26 00:33:18,792][123091] Updated weights for policy 0, policy_version 121909 (0.0011) [2023-12-26 00:33:18,840][123091] Updated weights for policy 0, policy_version 121919 (0.0007) [2023-12-26 00:33:18,997][123090] Updated weights for policy 1, policy_version 121322 (0.0010) [2023-12-26 00:33:19,061][123090] Updated weights for policy 1, policy_version 121332 (0.0011) [2023-12-26 00:33:19,117][123090] Updated weights for policy 1, policy_version 121342 (0.0011) [2023-12-26 00:33:19,662][123091] Updated weights for policy 0, policy_version 121929 (0.0006) [2023-12-26 00:33:19,733][123091] Updated weights for policy 0, policy_version 121939 (0.0009) [2023-12-26 00:33:19,793][123091] Updated weights for policy 0, policy_version 121949 (0.0009) [2023-12-26 00:33:19,913][123090] Updated weights for policy 1, policy_version 121352 (0.0011) [2023-12-26 00:33:19,982][123090] Updated weights for policy 1, policy_version 121362 (0.0011) [2023-12-26 00:33:20,056][123090] Updated weights for policy 1, policy_version 121372 (0.0007) [2023-12-26 00:33:20,638][123091] Updated weights for policy 0, policy_version 121959 (0.0008) [2023-12-26 00:33:20,699][123091] Updated weights for policy 0, policy_version 121969 (0.0009) [2023-12-26 00:33:20,768][123091] Updated weights for policy 0, policy_version 121979 (0.0009) [2023-12-26 00:33:20,843][123090] Updated weights for policy 1, policy_version 121382 (0.0005) [2023-12-26 00:33:20,902][123090] Updated weights for policy 1, policy_version 121392 (0.0006) [2023-12-26 00:33:20,956][123090] Updated weights for policy 1, policy_version 121402 (0.0007) [2023-12-26 00:33:21,632][123091] Updated weights for policy 0, policy_version 121989 (0.0010) [2023-12-26 00:33:21,692][123091] Updated weights for policy 0, policy_version 121999 (0.0010) [2023-12-26 00:33:21,767][123091] Updated weights for policy 0, policy_version 122009 (0.0009) [2023-12-26 00:33:21,769][123090] Updated weights for policy 1, policy_version 121412 (0.0010) [2023-12-26 00:33:21,825][123090] Updated weights for policy 1, policy_version 121422 (0.0010) [2023-12-26 00:33:21,890][123090] Updated weights for policy 1, policy_version 121432 (0.0005) [2023-12-26 00:33:22,637][123091] Updated weights for policy 0, policy_version 122019 (0.0008) [2023-12-26 00:33:22,688][123090] Updated weights for policy 1, policy_version 121442 (0.0007) [2023-12-26 00:33:22,697][123091] Updated weights for policy 0, policy_version 122029 (0.0007) [2023-12-26 00:33:22,752][123090] Updated weights for policy 1, policy_version 121452 (0.0011) [2023-12-26 00:33:22,765][123091] Updated weights for policy 0, policy_version 122039 (0.0006) [2023-12-26 00:33:22,815][123090] Updated weights for policy 1, policy_version 121462 (0.0011) [2023-12-26 00:33:22,875][123090] Updated weights for policy 1, policy_version 121472 (0.0011) [2023-12-26 00:33:23,563][123091] Updated weights for policy 0, policy_version 122049 (0.0010) [2023-12-26 00:33:23,624][123091] Updated weights for policy 0, policy_version 122059 (0.0006) [2023-12-26 00:33:23,679][123091] Updated weights for policy 0, policy_version 122069 (0.0005) [2023-12-26 00:33:23,701][123090] Updated weights for policy 1, policy_version 121482 (0.0011) [2023-12-26 00:33:23,733][123091] Updated weights for policy 0, policy_version 122079 (0.0006) [2023-12-26 00:33:23,752][123090] Updated weights for policy 1, policy_version 121492 (0.0010) [2023-12-26 00:33:23,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 62349312. Throughput: 0: 8863.0, 1: 8602.2. Samples: 62327100. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:23,786][121949] Avg episode reward: [(0, '5360.402'), (1, '5786.619')] [2023-12-26 00:33:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000122080_31252480.pth... [2023-12-26 00:33:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000121024_30982144.pth [2023-12-26 00:33:23,800][123090] Updated weights for policy 1, policy_version 121502 (0.0010) [2023-12-26 00:33:23,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000121504_31105024.pth... [2023-12-26 00:33:23,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000120480_30842880.pth [2023-12-26 00:33:24,434][123091] Updated weights for policy 0, policy_version 122089 (0.0010) [2023-12-26 00:33:24,499][123091] Updated weights for policy 0, policy_version 122099 (0.0008) [2023-12-26 00:33:24,564][123091] Updated weights for policy 0, policy_version 122109 (0.0008) [2023-12-26 00:33:24,601][123090] Updated weights for policy 1, policy_version 121512 (0.0010) [2023-12-26 00:33:24,665][123090] Updated weights for policy 1, policy_version 121522 (0.0011) [2023-12-26 00:33:24,739][123090] Updated weights for policy 1, policy_version 121532 (0.0011) [2023-12-26 00:33:25,345][123091] Updated weights for policy 0, policy_version 122119 (0.0007) [2023-12-26 00:33:25,408][123091] Updated weights for policy 0, policy_version 122129 (0.0008) [2023-12-26 00:33:25,468][123091] Updated weights for policy 0, policy_version 122139 (0.0009) [2023-12-26 00:33:25,549][123090] Updated weights for policy 1, policy_version 121542 (0.0010) [2023-12-26 00:33:25,608][123090] Updated weights for policy 1, policy_version 121552 (0.0010) [2023-12-26 00:33:25,659][123090] Updated weights for policy 1, policy_version 121562 (0.0010) [2023-12-26 00:33:26,267][123091] Updated weights for policy 0, policy_version 122149 (0.0008) [2023-12-26 00:33:26,315][123091] Updated weights for policy 0, policy_version 122159 (0.0008) [2023-12-26 00:33:26,363][123091] Updated weights for policy 0, policy_version 122169 (0.0009) [2023-12-26 00:33:26,491][123090] Updated weights for policy 1, policy_version 121572 (0.0010) [2023-12-26 00:33:26,541][123090] Updated weights for policy 1, policy_version 121582 (0.0010) [2023-12-26 00:33:26,588][123090] Updated weights for policy 1, policy_version 121592 (0.0010) [2023-12-26 00:33:27,212][123091] Updated weights for policy 0, policy_version 122179 (0.0008) [2023-12-26 00:33:27,264][123091] Updated weights for policy 0, policy_version 122189 (0.0009) [2023-12-26 00:33:27,322][123091] Updated weights for policy 0, policy_version 122199 (0.0008) [2023-12-26 00:33:27,424][123090] Updated weights for policy 1, policy_version 121602 (0.0009) [2023-12-26 00:33:27,476][123090] Updated weights for policy 1, policy_version 121612 (0.0005) [2023-12-26 00:33:27,529][123090] Updated weights for policy 1, policy_version 121622 (0.0005) [2023-12-26 00:33:27,589][123090] Updated weights for policy 1, policy_version 121632 (0.0005) [2023-12-26 00:33:28,161][123091] Updated weights for policy 0, policy_version 122209 (0.0009) [2023-12-26 00:33:28,211][123090] Updated weights for policy 1, policy_version 121642 (0.0005) [2023-12-26 00:33:28,214][123091] Updated weights for policy 0, policy_version 122219 (0.0008) [2023-12-26 00:33:28,263][123090] Updated weights for policy 1, policy_version 121652 (0.0005) [2023-12-26 00:33:28,281][123091] Updated weights for policy 0, policy_version 122229 (0.0008) [2023-12-26 00:33:28,317][123090] Updated weights for policy 1, policy_version 121662 (0.0005) [2023-12-26 00:33:28,349][123091] Updated weights for policy 0, policy_version 122239 (0.0009) [2023-12-26 00:33:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 62439424. Throughput: 0: 8892.1, 1: 8624.8. Samples: 62432224. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:28,785][121949] Avg episode reward: [(0, '5421.816'), (1, '5797.788')] [2023-12-26 00:33:28,967][123090] Updated weights for policy 1, policy_version 121672 (0.0010) [2023-12-26 00:33:29,014][123090] Updated weights for policy 1, policy_version 121682 (0.0010) [2023-12-26 00:33:29,068][123090] Updated weights for policy 1, policy_version 121692 (0.0010) [2023-12-26 00:33:29,211][123091] Updated weights for policy 0, policy_version 122249 (0.0009) [2023-12-26 00:33:29,279][123091] Updated weights for policy 0, policy_version 122259 (0.0009) [2023-12-26 00:33:29,342][123091] Updated weights for policy 0, policy_version 122269 (0.0009) [2023-12-26 00:33:29,911][123090] Updated weights for policy 1, policy_version 121702 (0.0010) [2023-12-26 00:33:29,982][123090] Updated weights for policy 1, policy_version 121712 (0.0009) [2023-12-26 00:33:30,047][123090] Updated weights for policy 1, policy_version 121722 (0.0008) [2023-12-26 00:33:30,166][123091] Updated weights for policy 0, policy_version 122279 (0.0010) [2023-12-26 00:33:30,218][123091] Updated weights for policy 0, policy_version 122289 (0.0010) [2023-12-26 00:33:30,268][123091] Updated weights for policy 0, policy_version 122299 (0.0008) [2023-12-26 00:33:30,725][123090] Updated weights for policy 1, policy_version 121732 (0.0005) [2023-12-26 00:33:30,799][123090] Updated weights for policy 1, policy_version 121742 (0.0005) [2023-12-26 00:33:30,863][123090] Updated weights for policy 1, policy_version 121752 (0.0005) [2023-12-26 00:33:31,072][123091] Updated weights for policy 0, policy_version 122309 (0.0008) [2023-12-26 00:33:31,144][123091] Updated weights for policy 0, policy_version 122319 (0.0008) [2023-12-26 00:33:31,214][123091] Updated weights for policy 0, policy_version 122329 (0.0009) [2023-12-26 00:33:31,618][123090] Updated weights for policy 1, policy_version 121762 (0.0006) [2023-12-26 00:33:31,683][123090] Updated weights for policy 1, policy_version 121772 (0.0008) [2023-12-26 00:33:31,747][123090] Updated weights for policy 1, policy_version 121782 (0.0010) [2023-12-26 00:33:31,796][123090] Updated weights for policy 1, policy_version 121792 (0.0009) [2023-12-26 00:33:32,042][123091] Updated weights for policy 0, policy_version 122339 (0.0009) [2023-12-26 00:33:32,107][123091] Updated weights for policy 0, policy_version 122349 (0.0008) [2023-12-26 00:33:32,162][123091] Updated weights for policy 0, policy_version 122359 (0.0009) [2023-12-26 00:33:32,656][123090] Updated weights for policy 1, policy_version 121802 (0.0009) [2023-12-26 00:33:32,713][123090] Updated weights for policy 1, policy_version 121812 (0.0009) [2023-12-26 00:33:32,770][123090] Updated weights for policy 1, policy_version 121822 (0.0009) [2023-12-26 00:33:32,996][123091] Updated weights for policy 0, policy_version 122369 (0.0009) [2023-12-26 00:33:33,046][123091] Updated weights for policy 0, policy_version 122379 (0.0005) [2023-12-26 00:33:33,112][123091] Updated weights for policy 0, policy_version 122389 (0.0005) [2023-12-26 00:33:33,180][123091] Updated weights for policy 0, policy_version 122399 (0.0005) [2023-12-26 00:33:33,612][123090] Updated weights for policy 1, policy_version 121832 (0.0009) [2023-12-26 00:33:33,667][123090] Updated weights for policy 1, policy_version 121842 (0.0010) [2023-12-26 00:33:33,724][123090] Updated weights for policy 1, policy_version 121852 (0.0006) [2023-12-26 00:33:33,767][123091] Updated weights for policy 0, policy_version 122409 (0.0005) [2023-12-26 00:33:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 62529536. Throughput: 0: 8825.6, 1: 8728.4. Samples: 62540768. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:33,785][121949] Avg episode reward: [(0, '5421.164'), (1, '5634.780')] [2023-12-26 00:33:33,819][123091] Updated weights for policy 0, policy_version 122419 (0.0005) [2023-12-26 00:33:33,864][123091] Updated weights for policy 0, policy_version 122429 (0.0005) [2023-12-26 00:33:34,580][123090] Updated weights for policy 1, policy_version 121862 (0.0006) [2023-12-26 00:33:34,595][123091] Updated weights for policy 0, policy_version 122439 (0.0007) [2023-12-26 00:33:34,650][123090] Updated weights for policy 1, policy_version 121872 (0.0008) [2023-12-26 00:33:34,655][123091] Updated weights for policy 0, policy_version 122449 (0.0008) [2023-12-26 00:33:34,715][123090] Updated weights for policy 1, policy_version 121882 (0.0008) [2023-12-26 00:33:34,718][123091] Updated weights for policy 0, policy_version 122459 (0.0009) [2023-12-26 00:33:35,409][123091] Updated weights for policy 0, policy_version 122469 (0.0008) [2023-12-26 00:33:35,474][123091] Updated weights for policy 0, policy_version 122479 (0.0009) [2023-12-26 00:33:35,531][123091] Updated weights for policy 0, policy_version 122489 (0.0010) [2023-12-26 00:33:35,541][123090] Updated weights for policy 1, policy_version 121892 (0.0009) [2023-12-26 00:33:35,587][123090] Updated weights for policy 1, policy_version 121902 (0.0007) [2023-12-26 00:33:35,639][123090] Updated weights for policy 1, policy_version 121912 (0.0009) [2023-12-26 00:33:36,397][123091] Updated weights for policy 0, policy_version 122499 (0.0008) [2023-12-26 00:33:36,456][123091] Updated weights for policy 0, policy_version 122509 (0.0009) [2023-12-26 00:33:36,509][123091] Updated weights for policy 0, policy_version 122519 (0.0008) [2023-12-26 00:33:36,514][123090] Updated weights for policy 1, policy_version 121922 (0.0009) [2023-12-26 00:33:36,578][123090] Updated weights for policy 1, policy_version 121932 (0.0011) [2023-12-26 00:33:36,651][123090] Updated weights for policy 1, policy_version 121942 (0.0011) [2023-12-26 00:33:36,718][123090] Updated weights for policy 1, policy_version 121952 (0.0011) [2023-12-26 00:33:37,235][123091] Updated weights for policy 0, policy_version 122529 (0.0006) [2023-12-26 00:33:37,301][123091] Updated weights for policy 0, policy_version 122539 (0.0009) [2023-12-26 00:33:37,366][123091] Updated weights for policy 0, policy_version 122549 (0.0010) [2023-12-26 00:33:37,425][123091] Updated weights for policy 0, policy_version 122559 (0.0010) [2023-12-26 00:33:37,510][123090] Updated weights for policy 1, policy_version 121962 (0.0005) [2023-12-26 00:33:37,577][123090] Updated weights for policy 1, policy_version 121972 (0.0006) [2023-12-26 00:33:37,640][123090] Updated weights for policy 1, policy_version 121982 (0.0006) [2023-12-26 00:33:38,197][123091] Updated weights for policy 0, policy_version 122569 (0.0005) [2023-12-26 00:33:38,252][123091] Updated weights for policy 0, policy_version 122579 (0.0006) [2023-12-26 00:33:38,299][123091] Updated weights for policy 0, policy_version 122589 (0.0009) [2023-12-26 00:33:38,393][123090] Updated weights for policy 1, policy_version 121992 (0.0008) [2023-12-26 00:33:38,446][123090] Updated weights for policy 1, policy_version 122002 (0.0009) [2023-12-26 00:33:38,504][123090] Updated weights for policy 1, policy_version 122012 (0.0010) [2023-12-26 00:33:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 62619648. Throughput: 0: 8840.4, 1: 8726.5. Samples: 62593544. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:38,785][121949] Avg episode reward: [(0, '5305.379'), (1, '5569.701')] [2023-12-26 00:33:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000122592_31383552.pth... [2023-12-26 00:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000122016_31236096.pth... [2023-12-26 00:33:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000120960_30965760.pth [2023-12-26 00:33:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000121568_31121408.pth [2023-12-26 00:33:38,986][123091] Updated weights for policy 0, policy_version 122599 (0.0007) [2023-12-26 00:33:39,050][123091] Updated weights for policy 0, policy_version 122609 (0.0005) [2023-12-26 00:33:39,105][123091] Updated weights for policy 0, policy_version 122619 (0.0006) [2023-12-26 00:33:39,277][123090] Updated weights for policy 1, policy_version 122022 (0.0010) [2023-12-26 00:33:39,353][123090] Updated weights for policy 1, policy_version 122032 (0.0008) [2023-12-26 00:33:39,431][123090] Updated weights for policy 1, policy_version 122042 (0.0012) [2023-12-26 00:33:39,900][123091] Updated weights for policy 0, policy_version 122629 (0.0007) [2023-12-26 00:33:39,968][123091] Updated weights for policy 0, policy_version 122639 (0.0008) [2023-12-26 00:33:40,037][123091] Updated weights for policy 0, policy_version 122649 (0.0009) [2023-12-26 00:33:40,245][123090] Updated weights for policy 1, policy_version 122052 (0.0011) [2023-12-26 00:33:40,297][123090] Updated weights for policy 1, policy_version 122062 (0.0010) [2023-12-26 00:33:40,364][123090] Updated weights for policy 1, policy_version 122072 (0.0011) [2023-12-26 00:33:40,878][123091] Updated weights for policy 0, policy_version 122659 (0.0008) [2023-12-26 00:33:40,937][123091] Updated weights for policy 0, policy_version 122669 (0.0007) [2023-12-26 00:33:41,000][123091] Updated weights for policy 0, policy_version 122679 (0.0007) [2023-12-26 00:33:41,194][123090] Updated weights for policy 1, policy_version 122082 (0.0010) [2023-12-26 00:33:41,270][123090] Updated weights for policy 1, policy_version 122092 (0.0006) [2023-12-26 00:33:41,336][123090] Updated weights for policy 1, policy_version 122102 (0.0008) [2023-12-26 00:33:41,407][123090] Updated weights for policy 1, policy_version 122112 (0.0007) [2023-12-26 00:33:41,835][123091] Updated weights for policy 0, policy_version 122689 (0.0009) [2023-12-26 00:33:41,888][123091] Updated weights for policy 0, policy_version 122699 (0.0009) [2023-12-26 00:33:41,946][123091] Updated weights for policy 0, policy_version 122709 (0.0009) [2023-12-26 00:33:42,000][123091] Updated weights for policy 0, policy_version 122719 (0.0009) [2023-12-26 00:33:42,132][123090] Updated weights for policy 1, policy_version 122122 (0.0010) [2023-12-26 00:33:42,181][123090] Updated weights for policy 1, policy_version 122132 (0.0011) [2023-12-26 00:33:42,233][123090] Updated weights for policy 1, policy_version 122142 (0.0010) [2023-12-26 00:33:42,848][123091] Updated weights for policy 0, policy_version 122729 (0.0011) [2023-12-26 00:33:42,915][123091] Updated weights for policy 0, policy_version 122739 (0.0011) [2023-12-26 00:33:42,982][123091] Updated weights for policy 0, policy_version 122749 (0.0011) [2023-12-26 00:33:43,086][123090] Updated weights for policy 1, policy_version 122152 (0.0007) [2023-12-26 00:33:43,150][123090] Updated weights for policy 1, policy_version 122162 (0.0007) [2023-12-26 00:33:43,221][123090] Updated weights for policy 1, policy_version 122172 (0.0010) [2023-12-26 00:33:43,693][123091] Updated weights for policy 0, policy_version 122759 (0.0007) [2023-12-26 00:33:43,757][123091] Updated weights for policy 0, policy_version 122769 (0.0005) [2023-12-26 00:33:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 62701568. Throughput: 0: 8790.8, 1: 8764.6. Samples: 62699452. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:43,785][121949] Avg episode reward: [(0, '5276.183'), (1, '5682.035')] [2023-12-26 00:33:43,815][123091] Updated weights for policy 0, policy_version 122779 (0.0005) [2023-12-26 00:33:44,010][123090] Updated weights for policy 1, policy_version 122182 (0.0010) [2023-12-26 00:33:44,075][123090] Updated weights for policy 1, policy_version 122192 (0.0010) [2023-12-26 00:33:44,130][123090] Updated weights for policy 1, policy_version 122202 (0.0009) [2023-12-26 00:33:44,550][123091] Updated weights for policy 0, policy_version 122789 (0.0007) [2023-12-26 00:33:44,604][123091] Updated weights for policy 0, policy_version 122799 (0.0009) [2023-12-26 00:33:44,658][123091] Updated weights for policy 0, policy_version 122809 (0.0010) [2023-12-26 00:33:44,967][123090] Updated weights for policy 1, policy_version 122212 (0.0009) [2023-12-26 00:33:45,036][123090] Updated weights for policy 1, policy_version 122222 (0.0009) [2023-12-26 00:33:45,108][123090] Updated weights for policy 1, policy_version 122232 (0.0009) [2023-12-26 00:33:45,465][123091] Updated weights for policy 0, policy_version 122819 (0.0008) [2023-12-26 00:33:45,530][123091] Updated weights for policy 0, policy_version 122829 (0.0005) [2023-12-26 00:33:45,599][123091] Updated weights for policy 0, policy_version 122839 (0.0005) [2023-12-26 00:33:46,009][123090] Updated weights for policy 1, policy_version 122242 (0.0010) [2023-12-26 00:33:46,063][123090] Updated weights for policy 1, policy_version 122252 (0.0010) [2023-12-26 00:33:46,113][123090] Updated weights for policy 1, policy_version 122262 (0.0008) [2023-12-26 00:33:46,160][123090] Updated weights for policy 1, policy_version 122272 (0.0008) [2023-12-26 00:33:46,309][123091] Updated weights for policy 0, policy_version 122849 (0.0006) [2023-12-26 00:33:46,367][123091] Updated weights for policy 0, policy_version 122859 (0.0008) [2023-12-26 00:33:46,426][123091] Updated weights for policy 0, policy_version 122869 (0.0005) [2023-12-26 00:33:46,499][123091] Updated weights for policy 0, policy_version 122879 (0.0005) [2023-12-26 00:33:47,075][123090] Updated weights for policy 1, policy_version 122282 (0.0010) [2023-12-26 00:33:47,129][123090] Updated weights for policy 1, policy_version 122292 (0.0009) [2023-12-26 00:33:47,170][123091] Updated weights for policy 0, policy_version 122889 (0.0007) [2023-12-26 00:33:47,186][123090] Updated weights for policy 1, policy_version 122303 (0.0008) [2023-12-26 00:33:47,234][123091] Updated weights for policy 0, policy_version 122899 (0.0006) [2023-12-26 00:33:47,290][123091] Updated weights for policy 0, policy_version 122909 (0.0006) [2023-12-26 00:33:48,017][123091] Updated weights for policy 0, policy_version 122919 (0.0006) [2023-12-26 00:33:48,078][123091] Updated weights for policy 0, policy_version 122929 (0.0006) [2023-12-26 00:33:48,091][123090] Updated weights for policy 1, policy_version 122313 (0.0005) [2023-12-26 00:33:48,131][123091] Updated weights for policy 0, policy_version 122939 (0.0007) [2023-12-26 00:33:48,150][123090] Updated weights for policy 1, policy_version 122323 (0.0008) [2023-12-26 00:33:48,208][123090] Updated weights for policy 1, policy_version 122333 (0.0005) [2023-12-26 00:33:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 62791680. Throughput: 0: 8888.7, 1: 8737.8. Samples: 62805896. Policy #0 lag: (min: 18.0, avg: 23.6, max: 50.0) [2023-12-26 00:33:48,786][121949] Avg episode reward: [(0, '5360.348'), (1, '5732.058')] [2023-12-26 00:33:48,918][123091] Updated weights for policy 0, policy_version 122949 (0.0008) [2023-12-26 00:33:48,984][123090] Updated weights for policy 1, policy_version 122343 (0.0007) [2023-12-26 00:33:48,984][123091] Updated weights for policy 0, policy_version 122959 (0.0011) [2023-12-26 00:33:49,045][123090] Updated weights for policy 1, policy_version 122353 (0.0008) [2023-12-26 00:33:49,055][123091] Updated weights for policy 0, policy_version 122969 (0.0011) [2023-12-26 00:33:49,101][123090] Updated weights for policy 1, policy_version 122363 (0.0007) [2023-12-26 00:33:49,846][123090] Updated weights for policy 1, policy_version 122373 (0.0008) [2023-12-26 00:33:49,889][123091] Updated weights for policy 0, policy_version 122979 (0.0011) [2023-12-26 00:33:49,906][123090] Updated weights for policy 1, policy_version 122383 (0.0011) [2023-12-26 00:33:49,952][123091] Updated weights for policy 0, policy_version 122989 (0.0011) [2023-12-26 00:33:49,974][123090] Updated weights for policy 1, policy_version 122393 (0.0011) [2023-12-26 00:33:50,017][123091] Updated weights for policy 0, policy_version 122999 (0.0011) [2023-12-26 00:33:50,798][123090] Updated weights for policy 1, policy_version 122403 (0.0011) [2023-12-26 00:33:50,843][123091] Updated weights for policy 0, policy_version 123009 (0.0010) [2023-12-26 00:33:50,854][123090] Updated weights for policy 1, policy_version 122413 (0.0010) [2023-12-26 00:33:50,895][123091] Updated weights for policy 0, policy_version 123019 (0.0006) [2023-12-26 00:33:50,906][123090] Updated weights for policy 1, policy_version 122423 (0.0010) [2023-12-26 00:33:50,949][123091] Updated weights for policy 0, policy_version 123029 (0.0008) [2023-12-26 00:33:51,011][123091] Updated weights for policy 0, policy_version 123039 (0.0008) [2023-12-26 00:33:51,698][123090] Updated weights for policy 1, policy_version 122433 (0.0010) [2023-12-26 00:33:51,770][123090] Updated weights for policy 1, policy_version 122443 (0.0008) [2023-12-26 00:33:51,832][123090] Updated weights for policy 1, policy_version 122453 (0.0006) [2023-12-26 00:33:51,891][123090] Updated weights for policy 1, policy_version 122463 (0.0007) [2023-12-26 00:33:51,956][123091] Updated weights for policy 0, policy_version 123049 (0.0010) [2023-12-26 00:33:52,012][123091] Updated weights for policy 0, policy_version 123059 (0.0010) [2023-12-26 00:33:52,068][123091] Updated weights for policy 0, policy_version 123069 (0.0010) [2023-12-26 00:33:52,624][123090] Updated weights for policy 1, policy_version 122473 (0.0007) [2023-12-26 00:33:52,691][123090] Updated weights for policy 1, policy_version 122483 (0.0005) [2023-12-26 00:33:52,747][123090] Updated weights for policy 1, policy_version 122493 (0.0006) [2023-12-26 00:33:52,994][123091] Updated weights for policy 0, policy_version 123079 (0.0010) [2023-12-26 00:33:53,054][123091] Updated weights for policy 0, policy_version 123089 (0.0010) [2023-12-26 00:33:53,110][123091] Updated weights for policy 0, policy_version 123099 (0.0009) [2023-12-26 00:33:53,469][123090] Updated weights for policy 1, policy_version 122503 (0.0005) [2023-12-26 00:33:53,527][123090] Updated weights for policy 1, policy_version 122513 (0.0006) [2023-12-26 00:33:53,579][123090] Updated weights for policy 1, policy_version 122523 (0.0006) [2023-12-26 00:33:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 62881792. Throughput: 0: 8841.6, 1: 8759.6. Samples: 62857840. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:33:53,785][121949] Avg episode reward: [(0, '5440.636'), (1, '5729.283')] [2023-12-26 00:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000123104_31514624.pth... [2023-12-26 00:33:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000122528_31367168.pth... [2023-12-26 00:33:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000122080_31252480.pth [2023-12-26 00:33:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000123104_31514624.pth [2023-12-26 00:33:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000121504_31105024.pth [2023-12-26 00:33:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000122528_31367168.pth [2023-12-26 00:33:53,921][123091] Updated weights for policy 0, policy_version 123109 (0.0009) [2023-12-26 00:33:53,973][123091] Updated weights for policy 0, policy_version 123119 (0.0010) [2023-12-26 00:33:54,032][123091] Updated weights for policy 0, policy_version 123129 (0.0011) [2023-12-26 00:33:54,377][123090] Updated weights for policy 1, policy_version 122533 (0.0008) [2023-12-26 00:33:54,429][123090] Updated weights for policy 1, policy_version 122543 (0.0010) [2023-12-26 00:33:54,492][123090] Updated weights for policy 1, policy_version 122553 (0.0009) [2023-12-26 00:33:54,851][123091] Updated weights for policy 0, policy_version 123139 (0.0010) [2023-12-26 00:33:54,920][123091] Updated weights for policy 0, policy_version 123149 (0.0011) [2023-12-26 00:33:54,973][123091] Updated weights for policy 0, policy_version 123159 (0.0011) [2023-12-26 00:33:55,278][123090] Updated weights for policy 1, policy_version 122563 (0.0009) [2023-12-26 00:33:55,337][123090] Updated weights for policy 1, policy_version 122573 (0.0008) [2023-12-26 00:33:55,399][123090] Updated weights for policy 1, policy_version 122583 (0.0005) [2023-12-26 00:33:55,773][123091] Updated weights for policy 0, policy_version 123169 (0.0010) [2023-12-26 00:33:55,825][123091] Updated weights for policy 0, policy_version 123179 (0.0005) [2023-12-26 00:33:55,871][123091] Updated weights for policy 0, policy_version 123189 (0.0005) [2023-12-26 00:33:55,916][123091] Updated weights for policy 0, policy_version 123199 (0.0005) [2023-12-26 00:33:56,042][123090] Updated weights for policy 1, policy_version 122593 (0.0005) [2023-12-26 00:33:56,102][123090] Updated weights for policy 1, policy_version 122603 (0.0005) [2023-12-26 00:33:56,174][123090] Updated weights for policy 1, policy_version 122613 (0.0005) [2023-12-26 00:33:56,242][123090] Updated weights for policy 1, policy_version 122623 (0.0005) [2023-12-26 00:33:56,663][123091] Updated weights for policy 0, policy_version 123209 (0.0010) [2023-12-26 00:33:56,727][123091] Updated weights for policy 0, policy_version 123219 (0.0010) [2023-12-26 00:33:56,777][123091] Updated weights for policy 0, policy_version 123229 (0.0007) [2023-12-26 00:33:56,856][123090] Updated weights for policy 1, policy_version 122633 (0.0005) [2023-12-26 00:33:56,910][123090] Updated weights for policy 1, policy_version 122643 (0.0005) [2023-12-26 00:33:56,959][123090] Updated weights for policy 1, policy_version 122653 (0.0005) [2023-12-26 00:33:57,454][123091] Updated weights for policy 0, policy_version 123239 (0.0009) [2023-12-26 00:33:57,504][123091] Updated weights for policy 0, policy_version 123249 (0.0010) [2023-12-26 00:33:57,554][123091] Updated weights for policy 0, policy_version 123259 (0.0010) [2023-12-26 00:33:57,689][123090] Updated weights for policy 1, policy_version 122663 (0.0009) [2023-12-26 00:33:57,744][123090] Updated weights for policy 1, policy_version 122673 (0.0010) [2023-12-26 00:33:57,798][123090] Updated weights for policy 1, policy_version 122683 (0.0010) [2023-12-26 00:33:58,398][123091] Updated weights for policy 0, policy_version 123269 (0.0010) [2023-12-26 00:33:58,466][123091] Updated weights for policy 0, policy_version 123279 (0.0010) [2023-12-26 00:33:58,525][123091] Updated weights for policy 0, policy_version 123289 (0.0011) [2023-12-26 00:33:58,646][123090] Updated weights for policy 1, policy_version 122693 (0.0010) [2023-12-26 00:33:58,723][123090] Updated weights for policy 1, policy_version 122703 (0.0010) [2023-12-26 00:33:58,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 62971904. Throughput: 0: 8849.2, 1: 8929.8. Samples: 62968588. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:33:58,784][121949] Avg episode reward: [(0, '5315.687'), (1, '5787.714')] [2023-12-26 00:33:58,803][123090] Updated weights for policy 1, policy_version 122713 (0.0010) [2023-12-26 00:33:59,499][123091] Updated weights for policy 0, policy_version 123299 (0.0010) [2023-12-26 00:33:59,558][123090] Updated weights for policy 1, policy_version 122723 (0.0009) [2023-12-26 00:33:59,561][123091] Updated weights for policy 0, policy_version 123309 (0.0007) [2023-12-26 00:33:59,618][123090] Updated weights for policy 1, policy_version 122733 (0.0010) [2023-12-26 00:33:59,620][123091] Updated weights for policy 0, policy_version 123319 (0.0005) [2023-12-26 00:33:59,684][123090] Updated weights for policy 1, policy_version 122743 (0.0010) [2023-12-26 00:34:00,307][123091] Updated weights for policy 0, policy_version 123329 (0.0006) [2023-12-26 00:34:00,360][123091] Updated weights for policy 0, policy_version 123339 (0.0010) [2023-12-26 00:34:00,407][123091] Updated weights for policy 0, policy_version 123349 (0.0010) [2023-12-26 00:34:00,457][123091] Updated weights for policy 0, policy_version 123359 (0.0010) [2023-12-26 00:34:00,506][123090] Updated weights for policy 1, policy_version 122753 (0.0010) [2023-12-26 00:34:00,556][123090] Updated weights for policy 1, policy_version 122763 (0.0010) [2023-12-26 00:34:00,605][123090] Updated weights for policy 1, policy_version 122773 (0.0010) [2023-12-26 00:34:00,675][123090] Updated weights for policy 1, policy_version 122783 (0.0008) [2023-12-26 00:34:01,344][123091] Updated weights for policy 0, policy_version 123369 (0.0010) [2023-12-26 00:34:01,408][123091] Updated weights for policy 0, policy_version 123379 (0.0009) [2023-12-26 00:34:01,428][123090] Updated weights for policy 1, policy_version 122793 (0.0008) [2023-12-26 00:34:01,466][123091] Updated weights for policy 0, policy_version 123389 (0.0009) [2023-12-26 00:34:01,484][123090] Updated weights for policy 1, policy_version 122803 (0.0009) [2023-12-26 00:34:01,545][123090] Updated weights for policy 1, policy_version 122813 (0.0009) [2023-12-26 00:34:02,292][123091] Updated weights for policy 0, policy_version 123399 (0.0009) [2023-12-26 00:34:02,350][123091] Updated weights for policy 0, policy_version 123409 (0.0009) [2023-12-26 00:34:02,395][123090] Updated weights for policy 1, policy_version 122823 (0.0010) [2023-12-26 00:34:02,418][123091] Updated weights for policy 0, policy_version 123419 (0.0008) [2023-12-26 00:34:02,458][123090] Updated weights for policy 1, policy_version 122833 (0.0011) [2023-12-26 00:34:02,521][123090] Updated weights for policy 1, policy_version 122843 (0.0010) [2023-12-26 00:34:03,263][123091] Updated weights for policy 0, policy_version 123429 (0.0009) [2023-12-26 00:34:03,310][123091] Updated weights for policy 0, policy_version 123439 (0.0009) [2023-12-26 00:34:03,357][123091] Updated weights for policy 0, policy_version 123449 (0.0009) [2023-12-26 00:34:03,364][123090] Updated weights for policy 1, policy_version 122853 (0.0011) [2023-12-26 00:34:03,429][123090] Updated weights for policy 1, policy_version 122863 (0.0010) [2023-12-26 00:34:03,495][123090] Updated weights for policy 1, policy_version 122873 (0.0010) [2023-12-26 00:34:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 63062016. Throughput: 0: 8813.7, 1: 8835.4. Samples: 63070692. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:03,785][121949] Avg episode reward: [(0, '5338.220'), (1, '5804.552')] [2023-12-26 00:34:04,230][123091] Updated weights for policy 0, policy_version 123459 (0.0006) [2023-12-26 00:34:04,293][123091] Updated weights for policy 0, policy_version 123469 (0.0008) [2023-12-26 00:34:04,303][123090] Updated weights for policy 1, policy_version 122883 (0.0010) [2023-12-26 00:34:04,357][123091] Updated weights for policy 0, policy_version 123479 (0.0006) [2023-12-26 00:34:04,366][123090] Updated weights for policy 1, policy_version 122893 (0.0010) [2023-12-26 00:34:04,429][123090] Updated weights for policy 1, policy_version 122903 (0.0010) [2023-12-26 00:34:05,179][123091] Updated weights for policy 0, policy_version 123489 (0.0008) [2023-12-26 00:34:05,241][123091] Updated weights for policy 0, policy_version 123499 (0.0010) [2023-12-26 00:34:05,252][123090] Updated weights for policy 1, policy_version 122913 (0.0010) [2023-12-26 00:34:05,308][123091] Updated weights for policy 0, policy_version 123509 (0.0008) [2023-12-26 00:34:05,330][123090] Updated weights for policy 1, policy_version 122923 (0.0005) [2023-12-26 00:34:05,376][123091] Updated weights for policy 0, policy_version 123519 (0.0008) [2023-12-26 00:34:05,402][123090] Updated weights for policy 1, policy_version 122933 (0.0008) [2023-12-26 00:34:05,463][123090] Updated weights for policy 1, policy_version 122943 (0.0010) [2023-12-26 00:34:06,229][123091] Updated weights for policy 0, policy_version 123529 (0.0007) [2023-12-26 00:34:06,240][123090] Updated weights for policy 1, policy_version 122953 (0.0010) [2023-12-26 00:34:06,288][123090] Updated weights for policy 1, policy_version 122963 (0.0010) [2023-12-26 00:34:06,295][123091] Updated weights for policy 0, policy_version 123539 (0.0008) [2023-12-26 00:34:06,356][123090] Updated weights for policy 1, policy_version 122973 (0.0010) [2023-12-26 00:34:06,363][123091] Updated weights for policy 0, policy_version 123549 (0.0006) [2023-12-26 00:34:07,191][123091] Updated weights for policy 0, policy_version 123559 (0.0008) [2023-12-26 00:34:07,209][123090] Updated weights for policy 1, policy_version 122983 (0.0010) [2023-12-26 00:34:07,245][123091] Updated weights for policy 0, policy_version 123569 (0.0009) [2023-12-26 00:34:07,276][123090] Updated weights for policy 1, policy_version 122993 (0.0011) [2023-12-26 00:34:07,298][123091] Updated weights for policy 0, policy_version 123579 (0.0010) [2023-12-26 00:34:07,339][123090] Updated weights for policy 1, policy_version 123003 (0.0010) [2023-12-26 00:34:08,124][123090] Updated weights for policy 1, policy_version 123013 (0.0009) [2023-12-26 00:34:08,156][123091] Updated weights for policy 0, policy_version 123589 (0.0007) [2023-12-26 00:34:08,183][123090] Updated weights for policy 1, policy_version 123023 (0.0010) [2023-12-26 00:34:08,209][123091] Updated weights for policy 0, policy_version 123599 (0.0008) [2023-12-26 00:34:08,239][123090] Updated weights for policy 1, policy_version 123033 (0.0010) [2023-12-26 00:34:08,255][123091] Updated weights for policy 0, policy_version 123609 (0.0008) [2023-12-26 00:34:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 63143936. Throughput: 0: 8824.2, 1: 8833.5. Samples: 63121688. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:08,785][121949] Avg episode reward: [(0, '5363.367'), (1, '5694.759')] [2023-12-26 00:34:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000123616_31645696.pth... [2023-12-26 00:34:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000123040_31498240.pth... [2023-12-26 00:34:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000122592_31383552.pth [2023-12-26 00:34:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000122016_31236096.pth [2023-12-26 00:34:08,987][123090] Updated weights for policy 1, policy_version 123043 (0.0009) [2023-12-26 00:34:09,058][123090] Updated weights for policy 1, policy_version 123053 (0.0006) [2023-12-26 00:34:09,130][123091] Updated weights for policy 0, policy_version 123619 (0.0008) [2023-12-26 00:34:09,133][123090] Updated weights for policy 1, policy_version 123063 (0.0006) [2023-12-26 00:34:09,189][123091] Updated weights for policy 0, policy_version 123629 (0.0008) [2023-12-26 00:34:09,253][123091] Updated weights for policy 0, policy_version 123639 (0.0009) [2023-12-26 00:34:09,914][123090] Updated weights for policy 1, policy_version 123073 (0.0006) [2023-12-26 00:34:09,990][123090] Updated weights for policy 1, policy_version 123083 (0.0011) [2023-12-26 00:34:10,057][123090] Updated weights for policy 1, policy_version 123093 (0.0011) [2023-12-26 00:34:10,117][123091] Updated weights for policy 0, policy_version 123649 (0.0008) [2023-12-26 00:34:10,132][123090] Updated weights for policy 1, policy_version 123103 (0.0011) [2023-12-26 00:34:10,173][123091] Updated weights for policy 0, policy_version 123659 (0.0007) [2023-12-26 00:34:10,234][123091] Updated weights for policy 0, policy_version 123669 (0.0009) [2023-12-26 00:34:10,299][123091] Updated weights for policy 0, policy_version 123679 (0.0007) [2023-12-26 00:34:10,933][123090] Updated weights for policy 1, policy_version 123113 (0.0010) [2023-12-26 00:34:10,995][123090] Updated weights for policy 1, policy_version 123123 (0.0010) [2023-12-26 00:34:11,067][123090] Updated weights for policy 1, policy_version 123133 (0.0010) [2023-12-26 00:34:11,097][123091] Updated weights for policy 0, policy_version 123689 (0.0008) [2023-12-26 00:34:11,175][123091] Updated weights for policy 0, policy_version 123699 (0.0011) [2023-12-26 00:34:11,238][123091] Updated weights for policy 0, policy_version 123709 (0.0006) [2023-12-26 00:34:11,892][123090] Updated weights for policy 1, policy_version 123143 (0.0009) [2023-12-26 00:34:11,945][123090] Updated weights for policy 1, policy_version 123153 (0.0009) [2023-12-26 00:34:11,999][123090] Updated weights for policy 1, policy_version 123163 (0.0009) [2023-12-26 00:34:12,041][123091] Updated weights for policy 0, policy_version 123719 (0.0009) [2023-12-26 00:34:12,102][123091] Updated weights for policy 0, policy_version 123729 (0.0009) [2023-12-26 00:34:12,160][123091] Updated weights for policy 0, policy_version 123739 (0.0009) [2023-12-26 00:34:12,922][123090] Updated weights for policy 1, policy_version 123173 (0.0008) [2023-12-26 00:34:12,940][123091] Updated weights for policy 0, policy_version 123749 (0.0009) [2023-12-26 00:34:12,988][123090] Updated weights for policy 1, policy_version 123183 (0.0009) [2023-12-26 00:34:13,008][123091] Updated weights for policy 0, policy_version 123759 (0.0006) [2023-12-26 00:34:13,046][123090] Updated weights for policy 1, policy_version 123193 (0.0008) [2023-12-26 00:34:13,067][123091] Updated weights for policy 0, policy_version 123769 (0.0009) [2023-12-26 00:34:13,783][123091] Updated weights for policy 0, policy_version 123779 (0.0009) [2023-12-26 00:34:13,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 63225856. Throughput: 0: 8778.6, 1: 8820.5. Samples: 63224184. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:13,784][121949] Avg episode reward: [(0, '5357.336'), (1, '5585.735')] [2023-12-26 00:34:13,834][123091] Updated weights for policy 0, policy_version 123789 (0.0008) [2023-12-26 00:34:13,883][123091] Updated weights for policy 0, policy_version 123799 (0.0009) [2023-12-26 00:34:13,917][123090] Updated weights for policy 1, policy_version 123203 (0.0007) [2023-12-26 00:34:13,970][123090] Updated weights for policy 1, policy_version 123213 (0.0009) [2023-12-26 00:34:14,024][123090] Updated weights for policy 1, policy_version 123224 (0.0009) [2023-12-26 00:34:14,769][123091] Updated weights for policy 0, policy_version 123810 (0.0011) [2023-12-26 00:34:14,776][123090] Updated weights for policy 1, policy_version 123234 (0.0008) [2023-12-26 00:34:14,823][123091] Updated weights for policy 0, policy_version 123820 (0.0005) [2023-12-26 00:34:14,833][123090] Updated weights for policy 1, policy_version 123244 (0.0007) [2023-12-26 00:34:14,888][123091] Updated weights for policy 0, policy_version 123830 (0.0009) [2023-12-26 00:34:14,895][123090] Updated weights for policy 1, policy_version 123254 (0.0005) [2023-12-26 00:34:14,947][123091] Updated weights for policy 0, policy_version 123840 (0.0008) [2023-12-26 00:34:14,950][123090] Updated weights for policy 1, policy_version 123264 (0.0007) [2023-12-26 00:34:15,656][123090] Updated weights for policy 1, policy_version 123274 (0.0010) [2023-12-26 00:34:15,708][123090] Updated weights for policy 1, policy_version 123284 (0.0006) [2023-12-26 00:34:15,759][123090] Updated weights for policy 1, policy_version 123294 (0.0009) [2023-12-26 00:34:15,762][123091] Updated weights for policy 0, policy_version 123850 (0.0006) [2023-12-26 00:34:15,808][123091] Updated weights for policy 0, policy_version 123860 (0.0005) [2023-12-26 00:34:15,853][123091] Updated weights for policy 0, policy_version 123870 (0.0005) [2023-12-26 00:34:16,523][123091] Updated weights for policy 0, policy_version 123880 (0.0006) [2023-12-26 00:34:16,539][123090] Updated weights for policy 1, policy_version 123304 (0.0011) [2023-12-26 00:34:16,585][123091] Updated weights for policy 0, policy_version 123890 (0.0007) [2023-12-26 00:34:16,595][123090] Updated weights for policy 1, policy_version 123314 (0.0010) [2023-12-26 00:34:16,648][123091] Updated weights for policy 0, policy_version 123900 (0.0006) [2023-12-26 00:34:16,658][123090] Updated weights for policy 1, policy_version 123324 (0.0010) [2023-12-26 00:34:17,324][123090] Updated weights for policy 1, policy_version 123334 (0.0007) [2023-12-26 00:34:17,373][123090] Updated weights for policy 1, policy_version 123344 (0.0005) [2023-12-26 00:34:17,421][123090] Updated weights for policy 1, policy_version 123354 (0.0005) [2023-12-26 00:34:17,504][123091] Updated weights for policy 0, policy_version 123910 (0.0008) [2023-12-26 00:34:17,559][123091] Updated weights for policy 0, policy_version 123922 (0.0011) [2023-12-26 00:34:17,614][123091] Updated weights for policy 0, policy_version 123932 (0.0011) [2023-12-26 00:34:18,064][123090] Updated weights for policy 1, policy_version 123364 (0.0007) [2023-12-26 00:34:18,119][123090] Updated weights for policy 1, policy_version 123374 (0.0010) [2023-12-26 00:34:18,190][123090] Updated weights for policy 1, policy_version 123384 (0.0011) [2023-12-26 00:34:18,529][123091] Updated weights for policy 0, policy_version 123942 (0.0009) [2023-12-26 00:34:18,592][123091] Updated weights for policy 0, policy_version 123952 (0.0007) [2023-12-26 00:34:18,651][123091] Updated weights for policy 0, policy_version 123962 (0.0007) [2023-12-26 00:34:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 63324160. Throughput: 0: 8784.4, 1: 8837.7. Samples: 63333764. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:18,785][121949] Avg episode reward: [(0, '5471.022'), (1, '5607.114')] [2023-12-26 00:34:18,786][123007] Saving new best policy, reward=5471.022! [2023-12-26 00:34:19,008][123090] Updated weights for policy 1, policy_version 123394 (0.0010) [2023-12-26 00:34:19,064][123090] Updated weights for policy 1, policy_version 123404 (0.0011) [2023-12-26 00:34:19,116][123090] Updated weights for policy 1, policy_version 123414 (0.0011) [2023-12-26 00:34:19,173][123090] Updated weights for policy 1, policy_version 123424 (0.0011) [2023-12-26 00:34:19,490][123091] Updated weights for policy 0, policy_version 123972 (0.0008) [2023-12-26 00:34:19,565][123091] Updated weights for policy 0, policy_version 123982 (0.0007) [2023-12-26 00:34:19,637][123091] Updated weights for policy 0, policy_version 123992 (0.0007) [2023-12-26 00:34:20,060][123090] Updated weights for policy 1, policy_version 123434 (0.0010) [2023-12-26 00:34:20,128][123090] Updated weights for policy 1, policy_version 123444 (0.0009) [2023-12-26 00:34:20,195][123090] Updated weights for policy 1, policy_version 123454 (0.0009) [2023-12-26 00:34:20,380][123091] Updated weights for policy 0, policy_version 124002 (0.0009) [2023-12-26 00:34:20,438][123091] Updated weights for policy 0, policy_version 124012 (0.0009) [2023-12-26 00:34:20,491][123091] Updated weights for policy 0, policy_version 124022 (0.0010) [2023-12-26 00:34:20,550][123091] Updated weights for policy 0, policy_version 124032 (0.0008) [2023-12-26 00:34:21,088][123090] Updated weights for policy 1, policy_version 123464 (0.0010) [2023-12-26 00:34:21,156][123090] Updated weights for policy 1, policy_version 123474 (0.0008) [2023-12-26 00:34:21,219][123090] Updated weights for policy 1, policy_version 123484 (0.0009) [2023-12-26 00:34:21,381][123091] Updated weights for policy 0, policy_version 124042 (0.0010) [2023-12-26 00:34:21,442][123091] Updated weights for policy 0, policy_version 124052 (0.0009) [2023-12-26 00:34:21,505][123091] Updated weights for policy 0, policy_version 124062 (0.0010) [2023-12-26 00:34:22,033][123090] Updated weights for policy 1, policy_version 123494 (0.0009) [2023-12-26 00:34:22,097][123090] Updated weights for policy 1, policy_version 123504 (0.0008) [2023-12-26 00:34:22,155][123090] Updated weights for policy 1, policy_version 123514 (0.0009) [2023-12-26 00:34:22,370][123091] Updated weights for policy 0, policy_version 124072 (0.0009) [2023-12-26 00:34:22,428][123091] Updated weights for policy 0, policy_version 124082 (0.0010) [2023-12-26 00:34:22,492][123091] Updated weights for policy 0, policy_version 124092 (0.0010) [2023-12-26 00:34:23,054][123090] Updated weights for policy 1, policy_version 123524 (0.0010) [2023-12-26 00:34:23,123][123090] Updated weights for policy 1, policy_version 123534 (0.0009) [2023-12-26 00:34:23,176][123090] Updated weights for policy 1, policy_version 123544 (0.0009) [2023-12-26 00:34:23,228][123091] Updated weights for policy 0, policy_version 124102 (0.0009) [2023-12-26 00:34:23,280][123091] Updated weights for policy 0, policy_version 124112 (0.0011) [2023-12-26 00:34:23,328][123091] Updated weights for policy 0, policy_version 124122 (0.0010) [2023-12-26 00:34:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 63406080. Throughput: 0: 8739.3, 1: 8830.5. Samples: 63384184. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:23,786][121949] Avg episode reward: [(0, '5521.721'), (1, '5555.434')] [2023-12-26 00:34:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000124128_31776768.pth... [2023-12-26 00:34:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000123552_31629312.pth... [2023-12-26 00:34:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000123104_31514624.pth [2023-12-26 00:34:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000122528_31367168.pth [2023-12-26 00:34:23,803][123007] Saving new best policy, reward=5521.721! [2023-12-26 00:34:23,885][123090] Updated weights for policy 1, policy_version 123554 (0.0005) [2023-12-26 00:34:23,939][123090] Updated weights for policy 1, policy_version 123564 (0.0005) [2023-12-26 00:34:23,986][123090] Updated weights for policy 1, policy_version 123574 (0.0005) [2023-12-26 00:34:24,038][123090] Updated weights for policy 1, policy_version 123584 (0.0005) [2023-12-26 00:34:24,149][123091] Updated weights for policy 0, policy_version 124132 (0.0010) [2023-12-26 00:34:24,216][123091] Updated weights for policy 0, policy_version 124142 (0.0008) [2023-12-26 00:34:24,274][123091] Updated weights for policy 0, policy_version 124152 (0.0010) [2023-12-26 00:34:24,823][123090] Updated weights for policy 1, policy_version 123594 (0.0010) [2023-12-26 00:34:24,883][123090] Updated weights for policy 1, policy_version 123604 (0.0010) [2023-12-26 00:34:24,936][123090] Updated weights for policy 1, policy_version 123614 (0.0009) [2023-12-26 00:34:25,030][123091] Updated weights for policy 0, policy_version 124162 (0.0010) [2023-12-26 00:34:25,085][123091] Updated weights for policy 0, policy_version 124172 (0.0009) [2023-12-26 00:34:25,143][123091] Updated weights for policy 0, policy_version 124182 (0.0009) [2023-12-26 00:34:25,204][123091] Updated weights for policy 0, policy_version 124192 (0.0010) [2023-12-26 00:34:25,807][123090] Updated weights for policy 1, policy_version 123624 (0.0010) [2023-12-26 00:34:25,862][123090] Updated weights for policy 1, policy_version 123634 (0.0010) [2023-12-26 00:34:25,920][123090] Updated weights for policy 1, policy_version 123644 (0.0010) [2023-12-26 00:34:26,030][123091] Updated weights for policy 0, policy_version 124202 (0.0007) [2023-12-26 00:34:26,080][123091] Updated weights for policy 0, policy_version 124212 (0.0005) [2023-12-26 00:34:26,127][123091] Updated weights for policy 0, policy_version 124222 (0.0005) [2023-12-26 00:34:26,676][123090] Updated weights for policy 1, policy_version 123654 (0.0009) [2023-12-26 00:34:26,735][123090] Updated weights for policy 1, policy_version 123664 (0.0007) [2023-12-26 00:34:26,758][123091] Updated weights for policy 0, policy_version 124232 (0.0007) [2023-12-26 00:34:26,790][123090] Updated weights for policy 1, policy_version 123674 (0.0008) [2023-12-26 00:34:26,810][123091] Updated weights for policy 0, policy_version 124242 (0.0008) [2023-12-26 00:34:26,860][123091] Updated weights for policy 0, policy_version 124252 (0.0005) [2023-12-26 00:34:27,493][123090] Updated weights for policy 1, policy_version 123684 (0.0006) [2023-12-26 00:34:27,558][123090] Updated weights for policy 1, policy_version 123694 (0.0010) [2023-12-26 00:34:27,621][123090] Updated weights for policy 1, policy_version 123704 (0.0009) [2023-12-26 00:34:27,648][123091] Updated weights for policy 0, policy_version 124262 (0.0008) [2023-12-26 00:34:27,695][123091] Updated weights for policy 0, policy_version 124272 (0.0008) [2023-12-26 00:34:27,766][123091] Updated weights for policy 0, policy_version 124282 (0.0008) [2023-12-26 00:34:28,288][123090] Updated weights for policy 1, policy_version 123714 (0.0007) [2023-12-26 00:34:28,356][123090] Updated weights for policy 1, policy_version 123724 (0.0010) [2023-12-26 00:34:28,413][123090] Updated weights for policy 1, policy_version 123734 (0.0009) [2023-12-26 00:34:28,486][123090] Updated weights for policy 1, policy_version 123744 (0.0010) [2023-12-26 00:34:28,579][123091] Updated weights for policy 0, policy_version 124292 (0.0009) [2023-12-26 00:34:28,655][123091] Updated weights for policy 0, policy_version 124302 (0.0010) [2023-12-26 00:34:28,729][123091] Updated weights for policy 0, policy_version 124312 (0.0009) [2023-12-26 00:34:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 63504384. Throughput: 0: 8785.6, 1: 8857.7. Samples: 63493400. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:28,785][121949] Avg episode reward: [(0, '5433.511'), (1, '5688.879')] [2023-12-26 00:34:29,187][123090] Updated weights for policy 1, policy_version 123754 (0.0005) [2023-12-26 00:34:29,254][123090] Updated weights for policy 1, policy_version 123764 (0.0009) [2023-12-26 00:34:29,309][123090] Updated weights for policy 1, policy_version 123774 (0.0010) [2023-12-26 00:34:29,549][123091] Updated weights for policy 0, policy_version 124322 (0.0010) [2023-12-26 00:34:29,601][123091] Updated weights for policy 0, policy_version 124332 (0.0009) [2023-12-26 00:34:29,664][123091] Updated weights for policy 0, policy_version 124342 (0.0008) [2023-12-26 00:34:29,721][123091] Updated weights for policy 0, policy_version 124352 (0.0005) [2023-12-26 00:34:30,046][123090] Updated weights for policy 1, policy_version 123784 (0.0006) [2023-12-26 00:34:30,096][123090] Updated weights for policy 1, policy_version 123794 (0.0005) [2023-12-26 00:34:30,147][123090] Updated weights for policy 1, policy_version 123804 (0.0005) [2023-12-26 00:34:30,498][123091] Updated weights for policy 0, policy_version 124362 (0.0006) [2023-12-26 00:34:30,553][123091] Updated weights for policy 0, policy_version 124372 (0.0011) [2023-12-26 00:34:30,612][123091] Updated weights for policy 0, policy_version 124382 (0.0011) [2023-12-26 00:34:30,866][123090] Updated weights for policy 1, policy_version 123814 (0.0005) [2023-12-26 00:34:30,912][123090] Updated weights for policy 1, policy_version 123824 (0.0008) [2023-12-26 00:34:30,960][123090] Updated weights for policy 1, policy_version 123834 (0.0009) [2023-12-26 00:34:31,392][123091] Updated weights for policy 0, policy_version 124392 (0.0008) [2023-12-26 00:34:31,464][123091] Updated weights for policy 0, policy_version 124402 (0.0006) [2023-12-26 00:34:31,535][123091] Updated weights for policy 0, policy_version 124412 (0.0006) [2023-12-26 00:34:31,772][123090] Updated weights for policy 1, policy_version 123844 (0.0008) [2023-12-26 00:34:31,823][123090] Updated weights for policy 1, policy_version 123854 (0.0008) [2023-12-26 00:34:31,870][123090] Updated weights for policy 1, policy_version 123864 (0.0008) [2023-12-26 00:34:32,313][123091] Updated weights for policy 0, policy_version 124422 (0.0006) [2023-12-26 00:34:32,376][123091] Updated weights for policy 0, policy_version 124432 (0.0008) [2023-12-26 00:34:32,441][123091] Updated weights for policy 0, policy_version 124442 (0.0011) [2023-12-26 00:34:32,648][123090] Updated weights for policy 1, policy_version 123874 (0.0008) [2023-12-26 00:34:32,716][123090] Updated weights for policy 1, policy_version 123884 (0.0006) [2023-12-26 00:34:32,791][123090] Updated weights for policy 1, policy_version 123894 (0.0006) [2023-12-26 00:34:32,846][123090] Updated weights for policy 1, policy_version 123904 (0.0010) [2023-12-26 00:34:33,182][123091] Updated weights for policy 0, policy_version 124452 (0.0011) [2023-12-26 00:34:33,237][123091] Updated weights for policy 0, policy_version 124462 (0.0010) [2023-12-26 00:34:33,292][123091] Updated weights for policy 0, policy_version 124472 (0.0010) [2023-12-26 00:34:33,526][123090] Updated weights for policy 1, policy_version 123914 (0.0006) [2023-12-26 00:34:33,578][123090] Updated weights for policy 1, policy_version 123924 (0.0009) [2023-12-26 00:34:33,637][123090] Updated weights for policy 1, policy_version 123934 (0.0010) [2023-12-26 00:34:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 63594496. Throughput: 0: 8691.4, 1: 9035.4. Samples: 63603600. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:33,785][121949] Avg episode reward: [(0, '5446.228'), (1, '5657.435')] [2023-12-26 00:34:34,067][123091] Updated weights for policy 0, policy_version 124482 (0.0009) [2023-12-26 00:34:34,127][123091] Updated weights for policy 0, policy_version 124492 (0.0005) [2023-12-26 00:34:34,196][123091] Updated weights for policy 0, policy_version 124502 (0.0008) [2023-12-26 00:34:34,268][123091] Updated weights for policy 0, policy_version 124512 (0.0011) [2023-12-26 00:34:34,338][123090] Updated weights for policy 1, policy_version 123944 (0.0009) [2023-12-26 00:34:34,412][123090] Updated weights for policy 1, policy_version 123954 (0.0010) [2023-12-26 00:34:34,486][123090] Updated weights for policy 1, policy_version 123964 (0.0010) [2023-12-26 00:34:34,985][123091] Updated weights for policy 0, policy_version 124522 (0.0006) [2023-12-26 00:34:35,037][123091] Updated weights for policy 0, policy_version 124532 (0.0011) [2023-12-26 00:34:35,096][123091] Updated weights for policy 0, policy_version 124542 (0.0010) [2023-12-26 00:34:35,169][123090] Updated weights for policy 1, policy_version 123974 (0.0010) [2023-12-26 00:34:35,228][123090] Updated weights for policy 1, policy_version 123984 (0.0010) [2023-12-26 00:34:35,286][123090] Updated weights for policy 1, policy_version 123994 (0.0010) [2023-12-26 00:34:35,915][123091] Updated weights for policy 0, policy_version 124552 (0.0010) [2023-12-26 00:34:35,966][123091] Updated weights for policy 0, policy_version 124562 (0.0010) [2023-12-26 00:34:36,018][123091] Updated weights for policy 0, policy_version 124572 (0.0010) [2023-12-26 00:34:36,067][123090] Updated weights for policy 1, policy_version 124004 (0.0008) [2023-12-26 00:34:36,126][123090] Updated weights for policy 1, policy_version 124014 (0.0007) [2023-12-26 00:34:36,189][123090] Updated weights for policy 1, policy_version 124024 (0.0008) [2023-12-26 00:34:36,898][123091] Updated weights for policy 0, policy_version 124582 (0.0011) [2023-12-26 00:34:36,955][123090] Updated weights for policy 1, policy_version 124034 (0.0008) [2023-12-26 00:34:36,968][123091] Updated weights for policy 0, policy_version 124592 (0.0010) [2023-12-26 00:34:37,020][123090] Updated weights for policy 1, policy_version 124044 (0.0007) [2023-12-26 00:34:37,026][123091] Updated weights for policy 0, policy_version 124602 (0.0010) [2023-12-26 00:34:37,077][123090] Updated weights for policy 1, policy_version 124054 (0.0008) [2023-12-26 00:34:37,133][123090] Updated weights for policy 1, policy_version 124064 (0.0009) [2023-12-26 00:34:37,845][123091] Updated weights for policy 0, policy_version 124612 (0.0010) [2023-12-26 00:34:37,908][123091] Updated weights for policy 0, policy_version 124622 (0.0010) [2023-12-26 00:34:37,956][123091] Updated weights for policy 0, policy_version 124632 (0.0010) [2023-12-26 00:34:37,971][123090] Updated weights for policy 1, policy_version 124074 (0.0005) [2023-12-26 00:34:38,036][123090] Updated weights for policy 1, policy_version 124084 (0.0005) [2023-12-26 00:34:38,108][123090] Updated weights for policy 1, policy_version 124094 (0.0005) [2023-12-26 00:34:38,734][123091] Updated weights for policy 0, policy_version 124642 (0.0011) [2023-12-26 00:34:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 63676416. Throughput: 0: 8747.5, 1: 9058.2. Samples: 63659096. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:38,785][121949] Avg episode reward: [(0, '5518.933'), (1, '5567.261')] [2023-12-26 00:34:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000124096_31768576.pth... [2023-12-26 00:34:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000123040_31498240.pth [2023-12-26 00:34:38,798][123091] Updated weights for policy 0, policy_version 124652 (0.0011) [2023-12-26 00:34:38,862][123091] Updated weights for policy 0, policy_version 124662 (0.0008) [2023-12-26 00:34:38,881][123090] Updated weights for policy 1, policy_version 124104 (0.0008) [2023-12-26 00:34:38,924][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000124672_31916032.pth... [2023-12-26 00:34:38,924][123091] Updated weights for policy 0, policy_version 124672 (0.0010) [2023-12-26 00:34:38,928][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000123616_31645696.pth [2023-12-26 00:34:38,946][123090] Updated weights for policy 1, policy_version 124114 (0.0010) [2023-12-26 00:34:39,010][123090] Updated weights for policy 1, policy_version 124124 (0.0009) [2023-12-26 00:34:39,695][123091] Updated weights for policy 0, policy_version 124682 (0.0011) [2023-12-26 00:34:39,765][123091] Updated weights for policy 0, policy_version 124692 (0.0009) [2023-12-26 00:34:39,832][123091] Updated weights for policy 0, policy_version 124702 (0.0008) [2023-12-26 00:34:39,919][123090] Updated weights for policy 1, policy_version 124134 (0.0009) [2023-12-26 00:34:39,988][123090] Updated weights for policy 1, policy_version 124144 (0.0009) [2023-12-26 00:34:40,050][123090] Updated weights for policy 1, policy_version 124154 (0.0008) [2023-12-26 00:34:40,641][123091] Updated weights for policy 0, policy_version 124712 (0.0009) [2023-12-26 00:34:40,691][123091] Updated weights for policy 0, policy_version 124722 (0.0009) [2023-12-26 00:34:40,746][123091] Updated weights for policy 0, policy_version 124732 (0.0009) [2023-12-26 00:34:40,889][123090] Updated weights for policy 1, policy_version 124164 (0.0010) [2023-12-26 00:34:40,954][123090] Updated weights for policy 1, policy_version 124174 (0.0009) [2023-12-26 00:34:41,019][123090] Updated weights for policy 1, policy_version 124184 (0.0009) [2023-12-26 00:34:41,631][123091] Updated weights for policy 0, policy_version 124742 (0.0010) [2023-12-26 00:34:41,693][123091] Updated weights for policy 0, policy_version 124752 (0.0009) [2023-12-26 00:34:41,760][123091] Updated weights for policy 0, policy_version 124762 (0.0008) [2023-12-26 00:34:41,899][123090] Updated weights for policy 1, policy_version 124194 (0.0008) [2023-12-26 00:34:41,963][123090] Updated weights for policy 1, policy_version 124204 (0.0010) [2023-12-26 00:34:42,018][123090] Updated weights for policy 1, policy_version 124214 (0.0009) [2023-12-26 00:34:42,085][123090] Updated weights for policy 1, policy_version 124224 (0.0009) [2023-12-26 00:34:42,603][123091] Updated weights for policy 0, policy_version 124772 (0.0008) [2023-12-26 00:34:42,661][123091] Updated weights for policy 0, policy_version 124783 (0.0009) [2023-12-26 00:34:42,716][123091] Updated weights for policy 0, policy_version 124793 (0.0009) [2023-12-26 00:34:42,952][123090] Updated weights for policy 1, policy_version 124234 (0.0010) [2023-12-26 00:34:43,014][123090] Updated weights for policy 1, policy_version 124245 (0.0010) [2023-12-26 00:34:43,069][123090] Updated weights for policy 1, policy_version 124255 (0.0010) [2023-12-26 00:34:43,541][123091] Updated weights for policy 0, policy_version 124803 (0.0009) [2023-12-26 00:34:43,603][123091] Updated weights for policy 0, policy_version 124813 (0.0009) [2023-12-26 00:34:43,667][123091] Updated weights for policy 0, policy_version 124823 (0.0009) [2023-12-26 00:34:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 63766528. Throughput: 0: 8727.9, 1: 8880.2. Samples: 63760956. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:43,785][121949] Avg episode reward: [(0, '5410.507'), (1, '5536.634')] [2023-12-26 00:34:43,900][123090] Updated weights for policy 1, policy_version 124265 (0.0006) [2023-12-26 00:34:43,971][123090] Updated weights for policy 1, policy_version 124275 (0.0010) [2023-12-26 00:34:44,034][123090] Updated weights for policy 1, policy_version 124285 (0.0009) [2023-12-26 00:34:44,300][123091] Updated weights for policy 0, policy_version 124833 (0.0008) [2023-12-26 00:34:44,360][123091] Updated weights for policy 0, policy_version 124843 (0.0008) [2023-12-26 00:34:44,413][123091] Updated weights for policy 0, policy_version 124853 (0.0008) [2023-12-26 00:34:44,458][123091] Updated weights for policy 0, policy_version 124863 (0.0008) [2023-12-26 00:34:44,697][123090] Updated weights for policy 1, policy_version 124295 (0.0005) [2023-12-26 00:34:44,756][123090] Updated weights for policy 1, policy_version 124305 (0.0006) [2023-12-26 00:34:44,822][123090] Updated weights for policy 1, policy_version 124315 (0.0008) [2023-12-26 00:34:45,271][123091] Updated weights for policy 0, policy_version 124873 (0.0006) [2023-12-26 00:34:45,341][123091] Updated weights for policy 0, policy_version 124883 (0.0006) [2023-12-26 00:34:45,398][123091] Updated weights for policy 0, policy_version 124893 (0.0010) [2023-12-26 00:34:45,583][123090] Updated weights for policy 1, policy_version 124325 (0.0008) [2023-12-26 00:34:45,644][123090] Updated weights for policy 1, policy_version 124335 (0.0009) [2023-12-26 00:34:45,711][123090] Updated weights for policy 1, policy_version 124345 (0.0009) [2023-12-26 00:34:46,225][123091] Updated weights for policy 0, policy_version 124903 (0.0009) [2023-12-26 00:34:46,275][123091] Updated weights for policy 0, policy_version 124913 (0.0010) [2023-12-26 00:34:46,326][123091] Updated weights for policy 0, policy_version 124923 (0.0009) [2023-12-26 00:34:46,532][123090] Updated weights for policy 1, policy_version 124355 (0.0009) [2023-12-26 00:34:46,594][123090] Updated weights for policy 1, policy_version 124365 (0.0008) [2023-12-26 00:34:46,659][123090] Updated weights for policy 1, policy_version 124375 (0.0009) [2023-12-26 00:34:47,214][123091] Updated weights for policy 0, policy_version 124933 (0.0010) [2023-12-26 00:34:47,271][123091] Updated weights for policy 0, policy_version 124943 (0.0010) [2023-12-26 00:34:47,326][123091] Updated weights for policy 0, policy_version 124953 (0.0010) [2023-12-26 00:34:47,377][123090] Updated weights for policy 1, policy_version 124385 (0.0010) [2023-12-26 00:34:47,431][123090] Updated weights for policy 1, policy_version 124395 (0.0006) [2023-12-26 00:34:47,478][123090] Updated weights for policy 1, policy_version 124405 (0.0010) [2023-12-26 00:34:47,525][123090] Updated weights for policy 1, policy_version 124415 (0.0010) [2023-12-26 00:34:48,230][123090] Updated weights for policy 1, policy_version 124425 (0.0006) [2023-12-26 00:34:48,233][123091] Updated weights for policy 0, policy_version 124963 (0.0009) [2023-12-26 00:34:48,284][123091] Updated weights for policy 0, policy_version 124973 (0.0007) [2023-12-26 00:34:48,290][123090] Updated weights for policy 1, policy_version 124435 (0.0009) [2023-12-26 00:34:48,341][123091] Updated weights for policy 0, policy_version 124983 (0.0007) [2023-12-26 00:34:48,358][123090] Updated weights for policy 1, policy_version 124445 (0.0009) [2023-12-26 00:34:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 63856640. Throughput: 0: 8734.3, 1: 8968.2. Samples: 63867300. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:48,784][121949] Avg episode reward: [(0, '5328.940'), (1, '5667.169')] [2023-12-26 00:34:48,961][123090] Updated weights for policy 1, policy_version 124455 (0.0009) [2023-12-26 00:34:49,023][123090] Updated weights for policy 1, policy_version 124465 (0.0010) [2023-12-26 00:34:49,086][123090] Updated weights for policy 1, policy_version 124475 (0.0006) [2023-12-26 00:34:49,260][123091] Updated weights for policy 0, policy_version 124993 (0.0009) [2023-12-26 00:34:49,330][123091] Updated weights for policy 0, policy_version 125003 (0.0009) [2023-12-26 00:34:49,393][123091] Updated weights for policy 0, policy_version 125013 (0.0009) [2023-12-26 00:34:49,442][123091] Updated weights for policy 0, policy_version 125023 (0.0009) [2023-12-26 00:34:49,831][123090] Updated weights for policy 1, policy_version 124485 (0.0006) [2023-12-26 00:34:49,903][123090] Updated weights for policy 1, policy_version 124495 (0.0007) [2023-12-26 00:34:49,977][123090] Updated weights for policy 1, policy_version 124505 (0.0011) [2023-12-26 00:34:50,325][123091] Updated weights for policy 0, policy_version 125033 (0.0008) [2023-12-26 00:34:50,391][123091] Updated weights for policy 0, policy_version 125043 (0.0007) [2023-12-26 00:34:50,455][123091] Updated weights for policy 0, policy_version 125053 (0.0009) [2023-12-26 00:34:50,794][123090] Updated weights for policy 1, policy_version 124515 (0.0011) [2023-12-26 00:34:50,860][123090] Updated weights for policy 1, policy_version 124525 (0.0011) [2023-12-26 00:34:50,929][123090] Updated weights for policy 1, policy_version 124535 (0.0011) [2023-12-26 00:34:51,270][123091] Updated weights for policy 0, policy_version 125063 (0.0008) [2023-12-26 00:34:51,326][123091] Updated weights for policy 0, policy_version 125073 (0.0008) [2023-12-26 00:34:51,399][123091] Updated weights for policy 0, policy_version 125083 (0.0009) [2023-12-26 00:34:51,678][123090] Updated weights for policy 1, policy_version 124545 (0.0010) [2023-12-26 00:34:51,740][123090] Updated weights for policy 1, policy_version 124555 (0.0008) [2023-12-26 00:34:51,808][123090] Updated weights for policy 1, policy_version 124565 (0.0010) [2023-12-26 00:34:51,868][123090] Updated weights for policy 1, policy_version 124575 (0.0011) [2023-12-26 00:34:52,177][123091] Updated weights for policy 0, policy_version 125093 (0.0009) [2023-12-26 00:34:52,236][123091] Updated weights for policy 0, policy_version 125103 (0.0011) [2023-12-26 00:34:52,308][123091] Updated weights for policy 0, policy_version 125113 (0.0011) [2023-12-26 00:34:52,677][123090] Updated weights for policy 1, policy_version 124585 (0.0009) [2023-12-26 00:34:52,732][123090] Updated weights for policy 1, policy_version 124595 (0.0010) [2023-12-26 00:34:52,791][123090] Updated weights for policy 1, policy_version 124605 (0.0010) [2023-12-26 00:34:53,102][123091] Updated weights for policy 0, policy_version 125123 (0.0011) [2023-12-26 00:34:53,168][123091] Updated weights for policy 0, policy_version 125133 (0.0011) [2023-12-26 00:34:53,227][123091] Updated weights for policy 0, policy_version 125143 (0.0010) [2023-12-26 00:34:53,523][123090] Updated weights for policy 1, policy_version 124615 (0.0011) [2023-12-26 00:34:53,590][123090] Updated weights for policy 1, policy_version 124625 (0.0011) [2023-12-26 00:34:53,646][123090] Updated weights for policy 1, policy_version 124635 (0.0010) [2023-12-26 00:34:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 63946752. Throughput: 0: 8721.1, 1: 9005.3. Samples: 63919380. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 00:34:53,785][121949] Avg episode reward: [(0, '5310.590'), (1, '5726.687')] [2023-12-26 00:34:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000124640_31907840.pth... [2023-12-26 00:34:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000125152_32038912.pth... [2023-12-26 00:34:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000123552_31629312.pth [2023-12-26 00:34:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000124128_31776768.pth [2023-12-26 00:34:54,027][123091] Updated weights for policy 0, policy_version 125153 (0.0009) [2023-12-26 00:34:54,082][123091] Updated weights for policy 0, policy_version 125163 (0.0005) [2023-12-26 00:34:54,137][123091] Updated weights for policy 0, policy_version 125173 (0.0006) [2023-12-26 00:34:54,185][123091] Updated weights for policy 0, policy_version 125183 (0.0005) [2023-12-26 00:34:54,356][123090] Updated weights for policy 1, policy_version 124645 (0.0008) [2023-12-26 00:34:54,422][123090] Updated weights for policy 1, policy_version 124655 (0.0005) [2023-12-26 00:34:54,493][123090] Updated weights for policy 1, policy_version 124665 (0.0005) [2023-12-26 00:34:54,951][123091] Updated weights for policy 0, policy_version 125193 (0.0006) [2023-12-26 00:34:55,019][123091] Updated weights for policy 0, policy_version 125203 (0.0008) [2023-12-26 00:34:55,085][123091] Updated weights for policy 0, policy_version 125213 (0.0008) [2023-12-26 00:34:55,180][123090] Updated weights for policy 1, policy_version 124675 (0.0005) [2023-12-26 00:34:55,246][123090] Updated weights for policy 1, policy_version 124685 (0.0010) [2023-12-26 00:34:55,310][123090] Updated weights for policy 1, policy_version 124695 (0.0011) [2023-12-26 00:34:55,844][123091] Updated weights for policy 0, policy_version 125223 (0.0009) [2023-12-26 00:34:55,897][123091] Updated weights for policy 0, policy_version 125233 (0.0010) [2023-12-26 00:34:55,956][123091] Updated weights for policy 0, policy_version 125243 (0.0010) [2023-12-26 00:34:55,991][123090] Updated weights for policy 1, policy_version 124705 (0.0010) [2023-12-26 00:34:56,044][123090] Updated weights for policy 1, policy_version 124715 (0.0009) [2023-12-26 00:34:56,089][123090] Updated weights for policy 1, policy_version 124725 (0.0010) [2023-12-26 00:34:56,141][123090] Updated weights for policy 1, policy_version 124735 (0.0010) [2023-12-26 00:34:56,710][123091] Updated weights for policy 0, policy_version 125253 (0.0007) [2023-12-26 00:34:56,769][123091] Updated weights for policy 0, policy_version 125263 (0.0005) [2023-12-26 00:34:56,829][123091] Updated weights for policy 0, policy_version 125273 (0.0005) [2023-12-26 00:34:56,857][123090] Updated weights for policy 1, policy_version 124745 (0.0006) [2023-12-26 00:34:56,916][123090] Updated weights for policy 1, policy_version 124755 (0.0005) [2023-12-26 00:34:56,974][123090] Updated weights for policy 1, policy_version 124765 (0.0005) [2023-12-26 00:34:57,475][123091] Updated weights for policy 0, policy_version 125283 (0.0005) [2023-12-26 00:34:57,530][123091] Updated weights for policy 0, policy_version 125293 (0.0005) [2023-12-26 00:34:57,587][123091] Updated weights for policy 0, policy_version 125303 (0.0005) [2023-12-26 00:34:57,639][123090] Updated weights for policy 1, policy_version 124775 (0.0009) [2023-12-26 00:34:57,701][123090] Updated weights for policy 1, policy_version 124785 (0.0010) [2023-12-26 00:34:57,759][123090] Updated weights for policy 1, policy_version 124795 (0.0010) [2023-12-26 00:34:58,292][123091] Updated weights for policy 0, policy_version 125313 (0.0009) [2023-12-26 00:34:58,372][123091] Updated weights for policy 0, policy_version 125323 (0.0010) [2023-12-26 00:34:58,440][123091] Updated weights for policy 0, policy_version 125333 (0.0010) [2023-12-26 00:34:58,512][123091] Updated weights for policy 0, policy_version 125343 (0.0010) [2023-12-26 00:34:58,594][123090] Updated weights for policy 1, policy_version 124805 (0.0009) [2023-12-26 00:34:58,661][123090] Updated weights for policy 1, policy_version 124815 (0.0010) [2023-12-26 00:34:58,727][123090] Updated weights for policy 1, policy_version 124825 (0.0009) [2023-12-26 00:34:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 64045056. Throughput: 0: 8853.8, 1: 9146.7. Samples: 64034212. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:34:58,785][121949] Avg episode reward: [(0, '5357.869'), (1, '5748.306')] [2023-12-26 00:34:59,347][123091] Updated weights for policy 0, policy_version 125353 (0.0009) [2023-12-26 00:34:59,409][123091] Updated weights for policy 0, policy_version 125363 (0.0009) [2023-12-26 00:34:59,458][123091] Updated weights for policy 0, policy_version 125373 (0.0009) [2023-12-26 00:34:59,542][123090] Updated weights for policy 1, policy_version 124835 (0.0009) [2023-12-26 00:34:59,608][123090] Updated weights for policy 1, policy_version 124845 (0.0010) [2023-12-26 00:34:59,678][123090] Updated weights for policy 1, policy_version 124855 (0.0010) [2023-12-26 00:35:00,297][123091] Updated weights for policy 0, policy_version 125383 (0.0009) [2023-12-26 00:35:00,359][123091] Updated weights for policy 0, policy_version 125393 (0.0008) [2023-12-26 00:35:00,409][123091] Updated weights for policy 0, policy_version 125403 (0.0006) [2023-12-26 00:35:00,452][123090] Updated weights for policy 1, policy_version 124865 (0.0010) [2023-12-26 00:35:00,518][123090] Updated weights for policy 1, policy_version 124875 (0.0010) [2023-12-26 00:35:00,579][123090] Updated weights for policy 1, policy_version 124885 (0.0010) [2023-12-26 00:35:00,643][123090] Updated weights for policy 1, policy_version 124895 (0.0010) [2023-12-26 00:35:01,107][123091] Updated weights for policy 0, policy_version 125413 (0.0006) [2023-12-26 00:35:01,174][123091] Updated weights for policy 0, policy_version 125423 (0.0006) [2023-12-26 00:35:01,232][123091] Updated weights for policy 0, policy_version 125433 (0.0005) [2023-12-26 00:35:01,413][123090] Updated weights for policy 1, policy_version 124905 (0.0009) [2023-12-26 00:35:01,482][123090] Updated weights for policy 1, policy_version 124915 (0.0009) [2023-12-26 00:35:01,539][123090] Updated weights for policy 1, policy_version 124925 (0.0011) [2023-12-26 00:35:01,949][123091] Updated weights for policy 0, policy_version 125443 (0.0008) [2023-12-26 00:35:01,999][123091] Updated weights for policy 0, policy_version 125453 (0.0008) [2023-12-26 00:35:02,055][123091] Updated weights for policy 0, policy_version 125463 (0.0008) [2023-12-26 00:35:02,324][123090] Updated weights for policy 1, policy_version 124935 (0.0011) [2023-12-26 00:35:02,390][123090] Updated weights for policy 1, policy_version 124945 (0.0011) [2023-12-26 00:35:02,441][123090] Updated weights for policy 1, policy_version 124955 (0.0010) [2023-12-26 00:35:02,875][123091] Updated weights for policy 0, policy_version 125473 (0.0009) [2023-12-26 00:35:02,927][123091] Updated weights for policy 0, policy_version 125483 (0.0010) [2023-12-26 00:35:02,977][123091] Updated weights for policy 0, policy_version 125493 (0.0009) [2023-12-26 00:35:03,032][123091] Updated weights for policy 0, policy_version 125503 (0.0005) [2023-12-26 00:35:03,144][123090] Updated weights for policy 1, policy_version 124965 (0.0010) [2023-12-26 00:35:03,195][123090] Updated weights for policy 1, policy_version 124975 (0.0010) [2023-12-26 00:35:03,250][123090] Updated weights for policy 1, policy_version 124985 (0.0010) [2023-12-26 00:35:03,783][123091] Updated weights for policy 0, policy_version 125513 (0.0008) [2023-12-26 00:35:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 64126976. Throughput: 0: 8885.4, 1: 9091.8. Samples: 64142732. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:03,785][121949] Avg episode reward: [(0, '5239.558'), (1, '5737.982')] [2023-12-26 00:35:03,840][123091] Updated weights for policy 0, policy_version 125523 (0.0007) [2023-12-26 00:35:03,899][123091] Updated weights for policy 0, policy_version 125533 (0.0008) [2023-12-26 00:35:04,098][123090] Updated weights for policy 1, policy_version 124995 (0.0010) [2023-12-26 00:35:04,170][123090] Updated weights for policy 1, policy_version 125005 (0.0008) [2023-12-26 00:35:04,242][123090] Updated weights for policy 1, policy_version 125015 (0.0008) [2023-12-26 00:35:04,749][123091] Updated weights for policy 0, policy_version 125543 (0.0007) [2023-12-26 00:35:04,797][123091] Updated weights for policy 0, policy_version 125553 (0.0005) [2023-12-26 00:35:04,844][123091] Updated weights for policy 0, policy_version 125563 (0.0006) [2023-12-26 00:35:05,063][123090] Updated weights for policy 1, policy_version 125025 (0.0008) [2023-12-26 00:35:05,113][123090] Updated weights for policy 1, policy_version 125035 (0.0009) [2023-12-26 00:35:05,175][123090] Updated weights for policy 1, policy_version 125046 (0.0010) [2023-12-26 00:35:05,228][123090] Updated weights for policy 1, policy_version 125056 (0.0010) [2023-12-26 00:35:05,511][123091] Updated weights for policy 0, policy_version 125573 (0.0005) [2023-12-26 00:35:05,568][123091] Updated weights for policy 0, policy_version 125583 (0.0009) [2023-12-26 00:35:05,619][123091] Updated weights for policy 0, policy_version 125593 (0.0010) [2023-12-26 00:35:05,965][123090] Updated weights for policy 1, policy_version 125066 (0.0009) [2023-12-26 00:35:06,031][123090] Updated weights for policy 1, policy_version 125076 (0.0010) [2023-12-26 00:35:06,086][123090] Updated weights for policy 1, policy_version 125086 (0.0010) [2023-12-26 00:35:06,440][123091] Updated weights for policy 0, policy_version 125603 (0.0009) [2023-12-26 00:35:06,514][123091] Updated weights for policy 0, policy_version 125613 (0.0006) [2023-12-26 00:35:06,588][123091] Updated weights for policy 0, policy_version 125623 (0.0009) [2023-12-26 00:35:06,905][123090] Updated weights for policy 1, policy_version 125096 (0.0010) [2023-12-26 00:35:06,961][123090] Updated weights for policy 1, policy_version 125106 (0.0010) [2023-12-26 00:35:07,028][123090] Updated weights for policy 1, policy_version 125116 (0.0010) [2023-12-26 00:35:07,318][123091] Updated weights for policy 0, policy_version 125633 (0.0011) [2023-12-26 00:35:07,369][123091] Updated weights for policy 0, policy_version 125643 (0.0011) [2023-12-26 00:35:07,432][123091] Updated weights for policy 0, policy_version 125653 (0.0011) [2023-12-26 00:35:07,503][123091] Updated weights for policy 0, policy_version 125663 (0.0011) [2023-12-26 00:35:07,856][123090] Updated weights for policy 1, policy_version 125126 (0.0010) [2023-12-26 00:35:07,917][123090] Updated weights for policy 1, policy_version 125136 (0.0010) [2023-12-26 00:35:07,978][123090] Updated weights for policy 1, policy_version 125146 (0.0010) [2023-12-26 00:35:08,337][123091] Updated weights for policy 0, policy_version 125673 (0.0011) [2023-12-26 00:35:08,402][123091] Updated weights for policy 0, policy_version 125683 (0.0011) [2023-12-26 00:35:08,465][123091] Updated weights for policy 0, policy_version 125693 (0.0011) [2023-12-26 00:35:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 64217088. Throughput: 0: 8917.7, 1: 9128.3. Samples: 64196252. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:08,785][121949] Avg episode reward: [(0, '5229.099'), (1, '5788.185')] [2023-12-26 00:35:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000125696_32178176.pth... [2023-12-26 00:35:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000124672_31916032.pth [2023-12-26 00:35:08,807][123090] Updated weights for policy 1, policy_version 125156 (0.0010) [2023-12-26 00:35:08,873][123090] Updated weights for policy 1, policy_version 125166 (0.0008) [2023-12-26 00:35:08,925][123090] Updated weights for policy 1, policy_version 125176 (0.0009) [2023-12-26 00:35:08,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000125184_32047104.pth... [2023-12-26 00:35:08,965][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000124096_31768576.pth [2023-12-26 00:35:09,282][123091] Updated weights for policy 0, policy_version 125703 (0.0007) [2023-12-26 00:35:09,353][123091] Updated weights for policy 0, policy_version 125713 (0.0009) [2023-12-26 00:35:09,428][123091] Updated weights for policy 0, policy_version 125723 (0.0011) [2023-12-26 00:35:09,737][123090] Updated weights for policy 1, policy_version 125186 (0.0009) [2023-12-26 00:35:09,789][123090] Updated weights for policy 1, policy_version 125196 (0.0011) [2023-12-26 00:35:09,864][123090] Updated weights for policy 1, policy_version 125206 (0.0010) [2023-12-26 00:35:09,931][123090] Updated weights for policy 1, policy_version 125216 (0.0010) [2023-12-26 00:35:10,259][123091] Updated weights for policy 0, policy_version 125733 (0.0010) [2023-12-26 00:35:10,318][123091] Updated weights for policy 0, policy_version 125743 (0.0011) [2023-12-26 00:35:10,384][123091] Updated weights for policy 0, policy_version 125753 (0.0010) [2023-12-26 00:35:10,774][123090] Updated weights for policy 1, policy_version 125226 (0.0009) [2023-12-26 00:35:10,843][123090] Updated weights for policy 1, policy_version 125236 (0.0009) [2023-12-26 00:35:10,896][123090] Updated weights for policy 1, policy_version 125246 (0.0009) [2023-12-26 00:35:11,214][123091] Updated weights for policy 0, policy_version 125763 (0.0011) [2023-12-26 00:35:11,285][123091] Updated weights for policy 0, policy_version 125773 (0.0011) [2023-12-26 00:35:11,344][123091] Updated weights for policy 0, policy_version 125783 (0.0007) [2023-12-26 00:35:11,692][123090] Updated weights for policy 1, policy_version 125256 (0.0007) [2023-12-26 00:35:11,764][123090] Updated weights for policy 1, policy_version 125266 (0.0008) [2023-12-26 00:35:11,834][123090] Updated weights for policy 1, policy_version 125276 (0.0008) [2023-12-26 00:35:12,146][123091] Updated weights for policy 0, policy_version 125793 (0.0010) [2023-12-26 00:35:12,213][123091] Updated weights for policy 0, policy_version 125803 (0.0009) [2023-12-26 00:35:12,280][123091] Updated weights for policy 0, policy_version 125813 (0.0009) [2023-12-26 00:35:12,349][123091] Updated weights for policy 0, policy_version 125823 (0.0009) [2023-12-26 00:35:12,642][123090] Updated weights for policy 1, policy_version 125286 (0.0010) [2023-12-26 00:35:12,687][123090] Updated weights for policy 1, policy_version 125296 (0.0010) [2023-12-26 00:35:12,739][123090] Updated weights for policy 1, policy_version 125306 (0.0010) [2023-12-26 00:35:13,109][123091] Updated weights for policy 0, policy_version 125833 (0.0006) [2023-12-26 00:35:13,159][123091] Updated weights for policy 0, policy_version 125843 (0.0005) [2023-12-26 00:35:13,220][123091] Updated weights for policy 0, policy_version 125853 (0.0006) [2023-12-26 00:35:13,458][123090] Updated weights for policy 1, policy_version 125316 (0.0009) [2023-12-26 00:35:13,523][123090] Updated weights for policy 1, policy_version 125326 (0.0005) [2023-12-26 00:35:13,588][123090] Updated weights for policy 1, policy_version 125336 (0.0010) [2023-12-26 00:35:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 64307200. Throughput: 0: 8837.1, 1: 9069.4. Samples: 64299196. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:13,785][121949] Avg episode reward: [(0, '5381.650'), (1, '5798.652')] [2023-12-26 00:35:13,890][123091] Updated weights for policy 0, policy_version 125863 (0.0005) [2023-12-26 00:35:13,943][123091] Updated weights for policy 0, policy_version 125873 (0.0007) [2023-12-26 00:35:13,995][123091] Updated weights for policy 0, policy_version 125883 (0.0011) [2023-12-26 00:35:14,225][123090] Updated weights for policy 1, policy_version 125346 (0.0010) [2023-12-26 00:35:14,288][123090] Updated weights for policy 1, policy_version 125356 (0.0005) [2023-12-26 00:35:14,358][123090] Updated weights for policy 1, policy_version 125366 (0.0007) [2023-12-26 00:35:14,421][123090] Updated weights for policy 1, policy_version 125376 (0.0006) [2023-12-26 00:35:14,710][123091] Updated weights for policy 0, policy_version 125893 (0.0010) [2023-12-26 00:35:14,778][123091] Updated weights for policy 0, policy_version 125903 (0.0009) [2023-12-26 00:35:14,848][123091] Updated weights for policy 0, policy_version 125913 (0.0008) [2023-12-26 00:35:15,204][123090] Updated weights for policy 1, policy_version 125386 (0.0011) [2023-12-26 00:35:15,264][123090] Updated weights for policy 1, policy_version 125396 (0.0011) [2023-12-26 00:35:15,329][123090] Updated weights for policy 1, policy_version 125406 (0.0011) [2023-12-26 00:35:15,658][123091] Updated weights for policy 0, policy_version 125923 (0.0008) [2023-12-26 00:35:15,720][123091] Updated weights for policy 0, policy_version 125933 (0.0008) [2023-12-26 00:35:15,769][123091] Updated weights for policy 0, policy_version 125943 (0.0009) [2023-12-26 00:35:16,158][123090] Updated weights for policy 1, policy_version 125416 (0.0011) [2023-12-26 00:35:16,220][123090] Updated weights for policy 1, policy_version 125426 (0.0010) [2023-12-26 00:35:16,279][123090] Updated weights for policy 1, policy_version 125436 (0.0010) [2023-12-26 00:35:16,481][123091] Updated weights for policy 0, policy_version 125953 (0.0010) [2023-12-26 00:35:16,538][123091] Updated weights for policy 0, policy_version 125963 (0.0007) [2023-12-26 00:35:16,596][123091] Updated weights for policy 0, policy_version 125973 (0.0005) [2023-12-26 00:35:16,663][123091] Updated weights for policy 0, policy_version 125983 (0.0009) [2023-12-26 00:35:17,019][123090] Updated weights for policy 1, policy_version 125446 (0.0007) [2023-12-26 00:35:17,068][123090] Updated weights for policy 1, policy_version 125456 (0.0005) [2023-12-26 00:35:17,126][123090] Updated weights for policy 1, policy_version 125466 (0.0005) [2023-12-26 00:35:17,430][123091] Updated weights for policy 0, policy_version 125993 (0.0010) [2023-12-26 00:35:17,485][123091] Updated weights for policy 0, policy_version 126003 (0.0010) [2023-12-26 00:35:17,532][123091] Updated weights for policy 0, policy_version 126013 (0.0010) [2023-12-26 00:35:17,808][123090] Updated weights for policy 1, policy_version 125476 (0.0005) [2023-12-26 00:35:17,872][123090] Updated weights for policy 1, policy_version 125486 (0.0005) [2023-12-26 00:35:17,949][123090] Updated weights for policy 1, policy_version 125496 (0.0005) [2023-12-26 00:35:18,240][123091] Updated weights for policy 0, policy_version 126023 (0.0007) [2023-12-26 00:35:18,304][123091] Updated weights for policy 0, policy_version 126033 (0.0010) [2023-12-26 00:35:18,368][123091] Updated weights for policy 0, policy_version 126043 (0.0010) [2023-12-26 00:35:18,727][123090] Updated weights for policy 1, policy_version 125506 (0.0007) [2023-12-26 00:35:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 64397312. Throughput: 0: 8933.0, 1: 9049.0. Samples: 64412792. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:18,785][121949] Avg episode reward: [(0, '5455.396'), (1, '5730.639')] [2023-12-26 00:35:18,791][123090] Updated weights for policy 1, policy_version 125516 (0.0011) [2023-12-26 00:35:18,854][123090] Updated weights for policy 1, policy_version 125526 (0.0010) [2023-12-26 00:35:18,920][123090] Updated weights for policy 1, policy_version 125536 (0.0010) [2023-12-26 00:35:19,109][123091] Updated weights for policy 0, policy_version 126053 (0.0008) [2023-12-26 00:35:19,172][123091] Updated weights for policy 0, policy_version 126063 (0.0011) [2023-12-26 00:35:19,227][123091] Updated weights for policy 0, policy_version 126073 (0.0010) [2023-12-26 00:35:19,687][123090] Updated weights for policy 1, policy_version 125546 (0.0011) [2023-12-26 00:35:19,736][123090] Updated weights for policy 1, policy_version 125556 (0.0010) [2023-12-26 00:35:19,788][123090] Updated weights for policy 1, policy_version 125566 (0.0011) [2023-12-26 00:35:20,029][123091] Updated weights for policy 0, policy_version 126083 (0.0008) [2023-12-26 00:35:20,097][123091] Updated weights for policy 0, policy_version 126093 (0.0011) [2023-12-26 00:35:20,157][123091] Updated weights for policy 0, policy_version 126103 (0.0011) [2023-12-26 00:35:20,661][123090] Updated weights for policy 1, policy_version 125576 (0.0007) [2023-12-26 00:35:20,733][123090] Updated weights for policy 1, policy_version 125586 (0.0006) [2023-12-26 00:35:20,805][123090] Updated weights for policy 1, policy_version 125596 (0.0006) [2023-12-26 00:35:20,982][123091] Updated weights for policy 0, policy_version 126113 (0.0011) [2023-12-26 00:35:21,058][123091] Updated weights for policy 0, policy_version 126123 (0.0011) [2023-12-26 00:35:21,123][123091] Updated weights for policy 0, policy_version 126133 (0.0011) [2023-12-26 00:35:21,186][123091] Updated weights for policy 0, policy_version 126143 (0.0011) [2023-12-26 00:35:21,588][123090] Updated weights for policy 1, policy_version 125606 (0.0009) [2023-12-26 00:35:21,654][123090] Updated weights for policy 1, policy_version 125616 (0.0011) [2023-12-26 00:35:21,715][123090] Updated weights for policy 1, policy_version 125626 (0.0011) [2023-12-26 00:35:22,069][123091] Updated weights for policy 0, policy_version 126153 (0.0011) [2023-12-26 00:35:22,141][123091] Updated weights for policy 0, policy_version 126163 (0.0011) [2023-12-26 00:35:22,204][123091] Updated weights for policy 0, policy_version 126173 (0.0011) [2023-12-26 00:35:22,509][123090] Updated weights for policy 1, policy_version 125636 (0.0008) [2023-12-26 00:35:22,574][123090] Updated weights for policy 1, policy_version 125646 (0.0011) [2023-12-26 00:35:22,647][123090] Updated weights for policy 1, policy_version 125656 (0.0008) [2023-12-26 00:35:23,002][123091] Updated weights for policy 0, policy_version 126183 (0.0011) [2023-12-26 00:35:23,054][123091] Updated weights for policy 0, policy_version 126193 (0.0009) [2023-12-26 00:35:23,113][123091] Updated weights for policy 0, policy_version 126203 (0.0010) [2023-12-26 00:35:23,436][123090] Updated weights for policy 1, policy_version 125666 (0.0006) [2023-12-26 00:35:23,494][123090] Updated weights for policy 1, policy_version 125676 (0.0006) [2023-12-26 00:35:23,545][123090] Updated weights for policy 1, policy_version 125686 (0.0005) [2023-12-26 00:35:23,607][123090] Updated weights for policy 1, policy_version 125696 (0.0010) [2023-12-26 00:35:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17689.1). Total num frames: 64487424. Throughput: 0: 8894.2, 1: 8987.1. Samples: 64463756. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:23,785][121949] Avg episode reward: [(0, '5468.569'), (1, '5716.734')] [2023-12-26 00:35:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000126208_32309248.pth... [2023-12-26 00:35:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000125696_32178176.pth... [2023-12-26 00:35:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000124640_31907840.pth [2023-12-26 00:35:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000125152_32038912.pth [2023-12-26 00:35:23,960][123091] Updated weights for policy 0, policy_version 126213 (0.0011) [2023-12-26 00:35:24,015][123091] Updated weights for policy 0, policy_version 126223 (0.0010) [2023-12-26 00:35:24,066][123091] Updated weights for policy 0, policy_version 126233 (0.0010) [2023-12-26 00:35:24,396][123090] Updated weights for policy 1, policy_version 125706 (0.0011) [2023-12-26 00:35:24,453][123090] Updated weights for policy 1, policy_version 125716 (0.0013) [2023-12-26 00:35:24,519][123090] Updated weights for policy 1, policy_version 125726 (0.0010) [2023-12-26 00:35:24,740][123091] Updated weights for policy 0, policy_version 126243 (0.0009) [2023-12-26 00:35:24,793][123091] Updated weights for policy 0, policy_version 126253 (0.0005) [2023-12-26 00:35:24,841][123091] Updated weights for policy 0, policy_version 126263 (0.0005) [2023-12-26 00:35:25,347][123090] Updated weights for policy 1, policy_version 125736 (0.0009) [2023-12-26 00:35:25,410][123090] Updated weights for policy 1, policy_version 125746 (0.0009) [2023-12-26 00:35:25,473][123090] Updated weights for policy 1, policy_version 125756 (0.0009) [2023-12-26 00:35:25,588][123091] Updated weights for policy 0, policy_version 126273 (0.0006) [2023-12-26 00:35:25,650][123091] Updated weights for policy 0, policy_version 126283 (0.0010) [2023-12-26 00:35:25,704][123091] Updated weights for policy 0, policy_version 126293 (0.0010) [2023-12-26 00:35:25,751][123091] Updated weights for policy 0, policy_version 126303 (0.0008) [2023-12-26 00:35:26,214][123090] Updated weights for policy 1, policy_version 125766 (0.0009) [2023-12-26 00:35:26,275][123090] Updated weights for policy 1, policy_version 125776 (0.0008) [2023-12-26 00:35:26,337][123090] Updated weights for policy 1, policy_version 125786 (0.0008) [2023-12-26 00:35:26,550][123091] Updated weights for policy 0, policy_version 126313 (0.0010) [2023-12-26 00:35:26,619][123091] Updated weights for policy 0, policy_version 126323 (0.0011) [2023-12-26 00:35:26,681][123091] Updated weights for policy 0, policy_version 126333 (0.0010) [2023-12-26 00:35:26,966][123090] Updated weights for policy 1, policy_version 125796 (0.0005) [2023-12-26 00:35:27,031][123090] Updated weights for policy 1, policy_version 125806 (0.0006) [2023-12-26 00:35:27,089][123090] Updated weights for policy 1, policy_version 125816 (0.0007) [2023-12-26 00:35:27,458][123091] Updated weights for policy 0, policy_version 126343 (0.0009) [2023-12-26 00:35:27,503][123091] Updated weights for policy 0, policy_version 126353 (0.0008) [2023-12-26 00:35:27,549][123091] Updated weights for policy 0, policy_version 126363 (0.0005) [2023-12-26 00:35:27,865][123090] Updated weights for policy 1, policy_version 125826 (0.0006) [2023-12-26 00:35:27,920][123090] Updated weights for policy 1, policy_version 125836 (0.0010) [2023-12-26 00:35:27,972][123090] Updated weights for policy 1, policy_version 125846 (0.0010) [2023-12-26 00:35:28,035][123090] Updated weights for policy 1, policy_version 125856 (0.0007) [2023-12-26 00:35:28,272][123091] Updated weights for policy 0, policy_version 126373 (0.0008) [2023-12-26 00:35:28,331][123091] Updated weights for policy 0, policy_version 126383 (0.0011) [2023-12-26 00:35:28,405][123091] Updated weights for policy 0, policy_version 126393 (0.0010) [2023-12-26 00:35:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 64577536. Throughput: 0: 8936.8, 1: 9101.8. Samples: 64572692. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:28,785][121949] Avg episode reward: [(0, '5438.986'), (1, '5718.202')] [2023-12-26 00:35:28,814][123090] Updated weights for policy 1, policy_version 125866 (0.0010) [2023-12-26 00:35:28,873][123090] Updated weights for policy 1, policy_version 125876 (0.0010) [2023-12-26 00:35:28,924][123090] Updated weights for policy 1, policy_version 125886 (0.0010) [2023-12-26 00:35:29,204][123091] Updated weights for policy 0, policy_version 126403 (0.0009) [2023-12-26 00:35:29,282][123091] Updated weights for policy 0, policy_version 126414 (0.0007) [2023-12-26 00:35:29,351][123091] Updated weights for policy 0, policy_version 126424 (0.0010) [2023-12-26 00:35:29,689][123090] Updated weights for policy 1, policy_version 125896 (0.0008) [2023-12-26 00:35:29,755][123090] Updated weights for policy 1, policy_version 125906 (0.0009) [2023-12-26 00:35:29,816][123090] Updated weights for policy 1, policy_version 125916 (0.0009) [2023-12-26 00:35:30,124][123091] Updated weights for policy 0, policy_version 126434 (0.0010) [2023-12-26 00:35:30,189][123091] Updated weights for policy 0, policy_version 126444 (0.0009) [2023-12-26 00:35:30,237][123091] Updated weights for policy 0, policy_version 126454 (0.0010) [2023-12-26 00:35:30,295][123091] Updated weights for policy 0, policy_version 126464 (0.0007) [2023-12-26 00:35:30,653][123090] Updated weights for policy 1, policy_version 125926 (0.0007) [2023-12-26 00:35:30,702][123090] Updated weights for policy 1, policy_version 125936 (0.0005) [2023-12-26 00:35:30,763][123090] Updated weights for policy 1, policy_version 125946 (0.0006) [2023-12-26 00:35:30,946][123091] Updated weights for policy 0, policy_version 126474 (0.0005) [2023-12-26 00:35:31,002][123091] Updated weights for policy 0, policy_version 126484 (0.0006) [2023-12-26 00:35:31,072][123091] Updated weights for policy 0, policy_version 126494 (0.0008) [2023-12-26 00:35:31,504][123090] Updated weights for policy 1, policy_version 125956 (0.0007) [2023-12-26 00:35:31,556][123090] Updated weights for policy 1, policy_version 125966 (0.0009) [2023-12-26 00:35:31,631][123090] Updated weights for policy 1, policy_version 125976 (0.0010) [2023-12-26 00:35:31,816][123091] Updated weights for policy 0, policy_version 126504 (0.0010) [2023-12-26 00:35:31,873][123091] Updated weights for policy 0, policy_version 126514 (0.0006) [2023-12-26 00:35:31,922][123091] Updated weights for policy 0, policy_version 126524 (0.0008) [2023-12-26 00:35:32,506][123090] Updated weights for policy 1, policy_version 125986 (0.0010) [2023-12-26 00:35:32,582][123090] Updated weights for policy 1, policy_version 125996 (0.0006) [2023-12-26 00:35:32,649][123090] Updated weights for policy 1, policy_version 126006 (0.0008) [2023-12-26 00:35:32,678][123091] Updated weights for policy 0, policy_version 126534 (0.0008) [2023-12-26 00:35:32,708][123090] Updated weights for policy 1, policy_version 126016 (0.0008) [2023-12-26 00:35:32,740][123091] Updated weights for policy 0, policy_version 126544 (0.0008) [2023-12-26 00:35:32,811][123091] Updated weights for policy 0, policy_version 126554 (0.0006) [2023-12-26 00:35:33,467][123090] Updated weights for policy 1, policy_version 126026 (0.0006) [2023-12-26 00:35:33,483][123091] Updated weights for policy 0, policy_version 126564 (0.0007) [2023-12-26 00:35:33,531][123090] Updated weights for policy 1, policy_version 126036 (0.0007) [2023-12-26 00:35:33,549][123091] Updated weights for policy 0, policy_version 126574 (0.0006) [2023-12-26 00:35:33,602][123090] Updated weights for policy 1, policy_version 126046 (0.0006) [2023-12-26 00:35:33,606][123091] Updated weights for policy 0, policy_version 126584 (0.0007) [2023-12-26 00:35:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 64675840. Throughput: 0: 9081.4, 1: 9056.1. Samples: 64683492. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:33,785][121949] Avg episode reward: [(0, '5433.210'), (1, '5644.400')] [2023-12-26 00:35:34,208][123090] Updated weights for policy 1, policy_version 126056 (0.0010) [2023-12-26 00:35:34,276][123090] Updated weights for policy 1, policy_version 126066 (0.0011) [2023-12-26 00:35:34,342][123090] Updated weights for policy 1, policy_version 126076 (0.0010) [2023-12-26 00:35:34,370][123091] Updated weights for policy 0, policy_version 126594 (0.0009) [2023-12-26 00:35:34,443][123091] Updated weights for policy 0, policy_version 126604 (0.0006) [2023-12-26 00:35:34,510][123091] Updated weights for policy 0, policy_version 126614 (0.0006) [2023-12-26 00:35:34,574][123091] Updated weights for policy 0, policy_version 126624 (0.0009) [2023-12-26 00:35:35,054][123090] Updated weights for policy 1, policy_version 126086 (0.0008) [2023-12-26 00:35:35,118][123090] Updated weights for policy 1, policy_version 126096 (0.0009) [2023-12-26 00:35:35,193][123090] Updated weights for policy 1, policy_version 126106 (0.0005) [2023-12-26 00:35:35,314][123091] Updated weights for policy 0, policy_version 126634 (0.0005) [2023-12-26 00:35:35,364][123091] Updated weights for policy 0, policy_version 126644 (0.0007) [2023-12-26 00:35:35,412][123091] Updated weights for policy 0, policy_version 126654 (0.0010) [2023-12-26 00:35:35,808][123090] Updated weights for policy 1, policy_version 126116 (0.0007) [2023-12-26 00:35:35,872][123090] Updated weights for policy 1, policy_version 126126 (0.0010) [2023-12-26 00:35:35,931][123090] Updated weights for policy 1, policy_version 126136 (0.0010) [2023-12-26 00:35:36,150][123091] Updated weights for policy 0, policy_version 126664 (0.0011) [2023-12-26 00:35:36,220][123091] Updated weights for policy 0, policy_version 126674 (0.0009) [2023-12-26 00:35:36,291][123091] Updated weights for policy 0, policy_version 126684 (0.0011) [2023-12-26 00:35:36,684][123090] Updated weights for policy 1, policy_version 126146 (0.0010) [2023-12-26 00:35:36,743][123090] Updated weights for policy 1, policy_version 126156 (0.0008) [2023-12-26 00:35:36,803][123090] Updated weights for policy 1, policy_version 126166 (0.0010) [2023-12-26 00:35:36,869][123090] Updated weights for policy 1, policy_version 126176 (0.0010) [2023-12-26 00:35:37,096][123091] Updated weights for policy 0, policy_version 126694 (0.0009) [2023-12-26 00:35:37,169][123091] Updated weights for policy 0, policy_version 126704 (0.0007) [2023-12-26 00:35:37,233][123091] Updated weights for policy 0, policy_version 126714 (0.0010) [2023-12-26 00:35:37,545][123090] Updated weights for policy 1, policy_version 126186 (0.0010) [2023-12-26 00:35:37,605][123090] Updated weights for policy 1, policy_version 126196 (0.0010) [2023-12-26 00:35:37,668][123090] Updated weights for policy 1, policy_version 126206 (0.0010) [2023-12-26 00:35:37,863][123091] Updated weights for policy 0, policy_version 126724 (0.0009) [2023-12-26 00:35:37,916][123091] Updated weights for policy 0, policy_version 126734 (0.0009) [2023-12-26 00:35:37,964][123091] Updated weights for policy 0, policy_version 126744 (0.0010) [2023-12-26 00:35:38,467][123090] Updated weights for policy 1, policy_version 126216 (0.0008) [2023-12-26 00:35:38,523][123090] Updated weights for policy 1, policy_version 126226 (0.0007) [2023-12-26 00:35:38,588][123090] Updated weights for policy 1, policy_version 126236 (0.0009) [2023-12-26 00:35:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18159.0, 300 sec: 17744.7). Total num frames: 64765952. Throughput: 0: 9139.7, 1: 9112.9. Samples: 64740740. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:38,785][121949] Avg episode reward: [(0, '5511.071'), (1, '5653.479')] [2023-12-26 00:35:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000126752_32448512.pth... [2023-12-26 00:35:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000126240_32317440.pth... [2023-12-26 00:35:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000125184_32047104.pth [2023-12-26 00:35:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000125696_32178176.pth [2023-12-26 00:35:38,827][123091] Updated weights for policy 0, policy_version 126754 (0.0010) [2023-12-26 00:35:38,898][123091] Updated weights for policy 0, policy_version 126764 (0.0011) [2023-12-26 00:35:38,964][123091] Updated weights for policy 0, policy_version 126774 (0.0011) [2023-12-26 00:35:39,020][123091] Updated weights for policy 0, policy_version 126784 (0.0011) [2023-12-26 00:35:39,310][123090] Updated weights for policy 1, policy_version 126246 (0.0010) [2023-12-26 00:35:39,372][123090] Updated weights for policy 1, policy_version 126256 (0.0009) [2023-12-26 00:35:39,437][123090] Updated weights for policy 1, policy_version 126266 (0.0009) [2023-12-26 00:35:39,857][123091] Updated weights for policy 0, policy_version 126794 (0.0011) [2023-12-26 00:35:39,925][123091] Updated weights for policy 0, policy_version 126804 (0.0011) [2023-12-26 00:35:39,997][123091] Updated weights for policy 0, policy_version 126814 (0.0011) [2023-12-26 00:35:40,240][123090] Updated weights for policy 1, policy_version 126276 (0.0009) [2023-12-26 00:35:40,307][123090] Updated weights for policy 1, policy_version 126286 (0.0008) [2023-12-26 00:35:40,375][123090] Updated weights for policy 1, policy_version 126296 (0.0007) [2023-12-26 00:35:40,749][123091] Updated weights for policy 0, policy_version 126824 (0.0011) [2023-12-26 00:35:40,813][123091] Updated weights for policy 0, policy_version 126834 (0.0011) [2023-12-26 00:35:40,877][123091] Updated weights for policy 0, policy_version 126844 (0.0011) [2023-12-26 00:35:41,093][123090] Updated weights for policy 1, policy_version 126306 (0.0007) [2023-12-26 00:35:41,162][123090] Updated weights for policy 1, policy_version 126316 (0.0010) [2023-12-26 00:35:41,222][123090] Updated weights for policy 1, policy_version 126326 (0.0009) [2023-12-26 00:35:41,301][123090] Updated weights for policy 1, policy_version 126336 (0.0010) [2023-12-26 00:35:41,629][123091] Updated weights for policy 0, policy_version 126854 (0.0009) [2023-12-26 00:35:41,698][123091] Updated weights for policy 0, policy_version 126864 (0.0007) [2023-12-26 00:35:41,761][123091] Updated weights for policy 0, policy_version 126874 (0.0009) [2023-12-26 00:35:42,227][123090] Updated weights for policy 1, policy_version 126346 (0.0009) [2023-12-26 00:35:42,293][123090] Updated weights for policy 1, policy_version 126356 (0.0010) [2023-12-26 00:35:42,366][123090] Updated weights for policy 1, policy_version 126366 (0.0009) [2023-12-26 00:35:42,571][123091] Updated weights for policy 0, policy_version 126884 (0.0008) [2023-12-26 00:35:42,635][123091] Updated weights for policy 0, policy_version 126894 (0.0005) [2023-12-26 00:35:42,701][123091] Updated weights for policy 0, policy_version 126904 (0.0006) [2023-12-26 00:35:43,153][123090] Updated weights for policy 1, policy_version 126376 (0.0006) [2023-12-26 00:35:43,213][123090] Updated weights for policy 1, policy_version 126386 (0.0006) [2023-12-26 00:35:43,279][123090] Updated weights for policy 1, policy_version 126396 (0.0010) [2023-12-26 00:35:43,351][123091] Updated weights for policy 0, policy_version 126914 (0.0007) [2023-12-26 00:35:43,398][123091] Updated weights for policy 0, policy_version 126924 (0.0005) [2023-12-26 00:35:43,454][123091] Updated weights for policy 0, policy_version 126934 (0.0005) [2023-12-26 00:35:43,502][123091] Updated weights for policy 0, policy_version 126944 (0.0006) [2023-12-26 00:35:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 64856064. Throughput: 0: 9066.7, 1: 9002.2. Samples: 64847312. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:43,785][121949] Avg episode reward: [(0, '5557.512'), (1, '5719.290')] [2023-12-26 00:35:43,786][123007] Saving new best policy, reward=5557.512! [2023-12-26 00:35:44,143][123090] Updated weights for policy 1, policy_version 126406 (0.0009) [2023-12-26 00:35:44,192][123090] Updated weights for policy 1, policy_version 126416 (0.0009) [2023-12-26 00:35:44,244][123091] Updated weights for policy 0, policy_version 126954 (0.0006) [2023-12-26 00:35:44,249][123090] Updated weights for policy 1, policy_version 126426 (0.0009) [2023-12-26 00:35:44,305][123091] Updated weights for policy 0, policy_version 126964 (0.0006) [2023-12-26 00:35:44,372][123091] Updated weights for policy 0, policy_version 126974 (0.0005) [2023-12-26 00:35:45,110][123090] Updated weights for policy 1, policy_version 126436 (0.0008) [2023-12-26 00:35:45,183][123090] Updated weights for policy 1, policy_version 126446 (0.0010) [2023-12-26 00:35:45,200][123091] Updated weights for policy 0, policy_version 126984 (0.0011) [2023-12-26 00:35:45,250][123090] Updated weights for policy 1, policy_version 126456 (0.0008) [2023-12-26 00:35:45,269][123091] Updated weights for policy 0, policy_version 126994 (0.0011) [2023-12-26 00:35:45,342][123091] Updated weights for policy 0, policy_version 127004 (0.0011) [2023-12-26 00:35:46,031][123090] Updated weights for policy 1, policy_version 126466 (0.0007) [2023-12-26 00:35:46,090][123090] Updated weights for policy 1, policy_version 126476 (0.0008) [2023-12-26 00:35:46,116][123091] Updated weights for policy 0, policy_version 127014 (0.0008) [2023-12-26 00:35:46,142][123090] Updated weights for policy 1, policy_version 126486 (0.0007) [2023-12-26 00:35:46,167][123091] Updated weights for policy 0, policy_version 127024 (0.0005) [2023-12-26 00:35:46,200][123090] Updated weights for policy 1, policy_version 126496 (0.0010) [2023-12-26 00:35:46,215][123091] Updated weights for policy 0, policy_version 127034 (0.0005) [2023-12-26 00:35:46,977][123091] Updated weights for policy 0, policy_version 127044 (0.0007) [2023-12-26 00:35:47,003][123090] Updated weights for policy 1, policy_version 126506 (0.0008) [2023-12-26 00:35:47,027][123091] Updated weights for policy 0, policy_version 127054 (0.0008) [2023-12-26 00:35:47,057][123090] Updated weights for policy 1, policy_version 126516 (0.0009) [2023-12-26 00:35:47,071][123091] Updated weights for policy 0, policy_version 127064 (0.0010) [2023-12-26 00:35:47,108][123090] Updated weights for policy 1, policy_version 126526 (0.0005) [2023-12-26 00:35:47,914][123091] Updated weights for policy 0, policy_version 127074 (0.0010) [2023-12-26 00:35:47,930][123090] Updated weights for policy 1, policy_version 126536 (0.0008) [2023-12-26 00:35:47,976][123091] Updated weights for policy 0, policy_version 127084 (0.0010) [2023-12-26 00:35:47,991][123090] Updated weights for policy 1, policy_version 126546 (0.0007) [2023-12-26 00:35:48,040][123091] Updated weights for policy 0, policy_version 127094 (0.0011) [2023-12-26 00:35:48,048][123090] Updated weights for policy 1, policy_version 126556 (0.0008) [2023-12-26 00:35:48,098][123091] Updated weights for policy 0, policy_version 127104 (0.0010) [2023-12-26 00:35:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 64937984. Throughput: 0: 9076.1, 1: 8962.8. Samples: 64954484. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:48,784][121949] Avg episode reward: [(0, '5509.453'), (1, '5788.876')] [2023-12-26 00:35:48,864][123090] Updated weights for policy 1, policy_version 126566 (0.0010) [2023-12-26 00:35:48,928][123091] Updated weights for policy 0, policy_version 127114 (0.0008) [2023-12-26 00:35:48,930][123090] Updated weights for policy 1, policy_version 126576 (0.0009) [2023-12-26 00:35:48,985][123091] Updated weights for policy 0, policy_version 127124 (0.0007) [2023-12-26 00:35:48,994][123090] Updated weights for policy 1, policy_version 126586 (0.0009) [2023-12-26 00:35:49,040][123091] Updated weights for policy 0, policy_version 127134 (0.0008) [2023-12-26 00:35:49,767][123090] Updated weights for policy 1, policy_version 126596 (0.0009) [2023-12-26 00:35:49,795][123091] Updated weights for policy 0, policy_version 127144 (0.0007) [2023-12-26 00:35:49,823][123090] Updated weights for policy 1, policy_version 126606 (0.0011) [2023-12-26 00:35:49,857][123091] Updated weights for policy 0, policy_version 127154 (0.0008) [2023-12-26 00:35:49,891][123090] Updated weights for policy 1, policy_version 126616 (0.0010) [2023-12-26 00:35:49,916][123091] Updated weights for policy 0, policy_version 127164 (0.0009) [2023-12-26 00:35:50,733][123090] Updated weights for policy 1, policy_version 126626 (0.0011) [2023-12-26 00:35:50,792][123091] Updated weights for policy 0, policy_version 127174 (0.0009) [2023-12-26 00:35:50,797][123090] Updated weights for policy 1, policy_version 126636 (0.0007) [2023-12-26 00:35:50,850][123091] Updated weights for policy 0, policy_version 127184 (0.0010) [2023-12-26 00:35:50,853][123090] Updated weights for policy 1, policy_version 126646 (0.0005) [2023-12-26 00:35:50,907][123091] Updated weights for policy 0, policy_version 127194 (0.0009) [2023-12-26 00:35:50,909][123090] Updated weights for policy 1, policy_version 126656 (0.0005) [2023-12-26 00:35:51,666][123090] Updated weights for policy 1, policy_version 126666 (0.0011) [2023-12-26 00:35:51,710][123090] Updated weights for policy 1, policy_version 126676 (0.0010) [2023-12-26 00:35:51,767][123091] Updated weights for policy 0, policy_version 127204 (0.0008) [2023-12-26 00:35:51,786][123090] Updated weights for policy 1, policy_version 126686 (0.0011) [2023-12-26 00:35:51,833][123091] Updated weights for policy 0, policy_version 127214 (0.0006) [2023-12-26 00:35:51,895][123091] Updated weights for policy 0, policy_version 127224 (0.0006) [2023-12-26 00:35:52,665][123090] Updated weights for policy 1, policy_version 126696 (0.0010) [2023-12-26 00:35:52,710][123091] Updated weights for policy 0, policy_version 127234 (0.0008) [2023-12-26 00:35:52,723][123090] Updated weights for policy 1, policy_version 126706 (0.0009) [2023-12-26 00:35:52,759][123091] Updated weights for policy 0, policy_version 127244 (0.0010) [2023-12-26 00:35:52,786][123090] Updated weights for policy 1, policy_version 126716 (0.0008) [2023-12-26 00:35:52,822][123091] Updated weights for policy 0, policy_version 127254 (0.0007) [2023-12-26 00:35:52,891][123091] Updated weights for policy 0, policy_version 127264 (0.0009) [2023-12-26 00:35:53,601][123090] Updated weights for policy 1, policy_version 126726 (0.0009) [2023-12-26 00:35:53,653][123090] Updated weights for policy 1, policy_version 126736 (0.0008) [2023-12-26 00:35:53,705][123090] Updated weights for policy 1, policy_version 126746 (0.0009) [2023-12-26 00:35:53,748][123091] Updated weights for policy 0, policy_version 127274 (0.0008) [2023-12-26 00:35:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 65028096. Throughput: 0: 9045.9, 1: 8959.3. Samples: 65006484. Policy #0 lag: (min: 31.0, avg: 46.2, max: 63.0) [2023-12-26 00:35:53,785][121949] Avg episode reward: [(0, '5408.882'), (1, '5831.451')] [2023-12-26 00:35:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000126752_32448512.pth... [2023-12-26 00:35:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000125696_32178176.pth [2023-12-26 00:35:53,794][123008] Saving new best policy, reward=5831.451! [2023-12-26 00:35:53,815][123091] Updated weights for policy 0, policy_version 127284 (0.0010) [2023-12-26 00:35:53,873][123091] Updated weights for policy 0, policy_version 127294 (0.0009) [2023-12-26 00:35:53,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000127296_32587776.pth... [2023-12-26 00:35:53,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000126208_32309248.pth [2023-12-26 00:35:54,454][123090] Updated weights for policy 1, policy_version 126756 (0.0007) [2023-12-26 00:35:54,513][123090] Updated weights for policy 1, policy_version 126766 (0.0006) [2023-12-26 00:35:54,583][123090] Updated weights for policy 1, policy_version 126776 (0.0008) [2023-12-26 00:35:54,607][123091] Updated weights for policy 0, policy_version 127304 (0.0006) [2023-12-26 00:35:54,662][123091] Updated weights for policy 0, policy_version 127314 (0.0005) [2023-12-26 00:35:54,728][123091] Updated weights for policy 0, policy_version 127324 (0.0005) [2023-12-26 00:35:55,261][123090] Updated weights for policy 1, policy_version 126786 (0.0008) [2023-12-26 00:35:55,318][123090] Updated weights for policy 1, policy_version 126796 (0.0005) [2023-12-26 00:35:55,367][123090] Updated weights for policy 1, policy_version 126806 (0.0005) [2023-12-26 00:35:55,419][123090] Updated weights for policy 1, policy_version 126816 (0.0005) [2023-12-26 00:35:55,421][123091] Updated weights for policy 0, policy_version 127334 (0.0007) [2023-12-26 00:35:55,480][123091] Updated weights for policy 0, policy_version 127344 (0.0009) [2023-12-26 00:35:55,542][123091] Updated weights for policy 0, policy_version 127354 (0.0008) [2023-12-26 00:35:56,226][123090] Updated weights for policy 1, policy_version 126826 (0.0005) [2023-12-26 00:35:56,301][123090] Updated weights for policy 1, policy_version 126836 (0.0006) [2023-12-26 00:35:56,312][123091] Updated weights for policy 0, policy_version 127364 (0.0008) [2023-12-26 00:35:56,358][123090] Updated weights for policy 1, policy_version 126846 (0.0006) [2023-12-26 00:35:56,374][123091] Updated weights for policy 0, policy_version 127374 (0.0009) [2023-12-26 00:35:56,430][123091] Updated weights for policy 0, policy_version 127384 (0.0010) [2023-12-26 00:35:57,102][123090] Updated weights for policy 1, policy_version 126856 (0.0010) [2023-12-26 00:35:57,162][123090] Updated weights for policy 1, policy_version 126866 (0.0010) [2023-12-26 00:35:57,225][123090] Updated weights for policy 1, policy_version 126876 (0.0010) [2023-12-26 00:35:57,255][123091] Updated weights for policy 0, policy_version 127394 (0.0009) [2023-12-26 00:35:57,318][123091] Updated weights for policy 0, policy_version 127404 (0.0006) [2023-12-26 00:35:57,379][123091] Updated weights for policy 0, policy_version 127414 (0.0005) [2023-12-26 00:35:57,425][123091] Updated weights for policy 0, policy_version 127424 (0.0005) [2023-12-26 00:35:58,050][123090] Updated weights for policy 1, policy_version 126886 (0.0010) [2023-12-26 00:35:58,077][123091] Updated weights for policy 0, policy_version 127434 (0.0011) [2023-12-26 00:35:58,109][123090] Updated weights for policy 1, policy_version 126896 (0.0010) [2023-12-26 00:35:58,144][123091] Updated weights for policy 0, policy_version 127444 (0.0007) [2023-12-26 00:35:58,169][123090] Updated weights for policy 1, policy_version 126906 (0.0010) [2023-12-26 00:35:58,208][123091] Updated weights for policy 0, policy_version 127454 (0.0008) [2023-12-26 00:35:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 65118208. Throughput: 0: 9079.4, 1: 9023.7. Samples: 65113832. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:35:58,785][121949] Avg episode reward: [(0, '5480.770'), (1, '5815.495')] [2023-12-26 00:35:58,949][123091] Updated weights for policy 0, policy_version 127464 (0.0009) [2023-12-26 00:35:59,012][123091] Updated weights for policy 0, policy_version 127474 (0.0011) [2023-12-26 00:35:59,027][123090] Updated weights for policy 1, policy_version 126916 (0.0009) [2023-12-26 00:35:59,060][123091] Updated weights for policy 0, policy_version 127484 (0.0010) [2023-12-26 00:35:59,075][123090] Updated weights for policy 1, policy_version 126926 (0.0010) [2023-12-26 00:35:59,125][123090] Updated weights for policy 1, policy_version 126936 (0.0010) [2023-12-26 00:35:59,872][123091] Updated weights for policy 0, policy_version 127494 (0.0010) [2023-12-26 00:35:59,898][123090] Updated weights for policy 1, policy_version 126946 (0.0007) [2023-12-26 00:35:59,924][123091] Updated weights for policy 0, policy_version 127504 (0.0008) [2023-12-26 00:35:59,961][123090] Updated weights for policy 1, policy_version 126956 (0.0008) [2023-12-26 00:35:59,989][123091] Updated weights for policy 0, policy_version 127514 (0.0008) [2023-12-26 00:36:00,019][123090] Updated weights for policy 1, policy_version 126966 (0.0008) [2023-12-26 00:36:00,068][123090] Updated weights for policy 1, policy_version 126976 (0.0009) [2023-12-26 00:36:00,806][123091] Updated weights for policy 0, policy_version 127524 (0.0008) [2023-12-26 00:36:00,874][123091] Updated weights for policy 0, policy_version 127534 (0.0006) [2023-12-26 00:36:00,932][123090] Updated weights for policy 1, policy_version 126986 (0.0009) [2023-12-26 00:36:00,939][123091] Updated weights for policy 0, policy_version 127544 (0.0009) [2023-12-26 00:36:00,992][123090] Updated weights for policy 1, policy_version 126996 (0.0008) [2023-12-26 00:36:01,064][123090] Updated weights for policy 1, policy_version 127006 (0.0009) [2023-12-26 00:36:01,756][123091] Updated weights for policy 0, policy_version 127554 (0.0008) [2023-12-26 00:36:01,816][123091] Updated weights for policy 0, policy_version 127564 (0.0010) [2023-12-26 00:36:01,832][123090] Updated weights for policy 1, policy_version 127016 (0.0008) [2023-12-26 00:36:01,869][123091] Updated weights for policy 0, policy_version 127574 (0.0009) [2023-12-26 00:36:01,880][123090] Updated weights for policy 1, policy_version 127026 (0.0008) [2023-12-26 00:36:01,926][123091] Updated weights for policy 0, policy_version 127584 (0.0007) [2023-12-26 00:36:01,934][123090] Updated weights for policy 1, policy_version 127036 (0.0007) [2023-12-26 00:36:02,753][123090] Updated weights for policy 1, policy_version 127046 (0.0008) [2023-12-26 00:36:02,794][123091] Updated weights for policy 0, policy_version 127594 (0.0009) [2023-12-26 00:36:02,811][123090] Updated weights for policy 1, policy_version 127056 (0.0008) [2023-12-26 00:36:02,864][123091] Updated weights for policy 0, policy_version 127604 (0.0009) [2023-12-26 00:36:02,873][123090] Updated weights for policy 1, policy_version 127066 (0.0006) [2023-12-26 00:36:02,929][123091] Updated weights for policy 0, policy_version 127614 (0.0009) [2023-12-26 00:36:03,558][123090] Updated weights for policy 1, policy_version 127076 (0.0005) [2023-12-26 00:36:03,619][123090] Updated weights for policy 1, policy_version 127086 (0.0006) [2023-12-26 00:36:03,624][123091] Updated weights for policy 0, policy_version 127624 (0.0006) [2023-12-26 00:36:03,672][123090] Updated weights for policy 1, policy_version 127096 (0.0007) [2023-12-26 00:36:03,678][123091] Updated weights for policy 0, policy_version 127634 (0.0005) [2023-12-26 00:36:03,732][123091] Updated weights for policy 0, policy_version 127644 (0.0005) [2023-12-26 00:36:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 65216512. Throughput: 0: 9017.7, 1: 8970.8. Samples: 65222280. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:03,785][121949] Avg episode reward: [(0, '5617.484'), (1, '5783.812')] [2023-12-26 00:36:03,786][123007] Saving new best policy, reward=5617.484! [2023-12-26 00:36:04,436][123091] Updated weights for policy 0, policy_version 127654 (0.0007) [2023-12-26 00:36:04,486][123090] Updated weights for policy 1, policy_version 127106 (0.0009) [2023-12-26 00:36:04,487][123091] Updated weights for policy 0, policy_version 127664 (0.0010) [2023-12-26 00:36:04,541][123091] Updated weights for policy 0, policy_version 127674 (0.0009) [2023-12-26 00:36:04,547][123090] Updated weights for policy 1, policy_version 127116 (0.0008) [2023-12-26 00:36:04,615][123090] Updated weights for policy 1, policy_version 127126 (0.0011) [2023-12-26 00:36:04,680][123090] Updated weights for policy 1, policy_version 127136 (0.0010) [2023-12-26 00:36:05,293][123090] Updated weights for policy 1, policy_version 127146 (0.0005) [2023-12-26 00:36:05,353][123090] Updated weights for policy 1, policy_version 127156 (0.0005) [2023-12-26 00:36:05,422][123090] Updated weights for policy 1, policy_version 127166 (0.0005) [2023-12-26 00:36:05,427][123091] Updated weights for policy 0, policy_version 127684 (0.0006) [2023-12-26 00:36:05,495][123091] Updated weights for policy 0, policy_version 127694 (0.0006) [2023-12-26 00:36:05,553][123091] Updated weights for policy 0, policy_version 127704 (0.0006) [2023-12-26 00:36:06,124][123090] Updated weights for policy 1, policy_version 127176 (0.0007) [2023-12-26 00:36:06,197][123090] Updated weights for policy 1, policy_version 127186 (0.0008) [2023-12-26 00:36:06,252][123090] Updated weights for policy 1, policy_version 127196 (0.0007) [2023-12-26 00:36:06,255][123091] Updated weights for policy 0, policy_version 127714 (0.0005) [2023-12-26 00:36:06,321][123091] Updated weights for policy 0, policy_version 127724 (0.0006) [2023-12-26 00:36:06,389][123091] Updated weights for policy 0, policy_version 127734 (0.0009) [2023-12-26 00:36:06,451][123091] Updated weights for policy 0, policy_version 127744 (0.0006) [2023-12-26 00:36:07,032][123090] Updated weights for policy 1, policy_version 127206 (0.0007) [2023-12-26 00:36:07,098][123090] Updated weights for policy 1, policy_version 127216 (0.0005) [2023-12-26 00:36:07,128][123091] Updated weights for policy 0, policy_version 127754 (0.0009) [2023-12-26 00:36:07,161][123090] Updated weights for policy 1, policy_version 127226 (0.0005) [2023-12-26 00:36:07,177][123091] Updated weights for policy 0, policy_version 127764 (0.0009) [2023-12-26 00:36:07,230][123091] Updated weights for policy 0, policy_version 127774 (0.0010) [2023-12-26 00:36:07,703][123090] Updated weights for policy 1, policy_version 127236 (0.0005) [2023-12-26 00:36:07,776][123090] Updated weights for policy 1, policy_version 127246 (0.0011) [2023-12-26 00:36:07,842][123090] Updated weights for policy 1, policy_version 127256 (0.0008) [2023-12-26 00:36:08,193][123091] Updated weights for policy 0, policy_version 127784 (0.0010) [2023-12-26 00:36:08,252][123091] Updated weights for policy 0, policy_version 127794 (0.0010) [2023-12-26 00:36:08,315][123091] Updated weights for policy 0, policy_version 127804 (0.0010) [2023-12-26 00:36:08,532][123090] Updated weights for policy 1, policy_version 127266 (0.0006) [2023-12-26 00:36:08,609][123090] Updated weights for policy 1, policy_version 127276 (0.0006) [2023-12-26 00:36:08,680][123090] Updated weights for policy 1, policy_version 127286 (0.0006) [2023-12-26 00:36:08,749][123090] Updated weights for policy 1, policy_version 127296 (0.0006) [2023-12-26 00:36:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 65306624. Throughput: 0: 9058.2, 1: 9027.3. Samples: 65277600. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:08,785][121949] Avg episode reward: [(0, '5668.382'), (1, '5783.996')] [2023-12-26 00:36:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000127808_32718848.pth... [2023-12-26 00:36:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000127296_32587776.pth... [2023-12-26 00:36:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000126752_32448512.pth [2023-12-26 00:36:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000126240_32317440.pth [2023-12-26 00:36:08,797][123007] Saving new best policy, reward=5668.382! [2023-12-26 00:36:09,216][123091] Updated weights for policy 0, policy_version 127814 (0.0009) [2023-12-26 00:36:09,286][123091] Updated weights for policy 0, policy_version 127824 (0.0010) [2023-12-26 00:36:09,344][123091] Updated weights for policy 0, policy_version 127834 (0.0010) [2023-12-26 00:36:09,444][123090] Updated weights for policy 1, policy_version 127306 (0.0010) [2023-12-26 00:36:09,511][123090] Updated weights for policy 1, policy_version 127316 (0.0006) [2023-12-26 00:36:09,571][123090] Updated weights for policy 1, policy_version 127326 (0.0007) [2023-12-26 00:36:10,223][123091] Updated weights for policy 0, policy_version 127844 (0.0011) [2023-12-26 00:36:10,287][123091] Updated weights for policy 0, policy_version 127854 (0.0011) [2023-12-26 00:36:10,326][123090] Updated weights for policy 1, policy_version 127336 (0.0008) [2023-12-26 00:36:10,359][123091] Updated weights for policy 0, policy_version 127864 (0.0009) [2023-12-26 00:36:10,388][123090] Updated weights for policy 1, policy_version 127346 (0.0010) [2023-12-26 00:36:10,439][123090] Updated weights for policy 1, policy_version 127356 (0.0010) [2023-12-26 00:36:11,163][123091] Updated weights for policy 0, policy_version 127874 (0.0010) [2023-12-26 00:36:11,231][123091] Updated weights for policy 0, policy_version 127884 (0.0011) [2023-12-26 00:36:11,277][123090] Updated weights for policy 1, policy_version 127366 (0.0010) [2023-12-26 00:36:11,300][123091] Updated weights for policy 0, policy_version 127894 (0.0011) [2023-12-26 00:36:11,349][123090] Updated weights for policy 1, policy_version 127376 (0.0011) [2023-12-26 00:36:11,417][123090] Updated weights for policy 1, policy_version 127386 (0.0009) [2023-12-26 00:36:12,166][123091] Updated weights for policy 0, policy_version 127905 (0.0011) [2023-12-26 00:36:12,210][123090] Updated weights for policy 1, policy_version 127396 (0.0008) [2023-12-26 00:36:12,226][123091] Updated weights for policy 0, policy_version 127915 (0.0009) [2023-12-26 00:36:12,273][123090] Updated weights for policy 1, policy_version 127406 (0.0008) [2023-12-26 00:36:12,288][123091] Updated weights for policy 0, policy_version 127925 (0.0009) [2023-12-26 00:36:12,339][123090] Updated weights for policy 1, policy_version 127416 (0.0009) [2023-12-26 00:36:12,354][123091] Updated weights for policy 0, policy_version 127935 (0.0007) [2023-12-26 00:36:13,110][123090] Updated weights for policy 1, policy_version 127426 (0.0008) [2023-12-26 00:36:13,160][123090] Updated weights for policy 1, policy_version 127436 (0.0008) [2023-12-26 00:36:13,207][123091] Updated weights for policy 0, policy_version 127945 (0.0008) [2023-12-26 00:36:13,220][123090] Updated weights for policy 1, policy_version 127446 (0.0009) [2023-12-26 00:36:13,262][123091] Updated weights for policy 0, policy_version 127955 (0.0008) [2023-12-26 00:36:13,273][123090] Updated weights for policy 1, policy_version 127456 (0.0010) [2023-12-26 00:36:13,309][123091] Updated weights for policy 0, policy_version 127965 (0.0008) [2023-12-26 00:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 65388544. Throughput: 0: 8955.0, 1: 9041.6. Samples: 65382540. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:13,785][121949] Avg episode reward: [(0, '5646.821'), (1, '5781.294')] [2023-12-26 00:36:13,992][123090] Updated weights for policy 1, policy_version 127466 (0.0008) [2023-12-26 00:36:14,054][123090] Updated weights for policy 1, policy_version 127476 (0.0010) [2023-12-26 00:36:14,120][123090] Updated weights for policy 1, policy_version 127486 (0.0010) [2023-12-26 00:36:14,219][123091] Updated weights for policy 0, policy_version 127976 (0.0009) [2023-12-26 00:36:14,287][123091] Updated weights for policy 0, policy_version 127986 (0.0009) [2023-12-26 00:36:14,350][123091] Updated weights for policy 0, policy_version 127996 (0.0009) [2023-12-26 00:36:14,870][123090] Updated weights for policy 1, policy_version 127496 (0.0008) [2023-12-26 00:36:14,918][123090] Updated weights for policy 1, policy_version 127506 (0.0008) [2023-12-26 00:36:14,974][123090] Updated weights for policy 1, policy_version 127516 (0.0005) [2023-12-26 00:36:15,207][123091] Updated weights for policy 0, policy_version 128006 (0.0008) [2023-12-26 00:36:15,264][123091] Updated weights for policy 0, policy_version 128016 (0.0011) [2023-12-26 00:36:15,324][123091] Updated weights for policy 0, policy_version 128026 (0.0011) [2023-12-26 00:36:15,778][123090] Updated weights for policy 1, policy_version 127526 (0.0008) [2023-12-26 00:36:15,843][123090] Updated weights for policy 1, policy_version 127536 (0.0009) [2023-12-26 00:36:15,908][123090] Updated weights for policy 1, policy_version 127546 (0.0009) [2023-12-26 00:36:16,155][123091] Updated weights for policy 0, policy_version 128036 (0.0011) [2023-12-26 00:36:16,224][123091] Updated weights for policy 0, policy_version 128046 (0.0011) [2023-12-26 00:36:16,277][123091] Updated weights for policy 0, policy_version 128056 (0.0011) [2023-12-26 00:36:16,781][123090] Updated weights for policy 1, policy_version 127556 (0.0009) [2023-12-26 00:36:16,828][123090] Updated weights for policy 1, policy_version 127566 (0.0006) [2023-12-26 00:36:16,874][123090] Updated weights for policy 1, policy_version 127576 (0.0005) [2023-12-26 00:36:17,024][123091] Updated weights for policy 0, policy_version 128066 (0.0010) [2023-12-26 00:36:17,087][123091] Updated weights for policy 0, policy_version 128076 (0.0008) [2023-12-26 00:36:17,150][123091] Updated weights for policy 0, policy_version 128086 (0.0008) [2023-12-26 00:36:17,218][123091] Updated weights for policy 0, policy_version 128096 (0.0009) [2023-12-26 00:36:17,560][123090] Updated weights for policy 1, policy_version 127586 (0.0005) [2023-12-26 00:36:17,616][123090] Updated weights for policy 1, policy_version 127596 (0.0005) [2023-12-26 00:36:17,675][123090] Updated weights for policy 1, policy_version 127606 (0.0009) [2023-12-26 00:36:18,002][123091] Updated weights for policy 0, policy_version 128106 (0.0006) [2023-12-26 00:36:18,069][123091] Updated weights for policy 0, policy_version 128116 (0.0005) [2023-12-26 00:36:18,137][123091] Updated weights for policy 0, policy_version 128126 (0.0005) [2023-12-26 00:36:18,365][123090] Updated weights for policy 1, policy_version 127617 (0.0008) [2023-12-26 00:36:18,425][123090] Updated weights for policy 1, policy_version 127627 (0.0010) [2023-12-26 00:36:18,480][123090] Updated weights for policy 1, policy_version 127637 (0.0010) [2023-12-26 00:36:18,539][123090] Updated weights for policy 1, policy_version 127647 (0.0010) [2023-12-26 00:36:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 65478656. Throughput: 0: 8836.3, 1: 9101.6. Samples: 65490696. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:18,785][121949] Avg episode reward: [(0, '5646.416'), (1, '5793.708')] [2023-12-26 00:36:18,892][123091] Updated weights for policy 0, policy_version 128136 (0.0010) [2023-12-26 00:36:18,955][123091] Updated weights for policy 0, policy_version 128146 (0.0011) [2023-12-26 00:36:19,021][123091] Updated weights for policy 0, policy_version 128156 (0.0010) [2023-12-26 00:36:19,378][123090] Updated weights for policy 1, policy_version 127657 (0.0008) [2023-12-26 00:36:19,434][123090] Updated weights for policy 1, policy_version 127667 (0.0007) [2023-12-26 00:36:19,500][123090] Updated weights for policy 1, policy_version 127677 (0.0009) [2023-12-26 00:36:19,846][123091] Updated weights for policy 0, policy_version 128166 (0.0009) [2023-12-26 00:36:19,913][123091] Updated weights for policy 0, policy_version 128176 (0.0011) [2023-12-26 00:36:19,986][123091] Updated weights for policy 0, policy_version 128186 (0.0007) [2023-12-26 00:36:20,337][123090] Updated weights for policy 1, policy_version 127687 (0.0009) [2023-12-26 00:36:20,405][123090] Updated weights for policy 1, policy_version 127697 (0.0008) [2023-12-26 00:36:20,468][123090] Updated weights for policy 1, policy_version 127707 (0.0009) [2023-12-26 00:36:20,702][123091] Updated weights for policy 0, policy_version 128196 (0.0007) [2023-12-26 00:36:20,756][123091] Updated weights for policy 0, policy_version 128206 (0.0007) [2023-12-26 00:36:20,823][123091] Updated weights for policy 0, policy_version 128216 (0.0006) [2023-12-26 00:36:21,363][123090] Updated weights for policy 1, policy_version 127717 (0.0010) [2023-12-26 00:36:21,435][123090] Updated weights for policy 1, policy_version 127727 (0.0009) [2023-12-26 00:36:21,503][123090] Updated weights for policy 1, policy_version 127737 (0.0009) [2023-12-26 00:36:21,556][123091] Updated weights for policy 0, policy_version 128226 (0.0006) [2023-12-26 00:36:21,625][123091] Updated weights for policy 0, policy_version 128236 (0.0008) [2023-12-26 00:36:21,695][123091] Updated weights for policy 0, policy_version 128246 (0.0010) [2023-12-26 00:36:21,769][123091] Updated weights for policy 0, policy_version 128256 (0.0009) [2023-12-26 00:36:22,391][123090] Updated weights for policy 1, policy_version 127747 (0.0009) [2023-12-26 00:36:22,456][123090] Updated weights for policy 1, policy_version 127757 (0.0009) [2023-12-26 00:36:22,519][123090] Updated weights for policy 1, policy_version 127767 (0.0008) [2023-12-26 00:36:22,626][123091] Updated weights for policy 0, policy_version 128266 (0.0009) [2023-12-26 00:36:22,695][123091] Updated weights for policy 0, policy_version 128276 (0.0009) [2023-12-26 00:36:22,763][123091] Updated weights for policy 0, policy_version 128286 (0.0009) [2023-12-26 00:36:23,320][123090] Updated weights for policy 1, policy_version 127777 (0.0009) [2023-12-26 00:36:23,373][123090] Updated weights for policy 1, policy_version 127787 (0.0009) [2023-12-26 00:36:23,422][123090] Updated weights for policy 1, policy_version 127797 (0.0009) [2023-12-26 00:36:23,473][123090] Updated weights for policy 1, policy_version 127807 (0.0009) [2023-12-26 00:36:23,578][123091] Updated weights for policy 0, policy_version 128296 (0.0010) [2023-12-26 00:36:23,646][123091] Updated weights for policy 0, policy_version 128306 (0.0005) [2023-12-26 00:36:23,703][123091] Updated weights for policy 0, policy_version 128316 (0.0005) [2023-12-26 00:36:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 65568768. Throughput: 0: 8834.9, 1: 8978.2. Samples: 65542332. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:23,785][121949] Avg episode reward: [(0, '5604.076'), (1, '5776.000')] [2023-12-26 00:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000128320_32849920.pth... [2023-12-26 00:36:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000127808_32718848.pth... [2023-12-26 00:36:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000127296_32587776.pth [2023-12-26 00:36:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000126752_32448512.pth [2023-12-26 00:36:24,352][123090] Updated weights for policy 1, policy_version 127817 (0.0009) [2023-12-26 00:36:24,405][123090] Updated weights for policy 1, policy_version 127827 (0.0009) [2023-12-26 00:36:24,445][123091] Updated weights for policy 0, policy_version 128326 (0.0007) [2023-12-26 00:36:24,463][123090] Updated weights for policy 1, policy_version 127837 (0.0008) [2023-12-26 00:36:24,502][123091] Updated weights for policy 0, policy_version 128336 (0.0009) [2023-12-26 00:36:24,558][123091] Updated weights for policy 0, policy_version 128346 (0.0009) [2023-12-26 00:36:25,290][123090] Updated weights for policy 1, policy_version 127847 (0.0009) [2023-12-26 00:36:25,352][123090] Updated weights for policy 1, policy_version 127857 (0.0008) [2023-12-26 00:36:25,358][123091] Updated weights for policy 0, policy_version 128356 (0.0010) [2023-12-26 00:36:25,407][123090] Updated weights for policy 1, policy_version 127867 (0.0006) [2023-12-26 00:36:25,414][123091] Updated weights for policy 0, policy_version 128366 (0.0010) [2023-12-26 00:36:25,482][123091] Updated weights for policy 0, policy_version 128376 (0.0009) [2023-12-26 00:36:26,124][123090] Updated weights for policy 1, policy_version 127877 (0.0008) [2023-12-26 00:36:26,190][123090] Updated weights for policy 1, policy_version 127887 (0.0010) [2023-12-26 00:36:26,260][123090] Updated weights for policy 1, policy_version 127897 (0.0010) [2023-12-26 00:36:26,347][123091] Updated weights for policy 0, policy_version 128386 (0.0009) [2023-12-26 00:36:26,411][123091] Updated weights for policy 0, policy_version 128396 (0.0010) [2023-12-26 00:36:26,462][123091] Updated weights for policy 0, policy_version 128406 (0.0009) [2023-12-26 00:36:26,516][123091] Updated weights for policy 0, policy_version 128416 (0.0009) [2023-12-26 00:36:27,117][123090] Updated weights for policy 1, policy_version 127907 (0.0008) [2023-12-26 00:36:27,181][123090] Updated weights for policy 1, policy_version 127917 (0.0008) [2023-12-26 00:36:27,207][123091] Updated weights for policy 0, policy_version 128426 (0.0008) [2023-12-26 00:36:27,229][123090] Updated weights for policy 1, policy_version 127927 (0.0007) [2023-12-26 00:36:27,262][123091] Updated weights for policy 0, policy_version 128436 (0.0008) [2023-12-26 00:36:27,328][123091] Updated weights for policy 0, policy_version 128446 (0.0009) [2023-12-26 00:36:27,960][123090] Updated weights for policy 1, policy_version 127937 (0.0009) [2023-12-26 00:36:28,016][123090] Updated weights for policy 1, policy_version 127947 (0.0009) [2023-12-26 00:36:28,065][123090] Updated weights for policy 1, policy_version 127957 (0.0009) [2023-12-26 00:36:28,126][123090] Updated weights for policy 1, policy_version 127967 (0.0009) [2023-12-26 00:36:28,141][123091] Updated weights for policy 0, policy_version 128456 (0.0009) [2023-12-26 00:36:28,188][123091] Updated weights for policy 0, policy_version 128466 (0.0009) [2023-12-26 00:36:28,234][123091] Updated weights for policy 0, policy_version 128476 (0.0009) [2023-12-26 00:36:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 65650688. Throughput: 0: 8810.8, 1: 8949.2. Samples: 65646508. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:28,785][121949] Avg episode reward: [(0, '5592.665'), (1, '5748.500')] [2023-12-26 00:36:28,923][123090] Updated weights for policy 1, policy_version 127977 (0.0009) [2023-12-26 00:36:28,977][123090] Updated weights for policy 1, policy_version 127987 (0.0009) [2023-12-26 00:36:29,034][123090] Updated weights for policy 1, policy_version 127998 (0.0009) [2023-12-26 00:36:29,160][123091] Updated weights for policy 0, policy_version 128486 (0.0010) [2023-12-26 00:36:29,236][123091] Updated weights for policy 0, policy_version 128496 (0.0010) [2023-12-26 00:36:29,294][123091] Updated weights for policy 0, policy_version 128506 (0.0009) [2023-12-26 00:36:29,783][123090] Updated weights for policy 1, policy_version 128008 (0.0006) [2023-12-26 00:36:29,849][123090] Updated weights for policy 1, policy_version 128018 (0.0006) [2023-12-26 00:36:29,917][123090] Updated weights for policy 1, policy_version 128028 (0.0008) [2023-12-26 00:36:30,151][123091] Updated weights for policy 0, policy_version 128516 (0.0009) [2023-12-26 00:36:30,217][123091] Updated weights for policy 0, policy_version 128527 (0.0010) [2023-12-26 00:36:30,290][123091] Updated weights for policy 0, policy_version 128537 (0.0009) [2023-12-26 00:36:30,668][123090] Updated weights for policy 1, policy_version 128038 (0.0007) [2023-12-26 00:36:30,723][123090] Updated weights for policy 1, policy_version 128048 (0.0005) [2023-12-26 00:36:30,775][123090] Updated weights for policy 1, policy_version 128058 (0.0005) [2023-12-26 00:36:31,184][123091] Updated weights for policy 0, policy_version 128547 (0.0009) [2023-12-26 00:36:31,245][123091] Updated weights for policy 0, policy_version 128557 (0.0007) [2023-12-26 00:36:31,313][123091] Updated weights for policy 0, policy_version 128567 (0.0009) [2023-12-26 00:36:31,488][123090] Updated weights for policy 1, policy_version 128068 (0.0008) [2023-12-26 00:36:31,547][123090] Updated weights for policy 1, policy_version 128078 (0.0010) [2023-12-26 00:36:31,607][123090] Updated weights for policy 1, policy_version 128088 (0.0011) [2023-12-26 00:36:32,140][123091] Updated weights for policy 0, policy_version 128577 (0.0010) [2023-12-26 00:36:32,201][123091] Updated weights for policy 0, policy_version 128587 (0.0006) [2023-12-26 00:36:32,265][123091] Updated weights for policy 0, policy_version 128597 (0.0006) [2023-12-26 00:36:32,329][123091] Updated weights for policy 0, policy_version 128607 (0.0011) [2023-12-26 00:36:32,438][123090] Updated weights for policy 1, policy_version 128098 (0.0011) [2023-12-26 00:36:32,490][123090] Updated weights for policy 1, policy_version 128108 (0.0010) [2023-12-26 00:36:32,541][123090] Updated weights for policy 1, policy_version 128118 (0.0010) [2023-12-26 00:36:32,596][123090] Updated weights for policy 1, policy_version 128128 (0.0010) [2023-12-26 00:36:33,101][123091] Updated weights for policy 0, policy_version 128617 (0.0010) [2023-12-26 00:36:33,163][123091] Updated weights for policy 0, policy_version 128627 (0.0011) [2023-12-26 00:36:33,221][123091] Updated weights for policy 0, policy_version 128637 (0.0010) [2023-12-26 00:36:33,419][123090] Updated weights for policy 1, policy_version 128138 (0.0010) [2023-12-26 00:36:33,485][123090] Updated weights for policy 1, policy_version 128148 (0.0010) [2023-12-26 00:36:33,550][123090] Updated weights for policy 1, policy_version 128158 (0.0010) [2023-12-26 00:36:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 65740800. Throughput: 0: 8702.8, 1: 9001.6. Samples: 65751184. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:33,785][121949] Avg episode reward: [(0, '5650.692'), (1, '5725.856')] [2023-12-26 00:36:34,049][123091] Updated weights for policy 0, policy_version 128647 (0.0010) [2023-12-26 00:36:34,108][123091] Updated weights for policy 0, policy_version 128657 (0.0010) [2023-12-26 00:36:34,184][123091] Updated weights for policy 0, policy_version 128667 (0.0011) [2023-12-26 00:36:34,226][123090] Updated weights for policy 1, policy_version 128168 (0.0007) [2023-12-26 00:36:34,284][123090] Updated weights for policy 1, policy_version 128178 (0.0007) [2023-12-26 00:36:34,347][123090] Updated weights for policy 1, policy_version 128188 (0.0007) [2023-12-26 00:36:34,999][123091] Updated weights for policy 0, policy_version 128677 (0.0011) [2023-12-26 00:36:35,062][123091] Updated weights for policy 0, policy_version 128687 (0.0010) [2023-12-26 00:36:35,106][123090] Updated weights for policy 1, policy_version 128198 (0.0006) [2023-12-26 00:36:35,124][123091] Updated weights for policy 0, policy_version 128697 (0.0011) [2023-12-26 00:36:35,163][123090] Updated weights for policy 1, policy_version 128208 (0.0008) [2023-12-26 00:36:35,226][123090] Updated weights for policy 1, policy_version 128218 (0.0008) [2023-12-26 00:36:35,926][123091] Updated weights for policy 0, policy_version 128707 (0.0011) [2023-12-26 00:36:35,988][123091] Updated weights for policy 0, policy_version 128717 (0.0011) [2023-12-26 00:36:36,056][123091] Updated weights for policy 0, policy_version 128727 (0.0011) [2023-12-26 00:36:36,087][123090] Updated weights for policy 1, policy_version 128228 (0.0009) [2023-12-26 00:36:36,154][123090] Updated weights for policy 1, policy_version 128238 (0.0008) [2023-12-26 00:36:36,220][123090] Updated weights for policy 1, policy_version 128248 (0.0005) [2023-12-26 00:36:36,881][123091] Updated weights for policy 0, policy_version 128737 (0.0011) [2023-12-26 00:36:36,895][123090] Updated weights for policy 1, policy_version 128258 (0.0007) [2023-12-26 00:36:36,944][123091] Updated weights for policy 0, policy_version 128747 (0.0008) [2023-12-26 00:36:36,954][123090] Updated weights for policy 1, policy_version 128268 (0.0011) [2023-12-26 00:36:37,007][123091] Updated weights for policy 0, policy_version 128757 (0.0006) [2023-12-26 00:36:37,017][123090] Updated weights for policy 1, policy_version 128278 (0.0010) [2023-12-26 00:36:37,073][123090] Updated weights for policy 1, policy_version 128288 (0.0010) [2023-12-26 00:36:37,075][123091] Updated weights for policy 0, policy_version 128767 (0.0006) [2023-12-26 00:36:37,768][123091] Updated weights for policy 0, policy_version 128777 (0.0008) [2023-12-26 00:36:37,827][123091] Updated weights for policy 0, policy_version 128787 (0.0007) [2023-12-26 00:36:37,884][123091] Updated weights for policy 0, policy_version 128797 (0.0006) [2023-12-26 00:36:37,913][123090] Updated weights for policy 1, policy_version 128298 (0.0010) [2023-12-26 00:36:37,972][123090] Updated weights for policy 1, policy_version 128308 (0.0010) [2023-12-26 00:36:38,020][123090] Updated weights for policy 1, policy_version 128318 (0.0010) [2023-12-26 00:36:38,572][123091] Updated weights for policy 0, policy_version 128807 (0.0007) [2023-12-26 00:36:38,642][123091] Updated weights for policy 0, policy_version 128817 (0.0011) [2023-12-26 00:36:38,708][123091] Updated weights for policy 0, policy_version 128827 (0.0010) [2023-12-26 00:36:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 65830912. Throughput: 0: 8698.9, 1: 9035.5. Samples: 65804536. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:38,785][121949] Avg episode reward: [(0, '5696.467'), (1, '5756.393')] [2023-12-26 00:36:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000128832_32980992.pth... [2023-12-26 00:36:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000128320_32849920.pth... [2023-12-26 00:36:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000127808_32718848.pth [2023-12-26 00:36:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000127296_32587776.pth [2023-12-26 00:36:38,799][123007] Saving new best policy, reward=5696.467! [2023-12-26 00:36:38,870][123090] Updated weights for policy 1, policy_version 128328 (0.0008) [2023-12-26 00:36:38,919][123090] Updated weights for policy 1, policy_version 128338 (0.0009) [2023-12-26 00:36:38,982][123090] Updated weights for policy 1, policy_version 128349 (0.0010) [2023-12-26 00:36:39,515][123091] Updated weights for policy 0, policy_version 128837 (0.0010) [2023-12-26 00:36:39,577][123091] Updated weights for policy 0, policy_version 128847 (0.0009) [2023-12-26 00:36:39,628][123091] Updated weights for policy 0, policy_version 128857 (0.0009) [2023-12-26 00:36:39,844][123090] Updated weights for policy 1, policy_version 128359 (0.0007) [2023-12-26 00:36:39,911][123090] Updated weights for policy 1, policy_version 128369 (0.0008) [2023-12-26 00:36:39,981][123090] Updated weights for policy 1, policy_version 128379 (0.0008) [2023-12-26 00:36:40,537][123091] Updated weights for policy 0, policy_version 128867 (0.0010) [2023-12-26 00:36:40,597][123091] Updated weights for policy 0, policy_version 128877 (0.0009) [2023-12-26 00:36:40,658][123091] Updated weights for policy 0, policy_version 128887 (0.0009) [2023-12-26 00:36:40,739][123090] Updated weights for policy 1, policy_version 128389 (0.0008) [2023-12-26 00:36:40,788][123090] Updated weights for policy 1, policy_version 128399 (0.0009) [2023-12-26 00:36:40,842][123090] Updated weights for policy 1, policy_version 128409 (0.0007) [2023-12-26 00:36:41,534][123091] Updated weights for policy 0, policy_version 128897 (0.0010) [2023-12-26 00:36:41,606][123091] Updated weights for policy 0, policy_version 128907 (0.0010) [2023-12-26 00:36:41,632][123090] Updated weights for policy 1, policy_version 128419 (0.0006) [2023-12-26 00:36:41,678][123091] Updated weights for policy 0, policy_version 128917 (0.0007) [2023-12-26 00:36:41,703][123090] Updated weights for policy 1, policy_version 128429 (0.0009) [2023-12-26 00:36:41,748][123091] Updated weights for policy 0, policy_version 128927 (0.0008) [2023-12-26 00:36:41,777][123090] Updated weights for policy 1, policy_version 128439 (0.0009) [2023-12-26 00:36:42,604][123090] Updated weights for policy 1, policy_version 128449 (0.0009) [2023-12-26 00:36:42,615][123091] Updated weights for policy 0, policy_version 128937 (0.0008) [2023-12-26 00:36:42,667][123090] Updated weights for policy 1, policy_version 128459 (0.0010) [2023-12-26 00:36:42,675][123091] Updated weights for policy 0, policy_version 128947 (0.0008) [2023-12-26 00:36:42,730][123090] Updated weights for policy 1, policy_version 128469 (0.0010) [2023-12-26 00:36:42,737][123091] Updated weights for policy 0, policy_version 128957 (0.0008) [2023-12-26 00:36:42,798][123090] Updated weights for policy 1, policy_version 128479 (0.0010) [2023-12-26 00:36:43,532][123090] Updated weights for policy 1, policy_version 128489 (0.0006) [2023-12-26 00:36:43,600][123090] Updated weights for policy 1, policy_version 128499 (0.0009) [2023-12-26 00:36:43,623][123091] Updated weights for policy 0, policy_version 128967 (0.0006) [2023-12-26 00:36:43,670][123090] Updated weights for policy 1, policy_version 128509 (0.0006) [2023-12-26 00:36:43,678][123091] Updated weights for policy 0, policy_version 128977 (0.0005) [2023-12-26 00:36:43,749][123091] Updated weights for policy 0, policy_version 128987 (0.0008) [2023-12-26 00:36:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 65921024. Throughput: 0: 8676.6, 1: 8984.0. Samples: 65908560. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:43,785][121949] Avg episode reward: [(0, '5682.958'), (1, '5797.208')] [2023-12-26 00:36:44,297][123090] Updated weights for policy 1, policy_version 128519 (0.0006) [2023-12-26 00:36:44,356][123090] Updated weights for policy 1, policy_version 128530 (0.0006) [2023-12-26 00:36:44,410][123090] Updated weights for policy 1, policy_version 128540 (0.0005) [2023-12-26 00:36:44,584][123091] Updated weights for policy 0, policy_version 128997 (0.0010) [2023-12-26 00:36:44,638][123091] Updated weights for policy 0, policy_version 129007 (0.0009) [2023-12-26 00:36:44,705][123091] Updated weights for policy 0, policy_version 129017 (0.0006) [2023-12-26 00:36:45,194][123090] Updated weights for policy 1, policy_version 128550 (0.0007) [2023-12-26 00:36:45,245][123090] Updated weights for policy 1, policy_version 128560 (0.0009) [2023-12-26 00:36:45,314][123090] Updated weights for policy 1, policy_version 128570 (0.0010) [2023-12-26 00:36:45,507][123091] Updated weights for policy 0, policy_version 129027 (0.0008) [2023-12-26 00:36:45,574][123091] Updated weights for policy 0, policy_version 129037 (0.0006) [2023-12-26 00:36:45,639][123091] Updated weights for policy 0, policy_version 129047 (0.0006) [2023-12-26 00:36:46,101][123090] Updated weights for policy 1, policy_version 128580 (0.0007) [2023-12-26 00:36:46,175][123090] Updated weights for policy 1, policy_version 128590 (0.0005) [2023-12-26 00:36:46,253][123090] Updated weights for policy 1, policy_version 128600 (0.0005) [2023-12-26 00:36:46,397][123091] Updated weights for policy 0, policy_version 129057 (0.0010) [2023-12-26 00:36:46,456][123091] Updated weights for policy 0, policy_version 129067 (0.0010) [2023-12-26 00:36:46,510][123091] Updated weights for policy 0, policy_version 129077 (0.0010) [2023-12-26 00:36:46,565][123091] Updated weights for policy 0, policy_version 129087 (0.0010) [2023-12-26 00:36:46,965][123090] Updated weights for policy 1, policy_version 128610 (0.0006) [2023-12-26 00:36:47,030][123090] Updated weights for policy 1, policy_version 128620 (0.0009) [2023-12-26 00:36:47,097][123090] Updated weights for policy 1, policy_version 128630 (0.0009) [2023-12-26 00:36:47,161][123090] Updated weights for policy 1, policy_version 128640 (0.0008) [2023-12-26 00:36:47,420][123091] Updated weights for policy 0, policy_version 129097 (0.0008) [2023-12-26 00:36:47,470][123091] Updated weights for policy 0, policy_version 129107 (0.0009) [2023-12-26 00:36:47,517][123091] Updated weights for policy 0, policy_version 129117 (0.0008) [2023-12-26 00:36:48,006][123090] Updated weights for policy 1, policy_version 128650 (0.0009) [2023-12-26 00:36:48,070][123090] Updated weights for policy 1, policy_version 128660 (0.0009) [2023-12-26 00:36:48,134][123090] Updated weights for policy 1, policy_version 128670 (0.0009) [2023-12-26 00:36:48,286][123091] Updated weights for policy 0, policy_version 129127 (0.0009) [2023-12-26 00:36:48,350][123091] Updated weights for policy 0, policy_version 129137 (0.0009) [2023-12-26 00:36:48,415][123091] Updated weights for policy 0, policy_version 129147 (0.0009) [2023-12-26 00:36:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 66002944. Throughput: 0: 8618.8, 1: 9002.0. Samples: 66015212. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:48,785][121949] Avg episode reward: [(0, '5684.889'), (1, '5804.021')] [2023-12-26 00:36:48,973][123090] Updated weights for policy 1, policy_version 128680 (0.0009) [2023-12-26 00:36:49,027][123090] Updated weights for policy 1, policy_version 128690 (0.0009) [2023-12-26 00:36:49,078][123090] Updated weights for policy 1, policy_version 128700 (0.0009) [2023-12-26 00:36:49,153][123091] Updated weights for policy 0, policy_version 129157 (0.0007) [2023-12-26 00:36:49,206][123091] Updated weights for policy 0, policy_version 129167 (0.0009) [2023-12-26 00:36:49,276][123091] Updated weights for policy 0, policy_version 129177 (0.0012) [2023-12-26 00:36:49,952][123090] Updated weights for policy 1, policy_version 128710 (0.0009) [2023-12-26 00:36:50,021][123090] Updated weights for policy 1, policy_version 128720 (0.0009) [2023-12-26 00:36:50,093][123090] Updated weights for policy 1, policy_version 128730 (0.0009) [2023-12-26 00:36:50,132][123091] Updated weights for policy 0, policy_version 129187 (0.0011) [2023-12-26 00:36:50,198][123091] Updated weights for policy 0, policy_version 129197 (0.0008) [2023-12-26 00:36:50,266][123091] Updated weights for policy 0, policy_version 129207 (0.0008) [2023-12-26 00:36:50,924][123090] Updated weights for policy 1, policy_version 128740 (0.0009) [2023-12-26 00:36:50,987][123090] Updated weights for policy 1, policy_version 128750 (0.0009) [2023-12-26 00:36:51,010][123091] Updated weights for policy 0, policy_version 129217 (0.0008) [2023-12-26 00:36:51,058][123090] Updated weights for policy 1, policy_version 128760 (0.0008) [2023-12-26 00:36:51,079][123091] Updated weights for policy 0, policy_version 129227 (0.0008) [2023-12-26 00:36:51,148][123091] Updated weights for policy 0, policy_version 129237 (0.0008) [2023-12-26 00:36:51,207][123091] Updated weights for policy 0, policy_version 129247 (0.0008) [2023-12-26 00:36:51,949][123090] Updated weights for policy 1, policy_version 128770 (0.0007) [2023-12-26 00:36:51,974][123091] Updated weights for policy 0, policy_version 129257 (0.0006) [2023-12-26 00:36:52,013][123090] Updated weights for policy 1, policy_version 128780 (0.0009) [2023-12-26 00:36:52,029][123091] Updated weights for policy 0, policy_version 129267 (0.0006) [2023-12-26 00:36:52,080][123090] Updated weights for policy 1, policy_version 128790 (0.0010) [2023-12-26 00:36:52,088][123091] Updated weights for policy 0, policy_version 129277 (0.0007) [2023-12-26 00:36:52,143][123090] Updated weights for policy 1, policy_version 128800 (0.0009) [2023-12-26 00:36:52,821][123091] Updated weights for policy 0, policy_version 129287 (0.0009) [2023-12-26 00:36:52,876][123091] Updated weights for policy 0, policy_version 129297 (0.0010) [2023-12-26 00:36:52,935][123091] Updated weights for policy 0, policy_version 129307 (0.0011) [2023-12-26 00:36:53,040][123090] Updated weights for policy 1, policy_version 128810 (0.0010) [2023-12-26 00:36:53,108][123090] Updated weights for policy 1, policy_version 128820 (0.0008) [2023-12-26 00:36:53,174][123090] Updated weights for policy 1, policy_version 128830 (0.0010) [2023-12-26 00:36:53,656][123091] Updated weights for policy 0, policy_version 129317 (0.0008) [2023-12-26 00:36:53,715][123091] Updated weights for policy 0, policy_version 129327 (0.0007) [2023-12-26 00:36:53,770][123091] Updated weights for policy 0, policy_version 129337 (0.0008) [2023-12-26 00:36:53,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 66084864. Throughput: 0: 8594.7, 1: 8930.5. Samples: 66066240. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:53,785][121949] Avg episode reward: [(0, '5622.281'), (1, '5755.677')] [2023-12-26 00:36:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000128832_32980992.pth... [2023-12-26 00:36:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000127808_32718848.pth [2023-12-26 00:36:53,817][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000129344_33112064.pth... [2023-12-26 00:36:53,820][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000128320_32849920.pth [2023-12-26 00:36:54,062][123090] Updated weights for policy 1, policy_version 128840 (0.0010) [2023-12-26 00:36:54,133][123090] Updated weights for policy 1, policy_version 128850 (0.0010) [2023-12-26 00:36:54,187][123090] Updated weights for policy 1, policy_version 128860 (0.0010) [2023-12-26 00:36:54,469][123091] Updated weights for policy 0, policy_version 129347 (0.0009) [2023-12-26 00:36:54,531][123091] Updated weights for policy 0, policy_version 129357 (0.0010) [2023-12-26 00:36:54,594][123091] Updated weights for policy 0, policy_version 129367 (0.0010) [2023-12-26 00:36:55,129][123090] Updated weights for policy 1, policy_version 128870 (0.0010) [2023-12-26 00:36:55,187][123090] Updated weights for policy 1, policy_version 128880 (0.0008) [2023-12-26 00:36:55,242][123090] Updated weights for policy 1, policy_version 128890 (0.0006) [2023-12-26 00:36:55,248][123091] Updated weights for policy 0, policy_version 129377 (0.0010) [2023-12-26 00:36:55,310][123091] Updated weights for policy 0, policy_version 129387 (0.0010) [2023-12-26 00:36:55,361][123091] Updated weights for policy 0, policy_version 129397 (0.0010) [2023-12-26 00:36:55,416][123091] Updated weights for policy 0, policy_version 129407 (0.0009) [2023-12-26 00:36:55,938][123090] Updated weights for policy 1, policy_version 128900 (0.0007) [2023-12-26 00:36:55,986][123090] Updated weights for policy 1, policy_version 128910 (0.0005) [2023-12-26 00:36:56,059][123090] Updated weights for policy 1, policy_version 128921 (0.0009) [2023-12-26 00:36:56,101][123091] Updated weights for policy 0, policy_version 129417 (0.0006) [2023-12-26 00:36:56,149][123091] Updated weights for policy 0, policy_version 129427 (0.0005) [2023-12-26 00:36:56,200][123091] Updated weights for policy 0, policy_version 129437 (0.0005) [2023-12-26 00:36:56,836][123090] Updated weights for policy 1, policy_version 128931 (0.0010) [2023-12-26 00:36:56,888][123090] Updated weights for policy 1, policy_version 128941 (0.0010) [2023-12-26 00:36:56,903][123091] Updated weights for policy 0, policy_version 129447 (0.0005) [2023-12-26 00:36:56,940][123090] Updated weights for policy 1, policy_version 128951 (0.0010) [2023-12-26 00:36:56,958][123091] Updated weights for policy 0, policy_version 129457 (0.0005) [2023-12-26 00:36:57,001][123091] Updated weights for policy 0, policy_version 129467 (0.0005) [2023-12-26 00:36:57,608][123090] Updated weights for policy 1, policy_version 128961 (0.0010) [2023-12-26 00:36:57,674][123090] Updated weights for policy 1, policy_version 128971 (0.0005) [2023-12-26 00:36:57,707][123091] Updated weights for policy 0, policy_version 129477 (0.0008) [2023-12-26 00:36:57,736][123090] Updated weights for policy 1, policy_version 128981 (0.0006) [2023-12-26 00:36:57,758][123091] Updated weights for policy 0, policy_version 129487 (0.0008) [2023-12-26 00:36:57,794][123090] Updated weights for policy 1, policy_version 128991 (0.0008) [2023-12-26 00:36:57,806][123091] Updated weights for policy 0, policy_version 129497 (0.0005) [2023-12-26 00:36:58,458][123091] Updated weights for policy 0, policy_version 129507 (0.0006) [2023-12-26 00:36:58,524][123091] Updated weights for policy 0, policy_version 129517 (0.0011) [2023-12-26 00:36:58,589][123091] Updated weights for policy 0, policy_version 129527 (0.0011) [2023-12-26 00:36:58,684][123090] Updated weights for policy 1, policy_version 129001 (0.0010) [2023-12-26 00:36:58,747][123090] Updated weights for policy 1, policy_version 129011 (0.0009) [2023-12-26 00:36:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 66183168. Throughput: 0: 8844.9, 1: 8829.0. Samples: 66177864. Policy #0 lag: (min: 16.0, avg: 42.1, max: 48.0) [2023-12-26 00:36:58,785][121949] Avg episode reward: [(0, '5569.404'), (1, '5758.074')] [2023-12-26 00:36:58,816][123090] Updated weights for policy 1, policy_version 129021 (0.0009) [2023-12-26 00:36:59,442][123091] Updated weights for policy 0, policy_version 129537 (0.0011) [2023-12-26 00:36:59,505][123091] Updated weights for policy 0, policy_version 129547 (0.0010) [2023-12-26 00:36:59,556][123091] Updated weights for policy 0, policy_version 129557 (0.0010) [2023-12-26 00:36:59,607][123091] Updated weights for policy 0, policy_version 129567 (0.0010) [2023-12-26 00:36:59,675][123090] Updated weights for policy 1, policy_version 129031 (0.0009) [2023-12-26 00:36:59,737][123090] Updated weights for policy 1, policy_version 129041 (0.0008) [2023-12-26 00:36:59,801][123090] Updated weights for policy 1, policy_version 129051 (0.0009) [2023-12-26 00:37:00,456][123091] Updated weights for policy 0, policy_version 129577 (0.0010) [2023-12-26 00:37:00,508][123091] Updated weights for policy 0, policy_version 129587 (0.0010) [2023-12-26 00:37:00,572][123091] Updated weights for policy 0, policy_version 129597 (0.0007) [2023-12-26 00:37:00,607][123090] Updated weights for policy 1, policy_version 129061 (0.0010) [2023-12-26 00:37:00,666][123090] Updated weights for policy 1, policy_version 129071 (0.0010) [2023-12-26 00:37:00,717][123090] Updated weights for policy 1, policy_version 129081 (0.0010) [2023-12-26 00:37:01,311][123091] Updated weights for policy 0, policy_version 129607 (0.0011) [2023-12-26 00:37:01,381][123091] Updated weights for policy 0, policy_version 129617 (0.0007) [2023-12-26 00:37:01,445][123091] Updated weights for policy 0, policy_version 129627 (0.0008) [2023-12-26 00:37:01,491][123090] Updated weights for policy 1, policy_version 129091 (0.0009) [2023-12-26 00:37:01,546][123090] Updated weights for policy 1, policy_version 129101 (0.0005) [2023-12-26 00:37:01,615][123090] Updated weights for policy 1, policy_version 129111 (0.0007) [2023-12-26 00:37:02,210][123091] Updated weights for policy 0, policy_version 129637 (0.0006) [2023-12-26 00:37:02,272][123091] Updated weights for policy 0, policy_version 129647 (0.0007) [2023-12-26 00:37:02,317][123090] Updated weights for policy 1, policy_version 129121 (0.0011) [2023-12-26 00:37:02,333][123091] Updated weights for policy 0, policy_version 129657 (0.0008) [2023-12-26 00:37:02,386][123090] Updated weights for policy 1, policy_version 129131 (0.0008) [2023-12-26 00:37:02,450][123090] Updated weights for policy 1, policy_version 129141 (0.0010) [2023-12-26 00:37:02,516][123090] Updated weights for policy 1, policy_version 129151 (0.0010) [2023-12-26 00:37:03,144][123091] Updated weights for policy 0, policy_version 129667 (0.0008) [2023-12-26 00:37:03,192][123091] Updated weights for policy 0, policy_version 129677 (0.0009) [2023-12-26 00:37:03,240][123091] Updated weights for policy 0, policy_version 129687 (0.0009) [2023-12-26 00:37:03,346][123090] Updated weights for policy 1, policy_version 129161 (0.0010) [2023-12-26 00:37:03,411][123090] Updated weights for policy 1, policy_version 129171 (0.0010) [2023-12-26 00:37:03,468][123090] Updated weights for policy 1, policy_version 129181 (0.0010) [2023-12-26 00:37:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 66273280. Throughput: 0: 8876.4, 1: 8735.3. Samples: 66283224. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:03,785][121949] Avg episode reward: [(0, '5594.725'), (1, '5766.741')] [2023-12-26 00:37:04,077][123091] Updated weights for policy 0, policy_version 129697 (0.0009) [2023-12-26 00:37:04,148][123091] Updated weights for policy 0, policy_version 129707 (0.0008) [2023-12-26 00:37:04,217][123091] Updated weights for policy 0, policy_version 129717 (0.0009) [2023-12-26 00:37:04,282][123091] Updated weights for policy 0, policy_version 129727 (0.0010) [2023-12-26 00:37:04,290][123090] Updated weights for policy 1, policy_version 129191 (0.0010) [2023-12-26 00:37:04,349][123090] Updated weights for policy 1, policy_version 129201 (0.0010) [2023-12-26 00:37:04,401][123090] Updated weights for policy 1, policy_version 129211 (0.0010) [2023-12-26 00:37:05,126][123091] Updated weights for policy 0, policy_version 129737 (0.0009) [2023-12-26 00:37:05,182][123091] Updated weights for policy 0, policy_version 129748 (0.0010) [2023-12-26 00:37:05,187][123090] Updated weights for policy 1, policy_version 129221 (0.0008) [2023-12-26 00:37:05,239][123091] Updated weights for policy 0, policy_version 129758 (0.0009) [2023-12-26 00:37:05,244][123090] Updated weights for policy 1, policy_version 129231 (0.0005) [2023-12-26 00:37:05,294][123090] Updated weights for policy 1, policy_version 129241 (0.0005) [2023-12-26 00:37:05,961][123090] Updated weights for policy 1, policy_version 129251 (0.0006) [2023-12-26 00:37:06,031][123090] Updated weights for policy 1, policy_version 129261 (0.0005) [2023-12-26 00:37:06,103][123090] Updated weights for policy 1, policy_version 129271 (0.0006) [2023-12-26 00:37:06,177][123091] Updated weights for policy 0, policy_version 129768 (0.0009) [2023-12-26 00:37:06,240][123091] Updated weights for policy 0, policy_version 129778 (0.0009) [2023-12-26 00:37:06,301][123091] Updated weights for policy 0, policy_version 129788 (0.0009) [2023-12-26 00:37:06,908][123090] Updated weights for policy 1, policy_version 129281 (0.0011) [2023-12-26 00:37:06,967][123090] Updated weights for policy 1, policy_version 129291 (0.0010) [2023-12-26 00:37:07,030][123090] Updated weights for policy 1, policy_version 129301 (0.0010) [2023-12-26 00:37:07,082][123090] Updated weights for policy 1, policy_version 129311 (0.0010) [2023-12-26 00:37:07,152][123091] Updated weights for policy 0, policy_version 129798 (0.0009) [2023-12-26 00:37:07,204][123091] Updated weights for policy 0, policy_version 129808 (0.0009) [2023-12-26 00:37:07,254][123091] Updated weights for policy 0, policy_version 129818 (0.0009) [2023-12-26 00:37:07,919][123090] Updated weights for policy 1, policy_version 129321 (0.0011) [2023-12-26 00:37:07,989][123090] Updated weights for policy 1, policy_version 129331 (0.0010) [2023-12-26 00:37:08,045][123090] Updated weights for policy 1, policy_version 129341 (0.0010) [2023-12-26 00:37:08,098][123091] Updated weights for policy 0, policy_version 129828 (0.0009) [2023-12-26 00:37:08,166][123091] Updated weights for policy 0, policy_version 129838 (0.0009) [2023-12-26 00:37:08,230][123091] Updated weights for policy 0, policy_version 129848 (0.0009) [2023-12-26 00:37:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 66355200. Throughput: 0: 8812.0, 1: 8822.3. Samples: 66335876. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:08,785][121949] Avg episode reward: [(0, '5641.501'), (1, '5768.321')] [2023-12-26 00:37:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000129856_33243136.pth... [2023-12-26 00:37:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000128832_32980992.pth [2023-12-26 00:37:08,829][123090] Updated weights for policy 1, policy_version 129351 (0.0010) [2023-12-26 00:37:08,880][123090] Updated weights for policy 1, policy_version 129361 (0.0009) [2023-12-26 00:37:08,941][123090] Updated weights for policy 1, policy_version 129371 (0.0009) [2023-12-26 00:37:08,965][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000129376_33120256.pth... [2023-12-26 00:37:08,969][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000128320_32849920.pth [2023-12-26 00:37:09,095][123091] Updated weights for policy 0, policy_version 129858 (0.0009) [2023-12-26 00:37:09,152][123091] Updated weights for policy 0, policy_version 129868 (0.0009) [2023-12-26 00:37:09,208][123091] Updated weights for policy 0, policy_version 129878 (0.0009) [2023-12-26 00:37:09,272][123091] Updated weights for policy 0, policy_version 129888 (0.0009) [2023-12-26 00:37:09,796][123090] Updated weights for policy 1, policy_version 129381 (0.0007) [2023-12-26 00:37:09,872][123090] Updated weights for policy 1, policy_version 129391 (0.0009) [2023-12-26 00:37:09,942][123090] Updated weights for policy 1, policy_version 129401 (0.0010) [2023-12-26 00:37:10,131][123091] Updated weights for policy 0, policy_version 129898 (0.0010) [2023-12-26 00:37:10,185][123091] Updated weights for policy 0, policy_version 129908 (0.0009) [2023-12-26 00:37:10,246][123091] Updated weights for policy 0, policy_version 129918 (0.0010) [2023-12-26 00:37:10,782][123090] Updated weights for policy 1, policy_version 129411 (0.0009) [2023-12-26 00:37:10,840][123090] Updated weights for policy 1, policy_version 129421 (0.0008) [2023-12-26 00:37:10,897][123090] Updated weights for policy 1, policy_version 129431 (0.0009) [2023-12-26 00:37:11,081][123091] Updated weights for policy 0, policy_version 129928 (0.0009) [2023-12-26 00:37:11,147][123091] Updated weights for policy 0, policy_version 129938 (0.0010) [2023-12-26 00:37:11,220][123091] Updated weights for policy 0, policy_version 129948 (0.0007) [2023-12-26 00:37:11,803][123090] Updated weights for policy 1, policy_version 129441 (0.0008) [2023-12-26 00:37:11,853][123090] Updated weights for policy 1, policy_version 129451 (0.0005) [2023-12-26 00:37:11,903][123090] Updated weights for policy 1, policy_version 129461 (0.0006) [2023-12-26 00:37:11,955][123090] Updated weights for policy 1, policy_version 129471 (0.0009) [2023-12-26 00:37:12,017][123091] Updated weights for policy 0, policy_version 129958 (0.0009) [2023-12-26 00:37:12,066][123091] Updated weights for policy 0, policy_version 129968 (0.0011) [2023-12-26 00:37:12,126][123091] Updated weights for policy 0, policy_version 129978 (0.0011) [2023-12-26 00:37:12,816][123090] Updated weights for policy 1, policy_version 129481 (0.0009) [2023-12-26 00:37:12,872][123090] Updated weights for policy 1, policy_version 129491 (0.0009) [2023-12-26 00:37:12,932][123090] Updated weights for policy 1, policy_version 129501 (0.0009) [2023-12-26 00:37:12,984][123091] Updated weights for policy 0, policy_version 129988 (0.0011) [2023-12-26 00:37:13,035][123091] Updated weights for policy 0, policy_version 129998 (0.0010) [2023-12-26 00:37:13,083][123091] Updated weights for policy 0, policy_version 130008 (0.0011) [2023-12-26 00:37:13,738][123090] Updated weights for policy 1, policy_version 129511 (0.0006) [2023-12-26 00:37:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 66437120. Throughput: 0: 8782.9, 1: 8794.7. Samples: 66437500. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:13,785][121949] Avg episode reward: [(0, '5698.409'), (1, '5675.756')] [2023-12-26 00:37:13,785][123007] Saving new best policy, reward=5698.409! [2023-12-26 00:37:13,803][123090] Updated weights for policy 1, policy_version 129521 (0.0005) [2023-12-26 00:37:13,865][123090] Updated weights for policy 1, policy_version 129531 (0.0005) [2023-12-26 00:37:13,929][123091] Updated weights for policy 0, policy_version 130018 (0.0009) [2023-12-26 00:37:14,007][123091] Updated weights for policy 0, policy_version 130028 (0.0005) [2023-12-26 00:37:14,080][123091] Updated weights for policy 0, policy_version 130038 (0.0005) [2023-12-26 00:37:14,143][123091] Updated weights for policy 0, policy_version 130048 (0.0010) [2023-12-26 00:37:14,574][123090] Updated weights for policy 1, policy_version 129541 (0.0009) [2023-12-26 00:37:14,621][123090] Updated weights for policy 1, policy_version 129551 (0.0010) [2023-12-26 00:37:14,675][123090] Updated weights for policy 1, policy_version 129561 (0.0010) [2023-12-26 00:37:14,911][123091] Updated weights for policy 0, policy_version 130058 (0.0006) [2023-12-26 00:37:14,969][123091] Updated weights for policy 0, policy_version 130068 (0.0006) [2023-12-26 00:37:15,040][123091] Updated weights for policy 0, policy_version 130078 (0.0008) [2023-12-26 00:37:15,436][123090] Updated weights for policy 1, policy_version 129571 (0.0009) [2023-12-26 00:37:15,485][123090] Updated weights for policy 1, policy_version 129581 (0.0006) [2023-12-26 00:37:15,547][123090] Updated weights for policy 1, policy_version 129591 (0.0007) [2023-12-26 00:37:15,702][123091] Updated weights for policy 0, policy_version 130088 (0.0007) [2023-12-26 00:37:15,762][123091] Updated weights for policy 0, policy_version 130098 (0.0011) [2023-12-26 00:37:15,830][123091] Updated weights for policy 0, policy_version 130108 (0.0011) [2023-12-26 00:37:16,217][123090] Updated weights for policy 1, policy_version 129601 (0.0006) [2023-12-26 00:37:16,285][123090] Updated weights for policy 1, policy_version 129611 (0.0005) [2023-12-26 00:37:16,357][123090] Updated weights for policy 1, policy_version 129621 (0.0005) [2023-12-26 00:37:16,424][123090] Updated weights for policy 1, policy_version 129631 (0.0005) [2023-12-26 00:37:16,508][123091] Updated weights for policy 0, policy_version 130118 (0.0010) [2023-12-26 00:37:16,583][123091] Updated weights for policy 0, policy_version 130128 (0.0010) [2023-12-26 00:37:16,648][123091] Updated weights for policy 0, policy_version 130138 (0.0010) [2023-12-26 00:37:16,992][123090] Updated weights for policy 1, policy_version 129641 (0.0006) [2023-12-26 00:37:17,048][123090] Updated weights for policy 1, policy_version 129651 (0.0007) [2023-12-26 00:37:17,104][123090] Updated weights for policy 1, policy_version 129661 (0.0005) [2023-12-26 00:37:17,548][123091] Updated weights for policy 0, policy_version 130148 (0.0010) [2023-12-26 00:37:17,600][123091] Updated weights for policy 0, policy_version 130158 (0.0009) [2023-12-26 00:37:17,662][123091] Updated weights for policy 0, policy_version 130168 (0.0009) [2023-12-26 00:37:17,839][123090] Updated weights for policy 1, policy_version 129671 (0.0006) [2023-12-26 00:37:17,892][123090] Updated weights for policy 1, policy_version 129681 (0.0005) [2023-12-26 00:37:17,949][123090] Updated weights for policy 1, policy_version 129691 (0.0005) [2023-12-26 00:37:18,447][123091] Updated weights for policy 0, policy_version 130178 (0.0009) [2023-12-26 00:37:18,514][123091] Updated weights for policy 0, policy_version 130188 (0.0007) [2023-12-26 00:37:18,583][123091] Updated weights for policy 0, policy_version 130198 (0.0006) [2023-12-26 00:37:18,650][123091] Updated weights for policy 0, policy_version 130208 (0.0006) [2023-12-26 00:37:18,760][123090] Updated weights for policy 1, policy_version 129701 (0.0009) [2023-12-26 00:37:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 66535424. Throughput: 0: 8844.6, 1: 8855.7. Samples: 66547700. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:18,785][121949] Avg episode reward: [(0, '5638.838'), (1, '5662.352')] [2023-12-26 00:37:18,837][123090] Updated weights for policy 1, policy_version 129711 (0.0010) [2023-12-26 00:37:18,902][123090] Updated weights for policy 1, policy_version 129721 (0.0009) [2023-12-26 00:37:19,358][123091] Updated weights for policy 0, policy_version 130218 (0.0007) [2023-12-26 00:37:19,416][123091] Updated weights for policy 0, policy_version 130228 (0.0007) [2023-12-26 00:37:19,465][123091] Updated weights for policy 0, policy_version 130238 (0.0007) [2023-12-26 00:37:19,708][123090] Updated weights for policy 1, policy_version 129731 (0.0009) [2023-12-26 00:37:19,773][123090] Updated weights for policy 1, policy_version 129741 (0.0009) [2023-12-26 00:37:19,840][123090] Updated weights for policy 1, policy_version 129751 (0.0009) [2023-12-26 00:37:20,327][123091] Updated weights for policy 0, policy_version 130248 (0.0011) [2023-12-26 00:37:20,383][123091] Updated weights for policy 0, policy_version 130258 (0.0011) [2023-12-26 00:37:20,441][123091] Updated weights for policy 0, policy_version 130268 (0.0010) [2023-12-26 00:37:20,714][123090] Updated weights for policy 1, policy_version 129761 (0.0009) [2023-12-26 00:37:20,783][123090] Updated weights for policy 1, policy_version 129771 (0.0011) [2023-12-26 00:37:20,851][123090] Updated weights for policy 1, policy_version 129781 (0.0011) [2023-12-26 00:37:20,924][123090] Updated weights for policy 1, policy_version 129791 (0.0011) [2023-12-26 00:37:21,251][123091] Updated weights for policy 0, policy_version 130278 (0.0008) [2023-12-26 00:37:21,318][123091] Updated weights for policy 0, policy_version 130288 (0.0010) [2023-12-26 00:37:21,399][123091] Updated weights for policy 0, policy_version 130298 (0.0011) [2023-12-26 00:37:21,813][123090] Updated weights for policy 1, policy_version 129801 (0.0008) [2023-12-26 00:37:21,883][123090] Updated weights for policy 1, policy_version 129811 (0.0008) [2023-12-26 00:37:21,957][123090] Updated weights for policy 1, policy_version 129821 (0.0008) [2023-12-26 00:37:22,230][123091] Updated weights for policy 0, policy_version 130308 (0.0009) [2023-12-26 00:37:22,299][123091] Updated weights for policy 0, policy_version 130318 (0.0006) [2023-12-26 00:37:22,364][123091] Updated weights for policy 0, policy_version 130328 (0.0007) [2023-12-26 00:37:22,703][123090] Updated weights for policy 1, policy_version 129831 (0.0009) [2023-12-26 00:37:22,758][123090] Updated weights for policy 1, policy_version 129841 (0.0010) [2023-12-26 00:37:22,823][123090] Updated weights for policy 1, policy_version 129851 (0.0010) [2023-12-26 00:37:23,054][123091] Updated weights for policy 0, policy_version 130338 (0.0007) [2023-12-26 00:37:23,105][123091] Updated weights for policy 0, policy_version 130348 (0.0010) [2023-12-26 00:37:23,157][123091] Updated weights for policy 0, policy_version 130358 (0.0010) [2023-12-26 00:37:23,216][123091] Updated weights for policy 0, policy_version 130368 (0.0009) [2023-12-26 00:37:23,692][123090] Updated weights for policy 1, policy_version 129861 (0.0008) [2023-12-26 00:37:23,748][123090] Updated weights for policy 1, policy_version 129871 (0.0005) [2023-12-26 00:37:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 66617344. Throughput: 0: 8845.8, 1: 8777.0. Samples: 66597564. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:23,786][121949] Avg episode reward: [(0, '5515.869'), (1, '5719.827')] [2023-12-26 00:37:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000130368_33374208.pth... [2023-12-26 00:37:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000129344_33112064.pth [2023-12-26 00:37:23,804][123090] Updated weights for policy 1, policy_version 129881 (0.0005) [2023-12-26 00:37:23,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000129888_33251328.pth... [2023-12-26 00:37:23,851][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000128832_32980992.pth [2023-12-26 00:37:23,992][123091] Updated weights for policy 0, policy_version 130378 (0.0009) [2023-12-26 00:37:24,058][123091] Updated weights for policy 0, policy_version 130388 (0.0011) [2023-12-26 00:37:24,109][123091] Updated weights for policy 0, policy_version 130398 (0.0010) [2023-12-26 00:37:24,597][123090] Updated weights for policy 1, policy_version 129891 (0.0007) [2023-12-26 00:37:24,650][123090] Updated weights for policy 1, policy_version 129902 (0.0010) [2023-12-26 00:37:24,712][123090] Updated weights for policy 1, policy_version 129912 (0.0008) [2023-12-26 00:37:24,724][123091] Updated weights for policy 0, policy_version 130408 (0.0006) [2023-12-26 00:37:24,779][123091] Updated weights for policy 0, policy_version 130418 (0.0005) [2023-12-26 00:37:24,830][123091] Updated weights for policy 0, policy_version 130428 (0.0005) [2023-12-26 00:37:25,546][123091] Updated weights for policy 0, policy_version 130438 (0.0005) [2023-12-26 00:37:25,600][123091] Updated weights for policy 0, policy_version 130448 (0.0005) [2023-12-26 00:37:25,615][123090] Updated weights for policy 1, policy_version 129922 (0.0008) [2023-12-26 00:37:25,662][123091] Updated weights for policy 0, policy_version 130458 (0.0005) [2023-12-26 00:37:25,679][123090] Updated weights for policy 1, policy_version 129932 (0.0008) [2023-12-26 00:37:25,747][123090] Updated weights for policy 1, policy_version 129942 (0.0009) [2023-12-26 00:37:26,357][123091] Updated weights for policy 0, policy_version 130468 (0.0007) [2023-12-26 00:37:26,412][123091] Updated weights for policy 0, policy_version 130478 (0.0010) [2023-12-26 00:37:26,464][123091] Updated weights for policy 0, policy_version 130488 (0.0010) [2023-12-26 00:37:26,583][123090] Updated weights for policy 1, policy_version 129953 (0.0010) [2023-12-26 00:37:26,654][123090] Updated weights for policy 1, policy_version 129963 (0.0011) [2023-12-26 00:37:26,733][123090] Updated weights for policy 1, policy_version 129973 (0.0011) [2023-12-26 00:37:26,813][123090] Updated weights for policy 1, policy_version 129983 (0.0011) [2023-12-26 00:37:27,183][123091] Updated weights for policy 0, policy_version 130498 (0.0008) [2023-12-26 00:37:27,235][123091] Updated weights for policy 0, policy_version 130508 (0.0010) [2023-12-26 00:37:27,285][123091] Updated weights for policy 0, policy_version 130518 (0.0010) [2023-12-26 00:37:27,337][123091] Updated weights for policy 0, policy_version 130528 (0.0010) [2023-12-26 00:37:27,538][123090] Updated weights for policy 1, policy_version 129993 (0.0010) [2023-12-26 00:37:27,594][123090] Updated weights for policy 1, policy_version 130003 (0.0010) [2023-12-26 00:37:27,644][123090] Updated weights for policy 1, policy_version 130013 (0.0008) [2023-12-26 00:37:28,072][123091] Updated weights for policy 0, policy_version 130538 (0.0005) [2023-12-26 00:37:28,138][123091] Updated weights for policy 0, policy_version 130548 (0.0005) [2023-12-26 00:37:28,197][123091] Updated weights for policy 0, policy_version 130558 (0.0005) [2023-12-26 00:37:28,376][123090] Updated weights for policy 1, policy_version 130023 (0.0008) [2023-12-26 00:37:28,451][123090] Updated weights for policy 1, policy_version 130033 (0.0010) [2023-12-26 00:37:28,514][123090] Updated weights for policy 1, policy_version 130043 (0.0010) [2023-12-26 00:37:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 66715648. Throughput: 0: 9004.2, 1: 8765.9. Samples: 66708216. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:28,785][121949] Avg episode reward: [(0, '5502.440'), (1, '5720.092')] [2023-12-26 00:37:28,838][123091] Updated weights for policy 0, policy_version 130568 (0.0010) [2023-12-26 00:37:28,909][123091] Updated weights for policy 0, policy_version 130578 (0.0011) [2023-12-26 00:37:28,967][123091] Updated weights for policy 0, policy_version 130588 (0.0010) [2023-12-26 00:37:29,238][123090] Updated weights for policy 1, policy_version 130053 (0.0008) [2023-12-26 00:37:29,313][123090] Updated weights for policy 1, policy_version 130063 (0.0005) [2023-12-26 00:37:29,385][123090] Updated weights for policy 1, policy_version 130073 (0.0008) [2023-12-26 00:37:29,787][123091] Updated weights for policy 0, policy_version 130598 (0.0010) [2023-12-26 00:37:29,863][123091] Updated weights for policy 0, policy_version 130608 (0.0010) [2023-12-26 00:37:29,927][123091] Updated weights for policy 0, policy_version 130618 (0.0010) [2023-12-26 00:37:30,103][123090] Updated weights for policy 1, policy_version 130083 (0.0007) [2023-12-26 00:37:30,166][123090] Updated weights for policy 1, policy_version 130093 (0.0009) [2023-12-26 00:37:30,223][123090] Updated weights for policy 1, policy_version 130103 (0.0009) [2023-12-26 00:37:30,715][123091] Updated weights for policy 0, policy_version 130628 (0.0008) [2023-12-26 00:37:30,786][123091] Updated weights for policy 0, policy_version 130638 (0.0006) [2023-12-26 00:37:30,848][123091] Updated weights for policy 0, policy_version 130648 (0.0006) [2023-12-26 00:37:31,023][123090] Updated weights for policy 1, policy_version 130113 (0.0009) [2023-12-26 00:37:31,095][123090] Updated weights for policy 1, policy_version 130123 (0.0008) [2023-12-26 00:37:31,171][123090] Updated weights for policy 1, policy_version 130133 (0.0008) [2023-12-26 00:37:31,239][123090] Updated weights for policy 1, policy_version 130143 (0.0007) [2023-12-26 00:37:31,582][123091] Updated weights for policy 0, policy_version 130658 (0.0006) [2023-12-26 00:37:31,641][123091] Updated weights for policy 0, policy_version 130668 (0.0011) [2023-12-26 00:37:31,703][123091] Updated weights for policy 0, policy_version 130678 (0.0011) [2023-12-26 00:37:31,763][123091] Updated weights for policy 0, policy_version 130688 (0.0011) [2023-12-26 00:37:31,959][123090] Updated weights for policy 1, policy_version 130153 (0.0009) [2023-12-26 00:37:32,017][123090] Updated weights for policy 1, policy_version 130163 (0.0009) [2023-12-26 00:37:32,076][123090] Updated weights for policy 1, policy_version 130173 (0.0010) [2023-12-26 00:37:32,571][123091] Updated weights for policy 0, policy_version 130698 (0.0005) [2023-12-26 00:37:32,626][123091] Updated weights for policy 0, policy_version 130708 (0.0007) [2023-12-26 00:37:32,684][123091] Updated weights for policy 0, policy_version 130718 (0.0008) [2023-12-26 00:37:32,952][123090] Updated weights for policy 1, policy_version 130183 (0.0009) [2023-12-26 00:37:33,012][123090] Updated weights for policy 1, policy_version 130193 (0.0010) [2023-12-26 00:37:33,065][123090] Updated weights for policy 1, policy_version 130203 (0.0007) [2023-12-26 00:37:33,511][123091] Updated weights for policy 0, policy_version 130728 (0.0010) [2023-12-26 00:37:33,564][123091] Updated weights for policy 0, policy_version 130738 (0.0009) [2023-12-26 00:37:33,622][123091] Updated weights for policy 0, policy_version 130748 (0.0010) [2023-12-26 00:37:33,778][123090] Updated weights for policy 1, policy_version 130213 (0.0005) [2023-12-26 00:37:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 66805760. Throughput: 0: 9060.8, 1: 8774.1. Samples: 66817780. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:33,785][121949] Avg episode reward: [(0, '5604.317'), (1, '5639.077')] [2023-12-26 00:37:33,833][123090] Updated weights for policy 1, policy_version 130223 (0.0009) [2023-12-26 00:37:33,890][123090] Updated weights for policy 1, policy_version 130233 (0.0007) [2023-12-26 00:37:34,496][123091] Updated weights for policy 0, policy_version 130758 (0.0010) [2023-12-26 00:37:34,566][123091] Updated weights for policy 0, policy_version 130768 (0.0010) [2023-12-26 00:37:34,632][123091] Updated weights for policy 0, policy_version 130778 (0.0010) [2023-12-26 00:37:34,662][123090] Updated weights for policy 1, policy_version 130243 (0.0007) [2023-12-26 00:37:34,719][123090] Updated weights for policy 1, policy_version 130253 (0.0009) [2023-12-26 00:37:34,783][123090] Updated weights for policy 1, policy_version 130263 (0.0009) [2023-12-26 00:37:35,365][123091] Updated weights for policy 0, policy_version 130788 (0.0008) [2023-12-26 00:37:35,421][123091] Updated weights for policy 0, policy_version 130798 (0.0005) [2023-12-26 00:37:35,472][123091] Updated weights for policy 0, policy_version 130808 (0.0006) [2023-12-26 00:37:35,537][123090] Updated weights for policy 1, policy_version 130273 (0.0010) [2023-12-26 00:37:35,596][123090] Updated weights for policy 1, policy_version 130283 (0.0010) [2023-12-26 00:37:35,658][123090] Updated weights for policy 1, policy_version 130293 (0.0010) [2023-12-26 00:37:35,717][123090] Updated weights for policy 1, policy_version 130303 (0.0010) [2023-12-26 00:37:36,122][123091] Updated weights for policy 0, policy_version 130818 (0.0007) [2023-12-26 00:37:36,190][123091] Updated weights for policy 0, policy_version 130828 (0.0008) [2023-12-26 00:37:36,253][123091] Updated weights for policy 0, policy_version 130838 (0.0009) [2023-12-26 00:37:36,318][123091] Updated weights for policy 0, policy_version 130848 (0.0008) [2023-12-26 00:37:36,534][123090] Updated weights for policy 1, policy_version 130313 (0.0011) [2023-12-26 00:37:36,586][123090] Updated weights for policy 1, policy_version 130323 (0.0010) [2023-12-26 00:37:36,652][123090] Updated weights for policy 1, policy_version 130333 (0.0006) [2023-12-26 00:37:37,056][123091] Updated weights for policy 0, policy_version 130858 (0.0011) [2023-12-26 00:37:37,122][123091] Updated weights for policy 0, policy_version 130868 (0.0005) [2023-12-26 00:37:37,191][123091] Updated weights for policy 0, policy_version 130878 (0.0005) [2023-12-26 00:37:37,389][123090] Updated weights for policy 1, policy_version 130343 (0.0006) [2023-12-26 00:37:37,447][123090] Updated weights for policy 1, policy_version 130353 (0.0010) [2023-12-26 00:37:37,508][123090] Updated weights for policy 1, policy_version 130363 (0.0010) [2023-12-26 00:37:37,851][123091] Updated weights for policy 0, policy_version 130888 (0.0005) [2023-12-26 00:37:37,917][123091] Updated weights for policy 0, policy_version 130898 (0.0005) [2023-12-26 00:37:37,985][123091] Updated weights for policy 0, policy_version 130908 (0.0005) [2023-12-26 00:37:38,371][123090] Updated weights for policy 1, policy_version 130373 (0.0008) [2023-12-26 00:37:38,434][123090] Updated weights for policy 1, policy_version 130383 (0.0008) [2023-12-26 00:37:38,495][123090] Updated weights for policy 1, policy_version 130393 (0.0009) [2023-12-26 00:37:38,604][123091] Updated weights for policy 0, policy_version 130918 (0.0008) [2023-12-26 00:37:38,663][123091] Updated weights for policy 0, policy_version 130928 (0.0011) [2023-12-26 00:37:38,718][123091] Updated weights for policy 0, policy_version 130938 (0.0010) [2023-12-26 00:37:38,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 66904064. Throughput: 0: 9100.8, 1: 8835.3. Samples: 66873360. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:38,785][121949] Avg episode reward: [(0, '5672.654'), (1, '5725.020')] [2023-12-26 00:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000130944_33521664.pth... [2023-12-26 00:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000130400_33382400.pth... [2023-12-26 00:37:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000129376_33120256.pth [2023-12-26 00:37:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000129856_33243136.pth [2023-12-26 00:37:39,331][123090] Updated weights for policy 1, policy_version 130403 (0.0009) [2023-12-26 00:37:39,397][123090] Updated weights for policy 1, policy_version 130413 (0.0010) [2023-12-26 00:37:39,471][123090] Updated weights for policy 1, policy_version 130423 (0.0010) [2023-12-26 00:37:39,520][123091] Updated weights for policy 0, policy_version 130948 (0.0009) [2023-12-26 00:37:39,590][123091] Updated weights for policy 0, policy_version 130958 (0.0005) [2023-12-26 00:37:39,660][123091] Updated weights for policy 0, policy_version 130968 (0.0008) [2023-12-26 00:37:40,300][123090] Updated weights for policy 1, policy_version 130433 (0.0008) [2023-12-26 00:37:40,359][123090] Updated weights for policy 1, policy_version 130443 (0.0011) [2023-12-26 00:37:40,412][123090] Updated weights for policy 1, policy_version 130453 (0.0010) [2023-12-26 00:37:40,471][123090] Updated weights for policy 1, policy_version 130463 (0.0010) [2023-12-26 00:37:40,493][123091] Updated weights for policy 0, policy_version 130978 (0.0010) [2023-12-26 00:37:40,556][123091] Updated weights for policy 0, policy_version 130988 (0.0005) [2023-12-26 00:37:40,620][123091] Updated weights for policy 0, policy_version 130998 (0.0007) [2023-12-26 00:37:40,668][123091] Updated weights for policy 0, policy_version 131008 (0.0010) [2023-12-26 00:37:41,292][123090] Updated weights for policy 1, policy_version 130473 (0.0008) [2023-12-26 00:37:41,373][123090] Updated weights for policy 1, policy_version 130483 (0.0007) [2023-12-26 00:37:41,448][123090] Updated weights for policy 1, policy_version 130493 (0.0009) [2023-12-26 00:37:41,509][123091] Updated weights for policy 0, policy_version 131018 (0.0005) [2023-12-26 00:37:41,570][123091] Updated weights for policy 0, policy_version 131028 (0.0009) [2023-12-26 00:37:41,630][123091] Updated weights for policy 0, policy_version 131038 (0.0010) [2023-12-26 00:37:42,264][123090] Updated weights for policy 1, policy_version 130503 (0.0007) [2023-12-26 00:37:42,342][123090] Updated weights for policy 1, policy_version 130513 (0.0007) [2023-12-26 00:37:42,390][123091] Updated weights for policy 0, policy_version 131048 (0.0009) [2023-12-26 00:37:42,409][123090] Updated weights for policy 1, policy_version 130523 (0.0007) [2023-12-26 00:37:42,464][123091] Updated weights for policy 0, policy_version 131058 (0.0009) [2023-12-26 00:37:42,526][123091] Updated weights for policy 0, policy_version 131068 (0.0008) [2023-12-26 00:37:43,228][123090] Updated weights for policy 1, policy_version 130533 (0.0007) [2023-12-26 00:37:43,283][123090] Updated weights for policy 1, policy_version 130543 (0.0010) [2023-12-26 00:37:43,287][123091] Updated weights for policy 0, policy_version 131078 (0.0008) [2023-12-26 00:37:43,343][123091] Updated weights for policy 0, policy_version 131088 (0.0009) [2023-12-26 00:37:43,344][123090] Updated weights for policy 1, policy_version 130553 (0.0008) [2023-12-26 00:37:43,399][123091] Updated weights for policy 0, policy_version 131098 (0.0008) [2023-12-26 00:37:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 66985984. Throughput: 0: 8970.4, 1: 8841.4. Samples: 66979396. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:43,785][121949] Avg episode reward: [(0, '5697.834'), (1, '5808.266')] [2023-12-26 00:37:44,174][123091] Updated weights for policy 0, policy_version 131108 (0.0008) [2023-12-26 00:37:44,197][123090] Updated weights for policy 1, policy_version 130563 (0.0009) [2023-12-26 00:37:44,230][123091] Updated weights for policy 0, policy_version 131118 (0.0005) [2023-12-26 00:37:44,257][123090] Updated weights for policy 1, policy_version 130573 (0.0009) [2023-12-26 00:37:44,280][123091] Updated weights for policy 0, policy_version 131128 (0.0005) [2023-12-26 00:37:44,313][123090] Updated weights for policy 1, policy_version 130583 (0.0009) [2023-12-26 00:37:45,024][123091] Updated weights for policy 0, policy_version 131138 (0.0008) [2023-12-26 00:37:45,087][123091] Updated weights for policy 0, policy_version 131148 (0.0006) [2023-12-26 00:37:45,153][123091] Updated weights for policy 0, policy_version 131158 (0.0006) [2023-12-26 00:37:45,176][123090] Updated weights for policy 1, policy_version 130593 (0.0010) [2023-12-26 00:37:45,222][123091] Updated weights for policy 0, policy_version 131168 (0.0006) [2023-12-26 00:37:45,236][123090] Updated weights for policy 1, policy_version 130603 (0.0009) [2023-12-26 00:37:45,291][123090] Updated weights for policy 1, policy_version 130613 (0.0008) [2023-12-26 00:37:45,357][123090] Updated weights for policy 1, policy_version 130623 (0.0005) [2023-12-26 00:37:45,917][123091] Updated weights for policy 0, policy_version 131178 (0.0006) [2023-12-26 00:37:45,977][123091] Updated weights for policy 0, policy_version 131188 (0.0006) [2023-12-26 00:37:46,023][123091] Updated weights for policy 0, policy_version 131198 (0.0006) [2023-12-26 00:37:46,029][123090] Updated weights for policy 1, policy_version 130633 (0.0008) [2023-12-26 00:37:46,091][123090] Updated weights for policy 1, policy_version 130643 (0.0008) [2023-12-26 00:37:46,155][123090] Updated weights for policy 1, policy_version 130653 (0.0008) [2023-12-26 00:37:46,655][123091] Updated weights for policy 0, policy_version 131208 (0.0005) [2023-12-26 00:37:46,721][123091] Updated weights for policy 0, policy_version 131218 (0.0006) [2023-12-26 00:37:46,770][123090] Updated weights for policy 1, policy_version 130663 (0.0006) [2023-12-26 00:37:46,786][123091] Updated weights for policy 0, policy_version 131228 (0.0005) [2023-12-26 00:37:46,839][123090] Updated weights for policy 1, policy_version 130673 (0.0005) [2023-12-26 00:37:46,907][123090] Updated weights for policy 1, policy_version 130683 (0.0005) [2023-12-26 00:37:47,368][123091] Updated weights for policy 0, policy_version 131238 (0.0008) [2023-12-26 00:37:47,422][123091] Updated weights for policy 0, policy_version 131248 (0.0009) [2023-12-26 00:37:47,470][123091] Updated weights for policy 0, policy_version 131258 (0.0009) [2023-12-26 00:37:47,542][123090] Updated weights for policy 1, policy_version 130693 (0.0007) [2023-12-26 00:37:47,606][123090] Updated weights for policy 1, policy_version 130703 (0.0008) [2023-12-26 00:37:47,656][123090] Updated weights for policy 1, policy_version 130713 (0.0009) [2023-12-26 00:37:48,280][123091] Updated weights for policy 0, policy_version 131268 (0.0010) [2023-12-26 00:37:48,354][123091] Updated weights for policy 0, policy_version 131278 (0.0007) [2023-12-26 00:37:48,428][123091] Updated weights for policy 0, policy_version 131288 (0.0006) [2023-12-26 00:37:48,567][123090] Updated weights for policy 1, policy_version 130723 (0.0010) [2023-12-26 00:37:48,636][123090] Updated weights for policy 1, policy_version 130733 (0.0009) [2023-12-26 00:37:48,703][123090] Updated weights for policy 1, policy_version 130743 (0.0008) [2023-12-26 00:37:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 67084288. Throughput: 0: 9058.8, 1: 8887.3. Samples: 67090796. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:48,785][121949] Avg episode reward: [(0, '5636.656'), (1, '5743.159')] [2023-12-26 00:37:49,143][123091] Updated weights for policy 0, policy_version 131298 (0.0006) [2023-12-26 00:37:49,198][123091] Updated weights for policy 0, policy_version 131308 (0.0007) [2023-12-26 00:37:49,268][123091] Updated weights for policy 0, policy_version 131318 (0.0008) [2023-12-26 00:37:49,343][123091] Updated weights for policy 0, policy_version 131328 (0.0010) [2023-12-26 00:37:49,592][123090] Updated weights for policy 1, policy_version 130753 (0.0010) [2023-12-26 00:37:49,651][123090] Updated weights for policy 1, policy_version 130763 (0.0009) [2023-12-26 00:37:49,715][123090] Updated weights for policy 1, policy_version 130773 (0.0009) [2023-12-26 00:37:49,774][123090] Updated weights for policy 1, policy_version 130783 (0.0009) [2023-12-26 00:37:50,173][123091] Updated weights for policy 0, policy_version 131338 (0.0009) [2023-12-26 00:37:50,222][123091] Updated weights for policy 0, policy_version 131348 (0.0010) [2023-12-26 00:37:50,285][123091] Updated weights for policy 0, policy_version 131358 (0.0008) [2023-12-26 00:37:50,606][123090] Updated weights for policy 1, policy_version 130793 (0.0009) [2023-12-26 00:37:50,668][123090] Updated weights for policy 1, policy_version 130803 (0.0010) [2023-12-26 00:37:50,733][123090] Updated weights for policy 1, policy_version 130813 (0.0008) [2023-12-26 00:37:51,162][123091] Updated weights for policy 0, policy_version 131368 (0.0010) [2023-12-26 00:37:51,223][123091] Updated weights for policy 0, policy_version 131378 (0.0007) [2023-12-26 00:37:51,283][123091] Updated weights for policy 0, policy_version 131388 (0.0006) [2023-12-26 00:37:51,576][123090] Updated weights for policy 1, policy_version 130823 (0.0009) [2023-12-26 00:37:51,639][123090] Updated weights for policy 1, policy_version 130833 (0.0010) [2023-12-26 00:37:51,702][123090] Updated weights for policy 1, policy_version 130843 (0.0008) [2023-12-26 00:37:52,117][123091] Updated weights for policy 0, policy_version 131398 (0.0008) [2023-12-26 00:37:52,181][123091] Updated weights for policy 0, policy_version 131408 (0.0009) [2023-12-26 00:37:52,252][123091] Updated weights for policy 0, policy_version 131418 (0.0008) [2023-12-26 00:37:52,548][123090] Updated weights for policy 1, policy_version 130853 (0.0010) [2023-12-26 00:37:52,600][123090] Updated weights for policy 1, policy_version 130863 (0.0008) [2023-12-26 00:37:52,662][123090] Updated weights for policy 1, policy_version 130873 (0.0010) [2023-12-26 00:37:53,082][123091] Updated weights for policy 0, policy_version 131428 (0.0010) [2023-12-26 00:37:53,149][123091] Updated weights for policy 0, policy_version 131438 (0.0010) [2023-12-26 00:37:53,207][123091] Updated weights for policy 0, policy_version 131448 (0.0009) [2023-12-26 00:37:53,507][123090] Updated weights for policy 1, policy_version 130883 (0.0009) [2023-12-26 00:37:53,555][123090] Updated weights for policy 1, policy_version 130893 (0.0009) [2023-12-26 00:37:53,607][123090] Updated weights for policy 1, policy_version 130903 (0.0006) [2023-12-26 00:37:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 67166208. Throughput: 0: 9092.5, 1: 8802.8. Samples: 67141168. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:53,785][121949] Avg episode reward: [(0, '5694.308'), (1, '5626.051')] [2023-12-26 00:37:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000131456_33652736.pth... [2023-12-26 00:37:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000130912_33513472.pth... [2023-12-26 00:37:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000130368_33374208.pth [2023-12-26 00:37:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000129888_33251328.pth [2023-12-26 00:37:54,050][123091] Updated weights for policy 0, policy_version 131458 (0.0009) [2023-12-26 00:37:54,103][123091] Updated weights for policy 0, policy_version 131468 (0.0009) [2023-12-26 00:37:54,156][123091] Updated weights for policy 0, policy_version 131478 (0.0009) [2023-12-26 00:37:54,210][123091] Updated weights for policy 0, policy_version 131488 (0.0009) [2023-12-26 00:37:54,443][123090] Updated weights for policy 1, policy_version 130913 (0.0009) [2023-12-26 00:37:54,509][123090] Updated weights for policy 1, policy_version 130923 (0.0006) [2023-12-26 00:37:54,578][123090] Updated weights for policy 1, policy_version 130933 (0.0005) [2023-12-26 00:37:54,643][123090] Updated weights for policy 1, policy_version 130943 (0.0007) [2023-12-26 00:37:55,094][123091] Updated weights for policy 0, policy_version 131498 (0.0009) [2023-12-26 00:37:55,163][123091] Updated weights for policy 0, policy_version 131508 (0.0009) [2023-12-26 00:37:55,220][123091] Updated weights for policy 0, policy_version 131518 (0.0009) [2023-12-26 00:37:55,374][123090] Updated weights for policy 1, policy_version 130953 (0.0009) [2023-12-26 00:37:55,436][123090] Updated weights for policy 1, policy_version 130963 (0.0010) [2023-12-26 00:37:55,498][123090] Updated weights for policy 1, policy_version 130973 (0.0010) [2023-12-26 00:37:56,055][123091] Updated weights for policy 0, policy_version 131528 (0.0010) [2023-12-26 00:37:56,116][123091] Updated weights for policy 0, policy_version 131539 (0.0011) [2023-12-26 00:37:56,173][123091] Updated weights for policy 0, policy_version 131549 (0.0009) [2023-12-26 00:37:56,237][123090] Updated weights for policy 1, policy_version 130983 (0.0009) [2023-12-26 00:37:56,294][123090] Updated weights for policy 1, policy_version 130993 (0.0009) [2023-12-26 00:37:56,352][123090] Updated weights for policy 1, policy_version 131003 (0.0009) [2023-12-26 00:37:56,992][123091] Updated weights for policy 0, policy_version 131559 (0.0009) [2023-12-26 00:37:57,058][123091] Updated weights for policy 0, policy_version 131569 (0.0008) [2023-12-26 00:37:57,120][123091] Updated weights for policy 0, policy_version 131579 (0.0008) [2023-12-26 00:37:57,202][123090] Updated weights for policy 1, policy_version 131013 (0.0009) [2023-12-26 00:37:57,280][123090] Updated weights for policy 1, policy_version 131023 (0.0010) [2023-12-26 00:37:57,341][123090] Updated weights for policy 1, policy_version 131033 (0.0009) [2023-12-26 00:37:57,931][123091] Updated weights for policy 0, policy_version 131589 (0.0009) [2023-12-26 00:37:58,000][123091] Updated weights for policy 0, policy_version 131599 (0.0010) [2023-12-26 00:37:58,066][123090] Updated weights for policy 1, policy_version 131043 (0.0008) [2023-12-26 00:37:58,068][123091] Updated weights for policy 0, policy_version 131609 (0.0010) [2023-12-26 00:37:58,132][123090] Updated weights for policy 1, policy_version 131053 (0.0009) [2023-12-26 00:37:58,201][123090] Updated weights for policy 1, policy_version 131063 (0.0009) [2023-12-26 00:37:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 67248128. Throughput: 0: 9097.1, 1: 8829.2. Samples: 67244180. Policy #0 lag: (min: 20.0, avg: 25.7, max: 52.0) [2023-12-26 00:37:58,785][121949] Avg episode reward: [(0, '5671.939'), (1, '5654.954')] [2023-12-26 00:37:58,942][123091] Updated weights for policy 0, policy_version 131619 (0.0011) [2023-12-26 00:37:59,001][123091] Updated weights for policy 0, policy_version 131629 (0.0010) [2023-12-26 00:37:59,024][123090] Updated weights for policy 1, policy_version 131073 (0.0008) [2023-12-26 00:37:59,060][123091] Updated weights for policy 0, policy_version 131639 (0.0009) [2023-12-26 00:37:59,083][123090] Updated weights for policy 1, policy_version 131083 (0.0006) [2023-12-26 00:37:59,141][123090] Updated weights for policy 1, policy_version 131093 (0.0008) [2023-12-26 00:37:59,210][123090] Updated weights for policy 1, policy_version 131103 (0.0009) [2023-12-26 00:37:59,900][123091] Updated weights for policy 0, policy_version 131649 (0.0009) [2023-12-26 00:37:59,968][123091] Updated weights for policy 0, policy_version 131659 (0.0009) [2023-12-26 00:38:00,031][123091] Updated weights for policy 0, policy_version 131669 (0.0009) [2023-12-26 00:38:00,051][123090] Updated weights for policy 1, policy_version 131113 (0.0008) [2023-12-26 00:38:00,082][123091] Updated weights for policy 0, policy_version 131679 (0.0009) [2023-12-26 00:38:00,113][123090] Updated weights for policy 1, policy_version 131123 (0.0008) [2023-12-26 00:38:00,166][123090] Updated weights for policy 1, policy_version 131133 (0.0009) [2023-12-26 00:38:00,894][123090] Updated weights for policy 1, policy_version 131143 (0.0010) [2023-12-26 00:38:00,941][123090] Updated weights for policy 1, policy_version 131153 (0.0009) [2023-12-26 00:38:00,955][123091] Updated weights for policy 0, policy_version 131689 (0.0008) [2023-12-26 00:38:00,993][123090] Updated weights for policy 1, policy_version 131163 (0.0010) [2023-12-26 00:38:01,000][123091] Updated weights for policy 0, policy_version 131699 (0.0006) [2023-12-26 00:38:01,055][123091] Updated weights for policy 0, policy_version 131709 (0.0008) [2023-12-26 00:38:01,884][123090] Updated weights for policy 1, policy_version 131173 (0.0009) [2023-12-26 00:38:01,920][123091] Updated weights for policy 0, policy_version 131719 (0.0006) [2023-12-26 00:38:01,939][123090] Updated weights for policy 1, policy_version 131183 (0.0009) [2023-12-26 00:38:01,970][123091] Updated weights for policy 0, policy_version 131729 (0.0006) [2023-12-26 00:38:02,009][123090] Updated weights for policy 1, policy_version 131193 (0.0008) [2023-12-26 00:38:02,030][123091] Updated weights for policy 0, policy_version 131739 (0.0006) [2023-12-26 00:38:02,741][123090] Updated weights for policy 1, policy_version 131203 (0.0008) [2023-12-26 00:38:02,798][123091] Updated weights for policy 0, policy_version 131749 (0.0006) [2023-12-26 00:38:02,800][123090] Updated weights for policy 1, policy_version 131213 (0.0010) [2023-12-26 00:38:02,860][123090] Updated weights for policy 1, policy_version 131223 (0.0011) [2023-12-26 00:38:02,868][123091] Updated weights for policy 0, policy_version 131759 (0.0005) [2023-12-26 00:38:02,922][123091] Updated weights for policy 0, policy_version 131769 (0.0008) [2023-12-26 00:38:03,572][123090] Updated weights for policy 1, policy_version 131233 (0.0011) [2023-12-26 00:38:03,587][123091] Updated weights for policy 0, policy_version 131779 (0.0008) [2023-12-26 00:38:03,625][123090] Updated weights for policy 1, policy_version 131243 (0.0009) [2023-12-26 00:38:03,643][123091] Updated weights for policy 0, policy_version 131789 (0.0005) [2023-12-26 00:38:03,685][123090] Updated weights for policy 1, policy_version 131253 (0.0005) [2023-12-26 00:38:03,694][123091] Updated weights for policy 0, policy_version 131799 (0.0005) [2023-12-26 00:38:03,739][123090] Updated weights for policy 1, policy_version 131263 (0.0005) [2023-12-26 00:38:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 67346432. Throughput: 0: 9070.7, 1: 8769.0. Samples: 67350484. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:03,785][121949] Avg episode reward: [(0, '5630.259'), (1, '5630.667')] [2023-12-26 00:38:04,431][123091] Updated weights for policy 0, policy_version 131809 (0.0006) [2023-12-26 00:38:04,483][123091] Updated weights for policy 0, policy_version 131819 (0.0008) [2023-12-26 00:38:04,544][123091] Updated weights for policy 0, policy_version 131829 (0.0005) [2023-12-26 00:38:04,557][123090] Updated weights for policy 1, policy_version 131273 (0.0009) [2023-12-26 00:38:04,600][123091] Updated weights for policy 0, policy_version 131839 (0.0006) [2023-12-26 00:38:04,610][123090] Updated weights for policy 1, policy_version 131283 (0.0009) [2023-12-26 00:38:04,668][123090] Updated weights for policy 1, policy_version 131293 (0.0010) [2023-12-26 00:38:05,293][123091] Updated weights for policy 0, policy_version 131849 (0.0010) [2023-12-26 00:38:05,356][123091] Updated weights for policy 0, policy_version 131859 (0.0009) [2023-12-26 00:38:05,422][123091] Updated weights for policy 0, policy_version 131869 (0.0009) [2023-12-26 00:38:05,558][123090] Updated weights for policy 1, policy_version 131304 (0.0010) [2023-12-26 00:38:05,626][123090] Updated weights for policy 1, policy_version 131314 (0.0010) [2023-12-26 00:38:05,693][123090] Updated weights for policy 1, policy_version 131324 (0.0009) [2023-12-26 00:38:06,165][123091] Updated weights for policy 0, policy_version 131879 (0.0007) [2023-12-26 00:38:06,224][123091] Updated weights for policy 0, policy_version 131889 (0.0008) [2023-12-26 00:38:06,291][123091] Updated weights for policy 0, policy_version 131899 (0.0010) [2023-12-26 00:38:06,488][123090] Updated weights for policy 1, policy_version 131334 (0.0007) [2023-12-26 00:38:06,554][123090] Updated weights for policy 1, policy_version 131344 (0.0006) [2023-12-26 00:38:06,621][123090] Updated weights for policy 1, policy_version 131354 (0.0005) [2023-12-26 00:38:07,159][123091] Updated weights for policy 0, policy_version 131909 (0.0009) [2023-12-26 00:38:07,216][123091] Updated weights for policy 0, policy_version 131920 (0.0010) [2023-12-26 00:38:07,267][123091] Updated weights for policy 0, policy_version 131931 (0.0010) [2023-12-26 00:38:07,389][123090] Updated weights for policy 1, policy_version 131364 (0.0007) [2023-12-26 00:38:07,450][123090] Updated weights for policy 1, policy_version 131374 (0.0007) [2023-12-26 00:38:07,525][123090] Updated weights for policy 1, policy_version 131384 (0.0008) [2023-12-26 00:38:08,138][123091] Updated weights for policy 0, policy_version 131941 (0.0010) [2023-12-26 00:38:08,190][123091] Updated weights for policy 0, policy_version 131951 (0.0009) [2023-12-26 00:38:08,254][123091] Updated weights for policy 0, policy_version 131961 (0.0009) [2023-12-26 00:38:08,276][123090] Updated weights for policy 1, policy_version 131394 (0.0009) [2023-12-26 00:38:08,350][123090] Updated weights for policy 1, policy_version 131404 (0.0009) [2023-12-26 00:38:08,408][123090] Updated weights for policy 1, policy_version 131414 (0.0010) [2023-12-26 00:38:08,466][123090] Updated weights for policy 1, policy_version 131424 (0.0010) [2023-12-26 00:38:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 67428352. Throughput: 0: 9128.3, 1: 8806.3. Samples: 67404616. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:08,785][121949] Avg episode reward: [(0, '5651.131'), (1, '5387.125')] [2023-12-26 00:38:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000131968_33783808.pth... [2023-12-26 00:38:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000131424_33644544.pth... [2023-12-26 00:38:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000130944_33521664.pth [2023-12-26 00:38:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000130400_33382400.pth [2023-12-26 00:38:09,058][123091] Updated weights for policy 0, policy_version 131971 (0.0010) [2023-12-26 00:38:09,117][123091] Updated weights for policy 0, policy_version 131981 (0.0009) [2023-12-26 00:38:09,176][123091] Updated weights for policy 0, policy_version 131991 (0.0010) [2023-12-26 00:38:09,288][123090] Updated weights for policy 1, policy_version 131434 (0.0009) [2023-12-26 00:38:09,353][123090] Updated weights for policy 1, policy_version 131444 (0.0010) [2023-12-26 00:38:09,420][123090] Updated weights for policy 1, policy_version 131454 (0.0009) [2023-12-26 00:38:09,996][123091] Updated weights for policy 0, policy_version 132001 (0.0010) [2023-12-26 00:38:10,063][123091] Updated weights for policy 0, policy_version 132011 (0.0010) [2023-12-26 00:38:10,130][123091] Updated weights for policy 0, policy_version 132021 (0.0010) [2023-12-26 00:38:10,200][123091] Updated weights for policy 0, policy_version 132031 (0.0010) [2023-12-26 00:38:10,275][123090] Updated weights for policy 1, policy_version 131464 (0.0009) [2023-12-26 00:38:10,339][123090] Updated weights for policy 1, policy_version 131474 (0.0010) [2023-12-26 00:38:10,406][123090] Updated weights for policy 1, policy_version 131484 (0.0010) [2023-12-26 00:38:11,045][123091] Updated weights for policy 0, policy_version 132041 (0.0009) [2023-12-26 00:38:11,116][123091] Updated weights for policy 0, policy_version 132051 (0.0009) [2023-12-26 00:38:11,148][123090] Updated weights for policy 1, policy_version 131494 (0.0010) [2023-12-26 00:38:11,182][123091] Updated weights for policy 0, policy_version 132061 (0.0007) [2023-12-26 00:38:11,205][123090] Updated weights for policy 1, policy_version 131504 (0.0011) [2023-12-26 00:38:11,268][123090] Updated weights for policy 1, policy_version 131514 (0.0011) [2023-12-26 00:38:12,019][123091] Updated weights for policy 0, policy_version 132071 (0.0008) [2023-12-26 00:38:12,086][123091] Updated weights for policy 0, policy_version 132081 (0.0009) [2023-12-26 00:38:12,142][123090] Updated weights for policy 1, policy_version 131524 (0.0011) [2023-12-26 00:38:12,149][123091] Updated weights for policy 0, policy_version 132091 (0.0007) [2023-12-26 00:38:12,206][123090] Updated weights for policy 1, policy_version 131534 (0.0011) [2023-12-26 00:38:12,272][123090] Updated weights for policy 1, policy_version 131544 (0.0011) [2023-12-26 00:38:12,863][123091] Updated weights for policy 0, policy_version 132101 (0.0008) [2023-12-26 00:38:12,911][123091] Updated weights for policy 0, policy_version 132111 (0.0009) [2023-12-26 00:38:12,961][123091] Updated weights for policy 0, policy_version 132121 (0.0007) [2023-12-26 00:38:13,126][123090] Updated weights for policy 1, policy_version 131554 (0.0009) [2023-12-26 00:38:13,186][123090] Updated weights for policy 1, policy_version 131564 (0.0010) [2023-12-26 00:38:13,238][123090] Updated weights for policy 1, policy_version 131574 (0.0010) [2023-12-26 00:38:13,284][123090] Updated weights for policy 1, policy_version 131584 (0.0005) [2023-12-26 00:38:13,637][123091] Updated weights for policy 0, policy_version 132131 (0.0005) [2023-12-26 00:38:13,698][123091] Updated weights for policy 0, policy_version 132141 (0.0005) [2023-12-26 00:38:13,754][123091] Updated weights for policy 0, policy_version 132151 (0.0008) [2023-12-26 00:38:13,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 67510272. Throughput: 0: 8950.3, 1: 8817.5. Samples: 67507768. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:13,785][121949] Avg episode reward: [(0, '5596.683'), (1, '5288.566')] [2023-12-26 00:38:14,130][123090] Updated weights for policy 1, policy_version 131594 (0.0009) [2023-12-26 00:38:14,198][123090] Updated weights for policy 1, policy_version 131604 (0.0008) [2023-12-26 00:38:14,255][123090] Updated weights for policy 1, policy_version 131614 (0.0009) [2023-12-26 00:38:14,459][123091] Updated weights for policy 0, policy_version 132161 (0.0010) [2023-12-26 00:38:14,515][123091] Updated weights for policy 0, policy_version 132171 (0.0009) [2023-12-26 00:38:14,591][123091] Updated weights for policy 0, policy_version 132181 (0.0006) [2023-12-26 00:38:14,647][123091] Updated weights for policy 0, policy_version 132191 (0.0005) [2023-12-26 00:38:14,967][123090] Updated weights for policy 1, policy_version 131624 (0.0006) [2023-12-26 00:38:15,023][123090] Updated weights for policy 1, policy_version 131634 (0.0005) [2023-12-26 00:38:15,095][123090] Updated weights for policy 1, policy_version 131644 (0.0006) [2023-12-26 00:38:15,331][123091] Updated weights for policy 0, policy_version 132201 (0.0006) [2023-12-26 00:38:15,386][123091] Updated weights for policy 0, policy_version 132211 (0.0005) [2023-12-26 00:38:15,435][123091] Updated weights for policy 0, policy_version 132221 (0.0005) [2023-12-26 00:38:15,747][123090] Updated weights for policy 1, policy_version 131654 (0.0006) [2023-12-26 00:38:15,821][123090] Updated weights for policy 1, policy_version 131664 (0.0008) [2023-12-26 00:38:15,887][123090] Updated weights for policy 1, policy_version 131674 (0.0010) [2023-12-26 00:38:16,135][123091] Updated weights for policy 0, policy_version 132231 (0.0008) [2023-12-26 00:38:16,207][123091] Updated weights for policy 0, policy_version 132241 (0.0010) [2023-12-26 00:38:16,264][123091] Updated weights for policy 0, policy_version 132251 (0.0010) [2023-12-26 00:38:16,564][123090] Updated weights for policy 1, policy_version 131684 (0.0006) [2023-12-26 00:38:16,627][123090] Updated weights for policy 1, policy_version 131694 (0.0006) [2023-12-26 00:38:16,678][123090] Updated weights for policy 1, policy_version 131704 (0.0010) [2023-12-26 00:38:17,128][123091] Updated weights for policy 0, policy_version 132261 (0.0009) [2023-12-26 00:38:17,186][123091] Updated weights for policy 0, policy_version 132271 (0.0010) [2023-12-26 00:38:17,244][123091] Updated weights for policy 0, policy_version 132281 (0.0010) [2023-12-26 00:38:17,414][123090] Updated weights for policy 1, policy_version 131714 (0.0010) [2023-12-26 00:38:17,461][123090] Updated weights for policy 1, policy_version 131724 (0.0010) [2023-12-26 00:38:17,516][123090] Updated weights for policy 1, policy_version 131734 (0.0010) [2023-12-26 00:38:17,572][123090] Updated weights for policy 1, policy_version 131744 (0.0010) [2023-12-26 00:38:18,092][123091] Updated weights for policy 0, policy_version 132291 (0.0010) [2023-12-26 00:38:18,157][123091] Updated weights for policy 0, policy_version 132301 (0.0010) [2023-12-26 00:38:18,207][123091] Updated weights for policy 0, policy_version 132311 (0.0010) [2023-12-26 00:38:18,404][123090] Updated weights for policy 1, policy_version 131754 (0.0009) [2023-12-26 00:38:18,470][123090] Updated weights for policy 1, policy_version 131764 (0.0009) [2023-12-26 00:38:18,530][123090] Updated weights for policy 1, policy_version 131774 (0.0010) [2023-12-26 00:38:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 67608576. Throughput: 0: 8993.1, 1: 8813.1. Samples: 67619064. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:18,785][121949] Avg episode reward: [(0, '5664.103'), (1, '5322.150')] [2023-12-26 00:38:19,065][123091] Updated weights for policy 0, policy_version 132322 (0.0010) [2023-12-26 00:38:19,124][123091] Updated weights for policy 0, policy_version 132332 (0.0010) [2023-12-26 00:38:19,182][123091] Updated weights for policy 0, policy_version 132342 (0.0009) [2023-12-26 00:38:19,257][123091] Updated weights for policy 0, policy_version 132352 (0.0009) [2023-12-26 00:38:19,357][123090] Updated weights for policy 1, policy_version 131784 (0.0010) [2023-12-26 00:38:19,413][123090] Updated weights for policy 1, policy_version 131794 (0.0009) [2023-12-26 00:38:19,472][123090] Updated weights for policy 1, policy_version 131804 (0.0009) [2023-12-26 00:38:20,080][123091] Updated weights for policy 0, policy_version 132362 (0.0010) [2023-12-26 00:38:20,152][123091] Updated weights for policy 0, policy_version 132372 (0.0010) [2023-12-26 00:38:20,225][123091] Updated weights for policy 0, policy_version 132382 (0.0009) [2023-12-26 00:38:20,416][123090] Updated weights for policy 1, policy_version 131814 (0.0010) [2023-12-26 00:38:20,480][123090] Updated weights for policy 1, policy_version 131824 (0.0010) [2023-12-26 00:38:20,539][123090] Updated weights for policy 1, policy_version 131834 (0.0009) [2023-12-26 00:38:21,072][123091] Updated weights for policy 0, policy_version 132392 (0.0008) [2023-12-26 00:38:21,141][123091] Updated weights for policy 0, policy_version 132402 (0.0010) [2023-12-26 00:38:21,212][123091] Updated weights for policy 0, policy_version 132412 (0.0010) [2023-12-26 00:38:21,398][123090] Updated weights for policy 1, policy_version 131844 (0.0009) [2023-12-26 00:38:21,457][123090] Updated weights for policy 1, policy_version 131854 (0.0010) [2023-12-26 00:38:21,521][123090] Updated weights for policy 1, policy_version 131865 (0.0010) [2023-12-26 00:38:22,057][123091] Updated weights for policy 0, policy_version 132422 (0.0010) [2023-12-26 00:38:22,124][123091] Updated weights for policy 0, policy_version 132432 (0.0010) [2023-12-26 00:38:22,186][123091] Updated weights for policy 0, policy_version 132442 (0.0010) [2023-12-26 00:38:22,371][123090] Updated weights for policy 1, policy_version 131875 (0.0010) [2023-12-26 00:38:22,461][123090] Updated weights for policy 1, policy_version 131885 (0.0009) [2023-12-26 00:38:22,526][123090] Updated weights for policy 1, policy_version 131895 (0.0010) [2023-12-26 00:38:23,012][123091] Updated weights for policy 0, policy_version 132452 (0.0009) [2023-12-26 00:38:23,068][123091] Updated weights for policy 0, policy_version 132462 (0.0009) [2023-12-26 00:38:23,126][123091] Updated weights for policy 0, policy_version 132472 (0.0009) [2023-12-26 00:38:23,333][123090] Updated weights for policy 1, policy_version 131905 (0.0009) [2023-12-26 00:38:23,392][123090] Updated weights for policy 1, policy_version 131915 (0.0009) [2023-12-26 00:38:23,447][123090] Updated weights for policy 1, policy_version 131925 (0.0009) [2023-12-26 00:38:23,510][123090] Updated weights for policy 1, policy_version 131935 (0.0010) [2023-12-26 00:38:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17886.0, 300 sec: 17800.2). Total num frames: 67690496. Throughput: 0: 8924.5, 1: 8743.6. Samples: 67668420. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:23,785][121949] Avg episode reward: [(0, '5679.147'), (1, '5256.787')] [2023-12-26 00:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000131936_33775616.pth... [2023-12-26 00:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000132480_33914880.pth... [2023-12-26 00:38:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000130912_33513472.pth [2023-12-26 00:38:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000131456_33652736.pth [2023-12-26 00:38:23,995][123091] Updated weights for policy 0, policy_version 132482 (0.0010) [2023-12-26 00:38:24,044][123091] Updated weights for policy 0, policy_version 132492 (0.0009) [2023-12-26 00:38:24,100][123091] Updated weights for policy 0, policy_version 132502 (0.0010) [2023-12-26 00:38:24,150][123091] Updated weights for policy 0, policy_version 132512 (0.0009) [2023-12-26 00:38:24,252][123090] Updated weights for policy 1, policy_version 131945 (0.0009) [2023-12-26 00:38:24,306][123090] Updated weights for policy 1, policy_version 131955 (0.0010) [2023-12-26 00:38:24,361][123090] Updated weights for policy 1, policy_version 131965 (0.0009) [2023-12-26 00:38:24,997][123091] Updated weights for policy 0, policy_version 132522 (0.0009) [2023-12-26 00:38:25,050][123091] Updated weights for policy 0, policy_version 132532 (0.0009) [2023-12-26 00:38:25,109][123091] Updated weights for policy 0, policy_version 132542 (0.0009) [2023-12-26 00:38:25,219][123090] Updated weights for policy 1, policy_version 131975 (0.0010) [2023-12-26 00:38:25,271][123090] Updated weights for policy 1, policy_version 131985 (0.0008) [2023-12-26 00:38:25,324][123090] Updated weights for policy 1, policy_version 131995 (0.0009) [2023-12-26 00:38:25,968][123091] Updated weights for policy 0, policy_version 132552 (0.0009) [2023-12-26 00:38:26,034][123091] Updated weights for policy 0, policy_version 132562 (0.0009) [2023-12-26 00:38:26,085][123091] Updated weights for policy 0, policy_version 132572 (0.0009) [2023-12-26 00:38:26,134][123090] Updated weights for policy 1, policy_version 132005 (0.0008) [2023-12-26 00:38:26,198][123090] Updated weights for policy 1, policy_version 132015 (0.0009) [2023-12-26 00:38:26,258][123090] Updated weights for policy 1, policy_version 132025 (0.0009) [2023-12-26 00:38:26,785][123091] Updated weights for policy 0, policy_version 132582 (0.0010) [2023-12-26 00:38:26,848][123091] Updated weights for policy 0, policy_version 132592 (0.0009) [2023-12-26 00:38:26,911][123091] Updated weights for policy 0, policy_version 132602 (0.0009) [2023-12-26 00:38:27,124][123090] Updated weights for policy 1, policy_version 132035 (0.0010) [2023-12-26 00:38:27,183][123090] Updated weights for policy 1, policy_version 132045 (0.0010) [2023-12-26 00:38:27,246][123090] Updated weights for policy 1, policy_version 132055 (0.0010) [2023-12-26 00:38:27,732][123091] Updated weights for policy 0, policy_version 132612 (0.0009) [2023-12-26 00:38:27,793][123091] Updated weights for policy 0, policy_version 132622 (0.0010) [2023-12-26 00:38:27,858][123091] Updated weights for policy 0, policy_version 132632 (0.0010) [2023-12-26 00:38:27,994][123090] Updated weights for policy 1, policy_version 132065 (0.0010) [2023-12-26 00:38:28,062][123090] Updated weights for policy 1, policy_version 132075 (0.0010) [2023-12-26 00:38:28,116][123090] Updated weights for policy 1, policy_version 132085 (0.0010) [2023-12-26 00:38:28,179][123090] Updated weights for policy 1, policy_version 132095 (0.0008) [2023-12-26 00:38:28,631][123091] Updated weights for policy 0, policy_version 132642 (0.0010) [2023-12-26 00:38:28,689][123091] Updated weights for policy 0, policy_version 132652 (0.0010) [2023-12-26 00:38:28,754][123091] Updated weights for policy 0, policy_version 132662 (0.0010) [2023-12-26 00:38:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 67772416. Throughput: 0: 8852.2, 1: 8753.1. Samples: 67771640. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:28,785][121949] Avg episode reward: [(0, '5619.387'), (1, '5269.401')] [2023-12-26 00:38:28,820][123091] Updated weights for policy 0, policy_version 132672 (0.0009) [2023-12-26 00:38:28,889][123090] Updated weights for policy 1, policy_version 132105 (0.0008) [2023-12-26 00:38:28,952][123090] Updated weights for policy 1, policy_version 132115 (0.0007) [2023-12-26 00:38:29,008][123090] Updated weights for policy 1, policy_version 132125 (0.0005) [2023-12-26 00:38:29,571][123091] Updated weights for policy 0, policy_version 132682 (0.0005) [2023-12-26 00:38:29,625][123091] Updated weights for policy 0, policy_version 132692 (0.0005) [2023-12-26 00:38:29,687][123091] Updated weights for policy 0, policy_version 132702 (0.0007) [2023-12-26 00:38:29,720][123090] Updated weights for policy 1, policy_version 132135 (0.0007) [2023-12-26 00:38:29,780][123090] Updated weights for policy 1, policy_version 132145 (0.0009) [2023-12-26 00:38:29,854][123090] Updated weights for policy 1, policy_version 132155 (0.0009) [2023-12-26 00:38:30,438][123091] Updated weights for policy 0, policy_version 132712 (0.0008) [2023-12-26 00:38:30,497][123091] Updated weights for policy 0, policy_version 132722 (0.0009) [2023-12-26 00:38:30,553][123091] Updated weights for policy 0, policy_version 132732 (0.0007) [2023-12-26 00:38:30,696][123090] Updated weights for policy 1, policy_version 132165 (0.0009) [2023-12-26 00:38:30,748][123090] Updated weights for policy 1, policy_version 132175 (0.0009) [2023-12-26 00:38:30,814][123090] Updated weights for policy 1, policy_version 132185 (0.0008) [2023-12-26 00:38:31,380][123091] Updated weights for policy 0, policy_version 132742 (0.0009) [2023-12-26 00:38:31,441][123091] Updated weights for policy 0, policy_version 132752 (0.0009) [2023-12-26 00:38:31,500][123091] Updated weights for policy 0, policy_version 132762 (0.0010) [2023-12-26 00:38:31,652][123090] Updated weights for policy 1, policy_version 132195 (0.0010) [2023-12-26 00:38:31,713][123090] Updated weights for policy 1, policy_version 132205 (0.0009) [2023-12-26 00:38:31,786][123090] Updated weights for policy 1, policy_version 132215 (0.0010) [2023-12-26 00:38:32,299][123091] Updated weights for policy 0, policy_version 132772 (0.0009) [2023-12-26 00:38:32,366][123091] Updated weights for policy 0, policy_version 132782 (0.0008) [2023-12-26 00:38:32,426][123091] Updated weights for policy 0, policy_version 132792 (0.0009) [2023-12-26 00:38:32,621][123090] Updated weights for policy 1, policy_version 132225 (0.0009) [2023-12-26 00:38:32,687][123090] Updated weights for policy 1, policy_version 132235 (0.0010) [2023-12-26 00:38:32,752][123090] Updated weights for policy 1, policy_version 132245 (0.0008) [2023-12-26 00:38:32,807][123090] Updated weights for policy 1, policy_version 132255 (0.0006) [2023-12-26 00:38:33,363][123091] Updated weights for policy 0, policy_version 132802 (0.0010) [2023-12-26 00:38:33,412][123091] Updated weights for policy 0, policy_version 132812 (0.0009) [2023-12-26 00:38:33,465][123091] Updated weights for policy 0, policy_version 132822 (0.0010) [2023-12-26 00:38:33,513][123090] Updated weights for policy 1, policy_version 132265 (0.0005) [2023-12-26 00:38:33,517][123091] Updated weights for policy 0, policy_version 132832 (0.0009) [2023-12-26 00:38:33,571][123090] Updated weights for policy 1, policy_version 132275 (0.0005) [2023-12-26 00:38:33,629][123090] Updated weights for policy 1, policy_version 132285 (0.0005) [2023-12-26 00:38:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 67870720. Throughput: 0: 8730.7, 1: 8776.0. Samples: 67878596. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:33,784][121949] Avg episode reward: [(0, '5588.878'), (1, '5443.205')] [2023-12-26 00:38:34,330][123090] Updated weights for policy 1, policy_version 132295 (0.0007) [2023-12-26 00:38:34,336][123091] Updated weights for policy 0, policy_version 132842 (0.0010) [2023-12-26 00:38:34,394][123091] Updated weights for policy 0, policy_version 132852 (0.0008) [2023-12-26 00:38:34,396][123090] Updated weights for policy 1, policy_version 132305 (0.0008) [2023-12-26 00:38:34,459][123091] Updated weights for policy 0, policy_version 132862 (0.0008) [2023-12-26 00:38:34,462][123090] Updated weights for policy 1, policy_version 132315 (0.0009) [2023-12-26 00:38:35,147][123090] Updated weights for policy 1, policy_version 132325 (0.0007) [2023-12-26 00:38:35,192][123091] Updated weights for policy 0, policy_version 132872 (0.0006) [2023-12-26 00:38:35,218][123090] Updated weights for policy 1, policy_version 132335 (0.0007) [2023-12-26 00:38:35,240][123091] Updated weights for policy 0, policy_version 132882 (0.0006) [2023-12-26 00:38:35,273][123090] Updated weights for policy 1, policy_version 132345 (0.0009) [2023-12-26 00:38:35,291][123091] Updated weights for policy 0, policy_version 132892 (0.0005) [2023-12-26 00:38:35,886][123091] Updated weights for policy 0, policy_version 132902 (0.0007) [2023-12-26 00:38:35,935][123091] Updated weights for policy 0, policy_version 132912 (0.0005) [2023-12-26 00:38:35,984][123091] Updated weights for policy 0, policy_version 132922 (0.0006) [2023-12-26 00:38:36,078][123090] Updated weights for policy 1, policy_version 132355 (0.0009) [2023-12-26 00:38:36,170][123090] Updated weights for policy 1, policy_version 132365 (0.0006) [2023-12-26 00:38:36,238][123090] Updated weights for policy 1, policy_version 132375 (0.0005) [2023-12-26 00:38:36,830][123091] Updated weights for policy 0, policy_version 132932 (0.0011) [2023-12-26 00:38:36,894][123091] Updated weights for policy 0, policy_version 132942 (0.0011) [2023-12-26 00:38:36,948][123090] Updated weights for policy 1, policy_version 132385 (0.0006) [2023-12-26 00:38:36,960][123091] Updated weights for policy 0, policy_version 132952 (0.0011) [2023-12-26 00:38:37,013][123090] Updated weights for policy 1, policy_version 132395 (0.0006) [2023-12-26 00:38:37,075][123090] Updated weights for policy 1, policy_version 132405 (0.0006) [2023-12-26 00:38:37,141][123090] Updated weights for policy 1, policy_version 132415 (0.0005) [2023-12-26 00:38:37,776][123091] Updated weights for policy 0, policy_version 132962 (0.0011) [2023-12-26 00:38:37,805][123090] Updated weights for policy 1, policy_version 132425 (0.0005) [2023-12-26 00:38:37,831][123091] Updated weights for policy 0, policy_version 132972 (0.0011) [2023-12-26 00:38:37,856][123090] Updated weights for policy 1, policy_version 132435 (0.0006) [2023-12-26 00:38:37,883][123091] Updated weights for policy 0, policy_version 132982 (0.0011) [2023-12-26 00:38:37,905][123090] Updated weights for policy 1, policy_version 132445 (0.0005) [2023-12-26 00:38:37,930][123091] Updated weights for policy 0, policy_version 132992 (0.0010) [2023-12-26 00:38:38,640][123090] Updated weights for policy 1, policy_version 132455 (0.0007) [2023-12-26 00:38:38,697][123090] Updated weights for policy 1, policy_version 132465 (0.0009) [2023-12-26 00:38:38,705][123091] Updated weights for policy 0, policy_version 133002 (0.0011) [2023-12-26 00:38:38,760][123090] Updated weights for policy 1, policy_version 132475 (0.0008) [2023-12-26 00:38:38,772][123091] Updated weights for policy 0, policy_version 133012 (0.0009) [2023-12-26 00:38:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 67952640. Throughput: 0: 8789.1, 1: 8848.7. Samples: 67934864. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:38,785][121949] Avg episode reward: [(0, '5662.659'), (1, '5651.894')] [2023-12-26 00:38:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000132480_33914880.pth... [2023-12-26 00:38:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000131424_33644544.pth [2023-12-26 00:38:38,841][123091] Updated weights for policy 0, policy_version 133022 (0.0008) [2023-12-26 00:38:38,852][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000133024_34054144.pth... [2023-12-26 00:38:38,857][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000131968_33783808.pth [2023-12-26 00:38:39,423][123090] Updated weights for policy 1, policy_version 132485 (0.0009) [2023-12-26 00:38:39,487][123090] Updated weights for policy 1, policy_version 132495 (0.0008) [2023-12-26 00:38:39,546][123090] Updated weights for policy 1, policy_version 132505 (0.0006) [2023-12-26 00:38:39,627][123091] Updated weights for policy 0, policy_version 133032 (0.0011) [2023-12-26 00:38:39,690][123091] Updated weights for policy 0, policy_version 133042 (0.0011) [2023-12-26 00:38:39,749][123091] Updated weights for policy 0, policy_version 133052 (0.0011) [2023-12-26 00:38:40,294][123090] Updated weights for policy 1, policy_version 132515 (0.0007) [2023-12-26 00:38:40,345][123090] Updated weights for policy 1, policy_version 132525 (0.0006) [2023-12-26 00:38:40,400][123090] Updated weights for policy 1, policy_version 132535 (0.0005) [2023-12-26 00:38:40,546][123091] Updated weights for policy 0, policy_version 133062 (0.0008) [2023-12-26 00:38:40,615][123091] Updated weights for policy 0, policy_version 133072 (0.0005) [2023-12-26 00:38:40,675][123091] Updated weights for policy 0, policy_version 133082 (0.0006) [2023-12-26 00:38:41,061][123090] Updated weights for policy 1, policy_version 132545 (0.0006) [2023-12-26 00:38:41,133][123090] Updated weights for policy 1, policy_version 132555 (0.0008) [2023-12-26 00:38:41,210][123090] Updated weights for policy 1, policy_version 132565 (0.0009) [2023-12-26 00:38:41,278][123090] Updated weights for policy 1, policy_version 132575 (0.0010) [2023-12-26 00:38:41,411][123091] Updated weights for policy 0, policy_version 133092 (0.0007) [2023-12-26 00:38:41,485][123091] Updated weights for policy 0, policy_version 133102 (0.0010) [2023-12-26 00:38:41,549][123091] Updated weights for policy 0, policy_version 133112 (0.0009) [2023-12-26 00:38:42,127][123090] Updated weights for policy 1, policy_version 132585 (0.0009) [2023-12-26 00:38:42,190][123090] Updated weights for policy 1, policy_version 132595 (0.0010) [2023-12-26 00:38:42,256][123090] Updated weights for policy 1, policy_version 132605 (0.0009) [2023-12-26 00:38:42,371][123091] Updated weights for policy 0, policy_version 133122 (0.0010) [2023-12-26 00:38:42,439][123091] Updated weights for policy 0, policy_version 133132 (0.0007) [2023-12-26 00:38:42,508][123091] Updated weights for policy 0, policy_version 133142 (0.0010) [2023-12-26 00:38:42,564][123091] Updated weights for policy 0, policy_version 133152 (0.0009) [2023-12-26 00:38:43,111][123090] Updated weights for policy 1, policy_version 132615 (0.0006) [2023-12-26 00:38:43,159][123090] Updated weights for policy 1, policy_version 132625 (0.0005) [2023-12-26 00:38:43,208][123090] Updated weights for policy 1, policy_version 132635 (0.0005) [2023-12-26 00:38:43,340][123091] Updated weights for policy 0, policy_version 133163 (0.0011) [2023-12-26 00:38:43,402][123091] Updated weights for policy 0, policy_version 133173 (0.0010) [2023-12-26 00:38:43,461][123091] Updated weights for policy 0, policy_version 133183 (0.0010) [2023-12-26 00:38:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 68050944. Throughput: 0: 8837.9, 1: 8934.2. Samples: 68043924. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:43,785][121949] Avg episode reward: [(0, '5707.598'), (1, '5733.719')] [2023-12-26 00:38:43,785][123007] Saving new best policy, reward=5707.598! [2023-12-26 00:38:43,926][123090] Updated weights for policy 1, policy_version 132645 (0.0007) [2023-12-26 00:38:43,979][123090] Updated weights for policy 1, policy_version 132655 (0.0009) [2023-12-26 00:38:44,044][123090] Updated weights for policy 1, policy_version 132665 (0.0009) [2023-12-26 00:38:44,220][123091] Updated weights for policy 0, policy_version 133193 (0.0010) [2023-12-26 00:38:44,271][123091] Updated weights for policy 0, policy_version 133203 (0.0010) [2023-12-26 00:38:44,336][123091] Updated weights for policy 0, policy_version 133213 (0.0010) [2023-12-26 00:38:44,750][123090] Updated weights for policy 1, policy_version 132675 (0.0007) [2023-12-26 00:38:44,813][123090] Updated weights for policy 1, policy_version 132685 (0.0008) [2023-12-26 00:38:44,879][123090] Updated weights for policy 1, policy_version 132695 (0.0005) [2023-12-26 00:38:45,100][123091] Updated weights for policy 0, policy_version 133223 (0.0011) [2023-12-26 00:38:45,167][123091] Updated weights for policy 0, policy_version 133233 (0.0011) [2023-12-26 00:38:45,220][123091] Updated weights for policy 0, policy_version 133243 (0.0011) [2023-12-26 00:38:45,563][123090] Updated weights for policy 1, policy_version 132705 (0.0005) [2023-12-26 00:38:45,627][123090] Updated weights for policy 1, policy_version 132715 (0.0005) [2023-12-26 00:38:45,689][123090] Updated weights for policy 1, policy_version 132725 (0.0005) [2023-12-26 00:38:45,750][123090] Updated weights for policy 1, policy_version 132735 (0.0005) [2023-12-26 00:38:46,045][123091] Updated weights for policy 0, policy_version 133253 (0.0010) [2023-12-26 00:38:46,097][123091] Updated weights for policy 0, policy_version 133263 (0.0010) [2023-12-26 00:38:46,147][123091] Updated weights for policy 0, policy_version 133273 (0.0010) [2023-12-26 00:38:46,437][123090] Updated weights for policy 1, policy_version 132745 (0.0006) [2023-12-26 00:38:46,497][123090] Updated weights for policy 1, policy_version 132755 (0.0010) [2023-12-26 00:38:46,558][123090] Updated weights for policy 1, policy_version 132765 (0.0011) [2023-12-26 00:38:46,958][123091] Updated weights for policy 0, policy_version 133283 (0.0009) [2023-12-26 00:38:47,016][123091] Updated weights for policy 0, policy_version 133293 (0.0005) [2023-12-26 00:38:47,075][123091] Updated weights for policy 0, policy_version 133303 (0.0007) [2023-12-26 00:38:47,212][123090] Updated weights for policy 1, policy_version 132775 (0.0009) [2023-12-26 00:38:47,265][123090] Updated weights for policy 1, policy_version 132785 (0.0009) [2023-12-26 00:38:47,326][123090] Updated weights for policy 1, policy_version 132795 (0.0009) [2023-12-26 00:38:47,862][123091] Updated weights for policy 0, policy_version 133313 (0.0007) [2023-12-26 00:38:47,929][123091] Updated weights for policy 0, policy_version 133323 (0.0008) [2023-12-26 00:38:47,984][123091] Updated weights for policy 0, policy_version 133333 (0.0009) [2023-12-26 00:38:48,052][123091] Updated weights for policy 0, policy_version 133343 (0.0010) [2023-12-26 00:38:48,119][123090] Updated weights for policy 1, policy_version 132805 (0.0010) [2023-12-26 00:38:48,173][123090] Updated weights for policy 1, policy_version 132815 (0.0010) [2023-12-26 00:38:48,237][123090] Updated weights for policy 1, policy_version 132826 (0.0010) [2023-12-26 00:38:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 68141056. Throughput: 0: 8887.7, 1: 9029.0. Samples: 68156736. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:48,785][121949] Avg episode reward: [(0, '5768.525'), (1, '5659.500')] [2023-12-26 00:38:48,829][123091] Updated weights for policy 0, policy_version 133353 (0.0011) [2023-12-26 00:38:48,908][123091] Updated weights for policy 0, policy_version 133363 (0.0011) [2023-12-26 00:38:48,963][123090] Updated weights for policy 1, policy_version 132836 (0.0009) [2023-12-26 00:38:48,982][123091] Updated weights for policy 0, policy_version 133373 (0.0008) [2023-12-26 00:38:48,999][123007] Saving new best policy, reward=5768.525! [2023-12-26 00:38:49,034][123090] Updated weights for policy 1, policy_version 132846 (0.0007) [2023-12-26 00:38:49,105][123090] Updated weights for policy 1, policy_version 132856 (0.0006) [2023-12-26 00:38:49,734][123091] Updated weights for policy 0, policy_version 133383 (0.0010) [2023-12-26 00:38:49,804][123091] Updated weights for policy 0, policy_version 133393 (0.0011) [2023-12-26 00:38:49,859][123090] Updated weights for policy 1, policy_version 132866 (0.0005) [2023-12-26 00:38:49,872][123091] Updated weights for policy 0, policy_version 133403 (0.0009) [2023-12-26 00:38:49,928][123090] Updated weights for policy 1, policy_version 132876 (0.0008) [2023-12-26 00:38:49,984][123090] Updated weights for policy 1, policy_version 132886 (0.0010) [2023-12-26 00:38:50,047][123090] Updated weights for policy 1, policy_version 132896 (0.0008) [2023-12-26 00:38:50,574][123091] Updated weights for policy 0, policy_version 133413 (0.0009) [2023-12-26 00:38:50,639][123091] Updated weights for policy 0, policy_version 133423 (0.0011) [2023-12-26 00:38:50,713][123091] Updated weights for policy 0, policy_version 133433 (0.0011) [2023-12-26 00:38:50,846][123090] Updated weights for policy 1, policy_version 132906 (0.0009) [2023-12-26 00:38:50,906][123090] Updated weights for policy 1, policy_version 132916 (0.0006) [2023-12-26 00:38:50,977][123090] Updated weights for policy 1, policy_version 132926 (0.0006) [2023-12-26 00:38:51,442][123091] Updated weights for policy 0, policy_version 133443 (0.0008) [2023-12-26 00:38:51,518][123091] Updated weights for policy 0, policy_version 133453 (0.0006) [2023-12-26 00:38:51,588][123091] Updated weights for policy 0, policy_version 133463 (0.0006) [2023-12-26 00:38:51,760][123090] Updated weights for policy 1, policy_version 132936 (0.0008) [2023-12-26 00:38:51,828][123090] Updated weights for policy 1, policy_version 132946 (0.0010) [2023-12-26 00:38:51,899][123090] Updated weights for policy 1, policy_version 132956 (0.0011) [2023-12-26 00:38:52,370][123091] Updated weights for policy 0, policy_version 133473 (0.0009) [2023-12-26 00:38:52,446][123091] Updated weights for policy 0, policy_version 133483 (0.0005) [2023-12-26 00:38:52,522][123091] Updated weights for policy 0, policy_version 133493 (0.0006) [2023-12-26 00:38:52,596][123091] Updated weights for policy 0, policy_version 133503 (0.0006) [2023-12-26 00:38:52,670][123090] Updated weights for policy 1, policy_version 132966 (0.0008) [2023-12-26 00:38:52,728][123090] Updated weights for policy 1, policy_version 132976 (0.0008) [2023-12-26 00:38:52,787][123090] Updated weights for policy 1, policy_version 132986 (0.0010) [2023-12-26 00:38:53,273][123091] Updated weights for policy 0, policy_version 133513 (0.0008) [2023-12-26 00:38:53,328][123091] Updated weights for policy 0, policy_version 133523 (0.0008) [2023-12-26 00:38:53,379][123091] Updated weights for policy 0, policy_version 133533 (0.0009) [2023-12-26 00:38:53,592][123090] Updated weights for policy 1, policy_version 132996 (0.0010) [2023-12-26 00:38:53,640][123090] Updated weights for policy 1, policy_version 133006 (0.0010) [2023-12-26 00:38:53,688][123090] Updated weights for policy 1, policy_version 133016 (0.0010) [2023-12-26 00:38:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 68239360. Throughput: 0: 8870.3, 1: 9047.9. Samples: 68210940. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:53,786][121949] Avg episode reward: [(0, '5766.301'), (1, '5545.619')] [2023-12-26 00:38:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000133536_34185216.pth... [2023-12-26 00:38:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000133024_34054144.pth... [2023-12-26 00:38:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000132480_33914880.pth [2023-12-26 00:38:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000131936_33775616.pth [2023-12-26 00:38:54,129][123091] Updated weights for policy 0, policy_version 133543 (0.0006) [2023-12-26 00:38:54,174][123091] Updated weights for policy 0, policy_version 133553 (0.0005) [2023-12-26 00:38:54,224][123091] Updated weights for policy 0, policy_version 133563 (0.0005) [2023-12-26 00:38:54,475][123090] Updated weights for policy 1, policy_version 133026 (0.0010) [2023-12-26 00:38:54,522][123090] Updated weights for policy 1, policy_version 133036 (0.0008) [2023-12-26 00:38:54,570][123090] Updated weights for policy 1, policy_version 133046 (0.0005) [2023-12-26 00:38:54,622][123090] Updated weights for policy 1, policy_version 133056 (0.0005) [2023-12-26 00:38:54,931][123091] Updated weights for policy 0, policy_version 133573 (0.0005) [2023-12-26 00:38:55,003][123091] Updated weights for policy 0, policy_version 133583 (0.0006) [2023-12-26 00:38:55,057][123091] Updated weights for policy 0, policy_version 133593 (0.0005) [2023-12-26 00:38:55,329][123090] Updated weights for policy 1, policy_version 133066 (0.0009) [2023-12-26 00:38:55,376][123090] Updated weights for policy 1, policy_version 133076 (0.0009) [2023-12-26 00:38:55,426][123090] Updated weights for policy 1, policy_version 133086 (0.0008) [2023-12-26 00:38:55,778][123091] Updated weights for policy 0, policy_version 133603 (0.0007) [2023-12-26 00:38:55,829][123091] Updated weights for policy 0, policy_version 133613 (0.0005) [2023-12-26 00:38:55,875][123091] Updated weights for policy 0, policy_version 133623 (0.0005) [2023-12-26 00:38:56,353][123090] Updated weights for policy 1, policy_version 133096 (0.0009) [2023-12-26 00:38:56,403][123090] Updated weights for policy 1, policy_version 133106 (0.0009) [2023-12-26 00:38:56,460][123090] Updated weights for policy 1, policy_version 133116 (0.0010) [2023-12-26 00:38:56,570][123091] Updated weights for policy 0, policy_version 133633 (0.0006) [2023-12-26 00:38:56,644][123091] Updated weights for policy 0, policy_version 133643 (0.0005) [2023-12-26 00:38:56,708][123091] Updated weights for policy 0, policy_version 133653 (0.0010) [2023-12-26 00:38:56,756][123091] Updated weights for policy 0, policy_version 133663 (0.0009) [2023-12-26 00:38:57,231][123090] Updated weights for policy 1, policy_version 133126 (0.0007) [2023-12-26 00:38:57,282][123090] Updated weights for policy 1, policy_version 133136 (0.0006) [2023-12-26 00:38:57,346][123090] Updated weights for policy 1, policy_version 133146 (0.0008) [2023-12-26 00:38:57,456][123091] Updated weights for policy 0, policy_version 133673 (0.0006) [2023-12-26 00:38:57,507][123091] Updated weights for policy 0, policy_version 133683 (0.0005) [2023-12-26 00:38:57,563][123091] Updated weights for policy 0, policy_version 133693 (0.0005) [2023-12-26 00:38:58,187][123090] Updated weights for policy 1, policy_version 133156 (0.0008) [2023-12-26 00:38:58,253][123090] Updated weights for policy 1, policy_version 133166 (0.0006) [2023-12-26 00:38:58,288][123091] Updated weights for policy 0, policy_version 133703 (0.0007) [2023-12-26 00:38:58,320][123090] Updated weights for policy 1, policy_version 133176 (0.0008) [2023-12-26 00:38:58,351][123091] Updated weights for policy 0, policy_version 133713 (0.0009) [2023-12-26 00:38:58,418][123091] Updated weights for policy 0, policy_version 133723 (0.0013) [2023-12-26 00:38:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 68329472. Throughput: 0: 9010.4, 1: 9077.8. Samples: 68321736. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:38:58,785][121949] Avg episode reward: [(0, '5729.739'), (1, '5590.949')] [2023-12-26 00:38:59,224][123090] Updated weights for policy 1, policy_version 133189 (0.0008) [2023-12-26 00:38:59,259][123091] Updated weights for policy 0, policy_version 133733 (0.0010) [2023-12-26 00:38:59,303][123090] Updated weights for policy 1, policy_version 133199 (0.0008) [2023-12-26 00:38:59,323][123091] Updated weights for policy 0, policy_version 133743 (0.0008) [2023-12-26 00:38:59,371][123090] Updated weights for policy 1, policy_version 133209 (0.0008) [2023-12-26 00:38:59,387][123091] Updated weights for policy 0, policy_version 133753 (0.0009) [2023-12-26 00:39:00,218][123090] Updated weights for policy 1, policy_version 133219 (0.0009) [2023-12-26 00:39:00,224][123091] Updated weights for policy 0, policy_version 133763 (0.0009) [2023-12-26 00:39:00,275][123090] Updated weights for policy 1, policy_version 133229 (0.0008) [2023-12-26 00:39:00,282][123091] Updated weights for policy 0, policy_version 133773 (0.0005) [2023-12-26 00:39:00,333][123090] Updated weights for policy 1, policy_version 133239 (0.0009) [2023-12-26 00:39:00,335][123091] Updated weights for policy 0, policy_version 133783 (0.0005) [2023-12-26 00:39:01,011][123091] Updated weights for policy 0, policy_version 133793 (0.0005) [2023-12-26 00:39:01,073][123091] Updated weights for policy 0, policy_version 133803 (0.0006) [2023-12-26 00:39:01,131][123091] Updated weights for policy 0, policy_version 133813 (0.0008) [2023-12-26 00:39:01,138][123090] Updated weights for policy 1, policy_version 133249 (0.0009) [2023-12-26 00:39:01,190][123091] Updated weights for policy 0, policy_version 133823 (0.0008) [2023-12-26 00:39:01,203][123090] Updated weights for policy 1, policy_version 133259 (0.0008) [2023-12-26 00:39:01,266][123090] Updated weights for policy 1, policy_version 133269 (0.0008) [2023-12-26 00:39:01,321][123090] Updated weights for policy 1, policy_version 133279 (0.0008) [2023-12-26 00:39:01,971][123091] Updated weights for policy 0, policy_version 133833 (0.0010) [2023-12-26 00:39:02,023][123091] Updated weights for policy 0, policy_version 133843 (0.0010) [2023-12-26 00:39:02,071][123090] Updated weights for policy 1, policy_version 133289 (0.0007) [2023-12-26 00:39:02,075][123091] Updated weights for policy 0, policy_version 133853 (0.0009) [2023-12-26 00:39:02,133][123090] Updated weights for policy 1, policy_version 133299 (0.0006) [2023-12-26 00:39:02,190][123090] Updated weights for policy 1, policy_version 133309 (0.0006) [2023-12-26 00:39:02,953][123091] Updated weights for policy 0, policy_version 133863 (0.0008) [2023-12-26 00:39:02,955][123090] Updated weights for policy 1, policy_version 133319 (0.0008) [2023-12-26 00:39:03,002][123091] Updated weights for policy 0, policy_version 133873 (0.0006) [2023-12-26 00:39:03,023][123090] Updated weights for policy 1, policy_version 133329 (0.0010) [2023-12-26 00:39:03,066][123091] Updated weights for policy 0, policy_version 133883 (0.0009) [2023-12-26 00:39:03,081][123090] Updated weights for policy 1, policy_version 133339 (0.0007) [2023-12-26 00:39:03,690][123090] Updated weights for policy 1, policy_version 133349 (0.0006) [2023-12-26 00:39:03,757][123090] Updated weights for policy 1, policy_version 133359 (0.0009) [2023-12-26 00:39:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 68411392. Throughput: 0: 8937.0, 1: 9044.1. Samples: 68428212. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 00:39:03,785][121949] Avg episode reward: [(0, '5690.721'), (1, '5681.408')] [2023-12-26 00:39:03,814][123090] Updated weights for policy 1, policy_version 133369 (0.0009) [2023-12-26 00:39:03,931][123091] Updated weights for policy 0, policy_version 133893 (0.0008) [2023-12-26 00:39:03,997][123091] Updated weights for policy 0, policy_version 133903 (0.0009) [2023-12-26 00:39:04,067][123091] Updated weights for policy 0, policy_version 133913 (0.0009) [2023-12-26 00:39:04,646][123090] Updated weights for policy 1, policy_version 133379 (0.0010) [2023-12-26 00:39:04,707][123090] Updated weights for policy 1, policy_version 133389 (0.0010) [2023-12-26 00:39:04,760][123090] Updated weights for policy 1, policy_version 133399 (0.0010) [2023-12-26 00:39:04,817][123091] Updated weights for policy 0, policy_version 133923 (0.0010) [2023-12-26 00:39:04,877][123091] Updated weights for policy 0, policy_version 133933 (0.0009) [2023-12-26 00:39:04,942][123091] Updated weights for policy 0, policy_version 133943 (0.0009) [2023-12-26 00:39:05,610][123090] Updated weights for policy 1, policy_version 133409 (0.0009) [2023-12-26 00:39:05,675][123090] Updated weights for policy 1, policy_version 133419 (0.0008) [2023-12-26 00:39:05,728][123090] Updated weights for policy 1, policy_version 133429 (0.0008) [2023-12-26 00:39:05,788][123091] Updated weights for policy 0, policy_version 133953 (0.0010) [2023-12-26 00:39:05,794][123090] Updated weights for policy 1, policy_version 133439 (0.0005) [2023-12-26 00:39:05,851][123091] Updated weights for policy 0, policy_version 133963 (0.0009) [2023-12-26 00:39:05,904][123091] Updated weights for policy 0, policy_version 133973 (0.0009) [2023-12-26 00:39:05,958][123091] Updated weights for policy 0, policy_version 133983 (0.0009) [2023-12-26 00:39:06,620][123090] Updated weights for policy 1, policy_version 133449 (0.0006) [2023-12-26 00:39:06,682][123090] Updated weights for policy 1, policy_version 133459 (0.0007) [2023-12-26 00:39:06,745][123090] Updated weights for policy 1, policy_version 133469 (0.0009) [2023-12-26 00:39:06,854][123091] Updated weights for policy 0, policy_version 133993 (0.0010) [2023-12-26 00:39:06,921][123091] Updated weights for policy 0, policy_version 134003 (0.0009) [2023-12-26 00:39:06,986][123091] Updated weights for policy 0, policy_version 134013 (0.0009) [2023-12-26 00:39:07,423][123090] Updated weights for policy 1, policy_version 133479 (0.0005) [2023-12-26 00:39:07,484][123090] Updated weights for policy 1, policy_version 133489 (0.0006) [2023-12-26 00:39:07,535][123090] Updated weights for policy 1, policy_version 133499 (0.0005) [2023-12-26 00:39:07,938][123091] Updated weights for policy 0, policy_version 134023 (0.0011) [2023-12-26 00:39:08,010][123091] Updated weights for policy 0, policy_version 134033 (0.0010) [2023-12-26 00:39:08,067][123091] Updated weights for policy 0, policy_version 134044 (0.0010) [2023-12-26 00:39:08,219][123090] Updated weights for policy 1, policy_version 133509 (0.0005) [2023-12-26 00:39:08,286][123090] Updated weights for policy 1, policy_version 133519 (0.0005) [2023-12-26 00:39:08,357][123090] Updated weights for policy 1, policy_version 133529 (0.0007) [2023-12-26 00:39:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 68501504. Throughput: 0: 8944.4, 1: 9076.9. Samples: 68479380. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:08,785][121949] Avg episode reward: [(0, '5689.545'), (1, '5772.094')] [2023-12-26 00:39:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000133536_34185216.pth... [2023-12-26 00:39:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000134048_34316288.pth... [2023-12-26 00:39:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000132480_33914880.pth [2023-12-26 00:39:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000133024_34054144.pth [2023-12-26 00:39:08,867][123090] Updated weights for policy 1, policy_version 133539 (0.0007) [2023-12-26 00:39:08,925][123090] Updated weights for policy 1, policy_version 133549 (0.0006) [2023-12-26 00:39:08,956][123091] Updated weights for policy 0, policy_version 134054 (0.0007) [2023-12-26 00:39:08,992][123090] Updated weights for policy 1, policy_version 133559 (0.0006) [2023-12-26 00:39:09,021][123091] Updated weights for policy 0, policy_version 134064 (0.0008) [2023-12-26 00:39:09,096][123091] Updated weights for policy 0, policy_version 134074 (0.0010) [2023-12-26 00:39:09,803][123090] Updated weights for policy 1, policy_version 133569 (0.0006) [2023-12-26 00:39:09,876][123090] Updated weights for policy 1, policy_version 133579 (0.0009) [2023-12-26 00:39:09,947][123090] Updated weights for policy 1, policy_version 133589 (0.0009) [2023-12-26 00:39:09,949][123091] Updated weights for policy 0, policy_version 134084 (0.0008) [2023-12-26 00:39:10,004][123091] Updated weights for policy 0, policy_version 134094 (0.0007) [2023-12-26 00:39:10,017][123090] Updated weights for policy 1, policy_version 133599 (0.0009) [2023-12-26 00:39:10,059][123091] Updated weights for policy 0, policy_version 134104 (0.0006) [2023-12-26 00:39:10,774][123090] Updated weights for policy 1, policy_version 133609 (0.0008) [2023-12-26 00:39:10,838][123091] Updated weights for policy 0, policy_version 134114 (0.0006) [2023-12-26 00:39:10,850][123090] Updated weights for policy 1, policy_version 133619 (0.0010) [2023-12-26 00:39:10,907][123091] Updated weights for policy 0, policy_version 134124 (0.0005) [2023-12-26 00:39:10,911][123090] Updated weights for policy 1, policy_version 133629 (0.0009) [2023-12-26 00:39:10,961][123091] Updated weights for policy 0, policy_version 134134 (0.0005) [2023-12-26 00:39:11,024][123091] Updated weights for policy 0, policy_version 134144 (0.0006) [2023-12-26 00:39:11,773][123090] Updated weights for policy 1, policy_version 133639 (0.0010) [2023-12-26 00:39:11,836][123090] Updated weights for policy 1, policy_version 133649 (0.0009) [2023-12-26 00:39:11,879][123091] Updated weights for policy 0, policy_version 134154 (0.0008) [2023-12-26 00:39:11,894][123090] Updated weights for policy 1, policy_version 133659 (0.0007) [2023-12-26 00:39:11,939][123091] Updated weights for policy 0, policy_version 134164 (0.0008) [2023-12-26 00:39:11,991][123091] Updated weights for policy 0, policy_version 134174 (0.0010) [2023-12-26 00:39:12,743][123090] Updated weights for policy 1, policy_version 133669 (0.0010) [2023-12-26 00:39:12,806][123090] Updated weights for policy 1, policy_version 133679 (0.0008) [2023-12-26 00:39:12,830][123091] Updated weights for policy 0, policy_version 134184 (0.0007) [2023-12-26 00:39:12,868][123090] Updated weights for policy 1, policy_version 133689 (0.0009) [2023-12-26 00:39:12,887][123091] Updated weights for policy 0, policy_version 134194 (0.0005) [2023-12-26 00:39:12,946][123091] Updated weights for policy 0, policy_version 134204 (0.0006) [2023-12-26 00:39:13,622][123091] Updated weights for policy 0, policy_version 134214 (0.0008) [2023-12-26 00:39:13,669][123091] Updated weights for policy 0, policy_version 134224 (0.0010) [2023-12-26 00:39:13,717][123091] Updated weights for policy 0, policy_version 134234 (0.0010) [2023-12-26 00:39:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 68591616. Throughput: 0: 8897.0, 1: 9153.7. Samples: 68583916. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:13,785][121949] Avg episode reward: [(0, '5660.763'), (1, '5698.991')] [2023-12-26 00:39:13,787][123090] Updated weights for policy 1, policy_version 133699 (0.0009) [2023-12-26 00:39:13,860][123090] Updated weights for policy 1, policy_version 133709 (0.0008) [2023-12-26 00:39:13,932][123090] Updated weights for policy 1, policy_version 133719 (0.0008) [2023-12-26 00:39:14,548][123090] Updated weights for policy 1, policy_version 133729 (0.0008) [2023-12-26 00:39:14,560][123091] Updated weights for policy 0, policy_version 134244 (0.0010) [2023-12-26 00:39:14,611][123091] Updated weights for policy 0, policy_version 134254 (0.0010) [2023-12-26 00:39:14,620][123090] Updated weights for policy 1, policy_version 133739 (0.0006) [2023-12-26 00:39:14,667][123091] Updated weights for policy 0, policy_version 134264 (0.0010) [2023-12-26 00:39:14,685][123090] Updated weights for policy 1, policy_version 133749 (0.0007) [2023-12-26 00:39:14,748][123090] Updated weights for policy 1, policy_version 133759 (0.0009) [2023-12-26 00:39:15,503][123090] Updated weights for policy 1, policy_version 133769 (0.0010) [2023-12-26 00:39:15,510][123091] Updated weights for policy 0, policy_version 134274 (0.0010) [2023-12-26 00:39:15,566][123090] Updated weights for policy 1, policy_version 133779 (0.0010) [2023-12-26 00:39:15,573][123091] Updated weights for policy 0, policy_version 134284 (0.0011) [2023-12-26 00:39:15,629][123091] Updated weights for policy 0, policy_version 134294 (0.0007) [2023-12-26 00:39:15,630][123090] Updated weights for policy 1, policy_version 133789 (0.0010) [2023-12-26 00:39:15,679][123091] Updated weights for policy 0, policy_version 134304 (0.0005) [2023-12-26 00:39:16,304][123091] Updated weights for policy 0, policy_version 134314 (0.0005) [2023-12-26 00:39:16,343][123090] Updated weights for policy 1, policy_version 133799 (0.0009) [2023-12-26 00:39:16,362][123091] Updated weights for policy 0, policy_version 134324 (0.0008) [2023-12-26 00:39:16,399][123090] Updated weights for policy 1, policy_version 133809 (0.0005) [2023-12-26 00:39:16,413][123091] Updated weights for policy 0, policy_version 134334 (0.0010) [2023-12-26 00:39:16,457][123090] Updated weights for policy 1, policy_version 133819 (0.0005) [2023-12-26 00:39:17,091][123090] Updated weights for policy 1, policy_version 133829 (0.0008) [2023-12-26 00:39:17,139][123090] Updated weights for policy 1, policy_version 133839 (0.0010) [2023-12-26 00:39:17,157][123091] Updated weights for policy 0, policy_version 134344 (0.0009) [2023-12-26 00:39:17,201][123090] Updated weights for policy 1, policy_version 133849 (0.0010) [2023-12-26 00:39:17,219][123091] Updated weights for policy 0, policy_version 134354 (0.0008) [2023-12-26 00:39:17,273][123091] Updated weights for policy 0, policy_version 134364 (0.0010) [2023-12-26 00:39:18,019][123090] Updated weights for policy 1, policy_version 133859 (0.0009) [2023-12-26 00:39:18,021][123091] Updated weights for policy 0, policy_version 134374 (0.0009) [2023-12-26 00:39:18,077][123090] Updated weights for policy 1, policy_version 133869 (0.0006) [2023-12-26 00:39:18,088][123091] Updated weights for policy 0, policy_version 134384 (0.0009) [2023-12-26 00:39:18,141][123090] Updated weights for policy 1, policy_version 133879 (0.0007) [2023-12-26 00:39:18,145][123091] Updated weights for policy 0, policy_version 134394 (0.0007) [2023-12-26 00:39:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 68681728. Throughput: 0: 8982.5, 1: 9165.9. Samples: 68695272. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:18,785][121949] Avg episode reward: [(0, '5638.585'), (1, '5643.881')] [2023-12-26 00:39:18,906][123090] Updated weights for policy 1, policy_version 133889 (0.0009) [2023-12-26 00:39:18,913][123091] Updated weights for policy 0, policy_version 134404 (0.0007) [2023-12-26 00:39:18,956][123090] Updated weights for policy 1, policy_version 133899 (0.0006) [2023-12-26 00:39:18,983][123091] Updated weights for policy 0, policy_version 134414 (0.0006) [2023-12-26 00:39:19,029][123090] Updated weights for policy 1, policy_version 133909 (0.0006) [2023-12-26 00:39:19,051][123091] Updated weights for policy 0, policy_version 134424 (0.0006) [2023-12-26 00:39:19,093][123090] Updated weights for policy 1, policy_version 133919 (0.0009) [2023-12-26 00:39:19,781][123091] Updated weights for policy 0, policy_version 134434 (0.0007) [2023-12-26 00:39:19,858][123091] Updated weights for policy 0, policy_version 134444 (0.0013) [2023-12-26 00:39:19,935][123091] Updated weights for policy 0, policy_version 134454 (0.0008) [2023-12-26 00:39:19,939][123090] Updated weights for policy 1, policy_version 133929 (0.0009) [2023-12-26 00:39:20,000][123091] Updated weights for policy 0, policy_version 134464 (0.0011) [2023-12-26 00:39:20,005][123090] Updated weights for policy 1, policy_version 133939 (0.0008) [2023-12-26 00:39:20,074][123090] Updated weights for policy 1, policy_version 133949 (0.0008) [2023-12-26 00:39:20,814][123090] Updated weights for policy 1, policy_version 133959 (0.0008) [2023-12-26 00:39:20,820][123091] Updated weights for policy 0, policy_version 134474 (0.0007) [2023-12-26 00:39:20,881][123090] Updated weights for policy 1, policy_version 133969 (0.0008) [2023-12-26 00:39:20,883][123091] Updated weights for policy 0, policy_version 134484 (0.0008) [2023-12-26 00:39:20,948][123090] Updated weights for policy 1, policy_version 133979 (0.0008) [2023-12-26 00:39:20,952][123091] Updated weights for policy 0, policy_version 134494 (0.0006) [2023-12-26 00:39:21,750][123091] Updated weights for policy 0, policy_version 134504 (0.0009) [2023-12-26 00:39:21,770][123090] Updated weights for policy 1, policy_version 133989 (0.0008) [2023-12-26 00:39:21,811][123091] Updated weights for policy 0, policy_version 134514 (0.0006) [2023-12-26 00:39:21,833][123090] Updated weights for policy 1, policy_version 133999 (0.0010) [2023-12-26 00:39:21,871][123091] Updated weights for policy 0, policy_version 134524 (0.0010) [2023-12-26 00:39:21,892][123090] Updated weights for policy 1, policy_version 134009 (0.0010) [2023-12-26 00:39:22,732][123090] Updated weights for policy 1, policy_version 134019 (0.0011) [2023-12-26 00:39:22,734][123091] Updated weights for policy 0, policy_version 134534 (0.0007) [2023-12-26 00:39:22,799][123091] Updated weights for policy 0, policy_version 134544 (0.0006) [2023-12-26 00:39:22,801][123090] Updated weights for policy 1, policy_version 134029 (0.0011) [2023-12-26 00:39:22,860][123091] Updated weights for policy 0, policy_version 134554 (0.0008) [2023-12-26 00:39:22,863][123090] Updated weights for policy 1, policy_version 134039 (0.0007) [2023-12-26 00:39:23,631][123090] Updated weights for policy 1, policy_version 134049 (0.0009) [2023-12-26 00:39:23,634][123091] Updated weights for policy 0, policy_version 134564 (0.0009) [2023-12-26 00:39:23,694][123090] Updated weights for policy 1, policy_version 134059 (0.0005) [2023-12-26 00:39:23,696][123091] Updated weights for policy 0, policy_version 134574 (0.0007) [2023-12-26 00:39:23,751][123091] Updated weights for policy 0, policy_version 134584 (0.0007) [2023-12-26 00:39:23,756][123090] Updated weights for policy 1, policy_version 134069 (0.0008) [2023-12-26 00:39:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 68763648. Throughput: 0: 8946.2, 1: 9136.5. Samples: 68748588. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:23,785][121949] Avg episode reward: [(0, '5740.370'), (1, '5614.628')] [2023-12-26 00:39:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000134592_34455552.pth... [2023-12-26 00:39:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000133536_34185216.pth [2023-12-26 00:39:23,823][123090] Updated weights for policy 1, policy_version 134079 (0.0010) [2023-12-26 00:39:23,826][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000134080_34324480.pth... [2023-12-26 00:39:23,831][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000133024_34054144.pth [2023-12-26 00:39:24,414][123091] Updated weights for policy 0, policy_version 134594 (0.0005) [2023-12-26 00:39:24,464][123091] Updated weights for policy 0, policy_version 134604 (0.0005) [2023-12-26 00:39:24,521][123091] Updated weights for policy 0, policy_version 134614 (0.0006) [2023-12-26 00:39:24,581][123091] Updated weights for policy 0, policy_version 134624 (0.0008) [2023-12-26 00:39:24,593][123090] Updated weights for policy 1, policy_version 134089 (0.0010) [2023-12-26 00:39:24,641][123090] Updated weights for policy 1, policy_version 134099 (0.0010) [2023-12-26 00:39:24,696][123090] Updated weights for policy 1, policy_version 134109 (0.0010) [2023-12-26 00:39:25,296][123091] Updated weights for policy 0, policy_version 134634 (0.0005) [2023-12-26 00:39:25,341][123091] Updated weights for policy 0, policy_version 134644 (0.0005) [2023-12-26 00:39:25,394][123091] Updated weights for policy 0, policy_version 134655 (0.0010) [2023-12-26 00:39:25,485][123090] Updated weights for policy 1, policy_version 134119 (0.0007) [2023-12-26 00:39:25,541][123090] Updated weights for policy 1, policy_version 134129 (0.0005) [2023-12-26 00:39:25,588][123090] Updated weights for policy 1, policy_version 134139 (0.0005) [2023-12-26 00:39:26,297][123091] Updated weights for policy 0, policy_version 134665 (0.0009) [2023-12-26 00:39:26,308][123090] Updated weights for policy 1, policy_version 134149 (0.0005) [2023-12-26 00:39:26,361][123090] Updated weights for policy 1, policy_version 134159 (0.0005) [2023-12-26 00:39:26,362][123091] Updated weights for policy 0, policy_version 134675 (0.0009) [2023-12-26 00:39:26,423][123091] Updated weights for policy 0, policy_version 134685 (0.0009) [2023-12-26 00:39:26,425][123090] Updated weights for policy 1, policy_version 134169 (0.0005) [2023-12-26 00:39:27,138][123091] Updated weights for policy 0, policy_version 134695 (0.0006) [2023-12-26 00:39:27,167][123090] Updated weights for policy 1, policy_version 134179 (0.0006) [2023-12-26 00:39:27,183][123091] Updated weights for policy 0, policy_version 134705 (0.0005) [2023-12-26 00:39:27,221][123090] Updated weights for policy 1, policy_version 134189 (0.0009) [2023-12-26 00:39:27,235][123091] Updated weights for policy 0, policy_version 134715 (0.0005) [2023-12-26 00:39:27,274][123090] Updated weights for policy 1, policy_version 134199 (0.0009) [2023-12-26 00:39:27,948][123091] Updated weights for policy 0, policy_version 134725 (0.0008) [2023-12-26 00:39:27,992][123091] Updated weights for policy 0, policy_version 134735 (0.0010) [2023-12-26 00:39:28,051][123091] Updated weights for policy 0, policy_version 134745 (0.0010) [2023-12-26 00:39:28,096][123090] Updated weights for policy 1, policy_version 134209 (0.0009) [2023-12-26 00:39:28,159][123090] Updated weights for policy 1, policy_version 134219 (0.0005) [2023-12-26 00:39:28,208][123090] Updated weights for policy 1, policy_version 134229 (0.0005) [2023-12-26 00:39:28,260][123090] Updated weights for policy 1, policy_version 134239 (0.0005) [2023-12-26 00:39:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 17855.8). Total num frames: 68861952. Throughput: 0: 8984.9, 1: 9100.6. Samples: 68857772. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:28,785][121949] Avg episode reward: [(0, '5731.514'), (1, '5653.022')] [2023-12-26 00:39:28,873][123091] Updated weights for policy 0, policy_version 134755 (0.0010) [2023-12-26 00:39:28,933][123091] Updated weights for policy 0, policy_version 134765 (0.0011) [2023-12-26 00:39:28,974][123090] Updated weights for policy 1, policy_version 134249 (0.0005) [2023-12-26 00:39:28,993][123091] Updated weights for policy 0, policy_version 134775 (0.0011) [2023-12-26 00:39:29,030][123090] Updated weights for policy 1, policy_version 134259 (0.0005) [2023-12-26 00:39:29,091][123090] Updated weights for policy 1, policy_version 134269 (0.0008) [2023-12-26 00:39:29,735][123091] Updated weights for policy 0, policy_version 134785 (0.0010) [2023-12-26 00:39:29,783][123091] Updated weights for policy 0, policy_version 134795 (0.0010) [2023-12-26 00:39:29,840][123091] Updated weights for policy 0, policy_version 134805 (0.0010) [2023-12-26 00:39:29,894][123091] Updated weights for policy 0, policy_version 134815 (0.0010) [2023-12-26 00:39:29,965][123090] Updated weights for policy 1, policy_version 134279 (0.0008) [2023-12-26 00:39:30,021][123090] Updated weights for policy 1, policy_version 134289 (0.0008) [2023-12-26 00:39:30,077][123090] Updated weights for policy 1, policy_version 134299 (0.0009) [2023-12-26 00:39:30,649][123091] Updated weights for policy 0, policy_version 134825 (0.0006) [2023-12-26 00:39:30,694][123091] Updated weights for policy 0, policy_version 134835 (0.0005) [2023-12-26 00:39:30,751][123091] Updated weights for policy 0, policy_version 134845 (0.0005) [2023-12-26 00:39:30,985][123090] Updated weights for policy 1, policy_version 134309 (0.0009) [2023-12-26 00:39:31,059][123090] Updated weights for policy 1, policy_version 134319 (0.0010) [2023-12-26 00:39:31,125][123090] Updated weights for policy 1, policy_version 134329 (0.0010) [2023-12-26 00:39:31,402][123091] Updated weights for policy 0, policy_version 134855 (0.0009) [2023-12-26 00:39:31,460][123091] Updated weights for policy 0, policy_version 134865 (0.0010) [2023-12-26 00:39:31,522][123091] Updated weights for policy 0, policy_version 134875 (0.0010) [2023-12-26 00:39:32,009][123090] Updated weights for policy 1, policy_version 134339 (0.0009) [2023-12-26 00:39:32,064][123090] Updated weights for policy 1, policy_version 134349 (0.0010) [2023-12-26 00:39:32,118][123090] Updated weights for policy 1, policy_version 134360 (0.0010) [2023-12-26 00:39:32,293][123091] Updated weights for policy 0, policy_version 134885 (0.0010) [2023-12-26 00:39:32,365][123091] Updated weights for policy 0, policy_version 134895 (0.0010) [2023-12-26 00:39:32,426][123091] Updated weights for policy 0, policy_version 134905 (0.0009) [2023-12-26 00:39:32,994][123090] Updated weights for policy 1, policy_version 134370 (0.0009) [2023-12-26 00:39:33,041][123090] Updated weights for policy 1, policy_version 134380 (0.0005) [2023-12-26 00:39:33,093][123090] Updated weights for policy 1, policy_version 134390 (0.0005) [2023-12-26 00:39:33,144][123090] Updated weights for policy 1, policy_version 134400 (0.0005) [2023-12-26 00:39:33,266][123091] Updated weights for policy 0, policy_version 134915 (0.0008) [2023-12-26 00:39:33,318][123091] Updated weights for policy 0, policy_version 134925 (0.0005) [2023-12-26 00:39:33,387][123091] Updated weights for policy 0, policy_version 134935 (0.0005) [2023-12-26 00:39:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 68952064. Throughput: 0: 9033.1, 1: 8926.8. Samples: 68964928. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:33,785][121949] Avg episode reward: [(0, '5734.380'), (1, '5733.324')] [2023-12-26 00:39:33,970][123090] Updated weights for policy 1, policy_version 134410 (0.0010) [2023-12-26 00:39:34,028][123090] Updated weights for policy 1, policy_version 134420 (0.0010) [2023-12-26 00:39:34,047][123091] Updated weights for policy 0, policy_version 134945 (0.0005) [2023-12-26 00:39:34,097][123090] Updated weights for policy 1, policy_version 134430 (0.0010) [2023-12-26 00:39:34,108][123091] Updated weights for policy 0, policy_version 134955 (0.0006) [2023-12-26 00:39:34,175][123091] Updated weights for policy 0, policy_version 134965 (0.0009) [2023-12-26 00:39:34,239][123091] Updated weights for policy 0, policy_version 134975 (0.0009) [2023-12-26 00:39:34,887][123091] Updated weights for policy 0, policy_version 134985 (0.0005) [2023-12-26 00:39:34,918][123090] Updated weights for policy 1, policy_version 134440 (0.0009) [2023-12-26 00:39:34,952][123091] Updated weights for policy 0, policy_version 134995 (0.0005) [2023-12-26 00:39:34,976][123090] Updated weights for policy 1, policy_version 134450 (0.0008) [2023-12-26 00:39:35,011][123091] Updated weights for policy 0, policy_version 135005 (0.0009) [2023-12-26 00:39:35,045][123090] Updated weights for policy 1, policy_version 134460 (0.0007) [2023-12-26 00:39:35,667][123091] Updated weights for policy 0, policy_version 135015 (0.0010) [2023-12-26 00:39:35,714][123091] Updated weights for policy 0, policy_version 135026 (0.0009) [2023-12-26 00:39:35,765][123091] Updated weights for policy 0, policy_version 135036 (0.0008) [2023-12-26 00:39:35,869][123090] Updated weights for policy 1, policy_version 134470 (0.0006) [2023-12-26 00:39:35,919][123090] Updated weights for policy 1, policy_version 134480 (0.0005) [2023-12-26 00:39:35,967][123090] Updated weights for policy 1, policy_version 134490 (0.0005) [2023-12-26 00:39:36,591][123091] Updated weights for policy 0, policy_version 135046 (0.0007) [2023-12-26 00:39:36,661][123091] Updated weights for policy 0, policy_version 135056 (0.0009) [2023-12-26 00:39:36,722][123091] Updated weights for policy 0, policy_version 135066 (0.0008) [2023-12-26 00:39:36,817][123090] Updated weights for policy 1, policy_version 134500 (0.0005) [2023-12-26 00:39:36,877][123090] Updated weights for policy 1, policy_version 134510 (0.0006) [2023-12-26 00:39:36,942][123090] Updated weights for policy 1, policy_version 134520 (0.0006) [2023-12-26 00:39:37,502][123091] Updated weights for policy 0, policy_version 135076 (0.0008) [2023-12-26 00:39:37,574][123091] Updated weights for policy 0, policy_version 135086 (0.0005) [2023-12-26 00:39:37,637][123091] Updated weights for policy 0, policy_version 135096 (0.0005) [2023-12-26 00:39:37,716][123090] Updated weights for policy 1, policy_version 134530 (0.0010) [2023-12-26 00:39:37,781][123090] Updated weights for policy 1, policy_version 134540 (0.0010) [2023-12-26 00:39:37,847][123090] Updated weights for policy 1, policy_version 134550 (0.0009) [2023-12-26 00:39:37,912][123090] Updated weights for policy 1, policy_version 134560 (0.0010) [2023-12-26 00:39:38,349][123091] Updated weights for policy 0, policy_version 135106 (0.0006) [2023-12-26 00:39:38,405][123091] Updated weights for policy 0, policy_version 135116 (0.0009) [2023-12-26 00:39:38,465][123091] Updated weights for policy 0, policy_version 135126 (0.0010) [2023-12-26 00:39:38,529][123091] Updated weights for policy 0, policy_version 135136 (0.0009) [2023-12-26 00:39:38,736][123090] Updated weights for policy 1, policy_version 134570 (0.0010) [2023-12-26 00:39:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 69042176. Throughput: 0: 9086.0, 1: 8894.6. Samples: 69020060. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:38,785][121949] Avg episode reward: [(0, '5811.950'), (1, '5660.803')] [2023-12-26 00:39:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000135136_34594816.pth... [2023-12-26 00:39:38,793][123090] Updated weights for policy 1, policy_version 134580 (0.0010) [2023-12-26 00:39:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000134048_34316288.pth [2023-12-26 00:39:38,794][123007] Saving new best policy, reward=5811.950! [2023-12-26 00:39:38,851][123090] Updated weights for policy 1, policy_version 134590 (0.0009) [2023-12-26 00:39:38,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000134592_34455552.pth... [2023-12-26 00:39:38,862][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000133536_34185216.pth [2023-12-26 00:39:39,379][123091] Updated weights for policy 0, policy_version 135146 (0.0012) [2023-12-26 00:39:39,453][123091] Updated weights for policy 0, policy_version 135156 (0.0008) [2023-12-26 00:39:39,522][123091] Updated weights for policy 0, policy_version 135166 (0.0008) [2023-12-26 00:39:39,627][123090] Updated weights for policy 1, policy_version 134600 (0.0011) [2023-12-26 00:39:39,691][123090] Updated weights for policy 1, policy_version 134610 (0.0011) [2023-12-26 00:39:39,761][123090] Updated weights for policy 1, policy_version 134620 (0.0011) [2023-12-26 00:39:40,339][123091] Updated weights for policy 0, policy_version 135176 (0.0008) [2023-12-26 00:39:40,399][123091] Updated weights for policy 0, policy_version 135186 (0.0008) [2023-12-26 00:39:40,468][123091] Updated weights for policy 0, policy_version 135196 (0.0006) [2023-12-26 00:39:40,573][123090] Updated weights for policy 1, policy_version 134630 (0.0011) [2023-12-26 00:39:40,633][123090] Updated weights for policy 1, policy_version 134640 (0.0010) [2023-12-26 00:39:40,696][123090] Updated weights for policy 1, policy_version 134650 (0.0010) [2023-12-26 00:39:41,240][123091] Updated weights for policy 0, policy_version 135206 (0.0007) [2023-12-26 00:39:41,311][123091] Updated weights for policy 0, policy_version 135216 (0.0009) [2023-12-26 00:39:41,381][123091] Updated weights for policy 0, policy_version 135226 (0.0009) [2023-12-26 00:39:41,537][123090] Updated weights for policy 1, policy_version 134660 (0.0010) [2023-12-26 00:39:41,582][123090] Updated weights for policy 1, policy_version 134670 (0.0008) [2023-12-26 00:39:41,665][123090] Updated weights for policy 1, policy_version 134680 (0.0009) [2023-12-26 00:39:42,161][123091] Updated weights for policy 0, policy_version 135236 (0.0009) [2023-12-26 00:39:42,227][123091] Updated weights for policy 0, policy_version 135246 (0.0011) [2023-12-26 00:39:42,291][123091] Updated weights for policy 0, policy_version 135256 (0.0011) [2023-12-26 00:39:42,503][123090] Updated weights for policy 1, policy_version 134690 (0.0009) [2023-12-26 00:39:42,568][123090] Updated weights for policy 1, policy_version 134700 (0.0008) [2023-12-26 00:39:42,627][123090] Updated weights for policy 1, policy_version 134710 (0.0007) [2023-12-26 00:39:42,699][123090] Updated weights for policy 1, policy_version 134720 (0.0006) [2023-12-26 00:39:43,038][123091] Updated weights for policy 0, policy_version 135266 (0.0010) [2023-12-26 00:39:43,098][123091] Updated weights for policy 0, policy_version 135276 (0.0005) [2023-12-26 00:39:43,161][123091] Updated weights for policy 0, policy_version 135286 (0.0006) [2023-12-26 00:39:43,228][123091] Updated weights for policy 0, policy_version 135296 (0.0005) [2023-12-26 00:39:43,509][123090] Updated weights for policy 1, policy_version 134730 (0.0010) [2023-12-26 00:39:43,562][123090] Updated weights for policy 1, policy_version 134740 (0.0009) [2023-12-26 00:39:43,614][123090] Updated weights for policy 1, policy_version 134750 (0.0010) [2023-12-26 00:39:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 69132288. Throughput: 0: 8968.9, 1: 8871.4. Samples: 69124552. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:43,785][121949] Avg episode reward: [(0, '5798.822'), (1, '5749.404')] [2023-12-26 00:39:43,872][123091] Updated weights for policy 0, policy_version 135306 (0.0005) [2023-12-26 00:39:43,942][123091] Updated weights for policy 0, policy_version 135316 (0.0005) [2023-12-26 00:39:44,012][123091] Updated weights for policy 0, policy_version 135326 (0.0005) [2023-12-26 00:39:44,425][123090] Updated weights for policy 1, policy_version 134760 (0.0006) [2023-12-26 00:39:44,481][123090] Updated weights for policy 1, policy_version 134770 (0.0005) [2023-12-26 00:39:44,534][123090] Updated weights for policy 1, policy_version 134780 (0.0005) [2023-12-26 00:39:44,660][123091] Updated weights for policy 0, policy_version 135336 (0.0008) [2023-12-26 00:39:44,716][123091] Updated weights for policy 0, policy_version 135346 (0.0006) [2023-12-26 00:39:44,774][123091] Updated weights for policy 0, policy_version 135356 (0.0006) [2023-12-26 00:39:45,212][123090] Updated weights for policy 1, policy_version 134790 (0.0005) [2023-12-26 00:39:45,283][123090] Updated weights for policy 1, policy_version 134800 (0.0006) [2023-12-26 00:39:45,359][123090] Updated weights for policy 1, policy_version 134810 (0.0006) [2023-12-26 00:39:45,533][123091] Updated weights for policy 0, policy_version 135366 (0.0008) [2023-12-26 00:39:45,602][123091] Updated weights for policy 0, policy_version 135376 (0.0006) [2023-12-26 00:39:45,667][123091] Updated weights for policy 0, policy_version 135386 (0.0006) [2023-12-26 00:39:46,010][123090] Updated weights for policy 1, policy_version 134820 (0.0006) [2023-12-26 00:39:46,060][123090] Updated weights for policy 1, policy_version 134830 (0.0005) [2023-12-26 00:39:46,126][123090] Updated weights for policy 1, policy_version 134840 (0.0007) [2023-12-26 00:39:46,388][123091] Updated weights for policy 0, policy_version 135396 (0.0007) [2023-12-26 00:39:46,450][123091] Updated weights for policy 0, policy_version 135406 (0.0010) [2023-12-26 00:39:46,511][123091] Updated weights for policy 0, policy_version 135416 (0.0009) [2023-12-26 00:39:46,874][123090] Updated weights for policy 1, policy_version 134850 (0.0006) [2023-12-26 00:39:46,927][123090] Updated weights for policy 1, policy_version 134860 (0.0009) [2023-12-26 00:39:46,984][123090] Updated weights for policy 1, policy_version 134870 (0.0008) [2023-12-26 00:39:47,036][123090] Updated weights for policy 1, policy_version 134880 (0.0009) [2023-12-26 00:39:47,267][123091] Updated weights for policy 0, policy_version 135426 (0.0010) [2023-12-26 00:39:47,314][123091] Updated weights for policy 0, policy_version 135436 (0.0008) [2023-12-26 00:39:47,365][123091] Updated weights for policy 0, policy_version 135446 (0.0005) [2023-12-26 00:39:47,430][123091] Updated weights for policy 0, policy_version 135456 (0.0006) [2023-12-26 00:39:47,803][123090] Updated weights for policy 1, policy_version 134890 (0.0009) [2023-12-26 00:39:47,851][123090] Updated weights for policy 1, policy_version 134900 (0.0009) [2023-12-26 00:39:47,898][123090] Updated weights for policy 1, policy_version 134910 (0.0008) [2023-12-26 00:39:48,198][123091] Updated weights for policy 0, policy_version 135466 (0.0005) [2023-12-26 00:39:48,277][123091] Updated weights for policy 0, policy_version 135476 (0.0006) [2023-12-26 00:39:48,361][123091] Updated weights for policy 0, policy_version 135486 (0.0007) [2023-12-26 00:39:48,675][123090] Updated weights for policy 1, policy_version 134920 (0.0006) [2023-12-26 00:39:48,733][123090] Updated weights for policy 1, policy_version 134930 (0.0005) [2023-12-26 00:39:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 69222400. Throughput: 0: 9074.9, 1: 8933.7. Samples: 69238600. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:48,785][121949] Avg episode reward: [(0, '5778.707'), (1, '5801.218')] [2023-12-26 00:39:48,804][123090] Updated weights for policy 1, policy_version 134940 (0.0007) [2023-12-26 00:39:49,121][123091] Updated weights for policy 0, policy_version 135496 (0.0010) [2023-12-26 00:39:49,185][123091] Updated weights for policy 0, policy_version 135506 (0.0010) [2023-12-26 00:39:49,270][123091] Updated weights for policy 0, policy_version 135516 (0.0010) [2023-12-26 00:39:49,574][123090] Updated weights for policy 1, policy_version 134950 (0.0006) [2023-12-26 00:39:49,635][123090] Updated weights for policy 1, policy_version 134960 (0.0005) [2023-12-26 00:39:49,690][123090] Updated weights for policy 1, policy_version 134970 (0.0006) [2023-12-26 00:39:50,084][123091] Updated weights for policy 0, policy_version 135526 (0.0011) [2023-12-26 00:39:50,147][123091] Updated weights for policy 0, policy_version 135536 (0.0011) [2023-12-26 00:39:50,212][123091] Updated weights for policy 0, policy_version 135546 (0.0011) [2023-12-26 00:39:50,503][123090] Updated weights for policy 1, policy_version 134980 (0.0007) [2023-12-26 00:39:50,556][123090] Updated weights for policy 1, policy_version 134990 (0.0010) [2023-12-26 00:39:50,631][123090] Updated weights for policy 1, policy_version 135000 (0.0011) [2023-12-26 00:39:51,049][123091] Updated weights for policy 0, policy_version 135556 (0.0010) [2023-12-26 00:39:51,115][123091] Updated weights for policy 0, policy_version 135566 (0.0012) [2023-12-26 00:39:51,182][123091] Updated weights for policy 0, policy_version 135576 (0.0009) [2023-12-26 00:39:51,504][123090] Updated weights for policy 1, policy_version 135010 (0.0010) [2023-12-26 00:39:51,555][123090] Updated weights for policy 1, policy_version 135020 (0.0008) [2023-12-26 00:39:51,605][123090] Updated weights for policy 1, policy_version 135030 (0.0008) [2023-12-26 00:39:51,665][123090] Updated weights for policy 1, policy_version 135040 (0.0008) [2023-12-26 00:39:51,891][123091] Updated weights for policy 0, policy_version 135586 (0.0011) [2023-12-26 00:39:51,942][123091] Updated weights for policy 0, policy_version 135596 (0.0008) [2023-12-26 00:39:51,998][123091] Updated weights for policy 0, policy_version 135606 (0.0008) [2023-12-26 00:39:52,062][123091] Updated weights for policy 0, policy_version 135616 (0.0008) [2023-12-26 00:39:52,490][123090] Updated weights for policy 1, policy_version 135050 (0.0010) [2023-12-26 00:39:52,553][123090] Updated weights for policy 1, policy_version 135060 (0.0010) [2023-12-26 00:39:52,616][123090] Updated weights for policy 1, policy_version 135070 (0.0010) [2023-12-26 00:39:52,850][123091] Updated weights for policy 0, policy_version 135626 (0.0011) [2023-12-26 00:39:52,897][123091] Updated weights for policy 0, policy_version 135636 (0.0010) [2023-12-26 00:39:52,948][123091] Updated weights for policy 0, policy_version 135646 (0.0009) [2023-12-26 00:39:53,440][123090] Updated weights for policy 1, policy_version 135080 (0.0010) [2023-12-26 00:39:53,502][123090] Updated weights for policy 1, policy_version 135090 (0.0010) [2023-12-26 00:39:53,565][123090] Updated weights for policy 1, policy_version 135100 (0.0010) [2023-12-26 00:39:53,572][123091] Updated weights for policy 0, policy_version 135656 (0.0005) [2023-12-26 00:39:53,637][123091] Updated weights for policy 0, policy_version 135666 (0.0006) [2023-12-26 00:39:53,697][123091] Updated weights for policy 0, policy_version 135676 (0.0006) [2023-12-26 00:39:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 69320704. Throughput: 0: 9088.7, 1: 8931.3. Samples: 69290288. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:53,785][121949] Avg episode reward: [(0, '5758.624'), (1, '5699.456')] [2023-12-26 00:39:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000135680_34734080.pth... [2023-12-26 00:39:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000135104_34586624.pth... [2023-12-26 00:39:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000134080_34324480.pth [2023-12-26 00:39:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000134592_34455552.pth [2023-12-26 00:39:54,244][123090] Updated weights for policy 1, policy_version 135110 (0.0007) [2023-12-26 00:39:54,304][123090] Updated weights for policy 1, policy_version 135120 (0.0006) [2023-12-26 00:39:54,358][123090] Updated weights for policy 1, policy_version 135130 (0.0010) [2023-12-26 00:39:54,429][123091] Updated weights for policy 0, policy_version 135686 (0.0005) [2023-12-26 00:39:54,496][123091] Updated weights for policy 0, policy_version 135696 (0.0005) [2023-12-26 00:39:54,563][123091] Updated weights for policy 0, policy_version 135706 (0.0005) [2023-12-26 00:39:55,046][123090] Updated weights for policy 1, policy_version 135140 (0.0007) [2023-12-26 00:39:55,094][123090] Updated weights for policy 1, policy_version 135150 (0.0005) [2023-12-26 00:39:55,148][123090] Updated weights for policy 1, policy_version 135160 (0.0008) [2023-12-26 00:39:55,193][123091] Updated weights for policy 0, policy_version 135716 (0.0006) [2023-12-26 00:39:55,247][123091] Updated weights for policy 0, policy_version 135726 (0.0008) [2023-12-26 00:39:55,301][123091] Updated weights for policy 0, policy_version 135736 (0.0009) [2023-12-26 00:39:55,911][123090] Updated weights for policy 1, policy_version 135170 (0.0009) [2023-12-26 00:39:55,979][123090] Updated weights for policy 1, policy_version 135180 (0.0008) [2023-12-26 00:39:56,014][123091] Updated weights for policy 0, policy_version 135746 (0.0009) [2023-12-26 00:39:56,045][123090] Updated weights for policy 1, policy_version 135190 (0.0009) [2023-12-26 00:39:56,066][123091] Updated weights for policy 0, policy_version 135756 (0.0010) [2023-12-26 00:39:56,098][123090] Updated weights for policy 1, policy_version 135200 (0.0006) [2023-12-26 00:39:56,124][123091] Updated weights for policy 0, policy_version 135766 (0.0010) [2023-12-26 00:39:56,182][123091] Updated weights for policy 0, policy_version 135776 (0.0010) [2023-12-26 00:39:56,859][123090] Updated weights for policy 1, policy_version 135210 (0.0005) [2023-12-26 00:39:56,903][123091] Updated weights for policy 0, policy_version 135786 (0.0005) [2023-12-26 00:39:56,913][123090] Updated weights for policy 1, policy_version 135220 (0.0005) [2023-12-26 00:39:56,967][123090] Updated weights for policy 1, policy_version 135230 (0.0006) [2023-12-26 00:39:56,968][123091] Updated weights for policy 0, policy_version 135796 (0.0005) [2023-12-26 00:39:57,031][123091] Updated weights for policy 0, policy_version 135806 (0.0005) [2023-12-26 00:39:57,612][123090] Updated weights for policy 1, policy_version 135240 (0.0009) [2023-12-26 00:39:57,681][123090] Updated weights for policy 1, policy_version 135250 (0.0009) [2023-12-26 00:39:57,742][123090] Updated weights for policy 1, policy_version 135260 (0.0007) [2023-12-26 00:39:57,766][123091] Updated weights for policy 0, policy_version 135816 (0.0007) [2023-12-26 00:39:57,824][123091] Updated weights for policy 0, policy_version 135826 (0.0010) [2023-12-26 00:39:57,881][123091] Updated weights for policy 0, policy_version 135836 (0.0010) [2023-12-26 00:39:58,622][123090] Updated weights for policy 1, policy_version 135270 (0.0008) [2023-12-26 00:39:58,697][123090] Updated weights for policy 1, policy_version 135280 (0.0009) [2023-12-26 00:39:58,705][123091] Updated weights for policy 0, policy_version 135846 (0.0014) [2023-12-26 00:39:58,775][123090] Updated weights for policy 1, policy_version 135290 (0.0008) [2023-12-26 00:39:58,781][123091] Updated weights for policy 0, policy_version 135856 (0.0010) [2023-12-26 00:39:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 69402624. Throughput: 0: 9301.5, 1: 8953.9. Samples: 69405408. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:39:58,785][121949] Avg episode reward: [(0, '5779.391'), (1, '5703.210')] [2023-12-26 00:39:58,847][123091] Updated weights for policy 0, policy_version 135866 (0.0010) [2023-12-26 00:39:59,566][123090] Updated weights for policy 1, policy_version 135300 (0.0006) [2023-12-26 00:39:59,622][123090] Updated weights for policy 1, policy_version 135310 (0.0006) [2023-12-26 00:39:59,651][123091] Updated weights for policy 0, policy_version 135876 (0.0008) [2023-12-26 00:39:59,678][123090] Updated weights for policy 1, policy_version 135320 (0.0007) [2023-12-26 00:39:59,704][123091] Updated weights for policy 0, policy_version 135886 (0.0009) [2023-12-26 00:39:59,767][123091] Updated weights for policy 0, policy_version 135896 (0.0009) [2023-12-26 00:40:00,443][123090] Updated weights for policy 1, policy_version 135330 (0.0010) [2023-12-26 00:40:00,498][123090] Updated weights for policy 1, policy_version 135340 (0.0009) [2023-12-26 00:40:00,548][123090] Updated weights for policy 1, policy_version 135350 (0.0008) [2023-12-26 00:40:00,605][123090] Updated weights for policy 1, policy_version 135360 (0.0010) [2023-12-26 00:40:00,640][123091] Updated weights for policy 0, policy_version 135907 (0.0010) [2023-12-26 00:40:00,693][123091] Updated weights for policy 0, policy_version 135917 (0.0009) [2023-12-26 00:40:00,758][123091] Updated weights for policy 0, policy_version 135928 (0.0009) [2023-12-26 00:40:01,421][123090] Updated weights for policy 1, policy_version 135370 (0.0010) [2023-12-26 00:40:01,486][123090] Updated weights for policy 1, policy_version 135380 (0.0009) [2023-12-26 00:40:01,548][123090] Updated weights for policy 1, policy_version 135390 (0.0008) [2023-12-26 00:40:01,587][123091] Updated weights for policy 0, policy_version 135938 (0.0009) [2023-12-26 00:40:01,649][123091] Updated weights for policy 0, policy_version 135948 (0.0010) [2023-12-26 00:40:01,707][123091] Updated weights for policy 0, policy_version 135958 (0.0010) [2023-12-26 00:40:01,769][123091] Updated weights for policy 0, policy_version 135968 (0.0010) [2023-12-26 00:40:02,345][123090] Updated weights for policy 1, policy_version 135400 (0.0009) [2023-12-26 00:40:02,411][123090] Updated weights for policy 1, policy_version 135410 (0.0009) [2023-12-26 00:40:02,458][123090] Updated weights for policy 1, policy_version 135420 (0.0009) [2023-12-26 00:40:02,571][123091] Updated weights for policy 0, policy_version 135978 (0.0006) [2023-12-26 00:40:02,633][123091] Updated weights for policy 0, policy_version 135988 (0.0005) [2023-12-26 00:40:02,711][123091] Updated weights for policy 0, policy_version 135998 (0.0005) [2023-12-26 00:40:03,184][123090] Updated weights for policy 1, policy_version 135430 (0.0007) [2023-12-26 00:40:03,239][123090] Updated weights for policy 1, policy_version 135440 (0.0005) [2023-12-26 00:40:03,261][123091] Updated weights for policy 0, policy_version 136008 (0.0005) [2023-12-26 00:40:03,294][123090] Updated weights for policy 1, policy_version 135450 (0.0007) [2023-12-26 00:40:03,316][123091] Updated weights for policy 0, policy_version 136018 (0.0005) [2023-12-26 00:40:03,367][123091] Updated weights for policy 0, policy_version 136028 (0.0005) [2023-12-26 00:40:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 69500928. Throughput: 0: 9246.1, 1: 8916.3. Samples: 69512580. Policy #0 lag: (min: 6.0, avg: 15.9, max: 38.0) [2023-12-26 00:40:03,785][121949] Avg episode reward: [(0, '5740.382'), (1, '5804.644')] [2023-12-26 00:40:04,038][123090] Updated weights for policy 1, policy_version 135460 (0.0009) [2023-12-26 00:40:04,102][123090] Updated weights for policy 1, policy_version 135470 (0.0008) [2023-12-26 00:40:04,140][123091] Updated weights for policy 0, policy_version 136038 (0.0008) [2023-12-26 00:40:04,159][123090] Updated weights for policy 1, policy_version 135480 (0.0008) [2023-12-26 00:40:04,199][123091] Updated weights for policy 0, policy_version 136048 (0.0011) [2023-12-26 00:40:04,261][123091] Updated weights for policy 0, policy_version 136058 (0.0010) [2023-12-26 00:40:04,987][123091] Updated weights for policy 0, policy_version 136068 (0.0009) [2023-12-26 00:40:05,038][123091] Updated weights for policy 0, policy_version 136078 (0.0009) [2023-12-26 00:40:05,048][123090] Updated weights for policy 1, policy_version 135490 (0.0008) [2023-12-26 00:40:05,087][123091] Updated weights for policy 0, policy_version 136088 (0.0010) [2023-12-26 00:40:05,094][123090] Updated weights for policy 1, policy_version 135500 (0.0006) [2023-12-26 00:40:05,146][123090] Updated weights for policy 1, policy_version 135510 (0.0006) [2023-12-26 00:40:05,201][123090] Updated weights for policy 1, policy_version 135520 (0.0005) [2023-12-26 00:40:05,822][123090] Updated weights for policy 1, policy_version 135530 (0.0009) [2023-12-26 00:40:05,887][123090] Updated weights for policy 1, policy_version 135540 (0.0009) [2023-12-26 00:40:05,948][123091] Updated weights for policy 0, policy_version 136098 (0.0009) [2023-12-26 00:40:05,951][123090] Updated weights for policy 1, policy_version 135550 (0.0009) [2023-12-26 00:40:06,004][123091] Updated weights for policy 0, policy_version 136108 (0.0006) [2023-12-26 00:40:06,055][123091] Updated weights for policy 0, policy_version 136118 (0.0009) [2023-12-26 00:40:06,127][123091] Updated weights for policy 0, policy_version 136128 (0.0009) [2023-12-26 00:40:06,796][123090] Updated weights for policy 1, policy_version 135560 (0.0009) [2023-12-26 00:40:06,854][123090] Updated weights for policy 1, policy_version 135570 (0.0009) [2023-12-26 00:40:06,922][123090] Updated weights for policy 1, policy_version 135580 (0.0009) [2023-12-26 00:40:06,955][123091] Updated weights for policy 0, policy_version 136138 (0.0010) [2023-12-26 00:40:07,023][123091] Updated weights for policy 0, policy_version 136148 (0.0010) [2023-12-26 00:40:07,085][123091] Updated weights for policy 0, policy_version 136158 (0.0009) [2023-12-26 00:40:07,801][123090] Updated weights for policy 1, policy_version 135590 (0.0008) [2023-12-26 00:40:07,839][123091] Updated weights for policy 0, policy_version 136168 (0.0007) [2023-12-26 00:40:07,863][123090] Updated weights for policy 1, policy_version 135600 (0.0008) [2023-12-26 00:40:07,896][123091] Updated weights for policy 0, policy_version 136178 (0.0009) [2023-12-26 00:40:07,922][123090] Updated weights for policy 1, policy_version 135610 (0.0008) [2023-12-26 00:40:07,952][123091] Updated weights for policy 0, policy_version 136188 (0.0008) [2023-12-26 00:40:08,719][123090] Updated weights for policy 1, policy_version 135620 (0.0010) [2023-12-26 00:40:08,778][123090] Updated weights for policy 1, policy_version 135630 (0.0010) [2023-12-26 00:40:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 69582848. Throughput: 0: 9239.8, 1: 8927.5. Samples: 69566120. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:08,785][121949] Avg episode reward: [(0, '5712.944'), (1, '5651.288')] [2023-12-26 00:40:08,829][123091] Updated weights for policy 0, policy_version 136198 (0.0007) [2023-12-26 00:40:08,839][123090] Updated weights for policy 1, policy_version 135640 (0.0011) [2023-12-26 00:40:08,885][123091] Updated weights for policy 0, policy_version 136208 (0.0006) [2023-12-26 00:40:08,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000135648_34725888.pth... [2023-12-26 00:40:08,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000134592_34455552.pth [2023-12-26 00:40:08,941][123091] Updated weights for policy 0, policy_version 136218 (0.0009) [2023-12-26 00:40:08,980][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000136224_34873344.pth... [2023-12-26 00:40:08,988][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000135136_34594816.pth [2023-12-26 00:40:09,687][123090] Updated weights for policy 1, policy_version 135650 (0.0011) [2023-12-26 00:40:09,742][123090] Updated weights for policy 1, policy_version 135660 (0.0010) [2023-12-26 00:40:09,807][123090] Updated weights for policy 1, policy_version 135670 (0.0011) [2023-12-26 00:40:09,856][123091] Updated weights for policy 0, policy_version 136228 (0.0009) [2023-12-26 00:40:09,881][123090] Updated weights for policy 1, policy_version 135680 (0.0010) [2023-12-26 00:40:09,926][123091] Updated weights for policy 0, policy_version 136238 (0.0009) [2023-12-26 00:40:09,987][123091] Updated weights for policy 0, policy_version 136248 (0.0010) [2023-12-26 00:40:10,745][123090] Updated weights for policy 1, policy_version 135690 (0.0010) [2023-12-26 00:40:10,788][123091] Updated weights for policy 0, policy_version 136258 (0.0009) [2023-12-26 00:40:10,796][123090] Updated weights for policy 1, policy_version 135700 (0.0010) [2023-12-26 00:40:10,848][123091] Updated weights for policy 0, policy_version 136268 (0.0010) [2023-12-26 00:40:10,856][123090] Updated weights for policy 1, policy_version 135710 (0.0010) [2023-12-26 00:40:10,904][123091] Updated weights for policy 0, policy_version 136278 (0.0011) [2023-12-26 00:40:10,960][123091] Updated weights for policy 0, policy_version 136288 (0.0011) [2023-12-26 00:40:11,721][123090] Updated weights for policy 1, policy_version 135720 (0.0011) [2023-12-26 00:40:11,789][123090] Updated weights for policy 1, policy_version 135730 (0.0010) [2023-12-26 00:40:11,793][123091] Updated weights for policy 0, policy_version 136298 (0.0010) [2023-12-26 00:40:11,853][123091] Updated weights for policy 0, policy_version 136308 (0.0011) [2023-12-26 00:40:11,854][123090] Updated weights for policy 1, policy_version 135740 (0.0010) [2023-12-26 00:40:11,910][123091] Updated weights for policy 0, policy_version 136318 (0.0008) [2023-12-26 00:40:12,610][123091] Updated weights for policy 0, policy_version 136328 (0.0007) [2023-12-26 00:40:12,651][123090] Updated weights for policy 1, policy_version 135750 (0.0007) [2023-12-26 00:40:12,674][123091] Updated weights for policy 0, policy_version 136338 (0.0011) [2023-12-26 00:40:12,710][123090] Updated weights for policy 1, policy_version 135760 (0.0006) [2023-12-26 00:40:12,729][123091] Updated weights for policy 0, policy_version 136348 (0.0010) [2023-12-26 00:40:12,773][123090] Updated weights for policy 1, policy_version 135770 (0.0008) [2023-12-26 00:40:13,388][123091] Updated weights for policy 0, policy_version 136358 (0.0007) [2023-12-26 00:40:13,458][123091] Updated weights for policy 0, policy_version 136368 (0.0007) [2023-12-26 00:40:13,517][123091] Updated weights for policy 0, policy_version 136378 (0.0009) [2023-12-26 00:40:13,623][123090] Updated weights for policy 1, policy_version 135780 (0.0009) [2023-12-26 00:40:13,694][123090] Updated weights for policy 1, policy_version 135790 (0.0007) [2023-12-26 00:40:13,764][123090] Updated weights for policy 1, policy_version 135800 (0.0005) [2023-12-26 00:40:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 69672960. Throughput: 0: 9184.9, 1: 8840.9. Samples: 69668932. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:13,784][121949] Avg episode reward: [(0, '5711.696'), (1, '5485.319')] [2023-12-26 00:40:14,241][123091] Updated weights for policy 0, policy_version 136388 (0.0009) [2023-12-26 00:40:14,316][123091] Updated weights for policy 0, policy_version 136398 (0.0009) [2023-12-26 00:40:14,371][123091] Updated weights for policy 0, policy_version 136408 (0.0011) [2023-12-26 00:40:14,486][123090] Updated weights for policy 1, policy_version 135810 (0.0007) [2023-12-26 00:40:14,530][123090] Updated weights for policy 1, policy_version 135820 (0.0010) [2023-12-26 00:40:14,577][123090] Updated weights for policy 1, policy_version 135830 (0.0009) [2023-12-26 00:40:14,633][123090] Updated weights for policy 1, policy_version 135840 (0.0009) [2023-12-26 00:40:15,087][123091] Updated weights for policy 0, policy_version 136418 (0.0010) [2023-12-26 00:40:15,149][123091] Updated weights for policy 0, policy_version 136428 (0.0010) [2023-12-26 00:40:15,217][123091] Updated weights for policy 0, policy_version 136438 (0.0011) [2023-12-26 00:40:15,280][123091] Updated weights for policy 0, policy_version 136448 (0.0011) [2023-12-26 00:40:15,532][123090] Updated weights for policy 1, policy_version 135850 (0.0009) [2023-12-26 00:40:15,596][123090] Updated weights for policy 1, policy_version 135860 (0.0008) [2023-12-26 00:40:15,649][123090] Updated weights for policy 1, policy_version 135870 (0.0006) [2023-12-26 00:40:15,943][123091] Updated weights for policy 0, policy_version 136458 (0.0006) [2023-12-26 00:40:16,007][123091] Updated weights for policy 0, policy_version 136468 (0.0009) [2023-12-26 00:40:16,062][123091] Updated weights for policy 0, policy_version 136478 (0.0011) [2023-12-26 00:40:16,454][123090] Updated weights for policy 1, policy_version 135880 (0.0007) [2023-12-26 00:40:16,526][123090] Updated weights for policy 1, policy_version 135890 (0.0011) [2023-12-26 00:40:16,595][123090] Updated weights for policy 1, policy_version 135900 (0.0010) [2023-12-26 00:40:16,831][123091] Updated weights for policy 0, policy_version 136488 (0.0011) [2023-12-26 00:40:16,879][123091] Updated weights for policy 0, policy_version 136498 (0.0010) [2023-12-26 00:40:16,938][123091] Updated weights for policy 0, policy_version 136508 (0.0010) [2023-12-26 00:40:17,206][123090] Updated weights for policy 1, policy_version 135910 (0.0006) [2023-12-26 00:40:17,255][123090] Updated weights for policy 1, policy_version 135920 (0.0005) [2023-12-26 00:40:17,317][123090] Updated weights for policy 1, policy_version 135930 (0.0005) [2023-12-26 00:40:17,634][123091] Updated weights for policy 0, policy_version 136518 (0.0007) [2023-12-26 00:40:17,686][123091] Updated weights for policy 0, policy_version 136528 (0.0005) [2023-12-26 00:40:17,749][123091] Updated weights for policy 0, policy_version 136538 (0.0008) [2023-12-26 00:40:18,015][123090] Updated weights for policy 1, policy_version 135940 (0.0007) [2023-12-26 00:40:18,069][123090] Updated weights for policy 1, policy_version 135950 (0.0010) [2023-12-26 00:40:18,127][123090] Updated weights for policy 1, policy_version 135960 (0.0009) [2023-12-26 00:40:18,466][123091] Updated weights for policy 0, policy_version 136548 (0.0009) [2023-12-26 00:40:18,535][123091] Updated weights for policy 0, policy_version 136558 (0.0008) [2023-12-26 00:40:18,598][123091] Updated weights for policy 0, policy_version 136568 (0.0011) [2023-12-26 00:40:18,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 69771264. Throughput: 0: 9223.8, 1: 8910.7. Samples: 69780984. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:18,785][121949] Avg episode reward: [(0, '5565.363'), (1, '5425.967')] [2023-12-26 00:40:19,022][123090] Updated weights for policy 1, policy_version 135970 (0.0010) [2023-12-26 00:40:19,079][123090] Updated weights for policy 1, policy_version 135980 (0.0009) [2023-12-26 00:40:19,135][123090] Updated weights for policy 1, policy_version 135990 (0.0010) [2023-12-26 00:40:19,187][123090] Updated weights for policy 1, policy_version 136000 (0.0009) [2023-12-26 00:40:19,355][123091] Updated weights for policy 0, policy_version 136578 (0.0010) [2023-12-26 00:40:19,421][123091] Updated weights for policy 0, policy_version 136588 (0.0008) [2023-12-26 00:40:19,476][123091] Updated weights for policy 0, policy_version 136598 (0.0008) [2023-12-26 00:40:19,546][123091] Updated weights for policy 0, policy_version 136608 (0.0008) [2023-12-26 00:40:20,124][123090] Updated weights for policy 1, policy_version 136010 (0.0008) [2023-12-26 00:40:20,191][123090] Updated weights for policy 1, policy_version 136020 (0.0009) [2023-12-26 00:40:20,262][123090] Updated weights for policy 1, policy_version 136030 (0.0010) [2023-12-26 00:40:20,322][123091] Updated weights for policy 0, policy_version 136618 (0.0006) [2023-12-26 00:40:20,396][123091] Updated weights for policy 0, policy_version 136628 (0.0006) [2023-12-26 00:40:20,468][123091] Updated weights for policy 0, policy_version 136638 (0.0008) [2023-12-26 00:40:21,106][123090] Updated weights for policy 1, policy_version 136040 (0.0010) [2023-12-26 00:40:21,183][123090] Updated weights for policy 1, policy_version 136050 (0.0011) [2023-12-26 00:40:21,268][123090] Updated weights for policy 1, policy_version 136060 (0.0010) [2023-12-26 00:40:21,302][123091] Updated weights for policy 0, policy_version 136648 (0.0009) [2023-12-26 00:40:21,375][123091] Updated weights for policy 0, policy_version 136658 (0.0010) [2023-12-26 00:40:21,441][123091] Updated weights for policy 0, policy_version 136668 (0.0009) [2023-12-26 00:40:22,047][123090] Updated weights for policy 1, policy_version 136070 (0.0007) [2023-12-26 00:40:22,113][123090] Updated weights for policy 1, policy_version 136080 (0.0008) [2023-12-26 00:40:22,179][123090] Updated weights for policy 1, policy_version 136090 (0.0008) [2023-12-26 00:40:22,232][123091] Updated weights for policy 0, policy_version 136678 (0.0009) [2023-12-26 00:40:22,308][123091] Updated weights for policy 0, policy_version 136688 (0.0009) [2023-12-26 00:40:22,378][123091] Updated weights for policy 0, policy_version 136698 (0.0009) [2023-12-26 00:40:22,977][123090] Updated weights for policy 1, policy_version 136100 (0.0008) [2023-12-26 00:40:23,038][123090] Updated weights for policy 1, policy_version 136110 (0.0009) [2023-12-26 00:40:23,092][123090] Updated weights for policy 1, policy_version 136120 (0.0009) [2023-12-26 00:40:23,168][123091] Updated weights for policy 0, policy_version 136708 (0.0007) [2023-12-26 00:40:23,234][123091] Updated weights for policy 0, policy_version 136718 (0.0005) [2023-12-26 00:40:23,298][123091] Updated weights for policy 0, policy_version 136728 (0.0006) [2023-12-26 00:40:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 69853184. Throughput: 0: 9140.0, 1: 8883.4. Samples: 69831116. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:23,785][121949] Avg episode reward: [(0, '5586.476'), (1, '5631.164')] [2023-12-26 00:40:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000136736_35004416.pth... [2023-12-26 00:40:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000136128_34848768.pth... [2023-12-26 00:40:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000135104_34586624.pth [2023-12-26 00:40:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000135680_34734080.pth [2023-12-26 00:40:23,972][123090] Updated weights for policy 1, policy_version 136130 (0.0010) [2023-12-26 00:40:24,038][123090] Updated weights for policy 1, policy_version 136140 (0.0006) [2023-12-26 00:40:24,050][123091] Updated weights for policy 0, policy_version 136738 (0.0006) [2023-12-26 00:40:24,098][123090] Updated weights for policy 1, policy_version 136150 (0.0008) [2023-12-26 00:40:24,110][123091] Updated weights for policy 0, policy_version 136748 (0.0006) [2023-12-26 00:40:24,152][123090] Updated weights for policy 1, policy_version 136160 (0.0010) [2023-12-26 00:40:24,175][123091] Updated weights for policy 0, policy_version 136758 (0.0006) [2023-12-26 00:40:24,247][123091] Updated weights for policy 0, policy_version 136768 (0.0008) [2023-12-26 00:40:24,785][123090] Updated weights for policy 1, policy_version 136170 (0.0005) [2023-12-26 00:40:24,835][123090] Updated weights for policy 1, policy_version 136180 (0.0005) [2023-12-26 00:40:24,891][123090] Updated weights for policy 1, policy_version 136190 (0.0007) [2023-12-26 00:40:25,073][123091] Updated weights for policy 0, policy_version 136778 (0.0006) [2023-12-26 00:40:25,133][123091] Updated weights for policy 0, policy_version 136788 (0.0007) [2023-12-26 00:40:25,189][123091] Updated weights for policy 0, policy_version 136798 (0.0006) [2023-12-26 00:40:25,676][123090] Updated weights for policy 1, policy_version 136200 (0.0009) [2023-12-26 00:40:25,727][123090] Updated weights for policy 1, policy_version 136210 (0.0010) [2023-12-26 00:40:25,771][123090] Updated weights for policy 1, policy_version 136220 (0.0010) [2023-12-26 00:40:25,933][123091] Updated weights for policy 0, policy_version 136808 (0.0009) [2023-12-26 00:40:25,995][123091] Updated weights for policy 0, policy_version 136818 (0.0010) [2023-12-26 00:40:26,048][123091] Updated weights for policy 0, policy_version 136828 (0.0010) [2023-12-26 00:40:26,523][123090] Updated weights for policy 1, policy_version 136230 (0.0009) [2023-12-26 00:40:26,585][123090] Updated weights for policy 1, policy_version 136240 (0.0005) [2023-12-26 00:40:26,636][123090] Updated weights for policy 1, policy_version 136250 (0.0008) [2023-12-26 00:40:26,828][123091] Updated weights for policy 0, policy_version 136838 (0.0009) [2023-12-26 00:40:26,884][123091] Updated weights for policy 0, policy_version 136848 (0.0010) [2023-12-26 00:40:26,932][123091] Updated weights for policy 0, policy_version 136858 (0.0009) [2023-12-26 00:40:27,445][123090] Updated weights for policy 1, policy_version 136260 (0.0007) [2023-12-26 00:40:27,509][123090] Updated weights for policy 1, policy_version 136270 (0.0005) [2023-12-26 00:40:27,555][123090] Updated weights for policy 1, policy_version 136280 (0.0005) [2023-12-26 00:40:27,761][123091] Updated weights for policy 0, policy_version 136868 (0.0008) [2023-12-26 00:40:27,807][123091] Updated weights for policy 0, policy_version 136878 (0.0005) [2023-12-26 00:40:27,865][123091] Updated weights for policy 0, policy_version 136888 (0.0005) [2023-12-26 00:40:28,267][123090] Updated weights for policy 1, policy_version 136290 (0.0010) [2023-12-26 00:40:28,330][123090] Updated weights for policy 1, policy_version 136300 (0.0010) [2023-12-26 00:40:28,392][123090] Updated weights for policy 1, policy_version 136310 (0.0010) [2023-12-26 00:40:28,456][123090] Updated weights for policy 1, policy_version 136320 (0.0011) [2023-12-26 00:40:28,691][123091] Updated weights for policy 0, policy_version 136898 (0.0009) [2023-12-26 00:40:28,751][123091] Updated weights for policy 0, policy_version 136908 (0.0009) [2023-12-26 00:40:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 69943296. Throughput: 0: 9170.4, 1: 8946.2. Samples: 69939800. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:28,785][121949] Avg episode reward: [(0, '5726.895'), (1, '5646.169')] [2023-12-26 00:40:28,817][123091] Updated weights for policy 0, policy_version 136918 (0.0009) [2023-12-26 00:40:28,882][123091] Updated weights for policy 0, policy_version 136928 (0.0009) [2023-12-26 00:40:29,177][123090] Updated weights for policy 1, policy_version 136330 (0.0009) [2023-12-26 00:40:29,237][123090] Updated weights for policy 1, policy_version 136340 (0.0008) [2023-12-26 00:40:29,306][123090] Updated weights for policy 1, policy_version 136350 (0.0008) [2023-12-26 00:40:29,778][123091] Updated weights for policy 0, policy_version 136938 (0.0009) [2023-12-26 00:40:29,833][123091] Updated weights for policy 0, policy_version 136948 (0.0009) [2023-12-26 00:40:29,905][123091] Updated weights for policy 0, policy_version 136958 (0.0010) [2023-12-26 00:40:30,069][123090] Updated weights for policy 1, policy_version 136360 (0.0009) [2023-12-26 00:40:30,128][123090] Updated weights for policy 1, policy_version 136370 (0.0009) [2023-12-26 00:40:30,180][123090] Updated weights for policy 1, policy_version 136380 (0.0009) [2023-12-26 00:40:30,712][123091] Updated weights for policy 0, policy_version 136968 (0.0008) [2023-12-26 00:40:30,759][123091] Updated weights for policy 0, policy_version 136978 (0.0008) [2023-12-26 00:40:30,817][123091] Updated weights for policy 0, policy_version 136988 (0.0009) [2023-12-26 00:40:30,977][123090] Updated weights for policy 1, policy_version 136390 (0.0007) [2023-12-26 00:40:31,031][123090] Updated weights for policy 1, policy_version 136400 (0.0006) [2023-12-26 00:40:31,097][123090] Updated weights for policy 1, policy_version 136410 (0.0007) [2023-12-26 00:40:31,719][123091] Updated weights for policy 0, policy_version 136998 (0.0009) [2023-12-26 00:40:31,786][123091] Updated weights for policy 0, policy_version 137008 (0.0009) [2023-12-26 00:40:31,853][123091] Updated weights for policy 0, policy_version 137018 (0.0009) [2023-12-26 00:40:31,855][123090] Updated weights for policy 1, policy_version 136420 (0.0009) [2023-12-26 00:40:31,911][123090] Updated weights for policy 1, policy_version 136430 (0.0009) [2023-12-26 00:40:31,967][123090] Updated weights for policy 1, policy_version 136440 (0.0010) [2023-12-26 00:40:32,704][123091] Updated weights for policy 0, policy_version 137028 (0.0007) [2023-12-26 00:40:32,769][123091] Updated weights for policy 0, policy_version 137038 (0.0005) [2023-12-26 00:40:32,833][123090] Updated weights for policy 1, policy_version 136450 (0.0010) [2023-12-26 00:40:32,839][123091] Updated weights for policy 0, policy_version 137048 (0.0005) [2023-12-26 00:40:32,885][123090] Updated weights for policy 1, policy_version 136460 (0.0010) [2023-12-26 00:40:32,936][123090] Updated weights for policy 1, policy_version 136470 (0.0009) [2023-12-26 00:40:33,414][123091] Updated weights for policy 0, policy_version 137058 (0.0005) [2023-12-26 00:40:33,464][123091] Updated weights for policy 0, policy_version 137068 (0.0005) [2023-12-26 00:40:33,520][123091] Updated weights for policy 0, policy_version 137078 (0.0005) [2023-12-26 00:40:33,575][123091] Updated weights for policy 0, policy_version 137088 (0.0005) [2023-12-26 00:40:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 70033408. Throughput: 0: 9062.5, 1: 8890.0. Samples: 70046468. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:33,785][121949] Avg episode reward: [(0, '5780.498'), (1, '5645.590')] [2023-12-26 00:40:33,817][123090] Updated weights for policy 1, policy_version 136481 (0.0011) [2023-12-26 00:40:33,883][123090] Updated weights for policy 1, policy_version 136491 (0.0008) [2023-12-26 00:40:33,944][123090] Updated weights for policy 1, policy_version 136501 (0.0010) [2023-12-26 00:40:33,998][123090] Updated weights for policy 1, policy_version 136511 (0.0009) [2023-12-26 00:40:34,296][123091] Updated weights for policy 0, policy_version 137098 (0.0006) [2023-12-26 00:40:34,368][123091] Updated weights for policy 0, policy_version 137108 (0.0006) [2023-12-26 00:40:34,438][123091] Updated weights for policy 0, policy_version 137118 (0.0010) [2023-12-26 00:40:34,847][123090] Updated weights for policy 1, policy_version 136521 (0.0010) [2023-12-26 00:40:34,897][123090] Updated weights for policy 1, policy_version 136531 (0.0010) [2023-12-26 00:40:34,943][123090] Updated weights for policy 1, policy_version 136541 (0.0010) [2023-12-26 00:40:35,221][123091] Updated weights for policy 0, policy_version 137128 (0.0009) [2023-12-26 00:40:35,273][123091] Updated weights for policy 0, policy_version 137138 (0.0008) [2023-12-26 00:40:35,326][123091] Updated weights for policy 0, policy_version 137148 (0.0009) [2023-12-26 00:40:35,764][123090] Updated weights for policy 1, policy_version 136551 (0.0007) [2023-12-26 00:40:35,818][123090] Updated weights for policy 1, policy_version 136561 (0.0008) [2023-12-26 00:40:35,873][123090] Updated weights for policy 1, policy_version 136571 (0.0010) [2023-12-26 00:40:36,210][123091] Updated weights for policy 0, policy_version 137158 (0.0007) [2023-12-26 00:40:36,310][123091] Updated weights for policy 0, policy_version 137168 (0.0006) [2023-12-26 00:40:36,379][123091] Updated weights for policy 0, policy_version 137178 (0.0006) [2023-12-26 00:40:36,700][123090] Updated weights for policy 1, policy_version 136581 (0.0010) [2023-12-26 00:40:36,759][123090] Updated weights for policy 1, policy_version 136591 (0.0010) [2023-12-26 00:40:36,825][123090] Updated weights for policy 1, policy_version 136601 (0.0011) [2023-12-26 00:40:37,009][123091] Updated weights for policy 0, policy_version 137188 (0.0007) [2023-12-26 00:40:37,081][123091] Updated weights for policy 0, policy_version 137198 (0.0006) [2023-12-26 00:40:37,150][123091] Updated weights for policy 0, policy_version 137208 (0.0007) [2023-12-26 00:40:37,667][123090] Updated weights for policy 1, policy_version 136611 (0.0011) [2023-12-26 00:40:37,719][123090] Updated weights for policy 1, policy_version 136621 (0.0010) [2023-12-26 00:40:37,767][123090] Updated weights for policy 1, policy_version 136631 (0.0010) [2023-12-26 00:40:37,868][123091] Updated weights for policy 0, policy_version 137218 (0.0009) [2023-12-26 00:40:37,925][123091] Updated weights for policy 0, policy_version 137228 (0.0005) [2023-12-26 00:40:37,978][123091] Updated weights for policy 0, policy_version 137238 (0.0005) [2023-12-26 00:40:38,037][123091] Updated weights for policy 0, policy_version 137248 (0.0005) [2023-12-26 00:40:38,610][123090] Updated weights for policy 1, policy_version 136641 (0.0009) [2023-12-26 00:40:38,677][123090] Updated weights for policy 1, policy_version 136651 (0.0011) [2023-12-26 00:40:38,737][123091] Updated weights for policy 0, policy_version 137258 (0.0010) [2023-12-26 00:40:38,743][123090] Updated weights for policy 1, policy_version 136661 (0.0005) [2023-12-26 00:40:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 70115328. Throughput: 0: 9086.8, 1: 8887.2. Samples: 70099116. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:38,785][121949] Avg episode reward: [(0, '5782.393'), (1, '5798.303')] [2023-12-26 00:40:38,805][123091] Updated weights for policy 0, policy_version 137268 (0.0008) [2023-12-26 00:40:38,806][123090] Updated weights for policy 1, policy_version 136671 (0.0007) [2023-12-26 00:40:38,812][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000136672_34988032.pth... [2023-12-26 00:40:38,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000135648_34725888.pth [2023-12-26 00:40:38,865][123091] Updated weights for policy 0, policy_version 137278 (0.0009) [2023-12-26 00:40:38,878][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000137280_35143680.pth... [2023-12-26 00:40:38,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000136224_34873344.pth [2023-12-26 00:40:39,637][123090] Updated weights for policy 1, policy_version 136681 (0.0009) [2023-12-26 00:40:39,686][123091] Updated weights for policy 0, policy_version 137288 (0.0009) [2023-12-26 00:40:39,707][123090] Updated weights for policy 1, policy_version 136691 (0.0009) [2023-12-26 00:40:39,751][123091] Updated weights for policy 0, policy_version 137298 (0.0009) [2023-12-26 00:40:39,775][123090] Updated weights for policy 1, policy_version 136701 (0.0010) [2023-12-26 00:40:39,827][123091] Updated weights for policy 0, policy_version 137308 (0.0011) [2023-12-26 00:40:40,577][123091] Updated weights for policy 0, policy_version 137318 (0.0007) [2023-12-26 00:40:40,640][123091] Updated weights for policy 0, policy_version 137328 (0.0006) [2023-12-26 00:40:40,692][123090] Updated weights for policy 1, policy_version 136711 (0.0009) [2023-12-26 00:40:40,704][123091] Updated weights for policy 0, policy_version 137338 (0.0006) [2023-12-26 00:40:40,760][123090] Updated weights for policy 1, policy_version 136721 (0.0010) [2023-12-26 00:40:40,828][123090] Updated weights for policy 1, policy_version 136731 (0.0010) [2023-12-26 00:40:41,449][123091] Updated weights for policy 0, policy_version 137348 (0.0006) [2023-12-26 00:40:41,511][123091] Updated weights for policy 0, policy_version 137358 (0.0009) [2023-12-26 00:40:41,579][123091] Updated weights for policy 0, policy_version 137368 (0.0011) [2023-12-26 00:40:41,744][123090] Updated weights for policy 1, policy_version 136741 (0.0009) [2023-12-26 00:40:41,811][123090] Updated weights for policy 1, policy_version 136751 (0.0008) [2023-12-26 00:40:41,881][123090] Updated weights for policy 1, policy_version 136761 (0.0008) [2023-12-26 00:40:42,373][123091] Updated weights for policy 0, policy_version 137378 (0.0009) [2023-12-26 00:40:42,432][123091] Updated weights for policy 0, policy_version 137388 (0.0008) [2023-12-26 00:40:42,496][123091] Updated weights for policy 0, policy_version 137398 (0.0008) [2023-12-26 00:40:42,563][123091] Updated weights for policy 0, policy_version 137408 (0.0010) [2023-12-26 00:40:42,706][123090] Updated weights for policy 1, policy_version 136771 (0.0009) [2023-12-26 00:40:42,772][123090] Updated weights for policy 1, policy_version 136781 (0.0009) [2023-12-26 00:40:42,837][123090] Updated weights for policy 1, policy_version 136791 (0.0010) [2023-12-26 00:40:43,334][123091] Updated weights for policy 0, policy_version 137418 (0.0009) [2023-12-26 00:40:43,401][123091] Updated weights for policy 0, policy_version 137429 (0.0009) [2023-12-26 00:40:43,460][123091] Updated weights for policy 0, policy_version 137439 (0.0010) [2023-12-26 00:40:43,687][123090] Updated weights for policy 1, policy_version 136801 (0.0010) [2023-12-26 00:40:43,755][123090] Updated weights for policy 1, policy_version 136811 (0.0009) [2023-12-26 00:40:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 70205440. Throughput: 0: 8991.6, 1: 8724.3. Samples: 70202620. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:43,785][121949] Avg episode reward: [(0, '5778.686'), (1, '5795.971')] [2023-12-26 00:40:43,820][123090] Updated weights for policy 1, policy_version 136821 (0.0009) [2023-12-26 00:40:43,871][123090] Updated weights for policy 1, policy_version 136831 (0.0009) [2023-12-26 00:40:44,279][123091] Updated weights for policy 0, policy_version 137449 (0.0009) [2023-12-26 00:40:44,349][123091] Updated weights for policy 0, policy_version 137459 (0.0009) [2023-12-26 00:40:44,424][123091] Updated weights for policy 0, policy_version 137469 (0.0010) [2023-12-26 00:40:44,608][123090] Updated weights for policy 1, policy_version 136841 (0.0010) [2023-12-26 00:40:44,669][123090] Updated weights for policy 1, policy_version 136851 (0.0010) [2023-12-26 00:40:44,732][123090] Updated weights for policy 1, policy_version 136862 (0.0009) [2023-12-26 00:40:45,215][123091] Updated weights for policy 0, policy_version 137479 (0.0010) [2023-12-26 00:40:45,276][123091] Updated weights for policy 0, policy_version 137489 (0.0008) [2023-12-26 00:40:45,333][123091] Updated weights for policy 0, policy_version 137499 (0.0010) [2023-12-26 00:40:45,571][123090] Updated weights for policy 1, policy_version 136872 (0.0006) [2023-12-26 00:40:45,650][123090] Updated weights for policy 1, policy_version 136882 (0.0005) [2023-12-26 00:40:45,725][123090] Updated weights for policy 1, policy_version 136892 (0.0009) [2023-12-26 00:40:46,205][123091] Updated weights for policy 0, policy_version 137509 (0.0010) [2023-12-26 00:40:46,266][123091] Updated weights for policy 0, policy_version 137519 (0.0010) [2023-12-26 00:40:46,328][123091] Updated weights for policy 0, policy_version 137529 (0.0011) [2023-12-26 00:40:46,399][123090] Updated weights for policy 1, policy_version 136902 (0.0009) [2023-12-26 00:40:46,454][123090] Updated weights for policy 1, policy_version 136912 (0.0005) [2023-12-26 00:40:46,502][123090] Updated weights for policy 1, policy_version 136922 (0.0005) [2023-12-26 00:40:47,082][123091] Updated weights for policy 0, policy_version 137539 (0.0007) [2023-12-26 00:40:47,136][123091] Updated weights for policy 0, policy_version 137549 (0.0005) [2023-12-26 00:40:47,191][123091] Updated weights for policy 0, policy_version 137559 (0.0005) [2023-12-26 00:40:47,299][123090] Updated weights for policy 1, policy_version 136932 (0.0007) [2023-12-26 00:40:47,352][123090] Updated weights for policy 1, policy_version 136942 (0.0010) [2023-12-26 00:40:47,405][123090] Updated weights for policy 1, policy_version 136952 (0.0009) [2023-12-26 00:40:47,867][123091] Updated weights for policy 0, policy_version 137569 (0.0005) [2023-12-26 00:40:47,946][123091] Updated weights for policy 0, policy_version 137579 (0.0005) [2023-12-26 00:40:48,016][123091] Updated weights for policy 0, policy_version 137589 (0.0006) [2023-12-26 00:40:48,084][123091] Updated weights for policy 0, policy_version 137599 (0.0005) [2023-12-26 00:40:48,205][123090] Updated weights for policy 1, policy_version 136962 (0.0010) [2023-12-26 00:40:48,272][123090] Updated weights for policy 1, policy_version 136972 (0.0011) [2023-12-26 00:40:48,340][123090] Updated weights for policy 1, policy_version 136982 (0.0009) [2023-12-26 00:40:48,402][123090] Updated weights for policy 1, policy_version 136992 (0.0010) [2023-12-26 00:40:48,698][123091] Updated weights for policy 0, policy_version 137609 (0.0010) [2023-12-26 00:40:48,757][123091] Updated weights for policy 0, policy_version 137619 (0.0011) [2023-12-26 00:40:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 70295552. Throughput: 0: 9023.1, 1: 8703.2. Samples: 70310264. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:48,785][121949] Avg episode reward: [(0, '5698.427'), (1, '5796.740')] [2023-12-26 00:40:48,817][123091] Updated weights for policy 0, policy_version 137629 (0.0010) [2023-12-26 00:40:49,277][123090] Updated weights for policy 1, policy_version 137002 (0.0011) [2023-12-26 00:40:49,342][123090] Updated weights for policy 1, policy_version 137013 (0.0011) [2023-12-26 00:40:49,416][123090] Updated weights for policy 1, policy_version 137023 (0.0011) [2023-12-26 00:40:49,537][123091] Updated weights for policy 0, policy_version 137639 (0.0007) [2023-12-26 00:40:49,588][123091] Updated weights for policy 0, policy_version 137649 (0.0005) [2023-12-26 00:40:49,639][123091] Updated weights for policy 0, policy_version 137659 (0.0005) [2023-12-26 00:40:50,249][123090] Updated weights for policy 1, policy_version 137033 (0.0011) [2023-12-26 00:40:50,312][123090] Updated weights for policy 1, policy_version 137043 (0.0010) [2023-12-26 00:40:50,379][123090] Updated weights for policy 1, policy_version 137053 (0.0010) [2023-12-26 00:40:50,416][123091] Updated weights for policy 0, policy_version 137669 (0.0006) [2023-12-26 00:40:50,491][123091] Updated weights for policy 0, policy_version 137679 (0.0005) [2023-12-26 00:40:50,569][123091] Updated weights for policy 0, policy_version 137689 (0.0006) [2023-12-26 00:40:51,178][123091] Updated weights for policy 0, policy_version 137699 (0.0008) [2023-12-26 00:40:51,216][123090] Updated weights for policy 1, policy_version 137063 (0.0011) [2023-12-26 00:40:51,234][123091] Updated weights for policy 0, policy_version 137709 (0.0011) [2023-12-26 00:40:51,284][123090] Updated weights for policy 1, policy_version 137073 (0.0011) [2023-12-26 00:40:51,291][123091] Updated weights for policy 0, policy_version 137719 (0.0011) [2023-12-26 00:40:51,371][123090] Updated weights for policy 1, policy_version 137083 (0.0010) [2023-12-26 00:40:52,196][123090] Updated weights for policy 1, policy_version 137093 (0.0009) [2023-12-26 00:40:52,216][123091] Updated weights for policy 0, policy_version 137729 (0.0009) [2023-12-26 00:40:52,256][123090] Updated weights for policy 1, policy_version 137103 (0.0010) [2023-12-26 00:40:52,269][123091] Updated weights for policy 0, policy_version 137739 (0.0009) [2023-12-26 00:40:52,309][123090] Updated weights for policy 1, policy_version 137113 (0.0010) [2023-12-26 00:40:52,333][123091] Updated weights for policy 0, policy_version 137749 (0.0007) [2023-12-26 00:40:52,399][123091] Updated weights for policy 0, policy_version 137759 (0.0010) [2023-12-26 00:40:53,078][123090] Updated weights for policy 1, policy_version 137123 (0.0010) [2023-12-26 00:40:53,129][123090] Updated weights for policy 1, policy_version 137133 (0.0010) [2023-12-26 00:40:53,181][123090] Updated weights for policy 1, policy_version 137143 (0.0010) [2023-12-26 00:40:53,213][123091] Updated weights for policy 0, policy_version 137769 (0.0011) [2023-12-26 00:40:53,270][123091] Updated weights for policy 0, policy_version 137779 (0.0010) [2023-12-26 00:40:53,342][123091] Updated weights for policy 0, policy_version 137789 (0.0005) [2023-12-26 00:40:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 70385664. Throughput: 0: 9072.4, 1: 8663.5. Samples: 70364240. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:53,785][121949] Avg episode reward: [(0, '5710.656'), (1, '5507.707')] [2023-12-26 00:40:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000137792_35274752.pth... [2023-12-26 00:40:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000137152_35110912.pth... [2023-12-26 00:40:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000136736_35004416.pth [2023-12-26 00:40:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000136128_34848768.pth [2023-12-26 00:40:54,020][123090] Updated weights for policy 1, policy_version 137153 (0.0010) [2023-12-26 00:40:54,044][123091] Updated weights for policy 0, policy_version 137799 (0.0006) [2023-12-26 00:40:54,082][123090] Updated weights for policy 1, policy_version 137163 (0.0010) [2023-12-26 00:40:54,102][123091] Updated weights for policy 0, policy_version 137809 (0.0005) [2023-12-26 00:40:54,142][123090] Updated weights for policy 1, policy_version 137173 (0.0010) [2023-12-26 00:40:54,162][123091] Updated weights for policy 0, policy_version 137819 (0.0005) [2023-12-26 00:40:54,198][123090] Updated weights for policy 1, policy_version 137183 (0.0010) [2023-12-26 00:40:54,931][123091] Updated weights for policy 0, policy_version 137829 (0.0008) [2023-12-26 00:40:54,984][123091] Updated weights for policy 0, policy_version 137839 (0.0009) [2023-12-26 00:40:55,020][123090] Updated weights for policy 1, policy_version 137193 (0.0007) [2023-12-26 00:40:55,040][123091] Updated weights for policy 0, policy_version 137849 (0.0008) [2023-12-26 00:40:55,072][123090] Updated weights for policy 1, policy_version 137203 (0.0010) [2023-12-26 00:40:55,138][123090] Updated weights for policy 1, policy_version 137213 (0.0010) [2023-12-26 00:40:55,684][123091] Updated weights for policy 0, policy_version 137859 (0.0007) [2023-12-26 00:40:55,749][123091] Updated weights for policy 0, policy_version 137869 (0.0008) [2023-12-26 00:40:55,818][123091] Updated weights for policy 0, policy_version 137879 (0.0008) [2023-12-26 00:40:55,937][123090] Updated weights for policy 1, policy_version 137223 (0.0007) [2023-12-26 00:40:55,985][123090] Updated weights for policy 1, policy_version 137233 (0.0005) [2023-12-26 00:40:56,067][123090] Updated weights for policy 1, policy_version 137243 (0.0005) [2023-12-26 00:40:56,491][123091] Updated weights for policy 0, policy_version 137889 (0.0007) [2023-12-26 00:40:56,542][123091] Updated weights for policy 0, policy_version 137899 (0.0009) [2023-12-26 00:40:56,592][123091] Updated weights for policy 0, policy_version 137909 (0.0009) [2023-12-26 00:40:56,647][123091] Updated weights for policy 0, policy_version 137919 (0.0009) [2023-12-26 00:40:56,694][123090] Updated weights for policy 1, policy_version 137253 (0.0006) [2023-12-26 00:40:56,742][123090] Updated weights for policy 1, policy_version 137263 (0.0005) [2023-12-26 00:40:56,787][123090] Updated weights for policy 1, policy_version 137273 (0.0005) [2023-12-26 00:40:57,360][123090] Updated weights for policy 1, policy_version 137283 (0.0005) [2023-12-26 00:40:57,407][123090] Updated weights for policy 1, policy_version 137293 (0.0005) [2023-12-26 00:40:57,453][123090] Updated weights for policy 1, policy_version 137303 (0.0005) [2023-12-26 00:40:57,586][123091] Updated weights for policy 0, policy_version 137929 (0.0010) [2023-12-26 00:40:57,646][123091] Updated weights for policy 0, policy_version 137941 (0.0010) [2023-12-26 00:40:57,701][123091] Updated weights for policy 0, policy_version 137951 (0.0010) [2023-12-26 00:40:58,182][123090] Updated weights for policy 1, policy_version 137313 (0.0006) [2023-12-26 00:40:58,258][123090] Updated weights for policy 1, policy_version 137323 (0.0010) [2023-12-26 00:40:58,326][123090] Updated weights for policy 1, policy_version 137333 (0.0010) [2023-12-26 00:40:58,399][123090] Updated weights for policy 1, policy_version 137343 (0.0010) [2023-12-26 00:40:58,654][123091] Updated weights for policy 0, policy_version 137961 (0.0011) [2023-12-26 00:40:58,728][123091] Updated weights for policy 0, policy_version 137971 (0.0009) [2023-12-26 00:40:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 70475776. Throughput: 0: 9097.8, 1: 8784.3. Samples: 70473632. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:40:58,785][121949] Avg episode reward: [(0, '5794.272'), (1, '5372.975')] [2023-12-26 00:40:58,794][123091] Updated weights for policy 0, policy_version 137981 (0.0009) [2023-12-26 00:40:59,289][123090] Updated weights for policy 1, policy_version 137353 (0.0007) [2023-12-26 00:40:59,340][123090] Updated weights for policy 1, policy_version 137363 (0.0006) [2023-12-26 00:40:59,408][123090] Updated weights for policy 1, policy_version 137373 (0.0008) [2023-12-26 00:40:59,527][123091] Updated weights for policy 0, policy_version 137991 (0.0007) [2023-12-26 00:40:59,580][123091] Updated weights for policy 0, policy_version 138001 (0.0005) [2023-12-26 00:40:59,639][123091] Updated weights for policy 0, policy_version 138011 (0.0005) [2023-12-26 00:41:00,193][123090] Updated weights for policy 1, policy_version 137383 (0.0009) [2023-12-26 00:41:00,260][123090] Updated weights for policy 1, policy_version 137393 (0.0010) [2023-12-26 00:41:00,290][123091] Updated weights for policy 0, policy_version 138021 (0.0006) [2023-12-26 00:41:00,315][123090] Updated weights for policy 1, policy_version 137403 (0.0010) [2023-12-26 00:41:00,339][123091] Updated weights for policy 0, policy_version 138031 (0.0005) [2023-12-26 00:41:00,387][123091] Updated weights for policy 0, policy_version 138041 (0.0005) [2023-12-26 00:41:01,135][123090] Updated weights for policy 1, policy_version 137413 (0.0009) [2023-12-26 00:41:01,197][123090] Updated weights for policy 1, policy_version 137423 (0.0006) [2023-12-26 00:41:01,198][123091] Updated weights for policy 0, policy_version 138051 (0.0006) [2023-12-26 00:41:01,255][123090] Updated weights for policy 1, policy_version 137433 (0.0006) [2023-12-26 00:41:01,267][123091] Updated weights for policy 0, policy_version 138061 (0.0008) [2023-12-26 00:41:01,335][123091] Updated weights for policy 0, policy_version 138071 (0.0008) [2023-12-26 00:41:01,996][123090] Updated weights for policy 1, policy_version 137443 (0.0008) [2023-12-26 00:41:02,059][123090] Updated weights for policy 1, policy_version 137453 (0.0010) [2023-12-26 00:41:02,117][123091] Updated weights for policy 0, policy_version 138081 (0.0008) [2023-12-26 00:41:02,121][123090] Updated weights for policy 1, policy_version 137463 (0.0010) [2023-12-26 00:41:02,182][123091] Updated weights for policy 0, policy_version 138091 (0.0006) [2023-12-26 00:41:02,239][123091] Updated weights for policy 0, policy_version 138101 (0.0009) [2023-12-26 00:41:02,317][123091] Updated weights for policy 0, policy_version 138111 (0.0006) [2023-12-26 00:41:02,882][123090] Updated weights for policy 1, policy_version 137473 (0.0010) [2023-12-26 00:41:02,931][123090] Updated weights for policy 1, policy_version 137483 (0.0009) [2023-12-26 00:41:02,999][123090] Updated weights for policy 1, policy_version 137493 (0.0008) [2023-12-26 00:41:03,056][123090] Updated weights for policy 1, policy_version 137503 (0.0007) [2023-12-26 00:41:03,076][123091] Updated weights for policy 0, policy_version 138122 (0.0009) [2023-12-26 00:41:03,130][123091] Updated weights for policy 0, policy_version 138132 (0.0010) [2023-12-26 00:41:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 70565888. Throughput: 0: 8990.3, 1: 8781.0. Samples: 70580692. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:41:03,785][121949] Avg episode reward: [(0, '5751.189'), (1, '5505.082')] [2023-12-26 00:41:03,834][123090] Updated weights for policy 1, policy_version 137513 (0.0007) [2023-12-26 00:41:03,901][123090] Updated weights for policy 1, policy_version 137523 (0.0007) [2023-12-26 00:41:03,977][123090] Updated weights for policy 1, policy_version 137533 (0.0009) [2023-12-26 00:41:04,041][123091] Updated weights for policy 0, policy_version 138145 (0.0010) [2023-12-26 00:41:04,108][123091] Updated weights for policy 0, policy_version 138155 (0.0005) [2023-12-26 00:41:04,171][123091] Updated weights for policy 0, policy_version 138165 (0.0006) [2023-12-26 00:41:04,241][123091] Updated weights for policy 0, policy_version 138175 (0.0006) [2023-12-26 00:41:04,697][123090] Updated weights for policy 1, policy_version 137543 (0.0009) [2023-12-26 00:41:04,754][123090] Updated weights for policy 1, policy_version 137553 (0.0007) [2023-12-26 00:41:04,826][123090] Updated weights for policy 1, policy_version 137563 (0.0007) [2023-12-26 00:41:05,004][123091] Updated weights for policy 0, policy_version 138185 (0.0009) [2023-12-26 00:41:05,053][123091] Updated weights for policy 0, policy_version 138195 (0.0009) [2023-12-26 00:41:05,098][123091] Updated weights for policy 0, policy_version 138205 (0.0005) [2023-12-26 00:41:05,629][123090] Updated weights for policy 1, policy_version 137573 (0.0009) [2023-12-26 00:41:05,695][123090] Updated weights for policy 1, policy_version 137583 (0.0010) [2023-12-26 00:41:05,761][123090] Updated weights for policy 1, policy_version 137593 (0.0009) [2023-12-26 00:41:05,929][123091] Updated weights for policy 0, policy_version 138215 (0.0008) [2023-12-26 00:41:05,992][123091] Updated weights for policy 0, policy_version 138226 (0.0009) [2023-12-26 00:41:06,051][123091] Updated weights for policy 0, policy_version 138236 (0.0010) [2023-12-26 00:41:06,620][123090] Updated weights for policy 1, policy_version 137603 (0.0010) [2023-12-26 00:41:06,692][123090] Updated weights for policy 1, policy_version 137613 (0.0010) [2023-12-26 00:41:06,764][123090] Updated weights for policy 1, policy_version 137623 (0.0009) [2023-12-26 00:41:06,783][123091] Updated weights for policy 0, policy_version 138246 (0.0007) [2023-12-26 00:41:06,848][123091] Updated weights for policy 0, policy_version 138256 (0.0005) [2023-12-26 00:41:06,923][123091] Updated weights for policy 0, policy_version 138266 (0.0009) [2023-12-26 00:41:07,596][123090] Updated weights for policy 1, policy_version 137633 (0.0009) [2023-12-26 00:41:07,661][123090] Updated weights for policy 1, policy_version 137643 (0.0009) [2023-12-26 00:41:07,681][123091] Updated weights for policy 0, policy_version 138276 (0.0009) [2023-12-26 00:41:07,715][123090] Updated weights for policy 1, policy_version 137653 (0.0010) [2023-12-26 00:41:07,741][123091] Updated weights for policy 0, policy_version 138286 (0.0006) [2023-12-26 00:41:07,772][123090] Updated weights for policy 1, policy_version 137663 (0.0009) [2023-12-26 00:41:07,817][123091] Updated weights for policy 0, policy_version 138296 (0.0005) [2023-12-26 00:41:08,616][123091] Updated weights for policy 0, policy_version 138306 (0.0009) [2023-12-26 00:41:08,643][123090] Updated weights for policy 1, policy_version 137673 (0.0010) [2023-12-26 00:41:08,672][123091] Updated weights for policy 0, policy_version 138316 (0.0011) [2023-12-26 00:41:08,707][123090] Updated weights for policy 1, policy_version 137683 (0.0010) [2023-12-26 00:41:08,736][123091] Updated weights for policy 0, policy_version 138326 (0.0011) [2023-12-26 00:41:08,774][123090] Updated weights for policy 1, policy_version 137693 (0.0010) [2023-12-26 00:41:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 70647808. Throughput: 0: 9000.5, 1: 8823.9. Samples: 70633208. Policy #0 lag: (min: 9.0, avg: 17.8, max: 41.0) [2023-12-26 00:41:08,785][121949] Avg episode reward: [(0, '5691.393'), (1, '5716.092')] [2023-12-26 00:41:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000137696_35250176.pth... [2023-12-26 00:41:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000136672_34988032.pth [2023-12-26 00:41:08,797][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000138336_35414016.pth... [2023-12-26 00:41:08,799][123091] Updated weights for policy 0, policy_version 138336 (0.0011) [2023-12-26 00:41:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000137280_35143680.pth [2023-12-26 00:41:09,577][123090] Updated weights for policy 1, policy_version 137703 (0.0011) [2023-12-26 00:41:09,632][123091] Updated weights for policy 0, policy_version 138346 (0.0007) [2023-12-26 00:41:09,637][123090] Updated weights for policy 1, policy_version 137713 (0.0010) [2023-12-26 00:41:09,698][123091] Updated weights for policy 0, policy_version 138356 (0.0006) [2023-12-26 00:41:09,704][123090] Updated weights for policy 1, policy_version 137723 (0.0008) [2023-12-26 00:41:09,767][123091] Updated weights for policy 0, policy_version 138366 (0.0008) [2023-12-26 00:41:10,382][123090] Updated weights for policy 1, policy_version 137733 (0.0006) [2023-12-26 00:41:10,451][123090] Updated weights for policy 1, policy_version 137743 (0.0010) [2023-12-26 00:41:10,511][123090] Updated weights for policy 1, policy_version 137753 (0.0009) [2023-12-26 00:41:10,602][123091] Updated weights for policy 0, policy_version 138376 (0.0006) [2023-12-26 00:41:10,663][123091] Updated weights for policy 0, policy_version 138386 (0.0010) [2023-12-26 00:41:10,721][123091] Updated weights for policy 0, policy_version 138396 (0.0009) [2023-12-26 00:41:11,282][123090] Updated weights for policy 1, policy_version 137763 (0.0011) [2023-12-26 00:41:11,351][123090] Updated weights for policy 1, policy_version 137773 (0.0008) [2023-12-26 00:41:11,420][123090] Updated weights for policy 1, policy_version 137783 (0.0008) [2023-12-26 00:41:11,629][123091] Updated weights for policy 0, policy_version 138406 (0.0009) [2023-12-26 00:41:11,695][123091] Updated weights for policy 0, policy_version 138416 (0.0008) [2023-12-26 00:41:11,773][123091] Updated weights for policy 0, policy_version 138426 (0.0007) [2023-12-26 00:41:12,310][123090] Updated weights for policy 1, policy_version 137793 (0.0008) [2023-12-26 00:41:12,386][123090] Updated weights for policy 1, policy_version 137803 (0.0010) [2023-12-26 00:41:12,449][123090] Updated weights for policy 1, policy_version 137813 (0.0010) [2023-12-26 00:41:12,511][123090] Updated weights for policy 1, policy_version 137823 (0.0010) [2023-12-26 00:41:12,561][123091] Updated weights for policy 0, policy_version 138436 (0.0007) [2023-12-26 00:41:12,621][123091] Updated weights for policy 0, policy_version 138446 (0.0006) [2023-12-26 00:41:12,676][123091] Updated weights for policy 0, policy_version 138456 (0.0006) [2023-12-26 00:41:13,350][123090] Updated weights for policy 1, policy_version 137833 (0.0009) [2023-12-26 00:41:13,420][123090] Updated weights for policy 1, policy_version 137843 (0.0005) [2023-12-26 00:41:13,478][123091] Updated weights for policy 0, policy_version 138466 (0.0009) [2023-12-26 00:41:13,480][123090] Updated weights for policy 1, policy_version 137853 (0.0005) [2023-12-26 00:41:13,545][123091] Updated weights for policy 0, policy_version 138476 (0.0010) [2023-12-26 00:41:13,618][123091] Updated weights for policy 0, policy_version 138486 (0.0010) [2023-12-26 00:41:13,688][123091] Updated weights for policy 0, policy_version 138496 (0.0009) [2023-12-26 00:41:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 70746112. Throughput: 0: 8963.7, 1: 8718.6. Samples: 70735504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:13,785][121949] Avg episode reward: [(0, '5710.271'), (1, '5703.845')] [2023-12-26 00:41:14,194][123090] Updated weights for policy 1, policy_version 137863 (0.0005) [2023-12-26 00:41:14,255][123090] Updated weights for policy 1, policy_version 137873 (0.0007) [2023-12-26 00:41:14,302][123090] Updated weights for policy 1, policy_version 137883 (0.0010) [2023-12-26 00:41:14,561][123091] Updated weights for policy 0, policy_version 138506 (0.0009) [2023-12-26 00:41:14,610][123091] Updated weights for policy 0, policy_version 138516 (0.0009) [2023-12-26 00:41:14,666][123091] Updated weights for policy 0, policy_version 138526 (0.0009) [2023-12-26 00:41:15,024][123090] Updated weights for policy 1, policy_version 137893 (0.0008) [2023-12-26 00:41:15,085][123090] Updated weights for policy 1, policy_version 137903 (0.0005) [2023-12-26 00:41:15,146][123090] Updated weights for policy 1, policy_version 137913 (0.0006) [2023-12-26 00:41:15,618][123091] Updated weights for policy 0, policy_version 138536 (0.0008) [2023-12-26 00:41:15,696][123091] Updated weights for policy 0, policy_version 138546 (0.0009) [2023-12-26 00:41:15,756][123091] Updated weights for policy 0, policy_version 138556 (0.0011) [2023-12-26 00:41:15,842][123090] Updated weights for policy 1, policy_version 137923 (0.0006) [2023-12-26 00:41:15,900][123090] Updated weights for policy 1, policy_version 137933 (0.0005) [2023-12-26 00:41:15,952][123090] Updated weights for policy 1, policy_version 137943 (0.0005) [2023-12-26 00:41:16,537][123091] Updated weights for policy 0, policy_version 138566 (0.0010) [2023-12-26 00:41:16,588][123091] Updated weights for policy 0, policy_version 138576 (0.0010) [2023-12-26 00:41:16,622][123090] Updated weights for policy 1, policy_version 137953 (0.0008) [2023-12-26 00:41:16,642][123091] Updated weights for policy 0, policy_version 138586 (0.0006) [2023-12-26 00:41:16,681][123090] Updated weights for policy 1, policy_version 137963 (0.0010) [2023-12-26 00:41:16,728][123090] Updated weights for policy 1, policy_version 137973 (0.0005) [2023-12-26 00:41:16,784][123090] Updated weights for policy 1, policy_version 137983 (0.0005) [2023-12-26 00:41:17,418][123090] Updated weights for policy 1, policy_version 137993 (0.0008) [2023-12-26 00:41:17,483][123090] Updated weights for policy 1, policy_version 138003 (0.0007) [2023-12-26 00:41:17,519][123091] Updated weights for policy 0, policy_version 138596 (0.0006) [2023-12-26 00:41:17,538][123090] Updated weights for policy 1, policy_version 138013 (0.0010) [2023-12-26 00:41:17,567][123091] Updated weights for policy 0, policy_version 138606 (0.0007) [2023-12-26 00:41:17,627][123091] Updated weights for policy 0, policy_version 138616 (0.0009) [2023-12-26 00:41:18,295][123090] Updated weights for policy 1, policy_version 138023 (0.0007) [2023-12-26 00:41:18,367][123090] Updated weights for policy 1, policy_version 138033 (0.0006) [2023-12-26 00:41:18,435][123090] Updated weights for policy 1, policy_version 138043 (0.0008) [2023-12-26 00:41:18,512][123091] Updated weights for policy 0, policy_version 138626 (0.0009) [2023-12-26 00:41:18,564][123091] Updated weights for policy 0, policy_version 138636 (0.0008) [2023-12-26 00:41:18,620][123091] Updated weights for policy 0, policy_version 138646 (0.0009) [2023-12-26 00:41:18,686][123091] Updated weights for policy 0, policy_version 138656 (0.0008) [2023-12-26 00:41:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 70836224. Throughput: 0: 8886.9, 1: 8835.2. Samples: 70843960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:18,784][121949] Avg episode reward: [(0, '5721.335'), (1, '5693.403')] [2023-12-26 00:41:19,193][123090] Updated weights for policy 1, policy_version 138053 (0.0010) [2023-12-26 00:41:19,265][123090] Updated weights for policy 1, policy_version 138063 (0.0011) [2023-12-26 00:41:19,325][123090] Updated weights for policy 1, policy_version 138073 (0.0011) [2023-12-26 00:41:19,546][123091] Updated weights for policy 0, policy_version 138666 (0.0009) [2023-12-26 00:41:19,599][123091] Updated weights for policy 0, policy_version 138676 (0.0009) [2023-12-26 00:41:19,667][123091] Updated weights for policy 0, policy_version 138686 (0.0009) [2023-12-26 00:41:20,204][123090] Updated weights for policy 1, policy_version 138083 (0.0010) [2023-12-26 00:41:20,253][123090] Updated weights for policy 1, policy_version 138093 (0.0011) [2023-12-26 00:41:20,305][123090] Updated weights for policy 1, policy_version 138103 (0.0010) [2023-12-26 00:41:20,534][123091] Updated weights for policy 0, policy_version 138696 (0.0010) [2023-12-26 00:41:20,607][123091] Updated weights for policy 0, policy_version 138706 (0.0010) [2023-12-26 00:41:20,675][123091] Updated weights for policy 0, policy_version 138716 (0.0011) [2023-12-26 00:41:21,047][123090] Updated weights for policy 1, policy_version 138113 (0.0008) [2023-12-26 00:41:21,107][123090] Updated weights for policy 1, policy_version 138123 (0.0008) [2023-12-26 00:41:21,170][123090] Updated weights for policy 1, policy_version 138133 (0.0011) [2023-12-26 00:41:21,226][123090] Updated weights for policy 1, policy_version 138143 (0.0011) [2023-12-26 00:41:21,557][123091] Updated weights for policy 0, policy_version 138726 (0.0011) [2023-12-26 00:41:21,610][123091] Updated weights for policy 0, policy_version 138736 (0.0011) [2023-12-26 00:41:21,676][123091] Updated weights for policy 0, policy_version 138746 (0.0010) [2023-12-26 00:41:22,019][123090] Updated weights for policy 1, policy_version 138153 (0.0007) [2023-12-26 00:41:22,095][123090] Updated weights for policy 1, policy_version 138163 (0.0006) [2023-12-26 00:41:22,164][123090] Updated weights for policy 1, policy_version 138173 (0.0007) [2023-12-26 00:41:22,563][123091] Updated weights for policy 0, policy_version 138756 (0.0011) [2023-12-26 00:41:22,611][123091] Updated weights for policy 0, policy_version 138766 (0.0010) [2023-12-26 00:41:22,676][123091] Updated weights for policy 0, policy_version 138776 (0.0010) [2023-12-26 00:41:22,946][123090] Updated weights for policy 1, policy_version 138183 (0.0009) [2023-12-26 00:41:23,011][123090] Updated weights for policy 1, policy_version 138193 (0.0011) [2023-12-26 00:41:23,076][123090] Updated weights for policy 1, policy_version 138203 (0.0010) [2023-12-26 00:41:23,537][123091] Updated weights for policy 0, policy_version 138786 (0.0011) [2023-12-26 00:41:23,596][123091] Updated weights for policy 0, policy_version 138796 (0.0011) [2023-12-26 00:41:23,659][123091] Updated weights for policy 0, policy_version 138806 (0.0011) [2023-12-26 00:41:23,710][123091] Updated weights for policy 0, policy_version 138816 (0.0010) [2023-12-26 00:41:23,780][123090] Updated weights for policy 1, policy_version 138213 (0.0010) [2023-12-26 00:41:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 70918144. Throughput: 0: 8836.6, 1: 8850.0. Samples: 70895012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:23,785][121949] Avg episode reward: [(0, '5766.902'), (1, '5673.669')] [2023-12-26 00:41:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000138816_35536896.pth... [2023-12-26 00:41:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000137792_35274752.pth [2023-12-26 00:41:23,843][123090] Updated weights for policy 1, policy_version 138223 (0.0010) [2023-12-26 00:41:23,902][123090] Updated weights for policy 1, policy_version 138233 (0.0010) [2023-12-26 00:41:23,945][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000138240_35389440.pth... [2023-12-26 00:41:23,949][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000137152_35110912.pth [2023-12-26 00:41:24,563][123091] Updated weights for policy 0, policy_version 138826 (0.0011) [2023-12-26 00:41:24,626][123091] Updated weights for policy 0, policy_version 138836 (0.0010) [2023-12-26 00:41:24,627][123090] Updated weights for policy 1, policy_version 138243 (0.0009) [2023-12-26 00:41:24,679][123090] Updated weights for policy 1, policy_version 138253 (0.0006) [2023-12-26 00:41:24,689][123091] Updated weights for policy 0, policy_version 138846 (0.0010) [2023-12-26 00:41:24,748][123090] Updated weights for policy 1, policy_version 138263 (0.0006) [2023-12-26 00:41:25,491][123090] Updated weights for policy 1, policy_version 138273 (0.0010) [2023-12-26 00:41:25,516][123091] Updated weights for policy 0, policy_version 138856 (0.0011) [2023-12-26 00:41:25,553][123090] Updated weights for policy 1, policy_version 138283 (0.0010) [2023-12-26 00:41:25,574][123091] Updated weights for policy 0, policy_version 138866 (0.0010) [2023-12-26 00:41:25,620][123090] Updated weights for policy 1, policy_version 138293 (0.0011) [2023-12-26 00:41:25,634][123091] Updated weights for policy 0, policy_version 138876 (0.0011) [2023-12-26 00:41:25,678][123090] Updated weights for policy 1, policy_version 138303 (0.0010) [2023-12-26 00:41:26,357][123091] Updated weights for policy 0, policy_version 138886 (0.0007) [2023-12-26 00:41:26,385][123090] Updated weights for policy 1, policy_version 138313 (0.0010) [2023-12-26 00:41:26,408][123091] Updated weights for policy 0, policy_version 138896 (0.0010) [2023-12-26 00:41:26,444][123090] Updated weights for policy 1, policy_version 138323 (0.0010) [2023-12-26 00:41:26,456][123091] Updated weights for policy 0, policy_version 138906 (0.0010) [2023-12-26 00:41:26,502][123090] Updated weights for policy 1, policy_version 138333 (0.0010) [2023-12-26 00:41:27,273][123091] Updated weights for policy 0, policy_version 138916 (0.0009) [2023-12-26 00:41:27,304][123090] Updated weights for policy 1, policy_version 138343 (0.0010) [2023-12-26 00:41:27,335][123091] Updated weights for policy 0, policy_version 138926 (0.0010) [2023-12-26 00:41:27,357][123090] Updated weights for policy 1, policy_version 138353 (0.0010) [2023-12-26 00:41:27,397][123091] Updated weights for policy 0, policy_version 138936 (0.0010) [2023-12-26 00:41:27,420][123090] Updated weights for policy 1, policy_version 138363 (0.0010) [2023-12-26 00:41:28,061][123091] Updated weights for policy 0, policy_version 138946 (0.0010) [2023-12-26 00:41:28,111][123090] Updated weights for policy 1, policy_version 138373 (0.0008) [2023-12-26 00:41:28,121][123091] Updated weights for policy 0, policy_version 138956 (0.0007) [2023-12-26 00:41:28,157][123090] Updated weights for policy 1, policy_version 138383 (0.0005) [2023-12-26 00:41:28,173][123091] Updated weights for policy 0, policy_version 138966 (0.0009) [2023-12-26 00:41:28,203][123090] Updated weights for policy 1, policy_version 138393 (0.0005) [2023-12-26 00:41:28,221][123091] Updated weights for policy 0, policy_version 138976 (0.0008) [2023-12-26 00:41:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 71008256. Throughput: 0: 8779.0, 1: 8994.2. Samples: 71002416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:28,785][121949] Avg episode reward: [(0, '5734.163'), (1, '5664.331')] [2023-12-26 00:41:28,915][123090] Updated weights for policy 1, policy_version 138403 (0.0006) [2023-12-26 00:41:28,965][123090] Updated weights for policy 1, policy_version 138413 (0.0009) [2023-12-26 00:41:29,026][123090] Updated weights for policy 1, policy_version 138423 (0.0009) [2023-12-26 00:41:29,091][123091] Updated weights for policy 0, policy_version 138986 (0.0006) [2023-12-26 00:41:29,153][123091] Updated weights for policy 0, policy_version 138996 (0.0005) [2023-12-26 00:41:29,226][123091] Updated weights for policy 0, policy_version 139006 (0.0007) [2023-12-26 00:41:29,797][123090] Updated weights for policy 1, policy_version 138433 (0.0008) [2023-12-26 00:41:29,865][123090] Updated weights for policy 1, policy_version 138443 (0.0008) [2023-12-26 00:41:29,935][123090] Updated weights for policy 1, policy_version 138453 (0.0006) [2023-12-26 00:41:29,957][123091] Updated weights for policy 0, policy_version 139016 (0.0007) [2023-12-26 00:41:29,991][123090] Updated weights for policy 1, policy_version 138463 (0.0008) [2023-12-26 00:41:30,018][123091] Updated weights for policy 0, policy_version 139026 (0.0008) [2023-12-26 00:41:30,065][123091] Updated weights for policy 0, policy_version 139036 (0.0005) [2023-12-26 00:41:30,715][123091] Updated weights for policy 0, policy_version 139046 (0.0006) [2023-12-26 00:41:30,788][123091] Updated weights for policy 0, policy_version 139056 (0.0005) [2023-12-26 00:41:30,838][123091] Updated weights for policy 0, policy_version 139066 (0.0005) [2023-12-26 00:41:30,838][123090] Updated weights for policy 1, policy_version 138473 (0.0009) [2023-12-26 00:41:30,894][123090] Updated weights for policy 1, policy_version 138483 (0.0009) [2023-12-26 00:41:30,944][123090] Updated weights for policy 1, policy_version 138493 (0.0009) [2023-12-26 00:41:31,487][123091] Updated weights for policy 0, policy_version 139076 (0.0005) [2023-12-26 00:41:31,538][123091] Updated weights for policy 0, policy_version 139086 (0.0007) [2023-12-26 00:41:31,597][123091] Updated weights for policy 0, policy_version 139096 (0.0006) [2023-12-26 00:41:31,849][123090] Updated weights for policy 1, policy_version 138503 (0.0009) [2023-12-26 00:41:31,905][123090] Updated weights for policy 1, policy_version 138513 (0.0009) [2023-12-26 00:41:31,964][123090] Updated weights for policy 1, policy_version 138523 (0.0009) [2023-12-26 00:41:32,428][123091] Updated weights for policy 0, policy_version 139106 (0.0008) [2023-12-26 00:41:32,484][123091] Updated weights for policy 0, policy_version 139116 (0.0009) [2023-12-26 00:41:32,533][123091] Updated weights for policy 0, policy_version 139126 (0.0005) [2023-12-26 00:41:32,580][123091] Updated weights for policy 0, policy_version 139136 (0.0006) [2023-12-26 00:41:32,736][123090] Updated weights for policy 1, policy_version 138533 (0.0006) [2023-12-26 00:41:32,782][123090] Updated weights for policy 1, policy_version 138543 (0.0005) [2023-12-26 00:41:32,831][123090] Updated weights for policy 1, policy_version 138553 (0.0005) [2023-12-26 00:41:33,238][123091] Updated weights for policy 0, policy_version 139146 (0.0005) [2023-12-26 00:41:33,287][123091] Updated weights for policy 0, policy_version 139156 (0.0005) [2023-12-26 00:41:33,335][123091] Updated weights for policy 0, policy_version 139166 (0.0005) [2023-12-26 00:41:33,537][123090] Updated weights for policy 1, policy_version 138563 (0.0006) [2023-12-26 00:41:33,591][123090] Updated weights for policy 1, policy_version 138573 (0.0005) [2023-12-26 00:41:33,634][123090] Updated weights for policy 1, policy_version 138583 (0.0005) [2023-12-26 00:41:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 71106560. Throughput: 0: 8852.0, 1: 9041.8. Samples: 71115488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:33,785][121949] Avg episode reward: [(0, '5714.084'), (1, '5695.547')] [2023-12-26 00:41:33,983][123091] Updated weights for policy 0, policy_version 139176 (0.0005) [2023-12-26 00:41:34,029][123091] Updated weights for policy 0, policy_version 139186 (0.0005) [2023-12-26 00:41:34,074][123091] Updated weights for policy 0, policy_version 139196 (0.0005) [2023-12-26 00:41:34,384][123090] Updated weights for policy 1, policy_version 138593 (0.0006) [2023-12-26 00:41:34,447][123090] Updated weights for policy 1, policy_version 138603 (0.0009) [2023-12-26 00:41:34,505][123090] Updated weights for policy 1, policy_version 138613 (0.0010) [2023-12-26 00:41:34,558][123090] Updated weights for policy 1, policy_version 138623 (0.0009) [2023-12-26 00:41:34,831][123091] Updated weights for policy 0, policy_version 139206 (0.0005) [2023-12-26 00:41:34,893][123091] Updated weights for policy 0, policy_version 139216 (0.0005) [2023-12-26 00:41:34,940][123091] Updated weights for policy 0, policy_version 139226 (0.0005) [2023-12-26 00:41:35,319][123090] Updated weights for policy 1, policy_version 138633 (0.0006) [2023-12-26 00:41:35,369][123090] Updated weights for policy 1, policy_version 138643 (0.0005) [2023-12-26 00:41:35,443][123090] Updated weights for policy 1, policy_version 138653 (0.0005) [2023-12-26 00:41:35,631][123091] Updated weights for policy 0, policy_version 139236 (0.0006) [2023-12-26 00:41:35,691][123091] Updated weights for policy 0, policy_version 139246 (0.0005) [2023-12-26 00:41:35,746][123091] Updated weights for policy 0, policy_version 139256 (0.0005) [2023-12-26 00:41:36,140][123090] Updated weights for policy 1, policy_version 138663 (0.0007) [2023-12-26 00:41:36,200][123090] Updated weights for policy 1, policy_version 138673 (0.0009) [2023-12-26 00:41:36,254][123090] Updated weights for policy 1, policy_version 138683 (0.0008) [2023-12-26 00:41:36,484][123091] Updated weights for policy 0, policy_version 139266 (0.0006) [2023-12-26 00:41:36,552][123091] Updated weights for policy 0, policy_version 139276 (0.0008) [2023-12-26 00:41:36,600][123091] Updated weights for policy 0, policy_version 139286 (0.0008) [2023-12-26 00:41:36,645][123091] Updated weights for policy 0, policy_version 139296 (0.0008) [2023-12-26 00:41:37,109][123090] Updated weights for policy 1, policy_version 138693 (0.0009) [2023-12-26 00:41:37,172][123090] Updated weights for policy 1, policy_version 138703 (0.0011) [2023-12-26 00:41:37,232][123090] Updated weights for policy 1, policy_version 138713 (0.0011) [2023-12-26 00:41:37,482][123091] Updated weights for policy 0, policy_version 139306 (0.0011) [2023-12-26 00:41:37,542][123091] Updated weights for policy 0, policy_version 139316 (0.0011) [2023-12-26 00:41:37,586][123091] Updated weights for policy 0, policy_version 139326 (0.0010) [2023-12-26 00:41:38,044][123090] Updated weights for policy 1, policy_version 138723 (0.0009) [2023-12-26 00:41:38,102][123090] Updated weights for policy 1, policy_version 138733 (0.0006) [2023-12-26 00:41:38,159][123090] Updated weights for policy 1, policy_version 138743 (0.0006) [2023-12-26 00:41:38,374][123091] Updated weights for policy 0, policy_version 139336 (0.0008) [2023-12-26 00:41:38,440][123091] Updated weights for policy 0, policy_version 139346 (0.0006) [2023-12-26 00:41:38,517][123091] Updated weights for policy 0, policy_version 139356 (0.0006) [2023-12-26 00:41:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 71196672. Throughput: 0: 8867.9, 1: 9110.7. Samples: 71173272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:38,785][121949] Avg episode reward: [(0, '5690.269'), (1, '5724.951')] [2023-12-26 00:41:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000139360_35676160.pth... [2023-12-26 00:41:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000138752_35520512.pth... [2023-12-26 00:41:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000138336_35414016.pth [2023-12-26 00:41:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000137696_35250176.pth [2023-12-26 00:41:38,976][123090] Updated weights for policy 1, policy_version 138753 (0.0006) [2023-12-26 00:41:39,031][123090] Updated weights for policy 1, policy_version 138763 (0.0010) [2023-12-26 00:41:39,083][123090] Updated weights for policy 1, policy_version 138773 (0.0010) [2023-12-26 00:41:39,145][123090] Updated weights for policy 1, policy_version 138783 (0.0010) [2023-12-26 00:41:39,173][123091] Updated weights for policy 0, policy_version 139366 (0.0007) [2023-12-26 00:41:39,246][123091] Updated weights for policy 0, policy_version 139376 (0.0008) [2023-12-26 00:41:39,317][123091] Updated weights for policy 0, policy_version 139386 (0.0008) [2023-12-26 00:41:39,954][123090] Updated weights for policy 1, policy_version 138793 (0.0008) [2023-12-26 00:41:40,010][123090] Updated weights for policy 1, policy_version 138803 (0.0008) [2023-12-26 00:41:40,062][123090] Updated weights for policy 1, policy_version 138813 (0.0008) [2023-12-26 00:41:40,113][123091] Updated weights for policy 0, policy_version 139396 (0.0008) [2023-12-26 00:41:40,175][123091] Updated weights for policy 0, policy_version 139406 (0.0010) [2023-12-26 00:41:40,244][123091] Updated weights for policy 0, policy_version 139416 (0.0009) [2023-12-26 00:41:40,882][123090] Updated weights for policy 1, policy_version 138823 (0.0009) [2023-12-26 00:41:40,944][123090] Updated weights for policy 1, policy_version 138833 (0.0009) [2023-12-26 00:41:41,004][123090] Updated weights for policy 1, policy_version 138843 (0.0009) [2023-12-26 00:41:41,091][123091] Updated weights for policy 0, policy_version 139426 (0.0010) [2023-12-26 00:41:41,156][123091] Updated weights for policy 0, policy_version 139436 (0.0010) [2023-12-26 00:41:41,219][123091] Updated weights for policy 0, policy_version 139446 (0.0009) [2023-12-26 00:41:41,293][123091] Updated weights for policy 0, policy_version 139456 (0.0010) [2023-12-26 00:41:41,901][123090] Updated weights for policy 1, policy_version 138853 (0.0010) [2023-12-26 00:41:41,969][123090] Updated weights for policy 1, policy_version 138863 (0.0009) [2023-12-26 00:41:42,032][123090] Updated weights for policy 1, policy_version 138873 (0.0010) [2023-12-26 00:41:42,119][123091] Updated weights for policy 0, policy_version 139466 (0.0010) [2023-12-26 00:41:42,189][123091] Updated weights for policy 0, policy_version 139476 (0.0009) [2023-12-26 00:41:42,258][123091] Updated weights for policy 0, policy_version 139486 (0.0010) [2023-12-26 00:41:42,885][123090] Updated weights for policy 1, policy_version 138883 (0.0009) [2023-12-26 00:41:42,965][123090] Updated weights for policy 1, policy_version 138893 (0.0008) [2023-12-26 00:41:43,037][123090] Updated weights for policy 1, policy_version 138903 (0.0008) [2023-12-26 00:41:43,049][123091] Updated weights for policy 0, policy_version 139496 (0.0008) [2023-12-26 00:41:43,120][123091] Updated weights for policy 0, policy_version 139506 (0.0007) [2023-12-26 00:41:43,189][123091] Updated weights for policy 0, policy_version 139516 (0.0008) [2023-12-26 00:41:43,707][123090] Updated weights for policy 1, policy_version 138913 (0.0007) [2023-12-26 00:41:43,767][123090] Updated weights for policy 1, policy_version 138923 (0.0008) [2023-12-26 00:41:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 71278592. Throughput: 0: 8842.0, 1: 9001.4. Samples: 71276580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:43,785][121949] Avg episode reward: [(0, '5563.881'), (1, '5736.926')] [2023-12-26 00:41:43,830][123090] Updated weights for policy 1, policy_version 138933 (0.0009) [2023-12-26 00:41:43,893][123090] Updated weights for policy 1, policy_version 138943 (0.0009) [2023-12-26 00:41:43,975][123091] Updated weights for policy 0, policy_version 139526 (0.0008) [2023-12-26 00:41:44,029][123091] Updated weights for policy 0, policy_version 139536 (0.0009) [2023-12-26 00:41:44,079][123091] Updated weights for policy 0, policy_version 139546 (0.0009) [2023-12-26 00:41:44,654][123090] Updated weights for policy 1, policy_version 138953 (0.0006) [2023-12-26 00:41:44,727][123090] Updated weights for policy 1, policy_version 138963 (0.0006) [2023-12-26 00:41:44,790][123090] Updated weights for policy 1, policy_version 138973 (0.0009) [2023-12-26 00:41:44,932][123091] Updated weights for policy 0, policy_version 139556 (0.0009) [2023-12-26 00:41:44,997][123091] Updated weights for policy 0, policy_version 139566 (0.0009) [2023-12-26 00:41:45,063][123091] Updated weights for policy 0, policy_version 139576 (0.0009) [2023-12-26 00:41:45,614][123090] Updated weights for policy 1, policy_version 138983 (0.0011) [2023-12-26 00:41:45,676][123090] Updated weights for policy 1, policy_version 138993 (0.0010) [2023-12-26 00:41:45,749][123090] Updated weights for policy 1, policy_version 139003 (0.0008) [2023-12-26 00:41:45,916][123091] Updated weights for policy 0, policy_version 139586 (0.0008) [2023-12-26 00:41:45,977][123091] Updated weights for policy 0, policy_version 139596 (0.0005) [2023-12-26 00:41:46,042][123091] Updated weights for policy 0, policy_version 139606 (0.0005) [2023-12-26 00:41:46,106][123091] Updated weights for policy 0, policy_version 139616 (0.0009) [2023-12-26 00:41:46,464][123090] Updated weights for policy 1, policy_version 139013 (0.0006) [2023-12-26 00:41:46,530][123090] Updated weights for policy 1, policy_version 139023 (0.0009) [2023-12-26 00:41:46,599][123090] Updated weights for policy 1, policy_version 139033 (0.0010) [2023-12-26 00:41:46,902][123091] Updated weights for policy 0, policy_version 139626 (0.0009) [2023-12-26 00:41:46,962][123091] Updated weights for policy 0, policy_version 139636 (0.0009) [2023-12-26 00:41:47,023][123091] Updated weights for policy 0, policy_version 139646 (0.0009) [2023-12-26 00:41:47,400][123090] Updated weights for policy 1, policy_version 139043 (0.0009) [2023-12-26 00:41:47,460][123090] Updated weights for policy 1, policy_version 139053 (0.0005) [2023-12-26 00:41:47,525][123090] Updated weights for policy 1, policy_version 139063 (0.0005) [2023-12-26 00:41:47,753][123091] Updated weights for policy 0, policy_version 139656 (0.0006) [2023-12-26 00:41:47,806][123091] Updated weights for policy 0, policy_version 139666 (0.0005) [2023-12-26 00:41:47,863][123091] Updated weights for policy 0, policy_version 139676 (0.0010) [2023-12-26 00:41:48,232][123090] Updated weights for policy 1, policy_version 139073 (0.0006) [2023-12-26 00:41:48,286][123090] Updated weights for policy 1, policy_version 139083 (0.0010) [2023-12-26 00:41:48,351][123090] Updated weights for policy 1, policy_version 139093 (0.0010) [2023-12-26 00:41:48,422][123090] Updated weights for policy 1, policy_version 139103 (0.0011) [2023-12-26 00:41:48,642][123091] Updated weights for policy 0, policy_version 139686 (0.0010) [2023-12-26 00:41:48,701][123091] Updated weights for policy 0, policy_version 139696 (0.0011) [2023-12-26 00:41:48,753][123091] Updated weights for policy 0, policy_version 139706 (0.0010) [2023-12-26 00:41:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 71368704. Throughput: 0: 8838.1, 1: 9027.8. Samples: 71384660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:48,785][121949] Avg episode reward: [(0, '5625.343'), (1, '5612.308')] [2023-12-26 00:41:49,261][123090] Updated weights for policy 1, policy_version 139113 (0.0008) [2023-12-26 00:41:49,341][123090] Updated weights for policy 1, policy_version 139123 (0.0008) [2023-12-26 00:41:49,405][123090] Updated weights for policy 1, policy_version 139133 (0.0008) [2023-12-26 00:41:49,540][123091] Updated weights for policy 0, policy_version 139716 (0.0009) [2023-12-26 00:41:49,602][123091] Updated weights for policy 0, policy_version 139726 (0.0005) [2023-12-26 00:41:49,656][123091] Updated weights for policy 0, policy_version 139736 (0.0006) [2023-12-26 00:41:50,181][123090] Updated weights for policy 1, policy_version 139143 (0.0009) [2023-12-26 00:41:50,237][123090] Updated weights for policy 1, policy_version 139153 (0.0010) [2023-12-26 00:41:50,285][123090] Updated weights for policy 1, policy_version 139163 (0.0010) [2023-12-26 00:41:50,367][123091] Updated weights for policy 0, policy_version 139746 (0.0007) [2023-12-26 00:41:50,419][123091] Updated weights for policy 0, policy_version 139756 (0.0011) [2023-12-26 00:41:50,474][123091] Updated weights for policy 0, policy_version 139766 (0.0010) [2023-12-26 00:41:50,536][123091] Updated weights for policy 0, policy_version 139776 (0.0010) [2023-12-26 00:41:51,145][123090] Updated weights for policy 1, policy_version 139173 (0.0009) [2023-12-26 00:41:51,209][123090] Updated weights for policy 1, policy_version 139183 (0.0009) [2023-12-26 00:41:51,277][123090] Updated weights for policy 1, policy_version 139193 (0.0008) [2023-12-26 00:41:51,303][123091] Updated weights for policy 0, policy_version 139786 (0.0008) [2023-12-26 00:41:51,373][123091] Updated weights for policy 0, policy_version 139796 (0.0009) [2023-12-26 00:41:51,441][123091] Updated weights for policy 0, policy_version 139806 (0.0009) [2023-12-26 00:41:52,074][123090] Updated weights for policy 1, policy_version 139203 (0.0007) [2023-12-26 00:41:52,145][123090] Updated weights for policy 1, policy_version 139213 (0.0005) [2023-12-26 00:41:52,203][123090] Updated weights for policy 1, policy_version 139223 (0.0005) [2023-12-26 00:41:52,373][123091] Updated weights for policy 0, policy_version 139816 (0.0010) [2023-12-26 00:41:52,443][123091] Updated weights for policy 0, policy_version 139826 (0.0011) [2023-12-26 00:41:52,497][123091] Updated weights for policy 0, policy_version 139837 (0.0009) [2023-12-26 00:41:52,943][123090] Updated weights for policy 1, policy_version 139233 (0.0005) [2023-12-26 00:41:53,015][123090] Updated weights for policy 1, policy_version 139243 (0.0007) [2023-12-26 00:41:53,092][123090] Updated weights for policy 1, policy_version 139253 (0.0007) [2023-12-26 00:41:53,164][123090] Updated weights for policy 1, policy_version 139263 (0.0008) [2023-12-26 00:41:53,281][123091] Updated weights for policy 0, policy_version 139847 (0.0007) [2023-12-26 00:41:53,342][123091] Updated weights for policy 0, policy_version 139857 (0.0007) [2023-12-26 00:41:53,415][123091] Updated weights for policy 0, policy_version 139867 (0.0007) [2023-12-26 00:41:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 71458816. Throughput: 0: 8854.6, 1: 9017.8. Samples: 71437468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:53,785][121949] Avg episode reward: [(0, '5665.250'), (1, '5404.824')] [2023-12-26 00:41:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000139872_35807232.pth... [2023-12-26 00:41:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000138816_35536896.pth [2023-12-26 00:41:53,840][123090] Updated weights for policy 1, policy_version 139273 (0.0006) [2023-12-26 00:41:53,914][123090] Updated weights for policy 1, policy_version 139283 (0.0006) [2023-12-26 00:41:53,986][123090] Updated weights for policy 1, policy_version 139293 (0.0006) [2023-12-26 00:41:54,003][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000139296_35659776.pth... [2023-12-26 00:41:54,009][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000138240_35389440.pth [2023-12-26 00:41:54,131][123091] Updated weights for policy 0, policy_version 139877 (0.0006) [2023-12-26 00:41:54,202][123091] Updated weights for policy 0, policy_version 139887 (0.0006) [2023-12-26 00:41:54,270][123091] Updated weights for policy 0, policy_version 139897 (0.0006) [2023-12-26 00:41:54,712][123090] Updated weights for policy 1, policy_version 139303 (0.0010) [2023-12-26 00:41:54,766][123090] Updated weights for policy 1, policy_version 139313 (0.0010) [2023-12-26 00:41:54,820][123090] Updated weights for policy 1, policy_version 139323 (0.0009) [2023-12-26 00:41:54,879][123091] Updated weights for policy 0, policy_version 139907 (0.0006) [2023-12-26 00:41:54,940][123091] Updated weights for policy 0, policy_version 139917 (0.0009) [2023-12-26 00:41:54,994][123091] Updated weights for policy 0, policy_version 139927 (0.0011) [2023-12-26 00:41:55,688][123090] Updated weights for policy 1, policy_version 139333 (0.0009) [2023-12-26 00:41:55,739][123090] Updated weights for policy 1, policy_version 139343 (0.0009) [2023-12-26 00:41:55,793][123090] Updated weights for policy 1, policy_version 139353 (0.0009) [2023-12-26 00:41:55,803][123091] Updated weights for policy 0, policy_version 139937 (0.0010) [2023-12-26 00:41:55,867][123091] Updated weights for policy 0, policy_version 139947 (0.0005) [2023-12-26 00:41:55,914][123091] Updated weights for policy 0, policy_version 139957 (0.0005) [2023-12-26 00:41:55,960][123091] Updated weights for policy 0, policy_version 139967 (0.0005) [2023-12-26 00:41:56,615][123091] Updated weights for policy 0, policy_version 139977 (0.0005) [2023-12-26 00:41:56,673][123091] Updated weights for policy 0, policy_version 139987 (0.0005) [2023-12-26 00:41:56,726][123091] Updated weights for policy 0, policy_version 139997 (0.0009) [2023-12-26 00:41:56,728][123090] Updated weights for policy 1, policy_version 139363 (0.0009) [2023-12-26 00:41:56,787][123090] Updated weights for policy 1, policy_version 139373 (0.0008) [2023-12-26 00:41:56,856][123090] Updated weights for policy 1, policy_version 139383 (0.0009) [2023-12-26 00:41:57,540][123091] Updated weights for policy 0, policy_version 140007 (0.0011) [2023-12-26 00:41:57,598][123091] Updated weights for policy 0, policy_version 140017 (0.0010) [2023-12-26 00:41:57,646][123090] Updated weights for policy 1, policy_version 139393 (0.0008) [2023-12-26 00:41:57,649][123091] Updated weights for policy 0, policy_version 140027 (0.0010) [2023-12-26 00:41:57,702][123090] Updated weights for policy 1, policy_version 139403 (0.0005) [2023-12-26 00:41:57,763][123090] Updated weights for policy 1, policy_version 139413 (0.0006) [2023-12-26 00:41:57,827][123090] Updated weights for policy 1, policy_version 139423 (0.0009) [2023-12-26 00:41:58,439][123091] Updated weights for policy 0, policy_version 140037 (0.0011) [2023-12-26 00:41:58,507][123091] Updated weights for policy 0, policy_version 140047 (0.0010) [2023-12-26 00:41:58,591][123091] Updated weights for policy 0, policy_version 140057 (0.0011) [2023-12-26 00:41:58,647][123090] Updated weights for policy 1, policy_version 139433 (0.0013) [2023-12-26 00:41:58,718][123090] Updated weights for policy 1, policy_version 139443 (0.0011) [2023-12-26 00:41:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 71548928. Throughput: 0: 8942.9, 1: 9073.0. Samples: 71546216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:41:58,785][121949] Avg episode reward: [(0, '5736.499'), (1, '5488.758')] [2023-12-26 00:41:58,793][123090] Updated weights for policy 1, policy_version 139453 (0.0010) [2023-12-26 00:41:59,481][123091] Updated weights for policy 0, policy_version 140067 (0.0008) [2023-12-26 00:41:59,542][123091] Updated weights for policy 0, policy_version 140077 (0.0009) [2023-12-26 00:41:59,604][123091] Updated weights for policy 0, policy_version 140087 (0.0009) [2023-12-26 00:41:59,652][123090] Updated weights for policy 1, policy_version 139463 (0.0009) [2023-12-26 00:41:59,709][123090] Updated weights for policy 1, policy_version 139473 (0.0006) [2023-12-26 00:41:59,770][123090] Updated weights for policy 1, policy_version 139483 (0.0006) [2023-12-26 00:42:00,452][123091] Updated weights for policy 0, policy_version 140097 (0.0008) [2023-12-26 00:42:00,514][123091] Updated weights for policy 0, policy_version 140107 (0.0011) [2023-12-26 00:42:00,577][123091] Updated weights for policy 0, policy_version 140117 (0.0010) [2023-12-26 00:42:00,598][123090] Updated weights for policy 1, policy_version 139493 (0.0008) [2023-12-26 00:42:00,640][123091] Updated weights for policy 0, policy_version 140127 (0.0010) [2023-12-26 00:42:00,652][123090] Updated weights for policy 1, policy_version 139503 (0.0008) [2023-12-26 00:42:00,711][123090] Updated weights for policy 1, policy_version 139513 (0.0008) [2023-12-26 00:42:01,315][123091] Updated weights for policy 0, policy_version 140137 (0.0008) [2023-12-26 00:42:01,381][123091] Updated weights for policy 0, policy_version 140147 (0.0008) [2023-12-26 00:42:01,441][123091] Updated weights for policy 0, policy_version 140157 (0.0007) [2023-12-26 00:42:01,533][123090] Updated weights for policy 1, policy_version 139523 (0.0007) [2023-12-26 00:42:01,584][123090] Updated weights for policy 1, policy_version 139533 (0.0005) [2023-12-26 00:42:01,653][123090] Updated weights for policy 1, policy_version 139543 (0.0008) [2023-12-26 00:42:02,184][123091] Updated weights for policy 0, policy_version 140167 (0.0008) [2023-12-26 00:42:02,236][123091] Updated weights for policy 0, policy_version 140177 (0.0009) [2023-12-26 00:42:02,303][123091] Updated weights for policy 0, policy_version 140187 (0.0010) [2023-12-26 00:42:02,439][123090] Updated weights for policy 1, policy_version 139553 (0.0009) [2023-12-26 00:42:02,495][123090] Updated weights for policy 1, policy_version 139563 (0.0006) [2023-12-26 00:42:02,552][123090] Updated weights for policy 1, policy_version 139573 (0.0009) [2023-12-26 00:42:02,606][123090] Updated weights for policy 1, policy_version 139583 (0.0009) [2023-12-26 00:42:03,152][123091] Updated weights for policy 0, policy_version 140197 (0.0010) [2023-12-26 00:42:03,199][123091] Updated weights for policy 0, policy_version 140207 (0.0009) [2023-12-26 00:42:03,253][123091] Updated weights for policy 0, policy_version 140217 (0.0009) [2023-12-26 00:42:03,374][123090] Updated weights for policy 1, policy_version 139593 (0.0005) [2023-12-26 00:42:03,424][123090] Updated weights for policy 1, policy_version 139603 (0.0005) [2023-12-26 00:42:03,491][123090] Updated weights for policy 1, policy_version 139613 (0.0006) [2023-12-26 00:42:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 71639040. Throughput: 0: 8995.4, 1: 8916.5. Samples: 71649996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:42:03,784][121949] Avg episode reward: [(0, '5780.332'), (1, '5687.708')] [2023-12-26 00:42:04,100][123091] Updated weights for policy 0, policy_version 140228 (0.0010) [2023-12-26 00:42:04,137][123090] Updated weights for policy 1, policy_version 139623 (0.0008) [2023-12-26 00:42:04,164][123091] Updated weights for policy 0, policy_version 140238 (0.0006) [2023-12-26 00:42:04,190][123090] Updated weights for policy 1, policy_version 139633 (0.0008) [2023-12-26 00:42:04,220][123091] Updated weights for policy 0, policy_version 140248 (0.0006) [2023-12-26 00:42:04,250][123090] Updated weights for policy 1, policy_version 139643 (0.0010) [2023-12-26 00:42:04,923][123091] Updated weights for policy 0, policy_version 140258 (0.0007) [2023-12-26 00:42:04,977][123091] Updated weights for policy 0, policy_version 140268 (0.0010) [2023-12-26 00:42:05,042][123091] Updated weights for policy 0, policy_version 140278 (0.0010) [2023-12-26 00:42:05,069][123090] Updated weights for policy 1, policy_version 139653 (0.0010) [2023-12-26 00:42:05,100][123091] Updated weights for policy 0, policy_version 140288 (0.0010) [2023-12-26 00:42:05,120][123090] Updated weights for policy 1, policy_version 139663 (0.0010) [2023-12-26 00:42:05,174][123090] Updated weights for policy 1, policy_version 139673 (0.0010) [2023-12-26 00:42:05,754][123091] Updated weights for policy 0, policy_version 140298 (0.0005) [2023-12-26 00:42:05,813][123091] Updated weights for policy 0, policy_version 140308 (0.0005) [2023-12-26 00:42:05,888][123091] Updated weights for policy 0, policy_version 140318 (0.0005) [2023-12-26 00:42:05,951][123090] Updated weights for policy 1, policy_version 139683 (0.0010) [2023-12-26 00:42:06,010][123090] Updated weights for policy 1, policy_version 139693 (0.0010) [2023-12-26 00:42:06,079][123090] Updated weights for policy 1, policy_version 139703 (0.0008) [2023-12-26 00:42:06,511][123091] Updated weights for policy 0, policy_version 140328 (0.0006) [2023-12-26 00:42:06,572][123091] Updated weights for policy 0, policy_version 140338 (0.0009) [2023-12-26 00:42:06,633][123091] Updated weights for policy 0, policy_version 140348 (0.0008) [2023-12-26 00:42:06,848][123090] Updated weights for policy 1, policy_version 139713 (0.0007) [2023-12-26 00:42:06,907][123090] Updated weights for policy 1, policy_version 139723 (0.0005) [2023-12-26 00:42:06,957][123090] Updated weights for policy 1, policy_version 139733 (0.0006) [2023-12-26 00:42:07,014][123090] Updated weights for policy 1, policy_version 139743 (0.0010) [2023-12-26 00:42:07,468][123091] Updated weights for policy 0, policy_version 140358 (0.0009) [2023-12-26 00:42:07,536][123091] Updated weights for policy 0, policy_version 140368 (0.0010) [2023-12-26 00:42:07,598][123091] Updated weights for policy 0, policy_version 140378 (0.0010) [2023-12-26 00:42:07,766][123090] Updated weights for policy 1, policy_version 139753 (0.0006) [2023-12-26 00:42:07,816][123090] Updated weights for policy 1, policy_version 139763 (0.0005) [2023-12-26 00:42:07,869][123090] Updated weights for policy 1, policy_version 139773 (0.0005) [2023-12-26 00:42:08,433][123091] Updated weights for policy 0, policy_version 140388 (0.0010) [2023-12-26 00:42:08,490][123091] Updated weights for policy 0, policy_version 140398 (0.0009) [2023-12-26 00:42:08,551][123091] Updated weights for policy 0, policy_version 140408 (0.0009) [2023-12-26 00:42:08,565][123090] Updated weights for policy 1, policy_version 139783 (0.0008) [2023-12-26 00:42:08,621][123090] Updated weights for policy 1, policy_version 139793 (0.0009) [2023-12-26 00:42:08,691][123090] Updated weights for policy 1, policy_version 139803 (0.0010) [2023-12-26 00:42:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17966.9). Total num frames: 71737344. Throughput: 0: 9103.1, 1: 8940.8. Samples: 71706988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:42:08,785][121949] Avg episode reward: [(0, '5578.895'), (1, '5605.716')] [2023-12-26 00:42:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000140416_35946496.pth... [2023-12-26 00:42:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000139808_35790848.pth... [2023-12-26 00:42:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000138752_35520512.pth [2023-12-26 00:42:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000139360_35676160.pth [2023-12-26 00:42:09,302][123091] Updated weights for policy 0, policy_version 140418 (0.0009) [2023-12-26 00:42:09,373][123091] Updated weights for policy 0, policy_version 140428 (0.0009) [2023-12-26 00:42:09,442][123091] Updated weights for policy 0, policy_version 140438 (0.0009) [2023-12-26 00:42:09,504][123091] Updated weights for policy 0, policy_version 140448 (0.0010) [2023-12-26 00:42:09,589][123090] Updated weights for policy 1, policy_version 139813 (0.0010) [2023-12-26 00:42:09,660][123090] Updated weights for policy 1, policy_version 139823 (0.0010) [2023-12-26 00:42:09,730][123090] Updated weights for policy 1, policy_version 139833 (0.0010) [2023-12-26 00:42:10,346][123091] Updated weights for policy 0, policy_version 140458 (0.0010) [2023-12-26 00:42:10,413][123091] Updated weights for policy 0, policy_version 140468 (0.0010) [2023-12-26 00:42:10,483][123091] Updated weights for policy 0, policy_version 140478 (0.0010) [2023-12-26 00:42:10,563][123090] Updated weights for policy 1, policy_version 139843 (0.0008) [2023-12-26 00:42:10,625][123090] Updated weights for policy 1, policy_version 139853 (0.0005) [2023-12-26 00:42:10,694][123090] Updated weights for policy 1, policy_version 139863 (0.0006) [2023-12-26 00:42:11,376][123090] Updated weights for policy 1, policy_version 139873 (0.0006) [2023-12-26 00:42:11,413][123091] Updated weights for policy 0, policy_version 140488 (0.0009) [2023-12-26 00:42:11,439][123090] Updated weights for policy 1, policy_version 139883 (0.0008) [2023-12-26 00:42:11,476][123091] Updated weights for policy 0, policy_version 140498 (0.0008) [2023-12-26 00:42:11,508][123090] Updated weights for policy 1, policy_version 139893 (0.0008) [2023-12-26 00:42:11,538][123091] Updated weights for policy 0, policy_version 140508 (0.0008) [2023-12-26 00:42:11,571][123090] Updated weights for policy 1, policy_version 139903 (0.0008) [2023-12-26 00:42:12,403][123091] Updated weights for policy 0, policy_version 140518 (0.0010) [2023-12-26 00:42:12,414][123090] Updated weights for policy 1, policy_version 139913 (0.0008) [2023-12-26 00:42:12,467][123091] Updated weights for policy 0, policy_version 140528 (0.0008) [2023-12-26 00:42:12,479][123090] Updated weights for policy 1, policy_version 139923 (0.0010) [2023-12-26 00:42:12,526][123091] Updated weights for policy 0, policy_version 140538 (0.0007) [2023-12-26 00:42:12,542][123090] Updated weights for policy 1, policy_version 139933 (0.0009) [2023-12-26 00:42:13,367][123091] Updated weights for policy 0, policy_version 140548 (0.0008) [2023-12-26 00:42:13,385][123090] Updated weights for policy 1, policy_version 139943 (0.0010) [2023-12-26 00:42:13,418][123091] Updated weights for policy 0, policy_version 140558 (0.0007) [2023-12-26 00:42:13,444][123090] Updated weights for policy 1, policy_version 139953 (0.0006) [2023-12-26 00:42:13,479][123091] Updated weights for policy 0, policy_version 140568 (0.0009) [2023-12-26 00:42:13,517][123090] Updated weights for policy 1, policy_version 139963 (0.0005) [2023-12-26 00:42:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 71819264. Throughput: 0: 9068.8, 1: 8888.7. Samples: 71810504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:42:13,785][121949] Avg episode reward: [(0, '5545.027'), (1, '5532.151')] [2023-12-26 00:42:14,326][123090] Updated weights for policy 1, policy_version 139973 (0.0008) [2023-12-26 00:42:14,347][123091] Updated weights for policy 0, policy_version 140578 (0.0010) [2023-12-26 00:42:14,398][123090] Updated weights for policy 1, policy_version 139983 (0.0009) [2023-12-26 00:42:14,412][123091] Updated weights for policy 0, policy_version 140588 (0.0008) [2023-12-26 00:42:14,463][123090] Updated weights for policy 1, policy_version 139993 (0.0008) [2023-12-26 00:42:14,479][123091] Updated weights for policy 0, policy_version 140598 (0.0009) [2023-12-26 00:42:14,549][123091] Updated weights for policy 0, policy_version 140608 (0.0009) [2023-12-26 00:42:15,230][123090] Updated weights for policy 1, policy_version 140003 (0.0010) [2023-12-26 00:42:15,283][123090] Updated weights for policy 1, policy_version 140013 (0.0009) [2023-12-26 00:42:15,337][123090] Updated weights for policy 1, policy_version 140023 (0.0010) [2023-12-26 00:42:15,375][123091] Updated weights for policy 0, policy_version 140618 (0.0007) [2023-12-26 00:42:15,428][123091] Updated weights for policy 0, policy_version 140628 (0.0008) [2023-12-26 00:42:15,492][123091] Updated weights for policy 0, policy_version 140638 (0.0009) [2023-12-26 00:42:16,163][123090] Updated weights for policy 1, policy_version 140033 (0.0009) [2023-12-26 00:42:16,219][123090] Updated weights for policy 1, policy_version 140043 (0.0009) [2023-12-26 00:42:16,286][123090] Updated weights for policy 1, policy_version 140053 (0.0009) [2023-12-26 00:42:16,331][123091] Updated weights for policy 0, policy_version 140648 (0.0009) [2023-12-26 00:42:16,352][123090] Updated weights for policy 1, policy_version 140063 (0.0007) [2023-12-26 00:42:16,388][123091] Updated weights for policy 0, policy_version 140658 (0.0008) [2023-12-26 00:42:16,458][123091] Updated weights for policy 0, policy_version 140668 (0.0009) [2023-12-26 00:42:17,173][123090] Updated weights for policy 1, policy_version 140073 (0.0009) [2023-12-26 00:42:17,244][123090] Updated weights for policy 1, policy_version 140083 (0.0008) [2023-12-26 00:42:17,264][123091] Updated weights for policy 0, policy_version 140678 (0.0008) [2023-12-26 00:42:17,300][123090] Updated weights for policy 1, policy_version 140093 (0.0007) [2023-12-26 00:42:17,320][123091] Updated weights for policy 0, policy_version 140688 (0.0008) [2023-12-26 00:42:17,380][123091] Updated weights for policy 0, policy_version 140698 (0.0009) [2023-12-26 00:42:18,124][123090] Updated weights for policy 1, policy_version 140103 (0.0009) [2023-12-26 00:42:18,188][123090] Updated weights for policy 1, policy_version 140113 (0.0009) [2023-12-26 00:42:18,203][123091] Updated weights for policy 0, policy_version 140708 (0.0010) [2023-12-26 00:42:18,252][123090] Updated weights for policy 1, policy_version 140123 (0.0006) [2023-12-26 00:42:18,265][123091] Updated weights for policy 0, policy_version 140718 (0.0010) [2023-12-26 00:42:18,331][123091] Updated weights for policy 0, policy_version 140728 (0.0011) [2023-12-26 00:42:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17911.3). Total num frames: 71901184. Throughput: 0: 8895.2, 1: 8812.6. Samples: 71912332. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:18,784][121949] Avg episode reward: [(0, '5687.592'), (1, '5552.576')] [2023-12-26 00:42:19,052][123090] Updated weights for policy 1, policy_version 140133 (0.0010) [2023-12-26 00:42:19,120][123090] Updated weights for policy 1, policy_version 140143 (0.0010) [2023-12-26 00:42:19,152][123091] Updated weights for policy 0, policy_version 140738 (0.0011) [2023-12-26 00:42:19,180][123090] Updated weights for policy 1, policy_version 140153 (0.0005) [2023-12-26 00:42:19,220][123091] Updated weights for policy 0, policy_version 140748 (0.0010) [2023-12-26 00:42:19,285][123091] Updated weights for policy 0, policy_version 140758 (0.0009) [2023-12-26 00:42:19,352][123091] Updated weights for policy 0, policy_version 140768 (0.0009) [2023-12-26 00:42:20,024][123090] Updated weights for policy 1, policy_version 140163 (0.0011) [2023-12-26 00:42:20,087][123090] Updated weights for policy 1, policy_version 140173 (0.0010) [2023-12-26 00:42:20,148][123090] Updated weights for policy 1, policy_version 140183 (0.0011) [2023-12-26 00:42:20,180][123091] Updated weights for policy 0, policy_version 140778 (0.0008) [2023-12-26 00:42:20,240][123091] Updated weights for policy 0, policy_version 140788 (0.0008) [2023-12-26 00:42:20,307][123091] Updated weights for policy 0, policy_version 140798 (0.0008) [2023-12-26 00:42:20,980][123090] Updated weights for policy 1, policy_version 140193 (0.0011) [2023-12-26 00:42:21,056][123090] Updated weights for policy 1, policy_version 140203 (0.0010) [2023-12-26 00:42:21,092][123091] Updated weights for policy 0, policy_version 140808 (0.0009) [2023-12-26 00:42:21,122][123090] Updated weights for policy 1, policy_version 140213 (0.0012) [2023-12-26 00:42:21,158][123091] Updated weights for policy 0, policy_version 140818 (0.0007) [2023-12-26 00:42:21,178][123090] Updated weights for policy 1, policy_version 140223 (0.0010) [2023-12-26 00:42:21,225][123091] Updated weights for policy 0, policy_version 140828 (0.0008) [2023-12-26 00:42:22,012][123090] Updated weights for policy 1, policy_version 140233 (0.0008) [2023-12-26 00:42:22,047][123091] Updated weights for policy 0, policy_version 140838 (0.0008) [2023-12-26 00:42:22,077][123090] Updated weights for policy 1, policy_version 140243 (0.0006) [2023-12-26 00:42:22,106][123091] Updated weights for policy 0, policy_version 140848 (0.0008) [2023-12-26 00:42:22,147][123090] Updated weights for policy 1, policy_version 140253 (0.0006) [2023-12-26 00:42:22,167][123091] Updated weights for policy 0, policy_version 140858 (0.0007) [2023-12-26 00:42:22,954][123090] Updated weights for policy 1, policy_version 140263 (0.0010) [2023-12-26 00:42:22,977][123091] Updated weights for policy 0, policy_version 140868 (0.0008) [2023-12-26 00:42:23,013][123090] Updated weights for policy 1, policy_version 140273 (0.0010) [2023-12-26 00:42:23,042][123091] Updated weights for policy 0, policy_version 140878 (0.0006) [2023-12-26 00:42:23,072][123090] Updated weights for policy 1, policy_version 140283 (0.0008) [2023-12-26 00:42:23,109][123091] Updated weights for policy 0, policy_version 140888 (0.0006) [2023-12-26 00:42:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 71983104. Throughput: 0: 8813.0, 1: 8741.3. Samples: 71963216. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:23,785][121949] Avg episode reward: [(0, '5749.679'), (1, '5615.634')] [2023-12-26 00:42:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000140896_36069376.pth... [2023-12-26 00:42:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000140288_35913728.pth... [2023-12-26 00:42:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000139872_35807232.pth [2023-12-26 00:42:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000139296_35659776.pth [2023-12-26 00:42:23,901][123091] Updated weights for policy 0, policy_version 140898 (0.0006) [2023-12-26 00:42:23,906][123090] Updated weights for policy 1, policy_version 140293 (0.0008) [2023-12-26 00:42:23,959][123091] Updated weights for policy 0, policy_version 140908 (0.0008) [2023-12-26 00:42:23,970][123090] Updated weights for policy 1, policy_version 140303 (0.0008) [2023-12-26 00:42:24,008][123091] Updated weights for policy 0, policy_version 140918 (0.0010) [2023-12-26 00:42:24,023][123090] Updated weights for policy 1, policy_version 140313 (0.0006) [2023-12-26 00:42:24,067][123091] Updated weights for policy 0, policy_version 140928 (0.0008) [2023-12-26 00:42:24,819][123090] Updated weights for policy 1, policy_version 140323 (0.0009) [2023-12-26 00:42:24,867][123090] Updated weights for policy 1, policy_version 140333 (0.0008) [2023-12-26 00:42:24,908][123091] Updated weights for policy 0, policy_version 140938 (0.0005) [2023-12-26 00:42:24,928][123090] Updated weights for policy 1, policy_version 140343 (0.0006) [2023-12-26 00:42:24,963][123091] Updated weights for policy 0, policy_version 140948 (0.0006) [2023-12-26 00:42:25,023][123091] Updated weights for policy 0, policy_version 140958 (0.0009) [2023-12-26 00:42:25,672][123090] Updated weights for policy 1, policy_version 140353 (0.0006) [2023-12-26 00:42:25,722][123090] Updated weights for policy 1, policy_version 140363 (0.0005) [2023-12-26 00:42:25,781][123090] Updated weights for policy 1, policy_version 140373 (0.0005) [2023-12-26 00:42:25,843][123090] Updated weights for policy 1, policy_version 140383 (0.0008) [2023-12-26 00:42:25,875][123091] Updated weights for policy 0, policy_version 140968 (0.0007) [2023-12-26 00:42:25,934][123091] Updated weights for policy 0, policy_version 140978 (0.0009) [2023-12-26 00:42:26,005][123091] Updated weights for policy 0, policy_version 140988 (0.0006) [2023-12-26 00:42:26,517][123090] Updated weights for policy 1, policy_version 140393 (0.0006) [2023-12-26 00:42:26,582][123090] Updated weights for policy 1, policy_version 140403 (0.0010) [2023-12-26 00:42:26,656][123090] Updated weights for policy 1, policy_version 140413 (0.0011) [2023-12-26 00:42:26,679][123091] Updated weights for policy 0, policy_version 140998 (0.0005) [2023-12-26 00:42:26,733][123091] Updated weights for policy 0, policy_version 141008 (0.0005) [2023-12-26 00:42:26,778][123091] Updated weights for policy 0, policy_version 141018 (0.0005) [2023-12-26 00:42:27,443][123091] Updated weights for policy 0, policy_version 141028 (0.0005) [2023-12-26 00:42:27,490][123091] Updated weights for policy 0, policy_version 141038 (0.0007) [2023-12-26 00:42:27,501][123090] Updated weights for policy 1, policy_version 140423 (0.0010) [2023-12-26 00:42:27,534][123091] Updated weights for policy 0, policy_version 141048 (0.0006) [2023-12-26 00:42:27,569][123090] Updated weights for policy 1, policy_version 140433 (0.0010) [2023-12-26 00:42:27,632][123090] Updated weights for policy 1, policy_version 140443 (0.0009) [2023-12-26 00:42:28,161][123091] Updated weights for policy 0, policy_version 141058 (0.0006) [2023-12-26 00:42:28,229][123091] Updated weights for policy 0, policy_version 141068 (0.0005) [2023-12-26 00:42:28,289][123091] Updated weights for policy 0, policy_version 141078 (0.0006) [2023-12-26 00:42:28,355][123091] Updated weights for policy 0, policy_version 141088 (0.0010) [2023-12-26 00:42:28,488][123090] Updated weights for policy 1, policy_version 140453 (0.0009) [2023-12-26 00:42:28,554][123090] Updated weights for policy 1, policy_version 140463 (0.0010) [2023-12-26 00:42:28,617][123090] Updated weights for policy 1, policy_version 140473 (0.0010) [2023-12-26 00:42:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 72081408. Throughput: 0: 8848.3, 1: 8822.6. Samples: 72071768. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:28,785][121949] Avg episode reward: [(0, '5736.087'), (1, '5569.981')] [2023-12-26 00:42:29,118][123091] Updated weights for policy 0, policy_version 141098 (0.0009) [2023-12-26 00:42:29,166][123091] Updated weights for policy 0, policy_version 141108 (0.0009) [2023-12-26 00:42:29,219][123091] Updated weights for policy 0, policy_version 141118 (0.0009) [2023-12-26 00:42:29,431][123090] Updated weights for policy 1, policy_version 140483 (0.0009) [2023-12-26 00:42:29,502][123090] Updated weights for policy 1, policy_version 140493 (0.0009) [2023-12-26 00:42:29,566][123090] Updated weights for policy 1, policy_version 140503 (0.0009) [2023-12-26 00:42:30,153][123091] Updated weights for policy 0, policy_version 141128 (0.0005) [2023-12-26 00:42:30,217][123091] Updated weights for policy 0, policy_version 141138 (0.0005) [2023-12-26 00:42:30,279][123091] Updated weights for policy 0, policy_version 141148 (0.0005) [2023-12-26 00:42:30,405][123090] Updated weights for policy 1, policy_version 140513 (0.0009) [2023-12-26 00:42:30,469][123090] Updated weights for policy 1, policy_version 140523 (0.0007) [2023-12-26 00:42:30,535][123090] Updated weights for policy 1, policy_version 140533 (0.0007) [2023-12-26 00:42:30,602][123090] Updated weights for policy 1, policy_version 140543 (0.0006) [2023-12-26 00:42:30,934][123091] Updated weights for policy 0, policy_version 141158 (0.0008) [2023-12-26 00:42:30,998][123091] Updated weights for policy 0, policy_version 141168 (0.0009) [2023-12-26 00:42:31,066][123091] Updated weights for policy 0, policy_version 141178 (0.0008) [2023-12-26 00:42:31,358][123090] Updated weights for policy 1, policy_version 140553 (0.0010) [2023-12-26 00:42:31,416][123090] Updated weights for policy 1, policy_version 140563 (0.0009) [2023-12-26 00:42:31,477][123090] Updated weights for policy 1, policy_version 140573 (0.0009) [2023-12-26 00:42:31,889][123091] Updated weights for policy 0, policy_version 141188 (0.0007) [2023-12-26 00:42:31,954][123091] Updated weights for policy 0, policy_version 141198 (0.0009) [2023-12-26 00:42:32,013][123091] Updated weights for policy 0, policy_version 141208 (0.0010) [2023-12-26 00:42:32,348][123090] Updated weights for policy 1, policy_version 140583 (0.0009) [2023-12-26 00:42:32,416][123090] Updated weights for policy 1, policy_version 140593 (0.0009) [2023-12-26 00:42:32,485][123090] Updated weights for policy 1, policy_version 140603 (0.0009) [2023-12-26 00:42:32,732][123091] Updated weights for policy 0, policy_version 141218 (0.0009) [2023-12-26 00:42:32,791][123091] Updated weights for policy 0, policy_version 141228 (0.0005) [2023-12-26 00:42:32,846][123091] Updated weights for policy 0, policy_version 141238 (0.0005) [2023-12-26 00:42:32,899][123091] Updated weights for policy 0, policy_version 141248 (0.0005) [2023-12-26 00:42:33,326][123090] Updated weights for policy 1, policy_version 140613 (0.0010) [2023-12-26 00:42:33,386][123090] Updated weights for policy 1, policy_version 140623 (0.0009) [2023-12-26 00:42:33,438][123090] Updated weights for policy 1, policy_version 140633 (0.0009) [2023-12-26 00:42:33,605][123091] Updated weights for policy 0, policy_version 141258 (0.0007) [2023-12-26 00:42:33,672][123091] Updated weights for policy 0, policy_version 141268 (0.0007) [2023-12-26 00:42:33,733][123091] Updated weights for policy 0, policy_version 141278 (0.0008) [2023-12-26 00:42:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 72171520. Throughput: 0: 8915.4, 1: 8714.1. Samples: 72177988. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:33,785][121949] Avg episode reward: [(0, '5725.812'), (1, '5589.603')] [2023-12-26 00:42:34,334][123090] Updated weights for policy 1, policy_version 140643 (0.0009) [2023-12-26 00:42:34,404][123090] Updated weights for policy 1, policy_version 140653 (0.0008) [2023-12-26 00:42:34,428][123091] Updated weights for policy 0, policy_version 141288 (0.0010) [2023-12-26 00:42:34,473][123090] Updated weights for policy 1, policy_version 140663 (0.0007) [2023-12-26 00:42:34,492][123091] Updated weights for policy 0, policy_version 141298 (0.0009) [2023-12-26 00:42:34,556][123091] Updated weights for policy 0, policy_version 141308 (0.0011) [2023-12-26 00:42:35,268][123091] Updated weights for policy 0, policy_version 141318 (0.0008) [2023-12-26 00:42:35,332][123090] Updated weights for policy 1, policy_version 140673 (0.0007) [2023-12-26 00:42:35,333][123091] Updated weights for policy 0, policy_version 141328 (0.0010) [2023-12-26 00:42:35,387][123091] Updated weights for policy 0, policy_version 141338 (0.0010) [2023-12-26 00:42:35,394][123090] Updated weights for policy 1, policy_version 140683 (0.0006) [2023-12-26 00:42:35,454][123090] Updated weights for policy 1, policy_version 140693 (0.0009) [2023-12-26 00:42:35,515][123090] Updated weights for policy 1, policy_version 140703 (0.0009) [2023-12-26 00:42:36,190][123091] Updated weights for policy 0, policy_version 141348 (0.0010) [2023-12-26 00:42:36,252][123091] Updated weights for policy 0, policy_version 141358 (0.0010) [2023-12-26 00:42:36,328][123091] Updated weights for policy 0, policy_version 141368 (0.0011) [2023-12-26 00:42:36,359][123090] Updated weights for policy 1, policy_version 140713 (0.0006) [2023-12-26 00:42:36,426][123090] Updated weights for policy 1, policy_version 140723 (0.0006) [2023-12-26 00:42:36,495][123090] Updated weights for policy 1, policy_version 140733 (0.0005) [2023-12-26 00:42:37,153][123091] Updated weights for policy 0, policy_version 141378 (0.0011) [2023-12-26 00:42:37,218][123091] Updated weights for policy 0, policy_version 141388 (0.0010) [2023-12-26 00:42:37,240][123090] Updated weights for policy 1, policy_version 140743 (0.0006) [2023-12-26 00:42:37,291][123091] Updated weights for policy 0, policy_version 141398 (0.0011) [2023-12-26 00:42:37,306][123090] Updated weights for policy 1, policy_version 140753 (0.0006) [2023-12-26 00:42:37,346][123091] Updated weights for policy 0, policy_version 141408 (0.0010) [2023-12-26 00:42:37,375][123090] Updated weights for policy 1, policy_version 140763 (0.0009) [2023-12-26 00:42:38,071][123091] Updated weights for policy 0, policy_version 141418 (0.0006) [2023-12-26 00:42:38,126][123091] Updated weights for policy 0, policy_version 141428 (0.0008) [2023-12-26 00:42:38,179][123091] Updated weights for policy 0, policy_version 141438 (0.0010) [2023-12-26 00:42:38,193][123090] Updated weights for policy 1, policy_version 140773 (0.0007) [2023-12-26 00:42:38,252][123090] Updated weights for policy 1, policy_version 140783 (0.0005) [2023-12-26 00:42:38,301][123090] Updated weights for policy 1, policy_version 140793 (0.0005) [2023-12-26 00:42:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 72253440. Throughput: 0: 8923.0, 1: 8713.7. Samples: 72231120. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:38,785][121949] Avg episode reward: [(0, '5756.547'), (1, '5514.684')] [2023-12-26 00:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000141440_36208640.pth... [2023-12-26 00:42:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000140800_36044800.pth... [2023-12-26 00:42:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000140416_35946496.pth [2023-12-26 00:42:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000139808_35790848.pth [2023-12-26 00:42:39,032][123091] Updated weights for policy 0, policy_version 141448 (0.0010) [2023-12-26 00:42:39,080][123091] Updated weights for policy 0, policy_version 141458 (0.0010) [2023-12-26 00:42:39,120][123090] Updated weights for policy 1, policy_version 140803 (0.0008) [2023-12-26 00:42:39,124][123091] Updated weights for policy 0, policy_version 141468 (0.0010) [2023-12-26 00:42:39,183][123090] Updated weights for policy 1, policy_version 140813 (0.0010) [2023-12-26 00:42:39,244][123090] Updated weights for policy 1, policy_version 140823 (0.0010) [2023-12-26 00:42:39,962][123091] Updated weights for policy 0, policy_version 141478 (0.0010) [2023-12-26 00:42:40,030][123091] Updated weights for policy 0, policy_version 141488 (0.0011) [2023-12-26 00:42:40,094][123091] Updated weights for policy 0, policy_version 141498 (0.0006) [2023-12-26 00:42:40,096][123090] Updated weights for policy 1, policy_version 140833 (0.0010) [2023-12-26 00:42:40,166][123090] Updated weights for policy 1, policy_version 140843 (0.0006) [2023-12-26 00:42:40,222][123090] Updated weights for policy 1, policy_version 140853 (0.0008) [2023-12-26 00:42:40,275][123090] Updated weights for policy 1, policy_version 140863 (0.0009) [2023-12-26 00:42:40,768][123091] Updated weights for policy 0, policy_version 141508 (0.0006) [2023-12-26 00:42:40,846][123091] Updated weights for policy 0, policy_version 141518 (0.0005) [2023-12-26 00:42:40,910][123091] Updated weights for policy 0, policy_version 141528 (0.0005) [2023-12-26 00:42:41,092][123090] Updated weights for policy 1, policy_version 140873 (0.0009) [2023-12-26 00:42:41,163][123090] Updated weights for policy 1, policy_version 140883 (0.0009) [2023-12-26 00:42:41,225][123090] Updated weights for policy 1, policy_version 140893 (0.0009) [2023-12-26 00:42:41,733][123091] Updated weights for policy 0, policy_version 141538 (0.0010) [2023-12-26 00:42:41,801][123091] Updated weights for policy 0, policy_version 141548 (0.0011) [2023-12-26 00:42:41,873][123091] Updated weights for policy 0, policy_version 141558 (0.0011) [2023-12-26 00:42:41,941][123091] Updated weights for policy 0, policy_version 141568 (0.0010) [2023-12-26 00:42:42,076][123090] Updated weights for policy 1, policy_version 140903 (0.0007) [2023-12-26 00:42:42,150][123090] Updated weights for policy 1, policy_version 140913 (0.0009) [2023-12-26 00:42:42,220][123090] Updated weights for policy 1, policy_version 140923 (0.0009) [2023-12-26 00:42:42,672][123091] Updated weights for policy 0, policy_version 141578 (0.0005) [2023-12-26 00:42:42,735][123091] Updated weights for policy 0, policy_version 141588 (0.0005) [2023-12-26 00:42:42,794][123091] Updated weights for policy 0, policy_version 141598 (0.0009) [2023-12-26 00:42:43,077][123090] Updated weights for policy 1, policy_version 140933 (0.0009) [2023-12-26 00:42:43,128][123090] Updated weights for policy 1, policy_version 140943 (0.0010) [2023-12-26 00:42:43,176][123090] Updated weights for policy 1, policy_version 140953 (0.0010) [2023-12-26 00:42:43,576][123091] Updated weights for policy 0, policy_version 141608 (0.0009) [2023-12-26 00:42:43,625][123091] Updated weights for policy 0, policy_version 141618 (0.0008) [2023-12-26 00:42:43,673][123091] Updated weights for policy 0, policy_version 141628 (0.0009) [2023-12-26 00:42:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 72343552. Throughput: 0: 8872.6, 1: 8660.1. Samples: 72335188. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:43,784][121949] Avg episode reward: [(0, '5699.176'), (1, '5504.979')] [2023-12-26 00:42:44,023][123090] Updated weights for policy 1, policy_version 140963 (0.0010) [2023-12-26 00:42:44,100][123090] Updated weights for policy 1, policy_version 140973 (0.0011) [2023-12-26 00:42:44,156][123090] Updated weights for policy 1, policy_version 140983 (0.0011) [2023-12-26 00:42:44,553][123091] Updated weights for policy 0, policy_version 141638 (0.0009) [2023-12-26 00:42:44,623][123091] Updated weights for policy 0, policy_version 141648 (0.0006) [2023-12-26 00:42:44,689][123091] Updated weights for policy 0, policy_version 141658 (0.0005) [2023-12-26 00:42:44,926][123090] Updated weights for policy 1, policy_version 140993 (0.0009) [2023-12-26 00:42:44,991][123090] Updated weights for policy 1, policy_version 141003 (0.0008) [2023-12-26 00:42:45,059][123090] Updated weights for policy 1, policy_version 141013 (0.0008) [2023-12-26 00:42:45,131][123090] Updated weights for policy 1, policy_version 141023 (0.0008) [2023-12-26 00:42:45,499][123091] Updated weights for policy 0, policy_version 141668 (0.0007) [2023-12-26 00:42:45,557][123091] Updated weights for policy 0, policy_version 141678 (0.0010) [2023-12-26 00:42:45,634][123091] Updated weights for policy 0, policy_version 141688 (0.0010) [2023-12-26 00:42:45,925][123090] Updated weights for policy 1, policy_version 141033 (0.0010) [2023-12-26 00:42:45,981][123090] Updated weights for policy 1, policy_version 141043 (0.0009) [2023-12-26 00:42:46,043][123090] Updated weights for policy 1, policy_version 141053 (0.0009) [2023-12-26 00:42:46,413][123091] Updated weights for policy 0, policy_version 141698 (0.0010) [2023-12-26 00:42:46,470][123091] Updated weights for policy 0, policy_version 141708 (0.0010) [2023-12-26 00:42:46,529][123091] Updated weights for policy 0, policy_version 141720 (0.0010) [2023-12-26 00:42:46,846][123090] Updated weights for policy 1, policy_version 141063 (0.0009) [2023-12-26 00:42:46,910][123090] Updated weights for policy 1, policy_version 141073 (0.0009) [2023-12-26 00:42:46,958][123090] Updated weights for policy 1, policy_version 141083 (0.0009) [2023-12-26 00:42:47,362][123091] Updated weights for policy 0, policy_version 141731 (0.0010) [2023-12-26 00:42:47,413][123091] Updated weights for policy 0, policy_version 141741 (0.0009) [2023-12-26 00:42:47,462][123091] Updated weights for policy 0, policy_version 141751 (0.0009) [2023-12-26 00:42:47,755][123090] Updated weights for policy 1, policy_version 141093 (0.0007) [2023-12-26 00:42:47,811][123090] Updated weights for policy 1, policy_version 141103 (0.0005) [2023-12-26 00:42:47,865][123090] Updated weights for policy 1, policy_version 141113 (0.0005) [2023-12-26 00:42:48,361][123091] Updated weights for policy 0, policy_version 141763 (0.0009) [2023-12-26 00:42:48,410][123091] Updated weights for policy 0, policy_version 141773 (0.0009) [2023-12-26 00:42:48,472][123091] Updated weights for policy 0, policy_version 141783 (0.0010) [2023-12-26 00:42:48,531][123090] Updated weights for policy 1, policy_version 141123 (0.0007) [2023-12-26 00:42:48,590][123090] Updated weights for policy 1, policy_version 141133 (0.0010) [2023-12-26 00:42:48,647][123090] Updated weights for policy 1, policy_version 141143 (0.0010) [2023-12-26 00:42:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 72433664. Throughput: 0: 8861.9, 1: 8683.7. Samples: 72439552. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:48,785][121949] Avg episode reward: [(0, '5701.566'), (1, '5521.369')] [2023-12-26 00:42:49,363][123091] Updated weights for policy 0, policy_version 141793 (0.0009) [2023-12-26 00:42:49,435][123091] Updated weights for policy 0, policy_version 141803 (0.0009) [2023-12-26 00:42:49,445][123090] Updated weights for policy 1, policy_version 141153 (0.0009) [2023-12-26 00:42:49,498][123091] Updated weights for policy 0, policy_version 141813 (0.0009) [2023-12-26 00:42:49,509][123090] Updated weights for policy 1, policy_version 141163 (0.0008) [2023-12-26 00:42:49,554][123091] Updated weights for policy 0, policy_version 141823 (0.0006) [2023-12-26 00:42:49,570][123090] Updated weights for policy 1, policy_version 141173 (0.0009) [2023-12-26 00:42:49,625][123090] Updated weights for policy 1, policy_version 141183 (0.0009) [2023-12-26 00:42:50,355][123091] Updated weights for policy 0, policy_version 141833 (0.0010) [2023-12-26 00:42:50,419][123091] Updated weights for policy 0, policy_version 141843 (0.0010) [2023-12-26 00:42:50,478][123091] Updated weights for policy 0, policy_version 141853 (0.0008) [2023-12-26 00:42:50,478][123090] Updated weights for policy 1, policy_version 141193 (0.0008) [2023-12-26 00:42:50,533][123090] Updated weights for policy 1, policy_version 141203 (0.0009) [2023-12-26 00:42:50,598][123090] Updated weights for policy 1, policy_version 141213 (0.0009) [2023-12-26 00:42:51,240][123091] Updated weights for policy 0, policy_version 141863 (0.0009) [2023-12-26 00:42:51,314][123091] Updated weights for policy 0, policy_version 141873 (0.0010) [2023-12-26 00:42:51,389][123091] Updated weights for policy 0, policy_version 141883 (0.0009) [2023-12-26 00:42:51,401][123090] Updated weights for policy 1, policy_version 141223 (0.0008) [2023-12-26 00:42:51,474][123090] Updated weights for policy 1, policy_version 141233 (0.0009) [2023-12-26 00:42:51,547][123090] Updated weights for policy 1, policy_version 141243 (0.0009) [2023-12-26 00:42:52,187][123091] Updated weights for policy 0, policy_version 141893 (0.0009) [2023-12-26 00:42:52,244][123091] Updated weights for policy 0, policy_version 141903 (0.0009) [2023-12-26 00:42:52,309][123091] Updated weights for policy 0, policy_version 141913 (0.0009) [2023-12-26 00:42:52,310][123090] Updated weights for policy 1, policy_version 141253 (0.0007) [2023-12-26 00:42:52,380][123090] Updated weights for policy 1, policy_version 141263 (0.0009) [2023-12-26 00:42:52,436][123090] Updated weights for policy 1, policy_version 141273 (0.0010) [2023-12-26 00:42:53,017][123091] Updated weights for policy 0, policy_version 141923 (0.0008) [2023-12-26 00:42:53,075][123091] Updated weights for policy 0, policy_version 141933 (0.0007) [2023-12-26 00:42:53,131][123091] Updated weights for policy 0, policy_version 141943 (0.0007) [2023-12-26 00:42:53,307][123090] Updated weights for policy 1, policy_version 141283 (0.0008) [2023-12-26 00:42:53,361][123090] Updated weights for policy 1, policy_version 141293 (0.0007) [2023-12-26 00:42:53,415][123090] Updated weights for policy 1, policy_version 141303 (0.0010) [2023-12-26 00:42:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 72515584. Throughput: 0: 8782.4, 1: 8653.5. Samples: 72491612. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:53,786][121949] Avg episode reward: [(0, '5768.095'), (1, '5334.429')] [2023-12-26 00:42:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000141952_36339712.pth... [2023-12-26 00:42:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000141312_36175872.pth... [2023-12-26 00:42:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000140288_35913728.pth [2023-12-26 00:42:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000140896_36069376.pth [2023-12-26 00:42:53,826][123091] Updated weights for policy 0, policy_version 141953 (0.0007) [2023-12-26 00:42:53,894][123091] Updated weights for policy 0, policy_version 141963 (0.0008) [2023-12-26 00:42:53,968][123091] Updated weights for policy 0, policy_version 141973 (0.0007) [2023-12-26 00:42:54,023][123091] Updated weights for policy 0, policy_version 141983 (0.0010) [2023-12-26 00:42:54,269][123090] Updated weights for policy 1, policy_version 141313 (0.0010) [2023-12-26 00:42:54,331][123090] Updated weights for policy 1, policy_version 141324 (0.0010) [2023-12-26 00:42:54,401][123090] Updated weights for policy 1, policy_version 141334 (0.0007) [2023-12-26 00:42:54,470][123090] Updated weights for policy 1, policy_version 141344 (0.0006) [2023-12-26 00:42:54,763][123091] Updated weights for policy 0, policy_version 141993 (0.0010) [2023-12-26 00:42:54,820][123091] Updated weights for policy 0, policy_version 142003 (0.0011) [2023-12-26 00:42:54,879][123091] Updated weights for policy 0, policy_version 142013 (0.0010) [2023-12-26 00:42:55,135][123090] Updated weights for policy 1, policy_version 141354 (0.0008) [2023-12-26 00:42:55,187][123090] Updated weights for policy 1, policy_version 141364 (0.0009) [2023-12-26 00:42:55,240][123090] Updated weights for policy 1, policy_version 141374 (0.0009) [2023-12-26 00:42:55,700][123091] Updated weights for policy 0, policy_version 142023 (0.0010) [2023-12-26 00:42:55,751][123091] Updated weights for policy 0, policy_version 142033 (0.0010) [2023-12-26 00:42:55,798][123091] Updated weights for policy 0, policy_version 142043 (0.0010) [2023-12-26 00:42:56,122][123090] Updated weights for policy 1, policy_version 141384 (0.0010) [2023-12-26 00:42:56,186][123090] Updated weights for policy 1, policy_version 141394 (0.0011) [2023-12-26 00:42:56,251][123090] Updated weights for policy 1, policy_version 141404 (0.0005) [2023-12-26 00:42:56,654][123091] Updated weights for policy 0, policy_version 142053 (0.0010) [2023-12-26 00:42:56,723][123091] Updated weights for policy 0, policy_version 142063 (0.0011) [2023-12-26 00:42:56,782][123091] Updated weights for policy 0, policy_version 142073 (0.0011) [2023-12-26 00:42:56,962][123090] Updated weights for policy 1, policy_version 141414 (0.0005) [2023-12-26 00:42:57,009][123090] Updated weights for policy 1, policy_version 141424 (0.0005) [2023-12-26 00:42:57,058][123090] Updated weights for policy 1, policy_version 141434 (0.0005) [2023-12-26 00:42:57,532][123091] Updated weights for policy 0, policy_version 142083 (0.0009) [2023-12-26 00:42:57,580][123091] Updated weights for policy 0, policy_version 142093 (0.0005) [2023-12-26 00:42:57,624][123091] Updated weights for policy 0, policy_version 142103 (0.0005) [2023-12-26 00:42:57,716][123090] Updated weights for policy 1, policy_version 141444 (0.0005) [2023-12-26 00:42:57,771][123090] Updated weights for policy 1, policy_version 141454 (0.0006) [2023-12-26 00:42:57,839][123090] Updated weights for policy 1, policy_version 141464 (0.0005) [2023-12-26 00:42:58,350][123091] Updated weights for policy 0, policy_version 142113 (0.0006) [2023-12-26 00:42:58,417][123091] Updated weights for policy 0, policy_version 142123 (0.0008) [2023-12-26 00:42:58,502][123091] Updated weights for policy 0, policy_version 142133 (0.0007) [2023-12-26 00:42:58,573][123091] Updated weights for policy 0, policy_version 142143 (0.0011) [2023-12-26 00:42:58,581][123090] Updated weights for policy 1, policy_version 141474 (0.0006) [2023-12-26 00:42:58,651][123090] Updated weights for policy 1, policy_version 141484 (0.0010) [2023-12-26 00:42:58,715][123090] Updated weights for policy 1, policy_version 141494 (0.0010) [2023-12-26 00:42:58,777][123090] Updated weights for policy 1, policy_version 141504 (0.0010) [2023-12-26 00:42:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 72613888. Throughput: 0: 8880.5, 1: 8687.7. Samples: 72601076. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:42:58,784][121949] Avg episode reward: [(0, '5764.732'), (1, '5487.312')] [2023-12-26 00:42:59,329][123091] Updated weights for policy 0, policy_version 142153 (0.0008) [2023-12-26 00:42:59,396][123091] Updated weights for policy 0, policy_version 142163 (0.0010) [2023-12-26 00:42:59,459][123091] Updated weights for policy 0, policy_version 142173 (0.0011) [2023-12-26 00:42:59,492][123090] Updated weights for policy 1, policy_version 141514 (0.0010) [2023-12-26 00:42:59,555][123090] Updated weights for policy 1, policy_version 141524 (0.0009) [2023-12-26 00:42:59,621][123090] Updated weights for policy 1, policy_version 141534 (0.0005) [2023-12-26 00:43:00,269][123091] Updated weights for policy 0, policy_version 142183 (0.0010) [2023-12-26 00:43:00,331][123091] Updated weights for policy 0, policy_version 142193 (0.0009) [2023-12-26 00:43:00,347][123090] Updated weights for policy 1, policy_version 141544 (0.0007) [2023-12-26 00:43:00,389][123091] Updated weights for policy 0, policy_version 142203 (0.0008) [2023-12-26 00:43:00,408][123090] Updated weights for policy 1, policy_version 141554 (0.0009) [2023-12-26 00:43:00,477][123090] Updated weights for policy 1, policy_version 141564 (0.0008) [2023-12-26 00:43:01,204][123091] Updated weights for policy 0, policy_version 142213 (0.0007) [2023-12-26 00:43:01,234][123090] Updated weights for policy 1, policy_version 141574 (0.0009) [2023-12-26 00:43:01,261][123091] Updated weights for policy 0, policy_version 142223 (0.0006) [2023-12-26 00:43:01,302][123090] Updated weights for policy 1, policy_version 141584 (0.0006) [2023-12-26 00:43:01,323][123091] Updated weights for policy 0, policy_version 142233 (0.0008) [2023-12-26 00:43:01,363][123090] Updated weights for policy 1, policy_version 141594 (0.0007) [2023-12-26 00:43:02,038][123091] Updated weights for policy 0, policy_version 142243 (0.0007) [2023-12-26 00:43:02,084][123090] Updated weights for policy 1, policy_version 141604 (0.0011) [2023-12-26 00:43:02,106][123091] Updated weights for policy 0, policy_version 142253 (0.0007) [2023-12-26 00:43:02,139][123090] Updated weights for policy 1, policy_version 141614 (0.0008) [2023-12-26 00:43:02,175][123091] Updated weights for policy 0, policy_version 142263 (0.0007) [2023-12-26 00:43:02,191][123090] Updated weights for policy 1, policy_version 141624 (0.0008) [2023-12-26 00:43:02,915][123091] Updated weights for policy 0, policy_version 142273 (0.0006) [2023-12-26 00:43:02,970][123090] Updated weights for policy 1, policy_version 141634 (0.0008) [2023-12-26 00:43:02,972][123091] Updated weights for policy 0, policy_version 142283 (0.0005) [2023-12-26 00:43:03,033][123091] Updated weights for policy 0, policy_version 142293 (0.0005) [2023-12-26 00:43:03,036][123090] Updated weights for policy 1, policy_version 141644 (0.0008) [2023-12-26 00:43:03,095][123090] Updated weights for policy 1, policy_version 141654 (0.0008) [2023-12-26 00:43:03,101][123091] Updated weights for policy 0, policy_version 142303 (0.0005) [2023-12-26 00:43:03,156][123090] Updated weights for policy 1, policy_version 141664 (0.0010) [2023-12-26 00:43:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 72695808. Throughput: 0: 8994.2, 1: 8774.5. Samples: 72711924. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:43:03,784][121949] Avg episode reward: [(0, '5736.777'), (1, '5626.616')] [2023-12-26 00:43:03,809][123091] Updated weights for policy 0, policy_version 142313 (0.0009) [2023-12-26 00:43:03,868][123091] Updated weights for policy 0, policy_version 142323 (0.0009) [2023-12-26 00:43:03,923][123091] Updated weights for policy 0, policy_version 142333 (0.0010) [2023-12-26 00:43:03,935][123090] Updated weights for policy 1, policy_version 141674 (0.0009) [2023-12-26 00:43:04,005][123090] Updated weights for policy 1, policy_version 141684 (0.0009) [2023-12-26 00:43:04,061][123090] Updated weights for policy 1, policy_version 141694 (0.0010) [2023-12-26 00:43:04,770][123091] Updated weights for policy 0, policy_version 142343 (0.0009) [2023-12-26 00:43:04,831][123091] Updated weights for policy 0, policy_version 142353 (0.0009) [2023-12-26 00:43:04,869][123090] Updated weights for policy 1, policy_version 141704 (0.0009) [2023-12-26 00:43:04,885][123091] Updated weights for policy 0, policy_version 142363 (0.0008) [2023-12-26 00:43:04,929][123090] Updated weights for policy 1, policy_version 141714 (0.0008) [2023-12-26 00:43:04,995][123090] Updated weights for policy 1, policy_version 141724 (0.0007) [2023-12-26 00:43:05,737][123091] Updated weights for policy 0, policy_version 142373 (0.0008) [2023-12-26 00:43:05,748][123090] Updated weights for policy 1, policy_version 141734 (0.0007) [2023-12-26 00:43:05,800][123091] Updated weights for policy 0, policy_version 142383 (0.0007) [2023-12-26 00:43:05,816][123090] Updated weights for policy 1, policy_version 141744 (0.0009) [2023-12-26 00:43:05,857][123091] Updated weights for policy 0, policy_version 142393 (0.0009) [2023-12-26 00:43:05,872][123090] Updated weights for policy 1, policy_version 141754 (0.0007) [2023-12-26 00:43:06,657][123091] Updated weights for policy 0, policy_version 142403 (0.0009) [2023-12-26 00:43:06,665][123090] Updated weights for policy 1, policy_version 141764 (0.0009) [2023-12-26 00:43:06,715][123090] Updated weights for policy 1, policy_version 141774 (0.0008) [2023-12-26 00:43:06,717][123091] Updated weights for policy 0, policy_version 142413 (0.0008) [2023-12-26 00:43:06,764][123090] Updated weights for policy 1, policy_version 141784 (0.0006) [2023-12-26 00:43:06,778][123091] Updated weights for policy 0, policy_version 142423 (0.0010) [2023-12-26 00:43:07,576][123090] Updated weights for policy 1, policy_version 141794 (0.0010) [2023-12-26 00:43:07,578][123091] Updated weights for policy 0, policy_version 142433 (0.0006) [2023-12-26 00:43:07,625][123090] Updated weights for policy 1, policy_version 141804 (0.0008) [2023-12-26 00:43:07,627][123091] Updated weights for policy 0, policy_version 142443 (0.0008) [2023-12-26 00:43:07,669][123090] Updated weights for policy 1, policy_version 141814 (0.0008) [2023-12-26 00:43:07,672][123091] Updated weights for policy 0, policy_version 142453 (0.0006) [2023-12-26 00:43:07,714][123090] Updated weights for policy 1, policy_version 141824 (0.0006) [2023-12-26 00:43:07,717][123091] Updated weights for policy 0, policy_version 142463 (0.0008) [2023-12-26 00:43:08,520][123091] Updated weights for policy 0, policy_version 142473 (0.0008) [2023-12-26 00:43:08,586][123091] Updated weights for policy 0, policy_version 142483 (0.0008) [2023-12-26 00:43:08,627][123090] Updated weights for policy 1, policy_version 141834 (0.0009) [2023-12-26 00:43:08,645][123091] Updated weights for policy 0, policy_version 142493 (0.0008) [2023-12-26 00:43:08,676][123090] Updated weights for policy 1, policy_version 141844 (0.0009) [2023-12-26 00:43:08,727][123090] Updated weights for policy 1, policy_version 141854 (0.0010) [2023-12-26 00:43:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17911.3). Total num frames: 72794112. Throughput: 0: 8989.4, 1: 8823.1. Samples: 72764780. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:43:08,785][121949] Avg episode reward: [(0, '5734.712'), (1, '5611.099')] [2023-12-26 00:43:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000142496_36478976.pth... [2023-12-26 00:43:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000141856_36315136.pth... [2023-12-26 00:43:08,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000141440_36208640.pth [2023-12-26 00:43:08,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000140800_36044800.pth [2023-12-26 00:43:09,428][123091] Updated weights for policy 0, policy_version 142503 (0.0008) [2023-12-26 00:43:09,497][123091] Updated weights for policy 0, policy_version 142513 (0.0006) [2023-12-26 00:43:09,567][123091] Updated weights for policy 0, policy_version 142523 (0.0007) [2023-12-26 00:43:09,599][123090] Updated weights for policy 1, policy_version 141864 (0.0008) [2023-12-26 00:43:09,658][123090] Updated weights for policy 1, policy_version 141874 (0.0009) [2023-12-26 00:43:09,716][123090] Updated weights for policy 1, policy_version 141884 (0.0009) [2023-12-26 00:43:10,303][123091] Updated weights for policy 0, policy_version 142533 (0.0006) [2023-12-26 00:43:10,371][123091] Updated weights for policy 0, policy_version 142543 (0.0009) [2023-12-26 00:43:10,427][123091] Updated weights for policy 0, policy_version 142553 (0.0009) [2023-12-26 00:43:10,530][123090] Updated weights for policy 1, policy_version 141894 (0.0010) [2023-12-26 00:43:10,592][123090] Updated weights for policy 1, policy_version 141904 (0.0009) [2023-12-26 00:43:10,649][123090] Updated weights for policy 1, policy_version 141914 (0.0010) [2023-12-26 00:43:11,227][123091] Updated weights for policy 0, policy_version 142563 (0.0009) [2023-12-26 00:43:11,289][123091] Updated weights for policy 0, policy_version 142573 (0.0008) [2023-12-26 00:43:11,349][123091] Updated weights for policy 0, policy_version 142583 (0.0005) [2023-12-26 00:43:11,558][123090] Updated weights for policy 1, policy_version 141924 (0.0009) [2023-12-26 00:43:11,631][123090] Updated weights for policy 1, policy_version 141934 (0.0009) [2023-12-26 00:43:11,708][123090] Updated weights for policy 1, policy_version 141944 (0.0009) [2023-12-26 00:43:12,132][123091] Updated weights for policy 0, policy_version 142593 (0.0007) [2023-12-26 00:43:12,193][123091] Updated weights for policy 0, policy_version 142603 (0.0009) [2023-12-26 00:43:12,258][123091] Updated weights for policy 0, policy_version 142613 (0.0009) [2023-12-26 00:43:12,327][123091] Updated weights for policy 0, policy_version 142623 (0.0008) [2023-12-26 00:43:12,509][123090] Updated weights for policy 1, policy_version 141954 (0.0006) [2023-12-26 00:43:12,580][123090] Updated weights for policy 1, policy_version 141964 (0.0005) [2023-12-26 00:43:12,645][123090] Updated weights for policy 1, policy_version 141974 (0.0005) [2023-12-26 00:43:12,698][123090] Updated weights for policy 1, policy_version 141984 (0.0007) [2023-12-26 00:43:13,154][123091] Updated weights for policy 0, policy_version 142633 (0.0008) [2023-12-26 00:43:13,205][123091] Updated weights for policy 0, policy_version 142643 (0.0010) [2023-12-26 00:43:13,269][123091] Updated weights for policy 0, policy_version 142653 (0.0010) [2023-12-26 00:43:13,457][123090] Updated weights for policy 1, policy_version 141994 (0.0005) [2023-12-26 00:43:13,515][123090] Updated weights for policy 1, policy_version 142004 (0.0005) [2023-12-26 00:43:13,580][123090] Updated weights for policy 1, policy_version 142014 (0.0005) [2023-12-26 00:43:13,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 72876032. Throughput: 0: 8969.8, 1: 8728.5. Samples: 72868196. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 00:43:13,785][121949] Avg episode reward: [(0, '5715.027'), (1, '5597.253')] [2023-12-26 00:43:14,017][123091] Updated weights for policy 0, policy_version 142663 (0.0007) [2023-12-26 00:43:14,074][123091] Updated weights for policy 0, policy_version 142673 (0.0005) [2023-12-26 00:43:14,129][123091] Updated weights for policy 0, policy_version 142683 (0.0006) [2023-12-26 00:43:14,178][123090] Updated weights for policy 1, policy_version 142024 (0.0008) [2023-12-26 00:43:14,244][123090] Updated weights for policy 1, policy_version 142034 (0.0009) [2023-12-26 00:43:14,318][123090] Updated weights for policy 1, policy_version 142044 (0.0010) [2023-12-26 00:43:14,894][123091] Updated weights for policy 0, policy_version 142693 (0.0007) [2023-12-26 00:43:14,950][123091] Updated weights for policy 0, policy_version 142703 (0.0010) [2023-12-26 00:43:15,000][123091] Updated weights for policy 0, policy_version 142713 (0.0009) [2023-12-26 00:43:15,127][123090] Updated weights for policy 1, policy_version 142054 (0.0009) [2023-12-26 00:43:15,189][123090] Updated weights for policy 1, policy_version 142064 (0.0009) [2023-12-26 00:43:15,256][123090] Updated weights for policy 1, policy_version 142074 (0.0009) [2023-12-26 00:43:15,746][123091] Updated weights for policy 0, policy_version 142723 (0.0010) [2023-12-26 00:43:15,812][123091] Updated weights for policy 0, policy_version 142733 (0.0006) [2023-12-26 00:43:15,879][123091] Updated weights for policy 0, policy_version 142743 (0.0011) [2023-12-26 00:43:16,189][123090] Updated weights for policy 1, policy_version 142084 (0.0010) [2023-12-26 00:43:16,246][123090] Updated weights for policy 1, policy_version 142094 (0.0010) [2023-12-26 00:43:16,309][123090] Updated weights for policy 1, policy_version 142104 (0.0009) [2023-12-26 00:43:16,552][123091] Updated weights for policy 0, policy_version 142753 (0.0006) [2023-12-26 00:43:16,600][123091] Updated weights for policy 0, policy_version 142763 (0.0011) [2023-12-26 00:43:16,651][123091] Updated weights for policy 0, policy_version 142773 (0.0010) [2023-12-26 00:43:16,698][123091] Updated weights for policy 0, policy_version 142783 (0.0010) [2023-12-26 00:43:17,180][123090] Updated weights for policy 1, policy_version 142114 (0.0010) [2023-12-26 00:43:17,236][123090] Updated weights for policy 1, policy_version 142124 (0.0008) [2023-12-26 00:43:17,295][123090] Updated weights for policy 1, policy_version 142134 (0.0010) [2023-12-26 00:43:17,522][123091] Updated weights for policy 0, policy_version 142793 (0.0010) [2023-12-26 00:43:17,575][123091] Updated weights for policy 0, policy_version 142803 (0.0009) [2023-12-26 00:43:17,629][123091] Updated weights for policy 0, policy_version 142813 (0.0009) [2023-12-26 00:43:18,152][123090] Updated weights for policy 1, policy_version 142145 (0.0010) [2023-12-26 00:43:18,213][123090] Updated weights for policy 1, policy_version 142155 (0.0009) [2023-12-26 00:43:18,272][123090] Updated weights for policy 1, policy_version 142165 (0.0008) [2023-12-26 00:43:18,333][123090] Updated weights for policy 1, policy_version 142175 (0.0009) [2023-12-26 00:43:18,483][123091] Updated weights for policy 0, policy_version 142823 (0.0009) [2023-12-26 00:43:18,535][123091] Updated weights for policy 0, policy_version 142833 (0.0010) [2023-12-26 00:43:18,585][123091] Updated weights for policy 0, policy_version 142843 (0.0010) [2023-12-26 00:43:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.2, 300 sec: 17883.5). Total num frames: 72966144. Throughput: 0: 8943.9, 1: 8760.8. Samples: 72974704. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:18,786][121949] Avg episode reward: [(0, '5624.208'), (1, '5559.621')] [2023-12-26 00:43:19,230][123090] Updated weights for policy 1, policy_version 142185 (0.0010) [2023-12-26 00:43:19,300][123090] Updated weights for policy 1, policy_version 142195 (0.0009) [2023-12-26 00:43:19,369][123090] Updated weights for policy 1, policy_version 142205 (0.0008) [2023-12-26 00:43:19,385][123091] Updated weights for policy 0, policy_version 142853 (0.0008) [2023-12-26 00:43:19,439][123091] Updated weights for policy 0, policy_version 142863 (0.0010) [2023-12-26 00:43:19,505][123091] Updated weights for policy 0, policy_version 142873 (0.0010) [2023-12-26 00:43:20,200][123090] Updated weights for policy 1, policy_version 142215 (0.0009) [2023-12-26 00:43:20,260][123090] Updated weights for policy 1, policy_version 142225 (0.0009) [2023-12-26 00:43:20,312][123090] Updated weights for policy 1, policy_version 142235 (0.0010) [2023-12-26 00:43:20,356][123091] Updated weights for policy 0, policy_version 142883 (0.0009) [2023-12-26 00:43:20,419][123091] Updated weights for policy 0, policy_version 142893 (0.0010) [2023-12-26 00:43:20,484][123091] Updated weights for policy 0, policy_version 142903 (0.0009) [2023-12-26 00:43:21,190][123090] Updated weights for policy 1, policy_version 142245 (0.0010) [2023-12-26 00:43:21,256][123090] Updated weights for policy 1, policy_version 142255 (0.0009) [2023-12-26 00:43:21,321][123091] Updated weights for policy 0, policy_version 142913 (0.0010) [2023-12-26 00:43:21,323][123090] Updated weights for policy 1, policy_version 142265 (0.0008) [2023-12-26 00:43:21,387][123091] Updated weights for policy 0, policy_version 142923 (0.0008) [2023-12-26 00:43:21,445][123091] Updated weights for policy 0, policy_version 142933 (0.0010) [2023-12-26 00:43:21,494][123091] Updated weights for policy 0, policy_version 142943 (0.0009) [2023-12-26 00:43:22,184][123090] Updated weights for policy 1, policy_version 142275 (0.0008) [2023-12-26 00:43:22,238][123090] Updated weights for policy 1, policy_version 142285 (0.0006) [2023-12-26 00:43:22,305][123090] Updated weights for policy 1, policy_version 142295 (0.0009) [2023-12-26 00:43:22,394][123091] Updated weights for policy 0, policy_version 142953 (0.0009) [2023-12-26 00:43:22,453][123091] Updated weights for policy 0, policy_version 142963 (0.0010) [2023-12-26 00:43:22,507][123091] Updated weights for policy 0, policy_version 142973 (0.0009) [2023-12-26 00:43:23,070][123090] Updated weights for policy 1, policy_version 142305 (0.0009) [2023-12-26 00:43:23,124][123090] Updated weights for policy 1, policy_version 142315 (0.0009) [2023-12-26 00:43:23,172][123090] Updated weights for policy 1, policy_version 142325 (0.0009) [2023-12-26 00:43:23,225][123090] Updated weights for policy 1, policy_version 142335 (0.0010) [2023-12-26 00:43:23,337][123091] Updated weights for policy 0, policy_version 142983 (0.0009) [2023-12-26 00:43:23,397][123091] Updated weights for policy 0, policy_version 142993 (0.0010) [2023-12-26 00:43:23,450][123091] Updated weights for policy 0, policy_version 143003 (0.0010) [2023-12-26 00:43:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 73048064. Throughput: 0: 8896.7, 1: 8739.1. Samples: 73024732. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:23,785][121949] Avg episode reward: [(0, '5627.670'), (1, '5514.889')] [2023-12-26 00:43:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000143008_36610048.pth... [2023-12-26 00:43:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000142336_36438016.pth... [2023-12-26 00:43:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000141952_36339712.pth [2023-12-26 00:43:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000141312_36175872.pth [2023-12-26 00:43:24,078][123090] Updated weights for policy 1, policy_version 142345 (0.0009) [2023-12-26 00:43:24,141][123090] Updated weights for policy 1, policy_version 142355 (0.0010) [2023-12-26 00:43:24,202][123090] Updated weights for policy 1, policy_version 142365 (0.0009) [2023-12-26 00:43:24,297][123091] Updated weights for policy 0, policy_version 143013 (0.0010) [2023-12-26 00:43:24,358][123091] Updated weights for policy 0, policy_version 143023 (0.0010) [2023-12-26 00:43:24,416][123091] Updated weights for policy 0, policy_version 143033 (0.0010) [2023-12-26 00:43:25,054][123090] Updated weights for policy 1, policy_version 142375 (0.0009) [2023-12-26 00:43:25,120][123090] Updated weights for policy 1, policy_version 142385 (0.0009) [2023-12-26 00:43:25,183][123090] Updated weights for policy 1, policy_version 142395 (0.0009) [2023-12-26 00:43:25,233][123091] Updated weights for policy 0, policy_version 143043 (0.0009) [2023-12-26 00:43:25,283][123091] Updated weights for policy 0, policy_version 143053 (0.0009) [2023-12-26 00:43:25,340][123091] Updated weights for policy 0, policy_version 143064 (0.0009) [2023-12-26 00:43:26,003][123090] Updated weights for policy 1, policy_version 142405 (0.0008) [2023-12-26 00:43:26,056][123090] Updated weights for policy 1, policy_version 142415 (0.0005) [2023-12-26 00:43:26,113][123090] Updated weights for policy 1, policy_version 142425 (0.0008) [2023-12-26 00:43:26,158][123091] Updated weights for policy 0, policy_version 143074 (0.0009) [2023-12-26 00:43:26,223][123091] Updated weights for policy 0, policy_version 143084 (0.0010) [2023-12-26 00:43:26,287][123091] Updated weights for policy 0, policy_version 143094 (0.0009) [2023-12-26 00:43:26,354][123091] Updated weights for policy 0, policy_version 143104 (0.0009) [2023-12-26 00:43:26,912][123090] Updated weights for policy 1, policy_version 142435 (0.0009) [2023-12-26 00:43:26,975][123090] Updated weights for policy 1, policy_version 142445 (0.0009) [2023-12-26 00:43:27,031][123090] Updated weights for policy 1, policy_version 142455 (0.0005) [2023-12-26 00:43:27,176][123091] Updated weights for policy 0, policy_version 143114 (0.0010) [2023-12-26 00:43:27,230][123091] Updated weights for policy 0, policy_version 143125 (0.0010) [2023-12-26 00:43:27,284][123091] Updated weights for policy 0, policy_version 143135 (0.0010) [2023-12-26 00:43:27,715][123090] Updated weights for policy 1, policy_version 142465 (0.0006) [2023-12-26 00:43:27,778][123090] Updated weights for policy 1, policy_version 142475 (0.0009) [2023-12-26 00:43:27,833][123090] Updated weights for policy 1, policy_version 142485 (0.0009) [2023-12-26 00:43:27,881][123090] Updated weights for policy 1, policy_version 142495 (0.0009) [2023-12-26 00:43:28,116][123091] Updated weights for policy 0, policy_version 143145 (0.0009) [2023-12-26 00:43:28,193][123091] Updated weights for policy 0, policy_version 143155 (0.0009) [2023-12-26 00:43:28,244][123091] Updated weights for policy 0, policy_version 143165 (0.0009) [2023-12-26 00:43:28,698][123090] Updated weights for policy 1, policy_version 142505 (0.0006) [2023-12-26 00:43:28,770][123090] Updated weights for policy 1, policy_version 142515 (0.0005) [2023-12-26 00:43:28,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 73129984. Throughput: 0: 8833.3, 1: 8793.9. Samples: 73128416. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:28,785][121949] Avg episode reward: [(0, '5727.341'), (1, '5512.884')] [2023-12-26 00:43:28,825][123090] Updated weights for policy 1, policy_version 142525 (0.0006) [2023-12-26 00:43:29,139][123091] Updated weights for policy 0, policy_version 143175 (0.0009) [2023-12-26 00:43:29,206][123091] Updated weights for policy 0, policy_version 143185 (0.0009) [2023-12-26 00:43:29,264][123091] Updated weights for policy 0, policy_version 143195 (0.0009) [2023-12-26 00:43:29,515][123090] Updated weights for policy 1, policy_version 142535 (0.0009) [2023-12-26 00:43:29,584][123090] Updated weights for policy 1, policy_version 142545 (0.0009) [2023-12-26 00:43:29,647][123090] Updated weights for policy 1, policy_version 142555 (0.0010) [2023-12-26 00:43:30,070][123091] Updated weights for policy 0, policy_version 143205 (0.0009) [2023-12-26 00:43:30,120][123091] Updated weights for policy 0, policy_version 143215 (0.0010) [2023-12-26 00:43:30,169][123091] Updated weights for policy 0, policy_version 143225 (0.0009) [2023-12-26 00:43:30,473][123090] Updated weights for policy 1, policy_version 142565 (0.0007) [2023-12-26 00:43:30,540][123090] Updated weights for policy 1, policy_version 142575 (0.0009) [2023-12-26 00:43:30,602][123090] Updated weights for policy 1, policy_version 142585 (0.0009) [2023-12-26 00:43:30,941][123091] Updated weights for policy 0, policy_version 143235 (0.0008) [2023-12-26 00:43:30,999][123091] Updated weights for policy 0, policy_version 143245 (0.0005) [2023-12-26 00:43:31,070][123091] Updated weights for policy 0, policy_version 143255 (0.0007) [2023-12-26 00:43:31,361][123090] Updated weights for policy 1, policy_version 142595 (0.0008) [2023-12-26 00:43:31,427][123090] Updated weights for policy 1, policy_version 142605 (0.0008) [2023-12-26 00:43:31,494][123090] Updated weights for policy 1, policy_version 142615 (0.0008) [2023-12-26 00:43:31,893][123091] Updated weights for policy 0, policy_version 143265 (0.0009) [2023-12-26 00:43:31,941][123091] Updated weights for policy 0, policy_version 143275 (0.0010) [2023-12-26 00:43:32,011][123091] Updated weights for policy 0, policy_version 143285 (0.0011) [2023-12-26 00:43:32,078][123091] Updated weights for policy 0, policy_version 143295 (0.0011) [2023-12-26 00:43:32,289][123090] Updated weights for policy 1, policy_version 142625 (0.0008) [2023-12-26 00:43:32,354][123090] Updated weights for policy 1, policy_version 142635 (0.0009) [2023-12-26 00:43:32,410][123090] Updated weights for policy 1, policy_version 142645 (0.0006) [2023-12-26 00:43:32,472][123090] Updated weights for policy 1, policy_version 142655 (0.0007) [2023-12-26 00:43:32,894][123091] Updated weights for policy 0, policy_version 143305 (0.0010) [2023-12-26 00:43:32,949][123091] Updated weights for policy 0, policy_version 143315 (0.0010) [2023-12-26 00:43:32,995][123091] Updated weights for policy 0, policy_version 143325 (0.0010) [2023-12-26 00:43:33,225][123090] Updated weights for policy 1, policy_version 142665 (0.0008) [2023-12-26 00:43:33,287][123090] Updated weights for policy 1, policy_version 142675 (0.0009) [2023-12-26 00:43:33,363][123090] Updated weights for policy 1, policy_version 142685 (0.0005) [2023-12-26 00:43:33,752][123091] Updated weights for policy 0, policy_version 143335 (0.0008) [2023-12-26 00:43:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 73220096. Throughput: 0: 8871.4, 1: 8826.4. Samples: 73235952. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:33,784][121949] Avg episode reward: [(0, '5664.169'), (1, '5396.430')] [2023-12-26 00:43:33,802][123091] Updated weights for policy 0, policy_version 143345 (0.0010) [2023-12-26 00:43:33,852][123091] Updated weights for policy 0, policy_version 143356 (0.0008) [2023-12-26 00:43:34,057][123090] Updated weights for policy 1, policy_version 142695 (0.0006) [2023-12-26 00:43:34,111][123090] Updated weights for policy 1, policy_version 142705 (0.0005) [2023-12-26 00:43:34,173][123090] Updated weights for policy 1, policy_version 142715 (0.0007) [2023-12-26 00:43:34,632][123091] Updated weights for policy 0, policy_version 143366 (0.0008) [2023-12-26 00:43:34,696][123091] Updated weights for policy 0, policy_version 143376 (0.0010) [2023-12-26 00:43:34,757][123091] Updated weights for policy 0, policy_version 143386 (0.0010) [2023-12-26 00:43:34,923][123090] Updated weights for policy 1, policy_version 142725 (0.0008) [2023-12-26 00:43:34,991][123090] Updated weights for policy 1, policy_version 142735 (0.0008) [2023-12-26 00:43:35,047][123090] Updated weights for policy 1, policy_version 142745 (0.0009) [2023-12-26 00:43:35,532][123091] Updated weights for policy 0, policy_version 143396 (0.0010) [2023-12-26 00:43:35,580][123091] Updated weights for policy 0, policy_version 143406 (0.0009) [2023-12-26 00:43:35,632][123091] Updated weights for policy 0, policy_version 143416 (0.0005) [2023-12-26 00:43:35,692][123090] Updated weights for policy 1, policy_version 142755 (0.0008) [2023-12-26 00:43:35,763][123090] Updated weights for policy 1, policy_version 142765 (0.0009) [2023-12-26 00:43:35,822][123090] Updated weights for policy 1, policy_version 142775 (0.0010) [2023-12-26 00:43:36,462][123091] Updated weights for policy 0, policy_version 143426 (0.0009) [2023-12-26 00:43:36,529][123091] Updated weights for policy 0, policy_version 143436 (0.0009) [2023-12-26 00:43:36,598][123091] Updated weights for policy 0, policy_version 143446 (0.0007) [2023-12-26 00:43:36,637][123090] Updated weights for policy 1, policy_version 142785 (0.0009) [2023-12-26 00:43:36,656][123091] Updated weights for policy 0, policy_version 143456 (0.0008) [2023-12-26 00:43:36,703][123090] Updated weights for policy 1, policy_version 142795 (0.0005) [2023-12-26 00:43:36,774][123090] Updated weights for policy 1, policy_version 142805 (0.0006) [2023-12-26 00:43:36,843][123090] Updated weights for policy 1, policy_version 142815 (0.0006) [2023-12-26 00:43:37,471][123091] Updated weights for policy 0, policy_version 143466 (0.0010) [2023-12-26 00:43:37,495][123090] Updated weights for policy 1, policy_version 142825 (0.0005) [2023-12-26 00:43:37,526][123091] Updated weights for policy 0, policy_version 143476 (0.0008) [2023-12-26 00:43:37,552][123090] Updated weights for policy 1, policy_version 142835 (0.0005) [2023-12-26 00:43:37,578][123091] Updated weights for policy 0, policy_version 143486 (0.0008) [2023-12-26 00:43:37,613][123090] Updated weights for policy 1, policy_version 142845 (0.0009) [2023-12-26 00:43:38,230][123091] Updated weights for policy 0, policy_version 143496 (0.0008) [2023-12-26 00:43:38,285][123091] Updated weights for policy 0, policy_version 143506 (0.0010) [2023-12-26 00:43:38,342][123091] Updated weights for policy 0, policy_version 143516 (0.0011) [2023-12-26 00:43:38,386][123090] Updated weights for policy 1, policy_version 142855 (0.0007) [2023-12-26 00:43:38,447][123090] Updated weights for policy 1, policy_version 142865 (0.0007) [2023-12-26 00:43:38,504][123090] Updated weights for policy 1, policy_version 142876 (0.0009) [2023-12-26 00:43:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 73318400. Throughput: 0: 8889.5, 1: 8870.5. Samples: 73290808. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:38,785][121949] Avg episode reward: [(0, '5687.831'), (1, '5276.998')] [2023-12-26 00:43:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000143520_36741120.pth... [2023-12-26 00:43:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000142880_36577280.pth... [2023-12-26 00:43:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000141856_36315136.pth [2023-12-26 00:43:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000142496_36478976.pth [2023-12-26 00:43:39,076][123091] Updated weights for policy 0, policy_version 143526 (0.0008) [2023-12-26 00:43:39,138][123091] Updated weights for policy 0, policy_version 143536 (0.0006) [2023-12-26 00:43:39,189][123091] Updated weights for policy 0, policy_version 143546 (0.0007) [2023-12-26 00:43:39,336][123090] Updated weights for policy 1, policy_version 142886 (0.0008) [2023-12-26 00:43:39,414][123090] Updated weights for policy 1, policy_version 142896 (0.0008) [2023-12-26 00:43:39,483][123090] Updated weights for policy 1, policy_version 142906 (0.0008) [2023-12-26 00:43:39,995][123091] Updated weights for policy 0, policy_version 143556 (0.0008) [2023-12-26 00:43:40,071][123091] Updated weights for policy 0, policy_version 143566 (0.0010) [2023-12-26 00:43:40,143][123091] Updated weights for policy 0, policy_version 143576 (0.0011) [2023-12-26 00:43:40,274][123090] Updated weights for policy 1, policy_version 142916 (0.0007) [2023-12-26 00:43:40,346][123090] Updated weights for policy 1, policy_version 142926 (0.0009) [2023-12-26 00:43:40,413][123090] Updated weights for policy 1, policy_version 142936 (0.0009) [2023-12-26 00:43:40,957][123091] Updated weights for policy 0, policy_version 143586 (0.0010) [2023-12-26 00:43:41,026][123091] Updated weights for policy 0, policy_version 143596 (0.0009) [2023-12-26 00:43:41,097][123091] Updated weights for policy 0, policy_version 143606 (0.0010) [2023-12-26 00:43:41,165][123091] Updated weights for policy 0, policy_version 143616 (0.0008) [2023-12-26 00:43:41,240][123090] Updated weights for policy 1, policy_version 142946 (0.0009) [2023-12-26 00:43:41,310][123090] Updated weights for policy 1, policy_version 142956 (0.0009) [2023-12-26 00:43:41,383][123090] Updated weights for policy 1, policy_version 142966 (0.0009) [2023-12-26 00:43:41,451][123090] Updated weights for policy 1, policy_version 142976 (0.0010) [2023-12-26 00:43:41,979][123091] Updated weights for policy 0, policy_version 143626 (0.0007) [2023-12-26 00:43:42,046][123091] Updated weights for policy 0, policy_version 143636 (0.0005) [2023-12-26 00:43:42,112][123091] Updated weights for policy 0, policy_version 143646 (0.0005) [2023-12-26 00:43:42,393][123090] Updated weights for policy 1, policy_version 142986 (0.0008) [2023-12-26 00:43:42,463][123090] Updated weights for policy 1, policy_version 142996 (0.0006) [2023-12-26 00:43:42,535][123090] Updated weights for policy 1, policy_version 143006 (0.0006) [2023-12-26 00:43:42,801][123091] Updated weights for policy 0, policy_version 143656 (0.0007) [2023-12-26 00:43:42,857][123091] Updated weights for policy 0, policy_version 143666 (0.0011) [2023-12-26 00:43:42,909][123091] Updated weights for policy 0, policy_version 143676 (0.0010) [2023-12-26 00:43:43,314][123090] Updated weights for policy 1, policy_version 143016 (0.0008) [2023-12-26 00:43:43,361][123090] Updated weights for policy 1, policy_version 143026 (0.0007) [2023-12-26 00:43:43,417][123090] Updated weights for policy 1, policy_version 143036 (0.0005) [2023-12-26 00:43:43,725][123091] Updated weights for policy 0, policy_version 143686 (0.0010) [2023-12-26 00:43:43,773][123091] Updated weights for policy 0, policy_version 143696 (0.0010) [2023-12-26 00:43:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 73400320. Throughput: 0: 8870.6, 1: 8808.0. Samples: 73396616. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:43,785][121949] Avg episode reward: [(0, '5674.698'), (1, '5326.627')] [2023-12-26 00:43:43,827][123091] Updated weights for policy 0, policy_version 143706 (0.0010) [2023-12-26 00:43:44,128][123090] Updated weights for policy 1, policy_version 143046 (0.0008) [2023-12-26 00:43:44,194][123090] Updated weights for policy 1, policy_version 143056 (0.0010) [2023-12-26 00:43:44,261][123090] Updated weights for policy 1, policy_version 143066 (0.0009) [2023-12-26 00:43:44,686][123091] Updated weights for policy 0, policy_version 143716 (0.0010) [2023-12-26 00:43:44,750][123091] Updated weights for policy 0, policy_version 143726 (0.0011) [2023-12-26 00:43:44,818][123091] Updated weights for policy 0, policy_version 143736 (0.0010) [2023-12-26 00:43:45,070][123090] Updated weights for policy 1, policy_version 143076 (0.0009) [2023-12-26 00:43:45,130][123090] Updated weights for policy 1, policy_version 143086 (0.0011) [2023-12-26 00:43:45,194][123090] Updated weights for policy 1, policy_version 143096 (0.0011) [2023-12-26 00:43:45,653][123091] Updated weights for policy 0, policy_version 143746 (0.0011) [2023-12-26 00:43:45,705][123091] Updated weights for policy 0, policy_version 143756 (0.0011) [2023-12-26 00:43:45,757][123091] Updated weights for policy 0, policy_version 143766 (0.0008) [2023-12-26 00:43:45,809][123091] Updated weights for policy 0, policy_version 143776 (0.0011) [2023-12-26 00:43:46,025][123090] Updated weights for policy 1, policy_version 143106 (0.0011) [2023-12-26 00:43:46,076][123090] Updated weights for policy 1, policy_version 143116 (0.0010) [2023-12-26 00:43:46,123][123090] Updated weights for policy 1, policy_version 143126 (0.0010) [2023-12-26 00:43:46,170][123090] Updated weights for policy 1, policy_version 143136 (0.0010) [2023-12-26 00:43:46,661][123091] Updated weights for policy 0, policy_version 143786 (0.0011) [2023-12-26 00:43:46,734][123091] Updated weights for policy 0, policy_version 143796 (0.0011) [2023-12-26 00:43:46,803][123091] Updated weights for policy 0, policy_version 143806 (0.0011) [2023-12-26 00:43:47,017][123090] Updated weights for policy 1, policy_version 143146 (0.0011) [2023-12-26 00:43:47,088][123090] Updated weights for policy 1, policy_version 143156 (0.0011) [2023-12-26 00:43:47,157][123090] Updated weights for policy 1, policy_version 143166 (0.0010) [2023-12-26 00:43:47,599][123091] Updated weights for policy 0, policy_version 143816 (0.0011) [2023-12-26 00:43:47,643][123091] Updated weights for policy 0, policy_version 143826 (0.0010) [2023-12-26 00:43:47,713][123091] Updated weights for policy 0, policy_version 143836 (0.0011) [2023-12-26 00:43:47,910][123090] Updated weights for policy 1, policy_version 143176 (0.0006) [2023-12-26 00:43:47,970][123090] Updated weights for policy 1, policy_version 143186 (0.0005) [2023-12-26 00:43:48,033][123090] Updated weights for policy 1, policy_version 143196 (0.0005) [2023-12-26 00:43:48,570][123091] Updated weights for policy 0, policy_version 143846 (0.0010) [2023-12-26 00:43:48,634][123091] Updated weights for policy 0, policy_version 143856 (0.0009) [2023-12-26 00:43:48,692][123090] Updated weights for policy 1, policy_version 143206 (0.0005) [2023-12-26 00:43:48,701][123091] Updated weights for policy 0, policy_version 143866 (0.0008) [2023-12-26 00:43:48,754][123090] Updated weights for policy 1, policy_version 143216 (0.0010) [2023-12-26 00:43:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 73490432. Throughput: 0: 8772.5, 1: 8786.7. Samples: 73502092. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:48,785][121949] Avg episode reward: [(0, '5640.247'), (1, '5476.116')] [2023-12-26 00:43:48,810][123090] Updated weights for policy 1, policy_version 143226 (0.0011) [2023-12-26 00:43:49,579][123090] Updated weights for policy 1, policy_version 143236 (0.0009) [2023-12-26 00:43:49,581][123091] Updated weights for policy 0, policy_version 143876 (0.0010) [2023-12-26 00:43:49,640][123091] Updated weights for policy 0, policy_version 143886 (0.0009) [2023-12-26 00:43:49,646][123090] Updated weights for policy 1, policy_version 143246 (0.0007) [2023-12-26 00:43:49,699][123091] Updated weights for policy 0, policy_version 143896 (0.0009) [2023-12-26 00:43:49,709][123090] Updated weights for policy 1, policy_version 143256 (0.0006) [2023-12-26 00:43:50,440][123090] Updated weights for policy 1, policy_version 143266 (0.0007) [2023-12-26 00:43:50,499][123090] Updated weights for policy 1, policy_version 143276 (0.0011) [2023-12-26 00:43:50,550][123090] Updated weights for policy 1, policy_version 143286 (0.0010) [2023-12-26 00:43:50,584][123091] Updated weights for policy 0, policy_version 143906 (0.0008) [2023-12-26 00:43:50,612][123090] Updated weights for policy 1, policy_version 143296 (0.0011) [2023-12-26 00:43:50,643][123091] Updated weights for policy 0, policy_version 143916 (0.0009) [2023-12-26 00:43:50,700][123091] Updated weights for policy 0, policy_version 143927 (0.0009) [2023-12-26 00:43:51,488][123090] Updated weights for policy 1, policy_version 143306 (0.0011) [2023-12-26 00:43:51,528][123091] Updated weights for policy 0, policy_version 143937 (0.0007) [2023-12-26 00:43:51,544][123090] Updated weights for policy 1, policy_version 143316 (0.0010) [2023-12-26 00:43:51,587][123091] Updated weights for policy 0, policy_version 143947 (0.0008) [2023-12-26 00:43:51,594][123090] Updated weights for policy 1, policy_version 143326 (0.0010) [2023-12-26 00:43:51,658][123091] Updated weights for policy 0, policy_version 143957 (0.0009) [2023-12-26 00:43:51,730][123091] Updated weights for policy 0, policy_version 143967 (0.0009) [2023-12-26 00:43:52,471][123090] Updated weights for policy 1, policy_version 143336 (0.0010) [2023-12-26 00:43:52,523][123090] Updated weights for policy 1, policy_version 143346 (0.0010) [2023-12-26 00:43:52,568][123091] Updated weights for policy 0, policy_version 143977 (0.0008) [2023-12-26 00:43:52,579][123090] Updated weights for policy 1, policy_version 143356 (0.0007) [2023-12-26 00:43:52,631][123091] Updated weights for policy 0, policy_version 143987 (0.0007) [2023-12-26 00:43:52,696][123091] Updated weights for policy 0, policy_version 143997 (0.0008) [2023-12-26 00:43:53,325][123090] Updated weights for policy 1, policy_version 143366 (0.0007) [2023-12-26 00:43:53,379][123091] Updated weights for policy 0, policy_version 144007 (0.0007) [2023-12-26 00:43:53,382][123090] Updated weights for policy 1, policy_version 143376 (0.0005) [2023-12-26 00:43:53,439][123090] Updated weights for policy 1, policy_version 143386 (0.0005) [2023-12-26 00:43:53,441][123091] Updated weights for policy 0, policy_version 144017 (0.0006) [2023-12-26 00:43:53,503][123091] Updated weights for policy 0, policy_version 144027 (0.0006) [2023-12-26 00:43:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 73580544. Throughput: 0: 8755.1, 1: 8765.0. Samples: 73553184. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:53,785][121949] Avg episode reward: [(0, '5627.747'), (1, '5430.270')] [2023-12-26 00:43:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000144032_36872192.pth... [2023-12-26 00:43:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000143392_36708352.pth... [2023-12-26 00:43:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000142336_36438016.pth [2023-12-26 00:43:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000143008_36610048.pth [2023-12-26 00:43:54,119][123090] Updated weights for policy 1, policy_version 143396 (0.0008) [2023-12-26 00:43:54,185][123090] Updated weights for policy 1, policy_version 143406 (0.0010) [2023-12-26 00:43:54,244][123090] Updated weights for policy 1, policy_version 143416 (0.0010) [2023-12-26 00:43:54,289][123091] Updated weights for policy 0, policy_version 144037 (0.0005) [2023-12-26 00:43:54,349][123091] Updated weights for policy 0, policy_version 144047 (0.0008) [2023-12-26 00:43:54,410][123091] Updated weights for policy 0, policy_version 144057 (0.0009) [2023-12-26 00:43:55,087][123090] Updated weights for policy 1, policy_version 143426 (0.0010) [2023-12-26 00:43:55,141][123090] Updated weights for policy 1, policy_version 143436 (0.0009) [2023-12-26 00:43:55,178][123091] Updated weights for policy 0, policy_version 144067 (0.0008) [2023-12-26 00:43:55,198][123090] Updated weights for policy 1, policy_version 143446 (0.0008) [2023-12-26 00:43:55,231][123091] Updated weights for policy 0, policy_version 144077 (0.0006) [2023-12-26 00:43:55,266][123090] Updated weights for policy 1, policy_version 143456 (0.0009) [2023-12-26 00:43:55,283][123091] Updated weights for policy 0, policy_version 144087 (0.0005) [2023-12-26 00:43:56,045][123091] Updated weights for policy 0, policy_version 144097 (0.0006) [2023-12-26 00:43:56,098][123090] Updated weights for policy 1, policy_version 143466 (0.0010) [2023-12-26 00:43:56,104][123091] Updated weights for policy 0, policy_version 144107 (0.0009) [2023-12-26 00:43:56,150][123090] Updated weights for policy 1, policy_version 143476 (0.0008) [2023-12-26 00:43:56,165][123091] Updated weights for policy 0, policy_version 144117 (0.0007) [2023-12-26 00:43:56,213][123090] Updated weights for policy 1, policy_version 143486 (0.0007) [2023-12-26 00:43:56,220][123091] Updated weights for policy 0, policy_version 144127 (0.0009) [2023-12-26 00:43:56,999][123090] Updated weights for policy 1, policy_version 143496 (0.0009) [2023-12-26 00:43:57,054][123091] Updated weights for policy 0, policy_version 144137 (0.0007) [2023-12-26 00:43:57,059][123090] Updated weights for policy 1, policy_version 143506 (0.0009) [2023-12-26 00:43:57,103][123091] Updated weights for policy 0, policy_version 144147 (0.0007) [2023-12-26 00:43:57,116][123090] Updated weights for policy 1, policy_version 143516 (0.0007) [2023-12-26 00:43:57,153][123091] Updated weights for policy 0, policy_version 144157 (0.0010) [2023-12-26 00:43:57,904][123090] Updated weights for policy 1, policy_version 143526 (0.0005) [2023-12-26 00:43:57,966][123090] Updated weights for policy 1, policy_version 143536 (0.0007) [2023-12-26 00:43:57,993][123091] Updated weights for policy 0, policy_version 144167 (0.0009) [2023-12-26 00:43:58,036][123090] Updated weights for policy 1, policy_version 143546 (0.0008) [2023-12-26 00:43:58,053][123091] Updated weights for policy 0, policy_version 144177 (0.0008) [2023-12-26 00:43:58,124][123091] Updated weights for policy 0, policy_version 144187 (0.0010) [2023-12-26 00:43:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 73662464. Throughput: 0: 8778.0, 1: 8836.9. Samples: 73660864. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:43:58,785][121949] Avg episode reward: [(0, '5679.271'), (1, '5223.990')] [2023-12-26 00:43:58,830][123090] Updated weights for policy 1, policy_version 143556 (0.0009) [2023-12-26 00:43:58,893][123090] Updated weights for policy 1, policy_version 143566 (0.0010) [2023-12-26 00:43:58,961][123090] Updated weights for policy 1, policy_version 143576 (0.0007) [2023-12-26 00:43:58,964][123091] Updated weights for policy 0, policy_version 144197 (0.0009) [2023-12-26 00:43:59,015][123091] Updated weights for policy 0, policy_version 144207 (0.0007) [2023-12-26 00:43:59,075][123091] Updated weights for policy 0, policy_version 144217 (0.0005) [2023-12-26 00:43:59,686][123090] Updated weights for policy 1, policy_version 143586 (0.0007) [2023-12-26 00:43:59,748][123090] Updated weights for policy 1, policy_version 143596 (0.0010) [2023-12-26 00:43:59,815][123090] Updated weights for policy 1, policy_version 143606 (0.0011) [2023-12-26 00:43:59,856][123091] Updated weights for policy 0, policy_version 144227 (0.0006) [2023-12-26 00:43:59,885][123090] Updated weights for policy 1, policy_version 143616 (0.0010) [2023-12-26 00:43:59,918][123091] Updated weights for policy 0, policy_version 144237 (0.0011) [2023-12-26 00:43:59,962][123091] Updated weights for policy 0, policy_version 144247 (0.0010) [2023-12-26 00:44:00,588][123090] Updated weights for policy 1, policy_version 143626 (0.0006) [2023-12-26 00:44:00,639][123090] Updated weights for policy 1, policy_version 143636 (0.0005) [2023-12-26 00:44:00,693][123090] Updated weights for policy 1, policy_version 143646 (0.0005) [2023-12-26 00:44:00,732][123091] Updated weights for policy 0, policy_version 144257 (0.0010) [2023-12-26 00:44:00,790][123091] Updated weights for policy 0, policy_version 144267 (0.0009) [2023-12-26 00:44:00,842][123091] Updated weights for policy 0, policy_version 144277 (0.0009) [2023-12-26 00:44:00,894][123091] Updated weights for policy 0, policy_version 144288 (0.0009) [2023-12-26 00:44:01,382][123090] Updated weights for policy 1, policy_version 143656 (0.0009) [2023-12-26 00:44:01,448][123090] Updated weights for policy 1, policy_version 143666 (0.0011) [2023-12-26 00:44:01,500][123090] Updated weights for policy 1, policy_version 143676 (0.0010) [2023-12-26 00:44:01,801][123091] Updated weights for policy 0, policy_version 144298 (0.0009) [2023-12-26 00:44:01,863][123091] Updated weights for policy 0, policy_version 144308 (0.0010) [2023-12-26 00:44:01,931][123091] Updated weights for policy 0, policy_version 144318 (0.0010) [2023-12-26 00:44:02,287][123090] Updated weights for policy 1, policy_version 143686 (0.0010) [2023-12-26 00:44:02,353][123090] Updated weights for policy 1, policy_version 143696 (0.0010) [2023-12-26 00:44:02,417][123090] Updated weights for policy 1, policy_version 143706 (0.0007) [2023-12-26 00:44:02,689][123091] Updated weights for policy 0, policy_version 144328 (0.0006) [2023-12-26 00:44:02,737][123091] Updated weights for policy 0, policy_version 144338 (0.0005) [2023-12-26 00:44:02,792][123091] Updated weights for policy 0, policy_version 144348 (0.0005) [2023-12-26 00:44:03,171][123090] Updated weights for policy 1, policy_version 143716 (0.0005) [2023-12-26 00:44:03,232][123090] Updated weights for policy 1, policy_version 143726 (0.0005) [2023-12-26 00:44:03,297][123090] Updated weights for policy 1, policy_version 143736 (0.0007) [2023-12-26 00:44:03,457][123091] Updated weights for policy 0, policy_version 144358 (0.0008) [2023-12-26 00:44:03,515][123091] Updated weights for policy 0, policy_version 144368 (0.0009) [2023-12-26 00:44:03,568][123091] Updated weights for policy 0, policy_version 144378 (0.0010) [2023-12-26 00:44:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 73760768. Throughput: 0: 8744.1, 1: 8935.7. Samples: 73770288. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:44:03,785][121949] Avg episode reward: [(0, '5643.986'), (1, '5184.823')] [2023-12-26 00:44:03,996][123090] Updated weights for policy 1, policy_version 143746 (0.0010) [2023-12-26 00:44:04,064][123090] Updated weights for policy 1, policy_version 143756 (0.0005) [2023-12-26 00:44:04,132][123090] Updated weights for policy 1, policy_version 143766 (0.0006) [2023-12-26 00:44:04,194][123090] Updated weights for policy 1, policy_version 143776 (0.0005) [2023-12-26 00:44:04,493][123091] Updated weights for policy 0, policy_version 144389 (0.0010) [2023-12-26 00:44:04,557][123091] Updated weights for policy 0, policy_version 144399 (0.0009) [2023-12-26 00:44:04,613][123091] Updated weights for policy 0, policy_version 144409 (0.0009) [2023-12-26 00:44:04,937][123090] Updated weights for policy 1, policy_version 143786 (0.0005) [2023-12-26 00:44:04,988][123090] Updated weights for policy 1, policy_version 143796 (0.0005) [2023-12-26 00:44:05,047][123090] Updated weights for policy 1, policy_version 143806 (0.0005) [2023-12-26 00:44:05,376][123091] Updated weights for policy 0, policy_version 144419 (0.0008) [2023-12-26 00:44:05,435][123091] Updated weights for policy 0, policy_version 144429 (0.0009) [2023-12-26 00:44:05,498][123091] Updated weights for policy 0, policy_version 144439 (0.0008) [2023-12-26 00:44:05,750][123090] Updated weights for policy 1, policy_version 143816 (0.0009) [2023-12-26 00:44:05,801][123090] Updated weights for policy 1, policy_version 143826 (0.0010) [2023-12-26 00:44:05,853][123090] Updated weights for policy 1, policy_version 143836 (0.0010) [2023-12-26 00:44:06,300][123091] Updated weights for policy 0, policy_version 144449 (0.0010) [2023-12-26 00:44:06,363][123091] Updated weights for policy 0, policy_version 144459 (0.0008) [2023-12-26 00:44:06,438][123091] Updated weights for policy 0, policy_version 144469 (0.0005) [2023-12-26 00:44:06,507][123091] Updated weights for policy 0, policy_version 144480 (0.0007) [2023-12-26 00:44:06,666][123090] Updated weights for policy 1, policy_version 143846 (0.0009) [2023-12-26 00:44:06,744][123090] Updated weights for policy 1, policy_version 143856 (0.0009) [2023-12-26 00:44:06,802][123090] Updated weights for policy 1, policy_version 143866 (0.0009) [2023-12-26 00:44:07,256][123091] Updated weights for policy 0, policy_version 144490 (0.0007) [2023-12-26 00:44:07,319][123091] Updated weights for policy 0, policy_version 144500 (0.0010) [2023-12-26 00:44:07,369][123091] Updated weights for policy 0, policy_version 144511 (0.0009) [2023-12-26 00:44:07,673][123090] Updated weights for policy 1, policy_version 143876 (0.0008) [2023-12-26 00:44:07,724][123090] Updated weights for policy 1, policy_version 143886 (0.0005) [2023-12-26 00:44:07,774][123090] Updated weights for policy 1, policy_version 143896 (0.0005) [2023-12-26 00:44:08,204][123091] Updated weights for policy 0, policy_version 144521 (0.0009) [2023-12-26 00:44:08,255][123091] Updated weights for policy 0, policy_version 144531 (0.0009) [2023-12-26 00:44:08,318][123091] Updated weights for policy 0, policy_version 144541 (0.0009) [2023-12-26 00:44:08,511][123090] Updated weights for policy 1, policy_version 143906 (0.0006) [2023-12-26 00:44:08,571][123090] Updated weights for policy 1, policy_version 143916 (0.0011) [2023-12-26 00:44:08,631][123090] Updated weights for policy 1, policy_version 143926 (0.0010) [2023-12-26 00:44:08,699][123090] Updated weights for policy 1, policy_version 143936 (0.0011) [2023-12-26 00:44:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 73850880. Throughput: 0: 8758.5, 1: 9021.9. Samples: 73824848. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:44:08,785][121949] Avg episode reward: [(0, '5694.656'), (1, '5431.973')] [2023-12-26 00:44:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000143936_36847616.pth... [2023-12-26 00:44:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000144544_37003264.pth... [2023-12-26 00:44:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000143520_36741120.pth [2023-12-26 00:44:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000142880_36577280.pth [2023-12-26 00:44:09,196][123091] Updated weights for policy 0, policy_version 144551 (0.0009) [2023-12-26 00:44:09,253][123091] Updated weights for policy 0, policy_version 144561 (0.0009) [2023-12-26 00:44:09,309][123091] Updated weights for policy 0, policy_version 144571 (0.0009) [2023-12-26 00:44:09,535][123090] Updated weights for policy 1, policy_version 143946 (0.0007) [2023-12-26 00:44:09,599][123090] Updated weights for policy 1, policy_version 143956 (0.0010) [2023-12-26 00:44:09,662][123090] Updated weights for policy 1, policy_version 143966 (0.0009) [2023-12-26 00:44:10,208][123091] Updated weights for policy 0, policy_version 144581 (0.0009) [2023-12-26 00:44:10,260][123091] Updated weights for policy 0, policy_version 144591 (0.0009) [2023-12-26 00:44:10,314][123091] Updated weights for policy 0, policy_version 144601 (0.0009) [2023-12-26 00:44:10,399][123090] Updated weights for policy 1, policy_version 143976 (0.0010) [2023-12-26 00:44:10,460][123090] Updated weights for policy 1, policy_version 143986 (0.0011) [2023-12-26 00:44:10,516][123090] Updated weights for policy 1, policy_version 143996 (0.0011) [2023-12-26 00:44:11,227][123091] Updated weights for policy 0, policy_version 144611 (0.0009) [2023-12-26 00:44:11,278][123090] Updated weights for policy 1, policy_version 144006 (0.0009) [2023-12-26 00:44:11,290][123091] Updated weights for policy 0, policy_version 144621 (0.0007) [2023-12-26 00:44:11,341][123090] Updated weights for policy 1, policy_version 144016 (0.0008) [2023-12-26 00:44:11,355][123091] Updated weights for policy 0, policy_version 144631 (0.0010) [2023-12-26 00:44:11,418][123090] Updated weights for policy 1, policy_version 144026 (0.0007) [2023-12-26 00:44:12,226][123091] Updated weights for policy 0, policy_version 144641 (0.0009) [2023-12-26 00:44:12,288][123091] Updated weights for policy 0, policy_version 144651 (0.0011) [2023-12-26 00:44:12,292][123090] Updated weights for policy 1, policy_version 144036 (0.0007) [2023-12-26 00:44:12,354][123091] Updated weights for policy 0, policy_version 144661 (0.0011) [2023-12-26 00:44:12,358][123090] Updated weights for policy 1, policy_version 144046 (0.0007) [2023-12-26 00:44:12,421][123090] Updated weights for policy 1, policy_version 144056 (0.0007) [2023-12-26 00:44:12,423][123091] Updated weights for policy 0, policy_version 144671 (0.0011) [2023-12-26 00:44:13,235][123091] Updated weights for policy 0, policy_version 144681 (0.0010) [2023-12-26 00:44:13,246][123090] Updated weights for policy 1, policy_version 144066 (0.0008) [2023-12-26 00:44:13,286][123091] Updated weights for policy 0, policy_version 144691 (0.0010) [2023-12-26 00:44:13,293][123090] Updated weights for policy 1, policy_version 144076 (0.0005) [2023-12-26 00:44:13,341][123091] Updated weights for policy 0, policy_version 144701 (0.0010) [2023-12-26 00:44:13,360][123090] Updated weights for policy 1, policy_version 144086 (0.0006) [2023-12-26 00:44:13,411][123090] Updated weights for policy 1, policy_version 144096 (0.0009) [2023-12-26 00:44:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 73932800. Throughput: 0: 8727.1, 1: 9000.6. Samples: 73926164. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:44:13,785][121949] Avg episode reward: [(0, '5583.359'), (1, '5442.664')] [2023-12-26 00:44:14,225][123091] Updated weights for policy 0, policy_version 144711 (0.0010) [2023-12-26 00:44:14,271][123090] Updated weights for policy 1, policy_version 144106 (0.0006) [2023-12-26 00:44:14,288][123091] Updated weights for policy 0, policy_version 144721 (0.0010) [2023-12-26 00:44:14,319][123090] Updated weights for policy 1, policy_version 144116 (0.0006) [2023-12-26 00:44:14,346][123091] Updated weights for policy 0, policy_version 144731 (0.0010) [2023-12-26 00:44:14,386][123090] Updated weights for policy 1, policy_version 144126 (0.0008) [2023-12-26 00:44:15,128][123091] Updated weights for policy 0, policy_version 144741 (0.0010) [2023-12-26 00:44:15,196][123091] Updated weights for policy 0, policy_version 144751 (0.0009) [2023-12-26 00:44:15,212][123090] Updated weights for policy 1, policy_version 144136 (0.0008) [2023-12-26 00:44:15,263][123091] Updated weights for policy 0, policy_version 144761 (0.0011) [2023-12-26 00:44:15,279][123090] Updated weights for policy 1, policy_version 144146 (0.0008) [2023-12-26 00:44:15,346][123090] Updated weights for policy 1, policy_version 144156 (0.0006) [2023-12-26 00:44:15,930][123091] Updated weights for policy 0, policy_version 144771 (0.0009) [2023-12-26 00:44:15,992][123091] Updated weights for policy 0, policy_version 144781 (0.0010) [2023-12-26 00:44:16,063][123091] Updated weights for policy 0, policy_version 144791 (0.0011) [2023-12-26 00:44:16,182][123090] Updated weights for policy 1, policy_version 144166 (0.0008) [2023-12-26 00:44:16,239][123090] Updated weights for policy 1, policy_version 144176 (0.0009) [2023-12-26 00:44:16,294][123090] Updated weights for policy 1, policy_version 144186 (0.0010) [2023-12-26 00:44:16,839][123091] Updated weights for policy 0, policy_version 144801 (0.0011) [2023-12-26 00:44:16,911][123091] Updated weights for policy 0, policy_version 144811 (0.0010) [2023-12-26 00:44:16,969][123091] Updated weights for policy 0, policy_version 144821 (0.0010) [2023-12-26 00:44:17,013][123090] Updated weights for policy 1, policy_version 144196 (0.0008) [2023-12-26 00:44:17,028][123091] Updated weights for policy 0, policy_version 144831 (0.0010) [2023-12-26 00:44:17,064][123090] Updated weights for policy 1, policy_version 144206 (0.0005) [2023-12-26 00:44:17,126][123090] Updated weights for policy 1, policy_version 144216 (0.0005) [2023-12-26 00:44:17,820][123091] Updated weights for policy 0, policy_version 144841 (0.0010) [2023-12-26 00:44:17,821][123090] Updated weights for policy 1, policy_version 144226 (0.0006) [2023-12-26 00:44:17,874][123091] Updated weights for policy 0, policy_version 144851 (0.0010) [2023-12-26 00:44:17,880][123090] Updated weights for policy 1, policy_version 144236 (0.0010) [2023-12-26 00:44:17,929][123091] Updated weights for policy 0, policy_version 144861 (0.0010) [2023-12-26 00:44:17,942][123090] Updated weights for policy 1, policy_version 144246 (0.0010) [2023-12-26 00:44:18,012][123090] Updated weights for policy 1, policy_version 144256 (0.0010) [2023-12-26 00:44:18,751][123091] Updated weights for policy 0, policy_version 144871 (0.0011) [2023-12-26 00:44:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 74014720. Throughput: 0: 8749.8, 1: 8976.3. Samples: 74033632. Policy #0 lag: (min: 31.0, avg: 42.1, max: 63.0) [2023-12-26 00:44:18,785][121949] Avg episode reward: [(0, '5485.840'), (1, '5464.042')] [2023-12-26 00:44:18,802][123091] Updated weights for policy 0, policy_version 144881 (0.0010) [2023-12-26 00:44:18,836][123090] Updated weights for policy 1, policy_version 144266 (0.0010) [2023-12-26 00:44:18,850][123091] Updated weights for policy 0, policy_version 144891 (0.0010) [2023-12-26 00:44:18,900][123090] Updated weights for policy 1, policy_version 144276 (0.0010) [2023-12-26 00:44:18,962][123090] Updated weights for policy 1, policy_version 144286 (0.0008) [2023-12-26 00:44:19,698][123091] Updated weights for policy 0, policy_version 144901 (0.0011) [2023-12-26 00:44:19,759][123091] Updated weights for policy 0, policy_version 144911 (0.0011) [2023-12-26 00:44:19,783][123090] Updated weights for policy 1, policy_version 144296 (0.0007) [2023-12-26 00:44:19,824][123091] Updated weights for policy 0, policy_version 144921 (0.0011) [2023-12-26 00:44:19,857][123090] Updated weights for policy 1, policy_version 144306 (0.0008) [2023-12-26 00:44:19,934][123090] Updated weights for policy 1, policy_version 144316 (0.0010) [2023-12-26 00:44:20,676][123091] Updated weights for policy 0, policy_version 144931 (0.0011) [2023-12-26 00:44:20,713][123090] Updated weights for policy 1, policy_version 144326 (0.0009) [2023-12-26 00:44:20,745][123091] Updated weights for policy 0, policy_version 144941 (0.0011) [2023-12-26 00:44:20,779][123090] Updated weights for policy 1, policy_version 144336 (0.0006) [2023-12-26 00:44:20,811][123091] Updated weights for policy 0, policy_version 144951 (0.0011) [2023-12-26 00:44:20,849][123090] Updated weights for policy 1, policy_version 144346 (0.0006) [2023-12-26 00:44:21,644][123090] Updated weights for policy 1, policy_version 144356 (0.0009) [2023-12-26 00:44:21,696][123090] Updated weights for policy 1, policy_version 144366 (0.0008) [2023-12-26 00:44:21,699][123091] Updated weights for policy 0, policy_version 144961 (0.0010) [2023-12-26 00:44:21,763][123090] Updated weights for policy 1, policy_version 144376 (0.0008) [2023-12-26 00:44:21,770][123091] Updated weights for policy 0, policy_version 144971 (0.0009) [2023-12-26 00:44:21,822][123091] Updated weights for policy 0, policy_version 144981 (0.0008) [2023-12-26 00:44:21,878][123091] Updated weights for policy 0, policy_version 144991 (0.0009) [2023-12-26 00:44:22,551][123090] Updated weights for policy 1, policy_version 144386 (0.0008) [2023-12-26 00:44:22,624][123090] Updated weights for policy 1, policy_version 144396 (0.0005) [2023-12-26 00:44:22,698][123090] Updated weights for policy 1, policy_version 144406 (0.0010) [2023-12-26 00:44:22,762][123090] Updated weights for policy 1, policy_version 144416 (0.0011) [2023-12-26 00:44:22,797][123091] Updated weights for policy 0, policy_version 145001 (0.0008) [2023-12-26 00:44:22,856][123091] Updated weights for policy 0, policy_version 145011 (0.0006) [2023-12-26 00:44:22,907][123091] Updated weights for policy 0, policy_version 145021 (0.0009) [2023-12-26 00:44:23,425][123090] Updated weights for policy 1, policy_version 144426 (0.0006) [2023-12-26 00:44:23,491][123090] Updated weights for policy 1, policy_version 144436 (0.0010) [2023-12-26 00:44:23,546][123090] Updated weights for policy 1, policy_version 144446 (0.0010) [2023-12-26 00:44:23,744][123091] Updated weights for policy 0, policy_version 145031 (0.0009) [2023-12-26 00:44:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 74104832. Throughput: 0: 8694.9, 1: 8931.1. Samples: 74083972. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:23,785][121949] Avg episode reward: [(0, '5464.893'), (1, '5398.176')] [2023-12-26 00:44:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000144448_36978688.pth... [2023-12-26 00:44:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000143392_36708352.pth [2023-12-26 00:44:23,800][123091] Updated weights for policy 0, policy_version 145041 (0.0008) [2023-12-26 00:44:23,856][123091] Updated weights for policy 0, policy_version 145051 (0.0009) [2023-12-26 00:44:23,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000145056_37134336.pth... [2023-12-26 00:44:23,880][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000144032_36872192.pth [2023-12-26 00:44:24,329][123090] Updated weights for policy 1, policy_version 144456 (0.0010) [2023-12-26 00:44:24,388][123090] Updated weights for policy 1, policy_version 144466 (0.0010) [2023-12-26 00:44:24,450][123090] Updated weights for policy 1, policy_version 144476 (0.0010) [2023-12-26 00:44:24,676][123091] Updated weights for policy 0, policy_version 145061 (0.0007) [2023-12-26 00:44:24,743][123091] Updated weights for policy 0, policy_version 145071 (0.0007) [2023-12-26 00:44:24,805][123091] Updated weights for policy 0, policy_version 145081 (0.0009) [2023-12-26 00:44:25,174][123090] Updated weights for policy 1, policy_version 144486 (0.0007) [2023-12-26 00:44:25,246][123090] Updated weights for policy 1, policy_version 144496 (0.0005) [2023-12-26 00:44:25,315][123090] Updated weights for policy 1, policy_version 144506 (0.0010) [2023-12-26 00:44:25,590][123091] Updated weights for policy 0, policy_version 145091 (0.0011) [2023-12-26 00:44:25,637][123091] Updated weights for policy 0, policy_version 145101 (0.0010) [2023-12-26 00:44:25,685][123091] Updated weights for policy 0, policy_version 145111 (0.0010) [2023-12-26 00:44:26,085][123090] Updated weights for policy 1, policy_version 144516 (0.0009) [2023-12-26 00:44:26,153][123090] Updated weights for policy 1, policy_version 144526 (0.0005) [2023-12-26 00:44:26,219][123090] Updated weights for policy 1, policy_version 144536 (0.0008) [2023-12-26 00:44:26,481][123091] Updated weights for policy 0, policy_version 145121 (0.0010) [2023-12-26 00:44:26,547][123091] Updated weights for policy 0, policy_version 145131 (0.0005) [2023-12-26 00:44:26,610][123091] Updated weights for policy 0, policy_version 145141 (0.0005) [2023-12-26 00:44:26,673][123091] Updated weights for policy 0, policy_version 145151 (0.0009) [2023-12-26 00:44:26,982][123090] Updated weights for policy 1, policy_version 144546 (0.0011) [2023-12-26 00:44:27,049][123090] Updated weights for policy 1, policy_version 144556 (0.0009) [2023-12-26 00:44:27,115][123090] Updated weights for policy 1, policy_version 144566 (0.0008) [2023-12-26 00:44:27,180][123090] Updated weights for policy 1, policy_version 144576 (0.0008) [2023-12-26 00:44:27,455][123091] Updated weights for policy 0, policy_version 145161 (0.0011) [2023-12-26 00:44:27,521][123091] Updated weights for policy 0, policy_version 145171 (0.0010) [2023-12-26 00:44:27,583][123091] Updated weights for policy 0, policy_version 145181 (0.0011) [2023-12-26 00:44:27,956][123090] Updated weights for policy 1, policy_version 144586 (0.0009) [2023-12-26 00:44:28,024][123090] Updated weights for policy 1, policy_version 144596 (0.0008) [2023-12-26 00:44:28,076][123090] Updated weights for policy 1, policy_version 144606 (0.0005) [2023-12-26 00:44:28,404][123091] Updated weights for policy 0, policy_version 145191 (0.0011) [2023-12-26 00:44:28,463][123091] Updated weights for policy 0, policy_version 145201 (0.0011) [2023-12-26 00:44:28,525][123091] Updated weights for policy 0, policy_version 145211 (0.0010) [2023-12-26 00:44:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 74194944. Throughput: 0: 8647.2, 1: 8993.9. Samples: 74190464. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:28,785][121949] Avg episode reward: [(0, '5450.043'), (1, '5358.756')] [2023-12-26 00:44:28,807][123090] Updated weights for policy 1, policy_version 144616 (0.0010) [2023-12-26 00:44:28,861][123090] Updated weights for policy 1, policy_version 144626 (0.0010) [2023-12-26 00:44:28,924][123090] Updated weights for policy 1, policy_version 144636 (0.0010) [2023-12-26 00:44:29,314][123091] Updated weights for policy 0, policy_version 145221 (0.0010) [2023-12-26 00:44:29,375][123091] Updated weights for policy 0, policy_version 145231 (0.0009) [2023-12-26 00:44:29,436][123091] Updated weights for policy 0, policy_version 145241 (0.0009) [2023-12-26 00:44:29,701][123090] Updated weights for policy 1, policy_version 144646 (0.0010) [2023-12-26 00:44:29,769][123090] Updated weights for policy 1, policy_version 144656 (0.0011) [2023-12-26 00:44:29,837][123090] Updated weights for policy 1, policy_version 144666 (0.0011) [2023-12-26 00:44:30,208][123091] Updated weights for policy 0, policy_version 145251 (0.0008) [2023-12-26 00:44:30,262][123091] Updated weights for policy 0, policy_version 145261 (0.0005) [2023-12-26 00:44:30,317][123091] Updated weights for policy 0, policy_version 145271 (0.0005) [2023-12-26 00:44:30,666][123090] Updated weights for policy 1, policy_version 144676 (0.0007) [2023-12-26 00:44:30,732][123090] Updated weights for policy 1, policy_version 144686 (0.0007) [2023-12-26 00:44:30,794][123090] Updated weights for policy 1, policy_version 144696 (0.0010) [2023-12-26 00:44:31,066][123091] Updated weights for policy 0, policy_version 145281 (0.0007) [2023-12-26 00:44:31,114][123091] Updated weights for policy 0, policy_version 145291 (0.0008) [2023-12-26 00:44:31,175][123091] Updated weights for policy 0, policy_version 145301 (0.0010) [2023-12-26 00:44:31,223][123091] Updated weights for policy 0, policy_version 145311 (0.0009) [2023-12-26 00:44:31,577][123090] Updated weights for policy 1, policy_version 144706 (0.0009) [2023-12-26 00:44:31,640][123090] Updated weights for policy 1, policy_version 144716 (0.0011) [2023-12-26 00:44:31,704][123090] Updated weights for policy 1, policy_version 144726 (0.0010) [2023-12-26 00:44:31,767][123090] Updated weights for policy 1, policy_version 144736 (0.0010) [2023-12-26 00:44:32,089][123091] Updated weights for policy 0, policy_version 145321 (0.0010) [2023-12-26 00:44:32,140][123091] Updated weights for policy 0, policy_version 145331 (0.0010) [2023-12-26 00:44:32,191][123091] Updated weights for policy 0, policy_version 145341 (0.0010) [2023-12-26 00:44:32,565][123090] Updated weights for policy 1, policy_version 144746 (0.0005) [2023-12-26 00:44:32,637][123090] Updated weights for policy 1, policy_version 144756 (0.0008) [2023-12-26 00:44:32,700][123090] Updated weights for policy 1, policy_version 144766 (0.0007) [2023-12-26 00:44:33,047][123091] Updated weights for policy 0, policy_version 145351 (0.0010) [2023-12-26 00:44:33,094][123091] Updated weights for policy 0, policy_version 145361 (0.0010) [2023-12-26 00:44:33,140][123091] Updated weights for policy 0, policy_version 145371 (0.0010) [2023-12-26 00:44:33,346][123090] Updated weights for policy 1, policy_version 144776 (0.0006) [2023-12-26 00:44:33,411][123090] Updated weights for policy 1, policy_version 144786 (0.0006) [2023-12-26 00:44:33,468][123090] Updated weights for policy 1, policy_version 144796 (0.0010) [2023-12-26 00:44:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 74285056. Throughput: 0: 8675.8, 1: 8982.9. Samples: 74296736. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:33,785][121949] Avg episode reward: [(0, '5514.092'), (1, '5376.467')] [2023-12-26 00:44:33,905][123091] Updated weights for policy 0, policy_version 145381 (0.0008) [2023-12-26 00:44:33,951][123091] Updated weights for policy 0, policy_version 145391 (0.0005) [2023-12-26 00:44:34,005][123091] Updated weights for policy 0, policy_version 145401 (0.0005) [2023-12-26 00:44:34,181][123090] Updated weights for policy 1, policy_version 144806 (0.0010) [2023-12-26 00:44:34,240][123090] Updated weights for policy 1, policy_version 144816 (0.0010) [2023-12-26 00:44:34,309][123090] Updated weights for policy 1, policy_version 144826 (0.0009) [2023-12-26 00:44:34,729][123091] Updated weights for policy 0, policy_version 145411 (0.0006) [2023-12-26 00:44:34,794][123091] Updated weights for policy 0, policy_version 145421 (0.0010) [2023-12-26 00:44:34,852][123091] Updated weights for policy 0, policy_version 145431 (0.0008) [2023-12-26 00:44:35,072][123090] Updated weights for policy 1, policy_version 144836 (0.0009) [2023-12-26 00:44:35,126][123090] Updated weights for policy 1, policy_version 144846 (0.0009) [2023-12-26 00:44:35,187][123090] Updated weights for policy 1, policy_version 144856 (0.0008) [2023-12-26 00:44:35,639][123091] Updated weights for policy 0, policy_version 145441 (0.0007) [2023-12-26 00:44:35,694][123091] Updated weights for policy 0, policy_version 145451 (0.0010) [2023-12-26 00:44:35,738][123091] Updated weights for policy 0, policy_version 145461 (0.0006) [2023-12-26 00:44:35,784][123091] Updated weights for policy 0, policy_version 145471 (0.0005) [2023-12-26 00:44:35,972][123090] Updated weights for policy 1, policy_version 144866 (0.0007) [2023-12-26 00:44:36,026][123090] Updated weights for policy 1, policy_version 144876 (0.0010) [2023-12-26 00:44:36,078][123090] Updated weights for policy 1, policy_version 144886 (0.0009) [2023-12-26 00:44:36,147][123090] Updated weights for policy 1, policy_version 144896 (0.0009) [2023-12-26 00:44:36,518][123091] Updated weights for policy 0, policy_version 145481 (0.0009) [2023-12-26 00:44:36,571][123091] Updated weights for policy 0, policy_version 145491 (0.0010) [2023-12-26 00:44:36,626][123091] Updated weights for policy 0, policy_version 145502 (0.0010) [2023-12-26 00:44:36,915][123090] Updated weights for policy 1, policy_version 144906 (0.0005) [2023-12-26 00:44:36,984][123090] Updated weights for policy 1, policy_version 144916 (0.0005) [2023-12-26 00:44:37,054][123090] Updated weights for policy 1, policy_version 144926 (0.0008) [2023-12-26 00:44:37,411][123091] Updated weights for policy 0, policy_version 145512 (0.0010) [2023-12-26 00:44:37,463][123091] Updated weights for policy 0, policy_version 145522 (0.0010) [2023-12-26 00:44:37,528][123091] Updated weights for policy 0, policy_version 145532 (0.0010) [2023-12-26 00:44:37,717][123090] Updated weights for policy 1, policy_version 144936 (0.0007) [2023-12-26 00:44:37,777][123090] Updated weights for policy 1, policy_version 144946 (0.0011) [2023-12-26 00:44:37,851][123090] Updated weights for policy 1, policy_version 144956 (0.0010) [2023-12-26 00:44:38,338][123091] Updated weights for policy 0, policy_version 145542 (0.0010) [2023-12-26 00:44:38,403][123091] Updated weights for policy 0, policy_version 145552 (0.0010) [2023-12-26 00:44:38,474][123091] Updated weights for policy 0, policy_version 145562 (0.0005) [2023-12-26 00:44:38,590][123090] Updated weights for policy 1, policy_version 144966 (0.0009) [2023-12-26 00:44:38,661][123090] Updated weights for policy 1, policy_version 144976 (0.0011) [2023-12-26 00:44:38,723][123090] Updated weights for policy 1, policy_version 144986 (0.0010) [2023-12-26 00:44:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 74383360. Throughput: 0: 8755.0, 1: 9010.6. Samples: 74352632. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:38,785][121949] Avg episode reward: [(0, '5638.538'), (1, '5328.165')] [2023-12-26 00:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000145568_37265408.pth... [2023-12-26 00:44:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000144992_37117952.pth... [2023-12-26 00:44:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000143936_36847616.pth [2023-12-26 00:44:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000144544_37003264.pth [2023-12-26 00:44:39,309][123091] Updated weights for policy 0, policy_version 145572 (0.0010) [2023-12-26 00:44:39,375][123091] Updated weights for policy 0, policy_version 145582 (0.0008) [2023-12-26 00:44:39,378][123090] Updated weights for policy 1, policy_version 144996 (0.0009) [2023-12-26 00:44:39,444][123091] Updated weights for policy 0, policy_version 145592 (0.0008) [2023-12-26 00:44:39,446][123090] Updated weights for policy 1, policy_version 145006 (0.0009) [2023-12-26 00:44:39,510][123090] Updated weights for policy 1, policy_version 145016 (0.0010) [2023-12-26 00:44:40,207][123091] Updated weights for policy 0, policy_version 145602 (0.0007) [2023-12-26 00:44:40,272][123091] Updated weights for policy 0, policy_version 145612 (0.0009) [2023-12-26 00:44:40,335][123091] Updated weights for policy 0, policy_version 145622 (0.0008) [2023-12-26 00:44:40,349][123090] Updated weights for policy 1, policy_version 145026 (0.0011) [2023-12-26 00:44:40,396][123091] Updated weights for policy 0, policy_version 145632 (0.0007) [2023-12-26 00:44:40,422][123090] Updated weights for policy 1, policy_version 145036 (0.0011) [2023-12-26 00:44:40,490][123090] Updated weights for policy 1, policy_version 145046 (0.0010) [2023-12-26 00:44:40,561][123090] Updated weights for policy 1, policy_version 145056 (0.0010) [2023-12-26 00:44:41,219][123091] Updated weights for policy 0, policy_version 145642 (0.0010) [2023-12-26 00:44:41,284][123091] Updated weights for policy 0, policy_version 145652 (0.0009) [2023-12-26 00:44:41,350][123091] Updated weights for policy 0, policy_version 145662 (0.0008) [2023-12-26 00:44:41,404][123090] Updated weights for policy 1, policy_version 145066 (0.0008) [2023-12-26 00:44:41,463][123090] Updated weights for policy 1, policy_version 145076 (0.0009) [2023-12-26 00:44:41,526][123090] Updated weights for policy 1, policy_version 145086 (0.0009) [2023-12-26 00:44:42,104][123091] Updated weights for policy 0, policy_version 145672 (0.0007) [2023-12-26 00:44:42,164][123091] Updated weights for policy 0, policy_version 145682 (0.0006) [2023-12-26 00:44:42,239][123091] Updated weights for policy 0, policy_version 145692 (0.0006) [2023-12-26 00:44:42,368][123090] Updated weights for policy 1, policy_version 145096 (0.0010) [2023-12-26 00:44:42,440][123090] Updated weights for policy 1, policy_version 145106 (0.0009) [2023-12-26 00:44:42,516][123090] Updated weights for policy 1, policy_version 145116 (0.0010) [2023-12-26 00:44:42,925][123091] Updated weights for policy 0, policy_version 145702 (0.0009) [2023-12-26 00:44:42,991][123091] Updated weights for policy 0, policy_version 145712 (0.0009) [2023-12-26 00:44:43,051][123091] Updated weights for policy 0, policy_version 145722 (0.0010) [2023-12-26 00:44:43,333][123090] Updated weights for policy 1, policy_version 145126 (0.0009) [2023-12-26 00:44:43,390][123090] Updated weights for policy 1, policy_version 145136 (0.0009) [2023-12-26 00:44:43,451][123090] Updated weights for policy 1, policy_version 145146 (0.0009) [2023-12-26 00:44:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 74465280. Throughput: 0: 8731.6, 1: 9011.3. Samples: 74459296. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:43,785][121949] Avg episode reward: [(0, '5664.656'), (1, '5505.354')] [2023-12-26 00:44:43,900][123091] Updated weights for policy 0, policy_version 145732 (0.0010) [2023-12-26 00:44:43,964][123091] Updated weights for policy 0, policy_version 145742 (0.0008) [2023-12-26 00:44:44,028][123091] Updated weights for policy 0, policy_version 145752 (0.0010) [2023-12-26 00:44:44,291][123090] Updated weights for policy 1, policy_version 145156 (0.0009) [2023-12-26 00:44:44,355][123090] Updated weights for policy 1, policy_version 145166 (0.0010) [2023-12-26 00:44:44,408][123090] Updated weights for policy 1, policy_version 145176 (0.0010) [2023-12-26 00:44:44,767][123091] Updated weights for policy 0, policy_version 145762 (0.0009) [2023-12-26 00:44:44,830][123091] Updated weights for policy 0, policy_version 145772 (0.0008) [2023-12-26 00:44:44,897][123091] Updated weights for policy 0, policy_version 145782 (0.0006) [2023-12-26 00:44:44,956][123091] Updated weights for policy 0, policy_version 145792 (0.0011) [2023-12-26 00:44:45,237][123090] Updated weights for policy 1, policy_version 145186 (0.0010) [2023-12-26 00:44:45,304][123090] Updated weights for policy 1, policy_version 145196 (0.0007) [2023-12-26 00:44:45,379][123090] Updated weights for policy 1, policy_version 145206 (0.0005) [2023-12-26 00:44:45,451][123090] Updated weights for policy 1, policy_version 145216 (0.0005) [2023-12-26 00:44:45,732][123091] Updated weights for policy 0, policy_version 145802 (0.0011) [2023-12-26 00:44:45,799][123091] Updated weights for policy 0, policy_version 145812 (0.0011) [2023-12-26 00:44:45,869][123091] Updated weights for policy 0, policy_version 145822 (0.0010) [2023-12-26 00:44:46,074][123090] Updated weights for policy 1, policy_version 145226 (0.0005) [2023-12-26 00:44:46,124][123090] Updated weights for policy 1, policy_version 145236 (0.0007) [2023-12-26 00:44:46,179][123090] Updated weights for policy 1, policy_version 145246 (0.0006) [2023-12-26 00:44:46,499][123091] Updated weights for policy 0, policy_version 145832 (0.0006) [2023-12-26 00:44:46,552][123091] Updated weights for policy 0, policy_version 145842 (0.0005) [2023-12-26 00:44:46,624][123091] Updated weights for policy 0, policy_version 145852 (0.0005) [2023-12-26 00:44:46,998][123090] Updated weights for policy 1, policy_version 145256 (0.0010) [2023-12-26 00:44:47,064][123090] Updated weights for policy 1, policy_version 145266 (0.0010) [2023-12-26 00:44:47,130][123090] Updated weights for policy 1, policy_version 145276 (0.0009) [2023-12-26 00:44:47,307][123091] Updated weights for policy 0, policy_version 145862 (0.0006) [2023-12-26 00:44:47,373][123091] Updated weights for policy 0, policy_version 145872 (0.0006) [2023-12-26 00:44:47,431][123091] Updated weights for policy 0, policy_version 145882 (0.0005) [2023-12-26 00:44:47,957][123090] Updated weights for policy 1, policy_version 145286 (0.0007) [2023-12-26 00:44:48,006][123090] Updated weights for policy 1, policy_version 145296 (0.0006) [2023-12-26 00:44:48,061][123090] Updated weights for policy 1, policy_version 145306 (0.0010) [2023-12-26 00:44:48,144][123091] Updated weights for policy 0, policy_version 145892 (0.0007) [2023-12-26 00:44:48,206][123091] Updated weights for policy 0, policy_version 145902 (0.0010) [2023-12-26 00:44:48,267][123091] Updated weights for policy 0, policy_version 145912 (0.0008) [2023-12-26 00:44:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 74555392. Throughput: 0: 8780.2, 1: 8960.2. Samples: 74568604. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:48,785][121949] Avg episode reward: [(0, '5701.593'), (1, '5480.965')] [2023-12-26 00:44:48,795][123090] Updated weights for policy 1, policy_version 145316 (0.0008) [2023-12-26 00:44:48,869][123090] Updated weights for policy 1, policy_version 145326 (0.0007) [2023-12-26 00:44:48,935][123090] Updated weights for policy 1, policy_version 145336 (0.0009) [2023-12-26 00:44:49,134][123091] Updated weights for policy 0, policy_version 145922 (0.0009) [2023-12-26 00:44:49,204][123091] Updated weights for policy 0, policy_version 145932 (0.0006) [2023-12-26 00:44:49,274][123091] Updated weights for policy 0, policy_version 145942 (0.0007) [2023-12-26 00:44:49,341][123091] Updated weights for policy 0, policy_version 145952 (0.0007) [2023-12-26 00:44:49,730][123090] Updated weights for policy 1, policy_version 145346 (0.0008) [2023-12-26 00:44:49,807][123090] Updated weights for policy 1, policy_version 145356 (0.0009) [2023-12-26 00:44:49,875][123090] Updated weights for policy 1, policy_version 145366 (0.0009) [2023-12-26 00:44:49,937][123090] Updated weights for policy 1, policy_version 145376 (0.0008) [2023-12-26 00:44:50,125][123091] Updated weights for policy 0, policy_version 145962 (0.0009) [2023-12-26 00:44:50,193][123091] Updated weights for policy 0, policy_version 145972 (0.0009) [2023-12-26 00:44:50,260][123091] Updated weights for policy 0, policy_version 145982 (0.0009) [2023-12-26 00:44:50,693][123090] Updated weights for policy 1, policy_version 145386 (0.0010) [2023-12-26 00:44:50,767][123090] Updated weights for policy 1, policy_version 145396 (0.0010) [2023-12-26 00:44:50,841][123090] Updated weights for policy 1, policy_version 145406 (0.0008) [2023-12-26 00:44:51,143][123091] Updated weights for policy 0, policy_version 145992 (0.0009) [2023-12-26 00:44:51,203][123091] Updated weights for policy 0, policy_version 146002 (0.0009) [2023-12-26 00:44:51,276][123091] Updated weights for policy 0, policy_version 146012 (0.0009) [2023-12-26 00:44:51,653][123090] Updated weights for policy 1, policy_version 145416 (0.0008) [2023-12-26 00:44:51,719][123090] Updated weights for policy 1, policy_version 145426 (0.0009) [2023-12-26 00:44:51,790][123090] Updated weights for policy 1, policy_version 145436 (0.0009) [2023-12-26 00:44:52,125][123091] Updated weights for policy 0, policy_version 146022 (0.0010) [2023-12-26 00:44:52,185][123091] Updated weights for policy 0, policy_version 146032 (0.0010) [2023-12-26 00:44:52,241][123091] Updated weights for policy 0, policy_version 146042 (0.0009) [2023-12-26 00:44:52,626][123090] Updated weights for policy 1, policy_version 145446 (0.0010) [2023-12-26 00:44:52,691][123090] Updated weights for policy 1, policy_version 145456 (0.0009) [2023-12-26 00:44:52,753][123090] Updated weights for policy 1, policy_version 145466 (0.0010) [2023-12-26 00:44:53,071][123091] Updated weights for policy 0, policy_version 146052 (0.0009) [2023-12-26 00:44:53,136][123091] Updated weights for policy 0, policy_version 146062 (0.0009) [2023-12-26 00:44:53,196][123091] Updated weights for policy 0, policy_version 146072 (0.0009) [2023-12-26 00:44:53,578][123090] Updated weights for policy 1, policy_version 145476 (0.0009) [2023-12-26 00:44:53,644][123090] Updated weights for policy 1, policy_version 145486 (0.0010) [2023-12-26 00:44:53,692][123090] Updated weights for policy 1, policy_version 145496 (0.0009) [2023-12-26 00:44:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 74645504. Throughput: 0: 8756.7, 1: 8918.5. Samples: 74620232. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:53,785][121949] Avg episode reward: [(0, '5779.739'), (1, '5454.527')] [2023-12-26 00:44:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000146080_37396480.pth... [2023-12-26 00:44:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000145504_37249024.pth... [2023-12-26 00:44:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000145056_37134336.pth [2023-12-26 00:44:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000144448_36978688.pth [2023-12-26 00:44:54,040][123091] Updated weights for policy 0, policy_version 146082 (0.0009) [2023-12-26 00:44:54,105][123091] Updated weights for policy 0, policy_version 146092 (0.0010) [2023-12-26 00:44:54,157][123091] Updated weights for policy 0, policy_version 146102 (0.0010) [2023-12-26 00:44:54,219][123091] Updated weights for policy 0, policy_version 146112 (0.0011) [2023-12-26 00:44:54,476][123090] Updated weights for policy 1, policy_version 145506 (0.0008) [2023-12-26 00:44:54,539][123090] Updated weights for policy 1, policy_version 145516 (0.0005) [2023-12-26 00:44:54,604][123090] Updated weights for policy 1, policy_version 145526 (0.0005) [2023-12-26 00:44:54,672][123090] Updated weights for policy 1, policy_version 145536 (0.0006) [2023-12-26 00:44:55,043][123091] Updated weights for policy 0, policy_version 146122 (0.0005) [2023-12-26 00:44:55,105][123091] Updated weights for policy 0, policy_version 146132 (0.0005) [2023-12-26 00:44:55,161][123091] Updated weights for policy 0, policy_version 146142 (0.0005) [2023-12-26 00:44:55,368][123090] Updated weights for policy 1, policy_version 145546 (0.0006) [2023-12-26 00:44:55,423][123090] Updated weights for policy 1, policy_version 145556 (0.0005) [2023-12-26 00:44:55,478][123090] Updated weights for policy 1, policy_version 145566 (0.0005) [2023-12-26 00:44:55,869][123091] Updated weights for policy 0, policy_version 146152 (0.0005) [2023-12-26 00:44:55,931][123091] Updated weights for policy 0, policy_version 146162 (0.0009) [2023-12-26 00:44:55,994][123091] Updated weights for policy 0, policy_version 146172 (0.0010) [2023-12-26 00:44:56,225][123090] Updated weights for policy 1, policy_version 145576 (0.0008) [2023-12-26 00:44:56,273][123090] Updated weights for policy 1, policy_version 145586 (0.0009) [2023-12-26 00:44:56,325][123090] Updated weights for policy 1, policy_version 145596 (0.0009) [2023-12-26 00:44:56,750][123091] Updated weights for policy 0, policy_version 146182 (0.0011) [2023-12-26 00:44:56,805][123091] Updated weights for policy 0, policy_version 146192 (0.0010) [2023-12-26 00:44:56,863][123091] Updated weights for policy 0, policy_version 146202 (0.0010) [2023-12-26 00:44:57,144][123090] Updated weights for policy 1, policy_version 145606 (0.0009) [2023-12-26 00:44:57,192][123090] Updated weights for policy 1, policy_version 145616 (0.0008) [2023-12-26 00:44:57,247][123090] Updated weights for policy 1, policy_version 145626 (0.0008) [2023-12-26 00:44:57,630][123091] Updated weights for policy 0, policy_version 146212 (0.0008) [2023-12-26 00:44:57,678][123091] Updated weights for policy 0, policy_version 146222 (0.0005) [2023-12-26 00:44:57,734][123091] Updated weights for policy 0, policy_version 146232 (0.0005) [2023-12-26 00:44:58,054][123090] Updated weights for policy 1, policy_version 145636 (0.0007) [2023-12-26 00:44:58,117][123090] Updated weights for policy 1, policy_version 145646 (0.0008) [2023-12-26 00:44:58,186][123090] Updated weights for policy 1, policy_version 145656 (0.0008) [2023-12-26 00:44:58,555][123091] Updated weights for policy 0, policy_version 146242 (0.0006) [2023-12-26 00:44:58,611][123091] Updated weights for policy 0, policy_version 146252 (0.0011) [2023-12-26 00:44:58,679][123091] Updated weights for policy 0, policy_version 146262 (0.0011) [2023-12-26 00:44:58,747][123091] Updated weights for policy 0, policy_version 146272 (0.0011) [2023-12-26 00:44:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 74735616. Throughput: 0: 8841.1, 1: 8943.5. Samples: 74726472. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:44:58,785][121949] Avg episode reward: [(0, '5798.869'), (1, '5438.534')] [2023-12-26 00:44:58,942][123090] Updated weights for policy 1, policy_version 145666 (0.0008) [2023-12-26 00:44:58,998][123090] Updated weights for policy 1, policy_version 145676 (0.0009) [2023-12-26 00:44:59,054][123090] Updated weights for policy 1, policy_version 145686 (0.0010) [2023-12-26 00:44:59,113][123090] Updated weights for policy 1, policy_version 145696 (0.0009) [2023-12-26 00:44:59,563][123091] Updated weights for policy 0, policy_version 146282 (0.0009) [2023-12-26 00:44:59,633][123091] Updated weights for policy 0, policy_version 146292 (0.0010) [2023-12-26 00:44:59,703][123091] Updated weights for policy 0, policy_version 146302 (0.0011) [2023-12-26 00:44:59,942][123090] Updated weights for policy 1, policy_version 145706 (0.0009) [2023-12-26 00:45:00,014][123090] Updated weights for policy 1, policy_version 145716 (0.0007) [2023-12-26 00:45:00,079][123090] Updated weights for policy 1, policy_version 145726 (0.0009) [2023-12-26 00:45:00,490][123091] Updated weights for policy 0, policy_version 146312 (0.0006) [2023-12-26 00:45:00,554][123091] Updated weights for policy 0, policy_version 146322 (0.0005) [2023-12-26 00:45:00,621][123091] Updated weights for policy 0, policy_version 146332 (0.0006) [2023-12-26 00:45:00,965][123090] Updated weights for policy 1, policy_version 145736 (0.0008) [2023-12-26 00:45:01,033][123090] Updated weights for policy 1, policy_version 145746 (0.0009) [2023-12-26 00:45:01,094][123090] Updated weights for policy 1, policy_version 145756 (0.0009) [2023-12-26 00:45:01,234][123091] Updated weights for policy 0, policy_version 146342 (0.0008) [2023-12-26 00:45:01,299][123091] Updated weights for policy 0, policy_version 146352 (0.0008) [2023-12-26 00:45:01,367][123091] Updated weights for policy 0, policy_version 146362 (0.0009) [2023-12-26 00:45:01,977][123090] Updated weights for policy 1, policy_version 145766 (0.0009) [2023-12-26 00:45:02,026][123090] Updated weights for policy 1, policy_version 145776 (0.0009) [2023-12-26 00:45:02,075][123090] Updated weights for policy 1, policy_version 145786 (0.0009) [2023-12-26 00:45:02,157][123091] Updated weights for policy 0, policy_version 146372 (0.0010) [2023-12-26 00:45:02,214][123091] Updated weights for policy 0, policy_version 146382 (0.0009) [2023-12-26 00:45:02,277][123091] Updated weights for policy 0, policy_version 146392 (0.0010) [2023-12-26 00:45:02,926][123090] Updated weights for policy 1, policy_version 145796 (0.0010) [2023-12-26 00:45:02,983][123090] Updated weights for policy 1, policy_version 145806 (0.0009) [2023-12-26 00:45:03,035][123090] Updated weights for policy 1, policy_version 145816 (0.0008) [2023-12-26 00:45:03,124][123091] Updated weights for policy 0, policy_version 146402 (0.0010) [2023-12-26 00:45:03,190][123091] Updated weights for policy 0, policy_version 146412 (0.0010) [2023-12-26 00:45:03,248][123091] Updated weights for policy 0, policy_version 146424 (0.0011) [2023-12-26 00:45:03,747][123090] Updated weights for policy 1, policy_version 145826 (0.0008) [2023-12-26 00:45:03,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 74817536. Throughput: 0: 8818.4, 1: 8912.4. Samples: 74831516. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:45:03,785][121949] Avg episode reward: [(0, '5802.688'), (1, '5426.805')] [2023-12-26 00:45:03,810][123090] Updated weights for policy 1, policy_version 145836 (0.0008) [2023-12-26 00:45:03,873][123090] Updated weights for policy 1, policy_version 145846 (0.0009) [2023-12-26 00:45:03,922][123090] Updated weights for policy 1, policy_version 145856 (0.0009) [2023-12-26 00:45:04,117][123091] Updated weights for policy 0, policy_version 146435 (0.0010) [2023-12-26 00:45:04,180][123091] Updated weights for policy 0, policy_version 146445 (0.0010) [2023-12-26 00:45:04,247][123091] Updated weights for policy 0, policy_version 146455 (0.0010) [2023-12-26 00:45:04,734][123090] Updated weights for policy 1, policy_version 145866 (0.0009) [2023-12-26 00:45:04,801][123090] Updated weights for policy 1, policy_version 145876 (0.0009) [2023-12-26 00:45:04,858][123090] Updated weights for policy 1, policy_version 145886 (0.0009) [2023-12-26 00:45:05,059][123091] Updated weights for policy 0, policy_version 146465 (0.0009) [2023-12-26 00:45:05,114][123091] Updated weights for policy 0, policy_version 146475 (0.0010) [2023-12-26 00:45:05,183][123091] Updated weights for policy 0, policy_version 146485 (0.0010) [2023-12-26 00:45:05,246][123091] Updated weights for policy 0, policy_version 146495 (0.0010) [2023-12-26 00:45:05,612][123090] Updated weights for policy 1, policy_version 145896 (0.0006) [2023-12-26 00:45:05,659][123090] Updated weights for policy 1, policy_version 145906 (0.0005) [2023-12-26 00:45:05,713][123090] Updated weights for policy 1, policy_version 145916 (0.0005) [2023-12-26 00:45:06,152][123091] Updated weights for policy 0, policy_version 146505 (0.0009) [2023-12-26 00:45:06,219][123091] Updated weights for policy 0, policy_version 146515 (0.0008) [2023-12-26 00:45:06,284][123091] Updated weights for policy 0, policy_version 146525 (0.0009) [2023-12-26 00:45:06,460][123090] Updated weights for policy 1, policy_version 145926 (0.0008) [2023-12-26 00:45:06,535][123090] Updated weights for policy 1, policy_version 145936 (0.0011) [2023-12-26 00:45:06,607][123090] Updated weights for policy 1, policy_version 145946 (0.0011) [2023-12-26 00:45:07,082][123091] Updated weights for policy 0, policy_version 146535 (0.0006) [2023-12-26 00:45:07,160][123091] Updated weights for policy 0, policy_version 146545 (0.0005) [2023-12-26 00:45:07,226][123091] Updated weights for policy 0, policy_version 146555 (0.0005) [2023-12-26 00:45:07,345][123090] Updated weights for policy 1, policy_version 145956 (0.0009) [2023-12-26 00:45:07,413][123090] Updated weights for policy 1, policy_version 145966 (0.0009) [2023-12-26 00:45:07,477][123090] Updated weights for policy 1, policy_version 145976 (0.0008) [2023-12-26 00:45:07,908][123091] Updated weights for policy 0, policy_version 146565 (0.0007) [2023-12-26 00:45:07,959][123091] Updated weights for policy 0, policy_version 146576 (0.0010) [2023-12-26 00:45:08,010][123091] Updated weights for policy 0, policy_version 146586 (0.0009) [2023-12-26 00:45:08,262][123090] Updated weights for policy 1, policy_version 145986 (0.0010) [2023-12-26 00:45:08,332][123090] Updated weights for policy 1, policy_version 145996 (0.0010) [2023-12-26 00:45:08,407][123090] Updated weights for policy 1, policy_version 146006 (0.0011) [2023-12-26 00:45:08,470][123090] Updated weights for policy 1, policy_version 146016 (0.0010) [2023-12-26 00:45:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 74907648. Throughput: 0: 8825.6, 1: 8949.8. Samples: 74883868. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:45:08,785][121949] Avg episode reward: [(0, '5818.772'), (1, '5458.759')] [2023-12-26 00:45:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000146016_37380096.pth... [2023-12-26 00:45:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000146592_37527552.pth... [2023-12-26 00:45:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000145568_37265408.pth [2023-12-26 00:45:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000144992_37117952.pth [2023-12-26 00:45:08,798][123007] Saving new best policy, reward=5818.772! [2023-12-26 00:45:08,837][123091] Updated weights for policy 0, policy_version 146596 (0.0010) [2023-12-26 00:45:08,886][123091] Updated weights for policy 0, policy_version 146606 (0.0011) [2023-12-26 00:45:08,931][123091] Updated weights for policy 0, policy_version 146616 (0.0011) [2023-12-26 00:45:09,254][123090] Updated weights for policy 1, policy_version 146026 (0.0007) [2023-12-26 00:45:09,323][123090] Updated weights for policy 1, policy_version 146036 (0.0007) [2023-12-26 00:45:09,394][123090] Updated weights for policy 1, policy_version 146046 (0.0007) [2023-12-26 00:45:09,754][123091] Updated weights for policy 0, policy_version 146626 (0.0011) [2023-12-26 00:45:09,826][123091] Updated weights for policy 0, policy_version 146636 (0.0011) [2023-12-26 00:45:09,892][123091] Updated weights for policy 0, policy_version 146646 (0.0011) [2023-12-26 00:45:09,963][123091] Updated weights for policy 0, policy_version 146656 (0.0010) [2023-12-26 00:45:10,189][123090] Updated weights for policy 1, policy_version 146056 (0.0006) [2023-12-26 00:45:10,263][123090] Updated weights for policy 1, policy_version 146066 (0.0006) [2023-12-26 00:45:10,333][123090] Updated weights for policy 1, policy_version 146076 (0.0009) [2023-12-26 00:45:10,734][123091] Updated weights for policy 0, policy_version 146666 (0.0006) [2023-12-26 00:45:10,782][123091] Updated weights for policy 0, policy_version 146676 (0.0005) [2023-12-26 00:45:10,836][123091] Updated weights for policy 0, policy_version 146686 (0.0005) [2023-12-26 00:45:11,040][123090] Updated weights for policy 1, policy_version 146086 (0.0009) [2023-12-26 00:45:11,104][123090] Updated weights for policy 1, policy_version 146096 (0.0010) [2023-12-26 00:45:11,177][123090] Updated weights for policy 1, policy_version 146106 (0.0009) [2023-12-26 00:45:11,564][123091] Updated weights for policy 0, policy_version 146696 (0.0009) [2023-12-26 00:45:11,624][123091] Updated weights for policy 0, policy_version 146706 (0.0009) [2023-12-26 00:45:11,689][123091] Updated weights for policy 0, policy_version 146716 (0.0009) [2023-12-26 00:45:11,960][123090] Updated weights for policy 1, policy_version 146116 (0.0008) [2023-12-26 00:45:12,032][123090] Updated weights for policy 1, policy_version 146126 (0.0010) [2023-12-26 00:45:12,103][123090] Updated weights for policy 1, policy_version 146136 (0.0010) [2023-12-26 00:45:12,590][123091] Updated weights for policy 0, policy_version 146726 (0.0010) [2023-12-26 00:45:12,650][123091] Updated weights for policy 0, policy_version 146736 (0.0010) [2023-12-26 00:45:12,711][123091] Updated weights for policy 0, policy_version 146746 (0.0009) [2023-12-26 00:45:12,919][123090] Updated weights for policy 1, policy_version 146146 (0.0006) [2023-12-26 00:45:12,998][123090] Updated weights for policy 1, policy_version 146156 (0.0006) [2023-12-26 00:45:13,066][123090] Updated weights for policy 1, policy_version 146166 (0.0005) [2023-12-26 00:45:13,130][123090] Updated weights for policy 1, policy_version 146176 (0.0005) [2023-12-26 00:45:13,562][123091] Updated weights for policy 0, policy_version 146756 (0.0008) [2023-12-26 00:45:13,631][123091] Updated weights for policy 0, policy_version 146766 (0.0006) [2023-12-26 00:45:13,698][123091] Updated weights for policy 0, policy_version 146776 (0.0005) [2023-12-26 00:45:13,704][123090] Updated weights for policy 1, policy_version 146186 (0.0005) [2023-12-26 00:45:13,760][123090] Updated weights for policy 1, policy_version 146196 (0.0005) [2023-12-26 00:45:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 74997760. Throughput: 0: 8860.1, 1: 8936.8. Samples: 74991324. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:45:13,785][121949] Avg episode reward: [(0, '5815.214'), (1, '5363.352')] [2023-12-26 00:45:13,814][123090] Updated weights for policy 1, policy_version 146206 (0.0005) [2023-12-26 00:45:14,460][123090] Updated weights for policy 1, policy_version 146216 (0.0005) [2023-12-26 00:45:14,496][123091] Updated weights for policy 0, policy_version 146786 (0.0006) [2023-12-26 00:45:14,533][123090] Updated weights for policy 1, policy_version 146226 (0.0006) [2023-12-26 00:45:14,544][123091] Updated weights for policy 0, policy_version 146796 (0.0008) [2023-12-26 00:45:14,595][123090] Updated weights for policy 1, policy_version 146236 (0.0005) [2023-12-26 00:45:14,597][123091] Updated weights for policy 0, policy_version 146806 (0.0010) [2023-12-26 00:45:14,644][123091] Updated weights for policy 0, policy_version 146816 (0.0006) [2023-12-26 00:45:15,265][123090] Updated weights for policy 1, policy_version 146246 (0.0005) [2023-12-26 00:45:15,339][123090] Updated weights for policy 1, policy_version 146256 (0.0008) [2023-12-26 00:45:15,351][123091] Updated weights for policy 0, policy_version 146826 (0.0007) [2023-12-26 00:45:15,397][123090] Updated weights for policy 1, policy_version 146266 (0.0008) [2023-12-26 00:45:15,403][123091] Updated weights for policy 0, policy_version 146836 (0.0007) [2023-12-26 00:45:15,460][123091] Updated weights for policy 0, policy_version 146846 (0.0010) [2023-12-26 00:45:16,074][123090] Updated weights for policy 1, policy_version 146276 (0.0010) [2023-12-26 00:45:16,153][123090] Updated weights for policy 1, policy_version 146286 (0.0007) [2023-12-26 00:45:16,220][123090] Updated weights for policy 1, policy_version 146296 (0.0005) [2023-12-26 00:45:16,350][123091] Updated weights for policy 0, policy_version 146856 (0.0009) [2023-12-26 00:45:16,399][123091] Updated weights for policy 0, policy_version 146867 (0.0010) [2023-12-26 00:45:16,457][123091] Updated weights for policy 0, policy_version 146877 (0.0010) [2023-12-26 00:45:16,977][123090] Updated weights for policy 1, policy_version 146306 (0.0010) [2023-12-26 00:45:17,024][123090] Updated weights for policy 1, policy_version 146316 (0.0008) [2023-12-26 00:45:17,081][123090] Updated weights for policy 1, policy_version 146327 (0.0009) [2023-12-26 00:45:17,307][123091] Updated weights for policy 0, policy_version 146887 (0.0010) [2023-12-26 00:45:17,370][123091] Updated weights for policy 0, policy_version 146897 (0.0010) [2023-12-26 00:45:17,432][123091] Updated weights for policy 0, policy_version 146907 (0.0009) [2023-12-26 00:45:17,934][123090] Updated weights for policy 1, policy_version 146337 (0.0009) [2023-12-26 00:45:17,985][123090] Updated weights for policy 1, policy_version 146347 (0.0009) [2023-12-26 00:45:18,042][123090] Updated weights for policy 1, policy_version 146358 (0.0009) [2023-12-26 00:45:18,099][123090] Updated weights for policy 1, policy_version 146368 (0.0009) [2023-12-26 00:45:18,257][123091] Updated weights for policy 0, policy_version 146917 (0.0009) [2023-12-26 00:45:18,307][123091] Updated weights for policy 0, policy_version 146927 (0.0009) [2023-12-26 00:45:18,371][123091] Updated weights for policy 0, policy_version 146937 (0.0010) [2023-12-26 00:45:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 75087872. Throughput: 0: 8851.2, 1: 8987.2. Samples: 75099464. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:45:18,784][121949] Avg episode reward: [(0, '5723.652'), (1, '5448.107')] [2023-12-26 00:45:18,955][123090] Updated weights for policy 1, policy_version 146378 (0.0009) [2023-12-26 00:45:19,012][123090] Updated weights for policy 1, policy_version 146388 (0.0009) [2023-12-26 00:45:19,066][123090] Updated weights for policy 1, policy_version 146398 (0.0008) [2023-12-26 00:45:19,211][123091] Updated weights for policy 0, policy_version 146947 (0.0009) [2023-12-26 00:45:19,279][123091] Updated weights for policy 0, policy_version 146957 (0.0010) [2023-12-26 00:45:19,352][123091] Updated weights for policy 0, policy_version 146967 (0.0010) [2023-12-26 00:45:19,950][123090] Updated weights for policy 1, policy_version 146408 (0.0009) [2023-12-26 00:45:20,016][123090] Updated weights for policy 1, policy_version 146418 (0.0010) [2023-12-26 00:45:20,083][123090] Updated weights for policy 1, policy_version 146428 (0.0010) [2023-12-26 00:45:20,166][123091] Updated weights for policy 0, policy_version 146977 (0.0010) [2023-12-26 00:45:20,226][123091] Updated weights for policy 0, policy_version 146987 (0.0010) [2023-12-26 00:45:20,286][123091] Updated weights for policy 0, policy_version 146997 (0.0010) [2023-12-26 00:45:20,353][123091] Updated weights for policy 0, policy_version 147007 (0.0009) [2023-12-26 00:45:20,974][123090] Updated weights for policy 1, policy_version 146438 (0.0010) [2023-12-26 00:45:21,048][123090] Updated weights for policy 1, policy_version 146448 (0.0009) [2023-12-26 00:45:21,117][123090] Updated weights for policy 1, policy_version 146458 (0.0009) [2023-12-26 00:45:21,161][123091] Updated weights for policy 0, policy_version 147017 (0.0008) [2023-12-26 00:45:21,231][123091] Updated weights for policy 0, policy_version 147027 (0.0010) [2023-12-26 00:45:21,302][123091] Updated weights for policy 0, policy_version 147037 (0.0009) [2023-12-26 00:45:21,938][123090] Updated weights for policy 1, policy_version 146468 (0.0009) [2023-12-26 00:45:21,997][123090] Updated weights for policy 1, policy_version 146478 (0.0009) [2023-12-26 00:45:22,055][123090] Updated weights for policy 1, policy_version 146488 (0.0009) [2023-12-26 00:45:22,125][123091] Updated weights for policy 0, policy_version 147047 (0.0009) [2023-12-26 00:45:22,188][123091] Updated weights for policy 0, policy_version 147057 (0.0009) [2023-12-26 00:45:22,250][123091] Updated weights for policy 0, policy_version 147067 (0.0010) [2023-12-26 00:45:22,951][123090] Updated weights for policy 1, policy_version 146498 (0.0009) [2023-12-26 00:45:23,013][123090] Updated weights for policy 1, policy_version 146508 (0.0009) [2023-12-26 00:45:23,062][123090] Updated weights for policy 1, policy_version 146518 (0.0009) [2023-12-26 00:45:23,111][123091] Updated weights for policy 0, policy_version 147077 (0.0010) [2023-12-26 00:45:23,118][123090] Updated weights for policy 1, policy_version 146528 (0.0007) [2023-12-26 00:45:23,169][123091] Updated weights for policy 0, policy_version 147087 (0.0009) [2023-12-26 00:45:23,228][123091] Updated weights for policy 0, policy_version 147097 (0.0009) [2023-12-26 00:45:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 75169792. Throughput: 0: 8791.4, 1: 8916.0. Samples: 75149472. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 00:45:23,785][121949] Avg episode reward: [(0, '5726.911'), (1, '5527.619')] [2023-12-26 00:45:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000147104_37658624.pth... [2023-12-26 00:45:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000146528_37511168.pth... [2023-12-26 00:45:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000146080_37396480.pth [2023-12-26 00:45:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000145504_37249024.pth [2023-12-26 00:45:23,957][123090] Updated weights for policy 1, policy_version 146538 (0.0010) [2023-12-26 00:45:24,013][123090] Updated weights for policy 1, policy_version 146548 (0.0010) [2023-12-26 00:45:24,060][123091] Updated weights for policy 0, policy_version 147107 (0.0009) [2023-12-26 00:45:24,070][123090] Updated weights for policy 1, policy_version 146558 (0.0009) [2023-12-26 00:45:24,109][123091] Updated weights for policy 0, policy_version 147117 (0.0009) [2023-12-26 00:45:24,179][123091] Updated weights for policy 0, policy_version 147127 (0.0009) [2023-12-26 00:45:24,865][123090] Updated weights for policy 1, policy_version 146568 (0.0007) [2023-12-26 00:45:24,939][123090] Updated weights for policy 1, policy_version 146578 (0.0006) [2023-12-26 00:45:25,006][123090] Updated weights for policy 1, policy_version 146588 (0.0008) [2023-12-26 00:45:25,045][123091] Updated weights for policy 0, policy_version 147137 (0.0009) [2023-12-26 00:45:25,111][123091] Updated weights for policy 0, policy_version 147147 (0.0008) [2023-12-26 00:45:25,167][123091] Updated weights for policy 0, policy_version 147157 (0.0006) [2023-12-26 00:45:25,232][123091] Updated weights for policy 0, policy_version 147167 (0.0005) [2023-12-26 00:45:25,831][123090] Updated weights for policy 1, policy_version 146598 (0.0010) [2023-12-26 00:45:25,893][123090] Updated weights for policy 1, policy_version 146608 (0.0010) [2023-12-26 00:45:25,955][123090] Updated weights for policy 1, policy_version 146618 (0.0007) [2023-12-26 00:45:25,974][123091] Updated weights for policy 0, policy_version 147177 (0.0008) [2023-12-26 00:45:26,033][123091] Updated weights for policy 0, policy_version 147187 (0.0009) [2023-12-26 00:45:26,092][123091] Updated weights for policy 0, policy_version 147197 (0.0009) [2023-12-26 00:45:26,800][123090] Updated weights for policy 1, policy_version 146628 (0.0009) [2023-12-26 00:45:26,863][123091] Updated weights for policy 0, policy_version 147207 (0.0008) [2023-12-26 00:45:26,865][123090] Updated weights for policy 1, policy_version 146638 (0.0009) [2023-12-26 00:45:26,907][123091] Updated weights for policy 0, policy_version 147217 (0.0007) [2023-12-26 00:45:26,914][123090] Updated weights for policy 1, policy_version 146648 (0.0007) [2023-12-26 00:45:26,952][123091] Updated weights for policy 0, policy_version 147227 (0.0005) [2023-12-26 00:45:27,764][123090] Updated weights for policy 1, policy_version 146658 (0.0009) [2023-12-26 00:45:27,783][123091] Updated weights for policy 0, policy_version 147237 (0.0006) [2023-12-26 00:45:27,823][123090] Updated weights for policy 1, policy_version 146668 (0.0011) [2023-12-26 00:45:27,843][123091] Updated weights for policy 0, policy_version 147247 (0.0007) [2023-12-26 00:45:27,868][123090] Updated weights for policy 1, policy_version 146678 (0.0010) [2023-12-26 00:45:27,892][123091] Updated weights for policy 0, policy_version 147257 (0.0008) [2023-12-26 00:45:27,917][123090] Updated weights for policy 1, policy_version 146688 (0.0010) [2023-12-26 00:45:28,721][123091] Updated weights for policy 0, policy_version 147267 (0.0007) [2023-12-26 00:45:28,775][123091] Updated weights for policy 0, policy_version 147278 (0.0007) [2023-12-26 00:45:28,782][123090] Updated weights for policy 1, policy_version 146698 (0.0011) [2023-12-26 00:45:28,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 75251712. Throughput: 0: 8772.7, 1: 8858.2. Samples: 75252688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:28,785][121949] Avg episode reward: [(0, '5758.092'), (1, '5505.360')] [2023-12-26 00:45:28,823][123091] Updated weights for policy 0, policy_version 147288 (0.0008) [2023-12-26 00:45:28,846][123090] Updated weights for policy 1, policy_version 146708 (0.0011) [2023-12-26 00:45:28,906][123090] Updated weights for policy 1, policy_version 146718 (0.0010) [2023-12-26 00:45:29,568][123091] Updated weights for policy 0, policy_version 147298 (0.0006) [2023-12-26 00:45:29,635][123091] Updated weights for policy 0, policy_version 147308 (0.0010) [2023-12-26 00:45:29,682][123090] Updated weights for policy 1, policy_version 146728 (0.0011) [2023-12-26 00:45:29,691][123091] Updated weights for policy 0, policy_version 147318 (0.0011) [2023-12-26 00:45:29,742][123090] Updated weights for policy 1, policy_version 146738 (0.0010) [2023-12-26 00:45:29,749][123091] Updated weights for policy 0, policy_version 147328 (0.0010) [2023-12-26 00:45:29,800][123090] Updated weights for policy 1, policy_version 146748 (0.0010) [2023-12-26 00:45:30,486][123091] Updated weights for policy 0, policy_version 147338 (0.0005) [2023-12-26 00:45:30,545][123091] Updated weights for policy 0, policy_version 147348 (0.0005) [2023-12-26 00:45:30,600][123091] Updated weights for policy 0, policy_version 147358 (0.0007) [2023-12-26 00:45:30,654][123090] Updated weights for policy 1, policy_version 146758 (0.0009) [2023-12-26 00:45:30,721][123090] Updated weights for policy 1, policy_version 146768 (0.0006) [2023-12-26 00:45:30,789][123090] Updated weights for policy 1, policy_version 146778 (0.0005) [2023-12-26 00:45:31,401][123091] Updated weights for policy 0, policy_version 147368 (0.0008) [2023-12-26 00:45:31,461][123091] Updated weights for policy 0, policy_version 147378 (0.0010) [2023-12-26 00:45:31,528][123091] Updated weights for policy 0, policy_version 147388 (0.0009) [2023-12-26 00:45:31,558][123090] Updated weights for policy 1, policy_version 146788 (0.0007) [2023-12-26 00:45:31,616][123090] Updated weights for policy 1, policy_version 146798 (0.0006) [2023-12-26 00:45:31,682][123090] Updated weights for policy 1, policy_version 146808 (0.0008) [2023-12-26 00:45:32,337][123091] Updated weights for policy 0, policy_version 147398 (0.0008) [2023-12-26 00:45:32,358][123090] Updated weights for policy 1, policy_version 146818 (0.0008) [2023-12-26 00:45:32,408][123091] Updated weights for policy 0, policy_version 147408 (0.0010) [2023-12-26 00:45:32,421][123090] Updated weights for policy 1, policy_version 146828 (0.0008) [2023-12-26 00:45:32,473][123090] Updated weights for policy 1, policy_version 146838 (0.0008) [2023-12-26 00:45:32,473][123091] Updated weights for policy 0, policy_version 147418 (0.0010) [2023-12-26 00:45:32,526][123090] Updated weights for policy 1, policy_version 146848 (0.0009) [2023-12-26 00:45:33,216][123091] Updated weights for policy 0, policy_version 147428 (0.0009) [2023-12-26 00:45:33,264][123091] Updated weights for policy 0, policy_version 147438 (0.0009) [2023-12-26 00:45:33,323][123091] Updated weights for policy 0, policy_version 147448 (0.0011) [2023-12-26 00:45:33,375][123090] Updated weights for policy 1, policy_version 146858 (0.0006) [2023-12-26 00:45:33,426][123090] Updated weights for policy 1, policy_version 146868 (0.0009) [2023-12-26 00:45:33,474][123090] Updated weights for policy 1, policy_version 146879 (0.0009) [2023-12-26 00:45:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 75350016. Throughput: 0: 8749.3, 1: 8836.4. Samples: 75359964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:33,785][121949] Avg episode reward: [(0, '5763.619'), (1, '5490.300')] [2023-12-26 00:45:34,074][123091] Updated weights for policy 0, policy_version 147458 (0.0009) [2023-12-26 00:45:34,132][123091] Updated weights for policy 0, policy_version 147468 (0.0005) [2023-12-26 00:45:34,193][123091] Updated weights for policy 0, policy_version 147478 (0.0009) [2023-12-26 00:45:34,241][123091] Updated weights for policy 0, policy_version 147488 (0.0008) [2023-12-26 00:45:34,385][123090] Updated weights for policy 1, policy_version 146889 (0.0009) [2023-12-26 00:45:34,457][123090] Updated weights for policy 1, policy_version 146899 (0.0009) [2023-12-26 00:45:34,531][123090] Updated weights for policy 1, policy_version 146909 (0.0010) [2023-12-26 00:45:35,005][123091] Updated weights for policy 0, policy_version 147498 (0.0009) [2023-12-26 00:45:35,063][123091] Updated weights for policy 0, policy_version 147508 (0.0006) [2023-12-26 00:45:35,126][123091] Updated weights for policy 0, policy_version 147518 (0.0006) [2023-12-26 00:45:35,311][123090] Updated weights for policy 1, policy_version 146919 (0.0006) [2023-12-26 00:45:35,361][123090] Updated weights for policy 1, policy_version 146929 (0.0008) [2023-12-26 00:45:35,412][123090] Updated weights for policy 1, policy_version 146939 (0.0010) [2023-12-26 00:45:35,786][123091] Updated weights for policy 0, policy_version 147528 (0.0006) [2023-12-26 00:45:35,837][123091] Updated weights for policy 0, policy_version 147538 (0.0009) [2023-12-26 00:45:35,890][123091] Updated weights for policy 0, policy_version 147548 (0.0006) [2023-12-26 00:45:36,195][123090] Updated weights for policy 1, policy_version 146949 (0.0010) [2023-12-26 00:45:36,254][123090] Updated weights for policy 1, policy_version 146959 (0.0008) [2023-12-26 00:45:36,326][123090] Updated weights for policy 1, policy_version 146969 (0.0006) [2023-12-26 00:45:36,602][123091] Updated weights for policy 0, policy_version 147558 (0.0006) [2023-12-26 00:45:36,664][123091] Updated weights for policy 0, policy_version 147568 (0.0006) [2023-12-26 00:45:36,732][123091] Updated weights for policy 0, policy_version 147578 (0.0006) [2023-12-26 00:45:37,063][123090] Updated weights for policy 1, policy_version 146979 (0.0008) [2023-12-26 00:45:37,127][123090] Updated weights for policy 1, policy_version 146989 (0.0007) [2023-12-26 00:45:37,193][123090] Updated weights for policy 1, policy_version 146999 (0.0010) [2023-12-26 00:45:37,477][123091] Updated weights for policy 0, policy_version 147588 (0.0007) [2023-12-26 00:45:37,533][123091] Updated weights for policy 0, policy_version 147598 (0.0009) [2023-12-26 00:45:37,586][123091] Updated weights for policy 0, policy_version 147608 (0.0009) [2023-12-26 00:45:37,945][123090] Updated weights for policy 1, policy_version 147009 (0.0010) [2023-12-26 00:45:38,016][123090] Updated weights for policy 1, policy_version 147019 (0.0006) [2023-12-26 00:45:38,070][123090] Updated weights for policy 1, policy_version 147029 (0.0006) [2023-12-26 00:45:38,121][123090] Updated weights for policy 1, policy_version 147039 (0.0007) [2023-12-26 00:45:38,377][123091] Updated weights for policy 0, policy_version 147618 (0.0009) [2023-12-26 00:45:38,437][123091] Updated weights for policy 0, policy_version 147628 (0.0009) [2023-12-26 00:45:38,495][123091] Updated weights for policy 0, policy_version 147638 (0.0009) [2023-12-26 00:45:38,552][123091] Updated weights for policy 0, policy_version 147648 (0.0009) [2023-12-26 00:45:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 75440128. Throughput: 0: 8846.6, 1: 8828.8. Samples: 75415616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:38,785][121949] Avg episode reward: [(0, '5799.234'), (1, '5546.748')] [2023-12-26 00:45:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000147648_37797888.pth... [2023-12-26 00:45:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000147040_37642240.pth... [2023-12-26 00:45:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000146592_37527552.pth [2023-12-26 00:45:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000146016_37380096.pth [2023-12-26 00:45:38,874][123090] Updated weights for policy 1, policy_version 147049 (0.0010) [2023-12-26 00:45:38,942][123090] Updated weights for policy 1, policy_version 147059 (0.0010) [2023-12-26 00:45:39,009][123090] Updated weights for policy 1, policy_version 147069 (0.0010) [2023-12-26 00:45:39,435][123091] Updated weights for policy 0, policy_version 147658 (0.0010) [2023-12-26 00:45:39,496][123091] Updated weights for policy 0, policy_version 147668 (0.0009) [2023-12-26 00:45:39,556][123091] Updated weights for policy 0, policy_version 147678 (0.0009) [2023-12-26 00:45:39,844][123090] Updated weights for policy 1, policy_version 147079 (0.0011) [2023-12-26 00:45:39,916][123090] Updated weights for policy 1, policy_version 147089 (0.0011) [2023-12-26 00:45:39,989][123090] Updated weights for policy 1, policy_version 147099 (0.0011) [2023-12-26 00:45:40,375][123091] Updated weights for policy 0, policy_version 147688 (0.0009) [2023-12-26 00:45:40,444][123091] Updated weights for policy 0, policy_version 147698 (0.0009) [2023-12-26 00:45:40,505][123091] Updated weights for policy 0, policy_version 147708 (0.0009) [2023-12-26 00:45:40,798][123090] Updated weights for policy 1, policy_version 147109 (0.0010) [2023-12-26 00:45:40,850][123090] Updated weights for policy 1, policy_version 147119 (0.0010) [2023-12-26 00:45:40,913][123090] Updated weights for policy 1, policy_version 147129 (0.0010) [2023-12-26 00:45:41,366][123091] Updated weights for policy 0, policy_version 147718 (0.0010) [2023-12-26 00:45:41,430][123091] Updated weights for policy 0, policy_version 147728 (0.0009) [2023-12-26 00:45:41,495][123091] Updated weights for policy 0, policy_version 147738 (0.0009) [2023-12-26 00:45:41,808][123090] Updated weights for policy 1, policy_version 147139 (0.0010) [2023-12-26 00:45:41,876][123090] Updated weights for policy 1, policy_version 147149 (0.0011) [2023-12-26 00:45:41,934][123090] Updated weights for policy 1, policy_version 147159 (0.0010) [2023-12-26 00:45:42,382][123091] Updated weights for policy 0, policy_version 147748 (0.0009) [2023-12-26 00:45:42,449][123091] Updated weights for policy 0, policy_version 147758 (0.0008) [2023-12-26 00:45:42,516][123091] Updated weights for policy 0, policy_version 147768 (0.0010) [2023-12-26 00:45:42,792][123090] Updated weights for policy 1, policy_version 147169 (0.0011) [2023-12-26 00:45:42,851][123090] Updated weights for policy 1, policy_version 147179 (0.0008) [2023-12-26 00:45:42,914][123090] Updated weights for policy 1, policy_version 147189 (0.0007) [2023-12-26 00:45:42,968][123090] Updated weights for policy 1, policy_version 147199 (0.0005) [2023-12-26 00:45:43,333][123091] Updated weights for policy 0, policy_version 147778 (0.0011) [2023-12-26 00:45:43,384][123091] Updated weights for policy 0, policy_version 147788 (0.0010) [2023-12-26 00:45:43,432][123091] Updated weights for policy 0, policy_version 147798 (0.0010) [2023-12-26 00:45:43,482][123091] Updated weights for policy 0, policy_version 147808 (0.0010) [2023-12-26 00:45:43,702][123090] Updated weights for policy 1, policy_version 147209 (0.0005) [2023-12-26 00:45:43,757][123090] Updated weights for policy 1, policy_version 147219 (0.0005) [2023-12-26 00:45:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 75522048. Throughput: 0: 8787.5, 1: 8804.4. Samples: 75518104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:43,785][121949] Avg episode reward: [(0, '5762.551'), (1, '5585.009')] [2023-12-26 00:45:43,809][123090] Updated weights for policy 1, policy_version 147229 (0.0005) [2023-12-26 00:45:44,252][123091] Updated weights for policy 0, policy_version 147818 (0.0009) [2023-12-26 00:45:44,300][123091] Updated weights for policy 0, policy_version 147828 (0.0010) [2023-12-26 00:45:44,351][123091] Updated weights for policy 0, policy_version 147838 (0.0010) [2023-12-26 00:45:44,483][123090] Updated weights for policy 1, policy_version 147239 (0.0009) [2023-12-26 00:45:44,530][123090] Updated weights for policy 1, policy_version 147249 (0.0010) [2023-12-26 00:45:44,577][123090] Updated weights for policy 1, policy_version 147259 (0.0010) [2023-12-26 00:45:45,215][123091] Updated weights for policy 0, policy_version 147848 (0.0010) [2023-12-26 00:45:45,282][123091] Updated weights for policy 0, policy_version 147858 (0.0009) [2023-12-26 00:45:45,344][123091] Updated weights for policy 0, policy_version 147868 (0.0009) [2023-12-26 00:45:45,419][123090] Updated weights for policy 1, policy_version 147269 (0.0010) [2023-12-26 00:45:45,482][123090] Updated weights for policy 1, policy_version 147279 (0.0010) [2023-12-26 00:45:45,545][123090] Updated weights for policy 1, policy_version 147289 (0.0010) [2023-12-26 00:45:46,256][123091] Updated weights for policy 0, policy_version 147878 (0.0009) [2023-12-26 00:45:46,262][123090] Updated weights for policy 1, policy_version 147299 (0.0009) [2023-12-26 00:45:46,314][123091] Updated weights for policy 0, policy_version 147888 (0.0010) [2023-12-26 00:45:46,331][123090] Updated weights for policy 1, policy_version 147309 (0.0005) [2023-12-26 00:45:46,362][123091] Updated weights for policy 0, policy_version 147898 (0.0009) [2023-12-26 00:45:46,386][123090] Updated weights for policy 1, policy_version 147319 (0.0005) [2023-12-26 00:45:47,038][123090] Updated weights for policy 1, policy_version 147329 (0.0005) [2023-12-26 00:45:47,096][123090] Updated weights for policy 1, policy_version 147339 (0.0005) [2023-12-26 00:45:47,145][123091] Updated weights for policy 0, policy_version 147908 (0.0008) [2023-12-26 00:45:47,153][123090] Updated weights for policy 1, policy_version 147349 (0.0010) [2023-12-26 00:45:47,194][123091] Updated weights for policy 0, policy_version 147918 (0.0005) [2023-12-26 00:45:47,208][123090] Updated weights for policy 1, policy_version 147359 (0.0010) [2023-12-26 00:45:47,241][123091] Updated weights for policy 0, policy_version 147928 (0.0005) [2023-12-26 00:45:47,977][123091] Updated weights for policy 0, policy_version 147938 (0.0007) [2023-12-26 00:45:48,038][123091] Updated weights for policy 0, policy_version 147948 (0.0009) [2023-12-26 00:45:48,046][123090] Updated weights for policy 1, policy_version 147369 (0.0010) [2023-12-26 00:45:48,094][123090] Updated weights for policy 1, policy_version 147379 (0.0010) [2023-12-26 00:45:48,101][123091] Updated weights for policy 0, policy_version 147958 (0.0009) [2023-12-26 00:45:48,145][123090] Updated weights for policy 1, policy_version 147389 (0.0010) [2023-12-26 00:45:48,152][123091] Updated weights for policy 0, policy_version 147968 (0.0006) [2023-12-26 00:45:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 75612160. Throughput: 0: 8796.5, 1: 8888.9. Samples: 75627364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:48,785][121949] Avg episode reward: [(0, '5659.782'), (1, '5512.451')] [2023-12-26 00:45:48,933][123091] Updated weights for policy 0, policy_version 147978 (0.0010) [2023-12-26 00:45:48,976][123090] Updated weights for policy 1, policy_version 147399 (0.0010) [2023-12-26 00:45:48,992][123091] Updated weights for policy 0, policy_version 147988 (0.0007) [2023-12-26 00:45:49,028][123090] Updated weights for policy 1, policy_version 147409 (0.0010) [2023-12-26 00:45:49,054][123091] Updated weights for policy 0, policy_version 147998 (0.0006) [2023-12-26 00:45:49,085][123090] Updated weights for policy 1, policy_version 147419 (0.0010) [2023-12-26 00:45:49,893][123090] Updated weights for policy 1, policy_version 147429 (0.0011) [2023-12-26 00:45:49,913][123091] Updated weights for policy 0, policy_version 148008 (0.0009) [2023-12-26 00:45:49,959][123090] Updated weights for policy 1, policy_version 147439 (0.0011) [2023-12-26 00:45:49,980][123091] Updated weights for policy 0, policy_version 148018 (0.0009) [2023-12-26 00:45:50,027][123090] Updated weights for policy 1, policy_version 147449 (0.0011) [2023-12-26 00:45:50,047][123091] Updated weights for policy 0, policy_version 148028 (0.0009) [2023-12-26 00:45:50,724][123090] Updated weights for policy 1, policy_version 147459 (0.0010) [2023-12-26 00:45:50,803][123090] Updated weights for policy 1, policy_version 147469 (0.0005) [2023-12-26 00:45:50,866][123091] Updated weights for policy 0, policy_version 148038 (0.0006) [2023-12-26 00:45:50,876][123090] Updated weights for policy 1, policy_version 147479 (0.0005) [2023-12-26 00:45:50,924][123091] Updated weights for policy 0, policy_version 148048 (0.0005) [2023-12-26 00:45:50,990][123091] Updated weights for policy 0, policy_version 148058 (0.0005) [2023-12-26 00:45:51,567][123090] Updated weights for policy 1, policy_version 147489 (0.0007) [2023-12-26 00:45:51,660][123090] Updated weights for policy 1, policy_version 147499 (0.0008) [2023-12-26 00:45:51,739][123090] Updated weights for policy 1, policy_version 147509 (0.0008) [2023-12-26 00:45:51,772][123091] Updated weights for policy 0, policy_version 148068 (0.0008) [2023-12-26 00:45:51,815][123090] Updated weights for policy 1, policy_version 147519 (0.0009) [2023-12-26 00:45:51,834][123091] Updated weights for policy 0, policy_version 148078 (0.0009) [2023-12-26 00:45:51,895][123091] Updated weights for policy 0, policy_version 148088 (0.0008) [2023-12-26 00:45:52,567][123090] Updated weights for policy 1, policy_version 147529 (0.0011) [2023-12-26 00:45:52,635][123090] Updated weights for policy 1, policy_version 147539 (0.0011) [2023-12-26 00:45:52,701][123090] Updated weights for policy 1, policy_version 147549 (0.0010) [2023-12-26 00:45:52,783][123091] Updated weights for policy 0, policy_version 148098 (0.0008) [2023-12-26 00:45:52,845][123091] Updated weights for policy 0, policy_version 148108 (0.0009) [2023-12-26 00:45:52,914][123091] Updated weights for policy 0, policy_version 148118 (0.0005) [2023-12-26 00:45:52,976][123091] Updated weights for policy 0, policy_version 148128 (0.0005) [2023-12-26 00:45:53,430][123090] Updated weights for policy 1, policy_version 147559 (0.0011) [2023-12-26 00:45:53,496][123090] Updated weights for policy 1, policy_version 147569 (0.0010) [2023-12-26 00:45:53,545][123091] Updated weights for policy 0, policy_version 148138 (0.0008) [2023-12-26 00:45:53,555][123090] Updated weights for policy 1, policy_version 147579 (0.0010) [2023-12-26 00:45:53,600][123091] Updated weights for policy 0, policy_version 148148 (0.0008) [2023-12-26 00:45:53,656][123091] Updated weights for policy 0, policy_version 148158 (0.0008) [2023-12-26 00:45:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 75710464. Throughput: 0: 8816.3, 1: 8889.5. Samples: 75680632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:53,786][121949] Avg episode reward: [(0, '5673.397'), (1, '5217.554')] [2023-12-26 00:45:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000148160_37928960.pth... [2023-12-26 00:45:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000147584_37781504.pth... [2023-12-26 00:45:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000147104_37658624.pth [2023-12-26 00:45:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000146528_37511168.pth [2023-12-26 00:45:54,367][123090] Updated weights for policy 1, policy_version 147589 (0.0010) [2023-12-26 00:45:54,435][123090] Updated weights for policy 1, policy_version 147599 (0.0011) [2023-12-26 00:45:54,446][123091] Updated weights for policy 0, policy_version 148168 (0.0011) [2023-12-26 00:45:54,499][123090] Updated weights for policy 1, policy_version 147609 (0.0011) [2023-12-26 00:45:54,505][123091] Updated weights for policy 0, policy_version 148178 (0.0011) [2023-12-26 00:45:54,564][123091] Updated weights for policy 0, policy_version 148188 (0.0011) [2023-12-26 00:45:55,336][123090] Updated weights for policy 1, policy_version 147619 (0.0009) [2023-12-26 00:45:55,400][123090] Updated weights for policy 1, policy_version 147629 (0.0006) [2023-12-26 00:45:55,403][123091] Updated weights for policy 0, policy_version 148198 (0.0008) [2023-12-26 00:45:55,450][123090] Updated weights for policy 1, policy_version 147639 (0.0008) [2023-12-26 00:45:55,468][123091] Updated weights for policy 0, policy_version 148208 (0.0005) [2023-12-26 00:45:55,528][123091] Updated weights for policy 0, policy_version 148218 (0.0005) [2023-12-26 00:45:56,258][123090] Updated weights for policy 1, policy_version 147649 (0.0010) [2023-12-26 00:45:56,314][123090] Updated weights for policy 1, policy_version 147659 (0.0008) [2023-12-26 00:45:56,320][123091] Updated weights for policy 0, policy_version 148228 (0.0007) [2023-12-26 00:45:56,364][123091] Updated weights for policy 0, policy_version 148238 (0.0010) [2023-12-26 00:45:56,366][123090] Updated weights for policy 1, policy_version 147669 (0.0005) [2023-12-26 00:45:56,418][123091] Updated weights for policy 0, policy_version 148248 (0.0010) [2023-12-26 00:45:56,432][123090] Updated weights for policy 1, policy_version 147679 (0.0006) [2023-12-26 00:45:57,279][123091] Updated weights for policy 0, policy_version 148258 (0.0011) [2023-12-26 00:45:57,291][123090] Updated weights for policy 1, policy_version 147689 (0.0006) [2023-12-26 00:45:57,345][123091] Updated weights for policy 0, policy_version 148268 (0.0007) [2023-12-26 00:45:57,350][123090] Updated weights for policy 1, policy_version 147699 (0.0009) [2023-12-26 00:45:57,397][123090] Updated weights for policy 1, policy_version 147709 (0.0008) [2023-12-26 00:45:57,406][123091] Updated weights for policy 0, policy_version 148278 (0.0008) [2023-12-26 00:45:57,475][123091] Updated weights for policy 0, policy_version 148288 (0.0010) [2023-12-26 00:45:58,169][123090] Updated weights for policy 1, policy_version 147719 (0.0008) [2023-12-26 00:45:58,227][123091] Updated weights for policy 0, policy_version 148298 (0.0008) [2023-12-26 00:45:58,234][123090] Updated weights for policy 1, policy_version 147729 (0.0008) [2023-12-26 00:45:58,296][123091] Updated weights for policy 0, policy_version 148308 (0.0008) [2023-12-26 00:45:58,301][123090] Updated weights for policy 1, policy_version 147739 (0.0011) [2023-12-26 00:45:58,371][123091] Updated weights for policy 0, policy_version 148318 (0.0008) [2023-12-26 00:45:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 75792384. Throughput: 0: 8816.3, 1: 8849.8. Samples: 75786300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:45:58,785][121949] Avg episode reward: [(0, '5747.554'), (1, '5256.224')] [2023-12-26 00:45:59,175][123090] Updated weights for policy 1, policy_version 147749 (0.0011) [2023-12-26 00:45:59,247][123090] Updated weights for policy 1, policy_version 147759 (0.0009) [2023-12-26 00:45:59,275][123091] Updated weights for policy 0, policy_version 148328 (0.0008) [2023-12-26 00:45:59,319][123090] Updated weights for policy 1, policy_version 147769 (0.0008) [2023-12-26 00:45:59,339][123091] Updated weights for policy 0, policy_version 148338 (0.0009) [2023-12-26 00:45:59,403][123091] Updated weights for policy 0, policy_version 148348 (0.0011) [2023-12-26 00:46:00,183][123090] Updated weights for policy 1, policy_version 147779 (0.0009) [2023-12-26 00:46:00,234][123090] Updated weights for policy 1, policy_version 147789 (0.0008) [2023-12-26 00:46:00,260][123091] Updated weights for policy 0, policy_version 148358 (0.0009) [2023-12-26 00:46:00,288][123090] Updated weights for policy 1, policy_version 147799 (0.0007) [2023-12-26 00:46:00,313][123091] Updated weights for policy 0, policy_version 148368 (0.0008) [2023-12-26 00:46:00,384][123091] Updated weights for policy 0, policy_version 148378 (0.0008) [2023-12-26 00:46:01,173][123090] Updated weights for policy 1, policy_version 147809 (0.0009) [2023-12-26 00:46:01,226][123091] Updated weights for policy 0, policy_version 148388 (0.0010) [2023-12-26 00:46:01,229][123090] Updated weights for policy 1, policy_version 147819 (0.0010) [2023-12-26 00:46:01,286][123090] Updated weights for policy 1, policy_version 147829 (0.0011) [2023-12-26 00:46:01,289][123091] Updated weights for policy 0, policy_version 148398 (0.0008) [2023-12-26 00:46:01,348][123090] Updated weights for policy 1, policy_version 147839 (0.0010) [2023-12-26 00:46:01,356][123091] Updated weights for policy 0, policy_version 148408 (0.0008) [2023-12-26 00:46:02,175][123090] Updated weights for policy 1, policy_version 147849 (0.0011) [2023-12-26 00:46:02,246][123090] Updated weights for policy 1, policy_version 147859 (0.0007) [2023-12-26 00:46:02,255][123091] Updated weights for policy 0, policy_version 148418 (0.0010) [2023-12-26 00:46:02,316][123090] Updated weights for policy 1, policy_version 147869 (0.0010) [2023-12-26 00:46:02,320][123091] Updated weights for policy 0, policy_version 148428 (0.0008) [2023-12-26 00:46:02,384][123091] Updated weights for policy 0, policy_version 148438 (0.0009) [2023-12-26 00:46:02,457][123091] Updated weights for policy 0, policy_version 148448 (0.0009) [2023-12-26 00:46:03,055][123090] Updated weights for policy 1, policy_version 147879 (0.0007) [2023-12-26 00:46:03,117][123090] Updated weights for policy 1, policy_version 147889 (0.0006) [2023-12-26 00:46:03,185][123090] Updated weights for policy 1, policy_version 147899 (0.0008) [2023-12-26 00:46:03,315][123091] Updated weights for policy 0, policy_version 148458 (0.0010) [2023-12-26 00:46:03,370][123091] Updated weights for policy 0, policy_version 148468 (0.0009) [2023-12-26 00:46:03,427][123091] Updated weights for policy 0, policy_version 148478 (0.0009) [2023-12-26 00:46:03,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 75874304. Throughput: 0: 8741.4, 1: 8728.2. Samples: 75885600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:46:03,785][121949] Avg episode reward: [(0, '5597.682'), (1, '5315.890')] [2023-12-26 00:46:04,007][123090] Updated weights for policy 1, policy_version 147909 (0.0009) [2023-12-26 00:46:04,081][123090] Updated weights for policy 1, policy_version 147919 (0.0009) [2023-12-26 00:46:04,137][123090] Updated weights for policy 1, policy_version 147929 (0.0009) [2023-12-26 00:46:04,249][123091] Updated weights for policy 0, policy_version 148488 (0.0009) [2023-12-26 00:46:04,325][123091] Updated weights for policy 0, policy_version 148498 (0.0007) [2023-12-26 00:46:04,387][123091] Updated weights for policy 0, policy_version 148508 (0.0008) [2023-12-26 00:46:05,049][123090] Updated weights for policy 1, policy_version 147939 (0.0010) [2023-12-26 00:46:05,081][123091] Updated weights for policy 0, policy_version 148518 (0.0007) [2023-12-26 00:46:05,101][123090] Updated weights for policy 1, policy_version 147950 (0.0009) [2023-12-26 00:46:05,141][123091] Updated weights for policy 0, policy_version 148528 (0.0011) [2023-12-26 00:46:05,151][123090] Updated weights for policy 1, policy_version 147960 (0.0008) [2023-12-26 00:46:05,193][123091] Updated weights for policy 0, policy_version 148538 (0.0011) [2023-12-26 00:46:06,015][123090] Updated weights for policy 1, policy_version 147970 (0.0008) [2023-12-26 00:46:06,025][123091] Updated weights for policy 0, policy_version 148548 (0.0009) [2023-12-26 00:46:06,087][123090] Updated weights for policy 1, policy_version 147980 (0.0009) [2023-12-26 00:46:06,089][123091] Updated weights for policy 0, policy_version 148558 (0.0006) [2023-12-26 00:46:06,153][123090] Updated weights for policy 1, policy_version 147990 (0.0010) [2023-12-26 00:46:06,154][123091] Updated weights for policy 0, policy_version 148568 (0.0007) [2023-12-26 00:46:06,216][123090] Updated weights for policy 1, policy_version 148000 (0.0008) [2023-12-26 00:46:06,897][123091] Updated weights for policy 0, policy_version 148578 (0.0008) [2023-12-26 00:46:06,949][123091] Updated weights for policy 0, policy_version 148588 (0.0011) [2023-12-26 00:46:07,015][123091] Updated weights for policy 0, policy_version 148598 (0.0011) [2023-12-26 00:46:07,075][123091] Updated weights for policy 0, policy_version 148608 (0.0006) [2023-12-26 00:46:07,093][123090] Updated weights for policy 1, policy_version 148010 (0.0009) [2023-12-26 00:46:07,140][123090] Updated weights for policy 1, policy_version 148020 (0.0008) [2023-12-26 00:46:07,198][123090] Updated weights for policy 1, policy_version 148030 (0.0009) [2023-12-26 00:46:07,787][123091] Updated weights for policy 0, policy_version 148618 (0.0006) [2023-12-26 00:46:07,837][123091] Updated weights for policy 0, policy_version 148628 (0.0005) [2023-12-26 00:46:07,887][123091] Updated weights for policy 0, policy_version 148638 (0.0007) [2023-12-26 00:46:08,065][123090] Updated weights for policy 1, policy_version 148040 (0.0009) [2023-12-26 00:46:08,136][123090] Updated weights for policy 1, policy_version 148050 (0.0010) [2023-12-26 00:46:08,195][123090] Updated weights for policy 1, policy_version 148060 (0.0010) [2023-12-26 00:46:08,636][123091] Updated weights for policy 0, policy_version 148648 (0.0009) [2023-12-26 00:46:08,691][123091] Updated weights for policy 0, policy_version 148658 (0.0008) [2023-12-26 00:46:08,753][123091] Updated weights for policy 0, policy_version 148668 (0.0008) [2023-12-26 00:46:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 75964416. Throughput: 0: 8784.5, 1: 8720.2. Samples: 75937180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:46:08,785][121949] Avg episode reward: [(0, '5591.201'), (1, '5271.692')] [2023-12-26 00:46:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000148672_38060032.pth... [2023-12-26 00:46:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000148064_37904384.pth... [2023-12-26 00:46:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000147648_37797888.pth [2023-12-26 00:46:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000147040_37642240.pth [2023-12-26 00:46:09,086][123090] Updated weights for policy 1, policy_version 148070 (0.0009) [2023-12-26 00:46:09,143][123090] Updated weights for policy 1, policy_version 148080 (0.0009) [2023-12-26 00:46:09,191][123090] Updated weights for policy 1, policy_version 148090 (0.0008) [2023-12-26 00:46:09,569][123091] Updated weights for policy 0, policy_version 148678 (0.0007) [2023-12-26 00:46:09,628][123091] Updated weights for policy 0, policy_version 148688 (0.0006) [2023-12-26 00:46:09,696][123091] Updated weights for policy 0, policy_version 148698 (0.0006) [2023-12-26 00:46:10,089][123090] Updated weights for policy 1, policy_version 148100 (0.0009) [2023-12-26 00:46:10,147][123090] Updated weights for policy 1, policy_version 148110 (0.0009) [2023-12-26 00:46:10,205][123090] Updated weights for policy 1, policy_version 148120 (0.0009) [2023-12-26 00:46:10,487][123091] Updated weights for policy 0, policy_version 148708 (0.0009) [2023-12-26 00:46:10,559][123091] Updated weights for policy 0, policy_version 148718 (0.0007) [2023-12-26 00:46:10,621][123091] Updated weights for policy 0, policy_version 148728 (0.0009) [2023-12-26 00:46:10,953][123090] Updated weights for policy 1, policy_version 148130 (0.0009) [2023-12-26 00:46:11,021][123090] Updated weights for policy 1, policy_version 148140 (0.0008) [2023-12-26 00:46:11,096][123090] Updated weights for policy 1, policy_version 148150 (0.0007) [2023-12-26 00:46:11,169][123090] Updated weights for policy 1, policy_version 148160 (0.0009) [2023-12-26 00:46:11,455][123091] Updated weights for policy 0, policy_version 148738 (0.0010) [2023-12-26 00:46:11,510][123091] Updated weights for policy 0, policy_version 148748 (0.0010) [2023-12-26 00:46:11,571][123091] Updated weights for policy 0, policy_version 148758 (0.0010) [2023-12-26 00:46:11,638][123091] Updated weights for policy 0, policy_version 148768 (0.0011) [2023-12-26 00:46:12,027][123090] Updated weights for policy 1, policy_version 148170 (0.0010) [2023-12-26 00:46:12,080][123090] Updated weights for policy 1, policy_version 148180 (0.0009) [2023-12-26 00:46:12,157][123090] Updated weights for policy 1, policy_version 148190 (0.0008) [2023-12-26 00:46:12,465][123091] Updated weights for policy 0, policy_version 148778 (0.0011) [2023-12-26 00:46:12,517][123091] Updated weights for policy 0, policy_version 148788 (0.0011) [2023-12-26 00:46:12,574][123091] Updated weights for policy 0, policy_version 148798 (0.0011) [2023-12-26 00:46:12,916][123090] Updated weights for policy 1, policy_version 148200 (0.0006) [2023-12-26 00:46:12,962][123090] Updated weights for policy 1, policy_version 148210 (0.0005) [2023-12-26 00:46:13,011][123090] Updated weights for policy 1, policy_version 148220 (0.0010) [2023-12-26 00:46:13,413][123091] Updated weights for policy 0, policy_version 148808 (0.0009) [2023-12-26 00:46:13,470][123091] Updated weights for policy 0, policy_version 148818 (0.0008) [2023-12-26 00:46:13,529][123091] Updated weights for policy 0, policy_version 148828 (0.0010) [2023-12-26 00:46:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 76046336. Throughput: 0: 8809.5, 1: 8686.0. Samples: 76039988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:46:13,785][121949] Avg episode reward: [(0, '5678.707'), (1, '5321.183')] [2023-12-26 00:46:13,809][123090] Updated weights for policy 1, policy_version 148230 (0.0007) [2023-12-26 00:46:13,879][123090] Updated weights for policy 1, policy_version 148240 (0.0005) [2023-12-26 00:46:13,947][123090] Updated weights for policy 1, policy_version 148250 (0.0006) [2023-12-26 00:46:14,244][123091] Updated weights for policy 0, policy_version 148838 (0.0007) [2023-12-26 00:46:14,301][123091] Updated weights for policy 0, policy_version 148848 (0.0005) [2023-12-26 00:46:14,355][123091] Updated weights for policy 0, policy_version 148858 (0.0005) [2023-12-26 00:46:14,638][123090] Updated weights for policy 1, policy_version 148260 (0.0007) [2023-12-26 00:46:14,706][123090] Updated weights for policy 1, policy_version 148270 (0.0008) [2023-12-26 00:46:14,772][123090] Updated weights for policy 1, policy_version 148280 (0.0008) [2023-12-26 00:46:15,156][123091] Updated weights for policy 0, policy_version 148868 (0.0007) [2023-12-26 00:46:15,211][123091] Updated weights for policy 0, policy_version 148878 (0.0010) [2023-12-26 00:46:15,275][123091] Updated weights for policy 0, policy_version 148888 (0.0010) [2023-12-26 00:46:15,516][123090] Updated weights for policy 1, policy_version 148290 (0.0007) [2023-12-26 00:46:15,595][123090] Updated weights for policy 1, policy_version 148300 (0.0005) [2023-12-26 00:46:15,651][123090] Updated weights for policy 1, policy_version 148310 (0.0005) [2023-12-26 00:46:15,715][123090] Updated weights for policy 1, policy_version 148320 (0.0005) [2023-12-26 00:46:16,178][123091] Updated weights for policy 0, policy_version 148898 (0.0010) [2023-12-26 00:46:16,239][123091] Updated weights for policy 0, policy_version 148908 (0.0010) [2023-12-26 00:46:16,296][123091] Updated weights for policy 0, policy_version 148918 (0.0009) [2023-12-26 00:46:16,364][123091] Updated weights for policy 0, policy_version 148928 (0.0009) [2023-12-26 00:46:16,455][123090] Updated weights for policy 1, policy_version 148330 (0.0010) [2023-12-26 00:46:16,507][123090] Updated weights for policy 1, policy_version 148340 (0.0010) [2023-12-26 00:46:16,574][123090] Updated weights for policy 1, policy_version 148350 (0.0010) [2023-12-26 00:46:17,241][123091] Updated weights for policy 0, policy_version 148938 (0.0010) [2023-12-26 00:46:17,290][123090] Updated weights for policy 1, policy_version 148360 (0.0006) [2023-12-26 00:46:17,294][123091] Updated weights for policy 0, policy_version 148948 (0.0009) [2023-12-26 00:46:17,347][123090] Updated weights for policy 1, policy_version 148370 (0.0009) [2023-12-26 00:46:17,359][123091] Updated weights for policy 0, policy_version 148958 (0.0007) [2023-12-26 00:46:17,409][123090] Updated weights for policy 1, policy_version 148380 (0.0010) [2023-12-26 00:46:18,108][123090] Updated weights for policy 1, policy_version 148390 (0.0007) [2023-12-26 00:46:18,157][123090] Updated weights for policy 1, policy_version 148400 (0.0005) [2023-12-26 00:46:18,213][123090] Updated weights for policy 1, policy_version 148410 (0.0006) [2023-12-26 00:46:18,256][123091] Updated weights for policy 0, policy_version 148968 (0.0008) [2023-12-26 00:46:18,314][123091] Updated weights for policy 0, policy_version 148978 (0.0009) [2023-12-26 00:46:18,383][123091] Updated weights for policy 0, policy_version 148988 (0.0009) [2023-12-26 00:46:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 76136448. Throughput: 0: 8718.1, 1: 8797.2. Samples: 76148148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:46:18,785][121949] Avg episode reward: [(0, '5640.069'), (1, '5548.470')] [2023-12-26 00:46:18,967][123090] Updated weights for policy 1, policy_version 148420 (0.0010) [2023-12-26 00:46:19,038][123090] Updated weights for policy 1, policy_version 148430 (0.0010) [2023-12-26 00:46:19,093][123090] Updated weights for policy 1, policy_version 148440 (0.0010) [2023-12-26 00:46:19,272][123091] Updated weights for policy 0, policy_version 148998 (0.0009) [2023-12-26 00:46:19,347][123091] Updated weights for policy 0, policy_version 149008 (0.0008) [2023-12-26 00:46:19,409][123091] Updated weights for policy 0, policy_version 149018 (0.0008) [2023-12-26 00:46:19,899][123090] Updated weights for policy 1, policy_version 148450 (0.0010) [2023-12-26 00:46:19,966][123090] Updated weights for policy 1, policy_version 148460 (0.0008) [2023-12-26 00:46:20,029][123090] Updated weights for policy 1, policy_version 148470 (0.0008) [2023-12-26 00:46:20,098][123090] Updated weights for policy 1, policy_version 148480 (0.0009) [2023-12-26 00:46:20,221][123091] Updated weights for policy 0, policy_version 149028 (0.0008) [2023-12-26 00:46:20,286][123091] Updated weights for policy 0, policy_version 149038 (0.0008) [2023-12-26 00:46:20,351][123091] Updated weights for policy 0, policy_version 149048 (0.0010) [2023-12-26 00:46:20,926][123090] Updated weights for policy 1, policy_version 148490 (0.0010) [2023-12-26 00:46:20,979][123090] Updated weights for policy 1, policy_version 148500 (0.0010) [2023-12-26 00:46:21,044][123090] Updated weights for policy 1, policy_version 148510 (0.0011) [2023-12-26 00:46:21,181][123091] Updated weights for policy 0, policy_version 149058 (0.0009) [2023-12-26 00:46:21,239][123091] Updated weights for policy 0, policy_version 149068 (0.0009) [2023-12-26 00:46:21,303][123091] Updated weights for policy 0, policy_version 149078 (0.0009) [2023-12-26 00:46:21,383][123091] Updated weights for policy 0, policy_version 149088 (0.0009) [2023-12-26 00:46:21,946][123090] Updated weights for policy 1, policy_version 148520 (0.0010) [2023-12-26 00:46:22,000][123090] Updated weights for policy 1, policy_version 148530 (0.0009) [2023-12-26 00:46:22,051][123090] Updated weights for policy 1, policy_version 148540 (0.0009) [2023-12-26 00:46:22,136][123091] Updated weights for policy 0, policy_version 149098 (0.0008) [2023-12-26 00:46:22,192][123091] Updated weights for policy 0, policy_version 149108 (0.0009) [2023-12-26 00:46:22,248][123091] Updated weights for policy 0, policy_version 149118 (0.0009) [2023-12-26 00:46:22,867][123090] Updated weights for policy 1, policy_version 148551 (0.0011) [2023-12-26 00:46:22,916][123090] Updated weights for policy 1, policy_version 148561 (0.0011) [2023-12-26 00:46:22,972][123090] Updated weights for policy 1, policy_version 148571 (0.0011) [2023-12-26 00:46:23,047][123091] Updated weights for policy 0, policy_version 149128 (0.0009) [2023-12-26 00:46:23,112][123091] Updated weights for policy 0, policy_version 149138 (0.0009) [2023-12-26 00:46:23,199][123091] Updated weights for policy 0, policy_version 149148 (0.0009) [2023-12-26 00:46:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 76218368. Throughput: 0: 8627.4, 1: 8777.5. Samples: 76198836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:46:23,785][121949] Avg episode reward: [(0, '5672.729'), (1, '5472.736')] [2023-12-26 00:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000149152_38182912.pth... [2023-12-26 00:46:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000148160_37928960.pth [2023-12-26 00:46:23,802][123090] Updated weights for policy 1, policy_version 148581 (0.0011) [2023-12-26 00:46:23,857][123090] Updated weights for policy 1, policy_version 148591 (0.0010) [2023-12-26 00:46:23,897][123091] Updated weights for policy 0, policy_version 149158 (0.0006) [2023-12-26 00:46:23,916][123090] Updated weights for policy 1, policy_version 148601 (0.0010) [2023-12-26 00:46:23,950][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000148608_38043648.pth... [2023-12-26 00:46:23,953][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000147584_37781504.pth [2023-12-26 00:46:23,957][123091] Updated weights for policy 0, policy_version 149168 (0.0005) [2023-12-26 00:46:24,018][123091] Updated weights for policy 0, policy_version 149178 (0.0005) [2023-12-26 00:46:24,753][123090] Updated weights for policy 1, policy_version 148611 (0.0010) [2023-12-26 00:46:24,772][123091] Updated weights for policy 0, policy_version 149188 (0.0007) [2023-12-26 00:46:24,812][123090] Updated weights for policy 1, policy_version 148621 (0.0010) [2023-12-26 00:46:24,834][123091] Updated weights for policy 0, policy_version 149198 (0.0007) [2023-12-26 00:46:24,860][123090] Updated weights for policy 1, policy_version 148631 (0.0008) [2023-12-26 00:46:24,905][123091] Updated weights for policy 0, policy_version 149208 (0.0010) [2023-12-26 00:46:25,608][123091] Updated weights for policy 0, policy_version 149218 (0.0007) [2023-12-26 00:46:25,664][123091] Updated weights for policy 0, policy_version 149228 (0.0006) [2023-12-26 00:46:25,672][123090] Updated weights for policy 1, policy_version 148641 (0.0006) [2023-12-26 00:46:25,713][123091] Updated weights for policy 0, policy_version 149238 (0.0008) [2023-12-26 00:46:25,727][123090] Updated weights for policy 1, policy_version 148651 (0.0010) [2023-12-26 00:46:25,761][123091] Updated weights for policy 0, policy_version 149248 (0.0007) [2023-12-26 00:46:25,782][123090] Updated weights for policy 1, policy_version 148661 (0.0010) [2023-12-26 00:46:25,839][123090] Updated weights for policy 1, policy_version 148671 (0.0009) [2023-12-26 00:46:26,602][123091] Updated weights for policy 0, policy_version 149258 (0.0011) [2023-12-26 00:46:26,667][123091] Updated weights for policy 0, policy_version 149268 (0.0010) [2023-12-26 00:46:26,683][123090] Updated weights for policy 1, policy_version 148681 (0.0007) [2023-12-26 00:46:26,730][123091] Updated weights for policy 0, policy_version 149278 (0.0007) [2023-12-26 00:46:26,746][123090] Updated weights for policy 1, policy_version 148691 (0.0010) [2023-12-26 00:46:26,814][123090] Updated weights for policy 1, policy_version 148701 (0.0010) [2023-12-26 00:46:27,456][123091] Updated weights for policy 0, policy_version 149288 (0.0005) [2023-12-26 00:46:27,525][123091] Updated weights for policy 0, policy_version 149298 (0.0005) [2023-12-26 00:46:27,590][123091] Updated weights for policy 0, policy_version 149308 (0.0006) [2023-12-26 00:46:27,600][123090] Updated weights for policy 1, policy_version 148711 (0.0007) [2023-12-26 00:46:27,657][123090] Updated weights for policy 1, policy_version 148721 (0.0005) [2023-12-26 00:46:27,729][123090] Updated weights for policy 1, policy_version 148731 (0.0006) [2023-12-26 00:46:28,224][123091] Updated weights for policy 0, policy_version 149318 (0.0006) [2023-12-26 00:46:28,274][123091] Updated weights for policy 0, policy_version 149328 (0.0008) [2023-12-26 00:46:28,336][123091] Updated weights for policy 0, policy_version 149339 (0.0009) [2023-12-26 00:46:28,394][123090] Updated weights for policy 1, policy_version 148741 (0.0007) [2023-12-26 00:46:28,460][123090] Updated weights for policy 1, policy_version 148751 (0.0008) [2023-12-26 00:46:28,528][123090] Updated weights for policy 1, policy_version 148761 (0.0007) [2023-12-26 00:46:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 76316672. Throughput: 0: 8723.7, 1: 8782.8. Samples: 76305892. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:28,785][121949] Avg episode reward: [(0, '5519.427'), (1, '5209.819')] [2023-12-26 00:46:29,185][123091] Updated weights for policy 0, policy_version 149349 (0.0009) [2023-12-26 00:46:29,257][123091] Updated weights for policy 0, policy_version 149359 (0.0009) [2023-12-26 00:46:29,266][123090] Updated weights for policy 1, policy_version 148771 (0.0008) [2023-12-26 00:46:29,325][123091] Updated weights for policy 0, policy_version 149369 (0.0007) [2023-12-26 00:46:29,333][123090] Updated weights for policy 1, policy_version 148781 (0.0011) [2023-12-26 00:46:29,396][123090] Updated weights for policy 1, policy_version 148791 (0.0010) [2023-12-26 00:46:30,160][123091] Updated weights for policy 0, policy_version 149379 (0.0009) [2023-12-26 00:46:30,181][123090] Updated weights for policy 1, policy_version 148801 (0.0010) [2023-12-26 00:46:30,215][123091] Updated weights for policy 0, policy_version 149389 (0.0008) [2023-12-26 00:46:30,241][123090] Updated weights for policy 1, policy_version 148811 (0.0011) [2023-12-26 00:46:30,278][123091] Updated weights for policy 0, policy_version 149399 (0.0008) [2023-12-26 00:46:30,297][123090] Updated weights for policy 1, policy_version 148821 (0.0010) [2023-12-26 00:46:30,359][123090] Updated weights for policy 1, policy_version 148831 (0.0010) [2023-12-26 00:46:31,070][123090] Updated weights for policy 1, policy_version 148841 (0.0008) [2023-12-26 00:46:31,119][123090] Updated weights for policy 1, policy_version 148851 (0.0005) [2023-12-26 00:46:31,134][123091] Updated weights for policy 0, policy_version 149409 (0.0008) [2023-12-26 00:46:31,194][123090] Updated weights for policy 1, policy_version 148861 (0.0008) [2023-12-26 00:46:31,208][123091] Updated weights for policy 0, policy_version 149419 (0.0008) [2023-12-26 00:46:31,269][123091] Updated weights for policy 0, policy_version 149429 (0.0008) [2023-12-26 00:46:31,322][123091] Updated weights for policy 0, policy_version 149439 (0.0008) [2023-12-26 00:46:31,970][123090] Updated weights for policy 1, policy_version 148871 (0.0010) [2023-12-26 00:46:32,031][123090] Updated weights for policy 1, policy_version 148881 (0.0010) [2023-12-26 00:46:32,090][123090] Updated weights for policy 1, policy_version 148891 (0.0010) [2023-12-26 00:46:32,132][123091] Updated weights for policy 0, policy_version 149449 (0.0007) [2023-12-26 00:46:32,180][123091] Updated weights for policy 0, policy_version 149459 (0.0009) [2023-12-26 00:46:32,235][123091] Updated weights for policy 0, policy_version 149469 (0.0008) [2023-12-26 00:46:32,905][123090] Updated weights for policy 1, policy_version 148901 (0.0008) [2023-12-26 00:46:32,962][123090] Updated weights for policy 1, policy_version 148911 (0.0005) [2023-12-26 00:46:33,005][123090] Updated weights for policy 1, policy_version 148921 (0.0005) [2023-12-26 00:46:33,096][123091] Updated weights for policy 0, policy_version 149479 (0.0009) [2023-12-26 00:46:33,143][123091] Updated weights for policy 0, policy_version 149489 (0.0009) [2023-12-26 00:46:33,192][123091] Updated weights for policy 0, policy_version 149499 (0.0009) [2023-12-26 00:46:33,692][123090] Updated weights for policy 1, policy_version 148931 (0.0005) [2023-12-26 00:46:33,738][123090] Updated weights for policy 1, policy_version 148941 (0.0005) [2023-12-26 00:46:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 76398592. Throughput: 0: 8697.2, 1: 8786.0. Samples: 76414104. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:33,785][121949] Avg episode reward: [(0, '5500.616'), (1, '5170.947')] [2023-12-26 00:46:33,824][123090] Updated weights for policy 1, policy_version 148951 (0.0007) [2023-12-26 00:46:34,058][123091] Updated weights for policy 0, policy_version 149509 (0.0009) [2023-12-26 00:46:34,107][123091] Updated weights for policy 0, policy_version 149519 (0.0009) [2023-12-26 00:46:34,164][123091] Updated weights for policy 0, policy_version 149529 (0.0009) [2023-12-26 00:46:34,605][123090] Updated weights for policy 1, policy_version 148961 (0.0010) [2023-12-26 00:46:34,673][123090] Updated weights for policy 1, policy_version 148971 (0.0011) [2023-12-26 00:46:34,736][123090] Updated weights for policy 1, policy_version 148981 (0.0010) [2023-12-26 00:46:34,807][123090] Updated weights for policy 1, policy_version 148991 (0.0011) [2023-12-26 00:46:35,061][123091] Updated weights for policy 0, policy_version 149539 (0.0009) [2023-12-26 00:46:35,115][123091] Updated weights for policy 0, policy_version 149550 (0.0010) [2023-12-26 00:46:35,169][123091] Updated weights for policy 0, policy_version 149561 (0.0010) [2023-12-26 00:46:35,502][123090] Updated weights for policy 1, policy_version 149001 (0.0006) [2023-12-26 00:46:35,550][123090] Updated weights for policy 1, policy_version 149011 (0.0005) [2023-12-26 00:46:35,599][123090] Updated weights for policy 1, policy_version 149021 (0.0005) [2023-12-26 00:46:36,151][123091] Updated weights for policy 0, policy_version 149571 (0.0009) [2023-12-26 00:46:36,215][123090] Updated weights for policy 1, policy_version 149031 (0.0007) [2023-12-26 00:46:36,217][123091] Updated weights for policy 0, policy_version 149581 (0.0008) [2023-12-26 00:46:36,274][123090] Updated weights for policy 1, policy_version 149041 (0.0010) [2023-12-26 00:46:36,279][123091] Updated weights for policy 0, policy_version 149591 (0.0005) [2023-12-26 00:46:36,330][123090] Updated weights for policy 1, policy_version 149051 (0.0010) [2023-12-26 00:46:37,115][123091] Updated weights for policy 0, policy_version 149601 (0.0008) [2023-12-26 00:46:37,133][123090] Updated weights for policy 1, policy_version 149061 (0.0010) [2023-12-26 00:46:37,175][123091] Updated weights for policy 0, policy_version 149611 (0.0009) [2023-12-26 00:46:37,199][123090] Updated weights for policy 1, policy_version 149071 (0.0011) [2023-12-26 00:46:37,237][123091] Updated weights for policy 0, policy_version 149621 (0.0007) [2023-12-26 00:46:37,259][123090] Updated weights for policy 1, policy_version 149081 (0.0010) [2023-12-26 00:46:37,294][123091] Updated weights for policy 0, policy_version 149631 (0.0009) [2023-12-26 00:46:38,084][123090] Updated weights for policy 1, policy_version 149091 (0.0010) [2023-12-26 00:46:38,133][123091] Updated weights for policy 0, policy_version 149641 (0.0006) [2023-12-26 00:46:38,143][123090] Updated weights for policy 1, policy_version 149101 (0.0010) [2023-12-26 00:46:38,196][123091] Updated weights for policy 0, policy_version 149651 (0.0007) [2023-12-26 00:46:38,206][123090] Updated weights for policy 1, policy_version 149111 (0.0010) [2023-12-26 00:46:38,256][123091] Updated weights for policy 0, policy_version 149661 (0.0006) [2023-12-26 00:46:38,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 76488704. Throughput: 0: 8663.9, 1: 8814.8. Samples: 76467172. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:38,786][121949] Avg episode reward: [(0, '5642.558'), (1, '5351.371')] [2023-12-26 00:46:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000149664_38313984.pth... [2023-12-26 00:46:38,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000149120_38174720.pth... [2023-12-26 00:46:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000148672_38060032.pth [2023-12-26 00:46:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000148064_37904384.pth [2023-12-26 00:46:39,029][123090] Updated weights for policy 1, policy_version 149121 (0.0011) [2023-12-26 00:46:39,083][123091] Updated weights for policy 0, policy_version 149671 (0.0006) [2023-12-26 00:46:39,088][123090] Updated weights for policy 1, policy_version 149131 (0.0010) [2023-12-26 00:46:39,146][123091] Updated weights for policy 0, policy_version 149681 (0.0008) [2023-12-26 00:46:39,146][123090] Updated weights for policy 1, policy_version 149141 (0.0008) [2023-12-26 00:46:39,201][123091] Updated weights for policy 0, policy_version 149691 (0.0009) [2023-12-26 00:46:39,203][123090] Updated weights for policy 1, policy_version 149151 (0.0006) [2023-12-26 00:46:40,071][123090] Updated weights for policy 1, policy_version 149161 (0.0009) [2023-12-26 00:46:40,092][123091] Updated weights for policy 0, policy_version 149701 (0.0009) [2023-12-26 00:46:40,135][123090] Updated weights for policy 1, policy_version 149171 (0.0008) [2023-12-26 00:46:40,139][123091] Updated weights for policy 0, policy_version 149711 (0.0009) [2023-12-26 00:46:40,192][123090] Updated weights for policy 1, policy_version 149181 (0.0007) [2023-12-26 00:46:40,194][123091] Updated weights for policy 0, policy_version 149721 (0.0009) [2023-12-26 00:46:40,950][123090] Updated weights for policy 1, policy_version 149191 (0.0008) [2023-12-26 00:46:40,998][123090] Updated weights for policy 1, policy_version 149201 (0.0009) [2023-12-26 00:46:41,067][123091] Updated weights for policy 0, policy_version 149731 (0.0009) [2023-12-26 00:46:41,079][123090] Updated weights for policy 1, policy_version 149211 (0.0008) [2023-12-26 00:46:41,141][123091] Updated weights for policy 0, policy_version 149741 (0.0010) [2023-12-26 00:46:41,211][123091] Updated weights for policy 0, policy_version 149751 (0.0010) [2023-12-26 00:46:41,941][123090] Updated weights for policy 1, policy_version 149221 (0.0008) [2023-12-26 00:46:42,011][123090] Updated weights for policy 1, policy_version 149231 (0.0010) [2023-12-26 00:46:42,050][123091] Updated weights for policy 0, policy_version 149761 (0.0010) [2023-12-26 00:46:42,070][123090] Updated weights for policy 1, policy_version 149241 (0.0009) [2023-12-26 00:46:42,106][123091] Updated weights for policy 0, policy_version 149771 (0.0009) [2023-12-26 00:46:42,162][123091] Updated weights for policy 0, policy_version 149781 (0.0010) [2023-12-26 00:46:42,210][123091] Updated weights for policy 0, policy_version 149791 (0.0009) [2023-12-26 00:46:42,913][123090] Updated weights for policy 1, policy_version 149251 (0.0009) [2023-12-26 00:46:42,970][123090] Updated weights for policy 1, policy_version 149261 (0.0009) [2023-12-26 00:46:43,022][123090] Updated weights for policy 1, policy_version 149271 (0.0009) [2023-12-26 00:46:43,078][123091] Updated weights for policy 0, policy_version 149801 (0.0008) [2023-12-26 00:46:43,128][123091] Updated weights for policy 0, policy_version 149811 (0.0010) [2023-12-26 00:46:43,178][123091] Updated weights for policy 0, policy_version 149821 (0.0009) [2023-12-26 00:46:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 76570624. Throughput: 0: 8579.2, 1: 8791.8. Samples: 76567992. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:43,785][121949] Avg episode reward: [(0, '5664.849'), (1, '5496.769')] [2023-12-26 00:46:43,813][123090] Updated weights for policy 1, policy_version 149281 (0.0008) [2023-12-26 00:46:43,881][123090] Updated weights for policy 1, policy_version 149291 (0.0009) [2023-12-26 00:46:43,936][123090] Updated weights for policy 1, policy_version 149301 (0.0009) [2023-12-26 00:46:43,989][123090] Updated weights for policy 1, policy_version 149311 (0.0009) [2023-12-26 00:46:44,035][123091] Updated weights for policy 0, policy_version 149831 (0.0010) [2023-12-26 00:46:44,086][123091] Updated weights for policy 0, policy_version 149841 (0.0009) [2023-12-26 00:46:44,161][123091] Updated weights for policy 0, policy_version 149851 (0.0009) [2023-12-26 00:46:44,806][123090] Updated weights for policy 1, policy_version 149321 (0.0009) [2023-12-26 00:46:44,865][123090] Updated weights for policy 1, policy_version 149331 (0.0009) [2023-12-26 00:46:44,881][123091] Updated weights for policy 0, policy_version 149861 (0.0008) [2023-12-26 00:46:44,934][123090] Updated weights for policy 1, policy_version 149341 (0.0009) [2023-12-26 00:46:44,938][123091] Updated weights for policy 0, policy_version 149871 (0.0009) [2023-12-26 00:46:44,998][123091] Updated weights for policy 0, policy_version 149881 (0.0008) [2023-12-26 00:46:45,688][123090] Updated weights for policy 1, policy_version 149351 (0.0011) [2023-12-26 00:46:45,744][123090] Updated weights for policy 1, policy_version 149361 (0.0011) [2023-12-26 00:46:45,796][123090] Updated weights for policy 1, policy_version 149371 (0.0010) [2023-12-26 00:46:45,875][123091] Updated weights for policy 0, policy_version 149891 (0.0010) [2023-12-26 00:46:45,944][123091] Updated weights for policy 0, policy_version 149901 (0.0010) [2023-12-26 00:46:46,004][123091] Updated weights for policy 0, policy_version 149911 (0.0009) [2023-12-26 00:46:46,641][123090] Updated weights for policy 1, policy_version 149381 (0.0010) [2023-12-26 00:46:46,697][123090] Updated weights for policy 1, policy_version 149391 (0.0010) [2023-12-26 00:46:46,755][123090] Updated weights for policy 1, policy_version 149401 (0.0010) [2023-12-26 00:46:46,839][123091] Updated weights for policy 0, policy_version 149921 (0.0009) [2023-12-26 00:46:46,888][123091] Updated weights for policy 0, policy_version 149931 (0.0009) [2023-12-26 00:46:46,942][123091] Updated weights for policy 0, policy_version 149941 (0.0009) [2023-12-26 00:46:46,992][123091] Updated weights for policy 0, policy_version 149951 (0.0009) [2023-12-26 00:46:47,607][123090] Updated weights for policy 1, policy_version 149411 (0.0010) [2023-12-26 00:46:47,669][123090] Updated weights for policy 1, policy_version 149421 (0.0010) [2023-12-26 00:46:47,731][123090] Updated weights for policy 1, policy_version 149431 (0.0010) [2023-12-26 00:46:47,887][123091] Updated weights for policy 0, policy_version 149961 (0.0009) [2023-12-26 00:46:47,944][123091] Updated weights for policy 0, policy_version 149971 (0.0009) [2023-12-26 00:46:47,993][123091] Updated weights for policy 0, policy_version 149981 (0.0008) [2023-12-26 00:46:48,489][123090] Updated weights for policy 1, policy_version 149441 (0.0010) [2023-12-26 00:46:48,550][123090] Updated weights for policy 1, policy_version 149451 (0.0008) [2023-12-26 00:46:48,620][123090] Updated weights for policy 1, policy_version 149461 (0.0008) [2023-12-26 00:46:48,688][123090] Updated weights for policy 1, policy_version 149471 (0.0007) [2023-12-26 00:46:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 76660736. Throughput: 0: 8639.9, 1: 8833.9. Samples: 76671924. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:48,785][121949] Avg episode reward: [(0, '5679.922'), (1, '5545.159')] [2023-12-26 00:46:48,918][123091] Updated weights for policy 0, policy_version 149991 (0.0009) [2023-12-26 00:46:48,983][123091] Updated weights for policy 0, policy_version 150001 (0.0009) [2023-12-26 00:46:49,040][123091] Updated weights for policy 0, policy_version 150011 (0.0010) [2023-12-26 00:46:49,449][123090] Updated weights for policy 1, policy_version 149481 (0.0009) [2023-12-26 00:46:49,516][123090] Updated weights for policy 1, policy_version 149491 (0.0009) [2023-12-26 00:46:49,588][123090] Updated weights for policy 1, policy_version 149501 (0.0009) [2023-12-26 00:46:49,914][123091] Updated weights for policy 0, policy_version 150021 (0.0009) [2023-12-26 00:46:49,976][123091] Updated weights for policy 0, policy_version 150031 (0.0010) [2023-12-26 00:46:50,030][123091] Updated weights for policy 0, policy_version 150041 (0.0010) [2023-12-26 00:46:50,333][123090] Updated weights for policy 1, policy_version 149511 (0.0007) [2023-12-26 00:46:50,396][123090] Updated weights for policy 1, policy_version 149521 (0.0006) [2023-12-26 00:46:50,465][123090] Updated weights for policy 1, policy_version 149531 (0.0006) [2023-12-26 00:46:50,923][123091] Updated weights for policy 0, policy_version 150051 (0.0009) [2023-12-26 00:46:50,975][123091] Updated weights for policy 0, policy_version 150061 (0.0010) [2023-12-26 00:46:51,044][123091] Updated weights for policy 0, policy_version 150071 (0.0009) [2023-12-26 00:46:51,137][123090] Updated weights for policy 1, policy_version 149541 (0.0009) [2023-12-26 00:46:51,191][123090] Updated weights for policy 1, policy_version 149551 (0.0009) [2023-12-26 00:46:51,247][123090] Updated weights for policy 1, policy_version 149561 (0.0009) [2023-12-26 00:46:51,905][123091] Updated weights for policy 0, policy_version 150081 (0.0010) [2023-12-26 00:46:51,963][123091] Updated weights for policy 0, policy_version 150091 (0.0008) [2023-12-26 00:46:52,035][123091] Updated weights for policy 0, policy_version 150101 (0.0009) [2023-12-26 00:46:52,099][123091] Updated weights for policy 0, policy_version 150111 (0.0010) [2023-12-26 00:46:52,151][123090] Updated weights for policy 1, policy_version 149571 (0.0009) [2023-12-26 00:46:52,215][123090] Updated weights for policy 1, policy_version 149581 (0.0009) [2023-12-26 00:46:52,286][123090] Updated weights for policy 1, policy_version 149591 (0.0009) [2023-12-26 00:46:52,859][123091] Updated weights for policy 0, policy_version 150121 (0.0005) [2023-12-26 00:46:52,933][123091] Updated weights for policy 0, policy_version 150131 (0.0007) [2023-12-26 00:46:52,999][123091] Updated weights for policy 0, policy_version 150141 (0.0011) [2023-12-26 00:46:53,088][123090] Updated weights for policy 1, policy_version 149601 (0.0008) [2023-12-26 00:46:53,141][123090] Updated weights for policy 1, policy_version 149611 (0.0009) [2023-12-26 00:46:53,199][123090] Updated weights for policy 1, policy_version 149621 (0.0009) [2023-12-26 00:46:53,256][123090] Updated weights for policy 1, policy_version 149631 (0.0009) [2023-12-26 00:46:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17203.2, 300 sec: 17605.8). Total num frames: 76742656. Throughput: 0: 8565.3, 1: 8890.8. Samples: 76722708. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:53,785][121949] Avg episode reward: [(0, '5681.016'), (1, '5535.927')] [2023-12-26 00:46:53,788][123091] Updated weights for policy 0, policy_version 150151 (0.0011) [2023-12-26 00:46:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000149632_38305792.pth... [2023-12-26 00:46:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000148608_38043648.pth [2023-12-26 00:46:53,841][123091] Updated weights for policy 0, policy_version 150161 (0.0011) [2023-12-26 00:46:53,907][123091] Updated weights for policy 0, policy_version 150171 (0.0011) [2023-12-26 00:46:53,932][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000150176_38445056.pth... [2023-12-26 00:46:53,935][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000149152_38182912.pth [2023-12-26 00:46:54,106][123090] Updated weights for policy 1, policy_version 149641 (0.0009) [2023-12-26 00:46:54,159][123090] Updated weights for policy 1, policy_version 149651 (0.0008) [2023-12-26 00:46:54,215][123090] Updated weights for policy 1, policy_version 149662 (0.0009) [2023-12-26 00:46:54,711][123091] Updated weights for policy 0, policy_version 150181 (0.0010) [2023-12-26 00:46:54,758][123091] Updated weights for policy 0, policy_version 150191 (0.0010) [2023-12-26 00:46:54,816][123091] Updated weights for policy 0, policy_version 150201 (0.0010) [2023-12-26 00:46:55,097][123090] Updated weights for policy 1, policy_version 149672 (0.0009) [2023-12-26 00:46:55,158][123090] Updated weights for policy 1, policy_version 149682 (0.0009) [2023-12-26 00:46:55,205][123090] Updated weights for policy 1, policy_version 149692 (0.0008) [2023-12-26 00:46:55,646][123091] Updated weights for policy 0, policy_version 150211 (0.0010) [2023-12-26 00:46:55,700][123091] Updated weights for policy 0, policy_version 150221 (0.0009) [2023-12-26 00:46:55,759][123091] Updated weights for policy 0, policy_version 150231 (0.0009) [2023-12-26 00:46:55,981][123090] Updated weights for policy 1, policy_version 149702 (0.0009) [2023-12-26 00:46:56,033][123090] Updated weights for policy 1, policy_version 149712 (0.0010) [2023-12-26 00:46:56,088][123090] Updated weights for policy 1, policy_version 149722 (0.0010) [2023-12-26 00:46:56,529][123091] Updated weights for policy 0, policy_version 150241 (0.0009) [2023-12-26 00:46:56,574][123091] Updated weights for policy 0, policy_version 150251 (0.0005) [2023-12-26 00:46:56,627][123091] Updated weights for policy 0, policy_version 150261 (0.0005) [2023-12-26 00:46:56,681][123091] Updated weights for policy 0, policy_version 150271 (0.0005) [2023-12-26 00:46:56,810][123090] Updated weights for policy 1, policy_version 149732 (0.0008) [2023-12-26 00:46:56,861][123090] Updated weights for policy 1, policy_version 149742 (0.0005) [2023-12-26 00:46:56,912][123090] Updated weights for policy 1, policy_version 149752 (0.0005) [2023-12-26 00:46:57,293][123091] Updated weights for policy 0, policy_version 150281 (0.0006) [2023-12-26 00:46:57,355][123091] Updated weights for policy 0, policy_version 150291 (0.0005) [2023-12-26 00:46:57,412][123091] Updated weights for policy 0, policy_version 150301 (0.0008) [2023-12-26 00:46:57,583][123090] Updated weights for policy 1, policy_version 149762 (0.0005) [2023-12-26 00:46:57,632][123090] Updated weights for policy 1, policy_version 149772 (0.0005) [2023-12-26 00:46:57,682][123090] Updated weights for policy 1, policy_version 149782 (0.0005) [2023-12-26 00:46:57,731][123090] Updated weights for policy 1, policy_version 149792 (0.0005) [2023-12-26 00:46:58,323][123091] Updated weights for policy 0, policy_version 150311 (0.0010) [2023-12-26 00:46:58,402][123091] Updated weights for policy 0, policy_version 150321 (0.0010) [2023-12-26 00:46:58,470][123091] Updated weights for policy 0, policy_version 150331 (0.0009) [2023-12-26 00:46:58,504][123090] Updated weights for policy 1, policy_version 149802 (0.0009) [2023-12-26 00:46:58,568][123090] Updated weights for policy 1, policy_version 149812 (0.0009) [2023-12-26 00:46:58,632][123090] Updated weights for policy 1, policy_version 149822 (0.0008) [2023-12-26 00:46:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 76840960. Throughput: 0: 8587.4, 1: 9015.6. Samples: 76832120. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:46:58,785][121949] Avg episode reward: [(0, '5763.418'), (1, '5515.425')] [2023-12-26 00:46:59,419][123091] Updated weights for policy 0, policy_version 150341 (0.0007) [2023-12-26 00:46:59,488][123091] Updated weights for policy 0, policy_version 150351 (0.0006) [2023-12-26 00:46:59,515][123090] Updated weights for policy 1, policy_version 149832 (0.0009) [2023-12-26 00:46:59,549][123091] Updated weights for policy 0, policy_version 150361 (0.0006) [2023-12-26 00:46:59,573][123090] Updated weights for policy 1, policy_version 149842 (0.0008) [2023-12-26 00:46:59,631][123090] Updated weights for policy 1, policy_version 149852 (0.0009) [2023-12-26 00:47:00,220][123091] Updated weights for policy 0, policy_version 150371 (0.0006) [2023-12-26 00:47:00,293][123091] Updated weights for policy 0, policy_version 150381 (0.0005) [2023-12-26 00:47:00,348][123091] Updated weights for policy 0, policy_version 150391 (0.0006) [2023-12-26 00:47:00,467][123090] Updated weights for policy 1, policy_version 149862 (0.0009) [2023-12-26 00:47:00,520][123090] Updated weights for policy 1, policy_version 149873 (0.0010) [2023-12-26 00:47:00,568][123090] Updated weights for policy 1, policy_version 149883 (0.0010) [2023-12-26 00:47:00,982][123091] Updated weights for policy 0, policy_version 150401 (0.0006) [2023-12-26 00:47:01,045][123091] Updated weights for policy 0, policy_version 150411 (0.0010) [2023-12-26 00:47:01,116][123091] Updated weights for policy 0, policy_version 150421 (0.0008) [2023-12-26 00:47:01,177][123091] Updated weights for policy 0, policy_version 150431 (0.0010) [2023-12-26 00:47:01,407][123090] Updated weights for policy 1, policy_version 149893 (0.0010) [2023-12-26 00:47:01,467][123090] Updated weights for policy 1, policy_version 149903 (0.0008) [2023-12-26 00:47:01,536][123090] Updated weights for policy 1, policy_version 149913 (0.0007) [2023-12-26 00:47:02,020][123091] Updated weights for policy 0, policy_version 150441 (0.0009) [2023-12-26 00:47:02,074][123091] Updated weights for policy 0, policy_version 150451 (0.0009) [2023-12-26 00:47:02,134][123091] Updated weights for policy 0, policy_version 150461 (0.0009) [2023-12-26 00:47:02,347][123090] Updated weights for policy 1, policy_version 149923 (0.0009) [2023-12-26 00:47:02,416][123090] Updated weights for policy 1, policy_version 149933 (0.0010) [2023-12-26 00:47:02,475][123090] Updated weights for policy 1, policy_version 149943 (0.0010) [2023-12-26 00:47:02,898][123091] Updated weights for policy 0, policy_version 150471 (0.0009) [2023-12-26 00:47:02,957][123091] Updated weights for policy 0, policy_version 150481 (0.0010) [2023-12-26 00:47:03,019][123091] Updated weights for policy 0, policy_version 150491 (0.0010) [2023-12-26 00:47:03,321][123090] Updated weights for policy 1, policy_version 149953 (0.0009) [2023-12-26 00:47:03,376][123090] Updated weights for policy 1, policy_version 149963 (0.0009) [2023-12-26 00:47:03,424][123090] Updated weights for policy 1, policy_version 149973 (0.0009) [2023-12-26 00:47:03,477][123090] Updated weights for policy 1, policy_version 149983 (0.0007) [2023-12-26 00:47:03,735][123091] Updated weights for policy 0, policy_version 150501 (0.0007) [2023-12-26 00:47:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 76922880. Throughput: 0: 8641.8, 1: 8870.0. Samples: 76936184. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:03,785][121949] Avg episode reward: [(0, '5767.650'), (1, '5482.551')] [2023-12-26 00:47:03,800][123091] Updated weights for policy 0, policy_version 150511 (0.0007) [2023-12-26 00:47:03,876][123091] Updated weights for policy 0, policy_version 150521 (0.0007) [2023-12-26 00:47:04,307][123090] Updated weights for policy 1, policy_version 149993 (0.0009) [2023-12-26 00:47:04,370][123090] Updated weights for policy 1, policy_version 150003 (0.0009) [2023-12-26 00:47:04,431][123090] Updated weights for policy 1, policy_version 150013 (0.0010) [2023-12-26 00:47:04,618][123091] Updated weights for policy 0, policy_version 150531 (0.0009) [2023-12-26 00:47:04,681][123091] Updated weights for policy 0, policy_version 150541 (0.0010) [2023-12-26 00:47:04,739][123091] Updated weights for policy 0, policy_version 150551 (0.0009) [2023-12-26 00:47:05,305][123090] Updated weights for policy 1, policy_version 150023 (0.0009) [2023-12-26 00:47:05,371][123090] Updated weights for policy 1, policy_version 150033 (0.0009) [2023-12-26 00:47:05,435][123090] Updated weights for policy 1, policy_version 150043 (0.0010) [2023-12-26 00:47:05,554][123091] Updated weights for policy 0, policy_version 150561 (0.0009) [2023-12-26 00:47:05,603][123091] Updated weights for policy 0, policy_version 150571 (0.0008) [2023-12-26 00:47:05,654][123091] Updated weights for policy 0, policy_version 150581 (0.0009) [2023-12-26 00:47:05,702][123091] Updated weights for policy 0, policy_version 150591 (0.0009) [2023-12-26 00:47:06,163][123090] Updated weights for policy 1, policy_version 150053 (0.0007) [2023-12-26 00:47:06,232][123090] Updated weights for policy 1, policy_version 150063 (0.0007) [2023-12-26 00:47:06,299][123090] Updated weights for policy 1, policy_version 150073 (0.0006) [2023-12-26 00:47:06,558][123091] Updated weights for policy 0, policy_version 150601 (0.0006) [2023-12-26 00:47:06,630][123091] Updated weights for policy 0, policy_version 150611 (0.0007) [2023-12-26 00:47:06,688][123091] Updated weights for policy 0, policy_version 150621 (0.0010) [2023-12-26 00:47:07,030][123090] Updated weights for policy 1, policy_version 150083 (0.0009) [2023-12-26 00:47:07,083][123090] Updated weights for policy 1, policy_version 150093 (0.0009) [2023-12-26 00:47:07,136][123090] Updated weights for policy 1, policy_version 150103 (0.0009) [2023-12-26 00:47:07,367][123091] Updated weights for policy 0, policy_version 150631 (0.0006) [2023-12-26 00:47:07,428][123091] Updated weights for policy 0, policy_version 150641 (0.0006) [2023-12-26 00:47:07,484][123091] Updated weights for policy 0, policy_version 150651 (0.0005) [2023-12-26 00:47:08,034][123090] Updated weights for policy 1, policy_version 150113 (0.0007) [2023-12-26 00:47:08,088][123090] Updated weights for policy 1, policy_version 150123 (0.0008) [2023-12-26 00:47:08,141][123090] Updated weights for policy 1, policy_version 150133 (0.0010) [2023-12-26 00:47:08,207][123090] Updated weights for policy 1, policy_version 150143 (0.0008) [2023-12-26 00:47:08,222][123091] Updated weights for policy 0, policy_version 150661 (0.0009) [2023-12-26 00:47:08,289][123091] Updated weights for policy 0, policy_version 150671 (0.0011) [2023-12-26 00:47:08,359][123091] Updated weights for policy 0, policy_version 150681 (0.0010) [2023-12-26 00:47:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 77012992. Throughput: 0: 8685.6, 1: 8902.9. Samples: 76990328. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:08,786][121949] Avg episode reward: [(0, '5667.752'), (1, '5402.359')] [2023-12-26 00:47:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000150688_38576128.pth... [2023-12-26 00:47:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000150144_38436864.pth... [2023-12-26 00:47:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000149664_38313984.pth [2023-12-26 00:47:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000149120_38174720.pth [2023-12-26 00:47:09,058][123090] Updated weights for policy 1, policy_version 150153 (0.0010) [2023-12-26 00:47:09,113][123090] Updated weights for policy 1, policy_version 150163 (0.0010) [2023-12-26 00:47:09,139][123091] Updated weights for policy 0, policy_version 150691 (0.0010) [2023-12-26 00:47:09,165][123090] Updated weights for policy 1, policy_version 150173 (0.0010) [2023-12-26 00:47:09,198][123091] Updated weights for policy 0, policy_version 150701 (0.0008) [2023-12-26 00:47:09,269][123091] Updated weights for policy 0, policy_version 150711 (0.0009) [2023-12-26 00:47:10,040][123090] Updated weights for policy 1, policy_version 150183 (0.0011) [2023-12-26 00:47:10,101][123090] Updated weights for policy 1, policy_version 150193 (0.0009) [2023-12-26 00:47:10,147][123091] Updated weights for policy 0, policy_version 150721 (0.0009) [2023-12-26 00:47:10,162][123090] Updated weights for policy 1, policy_version 150203 (0.0005) [2023-12-26 00:47:10,210][123091] Updated weights for policy 0, policy_version 150731 (0.0008) [2023-12-26 00:47:10,276][123091] Updated weights for policy 0, policy_version 150741 (0.0009) [2023-12-26 00:47:10,344][123091] Updated weights for policy 0, policy_version 150751 (0.0009) [2023-12-26 00:47:10,961][123090] Updated weights for policy 1, policy_version 150213 (0.0011) [2023-12-26 00:47:11,016][123090] Updated weights for policy 1, policy_version 150223 (0.0010) [2023-12-26 00:47:11,085][123090] Updated weights for policy 1, policy_version 150233 (0.0011) [2023-12-26 00:47:11,214][123091] Updated weights for policy 0, policy_version 150761 (0.0011) [2023-12-26 00:47:11,276][123091] Updated weights for policy 0, policy_version 150771 (0.0011) [2023-12-26 00:47:11,324][123091] Updated weights for policy 0, policy_version 150781 (0.0010) [2023-12-26 00:47:11,836][123090] Updated weights for policy 1, policy_version 150243 (0.0010) [2023-12-26 00:47:11,895][123090] Updated weights for policy 1, policy_version 150253 (0.0009) [2023-12-26 00:47:11,950][123090] Updated weights for policy 1, policy_version 150263 (0.0007) [2023-12-26 00:47:12,148][123091] Updated weights for policy 0, policy_version 150791 (0.0008) [2023-12-26 00:47:12,208][123091] Updated weights for policy 0, policy_version 150801 (0.0005) [2023-12-26 00:47:12,279][123091] Updated weights for policy 0, policy_version 150811 (0.0007) [2023-12-26 00:47:12,863][123090] Updated weights for policy 1, policy_version 150273 (0.0009) [2023-12-26 00:47:12,913][123090] Updated weights for policy 1, policy_version 150283 (0.0005) [2023-12-26 00:47:12,948][123091] Updated weights for policy 0, policy_version 150821 (0.0007) [2023-12-26 00:47:12,986][123090] Updated weights for policy 1, policy_version 150293 (0.0005) [2023-12-26 00:47:13,023][123091] Updated weights for policy 0, policy_version 150831 (0.0006) [2023-12-26 00:47:13,048][123090] Updated weights for policy 1, policy_version 150303 (0.0005) [2023-12-26 00:47:13,098][123091] Updated weights for policy 0, policy_version 150841 (0.0006) [2023-12-26 00:47:13,729][123090] Updated weights for policy 1, policy_version 150313 (0.0009) [2023-12-26 00:47:13,765][123091] Updated weights for policy 0, policy_version 150851 (0.0007) [2023-12-26 00:47:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 77094912. Throughput: 0: 8635.1, 1: 8875.3. Samples: 77093864. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:13,786][121949] Avg episode reward: [(0, '5586.302'), (1, '5345.857')] [2023-12-26 00:47:13,792][123090] Updated weights for policy 1, policy_version 150323 (0.0006) [2023-12-26 00:47:13,819][123091] Updated weights for policy 0, policy_version 150861 (0.0009) [2023-12-26 00:47:13,852][123090] Updated weights for policy 1, policy_version 150333 (0.0005) [2023-12-26 00:47:13,872][123091] Updated weights for policy 0, policy_version 150871 (0.0009) [2023-12-26 00:47:14,637][123090] Updated weights for policy 1, policy_version 150343 (0.0005) [2023-12-26 00:47:14,667][123091] Updated weights for policy 0, policy_version 150881 (0.0010) [2023-12-26 00:47:14,701][123090] Updated weights for policy 1, policy_version 150353 (0.0005) [2023-12-26 00:47:14,718][123091] Updated weights for policy 0, policy_version 150891 (0.0010) [2023-12-26 00:47:14,770][123091] Updated weights for policy 0, policy_version 150901 (0.0010) [2023-12-26 00:47:14,777][123090] Updated weights for policy 1, policy_version 150363 (0.0007) [2023-12-26 00:47:14,833][123091] Updated weights for policy 0, policy_version 150911 (0.0011) [2023-12-26 00:47:15,544][123090] Updated weights for policy 1, policy_version 150373 (0.0010) [2023-12-26 00:47:15,603][123090] Updated weights for policy 1, policy_version 150383 (0.0010) [2023-12-26 00:47:15,655][123091] Updated weights for policy 0, policy_version 150921 (0.0010) [2023-12-26 00:47:15,662][123090] Updated weights for policy 1, policy_version 150393 (0.0010) [2023-12-26 00:47:15,702][123091] Updated weights for policy 0, policy_version 150931 (0.0010) [2023-12-26 00:47:15,757][123091] Updated weights for policy 0, policy_version 150941 (0.0010) [2023-12-26 00:47:16,356][123090] Updated weights for policy 1, policy_version 150403 (0.0010) [2023-12-26 00:47:16,412][123090] Updated weights for policy 1, policy_version 150413 (0.0010) [2023-12-26 00:47:16,484][123090] Updated weights for policy 1, policy_version 150423 (0.0009) [2023-12-26 00:47:16,603][123091] Updated weights for policy 0, policy_version 150951 (0.0007) [2023-12-26 00:47:16,674][123091] Updated weights for policy 0, policy_version 150961 (0.0010) [2023-12-26 00:47:16,745][123091] Updated weights for policy 0, policy_version 150971 (0.0011) [2023-12-26 00:47:17,291][123090] Updated weights for policy 1, policy_version 150433 (0.0007) [2023-12-26 00:47:17,339][123090] Updated weights for policy 1, policy_version 150443 (0.0010) [2023-12-26 00:47:17,398][123090] Updated weights for policy 1, policy_version 150453 (0.0009) [2023-12-26 00:47:17,456][123090] Updated weights for policy 1, policy_version 150463 (0.0010) [2023-12-26 00:47:17,511][123091] Updated weights for policy 0, policy_version 150981 (0.0008) [2023-12-26 00:47:17,572][123091] Updated weights for policy 0, policy_version 150991 (0.0006) [2023-12-26 00:47:17,625][123091] Updated weights for policy 0, policy_version 151001 (0.0005) [2023-12-26 00:47:18,204][123090] Updated weights for policy 1, policy_version 150473 (0.0010) [2023-12-26 00:47:18,260][123090] Updated weights for policy 1, policy_version 150483 (0.0010) [2023-12-26 00:47:18,318][123091] Updated weights for policy 0, policy_version 151011 (0.0007) [2023-12-26 00:47:18,323][123090] Updated weights for policy 1, policy_version 150493 (0.0011) [2023-12-26 00:47:18,387][123091] Updated weights for policy 0, policy_version 151021 (0.0011) [2023-12-26 00:47:18,454][123091] Updated weights for policy 0, policy_version 151031 (0.0011) [2023-12-26 00:47:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 77193216. Throughput: 0: 8699.9, 1: 8841.3. Samples: 77203460. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:18,785][121949] Avg episode reward: [(0, '5588.424'), (1, '5175.093')] [2023-12-26 00:47:19,168][123090] Updated weights for policy 1, policy_version 150503 (0.0011) [2023-12-26 00:47:19,242][123090] Updated weights for policy 1, policy_version 150513 (0.0011) [2023-12-26 00:47:19,261][123091] Updated weights for policy 0, policy_version 151041 (0.0010) [2023-12-26 00:47:19,320][123090] Updated weights for policy 1, policy_version 150523 (0.0010) [2023-12-26 00:47:19,333][123091] Updated weights for policy 0, policy_version 151051 (0.0007) [2023-12-26 00:47:19,401][123091] Updated weights for policy 0, policy_version 151061 (0.0007) [2023-12-26 00:47:19,468][123091] Updated weights for policy 0, policy_version 151071 (0.0006) [2023-12-26 00:47:20,234][123090] Updated weights for policy 1, policy_version 150533 (0.0010) [2023-12-26 00:47:20,269][123091] Updated weights for policy 0, policy_version 151081 (0.0009) [2023-12-26 00:47:20,304][123090] Updated weights for policy 1, policy_version 150543 (0.0009) [2023-12-26 00:47:20,336][123091] Updated weights for policy 0, policy_version 151091 (0.0009) [2023-12-26 00:47:20,377][123090] Updated weights for policy 1, policy_version 150553 (0.0009) [2023-12-26 00:47:20,402][123091] Updated weights for policy 0, policy_version 151101 (0.0009) [2023-12-26 00:47:21,270][123090] Updated weights for policy 1, policy_version 150563 (0.0009) [2023-12-26 00:47:21,297][123091] Updated weights for policy 0, policy_version 151111 (0.0010) [2023-12-26 00:47:21,326][123090] Updated weights for policy 1, policy_version 150573 (0.0009) [2023-12-26 00:47:21,367][123091] Updated weights for policy 0, policy_version 151121 (0.0011) [2023-12-26 00:47:21,399][123090] Updated weights for policy 1, policy_version 150583 (0.0008) [2023-12-26 00:47:21,432][123091] Updated weights for policy 0, policy_version 151131 (0.0010) [2023-12-26 00:47:22,179][123091] Updated weights for policy 0, policy_version 151141 (0.0010) [2023-12-26 00:47:22,193][123090] Updated weights for policy 1, policy_version 150593 (0.0006) [2023-12-26 00:47:22,227][123091] Updated weights for policy 0, policy_version 151151 (0.0010) [2023-12-26 00:47:22,243][123090] Updated weights for policy 1, policy_version 150603 (0.0007) [2023-12-26 00:47:22,292][123091] Updated weights for policy 0, policy_version 151161 (0.0011) [2023-12-26 00:47:22,312][123090] Updated weights for policy 1, policy_version 150613 (0.0007) [2023-12-26 00:47:22,381][123090] Updated weights for policy 1, policy_version 150623 (0.0009) [2023-12-26 00:47:23,131][123091] Updated weights for policy 0, policy_version 151171 (0.0010) [2023-12-26 00:47:23,176][123090] Updated weights for policy 1, policy_version 150633 (0.0007) [2023-12-26 00:47:23,193][123091] Updated weights for policy 0, policy_version 151181 (0.0010) [2023-12-26 00:47:23,226][123090] Updated weights for policy 1, policy_version 150643 (0.0008) [2023-12-26 00:47:23,245][123091] Updated weights for policy 0, policy_version 151191 (0.0010) [2023-12-26 00:47:23,278][123090] Updated weights for policy 1, policy_version 150653 (0.0006) [2023-12-26 00:47:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 77275136. Throughput: 0: 8722.5, 1: 8730.5. Samples: 77252556. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:23,785][121949] Avg episode reward: [(0, '5543.022'), (1, '5285.022')] [2023-12-26 00:47:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000150656_38567936.pth... [2023-12-26 00:47:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000151200_38707200.pth... [2023-12-26 00:47:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000149632_38305792.pth [2023-12-26 00:47:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000150176_38445056.pth [2023-12-26 00:47:23,950][123091] Updated weights for policy 0, policy_version 151201 (0.0010) [2023-12-26 00:47:24,012][123091] Updated weights for policy 0, policy_version 151211 (0.0008) [2023-12-26 00:47:24,078][123091] Updated weights for policy 0, policy_version 151221 (0.0006) [2023-12-26 00:47:24,126][123090] Updated weights for policy 1, policy_version 150663 (0.0008) [2023-12-26 00:47:24,143][123091] Updated weights for policy 0, policy_version 151231 (0.0006) [2023-12-26 00:47:24,191][123090] Updated weights for policy 1, policy_version 150673 (0.0009) [2023-12-26 00:47:24,259][123090] Updated weights for policy 1, policy_version 150683 (0.0010) [2023-12-26 00:47:24,761][123091] Updated weights for policy 0, policy_version 151241 (0.0006) [2023-12-26 00:47:24,806][123091] Updated weights for policy 0, policy_version 151251 (0.0005) [2023-12-26 00:47:24,871][123091] Updated weights for policy 0, policy_version 151261 (0.0005) [2023-12-26 00:47:25,196][123090] Updated weights for policy 1, policy_version 150693 (0.0010) [2023-12-26 00:47:25,250][123090] Updated weights for policy 1, policy_version 150703 (0.0010) [2023-12-26 00:47:25,309][123090] Updated weights for policy 1, policy_version 150713 (0.0010) [2023-12-26 00:47:25,504][123091] Updated weights for policy 0, policy_version 151271 (0.0005) [2023-12-26 00:47:25,551][123091] Updated weights for policy 0, policy_version 151281 (0.0005) [2023-12-26 00:47:25,597][123091] Updated weights for policy 0, policy_version 151291 (0.0005) [2023-12-26 00:47:26,265][123090] Updated weights for policy 1, policy_version 150723 (0.0010) [2023-12-26 00:47:26,290][123091] Updated weights for policy 0, policy_version 151301 (0.0005) [2023-12-26 00:47:26,319][123090] Updated weights for policy 1, policy_version 150735 (0.0010) [2023-12-26 00:47:26,335][123091] Updated weights for policy 0, policy_version 151311 (0.0005) [2023-12-26 00:47:26,370][123090] Updated weights for policy 1, policy_version 150746 (0.0010) [2023-12-26 00:47:26,380][123091] Updated weights for policy 0, policy_version 151321 (0.0005) [2023-12-26 00:47:26,879][123091] Updated weights for policy 0, policy_version 151331 (0.0007) [2023-12-26 00:47:26,942][123091] Updated weights for policy 0, policy_version 151341 (0.0005) [2023-12-26 00:47:26,985][123091] Updated weights for policy 0, policy_version 151351 (0.0005) [2023-12-26 00:47:27,327][123090] Updated weights for policy 1, policy_version 150757 (0.0007) [2023-12-26 00:47:27,382][123090] Updated weights for policy 1, policy_version 150767 (0.0009) [2023-12-26 00:47:27,437][123090] Updated weights for policy 1, policy_version 150777 (0.0009) [2023-12-26 00:47:27,698][123091] Updated weights for policy 0, policy_version 151361 (0.0005) [2023-12-26 00:47:27,764][123091] Updated weights for policy 0, policy_version 151371 (0.0008) [2023-12-26 00:47:27,824][123091] Updated weights for policy 0, policy_version 151381 (0.0009) [2023-12-26 00:47:27,885][123091] Updated weights for policy 0, policy_version 151391 (0.0010) [2023-12-26 00:47:28,300][123090] Updated weights for policy 1, policy_version 150787 (0.0008) [2023-12-26 00:47:28,360][123090] Updated weights for policy 1, policy_version 150797 (0.0009) [2023-12-26 00:47:28,418][123090] Updated weights for policy 1, policy_version 150807 (0.0010) [2023-12-26 00:47:28,670][123091] Updated weights for policy 0, policy_version 151401 (0.0010) [2023-12-26 00:47:28,723][123091] Updated weights for policy 0, policy_version 151411 (0.0009) [2023-12-26 00:47:28,782][123091] Updated weights for policy 0, policy_version 151421 (0.0008) [2023-12-26 00:47:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 77365248. Throughput: 0: 8973.3, 1: 8670.4. Samples: 77361960. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 00:47:28,784][121949] Avg episode reward: [(0, '5476.779'), (1, '5371.438')] [2023-12-26 00:47:29,247][123090] Updated weights for policy 1, policy_version 150817 (0.0007) [2023-12-26 00:47:29,306][123090] Updated weights for policy 1, policy_version 150827 (0.0010) [2023-12-26 00:47:29,378][123090] Updated weights for policy 1, policy_version 150837 (0.0009) [2023-12-26 00:47:29,441][123090] Updated weights for policy 1, policy_version 150847 (0.0010) [2023-12-26 00:47:29,601][123091] Updated weights for policy 0, policy_version 151431 (0.0010) [2023-12-26 00:47:29,653][123091] Updated weights for policy 0, policy_version 151441 (0.0008) [2023-12-26 00:47:29,716][123091] Updated weights for policy 0, policy_version 151451 (0.0006) [2023-12-26 00:47:30,313][123090] Updated weights for policy 1, policy_version 150857 (0.0010) [2023-12-26 00:47:30,375][123090] Updated weights for policy 1, policy_version 150867 (0.0010) [2023-12-26 00:47:30,442][123090] Updated weights for policy 1, policy_version 150877 (0.0010) [2023-12-26 00:47:30,534][123091] Updated weights for policy 0, policy_version 151461 (0.0008) [2023-12-26 00:47:30,594][123091] Updated weights for policy 0, policy_version 151471 (0.0009) [2023-12-26 00:47:30,650][123091] Updated weights for policy 0, policy_version 151481 (0.0008) [2023-12-26 00:47:31,297][123090] Updated weights for policy 1, policy_version 150887 (0.0010) [2023-12-26 00:47:31,365][123090] Updated weights for policy 1, policy_version 150897 (0.0009) [2023-12-26 00:47:31,425][123090] Updated weights for policy 1, policy_version 150907 (0.0009) [2023-12-26 00:47:31,433][123091] Updated weights for policy 0, policy_version 151491 (0.0008) [2023-12-26 00:47:31,493][123091] Updated weights for policy 0, policy_version 151501 (0.0008) [2023-12-26 00:47:31,541][123091] Updated weights for policy 0, policy_version 151511 (0.0008) [2023-12-26 00:47:32,304][123090] Updated weights for policy 1, policy_version 150917 (0.0009) [2023-12-26 00:47:32,327][123091] Updated weights for policy 0, policy_version 151521 (0.0008) [2023-12-26 00:47:32,373][123090] Updated weights for policy 1, policy_version 150927 (0.0008) [2023-12-26 00:47:32,396][123091] Updated weights for policy 0, policy_version 151531 (0.0009) [2023-12-26 00:47:32,435][123090] Updated weights for policy 1, policy_version 150937 (0.0007) [2023-12-26 00:47:32,446][123091] Updated weights for policy 0, policy_version 151541 (0.0010) [2023-12-26 00:47:32,506][123091] Updated weights for policy 0, policy_version 151551 (0.0007) [2023-12-26 00:47:33,140][123091] Updated weights for policy 0, policy_version 151561 (0.0005) [2023-12-26 00:47:33,198][123091] Updated weights for policy 0, policy_version 151571 (0.0005) [2023-12-26 00:47:33,252][123091] Updated weights for policy 0, policy_version 151581 (0.0005) [2023-12-26 00:47:33,300][123090] Updated weights for policy 1, policy_version 150947 (0.0009) [2023-12-26 00:47:33,353][123090] Updated weights for policy 1, policy_version 150957 (0.0010) [2023-12-26 00:47:33,417][123090] Updated weights for policy 1, policy_version 150967 (0.0009) [2023-12-26 00:47:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 77455360. Throughput: 0: 9065.5, 1: 8587.9. Samples: 77466320. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:33,785][121949] Avg episode reward: [(0, '5359.865'), (1, '5361.160')] [2023-12-26 00:47:33,882][123091] Updated weights for policy 0, policy_version 151591 (0.0005) [2023-12-26 00:47:33,936][123091] Updated weights for policy 0, policy_version 151601 (0.0005) [2023-12-26 00:47:33,988][123091] Updated weights for policy 0, policy_version 151611 (0.0005) [2023-12-26 00:47:34,308][123090] Updated weights for policy 1, policy_version 150977 (0.0010) [2023-12-26 00:47:34,362][123090] Updated weights for policy 1, policy_version 150987 (0.0009) [2023-12-26 00:47:34,428][123090] Updated weights for policy 1, policy_version 150997 (0.0009) [2023-12-26 00:47:34,493][123090] Updated weights for policy 1, policy_version 151007 (0.0009) [2023-12-26 00:47:34,737][123091] Updated weights for policy 0, policy_version 151621 (0.0008) [2023-12-26 00:47:34,789][123091] Updated weights for policy 0, policy_version 151631 (0.0010) [2023-12-26 00:47:34,845][123091] Updated weights for policy 0, policy_version 151642 (0.0011) [2023-12-26 00:47:35,246][123090] Updated weights for policy 1, policy_version 151017 (0.0009) [2023-12-26 00:47:35,310][123090] Updated weights for policy 1, policy_version 151027 (0.0008) [2023-12-26 00:47:35,370][123090] Updated weights for policy 1, policy_version 151037 (0.0008) [2023-12-26 00:47:35,783][123091] Updated weights for policy 0, policy_version 151652 (0.0009) [2023-12-26 00:47:35,840][123091] Updated weights for policy 0, policy_version 151662 (0.0009) [2023-12-26 00:47:35,902][123091] Updated weights for policy 0, policy_version 151672 (0.0010) [2023-12-26 00:47:36,001][123090] Updated weights for policy 1, policy_version 151047 (0.0008) [2023-12-26 00:47:36,068][123090] Updated weights for policy 1, policy_version 151057 (0.0008) [2023-12-26 00:47:36,144][123090] Updated weights for policy 1, policy_version 151067 (0.0009) [2023-12-26 00:47:36,763][123091] Updated weights for policy 0, policy_version 151682 (0.0010) [2023-12-26 00:47:36,814][123091] Updated weights for policy 0, policy_version 151692 (0.0010) [2023-12-26 00:47:36,867][123091] Updated weights for policy 0, policy_version 151702 (0.0009) [2023-12-26 00:47:36,920][123091] Updated weights for policy 0, policy_version 151712 (0.0009) [2023-12-26 00:47:36,941][123090] Updated weights for policy 1, policy_version 151077 (0.0008) [2023-12-26 00:47:37,007][123090] Updated weights for policy 1, policy_version 151087 (0.0009) [2023-12-26 00:47:37,063][123090] Updated weights for policy 1, policy_version 151097 (0.0009) [2023-12-26 00:47:37,781][123091] Updated weights for policy 0, policy_version 151722 (0.0009) [2023-12-26 00:47:37,831][123091] Updated weights for policy 0, policy_version 151732 (0.0010) [2023-12-26 00:47:37,884][123091] Updated weights for policy 0, policy_version 151743 (0.0010) [2023-12-26 00:47:37,904][123090] Updated weights for policy 1, policy_version 151107 (0.0009) [2023-12-26 00:47:37,972][123090] Updated weights for policy 1, policy_version 151117 (0.0010) [2023-12-26 00:47:38,040][123090] Updated weights for policy 1, policy_version 151127 (0.0010) [2023-12-26 00:47:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 77537280. Throughput: 0: 9102.4, 1: 8595.2. Samples: 77519096. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:38,785][121949] Avg episode reward: [(0, '5354.935'), (1, '5422.489')] [2023-12-26 00:47:38,791][123091] Updated weights for policy 0, policy_version 151753 (0.0011) [2023-12-26 00:47:38,804][123090] Updated weights for policy 1, policy_version 151137 (0.0008) [2023-12-26 00:47:38,858][123091] Updated weights for policy 0, policy_version 151763 (0.0011) [2023-12-26 00:47:38,867][123090] Updated weights for policy 1, policy_version 151147 (0.0006) [2023-12-26 00:47:38,923][123091] Updated weights for policy 0, policy_version 151773 (0.0011) [2023-12-26 00:47:38,932][123090] Updated weights for policy 1, policy_version 151157 (0.0007) [2023-12-26 00:47:38,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000151776_38854656.pth... [2023-12-26 00:47:38,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000150688_38576128.pth [2023-12-26 00:47:38,985][123090] Updated weights for policy 1, policy_version 151167 (0.0006) [2023-12-26 00:47:38,988][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000151168_38699008.pth... [2023-12-26 00:47:38,991][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000150144_38436864.pth [2023-12-26 00:47:39,728][123091] Updated weights for policy 0, policy_version 151783 (0.0011) [2023-12-26 00:47:39,788][123091] Updated weights for policy 0, policy_version 151793 (0.0011) [2023-12-26 00:47:39,817][123090] Updated weights for policy 1, policy_version 151177 (0.0007) [2023-12-26 00:47:39,857][123091] Updated weights for policy 0, policy_version 151803 (0.0009) [2023-12-26 00:47:39,884][123090] Updated weights for policy 1, policy_version 151187 (0.0008) [2023-12-26 00:47:39,958][123090] Updated weights for policy 1, policy_version 151197 (0.0009) [2023-12-26 00:47:40,663][123091] Updated weights for policy 0, policy_version 151813 (0.0009) [2023-12-26 00:47:40,733][123091] Updated weights for policy 0, policy_version 151823 (0.0006) [2023-12-26 00:47:40,807][123091] Updated weights for policy 0, policy_version 151833 (0.0010) [2023-12-26 00:47:40,817][123090] Updated weights for policy 1, policy_version 151207 (0.0009) [2023-12-26 00:47:40,873][123090] Updated weights for policy 1, policy_version 151217 (0.0009) [2023-12-26 00:47:40,925][123090] Updated weights for policy 1, policy_version 151228 (0.0009) [2023-12-26 00:47:41,586][123091] Updated weights for policy 0, policy_version 151843 (0.0007) [2023-12-26 00:47:41,656][123091] Updated weights for policy 0, policy_version 151853 (0.0008) [2023-12-26 00:47:41,714][123091] Updated weights for policy 0, policy_version 151863 (0.0007) [2023-12-26 00:47:41,829][123090] Updated weights for policy 1, policy_version 151238 (0.0010) [2023-12-26 00:47:41,886][123090] Updated weights for policy 1, policy_version 151248 (0.0009) [2023-12-26 00:47:41,944][123090] Updated weights for policy 1, policy_version 151258 (0.0010) [2023-12-26 00:47:42,464][123091] Updated weights for policy 0, policy_version 151873 (0.0009) [2023-12-26 00:47:42,526][123091] Updated weights for policy 0, policy_version 151883 (0.0005) [2023-12-26 00:47:42,586][123091] Updated weights for policy 0, policy_version 151893 (0.0005) [2023-12-26 00:47:42,657][123091] Updated weights for policy 0, policy_version 151903 (0.0005) [2023-12-26 00:47:42,861][123090] Updated weights for policy 1, policy_version 151268 (0.0009) [2023-12-26 00:47:42,934][123090] Updated weights for policy 1, policy_version 151278 (0.0010) [2023-12-26 00:47:42,993][123090] Updated weights for policy 1, policy_version 151288 (0.0009) [2023-12-26 00:47:43,359][123091] Updated weights for policy 0, policy_version 151913 (0.0010) [2023-12-26 00:47:43,406][123091] Updated weights for policy 0, policy_version 151923 (0.0010) [2023-12-26 00:47:43,468][123091] Updated weights for policy 0, policy_version 151933 (0.0010) [2023-12-26 00:47:43,660][123090] Updated weights for policy 1, policy_version 151298 (0.0005) [2023-12-26 00:47:43,717][123090] Updated weights for policy 1, policy_version 151308 (0.0005) [2023-12-26 00:47:43,772][123090] Updated weights for policy 1, policy_version 151318 (0.0005) [2023-12-26 00:47:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 77627392. Throughput: 0: 9053.9, 1: 8496.0. Samples: 77621864. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:43,785][121949] Avg episode reward: [(0, '5432.332'), (1, '5406.237')] [2023-12-26 00:47:43,818][123090] Updated weights for policy 1, policy_version 151328 (0.0005) [2023-12-26 00:47:44,284][123091] Updated weights for policy 0, policy_version 151943 (0.0011) [2023-12-26 00:47:44,343][123091] Updated weights for policy 0, policy_version 151953 (0.0011) [2023-12-26 00:47:44,406][123091] Updated weights for policy 0, policy_version 151963 (0.0011) [2023-12-26 00:47:44,564][123090] Updated weights for policy 1, policy_version 151338 (0.0005) [2023-12-26 00:47:44,634][123090] Updated weights for policy 1, policy_version 151348 (0.0006) [2023-12-26 00:47:44,692][123090] Updated weights for policy 1, policy_version 151358 (0.0005) [2023-12-26 00:47:45,230][123091] Updated weights for policy 0, policy_version 151973 (0.0011) [2023-12-26 00:47:45,287][123091] Updated weights for policy 0, policy_version 151983 (0.0011) [2023-12-26 00:47:45,356][123091] Updated weights for policy 0, policy_version 151993 (0.0011) [2023-12-26 00:47:45,370][123090] Updated weights for policy 1, policy_version 151368 (0.0010) [2023-12-26 00:47:45,430][123090] Updated weights for policy 1, policy_version 151378 (0.0010) [2023-12-26 00:47:45,493][123090] Updated weights for policy 1, policy_version 151388 (0.0010) [2023-12-26 00:47:46,101][123091] Updated weights for policy 0, policy_version 152003 (0.0009) [2023-12-26 00:47:46,146][123091] Updated weights for policy 0, policy_version 152013 (0.0005) [2023-12-26 00:47:46,191][123091] Updated weights for policy 0, policy_version 152023 (0.0005) [2023-12-26 00:47:46,397][123090] Updated weights for policy 1, policy_version 151398 (0.0006) [2023-12-26 00:47:46,461][123090] Updated weights for policy 1, policy_version 151408 (0.0005) [2023-12-26 00:47:46,509][123090] Updated weights for policy 1, policy_version 151418 (0.0005) [2023-12-26 00:47:46,942][123091] Updated weights for policy 0, policy_version 152033 (0.0006) [2023-12-26 00:47:47,011][123091] Updated weights for policy 0, policy_version 152043 (0.0009) [2023-12-26 00:47:47,071][123091] Updated weights for policy 0, policy_version 152053 (0.0009) [2023-12-26 00:47:47,134][123091] Updated weights for policy 0, policy_version 152063 (0.0009) [2023-12-26 00:47:47,317][123090] Updated weights for policy 1, policy_version 151428 (0.0008) [2023-12-26 00:47:47,385][123090] Updated weights for policy 1, policy_version 151438 (0.0011) [2023-12-26 00:47:47,436][123090] Updated weights for policy 1, policy_version 151448 (0.0010) [2023-12-26 00:47:47,962][123091] Updated weights for policy 0, policy_version 152073 (0.0009) [2023-12-26 00:47:48,023][123091] Updated weights for policy 0, policy_version 152083 (0.0009) [2023-12-26 00:47:48,089][123091] Updated weights for policy 0, policy_version 152093 (0.0009) [2023-12-26 00:47:48,253][123090] Updated weights for policy 1, policy_version 151458 (0.0010) [2023-12-26 00:47:48,300][123090] Updated weights for policy 1, policy_version 151468 (0.0010) [2023-12-26 00:47:48,374][123090] Updated weights for policy 1, policy_version 151478 (0.0011) [2023-12-26 00:47:48,441][123090] Updated weights for policy 1, policy_version 151488 (0.0011) [2023-12-26 00:47:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 77717504. Throughput: 0: 9077.6, 1: 8568.2. Samples: 77730244. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:48,784][121949] Avg episode reward: [(0, '5502.694'), (1, '5380.822')] [2023-12-26 00:47:48,922][123091] Updated weights for policy 0, policy_version 152103 (0.0009) [2023-12-26 00:47:48,985][123091] Updated weights for policy 0, policy_version 152113 (0.0008) [2023-12-26 00:47:49,050][123091] Updated weights for policy 0, policy_version 152123 (0.0009) [2023-12-26 00:47:49,252][123090] Updated weights for policy 1, policy_version 151498 (0.0011) [2023-12-26 00:47:49,323][123090] Updated weights for policy 1, policy_version 151508 (0.0011) [2023-12-26 00:47:49,394][123090] Updated weights for policy 1, policy_version 151518 (0.0011) [2023-12-26 00:47:49,878][123091] Updated weights for policy 0, policy_version 152133 (0.0010) [2023-12-26 00:47:49,948][123091] Updated weights for policy 0, policy_version 152143 (0.0010) [2023-12-26 00:47:50,009][123091] Updated weights for policy 0, policy_version 152153 (0.0009) [2023-12-26 00:47:50,186][123090] Updated weights for policy 1, policy_version 151528 (0.0009) [2023-12-26 00:47:50,258][123090] Updated weights for policy 1, policy_version 151538 (0.0010) [2023-12-26 00:47:50,329][123090] Updated weights for policy 1, policy_version 151548 (0.0010) [2023-12-26 00:47:50,848][123091] Updated weights for policy 0, policy_version 152163 (0.0009) [2023-12-26 00:47:50,917][123091] Updated weights for policy 0, policy_version 152173 (0.0009) [2023-12-26 00:47:50,983][123091] Updated weights for policy 0, policy_version 152183 (0.0009) [2023-12-26 00:47:51,172][123090] Updated weights for policy 1, policy_version 151558 (0.0011) [2023-12-26 00:47:51,232][123090] Updated weights for policy 1, policy_version 151568 (0.0011) [2023-12-26 00:47:51,304][123090] Updated weights for policy 1, policy_version 151578 (0.0011) [2023-12-26 00:47:51,869][123091] Updated weights for policy 0, policy_version 152193 (0.0009) [2023-12-26 00:47:51,936][123091] Updated weights for policy 0, policy_version 152203 (0.0005) [2023-12-26 00:47:52,004][123091] Updated weights for policy 0, policy_version 152213 (0.0005) [2023-12-26 00:47:52,078][123091] Updated weights for policy 0, policy_version 152223 (0.0005) [2023-12-26 00:47:52,118][123090] Updated weights for policy 1, policy_version 151588 (0.0011) [2023-12-26 00:47:52,188][123090] Updated weights for policy 1, policy_version 151598 (0.0010) [2023-12-26 00:47:52,255][123090] Updated weights for policy 1, policy_version 151608 (0.0010) [2023-12-26 00:47:52,803][123091] Updated weights for policy 0, policy_version 152233 (0.0009) [2023-12-26 00:47:52,862][123091] Updated weights for policy 0, policy_version 152243 (0.0009) [2023-12-26 00:47:52,937][123091] Updated weights for policy 0, policy_version 152253 (0.0009) [2023-12-26 00:47:53,072][123090] Updated weights for policy 1, policy_version 151618 (0.0010) [2023-12-26 00:47:53,141][123090] Updated weights for policy 1, policy_version 151628 (0.0010) [2023-12-26 00:47:53,188][123090] Updated weights for policy 1, policy_version 151638 (0.0010) [2023-12-26 00:47:53,239][123090] Updated weights for policy 1, policy_version 151648 (0.0010) [2023-12-26 00:47:53,734][123091] Updated weights for policy 0, policy_version 152263 (0.0009) [2023-12-26 00:47:53,782][123091] Updated weights for policy 0, policy_version 152273 (0.0006) [2023-12-26 00:47:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 77799424. Throughput: 0: 9020.5, 1: 8546.0. Samples: 77780824. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:53,786][121949] Avg episode reward: [(0, '5541.691'), (1, '5344.071')] [2023-12-26 00:47:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000151648_38821888.pth... [2023-12-26 00:47:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000150656_38567936.pth [2023-12-26 00:47:53,837][123091] Updated weights for policy 0, policy_version 152283 (0.0008) [2023-12-26 00:47:53,864][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000152288_38985728.pth... [2023-12-26 00:47:53,868][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000151200_38707200.pth [2023-12-26 00:47:54,070][123090] Updated weights for policy 1, policy_version 151658 (0.0010) [2023-12-26 00:47:54,134][123090] Updated weights for policy 1, policy_version 151668 (0.0010) [2023-12-26 00:47:54,201][123090] Updated weights for policy 1, policy_version 151678 (0.0010) [2023-12-26 00:47:54,684][123091] Updated weights for policy 0, policy_version 152293 (0.0009) [2023-12-26 00:47:54,744][123091] Updated weights for policy 0, policy_version 152303 (0.0009) [2023-12-26 00:47:54,803][123091] Updated weights for policy 0, policy_version 152313 (0.0010) [2023-12-26 00:47:55,015][123090] Updated weights for policy 1, policy_version 151688 (0.0011) [2023-12-26 00:47:55,082][123090] Updated weights for policy 1, policy_version 151698 (0.0010) [2023-12-26 00:47:55,148][123090] Updated weights for policy 1, policy_version 151708 (0.0010) [2023-12-26 00:47:55,604][123091] Updated weights for policy 0, policy_version 152323 (0.0009) [2023-12-26 00:47:55,677][123091] Updated weights for policy 0, policy_version 152333 (0.0005) [2023-12-26 00:47:55,727][123091] Updated weights for policy 0, policy_version 152343 (0.0005) [2023-12-26 00:47:55,953][123090] Updated weights for policy 1, policy_version 151718 (0.0010) [2023-12-26 00:47:56,012][123090] Updated weights for policy 1, policy_version 151728 (0.0010) [2023-12-26 00:47:56,075][123090] Updated weights for policy 1, policy_version 151738 (0.0010) [2023-12-26 00:47:56,433][123091] Updated weights for policy 0, policy_version 152353 (0.0006) [2023-12-26 00:47:56,484][123091] Updated weights for policy 0, policy_version 152363 (0.0009) [2023-12-26 00:47:56,532][123091] Updated weights for policy 0, policy_version 152373 (0.0009) [2023-12-26 00:47:56,580][123091] Updated weights for policy 0, policy_version 152383 (0.0009) [2023-12-26 00:47:56,898][123090] Updated weights for policy 1, policy_version 151748 (0.0010) [2023-12-26 00:47:56,952][123090] Updated weights for policy 1, policy_version 151758 (0.0010) [2023-12-26 00:47:56,999][123090] Updated weights for policy 1, policy_version 151768 (0.0010) [2023-12-26 00:47:57,359][123091] Updated weights for policy 0, policy_version 152393 (0.0005) [2023-12-26 00:47:57,408][123091] Updated weights for policy 0, policy_version 152403 (0.0005) [2023-12-26 00:47:57,456][123091] Updated weights for policy 0, policy_version 152413 (0.0005) [2023-12-26 00:47:57,840][123090] Updated weights for policy 1, policy_version 151778 (0.0010) [2023-12-26 00:47:57,890][123090] Updated weights for policy 1, policy_version 151788 (0.0010) [2023-12-26 00:47:57,941][123090] Updated weights for policy 1, policy_version 151798 (0.0010) [2023-12-26 00:47:58,007][123090] Updated weights for policy 1, policy_version 151808 (0.0009) [2023-12-26 00:47:58,173][123091] Updated weights for policy 0, policy_version 152423 (0.0008) [2023-12-26 00:47:58,227][123091] Updated weights for policy 0, policy_version 152433 (0.0010) [2023-12-26 00:47:58,285][123091] Updated weights for policy 0, policy_version 152443 (0.0010) [2023-12-26 00:47:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 77889536. Throughput: 0: 9058.6, 1: 8559.1. Samples: 77886656. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:47:58,785][121949] Avg episode reward: [(0, '5567.607'), (1, '5321.082')] [2023-12-26 00:47:58,834][123090] Updated weights for policy 1, policy_version 151818 (0.0009) [2023-12-26 00:47:58,906][123090] Updated weights for policy 1, policy_version 151828 (0.0009) [2023-12-26 00:47:58,969][123090] Updated weights for policy 1, policy_version 151838 (0.0010) [2023-12-26 00:47:59,183][123091] Updated weights for policy 0, policy_version 152453 (0.0010) [2023-12-26 00:47:59,255][123091] Updated weights for policy 0, policy_version 152464 (0.0010) [2023-12-26 00:47:59,321][123091] Updated weights for policy 0, policy_version 152474 (0.0010) [2023-12-26 00:47:59,782][123090] Updated weights for policy 1, policy_version 151848 (0.0010) [2023-12-26 00:47:59,851][123090] Updated weights for policy 1, policy_version 151858 (0.0009) [2023-12-26 00:47:59,915][123090] Updated weights for policy 1, policy_version 151868 (0.0010) [2023-12-26 00:48:00,171][123091] Updated weights for policy 0, policy_version 152484 (0.0009) [2023-12-26 00:48:00,238][123091] Updated weights for policy 0, policy_version 152494 (0.0009) [2023-12-26 00:48:00,301][123091] Updated weights for policy 0, policy_version 152504 (0.0009) [2023-12-26 00:48:00,738][123090] Updated weights for policy 1, policy_version 151878 (0.0009) [2023-12-26 00:48:00,801][123090] Updated weights for policy 1, policy_version 151888 (0.0008) [2023-12-26 00:48:00,865][123090] Updated weights for policy 1, policy_version 151898 (0.0008) [2023-12-26 00:48:01,089][123091] Updated weights for policy 0, policy_version 152514 (0.0010) [2023-12-26 00:48:01,167][123091] Updated weights for policy 0, policy_version 152524 (0.0010) [2023-12-26 00:48:01,234][123091] Updated weights for policy 0, policy_version 152534 (0.0010) [2023-12-26 00:48:01,294][123091] Updated weights for policy 0, policy_version 152544 (0.0010) [2023-12-26 00:48:01,695][123090] Updated weights for policy 1, policy_version 151908 (0.0009) [2023-12-26 00:48:01,768][123090] Updated weights for policy 1, policy_version 151918 (0.0010) [2023-12-26 00:48:01,843][123090] Updated weights for policy 1, policy_version 151928 (0.0009) [2023-12-26 00:48:02,126][123091] Updated weights for policy 0, policy_version 152554 (0.0010) [2023-12-26 00:48:02,181][123091] Updated weights for policy 0, policy_version 152564 (0.0010) [2023-12-26 00:48:02,245][123091] Updated weights for policy 0, policy_version 152574 (0.0009) [2023-12-26 00:48:02,664][123090] Updated weights for policy 1, policy_version 151938 (0.0010) [2023-12-26 00:48:02,719][123090] Updated weights for policy 1, policy_version 151948 (0.0009) [2023-12-26 00:48:02,780][123090] Updated weights for policy 1, policy_version 151958 (0.0005) [2023-12-26 00:48:02,839][123090] Updated weights for policy 1, policy_version 151968 (0.0006) [2023-12-26 00:48:03,071][123091] Updated weights for policy 0, policy_version 152584 (0.0010) [2023-12-26 00:48:03,139][123091] Updated weights for policy 0, policy_version 152594 (0.0010) [2023-12-26 00:48:03,196][123091] Updated weights for policy 0, policy_version 152604 (0.0010) [2023-12-26 00:48:03,564][123090] Updated weights for policy 1, policy_version 151978 (0.0010) [2023-12-26 00:48:03,619][123090] Updated weights for policy 1, policy_version 151988 (0.0010) [2023-12-26 00:48:03,670][123090] Updated weights for policy 1, policy_version 151998 (0.0010) [2023-12-26 00:48:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 77979648. Throughput: 0: 8980.5, 1: 8494.1. Samples: 77989820. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:03,785][121949] Avg episode reward: [(0, '5530.261'), (1, '5276.213')] [2023-12-26 00:48:04,013][123091] Updated weights for policy 0, policy_version 152614 (0.0010) [2023-12-26 00:48:04,065][123091] Updated weights for policy 0, policy_version 152624 (0.0009) [2023-12-26 00:48:04,129][123091] Updated weights for policy 0, policy_version 152634 (0.0009) [2023-12-26 00:48:04,453][123090] Updated weights for policy 1, policy_version 152008 (0.0010) [2023-12-26 00:48:04,515][123090] Updated weights for policy 1, policy_version 152018 (0.0009) [2023-12-26 00:48:04,579][123090] Updated weights for policy 1, policy_version 152028 (0.0009) [2023-12-26 00:48:04,931][123091] Updated weights for policy 0, policy_version 152644 (0.0008) [2023-12-26 00:48:04,984][123091] Updated weights for policy 0, policy_version 152654 (0.0005) [2023-12-26 00:48:05,037][123091] Updated weights for policy 0, policy_version 152664 (0.0009) [2023-12-26 00:48:05,510][123090] Updated weights for policy 1, policy_version 152038 (0.0010) [2023-12-26 00:48:05,564][123090] Updated weights for policy 1, policy_version 152048 (0.0010) [2023-12-26 00:48:05,622][123090] Updated weights for policy 1, policy_version 152058 (0.0009) [2023-12-26 00:48:05,685][123091] Updated weights for policy 0, policy_version 152674 (0.0009) [2023-12-26 00:48:05,746][123091] Updated weights for policy 0, policy_version 152684 (0.0005) [2023-12-26 00:48:05,805][123091] Updated weights for policy 0, policy_version 152694 (0.0005) [2023-12-26 00:48:05,850][123091] Updated weights for policy 0, policy_version 152704 (0.0005) [2023-12-26 00:48:06,561][123090] Updated weights for policy 1, policy_version 152068 (0.0009) [2023-12-26 00:48:06,583][123091] Updated weights for policy 0, policy_version 152714 (0.0007) [2023-12-26 00:48:06,626][123090] Updated weights for policy 1, policy_version 152078 (0.0009) [2023-12-26 00:48:06,640][123091] Updated weights for policy 0, policy_version 152724 (0.0007) [2023-12-26 00:48:06,688][123090] Updated weights for policy 1, policy_version 152088 (0.0009) [2023-12-26 00:48:06,700][123091] Updated weights for policy 0, policy_version 152734 (0.0006) [2023-12-26 00:48:07,420][123091] Updated weights for policy 0, policy_version 152744 (0.0006) [2023-12-26 00:48:07,494][123091] Updated weights for policy 0, policy_version 152754 (0.0005) [2023-12-26 00:48:07,559][123091] Updated weights for policy 0, policy_version 152764 (0.0005) [2023-12-26 00:48:07,596][123090] Updated weights for policy 1, policy_version 152098 (0.0010) [2023-12-26 00:48:07,650][123090] Updated weights for policy 1, policy_version 152108 (0.0010) [2023-12-26 00:48:07,708][123090] Updated weights for policy 1, policy_version 152118 (0.0010) [2023-12-26 00:48:07,771][123090] Updated weights for policy 1, policy_version 152128 (0.0009) [2023-12-26 00:48:08,131][123091] Updated weights for policy 0, policy_version 152774 (0.0007) [2023-12-26 00:48:08,181][123091] Updated weights for policy 0, policy_version 152784 (0.0009) [2023-12-26 00:48:08,238][123091] Updated weights for policy 0, policy_version 152794 (0.0009) [2023-12-26 00:48:08,594][123090] Updated weights for policy 1, policy_version 152138 (0.0010) [2023-12-26 00:48:08,658][123090] Updated weights for policy 1, policy_version 152148 (0.0009) [2023-12-26 00:48:08,727][123090] Updated weights for policy 1, policy_version 152158 (0.0009) [2023-12-26 00:48:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 78069760. Throughput: 0: 9056.4, 1: 8501.5. Samples: 78042660. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:08,785][121949] Avg episode reward: [(0, '5546.195'), (1, '5159.023')] [2023-12-26 00:48:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000152800_39116800.pth... [2023-12-26 00:48:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000152160_38952960.pth... [2023-12-26 00:48:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000151168_38699008.pth [2023-12-26 00:48:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000151776_38854656.pth [2023-12-26 00:48:09,060][123091] Updated weights for policy 0, policy_version 152804 (0.0010) [2023-12-26 00:48:09,109][123091] Updated weights for policy 0, policy_version 152814 (0.0009) [2023-12-26 00:48:09,165][123091] Updated weights for policy 0, policy_version 152824 (0.0010) [2023-12-26 00:48:09,530][123090] Updated weights for policy 1, policy_version 152168 (0.0010) [2023-12-26 00:48:09,585][123090] Updated weights for policy 1, policy_version 152178 (0.0009) [2023-12-26 00:48:09,645][123090] Updated weights for policy 1, policy_version 152188 (0.0010) [2023-12-26 00:48:10,022][123091] Updated weights for policy 0, policy_version 152835 (0.0010) [2023-12-26 00:48:10,085][123091] Updated weights for policy 0, policy_version 152845 (0.0009) [2023-12-26 00:48:10,145][123091] Updated weights for policy 0, policy_version 152855 (0.0010) [2023-12-26 00:48:10,522][123090] Updated weights for policy 1, policy_version 152198 (0.0010) [2023-12-26 00:48:10,595][123090] Updated weights for policy 1, policy_version 152208 (0.0009) [2023-12-26 00:48:10,663][123090] Updated weights for policy 1, policy_version 152218 (0.0009) [2023-12-26 00:48:10,983][123091] Updated weights for policy 0, policy_version 152865 (0.0010) [2023-12-26 00:48:11,054][123091] Updated weights for policy 0, policy_version 152875 (0.0008) [2023-12-26 00:48:11,121][123091] Updated weights for policy 0, policy_version 152885 (0.0006) [2023-12-26 00:48:11,203][123091] Updated weights for policy 0, policy_version 152895 (0.0007) [2023-12-26 00:48:11,426][123090] Updated weights for policy 1, policy_version 152228 (0.0008) [2023-12-26 00:48:11,490][123090] Updated weights for policy 1, policy_version 152238 (0.0011) [2023-12-26 00:48:11,547][123090] Updated weights for policy 1, policy_version 152248 (0.0011) [2023-12-26 00:48:12,002][123091] Updated weights for policy 0, policy_version 152905 (0.0010) [2023-12-26 00:48:12,050][123091] Updated weights for policy 0, policy_version 152915 (0.0011) [2023-12-26 00:48:12,102][123091] Updated weights for policy 0, policy_version 152925 (0.0010) [2023-12-26 00:48:12,405][123090] Updated weights for policy 1, policy_version 152258 (0.0010) [2023-12-26 00:48:12,471][123090] Updated weights for policy 1, policy_version 152268 (0.0008) [2023-12-26 00:48:12,536][123090] Updated weights for policy 1, policy_version 152278 (0.0008) [2023-12-26 00:48:12,592][123090] Updated weights for policy 1, policy_version 152288 (0.0008) [2023-12-26 00:48:12,892][123091] Updated weights for policy 0, policy_version 152935 (0.0009) [2023-12-26 00:48:12,957][123091] Updated weights for policy 0, policy_version 152945 (0.0005) [2023-12-26 00:48:13,024][123091] Updated weights for policy 0, policy_version 152955 (0.0006) [2023-12-26 00:48:13,346][123090] Updated weights for policy 1, policy_version 152298 (0.0005) [2023-12-26 00:48:13,405][123090] Updated weights for policy 1, policy_version 152308 (0.0005) [2023-12-26 00:48:13,459][123090] Updated weights for policy 1, policy_version 152318 (0.0006) [2023-12-26 00:48:13,653][123091] Updated weights for policy 0, policy_version 152965 (0.0008) [2023-12-26 00:48:13,712][123091] Updated weights for policy 0, policy_version 152975 (0.0011) [2023-12-26 00:48:13,775][123091] Updated weights for policy 0, policy_version 152985 (0.0011) [2023-12-26 00:48:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 78151680. Throughput: 0: 8901.1, 1: 8534.6. Samples: 78146572. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:13,785][121949] Avg episode reward: [(0, '5610.856'), (1, '5249.520')] [2023-12-26 00:48:14,141][123090] Updated weights for policy 1, policy_version 152328 (0.0005) [2023-12-26 00:48:14,193][123090] Updated weights for policy 1, policy_version 152338 (0.0010) [2023-12-26 00:48:14,242][123090] Updated weights for policy 1, policy_version 152348 (0.0009) [2023-12-26 00:48:14,506][123091] Updated weights for policy 0, policy_version 152995 (0.0009) [2023-12-26 00:48:14,553][123091] Updated weights for policy 0, policy_version 153005 (0.0005) [2023-12-26 00:48:14,600][123091] Updated weights for policy 0, policy_version 153015 (0.0005) [2023-12-26 00:48:15,017][123090] Updated weights for policy 1, policy_version 152358 (0.0006) [2023-12-26 00:48:15,081][123090] Updated weights for policy 1, policy_version 152368 (0.0006) [2023-12-26 00:48:15,152][123090] Updated weights for policy 1, policy_version 152378 (0.0005) [2023-12-26 00:48:15,365][123091] Updated weights for policy 0, policy_version 153025 (0.0006) [2023-12-26 00:48:15,435][123091] Updated weights for policy 0, policy_version 153035 (0.0011) [2023-12-26 00:48:15,502][123091] Updated weights for policy 0, policy_version 153045 (0.0011) [2023-12-26 00:48:15,553][123091] Updated weights for policy 0, policy_version 153055 (0.0010) [2023-12-26 00:48:15,899][123090] Updated weights for policy 1, policy_version 152388 (0.0007) [2023-12-26 00:48:15,949][123090] Updated weights for policy 1, policy_version 152398 (0.0005) [2023-12-26 00:48:15,996][123090] Updated weights for policy 1, policy_version 152408 (0.0005) [2023-12-26 00:48:16,248][123091] Updated weights for policy 0, policy_version 153065 (0.0006) [2023-12-26 00:48:16,303][123091] Updated weights for policy 0, policy_version 153075 (0.0005) [2023-12-26 00:48:16,349][123091] Updated weights for policy 0, policy_version 153085 (0.0005) [2023-12-26 00:48:16,647][123090] Updated weights for policy 1, policy_version 152418 (0.0006) [2023-12-26 00:48:16,711][123090] Updated weights for policy 1, policy_version 152428 (0.0009) [2023-12-26 00:48:16,773][123090] Updated weights for policy 1, policy_version 152438 (0.0008) [2023-12-26 00:48:16,836][123090] Updated weights for policy 1, policy_version 152448 (0.0007) [2023-12-26 00:48:17,036][123091] Updated weights for policy 0, policy_version 153095 (0.0008) [2023-12-26 00:48:17,100][123091] Updated weights for policy 0, policy_version 153105 (0.0009) [2023-12-26 00:48:17,165][123091] Updated weights for policy 0, policy_version 153115 (0.0009) [2023-12-26 00:48:17,582][123090] Updated weights for policy 1, policy_version 152458 (0.0010) [2023-12-26 00:48:17,648][123090] Updated weights for policy 1, policy_version 152468 (0.0010) [2023-12-26 00:48:17,710][123090] Updated weights for policy 1, policy_version 152478 (0.0010) [2023-12-26 00:48:17,912][123091] Updated weights for policy 0, policy_version 153125 (0.0007) [2023-12-26 00:48:17,964][123091] Updated weights for policy 0, policy_version 153135 (0.0005) [2023-12-26 00:48:18,019][123091] Updated weights for policy 0, policy_version 153145 (0.0007) [2023-12-26 00:48:18,517][123090] Updated weights for policy 1, policy_version 152488 (0.0010) [2023-12-26 00:48:18,579][123090] Updated weights for policy 1, policy_version 152498 (0.0010) [2023-12-26 00:48:18,635][123090] Updated weights for policy 1, policy_version 152508 (0.0010) [2023-12-26 00:48:18,736][123091] Updated weights for policy 0, policy_version 153155 (0.0007) [2023-12-26 00:48:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 78249984. Throughput: 0: 8990.7, 1: 8718.0. Samples: 78263216. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:18,785][121949] Avg episode reward: [(0, '5411.321'), (1, '5308.974')] [2023-12-26 00:48:18,807][123091] Updated weights for policy 0, policy_version 153165 (0.0006) [2023-12-26 00:48:18,881][123091] Updated weights for policy 0, policy_version 153175 (0.0007) [2023-12-26 00:48:19,452][123090] Updated weights for policy 1, policy_version 152518 (0.0010) [2023-12-26 00:48:19,511][123090] Updated weights for policy 1, policy_version 152528 (0.0010) [2023-12-26 00:48:19,570][123090] Updated weights for policy 1, policy_version 152538 (0.0010) [2023-12-26 00:48:19,577][123091] Updated weights for policy 0, policy_version 153185 (0.0011) [2023-12-26 00:48:19,640][123091] Updated weights for policy 0, policy_version 153195 (0.0011) [2023-12-26 00:48:19,704][123091] Updated weights for policy 0, policy_version 153205 (0.0011) [2023-12-26 00:48:19,763][123091] Updated weights for policy 0, policy_version 153215 (0.0011) [2023-12-26 00:48:20,423][123090] Updated weights for policy 1, policy_version 152548 (0.0011) [2023-12-26 00:48:20,492][123090] Updated weights for policy 1, policy_version 152558 (0.0010) [2023-12-26 00:48:20,506][123091] Updated weights for policy 0, policy_version 153225 (0.0011) [2023-12-26 00:48:20,556][123090] Updated weights for policy 1, policy_version 152568 (0.0011) [2023-12-26 00:48:20,575][123091] Updated weights for policy 0, policy_version 153235 (0.0011) [2023-12-26 00:48:20,643][123091] Updated weights for policy 0, policy_version 153245 (0.0011) [2023-12-26 00:48:21,303][123090] Updated weights for policy 1, policy_version 152578 (0.0009) [2023-12-26 00:48:21,376][123090] Updated weights for policy 1, policy_version 152588 (0.0009) [2023-12-26 00:48:21,445][123090] Updated weights for policy 1, policy_version 152598 (0.0009) [2023-12-26 00:48:21,490][123091] Updated weights for policy 0, policy_version 153255 (0.0009) [2023-12-26 00:48:21,508][123090] Updated weights for policy 1, policy_version 152608 (0.0008) [2023-12-26 00:48:21,542][123091] Updated weights for policy 0, policy_version 153265 (0.0008) [2023-12-26 00:48:21,608][123091] Updated weights for policy 0, policy_version 153275 (0.0008) [2023-12-26 00:48:22,325][123090] Updated weights for policy 1, policy_version 152618 (0.0011) [2023-12-26 00:48:22,398][123090] Updated weights for policy 1, policy_version 152628 (0.0010) [2023-12-26 00:48:22,464][123090] Updated weights for policy 1, policy_version 152638 (0.0008) [2023-12-26 00:48:22,499][123091] Updated weights for policy 0, policy_version 153285 (0.0007) [2023-12-26 00:48:22,552][123091] Updated weights for policy 0, policy_version 153295 (0.0009) [2023-12-26 00:48:22,621][123091] Updated weights for policy 0, policy_version 153305 (0.0009) [2023-12-26 00:48:23,287][123090] Updated weights for policy 1, policy_version 152648 (0.0011) [2023-12-26 00:48:23,357][123090] Updated weights for policy 1, policy_version 152658 (0.0010) [2023-12-26 00:48:23,419][123090] Updated weights for policy 1, policy_version 152668 (0.0010) [2023-12-26 00:48:23,447][123091] Updated weights for policy 0, policy_version 153315 (0.0008) [2023-12-26 00:48:23,507][123091] Updated weights for policy 0, policy_version 153325 (0.0005) [2023-12-26 00:48:23,580][123091] Updated weights for policy 0, policy_version 153335 (0.0007) [2023-12-26 00:48:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 78340096. Throughput: 0: 9010.2, 1: 8688.6. Samples: 78315544. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:23,785][121949] Avg episode reward: [(0, '5454.402'), (1, '5211.613')] [2023-12-26 00:48:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000153344_39256064.pth... [2023-12-26 00:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000152672_39084032.pth... [2023-12-26 00:48:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000151648_38821888.pth [2023-12-26 00:48:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000152288_38985728.pth [2023-12-26 00:48:24,211][123090] Updated weights for policy 1, policy_version 152678 (0.0008) [2023-12-26 00:48:24,281][123090] Updated weights for policy 1, policy_version 152688 (0.0010) [2023-12-26 00:48:24,319][123091] Updated weights for policy 0, policy_version 153345 (0.0009) [2023-12-26 00:48:24,336][123090] Updated weights for policy 1, policy_version 152698 (0.0009) [2023-12-26 00:48:24,377][123091] Updated weights for policy 0, policy_version 153355 (0.0007) [2023-12-26 00:48:24,437][123091] Updated weights for policy 0, policy_version 153365 (0.0009) [2023-12-26 00:48:24,492][123091] Updated weights for policy 0, policy_version 153375 (0.0008) [2023-12-26 00:48:25,140][123090] Updated weights for policy 1, policy_version 152708 (0.0008) [2023-12-26 00:48:25,205][123090] Updated weights for policy 1, policy_version 152718 (0.0005) [2023-12-26 00:48:25,255][123090] Updated weights for policy 1, policy_version 152728 (0.0006) [2023-12-26 00:48:25,335][123091] Updated weights for policy 0, policy_version 153385 (0.0010) [2023-12-26 00:48:25,387][123091] Updated weights for policy 0, policy_version 153395 (0.0009) [2023-12-26 00:48:25,439][123091] Updated weights for policy 0, policy_version 153405 (0.0009) [2023-12-26 00:48:25,937][123090] Updated weights for policy 1, policy_version 152738 (0.0006) [2023-12-26 00:48:25,983][123090] Updated weights for policy 1, policy_version 152748 (0.0008) [2023-12-26 00:48:26,030][123090] Updated weights for policy 1, policy_version 152758 (0.0008) [2023-12-26 00:48:26,088][123090] Updated weights for policy 1, policy_version 152768 (0.0009) [2023-12-26 00:48:26,287][123091] Updated weights for policy 0, policy_version 153415 (0.0009) [2023-12-26 00:48:26,338][123091] Updated weights for policy 0, policy_version 153425 (0.0009) [2023-12-26 00:48:26,395][123091] Updated weights for policy 0, policy_version 153436 (0.0009) [2023-12-26 00:48:26,920][123090] Updated weights for policy 1, policy_version 152778 (0.0009) [2023-12-26 00:48:26,973][123090] Updated weights for policy 1, policy_version 152788 (0.0009) [2023-12-26 00:48:27,025][123090] Updated weights for policy 1, policy_version 152798 (0.0009) [2023-12-26 00:48:27,125][123091] Updated weights for policy 0, policy_version 153446 (0.0007) [2023-12-26 00:48:27,190][123091] Updated weights for policy 0, policy_version 153456 (0.0006) [2023-12-26 00:48:27,260][123091] Updated weights for policy 0, policy_version 153466 (0.0010) [2023-12-26 00:48:27,904][123091] Updated weights for policy 0, policy_version 153476 (0.0009) [2023-12-26 00:48:27,952][123090] Updated weights for policy 1, policy_version 152808 (0.0009) [2023-12-26 00:48:27,956][123091] Updated weights for policy 0, policy_version 153486 (0.0007) [2023-12-26 00:48:28,005][123091] Updated weights for policy 0, policy_version 153496 (0.0006) [2023-12-26 00:48:28,010][123090] Updated weights for policy 1, policy_version 152818 (0.0009) [2023-12-26 00:48:28,056][123090] Updated weights for policy 1, policy_version 152828 (0.0007) [2023-12-26 00:48:28,783][123091] Updated weights for policy 0, policy_version 153506 (0.0008) [2023-12-26 00:48:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 78422016. Throughput: 0: 9022.5, 1: 8725.2. Samples: 78420508. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:28,784][121949] Avg episode reward: [(0, '5387.537'), (1, '5299.199')] [2023-12-26 00:48:28,833][123091] Updated weights for policy 0, policy_version 153516 (0.0009) [2023-12-26 00:48:28,881][123091] Updated weights for policy 0, policy_version 153527 (0.0009) [2023-12-26 00:48:28,884][123090] Updated weights for policy 1, policy_version 152838 (0.0008) [2023-12-26 00:48:28,954][123090] Updated weights for policy 1, policy_version 152848 (0.0010) [2023-12-26 00:48:29,028][123090] Updated weights for policy 1, policy_version 152858 (0.0009) [2023-12-26 00:48:29,611][123091] Updated weights for policy 0, policy_version 153537 (0.0007) [2023-12-26 00:48:29,666][123091] Updated weights for policy 0, policy_version 153547 (0.0007) [2023-12-26 00:48:29,719][123091] Updated weights for policy 0, policy_version 153557 (0.0008) [2023-12-26 00:48:29,779][123091] Updated weights for policy 0, policy_version 153567 (0.0010) [2023-12-26 00:48:29,816][123090] Updated weights for policy 1, policy_version 152868 (0.0008) [2023-12-26 00:48:29,885][123090] Updated weights for policy 1, policy_version 152878 (0.0008) [2023-12-26 00:48:29,961][123090] Updated weights for policy 1, policy_version 152888 (0.0008) [2023-12-26 00:48:30,613][123091] Updated weights for policy 0, policy_version 153577 (0.0006) [2023-12-26 00:48:30,680][123091] Updated weights for policy 0, policy_version 153587 (0.0006) [2023-12-26 00:48:30,701][123090] Updated weights for policy 1, policy_version 152898 (0.0009) [2023-12-26 00:48:30,734][123091] Updated weights for policy 0, policy_version 153597 (0.0007) [2023-12-26 00:48:30,745][123090] Updated weights for policy 1, policy_version 152908 (0.0007) [2023-12-26 00:48:30,796][123090] Updated weights for policy 1, policy_version 152918 (0.0008) [2023-12-26 00:48:30,853][123090] Updated weights for policy 1, policy_version 152928 (0.0010) [2023-12-26 00:48:31,426][123091] Updated weights for policy 0, policy_version 153607 (0.0009) [2023-12-26 00:48:31,498][123091] Updated weights for policy 0, policy_version 153617 (0.0009) [2023-12-26 00:48:31,557][123091] Updated weights for policy 0, policy_version 153627 (0.0011) [2023-12-26 00:48:31,795][123090] Updated weights for policy 1, policy_version 152938 (0.0009) [2023-12-26 00:48:31,850][123090] Updated weights for policy 1, policy_version 152948 (0.0008) [2023-12-26 00:48:31,897][123090] Updated weights for policy 1, policy_version 152958 (0.0008) [2023-12-26 00:48:32,385][123091] Updated weights for policy 0, policy_version 153637 (0.0011) [2023-12-26 00:48:32,455][123091] Updated weights for policy 0, policy_version 153647 (0.0011) [2023-12-26 00:48:32,513][123091] Updated weights for policy 0, policy_version 153657 (0.0010) [2023-12-26 00:48:32,749][123090] Updated weights for policy 1, policy_version 152968 (0.0009) [2023-12-26 00:48:32,818][123090] Updated weights for policy 1, policy_version 152978 (0.0009) [2023-12-26 00:48:32,890][123090] Updated weights for policy 1, policy_version 152988 (0.0009) [2023-12-26 00:48:33,339][123091] Updated weights for policy 0, policy_version 153667 (0.0011) [2023-12-26 00:48:33,386][123091] Updated weights for policy 0, policy_version 153677 (0.0010) [2023-12-26 00:48:33,448][123091] Updated weights for policy 0, policy_version 153687 (0.0010) [2023-12-26 00:48:33,695][123090] Updated weights for policy 1, policy_version 152998 (0.0006) [2023-12-26 00:48:33,754][123090] Updated weights for policy 1, policy_version 153008 (0.0005) [2023-12-26 00:48:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 78512128. Throughput: 0: 9032.8, 1: 8643.1. Samples: 78525660. Policy #0 lag: (min: 31.0, avg: 48.2, max: 63.0) [2023-12-26 00:48:33,785][121949] Avg episode reward: [(0, '5546.351'), (1, '5318.608')] [2023-12-26 00:48:33,820][123090] Updated weights for policy 1, policy_version 153018 (0.0005) [2023-12-26 00:48:34,238][123091] Updated weights for policy 0, policy_version 153697 (0.0010) [2023-12-26 00:48:34,297][123091] Updated weights for policy 0, policy_version 153707 (0.0010) [2023-12-26 00:48:34,364][123091] Updated weights for policy 0, policy_version 153717 (0.0011) [2023-12-26 00:48:34,422][123091] Updated weights for policy 0, policy_version 153727 (0.0010) [2023-12-26 00:48:34,559][123090] Updated weights for policy 1, policy_version 153028 (0.0007) [2023-12-26 00:48:34,618][123090] Updated weights for policy 1, policy_version 153038 (0.0010) [2023-12-26 00:48:34,686][123090] Updated weights for policy 1, policy_version 153048 (0.0010) [2023-12-26 00:48:35,210][123091] Updated weights for policy 0, policy_version 153737 (0.0006) [2023-12-26 00:48:35,266][123091] Updated weights for policy 0, policy_version 153747 (0.0005) [2023-12-26 00:48:35,323][123091] Updated weights for policy 0, policy_version 153757 (0.0005) [2023-12-26 00:48:35,502][123090] Updated weights for policy 1, policy_version 153058 (0.0010) [2023-12-26 00:48:35,550][123090] Updated weights for policy 1, policy_version 153068 (0.0010) [2023-12-26 00:48:35,601][123090] Updated weights for policy 1, policy_version 153078 (0.0008) [2023-12-26 00:48:35,658][123090] Updated weights for policy 1, policy_version 153088 (0.0006) [2023-12-26 00:48:36,007][123091] Updated weights for policy 0, policy_version 153767 (0.0006) [2023-12-26 00:48:36,061][123091] Updated weights for policy 0, policy_version 153777 (0.0010) [2023-12-26 00:48:36,119][123091] Updated weights for policy 0, policy_version 153787 (0.0008) [2023-12-26 00:48:36,378][123090] Updated weights for policy 1, policy_version 153098 (0.0006) [2023-12-26 00:48:36,445][123090] Updated weights for policy 1, policy_version 153108 (0.0005) [2023-12-26 00:48:36,509][123090] Updated weights for policy 1, policy_version 153118 (0.0006) [2023-12-26 00:48:36,923][123091] Updated weights for policy 0, policy_version 153797 (0.0008) [2023-12-26 00:48:36,985][123091] Updated weights for policy 0, policy_version 153807 (0.0005) [2023-12-26 00:48:37,047][123091] Updated weights for policy 0, policy_version 153817 (0.0005) [2023-12-26 00:48:37,183][123090] Updated weights for policy 1, policy_version 153128 (0.0009) [2023-12-26 00:48:37,238][123090] Updated weights for policy 1, policy_version 153138 (0.0010) [2023-12-26 00:48:37,281][123090] Updated weights for policy 1, policy_version 153148 (0.0010) [2023-12-26 00:48:37,701][123091] Updated weights for policy 0, policy_version 153827 (0.0006) [2023-12-26 00:48:37,761][123091] Updated weights for policy 0, policy_version 153837 (0.0006) [2023-12-26 00:48:37,817][123091] Updated weights for policy 0, policy_version 153847 (0.0010) [2023-12-26 00:48:38,079][123090] Updated weights for policy 1, policy_version 153158 (0.0008) [2023-12-26 00:48:38,131][123090] Updated weights for policy 1, policy_version 153168 (0.0009) [2023-12-26 00:48:38,183][123090] Updated weights for policy 1, policy_version 153178 (0.0010) [2023-12-26 00:48:38,618][123091] Updated weights for policy 0, policy_version 153857 (0.0011) [2023-12-26 00:48:38,678][123091] Updated weights for policy 0, policy_version 153867 (0.0011) [2023-12-26 00:48:38,734][123091] Updated weights for policy 0, policy_version 153877 (0.0010) [2023-12-26 00:48:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 78602240. Throughput: 0: 9107.5, 1: 8702.8. Samples: 78582284. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:48:38,785][121949] Avg episode reward: [(0, '5653.770'), (1, '5369.704')] [2023-12-26 00:48:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000153184_39215104.pth... [2023-12-26 00:48:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000152160_38952960.pth [2023-12-26 00:48:38,801][123091] Updated weights for policy 0, policy_version 153887 (0.0008) [2023-12-26 00:48:38,805][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000153888_39395328.pth... [2023-12-26 00:48:38,810][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000152800_39116800.pth [2023-12-26 00:48:38,981][123090] Updated weights for policy 1, policy_version 153188 (0.0008) [2023-12-26 00:48:39,046][123090] Updated weights for policy 1, policy_version 153198 (0.0005) [2023-12-26 00:48:39,119][123090] Updated weights for policy 1, policy_version 153208 (0.0005) [2023-12-26 00:48:39,514][123091] Updated weights for policy 0, policy_version 153897 (0.0009) [2023-12-26 00:48:39,581][123091] Updated weights for policy 0, policy_version 153907 (0.0009) [2023-12-26 00:48:39,646][123091] Updated weights for policy 0, policy_version 153917 (0.0011) [2023-12-26 00:48:39,846][123090] Updated weights for policy 1, policy_version 153218 (0.0006) [2023-12-26 00:48:39,908][123090] Updated weights for policy 1, policy_version 153228 (0.0008) [2023-12-26 00:48:39,966][123090] Updated weights for policy 1, policy_version 153238 (0.0010) [2023-12-26 00:48:40,022][123090] Updated weights for policy 1, policy_version 153248 (0.0009) [2023-12-26 00:48:40,480][123091] Updated weights for policy 0, policy_version 153927 (0.0011) [2023-12-26 00:48:40,543][123091] Updated weights for policy 0, policy_version 153937 (0.0011) [2023-12-26 00:48:40,600][123091] Updated weights for policy 0, policy_version 153947 (0.0006) [2023-12-26 00:48:40,904][123090] Updated weights for policy 1, policy_version 153258 (0.0010) [2023-12-26 00:48:40,959][123090] Updated weights for policy 1, policy_version 153269 (0.0010) [2023-12-26 00:48:41,016][123090] Updated weights for policy 1, policy_version 153279 (0.0010) [2023-12-26 00:48:41,194][123091] Updated weights for policy 0, policy_version 153957 (0.0008) [2023-12-26 00:48:41,253][123091] Updated weights for policy 0, policy_version 153967 (0.0011) [2023-12-26 00:48:41,309][123091] Updated weights for policy 0, policy_version 153977 (0.0013) [2023-12-26 00:48:41,934][123090] Updated weights for policy 1, policy_version 153289 (0.0010) [2023-12-26 00:48:42,010][123090] Updated weights for policy 1, policy_version 153299 (0.0010) [2023-12-26 00:48:42,075][123090] Updated weights for policy 1, policy_version 153309 (0.0005) [2023-12-26 00:48:42,214][123091] Updated weights for policy 0, policy_version 153987 (0.0011) [2023-12-26 00:48:42,286][123091] Updated weights for policy 0, policy_version 153997 (0.0010) [2023-12-26 00:48:42,356][123091] Updated weights for policy 0, policy_version 154007 (0.0009) [2023-12-26 00:48:42,797][123090] Updated weights for policy 1, policy_version 153319 (0.0007) [2023-12-26 00:48:42,851][123090] Updated weights for policy 1, policy_version 153329 (0.0009) [2023-12-26 00:48:42,914][123090] Updated weights for policy 1, policy_version 153339 (0.0010) [2023-12-26 00:48:43,187][123091] Updated weights for policy 0, policy_version 154017 (0.0009) [2023-12-26 00:48:43,253][123091] Updated weights for policy 0, policy_version 154027 (0.0005) [2023-12-26 00:48:43,321][123091] Updated weights for policy 0, policy_version 154037 (0.0005) [2023-12-26 00:48:43,394][123091] Updated weights for policy 0, policy_version 154047 (0.0007) [2023-12-26 00:48:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 78692352. Throughput: 0: 9103.4, 1: 8746.2. Samples: 78689884. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:48:43,784][121949] Avg episode reward: [(0, '5603.196'), (1, '5507.490')] [2023-12-26 00:48:43,788][123090] Updated weights for policy 1, policy_version 153349 (0.0010) [2023-12-26 00:48:43,849][123090] Updated weights for policy 1, policy_version 153359 (0.0009) [2023-12-26 00:48:43,909][123090] Updated weights for policy 1, policy_version 153369 (0.0010) [2023-12-26 00:48:44,102][123091] Updated weights for policy 0, policy_version 154057 (0.0010) [2023-12-26 00:48:44,161][123091] Updated weights for policy 0, policy_version 154067 (0.0009) [2023-12-26 00:48:44,221][123091] Updated weights for policy 0, policy_version 154077 (0.0008) [2023-12-26 00:48:44,752][123090] Updated weights for policy 1, policy_version 153379 (0.0009) [2023-12-26 00:48:44,820][123090] Updated weights for policy 1, policy_version 153389 (0.0009) [2023-12-26 00:48:44,885][123090] Updated weights for policy 1, policy_version 153399 (0.0007) [2023-12-26 00:48:45,012][123091] Updated weights for policy 0, policy_version 154087 (0.0009) [2023-12-26 00:48:45,080][123091] Updated weights for policy 0, policy_version 154097 (0.0008) [2023-12-26 00:48:45,154][123091] Updated weights for policy 0, policy_version 154107 (0.0009) [2023-12-26 00:48:45,749][123090] Updated weights for policy 1, policy_version 153409 (0.0009) [2023-12-26 00:48:45,802][123090] Updated weights for policy 1, policy_version 153419 (0.0010) [2023-12-26 00:48:45,859][123090] Updated weights for policy 1, policy_version 153430 (0.0010) [2023-12-26 00:48:45,907][123091] Updated weights for policy 0, policy_version 154117 (0.0008) [2023-12-26 00:48:45,918][123090] Updated weights for policy 1, policy_version 153440 (0.0010) [2023-12-26 00:48:45,970][123091] Updated weights for policy 0, policy_version 154127 (0.0006) [2023-12-26 00:48:46,025][123091] Updated weights for policy 0, policy_version 154137 (0.0007) [2023-12-26 00:48:46,744][123091] Updated weights for policy 0, policy_version 154147 (0.0008) [2023-12-26 00:48:46,797][123090] Updated weights for policy 1, policy_version 153450 (0.0009) [2023-12-26 00:48:46,800][123091] Updated weights for policy 0, policy_version 154157 (0.0006) [2023-12-26 00:48:46,845][123090] Updated weights for policy 1, policy_version 153460 (0.0009) [2023-12-26 00:48:46,854][123091] Updated weights for policy 0, policy_version 154167 (0.0007) [2023-12-26 00:48:46,904][123090] Updated weights for policy 1, policy_version 153470 (0.0008) [2023-12-26 00:48:47,609][123091] Updated weights for policy 0, policy_version 154177 (0.0008) [2023-12-26 00:48:47,666][123091] Updated weights for policy 0, policy_version 154187 (0.0009) [2023-12-26 00:48:47,730][123091] Updated weights for policy 0, policy_version 154197 (0.0009) [2023-12-26 00:48:47,758][123090] Updated weights for policy 1, policy_version 153480 (0.0007) [2023-12-26 00:48:47,791][123091] Updated weights for policy 0, policy_version 154207 (0.0008) [2023-12-26 00:48:47,817][123090] Updated weights for policy 1, policy_version 153490 (0.0009) [2023-12-26 00:48:47,871][123090] Updated weights for policy 1, policy_version 153500 (0.0009) [2023-12-26 00:48:48,591][123091] Updated weights for policy 0, policy_version 154217 (0.0011) [2023-12-26 00:48:48,605][123090] Updated weights for policy 1, policy_version 153510 (0.0007) [2023-12-26 00:48:48,655][123091] Updated weights for policy 0, policy_version 154227 (0.0011) [2023-12-26 00:48:48,670][123090] Updated weights for policy 1, policy_version 153520 (0.0006) [2023-12-26 00:48:48,714][123091] Updated weights for policy 0, policy_version 154237 (0.0011) [2023-12-26 00:48:48,734][123090] Updated weights for policy 1, policy_version 153530 (0.0008) [2023-12-26 00:48:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 78790656. Throughput: 0: 9188.3, 1: 8722.0. Samples: 78795784. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:48:48,785][121949] Avg episode reward: [(0, '5590.211'), (1, '5549.525')] [2023-12-26 00:48:49,528][123090] Updated weights for policy 1, policy_version 153540 (0.0009) [2023-12-26 00:48:49,551][123091] Updated weights for policy 0, policy_version 154247 (0.0010) [2023-12-26 00:48:49,596][123090] Updated weights for policy 1, policy_version 153550 (0.0008) [2023-12-26 00:48:49,599][123091] Updated weights for policy 0, policy_version 154257 (0.0009) [2023-12-26 00:48:49,647][123091] Updated weights for policy 0, policy_version 154267 (0.0009) [2023-12-26 00:48:49,651][123090] Updated weights for policy 1, policy_version 153560 (0.0009) [2023-12-26 00:48:50,468][123091] Updated weights for policy 0, policy_version 154277 (0.0007) [2023-12-26 00:48:50,518][123090] Updated weights for policy 1, policy_version 153570 (0.0009) [2023-12-26 00:48:50,532][123091] Updated weights for policy 0, policy_version 154287 (0.0005) [2023-12-26 00:48:50,586][123090] Updated weights for policy 1, policy_version 153580 (0.0009) [2023-12-26 00:48:50,603][123091] Updated weights for policy 0, policy_version 154297 (0.0007) [2023-12-26 00:48:50,650][123090] Updated weights for policy 1, policy_version 153590 (0.0006) [2023-12-26 00:48:50,712][123090] Updated weights for policy 1, policy_version 153600 (0.0006) [2023-12-26 00:48:51,402][123091] Updated weights for policy 0, policy_version 154307 (0.0008) [2023-12-26 00:48:51,436][123090] Updated weights for policy 1, policy_version 153610 (0.0008) [2023-12-26 00:48:51,469][123091] Updated weights for policy 0, policy_version 154317 (0.0006) [2023-12-26 00:48:51,496][123090] Updated weights for policy 1, policy_version 153620 (0.0011) [2023-12-26 00:48:51,536][123091] Updated weights for policy 0, policy_version 154327 (0.0009) [2023-12-26 00:48:51,555][123090] Updated weights for policy 1, policy_version 153630 (0.0006) [2023-12-26 00:48:52,288][123090] Updated weights for policy 1, policy_version 153640 (0.0010) [2023-12-26 00:48:52,354][123091] Updated weights for policy 0, policy_version 154337 (0.0009) [2023-12-26 00:48:52,356][123090] Updated weights for policy 1, policy_version 153650 (0.0009) [2023-12-26 00:48:52,424][123091] Updated weights for policy 0, policy_version 154347 (0.0009) [2023-12-26 00:48:52,426][123090] Updated weights for policy 1, policy_version 153660 (0.0008) [2023-12-26 00:48:52,490][123091] Updated weights for policy 0, policy_version 154357 (0.0008) [2023-12-26 00:48:52,550][123091] Updated weights for policy 0, policy_version 154367 (0.0009) [2023-12-26 00:48:53,169][123090] Updated weights for policy 1, policy_version 153670 (0.0007) [2023-12-26 00:48:53,223][123090] Updated weights for policy 1, policy_version 153680 (0.0005) [2023-12-26 00:48:53,284][123090] Updated weights for policy 1, policy_version 153690 (0.0005) [2023-12-26 00:48:53,418][123091] Updated weights for policy 0, policy_version 154377 (0.0010) [2023-12-26 00:48:53,480][123091] Updated weights for policy 0, policy_version 154387 (0.0010) [2023-12-26 00:48:53,539][123091] Updated weights for policy 0, policy_version 154397 (0.0010) [2023-12-26 00:48:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17886.0, 300 sec: 17661.4). Total num frames: 78872576. Throughput: 0: 9134.8, 1: 8773.4. Samples: 78848528. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:48:53,785][121949] Avg episode reward: [(0, '5561.795'), (1, '5573.978')] [2023-12-26 00:48:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000154400_39526400.pth... [2023-12-26 00:48:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000153696_39346176.pth... [2023-12-26 00:48:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000152672_39084032.pth [2023-12-26 00:48:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000153344_39256064.pth [2023-12-26 00:48:54,006][123090] Updated weights for policy 1, policy_version 153700 (0.0007) [2023-12-26 00:48:54,075][123090] Updated weights for policy 1, policy_version 153710 (0.0011) [2023-12-26 00:48:54,139][123090] Updated weights for policy 1, policy_version 153720 (0.0010) [2023-12-26 00:48:54,361][123091] Updated weights for policy 0, policy_version 154407 (0.0010) [2023-12-26 00:48:54,412][123091] Updated weights for policy 0, policy_version 154417 (0.0010) [2023-12-26 00:48:54,467][123091] Updated weights for policy 0, policy_version 154427 (0.0010) [2023-12-26 00:48:54,791][123090] Updated weights for policy 1, policy_version 153730 (0.0007) [2023-12-26 00:48:54,849][123090] Updated weights for policy 1, policy_version 153741 (0.0010) [2023-12-26 00:48:54,920][123090] Updated weights for policy 1, policy_version 153751 (0.0009) [2023-12-26 00:48:55,241][123091] Updated weights for policy 0, policy_version 154437 (0.0010) [2023-12-26 00:48:55,299][123091] Updated weights for policy 0, policy_version 154447 (0.0010) [2023-12-26 00:48:55,354][123091] Updated weights for policy 0, policy_version 154457 (0.0010) [2023-12-26 00:48:55,630][123090] Updated weights for policy 1, policy_version 153761 (0.0006) [2023-12-26 00:48:55,681][123090] Updated weights for policy 1, policy_version 153771 (0.0006) [2023-12-26 00:48:55,728][123090] Updated weights for policy 1, policy_version 153781 (0.0005) [2023-12-26 00:48:55,778][123090] Updated weights for policy 1, policy_version 153791 (0.0010) [2023-12-26 00:48:56,188][123091] Updated weights for policy 0, policy_version 154467 (0.0010) [2023-12-26 00:48:56,236][123091] Updated weights for policy 0, policy_version 154477 (0.0010) [2023-12-26 00:48:56,283][123091] Updated weights for policy 0, policy_version 154487 (0.0010) [2023-12-26 00:48:56,492][123090] Updated weights for policy 1, policy_version 153801 (0.0006) [2023-12-26 00:48:56,544][123090] Updated weights for policy 1, policy_version 153811 (0.0010) [2023-12-26 00:48:56,591][123090] Updated weights for policy 1, policy_version 153821 (0.0010) [2023-12-26 00:48:57,112][123091] Updated weights for policy 0, policy_version 154497 (0.0010) [2023-12-26 00:48:57,171][123091] Updated weights for policy 0, policy_version 154507 (0.0008) [2023-12-26 00:48:57,231][123091] Updated weights for policy 0, policy_version 154517 (0.0009) [2023-12-26 00:48:57,290][123091] Updated weights for policy 0, policy_version 154527 (0.0009) [2023-12-26 00:48:57,405][123090] Updated weights for policy 1, policy_version 153831 (0.0007) [2023-12-26 00:48:57,463][123090] Updated weights for policy 1, policy_version 153841 (0.0007) [2023-12-26 00:48:57,529][123090] Updated weights for policy 1, policy_version 153851 (0.0010) [2023-12-26 00:48:58,023][123091] Updated weights for policy 0, policy_version 154537 (0.0010) [2023-12-26 00:48:58,090][123091] Updated weights for policy 0, policy_version 154547 (0.0010) [2023-12-26 00:48:58,148][123091] Updated weights for policy 0, policy_version 154557 (0.0010) [2023-12-26 00:48:58,275][123090] Updated weights for policy 1, policy_version 153861 (0.0010) [2023-12-26 00:48:58,341][123090] Updated weights for policy 1, policy_version 153871 (0.0010) [2023-12-26 00:48:58,406][123090] Updated weights for policy 1, policy_version 153881 (0.0011) [2023-12-26 00:48:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 78962688. Throughput: 0: 9088.2, 1: 8939.7. Samples: 78957828. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:48:58,785][121949] Avg episode reward: [(0, '5579.268'), (1, '5489.236')] [2023-12-26 00:48:59,037][123091] Updated weights for policy 0, policy_version 154567 (0.0009) [2023-12-26 00:48:59,098][123091] Updated weights for policy 0, policy_version 154577 (0.0009) [2023-12-26 00:48:59,162][123091] Updated weights for policy 0, policy_version 154587 (0.0009) [2023-12-26 00:48:59,295][123090] Updated weights for policy 1, policy_version 153891 (0.0007) [2023-12-26 00:48:59,350][123090] Updated weights for policy 1, policy_version 153901 (0.0008) [2023-12-26 00:48:59,423][123090] Updated weights for policy 1, policy_version 153911 (0.0008) [2023-12-26 00:49:00,066][123091] Updated weights for policy 0, policy_version 154597 (0.0009) [2023-12-26 00:49:00,131][123091] Updated weights for policy 0, policy_version 154607 (0.0008) [2023-12-26 00:49:00,146][123090] Updated weights for policy 1, policy_version 153921 (0.0007) [2023-12-26 00:49:00,196][123091] Updated weights for policy 0, policy_version 154617 (0.0005) [2023-12-26 00:49:00,209][123090] Updated weights for policy 1, policy_version 153931 (0.0010) [2023-12-26 00:49:00,272][123090] Updated weights for policy 1, policy_version 153941 (0.0010) [2023-12-26 00:49:00,337][123090] Updated weights for policy 1, policy_version 153951 (0.0010) [2023-12-26 00:49:01,026][123091] Updated weights for policy 0, policy_version 154627 (0.0007) [2023-12-26 00:49:01,087][123091] Updated weights for policy 0, policy_version 154637 (0.0009) [2023-12-26 00:49:01,117][123090] Updated weights for policy 1, policy_version 153961 (0.0010) [2023-12-26 00:49:01,149][123091] Updated weights for policy 0, policy_version 154647 (0.0009) [2023-12-26 00:49:01,188][123090] Updated weights for policy 1, policy_version 153971 (0.0010) [2023-12-26 00:49:01,247][123090] Updated weights for policy 1, policy_version 153981 (0.0010) [2023-12-26 00:49:02,018][123091] Updated weights for policy 0, policy_version 154657 (0.0007) [2023-12-26 00:49:02,049][123090] Updated weights for policy 1, policy_version 153991 (0.0011) [2023-12-26 00:49:02,078][123091] Updated weights for policy 0, policy_version 154667 (0.0008) [2023-12-26 00:49:02,114][123090] Updated weights for policy 1, policy_version 154001 (0.0009) [2023-12-26 00:49:02,147][123091] Updated weights for policy 0, policy_version 154677 (0.0009) [2023-12-26 00:49:02,181][123090] Updated weights for policy 1, policy_version 154011 (0.0008) [2023-12-26 00:49:02,213][123091] Updated weights for policy 0, policy_version 154687 (0.0006) [2023-12-26 00:49:02,988][123090] Updated weights for policy 1, policy_version 154021 (0.0011) [2023-12-26 00:49:03,043][123090] Updated weights for policy 1, policy_version 154031 (0.0010) [2023-12-26 00:49:03,046][123091] Updated weights for policy 0, policy_version 154697 (0.0007) [2023-12-26 00:49:03,102][123091] Updated weights for policy 0, policy_version 154707 (0.0010) [2023-12-26 00:49:03,105][123090] Updated weights for policy 1, policy_version 154041 (0.0010) [2023-12-26 00:49:03,155][123091] Updated weights for policy 0, policy_version 154717 (0.0007) [2023-12-26 00:49:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 79044608. Throughput: 0: 8870.2, 1: 8840.3. Samples: 79060192. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:03,785][121949] Avg episode reward: [(0, '5644.767'), (1, '5478.751')] [2023-12-26 00:49:03,917][123090] Updated weights for policy 1, policy_version 154051 (0.0010) [2023-12-26 00:49:03,937][123091] Updated weights for policy 0, policy_version 154727 (0.0007) [2023-12-26 00:49:03,976][123090] Updated weights for policy 1, policy_version 154061 (0.0010) [2023-12-26 00:49:04,001][123091] Updated weights for policy 0, policy_version 154737 (0.0006) [2023-12-26 00:49:04,039][123090] Updated weights for policy 1, policy_version 154071 (0.0010) [2023-12-26 00:49:04,064][123091] Updated weights for policy 0, policy_version 154747 (0.0007) [2023-12-26 00:49:04,896][123090] Updated weights for policy 1, policy_version 154081 (0.0011) [2023-12-26 00:49:04,916][123091] Updated weights for policy 0, policy_version 154757 (0.0009) [2023-12-26 00:49:04,963][123090] Updated weights for policy 1, policy_version 154091 (0.0006) [2023-12-26 00:49:04,976][123091] Updated weights for policy 0, policy_version 154767 (0.0008) [2023-12-26 00:49:05,029][123090] Updated weights for policy 1, policy_version 154101 (0.0005) [2023-12-26 00:49:05,030][123091] Updated weights for policy 0, policy_version 154777 (0.0009) [2023-12-26 00:49:05,083][123090] Updated weights for policy 1, policy_version 154111 (0.0005) [2023-12-26 00:49:05,637][123090] Updated weights for policy 1, policy_version 154121 (0.0010) [2023-12-26 00:49:05,707][123090] Updated weights for policy 1, policy_version 154131 (0.0010) [2023-12-26 00:49:05,769][123090] Updated weights for policy 1, policy_version 154141 (0.0010) [2023-12-26 00:49:05,944][123091] Updated weights for policy 0, policy_version 154787 (0.0011) [2023-12-26 00:49:05,994][123091] Updated weights for policy 0, policy_version 154797 (0.0009) [2023-12-26 00:49:06,059][123091] Updated weights for policy 0, policy_version 154807 (0.0010) [2023-12-26 00:49:06,538][123090] Updated weights for policy 1, policy_version 154151 (0.0010) [2023-12-26 00:49:06,607][123090] Updated weights for policy 1, policy_version 154161 (0.0009) [2023-12-26 00:49:06,672][123090] Updated weights for policy 1, policy_version 154171 (0.0010) [2023-12-26 00:49:06,921][123091] Updated weights for policy 0, policy_version 154817 (0.0008) [2023-12-26 00:49:06,975][123091] Updated weights for policy 0, policy_version 154827 (0.0010) [2023-12-26 00:49:07,037][123091] Updated weights for policy 0, policy_version 154837 (0.0010) [2023-12-26 00:49:07,092][123091] Updated weights for policy 0, policy_version 154847 (0.0009) [2023-12-26 00:49:07,383][123090] Updated weights for policy 1, policy_version 154181 (0.0007) [2023-12-26 00:49:07,431][123090] Updated weights for policy 1, policy_version 154191 (0.0005) [2023-12-26 00:49:07,484][123090] Updated weights for policy 1, policy_version 154201 (0.0005) [2023-12-26 00:49:08,026][123091] Updated weights for policy 0, policy_version 154857 (0.0010) [2023-12-26 00:49:08,086][123091] Updated weights for policy 0, policy_version 154868 (0.0011) [2023-12-26 00:49:08,142][123091] Updated weights for policy 0, policy_version 154879 (0.0010) [2023-12-26 00:49:08,200][123090] Updated weights for policy 1, policy_version 154211 (0.0005) [2023-12-26 00:49:08,252][123090] Updated weights for policy 1, policy_version 154221 (0.0005) [2023-12-26 00:49:08,311][123090] Updated weights for policy 1, policy_version 154231 (0.0006) [2023-12-26 00:49:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 79134720. Throughput: 0: 8822.3, 1: 8872.1. Samples: 79111792. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:08,785][121949] Avg episode reward: [(0, '5748.091'), (1, '5549.742')] [2023-12-26 00:49:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000154880_39649280.pth... [2023-12-26 00:49:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000154240_39485440.pth... [2023-12-26 00:49:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000153888_39395328.pth [2023-12-26 00:49:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000153184_39215104.pth [2023-12-26 00:49:09,053][123091] Updated weights for policy 0, policy_version 154890 (0.0010) [2023-12-26 00:49:09,095][123090] Updated weights for policy 1, policy_version 154241 (0.0010) [2023-12-26 00:49:09,106][123091] Updated weights for policy 0, policy_version 154900 (0.0009) [2023-12-26 00:49:09,158][123090] Updated weights for policy 1, policy_version 154251 (0.0008) [2023-12-26 00:49:09,161][123091] Updated weights for policy 0, policy_version 154910 (0.0009) [2023-12-26 00:49:09,227][123090] Updated weights for policy 1, policy_version 154261 (0.0010) [2023-12-26 00:49:09,293][123090] Updated weights for policy 1, policy_version 154271 (0.0010) [2023-12-26 00:49:10,033][123090] Updated weights for policy 1, policy_version 154281 (0.0010) [2023-12-26 00:49:10,082][123091] Updated weights for policy 0, policy_version 154920 (0.0008) [2023-12-26 00:49:10,102][123090] Updated weights for policy 1, policy_version 154291 (0.0009) [2023-12-26 00:49:10,144][123091] Updated weights for policy 0, policy_version 154930 (0.0010) [2023-12-26 00:49:10,163][123090] Updated weights for policy 1, policy_version 154301 (0.0008) [2023-12-26 00:49:10,209][123091] Updated weights for policy 0, policy_version 154940 (0.0008) [2023-12-26 00:49:10,923][123090] Updated weights for policy 1, policy_version 154311 (0.0008) [2023-12-26 00:49:10,989][123090] Updated weights for policy 1, policy_version 154321 (0.0005) [2023-12-26 00:49:11,063][123090] Updated weights for policy 1, policy_version 154331 (0.0010) [2023-12-26 00:49:11,082][123091] Updated weights for policy 0, policy_version 154950 (0.0009) [2023-12-26 00:49:11,154][123091] Updated weights for policy 0, policy_version 154960 (0.0007) [2023-12-26 00:49:11,232][123091] Updated weights for policy 0, policy_version 154970 (0.0006) [2023-12-26 00:49:11,932][123090] Updated weights for policy 1, policy_version 154341 (0.0010) [2023-12-26 00:49:11,967][123091] Updated weights for policy 0, policy_version 154980 (0.0009) [2023-12-26 00:49:11,992][123090] Updated weights for policy 1, policy_version 154351 (0.0008) [2023-12-26 00:49:12,031][123091] Updated weights for policy 0, policy_version 154990 (0.0008) [2023-12-26 00:49:12,054][123090] Updated weights for policy 1, policy_version 154361 (0.0009) [2023-12-26 00:49:12,097][123091] Updated weights for policy 0, policy_version 155000 (0.0006) [2023-12-26 00:49:12,820][123091] Updated weights for policy 0, policy_version 155010 (0.0009) [2023-12-26 00:49:12,864][123090] Updated weights for policy 1, policy_version 154371 (0.0009) [2023-12-26 00:49:12,875][123091] Updated weights for policy 0, policy_version 155020 (0.0009) [2023-12-26 00:49:12,919][123091] Updated weights for policy 0, policy_version 155030 (0.0006) [2023-12-26 00:49:12,924][123090] Updated weights for policy 1, policy_version 154381 (0.0009) [2023-12-26 00:49:12,973][123091] Updated weights for policy 0, policy_version 155040 (0.0009) [2023-12-26 00:49:12,975][123090] Updated weights for policy 1, policy_version 154391 (0.0008) [2023-12-26 00:49:13,718][123091] Updated weights for policy 0, policy_version 155050 (0.0005) [2023-12-26 00:49:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 79216640. Throughput: 0: 8751.5, 1: 8925.4. Samples: 79215972. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:13,785][121949] Avg episode reward: [(0, '5780.240'), (1, '5505.169')] [2023-12-26 00:49:13,791][123091] Updated weights for policy 0, policy_version 155060 (0.0007) [2023-12-26 00:49:13,854][123090] Updated weights for policy 1, policy_version 154401 (0.0010) [2023-12-26 00:49:13,862][123091] Updated weights for policy 0, policy_version 155070 (0.0009) [2023-12-26 00:49:13,906][123090] Updated weights for policy 1, policy_version 154411 (0.0010) [2023-12-26 00:49:13,966][123090] Updated weights for policy 1, policy_version 154421 (0.0010) [2023-12-26 00:49:14,023][123090] Updated weights for policy 1, policy_version 154431 (0.0010) [2023-12-26 00:49:14,551][123091] Updated weights for policy 0, policy_version 155080 (0.0009) [2023-12-26 00:49:14,608][123091] Updated weights for policy 0, policy_version 155090 (0.0009) [2023-12-26 00:49:14,663][123091] Updated weights for policy 0, policy_version 155100 (0.0009) [2023-12-26 00:49:14,874][123090] Updated weights for policy 1, policy_version 154441 (0.0009) [2023-12-26 00:49:14,938][123090] Updated weights for policy 1, policy_version 154451 (0.0009) [2023-12-26 00:49:15,004][123090] Updated weights for policy 1, policy_version 154461 (0.0009) [2023-12-26 00:49:15,513][123091] Updated weights for policy 0, policy_version 155110 (0.0009) [2023-12-26 00:49:15,559][123091] Updated weights for policy 0, policy_version 155120 (0.0009) [2023-12-26 00:49:15,629][123091] Updated weights for policy 0, policy_version 155130 (0.0009) [2023-12-26 00:49:15,835][123090] Updated weights for policy 1, policy_version 154471 (0.0007) [2023-12-26 00:49:15,883][123090] Updated weights for policy 1, policy_version 154481 (0.0005) [2023-12-26 00:49:15,932][123090] Updated weights for policy 1, policy_version 154491 (0.0005) [2023-12-26 00:49:16,533][123091] Updated weights for policy 0, policy_version 155141 (0.0010) [2023-12-26 00:49:16,584][123091] Updated weights for policy 0, policy_version 155151 (0.0009) [2023-12-26 00:49:16,633][123090] Updated weights for policy 1, policy_version 154501 (0.0007) [2023-12-26 00:49:16,641][123091] Updated weights for policy 0, policy_version 155161 (0.0007) [2023-12-26 00:49:16,700][123090] Updated weights for policy 1, policy_version 154511 (0.0009) [2023-12-26 00:49:16,764][123090] Updated weights for policy 1, policy_version 154521 (0.0009) [2023-12-26 00:49:17,506][123091] Updated weights for policy 0, policy_version 155171 (0.0010) [2023-12-26 00:49:17,562][123091] Updated weights for policy 0, policy_version 155181 (0.0010) [2023-12-26 00:49:17,571][123090] Updated weights for policy 1, policy_version 154531 (0.0009) [2023-12-26 00:49:17,618][123091] Updated weights for policy 0, policy_version 155191 (0.0009) [2023-12-26 00:49:17,639][123090] Updated weights for policy 1, policy_version 154541 (0.0008) [2023-12-26 00:49:17,704][123090] Updated weights for policy 1, policy_version 154551 (0.0009) [2023-12-26 00:49:18,459][123090] Updated weights for policy 1, policy_version 154561 (0.0009) [2023-12-26 00:49:18,472][123091] Updated weights for policy 0, policy_version 155201 (0.0008) [2023-12-26 00:49:18,509][123090] Updated weights for policy 1, policy_version 154571 (0.0008) [2023-12-26 00:49:18,538][123091] Updated weights for policy 0, policy_version 155211 (0.0008) [2023-12-26 00:49:18,574][123090] Updated weights for policy 1, policy_version 154581 (0.0010) [2023-12-26 00:49:18,604][123091] Updated weights for policy 0, policy_version 155221 (0.0006) [2023-12-26 00:49:18,633][123090] Updated weights for policy 1, policy_version 154591 (0.0010) [2023-12-26 00:49:18,670][123091] Updated weights for policy 0, policy_version 155231 (0.0008) [2023-12-26 00:49:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 79314944. Throughput: 0: 8692.7, 1: 8979.7. Samples: 79320920. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:18,784][121949] Avg episode reward: [(0, '5781.951'), (1, '5393.475')] [2023-12-26 00:49:19,349][123091] Updated weights for policy 0, policy_version 155241 (0.0009) [2023-12-26 00:49:19,405][123091] Updated weights for policy 0, policy_version 155251 (0.0006) [2023-12-26 00:49:19,469][123091] Updated weights for policy 0, policy_version 155261 (0.0009) [2023-12-26 00:49:19,555][123090] Updated weights for policy 1, policy_version 154601 (0.0010) [2023-12-26 00:49:19,621][123090] Updated weights for policy 1, policy_version 154611 (0.0010) [2023-12-26 00:49:19,689][123090] Updated weights for policy 1, policy_version 154621 (0.0010) [2023-12-26 00:49:20,208][123091] Updated weights for policy 0, policy_version 155271 (0.0009) [2023-12-26 00:49:20,270][123091] Updated weights for policy 0, policy_version 155281 (0.0008) [2023-12-26 00:49:20,327][123091] Updated weights for policy 0, policy_version 155291 (0.0006) [2023-12-26 00:49:20,561][123090] Updated weights for policy 1, policy_version 154631 (0.0010) [2023-12-26 00:49:20,627][123090] Updated weights for policy 1, policy_version 154641 (0.0010) [2023-12-26 00:49:20,691][123090] Updated weights for policy 1, policy_version 154651 (0.0010) [2023-12-26 00:49:21,179][123091] Updated weights for policy 0, policy_version 155301 (0.0006) [2023-12-26 00:49:21,242][123091] Updated weights for policy 0, policy_version 155311 (0.0008) [2023-12-26 00:49:21,309][123091] Updated weights for policy 0, policy_version 155321 (0.0009) [2023-12-26 00:49:21,628][123090] Updated weights for policy 1, policy_version 154661 (0.0009) [2023-12-26 00:49:21,697][123090] Updated weights for policy 1, policy_version 154671 (0.0008) [2023-12-26 00:49:21,766][123090] Updated weights for policy 1, policy_version 154681 (0.0010) [2023-12-26 00:49:22,160][123091] Updated weights for policy 0, policy_version 155331 (0.0010) [2023-12-26 00:49:22,225][123091] Updated weights for policy 0, policy_version 155341 (0.0009) [2023-12-26 00:49:22,295][123091] Updated weights for policy 0, policy_version 155351 (0.0007) [2023-12-26 00:49:22,613][123090] Updated weights for policy 1, policy_version 154691 (0.0009) [2023-12-26 00:49:22,678][123090] Updated weights for policy 1, policy_version 154701 (0.0009) [2023-12-26 00:49:22,740][123090] Updated weights for policy 1, policy_version 154711 (0.0009) [2023-12-26 00:49:23,124][123091] Updated weights for policy 0, policy_version 155361 (0.0007) [2023-12-26 00:49:23,194][123091] Updated weights for policy 0, policy_version 155371 (0.0009) [2023-12-26 00:49:23,258][123091] Updated weights for policy 0, policy_version 155381 (0.0009) [2023-12-26 00:49:23,318][123091] Updated weights for policy 0, policy_version 155391 (0.0010) [2023-12-26 00:49:23,574][123090] Updated weights for policy 1, policy_version 154721 (0.0010) [2023-12-26 00:49:23,640][123090] Updated weights for policy 1, policy_version 154731 (0.0009) [2023-12-26 00:49:23,714][123090] Updated weights for policy 1, policy_version 154741 (0.0009) [2023-12-26 00:49:23,782][123090] Updated weights for policy 1, policy_version 154751 (0.0009) [2023-12-26 00:49:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 79388672. Throughput: 0: 8670.1, 1: 8875.6. Samples: 79371836. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:23,784][121949] Avg episode reward: [(0, '5738.206'), (1, '5371.596')] [2023-12-26 00:49:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000155392_39780352.pth... [2023-12-26 00:49:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000154752_39616512.pth... [2023-12-26 00:49:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000154400_39526400.pth [2023-12-26 00:49:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000153696_39346176.pth [2023-12-26 00:49:24,117][123091] Updated weights for policy 0, policy_version 155401 (0.0010) [2023-12-26 00:49:24,172][123091] Updated weights for policy 0, policy_version 155411 (0.0009) [2023-12-26 00:49:24,226][123091] Updated weights for policy 0, policy_version 155421 (0.0009) [2023-12-26 00:49:24,597][123090] Updated weights for policy 1, policy_version 154761 (0.0010) [2023-12-26 00:49:24,646][123090] Updated weights for policy 1, policy_version 154772 (0.0009) [2023-12-26 00:49:24,703][123090] Updated weights for policy 1, policy_version 154782 (0.0010) [2023-12-26 00:49:25,045][123091] Updated weights for policy 0, policy_version 155431 (0.0007) [2023-12-26 00:49:25,113][123091] Updated weights for policy 0, policy_version 155441 (0.0006) [2023-12-26 00:49:25,175][123091] Updated weights for policy 0, policy_version 155451 (0.0009) [2023-12-26 00:49:25,606][123090] Updated weights for policy 1, policy_version 154792 (0.0010) [2023-12-26 00:49:25,675][123090] Updated weights for policy 1, policy_version 154802 (0.0009) [2023-12-26 00:49:25,744][123090] Updated weights for policy 1, policy_version 154812 (0.0009) [2023-12-26 00:49:25,998][123091] Updated weights for policy 0, policy_version 155461 (0.0009) [2023-12-26 00:49:26,061][123091] Updated weights for policy 0, policy_version 155471 (0.0010) [2023-12-26 00:49:26,118][123091] Updated weights for policy 0, policy_version 155481 (0.0009) [2023-12-26 00:49:26,554][123090] Updated weights for policy 1, policy_version 154822 (0.0010) [2023-12-26 00:49:26,606][123090] Updated weights for policy 1, policy_version 154832 (0.0009) [2023-12-26 00:49:26,657][123090] Updated weights for policy 1, policy_version 154842 (0.0009) [2023-12-26 00:49:26,940][123091] Updated weights for policy 0, policy_version 155491 (0.0009) [2023-12-26 00:49:26,988][123091] Updated weights for policy 0, policy_version 155501 (0.0009) [2023-12-26 00:49:27,037][123091] Updated weights for policy 0, policy_version 155511 (0.0009) [2023-12-26 00:49:27,474][123090] Updated weights for policy 1, policy_version 154852 (0.0009) [2023-12-26 00:49:27,528][123090] Updated weights for policy 1, policy_version 154862 (0.0009) [2023-12-26 00:49:27,587][123090] Updated weights for policy 1, policy_version 154873 (0.0010) [2023-12-26 00:49:27,766][123091] Updated weights for policy 0, policy_version 155521 (0.0009) [2023-12-26 00:49:27,819][123091] Updated weights for policy 0, policy_version 155531 (0.0005) [2023-12-26 00:49:27,864][123091] Updated weights for policy 0, policy_version 155541 (0.0005) [2023-12-26 00:49:27,909][123091] Updated weights for policy 0, policy_version 155551 (0.0005) [2023-12-26 00:49:28,491][123090] Updated weights for policy 1, policy_version 154884 (0.0009) [2023-12-26 00:49:28,548][123090] Updated weights for policy 1, policy_version 154894 (0.0010) [2023-12-26 00:49:28,610][123090] Updated weights for policy 1, policy_version 154904 (0.0010) [2023-12-26 00:49:28,680][123091] Updated weights for policy 0, policy_version 155561 (0.0009) [2023-12-26 00:49:28,730][123091] Updated weights for policy 0, policy_version 155571 (0.0009) [2023-12-26 00:49:28,779][123091] Updated weights for policy 0, policy_version 155581 (0.0009) [2023-12-26 00:49:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 79478784. Throughput: 0: 8629.1, 1: 8796.4. Samples: 79474036. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:28,785][121949] Avg episode reward: [(0, '5680.558'), (1, '5345.153')] [2023-12-26 00:49:29,456][123090] Updated weights for policy 1, policy_version 154914 (0.0008) [2023-12-26 00:49:29,532][123090] Updated weights for policy 1, policy_version 154924 (0.0005) [2023-12-26 00:49:29,608][123090] Updated weights for policy 1, policy_version 154934 (0.0006) [2023-12-26 00:49:29,628][123091] Updated weights for policy 0, policy_version 155591 (0.0009) [2023-12-26 00:49:29,677][123090] Updated weights for policy 1, policy_version 154944 (0.0006) [2023-12-26 00:49:29,691][123091] Updated weights for policy 0, policy_version 155601 (0.0007) [2023-12-26 00:49:29,763][123091] Updated weights for policy 0, policy_version 155611 (0.0009) [2023-12-26 00:49:30,353][123090] Updated weights for policy 1, policy_version 154954 (0.0006) [2023-12-26 00:49:30,417][123090] Updated weights for policy 1, policy_version 154964 (0.0007) [2023-12-26 00:49:30,469][123090] Updated weights for policy 1, policy_version 154974 (0.0009) [2023-12-26 00:49:30,576][123091] Updated weights for policy 0, policy_version 155621 (0.0010) [2023-12-26 00:49:30,631][123091] Updated weights for policy 0, policy_version 155631 (0.0009) [2023-12-26 00:49:30,695][123091] Updated weights for policy 0, policy_version 155641 (0.0009) [2023-12-26 00:49:31,282][123090] Updated weights for policy 1, policy_version 154984 (0.0010) [2023-12-26 00:49:31,344][123090] Updated weights for policy 1, policy_version 154994 (0.0010) [2023-12-26 00:49:31,420][123090] Updated weights for policy 1, policy_version 155004 (0.0010) [2023-12-26 00:49:31,547][123091] Updated weights for policy 0, policy_version 155651 (0.0009) [2023-12-26 00:49:31,605][123091] Updated weights for policy 0, policy_version 155661 (0.0009) [2023-12-26 00:49:31,683][123091] Updated weights for policy 0, policy_version 155671 (0.0008) [2023-12-26 00:49:32,179][123090] Updated weights for policy 1, policy_version 155014 (0.0006) [2023-12-26 00:49:32,229][123090] Updated weights for policy 1, policy_version 155024 (0.0005) [2023-12-26 00:49:32,290][123090] Updated weights for policy 1, policy_version 155034 (0.0007) [2023-12-26 00:49:32,330][123091] Updated weights for policy 0, policy_version 155681 (0.0007) [2023-12-26 00:49:32,399][123091] Updated weights for policy 0, policy_version 155691 (0.0006) [2023-12-26 00:49:32,466][123091] Updated weights for policy 0, policy_version 155701 (0.0006) [2023-12-26 00:49:32,521][123091] Updated weights for policy 0, policy_version 155711 (0.0005) [2023-12-26 00:49:33,146][123090] Updated weights for policy 1, policy_version 155044 (0.0006) [2023-12-26 00:49:33,196][123090] Updated weights for policy 1, policy_version 155054 (0.0005) [2023-12-26 00:49:33,216][123091] Updated weights for policy 0, policy_version 155721 (0.0007) [2023-12-26 00:49:33,248][123090] Updated weights for policy 1, policy_version 155064 (0.0005) [2023-12-26 00:49:33,279][123091] Updated weights for policy 0, policy_version 155731 (0.0005) [2023-12-26 00:49:33,325][123091] Updated weights for policy 0, policy_version 155741 (0.0005) [2023-12-26 00:49:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 79568896. Throughput: 0: 8634.4, 1: 8854.1. Samples: 79582768. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:33,785][121949] Avg episode reward: [(0, '5632.438'), (1, '5334.419')] [2023-12-26 00:49:33,896][123090] Updated weights for policy 1, policy_version 155074 (0.0005) [2023-12-26 00:49:33,951][123090] Updated weights for policy 1, policy_version 155084 (0.0005) [2023-12-26 00:49:34,000][123090] Updated weights for policy 1, policy_version 155094 (0.0005) [2023-12-26 00:49:34,007][123091] Updated weights for policy 0, policy_version 155751 (0.0005) [2023-12-26 00:49:34,057][123090] Updated weights for policy 1, policy_version 155104 (0.0005) [2023-12-26 00:49:34,059][123091] Updated weights for policy 0, policy_version 155761 (0.0005) [2023-12-26 00:49:34,111][123091] Updated weights for policy 0, policy_version 155771 (0.0005) [2023-12-26 00:49:34,829][123090] Updated weights for policy 1, policy_version 155114 (0.0006) [2023-12-26 00:49:34,876][123091] Updated weights for policy 0, policy_version 155781 (0.0007) [2023-12-26 00:49:34,887][123090] Updated weights for policy 1, policy_version 155124 (0.0006) [2023-12-26 00:49:34,928][123091] Updated weights for policy 0, policy_version 155791 (0.0008) [2023-12-26 00:49:34,941][123090] Updated weights for policy 1, policy_version 155134 (0.0007) [2023-12-26 00:49:34,980][123091] Updated weights for policy 0, policy_version 155801 (0.0009) [2023-12-26 00:49:35,726][123090] Updated weights for policy 1, policy_version 155144 (0.0009) [2023-12-26 00:49:35,792][123090] Updated weights for policy 1, policy_version 155154 (0.0010) [2023-12-26 00:49:35,835][123091] Updated weights for policy 0, policy_version 155811 (0.0008) [2023-12-26 00:49:35,845][123090] Updated weights for policy 1, policy_version 155164 (0.0010) [2023-12-26 00:49:35,885][123091] Updated weights for policy 0, policy_version 155821 (0.0008) [2023-12-26 00:49:35,941][123091] Updated weights for policy 0, policy_version 155831 (0.0009) [2023-12-26 00:49:36,725][123090] Updated weights for policy 1, policy_version 155174 (0.0010) [2023-12-26 00:49:36,749][123091] Updated weights for policy 0, policy_version 155841 (0.0010) [2023-12-26 00:49:36,784][123090] Updated weights for policy 1, policy_version 155184 (0.0010) [2023-12-26 00:49:36,814][123091] Updated weights for policy 0, policy_version 155851 (0.0008) [2023-12-26 00:49:36,849][123090] Updated weights for policy 1, policy_version 155194 (0.0010) [2023-12-26 00:49:36,878][123091] Updated weights for policy 0, policy_version 155861 (0.0008) [2023-12-26 00:49:36,930][123091] Updated weights for policy 0, policy_version 155871 (0.0009) [2023-12-26 00:49:37,598][123091] Updated weights for policy 0, policy_version 155881 (0.0007) [2023-12-26 00:49:37,664][123091] Updated weights for policy 0, policy_version 155891 (0.0008) [2023-12-26 00:49:37,720][123091] Updated weights for policy 0, policy_version 155901 (0.0009) [2023-12-26 00:49:37,752][123090] Updated weights for policy 1, policy_version 155204 (0.0009) [2023-12-26 00:49:37,809][123090] Updated weights for policy 1, policy_version 155214 (0.0009) [2023-12-26 00:49:37,874][123090] Updated weights for policy 1, policy_version 155224 (0.0010) [2023-12-26 00:49:38,568][123091] Updated weights for policy 0, policy_version 155911 (0.0010) [2023-12-26 00:49:38,636][123091] Updated weights for policy 0, policy_version 155921 (0.0010) [2023-12-26 00:49:38,701][123091] Updated weights for policy 0, policy_version 155931 (0.0009) [2023-12-26 00:49:38,715][123090] Updated weights for policy 1, policy_version 155234 (0.0009) [2023-12-26 00:49:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 79659008. Throughput: 0: 8662.1, 1: 8854.1. Samples: 79636760. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 00:49:38,785][121949] Avg episode reward: [(0, '5680.621'), (1, '5396.325')] [2023-12-26 00:49:38,785][123090] Updated weights for policy 1, policy_version 155244 (0.0009) [2023-12-26 00:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000155936_39919616.pth... [2023-12-26 00:49:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000154880_39649280.pth [2023-12-26 00:49:38,842][123090] Updated weights for policy 1, policy_version 155254 (0.0009) [2023-12-26 00:49:38,892][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000155264_39747584.pth... [2023-12-26 00:49:38,893][123090] Updated weights for policy 1, policy_version 155264 (0.0010) [2023-12-26 00:49:38,895][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000154240_39485440.pth [2023-12-26 00:49:39,531][123091] Updated weights for policy 0, policy_version 155941 (0.0008) [2023-12-26 00:49:39,594][123091] Updated weights for policy 0, policy_version 155951 (0.0009) [2023-12-26 00:49:39,660][123091] Updated weights for policy 0, policy_version 155961 (0.0010) [2023-12-26 00:49:39,762][123090] Updated weights for policy 1, policy_version 155275 (0.0010) [2023-12-26 00:49:39,818][123090] Updated weights for policy 1, policy_version 155285 (0.0009) [2023-12-26 00:49:39,880][123090] Updated weights for policy 1, policy_version 155295 (0.0010) [2023-12-26 00:49:40,445][123091] Updated weights for policy 0, policy_version 155971 (0.0010) [2023-12-26 00:49:40,509][123091] Updated weights for policy 0, policy_version 155981 (0.0009) [2023-12-26 00:49:40,566][123091] Updated weights for policy 0, policy_version 155991 (0.0009) [2023-12-26 00:49:40,775][123090] Updated weights for policy 1, policy_version 155305 (0.0010) [2023-12-26 00:49:40,843][123090] Updated weights for policy 1, policy_version 155315 (0.0009) [2023-12-26 00:49:40,895][123090] Updated weights for policy 1, policy_version 155325 (0.0010) [2023-12-26 00:49:41,449][123091] Updated weights for policy 0, policy_version 156002 (0.0010) [2023-12-26 00:49:41,518][123091] Updated weights for policy 0, policy_version 156012 (0.0008) [2023-12-26 00:49:41,590][123091] Updated weights for policy 0, policy_version 156022 (0.0009) [2023-12-26 00:49:41,659][123091] Updated weights for policy 0, policy_version 156032 (0.0008) [2023-12-26 00:49:41,735][123090] Updated weights for policy 1, policy_version 155336 (0.0007) [2023-12-26 00:49:41,811][123090] Updated weights for policy 1, policy_version 155346 (0.0007) [2023-12-26 00:49:41,882][123090] Updated weights for policy 1, policy_version 155356 (0.0010) [2023-12-26 00:49:42,503][123091] Updated weights for policy 0, policy_version 156042 (0.0009) [2023-12-26 00:49:42,566][123091] Updated weights for policy 0, policy_version 156052 (0.0009) [2023-12-26 00:49:42,636][123091] Updated weights for policy 0, policy_version 156062 (0.0009) [2023-12-26 00:49:42,670][123090] Updated weights for policy 1, policy_version 155366 (0.0009) [2023-12-26 00:49:42,741][123090] Updated weights for policy 1, policy_version 155376 (0.0010) [2023-12-26 00:49:42,804][123090] Updated weights for policy 1, policy_version 155386 (0.0010) [2023-12-26 00:49:43,385][123091] Updated weights for policy 0, policy_version 156072 (0.0009) [2023-12-26 00:49:43,437][123091] Updated weights for policy 0, policy_version 156082 (0.0009) [2023-12-26 00:49:43,490][123091] Updated weights for policy 0, policy_version 156092 (0.0007) [2023-12-26 00:49:43,660][123090] Updated weights for policy 1, policy_version 155396 (0.0010) [2023-12-26 00:49:43,724][123090] Updated weights for policy 1, policy_version 155406 (0.0009) [2023-12-26 00:49:43,776][123090] Updated weights for policy 1, policy_version 155416 (0.0009) [2023-12-26 00:49:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 79740928. Throughput: 0: 8647.7, 1: 8684.3. Samples: 79737768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:49:43,785][121949] Avg episode reward: [(0, '5727.972'), (1, '5472.887')] [2023-12-26 00:49:44,254][123091] Updated weights for policy 0, policy_version 156102 (0.0005) [2023-12-26 00:49:44,299][123091] Updated weights for policy 0, policy_version 156112 (0.0005) [2023-12-26 00:49:44,367][123091] Updated weights for policy 0, policy_version 156122 (0.0005) [2023-12-26 00:49:44,676][123090] Updated weights for policy 1, policy_version 155426 (0.0009) [2023-12-26 00:49:44,742][123090] Updated weights for policy 1, policy_version 155436 (0.0009) [2023-12-26 00:49:44,818][123090] Updated weights for policy 1, policy_version 155446 (0.0010) [2023-12-26 00:49:44,885][123090] Updated weights for policy 1, policy_version 155456 (0.0009) [2023-12-26 00:49:45,063][123091] Updated weights for policy 0, policy_version 156132 (0.0007) [2023-12-26 00:49:45,126][123091] Updated weights for policy 0, policy_version 156142 (0.0010) [2023-12-26 00:49:45,180][123091] Updated weights for policy 0, policy_version 156152 (0.0010) [2023-12-26 00:49:45,705][123090] Updated weights for policy 1, policy_version 155466 (0.0009) [2023-12-26 00:49:45,772][123090] Updated weights for policy 1, policy_version 155476 (0.0010) [2023-12-26 00:49:45,844][123090] Updated weights for policy 1, policy_version 155486 (0.0010) [2023-12-26 00:49:45,977][123091] Updated weights for policy 0, policy_version 156162 (0.0009) [2023-12-26 00:49:46,040][123091] Updated weights for policy 0, policy_version 156172 (0.0009) [2023-12-26 00:49:46,096][123091] Updated weights for policy 0, policy_version 156182 (0.0009) [2023-12-26 00:49:46,151][123091] Updated weights for policy 0, policy_version 156192 (0.0010) [2023-12-26 00:49:46,576][123090] Updated weights for policy 1, policy_version 155496 (0.0008) [2023-12-26 00:49:46,645][123090] Updated weights for policy 1, policy_version 155506 (0.0008) [2023-12-26 00:49:46,710][123090] Updated weights for policy 1, policy_version 155516 (0.0008) [2023-12-26 00:49:47,054][123091] Updated weights for policy 0, policy_version 156202 (0.0009) [2023-12-26 00:49:47,111][123091] Updated weights for policy 0, policy_version 156212 (0.0009) [2023-12-26 00:49:47,165][123091] Updated weights for policy 0, policy_version 156222 (0.0009) [2023-12-26 00:49:47,428][123090] Updated weights for policy 1, policy_version 155526 (0.0008) [2023-12-26 00:49:47,490][123090] Updated weights for policy 1, policy_version 155536 (0.0009) [2023-12-26 00:49:47,560][123090] Updated weights for policy 1, policy_version 155546 (0.0009) [2023-12-26 00:49:47,945][123091] Updated weights for policy 0, policy_version 156232 (0.0009) [2023-12-26 00:49:48,003][123091] Updated weights for policy 0, policy_version 156242 (0.0008) [2023-12-26 00:49:48,072][123091] Updated weights for policy 0, policy_version 156252 (0.0007) [2023-12-26 00:49:48,386][123090] Updated weights for policy 1, policy_version 155556 (0.0008) [2023-12-26 00:49:48,448][123090] Updated weights for policy 1, policy_version 155566 (0.0008) [2023-12-26 00:49:48,512][123090] Updated weights for policy 1, policy_version 155576 (0.0009) [2023-12-26 00:49:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 79831040. Throughput: 0: 8745.5, 1: 8640.5. Samples: 79842564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:49:48,785][121949] Avg episode reward: [(0, '5643.540'), (1, '5436.871')] [2023-12-26 00:49:48,904][123091] Updated weights for policy 0, policy_version 156262 (0.0007) [2023-12-26 00:49:48,969][123091] Updated weights for policy 0, policy_version 156272 (0.0005) [2023-12-26 00:49:49,040][123091] Updated weights for policy 0, policy_version 156282 (0.0008) [2023-12-26 00:49:49,258][123090] Updated weights for policy 1, policy_version 155586 (0.0009) [2023-12-26 00:49:49,314][123090] Updated weights for policy 1, policy_version 155596 (0.0006) [2023-12-26 00:49:49,386][123090] Updated weights for policy 1, policy_version 155606 (0.0007) [2023-12-26 00:49:49,445][123090] Updated weights for policy 1, policy_version 155616 (0.0008) [2023-12-26 00:49:49,861][123091] Updated weights for policy 0, policy_version 156292 (0.0010) [2023-12-26 00:49:49,923][123091] Updated weights for policy 0, policy_version 156302 (0.0009) [2023-12-26 00:49:49,981][123091] Updated weights for policy 0, policy_version 156312 (0.0009) [2023-12-26 00:49:50,275][123090] Updated weights for policy 1, policy_version 155626 (0.0011) [2023-12-26 00:49:50,333][123090] Updated weights for policy 1, policy_version 155636 (0.0011) [2023-12-26 00:49:50,396][123090] Updated weights for policy 1, policy_version 155646 (0.0011) [2023-12-26 00:49:50,839][123091] Updated weights for policy 0, policy_version 156322 (0.0009) [2023-12-26 00:49:50,896][123091] Updated weights for policy 0, policy_version 156332 (0.0009) [2023-12-26 00:49:50,958][123091] Updated weights for policy 0, policy_version 156342 (0.0009) [2023-12-26 00:49:51,027][123091] Updated weights for policy 0, policy_version 156352 (0.0010) [2023-12-26 00:49:51,248][123090] Updated weights for policy 1, policy_version 155656 (0.0010) [2023-12-26 00:49:51,318][123090] Updated weights for policy 1, policy_version 155666 (0.0011) [2023-12-26 00:49:51,390][123090] Updated weights for policy 1, policy_version 155676 (0.0010) [2023-12-26 00:49:51,906][123091] Updated weights for policy 0, policy_version 156362 (0.0009) [2023-12-26 00:49:51,961][123091] Updated weights for policy 0, policy_version 156372 (0.0010) [2023-12-26 00:49:52,020][123091] Updated weights for policy 0, policy_version 156383 (0.0010) [2023-12-26 00:49:52,143][123090] Updated weights for policy 1, policy_version 155686 (0.0008) [2023-12-26 00:49:52,212][123090] Updated weights for policy 1, policy_version 155696 (0.0008) [2023-12-26 00:49:52,283][123090] Updated weights for policy 1, policy_version 155706 (0.0008) [2023-12-26 00:49:52,933][123091] Updated weights for policy 0, policy_version 156393 (0.0009) [2023-12-26 00:49:52,998][123091] Updated weights for policy 0, policy_version 156403 (0.0009) [2023-12-26 00:49:53,057][123090] Updated weights for policy 1, policy_version 155716 (0.0008) [2023-12-26 00:49:53,064][123091] Updated weights for policy 0, policy_version 156413 (0.0007) [2023-12-26 00:49:53,108][123090] Updated weights for policy 1, policy_version 155726 (0.0010) [2023-12-26 00:49:53,162][123090] Updated weights for policy 1, policy_version 155736 (0.0010) [2023-12-26 00:49:53,721][123091] Updated weights for policy 0, policy_version 156423 (0.0007) [2023-12-26 00:49:53,783][123091] Updated weights for policy 0, policy_version 156433 (0.0006) [2023-12-26 00:49:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 79912960. Throughput: 0: 8760.7, 1: 8614.0. Samples: 79893648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:49:53,785][121949] Avg episode reward: [(0, '5693.491'), (1, '5427.065')] [2023-12-26 00:49:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000155744_39870464.pth... [2023-12-26 00:49:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000154752_39616512.pth [2023-12-26 00:49:53,833][123091] Updated weights for policy 0, policy_version 156443 (0.0007) [2023-12-26 00:49:53,854][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000156448_40050688.pth... [2023-12-26 00:49:53,857][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000155392_39780352.pth [2023-12-26 00:49:53,968][123090] Updated weights for policy 1, policy_version 155746 (0.0010) [2023-12-26 00:49:54,030][123090] Updated weights for policy 1, policy_version 155756 (0.0010) [2023-12-26 00:49:54,096][123090] Updated weights for policy 1, policy_version 155766 (0.0010) [2023-12-26 00:49:54,143][123090] Updated weights for policy 1, policy_version 155776 (0.0010) [2023-12-26 00:49:54,649][123091] Updated weights for policy 0, policy_version 156453 (0.0009) [2023-12-26 00:49:54,708][123091] Updated weights for policy 0, policy_version 156463 (0.0006) [2023-12-26 00:49:54,767][123091] Updated weights for policy 0, policy_version 156473 (0.0005) [2023-12-26 00:49:54,973][123090] Updated weights for policy 1, policy_version 155786 (0.0008) [2023-12-26 00:49:55,041][123090] Updated weights for policy 1, policy_version 155796 (0.0009) [2023-12-26 00:49:55,096][123090] Updated weights for policy 1, policy_version 155806 (0.0010) [2023-12-26 00:49:55,517][123091] Updated weights for policy 0, policy_version 156483 (0.0005) [2023-12-26 00:49:55,566][123091] Updated weights for policy 0, policy_version 156493 (0.0005) [2023-12-26 00:49:55,612][123091] Updated weights for policy 0, policy_version 156503 (0.0005) [2023-12-26 00:49:55,852][123090] Updated weights for policy 1, policy_version 155816 (0.0006) [2023-12-26 00:49:55,931][123090] Updated weights for policy 1, policy_version 155826 (0.0005) [2023-12-26 00:49:55,998][123090] Updated weights for policy 1, policy_version 155836 (0.0005) [2023-12-26 00:49:56,334][123091] Updated weights for policy 0, policy_version 156513 (0.0006) [2023-12-26 00:49:56,385][123091] Updated weights for policy 0, policy_version 156523 (0.0005) [2023-12-26 00:49:56,442][123091] Updated weights for policy 0, policy_version 156533 (0.0006) [2023-12-26 00:49:56,496][123091] Updated weights for policy 0, policy_version 156543 (0.0006) [2023-12-26 00:49:56,642][123090] Updated weights for policy 1, policy_version 155846 (0.0005) [2023-12-26 00:49:56,716][123090] Updated weights for policy 1, policy_version 155856 (0.0009) [2023-12-26 00:49:56,764][123090] Updated weights for policy 1, policy_version 155866 (0.0010) [2023-12-26 00:49:57,142][123091] Updated weights for policy 0, policy_version 156554 (0.0008) [2023-12-26 00:49:57,204][123091] Updated weights for policy 0, policy_version 156564 (0.0007) [2023-12-26 00:49:57,258][123091] Updated weights for policy 0, policy_version 156574 (0.0010) [2023-12-26 00:49:57,566][123090] Updated weights for policy 1, policy_version 155876 (0.0010) [2023-12-26 00:49:57,626][123090] Updated weights for policy 1, policy_version 155886 (0.0010) [2023-12-26 00:49:57,694][123090] Updated weights for policy 1, policy_version 155896 (0.0011) [2023-12-26 00:49:57,988][123091] Updated weights for policy 0, policy_version 156584 (0.0007) [2023-12-26 00:49:58,044][123091] Updated weights for policy 0, policy_version 156594 (0.0008) [2023-12-26 00:49:58,098][123091] Updated weights for policy 0, policy_version 156604 (0.0009) [2023-12-26 00:49:58,491][123090] Updated weights for policy 1, policy_version 155906 (0.0010) [2023-12-26 00:49:58,564][123090] Updated weights for policy 1, policy_version 155916 (0.0011) [2023-12-26 00:49:58,634][123090] Updated weights for policy 1, policy_version 155926 (0.0010) [2023-12-26 00:49:58,701][123090] Updated weights for policy 1, policy_version 155936 (0.0010) [2023-12-26 00:49:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 80011264. Throughput: 0: 8891.9, 1: 8626.8. Samples: 80004312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:49:58,785][121949] Avg episode reward: [(0, '5736.649'), (1, '5485.959')] [2023-12-26 00:49:58,917][123091] Updated weights for policy 0, policy_version 156614 (0.0007) [2023-12-26 00:49:58,990][123091] Updated weights for policy 0, policy_version 156624 (0.0010) [2023-12-26 00:49:59,063][123091] Updated weights for policy 0, policy_version 156634 (0.0010) [2023-12-26 00:49:59,499][123090] Updated weights for policy 1, policy_version 155946 (0.0005) [2023-12-26 00:49:59,564][123090] Updated weights for policy 1, policy_version 155956 (0.0006) [2023-12-26 00:49:59,611][123090] Updated weights for policy 1, policy_version 155966 (0.0010) [2023-12-26 00:49:59,815][123091] Updated weights for policy 0, policy_version 156644 (0.0010) [2023-12-26 00:49:59,879][123091] Updated weights for policy 0, policy_version 156654 (0.0009) [2023-12-26 00:49:59,929][123091] Updated weights for policy 0, policy_version 156664 (0.0009) [2023-12-26 00:50:00,393][123090] Updated weights for policy 1, policy_version 155976 (0.0006) [2023-12-26 00:50:00,467][123090] Updated weights for policy 1, policy_version 155986 (0.0010) [2023-12-26 00:50:00,544][123090] Updated weights for policy 1, policy_version 155996 (0.0006) [2023-12-26 00:50:00,685][123091] Updated weights for policy 0, policy_version 156674 (0.0010) [2023-12-26 00:50:00,745][123091] Updated weights for policy 0, policy_version 156684 (0.0006) [2023-12-26 00:50:00,805][123091] Updated weights for policy 0, policy_version 156694 (0.0007) [2023-12-26 00:50:00,849][123091] Updated weights for policy 0, policy_version 156704 (0.0005) [2023-12-26 00:50:01,284][123090] Updated weights for policy 1, policy_version 156006 (0.0008) [2023-12-26 00:50:01,360][123090] Updated weights for policy 1, policy_version 156016 (0.0011) [2023-12-26 00:50:01,422][123090] Updated weights for policy 1, policy_version 156026 (0.0010) [2023-12-26 00:50:01,584][123091] Updated weights for policy 0, policy_version 156714 (0.0005) [2023-12-26 00:50:01,650][123091] Updated weights for policy 0, policy_version 156724 (0.0007) [2023-12-26 00:50:01,712][123091] Updated weights for policy 0, policy_version 156734 (0.0006) [2023-12-26 00:50:02,275][123090] Updated weights for policy 1, policy_version 156036 (0.0011) [2023-12-26 00:50:02,327][123090] Updated weights for policy 1, policy_version 156046 (0.0010) [2023-12-26 00:50:02,390][123090] Updated weights for policy 1, policy_version 156056 (0.0010) [2023-12-26 00:50:02,417][123091] Updated weights for policy 0, policy_version 156744 (0.0010) [2023-12-26 00:50:02,479][123091] Updated weights for policy 0, policy_version 156754 (0.0010) [2023-12-26 00:50:02,538][123091] Updated weights for policy 0, policy_version 156764 (0.0010) [2023-12-26 00:50:03,148][123090] Updated weights for policy 1, policy_version 156066 (0.0010) [2023-12-26 00:50:03,214][123090] Updated weights for policy 1, policy_version 156076 (0.0010) [2023-12-26 00:50:03,274][123090] Updated weights for policy 1, policy_version 156086 (0.0010) [2023-12-26 00:50:03,299][123091] Updated weights for policy 0, policy_version 156774 (0.0007) [2023-12-26 00:50:03,330][123090] Updated weights for policy 1, policy_version 156096 (0.0008) [2023-12-26 00:50:03,347][123091] Updated weights for policy 0, policy_version 156784 (0.0005) [2023-12-26 00:50:03,420][123091] Updated weights for policy 0, policy_version 156794 (0.0005) [2023-12-26 00:50:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 80101376. Throughput: 0: 8982.9, 1: 8620.2. Samples: 80113060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:03,784][121949] Avg episode reward: [(0, '5654.639'), (1, '5499.993')] [2023-12-26 00:50:04,060][123090] Updated weights for policy 1, policy_version 156106 (0.0009) [2023-12-26 00:50:04,125][123090] Updated weights for policy 1, policy_version 156116 (0.0009) [2023-12-26 00:50:04,179][123090] Updated weights for policy 1, policy_version 156126 (0.0009) [2023-12-26 00:50:04,227][123091] Updated weights for policy 0, policy_version 156804 (0.0007) [2023-12-26 00:50:04,291][123091] Updated weights for policy 0, policy_version 156814 (0.0010) [2023-12-26 00:50:04,361][123091] Updated weights for policy 0, policy_version 156824 (0.0010) [2023-12-26 00:50:05,063][123090] Updated weights for policy 1, policy_version 156136 (0.0009) [2023-12-26 00:50:05,110][123091] Updated weights for policy 0, policy_version 156834 (0.0009) [2023-12-26 00:50:05,124][123090] Updated weights for policy 1, policy_version 156146 (0.0008) [2023-12-26 00:50:05,162][123091] Updated weights for policy 0, policy_version 156844 (0.0005) [2023-12-26 00:50:05,178][123090] Updated weights for policy 1, policy_version 156156 (0.0009) [2023-12-26 00:50:05,215][123091] Updated weights for policy 0, policy_version 156854 (0.0005) [2023-12-26 00:50:05,276][123091] Updated weights for policy 0, policy_version 156864 (0.0010) [2023-12-26 00:50:06,062][123090] Updated weights for policy 1, policy_version 156166 (0.0008) [2023-12-26 00:50:06,086][123091] Updated weights for policy 0, policy_version 156874 (0.0005) [2023-12-26 00:50:06,124][123090] Updated weights for policy 1, policy_version 156176 (0.0009) [2023-12-26 00:50:06,156][123091] Updated weights for policy 0, policy_version 156884 (0.0007) [2023-12-26 00:50:06,186][123090] Updated weights for policy 1, policy_version 156186 (0.0007) [2023-12-26 00:50:06,230][123091] Updated weights for policy 0, policy_version 156894 (0.0006) [2023-12-26 00:50:06,887][123091] Updated weights for policy 0, policy_version 156904 (0.0006) [2023-12-26 00:50:06,958][123091] Updated weights for policy 0, policy_version 156914 (0.0006) [2023-12-26 00:50:07,027][123091] Updated weights for policy 0, policy_version 156924 (0.0005) [2023-12-26 00:50:07,036][123090] Updated weights for policy 1, policy_version 156196 (0.0008) [2023-12-26 00:50:07,086][123090] Updated weights for policy 1, policy_version 156206 (0.0009) [2023-12-26 00:50:07,151][123090] Updated weights for policy 1, policy_version 156216 (0.0009) [2023-12-26 00:50:07,807][123090] Updated weights for policy 1, policy_version 156226 (0.0010) [2023-12-26 00:50:07,832][123091] Updated weights for policy 0, policy_version 156934 (0.0006) [2023-12-26 00:50:07,858][123090] Updated weights for policy 1, policy_version 156236 (0.0009) [2023-12-26 00:50:07,901][123091] Updated weights for policy 0, policy_version 156944 (0.0006) [2023-12-26 00:50:07,907][123090] Updated weights for policy 1, policy_version 156246 (0.0008) [2023-12-26 00:50:07,962][123090] Updated weights for policy 1, policy_version 156256 (0.0008) [2023-12-26 00:50:07,967][123091] Updated weights for policy 0, policy_version 156954 (0.0008) [2023-12-26 00:50:08,656][123091] Updated weights for policy 0, policy_version 156964 (0.0007) [2023-12-26 00:50:08,724][123091] Updated weights for policy 0, policy_version 156974 (0.0006) [2023-12-26 00:50:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 80183296. Throughput: 0: 8992.2, 1: 8656.3. Samples: 80166020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:08,785][121949] Avg episode reward: [(0, '5553.244'), (1, '5522.437')] [2023-12-26 00:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000156256_40001536.pth... [2023-12-26 00:50:08,794][123091] Updated weights for policy 0, policy_version 156984 (0.0006) [2023-12-26 00:50:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000155264_39747584.pth [2023-12-26 00:50:08,852][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000156992_40189952.pth... [2023-12-26 00:50:08,857][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000155936_39919616.pth [2023-12-26 00:50:08,880][123090] Updated weights for policy 1, policy_version 156266 (0.0009) [2023-12-26 00:50:08,942][123090] Updated weights for policy 1, policy_version 156276 (0.0009) [2023-12-26 00:50:08,992][123090] Updated weights for policy 1, policy_version 156286 (0.0009) [2023-12-26 00:50:09,597][123091] Updated weights for policy 0, policy_version 156994 (0.0006) [2023-12-26 00:50:09,655][123091] Updated weights for policy 0, policy_version 157004 (0.0010) [2023-12-26 00:50:09,711][123091] Updated weights for policy 0, policy_version 157016 (0.0011) [2023-12-26 00:50:09,783][123090] Updated weights for policy 1, policy_version 156296 (0.0006) [2023-12-26 00:50:09,850][123090] Updated weights for policy 1, policy_version 156306 (0.0008) [2023-12-26 00:50:09,915][123090] Updated weights for policy 1, policy_version 156316 (0.0011) [2023-12-26 00:50:10,629][123091] Updated weights for policy 0, policy_version 157026 (0.0010) [2023-12-26 00:50:10,686][123091] Updated weights for policy 0, policy_version 157036 (0.0008) [2023-12-26 00:50:10,691][123090] Updated weights for policy 1, policy_version 156326 (0.0009) [2023-12-26 00:50:10,750][123091] Updated weights for policy 0, policy_version 157046 (0.0010) [2023-12-26 00:50:10,758][123090] Updated weights for policy 1, policy_version 156336 (0.0011) [2023-12-26 00:50:10,804][123091] Updated weights for policy 0, policy_version 157056 (0.0007) [2023-12-26 00:50:10,818][123090] Updated weights for policy 1, policy_version 156346 (0.0010) [2023-12-26 00:50:11,599][123090] Updated weights for policy 1, policy_version 156356 (0.0010) [2023-12-26 00:50:11,674][123090] Updated weights for policy 1, policy_version 156366 (0.0009) [2023-12-26 00:50:11,700][123091] Updated weights for policy 0, policy_version 157066 (0.0007) [2023-12-26 00:50:11,736][123090] Updated weights for policy 1, policy_version 156376 (0.0010) [2023-12-26 00:50:11,771][123091] Updated weights for policy 0, policy_version 157076 (0.0008) [2023-12-26 00:50:11,825][123091] Updated weights for policy 0, policy_version 157086 (0.0009) [2023-12-26 00:50:12,613][123090] Updated weights for policy 1, policy_version 156386 (0.0009) [2023-12-26 00:50:12,685][123090] Updated weights for policy 1, policy_version 156396 (0.0010) [2023-12-26 00:50:12,692][123091] Updated weights for policy 0, policy_version 157096 (0.0007) [2023-12-26 00:50:12,755][123090] Updated weights for policy 1, policy_version 156406 (0.0008) [2023-12-26 00:50:12,757][123091] Updated weights for policy 0, policy_version 157106 (0.0008) [2023-12-26 00:50:12,813][123090] Updated weights for policy 1, policy_version 156416 (0.0009) [2023-12-26 00:50:12,823][123091] Updated weights for policy 0, policy_version 157116 (0.0008) [2023-12-26 00:50:13,633][123091] Updated weights for policy 0, policy_version 157126 (0.0009) [2023-12-26 00:50:13,635][123090] Updated weights for policy 1, policy_version 156426 (0.0009) [2023-12-26 00:50:13,691][123091] Updated weights for policy 0, policy_version 157136 (0.0007) [2023-12-26 00:50:13,699][123090] Updated weights for policy 1, policy_version 156436 (0.0009) [2023-12-26 00:50:13,738][123091] Updated weights for policy 0, policy_version 157146 (0.0008) [2023-12-26 00:50:13,752][123090] Updated weights for policy 1, policy_version 156446 (0.0009) [2023-12-26 00:50:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 80281600. Throughput: 0: 8952.5, 1: 8701.0. Samples: 80268444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:13,784][121949] Avg episode reward: [(0, '5583.851'), (1, '5543.094')] [2023-12-26 00:50:14,561][123090] Updated weights for policy 1, policy_version 156456 (0.0010) [2023-12-26 00:50:14,597][123091] Updated weights for policy 0, policy_version 157156 (0.0008) [2023-12-26 00:50:14,608][123090] Updated weights for policy 1, policy_version 156466 (0.0010) [2023-12-26 00:50:14,646][123091] Updated weights for policy 0, policy_version 157166 (0.0007) [2023-12-26 00:50:14,660][123090] Updated weights for policy 1, policy_version 156476 (0.0010) [2023-12-26 00:50:14,711][123091] Updated weights for policy 0, policy_version 157176 (0.0007) [2023-12-26 00:50:15,494][123090] Updated weights for policy 1, policy_version 156486 (0.0008) [2023-12-26 00:50:15,568][123090] Updated weights for policy 1, policy_version 156496 (0.0006) [2023-12-26 00:50:15,587][123091] Updated weights for policy 0, policy_version 157186 (0.0009) [2023-12-26 00:50:15,636][123090] Updated weights for policy 1, policy_version 156506 (0.0011) [2023-12-26 00:50:15,652][123091] Updated weights for policy 0, policy_version 157196 (0.0008) [2023-12-26 00:50:15,716][123091] Updated weights for policy 0, policy_version 157206 (0.0010) [2023-12-26 00:50:15,781][123091] Updated weights for policy 0, policy_version 157216 (0.0009) [2023-12-26 00:50:16,373][123090] Updated weights for policy 1, policy_version 156516 (0.0009) [2023-12-26 00:50:16,429][123090] Updated weights for policy 1, policy_version 156526 (0.0005) [2023-12-26 00:50:16,484][123090] Updated weights for policy 1, policy_version 156536 (0.0005) [2023-12-26 00:50:16,650][123091] Updated weights for policy 0, policy_version 157226 (0.0010) [2023-12-26 00:50:16,707][123091] Updated weights for policy 0, policy_version 157236 (0.0009) [2023-12-26 00:50:16,765][123091] Updated weights for policy 0, policy_version 157246 (0.0009) [2023-12-26 00:50:17,095][123090] Updated weights for policy 1, policy_version 156546 (0.0005) [2023-12-26 00:50:17,156][123090] Updated weights for policy 1, policy_version 156556 (0.0005) [2023-12-26 00:50:17,218][123090] Updated weights for policy 1, policy_version 156566 (0.0005) [2023-12-26 00:50:17,294][123090] Updated weights for policy 1, policy_version 156576 (0.0006) [2023-12-26 00:50:17,632][123091] Updated weights for policy 0, policy_version 157256 (0.0009) [2023-12-26 00:50:17,689][123091] Updated weights for policy 0, policy_version 157266 (0.0010) [2023-12-26 00:50:17,757][123091] Updated weights for policy 0, policy_version 157276 (0.0010) [2023-12-26 00:50:17,962][123090] Updated weights for policy 1, policy_version 156586 (0.0009) [2023-12-26 00:50:18,029][123090] Updated weights for policy 1, policy_version 156596 (0.0011) [2023-12-26 00:50:18,107][123090] Updated weights for policy 1, policy_version 156606 (0.0007) [2023-12-26 00:50:18,522][123091] Updated weights for policy 0, policy_version 157286 (0.0007) [2023-12-26 00:50:18,596][123091] Updated weights for policy 0, policy_version 157296 (0.0007) [2023-12-26 00:50:18,659][123091] Updated weights for policy 0, policy_version 157306 (0.0011) [2023-12-26 00:50:18,783][123090] Updated weights for policy 1, policy_version 156616 (0.0006) [2023-12-26 00:50:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 80363520. Throughput: 0: 8851.2, 1: 8763.3. Samples: 80375420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:18,784][121949] Avg episode reward: [(0, '5757.217'), (1, '5459.044')] [2023-12-26 00:50:18,857][123090] Updated weights for policy 1, policy_version 156626 (0.0007) [2023-12-26 00:50:18,928][123090] Updated weights for policy 1, policy_version 156636 (0.0006) [2023-12-26 00:50:19,354][123091] Updated weights for policy 0, policy_version 157316 (0.0010) [2023-12-26 00:50:19,425][123091] Updated weights for policy 0, policy_version 157326 (0.0007) [2023-12-26 00:50:19,496][123091] Updated weights for policy 0, policy_version 157336 (0.0008) [2023-12-26 00:50:19,620][123090] Updated weights for policy 1, policy_version 156646 (0.0008) [2023-12-26 00:50:19,682][123090] Updated weights for policy 1, policy_version 156656 (0.0009) [2023-12-26 00:50:19,739][123090] Updated weights for policy 1, policy_version 156666 (0.0009) [2023-12-26 00:50:20,277][123091] Updated weights for policy 0, policy_version 157346 (0.0011) [2023-12-26 00:50:20,336][123091] Updated weights for policy 0, policy_version 157356 (0.0011) [2023-12-26 00:50:20,385][123091] Updated weights for policy 0, policy_version 157366 (0.0010) [2023-12-26 00:50:20,448][123091] Updated weights for policy 0, policy_version 157376 (0.0011) [2023-12-26 00:50:20,532][123090] Updated weights for policy 1, policy_version 156676 (0.0008) [2023-12-26 00:50:20,593][123090] Updated weights for policy 1, policy_version 156686 (0.0007) [2023-12-26 00:50:20,661][123090] Updated weights for policy 1, policy_version 156696 (0.0009) [2023-12-26 00:50:21,274][123091] Updated weights for policy 0, policy_version 157386 (0.0010) [2023-12-26 00:50:21,339][123091] Updated weights for policy 0, policy_version 157396 (0.0007) [2023-12-26 00:50:21,407][123091] Updated weights for policy 0, policy_version 157406 (0.0009) [2023-12-26 00:50:21,499][123090] Updated weights for policy 1, policy_version 156706 (0.0008) [2023-12-26 00:50:21,565][123090] Updated weights for policy 1, policy_version 156716 (0.0009) [2023-12-26 00:50:21,633][123090] Updated weights for policy 1, policy_version 156726 (0.0010) [2023-12-26 00:50:21,706][123090] Updated weights for policy 1, policy_version 156736 (0.0009) [2023-12-26 00:50:22,208][123091] Updated weights for policy 0, policy_version 157416 (0.0009) [2023-12-26 00:50:22,272][123091] Updated weights for policy 0, policy_version 157426 (0.0009) [2023-12-26 00:50:22,346][123091] Updated weights for policy 0, policy_version 157436 (0.0009) [2023-12-26 00:50:22,544][123090] Updated weights for policy 1, policy_version 156746 (0.0006) [2023-12-26 00:50:22,613][123090] Updated weights for policy 1, policy_version 156756 (0.0005) [2023-12-26 00:50:22,678][123090] Updated weights for policy 1, policy_version 156766 (0.0006) [2023-12-26 00:50:23,275][123091] Updated weights for policy 0, policy_version 157446 (0.0007) [2023-12-26 00:50:23,336][123091] Updated weights for policy 0, policy_version 157456 (0.0009) [2023-12-26 00:50:23,385][123090] Updated weights for policy 1, policy_version 156776 (0.0009) [2023-12-26 00:50:23,402][123091] Updated weights for policy 0, policy_version 157466 (0.0008) [2023-12-26 00:50:23,439][123090] Updated weights for policy 1, policy_version 156786 (0.0008) [2023-12-26 00:50:23,488][123090] Updated weights for policy 1, policy_version 156796 (0.0009) [2023-12-26 00:50:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 80453632. Throughput: 0: 8825.0, 1: 8777.9. Samples: 80428888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:23,785][121949] Avg episode reward: [(0, '5791.387'), (1, '5487.473')] [2023-12-26 00:50:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000156800_40140800.pth... [2023-12-26 00:50:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000157472_40312832.pth... [2023-12-26 00:50:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000155744_39870464.pth [2023-12-26 00:50:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000156448_40050688.pth [2023-12-26 00:50:24,070][123091] Updated weights for policy 0, policy_version 157476 (0.0007) [2023-12-26 00:50:24,135][123091] Updated weights for policy 0, policy_version 157486 (0.0008) [2023-12-26 00:50:24,192][123091] Updated weights for policy 0, policy_version 157496 (0.0006) [2023-12-26 00:50:24,376][123090] Updated weights for policy 1, policy_version 156806 (0.0010) [2023-12-26 00:50:24,430][123090] Updated weights for policy 1, policy_version 156816 (0.0009) [2023-12-26 00:50:24,486][123090] Updated weights for policy 1, policy_version 156826 (0.0009) [2023-12-26 00:50:24,906][123091] Updated weights for policy 0, policy_version 157506 (0.0007) [2023-12-26 00:50:24,960][123091] Updated weights for policy 0, policy_version 157517 (0.0010) [2023-12-26 00:50:25,020][123091] Updated weights for policy 0, policy_version 157527 (0.0009) [2023-12-26 00:50:25,274][123090] Updated weights for policy 1, policy_version 156836 (0.0010) [2023-12-26 00:50:25,341][123090] Updated weights for policy 1, policy_version 156846 (0.0009) [2023-12-26 00:50:25,407][123090] Updated weights for policy 1, policy_version 156856 (0.0010) [2023-12-26 00:50:25,891][123091] Updated weights for policy 0, policy_version 157537 (0.0009) [2023-12-26 00:50:25,951][123091] Updated weights for policy 0, policy_version 157547 (0.0006) [2023-12-26 00:50:26,015][123091] Updated weights for policy 0, policy_version 157557 (0.0009) [2023-12-26 00:50:26,068][123091] Updated weights for policy 0, policy_version 157567 (0.0005) [2023-12-26 00:50:26,089][123090] Updated weights for policy 1, policy_version 156866 (0.0010) [2023-12-26 00:50:26,155][123090] Updated weights for policy 1, policy_version 156876 (0.0010) [2023-12-26 00:50:26,217][123090] Updated weights for policy 1, policy_version 156886 (0.0010) [2023-12-26 00:50:26,286][123090] Updated weights for policy 1, policy_version 156896 (0.0010) [2023-12-26 00:50:26,862][123091] Updated weights for policy 0, policy_version 157577 (0.0008) [2023-12-26 00:50:26,916][123091] Updated weights for policy 0, policy_version 157587 (0.0005) [2023-12-26 00:50:26,971][123091] Updated weights for policy 0, policy_version 157598 (0.0007) [2023-12-26 00:50:27,107][123090] Updated weights for policy 1, policy_version 156906 (0.0006) [2023-12-26 00:50:27,186][123090] Updated weights for policy 1, policy_version 156916 (0.0005) [2023-12-26 00:50:27,264][123090] Updated weights for policy 1, policy_version 156926 (0.0007) [2023-12-26 00:50:27,731][123091] Updated weights for policy 0, policy_version 157608 (0.0005) [2023-12-26 00:50:27,777][123091] Updated weights for policy 0, policy_version 157618 (0.0005) [2023-12-26 00:50:27,828][123091] Updated weights for policy 0, policy_version 157628 (0.0005) [2023-12-26 00:50:27,987][123090] Updated weights for policy 1, policy_version 156936 (0.0006) [2023-12-26 00:50:28,044][123090] Updated weights for policy 1, policy_version 156946 (0.0005) [2023-12-26 00:50:28,106][123090] Updated weights for policy 1, policy_version 156956 (0.0005) [2023-12-26 00:50:28,471][123091] Updated weights for policy 0, policy_version 157638 (0.0005) [2023-12-26 00:50:28,520][123091] Updated weights for policy 0, policy_version 157648 (0.0005) [2023-12-26 00:50:28,567][123091] Updated weights for policy 0, policy_version 157658 (0.0005) [2023-12-26 00:50:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 80543744. Throughput: 0: 8886.6, 1: 8848.2. Samples: 80535832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:28,785][121949] Avg episode reward: [(0, '5767.600'), (1, '5445.954')] [2023-12-26 00:50:28,865][123090] Updated weights for policy 1, policy_version 156966 (0.0008) [2023-12-26 00:50:28,920][123090] Updated weights for policy 1, policy_version 156976 (0.0010) [2023-12-26 00:50:28,967][123090] Updated weights for policy 1, policy_version 156986 (0.0010) [2023-12-26 00:50:29,371][123091] Updated weights for policy 0, policy_version 157668 (0.0007) [2023-12-26 00:50:29,437][123091] Updated weights for policy 0, policy_version 157678 (0.0008) [2023-12-26 00:50:29,495][123091] Updated weights for policy 0, policy_version 157688 (0.0006) [2023-12-26 00:50:29,762][123090] Updated weights for policy 1, policy_version 156996 (0.0008) [2023-12-26 00:50:29,831][123090] Updated weights for policy 1, policy_version 157006 (0.0006) [2023-12-26 00:50:29,896][123090] Updated weights for policy 1, policy_version 157016 (0.0008) [2023-12-26 00:50:30,288][123091] Updated weights for policy 0, policy_version 157698 (0.0006) [2023-12-26 00:50:30,331][123091] Updated weights for policy 0, policy_version 157708 (0.0010) [2023-12-26 00:50:30,382][123091] Updated weights for policy 0, policy_version 157718 (0.0010) [2023-12-26 00:50:30,439][123091] Updated weights for policy 0, policy_version 157728 (0.0010) [2023-12-26 00:50:30,691][123090] Updated weights for policy 1, policy_version 157026 (0.0009) [2023-12-26 00:50:30,753][123090] Updated weights for policy 1, policy_version 157036 (0.0009) [2023-12-26 00:50:30,815][123090] Updated weights for policy 1, policy_version 157046 (0.0010) [2023-12-26 00:50:30,860][123090] Updated weights for policy 1, policy_version 157056 (0.0010) [2023-12-26 00:50:31,279][123091] Updated weights for policy 0, policy_version 157738 (0.0011) [2023-12-26 00:50:31,342][123091] Updated weights for policy 0, policy_version 157748 (0.0010) [2023-12-26 00:50:31,404][123091] Updated weights for policy 0, policy_version 157758 (0.0010) [2023-12-26 00:50:31,663][123090] Updated weights for policy 1, policy_version 157066 (0.0010) [2023-12-26 00:50:31,734][123090] Updated weights for policy 1, policy_version 157076 (0.0013) [2023-12-26 00:50:31,799][123090] Updated weights for policy 1, policy_version 157086 (0.0011) [2023-12-26 00:50:32,228][123091] Updated weights for policy 0, policy_version 157768 (0.0010) [2023-12-26 00:50:32,285][123091] Updated weights for policy 0, policy_version 157778 (0.0010) [2023-12-26 00:50:32,348][123091] Updated weights for policy 0, policy_version 157788 (0.0011) [2023-12-26 00:50:32,627][123090] Updated weights for policy 1, policy_version 157096 (0.0009) [2023-12-26 00:50:32,675][123090] Updated weights for policy 1, policy_version 157106 (0.0008) [2023-12-26 00:50:32,731][123090] Updated weights for policy 1, policy_version 157116 (0.0008) [2023-12-26 00:50:33,195][123091] Updated weights for policy 0, policy_version 157798 (0.0011) [2023-12-26 00:50:33,253][123091] Updated weights for policy 0, policy_version 157808 (0.0010) [2023-12-26 00:50:33,304][123091] Updated weights for policy 0, policy_version 157818 (0.0010) [2023-12-26 00:50:33,566][123090] Updated weights for policy 1, policy_version 157126 (0.0007) [2023-12-26 00:50:33,619][123090] Updated weights for policy 1, policy_version 157136 (0.0009) [2023-12-26 00:50:33,674][123090] Updated weights for policy 1, policy_version 157146 (0.0009) [2023-12-26 00:50:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 80633856. Throughput: 0: 8876.6, 1: 8893.3. Samples: 80642204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:33,784][121949] Avg episode reward: [(0, '5745.573'), (1, '5312.884')] [2023-12-26 00:50:34,137][123091] Updated weights for policy 0, policy_version 157828 (0.0009) [2023-12-26 00:50:34,199][123091] Updated weights for policy 0, policy_version 157838 (0.0011) [2023-12-26 00:50:34,261][123091] Updated weights for policy 0, policy_version 157848 (0.0013) [2023-12-26 00:50:34,466][123090] Updated weights for policy 1, policy_version 157156 (0.0009) [2023-12-26 00:50:34,522][123090] Updated weights for policy 1, policy_version 157166 (0.0009) [2023-12-26 00:50:34,582][123090] Updated weights for policy 1, policy_version 157176 (0.0011) [2023-12-26 00:50:35,064][123091] Updated weights for policy 0, policy_version 157858 (0.0010) [2023-12-26 00:50:35,118][123091] Updated weights for policy 0, policy_version 157868 (0.0005) [2023-12-26 00:50:35,165][123091] Updated weights for policy 0, policy_version 157878 (0.0005) [2023-12-26 00:50:35,219][123091] Updated weights for policy 0, policy_version 157888 (0.0005) [2023-12-26 00:50:35,426][123090] Updated weights for policy 1, policy_version 157186 (0.0009) [2023-12-26 00:50:35,483][123090] Updated weights for policy 1, policy_version 157196 (0.0010) [2023-12-26 00:50:35,547][123090] Updated weights for policy 1, policy_version 157206 (0.0009) [2023-12-26 00:50:35,609][123090] Updated weights for policy 1, policy_version 157216 (0.0010) [2023-12-26 00:50:35,877][123091] Updated weights for policy 0, policy_version 157898 (0.0005) [2023-12-26 00:50:35,927][123091] Updated weights for policy 0, policy_version 157908 (0.0005) [2023-12-26 00:50:35,980][123091] Updated weights for policy 0, policy_version 157918 (0.0007) [2023-12-26 00:50:36,490][123090] Updated weights for policy 1, policy_version 157226 (0.0011) [2023-12-26 00:50:36,554][123090] Updated weights for policy 1, policy_version 157236 (0.0010) [2023-12-26 00:50:36,624][123090] Updated weights for policy 1, policy_version 157246 (0.0006) [2023-12-26 00:50:36,749][123091] Updated weights for policy 0, policy_version 157928 (0.0009) [2023-12-26 00:50:36,809][123091] Updated weights for policy 0, policy_version 157938 (0.0009) [2023-12-26 00:50:36,870][123091] Updated weights for policy 0, policy_version 157948 (0.0009) [2023-12-26 00:50:37,346][123090] Updated weights for policy 1, policy_version 157256 (0.0007) [2023-12-26 00:50:37,391][123090] Updated weights for policy 1, policy_version 157266 (0.0005) [2023-12-26 00:50:37,450][123090] Updated weights for policy 1, policy_version 157276 (0.0005) [2023-12-26 00:50:37,716][123091] Updated weights for policy 0, policy_version 157958 (0.0007) [2023-12-26 00:50:37,777][123091] Updated weights for policy 0, policy_version 157968 (0.0006) [2023-12-26 00:50:37,845][123091] Updated weights for policy 0, policy_version 157978 (0.0005) [2023-12-26 00:50:38,191][123090] Updated weights for policy 1, policy_version 157286 (0.0008) [2023-12-26 00:50:38,242][123090] Updated weights for policy 1, policy_version 157296 (0.0010) [2023-12-26 00:50:38,289][123090] Updated weights for policy 1, policy_version 157306 (0.0010) [2023-12-26 00:50:38,529][123091] Updated weights for policy 0, policy_version 157988 (0.0006) [2023-12-26 00:50:38,599][123091] Updated weights for policy 0, policy_version 157998 (0.0009) [2023-12-26 00:50:38,666][123091] Updated weights for policy 0, policy_version 158008 (0.0011) [2023-12-26 00:50:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 80723968. Throughput: 0: 8936.2, 1: 8891.4. Samples: 80695896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:38,785][121949] Avg episode reward: [(0, '5763.294'), (1, '5401.836')] [2023-12-26 00:50:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000158016_40452096.pth... [2023-12-26 00:50:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000157312_40271872.pth... [2023-12-26 00:50:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000156992_40189952.pth [2023-12-26 00:50:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000156256_40001536.pth [2023-12-26 00:50:39,050][123090] Updated weights for policy 1, policy_version 157316 (0.0007) [2023-12-26 00:50:39,106][123090] Updated weights for policy 1, policy_version 157326 (0.0005) [2023-12-26 00:50:39,156][123090] Updated weights for policy 1, policy_version 157336 (0.0005) [2023-12-26 00:50:39,440][123091] Updated weights for policy 0, policy_version 158018 (0.0010) [2023-12-26 00:50:39,502][123091] Updated weights for policy 0, policy_version 158028 (0.0011) [2023-12-26 00:50:39,557][123091] Updated weights for policy 0, policy_version 158038 (0.0011) [2023-12-26 00:50:39,610][123091] Updated weights for policy 0, policy_version 158048 (0.0011) [2023-12-26 00:50:39,924][123090] Updated weights for policy 1, policy_version 157346 (0.0006) [2023-12-26 00:50:39,997][123090] Updated weights for policy 1, policy_version 157356 (0.0007) [2023-12-26 00:50:40,068][123090] Updated weights for policy 1, policy_version 157366 (0.0009) [2023-12-26 00:50:40,137][123090] Updated weights for policy 1, policy_version 157376 (0.0007) [2023-12-26 00:50:40,458][123091] Updated weights for policy 0, policy_version 158058 (0.0011) [2023-12-26 00:50:40,525][123091] Updated weights for policy 0, policy_version 158068 (0.0011) [2023-12-26 00:50:40,596][123091] Updated weights for policy 0, policy_version 158078 (0.0011) [2023-12-26 00:50:40,960][123090] Updated weights for policy 1, policy_version 157386 (0.0009) [2023-12-26 00:50:41,020][123090] Updated weights for policy 1, policy_version 157396 (0.0008) [2023-12-26 00:50:41,089][123090] Updated weights for policy 1, policy_version 157406 (0.0009) [2023-12-26 00:50:41,412][123091] Updated weights for policy 0, policy_version 158088 (0.0010) [2023-12-26 00:50:41,477][123091] Updated weights for policy 0, policy_version 158098 (0.0009) [2023-12-26 00:50:41,533][123091] Updated weights for policy 0, policy_version 158108 (0.0010) [2023-12-26 00:50:41,935][123090] Updated weights for policy 1, policy_version 157416 (0.0008) [2023-12-26 00:50:42,000][123090] Updated weights for policy 1, policy_version 157426 (0.0008) [2023-12-26 00:50:42,069][123090] Updated weights for policy 1, policy_version 157436 (0.0009) [2023-12-26 00:50:42,359][123091] Updated weights for policy 0, policy_version 158118 (0.0009) [2023-12-26 00:50:42,422][123091] Updated weights for policy 0, policy_version 158128 (0.0009) [2023-12-26 00:50:42,470][123091] Updated weights for policy 0, policy_version 158138 (0.0008) [2023-12-26 00:50:42,875][123090] Updated weights for policy 1, policy_version 157446 (0.0008) [2023-12-26 00:50:42,926][123090] Updated weights for policy 1, policy_version 157456 (0.0009) [2023-12-26 00:50:42,984][123090] Updated weights for policy 1, policy_version 157466 (0.0010) [2023-12-26 00:50:43,231][123091] Updated weights for policy 0, policy_version 158148 (0.0007) [2023-12-26 00:50:43,282][123091] Updated weights for policy 0, policy_version 158158 (0.0005) [2023-12-26 00:50:43,341][123091] Updated weights for policy 0, policy_version 158168 (0.0005) [2023-12-26 00:50:43,744][123090] Updated weights for policy 1, policy_version 157476 (0.0010) [2023-12-26 00:50:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 80805888. Throughput: 0: 8866.8, 1: 8868.3. Samples: 80802392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:50:43,784][121949] Avg episode reward: [(0, '5829.973'), (1, '5528.485')] [2023-12-26 00:50:43,785][123007] Saving new best policy, reward=5829.973! [2023-12-26 00:50:43,795][123090] Updated weights for policy 1, policy_version 157486 (0.0009) [2023-12-26 00:50:43,844][123090] Updated weights for policy 1, policy_version 157496 (0.0009) [2023-12-26 00:50:44,037][123091] Updated weights for policy 0, policy_version 158178 (0.0006) [2023-12-26 00:50:44,093][123091] Updated weights for policy 0, policy_version 158188 (0.0010) [2023-12-26 00:50:44,154][123091] Updated weights for policy 0, policy_version 158198 (0.0009) [2023-12-26 00:50:44,203][123091] Updated weights for policy 0, policy_version 158208 (0.0009) [2023-12-26 00:50:44,750][123090] Updated weights for policy 1, policy_version 157506 (0.0009) [2023-12-26 00:50:44,818][123090] Updated weights for policy 1, policy_version 157516 (0.0009) [2023-12-26 00:50:44,890][123090] Updated weights for policy 1, policy_version 157526 (0.0008) [2023-12-26 00:50:44,909][123091] Updated weights for policy 0, policy_version 158218 (0.0005) [2023-12-26 00:50:44,961][123090] Updated weights for policy 1, policy_version 157536 (0.0009) [2023-12-26 00:50:44,961][123091] Updated weights for policy 0, policy_version 158228 (0.0006) [2023-12-26 00:50:45,017][123091] Updated weights for policy 0, policy_version 158238 (0.0006) [2023-12-26 00:50:45,777][123091] Updated weights for policy 0, policy_version 158248 (0.0008) [2023-12-26 00:50:45,828][123090] Updated weights for policy 1, policy_version 157546 (0.0011) [2023-12-26 00:50:45,831][123091] Updated weights for policy 0, policy_version 158258 (0.0008) [2023-12-26 00:50:45,879][123091] Updated weights for policy 0, policy_version 158268 (0.0005) [2023-12-26 00:50:45,885][123090] Updated weights for policy 1, policy_version 157556 (0.0010) [2023-12-26 00:50:45,949][123090] Updated weights for policy 1, policy_version 157566 (0.0010) [2023-12-26 00:50:46,600][123090] Updated weights for policy 1, policy_version 157576 (0.0007) [2023-12-26 00:50:46,656][123090] Updated weights for policy 1, policy_version 157586 (0.0006) [2023-12-26 00:50:46,716][123090] Updated weights for policy 1, policy_version 157596 (0.0007) [2023-12-26 00:50:46,784][123091] Updated weights for policy 0, policy_version 158278 (0.0009) [2023-12-26 00:50:46,842][123091] Updated weights for policy 0, policy_version 158288 (0.0010) [2023-12-26 00:50:46,895][123091] Updated weights for policy 0, policy_version 158299 (0.0010) [2023-12-26 00:50:47,375][123090] Updated weights for policy 1, policy_version 157606 (0.0006) [2023-12-26 00:50:47,423][123090] Updated weights for policy 1, policy_version 157616 (0.0005) [2023-12-26 00:50:47,486][123090] Updated weights for policy 1, policy_version 157626 (0.0007) [2023-12-26 00:50:47,690][123091] Updated weights for policy 0, policy_version 158309 (0.0009) [2023-12-26 00:50:47,755][123091] Updated weights for policy 0, policy_version 158319 (0.0010) [2023-12-26 00:50:47,813][123091] Updated weights for policy 0, policy_version 158329 (0.0010) [2023-12-26 00:50:48,273][123090] Updated weights for policy 1, policy_version 157636 (0.0009) [2023-12-26 00:50:48,337][123090] Updated weights for policy 1, policy_version 157646 (0.0006) [2023-12-26 00:50:48,400][123090] Updated weights for policy 1, policy_version 157656 (0.0008) [2023-12-26 00:50:48,635][123091] Updated weights for policy 0, policy_version 158339 (0.0010) [2023-12-26 00:50:48,700][123091] Updated weights for policy 0, policy_version 158349 (0.0007) [2023-12-26 00:50:48,763][123091] Updated weights for policy 0, policy_version 158359 (0.0005) [2023-12-26 00:50:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 80896000. Throughput: 0: 8848.3, 1: 8882.6. Samples: 80910948. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:50:48,785][121949] Avg episode reward: [(0, '5793.739'), (1, '5473.338')] [2023-12-26 00:50:49,214][123090] Updated weights for policy 1, policy_version 157666 (0.0006) [2023-12-26 00:50:49,282][123090] Updated weights for policy 1, policy_version 157676 (0.0010) [2023-12-26 00:50:49,354][123090] Updated weights for policy 1, policy_version 157686 (0.0010) [2023-12-26 00:50:49,422][123090] Updated weights for policy 1, policy_version 157696 (0.0010) [2023-12-26 00:50:49,528][123091] Updated weights for policy 0, policy_version 158369 (0.0008) [2023-12-26 00:50:49,589][123091] Updated weights for policy 0, policy_version 158379 (0.0009) [2023-12-26 00:50:49,642][123091] Updated weights for policy 0, policy_version 158389 (0.0009) [2023-12-26 00:50:49,705][123091] Updated weights for policy 0, policy_version 158399 (0.0009) [2023-12-26 00:50:50,278][123090] Updated weights for policy 1, policy_version 157706 (0.0010) [2023-12-26 00:50:50,342][123090] Updated weights for policy 1, policy_version 157716 (0.0009) [2023-12-26 00:50:50,405][123090] Updated weights for policy 1, policy_version 157726 (0.0009) [2023-12-26 00:50:50,542][123091] Updated weights for policy 0, policy_version 158409 (0.0010) [2023-12-26 00:50:50,611][123091] Updated weights for policy 0, policy_version 158419 (0.0010) [2023-12-26 00:50:50,684][123091] Updated weights for policy 0, policy_version 158429 (0.0010) [2023-12-26 00:50:51,264][123090] Updated weights for policy 1, policy_version 157736 (0.0009) [2023-12-26 00:50:51,334][123090] Updated weights for policy 1, policy_version 157746 (0.0010) [2023-12-26 00:50:51,414][123090] Updated weights for policy 1, policy_version 157756 (0.0009) [2023-12-26 00:50:51,515][123091] Updated weights for policy 0, policy_version 158439 (0.0010) [2023-12-26 00:50:51,573][123091] Updated weights for policy 0, policy_version 158449 (0.0009) [2023-12-26 00:50:51,628][123091] Updated weights for policy 0, policy_version 158459 (0.0009) [2023-12-26 00:50:52,309][123090] Updated weights for policy 1, policy_version 157766 (0.0009) [2023-12-26 00:50:52,319][123091] Updated weights for policy 0, policy_version 158469 (0.0008) [2023-12-26 00:50:52,374][123090] Updated weights for policy 1, policy_version 157776 (0.0009) [2023-12-26 00:50:52,389][123091] Updated weights for policy 0, policy_version 158479 (0.0008) [2023-12-26 00:50:52,435][123090] Updated weights for policy 1, policy_version 157786 (0.0007) [2023-12-26 00:50:52,455][123091] Updated weights for policy 0, policy_version 158489 (0.0009) [2023-12-26 00:50:53,231][123091] Updated weights for policy 0, policy_version 158499 (0.0008) [2023-12-26 00:50:53,283][123091] Updated weights for policy 0, policy_version 158509 (0.0005) [2023-12-26 00:50:53,313][123090] Updated weights for policy 1, policy_version 157796 (0.0009) [2023-12-26 00:50:53,349][123091] Updated weights for policy 0, policy_version 158519 (0.0005) [2023-12-26 00:50:53,362][123090] Updated weights for policy 1, policy_version 157806 (0.0009) [2023-12-26 00:50:53,415][123090] Updated weights for policy 1, policy_version 157816 (0.0007) [2023-12-26 00:50:53,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.8, 300 sec: 17605.8). Total num frames: 80986112. Throughput: 0: 8801.5, 1: 8862.5. Samples: 80960908. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:50:53,786][121949] Avg episode reward: [(0, '5804.677'), (1, '5387.098')] [2023-12-26 00:50:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000157824_40402944.pth... [2023-12-26 00:50:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000158528_40583168.pth... [2023-12-26 00:50:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000156800_40140800.pth [2023-12-26 00:50:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000157472_40312832.pth [2023-12-26 00:50:54,036][123091] Updated weights for policy 0, policy_version 158529 (0.0006) [2023-12-26 00:50:54,091][123091] Updated weights for policy 0, policy_version 158539 (0.0008) [2023-12-26 00:50:54,147][123091] Updated weights for policy 0, policy_version 158549 (0.0006) [2023-12-26 00:50:54,201][123091] Updated weights for policy 0, policy_version 158559 (0.0005) [2023-12-26 00:50:54,226][123090] Updated weights for policy 1, policy_version 157826 (0.0006) [2023-12-26 00:50:54,280][123090] Updated weights for policy 1, policy_version 157836 (0.0010) [2023-12-26 00:50:54,342][123090] Updated weights for policy 1, policy_version 157846 (0.0009) [2023-12-26 00:50:54,406][123090] Updated weights for policy 1, policy_version 157856 (0.0009) [2023-12-26 00:50:54,946][123091] Updated weights for policy 0, policy_version 158569 (0.0006) [2023-12-26 00:50:54,998][123091] Updated weights for policy 0, policy_version 158579 (0.0005) [2023-12-26 00:50:55,066][123091] Updated weights for policy 0, policy_version 158589 (0.0006) [2023-12-26 00:50:55,305][123090] Updated weights for policy 1, policy_version 157866 (0.0010) [2023-12-26 00:50:55,366][123090] Updated weights for policy 1, policy_version 157876 (0.0009) [2023-12-26 00:50:55,421][123090] Updated weights for policy 1, policy_version 157886 (0.0009) [2023-12-26 00:50:55,732][123091] Updated weights for policy 0, policy_version 158599 (0.0005) [2023-12-26 00:50:55,780][123091] Updated weights for policy 0, policy_version 158609 (0.0006) [2023-12-26 00:50:55,832][123091] Updated weights for policy 0, policy_version 158619 (0.0005) [2023-12-26 00:50:56,359][123090] Updated weights for policy 1, policy_version 157896 (0.0010) [2023-12-26 00:50:56,424][123090] Updated weights for policy 1, policy_version 157906 (0.0009) [2023-12-26 00:50:56,474][123090] Updated weights for policy 1, policy_version 157916 (0.0010) [2023-12-26 00:50:56,605][123091] Updated weights for policy 0, policy_version 158629 (0.0008) [2023-12-26 00:50:56,664][123091] Updated weights for policy 0, policy_version 158639 (0.0009) [2023-12-26 00:50:56,719][123091] Updated weights for policy 0, policy_version 158649 (0.0009) [2023-12-26 00:50:57,285][123090] Updated weights for policy 1, policy_version 157926 (0.0009) [2023-12-26 00:50:57,346][123090] Updated weights for policy 1, policy_version 157936 (0.0009) [2023-12-26 00:50:57,411][123090] Updated weights for policy 1, policy_version 157946 (0.0008) [2023-12-26 00:50:57,552][123091] Updated weights for policy 0, policy_version 158659 (0.0009) [2023-12-26 00:50:57,599][123091] Updated weights for policy 0, policy_version 158669 (0.0008) [2023-12-26 00:50:57,647][123091] Updated weights for policy 0, policy_version 158680 (0.0009) [2023-12-26 00:50:58,252][123090] Updated weights for policy 1, policy_version 157956 (0.0007) [2023-12-26 00:50:58,317][123090] Updated weights for policy 1, policy_version 157966 (0.0007) [2023-12-26 00:50:58,406][123090] Updated weights for policy 1, policy_version 157976 (0.0009) [2023-12-26 00:50:58,523][123091] Updated weights for policy 0, policy_version 158690 (0.0010) [2023-12-26 00:50:58,593][123091] Updated weights for policy 0, policy_version 158700 (0.0011) [2023-12-26 00:50:58,661][123091] Updated weights for policy 0, policy_version 158710 (0.0010) [2023-12-26 00:50:58,728][123091] Updated weights for policy 0, policy_version 158720 (0.0011) [2023-12-26 00:50:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 81076224. Throughput: 0: 8943.6, 1: 8811.5. Samples: 81067424. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:50:58,785][121949] Avg episode reward: [(0, '5854.817'), (1, '5484.300')] [2023-12-26 00:50:58,785][123007] Saving new best policy, reward=5854.817! [2023-12-26 00:50:59,244][123090] Updated weights for policy 1, policy_version 157986 (0.0008) [2023-12-26 00:50:59,306][123090] Updated weights for policy 1, policy_version 157996 (0.0007) [2023-12-26 00:50:59,371][123090] Updated weights for policy 1, policy_version 158006 (0.0008) [2023-12-26 00:50:59,437][123090] Updated weights for policy 1, policy_version 158016 (0.0009) [2023-12-26 00:50:59,533][123091] Updated weights for policy 0, policy_version 158730 (0.0005) [2023-12-26 00:50:59,593][123091] Updated weights for policy 0, policy_version 158740 (0.0005) [2023-12-26 00:50:59,652][123091] Updated weights for policy 0, policy_version 158750 (0.0005) [2023-12-26 00:51:00,290][123090] Updated weights for policy 1, policy_version 158026 (0.0010) [2023-12-26 00:51:00,342][123090] Updated weights for policy 1, policy_version 158036 (0.0009) [2023-12-26 00:51:00,353][123091] Updated weights for policy 0, policy_version 158760 (0.0008) [2023-12-26 00:51:00,399][123090] Updated weights for policy 1, policy_version 158046 (0.0009) [2023-12-26 00:51:00,403][123091] Updated weights for policy 0, policy_version 158770 (0.0008) [2023-12-26 00:51:00,453][123091] Updated weights for policy 0, policy_version 158780 (0.0010) [2023-12-26 00:51:01,100][123091] Updated weights for policy 0, policy_version 158790 (0.0010) [2023-12-26 00:51:01,169][123091] Updated weights for policy 0, policy_version 158800 (0.0010) [2023-12-26 00:51:01,230][123091] Updated weights for policy 0, policy_version 158810 (0.0009) [2023-12-26 00:51:01,310][123090] Updated weights for policy 1, policy_version 158056 (0.0008) [2023-12-26 00:51:01,379][123090] Updated weights for policy 1, policy_version 158066 (0.0010) [2023-12-26 00:51:01,446][123090] Updated weights for policy 1, policy_version 158076 (0.0009) [2023-12-26 00:51:02,066][123091] Updated weights for policy 0, policy_version 158820 (0.0010) [2023-12-26 00:51:02,125][123091] Updated weights for policy 0, policy_version 158830 (0.0010) [2023-12-26 00:51:02,176][123091] Updated weights for policy 0, policy_version 158840 (0.0010) [2023-12-26 00:51:02,270][123090] Updated weights for policy 1, policy_version 158086 (0.0009) [2023-12-26 00:51:02,321][123090] Updated weights for policy 1, policy_version 158096 (0.0009) [2023-12-26 00:51:02,383][123090] Updated weights for policy 1, policy_version 158106 (0.0010) [2023-12-26 00:51:03,019][123091] Updated weights for policy 0, policy_version 158850 (0.0010) [2023-12-26 00:51:03,074][123091] Updated weights for policy 0, policy_version 158860 (0.0009) [2023-12-26 00:51:03,115][123090] Updated weights for policy 1, policy_version 158116 (0.0006) [2023-12-26 00:51:03,136][123091] Updated weights for policy 0, policy_version 158870 (0.0010) [2023-12-26 00:51:03,167][123090] Updated weights for policy 1, policy_version 158126 (0.0006) [2023-12-26 00:51:03,202][123091] Updated weights for policy 0, policy_version 158880 (0.0010) [2023-12-26 00:51:03,222][123090] Updated weights for policy 1, policy_version 158136 (0.0005) [2023-12-26 00:51:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 81158144. Throughput: 0: 9009.8, 1: 8701.1. Samples: 81172416. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:03,785][121949] Avg episode reward: [(0, '5842.943'), (1, '5453.183')] [2023-12-26 00:51:04,008][123090] Updated weights for policy 1, policy_version 158146 (0.0006) [2023-12-26 00:51:04,011][123091] Updated weights for policy 0, policy_version 158890 (0.0008) [2023-12-26 00:51:04,070][123090] Updated weights for policy 1, policy_version 158156 (0.0007) [2023-12-26 00:51:04,073][123091] Updated weights for policy 0, policy_version 158900 (0.0008) [2023-12-26 00:51:04,132][123090] Updated weights for policy 1, policy_version 158166 (0.0008) [2023-12-26 00:51:04,133][123091] Updated weights for policy 0, policy_version 158910 (0.0008) [2023-12-26 00:51:04,195][123090] Updated weights for policy 1, policy_version 158176 (0.0008) [2023-12-26 00:51:04,872][123091] Updated weights for policy 0, policy_version 158920 (0.0006) [2023-12-26 00:51:04,937][123091] Updated weights for policy 0, policy_version 158930 (0.0005) [2023-12-26 00:51:04,959][123090] Updated weights for policy 1, policy_version 158186 (0.0006) [2023-12-26 00:51:05,008][123091] Updated weights for policy 0, policy_version 158940 (0.0009) [2023-12-26 00:51:05,025][123090] Updated weights for policy 1, policy_version 158196 (0.0006) [2023-12-26 00:51:05,089][123090] Updated weights for policy 1, policy_version 158206 (0.0005) [2023-12-26 00:51:05,693][123090] Updated weights for policy 1, policy_version 158216 (0.0008) [2023-12-26 00:51:05,752][123091] Updated weights for policy 0, policy_version 158950 (0.0008) [2023-12-26 00:51:05,752][123090] Updated weights for policy 1, policy_version 158226 (0.0009) [2023-12-26 00:51:05,816][123090] Updated weights for policy 1, policy_version 158236 (0.0009) [2023-12-26 00:51:05,822][123091] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-12-26 00:51:05,882][123091] Updated weights for policy 0, policy_version 158970 (0.0005) [2023-12-26 00:51:06,615][123091] Updated weights for policy 0, policy_version 158980 (0.0007) [2023-12-26 00:51:06,641][123090] Updated weights for policy 1, policy_version 158246 (0.0006) [2023-12-26 00:51:06,682][123091] Updated weights for policy 0, policy_version 158990 (0.0010) [2023-12-26 00:51:06,703][123090] Updated weights for policy 1, policy_version 158256 (0.0007) [2023-12-26 00:51:06,743][123091] Updated weights for policy 0, policy_version 159000 (0.0006) [2023-12-26 00:51:06,764][123090] Updated weights for policy 1, policy_version 158266 (0.0008) [2023-12-26 00:51:07,407][123091] Updated weights for policy 0, policy_version 159010 (0.0005) [2023-12-26 00:51:07,462][123091] Updated weights for policy 0, policy_version 159020 (0.0009) [2023-12-26 00:51:07,528][123091] Updated weights for policy 0, policy_version 159030 (0.0009) [2023-12-26 00:51:07,601][123091] Updated weights for policy 0, policy_version 159040 (0.0010) [2023-12-26 00:51:07,636][123090] Updated weights for policy 1, policy_version 158276 (0.0009) [2023-12-26 00:51:07,699][123090] Updated weights for policy 1, policy_version 158286 (0.0010) [2023-12-26 00:51:07,752][123090] Updated weights for policy 1, policy_version 158296 (0.0009) [2023-12-26 00:51:08,416][123091] Updated weights for policy 0, policy_version 159050 (0.0009) [2023-12-26 00:51:08,486][123091] Updated weights for policy 0, policy_version 159060 (0.0010) [2023-12-26 00:51:08,549][123091] Updated weights for policy 0, policy_version 159070 (0.0010) [2023-12-26 00:51:08,599][123090] Updated weights for policy 1, policy_version 158306 (0.0010) [2023-12-26 00:51:08,666][123090] Updated weights for policy 1, policy_version 158316 (0.0009) [2023-12-26 00:51:08,723][123090] Updated weights for policy 1, policy_version 158326 (0.0009) [2023-12-26 00:51:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 81248256. Throughput: 0: 9053.6, 1: 8700.6. Samples: 81227828. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:08,785][121949] Avg episode reward: [(0, '5784.381'), (1, '5280.877')] [2023-12-26 00:51:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000159072_40722432.pth... [2023-12-26 00:51:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000158336_40534016.pth... [2023-12-26 00:51:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000158016_40452096.pth [2023-12-26 00:51:08,795][123090] Updated weights for policy 1, policy_version 158336 (0.0007) [2023-12-26 00:51:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000157312_40271872.pth [2023-12-26 00:51:09,352][123091] Updated weights for policy 0, policy_version 159080 (0.0009) [2023-12-26 00:51:09,422][123091] Updated weights for policy 0, policy_version 159090 (0.0010) [2023-12-26 00:51:09,478][123091] Updated weights for policy 0, policy_version 159100 (0.0009) [2023-12-26 00:51:09,675][123090] Updated weights for policy 1, policy_version 158346 (0.0009) [2023-12-26 00:51:09,746][123090] Updated weights for policy 1, policy_version 158356 (0.0009) [2023-12-26 00:51:09,808][123090] Updated weights for policy 1, policy_version 158366 (0.0010) [2023-12-26 00:51:10,318][123091] Updated weights for policy 0, policy_version 159110 (0.0010) [2023-12-26 00:51:10,385][123091] Updated weights for policy 0, policy_version 159121 (0.0009) [2023-12-26 00:51:10,443][123091] Updated weights for policy 0, policy_version 159131 (0.0010) [2023-12-26 00:51:10,619][123090] Updated weights for policy 1, policy_version 158376 (0.0009) [2023-12-26 00:51:10,670][123090] Updated weights for policy 1, policy_version 158386 (0.0009) [2023-12-26 00:51:10,720][123090] Updated weights for policy 1, policy_version 158396 (0.0009) [2023-12-26 00:51:11,277][123091] Updated weights for policy 0, policy_version 159141 (0.0008) [2023-12-26 00:51:11,336][123091] Updated weights for policy 0, policy_version 159151 (0.0006) [2023-12-26 00:51:11,404][123091] Updated weights for policy 0, policy_version 159161 (0.0009) [2023-12-26 00:51:11,595][123090] Updated weights for policy 1, policy_version 158406 (0.0009) [2023-12-26 00:51:11,666][123090] Updated weights for policy 1, policy_version 158416 (0.0007) [2023-12-26 00:51:11,745][123090] Updated weights for policy 1, policy_version 158426 (0.0009) [2023-12-26 00:51:12,129][123091] Updated weights for policy 0, policy_version 159171 (0.0009) [2023-12-26 00:51:12,194][123091] Updated weights for policy 0, policy_version 159181 (0.0006) [2023-12-26 00:51:12,269][123091] Updated weights for policy 0, policy_version 159191 (0.0006) [2023-12-26 00:51:12,533][123090] Updated weights for policy 1, policy_version 158436 (0.0007) [2023-12-26 00:51:12,586][123090] Updated weights for policy 1, policy_version 158446 (0.0005) [2023-12-26 00:51:12,645][123090] Updated weights for policy 1, policy_version 158456 (0.0006) [2023-12-26 00:51:12,955][123091] Updated weights for policy 0, policy_version 159201 (0.0010) [2023-12-26 00:51:13,023][123091] Updated weights for policy 0, policy_version 159211 (0.0007) [2023-12-26 00:51:13,094][123091] Updated weights for policy 0, policy_version 159221 (0.0007) [2023-12-26 00:51:13,152][123091] Updated weights for policy 0, policy_version 159231 (0.0005) [2023-12-26 00:51:13,399][123090] Updated weights for policy 1, policy_version 158466 (0.0006) [2023-12-26 00:51:13,452][123090] Updated weights for policy 1, policy_version 158476 (0.0010) [2023-12-26 00:51:13,515][123090] Updated weights for policy 1, policy_version 158486 (0.0009) [2023-12-26 00:51:13,577][123090] Updated weights for policy 1, policy_version 158496 (0.0010) [2023-12-26 00:51:13,767][123091] Updated weights for policy 0, policy_version 159241 (0.0005) [2023-12-26 00:51:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 81338368. Throughput: 0: 9042.8, 1: 8634.1. Samples: 81331296. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:13,785][121949] Avg episode reward: [(0, '5719.706'), (1, '5135.651')] [2023-12-26 00:51:13,818][123091] Updated weights for policy 0, policy_version 159251 (0.0006) [2023-12-26 00:51:13,869][123091] Updated weights for policy 0, policy_version 159261 (0.0007) [2023-12-26 00:51:14,514][123090] Updated weights for policy 1, policy_version 158506 (0.0009) [2023-12-26 00:51:14,514][123091] Updated weights for policy 0, policy_version 159271 (0.0006) [2023-12-26 00:51:14,570][123091] Updated weights for policy 0, policy_version 159281 (0.0007) [2023-12-26 00:51:14,580][123090] Updated weights for policy 1, policy_version 158516 (0.0009) [2023-12-26 00:51:14,622][123091] Updated weights for policy 0, policy_version 159291 (0.0008) [2023-12-26 00:51:14,643][123090] Updated weights for policy 1, policy_version 158526 (0.0008) [2023-12-26 00:51:15,335][123091] Updated weights for policy 0, policy_version 159301 (0.0008) [2023-12-26 00:51:15,404][123091] Updated weights for policy 0, policy_version 159311 (0.0008) [2023-12-26 00:51:15,463][123090] Updated weights for policy 1, policy_version 158536 (0.0011) [2023-12-26 00:51:15,470][123091] Updated weights for policy 0, policy_version 159321 (0.0008) [2023-12-26 00:51:15,522][123090] Updated weights for policy 1, policy_version 158546 (0.0008) [2023-12-26 00:51:15,590][123090] Updated weights for policy 1, policy_version 158556 (0.0011) [2023-12-26 00:51:16,109][123091] Updated weights for policy 0, policy_version 159331 (0.0006) [2023-12-26 00:51:16,164][123091] Updated weights for policy 0, policy_version 159341 (0.0010) [2023-12-26 00:51:16,215][123091] Updated weights for policy 0, policy_version 159351 (0.0010) [2023-12-26 00:51:16,335][123090] Updated weights for policy 1, policy_version 158566 (0.0010) [2023-12-26 00:51:16,397][123090] Updated weights for policy 1, policy_version 158576 (0.0010) [2023-12-26 00:51:16,448][123090] Updated weights for policy 1, policy_version 158586 (0.0010) [2023-12-26 00:51:17,029][123091] Updated weights for policy 0, policy_version 159361 (0.0010) [2023-12-26 00:51:17,085][123091] Updated weights for policy 0, policy_version 159371 (0.0011) [2023-12-26 00:51:17,135][123091] Updated weights for policy 0, policy_version 159381 (0.0007) [2023-12-26 00:51:17,191][123090] Updated weights for policy 1, policy_version 158596 (0.0008) [2023-12-26 00:51:17,195][123091] Updated weights for policy 0, policy_version 159391 (0.0009) [2023-12-26 00:51:17,255][123090] Updated weights for policy 1, policy_version 158606 (0.0007) [2023-12-26 00:51:17,320][123090] Updated weights for policy 1, policy_version 158616 (0.0006) [2023-12-26 00:51:17,863][123090] Updated weights for policy 1, policy_version 158626 (0.0006) [2023-12-26 00:51:17,926][123090] Updated weights for policy 1, policy_version 158636 (0.0009) [2023-12-26 00:51:17,986][123090] Updated weights for policy 1, policy_version 158646 (0.0008) [2023-12-26 00:51:18,017][123091] Updated weights for policy 0, policy_version 159401 (0.0009) [2023-12-26 00:51:18,052][123090] Updated weights for policy 1, policy_version 158656 (0.0008) [2023-12-26 00:51:18,086][123091] Updated weights for policy 0, policy_version 159411 (0.0010) [2023-12-26 00:51:18,147][123091] Updated weights for policy 0, policy_version 159421 (0.0011) [2023-12-26 00:51:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 81428480. Throughput: 0: 9136.4, 1: 8667.7. Samples: 81443392. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:18,784][121949] Avg episode reward: [(0, '5765.093'), (1, '5024.664')] [2023-12-26 00:51:18,909][123091] Updated weights for policy 0, policy_version 159431 (0.0010) [2023-12-26 00:51:18,912][123090] Updated weights for policy 1, policy_version 158666 (0.0010) [2023-12-26 00:51:18,966][123091] Updated weights for policy 0, policy_version 159441 (0.0010) [2023-12-26 00:51:18,971][123090] Updated weights for policy 1, policy_version 158676 (0.0007) [2023-12-26 00:51:19,016][123091] Updated weights for policy 0, policy_version 159451 (0.0009) [2023-12-26 00:51:19,036][123090] Updated weights for policy 1, policy_version 158686 (0.0008) [2023-12-26 00:51:19,782][123090] Updated weights for policy 1, policy_version 158696 (0.0009) [2023-12-26 00:51:19,852][123090] Updated weights for policy 1, policy_version 158706 (0.0008) [2023-12-26 00:51:19,903][123091] Updated weights for policy 0, policy_version 159461 (0.0008) [2023-12-26 00:51:19,921][123090] Updated weights for policy 1, policy_version 158716 (0.0011) [2023-12-26 00:51:19,966][123091] Updated weights for policy 0, policy_version 159471 (0.0009) [2023-12-26 00:51:20,028][123091] Updated weights for policy 0, policy_version 159481 (0.0009) [2023-12-26 00:51:20,763][123090] Updated weights for policy 1, policy_version 158726 (0.0009) [2023-12-26 00:51:20,823][123090] Updated weights for policy 1, policy_version 158736 (0.0011) [2023-12-26 00:51:20,872][123091] Updated weights for policy 0, policy_version 159491 (0.0009) [2023-12-26 00:51:20,887][123090] Updated weights for policy 1, policy_version 158746 (0.0011) [2023-12-26 00:51:20,937][123091] Updated weights for policy 0, policy_version 159501 (0.0007) [2023-12-26 00:51:21,005][123091] Updated weights for policy 0, policy_version 159511 (0.0009) [2023-12-26 00:51:21,663][123090] Updated weights for policy 1, policy_version 158756 (0.0009) [2023-12-26 00:51:21,735][123090] Updated weights for policy 1, policy_version 158766 (0.0008) [2023-12-26 00:51:21,805][123090] Updated weights for policy 1, policy_version 158776 (0.0010) [2023-12-26 00:51:21,882][123091] Updated weights for policy 0, policy_version 159521 (0.0009) [2023-12-26 00:51:21,931][123091] Updated weights for policy 0, policy_version 159531 (0.0009) [2023-12-26 00:51:21,979][123091] Updated weights for policy 0, policy_version 159541 (0.0008) [2023-12-26 00:51:22,035][123091] Updated weights for policy 0, policy_version 159551 (0.0008) [2023-12-26 00:51:22,630][123090] Updated weights for policy 1, policy_version 158786 (0.0009) [2023-12-26 00:51:22,699][123090] Updated weights for policy 1, policy_version 158796 (0.0008) [2023-12-26 00:51:22,758][123090] Updated weights for policy 1, policy_version 158806 (0.0007) [2023-12-26 00:51:22,828][123090] Updated weights for policy 1, policy_version 158816 (0.0005) [2023-12-26 00:51:22,968][123091] Updated weights for policy 0, policy_version 159561 (0.0007) [2023-12-26 00:51:23,043][123091] Updated weights for policy 0, policy_version 159571 (0.0005) [2023-12-26 00:51:23,117][123091] Updated weights for policy 0, policy_version 159581 (0.0006) [2023-12-26 00:51:23,604][123090] Updated weights for policy 1, policy_version 158826 (0.0011) [2023-12-26 00:51:23,659][123090] Updated weights for policy 1, policy_version 158836 (0.0010) [2023-12-26 00:51:23,714][123090] Updated weights for policy 1, policy_version 158846 (0.0010) [2023-12-26 00:51:23,762][123091] Updated weights for policy 0, policy_version 159591 (0.0006) [2023-12-26 00:51:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 81518592. Throughput: 0: 9056.0, 1: 8674.2. Samples: 81493756. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:23,785][121949] Avg episode reward: [(0, '5879.388'), (1, '5095.600')] [2023-12-26 00:51:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000158848_40665088.pth... [2023-12-26 00:51:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000157824_40402944.pth [2023-12-26 00:51:23,830][123091] Updated weights for policy 0, policy_version 159601 (0.0006) [2023-12-26 00:51:23,901][123091] Updated weights for policy 0, policy_version 159611 (0.0005) [2023-12-26 00:51:23,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000159616_40861696.pth... [2023-12-26 00:51:23,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000158528_40583168.pth [2023-12-26 00:51:23,939][123007] Saving new best policy, reward=5879.388! [2023-12-26 00:51:24,516][123090] Updated weights for policy 1, policy_version 158856 (0.0009) [2023-12-26 00:51:24,574][123090] Updated weights for policy 1, policy_version 158866 (0.0010) [2023-12-26 00:51:24,637][123090] Updated weights for policy 1, policy_version 158876 (0.0010) [2023-12-26 00:51:24,673][123091] Updated weights for policy 0, policy_version 159621 (0.0006) [2023-12-26 00:51:24,726][123091] Updated weights for policy 0, policy_version 159631 (0.0006) [2023-12-26 00:51:24,777][123091] Updated weights for policy 0, policy_version 159641 (0.0005) [2023-12-26 00:51:25,439][123090] Updated weights for policy 1, policy_version 158886 (0.0010) [2023-12-26 00:51:25,459][123091] Updated weights for policy 0, policy_version 159651 (0.0009) [2023-12-26 00:51:25,494][123090] Updated weights for policy 1, policy_version 158896 (0.0010) [2023-12-26 00:51:25,519][123091] Updated weights for policy 0, policy_version 159661 (0.0006) [2023-12-26 00:51:25,548][123090] Updated weights for policy 1, policy_version 158906 (0.0008) [2023-12-26 00:51:25,567][123091] Updated weights for policy 0, policy_version 159671 (0.0010) [2023-12-26 00:51:26,294][123091] Updated weights for policy 0, policy_version 159682 (0.0006) [2023-12-26 00:51:26,303][123090] Updated weights for policy 1, policy_version 158916 (0.0007) [2023-12-26 00:51:26,348][123091] Updated weights for policy 0, policy_version 159692 (0.0005) [2023-12-26 00:51:26,352][123090] Updated weights for policy 1, policy_version 158926 (0.0008) [2023-12-26 00:51:26,407][123091] Updated weights for policy 0, policy_version 159702 (0.0005) [2023-12-26 00:51:26,414][123090] Updated weights for policy 1, policy_version 158936 (0.0009) [2023-12-26 00:51:26,455][123091] Updated weights for policy 0, policy_version 159712 (0.0005) [2023-12-26 00:51:27,135][123091] Updated weights for policy 0, policy_version 159722 (0.0005) [2023-12-26 00:51:27,187][123091] Updated weights for policy 0, policy_version 159732 (0.0005) [2023-12-26 00:51:27,236][123091] Updated weights for policy 0, policy_version 159742 (0.0008) [2023-12-26 00:51:27,331][123090] Updated weights for policy 1, policy_version 158946 (0.0008) [2023-12-26 00:51:27,386][123090] Updated weights for policy 1, policy_version 158956 (0.0008) [2023-12-26 00:51:27,454][123090] Updated weights for policy 1, policy_version 158966 (0.0009) [2023-12-26 00:51:27,506][123090] Updated weights for policy 1, policy_version 158976 (0.0010) [2023-12-26 00:51:28,034][123091] Updated weights for policy 0, policy_version 159752 (0.0009) [2023-12-26 00:51:28,102][123091] Updated weights for policy 0, policy_version 159762 (0.0010) [2023-12-26 00:51:28,160][123091] Updated weights for policy 0, policy_version 159772 (0.0010) [2023-12-26 00:51:28,219][123090] Updated weights for policy 1, policy_version 158986 (0.0005) [2023-12-26 00:51:28,275][123090] Updated weights for policy 1, policy_version 158996 (0.0006) [2023-12-26 00:51:28,343][123090] Updated weights for policy 1, policy_version 159006 (0.0006) [2023-12-26 00:51:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 81608704. Throughput: 0: 9161.8, 1: 8629.0. Samples: 81602980. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:28,785][121949] Avg episode reward: [(0, '5863.461'), (1, '5292.395')] [2023-12-26 00:51:29,049][123091] Updated weights for policy 0, policy_version 159782 (0.0008) [2023-12-26 00:51:29,055][123090] Updated weights for policy 1, policy_version 159016 (0.0008) [2023-12-26 00:51:29,110][123091] Updated weights for policy 0, policy_version 159792 (0.0009) [2023-12-26 00:51:29,121][123090] Updated weights for policy 1, policy_version 159026 (0.0008) [2023-12-26 00:51:29,171][123091] Updated weights for policy 0, policy_version 159802 (0.0009) [2023-12-26 00:51:29,188][123090] Updated weights for policy 1, policy_version 159036 (0.0007) [2023-12-26 00:51:29,934][123090] Updated weights for policy 1, policy_version 159046 (0.0008) [2023-12-26 00:51:29,995][123090] Updated weights for policy 1, policy_version 159056 (0.0009) [2023-12-26 00:51:30,052][123090] Updated weights for policy 1, policy_version 159066 (0.0009) [2023-12-26 00:51:30,094][123091] Updated weights for policy 0, policy_version 159812 (0.0009) [2023-12-26 00:51:30,146][123091] Updated weights for policy 0, policy_version 159822 (0.0009) [2023-12-26 00:51:30,206][123091] Updated weights for policy 0, policy_version 159833 (0.0010) [2023-12-26 00:51:30,879][123090] Updated weights for policy 1, policy_version 159076 (0.0010) [2023-12-26 00:51:30,931][123090] Updated weights for policy 1, policy_version 159086 (0.0009) [2023-12-26 00:51:30,978][123090] Updated weights for policy 1, policy_version 159096 (0.0008) [2023-12-26 00:51:31,041][123091] Updated weights for policy 0, policy_version 159843 (0.0008) [2023-12-26 00:51:31,098][123091] Updated weights for policy 0, policy_version 159853 (0.0009) [2023-12-26 00:51:31,166][123091] Updated weights for policy 0, policy_version 159863 (0.0009) [2023-12-26 00:51:31,745][123090] Updated weights for policy 1, policy_version 159106 (0.0009) [2023-12-26 00:51:31,815][123090] Updated weights for policy 1, policy_version 159116 (0.0010) [2023-12-26 00:51:31,883][123090] Updated weights for policy 1, policy_version 159126 (0.0009) [2023-12-26 00:51:31,949][123090] Updated weights for policy 1, policy_version 159136 (0.0009) [2023-12-26 00:51:32,034][123091] Updated weights for policy 0, policy_version 159873 (0.0010) [2023-12-26 00:51:32,086][123091] Updated weights for policy 0, policy_version 159883 (0.0009) [2023-12-26 00:51:32,147][123091] Updated weights for policy 0, policy_version 159893 (0.0009) [2023-12-26 00:51:32,199][123091] Updated weights for policy 0, policy_version 159903 (0.0009) [2023-12-26 00:51:32,786][123090] Updated weights for policy 1, policy_version 159146 (0.0009) [2023-12-26 00:51:32,835][123090] Updated weights for policy 1, policy_version 159156 (0.0009) [2023-12-26 00:51:32,888][123090] Updated weights for policy 1, policy_version 159166 (0.0009) [2023-12-26 00:51:33,039][123091] Updated weights for policy 0, policy_version 159913 (0.0010) [2023-12-26 00:51:33,105][123091] Updated weights for policy 0, policy_version 159923 (0.0009) [2023-12-26 00:51:33,155][123091] Updated weights for policy 0, policy_version 159934 (0.0010) [2023-12-26 00:51:33,749][123090] Updated weights for policy 1, policy_version 159176 (0.0009) [2023-12-26 00:51:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 81690624. Throughput: 0: 9031.9, 1: 8668.5. Samples: 81707468. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:33,785][121949] Avg episode reward: [(0, '5860.792'), (1, '5444.431')] [2023-12-26 00:51:33,820][123090] Updated weights for policy 1, policy_version 159186 (0.0007) [2023-12-26 00:51:33,896][123090] Updated weights for policy 1, policy_version 159196 (0.0005) [2023-12-26 00:51:33,999][123091] Updated weights for policy 0, policy_version 159944 (0.0007) [2023-12-26 00:51:34,065][123091] Updated weights for policy 0, policy_version 159954 (0.0005) [2023-12-26 00:51:34,132][123091] Updated weights for policy 0, policy_version 159964 (0.0008) [2023-12-26 00:51:34,534][123090] Updated weights for policy 1, policy_version 159206 (0.0008) [2023-12-26 00:51:34,598][123090] Updated weights for policy 1, policy_version 159216 (0.0009) [2023-12-26 00:51:34,664][123090] Updated weights for policy 1, policy_version 159226 (0.0008) [2023-12-26 00:51:34,937][123091] Updated weights for policy 0, policy_version 159974 (0.0009) [2023-12-26 00:51:35,006][123091] Updated weights for policy 0, policy_version 159984 (0.0005) [2023-12-26 00:51:35,067][123091] Updated weights for policy 0, policy_version 159994 (0.0005) [2023-12-26 00:51:35,386][123090] Updated weights for policy 1, policy_version 159236 (0.0005) [2023-12-26 00:51:35,437][123090] Updated weights for policy 1, policy_version 159246 (0.0005) [2023-12-26 00:51:35,486][123090] Updated weights for policy 1, policy_version 159256 (0.0006) [2023-12-26 00:51:35,745][123091] Updated weights for policy 0, policy_version 160004 (0.0005) [2023-12-26 00:51:35,797][123091] Updated weights for policy 0, policy_version 160014 (0.0006) [2023-12-26 00:51:35,862][123091] Updated weights for policy 0, policy_version 160024 (0.0008) [2023-12-26 00:51:36,264][123090] Updated weights for policy 1, policy_version 159266 (0.0007) [2023-12-26 00:51:36,339][123090] Updated weights for policy 1, policy_version 159276 (0.0006) [2023-12-26 00:51:36,411][123090] Updated weights for policy 1, policy_version 159286 (0.0007) [2023-12-26 00:51:36,476][123090] Updated weights for policy 1, policy_version 159296 (0.0008) [2023-12-26 00:51:36,642][123091] Updated weights for policy 0, policy_version 160034 (0.0009) [2023-12-26 00:51:36,710][123091] Updated weights for policy 0, policy_version 160044 (0.0011) [2023-12-26 00:51:36,782][123091] Updated weights for policy 0, policy_version 160054 (0.0011) [2023-12-26 00:51:36,850][123091] Updated weights for policy 0, policy_version 160064 (0.0010) [2023-12-26 00:51:37,271][123090] Updated weights for policy 1, policy_version 159306 (0.0009) [2023-12-26 00:51:37,336][123090] Updated weights for policy 1, policy_version 159316 (0.0009) [2023-12-26 00:51:37,398][123090] Updated weights for policy 1, policy_version 159326 (0.0009) [2023-12-26 00:51:37,608][123091] Updated weights for policy 0, policy_version 160074 (0.0009) [2023-12-26 00:51:37,667][123091] Updated weights for policy 0, policy_version 160084 (0.0010) [2023-12-26 00:51:37,725][123091] Updated weights for policy 0, policy_version 160094 (0.0010) [2023-12-26 00:51:38,119][123090] Updated weights for policy 1, policy_version 159336 (0.0009) [2023-12-26 00:51:38,178][123090] Updated weights for policy 1, policy_version 159346 (0.0010) [2023-12-26 00:51:38,235][123090] Updated weights for policy 1, policy_version 159356 (0.0010) [2023-12-26 00:51:38,532][123091] Updated weights for policy 0, policy_version 160104 (0.0006) [2023-12-26 00:51:38,593][123091] Updated weights for policy 0, policy_version 160114 (0.0007) [2023-12-26 00:51:38,654][123091] Updated weights for policy 0, policy_version 160124 (0.0010) [2023-12-26 00:51:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 81788928. Throughput: 0: 9068.1, 1: 8753.9. Samples: 81762892. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:38,785][121949] Avg episode reward: [(0, '5803.062'), (1, '5228.764')] [2023-12-26 00:51:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000160128_40992768.pth... [2023-12-26 00:51:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000159360_40796160.pth... [2023-12-26 00:51:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000159072_40722432.pth [2023-12-26 00:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000158336_40534016.pth [2023-12-26 00:51:39,036][123090] Updated weights for policy 1, policy_version 159366 (0.0010) [2023-12-26 00:51:39,098][123090] Updated weights for policy 1, policy_version 159376 (0.0010) [2023-12-26 00:51:39,175][123090] Updated weights for policy 1, policy_version 159386 (0.0010) [2023-12-26 00:51:39,446][123091] Updated weights for policy 0, policy_version 160134 (0.0009) [2023-12-26 00:51:39,495][123091] Updated weights for policy 0, policy_version 160144 (0.0009) [2023-12-26 00:51:39,545][123091] Updated weights for policy 0, policy_version 160154 (0.0009) [2023-12-26 00:51:39,978][123090] Updated weights for policy 1, policy_version 159396 (0.0010) [2023-12-26 00:51:40,037][123090] Updated weights for policy 1, policy_version 159406 (0.0010) [2023-12-26 00:51:40,105][123090] Updated weights for policy 1, policy_version 159417 (0.0010) [2023-12-26 00:51:40,429][123091] Updated weights for policy 0, policy_version 160164 (0.0009) [2023-12-26 00:51:40,491][123091] Updated weights for policy 0, policy_version 160174 (0.0009) [2023-12-26 00:51:40,550][123091] Updated weights for policy 0, policy_version 160184 (0.0009) [2023-12-26 00:51:40,937][123090] Updated weights for policy 1, policy_version 159427 (0.0008) [2023-12-26 00:51:40,986][123090] Updated weights for policy 1, policy_version 159437 (0.0005) [2023-12-26 00:51:41,051][123090] Updated weights for policy 1, policy_version 159447 (0.0009) [2023-12-26 00:51:41,408][123091] Updated weights for policy 0, policy_version 160194 (0.0010) [2023-12-26 00:51:41,457][123091] Updated weights for policy 0, policy_version 160204 (0.0009) [2023-12-26 00:51:41,522][123091] Updated weights for policy 0, policy_version 160214 (0.0006) [2023-12-26 00:51:41,589][123091] Updated weights for policy 0, policy_version 160224 (0.0006) [2023-12-26 00:51:41,933][123090] Updated weights for policy 1, policy_version 159457 (0.0009) [2023-12-26 00:51:42,002][123090] Updated weights for policy 1, policy_version 159467 (0.0009) [2023-12-26 00:51:42,061][123090] Updated weights for policy 1, policy_version 159477 (0.0009) [2023-12-26 00:51:42,136][123090] Updated weights for policy 1, policy_version 159487 (0.0010) [2023-12-26 00:51:42,379][123091] Updated weights for policy 0, policy_version 160234 (0.0009) [2023-12-26 00:51:42,435][123091] Updated weights for policy 0, policy_version 160244 (0.0006) [2023-12-26 00:51:42,501][123091] Updated weights for policy 0, policy_version 160254 (0.0009) [2023-12-26 00:51:42,993][123090] Updated weights for policy 1, policy_version 159497 (0.0006) [2023-12-26 00:51:43,065][123090] Updated weights for policy 1, policy_version 159507 (0.0006) [2023-12-26 00:51:43,126][123090] Updated weights for policy 1, policy_version 159517 (0.0010) [2023-12-26 00:51:43,280][123091] Updated weights for policy 0, policy_version 160264 (0.0006) [2023-12-26 00:51:43,350][123091] Updated weights for policy 0, policy_version 160274 (0.0006) [2023-12-26 00:51:43,407][123091] Updated weights for policy 0, policy_version 160284 (0.0005) [2023-12-26 00:51:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 81870848. Throughput: 0: 8957.1, 1: 8783.9. Samples: 81865768. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:43,784][121949] Avg episode reward: [(0, '5794.495'), (1, '5070.245')] [2023-12-26 00:51:43,831][123090] Updated weights for policy 1, policy_version 159528 (0.0009) [2023-12-26 00:51:43,888][123090] Updated weights for policy 1, policy_version 159538 (0.0009) [2023-12-26 00:51:43,951][123090] Updated weights for policy 1, policy_version 159548 (0.0009) [2023-12-26 00:51:44,154][123091] Updated weights for policy 0, policy_version 160294 (0.0008) [2023-12-26 00:51:44,201][123091] Updated weights for policy 0, policy_version 160304 (0.0010) [2023-12-26 00:51:44,253][123091] Updated weights for policy 0, policy_version 160314 (0.0010) [2023-12-26 00:51:44,676][123090] Updated weights for policy 1, policy_version 159558 (0.0006) [2023-12-26 00:51:44,736][123090] Updated weights for policy 1, policy_version 159568 (0.0005) [2023-12-26 00:51:44,803][123090] Updated weights for policy 1, policy_version 159578 (0.0008) [2023-12-26 00:51:45,054][123091] Updated weights for policy 0, policy_version 160324 (0.0009) [2023-12-26 00:51:45,106][123091] Updated weights for policy 0, policy_version 160334 (0.0008) [2023-12-26 00:51:45,171][123091] Updated weights for policy 0, policy_version 160344 (0.0008) [2023-12-26 00:51:45,574][123090] Updated weights for policy 1, policy_version 159588 (0.0008) [2023-12-26 00:51:45,627][123090] Updated weights for policy 1, policy_version 159598 (0.0009) [2023-12-26 00:51:45,687][123090] Updated weights for policy 1, policy_version 159608 (0.0009) [2023-12-26 00:51:45,992][123091] Updated weights for policy 0, policy_version 160354 (0.0008) [2023-12-26 00:51:46,054][123091] Updated weights for policy 0, policy_version 160364 (0.0011) [2023-12-26 00:51:46,119][123091] Updated weights for policy 0, policy_version 160374 (0.0010) [2023-12-26 00:51:46,181][123091] Updated weights for policy 0, policy_version 160384 (0.0010) [2023-12-26 00:51:46,530][123090] Updated weights for policy 1, policy_version 159618 (0.0009) [2023-12-26 00:51:46,578][123090] Updated weights for policy 1, policy_version 159628 (0.0009) [2023-12-26 00:51:46,627][123090] Updated weights for policy 1, policy_version 159638 (0.0009) [2023-12-26 00:51:46,675][123090] Updated weights for policy 1, policy_version 159648 (0.0009) [2023-12-26 00:51:46,993][123091] Updated weights for policy 0, policy_version 160394 (0.0010) [2023-12-26 00:51:47,047][123091] Updated weights for policy 0, policy_version 160404 (0.0010) [2023-12-26 00:51:47,091][123091] Updated weights for policy 0, policy_version 160414 (0.0010) [2023-12-26 00:51:47,535][123090] Updated weights for policy 1, policy_version 159658 (0.0009) [2023-12-26 00:51:47,583][123090] Updated weights for policy 1, policy_version 159668 (0.0008) [2023-12-26 00:51:47,631][123090] Updated weights for policy 1, policy_version 159678 (0.0009) [2023-12-26 00:51:47,924][123091] Updated weights for policy 0, policy_version 160424 (0.0010) [2023-12-26 00:51:47,990][123091] Updated weights for policy 0, policy_version 160434 (0.0011) [2023-12-26 00:51:48,057][123091] Updated weights for policy 0, policy_version 160444 (0.0011) [2023-12-26 00:51:48,497][123090] Updated weights for policy 1, policy_version 159688 (0.0009) [2023-12-26 00:51:48,558][123090] Updated weights for policy 1, policy_version 159698 (0.0009) [2023-12-26 00:51:48,626][123090] Updated weights for policy 1, policy_version 159708 (0.0008) [2023-12-26 00:51:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 81960960. Throughput: 0: 8939.3, 1: 8835.3. Samples: 81972272. Policy #0 lag: (min: 17.0, avg: 37.4, max: 49.0) [2023-12-26 00:51:48,785][121949] Avg episode reward: [(0, '5810.348'), (1, '5279.447')] [2023-12-26 00:51:48,862][123091] Updated weights for policy 0, policy_version 160454 (0.0009) [2023-12-26 00:51:48,927][123091] Updated weights for policy 0, policy_version 160464 (0.0008) [2023-12-26 00:51:48,998][123091] Updated weights for policy 0, policy_version 160474 (0.0008) [2023-12-26 00:51:49,498][123090] Updated weights for policy 1, policy_version 159718 (0.0008) [2023-12-26 00:51:49,558][123090] Updated weights for policy 1, policy_version 159728 (0.0007) [2023-12-26 00:51:49,610][123090] Updated weights for policy 1, policy_version 159738 (0.0009) [2023-12-26 00:51:49,817][123091] Updated weights for policy 0, policy_version 160484 (0.0009) [2023-12-26 00:51:49,882][123091] Updated weights for policy 0, policy_version 160494 (0.0008) [2023-12-26 00:51:49,944][123091] Updated weights for policy 0, policy_version 160504 (0.0009) [2023-12-26 00:51:50,455][123090] Updated weights for policy 1, policy_version 159748 (0.0009) [2023-12-26 00:51:50,513][123090] Updated weights for policy 1, policy_version 159758 (0.0008) [2023-12-26 00:51:50,581][123090] Updated weights for policy 1, policy_version 159768 (0.0009) [2023-12-26 00:51:50,696][123091] Updated weights for policy 0, policy_version 160514 (0.0007) [2023-12-26 00:51:50,763][123091] Updated weights for policy 0, policy_version 160524 (0.0011) [2023-12-26 00:51:50,822][123091] Updated weights for policy 0, policy_version 160534 (0.0011) [2023-12-26 00:51:50,888][123091] Updated weights for policy 0, policy_version 160544 (0.0011) [2023-12-26 00:51:51,430][123090] Updated weights for policy 1, policy_version 159778 (0.0009) [2023-12-26 00:51:51,494][123090] Updated weights for policy 1, policy_version 159788 (0.0011) [2023-12-26 00:51:51,561][123090] Updated weights for policy 1, policy_version 159798 (0.0006) [2023-12-26 00:51:51,621][123090] Updated weights for policy 1, policy_version 159808 (0.0008) [2023-12-26 00:51:51,730][123091] Updated weights for policy 0, policy_version 160554 (0.0008) [2023-12-26 00:51:51,789][123091] Updated weights for policy 0, policy_version 160564 (0.0009) [2023-12-26 00:51:51,838][123091] Updated weights for policy 0, policy_version 160574 (0.0009) [2023-12-26 00:51:52,466][123090] Updated weights for policy 1, policy_version 159818 (0.0011) [2023-12-26 00:51:52,534][123090] Updated weights for policy 1, policy_version 159828 (0.0008) [2023-12-26 00:51:52,604][123090] Updated weights for policy 1, policy_version 159838 (0.0009) [2023-12-26 00:51:52,668][123091] Updated weights for policy 0, policy_version 160584 (0.0006) [2023-12-26 00:51:52,737][123091] Updated weights for policy 0, policy_version 160594 (0.0007) [2023-12-26 00:51:52,789][123091] Updated weights for policy 0, policy_version 160604 (0.0009) [2023-12-26 00:51:53,361][123090] Updated weights for policy 1, policy_version 159848 (0.0006) [2023-12-26 00:51:53,417][123090] Updated weights for policy 1, policy_version 159858 (0.0007) [2023-12-26 00:51:53,471][123090] Updated weights for policy 1, policy_version 159868 (0.0007) [2023-12-26 00:51:53,638][123091] Updated weights for policy 0, policy_version 160614 (0.0009) [2023-12-26 00:51:53,687][123091] Updated weights for policy 0, policy_version 160624 (0.0009) [2023-12-26 00:51:53,735][123091] Updated weights for policy 0, policy_version 160634 (0.0009) [2023-12-26 00:51:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 82051072. Throughput: 0: 8885.7, 1: 8776.7. Samples: 82022640. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:51:53,785][121949] Avg episode reward: [(0, '5800.422'), (1, '5409.894')] [2023-12-26 00:51:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000159872_40927232.pth... [2023-12-26 00:51:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000160640_41123840.pth... [2023-12-26 00:51:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000158848_40665088.pth [2023-12-26 00:51:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000159616_40861696.pth [2023-12-26 00:51:54,267][123090] Updated weights for policy 1, policy_version 159878 (0.0009) [2023-12-26 00:51:54,338][123090] Updated weights for policy 1, policy_version 159888 (0.0011) [2023-12-26 00:51:54,393][123090] Updated weights for policy 1, policy_version 159898 (0.0010) [2023-12-26 00:51:54,603][123091] Updated weights for policy 0, policy_version 160644 (0.0009) [2023-12-26 00:51:54,657][123091] Updated weights for policy 0, policy_version 160654 (0.0007) [2023-12-26 00:51:54,714][123091] Updated weights for policy 0, policy_version 160664 (0.0006) [2023-12-26 00:51:55,154][123090] Updated weights for policy 1, policy_version 159908 (0.0008) [2023-12-26 00:51:55,207][123090] Updated weights for policy 1, policy_version 159918 (0.0005) [2023-12-26 00:51:55,259][123090] Updated weights for policy 1, policy_version 159928 (0.0005) [2023-12-26 00:51:55,569][123091] Updated weights for policy 0, policy_version 160674 (0.0006) [2023-12-26 00:51:55,626][123091] Updated weights for policy 0, policy_version 160685 (0.0010) [2023-12-26 00:51:55,679][123091] Updated weights for policy 0, policy_version 160695 (0.0010) [2023-12-26 00:51:55,901][123090] Updated weights for policy 1, policy_version 159938 (0.0005) [2023-12-26 00:51:55,951][123090] Updated weights for policy 1, policy_version 159948 (0.0005) [2023-12-26 00:51:56,004][123090] Updated weights for policy 1, policy_version 159958 (0.0005) [2023-12-26 00:51:56,058][123090] Updated weights for policy 1, policy_version 159968 (0.0005) [2023-12-26 00:51:56,635][123091] Updated weights for policy 0, policy_version 160705 (0.0010) [2023-12-26 00:51:56,698][123091] Updated weights for policy 0, policy_version 160715 (0.0011) [2023-12-26 00:51:56,740][123090] Updated weights for policy 1, policy_version 159978 (0.0005) [2023-12-26 00:51:56,761][123091] Updated weights for policy 0, policy_version 160725 (0.0010) [2023-12-26 00:51:56,801][123090] Updated weights for policy 1, policy_version 159988 (0.0005) [2023-12-26 00:51:56,820][123091] Updated weights for policy 0, policy_version 160735 (0.0010) [2023-12-26 00:51:56,848][123090] Updated weights for policy 1, policy_version 159998 (0.0005) [2023-12-26 00:51:57,628][123090] Updated weights for policy 1, policy_version 160008 (0.0008) [2023-12-26 00:51:57,643][123091] Updated weights for policy 0, policy_version 160745 (0.0006) [2023-12-26 00:51:57,676][123090] Updated weights for policy 1, policy_version 160018 (0.0008) [2023-12-26 00:51:57,695][123091] Updated weights for policy 0, policy_version 160755 (0.0005) [2023-12-26 00:51:57,732][123090] Updated weights for policy 1, policy_version 160028 (0.0010) [2023-12-26 00:51:57,745][123091] Updated weights for policy 0, policy_version 160765 (0.0005) [2023-12-26 00:51:58,531][123091] Updated weights for policy 0, policy_version 160775 (0.0008) [2023-12-26 00:51:58,569][123090] Updated weights for policy 1, policy_version 160038 (0.0010) [2023-12-26 00:51:58,599][123091] Updated weights for policy 0, policy_version 160785 (0.0008) [2023-12-26 00:51:58,639][123090] Updated weights for policy 1, policy_version 160048 (0.0010) [2023-12-26 00:51:58,662][123091] Updated weights for policy 0, policy_version 160795 (0.0009) [2023-12-26 00:51:58,716][123090] Updated weights for policy 1, policy_version 160058 (0.0008) [2023-12-26 00:51:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 82141184. Throughput: 0: 8809.0, 1: 8936.5. Samples: 82129844. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:51:58,785][121949] Avg episode reward: [(0, '5767.307'), (1, '5426.880')] [2023-12-26 00:51:59,514][123091] Updated weights for policy 0, policy_version 160805 (0.0009) [2023-12-26 00:51:59,533][123090] Updated weights for policy 1, policy_version 160068 (0.0011) [2023-12-26 00:51:59,575][123091] Updated weights for policy 0, policy_version 160815 (0.0009) [2023-12-26 00:51:59,596][123090] Updated weights for policy 1, policy_version 160078 (0.0006) [2023-12-26 00:51:59,634][123091] Updated weights for policy 0, policy_version 160825 (0.0007) [2023-12-26 00:51:59,653][123090] Updated weights for policy 1, policy_version 160088 (0.0010) [2023-12-26 00:52:00,334][123090] Updated weights for policy 1, policy_version 160098 (0.0008) [2023-12-26 00:52:00,406][123090] Updated weights for policy 1, policy_version 160108 (0.0008) [2023-12-26 00:52:00,448][123091] Updated weights for policy 0, policy_version 160835 (0.0007) [2023-12-26 00:52:00,471][123090] Updated weights for policy 1, policy_version 160118 (0.0010) [2023-12-26 00:52:00,498][123091] Updated weights for policy 0, policy_version 160845 (0.0009) [2023-12-26 00:52:00,533][123090] Updated weights for policy 1, policy_version 160128 (0.0008) [2023-12-26 00:52:00,562][123091] Updated weights for policy 0, policy_version 160855 (0.0009) [2023-12-26 00:52:01,249][123090] Updated weights for policy 1, policy_version 160138 (0.0008) [2023-12-26 00:52:01,295][123091] Updated weights for policy 0, policy_version 160865 (0.0009) [2023-12-26 00:52:01,317][123090] Updated weights for policy 1, policy_version 160148 (0.0008) [2023-12-26 00:52:01,358][123091] Updated weights for policy 0, policy_version 160875 (0.0008) [2023-12-26 00:52:01,387][123090] Updated weights for policy 1, policy_version 160158 (0.0008) [2023-12-26 00:52:01,421][123091] Updated weights for policy 0, policy_version 160885 (0.0008) [2023-12-26 00:52:01,485][123091] Updated weights for policy 0, policy_version 160895 (0.0008) [2023-12-26 00:52:02,168][123090] Updated weights for policy 1, policy_version 160168 (0.0006) [2023-12-26 00:52:02,223][123090] Updated weights for policy 1, policy_version 160178 (0.0010) [2023-12-26 00:52:02,253][123091] Updated weights for policy 0, policy_version 160905 (0.0006) [2023-12-26 00:52:02,283][123090] Updated weights for policy 1, policy_version 160188 (0.0010) [2023-12-26 00:52:02,310][123091] Updated weights for policy 0, policy_version 160915 (0.0007) [2023-12-26 00:52:02,383][123091] Updated weights for policy 0, policy_version 160925 (0.0008) [2023-12-26 00:52:02,992][123090] Updated weights for policy 1, policy_version 160198 (0.0005) [2023-12-26 00:52:03,040][123090] Updated weights for policy 1, policy_version 160208 (0.0005) [2023-12-26 00:52:03,101][123090] Updated weights for policy 1, policy_version 160218 (0.0005) [2023-12-26 00:52:03,154][123091] Updated weights for policy 0, policy_version 160935 (0.0009) [2023-12-26 00:52:03,209][123091] Updated weights for policy 0, policy_version 160945 (0.0005) [2023-12-26 00:52:03,253][123091] Updated weights for policy 0, policy_version 160955 (0.0005) [2023-12-26 00:52:03,751][123090] Updated weights for policy 1, policy_version 160228 (0.0005) [2023-12-26 00:52:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 82223104. Throughput: 0: 8733.4, 1: 8959.8. Samples: 82239588. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:03,785][121949] Avg episode reward: [(0, '5834.864'), (1, '5495.139')] [2023-12-26 00:52:03,801][123090] Updated weights for policy 1, policy_version 160238 (0.0005) [2023-12-26 00:52:03,854][123090] Updated weights for policy 1, policy_version 160248 (0.0006) [2023-12-26 00:52:03,898][123091] Updated weights for policy 0, policy_version 160965 (0.0006) [2023-12-26 00:52:03,971][123091] Updated weights for policy 0, policy_version 160975 (0.0006) [2023-12-26 00:52:04,032][123091] Updated weights for policy 0, policy_version 160985 (0.0009) [2023-12-26 00:52:04,643][123090] Updated weights for policy 1, policy_version 160258 (0.0007) [2023-12-26 00:52:04,713][123090] Updated weights for policy 1, policy_version 160268 (0.0009) [2023-12-26 00:52:04,783][123090] Updated weights for policy 1, policy_version 160278 (0.0009) [2023-12-26 00:52:04,848][123090] Updated weights for policy 1, policy_version 160288 (0.0009) [2023-12-26 00:52:04,878][123091] Updated weights for policy 0, policy_version 160995 (0.0008) [2023-12-26 00:52:04,940][123091] Updated weights for policy 0, policy_version 161005 (0.0010) [2023-12-26 00:52:05,007][123091] Updated weights for policy 0, policy_version 161015 (0.0010) [2023-12-26 00:52:05,641][123090] Updated weights for policy 1, policy_version 160298 (0.0006) [2023-12-26 00:52:05,673][123091] Updated weights for policy 0, policy_version 161025 (0.0006) [2023-12-26 00:52:05,693][123090] Updated weights for policy 1, policy_version 160308 (0.0005) [2023-12-26 00:52:05,733][123091] Updated weights for policy 0, policy_version 161035 (0.0008) [2023-12-26 00:52:05,746][123090] Updated weights for policy 1, policy_version 160318 (0.0005) [2023-12-26 00:52:05,783][123091] Updated weights for policy 0, policy_version 161045 (0.0009) [2023-12-26 00:52:05,828][123091] Updated weights for policy 0, policy_version 161055 (0.0006) [2023-12-26 00:52:06,478][123090] Updated weights for policy 1, policy_version 160328 (0.0009) [2023-12-26 00:52:06,548][123090] Updated weights for policy 1, policy_version 160338 (0.0006) [2023-12-26 00:52:06,593][123091] Updated weights for policy 0, policy_version 161065 (0.0008) [2023-12-26 00:52:06,613][123090] Updated weights for policy 1, policy_version 160348 (0.0006) [2023-12-26 00:52:06,663][123091] Updated weights for policy 0, policy_version 161075 (0.0006) [2023-12-26 00:52:06,733][123091] Updated weights for policy 0, policy_version 161085 (0.0008) [2023-12-26 00:52:07,382][123090] Updated weights for policy 1, policy_version 160358 (0.0009) [2023-12-26 00:52:07,433][123091] Updated weights for policy 0, policy_version 161095 (0.0009) [2023-12-26 00:52:07,450][123090] Updated weights for policy 1, policy_version 160368 (0.0010) [2023-12-26 00:52:07,494][123091] Updated weights for policy 0, policy_version 161105 (0.0011) [2023-12-26 00:52:07,517][123090] Updated weights for policy 1, policy_version 160378 (0.0010) [2023-12-26 00:52:07,546][123091] Updated weights for policy 0, policy_version 161115 (0.0009) [2023-12-26 00:52:08,254][123091] Updated weights for policy 0, policy_version 161125 (0.0006) [2023-12-26 00:52:08,314][123090] Updated weights for policy 1, policy_version 160388 (0.0010) [2023-12-26 00:52:08,326][123091] Updated weights for policy 0, policy_version 161135 (0.0011) [2023-12-26 00:52:08,382][123090] Updated weights for policy 1, policy_version 160398 (0.0010) [2023-12-26 00:52:08,393][123091] Updated weights for policy 0, policy_version 161145 (0.0010) [2023-12-26 00:52:08,453][123090] Updated weights for policy 1, policy_version 160408 (0.0010) [2023-12-26 00:52:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 82321408. Throughput: 0: 8813.8, 1: 8986.6. Samples: 82294772. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:08,785][121949] Avg episode reward: [(0, '5837.804'), (1, '5513.149')] [2023-12-26 00:52:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000161152_41254912.pth... [2023-12-26 00:52:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000160416_41066496.pth... [2023-12-26 00:52:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000160128_40992768.pth [2023-12-26 00:52:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000159360_40796160.pth [2023-12-26 00:52:09,048][123091] Updated weights for policy 0, policy_version 161155 (0.0006) [2023-12-26 00:52:09,113][123091] Updated weights for policy 0, policy_version 161165 (0.0006) [2023-12-26 00:52:09,175][123091] Updated weights for policy 0, policy_version 161175 (0.0008) [2023-12-26 00:52:09,273][123090] Updated weights for policy 1, policy_version 160418 (0.0010) [2023-12-26 00:52:09,341][123090] Updated weights for policy 1, policy_version 160428 (0.0009) [2023-12-26 00:52:09,410][123090] Updated weights for policy 1, policy_version 160438 (0.0008) [2023-12-26 00:52:09,477][123090] Updated weights for policy 1, policy_version 160448 (0.0008) [2023-12-26 00:52:09,968][123091] Updated weights for policy 0, policy_version 161185 (0.0007) [2023-12-26 00:52:10,034][123091] Updated weights for policy 0, policy_version 161195 (0.0009) [2023-12-26 00:52:10,101][123091] Updated weights for policy 0, policy_version 161205 (0.0009) [2023-12-26 00:52:10,166][123091] Updated weights for policy 0, policy_version 161215 (0.0009) [2023-12-26 00:52:10,229][123090] Updated weights for policy 1, policy_version 160458 (0.0010) [2023-12-26 00:52:10,295][123090] Updated weights for policy 1, policy_version 160468 (0.0010) [2023-12-26 00:52:10,365][123090] Updated weights for policy 1, policy_version 160478 (0.0010) [2023-12-26 00:52:10,966][123091] Updated weights for policy 0, policy_version 161225 (0.0010) [2023-12-26 00:52:11,021][123091] Updated weights for policy 0, policy_version 161235 (0.0010) [2023-12-26 00:52:11,085][123091] Updated weights for policy 0, policy_version 161245 (0.0009) [2023-12-26 00:52:11,167][123090] Updated weights for policy 1, policy_version 160488 (0.0009) [2023-12-26 00:52:11,234][123090] Updated weights for policy 1, policy_version 160498 (0.0008) [2023-12-26 00:52:11,307][123090] Updated weights for policy 1, policy_version 160508 (0.0007) [2023-12-26 00:52:12,015][123091] Updated weights for policy 0, policy_version 161255 (0.0009) [2023-12-26 00:52:12,043][123090] Updated weights for policy 1, policy_version 160518 (0.0008) [2023-12-26 00:52:12,076][123091] Updated weights for policy 0, policy_version 161265 (0.0008) [2023-12-26 00:52:12,105][123090] Updated weights for policy 1, policy_version 160528 (0.0007) [2023-12-26 00:52:12,138][123091] Updated weights for policy 0, policy_version 161275 (0.0007) [2023-12-26 00:52:12,168][123090] Updated weights for policy 1, policy_version 160538 (0.0008) [2023-12-26 00:52:12,949][123091] Updated weights for policy 0, policy_version 161285 (0.0009) [2023-12-26 00:52:12,984][123090] Updated weights for policy 1, policy_version 160548 (0.0009) [2023-12-26 00:52:13,001][123091] Updated weights for policy 0, policy_version 161295 (0.0007) [2023-12-26 00:52:13,031][123090] Updated weights for policy 1, policy_version 160558 (0.0007) [2023-12-26 00:52:13,063][123091] Updated weights for policy 0, policy_version 161305 (0.0009) [2023-12-26 00:52:13,088][123090] Updated weights for policy 1, policy_version 160568 (0.0005) [2023-12-26 00:52:13,748][123090] Updated weights for policy 1, policy_version 160578 (0.0007) [2023-12-26 00:52:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 82403328. Throughput: 0: 8744.5, 1: 8990.9. Samples: 82401072. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:13,785][121949] Avg episode reward: [(0, '5837.095'), (1, '5457.203')] [2023-12-26 00:52:13,806][123090] Updated weights for policy 1, policy_version 160588 (0.0008) [2023-12-26 00:52:13,869][123090] Updated weights for policy 1, policy_version 160598 (0.0009) [2023-12-26 00:52:13,917][123090] Updated weights for policy 1, policy_version 160608 (0.0009) [2023-12-26 00:52:13,947][123091] Updated weights for policy 0, policy_version 161315 (0.0009) [2023-12-26 00:52:14,003][123091] Updated weights for policy 0, policy_version 161325 (0.0008) [2023-12-26 00:52:14,061][123091] Updated weights for policy 0, policy_version 161335 (0.0010) [2023-12-26 00:52:14,628][123090] Updated weights for policy 1, policy_version 160618 (0.0006) [2023-12-26 00:52:14,677][123090] Updated weights for policy 1, policy_version 160628 (0.0007) [2023-12-26 00:52:14,724][123090] Updated weights for policy 1, policy_version 160638 (0.0010) [2023-12-26 00:52:14,955][123091] Updated weights for policy 0, policy_version 161345 (0.0008) [2023-12-26 00:52:15,029][123091] Updated weights for policy 0, policy_version 161355 (0.0008) [2023-12-26 00:52:15,098][123091] Updated weights for policy 0, policy_version 161365 (0.0011) [2023-12-26 00:52:15,168][123091] Updated weights for policy 0, policy_version 161375 (0.0007) [2023-12-26 00:52:15,586][123090] Updated weights for policy 1, policy_version 160648 (0.0009) [2023-12-26 00:52:15,642][123090] Updated weights for policy 1, policy_version 160658 (0.0008) [2023-12-26 00:52:15,690][123090] Updated weights for policy 1, policy_version 160668 (0.0009) [2023-12-26 00:52:15,967][123091] Updated weights for policy 0, policy_version 161385 (0.0011) [2023-12-26 00:52:16,016][123091] Updated weights for policy 0, policy_version 161395 (0.0010) [2023-12-26 00:52:16,075][123091] Updated weights for policy 0, policy_version 161405 (0.0011) [2023-12-26 00:52:16,582][123090] Updated weights for policy 1, policy_version 160678 (0.0008) [2023-12-26 00:52:16,631][123090] Updated weights for policy 1, policy_version 160688 (0.0005) [2023-12-26 00:52:16,693][123090] Updated weights for policy 1, policy_version 160698 (0.0005) [2023-12-26 00:52:16,781][123091] Updated weights for policy 0, policy_version 161415 (0.0008) [2023-12-26 00:52:16,841][123091] Updated weights for policy 0, policy_version 161425 (0.0005) [2023-12-26 00:52:16,913][123091] Updated weights for policy 0, policy_version 161435 (0.0005) [2023-12-26 00:52:17,341][123090] Updated weights for policy 1, policy_version 160708 (0.0005) [2023-12-26 00:52:17,392][123090] Updated weights for policy 1, policy_version 160718 (0.0005) [2023-12-26 00:52:17,450][123090] Updated weights for policy 1, policy_version 160728 (0.0005) [2023-12-26 00:52:17,530][123091] Updated weights for policy 0, policy_version 161445 (0.0005) [2023-12-26 00:52:17,584][123091] Updated weights for policy 0, policy_version 161455 (0.0005) [2023-12-26 00:52:17,643][123091] Updated weights for policy 0, policy_version 161465 (0.0006) [2023-12-26 00:52:18,189][123090] Updated weights for policy 1, policy_version 160738 (0.0005) [2023-12-26 00:52:18,251][123090] Updated weights for policy 1, policy_version 160748 (0.0005) [2023-12-26 00:52:18,305][123090] Updated weights for policy 1, policy_version 160758 (0.0008) [2023-12-26 00:52:18,373][123090] Updated weights for policy 1, policy_version 160768 (0.0010) [2023-12-26 00:52:18,396][123091] Updated weights for policy 0, policy_version 161475 (0.0010) [2023-12-26 00:52:18,462][123091] Updated weights for policy 0, policy_version 161485 (0.0009) [2023-12-26 00:52:18,524][123091] Updated weights for policy 0, policy_version 161495 (0.0009) [2023-12-26 00:52:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 82501632. Throughput: 0: 8843.8, 1: 9017.0. Samples: 82511208. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:18,785][121949] Avg episode reward: [(0, '5859.960'), (1, '5378.964')] [2023-12-26 00:52:19,063][123090] Updated weights for policy 1, policy_version 160778 (0.0005) [2023-12-26 00:52:19,136][123090] Updated weights for policy 1, policy_version 160788 (0.0011) [2023-12-26 00:52:19,188][123090] Updated weights for policy 1, policy_version 160798 (0.0010) [2023-12-26 00:52:19,375][123091] Updated weights for policy 0, policy_version 161505 (0.0009) [2023-12-26 00:52:19,447][123091] Updated weights for policy 0, policy_version 161515 (0.0006) [2023-12-26 00:52:19,522][123091] Updated weights for policy 0, policy_version 161525 (0.0008) [2023-12-26 00:52:19,582][123091] Updated weights for policy 0, policy_version 161535 (0.0010) [2023-12-26 00:52:19,992][123090] Updated weights for policy 1, policy_version 160808 (0.0007) [2023-12-26 00:52:20,055][123090] Updated weights for policy 1, policy_version 160818 (0.0008) [2023-12-26 00:52:20,122][123090] Updated weights for policy 1, policy_version 160828 (0.0010) [2023-12-26 00:52:20,454][123091] Updated weights for policy 0, policy_version 161545 (0.0010) [2023-12-26 00:52:20,527][123091] Updated weights for policy 0, policy_version 161555 (0.0007) [2023-12-26 00:52:20,592][123091] Updated weights for policy 0, policy_version 161565 (0.0010) [2023-12-26 00:52:20,957][123090] Updated weights for policy 1, policy_version 160838 (0.0007) [2023-12-26 00:52:21,032][123090] Updated weights for policy 1, policy_version 160848 (0.0007) [2023-12-26 00:52:21,098][123090] Updated weights for policy 1, policy_version 160858 (0.0007) [2023-12-26 00:52:21,456][123091] Updated weights for policy 0, policy_version 161575 (0.0008) [2023-12-26 00:52:21,529][123091] Updated weights for policy 0, policy_version 161585 (0.0008) [2023-12-26 00:52:21,596][123091] Updated weights for policy 0, policy_version 161595 (0.0008) [2023-12-26 00:52:22,025][123090] Updated weights for policy 1, policy_version 160868 (0.0009) [2023-12-26 00:52:22,096][123090] Updated weights for policy 1, policy_version 160878 (0.0009) [2023-12-26 00:52:22,167][123090] Updated weights for policy 1, policy_version 160888 (0.0009) [2023-12-26 00:52:22,421][123091] Updated weights for policy 0, policy_version 161605 (0.0010) [2023-12-26 00:52:22,485][123091] Updated weights for policy 0, policy_version 161615 (0.0010) [2023-12-26 00:52:22,554][123091] Updated weights for policy 0, policy_version 161625 (0.0010) [2023-12-26 00:52:22,992][123090] Updated weights for policy 1, policy_version 160898 (0.0010) [2023-12-26 00:52:23,049][123090] Updated weights for policy 1, policy_version 160908 (0.0011) [2023-12-26 00:52:23,112][123090] Updated weights for policy 1, policy_version 160918 (0.0011) [2023-12-26 00:52:23,172][123090] Updated weights for policy 1, policy_version 160928 (0.0011) [2023-12-26 00:52:23,418][123091] Updated weights for policy 0, policy_version 161635 (0.0009) [2023-12-26 00:52:23,467][123091] Updated weights for policy 0, policy_version 161645 (0.0009) [2023-12-26 00:52:23,524][123091] Updated weights for policy 0, policy_version 161655 (0.0009) [2023-12-26 00:52:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 82583552. Throughput: 0: 8794.2, 1: 8966.9. Samples: 82562144. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:23,785][121949] Avg episode reward: [(0, '5762.306'), (1, '5308.783')] [2023-12-26 00:52:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000161664_41385984.pth... [2023-12-26 00:52:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000160928_41197568.pth... [2023-12-26 00:52:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000160640_41123840.pth [2023-12-26 00:52:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000159872_40927232.pth [2023-12-26 00:52:23,966][123090] Updated weights for policy 1, policy_version 160938 (0.0010) [2023-12-26 00:52:24,028][123090] Updated weights for policy 1, policy_version 160948 (0.0005) [2023-12-26 00:52:24,083][123090] Updated weights for policy 1, policy_version 160958 (0.0005) [2023-12-26 00:52:24,233][123091] Updated weights for policy 0, policy_version 161665 (0.0009) [2023-12-26 00:52:24,288][123091] Updated weights for policy 0, policy_version 161675 (0.0010) [2023-12-26 00:52:24,336][123091] Updated weights for policy 0, policy_version 161685 (0.0006) [2023-12-26 00:52:24,383][123091] Updated weights for policy 0, policy_version 161695 (0.0005) [2023-12-26 00:52:24,789][123090] Updated weights for policy 1, policy_version 160968 (0.0009) [2023-12-26 00:52:24,843][123090] Updated weights for policy 1, policy_version 160978 (0.0010) [2023-12-26 00:52:24,916][123090] Updated weights for policy 1, policy_version 160988 (0.0010) [2023-12-26 00:52:25,080][123091] Updated weights for policy 0, policy_version 161705 (0.0009) [2023-12-26 00:52:25,144][123091] Updated weights for policy 0, policy_version 161715 (0.0010) [2023-12-26 00:52:25,202][123091] Updated weights for policy 0, policy_version 161726 (0.0010) [2023-12-26 00:52:25,565][123090] Updated weights for policy 1, policy_version 160998 (0.0009) [2023-12-26 00:52:25,629][123090] Updated weights for policy 1, policy_version 161008 (0.0008) [2023-12-26 00:52:25,692][123090] Updated weights for policy 1, policy_version 161018 (0.0008) [2023-12-26 00:52:26,097][123091] Updated weights for policy 0, policy_version 161736 (0.0010) [2023-12-26 00:52:26,144][123091] Updated weights for policy 0, policy_version 161746 (0.0005) [2023-12-26 00:52:26,201][123091] Updated weights for policy 0, policy_version 161756 (0.0006) [2023-12-26 00:52:26,366][123090] Updated weights for policy 1, policy_version 161028 (0.0008) [2023-12-26 00:52:26,442][123090] Updated weights for policy 1, policy_version 161038 (0.0009) [2023-12-26 00:52:26,508][123090] Updated weights for policy 1, policy_version 161048 (0.0007) [2023-12-26 00:52:26,890][123091] Updated weights for policy 0, policy_version 161766 (0.0009) [2023-12-26 00:52:26,948][123091] Updated weights for policy 0, policy_version 161776 (0.0010) [2023-12-26 00:52:27,005][123091] Updated weights for policy 0, policy_version 161786 (0.0010) [2023-12-26 00:52:27,162][123090] Updated weights for policy 1, policy_version 161058 (0.0008) [2023-12-26 00:52:27,211][123090] Updated weights for policy 1, policy_version 161068 (0.0007) [2023-12-26 00:52:27,267][123090] Updated weights for policy 1, policy_version 161078 (0.0010) [2023-12-26 00:52:27,330][123090] Updated weights for policy 1, policy_version 161088 (0.0010) [2023-12-26 00:52:27,746][123091] Updated weights for policy 0, policy_version 161796 (0.0008) [2023-12-26 00:52:27,820][123091] Updated weights for policy 0, policy_version 161806 (0.0006) [2023-12-26 00:52:27,890][123091] Updated weights for policy 0, policy_version 161816 (0.0005) [2023-12-26 00:52:28,080][123090] Updated weights for policy 1, policy_version 161098 (0.0010) [2023-12-26 00:52:28,142][123090] Updated weights for policy 1, policy_version 161108 (0.0010) [2023-12-26 00:52:28,212][123090] Updated weights for policy 1, policy_version 161118 (0.0008) [2023-12-26 00:52:28,571][123091] Updated weights for policy 0, policy_version 161826 (0.0007) [2023-12-26 00:52:28,634][123091] Updated weights for policy 0, policy_version 161836 (0.0011) [2023-12-26 00:52:28,699][123091] Updated weights for policy 0, policy_version 161846 (0.0010) [2023-12-26 00:52:28,761][123091] Updated weights for policy 0, policy_version 161856 (0.0010) [2023-12-26 00:52:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 82681856. Throughput: 0: 8840.6, 1: 9088.9. Samples: 82672596. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:28,785][121949] Avg episode reward: [(0, '5694.432'), (1, '5438.611')] [2023-12-26 00:52:28,994][123090] Updated weights for policy 1, policy_version 161128 (0.0006) [2023-12-26 00:52:29,061][123090] Updated weights for policy 1, policy_version 161138 (0.0005) [2023-12-26 00:52:29,134][123090] Updated weights for policy 1, policy_version 161148 (0.0005) [2023-12-26 00:52:29,440][123091] Updated weights for policy 0, policy_version 161866 (0.0005) [2023-12-26 00:52:29,486][123091] Updated weights for policy 0, policy_version 161876 (0.0005) [2023-12-26 00:52:29,538][123091] Updated weights for policy 0, policy_version 161886 (0.0006) [2023-12-26 00:52:29,799][123090] Updated weights for policy 1, policy_version 161158 (0.0006) [2023-12-26 00:52:29,866][123090] Updated weights for policy 1, policy_version 161168 (0.0006) [2023-12-26 00:52:29,933][123090] Updated weights for policy 1, policy_version 161178 (0.0010) [2023-12-26 00:52:30,318][123091] Updated weights for policy 0, policy_version 161896 (0.0008) [2023-12-26 00:52:30,388][123091] Updated weights for policy 0, policy_version 161906 (0.0009) [2023-12-26 00:52:30,441][123091] Updated weights for policy 0, policy_version 161917 (0.0010) [2023-12-26 00:52:30,654][123090] Updated weights for policy 1, policy_version 161188 (0.0009) [2023-12-26 00:52:30,719][123090] Updated weights for policy 1, policy_version 161198 (0.0005) [2023-12-26 00:52:30,770][123090] Updated weights for policy 1, policy_version 161208 (0.0005) [2023-12-26 00:52:31,218][123091] Updated weights for policy 0, policy_version 161927 (0.0010) [2023-12-26 00:52:31,286][123091] Updated weights for policy 0, policy_version 161938 (0.0008) [2023-12-26 00:52:31,346][123091] Updated weights for policy 0, policy_version 161948 (0.0007) [2023-12-26 00:52:31,522][123090] Updated weights for policy 1, policy_version 161218 (0.0006) [2023-12-26 00:52:31,590][123090] Updated weights for policy 1, policy_version 161228 (0.0009) [2023-12-26 00:52:31,656][123090] Updated weights for policy 1, policy_version 161238 (0.0009) [2023-12-26 00:52:31,709][123090] Updated weights for policy 1, policy_version 161248 (0.0009) [2023-12-26 00:52:32,145][123091] Updated weights for policy 0, policy_version 161958 (0.0006) [2023-12-26 00:52:32,195][123091] Updated weights for policy 0, policy_version 161968 (0.0007) [2023-12-26 00:52:32,266][123091] Updated weights for policy 0, policy_version 161978 (0.0010) [2023-12-26 00:52:32,542][123090] Updated weights for policy 1, policy_version 161258 (0.0009) [2023-12-26 00:52:32,596][123090] Updated weights for policy 1, policy_version 161268 (0.0010) [2023-12-26 00:52:32,662][123090] Updated weights for policy 1, policy_version 161278 (0.0010) [2023-12-26 00:52:33,058][123091] Updated weights for policy 0, policy_version 161988 (0.0010) [2023-12-26 00:52:33,111][123091] Updated weights for policy 0, policy_version 161998 (0.0010) [2023-12-26 00:52:33,165][123091] Updated weights for policy 0, policy_version 162008 (0.0010) [2023-12-26 00:52:33,319][123090] Updated weights for policy 1, policy_version 161288 (0.0005) [2023-12-26 00:52:33,364][123090] Updated weights for policy 1, policy_version 161298 (0.0005) [2023-12-26 00:52:33,425][123090] Updated weights for policy 1, policy_version 161308 (0.0005) [2023-12-26 00:52:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 82771968. Throughput: 0: 8905.6, 1: 9157.5. Samples: 82785112. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:33,785][121949] Avg episode reward: [(0, '5777.603'), (1, '5574.126')] [2023-12-26 00:52:33,826][123091] Updated weights for policy 0, policy_version 162018 (0.0009) [2023-12-26 00:52:33,875][123091] Updated weights for policy 0, policy_version 162028 (0.0005) [2023-12-26 00:52:33,923][123091] Updated weights for policy 0, policy_version 162038 (0.0005) [2023-12-26 00:52:33,969][123091] Updated weights for policy 0, policy_version 162048 (0.0005) [2023-12-26 00:52:34,095][123090] Updated weights for policy 1, policy_version 161318 (0.0007) [2023-12-26 00:52:34,170][123090] Updated weights for policy 1, policy_version 161328 (0.0008) [2023-12-26 00:52:34,241][123090] Updated weights for policy 1, policy_version 161338 (0.0006) [2023-12-26 00:52:34,681][123091] Updated weights for policy 0, policy_version 162058 (0.0008) [2023-12-26 00:52:34,735][123091] Updated weights for policy 0, policy_version 162068 (0.0007) [2023-12-26 00:52:34,786][123091] Updated weights for policy 0, policy_version 162078 (0.0009) [2023-12-26 00:52:34,922][123090] Updated weights for policy 1, policy_version 161348 (0.0009) [2023-12-26 00:52:34,975][123090] Updated weights for policy 1, policy_version 161358 (0.0009) [2023-12-26 00:52:35,028][123090] Updated weights for policy 1, policy_version 161368 (0.0009) [2023-12-26 00:52:35,590][123091] Updated weights for policy 0, policy_version 162088 (0.0009) [2023-12-26 00:52:35,655][123091] Updated weights for policy 0, policy_version 162098 (0.0010) [2023-12-26 00:52:35,715][123091] Updated weights for policy 0, policy_version 162108 (0.0009) [2023-12-26 00:52:35,850][123090] Updated weights for policy 1, policy_version 161378 (0.0009) [2023-12-26 00:52:35,918][123090] Updated weights for policy 1, policy_version 161388 (0.0010) [2023-12-26 00:52:35,982][123090] Updated weights for policy 1, policy_version 161398 (0.0009) [2023-12-26 00:52:36,040][123090] Updated weights for policy 1, policy_version 161408 (0.0009) [2023-12-26 00:52:36,457][123091] Updated weights for policy 0, policy_version 162118 (0.0009) [2023-12-26 00:52:36,518][123091] Updated weights for policy 0, policy_version 162128 (0.0010) [2023-12-26 00:52:36,575][123091] Updated weights for policy 0, policy_version 162138 (0.0008) [2023-12-26 00:52:36,844][123090] Updated weights for policy 1, policy_version 161418 (0.0010) [2023-12-26 00:52:36,904][123090] Updated weights for policy 1, policy_version 161428 (0.0010) [2023-12-26 00:52:36,974][123090] Updated weights for policy 1, policy_version 161438 (0.0009) [2023-12-26 00:52:37,372][123091] Updated weights for policy 0, policy_version 162148 (0.0010) [2023-12-26 00:52:37,432][123091] Updated weights for policy 0, policy_version 162158 (0.0009) [2023-12-26 00:52:37,489][123091] Updated weights for policy 0, policy_version 162168 (0.0009) [2023-12-26 00:52:37,867][123090] Updated weights for policy 1, policy_version 161448 (0.0010) [2023-12-26 00:52:37,935][123090] Updated weights for policy 1, policy_version 161458 (0.0011) [2023-12-26 00:52:38,004][123090] Updated weights for policy 1, policy_version 161468 (0.0011) [2023-12-26 00:52:38,348][123091] Updated weights for policy 0, policy_version 162178 (0.0009) [2023-12-26 00:52:38,409][123091] Updated weights for policy 0, policy_version 162188 (0.0008) [2023-12-26 00:52:38,481][123091] Updated weights for policy 0, policy_version 162198 (0.0009) [2023-12-26 00:52:38,545][123091] Updated weights for policy 0, policy_version 162208 (0.0009) [2023-12-26 00:52:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 82862080. Throughput: 0: 8955.6, 1: 9220.8. Samples: 82840572. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:38,784][121949] Avg episode reward: [(0, '5721.641'), (1, '5525.883')] [2023-12-26 00:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000162208_41525248.pth... [2023-12-26 00:52:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000161152_41254912.pth [2023-12-26 00:52:38,822][123090] Updated weights for policy 1, policy_version 161478 (0.0010) [2023-12-26 00:52:38,874][123090] Updated weights for policy 1, policy_version 161488 (0.0010) [2023-12-26 00:52:38,926][123090] Updated weights for policy 1, policy_version 161498 (0.0010) [2023-12-26 00:52:38,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000161504_41345024.pth... [2023-12-26 00:52:38,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000160416_41066496.pth [2023-12-26 00:52:39,353][123091] Updated weights for policy 0, policy_version 162218 (0.0009) [2023-12-26 00:52:39,424][123091] Updated weights for policy 0, policy_version 162228 (0.0009) [2023-12-26 00:52:39,489][123091] Updated weights for policy 0, policy_version 162238 (0.0009) [2023-12-26 00:52:39,793][123090] Updated weights for policy 1, policy_version 161508 (0.0010) [2023-12-26 00:52:39,862][123090] Updated weights for policy 1, policy_version 161518 (0.0010) [2023-12-26 00:52:39,933][123090] Updated weights for policy 1, policy_version 161528 (0.0010) [2023-12-26 00:52:40,323][123091] Updated weights for policy 0, policy_version 162248 (0.0009) [2023-12-26 00:52:40,377][123091] Updated weights for policy 0, policy_version 162258 (0.0009) [2023-12-26 00:52:40,441][123091] Updated weights for policy 0, policy_version 162268 (0.0009) [2023-12-26 00:52:40,765][123090] Updated weights for policy 1, policy_version 161538 (0.0010) [2023-12-26 00:52:40,816][123090] Updated weights for policy 1, policy_version 161548 (0.0010) [2023-12-26 00:52:40,871][123090] Updated weights for policy 1, policy_version 161558 (0.0010) [2023-12-26 00:52:40,937][123090] Updated weights for policy 1, policy_version 161568 (0.0010) [2023-12-26 00:52:41,302][123091] Updated weights for policy 0, policy_version 162278 (0.0009) [2023-12-26 00:52:41,379][123091] Updated weights for policy 0, policy_version 162288 (0.0010) [2023-12-26 00:52:41,436][123091] Updated weights for policy 0, policy_version 162298 (0.0009) [2023-12-26 00:52:41,815][123090] Updated weights for policy 1, policy_version 161578 (0.0009) [2023-12-26 00:52:41,882][123090] Updated weights for policy 1, policy_version 161588 (0.0010) [2023-12-26 00:52:41,950][123090] Updated weights for policy 1, policy_version 161598 (0.0010) [2023-12-26 00:52:42,345][123091] Updated weights for policy 0, policy_version 162308 (0.0008) [2023-12-26 00:52:42,412][123091] Updated weights for policy 0, policy_version 162318 (0.0010) [2023-12-26 00:52:42,475][123091] Updated weights for policy 0, policy_version 162328 (0.0011) [2023-12-26 00:52:42,750][123090] Updated weights for policy 1, policy_version 161608 (0.0010) [2023-12-26 00:52:42,808][123090] Updated weights for policy 1, policy_version 161619 (0.0010) [2023-12-26 00:52:42,873][123090] Updated weights for policy 1, policy_version 161629 (0.0009) [2023-12-26 00:52:43,242][123091] Updated weights for policy 0, policy_version 162338 (0.0011) [2023-12-26 00:52:43,289][123091] Updated weights for policy 0, policy_version 162348 (0.0010) [2023-12-26 00:52:43,346][123091] Updated weights for policy 0, policy_version 162358 (0.0006) [2023-12-26 00:52:43,395][123091] Updated weights for policy 0, policy_version 162368 (0.0005) [2023-12-26 00:52:43,625][123090] Updated weights for policy 1, policy_version 161639 (0.0007) [2023-12-26 00:52:43,695][123090] Updated weights for policy 1, policy_version 161649 (0.0006) [2023-12-26 00:52:43,758][123090] Updated weights for policy 1, policy_version 161659 (0.0006) [2023-12-26 00:52:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 82944000. Throughput: 0: 8969.4, 1: 9062.8. Samples: 82941296. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:43,785][121949] Avg episode reward: [(0, '5751.980'), (1, '5445.958')] [2023-12-26 00:52:44,081][123091] Updated weights for policy 0, policy_version 162378 (0.0010) [2023-12-26 00:52:44,148][123091] Updated weights for policy 0, policy_version 162388 (0.0009) [2023-12-26 00:52:44,213][123091] Updated weights for policy 0, policy_version 162398 (0.0008) [2023-12-26 00:52:44,433][123090] Updated weights for policy 1, policy_version 161669 (0.0007) [2023-12-26 00:52:44,497][123090] Updated weights for policy 1, policy_version 161679 (0.0010) [2023-12-26 00:52:44,563][123090] Updated weights for policy 1, policy_version 161689 (0.0010) [2023-12-26 00:52:44,944][123091] Updated weights for policy 0, policy_version 162408 (0.0006) [2023-12-26 00:52:44,994][123091] Updated weights for policy 0, policy_version 162418 (0.0006) [2023-12-26 00:52:45,048][123091] Updated weights for policy 0, policy_version 162428 (0.0007) [2023-12-26 00:52:45,366][123090] Updated weights for policy 1, policy_version 161699 (0.0011) [2023-12-26 00:52:45,428][123090] Updated weights for policy 1, policy_version 161709 (0.0011) [2023-12-26 00:52:45,488][123090] Updated weights for policy 1, policy_version 161719 (0.0011) [2023-12-26 00:52:45,795][123091] Updated weights for policy 0, policy_version 162438 (0.0008) [2023-12-26 00:52:45,850][123091] Updated weights for policy 0, policy_version 162448 (0.0006) [2023-12-26 00:52:45,916][123091] Updated weights for policy 0, policy_version 162458 (0.0006) [2023-12-26 00:52:46,328][123090] Updated weights for policy 1, policy_version 161729 (0.0010) [2023-12-26 00:52:46,384][123090] Updated weights for policy 1, policy_version 161739 (0.0010) [2023-12-26 00:52:46,439][123090] Updated weights for policy 1, policy_version 161749 (0.0010) [2023-12-26 00:52:46,503][123090] Updated weights for policy 1, policy_version 161759 (0.0010) [2023-12-26 00:52:46,586][123091] Updated weights for policy 0, policy_version 162468 (0.0006) [2023-12-26 00:52:46,649][123091] Updated weights for policy 0, policy_version 162478 (0.0008) [2023-12-26 00:52:46,712][123091] Updated weights for policy 0, policy_version 162488 (0.0007) [2023-12-26 00:52:47,295][123090] Updated weights for policy 1, policy_version 161769 (0.0006) [2023-12-26 00:52:47,349][123090] Updated weights for policy 1, policy_version 161779 (0.0009) [2023-12-26 00:52:47,399][123090] Updated weights for policy 1, policy_version 161789 (0.0010) [2023-12-26 00:52:47,477][123091] Updated weights for policy 0, policy_version 162498 (0.0008) [2023-12-26 00:52:47,526][123091] Updated weights for policy 0, policy_version 162508 (0.0009) [2023-12-26 00:52:47,573][123091] Updated weights for policy 0, policy_version 162518 (0.0009) [2023-12-26 00:52:48,230][123090] Updated weights for policy 1, policy_version 161799 (0.0010) [2023-12-26 00:52:48,296][123090] Updated weights for policy 1, policy_version 161809 (0.0010) [2023-12-26 00:52:48,358][123090] Updated weights for policy 1, policy_version 161819 (0.0009) [2023-12-26 00:52:48,438][123091] Updated weights for policy 0, policy_version 162529 (0.0009) [2023-12-26 00:52:48,491][123091] Updated weights for policy 0, policy_version 162539 (0.0009) [2023-12-26 00:52:48,551][123091] Updated weights for policy 0, policy_version 162549 (0.0009) [2023-12-26 00:52:48,616][123091] Updated weights for policy 0, policy_version 162559 (0.0009) [2023-12-26 00:52:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 83042304. Throughput: 0: 9027.5, 1: 9013.2. Samples: 83051416. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:48,785][121949] Avg episode reward: [(0, '5802.765'), (1, '5431.740')] [2023-12-26 00:52:49,177][123090] Updated weights for policy 1, policy_version 161829 (0.0010) [2023-12-26 00:52:49,239][123090] Updated weights for policy 1, policy_version 161839 (0.0010) [2023-12-26 00:52:49,313][123090] Updated weights for policy 1, policy_version 161849 (0.0010) [2023-12-26 00:52:49,446][123091] Updated weights for policy 0, policy_version 162569 (0.0008) [2023-12-26 00:52:49,497][123091] Updated weights for policy 0, policy_version 162579 (0.0008) [2023-12-26 00:52:49,551][123091] Updated weights for policy 0, policy_version 162589 (0.0007) [2023-12-26 00:52:50,170][123090] Updated weights for policy 1, policy_version 161859 (0.0008) [2023-12-26 00:52:50,223][123090] Updated weights for policy 1, policy_version 161869 (0.0005) [2023-12-26 00:52:50,260][123091] Updated weights for policy 0, policy_version 162599 (0.0006) [2023-12-26 00:52:50,289][123090] Updated weights for policy 1, policy_version 161879 (0.0006) [2023-12-26 00:52:50,320][123091] Updated weights for policy 0, policy_version 162609 (0.0010) [2023-12-26 00:52:50,374][123091] Updated weights for policy 0, policy_version 162619 (0.0009) [2023-12-26 00:52:51,058][123090] Updated weights for policy 1, policy_version 161889 (0.0008) [2023-12-26 00:52:51,129][123090] Updated weights for policy 1, policy_version 161899 (0.0010) [2023-12-26 00:52:51,180][123090] Updated weights for policy 1, policy_version 161909 (0.0009) [2023-12-26 00:52:51,217][123091] Updated weights for policy 0, policy_version 162629 (0.0010) [2023-12-26 00:52:51,242][123090] Updated weights for policy 1, policy_version 161919 (0.0009) [2023-12-26 00:52:51,275][123091] Updated weights for policy 0, policy_version 162639 (0.0008) [2023-12-26 00:52:51,345][123091] Updated weights for policy 0, policy_version 162649 (0.0010) [2023-12-26 00:52:52,045][123090] Updated weights for policy 1, policy_version 161929 (0.0009) [2023-12-26 00:52:52,095][123090] Updated weights for policy 1, policy_version 161939 (0.0009) [2023-12-26 00:52:52,150][123090] Updated weights for policy 1, policy_version 161949 (0.0010) [2023-12-26 00:52:52,209][123091] Updated weights for policy 0, policy_version 162659 (0.0010) [2023-12-26 00:52:52,266][123091] Updated weights for policy 0, policy_version 162669 (0.0008) [2023-12-26 00:52:52,335][123091] Updated weights for policy 0, policy_version 162679 (0.0010) [2023-12-26 00:52:53,019][123090] Updated weights for policy 1, policy_version 161959 (0.0010) [2023-12-26 00:52:53,080][123090] Updated weights for policy 1, policy_version 161969 (0.0009) [2023-12-26 00:52:53,131][123090] Updated weights for policy 1, policy_version 161979 (0.0010) [2023-12-26 00:52:53,206][123091] Updated weights for policy 0, policy_version 162689 (0.0009) [2023-12-26 00:52:53,272][123091] Updated weights for policy 0, policy_version 162699 (0.0011) [2023-12-26 00:52:53,349][123091] Updated weights for policy 0, policy_version 162709 (0.0011) [2023-12-26 00:52:53,422][123091] Updated weights for policy 0, policy_version 162719 (0.0011) [2023-12-26 00:52:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 83124224. Throughput: 0: 8987.9, 1: 8988.7. Samples: 83103720. Policy #0 lag: (min: 31.0, avg: 53.5, max: 56.0) [2023-12-26 00:52:53,785][121949] Avg episode reward: [(0, '5682.449'), (1, '5454.775')] [2023-12-26 00:52:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000161984_41467904.pth... [2023-12-26 00:52:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000162720_41656320.pth... [2023-12-26 00:52:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000161664_41385984.pth [2023-12-26 00:52:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000160928_41197568.pth [2023-12-26 00:52:53,939][123090] Updated weights for policy 1, policy_version 161990 (0.0011) [2023-12-26 00:52:53,992][123090] Updated weights for policy 1, policy_version 162000 (0.0009) [2023-12-26 00:52:54,050][123090] Updated weights for policy 1, policy_version 162010 (0.0009) [2023-12-26 00:52:54,169][123091] Updated weights for policy 0, policy_version 162729 (0.0010) [2023-12-26 00:52:54,229][123091] Updated weights for policy 0, policy_version 162739 (0.0009) [2023-12-26 00:52:54,284][123091] Updated weights for policy 0, policy_version 162749 (0.0009) [2023-12-26 00:52:54,821][123090] Updated weights for policy 1, policy_version 162021 (0.0011) [2023-12-26 00:52:54,889][123090] Updated weights for policy 1, policy_version 162031 (0.0010) [2023-12-26 00:52:54,954][123090] Updated weights for policy 1, policy_version 162041 (0.0009) [2023-12-26 00:52:55,046][123091] Updated weights for policy 0, policy_version 162759 (0.0006) [2023-12-26 00:52:55,102][123091] Updated weights for policy 0, policy_version 162769 (0.0005) [2023-12-26 00:52:55,172][123091] Updated weights for policy 0, policy_version 162779 (0.0005) [2023-12-26 00:52:55,786][123091] Updated weights for policy 0, policy_version 162789 (0.0007) [2023-12-26 00:52:55,826][123090] Updated weights for policy 1, policy_version 162051 (0.0009) [2023-12-26 00:52:55,836][123091] Updated weights for policy 0, policy_version 162799 (0.0009) [2023-12-26 00:52:55,886][123091] Updated weights for policy 0, policy_version 162809 (0.0008) [2023-12-26 00:52:55,888][123090] Updated weights for policy 1, policy_version 162061 (0.0008) [2023-12-26 00:52:55,936][123090] Updated weights for policy 1, policy_version 162071 (0.0008) [2023-12-26 00:52:56,580][123090] Updated weights for policy 1, policy_version 162081 (0.0009) [2023-12-26 00:52:56,639][123090] Updated weights for policy 1, policy_version 162091 (0.0005) [2023-12-26 00:52:56,702][123090] Updated weights for policy 1, policy_version 162101 (0.0005) [2023-12-26 00:52:56,761][123090] Updated weights for policy 1, policy_version 162111 (0.0005) [2023-12-26 00:52:56,797][123091] Updated weights for policy 0, policy_version 162819 (0.0007) [2023-12-26 00:52:56,868][123091] Updated weights for policy 0, policy_version 162829 (0.0010) [2023-12-26 00:52:56,925][123091] Updated weights for policy 0, policy_version 162839 (0.0010) [2023-12-26 00:52:57,421][123090] Updated weights for policy 1, policy_version 162121 (0.0009) [2023-12-26 00:52:57,475][123090] Updated weights for policy 1, policy_version 162131 (0.0009) [2023-12-26 00:52:57,527][123090] Updated weights for policy 1, policy_version 162141 (0.0009) [2023-12-26 00:52:57,757][123091] Updated weights for policy 0, policy_version 162849 (0.0009) [2023-12-26 00:52:57,821][123091] Updated weights for policy 0, policy_version 162859 (0.0010) [2023-12-26 00:52:57,872][123091] Updated weights for policy 0, policy_version 162869 (0.0009) [2023-12-26 00:52:57,930][123091] Updated weights for policy 0, policy_version 162879 (0.0008) [2023-12-26 00:52:58,359][123090] Updated weights for policy 1, policy_version 162151 (0.0008) [2023-12-26 00:52:58,432][123090] Updated weights for policy 1, policy_version 162161 (0.0007) [2023-12-26 00:52:58,503][123090] Updated weights for policy 1, policy_version 162171 (0.0008) [2023-12-26 00:52:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 83214336. Throughput: 0: 8942.3, 1: 9031.8. Samples: 83209908. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:52:58,785][121949] Avg episode reward: [(0, '5698.013'), (1, '5520.638')] [2023-12-26 00:52:58,861][123091] Updated weights for policy 0, policy_version 162889 (0.0007) [2023-12-26 00:52:58,930][123091] Updated weights for policy 0, policy_version 162899 (0.0005) [2023-12-26 00:52:59,007][123091] Updated weights for policy 0, policy_version 162909 (0.0006) [2023-12-26 00:52:59,210][123090] Updated weights for policy 1, policy_version 162181 (0.0006) [2023-12-26 00:52:59,279][123090] Updated weights for policy 1, policy_version 162191 (0.0010) [2023-12-26 00:52:59,342][123090] Updated weights for policy 1, policy_version 162201 (0.0009) [2023-12-26 00:52:59,731][123091] Updated weights for policy 0, policy_version 162919 (0.0005) [2023-12-26 00:52:59,797][123091] Updated weights for policy 0, policy_version 162929 (0.0005) [2023-12-26 00:52:59,870][123091] Updated weights for policy 0, policy_version 162939 (0.0008) [2023-12-26 00:53:00,173][123090] Updated weights for policy 1, policy_version 162211 (0.0007) [2023-12-26 00:53:00,226][123090] Updated weights for policy 1, policy_version 162221 (0.0010) [2023-12-26 00:53:00,282][123090] Updated weights for policy 1, policy_version 162231 (0.0009) [2023-12-26 00:53:00,425][123091] Updated weights for policy 0, policy_version 162949 (0.0010) [2023-12-26 00:53:00,491][123091] Updated weights for policy 0, policy_version 162959 (0.0011) [2023-12-26 00:53:00,561][123091] Updated weights for policy 0, policy_version 162969 (0.0011) [2023-12-26 00:53:00,919][123090] Updated weights for policy 1, policy_version 162241 (0.0010) [2023-12-26 00:53:00,973][123090] Updated weights for policy 1, policy_version 162251 (0.0006) [2023-12-26 00:53:01,029][123090] Updated weights for policy 1, policy_version 162261 (0.0006) [2023-12-26 00:53:01,095][123090] Updated weights for policy 1, policy_version 162271 (0.0007) [2023-12-26 00:53:01,366][123091] Updated weights for policy 0, policy_version 162979 (0.0010) [2023-12-26 00:53:01,437][123091] Updated weights for policy 0, policy_version 162989 (0.0006) [2023-12-26 00:53:01,506][123091] Updated weights for policy 0, policy_version 162999 (0.0006) [2023-12-26 00:53:01,888][123090] Updated weights for policy 1, policy_version 162281 (0.0008) [2023-12-26 00:53:01,949][123090] Updated weights for policy 1, policy_version 162291 (0.0008) [2023-12-26 00:53:02,014][123090] Updated weights for policy 1, policy_version 162301 (0.0008) [2023-12-26 00:53:02,222][123091] Updated weights for policy 0, policy_version 163009 (0.0005) [2023-12-26 00:53:02,293][123091] Updated weights for policy 0, policy_version 163019 (0.0007) [2023-12-26 00:53:02,363][123091] Updated weights for policy 0, policy_version 163029 (0.0009) [2023-12-26 00:53:02,428][123091] Updated weights for policy 0, policy_version 163039 (0.0006) [2023-12-26 00:53:02,748][123090] Updated weights for policy 1, policy_version 162311 (0.0010) [2023-12-26 00:53:02,808][123090] Updated weights for policy 1, policy_version 162321 (0.0007) [2023-12-26 00:53:02,861][123090] Updated weights for policy 1, policy_version 162331 (0.0007) [2023-12-26 00:53:03,145][123091] Updated weights for policy 0, policy_version 163049 (0.0005) [2023-12-26 00:53:03,190][123091] Updated weights for policy 0, policy_version 163059 (0.0005) [2023-12-26 00:53:03,235][123091] Updated weights for policy 0, policy_version 163069 (0.0005) [2023-12-26 00:53:03,708][123090] Updated weights for policy 1, policy_version 162341 (0.0010) [2023-12-26 00:53:03,773][123090] Updated weights for policy 1, policy_version 162351 (0.0010) [2023-12-26 00:53:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 83304448. Throughput: 0: 8988.1, 1: 8994.3. Samples: 83320412. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:03,784][121949] Avg episode reward: [(0, '5532.119'), (1, '5435.607')] [2023-12-26 00:53:03,844][123090] Updated weights for policy 1, policy_version 162361 (0.0006) [2023-12-26 00:53:03,880][123091] Updated weights for policy 0, policy_version 163079 (0.0006) [2023-12-26 00:53:03,947][123091] Updated weights for policy 0, policy_version 163089 (0.0006) [2023-12-26 00:53:04,013][123091] Updated weights for policy 0, policy_version 163099 (0.0006) [2023-12-26 00:53:04,598][123090] Updated weights for policy 1, policy_version 162371 (0.0008) [2023-12-26 00:53:04,663][123090] Updated weights for policy 1, policy_version 162381 (0.0008) [2023-12-26 00:53:04,713][123091] Updated weights for policy 0, policy_version 163109 (0.0008) [2023-12-26 00:53:04,728][123090] Updated weights for policy 1, policy_version 162391 (0.0009) [2023-12-26 00:53:04,765][123091] Updated weights for policy 0, policy_version 163119 (0.0007) [2023-12-26 00:53:04,817][123091] Updated weights for policy 0, policy_version 163129 (0.0008) [2023-12-26 00:53:05,440][123090] Updated weights for policy 1, policy_version 162401 (0.0010) [2023-12-26 00:53:05,487][123090] Updated weights for policy 1, policy_version 162411 (0.0005) [2023-12-26 00:53:05,554][123090] Updated weights for policy 1, policy_version 162421 (0.0006) [2023-12-26 00:53:05,608][123091] Updated weights for policy 0, policy_version 163139 (0.0009) [2023-12-26 00:53:05,615][123090] Updated weights for policy 1, policy_version 162431 (0.0010) [2023-12-26 00:53:05,660][123091] Updated weights for policy 0, policy_version 163149 (0.0008) [2023-12-26 00:53:05,715][123091] Updated weights for policy 0, policy_version 163159 (0.0008) [2023-12-26 00:53:06,409][123090] Updated weights for policy 1, policy_version 162441 (0.0009) [2023-12-26 00:53:06,478][123090] Updated weights for policy 1, policy_version 162451 (0.0009) [2023-12-26 00:53:06,550][123090] Updated weights for policy 1, policy_version 162461 (0.0008) [2023-12-26 00:53:06,577][123091] Updated weights for policy 0, policy_version 163169 (0.0009) [2023-12-26 00:53:06,647][123091] Updated weights for policy 0, policy_version 163179 (0.0010) [2023-12-26 00:53:06,718][123091] Updated weights for policy 0, policy_version 163189 (0.0010) [2023-12-26 00:53:06,781][123091] Updated weights for policy 0, policy_version 163199 (0.0010) [2023-12-26 00:53:07,380][123090] Updated weights for policy 1, policy_version 162471 (0.0009) [2023-12-26 00:53:07,444][123090] Updated weights for policy 1, policy_version 162481 (0.0009) [2023-12-26 00:53:07,506][123090] Updated weights for policy 1, policy_version 162491 (0.0009) [2023-12-26 00:53:07,512][123091] Updated weights for policy 0, policy_version 163209 (0.0006) [2023-12-26 00:53:07,587][123091] Updated weights for policy 0, policy_version 163219 (0.0005) [2023-12-26 00:53:07,664][123091] Updated weights for policy 0, policy_version 163229 (0.0006) [2023-12-26 00:53:08,387][123090] Updated weights for policy 1, policy_version 162501 (0.0009) [2023-12-26 00:53:08,405][123091] Updated weights for policy 0, policy_version 163239 (0.0010) [2023-12-26 00:53:08,443][123090] Updated weights for policy 1, policy_version 162511 (0.0008) [2023-12-26 00:53:08,461][123091] Updated weights for policy 0, policy_version 163249 (0.0010) [2023-12-26 00:53:08,500][123090] Updated weights for policy 1, policy_version 162521 (0.0008) [2023-12-26 00:53:08,514][123091] Updated weights for policy 0, policy_version 163259 (0.0010) [2023-12-26 00:53:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 83402752. Throughput: 0: 9043.5, 1: 9010.3. Samples: 83374564. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:08,785][121949] Avg episode reward: [(0, '5432.034'), (1, '5511.284')] [2023-12-26 00:53:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000163264_41795584.pth... [2023-12-26 00:53:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000162528_41607168.pth... [2023-12-26 00:53:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000162208_41525248.pth [2023-12-26 00:53:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000161504_41345024.pth [2023-12-26 00:53:09,351][123091] Updated weights for policy 0, policy_version 163269 (0.0011) [2023-12-26 00:53:09,354][123090] Updated weights for policy 1, policy_version 162531 (0.0007) [2023-12-26 00:53:09,419][123091] Updated weights for policy 0, policy_version 163279 (0.0010) [2023-12-26 00:53:09,421][123090] Updated weights for policy 1, policy_version 162541 (0.0009) [2023-12-26 00:53:09,485][123091] Updated weights for policy 0, policy_version 163289 (0.0009) [2023-12-26 00:53:09,485][123090] Updated weights for policy 1, policy_version 162551 (0.0008) [2023-12-26 00:53:10,256][123091] Updated weights for policy 0, policy_version 163299 (0.0009) [2023-12-26 00:53:10,312][123091] Updated weights for policy 0, policy_version 163309 (0.0009) [2023-12-26 00:53:10,341][123090] Updated weights for policy 1, policy_version 162561 (0.0009) [2023-12-26 00:53:10,382][123091] Updated weights for policy 0, policy_version 163319 (0.0008) [2023-12-26 00:53:10,405][123090] Updated weights for policy 1, policy_version 162571 (0.0010) [2023-12-26 00:53:10,468][123090] Updated weights for policy 1, policy_version 162581 (0.0010) [2023-12-26 00:53:10,527][123090] Updated weights for policy 1, policy_version 162591 (0.0010) [2023-12-26 00:53:11,222][123091] Updated weights for policy 0, policy_version 163329 (0.0008) [2023-12-26 00:53:11,290][123091] Updated weights for policy 0, policy_version 163339 (0.0009) [2023-12-26 00:53:11,316][123090] Updated weights for policy 1, policy_version 162601 (0.0008) [2023-12-26 00:53:11,356][123091] Updated weights for policy 0, policy_version 163349 (0.0009) [2023-12-26 00:53:11,389][123090] Updated weights for policy 1, policy_version 162611 (0.0009) [2023-12-26 00:53:11,426][123091] Updated weights for policy 0, policy_version 163359 (0.0009) [2023-12-26 00:53:11,456][123090] Updated weights for policy 1, policy_version 162621 (0.0008) [2023-12-26 00:53:12,197][123091] Updated weights for policy 0, policy_version 163369 (0.0007) [2023-12-26 00:53:12,259][123091] Updated weights for policy 0, policy_version 163379 (0.0008) [2023-12-26 00:53:12,325][123091] Updated weights for policy 0, policy_version 163389 (0.0010) [2023-12-26 00:53:12,332][123090] Updated weights for policy 1, policy_version 162631 (0.0008) [2023-12-26 00:53:12,403][123090] Updated weights for policy 1, policy_version 162641 (0.0007) [2023-12-26 00:53:12,478][123090] Updated weights for policy 1, policy_version 162651 (0.0007) [2023-12-26 00:53:13,158][123091] Updated weights for policy 0, policy_version 163399 (0.0010) [2023-12-26 00:53:13,183][123090] Updated weights for policy 1, policy_version 162661 (0.0007) [2023-12-26 00:53:13,217][123091] Updated weights for policy 0, policy_version 163409 (0.0008) [2023-12-26 00:53:13,245][123090] Updated weights for policy 1, policy_version 162671 (0.0009) [2023-12-26 00:53:13,275][123091] Updated weights for policy 0, policy_version 163419 (0.0009) [2023-12-26 00:53:13,295][123090] Updated weights for policy 1, policy_version 162681 (0.0005) [2023-12-26 00:53:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 83484672. Throughput: 0: 9011.0, 1: 8869.9. Samples: 83477236. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:13,784][121949] Avg episode reward: [(0, '5553.868'), (1, '5416.943')] [2023-12-26 00:53:14,042][123090] Updated weights for policy 1, policy_version 162691 (0.0005) [2023-12-26 00:53:14,093][123090] Updated weights for policy 1, policy_version 162701 (0.0005) [2023-12-26 00:53:14,098][123091] Updated weights for policy 0, policy_version 163429 (0.0009) [2023-12-26 00:53:14,147][123090] Updated weights for policy 1, policy_version 162711 (0.0005) [2023-12-26 00:53:14,155][123091] Updated weights for policy 0, policy_version 163439 (0.0008) [2023-12-26 00:53:14,210][123091] Updated weights for policy 0, policy_version 163449 (0.0009) [2023-12-26 00:53:14,860][123090] Updated weights for policy 1, policy_version 162721 (0.0006) [2023-12-26 00:53:14,932][123090] Updated weights for policy 1, policy_version 162731 (0.0010) [2023-12-26 00:53:14,996][123090] Updated weights for policy 1, policy_version 162741 (0.0010) [2023-12-26 00:53:15,030][123091] Updated weights for policy 0, policy_version 163459 (0.0009) [2023-12-26 00:53:15,053][123090] Updated weights for policy 1, policy_version 162751 (0.0010) [2023-12-26 00:53:15,092][123091] Updated weights for policy 0, policy_version 163469 (0.0008) [2023-12-26 00:53:15,157][123091] Updated weights for policy 0, policy_version 163479 (0.0009) [2023-12-26 00:53:15,861][123090] Updated weights for policy 1, policy_version 162761 (0.0010) [2023-12-26 00:53:15,919][123090] Updated weights for policy 1, policy_version 162771 (0.0008) [2023-12-26 00:53:15,980][123090] Updated weights for policy 1, policy_version 162781 (0.0008) [2023-12-26 00:53:16,022][123091] Updated weights for policy 0, policy_version 163489 (0.0009) [2023-12-26 00:53:16,084][123091] Updated weights for policy 0, policy_version 163499 (0.0010) [2023-12-26 00:53:16,139][123091] Updated weights for policy 0, policy_version 163509 (0.0010) [2023-12-26 00:53:16,193][123091] Updated weights for policy 0, policy_version 163519 (0.0010) [2023-12-26 00:53:16,772][123090] Updated weights for policy 1, policy_version 162791 (0.0009) [2023-12-26 00:53:16,844][123090] Updated weights for policy 1, policy_version 162801 (0.0010) [2023-12-26 00:53:16,909][123090] Updated weights for policy 1, policy_version 162811 (0.0010) [2023-12-26 00:53:16,997][123091] Updated weights for policy 0, policy_version 163529 (0.0009) [2023-12-26 00:53:17,046][123091] Updated weights for policy 0, policy_version 163539 (0.0009) [2023-12-26 00:53:17,094][123091] Updated weights for policy 0, policy_version 163549 (0.0008) [2023-12-26 00:53:17,701][123090] Updated weights for policy 1, policy_version 162821 (0.0010) [2023-12-26 00:53:17,760][123090] Updated weights for policy 1, policy_version 162831 (0.0010) [2023-12-26 00:53:17,820][123090] Updated weights for policy 1, policy_version 162841 (0.0010) [2023-12-26 00:53:17,952][123091] Updated weights for policy 0, policy_version 163559 (0.0007) [2023-12-26 00:53:18,005][123091] Updated weights for policy 0, policy_version 163569 (0.0006) [2023-12-26 00:53:18,065][123091] Updated weights for policy 0, policy_version 163579 (0.0006) [2023-12-26 00:53:18,655][123090] Updated weights for policy 1, policy_version 162851 (0.0008) [2023-12-26 00:53:18,729][123090] Updated weights for policy 1, policy_version 162861 (0.0009) [2023-12-26 00:53:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 83566592. Throughput: 0: 8925.7, 1: 8845.0. Samples: 83584792. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:18,785][121949] Avg episode reward: [(0, '5544.376'), (1, '5268.535')] [2023-12-26 00:53:18,792][123090] Updated weights for policy 1, policy_version 162871 (0.0010) [2023-12-26 00:53:18,805][123091] Updated weights for policy 0, policy_version 163589 (0.0008) [2023-12-26 00:53:18,858][123091] Updated weights for policy 0, policy_version 163599 (0.0011) [2023-12-26 00:53:18,910][123091] Updated weights for policy 0, policy_version 163609 (0.0010) [2023-12-26 00:53:19,601][123090] Updated weights for policy 1, policy_version 162881 (0.0010) [2023-12-26 00:53:19,662][123090] Updated weights for policy 1, policy_version 162891 (0.0006) [2023-12-26 00:53:19,722][123090] Updated weights for policy 1, policy_version 162901 (0.0010) [2023-12-26 00:53:19,792][123090] Updated weights for policy 1, policy_version 162911 (0.0006) [2023-12-26 00:53:19,798][123091] Updated weights for policy 0, policy_version 163619 (0.0010) [2023-12-26 00:53:19,873][123091] Updated weights for policy 0, policy_version 163629 (0.0009) [2023-12-26 00:53:19,944][123091] Updated weights for policy 0, policy_version 163639 (0.0010) [2023-12-26 00:53:20,535][123090] Updated weights for policy 1, policy_version 162921 (0.0006) [2023-12-26 00:53:20,598][123090] Updated weights for policy 1, policy_version 162931 (0.0007) [2023-12-26 00:53:20,659][123090] Updated weights for policy 1, policy_version 162941 (0.0008) [2023-12-26 00:53:20,771][123091] Updated weights for policy 0, policy_version 163649 (0.0010) [2023-12-26 00:53:20,839][123091] Updated weights for policy 0, policy_version 163659 (0.0011) [2023-12-26 00:53:20,904][123091] Updated weights for policy 0, policy_version 163669 (0.0011) [2023-12-26 00:53:20,973][123091] Updated weights for policy 0, policy_version 163679 (0.0011) [2023-12-26 00:53:21,472][123090] Updated weights for policy 1, policy_version 162951 (0.0007) [2023-12-26 00:53:21,529][123090] Updated weights for policy 1, policy_version 162961 (0.0010) [2023-12-26 00:53:21,594][123090] Updated weights for policy 1, policy_version 162972 (0.0010) [2023-12-26 00:53:21,771][123091] Updated weights for policy 0, policy_version 163689 (0.0008) [2023-12-26 00:53:21,838][123091] Updated weights for policy 0, policy_version 163699 (0.0008) [2023-12-26 00:53:21,902][123091] Updated weights for policy 0, policy_version 163709 (0.0010) [2023-12-26 00:53:22,433][123090] Updated weights for policy 1, policy_version 162982 (0.0010) [2023-12-26 00:53:22,503][123090] Updated weights for policy 1, policy_version 162992 (0.0009) [2023-12-26 00:53:22,566][123090] Updated weights for policy 1, policy_version 163002 (0.0006) [2023-12-26 00:53:22,763][123091] Updated weights for policy 0, policy_version 163719 (0.0010) [2023-12-26 00:53:22,808][123091] Updated weights for policy 0, policy_version 163729 (0.0007) [2023-12-26 00:53:22,861][123091] Updated weights for policy 0, policy_version 163739 (0.0005) [2023-12-26 00:53:23,340][123090] Updated weights for policy 1, policy_version 163012 (0.0006) [2023-12-26 00:53:23,395][123090] Updated weights for policy 1, policy_version 163022 (0.0005) [2023-12-26 00:53:23,453][123090] Updated weights for policy 1, policy_version 163032 (0.0005) [2023-12-26 00:53:23,706][123091] Updated weights for policy 0, policy_version 163749 (0.0008) [2023-12-26 00:53:23,764][123091] Updated weights for policy 0, policy_version 163759 (0.0010) [2023-12-26 00:53:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 83656704. Throughput: 0: 8855.8, 1: 8819.3. Samples: 83635952. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:23,785][121949] Avg episode reward: [(0, '5421.272'), (1, '5240.677')] [2023-12-26 00:53:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000163040_41738240.pth... [2023-12-26 00:53:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000161984_41467904.pth [2023-12-26 00:53:23,822][123091] Updated weights for policy 0, policy_version 163769 (0.0009) [2023-12-26 00:53:23,859][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000163776_41926656.pth... [2023-12-26 00:53:23,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000162720_41656320.pth [2023-12-26 00:53:24,172][123090] Updated weights for policy 1, policy_version 163042 (0.0008) [2023-12-26 00:53:24,227][123090] Updated weights for policy 1, policy_version 163052 (0.0009) [2023-12-26 00:53:24,276][123090] Updated weights for policy 1, policy_version 163062 (0.0009) [2023-12-26 00:53:24,326][123090] Updated weights for policy 1, policy_version 163072 (0.0010) [2023-12-26 00:53:24,673][123091] Updated weights for policy 0, policy_version 163779 (0.0009) [2023-12-26 00:53:24,730][123091] Updated weights for policy 0, policy_version 163789 (0.0010) [2023-12-26 00:53:24,785][123091] Updated weights for policy 0, policy_version 163799 (0.0009) [2023-12-26 00:53:25,072][123090] Updated weights for policy 1, policy_version 163082 (0.0010) [2023-12-26 00:53:25,138][123090] Updated weights for policy 1, policy_version 163092 (0.0009) [2023-12-26 00:53:25,207][123090] Updated weights for policy 1, policy_version 163102 (0.0009) [2023-12-26 00:53:25,613][123091] Updated weights for policy 0, policy_version 163809 (0.0009) [2023-12-26 00:53:25,676][123091] Updated weights for policy 0, policy_version 163819 (0.0008) [2023-12-26 00:53:25,727][123091] Updated weights for policy 0, policy_version 163829 (0.0005) [2023-12-26 00:53:25,800][123091] Updated weights for policy 0, policy_version 163839 (0.0007) [2023-12-26 00:53:25,856][123090] Updated weights for policy 1, policy_version 163112 (0.0009) [2023-12-26 00:53:25,909][123090] Updated weights for policy 1, policy_version 163122 (0.0008) [2023-12-26 00:53:25,972][123090] Updated weights for policy 1, policy_version 163132 (0.0009) [2023-12-26 00:53:26,583][123091] Updated weights for policy 0, policy_version 163849 (0.0005) [2023-12-26 00:53:26,629][123091] Updated weights for policy 0, policy_version 163859 (0.0005) [2023-12-26 00:53:26,682][123091] Updated weights for policy 0, policy_version 163869 (0.0005) [2023-12-26 00:53:26,703][123090] Updated weights for policy 1, policy_version 163142 (0.0007) [2023-12-26 00:53:26,754][123090] Updated weights for policy 1, policy_version 163152 (0.0005) [2023-12-26 00:53:26,812][123090] Updated weights for policy 1, policy_version 163162 (0.0008) [2023-12-26 00:53:27,362][123091] Updated weights for policy 0, policy_version 163879 (0.0005) [2023-12-26 00:53:27,430][123091] Updated weights for policy 0, policy_version 163889 (0.0005) [2023-12-26 00:53:27,496][123091] Updated weights for policy 0, policy_version 163899 (0.0005) [2023-12-26 00:53:27,651][123090] Updated weights for policy 1, policy_version 163172 (0.0008) [2023-12-26 00:53:27,699][123090] Updated weights for policy 1, policy_version 163182 (0.0006) [2023-12-26 00:53:27,750][123090] Updated weights for policy 1, policy_version 163192 (0.0006) [2023-12-26 00:53:28,170][123091] Updated weights for policy 0, policy_version 163909 (0.0005) [2023-12-26 00:53:28,227][123091] Updated weights for policy 0, policy_version 163919 (0.0005) [2023-12-26 00:53:28,284][123091] Updated weights for policy 0, policy_version 163929 (0.0005) [2023-12-26 00:53:28,420][123090] Updated weights for policy 1, policy_version 163202 (0.0006) [2023-12-26 00:53:28,475][123090] Updated weights for policy 1, policy_version 163212 (0.0010) [2023-12-26 00:53:28,522][123090] Updated weights for policy 1, policy_version 163222 (0.0010) [2023-12-26 00:53:28,583][123090] Updated weights for policy 1, policy_version 163232 (0.0010) [2023-12-26 00:53:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 83755008. Throughput: 0: 8915.6, 1: 8932.6. Samples: 83744464. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:28,785][121949] Avg episode reward: [(0, '5324.851'), (1, '5269.700')] [2023-12-26 00:53:29,083][123091] Updated weights for policy 0, policy_version 163939 (0.0009) [2023-12-26 00:53:29,132][123091] Updated weights for policy 0, policy_version 163949 (0.0008) [2023-12-26 00:53:29,188][123091] Updated weights for policy 0, policy_version 163959 (0.0009) [2023-12-26 00:53:29,433][123090] Updated weights for policy 1, policy_version 163242 (0.0010) [2023-12-26 00:53:29,480][123090] Updated weights for policy 1, policy_version 163252 (0.0010) [2023-12-26 00:53:29,524][123090] Updated weights for policy 1, policy_version 163262 (0.0010) [2023-12-26 00:53:30,039][123091] Updated weights for policy 0, policy_version 163969 (0.0009) [2023-12-26 00:53:30,102][123091] Updated weights for policy 0, policy_version 163979 (0.0011) [2023-12-26 00:53:30,156][123091] Updated weights for policy 0, policy_version 163989 (0.0011) [2023-12-26 00:53:30,218][123091] Updated weights for policy 0, policy_version 163999 (0.0011) [2023-12-26 00:53:30,378][123090] Updated weights for policy 1, policy_version 163272 (0.0010) [2023-12-26 00:53:30,436][123090] Updated weights for policy 1, policy_version 163282 (0.0010) [2023-12-26 00:53:30,487][123090] Updated weights for policy 1, policy_version 163292 (0.0010) [2023-12-26 00:53:31,000][123091] Updated weights for policy 0, policy_version 164009 (0.0010) [2023-12-26 00:53:31,062][123091] Updated weights for policy 0, policy_version 164019 (0.0008) [2023-12-26 00:53:31,125][123091] Updated weights for policy 0, policy_version 164029 (0.0007) [2023-12-26 00:53:31,323][123090] Updated weights for policy 1, policy_version 163302 (0.0010) [2023-12-26 00:53:31,401][123090] Updated weights for policy 1, policy_version 163312 (0.0009) [2023-12-26 00:53:31,472][123090] Updated weights for policy 1, policy_version 163322 (0.0008) [2023-12-26 00:53:31,929][123091] Updated weights for policy 0, policy_version 164039 (0.0009) [2023-12-26 00:53:31,977][123091] Updated weights for policy 0, policy_version 164049 (0.0009) [2023-12-26 00:53:32,044][123091] Updated weights for policy 0, policy_version 164059 (0.0009) [2023-12-26 00:53:32,190][123090] Updated weights for policy 1, policy_version 163332 (0.0007) [2023-12-26 00:53:32,264][123090] Updated weights for policy 1, policy_version 163342 (0.0006) [2023-12-26 00:53:32,328][123090] Updated weights for policy 1, policy_version 163352 (0.0009) [2023-12-26 00:53:32,931][123091] Updated weights for policy 0, policy_version 164069 (0.0010) [2023-12-26 00:53:32,988][123091] Updated weights for policy 0, policy_version 164079 (0.0009) [2023-12-26 00:53:33,047][123091] Updated weights for policy 0, policy_version 164089 (0.0009) [2023-12-26 00:53:33,102][123090] Updated weights for policy 1, policy_version 163362 (0.0010) [2023-12-26 00:53:33,166][123090] Updated weights for policy 1, policy_version 163372 (0.0009) [2023-12-26 00:53:33,230][123090] Updated weights for policy 1, policy_version 163382 (0.0010) [2023-12-26 00:53:33,290][123090] Updated weights for policy 1, policy_version 163392 (0.0007) [2023-12-26 00:53:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 83836928. Throughput: 0: 8802.6, 1: 8959.0. Samples: 83850688. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:33,784][121949] Avg episode reward: [(0, '5513.498'), (1, '5426.404')] [2023-12-26 00:53:33,943][123091] Updated weights for policy 0, policy_version 164099 (0.0010) [2023-12-26 00:53:33,968][123090] Updated weights for policy 1, policy_version 163402 (0.0005) [2023-12-26 00:53:33,992][123091] Updated weights for policy 0, policy_version 164109 (0.0007) [2023-12-26 00:53:34,024][123090] Updated weights for policy 1, policy_version 163412 (0.0010) [2023-12-26 00:53:34,051][123091] Updated weights for policy 0, policy_version 164119 (0.0006) [2023-12-26 00:53:34,071][123090] Updated weights for policy 1, policy_version 163422 (0.0010) [2023-12-26 00:53:34,827][123090] Updated weights for policy 1, policy_version 163432 (0.0006) [2023-12-26 00:53:34,832][123091] Updated weights for policy 0, policy_version 164129 (0.0008) [2023-12-26 00:53:34,889][123090] Updated weights for policy 1, policy_version 163442 (0.0005) [2023-12-26 00:53:34,892][123091] Updated weights for policy 0, policy_version 164139 (0.0007) [2023-12-26 00:53:34,942][123090] Updated weights for policy 1, policy_version 163452 (0.0007) [2023-12-26 00:53:34,953][123091] Updated weights for policy 0, policy_version 164149 (0.0009) [2023-12-26 00:53:35,018][123091] Updated weights for policy 0, policy_version 164159 (0.0009) [2023-12-26 00:53:35,684][123090] Updated weights for policy 1, policy_version 163462 (0.0006) [2023-12-26 00:53:35,753][123090] Updated weights for policy 1, policy_version 163472 (0.0006) [2023-12-26 00:53:35,805][123090] Updated weights for policy 1, policy_version 163482 (0.0008) [2023-12-26 00:53:35,816][123091] Updated weights for policy 0, policy_version 164169 (0.0006) [2023-12-26 00:53:35,884][123091] Updated weights for policy 0, policy_version 164179 (0.0006) [2023-12-26 00:53:35,950][123091] Updated weights for policy 0, policy_version 164189 (0.0005) [2023-12-26 00:53:36,451][123090] Updated weights for policy 1, policy_version 163492 (0.0007) [2023-12-26 00:53:36,514][123090] Updated weights for policy 1, policy_version 163502 (0.0011) [2023-12-26 00:53:36,574][123090] Updated weights for policy 1, policy_version 163512 (0.0011) [2023-12-26 00:53:36,659][123091] Updated weights for policy 0, policy_version 164199 (0.0009) [2023-12-26 00:53:36,727][123091] Updated weights for policy 0, policy_version 164209 (0.0011) [2023-12-26 00:53:36,793][123091] Updated weights for policy 0, policy_version 164219 (0.0011) [2023-12-26 00:53:37,415][123090] Updated weights for policy 1, policy_version 163522 (0.0010) [2023-12-26 00:53:37,471][123090] Updated weights for policy 1, policy_version 163532 (0.0010) [2023-12-26 00:53:37,480][123091] Updated weights for policy 0, policy_version 164229 (0.0008) [2023-12-26 00:53:37,534][123090] Updated weights for policy 1, policy_version 163542 (0.0010) [2023-12-26 00:53:37,547][123091] Updated weights for policy 0, policy_version 164239 (0.0006) [2023-12-26 00:53:37,608][123090] Updated weights for policy 1, policy_version 163552 (0.0010) [2023-12-26 00:53:37,618][123091] Updated weights for policy 0, policy_version 164249 (0.0005) [2023-12-26 00:53:38,279][123091] Updated weights for policy 0, policy_version 164259 (0.0005) [2023-12-26 00:53:38,354][123091] Updated weights for policy 0, policy_version 164269 (0.0007) [2023-12-26 00:53:38,414][123091] Updated weights for policy 0, policy_version 164279 (0.0011) [2023-12-26 00:53:38,424][123090] Updated weights for policy 1, policy_version 163562 (0.0011) [2023-12-26 00:53:38,481][123090] Updated weights for policy 1, policy_version 163572 (0.0011) [2023-12-26 00:53:38,553][123090] Updated weights for policy 1, policy_version 163582 (0.0011) [2023-12-26 00:53:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 83935232. Throughput: 0: 8840.4, 1: 9020.3. Samples: 83907452. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:38,785][121949] Avg episode reward: [(0, '5319.458'), (1, '5299.521')] [2023-12-26 00:53:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000164288_42057728.pth... [2023-12-26 00:53:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000163584_41877504.pth... [2023-12-26 00:53:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000163264_41795584.pth [2023-12-26 00:53:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000162528_41607168.pth [2023-12-26 00:53:39,223][123091] Updated weights for policy 0, policy_version 164289 (0.0011) [2023-12-26 00:53:39,291][123091] Updated weights for policy 0, policy_version 164299 (0.0011) [2023-12-26 00:53:39,351][123090] Updated weights for policy 1, policy_version 163592 (0.0010) [2023-12-26 00:53:39,358][123091] Updated weights for policy 0, policy_version 164309 (0.0011) [2023-12-26 00:53:39,420][123091] Updated weights for policy 0, policy_version 164319 (0.0010) [2023-12-26 00:53:39,423][123090] Updated weights for policy 1, policy_version 163602 (0.0011) [2023-12-26 00:53:39,488][123090] Updated weights for policy 1, policy_version 163612 (0.0011) [2023-12-26 00:53:40,257][123091] Updated weights for policy 0, policy_version 164329 (0.0009) [2023-12-26 00:53:40,326][123091] Updated weights for policy 0, policy_version 164339 (0.0009) [2023-12-26 00:53:40,333][123090] Updated weights for policy 1, policy_version 163622 (0.0008) [2023-12-26 00:53:40,383][123091] Updated weights for policy 0, policy_version 164349 (0.0009) [2023-12-26 00:53:40,401][123090] Updated weights for policy 1, policy_version 163632 (0.0010) [2023-12-26 00:53:40,471][123090] Updated weights for policy 1, policy_version 163642 (0.0011) [2023-12-26 00:53:41,198][123091] Updated weights for policy 0, policy_version 164359 (0.0010) [2023-12-26 00:53:41,267][123091] Updated weights for policy 0, policy_version 164369 (0.0011) [2023-12-26 00:53:41,278][123090] Updated weights for policy 1, policy_version 163652 (0.0009) [2023-12-26 00:53:41,336][123091] Updated weights for policy 0, policy_version 164379 (0.0007) [2023-12-26 00:53:41,344][123090] Updated weights for policy 1, policy_version 163662 (0.0009) [2023-12-26 00:53:41,421][123090] Updated weights for policy 1, policy_version 163672 (0.0009) [2023-12-26 00:53:42,113][123091] Updated weights for policy 0, policy_version 164389 (0.0009) [2023-12-26 00:53:42,172][123091] Updated weights for policy 0, policy_version 164399 (0.0009) [2023-12-26 00:53:42,223][123091] Updated weights for policy 0, policy_version 164409 (0.0010) [2023-12-26 00:53:42,301][123090] Updated weights for policy 1, policy_version 163682 (0.0010) [2023-12-26 00:53:42,361][123090] Updated weights for policy 1, policy_version 163692 (0.0008) [2023-12-26 00:53:42,421][123090] Updated weights for policy 1, policy_version 163702 (0.0007) [2023-12-26 00:53:42,475][123090] Updated weights for policy 1, policy_version 163712 (0.0006) [2023-12-26 00:53:43,046][123091] Updated weights for policy 0, policy_version 164419 (0.0009) [2023-12-26 00:53:43,094][123091] Updated weights for policy 0, policy_version 164429 (0.0008) [2023-12-26 00:53:43,140][123091] Updated weights for policy 0, policy_version 164439 (0.0008) [2023-12-26 00:53:43,172][123090] Updated weights for policy 1, policy_version 163722 (0.0010) [2023-12-26 00:53:43,229][123090] Updated weights for policy 1, policy_version 163732 (0.0010) [2023-12-26 00:53:43,281][123090] Updated weights for policy 1, policy_version 163742 (0.0009) [2023-12-26 00:53:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 84017152. Throughput: 0: 8888.2, 1: 8952.5. Samples: 84012740. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:43,785][121949] Avg episode reward: [(0, '5023.723'), (1, '5260.454')] [2023-12-26 00:53:44,015][123090] Updated weights for policy 1, policy_version 163752 (0.0007) [2023-12-26 00:53:44,050][123091] Updated weights for policy 0, policy_version 164449 (0.0006) [2023-12-26 00:53:44,072][123090] Updated weights for policy 1, policy_version 163762 (0.0009) [2023-12-26 00:53:44,105][123091] Updated weights for policy 0, policy_version 164459 (0.0005) [2023-12-26 00:53:44,133][123090] Updated weights for policy 1, policy_version 163772 (0.0008) [2023-12-26 00:53:44,166][123091] Updated weights for policy 0, policy_version 164469 (0.0006) [2023-12-26 00:53:44,225][123091] Updated weights for policy 0, policy_version 164479 (0.0007) [2023-12-26 00:53:44,896][123091] Updated weights for policy 0, policy_version 164489 (0.0010) [2023-12-26 00:53:44,962][123091] Updated weights for policy 0, policy_version 164499 (0.0010) [2023-12-26 00:53:45,011][123090] Updated weights for policy 1, policy_version 163782 (0.0009) [2023-12-26 00:53:45,025][123091] Updated weights for policy 0, policy_version 164509 (0.0010) [2023-12-26 00:53:45,073][123090] Updated weights for policy 1, policy_version 163792 (0.0008) [2023-12-26 00:53:45,137][123090] Updated weights for policy 1, policy_version 163802 (0.0009) [2023-12-26 00:53:45,840][123091] Updated weights for policy 0, policy_version 164519 (0.0007) [2023-12-26 00:53:45,895][123091] Updated weights for policy 0, policy_version 164529 (0.0007) [2023-12-26 00:53:45,948][123091] Updated weights for policy 0, policy_version 164539 (0.0008) [2023-12-26 00:53:45,963][123090] Updated weights for policy 1, policy_version 163812 (0.0010) [2023-12-26 00:53:46,029][123090] Updated weights for policy 1, policy_version 163822 (0.0008) [2023-12-26 00:53:46,083][123090] Updated weights for policy 1, policy_version 163832 (0.0009) [2023-12-26 00:53:46,700][123091] Updated weights for policy 0, policy_version 164549 (0.0006) [2023-12-26 00:53:46,748][123090] Updated weights for policy 1, policy_version 163842 (0.0009) [2023-12-26 00:53:46,763][123091] Updated weights for policy 0, policy_version 164559 (0.0006) [2023-12-26 00:53:46,813][123090] Updated weights for policy 1, policy_version 163852 (0.0008) [2023-12-26 00:53:46,827][123091] Updated weights for policy 0, policy_version 164569 (0.0005) [2023-12-26 00:53:46,863][123090] Updated weights for policy 1, policy_version 163862 (0.0008) [2023-12-26 00:53:46,914][123090] Updated weights for policy 1, policy_version 163872 (0.0009) [2023-12-26 00:53:47,492][123091] Updated weights for policy 0, policy_version 164579 (0.0006) [2023-12-26 00:53:47,554][123091] Updated weights for policy 0, policy_version 164589 (0.0005) [2023-12-26 00:53:47,619][123091] Updated weights for policy 0, policy_version 164599 (0.0005) [2023-12-26 00:53:47,716][123090] Updated weights for policy 1, policy_version 163882 (0.0009) [2023-12-26 00:53:47,782][123090] Updated weights for policy 1, policy_version 163892 (0.0010) [2023-12-26 00:53:47,836][123090] Updated weights for policy 1, policy_version 163902 (0.0010) [2023-12-26 00:53:48,250][123091] Updated weights for policy 0, policy_version 164609 (0.0005) [2023-12-26 00:53:48,308][123091] Updated weights for policy 0, policy_version 164619 (0.0006) [2023-12-26 00:53:48,369][123091] Updated weights for policy 0, policy_version 164629 (0.0008) [2023-12-26 00:53:48,429][123091] Updated weights for policy 0, policy_version 164639 (0.0007) [2023-12-26 00:53:48,608][123090] Updated weights for policy 1, policy_version 163912 (0.0010) [2023-12-26 00:53:48,675][123090] Updated weights for policy 1, policy_version 163922 (0.0010) [2023-12-26 00:53:48,738][123090] Updated weights for policy 1, policy_version 163932 (0.0010) [2023-12-26 00:53:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 84115456. Throughput: 0: 8885.3, 1: 8955.7. Samples: 84123260. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:48,785][121949] Avg episode reward: [(0, '5114.570'), (1, '5310.755')] [2023-12-26 00:53:49,253][123091] Updated weights for policy 0, policy_version 164649 (0.0009) [2023-12-26 00:53:49,324][123091] Updated weights for policy 0, policy_version 164659 (0.0006) [2023-12-26 00:53:49,383][123091] Updated weights for policy 0, policy_version 164669 (0.0008) [2023-12-26 00:53:49,562][123090] Updated weights for policy 1, policy_version 163942 (0.0008) [2023-12-26 00:53:49,624][123090] Updated weights for policy 1, policy_version 163952 (0.0009) [2023-12-26 00:53:49,684][123090] Updated weights for policy 1, policy_version 163962 (0.0009) [2023-12-26 00:53:50,132][123091] Updated weights for policy 0, policy_version 164679 (0.0009) [2023-12-26 00:53:50,193][123091] Updated weights for policy 0, policy_version 164689 (0.0010) [2023-12-26 00:53:50,257][123091] Updated weights for policy 0, policy_version 164699 (0.0010) [2023-12-26 00:53:50,436][123090] Updated weights for policy 1, policy_version 163972 (0.0009) [2023-12-26 00:53:50,504][123090] Updated weights for policy 1, policy_version 163982 (0.0009) [2023-12-26 00:53:50,579][123090] Updated weights for policy 1, policy_version 163992 (0.0009) [2023-12-26 00:53:51,079][123091] Updated weights for policy 0, policy_version 164709 (0.0009) [2023-12-26 00:53:51,143][123091] Updated weights for policy 0, policy_version 164719 (0.0009) [2023-12-26 00:53:51,206][123091] Updated weights for policy 0, policy_version 164729 (0.0010) [2023-12-26 00:53:51,411][123090] Updated weights for policy 1, policy_version 164002 (0.0010) [2023-12-26 00:53:51,473][123090] Updated weights for policy 1, policy_version 164012 (0.0009) [2023-12-26 00:53:51,540][123090] Updated weights for policy 1, policy_version 164022 (0.0009) [2023-12-26 00:53:51,610][123090] Updated weights for policy 1, policy_version 164032 (0.0009) [2023-12-26 00:53:52,057][123091] Updated weights for policy 0, policy_version 164739 (0.0009) [2023-12-26 00:53:52,119][123091] Updated weights for policy 0, policy_version 164749 (0.0010) [2023-12-26 00:53:52,167][123091] Updated weights for policy 0, policy_version 164759 (0.0008) [2023-12-26 00:53:52,471][123090] Updated weights for policy 1, policy_version 164042 (0.0010) [2023-12-26 00:53:52,537][123090] Updated weights for policy 1, policy_version 164052 (0.0010) [2023-12-26 00:53:52,599][123090] Updated weights for policy 1, policy_version 164062 (0.0010) [2023-12-26 00:53:52,969][123091] Updated weights for policy 0, policy_version 164769 (0.0009) [2023-12-26 00:53:53,038][123091] Updated weights for policy 0, policy_version 164779 (0.0006) [2023-12-26 00:53:53,082][123091] Updated weights for policy 0, policy_version 164789 (0.0005) [2023-12-26 00:53:53,132][123091] Updated weights for policy 0, policy_version 164799 (0.0005) [2023-12-26 00:53:53,455][123090] Updated weights for policy 1, policy_version 164072 (0.0009) [2023-12-26 00:53:53,509][123090] Updated weights for policy 1, policy_version 164082 (0.0010) [2023-12-26 00:53:53,563][123090] Updated weights for policy 1, policy_version 164092 (0.0010) [2023-12-26 00:53:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 84197376. Throughput: 0: 8858.9, 1: 8922.8. Samples: 84174744. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:53,785][121949] Avg episode reward: [(0, '5243.399'), (1, '5235.772')] [2023-12-26 00:53:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000164096_42008576.pth... [2023-12-26 00:53:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000163040_41738240.pth [2023-12-26 00:53:53,794][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000164096_42008576.pth [2023-12-26 00:53:53,822][123091] Updated weights for policy 0, policy_version 164809 (0.0005) [2023-12-26 00:53:53,868][123091] Updated weights for policy 0, policy_version 164819 (0.0005) [2023-12-26 00:53:53,918][123091] Updated weights for policy 0, policy_version 164829 (0.0005) [2023-12-26 00:53:53,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000164832_42196992.pth... [2023-12-26 00:53:53,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000163776_41926656.pth [2023-12-26 00:53:53,942][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000164832_42196992.pth [2023-12-26 00:53:54,477][123090] Updated weights for policy 1, policy_version 164102 (0.0010) [2023-12-26 00:53:54,547][123090] Updated weights for policy 1, policy_version 164112 (0.0010) [2023-12-26 00:53:54,600][123091] Updated weights for policy 0, policy_version 164839 (0.0005) [2023-12-26 00:53:54,618][123090] Updated weights for policy 1, policy_version 164122 (0.0008) [2023-12-26 00:53:54,656][123091] Updated weights for policy 0, policy_version 164849 (0.0006) [2023-12-26 00:53:54,717][123091] Updated weights for policy 0, policy_version 164859 (0.0005) [2023-12-26 00:53:55,418][123090] Updated weights for policy 1, policy_version 164132 (0.0010) [2023-12-26 00:53:55,458][123091] Updated weights for policy 0, policy_version 164869 (0.0006) [2023-12-26 00:53:55,472][123090] Updated weights for policy 1, policy_version 164142 (0.0009) [2023-12-26 00:53:55,520][123091] Updated weights for policy 0, policy_version 164879 (0.0005) [2023-12-26 00:53:55,534][123090] Updated weights for policy 1, policy_version 164152 (0.0009) [2023-12-26 00:53:55,586][123091] Updated weights for policy 0, policy_version 164889 (0.0005) [2023-12-26 00:53:56,376][123090] Updated weights for policy 1, policy_version 164162 (0.0009) [2023-12-26 00:53:56,384][123091] Updated weights for policy 0, policy_version 164899 (0.0007) [2023-12-26 00:53:56,434][123090] Updated weights for policy 1, policy_version 164172 (0.0009) [2023-12-26 00:53:56,434][123091] Updated weights for policy 0, policy_version 164909 (0.0007) [2023-12-26 00:53:56,481][123091] Updated weights for policy 0, policy_version 164919 (0.0009) [2023-12-26 00:53:56,485][123090] Updated weights for policy 1, policy_version 164182 (0.0008) [2023-12-26 00:53:56,534][123090] Updated weights for policy 1, policy_version 164192 (0.0009) [2023-12-26 00:53:57,160][123091] Updated weights for policy 0, policy_version 164929 (0.0007) [2023-12-26 00:53:57,226][123091] Updated weights for policy 0, policy_version 164939 (0.0005) [2023-12-26 00:53:57,306][123091] Updated weights for policy 0, policy_version 164949 (0.0007) [2023-12-26 00:53:57,358][123091] Updated weights for policy 0, policy_version 164959 (0.0009) [2023-12-26 00:53:57,402][123090] Updated weights for policy 1, policy_version 164202 (0.0009) [2023-12-26 00:53:57,460][123090] Updated weights for policy 1, policy_version 164212 (0.0009) [2023-12-26 00:53:57,516][123090] Updated weights for policy 1, policy_version 164222 (0.0009) [2023-12-26 00:53:58,150][123091] Updated weights for policy 0, policy_version 164969 (0.0008) [2023-12-26 00:53:58,215][123091] Updated weights for policy 0, policy_version 164979 (0.0008) [2023-12-26 00:53:58,278][123091] Updated weights for policy 0, policy_version 164989 (0.0008) [2023-12-26 00:53:58,308][123090] Updated weights for policy 1, policy_version 164232 (0.0009) [2023-12-26 00:53:58,379][123090] Updated weights for policy 1, policy_version 164242 (0.0008) [2023-12-26 00:53:58,448][123090] Updated weights for policy 1, policy_version 164252 (0.0010) [2023-12-26 00:53:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 84287488. Throughput: 0: 8943.5, 1: 8925.4. Samples: 84281336. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 00:53:58,785][121949] Avg episode reward: [(0, '5149.066'), (1, '5252.036')] [2023-12-26 00:53:59,177][123091] Updated weights for policy 0, policy_version 164999 (0.0009) [2023-12-26 00:53:59,247][123091] Updated weights for policy 0, policy_version 165009 (0.0009) [2023-12-26 00:53:59,302][123091] Updated weights for policy 0, policy_version 165019 (0.0009) [2023-12-26 00:53:59,369][123090] Updated weights for policy 1, policy_version 164262 (0.0009) [2023-12-26 00:53:59,440][123090] Updated weights for policy 1, policy_version 164272 (0.0009) [2023-12-26 00:53:59,508][123090] Updated weights for policy 1, policy_version 164282 (0.0009) [2023-12-26 00:54:00,235][123091] Updated weights for policy 0, policy_version 165029 (0.0008) [2023-12-26 00:54:00,289][123091] Updated weights for policy 0, policy_version 165039 (0.0009) [2023-12-26 00:54:00,340][123091] Updated weights for policy 0, policy_version 165049 (0.0010) [2023-12-26 00:54:00,353][123090] Updated weights for policy 1, policy_version 164292 (0.0009) [2023-12-26 00:54:00,414][123090] Updated weights for policy 1, policy_version 164302 (0.0009) [2023-12-26 00:54:00,466][123090] Updated weights for policy 1, policy_version 164312 (0.0009) [2023-12-26 00:54:01,170][123091] Updated weights for policy 0, policy_version 165059 (0.0011) [2023-12-26 00:54:01,221][123091] Updated weights for policy 0, policy_version 165069 (0.0010) [2023-12-26 00:54:01,254][123090] Updated weights for policy 1, policy_version 164322 (0.0009) [2023-12-26 00:54:01,276][123091] Updated weights for policy 0, policy_version 165079 (0.0011) [2023-12-26 00:54:01,309][123090] Updated weights for policy 1, policy_version 164332 (0.0006) [2023-12-26 00:54:01,374][123090] Updated weights for policy 1, policy_version 164342 (0.0008) [2023-12-26 00:54:01,444][123090] Updated weights for policy 1, policy_version 164352 (0.0007) [2023-12-26 00:54:02,110][123091] Updated weights for policy 0, policy_version 165089 (0.0011) [2023-12-26 00:54:02,162][123091] Updated weights for policy 0, policy_version 165099 (0.0011) [2023-12-26 00:54:02,196][123090] Updated weights for policy 1, policy_version 164362 (0.0008) [2023-12-26 00:54:02,218][123091] Updated weights for policy 0, policy_version 165109 (0.0010) [2023-12-26 00:54:02,263][123090] Updated weights for policy 1, policy_version 164372 (0.0007) [2023-12-26 00:54:02,285][123091] Updated weights for policy 0, policy_version 165119 (0.0011) [2023-12-26 00:54:02,320][123090] Updated weights for policy 1, policy_version 164382 (0.0007) [2023-12-26 00:54:03,124][123091] Updated weights for policy 0, policy_version 165129 (0.0010) [2023-12-26 00:54:03,136][123090] Updated weights for policy 1, policy_version 164392 (0.0007) [2023-12-26 00:54:03,183][123091] Updated weights for policy 0, policy_version 165139 (0.0011) [2023-12-26 00:54:03,190][123090] Updated weights for policy 1, policy_version 164402 (0.0008) [2023-12-26 00:54:03,239][123091] Updated weights for policy 0, policy_version 165149 (0.0011) [2023-12-26 00:54:03,241][123090] Updated weights for policy 1, policy_version 164412 (0.0008) [2023-12-26 00:54:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 84369408. Throughput: 0: 8888.3, 1: 8832.4. Samples: 84382224. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:03,785][121949] Avg episode reward: [(0, '5211.497'), (1, '5475.572')] [2023-12-26 00:54:04,043][123090] Updated weights for policy 1, policy_version 164422 (0.0008) [2023-12-26 00:54:04,075][123091] Updated weights for policy 0, policy_version 165159 (0.0011) [2023-12-26 00:54:04,107][123090] Updated weights for policy 1, policy_version 164432 (0.0006) [2023-12-26 00:54:04,138][123091] Updated weights for policy 0, policy_version 165169 (0.0011) [2023-12-26 00:54:04,167][123090] Updated weights for policy 1, policy_version 164442 (0.0007) [2023-12-26 00:54:04,206][123091] Updated weights for policy 0, policy_version 165179 (0.0011) [2023-12-26 00:54:04,829][123090] Updated weights for policy 1, policy_version 164452 (0.0007) [2023-12-26 00:54:04,892][123090] Updated weights for policy 1, policy_version 164462 (0.0010) [2023-12-26 00:54:04,958][123090] Updated weights for policy 1, policy_version 164472 (0.0011) [2023-12-26 00:54:05,053][123091] Updated weights for policy 0, policy_version 165189 (0.0011) [2023-12-26 00:54:05,101][123091] Updated weights for policy 0, policy_version 165199 (0.0010) [2023-12-26 00:54:05,156][123091] Updated weights for policy 0, policy_version 165209 (0.0010) [2023-12-26 00:54:05,740][123090] Updated weights for policy 1, policy_version 164482 (0.0011) [2023-12-26 00:54:05,802][123090] Updated weights for policy 1, policy_version 164492 (0.0010) [2023-12-26 00:54:05,864][123090] Updated weights for policy 1, policy_version 164502 (0.0010) [2023-12-26 00:54:05,936][123090] Updated weights for policy 1, policy_version 164512 (0.0009) [2023-12-26 00:54:05,978][123091] Updated weights for policy 0, policy_version 165219 (0.0011) [2023-12-26 00:54:06,041][123091] Updated weights for policy 0, policy_version 165229 (0.0011) [2023-12-26 00:54:06,106][123091] Updated weights for policy 0, policy_version 165239 (0.0007) [2023-12-26 00:54:06,672][123090] Updated weights for policy 1, policy_version 164522 (0.0008) [2023-12-26 00:54:06,748][123090] Updated weights for policy 1, policy_version 164532 (0.0010) [2023-12-26 00:54:06,800][123090] Updated weights for policy 1, policy_version 164542 (0.0011) [2023-12-26 00:54:06,911][123091] Updated weights for policy 0, policy_version 165249 (0.0009) [2023-12-26 00:54:06,974][123091] Updated weights for policy 0, policy_version 165259 (0.0011) [2023-12-26 00:54:07,040][123091] Updated weights for policy 0, policy_version 165269 (0.0011) [2023-12-26 00:54:07,103][123091] Updated weights for policy 0, policy_version 165279 (0.0011) [2023-12-26 00:54:07,608][123090] Updated weights for policy 1, policy_version 164552 (0.0010) [2023-12-26 00:54:07,652][123090] Updated weights for policy 1, policy_version 164562 (0.0010) [2023-12-26 00:54:07,699][123090] Updated weights for policy 1, policy_version 164572 (0.0010) [2023-12-26 00:54:07,799][123091] Updated weights for policy 0, policy_version 165289 (0.0006) [2023-12-26 00:54:07,851][123091] Updated weights for policy 0, policy_version 165299 (0.0006) [2023-12-26 00:54:07,911][123091] Updated weights for policy 0, policy_version 165309 (0.0005) [2023-12-26 00:54:08,507][123090] Updated weights for policy 1, policy_version 164582 (0.0009) [2023-12-26 00:54:08,571][123090] Updated weights for policy 1, policy_version 164592 (0.0006) [2023-12-26 00:54:08,613][123091] Updated weights for policy 0, policy_version 165319 (0.0007) [2023-12-26 00:54:08,639][123090] Updated weights for policy 1, policy_version 164602 (0.0006) [2023-12-26 00:54:08,672][123091] Updated weights for policy 0, policy_version 165329 (0.0009) [2023-12-26 00:54:08,731][123091] Updated weights for policy 0, policy_version 165339 (0.0011) [2023-12-26 00:54:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 84467712. Throughput: 0: 8909.6, 1: 8857.8. Samples: 84435488. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:08,785][121949] Avg episode reward: [(0, '5405.664'), (1, '5520.068')] [2023-12-26 00:54:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000165344_42328064.pth... [2023-12-26 00:54:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000164608_42139648.pth... [2023-12-26 00:54:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000164288_42057728.pth [2023-12-26 00:54:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000163584_41877504.pth [2023-12-26 00:54:09,368][123090] Updated weights for policy 1, policy_version 164612 (0.0009) [2023-12-26 00:54:09,447][123090] Updated weights for policy 1, policy_version 164622 (0.0010) [2023-12-26 00:54:09,517][123090] Updated weights for policy 1, policy_version 164632 (0.0007) [2023-12-26 00:54:09,523][123091] Updated weights for policy 0, policy_version 165349 (0.0010) [2023-12-26 00:54:09,583][123091] Updated weights for policy 0, policy_version 165359 (0.0009) [2023-12-26 00:54:09,637][123091] Updated weights for policy 0, policy_version 165369 (0.0009) [2023-12-26 00:54:10,311][123090] Updated weights for policy 1, policy_version 164642 (0.0008) [2023-12-26 00:54:10,377][123090] Updated weights for policy 1, policy_version 164652 (0.0006) [2023-12-26 00:54:10,450][123090] Updated weights for policy 1, policy_version 164662 (0.0008) [2023-12-26 00:54:10,482][123091] Updated weights for policy 0, policy_version 165379 (0.0009) [2023-12-26 00:54:10,517][123090] Updated weights for policy 1, policy_version 164672 (0.0008) [2023-12-26 00:54:10,549][123091] Updated weights for policy 0, policy_version 165389 (0.0009) [2023-12-26 00:54:10,612][123091] Updated weights for policy 0, policy_version 165399 (0.0010) [2023-12-26 00:54:11,240][123090] Updated weights for policy 1, policy_version 164682 (0.0010) [2023-12-26 00:54:11,308][123090] Updated weights for policy 1, policy_version 164692 (0.0008) [2023-12-26 00:54:11,386][123090] Updated weights for policy 1, policy_version 164702 (0.0010) [2023-12-26 00:54:11,528][123091] Updated weights for policy 0, policy_version 165409 (0.0010) [2023-12-26 00:54:11,591][123091] Updated weights for policy 0, policy_version 165419 (0.0010) [2023-12-26 00:54:11,659][123091] Updated weights for policy 0, policy_version 165429 (0.0009) [2023-12-26 00:54:11,722][123091] Updated weights for policy 0, policy_version 165439 (0.0009) [2023-12-26 00:54:12,117][123090] Updated weights for policy 1, policy_version 164712 (0.0010) [2023-12-26 00:54:12,166][123090] Updated weights for policy 1, policy_version 164722 (0.0010) [2023-12-26 00:54:12,231][123090] Updated weights for policy 1, policy_version 164732 (0.0010) [2023-12-26 00:54:12,628][123091] Updated weights for policy 0, policy_version 165449 (0.0008) [2023-12-26 00:54:12,681][123091] Updated weights for policy 0, policy_version 165459 (0.0009) [2023-12-26 00:54:12,750][123091] Updated weights for policy 0, policy_version 165469 (0.0009) [2023-12-26 00:54:13,069][123090] Updated weights for policy 1, policy_version 164742 (0.0009) [2023-12-26 00:54:13,128][123090] Updated weights for policy 1, policy_version 164752 (0.0010) [2023-12-26 00:54:13,193][123090] Updated weights for policy 1, policy_version 164762 (0.0010) [2023-12-26 00:54:13,580][123091] Updated weights for policy 0, policy_version 165479 (0.0008) [2023-12-26 00:54:13,644][123091] Updated weights for policy 0, policy_version 165489 (0.0009) [2023-12-26 00:54:13,711][123091] Updated weights for policy 0, policy_version 165499 (0.0009) [2023-12-26 00:54:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 84549632. Throughput: 0: 8868.1, 1: 8837.2. Samples: 84541200. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:13,785][121949] Avg episode reward: [(0, '5559.396'), (1, '5363.259')] [2023-12-26 00:54:14,005][123090] Updated weights for policy 1, policy_version 164772 (0.0010) [2023-12-26 00:54:14,065][123090] Updated weights for policy 1, policy_version 164782 (0.0010) [2023-12-26 00:54:14,134][123090] Updated weights for policy 1, policy_version 164792 (0.0010) [2023-12-26 00:54:14,533][123091] Updated weights for policy 0, policy_version 165509 (0.0008) [2023-12-26 00:54:14,579][123091] Updated weights for policy 0, policy_version 165519 (0.0007) [2023-12-26 00:54:14,626][123091] Updated weights for policy 0, policy_version 165529 (0.0008) [2023-12-26 00:54:14,947][123090] Updated weights for policy 1, policy_version 164802 (0.0009) [2023-12-26 00:54:15,018][123090] Updated weights for policy 1, policy_version 164812 (0.0006) [2023-12-26 00:54:15,080][123090] Updated weights for policy 1, policy_version 164822 (0.0006) [2023-12-26 00:54:15,158][123090] Updated weights for policy 1, policy_version 164832 (0.0006) [2023-12-26 00:54:15,477][123091] Updated weights for policy 0, policy_version 165539 (0.0008) [2023-12-26 00:54:15,551][123091] Updated weights for policy 0, policy_version 165549 (0.0009) [2023-12-26 00:54:15,604][123091] Updated weights for policy 0, policy_version 165559 (0.0009) [2023-12-26 00:54:15,854][123090] Updated weights for policy 1, policy_version 164842 (0.0008) [2023-12-26 00:54:15,906][123090] Updated weights for policy 1, policy_version 164852 (0.0010) [2023-12-26 00:54:15,953][123090] Updated weights for policy 1, policy_version 164862 (0.0010) [2023-12-26 00:54:16,445][123091] Updated weights for policy 0, policy_version 165569 (0.0010) [2023-12-26 00:54:16,509][123091] Updated weights for policy 0, policy_version 165579 (0.0009) [2023-12-26 00:54:16,567][123091] Updated weights for policy 0, policy_version 165589 (0.0007) [2023-12-26 00:54:16,625][123091] Updated weights for policy 0, policy_version 165599 (0.0005) [2023-12-26 00:54:16,787][123090] Updated weights for policy 1, policy_version 164872 (0.0010) [2023-12-26 00:54:16,846][123090] Updated weights for policy 1, policy_version 164882 (0.0010) [2023-12-26 00:54:16,908][123090] Updated weights for policy 1, policy_version 164892 (0.0010) [2023-12-26 00:54:17,380][123091] Updated weights for policy 0, policy_version 165609 (0.0005) [2023-12-26 00:54:17,442][123091] Updated weights for policy 0, policy_version 165619 (0.0005) [2023-12-26 00:54:17,493][123091] Updated weights for policy 0, policy_version 165629 (0.0005) [2023-12-26 00:54:17,698][123090] Updated weights for policy 1, policy_version 164902 (0.0010) [2023-12-26 00:54:17,753][123090] Updated weights for policy 1, policy_version 164912 (0.0010) [2023-12-26 00:54:17,812][123090] Updated weights for policy 1, policy_version 164922 (0.0005) [2023-12-26 00:54:18,193][123091] Updated weights for policy 0, policy_version 165639 (0.0009) [2023-12-26 00:54:18,240][123091] Updated weights for policy 0, policy_version 165649 (0.0009) [2023-12-26 00:54:18,289][123091] Updated weights for policy 0, policy_version 165659 (0.0009) [2023-12-26 00:54:18,609][123090] Updated weights for policy 1, policy_version 164932 (0.0010) [2023-12-26 00:54:18,673][123090] Updated weights for policy 1, policy_version 164942 (0.0010) [2023-12-26 00:54:18,735][123090] Updated weights for policy 1, policy_version 164952 (0.0010) [2023-12-26 00:54:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 84631552. Throughput: 0: 8892.2, 1: 8825.4. Samples: 84647984. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:18,785][121949] Avg episode reward: [(0, '5573.067'), (1, '5396.178')] [2023-12-26 00:54:19,145][123091] Updated weights for policy 0, policy_version 165669 (0.0009) [2023-12-26 00:54:19,210][123091] Updated weights for policy 0, policy_version 165679 (0.0010) [2023-12-26 00:54:19,288][123091] Updated weights for policy 0, policy_version 165689 (0.0009) [2023-12-26 00:54:19,567][123090] Updated weights for policy 1, policy_version 164962 (0.0010) [2023-12-26 00:54:19,615][123090] Updated weights for policy 1, policy_version 164972 (0.0009) [2023-12-26 00:54:19,671][123090] Updated weights for policy 1, policy_version 164983 (0.0008) [2023-12-26 00:54:20,202][123091] Updated weights for policy 0, policy_version 165699 (0.0011) [2023-12-26 00:54:20,271][123091] Updated weights for policy 0, policy_version 165709 (0.0010) [2023-12-26 00:54:20,345][123091] Updated weights for policy 0, policy_version 165719 (0.0009) [2023-12-26 00:54:20,484][123090] Updated weights for policy 1, policy_version 164993 (0.0010) [2023-12-26 00:54:20,551][123090] Updated weights for policy 1, policy_version 165003 (0.0011) [2023-12-26 00:54:20,621][123090] Updated weights for policy 1, policy_version 165013 (0.0009) [2023-12-26 00:54:20,692][123090] Updated weights for policy 1, policy_version 165023 (0.0009) [2023-12-26 00:54:21,234][123091] Updated weights for policy 0, policy_version 165729 (0.0010) [2023-12-26 00:54:21,297][123091] Updated weights for policy 0, policy_version 165739 (0.0010) [2023-12-26 00:54:21,361][123091] Updated weights for policy 0, policy_version 165749 (0.0008) [2023-12-26 00:54:21,439][123091] Updated weights for policy 0, policy_version 165759 (0.0007) [2023-12-26 00:54:21,536][123090] Updated weights for policy 1, policy_version 165033 (0.0009) [2023-12-26 00:54:21,595][123090] Updated weights for policy 1, policy_version 165043 (0.0010) [2023-12-26 00:54:21,666][123090] Updated weights for policy 1, policy_version 165053 (0.0009) [2023-12-26 00:54:22,194][123091] Updated weights for policy 0, policy_version 165769 (0.0011) [2023-12-26 00:54:22,255][123091] Updated weights for policy 0, policy_version 165779 (0.0010) [2023-12-26 00:54:22,323][123091] Updated weights for policy 0, policy_version 165789 (0.0011) [2023-12-26 00:54:22,574][123090] Updated weights for policy 1, policy_version 165063 (0.0009) [2023-12-26 00:54:22,639][123090] Updated weights for policy 1, policy_version 165073 (0.0009) [2023-12-26 00:54:22,703][123090] Updated weights for policy 1, policy_version 165083 (0.0009) [2023-12-26 00:54:23,125][123091] Updated weights for policy 0, policy_version 165799 (0.0007) [2023-12-26 00:54:23,182][123091] Updated weights for policy 0, policy_version 165809 (0.0006) [2023-12-26 00:54:23,256][123091] Updated weights for policy 0, policy_version 165819 (0.0006) [2023-12-26 00:54:23,601][123090] Updated weights for policy 1, policy_version 165093 (0.0009) [2023-12-26 00:54:23,660][123090] Updated weights for policy 1, policy_version 165103 (0.0009) [2023-12-26 00:54:23,729][123090] Updated weights for policy 1, policy_version 165113 (0.0010) [2023-12-26 00:54:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 84721664. Throughput: 0: 8814.3, 1: 8738.2. Samples: 84697316. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:23,785][121949] Avg episode reward: [(0, '5458.768'), (1, '5224.866')] [2023-12-26 00:54:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000165824_42450944.pth... [2023-12-26 00:54:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000165120_42270720.pth... [2023-12-26 00:54:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000164096_42008576.pth [2023-12-26 00:54:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000164832_42196992.pth [2023-12-26 00:54:23,913][123091] Updated weights for policy 0, policy_version 165829 (0.0008) [2023-12-26 00:54:23,971][123091] Updated weights for policy 0, policy_version 165839 (0.0006) [2023-12-26 00:54:24,030][123091] Updated weights for policy 0, policy_version 165849 (0.0006) [2023-12-26 00:54:24,370][123090] Updated weights for policy 1, policy_version 165123 (0.0007) [2023-12-26 00:54:24,427][123090] Updated weights for policy 1, policy_version 165133 (0.0005) [2023-12-26 00:54:24,490][123090] Updated weights for policy 1, policy_version 165143 (0.0006) [2023-12-26 00:54:24,802][123091] Updated weights for policy 0, policy_version 165859 (0.0008) [2023-12-26 00:54:24,872][123091] Updated weights for policy 0, policy_version 165869 (0.0011) [2023-12-26 00:54:24,938][123091] Updated weights for policy 0, policy_version 165879 (0.0008) [2023-12-26 00:54:25,154][123090] Updated weights for policy 1, policy_version 165153 (0.0005) [2023-12-26 00:54:25,224][123090] Updated weights for policy 1, policy_version 165163 (0.0005) [2023-12-26 00:54:25,272][123090] Updated weights for policy 1, policy_version 165173 (0.0005) [2023-12-26 00:54:25,318][123090] Updated weights for policy 1, policy_version 165183 (0.0005) [2023-12-26 00:54:25,664][123091] Updated weights for policy 0, policy_version 165889 (0.0006) [2023-12-26 00:54:25,724][123091] Updated weights for policy 0, policy_version 165899 (0.0010) [2023-12-26 00:54:25,782][123091] Updated weights for policy 0, policy_version 165910 (0.0010) [2023-12-26 00:54:25,835][123091] Updated weights for policy 0, policy_version 165920 (0.0010) [2023-12-26 00:54:26,031][123090] Updated weights for policy 1, policy_version 165193 (0.0010) [2023-12-26 00:54:26,083][123090] Updated weights for policy 1, policy_version 165203 (0.0010) [2023-12-26 00:54:26,134][123090] Updated weights for policy 1, policy_version 165213 (0.0010) [2023-12-26 00:54:26,697][123091] Updated weights for policy 0, policy_version 165930 (0.0009) [2023-12-26 00:54:26,757][123091] Updated weights for policy 0, policy_version 165940 (0.0009) [2023-12-26 00:54:26,819][123091] Updated weights for policy 0, policy_version 165950 (0.0009) [2023-12-26 00:54:26,926][123090] Updated weights for policy 1, policy_version 165223 (0.0007) [2023-12-26 00:54:26,989][123090] Updated weights for policy 1, policy_version 165233 (0.0005) [2023-12-26 00:54:27,043][123090] Updated weights for policy 1, policy_version 165243 (0.0008) [2023-12-26 00:54:27,673][123091] Updated weights for policy 0, policy_version 165960 (0.0010) [2023-12-26 00:54:27,724][123091] Updated weights for policy 0, policy_version 165970 (0.0008) [2023-12-26 00:54:27,764][123090] Updated weights for policy 1, policy_version 165253 (0.0010) [2023-12-26 00:54:27,776][123091] Updated weights for policy 0, policy_version 165980 (0.0008) [2023-12-26 00:54:27,822][123090] Updated weights for policy 1, policy_version 165263 (0.0010) [2023-12-26 00:54:27,876][123090] Updated weights for policy 1, policy_version 165273 (0.0010) [2023-12-26 00:54:28,629][123091] Updated weights for policy 0, policy_version 165990 (0.0009) [2023-12-26 00:54:28,692][123091] Updated weights for policy 0, policy_version 166000 (0.0009) [2023-12-26 00:54:28,711][123090] Updated weights for policy 1, policy_version 165283 (0.0010) [2023-12-26 00:54:28,744][123091] Updated weights for policy 0, policy_version 166010 (0.0006) [2023-12-26 00:54:28,770][123090] Updated weights for policy 1, policy_version 165293 (0.0010) [2023-12-26 00:54:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 84811776. Throughput: 0: 8813.4, 1: 8830.6. Samples: 84806720. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:28,784][121949] Avg episode reward: [(0, '5311.534'), (1, '5265.708')] [2023-12-26 00:54:28,832][123090] Updated weights for policy 1, policy_version 165303 (0.0010) [2023-12-26 00:54:29,584][123091] Updated weights for policy 0, policy_version 166020 (0.0007) [2023-12-26 00:54:29,636][123091] Updated weights for policy 0, policy_version 166030 (0.0009) [2023-12-26 00:54:29,668][123090] Updated weights for policy 1, policy_version 165313 (0.0010) [2023-12-26 00:54:29,702][123091] Updated weights for policy 0, policy_version 166040 (0.0008) [2023-12-26 00:54:29,738][123090] Updated weights for policy 1, policy_version 165323 (0.0007) [2023-12-26 00:54:29,804][123090] Updated weights for policy 1, policy_version 165333 (0.0010) [2023-12-26 00:54:29,868][123090] Updated weights for policy 1, policy_version 165343 (0.0011) [2023-12-26 00:54:30,455][123091] Updated weights for policy 0, policy_version 166050 (0.0007) [2023-12-26 00:54:30,518][123091] Updated weights for policy 0, policy_version 166060 (0.0005) [2023-12-26 00:54:30,591][123091] Updated weights for policy 0, policy_version 166070 (0.0005) [2023-12-26 00:54:30,656][123091] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-12-26 00:54:30,696][123090] Updated weights for policy 1, policy_version 165353 (0.0010) [2023-12-26 00:54:30,761][123090] Updated weights for policy 1, policy_version 165363 (0.0010) [2023-12-26 00:54:30,834][123090] Updated weights for policy 1, policy_version 165373 (0.0011) [2023-12-26 00:54:31,294][123091] Updated weights for policy 0, policy_version 166090 (0.0008) [2023-12-26 00:54:31,347][123091] Updated weights for policy 0, policy_version 166100 (0.0007) [2023-12-26 00:54:31,420][123091] Updated weights for policy 0, policy_version 166110 (0.0009) [2023-12-26 00:54:31,641][123090] Updated weights for policy 1, policy_version 165383 (0.0011) [2023-12-26 00:54:31,696][123090] Updated weights for policy 1, policy_version 165393 (0.0010) [2023-12-26 00:54:31,761][123090] Updated weights for policy 1, policy_version 165403 (0.0011) [2023-12-26 00:54:32,160][123091] Updated weights for policy 0, policy_version 166120 (0.0008) [2023-12-26 00:54:32,234][123091] Updated weights for policy 0, policy_version 166130 (0.0006) [2023-12-26 00:54:32,305][123091] Updated weights for policy 0, policy_version 166140 (0.0008) [2023-12-26 00:54:32,617][123090] Updated weights for policy 1, policy_version 165413 (0.0010) [2023-12-26 00:54:32,672][123090] Updated weights for policy 1, policy_version 165423 (0.0010) [2023-12-26 00:54:32,725][123090] Updated weights for policy 1, policy_version 165433 (0.0010) [2023-12-26 00:54:33,046][123091] Updated weights for policy 0, policy_version 166150 (0.0009) [2023-12-26 00:54:33,115][123091] Updated weights for policy 0, policy_version 166160 (0.0009) [2023-12-26 00:54:33,179][123091] Updated weights for policy 0, policy_version 166170 (0.0009) [2023-12-26 00:54:33,520][123090] Updated weights for policy 1, policy_version 165443 (0.0010) [2023-12-26 00:54:33,579][123090] Updated weights for policy 1, policy_version 165453 (0.0009) [2023-12-26 00:54:33,633][123090] Updated weights for policy 1, policy_version 165463 (0.0010) [2023-12-26 00:54:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 84901888. Throughput: 0: 8786.7, 1: 8761.8. Samples: 84912940. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:33,785][121949] Avg episode reward: [(0, '5510.040'), (1, '5440.638')] [2023-12-26 00:54:33,914][123091] Updated weights for policy 0, policy_version 166180 (0.0008) [2023-12-26 00:54:33,962][123091] Updated weights for policy 0, policy_version 166190 (0.0005) [2023-12-26 00:54:34,012][123091] Updated weights for policy 0, policy_version 166200 (0.0009) [2023-12-26 00:54:34,433][123090] Updated weights for policy 1, policy_version 165474 (0.0010) [2023-12-26 00:54:34,498][123090] Updated weights for policy 1, policy_version 165484 (0.0006) [2023-12-26 00:54:34,561][123090] Updated weights for policy 1, policy_version 165494 (0.0006) [2023-12-26 00:54:34,621][123090] Updated weights for policy 1, policy_version 165504 (0.0007) [2023-12-26 00:54:34,882][123091] Updated weights for policy 0, policy_version 166210 (0.0009) [2023-12-26 00:54:34,938][123091] Updated weights for policy 0, policy_version 166220 (0.0005) [2023-12-26 00:54:34,995][123091] Updated weights for policy 0, policy_version 166230 (0.0006) [2023-12-26 00:54:35,047][123091] Updated weights for policy 0, policy_version 166240 (0.0006) [2023-12-26 00:54:35,340][123090] Updated weights for policy 1, policy_version 165514 (0.0009) [2023-12-26 00:54:35,400][123090] Updated weights for policy 1, policy_version 165524 (0.0009) [2023-12-26 00:54:35,463][123090] Updated weights for policy 1, policy_version 165534 (0.0010) [2023-12-26 00:54:35,758][123091] Updated weights for policy 0, policy_version 166250 (0.0007) [2023-12-26 00:54:35,819][123091] Updated weights for policy 0, policy_version 166260 (0.0005) [2023-12-26 00:54:35,883][123091] Updated weights for policy 0, policy_version 166270 (0.0006) [2023-12-26 00:54:36,144][123090] Updated weights for policy 1, policy_version 165544 (0.0008) [2023-12-26 00:54:36,208][123090] Updated weights for policy 1, policy_version 165554 (0.0008) [2023-12-26 00:54:36,274][123090] Updated weights for policy 1, policy_version 165564 (0.0006) [2023-12-26 00:54:36,625][123091] Updated weights for policy 0, policy_version 166280 (0.0006) [2023-12-26 00:54:36,679][123091] Updated weights for policy 0, policy_version 166290 (0.0008) [2023-12-26 00:54:36,743][123091] Updated weights for policy 0, policy_version 166300 (0.0006) [2023-12-26 00:54:37,070][123090] Updated weights for policy 1, policy_version 165574 (0.0008) [2023-12-26 00:54:37,129][123090] Updated weights for policy 1, policy_version 165584 (0.0010) [2023-12-26 00:54:37,200][123090] Updated weights for policy 1, policy_version 165594 (0.0009) [2023-12-26 00:54:37,388][123091] Updated weights for policy 0, policy_version 166310 (0.0005) [2023-12-26 00:54:37,450][123091] Updated weights for policy 0, policy_version 166320 (0.0006) [2023-12-26 00:54:37,515][123091] Updated weights for policy 0, policy_version 166330 (0.0005) [2023-12-26 00:54:38,081][123090] Updated weights for policy 1, policy_version 165604 (0.0010) [2023-12-26 00:54:38,132][123090] Updated weights for policy 1, policy_version 165614 (0.0008) [2023-12-26 00:54:38,135][123091] Updated weights for policy 0, policy_version 166340 (0.0007) [2023-12-26 00:54:38,184][123091] Updated weights for policy 0, policy_version 166350 (0.0008) [2023-12-26 00:54:38,186][123090] Updated weights for policy 1, policy_version 165624 (0.0005) [2023-12-26 00:54:38,231][123091] Updated weights for policy 0, policy_version 166360 (0.0008) [2023-12-26 00:54:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 84992000. Throughput: 0: 8825.8, 1: 8805.6. Samples: 84968156. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:38,785][121949] Avg episode reward: [(0, '5658.318'), (1, '5467.261')] [2023-12-26 00:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000166368_42590208.pth... [2023-12-26 00:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000165632_42401792.pth... [2023-12-26 00:54:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000164608_42139648.pth [2023-12-26 00:54:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000165344_42328064.pth [2023-12-26 00:54:39,028][123091] Updated weights for policy 0, policy_version 166370 (0.0006) [2023-12-26 00:54:39,060][123090] Updated weights for policy 1, policy_version 165634 (0.0006) [2023-12-26 00:54:39,092][123091] Updated weights for policy 0, policy_version 166380 (0.0011) [2023-12-26 00:54:39,124][123090] Updated weights for policy 1, policy_version 165644 (0.0006) [2023-12-26 00:54:39,155][123091] Updated weights for policy 0, policy_version 166390 (0.0011) [2023-12-26 00:54:39,181][123090] Updated weights for policy 1, policy_version 165654 (0.0005) [2023-12-26 00:54:39,222][123091] Updated weights for policy 0, policy_version 166400 (0.0010) [2023-12-26 00:54:39,251][123090] Updated weights for policy 1, policy_version 165664 (0.0006) [2023-12-26 00:54:40,068][123091] Updated weights for policy 0, policy_version 166410 (0.0007) [2023-12-26 00:54:40,131][123090] Updated weights for policy 1, policy_version 165674 (0.0009) [2023-12-26 00:54:40,134][123091] Updated weights for policy 0, policy_version 166420 (0.0007) [2023-12-26 00:54:40,195][123091] Updated weights for policy 0, policy_version 166430 (0.0007) [2023-12-26 00:54:40,200][123090] Updated weights for policy 1, policy_version 165684 (0.0011) [2023-12-26 00:54:40,275][123090] Updated weights for policy 1, policy_version 165694 (0.0008) [2023-12-26 00:54:40,970][123091] Updated weights for policy 0, policy_version 166440 (0.0009) [2023-12-26 00:54:41,023][123090] Updated weights for policy 1, policy_version 165704 (0.0009) [2023-12-26 00:54:41,035][123091] Updated weights for policy 0, policy_version 166450 (0.0007) [2023-12-26 00:54:41,095][123091] Updated weights for policy 0, policy_version 166460 (0.0009) [2023-12-26 00:54:41,097][123090] Updated weights for policy 1, policy_version 165714 (0.0009) [2023-12-26 00:54:41,165][123090] Updated weights for policy 1, policy_version 165724 (0.0010) [2023-12-26 00:54:41,925][123091] Updated weights for policy 0, policy_version 166470 (0.0010) [2023-12-26 00:54:41,982][123091] Updated weights for policy 0, policy_version 166480 (0.0010) [2023-12-26 00:54:42,002][123090] Updated weights for policy 1, policy_version 165734 (0.0009) [2023-12-26 00:54:42,040][123091] Updated weights for policy 0, policy_version 166490 (0.0007) [2023-12-26 00:54:42,066][123090] Updated weights for policy 1, policy_version 165744 (0.0011) [2023-12-26 00:54:42,126][123090] Updated weights for policy 1, policy_version 165754 (0.0010) [2023-12-26 00:54:42,821][123091] Updated weights for policy 0, policy_version 166500 (0.0010) [2023-12-26 00:54:42,865][123091] Updated weights for policy 0, policy_version 166510 (0.0010) [2023-12-26 00:54:42,930][123091] Updated weights for policy 0, policy_version 166520 (0.0011) [2023-12-26 00:54:42,970][123090] Updated weights for policy 1, policy_version 165764 (0.0011) [2023-12-26 00:54:43,034][123090] Updated weights for policy 1, policy_version 165774 (0.0011) [2023-12-26 00:54:43,101][123090] Updated weights for policy 1, policy_version 165784 (0.0011) [2023-12-26 00:54:43,667][123091] Updated weights for policy 0, policy_version 166530 (0.0011) [2023-12-26 00:54:43,729][123091] Updated weights for policy 0, policy_version 166540 (0.0010) [2023-12-26 00:54:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 85073920. Throughput: 0: 8790.1, 1: 8802.8. Samples: 85073016. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:43,784][121949] Avg episode reward: [(0, '5582.486'), (1, '5449.325')] [2023-12-26 00:54:43,798][123091] Updated weights for policy 0, policy_version 166550 (0.0007) [2023-12-26 00:54:43,853][123090] Updated weights for policy 1, policy_version 165794 (0.0011) [2023-12-26 00:54:43,864][123091] Updated weights for policy 0, policy_version 166560 (0.0008) [2023-12-26 00:54:43,907][123090] Updated weights for policy 1, policy_version 165804 (0.0010) [2023-12-26 00:54:43,966][123090] Updated weights for policy 1, policy_version 165814 (0.0010) [2023-12-26 00:54:44,035][123090] Updated weights for policy 1, policy_version 165824 (0.0010) [2023-12-26 00:54:44,617][123091] Updated weights for policy 0, policy_version 166570 (0.0009) [2023-12-26 00:54:44,679][123091] Updated weights for policy 0, policy_version 166580 (0.0010) [2023-12-26 00:54:44,749][123091] Updated weights for policy 0, policy_version 166590 (0.0010) [2023-12-26 00:54:44,806][123090] Updated weights for policy 1, policy_version 165834 (0.0008) [2023-12-26 00:54:44,855][123090] Updated weights for policy 1, policy_version 165844 (0.0005) [2023-12-26 00:54:44,922][123090] Updated weights for policy 1, policy_version 165854 (0.0006) [2023-12-26 00:54:45,629][123090] Updated weights for policy 1, policy_version 165864 (0.0009) [2023-12-26 00:54:45,667][123091] Updated weights for policy 0, policy_version 166600 (0.0007) [2023-12-26 00:54:45,690][123090] Updated weights for policy 1, policy_version 165874 (0.0011) [2023-12-26 00:54:45,732][123091] Updated weights for policy 0, policy_version 166610 (0.0008) [2023-12-26 00:54:45,757][123090] Updated weights for policy 1, policy_version 165884 (0.0011) [2023-12-26 00:54:45,799][123091] Updated weights for policy 0, policy_version 166620 (0.0009) [2023-12-26 00:54:46,553][123090] Updated weights for policy 1, policy_version 165894 (0.0010) [2023-12-26 00:54:46,619][123090] Updated weights for policy 1, policy_version 165904 (0.0009) [2023-12-26 00:54:46,644][123091] Updated weights for policy 0, policy_version 166630 (0.0008) [2023-12-26 00:54:46,687][123090] Updated weights for policy 1, policy_version 165914 (0.0009) [2023-12-26 00:54:46,703][123091] Updated weights for policy 0, policy_version 166640 (0.0006) [2023-12-26 00:54:46,758][123091] Updated weights for policy 0, policy_version 166650 (0.0005) [2023-12-26 00:54:47,451][123090] Updated weights for policy 1, policy_version 165924 (0.0008) [2023-12-26 00:54:47,502][123090] Updated weights for policy 1, policy_version 165934 (0.0005) [2023-12-26 00:54:47,524][123091] Updated weights for policy 0, policy_version 166660 (0.0006) [2023-12-26 00:54:47,560][123090] Updated weights for policy 1, policy_version 165944 (0.0005) [2023-12-26 00:54:47,587][123091] Updated weights for policy 0, policy_version 166670 (0.0010) [2023-12-26 00:54:47,643][123091] Updated weights for policy 0, policy_version 166680 (0.0009) [2023-12-26 00:54:48,190][123090] Updated weights for policy 1, policy_version 165954 (0.0006) [2023-12-26 00:54:48,254][123090] Updated weights for policy 1, policy_version 165964 (0.0011) [2023-12-26 00:54:48,325][123090] Updated weights for policy 1, policy_version 165974 (0.0011) [2023-12-26 00:54:48,396][123090] Updated weights for policy 1, policy_version 165984 (0.0011) [2023-12-26 00:54:48,524][123091] Updated weights for policy 0, policy_version 166690 (0.0008) [2023-12-26 00:54:48,589][123091] Updated weights for policy 0, policy_version 166700 (0.0007) [2023-12-26 00:54:48,651][123091] Updated weights for policy 0, policy_version 166710 (0.0009) [2023-12-26 00:54:48,723][123091] Updated weights for policy 0, policy_version 166720 (0.0006) [2023-12-26 00:54:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 85172224. Throughput: 0: 8852.5, 1: 8898.4. Samples: 85181016. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:48,785][121949] Avg episode reward: [(0, '5668.052'), (1, '5267.279')] [2023-12-26 00:54:49,205][123090] Updated weights for policy 1, policy_version 165994 (0.0010) [2023-12-26 00:54:49,276][123090] Updated weights for policy 1, policy_version 166004 (0.0011) [2023-12-26 00:54:49,347][123090] Updated weights for policy 1, policy_version 166014 (0.0011) [2023-12-26 00:54:49,368][123091] Updated weights for policy 0, policy_version 166730 (0.0007) [2023-12-26 00:54:49,425][123091] Updated weights for policy 0, policy_version 166740 (0.0009) [2023-12-26 00:54:49,483][123091] Updated weights for policy 0, policy_version 166750 (0.0006) [2023-12-26 00:54:50,114][123090] Updated weights for policy 1, policy_version 166024 (0.0006) [2023-12-26 00:54:50,172][123090] Updated weights for policy 1, policy_version 166034 (0.0005) [2023-12-26 00:54:50,221][123091] Updated weights for policy 0, policy_version 166760 (0.0009) [2023-12-26 00:54:50,233][123090] Updated weights for policy 1, policy_version 166044 (0.0006) [2023-12-26 00:54:50,285][123091] Updated weights for policy 0, policy_version 166770 (0.0011) [2023-12-26 00:54:50,337][123091] Updated weights for policy 0, policy_version 166780 (0.0011) [2023-12-26 00:54:50,989][123090] Updated weights for policy 1, policy_version 166054 (0.0008) [2023-12-26 00:54:51,056][123090] Updated weights for policy 1, policy_version 166064 (0.0011) [2023-12-26 00:54:51,119][123090] Updated weights for policy 1, policy_version 166074 (0.0009) [2023-12-26 00:54:51,144][123091] Updated weights for policy 0, policy_version 166790 (0.0011) [2023-12-26 00:54:51,207][123091] Updated weights for policy 0, policy_version 166800 (0.0011) [2023-12-26 00:54:51,274][123091] Updated weights for policy 0, policy_version 166810 (0.0011) [2023-12-26 00:54:51,964][123090] Updated weights for policy 1, policy_version 166084 (0.0011) [2023-12-26 00:54:52,027][123090] Updated weights for policy 1, policy_version 166094 (0.0010) [2023-12-26 00:54:52,077][123091] Updated weights for policy 0, policy_version 166820 (0.0011) [2023-12-26 00:54:52,090][123090] Updated weights for policy 1, policy_version 166104 (0.0010) [2023-12-26 00:54:52,133][123091] Updated weights for policy 0, policy_version 166830 (0.0011) [2023-12-26 00:54:52,189][123091] Updated weights for policy 0, policy_version 166840 (0.0011) [2023-12-26 00:54:52,858][123090] Updated weights for policy 1, policy_version 166114 (0.0009) [2023-12-26 00:54:52,915][123090] Updated weights for policy 1, policy_version 166124 (0.0005) [2023-12-26 00:54:52,981][123090] Updated weights for policy 1, policy_version 166134 (0.0006) [2023-12-26 00:54:53,033][123091] Updated weights for policy 0, policy_version 166850 (0.0010) [2023-12-26 00:54:53,043][123090] Updated weights for policy 1, policy_version 166144 (0.0008) [2023-12-26 00:54:53,098][123091] Updated weights for policy 0, policy_version 166860 (0.0009) [2023-12-26 00:54:53,164][123091] Updated weights for policy 0, policy_version 166870 (0.0011) [2023-12-26 00:54:53,226][123091] Updated weights for policy 0, policy_version 166880 (0.0011) [2023-12-26 00:54:53,688][123090] Updated weights for policy 1, policy_version 166154 (0.0009) [2023-12-26 00:54:53,744][123090] Updated weights for policy 1, policy_version 166164 (0.0007) [2023-12-26 00:54:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 85254144. Throughput: 0: 8890.9, 1: 8883.4. Samples: 85235328. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:53,785][121949] Avg episode reward: [(0, '5774.596'), (1, '4793.065')] [2023-12-26 00:54:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000166880_42721280.pth... [2023-12-26 00:54:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000165824_42450944.pth [2023-12-26 00:54:53,795][123090] Updated weights for policy 1, policy_version 166174 (0.0010) [2023-12-26 00:54:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000166176_42541056.pth... [2023-12-26 00:54:53,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000165120_42270720.pth [2023-12-26 00:54:53,946][123091] Updated weights for policy 0, policy_version 166890 (0.0010) [2023-12-26 00:54:53,997][123091] Updated weights for policy 0, policy_version 166900 (0.0010) [2023-12-26 00:54:54,047][123091] Updated weights for policy 0, policy_version 166910 (0.0010) [2023-12-26 00:54:54,545][123090] Updated weights for policy 1, policy_version 166184 (0.0006) [2023-12-26 00:54:54,621][123090] Updated weights for policy 1, policy_version 166194 (0.0005) [2023-12-26 00:54:54,694][123090] Updated weights for policy 1, policy_version 166204 (0.0005) [2023-12-26 00:54:54,852][123091] Updated weights for policy 0, policy_version 166920 (0.0006) [2023-12-26 00:54:54,897][123091] Updated weights for policy 0, policy_version 166930 (0.0005) [2023-12-26 00:54:54,951][123091] Updated weights for policy 0, policy_version 166940 (0.0006) [2023-12-26 00:54:55,398][123090] Updated weights for policy 1, policy_version 166214 (0.0005) [2023-12-26 00:54:55,446][123090] Updated weights for policy 1, policy_version 166224 (0.0005) [2023-12-26 00:54:55,508][123090] Updated weights for policy 1, policy_version 166234 (0.0009) [2023-12-26 00:54:55,615][123091] Updated weights for policy 0, policy_version 166950 (0.0009) [2023-12-26 00:54:55,674][123091] Updated weights for policy 0, policy_version 166960 (0.0011) [2023-12-26 00:54:55,738][123091] Updated weights for policy 0, policy_version 166970 (0.0008) [2023-12-26 00:54:56,274][123090] Updated weights for policy 1, policy_version 166244 (0.0007) [2023-12-26 00:54:56,340][123090] Updated weights for policy 1, policy_version 166254 (0.0005) [2023-12-26 00:54:56,396][123090] Updated weights for policy 1, policy_version 166264 (0.0005) [2023-12-26 00:54:56,541][123091] Updated weights for policy 0, policy_version 166980 (0.0008) [2023-12-26 00:54:56,599][123091] Updated weights for policy 0, policy_version 166990 (0.0010) [2023-12-26 00:54:56,655][123091] Updated weights for policy 0, policy_version 167000 (0.0009) [2023-12-26 00:54:56,993][123090] Updated weights for policy 1, policy_version 166274 (0.0005) [2023-12-26 00:54:57,054][123090] Updated weights for policy 1, policy_version 166284 (0.0005) [2023-12-26 00:54:57,112][123090] Updated weights for policy 1, policy_version 166294 (0.0005) [2023-12-26 00:54:57,176][123090] Updated weights for policy 1, policy_version 166304 (0.0005) [2023-12-26 00:54:57,551][123091] Updated weights for policy 0, policy_version 167010 (0.0009) [2023-12-26 00:54:57,598][123091] Updated weights for policy 0, policy_version 167020 (0.0010) [2023-12-26 00:54:57,642][123091] Updated weights for policy 0, policy_version 167030 (0.0010) [2023-12-26 00:54:57,700][123091] Updated weights for policy 0, policy_version 167040 (0.0010) [2023-12-26 00:54:57,851][123090] Updated weights for policy 1, policy_version 166314 (0.0005) [2023-12-26 00:54:57,920][123090] Updated weights for policy 1, policy_version 166324 (0.0005) [2023-12-26 00:54:57,984][123090] Updated weights for policy 1, policy_version 166334 (0.0006) [2023-12-26 00:54:58,508][123091] Updated weights for policy 0, policy_version 167050 (0.0008) [2023-12-26 00:54:58,576][123091] Updated weights for policy 0, policy_version 167060 (0.0007) [2023-12-26 00:54:58,645][123091] Updated weights for policy 0, policy_version 167070 (0.0010) [2023-12-26 00:54:58,759][123090] Updated weights for policy 1, policy_version 166344 (0.0009) [2023-12-26 00:54:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 85352448. Throughput: 0: 8932.0, 1: 8961.5. Samples: 85346400. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:54:58,784][121949] Avg episode reward: [(0, '5816.806'), (1, '4854.564')] [2023-12-26 00:54:58,833][123090] Updated weights for policy 1, policy_version 166354 (0.0009) [2023-12-26 00:54:58,904][123090] Updated weights for policy 1, policy_version 166364 (0.0009) [2023-12-26 00:54:59,527][123091] Updated weights for policy 0, policy_version 167080 (0.0009) [2023-12-26 00:54:59,586][123091] Updated weights for policy 0, policy_version 167090 (0.0008) [2023-12-26 00:54:59,638][123091] Updated weights for policy 0, policy_version 167100 (0.0008) [2023-12-26 00:54:59,715][123090] Updated weights for policy 1, policy_version 166374 (0.0007) [2023-12-26 00:54:59,780][123090] Updated weights for policy 1, policy_version 166384 (0.0008) [2023-12-26 00:54:59,843][123090] Updated weights for policy 1, policy_version 166394 (0.0008) [2023-12-26 00:55:00,408][123091] Updated weights for policy 0, policy_version 167110 (0.0006) [2023-12-26 00:55:00,466][123091] Updated weights for policy 0, policy_version 167120 (0.0007) [2023-12-26 00:55:00,529][123091] Updated weights for policy 0, policy_version 167130 (0.0009) [2023-12-26 00:55:00,604][123090] Updated weights for policy 1, policy_version 166404 (0.0009) [2023-12-26 00:55:00,657][123090] Updated weights for policy 1, policy_version 166414 (0.0009) [2023-12-26 00:55:00,704][123090] Updated weights for policy 1, policy_version 166424 (0.0010) [2023-12-26 00:55:01,332][123091] Updated weights for policy 0, policy_version 167140 (0.0009) [2023-12-26 00:55:01,401][123091] Updated weights for policy 0, policy_version 167150 (0.0009) [2023-12-26 00:55:01,461][123091] Updated weights for policy 0, policy_version 167160 (0.0005) [2023-12-26 00:55:01,574][123090] Updated weights for policy 1, policy_version 166434 (0.0010) [2023-12-26 00:55:01,639][123090] Updated weights for policy 1, policy_version 166444 (0.0010) [2023-12-26 00:55:01,700][123090] Updated weights for policy 1, policy_version 166454 (0.0010) [2023-12-26 00:55:01,776][123090] Updated weights for policy 1, policy_version 166464 (0.0006) [2023-12-26 00:55:02,240][123091] Updated weights for policy 0, policy_version 167170 (0.0009) [2023-12-26 00:55:02,302][123091] Updated weights for policy 0, policy_version 167180 (0.0006) [2023-12-26 00:55:02,363][123091] Updated weights for policy 0, policy_version 167190 (0.0009) [2023-12-26 00:55:02,425][123091] Updated weights for policy 0, policy_version 167200 (0.0009) [2023-12-26 00:55:02,468][123090] Updated weights for policy 1, policy_version 166474 (0.0009) [2023-12-26 00:55:02,529][123090] Updated weights for policy 1, policy_version 166484 (0.0008) [2023-12-26 00:55:02,578][123090] Updated weights for policy 1, policy_version 166494 (0.0009) [2023-12-26 00:55:03,184][123091] Updated weights for policy 0, policy_version 167210 (0.0005) [2023-12-26 00:55:03,236][123091] Updated weights for policy 0, policy_version 167220 (0.0005) [2023-12-26 00:55:03,271][123090] Updated weights for policy 1, policy_version 166504 (0.0006) [2023-12-26 00:55:03,286][123091] Updated weights for policy 0, policy_version 167230 (0.0005) [2023-12-26 00:55:03,319][123090] Updated weights for policy 1, policy_version 166514 (0.0005) [2023-12-26 00:55:03,372][123090] Updated weights for policy 1, policy_version 166524 (0.0005) [2023-12-26 00:55:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 85442560. Throughput: 0: 8935.6, 1: 8986.0. Samples: 85454456. Policy #0 lag: (min: 9.0, avg: 30.7, max: 41.0) [2023-12-26 00:55:03,785][121949] Avg episode reward: [(0, '5830.468'), (1, '5063.608')] [2023-12-26 00:55:03,955][123090] Updated weights for policy 1, policy_version 166534 (0.0005) [2023-12-26 00:55:04,028][123090] Updated weights for policy 1, policy_version 166544 (0.0007) [2023-12-26 00:55:04,071][123091] Updated weights for policy 0, policy_version 167240 (0.0007) [2023-12-26 00:55:04,103][123090] Updated weights for policy 1, policy_version 166554 (0.0009) [2023-12-26 00:55:04,141][123091] Updated weights for policy 0, policy_version 167250 (0.0008) [2023-12-26 00:55:04,201][123091] Updated weights for policy 0, policy_version 167260 (0.0006) [2023-12-26 00:55:04,924][123090] Updated weights for policy 1, policy_version 166564 (0.0008) [2023-12-26 00:55:04,992][123090] Updated weights for policy 1, policy_version 166574 (0.0006) [2023-12-26 00:55:04,994][123091] Updated weights for policy 0, policy_version 167270 (0.0009) [2023-12-26 00:55:05,048][123090] Updated weights for policy 1, policy_version 166584 (0.0006) [2023-12-26 00:55:05,053][123091] Updated weights for policy 0, policy_version 167280 (0.0010) [2023-12-26 00:55:05,108][123091] Updated weights for policy 0, policy_version 167290 (0.0010) [2023-12-26 00:55:05,805][123091] Updated weights for policy 0, policy_version 167300 (0.0006) [2023-12-26 00:55:05,863][123091] Updated weights for policy 0, policy_version 167310 (0.0006) [2023-12-26 00:55:05,903][123090] Updated weights for policy 1, policy_version 166594 (0.0007) [2023-12-26 00:55:05,924][123091] Updated weights for policy 0, policy_version 167320 (0.0007) [2023-12-26 00:55:05,974][123090] Updated weights for policy 1, policy_version 166604 (0.0008) [2023-12-26 00:55:06,034][123090] Updated weights for policy 1, policy_version 166614 (0.0009) [2023-12-26 00:55:06,099][123090] Updated weights for policy 1, policy_version 166624 (0.0010) [2023-12-26 00:55:06,609][123091] Updated weights for policy 0, policy_version 167330 (0.0006) [2023-12-26 00:55:06,670][123091] Updated weights for policy 0, policy_version 167340 (0.0011) [2023-12-26 00:55:06,725][123091] Updated weights for policy 0, policy_version 167350 (0.0010) [2023-12-26 00:55:06,776][123091] Updated weights for policy 0, policy_version 167360 (0.0008) [2023-12-26 00:55:06,940][123090] Updated weights for policy 1, policy_version 166634 (0.0010) [2023-12-26 00:55:06,999][123090] Updated weights for policy 1, policy_version 166644 (0.0010) [2023-12-26 00:55:07,058][123090] Updated weights for policy 1, policy_version 166654 (0.0010) [2023-12-26 00:55:07,464][123091] Updated weights for policy 0, policy_version 167370 (0.0005) [2023-12-26 00:55:07,533][123091] Updated weights for policy 0, policy_version 167380 (0.0008) [2023-12-26 00:55:07,589][123091] Updated weights for policy 0, policy_version 167390 (0.0010) [2023-12-26 00:55:07,961][123090] Updated weights for policy 1, policy_version 166664 (0.0010) [2023-12-26 00:55:08,016][123090] Updated weights for policy 1, policy_version 166675 (0.0009) [2023-12-26 00:55:08,074][123090] Updated weights for policy 1, policy_version 166685 (0.0009) [2023-12-26 00:55:08,311][123091] Updated weights for policy 0, policy_version 167400 (0.0006) [2023-12-26 00:55:08,377][123091] Updated weights for policy 0, policy_version 167410 (0.0009) [2023-12-26 00:55:08,440][123091] Updated weights for policy 0, policy_version 167420 (0.0010) [2023-12-26 00:55:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 85532672. Throughput: 0: 9030.2, 1: 9009.1. Samples: 85509084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:08,784][121949] Avg episode reward: [(0, '5774.594'), (1, '5165.715')] [2023-12-26 00:55:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000166688_42672128.pth... [2023-12-26 00:55:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000167424_42860544.pth... [2023-12-26 00:55:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000166368_42590208.pth [2023-12-26 00:55:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000165632_42401792.pth [2023-12-26 00:55:08,971][123090] Updated weights for policy 1, policy_version 166696 (0.0010) [2023-12-26 00:55:09,031][123090] Updated weights for policy 1, policy_version 166706 (0.0009) [2023-12-26 00:55:09,087][123090] Updated weights for policy 1, policy_version 166716 (0.0008) [2023-12-26 00:55:09,261][123091] Updated weights for policy 0, policy_version 167430 (0.0011) [2023-12-26 00:55:09,324][123091] Updated weights for policy 0, policy_version 167440 (0.0011) [2023-12-26 00:55:09,399][123091] Updated weights for policy 0, policy_version 167450 (0.0011) [2023-12-26 00:55:09,928][123090] Updated weights for policy 1, policy_version 166726 (0.0009) [2023-12-26 00:55:09,988][123090] Updated weights for policy 1, policy_version 166736 (0.0011) [2023-12-26 00:55:10,053][123090] Updated weights for policy 1, policy_version 166746 (0.0011) [2023-12-26 00:55:10,180][123091] Updated weights for policy 0, policy_version 167460 (0.0012) [2023-12-26 00:55:10,242][123091] Updated weights for policy 0, policy_version 167470 (0.0007) [2023-12-26 00:55:10,302][123091] Updated weights for policy 0, policy_version 167480 (0.0007) [2023-12-26 00:55:10,876][123090] Updated weights for policy 1, policy_version 166756 (0.0011) [2023-12-26 00:55:10,939][123090] Updated weights for policy 1, policy_version 166766 (0.0008) [2023-12-26 00:55:11,008][123090] Updated weights for policy 1, policy_version 166776 (0.0006) [2023-12-26 00:55:11,042][123091] Updated weights for policy 0, policy_version 167490 (0.0009) [2023-12-26 00:55:11,113][123091] Updated weights for policy 0, policy_version 167500 (0.0009) [2023-12-26 00:55:11,186][123091] Updated weights for policy 0, policy_version 167510 (0.0009) [2023-12-26 00:55:11,258][123091] Updated weights for policy 0, policy_version 167520 (0.0010) [2023-12-26 00:55:11,881][123090] Updated weights for policy 1, policy_version 166786 (0.0009) [2023-12-26 00:55:11,936][123090] Updated weights for policy 1, policy_version 166796 (0.0009) [2023-12-26 00:55:12,003][123090] Updated weights for policy 1, policy_version 166806 (0.0009) [2023-12-26 00:55:12,065][123090] Updated weights for policy 1, policy_version 166816 (0.0009) [2023-12-26 00:55:12,108][123091] Updated weights for policy 0, policy_version 167530 (0.0008) [2023-12-26 00:55:12,164][123091] Updated weights for policy 0, policy_version 167540 (0.0008) [2023-12-26 00:55:12,212][123091] Updated weights for policy 0, policy_version 167550 (0.0008) [2023-12-26 00:55:12,892][123090] Updated weights for policy 1, policy_version 166826 (0.0005) [2023-12-26 00:55:12,943][123090] Updated weights for policy 1, policy_version 166836 (0.0005) [2023-12-26 00:55:12,992][123090] Updated weights for policy 1, policy_version 166846 (0.0005) [2023-12-26 00:55:13,088][123091] Updated weights for policy 0, policy_version 167560 (0.0010) [2023-12-26 00:55:13,146][123091] Updated weights for policy 0, policy_version 167570 (0.0010) [2023-12-26 00:55:13,205][123091] Updated weights for policy 0, policy_version 167580 (0.0010) [2023-12-26 00:55:13,697][123090] Updated weights for policy 1, policy_version 166856 (0.0005) [2023-12-26 00:55:13,753][123090] Updated weights for policy 1, policy_version 166866 (0.0007) [2023-12-26 00:55:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 85614592. Throughput: 0: 9016.5, 1: 8875.0. Samples: 85611840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:13,785][121949] Avg episode reward: [(0, '5788.558'), (1, '5256.833')] [2023-12-26 00:55:13,801][123090] Updated weights for policy 1, policy_version 166876 (0.0007) [2023-12-26 00:55:14,023][123091] Updated weights for policy 0, policy_version 167590 (0.0007) [2023-12-26 00:55:14,089][123091] Updated weights for policy 0, policy_version 167600 (0.0006) [2023-12-26 00:55:14,146][123091] Updated weights for policy 0, policy_version 167610 (0.0005) [2023-12-26 00:55:14,619][123090] Updated weights for policy 1, policy_version 166886 (0.0007) [2023-12-26 00:55:14,679][123090] Updated weights for policy 1, policy_version 166896 (0.0008) [2023-12-26 00:55:14,746][123090] Updated weights for policy 1, policy_version 166906 (0.0006) [2023-12-26 00:55:14,777][123091] Updated weights for policy 0, policy_version 167620 (0.0006) [2023-12-26 00:55:14,835][123091] Updated weights for policy 0, policy_version 167630 (0.0006) [2023-12-26 00:55:14,894][123091] Updated weights for policy 0, policy_version 167640 (0.0006) [2023-12-26 00:55:15,616][123090] Updated weights for policy 1, policy_version 166916 (0.0008) [2023-12-26 00:55:15,673][123090] Updated weights for policy 1, policy_version 166926 (0.0009) [2023-12-26 00:55:15,676][123091] Updated weights for policy 0, policy_version 167650 (0.0007) [2023-12-26 00:55:15,734][123090] Updated weights for policy 1, policy_version 166936 (0.0009) [2023-12-26 00:55:15,740][123091] Updated weights for policy 0, policy_version 167660 (0.0007) [2023-12-26 00:55:15,797][123091] Updated weights for policy 0, policy_version 167670 (0.0006) [2023-12-26 00:55:15,849][123091] Updated weights for policy 0, policy_version 167680 (0.0010) [2023-12-26 00:55:16,448][123090] Updated weights for policy 1, policy_version 166946 (0.0008) [2023-12-26 00:55:16,507][123090] Updated weights for policy 1, policy_version 166956 (0.0005) [2023-12-26 00:55:16,508][123091] Updated weights for policy 0, policy_version 167690 (0.0005) [2023-12-26 00:55:16,557][123091] Updated weights for policy 0, policy_version 167700 (0.0005) [2023-12-26 00:55:16,578][123090] Updated weights for policy 1, policy_version 166966 (0.0005) [2023-12-26 00:55:16,602][123091] Updated weights for policy 0, policy_version 167710 (0.0005) [2023-12-26 00:55:16,638][123090] Updated weights for policy 1, policy_version 166976 (0.0007) [2023-12-26 00:55:17,257][123091] Updated weights for policy 0, policy_version 167720 (0.0005) [2023-12-26 00:55:17,313][123091] Updated weights for policy 0, policy_version 167730 (0.0010) [2023-12-26 00:55:17,367][123091] Updated weights for policy 0, policy_version 167740 (0.0010) [2023-12-26 00:55:17,395][123090] Updated weights for policy 1, policy_version 166986 (0.0005) [2023-12-26 00:55:17,443][123090] Updated weights for policy 1, policy_version 166996 (0.0009) [2023-12-26 00:55:17,491][123090] Updated weights for policy 1, policy_version 167006 (0.0009) [2023-12-26 00:55:18,170][123091] Updated weights for policy 0, policy_version 167750 (0.0007) [2023-12-26 00:55:18,243][123091] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-12-26 00:55:18,300][123090] Updated weights for policy 1, policy_version 167016 (0.0010) [2023-12-26 00:55:18,310][123091] Updated weights for policy 0, policy_version 167770 (0.0005) [2023-12-26 00:55:18,360][123090] Updated weights for policy 1, policy_version 167026 (0.0010) [2023-12-26 00:55:18,408][123090] Updated weights for policy 1, policy_version 167036 (0.0010) [2023-12-26 00:55:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 85712896. Throughput: 0: 9090.2, 1: 8939.4. Samples: 85724268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:18,784][121949] Avg episode reward: [(0, '5865.739'), (1, '5397.159')] [2023-12-26 00:55:18,940][123091] Updated weights for policy 0, policy_version 167780 (0.0007) [2023-12-26 00:55:18,998][123091] Updated weights for policy 0, policy_version 167790 (0.0007) [2023-12-26 00:55:19,050][123091] Updated weights for policy 0, policy_version 167800 (0.0010) [2023-12-26 00:55:19,256][123090] Updated weights for policy 1, policy_version 167046 (0.0011) [2023-12-26 00:55:19,312][123090] Updated weights for policy 1, policy_version 167056 (0.0010) [2023-12-26 00:55:19,380][123090] Updated weights for policy 1, policy_version 167066 (0.0010) [2023-12-26 00:55:19,876][123091] Updated weights for policy 0, policy_version 167810 (0.0010) [2023-12-26 00:55:19,945][123091] Updated weights for policy 0, policy_version 167820 (0.0010) [2023-12-26 00:55:20,011][123091] Updated weights for policy 0, policy_version 167830 (0.0009) [2023-12-26 00:55:20,066][123091] Updated weights for policy 0, policy_version 167840 (0.0008) [2023-12-26 00:55:20,259][123090] Updated weights for policy 1, policy_version 167076 (0.0010) [2023-12-26 00:55:20,332][123090] Updated weights for policy 1, policy_version 167086 (0.0009) [2023-12-26 00:55:20,394][123090] Updated weights for policy 1, policy_version 167096 (0.0009) [2023-12-26 00:55:20,932][123091] Updated weights for policy 0, policy_version 167850 (0.0010) [2023-12-26 00:55:21,004][123091] Updated weights for policy 0, policy_version 167860 (0.0010) [2023-12-26 00:55:21,074][123091] Updated weights for policy 0, policy_version 167870 (0.0008) [2023-12-26 00:55:21,225][123090] Updated weights for policy 1, policy_version 167106 (0.0009) [2023-12-26 00:55:21,287][123090] Updated weights for policy 1, policy_version 167116 (0.0009) [2023-12-26 00:55:21,362][123090] Updated weights for policy 1, policy_version 167126 (0.0009) [2023-12-26 00:55:21,435][123090] Updated weights for policy 1, policy_version 167136 (0.0009) [2023-12-26 00:55:21,902][123091] Updated weights for policy 0, policy_version 167880 (0.0007) [2023-12-26 00:55:21,971][123091] Updated weights for policy 0, policy_version 167890 (0.0007) [2023-12-26 00:55:22,041][123091] Updated weights for policy 0, policy_version 167900 (0.0009) [2023-12-26 00:55:22,300][123090] Updated weights for policy 1, policy_version 167146 (0.0006) [2023-12-26 00:55:22,377][123090] Updated weights for policy 1, policy_version 167156 (0.0009) [2023-12-26 00:55:22,436][123090] Updated weights for policy 1, policy_version 167166 (0.0013) [2023-12-26 00:55:22,834][123091] Updated weights for policy 0, policy_version 167910 (0.0009) [2023-12-26 00:55:22,909][123091] Updated weights for policy 0, policy_version 167920 (0.0007) [2023-12-26 00:55:22,979][123091] Updated weights for policy 0, policy_version 167930 (0.0007) [2023-12-26 00:55:23,193][123090] Updated weights for policy 1, policy_version 167176 (0.0010) [2023-12-26 00:55:23,256][123090] Updated weights for policy 1, policy_version 167186 (0.0008) [2023-12-26 00:55:23,327][123090] Updated weights for policy 1, policy_version 167196 (0.0005) [2023-12-26 00:55:23,720][123091] Updated weights for policy 0, policy_version 167940 (0.0009) [2023-12-26 00:55:23,775][123091] Updated weights for policy 0, policy_version 167951 (0.0011) [2023-12-26 00:55:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 85794816. Throughput: 0: 9041.7, 1: 8888.8. Samples: 85775028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:23,785][121949] Avg episode reward: [(0, '5709.966'), (1, '5377.250')] [2023-12-26 00:55:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000167200_42803200.pth... [2023-12-26 00:55:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000166176_42541056.pth [2023-12-26 00:55:23,845][123091] Updated weights for policy 0, policy_version 167961 (0.0010) [2023-12-26 00:55:23,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000167968_42999808.pth... [2023-12-26 00:55:23,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000166880_42721280.pth [2023-12-26 00:55:24,006][123090] Updated weights for policy 1, policy_version 167206 (0.0010) [2023-12-26 00:55:24,074][123090] Updated weights for policy 1, policy_version 167216 (0.0008) [2023-12-26 00:55:24,141][123090] Updated weights for policy 1, policy_version 167226 (0.0007) [2023-12-26 00:55:24,776][123091] Updated weights for policy 0, policy_version 167971 (0.0010) [2023-12-26 00:55:24,791][123090] Updated weights for policy 1, policy_version 167236 (0.0007) [2023-12-26 00:55:24,842][123091] Updated weights for policy 0, policy_version 167981 (0.0007) [2023-12-26 00:55:24,860][123090] Updated weights for policy 1, policy_version 167246 (0.0008) [2023-12-26 00:55:24,903][123091] Updated weights for policy 0, policy_version 167991 (0.0009) [2023-12-26 00:55:24,929][123090] Updated weights for policy 1, policy_version 167256 (0.0007) [2023-12-26 00:55:25,620][123090] Updated weights for policy 1, policy_version 167266 (0.0008) [2023-12-26 00:55:25,677][123090] Updated weights for policy 1, policy_version 167276 (0.0005) [2023-12-26 00:55:25,731][123090] Updated weights for policy 1, policy_version 167286 (0.0005) [2023-12-26 00:55:25,777][123091] Updated weights for policy 0, policy_version 168001 (0.0008) [2023-12-26 00:55:25,793][123090] Updated weights for policy 1, policy_version 167296 (0.0005) [2023-12-26 00:55:25,827][123091] Updated weights for policy 0, policy_version 168011 (0.0009) [2023-12-26 00:55:25,877][123091] Updated weights for policy 0, policy_version 168021 (0.0009) [2023-12-26 00:55:25,931][123091] Updated weights for policy 0, policy_version 168031 (0.0010) [2023-12-26 00:55:26,513][123090] Updated weights for policy 1, policy_version 167306 (0.0009) [2023-12-26 00:55:26,580][123090] Updated weights for policy 1, policy_version 167316 (0.0009) [2023-12-26 00:55:26,644][123090] Updated weights for policy 1, policy_version 167326 (0.0010) [2023-12-26 00:55:26,825][123091] Updated weights for policy 0, policy_version 168041 (0.0009) [2023-12-26 00:55:26,885][123091] Updated weights for policy 0, policy_version 168051 (0.0009) [2023-12-26 00:55:26,950][123091] Updated weights for policy 0, policy_version 168061 (0.0009) [2023-12-26 00:55:27,461][123090] Updated weights for policy 1, policy_version 167336 (0.0008) [2023-12-26 00:55:27,508][123090] Updated weights for policy 1, policy_version 167346 (0.0005) [2023-12-26 00:55:27,554][123090] Updated weights for policy 1, policy_version 167356 (0.0005) [2023-12-26 00:55:27,761][123091] Updated weights for policy 0, policy_version 168071 (0.0006) [2023-12-26 00:55:27,812][123091] Updated weights for policy 0, policy_version 168081 (0.0005) [2023-12-26 00:55:27,858][123091] Updated weights for policy 0, policy_version 168091 (0.0005) [2023-12-26 00:55:28,178][123090] Updated weights for policy 1, policy_version 167366 (0.0005) [2023-12-26 00:55:28,229][123090] Updated weights for policy 1, policy_version 167376 (0.0005) [2023-12-26 00:55:28,275][123090] Updated weights for policy 1, policy_version 167386 (0.0005) [2023-12-26 00:55:28,555][123091] Updated weights for policy 0, policy_version 168101 (0.0005) [2023-12-26 00:55:28,612][123091] Updated weights for policy 0, policy_version 168111 (0.0006) [2023-12-26 00:55:28,683][123091] Updated weights for policy 0, policy_version 168121 (0.0006) [2023-12-26 00:55:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 85893120. Throughput: 0: 8939.1, 1: 9026.4. Samples: 85881468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:28,785][121949] Avg episode reward: [(0, '5651.330'), (1, '5371.777')] [2023-12-26 00:55:29,012][123090] Updated weights for policy 1, policy_version 167396 (0.0005) [2023-12-26 00:55:29,067][123090] Updated weights for policy 1, policy_version 167406 (0.0005) [2023-12-26 00:55:29,122][123090] Updated weights for policy 1, policy_version 167416 (0.0005) [2023-12-26 00:55:29,413][123091] Updated weights for policy 0, policy_version 168131 (0.0006) [2023-12-26 00:55:29,479][123091] Updated weights for policy 0, policy_version 168141 (0.0006) [2023-12-26 00:55:29,543][123091] Updated weights for policy 0, policy_version 168151 (0.0007) [2023-12-26 00:55:29,917][123090] Updated weights for policy 1, policy_version 167426 (0.0006) [2023-12-26 00:55:29,989][123090] Updated weights for policy 1, policy_version 167436 (0.0006) [2023-12-26 00:55:30,065][123090] Updated weights for policy 1, policy_version 167446 (0.0006) [2023-12-26 00:55:30,120][123090] Updated weights for policy 1, policy_version 167456 (0.0007) [2023-12-26 00:55:30,300][123091] Updated weights for policy 0, policy_version 168161 (0.0010) [2023-12-26 00:55:30,351][123091] Updated weights for policy 0, policy_version 168171 (0.0010) [2023-12-26 00:55:30,414][123091] Updated weights for policy 0, policy_version 168181 (0.0007) [2023-12-26 00:55:30,474][123091] Updated weights for policy 0, policy_version 168191 (0.0005) [2023-12-26 00:55:30,765][123090] Updated weights for policy 1, policy_version 167466 (0.0009) [2023-12-26 00:55:30,819][123090] Updated weights for policy 1, policy_version 167476 (0.0010) [2023-12-26 00:55:30,871][123090] Updated weights for policy 1, policy_version 167487 (0.0010) [2023-12-26 00:55:31,228][123091] Updated weights for policy 0, policy_version 168201 (0.0009) [2023-12-26 00:55:31,288][123091] Updated weights for policy 0, policy_version 168211 (0.0008) [2023-12-26 00:55:31,345][123091] Updated weights for policy 0, policy_version 168221 (0.0006) [2023-12-26 00:55:31,683][123090] Updated weights for policy 1, policy_version 167497 (0.0008) [2023-12-26 00:55:31,753][123090] Updated weights for policy 1, policy_version 167507 (0.0006) [2023-12-26 00:55:31,818][123090] Updated weights for policy 1, policy_version 167517 (0.0005) [2023-12-26 00:55:32,162][123091] Updated weights for policy 0, policy_version 168231 (0.0009) [2023-12-26 00:55:32,219][123091] Updated weights for policy 0, policy_version 168241 (0.0009) [2023-12-26 00:55:32,283][123091] Updated weights for policy 0, policy_version 168251 (0.0009) [2023-12-26 00:55:32,590][123090] Updated weights for policy 1, policy_version 167527 (0.0009) [2023-12-26 00:55:32,656][123090] Updated weights for policy 1, policy_version 167537 (0.0010) [2023-12-26 00:55:32,722][123090] Updated weights for policy 1, policy_version 167547 (0.0010) [2023-12-26 00:55:33,140][123091] Updated weights for policy 0, policy_version 168261 (0.0009) [2023-12-26 00:55:33,196][123091] Updated weights for policy 0, policy_version 168271 (0.0009) [2023-12-26 00:55:33,247][123091] Updated weights for policy 0, policy_version 168281 (0.0010) [2023-12-26 00:55:33,392][123090] Updated weights for policy 1, policy_version 167557 (0.0008) [2023-12-26 00:55:33,436][123090] Updated weights for policy 1, policy_version 167567 (0.0005) [2023-12-26 00:55:33,485][123090] Updated weights for policy 1, policy_version 167577 (0.0008) [2023-12-26 00:55:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 85983232. Throughput: 0: 8980.8, 1: 9071.5. Samples: 85993368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:33,785][121949] Avg episode reward: [(0, '5757.043'), (1, '5459.317')] [2023-12-26 00:55:34,109][123091] Updated weights for policy 0, policy_version 168291 (0.0009) [2023-12-26 00:55:34,168][123091] Updated weights for policy 0, policy_version 168301 (0.0009) [2023-12-26 00:55:34,241][123091] Updated weights for policy 0, policy_version 168311 (0.0010) [2023-12-26 00:55:34,250][123090] Updated weights for policy 1, policy_version 167587 (0.0010) [2023-12-26 00:55:34,309][123090] Updated weights for policy 1, policy_version 167597 (0.0008) [2023-12-26 00:55:34,366][123090] Updated weights for policy 1, policy_version 167607 (0.0010) [2023-12-26 00:55:35,039][123091] Updated weights for policy 0, policy_version 168321 (0.0007) [2023-12-26 00:55:35,095][123091] Updated weights for policy 0, policy_version 168331 (0.0010) [2023-12-26 00:55:35,146][123091] Updated weights for policy 0, policy_version 168341 (0.0010) [2023-12-26 00:55:35,156][123090] Updated weights for policy 1, policy_version 167617 (0.0010) [2023-12-26 00:55:35,204][123091] Updated weights for policy 0, policy_version 168351 (0.0007) [2023-12-26 00:55:35,226][123090] Updated weights for policy 1, policy_version 167627 (0.0008) [2023-12-26 00:55:35,291][123090] Updated weights for policy 1, policy_version 167637 (0.0005) [2023-12-26 00:55:35,354][123090] Updated weights for policy 1, policy_version 167647 (0.0006) [2023-12-26 00:55:35,948][123091] Updated weights for policy 0, policy_version 168361 (0.0006) [2023-12-26 00:55:36,015][123091] Updated weights for policy 0, policy_version 168371 (0.0008) [2023-12-26 00:55:36,078][123091] Updated weights for policy 0, policy_version 168381 (0.0008) [2023-12-26 00:55:36,080][123090] Updated weights for policy 1, policy_version 167657 (0.0008) [2023-12-26 00:55:36,149][123090] Updated weights for policy 1, policy_version 167667 (0.0009) [2023-12-26 00:55:36,218][123090] Updated weights for policy 1, policy_version 167677 (0.0009) [2023-12-26 00:55:36,844][123091] Updated weights for policy 0, policy_version 168391 (0.0009) [2023-12-26 00:55:36,906][123091] Updated weights for policy 0, policy_version 168401 (0.0009) [2023-12-26 00:55:36,966][123091] Updated weights for policy 0, policy_version 168411 (0.0010) [2023-12-26 00:55:37,045][123090] Updated weights for policy 1, policy_version 167687 (0.0009) [2023-12-26 00:55:37,120][123090] Updated weights for policy 1, policy_version 167697 (0.0008) [2023-12-26 00:55:37,191][123090] Updated weights for policy 1, policy_version 167707 (0.0009) [2023-12-26 00:55:37,732][123091] Updated weights for policy 0, policy_version 168421 (0.0008) [2023-12-26 00:55:37,788][123091] Updated weights for policy 0, policy_version 168431 (0.0005) [2023-12-26 00:55:37,852][123091] Updated weights for policy 0, policy_version 168441 (0.0006) [2023-12-26 00:55:37,880][123090] Updated weights for policy 1, policy_version 167717 (0.0009) [2023-12-26 00:55:37,946][123090] Updated weights for policy 1, policy_version 167727 (0.0009) [2023-12-26 00:55:38,012][123090] Updated weights for policy 1, policy_version 167737 (0.0009) [2023-12-26 00:55:38,582][123091] Updated weights for policy 0, policy_version 168451 (0.0007) [2023-12-26 00:55:38,647][123091] Updated weights for policy 0, policy_version 168461 (0.0010) [2023-12-26 00:55:38,716][123091] Updated weights for policy 0, policy_version 168471 (0.0009) [2023-12-26 00:55:38,731][123090] Updated weights for policy 1, policy_version 167747 (0.0007) [2023-12-26 00:55:38,780][123090] Updated weights for policy 1, policy_version 167757 (0.0006) [2023-12-26 00:55:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 86073344. Throughput: 0: 8969.9, 1: 9075.1. Samples: 86047352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:38,785][121949] Avg episode reward: [(0, '5815.255'), (1, '5432.096')] [2023-12-26 00:55:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000168480_43130880.pth... [2023-12-26 00:55:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000167424_42860544.pth [2023-12-26 00:55:38,842][123090] Updated weights for policy 1, policy_version 167767 (0.0009) [2023-12-26 00:55:38,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000167776_42950656.pth... [2023-12-26 00:55:38,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000166688_42672128.pth [2023-12-26 00:55:39,602][123091] Updated weights for policy 0, policy_version 168481 (0.0008) [2023-12-26 00:55:39,631][123090] Updated weights for policy 1, policy_version 167777 (0.0008) [2023-12-26 00:55:39,669][123091] Updated weights for policy 0, policy_version 168491 (0.0010) [2023-12-26 00:55:39,696][123090] Updated weights for policy 1, policy_version 167787 (0.0008) [2023-12-26 00:55:39,726][123091] Updated weights for policy 0, policy_version 168501 (0.0006) [2023-12-26 00:55:39,757][123090] Updated weights for policy 1, policy_version 167797 (0.0011) [2023-12-26 00:55:39,790][123091] Updated weights for policy 0, policy_version 168511 (0.0007) [2023-12-26 00:55:39,812][123090] Updated weights for policy 1, policy_version 167807 (0.0010) [2023-12-26 00:55:40,527][123090] Updated weights for policy 1, policy_version 167817 (0.0006) [2023-12-26 00:55:40,579][123090] Updated weights for policy 1, policy_version 167827 (0.0005) [2023-12-26 00:55:40,642][123090] Updated weights for policy 1, policy_version 167837 (0.0005) [2023-12-26 00:55:40,644][123091] Updated weights for policy 0, policy_version 168521 (0.0010) [2023-12-26 00:55:40,691][123091] Updated weights for policy 0, policy_version 168531 (0.0010) [2023-12-26 00:55:40,738][123091] Updated weights for policy 0, policy_version 168541 (0.0010) [2023-12-26 00:55:41,449][123090] Updated weights for policy 1, policy_version 167847 (0.0009) [2023-12-26 00:55:41,518][123090] Updated weights for policy 1, policy_version 167857 (0.0009) [2023-12-26 00:55:41,589][123090] Updated weights for policy 1, policy_version 167867 (0.0010) [2023-12-26 00:55:41,653][123091] Updated weights for policy 0, policy_version 168551 (0.0010) [2023-12-26 00:55:41,717][123091] Updated weights for policy 0, policy_version 168561 (0.0009) [2023-12-26 00:55:41,786][123091] Updated weights for policy 0, policy_version 168571 (0.0007) [2023-12-26 00:55:42,470][123090] Updated weights for policy 1, policy_version 167877 (0.0010) [2023-12-26 00:55:42,534][123090] Updated weights for policy 1, policy_version 167887 (0.0011) [2023-12-26 00:55:42,589][123091] Updated weights for policy 0, policy_version 168581 (0.0006) [2023-12-26 00:55:42,599][123090] Updated weights for policy 1, policy_version 167897 (0.0009) [2023-12-26 00:55:42,667][123091] Updated weights for policy 0, policy_version 168591 (0.0011) [2023-12-26 00:55:42,738][123091] Updated weights for policy 0, policy_version 168601 (0.0011) [2023-12-26 00:55:43,344][123090] Updated weights for policy 1, policy_version 167907 (0.0005) [2023-12-26 00:55:43,418][123090] Updated weights for policy 1, policy_version 167917 (0.0006) [2023-12-26 00:55:43,437][123091] Updated weights for policy 0, policy_version 168611 (0.0009) [2023-12-26 00:55:43,483][123090] Updated weights for policy 1, policy_version 167927 (0.0009) [2023-12-26 00:55:43,485][123091] Updated weights for policy 0, policy_version 168621 (0.0005) [2023-12-26 00:55:43,545][123091] Updated weights for policy 0, policy_version 168631 (0.0005) [2023-12-26 00:55:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 86163456. Throughput: 0: 8924.3, 1: 8990.4. Samples: 86152564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:43,786][121949] Avg episode reward: [(0, '5736.762'), (1, '5220.200')] [2023-12-26 00:55:44,143][123090] Updated weights for policy 1, policy_version 167937 (0.0005) [2023-12-26 00:55:44,155][123091] Updated weights for policy 0, policy_version 168641 (0.0006) [2023-12-26 00:55:44,206][123090] Updated weights for policy 1, policy_version 167947 (0.0006) [2023-12-26 00:55:44,223][123091] Updated weights for policy 0, policy_version 168651 (0.0006) [2023-12-26 00:55:44,259][123090] Updated weights for policy 1, policy_version 167957 (0.0005) [2023-12-26 00:55:44,298][123091] Updated weights for policy 0, policy_version 168661 (0.0005) [2023-12-26 00:55:44,317][123090] Updated weights for policy 1, policy_version 167967 (0.0005) [2023-12-26 00:55:44,357][123091] Updated weights for policy 0, policy_version 168671 (0.0005) [2023-12-26 00:55:45,000][123090] Updated weights for policy 1, policy_version 167977 (0.0009) [2023-12-26 00:55:45,025][123091] Updated weights for policy 0, policy_version 168681 (0.0009) [2023-12-26 00:55:45,065][123090] Updated weights for policy 1, policy_version 167987 (0.0010) [2023-12-26 00:55:45,084][123091] Updated weights for policy 0, policy_version 168691 (0.0011) [2023-12-26 00:55:45,129][123090] Updated weights for policy 1, policy_version 167997 (0.0011) [2023-12-26 00:55:45,145][123091] Updated weights for policy 0, policy_version 168701 (0.0011) [2023-12-26 00:55:45,903][123090] Updated weights for policy 1, policy_version 168007 (0.0007) [2023-12-26 00:55:45,962][123090] Updated weights for policy 1, policy_version 168017 (0.0005) [2023-12-26 00:55:45,989][123091] Updated weights for policy 0, policy_version 168711 (0.0009) [2023-12-26 00:55:46,024][123090] Updated weights for policy 1, policy_version 168027 (0.0005) [2023-12-26 00:55:46,052][123091] Updated weights for policy 0, policy_version 168721 (0.0009) [2023-12-26 00:55:46,106][123091] Updated weights for policy 0, policy_version 168731 (0.0010) [2023-12-26 00:55:46,639][123090] Updated weights for policy 1, policy_version 168037 (0.0005) [2023-12-26 00:55:46,718][123090] Updated weights for policy 1, policy_version 168047 (0.0006) [2023-12-26 00:55:46,773][123090] Updated weights for policy 1, policy_version 168057 (0.0007) [2023-12-26 00:55:46,896][123091] Updated weights for policy 0, policy_version 168741 (0.0008) [2023-12-26 00:55:46,953][123091] Updated weights for policy 0, policy_version 168751 (0.0005) [2023-12-26 00:55:46,998][123091] Updated weights for policy 0, policy_version 168761 (0.0005) [2023-12-26 00:55:47,414][123090] Updated weights for policy 1, policy_version 168067 (0.0005) [2023-12-26 00:55:47,462][123090] Updated weights for policy 1, policy_version 168077 (0.0005) [2023-12-26 00:55:47,523][123090] Updated weights for policy 1, policy_version 168087 (0.0006) [2023-12-26 00:55:47,717][123091] Updated weights for policy 0, policy_version 168771 (0.0006) [2023-12-26 00:55:47,766][123091] Updated weights for policy 0, policy_version 168781 (0.0009) [2023-12-26 00:55:47,814][123091] Updated weights for policy 0, policy_version 168791 (0.0009) [2023-12-26 00:55:48,328][123090] Updated weights for policy 1, policy_version 168097 (0.0010) [2023-12-26 00:55:48,396][123090] Updated weights for policy 1, policy_version 168107 (0.0009) [2023-12-26 00:55:48,463][123090] Updated weights for policy 1, policy_version 168117 (0.0011) [2023-12-26 00:55:48,522][123090] Updated weights for policy 1, policy_version 168127 (0.0010) [2023-12-26 00:55:48,697][123091] Updated weights for policy 0, policy_version 168801 (0.0009) [2023-12-26 00:55:48,752][123091] Updated weights for policy 0, policy_version 168811 (0.0010) [2023-12-26 00:55:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 86253568. Throughput: 0: 8991.0, 1: 9073.1. Samples: 86267340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:48,785][121949] Avg episode reward: [(0, '5666.498'), (1, '5132.108')] [2023-12-26 00:55:48,806][123091] Updated weights for policy 0, policy_version 168821 (0.0010) [2023-12-26 00:55:48,860][123091] Updated weights for policy 0, policy_version 168831 (0.0010) [2023-12-26 00:55:49,254][123090] Updated weights for policy 1, policy_version 168137 (0.0010) [2023-12-26 00:55:49,317][123090] Updated weights for policy 1, policy_version 168147 (0.0010) [2023-12-26 00:55:49,390][123090] Updated weights for policy 1, policy_version 168157 (0.0009) [2023-12-26 00:55:49,700][123091] Updated weights for policy 0, policy_version 168841 (0.0009) [2023-12-26 00:55:49,769][123091] Updated weights for policy 0, policy_version 168851 (0.0009) [2023-12-26 00:55:49,845][123091] Updated weights for policy 0, policy_version 168861 (0.0010) [2023-12-26 00:55:50,246][123090] Updated weights for policy 1, policy_version 168167 (0.0009) [2023-12-26 00:55:50,311][123090] Updated weights for policy 1, policy_version 168177 (0.0009) [2023-12-26 00:55:50,372][123090] Updated weights for policy 1, policy_version 168187 (0.0009) [2023-12-26 00:55:50,674][123091] Updated weights for policy 0, policy_version 168871 (0.0009) [2023-12-26 00:55:50,737][123091] Updated weights for policy 0, policy_version 168881 (0.0010) [2023-12-26 00:55:50,805][123091] Updated weights for policy 0, policy_version 168892 (0.0010) [2023-12-26 00:55:51,155][123090] Updated weights for policy 1, policy_version 168197 (0.0010) [2023-12-26 00:55:51,224][123090] Updated weights for policy 1, policy_version 168207 (0.0009) [2023-12-26 00:55:51,291][123090] Updated weights for policy 1, policy_version 168217 (0.0010) [2023-12-26 00:55:51,645][123091] Updated weights for policy 0, policy_version 168902 (0.0010) [2023-12-26 00:55:51,711][123091] Updated weights for policy 0, policy_version 168912 (0.0010) [2023-12-26 00:55:51,774][123091] Updated weights for policy 0, policy_version 168922 (0.0008) [2023-12-26 00:55:52,154][123090] Updated weights for policy 1, policy_version 168227 (0.0009) [2023-12-26 00:55:52,222][123090] Updated weights for policy 1, policy_version 168237 (0.0009) [2023-12-26 00:55:52,288][123090] Updated weights for policy 1, policy_version 168247 (0.0009) [2023-12-26 00:55:52,569][123091] Updated weights for policy 0, policy_version 168932 (0.0009) [2023-12-26 00:55:52,625][123091] Updated weights for policy 0, policy_version 168942 (0.0009) [2023-12-26 00:55:52,673][123091] Updated weights for policy 0, policy_version 168952 (0.0009) [2023-12-26 00:55:53,139][123090] Updated weights for policy 1, policy_version 168257 (0.0009) [2023-12-26 00:55:53,197][123090] Updated weights for policy 1, policy_version 168267 (0.0009) [2023-12-26 00:55:53,262][123090] Updated weights for policy 1, policy_version 168277 (0.0010) [2023-12-26 00:55:53,327][123090] Updated weights for policy 1, policy_version 168287 (0.0009) [2023-12-26 00:55:53,515][123091] Updated weights for policy 0, policy_version 168962 (0.0010) [2023-12-26 00:55:53,570][123091] Updated weights for policy 0, policy_version 168972 (0.0010) [2023-12-26 00:55:53,620][123091] Updated weights for policy 0, policy_version 168982 (0.0010) [2023-12-26 00:55:53,668][123091] Updated weights for policy 0, policy_version 168992 (0.0009) [2023-12-26 00:55:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 86343680. Throughput: 0: 8907.5, 1: 9065.1. Samples: 86317852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:53,785][121949] Avg episode reward: [(0, '5717.267'), (1, '5338.780')] [2023-12-26 00:55:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000168992_43261952.pth... [2023-12-26 00:55:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000168288_43081728.pth... [2023-12-26 00:55:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000167200_42803200.pth [2023-12-26 00:55:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000167968_42999808.pth [2023-12-26 00:55:54,197][123090] Updated weights for policy 1, policy_version 168297 (0.0010) [2023-12-26 00:55:54,260][123090] Updated weights for policy 1, policy_version 168307 (0.0010) [2023-12-26 00:55:54,313][123090] Updated weights for policy 1, policy_version 168317 (0.0005) [2023-12-26 00:55:54,466][123091] Updated weights for policy 0, policy_version 169002 (0.0008) [2023-12-26 00:55:54,522][123091] Updated weights for policy 0, policy_version 169012 (0.0008) [2023-12-26 00:55:54,582][123091] Updated weights for policy 0, policy_version 169022 (0.0008) [2023-12-26 00:55:55,154][123090] Updated weights for policy 1, policy_version 168327 (0.0010) [2023-12-26 00:55:55,214][123090] Updated weights for policy 1, policy_version 168337 (0.0007) [2023-12-26 00:55:55,284][123090] Updated weights for policy 1, policy_version 168347 (0.0006) [2023-12-26 00:55:55,347][123091] Updated weights for policy 0, policy_version 169032 (0.0011) [2023-12-26 00:55:55,424][123091] Updated weights for policy 0, policy_version 169042 (0.0011) [2023-12-26 00:55:55,483][123091] Updated weights for policy 0, policy_version 169052 (0.0011) [2023-12-26 00:55:56,042][123090] Updated weights for policy 1, policy_version 168357 (0.0008) [2023-12-26 00:55:56,106][123090] Updated weights for policy 1, policy_version 168367 (0.0010) [2023-12-26 00:55:56,153][123091] Updated weights for policy 0, policy_version 169062 (0.0010) [2023-12-26 00:55:56,158][123090] Updated weights for policy 1, policy_version 168377 (0.0008) [2023-12-26 00:55:56,222][123091] Updated weights for policy 0, policy_version 169072 (0.0008) [2023-12-26 00:55:56,282][123091] Updated weights for policy 0, policy_version 169082 (0.0009) [2023-12-26 00:55:56,880][123090] Updated weights for policy 1, policy_version 168387 (0.0009) [2023-12-26 00:55:56,928][123090] Updated weights for policy 1, policy_version 168397 (0.0010) [2023-12-26 00:55:56,980][123090] Updated weights for policy 1, policy_version 168407 (0.0010) [2023-12-26 00:55:57,051][123091] Updated weights for policy 0, policy_version 169092 (0.0008) [2023-12-26 00:55:57,102][123091] Updated weights for policy 0, policy_version 169102 (0.0006) [2023-12-26 00:55:57,155][123091] Updated weights for policy 0, policy_version 169112 (0.0005) [2023-12-26 00:55:57,746][123090] Updated weights for policy 1, policy_version 168417 (0.0010) [2023-12-26 00:55:57,798][123090] Updated weights for policy 1, policy_version 168427 (0.0005) [2023-12-26 00:55:57,848][123090] Updated weights for policy 1, policy_version 168437 (0.0005) [2023-12-26 00:55:57,892][123090] Updated weights for policy 1, policy_version 168447 (0.0005) [2023-12-26 00:55:57,899][123091] Updated weights for policy 0, policy_version 169122 (0.0005) [2023-12-26 00:55:57,972][123091] Updated weights for policy 0, policy_version 169132 (0.0006) [2023-12-26 00:55:58,045][123091] Updated weights for policy 0, policy_version 169142 (0.0008) [2023-12-26 00:55:58,112][123091] Updated weights for policy 0, policy_version 169152 (0.0008) [2023-12-26 00:55:58,707][123090] Updated weights for policy 1, policy_version 168457 (0.0010) [2023-12-26 00:55:58,777][123090] Updated weights for policy 1, policy_version 168467 (0.0011) [2023-12-26 00:55:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 86425600. Throughput: 0: 8944.8, 1: 9149.9. Samples: 86426100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:55:58,785][121949] Avg episode reward: [(0, '5666.431'), (1, '5416.356')] [2023-12-26 00:55:58,840][123091] Updated weights for policy 0, policy_version 169162 (0.0011) [2023-12-26 00:55:58,843][123090] Updated weights for policy 1, policy_version 168477 (0.0010) [2023-12-26 00:55:58,894][123091] Updated weights for policy 0, policy_version 169172 (0.0010) [2023-12-26 00:55:58,956][123091] Updated weights for policy 0, policy_version 169182 (0.0010) [2023-12-26 00:55:59,636][123090] Updated weights for policy 1, policy_version 168487 (0.0010) [2023-12-26 00:55:59,660][123091] Updated weights for policy 0, policy_version 169192 (0.0006) [2023-12-26 00:55:59,695][123090] Updated weights for policy 1, policy_version 168497 (0.0010) [2023-12-26 00:55:59,724][123091] Updated weights for policy 0, policy_version 169202 (0.0006) [2023-12-26 00:55:59,755][123090] Updated weights for policy 1, policy_version 168507 (0.0010) [2023-12-26 00:55:59,783][123091] Updated weights for policy 0, policy_version 169212 (0.0007) [2023-12-26 00:56:00,585][123090] Updated weights for policy 1, policy_version 168517 (0.0010) [2023-12-26 00:56:00,602][123091] Updated weights for policy 0, policy_version 169222 (0.0007) [2023-12-26 00:56:00,644][123090] Updated weights for policy 1, policy_version 168527 (0.0010) [2023-12-26 00:56:00,659][123091] Updated weights for policy 0, policy_version 169232 (0.0006) [2023-12-26 00:56:00,695][123090] Updated weights for policy 1, policy_version 168537 (0.0010) [2023-12-26 00:56:00,718][123091] Updated weights for policy 0, policy_version 169242 (0.0007) [2023-12-26 00:56:01,487][123090] Updated weights for policy 1, policy_version 168547 (0.0009) [2023-12-26 00:56:01,512][123091] Updated weights for policy 0, policy_version 169252 (0.0008) [2023-12-26 00:56:01,542][123090] Updated weights for policy 1, policy_version 168557 (0.0005) [2023-12-26 00:56:01,561][123091] Updated weights for policy 0, policy_version 169262 (0.0009) [2023-12-26 00:56:01,603][123090] Updated weights for policy 1, policy_version 168567 (0.0006) [2023-12-26 00:56:01,614][123091] Updated weights for policy 0, policy_version 169273 (0.0010) [2023-12-26 00:56:02,417][123091] Updated weights for policy 0, policy_version 169283 (0.0009) [2023-12-26 00:56:02,464][123090] Updated weights for policy 1, policy_version 168577 (0.0009) [2023-12-26 00:56:02,484][123091] Updated weights for policy 0, policy_version 169293 (0.0009) [2023-12-26 00:56:02,526][123090] Updated weights for policy 1, policy_version 168587 (0.0007) [2023-12-26 00:56:02,550][123091] Updated weights for policy 0, policy_version 169303 (0.0008) [2023-12-26 00:56:02,594][123090] Updated weights for policy 1, policy_version 168597 (0.0009) [2023-12-26 00:56:02,659][123090] Updated weights for policy 1, policy_version 168607 (0.0006) [2023-12-26 00:56:03,204][123091] Updated weights for policy 0, policy_version 169313 (0.0007) [2023-12-26 00:56:03,270][123091] Updated weights for policy 0, policy_version 169323 (0.0006) [2023-12-26 00:56:03,336][123091] Updated weights for policy 0, policy_version 169333 (0.0006) [2023-12-26 00:56:03,378][123090] Updated weights for policy 1, policy_version 168617 (0.0010) [2023-12-26 00:56:03,405][123091] Updated weights for policy 0, policy_version 169343 (0.0005) [2023-12-26 00:56:03,449][123090] Updated weights for policy 1, policy_version 168627 (0.0011) [2023-12-26 00:56:03,516][123090] Updated weights for policy 1, policy_version 168637 (0.0009) [2023-12-26 00:56:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 86523904. Throughput: 0: 8882.7, 1: 9116.9. Samples: 86534252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:03,785][121949] Avg episode reward: [(0, '5621.447'), (1, '5557.919')] [2023-12-26 00:56:04,068][123091] Updated weights for policy 0, policy_version 169353 (0.0006) [2023-12-26 00:56:04,124][123091] Updated weights for policy 0, policy_version 169363 (0.0006) [2023-12-26 00:56:04,186][123091] Updated weights for policy 0, policy_version 169373 (0.0009) [2023-12-26 00:56:04,195][123090] Updated weights for policy 1, policy_version 168647 (0.0009) [2023-12-26 00:56:04,257][123090] Updated weights for policy 1, policy_version 168657 (0.0011) [2023-12-26 00:56:04,324][123090] Updated weights for policy 1, policy_version 168667 (0.0011) [2023-12-26 00:56:04,989][123091] Updated weights for policy 0, policy_version 169383 (0.0009) [2023-12-26 00:56:05,046][123091] Updated weights for policy 0, policy_version 169393 (0.0006) [2023-12-26 00:56:05,103][123091] Updated weights for policy 0, policy_version 169403 (0.0005) [2023-12-26 00:56:05,163][123090] Updated weights for policy 1, policy_version 168677 (0.0010) [2023-12-26 00:56:05,212][123090] Updated weights for policy 1, policy_version 168687 (0.0011) [2023-12-26 00:56:05,265][123090] Updated weights for policy 1, policy_version 168697 (0.0010) [2023-12-26 00:56:05,839][123091] Updated weights for policy 0, policy_version 169413 (0.0007) [2023-12-26 00:56:05,901][123091] Updated weights for policy 0, policy_version 169423 (0.0010) [2023-12-26 00:56:05,955][123091] Updated weights for policy 0, policy_version 169433 (0.0008) [2023-12-26 00:56:06,122][123090] Updated weights for policy 1, policy_version 168707 (0.0011) [2023-12-26 00:56:06,193][123090] Updated weights for policy 1, policy_version 168717 (0.0011) [2023-12-26 00:56:06,269][123090] Updated weights for policy 1, policy_version 168727 (0.0011) [2023-12-26 00:56:06,776][123091] Updated weights for policy 0, policy_version 169443 (0.0006) [2023-12-26 00:56:06,851][123091] Updated weights for policy 0, policy_version 169453 (0.0006) [2023-12-26 00:56:06,926][123091] Updated weights for policy 0, policy_version 169463 (0.0006) [2023-12-26 00:56:07,006][123090] Updated weights for policy 1, policy_version 168737 (0.0008) [2023-12-26 00:56:07,057][123090] Updated weights for policy 1, policy_version 168747 (0.0006) [2023-12-26 00:56:07,114][123090] Updated weights for policy 1, policy_version 168757 (0.0006) [2023-12-26 00:56:07,166][123090] Updated weights for policy 1, policy_version 168767 (0.0005) [2023-12-26 00:56:07,587][123091] Updated weights for policy 0, policy_version 169473 (0.0010) [2023-12-26 00:56:07,640][123091] Updated weights for policy 0, policy_version 169483 (0.0009) [2023-12-26 00:56:07,698][123091] Updated weights for policy 0, policy_version 169493 (0.0009) [2023-12-26 00:56:07,763][123091] Updated weights for policy 0, policy_version 169503 (0.0009) [2023-12-26 00:56:07,976][123090] Updated weights for policy 1, policy_version 168777 (0.0010) [2023-12-26 00:56:08,034][123090] Updated weights for policy 1, policy_version 168787 (0.0010) [2023-12-26 00:56:08,104][123090] Updated weights for policy 1, policy_version 168797 (0.0010) [2023-12-26 00:56:08,461][123091] Updated weights for policy 0, policy_version 169513 (0.0006) [2023-12-26 00:56:08,534][123091] Updated weights for policy 0, policy_version 169523 (0.0005) [2023-12-26 00:56:08,606][123091] Updated weights for policy 0, policy_version 169533 (0.0006) [2023-12-26 00:56:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 86614016. Throughput: 0: 8932.2, 1: 9131.3. Samples: 86587884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:08,785][121949] Avg episode reward: [(0, '5643.171'), (1, '5582.007')] [2023-12-26 00:56:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000168800_43212800.pth... [2023-12-26 00:56:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000169536_43401216.pth... [2023-12-26 00:56:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000167776_42950656.pth [2023-12-26 00:56:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000168480_43130880.pth [2023-12-26 00:56:08,964][123090] Updated weights for policy 1, policy_version 168807 (0.0009) [2023-12-26 00:56:09,036][123090] Updated weights for policy 1, policy_version 168817 (0.0010) [2023-12-26 00:56:09,104][123090] Updated weights for policy 1, policy_version 168827 (0.0010) [2023-12-26 00:56:09,325][123091] Updated weights for policy 0, policy_version 169543 (0.0009) [2023-12-26 00:56:09,401][123091] Updated weights for policy 0, policy_version 169553 (0.0007) [2023-12-26 00:56:09,463][123091] Updated weights for policy 0, policy_version 169563 (0.0009) [2023-12-26 00:56:09,967][123090] Updated weights for policy 1, policy_version 168837 (0.0009) [2023-12-26 00:56:10,034][123090] Updated weights for policy 1, policy_version 168847 (0.0008) [2023-12-26 00:56:10,103][123090] Updated weights for policy 1, policy_version 168857 (0.0009) [2023-12-26 00:56:10,329][123091] Updated weights for policy 0, policy_version 169573 (0.0009) [2023-12-26 00:56:10,392][123091] Updated weights for policy 0, policy_version 169583 (0.0010) [2023-12-26 00:56:10,439][123091] Updated weights for policy 0, policy_version 169593 (0.0009) [2023-12-26 00:56:10,819][123090] Updated weights for policy 1, policy_version 168867 (0.0008) [2023-12-26 00:56:10,871][123090] Updated weights for policy 1, policy_version 168877 (0.0009) [2023-12-26 00:56:10,924][123090] Updated weights for policy 1, policy_version 168887 (0.0009) [2023-12-26 00:56:11,294][123091] Updated weights for policy 0, policy_version 169603 (0.0009) [2023-12-26 00:56:11,362][123091] Updated weights for policy 0, policy_version 169613 (0.0008) [2023-12-26 00:56:11,437][123091] Updated weights for policy 0, policy_version 169623 (0.0008) [2023-12-26 00:56:11,810][123090] Updated weights for policy 1, policy_version 168897 (0.0008) [2023-12-26 00:56:11,883][123090] Updated weights for policy 1, policy_version 168907 (0.0010) [2023-12-26 00:56:11,952][123090] Updated weights for policy 1, policy_version 168917 (0.0010) [2023-12-26 00:56:12,018][123090] Updated weights for policy 1, policy_version 168928 (0.0007) [2023-12-26 00:56:12,240][123091] Updated weights for policy 0, policy_version 169633 (0.0006) [2023-12-26 00:56:12,307][123091] Updated weights for policy 0, policy_version 169643 (0.0010) [2023-12-26 00:56:12,378][123091] Updated weights for policy 0, policy_version 169653 (0.0009) [2023-12-26 00:56:12,448][123091] Updated weights for policy 0, policy_version 169663 (0.0009) [2023-12-26 00:56:12,850][123090] Updated weights for policy 1, policy_version 168938 (0.0009) [2023-12-26 00:56:12,912][123090] Updated weights for policy 1, policy_version 168948 (0.0011) [2023-12-26 00:56:12,977][123090] Updated weights for policy 1, policy_version 168958 (0.0006) [2023-12-26 00:56:13,362][123091] Updated weights for policy 0, policy_version 169673 (0.0010) [2023-12-26 00:56:13,424][123091] Updated weights for policy 0, policy_version 169683 (0.0010) [2023-12-26 00:56:13,478][123091] Updated weights for policy 0, policy_version 169693 (0.0010) [2023-12-26 00:56:13,604][123090] Updated weights for policy 1, policy_version 168968 (0.0005) [2023-12-26 00:56:13,663][123090] Updated weights for policy 1, policy_version 168978 (0.0008) [2023-12-26 00:56:13,729][123090] Updated weights for policy 1, policy_version 168988 (0.0010) [2023-12-26 00:56:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18159.0, 300 sec: 17883.6). Total num frames: 86704128. Throughput: 0: 9000.4, 1: 9026.1. Samples: 86692656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:13,785][121949] Avg episode reward: [(0, '5653.513'), (1, '5452.467')] [2023-12-26 00:56:14,326][123091] Updated weights for policy 0, policy_version 169703 (0.0009) [2023-12-26 00:56:14,386][123091] Updated weights for policy 0, policy_version 169713 (0.0009) [2023-12-26 00:56:14,450][123091] Updated weights for policy 0, policy_version 169723 (0.0009) [2023-12-26 00:56:14,519][123090] Updated weights for policy 1, policy_version 168998 (0.0010) [2023-12-26 00:56:14,585][123090] Updated weights for policy 1, policy_version 169008 (0.0010) [2023-12-26 00:56:14,646][123090] Updated weights for policy 1, policy_version 169018 (0.0010) [2023-12-26 00:56:15,317][123091] Updated weights for policy 0, policy_version 169733 (0.0009) [2023-12-26 00:56:15,378][123091] Updated weights for policy 0, policy_version 169743 (0.0010) [2023-12-26 00:56:15,443][123090] Updated weights for policy 1, policy_version 169028 (0.0010) [2023-12-26 00:56:15,445][123091] Updated weights for policy 0, policy_version 169753 (0.0007) [2023-12-26 00:56:15,498][123090] Updated weights for policy 1, policy_version 169038 (0.0010) [2023-12-26 00:56:15,570][123090] Updated weights for policy 1, policy_version 169048 (0.0008) [2023-12-26 00:56:16,296][123091] Updated weights for policy 0, policy_version 169763 (0.0007) [2023-12-26 00:56:16,317][123090] Updated weights for policy 1, policy_version 169058 (0.0006) [2023-12-26 00:56:16,345][123091] Updated weights for policy 0, policy_version 169773 (0.0009) [2023-12-26 00:56:16,379][123090] Updated weights for policy 1, policy_version 169068 (0.0008) [2023-12-26 00:56:16,391][123091] Updated weights for policy 0, policy_version 169783 (0.0009) [2023-12-26 00:56:16,454][123090] Updated weights for policy 1, policy_version 169078 (0.0008) [2023-12-26 00:56:16,511][123090] Updated weights for policy 1, policy_version 169088 (0.0009) [2023-12-26 00:56:17,113][123091] Updated weights for policy 0, policy_version 169793 (0.0009) [2023-12-26 00:56:17,160][123091] Updated weights for policy 0, policy_version 169803 (0.0009) [2023-12-26 00:56:17,207][123091] Updated weights for policy 0, policy_version 169813 (0.0008) [2023-12-26 00:56:17,256][123091] Updated weights for policy 0, policy_version 169823 (0.0009) [2023-12-26 00:56:17,373][123090] Updated weights for policy 1, policy_version 169098 (0.0009) [2023-12-26 00:56:17,435][123090] Updated weights for policy 1, policy_version 169108 (0.0010) [2023-12-26 00:56:17,493][123090] Updated weights for policy 1, policy_version 169119 (0.0010) [2023-12-26 00:56:18,040][123091] Updated weights for policy 0, policy_version 169833 (0.0006) [2023-12-26 00:56:18,098][123091] Updated weights for policy 0, policy_version 169843 (0.0006) [2023-12-26 00:56:18,168][123091] Updated weights for policy 0, policy_version 169853 (0.0006) [2023-12-26 00:56:18,397][123090] Updated weights for policy 1, policy_version 169129 (0.0009) [2023-12-26 00:56:18,459][123090] Updated weights for policy 1, policy_version 169139 (0.0009) [2023-12-26 00:56:18,525][123090] Updated weights for policy 1, policy_version 169149 (0.0009) [2023-12-26 00:56:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 86786048. Throughput: 0: 8959.9, 1: 8915.4. Samples: 86797756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:18,784][121949] Avg episode reward: [(0, '5675.825'), (1, '5391.514')] [2023-12-26 00:56:18,889][123091] Updated weights for policy 0, policy_version 169863 (0.0009) [2023-12-26 00:56:18,945][123091] Updated weights for policy 0, policy_version 169873 (0.0011) [2023-12-26 00:56:18,997][123091] Updated weights for policy 0, policy_version 169883 (0.0010) [2023-12-26 00:56:19,346][123090] Updated weights for policy 1, policy_version 169159 (0.0009) [2023-12-26 00:56:19,420][123090] Updated weights for policy 1, policy_version 169169 (0.0008) [2023-12-26 00:56:19,475][123090] Updated weights for policy 1, policy_version 169179 (0.0008) [2023-12-26 00:56:19,871][123091] Updated weights for policy 0, policy_version 169893 (0.0011) [2023-12-26 00:56:19,945][123091] Updated weights for policy 0, policy_version 169903 (0.0011) [2023-12-26 00:56:20,013][123091] Updated weights for policy 0, policy_version 169913 (0.0011) [2023-12-26 00:56:20,319][123090] Updated weights for policy 1, policy_version 169189 (0.0010) [2023-12-26 00:56:20,386][123090] Updated weights for policy 1, policy_version 169199 (0.0008) [2023-12-26 00:56:20,460][123090] Updated weights for policy 1, policy_version 169209 (0.0008) [2023-12-26 00:56:20,747][123091] Updated weights for policy 0, policy_version 169923 (0.0009) [2023-12-26 00:56:20,807][123091] Updated weights for policy 0, policy_version 169933 (0.0006) [2023-12-26 00:56:20,876][123091] Updated weights for policy 0, policy_version 169943 (0.0006) [2023-12-26 00:56:21,226][123090] Updated weights for policy 1, policy_version 169219 (0.0010) [2023-12-26 00:56:21,296][123090] Updated weights for policy 1, policy_version 169229 (0.0008) [2023-12-26 00:56:21,366][123090] Updated weights for policy 1, policy_version 169239 (0.0010) [2023-12-26 00:56:21,718][123091] Updated weights for policy 0, policy_version 169953 (0.0010) [2023-12-26 00:56:21,790][123091] Updated weights for policy 0, policy_version 169963 (0.0011) [2023-12-26 00:56:21,857][123091] Updated weights for policy 0, policy_version 169973 (0.0011) [2023-12-26 00:56:21,924][123091] Updated weights for policy 0, policy_version 169983 (0.0011) [2023-12-26 00:56:22,168][123090] Updated weights for policy 1, policy_version 169249 (0.0008) [2023-12-26 00:56:22,237][123090] Updated weights for policy 1, policy_version 169259 (0.0008) [2023-12-26 00:56:22,295][123090] Updated weights for policy 1, policy_version 169269 (0.0009) [2023-12-26 00:56:22,348][123090] Updated weights for policy 1, policy_version 169279 (0.0009) [2023-12-26 00:56:22,694][123091] Updated weights for policy 0, policy_version 169993 (0.0010) [2023-12-26 00:56:22,771][123091] Updated weights for policy 0, policy_version 170003 (0.0010) [2023-12-26 00:56:22,842][123091] Updated weights for policy 0, policy_version 170013 (0.0010) [2023-12-26 00:56:23,171][123090] Updated weights for policy 1, policy_version 169289 (0.0006) [2023-12-26 00:56:23,230][123090] Updated weights for policy 1, policy_version 169299 (0.0006) [2023-12-26 00:56:23,287][123090] Updated weights for policy 1, policy_version 169309 (0.0005) [2023-12-26 00:56:23,612][123091] Updated weights for policy 0, policy_version 170024 (0.0010) [2023-12-26 00:56:23,661][123091] Updated weights for policy 0, policy_version 170034 (0.0009) [2023-12-26 00:56:23,718][123091] Updated weights for policy 0, policy_version 170044 (0.0009) [2023-12-26 00:56:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 86876160. Throughput: 0: 8933.6, 1: 8884.4. Samples: 86849164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:23,785][121949] Avg episode reward: [(0, '5706.925'), (1, '5359.438')] [2023-12-26 00:56:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000170048_43532288.pth... [2023-12-26 00:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000169312_43343872.pth... [2023-12-26 00:56:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000168288_43081728.pth [2023-12-26 00:56:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000168992_43261952.pth [2023-12-26 00:56:23,956][123090] Updated weights for policy 1, policy_version 169319 (0.0005) [2023-12-26 00:56:24,007][123090] Updated weights for policy 1, policy_version 169329 (0.0006) [2023-12-26 00:56:24,081][123090] Updated weights for policy 1, policy_version 169339 (0.0008) [2023-12-26 00:56:24,517][123091] Updated weights for policy 0, policy_version 170054 (0.0009) [2023-12-26 00:56:24,577][123091] Updated weights for policy 0, policy_version 170064 (0.0009) [2023-12-26 00:56:24,632][123091] Updated weights for policy 0, policy_version 170074 (0.0010) [2023-12-26 00:56:24,809][123090] Updated weights for policy 1, policy_version 169349 (0.0006) [2023-12-26 00:56:24,882][123090] Updated weights for policy 1, policy_version 169359 (0.0005) [2023-12-26 00:56:24,951][123090] Updated weights for policy 1, policy_version 169369 (0.0005) [2023-12-26 00:56:25,473][123091] Updated weights for policy 0, policy_version 170084 (0.0008) [2023-12-26 00:56:25,522][123091] Updated weights for policy 0, policy_version 170094 (0.0005) [2023-12-26 00:56:25,590][123091] Updated weights for policy 0, policy_version 170104 (0.0005) [2023-12-26 00:56:25,639][123090] Updated weights for policy 1, policy_version 169379 (0.0010) [2023-12-26 00:56:25,693][123090] Updated weights for policy 1, policy_version 169389 (0.0010) [2023-12-26 00:56:25,756][123090] Updated weights for policy 1, policy_version 169399 (0.0010) [2023-12-26 00:56:26,397][123091] Updated weights for policy 0, policy_version 170114 (0.0007) [2023-12-26 00:56:26,434][123090] Updated weights for policy 1, policy_version 169409 (0.0010) [2023-12-26 00:56:26,448][123091] Updated weights for policy 0, policy_version 170124 (0.0006) [2023-12-26 00:56:26,488][123090] Updated weights for policy 1, policy_version 169419 (0.0005) [2023-12-26 00:56:26,497][123091] Updated weights for policy 0, policy_version 170134 (0.0005) [2023-12-26 00:56:26,538][123090] Updated weights for policy 1, policy_version 169429 (0.0009) [2023-12-26 00:56:26,543][123091] Updated weights for policy 0, policy_version 170144 (0.0006) [2023-12-26 00:56:26,590][123090] Updated weights for policy 1, policy_version 169440 (0.0010) [2023-12-26 00:56:27,222][123090] Updated weights for policy 1, policy_version 169450 (0.0010) [2023-12-26 00:56:27,284][123090] Updated weights for policy 1, policy_version 169460 (0.0009) [2023-12-26 00:56:27,315][123091] Updated weights for policy 0, policy_version 170154 (0.0008) [2023-12-26 00:56:27,348][123090] Updated weights for policy 1, policy_version 169470 (0.0008) [2023-12-26 00:56:27,370][123091] Updated weights for policy 0, policy_version 170164 (0.0008) [2023-12-26 00:56:27,419][123091] Updated weights for policy 0, policy_version 170174 (0.0009) [2023-12-26 00:56:28,130][123091] Updated weights for policy 0, policy_version 170184 (0.0006) [2023-12-26 00:56:28,185][123091] Updated weights for policy 0, policy_version 170194 (0.0005) [2023-12-26 00:56:28,222][123090] Updated weights for policy 1, policy_version 169480 (0.0010) [2023-12-26 00:56:28,238][123091] Updated weights for policy 0, policy_version 170204 (0.0005) [2023-12-26 00:56:28,283][123090] Updated weights for policy 1, policy_version 169490 (0.0008) [2023-12-26 00:56:28,351][123090] Updated weights for policy 1, policy_version 169500 (0.0009) [2023-12-26 00:56:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 86966272. Throughput: 0: 8965.8, 1: 8964.5. Samples: 86959424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:28,784][121949] Avg episode reward: [(0, '5695.851'), (1, '5396.232')] [2023-12-26 00:56:28,978][123091] Updated weights for policy 0, policy_version 170214 (0.0009) [2023-12-26 00:56:29,037][123091] Updated weights for policy 0, policy_version 170224 (0.0010) [2023-12-26 00:56:29,100][123091] Updated weights for policy 0, policy_version 170234 (0.0009) [2023-12-26 00:56:29,238][123090] Updated weights for policy 1, policy_version 169510 (0.0010) [2023-12-26 00:56:29,293][123090] Updated weights for policy 1, policy_version 169520 (0.0010) [2023-12-26 00:56:29,346][123090] Updated weights for policy 1, policy_version 169530 (0.0009) [2023-12-26 00:56:29,959][123091] Updated weights for policy 0, policy_version 170245 (0.0010) [2023-12-26 00:56:30,018][123091] Updated weights for policy 0, policy_version 170255 (0.0010) [2023-12-26 00:56:30,071][123091] Updated weights for policy 0, policy_version 170266 (0.0010) [2023-12-26 00:56:30,209][123090] Updated weights for policy 1, policy_version 169540 (0.0010) [2023-12-26 00:56:30,266][123090] Updated weights for policy 1, policy_version 169550 (0.0009) [2023-12-26 00:56:30,326][123090] Updated weights for policy 1, policy_version 169560 (0.0009) [2023-12-26 00:56:30,897][123091] Updated weights for policy 0, policy_version 170276 (0.0010) [2023-12-26 00:56:30,952][123091] Updated weights for policy 0, policy_version 170286 (0.0010) [2023-12-26 00:56:31,014][123091] Updated weights for policy 0, policy_version 170296 (0.0011) [2023-12-26 00:56:31,140][123090] Updated weights for policy 1, policy_version 169570 (0.0009) [2023-12-26 00:56:31,206][123090] Updated weights for policy 1, policy_version 169580 (0.0010) [2023-12-26 00:56:31,273][123090] Updated weights for policy 1, policy_version 169590 (0.0009) [2023-12-26 00:56:31,333][123090] Updated weights for policy 1, policy_version 169600 (0.0009) [2023-12-26 00:56:31,902][123091] Updated weights for policy 0, policy_version 170307 (0.0008) [2023-12-26 00:56:31,972][123091] Updated weights for policy 0, policy_version 170317 (0.0006) [2023-12-26 00:56:32,027][123091] Updated weights for policy 0, policy_version 170327 (0.0007) [2023-12-26 00:56:32,108][123090] Updated weights for policy 1, policy_version 169610 (0.0006) [2023-12-26 00:56:32,157][123090] Updated weights for policy 1, policy_version 169620 (0.0005) [2023-12-26 00:56:32,221][123090] Updated weights for policy 1, policy_version 169630 (0.0008) [2023-12-26 00:56:32,745][123091] Updated weights for policy 0, policy_version 170337 (0.0007) [2023-12-26 00:56:32,805][123091] Updated weights for policy 0, policy_version 170347 (0.0005) [2023-12-26 00:56:32,871][123091] Updated weights for policy 0, policy_version 170357 (0.0005) [2023-12-26 00:56:32,936][123091] Updated weights for policy 0, policy_version 170367 (0.0006) [2023-12-26 00:56:33,105][123090] Updated weights for policy 1, policy_version 169640 (0.0010) [2023-12-26 00:56:33,154][123090] Updated weights for policy 1, policy_version 169651 (0.0010) [2023-12-26 00:56:33,219][123090] Updated weights for policy 1, policy_version 169661 (0.0010) [2023-12-26 00:56:33,510][123091] Updated weights for policy 0, policy_version 170377 (0.0005) [2023-12-26 00:56:33,579][123091] Updated weights for policy 0, policy_version 170387 (0.0005) [2023-12-26 00:56:33,644][123091] Updated weights for policy 0, policy_version 170397 (0.0005) [2023-12-26 00:56:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 87056384. Throughput: 0: 8964.0, 1: 8803.2. Samples: 87066864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:33,785][121949] Avg episode reward: [(0, '5624.429'), (1, '5434.027')] [2023-12-26 00:56:33,948][123090] Updated weights for policy 1, policy_version 169671 (0.0005) [2023-12-26 00:56:34,002][123090] Updated weights for policy 1, policy_version 169681 (0.0007) [2023-12-26 00:56:34,061][123090] Updated weights for policy 1, policy_version 169691 (0.0010) [2023-12-26 00:56:34,346][123091] Updated weights for policy 0, policy_version 170407 (0.0007) [2023-12-26 00:56:34,415][123091] Updated weights for policy 0, policy_version 170417 (0.0009) [2023-12-26 00:56:34,487][123091] Updated weights for policy 0, policy_version 170427 (0.0009) [2023-12-26 00:56:34,888][123090] Updated weights for policy 1, policy_version 169701 (0.0010) [2023-12-26 00:56:34,958][123090] Updated weights for policy 1, policy_version 169711 (0.0011) [2023-12-26 00:56:35,025][123090] Updated weights for policy 1, policy_version 169721 (0.0011) [2023-12-26 00:56:35,255][123091] Updated weights for policy 0, policy_version 170437 (0.0007) [2023-12-26 00:56:35,313][123091] Updated weights for policy 0, policy_version 170447 (0.0005) [2023-12-26 00:56:35,380][123091] Updated weights for policy 0, policy_version 170457 (0.0005) [2023-12-26 00:56:35,754][123090] Updated weights for policy 1, policy_version 169731 (0.0009) [2023-12-26 00:56:35,808][123090] Updated weights for policy 1, policy_version 169741 (0.0005) [2023-12-26 00:56:35,866][123090] Updated weights for policy 1, policy_version 169751 (0.0005) [2023-12-26 00:56:36,046][123091] Updated weights for policy 0, policy_version 170467 (0.0006) [2023-12-26 00:56:36,103][123091] Updated weights for policy 0, policy_version 170477 (0.0010) [2023-12-26 00:56:36,186][123091] Updated weights for policy 0, policy_version 170487 (0.0009) [2023-12-26 00:56:36,501][123090] Updated weights for policy 1, policy_version 169761 (0.0005) [2023-12-26 00:56:36,570][123090] Updated weights for policy 1, policy_version 169771 (0.0005) [2023-12-26 00:56:36,637][123090] Updated weights for policy 1, policy_version 169781 (0.0008) [2023-12-26 00:56:36,708][123090] Updated weights for policy 1, policy_version 169791 (0.0010) [2023-12-26 00:56:37,008][123091] Updated weights for policy 0, policy_version 170497 (0.0010) [2023-12-26 00:56:37,060][123091] Updated weights for policy 0, policy_version 170507 (0.0009) [2023-12-26 00:56:37,116][123091] Updated weights for policy 0, policy_version 170517 (0.0009) [2023-12-26 00:56:37,179][123091] Updated weights for policy 0, policy_version 170527 (0.0009) [2023-12-26 00:56:37,419][123090] Updated weights for policy 1, policy_version 169801 (0.0006) [2023-12-26 00:56:37,485][123090] Updated weights for policy 1, policy_version 169811 (0.0005) [2023-12-26 00:56:37,556][123090] Updated weights for policy 1, policy_version 169821 (0.0005) [2023-12-26 00:56:37,911][123091] Updated weights for policy 0, policy_version 170537 (0.0010) [2023-12-26 00:56:37,985][123091] Updated weights for policy 0, policy_version 170547 (0.0011) [2023-12-26 00:56:38,052][123091] Updated weights for policy 0, policy_version 170557 (0.0011) [2023-12-26 00:56:38,275][123090] Updated weights for policy 1, policy_version 169831 (0.0009) [2023-12-26 00:56:38,332][123090] Updated weights for policy 1, policy_version 169841 (0.0010) [2023-12-26 00:56:38,395][123090] Updated weights for policy 1, policy_version 169851 (0.0011) [2023-12-26 00:56:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 87146496. Throughput: 0: 9024.0, 1: 8864.7. Samples: 87122844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:38,785][121949] Avg episode reward: [(0, '5462.400'), (1, '5370.464')] [2023-12-26 00:56:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000170560_43663360.pth... [2023-12-26 00:56:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000169856_43483136.pth... [2023-12-26 00:56:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000169536_43401216.pth [2023-12-26 00:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000168800_43212800.pth [2023-12-26 00:56:38,865][123091] Updated weights for policy 0, policy_version 170567 (0.0008) [2023-12-26 00:56:38,935][123091] Updated weights for policy 0, policy_version 170577 (0.0008) [2023-12-26 00:56:38,986][123091] Updated weights for policy 0, policy_version 170587 (0.0006) [2023-12-26 00:56:39,267][123090] Updated weights for policy 1, policy_version 169861 (0.0010) [2023-12-26 00:56:39,339][123090] Updated weights for policy 1, policy_version 169871 (0.0011) [2023-12-26 00:56:39,411][123090] Updated weights for policy 1, policy_version 169881 (0.0011) [2023-12-26 00:56:39,692][123091] Updated weights for policy 0, policy_version 170597 (0.0007) [2023-12-26 00:56:39,762][123091] Updated weights for policy 0, policy_version 170607 (0.0006) [2023-12-26 00:56:39,836][123091] Updated weights for policy 0, policy_version 170617 (0.0007) [2023-12-26 00:56:40,247][123090] Updated weights for policy 1, policy_version 169891 (0.0009) [2023-12-26 00:56:40,308][123090] Updated weights for policy 1, policy_version 169901 (0.0009) [2023-12-26 00:56:40,362][123090] Updated weights for policy 1, policy_version 169911 (0.0009) [2023-12-26 00:56:40,618][123091] Updated weights for policy 0, policy_version 170627 (0.0011) [2023-12-26 00:56:40,665][123091] Updated weights for policy 0, policy_version 170637 (0.0010) [2023-12-26 00:56:40,717][123091] Updated weights for policy 0, policy_version 170647 (0.0010) [2023-12-26 00:56:41,142][123090] Updated weights for policy 1, policy_version 169921 (0.0009) [2023-12-26 00:56:41,210][123090] Updated weights for policy 1, policy_version 169931 (0.0009) [2023-12-26 00:56:41,277][123090] Updated weights for policy 1, policy_version 169941 (0.0009) [2023-12-26 00:56:41,353][123090] Updated weights for policy 1, policy_version 169951 (0.0009) [2023-12-26 00:56:41,495][123091] Updated weights for policy 0, policy_version 170657 (0.0010) [2023-12-26 00:56:41,564][123091] Updated weights for policy 0, policy_version 170667 (0.0007) [2023-12-26 00:56:41,632][123091] Updated weights for policy 0, policy_version 170677 (0.0009) [2023-12-26 00:56:41,695][123091] Updated weights for policy 0, policy_version 170687 (0.0011) [2023-12-26 00:56:42,214][123090] Updated weights for policy 1, policy_version 169961 (0.0009) [2023-12-26 00:56:42,282][123090] Updated weights for policy 1, policy_version 169971 (0.0009) [2023-12-26 00:56:42,349][123090] Updated weights for policy 1, policy_version 169981 (0.0009) [2023-12-26 00:56:42,520][123091] Updated weights for policy 0, policy_version 170697 (0.0010) [2023-12-26 00:56:42,579][123091] Updated weights for policy 0, policy_version 170707 (0.0011) [2023-12-26 00:56:42,640][123091] Updated weights for policy 0, policy_version 170717 (0.0011) [2023-12-26 00:56:43,210][123090] Updated weights for policy 1, policy_version 169991 (0.0010) [2023-12-26 00:56:43,268][123090] Updated weights for policy 1, policy_version 170001 (0.0009) [2023-12-26 00:56:43,346][123090] Updated weights for policy 1, policy_version 170011 (0.0009) [2023-12-26 00:56:43,405][123091] Updated weights for policy 0, policy_version 170727 (0.0010) [2023-12-26 00:56:43,463][123091] Updated weights for policy 0, policy_version 170737 (0.0010) [2023-12-26 00:56:43,523][123091] Updated weights for policy 0, policy_version 170747 (0.0010) [2023-12-26 00:56:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 87236608. Throughput: 0: 9009.6, 1: 8832.6. Samples: 87229000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:43,785][121949] Avg episode reward: [(0, '5423.235'), (1, '5500.746')] [2023-12-26 00:56:44,181][123090] Updated weights for policy 1, policy_version 170021 (0.0008) [2023-12-26 00:56:44,238][123090] Updated weights for policy 1, policy_version 170031 (0.0009) [2023-12-26 00:56:44,307][123090] Updated weights for policy 1, policy_version 170041 (0.0009) [2023-12-26 00:56:44,319][123091] Updated weights for policy 0, policy_version 170757 (0.0007) [2023-12-26 00:56:44,376][123091] Updated weights for policy 0, policy_version 170767 (0.0009) [2023-12-26 00:56:44,441][123091] Updated weights for policy 0, policy_version 170777 (0.0009) [2023-12-26 00:56:45,171][123090] Updated weights for policy 1, policy_version 170051 (0.0008) [2023-12-26 00:56:45,209][123091] Updated weights for policy 0, policy_version 170787 (0.0009) [2023-12-26 00:56:45,226][123090] Updated weights for policy 1, policy_version 170061 (0.0009) [2023-12-26 00:56:45,265][123091] Updated weights for policy 0, policy_version 170797 (0.0006) [2023-12-26 00:56:45,297][123090] Updated weights for policy 1, policy_version 170071 (0.0007) [2023-12-26 00:56:45,334][123091] Updated weights for policy 0, policy_version 170807 (0.0009) [2023-12-26 00:56:45,951][123091] Updated weights for policy 0, policy_version 170817 (0.0008) [2023-12-26 00:56:46,031][123091] Updated weights for policy 0, policy_version 170827 (0.0005) [2023-12-26 00:56:46,094][123091] Updated weights for policy 0, policy_version 170837 (0.0006) [2023-12-26 00:56:46,171][123091] Updated weights for policy 0, policy_version 170847 (0.0007) [2023-12-26 00:56:46,181][123090] Updated weights for policy 1, policy_version 170081 (0.0008) [2023-12-26 00:56:46,241][123090] Updated weights for policy 1, policy_version 170091 (0.0009) [2023-12-26 00:56:46,293][123090] Updated weights for policy 1, policy_version 170101 (0.0009) [2023-12-26 00:56:46,368][123090] Updated weights for policy 1, policy_version 170112 (0.0010) [2023-12-26 00:56:46,806][123091] Updated weights for policy 0, policy_version 170857 (0.0006) [2023-12-26 00:56:46,857][123091] Updated weights for policy 0, policy_version 170867 (0.0005) [2023-12-26 00:56:46,922][123091] Updated weights for policy 0, policy_version 170877 (0.0009) [2023-12-26 00:56:47,264][123090] Updated weights for policy 1, policy_version 170122 (0.0009) [2023-12-26 00:56:47,321][123090] Updated weights for policy 1, policy_version 170132 (0.0009) [2023-12-26 00:56:47,377][123090] Updated weights for policy 1, policy_version 170142 (0.0009) [2023-12-26 00:56:47,699][123091] Updated weights for policy 0, policy_version 170887 (0.0010) [2023-12-26 00:56:47,759][123091] Updated weights for policy 0, policy_version 170897 (0.0010) [2023-12-26 00:56:47,809][123091] Updated weights for policy 0, policy_version 170907 (0.0010) [2023-12-26 00:56:48,236][123090] Updated weights for policy 1, policy_version 170152 (0.0010) [2023-12-26 00:56:48,304][123090] Updated weights for policy 1, policy_version 170162 (0.0009) [2023-12-26 00:56:48,374][123090] Updated weights for policy 1, policy_version 170172 (0.0008) [2023-12-26 00:56:48,622][123091] Updated weights for policy 0, policy_version 170917 (0.0010) [2023-12-26 00:56:48,678][123091] Updated weights for policy 0, policy_version 170927 (0.0010) [2023-12-26 00:56:48,735][123091] Updated weights for policy 0, policy_version 170937 (0.0009) [2023-12-26 00:56:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 87326720. Throughput: 0: 9037.0, 1: 8735.0. Samples: 87333992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:48,784][121949] Avg episode reward: [(0, '5513.873'), (1, '5365.029')] [2023-12-26 00:56:49,245][123090] Updated weights for policy 1, policy_version 170182 (0.0009) [2023-12-26 00:56:49,320][123090] Updated weights for policy 1, policy_version 170192 (0.0006) [2023-12-26 00:56:49,395][123090] Updated weights for policy 1, policy_version 170202 (0.0007) [2023-12-26 00:56:49,481][123091] Updated weights for policy 0, policy_version 170947 (0.0009) [2023-12-26 00:56:49,532][123091] Updated weights for policy 0, policy_version 170957 (0.0007) [2023-12-26 00:56:49,588][123091] Updated weights for policy 0, policy_version 170967 (0.0005) [2023-12-26 00:56:50,244][123090] Updated weights for policy 1, policy_version 170212 (0.0010) [2023-12-26 00:56:50,265][123091] Updated weights for policy 0, policy_version 170977 (0.0005) [2023-12-26 00:56:50,307][123090] Updated weights for policy 1, policy_version 170222 (0.0009) [2023-12-26 00:56:50,335][123091] Updated weights for policy 0, policy_version 170987 (0.0005) [2023-12-26 00:56:50,373][123090] Updated weights for policy 1, policy_version 170232 (0.0009) [2023-12-26 00:56:50,400][123091] Updated weights for policy 0, policy_version 170997 (0.0006) [2023-12-26 00:56:50,460][123091] Updated weights for policy 0, policy_version 171007 (0.0006) [2023-12-26 00:56:51,209][123090] Updated weights for policy 1, policy_version 170242 (0.0009) [2023-12-26 00:56:51,241][123091] Updated weights for policy 0, policy_version 171017 (0.0009) [2023-12-26 00:56:51,271][123090] Updated weights for policy 1, policy_version 170252 (0.0008) [2023-12-26 00:56:51,308][123091] Updated weights for policy 0, policy_version 171027 (0.0009) [2023-12-26 00:56:51,328][123090] Updated weights for policy 1, policy_version 170262 (0.0009) [2023-12-26 00:56:51,371][123091] Updated weights for policy 0, policy_version 171037 (0.0008) [2023-12-26 00:56:51,398][123090] Updated weights for policy 1, policy_version 170272 (0.0008) [2023-12-26 00:56:52,131][123091] Updated weights for policy 0, policy_version 171047 (0.0009) [2023-12-26 00:56:52,183][123091] Updated weights for policy 0, policy_version 171057 (0.0009) [2023-12-26 00:56:52,222][123090] Updated weights for policy 1, policy_version 170282 (0.0007) [2023-12-26 00:56:52,232][123091] Updated weights for policy 0, policy_version 171067 (0.0010) [2023-12-26 00:56:52,290][123090] Updated weights for policy 1, policy_version 170292 (0.0009) [2023-12-26 00:56:52,361][123090] Updated weights for policy 1, policy_version 170302 (0.0010) [2023-12-26 00:56:53,088][123091] Updated weights for policy 0, policy_version 171077 (0.0009) [2023-12-26 00:56:53,143][123091] Updated weights for policy 0, policy_version 171087 (0.0009) [2023-12-26 00:56:53,167][123090] Updated weights for policy 1, policy_version 170312 (0.0009) [2023-12-26 00:56:53,200][123091] Updated weights for policy 0, policy_version 171097 (0.0006) [2023-12-26 00:56:53,228][123090] Updated weights for policy 1, policy_version 170322 (0.0010) [2023-12-26 00:56:53,291][123090] Updated weights for policy 1, policy_version 170332 (0.0009) [2023-12-26 00:56:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 87408640. Throughput: 0: 9038.2, 1: 8706.1. Samples: 87386384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:53,785][121949] Avg episode reward: [(0, '5575.040'), (1, '5288.997')] [2023-12-26 00:56:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000171104_43802624.pth... [2023-12-26 00:56:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000170336_43606016.pth... [2023-12-26 00:56:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000169312_43343872.pth [2023-12-26 00:56:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000170048_43532288.pth [2023-12-26 00:56:53,926][123091] Updated weights for policy 0, policy_version 171107 (0.0007) [2023-12-26 00:56:53,997][123091] Updated weights for policy 0, policy_version 171117 (0.0005) [2023-12-26 00:56:54,063][123091] Updated weights for policy 0, policy_version 171127 (0.0006) [2023-12-26 00:56:54,168][123090] Updated weights for policy 1, policy_version 170342 (0.0009) [2023-12-26 00:56:54,229][123090] Updated weights for policy 1, policy_version 170352 (0.0009) [2023-12-26 00:56:54,304][123090] Updated weights for policy 1, policy_version 170362 (0.0009) [2023-12-26 00:56:54,832][123091] Updated weights for policy 0, policy_version 171137 (0.0006) [2023-12-26 00:56:54,902][123091] Updated weights for policy 0, policy_version 171147 (0.0006) [2023-12-26 00:56:54,958][123091] Updated weights for policy 0, policy_version 171157 (0.0006) [2023-12-26 00:56:55,017][123091] Updated weights for policy 0, policy_version 171167 (0.0007) [2023-12-26 00:56:55,160][123090] Updated weights for policy 1, policy_version 170372 (0.0010) [2023-12-26 00:56:55,229][123090] Updated weights for policy 1, policy_version 170382 (0.0009) [2023-12-26 00:56:55,301][123090] Updated weights for policy 1, policy_version 170392 (0.0006) [2023-12-26 00:56:55,820][123091] Updated weights for policy 0, policy_version 171177 (0.0010) [2023-12-26 00:56:55,867][123091] Updated weights for policy 0, policy_version 171187 (0.0009) [2023-12-26 00:56:55,916][123091] Updated weights for policy 0, policy_version 171197 (0.0009) [2023-12-26 00:56:56,029][123090] Updated weights for policy 1, policy_version 170402 (0.0006) [2023-12-26 00:56:56,079][123090] Updated weights for policy 1, policy_version 170412 (0.0009) [2023-12-26 00:56:56,138][123090] Updated weights for policy 1, policy_version 170422 (0.0009) [2023-12-26 00:56:56,196][123090] Updated weights for policy 1, policy_version 170432 (0.0008) [2023-12-26 00:56:56,706][123091] Updated weights for policy 0, policy_version 171207 (0.0009) [2023-12-26 00:56:56,772][123091] Updated weights for policy 0, policy_version 171217 (0.0008) [2023-12-26 00:56:56,825][123091] Updated weights for policy 0, policy_version 171227 (0.0009) [2023-12-26 00:56:57,094][123090] Updated weights for policy 1, policy_version 170442 (0.0010) [2023-12-26 00:56:57,151][123090] Updated weights for policy 1, policy_version 170452 (0.0008) [2023-12-26 00:56:57,218][123090] Updated weights for policy 1, policy_version 170462 (0.0008) [2023-12-26 00:56:57,658][123091] Updated weights for policy 0, policy_version 171237 (0.0010) [2023-12-26 00:56:57,706][123091] Updated weights for policy 0, policy_version 171247 (0.0009) [2023-12-26 00:56:57,761][123091] Updated weights for policy 0, policy_version 171257 (0.0010) [2023-12-26 00:56:58,034][123090] Updated weights for policy 1, policy_version 170472 (0.0010) [2023-12-26 00:56:58,100][123090] Updated weights for policy 1, policy_version 170482 (0.0009) [2023-12-26 00:56:58,169][123090] Updated weights for policy 1, policy_version 170492 (0.0009) [2023-12-26 00:56:58,648][123091] Updated weights for policy 0, policy_version 171267 (0.0009) [2023-12-26 00:56:58,725][123091] Updated weights for policy 0, policy_version 171277 (0.0008) [2023-12-26 00:56:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 87490560. Throughput: 0: 9048.7, 1: 8703.2. Samples: 87491492. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:56:58,785][121949] Avg episode reward: [(0, '5387.712'), (1, '5397.409')] [2023-12-26 00:56:58,801][123091] Updated weights for policy 0, policy_version 171287 (0.0011) [2023-12-26 00:56:59,061][123090] Updated weights for policy 1, policy_version 170502 (0.0010) [2023-12-26 00:56:59,125][123090] Updated weights for policy 1, policy_version 170512 (0.0010) [2023-12-26 00:56:59,184][123090] Updated weights for policy 1, policy_version 170522 (0.0010) [2023-12-26 00:56:59,641][123091] Updated weights for policy 0, policy_version 171297 (0.0007) [2023-12-26 00:56:59,697][123091] Updated weights for policy 0, policy_version 171307 (0.0011) [2023-12-26 00:56:59,746][123091] Updated weights for policy 0, policy_version 171317 (0.0010) [2023-12-26 00:56:59,794][123091] Updated weights for policy 0, policy_version 171327 (0.0010) [2023-12-26 00:57:00,018][123090] Updated weights for policy 1, policy_version 170532 (0.0009) [2023-12-26 00:57:00,076][123090] Updated weights for policy 1, policy_version 170542 (0.0009) [2023-12-26 00:57:00,139][123090] Updated weights for policy 1, policy_version 170552 (0.0008) [2023-12-26 00:57:00,654][123091] Updated weights for policy 0, policy_version 171337 (0.0010) [2023-12-26 00:57:00,703][123091] Updated weights for policy 0, policy_version 171347 (0.0009) [2023-12-26 00:57:00,757][123091] Updated weights for policy 0, policy_version 171358 (0.0010) [2023-12-26 00:57:00,859][123090] Updated weights for policy 1, policy_version 170562 (0.0009) [2023-12-26 00:57:00,934][123090] Updated weights for policy 1, policy_version 170572 (0.0005) [2023-12-26 00:57:00,997][123090] Updated weights for policy 1, policy_version 170582 (0.0005) [2023-12-26 00:57:01,058][123090] Updated weights for policy 1, policy_version 170592 (0.0007) [2023-12-26 00:57:01,647][123091] Updated weights for policy 0, policy_version 171368 (0.0010) [2023-12-26 00:57:01,718][123091] Updated weights for policy 0, policy_version 171378 (0.0009) [2023-12-26 00:57:01,782][123091] Updated weights for policy 0, policy_version 171388 (0.0008) [2023-12-26 00:57:01,807][123090] Updated weights for policy 1, policy_version 170602 (0.0008) [2023-12-26 00:57:01,875][123090] Updated weights for policy 1, policy_version 170612 (0.0009) [2023-12-26 00:57:01,935][123090] Updated weights for policy 1, policy_version 170622 (0.0010) [2023-12-26 00:57:02,615][123091] Updated weights for policy 0, policy_version 171399 (0.0010) [2023-12-26 00:57:02,681][123091] Updated weights for policy 0, policy_version 171409 (0.0009) [2023-12-26 00:57:02,739][123091] Updated weights for policy 0, policy_version 171419 (0.0008) [2023-12-26 00:57:02,746][123090] Updated weights for policy 1, policy_version 170632 (0.0009) [2023-12-26 00:57:02,797][123090] Updated weights for policy 1, policy_version 170642 (0.0008) [2023-12-26 00:57:02,855][123090] Updated weights for policy 1, policy_version 170652 (0.0010) [2023-12-26 00:57:03,589][123090] Updated weights for policy 1, policy_version 170662 (0.0009) [2023-12-26 00:57:03,593][123091] Updated weights for policy 0, policy_version 171429 (0.0007) [2023-12-26 00:57:03,639][123090] Updated weights for policy 1, policy_version 170672 (0.0007) [2023-12-26 00:57:03,645][123091] Updated weights for policy 0, policy_version 171439 (0.0009) [2023-12-26 00:57:03,686][123090] Updated weights for policy 1, policy_version 170682 (0.0005) [2023-12-26 00:57:03,694][123091] Updated weights for policy 0, policy_version 171449 (0.0010) [2023-12-26 00:57:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 87588864. Throughput: 0: 8986.4, 1: 8704.0. Samples: 87593824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:57:03,785][121949] Avg episode reward: [(0, '5392.560'), (1, '5200.393')] [2023-12-26 00:57:04,519][123090] Updated weights for policy 1, policy_version 170692 (0.0007) [2023-12-26 00:57:04,569][123091] Updated weights for policy 0, policy_version 171459 (0.0008) [2023-12-26 00:57:04,583][123090] Updated weights for policy 1, policy_version 170702 (0.0006) [2023-12-26 00:57:04,632][123091] Updated weights for policy 0, policy_version 171469 (0.0006) [2023-12-26 00:57:04,639][123090] Updated weights for policy 1, policy_version 170712 (0.0010) [2023-12-26 00:57:04,696][123091] Updated weights for policy 0, policy_version 171479 (0.0009) [2023-12-26 00:57:05,329][123090] Updated weights for policy 1, policy_version 170722 (0.0006) [2023-12-26 00:57:05,377][123090] Updated weights for policy 1, policy_version 170732 (0.0005) [2023-12-26 00:57:05,431][123090] Updated weights for policy 1, policy_version 170742 (0.0008) [2023-12-26 00:57:05,496][123090] Updated weights for policy 1, policy_version 170752 (0.0010) [2023-12-26 00:57:05,605][123091] Updated weights for policy 0, policy_version 171489 (0.0010) [2023-12-26 00:57:05,672][123091] Updated weights for policy 0, policy_version 171499 (0.0010) [2023-12-26 00:57:05,736][123091] Updated weights for policy 0, policy_version 171509 (0.0010) [2023-12-26 00:57:05,801][123091] Updated weights for policy 0, policy_version 171519 (0.0009) [2023-12-26 00:57:06,333][123090] Updated weights for policy 1, policy_version 170762 (0.0008) [2023-12-26 00:57:06,402][123090] Updated weights for policy 1, policy_version 170772 (0.0008) [2023-12-26 00:57:06,472][123090] Updated weights for policy 1, policy_version 170782 (0.0008) [2023-12-26 00:57:06,638][123091] Updated weights for policy 0, policy_version 171529 (0.0010) [2023-12-26 00:57:06,697][123091] Updated weights for policy 0, policy_version 171539 (0.0010) [2023-12-26 00:57:06,759][123091] Updated weights for policy 0, policy_version 171549 (0.0010) [2023-12-26 00:57:07,184][123090] Updated weights for policy 1, policy_version 170792 (0.0006) [2023-12-26 00:57:07,239][123090] Updated weights for policy 1, policy_version 170802 (0.0006) [2023-12-26 00:57:07,296][123090] Updated weights for policy 1, policy_version 170812 (0.0007) [2023-12-26 00:57:07,671][123091] Updated weights for policy 0, policy_version 171559 (0.0009) [2023-12-26 00:57:07,731][123091] Updated weights for policy 0, policy_version 171569 (0.0010) [2023-12-26 00:57:07,790][123091] Updated weights for policy 0, policy_version 171579 (0.0010) [2023-12-26 00:57:07,986][123090] Updated weights for policy 1, policy_version 170822 (0.0007) [2023-12-26 00:57:08,045][123090] Updated weights for policy 1, policy_version 170832 (0.0006) [2023-12-26 00:57:08,091][123090] Updated weights for policy 1, policy_version 170842 (0.0005) [2023-12-26 00:57:08,621][123091] Updated weights for policy 0, policy_version 171589 (0.0008) [2023-12-26 00:57:08,685][123091] Updated weights for policy 0, policy_version 171599 (0.0006) [2023-12-26 00:57:08,753][123091] Updated weights for policy 0, policy_version 171609 (0.0005) [2023-12-26 00:57:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 87662592. Throughput: 0: 8958.4, 1: 8743.5. Samples: 87645748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:57:08,785][121949] Avg episode reward: [(0, '5578.153'), (1, '5108.173')] [2023-12-26 00:57:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000170848_43737088.pth... [2023-12-26 00:57:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000169856_43483136.pth [2023-12-26 00:57:08,800][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000171616_43933696.pth... [2023-12-26 00:57:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000170560_43663360.pth [2023-12-26 00:57:08,851][123090] Updated weights for policy 1, policy_version 170852 (0.0007) [2023-12-26 00:57:08,909][123090] Updated weights for policy 1, policy_version 170862 (0.0008) [2023-12-26 00:57:08,973][123090] Updated weights for policy 1, policy_version 170872 (0.0005) [2023-12-26 00:57:09,459][123091] Updated weights for policy 0, policy_version 171619 (0.0007) [2023-12-26 00:57:09,523][123091] Updated weights for policy 0, policy_version 171629 (0.0010) [2023-12-26 00:57:09,582][123091] Updated weights for policy 0, policy_version 171639 (0.0011) [2023-12-26 00:57:09,649][123090] Updated weights for policy 1, policy_version 170882 (0.0007) [2023-12-26 00:57:09,709][123090] Updated weights for policy 1, policy_version 170892 (0.0010) [2023-12-26 00:57:09,762][123090] Updated weights for policy 1, policy_version 170902 (0.0011) [2023-12-26 00:57:09,821][123090] Updated weights for policy 1, policy_version 170912 (0.0011) [2023-12-26 00:57:10,352][123091] Updated weights for policy 0, policy_version 171649 (0.0010) [2023-12-26 00:57:10,422][123091] Updated weights for policy 0, policy_version 171659 (0.0006) [2023-12-26 00:57:10,491][123091] Updated weights for policy 0, policy_version 171669 (0.0006) [2023-12-26 00:57:10,554][123091] Updated weights for policy 0, policy_version 171679 (0.0010) [2023-12-26 00:57:10,617][123090] Updated weights for policy 1, policy_version 170922 (0.0005) [2023-12-26 00:57:10,669][123090] Updated weights for policy 1, policy_version 170932 (0.0007) [2023-12-26 00:57:10,719][123090] Updated weights for policy 1, policy_version 170942 (0.0009) [2023-12-26 00:57:11,364][123091] Updated weights for policy 0, policy_version 171689 (0.0011) [2023-12-26 00:57:11,430][123091] Updated weights for policy 0, policy_version 171699 (0.0010) [2023-12-26 00:57:11,490][123091] Updated weights for policy 0, policy_version 171709 (0.0011) [2023-12-26 00:57:11,610][123090] Updated weights for policy 1, policy_version 170952 (0.0008) [2023-12-26 00:57:11,683][123090] Updated weights for policy 1, policy_version 170962 (0.0008) [2023-12-26 00:57:11,753][123090] Updated weights for policy 1, policy_version 170972 (0.0010) [2023-12-26 00:57:12,236][123091] Updated weights for policy 0, policy_version 171719 (0.0008) [2023-12-26 00:57:12,303][123091] Updated weights for policy 0, policy_version 171729 (0.0009) [2023-12-26 00:57:12,378][123091] Updated weights for policy 0, policy_version 171739 (0.0010) [2023-12-26 00:57:12,513][123090] Updated weights for policy 1, policy_version 170982 (0.0009) [2023-12-26 00:57:12,580][123090] Updated weights for policy 1, policy_version 170992 (0.0011) [2023-12-26 00:57:12,637][123090] Updated weights for policy 1, policy_version 171002 (0.0010) [2023-12-26 00:57:13,162][123091] Updated weights for policy 0, policy_version 171749 (0.0008) [2023-12-26 00:57:13,226][123091] Updated weights for policy 0, policy_version 171759 (0.0005) [2023-12-26 00:57:13,302][123091] Updated weights for policy 0, policy_version 171769 (0.0005) [2023-12-26 00:57:13,448][123090] Updated weights for policy 1, policy_version 171012 (0.0008) [2023-12-26 00:57:13,504][123090] Updated weights for policy 1, policy_version 171022 (0.0005) [2023-12-26 00:57:13,565][123090] Updated weights for policy 1, policy_version 171032 (0.0005) [2023-12-26 00:57:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 87760896. Throughput: 0: 8948.4, 1: 8694.9. Samples: 87753376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 00:57:13,785][121949] Avg episode reward: [(0, '5577.035'), (1, '5265.851')] [2023-12-26 00:57:14,075][123091] Updated weights for policy 0, policy_version 171779 (0.0009) [2023-12-26 00:57:14,127][123091] Updated weights for policy 0, policy_version 171789 (0.0011) [2023-12-26 00:57:14,198][123091] Updated weights for policy 0, policy_version 171799 (0.0011) [2023-12-26 00:57:14,212][123090] Updated weights for policy 1, policy_version 171042 (0.0005) [2023-12-26 00:57:14,259][123090] Updated weights for policy 1, policy_version 171052 (0.0005) [2023-12-26 00:57:14,313][123090] Updated weights for policy 1, policy_version 171062 (0.0005) [2023-12-26 00:57:14,382][123090] Updated weights for policy 1, policy_version 171072 (0.0008) [2023-12-26 00:57:15,014][123091] Updated weights for policy 0, policy_version 171809 (0.0011) [2023-12-26 00:57:15,078][123091] Updated weights for policy 0, policy_version 171819 (0.0011) [2023-12-26 00:57:15,124][123090] Updated weights for policy 1, policy_version 171082 (0.0007) [2023-12-26 00:57:15,141][123091] Updated weights for policy 0, policy_version 171829 (0.0011) [2023-12-26 00:57:15,183][123090] Updated weights for policy 1, policy_version 171092 (0.0008) [2023-12-26 00:57:15,206][123091] Updated weights for policy 0, policy_version 171839 (0.0011) [2023-12-26 00:57:15,253][123090] Updated weights for policy 1, policy_version 171102 (0.0007) [2023-12-26 00:57:16,031][123091] Updated weights for policy 0, policy_version 171849 (0.0011) [2023-12-26 00:57:16,064][123090] Updated weights for policy 1, policy_version 171112 (0.0010) [2023-12-26 00:57:16,094][123091] Updated weights for policy 0, policy_version 171859 (0.0011) [2023-12-26 00:57:16,124][123090] Updated weights for policy 1, policy_version 171122 (0.0010) [2023-12-26 00:57:16,153][123091] Updated weights for policy 0, policy_version 171869 (0.0011) [2023-12-26 00:57:16,184][123090] Updated weights for policy 1, policy_version 171132 (0.0007) [2023-12-26 00:57:16,865][123091] Updated weights for policy 0, policy_version 171879 (0.0008) [2023-12-26 00:57:16,909][123090] Updated weights for policy 1, policy_version 171142 (0.0008) [2023-12-26 00:57:16,938][123091] Updated weights for policy 0, policy_version 171889 (0.0006) [2023-12-26 00:57:16,968][123090] Updated weights for policy 1, policy_version 171152 (0.0010) [2023-12-26 00:57:16,997][123091] Updated weights for policy 0, policy_version 171899 (0.0007) [2023-12-26 00:57:17,020][123090] Updated weights for policy 1, policy_version 171162 (0.0010) [2023-12-26 00:57:17,663][123091] Updated weights for policy 0, policy_version 171909 (0.0008) [2023-12-26 00:57:17,719][123091] Updated weights for policy 0, policy_version 171919 (0.0009) [2023-12-26 00:57:17,767][123091] Updated weights for policy 0, policy_version 171929 (0.0009) [2023-12-26 00:57:17,827][123090] Updated weights for policy 1, policy_version 171172 (0.0010) [2023-12-26 00:57:17,889][123090] Updated weights for policy 1, policy_version 171182 (0.0010) [2023-12-26 00:57:17,952][123090] Updated weights for policy 1, policy_version 171192 (0.0008) [2023-12-26 00:57:18,513][123091] Updated weights for policy 0, policy_version 171939 (0.0009) [2023-12-26 00:57:18,574][123091] Updated weights for policy 0, policy_version 171949 (0.0009) [2023-12-26 00:57:18,637][123091] Updated weights for policy 0, policy_version 171959 (0.0010) [2023-12-26 00:57:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 87851008. Throughput: 0: 8908.5, 1: 8772.0. Samples: 87862484. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:18,785][121949] Avg episode reward: [(0, '5559.465'), (1, '5222.309')] [2023-12-26 00:57:18,808][123090] Updated weights for policy 1, policy_version 171203 (0.0010) [2023-12-26 00:57:18,872][123090] Updated weights for policy 1, policy_version 171213 (0.0010) [2023-12-26 00:57:18,945][123090] Updated weights for policy 1, policy_version 171223 (0.0008) [2023-12-26 00:57:19,496][123091] Updated weights for policy 0, policy_version 171969 (0.0009) [2023-12-26 00:57:19,559][123091] Updated weights for policy 0, policy_version 171979 (0.0009) [2023-12-26 00:57:19,629][123091] Updated weights for policy 0, policy_version 171989 (0.0010) [2023-12-26 00:57:19,686][123090] Updated weights for policy 1, policy_version 171233 (0.0006) [2023-12-26 00:57:19,695][123091] Updated weights for policy 0, policy_version 171999 (0.0008) [2023-12-26 00:57:19,746][123090] Updated weights for policy 1, policy_version 171243 (0.0005) [2023-12-26 00:57:19,800][123090] Updated weights for policy 1, policy_version 171253 (0.0005) [2023-12-26 00:57:19,875][123090] Updated weights for policy 1, policy_version 171263 (0.0010) [2023-12-26 00:57:20,589][123091] Updated weights for policy 0, policy_version 172009 (0.0009) [2023-12-26 00:57:20,637][123090] Updated weights for policy 1, policy_version 171273 (0.0011) [2023-12-26 00:57:20,656][123091] Updated weights for policy 0, policy_version 172019 (0.0006) [2023-12-26 00:57:20,702][123090] Updated weights for policy 1, policy_version 171283 (0.0009) [2023-12-26 00:57:20,718][123091] Updated weights for policy 0, policy_version 172029 (0.0007) [2023-12-26 00:57:20,771][123090] Updated weights for policy 1, policy_version 171293 (0.0010) [2023-12-26 00:57:21,566][123091] Updated weights for policy 0, policy_version 172039 (0.0009) [2023-12-26 00:57:21,626][123090] Updated weights for policy 1, policy_version 171303 (0.0010) [2023-12-26 00:57:21,633][123091] Updated weights for policy 0, policy_version 172049 (0.0008) [2023-12-26 00:57:21,699][123090] Updated weights for policy 1, policy_version 171313 (0.0010) [2023-12-26 00:57:21,703][123091] Updated weights for policy 0, policy_version 172059 (0.0008) [2023-12-26 00:57:21,762][123090] Updated weights for policy 1, policy_version 171323 (0.0011) [2023-12-26 00:57:22,583][123090] Updated weights for policy 1, policy_version 171333 (0.0008) [2023-12-26 00:57:22,587][123091] Updated weights for policy 0, policy_version 172069 (0.0006) [2023-12-26 00:57:22,652][123090] Updated weights for policy 1, policy_version 171343 (0.0005) [2023-12-26 00:57:22,653][123091] Updated weights for policy 0, policy_version 172079 (0.0005) [2023-12-26 00:57:22,713][123091] Updated weights for policy 0, policy_version 172089 (0.0007) [2023-12-26 00:57:22,716][123090] Updated weights for policy 1, policy_version 171353 (0.0006) [2023-12-26 00:57:23,331][123090] Updated weights for policy 1, policy_version 171363 (0.0007) [2023-12-26 00:57:23,391][123090] Updated weights for policy 1, policy_version 171373 (0.0009) [2023-12-26 00:57:23,445][123090] Updated weights for policy 1, policy_version 171383 (0.0009) [2023-12-26 00:57:23,466][123091] Updated weights for policy 0, policy_version 172099 (0.0008) [2023-12-26 00:57:23,529][123091] Updated weights for policy 0, policy_version 172109 (0.0010) [2023-12-26 00:57:23,594][123091] Updated weights for policy 0, policy_version 172119 (0.0009) [2023-12-26 00:57:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 87941120. Throughput: 0: 8833.0, 1: 8734.0. Samples: 87913360. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:23,785][121949] Avg episode reward: [(0, '5585.109'), (1, '5241.581')] [2023-12-26 00:57:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000171392_43876352.pth... [2023-12-26 00:57:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000172128_44064768.pth... [2023-12-26 00:57:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000170336_43606016.pth [2023-12-26 00:57:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000171104_43802624.pth [2023-12-26 00:57:24,280][123090] Updated weights for policy 1, policy_version 171393 (0.0008) [2023-12-26 00:57:24,332][123090] Updated weights for policy 1, policy_version 171403 (0.0008) [2023-12-26 00:57:24,356][123091] Updated weights for policy 0, policy_version 172130 (0.0009) [2023-12-26 00:57:24,391][123090] Updated weights for policy 1, policy_version 171413 (0.0006) [2023-12-26 00:57:24,414][123091] Updated weights for policy 0, policy_version 172140 (0.0010) [2023-12-26 00:57:24,450][123090] Updated weights for policy 1, policy_version 171423 (0.0005) [2023-12-26 00:57:24,469][123091] Updated weights for policy 0, policy_version 172150 (0.0010) [2023-12-26 00:57:24,527][123091] Updated weights for policy 0, policy_version 172160 (0.0010) [2023-12-26 00:57:25,132][123090] Updated weights for policy 1, policy_version 171433 (0.0005) [2023-12-26 00:57:25,189][123090] Updated weights for policy 1, policy_version 171443 (0.0007) [2023-12-26 00:57:25,237][123090] Updated weights for policy 1, policy_version 171453 (0.0008) [2023-12-26 00:57:25,379][123091] Updated weights for policy 0, policy_version 172170 (0.0010) [2023-12-26 00:57:25,430][123091] Updated weights for policy 0, policy_version 172180 (0.0010) [2023-12-26 00:57:25,474][123091] Updated weights for policy 0, policy_version 172190 (0.0010) [2023-12-26 00:57:25,946][123090] Updated weights for policy 1, policy_version 171463 (0.0006) [2023-12-26 00:57:26,008][123090] Updated weights for policy 1, policy_version 171473 (0.0005) [2023-12-26 00:57:26,071][123090] Updated weights for policy 1, policy_version 171483 (0.0005) [2023-12-26 00:57:26,317][123091] Updated weights for policy 0, policy_version 172200 (0.0006) [2023-12-26 00:57:26,365][123091] Updated weights for policy 0, policy_version 172210 (0.0005) [2023-12-26 00:57:26,411][123091] Updated weights for policy 0, policy_version 172220 (0.0005) [2023-12-26 00:57:26,783][123090] Updated weights for policy 1, policy_version 171493 (0.0008) [2023-12-26 00:57:26,838][123090] Updated weights for policy 1, policy_version 171503 (0.0010) [2023-12-26 00:57:26,889][123090] Updated weights for policy 1, policy_version 171513 (0.0010) [2023-12-26 00:57:27,156][123091] Updated weights for policy 0, policy_version 172230 (0.0007) [2023-12-26 00:57:27,203][123091] Updated weights for policy 0, policy_version 172240 (0.0008) [2023-12-26 00:57:27,250][123091] Updated weights for policy 0, policy_version 172250 (0.0008) [2023-12-26 00:57:27,695][123090] Updated weights for policy 1, policy_version 171523 (0.0010) [2023-12-26 00:57:27,750][123090] Updated weights for policy 1, policy_version 171533 (0.0010) [2023-12-26 00:57:27,812][123090] Updated weights for policy 1, policy_version 171543 (0.0010) [2023-12-26 00:57:28,020][123091] Updated weights for policy 0, policy_version 172260 (0.0007) [2023-12-26 00:57:28,081][123091] Updated weights for policy 0, policy_version 172270 (0.0005) [2023-12-26 00:57:28,141][123091] Updated weights for policy 0, policy_version 172280 (0.0005) [2023-12-26 00:57:28,639][123090] Updated weights for policy 1, policy_version 171553 (0.0010) [2023-12-26 00:57:28,698][123090] Updated weights for policy 1, policy_version 171563 (0.0010) [2023-12-26 00:57:28,752][123090] Updated weights for policy 1, policy_version 171573 (0.0007) [2023-12-26 00:57:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 88023040. Throughput: 0: 8793.6, 1: 8820.7. Samples: 88021644. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:28,784][121949] Avg episode reward: [(0, '5647.010'), (1, '5365.060')] [2023-12-26 00:57:28,821][123090] Updated weights for policy 1, policy_version 171583 (0.0006) [2023-12-26 00:57:28,858][123091] Updated weights for policy 0, policy_version 172290 (0.0006) [2023-12-26 00:57:28,906][123091] Updated weights for policy 0, policy_version 172300 (0.0010) [2023-12-26 00:57:28,968][123091] Updated weights for policy 0, policy_version 172310 (0.0010) [2023-12-26 00:57:29,030][123091] Updated weights for policy 0, policy_version 172320 (0.0011) [2023-12-26 00:57:29,496][123090] Updated weights for policy 1, policy_version 171593 (0.0005) [2023-12-26 00:57:29,557][123090] Updated weights for policy 1, policy_version 171603 (0.0005) [2023-12-26 00:57:29,604][123090] Updated weights for policy 1, policy_version 171613 (0.0009) [2023-12-26 00:57:29,878][123091] Updated weights for policy 0, policy_version 172330 (0.0008) [2023-12-26 00:57:29,951][123091] Updated weights for policy 0, policy_version 172340 (0.0008) [2023-12-26 00:57:30,018][123091] Updated weights for policy 0, policy_version 172350 (0.0011) [2023-12-26 00:57:30,394][123090] Updated weights for policy 1, policy_version 171623 (0.0007) [2023-12-26 00:57:30,472][123090] Updated weights for policy 1, policy_version 171633 (0.0005) [2023-12-26 00:57:30,543][123090] Updated weights for policy 1, policy_version 171643 (0.0006) [2023-12-26 00:57:30,855][123091] Updated weights for policy 0, policy_version 172360 (0.0010) [2023-12-26 00:57:30,909][123091] Updated weights for policy 0, policy_version 172371 (0.0010) [2023-12-26 00:57:30,961][123091] Updated weights for policy 0, policy_version 172381 (0.0006) [2023-12-26 00:57:31,226][123090] Updated weights for policy 1, policy_version 171653 (0.0007) [2023-12-26 00:57:31,302][123090] Updated weights for policy 1, policy_version 171663 (0.0009) [2023-12-26 00:57:31,382][123090] Updated weights for policy 1, policy_version 171673 (0.0009) [2023-12-26 00:57:31,814][123091] Updated weights for policy 0, policy_version 172391 (0.0006) [2023-12-26 00:57:31,885][123091] Updated weights for policy 0, policy_version 172401 (0.0007) [2023-12-26 00:57:31,934][123091] Updated weights for policy 0, policy_version 172411 (0.0007) [2023-12-26 00:57:32,185][123090] Updated weights for policy 1, policy_version 171683 (0.0009) [2023-12-26 00:57:32,233][123090] Updated weights for policy 1, policy_version 171693 (0.0010) [2023-12-26 00:57:32,304][123090] Updated weights for policy 1, policy_version 171703 (0.0011) [2023-12-26 00:57:32,730][123091] Updated weights for policy 0, policy_version 172421 (0.0007) [2023-12-26 00:57:32,788][123091] Updated weights for policy 0, policy_version 172431 (0.0010) [2023-12-26 00:57:32,840][123091] Updated weights for policy 0, policy_version 172441 (0.0010) [2023-12-26 00:57:33,027][123090] Updated weights for policy 1, policy_version 171713 (0.0009) [2023-12-26 00:57:33,081][123090] Updated weights for policy 1, policy_version 171723 (0.0008) [2023-12-26 00:57:33,132][123090] Updated weights for policy 1, policy_version 171733 (0.0008) [2023-12-26 00:57:33,184][123090] Updated weights for policy 1, policy_version 171743 (0.0009) [2023-12-26 00:57:33,671][123091] Updated weights for policy 0, policy_version 172451 (0.0008) [2023-12-26 00:57:33,734][123091] Updated weights for policy 0, policy_version 172461 (0.0005) [2023-12-26 00:57:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 88113152. Throughput: 0: 8734.9, 1: 8970.0. Samples: 88130712. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:33,784][121949] Avg episode reward: [(0, '5523.369'), (1, '5549.085')] [2023-12-26 00:57:33,796][123091] Updated weights for policy 0, policy_version 172471 (0.0005) [2023-12-26 00:57:33,911][123090] Updated weights for policy 1, policy_version 171753 (0.0009) [2023-12-26 00:57:33,956][123090] Updated weights for policy 1, policy_version 171763 (0.0008) [2023-12-26 00:57:34,007][123090] Updated weights for policy 1, policy_version 171773 (0.0009) [2023-12-26 00:57:34,482][123091] Updated weights for policy 0, policy_version 172481 (0.0007) [2023-12-26 00:57:34,552][123091] Updated weights for policy 0, policy_version 172491 (0.0006) [2023-12-26 00:57:34,619][123091] Updated weights for policy 0, policy_version 172501 (0.0006) [2023-12-26 00:57:34,677][123091] Updated weights for policy 0, policy_version 172511 (0.0006) [2023-12-26 00:57:34,844][123090] Updated weights for policy 1, policy_version 171783 (0.0009) [2023-12-26 00:57:34,912][123090] Updated weights for policy 1, policy_version 171793 (0.0010) [2023-12-26 00:57:34,980][123090] Updated weights for policy 1, policy_version 171803 (0.0009) [2023-12-26 00:57:35,250][123091] Updated weights for policy 0, policy_version 172521 (0.0006) [2023-12-26 00:57:35,314][123091] Updated weights for policy 0, policy_version 172531 (0.0005) [2023-12-26 00:57:35,365][123091] Updated weights for policy 0, policy_version 172541 (0.0005) [2023-12-26 00:57:35,897][123090] Updated weights for policy 1, policy_version 171813 (0.0010) [2023-12-26 00:57:35,953][123090] Updated weights for policy 1, policy_version 171823 (0.0010) [2023-12-26 00:57:36,000][123091] Updated weights for policy 0, policy_version 172551 (0.0005) [2023-12-26 00:57:36,003][123090] Updated weights for policy 1, policy_version 171833 (0.0008) [2023-12-26 00:57:36,056][123091] Updated weights for policy 0, policy_version 172561 (0.0005) [2023-12-26 00:57:36,111][123091] Updated weights for policy 0, policy_version 172571 (0.0006) [2023-12-26 00:57:36,897][123090] Updated weights for policy 1, policy_version 171844 (0.0010) [2023-12-26 00:57:36,963][123090] Updated weights for policy 1, policy_version 171854 (0.0009) [2023-12-26 00:57:36,979][123091] Updated weights for policy 0, policy_version 172581 (0.0009) [2023-12-26 00:57:37,026][123090] Updated weights for policy 1, policy_version 171864 (0.0008) [2023-12-26 00:57:37,042][123091] Updated weights for policy 0, policy_version 172591 (0.0008) [2023-12-26 00:57:37,104][123091] Updated weights for policy 0, policy_version 172601 (0.0008) [2023-12-26 00:57:37,854][123091] Updated weights for policy 0, policy_version 172611 (0.0009) [2023-12-26 00:57:37,857][123090] Updated weights for policy 1, policy_version 171874 (0.0010) [2023-12-26 00:57:37,914][123090] Updated weights for policy 1, policy_version 171884 (0.0009) [2023-12-26 00:57:37,921][123091] Updated weights for policy 0, policy_version 172621 (0.0005) [2023-12-26 00:57:37,974][123091] Updated weights for policy 0, policy_version 172631 (0.0005) [2023-12-26 00:57:37,974][123090] Updated weights for policy 1, policy_version 171894 (0.0008) [2023-12-26 00:57:38,029][123090] Updated weights for policy 1, policy_version 171904 (0.0009) [2023-12-26 00:57:38,727][123091] Updated weights for policy 0, policy_version 172641 (0.0005) [2023-12-26 00:57:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 88203264. Throughput: 0: 8776.0, 1: 8985.5. Samples: 88185644. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:38,785][121949] Avg episode reward: [(0, '5446.139'), (1, '5549.854')] [2023-12-26 00:57:38,794][123091] Updated weights for policy 0, policy_version 172651 (0.0006) [2023-12-26 00:57:38,819][123090] Updated weights for policy 1, policy_version 171914 (0.0007) [2023-12-26 00:57:38,861][123091] Updated weights for policy 0, policy_version 172661 (0.0009) [2023-12-26 00:57:38,875][123090] Updated weights for policy 1, policy_version 171924 (0.0005) [2023-12-26 00:57:38,925][123091] Updated weights for policy 0, policy_version 172671 (0.0008) [2023-12-26 00:57:38,927][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000172672_44204032.pth... [2023-12-26 00:57:38,927][123090] Updated weights for policy 1, policy_version 171934 (0.0007) [2023-12-26 00:57:38,932][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000171616_43933696.pth [2023-12-26 00:57:38,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000171936_44015616.pth... [2023-12-26 00:57:38,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000170848_43737088.pth [2023-12-26 00:57:39,700][123091] Updated weights for policy 0, policy_version 172681 (0.0007) [2023-12-26 00:57:39,766][123091] Updated weights for policy 0, policy_version 172691 (0.0007) [2023-12-26 00:57:39,803][123090] Updated weights for policy 1, policy_version 171944 (0.0008) [2023-12-26 00:57:39,822][123091] Updated weights for policy 0, policy_version 172701 (0.0009) [2023-12-26 00:57:39,866][123090] Updated weights for policy 1, policy_version 171954 (0.0009) [2023-12-26 00:57:39,922][123090] Updated weights for policy 1, policy_version 171964 (0.0008) [2023-12-26 00:57:40,609][123091] Updated weights for policy 0, policy_version 172711 (0.0010) [2023-12-26 00:57:40,655][123091] Updated weights for policy 0, policy_version 172721 (0.0006) [2023-12-26 00:57:40,702][123091] Updated weights for policy 0, policy_version 172731 (0.0006) [2023-12-26 00:57:40,792][123090] Updated weights for policy 1, policy_version 171974 (0.0007) [2023-12-26 00:57:40,844][123090] Updated weights for policy 1, policy_version 171984 (0.0005) [2023-12-26 00:57:40,905][123090] Updated weights for policy 1, policy_version 171995 (0.0010) [2023-12-26 00:57:41,410][123091] Updated weights for policy 0, policy_version 172741 (0.0008) [2023-12-26 00:57:41,474][123091] Updated weights for policy 0, policy_version 172751 (0.0011) [2023-12-26 00:57:41,538][123091] Updated weights for policy 0, policy_version 172761 (0.0011) [2023-12-26 00:57:41,781][123090] Updated weights for policy 1, policy_version 172005 (0.0010) [2023-12-26 00:57:41,833][123090] Updated weights for policy 1, policy_version 172015 (0.0010) [2023-12-26 00:57:41,881][123090] Updated weights for policy 1, policy_version 172025 (0.0010) [2023-12-26 00:57:42,314][123091] Updated weights for policy 0, policy_version 172771 (0.0010) [2023-12-26 00:57:42,384][123091] Updated weights for policy 0, policy_version 172781 (0.0013) [2023-12-26 00:57:42,460][123091] Updated weights for policy 0, policy_version 172791 (0.0006) [2023-12-26 00:57:42,780][123090] Updated weights for policy 1, policy_version 172035 (0.0009) [2023-12-26 00:57:42,854][123090] Updated weights for policy 1, policy_version 172045 (0.0006) [2023-12-26 00:57:42,925][123090] Updated weights for policy 1, policy_version 172055 (0.0008) [2023-12-26 00:57:43,180][123091] Updated weights for policy 0, policy_version 172801 (0.0009) [2023-12-26 00:57:43,246][123091] Updated weights for policy 0, policy_version 172811 (0.0005) [2023-12-26 00:57:43,310][123091] Updated weights for policy 0, policy_version 172821 (0.0005) [2023-12-26 00:57:43,373][123091] Updated weights for policy 0, policy_version 172831 (0.0005) [2023-12-26 00:57:43,513][123090] Updated weights for policy 1, policy_version 172065 (0.0006) [2023-12-26 00:57:43,582][123090] Updated weights for policy 1, policy_version 172075 (0.0005) [2023-12-26 00:57:43,639][123090] Updated weights for policy 1, policy_version 172085 (0.0005) [2023-12-26 00:57:43,697][123090] Updated weights for policy 1, policy_version 172095 (0.0005) [2023-12-26 00:57:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 88301568. Throughput: 0: 8790.4, 1: 8972.9. Samples: 88290840. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:43,785][121949] Avg episode reward: [(0, '5452.599'), (1, '5571.911')] [2023-12-26 00:57:44,033][123091] Updated weights for policy 0, policy_version 172841 (0.0007) [2023-12-26 00:57:44,091][123091] Updated weights for policy 0, policy_version 172851 (0.0006) [2023-12-26 00:57:44,153][123091] Updated weights for policy 0, policy_version 172861 (0.0008) [2023-12-26 00:57:44,291][123090] Updated weights for policy 1, policy_version 172105 (0.0006) [2023-12-26 00:57:44,343][123090] Updated weights for policy 1, policy_version 172115 (0.0006) [2023-12-26 00:57:44,406][123090] Updated weights for policy 1, policy_version 172125 (0.0006) [2023-12-26 00:57:44,960][123091] Updated weights for policy 0, policy_version 172871 (0.0010) [2023-12-26 00:57:45,020][123091] Updated weights for policy 0, policy_version 172881 (0.0011) [2023-12-26 00:57:45,094][123091] Updated weights for policy 0, policy_version 172891 (0.0011) [2023-12-26 00:57:45,182][123090] Updated weights for policy 1, policy_version 172135 (0.0009) [2023-12-26 00:57:45,244][123090] Updated weights for policy 1, policy_version 172145 (0.0009) [2023-12-26 00:57:45,294][123090] Updated weights for policy 1, policy_version 172155 (0.0009) [2023-12-26 00:57:45,862][123091] Updated weights for policy 0, policy_version 172901 (0.0010) [2023-12-26 00:57:45,933][123091] Updated weights for policy 0, policy_version 172911 (0.0011) [2023-12-26 00:57:45,999][123091] Updated weights for policy 0, policy_version 172921 (0.0011) [2023-12-26 00:57:46,132][123090] Updated weights for policy 1, policy_version 172165 (0.0009) [2023-12-26 00:57:46,190][123090] Updated weights for policy 1, policy_version 172175 (0.0008) [2023-12-26 00:57:46,252][123090] Updated weights for policy 1, policy_version 172185 (0.0005) [2023-12-26 00:57:46,716][123091] Updated weights for policy 0, policy_version 172931 (0.0009) [2023-12-26 00:57:46,786][123091] Updated weights for policy 0, policy_version 172941 (0.0005) [2023-12-26 00:57:46,855][123091] Updated weights for policy 0, policy_version 172951 (0.0005) [2023-12-26 00:57:46,956][123090] Updated weights for policy 1, policy_version 172195 (0.0005) [2023-12-26 00:57:47,003][123090] Updated weights for policy 1, policy_version 172205 (0.0005) [2023-12-26 00:57:47,064][123090] Updated weights for policy 1, policy_version 172215 (0.0005) [2023-12-26 00:57:47,528][123091] Updated weights for policy 0, policy_version 172961 (0.0005) [2023-12-26 00:57:47,581][123091] Updated weights for policy 0, policy_version 172971 (0.0005) [2023-12-26 00:57:47,639][123091] Updated weights for policy 0, policy_version 172981 (0.0005) [2023-12-26 00:57:47,667][123090] Updated weights for policy 1, policy_version 172225 (0.0006) [2023-12-26 00:57:47,699][123091] Updated weights for policy 0, policy_version 172991 (0.0006) [2023-12-26 00:57:47,736][123090] Updated weights for policy 1, policy_version 172235 (0.0006) [2023-12-26 00:57:47,814][123090] Updated weights for policy 1, policy_version 172245 (0.0005) [2023-12-26 00:57:47,891][123090] Updated weights for policy 1, policy_version 172255 (0.0005) [2023-12-26 00:57:48,411][123091] Updated weights for policy 0, policy_version 173001 (0.0006) [2023-12-26 00:57:48,481][123091] Updated weights for policy 0, policy_version 173011 (0.0008) [2023-12-26 00:57:48,536][123091] Updated weights for policy 0, policy_version 173021 (0.0008) [2023-12-26 00:57:48,572][123090] Updated weights for policy 1, policy_version 172265 (0.0008) [2023-12-26 00:57:48,627][123090] Updated weights for policy 1, policy_version 172275 (0.0007) [2023-12-26 00:57:48,691][123090] Updated weights for policy 1, policy_version 172285 (0.0008) [2023-12-26 00:57:48,784][121949] Fps is (10 sec: 19661.0, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 88399872. Throughput: 0: 8946.1, 1: 9115.8. Samples: 88406604. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:48,784][121949] Avg episode reward: [(0, '5468.024'), (1, '5657.966')] [2023-12-26 00:57:49,306][123091] Updated weights for policy 0, policy_version 173031 (0.0008) [2023-12-26 00:57:49,377][123091] Updated weights for policy 0, policy_version 173041 (0.0008) [2023-12-26 00:57:49,446][123091] Updated weights for policy 0, policy_version 173051 (0.0008) [2023-12-26 00:57:49,537][123090] Updated weights for policy 1, policy_version 172295 (0.0010) [2023-12-26 00:57:49,588][123090] Updated weights for policy 1, policy_version 172305 (0.0009) [2023-12-26 00:57:49,644][123090] Updated weights for policy 1, policy_version 172315 (0.0011) [2023-12-26 00:57:50,260][123091] Updated weights for policy 0, policy_version 173061 (0.0008) [2023-12-26 00:57:50,308][123091] Updated weights for policy 0, policy_version 173071 (0.0009) [2023-12-26 00:57:50,364][123091] Updated weights for policy 0, policy_version 173081 (0.0009) [2023-12-26 00:57:50,520][123090] Updated weights for policy 1, policy_version 172325 (0.0009) [2023-12-26 00:57:50,590][123090] Updated weights for policy 1, policy_version 172335 (0.0007) [2023-12-26 00:57:50,656][123090] Updated weights for policy 1, policy_version 172345 (0.0008) [2023-12-26 00:57:51,240][123091] Updated weights for policy 0, policy_version 173091 (0.0009) [2023-12-26 00:57:51,310][123091] Updated weights for policy 0, policy_version 173101 (0.0009) [2023-12-26 00:57:51,387][123091] Updated weights for policy 0, policy_version 173111 (0.0009) [2023-12-26 00:57:51,411][123090] Updated weights for policy 1, policy_version 172355 (0.0009) [2023-12-26 00:57:51,478][123090] Updated weights for policy 1, policy_version 172365 (0.0010) [2023-12-26 00:57:51,534][123090] Updated weights for policy 1, policy_version 172375 (0.0010) [2023-12-26 00:57:52,244][123091] Updated weights for policy 0, policy_version 173121 (0.0007) [2023-12-26 00:57:52,310][123091] Updated weights for policy 0, policy_version 173131 (0.0009) [2023-12-26 00:57:52,371][123090] Updated weights for policy 1, policy_version 172385 (0.0010) [2023-12-26 00:57:52,373][123091] Updated weights for policy 0, policy_version 173141 (0.0009) [2023-12-26 00:57:52,435][123090] Updated weights for policy 1, policy_version 172395 (0.0011) [2023-12-26 00:57:52,438][123091] Updated weights for policy 0, policy_version 173151 (0.0006) [2023-12-26 00:57:52,487][123090] Updated weights for policy 1, policy_version 172405 (0.0010) [2023-12-26 00:57:52,547][123090] Updated weights for policy 1, policy_version 172415 (0.0010) [2023-12-26 00:57:53,216][123091] Updated weights for policy 0, policy_version 173161 (0.0008) [2023-12-26 00:57:53,273][123091] Updated weights for policy 0, policy_version 173171 (0.0009) [2023-12-26 00:57:53,332][123091] Updated weights for policy 0, policy_version 173181 (0.0009) [2023-12-26 00:57:53,385][123090] Updated weights for policy 1, policy_version 172425 (0.0010) [2023-12-26 00:57:53,451][123090] Updated weights for policy 1, policy_version 172435 (0.0010) [2023-12-26 00:57:53,513][123090] Updated weights for policy 1, policy_version 172445 (0.0010) [2023-12-26 00:57:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 88481792. Throughput: 0: 8958.5, 1: 9074.2. Samples: 88457220. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:53,785][121949] Avg episode reward: [(0, '5480.631'), (1, '5561.193')] [2023-12-26 00:57:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000172448_44146688.pth... [2023-12-26 00:57:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000173184_44335104.pth... [2023-12-26 00:57:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000171392_43876352.pth [2023-12-26 00:57:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000172128_44064768.pth [2023-12-26 00:57:54,203][123091] Updated weights for policy 0, policy_version 173191 (0.0006) [2023-12-26 00:57:54,259][123090] Updated weights for policy 1, policy_version 172455 (0.0007) [2023-12-26 00:57:54,266][123091] Updated weights for policy 0, policy_version 173201 (0.0006) [2023-12-26 00:57:54,323][123090] Updated weights for policy 1, policy_version 172465 (0.0007) [2023-12-26 00:57:54,329][123091] Updated weights for policy 0, policy_version 173211 (0.0005) [2023-12-26 00:57:54,386][123090] Updated weights for policy 1, policy_version 172475 (0.0010) [2023-12-26 00:57:55,025][123090] Updated weights for policy 1, policy_version 172485 (0.0008) [2023-12-26 00:57:55,072][123090] Updated weights for policy 1, policy_version 172495 (0.0005) [2023-12-26 00:57:55,125][123090] Updated weights for policy 1, policy_version 172505 (0.0009) [2023-12-26 00:57:55,151][123091] Updated weights for policy 0, policy_version 173221 (0.0007) [2023-12-26 00:57:55,202][123091] Updated weights for policy 0, policy_version 173231 (0.0008) [2023-12-26 00:57:55,251][123091] Updated weights for policy 0, policy_version 173241 (0.0009) [2023-12-26 00:57:55,857][123090] Updated weights for policy 1, policy_version 172515 (0.0009) [2023-12-26 00:57:55,922][123090] Updated weights for policy 1, policy_version 172525 (0.0010) [2023-12-26 00:57:55,989][123090] Updated weights for policy 1, policy_version 172535 (0.0007) [2023-12-26 00:57:56,156][123091] Updated weights for policy 0, policy_version 173251 (0.0009) [2023-12-26 00:57:56,226][123091] Updated weights for policy 0, policy_version 173261 (0.0010) [2023-12-26 00:57:56,280][123091] Updated weights for policy 0, policy_version 173271 (0.0009) [2023-12-26 00:57:56,611][123090] Updated weights for policy 1, policy_version 172545 (0.0006) [2023-12-26 00:57:56,657][123090] Updated weights for policy 1, policy_version 172555 (0.0010) [2023-12-26 00:57:56,704][123090] Updated weights for policy 1, policy_version 172565 (0.0010) [2023-12-26 00:57:56,762][123090] Updated weights for policy 1, policy_version 172575 (0.0008) [2023-12-26 00:57:57,171][123091] Updated weights for policy 0, policy_version 173281 (0.0009) [2023-12-26 00:57:57,237][123091] Updated weights for policy 0, policy_version 173291 (0.0008) [2023-12-26 00:57:57,293][123091] Updated weights for policy 0, policy_version 173301 (0.0009) [2023-12-26 00:57:57,347][123091] Updated weights for policy 0, policy_version 173311 (0.0009) [2023-12-26 00:57:57,478][123090] Updated weights for policy 1, policy_version 172585 (0.0008) [2023-12-26 00:57:57,528][123090] Updated weights for policy 1, policy_version 172595 (0.0007) [2023-12-26 00:57:57,580][123090] Updated weights for policy 1, policy_version 172605 (0.0005) [2023-12-26 00:57:58,252][123091] Updated weights for policy 0, policy_version 173321 (0.0011) [2023-12-26 00:57:58,308][123091] Updated weights for policy 0, policy_version 173331 (0.0010) [2023-12-26 00:57:58,337][123090] Updated weights for policy 1, policy_version 172615 (0.0008) [2023-12-26 00:57:58,373][123091] Updated weights for policy 0, policy_version 173341 (0.0010) [2023-12-26 00:57:58,399][123090] Updated weights for policy 1, policy_version 172625 (0.0008) [2023-12-26 00:57:58,475][123090] Updated weights for policy 1, policy_version 172635 (0.0010) [2023-12-26 00:57:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 88571904. Throughput: 0: 8900.4, 1: 9113.1. Samples: 88563980. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:57:58,784][121949] Avg episode reward: [(0, '5603.568'), (1, '5574.319')] [2023-12-26 00:57:59,263][123091] Updated weights for policy 0, policy_version 173351 (0.0010) [2023-12-26 00:57:59,329][123091] Updated weights for policy 0, policy_version 173361 (0.0009) [2023-12-26 00:57:59,393][123090] Updated weights for policy 1, policy_version 172645 (0.0010) [2023-12-26 00:57:59,398][123091] Updated weights for policy 0, policy_version 173371 (0.0010) [2023-12-26 00:57:59,456][123090] Updated weights for policy 1, policy_version 172655 (0.0010) [2023-12-26 00:57:59,511][123090] Updated weights for policy 1, policy_version 172665 (0.0010) [2023-12-26 00:58:00,216][123091] Updated weights for policy 0, policy_version 173381 (0.0008) [2023-12-26 00:58:00,266][123091] Updated weights for policy 0, policy_version 173391 (0.0005) [2023-12-26 00:58:00,317][123091] Updated weights for policy 0, policy_version 173401 (0.0005) [2023-12-26 00:58:00,326][123090] Updated weights for policy 1, policy_version 172675 (0.0010) [2023-12-26 00:58:00,383][123090] Updated weights for policy 1, policy_version 172685 (0.0009) [2023-12-26 00:58:00,442][123090] Updated weights for policy 1, policy_version 172695 (0.0010) [2023-12-26 00:58:01,090][123091] Updated weights for policy 0, policy_version 173411 (0.0008) [2023-12-26 00:58:01,148][123091] Updated weights for policy 0, policy_version 173421 (0.0008) [2023-12-26 00:58:01,205][123091] Updated weights for policy 0, policy_version 173431 (0.0009) [2023-12-26 00:58:01,264][123090] Updated weights for policy 1, policy_version 172705 (0.0009) [2023-12-26 00:58:01,328][123090] Updated weights for policy 1, policy_version 172715 (0.0009) [2023-12-26 00:58:01,396][123090] Updated weights for policy 1, policy_version 172725 (0.0008) [2023-12-26 00:58:01,455][123090] Updated weights for policy 1, policy_version 172735 (0.0005) [2023-12-26 00:58:02,061][123091] Updated weights for policy 0, policy_version 173441 (0.0007) [2023-12-26 00:58:02,126][123091] Updated weights for policy 0, policy_version 173451 (0.0006) [2023-12-26 00:58:02,195][123091] Updated weights for policy 0, policy_version 173461 (0.0005) [2023-12-26 00:58:02,263][123091] Updated weights for policy 0, policy_version 173471 (0.0007) [2023-12-26 00:58:02,282][123090] Updated weights for policy 1, policy_version 172745 (0.0007) [2023-12-26 00:58:02,339][123090] Updated weights for policy 1, policy_version 172755 (0.0009) [2023-12-26 00:58:02,411][123090] Updated weights for policy 1, policy_version 172765 (0.0010) [2023-12-26 00:58:02,998][123091] Updated weights for policy 0, policy_version 173481 (0.0008) [2023-12-26 00:58:03,059][123091] Updated weights for policy 0, policy_version 173491 (0.0008) [2023-12-26 00:58:03,110][123091] Updated weights for policy 0, policy_version 173501 (0.0008) [2023-12-26 00:58:03,289][123090] Updated weights for policy 1, policy_version 172775 (0.0010) [2023-12-26 00:58:03,337][123090] Updated weights for policy 1, policy_version 172785 (0.0009) [2023-12-26 00:58:03,389][123090] Updated weights for policy 1, policy_version 172795 (0.0008) [2023-12-26 00:58:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 88653824. Throughput: 0: 8849.9, 1: 9026.9. Samples: 88666936. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:58:03,784][121949] Avg episode reward: [(0, '5619.236'), (1, '5623.951')] [2023-12-26 00:58:03,920][123091] Updated weights for policy 0, policy_version 173511 (0.0010) [2023-12-26 00:58:03,982][123091] Updated weights for policy 0, policy_version 173521 (0.0009) [2023-12-26 00:58:04,050][123091] Updated weights for policy 0, policy_version 173531 (0.0009) [2023-12-26 00:58:04,248][123090] Updated weights for policy 1, policy_version 172805 (0.0009) [2023-12-26 00:58:04,311][123090] Updated weights for policy 1, policy_version 172815 (0.0009) [2023-12-26 00:58:04,378][123090] Updated weights for policy 1, policy_version 172825 (0.0009) [2023-12-26 00:58:04,897][123091] Updated weights for policy 0, policy_version 173541 (0.0010) [2023-12-26 00:58:04,958][123091] Updated weights for policy 0, policy_version 173551 (0.0009) [2023-12-26 00:58:05,031][123091] Updated weights for policy 0, policy_version 173561 (0.0009) [2023-12-26 00:58:05,224][123090] Updated weights for policy 1, policy_version 172835 (0.0009) [2023-12-26 00:58:05,277][123090] Updated weights for policy 1, policy_version 172845 (0.0010) [2023-12-26 00:58:05,328][123090] Updated weights for policy 1, policy_version 172855 (0.0010) [2023-12-26 00:58:05,751][123091] Updated weights for policy 0, policy_version 173571 (0.0010) [2023-12-26 00:58:05,807][123091] Updated weights for policy 0, policy_version 173581 (0.0010) [2023-12-26 00:58:05,859][123091] Updated weights for policy 0, policy_version 173592 (0.0010) [2023-12-26 00:58:06,215][123090] Updated weights for policy 1, policy_version 172865 (0.0010) [2023-12-26 00:58:06,280][123090] Updated weights for policy 1, policy_version 172875 (0.0009) [2023-12-26 00:58:06,350][123090] Updated weights for policy 1, policy_version 172885 (0.0009) [2023-12-26 00:58:06,415][123090] Updated weights for policy 1, policy_version 172895 (0.0011) [2023-12-26 00:58:06,682][123091] Updated weights for policy 0, policy_version 173603 (0.0009) [2023-12-26 00:58:06,740][123091] Updated weights for policy 0, policy_version 173613 (0.0007) [2023-12-26 00:58:06,802][123091] Updated weights for policy 0, policy_version 173623 (0.0006) [2023-12-26 00:58:07,276][123090] Updated weights for policy 1, policy_version 172905 (0.0011) [2023-12-26 00:58:07,339][123090] Updated weights for policy 1, policy_version 172915 (0.0011) [2023-12-26 00:58:07,403][123090] Updated weights for policy 1, policy_version 172925 (0.0011) [2023-12-26 00:58:07,588][123091] Updated weights for policy 0, policy_version 173633 (0.0006) [2023-12-26 00:58:07,636][123091] Updated weights for policy 0, policy_version 173643 (0.0011) [2023-12-26 00:58:07,691][123091] Updated weights for policy 0, policy_version 173653 (0.0010) [2023-12-26 00:58:07,762][123091] Updated weights for policy 0, policy_version 173663 (0.0011) [2023-12-26 00:58:08,227][123090] Updated weights for policy 1, policy_version 172935 (0.0011) [2023-12-26 00:58:08,293][123090] Updated weights for policy 1, policy_version 172945 (0.0010) [2023-12-26 00:58:08,364][123090] Updated weights for policy 1, policy_version 172955 (0.0011) [2023-12-26 00:58:08,576][123091] Updated weights for policy 0, policy_version 173673 (0.0011) [2023-12-26 00:58:08,642][123091] Updated weights for policy 0, policy_version 173683 (0.0011) [2023-12-26 00:58:08,698][123091] Updated weights for policy 0, policy_version 173693 (0.0010) [2023-12-26 00:58:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 88743936. Throughput: 0: 8896.7, 1: 8991.5. Samples: 88718328. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:58:08,785][121949] Avg episode reward: [(0, '5590.231'), (1, '5678.315')] [2023-12-26 00:58:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000173696_44466176.pth... [2023-12-26 00:58:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000172960_44277760.pth... [2023-12-26 00:58:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000172672_44204032.pth [2023-12-26 00:58:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000171936_44015616.pth [2023-12-26 00:58:09,106][123090] Updated weights for policy 1, policy_version 172965 (0.0011) [2023-12-26 00:58:09,165][123090] Updated weights for policy 1, policy_version 172976 (0.0009) [2023-12-26 00:58:09,225][123090] Updated weights for policy 1, policy_version 172986 (0.0009) [2023-12-26 00:58:09,372][123091] Updated weights for policy 0, policy_version 173703 (0.0010) [2023-12-26 00:58:09,438][123091] Updated weights for policy 0, policy_version 173713 (0.0010) [2023-12-26 00:58:09,502][123091] Updated weights for policy 0, policy_version 173723 (0.0008) [2023-12-26 00:58:10,131][123090] Updated weights for policy 1, policy_version 172996 (0.0006) [2023-12-26 00:58:10,203][123090] Updated weights for policy 1, policy_version 173006 (0.0006) [2023-12-26 00:58:10,266][123091] Updated weights for policy 0, policy_version 173733 (0.0009) [2023-12-26 00:58:10,278][123090] Updated weights for policy 1, policy_version 173016 (0.0006) [2023-12-26 00:58:10,321][123091] Updated weights for policy 0, policy_version 173743 (0.0011) [2023-12-26 00:58:10,373][123091] Updated weights for policy 0, policy_version 173753 (0.0011) [2023-12-26 00:58:11,090][123090] Updated weights for policy 1, policy_version 173026 (0.0007) [2023-12-26 00:58:11,148][123090] Updated weights for policy 1, policy_version 173036 (0.0009) [2023-12-26 00:58:11,171][123091] Updated weights for policy 0, policy_version 173763 (0.0010) [2023-12-26 00:58:11,213][123090] Updated weights for policy 1, policy_version 173046 (0.0008) [2023-12-26 00:58:11,234][123091] Updated weights for policy 0, policy_version 173773 (0.0008) [2023-12-26 00:58:11,279][123090] Updated weights for policy 1, policy_version 173056 (0.0008) [2023-12-26 00:58:11,304][123091] Updated weights for policy 0, policy_version 173783 (0.0008) [2023-12-26 00:58:12,093][123091] Updated weights for policy 0, policy_version 173793 (0.0008) [2023-12-26 00:58:12,130][123090] Updated weights for policy 1, policy_version 173066 (0.0009) [2023-12-26 00:58:12,155][123091] Updated weights for policy 0, policy_version 173803 (0.0008) [2023-12-26 00:58:12,194][123090] Updated weights for policy 1, policy_version 173076 (0.0009) [2023-12-26 00:58:12,219][123091] Updated weights for policy 0, policy_version 173813 (0.0006) [2023-12-26 00:58:12,264][123090] Updated weights for policy 1, policy_version 173086 (0.0009) [2023-12-26 00:58:12,285][123091] Updated weights for policy 0, policy_version 173823 (0.0008) [2023-12-26 00:58:13,024][123090] Updated weights for policy 1, policy_version 173096 (0.0011) [2023-12-26 00:58:13,080][123090] Updated weights for policy 1, policy_version 173106 (0.0011) [2023-12-26 00:58:13,091][123091] Updated weights for policy 0, policy_version 173833 (0.0011) [2023-12-26 00:58:13,140][123090] Updated weights for policy 1, policy_version 173116 (0.0010) [2023-12-26 00:58:13,158][123091] Updated weights for policy 0, policy_version 173843 (0.0011) [2023-12-26 00:58:13,228][123091] Updated weights for policy 0, policy_version 173853 (0.0011) [2023-12-26 00:58:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 88825856. Throughput: 0: 8925.3, 1: 8881.2. Samples: 88822940. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:58:13,784][121949] Avg episode reward: [(0, '5510.714'), (1, '5597.938')] [2023-12-26 00:58:13,878][123090] Updated weights for policy 1, policy_version 173126 (0.0008) [2023-12-26 00:58:13,931][123090] Updated weights for policy 1, policy_version 173136 (0.0005) [2023-12-26 00:58:13,978][123090] Updated weights for policy 1, policy_version 173146 (0.0005) [2023-12-26 00:58:14,027][123091] Updated weights for policy 0, policy_version 173863 (0.0011) [2023-12-26 00:58:14,074][123091] Updated weights for policy 0, policy_version 173873 (0.0010) [2023-12-26 00:58:14,128][123091] Updated weights for policy 0, policy_version 173883 (0.0010) [2023-12-26 00:58:14,799][123090] Updated weights for policy 1, policy_version 173156 (0.0007) [2023-12-26 00:58:14,868][123090] Updated weights for policy 1, policy_version 173166 (0.0005) [2023-12-26 00:58:14,936][123090] Updated weights for policy 1, policy_version 173176 (0.0007) [2023-12-26 00:58:14,956][123091] Updated weights for policy 0, policy_version 173893 (0.0011) [2023-12-26 00:58:15,019][123091] Updated weights for policy 0, policy_version 173903 (0.0013) [2023-12-26 00:58:15,084][123091] Updated weights for policy 0, policy_version 173913 (0.0011) [2023-12-26 00:58:15,623][123090] Updated weights for policy 1, policy_version 173186 (0.0006) [2023-12-26 00:58:15,683][123090] Updated weights for policy 1, policy_version 173196 (0.0006) [2023-12-26 00:58:15,730][123090] Updated weights for policy 1, policy_version 173206 (0.0010) [2023-12-26 00:58:15,785][123090] Updated weights for policy 1, policy_version 173216 (0.0010) [2023-12-26 00:58:15,875][123091] Updated weights for policy 0, policy_version 173923 (0.0010) [2023-12-26 00:58:15,935][123091] Updated weights for policy 0, policy_version 173933 (0.0009) [2023-12-26 00:58:15,998][123091] Updated weights for policy 0, policy_version 173943 (0.0009) [2023-12-26 00:58:16,578][123090] Updated weights for policy 1, policy_version 173226 (0.0005) [2023-12-26 00:58:16,639][123090] Updated weights for policy 1, policy_version 173236 (0.0005) [2023-12-26 00:58:16,696][123090] Updated weights for policy 1, policy_version 173246 (0.0005) [2023-12-26 00:58:16,699][123091] Updated weights for policy 0, policy_version 173953 (0.0008) [2023-12-26 00:58:16,765][123091] Updated weights for policy 0, policy_version 173963 (0.0006) [2023-12-26 00:58:16,841][123091] Updated weights for policy 0, policy_version 173973 (0.0005) [2023-12-26 00:58:16,913][123091] Updated weights for policy 0, policy_version 173983 (0.0005) [2023-12-26 00:58:17,365][123090] Updated weights for policy 1, policy_version 173256 (0.0005) [2023-12-26 00:58:17,427][123090] Updated weights for policy 1, policy_version 173266 (0.0006) [2023-12-26 00:58:17,478][123091] Updated weights for policy 0, policy_version 173993 (0.0008) [2023-12-26 00:58:17,480][123090] Updated weights for policy 1, policy_version 173276 (0.0007) [2023-12-26 00:58:17,537][123091] Updated weights for policy 0, policy_version 174003 (0.0008) [2023-12-26 00:58:17,594][123091] Updated weights for policy 0, policy_version 174013 (0.0010) [2023-12-26 00:58:17,997][123090] Updated weights for policy 1, policy_version 173286 (0.0006) [2023-12-26 00:58:18,055][123090] Updated weights for policy 1, policy_version 173296 (0.0006) [2023-12-26 00:58:18,124][123090] Updated weights for policy 1, policy_version 173306 (0.0008) [2023-12-26 00:58:18,487][123091] Updated weights for policy 0, policy_version 174023 (0.0010) [2023-12-26 00:58:18,550][123091] Updated weights for policy 0, policy_version 174033 (0.0010) [2023-12-26 00:58:18,610][123091] Updated weights for policy 0, policy_version 174043 (0.0009) [2023-12-26 00:58:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 88924160. Throughput: 0: 8948.0, 1: 8913.8. Samples: 88934492. Policy #0 lag: (min: 14.0, avg: 14.3, max: 23.0) [2023-12-26 00:58:18,785][121949] Avg episode reward: [(0, '5542.819'), (1, '5473.713')] [2023-12-26 00:58:18,913][123090] Updated weights for policy 1, policy_version 173316 (0.0009) [2023-12-26 00:58:18,969][123090] Updated weights for policy 1, policy_version 173326 (0.0011) [2023-12-26 00:58:19,021][123090] Updated weights for policy 1, policy_version 173336 (0.0010) [2023-12-26 00:58:19,375][123091] Updated weights for policy 0, policy_version 174053 (0.0011) [2023-12-26 00:58:19,445][123091] Updated weights for policy 0, policy_version 174063 (0.0011) [2023-12-26 00:58:19,513][123091] Updated weights for policy 0, policy_version 174073 (0.0011) [2023-12-26 00:58:19,876][123090] Updated weights for policy 1, policy_version 173346 (0.0010) [2023-12-26 00:58:19,951][123090] Updated weights for policy 1, policy_version 173356 (0.0009) [2023-12-26 00:58:20,008][123090] Updated weights for policy 1, policy_version 173366 (0.0011) [2023-12-26 00:58:20,080][123090] Updated weights for policy 1, policy_version 173376 (0.0011) [2023-12-26 00:58:20,351][123091] Updated weights for policy 0, policy_version 174083 (0.0011) [2023-12-26 00:58:20,425][123091] Updated weights for policy 0, policy_version 174093 (0.0011) [2023-12-26 00:58:20,492][123091] Updated weights for policy 0, policy_version 174103 (0.0006) [2023-12-26 00:58:20,901][123090] Updated weights for policy 1, policy_version 173386 (0.0011) [2023-12-26 00:58:20,970][123090] Updated weights for policy 1, policy_version 173396 (0.0011) [2023-12-26 00:58:21,039][123090] Updated weights for policy 1, policy_version 173406 (0.0010) [2023-12-26 00:58:21,285][123091] Updated weights for policy 0, policy_version 174113 (0.0006) [2023-12-26 00:58:21,356][123091] Updated weights for policy 0, policy_version 174123 (0.0010) [2023-12-26 00:58:21,433][123091] Updated weights for policy 0, policy_version 174133 (0.0009) [2023-12-26 00:58:21,506][123091] Updated weights for policy 0, policy_version 174143 (0.0009) [2023-12-26 00:58:21,895][123090] Updated weights for policy 1, policy_version 173416 (0.0008) [2023-12-26 00:58:21,961][123090] Updated weights for policy 1, policy_version 173426 (0.0009) [2023-12-26 00:58:22,027][123090] Updated weights for policy 1, policy_version 173436 (0.0009) [2023-12-26 00:58:22,345][123091] Updated weights for policy 0, policy_version 174153 (0.0009) [2023-12-26 00:58:22,415][123091] Updated weights for policy 0, policy_version 174163 (0.0010) [2023-12-26 00:58:22,472][123091] Updated weights for policy 0, policy_version 174173 (0.0010) [2023-12-26 00:58:22,861][123090] Updated weights for policy 1, policy_version 173446 (0.0010) [2023-12-26 00:58:22,914][123090] Updated weights for policy 1, policy_version 173456 (0.0009) [2023-12-26 00:58:22,971][123090] Updated weights for policy 1, policy_version 173466 (0.0009) [2023-12-26 00:58:23,304][123091] Updated weights for policy 0, policy_version 174183 (0.0010) [2023-12-26 00:58:23,364][123091] Updated weights for policy 0, policy_version 174193 (0.0010) [2023-12-26 00:58:23,426][123091] Updated weights for policy 0, policy_version 174203 (0.0009) [2023-12-26 00:58:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 89006080. Throughput: 0: 8863.0, 1: 8916.3. Samples: 88985712. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:23,785][121949] Avg episode reward: [(0, '5501.900'), (1, '5376.595')] [2023-12-26 00:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000174208_44597248.pth... [2023-12-26 00:58:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000173184_44335104.pth [2023-12-26 00:58:23,804][123090] Updated weights for policy 1, policy_version 173476 (0.0009) [2023-12-26 00:58:23,854][123090] Updated weights for policy 1, policy_version 173486 (0.0009) [2023-12-26 00:58:23,902][123090] Updated weights for policy 1, policy_version 173496 (0.0009) [2023-12-26 00:58:23,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000173504_44417024.pth... [2023-12-26 00:58:23,946][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000172448_44146688.pth [2023-12-26 00:58:24,264][123091] Updated weights for policy 0, policy_version 174213 (0.0009) [2023-12-26 00:58:24,329][123091] Updated weights for policy 0, policy_version 174223 (0.0010) [2023-12-26 00:58:24,385][123091] Updated weights for policy 0, policy_version 174233 (0.0010) [2023-12-26 00:58:24,709][123090] Updated weights for policy 1, policy_version 173506 (0.0008) [2023-12-26 00:58:24,775][123090] Updated weights for policy 1, policy_version 173516 (0.0009) [2023-12-26 00:58:24,837][123090] Updated weights for policy 1, policy_version 173527 (0.0009) [2023-12-26 00:58:25,206][123091] Updated weights for policy 0, policy_version 174243 (0.0008) [2023-12-26 00:58:25,272][123091] Updated weights for policy 0, policy_version 174253 (0.0005) [2023-12-26 00:58:25,338][123091] Updated weights for policy 0, policy_version 174263 (0.0005) [2023-12-26 00:58:25,599][123090] Updated weights for policy 1, policy_version 173537 (0.0008) [2023-12-26 00:58:25,675][123090] Updated weights for policy 1, policy_version 173547 (0.0005) [2023-12-26 00:58:25,736][123090] Updated weights for policy 1, policy_version 173557 (0.0009) [2023-12-26 00:58:25,785][123090] Updated weights for policy 1, policy_version 173567 (0.0008) [2023-12-26 00:58:26,162][123091] Updated weights for policy 0, policy_version 174273 (0.0007) [2023-12-26 00:58:26,214][123091] Updated weights for policy 0, policy_version 174283 (0.0008) [2023-12-26 00:58:26,274][123091] Updated weights for policy 0, policy_version 174293 (0.0010) [2023-12-26 00:58:26,327][123091] Updated weights for policy 0, policy_version 174303 (0.0011) [2023-12-26 00:58:26,565][123090] Updated weights for policy 1, policy_version 173577 (0.0005) [2023-12-26 00:58:26,620][123090] Updated weights for policy 1, policy_version 173587 (0.0005) [2023-12-26 00:58:26,673][123090] Updated weights for policy 1, policy_version 173597 (0.0005) [2023-12-26 00:58:27,181][123091] Updated weights for policy 0, policy_version 174313 (0.0009) [2023-12-26 00:58:27,252][123091] Updated weights for policy 0, policy_version 174323 (0.0009) [2023-12-26 00:58:27,316][123091] Updated weights for policy 0, policy_version 174333 (0.0010) [2023-12-26 00:58:27,427][123090] Updated weights for policy 1, policy_version 173607 (0.0006) [2023-12-26 00:58:27,487][123090] Updated weights for policy 1, policy_version 173617 (0.0006) [2023-12-26 00:58:27,538][123090] Updated weights for policy 1, policy_version 173627 (0.0005) [2023-12-26 00:58:28,167][123091] Updated weights for policy 0, policy_version 174343 (0.0010) [2023-12-26 00:58:28,222][123091] Updated weights for policy 0, policy_version 174353 (0.0010) [2023-12-26 00:58:28,274][123090] Updated weights for policy 1, policy_version 173637 (0.0006) [2023-12-26 00:58:28,281][123091] Updated weights for policy 0, policy_version 174363 (0.0008) [2023-12-26 00:58:28,330][123090] Updated weights for policy 1, policy_version 173647 (0.0006) [2023-12-26 00:58:28,405][123090] Updated weights for policy 1, policy_version 173657 (0.0009) [2023-12-26 00:58:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 89096192. Throughput: 0: 8770.8, 1: 8982.0. Samples: 89089720. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:28,785][121949] Avg episode reward: [(0, '5616.163'), (1, '5370.281')] [2023-12-26 00:58:29,068][123091] Updated weights for policy 0, policy_version 174373 (0.0007) [2023-12-26 00:58:29,135][123091] Updated weights for policy 0, policy_version 174383 (0.0007) [2023-12-26 00:58:29,186][123091] Updated weights for policy 0, policy_version 174393 (0.0009) [2023-12-26 00:58:29,210][123090] Updated weights for policy 1, policy_version 173667 (0.0010) [2023-12-26 00:58:29,282][123090] Updated weights for policy 1, policy_version 173677 (0.0007) [2023-12-26 00:58:29,359][123090] Updated weights for policy 1, policy_version 173687 (0.0008) [2023-12-26 00:58:29,957][123091] Updated weights for policy 0, policy_version 174403 (0.0010) [2023-12-26 00:58:30,025][123091] Updated weights for policy 0, policy_version 174413 (0.0009) [2023-12-26 00:58:30,091][123091] Updated weights for policy 0, policy_version 174423 (0.0010) [2023-12-26 00:58:30,097][123090] Updated weights for policy 1, policy_version 173697 (0.0009) [2023-12-26 00:58:30,166][123090] Updated weights for policy 1, policy_version 173707 (0.0007) [2023-12-26 00:58:30,228][123090] Updated weights for policy 1, policy_version 173717 (0.0008) [2023-12-26 00:58:30,284][123090] Updated weights for policy 1, policy_version 173727 (0.0009) [2023-12-26 00:58:30,867][123091] Updated weights for policy 0, policy_version 174433 (0.0008) [2023-12-26 00:58:30,935][123091] Updated weights for policy 0, policy_version 174443 (0.0005) [2023-12-26 00:58:30,993][123091] Updated weights for policy 0, policy_version 174453 (0.0005) [2023-12-26 00:58:31,053][123091] Updated weights for policy 0, policy_version 174463 (0.0007) [2023-12-26 00:58:31,122][123090] Updated weights for policy 1, policy_version 173737 (0.0010) [2023-12-26 00:58:31,186][123090] Updated weights for policy 1, policy_version 173747 (0.0009) [2023-12-26 00:58:31,248][123090] Updated weights for policy 1, policy_version 173757 (0.0007) [2023-12-26 00:58:31,836][123091] Updated weights for policy 0, policy_version 174473 (0.0009) [2023-12-26 00:58:31,891][123091] Updated weights for policy 0, policy_version 174483 (0.0010) [2023-12-26 00:58:31,943][123091] Updated weights for policy 0, policy_version 174493 (0.0009) [2023-12-26 00:58:32,031][123090] Updated weights for policy 1, policy_version 173767 (0.0007) [2023-12-26 00:58:32,092][123090] Updated weights for policy 1, policy_version 173777 (0.0006) [2023-12-26 00:58:32,145][123090] Updated weights for policy 1, policy_version 173787 (0.0005) [2023-12-26 00:58:32,828][123090] Updated weights for policy 1, policy_version 173797 (0.0005) [2023-12-26 00:58:32,887][123090] Updated weights for policy 1, policy_version 173807 (0.0005) [2023-12-26 00:58:32,891][123091] Updated weights for policy 0, policy_version 174503 (0.0009) [2023-12-26 00:58:32,943][123090] Updated weights for policy 1, policy_version 173817 (0.0006) [2023-12-26 00:58:32,947][123091] Updated weights for policy 0, policy_version 174513 (0.0008) [2023-12-26 00:58:32,998][123091] Updated weights for policy 0, policy_version 174523 (0.0009) [2023-12-26 00:58:33,595][123090] Updated weights for policy 1, policy_version 173827 (0.0006) [2023-12-26 00:58:33,648][123090] Updated weights for policy 1, policy_version 173837 (0.0005) [2023-12-26 00:58:33,695][123090] Updated weights for policy 1, policy_version 173847 (0.0006) [2023-12-26 00:58:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 89186304. Throughput: 0: 8649.7, 1: 8902.9. Samples: 89196472. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:33,784][121949] Avg episode reward: [(0, '5628.737'), (1, '5372.483')] [2023-12-26 00:58:33,901][123091] Updated weights for policy 0, policy_version 174534 (0.0010) [2023-12-26 00:58:33,952][123091] Updated weights for policy 0, policy_version 174544 (0.0010) [2023-12-26 00:58:34,005][123091] Updated weights for policy 0, policy_version 174554 (0.0009) [2023-12-26 00:58:34,497][123090] Updated weights for policy 1, policy_version 173857 (0.0009) [2023-12-26 00:58:34,578][123090] Updated weights for policy 1, policy_version 173867 (0.0008) [2023-12-26 00:58:34,647][123090] Updated weights for policy 1, policy_version 173877 (0.0008) [2023-12-26 00:58:34,717][123090] Updated weights for policy 1, policy_version 173887 (0.0007) [2023-12-26 00:58:34,901][123091] Updated weights for policy 0, policy_version 174564 (0.0010) [2023-12-26 00:58:34,961][123091] Updated weights for policy 0, policy_version 174574 (0.0010) [2023-12-26 00:58:35,020][123091] Updated weights for policy 0, policy_version 174584 (0.0010) [2023-12-26 00:58:35,388][123090] Updated weights for policy 1, policy_version 173897 (0.0009) [2023-12-26 00:58:35,455][123090] Updated weights for policy 1, policy_version 173907 (0.0009) [2023-12-26 00:58:35,523][123090] Updated weights for policy 1, policy_version 173917 (0.0010) [2023-12-26 00:58:35,876][123091] Updated weights for policy 0, policy_version 174594 (0.0010) [2023-12-26 00:58:35,944][123091] Updated weights for policy 0, policy_version 174604 (0.0009) [2023-12-26 00:58:36,010][123091] Updated weights for policy 0, policy_version 174614 (0.0009) [2023-12-26 00:58:36,081][123091] Updated weights for policy 0, policy_version 174624 (0.0010) [2023-12-26 00:58:36,348][123090] Updated weights for policy 1, policy_version 173927 (0.0010) [2023-12-26 00:58:36,418][123090] Updated weights for policy 1, policy_version 173937 (0.0010) [2023-12-26 00:58:36,480][123090] Updated weights for policy 1, policy_version 173947 (0.0009) [2023-12-26 00:58:36,891][123091] Updated weights for policy 0, policy_version 174634 (0.0010) [2023-12-26 00:58:36,946][123091] Updated weights for policy 0, policy_version 174644 (0.0009) [2023-12-26 00:58:36,995][123091] Updated weights for policy 0, policy_version 174654 (0.0009) [2023-12-26 00:58:37,282][123090] Updated weights for policy 1, policy_version 173957 (0.0010) [2023-12-26 00:58:37,345][123090] Updated weights for policy 1, policy_version 173967 (0.0010) [2023-12-26 00:58:37,412][123090] Updated weights for policy 1, policy_version 173977 (0.0009) [2023-12-26 00:58:37,849][123091] Updated weights for policy 0, policy_version 174664 (0.0010) [2023-12-26 00:58:37,906][123091] Updated weights for policy 0, policy_version 174674 (0.0009) [2023-12-26 00:58:37,960][123091] Updated weights for policy 0, policy_version 174684 (0.0009) [2023-12-26 00:58:38,247][123090] Updated weights for policy 1, policy_version 173987 (0.0009) [2023-12-26 00:58:38,302][123090] Updated weights for policy 1, policy_version 173997 (0.0009) [2023-12-26 00:58:38,363][123090] Updated weights for policy 1, policy_version 174007 (0.0009) [2023-12-26 00:58:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 89268224. Throughput: 0: 8643.4, 1: 8933.1. Samples: 89248160. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:38,785][121949] Avg episode reward: [(0, '5597.275'), (1, '5437.701')] [2023-12-26 00:58:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000174016_44548096.pth... [2023-12-26 00:58:38,793][123091] Updated weights for policy 0, policy_version 174694 (0.0008) [2023-12-26 00:58:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000172960_44277760.pth [2023-12-26 00:58:38,858][123091] Updated weights for policy 0, policy_version 174704 (0.0009) [2023-12-26 00:58:38,915][123091] Updated weights for policy 0, policy_version 174714 (0.0009) [2023-12-26 00:58:38,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000174720_44728320.pth... [2023-12-26 00:58:38,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000173696_44466176.pth [2023-12-26 00:58:39,247][123090] Updated weights for policy 1, policy_version 174017 (0.0009) [2023-12-26 00:58:39,315][123090] Updated weights for policy 1, policy_version 174027 (0.0010) [2023-12-26 00:58:39,385][123090] Updated weights for policy 1, policy_version 174037 (0.0010) [2023-12-26 00:58:39,451][123090] Updated weights for policy 1, policy_version 174047 (0.0010) [2023-12-26 00:58:39,781][123091] Updated weights for policy 0, policy_version 174724 (0.0009) [2023-12-26 00:58:39,848][123091] Updated weights for policy 0, policy_version 174734 (0.0010) [2023-12-26 00:58:39,918][123091] Updated weights for policy 0, policy_version 174744 (0.0010) [2023-12-26 00:58:40,267][123090] Updated weights for policy 1, policy_version 174057 (0.0010) [2023-12-26 00:58:40,323][123090] Updated weights for policy 1, policy_version 174067 (0.0009) [2023-12-26 00:58:40,375][123090] Updated weights for policy 1, policy_version 174077 (0.0009) [2023-12-26 00:58:40,745][123091] Updated weights for policy 0, policy_version 174754 (0.0010) [2023-12-26 00:58:40,804][123091] Updated weights for policy 0, policy_version 174764 (0.0010) [2023-12-26 00:58:40,864][123091] Updated weights for policy 0, policy_version 174774 (0.0007) [2023-12-26 00:58:40,929][123091] Updated weights for policy 0, policy_version 174784 (0.0009) [2023-12-26 00:58:41,267][123090] Updated weights for policy 1, policy_version 174087 (0.0009) [2023-12-26 00:58:41,333][123090] Updated weights for policy 1, policy_version 174097 (0.0009) [2023-12-26 00:58:41,406][123090] Updated weights for policy 1, policy_version 174107 (0.0008) [2023-12-26 00:58:41,764][123091] Updated weights for policy 0, policy_version 174794 (0.0007) [2023-12-26 00:58:41,829][123091] Updated weights for policy 0, policy_version 174804 (0.0009) [2023-12-26 00:58:41,885][123091] Updated weights for policy 0, policy_version 174814 (0.0010) [2023-12-26 00:58:42,273][123090] Updated weights for policy 1, policy_version 174117 (0.0008) [2023-12-26 00:58:42,341][123090] Updated weights for policy 1, policy_version 174127 (0.0010) [2023-12-26 00:58:42,417][123090] Updated weights for policy 1, policy_version 174137 (0.0010) [2023-12-26 00:58:42,681][123091] Updated weights for policy 0, policy_version 174824 (0.0010) [2023-12-26 00:58:42,737][123091] Updated weights for policy 0, policy_version 174834 (0.0009) [2023-12-26 00:58:42,797][123091] Updated weights for policy 0, policy_version 174844 (0.0009) [2023-12-26 00:58:43,235][123090] Updated weights for policy 1, policy_version 174147 (0.0009) [2023-12-26 00:58:43,294][123090] Updated weights for policy 1, policy_version 174157 (0.0009) [2023-12-26 00:58:43,349][123090] Updated weights for policy 1, policy_version 174167 (0.0008) [2023-12-26 00:58:43,652][123091] Updated weights for policy 0, policy_version 174854 (0.0007) [2023-12-26 00:58:43,715][123091] Updated weights for policy 0, policy_version 174864 (0.0008) [2023-12-26 00:58:43,777][123091] Updated weights for policy 0, policy_version 174874 (0.0006) [2023-12-26 00:58:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 89350144. Throughput: 0: 8681.4, 1: 8772.9. Samples: 89349424. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:43,785][121949] Avg episode reward: [(0, '5632.361'), (1, '5489.995')] [2023-12-26 00:58:44,248][123090] Updated weights for policy 1, policy_version 174177 (0.0008) [2023-12-26 00:58:44,306][123090] Updated weights for policy 1, policy_version 174187 (0.0010) [2023-12-26 00:58:44,355][123091] Updated weights for policy 0, policy_version 174884 (0.0006) [2023-12-26 00:58:44,373][123090] Updated weights for policy 1, policy_version 174197 (0.0008) [2023-12-26 00:58:44,416][123091] Updated weights for policy 0, policy_version 174894 (0.0008) [2023-12-26 00:58:44,431][123090] Updated weights for policy 1, policy_version 174207 (0.0008) [2023-12-26 00:58:44,479][123091] Updated weights for policy 0, policy_version 174904 (0.0007) [2023-12-26 00:58:45,186][123091] Updated weights for policy 0, policy_version 174914 (0.0008) [2023-12-26 00:58:45,246][123091] Updated weights for policy 0, policy_version 174924 (0.0011) [2023-12-26 00:58:45,314][123091] Updated weights for policy 0, policy_version 174934 (0.0010) [2023-12-26 00:58:45,326][123090] Updated weights for policy 1, policy_version 174217 (0.0008) [2023-12-26 00:58:45,377][123091] Updated weights for policy 0, policy_version 174944 (0.0005) [2023-12-26 00:58:45,389][123090] Updated weights for policy 1, policy_version 174227 (0.0009) [2023-12-26 00:58:45,441][123090] Updated weights for policy 1, policy_version 174237 (0.0008) [2023-12-26 00:58:46,168][123091] Updated weights for policy 0, policy_version 174954 (0.0011) [2023-12-26 00:58:46,226][123091] Updated weights for policy 0, policy_version 174964 (0.0011) [2023-12-26 00:58:46,274][123091] Updated weights for policy 0, policy_version 174974 (0.0010) [2023-12-26 00:58:46,298][123090] Updated weights for policy 1, policy_version 174247 (0.0008) [2023-12-26 00:58:46,349][123090] Updated weights for policy 1, policy_version 174257 (0.0009) [2023-12-26 00:58:46,405][123090] Updated weights for policy 1, policy_version 174267 (0.0009) [2023-12-26 00:58:47,044][123091] Updated weights for policy 0, policy_version 174984 (0.0006) [2023-12-26 00:58:47,104][123091] Updated weights for policy 0, policy_version 174994 (0.0005) [2023-12-26 00:58:47,151][123091] Updated weights for policy 0, policy_version 175004 (0.0005) [2023-12-26 00:58:47,306][123090] Updated weights for policy 1, policy_version 174277 (0.0009) [2023-12-26 00:58:47,365][123090] Updated weights for policy 1, policy_version 174288 (0.0009) [2023-12-26 00:58:47,420][123090] Updated weights for policy 1, policy_version 174298 (0.0009) [2023-12-26 00:58:47,913][123091] Updated weights for policy 0, policy_version 175014 (0.0008) [2023-12-26 00:58:47,965][123091] Updated weights for policy 0, policy_version 175024 (0.0010) [2023-12-26 00:58:48,019][123091] Updated weights for policy 0, policy_version 175034 (0.0009) [2023-12-26 00:58:48,267][123090] Updated weights for policy 1, policy_version 174308 (0.0009) [2023-12-26 00:58:48,322][123090] Updated weights for policy 1, policy_version 174318 (0.0009) [2023-12-26 00:58:48,391][123090] Updated weights for policy 1, policy_version 174328 (0.0008) [2023-12-26 00:58:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17772.5). Total num frames: 89440256. Throughput: 0: 8766.3, 1: 8730.7. Samples: 89454300. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:48,785][121949] Avg episode reward: [(0, '5680.852'), (1, '5394.753')] [2023-12-26 00:58:48,801][123091] Updated weights for policy 0, policy_version 175045 (0.0008) [2023-12-26 00:58:48,873][123091] Updated weights for policy 0, policy_version 175055 (0.0008) [2023-12-26 00:58:48,939][123091] Updated weights for policy 0, policy_version 175065 (0.0010) [2023-12-26 00:58:49,143][123090] Updated weights for policy 1, policy_version 174338 (0.0010) [2023-12-26 00:58:49,203][123090] Updated weights for policy 1, policy_version 174348 (0.0010) [2023-12-26 00:58:49,277][123090] Updated weights for policy 1, policy_version 174358 (0.0010) [2023-12-26 00:58:49,349][123090] Updated weights for policy 1, policy_version 174368 (0.0010) [2023-12-26 00:58:49,718][123091] Updated weights for policy 0, policy_version 175075 (0.0010) [2023-12-26 00:58:49,766][123091] Updated weights for policy 0, policy_version 175085 (0.0009) [2023-12-26 00:58:49,828][123091] Updated weights for policy 0, policy_version 175095 (0.0010) [2023-12-26 00:58:50,141][123090] Updated weights for policy 1, policy_version 174378 (0.0008) [2023-12-26 00:58:50,193][123090] Updated weights for policy 1, policy_version 174388 (0.0010) [2023-12-26 00:58:50,255][123090] Updated weights for policy 1, policy_version 174398 (0.0010) [2023-12-26 00:58:50,643][123091] Updated weights for policy 0, policy_version 175105 (0.0009) [2023-12-26 00:58:50,692][123091] Updated weights for policy 0, policy_version 175115 (0.0009) [2023-12-26 00:58:50,749][123091] Updated weights for policy 0, policy_version 175125 (0.0009) [2023-12-26 00:58:50,804][123091] Updated weights for policy 0, policy_version 175135 (0.0009) [2023-12-26 00:58:51,090][123090] Updated weights for policy 1, policy_version 174408 (0.0011) [2023-12-26 00:58:51,156][123090] Updated weights for policy 1, policy_version 174418 (0.0011) [2023-12-26 00:58:51,212][123090] Updated weights for policy 1, policy_version 174428 (0.0010) [2023-12-26 00:58:51,667][123091] Updated weights for policy 0, policy_version 175145 (0.0008) [2023-12-26 00:58:51,738][123091] Updated weights for policy 0, policy_version 175155 (0.0009) [2023-12-26 00:58:51,802][123091] Updated weights for policy 0, policy_version 175165 (0.0008) [2023-12-26 00:58:52,069][123090] Updated weights for policy 1, policy_version 174438 (0.0010) [2023-12-26 00:58:52,147][123090] Updated weights for policy 1, policy_version 174448 (0.0007) [2023-12-26 00:58:52,222][123090] Updated weights for policy 1, policy_version 174458 (0.0008) [2023-12-26 00:58:52,513][123091] Updated weights for policy 0, policy_version 175175 (0.0009) [2023-12-26 00:58:52,581][123091] Updated weights for policy 0, policy_version 175185 (0.0009) [2023-12-26 00:58:52,639][123091] Updated weights for policy 0, policy_version 175195 (0.0005) [2023-12-26 00:58:52,933][123090] Updated weights for policy 1, policy_version 174468 (0.0008) [2023-12-26 00:58:52,990][123090] Updated weights for policy 1, policy_version 174478 (0.0005) [2023-12-26 00:58:53,047][123090] Updated weights for policy 1, policy_version 174488 (0.0005) [2023-12-26 00:58:53,327][123091] Updated weights for policy 0, policy_version 175205 (0.0007) [2023-12-26 00:58:53,377][123091] Updated weights for policy 0, policy_version 175215 (0.0008) [2023-12-26 00:58:53,425][123091] Updated weights for policy 0, policy_version 175225 (0.0009) [2023-12-26 00:58:53,651][123090] Updated weights for policy 1, policy_version 174498 (0.0005) [2023-12-26 00:58:53,709][123090] Updated weights for policy 1, policy_version 174508 (0.0005) [2023-12-26 00:58:53,769][123090] Updated weights for policy 1, policy_version 174518 (0.0005) [2023-12-26 00:58:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 89530368. Throughput: 0: 8764.7, 1: 8743.4. Samples: 89506196. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:53,785][121949] Avg episode reward: [(0, '5680.908'), (1, '5157.736')] [2023-12-26 00:58:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000175232_44859392.pth... [2023-12-26 00:58:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000174208_44597248.pth [2023-12-26 00:58:53,826][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000174528_44679168.pth... [2023-12-26 00:58:53,827][123090] Updated weights for policy 1, policy_version 174528 (0.0005) [2023-12-26 00:58:53,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000173504_44417024.pth [2023-12-26 00:58:54,169][123091] Updated weights for policy 0, policy_version 175235 (0.0008) [2023-12-26 00:58:54,231][123091] Updated weights for policy 0, policy_version 175245 (0.0005) [2023-12-26 00:58:54,297][123091] Updated weights for policy 0, policy_version 175255 (0.0005) [2023-12-26 00:58:54,508][123090] Updated weights for policy 1, policy_version 174538 (0.0007) [2023-12-26 00:58:54,571][123090] Updated weights for policy 1, policy_version 174548 (0.0010) [2023-12-26 00:58:54,626][123090] Updated weights for policy 1, policy_version 174558 (0.0010) [2023-12-26 00:58:54,925][123091] Updated weights for policy 0, policy_version 175265 (0.0005) [2023-12-26 00:58:54,996][123091] Updated weights for policy 0, policy_version 175275 (0.0009) [2023-12-26 00:58:55,058][123091] Updated weights for policy 0, policy_version 175285 (0.0006) [2023-12-26 00:58:55,120][123091] Updated weights for policy 0, policy_version 175295 (0.0005) [2023-12-26 00:58:55,376][123090] Updated weights for policy 1, policy_version 174568 (0.0006) [2023-12-26 00:58:55,426][123090] Updated weights for policy 1, policy_version 174578 (0.0007) [2023-12-26 00:58:55,475][123090] Updated weights for policy 1, policy_version 174588 (0.0005) [2023-12-26 00:58:55,740][123091] Updated weights for policy 0, policy_version 175305 (0.0005) [2023-12-26 00:58:55,806][123091] Updated weights for policy 0, policy_version 175315 (0.0005) [2023-12-26 00:58:55,855][123091] Updated weights for policy 0, policy_version 175325 (0.0005) [2023-12-26 00:58:56,159][123090] Updated weights for policy 1, policy_version 174598 (0.0005) [2023-12-26 00:58:56,209][123090] Updated weights for policy 1, policy_version 174608 (0.0005) [2023-12-26 00:58:56,257][123090] Updated weights for policy 1, policy_version 174618 (0.0005) [2023-12-26 00:58:56,487][123091] Updated weights for policy 0, policy_version 175335 (0.0005) [2023-12-26 00:58:56,542][123091] Updated weights for policy 0, policy_version 175345 (0.0005) [2023-12-26 00:58:56,593][123091] Updated weights for policy 0, policy_version 175355 (0.0009) [2023-12-26 00:58:56,970][123090] Updated weights for policy 1, policy_version 174628 (0.0007) [2023-12-26 00:58:57,028][123090] Updated weights for policy 1, policy_version 174638 (0.0010) [2023-12-26 00:58:57,083][123090] Updated weights for policy 1, policy_version 174648 (0.0010) [2023-12-26 00:58:57,282][123091] Updated weights for policy 0, policy_version 175365 (0.0008) [2023-12-26 00:58:57,335][123091] Updated weights for policy 0, policy_version 175375 (0.0005) [2023-12-26 00:58:57,382][123091] Updated weights for policy 0, policy_version 175385 (0.0010) [2023-12-26 00:58:57,868][123090] Updated weights for policy 1, policy_version 174658 (0.0010) [2023-12-26 00:58:57,917][123090] Updated weights for policy 1, policy_version 174668 (0.0005) [2023-12-26 00:58:57,964][123090] Updated weights for policy 1, policy_version 174678 (0.0005) [2023-12-26 00:58:58,035][123090] Updated weights for policy 1, policy_version 174688 (0.0008) [2023-12-26 00:58:58,172][123091] Updated weights for policy 0, policy_version 175395 (0.0010) [2023-12-26 00:58:58,228][123091] Updated weights for policy 0, policy_version 175405 (0.0007) [2023-12-26 00:58:58,295][123091] Updated weights for policy 0, policy_version 175415 (0.0006) [2023-12-26 00:58:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 89628672. Throughput: 0: 8898.9, 1: 8927.6. Samples: 89625132. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:58:58,784][121949] Avg episode reward: [(0, '5670.065'), (1, '5077.388')] [2023-12-26 00:58:58,827][123090] Updated weights for policy 1, policy_version 174699 (0.0010) [2023-12-26 00:58:58,894][123090] Updated weights for policy 1, policy_version 174709 (0.0009) [2023-12-26 00:58:58,960][123090] Updated weights for policy 1, policy_version 174719 (0.0009) [2023-12-26 00:58:59,065][123091] Updated weights for policy 0, policy_version 175425 (0.0008) [2023-12-26 00:58:59,124][123091] Updated weights for policy 0, policy_version 175435 (0.0005) [2023-12-26 00:58:59,177][123091] Updated weights for policy 0, policy_version 175445 (0.0005) [2023-12-26 00:58:59,237][123091] Updated weights for policy 0, policy_version 175455 (0.0006) [2023-12-26 00:58:59,884][123091] Updated weights for policy 0, policy_version 175465 (0.0007) [2023-12-26 00:58:59,900][123090] Updated weights for policy 1, policy_version 174729 (0.0007) [2023-12-26 00:58:59,950][123091] Updated weights for policy 0, policy_version 175475 (0.0008) [2023-12-26 00:58:59,974][123090] Updated weights for policy 1, policy_version 174739 (0.0008) [2023-12-26 00:59:00,016][123091] Updated weights for policy 0, policy_version 175485 (0.0007) [2023-12-26 00:59:00,041][123090] Updated weights for policy 1, policy_version 174749 (0.0009) [2023-12-26 00:59:00,841][123091] Updated weights for policy 0, policy_version 175495 (0.0009) [2023-12-26 00:59:00,870][123090] Updated weights for policy 1, policy_version 174759 (0.0007) [2023-12-26 00:59:00,901][123091] Updated weights for policy 0, policy_version 175505 (0.0009) [2023-12-26 00:59:00,926][123090] Updated weights for policy 1, policy_version 174769 (0.0005) [2023-12-26 00:59:00,950][123091] Updated weights for policy 0, policy_version 175515 (0.0008) [2023-12-26 00:59:00,990][123090] Updated weights for policy 1, policy_version 174779 (0.0009) [2023-12-26 00:59:01,779][123090] Updated weights for policy 1, policy_version 174789 (0.0009) [2023-12-26 00:59:01,798][123091] Updated weights for policy 0, policy_version 175525 (0.0008) [2023-12-26 00:59:01,841][123090] Updated weights for policy 1, policy_version 174799 (0.0008) [2023-12-26 00:59:01,851][123091] Updated weights for policy 0, policy_version 175535 (0.0009) [2023-12-26 00:59:01,909][123090] Updated weights for policy 1, policy_version 174809 (0.0008) [2023-12-26 00:59:01,912][123091] Updated weights for policy 0, policy_version 175545 (0.0008) [2023-12-26 00:59:02,635][123090] Updated weights for policy 1, policy_version 174819 (0.0009) [2023-12-26 00:59:02,694][123090] Updated weights for policy 1, policy_version 174829 (0.0009) [2023-12-26 00:59:02,749][123090] Updated weights for policy 1, policy_version 174839 (0.0009) [2023-12-26 00:59:02,757][123091] Updated weights for policy 0, policy_version 175555 (0.0008) [2023-12-26 00:59:02,827][123091] Updated weights for policy 0, policy_version 175565 (0.0008) [2023-12-26 00:59:02,883][123091] Updated weights for policy 0, policy_version 175575 (0.0008) [2023-12-26 00:59:03,551][123090] Updated weights for policy 1, policy_version 174849 (0.0009) [2023-12-26 00:59:03,600][123090] Updated weights for policy 1, policy_version 174860 (0.0008) [2023-12-26 00:59:03,658][123090] Updated weights for policy 1, policy_version 174870 (0.0008) [2023-12-26 00:59:03,681][123091] Updated weights for policy 0, policy_version 175585 (0.0009) [2023-12-26 00:59:03,716][123090] Updated weights for policy 1, policy_version 174880 (0.0010) [2023-12-26 00:59:03,734][123091] Updated weights for policy 0, policy_version 175595 (0.0008) [2023-12-26 00:59:03,781][123091] Updated weights for policy 0, policy_version 175605 (0.0009) [2023-12-26 00:59:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 89718784. Throughput: 0: 8867.9, 1: 8808.5. Samples: 89729932. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:59:03,785][121949] Avg episode reward: [(0, '5787.393'), (1, '5050.563')] [2023-12-26 00:59:03,830][123091] Updated weights for policy 0, policy_version 175615 (0.0009) [2023-12-26 00:59:04,596][123090] Updated weights for policy 1, policy_version 174890 (0.0009) [2023-12-26 00:59:04,663][123090] Updated weights for policy 1, policy_version 174900 (0.0008) [2023-12-26 00:59:04,672][123091] Updated weights for policy 0, policy_version 175625 (0.0009) [2023-12-26 00:59:04,728][123090] Updated weights for policy 1, policy_version 174910 (0.0010) [2023-12-26 00:59:04,732][123091] Updated weights for policy 0, policy_version 175635 (0.0010) [2023-12-26 00:59:04,795][123091] Updated weights for policy 0, policy_version 175645 (0.0009) [2023-12-26 00:59:05,552][123090] Updated weights for policy 1, policy_version 174920 (0.0010) [2023-12-26 00:59:05,615][123090] Updated weights for policy 1, policy_version 174930 (0.0010) [2023-12-26 00:59:05,620][123091] Updated weights for policy 0, policy_version 175655 (0.0007) [2023-12-26 00:59:05,669][123091] Updated weights for policy 0, policy_version 175665 (0.0006) [2023-12-26 00:59:05,680][123090] Updated weights for policy 1, policy_version 174940 (0.0009) [2023-12-26 00:59:05,718][123091] Updated weights for policy 0, policy_version 175675 (0.0006) [2023-12-26 00:59:06,527][123090] Updated weights for policy 1, policy_version 174950 (0.0009) [2023-12-26 00:59:06,547][123091] Updated weights for policy 0, policy_version 175685 (0.0009) [2023-12-26 00:59:06,596][123090] Updated weights for policy 1, policy_version 174960 (0.0010) [2023-12-26 00:59:06,613][123091] Updated weights for policy 0, policy_version 175695 (0.0006) [2023-12-26 00:59:06,665][123090] Updated weights for policy 1, policy_version 174970 (0.0008) [2023-12-26 00:59:06,675][123091] Updated weights for policy 0, policy_version 175705 (0.0007) [2023-12-26 00:59:07,487][123091] Updated weights for policy 0, policy_version 175715 (0.0010) [2023-12-26 00:59:07,503][123090] Updated weights for policy 1, policy_version 174980 (0.0006) [2023-12-26 00:59:07,548][123091] Updated weights for policy 0, policy_version 175725 (0.0010) [2023-12-26 00:59:07,566][123090] Updated weights for policy 1, policy_version 174990 (0.0007) [2023-12-26 00:59:07,611][123091] Updated weights for policy 0, policy_version 175735 (0.0009) [2023-12-26 00:59:07,632][123090] Updated weights for policy 1, policy_version 175000 (0.0008) [2023-12-26 00:59:08,451][123091] Updated weights for policy 0, policy_version 175745 (0.0008) [2023-12-26 00:59:08,462][123090] Updated weights for policy 1, policy_version 175010 (0.0009) [2023-12-26 00:59:08,504][123091] Updated weights for policy 0, policy_version 175755 (0.0007) [2023-12-26 00:59:08,520][123090] Updated weights for policy 1, policy_version 175020 (0.0009) [2023-12-26 00:59:08,561][123091] Updated weights for policy 0, policy_version 175765 (0.0006) [2023-12-26 00:59:08,576][123090] Updated weights for policy 1, policy_version 175030 (0.0008) [2023-12-26 00:59:08,619][123091] Updated weights for policy 0, policy_version 175775 (0.0007) [2023-12-26 00:59:08,640][123090] Updated weights for policy 1, policy_version 175040 (0.0008) [2023-12-26 00:59:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 89808896. Throughput: 0: 8868.6, 1: 8802.3. Samples: 89780900. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:59:08,785][121949] Avg episode reward: [(0, '5757.754'), (1, '5002.590')] [2023-12-26 00:59:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000175776_44998656.pth... [2023-12-26 00:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000175040_44810240.pth... [2023-12-26 00:59:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000174720_44728320.pth [2023-12-26 00:59:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000174016_44548096.pth [2023-12-26 00:59:09,462][123091] Updated weights for policy 0, policy_version 175785 (0.0006) [2023-12-26 00:59:09,479][123090] Updated weights for policy 1, policy_version 175050 (0.0006) [2023-12-26 00:59:09,534][123091] Updated weights for policy 0, policy_version 175795 (0.0007) [2023-12-26 00:59:09,549][123090] Updated weights for policy 1, policy_version 175060 (0.0006) [2023-12-26 00:59:09,592][123091] Updated weights for policy 0, policy_version 175805 (0.0009) [2023-12-26 00:59:09,612][123090] Updated weights for policy 1, policy_version 175070 (0.0007) [2023-12-26 00:59:10,369][123090] Updated weights for policy 1, policy_version 175080 (0.0008) [2023-12-26 00:59:10,375][123091] Updated weights for policy 0, policy_version 175815 (0.0009) [2023-12-26 00:59:10,417][123090] Updated weights for policy 1, policy_version 175090 (0.0008) [2023-12-26 00:59:10,424][123091] Updated weights for policy 0, policy_version 175825 (0.0008) [2023-12-26 00:59:10,472][123090] Updated weights for policy 1, policy_version 175100 (0.0007) [2023-12-26 00:59:10,483][123091] Updated weights for policy 0, policy_version 175835 (0.0010) [2023-12-26 00:59:11,294][123091] Updated weights for policy 0, policy_version 175845 (0.0008) [2023-12-26 00:59:11,331][123090] Updated weights for policy 1, policy_version 175110 (0.0008) [2023-12-26 00:59:11,364][123091] Updated weights for policy 0, policy_version 175855 (0.0008) [2023-12-26 00:59:11,401][123090] Updated weights for policy 1, policy_version 175120 (0.0008) [2023-12-26 00:59:11,438][123091] Updated weights for policy 0, policy_version 175865 (0.0010) [2023-12-26 00:59:11,471][123090] Updated weights for policy 1, policy_version 175130 (0.0007) [2023-12-26 00:59:12,222][123091] Updated weights for policy 0, policy_version 175875 (0.0009) [2023-12-26 00:59:12,284][123090] Updated weights for policy 1, policy_version 175140 (0.0008) [2023-12-26 00:59:12,293][123091] Updated weights for policy 0, policy_version 175885 (0.0007) [2023-12-26 00:59:12,347][123090] Updated weights for policy 1, policy_version 175150 (0.0009) [2023-12-26 00:59:12,370][123091] Updated weights for policy 0, policy_version 175895 (0.0009) [2023-12-26 00:59:12,415][123090] Updated weights for policy 1, policy_version 175160 (0.0008) [2023-12-26 00:59:13,110][123091] Updated weights for policy 0, policy_version 175905 (0.0008) [2023-12-26 00:59:13,170][123091] Updated weights for policy 0, policy_version 175915 (0.0005) [2023-12-26 00:59:13,217][123091] Updated weights for policy 0, policy_version 175925 (0.0005) [2023-12-26 00:59:13,263][123091] Updated weights for policy 0, policy_version 175935 (0.0005) [2023-12-26 00:59:13,318][123090] Updated weights for policy 1, policy_version 175170 (0.0008) [2023-12-26 00:59:13,369][123090] Updated weights for policy 1, policy_version 175181 (0.0007) [2023-12-26 00:59:13,416][123090] Updated weights for policy 1, policy_version 175191 (0.0005) [2023-12-26 00:59:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 89890816. Throughput: 0: 8892.0, 1: 8741.8. Samples: 89883240. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:59:13,785][121949] Avg episode reward: [(0, '5750.677'), (1, '4962.904')] [2023-12-26 00:59:13,928][123091] Updated weights for policy 0, policy_version 175945 (0.0005) [2023-12-26 00:59:14,004][123091] Updated weights for policy 0, policy_version 175955 (0.0006) [2023-12-26 00:59:14,075][123091] Updated weights for policy 0, policy_version 175965 (0.0005) [2023-12-26 00:59:14,123][123090] Updated weights for policy 1, policy_version 175201 (0.0005) [2023-12-26 00:59:14,180][123090] Updated weights for policy 1, policy_version 175211 (0.0006) [2023-12-26 00:59:14,248][123090] Updated weights for policy 1, policy_version 175221 (0.0005) [2023-12-26 00:59:14,319][123090] Updated weights for policy 1, policy_version 175231 (0.0006) [2023-12-26 00:59:14,669][123091] Updated weights for policy 0, policy_version 175975 (0.0006) [2023-12-26 00:59:14,729][123091] Updated weights for policy 0, policy_version 175985 (0.0008) [2023-12-26 00:59:14,797][123091] Updated weights for policy 0, policy_version 175995 (0.0008) [2023-12-26 00:59:15,026][123090] Updated weights for policy 1, policy_version 175241 (0.0006) [2023-12-26 00:59:15,098][123090] Updated weights for policy 1, policy_version 175251 (0.0006) [2023-12-26 00:59:15,171][123090] Updated weights for policy 1, policy_version 175261 (0.0006) [2023-12-26 00:59:15,612][123091] Updated weights for policy 0, policy_version 176005 (0.0008) [2023-12-26 00:59:15,667][123091] Updated weights for policy 0, policy_version 176015 (0.0011) [2023-12-26 00:59:15,737][123091] Updated weights for policy 0, policy_version 176025 (0.0011) [2023-12-26 00:59:15,872][123090] Updated weights for policy 1, policy_version 175271 (0.0009) [2023-12-26 00:59:15,942][123090] Updated weights for policy 1, policy_version 175281 (0.0010) [2023-12-26 00:59:16,008][123090] Updated weights for policy 1, policy_version 175291 (0.0011) [2023-12-26 00:59:16,435][123091] Updated weights for policy 0, policy_version 176035 (0.0009) [2023-12-26 00:59:16,501][123091] Updated weights for policy 0, policy_version 176045 (0.0009) [2023-12-26 00:59:16,556][123091] Updated weights for policy 0, policy_version 176055 (0.0010) [2023-12-26 00:59:16,818][123090] Updated weights for policy 1, policy_version 175301 (0.0010) [2023-12-26 00:59:16,876][123090] Updated weights for policy 1, policy_version 175311 (0.0010) [2023-12-26 00:59:16,939][123090] Updated weights for policy 1, policy_version 175321 (0.0010) [2023-12-26 00:59:17,298][123091] Updated weights for policy 0, policy_version 176065 (0.0010) [2023-12-26 00:59:17,353][123091] Updated weights for policy 0, policy_version 176075 (0.0005) [2023-12-26 00:59:17,399][123091] Updated weights for policy 0, policy_version 176085 (0.0005) [2023-12-26 00:59:17,444][123091] Updated weights for policy 0, policy_version 176095 (0.0005) [2023-12-26 00:59:17,650][123090] Updated weights for policy 1, policy_version 175331 (0.0009) [2023-12-26 00:59:17,719][123090] Updated weights for policy 1, policy_version 175341 (0.0010) [2023-12-26 00:59:17,797][123090] Updated weights for policy 1, policy_version 175351 (0.0011) [2023-12-26 00:59:18,114][123091] Updated weights for policy 0, policy_version 176105 (0.0008) [2023-12-26 00:59:18,167][123091] Updated weights for policy 0, policy_version 176115 (0.0005) [2023-12-26 00:59:18,222][123091] Updated weights for policy 0, policy_version 176125 (0.0005) [2023-12-26 00:59:18,590][123090] Updated weights for policy 1, policy_version 175361 (0.0011) [2023-12-26 00:59:18,650][123090] Updated weights for policy 1, policy_version 175371 (0.0011) [2023-12-26 00:59:18,716][123090] Updated weights for policy 1, policy_version 175381 (0.0010) [2023-12-26 00:59:18,774][123090] Updated weights for policy 1, policy_version 175391 (0.0010) [2023-12-26 00:59:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 89989120. Throughput: 0: 9088.0, 1: 8736.7. Samples: 89998584. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:59:18,785][121949] Avg episode reward: [(0, '5759.509'), (1, '4860.382')] [2023-12-26 00:59:18,902][123091] Updated weights for policy 0, policy_version 176135 (0.0006) [2023-12-26 00:59:18,976][123091] Updated weights for policy 0, policy_version 176145 (0.0007) [2023-12-26 00:59:19,054][123091] Updated weights for policy 0, policy_version 176155 (0.0010) [2023-12-26 00:59:19,584][123090] Updated weights for policy 1, policy_version 175401 (0.0011) [2023-12-26 00:59:19,644][123090] Updated weights for policy 1, policy_version 175411 (0.0010) [2023-12-26 00:59:19,703][123090] Updated weights for policy 1, policy_version 175421 (0.0010) [2023-12-26 00:59:19,876][123091] Updated weights for policy 0, policy_version 176165 (0.0010) [2023-12-26 00:59:19,951][123091] Updated weights for policy 0, policy_version 176175 (0.0009) [2023-12-26 00:59:20,016][123091] Updated weights for policy 0, policy_version 176185 (0.0009) [2023-12-26 00:59:20,406][123090] Updated weights for policy 1, policy_version 175431 (0.0009) [2023-12-26 00:59:20,475][123090] Updated weights for policy 1, policy_version 175441 (0.0006) [2023-12-26 00:59:20,542][123090] Updated weights for policy 1, policy_version 175451 (0.0005) [2023-12-26 00:59:20,902][123091] Updated weights for policy 0, policy_version 176195 (0.0010) [2023-12-26 00:59:20,967][123091] Updated weights for policy 0, policy_version 176205 (0.0010) [2023-12-26 00:59:21,023][123091] Updated weights for policy 0, policy_version 176215 (0.0010) [2023-12-26 00:59:21,312][123090] Updated weights for policy 1, policy_version 175461 (0.0008) [2023-12-26 00:59:21,396][123090] Updated weights for policy 1, policy_version 175471 (0.0008) [2023-12-26 00:59:21,464][123090] Updated weights for policy 1, policy_version 175481 (0.0006) [2023-12-26 00:59:21,946][123091] Updated weights for policy 0, policy_version 176225 (0.0010) [2023-12-26 00:59:22,009][123091] Updated weights for policy 0, policy_version 176235 (0.0010) [2023-12-26 00:59:22,079][123091] Updated weights for policy 0, policy_version 176245 (0.0009) [2023-12-26 00:59:22,135][123091] Updated weights for policy 0, policy_version 176255 (0.0009) [2023-12-26 00:59:22,231][123090] Updated weights for policy 1, policy_version 175491 (0.0008) [2023-12-26 00:59:22,296][123090] Updated weights for policy 1, policy_version 175501 (0.0009) [2023-12-26 00:59:22,357][123090] Updated weights for policy 1, policy_version 175511 (0.0009) [2023-12-26 00:59:22,912][123091] Updated weights for policy 0, policy_version 176265 (0.0008) [2023-12-26 00:59:22,975][123091] Updated weights for policy 0, policy_version 176275 (0.0008) [2023-12-26 00:59:23,038][123091] Updated weights for policy 0, policy_version 176285 (0.0008) [2023-12-26 00:59:23,155][123090] Updated weights for policy 1, policy_version 175521 (0.0010) [2023-12-26 00:59:23,230][123090] Updated weights for policy 1, policy_version 175531 (0.0009) [2023-12-26 00:59:23,296][123090] Updated weights for policy 1, policy_version 175541 (0.0009) [2023-12-26 00:59:23,364][123090] Updated weights for policy 1, policy_version 175551 (0.0009) [2023-12-26 00:59:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 90071040. Throughput: 0: 9082.9, 1: 8736.3. Samples: 90050020. Policy #0 lag: (min: 3.0, avg: 6.3, max: 35.0) [2023-12-26 00:59:23,785][121949] Avg episode reward: [(0, '5780.670'), (1, '4876.414')] [2023-12-26 00:59:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000175552_44941312.pth... [2023-12-26 00:59:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000174528_44679168.pth [2023-12-26 00:59:23,793][123091] Updated weights for policy 0, policy_version 176295 (0.0010) [2023-12-26 00:59:23,841][123091] Updated weights for policy 0, policy_version 176305 (0.0010) [2023-12-26 00:59:23,896][123091] Updated weights for policy 0, policy_version 176315 (0.0010) [2023-12-26 00:59:23,927][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000176320_45137920.pth... [2023-12-26 00:59:23,932][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000175232_44859392.pth [2023-12-26 00:59:24,214][123090] Updated weights for policy 1, policy_version 175561 (0.0009) [2023-12-26 00:59:24,284][123090] Updated weights for policy 1, policy_version 175571 (0.0010) [2023-12-26 00:59:24,351][123090] Updated weights for policy 1, policy_version 175581 (0.0010) [2023-12-26 00:59:24,630][123091] Updated weights for policy 0, policy_version 176325 (0.0010) [2023-12-26 00:59:24,687][123091] Updated weights for policy 0, policy_version 176335 (0.0005) [2023-12-26 00:59:24,744][123091] Updated weights for policy 0, policy_version 176345 (0.0008) [2023-12-26 00:59:25,097][123090] Updated weights for policy 1, policy_version 175591 (0.0007) [2023-12-26 00:59:25,151][123090] Updated weights for policy 1, policy_version 175601 (0.0005) [2023-12-26 00:59:25,207][123090] Updated weights for policy 1, policy_version 175611 (0.0005) [2023-12-26 00:59:25,553][123091] Updated weights for policy 0, policy_version 176355 (0.0010) [2023-12-26 00:59:25,612][123091] Updated weights for policy 0, policy_version 176365 (0.0010) [2023-12-26 00:59:25,667][123091] Updated weights for policy 0, policy_version 176375 (0.0010) [2023-12-26 00:59:25,949][123090] Updated weights for policy 1, policy_version 175621 (0.0007) [2023-12-26 00:59:26,004][123090] Updated weights for policy 1, policy_version 175631 (0.0008) [2023-12-26 00:59:26,052][123090] Updated weights for policy 1, policy_version 175641 (0.0008) [2023-12-26 00:59:26,480][123091] Updated weights for policy 0, policy_version 176385 (0.0010) [2023-12-26 00:59:26,531][123091] Updated weights for policy 0, policy_version 176395 (0.0010) [2023-12-26 00:59:26,586][123091] Updated weights for policy 0, policy_version 176405 (0.0010) [2023-12-26 00:59:26,633][123091] Updated weights for policy 0, policy_version 176415 (0.0010) [2023-12-26 00:59:26,897][123090] Updated weights for policy 1, policy_version 175651 (0.0008) [2023-12-26 00:59:26,950][123090] Updated weights for policy 1, policy_version 175661 (0.0009) [2023-12-26 00:59:27,007][123090] Updated weights for policy 1, policy_version 175671 (0.0009) [2023-12-26 00:59:27,430][123091] Updated weights for policy 0, policy_version 176425 (0.0009) [2023-12-26 00:59:27,481][123091] Updated weights for policy 0, policy_version 176435 (0.0009) [2023-12-26 00:59:27,525][123091] Updated weights for policy 0, policy_version 176445 (0.0006) [2023-12-26 00:59:27,871][123090] Updated weights for policy 1, policy_version 175681 (0.0008) [2023-12-26 00:59:27,918][123090] Updated weights for policy 1, policy_version 175691 (0.0008) [2023-12-26 00:59:27,965][123090] Updated weights for policy 1, policy_version 175701 (0.0008) [2023-12-26 00:59:28,020][123090] Updated weights for policy 1, policy_version 175711 (0.0008) [2023-12-26 00:59:28,338][123091] Updated weights for policy 0, policy_version 176455 (0.0006) [2023-12-26 00:59:28,389][123091] Updated weights for policy 0, policy_version 176465 (0.0006) [2023-12-26 00:59:28,445][123091] Updated weights for policy 0, policy_version 176475 (0.0005) [2023-12-26 00:59:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 90161152. Throughput: 0: 9133.5, 1: 8805.9. Samples: 90156700. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:28,785][121949] Avg episode reward: [(0, '5654.857'), (1, '4990.932')] [2023-12-26 00:59:28,909][123090] Updated weights for policy 1, policy_version 175721 (0.0009) [2023-12-26 00:59:28,980][123090] Updated weights for policy 1, policy_version 175731 (0.0009) [2023-12-26 00:59:29,043][123090] Updated weights for policy 1, policy_version 175741 (0.0009) [2023-12-26 00:59:29,262][123091] Updated weights for policy 0, policy_version 176485 (0.0008) [2023-12-26 00:59:29,322][123091] Updated weights for policy 0, policy_version 176495 (0.0011) [2023-12-26 00:59:29,384][123091] Updated weights for policy 0, policy_version 176505 (0.0011) [2023-12-26 00:59:29,863][123090] Updated weights for policy 1, policy_version 175751 (0.0009) [2023-12-26 00:59:29,920][123090] Updated weights for policy 1, policy_version 175761 (0.0009) [2023-12-26 00:59:29,988][123090] Updated weights for policy 1, policy_version 175771 (0.0009) [2023-12-26 00:59:30,200][123091] Updated weights for policy 0, policy_version 176515 (0.0009) [2023-12-26 00:59:30,260][123091] Updated weights for policy 0, policy_version 176525 (0.0008) [2023-12-26 00:59:30,318][123091] Updated weights for policy 0, policy_version 176535 (0.0008) [2023-12-26 00:59:30,858][123090] Updated weights for policy 1, policy_version 175781 (0.0009) [2023-12-26 00:59:30,918][123090] Updated weights for policy 1, policy_version 175791 (0.0009) [2023-12-26 00:59:30,982][123090] Updated weights for policy 1, policy_version 175801 (0.0005) [2023-12-26 00:59:31,171][123091] Updated weights for policy 0, policy_version 176545 (0.0008) [2023-12-26 00:59:31,239][123091] Updated weights for policy 0, policy_version 176555 (0.0008) [2023-12-26 00:59:31,310][123091] Updated weights for policy 0, policy_version 176565 (0.0010) [2023-12-26 00:59:31,380][123091] Updated weights for policy 0, policy_version 176575 (0.0009) [2023-12-26 00:59:31,791][123090] Updated weights for policy 1, policy_version 175811 (0.0007) [2023-12-26 00:59:31,865][123090] Updated weights for policy 1, policy_version 175821 (0.0009) [2023-12-26 00:59:31,921][123090] Updated weights for policy 1, policy_version 175831 (0.0009) [2023-12-26 00:59:32,114][123091] Updated weights for policy 0, policy_version 176585 (0.0010) [2023-12-26 00:59:32,179][123091] Updated weights for policy 0, policy_version 176595 (0.0009) [2023-12-26 00:59:32,247][123091] Updated weights for policy 0, policy_version 176605 (0.0005) [2023-12-26 00:59:32,734][123090] Updated weights for policy 1, policy_version 175841 (0.0008) [2023-12-26 00:59:32,825][123090] Updated weights for policy 1, policy_version 175851 (0.0006) [2023-12-26 00:59:32,892][123090] Updated weights for policy 1, policy_version 175861 (0.0009) [2023-12-26 00:59:32,965][123090] Updated weights for policy 1, policy_version 175871 (0.0009) [2023-12-26 00:59:33,044][123091] Updated weights for policy 0, policy_version 176615 (0.0009) [2023-12-26 00:59:33,090][123091] Updated weights for policy 0, policy_version 176625 (0.0010) [2023-12-26 00:59:33,137][123091] Updated weights for policy 0, policy_version 176635 (0.0010) [2023-12-26 00:59:33,642][123090] Updated weights for policy 1, policy_version 175881 (0.0006) [2023-12-26 00:59:33,691][123090] Updated weights for policy 1, policy_version 175891 (0.0005) [2023-12-26 00:59:33,742][123090] Updated weights for policy 1, policy_version 175901 (0.0005) [2023-12-26 00:59:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 90251264. Throughput: 0: 9061.2, 1: 8860.6. Samples: 90260780. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:33,785][121949] Avg episode reward: [(0, '5654.068'), (1, '5008.662')] [2023-12-26 00:59:33,992][123091] Updated weights for policy 0, policy_version 176645 (0.0010) [2023-12-26 00:59:34,042][123091] Updated weights for policy 0, policy_version 176655 (0.0010) [2023-12-26 00:59:34,097][123091] Updated weights for policy 0, policy_version 176665 (0.0010) [2023-12-26 00:59:34,401][123090] Updated weights for policy 1, policy_version 175911 (0.0005) [2023-12-26 00:59:34,450][123090] Updated weights for policy 1, policy_version 175921 (0.0005) [2023-12-26 00:59:34,506][123090] Updated weights for policy 1, policy_version 175931 (0.0005) [2023-12-26 00:59:34,952][123091] Updated weights for policy 0, policy_version 176675 (0.0011) [2023-12-26 00:59:35,015][123091] Updated weights for policy 0, policy_version 176685 (0.0010) [2023-12-26 00:59:35,067][123091] Updated weights for policy 0, policy_version 176695 (0.0010) [2023-12-26 00:59:35,199][123090] Updated weights for policy 1, policy_version 175941 (0.0005) [2023-12-26 00:59:35,256][123090] Updated weights for policy 1, policy_version 175951 (0.0008) [2023-12-26 00:59:35,318][123090] Updated weights for policy 1, policy_version 175961 (0.0005) [2023-12-26 00:59:35,831][123091] Updated weights for policy 0, policy_version 176705 (0.0011) [2023-12-26 00:59:35,886][123091] Updated weights for policy 0, policy_version 176715 (0.0010) [2023-12-26 00:59:35,947][123091] Updated weights for policy 0, policy_version 176725 (0.0008) [2023-12-26 00:59:36,018][123091] Updated weights for policy 0, policy_version 176735 (0.0006) [2023-12-26 00:59:36,141][123090] Updated weights for policy 1, policy_version 175971 (0.0009) [2023-12-26 00:59:36,206][123090] Updated weights for policy 1, policy_version 175981 (0.0006) [2023-12-26 00:59:36,275][123090] Updated weights for policy 1, policy_version 175991 (0.0009) [2023-12-26 00:59:36,857][123091] Updated weights for policy 0, policy_version 176745 (0.0010) [2023-12-26 00:59:36,918][123091] Updated weights for policy 0, policy_version 176755 (0.0009) [2023-12-26 00:59:36,971][123091] Updated weights for policy 0, policy_version 176765 (0.0010) [2023-12-26 00:59:37,015][123090] Updated weights for policy 1, policy_version 176001 (0.0009) [2023-12-26 00:59:37,078][123090] Updated weights for policy 1, policy_version 176011 (0.0009) [2023-12-26 00:59:37,147][123090] Updated weights for policy 1, policy_version 176021 (0.0010) [2023-12-26 00:59:37,204][123090] Updated weights for policy 1, policy_version 176031 (0.0008) [2023-12-26 00:59:37,842][123091] Updated weights for policy 0, policy_version 176775 (0.0010) [2023-12-26 00:59:37,896][123091] Updated weights for policy 0, policy_version 176785 (0.0009) [2023-12-26 00:59:37,956][123090] Updated weights for policy 1, policy_version 176041 (0.0008) [2023-12-26 00:59:37,963][123091] Updated weights for policy 0, policy_version 176795 (0.0009) [2023-12-26 00:59:38,018][123090] Updated weights for policy 1, policy_version 176051 (0.0007) [2023-12-26 00:59:38,088][123090] Updated weights for policy 1, policy_version 176061 (0.0009) [2023-12-26 00:59:38,775][123091] Updated weights for policy 0, policy_version 176805 (0.0010) [2023-12-26 00:59:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 90333184. Throughput: 0: 9064.7, 1: 8920.7. Samples: 90315536. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:38,785][121949] Avg episode reward: [(0, '5786.841'), (1, '4761.973')] [2023-12-26 00:59:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000176064_45072384.pth... [2023-12-26 00:59:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000175040_44810240.pth [2023-12-26 00:59:38,828][123091] Updated weights for policy 0, policy_version 176815 (0.0010) [2023-12-26 00:59:38,881][123091] Updated weights for policy 0, policy_version 176825 (0.0009) [2023-12-26 00:59:38,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000176832_45268992.pth... [2023-12-26 00:59:38,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000175776_44998656.pth [2023-12-26 00:59:38,936][123090] Updated weights for policy 1, policy_version 176071 (0.0010) [2023-12-26 00:59:38,997][123090] Updated weights for policy 1, policy_version 176081 (0.0010) [2023-12-26 00:59:39,060][123090] Updated weights for policy 1, policy_version 176091 (0.0011) [2023-12-26 00:59:39,750][123091] Updated weights for policy 0, policy_version 176836 (0.0010) [2023-12-26 00:59:39,819][123091] Updated weights for policy 0, policy_version 176846 (0.0007) [2023-12-26 00:59:39,889][123091] Updated weights for policy 0, policy_version 176856 (0.0011) [2023-12-26 00:59:39,951][123090] Updated weights for policy 1, policy_version 176101 (0.0008) [2023-12-26 00:59:40,015][123090] Updated weights for policy 1, policy_version 176111 (0.0009) [2023-12-26 00:59:40,084][123090] Updated weights for policy 1, policy_version 176121 (0.0009) [2023-12-26 00:59:40,709][123091] Updated weights for policy 0, policy_version 176866 (0.0011) [2023-12-26 00:59:40,764][123091] Updated weights for policy 0, policy_version 176876 (0.0010) [2023-12-26 00:59:40,820][123091] Updated weights for policy 0, policy_version 176886 (0.0011) [2023-12-26 00:59:40,891][123091] Updated weights for policy 0, policy_version 176896 (0.0011) [2023-12-26 00:59:40,908][123090] Updated weights for policy 1, policy_version 176131 (0.0009) [2023-12-26 00:59:40,956][123090] Updated weights for policy 1, policy_version 176141 (0.0008) [2023-12-26 00:59:41,017][123090] Updated weights for policy 1, policy_version 176151 (0.0009) [2023-12-26 00:59:41,757][123091] Updated weights for policy 0, policy_version 176906 (0.0009) [2023-12-26 00:59:41,822][123091] Updated weights for policy 0, policy_version 176916 (0.0008) [2023-12-26 00:59:41,889][123091] Updated weights for policy 0, policy_version 176926 (0.0008) [2023-12-26 00:59:41,930][123090] Updated weights for policy 1, policy_version 176161 (0.0009) [2023-12-26 00:59:41,993][123090] Updated weights for policy 1, policy_version 176171 (0.0009) [2023-12-26 00:59:42,057][123090] Updated weights for policy 1, policy_version 176181 (0.0007) [2023-12-26 00:59:42,127][123090] Updated weights for policy 1, policy_version 176191 (0.0005) [2023-12-26 00:59:42,666][123091] Updated weights for policy 0, policy_version 176936 (0.0006) [2023-12-26 00:59:42,734][123091] Updated weights for policy 0, policy_version 176946 (0.0005) [2023-12-26 00:59:42,796][123091] Updated weights for policy 0, policy_version 176956 (0.0005) [2023-12-26 00:59:42,914][123090] Updated weights for policy 1, policy_version 176201 (0.0010) [2023-12-26 00:59:42,982][123090] Updated weights for policy 1, policy_version 176211 (0.0011) [2023-12-26 00:59:43,052][123090] Updated weights for policy 1, policy_version 176221 (0.0010) [2023-12-26 00:59:43,396][123091] Updated weights for policy 0, policy_version 176966 (0.0006) [2023-12-26 00:59:43,449][123091] Updated weights for policy 0, policy_version 176976 (0.0005) [2023-12-26 00:59:43,512][123091] Updated weights for policy 0, policy_version 176986 (0.0005) [2023-12-26 00:59:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 90423296. Throughput: 0: 8855.1, 1: 8733.2. Samples: 90416604. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:43,784][121949] Avg episode reward: [(0, '5699.178'), (1, '4735.992')] [2023-12-26 00:59:43,819][123090] Updated weights for policy 1, policy_version 176231 (0.0010) [2023-12-26 00:59:43,880][123090] Updated weights for policy 1, policy_version 176241 (0.0009) [2023-12-26 00:59:43,938][123090] Updated weights for policy 1, policy_version 176251 (0.0009) [2023-12-26 00:59:44,240][123091] Updated weights for policy 0, policy_version 176996 (0.0007) [2023-12-26 00:59:44,293][123091] Updated weights for policy 0, policy_version 177006 (0.0010) [2023-12-26 00:59:44,344][123091] Updated weights for policy 0, policy_version 177016 (0.0010) [2023-12-26 00:59:44,781][123090] Updated weights for policy 1, policy_version 176261 (0.0009) [2023-12-26 00:59:44,836][123090] Updated weights for policy 1, policy_version 176271 (0.0010) [2023-12-26 00:59:44,894][123090] Updated weights for policy 1, policy_version 176281 (0.0010) [2023-12-26 00:59:45,105][123091] Updated weights for policy 0, policy_version 177026 (0.0010) [2023-12-26 00:59:45,162][123091] Updated weights for policy 0, policy_version 177036 (0.0009) [2023-12-26 00:59:45,215][123091] Updated weights for policy 0, policy_version 177046 (0.0009) [2023-12-26 00:59:45,272][123091] Updated weights for policy 0, policy_version 177056 (0.0009) [2023-12-26 00:59:45,747][123090] Updated weights for policy 1, policy_version 176291 (0.0011) [2023-12-26 00:59:45,802][123090] Updated weights for policy 1, policy_version 176301 (0.0010) [2023-12-26 00:59:45,849][123090] Updated weights for policy 1, policy_version 176311 (0.0010) [2023-12-26 00:59:46,071][123091] Updated weights for policy 0, policy_version 177066 (0.0005) [2023-12-26 00:59:46,135][123091] Updated weights for policy 0, policy_version 177076 (0.0005) [2023-12-26 00:59:46,207][123091] Updated weights for policy 0, policy_version 177086 (0.0005) [2023-12-26 00:59:46,707][123090] Updated weights for policy 1, policy_version 176321 (0.0010) [2023-12-26 00:59:46,777][123090] Updated weights for policy 1, policy_version 176331 (0.0009) [2023-12-26 00:59:46,838][123090] Updated weights for policy 1, policy_version 176341 (0.0005) [2023-12-26 00:59:46,903][123090] Updated weights for policy 1, policy_version 176351 (0.0005) [2023-12-26 00:59:46,918][123091] Updated weights for policy 0, policy_version 177096 (0.0006) [2023-12-26 00:59:46,970][123091] Updated weights for policy 0, policy_version 177106 (0.0009) [2023-12-26 00:59:47,022][123091] Updated weights for policy 0, policy_version 177117 (0.0010) [2023-12-26 00:59:47,503][123090] Updated weights for policy 1, policy_version 176361 (0.0007) [2023-12-26 00:59:47,551][123090] Updated weights for policy 1, policy_version 176371 (0.0005) [2023-12-26 00:59:47,597][123090] Updated weights for policy 1, policy_version 176381 (0.0006) [2023-12-26 00:59:47,937][123091] Updated weights for policy 0, policy_version 177127 (0.0009) [2023-12-26 00:59:48,002][123091] Updated weights for policy 0, policy_version 177137 (0.0009) [2023-12-26 00:59:48,067][123091] Updated weights for policy 0, policy_version 177147 (0.0006) [2023-12-26 00:59:48,377][123090] Updated weights for policy 1, policy_version 176391 (0.0006) [2023-12-26 00:59:48,434][123090] Updated weights for policy 1, policy_version 176401 (0.0005) [2023-12-26 00:59:48,481][123090] Updated weights for policy 1, policy_version 176411 (0.0008) [2023-12-26 00:59:48,770][123091] Updated weights for policy 0, policy_version 177157 (0.0006) [2023-12-26 00:59:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 90513408. Throughput: 0: 8919.8, 1: 8776.5. Samples: 90526264. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:48,785][121949] Avg episode reward: [(0, '5663.798'), (1, '4955.854')] [2023-12-26 00:59:48,821][123091] Updated weights for policy 0, policy_version 177167 (0.0010) [2023-12-26 00:59:48,868][123091] Updated weights for policy 0, policy_version 177177 (0.0010) [2023-12-26 00:59:49,272][123090] Updated weights for policy 1, policy_version 176421 (0.0009) [2023-12-26 00:59:49,341][123090] Updated weights for policy 1, policy_version 176431 (0.0010) [2023-12-26 00:59:49,414][123090] Updated weights for policy 1, policy_version 176441 (0.0010) [2023-12-26 00:59:49,653][123091] Updated weights for policy 0, policy_version 177187 (0.0009) [2023-12-26 00:59:49,722][123091] Updated weights for policy 0, policy_version 177197 (0.0011) [2023-12-26 00:59:49,780][123091] Updated weights for policy 0, policy_version 177207 (0.0010) [2023-12-26 00:59:50,235][123090] Updated weights for policy 1, policy_version 176451 (0.0010) [2023-12-26 00:59:50,295][123090] Updated weights for policy 1, policy_version 176461 (0.0010) [2023-12-26 00:59:50,354][123090] Updated weights for policy 1, policy_version 176471 (0.0010) [2023-12-26 00:59:50,478][123091] Updated weights for policy 0, policy_version 177217 (0.0009) [2023-12-26 00:59:50,532][123091] Updated weights for policy 0, policy_version 177227 (0.0005) [2023-12-26 00:59:50,603][123091] Updated weights for policy 0, policy_version 177237 (0.0008) [2023-12-26 00:59:50,667][123091] Updated weights for policy 0, policy_version 177247 (0.0009) [2023-12-26 00:59:51,183][123090] Updated weights for policy 1, policy_version 176481 (0.0010) [2023-12-26 00:59:51,256][123090] Updated weights for policy 1, policy_version 176491 (0.0007) [2023-12-26 00:59:51,322][123090] Updated weights for policy 1, policy_version 176501 (0.0010) [2023-12-26 00:59:51,398][123090] Updated weights for policy 1, policy_version 176511 (0.0011) [2023-12-26 00:59:51,487][123091] Updated weights for policy 0, policy_version 177257 (0.0009) [2023-12-26 00:59:51,548][123091] Updated weights for policy 0, policy_version 177267 (0.0009) [2023-12-26 00:59:51,620][123091] Updated weights for policy 0, policy_version 177277 (0.0010) [2023-12-26 00:59:52,238][123090] Updated weights for policy 1, policy_version 176521 (0.0010) [2023-12-26 00:59:52,303][123090] Updated weights for policy 1, policy_version 176531 (0.0010) [2023-12-26 00:59:52,365][123090] Updated weights for policy 1, policy_version 176541 (0.0010) [2023-12-26 00:59:52,489][123091] Updated weights for policy 0, policy_version 177287 (0.0010) [2023-12-26 00:59:52,548][123091] Updated weights for policy 0, policy_version 177297 (0.0009) [2023-12-26 00:59:52,614][123091] Updated weights for policy 0, policy_version 177307 (0.0010) [2023-12-26 00:59:53,175][123090] Updated weights for policy 1, policy_version 176551 (0.0009) [2023-12-26 00:59:53,234][123090] Updated weights for policy 1, policy_version 176561 (0.0008) [2023-12-26 00:59:53,297][123090] Updated weights for policy 1, policy_version 176571 (0.0009) [2023-12-26 00:59:53,465][123091] Updated weights for policy 0, policy_version 177317 (0.0010) [2023-12-26 00:59:53,519][123091] Updated weights for policy 0, policy_version 177327 (0.0010) [2023-12-26 00:59:53,570][123091] Updated weights for policy 0, policy_version 177337 (0.0010) [2023-12-26 00:59:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 90603520. Throughput: 0: 8941.4, 1: 8788.0. Samples: 90578724. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:53,785][121949] Avg episode reward: [(0, '5766.808'), (1, '5028.741')] [2023-12-26 00:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000177344_45400064.pth... [2023-12-26 00:59:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000176576_45203456.pth... [2023-12-26 00:59:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000176320_45137920.pth [2023-12-26 00:59:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000175552_44941312.pth [2023-12-26 00:59:54,158][123090] Updated weights for policy 1, policy_version 176581 (0.0009) [2023-12-26 00:59:54,231][123090] Updated weights for policy 1, policy_version 176591 (0.0011) [2023-12-26 00:59:54,271][123091] Updated weights for policy 0, policy_version 177347 (0.0007) [2023-12-26 00:59:54,286][123090] Updated weights for policy 1, policy_version 176601 (0.0010) [2023-12-26 00:59:54,322][123091] Updated weights for policy 0, policy_version 177357 (0.0010) [2023-12-26 00:59:54,373][123091] Updated weights for policy 0, policy_version 177367 (0.0010) [2023-12-26 00:59:55,065][123090] Updated weights for policy 1, policy_version 176611 (0.0010) [2023-12-26 00:59:55,120][123090] Updated weights for policy 1, policy_version 176621 (0.0010) [2023-12-26 00:59:55,183][123090] Updated weights for policy 1, policy_version 176631 (0.0010) [2023-12-26 00:59:55,222][123091] Updated weights for policy 0, policy_version 177377 (0.0011) [2023-12-26 00:59:55,287][123091] Updated weights for policy 0, policy_version 177387 (0.0010) [2023-12-26 00:59:55,353][123091] Updated weights for policy 0, policy_version 177397 (0.0010) [2023-12-26 00:59:55,407][123091] Updated weights for policy 0, policy_version 177407 (0.0010) [2023-12-26 00:59:55,891][123090] Updated weights for policy 1, policy_version 176641 (0.0010) [2023-12-26 00:59:55,959][123090] Updated weights for policy 1, policy_version 176651 (0.0008) [2023-12-26 00:59:56,022][123090] Updated weights for policy 1, policy_version 176661 (0.0010) [2023-12-26 00:59:56,088][123090] Updated weights for policy 1, policy_version 176671 (0.0010) [2023-12-26 00:59:56,229][123091] Updated weights for policy 0, policy_version 177417 (0.0010) [2023-12-26 00:59:56,298][123091] Updated weights for policy 0, policy_version 177427 (0.0011) [2023-12-26 00:59:56,363][123091] Updated weights for policy 0, policy_version 177437 (0.0010) [2023-12-26 00:59:56,900][123090] Updated weights for policy 1, policy_version 176681 (0.0010) [2023-12-26 00:59:56,958][123090] Updated weights for policy 1, policy_version 176691 (0.0010) [2023-12-26 00:59:57,009][123090] Updated weights for policy 1, policy_version 176701 (0.0010) [2023-12-26 00:59:57,150][123091] Updated weights for policy 0, policy_version 177447 (0.0007) [2023-12-26 00:59:57,210][123091] Updated weights for policy 0, policy_version 177457 (0.0005) [2023-12-26 00:59:57,272][123091] Updated weights for policy 0, policy_version 177467 (0.0005) [2023-12-26 00:59:57,830][123090] Updated weights for policy 1, policy_version 176711 (0.0010) [2023-12-26 00:59:57,888][123090] Updated weights for policy 1, policy_version 176721 (0.0010) [2023-12-26 00:59:57,939][123090] Updated weights for policy 1, policy_version 176731 (0.0010) [2023-12-26 00:59:58,025][123091] Updated weights for policy 0, policy_version 177477 (0.0008) [2023-12-26 00:59:58,088][123091] Updated weights for policy 0, policy_version 177487 (0.0011) [2023-12-26 00:59:58,145][123091] Updated weights for policy 0, policy_version 177497 (0.0010) [2023-12-26 00:59:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 90685440. Throughput: 0: 8975.3, 1: 8827.0. Samples: 90684344. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 00:59:58,785][121949] Avg episode reward: [(0, '5707.169'), (1, '4972.452')] [2023-12-26 00:59:58,807][123090] Updated weights for policy 1, policy_version 176741 (0.0010) [2023-12-26 00:59:58,874][123090] Updated weights for policy 1, policy_version 176751 (0.0010) [2023-12-26 00:59:58,925][123091] Updated weights for policy 0, policy_version 177507 (0.0009) [2023-12-26 00:59:58,940][123090] Updated weights for policy 1, policy_version 176761 (0.0008) [2023-12-26 00:59:58,996][123091] Updated weights for policy 0, policy_version 177517 (0.0006) [2023-12-26 00:59:59,067][123091] Updated weights for policy 0, policy_version 177527 (0.0005) [2023-12-26 00:59:59,710][123091] Updated weights for policy 0, policy_version 177537 (0.0006) [2023-12-26 00:59:59,756][123090] Updated weights for policy 1, policy_version 176771 (0.0010) [2023-12-26 00:59:59,777][123091] Updated weights for policy 0, policy_version 177547 (0.0009) [2023-12-26 00:59:59,830][123090] Updated weights for policy 1, policy_version 176781 (0.0011) [2023-12-26 00:59:59,855][123091] Updated weights for policy 0, policy_version 177557 (0.0009) [2023-12-26 00:59:59,898][123090] Updated weights for policy 1, policy_version 176791 (0.0011) [2023-12-26 00:59:59,917][123091] Updated weights for policy 0, policy_version 177567 (0.0011) [2023-12-26 01:00:00,563][123091] Updated weights for policy 0, policy_version 177577 (0.0009) [2023-12-26 01:00:00,613][123091] Updated weights for policy 0, policy_version 177587 (0.0009) [2023-12-26 01:00:00,672][123091] Updated weights for policy 0, policy_version 177597 (0.0008) [2023-12-26 01:00:00,732][123090] Updated weights for policy 1, policy_version 176801 (0.0011) [2023-12-26 01:00:00,786][123090] Updated weights for policy 1, policy_version 176811 (0.0010) [2023-12-26 01:00:00,829][123090] Updated weights for policy 1, policy_version 176821 (0.0010) [2023-12-26 01:00:00,880][123090] Updated weights for policy 1, policy_version 176831 (0.0010) [2023-12-26 01:00:01,445][123091] Updated weights for policy 0, policy_version 177607 (0.0006) [2023-12-26 01:00:01,513][123091] Updated weights for policy 0, policy_version 177617 (0.0005) [2023-12-26 01:00:01,575][123091] Updated weights for policy 0, policy_version 177627 (0.0005) [2023-12-26 01:00:01,695][123090] Updated weights for policy 1, policy_version 176841 (0.0008) [2023-12-26 01:00:01,772][123090] Updated weights for policy 1, policy_version 176851 (0.0006) [2023-12-26 01:00:01,843][123090] Updated weights for policy 1, policy_version 176861 (0.0005) [2023-12-26 01:00:02,279][123091] Updated weights for policy 0, policy_version 177637 (0.0008) [2023-12-26 01:00:02,346][123091] Updated weights for policy 0, policy_version 177647 (0.0007) [2023-12-26 01:00:02,413][123091] Updated weights for policy 0, policy_version 177657 (0.0007) [2023-12-26 01:00:02,587][123090] Updated weights for policy 1, policy_version 176871 (0.0007) [2023-12-26 01:00:02,645][123090] Updated weights for policy 1, policy_version 176881 (0.0006) [2023-12-26 01:00:02,690][123090] Updated weights for policy 1, policy_version 176891 (0.0005) [2023-12-26 01:00:03,069][123091] Updated weights for policy 0, policy_version 177667 (0.0006) [2023-12-26 01:00:03,124][123091] Updated weights for policy 0, policy_version 177677 (0.0006) [2023-12-26 01:00:03,182][123091] Updated weights for policy 0, policy_version 177687 (0.0006) [2023-12-26 01:00:03,358][123090] Updated weights for policy 1, policy_version 176901 (0.0006) [2023-12-26 01:00:03,411][123090] Updated weights for policy 1, policy_version 176911 (0.0005) [2023-12-26 01:00:03,468][123090] Updated weights for policy 1, policy_version 176921 (0.0005) [2023-12-26 01:00:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 90783744. Throughput: 0: 8926.8, 1: 8785.3. Samples: 90795624. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:03,785][121949] Avg episode reward: [(0, '5675.399'), (1, '4957.965')] [2023-12-26 01:00:03,818][123091] Updated weights for policy 0, policy_version 177697 (0.0006) [2023-12-26 01:00:03,882][123091] Updated weights for policy 0, policy_version 177707 (0.0007) [2023-12-26 01:00:03,936][123091] Updated weights for policy 0, policy_version 177717 (0.0010) [2023-12-26 01:00:03,994][123091] Updated weights for policy 0, policy_version 177727 (0.0010) [2023-12-26 01:00:04,228][123090] Updated weights for policy 1, policy_version 176931 (0.0010) [2023-12-26 01:00:04,304][123090] Updated weights for policy 1, policy_version 176941 (0.0011) [2023-12-26 01:00:04,379][123090] Updated weights for policy 1, policy_version 176951 (0.0011) [2023-12-26 01:00:04,702][123091] Updated weights for policy 0, policy_version 177737 (0.0006) [2023-12-26 01:00:04,772][123091] Updated weights for policy 0, policy_version 177747 (0.0008) [2023-12-26 01:00:04,837][123091] Updated weights for policy 0, policy_version 177757 (0.0009) [2023-12-26 01:00:05,104][123090] Updated weights for policy 1, policy_version 176961 (0.0010) [2023-12-26 01:00:05,167][123090] Updated weights for policy 1, policy_version 176971 (0.0005) [2023-12-26 01:00:05,230][123090] Updated weights for policy 1, policy_version 176981 (0.0006) [2023-12-26 01:00:05,299][123090] Updated weights for policy 1, policy_version 176991 (0.0008) [2023-12-26 01:00:05,646][123091] Updated weights for policy 0, policy_version 177767 (0.0009) [2023-12-26 01:00:05,701][123091] Updated weights for policy 0, policy_version 177777 (0.0008) [2023-12-26 01:00:05,749][123091] Updated weights for policy 0, policy_version 177787 (0.0008) [2023-12-26 01:00:05,975][123090] Updated weights for policy 1, policy_version 177001 (0.0009) [2023-12-26 01:00:06,030][123090] Updated weights for policy 1, policy_version 177011 (0.0009) [2023-12-26 01:00:06,086][123090] Updated weights for policy 1, policy_version 177021 (0.0009) [2023-12-26 01:00:06,660][123091] Updated weights for policy 0, policy_version 177798 (0.0010) [2023-12-26 01:00:06,723][123091] Updated weights for policy 0, policy_version 177808 (0.0010) [2023-12-26 01:00:06,792][123091] Updated weights for policy 0, policy_version 177818 (0.0009) [2023-12-26 01:00:06,928][123090] Updated weights for policy 1, policy_version 177031 (0.0010) [2023-12-26 01:00:06,988][123090] Updated weights for policy 1, policy_version 177041 (0.0009) [2023-12-26 01:00:07,045][123090] Updated weights for policy 1, policy_version 177051 (0.0009) [2023-12-26 01:00:07,624][123091] Updated weights for policy 0, policy_version 177828 (0.0009) [2023-12-26 01:00:07,687][123091] Updated weights for policy 0, policy_version 177838 (0.0009) [2023-12-26 01:00:07,739][123091] Updated weights for policy 0, policy_version 177848 (0.0009) [2023-12-26 01:00:07,906][123090] Updated weights for policy 1, policy_version 177061 (0.0009) [2023-12-26 01:00:07,979][123090] Updated weights for policy 1, policy_version 177071 (0.0009) [2023-12-26 01:00:08,049][123090] Updated weights for policy 1, policy_version 177081 (0.0009) [2023-12-26 01:00:08,548][123091] Updated weights for policy 0, policy_version 177858 (0.0007) [2023-12-26 01:00:08,620][123091] Updated weights for policy 0, policy_version 177868 (0.0006) [2023-12-26 01:00:08,695][123091] Updated weights for policy 0, policy_version 177878 (0.0006) [2023-12-26 01:00:08,767][123091] Updated weights for policy 0, policy_version 177888 (0.0006) [2023-12-26 01:00:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 90873856. Throughput: 0: 8972.5, 1: 8802.1. Samples: 90849880. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:08,785][121949] Avg episode reward: [(0, '5719.831'), (1, '4980.957')] [2023-12-26 01:00:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000177888_45539328.pth... [2023-12-26 01:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000177088_45334528.pth... [2023-12-26 01:00:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000176832_45268992.pth [2023-12-26 01:00:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000176064_45072384.pth [2023-12-26 01:00:08,893][123090] Updated weights for policy 1, policy_version 177091 (0.0009) [2023-12-26 01:00:08,947][123090] Updated weights for policy 1, policy_version 177102 (0.0010) [2023-12-26 01:00:09,016][123090] Updated weights for policy 1, policy_version 177112 (0.0009) [2023-12-26 01:00:09,383][123091] Updated weights for policy 0, policy_version 177898 (0.0010) [2023-12-26 01:00:09,450][123091] Updated weights for policy 0, policy_version 177908 (0.0010) [2023-12-26 01:00:09,512][123091] Updated weights for policy 0, policy_version 177918 (0.0009) [2023-12-26 01:00:09,906][123090] Updated weights for policy 1, policy_version 177122 (0.0009) [2023-12-26 01:00:09,974][123090] Updated weights for policy 1, policy_version 177132 (0.0009) [2023-12-26 01:00:10,035][123090] Updated weights for policy 1, policy_version 177142 (0.0009) [2023-12-26 01:00:10,098][123090] Updated weights for policy 1, policy_version 177152 (0.0008) [2023-12-26 01:00:10,411][123091] Updated weights for policy 0, policy_version 177928 (0.0010) [2023-12-26 01:00:10,467][123091] Updated weights for policy 0, policy_version 177938 (0.0010) [2023-12-26 01:00:10,527][123091] Updated weights for policy 0, policy_version 177948 (0.0009) [2023-12-26 01:00:10,939][123090] Updated weights for policy 1, policy_version 177163 (0.0010) [2023-12-26 01:00:10,995][123090] Updated weights for policy 1, policy_version 177173 (0.0007) [2023-12-26 01:00:11,063][123090] Updated weights for policy 1, policy_version 177183 (0.0010) [2023-12-26 01:00:11,345][123091] Updated weights for policy 0, policy_version 177958 (0.0010) [2023-12-26 01:00:11,423][123091] Updated weights for policy 0, policy_version 177968 (0.0011) [2023-12-26 01:00:11,473][123091] Updated weights for policy 0, policy_version 177978 (0.0010) [2023-12-26 01:00:11,954][123090] Updated weights for policy 1, policy_version 177193 (0.0008) [2023-12-26 01:00:12,014][123090] Updated weights for policy 1, policy_version 177203 (0.0008) [2023-12-26 01:00:12,064][123090] Updated weights for policy 1, policy_version 177213 (0.0008) [2023-12-26 01:00:12,209][123091] Updated weights for policy 0, policy_version 177988 (0.0008) [2023-12-26 01:00:12,284][123091] Updated weights for policy 0, policy_version 177998 (0.0011) [2023-12-26 01:00:12,357][123091] Updated weights for policy 0, policy_version 178008 (0.0011) [2023-12-26 01:00:12,869][123090] Updated weights for policy 1, policy_version 177223 (0.0006) [2023-12-26 01:00:12,933][123090] Updated weights for policy 1, policy_version 177233 (0.0006) [2023-12-26 01:00:13,000][123090] Updated weights for policy 1, policy_version 177243 (0.0007) [2023-12-26 01:00:13,154][123091] Updated weights for policy 0, policy_version 178018 (0.0010) [2023-12-26 01:00:13,215][123091] Updated weights for policy 0, policy_version 178028 (0.0009) [2023-12-26 01:00:13,273][123091] Updated weights for policy 0, policy_version 178038 (0.0009) [2023-12-26 01:00:13,332][123091] Updated weights for policy 0, policy_version 178048 (0.0009) [2023-12-26 01:00:13,781][123090] Updated weights for policy 1, policy_version 177253 (0.0009) [2023-12-26 01:00:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 90955776. Throughput: 0: 8951.6, 1: 8723.2. Samples: 90952060. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:13,785][121949] Avg episode reward: [(0, '5738.915'), (1, '4991.326')] [2023-12-26 01:00:13,839][123090] Updated weights for policy 1, policy_version 177263 (0.0005) [2023-12-26 01:00:13,911][123090] Updated weights for policy 1, policy_version 177273 (0.0005) [2023-12-26 01:00:14,157][123091] Updated weights for policy 0, policy_version 178058 (0.0006) [2023-12-26 01:00:14,227][123091] Updated weights for policy 0, policy_version 178068 (0.0006) [2023-12-26 01:00:14,300][123091] Updated weights for policy 0, policy_version 178078 (0.0006) [2023-12-26 01:00:14,596][123090] Updated weights for policy 1, policy_version 177283 (0.0006) [2023-12-26 01:00:14,658][123090] Updated weights for policy 1, policy_version 177293 (0.0009) [2023-12-26 01:00:14,722][123090] Updated weights for policy 1, policy_version 177303 (0.0009) [2023-12-26 01:00:14,924][123091] Updated weights for policy 0, policy_version 178088 (0.0010) [2023-12-26 01:00:14,994][123091] Updated weights for policy 0, policy_version 178098 (0.0006) [2023-12-26 01:00:15,061][123091] Updated weights for policy 0, policy_version 178108 (0.0008) [2023-12-26 01:00:15,650][123090] Updated weights for policy 1, policy_version 177313 (0.0009) [2023-12-26 01:00:15,707][123090] Updated weights for policy 1, policy_version 177323 (0.0009) [2023-12-26 01:00:15,736][123091] Updated weights for policy 0, policy_version 178118 (0.0005) [2023-12-26 01:00:15,765][123090] Updated weights for policy 1, policy_version 177333 (0.0009) [2023-12-26 01:00:15,803][123091] Updated weights for policy 0, policy_version 178128 (0.0006) [2023-12-26 01:00:15,817][123090] Updated weights for policy 1, policy_version 177343 (0.0009) [2023-12-26 01:00:15,870][123091] Updated weights for policy 0, policy_version 178138 (0.0005) [2023-12-26 01:00:16,508][123091] Updated weights for policy 0, policy_version 178148 (0.0008) [2023-12-26 01:00:16,570][123091] Updated weights for policy 0, policy_version 178158 (0.0010) [2023-12-26 01:00:16,613][123091] Updated weights for policy 0, policy_version 178168 (0.0010) [2023-12-26 01:00:16,742][123090] Updated weights for policy 1, policy_version 177353 (0.0009) [2023-12-26 01:00:16,790][123090] Updated weights for policy 1, policy_version 177363 (0.0009) [2023-12-26 01:00:16,849][123090] Updated weights for policy 1, policy_version 177373 (0.0008) [2023-12-26 01:00:17,390][123091] Updated weights for policy 0, policy_version 178178 (0.0009) [2023-12-26 01:00:17,459][123091] Updated weights for policy 0, policy_version 178188 (0.0005) [2023-12-26 01:00:17,512][123091] Updated weights for policy 0, policy_version 178198 (0.0005) [2023-12-26 01:00:17,568][123091] Updated weights for policy 0, policy_version 178208 (0.0008) [2023-12-26 01:00:17,738][123090] Updated weights for policy 1, policy_version 177383 (0.0009) [2023-12-26 01:00:17,802][123090] Updated weights for policy 1, policy_version 177393 (0.0008) [2023-12-26 01:00:17,853][123090] Updated weights for policy 1, policy_version 177403 (0.0009) [2023-12-26 01:00:18,319][123091] Updated weights for policy 0, policy_version 178218 (0.0009) [2023-12-26 01:00:18,397][123091] Updated weights for policy 0, policy_version 178228 (0.0010) [2023-12-26 01:00:18,476][123091] Updated weights for policy 0, policy_version 178238 (0.0011) [2023-12-26 01:00:18,713][123090] Updated weights for policy 1, policy_version 177413 (0.0009) [2023-12-26 01:00:18,782][123090] Updated weights for policy 1, policy_version 177423 (0.0009) [2023-12-26 01:00:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17800.3). Total num frames: 91045888. Throughput: 0: 9037.5, 1: 8702.1. Samples: 91059064. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:18,785][121949] Avg episode reward: [(0, '5730.379'), (1, '4984.263')] [2023-12-26 01:00:18,850][123090] Updated weights for policy 1, policy_version 177433 (0.0009) [2023-12-26 01:00:19,321][123091] Updated weights for policy 0, policy_version 178248 (0.0009) [2023-12-26 01:00:19,395][123091] Updated weights for policy 0, policy_version 178258 (0.0010) [2023-12-26 01:00:19,466][123091] Updated weights for policy 0, policy_version 178268 (0.0009) [2023-12-26 01:00:19,677][123090] Updated weights for policy 1, policy_version 177443 (0.0009) [2023-12-26 01:00:19,737][123090] Updated weights for policy 1, policy_version 177453 (0.0006) [2023-12-26 01:00:19,795][123090] Updated weights for policy 1, policy_version 177463 (0.0005) [2023-12-26 01:00:20,330][123091] Updated weights for policy 0, policy_version 178278 (0.0010) [2023-12-26 01:00:20,397][123091] Updated weights for policy 0, policy_version 178288 (0.0010) [2023-12-26 01:00:20,463][123091] Updated weights for policy 0, policy_version 178298 (0.0010) [2023-12-26 01:00:20,551][123090] Updated weights for policy 1, policy_version 177473 (0.0007) [2023-12-26 01:00:20,617][123090] Updated weights for policy 1, policy_version 177483 (0.0009) [2023-12-26 01:00:20,686][123090] Updated weights for policy 1, policy_version 177493 (0.0009) [2023-12-26 01:00:20,759][123090] Updated weights for policy 1, policy_version 177503 (0.0010) [2023-12-26 01:00:21,235][123091] Updated weights for policy 0, policy_version 178308 (0.0010) [2023-12-26 01:00:21,301][123091] Updated weights for policy 0, policy_version 178318 (0.0007) [2023-12-26 01:00:21,378][123091] Updated weights for policy 0, policy_version 178328 (0.0008) [2023-12-26 01:00:21,654][123090] Updated weights for policy 1, policy_version 177513 (0.0009) [2023-12-26 01:00:21,728][123090] Updated weights for policy 1, policy_version 177523 (0.0009) [2023-12-26 01:00:21,790][123090] Updated weights for policy 1, policy_version 177533 (0.0010) [2023-12-26 01:00:22,136][123091] Updated weights for policy 0, policy_version 178338 (0.0008) [2023-12-26 01:00:22,193][123091] Updated weights for policy 0, policy_version 178348 (0.0009) [2023-12-26 01:00:22,246][123091] Updated weights for policy 0, policy_version 178358 (0.0009) [2023-12-26 01:00:22,314][123091] Updated weights for policy 0, policy_version 178368 (0.0010) [2023-12-26 01:00:22,648][123090] Updated weights for policy 1, policy_version 177543 (0.0008) [2023-12-26 01:00:22,711][123090] Updated weights for policy 1, policy_version 177553 (0.0006) [2023-12-26 01:00:22,776][123090] Updated weights for policy 1, policy_version 177563 (0.0007) [2023-12-26 01:00:23,059][123091] Updated weights for policy 0, policy_version 178378 (0.0010) [2023-12-26 01:00:23,123][123091] Updated weights for policy 0, policy_version 178388 (0.0009) [2023-12-26 01:00:23,196][123091] Updated weights for policy 0, policy_version 178398 (0.0009) [2023-12-26 01:00:23,534][123090] Updated weights for policy 1, policy_version 177573 (0.0009) [2023-12-26 01:00:23,584][123090] Updated weights for policy 1, policy_version 177583 (0.0009) [2023-12-26 01:00:23,638][123090] Updated weights for policy 1, policy_version 177593 (0.0009) [2023-12-26 01:00:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 91136000. Throughput: 0: 9016.1, 1: 8636.1. Samples: 91109884. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:23,785][121949] Avg episode reward: [(0, '5506.976'), (1, '4950.736')] [2023-12-26 01:00:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000177600_45465600.pth... [2023-12-26 01:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000178400_45670400.pth... [2023-12-26 01:00:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000176576_45203456.pth [2023-12-26 01:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000177344_45400064.pth [2023-12-26 01:00:24,032][123091] Updated weights for policy 0, policy_version 178408 (0.0009) [2023-12-26 01:00:24,085][123091] Updated weights for policy 0, policy_version 178418 (0.0009) [2023-12-26 01:00:24,152][123091] Updated weights for policy 0, policy_version 178428 (0.0009) [2023-12-26 01:00:24,502][123090] Updated weights for policy 1, policy_version 177603 (0.0010) [2023-12-26 01:00:24,549][123090] Updated weights for policy 1, policy_version 177613 (0.0010) [2023-12-26 01:00:24,608][123090] Updated weights for policy 1, policy_version 177623 (0.0010) [2023-12-26 01:00:25,034][123091] Updated weights for policy 0, policy_version 178438 (0.0009) [2023-12-26 01:00:25,088][123091] Updated weights for policy 0, policy_version 178448 (0.0008) [2023-12-26 01:00:25,140][123091] Updated weights for policy 0, policy_version 178458 (0.0005) [2023-12-26 01:00:25,281][123090] Updated weights for policy 1, policy_version 177633 (0.0007) [2023-12-26 01:00:25,328][123090] Updated weights for policy 1, policy_version 177643 (0.0010) [2023-12-26 01:00:25,375][123090] Updated weights for policy 1, policy_version 177653 (0.0010) [2023-12-26 01:00:25,419][123090] Updated weights for policy 1, policy_version 177663 (0.0010) [2023-12-26 01:00:25,880][123091] Updated weights for policy 0, policy_version 178468 (0.0005) [2023-12-26 01:00:25,945][123091] Updated weights for policy 0, policy_version 178478 (0.0005) [2023-12-26 01:00:25,994][123091] Updated weights for policy 0, policy_version 178488 (0.0005) [2023-12-26 01:00:26,141][123090] Updated weights for policy 1, policy_version 177673 (0.0006) [2023-12-26 01:00:26,196][123090] Updated weights for policy 1, policy_version 177683 (0.0005) [2023-12-26 01:00:26,245][123090] Updated weights for policy 1, policy_version 177693 (0.0006) [2023-12-26 01:00:26,740][123091] Updated weights for policy 0, policy_version 178498 (0.0006) [2023-12-26 01:00:26,798][123091] Updated weights for policy 0, policy_version 178508 (0.0010) [2023-12-26 01:00:26,849][123091] Updated weights for policy 0, policy_version 178518 (0.0010) [2023-12-26 01:00:26,908][123091] Updated weights for policy 0, policy_version 178528 (0.0010) [2023-12-26 01:00:26,959][123090] Updated weights for policy 1, policy_version 177703 (0.0005) [2023-12-26 01:00:27,031][123090] Updated weights for policy 1, policy_version 177713 (0.0007) [2023-12-26 01:00:27,098][123090] Updated weights for policy 1, policy_version 177723 (0.0010) [2023-12-26 01:00:27,639][123091] Updated weights for policy 0, policy_version 178538 (0.0005) [2023-12-26 01:00:27,685][123091] Updated weights for policy 0, policy_version 178548 (0.0005) [2023-12-26 01:00:27,730][123091] Updated weights for policy 0, policy_version 178558 (0.0005) [2023-12-26 01:00:27,774][123090] Updated weights for policy 1, policy_version 177733 (0.0008) [2023-12-26 01:00:27,827][123090] Updated weights for policy 1, policy_version 177743 (0.0005) [2023-12-26 01:00:27,886][123090] Updated weights for policy 1, policy_version 177753 (0.0005) [2023-12-26 01:00:28,423][123091] Updated weights for policy 0, policy_version 178568 (0.0006) [2023-12-26 01:00:28,488][123091] Updated weights for policy 0, policy_version 178578 (0.0006) [2023-12-26 01:00:28,558][123091] Updated weights for policy 0, policy_version 178588 (0.0005) [2023-12-26 01:00:28,566][123090] Updated weights for policy 1, policy_version 177763 (0.0007) [2023-12-26 01:00:28,633][123090] Updated weights for policy 1, policy_version 177773 (0.0010) [2023-12-26 01:00:28,696][123090] Updated weights for policy 1, policy_version 177783 (0.0010) [2023-12-26 01:00:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 91234304. Throughput: 0: 9088.2, 1: 8762.1. Samples: 91219872. Policy #0 lag: (min: 31.0, avg: 33.5, max: 63.0) [2023-12-26 01:00:28,785][121949] Avg episode reward: [(0, '5412.721'), (1, '5149.713')] [2023-12-26 01:00:29,306][123091] Updated weights for policy 0, policy_version 178598 (0.0008) [2023-12-26 01:00:29,373][123091] Updated weights for policy 0, policy_version 178608 (0.0009) [2023-12-26 01:00:29,408][123090] Updated weights for policy 1, policy_version 177793 (0.0010) [2023-12-26 01:00:29,437][123091] Updated weights for policy 0, policy_version 178618 (0.0006) [2023-12-26 01:00:29,469][123090] Updated weights for policy 1, policy_version 177803 (0.0009) [2023-12-26 01:00:29,531][123090] Updated weights for policy 1, policy_version 177813 (0.0009) [2023-12-26 01:00:29,588][123090] Updated weights for policy 1, policy_version 177823 (0.0009) [2023-12-26 01:00:30,268][123091] Updated weights for policy 0, policy_version 178628 (0.0007) [2023-12-26 01:00:30,335][123091] Updated weights for policy 0, policy_version 178638 (0.0009) [2023-12-26 01:00:30,371][123090] Updated weights for policy 1, policy_version 177833 (0.0010) [2023-12-26 01:00:30,394][123091] Updated weights for policy 0, policy_version 178648 (0.0008) [2023-12-26 01:00:30,424][123090] Updated weights for policy 1, policy_version 177843 (0.0009) [2023-12-26 01:00:30,472][123090] Updated weights for policy 1, policy_version 177853 (0.0009) [2023-12-26 01:00:31,130][123091] Updated weights for policy 0, policy_version 178658 (0.0009) [2023-12-26 01:00:31,193][123091] Updated weights for policy 0, policy_version 178668 (0.0007) [2023-12-26 01:00:31,270][123091] Updated weights for policy 0, policy_version 178678 (0.0006) [2023-12-26 01:00:31,325][123091] Updated weights for policy 0, policy_version 178688 (0.0005) [2023-12-26 01:00:31,339][123090] Updated weights for policy 1, policy_version 177863 (0.0010) [2023-12-26 01:00:31,404][123090] Updated weights for policy 1, policy_version 177873 (0.0009) [2023-12-26 01:00:31,461][123090] Updated weights for policy 1, policy_version 177883 (0.0009) [2023-12-26 01:00:32,028][123091] Updated weights for policy 0, policy_version 178698 (0.0009) [2023-12-26 01:00:32,090][123091] Updated weights for policy 0, policy_version 178708 (0.0005) [2023-12-26 01:00:32,159][123091] Updated weights for policy 0, policy_version 178718 (0.0005) [2023-12-26 01:00:32,339][123090] Updated weights for policy 1, policy_version 177893 (0.0007) [2023-12-26 01:00:32,405][123090] Updated weights for policy 1, policy_version 177903 (0.0006) [2023-12-26 01:00:32,466][123090] Updated weights for policy 1, policy_version 177913 (0.0006) [2023-12-26 01:00:32,883][123091] Updated weights for policy 0, policy_version 178728 (0.0009) [2023-12-26 01:00:32,932][123091] Updated weights for policy 0, policy_version 178738 (0.0007) [2023-12-26 01:00:32,986][123091] Updated weights for policy 0, policy_version 178748 (0.0006) [2023-12-26 01:00:33,162][123090] Updated weights for policy 1, policy_version 177923 (0.0007) [2023-12-26 01:00:33,220][123090] Updated weights for policy 1, policy_version 177933 (0.0008) [2023-12-26 01:00:33,268][123090] Updated weights for policy 1, policy_version 177943 (0.0005) [2023-12-26 01:00:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 91316224. Throughput: 0: 9087.9, 1: 8776.1. Samples: 91330144. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:33,785][121949] Avg episode reward: [(0, '5456.042'), (1, '5310.985')] [2023-12-26 01:00:33,799][123091] Updated weights for policy 0, policy_version 178758 (0.0007) [2023-12-26 01:00:33,855][123091] Updated weights for policy 0, policy_version 178768 (0.0007) [2023-12-26 01:00:33,906][123091] Updated weights for policy 0, policy_version 178778 (0.0008) [2023-12-26 01:00:33,997][123090] Updated weights for policy 1, policy_version 177953 (0.0006) [2023-12-26 01:00:34,049][123090] Updated weights for policy 1, policy_version 177963 (0.0006) [2023-12-26 01:00:34,100][123090] Updated weights for policy 1, policy_version 177973 (0.0005) [2023-12-26 01:00:34,156][123090] Updated weights for policy 1, policy_version 177983 (0.0009) [2023-12-26 01:00:34,595][123091] Updated weights for policy 0, policy_version 178788 (0.0007) [2023-12-26 01:00:34,661][123091] Updated weights for policy 0, policy_version 178798 (0.0008) [2023-12-26 01:00:34,731][123091] Updated weights for policy 0, policy_version 178808 (0.0008) [2023-12-26 01:00:35,040][123090] Updated weights for policy 1, policy_version 177993 (0.0009) [2023-12-26 01:00:35,100][123090] Updated weights for policy 1, policy_version 178003 (0.0009) [2023-12-26 01:00:35,148][123090] Updated weights for policy 1, policy_version 178013 (0.0008) [2023-12-26 01:00:35,413][123091] Updated weights for policy 0, policy_version 178818 (0.0009) [2023-12-26 01:00:35,460][123091] Updated weights for policy 0, policy_version 178828 (0.0010) [2023-12-26 01:00:35,504][123091] Updated weights for policy 0, policy_version 178838 (0.0010) [2023-12-26 01:00:35,551][123091] Updated weights for policy 0, policy_version 178848 (0.0010) [2023-12-26 01:00:35,968][123090] Updated weights for policy 1, policy_version 178023 (0.0010) [2023-12-26 01:00:36,026][123090] Updated weights for policy 1, policy_version 178033 (0.0008) [2023-12-26 01:00:36,086][123090] Updated weights for policy 1, policy_version 178043 (0.0009) [2023-12-26 01:00:36,397][123091] Updated weights for policy 0, policy_version 178858 (0.0011) [2023-12-26 01:00:36,461][123091] Updated weights for policy 0, policy_version 178868 (0.0011) [2023-12-26 01:00:36,525][123091] Updated weights for policy 0, policy_version 178878 (0.0011) [2023-12-26 01:00:36,934][123090] Updated weights for policy 1, policy_version 178053 (0.0010) [2023-12-26 01:00:37,000][123090] Updated weights for policy 1, policy_version 178063 (0.0009) [2023-12-26 01:00:37,060][123090] Updated weights for policy 1, policy_version 178073 (0.0009) [2023-12-26 01:00:37,358][123091] Updated weights for policy 0, policy_version 178888 (0.0011) [2023-12-26 01:00:37,421][123091] Updated weights for policy 0, policy_version 178898 (0.0011) [2023-12-26 01:00:37,485][123091] Updated weights for policy 0, policy_version 178908 (0.0011) [2023-12-26 01:00:37,889][123090] Updated weights for policy 1, policy_version 178083 (0.0008) [2023-12-26 01:00:37,943][123090] Updated weights for policy 1, policy_version 178093 (0.0009) [2023-12-26 01:00:38,013][123090] Updated weights for policy 1, policy_version 178103 (0.0009) [2023-12-26 01:00:38,314][123091] Updated weights for policy 0, policy_version 178918 (0.0011) [2023-12-26 01:00:38,382][123091] Updated weights for policy 0, policy_version 178928 (0.0011) [2023-12-26 01:00:38,445][123091] Updated weights for policy 0, policy_version 178938 (0.0010) [2023-12-26 01:00:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 91406336. Throughput: 0: 9110.8, 1: 8798.3. Samples: 91384632. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:38,785][121949] Avg episode reward: [(0, '5386.045'), (1, '5148.668')] [2023-12-26 01:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000178944_45809664.pth... [2023-12-26 01:00:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000178112_45596672.pth... [2023-12-26 01:00:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000177088_45334528.pth [2023-12-26 01:00:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000177888_45539328.pth [2023-12-26 01:00:38,893][123090] Updated weights for policy 1, policy_version 178113 (0.0009) [2023-12-26 01:00:38,965][123090] Updated weights for policy 1, policy_version 178123 (0.0009) [2023-12-26 01:00:39,029][123090] Updated weights for policy 1, policy_version 178133 (0.0009) [2023-12-26 01:00:39,098][123090] Updated weights for policy 1, policy_version 178143 (0.0009) [2023-12-26 01:00:39,266][123091] Updated weights for policy 0, policy_version 178948 (0.0011) [2023-12-26 01:00:39,317][123091] Updated weights for policy 0, policy_version 178958 (0.0011) [2023-12-26 01:00:39,385][123091] Updated weights for policy 0, policy_version 178968 (0.0009) [2023-12-26 01:00:39,908][123090] Updated weights for policy 1, policy_version 178153 (0.0008) [2023-12-26 01:00:39,965][123090] Updated weights for policy 1, policy_version 178163 (0.0010) [2023-12-26 01:00:40,018][123090] Updated weights for policy 1, policy_version 178173 (0.0010) [2023-12-26 01:00:40,145][123091] Updated weights for policy 0, policy_version 178978 (0.0008) [2023-12-26 01:00:40,208][123091] Updated weights for policy 0, policy_version 178988 (0.0011) [2023-12-26 01:00:40,268][123091] Updated weights for policy 0, policy_version 178998 (0.0009) [2023-12-26 01:00:40,337][123091] Updated weights for policy 0, policy_version 179008 (0.0006) [2023-12-26 01:00:40,851][123090] Updated weights for policy 1, policy_version 178183 (0.0010) [2023-12-26 01:00:40,912][123090] Updated weights for policy 1, policy_version 178193 (0.0009) [2023-12-26 01:00:40,969][123090] Updated weights for policy 1, policy_version 178203 (0.0005) [2023-12-26 01:00:41,036][123091] Updated weights for policy 0, policy_version 179018 (0.0011) [2023-12-26 01:00:41,106][123091] Updated weights for policy 0, policy_version 179028 (0.0011) [2023-12-26 01:00:41,179][123091] Updated weights for policy 0, policy_version 179038 (0.0011) [2023-12-26 01:00:41,772][123090] Updated weights for policy 1, policy_version 178213 (0.0008) [2023-12-26 01:00:41,833][123090] Updated weights for policy 1, policy_version 178223 (0.0011) [2023-12-26 01:00:41,895][123090] Updated weights for policy 1, policy_version 178233 (0.0010) [2023-12-26 01:00:42,014][123091] Updated weights for policy 0, policy_version 179048 (0.0011) [2023-12-26 01:00:42,078][123091] Updated weights for policy 0, policy_version 179058 (0.0011) [2023-12-26 01:00:42,134][123091] Updated weights for policy 0, policy_version 179068 (0.0011) [2023-12-26 01:00:42,661][123090] Updated weights for policy 1, policy_version 178243 (0.0010) [2023-12-26 01:00:42,709][123090] Updated weights for policy 1, policy_version 178253 (0.0010) [2023-12-26 01:00:42,761][123090] Updated weights for policy 1, policy_version 178263 (0.0010) [2023-12-26 01:00:42,972][123091] Updated weights for policy 0, policy_version 179078 (0.0010) [2023-12-26 01:00:43,023][123091] Updated weights for policy 0, policy_version 179088 (0.0009) [2023-12-26 01:00:43,078][123091] Updated weights for policy 0, policy_version 179098 (0.0009) [2023-12-26 01:00:43,560][123090] Updated weights for policy 1, policy_version 178273 (0.0010) [2023-12-26 01:00:43,608][123090] Updated weights for policy 1, policy_version 178283 (0.0009) [2023-12-26 01:00:43,656][123090] Updated weights for policy 1, policy_version 178293 (0.0009) [2023-12-26 01:00:43,711][123090] Updated weights for policy 1, policy_version 178303 (0.0008) [2023-12-26 01:00:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 91496448. Throughput: 0: 9089.1, 1: 8766.2. Samples: 91487836. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:43,785][121949] Avg episode reward: [(0, '5397.842'), (1, '4925.435')] [2023-12-26 01:00:43,934][123091] Updated weights for policy 0, policy_version 179108 (0.0009) [2023-12-26 01:00:43,985][123091] Updated weights for policy 0, policy_version 179118 (0.0010) [2023-12-26 01:00:44,043][123091] Updated weights for policy 0, policy_version 179128 (0.0010) [2023-12-26 01:00:44,579][123090] Updated weights for policy 1, policy_version 178313 (0.0009) [2023-12-26 01:00:44,640][123090] Updated weights for policy 1, policy_version 178323 (0.0008) [2023-12-26 01:00:44,704][123090] Updated weights for policy 1, policy_version 178333 (0.0009) [2023-12-26 01:00:44,885][123091] Updated weights for policy 0, policy_version 179138 (0.0011) [2023-12-26 01:00:44,953][123091] Updated weights for policy 0, policy_version 179148 (0.0011) [2023-12-26 01:00:45,009][123091] Updated weights for policy 0, policy_version 179158 (0.0011) [2023-12-26 01:00:45,061][123091] Updated weights for policy 0, policy_version 179168 (0.0011) [2023-12-26 01:00:45,556][123090] Updated weights for policy 1, policy_version 178343 (0.0009) [2023-12-26 01:00:45,613][123090] Updated weights for policy 1, policy_version 178353 (0.0008) [2023-12-26 01:00:45,667][123090] Updated weights for policy 1, policy_version 178363 (0.0009) [2023-12-26 01:00:45,904][123091] Updated weights for policy 0, policy_version 179178 (0.0011) [2023-12-26 01:00:45,960][123091] Updated weights for policy 0, policy_version 179188 (0.0011) [2023-12-26 01:00:46,012][123091] Updated weights for policy 0, policy_version 179198 (0.0011) [2023-12-26 01:00:46,516][123090] Updated weights for policy 1, policy_version 178373 (0.0010) [2023-12-26 01:00:46,575][123090] Updated weights for policy 1, policy_version 178383 (0.0010) [2023-12-26 01:00:46,627][123090] Updated weights for policy 1, policy_version 178393 (0.0010) [2023-12-26 01:00:46,788][123091] Updated weights for policy 0, policy_version 179208 (0.0006) [2023-12-26 01:00:46,846][123091] Updated weights for policy 0, policy_version 179218 (0.0005) [2023-12-26 01:00:46,919][123091] Updated weights for policy 0, policy_version 179228 (0.0005) [2023-12-26 01:00:47,324][123090] Updated weights for policy 1, policy_version 178403 (0.0009) [2023-12-26 01:00:47,387][123090] Updated weights for policy 1, policy_version 178413 (0.0010) [2023-12-26 01:00:47,442][123090] Updated weights for policy 1, policy_version 178423 (0.0010) [2023-12-26 01:00:47,648][123091] Updated weights for policy 0, policy_version 179238 (0.0009) [2023-12-26 01:00:47,699][123091] Updated weights for policy 0, policy_version 179248 (0.0010) [2023-12-26 01:00:47,750][123091] Updated weights for policy 0, policy_version 179258 (0.0010) [2023-12-26 01:00:48,239][123090] Updated weights for policy 1, policy_version 178433 (0.0010) [2023-12-26 01:00:48,292][123090] Updated weights for policy 1, policy_version 178443 (0.0010) [2023-12-26 01:00:48,357][123090] Updated weights for policy 1, policy_version 178453 (0.0010) [2023-12-26 01:00:48,421][123090] Updated weights for policy 1, policy_version 178463 (0.0010) [2023-12-26 01:00:48,567][123091] Updated weights for policy 0, policy_version 179268 (0.0008) [2023-12-26 01:00:48,628][123091] Updated weights for policy 0, policy_version 179278 (0.0011) [2023-12-26 01:00:48,686][123091] Updated weights for policy 0, policy_version 179288 (0.0011) [2023-12-26 01:00:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 91586560. Throughput: 0: 8988.6, 1: 8734.8. Samples: 91593176. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:48,785][121949] Avg episode reward: [(0, '5358.171'), (1, '5117.429')] [2023-12-26 01:00:49,328][123090] Updated weights for policy 1, policy_version 178473 (0.0008) [2023-12-26 01:00:49,400][123090] Updated weights for policy 1, policy_version 178483 (0.0009) [2023-12-26 01:00:49,464][123091] Updated weights for policy 0, policy_version 179298 (0.0011) [2023-12-26 01:00:49,469][123090] Updated weights for policy 1, policy_version 178493 (0.0009) [2023-12-26 01:00:49,532][123091] Updated weights for policy 0, policy_version 179308 (0.0011) [2023-12-26 01:00:49,596][123091] Updated weights for policy 0, policy_version 179318 (0.0011) [2023-12-26 01:00:49,668][123091] Updated weights for policy 0, policy_version 179328 (0.0011) [2023-12-26 01:00:50,318][123090] Updated weights for policy 1, policy_version 178503 (0.0009) [2023-12-26 01:00:50,373][123090] Updated weights for policy 1, policy_version 178513 (0.0008) [2023-12-26 01:00:50,440][123090] Updated weights for policy 1, policy_version 178523 (0.0008) [2023-12-26 01:00:50,501][123091] Updated weights for policy 0, policy_version 179338 (0.0008) [2023-12-26 01:00:50,570][123091] Updated weights for policy 0, policy_version 179348 (0.0009) [2023-12-26 01:00:50,644][123091] Updated weights for policy 0, policy_version 179358 (0.0009) [2023-12-26 01:00:51,310][123090] Updated weights for policy 1, policy_version 178533 (0.0010) [2023-12-26 01:00:51,377][123090] Updated weights for policy 1, policy_version 178543 (0.0009) [2023-12-26 01:00:51,431][123091] Updated weights for policy 0, policy_version 179368 (0.0007) [2023-12-26 01:00:51,453][123090] Updated weights for policy 1, policy_version 178553 (0.0009) [2023-12-26 01:00:51,504][123091] Updated weights for policy 0, policy_version 179378 (0.0008) [2023-12-26 01:00:51,578][123091] Updated weights for policy 0, policy_version 179388 (0.0009) [2023-12-26 01:00:52,346][123090] Updated weights for policy 1, policy_version 178563 (0.0009) [2023-12-26 01:00:52,423][123090] Updated weights for policy 1, policy_version 178573 (0.0011) [2023-12-26 01:00:52,482][123090] Updated weights for policy 1, policy_version 178583 (0.0008) [2023-12-26 01:00:52,486][123091] Updated weights for policy 0, policy_version 179398 (0.0007) [2023-12-26 01:00:52,554][123091] Updated weights for policy 0, policy_version 179408 (0.0006) [2023-12-26 01:00:52,617][123091] Updated weights for policy 0, policy_version 179418 (0.0006) [2023-12-26 01:00:53,192][123090] Updated weights for policy 1, policy_version 178593 (0.0008) [2023-12-26 01:00:53,252][123090] Updated weights for policy 1, policy_version 178603 (0.0006) [2023-12-26 01:00:53,325][123090] Updated weights for policy 1, policy_version 178613 (0.0006) [2023-12-26 01:00:53,332][123091] Updated weights for policy 0, policy_version 179428 (0.0007) [2023-12-26 01:00:53,389][123091] Updated weights for policy 0, policy_version 179438 (0.0009) [2023-12-26 01:00:53,395][123090] Updated weights for policy 1, policy_version 178623 (0.0010) [2023-12-26 01:00:53,454][123091] Updated weights for policy 0, policy_version 179448 (0.0009) [2023-12-26 01:00:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 91668480. Throughput: 0: 8964.5, 1: 8662.9. Samples: 91643108. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:53,784][121949] Avg episode reward: [(0, '5219.327'), (1, '5328.661')] [2023-12-26 01:00:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000179456_45940736.pth... [2023-12-26 01:00:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000178624_45727744.pth... [2023-12-26 01:00:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000177600_45465600.pth [2023-12-26 01:00:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000178400_45670400.pth [2023-12-26 01:00:54,147][123090] Updated weights for policy 1, policy_version 178633 (0.0010) [2023-12-26 01:00:54,199][123090] Updated weights for policy 1, policy_version 178643 (0.0010) [2023-12-26 01:00:54,246][123090] Updated weights for policy 1, policy_version 178653 (0.0010) [2023-12-26 01:00:54,305][123091] Updated weights for policy 0, policy_version 179458 (0.0009) [2023-12-26 01:00:54,361][123091] Updated weights for policy 0, policy_version 179468 (0.0009) [2023-12-26 01:00:54,411][123091] Updated weights for policy 0, policy_version 179478 (0.0008) [2023-12-26 01:00:54,459][123091] Updated weights for policy 0, policy_version 179488 (0.0008) [2023-12-26 01:00:55,103][123090] Updated weights for policy 1, policy_version 178663 (0.0007) [2023-12-26 01:00:55,160][123090] Updated weights for policy 1, policy_version 178673 (0.0010) [2023-12-26 01:00:55,208][123090] Updated weights for policy 1, policy_version 178683 (0.0010) [2023-12-26 01:00:55,292][123091] Updated weights for policy 0, policy_version 179498 (0.0009) [2023-12-26 01:00:55,349][123091] Updated weights for policy 0, policy_version 179508 (0.0010) [2023-12-26 01:00:55,404][123091] Updated weights for policy 0, policy_version 179518 (0.0009) [2023-12-26 01:00:56,044][123090] Updated weights for policy 1, policy_version 178694 (0.0006) [2023-12-26 01:00:56,116][123090] Updated weights for policy 1, policy_version 178704 (0.0005) [2023-12-26 01:00:56,175][123090] Updated weights for policy 1, policy_version 178714 (0.0006) [2023-12-26 01:00:56,287][123091] Updated weights for policy 0, policy_version 179528 (0.0010) [2023-12-26 01:00:56,345][123091] Updated weights for policy 0, policy_version 179538 (0.0009) [2023-12-26 01:00:56,404][123091] Updated weights for policy 0, policy_version 179548 (0.0009) [2023-12-26 01:00:56,889][123090] Updated weights for policy 1, policy_version 178724 (0.0006) [2023-12-26 01:00:56,944][123090] Updated weights for policy 1, policy_version 178734 (0.0009) [2023-12-26 01:00:57,001][123090] Updated weights for policy 1, policy_version 178744 (0.0006) [2023-12-26 01:00:57,321][123091] Updated weights for policy 0, policy_version 179558 (0.0009) [2023-12-26 01:00:57,382][123091] Updated weights for policy 0, policy_version 179568 (0.0010) [2023-12-26 01:00:57,434][123091] Updated weights for policy 0, policy_version 179578 (0.0010) [2023-12-26 01:00:57,729][123090] Updated weights for policy 1, policy_version 178754 (0.0006) [2023-12-26 01:00:57,795][123090] Updated weights for policy 1, policy_version 178764 (0.0010) [2023-12-26 01:00:57,846][123090] Updated weights for policy 1, policy_version 178774 (0.0010) [2023-12-26 01:00:57,897][123090] Updated weights for policy 1, policy_version 178784 (0.0010) [2023-12-26 01:00:58,322][123091] Updated weights for policy 0, policy_version 179588 (0.0009) [2023-12-26 01:00:58,393][123091] Updated weights for policy 0, policy_version 179598 (0.0010) [2023-12-26 01:00:58,458][123091] Updated weights for policy 0, policy_version 179608 (0.0009) [2023-12-26 01:00:58,785][121949] Fps is (10 sec: 16383.0, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 91750400. Throughput: 0: 8904.5, 1: 8772.4. Samples: 91747532. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:00:58,785][121949] Avg episode reward: [(0, '5227.154'), (1, '5493.424')] [2023-12-26 01:00:58,815][123090] Updated weights for policy 1, policy_version 178794 (0.0008) [2023-12-26 01:00:58,869][123090] Updated weights for policy 1, policy_version 178804 (0.0008) [2023-12-26 01:00:58,927][123090] Updated weights for policy 1, policy_version 178814 (0.0008) [2023-12-26 01:00:59,450][123091] Updated weights for policy 0, policy_version 179618 (0.0008) [2023-12-26 01:00:59,518][123091] Updated weights for policy 0, policy_version 179628 (0.0010) [2023-12-26 01:00:59,583][123091] Updated weights for policy 0, policy_version 179638 (0.0009) [2023-12-26 01:00:59,648][123091] Updated weights for policy 0, policy_version 179648 (0.0010) [2023-12-26 01:00:59,832][123090] Updated weights for policy 1, policy_version 178824 (0.0010) [2023-12-26 01:00:59,899][123090] Updated weights for policy 1, policy_version 178834 (0.0008) [2023-12-26 01:00:59,968][123090] Updated weights for policy 1, policy_version 178844 (0.0009) [2023-12-26 01:01:00,484][123091] Updated weights for policy 0, policy_version 179658 (0.0006) [2023-12-26 01:01:00,547][123091] Updated weights for policy 0, policy_version 179668 (0.0005) [2023-12-26 01:01:00,600][123091] Updated weights for policy 0, policy_version 179678 (0.0006) [2023-12-26 01:01:00,828][123090] Updated weights for policy 1, policy_version 178854 (0.0010) [2023-12-26 01:01:00,879][123090] Updated weights for policy 1, policy_version 178864 (0.0009) [2023-12-26 01:01:00,944][123090] Updated weights for policy 1, policy_version 178874 (0.0008) [2023-12-26 01:01:01,290][123091] Updated weights for policy 0, policy_version 179688 (0.0008) [2023-12-26 01:01:01,361][123091] Updated weights for policy 0, policy_version 179698 (0.0009) [2023-12-26 01:01:01,423][123091] Updated weights for policy 0, policy_version 179708 (0.0009) [2023-12-26 01:01:01,842][123090] Updated weights for policy 1, policy_version 178884 (0.0010) [2023-12-26 01:01:01,900][123090] Updated weights for policy 1, policy_version 178894 (0.0009) [2023-12-26 01:01:01,969][123090] Updated weights for policy 1, policy_version 178904 (0.0010) [2023-12-26 01:01:02,217][123091] Updated weights for policy 0, policy_version 179718 (0.0009) [2023-12-26 01:01:02,282][123091] Updated weights for policy 0, policy_version 179728 (0.0009) [2023-12-26 01:01:02,350][123091] Updated weights for policy 0, policy_version 179738 (0.0008) [2023-12-26 01:01:02,827][123090] Updated weights for policy 1, policy_version 178914 (0.0009) [2023-12-26 01:01:02,888][123090] Updated weights for policy 1, policy_version 178924 (0.0009) [2023-12-26 01:01:02,948][123090] Updated weights for policy 1, policy_version 178934 (0.0010) [2023-12-26 01:01:03,005][123090] Updated weights for policy 1, policy_version 178944 (0.0009) [2023-12-26 01:01:03,211][123091] Updated weights for policy 0, policy_version 179748 (0.0010) [2023-12-26 01:01:03,280][123091] Updated weights for policy 0, policy_version 179758 (0.0009) [2023-12-26 01:01:03,337][123091] Updated weights for policy 0, policy_version 179768 (0.0009) [2023-12-26 01:01:03,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 91832320. Throughput: 0: 8752.6, 1: 8733.2. Samples: 91845928. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:03,785][121949] Avg episode reward: [(0, '5279.896'), (1, '5408.288')] [2023-12-26 01:01:03,831][123090] Updated weights for policy 1, policy_version 178954 (0.0009) [2023-12-26 01:01:03,901][123090] Updated weights for policy 1, policy_version 178964 (0.0007) [2023-12-26 01:01:03,979][123090] Updated weights for policy 1, policy_version 178974 (0.0006) [2023-12-26 01:01:04,195][123091] Updated weights for policy 0, policy_version 179778 (0.0009) [2023-12-26 01:01:04,257][123091] Updated weights for policy 0, policy_version 179788 (0.0010) [2023-12-26 01:01:04,318][123091] Updated weights for policy 0, policy_version 179798 (0.0009) [2023-12-26 01:01:04,383][123091] Updated weights for policy 0, policy_version 179808 (0.0010) [2023-12-26 01:01:04,737][123090] Updated weights for policy 1, policy_version 178984 (0.0009) [2023-12-26 01:01:04,789][123090] Updated weights for policy 1, policy_version 178994 (0.0007) [2023-12-26 01:01:04,843][123090] Updated weights for policy 1, policy_version 179004 (0.0009) [2023-12-26 01:01:05,235][123091] Updated weights for policy 0, policy_version 179818 (0.0009) [2023-12-26 01:01:05,298][123091] Updated weights for policy 0, policy_version 179828 (0.0009) [2023-12-26 01:01:05,356][123091] Updated weights for policy 0, policy_version 179838 (0.0010) [2023-12-26 01:01:05,686][123090] Updated weights for policy 1, policy_version 179014 (0.0009) [2023-12-26 01:01:05,749][123090] Updated weights for policy 1, policy_version 179024 (0.0009) [2023-12-26 01:01:05,810][123090] Updated weights for policy 1, policy_version 179034 (0.0009) [2023-12-26 01:01:06,172][123091] Updated weights for policy 0, policy_version 179848 (0.0006) [2023-12-26 01:01:06,238][123091] Updated weights for policy 0, policy_version 179858 (0.0009) [2023-12-26 01:01:06,318][123091] Updated weights for policy 0, policy_version 179868 (0.0010) [2023-12-26 01:01:06,613][123090] Updated weights for policy 1, policy_version 179044 (0.0009) [2023-12-26 01:01:06,684][123090] Updated weights for policy 1, policy_version 179054 (0.0009) [2023-12-26 01:01:06,746][123090] Updated weights for policy 1, policy_version 179064 (0.0010) [2023-12-26 01:01:07,115][123091] Updated weights for policy 0, policy_version 179878 (0.0010) [2023-12-26 01:01:07,180][123091] Updated weights for policy 0, policy_version 179888 (0.0009) [2023-12-26 01:01:07,242][123091] Updated weights for policy 0, policy_version 179898 (0.0009) [2023-12-26 01:01:07,579][123090] Updated weights for policy 1, policy_version 179074 (0.0010) [2023-12-26 01:01:07,643][123090] Updated weights for policy 1, policy_version 179084 (0.0009) [2023-12-26 01:01:07,703][123090] Updated weights for policy 1, policy_version 179094 (0.0009) [2023-12-26 01:01:07,761][123090] Updated weights for policy 1, policy_version 179104 (0.0009) [2023-12-26 01:01:08,093][123091] Updated weights for policy 0, policy_version 179908 (0.0009) [2023-12-26 01:01:08,149][123091] Updated weights for policy 0, policy_version 179918 (0.0010) [2023-12-26 01:01:08,213][123091] Updated weights for policy 0, policy_version 179928 (0.0010) [2023-12-26 01:01:08,620][123090] Updated weights for policy 1, policy_version 179114 (0.0009) [2023-12-26 01:01:08,690][123090] Updated weights for policy 1, policy_version 179124 (0.0006) [2023-12-26 01:01:08,755][123090] Updated weights for policy 1, policy_version 179134 (0.0006) [2023-12-26 01:01:08,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 91922432. Throughput: 0: 8743.0, 1: 8759.2. Samples: 91897484. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:08,785][121949] Avg episode reward: [(0, '5241.638'), (1, '5260.171')] [2023-12-26 01:01:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000179936_46063616.pth... [2023-12-26 01:01:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000179136_45858816.pth... [2023-12-26 01:01:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000178944_45809664.pth [2023-12-26 01:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000178112_45596672.pth [2023-12-26 01:01:09,037][123091] Updated weights for policy 0, policy_version 179938 (0.0009) [2023-12-26 01:01:09,093][123091] Updated weights for policy 0, policy_version 179948 (0.0010) [2023-12-26 01:01:09,147][123091] Updated weights for policy 0, policy_version 179959 (0.0010) [2023-12-26 01:01:09,431][123090] Updated weights for policy 1, policy_version 179144 (0.0011) [2023-12-26 01:01:09,482][123090] Updated weights for policy 1, policy_version 179154 (0.0006) [2023-12-26 01:01:09,546][123090] Updated weights for policy 1, policy_version 179164 (0.0006) [2023-12-26 01:01:10,116][123091] Updated weights for policy 0, policy_version 179970 (0.0010) [2023-12-26 01:01:10,180][123091] Updated weights for policy 0, policy_version 179980 (0.0007) [2023-12-26 01:01:10,251][123091] Updated weights for policy 0, policy_version 179990 (0.0007) [2023-12-26 01:01:10,288][123090] Updated weights for policy 1, policy_version 179174 (0.0008) [2023-12-26 01:01:10,310][123091] Updated weights for policy 0, policy_version 180000 (0.0009) [2023-12-26 01:01:10,352][123090] Updated weights for policy 1, policy_version 179184 (0.0008) [2023-12-26 01:01:10,417][123090] Updated weights for policy 1, policy_version 179194 (0.0010) [2023-12-26 01:01:11,172][123091] Updated weights for policy 0, policy_version 180010 (0.0008) [2023-12-26 01:01:11,219][123090] Updated weights for policy 1, policy_version 179204 (0.0008) [2023-12-26 01:01:11,239][123091] Updated weights for policy 0, policy_version 180020 (0.0009) [2023-12-26 01:01:11,292][123090] Updated weights for policy 1, policy_version 179214 (0.0011) [2023-12-26 01:01:11,308][123091] Updated weights for policy 0, policy_version 180030 (0.0006) [2023-12-26 01:01:11,359][123090] Updated weights for policy 1, policy_version 179224 (0.0009) [2023-12-26 01:01:12,063][123091] Updated weights for policy 0, policy_version 180040 (0.0009) [2023-12-26 01:01:12,124][123091] Updated weights for policy 0, policy_version 180050 (0.0009) [2023-12-26 01:01:12,182][123091] Updated weights for policy 0, policy_version 180060 (0.0009) [2023-12-26 01:01:12,214][123090] Updated weights for policy 1, policy_version 179234 (0.0010) [2023-12-26 01:01:12,285][123090] Updated weights for policy 1, policy_version 179244 (0.0010) [2023-12-26 01:01:12,366][123090] Updated weights for policy 1, policy_version 179254 (0.0010) [2023-12-26 01:01:12,439][123090] Updated weights for policy 1, policy_version 179264 (0.0009) [2023-12-26 01:01:13,045][123091] Updated weights for policy 0, policy_version 180070 (0.0010) [2023-12-26 01:01:13,106][123091] Updated weights for policy 0, policy_version 180080 (0.0009) [2023-12-26 01:01:13,175][123091] Updated weights for policy 0, policy_version 180090 (0.0010) [2023-12-26 01:01:13,235][123090] Updated weights for policy 1, policy_version 179274 (0.0010) [2023-12-26 01:01:13,299][123090] Updated weights for policy 1, policy_version 179284 (0.0010) [2023-12-26 01:01:13,365][123090] Updated weights for policy 1, policy_version 179294 (0.0010) [2023-12-26 01:01:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 92004352. Throughput: 0: 8658.5, 1: 8663.0. Samples: 91999340. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:13,785][121949] Avg episode reward: [(0, '5343.655'), (1, '5106.117')] [2023-12-26 01:01:13,999][123091] Updated weights for policy 0, policy_version 180100 (0.0010) [2023-12-26 01:01:14,048][123091] Updated weights for policy 0, policy_version 180110 (0.0010) [2023-12-26 01:01:14,100][123090] Updated weights for policy 1, policy_version 179304 (0.0010) [2023-12-26 01:01:14,107][123091] Updated weights for policy 0, policy_version 180120 (0.0011) [2023-12-26 01:01:14,165][123090] Updated weights for policy 1, policy_version 179314 (0.0007) [2023-12-26 01:01:14,230][123090] Updated weights for policy 1, policy_version 179324 (0.0009) [2023-12-26 01:01:14,866][123091] Updated weights for policy 0, policy_version 180130 (0.0010) [2023-12-26 01:01:14,925][123091] Updated weights for policy 0, policy_version 180140 (0.0008) [2023-12-26 01:01:14,990][123091] Updated weights for policy 0, policy_version 180150 (0.0007) [2023-12-26 01:01:15,062][123091] Updated weights for policy 0, policy_version 180160 (0.0007) [2023-12-26 01:01:15,102][123090] Updated weights for policy 1, policy_version 179334 (0.0008) [2023-12-26 01:01:15,169][123090] Updated weights for policy 1, policy_version 179344 (0.0005) [2023-12-26 01:01:15,241][123090] Updated weights for policy 1, policy_version 179354 (0.0007) [2023-12-26 01:01:15,810][123091] Updated weights for policy 0, policy_version 180170 (0.0005) [2023-12-26 01:01:15,857][123091] Updated weights for policy 0, policy_version 180180 (0.0005) [2023-12-26 01:01:15,904][123091] Updated weights for policy 0, policy_version 180190 (0.0005) [2023-12-26 01:01:15,965][123090] Updated weights for policy 1, policy_version 179364 (0.0007) [2023-12-26 01:01:16,018][123090] Updated weights for policy 1, policy_version 179374 (0.0005) [2023-12-26 01:01:16,069][123090] Updated weights for policy 1, policy_version 179384 (0.0009) [2023-12-26 01:01:16,653][123091] Updated weights for policy 0, policy_version 180200 (0.0005) [2023-12-26 01:01:16,707][123091] Updated weights for policy 0, policy_version 180210 (0.0005) [2023-12-26 01:01:16,769][123091] Updated weights for policy 0, policy_version 180220 (0.0005) [2023-12-26 01:01:16,803][123090] Updated weights for policy 1, policy_version 179394 (0.0007) [2023-12-26 01:01:16,866][123090] Updated weights for policy 1, policy_version 179404 (0.0006) [2023-12-26 01:01:16,923][123090] Updated weights for policy 1, policy_version 179414 (0.0010) [2023-12-26 01:01:16,977][123090] Updated weights for policy 1, policy_version 179424 (0.0010) [2023-12-26 01:01:17,433][123091] Updated weights for policy 0, policy_version 180230 (0.0005) [2023-12-26 01:01:17,480][123091] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-12-26 01:01:17,532][123091] Updated weights for policy 0, policy_version 180250 (0.0006) [2023-12-26 01:01:17,803][123090] Updated weights for policy 1, policy_version 179434 (0.0010) [2023-12-26 01:01:17,855][123090] Updated weights for policy 1, policy_version 179444 (0.0010) [2023-12-26 01:01:17,902][123090] Updated weights for policy 1, policy_version 179454 (0.0010) [2023-12-26 01:01:18,221][123091] Updated weights for policy 0, policy_version 180260 (0.0006) [2023-12-26 01:01:18,279][123091] Updated weights for policy 0, policy_version 180270 (0.0006) [2023-12-26 01:01:18,337][123091] Updated weights for policy 0, policy_version 180280 (0.0007) [2023-12-26 01:01:18,714][123090] Updated weights for policy 1, policy_version 179464 (0.0008) [2023-12-26 01:01:18,766][123090] Updated weights for policy 1, policy_version 179474 (0.0010) [2023-12-26 01:01:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 92094464. Throughput: 0: 8673.0, 1: 8660.4. Samples: 92110148. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:18,785][121949] Avg episode reward: [(0, '5292.873'), (1, '5185.189')] [2023-12-26 01:01:18,818][123090] Updated weights for policy 1, policy_version 179484 (0.0010) [2023-12-26 01:01:19,018][123091] Updated weights for policy 0, policy_version 180290 (0.0008) [2023-12-26 01:01:19,070][123091] Updated weights for policy 0, policy_version 180300 (0.0009) [2023-12-26 01:01:19,136][123091] Updated weights for policy 0, policy_version 180310 (0.0007) [2023-12-26 01:01:19,214][123091] Updated weights for policy 0, policy_version 180320 (0.0007) [2023-12-26 01:01:19,670][123090] Updated weights for policy 1, policy_version 179494 (0.0010) [2023-12-26 01:01:19,733][123090] Updated weights for policy 1, policy_version 179504 (0.0010) [2023-12-26 01:01:19,802][123090] Updated weights for policy 1, policy_version 179514 (0.0006) [2023-12-26 01:01:20,022][123091] Updated weights for policy 0, policy_version 180330 (0.0009) [2023-12-26 01:01:20,092][123091] Updated weights for policy 0, policy_version 180340 (0.0010) [2023-12-26 01:01:20,159][123091] Updated weights for policy 0, policy_version 180350 (0.0009) [2023-12-26 01:01:20,652][123090] Updated weights for policy 1, policy_version 179524 (0.0007) [2023-12-26 01:01:20,716][123090] Updated weights for policy 1, policy_version 179534 (0.0005) [2023-12-26 01:01:20,786][123090] Updated weights for policy 1, policy_version 179544 (0.0006) [2023-12-26 01:01:20,942][123091] Updated weights for policy 0, policy_version 180360 (0.0011) [2023-12-26 01:01:21,013][123091] Updated weights for policy 0, policy_version 180370 (0.0010) [2023-12-26 01:01:21,084][123091] Updated weights for policy 0, policy_version 180380 (0.0009) [2023-12-26 01:01:21,575][123090] Updated weights for policy 1, policy_version 179554 (0.0006) [2023-12-26 01:01:21,641][123090] Updated weights for policy 1, policy_version 179565 (0.0008) [2023-12-26 01:01:21,709][123090] Updated weights for policy 1, policy_version 179575 (0.0008) [2023-12-26 01:01:21,918][123091] Updated weights for policy 0, policy_version 180390 (0.0010) [2023-12-26 01:01:21,981][123091] Updated weights for policy 0, policy_version 180400 (0.0010) [2023-12-26 01:01:22,046][123091] Updated weights for policy 0, policy_version 180410 (0.0009) [2023-12-26 01:01:22,548][123090] Updated weights for policy 1, policy_version 179585 (0.0009) [2023-12-26 01:01:22,612][123090] Updated weights for policy 1, policy_version 179595 (0.0010) [2023-12-26 01:01:22,664][123090] Updated weights for policy 1, policy_version 179605 (0.0008) [2023-12-26 01:01:22,715][123090] Updated weights for policy 1, policy_version 179615 (0.0006) [2023-12-26 01:01:22,897][123091] Updated weights for policy 0, policy_version 180420 (0.0010) [2023-12-26 01:01:22,948][123091] Updated weights for policy 0, policy_version 180430 (0.0009) [2023-12-26 01:01:23,001][123091] Updated weights for policy 0, policy_version 180440 (0.0009) [2023-12-26 01:01:23,460][123090] Updated weights for policy 1, policy_version 179625 (0.0010) [2023-12-26 01:01:23,518][123090] Updated weights for policy 1, policy_version 179635 (0.0010) [2023-12-26 01:01:23,570][123090] Updated weights for policy 1, policy_version 179645 (0.0010) [2023-12-26 01:01:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 92184576. Throughput: 0: 8644.5, 1: 8647.0. Samples: 92162748. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:23,784][121949] Avg episode reward: [(0, '5388.681'), (1, '5220.041')] [2023-12-26 01:01:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000179648_45989888.pth... [2023-12-26 01:01:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000180448_46194688.pth... [2023-12-26 01:01:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000178624_45727744.pth [2023-12-26 01:01:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000179456_45940736.pth [2023-12-26 01:01:23,908][123091] Updated weights for policy 0, policy_version 180451 (0.0010) [2023-12-26 01:01:23,962][123091] Updated weights for policy 0, policy_version 180461 (0.0009) [2023-12-26 01:01:24,030][123091] Updated weights for policy 0, policy_version 180471 (0.0010) [2023-12-26 01:01:24,374][123090] Updated weights for policy 1, policy_version 179655 (0.0010) [2023-12-26 01:01:24,442][123090] Updated weights for policy 1, policy_version 179665 (0.0007) [2023-12-26 01:01:24,514][123090] Updated weights for policy 1, policy_version 179675 (0.0006) [2023-12-26 01:01:24,921][123091] Updated weights for policy 0, policy_version 180481 (0.0009) [2023-12-26 01:01:24,979][123091] Updated weights for policy 0, policy_version 180491 (0.0010) [2023-12-26 01:01:25,033][123091] Updated weights for policy 0, policy_version 180502 (0.0010) [2023-12-26 01:01:25,242][123090] Updated weights for policy 1, policy_version 179685 (0.0007) [2023-12-26 01:01:25,291][123090] Updated weights for policy 1, policy_version 179695 (0.0005) [2023-12-26 01:01:25,340][123090] Updated weights for policy 1, policy_version 179705 (0.0005) [2023-12-26 01:01:25,922][123090] Updated weights for policy 1, policy_version 179715 (0.0007) [2023-12-26 01:01:25,953][123091] Updated weights for policy 0, policy_version 180513 (0.0009) [2023-12-26 01:01:25,987][123090] Updated weights for policy 1, policy_version 179725 (0.0010) [2023-12-26 01:01:26,005][123091] Updated weights for policy 0, policy_version 180523 (0.0007) [2023-12-26 01:01:26,037][123090] Updated weights for policy 1, policy_version 179735 (0.0006) [2023-12-26 01:01:26,058][123091] Updated weights for policy 0, policy_version 180533 (0.0009) [2023-12-26 01:01:26,109][123091] Updated weights for policy 0, policy_version 180543 (0.0010) [2023-12-26 01:01:26,652][123090] Updated weights for policy 1, policy_version 179745 (0.0006) [2023-12-26 01:01:26,701][123090] Updated weights for policy 1, policy_version 179755 (0.0009) [2023-12-26 01:01:26,760][123090] Updated weights for policy 1, policy_version 179765 (0.0009) [2023-12-26 01:01:26,813][123090] Updated weights for policy 1, policy_version 179775 (0.0010) [2023-12-26 01:01:26,991][123091] Updated weights for policy 0, policy_version 180553 (0.0010) [2023-12-26 01:01:27,045][123091] Updated weights for policy 0, policy_version 180563 (0.0010) [2023-12-26 01:01:27,092][123091] Updated weights for policy 0, policy_version 180573 (0.0008) [2023-12-26 01:01:27,667][123090] Updated weights for policy 1, policy_version 179785 (0.0009) [2023-12-26 01:01:27,717][123090] Updated weights for policy 1, policy_version 179795 (0.0009) [2023-12-26 01:01:27,770][123090] Updated weights for policy 1, policy_version 179806 (0.0009) [2023-12-26 01:01:27,956][123091] Updated weights for policy 0, policy_version 180583 (0.0009) [2023-12-26 01:01:28,011][123091] Updated weights for policy 0, policy_version 180593 (0.0009) [2023-12-26 01:01:28,061][123091] Updated weights for policy 0, policy_version 180604 (0.0010) [2023-12-26 01:01:28,551][123090] Updated weights for policy 1, policy_version 179816 (0.0008) [2023-12-26 01:01:28,615][123090] Updated weights for policy 1, policy_version 179826 (0.0007) [2023-12-26 01:01:28,686][123090] Updated weights for policy 1, policy_version 179836 (0.0006) [2023-12-26 01:01:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 92274688. Throughput: 0: 8583.8, 1: 8746.1. Samples: 92267676. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:28,784][121949] Avg episode reward: [(0, '5521.185'), (1, '5221.951')] [2023-12-26 01:01:28,919][123091] Updated weights for policy 0, policy_version 180614 (0.0007) [2023-12-26 01:01:28,976][123091] Updated weights for policy 0, policy_version 180624 (0.0005) [2023-12-26 01:01:29,029][123091] Updated weights for policy 0, policy_version 180634 (0.0005) [2023-12-26 01:01:29,479][123090] Updated weights for policy 1, policy_version 179846 (0.0007) [2023-12-26 01:01:29,552][123090] Updated weights for policy 1, policy_version 179856 (0.0005) [2023-12-26 01:01:29,613][123090] Updated weights for policy 1, policy_version 179866 (0.0006) [2023-12-26 01:01:29,640][123091] Updated weights for policy 0, policy_version 180644 (0.0006) [2023-12-26 01:01:29,711][123091] Updated weights for policy 0, policy_version 180654 (0.0008) [2023-12-26 01:01:29,767][123091] Updated weights for policy 0, policy_version 180664 (0.0009) [2023-12-26 01:01:30,319][123090] Updated weights for policy 1, policy_version 179876 (0.0008) [2023-12-26 01:01:30,382][123090] Updated weights for policy 1, policy_version 179886 (0.0009) [2023-12-26 01:01:30,450][123090] Updated weights for policy 1, policy_version 179896 (0.0009) [2023-12-26 01:01:30,583][123091] Updated weights for policy 0, policy_version 180674 (0.0009) [2023-12-26 01:01:30,637][123091] Updated weights for policy 0, policy_version 180684 (0.0010) [2023-12-26 01:01:30,695][123091] Updated weights for policy 0, policy_version 180694 (0.0009) [2023-12-26 01:01:30,753][123091] Updated weights for policy 0, policy_version 180704 (0.0009) [2023-12-26 01:01:31,290][123090] Updated weights for policy 1, policy_version 179906 (0.0009) [2023-12-26 01:01:31,346][123090] Updated weights for policy 1, policy_version 179916 (0.0009) [2023-12-26 01:01:31,413][123090] Updated weights for policy 1, policy_version 179926 (0.0009) [2023-12-26 01:01:31,484][123090] Updated weights for policy 1, policy_version 179936 (0.0009) [2023-12-26 01:01:31,545][123091] Updated weights for policy 0, policy_version 180714 (0.0009) [2023-12-26 01:01:31,596][123091] Updated weights for policy 0, policy_version 180724 (0.0009) [2023-12-26 01:01:31,665][123091] Updated weights for policy 0, policy_version 180734 (0.0006) [2023-12-26 01:01:32,313][123090] Updated weights for policy 1, policy_version 179946 (0.0009) [2023-12-26 01:01:32,377][123090] Updated weights for policy 1, policy_version 179956 (0.0009) [2023-12-26 01:01:32,439][123090] Updated weights for policy 1, policy_version 179966 (0.0009) [2023-12-26 01:01:32,479][123091] Updated weights for policy 0, policy_version 180744 (0.0007) [2023-12-26 01:01:32,543][123091] Updated weights for policy 0, policy_version 180754 (0.0008) [2023-12-26 01:01:32,611][123091] Updated weights for policy 0, policy_version 180764 (0.0005) [2023-12-26 01:01:33,297][123090] Updated weights for policy 1, policy_version 179976 (0.0009) [2023-12-26 01:01:33,345][123090] Updated weights for policy 1, policy_version 179986 (0.0008) [2023-12-26 01:01:33,373][123091] Updated weights for policy 0, policy_version 180774 (0.0007) [2023-12-26 01:01:33,394][123090] Updated weights for policy 1, policy_version 179996 (0.0008) [2023-12-26 01:01:33,438][123091] Updated weights for policy 0, policy_version 180784 (0.0008) [2023-12-26 01:01:33,511][123091] Updated weights for policy 0, policy_version 180794 (0.0005) [2023-12-26 01:01:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 92364800. Throughput: 0: 8608.3, 1: 8744.5. Samples: 92374056. Policy #0 lag: (min: 24.0, avg: 38.6, max: 40.0) [2023-12-26 01:01:33,785][121949] Avg episode reward: [(0, '5559.814'), (1, '5133.045')] [2023-12-26 01:01:34,228][123091] Updated weights for policy 0, policy_version 180804 (0.0006) [2023-12-26 01:01:34,293][123091] Updated weights for policy 0, policy_version 180814 (0.0006) [2023-12-26 01:01:34,297][123090] Updated weights for policy 1, policy_version 180006 (0.0009) [2023-12-26 01:01:34,358][123091] Updated weights for policy 0, policy_version 180824 (0.0006) [2023-12-26 01:01:34,363][123090] Updated weights for policy 1, policy_version 180016 (0.0009) [2023-12-26 01:01:34,425][123090] Updated weights for policy 1, policy_version 180026 (0.0009) [2023-12-26 01:01:35,130][123091] Updated weights for policy 0, policy_version 180834 (0.0008) [2023-12-26 01:01:35,187][123091] Updated weights for policy 0, policy_version 180844 (0.0010) [2023-12-26 01:01:35,251][123091] Updated weights for policy 0, policy_version 180854 (0.0009) [2023-12-26 01:01:35,252][123090] Updated weights for policy 1, policy_version 180036 (0.0009) [2023-12-26 01:01:35,313][123091] Updated weights for policy 0, policy_version 180864 (0.0008) [2023-12-26 01:01:35,315][123090] Updated weights for policy 1, policy_version 180046 (0.0009) [2023-12-26 01:01:35,380][123090] Updated weights for policy 1, policy_version 180056 (0.0009) [2023-12-26 01:01:36,137][123091] Updated weights for policy 0, policy_version 180874 (0.0009) [2023-12-26 01:01:36,191][123091] Updated weights for policy 0, policy_version 180884 (0.0009) [2023-12-26 01:01:36,196][123090] Updated weights for policy 1, policy_version 180066 (0.0009) [2023-12-26 01:01:36,250][123091] Updated weights for policy 0, policy_version 180894 (0.0008) [2023-12-26 01:01:36,260][123090] Updated weights for policy 1, policy_version 180076 (0.0008) [2023-12-26 01:01:36,316][123090] Updated weights for policy 1, policy_version 180086 (0.0009) [2023-12-26 01:01:36,376][123090] Updated weights for policy 1, policy_version 180096 (0.0009) [2023-12-26 01:01:37,064][123091] Updated weights for policy 0, policy_version 180904 (0.0009) [2023-12-26 01:01:37,129][123091] Updated weights for policy 0, policy_version 180914 (0.0010) [2023-12-26 01:01:37,185][123091] Updated weights for policy 0, policy_version 180924 (0.0009) [2023-12-26 01:01:37,218][123090] Updated weights for policy 1, policy_version 180106 (0.0009) [2023-12-26 01:01:37,279][123090] Updated weights for policy 1, policy_version 180116 (0.0008) [2023-12-26 01:01:37,344][123090] Updated weights for policy 1, policy_version 180126 (0.0009) [2023-12-26 01:01:38,030][123091] Updated weights for policy 0, policy_version 180934 (0.0007) [2023-12-26 01:01:38,094][123091] Updated weights for policy 0, policy_version 180944 (0.0005) [2023-12-26 01:01:38,158][123091] Updated weights for policy 0, policy_version 180954 (0.0005) [2023-12-26 01:01:38,173][123090] Updated weights for policy 1, policy_version 180136 (0.0009) [2023-12-26 01:01:38,231][123090] Updated weights for policy 1, policy_version 180146 (0.0010) [2023-12-26 01:01:38,294][123090] Updated weights for policy 1, policy_version 180156 (0.0011) [2023-12-26 01:01:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 92446720. Throughput: 0: 8624.6, 1: 8758.8. Samples: 92425364. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:01:38,785][121949] Avg episode reward: [(0, '5566.968'), (1, '5044.374')] [2023-12-26 01:01:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000180160_46120960.pth... [2023-12-26 01:01:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000180960_46325760.pth... [2023-12-26 01:01:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000179136_45858816.pth [2023-12-26 01:01:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000179936_46063616.pth [2023-12-26 01:01:38,954][123091] Updated weights for policy 0, policy_version 180964 (0.0008) [2023-12-26 01:01:39,021][123091] Updated weights for policy 0, policy_version 180975 (0.0010) [2023-12-26 01:01:39,088][123091] Updated weights for policy 0, policy_version 180985 (0.0009) [2023-12-26 01:01:39,170][123090] Updated weights for policy 1, policy_version 180166 (0.0008) [2023-12-26 01:01:39,236][123090] Updated weights for policy 1, policy_version 180176 (0.0009) [2023-12-26 01:01:39,310][123090] Updated weights for policy 1, policy_version 180186 (0.0008) [2023-12-26 01:01:39,980][123091] Updated weights for policy 0, policy_version 180995 (0.0010) [2023-12-26 01:01:40,042][123091] Updated weights for policy 0, policy_version 181005 (0.0010) [2023-12-26 01:01:40,103][123091] Updated weights for policy 0, policy_version 181015 (0.0008) [2023-12-26 01:01:40,105][123090] Updated weights for policy 1, policy_version 180196 (0.0010) [2023-12-26 01:01:40,159][123090] Updated weights for policy 1, policy_version 180206 (0.0009) [2023-12-26 01:01:40,231][123090] Updated weights for policy 1, policy_version 180216 (0.0010) [2023-12-26 01:01:40,974][123091] Updated weights for policy 0, policy_version 181025 (0.0008) [2023-12-26 01:01:41,043][123091] Updated weights for policy 0, policy_version 181035 (0.0010) [2023-12-26 01:01:41,044][123090] Updated weights for policy 1, policy_version 180226 (0.0010) [2023-12-26 01:01:41,106][123091] Updated weights for policy 0, policy_version 181045 (0.0010) [2023-12-26 01:01:41,108][123090] Updated weights for policy 1, policy_version 180236 (0.0008) [2023-12-26 01:01:41,176][123091] Updated weights for policy 0, policy_version 181055 (0.0010) [2023-12-26 01:01:41,178][123090] Updated weights for policy 1, policy_version 180246 (0.0009) [2023-12-26 01:01:41,234][123090] Updated weights for policy 1, policy_version 180256 (0.0009) [2023-12-26 01:01:42,031][123091] Updated weights for policy 0, policy_version 181065 (0.0009) [2023-12-26 01:01:42,060][123090] Updated weights for policy 1, policy_version 180266 (0.0008) [2023-12-26 01:01:42,093][123091] Updated weights for policy 0, policy_version 181075 (0.0009) [2023-12-26 01:01:42,121][123090] Updated weights for policy 1, policy_version 180276 (0.0008) [2023-12-26 01:01:42,155][123091] Updated weights for policy 0, policy_version 181085 (0.0008) [2023-12-26 01:01:42,175][123090] Updated weights for policy 1, policy_version 180286 (0.0007) [2023-12-26 01:01:42,975][123090] Updated weights for policy 1, policy_version 180296 (0.0010) [2023-12-26 01:01:43,032][123091] Updated weights for policy 0, policy_version 181095 (0.0008) [2023-12-26 01:01:43,045][123090] Updated weights for policy 1, policy_version 180306 (0.0010) [2023-12-26 01:01:43,087][123091] Updated weights for policy 0, policy_version 181105 (0.0008) [2023-12-26 01:01:43,112][123090] Updated weights for policy 1, policy_version 180316 (0.0010) [2023-12-26 01:01:43,150][123091] Updated weights for policy 0, policy_version 181115 (0.0008) [2023-12-26 01:01:43,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17203.3, 300 sec: 17633.6). Total num frames: 92528640. Throughput: 0: 8621.6, 1: 8684.7. Samples: 92526304. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:01:43,784][121949] Avg episode reward: [(0, '5608.152'), (1, '5098.356')] [2023-12-26 01:01:43,876][123090] Updated weights for policy 1, policy_version 180326 (0.0010) [2023-12-26 01:01:43,931][123090] Updated weights for policy 1, policy_version 180336 (0.0010) [2023-12-26 01:01:43,992][123090] Updated weights for policy 1, policy_version 180346 (0.0010) [2023-12-26 01:01:44,015][123091] Updated weights for policy 0, policy_version 181125 (0.0009) [2023-12-26 01:01:44,076][123091] Updated weights for policy 0, policy_version 181136 (0.0009) [2023-12-26 01:01:44,147][123091] Updated weights for policy 0, policy_version 181146 (0.0009) [2023-12-26 01:01:44,821][123090] Updated weights for policy 1, policy_version 180356 (0.0008) [2023-12-26 01:01:44,896][123090] Updated weights for policy 1, policy_version 180366 (0.0010) [2023-12-26 01:01:44,967][123091] Updated weights for policy 0, policy_version 181156 (0.0008) [2023-12-26 01:01:44,970][123090] Updated weights for policy 1, policy_version 180376 (0.0010) [2023-12-26 01:01:45,029][123091] Updated weights for policy 0, policy_version 181166 (0.0006) [2023-12-26 01:01:45,077][123091] Updated weights for policy 0, policy_version 181176 (0.0006) [2023-12-26 01:01:45,790][123090] Updated weights for policy 1, policy_version 180386 (0.0011) [2023-12-26 01:01:45,846][123090] Updated weights for policy 1, policy_version 180396 (0.0010) [2023-12-26 01:01:45,904][123091] Updated weights for policy 0, policy_version 181186 (0.0009) [2023-12-26 01:01:45,921][123090] Updated weights for policy 1, policy_version 180406 (0.0011) [2023-12-26 01:01:45,970][123091] Updated weights for policy 0, policy_version 181196 (0.0007) [2023-12-26 01:01:45,989][123090] Updated weights for policy 1, policy_version 180416 (0.0010) [2023-12-26 01:01:46,037][123091] Updated weights for policy 0, policy_version 181206 (0.0008) [2023-12-26 01:01:46,102][123091] Updated weights for policy 0, policy_version 181216 (0.0008) [2023-12-26 01:01:46,790][123090] Updated weights for policy 1, policy_version 180426 (0.0010) [2023-12-26 01:01:46,841][123090] Updated weights for policy 1, policy_version 180436 (0.0010) [2023-12-26 01:01:46,861][123091] Updated weights for policy 0, policy_version 181226 (0.0006) [2023-12-26 01:01:46,904][123090] Updated weights for policy 1, policy_version 180446 (0.0010) [2023-12-26 01:01:46,924][123091] Updated weights for policy 0, policy_version 181236 (0.0007) [2023-12-26 01:01:46,972][123091] Updated weights for policy 0, policy_version 181246 (0.0009) [2023-12-26 01:01:47,740][123090] Updated weights for policy 1, policy_version 180456 (0.0010) [2023-12-26 01:01:47,807][123090] Updated weights for policy 1, policy_version 180466 (0.0010) [2023-12-26 01:01:47,810][123091] Updated weights for policy 0, policy_version 181256 (0.0008) [2023-12-26 01:01:47,870][123090] Updated weights for policy 1, policy_version 180476 (0.0010) [2023-12-26 01:01:47,879][123091] Updated weights for policy 0, policy_version 181266 (0.0009) [2023-12-26 01:01:47,932][123091] Updated weights for policy 0, policy_version 181276 (0.0008) [2023-12-26 01:01:48,559][123091] Updated weights for policy 0, policy_version 181286 (0.0005) [2023-12-26 01:01:48,618][123091] Updated weights for policy 0, policy_version 181296 (0.0006) [2023-12-26 01:01:48,677][123091] Updated weights for policy 0, policy_version 181306 (0.0005) [2023-12-26 01:01:48,703][123090] Updated weights for policy 1, policy_version 180486 (0.0010) [2023-12-26 01:01:48,775][123090] Updated weights for policy 1, policy_version 180496 (0.0011) [2023-12-26 01:01:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 92618752. Throughput: 0: 8696.1, 1: 8762.7. Samples: 92631572. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:01:48,785][121949] Avg episode reward: [(0, '5702.939'), (1, '5370.782')] [2023-12-26 01:01:48,830][123090] Updated weights for policy 1, policy_version 180506 (0.0010) [2023-12-26 01:01:49,405][123091] Updated weights for policy 0, policy_version 181316 (0.0007) [2023-12-26 01:01:49,468][123091] Updated weights for policy 0, policy_version 181326 (0.0010) [2023-12-26 01:01:49,534][123091] Updated weights for policy 0, policy_version 181336 (0.0009) [2023-12-26 01:01:49,645][123090] Updated weights for policy 1, policy_version 180516 (0.0011) [2023-12-26 01:01:49,707][123090] Updated weights for policy 1, policy_version 180527 (0.0009) [2023-12-26 01:01:49,761][123090] Updated weights for policy 1, policy_version 180537 (0.0009) [2023-12-26 01:01:50,346][123091] Updated weights for policy 0, policy_version 181346 (0.0009) [2023-12-26 01:01:50,404][123091] Updated weights for policy 0, policy_version 181356 (0.0010) [2023-12-26 01:01:50,465][123091] Updated weights for policy 0, policy_version 181366 (0.0009) [2023-12-26 01:01:50,517][123091] Updated weights for policy 0, policy_version 181376 (0.0009) [2023-12-26 01:01:50,630][123090] Updated weights for policy 1, policy_version 180548 (0.0009) [2023-12-26 01:01:50,703][123090] Updated weights for policy 1, policy_version 180558 (0.0007) [2023-12-26 01:01:50,771][123090] Updated weights for policy 1, policy_version 180568 (0.0008) [2023-12-26 01:01:51,412][123091] Updated weights for policy 0, policy_version 181386 (0.0010) [2023-12-26 01:01:51,479][123091] Updated weights for policy 0, policy_version 181396 (0.0010) [2023-12-26 01:01:51,541][123091] Updated weights for policy 0, policy_version 181406 (0.0010) [2023-12-26 01:01:51,571][123090] Updated weights for policy 1, policy_version 180578 (0.0009) [2023-12-26 01:01:51,635][123090] Updated weights for policy 1, policy_version 180588 (0.0009) [2023-12-26 01:01:51,690][123090] Updated weights for policy 1, policy_version 180598 (0.0009) [2023-12-26 01:01:51,760][123090] Updated weights for policy 1, policy_version 180608 (0.0008) [2023-12-26 01:01:52,305][123091] Updated weights for policy 0, policy_version 181416 (0.0009) [2023-12-26 01:01:52,372][123091] Updated weights for policy 0, policy_version 181426 (0.0009) [2023-12-26 01:01:52,439][123091] Updated weights for policy 0, policy_version 181436 (0.0009) [2023-12-26 01:01:52,549][123090] Updated weights for policy 1, policy_version 180618 (0.0010) [2023-12-26 01:01:52,618][123090] Updated weights for policy 1, policy_version 180628 (0.0009) [2023-12-26 01:01:52,686][123090] Updated weights for policy 1, policy_version 180638 (0.0010) [2023-12-26 01:01:53,247][123091] Updated weights for policy 0, policy_version 181446 (0.0009) [2023-12-26 01:01:53,308][123091] Updated weights for policy 0, policy_version 181456 (0.0009) [2023-12-26 01:01:53,363][123091] Updated weights for policy 0, policy_version 181466 (0.0008) [2023-12-26 01:01:53,521][123090] Updated weights for policy 1, policy_version 180648 (0.0010) [2023-12-26 01:01:53,575][123090] Updated weights for policy 1, policy_version 180658 (0.0010) [2023-12-26 01:01:53,634][123090] Updated weights for policy 1, policy_version 180668 (0.0010) [2023-12-26 01:01:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 92708864. Throughput: 0: 8712.7, 1: 8738.6. Samples: 92682792. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:01:53,784][121949] Avg episode reward: [(0, '5679.702'), (1, '5418.134')] [2023-12-26 01:01:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000180672_46252032.pth... [2023-12-26 01:01:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000181472_46456832.pth... [2023-12-26 01:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000179648_45989888.pth [2023-12-26 01:01:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000180448_46194688.pth [2023-12-26 01:01:54,150][123091] Updated weights for policy 0, policy_version 181476 (0.0008) [2023-12-26 01:01:54,211][123091] Updated weights for policy 0, policy_version 181486 (0.0009) [2023-12-26 01:01:54,271][123091] Updated weights for policy 0, policy_version 181496 (0.0009) [2023-12-26 01:01:54,468][123090] Updated weights for policy 1, policy_version 180678 (0.0010) [2023-12-26 01:01:54,532][123090] Updated weights for policy 1, policy_version 180688 (0.0010) [2023-12-26 01:01:54,584][123090] Updated weights for policy 1, policy_version 180698 (0.0010) [2023-12-26 01:01:55,102][123091] Updated weights for policy 0, policy_version 181506 (0.0010) [2023-12-26 01:01:55,158][123091] Updated weights for policy 0, policy_version 181516 (0.0010) [2023-12-26 01:01:55,212][123091] Updated weights for policy 0, policy_version 181526 (0.0009) [2023-12-26 01:01:55,265][123091] Updated weights for policy 0, policy_version 181536 (0.0009) [2023-12-26 01:01:55,317][123090] Updated weights for policy 1, policy_version 180708 (0.0010) [2023-12-26 01:01:55,383][123090] Updated weights for policy 1, policy_version 180718 (0.0010) [2023-12-26 01:01:55,448][123090] Updated weights for policy 1, policy_version 180728 (0.0009) [2023-12-26 01:01:56,054][123091] Updated weights for policy 0, policy_version 181546 (0.0007) [2023-12-26 01:01:56,110][123091] Updated weights for policy 0, policy_version 181556 (0.0010) [2023-12-26 01:01:56,174][123091] Updated weights for policy 0, policy_version 181566 (0.0011) [2023-12-26 01:01:56,248][123090] Updated weights for policy 1, policy_version 180738 (0.0010) [2023-12-26 01:01:56,303][123090] Updated weights for policy 1, policy_version 180748 (0.0010) [2023-12-26 01:01:56,371][123090] Updated weights for policy 1, policy_version 180758 (0.0010) [2023-12-26 01:01:56,429][123090] Updated weights for policy 1, policy_version 180768 (0.0009) [2023-12-26 01:01:57,033][123091] Updated weights for policy 0, policy_version 181576 (0.0008) [2023-12-26 01:01:57,084][123091] Updated weights for policy 0, policy_version 181587 (0.0010) [2023-12-26 01:01:57,132][123091] Updated weights for policy 0, policy_version 181597 (0.0008) [2023-12-26 01:01:57,148][123090] Updated weights for policy 1, policy_version 180778 (0.0008) [2023-12-26 01:01:57,213][123090] Updated weights for policy 1, policy_version 180788 (0.0008) [2023-12-26 01:01:57,285][123090] Updated weights for policy 1, policy_version 180798 (0.0007) [2023-12-26 01:01:58,006][123091] Updated weights for policy 0, policy_version 181607 (0.0008) [2023-12-26 01:01:58,039][123090] Updated weights for policy 1, policy_version 180808 (0.0008) [2023-12-26 01:01:58,069][123091] Updated weights for policy 0, policy_version 181617 (0.0008) [2023-12-26 01:01:58,102][123090] Updated weights for policy 1, policy_version 180818 (0.0009) [2023-12-26 01:01:58,127][123091] Updated weights for policy 0, policy_version 181627 (0.0008) [2023-12-26 01:01:58,153][123090] Updated weights for policy 1, policy_version 180828 (0.0008) [2023-12-26 01:01:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.9, 300 sec: 17633.6). Total num frames: 92790784. Throughput: 0: 8765.7, 1: 8778.0. Samples: 92788804. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:01:58,785][121949] Avg episode reward: [(0, '5619.495'), (1, '5437.772')] [2023-12-26 01:01:58,971][123091] Updated weights for policy 0, policy_version 181637 (0.0008) [2023-12-26 01:01:59,034][123091] Updated weights for policy 0, policy_version 181647 (0.0007) [2023-12-26 01:01:59,093][123090] Updated weights for policy 1, policy_version 180838 (0.0009) [2023-12-26 01:01:59,105][123091] Updated weights for policy 0, policy_version 181657 (0.0008) [2023-12-26 01:01:59,152][123090] Updated weights for policy 1, policy_version 180848 (0.0009) [2023-12-26 01:01:59,207][123090] Updated weights for policy 1, policy_version 180858 (0.0007) [2023-12-26 01:01:59,895][123091] Updated weights for policy 0, policy_version 181667 (0.0009) [2023-12-26 01:01:59,961][123091] Updated weights for policy 0, policy_version 181677 (0.0009) [2023-12-26 01:02:00,029][123091] Updated weights for policy 0, policy_version 181687 (0.0009) [2023-12-26 01:02:00,034][123090] Updated weights for policy 1, policy_version 180868 (0.0009) [2023-12-26 01:02:00,096][123090] Updated weights for policy 1, policy_version 180878 (0.0009) [2023-12-26 01:02:00,161][123090] Updated weights for policy 1, policy_version 180888 (0.0009) [2023-12-26 01:02:00,893][123091] Updated weights for policy 0, policy_version 181697 (0.0006) [2023-12-26 01:02:00,943][123090] Updated weights for policy 1, policy_version 180898 (0.0009) [2023-12-26 01:02:00,960][123091] Updated weights for policy 0, policy_version 181707 (0.0009) [2023-12-26 01:02:01,004][123090] Updated weights for policy 1, policy_version 180908 (0.0005) [2023-12-26 01:02:01,019][123091] Updated weights for policy 0, policy_version 181717 (0.0009) [2023-12-26 01:02:01,070][123090] Updated weights for policy 1, policy_version 180918 (0.0007) [2023-12-26 01:02:01,082][123091] Updated weights for policy 0, policy_version 181727 (0.0008) [2023-12-26 01:02:01,136][123090] Updated weights for policy 1, policy_version 180928 (0.0009) [2023-12-26 01:02:01,895][123091] Updated weights for policy 0, policy_version 181737 (0.0008) [2023-12-26 01:02:01,911][123090] Updated weights for policy 1, policy_version 180938 (0.0009) [2023-12-26 01:02:01,940][123091] Updated weights for policy 0, policy_version 181747 (0.0008) [2023-12-26 01:02:01,974][123090] Updated weights for policy 1, policy_version 180948 (0.0009) [2023-12-26 01:02:01,989][123091] Updated weights for policy 0, policy_version 181757 (0.0006) [2023-12-26 01:02:02,037][123090] Updated weights for policy 1, policy_version 180958 (0.0009) [2023-12-26 01:02:02,673][123091] Updated weights for policy 0, policy_version 181767 (0.0006) [2023-12-26 01:02:02,740][123091] Updated weights for policy 0, policy_version 181777 (0.0009) [2023-12-26 01:02:02,741][123090] Updated weights for policy 1, policy_version 180968 (0.0007) [2023-12-26 01:02:02,793][123090] Updated weights for policy 1, policy_version 180979 (0.0008) [2023-12-26 01:02:02,805][123091] Updated weights for policy 0, policy_version 181787 (0.0008) [2023-12-26 01:02:02,839][123090] Updated weights for policy 1, policy_version 180989 (0.0008) [2023-12-26 01:02:03,406][123091] Updated weights for policy 0, policy_version 181797 (0.0007) [2023-12-26 01:02:03,469][123091] Updated weights for policy 0, policy_version 181807 (0.0008) [2023-12-26 01:02:03,525][123091] Updated weights for policy 0, policy_version 181817 (0.0009) [2023-12-26 01:02:03,742][123090] Updated weights for policy 1, policy_version 180999 (0.0010) [2023-12-26 01:02:03,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 92880896. Throughput: 0: 8709.9, 1: 8735.4. Samples: 92895192. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:03,785][121949] Avg episode reward: [(0, '5622.955'), (1, '5413.770')] [2023-12-26 01:02:03,796][123090] Updated weights for policy 1, policy_version 181011 (0.0010) [2023-12-26 01:02:03,854][123090] Updated weights for policy 1, policy_version 181022 (0.0009) [2023-12-26 01:02:04,240][123091] Updated weights for policy 0, policy_version 181827 (0.0006) [2023-12-26 01:02:04,303][123091] Updated weights for policy 0, policy_version 181837 (0.0009) [2023-12-26 01:02:04,364][123091] Updated weights for policy 0, policy_version 181847 (0.0009) [2023-12-26 01:02:04,709][123090] Updated weights for policy 1, policy_version 181032 (0.0010) [2023-12-26 01:02:04,769][123090] Updated weights for policy 1, policy_version 181042 (0.0011) [2023-12-26 01:02:04,822][123090] Updated weights for policy 1, policy_version 181052 (0.0011) [2023-12-26 01:02:05,222][123091] Updated weights for policy 0, policy_version 181857 (0.0009) [2023-12-26 01:02:05,283][123091] Updated weights for policy 0, policy_version 181867 (0.0009) [2023-12-26 01:02:05,336][123091] Updated weights for policy 0, policy_version 181877 (0.0010) [2023-12-26 01:02:05,390][123091] Updated weights for policy 0, policy_version 181888 (0.0010) [2023-12-26 01:02:05,487][123090] Updated weights for policy 1, policy_version 181062 (0.0007) [2023-12-26 01:02:05,540][123090] Updated weights for policy 1, policy_version 181072 (0.0005) [2023-12-26 01:02:05,595][123090] Updated weights for policy 1, policy_version 181082 (0.0005) [2023-12-26 01:02:06,091][123090] Updated weights for policy 1, policy_version 181092 (0.0005) [2023-12-26 01:02:06,156][123090] Updated weights for policy 1, policy_version 181102 (0.0010) [2023-12-26 01:02:06,224][123090] Updated weights for policy 1, policy_version 181112 (0.0010) [2023-12-26 01:02:06,317][123091] Updated weights for policy 0, policy_version 181898 (0.0009) [2023-12-26 01:02:06,382][123091] Updated weights for policy 0, policy_version 181908 (0.0009) [2023-12-26 01:02:06,455][123091] Updated weights for policy 0, policy_version 181918 (0.0009) [2023-12-26 01:02:07,030][123090] Updated weights for policy 1, policy_version 181122 (0.0011) [2023-12-26 01:02:07,079][123090] Updated weights for policy 1, policy_version 181132 (0.0010) [2023-12-26 01:02:07,134][123090] Updated weights for policy 1, policy_version 181142 (0.0010) [2023-12-26 01:02:07,185][123090] Updated weights for policy 1, policy_version 181152 (0.0010) [2023-12-26 01:02:07,278][123091] Updated weights for policy 0, policy_version 181928 (0.0009) [2023-12-26 01:02:07,338][123091] Updated weights for policy 0, policy_version 181938 (0.0009) [2023-12-26 01:02:07,390][123091] Updated weights for policy 0, policy_version 181948 (0.0009) [2023-12-26 01:02:07,984][123090] Updated weights for policy 1, policy_version 181162 (0.0010) [2023-12-26 01:02:08,046][123090] Updated weights for policy 1, policy_version 181172 (0.0010) [2023-12-26 01:02:08,093][123090] Updated weights for policy 1, policy_version 181182 (0.0010) [2023-12-26 01:02:08,269][123091] Updated weights for policy 0, policy_version 181958 (0.0009) [2023-12-26 01:02:08,326][123091] Updated weights for policy 0, policy_version 181968 (0.0009) [2023-12-26 01:02:08,391][123091] Updated weights for policy 0, policy_version 181978 (0.0009) [2023-12-26 01:02:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 92971008. Throughput: 0: 8668.5, 1: 8784.9. Samples: 92948156. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:08,785][121949] Avg episode reward: [(0, '5586.864'), (1, '5416.189')] [2023-12-26 01:02:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000181184_46383104.pth... [2023-12-26 01:02:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000181984_46587904.pth... [2023-12-26 01:02:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000180160_46120960.pth [2023-12-26 01:02:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000180960_46325760.pth [2023-12-26 01:02:08,898][123090] Updated weights for policy 1, policy_version 181192 (0.0007) [2023-12-26 01:02:08,963][123090] Updated weights for policy 1, policy_version 181202 (0.0006) [2023-12-26 01:02:09,035][123090] Updated weights for policy 1, policy_version 181212 (0.0006) [2023-12-26 01:02:09,210][123091] Updated weights for policy 0, policy_version 181988 (0.0009) [2023-12-26 01:02:09,281][123091] Updated weights for policy 0, policy_version 181998 (0.0010) [2023-12-26 01:02:09,352][123091] Updated weights for policy 0, policy_version 182008 (0.0010) [2023-12-26 01:02:09,856][123090] Updated weights for policy 1, policy_version 181222 (0.0009) [2023-12-26 01:02:09,918][123090] Updated weights for policy 1, policy_version 181232 (0.0010) [2023-12-26 01:02:09,985][123090] Updated weights for policy 1, policy_version 181242 (0.0008) [2023-12-26 01:02:10,166][123091] Updated weights for policy 0, policy_version 182018 (0.0010) [2023-12-26 01:02:10,231][123091] Updated weights for policy 0, policy_version 182028 (0.0009) [2023-12-26 01:02:10,301][123091] Updated weights for policy 0, policy_version 182038 (0.0010) [2023-12-26 01:02:10,372][123091] Updated weights for policy 0, policy_version 182048 (0.0010) [2023-12-26 01:02:10,721][123090] Updated weights for policy 1, policy_version 181252 (0.0007) [2023-12-26 01:02:10,782][123090] Updated weights for policy 1, policy_version 181262 (0.0009) [2023-12-26 01:02:10,837][123090] Updated weights for policy 1, policy_version 181272 (0.0009) [2023-12-26 01:02:11,227][123091] Updated weights for policy 0, policy_version 182058 (0.0006) [2023-12-26 01:02:11,293][123091] Updated weights for policy 0, policy_version 182068 (0.0007) [2023-12-26 01:02:11,343][123091] Updated weights for policy 0, policy_version 182078 (0.0007) [2023-12-26 01:02:11,729][123090] Updated weights for policy 1, policy_version 181282 (0.0010) [2023-12-26 01:02:11,793][123090] Updated weights for policy 1, policy_version 181292 (0.0010) [2023-12-26 01:02:11,852][123090] Updated weights for policy 1, policy_version 181302 (0.0010) [2023-12-26 01:02:11,915][123090] Updated weights for policy 1, policy_version 181312 (0.0009) [2023-12-26 01:02:12,183][123091] Updated weights for policy 0, policy_version 182088 (0.0010) [2023-12-26 01:02:12,233][123091] Updated weights for policy 0, policy_version 182098 (0.0010) [2023-12-26 01:02:12,295][123091] Updated weights for policy 0, policy_version 182108 (0.0010) [2023-12-26 01:02:12,741][123090] Updated weights for policy 1, policy_version 181322 (0.0007) [2023-12-26 01:02:12,806][123090] Updated weights for policy 1, policy_version 181332 (0.0008) [2023-12-26 01:02:12,867][123090] Updated weights for policy 1, policy_version 181342 (0.0005) [2023-12-26 01:02:13,214][123091] Updated weights for policy 0, policy_version 182118 (0.0009) [2023-12-26 01:02:13,275][123091] Updated weights for policy 0, policy_version 182128 (0.0009) [2023-12-26 01:02:13,339][123091] Updated weights for policy 0, policy_version 182138 (0.0009) [2023-12-26 01:02:13,605][123090] Updated weights for policy 1, policy_version 181352 (0.0009) [2023-12-26 01:02:13,656][123090] Updated weights for policy 1, policy_version 181362 (0.0009) [2023-12-26 01:02:13,705][123090] Updated weights for policy 1, policy_version 181372 (0.0009) [2023-12-26 01:02:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 93061120. Throughput: 0: 8682.4, 1: 8715.5. Samples: 93050588. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:13,785][121949] Avg episode reward: [(0, '5584.696'), (1, '5449.268')] [2023-12-26 01:02:14,119][123091] Updated weights for policy 0, policy_version 182148 (0.0010) [2023-12-26 01:02:14,171][123091] Updated weights for policy 0, policy_version 182158 (0.0009) [2023-12-26 01:02:14,225][123091] Updated weights for policy 0, policy_version 182168 (0.0009) [2023-12-26 01:02:14,585][123090] Updated weights for policy 1, policy_version 181382 (0.0009) [2023-12-26 01:02:14,639][123090] Updated weights for policy 1, policy_version 181392 (0.0009) [2023-12-26 01:02:14,689][123090] Updated weights for policy 1, policy_version 181402 (0.0009) [2023-12-26 01:02:15,078][123091] Updated weights for policy 0, policy_version 182178 (0.0009) [2023-12-26 01:02:15,132][123091] Updated weights for policy 0, policy_version 182188 (0.0009) [2023-12-26 01:02:15,186][123091] Updated weights for policy 0, policy_version 182198 (0.0009) [2023-12-26 01:02:15,249][123091] Updated weights for policy 0, policy_version 182208 (0.0008) [2023-12-26 01:02:15,533][123090] Updated weights for policy 1, policy_version 181412 (0.0010) [2023-12-26 01:02:15,594][123090] Updated weights for policy 1, policy_version 181422 (0.0009) [2023-12-26 01:02:15,650][123090] Updated weights for policy 1, policy_version 181432 (0.0006) [2023-12-26 01:02:16,124][123091] Updated weights for policy 0, policy_version 182218 (0.0009) [2023-12-26 01:02:16,187][123091] Updated weights for policy 0, policy_version 182228 (0.0009) [2023-12-26 01:02:16,261][123091] Updated weights for policy 0, policy_version 182238 (0.0010) [2023-12-26 01:02:16,315][123090] Updated weights for policy 1, policy_version 181442 (0.0005) [2023-12-26 01:02:16,378][123090] Updated weights for policy 1, policy_version 181452 (0.0005) [2023-12-26 01:02:16,438][123090] Updated weights for policy 1, policy_version 181462 (0.0005) [2023-12-26 01:02:17,110][123091] Updated weights for policy 0, policy_version 182248 (0.0010) [2023-12-26 01:02:17,145][123090] Updated weights for policy 1, policy_version 181473 (0.0009) [2023-12-26 01:02:17,169][123091] Updated weights for policy 0, policy_version 182258 (0.0009) [2023-12-26 01:02:17,194][123090] Updated weights for policy 1, policy_version 181483 (0.0005) [2023-12-26 01:02:17,228][123091] Updated weights for policy 0, policy_version 182268 (0.0009) [2023-12-26 01:02:17,245][123090] Updated weights for policy 1, policy_version 181493 (0.0005) [2023-12-26 01:02:17,304][123090] Updated weights for policy 1, policy_version 181503 (0.0005) [2023-12-26 01:02:17,986][123090] Updated weights for policy 1, policy_version 181513 (0.0008) [2023-12-26 01:02:18,045][123090] Updated weights for policy 1, policy_version 181523 (0.0007) [2023-12-26 01:02:18,091][123091] Updated weights for policy 0, policy_version 182278 (0.0010) [2023-12-26 01:02:18,106][123090] Updated weights for policy 1, policy_version 181533 (0.0008) [2023-12-26 01:02:18,149][123091] Updated weights for policy 0, policy_version 182288 (0.0010) [2023-12-26 01:02:18,208][123091] Updated weights for policy 0, policy_version 182298 (0.0010) [2023-12-26 01:02:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 93143040. Throughput: 0: 8588.1, 1: 8806.7. Samples: 93156820. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:18,785][121949] Avg episode reward: [(0, '5628.820'), (1, '5392.264')] [2023-12-26 01:02:18,953][123090] Updated weights for policy 1, policy_version 181543 (0.0009) [2023-12-26 01:02:19,005][123090] Updated weights for policy 1, policy_version 181553 (0.0009) [2023-12-26 01:02:19,039][123091] Updated weights for policy 0, policy_version 182308 (0.0009) [2023-12-26 01:02:19,053][123090] Updated weights for policy 1, policy_version 181563 (0.0009) [2023-12-26 01:02:19,084][123091] Updated weights for policy 0, policy_version 182318 (0.0005) [2023-12-26 01:02:19,140][123091] Updated weights for policy 0, policy_version 182328 (0.0005) [2023-12-26 01:02:19,918][123091] Updated weights for policy 0, policy_version 182338 (0.0006) [2023-12-26 01:02:19,931][123090] Updated weights for policy 1, policy_version 181574 (0.0009) [2023-12-26 01:02:19,984][123091] Updated weights for policy 0, policy_version 182348 (0.0011) [2023-12-26 01:02:19,996][123090] Updated weights for policy 1, policy_version 181584 (0.0006) [2023-12-26 01:02:20,048][123091] Updated weights for policy 0, policy_version 182358 (0.0009) [2023-12-26 01:02:20,062][123090] Updated weights for policy 1, policy_version 181594 (0.0009) [2023-12-26 01:02:20,121][123091] Updated weights for policy 0, policy_version 182368 (0.0008) [2023-12-26 01:02:20,924][123091] Updated weights for policy 0, policy_version 182378 (0.0009) [2023-12-26 01:02:20,952][123090] Updated weights for policy 1, policy_version 181604 (0.0008) [2023-12-26 01:02:20,994][123091] Updated weights for policy 0, policy_version 182388 (0.0009) [2023-12-26 01:02:21,020][123090] Updated weights for policy 1, policy_version 181614 (0.0008) [2023-12-26 01:02:21,064][123091] Updated weights for policy 0, policy_version 182398 (0.0008) [2023-12-26 01:02:21,098][123090] Updated weights for policy 1, policy_version 181624 (0.0009) [2023-12-26 01:02:21,805][123091] Updated weights for policy 0, policy_version 182408 (0.0009) [2023-12-26 01:02:21,871][123091] Updated weights for policy 0, policy_version 182418 (0.0010) [2023-12-26 01:02:21,933][123091] Updated weights for policy 0, policy_version 182428 (0.0009) [2023-12-26 01:02:21,946][123090] Updated weights for policy 1, policy_version 181634 (0.0009) [2023-12-26 01:02:22,013][123090] Updated weights for policy 1, policy_version 181644 (0.0009) [2023-12-26 01:02:22,084][123090] Updated weights for policy 1, policy_version 181654 (0.0007) [2023-12-26 01:02:22,153][123090] Updated weights for policy 1, policy_version 181664 (0.0010) [2023-12-26 01:02:22,825][123091] Updated weights for policy 0, policy_version 182438 (0.0009) [2023-12-26 01:02:22,882][123091] Updated weights for policy 0, policy_version 182448 (0.0009) [2023-12-26 01:02:22,937][123091] Updated weights for policy 0, policy_version 182458 (0.0008) [2023-12-26 01:02:22,977][123090] Updated weights for policy 1, policy_version 181674 (0.0010) [2023-12-26 01:02:23,040][123090] Updated weights for policy 1, policy_version 181684 (0.0010) [2023-12-26 01:02:23,106][123090] Updated weights for policy 1, policy_version 181694 (0.0010) [2023-12-26 01:02:23,703][123091] Updated weights for policy 0, policy_version 182468 (0.0006) [2023-12-26 01:02:23,751][123091] Updated weights for policy 0, policy_version 182478 (0.0006) [2023-12-26 01:02:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 93224960. Throughput: 0: 8599.2, 1: 8792.5. Samples: 93207992. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:23,785][121949] Avg episode reward: [(0, '5572.450'), (1, '5329.537')] [2023-12-26 01:02:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000181696_46514176.pth... [2023-12-26 01:02:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000180672_46252032.pth [2023-12-26 01:02:23,806][123091] Updated weights for policy 0, policy_version 182488 (0.0007) [2023-12-26 01:02:23,856][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000182496_46718976.pth... [2023-12-26 01:02:23,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000181472_46456832.pth [2023-12-26 01:02:23,903][123090] Updated weights for policy 1, policy_version 181704 (0.0007) [2023-12-26 01:02:23,971][123090] Updated weights for policy 1, policy_version 181714 (0.0005) [2023-12-26 01:02:24,032][123090] Updated weights for policy 1, policy_version 181724 (0.0005) [2023-12-26 01:02:24,634][123091] Updated weights for policy 0, policy_version 182498 (0.0007) [2023-12-26 01:02:24,702][123091] Updated weights for policy 0, policy_version 182508 (0.0009) [2023-12-26 01:02:24,774][123091] Updated weights for policy 0, policy_version 182518 (0.0007) [2023-12-26 01:02:24,805][123090] Updated weights for policy 1, policy_version 181734 (0.0009) [2023-12-26 01:02:24,834][123091] Updated weights for policy 0, policy_version 182528 (0.0006) [2023-12-26 01:02:24,872][123090] Updated weights for policy 1, policy_version 181744 (0.0010) [2023-12-26 01:02:24,935][123090] Updated weights for policy 1, policy_version 181754 (0.0011) [2023-12-26 01:02:25,578][123091] Updated weights for policy 0, policy_version 182538 (0.0006) [2023-12-26 01:02:25,636][123091] Updated weights for policy 0, policy_version 182548 (0.0006) [2023-12-26 01:02:25,685][123091] Updated weights for policy 0, policy_version 182558 (0.0010) [2023-12-26 01:02:25,716][123090] Updated weights for policy 1, policy_version 181764 (0.0008) [2023-12-26 01:02:25,772][123090] Updated weights for policy 1, policy_version 181774 (0.0005) [2023-12-26 01:02:25,825][123090] Updated weights for policy 1, policy_version 181784 (0.0005) [2023-12-26 01:02:26,386][123091] Updated weights for policy 0, policy_version 182568 (0.0006) [2023-12-26 01:02:26,440][123091] Updated weights for policy 0, policy_version 182578 (0.0005) [2023-12-26 01:02:26,498][123091] Updated weights for policy 0, policy_version 182588 (0.0006) [2023-12-26 01:02:26,594][123090] Updated weights for policy 1, policy_version 181794 (0.0006) [2023-12-26 01:02:26,656][123090] Updated weights for policy 1, policy_version 181804 (0.0010) [2023-12-26 01:02:26,720][123090] Updated weights for policy 1, policy_version 181814 (0.0010) [2023-12-26 01:02:26,790][123090] Updated weights for policy 1, policy_version 181824 (0.0011) [2023-12-26 01:02:27,255][123091] Updated weights for policy 0, policy_version 182598 (0.0007) [2023-12-26 01:02:27,308][123091] Updated weights for policy 0, policy_version 182608 (0.0005) [2023-12-26 01:02:27,367][123091] Updated weights for policy 0, policy_version 182618 (0.0006) [2023-12-26 01:02:27,522][123090] Updated weights for policy 1, policy_version 181834 (0.0005) [2023-12-26 01:02:27,581][123090] Updated weights for policy 1, policy_version 181844 (0.0006) [2023-12-26 01:02:27,636][123090] Updated weights for policy 1, policy_version 181854 (0.0010) [2023-12-26 01:02:28,114][123091] Updated weights for policy 0, policy_version 182628 (0.0007) [2023-12-26 01:02:28,171][123091] Updated weights for policy 0, policy_version 182638 (0.0010) [2023-12-26 01:02:28,209][123090] Updated weights for policy 1, policy_version 181864 (0.0010) [2023-12-26 01:02:28,232][123091] Updated weights for policy 0, policy_version 182648 (0.0010) [2023-12-26 01:02:28,256][123090] Updated weights for policy 1, policy_version 181874 (0.0010) [2023-12-26 01:02:28,310][123090] Updated weights for policy 1, policy_version 181884 (0.0010) [2023-12-26 01:02:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 93323264. Throughput: 0: 8707.4, 1: 8854.8. Samples: 93316608. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:28,785][121949] Avg episode reward: [(0, '5592.104'), (1, '5346.662')] [2023-12-26 01:02:29,038][123091] Updated weights for policy 0, policy_version 182658 (0.0010) [2023-12-26 01:02:29,085][123091] Updated weights for policy 0, policy_version 182668 (0.0010) [2023-12-26 01:02:29,126][123090] Updated weights for policy 1, policy_version 181894 (0.0007) [2023-12-26 01:02:29,129][123091] Updated weights for policy 0, policy_version 182678 (0.0010) [2023-12-26 01:02:29,175][123091] Updated weights for policy 0, policy_version 182688 (0.0008) [2023-12-26 01:02:29,182][123090] Updated weights for policy 1, policy_version 181904 (0.0008) [2023-12-26 01:02:29,251][123090] Updated weights for policy 1, policy_version 181914 (0.0009) [2023-12-26 01:02:30,038][123091] Updated weights for policy 0, policy_version 182698 (0.0009) [2023-12-26 01:02:30,102][123091] Updated weights for policy 0, policy_version 182708 (0.0009) [2023-12-26 01:02:30,121][123090] Updated weights for policy 1, policy_version 181924 (0.0010) [2023-12-26 01:02:30,155][123091] Updated weights for policy 0, policy_version 182718 (0.0006) [2023-12-26 01:02:30,169][123090] Updated weights for policy 1, policy_version 181934 (0.0010) [2023-12-26 01:02:30,231][123090] Updated weights for policy 1, policy_version 181944 (0.0010) [2023-12-26 01:02:30,994][123090] Updated weights for policy 1, policy_version 181954 (0.0010) [2023-12-26 01:02:31,009][123091] Updated weights for policy 0, policy_version 182728 (0.0008) [2023-12-26 01:02:31,066][123090] Updated weights for policy 1, policy_version 181964 (0.0009) [2023-12-26 01:02:31,072][123091] Updated weights for policy 0, policy_version 182738 (0.0009) [2023-12-26 01:02:31,124][123090] Updated weights for policy 1, policy_version 181974 (0.0009) [2023-12-26 01:02:31,142][123091] Updated weights for policy 0, policy_version 182748 (0.0008) [2023-12-26 01:02:31,189][123090] Updated weights for policy 1, policy_version 181984 (0.0008) [2023-12-26 01:02:31,930][123091] Updated weights for policy 0, policy_version 182758 (0.0006) [2023-12-26 01:02:31,992][123091] Updated weights for policy 0, policy_version 182768 (0.0005) [2023-12-26 01:02:32,031][123090] Updated weights for policy 1, policy_version 181994 (0.0009) [2023-12-26 01:02:32,057][123091] Updated weights for policy 0, policy_version 182778 (0.0006) [2023-12-26 01:02:32,089][123090] Updated weights for policy 1, policy_version 182004 (0.0008) [2023-12-26 01:02:32,146][123090] Updated weights for policy 1, policy_version 182014 (0.0010) [2023-12-26 01:02:32,779][123091] Updated weights for policy 0, policy_version 182788 (0.0009) [2023-12-26 01:02:32,835][123091] Updated weights for policy 0, policy_version 182798 (0.0009) [2023-12-26 01:02:32,896][123091] Updated weights for policy 0, policy_version 182808 (0.0009) [2023-12-26 01:02:32,978][123090] Updated weights for policy 1, policy_version 182024 (0.0010) [2023-12-26 01:02:33,029][123090] Updated weights for policy 1, policy_version 182034 (0.0010) [2023-12-26 01:02:33,083][123090] Updated weights for policy 1, policy_version 182044 (0.0010) [2023-12-26 01:02:33,576][123091] Updated weights for policy 0, policy_version 182818 (0.0009) [2023-12-26 01:02:33,647][123091] Updated weights for policy 0, policy_version 182828 (0.0005) [2023-12-26 01:02:33,723][123091] Updated weights for policy 0, policy_version 182838 (0.0005) [2023-12-26 01:02:33,779][123091] Updated weights for policy 0, policy_version 182848 (0.0005) [2023-12-26 01:02:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 93413376. Throughput: 0: 8731.9, 1: 8879.4. Samples: 93424080. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:33,785][121949] Avg episode reward: [(0, '5604.739'), (1, '5403.127')] [2023-12-26 01:02:33,918][123090] Updated weights for policy 1, policy_version 182054 (0.0010) [2023-12-26 01:02:33,970][123090] Updated weights for policy 1, policy_version 182064 (0.0007) [2023-12-26 01:02:34,020][123090] Updated weights for policy 1, policy_version 182074 (0.0005) [2023-12-26 01:02:34,483][123091] Updated weights for policy 0, policy_version 182858 (0.0009) [2023-12-26 01:02:34,549][123091] Updated weights for policy 0, policy_version 182868 (0.0007) [2023-12-26 01:02:34,611][123091] Updated weights for policy 0, policy_version 182878 (0.0005) [2023-12-26 01:02:34,724][123090] Updated weights for policy 1, policy_version 182084 (0.0005) [2023-12-26 01:02:34,795][123090] Updated weights for policy 1, policy_version 182094 (0.0006) [2023-12-26 01:02:34,861][123090] Updated weights for policy 1, policy_version 182104 (0.0005) [2023-12-26 01:02:35,466][123091] Updated weights for policy 0, policy_version 182888 (0.0008) [2023-12-26 01:02:35,520][123091] Updated weights for policy 0, policy_version 182898 (0.0009) [2023-12-26 01:02:35,546][123090] Updated weights for policy 1, policy_version 182114 (0.0006) [2023-12-26 01:02:35,572][123091] Updated weights for policy 0, policy_version 182908 (0.0009) [2023-12-26 01:02:35,601][123090] Updated weights for policy 1, policy_version 182124 (0.0007) [2023-12-26 01:02:35,653][123090] Updated weights for policy 1, policy_version 182134 (0.0009) [2023-12-26 01:02:35,703][123090] Updated weights for policy 1, policy_version 182144 (0.0008) [2023-12-26 01:02:36,462][123091] Updated weights for policy 0, policy_version 182918 (0.0009) [2023-12-26 01:02:36,520][123090] Updated weights for policy 1, policy_version 182154 (0.0006) [2023-12-26 01:02:36,528][123091] Updated weights for policy 0, policy_version 182928 (0.0009) [2023-12-26 01:02:36,589][123090] Updated weights for policy 1, policy_version 182164 (0.0006) [2023-12-26 01:02:36,592][123091] Updated weights for policy 0, policy_version 182938 (0.0008) [2023-12-26 01:02:36,655][123090] Updated weights for policy 1, policy_version 182174 (0.0006) [2023-12-26 01:02:37,298][123090] Updated weights for policy 1, policy_version 182184 (0.0005) [2023-12-26 01:02:37,352][123090] Updated weights for policy 1, policy_version 182194 (0.0005) [2023-12-26 01:02:37,393][123091] Updated weights for policy 0, policy_version 182948 (0.0009) [2023-12-26 01:02:37,412][123090] Updated weights for policy 1, policy_version 182204 (0.0009) [2023-12-26 01:02:37,451][123091] Updated weights for policy 0, policy_version 182958 (0.0007) [2023-12-26 01:02:37,515][123091] Updated weights for policy 0, policy_version 182968 (0.0009) [2023-12-26 01:02:38,143][123090] Updated weights for policy 1, policy_version 182214 (0.0008) [2023-12-26 01:02:38,210][123090] Updated weights for policy 1, policy_version 182224 (0.0010) [2023-12-26 01:02:38,290][123090] Updated weights for policy 1, policy_version 182234 (0.0006) [2023-12-26 01:02:38,329][123091] Updated weights for policy 0, policy_version 182978 (0.0009) [2023-12-26 01:02:38,402][123091] Updated weights for policy 0, policy_version 182988 (0.0007) [2023-12-26 01:02:38,467][123091] Updated weights for policy 0, policy_version 182998 (0.0011) [2023-12-26 01:02:38,523][123091] Updated weights for policy 0, policy_version 183008 (0.0010) [2023-12-26 01:02:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 93503488. Throughput: 0: 8721.3, 1: 8950.9. Samples: 93478052. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:38,785][121949] Avg episode reward: [(0, '5673.203'), (1, '5435.996')] [2023-12-26 01:02:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000183008_46850048.pth... [2023-12-26 01:02:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000182240_46653440.pth... [2023-12-26 01:02:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000181984_46587904.pth [2023-12-26 01:02:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000181184_46383104.pth [2023-12-26 01:02:38,924][123090] Updated weights for policy 1, policy_version 182244 (0.0007) [2023-12-26 01:02:38,993][123090] Updated weights for policy 1, policy_version 182254 (0.0006) [2023-12-26 01:02:39,053][123090] Updated weights for policy 1, policy_version 182264 (0.0005) [2023-12-26 01:02:39,233][123091] Updated weights for policy 0, policy_version 183018 (0.0006) [2023-12-26 01:02:39,296][123091] Updated weights for policy 0, policy_version 183028 (0.0009) [2023-12-26 01:02:39,361][123091] Updated weights for policy 0, policy_version 183038 (0.0010) [2023-12-26 01:02:39,828][123090] Updated weights for policy 1, policy_version 182274 (0.0006) [2023-12-26 01:02:39,892][123090] Updated weights for policy 1, policy_version 182284 (0.0008) [2023-12-26 01:02:39,965][123090] Updated weights for policy 1, policy_version 182294 (0.0010) [2023-12-26 01:02:40,035][123090] Updated weights for policy 1, policy_version 182304 (0.0008) [2023-12-26 01:02:40,136][123091] Updated weights for policy 0, policy_version 183048 (0.0008) [2023-12-26 01:02:40,202][123091] Updated weights for policy 0, policy_version 183058 (0.0009) [2023-12-26 01:02:40,256][123091] Updated weights for policy 0, policy_version 183068 (0.0009) [2023-12-26 01:02:40,782][123090] Updated weights for policy 1, policy_version 182314 (0.0008) [2023-12-26 01:02:40,844][123090] Updated weights for policy 1, policy_version 182324 (0.0009) [2023-12-26 01:02:40,904][123090] Updated weights for policy 1, policy_version 182334 (0.0009) [2023-12-26 01:02:41,049][123091] Updated weights for policy 0, policy_version 183078 (0.0008) [2023-12-26 01:02:41,116][123091] Updated weights for policy 0, policy_version 183088 (0.0006) [2023-12-26 01:02:41,180][123091] Updated weights for policy 0, policy_version 183098 (0.0007) [2023-12-26 01:02:41,800][123090] Updated weights for policy 1, policy_version 182344 (0.0010) [2023-12-26 01:02:41,864][123090] Updated weights for policy 1, policy_version 182354 (0.0011) [2023-12-26 01:02:41,936][123090] Updated weights for policy 1, policy_version 182364 (0.0011) [2023-12-26 01:02:41,993][123091] Updated weights for policy 0, policy_version 183108 (0.0007) [2023-12-26 01:02:42,047][123091] Updated weights for policy 0, policy_version 183118 (0.0009) [2023-12-26 01:02:42,115][123091] Updated weights for policy 0, policy_version 183128 (0.0009) [2023-12-26 01:02:42,773][123090] Updated weights for policy 1, policy_version 182374 (0.0011) [2023-12-26 01:02:42,836][123090] Updated weights for policy 1, policy_version 182384 (0.0010) [2023-12-26 01:02:42,897][123090] Updated weights for policy 1, policy_version 182394 (0.0010) [2023-12-26 01:02:43,010][123091] Updated weights for policy 0, policy_version 183138 (0.0009) [2023-12-26 01:02:43,070][123091] Updated weights for policy 0, policy_version 183148 (0.0009) [2023-12-26 01:02:43,132][123091] Updated weights for policy 0, policy_version 183158 (0.0008) [2023-12-26 01:02:43,188][123091] Updated weights for policy 0, policy_version 183168 (0.0009) [2023-12-26 01:02:43,721][123090] Updated weights for policy 1, policy_version 182404 (0.0011) [2023-12-26 01:02:43,784][123090] Updated weights for policy 1, policy_version 182414 (0.0010) [2023-12-26 01:02:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 93585408. Throughput: 0: 8718.5, 1: 8964.5. Samples: 93584544. Policy #0 lag: (min: 22.0, avg: 38.7, max: 40.0) [2023-12-26 01:02:43,785][121949] Avg episode reward: [(0, '5687.010'), (1, '5413.251')] [2023-12-26 01:02:43,839][123090] Updated weights for policy 1, policy_version 182424 (0.0010) [2023-12-26 01:02:44,019][123091] Updated weights for policy 0, policy_version 183178 (0.0009) [2023-12-26 01:02:44,071][123091] Updated weights for policy 0, policy_version 183188 (0.0009) [2023-12-26 01:02:44,119][123091] Updated weights for policy 0, policy_version 183198 (0.0009) [2023-12-26 01:02:44,661][123090] Updated weights for policy 1, policy_version 182434 (0.0010) [2023-12-26 01:02:44,717][123090] Updated weights for policy 1, policy_version 182444 (0.0010) [2023-12-26 01:02:44,784][123090] Updated weights for policy 1, policy_version 182454 (0.0011) [2023-12-26 01:02:44,854][123090] Updated weights for policy 1, policy_version 182464 (0.0011) [2023-12-26 01:02:44,948][123091] Updated weights for policy 0, policy_version 183208 (0.0010) [2023-12-26 01:02:45,016][123091] Updated weights for policy 0, policy_version 183218 (0.0011) [2023-12-26 01:02:45,091][123091] Updated weights for policy 0, policy_version 183228 (0.0011) [2023-12-26 01:02:45,672][123090] Updated weights for policy 1, policy_version 182474 (0.0010) [2023-12-26 01:02:45,720][123090] Updated weights for policy 1, policy_version 182484 (0.0010) [2023-12-26 01:02:45,772][123090] Updated weights for policy 1, policy_version 182494 (0.0010) [2023-12-26 01:02:45,898][123091] Updated weights for policy 0, policy_version 183238 (0.0011) [2023-12-26 01:02:45,956][123091] Updated weights for policy 0, policy_version 183248 (0.0010) [2023-12-26 01:02:46,022][123091] Updated weights for policy 0, policy_version 183258 (0.0010) [2023-12-26 01:02:46,533][123090] Updated weights for policy 1, policy_version 182504 (0.0007) [2023-12-26 01:02:46,579][123090] Updated weights for policy 1, policy_version 182514 (0.0005) [2023-12-26 01:02:46,630][123090] Updated weights for policy 1, policy_version 182524 (0.0008) [2023-12-26 01:02:46,825][123091] Updated weights for policy 0, policy_version 183268 (0.0010) [2023-12-26 01:02:46,880][123091] Updated weights for policy 0, policy_version 183278 (0.0010) [2023-12-26 01:02:46,935][123091] Updated weights for policy 0, policy_version 183288 (0.0010) [2023-12-26 01:02:47,385][123090] Updated weights for policy 1, policy_version 182534 (0.0011) [2023-12-26 01:02:47,437][123090] Updated weights for policy 1, policy_version 182544 (0.0010) [2023-12-26 01:02:47,500][123090] Updated weights for policy 1, policy_version 182554 (0.0010) [2023-12-26 01:02:47,714][123091] Updated weights for policy 0, policy_version 183298 (0.0010) [2023-12-26 01:02:47,776][123091] Updated weights for policy 0, policy_version 183308 (0.0006) [2023-12-26 01:02:47,834][123091] Updated weights for policy 0, policy_version 183318 (0.0006) [2023-12-26 01:02:47,894][123091] Updated weights for policy 0, policy_version 183328 (0.0005) [2023-12-26 01:02:48,186][123090] Updated weights for policy 1, policy_version 182564 (0.0008) [2023-12-26 01:02:48,245][123090] Updated weights for policy 1, policy_version 182574 (0.0010) [2023-12-26 01:02:48,298][123090] Updated weights for policy 1, policy_version 182584 (0.0010) [2023-12-26 01:02:48,577][123091] Updated weights for policy 0, policy_version 183338 (0.0010) [2023-12-26 01:02:48,640][123091] Updated weights for policy 0, policy_version 183348 (0.0011) [2023-12-26 01:02:48,706][123091] Updated weights for policy 0, policy_version 183358 (0.0011) [2023-12-26 01:02:48,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 93683712. Throughput: 0: 8704.2, 1: 8979.2. Samples: 93690940. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:02:48,785][121949] Avg episode reward: [(0, '5658.029'), (1, '5294.837')] [2023-12-26 01:02:49,133][123090] Updated weights for policy 1, policy_version 182594 (0.0010) [2023-12-26 01:02:49,203][123090] Updated weights for policy 1, policy_version 182604 (0.0010) [2023-12-26 01:02:49,274][123090] Updated weights for policy 1, policy_version 182614 (0.0010) [2023-12-26 01:02:49,341][123090] Updated weights for policy 1, policy_version 182624 (0.0010) [2023-12-26 01:02:49,495][123091] Updated weights for policy 0, policy_version 183368 (0.0009) [2023-12-26 01:02:49,557][123091] Updated weights for policy 0, policy_version 183378 (0.0010) [2023-12-26 01:02:49,615][123091] Updated weights for policy 0, policy_version 183388 (0.0011) [2023-12-26 01:02:50,133][123090] Updated weights for policy 1, policy_version 182634 (0.0010) [2023-12-26 01:02:50,209][123090] Updated weights for policy 1, policy_version 182644 (0.0010) [2023-12-26 01:02:50,279][123090] Updated weights for policy 1, policy_version 182654 (0.0010) [2023-12-26 01:02:50,376][123091] Updated weights for policy 0, policy_version 183398 (0.0011) [2023-12-26 01:02:50,440][123091] Updated weights for policy 0, policy_version 183408 (0.0006) [2023-12-26 01:02:50,502][123091] Updated weights for policy 0, policy_version 183418 (0.0006) [2023-12-26 01:02:51,049][123090] Updated weights for policy 1, policy_version 182664 (0.0011) [2023-12-26 01:02:51,122][123090] Updated weights for policy 1, policy_version 182674 (0.0009) [2023-12-26 01:02:51,191][123090] Updated weights for policy 1, policy_version 182684 (0.0010) [2023-12-26 01:02:51,269][123091] Updated weights for policy 0, policy_version 183428 (0.0008) [2023-12-26 01:02:51,335][123091] Updated weights for policy 0, policy_version 183438 (0.0008) [2023-12-26 01:02:51,403][123091] Updated weights for policy 0, policy_version 183448 (0.0008) [2023-12-26 01:02:52,049][123090] Updated weights for policy 1, policy_version 182694 (0.0008) [2023-12-26 01:02:52,096][123090] Updated weights for policy 1, policy_version 182704 (0.0005) [2023-12-26 01:02:52,147][123090] Updated weights for policy 1, policy_version 182714 (0.0006) [2023-12-26 01:02:52,259][123091] Updated weights for policy 0, policy_version 183458 (0.0010) [2023-12-26 01:02:52,321][123091] Updated weights for policy 0, policy_version 183468 (0.0009) [2023-12-26 01:02:52,379][123091] Updated weights for policy 0, policy_version 183478 (0.0010) [2023-12-26 01:02:52,434][123091] Updated weights for policy 0, policy_version 183488 (0.0009) [2023-12-26 01:02:52,961][123090] Updated weights for policy 1, policy_version 182724 (0.0009) [2023-12-26 01:02:53,011][123090] Updated weights for policy 1, policy_version 182734 (0.0009) [2023-12-26 01:02:53,076][123090] Updated weights for policy 1, policy_version 182744 (0.0010) [2023-12-26 01:02:53,294][123091] Updated weights for policy 0, policy_version 183498 (0.0010) [2023-12-26 01:02:53,352][123091] Updated weights for policy 0, policy_version 183508 (0.0010) [2023-12-26 01:02:53,412][123091] Updated weights for policy 0, policy_version 183518 (0.0010) [2023-12-26 01:02:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 93765632. Throughput: 0: 8744.7, 1: 8925.7. Samples: 93743324. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:02:53,786][121949] Avg episode reward: [(0, '5677.474'), (1, '5079.984')] [2023-12-26 01:02:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000183520_46981120.pth... [2023-12-26 01:02:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000182496_46718976.pth [2023-12-26 01:02:53,815][123090] Updated weights for policy 1, policy_version 182754 (0.0009) [2023-12-26 01:02:53,861][123090] Updated weights for policy 1, policy_version 182764 (0.0008) [2023-12-26 01:02:53,910][123090] Updated weights for policy 1, policy_version 182774 (0.0009) [2023-12-26 01:02:53,956][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000182784_46792704.pth... [2023-12-26 01:02:53,958][123090] Updated weights for policy 1, policy_version 182784 (0.0009) [2023-12-26 01:02:53,959][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000181696_46514176.pth [2023-12-26 01:02:54,262][123091] Updated weights for policy 0, policy_version 183528 (0.0009) [2023-12-26 01:02:54,326][123091] Updated weights for policy 0, policy_version 183538 (0.0009) [2023-12-26 01:02:54,391][123091] Updated weights for policy 0, policy_version 183548 (0.0010) [2023-12-26 01:02:54,819][123090] Updated weights for policy 1, policy_version 182794 (0.0009) [2023-12-26 01:02:54,877][123090] Updated weights for policy 1, policy_version 182804 (0.0009) [2023-12-26 01:02:54,948][123090] Updated weights for policy 1, policy_version 182814 (0.0010) [2023-12-26 01:02:55,266][123091] Updated weights for policy 0, policy_version 183558 (0.0008) [2023-12-26 01:02:55,319][123091] Updated weights for policy 0, policy_version 183568 (0.0005) [2023-12-26 01:02:55,380][123091] Updated weights for policy 0, policy_version 183578 (0.0008) [2023-12-26 01:02:55,736][123090] Updated weights for policy 1, policy_version 182824 (0.0006) [2023-12-26 01:02:55,800][123090] Updated weights for policy 1, policy_version 182834 (0.0005) [2023-12-26 01:02:55,862][123090] Updated weights for policy 1, policy_version 182844 (0.0005) [2023-12-26 01:02:56,208][123091] Updated weights for policy 0, policy_version 183588 (0.0010) [2023-12-26 01:02:56,255][123091] Updated weights for policy 0, policy_version 183598 (0.0008) [2023-12-26 01:02:56,311][123091] Updated weights for policy 0, policy_version 183608 (0.0009) [2023-12-26 01:02:56,615][123090] Updated weights for policy 1, policy_version 182854 (0.0008) [2023-12-26 01:02:56,670][123090] Updated weights for policy 1, policy_version 182864 (0.0009) [2023-12-26 01:02:56,726][123090] Updated weights for policy 1, policy_version 182874 (0.0010) [2023-12-26 01:02:57,198][123091] Updated weights for policy 0, policy_version 183618 (0.0008) [2023-12-26 01:02:57,262][123091] Updated weights for policy 0, policy_version 183628 (0.0009) [2023-12-26 01:02:57,319][123091] Updated weights for policy 0, policy_version 183638 (0.0009) [2023-12-26 01:02:57,379][123091] Updated weights for policy 0, policy_version 183648 (0.0010) [2023-12-26 01:02:57,443][123090] Updated weights for policy 1, policy_version 182884 (0.0008) [2023-12-26 01:02:57,497][123090] Updated weights for policy 1, policy_version 182894 (0.0005) [2023-12-26 01:02:57,553][123090] Updated weights for policy 1, policy_version 182904 (0.0008) [2023-12-26 01:02:58,232][123091] Updated weights for policy 0, policy_version 183658 (0.0009) [2023-12-26 01:02:58,293][123091] Updated weights for policy 0, policy_version 183668 (0.0009) [2023-12-26 01:02:58,357][123091] Updated weights for policy 0, policy_version 183678 (0.0009) [2023-12-26 01:02:58,381][123090] Updated weights for policy 1, policy_version 182914 (0.0011) [2023-12-26 01:02:58,448][123090] Updated weights for policy 1, policy_version 182924 (0.0010) [2023-12-26 01:02:58,520][123090] Updated weights for policy 1, policy_version 182934 (0.0011) [2023-12-26 01:02:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 93855744. Throughput: 0: 8742.2, 1: 8971.2. Samples: 93847684. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:02:58,784][121949] Avg episode reward: [(0, '5607.244'), (1, '5045.862')] [2023-12-26 01:02:59,310][123090] Updated weights for policy 1, policy_version 182945 (0.0010) [2023-12-26 01:02:59,356][123091] Updated weights for policy 0, policy_version 183688 (0.0008) [2023-12-26 01:02:59,380][123090] Updated weights for policy 1, policy_version 182955 (0.0009) [2023-12-26 01:02:59,423][123091] Updated weights for policy 0, policy_version 183698 (0.0007) [2023-12-26 01:02:59,441][123090] Updated weights for policy 1, policy_version 182965 (0.0010) [2023-12-26 01:02:59,490][123091] Updated weights for policy 0, policy_version 183708 (0.0009) [2023-12-26 01:02:59,507][123090] Updated weights for policy 1, policy_version 182975 (0.0009) [2023-12-26 01:03:00,214][123091] Updated weights for policy 0, policy_version 183718 (0.0008) [2023-12-26 01:03:00,283][123091] Updated weights for policy 0, policy_version 183728 (0.0008) [2023-12-26 01:03:00,302][123090] Updated weights for policy 1, policy_version 182985 (0.0009) [2023-12-26 01:03:00,345][123091] Updated weights for policy 0, policy_version 183738 (0.0009) [2023-12-26 01:03:00,355][123090] Updated weights for policy 1, policy_version 182995 (0.0009) [2023-12-26 01:03:00,416][123090] Updated weights for policy 1, policy_version 183005 (0.0008) [2023-12-26 01:03:01,157][123090] Updated weights for policy 1, policy_version 183015 (0.0010) [2023-12-26 01:03:01,220][123091] Updated weights for policy 0, policy_version 183748 (0.0008) [2023-12-26 01:03:01,220][123090] Updated weights for policy 1, policy_version 183025 (0.0008) [2023-12-26 01:03:01,278][123091] Updated weights for policy 0, policy_version 183758 (0.0008) [2023-12-26 01:03:01,284][123090] Updated weights for policy 1, policy_version 183035 (0.0007) [2023-12-26 01:03:01,329][123091] Updated weights for policy 0, policy_version 183768 (0.0007) [2023-12-26 01:03:02,090][123090] Updated weights for policy 1, policy_version 183045 (0.0010) [2023-12-26 01:03:02,151][123090] Updated weights for policy 1, policy_version 183055 (0.0010) [2023-12-26 01:03:02,177][123091] Updated weights for policy 0, policy_version 183778 (0.0009) [2023-12-26 01:03:02,205][123090] Updated weights for policy 1, policy_version 183065 (0.0009) [2023-12-26 01:03:02,229][123091] Updated weights for policy 0, policy_version 183788 (0.0005) [2023-12-26 01:03:02,283][123091] Updated weights for policy 0, policy_version 183798 (0.0009) [2023-12-26 01:03:02,338][123091] Updated weights for policy 0, policy_version 183808 (0.0010) [2023-12-26 01:03:03,072][123090] Updated weights for policy 1, policy_version 183075 (0.0009) [2023-12-26 01:03:03,142][123090] Updated weights for policy 1, policy_version 183085 (0.0009) [2023-12-26 01:03:03,152][123091] Updated weights for policy 0, policy_version 183818 (0.0008) [2023-12-26 01:03:03,205][123091] Updated weights for policy 0, policy_version 183828 (0.0007) [2023-12-26 01:03:03,207][123090] Updated weights for policy 1, policy_version 183095 (0.0009) [2023-12-26 01:03:03,252][123091] Updated weights for policy 0, policy_version 183838 (0.0007) [2023-12-26 01:03:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 93937664. Throughput: 0: 8738.5, 1: 8902.6. Samples: 93950676. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:03,785][121949] Avg episode reward: [(0, '5662.546'), (1, '4922.064')] [2023-12-26 01:03:03,900][123090] Updated weights for policy 1, policy_version 183105 (0.0009) [2023-12-26 01:03:03,964][123090] Updated weights for policy 1, policy_version 183115 (0.0006) [2023-12-26 01:03:04,028][123090] Updated weights for policy 1, policy_version 183125 (0.0006) [2023-12-26 01:03:04,090][123090] Updated weights for policy 1, policy_version 183135 (0.0006) [2023-12-26 01:03:04,140][123091] Updated weights for policy 0, policy_version 183848 (0.0008) [2023-12-26 01:03:04,200][123091] Updated weights for policy 0, policy_version 183858 (0.0008) [2023-12-26 01:03:04,273][123091] Updated weights for policy 0, policy_version 183868 (0.0009) [2023-12-26 01:03:04,853][123090] Updated weights for policy 1, policy_version 183145 (0.0007) [2023-12-26 01:03:04,915][123090] Updated weights for policy 1, policy_version 183155 (0.0005) [2023-12-26 01:03:04,986][123090] Updated weights for policy 1, policy_version 183165 (0.0005) [2023-12-26 01:03:05,104][123091] Updated weights for policy 0, policy_version 183878 (0.0009) [2023-12-26 01:03:05,151][123091] Updated weights for policy 0, policy_version 183888 (0.0008) [2023-12-26 01:03:05,212][123091] Updated weights for policy 0, policy_version 183898 (0.0009) [2023-12-26 01:03:05,766][123090] Updated weights for policy 1, policy_version 183175 (0.0011) [2023-12-26 01:03:05,828][123090] Updated weights for policy 1, policy_version 183185 (0.0010) [2023-12-26 01:03:05,879][123090] Updated weights for policy 1, policy_version 183195 (0.0010) [2023-12-26 01:03:06,054][123091] Updated weights for policy 0, policy_version 183908 (0.0009) [2023-12-26 01:03:06,119][123091] Updated weights for policy 0, policy_version 183918 (0.0008) [2023-12-26 01:03:06,172][123091] Updated weights for policy 0, policy_version 183928 (0.0009) [2023-12-26 01:03:06,635][123090] Updated weights for policy 1, policy_version 183205 (0.0008) [2023-12-26 01:03:06,702][123090] Updated weights for policy 1, policy_version 183215 (0.0005) [2023-12-26 01:03:06,773][123090] Updated weights for policy 1, policy_version 183225 (0.0007) [2023-12-26 01:03:07,093][123091] Updated weights for policy 0, policy_version 183938 (0.0009) [2023-12-26 01:03:07,162][123091] Updated weights for policy 0, policy_version 183948 (0.0006) [2023-12-26 01:03:07,219][123091] Updated weights for policy 0, policy_version 183958 (0.0009) [2023-12-26 01:03:07,289][123091] Updated weights for policy 0, policy_version 183968 (0.0009) [2023-12-26 01:03:07,474][123090] Updated weights for policy 1, policy_version 183235 (0.0008) [2023-12-26 01:03:07,544][123090] Updated weights for policy 1, policy_version 183245 (0.0008) [2023-12-26 01:03:07,602][123090] Updated weights for policy 1, policy_version 183255 (0.0007) [2023-12-26 01:03:08,120][123091] Updated weights for policy 0, policy_version 183978 (0.0010) [2023-12-26 01:03:08,189][123091] Updated weights for policy 0, policy_version 183988 (0.0009) [2023-12-26 01:03:08,242][123090] Updated weights for policy 1, policy_version 183265 (0.0005) [2023-12-26 01:03:08,260][123091] Updated weights for policy 0, policy_version 183998 (0.0008) [2023-12-26 01:03:08,304][123090] Updated weights for policy 1, policy_version 183275 (0.0005) [2023-12-26 01:03:08,364][123090] Updated weights for policy 1, policy_version 183285 (0.0011) [2023-12-26 01:03:08,412][123090] Updated weights for policy 1, policy_version 183295 (0.0010) [2023-12-26 01:03:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 94027776. Throughput: 0: 8690.8, 1: 8983.6. Samples: 94003336. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:08,785][121949] Avg episode reward: [(0, '5754.517'), (1, '4939.498')] [2023-12-26 01:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000184000_47104000.pth... [2023-12-26 01:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000183296_46923776.pth... [2023-12-26 01:03:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000182240_46653440.pth [2023-12-26 01:03:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000183008_46850048.pth [2023-12-26 01:03:09,121][123091] Updated weights for policy 0, policy_version 184008 (0.0008) [2023-12-26 01:03:09,148][123090] Updated weights for policy 1, policy_version 183305 (0.0010) [2023-12-26 01:03:09,181][123091] Updated weights for policy 0, policy_version 184018 (0.0006) [2023-12-26 01:03:09,200][123090] Updated weights for policy 1, policy_version 183315 (0.0010) [2023-12-26 01:03:09,254][123091] Updated weights for policy 0, policy_version 184028 (0.0008) [2023-12-26 01:03:09,271][123090] Updated weights for policy 1, policy_version 183325 (0.0010) [2023-12-26 01:03:10,124][123091] Updated weights for policy 0, policy_version 184038 (0.0009) [2023-12-26 01:03:10,160][123090] Updated weights for policy 1, policy_version 183335 (0.0011) [2023-12-26 01:03:10,190][123091] Updated weights for policy 0, policy_version 184048 (0.0006) [2023-12-26 01:03:10,225][123090] Updated weights for policy 1, policy_version 183345 (0.0011) [2023-12-26 01:03:10,246][123091] Updated weights for policy 0, policy_version 184058 (0.0008) [2023-12-26 01:03:10,287][123090] Updated weights for policy 1, policy_version 183355 (0.0011) [2023-12-26 01:03:10,962][123090] Updated weights for policy 1, policy_version 183365 (0.0008) [2023-12-26 01:03:11,035][123090] Updated weights for policy 1, policy_version 183375 (0.0006) [2023-12-26 01:03:11,101][123090] Updated weights for policy 1, policy_version 183385 (0.0008) [2023-12-26 01:03:11,138][123091] Updated weights for policy 0, policy_version 184068 (0.0008) [2023-12-26 01:03:11,204][123091] Updated weights for policy 0, policy_version 184078 (0.0009) [2023-12-26 01:03:11,278][123091] Updated weights for policy 0, policy_version 184088 (0.0009) [2023-12-26 01:03:11,911][123090] Updated weights for policy 1, policy_version 183395 (0.0008) [2023-12-26 01:03:11,986][123090] Updated weights for policy 1, policy_version 183405 (0.0006) [2023-12-26 01:03:12,054][123090] Updated weights for policy 1, policy_version 183415 (0.0006) [2023-12-26 01:03:12,070][123091] Updated weights for policy 0, policy_version 184098 (0.0009) [2023-12-26 01:03:12,125][123091] Updated weights for policy 0, policy_version 184108 (0.0009) [2023-12-26 01:03:12,179][123091] Updated weights for policy 0, policy_version 184118 (0.0009) [2023-12-26 01:03:12,243][123091] Updated weights for policy 0, policy_version 184128 (0.0008) [2023-12-26 01:03:12,839][123090] Updated weights for policy 1, policy_version 183425 (0.0007) [2023-12-26 01:03:12,905][123090] Updated weights for policy 1, policy_version 183435 (0.0010) [2023-12-26 01:03:12,964][123090] Updated weights for policy 1, policy_version 183445 (0.0009) [2023-12-26 01:03:13,010][123091] Updated weights for policy 0, policy_version 184138 (0.0008) [2023-12-26 01:03:13,034][123090] Updated weights for policy 1, policy_version 183455 (0.0007) [2023-12-26 01:03:13,066][123091] Updated weights for policy 0, policy_version 184148 (0.0010) [2023-12-26 01:03:13,123][123091] Updated weights for policy 0, policy_version 184158 (0.0011) [2023-12-26 01:03:13,781][123090] Updated weights for policy 1, policy_version 183465 (0.0005) [2023-12-26 01:03:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 94109696. Throughput: 0: 8573.6, 1: 9008.6. Samples: 94107804. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:13,785][121949] Avg episode reward: [(0, '5758.629'), (1, '5254.817')] [2023-12-26 01:03:13,845][123090] Updated weights for policy 1, policy_version 183475 (0.0005) [2023-12-26 01:03:13,872][123091] Updated weights for policy 0, policy_version 184168 (0.0010) [2023-12-26 01:03:13,910][123090] Updated weights for policy 1, policy_version 183485 (0.0005) [2023-12-26 01:03:13,923][123091] Updated weights for policy 0, policy_version 184178 (0.0010) [2023-12-26 01:03:13,978][123091] Updated weights for policy 0, policy_version 184188 (0.0010) [2023-12-26 01:03:14,683][123090] Updated weights for policy 1, policy_version 183495 (0.0008) [2023-12-26 01:03:14,754][123090] Updated weights for policy 1, policy_version 183505 (0.0009) [2023-12-26 01:03:14,803][123091] Updated weights for policy 0, policy_version 184198 (0.0010) [2023-12-26 01:03:14,823][123090] Updated weights for policy 1, policy_version 183515 (0.0007) [2023-12-26 01:03:14,869][123091] Updated weights for policy 0, policy_version 184208 (0.0009) [2023-12-26 01:03:14,938][123091] Updated weights for policy 0, policy_version 184218 (0.0008) [2023-12-26 01:03:15,596][123091] Updated weights for policy 0, policy_version 184228 (0.0009) [2023-12-26 01:03:15,656][123091] Updated weights for policy 0, policy_version 184238 (0.0011) [2023-12-26 01:03:15,698][123090] Updated weights for policy 1, policy_version 183525 (0.0010) [2023-12-26 01:03:15,715][123091] Updated weights for policy 0, policy_version 184248 (0.0011) [2023-12-26 01:03:15,762][123090] Updated weights for policy 1, policy_version 183535 (0.0008) [2023-12-26 01:03:15,815][123090] Updated weights for policy 1, policy_version 183545 (0.0009) [2023-12-26 01:03:16,538][123091] Updated weights for policy 0, policy_version 184258 (0.0008) [2023-12-26 01:03:16,596][123091] Updated weights for policy 0, policy_version 184268 (0.0007) [2023-12-26 01:03:16,628][123090] Updated weights for policy 1, policy_version 183555 (0.0009) [2023-12-26 01:03:16,642][123091] Updated weights for policy 0, policy_version 184278 (0.0010) [2023-12-26 01:03:16,685][123090] Updated weights for policy 1, policy_version 183565 (0.0009) [2023-12-26 01:03:16,691][123091] Updated weights for policy 0, policy_version 184288 (0.0008) [2023-12-26 01:03:16,744][123090] Updated weights for policy 1, policy_version 183575 (0.0009) [2023-12-26 01:03:17,509][123091] Updated weights for policy 0, policy_version 184298 (0.0010) [2023-12-26 01:03:17,559][123091] Updated weights for policy 0, policy_version 184308 (0.0009) [2023-12-26 01:03:17,574][123090] Updated weights for policy 1, policy_version 183585 (0.0009) [2023-12-26 01:03:17,617][123091] Updated weights for policy 0, policy_version 184318 (0.0008) [2023-12-26 01:03:17,636][123090] Updated weights for policy 1, policy_version 183595 (0.0009) [2023-12-26 01:03:17,689][123090] Updated weights for policy 1, policy_version 183605 (0.0009) [2023-12-26 01:03:17,738][123090] Updated weights for policy 1, policy_version 183615 (0.0009) [2023-12-26 01:03:18,483][123091] Updated weights for policy 0, policy_version 184328 (0.0009) [2023-12-26 01:03:18,544][123091] Updated weights for policy 0, policy_version 184338 (0.0010) [2023-12-26 01:03:18,601][123090] Updated weights for policy 1, policy_version 183625 (0.0007) [2023-12-26 01:03:18,603][123091] Updated weights for policy 0, policy_version 184348 (0.0010) [2023-12-26 01:03:18,666][123090] Updated weights for policy 1, policy_version 183635 (0.0009) [2023-12-26 01:03:18,731][123090] Updated weights for policy 1, policy_version 183645 (0.0009) [2023-12-26 01:03:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 94208000. Throughput: 0: 8561.9, 1: 8973.8. Samples: 94213184. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:18,785][121949] Avg episode reward: [(0, '5792.664'), (1, '4880.274')] [2023-12-26 01:03:19,436][123091] Updated weights for policy 0, policy_version 184358 (0.0009) [2023-12-26 01:03:19,511][123091] Updated weights for policy 0, policy_version 184368 (0.0008) [2023-12-26 01:03:19,575][123091] Updated weights for policy 0, policy_version 184378 (0.0009) [2023-12-26 01:03:19,612][123090] Updated weights for policy 1, policy_version 183655 (0.0010) [2023-12-26 01:03:19,680][123090] Updated weights for policy 1, policy_version 183665 (0.0011) [2023-12-26 01:03:19,743][123090] Updated weights for policy 1, policy_version 183675 (0.0010) [2023-12-26 01:03:20,420][123091] Updated weights for policy 0, policy_version 184388 (0.0008) [2023-12-26 01:03:20,490][123091] Updated weights for policy 0, policy_version 184398 (0.0009) [2023-12-26 01:03:20,555][123091] Updated weights for policy 0, policy_version 184408 (0.0009) [2023-12-26 01:03:20,594][123090] Updated weights for policy 1, policy_version 183685 (0.0011) [2023-12-26 01:03:20,657][123090] Updated weights for policy 1, policy_version 183695 (0.0011) [2023-12-26 01:03:20,726][123090] Updated weights for policy 1, policy_version 183705 (0.0011) [2023-12-26 01:03:21,396][123091] Updated weights for policy 0, policy_version 184418 (0.0011) [2023-12-26 01:03:21,473][123091] Updated weights for policy 0, policy_version 184428 (0.0007) [2023-12-26 01:03:21,547][123091] Updated weights for policy 0, policy_version 184438 (0.0011) [2023-12-26 01:03:21,571][123090] Updated weights for policy 1, policy_version 183715 (0.0009) [2023-12-26 01:03:21,610][123091] Updated weights for policy 0, policy_version 184448 (0.0010) [2023-12-26 01:03:21,641][123090] Updated weights for policy 1, policy_version 183725 (0.0008) [2023-12-26 01:03:21,711][123090] Updated weights for policy 1, policy_version 183735 (0.0009) [2023-12-26 01:03:22,405][123091] Updated weights for policy 0, policy_version 184458 (0.0008) [2023-12-26 01:03:22,473][123091] Updated weights for policy 0, policy_version 184468 (0.0008) [2023-12-26 01:03:22,515][123090] Updated weights for policy 1, policy_version 183745 (0.0008) [2023-12-26 01:03:22,538][123091] Updated weights for policy 0, policy_version 184478 (0.0008) [2023-12-26 01:03:22,575][123090] Updated weights for policy 1, policy_version 183755 (0.0010) [2023-12-26 01:03:22,647][123090] Updated weights for policy 1, policy_version 183765 (0.0010) [2023-12-26 01:03:22,714][123090] Updated weights for policy 1, policy_version 183775 (0.0009) [2023-12-26 01:03:23,303][123091] Updated weights for policy 0, policy_version 184488 (0.0009) [2023-12-26 01:03:23,360][123091] Updated weights for policy 0, policy_version 184498 (0.0009) [2023-12-26 01:03:23,411][123091] Updated weights for policy 0, policy_version 184508 (0.0006) [2023-12-26 01:03:23,586][123090] Updated weights for policy 1, policy_version 183785 (0.0009) [2023-12-26 01:03:23,648][123090] Updated weights for policy 1, policy_version 183795 (0.0009) [2023-12-26 01:03:23,696][123090] Updated weights for policy 1, policy_version 183805 (0.0009) [2023-12-26 01:03:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17605.8). Total num frames: 94289920. Throughput: 0: 8557.6, 1: 8882.9. Samples: 94262872. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:23,785][121949] Avg episode reward: [(0, '5768.588'), (1, '4768.429')] [2023-12-26 01:03:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000184512_47235072.pth... [2023-12-26 01:03:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000183808_47054848.pth... [2023-12-26 01:03:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000182784_46792704.pth [2023-12-26 01:03:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000183520_46981120.pth [2023-12-26 01:03:24,228][123091] Updated weights for policy 0, policy_version 184518 (0.0009) [2023-12-26 01:03:24,286][123091] Updated weights for policy 0, policy_version 184528 (0.0009) [2023-12-26 01:03:24,339][123091] Updated weights for policy 0, policy_version 184538 (0.0009) [2023-12-26 01:03:24,442][123090] Updated weights for policy 1, policy_version 183815 (0.0007) [2023-12-26 01:03:24,500][123090] Updated weights for policy 1, policy_version 183825 (0.0006) [2023-12-26 01:03:24,568][123090] Updated weights for policy 1, policy_version 183835 (0.0005) [2023-12-26 01:03:25,174][123091] Updated weights for policy 0, policy_version 184548 (0.0009) [2023-12-26 01:03:25,214][123090] Updated weights for policy 1, policy_version 183845 (0.0005) [2023-12-26 01:03:25,238][123091] Updated weights for policy 0, policy_version 184558 (0.0009) [2023-12-26 01:03:25,278][123090] Updated weights for policy 1, policy_version 183855 (0.0005) [2023-12-26 01:03:25,298][123091] Updated weights for policy 0, policy_version 184568 (0.0008) [2023-12-26 01:03:25,349][123090] Updated weights for policy 1, policy_version 183865 (0.0007) [2023-12-26 01:03:26,121][123091] Updated weights for policy 0, policy_version 184578 (0.0008) [2023-12-26 01:03:26,152][123090] Updated weights for policy 1, policy_version 183875 (0.0009) [2023-12-26 01:03:26,185][123091] Updated weights for policy 0, policy_version 184588 (0.0005) [2023-12-26 01:03:26,210][123090] Updated weights for policy 1, policy_version 183885 (0.0009) [2023-12-26 01:03:26,239][123091] Updated weights for policy 0, policy_version 184598 (0.0005) [2023-12-26 01:03:26,260][123090] Updated weights for policy 1, policy_version 183895 (0.0008) [2023-12-26 01:03:26,296][123091] Updated weights for policy 0, policy_version 184608 (0.0011) [2023-12-26 01:03:27,083][123090] Updated weights for policy 1, policy_version 183905 (0.0006) [2023-12-26 01:03:27,097][123091] Updated weights for policy 0, policy_version 184618 (0.0009) [2023-12-26 01:03:27,133][123090] Updated weights for policy 1, policy_version 183915 (0.0006) [2023-12-26 01:03:27,148][123091] Updated weights for policy 0, policy_version 184628 (0.0010) [2023-12-26 01:03:27,184][123090] Updated weights for policy 1, policy_version 183925 (0.0009) [2023-12-26 01:03:27,204][123091] Updated weights for policy 0, policy_version 184638 (0.0007) [2023-12-26 01:03:27,239][123090] Updated weights for policy 1, policy_version 183935 (0.0010) [2023-12-26 01:03:28,036][123091] Updated weights for policy 0, policy_version 184648 (0.0008) [2023-12-26 01:03:28,072][123090] Updated weights for policy 1, policy_version 183945 (0.0009) [2023-12-26 01:03:28,083][123091] Updated weights for policy 0, policy_version 184658 (0.0005) [2023-12-26 01:03:28,123][123090] Updated weights for policy 1, policy_version 183955 (0.0010) [2023-12-26 01:03:28,134][123091] Updated weights for policy 0, policy_version 184668 (0.0006) [2023-12-26 01:03:28,170][123090] Updated weights for policy 1, policy_version 183965 (0.0010) [2023-12-26 01:03:28,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 94371840. Throughput: 0: 8562.5, 1: 8864.7. Samples: 94368768. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:28,785][121949] Avg episode reward: [(0, '5816.667'), (1, '5011.032')] [2023-12-26 01:03:28,852][123090] Updated weights for policy 1, policy_version 183975 (0.0007) [2023-12-26 01:03:28,915][123090] Updated weights for policy 1, policy_version 183985 (0.0005) [2023-12-26 01:03:28,976][123090] Updated weights for policy 1, policy_version 183995 (0.0008) [2023-12-26 01:03:29,037][123091] Updated weights for policy 0, policy_version 184678 (0.0008) [2023-12-26 01:03:29,100][123091] Updated weights for policy 0, policy_version 184688 (0.0009) [2023-12-26 01:03:29,166][123091] Updated weights for policy 0, policy_version 184698 (0.0009) [2023-12-26 01:03:29,730][123090] Updated weights for policy 1, policy_version 184005 (0.0010) [2023-12-26 01:03:29,790][123090] Updated weights for policy 1, policy_version 184015 (0.0009) [2023-12-26 01:03:29,856][123090] Updated weights for policy 1, policy_version 184025 (0.0009) [2023-12-26 01:03:30,071][123091] Updated weights for policy 0, policy_version 184709 (0.0008) [2023-12-26 01:03:30,132][123091] Updated weights for policy 0, policy_version 184719 (0.0005) [2023-12-26 01:03:30,186][123091] Updated weights for policy 0, policy_version 184729 (0.0005) [2023-12-26 01:03:30,658][123090] Updated weights for policy 1, policy_version 184035 (0.0010) [2023-12-26 01:03:30,709][123090] Updated weights for policy 1, policy_version 184045 (0.0009) [2023-12-26 01:03:30,763][123090] Updated weights for policy 1, policy_version 184055 (0.0009) [2023-12-26 01:03:30,854][123091] Updated weights for policy 0, policy_version 184739 (0.0008) [2023-12-26 01:03:30,909][123091] Updated weights for policy 0, policy_version 184749 (0.0009) [2023-12-26 01:03:30,970][123091] Updated weights for policy 0, policy_version 184759 (0.0010) [2023-12-26 01:03:31,658][123090] Updated weights for policy 1, policy_version 184065 (0.0009) [2023-12-26 01:03:31,719][123090] Updated weights for policy 1, policy_version 184075 (0.0009) [2023-12-26 01:03:31,783][123090] Updated weights for policy 1, policy_version 184085 (0.0009) [2023-12-26 01:03:31,798][123091] Updated weights for policy 0, policy_version 184769 (0.0008) [2023-12-26 01:03:31,844][123090] Updated weights for policy 1, policy_version 184095 (0.0009) [2023-12-26 01:03:31,856][123091] Updated weights for policy 0, policy_version 184779 (0.0005) [2023-12-26 01:03:31,915][123091] Updated weights for policy 0, policy_version 184789 (0.0005) [2023-12-26 01:03:31,964][123091] Updated weights for policy 0, policy_version 184799 (0.0008) [2023-12-26 01:03:32,697][123090] Updated weights for policy 1, policy_version 184105 (0.0009) [2023-12-26 01:03:32,735][123091] Updated weights for policy 0, policy_version 184809 (0.0007) [2023-12-26 01:03:32,758][123090] Updated weights for policy 1, policy_version 184115 (0.0009) [2023-12-26 01:03:32,788][123091] Updated weights for policy 0, policy_version 184819 (0.0008) [2023-12-26 01:03:32,811][123090] Updated weights for policy 1, policy_version 184125 (0.0009) [2023-12-26 01:03:32,849][123091] Updated weights for policy 0, policy_version 184829 (0.0007) [2023-12-26 01:03:33,581][123090] Updated weights for policy 1, policy_version 184135 (0.0007) [2023-12-26 01:03:33,633][123090] Updated weights for policy 1, policy_version 184145 (0.0006) [2023-12-26 01:03:33,685][123090] Updated weights for policy 1, policy_version 184155 (0.0008) [2023-12-26 01:03:33,703][123091] Updated weights for policy 0, policy_version 184839 (0.0009) [2023-12-26 01:03:33,756][123091] Updated weights for policy 0, policy_version 184849 (0.0008) [2023-12-26 01:03:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 94461952. Throughput: 0: 8531.2, 1: 8886.5. Samples: 94474740. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:33,785][121949] Avg episode reward: [(0, '5835.770'), (1, '4952.336')] [2023-12-26 01:03:33,807][123091] Updated weights for policy 0, policy_version 184859 (0.0009) [2023-12-26 01:03:34,414][123090] Updated weights for policy 1, policy_version 184165 (0.0009) [2023-12-26 01:03:34,479][123090] Updated weights for policy 1, policy_version 184175 (0.0010) [2023-12-26 01:03:34,541][123090] Updated weights for policy 1, policy_version 184185 (0.0007) [2023-12-26 01:03:34,679][123091] Updated weights for policy 0, policy_version 184869 (0.0010) [2023-12-26 01:03:34,743][123091] Updated weights for policy 0, policy_version 184879 (0.0009) [2023-12-26 01:03:34,804][123091] Updated weights for policy 0, policy_version 184889 (0.0010) [2023-12-26 01:03:35,343][123090] Updated weights for policy 1, policy_version 184195 (0.0007) [2023-12-26 01:03:35,398][123090] Updated weights for policy 1, policy_version 184205 (0.0009) [2023-12-26 01:03:35,461][123090] Updated weights for policy 1, policy_version 184215 (0.0009) [2023-12-26 01:03:35,629][123091] Updated weights for policy 0, policy_version 184899 (0.0010) [2023-12-26 01:03:35,695][123091] Updated weights for policy 0, policy_version 184909 (0.0010) [2023-12-26 01:03:35,755][123091] Updated weights for policy 0, policy_version 184919 (0.0006) [2023-12-26 01:03:36,245][123090] Updated weights for policy 1, policy_version 184225 (0.0008) [2023-12-26 01:03:36,298][123090] Updated weights for policy 1, policy_version 184235 (0.0009) [2023-12-26 01:03:36,357][123090] Updated weights for policy 1, policy_version 184245 (0.0010) [2023-12-26 01:03:36,420][123090] Updated weights for policy 1, policy_version 184255 (0.0010) [2023-12-26 01:03:36,598][123091] Updated weights for policy 0, policy_version 184929 (0.0009) [2023-12-26 01:03:36,660][123091] Updated weights for policy 0, policy_version 184939 (0.0008) [2023-12-26 01:03:36,718][123091] Updated weights for policy 0, policy_version 184949 (0.0010) [2023-12-26 01:03:36,780][123091] Updated weights for policy 0, policy_version 184959 (0.0010) [2023-12-26 01:03:37,250][123090] Updated weights for policy 1, policy_version 184265 (0.0006) [2023-12-26 01:03:37,315][123090] Updated weights for policy 1, policy_version 184275 (0.0005) [2023-12-26 01:03:37,386][123090] Updated weights for policy 1, policy_version 184285 (0.0005) [2023-12-26 01:03:37,694][123091] Updated weights for policy 0, policy_version 184969 (0.0010) [2023-12-26 01:03:37,762][123091] Updated weights for policy 0, policy_version 184979 (0.0009) [2023-12-26 01:03:37,830][123091] Updated weights for policy 0, policy_version 184989 (0.0009) [2023-12-26 01:03:38,001][123090] Updated weights for policy 1, policy_version 184295 (0.0009) [2023-12-26 01:03:38,064][123090] Updated weights for policy 1, policy_version 184305 (0.0011) [2023-12-26 01:03:38,120][123090] Updated weights for policy 1, policy_version 184315 (0.0010) [2023-12-26 01:03:38,678][123091] Updated weights for policy 0, policy_version 184999 (0.0010) [2023-12-26 01:03:38,727][123091] Updated weights for policy 0, policy_version 185009 (0.0009) [2023-12-26 01:03:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 94543872. Throughput: 0: 8495.4, 1: 8903.5. Samples: 94526272. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:38,785][121949] Avg episode reward: [(0, '5791.039'), (1, '4865.672')] [2023-12-26 01:03:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000184320_47185920.pth... [2023-12-26 01:03:38,794][123091] Updated weights for policy 0, policy_version 185019 (0.0009) [2023-12-26 01:03:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000183296_46923776.pth [2023-12-26 01:03:38,822][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000185024_47366144.pth... [2023-12-26 01:03:38,827][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000184000_47104000.pth [2023-12-26 01:03:38,949][123090] Updated weights for policy 1, policy_version 184325 (0.0010) [2023-12-26 01:03:39,007][123090] Updated weights for policy 1, policy_version 184335 (0.0010) [2023-12-26 01:03:39,073][123090] Updated weights for policy 1, policy_version 184345 (0.0011) [2023-12-26 01:03:39,538][123091] Updated weights for policy 0, policy_version 185029 (0.0007) [2023-12-26 01:03:39,603][123091] Updated weights for policy 0, policy_version 185039 (0.0006) [2023-12-26 01:03:39,667][123091] Updated weights for policy 0, policy_version 185049 (0.0007) [2023-12-26 01:03:39,889][123090] Updated weights for policy 1, policy_version 184355 (0.0009) [2023-12-26 01:03:39,960][123090] Updated weights for policy 1, policy_version 184365 (0.0007) [2023-12-26 01:03:40,035][123090] Updated weights for policy 1, policy_version 184375 (0.0010) [2023-12-26 01:03:40,525][123091] Updated weights for policy 0, policy_version 185059 (0.0010) [2023-12-26 01:03:40,587][123091] Updated weights for policy 0, policy_version 185069 (0.0010) [2023-12-26 01:03:40,643][123091] Updated weights for policy 0, policy_version 185079 (0.0009) [2023-12-26 01:03:40,765][123090] Updated weights for policy 1, policy_version 184385 (0.0009) [2023-12-26 01:03:40,817][123090] Updated weights for policy 1, policy_version 184395 (0.0005) [2023-12-26 01:03:40,866][123090] Updated weights for policy 1, policy_version 184405 (0.0005) [2023-12-26 01:03:40,925][123090] Updated weights for policy 1, policy_version 184415 (0.0005) [2023-12-26 01:03:41,563][123091] Updated weights for policy 0, policy_version 185089 (0.0010) [2023-12-26 01:03:41,623][123091] Updated weights for policy 0, policy_version 185099 (0.0009) [2023-12-26 01:03:41,696][123091] Updated weights for policy 0, policy_version 185109 (0.0008) [2023-12-26 01:03:41,698][123090] Updated weights for policy 1, policy_version 184425 (0.0008) [2023-12-26 01:03:41,766][123091] Updated weights for policy 0, policy_version 185119 (0.0010) [2023-12-26 01:03:41,769][123090] Updated weights for policy 1, policy_version 184435 (0.0008) [2023-12-26 01:03:41,845][123090] Updated weights for policy 1, policy_version 184445 (0.0010) [2023-12-26 01:03:42,620][123091] Updated weights for policy 0, policy_version 185129 (0.0009) [2023-12-26 01:03:42,692][123091] Updated weights for policy 0, policy_version 185139 (0.0009) [2023-12-26 01:03:42,699][123090] Updated weights for policy 1, policy_version 184455 (0.0007) [2023-12-26 01:03:42,764][123090] Updated weights for policy 1, policy_version 184465 (0.0005) [2023-12-26 01:03:42,768][123091] Updated weights for policy 0, policy_version 185149 (0.0009) [2023-12-26 01:03:42,820][123090] Updated weights for policy 1, policy_version 184475 (0.0008) [2023-12-26 01:03:43,568][123090] Updated weights for policy 1, policy_version 184485 (0.0009) [2023-12-26 01:03:43,582][123091] Updated weights for policy 0, policy_version 185159 (0.0007) [2023-12-26 01:03:43,624][123090] Updated weights for policy 1, policy_version 184495 (0.0009) [2023-12-26 01:03:43,629][123091] Updated weights for policy 0, policy_version 185169 (0.0005) [2023-12-26 01:03:43,686][123091] Updated weights for policy 0, policy_version 185179 (0.0005) [2023-12-26 01:03:43,689][123090] Updated weights for policy 1, policy_version 184505 (0.0008) [2023-12-26 01:03:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 94642176. Throughput: 0: 8488.5, 1: 8884.6. Samples: 94629476. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:43,785][121949] Avg episode reward: [(0, '5771.966'), (1, '4787.475')] [2023-12-26 01:03:44,356][123091] Updated weights for policy 0, policy_version 185189 (0.0007) [2023-12-26 01:03:44,413][123091] Updated weights for policy 0, policy_version 185199 (0.0007) [2023-12-26 01:03:44,462][123091] Updated weights for policy 0, policy_version 185209 (0.0005) [2023-12-26 01:03:44,593][123090] Updated weights for policy 1, policy_version 184515 (0.0009) [2023-12-26 01:03:44,644][123090] Updated weights for policy 1, policy_version 184525 (0.0010) [2023-12-26 01:03:44,710][123090] Updated weights for policy 1, policy_version 184535 (0.0010) [2023-12-26 01:03:45,278][123091] Updated weights for policy 0, policy_version 185219 (0.0006) [2023-12-26 01:03:45,339][123091] Updated weights for policy 0, policy_version 185229 (0.0009) [2023-12-26 01:03:45,393][123091] Updated weights for policy 0, policy_version 185239 (0.0009) [2023-12-26 01:03:45,551][123090] Updated weights for policy 1, policy_version 184545 (0.0010) [2023-12-26 01:03:45,614][123090] Updated weights for policy 1, policy_version 184555 (0.0011) [2023-12-26 01:03:45,665][123090] Updated weights for policy 1, policy_version 184565 (0.0010) [2023-12-26 01:03:45,716][123090] Updated weights for policy 1, policy_version 184575 (0.0010) [2023-12-26 01:03:46,238][123091] Updated weights for policy 0, policy_version 185249 (0.0009) [2023-12-26 01:03:46,297][123091] Updated weights for policy 0, policy_version 185259 (0.0009) [2023-12-26 01:03:46,366][123091] Updated weights for policy 0, policy_version 185269 (0.0006) [2023-12-26 01:03:46,437][123091] Updated weights for policy 0, policy_version 185279 (0.0005) [2023-12-26 01:03:46,559][123090] Updated weights for policy 1, policy_version 184585 (0.0010) [2023-12-26 01:03:46,621][123090] Updated weights for policy 1, policy_version 184595 (0.0010) [2023-12-26 01:03:46,672][123090] Updated weights for policy 1, policy_version 184605 (0.0010) [2023-12-26 01:03:47,141][123091] Updated weights for policy 0, policy_version 185289 (0.0010) [2023-12-26 01:03:47,205][123091] Updated weights for policy 0, policy_version 185299 (0.0005) [2023-12-26 01:03:47,253][123091] Updated weights for policy 0, policy_version 185309 (0.0005) [2023-12-26 01:03:47,484][123090] Updated weights for policy 1, policy_version 184615 (0.0010) [2023-12-26 01:03:47,545][123090] Updated weights for policy 1, policy_version 184625 (0.0010) [2023-12-26 01:03:47,607][123090] Updated weights for policy 1, policy_version 184635 (0.0011) [2023-12-26 01:03:47,908][123091] Updated weights for policy 0, policy_version 185319 (0.0009) [2023-12-26 01:03:47,966][123091] Updated weights for policy 0, policy_version 185329 (0.0010) [2023-12-26 01:03:48,013][123091] Updated weights for policy 0, policy_version 185339 (0.0010) [2023-12-26 01:03:48,365][123090] Updated weights for policy 1, policy_version 184645 (0.0009) [2023-12-26 01:03:48,430][123090] Updated weights for policy 1, policy_version 184655 (0.0008) [2023-12-26 01:03:48,487][123090] Updated weights for policy 1, policy_version 184665 (0.0010) [2023-12-26 01:03:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 94724096. Throughput: 0: 8612.6, 1: 8849.3. Samples: 94736456. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 01:03:48,784][121949] Avg episode reward: [(0, '5790.529'), (1, '4985.202')] [2023-12-26 01:03:48,797][123091] Updated weights for policy 0, policy_version 185349 (0.0009) [2023-12-26 01:03:48,858][123091] Updated weights for policy 0, policy_version 185359 (0.0008) [2023-12-26 01:03:48,920][123091] Updated weights for policy 0, policy_version 185369 (0.0009) [2023-12-26 01:03:49,351][123090] Updated weights for policy 1, policy_version 184675 (0.0010) [2023-12-26 01:03:49,426][123090] Updated weights for policy 1, policy_version 184685 (0.0009) [2023-12-26 01:03:49,493][123090] Updated weights for policy 1, policy_version 184695 (0.0008) [2023-12-26 01:03:49,738][123091] Updated weights for policy 0, policy_version 185379 (0.0009) [2023-12-26 01:03:49,790][123091] Updated weights for policy 0, policy_version 185389 (0.0009) [2023-12-26 01:03:49,852][123091] Updated weights for policy 0, policy_version 185399 (0.0009) [2023-12-26 01:03:50,321][123090] Updated weights for policy 1, policy_version 184705 (0.0009) [2023-12-26 01:03:50,388][123090] Updated weights for policy 1, policy_version 184715 (0.0009) [2023-12-26 01:03:50,448][123090] Updated weights for policy 1, policy_version 184725 (0.0010) [2023-12-26 01:03:50,510][123090] Updated weights for policy 1, policy_version 184735 (0.0009) [2023-12-26 01:03:50,720][123091] Updated weights for policy 0, policy_version 185409 (0.0010) [2023-12-26 01:03:50,778][123091] Updated weights for policy 0, policy_version 185419 (0.0009) [2023-12-26 01:03:50,853][123091] Updated weights for policy 0, policy_version 185429 (0.0010) [2023-12-26 01:03:50,911][123091] Updated weights for policy 0, policy_version 185439 (0.0010) [2023-12-26 01:03:51,359][123090] Updated weights for policy 1, policy_version 184745 (0.0008) [2023-12-26 01:03:51,422][123090] Updated weights for policy 1, policy_version 184755 (0.0010) [2023-12-26 01:03:51,475][123090] Updated weights for policy 1, policy_version 184765 (0.0009) [2023-12-26 01:03:51,781][123091] Updated weights for policy 0, policy_version 185449 (0.0010) [2023-12-26 01:03:51,837][123091] Updated weights for policy 0, policy_version 185459 (0.0010) [2023-12-26 01:03:51,898][123091] Updated weights for policy 0, policy_version 185469 (0.0009) [2023-12-26 01:03:52,305][123090] Updated weights for policy 1, policy_version 184775 (0.0010) [2023-12-26 01:03:52,367][123090] Updated weights for policy 1, policy_version 184785 (0.0009) [2023-12-26 01:03:52,432][123090] Updated weights for policy 1, policy_version 184795 (0.0010) [2023-12-26 01:03:52,750][123091] Updated weights for policy 0, policy_version 185479 (0.0010) [2023-12-26 01:03:52,810][123091] Updated weights for policy 0, policy_version 185489 (0.0009) [2023-12-26 01:03:52,872][123091] Updated weights for policy 0, policy_version 185499 (0.0009) [2023-12-26 01:03:53,169][123090] Updated weights for policy 1, policy_version 184805 (0.0008) [2023-12-26 01:03:53,228][123090] Updated weights for policy 1, policy_version 184815 (0.0009) [2023-12-26 01:03:53,282][123090] Updated weights for policy 1, policy_version 184825 (0.0010) [2023-12-26 01:03:53,688][123091] Updated weights for policy 0, policy_version 185509 (0.0006) [2023-12-26 01:03:53,745][123091] Updated weights for policy 0, policy_version 185519 (0.0005) [2023-12-26 01:03:53,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 94806016. Throughput: 0: 8625.0, 1: 8789.1. Samples: 94786968. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:03:53,785][121949] Avg episode reward: [(0, '5751.283'), (1, '5074.304')] [2023-12-26 01:03:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000184832_47316992.pth... [2023-12-26 01:03:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000183808_47054848.pth [2023-12-26 01:03:53,805][123091] Updated weights for policy 0, policy_version 185529 (0.0005) [2023-12-26 01:03:53,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000185536_47497216.pth... [2023-12-26 01:03:53,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000184512_47235072.pth [2023-12-26 01:03:54,139][123090] Updated weights for policy 1, policy_version 184835 (0.0008) [2023-12-26 01:03:54,205][123090] Updated weights for policy 1, policy_version 184845 (0.0008) [2023-12-26 01:03:54,272][123090] Updated weights for policy 1, policy_version 184855 (0.0011) [2023-12-26 01:03:54,573][123091] Updated weights for policy 0, policy_version 185539 (0.0006) [2023-12-26 01:03:54,636][123091] Updated weights for policy 0, policy_version 185549 (0.0009) [2023-12-26 01:03:54,702][123091] Updated weights for policy 0, policy_version 185559 (0.0009) [2023-12-26 01:03:54,930][123090] Updated weights for policy 1, policy_version 184865 (0.0008) [2023-12-26 01:03:55,000][123090] Updated weights for policy 1, policy_version 184875 (0.0006) [2023-12-26 01:03:55,054][123090] Updated weights for policy 1, policy_version 184885 (0.0007) [2023-12-26 01:03:55,110][123090] Updated weights for policy 1, policy_version 184895 (0.0005) [2023-12-26 01:03:55,619][123091] Updated weights for policy 0, policy_version 185569 (0.0009) [2023-12-26 01:03:55,684][123091] Updated weights for policy 0, policy_version 185579 (0.0009) [2023-12-26 01:03:55,733][123091] Updated weights for policy 0, policy_version 185589 (0.0008) [2023-12-26 01:03:55,783][123091] Updated weights for policy 0, policy_version 185599 (0.0009) [2023-12-26 01:03:55,802][123090] Updated weights for policy 1, policy_version 184905 (0.0010) [2023-12-26 01:03:55,868][123090] Updated weights for policy 1, policy_version 184915 (0.0010) [2023-12-26 01:03:55,922][123090] Updated weights for policy 1, policy_version 184925 (0.0010) [2023-12-26 01:03:56,626][123091] Updated weights for policy 0, policy_version 185609 (0.0009) [2023-12-26 01:03:56,679][123091] Updated weights for policy 0, policy_version 185620 (0.0010) [2023-12-26 01:03:56,718][123090] Updated weights for policy 1, policy_version 184935 (0.0007) [2023-12-26 01:03:56,746][123091] Updated weights for policy 0, policy_version 185630 (0.0009) [2023-12-26 01:03:56,771][123090] Updated weights for policy 1, policy_version 184945 (0.0005) [2023-12-26 01:03:56,839][123090] Updated weights for policy 1, policy_version 184955 (0.0006) [2023-12-26 01:03:57,516][123090] Updated weights for policy 1, policy_version 184965 (0.0009) [2023-12-26 01:03:57,569][123090] Updated weights for policy 1, policy_version 184975 (0.0009) [2023-12-26 01:03:57,601][123091] Updated weights for policy 0, policy_version 185641 (0.0008) [2023-12-26 01:03:57,625][123090] Updated weights for policy 1, policy_version 184985 (0.0005) [2023-12-26 01:03:57,663][123091] Updated weights for policy 0, policy_version 185651 (0.0008) [2023-12-26 01:03:57,720][123091] Updated weights for policy 0, policy_version 185661 (0.0009) [2023-12-26 01:03:58,341][123090] Updated weights for policy 1, policy_version 184995 (0.0006) [2023-12-26 01:03:58,405][123090] Updated weights for policy 1, policy_version 185005 (0.0009) [2023-12-26 01:03:58,467][123090] Updated weights for policy 1, policy_version 185015 (0.0008) [2023-12-26 01:03:58,619][123091] Updated weights for policy 0, policy_version 185671 (0.0009) [2023-12-26 01:03:58,687][123091] Updated weights for policy 0, policy_version 185681 (0.0008) [2023-12-26 01:03:58,761][123091] Updated weights for policy 0, policy_version 185691 (0.0008) [2023-12-26 01:03:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 94896128. Throughput: 0: 8643.0, 1: 8805.3. Samples: 94892980. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:03:58,785][121949] Avg episode reward: [(0, '5714.414'), (1, '5016.645')] [2023-12-26 01:03:59,363][123090] Updated weights for policy 1, policy_version 185025 (0.0008) [2023-12-26 01:03:59,426][123090] Updated weights for policy 1, policy_version 185035 (0.0009) [2023-12-26 01:03:59,489][123090] Updated weights for policy 1, policy_version 185045 (0.0009) [2023-12-26 01:03:59,552][123090] Updated weights for policy 1, policy_version 185055 (0.0008) [2023-12-26 01:03:59,587][123091] Updated weights for policy 0, policy_version 185701 (0.0007) [2023-12-26 01:03:59,663][123091] Updated weights for policy 0, policy_version 185711 (0.0007) [2023-12-26 01:03:59,718][123091] Updated weights for policy 0, policy_version 185721 (0.0009) [2023-12-26 01:04:00,320][123090] Updated weights for policy 1, policy_version 185065 (0.0009) [2023-12-26 01:04:00,380][123090] Updated weights for policy 1, policy_version 185075 (0.0010) [2023-12-26 01:04:00,439][123090] Updated weights for policy 1, policy_version 185085 (0.0009) [2023-12-26 01:04:00,507][123091] Updated weights for policy 0, policy_version 185731 (0.0010) [2023-12-26 01:04:00,558][123091] Updated weights for policy 0, policy_version 185741 (0.0009) [2023-12-26 01:04:00,608][123091] Updated weights for policy 0, policy_version 185752 (0.0010) [2023-12-26 01:04:01,287][123090] Updated weights for policy 1, policy_version 185095 (0.0009) [2023-12-26 01:04:01,357][123090] Updated weights for policy 1, policy_version 185105 (0.0010) [2023-12-26 01:04:01,417][123090] Updated weights for policy 1, policy_version 185115 (0.0010) [2023-12-26 01:04:01,472][123091] Updated weights for policy 0, policy_version 185762 (0.0009) [2023-12-26 01:04:01,537][123091] Updated weights for policy 0, policy_version 185772 (0.0009) [2023-12-26 01:04:01,614][123091] Updated weights for policy 0, policy_version 185782 (0.0006) [2023-12-26 01:04:01,686][123091] Updated weights for policy 0, policy_version 185792 (0.0007) [2023-12-26 01:04:02,319][123090] Updated weights for policy 1, policy_version 185125 (0.0009) [2023-12-26 01:04:02,344][123091] Updated weights for policy 0, policy_version 185802 (0.0006) [2023-12-26 01:04:02,383][123090] Updated weights for policy 1, policy_version 185135 (0.0009) [2023-12-26 01:04:02,414][123091] Updated weights for policy 0, policy_version 185812 (0.0008) [2023-12-26 01:04:02,447][123090] Updated weights for policy 1, policy_version 185145 (0.0006) [2023-12-26 01:04:02,481][123091] Updated weights for policy 0, policy_version 185822 (0.0008) [2023-12-26 01:04:03,141][123091] Updated weights for policy 0, policy_version 185832 (0.0006) [2023-12-26 01:04:03,197][123091] Updated weights for policy 0, policy_version 185842 (0.0005) [2023-12-26 01:04:03,259][123091] Updated weights for policy 0, policy_version 185852 (0.0005) [2023-12-26 01:04:03,315][123090] Updated weights for policy 1, policy_version 185155 (0.0007) [2023-12-26 01:04:03,373][123090] Updated weights for policy 1, policy_version 185165 (0.0005) [2023-12-26 01:04:03,433][123090] Updated weights for policy 1, policy_version 185175 (0.0005) [2023-12-26 01:04:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 94986240. Throughput: 0: 8653.9, 1: 8804.0. Samples: 94998788. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:03,784][121949] Avg episode reward: [(0, '5595.019'), (1, '5112.742')] [2023-12-26 01:04:03,994][123091] Updated weights for policy 0, policy_version 185862 (0.0008) [2023-12-26 01:04:04,054][123091] Updated weights for policy 0, policy_version 185872 (0.0009) [2023-12-26 01:04:04,115][123091] Updated weights for policy 0, policy_version 185882 (0.0009) [2023-12-26 01:04:04,182][123090] Updated weights for policy 1, policy_version 185185 (0.0006) [2023-12-26 01:04:04,246][123090] Updated weights for policy 1, policy_version 185195 (0.0010) [2023-12-26 01:04:04,305][123090] Updated weights for policy 1, policy_version 185205 (0.0009) [2023-12-26 01:04:04,355][123090] Updated weights for policy 1, policy_version 185215 (0.0009) [2023-12-26 01:04:04,848][123091] Updated weights for policy 0, policy_version 185892 (0.0009) [2023-12-26 01:04:04,901][123091] Updated weights for policy 0, policy_version 185902 (0.0008) [2023-12-26 01:04:04,948][123091] Updated weights for policy 0, policy_version 185912 (0.0005) [2023-12-26 01:04:05,160][123090] Updated weights for policy 1, policy_version 185225 (0.0005) [2023-12-26 01:04:05,219][123090] Updated weights for policy 1, policy_version 185235 (0.0006) [2023-12-26 01:04:05,272][123090] Updated weights for policy 1, policy_version 185245 (0.0005) [2023-12-26 01:04:05,681][123091] Updated weights for policy 0, policy_version 185922 (0.0006) [2023-12-26 01:04:05,753][123091] Updated weights for policy 0, policy_version 185932 (0.0008) [2023-12-26 01:04:05,816][123091] Updated weights for policy 0, policy_version 185942 (0.0009) [2023-12-26 01:04:05,872][123091] Updated weights for policy 0, policy_version 185952 (0.0006) [2023-12-26 01:04:05,909][123090] Updated weights for policy 1, policy_version 185255 (0.0005) [2023-12-26 01:04:05,956][123090] Updated weights for policy 1, policy_version 185265 (0.0005) [2023-12-26 01:04:06,003][123090] Updated weights for policy 1, policy_version 185275 (0.0005) [2023-12-26 01:04:06,661][123091] Updated weights for policy 0, policy_version 185962 (0.0010) [2023-12-26 01:04:06,720][123091] Updated weights for policy 0, policy_version 185972 (0.0011) [2023-12-26 01:04:06,728][123090] Updated weights for policy 1, policy_version 185285 (0.0006) [2023-12-26 01:04:06,777][123091] Updated weights for policy 0, policy_version 185982 (0.0011) [2023-12-26 01:04:06,781][123090] Updated weights for policy 1, policy_version 185295 (0.0008) [2023-12-26 01:04:06,852][123090] Updated weights for policy 1, policy_version 185305 (0.0009) [2023-12-26 01:04:07,427][123091] Updated weights for policy 0, policy_version 185992 (0.0007) [2023-12-26 01:04:07,488][123091] Updated weights for policy 0, policy_version 186002 (0.0010) [2023-12-26 01:04:07,551][123091] Updated weights for policy 0, policy_version 186012 (0.0011) [2023-12-26 01:04:07,724][123090] Updated weights for policy 1, policy_version 185315 (0.0010) [2023-12-26 01:04:07,784][123090] Updated weights for policy 1, policy_version 185325 (0.0011) [2023-12-26 01:04:07,849][123090] Updated weights for policy 1, policy_version 185335 (0.0011) [2023-12-26 01:04:08,330][123091] Updated weights for policy 0, policy_version 186022 (0.0008) [2023-12-26 01:04:08,397][123091] Updated weights for policy 0, policy_version 186032 (0.0008) [2023-12-26 01:04:08,460][123091] Updated weights for policy 0, policy_version 186042 (0.0008) [2023-12-26 01:04:08,682][123090] Updated weights for policy 1, policy_version 185345 (0.0011) [2023-12-26 01:04:08,743][123090] Updated weights for policy 1, policy_version 185355 (0.0009) [2023-12-26 01:04:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 95076352. Throughput: 0: 8719.6, 1: 8891.0. Samples: 95055344. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:08,785][121949] Avg episode reward: [(0, '5623.672'), (1, '5247.021')] [2023-12-26 01:04:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000186048_47628288.pth... [2023-12-26 01:04:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000185024_47366144.pth [2023-12-26 01:04:08,806][123090] Updated weights for policy 1, policy_version 185365 (0.0009) [2023-12-26 01:04:08,861][123090] Updated weights for policy 1, policy_version 185375 (0.0010) [2023-12-26 01:04:08,866][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000185376_47456256.pth... [2023-12-26 01:04:08,869][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000184320_47185920.pth [2023-12-26 01:04:09,233][123091] Updated weights for policy 0, policy_version 186052 (0.0008) [2023-12-26 01:04:09,302][123091] Updated weights for policy 0, policy_version 186062 (0.0009) [2023-12-26 01:04:09,368][123091] Updated weights for policy 0, policy_version 186072 (0.0008) [2023-12-26 01:04:09,743][123090] Updated weights for policy 1, policy_version 185385 (0.0010) [2023-12-26 01:04:09,810][123090] Updated weights for policy 1, policy_version 185395 (0.0011) [2023-12-26 01:04:09,880][123090] Updated weights for policy 1, policy_version 185405 (0.0010) [2023-12-26 01:04:10,083][123091] Updated weights for policy 0, policy_version 186082 (0.0008) [2023-12-26 01:04:10,150][123091] Updated weights for policy 0, policy_version 186092 (0.0009) [2023-12-26 01:04:10,217][123091] Updated weights for policy 0, policy_version 186102 (0.0006) [2023-12-26 01:04:10,276][123091] Updated weights for policy 0, policy_version 186112 (0.0008) [2023-12-26 01:04:10,690][123090] Updated weights for policy 1, policy_version 185415 (0.0008) [2023-12-26 01:04:10,763][123090] Updated weights for policy 1, policy_version 185425 (0.0006) [2023-12-26 01:04:10,837][123090] Updated weights for policy 1, policy_version 185435 (0.0005) [2023-12-26 01:04:11,095][123091] Updated weights for policy 0, policy_version 186122 (0.0011) [2023-12-26 01:04:11,167][123091] Updated weights for policy 0, policy_version 186132 (0.0009) [2023-12-26 01:04:11,236][123091] Updated weights for policy 0, policy_version 186142 (0.0009) [2023-12-26 01:04:11,595][123090] Updated weights for policy 1, policy_version 185445 (0.0008) [2023-12-26 01:04:11,664][123090] Updated weights for policy 1, policy_version 185455 (0.0010) [2023-12-26 01:04:11,740][123090] Updated weights for policy 1, policy_version 185465 (0.0010) [2023-12-26 01:04:12,107][123091] Updated weights for policy 0, policy_version 186152 (0.0011) [2023-12-26 01:04:12,179][123091] Updated weights for policy 0, policy_version 186162 (0.0011) [2023-12-26 01:04:12,243][123091] Updated weights for policy 0, policy_version 186172 (0.0010) [2023-12-26 01:04:12,562][123090] Updated weights for policy 1, policy_version 185475 (0.0009) [2023-12-26 01:04:12,643][123090] Updated weights for policy 1, policy_version 185485 (0.0006) [2023-12-26 01:04:12,702][123090] Updated weights for policy 1, policy_version 185495 (0.0005) [2023-12-26 01:04:13,067][123091] Updated weights for policy 0, policy_version 186182 (0.0006) [2023-12-26 01:04:13,142][123091] Updated weights for policy 0, policy_version 186192 (0.0005) [2023-12-26 01:04:13,218][123091] Updated weights for policy 0, policy_version 186202 (0.0005) [2023-12-26 01:04:13,469][123090] Updated weights for policy 1, policy_version 185505 (0.0006) [2023-12-26 01:04:13,518][123090] Updated weights for policy 1, policy_version 185515 (0.0009) [2023-12-26 01:04:13,568][123090] Updated weights for policy 1, policy_version 185525 (0.0009) [2023-12-26 01:04:13,625][123090] Updated weights for policy 1, policy_version 185535 (0.0009) [2023-12-26 01:04:13,778][123091] Updated weights for policy 0, policy_version 186212 (0.0005) [2023-12-26 01:04:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 95166464. Throughput: 0: 8735.8, 1: 8833.1. Samples: 95159368. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:13,784][121949] Avg episode reward: [(0, '5740.918'), (1, '5349.562')] [2023-12-26 01:04:13,854][123091] Updated weights for policy 0, policy_version 186222 (0.0005) [2023-12-26 01:04:13,906][123091] Updated weights for policy 0, policy_version 186232 (0.0005) [2023-12-26 01:04:14,540][123090] Updated weights for policy 1, policy_version 185545 (0.0010) [2023-12-26 01:04:14,591][123091] Updated weights for policy 0, policy_version 186242 (0.0006) [2023-12-26 01:04:14,591][123090] Updated weights for policy 1, policy_version 185555 (0.0009) [2023-12-26 01:04:14,648][123091] Updated weights for policy 0, policy_version 186252 (0.0005) [2023-12-26 01:04:14,650][123090] Updated weights for policy 1, policy_version 185565 (0.0008) [2023-12-26 01:04:14,709][123091] Updated weights for policy 0, policy_version 186262 (0.0005) [2023-12-26 01:04:14,759][123091] Updated weights for policy 0, policy_version 186272 (0.0005) [2023-12-26 01:04:15,511][123091] Updated weights for policy 0, policy_version 186282 (0.0007) [2023-12-26 01:04:15,558][123090] Updated weights for policy 1, policy_version 185575 (0.0007) [2023-12-26 01:04:15,573][123091] Updated weights for policy 0, policy_version 186292 (0.0010) [2023-12-26 01:04:15,618][123090] Updated weights for policy 1, policy_version 185585 (0.0007) [2023-12-26 01:04:15,633][123091] Updated weights for policy 0, policy_version 186302 (0.0009) [2023-12-26 01:04:15,677][123090] Updated weights for policy 1, policy_version 185595 (0.0008) [2023-12-26 01:04:16,428][123091] Updated weights for policy 0, policy_version 186312 (0.0006) [2023-12-26 01:04:16,481][123091] Updated weights for policy 0, policy_version 186322 (0.0007) [2023-12-26 01:04:16,536][123090] Updated weights for policy 1, policy_version 185605 (0.0009) [2023-12-26 01:04:16,546][123091] Updated weights for policy 0, policy_version 186332 (0.0007) [2023-12-26 01:04:16,601][123090] Updated weights for policy 1, policy_version 185615 (0.0009) [2023-12-26 01:04:16,660][123090] Updated weights for policy 1, policy_version 185625 (0.0010) [2023-12-26 01:04:17,135][123091] Updated weights for policy 0, policy_version 186342 (0.0007) [2023-12-26 01:04:17,198][123091] Updated weights for policy 0, policy_version 186352 (0.0009) [2023-12-26 01:04:17,257][123091] Updated weights for policy 0, policy_version 186362 (0.0009) [2023-12-26 01:04:17,535][123090] Updated weights for policy 1, policy_version 185635 (0.0009) [2023-12-26 01:04:17,595][123090] Updated weights for policy 1, policy_version 185645 (0.0009) [2023-12-26 01:04:17,654][123090] Updated weights for policy 1, policy_version 185655 (0.0009) [2023-12-26 01:04:18,057][123091] Updated weights for policy 0, policy_version 186372 (0.0009) [2023-12-26 01:04:18,113][123091] Updated weights for policy 0, policy_version 186382 (0.0009) [2023-12-26 01:04:18,161][123091] Updated weights for policy 0, policy_version 186392 (0.0009) [2023-12-26 01:04:18,279][123090] Updated weights for policy 1, policy_version 185665 (0.0006) [2023-12-26 01:04:18,344][123090] Updated weights for policy 1, policy_version 185675 (0.0009) [2023-12-26 01:04:18,412][123090] Updated weights for policy 1, policy_version 185685 (0.0010) [2023-12-26 01:04:18,475][123090] Updated weights for policy 1, policy_version 185695 (0.0010) [2023-12-26 01:04:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 95256576. Throughput: 0: 8847.0, 1: 8754.1. Samples: 95266784. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:18,785][121949] Avg episode reward: [(0, '5747.521'), (1, '5337.354')] [2023-12-26 01:04:19,016][123091] Updated weights for policy 0, policy_version 186402 (0.0009) [2023-12-26 01:04:19,076][123091] Updated weights for policy 0, policy_version 186412 (0.0009) [2023-12-26 01:04:19,133][123091] Updated weights for policy 0, policy_version 186422 (0.0009) [2023-12-26 01:04:19,190][123091] Updated weights for policy 0, policy_version 186432 (0.0009) [2023-12-26 01:04:19,314][123090] Updated weights for policy 1, policy_version 185705 (0.0010) [2023-12-26 01:04:19,385][123090] Updated weights for policy 1, policy_version 185715 (0.0009) [2023-12-26 01:04:19,443][123090] Updated weights for policy 1, policy_version 185725 (0.0008) [2023-12-26 01:04:20,040][123091] Updated weights for policy 0, policy_version 186442 (0.0010) [2023-12-26 01:04:20,097][123091] Updated weights for policy 0, policy_version 186452 (0.0009) [2023-12-26 01:04:20,152][123091] Updated weights for policy 0, policy_version 186462 (0.0009) [2023-12-26 01:04:20,293][123090] Updated weights for policy 1, policy_version 185735 (0.0009) [2023-12-26 01:04:20,355][123090] Updated weights for policy 1, policy_version 185745 (0.0010) [2023-12-26 01:04:20,411][123090] Updated weights for policy 1, policy_version 185755 (0.0010) [2023-12-26 01:04:21,079][123091] Updated weights for policy 0, policy_version 186472 (0.0009) [2023-12-26 01:04:21,150][123091] Updated weights for policy 0, policy_version 186482 (0.0008) [2023-12-26 01:04:21,222][123090] Updated weights for policy 1, policy_version 185765 (0.0010) [2023-12-26 01:04:21,222][123091] Updated weights for policy 0, policy_version 186492 (0.0006) [2023-12-26 01:04:21,290][123090] Updated weights for policy 1, policy_version 185775 (0.0011) [2023-12-26 01:04:21,360][123090] Updated weights for policy 1, policy_version 185785 (0.0012) [2023-12-26 01:04:22,034][123091] Updated weights for policy 0, policy_version 186502 (0.0007) [2023-12-26 01:04:22,095][123091] Updated weights for policy 0, policy_version 186512 (0.0008) [2023-12-26 01:04:22,164][123091] Updated weights for policy 0, policy_version 186522 (0.0008) [2023-12-26 01:04:22,225][123090] Updated weights for policy 1, policy_version 185795 (0.0010) [2023-12-26 01:04:22,299][123090] Updated weights for policy 1, policy_version 185805 (0.0009) [2023-12-26 01:04:22,371][123090] Updated weights for policy 1, policy_version 185815 (0.0009) [2023-12-26 01:04:22,988][123091] Updated weights for policy 0, policy_version 186532 (0.0009) [2023-12-26 01:04:23,036][123091] Updated weights for policy 0, policy_version 186542 (0.0009) [2023-12-26 01:04:23,100][123091] Updated weights for policy 0, policy_version 186552 (0.0009) [2023-12-26 01:04:23,216][123090] Updated weights for policy 1, policy_version 185825 (0.0010) [2023-12-26 01:04:23,264][123090] Updated weights for policy 1, policy_version 185835 (0.0010) [2023-12-26 01:04:23,312][123090] Updated weights for policy 1, policy_version 185845 (0.0010) [2023-12-26 01:04:23,364][123090] Updated weights for policy 1, policy_version 185855 (0.0010) [2023-12-26 01:04:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 95338496. Throughput: 0: 8840.9, 1: 8743.2. Samples: 95317556. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:23,785][121949] Avg episode reward: [(0, '5723.094'), (1, '5322.406')] [2023-12-26 01:04:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000186560_47759360.pth... [2023-12-26 01:04:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000185856_47579136.pth... [2023-12-26 01:04:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000185536_47497216.pth [2023-12-26 01:04:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000184832_47316992.pth [2023-12-26 01:04:23,970][123091] Updated weights for policy 0, policy_version 186562 (0.0009) [2023-12-26 01:04:24,020][123091] Updated weights for policy 0, policy_version 186572 (0.0010) [2023-12-26 01:04:24,091][123091] Updated weights for policy 0, policy_version 186582 (0.0009) [2023-12-26 01:04:24,152][123091] Updated weights for policy 0, policy_version 186592 (0.0008) [2023-12-26 01:04:24,188][123090] Updated weights for policy 1, policy_version 185865 (0.0006) [2023-12-26 01:04:24,249][123090] Updated weights for policy 1, policy_version 185875 (0.0005) [2023-12-26 01:04:24,310][123090] Updated weights for policy 1, policy_version 185885 (0.0005) [2023-12-26 01:04:24,930][123091] Updated weights for policy 0, policy_version 186602 (0.0010) [2023-12-26 01:04:24,985][123091] Updated weights for policy 0, policy_version 186612 (0.0010) [2023-12-26 01:04:24,992][123090] Updated weights for policy 1, policy_version 185895 (0.0006) [2023-12-26 01:04:25,045][123091] Updated weights for policy 0, policy_version 186622 (0.0011) [2023-12-26 01:04:25,054][123090] Updated weights for policy 1, policy_version 185905 (0.0008) [2023-12-26 01:04:25,114][123090] Updated weights for policy 1, policy_version 185915 (0.0009) [2023-12-26 01:04:25,823][123090] Updated weights for policy 1, policy_version 185925 (0.0007) [2023-12-26 01:04:25,865][123091] Updated weights for policy 0, policy_version 186632 (0.0011) [2023-12-26 01:04:25,879][123090] Updated weights for policy 1, policy_version 185935 (0.0008) [2023-12-26 01:04:25,929][123091] Updated weights for policy 0, policy_version 186642 (0.0011) [2023-12-26 01:04:25,939][123090] Updated weights for policy 1, policy_version 185945 (0.0006) [2023-12-26 01:04:25,996][123091] Updated weights for policy 0, policy_version 186652 (0.0011) [2023-12-26 01:04:26,739][123090] Updated weights for policy 1, policy_version 185955 (0.0008) [2023-12-26 01:04:26,792][123090] Updated weights for policy 1, policy_version 185965 (0.0011) [2023-12-26 01:04:26,794][123091] Updated weights for policy 0, policy_version 186662 (0.0008) [2023-12-26 01:04:26,855][123090] Updated weights for policy 1, policy_version 185975 (0.0010) [2023-12-26 01:04:26,857][123091] Updated weights for policy 0, policy_version 186672 (0.0005) [2023-12-26 01:04:26,914][123091] Updated weights for policy 0, policy_version 186682 (0.0009) [2023-12-26 01:04:27,544][123091] Updated weights for policy 0, policy_version 186692 (0.0006) [2023-12-26 01:04:27,593][123090] Updated weights for policy 1, policy_version 185985 (0.0008) [2023-12-26 01:04:27,616][123091] Updated weights for policy 0, policy_version 186702 (0.0006) [2023-12-26 01:04:27,648][123090] Updated weights for policy 1, policy_version 185995 (0.0010) [2023-12-26 01:04:27,679][123091] Updated weights for policy 0, policy_version 186712 (0.0006) [2023-12-26 01:04:27,706][123090] Updated weights for policy 1, policy_version 186005 (0.0010) [2023-12-26 01:04:27,764][123090] Updated weights for policy 1, policy_version 186015 (0.0010) [2023-12-26 01:04:28,299][123091] Updated weights for policy 0, policy_version 186722 (0.0007) [2023-12-26 01:04:28,359][123091] Updated weights for policy 0, policy_version 186732 (0.0007) [2023-12-26 01:04:28,426][123091] Updated weights for policy 0, policy_version 186742 (0.0006) [2023-12-26 01:04:28,488][123091] Updated weights for policy 0, policy_version 186752 (0.0005) [2023-12-26 01:04:28,594][123090] Updated weights for policy 1, policy_version 186025 (0.0010) [2023-12-26 01:04:28,645][123090] Updated weights for policy 1, policy_version 186035 (0.0010) [2023-12-26 01:04:28,700][123090] Updated weights for policy 1, policy_version 186045 (0.0010) [2023-12-26 01:04:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 95436800. Throughput: 0: 8938.0, 1: 8754.4. Samples: 95425636. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:28,785][121949] Avg episode reward: [(0, '5773.256'), (1, '5308.181')] [2023-12-26 01:04:29,138][123091] Updated weights for policy 0, policy_version 186762 (0.0007) [2023-12-26 01:04:29,220][123091] Updated weights for policy 0, policy_version 186772 (0.0007) [2023-12-26 01:04:29,280][123091] Updated weights for policy 0, policy_version 186782 (0.0009) [2023-12-26 01:04:29,563][123090] Updated weights for policy 1, policy_version 186055 (0.0010) [2023-12-26 01:04:29,623][123090] Updated weights for policy 1, policy_version 186065 (0.0009) [2023-12-26 01:04:29,678][123090] Updated weights for policy 1, policy_version 186075 (0.0008) [2023-12-26 01:04:30,068][123091] Updated weights for policy 0, policy_version 186792 (0.0010) [2023-12-26 01:04:30,119][123091] Updated weights for policy 0, policy_version 186802 (0.0010) [2023-12-26 01:04:30,174][123091] Updated weights for policy 0, policy_version 186812 (0.0010) [2023-12-26 01:04:30,457][123090] Updated weights for policy 1, policy_version 186085 (0.0007) [2023-12-26 01:04:30,522][123090] Updated weights for policy 1, policy_version 186095 (0.0005) [2023-12-26 01:04:30,586][123090] Updated weights for policy 1, policy_version 186105 (0.0005) [2023-12-26 01:04:30,928][123091] Updated weights for policy 0, policy_version 186822 (0.0006) [2023-12-26 01:04:30,990][123091] Updated weights for policy 0, policy_version 186832 (0.0006) [2023-12-26 01:04:31,053][123091] Updated weights for policy 0, policy_version 186842 (0.0012) [2023-12-26 01:04:31,189][123090] Updated weights for policy 1, policy_version 186115 (0.0006) [2023-12-26 01:04:31,242][123090] Updated weights for policy 1, policy_version 186125 (0.0009) [2023-12-26 01:04:31,300][123090] Updated weights for policy 1, policy_version 186135 (0.0010) [2023-12-26 01:04:31,792][123091] Updated weights for policy 0, policy_version 186852 (0.0006) [2023-12-26 01:04:31,848][123091] Updated weights for policy 0, policy_version 186862 (0.0006) [2023-12-26 01:04:31,917][123091] Updated weights for policy 0, policy_version 186872 (0.0005) [2023-12-26 01:04:32,220][123090] Updated weights for policy 1, policy_version 186145 (0.0010) [2023-12-26 01:04:32,287][123090] Updated weights for policy 1, policy_version 186155 (0.0009) [2023-12-26 01:04:32,354][123090] Updated weights for policy 1, policy_version 186165 (0.0009) [2023-12-26 01:04:32,419][123090] Updated weights for policy 1, policy_version 186175 (0.0008) [2023-12-26 01:04:32,608][123091] Updated weights for policy 0, policy_version 186882 (0.0006) [2023-12-26 01:04:32,666][123091] Updated weights for policy 0, policy_version 186892 (0.0009) [2023-12-26 01:04:32,725][123091] Updated weights for policy 0, policy_version 186902 (0.0009) [2023-12-26 01:04:32,789][123091] Updated weights for policy 0, policy_version 186912 (0.0009) [2023-12-26 01:04:33,256][123090] Updated weights for policy 1, policy_version 186185 (0.0008) [2023-12-26 01:04:33,306][123090] Updated weights for policy 1, policy_version 186195 (0.0005) [2023-12-26 01:04:33,364][123090] Updated weights for policy 1, policy_version 186205 (0.0008) [2023-12-26 01:04:33,561][123091] Updated weights for policy 0, policy_version 186922 (0.0009) [2023-12-26 01:04:33,620][123091] Updated weights for policy 0, policy_version 186932 (0.0009) [2023-12-26 01:04:33,679][123091] Updated weights for policy 0, policy_version 186942 (0.0005) [2023-12-26 01:04:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 95526912. Throughput: 0: 8980.1, 1: 8769.2. Samples: 95535176. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:33,785][121949] Avg episode reward: [(0, '5648.630'), (1, '5138.079')] [2023-12-26 01:04:34,254][123090] Updated weights for policy 1, policy_version 186215 (0.0010) [2023-12-26 01:04:34,312][123090] Updated weights for policy 1, policy_version 186225 (0.0009) [2023-12-26 01:04:34,319][123091] Updated weights for policy 0, policy_version 186952 (0.0007) [2023-12-26 01:04:34,378][123090] Updated weights for policy 1, policy_version 186235 (0.0009) [2023-12-26 01:04:34,383][123091] Updated weights for policy 0, policy_version 186962 (0.0010) [2023-12-26 01:04:34,443][123091] Updated weights for policy 0, policy_version 186972 (0.0010) [2023-12-26 01:04:35,204][123090] Updated weights for policy 1, policy_version 186245 (0.0010) [2023-12-26 01:04:35,255][123090] Updated weights for policy 1, policy_version 186255 (0.0007) [2023-12-26 01:04:35,258][123091] Updated weights for policy 0, policy_version 186982 (0.0010) [2023-12-26 01:04:35,307][123091] Updated weights for policy 0, policy_version 186992 (0.0009) [2023-12-26 01:04:35,309][123090] Updated weights for policy 1, policy_version 186265 (0.0007) [2023-12-26 01:04:35,365][123091] Updated weights for policy 0, policy_version 187002 (0.0009) [2023-12-26 01:04:36,049][123091] Updated weights for policy 0, policy_version 187012 (0.0009) [2023-12-26 01:04:36,108][123091] Updated weights for policy 0, policy_version 187022 (0.0010) [2023-12-26 01:04:36,180][123091] Updated weights for policy 0, policy_version 187032 (0.0010) [2023-12-26 01:04:36,224][123090] Updated weights for policy 1, policy_version 186275 (0.0008) [2023-12-26 01:04:36,285][123090] Updated weights for policy 1, policy_version 186285 (0.0009) [2023-12-26 01:04:36,336][123090] Updated weights for policy 1, policy_version 186295 (0.0009) [2023-12-26 01:04:37,026][123091] Updated weights for policy 0, policy_version 187042 (0.0009) [2023-12-26 01:04:37,097][123091] Updated weights for policy 0, policy_version 187052 (0.0010) [2023-12-26 01:04:37,146][123090] Updated weights for policy 1, policy_version 186305 (0.0009) [2023-12-26 01:04:37,165][123091] Updated weights for policy 0, policy_version 187062 (0.0010) [2023-12-26 01:04:37,204][123090] Updated weights for policy 1, policy_version 186315 (0.0007) [2023-12-26 01:04:37,229][123091] Updated weights for policy 0, policy_version 187072 (0.0010) [2023-12-26 01:04:37,256][123090] Updated weights for policy 1, policy_version 186325 (0.0007) [2023-12-26 01:04:37,310][123090] Updated weights for policy 1, policy_version 186335 (0.0009) [2023-12-26 01:04:38,074][123091] Updated weights for policy 0, policy_version 187082 (0.0010) [2023-12-26 01:04:38,113][123090] Updated weights for policy 1, policy_version 186345 (0.0009) [2023-12-26 01:04:38,128][123091] Updated weights for policy 0, policy_version 187092 (0.0009) [2023-12-26 01:04:38,177][123090] Updated weights for policy 1, policy_version 186355 (0.0008) [2023-12-26 01:04:38,184][123091] Updated weights for policy 0, policy_version 187103 (0.0009) [2023-12-26 01:04:38,235][123090] Updated weights for policy 1, policy_version 186365 (0.0010) [2023-12-26 01:04:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 95608832. Throughput: 0: 9051.5, 1: 8753.4. Samples: 95588188. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:38,785][121949] Avg episode reward: [(0, '5684.142'), (1, '4977.753')] [2023-12-26 01:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000187104_47898624.pth... [2023-12-26 01:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000186368_47710208.pth... [2023-12-26 01:04:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000186048_47628288.pth [2023-12-26 01:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000185376_47456256.pth [2023-12-26 01:04:39,039][123090] Updated weights for policy 1, policy_version 186375 (0.0006) [2023-12-26 01:04:39,063][123091] Updated weights for policy 0, policy_version 187113 (0.0009) [2023-12-26 01:04:39,093][123090] Updated weights for policy 1, policy_version 186385 (0.0005) [2023-12-26 01:04:39,112][123091] Updated weights for policy 0, policy_version 187123 (0.0008) [2023-12-26 01:04:39,150][123090] Updated weights for policy 1, policy_version 186395 (0.0005) [2023-12-26 01:04:39,173][123091] Updated weights for policy 0, policy_version 187133 (0.0008) [2023-12-26 01:04:39,909][123090] Updated weights for policy 1, policy_version 186405 (0.0008) [2023-12-26 01:04:39,977][123090] Updated weights for policy 1, policy_version 186415 (0.0007) [2023-12-26 01:04:40,027][123091] Updated weights for policy 0, policy_version 187143 (0.0010) [2023-12-26 01:04:40,053][123090] Updated weights for policy 1, policy_version 186425 (0.0006) [2023-12-26 01:04:40,087][123091] Updated weights for policy 0, policy_version 187153 (0.0008) [2023-12-26 01:04:40,150][123091] Updated weights for policy 0, policy_version 187163 (0.0009) [2023-12-26 01:04:40,872][123090] Updated weights for policy 1, policy_version 186435 (0.0009) [2023-12-26 01:04:40,933][123090] Updated weights for policy 1, policy_version 186445 (0.0009) [2023-12-26 01:04:40,987][123090] Updated weights for policy 1, policy_version 186455 (0.0010) [2023-12-26 01:04:41,004][123091] Updated weights for policy 0, policy_version 187173 (0.0008) [2023-12-26 01:04:41,070][123091] Updated weights for policy 0, policy_version 187183 (0.0008) [2023-12-26 01:04:41,139][123091] Updated weights for policy 0, policy_version 187193 (0.0009) [2023-12-26 01:04:41,796][123090] Updated weights for policy 1, policy_version 186465 (0.0008) [2023-12-26 01:04:41,870][123090] Updated weights for policy 1, policy_version 186475 (0.0008) [2023-12-26 01:04:41,940][123090] Updated weights for policy 1, policy_version 186485 (0.0008) [2023-12-26 01:04:42,003][123090] Updated weights for policy 1, policy_version 186495 (0.0008) [2023-12-26 01:04:42,045][123091] Updated weights for policy 0, policy_version 187203 (0.0011) [2023-12-26 01:04:42,108][123091] Updated weights for policy 0, policy_version 187213 (0.0009) [2023-12-26 01:04:42,176][123091] Updated weights for policy 0, policy_version 187223 (0.0009) [2023-12-26 01:04:42,770][123090] Updated weights for policy 1, policy_version 186505 (0.0010) [2023-12-26 01:04:42,827][123090] Updated weights for policy 1, policy_version 186515 (0.0011) [2023-12-26 01:04:42,871][123090] Updated weights for policy 1, policy_version 186525 (0.0010) [2023-12-26 01:04:43,042][123091] Updated weights for policy 0, policy_version 187233 (0.0010) [2023-12-26 01:04:43,112][123091] Updated weights for policy 0, policy_version 187243 (0.0009) [2023-12-26 01:04:43,179][123091] Updated weights for policy 0, policy_version 187253 (0.0009) [2023-12-26 01:04:43,231][123091] Updated weights for policy 0, policy_version 187263 (0.0009) [2023-12-26 01:04:43,659][123090] Updated weights for policy 1, policy_version 186535 (0.0009) [2023-12-26 01:04:43,707][123090] Updated weights for policy 1, policy_version 186545 (0.0009) [2023-12-26 01:04:43,757][123090] Updated weights for policy 1, policy_version 186556 (0.0009) [2023-12-26 01:04:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 95698944. Throughput: 0: 9014.6, 1: 8705.5. Samples: 95690384. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:43,784][121949] Avg episode reward: [(0, '5729.689'), (1, '5089.344')] [2023-12-26 01:04:44,067][123091] Updated weights for policy 0, policy_version 187273 (0.0009) [2023-12-26 01:04:44,122][123091] Updated weights for policy 0, policy_version 187283 (0.0010) [2023-12-26 01:04:44,188][123091] Updated weights for policy 0, policy_version 187293 (0.0009) [2023-12-26 01:04:44,567][123090] Updated weights for policy 1, policy_version 186566 (0.0007) [2023-12-26 01:04:44,621][123090] Updated weights for policy 1, policy_version 186576 (0.0005) [2023-12-26 01:04:44,679][123090] Updated weights for policy 1, policy_version 186586 (0.0006) [2023-12-26 01:04:45,053][123091] Updated weights for policy 0, policy_version 187303 (0.0009) [2023-12-26 01:04:45,104][123091] Updated weights for policy 0, policy_version 187313 (0.0009) [2023-12-26 01:04:45,165][123091] Updated weights for policy 0, policy_version 187323 (0.0009) [2023-12-26 01:04:45,486][123090] Updated weights for policy 1, policy_version 186596 (0.0010) [2023-12-26 01:04:45,567][123090] Updated weights for policy 1, policy_version 186606 (0.0009) [2023-12-26 01:04:45,640][123090] Updated weights for policy 1, policy_version 186616 (0.0009) [2023-12-26 01:04:45,827][123091] Updated weights for policy 0, policy_version 187333 (0.0007) [2023-12-26 01:04:45,879][123091] Updated weights for policy 0, policy_version 187343 (0.0007) [2023-12-26 01:04:45,932][123091] Updated weights for policy 0, policy_version 187353 (0.0009) [2023-12-26 01:04:46,444][123090] Updated weights for policy 1, policy_version 186626 (0.0009) [2023-12-26 01:04:46,497][123090] Updated weights for policy 1, policy_version 186636 (0.0010) [2023-12-26 01:04:46,554][123090] Updated weights for policy 1, policy_version 186647 (0.0011) [2023-12-26 01:04:46,693][123091] Updated weights for policy 0, policy_version 187363 (0.0008) [2023-12-26 01:04:46,760][123091] Updated weights for policy 0, policy_version 187373 (0.0005) [2023-12-26 01:04:46,831][123091] Updated weights for policy 0, policy_version 187383 (0.0005) [2023-12-26 01:04:47,266][123090] Updated weights for policy 1, policy_version 186657 (0.0010) [2023-12-26 01:04:47,332][123090] Updated weights for policy 1, policy_version 186667 (0.0010) [2023-12-26 01:04:47,388][123091] Updated weights for policy 0, policy_version 187393 (0.0005) [2023-12-26 01:04:47,401][123090] Updated weights for policy 1, policy_version 186677 (0.0010) [2023-12-26 01:04:47,438][123091] Updated weights for policy 0, policy_version 187403 (0.0008) [2023-12-26 01:04:47,456][123090] Updated weights for policy 1, policy_version 186687 (0.0010) [2023-12-26 01:04:47,491][123091] Updated weights for policy 0, policy_version 187413 (0.0007) [2023-12-26 01:04:47,546][123091] Updated weights for policy 0, policy_version 187423 (0.0008) [2023-12-26 01:04:48,262][123091] Updated weights for policy 0, policy_version 187433 (0.0006) [2023-12-26 01:04:48,279][123090] Updated weights for policy 1, policy_version 186697 (0.0010) [2023-12-26 01:04:48,319][123091] Updated weights for policy 0, policy_version 187443 (0.0007) [2023-12-26 01:04:48,362][123090] Updated weights for policy 1, policy_version 186707 (0.0009) [2023-12-26 01:04:48,381][123091] Updated weights for policy 0, policy_version 187453 (0.0011) [2023-12-26 01:04:48,432][123090] Updated weights for policy 1, policy_version 186717 (0.0006) [2023-12-26 01:04:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 95789056. Throughput: 0: 9050.7, 1: 8746.8. Samples: 95799676. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:48,785][121949] Avg episode reward: [(0, '5504.232'), (1, '5116.548')] [2023-12-26 01:04:49,149][123090] Updated weights for policy 1, policy_version 186727 (0.0005) [2023-12-26 01:04:49,194][123091] Updated weights for policy 0, policy_version 187463 (0.0008) [2023-12-26 01:04:49,203][123090] Updated weights for policy 1, policy_version 186737 (0.0008) [2023-12-26 01:04:49,261][123091] Updated weights for policy 0, policy_version 187473 (0.0008) [2023-12-26 01:04:49,270][123090] Updated weights for policy 1, policy_version 186747 (0.0010) [2023-12-26 01:04:49,333][123091] Updated weights for policy 0, policy_version 187484 (0.0008) [2023-12-26 01:04:49,975][123090] Updated weights for policy 1, policy_version 186757 (0.0009) [2023-12-26 01:04:50,038][123090] Updated weights for policy 1, policy_version 186767 (0.0010) [2023-12-26 01:04:50,106][123090] Updated weights for policy 1, policy_version 186777 (0.0009) [2023-12-26 01:04:50,108][123091] Updated weights for policy 0, policy_version 187494 (0.0008) [2023-12-26 01:04:50,168][123091] Updated weights for policy 0, policy_version 187504 (0.0008) [2023-12-26 01:04:50,232][123091] Updated weights for policy 0, policy_version 187514 (0.0010) [2023-12-26 01:04:50,983][123090] Updated weights for policy 1, policy_version 186787 (0.0009) [2023-12-26 01:04:51,051][123090] Updated weights for policy 1, policy_version 186797 (0.0009) [2023-12-26 01:04:51,057][123091] Updated weights for policy 0, policy_version 187524 (0.0009) [2023-12-26 01:04:51,108][123090] Updated weights for policy 1, policy_version 186807 (0.0010) [2023-12-26 01:04:51,118][123091] Updated weights for policy 0, policy_version 187534 (0.0006) [2023-12-26 01:04:51,181][123091] Updated weights for policy 0, policy_version 187544 (0.0010) [2023-12-26 01:04:51,979][123090] Updated weights for policy 1, policy_version 186817 (0.0008) [2023-12-26 01:04:52,025][123091] Updated weights for policy 0, policy_version 187554 (0.0011) [2023-12-26 01:04:52,036][123090] Updated weights for policy 1, policy_version 186827 (0.0008) [2023-12-26 01:04:52,088][123091] Updated weights for policy 0, policy_version 187564 (0.0011) [2023-12-26 01:04:52,104][123090] Updated weights for policy 1, policy_version 186837 (0.0006) [2023-12-26 01:04:52,152][123091] Updated weights for policy 0, policy_version 187574 (0.0011) [2023-12-26 01:04:52,155][123090] Updated weights for policy 1, policy_version 186847 (0.0008) [2023-12-26 01:04:52,212][123091] Updated weights for policy 0, policy_version 187584 (0.0011) [2023-12-26 01:04:52,885][123090] Updated weights for policy 1, policy_version 186857 (0.0008) [2023-12-26 01:04:52,952][123090] Updated weights for policy 1, policy_version 186867 (0.0009) [2023-12-26 01:04:53,012][123090] Updated weights for policy 1, policy_version 186877 (0.0009) [2023-12-26 01:04:53,047][123091] Updated weights for policy 0, policy_version 187594 (0.0011) [2023-12-26 01:04:53,111][123091] Updated weights for policy 0, policy_version 187604 (0.0011) [2023-12-26 01:04:53,171][123091] Updated weights for policy 0, policy_version 187614 (0.0010) [2023-12-26 01:04:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.2, 300 sec: 17578.1). Total num frames: 95870976. Throughput: 0: 9006.5, 1: 8689.2. Samples: 95851656. Policy #0 lag: (min: 19.0, avg: 24.6, max: 51.0) [2023-12-26 01:04:53,786][121949] Avg episode reward: [(0, '5555.531'), (1, '5086.480')] [2023-12-26 01:04:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000187616_48029696.pth... [2023-12-26 01:04:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000186880_47841280.pth... [2023-12-26 01:04:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000186560_47759360.pth [2023-12-26 01:04:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000185856_47579136.pth [2023-12-26 01:04:53,874][123091] Updated weights for policy 0, policy_version 187624 (0.0005) [2023-12-26 01:04:53,925][123090] Updated weights for policy 1, policy_version 186887 (0.0009) [2023-12-26 01:04:53,945][123091] Updated weights for policy 0, policy_version 187634 (0.0006) [2023-12-26 01:04:53,974][123090] Updated weights for policy 1, policy_version 186897 (0.0009) [2023-12-26 01:04:54,016][123091] Updated weights for policy 0, policy_version 187644 (0.0011) [2023-12-26 01:04:54,038][123090] Updated weights for policy 1, policy_version 186907 (0.0005) [2023-12-26 01:04:54,710][123091] Updated weights for policy 0, policy_version 187654 (0.0009) [2023-12-26 01:04:54,775][123091] Updated weights for policy 0, policy_version 187664 (0.0005) [2023-12-26 01:04:54,843][123091] Updated weights for policy 0, policy_version 187674 (0.0006) [2023-12-26 01:04:54,847][123090] Updated weights for policy 1, policy_version 186917 (0.0007) [2023-12-26 01:04:54,920][123090] Updated weights for policy 1, policy_version 186927 (0.0008) [2023-12-26 01:04:54,984][123090] Updated weights for policy 1, policy_version 186937 (0.0008) [2023-12-26 01:04:55,543][123091] Updated weights for policy 0, policy_version 187684 (0.0006) [2023-12-26 01:04:55,610][123091] Updated weights for policy 0, policy_version 187694 (0.0006) [2023-12-26 01:04:55,677][123091] Updated weights for policy 0, policy_version 187704 (0.0007) [2023-12-26 01:04:55,824][123090] Updated weights for policy 1, policy_version 186947 (0.0009) [2023-12-26 01:04:55,891][123090] Updated weights for policy 1, policy_version 186957 (0.0009) [2023-12-26 01:04:55,956][123090] Updated weights for policy 1, policy_version 186967 (0.0009) [2023-12-26 01:04:56,462][123091] Updated weights for policy 0, policy_version 187714 (0.0008) [2023-12-26 01:04:56,521][123091] Updated weights for policy 0, policy_version 187724 (0.0010) [2023-12-26 01:04:56,568][123091] Updated weights for policy 0, policy_version 187734 (0.0010) [2023-12-26 01:04:56,619][123091] Updated weights for policy 0, policy_version 187744 (0.0011) [2023-12-26 01:04:56,630][123090] Updated weights for policy 1, policy_version 186977 (0.0008) [2023-12-26 01:04:56,677][123090] Updated weights for policy 1, policy_version 186987 (0.0005) [2023-12-26 01:04:56,723][123090] Updated weights for policy 1, policy_version 186997 (0.0008) [2023-12-26 01:04:56,774][123090] Updated weights for policy 1, policy_version 187007 (0.0010) [2023-12-26 01:04:57,383][123091] Updated weights for policy 0, policy_version 187754 (0.0005) [2023-12-26 01:04:57,442][123091] Updated weights for policy 0, policy_version 187764 (0.0006) [2023-12-26 01:04:57,501][123091] Updated weights for policy 0, policy_version 187774 (0.0005) [2023-12-26 01:04:57,686][123090] Updated weights for policy 1, policy_version 187017 (0.0010) [2023-12-26 01:04:57,747][123090] Updated weights for policy 1, policy_version 187027 (0.0009) [2023-12-26 01:04:57,799][123090] Updated weights for policy 1, policy_version 187037 (0.0009) [2023-12-26 01:04:58,244][123091] Updated weights for policy 0, policy_version 187784 (0.0010) [2023-12-26 01:04:58,310][123091] Updated weights for policy 0, policy_version 187794 (0.0011) [2023-12-26 01:04:58,392][123091] Updated weights for policy 0, policy_version 187804 (0.0013) [2023-12-26 01:04:58,693][123090] Updated weights for policy 1, policy_version 187047 (0.0010) [2023-12-26 01:04:58,749][123090] Updated weights for policy 1, policy_version 187057 (0.0010) [2023-12-26 01:04:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 95961088. Throughput: 0: 9042.2, 1: 8712.3. Samples: 95958324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:04:58,785][121949] Avg episode reward: [(0, '5765.163'), (1, '5159.800')] [2023-12-26 01:04:58,810][123090] Updated weights for policy 1, policy_version 187067 (0.0009) [2023-12-26 01:04:59,145][123091] Updated weights for policy 0, policy_version 187814 (0.0007) [2023-12-26 01:04:59,204][123091] Updated weights for policy 0, policy_version 187824 (0.0006) [2023-12-26 01:04:59,266][123091] Updated weights for policy 0, policy_version 187834 (0.0010) [2023-12-26 01:04:59,664][123090] Updated weights for policy 1, policy_version 187077 (0.0008) [2023-12-26 01:04:59,730][123090] Updated weights for policy 1, policy_version 187087 (0.0005) [2023-12-26 01:04:59,805][123090] Updated weights for policy 1, policy_version 187097 (0.0006) [2023-12-26 01:05:00,075][123091] Updated weights for policy 0, policy_version 187844 (0.0008) [2023-12-26 01:05:00,138][123091] Updated weights for policy 0, policy_version 187854 (0.0009) [2023-12-26 01:05:00,201][123091] Updated weights for policy 0, policy_version 187864 (0.0009) [2023-12-26 01:05:00,521][123090] Updated weights for policy 1, policy_version 187107 (0.0009) [2023-12-26 01:05:00,579][123090] Updated weights for policy 1, policy_version 187117 (0.0010) [2023-12-26 01:05:00,638][123090] Updated weights for policy 1, policy_version 187127 (0.0010) [2023-12-26 01:05:01,003][123091] Updated weights for policy 0, policy_version 187874 (0.0009) [2023-12-26 01:05:01,071][123091] Updated weights for policy 0, policy_version 187884 (0.0008) [2023-12-26 01:05:01,141][123091] Updated weights for policy 0, policy_version 187894 (0.0009) [2023-12-26 01:05:01,203][123091] Updated weights for policy 0, policy_version 187904 (0.0009) [2023-12-26 01:05:01,462][123090] Updated weights for policy 1, policy_version 187137 (0.0010) [2023-12-26 01:05:01,517][123090] Updated weights for policy 1, policy_version 187147 (0.0010) [2023-12-26 01:05:01,575][123090] Updated weights for policy 1, policy_version 187157 (0.0010) [2023-12-26 01:05:01,646][123090] Updated weights for policy 1, policy_version 187167 (0.0007) [2023-12-26 01:05:02,068][123091] Updated weights for policy 0, policy_version 187914 (0.0006) [2023-12-26 01:05:02,136][123091] Updated weights for policy 0, policy_version 187924 (0.0007) [2023-12-26 01:05:02,205][123091] Updated weights for policy 0, policy_version 187934 (0.0009) [2023-12-26 01:05:02,425][123090] Updated weights for policy 1, policy_version 187177 (0.0006) [2023-12-26 01:05:02,487][123090] Updated weights for policy 1, policy_version 187187 (0.0005) [2023-12-26 01:05:02,554][123090] Updated weights for policy 1, policy_version 187197 (0.0006) [2023-12-26 01:05:03,028][123091] Updated weights for policy 0, policy_version 187944 (0.0010) [2023-12-26 01:05:03,083][123091] Updated weights for policy 0, policy_version 187954 (0.0010) [2023-12-26 01:05:03,134][123091] Updated weights for policy 0, policy_version 187964 (0.0010) [2023-12-26 01:05:03,191][123090] Updated weights for policy 1, policy_version 187207 (0.0005) [2023-12-26 01:05:03,252][123090] Updated weights for policy 1, policy_version 187217 (0.0005) [2023-12-26 01:05:03,310][123090] Updated weights for policy 1, policy_version 187227 (0.0008) [2023-12-26 01:05:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 96051200. Throughput: 0: 8946.9, 1: 8801.3. Samples: 96065448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:03,785][121949] Avg episode reward: [(0, '5594.790'), (1, '5272.007')] [2023-12-26 01:05:03,885][123091] Updated weights for policy 0, policy_version 187974 (0.0010) [2023-12-26 01:05:03,948][123091] Updated weights for policy 0, policy_version 187984 (0.0011) [2023-12-26 01:05:03,965][123090] Updated weights for policy 1, policy_version 187237 (0.0008) [2023-12-26 01:05:04,005][123091] Updated weights for policy 0, policy_version 187994 (0.0010) [2023-12-26 01:05:04,025][123090] Updated weights for policy 1, policy_version 187247 (0.0010) [2023-12-26 01:05:04,084][123090] Updated weights for policy 1, policy_version 187257 (0.0010) [2023-12-26 01:05:04,783][123091] Updated weights for policy 0, policy_version 188004 (0.0011) [2023-12-26 01:05:04,841][123091] Updated weights for policy 0, policy_version 188014 (0.0010) [2023-12-26 01:05:04,852][123090] Updated weights for policy 1, policy_version 187267 (0.0011) [2023-12-26 01:05:04,889][123091] Updated weights for policy 0, policy_version 188024 (0.0010) [2023-12-26 01:05:04,903][123090] Updated weights for policy 1, policy_version 187277 (0.0010) [2023-12-26 01:05:04,950][123090] Updated weights for policy 1, policy_version 187287 (0.0010) [2023-12-26 01:05:05,724][123090] Updated weights for policy 1, policy_version 187297 (0.0009) [2023-12-26 01:05:05,726][123091] Updated weights for policy 0, policy_version 188034 (0.0010) [2023-12-26 01:05:05,777][123091] Updated weights for policy 0, policy_version 188044 (0.0010) [2023-12-26 01:05:05,786][123090] Updated weights for policy 1, policy_version 187307 (0.0005) [2023-12-26 01:05:05,840][123091] Updated weights for policy 0, policy_version 188054 (0.0011) [2023-12-26 01:05:05,844][123090] Updated weights for policy 1, policy_version 187317 (0.0006) [2023-12-26 01:05:05,900][123090] Updated weights for policy 1, policy_version 187327 (0.0006) [2023-12-26 01:05:05,908][123091] Updated weights for policy 0, policy_version 188064 (0.0010) [2023-12-26 01:05:06,599][123090] Updated weights for policy 1, policy_version 187337 (0.0006) [2023-12-26 01:05:06,669][123090] Updated weights for policy 1, policy_version 187347 (0.0006) [2023-12-26 01:05:06,724][123090] Updated weights for policy 1, policy_version 187357 (0.0009) [2023-12-26 01:05:06,731][123091] Updated weights for policy 0, policy_version 188074 (0.0007) [2023-12-26 01:05:06,798][123091] Updated weights for policy 0, policy_version 188084 (0.0008) [2023-12-26 01:05:06,853][123091] Updated weights for policy 0, policy_version 188094 (0.0010) [2023-12-26 01:05:07,405][123090] Updated weights for policy 1, policy_version 187367 (0.0007) [2023-12-26 01:05:07,463][123090] Updated weights for policy 1, policy_version 187377 (0.0005) [2023-12-26 01:05:07,520][123090] Updated weights for policy 1, policy_version 187387 (0.0005) [2023-12-26 01:05:07,720][123091] Updated weights for policy 0, policy_version 188104 (0.0011) [2023-12-26 01:05:07,771][123091] Updated weights for policy 0, policy_version 188114 (0.0010) [2023-12-26 01:05:07,826][123091] Updated weights for policy 0, policy_version 188124 (0.0010) [2023-12-26 01:05:08,214][123090] Updated weights for policy 1, policy_version 187397 (0.0008) [2023-12-26 01:05:08,283][123090] Updated weights for policy 1, policy_version 187407 (0.0010) [2023-12-26 01:05:08,358][123090] Updated weights for policy 1, policy_version 187417 (0.0008) [2023-12-26 01:05:08,677][123091] Updated weights for policy 0, policy_version 188134 (0.0011) [2023-12-26 01:05:08,732][123091] Updated weights for policy 0, policy_version 188144 (0.0010) [2023-12-26 01:05:08,779][123091] Updated weights for policy 0, policy_version 188154 (0.0010) [2023-12-26 01:05:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 96141312. Throughput: 0: 8982.2, 1: 8862.5. Samples: 96120568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:08,785][121949] Avg episode reward: [(0, '5445.708'), (1, '5213.854')] [2023-12-26 01:05:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000187424_47980544.pth... [2023-12-26 01:05:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000186368_47710208.pth [2023-12-26 01:05:08,809][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000188160_48168960.pth... [2023-12-26 01:05:08,812][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000187104_47898624.pth [2023-12-26 01:05:09,103][123090] Updated weights for policy 1, policy_version 187427 (0.0009) [2023-12-26 01:05:09,164][123090] Updated weights for policy 1, policy_version 187437 (0.0007) [2023-12-26 01:05:09,222][123090] Updated weights for policy 1, policy_version 187447 (0.0008) [2023-12-26 01:05:09,643][123091] Updated weights for policy 0, policy_version 188164 (0.0010) [2023-12-26 01:05:09,705][123091] Updated weights for policy 0, policy_version 188174 (0.0009) [2023-12-26 01:05:09,777][123091] Updated weights for policy 0, policy_version 188184 (0.0009) [2023-12-26 01:05:10,095][123090] Updated weights for policy 1, policy_version 187457 (0.0007) [2023-12-26 01:05:10,160][123090] Updated weights for policy 1, policy_version 187467 (0.0009) [2023-12-26 01:05:10,228][123090] Updated weights for policy 1, policy_version 187477 (0.0010) [2023-12-26 01:05:10,288][123090] Updated weights for policy 1, policy_version 187487 (0.0009) [2023-12-26 01:05:10,644][123091] Updated weights for policy 0, policy_version 188194 (0.0009) [2023-12-26 01:05:10,720][123091] Updated weights for policy 0, policy_version 188204 (0.0009) [2023-12-26 01:05:10,794][123091] Updated weights for policy 0, policy_version 188214 (0.0010) [2023-12-26 01:05:10,855][123091] Updated weights for policy 0, policy_version 188224 (0.0009) [2023-12-26 01:05:11,012][123090] Updated weights for policy 1, policy_version 187497 (0.0010) [2023-12-26 01:05:11,082][123090] Updated weights for policy 1, policy_version 187507 (0.0010) [2023-12-26 01:05:11,142][123090] Updated weights for policy 1, policy_version 187517 (0.0010) [2023-12-26 01:05:11,718][123091] Updated weights for policy 0, policy_version 188234 (0.0007) [2023-12-26 01:05:11,794][123091] Updated weights for policy 0, policy_version 188244 (0.0009) [2023-12-26 01:05:11,858][123091] Updated weights for policy 0, policy_version 188254 (0.0009) [2023-12-26 01:05:12,000][123090] Updated weights for policy 1, policy_version 187527 (0.0010) [2023-12-26 01:05:12,068][123090] Updated weights for policy 1, policy_version 187537 (0.0010) [2023-12-26 01:05:12,140][123090] Updated weights for policy 1, policy_version 187547 (0.0010) [2023-12-26 01:05:12,714][123091] Updated weights for policy 0, policy_version 188264 (0.0006) [2023-12-26 01:05:12,781][123091] Updated weights for policy 0, policy_version 188274 (0.0005) [2023-12-26 01:05:12,845][123091] Updated weights for policy 0, policy_version 188284 (0.0005) [2023-12-26 01:05:12,964][123090] Updated weights for policy 1, policy_version 187557 (0.0009) [2023-12-26 01:05:13,025][123090] Updated weights for policy 1, policy_version 187567 (0.0009) [2023-12-26 01:05:13,080][123090] Updated weights for policy 1, policy_version 187577 (0.0009) [2023-12-26 01:05:13,539][123091] Updated weights for policy 0, policy_version 188294 (0.0006) [2023-12-26 01:05:13,603][123091] Updated weights for policy 0, policy_version 188304 (0.0005) [2023-12-26 01:05:13,672][123091] Updated weights for policy 0, policy_version 188314 (0.0008) [2023-12-26 01:05:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 96231424. Throughput: 0: 8882.7, 1: 8855.2. Samples: 96223840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:13,784][121949] Avg episode reward: [(0, '5633.914'), (1, '5200.885')] [2023-12-26 01:05:13,882][123090] Updated weights for policy 1, policy_version 187587 (0.0009) [2023-12-26 01:05:13,931][123090] Updated weights for policy 1, policy_version 187597 (0.0009) [2023-12-26 01:05:13,983][123090] Updated weights for policy 1, policy_version 187607 (0.0008) [2023-12-26 01:05:14,435][123091] Updated weights for policy 0, policy_version 188324 (0.0009) [2023-12-26 01:05:14,500][123091] Updated weights for policy 0, policy_version 188334 (0.0010) [2023-12-26 01:05:14,565][123091] Updated weights for policy 0, policy_version 188344 (0.0009) [2023-12-26 01:05:14,837][123090] Updated weights for policy 1, policy_version 187617 (0.0009) [2023-12-26 01:05:14,936][123090] Updated weights for policy 1, policy_version 187627 (0.0009) [2023-12-26 01:05:14,996][123090] Updated weights for policy 1, policy_version 187637 (0.0008) [2023-12-26 01:05:15,049][123090] Updated weights for policy 1, policy_version 187647 (0.0009) [2023-12-26 01:05:15,383][123091] Updated weights for policy 0, policy_version 188354 (0.0010) [2023-12-26 01:05:15,446][123091] Updated weights for policy 0, policy_version 188364 (0.0011) [2023-12-26 01:05:15,517][123091] Updated weights for policy 0, policy_version 188374 (0.0010) [2023-12-26 01:05:15,576][123091] Updated weights for policy 0, policy_version 188384 (0.0011) [2023-12-26 01:05:15,877][123090] Updated weights for policy 1, policy_version 187657 (0.0009) [2023-12-26 01:05:15,933][123090] Updated weights for policy 1, policy_version 187667 (0.0008) [2023-12-26 01:05:15,996][123090] Updated weights for policy 1, policy_version 187677 (0.0009) [2023-12-26 01:05:16,344][123091] Updated weights for policy 0, policy_version 188394 (0.0005) [2023-12-26 01:05:16,387][123091] Updated weights for policy 0, policy_version 188404 (0.0005) [2023-12-26 01:05:16,445][123091] Updated weights for policy 0, policy_version 188414 (0.0007) [2023-12-26 01:05:16,868][123090] Updated weights for policy 1, policy_version 187687 (0.0009) [2023-12-26 01:05:16,929][123090] Updated weights for policy 1, policy_version 187698 (0.0010) [2023-12-26 01:05:16,986][123090] Updated weights for policy 1, policy_version 187708 (0.0010) [2023-12-26 01:05:17,175][123091] Updated weights for policy 0, policy_version 188424 (0.0006) [2023-12-26 01:05:17,223][123091] Updated weights for policy 0, policy_version 188434 (0.0005) [2023-12-26 01:05:17,282][123091] Updated weights for policy 0, policy_version 188444 (0.0005) [2023-12-26 01:05:17,900][123090] Updated weights for policy 1, policy_version 187718 (0.0010) [2023-12-26 01:05:17,968][123090] Updated weights for policy 1, policy_version 187728 (0.0009) [2023-12-26 01:05:18,010][123091] Updated weights for policy 0, policy_version 188454 (0.0008) [2023-12-26 01:05:18,029][123090] Updated weights for policy 1, policy_version 187738 (0.0007) [2023-12-26 01:05:18,076][123091] Updated weights for policy 0, policy_version 188464 (0.0010) [2023-12-26 01:05:18,130][123091] Updated weights for policy 0, policy_version 188474 (0.0010) [2023-12-26 01:05:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 96313344. Throughput: 0: 8835.0, 1: 8807.9. Samples: 96329108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:18,785][121949] Avg episode reward: [(0, '5668.721'), (1, '5335.446')] [2023-12-26 01:05:18,820][123090] Updated weights for policy 1, policy_version 187748 (0.0007) [2023-12-26 01:05:18,886][123090] Updated weights for policy 1, policy_version 187758 (0.0008) [2023-12-26 01:05:18,892][123091] Updated weights for policy 0, policy_version 188484 (0.0010) [2023-12-26 01:05:18,951][123091] Updated weights for policy 0, policy_version 188494 (0.0007) [2023-12-26 01:05:18,957][123090] Updated weights for policy 1, policy_version 187768 (0.0008) [2023-12-26 01:05:19,008][123091] Updated weights for policy 0, policy_version 188504 (0.0005) [2023-12-26 01:05:19,698][123091] Updated weights for policy 0, policy_version 188514 (0.0006) [2023-12-26 01:05:19,759][123091] Updated weights for policy 0, policy_version 188524 (0.0010) [2023-12-26 01:05:19,821][123090] Updated weights for policy 1, policy_version 187778 (0.0008) [2023-12-26 01:05:19,828][123091] Updated weights for policy 0, policy_version 188534 (0.0009) [2023-12-26 01:05:19,891][123091] Updated weights for policy 0, policy_version 188544 (0.0009) [2023-12-26 01:05:19,893][123090] Updated weights for policy 1, policy_version 187788 (0.0009) [2023-12-26 01:05:19,954][123090] Updated weights for policy 1, policy_version 187798 (0.0009) [2023-12-26 01:05:20,011][123090] Updated weights for policy 1, policy_version 187808 (0.0009) [2023-12-26 01:05:20,736][123091] Updated weights for policy 0, policy_version 188554 (0.0011) [2023-12-26 01:05:20,800][123091] Updated weights for policy 0, policy_version 188564 (0.0011) [2023-12-26 01:05:20,869][123091] Updated weights for policy 0, policy_version 188574 (0.0011) [2023-12-26 01:05:20,871][123090] Updated weights for policy 1, policy_version 187818 (0.0006) [2023-12-26 01:05:20,943][123090] Updated weights for policy 1, policy_version 187828 (0.0006) [2023-12-26 01:05:21,013][123090] Updated weights for policy 1, policy_version 187838 (0.0006) [2023-12-26 01:05:21,745][123091] Updated weights for policy 0, policy_version 188584 (0.0009) [2023-12-26 01:05:21,787][123090] Updated weights for policy 1, policy_version 187848 (0.0008) [2023-12-26 01:05:21,811][123091] Updated weights for policy 0, policy_version 188594 (0.0008) [2023-12-26 01:05:21,842][123090] Updated weights for policy 1, policy_version 187858 (0.0008) [2023-12-26 01:05:21,875][123091] Updated weights for policy 0, policy_version 188604 (0.0006) [2023-12-26 01:05:21,896][123090] Updated weights for policy 1, policy_version 187868 (0.0008) [2023-12-26 01:05:22,666][123091] Updated weights for policy 0, policy_version 188614 (0.0008) [2023-12-26 01:05:22,737][123091] Updated weights for policy 0, policy_version 188624 (0.0010) [2023-12-26 01:05:22,775][123090] Updated weights for policy 1, policy_version 187878 (0.0008) [2023-12-26 01:05:22,803][123091] Updated weights for policy 0, policy_version 188634 (0.0009) [2023-12-26 01:05:22,843][123090] Updated weights for policy 1, policy_version 187888 (0.0009) [2023-12-26 01:05:22,907][123090] Updated weights for policy 1, policy_version 187898 (0.0009) [2023-12-26 01:05:23,557][123091] Updated weights for policy 0, policy_version 188644 (0.0007) [2023-12-26 01:05:23,618][123091] Updated weights for policy 0, policy_version 188654 (0.0006) [2023-12-26 01:05:23,630][123090] Updated weights for policy 1, policy_version 187908 (0.0008) [2023-12-26 01:05:23,682][123090] Updated weights for policy 1, policy_version 187918 (0.0005) [2023-12-26 01:05:23,683][123091] Updated weights for policy 0, policy_version 188664 (0.0005) [2023-12-26 01:05:23,735][123090] Updated weights for policy 1, policy_version 187928 (0.0005) [2023-12-26 01:05:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17522.6). Total num frames: 96403456. Throughput: 0: 8794.4, 1: 8829.9. Samples: 96381284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:23,785][121949] Avg episode reward: [(0, '5690.244'), (1, '5259.659')] [2023-12-26 01:05:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000188672_48300032.pth... [2023-12-26 01:05:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000187616_48029696.pth [2023-12-26 01:05:23,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000187936_48111616.pth... [2023-12-26 01:05:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000186880_47841280.pth [2023-12-26 01:05:24,418][123090] Updated weights for policy 1, policy_version 187938 (0.0005) [2023-12-26 01:05:24,464][123091] Updated weights for policy 0, policy_version 188674 (0.0006) [2023-12-26 01:05:24,481][123090] Updated weights for policy 1, policy_version 187948 (0.0006) [2023-12-26 01:05:24,524][123091] Updated weights for policy 0, policy_version 188684 (0.0008) [2023-12-26 01:05:24,535][123090] Updated weights for policy 1, policy_version 187958 (0.0006) [2023-12-26 01:05:24,589][123090] Updated weights for policy 1, policy_version 187968 (0.0006) [2023-12-26 01:05:24,592][123091] Updated weights for policy 0, policy_version 188694 (0.0009) [2023-12-26 01:05:24,647][123091] Updated weights for policy 0, policy_version 188704 (0.0010) [2023-12-26 01:05:25,292][123090] Updated weights for policy 1, policy_version 187978 (0.0009) [2023-12-26 01:05:25,346][123090] Updated weights for policy 1, policy_version 187988 (0.0007) [2023-12-26 01:05:25,407][123090] Updated weights for policy 1, policy_version 187998 (0.0008) [2023-12-26 01:05:25,501][123091] Updated weights for policy 0, policy_version 188714 (0.0011) [2023-12-26 01:05:25,561][123091] Updated weights for policy 0, policy_version 188724 (0.0011) [2023-12-26 01:05:25,616][123091] Updated weights for policy 0, policy_version 188734 (0.0011) [2023-12-26 01:05:26,200][123090] Updated weights for policy 1, policy_version 188008 (0.0006) [2023-12-26 01:05:26,253][123090] Updated weights for policy 1, policy_version 188018 (0.0009) [2023-12-26 01:05:26,308][123090] Updated weights for policy 1, policy_version 188028 (0.0009) [2023-12-26 01:05:26,366][123091] Updated weights for policy 0, policy_version 188744 (0.0011) [2023-12-26 01:05:26,436][123091] Updated weights for policy 0, policy_version 188754 (0.0011) [2023-12-26 01:05:26,495][123091] Updated weights for policy 0, policy_version 188764 (0.0011) [2023-12-26 01:05:27,096][123090] Updated weights for policy 1, policy_version 188038 (0.0006) [2023-12-26 01:05:27,161][123090] Updated weights for policy 1, policy_version 188048 (0.0009) [2023-12-26 01:05:27,213][123090] Updated weights for policy 1, policy_version 188058 (0.0009) [2023-12-26 01:05:27,317][123091] Updated weights for policy 0, policy_version 188774 (0.0011) [2023-12-26 01:05:27,379][123091] Updated weights for policy 0, policy_version 188784 (0.0010) [2023-12-26 01:05:27,446][123091] Updated weights for policy 0, policy_version 188794 (0.0010) [2023-12-26 01:05:27,946][123090] Updated weights for policy 1, policy_version 188068 (0.0007) [2023-12-26 01:05:28,017][123090] Updated weights for policy 1, policy_version 188078 (0.0008) [2023-12-26 01:05:28,071][123090] Updated weights for policy 1, policy_version 188090 (0.0010) [2023-12-26 01:05:28,175][123091] Updated weights for policy 0, policy_version 188804 (0.0008) [2023-12-26 01:05:28,220][123091] Updated weights for policy 0, policy_version 188814 (0.0005) [2023-12-26 01:05:28,266][123091] Updated weights for policy 0, policy_version 188824 (0.0005) [2023-12-26 01:05:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 96493568. Throughput: 0: 8868.9, 1: 8870.7. Samples: 96488668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:28,785][121949] Avg episode reward: [(0, '5798.258'), (1, '5313.216')] [2023-12-26 01:05:28,887][123090] Updated weights for policy 1, policy_version 188100 (0.0009) [2023-12-26 01:05:28,946][123090] Updated weights for policy 1, policy_version 188110 (0.0008) [2023-12-26 01:05:29,005][123090] Updated weights for policy 1, policy_version 188120 (0.0008) [2023-12-26 01:05:29,074][123091] Updated weights for policy 0, policy_version 188834 (0.0010) [2023-12-26 01:05:29,128][123091] Updated weights for policy 0, policy_version 188844 (0.0010) [2023-12-26 01:05:29,175][123091] Updated weights for policy 0, policy_version 188854 (0.0010) [2023-12-26 01:05:29,246][123091] Updated weights for policy 0, policy_version 188864 (0.0009) [2023-12-26 01:05:29,807][123090] Updated weights for policy 1, policy_version 188130 (0.0008) [2023-12-26 01:05:29,875][123090] Updated weights for policy 1, policy_version 188140 (0.0009) [2023-12-26 01:05:29,938][123090] Updated weights for policy 1, policy_version 188150 (0.0009) [2023-12-26 01:05:30,001][123090] Updated weights for policy 1, policy_version 188160 (0.0009) [2023-12-26 01:05:30,056][123091] Updated weights for policy 0, policy_version 188874 (0.0011) [2023-12-26 01:05:30,116][123091] Updated weights for policy 0, policy_version 188884 (0.0011) [2023-12-26 01:05:30,165][123091] Updated weights for policy 0, policy_version 188894 (0.0010) [2023-12-26 01:05:30,686][123090] Updated weights for policy 1, policy_version 188170 (0.0010) [2023-12-26 01:05:30,736][123090] Updated weights for policy 1, policy_version 188180 (0.0010) [2023-12-26 01:05:30,792][123090] Updated weights for policy 1, policy_version 188190 (0.0008) [2023-12-26 01:05:31,028][123091] Updated weights for policy 0, policy_version 188904 (0.0007) [2023-12-26 01:05:31,085][123091] Updated weights for policy 0, policy_version 188914 (0.0008) [2023-12-26 01:05:31,150][123091] Updated weights for policy 0, policy_version 188924 (0.0008) [2023-12-26 01:05:31,648][123090] Updated weights for policy 1, policy_version 188200 (0.0008) [2023-12-26 01:05:31,699][123090] Updated weights for policy 1, policy_version 188210 (0.0008) [2023-12-26 01:05:31,766][123090] Updated weights for policy 1, policy_version 188220 (0.0010) [2023-12-26 01:05:31,939][123091] Updated weights for policy 0, policy_version 188934 (0.0009) [2023-12-26 01:05:31,990][123091] Updated weights for policy 0, policy_version 188944 (0.0010) [2023-12-26 01:05:32,041][123091] Updated weights for policy 0, policy_version 188954 (0.0010) [2023-12-26 01:05:32,670][123090] Updated weights for policy 1, policy_version 188230 (0.0008) [2023-12-26 01:05:32,731][123090] Updated weights for policy 1, policy_version 188240 (0.0008) [2023-12-26 01:05:32,789][123091] Updated weights for policy 0, policy_version 188964 (0.0010) [2023-12-26 01:05:32,792][123090] Updated weights for policy 1, policy_version 188250 (0.0008) [2023-12-26 01:05:32,843][123091] Updated weights for policy 0, policy_version 188974 (0.0011) [2023-12-26 01:05:32,891][123091] Updated weights for policy 0, policy_version 188984 (0.0011) [2023-12-26 01:05:33,507][123090] Updated weights for policy 1, policy_version 188260 (0.0008) [2023-12-26 01:05:33,564][123091] Updated weights for policy 0, policy_version 188994 (0.0010) [2023-12-26 01:05:33,571][123090] Updated weights for policy 1, policy_version 188270 (0.0008) [2023-12-26 01:05:33,626][123091] Updated weights for policy 0, policy_version 189004 (0.0006) [2023-12-26 01:05:33,633][123090] Updated weights for policy 1, policy_version 188280 (0.0009) [2023-12-26 01:05:33,671][123091] Updated weights for policy 0, policy_version 189014 (0.0005) [2023-12-26 01:05:33,718][123091] Updated weights for policy 0, policy_version 189024 (0.0005) [2023-12-26 01:05:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 96591872. Throughput: 0: 8856.4, 1: 8870.8. Samples: 96597404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:33,785][121949] Avg episode reward: [(0, '5721.107'), (1, '5421.652')] [2023-12-26 01:05:34,300][123090] Updated weights for policy 1, policy_version 188290 (0.0008) [2023-12-26 01:05:34,348][123090] Updated weights for policy 1, policy_version 188300 (0.0009) [2023-12-26 01:05:34,414][123090] Updated weights for policy 1, policy_version 188310 (0.0009) [2023-12-26 01:05:34,424][123091] Updated weights for policy 0, policy_version 189034 (0.0006) [2023-12-26 01:05:34,485][123091] Updated weights for policy 0, policy_version 189044 (0.0007) [2023-12-26 01:05:34,544][123091] Updated weights for policy 0, policy_version 189054 (0.0006) [2023-12-26 01:05:35,176][123091] Updated weights for policy 0, policy_version 189064 (0.0005) [2023-12-26 01:05:35,231][123091] Updated weights for policy 0, policy_version 189074 (0.0005) [2023-12-26 01:05:35,278][123091] Updated weights for policy 0, policy_version 189084 (0.0008) [2023-12-26 01:05:35,352][123090] Updated weights for policy 1, policy_version 188321 (0.0010) [2023-12-26 01:05:35,404][123090] Updated weights for policy 1, policy_version 188331 (0.0008) [2023-12-26 01:05:35,452][123090] Updated weights for policy 1, policy_version 188341 (0.0009) [2023-12-26 01:05:35,508][123090] Updated weights for policy 1, policy_version 188351 (0.0008) [2023-12-26 01:05:36,078][123091] Updated weights for policy 0, policy_version 189094 (0.0010) [2023-12-26 01:05:36,132][123091] Updated weights for policy 0, policy_version 189104 (0.0009) [2023-12-26 01:05:36,179][123091] Updated weights for policy 0, policy_version 189114 (0.0010) [2023-12-26 01:05:36,353][123090] Updated weights for policy 1, policy_version 188361 (0.0009) [2023-12-26 01:05:36,410][123090] Updated weights for policy 1, policy_version 188371 (0.0009) [2023-12-26 01:05:36,467][123090] Updated weights for policy 1, policy_version 188381 (0.0009) [2023-12-26 01:05:37,052][123091] Updated weights for policy 0, policy_version 189124 (0.0011) [2023-12-26 01:05:37,118][123091] Updated weights for policy 0, policy_version 189134 (0.0011) [2023-12-26 01:05:37,188][123091] Updated weights for policy 0, policy_version 189144 (0.0011) [2023-12-26 01:05:37,274][123090] Updated weights for policy 1, policy_version 188391 (0.0009) [2023-12-26 01:05:37,327][123090] Updated weights for policy 1, policy_version 188401 (0.0009) [2023-12-26 01:05:37,383][123090] Updated weights for policy 1, policy_version 188411 (0.0009) [2023-12-26 01:05:37,988][123091] Updated weights for policy 0, policy_version 189154 (0.0011) [2023-12-26 01:05:38,052][123091] Updated weights for policy 0, policy_version 189164 (0.0011) [2023-12-26 01:05:38,109][123091] Updated weights for policy 0, policy_version 189174 (0.0011) [2023-12-26 01:05:38,144][123090] Updated weights for policy 1, policy_version 188421 (0.0010) [2023-12-26 01:05:38,169][123091] Updated weights for policy 0, policy_version 189184 (0.0011) [2023-12-26 01:05:38,210][123090] Updated weights for policy 1, policy_version 188431 (0.0010) [2023-12-26 01:05:38,275][123090] Updated weights for policy 1, policy_version 188441 (0.0009) [2023-12-26 01:05:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 96673792. Throughput: 0: 8916.9, 1: 8860.6. Samples: 96651640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:38,785][121949] Avg episode reward: [(0, '5649.538'), (1, '5367.143')] [2023-12-26 01:05:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000189184_48431104.pth... [2023-12-26 01:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000188448_48242688.pth... [2023-12-26 01:05:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000188160_48168960.pth [2023-12-26 01:05:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000187424_47980544.pth [2023-12-26 01:05:39,002][123091] Updated weights for policy 0, policy_version 189194 (0.0010) [2023-12-26 01:05:39,049][123091] Updated weights for policy 0, policy_version 189204 (0.0010) [2023-12-26 01:05:39,087][123090] Updated weights for policy 1, policy_version 188451 (0.0009) [2023-12-26 01:05:39,115][123091] Updated weights for policy 0, policy_version 189214 (0.0011) [2023-12-26 01:05:39,150][123090] Updated weights for policy 1, policy_version 188461 (0.0005) [2023-12-26 01:05:39,220][123090] Updated weights for policy 1, policy_version 188471 (0.0006) [2023-12-26 01:05:39,985][123091] Updated weights for policy 0, policy_version 189224 (0.0010) [2023-12-26 01:05:40,015][123090] Updated weights for policy 1, policy_version 188481 (0.0008) [2023-12-26 01:05:40,048][123091] Updated weights for policy 0, policy_version 189234 (0.0009) [2023-12-26 01:05:40,084][123090] Updated weights for policy 1, policy_version 188491 (0.0009) [2023-12-26 01:05:40,113][123091] Updated weights for policy 0, policy_version 189244 (0.0007) [2023-12-26 01:05:40,148][123090] Updated weights for policy 1, policy_version 188501 (0.0009) [2023-12-26 01:05:40,211][123090] Updated weights for policy 1, policy_version 188511 (0.0010) [2023-12-26 01:05:40,897][123091] Updated weights for policy 0, policy_version 189254 (0.0009) [2023-12-26 01:05:40,950][123091] Updated weights for policy 0, policy_version 189264 (0.0010) [2023-12-26 01:05:41,007][123091] Updated weights for policy 0, policy_version 189274 (0.0009) [2023-12-26 01:05:41,081][123090] Updated weights for policy 1, policy_version 188521 (0.0008) [2023-12-26 01:05:41,162][123090] Updated weights for policy 1, policy_version 188531 (0.0010) [2023-12-26 01:05:41,229][123090] Updated weights for policy 1, policy_version 188541 (0.0010) [2023-12-26 01:05:41,918][123091] Updated weights for policy 0, policy_version 189284 (0.0009) [2023-12-26 01:05:41,968][123091] Updated weights for policy 0, policy_version 189294 (0.0008) [2023-12-26 01:05:42,020][123091] Updated weights for policy 0, policy_version 189304 (0.0009) [2023-12-26 01:05:42,074][123090] Updated weights for policy 1, policy_version 188551 (0.0010) [2023-12-26 01:05:42,142][123090] Updated weights for policy 1, policy_version 188561 (0.0011) [2023-12-26 01:05:42,205][123090] Updated weights for policy 1, policy_version 188571 (0.0011) [2023-12-26 01:05:42,888][123091] Updated weights for policy 0, policy_version 189314 (0.0008) [2023-12-26 01:05:42,944][123091] Updated weights for policy 0, policy_version 189324 (0.0008) [2023-12-26 01:05:42,997][123091] Updated weights for policy 0, policy_version 189334 (0.0009) [2023-12-26 01:05:43,021][123090] Updated weights for policy 1, policy_version 188581 (0.0011) [2023-12-26 01:05:43,046][123091] Updated weights for policy 0, policy_version 189344 (0.0008) [2023-12-26 01:05:43,076][123090] Updated weights for policy 1, policy_version 188591 (0.0010) [2023-12-26 01:05:43,143][123090] Updated weights for policy 1, policy_version 188601 (0.0011) [2023-12-26 01:05:43,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 96755712. Throughput: 0: 8822.3, 1: 8852.5. Samples: 96753688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:43,784][121949] Avg episode reward: [(0, '5792.328'), (1, '5292.907')] [2023-12-26 01:05:43,816][123091] Updated weights for policy 0, policy_version 189354 (0.0010) [2023-12-26 01:05:43,877][123091] Updated weights for policy 0, policy_version 189364 (0.0009) [2023-12-26 01:05:43,878][123090] Updated weights for policy 1, policy_version 188611 (0.0010) [2023-12-26 01:05:43,937][123091] Updated weights for policy 0, policy_version 189374 (0.0007) [2023-12-26 01:05:43,938][123090] Updated weights for policy 1, policy_version 188621 (0.0011) [2023-12-26 01:05:44,006][123090] Updated weights for policy 1, policy_version 188631 (0.0011) [2023-12-26 01:05:44,800][123090] Updated weights for policy 1, policy_version 188641 (0.0010) [2023-12-26 01:05:44,811][123091] Updated weights for policy 0, policy_version 189384 (0.0008) [2023-12-26 01:05:44,858][123090] Updated weights for policy 1, policy_version 188651 (0.0006) [2023-12-26 01:05:44,881][123091] Updated weights for policy 0, policy_version 189394 (0.0008) [2023-12-26 01:05:44,917][123090] Updated weights for policy 1, policy_version 188661 (0.0008) [2023-12-26 01:05:44,942][123091] Updated weights for policy 0, policy_version 189404 (0.0007) [2023-12-26 01:05:44,969][123090] Updated weights for policy 1, policy_version 188671 (0.0009) [2023-12-26 01:05:45,674][123090] Updated weights for policy 1, policy_version 188681 (0.0006) [2023-12-26 01:05:45,737][123090] Updated weights for policy 1, policy_version 188691 (0.0005) [2023-12-26 01:05:45,811][123090] Updated weights for policy 1, policy_version 188701 (0.0006) [2023-12-26 01:05:45,841][123091] Updated weights for policy 0, policy_version 189414 (0.0009) [2023-12-26 01:05:45,899][123091] Updated weights for policy 0, policy_version 189424 (0.0009) [2023-12-26 01:05:45,960][123091] Updated weights for policy 0, policy_version 189434 (0.0010) [2023-12-26 01:05:46,441][123090] Updated weights for policy 1, policy_version 188711 (0.0007) [2023-12-26 01:05:46,506][123090] Updated weights for policy 1, policy_version 188721 (0.0005) [2023-12-26 01:05:46,570][123090] Updated weights for policy 1, policy_version 188731 (0.0005) [2023-12-26 01:05:46,845][123091] Updated weights for policy 0, policy_version 189444 (0.0010) [2023-12-26 01:05:46,908][123091] Updated weights for policy 0, policy_version 189454 (0.0009) [2023-12-26 01:05:46,959][123091] Updated weights for policy 0, policy_version 189464 (0.0008) [2023-12-26 01:05:47,334][123090] Updated weights for policy 1, policy_version 188741 (0.0007) [2023-12-26 01:05:47,395][123090] Updated weights for policy 1, policy_version 188751 (0.0009) [2023-12-26 01:05:47,444][123090] Updated weights for policy 1, policy_version 188761 (0.0009) [2023-12-26 01:05:47,796][123091] Updated weights for policy 0, policy_version 189474 (0.0010) [2023-12-26 01:05:47,849][123091] Updated weights for policy 0, policy_version 189484 (0.0009) [2023-12-26 01:05:47,901][123091] Updated weights for policy 0, policy_version 189495 (0.0010) [2023-12-26 01:05:48,195][123090] Updated weights for policy 1, policy_version 188771 (0.0008) [2023-12-26 01:05:48,250][123090] Updated weights for policy 1, policy_version 188781 (0.0005) [2023-12-26 01:05:48,311][123090] Updated weights for policy 1, policy_version 188791 (0.0005) [2023-12-26 01:05:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 96845824. Throughput: 0: 8760.7, 1: 8903.9. Samples: 96860356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:48,784][121949] Avg episode reward: [(0, '5827.902'), (1, '5259.589')] [2023-12-26 01:05:48,786][123091] Updated weights for policy 0, policy_version 189505 (0.0009) [2023-12-26 01:05:48,842][123091] Updated weights for policy 0, policy_version 189515 (0.0010) [2023-12-26 01:05:48,900][123091] Updated weights for policy 0, policy_version 189525 (0.0010) [2023-12-26 01:05:48,955][123091] Updated weights for policy 0, policy_version 189535 (0.0010) [2023-12-26 01:05:49,065][123090] Updated weights for policy 1, policy_version 188801 (0.0008) [2023-12-26 01:05:49,131][123090] Updated weights for policy 1, policy_version 188811 (0.0008) [2023-12-26 01:05:49,197][123090] Updated weights for policy 1, policy_version 188821 (0.0007) [2023-12-26 01:05:49,262][123090] Updated weights for policy 1, policy_version 188831 (0.0009) [2023-12-26 01:05:49,769][123091] Updated weights for policy 0, policy_version 189545 (0.0009) [2023-12-26 01:05:49,824][123091] Updated weights for policy 0, policy_version 189555 (0.0009) [2023-12-26 01:05:49,895][123091] Updated weights for policy 0, policy_version 189565 (0.0010) [2023-12-26 01:05:49,989][123090] Updated weights for policy 1, policy_version 188841 (0.0009) [2023-12-26 01:05:50,053][123090] Updated weights for policy 1, policy_version 188851 (0.0010) [2023-12-26 01:05:50,117][123090] Updated weights for policy 1, policy_version 188861 (0.0009) [2023-12-26 01:05:50,734][123091] Updated weights for policy 0, policy_version 189575 (0.0010) [2023-12-26 01:05:50,796][123091] Updated weights for policy 0, policy_version 189585 (0.0009) [2023-12-26 01:05:50,863][123091] Updated weights for policy 0, policy_version 189595 (0.0010) [2023-12-26 01:05:50,953][123090] Updated weights for policy 1, policy_version 188871 (0.0009) [2023-12-26 01:05:51,004][123090] Updated weights for policy 1, policy_version 188881 (0.0010) [2023-12-26 01:05:51,070][123090] Updated weights for policy 1, policy_version 188891 (0.0010) [2023-12-26 01:05:51,694][123091] Updated weights for policy 0, policy_version 189605 (0.0009) [2023-12-26 01:05:51,766][123091] Updated weights for policy 0, policy_version 189615 (0.0009) [2023-12-26 01:05:51,820][123091] Updated weights for policy 0, policy_version 189625 (0.0010) [2023-12-26 01:05:51,895][123090] Updated weights for policy 1, policy_version 188901 (0.0009) [2023-12-26 01:05:51,950][123090] Updated weights for policy 1, policy_version 188911 (0.0010) [2023-12-26 01:05:52,013][123090] Updated weights for policy 1, policy_version 188921 (0.0010) [2023-12-26 01:05:52,646][123091] Updated weights for policy 0, policy_version 189635 (0.0008) [2023-12-26 01:05:52,722][123091] Updated weights for policy 0, policy_version 189645 (0.0006) [2023-12-26 01:05:52,785][123091] Updated weights for policy 0, policy_version 189655 (0.0009) [2023-12-26 01:05:52,807][123090] Updated weights for policy 1, policy_version 188931 (0.0009) [2023-12-26 01:05:52,876][123090] Updated weights for policy 1, policy_version 188942 (0.0009) [2023-12-26 01:05:52,942][123090] Updated weights for policy 1, policy_version 188952 (0.0010) [2023-12-26 01:05:53,576][123091] Updated weights for policy 0, policy_version 189665 (0.0010) [2023-12-26 01:05:53,627][123091] Updated weights for policy 0, policy_version 189675 (0.0009) [2023-12-26 01:05:53,676][123091] Updated weights for policy 0, policy_version 189685 (0.0009) [2023-12-26 01:05:53,729][123091] Updated weights for policy 0, policy_version 189696 (0.0010) [2023-12-26 01:05:53,754][123090] Updated weights for policy 1, policy_version 188962 (0.0009) [2023-12-26 01:05:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 96935936. Throughput: 0: 8737.8, 1: 8850.2. Samples: 96912028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:53,785][121949] Avg episode reward: [(0, '5881.062'), (1, '5196.331')] [2023-12-26 01:05:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000189696_48562176.pth... [2023-12-26 01:05:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000188672_48300032.pth [2023-12-26 01:05:53,800][123007] Saving new best policy, reward=5881.062! [2023-12-26 01:05:53,810][123090] Updated weights for policy 1, policy_version 188972 (0.0010) [2023-12-26 01:05:53,868][123090] Updated weights for policy 1, policy_version 188982 (0.0010) [2023-12-26 01:05:53,918][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000188992_48381952.pth... [2023-12-26 01:05:53,920][123090] Updated weights for policy 1, policy_version 188992 (0.0009) [2023-12-26 01:05:53,921][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000187936_48111616.pth [2023-12-26 01:05:54,630][123090] Updated weights for policy 1, policy_version 189002 (0.0009) [2023-12-26 01:05:54,657][123091] Updated weights for policy 0, policy_version 189706 (0.0009) [2023-12-26 01:05:54,696][123090] Updated weights for policy 1, policy_version 189012 (0.0009) [2023-12-26 01:05:54,708][123091] Updated weights for policy 0, policy_version 189716 (0.0007) [2023-12-26 01:05:54,758][123090] Updated weights for policy 1, policy_version 189022 (0.0009) [2023-12-26 01:05:54,760][123091] Updated weights for policy 0, policy_version 189726 (0.0009) [2023-12-26 01:05:55,577][123090] Updated weights for policy 1, policy_version 189032 (0.0009) [2023-12-26 01:05:55,594][123091] Updated weights for policy 0, policy_version 189736 (0.0009) [2023-12-26 01:05:55,640][123090] Updated weights for policy 1, policy_version 189042 (0.0008) [2023-12-26 01:05:55,651][123091] Updated weights for policy 0, policy_version 189746 (0.0008) [2023-12-26 01:05:55,704][123090] Updated weights for policy 1, policy_version 189052 (0.0009) [2023-12-26 01:05:55,707][123091] Updated weights for policy 0, policy_version 189756 (0.0007) [2023-12-26 01:05:56,520][123090] Updated weights for policy 1, policy_version 189062 (0.0010) [2023-12-26 01:05:56,578][123091] Updated weights for policy 0, policy_version 189766 (0.0007) [2023-12-26 01:05:56,584][123090] Updated weights for policy 1, policy_version 189072 (0.0010) [2023-12-26 01:05:56,639][123091] Updated weights for policy 0, policy_version 189776 (0.0008) [2023-12-26 01:05:56,646][123090] Updated weights for policy 1, policy_version 189082 (0.0006) [2023-12-26 01:05:56,702][123091] Updated weights for policy 0, policy_version 189786 (0.0008) [2023-12-26 01:05:57,403][123090] Updated weights for policy 1, policy_version 189092 (0.0009) [2023-12-26 01:05:57,462][123090] Updated weights for policy 1, policy_version 189102 (0.0010) [2023-12-26 01:05:57,525][123090] Updated weights for policy 1, policy_version 189112 (0.0010) [2023-12-26 01:05:57,546][123091] Updated weights for policy 0, policy_version 189796 (0.0009) [2023-12-26 01:05:57,606][123091] Updated weights for policy 0, policy_version 189806 (0.0006) [2023-12-26 01:05:57,662][123091] Updated weights for policy 0, policy_version 189817 (0.0010) [2023-12-26 01:05:58,297][123090] Updated weights for policy 1, policy_version 189122 (0.0008) [2023-12-26 01:05:58,368][123090] Updated weights for policy 1, policy_version 189132 (0.0008) [2023-12-26 01:05:58,441][123090] Updated weights for policy 1, policy_version 189142 (0.0009) [2023-12-26 01:05:58,512][123090] Updated weights for policy 1, policy_version 189152 (0.0010) [2023-12-26 01:05:58,563][123091] Updated weights for policy 0, policy_version 189828 (0.0009) [2023-12-26 01:05:58,631][123091] Updated weights for policy 0, policy_version 189838 (0.0009) [2023-12-26 01:05:58,699][123091] Updated weights for policy 0, policy_version 189848 (0.0009) [2023-12-26 01:05:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 97026048. Throughput: 0: 8766.8, 1: 8833.7. Samples: 97015864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:05:58,785][121949] Avg episode reward: [(0, '5904.716'), (1, '5080.927')] [2023-12-26 01:05:58,785][123007] Saving new best policy, reward=5904.716! [2023-12-26 01:05:59,341][123090] Updated weights for policy 1, policy_version 189162 (0.0009) [2023-12-26 01:05:59,408][123090] Updated weights for policy 1, policy_version 189172 (0.0010) [2023-12-26 01:05:59,475][123090] Updated weights for policy 1, policy_version 189182 (0.0009) [2023-12-26 01:05:59,513][123091] Updated weights for policy 0, policy_version 189858 (0.0010) [2023-12-26 01:05:59,574][123091] Updated weights for policy 0, policy_version 189868 (0.0009) [2023-12-26 01:05:59,632][123091] Updated weights for policy 0, policy_version 189878 (0.0009) [2023-12-26 01:05:59,700][123091] Updated weights for policy 0, policy_version 189888 (0.0009) [2023-12-26 01:06:00,268][123090] Updated weights for policy 1, policy_version 189192 (0.0010) [2023-12-26 01:06:00,334][123090] Updated weights for policy 1, policy_version 189202 (0.0005) [2023-12-26 01:06:00,396][123090] Updated weights for policy 1, policy_version 189212 (0.0007) [2023-12-26 01:06:00,582][123091] Updated weights for policy 0, policy_version 189898 (0.0008) [2023-12-26 01:06:00,637][123091] Updated weights for policy 0, policy_version 189908 (0.0009) [2023-12-26 01:06:00,685][123091] Updated weights for policy 0, policy_version 189918 (0.0009) [2023-12-26 01:06:01,159][123090] Updated weights for policy 1, policy_version 189222 (0.0009) [2023-12-26 01:06:01,227][123090] Updated weights for policy 1, policy_version 189232 (0.0008) [2023-12-26 01:06:01,291][123090] Updated weights for policy 1, policy_version 189242 (0.0009) [2023-12-26 01:06:01,467][123091] Updated weights for policy 0, policy_version 189928 (0.0009) [2023-12-26 01:06:01,517][123091] Updated weights for policy 0, policy_version 189938 (0.0009) [2023-12-26 01:06:01,582][123091] Updated weights for policy 0, policy_version 189948 (0.0009) [2023-12-26 01:06:02,025][123090] Updated weights for policy 1, policy_version 189252 (0.0008) [2023-12-26 01:06:02,091][123090] Updated weights for policy 1, policy_version 189262 (0.0006) [2023-12-26 01:06:02,154][123090] Updated weights for policy 1, policy_version 189272 (0.0005) [2023-12-26 01:06:02,462][123091] Updated weights for policy 0, policy_version 189958 (0.0009) [2023-12-26 01:06:02,517][123091] Updated weights for policy 0, policy_version 189968 (0.0009) [2023-12-26 01:06:02,571][123091] Updated weights for policy 0, policy_version 189978 (0.0009) [2023-12-26 01:06:02,877][123090] Updated weights for policy 1, policy_version 189282 (0.0007) [2023-12-26 01:06:02,928][123090] Updated weights for policy 1, policy_version 189292 (0.0010) [2023-12-26 01:06:02,975][123090] Updated weights for policy 1, policy_version 189302 (0.0008) [2023-12-26 01:06:03,023][123090] Updated weights for policy 1, policy_version 189312 (0.0009) [2023-12-26 01:06:03,430][123091] Updated weights for policy 0, policy_version 189988 (0.0009) [2023-12-26 01:06:03,487][123091] Updated weights for policy 0, policy_version 189998 (0.0010) [2023-12-26 01:06:03,536][123091] Updated weights for policy 0, policy_version 190008 (0.0009) [2023-12-26 01:06:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 97107968. Throughput: 0: 8643.5, 1: 8934.6. Samples: 97120120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:06:03,785][121949] Avg episode reward: [(0, '5858.994'), (1, '5206.067')] [2023-12-26 01:06:03,854][123090] Updated weights for policy 1, policy_version 189322 (0.0007) [2023-12-26 01:06:03,920][123090] Updated weights for policy 1, policy_version 189332 (0.0009) [2023-12-26 01:06:03,983][123090] Updated weights for policy 1, policy_version 189342 (0.0010) [2023-12-26 01:06:04,373][123091] Updated weights for policy 0, policy_version 190018 (0.0009) [2023-12-26 01:06:04,433][123091] Updated weights for policy 0, policy_version 190028 (0.0010) [2023-12-26 01:06:04,486][123091] Updated weights for policy 0, policy_version 190038 (0.0010) [2023-12-26 01:06:04,550][123091] Updated weights for policy 0, policy_version 190048 (0.0009) [2023-12-26 01:06:04,808][123090] Updated weights for policy 1, policy_version 189352 (0.0008) [2023-12-26 01:06:04,871][123090] Updated weights for policy 1, policy_version 189362 (0.0010) [2023-12-26 01:06:04,933][123090] Updated weights for policy 1, policy_version 189372 (0.0009) [2023-12-26 01:06:05,246][123091] Updated weights for policy 0, policy_version 190058 (0.0005) [2023-12-26 01:06:05,303][123091] Updated weights for policy 0, policy_version 190068 (0.0005) [2023-12-26 01:06:05,355][123091] Updated weights for policy 0, policy_version 190078 (0.0005) [2023-12-26 01:06:05,641][123090] Updated weights for policy 1, policy_version 189382 (0.0010) [2023-12-26 01:06:05,695][123090] Updated weights for policy 1, policy_version 189392 (0.0010) [2023-12-26 01:06:05,756][123090] Updated weights for policy 1, policy_version 189402 (0.0010) [2023-12-26 01:06:06,013][123091] Updated weights for policy 0, policy_version 190088 (0.0005) [2023-12-26 01:06:06,065][123091] Updated weights for policy 0, policy_version 190098 (0.0005) [2023-12-26 01:06:06,130][123091] Updated weights for policy 0, policy_version 190108 (0.0008) [2023-12-26 01:06:06,523][123090] Updated weights for policy 1, policy_version 189412 (0.0008) [2023-12-26 01:06:06,597][123090] Updated weights for policy 1, policy_version 189422 (0.0006) [2023-12-26 01:06:06,664][123090] Updated weights for policy 1, policy_version 189432 (0.0006) [2023-12-26 01:06:06,930][123091] Updated weights for policy 0, policy_version 190118 (0.0010) [2023-12-26 01:06:06,983][123091] Updated weights for policy 0, policy_version 190128 (0.0006) [2023-12-26 01:06:07,036][123091] Updated weights for policy 0, policy_version 190138 (0.0005) [2023-12-26 01:06:07,395][123090] Updated weights for policy 1, policy_version 189442 (0.0005) [2023-12-26 01:06:07,471][123090] Updated weights for policy 1, policy_version 189452 (0.0006) [2023-12-26 01:06:07,531][123090] Updated weights for policy 1, policy_version 189462 (0.0005) [2023-12-26 01:06:07,598][123090] Updated weights for policy 1, policy_version 189472 (0.0007) [2023-12-26 01:06:07,684][123091] Updated weights for policy 0, policy_version 190148 (0.0005) [2023-12-26 01:06:07,739][123091] Updated weights for policy 0, policy_version 190158 (0.0005) [2023-12-26 01:06:07,797][123091] Updated weights for policy 0, policy_version 190168 (0.0008) [2023-12-26 01:06:08,356][123090] Updated weights for policy 1, policy_version 189482 (0.0009) [2023-12-26 01:06:08,420][123090] Updated weights for policy 1, policy_version 189492 (0.0010) [2023-12-26 01:06:08,484][123090] Updated weights for policy 1, policy_version 189502 (0.0011) [2023-12-26 01:06:08,513][123091] Updated weights for policy 0, policy_version 190178 (0.0009) [2023-12-26 01:06:08,585][123091] Updated weights for policy 0, policy_version 190188 (0.0006) [2023-12-26 01:06:08,652][123091] Updated weights for policy 0, policy_version 190198 (0.0006) [2023-12-26 01:06:08,723][123091] Updated weights for policy 0, policy_version 190208 (0.0006) [2023-12-26 01:06:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 97206272. Throughput: 0: 8702.5, 1: 8975.8. Samples: 97176808. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:08,785][121949] Avg episode reward: [(0, '5801.324'), (1, '5272.475')] [2023-12-26 01:06:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000189504_48513024.pth... [2023-12-26 01:06:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000190208_48693248.pth... [2023-12-26 01:06:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000188448_48242688.pth [2023-12-26 01:06:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000189184_48431104.pth [2023-12-26 01:06:09,282][123090] Updated weights for policy 1, policy_version 189512 (0.0011) [2023-12-26 01:06:09,344][123090] Updated weights for policy 1, policy_version 189522 (0.0009) [2023-12-26 01:06:09,415][123091] Updated weights for policy 0, policy_version 190218 (0.0011) [2023-12-26 01:06:09,421][123090] Updated weights for policy 1, policy_version 189532 (0.0008) [2023-12-26 01:06:09,484][123091] Updated weights for policy 0, policy_version 190228 (0.0010) [2023-12-26 01:06:09,545][123091] Updated weights for policy 0, policy_version 190238 (0.0011) [2023-12-26 01:06:10,216][123090] Updated weights for policy 1, policy_version 189542 (0.0008) [2023-12-26 01:06:10,285][123090] Updated weights for policy 1, policy_version 189552 (0.0008) [2023-12-26 01:06:10,349][123090] Updated weights for policy 1, policy_version 189562 (0.0010) [2023-12-26 01:06:10,400][123091] Updated weights for policy 0, policy_version 190248 (0.0008) [2023-12-26 01:06:10,462][123091] Updated weights for policy 0, policy_version 190258 (0.0009) [2023-12-26 01:06:10,527][123091] Updated weights for policy 0, policy_version 190268 (0.0009) [2023-12-26 01:06:11,161][123090] Updated weights for policy 1, policy_version 189572 (0.0011) [2023-12-26 01:06:11,230][123090] Updated weights for policy 1, policy_version 189582 (0.0011) [2023-12-26 01:06:11,297][123090] Updated weights for policy 1, policy_version 189592 (0.0009) [2023-12-26 01:06:11,357][123091] Updated weights for policy 0, policy_version 190278 (0.0009) [2023-12-26 01:06:11,428][123091] Updated weights for policy 0, policy_version 190288 (0.0007) [2023-12-26 01:06:11,496][123091] Updated weights for policy 0, policy_version 190298 (0.0006) [2023-12-26 01:06:12,130][123090] Updated weights for policy 1, policy_version 189602 (0.0010) [2023-12-26 01:06:12,185][123090] Updated weights for policy 1, policy_version 189612 (0.0005) [2023-12-26 01:06:12,244][123090] Updated weights for policy 1, policy_version 189622 (0.0006) [2023-12-26 01:06:12,295][123091] Updated weights for policy 0, policy_version 190308 (0.0007) [2023-12-26 01:06:12,321][123090] Updated weights for policy 1, policy_version 189632 (0.0006) [2023-12-26 01:06:12,359][123091] Updated weights for policy 0, policy_version 190318 (0.0007) [2023-12-26 01:06:12,426][123091] Updated weights for policy 0, policy_version 190328 (0.0007) [2023-12-26 01:06:12,987][123090] Updated weights for policy 1, policy_version 189642 (0.0006) [2023-12-26 01:06:13,041][123090] Updated weights for policy 1, policy_version 189652 (0.0005) [2023-12-26 01:06:13,088][123091] Updated weights for policy 0, policy_version 190338 (0.0006) [2023-12-26 01:06:13,099][123090] Updated weights for policy 1, policy_version 189662 (0.0005) [2023-12-26 01:06:13,150][123091] Updated weights for policy 0, policy_version 190348 (0.0011) [2023-12-26 01:06:13,209][123091] Updated weights for policy 0, policy_version 190358 (0.0010) [2023-12-26 01:06:13,272][123091] Updated weights for policy 0, policy_version 190368 (0.0011) [2023-12-26 01:06:13,748][123090] Updated weights for policy 1, policy_version 189672 (0.0005) [2023-12-26 01:06:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 97288192. Throughput: 0: 8745.3, 1: 8925.9. Samples: 97283876. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:13,785][121949] Avg episode reward: [(0, '5855.707'), (1, '5384.639')] [2023-12-26 01:06:13,824][123090] Updated weights for policy 1, policy_version 189682 (0.0005) [2023-12-26 01:06:13,882][123090] Updated weights for policy 1, policy_version 189692 (0.0005) [2023-12-26 01:06:13,947][123091] Updated weights for policy 0, policy_version 190378 (0.0006) [2023-12-26 01:06:13,993][123091] Updated weights for policy 0, policy_version 190388 (0.0006) [2023-12-26 01:06:14,050][123091] Updated weights for policy 0, policy_version 190398 (0.0005) [2023-12-26 01:06:14,597][123090] Updated weights for policy 1, policy_version 189702 (0.0008) [2023-12-26 01:06:14,653][123090] Updated weights for policy 1, policy_version 189712 (0.0010) [2023-12-26 01:06:14,720][123090] Updated weights for policy 1, policy_version 189722 (0.0011) [2023-12-26 01:06:14,747][123091] Updated weights for policy 0, policy_version 190408 (0.0006) [2023-12-26 01:06:14,826][123091] Updated weights for policy 0, policy_version 190418 (0.0010) [2023-12-26 01:06:14,886][123091] Updated weights for policy 0, policy_version 190428 (0.0011) [2023-12-26 01:06:15,499][123090] Updated weights for policy 1, policy_version 189732 (0.0010) [2023-12-26 01:06:15,566][123090] Updated weights for policy 1, policy_version 189742 (0.0011) [2023-12-26 01:06:15,637][123090] Updated weights for policy 1, policy_version 189752 (0.0010) [2023-12-26 01:06:15,662][123091] Updated weights for policy 0, policy_version 190438 (0.0009) [2023-12-26 01:06:15,726][123091] Updated weights for policy 0, policy_version 190448 (0.0009) [2023-12-26 01:06:15,784][123091] Updated weights for policy 0, policy_version 190458 (0.0008) [2023-12-26 01:06:16,336][123090] Updated weights for policy 1, policy_version 189762 (0.0009) [2023-12-26 01:06:16,400][123090] Updated weights for policy 1, policy_version 189772 (0.0005) [2023-12-26 01:06:16,475][123090] Updated weights for policy 1, policy_version 189782 (0.0006) [2023-12-26 01:06:16,498][123091] Updated weights for policy 0, policy_version 190468 (0.0005) [2023-12-26 01:06:16,537][123090] Updated weights for policy 1, policy_version 189792 (0.0010) [2023-12-26 01:06:16,554][123091] Updated weights for policy 0, policy_version 190478 (0.0006) [2023-12-26 01:06:16,598][123091] Updated weights for policy 0, policy_version 190488 (0.0005) [2023-12-26 01:06:17,205][123090] Updated weights for policy 1, policy_version 189802 (0.0010) [2023-12-26 01:06:17,265][123091] Updated weights for policy 0, policy_version 190498 (0.0005) [2023-12-26 01:06:17,271][123090] Updated weights for policy 1, policy_version 189812 (0.0010) [2023-12-26 01:06:17,319][123091] Updated weights for policy 0, policy_version 190508 (0.0005) [2023-12-26 01:06:17,334][123090] Updated weights for policy 1, policy_version 189822 (0.0010) [2023-12-26 01:06:17,373][123091] Updated weights for policy 0, policy_version 190518 (0.0005) [2023-12-26 01:06:17,445][123091] Updated weights for policy 0, policy_version 190528 (0.0006) [2023-12-26 01:06:18,084][123091] Updated weights for policy 0, policy_version 190538 (0.0006) [2023-12-26 01:06:18,131][123090] Updated weights for policy 1, policy_version 189832 (0.0007) [2023-12-26 01:06:18,141][123091] Updated weights for policy 0, policy_version 190548 (0.0009) [2023-12-26 01:06:18,179][123090] Updated weights for policy 1, policy_version 189842 (0.0005) [2023-12-26 01:06:18,198][123091] Updated weights for policy 0, policy_version 190559 (0.0009) [2023-12-26 01:06:18,228][123090] Updated weights for policy 1, policy_version 189852 (0.0006) [2023-12-26 01:06:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 97386496. Throughput: 0: 8825.9, 1: 9002.5. Samples: 97399680. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:18,785][121949] Avg episode reward: [(0, '5910.710'), (1, '5451.763')] [2023-12-26 01:06:18,786][123007] Saving new best policy, reward=5910.710! [2023-12-26 01:06:19,016][123090] Updated weights for policy 1, policy_version 189862 (0.0008) [2023-12-26 01:06:19,061][123091] Updated weights for policy 0, policy_version 190569 (0.0006) [2023-12-26 01:06:19,067][123090] Updated weights for policy 1, policy_version 189872 (0.0010) [2023-12-26 01:06:19,116][123091] Updated weights for policy 0, policy_version 190579 (0.0005) [2023-12-26 01:06:19,118][123090] Updated weights for policy 1, policy_version 189882 (0.0010) [2023-12-26 01:06:19,165][123091] Updated weights for policy 0, policy_version 190589 (0.0008) [2023-12-26 01:06:19,986][123091] Updated weights for policy 0, policy_version 190599 (0.0007) [2023-12-26 01:06:19,991][123090] Updated weights for policy 1, policy_version 189892 (0.0007) [2023-12-26 01:06:20,051][123091] Updated weights for policy 0, policy_version 190609 (0.0011) [2023-12-26 01:06:20,055][123090] Updated weights for policy 1, policy_version 189902 (0.0007) [2023-12-26 01:06:20,119][123091] Updated weights for policy 0, policy_version 190619 (0.0011) [2023-12-26 01:06:20,124][123090] Updated weights for policy 1, policy_version 189912 (0.0008) [2023-12-26 01:06:20,938][123091] Updated weights for policy 0, policy_version 190629 (0.0009) [2023-12-26 01:06:20,959][123090] Updated weights for policy 1, policy_version 189922 (0.0008) [2023-12-26 01:06:21,013][123091] Updated weights for policy 0, policy_version 190639 (0.0006) [2023-12-26 01:06:21,036][123090] Updated weights for policy 1, policy_version 189932 (0.0007) [2023-12-26 01:06:21,078][123091] Updated weights for policy 0, policy_version 190649 (0.0009) [2023-12-26 01:06:21,104][123090] Updated weights for policy 1, policy_version 189942 (0.0008) [2023-12-26 01:06:21,180][123090] Updated weights for policy 1, policy_version 189952 (0.0006) [2023-12-26 01:06:21,865][123091] Updated weights for policy 0, policy_version 190659 (0.0007) [2023-12-26 01:06:21,930][123091] Updated weights for policy 0, policy_version 190669 (0.0006) [2023-12-26 01:06:21,960][123090] Updated weights for policy 1, policy_version 189962 (0.0008) [2023-12-26 01:06:21,993][123091] Updated weights for policy 0, policy_version 190679 (0.0006) [2023-12-26 01:06:22,026][123090] Updated weights for policy 1, policy_version 189972 (0.0007) [2023-12-26 01:06:22,083][123090] Updated weights for policy 1, policy_version 189982 (0.0009) [2023-12-26 01:06:22,783][123091] Updated weights for policy 0, policy_version 190689 (0.0009) [2023-12-26 01:06:22,837][123091] Updated weights for policy 0, policy_version 190699 (0.0005) [2023-12-26 01:06:22,901][123091] Updated weights for policy 0, policy_version 190709 (0.0005) [2023-12-26 01:06:22,959][123091] Updated weights for policy 0, policy_version 190719 (0.0008) [2023-12-26 01:06:22,966][123090] Updated weights for policy 1, policy_version 189992 (0.0008) [2023-12-26 01:06:23,031][123090] Updated weights for policy 1, policy_version 190002 (0.0009) [2023-12-26 01:06:23,103][123090] Updated weights for policy 1, policy_version 190012 (0.0009) [2023-12-26 01:06:23,764][123091] Updated weights for policy 0, policy_version 190729 (0.0010) [2023-12-26 01:06:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 97468416. Throughput: 0: 8757.2, 1: 9000.3. Samples: 97450728. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:23,785][121949] Avg episode reward: [(0, '5866.052'), (1, '5463.257')] [2023-12-26 01:06:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000190016_48644096.pth... [2023-12-26 01:06:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000188992_48381952.pth [2023-12-26 01:06:23,819][123091] Updated weights for policy 0, policy_version 190739 (0.0010) [2023-12-26 01:06:23,873][123091] Updated weights for policy 0, policy_version 190749 (0.0010) [2023-12-26 01:06:23,890][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000190752_48832512.pth... [2023-12-26 01:06:23,895][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000189696_48562176.pth [2023-12-26 01:06:23,916][123090] Updated weights for policy 1, policy_version 190022 (0.0007) [2023-12-26 01:06:23,978][123090] Updated weights for policy 1, policy_version 190032 (0.0009) [2023-12-26 01:06:24,040][123090] Updated weights for policy 1, policy_version 190042 (0.0009) [2023-12-26 01:06:24,517][123091] Updated weights for policy 0, policy_version 190759 (0.0010) [2023-12-26 01:06:24,587][123091] Updated weights for policy 0, policy_version 190769 (0.0009) [2023-12-26 01:06:24,652][123091] Updated weights for policy 0, policy_version 190779 (0.0009) [2023-12-26 01:06:24,897][123090] Updated weights for policy 1, policy_version 190052 (0.0009) [2023-12-26 01:06:24,961][123090] Updated weights for policy 1, policy_version 190062 (0.0009) [2023-12-26 01:06:25,014][123090] Updated weights for policy 1, policy_version 190072 (0.0009) [2023-12-26 01:06:25,465][123091] Updated weights for policy 0, policy_version 190789 (0.0010) [2023-12-26 01:06:25,527][123091] Updated weights for policy 0, policy_version 190799 (0.0010) [2023-12-26 01:06:25,582][123091] Updated weights for policy 0, policy_version 190809 (0.0010) [2023-12-26 01:06:25,742][123090] Updated weights for policy 1, policy_version 190082 (0.0008) [2023-12-26 01:06:25,792][123090] Updated weights for policy 1, policy_version 190092 (0.0005) [2023-12-26 01:06:25,840][123090] Updated weights for policy 1, policy_version 190102 (0.0005) [2023-12-26 01:06:25,887][123090] Updated weights for policy 1, policy_version 190112 (0.0005) [2023-12-26 01:06:26,497][123091] Updated weights for policy 0, policy_version 190819 (0.0010) [2023-12-26 01:06:26,560][123091] Updated weights for policy 0, policy_version 190829 (0.0009) [2023-12-26 01:06:26,620][123091] Updated weights for policy 0, policy_version 190839 (0.0010) [2023-12-26 01:06:26,696][123090] Updated weights for policy 1, policy_version 190122 (0.0008) [2023-12-26 01:06:26,757][123090] Updated weights for policy 1, policy_version 190132 (0.0010) [2023-12-26 01:06:26,821][123090] Updated weights for policy 1, policy_version 190142 (0.0009) [2023-12-26 01:06:27,440][123091] Updated weights for policy 0, policy_version 190849 (0.0010) [2023-12-26 01:06:27,502][123091] Updated weights for policy 0, policy_version 190859 (0.0009) [2023-12-26 01:06:27,573][123091] Updated weights for policy 0, policy_version 190869 (0.0007) [2023-12-26 01:06:27,624][123090] Updated weights for policy 1, policy_version 190152 (0.0006) [2023-12-26 01:06:27,632][123091] Updated weights for policy 0, policy_version 190879 (0.0005) [2023-12-26 01:06:27,682][123090] Updated weights for policy 1, policy_version 190162 (0.0005) [2023-12-26 01:06:27,737][123090] Updated weights for policy 1, policy_version 190172 (0.0005) [2023-12-26 01:06:28,357][123091] Updated weights for policy 0, policy_version 190889 (0.0009) [2023-12-26 01:06:28,424][123091] Updated weights for policy 0, policy_version 190899 (0.0009) [2023-12-26 01:06:28,455][123090] Updated weights for policy 1, policy_version 190182 (0.0006) [2023-12-26 01:06:28,487][123091] Updated weights for policy 0, policy_version 190909 (0.0009) [2023-12-26 01:06:28,512][123090] Updated weights for policy 1, policy_version 190192 (0.0005) [2023-12-26 01:06:28,570][123090] Updated weights for policy 1, policy_version 190202 (0.0005) [2023-12-26 01:06:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 97566720. Throughput: 0: 8800.6, 1: 9012.2. Samples: 97555264. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:28,784][121949] Avg episode reward: [(0, '5857.824'), (1, '5490.678')] [2023-12-26 01:06:29,313][123091] Updated weights for policy 0, policy_version 190919 (0.0009) [2023-12-26 01:06:29,377][123091] Updated weights for policy 0, policy_version 190929 (0.0009) [2023-12-26 01:06:29,404][123090] Updated weights for policy 1, policy_version 190212 (0.0007) [2023-12-26 01:06:29,430][123091] Updated weights for policy 0, policy_version 190939 (0.0009) [2023-12-26 01:06:29,461][123090] Updated weights for policy 1, policy_version 190222 (0.0006) [2023-12-26 01:06:29,522][123090] Updated weights for policy 1, policy_version 190232 (0.0005) [2023-12-26 01:06:30,237][123090] Updated weights for policy 1, policy_version 190242 (0.0006) [2023-12-26 01:06:30,254][123091] Updated weights for policy 0, policy_version 190949 (0.0007) [2023-12-26 01:06:30,301][123090] Updated weights for policy 1, policy_version 190252 (0.0008) [2023-12-26 01:06:30,303][123091] Updated weights for policy 0, policy_version 190959 (0.0005) [2023-12-26 01:06:30,359][123090] Updated weights for policy 1, policy_version 190262 (0.0006) [2023-12-26 01:06:30,359][123091] Updated weights for policy 0, policy_version 190969 (0.0005) [2023-12-26 01:06:30,417][123090] Updated weights for policy 1, policy_version 190272 (0.0006) [2023-12-26 01:06:31,088][123091] Updated weights for policy 0, policy_version 190979 (0.0007) [2023-12-26 01:06:31,138][123090] Updated weights for policy 1, policy_version 190282 (0.0006) [2023-12-26 01:06:31,159][123091] Updated weights for policy 0, policy_version 190989 (0.0010) [2023-12-26 01:06:31,209][123090] Updated weights for policy 1, policy_version 190292 (0.0008) [2023-12-26 01:06:31,214][123091] Updated weights for policy 0, policy_version 190999 (0.0008) [2023-12-26 01:06:31,275][123090] Updated weights for policy 1, policy_version 190302 (0.0008) [2023-12-26 01:06:32,005][123091] Updated weights for policy 0, policy_version 191009 (0.0008) [2023-12-26 01:06:32,061][123091] Updated weights for policy 0, policy_version 191019 (0.0009) [2023-12-26 01:06:32,125][123090] Updated weights for policy 1, policy_version 190312 (0.0009) [2023-12-26 01:06:32,131][123091] Updated weights for policy 0, policy_version 191029 (0.0007) [2023-12-26 01:06:32,177][123090] Updated weights for policy 1, policy_version 190322 (0.0008) [2023-12-26 01:06:32,191][123091] Updated weights for policy 0, policy_version 191039 (0.0005) [2023-12-26 01:06:32,229][123090] Updated weights for policy 1, policy_version 190332 (0.0010) [2023-12-26 01:06:32,948][123091] Updated weights for policy 0, policy_version 191049 (0.0005) [2023-12-26 01:06:33,014][123091] Updated weights for policy 0, policy_version 191059 (0.0005) [2023-12-26 01:06:33,070][123091] Updated weights for policy 0, policy_version 191069 (0.0005) [2023-12-26 01:06:33,118][123090] Updated weights for policy 1, policy_version 190342 (0.0010) [2023-12-26 01:06:33,169][123090] Updated weights for policy 1, policy_version 190352 (0.0005) [2023-12-26 01:06:33,232][123090] Updated weights for policy 1, policy_version 190362 (0.0005) [2023-12-26 01:06:33,777][123091] Updated weights for policy 0, policy_version 191079 (0.0006) [2023-12-26 01:06:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 97648640. Throughput: 0: 8906.8, 1: 8956.0. Samples: 97664184. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:33,785][121949] Avg episode reward: [(0, '5853.621'), (1, '5460.904')] [2023-12-26 01:06:33,824][123091] Updated weights for policy 0, policy_version 191089 (0.0005) [2023-12-26 01:06:33,845][123090] Updated weights for policy 1, policy_version 190372 (0.0007) [2023-12-26 01:06:33,868][123091] Updated weights for policy 0, policy_version 191099 (0.0005) [2023-12-26 01:06:33,919][123090] Updated weights for policy 1, policy_version 190382 (0.0008) [2023-12-26 01:06:33,988][123090] Updated weights for policy 1, policy_version 190392 (0.0006) [2023-12-26 01:06:34,585][123091] Updated weights for policy 0, policy_version 191109 (0.0005) [2023-12-26 01:06:34,655][123091] Updated weights for policy 0, policy_version 191119 (0.0008) [2023-12-26 01:06:34,726][123091] Updated weights for policy 0, policy_version 191129 (0.0009) [2023-12-26 01:06:34,738][123090] Updated weights for policy 1, policy_version 190402 (0.0005) [2023-12-26 01:06:34,800][123090] Updated weights for policy 1, policy_version 190412 (0.0008) [2023-12-26 01:06:34,867][123090] Updated weights for policy 1, policy_version 190422 (0.0010) [2023-12-26 01:06:34,926][123090] Updated weights for policy 1, policy_version 190432 (0.0009) [2023-12-26 01:06:35,446][123091] Updated weights for policy 0, policy_version 191139 (0.0009) [2023-12-26 01:06:35,490][123091] Updated weights for policy 0, policy_version 191149 (0.0010) [2023-12-26 01:06:35,539][123091] Updated weights for policy 0, policy_version 191159 (0.0010) [2023-12-26 01:06:35,718][123090] Updated weights for policy 1, policy_version 190442 (0.0010) [2023-12-26 01:06:35,784][123090] Updated weights for policy 1, policy_version 190452 (0.0008) [2023-12-26 01:06:35,850][123090] Updated weights for policy 1, policy_version 190462 (0.0010) [2023-12-26 01:06:36,365][123091] Updated weights for policy 0, policy_version 191169 (0.0006) [2023-12-26 01:06:36,428][123091] Updated weights for policy 0, policy_version 191179 (0.0011) [2023-12-26 01:06:36,495][123091] Updated weights for policy 0, policy_version 191189 (0.0011) [2023-12-26 01:06:36,560][123091] Updated weights for policy 0, policy_version 191199 (0.0011) [2023-12-26 01:06:36,654][123090] Updated weights for policy 1, policy_version 190472 (0.0009) [2023-12-26 01:06:36,708][123090] Updated weights for policy 1, policy_version 190482 (0.0008) [2023-12-26 01:06:36,764][123090] Updated weights for policy 1, policy_version 190492 (0.0008) [2023-12-26 01:06:37,287][123091] Updated weights for policy 0, policy_version 191209 (0.0006) [2023-12-26 01:06:37,333][123091] Updated weights for policy 0, policy_version 191219 (0.0005) [2023-12-26 01:06:37,394][123091] Updated weights for policy 0, policy_version 191229 (0.0007) [2023-12-26 01:06:37,673][123090] Updated weights for policy 1, policy_version 190502 (0.0009) [2023-12-26 01:06:37,735][123090] Updated weights for policy 1, policy_version 190512 (0.0010) [2023-12-26 01:06:37,809][123090] Updated weights for policy 1, policy_version 190522 (0.0010) [2023-12-26 01:06:38,139][123091] Updated weights for policy 0, policy_version 191239 (0.0006) [2023-12-26 01:06:38,196][123091] Updated weights for policy 0, policy_version 191249 (0.0005) [2023-12-26 01:06:38,241][123091] Updated weights for policy 0, policy_version 191259 (0.0005) [2023-12-26 01:06:38,739][123090] Updated weights for policy 1, policy_version 190532 (0.0009) [2023-12-26 01:06:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 97738752. Throughput: 0: 8968.0, 1: 8977.4. Samples: 97719572. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:38,785][121949] Avg episode reward: [(0, '5876.536'), (1, '5471.913')] [2023-12-26 01:06:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000191264_48963584.pth... [2023-12-26 01:06:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000190208_48693248.pth [2023-12-26 01:06:38,795][123090] Updated weights for policy 1, policy_version 190542 (0.0010) [2023-12-26 01:06:38,853][123090] Updated weights for policy 1, policy_version 190553 (0.0009) [2023-12-26 01:06:38,887][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000190560_48783360.pth... [2023-12-26 01:06:38,890][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000189504_48513024.pth [2023-12-26 01:06:38,931][123091] Updated weights for policy 0, policy_version 191269 (0.0007) [2023-12-26 01:06:38,986][123091] Updated weights for policy 0, policy_version 191279 (0.0010) [2023-12-26 01:06:39,042][123091] Updated weights for policy 0, policy_version 191289 (0.0008) [2023-12-26 01:06:39,702][123090] Updated weights for policy 1, policy_version 190563 (0.0010) [2023-12-26 01:06:39,773][123090] Updated weights for policy 1, policy_version 190573 (0.0011) [2023-12-26 01:06:39,823][123091] Updated weights for policy 0, policy_version 191299 (0.0006) [2023-12-26 01:06:39,830][123090] Updated weights for policy 1, policy_version 190583 (0.0011) [2023-12-26 01:06:39,888][123091] Updated weights for policy 0, policy_version 191309 (0.0007) [2023-12-26 01:06:39,960][123091] Updated weights for policy 0, policy_version 191319 (0.0008) [2023-12-26 01:06:40,575][123090] Updated weights for policy 1, policy_version 190593 (0.0010) [2023-12-26 01:06:40,634][123090] Updated weights for policy 1, policy_version 190603 (0.0008) [2023-12-26 01:06:40,702][123090] Updated weights for policy 1, policy_version 190613 (0.0011) [2023-12-26 01:06:40,770][123090] Updated weights for policy 1, policy_version 190623 (0.0011) [2023-12-26 01:06:40,813][123091] Updated weights for policy 0, policy_version 191329 (0.0009) [2023-12-26 01:06:40,882][123091] Updated weights for policy 0, policy_version 191339 (0.0009) [2023-12-26 01:06:40,952][123091] Updated weights for policy 0, policy_version 191349 (0.0007) [2023-12-26 01:06:41,019][123091] Updated weights for policy 0, policy_version 191359 (0.0006) [2023-12-26 01:06:41,690][123090] Updated weights for policy 1, policy_version 190633 (0.0008) [2023-12-26 01:06:41,761][123090] Updated weights for policy 1, policy_version 190643 (0.0007) [2023-12-26 01:06:41,806][123091] Updated weights for policy 0, policy_version 191369 (0.0010) [2023-12-26 01:06:41,827][123090] Updated weights for policy 1, policy_version 190653 (0.0007) [2023-12-26 01:06:41,877][123091] Updated weights for policy 0, policy_version 191379 (0.0011) [2023-12-26 01:06:41,947][123091] Updated weights for policy 0, policy_version 191389 (0.0011) [2023-12-26 01:06:42,586][123090] Updated weights for policy 1, policy_version 190663 (0.0007) [2023-12-26 01:06:42,641][123090] Updated weights for policy 1, policy_version 190673 (0.0005) [2023-12-26 01:06:42,709][123090] Updated weights for policy 1, policy_version 190684 (0.0006) [2023-12-26 01:06:42,726][123091] Updated weights for policy 0, policy_version 191399 (0.0011) [2023-12-26 01:06:42,774][123091] Updated weights for policy 0, policy_version 191409 (0.0011) [2023-12-26 01:06:42,822][123091] Updated weights for policy 0, policy_version 191419 (0.0010) [2023-12-26 01:06:43,382][123090] Updated weights for policy 1, policy_version 190694 (0.0005) [2023-12-26 01:06:43,442][123090] Updated weights for policy 1, policy_version 190704 (0.0006) [2023-12-26 01:06:43,503][123090] Updated weights for policy 1, policy_version 190714 (0.0010) [2023-12-26 01:06:43,680][123091] Updated weights for policy 0, policy_version 191429 (0.0010) [2023-12-26 01:06:43,734][123091] Updated weights for policy 0, policy_version 191439 (0.0010) [2023-12-26 01:06:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 97828864. Throughput: 0: 9066.5, 1: 8901.0. Samples: 97824400. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:43,784][121949] Avg episode reward: [(0, '5934.572'), (1, '5506.069')] [2023-12-26 01:06:43,789][123091] Updated weights for policy 0, policy_version 191449 (0.0010) [2023-12-26 01:06:43,823][123007] Saving new best policy, reward=5934.572! [2023-12-26 01:06:44,188][123090] Updated weights for policy 1, policy_version 190724 (0.0008) [2023-12-26 01:06:44,244][123090] Updated weights for policy 1, policy_version 190734 (0.0009) [2023-12-26 01:06:44,310][123090] Updated weights for policy 1, policy_version 190744 (0.0010) [2023-12-26 01:06:44,626][123091] Updated weights for policy 0, policy_version 191459 (0.0010) [2023-12-26 01:06:44,680][123091] Updated weights for policy 0, policy_version 191469 (0.0008) [2023-12-26 01:06:44,725][123091] Updated weights for policy 0, policy_version 191479 (0.0005) [2023-12-26 01:06:45,098][123090] Updated weights for policy 1, policy_version 190754 (0.0010) [2023-12-26 01:06:45,166][123090] Updated weights for policy 1, policy_version 190764 (0.0011) [2023-12-26 01:06:45,233][123090] Updated weights for policy 1, policy_version 190774 (0.0010) [2023-12-26 01:06:45,309][123090] Updated weights for policy 1, policy_version 190784 (0.0009) [2023-12-26 01:06:45,512][123091] Updated weights for policy 0, policy_version 191489 (0.0007) [2023-12-26 01:06:45,575][123091] Updated weights for policy 0, policy_version 191499 (0.0011) [2023-12-26 01:06:45,635][123091] Updated weights for policy 0, policy_version 191509 (0.0011) [2023-12-26 01:06:45,693][123091] Updated weights for policy 0, policy_version 191519 (0.0010) [2023-12-26 01:06:46,090][123090] Updated weights for policy 1, policy_version 190794 (0.0005) [2023-12-26 01:06:46,151][123090] Updated weights for policy 1, policy_version 190804 (0.0005) [2023-12-26 01:06:46,223][123090] Updated weights for policy 1, policy_version 190814 (0.0005) [2023-12-26 01:06:46,521][123091] Updated weights for policy 0, policy_version 191529 (0.0011) [2023-12-26 01:06:46,584][123091] Updated weights for policy 0, policy_version 191539 (0.0011) [2023-12-26 01:06:46,640][123091] Updated weights for policy 0, policy_version 191549 (0.0011) [2023-12-26 01:06:46,862][123090] Updated weights for policy 1, policy_version 190824 (0.0009) [2023-12-26 01:06:46,912][123090] Updated weights for policy 1, policy_version 190834 (0.0008) [2023-12-26 01:06:46,975][123090] Updated weights for policy 1, policy_version 190844 (0.0005) [2023-12-26 01:06:47,457][123091] Updated weights for policy 0, policy_version 191559 (0.0011) [2023-12-26 01:06:47,519][123091] Updated weights for policy 0, policy_version 191569 (0.0010) [2023-12-26 01:06:47,590][123091] Updated weights for policy 0, policy_version 191579 (0.0010) [2023-12-26 01:06:47,635][123090] Updated weights for policy 1, policy_version 190854 (0.0005) [2023-12-26 01:06:47,686][123090] Updated weights for policy 1, policy_version 190864 (0.0006) [2023-12-26 01:06:47,747][123090] Updated weights for policy 1, policy_version 190874 (0.0005) [2023-12-26 01:06:48,394][123091] Updated weights for policy 0, policy_version 191589 (0.0011) [2023-12-26 01:06:48,418][123090] Updated weights for policy 1, policy_version 190884 (0.0006) [2023-12-26 01:06:48,469][123091] Updated weights for policy 0, policy_version 191599 (0.0011) [2023-12-26 01:06:48,486][123090] Updated weights for policy 1, policy_version 190894 (0.0006) [2023-12-26 01:06:48,540][123091] Updated weights for policy 0, policy_version 191609 (0.0011) [2023-12-26 01:06:48,557][123090] Updated weights for policy 1, policy_version 190904 (0.0005) [2023-12-26 01:06:48,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 97927168. Throughput: 0: 9112.5, 1: 8996.5. Samples: 97935024. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:48,784][121949] Avg episode reward: [(0, '5938.717'), (1, '5443.447')] [2023-12-26 01:06:48,785][123007] Saving new best policy, reward=5938.717! [2023-12-26 01:06:49,230][123090] Updated weights for policy 1, policy_version 190914 (0.0008) [2023-12-26 01:06:49,289][123090] Updated weights for policy 1, policy_version 190924 (0.0009) [2023-12-26 01:06:49,357][123091] Updated weights for policy 0, policy_version 191619 (0.0010) [2023-12-26 01:06:49,358][123090] Updated weights for policy 1, policy_version 190934 (0.0011) [2023-12-26 01:06:49,426][123090] Updated weights for policy 1, policy_version 190944 (0.0007) [2023-12-26 01:06:49,427][123091] Updated weights for policy 0, policy_version 191629 (0.0009) [2023-12-26 01:06:49,490][123091] Updated weights for policy 0, policy_version 191639 (0.0007) [2023-12-26 01:06:50,229][123090] Updated weights for policy 1, policy_version 190954 (0.0006) [2023-12-26 01:06:50,256][123091] Updated weights for policy 0, policy_version 191649 (0.0006) [2023-12-26 01:06:50,293][123090] Updated weights for policy 1, policy_version 190964 (0.0007) [2023-12-26 01:06:50,308][123091] Updated weights for policy 0, policy_version 191659 (0.0011) [2023-12-26 01:06:50,355][123091] Updated weights for policy 0, policy_version 191669 (0.0010) [2023-12-26 01:06:50,358][123090] Updated weights for policy 1, policy_version 190974 (0.0006) [2023-12-26 01:06:50,410][123091] Updated weights for policy 0, policy_version 191679 (0.0010) [2023-12-26 01:06:51,129][123090] Updated weights for policy 1, policy_version 190984 (0.0006) [2023-12-26 01:06:51,179][123091] Updated weights for policy 0, policy_version 191689 (0.0008) [2023-12-26 01:06:51,194][123090] Updated weights for policy 1, policy_version 190994 (0.0007) [2023-12-26 01:06:51,252][123091] Updated weights for policy 0, policy_version 191699 (0.0008) [2023-12-26 01:06:51,257][123090] Updated weights for policy 1, policy_version 191004 (0.0008) [2023-12-26 01:06:51,321][123091] Updated weights for policy 0, policy_version 191709 (0.0008) [2023-12-26 01:06:52,082][123090] Updated weights for policy 1, policy_version 191014 (0.0009) [2023-12-26 01:06:52,125][123091] Updated weights for policy 0, policy_version 191719 (0.0009) [2023-12-26 01:06:52,149][123090] Updated weights for policy 1, policy_version 191024 (0.0008) [2023-12-26 01:06:52,193][123091] Updated weights for policy 0, policy_version 191729 (0.0009) [2023-12-26 01:06:52,210][123090] Updated weights for policy 1, policy_version 191034 (0.0008) [2023-12-26 01:06:52,255][123091] Updated weights for policy 0, policy_version 191739 (0.0010) [2023-12-26 01:06:52,967][123091] Updated weights for policy 0, policy_version 191749 (0.0008) [2023-12-26 01:06:53,016][123091] Updated weights for policy 0, policy_version 191759 (0.0006) [2023-12-26 01:06:53,038][123090] Updated weights for policy 1, policy_version 191044 (0.0006) [2023-12-26 01:06:53,069][123091] Updated weights for policy 0, policy_version 191769 (0.0006) [2023-12-26 01:06:53,108][123090] Updated weights for policy 1, policy_version 191054 (0.0005) [2023-12-26 01:06:53,162][123090] Updated weights for policy 1, policy_version 191064 (0.0006) [2023-12-26 01:06:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 98009088. Throughput: 0: 9059.2, 1: 8996.1. Samples: 97989300. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:53,786][123091] Updated weights for policy 0, policy_version 191779 (0.0006) [2023-12-26 01:06:53,786][121949] Avg episode reward: [(0, '5925.784'), (1, '5486.491')] [2023-12-26 01:06:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000191072_48914432.pth... [2023-12-26 01:06:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000190016_48644096.pth [2023-12-26 01:06:53,841][123091] Updated weights for policy 0, policy_version 191789 (0.0005) [2023-12-26 01:06:53,887][123091] Updated weights for policy 0, policy_version 191799 (0.0006) [2023-12-26 01:06:53,942][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000191808_49102848.pth... [2023-12-26 01:06:53,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000190752_48832512.pth [2023-12-26 01:06:53,982][123090] Updated weights for policy 1, policy_version 191074 (0.0006) [2023-12-26 01:06:54,044][123090] Updated weights for policy 1, policy_version 191084 (0.0010) [2023-12-26 01:06:54,096][123090] Updated weights for policy 1, policy_version 191094 (0.0009) [2023-12-26 01:06:54,149][123090] Updated weights for policy 1, policy_version 191104 (0.0010) [2023-12-26 01:06:54,465][123091] Updated weights for policy 0, policy_version 191809 (0.0006) [2023-12-26 01:06:54,512][123091] Updated weights for policy 0, policy_version 191819 (0.0006) [2023-12-26 01:06:54,558][123091] Updated weights for policy 0, policy_version 191829 (0.0005) [2023-12-26 01:06:54,603][123091] Updated weights for policy 0, policy_version 191839 (0.0005) [2023-12-26 01:06:55,129][123090] Updated weights for policy 1, policy_version 191114 (0.0010) [2023-12-26 01:06:55,189][123090] Updated weights for policy 1, policy_version 191124 (0.0009) [2023-12-26 01:06:55,251][123090] Updated weights for policy 1, policy_version 191134 (0.0008) [2023-12-26 01:06:55,349][123091] Updated weights for policy 0, policy_version 191849 (0.0010) [2023-12-26 01:06:55,417][123091] Updated weights for policy 0, policy_version 191859 (0.0010) [2023-12-26 01:06:55,474][123091] Updated weights for policy 0, policy_version 191869 (0.0011) [2023-12-26 01:06:56,075][123090] Updated weights for policy 1, policy_version 191144 (0.0010) [2023-12-26 01:06:56,140][123090] Updated weights for policy 1, policy_version 191154 (0.0010) [2023-12-26 01:06:56,197][123090] Updated weights for policy 1, policy_version 191164 (0.0009) [2023-12-26 01:06:56,256][123091] Updated weights for policy 0, policy_version 191879 (0.0010) [2023-12-26 01:06:56,312][123091] Updated weights for policy 0, policy_version 191889 (0.0010) [2023-12-26 01:06:56,369][123091] Updated weights for policy 0, policy_version 191899 (0.0010) [2023-12-26 01:06:56,872][123090] Updated weights for policy 1, policy_version 191174 (0.0008) [2023-12-26 01:06:56,923][123090] Updated weights for policy 1, policy_version 191184 (0.0010) [2023-12-26 01:06:56,980][123090] Updated weights for policy 1, policy_version 191194 (0.0011) [2023-12-26 01:06:57,187][123091] Updated weights for policy 0, policy_version 191910 (0.0010) [2023-12-26 01:06:57,251][123091] Updated weights for policy 0, policy_version 191920 (0.0011) [2023-12-26 01:06:57,311][123091] Updated weights for policy 0, policy_version 191930 (0.0011) [2023-12-26 01:06:57,760][123090] Updated weights for policy 1, policy_version 191204 (0.0010) [2023-12-26 01:06:57,815][123090] Updated weights for policy 1, policy_version 191214 (0.0010) [2023-12-26 01:06:57,881][123090] Updated weights for policy 1, policy_version 191224 (0.0010) [2023-12-26 01:06:58,061][123091] Updated weights for policy 0, policy_version 191940 (0.0009) [2023-12-26 01:06:58,123][123091] Updated weights for policy 0, policy_version 191950 (0.0008) [2023-12-26 01:06:58,184][123091] Updated weights for policy 0, policy_version 191960 (0.0007) [2023-12-26 01:06:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 98099200. Throughput: 0: 9118.1, 1: 8943.1. Samples: 98096628. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:06:58,785][121949] Avg episode reward: [(0, '5925.120'), (1, '5491.468')] [2023-12-26 01:06:58,827][123090] Updated weights for policy 1, policy_version 191234 (0.0010) [2023-12-26 01:06:58,895][123090] Updated weights for policy 1, policy_version 191244 (0.0011) [2023-12-26 01:06:58,954][123090] Updated weights for policy 1, policy_version 191254 (0.0010) [2023-12-26 01:06:59,017][123090] Updated weights for policy 1, policy_version 191264 (0.0010) [2023-12-26 01:06:59,050][123091] Updated weights for policy 0, policy_version 191970 (0.0008) [2023-12-26 01:06:59,116][123091] Updated weights for policy 0, policy_version 191980 (0.0010) [2023-12-26 01:06:59,181][123091] Updated weights for policy 0, policy_version 191990 (0.0009) [2023-12-26 01:06:59,248][123091] Updated weights for policy 0, policy_version 192000 (0.0009) [2023-12-26 01:06:59,749][123090] Updated weights for policy 1, policy_version 191274 (0.0009) [2023-12-26 01:06:59,804][123090] Updated weights for policy 1, policy_version 191284 (0.0010) [2023-12-26 01:06:59,876][123090] Updated weights for policy 1, policy_version 191294 (0.0011) [2023-12-26 01:07:00,147][123091] Updated weights for policy 0, policy_version 192010 (0.0009) [2023-12-26 01:07:00,212][123091] Updated weights for policy 0, policy_version 192020 (0.0009) [2023-12-26 01:07:00,286][123091] Updated weights for policy 0, policy_version 192030 (0.0009) [2023-12-26 01:07:00,675][123090] Updated weights for policy 1, policy_version 191304 (0.0006) [2023-12-26 01:07:00,723][123090] Updated weights for policy 1, policy_version 191314 (0.0005) [2023-12-26 01:07:00,767][123090] Updated weights for policy 1, policy_version 191324 (0.0005) [2023-12-26 01:07:01,041][123091] Updated weights for policy 0, policy_version 192040 (0.0007) [2023-12-26 01:07:01,108][123091] Updated weights for policy 0, policy_version 192050 (0.0007) [2023-12-26 01:07:01,176][123091] Updated weights for policy 0, policy_version 192060 (0.0008) [2023-12-26 01:07:01,514][123090] Updated weights for policy 1, policy_version 191334 (0.0005) [2023-12-26 01:07:01,583][123090] Updated weights for policy 1, policy_version 191344 (0.0006) [2023-12-26 01:07:01,644][123090] Updated weights for policy 1, policy_version 191354 (0.0009) [2023-12-26 01:07:01,900][123091] Updated weights for policy 0, policy_version 192070 (0.0008) [2023-12-26 01:07:01,954][123091] Updated weights for policy 0, policy_version 192080 (0.0010) [2023-12-26 01:07:02,013][123091] Updated weights for policy 0, policy_version 192090 (0.0009) [2023-12-26 01:07:02,334][123090] Updated weights for policy 1, policy_version 191364 (0.0009) [2023-12-26 01:07:02,394][123090] Updated weights for policy 1, policy_version 191374 (0.0010) [2023-12-26 01:07:02,442][123090] Updated weights for policy 1, policy_version 191384 (0.0010) [2023-12-26 01:07:02,876][123091] Updated weights for policy 0, policy_version 192100 (0.0010) [2023-12-26 01:07:02,932][123091] Updated weights for policy 0, policy_version 192110 (0.0009) [2023-12-26 01:07:02,988][123091] Updated weights for policy 0, policy_version 192120 (0.0009) [2023-12-26 01:07:03,268][123090] Updated weights for policy 1, policy_version 191394 (0.0010) [2023-12-26 01:07:03,322][123090] Updated weights for policy 1, policy_version 191404 (0.0010) [2023-12-26 01:07:03,376][123090] Updated weights for policy 1, policy_version 191414 (0.0010) [2023-12-26 01:07:03,419][123090] Updated weights for policy 1, policy_version 191424 (0.0010) [2023-12-26 01:07:03,769][123091] Updated weights for policy 0, policy_version 192130 (0.0009) [2023-12-26 01:07:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 98189312. Throughput: 0: 8992.3, 1: 8853.9. Samples: 98202760. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:07:03,785][121949] Avg episode reward: [(0, '5743.170'), (1, '5264.639')] [2023-12-26 01:07:03,833][123091] Updated weights for policy 0, policy_version 192140 (0.0010) [2023-12-26 01:07:03,893][123091] Updated weights for policy 0, policy_version 192150 (0.0009) [2023-12-26 01:07:03,947][123091] Updated weights for policy 0, policy_version 192160 (0.0010) [2023-12-26 01:07:04,284][123090] Updated weights for policy 1, policy_version 191434 (0.0009) [2023-12-26 01:07:04,337][123090] Updated weights for policy 1, policy_version 191444 (0.0010) [2023-12-26 01:07:04,388][123090] Updated weights for policy 1, policy_version 191454 (0.0008) [2023-12-26 01:07:04,744][123091] Updated weights for policy 0, policy_version 192170 (0.0006) [2023-12-26 01:07:04,797][123091] Updated weights for policy 0, policy_version 192180 (0.0008) [2023-12-26 01:07:04,858][123091] Updated weights for policy 0, policy_version 192190 (0.0008) [2023-12-26 01:07:05,262][123090] Updated weights for policy 1, policy_version 191464 (0.0009) [2023-12-26 01:07:05,325][123090] Updated weights for policy 1, policy_version 191474 (0.0009) [2023-12-26 01:07:05,390][123090] Updated weights for policy 1, policy_version 191484 (0.0007) [2023-12-26 01:07:05,643][123091] Updated weights for policy 0, policy_version 192200 (0.0009) [2023-12-26 01:07:05,721][123091] Updated weights for policy 0, policy_version 192211 (0.0010) [2023-12-26 01:07:05,774][123091] Updated weights for policy 0, policy_version 192221 (0.0009) [2023-12-26 01:07:06,211][123090] Updated weights for policy 1, policy_version 191494 (0.0009) [2023-12-26 01:07:06,263][123090] Updated weights for policy 1, policy_version 191504 (0.0010) [2023-12-26 01:07:06,321][123090] Updated weights for policy 1, policy_version 191514 (0.0010) [2023-12-26 01:07:06,625][123091] Updated weights for policy 0, policy_version 192231 (0.0009) [2023-12-26 01:07:06,689][123091] Updated weights for policy 0, policy_version 192241 (0.0009) [2023-12-26 01:07:06,749][123091] Updated weights for policy 0, policy_version 192251 (0.0010) [2023-12-26 01:07:07,165][123090] Updated weights for policy 1, policy_version 191524 (0.0010) [2023-12-26 01:07:07,232][123090] Updated weights for policy 1, policy_version 191534 (0.0009) [2023-12-26 01:07:07,294][123090] Updated weights for policy 1, policy_version 191544 (0.0009) [2023-12-26 01:07:07,567][123091] Updated weights for policy 0, policy_version 192261 (0.0010) [2023-12-26 01:07:07,617][123091] Updated weights for policy 0, policy_version 192271 (0.0009) [2023-12-26 01:07:07,672][123091] Updated weights for policy 0, policy_version 192281 (0.0005) [2023-12-26 01:07:08,141][123090] Updated weights for policy 1, policy_version 191554 (0.0009) [2023-12-26 01:07:08,205][123090] Updated weights for policy 1, policy_version 191564 (0.0010) [2023-12-26 01:07:08,258][123090] Updated weights for policy 1, policy_version 191574 (0.0009) [2023-12-26 01:07:08,496][123091] Updated weights for policy 0, policy_version 192291 (0.0008) [2023-12-26 01:07:08,544][123091] Updated weights for policy 0, policy_version 192301 (0.0009) [2023-12-26 01:07:08,595][123091] Updated weights for policy 0, policy_version 192311 (0.0010) [2023-12-26 01:07:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 98279424. Throughput: 0: 9001.6, 1: 8850.1. Samples: 98254056. Policy #0 lag: (min: 19.0, avg: 19.5, max: 34.0) [2023-12-26 01:07:08,785][121949] Avg episode reward: [(0, '5755.511'), (1, '5241.891')] [2023-12-26 01:07:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000191584_49045504.pth... [2023-12-26 01:07:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000192320_49233920.pth... [2023-12-26 01:07:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000190560_48783360.pth [2023-12-26 01:07:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000191264_48963584.pth [2023-12-26 01:07:09,083][123090] Updated weights for policy 1, policy_version 191585 (0.0010) [2023-12-26 01:07:09,151][123090] Updated weights for policy 1, policy_version 191595 (0.0010) [2023-12-26 01:07:09,212][123090] Updated weights for policy 1, policy_version 191605 (0.0009) [2023-12-26 01:07:09,281][123090] Updated weights for policy 1, policy_version 191615 (0.0008) [2023-12-26 01:07:09,507][123091] Updated weights for policy 0, policy_version 192321 (0.0010) [2023-12-26 01:07:09,570][123091] Updated weights for policy 0, policy_version 192331 (0.0010) [2023-12-26 01:07:09,634][123091] Updated weights for policy 0, policy_version 192341 (0.0009) [2023-12-26 01:07:09,691][123091] Updated weights for policy 0, policy_version 192351 (0.0010) [2023-12-26 01:07:10,102][123090] Updated weights for policy 1, policy_version 191625 (0.0009) [2023-12-26 01:07:10,165][123090] Updated weights for policy 1, policy_version 191635 (0.0010) [2023-12-26 01:07:10,225][123090] Updated weights for policy 1, policy_version 191645 (0.0009) [2023-12-26 01:07:10,552][123091] Updated weights for policy 0, policy_version 192361 (0.0009) [2023-12-26 01:07:10,612][123091] Updated weights for policy 0, policy_version 192371 (0.0009) [2023-12-26 01:07:10,669][123091] Updated weights for policy 0, policy_version 192381 (0.0009) [2023-12-26 01:07:11,073][123090] Updated weights for policy 1, policy_version 191655 (0.0010) [2023-12-26 01:07:11,136][123090] Updated weights for policy 1, policy_version 191665 (0.0010) [2023-12-26 01:07:11,206][123090] Updated weights for policy 1, policy_version 191675 (0.0009) [2023-12-26 01:07:11,495][123091] Updated weights for policy 0, policy_version 192391 (0.0009) [2023-12-26 01:07:11,552][123091] Updated weights for policy 0, policy_version 192401 (0.0009) [2023-12-26 01:07:11,610][123091] Updated weights for policy 0, policy_version 192411 (0.0008) [2023-12-26 01:07:12,038][123090] Updated weights for policy 1, policy_version 191685 (0.0007) [2023-12-26 01:07:12,096][123090] Updated weights for policy 1, policy_version 191695 (0.0005) [2023-12-26 01:07:12,162][123090] Updated weights for policy 1, policy_version 191705 (0.0005) [2023-12-26 01:07:12,463][123091] Updated weights for policy 0, policy_version 192421 (0.0010) [2023-12-26 01:07:12,533][123091] Updated weights for policy 0, policy_version 192431 (0.0009) [2023-12-26 01:07:12,597][123091] Updated weights for policy 0, policy_version 192441 (0.0009) [2023-12-26 01:07:12,857][123090] Updated weights for policy 1, policy_version 191715 (0.0006) [2023-12-26 01:07:12,917][123090] Updated weights for policy 1, policy_version 191725 (0.0009) [2023-12-26 01:07:12,975][123090] Updated weights for policy 1, policy_version 191735 (0.0009) [2023-12-26 01:07:13,429][123091] Updated weights for policy 0, policy_version 192451 (0.0009) [2023-12-26 01:07:13,491][123091] Updated weights for policy 0, policy_version 192461 (0.0010) [2023-12-26 01:07:13,551][123091] Updated weights for policy 0, policy_version 192471 (0.0010) [2023-12-26 01:07:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 98361344. Throughput: 0: 8943.4, 1: 8848.5. Samples: 98355900. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:13,785][121949] Avg episode reward: [(0, '5946.564'), (1, '5405.552')] [2023-12-26 01:07:13,786][123007] Saving new best policy, reward=5946.564! [2023-12-26 01:07:13,822][123090] Updated weights for policy 1, policy_version 191745 (0.0010) [2023-12-26 01:07:13,876][123090] Updated weights for policy 1, policy_version 191755 (0.0009) [2023-12-26 01:07:13,930][123090] Updated weights for policy 1, policy_version 191765 (0.0009) [2023-12-26 01:07:13,979][123090] Updated weights for policy 1, policy_version 191775 (0.0009) [2023-12-26 01:07:14,358][123091] Updated weights for policy 0, policy_version 192481 (0.0010) [2023-12-26 01:07:14,416][123091] Updated weights for policy 0, policy_version 192491 (0.0005) [2023-12-26 01:07:14,475][123091] Updated weights for policy 0, policy_version 192501 (0.0005) [2023-12-26 01:07:14,528][123091] Updated weights for policy 0, policy_version 192511 (0.0005) [2023-12-26 01:07:14,765][123090] Updated weights for policy 1, policy_version 191785 (0.0009) [2023-12-26 01:07:14,834][123090] Updated weights for policy 1, policy_version 191795 (0.0009) [2023-12-26 01:07:14,903][123090] Updated weights for policy 1, policy_version 191805 (0.0009) [2023-12-26 01:07:15,269][123091] Updated weights for policy 0, policy_version 192521 (0.0009) [2023-12-26 01:07:15,328][123091] Updated weights for policy 0, policy_version 192531 (0.0009) [2023-12-26 01:07:15,388][123091] Updated weights for policy 0, policy_version 192541 (0.0009) [2023-12-26 01:07:15,667][123090] Updated weights for policy 1, policy_version 191815 (0.0009) [2023-12-26 01:07:15,737][123090] Updated weights for policy 1, policy_version 191825 (0.0009) [2023-12-26 01:07:15,798][123090] Updated weights for policy 1, policy_version 191835 (0.0009) [2023-12-26 01:07:16,217][123091] Updated weights for policy 0, policy_version 192551 (0.0010) [2023-12-26 01:07:16,285][123091] Updated weights for policy 0, policy_version 192561 (0.0009) [2023-12-26 01:07:16,349][123091] Updated weights for policy 0, policy_version 192571 (0.0009) [2023-12-26 01:07:16,617][123090] Updated weights for policy 1, policy_version 191845 (0.0009) [2023-12-26 01:07:16,679][123090] Updated weights for policy 1, policy_version 191855 (0.0010) [2023-12-26 01:07:16,740][123090] Updated weights for policy 1, policy_version 191865 (0.0009) [2023-12-26 01:07:17,074][123091] Updated weights for policy 0, policy_version 192581 (0.0007) [2023-12-26 01:07:17,136][123091] Updated weights for policy 0, policy_version 192591 (0.0005) [2023-12-26 01:07:17,196][123091] Updated weights for policy 0, policy_version 192601 (0.0005) [2023-12-26 01:07:17,597][123090] Updated weights for policy 1, policy_version 191875 (0.0010) [2023-12-26 01:07:17,658][123090] Updated weights for policy 1, policy_version 191885 (0.0009) [2023-12-26 01:07:17,720][123090] Updated weights for policy 1, policy_version 191895 (0.0009) [2023-12-26 01:07:17,881][123091] Updated weights for policy 0, policy_version 192611 (0.0007) [2023-12-26 01:07:17,947][123091] Updated weights for policy 0, policy_version 192621 (0.0010) [2023-12-26 01:07:18,005][123091] Updated weights for policy 0, policy_version 192631 (0.0010) [2023-12-26 01:07:18,594][123090] Updated weights for policy 1, policy_version 191905 (0.0009) [2023-12-26 01:07:18,653][123090] Updated weights for policy 1, policy_version 191915 (0.0009) [2023-12-26 01:07:18,722][123090] Updated weights for policy 1, policy_version 191925 (0.0009) [2023-12-26 01:07:18,741][123091] Updated weights for policy 0, policy_version 192641 (0.0010) [2023-12-26 01:07:18,782][123090] Updated weights for policy 1, policy_version 191935 (0.0007) [2023-12-26 01:07:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 98443264. Throughput: 0: 8937.8, 1: 8796.9. Samples: 98462244. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:18,784][121949] Avg episode reward: [(0, '5906.359'), (1, '5349.742')] [2023-12-26 01:07:18,804][123091] Updated weights for policy 0, policy_version 192651 (0.0010) [2023-12-26 01:07:18,864][123091] Updated weights for policy 0, policy_version 192661 (0.0005) [2023-12-26 01:07:18,915][123091] Updated weights for policy 0, policy_version 192671 (0.0005) [2023-12-26 01:07:19,631][123090] Updated weights for policy 1, policy_version 191945 (0.0009) [2023-12-26 01:07:19,692][123090] Updated weights for policy 1, policy_version 191955 (0.0009) [2023-12-26 01:07:19,735][123091] Updated weights for policy 0, policy_version 192681 (0.0010) [2023-12-26 01:07:19,759][123090] Updated weights for policy 1, policy_version 191965 (0.0009) [2023-12-26 01:07:19,799][123091] Updated weights for policy 0, policy_version 192691 (0.0011) [2023-12-26 01:07:19,867][123091] Updated weights for policy 0, policy_version 192701 (0.0008) [2023-12-26 01:07:20,662][123091] Updated weights for policy 0, policy_version 192711 (0.0008) [2023-12-26 01:07:20,703][123090] Updated weights for policy 1, policy_version 191975 (0.0009) [2023-12-26 01:07:20,724][123091] Updated weights for policy 0, policy_version 192721 (0.0006) [2023-12-26 01:07:20,769][123090] Updated weights for policy 1, policy_version 191985 (0.0009) [2023-12-26 01:07:20,784][123091] Updated weights for policy 0, policy_version 192731 (0.0007) [2023-12-26 01:07:20,825][123090] Updated weights for policy 1, policy_version 191995 (0.0010) [2023-12-26 01:07:21,626][123091] Updated weights for policy 0, policy_version 192741 (0.0009) [2023-12-26 01:07:21,627][123090] Updated weights for policy 1, policy_version 192005 (0.0009) [2023-12-26 01:07:21,687][123091] Updated weights for policy 0, policy_version 192751 (0.0009) [2023-12-26 01:07:21,689][123090] Updated weights for policy 1, policy_version 192015 (0.0008) [2023-12-26 01:07:21,751][123091] Updated weights for policy 0, policy_version 192761 (0.0009) [2023-12-26 01:07:21,757][123090] Updated weights for policy 1, policy_version 192025 (0.0008) [2023-12-26 01:07:22,549][123091] Updated weights for policy 0, policy_version 192771 (0.0007) [2023-12-26 01:07:22,614][123090] Updated weights for policy 1, policy_version 192035 (0.0009) [2023-12-26 01:07:22,615][123091] Updated weights for policy 0, policy_version 192781 (0.0008) [2023-12-26 01:07:22,693][123090] Updated weights for policy 1, policy_version 192045 (0.0008) [2023-12-26 01:07:22,695][123091] Updated weights for policy 0, policy_version 192791 (0.0008) [2023-12-26 01:07:22,766][123090] Updated weights for policy 1, policy_version 192055 (0.0012) [2023-12-26 01:07:23,403][123091] Updated weights for policy 0, policy_version 192801 (0.0007) [2023-12-26 01:07:23,450][123091] Updated weights for policy 0, policy_version 192811 (0.0005) [2023-12-26 01:07:23,501][123091] Updated weights for policy 0, policy_version 192821 (0.0009) [2023-12-26 01:07:23,548][123091] Updated weights for policy 0, policy_version 192831 (0.0009) [2023-12-26 01:07:23,677][123090] Updated weights for policy 1, policy_version 192065 (0.0010) [2023-12-26 01:07:23,736][123090] Updated weights for policy 1, policy_version 192075 (0.0010) [2023-12-26 01:07:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 98533376. Throughput: 0: 8888.3, 1: 8741.2. Samples: 98512896. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:23,785][121949] Avg episode reward: [(0, '5864.541'), (1, '5275.085')] [2023-12-26 01:07:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000192832_49364992.pth... [2023-12-26 01:07:23,791][123090] Updated weights for policy 1, policy_version 192085 (0.0010) [2023-12-26 01:07:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000191808_49102848.pth [2023-12-26 01:07:23,857][123090] Updated weights for policy 1, policy_version 192095 (0.0009) [2023-12-26 01:07:23,864][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000192096_49176576.pth... [2023-12-26 01:07:23,870][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000191072_48914432.pth [2023-12-26 01:07:24,369][123091] Updated weights for policy 0, policy_version 192841 (0.0006) [2023-12-26 01:07:24,424][123091] Updated weights for policy 0, policy_version 192851 (0.0006) [2023-12-26 01:07:24,482][123091] Updated weights for policy 0, policy_version 192861 (0.0009) [2023-12-26 01:07:24,710][123090] Updated weights for policy 1, policy_version 192105 (0.0009) [2023-12-26 01:07:24,763][123090] Updated weights for policy 1, policy_version 192115 (0.0008) [2023-12-26 01:07:24,814][123090] Updated weights for policy 1, policy_version 192125 (0.0009) [2023-12-26 01:07:25,330][123091] Updated weights for policy 0, policy_version 192871 (0.0010) [2023-12-26 01:07:25,383][123091] Updated weights for policy 0, policy_version 192881 (0.0010) [2023-12-26 01:07:25,433][123091] Updated weights for policy 0, policy_version 192891 (0.0010) [2023-12-26 01:07:25,540][123090] Updated weights for policy 1, policy_version 192135 (0.0009) [2023-12-26 01:07:25,608][123090] Updated weights for policy 1, policy_version 192145 (0.0008) [2023-12-26 01:07:25,672][123090] Updated weights for policy 1, policy_version 192155 (0.0008) [2023-12-26 01:07:26,318][123091] Updated weights for policy 0, policy_version 192901 (0.0010) [2023-12-26 01:07:26,373][123091] Updated weights for policy 0, policy_version 192911 (0.0009) [2023-12-26 01:07:26,379][123090] Updated weights for policy 1, policy_version 192165 (0.0006) [2023-12-26 01:07:26,431][123091] Updated weights for policy 0, policy_version 192921 (0.0009) [2023-12-26 01:07:26,438][123090] Updated weights for policy 1, policy_version 192175 (0.0006) [2023-12-26 01:07:26,486][123090] Updated weights for policy 1, policy_version 192185 (0.0006) [2023-12-26 01:07:27,108][123090] Updated weights for policy 1, policy_version 192195 (0.0006) [2023-12-26 01:07:27,174][123090] Updated weights for policy 1, policy_version 192205 (0.0006) [2023-12-26 01:07:27,241][123090] Updated weights for policy 1, policy_version 192215 (0.0009) [2023-12-26 01:07:27,309][123091] Updated weights for policy 0, policy_version 192931 (0.0008) [2023-12-26 01:07:27,377][123091] Updated weights for policy 0, policy_version 192941 (0.0010) [2023-12-26 01:07:27,446][123091] Updated weights for policy 0, policy_version 192951 (0.0010) [2023-12-26 01:07:27,953][123090] Updated weights for policy 1, policy_version 192225 (0.0009) [2023-12-26 01:07:28,007][123090] Updated weights for policy 1, policy_version 192235 (0.0009) [2023-12-26 01:07:28,068][123090] Updated weights for policy 1, policy_version 192245 (0.0009) [2023-12-26 01:07:28,126][123090] Updated weights for policy 1, policy_version 192255 (0.0010) [2023-12-26 01:07:28,226][123091] Updated weights for policy 0, policy_version 192961 (0.0010) [2023-12-26 01:07:28,285][123091] Updated weights for policy 0, policy_version 192971 (0.0009) [2023-12-26 01:07:28,361][123091] Updated weights for policy 0, policy_version 192981 (0.0009) [2023-12-26 01:07:28,432][123091] Updated weights for policy 0, policy_version 192991 (0.0010) [2023-12-26 01:07:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 98623488. Throughput: 0: 8809.8, 1: 8828.3. Samples: 98618116. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:28,785][121949] Avg episode reward: [(0, '5777.716'), (1, '5176.644')] [2023-12-26 01:07:29,009][123090] Updated weights for policy 1, policy_version 192265 (0.0010) [2023-12-26 01:07:29,069][123090] Updated weights for policy 1, policy_version 192275 (0.0010) [2023-12-26 01:07:29,125][123090] Updated weights for policy 1, policy_version 192285 (0.0009) [2023-12-26 01:07:29,167][123091] Updated weights for policy 0, policy_version 193001 (0.0008) [2023-12-26 01:07:29,228][123091] Updated weights for policy 0, policy_version 193011 (0.0007) [2023-12-26 01:07:29,296][123091] Updated weights for policy 0, policy_version 193021 (0.0006) [2023-12-26 01:07:30,054][123091] Updated weights for policy 0, policy_version 193031 (0.0010) [2023-12-26 01:07:30,056][123090] Updated weights for policy 1, policy_version 192295 (0.0008) [2023-12-26 01:07:30,113][123090] Updated weights for policy 1, policy_version 192305 (0.0007) [2023-12-26 01:07:30,115][123091] Updated weights for policy 0, policy_version 193041 (0.0009) [2023-12-26 01:07:30,173][123090] Updated weights for policy 1, policy_version 192315 (0.0008) [2023-12-26 01:07:30,175][123091] Updated weights for policy 0, policy_version 193051 (0.0009) [2023-12-26 01:07:31,007][123090] Updated weights for policy 1, policy_version 192325 (0.0010) [2023-12-26 01:07:31,008][123091] Updated weights for policy 0, policy_version 193061 (0.0007) [2023-12-26 01:07:31,064][123090] Updated weights for policy 1, policy_version 192335 (0.0006) [2023-12-26 01:07:31,075][123091] Updated weights for policy 0, policy_version 193071 (0.0009) [2023-12-26 01:07:31,131][123090] Updated weights for policy 1, policy_version 192345 (0.0007) [2023-12-26 01:07:31,142][123091] Updated weights for policy 0, policy_version 193081 (0.0009) [2023-12-26 01:07:31,925][123091] Updated weights for policy 0, policy_version 193091 (0.0009) [2023-12-26 01:07:31,942][123090] Updated weights for policy 1, policy_version 192355 (0.0008) [2023-12-26 01:07:31,985][123091] Updated weights for policy 0, policy_version 193101 (0.0009) [2023-12-26 01:07:32,010][123090] Updated weights for policy 1, policy_version 192365 (0.0005) [2023-12-26 01:07:32,035][123091] Updated weights for policy 0, policy_version 193111 (0.0008) [2023-12-26 01:07:32,083][123090] Updated weights for policy 1, policy_version 192375 (0.0005) [2023-12-26 01:07:32,749][123091] Updated weights for policy 0, policy_version 193121 (0.0005) [2023-12-26 01:07:32,813][123091] Updated weights for policy 0, policy_version 193131 (0.0006) [2023-12-26 01:07:32,835][123090] Updated weights for policy 1, policy_version 192385 (0.0006) [2023-12-26 01:07:32,875][123091] Updated weights for policy 0, policy_version 193141 (0.0006) [2023-12-26 01:07:32,887][123090] Updated weights for policy 1, policy_version 192395 (0.0005) [2023-12-26 01:07:32,937][123091] Updated weights for policy 0, policy_version 193151 (0.0010) [2023-12-26 01:07:32,945][123090] Updated weights for policy 1, policy_version 192405 (0.0006) [2023-12-26 01:07:33,003][123090] Updated weights for policy 1, policy_version 192415 (0.0008) [2023-12-26 01:07:33,729][123091] Updated weights for policy 0, policy_version 193161 (0.0011) [2023-12-26 01:07:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.7). Total num frames: 98705408. Throughput: 0: 8855.6, 1: 8660.6. Samples: 98723252. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:33,784][121949] Avg episode reward: [(0, '5808.437'), (1, '5262.513')] [2023-12-26 01:07:33,794][123091] Updated weights for policy 0, policy_version 193171 (0.0011) [2023-12-26 01:07:33,798][123090] Updated weights for policy 1, policy_version 192425 (0.0008) [2023-12-26 01:07:33,852][123090] Updated weights for policy 1, policy_version 192435 (0.0008) [2023-12-26 01:07:33,856][123091] Updated weights for policy 0, policy_version 193181 (0.0010) [2023-12-26 01:07:33,905][123090] Updated weights for policy 1, policy_version 192445 (0.0008) [2023-12-26 01:07:34,635][123091] Updated weights for policy 0, policy_version 193191 (0.0009) [2023-12-26 01:07:34,686][123091] Updated weights for policy 0, policy_version 193201 (0.0006) [2023-12-26 01:07:34,737][123091] Updated weights for policy 0, policy_version 193211 (0.0010) [2023-12-26 01:07:34,766][123090] Updated weights for policy 1, policy_version 192455 (0.0007) [2023-12-26 01:07:34,815][123090] Updated weights for policy 1, policy_version 192465 (0.0008) [2023-12-26 01:07:34,876][123090] Updated weights for policy 1, policy_version 192475 (0.0005) [2023-12-26 01:07:35,552][123091] Updated weights for policy 0, policy_version 193221 (0.0011) [2023-12-26 01:07:35,601][123090] Updated weights for policy 1, policy_version 192485 (0.0005) [2023-12-26 01:07:35,614][123091] Updated weights for policy 0, policy_version 193231 (0.0011) [2023-12-26 01:07:35,656][123090] Updated weights for policy 1, policy_version 192495 (0.0007) [2023-12-26 01:07:35,669][123091] Updated weights for policy 0, policy_version 193241 (0.0010) [2023-12-26 01:07:35,725][123090] Updated weights for policy 1, policy_version 192505 (0.0010) [2023-12-26 01:07:36,517][123091] Updated weights for policy 0, policy_version 193251 (0.0009) [2023-12-26 01:07:36,533][123090] Updated weights for policy 1, policy_version 192515 (0.0008) [2023-12-26 01:07:36,583][123091] Updated weights for policy 0, policy_version 193261 (0.0011) [2023-12-26 01:07:36,594][123090] Updated weights for policy 1, policy_version 192525 (0.0007) [2023-12-26 01:07:36,648][123091] Updated weights for policy 0, policy_version 193271 (0.0011) [2023-12-26 01:07:36,658][123090] Updated weights for policy 1, policy_version 192535 (0.0007) [2023-12-26 01:07:37,441][123090] Updated weights for policy 1, policy_version 192545 (0.0007) [2023-12-26 01:07:37,453][123091] Updated weights for policy 0, policy_version 193281 (0.0011) [2023-12-26 01:07:37,499][123090] Updated weights for policy 1, policy_version 192555 (0.0006) [2023-12-26 01:07:37,505][123091] Updated weights for policy 0, policy_version 193291 (0.0011) [2023-12-26 01:07:37,552][123091] Updated weights for policy 0, policy_version 193301 (0.0010) [2023-12-26 01:07:37,560][123090] Updated weights for policy 1, policy_version 192565 (0.0006) [2023-12-26 01:07:37,608][123091] Updated weights for policy 0, policy_version 193311 (0.0011) [2023-12-26 01:07:37,620][123090] Updated weights for policy 1, policy_version 192575 (0.0006) [2023-12-26 01:07:38,465][123090] Updated weights for policy 1, policy_version 192585 (0.0009) [2023-12-26 01:07:38,471][123091] Updated weights for policy 0, policy_version 193321 (0.0008) [2023-12-26 01:07:38,527][123090] Updated weights for policy 1, policy_version 192595 (0.0008) [2023-12-26 01:07:38,539][123091] Updated weights for policy 0, policy_version 193331 (0.0008) [2023-12-26 01:07:38,579][123090] Updated weights for policy 1, policy_version 192605 (0.0008) [2023-12-26 01:07:38,604][123091] Updated weights for policy 0, policy_version 193341 (0.0008) [2023-12-26 01:07:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 98803712. Throughput: 0: 8834.8, 1: 8649.1. Samples: 98776072. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:38,786][121949] Avg episode reward: [(0, '5898.850'), (1, '5303.770')] [2023-12-26 01:07:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000193344_49496064.pth... [2023-12-26 01:07:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000192608_49307648.pth... [2023-12-26 01:07:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000191584_49045504.pth [2023-12-26 01:07:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000192320_49233920.pth [2023-12-26 01:07:39,281][123091] Updated weights for policy 0, policy_version 193351 (0.0008) [2023-12-26 01:07:39,344][123091] Updated weights for policy 0, policy_version 193361 (0.0010) [2023-12-26 01:07:39,416][123091] Updated weights for policy 0, policy_version 193371 (0.0010) [2023-12-26 01:07:39,502][123090] Updated weights for policy 1, policy_version 192615 (0.0009) [2023-12-26 01:07:39,565][123090] Updated weights for policy 1, policy_version 192625 (0.0009) [2023-12-26 01:07:39,629][123090] Updated weights for policy 1, policy_version 192635 (0.0008) [2023-12-26 01:07:40,257][123091] Updated weights for policy 0, policy_version 193381 (0.0011) [2023-12-26 01:07:40,327][123091] Updated weights for policy 0, policy_version 193391 (0.0011) [2023-12-26 01:07:40,394][123091] Updated weights for policy 0, policy_version 193401 (0.0011) [2023-12-26 01:07:40,479][123090] Updated weights for policy 1, policy_version 192645 (0.0008) [2023-12-26 01:07:40,544][123090] Updated weights for policy 1, policy_version 192655 (0.0009) [2023-12-26 01:07:40,601][123090] Updated weights for policy 1, policy_version 192665 (0.0008) [2023-12-26 01:07:41,257][123091] Updated weights for policy 0, policy_version 193411 (0.0010) [2023-12-26 01:07:41,327][123091] Updated weights for policy 0, policy_version 193421 (0.0007) [2023-12-26 01:07:41,386][123090] Updated weights for policy 1, policy_version 192675 (0.0008) [2023-12-26 01:07:41,395][123091] Updated weights for policy 0, policy_version 193431 (0.0009) [2023-12-26 01:07:41,442][123090] Updated weights for policy 1, policy_version 192685 (0.0008) [2023-12-26 01:07:41,512][123090] Updated weights for policy 1, policy_version 192695 (0.0008) [2023-12-26 01:07:42,255][123091] Updated weights for policy 0, policy_version 193441 (0.0008) [2023-12-26 01:07:42,290][123090] Updated weights for policy 1, policy_version 192705 (0.0008) [2023-12-26 01:07:42,325][123091] Updated weights for policy 0, policy_version 193451 (0.0010) [2023-12-26 01:07:42,358][123090] Updated weights for policy 1, policy_version 192715 (0.0007) [2023-12-26 01:07:42,394][123091] Updated weights for policy 0, policy_version 193461 (0.0009) [2023-12-26 01:07:42,423][123090] Updated weights for policy 1, policy_version 192725 (0.0008) [2023-12-26 01:07:42,454][123091] Updated weights for policy 0, policy_version 193471 (0.0008) [2023-12-26 01:07:42,492][123090] Updated weights for policy 1, policy_version 192735 (0.0008) [2023-12-26 01:07:43,175][123091] Updated weights for policy 0, policy_version 193481 (0.0006) [2023-12-26 01:07:43,221][123091] Updated weights for policy 0, policy_version 193491 (0.0005) [2023-12-26 01:07:43,272][123091] Updated weights for policy 0, policy_version 193501 (0.0010) [2023-12-26 01:07:43,384][123090] Updated weights for policy 1, policy_version 192745 (0.0010) [2023-12-26 01:07:43,443][123090] Updated weights for policy 1, policy_version 192755 (0.0010) [2023-12-26 01:07:43,490][123090] Updated weights for policy 1, policy_version 192765 (0.0010) [2023-12-26 01:07:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 98885632. Throughput: 0: 8712.3, 1: 8655.9. Samples: 98878196. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:43,784][121949] Avg episode reward: [(0, '5947.277'), (1, '5393.576')] [2023-12-26 01:07:43,785][123007] Saving new best policy, reward=5947.277! [2023-12-26 01:07:44,018][123091] Updated weights for policy 0, policy_version 193511 (0.0007) [2023-12-26 01:07:44,063][123091] Updated weights for policy 0, policy_version 193521 (0.0005) [2023-12-26 01:07:44,114][123091] Updated weights for policy 0, policy_version 193531 (0.0005) [2023-12-26 01:07:44,332][123090] Updated weights for policy 1, policy_version 192775 (0.0010) [2023-12-26 01:07:44,384][123090] Updated weights for policy 1, policy_version 192785 (0.0010) [2023-12-26 01:07:44,437][123090] Updated weights for policy 1, policy_version 192795 (0.0007) [2023-12-26 01:07:44,780][123091] Updated weights for policy 0, policy_version 193541 (0.0008) [2023-12-26 01:07:44,851][123091] Updated weights for policy 0, policy_version 193551 (0.0011) [2023-12-26 01:07:44,911][123091] Updated weights for policy 0, policy_version 193561 (0.0011) [2023-12-26 01:07:45,216][123090] Updated weights for policy 1, policy_version 192805 (0.0007) [2023-12-26 01:07:45,280][123090] Updated weights for policy 1, policy_version 192815 (0.0009) [2023-12-26 01:07:45,344][123090] Updated weights for policy 1, policy_version 192825 (0.0008) [2023-12-26 01:07:45,708][123091] Updated weights for policy 0, policy_version 193571 (0.0009) [2023-12-26 01:07:45,783][123091] Updated weights for policy 0, policy_version 193581 (0.0006) [2023-12-26 01:07:45,828][123091] Updated weights for policy 0, policy_version 193591 (0.0007) [2023-12-26 01:07:46,175][123090] Updated weights for policy 1, policy_version 192835 (0.0009) [2023-12-26 01:07:46,247][123090] Updated weights for policy 1, policy_version 192845 (0.0006) [2023-12-26 01:07:46,304][123090] Updated weights for policy 1, policy_version 192855 (0.0006) [2023-12-26 01:07:46,613][123091] Updated weights for policy 0, policy_version 193601 (0.0006) [2023-12-26 01:07:46,667][123091] Updated weights for policy 0, policy_version 193611 (0.0010) [2023-12-26 01:07:46,721][123091] Updated weights for policy 0, policy_version 193621 (0.0010) [2023-12-26 01:07:46,784][123091] Updated weights for policy 0, policy_version 193631 (0.0010) [2023-12-26 01:07:47,020][123090] Updated weights for policy 1, policy_version 192865 (0.0006) [2023-12-26 01:07:47,073][123090] Updated weights for policy 1, policy_version 192875 (0.0009) [2023-12-26 01:07:47,130][123090] Updated weights for policy 1, policy_version 192885 (0.0010) [2023-12-26 01:07:47,181][123090] Updated weights for policy 1, policy_version 192895 (0.0006) [2023-12-26 01:07:47,602][123091] Updated weights for policy 0, policy_version 193641 (0.0010) [2023-12-26 01:07:47,656][123091] Updated weights for policy 0, policy_version 193651 (0.0008) [2023-12-26 01:07:47,705][123091] Updated weights for policy 0, policy_version 193661 (0.0009) [2023-12-26 01:07:47,877][123090] Updated weights for policy 1, policy_version 192905 (0.0009) [2023-12-26 01:07:47,936][123090] Updated weights for policy 1, policy_version 192915 (0.0010) [2023-12-26 01:07:47,993][123090] Updated weights for policy 1, policy_version 192925 (0.0009) [2023-12-26 01:07:48,598][123091] Updated weights for policy 0, policy_version 193671 (0.0009) [2023-12-26 01:07:48,663][123091] Updated weights for policy 0, policy_version 193681 (0.0008) [2023-12-26 01:07:48,726][123091] Updated weights for policy 0, policy_version 193691 (0.0009) [2023-12-26 01:07:48,752][123090] Updated weights for policy 1, policy_version 192935 (0.0011) [2023-12-26 01:07:48,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 98975744. Throughput: 0: 8763.8, 1: 8659.7. Samples: 98986816. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:48,784][121949] Avg episode reward: [(0, '5839.850'), (1, '5276.106')] [2023-12-26 01:07:48,810][123090] Updated weights for policy 1, policy_version 192945 (0.0006) [2023-12-26 01:07:48,867][123090] Updated weights for policy 1, policy_version 192955 (0.0005) [2023-12-26 01:07:49,524][123091] Updated weights for policy 0, policy_version 193701 (0.0008) [2023-12-26 01:07:49,535][123090] Updated weights for policy 1, policy_version 192965 (0.0006) [2023-12-26 01:07:49,583][123091] Updated weights for policy 0, policy_version 193711 (0.0008) [2023-12-26 01:07:49,593][123090] Updated weights for policy 1, policy_version 192975 (0.0009) [2023-12-26 01:07:49,633][123091] Updated weights for policy 0, policy_version 193721 (0.0008) [2023-12-26 01:07:49,657][123090] Updated weights for policy 1, policy_version 192985 (0.0010) [2023-12-26 01:07:50,430][123091] Updated weights for policy 0, policy_version 193731 (0.0007) [2023-12-26 01:07:50,443][123090] Updated weights for policy 1, policy_version 192995 (0.0009) [2023-12-26 01:07:50,489][123091] Updated weights for policy 0, policy_version 193741 (0.0005) [2023-12-26 01:07:50,506][123090] Updated weights for policy 1, policy_version 193005 (0.0005) [2023-12-26 01:07:50,551][123091] Updated weights for policy 0, policy_version 193751 (0.0005) [2023-12-26 01:07:50,570][123090] Updated weights for policy 1, policy_version 193015 (0.0006) [2023-12-26 01:07:51,330][123091] Updated weights for policy 0, policy_version 193761 (0.0008) [2023-12-26 01:07:51,355][123090] Updated weights for policy 1, policy_version 193025 (0.0007) [2023-12-26 01:07:51,402][123091] Updated weights for policy 0, policy_version 193771 (0.0008) [2023-12-26 01:07:51,422][123090] Updated weights for policy 1, policy_version 193035 (0.0009) [2023-12-26 01:07:51,471][123091] Updated weights for policy 0, policy_version 193781 (0.0007) [2023-12-26 01:07:51,478][123090] Updated weights for policy 1, policy_version 193045 (0.0009) [2023-12-26 01:07:51,538][123091] Updated weights for policy 0, policy_version 193791 (0.0006) [2023-12-26 01:07:51,540][123090] Updated weights for policy 1, policy_version 193055 (0.0009) [2023-12-26 01:07:52,321][123091] Updated weights for policy 0, policy_version 193801 (0.0010) [2023-12-26 01:07:52,374][123090] Updated weights for policy 1, policy_version 193065 (0.0009) [2023-12-26 01:07:52,383][123091] Updated weights for policy 0, policy_version 193811 (0.0007) [2023-12-26 01:07:52,442][123091] Updated weights for policy 0, policy_version 193821 (0.0006) [2023-12-26 01:07:52,444][123090] Updated weights for policy 1, policy_version 193075 (0.0009) [2023-12-26 01:07:52,513][123090] Updated weights for policy 1, policy_version 193085 (0.0009) [2023-12-26 01:07:53,195][123091] Updated weights for policy 0, policy_version 193831 (0.0005) [2023-12-26 01:07:53,249][123091] Updated weights for policy 0, policy_version 193841 (0.0006) [2023-12-26 01:07:53,302][123091] Updated weights for policy 0, policy_version 193851 (0.0009) [2023-12-26 01:07:53,382][123090] Updated weights for policy 1, policy_version 193095 (0.0009) [2023-12-26 01:07:53,430][123090] Updated weights for policy 1, policy_version 193105 (0.0009) [2023-12-26 01:07:53,483][123090] Updated weights for policy 1, policy_version 193116 (0.0010) [2023-12-26 01:07:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 99065856. Throughput: 0: 8775.3, 1: 8705.5. Samples: 99040688. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:53,785][121949] Avg episode reward: [(0, '5680.795'), (1, '5338.869')] [2023-12-26 01:07:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000193120_49438720.pth... [2023-12-26 01:07:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000193856_49627136.pth... [2023-12-26 01:07:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000192096_49176576.pth [2023-12-26 01:07:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000192832_49364992.pth [2023-12-26 01:07:53,969][123091] Updated weights for policy 0, policy_version 193861 (0.0009) [2023-12-26 01:07:54,037][123091] Updated weights for policy 0, policy_version 193871 (0.0010) [2023-12-26 01:07:54,092][123091] Updated weights for policy 0, policy_version 193881 (0.0010) [2023-12-26 01:07:54,328][123090] Updated weights for policy 1, policy_version 193127 (0.0009) [2023-12-26 01:07:54,392][123090] Updated weights for policy 1, policy_version 193138 (0.0009) [2023-12-26 01:07:54,454][123090] Updated weights for policy 1, policy_version 193148 (0.0008) [2023-12-26 01:07:54,962][123091] Updated weights for policy 0, policy_version 193891 (0.0010) [2023-12-26 01:07:55,025][123091] Updated weights for policy 0, policy_version 193901 (0.0010) [2023-12-26 01:07:55,074][123091] Updated weights for policy 0, policy_version 193911 (0.0009) [2023-12-26 01:07:55,215][123090] Updated weights for policy 1, policy_version 193158 (0.0007) [2023-12-26 01:07:55,284][123090] Updated weights for policy 1, policy_version 193168 (0.0009) [2023-12-26 01:07:55,346][123090] Updated weights for policy 1, policy_version 193178 (0.0007) [2023-12-26 01:07:55,808][123091] Updated weights for policy 0, policy_version 193921 (0.0009) [2023-12-26 01:07:55,870][123091] Updated weights for policy 0, policy_version 193931 (0.0010) [2023-12-26 01:07:55,936][123091] Updated weights for policy 0, policy_version 193941 (0.0008) [2023-12-26 01:07:55,996][123091] Updated weights for policy 0, policy_version 193951 (0.0006) [2023-12-26 01:07:56,030][123090] Updated weights for policy 1, policy_version 193188 (0.0006) [2023-12-26 01:07:56,083][123090] Updated weights for policy 1, policy_version 193198 (0.0005) [2023-12-26 01:07:56,142][123090] Updated weights for policy 1, policy_version 193208 (0.0005) [2023-12-26 01:07:56,802][123091] Updated weights for policy 0, policy_version 193961 (0.0010) [2023-12-26 01:07:56,841][123090] Updated weights for policy 1, policy_version 193218 (0.0005) [2023-12-26 01:07:56,860][123091] Updated weights for policy 0, policy_version 193971 (0.0010) [2023-12-26 01:07:56,897][123090] Updated weights for policy 1, policy_version 193228 (0.0005) [2023-12-26 01:07:56,924][123091] Updated weights for policy 0, policy_version 193981 (0.0006) [2023-12-26 01:07:56,971][123090] Updated weights for policy 1, policy_version 193238 (0.0007) [2023-12-26 01:07:57,036][123090] Updated weights for policy 1, policy_version 193248 (0.0010) [2023-12-26 01:07:57,654][123091] Updated weights for policy 0, policy_version 193991 (0.0005) [2023-12-26 01:07:57,701][123091] Updated weights for policy 0, policy_version 194001 (0.0005) [2023-12-26 01:07:57,752][123091] Updated weights for policy 0, policy_version 194011 (0.0006) [2023-12-26 01:07:57,817][123090] Updated weights for policy 1, policy_version 193258 (0.0010) [2023-12-26 01:07:57,883][123090] Updated weights for policy 1, policy_version 193268 (0.0010) [2023-12-26 01:07:57,954][123090] Updated weights for policy 1, policy_version 193278 (0.0010) [2023-12-26 01:07:58,606][123091] Updated weights for policy 0, policy_version 194021 (0.0008) [2023-12-26 01:07:58,674][123091] Updated weights for policy 0, policy_version 194031 (0.0009) [2023-12-26 01:07:58,737][123091] Updated weights for policy 0, policy_version 194041 (0.0009) [2023-12-26 01:07:58,786][121949] Fps is (10 sec: 17200.0, 60 sec: 17475.7, 300 sec: 17661.3). Total num frames: 99147776. Throughput: 0: 8881.3, 1: 8764.4. Samples: 99149988. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:07:58,787][121949] Avg episode reward: [(0, '5489.040'), (1, '5492.411')] [2023-12-26 01:07:58,843][123090] Updated weights for policy 1, policy_version 193288 (0.0007) [2023-12-26 01:07:58,891][123090] Updated weights for policy 1, policy_version 193298 (0.0006) [2023-12-26 01:07:58,950][123090] Updated weights for policy 1, policy_version 193308 (0.0008) [2023-12-26 01:07:59,566][123091] Updated weights for policy 0, policy_version 194051 (0.0009) [2023-12-26 01:07:59,626][123091] Updated weights for policy 0, policy_version 194061 (0.0009) [2023-12-26 01:07:59,685][123091] Updated weights for policy 0, policy_version 194071 (0.0009) [2023-12-26 01:07:59,805][123090] Updated weights for policy 1, policy_version 193318 (0.0006) [2023-12-26 01:07:59,879][123090] Updated weights for policy 1, policy_version 193328 (0.0007) [2023-12-26 01:07:59,951][123090] Updated weights for policy 1, policy_version 193338 (0.0010) [2023-12-26 01:08:00,432][123091] Updated weights for policy 0, policy_version 194081 (0.0009) [2023-12-26 01:08:00,487][123091] Updated weights for policy 0, policy_version 194091 (0.0009) [2023-12-26 01:08:00,542][123091] Updated weights for policy 0, policy_version 194101 (0.0010) [2023-12-26 01:08:00,603][123091] Updated weights for policy 0, policy_version 194111 (0.0010) [2023-12-26 01:08:00,731][123090] Updated weights for policy 1, policy_version 193348 (0.0010) [2023-12-26 01:08:00,784][123090] Updated weights for policy 1, policy_version 193358 (0.0009) [2023-12-26 01:08:00,832][123090] Updated weights for policy 1, policy_version 193368 (0.0009) [2023-12-26 01:08:01,411][123091] Updated weights for policy 0, policy_version 194121 (0.0010) [2023-12-26 01:08:01,482][123091] Updated weights for policy 0, policy_version 194131 (0.0006) [2023-12-26 01:08:01,549][123091] Updated weights for policy 0, policy_version 194141 (0.0006) [2023-12-26 01:08:01,727][123090] Updated weights for policy 1, policy_version 193378 (0.0010) [2023-12-26 01:08:01,792][123090] Updated weights for policy 1, policy_version 193388 (0.0008) [2023-12-26 01:08:01,845][123090] Updated weights for policy 1, policy_version 193398 (0.0009) [2023-12-26 01:08:01,894][123090] Updated weights for policy 1, policy_version 193408 (0.0009) [2023-12-26 01:08:02,286][123091] Updated weights for policy 0, policy_version 194151 (0.0009) [2023-12-26 01:08:02,339][123091] Updated weights for policy 0, policy_version 194161 (0.0006) [2023-12-26 01:08:02,405][123091] Updated weights for policy 0, policy_version 194172 (0.0008) [2023-12-26 01:08:02,701][123090] Updated weights for policy 1, policy_version 193418 (0.0007) [2023-12-26 01:08:02,755][123090] Updated weights for policy 1, policy_version 193429 (0.0008) [2023-12-26 01:08:02,814][123090] Updated weights for policy 1, policy_version 193439 (0.0008) [2023-12-26 01:08:03,295][123091] Updated weights for policy 0, policy_version 194183 (0.0010) [2023-12-26 01:08:03,360][123091] Updated weights for policy 0, policy_version 194193 (0.0010) [2023-12-26 01:08:03,413][123091] Updated weights for policy 0, policy_version 194204 (0.0010) [2023-12-26 01:08:03,490][123090] Updated weights for policy 1, policy_version 193449 (0.0007) [2023-12-26 01:08:03,555][123090] Updated weights for policy 1, policy_version 193459 (0.0010) [2023-12-26 01:08:03,620][123090] Updated weights for policy 1, policy_version 193469 (0.0009) [2023-12-26 01:08:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 99246080. Throughput: 0: 8826.5, 1: 8767.5. Samples: 99253980. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:08:03,785][121949] Avg episode reward: [(0, '5292.565'), (1, '5522.386')] [2023-12-26 01:08:04,259][123091] Updated weights for policy 0, policy_version 194214 (0.0010) [2023-12-26 01:08:04,323][123091] Updated weights for policy 0, policy_version 194224 (0.0011) [2023-12-26 01:08:04,360][123090] Updated weights for policy 1, policy_version 193479 (0.0008) [2023-12-26 01:08:04,383][123091] Updated weights for policy 0, policy_version 194234 (0.0011) [2023-12-26 01:08:04,426][123090] Updated weights for policy 1, policy_version 193489 (0.0006) [2023-12-26 01:08:04,498][123090] Updated weights for policy 1, policy_version 193499 (0.0009) [2023-12-26 01:08:05,079][123091] Updated weights for policy 0, policy_version 194244 (0.0011) [2023-12-26 01:08:05,134][123091] Updated weights for policy 0, policy_version 194254 (0.0011) [2023-12-26 01:08:05,197][123091] Updated weights for policy 0, policy_version 194264 (0.0011) [2023-12-26 01:08:05,207][123090] Updated weights for policy 1, policy_version 193509 (0.0008) [2023-12-26 01:08:05,262][123090] Updated weights for policy 1, policy_version 193519 (0.0008) [2023-12-26 01:08:05,314][123090] Updated weights for policy 1, policy_version 193529 (0.0009) [2023-12-26 01:08:05,967][123091] Updated weights for policy 0, policy_version 194274 (0.0011) [2023-12-26 01:08:06,026][123091] Updated weights for policy 0, policy_version 194284 (0.0011) [2023-12-26 01:08:06,084][123091] Updated weights for policy 0, policy_version 194294 (0.0008) [2023-12-26 01:08:06,140][123090] Updated weights for policy 1, policy_version 193539 (0.0008) [2023-12-26 01:08:06,154][123091] Updated weights for policy 0, policy_version 194304 (0.0008) [2023-12-26 01:08:06,201][123090] Updated weights for policy 1, policy_version 193549 (0.0010) [2023-12-26 01:08:06,261][123090] Updated weights for policy 1, policy_version 193559 (0.0010) [2023-12-26 01:08:06,947][123091] Updated weights for policy 0, policy_version 194314 (0.0011) [2023-12-26 01:08:07,003][123091] Updated weights for policy 0, policy_version 194324 (0.0011) [2023-12-26 01:08:07,051][123091] Updated weights for policy 0, policy_version 194334 (0.0010) [2023-12-26 01:08:07,116][123090] Updated weights for policy 1, policy_version 193569 (0.0010) [2023-12-26 01:08:07,172][123090] Updated weights for policy 1, policy_version 193579 (0.0008) [2023-12-26 01:08:07,228][123090] Updated weights for policy 1, policy_version 193589 (0.0009) [2023-12-26 01:08:07,292][123090] Updated weights for policy 1, policy_version 193599 (0.0009) [2023-12-26 01:08:07,879][123091] Updated weights for policy 0, policy_version 194344 (0.0007) [2023-12-26 01:08:07,938][123091] Updated weights for policy 0, policy_version 194354 (0.0005) [2023-12-26 01:08:08,002][123091] Updated weights for policy 0, policy_version 194364 (0.0005) [2023-12-26 01:08:08,185][123090] Updated weights for policy 1, policy_version 193609 (0.0009) [2023-12-26 01:08:08,239][123090] Updated weights for policy 1, policy_version 193620 (0.0010) [2023-12-26 01:08:08,302][123090] Updated weights for policy 1, policy_version 193631 (0.0010) [2023-12-26 01:08:08,698][123091] Updated weights for policy 0, policy_version 194374 (0.0008) [2023-12-26 01:08:08,767][123091] Updated weights for policy 0, policy_version 194384 (0.0009) [2023-12-26 01:08:08,784][121949] Fps is (10 sec: 18025.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 99328000. Throughput: 0: 8855.9, 1: 8814.6. Samples: 99308072. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:08:08,786][121949] Avg episode reward: [(0, '5224.250'), (1, '5413.670')] [2023-12-26 01:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000193632_49569792.pth... [2023-12-26 01:08:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000192608_49307648.pth [2023-12-26 01:08:08,840][123091] Updated weights for policy 0, policy_version 194394 (0.0010) [2023-12-26 01:08:08,880][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000194400_49766400.pth... [2023-12-26 01:08:08,885][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000193344_49496064.pth [2023-12-26 01:08:09,181][123090] Updated weights for policy 1, policy_version 193641 (0.0009) [2023-12-26 01:08:09,236][123090] Updated weights for policy 1, policy_version 193651 (0.0008) [2023-12-26 01:08:09,304][123090] Updated weights for policy 1, policy_version 193661 (0.0008) [2023-12-26 01:08:09,697][123091] Updated weights for policy 0, policy_version 194404 (0.0010) [2023-12-26 01:08:09,747][123091] Updated weights for policy 0, policy_version 194414 (0.0009) [2023-12-26 01:08:09,808][123091] Updated weights for policy 0, policy_version 194424 (0.0009) [2023-12-26 01:08:10,152][123090] Updated weights for policy 1, policy_version 193671 (0.0009) [2023-12-26 01:08:10,213][123090] Updated weights for policy 1, policy_version 193681 (0.0009) [2023-12-26 01:08:10,266][123090] Updated weights for policy 1, policy_version 193691 (0.0009) [2023-12-26 01:08:10,626][123091] Updated weights for policy 0, policy_version 194434 (0.0007) [2023-12-26 01:08:10,678][123091] Updated weights for policy 0, policy_version 194444 (0.0006) [2023-12-26 01:08:10,724][123091] Updated weights for policy 0, policy_version 194454 (0.0005) [2023-12-26 01:08:10,778][123091] Updated weights for policy 0, policy_version 194464 (0.0005) [2023-12-26 01:08:11,163][123090] Updated weights for policy 1, policy_version 193701 (0.0009) [2023-12-26 01:08:11,232][123090] Updated weights for policy 1, policy_version 193711 (0.0009) [2023-12-26 01:08:11,300][123090] Updated weights for policy 1, policy_version 193721 (0.0009) [2023-12-26 01:08:11,559][123091] Updated weights for policy 0, policy_version 194474 (0.0009) [2023-12-26 01:08:11,618][123091] Updated weights for policy 0, policy_version 194484 (0.0009) [2023-12-26 01:08:11,686][123091] Updated weights for policy 0, policy_version 194494 (0.0009) [2023-12-26 01:08:12,187][123090] Updated weights for policy 1, policy_version 193731 (0.0009) [2023-12-26 01:08:12,251][123090] Updated weights for policy 1, policy_version 193741 (0.0009) [2023-12-26 01:08:12,318][123090] Updated weights for policy 1, policy_version 193751 (0.0010) [2023-12-26 01:08:12,563][123091] Updated weights for policy 0, policy_version 194504 (0.0010) [2023-12-26 01:08:12,633][123091] Updated weights for policy 0, policy_version 194514 (0.0010) [2023-12-26 01:08:12,695][123091] Updated weights for policy 0, policy_version 194524 (0.0009) [2023-12-26 01:08:13,165][123090] Updated weights for policy 1, policy_version 193761 (0.0009) [2023-12-26 01:08:13,222][123090] Updated weights for policy 1, policy_version 193771 (0.0008) [2023-12-26 01:08:13,279][123090] Updated weights for policy 1, policy_version 193781 (0.0009) [2023-12-26 01:08:13,344][123090] Updated weights for policy 1, policy_version 193791 (0.0009) [2023-12-26 01:08:13,488][123091] Updated weights for policy 0, policy_version 194534 (0.0007) [2023-12-26 01:08:13,559][123091] Updated weights for policy 0, policy_version 194544 (0.0005) [2023-12-26 01:08:13,630][123091] Updated weights for policy 0, policy_version 194554 (0.0005) [2023-12-26 01:08:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 99418112. Throughput: 0: 8873.8, 1: 8707.6. Samples: 99409276. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:08:13,784][121949] Avg episode reward: [(0, '5221.111'), (1, '5572.859')] [2023-12-26 01:08:14,238][123090] Updated weights for policy 1, policy_version 193801 (0.0009) [2023-12-26 01:08:14,286][123090] Updated weights for policy 1, policy_version 193811 (0.0009) [2023-12-26 01:08:14,291][123091] Updated weights for policy 0, policy_version 194564 (0.0006) [2023-12-26 01:08:14,344][123090] Updated weights for policy 1, policy_version 193821 (0.0009) [2023-12-26 01:08:14,357][123091] Updated weights for policy 0, policy_version 194574 (0.0010) [2023-12-26 01:08:14,412][123091] Updated weights for policy 0, policy_version 194584 (0.0007) [2023-12-26 01:08:15,196][123091] Updated weights for policy 0, policy_version 194594 (0.0007) [2023-12-26 01:08:15,217][123090] Updated weights for policy 1, policy_version 193831 (0.0009) [2023-12-26 01:08:15,259][123091] Updated weights for policy 0, policy_version 194604 (0.0009) [2023-12-26 01:08:15,285][123090] Updated weights for policy 1, policy_version 193841 (0.0008) [2023-12-26 01:08:15,319][123091] Updated weights for policy 0, policy_version 194614 (0.0010) [2023-12-26 01:08:15,349][123090] Updated weights for policy 1, policy_version 193851 (0.0009) [2023-12-26 01:08:15,387][123091] Updated weights for policy 0, policy_version 194624 (0.0008) [2023-12-26 01:08:16,082][123090] Updated weights for policy 1, policy_version 193861 (0.0010) [2023-12-26 01:08:16,146][123090] Updated weights for policy 1, policy_version 193871 (0.0009) [2023-12-26 01:08:16,199][123090] Updated weights for policy 1, policy_version 193881 (0.0009) [2023-12-26 01:08:16,216][123091] Updated weights for policy 0, policy_version 194634 (0.0005) [2023-12-26 01:08:16,276][123091] Updated weights for policy 0, policy_version 194644 (0.0005) [2023-12-26 01:08:16,338][123091] Updated weights for policy 0, policy_version 194654 (0.0005) [2023-12-26 01:08:17,057][123090] Updated weights for policy 1, policy_version 193891 (0.0009) [2023-12-26 01:08:17,101][123091] Updated weights for policy 0, policy_version 194664 (0.0008) [2023-12-26 01:08:17,125][123090] Updated weights for policy 1, policy_version 193901 (0.0007) [2023-12-26 01:08:17,166][123091] Updated weights for policy 0, policy_version 194674 (0.0009) [2023-12-26 01:08:17,186][123090] Updated weights for policy 1, policy_version 193911 (0.0007) [2023-12-26 01:08:17,231][123091] Updated weights for policy 0, policy_version 194684 (0.0009) [2023-12-26 01:08:17,919][123091] Updated weights for policy 0, policy_version 194694 (0.0007) [2023-12-26 01:08:17,980][123091] Updated weights for policy 0, policy_version 194704 (0.0005) [2023-12-26 01:08:18,048][123090] Updated weights for policy 1, policy_version 193921 (0.0007) [2023-12-26 01:08:18,051][123091] Updated weights for policy 0, policy_version 194714 (0.0006) [2023-12-26 01:08:18,111][123090] Updated weights for policy 1, policy_version 193931 (0.0009) [2023-12-26 01:08:18,163][123090] Updated weights for policy 1, policy_version 193941 (0.0009) [2023-12-26 01:08:18,221][123090] Updated weights for policy 1, policy_version 193951 (0.0008) [2023-12-26 01:08:18,688][123091] Updated weights for policy 0, policy_version 194724 (0.0006) [2023-12-26 01:08:18,754][123091] Updated weights for policy 0, policy_version 194734 (0.0005) [2023-12-26 01:08:18,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 99500032. Throughput: 0: 8921.8, 1: 8696.6. Samples: 99516080. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 01:08:18,784][121949] Avg episode reward: [(0, '5216.920'), (1, '5668.612')] [2023-12-26 01:08:18,817][123091] Updated weights for policy 0, policy_version 194744 (0.0005) [2023-12-26 01:08:19,115][123090] Updated weights for policy 1, policy_version 193961 (0.0009) [2023-12-26 01:08:19,180][123090] Updated weights for policy 1, policy_version 193971 (0.0009) [2023-12-26 01:08:19,248][123090] Updated weights for policy 1, policy_version 193981 (0.0008) [2023-12-26 01:08:19,581][123091] Updated weights for policy 0, policy_version 194754 (0.0005) [2023-12-26 01:08:19,652][123091] Updated weights for policy 0, policy_version 194764 (0.0010) [2023-12-26 01:08:19,710][123091] Updated weights for policy 0, policy_version 194774 (0.0009) [2023-12-26 01:08:19,762][123091] Updated weights for policy 0, policy_version 194784 (0.0009) [2023-12-26 01:08:20,056][123090] Updated weights for policy 1, policy_version 193991 (0.0009) [2023-12-26 01:08:20,122][123090] Updated weights for policy 1, policy_version 194001 (0.0010) [2023-12-26 01:08:20,185][123090] Updated weights for policy 1, policy_version 194011 (0.0009) [2023-12-26 01:08:20,629][123091] Updated weights for policy 0, policy_version 194794 (0.0010) [2023-12-26 01:08:20,685][123091] Updated weights for policy 0, policy_version 194804 (0.0010) [2023-12-26 01:08:20,751][123091] Updated weights for policy 0, policy_version 194814 (0.0008) [2023-12-26 01:08:21,069][123090] Updated weights for policy 1, policy_version 194021 (0.0010) [2023-12-26 01:08:21,123][123090] Updated weights for policy 1, policy_version 194031 (0.0009) [2023-12-26 01:08:21,192][123090] Updated weights for policy 1, policy_version 194041 (0.0009) [2023-12-26 01:08:21,630][123091] Updated weights for policy 0, policy_version 194824 (0.0009) [2023-12-26 01:08:21,698][123091] Updated weights for policy 0, policy_version 194834 (0.0009) [2023-12-26 01:08:21,765][123091] Updated weights for policy 0, policy_version 194844 (0.0008) [2023-12-26 01:08:22,065][123090] Updated weights for policy 1, policy_version 194051 (0.0008) [2023-12-26 01:08:22,132][123090] Updated weights for policy 1, policy_version 194061 (0.0006) [2023-12-26 01:08:22,203][123090] Updated weights for policy 1, policy_version 194071 (0.0006) [2023-12-26 01:08:22,649][123091] Updated weights for policy 0, policy_version 194854 (0.0010) [2023-12-26 01:08:22,716][123091] Updated weights for policy 0, policy_version 194864 (0.0011) [2023-12-26 01:08:22,781][123091] Updated weights for policy 0, policy_version 194874 (0.0006) [2023-12-26 01:08:22,932][123090] Updated weights for policy 1, policy_version 194081 (0.0009) [2023-12-26 01:08:22,983][123090] Updated weights for policy 1, policy_version 194091 (0.0005) [2023-12-26 01:08:23,038][123090] Updated weights for policy 1, policy_version 194101 (0.0005) [2023-12-26 01:08:23,089][123090] Updated weights for policy 1, policy_version 194111 (0.0005) [2023-12-26 01:08:23,465][123091] Updated weights for policy 0, policy_version 194884 (0.0005) [2023-12-26 01:08:23,519][123091] Updated weights for policy 0, policy_version 194894 (0.0005) [2023-12-26 01:08:23,574][123091] Updated weights for policy 0, policy_version 194904 (0.0007) [2023-12-26 01:08:23,726][123090] Updated weights for policy 1, policy_version 194121 (0.0005) [2023-12-26 01:08:23,782][123090] Updated weights for policy 1, policy_version 194131 (0.0006) [2023-12-26 01:08:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 99590144. Throughput: 0: 8907.7, 1: 8642.7. Samples: 99565836. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:23,785][121949] Avg episode reward: [(0, '5463.303'), (1, '5622.090')] [2023-12-26 01:08:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000194912_49897472.pth... [2023-12-26 01:08:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000193856_49627136.pth [2023-12-26 01:08:23,842][123090] Updated weights for policy 1, policy_version 194141 (0.0005) [2023-12-26 01:08:23,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000194144_49700864.pth... [2023-12-26 01:08:23,862][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000193120_49438720.pth [2023-12-26 01:08:24,250][123091] Updated weights for policy 0, policy_version 194914 (0.0009) [2023-12-26 01:08:24,303][123091] Updated weights for policy 0, policy_version 194924 (0.0005) [2023-12-26 01:08:24,363][123091] Updated weights for policy 0, policy_version 194934 (0.0007) [2023-12-26 01:08:24,418][123091] Updated weights for policy 0, policy_version 194944 (0.0010) [2023-12-26 01:08:24,658][123090] Updated weights for policy 1, policy_version 194151 (0.0008) [2023-12-26 01:08:24,718][123090] Updated weights for policy 1, policy_version 194161 (0.0008) [2023-12-26 01:08:24,777][123090] Updated weights for policy 1, policy_version 194171 (0.0008) [2023-12-26 01:08:25,221][123091] Updated weights for policy 0, policy_version 194954 (0.0005) [2023-12-26 01:08:25,268][123091] Updated weights for policy 0, policy_version 194964 (0.0005) [2023-12-26 01:08:25,315][123091] Updated weights for policy 0, policy_version 194974 (0.0005) [2023-12-26 01:08:25,582][123090] Updated weights for policy 1, policy_version 194181 (0.0009) [2023-12-26 01:08:25,638][123090] Updated weights for policy 1, policy_version 194191 (0.0009) [2023-12-26 01:08:25,691][123090] Updated weights for policy 1, policy_version 194201 (0.0009) [2023-12-26 01:08:26,047][123091] Updated weights for policy 0, policy_version 194984 (0.0008) [2023-12-26 01:08:26,095][123091] Updated weights for policy 0, policy_version 194994 (0.0009) [2023-12-26 01:08:26,159][123091] Updated weights for policy 0, policy_version 195004 (0.0010) [2023-12-26 01:08:26,474][123090] Updated weights for policy 1, policy_version 194211 (0.0009) [2023-12-26 01:08:26,527][123090] Updated weights for policy 1, policy_version 194221 (0.0009) [2023-12-26 01:08:26,577][123090] Updated weights for policy 1, policy_version 194231 (0.0005) [2023-12-26 01:08:26,919][123091] Updated weights for policy 0, policy_version 195014 (0.0008) [2023-12-26 01:08:26,976][123091] Updated weights for policy 0, policy_version 195024 (0.0005) [2023-12-26 01:08:27,035][123091] Updated weights for policy 0, policy_version 195034 (0.0006) [2023-12-26 01:08:27,361][123090] Updated weights for policy 1, policy_version 194241 (0.0006) [2023-12-26 01:08:27,414][123090] Updated weights for policy 1, policy_version 194251 (0.0009) [2023-12-26 01:08:27,463][123090] Updated weights for policy 1, policy_version 194261 (0.0009) [2023-12-26 01:08:27,516][123090] Updated weights for policy 1, policy_version 194271 (0.0008) [2023-12-26 01:08:27,783][123091] Updated weights for policy 0, policy_version 195044 (0.0007) [2023-12-26 01:08:27,831][123091] Updated weights for policy 0, policy_version 195054 (0.0009) [2023-12-26 01:08:27,880][123091] Updated weights for policy 0, policy_version 195064 (0.0009) [2023-12-26 01:08:28,389][123090] Updated weights for policy 1, policy_version 194281 (0.0010) [2023-12-26 01:08:28,454][123090] Updated weights for policy 1, policy_version 194291 (0.0009) [2023-12-26 01:08:28,516][123090] Updated weights for policy 1, policy_version 194301 (0.0009) [2023-12-26 01:08:28,666][123091] Updated weights for policy 0, policy_version 195074 (0.0009) [2023-12-26 01:08:28,726][123091] Updated weights for policy 0, policy_version 195084 (0.0009) [2023-12-26 01:08:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 99680256. Throughput: 0: 9035.6, 1: 8721.5. Samples: 99677264. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:28,784][121949] Avg episode reward: [(0, '5709.413'), (1, '5495.194')] [2023-12-26 01:08:28,785][123091] Updated weights for policy 0, policy_version 195094 (0.0009) [2023-12-26 01:08:28,850][123091] Updated weights for policy 0, policy_version 195104 (0.0008) [2023-12-26 01:08:29,404][123090] Updated weights for policy 1, policy_version 194311 (0.0010) [2023-12-26 01:08:29,464][123090] Updated weights for policy 1, policy_version 194321 (0.0009) [2023-12-26 01:08:29,522][123090] Updated weights for policy 1, policy_version 194331 (0.0009) [2023-12-26 01:08:29,543][123091] Updated weights for policy 0, policy_version 195114 (0.0005) [2023-12-26 01:08:29,598][123091] Updated weights for policy 0, policy_version 195124 (0.0005) [2023-12-26 01:08:29,664][123091] Updated weights for policy 0, policy_version 195134 (0.0007) [2023-12-26 01:08:30,285][123091] Updated weights for policy 0, policy_version 195144 (0.0009) [2023-12-26 01:08:30,358][123091] Updated weights for policy 0, policy_version 195154 (0.0009) [2023-12-26 01:08:30,422][123091] Updated weights for policy 0, policy_version 195164 (0.0009) [2023-12-26 01:08:30,434][123090] Updated weights for policy 1, policy_version 194341 (0.0009) [2023-12-26 01:08:30,486][123090] Updated weights for policy 1, policy_version 194351 (0.0009) [2023-12-26 01:08:30,540][123090] Updated weights for policy 1, policy_version 194361 (0.0009) [2023-12-26 01:08:31,146][123091] Updated weights for policy 0, policy_version 195174 (0.0008) [2023-12-26 01:08:31,206][123091] Updated weights for policy 0, policy_version 195184 (0.0006) [2023-12-26 01:08:31,276][123091] Updated weights for policy 0, policy_version 195194 (0.0007) [2023-12-26 01:08:31,452][123090] Updated weights for policy 1, policy_version 194371 (0.0009) [2023-12-26 01:08:31,516][123090] Updated weights for policy 1, policy_version 194381 (0.0009) [2023-12-26 01:08:31,564][123090] Updated weights for policy 1, policy_version 194391 (0.0008) [2023-12-26 01:08:32,043][123091] Updated weights for policy 0, policy_version 195204 (0.0010) [2023-12-26 01:08:32,094][123091] Updated weights for policy 0, policy_version 195214 (0.0010) [2023-12-26 01:08:32,138][123091] Updated weights for policy 0, policy_version 195224 (0.0010) [2023-12-26 01:08:32,443][123090] Updated weights for policy 1, policy_version 194401 (0.0009) [2023-12-26 01:08:32,507][123090] Updated weights for policy 1, policy_version 194411 (0.0009) [2023-12-26 01:08:32,570][123090] Updated weights for policy 1, policy_version 194421 (0.0010) [2023-12-26 01:08:32,624][123090] Updated weights for policy 1, policy_version 194431 (0.0010) [2023-12-26 01:08:32,977][123091] Updated weights for policy 0, policy_version 195234 (0.0010) [2023-12-26 01:08:33,025][123091] Updated weights for policy 0, policy_version 195244 (0.0009) [2023-12-26 01:08:33,074][123091] Updated weights for policy 0, policy_version 195254 (0.0009) [2023-12-26 01:08:33,121][123091] Updated weights for policy 0, policy_version 195264 (0.0010) [2023-12-26 01:08:33,480][123090] Updated weights for policy 1, policy_version 194441 (0.0009) [2023-12-26 01:08:33,531][123090] Updated weights for policy 1, policy_version 194451 (0.0009) [2023-12-26 01:08:33,587][123090] Updated weights for policy 1, policy_version 194461 (0.0005) [2023-12-26 01:08:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 99770368. Throughput: 0: 9042.6, 1: 8625.0. Samples: 99781856. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:33,785][121949] Avg episode reward: [(0, '5652.571'), (1, '5540.906')] [2023-12-26 01:08:33,971][123091] Updated weights for policy 0, policy_version 195274 (0.0010) [2023-12-26 01:08:34,033][123091] Updated weights for policy 0, policy_version 195284 (0.0009) [2023-12-26 01:08:34,088][123091] Updated weights for policy 0, policy_version 195294 (0.0009) [2023-12-26 01:08:34,395][123090] Updated weights for policy 1, policy_version 194471 (0.0008) [2023-12-26 01:08:34,470][123090] Updated weights for policy 1, policy_version 194481 (0.0009) [2023-12-26 01:08:34,535][123090] Updated weights for policy 1, policy_version 194491 (0.0009) [2023-12-26 01:08:34,919][123091] Updated weights for policy 0, policy_version 195304 (0.0010) [2023-12-26 01:08:34,987][123091] Updated weights for policy 0, policy_version 195314 (0.0010) [2023-12-26 01:08:35,042][123091] Updated weights for policy 0, policy_version 195324 (0.0010) [2023-12-26 01:08:35,387][123090] Updated weights for policy 1, policy_version 194501 (0.0009) [2023-12-26 01:08:35,451][123090] Updated weights for policy 1, policy_version 194511 (0.0010) [2023-12-26 01:08:35,506][123090] Updated weights for policy 1, policy_version 194521 (0.0009) [2023-12-26 01:08:35,897][123091] Updated weights for policy 0, policy_version 195334 (0.0010) [2023-12-26 01:08:35,954][123091] Updated weights for policy 0, policy_version 195344 (0.0010) [2023-12-26 01:08:36,011][123091] Updated weights for policy 0, policy_version 195354 (0.0009) [2023-12-26 01:08:36,313][123090] Updated weights for policy 1, policy_version 194531 (0.0008) [2023-12-26 01:08:36,374][123090] Updated weights for policy 1, policy_version 194541 (0.0009) [2023-12-26 01:08:36,439][123090] Updated weights for policy 1, policy_version 194551 (0.0010) [2023-12-26 01:08:36,860][123091] Updated weights for policy 0, policy_version 195364 (0.0010) [2023-12-26 01:08:36,916][123091] Updated weights for policy 0, policy_version 195374 (0.0009) [2023-12-26 01:08:36,969][123091] Updated weights for policy 0, policy_version 195384 (0.0010) [2023-12-26 01:08:37,327][123090] Updated weights for policy 1, policy_version 194561 (0.0009) [2023-12-26 01:08:37,388][123090] Updated weights for policy 1, policy_version 194571 (0.0009) [2023-12-26 01:08:37,450][123090] Updated weights for policy 1, policy_version 194581 (0.0009) [2023-12-26 01:08:37,511][123090] Updated weights for policy 1, policy_version 194591 (0.0009) [2023-12-26 01:08:37,686][123091] Updated weights for policy 0, policy_version 195394 (0.0007) [2023-12-26 01:08:37,752][123091] Updated weights for policy 0, policy_version 195404 (0.0011) [2023-12-26 01:08:37,812][123091] Updated weights for policy 0, policy_version 195414 (0.0011) [2023-12-26 01:08:37,880][123091] Updated weights for policy 0, policy_version 195424 (0.0011) [2023-12-26 01:08:38,299][123090] Updated weights for policy 1, policy_version 194601 (0.0010) [2023-12-26 01:08:38,362][123090] Updated weights for policy 1, policy_version 194611 (0.0009) [2023-12-26 01:08:38,419][123090] Updated weights for policy 1, policy_version 194621 (0.0009) [2023-12-26 01:08:38,684][123091] Updated weights for policy 0, policy_version 195434 (0.0011) [2023-12-26 01:08:38,731][123091] Updated weights for policy 0, policy_version 195444 (0.0010) [2023-12-26 01:08:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 99852288. Throughput: 0: 9015.9, 1: 8583.4. Samples: 99832656. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:38,785][121949] Avg episode reward: [(0, '5738.600'), (1, '5584.477')] [2023-12-26 01:08:38,787][123091] Updated weights for policy 0, policy_version 195454 (0.0007) [2023-12-26 01:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000194624_49823744.pth... [2023-12-26 01:08:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000193632_49569792.pth [2023-12-26 01:08:38,797][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000195456_50036736.pth... [2023-12-26 01:08:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000194400_49766400.pth [2023-12-26 01:08:39,267][123090] Updated weights for policy 1, policy_version 194631 (0.0009) [2023-12-26 01:08:39,330][123090] Updated weights for policy 1, policy_version 194641 (0.0007) [2023-12-26 01:08:39,399][123090] Updated weights for policy 1, policy_version 194651 (0.0009) [2023-12-26 01:08:39,599][123091] Updated weights for policy 0, policy_version 195464 (0.0009) [2023-12-26 01:08:39,669][123091] Updated weights for policy 0, policy_version 195474 (0.0008) [2023-12-26 01:08:39,739][123091] Updated weights for policy 0, policy_version 195484 (0.0007) [2023-12-26 01:08:40,268][123090] Updated weights for policy 1, policy_version 194661 (0.0006) [2023-12-26 01:08:40,336][123090] Updated weights for policy 1, policy_version 194671 (0.0007) [2023-12-26 01:08:40,409][123090] Updated weights for policy 1, policy_version 194681 (0.0010) [2023-12-26 01:08:40,496][123091] Updated weights for policy 0, policy_version 195494 (0.0009) [2023-12-26 01:08:40,561][123091] Updated weights for policy 0, policy_version 195504 (0.0009) [2023-12-26 01:08:40,624][123091] Updated weights for policy 0, policy_version 195514 (0.0010) [2023-12-26 01:08:41,200][123090] Updated weights for policy 1, policy_version 194691 (0.0010) [2023-12-26 01:08:41,266][123090] Updated weights for policy 1, policy_version 194701 (0.0009) [2023-12-26 01:08:41,336][123090] Updated weights for policy 1, policy_version 194711 (0.0009) [2023-12-26 01:08:41,464][123091] Updated weights for policy 0, policy_version 195524 (0.0010) [2023-12-26 01:08:41,527][123091] Updated weights for policy 0, policy_version 195534 (0.0008) [2023-12-26 01:08:41,597][123091] Updated weights for policy 0, policy_version 195544 (0.0009) [2023-12-26 01:08:42,167][123090] Updated weights for policy 1, policy_version 194722 (0.0012) [2023-12-26 01:08:42,238][123090] Updated weights for policy 1, policy_version 194732 (0.0010) [2023-12-26 01:08:42,311][123090] Updated weights for policy 1, policy_version 194742 (0.0010) [2023-12-26 01:08:42,384][123090] Updated weights for policy 1, policy_version 194752 (0.0011) [2023-12-26 01:08:42,462][123091] Updated weights for policy 0, policy_version 195554 (0.0009) [2023-12-26 01:08:42,518][123091] Updated weights for policy 0, policy_version 195564 (0.0009) [2023-12-26 01:08:42,582][123091] Updated weights for policy 0, policy_version 195574 (0.0009) [2023-12-26 01:08:42,646][123091] Updated weights for policy 0, policy_version 195584 (0.0008) [2023-12-26 01:08:43,205][123090] Updated weights for policy 1, policy_version 194762 (0.0010) [2023-12-26 01:08:43,276][123090] Updated weights for policy 1, policy_version 194772 (0.0010) [2023-12-26 01:08:43,342][123090] Updated weights for policy 1, policy_version 194782 (0.0010) [2023-12-26 01:08:43,451][123091] Updated weights for policy 0, policy_version 195594 (0.0009) [2023-12-26 01:08:43,498][123091] Updated weights for policy 0, policy_version 195604 (0.0009) [2023-12-26 01:08:43,546][123091] Updated weights for policy 0, policy_version 195614 (0.0009) [2023-12-26 01:08:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 99942400. Throughput: 0: 8960.9, 1: 8507.6. Samples: 99936036. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:43,784][121949] Avg episode reward: [(0, '5780.883'), (1, '5521.435')] [2023-12-26 01:08:44,150][123090] Updated weights for policy 1, policy_version 194792 (0.0010) [2023-12-26 01:08:44,191][123091] Updated weights for policy 0, policy_version 195624 (0.0006) [2023-12-26 01:08:44,209][123090] Updated weights for policy 1, policy_version 194802 (0.0010) [2023-12-26 01:08:44,242][123091] Updated weights for policy 0, policy_version 195634 (0.0009) [2023-12-26 01:08:44,260][123090] Updated weights for policy 1, policy_version 194812 (0.0010) [2023-12-26 01:08:44,297][123091] Updated weights for policy 0, policy_version 195644 (0.0006) [2023-12-26 01:08:44,940][123090] Updated weights for policy 1, policy_version 194822 (0.0010) [2023-12-26 01:08:45,001][123090] Updated weights for policy 1, policy_version 194832 (0.0010) [2023-12-26 01:08:45,065][123090] Updated weights for policy 1, policy_version 194842 (0.0010) [2023-12-26 01:08:45,174][123091] Updated weights for policy 0, policy_version 195654 (0.0008) [2023-12-26 01:08:45,236][123091] Updated weights for policy 0, policy_version 195664 (0.0006) [2023-12-26 01:08:45,299][123091] Updated weights for policy 0, policy_version 195674 (0.0008) [2023-12-26 01:08:45,873][123090] Updated weights for policy 1, policy_version 194852 (0.0008) [2023-12-26 01:08:45,926][123090] Updated weights for policy 1, policy_version 194862 (0.0006) [2023-12-26 01:08:45,981][123090] Updated weights for policy 1, policy_version 194872 (0.0005) [2023-12-26 01:08:46,121][123091] Updated weights for policy 0, policy_version 195684 (0.0008) [2023-12-26 01:08:46,184][123091] Updated weights for policy 0, policy_version 195694 (0.0009) [2023-12-26 01:08:46,247][123091] Updated weights for policy 0, policy_version 195704 (0.0009) [2023-12-26 01:08:46,748][123090] Updated weights for policy 1, policy_version 194882 (0.0007) [2023-12-26 01:08:46,802][123090] Updated weights for policy 1, policy_version 194892 (0.0010) [2023-12-26 01:08:46,855][123090] Updated weights for policy 1, policy_version 194902 (0.0009) [2023-12-26 01:08:46,913][123090] Updated weights for policy 1, policy_version 194912 (0.0008) [2023-12-26 01:08:46,917][123091] Updated weights for policy 0, policy_version 195714 (0.0009) [2023-12-26 01:08:46,981][123091] Updated weights for policy 0, policy_version 195724 (0.0005) [2023-12-26 01:08:47,055][123091] Updated weights for policy 0, policy_version 195734 (0.0005) [2023-12-26 01:08:47,119][123091] Updated weights for policy 0, policy_version 195744 (0.0005) [2023-12-26 01:08:47,663][123091] Updated weights for policy 0, policy_version 195754 (0.0007) [2023-12-26 01:08:47,678][123090] Updated weights for policy 1, policy_version 194922 (0.0005) [2023-12-26 01:08:47,723][123091] Updated weights for policy 0, policy_version 195764 (0.0009) [2023-12-26 01:08:47,749][123090] Updated weights for policy 1, policy_version 194932 (0.0008) [2023-12-26 01:08:47,781][123091] Updated weights for policy 0, policy_version 195774 (0.0010) [2023-12-26 01:08:47,812][123090] Updated weights for policy 1, policy_version 194942 (0.0008) [2023-12-26 01:08:48,563][123090] Updated weights for policy 1, policy_version 194952 (0.0009) [2023-12-26 01:08:48,618][123090] Updated weights for policy 1, policy_version 194962 (0.0010) [2023-12-26 01:08:48,655][123091] Updated weights for policy 0, policy_version 195784 (0.0009) [2023-12-26 01:08:48,681][123090] Updated weights for policy 1, policy_version 194972 (0.0007) [2023-12-26 01:08:48,709][123091] Updated weights for policy 0, policy_version 195794 (0.0007) [2023-12-26 01:08:48,773][123091] Updated weights for policy 0, policy_version 195804 (0.0010) [2023-12-26 01:08:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 100032512. Throughput: 0: 9034.8, 1: 8547.0. Samples: 100045156. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:48,785][121949] Avg episode reward: [(0, '5746.553'), (1, '5508.182')] [2023-12-26 01:08:49,458][123090] Updated weights for policy 1, policy_version 194982 (0.0007) [2023-12-26 01:08:49,525][123090] Updated weights for policy 1, policy_version 194992 (0.0009) [2023-12-26 01:08:49,593][123090] Updated weights for policy 1, policy_version 195002 (0.0009) [2023-12-26 01:08:49,639][123091] Updated weights for policy 0, policy_version 195814 (0.0007) [2023-12-26 01:08:49,702][123091] Updated weights for policy 0, policy_version 195824 (0.0006) [2023-12-26 01:08:49,773][123091] Updated weights for policy 0, policy_version 195834 (0.0006) [2023-12-26 01:08:50,417][123090] Updated weights for policy 1, policy_version 195012 (0.0008) [2023-12-26 01:08:50,482][123090] Updated weights for policy 1, policy_version 195022 (0.0009) [2023-12-26 01:08:50,534][123090] Updated weights for policy 1, policy_version 195032 (0.0009) [2023-12-26 01:08:50,573][123091] Updated weights for policy 0, policy_version 195844 (0.0008) [2023-12-26 01:08:50,630][123091] Updated weights for policy 0, policy_version 195854 (0.0007) [2023-12-26 01:08:50,683][123091] Updated weights for policy 0, policy_version 195864 (0.0006) [2023-12-26 01:08:51,370][123090] Updated weights for policy 1, policy_version 195042 (0.0010) [2023-12-26 01:08:51,443][123090] Updated weights for policy 1, policy_version 195052 (0.0009) [2023-12-26 01:08:51,514][123090] Updated weights for policy 1, policy_version 195062 (0.0010) [2023-12-26 01:08:51,526][123091] Updated weights for policy 0, policy_version 195874 (0.0006) [2023-12-26 01:08:51,587][123091] Updated weights for policy 0, policy_version 195884 (0.0005) [2023-12-26 01:08:51,589][123090] Updated weights for policy 1, policy_version 195072 (0.0009) [2023-12-26 01:08:51,648][123091] Updated weights for policy 0, policy_version 195894 (0.0007) [2023-12-26 01:08:51,711][123091] Updated weights for policy 0, policy_version 195904 (0.0007) [2023-12-26 01:08:52,389][123090] Updated weights for policy 1, policy_version 195082 (0.0008) [2023-12-26 01:08:52,439][123091] Updated weights for policy 0, policy_version 195914 (0.0008) [2023-12-26 01:08:52,447][123090] Updated weights for policy 1, policy_version 195092 (0.0008) [2023-12-26 01:08:52,498][123091] Updated weights for policy 0, policy_version 195924 (0.0008) [2023-12-26 01:08:52,499][123090] Updated weights for policy 1, policy_version 195102 (0.0008) [2023-12-26 01:08:52,566][123091] Updated weights for policy 0, policy_version 195934 (0.0008) [2023-12-26 01:08:53,300][123090] Updated weights for policy 1, policy_version 195112 (0.0009) [2023-12-26 01:08:53,368][123090] Updated weights for policy 1, policy_version 195122 (0.0008) [2023-12-26 01:08:53,394][123091] Updated weights for policy 0, policy_version 195944 (0.0009) [2023-12-26 01:08:53,428][123090] Updated weights for policy 1, policy_version 195132 (0.0008) [2023-12-26 01:08:53,449][123091] Updated weights for policy 0, policy_version 195954 (0.0007) [2023-12-26 01:08:53,500][123091] Updated weights for policy 0, policy_version 195964 (0.0009) [2023-12-26 01:08:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 100122624. Throughput: 0: 9008.3, 1: 8525.8. Samples: 100097104. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:53,785][121949] Avg episode reward: [(0, '5714.915'), (1, '5595.665')] [2023-12-26 01:08:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000195136_49954816.pth... [2023-12-26 01:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000195968_50167808.pth... [2023-12-26 01:08:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000194144_49700864.pth [2023-12-26 01:08:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000194912_49897472.pth [2023-12-26 01:08:54,155][123090] Updated weights for policy 1, policy_version 195142 (0.0009) [2023-12-26 01:08:54,213][123090] Updated weights for policy 1, policy_version 195152 (0.0009) [2023-12-26 01:08:54,268][123090] Updated weights for policy 1, policy_version 195162 (0.0008) [2023-12-26 01:08:54,337][123091] Updated weights for policy 0, policy_version 195974 (0.0010) [2023-12-26 01:08:54,393][123091] Updated weights for policy 0, policy_version 195985 (0.0009) [2023-12-26 01:08:54,447][123091] Updated weights for policy 0, policy_version 195995 (0.0009) [2023-12-26 01:08:55,076][123090] Updated weights for policy 1, policy_version 195172 (0.0010) [2023-12-26 01:08:55,145][123090] Updated weights for policy 1, policy_version 195182 (0.0009) [2023-12-26 01:08:55,216][123090] Updated weights for policy 1, policy_version 195192 (0.0010) [2023-12-26 01:08:55,289][123091] Updated weights for policy 0, policy_version 196005 (0.0009) [2023-12-26 01:08:55,355][123091] Updated weights for policy 0, policy_version 196015 (0.0010) [2023-12-26 01:08:55,423][123091] Updated weights for policy 0, policy_version 196025 (0.0009) [2023-12-26 01:08:55,990][123090] Updated weights for policy 1, policy_version 195202 (0.0008) [2023-12-26 01:08:56,057][123090] Updated weights for policy 1, policy_version 195212 (0.0009) [2023-12-26 01:08:56,132][123090] Updated weights for policy 1, policy_version 195222 (0.0009) [2023-12-26 01:08:56,181][123090] Updated weights for policy 1, policy_version 195232 (0.0009) [2023-12-26 01:08:56,254][123091] Updated weights for policy 0, policy_version 196035 (0.0010) [2023-12-26 01:08:56,308][123091] Updated weights for policy 0, policy_version 196045 (0.0009) [2023-12-26 01:08:56,366][123091] Updated weights for policy 0, policy_version 196055 (0.0010) [2023-12-26 01:08:57,048][123090] Updated weights for policy 1, policy_version 195242 (0.0009) [2023-12-26 01:08:57,077][123091] Updated weights for policy 0, policy_version 196065 (0.0010) [2023-12-26 01:08:57,109][123090] Updated weights for policy 1, policy_version 195252 (0.0009) [2023-12-26 01:08:57,128][123091] Updated weights for policy 0, policy_version 196075 (0.0008) [2023-12-26 01:08:57,156][123090] Updated weights for policy 1, policy_version 195262 (0.0006) [2023-12-26 01:08:57,178][123091] Updated weights for policy 0, policy_version 196085 (0.0008) [2023-12-26 01:08:57,224][123091] Updated weights for policy 0, policy_version 196095 (0.0009) [2023-12-26 01:08:57,987][123090] Updated weights for policy 1, policy_version 195272 (0.0009) [2023-12-26 01:08:58,048][123091] Updated weights for policy 0, policy_version 196105 (0.0008) [2023-12-26 01:08:58,055][123090] Updated weights for policy 1, policy_version 195282 (0.0009) [2023-12-26 01:08:58,115][123091] Updated weights for policy 0, policy_version 196115 (0.0008) [2023-12-26 01:08:58,123][123090] Updated weights for policy 1, policy_version 195292 (0.0011) [2023-12-26 01:08:58,174][123091] Updated weights for policy 0, policy_version 196125 (0.0008) [2023-12-26 01:08:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17613.3, 300 sec: 17689.2). Total num frames: 100204544. Throughput: 0: 9011.7, 1: 8621.2. Samples: 100202760. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:08:58,785][121949] Avg episode reward: [(0, '5765.211'), (1, '5647.068')] [2023-12-26 01:08:58,978][123090] Updated weights for policy 1, policy_version 195302 (0.0010) [2023-12-26 01:08:59,044][123090] Updated weights for policy 1, policy_version 195312 (0.0009) [2023-12-26 01:08:59,064][123091] Updated weights for policy 0, policy_version 196135 (0.0008) [2023-12-26 01:08:59,112][123090] Updated weights for policy 1, policy_version 195322 (0.0006) [2023-12-26 01:08:59,133][123091] Updated weights for policy 0, policy_version 196145 (0.0006) [2023-12-26 01:08:59,185][123091] Updated weights for policy 0, policy_version 196155 (0.0005) [2023-12-26 01:08:59,841][123090] Updated weights for policy 1, policy_version 195332 (0.0006) [2023-12-26 01:08:59,913][123090] Updated weights for policy 1, policy_version 195343 (0.0010) [2023-12-26 01:08:59,918][123091] Updated weights for policy 0, policy_version 196165 (0.0008) [2023-12-26 01:08:59,982][123090] Updated weights for policy 1, policy_version 195353 (0.0011) [2023-12-26 01:08:59,984][123091] Updated weights for policy 0, policy_version 196175 (0.0008) [2023-12-26 01:09:00,040][123091] Updated weights for policy 0, policy_version 196185 (0.0008) [2023-12-26 01:09:00,794][123091] Updated weights for policy 0, policy_version 196195 (0.0007) [2023-12-26 01:09:00,797][123090] Updated weights for policy 1, policy_version 195363 (0.0009) [2023-12-26 01:09:00,856][123091] Updated weights for policy 0, policy_version 196205 (0.0005) [2023-12-26 01:09:00,860][123090] Updated weights for policy 1, policy_version 195373 (0.0010) [2023-12-26 01:09:00,913][123091] Updated weights for policy 0, policy_version 196215 (0.0007) [2023-12-26 01:09:00,918][123090] Updated weights for policy 1, policy_version 195383 (0.0010) [2023-12-26 01:09:01,719][123091] Updated weights for policy 0, policy_version 196225 (0.0006) [2023-12-26 01:09:01,746][123090] Updated weights for policy 1, policy_version 195393 (0.0010) [2023-12-26 01:09:01,788][123091] Updated weights for policy 0, policy_version 196235 (0.0008) [2023-12-26 01:09:01,803][123090] Updated weights for policy 1, policy_version 195403 (0.0005) [2023-12-26 01:09:01,849][123091] Updated weights for policy 0, policy_version 196245 (0.0008) [2023-12-26 01:09:01,863][123090] Updated weights for policy 1, policy_version 195413 (0.0009) [2023-12-26 01:09:01,907][123091] Updated weights for policy 0, policy_version 196255 (0.0008) [2023-12-26 01:09:01,927][123090] Updated weights for policy 1, policy_version 195423 (0.0008) [2023-12-26 01:09:02,677][123091] Updated weights for policy 0, policy_version 196265 (0.0007) [2023-12-26 01:09:02,755][123091] Updated weights for policy 0, policy_version 196275 (0.0005) [2023-12-26 01:09:02,783][123090] Updated weights for policy 1, policy_version 195433 (0.0006) [2023-12-26 01:09:02,821][123091] Updated weights for policy 0, policy_version 196285 (0.0006) [2023-12-26 01:09:02,850][123090] Updated weights for policy 1, policy_version 195443 (0.0005) [2023-12-26 01:09:02,907][123090] Updated weights for policy 1, policy_version 195453 (0.0005) [2023-12-26 01:09:03,483][123091] Updated weights for policy 0, policy_version 196295 (0.0008) [2023-12-26 01:09:03,534][123091] Updated weights for policy 0, policy_version 196305 (0.0009) [2023-12-26 01:09:03,584][123091] Updated weights for policy 0, policy_version 196315 (0.0009) [2023-12-26 01:09:03,650][123090] Updated weights for policy 1, policy_version 195463 (0.0005) [2023-12-26 01:09:03,700][123090] Updated weights for policy 1, policy_version 195473 (0.0005) [2023-12-26 01:09:03,745][123090] Updated weights for policy 1, policy_version 195483 (0.0005) [2023-12-26 01:09:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 100302848. Throughput: 0: 8966.7, 1: 8642.7. Samples: 100308508. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:09:03,785][121949] Avg episode reward: [(0, '5765.587'), (1, '5638.007')] [2023-12-26 01:09:04,497][123091] Updated weights for policy 0, policy_version 196325 (0.0010) [2023-12-26 01:09:04,512][123090] Updated weights for policy 1, policy_version 195493 (0.0005) [2023-12-26 01:09:04,550][123091] Updated weights for policy 0, policy_version 196335 (0.0009) [2023-12-26 01:09:04,574][123090] Updated weights for policy 1, policy_version 195503 (0.0005) [2023-12-26 01:09:04,605][123091] Updated weights for policy 0, policy_version 196345 (0.0009) [2023-12-26 01:09:04,631][123090] Updated weights for policy 1, policy_version 195513 (0.0008) [2023-12-26 01:09:05,337][123090] Updated weights for policy 1, policy_version 195523 (0.0006) [2023-12-26 01:09:05,368][123091] Updated weights for policy 0, policy_version 196355 (0.0007) [2023-12-26 01:09:05,391][123090] Updated weights for policy 1, policy_version 195533 (0.0006) [2023-12-26 01:09:05,430][123091] Updated weights for policy 0, policy_version 196365 (0.0008) [2023-12-26 01:09:05,438][123090] Updated weights for policy 1, policy_version 195543 (0.0008) [2023-12-26 01:09:05,495][123091] Updated weights for policy 0, policy_version 196375 (0.0010) [2023-12-26 01:09:06,260][123091] Updated weights for policy 0, policy_version 196385 (0.0010) [2023-12-26 01:09:06,268][123090] Updated weights for policy 1, policy_version 195553 (0.0009) [2023-12-26 01:09:06,321][123091] Updated weights for policy 0, policy_version 196395 (0.0009) [2023-12-26 01:09:06,338][123090] Updated weights for policy 1, policy_version 195563 (0.0009) [2023-12-26 01:09:06,381][123091] Updated weights for policy 0, policy_version 196405 (0.0010) [2023-12-26 01:09:06,406][123090] Updated weights for policy 1, policy_version 195573 (0.0008) [2023-12-26 01:09:06,445][123091] Updated weights for policy 0, policy_version 196415 (0.0009) [2023-12-26 01:09:06,473][123090] Updated weights for policy 1, policy_version 195583 (0.0008) [2023-12-26 01:09:07,235][123090] Updated weights for policy 1, policy_version 195593 (0.0007) [2023-12-26 01:09:07,287][123090] Updated weights for policy 1, policy_version 195603 (0.0007) [2023-12-26 01:09:07,294][123091] Updated weights for policy 0, policy_version 196425 (0.0010) [2023-12-26 01:09:07,348][123091] Updated weights for policy 0, policy_version 196435 (0.0008) [2023-12-26 01:09:07,350][123090] Updated weights for policy 1, policy_version 195613 (0.0008) [2023-12-26 01:09:07,403][123091] Updated weights for policy 0, policy_version 196445 (0.0009) [2023-12-26 01:09:08,181][123090] Updated weights for policy 1, policy_version 195623 (0.0009) [2023-12-26 01:09:08,205][123091] Updated weights for policy 0, policy_version 196455 (0.0008) [2023-12-26 01:09:08,243][123090] Updated weights for policy 1, policy_version 195633 (0.0009) [2023-12-26 01:09:08,253][123091] Updated weights for policy 0, policy_version 196465 (0.0009) [2023-12-26 01:09:08,305][123091] Updated weights for policy 0, policy_version 196475 (0.0007) [2023-12-26 01:09:08,306][123090] Updated weights for policy 1, policy_version 195643 (0.0009) [2023-12-26 01:09:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 100384768. Throughput: 0: 8979.0, 1: 8708.1. Samples: 100361760. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:09:08,786][121949] Avg episode reward: [(0, '5727.803'), (1, '5616.504')] [2023-12-26 01:09:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000196480_50298880.pth... [2023-12-26 01:09:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000195648_50085888.pth... [2023-12-26 01:09:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000195456_50036736.pth [2023-12-26 01:09:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000194624_49823744.pth [2023-12-26 01:09:09,127][123090] Updated weights for policy 1, policy_version 195653 (0.0008) [2023-12-26 01:09:09,159][123091] Updated weights for policy 0, policy_version 196485 (0.0009) [2023-12-26 01:09:09,193][123090] Updated weights for policy 1, policy_version 195663 (0.0009) [2023-12-26 01:09:09,209][123091] Updated weights for policy 0, policy_version 196495 (0.0008) [2023-12-26 01:09:09,265][123090] Updated weights for policy 1, policy_version 195673 (0.0008) [2023-12-26 01:09:09,275][123091] Updated weights for policy 0, policy_version 196505 (0.0009) [2023-12-26 01:09:10,105][123091] Updated weights for policy 0, policy_version 196515 (0.0009) [2023-12-26 01:09:10,143][123090] Updated weights for policy 1, policy_version 195683 (0.0008) [2023-12-26 01:09:10,170][123091] Updated weights for policy 0, policy_version 196525 (0.0007) [2023-12-26 01:09:10,210][123090] Updated weights for policy 1, policy_version 195693 (0.0008) [2023-12-26 01:09:10,232][123091] Updated weights for policy 0, policy_version 196535 (0.0006) [2023-12-26 01:09:10,276][123090] Updated weights for policy 1, policy_version 195703 (0.0009) [2023-12-26 01:09:11,020][123090] Updated weights for policy 1, policy_version 195713 (0.0009) [2023-12-26 01:09:11,040][123091] Updated weights for policy 0, policy_version 196545 (0.0007) [2023-12-26 01:09:11,093][123090] Updated weights for policy 1, policy_version 195723 (0.0006) [2023-12-26 01:09:11,115][123091] Updated weights for policy 0, policy_version 196555 (0.0007) [2023-12-26 01:09:11,168][123090] Updated weights for policy 1, policy_version 195733 (0.0008) [2023-12-26 01:09:11,180][123091] Updated weights for policy 0, policy_version 196565 (0.0008) [2023-12-26 01:09:11,231][123090] Updated weights for policy 1, policy_version 195743 (0.0008) [2023-12-26 01:09:11,233][123091] Updated weights for policy 0, policy_version 196575 (0.0010) [2023-12-26 01:09:12,062][123091] Updated weights for policy 0, policy_version 196585 (0.0009) [2023-12-26 01:09:12,113][123091] Updated weights for policy 0, policy_version 196595 (0.0009) [2023-12-26 01:09:12,116][123090] Updated weights for policy 1, policy_version 195753 (0.0007) [2023-12-26 01:09:12,168][123090] Updated weights for policy 1, policy_version 195763 (0.0008) [2023-12-26 01:09:12,180][123091] Updated weights for policy 0, policy_version 196605 (0.0009) [2023-12-26 01:09:12,232][123090] Updated weights for policy 1, policy_version 195773 (0.0010) [2023-12-26 01:09:13,017][123091] Updated weights for policy 0, policy_version 196615 (0.0009) [2023-12-26 01:09:13,080][123091] Updated weights for policy 0, policy_version 196625 (0.0010) [2023-12-26 01:09:13,087][123090] Updated weights for policy 1, policy_version 195783 (0.0007) [2023-12-26 01:09:13,138][123091] Updated weights for policy 0, policy_version 196635 (0.0007) [2023-12-26 01:09:13,152][123090] Updated weights for policy 1, policy_version 195793 (0.0009) [2023-12-26 01:09:13,216][123090] Updated weights for policy 1, policy_version 195803 (0.0010) [2023-12-26 01:09:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 100466688. Throughput: 0: 8861.8, 1: 8619.9. Samples: 100463944. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:09:13,785][121949] Avg episode reward: [(0, '5778.061'), (1, '5650.169')] [2023-12-26 01:09:13,983][123091] Updated weights for policy 0, policy_version 196645 (0.0008) [2023-12-26 01:09:14,007][123090] Updated weights for policy 1, policy_version 195813 (0.0008) [2023-12-26 01:09:14,040][123091] Updated weights for policy 0, policy_version 196655 (0.0008) [2023-12-26 01:09:14,070][123090] Updated weights for policy 1, policy_version 195823 (0.0008) [2023-12-26 01:09:14,103][123091] Updated weights for policy 0, policy_version 196665 (0.0008) [2023-12-26 01:09:14,132][123090] Updated weights for policy 1, policy_version 195833 (0.0009) [2023-12-26 01:09:14,912][123091] Updated weights for policy 0, policy_version 196675 (0.0007) [2023-12-26 01:09:14,946][123090] Updated weights for policy 1, policy_version 195843 (0.0010) [2023-12-26 01:09:14,974][123091] Updated weights for policy 0, policy_version 196685 (0.0008) [2023-12-26 01:09:15,017][123090] Updated weights for policy 1, policy_version 195853 (0.0010) [2023-12-26 01:09:15,043][123091] Updated weights for policy 0, policy_version 196695 (0.0010) [2023-12-26 01:09:15,085][123090] Updated weights for policy 1, policy_version 195863 (0.0009) [2023-12-26 01:09:15,858][123091] Updated weights for policy 0, policy_version 196705 (0.0007) [2023-12-26 01:09:15,893][123090] Updated weights for policy 1, policy_version 195873 (0.0009) [2023-12-26 01:09:15,919][123091] Updated weights for policy 0, policy_version 196715 (0.0009) [2023-12-26 01:09:15,946][123090] Updated weights for policy 1, policy_version 195883 (0.0008) [2023-12-26 01:09:15,982][123091] Updated weights for policy 0, policy_version 196725 (0.0008) [2023-12-26 01:09:15,998][123090] Updated weights for policy 1, policy_version 195893 (0.0007) [2023-12-26 01:09:16,030][123091] Updated weights for policy 0, policy_version 196735 (0.0007) [2023-12-26 01:09:16,050][123090] Updated weights for policy 1, policy_version 195903 (0.0007) [2023-12-26 01:09:16,869][123090] Updated weights for policy 1, policy_version 195913 (0.0006) [2023-12-26 01:09:16,876][123091] Updated weights for policy 0, policy_version 196745 (0.0009) [2023-12-26 01:09:16,918][123090] Updated weights for policy 1, policy_version 195923 (0.0005) [2023-12-26 01:09:16,925][123091] Updated weights for policy 0, policy_version 196755 (0.0009) [2023-12-26 01:09:16,975][123090] Updated weights for policy 1, policy_version 195933 (0.0005) [2023-12-26 01:09:16,985][123091] Updated weights for policy 0, policy_version 196765 (0.0009) [2023-12-26 01:09:17,548][123090] Updated weights for policy 1, policy_version 195943 (0.0008) [2023-12-26 01:09:17,612][123090] Updated weights for policy 1, policy_version 195953 (0.0009) [2023-12-26 01:09:17,677][123090] Updated weights for policy 1, policy_version 195963 (0.0009) [2023-12-26 01:09:17,853][123091] Updated weights for policy 0, policy_version 196775 (0.0009) [2023-12-26 01:09:17,909][123091] Updated weights for policy 0, policy_version 196785 (0.0009) [2023-12-26 01:09:17,967][123091] Updated weights for policy 0, policy_version 196795 (0.0010) [2023-12-26 01:09:18,522][123090] Updated weights for policy 1, policy_version 195973 (0.0010) [2023-12-26 01:09:18,578][123090] Updated weights for policy 1, policy_version 195983 (0.0009) [2023-12-26 01:09:18,635][123090] Updated weights for policy 1, policy_version 195993 (0.0009) [2023-12-26 01:09:18,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 100556800. Throughput: 0: 8750.7, 1: 8712.5. Samples: 100567700. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:09:18,785][121949] Avg episode reward: [(0, '5879.592'), (1, '5551.226')] [2023-12-26 01:09:18,798][123091] Updated weights for policy 0, policy_version 196805 (0.0009) [2023-12-26 01:09:18,857][123091] Updated weights for policy 0, policy_version 196815 (0.0010) [2023-12-26 01:09:18,910][123091] Updated weights for policy 0, policy_version 196825 (0.0009) [2023-12-26 01:09:19,515][123090] Updated weights for policy 1, policy_version 196004 (0.0010) [2023-12-26 01:09:19,573][123090] Updated weights for policy 1, policy_version 196014 (0.0009) [2023-12-26 01:09:19,629][123090] Updated weights for policy 1, policy_version 196024 (0.0010) [2023-12-26 01:09:19,762][123091] Updated weights for policy 0, policy_version 196835 (0.0009) [2023-12-26 01:09:19,831][123091] Updated weights for policy 0, policy_version 196845 (0.0008) [2023-12-26 01:09:19,912][123091] Updated weights for policy 0, policy_version 196855 (0.0007) [2023-12-26 01:09:20,519][123090] Updated weights for policy 1, policy_version 196034 (0.0009) [2023-12-26 01:09:20,596][123090] Updated weights for policy 1, policy_version 196044 (0.0010) [2023-12-26 01:09:20,609][123091] Updated weights for policy 0, policy_version 196865 (0.0010) [2023-12-26 01:09:20,664][123090] Updated weights for policy 1, policy_version 196054 (0.0010) [2023-12-26 01:09:20,680][123091] Updated weights for policy 0, policy_version 196875 (0.0007) [2023-12-26 01:09:20,726][123090] Updated weights for policy 1, policy_version 196064 (0.0008) [2023-12-26 01:09:20,746][123091] Updated weights for policy 0, policy_version 196885 (0.0009) [2023-12-26 01:09:20,815][123091] Updated weights for policy 0, policy_version 196895 (0.0008) [2023-12-26 01:09:21,565][123090] Updated weights for policy 1, policy_version 196074 (0.0009) [2023-12-26 01:09:21,566][123091] Updated weights for policy 0, policy_version 196905 (0.0008) [2023-12-26 01:09:21,633][123090] Updated weights for policy 1, policy_version 196084 (0.0008) [2023-12-26 01:09:21,634][123091] Updated weights for policy 0, policy_version 196915 (0.0008) [2023-12-26 01:09:21,705][123091] Updated weights for policy 0, policy_version 196925 (0.0006) [2023-12-26 01:09:21,708][123090] Updated weights for policy 1, policy_version 196094 (0.0008) [2023-12-26 01:09:22,516][123090] Updated weights for policy 1, policy_version 196104 (0.0006) [2023-12-26 01:09:22,519][123091] Updated weights for policy 0, policy_version 196935 (0.0007) [2023-12-26 01:09:22,576][123090] Updated weights for policy 1, policy_version 196114 (0.0005) [2023-12-26 01:09:22,581][123091] Updated weights for policy 0, policy_version 196945 (0.0008) [2023-12-26 01:09:22,637][123090] Updated weights for policy 1, policy_version 196124 (0.0005) [2023-12-26 01:09:22,644][123091] Updated weights for policy 0, policy_version 196955 (0.0009) [2023-12-26 01:09:23,257][123091] Updated weights for policy 0, policy_version 196965 (0.0008) [2023-12-26 01:09:23,317][123091] Updated weights for policy 0, policy_version 196975 (0.0008) [2023-12-26 01:09:23,371][123091] Updated weights for policy 0, policy_version 196986 (0.0009) [2023-12-26 01:09:23,421][123090] Updated weights for policy 1, policy_version 196134 (0.0008) [2023-12-26 01:09:23,484][123090] Updated weights for policy 1, policy_version 196144 (0.0011) [2023-12-26 01:09:23,536][123090] Updated weights for policy 1, policy_version 196154 (0.0010) [2023-12-26 01:09:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 100646912. Throughput: 0: 8784.6, 1: 8689.4. Samples: 100618984. Policy #0 lag: (min: 31.0, avg: 40.8, max: 63.0) [2023-12-26 01:09:23,785][121949] Avg episode reward: [(0, '5826.084'), (1, '5515.565')] [2023-12-26 01:09:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000196992_50429952.pth... [2023-12-26 01:09:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000196160_50216960.pth... [2023-12-26 01:09:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000195968_50167808.pth [2023-12-26 01:09:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000195136_49954816.pth [2023-12-26 01:09:24,265][123091] Updated weights for policy 0, policy_version 196996 (0.0008) [2023-12-26 01:09:24,272][123090] Updated weights for policy 1, policy_version 196164 (0.0008) [2023-12-26 01:09:24,314][123091] Updated weights for policy 0, policy_version 197006 (0.0009) [2023-12-26 01:09:24,327][123090] Updated weights for policy 1, policy_version 196174 (0.0005) [2023-12-26 01:09:24,378][123091] Updated weights for policy 0, policy_version 197016 (0.0009) [2023-12-26 01:09:24,391][123090] Updated weights for policy 1, policy_version 196184 (0.0005) [2023-12-26 01:09:24,980][123090] Updated weights for policy 1, policy_version 196194 (0.0005) [2023-12-26 01:09:25,033][123090] Updated weights for policy 1, policy_version 196204 (0.0006) [2023-12-26 01:09:25,086][123090] Updated weights for policy 1, policy_version 196214 (0.0005) [2023-12-26 01:09:25,160][123090] Updated weights for policy 1, policy_version 196224 (0.0005) [2023-12-26 01:09:25,304][123091] Updated weights for policy 0, policy_version 197026 (0.0009) [2023-12-26 01:09:25,367][123091] Updated weights for policy 0, policy_version 197036 (0.0009) [2023-12-26 01:09:25,429][123091] Updated weights for policy 0, policy_version 197046 (0.0009) [2023-12-26 01:09:25,487][123091] Updated weights for policy 0, policy_version 197056 (0.0009) [2023-12-26 01:09:25,922][123090] Updated weights for policy 1, policy_version 196234 (0.0010) [2023-12-26 01:09:25,983][123090] Updated weights for policy 1, policy_version 196244 (0.0010) [2023-12-26 01:09:26,038][123090] Updated weights for policy 1, policy_version 196254 (0.0010) [2023-12-26 01:09:26,308][123091] Updated weights for policy 0, policy_version 197066 (0.0009) [2023-12-26 01:09:26,376][123091] Updated weights for policy 0, policy_version 197076 (0.0009) [2023-12-26 01:09:26,443][123091] Updated weights for policy 0, policy_version 197086 (0.0009) [2023-12-26 01:09:26,853][123090] Updated weights for policy 1, policy_version 196264 (0.0006) [2023-12-26 01:09:26,898][123090] Updated weights for policy 1, policy_version 196274 (0.0005) [2023-12-26 01:09:26,968][123090] Updated weights for policy 1, policy_version 196284 (0.0005) [2023-12-26 01:09:27,278][123091] Updated weights for policy 0, policy_version 197096 (0.0010) [2023-12-26 01:09:27,332][123091] Updated weights for policy 0, policy_version 197106 (0.0009) [2023-12-26 01:09:27,389][123091] Updated weights for policy 0, policy_version 197116 (0.0010) [2023-12-26 01:09:27,636][123090] Updated weights for policy 1, policy_version 196294 (0.0005) [2023-12-26 01:09:27,686][123090] Updated weights for policy 1, policy_version 196304 (0.0005) [2023-12-26 01:09:27,738][123090] Updated weights for policy 1, policy_version 196314 (0.0005) [2023-12-26 01:09:28,160][123091] Updated weights for policy 0, policy_version 197126 (0.0008) [2023-12-26 01:09:28,211][123091] Updated weights for policy 0, policy_version 197136 (0.0005) [2023-12-26 01:09:28,268][123091] Updated weights for policy 0, policy_version 197146 (0.0005) [2023-12-26 01:09:28,402][123090] Updated weights for policy 1, policy_version 196324 (0.0007) [2023-12-26 01:09:28,460][123090] Updated weights for policy 1, policy_version 196334 (0.0009) [2023-12-26 01:09:28,507][123090] Updated weights for policy 1, policy_version 196344 (0.0010) [2023-12-26 01:09:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 100737024. Throughput: 0: 8752.7, 1: 8822.6. Samples: 100726928. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:28,785][121949] Avg episode reward: [(0, '5819.891'), (1, '5474.210')] [2023-12-26 01:09:29,070][123091] Updated weights for policy 0, policy_version 197156 (0.0006) [2023-12-26 01:09:29,129][123091] Updated weights for policy 0, policy_version 197166 (0.0008) [2023-12-26 01:09:29,186][123091] Updated weights for policy 0, policy_version 197176 (0.0006) [2023-12-26 01:09:29,335][123090] Updated weights for policy 1, policy_version 196354 (0.0010) [2023-12-26 01:09:29,410][123090] Updated weights for policy 1, policy_version 196364 (0.0010) [2023-12-26 01:09:29,477][123090] Updated weights for policy 1, policy_version 196374 (0.0009) [2023-12-26 01:09:29,547][123090] Updated weights for policy 1, policy_version 196384 (0.0010) [2023-12-26 01:09:29,937][123091] Updated weights for policy 0, policy_version 197186 (0.0008) [2023-12-26 01:09:29,994][123091] Updated weights for policy 0, policy_version 197196 (0.0009) [2023-12-26 01:09:30,053][123091] Updated weights for policy 0, policy_version 197206 (0.0006) [2023-12-26 01:09:30,124][123091] Updated weights for policy 0, policy_version 197216 (0.0006) [2023-12-26 01:09:30,399][123090] Updated weights for policy 1, policy_version 196394 (0.0011) [2023-12-26 01:09:30,466][123090] Updated weights for policy 1, policy_version 196404 (0.0010) [2023-12-26 01:09:30,535][123090] Updated weights for policy 1, policy_version 196414 (0.0010) [2023-12-26 01:09:30,960][123091] Updated weights for policy 0, policy_version 197226 (0.0010) [2023-12-26 01:09:31,016][123091] Updated weights for policy 0, policy_version 197237 (0.0010) [2023-12-26 01:09:31,066][123091] Updated weights for policy 0, policy_version 197247 (0.0009) [2023-12-26 01:09:31,208][123090] Updated weights for policy 1, policy_version 196424 (0.0009) [2023-12-26 01:09:31,275][123090] Updated weights for policy 1, policy_version 196434 (0.0009) [2023-12-26 01:09:31,335][123090] Updated weights for policy 1, policy_version 196444 (0.0009) [2023-12-26 01:09:31,885][123091] Updated weights for policy 0, policy_version 197257 (0.0009) [2023-12-26 01:09:31,933][123091] Updated weights for policy 0, policy_version 197267 (0.0009) [2023-12-26 01:09:31,981][123091] Updated weights for policy 0, policy_version 197277 (0.0009) [2023-12-26 01:09:32,180][123090] Updated weights for policy 1, policy_version 196454 (0.0009) [2023-12-26 01:09:32,231][123090] Updated weights for policy 1, policy_version 196464 (0.0008) [2023-12-26 01:09:32,292][123090] Updated weights for policy 1, policy_version 196474 (0.0009) [2023-12-26 01:09:32,858][123091] Updated weights for policy 0, policy_version 197287 (0.0010) [2023-12-26 01:09:32,912][123091] Updated weights for policy 0, policy_version 197297 (0.0009) [2023-12-26 01:09:32,957][123091] Updated weights for policy 0, policy_version 197307 (0.0008) [2023-12-26 01:09:33,112][123090] Updated weights for policy 1, policy_version 196484 (0.0009) [2023-12-26 01:09:33,164][123090] Updated weights for policy 1, policy_version 196494 (0.0008) [2023-12-26 01:09:33,224][123090] Updated weights for policy 1, policy_version 196504 (0.0010) [2023-12-26 01:09:33,716][123091] Updated weights for policy 0, policy_version 197318 (0.0007) [2023-12-26 01:09:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 100818944. Throughput: 0: 8718.1, 1: 8809.6. Samples: 100833904. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:33,785][121949] Avg episode reward: [(0, '5780.787'), (1, '5439.658')] [2023-12-26 01:09:33,786][123091] Updated weights for policy 0, policy_version 197328 (0.0005) [2023-12-26 01:09:33,842][123091] Updated weights for policy 0, policy_version 197338 (0.0007) [2023-12-26 01:09:34,038][123090] Updated weights for policy 1, policy_version 196514 (0.0008) [2023-12-26 01:09:34,091][123090] Updated weights for policy 1, policy_version 196524 (0.0005) [2023-12-26 01:09:34,154][123090] Updated weights for policy 1, policy_version 196534 (0.0007) [2023-12-26 01:09:34,221][123090] Updated weights for policy 1, policy_version 196544 (0.0009) [2023-12-26 01:09:34,627][123091] Updated weights for policy 0, policy_version 197348 (0.0009) [2023-12-26 01:09:34,677][123091] Updated weights for policy 0, policy_version 197358 (0.0010) [2023-12-26 01:09:34,732][123091] Updated weights for policy 0, policy_version 197368 (0.0009) [2023-12-26 01:09:35,036][123090] Updated weights for policy 1, policy_version 196555 (0.0009) [2023-12-26 01:09:35,094][123090] Updated weights for policy 1, policy_version 196566 (0.0009) [2023-12-26 01:09:35,144][123090] Updated weights for policy 1, policy_version 196576 (0.0010) [2023-12-26 01:09:35,580][123091] Updated weights for policy 0, policy_version 197378 (0.0009) [2023-12-26 01:09:35,628][123091] Updated weights for policy 0, policy_version 197388 (0.0009) [2023-12-26 01:09:35,683][123091] Updated weights for policy 0, policy_version 197398 (0.0009) [2023-12-26 01:09:35,738][123091] Updated weights for policy 0, policy_version 197408 (0.0009) [2023-12-26 01:09:36,001][123090] Updated weights for policy 1, policy_version 196586 (0.0008) [2023-12-26 01:09:36,055][123090] Updated weights for policy 1, policy_version 196596 (0.0009) [2023-12-26 01:09:36,118][123090] Updated weights for policy 1, policy_version 196607 (0.0009) [2023-12-26 01:09:36,644][123091] Updated weights for policy 0, policy_version 197418 (0.0010) [2023-12-26 01:09:36,710][123091] Updated weights for policy 0, policy_version 197428 (0.0010) [2023-12-26 01:09:36,769][123091] Updated weights for policy 0, policy_version 197438 (0.0010) [2023-12-26 01:09:36,942][123090] Updated weights for policy 1, policy_version 196617 (0.0009) [2023-12-26 01:09:37,008][123090] Updated weights for policy 1, policy_version 196627 (0.0009) [2023-12-26 01:09:37,063][123090] Updated weights for policy 1, policy_version 196637 (0.0008) [2023-12-26 01:09:37,656][123091] Updated weights for policy 0, policy_version 197448 (0.0010) [2023-12-26 01:09:37,722][123091] Updated weights for policy 0, policy_version 197458 (0.0009) [2023-12-26 01:09:37,769][123091] Updated weights for policy 0, policy_version 197468 (0.0009) [2023-12-26 01:09:37,860][123090] Updated weights for policy 1, policy_version 196647 (0.0008) [2023-12-26 01:09:37,930][123090] Updated weights for policy 1, policy_version 196657 (0.0009) [2023-12-26 01:09:37,996][123090] Updated weights for policy 1, policy_version 196667 (0.0009) [2023-12-26 01:09:38,633][123091] Updated weights for policy 0, policy_version 197478 (0.0009) [2023-12-26 01:09:38,690][123091] Updated weights for policy 0, policy_version 197489 (0.0009) [2023-12-26 01:09:38,748][123091] Updated weights for policy 0, policy_version 197499 (0.0009) [2023-12-26 01:09:38,782][123090] Updated weights for policy 1, policy_version 196677 (0.0006) [2023-12-26 01:09:38,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 100909056. Throughput: 0: 8709.0, 1: 8826.3. Samples: 100886192. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:38,784][121949] Avg episode reward: [(0, '5742.791'), (1, '5342.200')] [2023-12-26 01:09:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000197504_50561024.pth... [2023-12-26 01:09:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000196480_50298880.pth [2023-12-26 01:09:38,839][123090] Updated weights for policy 1, policy_version 196687 (0.0008) [2023-12-26 01:09:38,899][123090] Updated weights for policy 1, policy_version 196697 (0.0011) [2023-12-26 01:09:38,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000196704_50356224.pth... [2023-12-26 01:09:38,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000195648_50085888.pth [2023-12-26 01:09:39,634][123090] Updated weights for policy 1, policy_version 196707 (0.0011) [2023-12-26 01:09:39,662][123091] Updated weights for policy 0, policy_version 197509 (0.0010) [2023-12-26 01:09:39,691][123090] Updated weights for policy 1, policy_version 196717 (0.0011) [2023-12-26 01:09:39,726][123091] Updated weights for policy 0, policy_version 197519 (0.0008) [2023-12-26 01:09:39,743][123090] Updated weights for policy 1, policy_version 196727 (0.0006) [2023-12-26 01:09:39,793][123091] Updated weights for policy 0, policy_version 197529 (0.0010) [2023-12-26 01:09:40,565][123090] Updated weights for policy 1, policy_version 196737 (0.0006) [2023-12-26 01:09:40,578][123091] Updated weights for policy 0, policy_version 197539 (0.0008) [2023-12-26 01:09:40,617][123090] Updated weights for policy 1, policy_version 196747 (0.0010) [2023-12-26 01:09:40,638][123091] Updated weights for policy 0, policy_version 197549 (0.0009) [2023-12-26 01:09:40,679][123090] Updated weights for policy 1, policy_version 196757 (0.0009) [2023-12-26 01:09:40,700][123091] Updated weights for policy 0, policy_version 197559 (0.0009) [2023-12-26 01:09:40,746][123090] Updated weights for policy 1, policy_version 196767 (0.0009) [2023-12-26 01:09:41,564][123091] Updated weights for policy 0, policy_version 197569 (0.0008) [2023-12-26 01:09:41,569][123090] Updated weights for policy 1, policy_version 196777 (0.0006) [2023-12-26 01:09:41,627][123091] Updated weights for policy 0, policy_version 197579 (0.0009) [2023-12-26 01:09:41,638][123090] Updated weights for policy 1, policy_version 196787 (0.0008) [2023-12-26 01:09:41,690][123091] Updated weights for policy 0, policy_version 197589 (0.0008) [2023-12-26 01:09:41,706][123090] Updated weights for policy 1, policy_version 196797 (0.0008) [2023-12-26 01:09:41,763][123091] Updated weights for policy 0, policy_version 197599 (0.0009) [2023-12-26 01:09:42,481][123090] Updated weights for policy 1, policy_version 196807 (0.0009) [2023-12-26 01:09:42,545][123090] Updated weights for policy 1, policy_version 196817 (0.0010) [2023-12-26 01:09:42,605][123091] Updated weights for policy 0, policy_version 197609 (0.0009) [2023-12-26 01:09:42,607][123090] Updated weights for policy 1, policy_version 196827 (0.0009) [2023-12-26 01:09:42,672][123091] Updated weights for policy 0, policy_version 197619 (0.0005) [2023-12-26 01:09:42,745][123091] Updated weights for policy 0, policy_version 197629 (0.0005) [2023-12-26 01:09:43,410][123091] Updated weights for policy 0, policy_version 197639 (0.0008) [2023-12-26 01:09:43,472][123091] Updated weights for policy 0, policy_version 197649 (0.0010) [2023-12-26 01:09:43,494][123090] Updated weights for policy 1, policy_version 196837 (0.0009) [2023-12-26 01:09:43,524][123091] Updated weights for policy 0, policy_version 197659 (0.0007) [2023-12-26 01:09:43,544][123090] Updated weights for policy 1, policy_version 196847 (0.0008) [2023-12-26 01:09:43,598][123090] Updated weights for policy 1, policy_version 196857 (0.0009) [2023-12-26 01:09:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 100999168. Throughput: 0: 8640.1, 1: 8808.1. Samples: 100987936. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:43,785][121949] Avg episode reward: [(0, '5791.003'), (1, '5366.018')] [2023-12-26 01:09:44,377][123091] Updated weights for policy 0, policy_version 197669 (0.0009) [2023-12-26 01:09:44,426][123091] Updated weights for policy 0, policy_version 197679 (0.0009) [2023-12-26 01:09:44,446][123090] Updated weights for policy 1, policy_version 196867 (0.0009) [2023-12-26 01:09:44,484][123091] Updated weights for policy 0, policy_version 197689 (0.0009) [2023-12-26 01:09:44,510][123090] Updated weights for policy 1, policy_version 196877 (0.0008) [2023-12-26 01:09:44,574][123090] Updated weights for policy 1, policy_version 196888 (0.0008) [2023-12-26 01:09:45,388][123090] Updated weights for policy 1, policy_version 196898 (0.0008) [2023-12-26 01:09:45,396][123091] Updated weights for policy 0, policy_version 197699 (0.0010) [2023-12-26 01:09:45,440][123090] Updated weights for policy 1, policy_version 196908 (0.0007) [2023-12-26 01:09:45,442][123091] Updated weights for policy 0, policy_version 197709 (0.0009) [2023-12-26 01:09:45,502][123091] Updated weights for policy 0, policy_version 197719 (0.0007) [2023-12-26 01:09:45,510][123090] Updated weights for policy 1, policy_version 196918 (0.0008) [2023-12-26 01:09:45,576][123090] Updated weights for policy 1, policy_version 196928 (0.0010) [2023-12-26 01:09:46,276][123091] Updated weights for policy 0, policy_version 197729 (0.0006) [2023-12-26 01:09:46,328][123091] Updated weights for policy 0, policy_version 197739 (0.0009) [2023-12-26 01:09:46,376][123091] Updated weights for policy 0, policy_version 197749 (0.0010) [2023-12-26 01:09:46,421][123091] Updated weights for policy 0, policy_version 197759 (0.0008) [2023-12-26 01:09:46,428][123090] Updated weights for policy 1, policy_version 196938 (0.0008) [2023-12-26 01:09:46,480][123090] Updated weights for policy 1, policy_version 196948 (0.0008) [2023-12-26 01:09:46,544][123090] Updated weights for policy 1, policy_version 196958 (0.0008) [2023-12-26 01:09:47,291][123091] Updated weights for policy 0, policy_version 197769 (0.0009) [2023-12-26 01:09:47,349][123091] Updated weights for policy 0, policy_version 197779 (0.0010) [2023-12-26 01:09:47,397][123091] Updated weights for policy 0, policy_version 197789 (0.0009) [2023-12-26 01:09:47,401][123090] Updated weights for policy 1, policy_version 196968 (0.0006) [2023-12-26 01:09:47,450][123090] Updated weights for policy 1, policy_version 196978 (0.0005) [2023-12-26 01:09:47,498][123090] Updated weights for policy 1, policy_version 196988 (0.0008) [2023-12-26 01:09:48,264][123091] Updated weights for policy 0, policy_version 197799 (0.0009) [2023-12-26 01:09:48,288][123090] Updated weights for policy 1, policy_version 196998 (0.0008) [2023-12-26 01:09:48,318][123091] Updated weights for policy 0, policy_version 197809 (0.0007) [2023-12-26 01:09:48,350][123090] Updated weights for policy 1, policy_version 197008 (0.0009) [2023-12-26 01:09:48,376][123091] Updated weights for policy 0, policy_version 197819 (0.0007) [2023-12-26 01:09:48,417][123090] Updated weights for policy 1, policy_version 197018 (0.0008) [2023-12-26 01:09:48,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 101081088. Throughput: 0: 8609.9, 1: 8791.4. Samples: 101091568. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:48,786][121949] Avg episode reward: [(0, '5822.931'), (1, '5301.580')] [2023-12-26 01:09:49,148][123091] Updated weights for policy 0, policy_version 197829 (0.0009) [2023-12-26 01:09:49,213][123091] Updated weights for policy 0, policy_version 197839 (0.0009) [2023-12-26 01:09:49,215][123090] Updated weights for policy 1, policy_version 197028 (0.0008) [2023-12-26 01:09:49,283][123091] Updated weights for policy 0, policy_version 197849 (0.0010) [2023-12-26 01:09:49,285][123090] Updated weights for policy 1, policy_version 197038 (0.0008) [2023-12-26 01:09:49,357][123090] Updated weights for policy 1, policy_version 197048 (0.0007) [2023-12-26 01:09:50,110][123091] Updated weights for policy 0, policy_version 197859 (0.0009) [2023-12-26 01:09:50,152][123090] Updated weights for policy 1, policy_version 197058 (0.0008) [2023-12-26 01:09:50,185][123091] Updated weights for policy 0, policy_version 197869 (0.0011) [2023-12-26 01:09:50,220][123090] Updated weights for policy 1, policy_version 197068 (0.0008) [2023-12-26 01:09:50,249][123091] Updated weights for policy 0, policy_version 197879 (0.0006) [2023-12-26 01:09:50,283][123090] Updated weights for policy 1, policy_version 197078 (0.0007) [2023-12-26 01:09:50,353][123090] Updated weights for policy 1, policy_version 197088 (0.0005) [2023-12-26 01:09:50,964][123091] Updated weights for policy 0, policy_version 197889 (0.0006) [2023-12-26 01:09:51,024][123091] Updated weights for policy 0, policy_version 197899 (0.0011) [2023-12-26 01:09:51,096][123091] Updated weights for policy 0, policy_version 197909 (0.0011) [2023-12-26 01:09:51,117][123090] Updated weights for policy 1, policy_version 197098 (0.0009) [2023-12-26 01:09:51,166][123091] Updated weights for policy 0, policy_version 197919 (0.0010) [2023-12-26 01:09:51,187][123090] Updated weights for policy 1, policy_version 197108 (0.0007) [2023-12-26 01:09:51,262][123090] Updated weights for policy 1, policy_version 197118 (0.0010) [2023-12-26 01:09:51,960][123091] Updated weights for policy 0, policy_version 197929 (0.0009) [2023-12-26 01:09:52,016][123091] Updated weights for policy 0, policy_version 197939 (0.0011) [2023-12-26 01:09:52,061][123090] Updated weights for policy 1, policy_version 197128 (0.0008) [2023-12-26 01:09:52,068][123091] Updated weights for policy 0, policy_version 197949 (0.0010) [2023-12-26 01:09:52,124][123090] Updated weights for policy 1, policy_version 197138 (0.0008) [2023-12-26 01:09:52,198][123090] Updated weights for policy 1, policy_version 197148 (0.0008) [2023-12-26 01:09:52,925][123091] Updated weights for policy 0, policy_version 197959 (0.0010) [2023-12-26 01:09:52,969][123090] Updated weights for policy 1, policy_version 197158 (0.0007) [2023-12-26 01:09:52,985][123091] Updated weights for policy 0, policy_version 197969 (0.0011) [2023-12-26 01:09:53,022][123090] Updated weights for policy 1, policy_version 197168 (0.0008) [2023-12-26 01:09:53,038][123091] Updated weights for policy 0, policy_version 197979 (0.0008) [2023-12-26 01:09:53,084][123090] Updated weights for policy 1, policy_version 197178 (0.0010) [2023-12-26 01:09:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 101163008. Throughput: 0: 8626.7, 1: 8770.3. Samples: 101144620. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:53,785][121949] Avg episode reward: [(0, '5756.061'), (1, '5448.770')] [2023-12-26 01:09:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000197984_50683904.pth... [2023-12-26 01:09:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000197184_50479104.pth... [2023-12-26 01:09:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000196160_50216960.pth [2023-12-26 01:09:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000196992_50429952.pth [2023-12-26 01:09:53,845][123091] Updated weights for policy 0, policy_version 197989 (0.0007) [2023-12-26 01:09:53,891][123091] Updated weights for policy 0, policy_version 197999 (0.0008) [2023-12-26 01:09:53,919][123090] Updated weights for policy 1, policy_version 197188 (0.0009) [2023-12-26 01:09:53,941][123091] Updated weights for policy 0, policy_version 198009 (0.0008) [2023-12-26 01:09:53,978][123090] Updated weights for policy 1, policy_version 197198 (0.0010) [2023-12-26 01:09:54,030][123090] Updated weights for policy 1, policy_version 197208 (0.0009) [2023-12-26 01:09:54,658][123091] Updated weights for policy 0, policy_version 198019 (0.0006) [2023-12-26 01:09:54,721][123091] Updated weights for policy 0, policy_version 198029 (0.0009) [2023-12-26 01:09:54,736][123090] Updated weights for policy 1, policy_version 197218 (0.0005) [2023-12-26 01:09:54,784][123091] Updated weights for policy 0, policy_version 198039 (0.0008) [2023-12-26 01:09:54,795][123090] Updated weights for policy 1, policy_version 197228 (0.0007) [2023-12-26 01:09:54,856][123090] Updated weights for policy 1, policy_version 197238 (0.0007) [2023-12-26 01:09:54,932][123090] Updated weights for policy 1, policy_version 197248 (0.0006) [2023-12-26 01:09:55,628][123090] Updated weights for policy 1, policy_version 197258 (0.0005) [2023-12-26 01:09:55,656][123091] Updated weights for policy 0, policy_version 198049 (0.0008) [2023-12-26 01:09:55,701][123090] Updated weights for policy 1, policy_version 197268 (0.0006) [2023-12-26 01:09:55,707][123091] Updated weights for policy 0, policy_version 198059 (0.0010) [2023-12-26 01:09:55,754][123091] Updated weights for policy 0, policy_version 198069 (0.0010) [2023-12-26 01:09:55,759][123090] Updated weights for policy 1, policy_version 197278 (0.0006) [2023-12-26 01:09:55,824][123091] Updated weights for policy 0, policy_version 198079 (0.0005) [2023-12-26 01:09:56,331][123090] Updated weights for policy 1, policy_version 197288 (0.0005) [2023-12-26 01:09:56,401][123090] Updated weights for policy 1, policy_version 197298 (0.0005) [2023-12-26 01:09:56,468][123090] Updated weights for policy 1, policy_version 197308 (0.0005) [2023-12-26 01:09:56,536][123091] Updated weights for policy 0, policy_version 198089 (0.0005) [2023-12-26 01:09:56,590][123091] Updated weights for policy 0, policy_version 198099 (0.0005) [2023-12-26 01:09:56,643][123091] Updated weights for policy 0, policy_version 198109 (0.0005) [2023-12-26 01:09:57,068][123090] Updated weights for policy 1, policy_version 197318 (0.0007) [2023-12-26 01:09:57,114][123090] Updated weights for policy 1, policy_version 197328 (0.0007) [2023-12-26 01:09:57,163][123090] Updated weights for policy 1, policy_version 197338 (0.0005) [2023-12-26 01:09:57,367][123091] Updated weights for policy 0, policy_version 198119 (0.0009) [2023-12-26 01:09:57,428][123091] Updated weights for policy 0, policy_version 198129 (0.0008) [2023-12-26 01:09:57,495][123091] Updated weights for policy 0, policy_version 198139 (0.0005) [2023-12-26 01:09:57,905][123090] Updated weights for policy 1, policy_version 197348 (0.0005) [2023-12-26 01:09:57,965][123090] Updated weights for policy 1, policy_version 197358 (0.0005) [2023-12-26 01:09:58,038][123090] Updated weights for policy 1, policy_version 197368 (0.0008) [2023-12-26 01:09:58,297][123091] Updated weights for policy 0, policy_version 198149 (0.0009) [2023-12-26 01:09:58,361][123091] Updated weights for policy 0, policy_version 198159 (0.0010) [2023-12-26 01:09:58,428][123091] Updated weights for policy 0, policy_version 198169 (0.0008) [2023-12-26 01:09:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 101261312. Throughput: 0: 8685.9, 1: 8931.1. Samples: 101256708. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:09:58,785][121949] Avg episode reward: [(0, '5677.399'), (1, '5485.890')] [2023-12-26 01:09:58,858][123090] Updated weights for policy 1, policy_version 197378 (0.0008) [2023-12-26 01:09:58,917][123090] Updated weights for policy 1, policy_version 197388 (0.0008) [2023-12-26 01:09:58,972][123090] Updated weights for policy 1, policy_version 197398 (0.0008) [2023-12-26 01:09:59,042][123090] Updated weights for policy 1, policy_version 197408 (0.0008) [2023-12-26 01:09:59,339][123091] Updated weights for policy 0, policy_version 198179 (0.0009) [2023-12-26 01:09:59,432][123091] Updated weights for policy 0, policy_version 198189 (0.0006) [2023-12-26 01:09:59,502][123091] Updated weights for policy 0, policy_version 198199 (0.0005) [2023-12-26 01:09:59,867][123090] Updated weights for policy 1, policy_version 197418 (0.0009) [2023-12-26 01:09:59,928][123090] Updated weights for policy 1, policy_version 197428 (0.0007) [2023-12-26 01:09:59,989][123090] Updated weights for policy 1, policy_version 197438 (0.0006) [2023-12-26 01:10:00,101][123091] Updated weights for policy 0, policy_version 198209 (0.0009) [2023-12-26 01:10:00,151][123091] Updated weights for policy 0, policy_version 198219 (0.0008) [2023-12-26 01:10:00,206][123091] Updated weights for policy 0, policy_version 198229 (0.0008) [2023-12-26 01:10:00,260][123091] Updated weights for policy 0, policy_version 198239 (0.0008) [2023-12-26 01:10:00,705][123090] Updated weights for policy 1, policy_version 197448 (0.0007) [2023-12-26 01:10:00,767][123090] Updated weights for policy 1, policy_version 197458 (0.0010) [2023-12-26 01:10:00,823][123090] Updated weights for policy 1, policy_version 197468 (0.0009) [2023-12-26 01:10:00,922][123091] Updated weights for policy 0, policy_version 198249 (0.0008) [2023-12-26 01:10:00,987][123091] Updated weights for policy 0, policy_version 198259 (0.0009) [2023-12-26 01:10:01,060][123091] Updated weights for policy 0, policy_version 198269 (0.0008) [2023-12-26 01:10:01,631][123090] Updated weights for policy 1, policy_version 197478 (0.0008) [2023-12-26 01:10:01,700][123090] Updated weights for policy 1, policy_version 197488 (0.0009) [2023-12-26 01:10:01,764][123090] Updated weights for policy 1, policy_version 197498 (0.0009) [2023-12-26 01:10:01,853][123091] Updated weights for policy 0, policy_version 198279 (0.0010) [2023-12-26 01:10:01,912][123091] Updated weights for policy 0, policy_version 198289 (0.0011) [2023-12-26 01:10:01,975][123091] Updated weights for policy 0, policy_version 198299 (0.0011) [2023-12-26 01:10:02,528][123090] Updated weights for policy 1, policy_version 197508 (0.0008) [2023-12-26 01:10:02,590][123090] Updated weights for policy 1, policy_version 197518 (0.0010) [2023-12-26 01:10:02,649][123090] Updated weights for policy 1, policy_version 197528 (0.0010) [2023-12-26 01:10:02,744][123091] Updated weights for policy 0, policy_version 198309 (0.0010) [2023-12-26 01:10:02,795][123091] Updated weights for policy 0, policy_version 198319 (0.0010) [2023-12-26 01:10:02,846][123091] Updated weights for policy 0, policy_version 198329 (0.0010) [2023-12-26 01:10:03,531][123090] Updated weights for policy 1, policy_version 197538 (0.0010) [2023-12-26 01:10:03,538][123091] Updated weights for policy 0, policy_version 198339 (0.0009) [2023-12-26 01:10:03,589][123090] Updated weights for policy 1, policy_version 197548 (0.0008) [2023-12-26 01:10:03,591][123091] Updated weights for policy 0, policy_version 198349 (0.0007) [2023-12-26 01:10:03,644][123090] Updated weights for policy 1, policy_version 197558 (0.0006) [2023-12-26 01:10:03,645][123091] Updated weights for policy 0, policy_version 198359 (0.0010) [2023-12-26 01:10:03,716][123090] Updated weights for policy 1, policy_version 197568 (0.0008) [2023-12-26 01:10:03,784][121949] Fps is (10 sec: 19660.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 101359616. Throughput: 0: 8789.9, 1: 8920.2. Samples: 101364656. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:03,785][121949] Avg episode reward: [(0, '5655.777'), (1, '5578.855')] [2023-12-26 01:10:04,367][123091] Updated weights for policy 0, policy_version 198369 (0.0006) [2023-12-26 01:10:04,431][123091] Updated weights for policy 0, policy_version 198379 (0.0006) [2023-12-26 01:10:04,497][123091] Updated weights for policy 0, policy_version 198389 (0.0005) [2023-12-26 01:10:04,551][123091] Updated weights for policy 0, policy_version 198399 (0.0005) [2023-12-26 01:10:04,631][123090] Updated weights for policy 1, policy_version 197578 (0.0009) [2023-12-26 01:10:04,678][123090] Updated weights for policy 1, policy_version 197588 (0.0007) [2023-12-26 01:10:04,739][123090] Updated weights for policy 1, policy_version 197598 (0.0005) [2023-12-26 01:10:05,256][123091] Updated weights for policy 0, policy_version 198409 (0.0010) [2023-12-26 01:10:05,319][123091] Updated weights for policy 0, policy_version 198419 (0.0010) [2023-12-26 01:10:05,385][123091] Updated weights for policy 0, policy_version 198429 (0.0011) [2023-12-26 01:10:05,478][123090] Updated weights for policy 1, policy_version 197608 (0.0009) [2023-12-26 01:10:05,540][123090] Updated weights for policy 1, policy_version 197618 (0.0010) [2023-12-26 01:10:05,595][123090] Updated weights for policy 1, policy_version 197628 (0.0010) [2023-12-26 01:10:06,179][123091] Updated weights for policy 0, policy_version 198439 (0.0007) [2023-12-26 01:10:06,245][123091] Updated weights for policy 0, policy_version 198449 (0.0010) [2023-12-26 01:10:06,281][123090] Updated weights for policy 1, policy_version 197638 (0.0008) [2023-12-26 01:10:06,310][123091] Updated weights for policy 0, policy_version 198459 (0.0011) [2023-12-26 01:10:06,352][123090] Updated weights for policy 1, policy_version 197648 (0.0007) [2023-12-26 01:10:06,404][123090] Updated weights for policy 1, policy_version 197658 (0.0009) [2023-12-26 01:10:07,061][123091] Updated weights for policy 0, policy_version 198469 (0.0011) [2023-12-26 01:10:07,114][123091] Updated weights for policy 0, policy_version 198479 (0.0009) [2023-12-26 01:10:07,166][123091] Updated weights for policy 0, policy_version 198489 (0.0009) [2023-12-26 01:10:07,265][123090] Updated weights for policy 1, policy_version 197668 (0.0009) [2023-12-26 01:10:07,320][123090] Updated weights for policy 1, policy_version 197678 (0.0009) [2023-12-26 01:10:07,379][123090] Updated weights for policy 1, policy_version 197688 (0.0008) [2023-12-26 01:10:07,948][123091] Updated weights for policy 0, policy_version 198499 (0.0011) [2023-12-26 01:10:08,011][123091] Updated weights for policy 0, policy_version 198509 (0.0011) [2023-12-26 01:10:08,070][123091] Updated weights for policy 0, policy_version 198519 (0.0010) [2023-12-26 01:10:08,273][123090] Updated weights for policy 1, policy_version 197698 (0.0009) [2023-12-26 01:10:08,330][123090] Updated weights for policy 1, policy_version 197708 (0.0009) [2023-12-26 01:10:08,403][123090] Updated weights for policy 1, policy_version 197718 (0.0009) [2023-12-26 01:10:08,476][123090] Updated weights for policy 1, policy_version 197728 (0.0007) [2023-12-26 01:10:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 101441536. Throughput: 0: 8821.8, 1: 8972.2. Samples: 101419712. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:08,785][121949] Avg episode reward: [(0, '5848.703'), (1, '5602.233')] [2023-12-26 01:10:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000198528_50823168.pth... [2023-12-26 01:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000197728_50618368.pth... [2023-12-26 01:10:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000196704_50356224.pth [2023-12-26 01:10:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000197504_50561024.pth [2023-12-26 01:10:08,898][123091] Updated weights for policy 0, policy_version 198529 (0.0008) [2023-12-26 01:10:08,977][123091] Updated weights for policy 0, policy_version 198539 (0.0011) [2023-12-26 01:10:09,034][123091] Updated weights for policy 0, policy_version 198549 (0.0011) [2023-12-26 01:10:09,101][123091] Updated weights for policy 0, policy_version 198559 (0.0011) [2023-12-26 01:10:09,275][123090] Updated weights for policy 1, policy_version 197738 (0.0008) [2023-12-26 01:10:09,350][123090] Updated weights for policy 1, policy_version 197748 (0.0009) [2023-12-26 01:10:09,436][123090] Updated weights for policy 1, policy_version 197758 (0.0008) [2023-12-26 01:10:09,933][123091] Updated weights for policy 0, policy_version 198569 (0.0011) [2023-12-26 01:10:09,997][123091] Updated weights for policy 0, policy_version 198579 (0.0011) [2023-12-26 01:10:10,061][123091] Updated weights for policy 0, policy_version 198589 (0.0008) [2023-12-26 01:10:10,239][123090] Updated weights for policy 1, policy_version 197768 (0.0009) [2023-12-26 01:10:10,298][123090] Updated weights for policy 1, policy_version 197778 (0.0010) [2023-12-26 01:10:10,349][123090] Updated weights for policy 1, policy_version 197788 (0.0009) [2023-12-26 01:10:10,715][123091] Updated weights for policy 0, policy_version 198599 (0.0006) [2023-12-26 01:10:10,773][123091] Updated weights for policy 0, policy_version 198609 (0.0005) [2023-12-26 01:10:10,836][123091] Updated weights for policy 0, policy_version 198619 (0.0005) [2023-12-26 01:10:11,269][123090] Updated weights for policy 1, policy_version 197798 (0.0010) [2023-12-26 01:10:11,328][123090] Updated weights for policy 1, policy_version 197808 (0.0009) [2023-12-26 01:10:11,407][123090] Updated weights for policy 1, policy_version 197818 (0.0007) [2023-12-26 01:10:11,588][123091] Updated weights for policy 0, policy_version 198629 (0.0007) [2023-12-26 01:10:11,654][123091] Updated weights for policy 0, policy_version 198639 (0.0008) [2023-12-26 01:10:11,731][123091] Updated weights for policy 0, policy_version 198649 (0.0007) [2023-12-26 01:10:12,235][123090] Updated weights for policy 1, policy_version 197828 (0.0008) [2023-12-26 01:10:12,301][123090] Updated weights for policy 1, policy_version 197838 (0.0009) [2023-12-26 01:10:12,374][123090] Updated weights for policy 1, policy_version 197848 (0.0010) [2023-12-26 01:10:12,449][123091] Updated weights for policy 0, policy_version 198659 (0.0007) [2023-12-26 01:10:12,525][123091] Updated weights for policy 0, policy_version 198669 (0.0007) [2023-12-26 01:10:12,586][123091] Updated weights for policy 0, policy_version 198679 (0.0010) [2023-12-26 01:10:13,220][123090] Updated weights for policy 1, policy_version 197858 (0.0010) [2023-12-26 01:10:13,277][123091] Updated weights for policy 0, policy_version 198689 (0.0009) [2023-12-26 01:10:13,282][123090] Updated weights for policy 1, policy_version 197868 (0.0010) [2023-12-26 01:10:13,326][123090] Updated weights for policy 1, policy_version 197878 (0.0008) [2023-12-26 01:10:13,328][123091] Updated weights for policy 0, policy_version 198699 (0.0008) [2023-12-26 01:10:13,371][123090] Updated weights for policy 1, policy_version 197888 (0.0007) [2023-12-26 01:10:13,373][123091] Updated weights for policy 0, policy_version 198709 (0.0007) [2023-12-26 01:10:13,426][123091] Updated weights for policy 0, policy_version 198719 (0.0010) [2023-12-26 01:10:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 101531648. Throughput: 0: 8908.5, 1: 8800.3. Samples: 101523820. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:13,785][121949] Avg episode reward: [(0, '5901.513'), (1, '5504.187')] [2023-12-26 01:10:14,160][123090] Updated weights for policy 1, policy_version 197898 (0.0011) [2023-12-26 01:10:14,220][123090] Updated weights for policy 1, policy_version 197908 (0.0011) [2023-12-26 01:10:14,289][123090] Updated weights for policy 1, policy_version 197918 (0.0011) [2023-12-26 01:10:14,336][123091] Updated weights for policy 0, policy_version 198729 (0.0008) [2023-12-26 01:10:14,396][123091] Updated weights for policy 0, policy_version 198739 (0.0010) [2023-12-26 01:10:14,461][123091] Updated weights for policy 0, policy_version 198749 (0.0006) [2023-12-26 01:10:15,022][123090] Updated weights for policy 1, policy_version 197928 (0.0011) [2023-12-26 01:10:15,090][123090] Updated weights for policy 1, policy_version 197938 (0.0011) [2023-12-26 01:10:15,158][123090] Updated weights for policy 1, policy_version 197948 (0.0011) [2023-12-26 01:10:15,205][123091] Updated weights for policy 0, policy_version 198759 (0.0009) [2023-12-26 01:10:15,272][123091] Updated weights for policy 0, policy_version 198769 (0.0011) [2023-12-26 01:10:15,333][123091] Updated weights for policy 0, policy_version 198779 (0.0011) [2023-12-26 01:10:15,891][123090] Updated weights for policy 1, policy_version 197958 (0.0009) [2023-12-26 01:10:15,942][123090] Updated weights for policy 1, policy_version 197968 (0.0010) [2023-12-26 01:10:16,008][123090] Updated weights for policy 1, policy_version 197978 (0.0006) [2023-12-26 01:10:16,158][123091] Updated weights for policy 0, policy_version 198789 (0.0011) [2023-12-26 01:10:16,216][123091] Updated weights for policy 0, policy_version 198799 (0.0010) [2023-12-26 01:10:16,268][123091] Updated weights for policy 0, policy_version 198809 (0.0011) [2023-12-26 01:10:16,817][123090] Updated weights for policy 1, policy_version 197988 (0.0010) [2023-12-26 01:10:16,872][123090] Updated weights for policy 1, policy_version 197998 (0.0010) [2023-12-26 01:10:16,927][123090] Updated weights for policy 1, policy_version 198008 (0.0010) [2023-12-26 01:10:17,065][123091] Updated weights for policy 0, policy_version 198819 (0.0009) [2023-12-26 01:10:17,114][123091] Updated weights for policy 0, policy_version 198829 (0.0009) [2023-12-26 01:10:17,165][123091] Updated weights for policy 0, policy_version 198839 (0.0010) [2023-12-26 01:10:17,630][123090] Updated weights for policy 1, policy_version 198018 (0.0009) [2023-12-26 01:10:17,681][123090] Updated weights for policy 1, policy_version 198028 (0.0005) [2023-12-26 01:10:17,731][123090] Updated weights for policy 1, policy_version 198038 (0.0005) [2023-12-26 01:10:17,782][123090] Updated weights for policy 1, policy_version 198048 (0.0005) [2023-12-26 01:10:17,865][123091] Updated weights for policy 0, policy_version 198849 (0.0010) [2023-12-26 01:10:17,914][123091] Updated weights for policy 0, policy_version 198859 (0.0005) [2023-12-26 01:10:17,967][123091] Updated weights for policy 0, policy_version 198869 (0.0005) [2023-12-26 01:10:18,024][123091] Updated weights for policy 0, policy_version 198879 (0.0006) [2023-12-26 01:10:18,479][123090] Updated weights for policy 1, policy_version 198058 (0.0011) [2023-12-26 01:10:18,538][123090] Updated weights for policy 1, policy_version 198068 (0.0010) [2023-12-26 01:10:18,595][123090] Updated weights for policy 1, policy_version 198078 (0.0010) [2023-12-26 01:10:18,733][123091] Updated weights for policy 0, policy_version 198889 (0.0010) [2023-12-26 01:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 101621760. Throughput: 0: 8935.2, 1: 8872.1. Samples: 101635228. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:18,785][121949] Avg episode reward: [(0, '5878.219'), (1, '5507.781')] [2023-12-26 01:10:18,792][123091] Updated weights for policy 0, policy_version 198899 (0.0011) [2023-12-26 01:10:18,856][123091] Updated weights for policy 0, policy_version 198909 (0.0008) [2023-12-26 01:10:19,467][123090] Updated weights for policy 1, policy_version 198088 (0.0006) [2023-12-26 01:10:19,538][123090] Updated weights for policy 1, policy_version 198098 (0.0010) [2023-12-26 01:10:19,603][123090] Updated weights for policy 1, policy_version 198108 (0.0011) [2023-12-26 01:10:19,688][123091] Updated weights for policy 0, policy_version 198919 (0.0007) [2023-12-26 01:10:19,746][123091] Updated weights for policy 0, policy_version 198929 (0.0006) [2023-12-26 01:10:19,812][123091] Updated weights for policy 0, policy_version 198939 (0.0006) [2023-12-26 01:10:20,370][123090] Updated weights for policy 1, policy_version 198118 (0.0010) [2023-12-26 01:10:20,426][123090] Updated weights for policy 1, policy_version 198128 (0.0010) [2023-12-26 01:10:20,486][123090] Updated weights for policy 1, policy_version 198138 (0.0010) [2023-12-26 01:10:20,612][123091] Updated weights for policy 0, policy_version 198949 (0.0009) [2023-12-26 01:10:20,672][123091] Updated weights for policy 0, policy_version 198959 (0.0009) [2023-12-26 01:10:20,729][123091] Updated weights for policy 0, policy_version 198969 (0.0008) [2023-12-26 01:10:21,340][123090] Updated weights for policy 1, policy_version 198148 (0.0010) [2023-12-26 01:10:21,409][123090] Updated weights for policy 1, policy_version 198158 (0.0010) [2023-12-26 01:10:21,473][123090] Updated weights for policy 1, policy_version 198168 (0.0010) [2023-12-26 01:10:21,585][123091] Updated weights for policy 0, policy_version 198979 (0.0009) [2023-12-26 01:10:21,652][123091] Updated weights for policy 0, policy_version 198989 (0.0010) [2023-12-26 01:10:21,715][123091] Updated weights for policy 0, policy_version 198999 (0.0009) [2023-12-26 01:10:22,268][123090] Updated weights for policy 1, policy_version 198178 (0.0011) [2023-12-26 01:10:22,330][123090] Updated weights for policy 1, policy_version 198188 (0.0005) [2023-12-26 01:10:22,402][123090] Updated weights for policy 1, policy_version 198198 (0.0007) [2023-12-26 01:10:22,472][123090] Updated weights for policy 1, policy_version 198208 (0.0006) [2023-12-26 01:10:22,558][123091] Updated weights for policy 0, policy_version 199009 (0.0008) [2023-12-26 01:10:22,616][123091] Updated weights for policy 0, policy_version 199019 (0.0008) [2023-12-26 01:10:22,693][123091] Updated weights for policy 0, policy_version 199029 (0.0006) [2023-12-26 01:10:22,767][123091] Updated weights for policy 0, policy_version 199039 (0.0007) [2023-12-26 01:10:23,145][123090] Updated weights for policy 1, policy_version 198218 (0.0005) [2023-12-26 01:10:23,218][123090] Updated weights for policy 1, policy_version 198228 (0.0006) [2023-12-26 01:10:23,280][123090] Updated weights for policy 1, policy_version 198238 (0.0006) [2023-12-26 01:10:23,427][123091] Updated weights for policy 0, policy_version 199049 (0.0005) [2023-12-26 01:10:23,485][123091] Updated weights for policy 0, policy_version 199059 (0.0006) [2023-12-26 01:10:23,542][123091] Updated weights for policy 0, policy_version 199069 (0.0009) [2023-12-26 01:10:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 101711872. Throughput: 0: 8925.9, 1: 8840.4. Samples: 101685680. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:23,785][121949] Avg episode reward: [(0, '5840.500'), (1, '5488.519')] [2023-12-26 01:10:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000199072_50962432.pth... [2023-12-26 01:10:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000198240_50749440.pth... [2023-12-26 01:10:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000197984_50683904.pth [2023-12-26 01:10:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000197184_50479104.pth [2023-12-26 01:10:23,967][123090] Updated weights for policy 1, policy_version 198248 (0.0005) [2023-12-26 01:10:24,014][123090] Updated weights for policy 1, policy_version 198258 (0.0008) [2023-12-26 01:10:24,085][123090] Updated weights for policy 1, policy_version 198268 (0.0010) [2023-12-26 01:10:24,195][123091] Updated weights for policy 0, policy_version 199079 (0.0006) [2023-12-26 01:10:24,245][123091] Updated weights for policy 0, policy_version 199089 (0.0006) [2023-12-26 01:10:24,292][123091] Updated weights for policy 0, policy_version 199099 (0.0008) [2023-12-26 01:10:24,780][123090] Updated weights for policy 1, policy_version 198278 (0.0008) [2023-12-26 01:10:24,827][123090] Updated weights for policy 1, policy_version 198288 (0.0005) [2023-12-26 01:10:24,876][123090] Updated weights for policy 1, policy_version 198298 (0.0005) [2023-12-26 01:10:25,019][123091] Updated weights for policy 0, policy_version 199109 (0.0009) [2023-12-26 01:10:25,066][123091] Updated weights for policy 0, policy_version 199119 (0.0010) [2023-12-26 01:10:25,117][123091] Updated weights for policy 0, policy_version 199129 (0.0010) [2023-12-26 01:10:25,569][123090] Updated weights for policy 1, policy_version 198308 (0.0005) [2023-12-26 01:10:25,629][123090] Updated weights for policy 1, policy_version 198318 (0.0005) [2023-12-26 01:10:25,688][123090] Updated weights for policy 1, policy_version 198328 (0.0005) [2023-12-26 01:10:25,953][123091] Updated weights for policy 0, policy_version 199139 (0.0011) [2023-12-26 01:10:26,011][123091] Updated weights for policy 0, policy_version 199149 (0.0010) [2023-12-26 01:10:26,073][123091] Updated weights for policy 0, policy_version 199159 (0.0010) [2023-12-26 01:10:26,280][123090] Updated weights for policy 1, policy_version 198338 (0.0005) [2023-12-26 01:10:26,340][123090] Updated weights for policy 1, policy_version 198348 (0.0008) [2023-12-26 01:10:26,400][123090] Updated weights for policy 1, policy_version 198358 (0.0010) [2023-12-26 01:10:26,455][123090] Updated weights for policy 1, policy_version 198368 (0.0010) [2023-12-26 01:10:26,876][123091] Updated weights for policy 0, policy_version 199169 (0.0010) [2023-12-26 01:10:26,927][123091] Updated weights for policy 0, policy_version 199179 (0.0008) [2023-12-26 01:10:26,977][123091] Updated weights for policy 0, policy_version 199189 (0.0005) [2023-12-26 01:10:27,034][123091] Updated weights for policy 0, policy_version 199199 (0.0009) [2023-12-26 01:10:27,240][123090] Updated weights for policy 1, policy_version 198378 (0.0010) [2023-12-26 01:10:27,309][123090] Updated weights for policy 1, policy_version 198388 (0.0010) [2023-12-26 01:10:27,380][123090] Updated weights for policy 1, policy_version 198398 (0.0010) [2023-12-26 01:10:27,802][123091] Updated weights for policy 0, policy_version 199209 (0.0006) [2023-12-26 01:10:27,862][123091] Updated weights for policy 0, policy_version 199219 (0.0005) [2023-12-26 01:10:27,910][123091] Updated weights for policy 0, policy_version 199229 (0.0005) [2023-12-26 01:10:28,063][123090] Updated weights for policy 1, policy_version 198408 (0.0008) [2023-12-26 01:10:28,123][123090] Updated weights for policy 1, policy_version 198418 (0.0005) [2023-12-26 01:10:28,195][123090] Updated weights for policy 1, policy_version 198428 (0.0005) [2023-12-26 01:10:28,691][123091] Updated weights for policy 0, policy_version 199239 (0.0010) [2023-12-26 01:10:28,749][123091] Updated weights for policy 0, policy_version 199249 (0.0010) [2023-12-26 01:10:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 101801984. Throughput: 0: 9048.5, 1: 8987.3. Samples: 101799544. Policy #0 lag: (min: 23.0, avg: 31.0, max: 55.0) [2023-12-26 01:10:28,785][121949] Avg episode reward: [(0, '5898.278'), (1, '5620.078')] [2023-12-26 01:10:28,808][123091] Updated weights for policy 0, policy_version 199259 (0.0010) [2023-12-26 01:10:28,894][123090] Updated weights for policy 1, policy_version 198438 (0.0005) [2023-12-26 01:10:28,950][123090] Updated weights for policy 1, policy_version 198448 (0.0006) [2023-12-26 01:10:29,017][123090] Updated weights for policy 1, policy_version 198458 (0.0005) [2023-12-26 01:10:29,645][123091] Updated weights for policy 0, policy_version 199269 (0.0010) [2023-12-26 01:10:29,696][123091] Updated weights for policy 0, policy_version 199279 (0.0010) [2023-12-26 01:10:29,759][123091] Updated weights for policy 0, policy_version 199289 (0.0010) [2023-12-26 01:10:29,832][123090] Updated weights for policy 1, policy_version 198468 (0.0007) [2023-12-26 01:10:29,893][123090] Updated weights for policy 1, policy_version 198478 (0.0009) [2023-12-26 01:10:29,955][123090] Updated weights for policy 1, policy_version 198488 (0.0009) [2023-12-26 01:10:30,462][123091] Updated weights for policy 0, policy_version 199299 (0.0010) [2023-12-26 01:10:30,512][123091] Updated weights for policy 0, policy_version 199309 (0.0010) [2023-12-26 01:10:30,584][123091] Updated weights for policy 0, policy_version 199319 (0.0010) [2023-12-26 01:10:30,784][123090] Updated weights for policy 1, policy_version 198498 (0.0008) [2023-12-26 01:10:30,857][123090] Updated weights for policy 1, policy_version 198508 (0.0005) [2023-12-26 01:10:30,930][123090] Updated weights for policy 1, policy_version 198518 (0.0005) [2023-12-26 01:10:30,999][123090] Updated weights for policy 1, policy_version 198528 (0.0005) [2023-12-26 01:10:31,336][123091] Updated weights for policy 0, policy_version 199329 (0.0010) [2023-12-26 01:10:31,403][123091] Updated weights for policy 0, policy_version 199339 (0.0009) [2023-12-26 01:10:31,456][123091] Updated weights for policy 0, policy_version 199349 (0.0009) [2023-12-26 01:10:31,520][123091] Updated weights for policy 0, policy_version 199359 (0.0009) [2023-12-26 01:10:31,673][123090] Updated weights for policy 1, policy_version 198538 (0.0008) [2023-12-26 01:10:31,742][123090] Updated weights for policy 1, policy_version 198548 (0.0012) [2023-12-26 01:10:31,820][123090] Updated weights for policy 1, policy_version 198558 (0.0008) [2023-12-26 01:10:32,291][123091] Updated weights for policy 0, policy_version 199369 (0.0006) [2023-12-26 01:10:32,361][123091] Updated weights for policy 0, policy_version 199379 (0.0008) [2023-12-26 01:10:32,435][123091] Updated weights for policy 0, policy_version 199389 (0.0007) [2023-12-26 01:10:32,676][123090] Updated weights for policy 1, policy_version 198568 (0.0010) [2023-12-26 01:10:32,750][123090] Updated weights for policy 1, policy_version 198578 (0.0008) [2023-12-26 01:10:32,811][123090] Updated weights for policy 1, policy_version 198588 (0.0009) [2023-12-26 01:10:33,118][123091] Updated weights for policy 0, policy_version 199399 (0.0005) [2023-12-26 01:10:33,188][123091] Updated weights for policy 0, policy_version 199409 (0.0005) [2023-12-26 01:10:33,239][123091] Updated weights for policy 0, policy_version 199419 (0.0005) [2023-12-26 01:10:33,727][123090] Updated weights for policy 1, policy_version 198598 (0.0010) [2023-12-26 01:10:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 101892096. Throughput: 0: 9154.4, 1: 9039.5. Samples: 101910292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:33,785][121949] Avg episode reward: [(0, '5888.303'), (1, '5580.951')] [2023-12-26 01:10:33,793][123090] Updated weights for policy 1, policy_version 198608 (0.0010) [2023-12-26 01:10:33,825][123091] Updated weights for policy 0, policy_version 199429 (0.0005) [2023-12-26 01:10:33,851][123090] Updated weights for policy 1, policy_version 198618 (0.0010) [2023-12-26 01:10:33,877][123091] Updated weights for policy 0, policy_version 199439 (0.0005) [2023-12-26 01:10:33,929][123091] Updated weights for policy 0, policy_version 199449 (0.0005) [2023-12-26 01:10:34,680][123091] Updated weights for policy 0, policy_version 199459 (0.0007) [2023-12-26 01:10:34,683][123090] Updated weights for policy 1, policy_version 198628 (0.0010) [2023-12-26 01:10:34,731][123090] Updated weights for policy 1, policy_version 198638 (0.0010) [2023-12-26 01:10:34,744][123091] Updated weights for policy 0, policy_version 199469 (0.0011) [2023-12-26 01:10:34,783][123090] Updated weights for policy 1, policy_version 198648 (0.0010) [2023-12-26 01:10:34,807][123091] Updated weights for policy 0, policy_version 199479 (0.0011) [2023-12-26 01:10:35,519][123091] Updated weights for policy 0, policy_version 199489 (0.0010) [2023-12-26 01:10:35,567][123091] Updated weights for policy 0, policy_version 199499 (0.0006) [2023-12-26 01:10:35,623][123091] Updated weights for policy 0, policy_version 199509 (0.0005) [2023-12-26 01:10:35,639][123090] Updated weights for policy 1, policy_version 198658 (0.0010) [2023-12-26 01:10:35,680][123091] Updated weights for policy 0, policy_version 199519 (0.0005) [2023-12-26 01:10:35,702][123090] Updated weights for policy 1, policy_version 198668 (0.0010) [2023-12-26 01:10:35,764][123090] Updated weights for policy 1, policy_version 198678 (0.0010) [2023-12-26 01:10:35,819][123090] Updated weights for policy 1, policy_version 198688 (0.0010) [2023-12-26 01:10:36,318][123091] Updated weights for policy 0, policy_version 199529 (0.0009) [2023-12-26 01:10:36,379][123091] Updated weights for policy 0, policy_version 199539 (0.0011) [2023-12-26 01:10:36,439][123091] Updated weights for policy 0, policy_version 199549 (0.0011) [2023-12-26 01:10:36,680][123090] Updated weights for policy 1, policy_version 198698 (0.0011) [2023-12-26 01:10:36,747][123090] Updated weights for policy 1, policy_version 198708 (0.0011) [2023-12-26 01:10:36,802][123090] Updated weights for policy 1, policy_version 198718 (0.0010) [2023-12-26 01:10:37,179][123091] Updated weights for policy 0, policy_version 199559 (0.0007) [2023-12-26 01:10:37,255][123091] Updated weights for policy 0, policy_version 199569 (0.0008) [2023-12-26 01:10:37,299][123091] Updated weights for policy 0, policy_version 199579 (0.0010) [2023-12-26 01:10:37,595][123090] Updated weights for policy 1, policy_version 198728 (0.0009) [2023-12-26 01:10:37,663][123090] Updated weights for policy 1, policy_version 198738 (0.0009) [2023-12-26 01:10:37,730][123090] Updated weights for policy 1, policy_version 198748 (0.0011) [2023-12-26 01:10:38,095][123091] Updated weights for policy 0, policy_version 199589 (0.0010) [2023-12-26 01:10:38,146][123091] Updated weights for policy 0, policy_version 199599 (0.0010) [2023-12-26 01:10:38,204][123091] Updated weights for policy 0, policy_version 199609 (0.0010) [2023-12-26 01:10:38,523][123090] Updated weights for policy 1, policy_version 198758 (0.0008) [2023-12-26 01:10:38,604][123090] Updated weights for policy 1, policy_version 198768 (0.0005) [2023-12-26 01:10:38,681][123090] Updated weights for policy 1, policy_version 198778 (0.0006) [2023-12-26 01:10:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 101990400. Throughput: 0: 9220.5, 1: 9012.6. Samples: 101965112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:38,785][121949] Avg episode reward: [(0, '5910.280'), (1, '5609.826')] [2023-12-26 01:10:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000199616_51101696.pth... [2023-12-26 01:10:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000198784_50888704.pth... [2023-12-26 01:10:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000198528_50823168.pth [2023-12-26 01:10:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000197728_50618368.pth [2023-12-26 01:10:39,064][123091] Updated weights for policy 0, policy_version 199619 (0.0010) [2023-12-26 01:10:39,128][123091] Updated weights for policy 0, policy_version 199629 (0.0012) [2023-12-26 01:10:39,186][123091] Updated weights for policy 0, policy_version 199639 (0.0010) [2023-12-26 01:10:39,351][123090] Updated weights for policy 1, policy_version 198788 (0.0007) [2023-12-26 01:10:39,427][123090] Updated weights for policy 1, policy_version 198798 (0.0010) [2023-12-26 01:10:39,491][123090] Updated weights for policy 1, policy_version 198808 (0.0007) [2023-12-26 01:10:40,070][123091] Updated weights for policy 0, policy_version 199649 (0.0011) [2023-12-26 01:10:40,136][123091] Updated weights for policy 0, policy_version 199659 (0.0010) [2023-12-26 01:10:40,208][123091] Updated weights for policy 0, policy_version 199669 (0.0011) [2023-12-26 01:10:40,251][123090] Updated weights for policy 1, policy_version 198818 (0.0006) [2023-12-26 01:10:40,283][123091] Updated weights for policy 0, policy_version 199679 (0.0011) [2023-12-26 01:10:40,318][123090] Updated weights for policy 1, policy_version 198828 (0.0006) [2023-12-26 01:10:40,377][123090] Updated weights for policy 1, policy_version 198838 (0.0006) [2023-12-26 01:10:40,441][123090] Updated weights for policy 1, policy_version 198848 (0.0007) [2023-12-26 01:10:41,057][123091] Updated weights for policy 0, policy_version 199689 (0.0011) [2023-12-26 01:10:41,121][123091] Updated weights for policy 0, policy_version 199699 (0.0010) [2023-12-26 01:10:41,125][123090] Updated weights for policy 1, policy_version 198858 (0.0011) [2023-12-26 01:10:41,197][123091] Updated weights for policy 0, policy_version 199709 (0.0008) [2023-12-26 01:10:41,206][123090] Updated weights for policy 1, policy_version 198868 (0.0008) [2023-12-26 01:10:41,275][123090] Updated weights for policy 1, policy_version 198878 (0.0009) [2023-12-26 01:10:42,038][123090] Updated weights for policy 1, policy_version 198888 (0.0009) [2023-12-26 01:10:42,076][123091] Updated weights for policy 0, policy_version 199719 (0.0007) [2023-12-26 01:10:42,096][123090] Updated weights for policy 1, policy_version 198898 (0.0008) [2023-12-26 01:10:42,139][123091] Updated weights for policy 0, policy_version 199729 (0.0009) [2023-12-26 01:10:42,155][123090] Updated weights for policy 1, policy_version 198908 (0.0008) [2023-12-26 01:10:42,203][123091] Updated weights for policy 0, policy_version 199739 (0.0010) [2023-12-26 01:10:42,939][123091] Updated weights for policy 0, policy_version 199749 (0.0009) [2023-12-26 01:10:42,959][123090] Updated weights for policy 1, policy_version 198918 (0.0008) [2023-12-26 01:10:42,995][123091] Updated weights for policy 0, policy_version 199759 (0.0008) [2023-12-26 01:10:43,021][123090] Updated weights for policy 1, policy_version 198928 (0.0008) [2023-12-26 01:10:43,055][123091] Updated weights for policy 0, policy_version 199769 (0.0007) [2023-12-26 01:10:43,085][123090] Updated weights for policy 1, policy_version 198938 (0.0009) [2023-12-26 01:10:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 102072320. Throughput: 0: 9156.8, 1: 8923.3. Samples: 102070312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:43,785][121949] Avg episode reward: [(0, '5825.700'), (1, '5757.295')] [2023-12-26 01:10:43,789][123091] Updated weights for policy 0, policy_version 199779 (0.0008) [2023-12-26 01:10:43,846][123091] Updated weights for policy 0, policy_version 199789 (0.0010) [2023-12-26 01:10:43,907][123091] Updated weights for policy 0, policy_version 199799 (0.0009) [2023-12-26 01:10:43,953][123090] Updated weights for policy 1, policy_version 198948 (0.0010) [2023-12-26 01:10:44,012][123090] Updated weights for policy 1, policy_version 198958 (0.0009) [2023-12-26 01:10:44,077][123090] Updated weights for policy 1, policy_version 198968 (0.0010) [2023-12-26 01:10:44,759][123091] Updated weights for policy 0, policy_version 199809 (0.0008) [2023-12-26 01:10:44,830][123091] Updated weights for policy 0, policy_version 199819 (0.0009) [2023-12-26 01:10:44,889][123091] Updated weights for policy 0, policy_version 199829 (0.0009) [2023-12-26 01:10:44,949][123090] Updated weights for policy 1, policy_version 198978 (0.0009) [2023-12-26 01:10:44,953][123091] Updated weights for policy 0, policy_version 199839 (0.0009) [2023-12-26 01:10:45,018][123090] Updated weights for policy 1, policy_version 198988 (0.0006) [2023-12-26 01:10:45,090][123090] Updated weights for policy 1, policy_version 198998 (0.0005) [2023-12-26 01:10:45,145][123090] Updated weights for policy 1, policy_version 199008 (0.0006) [2023-12-26 01:10:45,710][123091] Updated weights for policy 0, policy_version 199849 (0.0010) [2023-12-26 01:10:45,786][123091] Updated weights for policy 0, policy_version 199859 (0.0009) [2023-12-26 01:10:45,836][123091] Updated weights for policy 0, policy_version 199869 (0.0009) [2023-12-26 01:10:45,836][123090] Updated weights for policy 1, policy_version 199018 (0.0006) [2023-12-26 01:10:45,894][123090] Updated weights for policy 1, policy_version 199028 (0.0009) [2023-12-26 01:10:45,945][123090] Updated weights for policy 1, policy_version 199038 (0.0009) [2023-12-26 01:10:46,568][123090] Updated weights for policy 1, policy_version 199048 (0.0006) [2023-12-26 01:10:46,592][123091] Updated weights for policy 0, policy_version 199879 (0.0006) [2023-12-26 01:10:46,624][123090] Updated weights for policy 1, policy_version 199058 (0.0008) [2023-12-26 01:10:46,649][123091] Updated weights for policy 0, policy_version 199889 (0.0006) [2023-12-26 01:10:46,679][123090] Updated weights for policy 1, policy_version 199068 (0.0009) [2023-12-26 01:10:46,705][123091] Updated weights for policy 0, policy_version 199899 (0.0008) [2023-12-26 01:10:47,369][123091] Updated weights for policy 0, policy_version 199909 (0.0008) [2023-12-26 01:10:47,420][123091] Updated weights for policy 0, policy_version 199919 (0.0005) [2023-12-26 01:10:47,476][123091] Updated weights for policy 0, policy_version 199929 (0.0005) [2023-12-26 01:10:47,565][123090] Updated weights for policy 1, policy_version 199078 (0.0010) [2023-12-26 01:10:47,620][123090] Updated weights for policy 1, policy_version 199088 (0.0010) [2023-12-26 01:10:47,674][123090] Updated weights for policy 1, policy_version 199098 (0.0010) [2023-12-26 01:10:48,130][123091] Updated weights for policy 0, policy_version 199939 (0.0005) [2023-12-26 01:10:48,178][123091] Updated weights for policy 0, policy_version 199949 (0.0005) [2023-12-26 01:10:48,236][123091] Updated weights for policy 0, policy_version 199959 (0.0010) [2023-12-26 01:10:48,562][123090] Updated weights for policy 1, policy_version 199109 (0.0010) [2023-12-26 01:10:48,627][123090] Updated weights for policy 1, policy_version 199119 (0.0009) [2023-12-26 01:10:48,695][123090] Updated weights for policy 1, policy_version 199129 (0.0009) [2023-12-26 01:10:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18159.0, 300 sec: 17744.7). Total num frames: 102170624. Throughput: 0: 9192.7, 1: 8903.3. Samples: 102178976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:48,785][121949] Avg episode reward: [(0, '5837.743'), (1, '5715.780')] [2023-12-26 01:10:49,073][123091] Updated weights for policy 0, policy_version 199969 (0.0010) [2023-12-26 01:10:49,125][123091] Updated weights for policy 0, policy_version 199979 (0.0011) [2023-12-26 01:10:49,176][123091] Updated weights for policy 0, policy_version 199989 (0.0011) [2023-12-26 01:10:49,233][123091] Updated weights for policy 0, policy_version 199999 (0.0009) [2023-12-26 01:10:49,516][123090] Updated weights for policy 1, policy_version 199139 (0.0008) [2023-12-26 01:10:49,565][123090] Updated weights for policy 1, policy_version 199149 (0.0005) [2023-12-26 01:10:49,622][123090] Updated weights for policy 1, policy_version 199159 (0.0005) [2023-12-26 01:10:50,135][123091] Updated weights for policy 0, policy_version 200009 (0.0010) [2023-12-26 01:10:50,199][123091] Updated weights for policy 0, policy_version 200019 (0.0010) [2023-12-26 01:10:50,258][123091] Updated weights for policy 0, policy_version 200029 (0.0010) [2023-12-26 01:10:50,407][123090] Updated weights for policy 1, policy_version 199169 (0.0006) [2023-12-26 01:10:50,464][123090] Updated weights for policy 1, policy_version 199179 (0.0009) [2023-12-26 01:10:50,521][123090] Updated weights for policy 1, policy_version 199189 (0.0009) [2023-12-26 01:10:50,576][123090] Updated weights for policy 1, policy_version 199199 (0.0009) [2023-12-26 01:10:51,030][123091] Updated weights for policy 0, policy_version 200039 (0.0007) [2023-12-26 01:10:51,091][123091] Updated weights for policy 0, policy_version 200049 (0.0007) [2023-12-26 01:10:51,160][123091] Updated weights for policy 0, policy_version 200059 (0.0006) [2023-12-26 01:10:51,493][123090] Updated weights for policy 1, policy_version 199209 (0.0006) [2023-12-26 01:10:51,557][123090] Updated weights for policy 1, policy_version 199219 (0.0007) [2023-12-26 01:10:51,621][123090] Updated weights for policy 1, policy_version 199229 (0.0007) [2023-12-26 01:10:51,885][123091] Updated weights for policy 0, policy_version 200069 (0.0010) [2023-12-26 01:10:51,948][123091] Updated weights for policy 0, policy_version 200079 (0.0011) [2023-12-26 01:10:52,007][123091] Updated weights for policy 0, policy_version 200089 (0.0011) [2023-12-26 01:10:52,372][123090] Updated weights for policy 1, policy_version 199239 (0.0007) [2023-12-26 01:10:52,440][123090] Updated weights for policy 1, policy_version 199249 (0.0006) [2023-12-26 01:10:52,508][123090] Updated weights for policy 1, policy_version 199259 (0.0005) [2023-12-26 01:10:52,787][123091] Updated weights for policy 0, policy_version 200099 (0.0009) [2023-12-26 01:10:52,839][123091] Updated weights for policy 0, policy_version 200109 (0.0006) [2023-12-26 01:10:52,893][123091] Updated weights for policy 0, policy_version 200119 (0.0005) [2023-12-26 01:10:53,221][123090] Updated weights for policy 1, policy_version 199269 (0.0008) [2023-12-26 01:10:53,275][123090] Updated weights for policy 1, policy_version 199279 (0.0010) [2023-12-26 01:10:53,341][123090] Updated weights for policy 1, policy_version 199289 (0.0007) [2023-12-26 01:10:53,679][123091] Updated weights for policy 0, policy_version 200129 (0.0007) [2023-12-26 01:10:53,731][123091] Updated weights for policy 0, policy_version 200139 (0.0009) [2023-12-26 01:10:53,759][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000008 [2023-12-26 01:10:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18295.5, 300 sec: 17744.7). Total num frames: 102260736. Throughput: 0: 9128.1, 1: 8888.6. Samples: 102230464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:53,785][121949] Avg episode reward: [(0, '5890.542'), (1, '5639.909')] [2023-12-26 01:10:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000200144_51240960.pth... [2023-12-26 01:10:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000199296_51019776.pth... [2023-12-26 01:10:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000199072_50962432.pth [2023-12-26 01:10:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000198240_50749440.pth [2023-12-26 01:10:54,086][123090] Updated weights for policy 1, policy_version 199299 (0.0005) [2023-12-26 01:10:54,153][123090] Updated weights for policy 1, policy_version 199309 (0.0010) [2023-12-26 01:10:54,209][123090] Updated weights for policy 1, policy_version 199319 (0.0010) [2023-12-26 01:10:54,671][123091] Updated weights for policy 0, policy_version 200149 (0.0010) [2023-12-26 01:10:54,724][123091] Updated weights for policy 0, policy_version 200159 (0.0009) [2023-12-26 01:10:54,781][123091] Updated weights for policy 0, policy_version 200169 (0.0009) [2023-12-26 01:10:55,017][123090] Updated weights for policy 1, policy_version 199329 (0.0010) [2023-12-26 01:10:55,087][123090] Updated weights for policy 1, policy_version 199339 (0.0010) [2023-12-26 01:10:55,140][123090] Updated weights for policy 1, policy_version 199349 (0.0009) [2023-12-26 01:10:55,193][123090] Updated weights for policy 1, policy_version 199359 (0.0009) [2023-12-26 01:10:55,556][123091] Updated weights for policy 0, policy_version 200179 (0.0008) [2023-12-26 01:10:55,607][123091] Updated weights for policy 0, policy_version 200189 (0.0005) [2023-12-26 01:10:55,670][123091] Updated weights for policy 0, policy_version 200199 (0.0005) [2023-12-26 01:10:56,096][123090] Updated weights for policy 1, policy_version 199369 (0.0009) [2023-12-26 01:10:56,143][123090] Updated weights for policy 1, policy_version 199379 (0.0009) [2023-12-26 01:10:56,193][123090] Updated weights for policy 1, policy_version 199390 (0.0009) [2023-12-26 01:10:56,325][123091] Updated weights for policy 0, policy_version 200209 (0.0005) [2023-12-26 01:10:56,379][123091] Updated weights for policy 0, policy_version 200219 (0.0005) [2023-12-26 01:10:56,427][123091] Updated weights for policy 0, policy_version 200229 (0.0005) [2023-12-26 01:10:56,473][123091] Updated weights for policy 0, policy_version 200239 (0.0005) [2023-12-26 01:10:57,018][123090] Updated weights for policy 1, policy_version 199400 (0.0009) [2023-12-26 01:10:57,065][123090] Updated weights for policy 1, policy_version 199410 (0.0010) [2023-12-26 01:10:57,116][123090] Updated weights for policy 1, policy_version 199420 (0.0010) [2023-12-26 01:10:57,130][123091] Updated weights for policy 0, policy_version 200249 (0.0005) [2023-12-26 01:10:57,183][123091] Updated weights for policy 0, policy_version 200259 (0.0005) [2023-12-26 01:10:57,235][123091] Updated weights for policy 0, policy_version 200269 (0.0005) [2023-12-26 01:10:57,916][123090] Updated weights for policy 1, policy_version 199430 (0.0010) [2023-12-26 01:10:57,967][123091] Updated weights for policy 0, policy_version 200279 (0.0005) [2023-12-26 01:10:57,975][123090] Updated weights for policy 1, policy_version 199440 (0.0010) [2023-12-26 01:10:58,036][123091] Updated weights for policy 0, policy_version 200289 (0.0008) [2023-12-26 01:10:58,043][123090] Updated weights for policy 1, policy_version 199450 (0.0010) [2023-12-26 01:10:58,100][123091] Updated weights for policy 0, policy_version 200299 (0.0007) [2023-12-26 01:10:58,786][121949] Fps is (10 sec: 17200.8, 60 sec: 18022.0, 300 sec: 17744.6). Total num frames: 102342656. Throughput: 0: 9170.1, 1: 8984.8. Samples: 102340816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:10:58,786][121949] Avg episode reward: [(0, '5871.457'), (1, '5471.587')] [2023-12-26 01:10:58,893][123090] Updated weights for policy 1, policy_version 199460 (0.0010) [2023-12-26 01:10:58,956][123090] Updated weights for policy 1, policy_version 199470 (0.0008) [2023-12-26 01:10:58,957][123091] Updated weights for policy 0, policy_version 200309 (0.0008) [2023-12-26 01:10:59,019][123090] Updated weights for policy 1, policy_version 199480 (0.0008) [2023-12-26 01:10:59,022][123091] Updated weights for policy 0, policy_version 200319 (0.0008) [2023-12-26 01:10:59,080][123091] Updated weights for policy 0, policy_version 200329 (0.0008) [2023-12-26 01:10:59,813][123090] Updated weights for policy 1, policy_version 199490 (0.0007) [2023-12-26 01:10:59,882][123090] Updated weights for policy 1, policy_version 199500 (0.0010) [2023-12-26 01:10:59,889][123091] Updated weights for policy 0, policy_version 200339 (0.0006) [2023-12-26 01:10:59,947][123090] Updated weights for policy 1, policy_version 199510 (0.0008) [2023-12-26 01:10:59,951][123091] Updated weights for policy 0, policy_version 200349 (0.0008) [2023-12-26 01:11:00,000][123091] Updated weights for policy 0, policy_version 200359 (0.0009) [2023-12-26 01:11:00,011][123090] Updated weights for policy 1, policy_version 199520 (0.0005) [2023-12-26 01:11:00,752][123090] Updated weights for policy 1, policy_version 199530 (0.0009) [2023-12-26 01:11:00,807][123090] Updated weights for policy 1, policy_version 199540 (0.0009) [2023-12-26 01:11:00,858][123091] Updated weights for policy 0, policy_version 200369 (0.0010) [2023-12-26 01:11:00,870][123090] Updated weights for policy 1, policy_version 199550 (0.0009) [2023-12-26 01:11:00,909][123091] Updated weights for policy 0, policy_version 200379 (0.0009) [2023-12-26 01:11:00,954][123091] Updated weights for policy 0, policy_version 200389 (0.0008) [2023-12-26 01:11:01,002][123091] Updated weights for policy 0, policy_version 200399 (0.0005) [2023-12-26 01:11:01,769][123090] Updated weights for policy 1, policy_version 199560 (0.0008) [2023-12-26 01:11:01,804][123091] Updated weights for policy 0, policy_version 200410 (0.0008) [2023-12-26 01:11:01,832][123090] Updated weights for policy 1, policy_version 199570 (0.0007) [2023-12-26 01:11:01,858][123091] Updated weights for policy 0, policy_version 200420 (0.0009) [2023-12-26 01:11:01,889][123090] Updated weights for policy 1, policy_version 199580 (0.0008) [2023-12-26 01:11:01,918][123091] Updated weights for policy 0, policy_version 200430 (0.0007) [2023-12-26 01:11:02,673][123090] Updated weights for policy 1, policy_version 199590 (0.0007) [2023-12-26 01:11:02,727][123090] Updated weights for policy 1, policy_version 199600 (0.0006) [2023-12-26 01:11:02,784][123090] Updated weights for policy 1, policy_version 199610 (0.0009) [2023-12-26 01:11:02,803][123091] Updated weights for policy 0, policy_version 200440 (0.0007) [2023-12-26 01:11:02,865][123091] Updated weights for policy 0, policy_version 200450 (0.0008) [2023-12-26 01:11:02,921][123091] Updated weights for policy 0, policy_version 200460 (0.0009) [2023-12-26 01:11:03,466][123090] Updated weights for policy 1, policy_version 199620 (0.0008) [2023-12-26 01:11:03,532][123090] Updated weights for policy 1, policy_version 199630 (0.0005) [2023-12-26 01:11:03,582][123090] Updated weights for policy 1, policy_version 199640 (0.0005) [2023-12-26 01:11:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 102432768. Throughput: 0: 9070.1, 1: 8908.4. Samples: 102444264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:03,785][121949] Avg episode reward: [(0, '5885.099'), (1, '5394.525')] [2023-12-26 01:11:03,825][123091] Updated weights for policy 0, policy_version 200471 (0.0010) [2023-12-26 01:11:03,891][123091] Updated weights for policy 0, policy_version 200481 (0.0009) [2023-12-26 01:11:03,945][123091] Updated weights for policy 0, policy_version 200491 (0.0009) [2023-12-26 01:11:04,319][123090] Updated weights for policy 1, policy_version 199650 (0.0005) [2023-12-26 01:11:04,374][123090] Updated weights for policy 1, policy_version 199660 (0.0006) [2023-12-26 01:11:04,440][123090] Updated weights for policy 1, policy_version 199670 (0.0006) [2023-12-26 01:11:04,512][123090] Updated weights for policy 1, policy_version 199680 (0.0006) [2023-12-26 01:11:04,710][123091] Updated weights for policy 0, policy_version 200501 (0.0008) [2023-12-26 01:11:04,772][123091] Updated weights for policy 0, policy_version 200511 (0.0005) [2023-12-26 01:11:04,831][123091] Updated weights for policy 0, policy_version 200521 (0.0006) [2023-12-26 01:11:05,196][123090] Updated weights for policy 1, policy_version 199690 (0.0005) [2023-12-26 01:11:05,255][123090] Updated weights for policy 1, policy_version 199700 (0.0005) [2023-12-26 01:11:05,312][123090] Updated weights for policy 1, policy_version 199710 (0.0005) [2023-12-26 01:11:05,564][123091] Updated weights for policy 0, policy_version 200531 (0.0006) [2023-12-26 01:11:05,630][123091] Updated weights for policy 0, policy_version 200541 (0.0009) [2023-12-26 01:11:05,686][123091] Updated weights for policy 0, policy_version 200551 (0.0009) [2023-12-26 01:11:06,053][123090] Updated weights for policy 1, policy_version 199720 (0.0009) [2023-12-26 01:11:06,114][123090] Updated weights for policy 1, policy_version 199730 (0.0009) [2023-12-26 01:11:06,174][123090] Updated weights for policy 1, policy_version 199740 (0.0009) [2023-12-26 01:11:06,513][123091] Updated weights for policy 0, policy_version 200561 (0.0009) [2023-12-26 01:11:06,574][123091] Updated weights for policy 0, policy_version 200571 (0.0009) [2023-12-26 01:11:06,625][123091] Updated weights for policy 0, policy_version 200581 (0.0010) [2023-12-26 01:11:06,683][123091] Updated weights for policy 0, policy_version 200591 (0.0010) [2023-12-26 01:11:07,037][123090] Updated weights for policy 1, policy_version 199750 (0.0010) [2023-12-26 01:11:07,086][123090] Updated weights for policy 1, policy_version 199761 (0.0009) [2023-12-26 01:11:07,134][123090] Updated weights for policy 1, policy_version 199771 (0.0008) [2023-12-26 01:11:07,553][123091] Updated weights for policy 0, policy_version 200601 (0.0010) [2023-12-26 01:11:07,611][123091] Updated weights for policy 0, policy_version 200611 (0.0010) [2023-12-26 01:11:07,669][123091] Updated weights for policy 0, policy_version 200621 (0.0010) [2023-12-26 01:11:07,898][123090] Updated weights for policy 1, policy_version 199781 (0.0008) [2023-12-26 01:11:07,950][123090] Updated weights for policy 1, policy_version 199792 (0.0010) [2023-12-26 01:11:08,005][123090] Updated weights for policy 1, policy_version 199802 (0.0009) [2023-12-26 01:11:08,535][123091] Updated weights for policy 0, policy_version 200631 (0.0010) [2023-12-26 01:11:08,594][123091] Updated weights for policy 0, policy_version 200641 (0.0009) [2023-12-26 01:11:08,657][123091] Updated weights for policy 0, policy_version 200651 (0.0009) [2023-12-26 01:11:08,784][121949] Fps is (10 sec: 18025.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 102522880. Throughput: 0: 9100.7, 1: 8972.6. Samples: 102498972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:08,785][121949] Avg episode reward: [(0, '5902.614'), (1, '5431.373')] [2023-12-26 01:11:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000200656_51372032.pth... [2023-12-26 01:11:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000199808_51150848.pth... [2023-12-26 01:11:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000198784_50888704.pth [2023-12-26 01:11:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000199616_51101696.pth [2023-12-26 01:11:08,850][123090] Updated weights for policy 1, policy_version 199812 (0.0009) [2023-12-26 01:11:08,920][123090] Updated weights for policy 1, policy_version 199822 (0.0007) [2023-12-26 01:11:08,993][123090] Updated weights for policy 1, policy_version 199832 (0.0006) [2023-12-26 01:11:09,552][123091] Updated weights for policy 0, policy_version 200661 (0.0009) [2023-12-26 01:11:09,604][123091] Updated weights for policy 0, policy_version 200672 (0.0010) [2023-12-26 01:11:09,656][123091] Updated weights for policy 0, policy_version 200682 (0.0010) [2023-12-26 01:11:09,688][123090] Updated weights for policy 1, policy_version 199842 (0.0007) [2023-12-26 01:11:09,740][123090] Updated weights for policy 1, policy_version 199852 (0.0010) [2023-12-26 01:11:09,805][123090] Updated weights for policy 1, policy_version 199862 (0.0010) [2023-12-26 01:11:09,875][123090] Updated weights for policy 1, policy_version 199872 (0.0010) [2023-12-26 01:11:10,531][123091] Updated weights for policy 0, policy_version 200692 (0.0009) [2023-12-26 01:11:10,597][123091] Updated weights for policy 0, policy_version 200702 (0.0009) [2023-12-26 01:11:10,660][123091] Updated weights for policy 0, policy_version 200712 (0.0009) [2023-12-26 01:11:10,722][123090] Updated weights for policy 1, policy_version 199882 (0.0007) [2023-12-26 01:11:10,791][123090] Updated weights for policy 1, policy_version 199892 (0.0007) [2023-12-26 01:11:10,860][123090] Updated weights for policy 1, policy_version 199902 (0.0010) [2023-12-26 01:11:11,567][123091] Updated weights for policy 0, policy_version 200722 (0.0008) [2023-12-26 01:11:11,633][123091] Updated weights for policy 0, policy_version 200732 (0.0009) [2023-12-26 01:11:11,665][123090] Updated weights for policy 1, policy_version 199912 (0.0009) [2023-12-26 01:11:11,689][123091] Updated weights for policy 0, policy_version 200742 (0.0008) [2023-12-26 01:11:11,743][123090] Updated weights for policy 1, policy_version 199922 (0.0009) [2023-12-26 01:11:11,760][123091] Updated weights for policy 0, policy_version 200752 (0.0009) [2023-12-26 01:11:11,813][123090] Updated weights for policy 1, policy_version 199932 (0.0010) [2023-12-26 01:11:12,621][123090] Updated weights for policy 1, policy_version 199942 (0.0009) [2023-12-26 01:11:12,653][123091] Updated weights for policy 0, policy_version 200762 (0.0006) [2023-12-26 01:11:12,689][123090] Updated weights for policy 1, policy_version 199952 (0.0011) [2023-12-26 01:11:12,717][123091] Updated weights for policy 0, policy_version 200772 (0.0006) [2023-12-26 01:11:12,757][123090] Updated weights for policy 1, policy_version 199962 (0.0011) [2023-12-26 01:11:12,783][123091] Updated weights for policy 0, policy_version 200782 (0.0006) [2023-12-26 01:11:13,463][123090] Updated weights for policy 1, policy_version 199972 (0.0007) [2023-12-26 01:11:13,529][123090] Updated weights for policy 1, policy_version 199982 (0.0005) [2023-12-26 01:11:13,600][123090] Updated weights for policy 1, policy_version 199992 (0.0005) [2023-12-26 01:11:13,659][123091] Updated weights for policy 0, policy_version 200792 (0.0009) [2023-12-26 01:11:13,717][123091] Updated weights for policy 0, policy_version 200802 (0.0010) [2023-12-26 01:11:13,778][123091] Updated weights for policy 0, policy_version 200812 (0.0010) [2023-12-26 01:11:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 102604800. Throughput: 0: 8964.3, 1: 8839.4. Samples: 102600716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:13,785][121949] Avg episode reward: [(0, '5943.790'), (1, '5555.004')] [2023-12-26 01:11:14,177][123090] Updated weights for policy 1, policy_version 200002 (0.0006) [2023-12-26 01:11:14,246][123090] Updated weights for policy 1, policy_version 200012 (0.0006) [2023-12-26 01:11:14,311][123090] Updated weights for policy 1, policy_version 200022 (0.0008) [2023-12-26 01:11:14,382][123090] Updated weights for policy 1, policy_version 200032 (0.0006) [2023-12-26 01:11:14,676][123091] Updated weights for policy 0, policy_version 200822 (0.0010) [2023-12-26 01:11:14,737][123091] Updated weights for policy 0, policy_version 200832 (0.0009) [2023-12-26 01:11:14,811][123091] Updated weights for policy 0, policy_version 200842 (0.0009) [2023-12-26 01:11:15,098][123090] Updated weights for policy 1, policy_version 200042 (0.0010) [2023-12-26 01:11:15,155][123090] Updated weights for policy 1, policy_version 200052 (0.0009) [2023-12-26 01:11:15,204][123090] Updated weights for policy 1, policy_version 200062 (0.0009) [2023-12-26 01:11:15,661][123091] Updated weights for policy 0, policy_version 200852 (0.0009) [2023-12-26 01:11:15,721][123091] Updated weights for policy 0, policy_version 200862 (0.0010) [2023-12-26 01:11:15,789][123091] Updated weights for policy 0, policy_version 200872 (0.0009) [2023-12-26 01:11:16,072][123090] Updated weights for policy 1, policy_version 200072 (0.0010) [2023-12-26 01:11:16,135][123090] Updated weights for policy 1, policy_version 200082 (0.0010) [2023-12-26 01:11:16,189][123090] Updated weights for policy 1, policy_version 200092 (0.0010) [2023-12-26 01:11:16,642][123091] Updated weights for policy 0, policy_version 200882 (0.0009) [2023-12-26 01:11:16,696][123091] Updated weights for policy 0, policy_version 200892 (0.0009) [2023-12-26 01:11:16,757][123091] Updated weights for policy 0, policy_version 200902 (0.0005) [2023-12-26 01:11:16,819][123091] Updated weights for policy 0, policy_version 200912 (0.0005) [2023-12-26 01:11:16,946][123090] Updated weights for policy 1, policy_version 200102 (0.0007) [2023-12-26 01:11:17,003][123090] Updated weights for policy 1, policy_version 200112 (0.0005) [2023-12-26 01:11:17,057][123090] Updated weights for policy 1, policy_version 200122 (0.0010) [2023-12-26 01:11:17,575][123091] Updated weights for policy 0, policy_version 200922 (0.0009) [2023-12-26 01:11:17,635][123091] Updated weights for policy 0, policy_version 200932 (0.0008) [2023-12-26 01:11:17,696][123091] Updated weights for policy 0, policy_version 200942 (0.0009) [2023-12-26 01:11:17,852][123090] Updated weights for policy 1, policy_version 200132 (0.0010) [2023-12-26 01:11:17,906][123090] Updated weights for policy 1, policy_version 200142 (0.0010) [2023-12-26 01:11:17,957][123090] Updated weights for policy 1, policy_version 200152 (0.0010) [2023-12-26 01:11:18,531][123091] Updated weights for policy 0, policy_version 200952 (0.0008) [2023-12-26 01:11:18,598][123091] Updated weights for policy 0, policy_version 200962 (0.0008) [2023-12-26 01:11:18,651][123091] Updated weights for policy 0, policy_version 200972 (0.0010) [2023-12-26 01:11:18,766][123090] Updated weights for policy 1, policy_version 200162 (0.0009) [2023-12-26 01:11:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 102694912. Throughput: 0: 8798.0, 1: 8878.7. Samples: 102705740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:18,785][121949] Avg episode reward: [(0, '5877.346'), (1, '5549.285')] [2023-12-26 01:11:18,829][123090] Updated weights for policy 1, policy_version 200172 (0.0006) [2023-12-26 01:11:18,894][123090] Updated weights for policy 1, policy_version 200182 (0.0010) [2023-12-26 01:11:18,958][123090] Updated weights for policy 1, policy_version 200192 (0.0010) [2023-12-26 01:11:19,417][123091] Updated weights for policy 0, policy_version 200982 (0.0009) [2023-12-26 01:11:19,483][123091] Updated weights for policy 0, policy_version 200992 (0.0011) [2023-12-26 01:11:19,558][123091] Updated weights for policy 0, policy_version 201002 (0.0011) [2023-12-26 01:11:19,735][123090] Updated weights for policy 1, policy_version 200202 (0.0008) [2023-12-26 01:11:19,794][123090] Updated weights for policy 1, policy_version 200212 (0.0009) [2023-12-26 01:11:19,857][123090] Updated weights for policy 1, policy_version 200222 (0.0009) [2023-12-26 01:11:20,386][123091] Updated weights for policy 0, policy_version 201012 (0.0011) [2023-12-26 01:11:20,443][123091] Updated weights for policy 0, policy_version 201022 (0.0009) [2023-12-26 01:11:20,504][123091] Updated weights for policy 0, policy_version 201032 (0.0009) [2023-12-26 01:11:20,748][123090] Updated weights for policy 1, policy_version 200232 (0.0009) [2023-12-26 01:11:20,809][123090] Updated weights for policy 1, policy_version 200242 (0.0009) [2023-12-26 01:11:20,858][123090] Updated weights for policy 1, policy_version 200252 (0.0008) [2023-12-26 01:11:21,404][123091] Updated weights for policy 0, policy_version 201042 (0.0009) [2023-12-26 01:11:21,469][123091] Updated weights for policy 0, policy_version 201052 (0.0009) [2023-12-26 01:11:21,534][123091] Updated weights for policy 0, policy_version 201062 (0.0009) [2023-12-26 01:11:21,594][123091] Updated weights for policy 0, policy_version 201072 (0.0009) [2023-12-26 01:11:21,740][123090] Updated weights for policy 1, policy_version 200262 (0.0008) [2023-12-26 01:11:21,818][123090] Updated weights for policy 1, policy_version 200272 (0.0007) [2023-12-26 01:11:21,892][123090] Updated weights for policy 1, policy_version 200282 (0.0006) [2023-12-26 01:11:22,453][123091] Updated weights for policy 0, policy_version 201082 (0.0009) [2023-12-26 01:11:22,517][123091] Updated weights for policy 0, policy_version 201092 (0.0009) [2023-12-26 01:11:22,576][123091] Updated weights for policy 0, policy_version 201102 (0.0009) [2023-12-26 01:11:22,626][123090] Updated weights for policy 1, policy_version 200292 (0.0007) [2023-12-26 01:11:22,706][123090] Updated weights for policy 1, policy_version 200302 (0.0007) [2023-12-26 01:11:22,781][123090] Updated weights for policy 1, policy_version 200312 (0.0011) [2023-12-26 01:11:23,255][123091] Updated weights for policy 0, policy_version 201112 (0.0007) [2023-12-26 01:11:23,314][123091] Updated weights for policy 0, policy_version 201122 (0.0006) [2023-12-26 01:11:23,371][123091] Updated weights for policy 0, policy_version 201132 (0.0006) [2023-12-26 01:11:23,437][123090] Updated weights for policy 1, policy_version 200322 (0.0009) [2023-12-26 01:11:23,490][123090] Updated weights for policy 1, policy_version 200332 (0.0005) [2023-12-26 01:11:23,547][123090] Updated weights for policy 1, policy_version 200342 (0.0009) [2023-12-26 01:11:23,620][123090] Updated weights for policy 1, policy_version 200352 (0.0010) [2023-12-26 01:11:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 102785024. Throughput: 0: 8703.5, 1: 8895.0. Samples: 102757040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:23,785][121949] Avg episode reward: [(0, '5912.922'), (1, '5343.087')] [2023-12-26 01:11:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000201136_51494912.pth... [2023-12-26 01:11:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000200352_51290112.pth... [2023-12-26 01:11:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000200144_51240960.pth [2023-12-26 01:11:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000199296_51019776.pth [2023-12-26 01:11:24,126][123091] Updated weights for policy 0, policy_version 201142 (0.0009) [2023-12-26 01:11:24,203][123091] Updated weights for policy 0, policy_version 201152 (0.0010) [2023-12-26 01:11:24,266][123091] Updated weights for policy 0, policy_version 201162 (0.0011) [2023-12-26 01:11:24,328][123090] Updated weights for policy 1, policy_version 200362 (0.0009) [2023-12-26 01:11:24,401][123090] Updated weights for policy 1, policy_version 200372 (0.0006) [2023-12-26 01:11:24,467][123090] Updated weights for policy 1, policy_version 200382 (0.0005) [2023-12-26 01:11:25,073][123091] Updated weights for policy 0, policy_version 201172 (0.0010) [2023-12-26 01:11:25,120][123091] Updated weights for policy 0, policy_version 201182 (0.0010) [2023-12-26 01:11:25,171][123091] Updated weights for policy 0, policy_version 201192 (0.0010) [2023-12-26 01:11:25,175][123090] Updated weights for policy 1, policy_version 200392 (0.0010) [2023-12-26 01:11:25,238][123090] Updated weights for policy 1, policy_version 200402 (0.0010) [2023-12-26 01:11:25,300][123090] Updated weights for policy 1, policy_version 200412 (0.0010) [2023-12-26 01:11:25,864][123091] Updated weights for policy 0, policy_version 201202 (0.0010) [2023-12-26 01:11:25,926][123091] Updated weights for policy 0, policy_version 201212 (0.0011) [2023-12-26 01:11:25,970][123090] Updated weights for policy 1, policy_version 200422 (0.0005) [2023-12-26 01:11:25,978][123091] Updated weights for policy 0, policy_version 201222 (0.0010) [2023-12-26 01:11:26,031][123090] Updated weights for policy 1, policy_version 200432 (0.0011) [2023-12-26 01:11:26,041][123091] Updated weights for policy 0, policy_version 201232 (0.0011) [2023-12-26 01:11:26,086][123090] Updated weights for policy 1, policy_version 200442 (0.0010) [2023-12-26 01:11:26,792][123090] Updated weights for policy 1, policy_version 200452 (0.0009) [2023-12-26 01:11:26,840][123090] Updated weights for policy 1, policy_version 200462 (0.0006) [2023-12-26 01:11:26,865][123091] Updated weights for policy 0, policy_version 201242 (0.0011) [2023-12-26 01:11:26,892][123090] Updated weights for policy 1, policy_version 200472 (0.0005) [2023-12-26 01:11:26,915][123091] Updated weights for policy 0, policy_version 201252 (0.0010) [2023-12-26 01:11:26,963][123091] Updated weights for policy 0, policy_version 201262 (0.0005) [2023-12-26 01:11:27,638][123090] Updated weights for policy 1, policy_version 200482 (0.0006) [2023-12-26 01:11:27,690][123090] Updated weights for policy 1, policy_version 200492 (0.0006) [2023-12-26 01:11:27,740][123090] Updated weights for policy 1, policy_version 200502 (0.0010) [2023-12-26 01:11:27,787][123091] Updated weights for policy 0, policy_version 201272 (0.0009) [2023-12-26 01:11:27,796][123090] Updated weights for policy 1, policy_version 200512 (0.0010) [2023-12-26 01:11:27,838][123091] Updated weights for policy 0, policy_version 201282 (0.0010) [2023-12-26 01:11:27,881][123091] Updated weights for policy 0, policy_version 201292 (0.0010) [2023-12-26 01:11:28,482][123090] Updated weights for policy 1, policy_version 200522 (0.0005) [2023-12-26 01:11:28,542][123090] Updated weights for policy 1, policy_version 200532 (0.0005) [2023-12-26 01:11:28,602][123090] Updated weights for policy 1, policy_version 200542 (0.0005) [2023-12-26 01:11:28,744][123091] Updated weights for policy 0, policy_version 201302 (0.0010) [2023-12-26 01:11:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 102875136. Throughput: 0: 8760.8, 1: 8977.3. Samples: 102868524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:28,784][121949] Avg episode reward: [(0, '5958.271'), (1, '5284.987')] [2023-12-26 01:11:28,807][123091] Updated weights for policy 0, policy_version 201312 (0.0010) [2023-12-26 01:11:28,880][123091] Updated weights for policy 0, policy_version 201322 (0.0011) [2023-12-26 01:11:28,919][123007] Saving new best policy, reward=5958.271! [2023-12-26 01:11:29,278][123090] Updated weights for policy 1, policy_version 200552 (0.0007) [2023-12-26 01:11:29,344][123090] Updated weights for policy 1, policy_version 200562 (0.0008) [2023-12-26 01:11:29,402][123090] Updated weights for policy 1, policy_version 200572 (0.0010) [2023-12-26 01:11:29,650][123091] Updated weights for policy 0, policy_version 201332 (0.0010) [2023-12-26 01:11:29,706][123091] Updated weights for policy 0, policy_version 201342 (0.0006) [2023-12-26 01:11:29,760][123091] Updated weights for policy 0, policy_version 201352 (0.0005) [2023-12-26 01:11:30,188][123090] Updated weights for policy 1, policy_version 200582 (0.0007) [2023-12-26 01:11:30,260][123090] Updated weights for policy 1, policy_version 200592 (0.0005) [2023-12-26 01:11:30,331][123090] Updated weights for policy 1, policy_version 200602 (0.0005) [2023-12-26 01:11:30,585][123091] Updated weights for policy 0, policy_version 201362 (0.0006) [2023-12-26 01:11:30,642][123091] Updated weights for policy 0, policy_version 201372 (0.0010) [2023-12-26 01:11:30,705][123091] Updated weights for policy 0, policy_version 201382 (0.0010) [2023-12-26 01:11:30,753][123091] Updated weights for policy 0, policy_version 201392 (0.0010) [2023-12-26 01:11:30,965][123090] Updated weights for policy 1, policy_version 200612 (0.0007) [2023-12-26 01:11:31,033][123090] Updated weights for policy 1, policy_version 200622 (0.0007) [2023-12-26 01:11:31,096][123090] Updated weights for policy 1, policy_version 200632 (0.0007) [2023-12-26 01:11:31,519][123091] Updated weights for policy 0, policy_version 201402 (0.0006) [2023-12-26 01:11:31,586][123091] Updated weights for policy 0, policy_version 201412 (0.0006) [2023-12-26 01:11:31,652][123091] Updated weights for policy 0, policy_version 201422 (0.0008) [2023-12-26 01:11:31,829][123090] Updated weights for policy 1, policy_version 200642 (0.0008) [2023-12-26 01:11:31,898][123090] Updated weights for policy 1, policy_version 200652 (0.0008) [2023-12-26 01:11:31,970][123090] Updated weights for policy 1, policy_version 200662 (0.0008) [2023-12-26 01:11:32,039][123090] Updated weights for policy 1, policy_version 200672 (0.0008) [2023-12-26 01:11:32,341][123091] Updated weights for policy 0, policy_version 201432 (0.0009) [2023-12-26 01:11:32,407][123091] Updated weights for policy 0, policy_version 201442 (0.0009) [2023-12-26 01:11:32,465][123091] Updated weights for policy 0, policy_version 201452 (0.0009) [2023-12-26 01:11:32,875][123090] Updated weights for policy 1, policy_version 200682 (0.0010) [2023-12-26 01:11:32,939][123090] Updated weights for policy 1, policy_version 200692 (0.0009) [2023-12-26 01:11:33,001][123090] Updated weights for policy 1, policy_version 200702 (0.0009) [2023-12-26 01:11:33,211][123091] Updated weights for policy 0, policy_version 201462 (0.0007) [2023-12-26 01:11:33,262][123091] Updated weights for policy 0, policy_version 201472 (0.0005) [2023-12-26 01:11:33,307][123091] Updated weights for policy 0, policy_version 201482 (0.0005) [2023-12-26 01:11:33,724][123090] Updated weights for policy 1, policy_version 200712 (0.0005) [2023-12-26 01:11:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 102965248. Throughput: 0: 8729.1, 1: 9088.4. Samples: 102980760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:33,785][121949] Avg episode reward: [(0, '5922.572'), (1, '5393.946')] [2023-12-26 01:11:33,799][123090] Updated weights for policy 1, policy_version 200722 (0.0005) [2023-12-26 01:11:33,867][123090] Updated weights for policy 1, policy_version 200732 (0.0005) [2023-12-26 01:11:33,965][123091] Updated weights for policy 0, policy_version 201492 (0.0005) [2023-12-26 01:11:34,010][123091] Updated weights for policy 0, policy_version 201502 (0.0005) [2023-12-26 01:11:34,069][123091] Updated weights for policy 0, policy_version 201512 (0.0005) [2023-12-26 01:11:34,555][123090] Updated weights for policy 1, policy_version 200742 (0.0008) [2023-12-26 01:11:34,627][123090] Updated weights for policy 1, policy_version 200752 (0.0010) [2023-12-26 01:11:34,685][123090] Updated weights for policy 1, policy_version 200762 (0.0010) [2023-12-26 01:11:34,814][123091] Updated weights for policy 0, policy_version 201522 (0.0005) [2023-12-26 01:11:34,868][123091] Updated weights for policy 0, policy_version 201532 (0.0005) [2023-12-26 01:11:34,916][123091] Updated weights for policy 0, policy_version 201542 (0.0005) [2023-12-26 01:11:34,967][123091] Updated weights for policy 0, policy_version 201552 (0.0005) [2023-12-26 01:11:35,581][123090] Updated weights for policy 1, policy_version 200772 (0.0010) [2023-12-26 01:11:35,632][123090] Updated weights for policy 1, policy_version 200782 (0.0009) [2023-12-26 01:11:35,684][123091] Updated weights for policy 0, policy_version 201562 (0.0006) [2023-12-26 01:11:35,685][123090] Updated weights for policy 1, policy_version 200792 (0.0009) [2023-12-26 01:11:35,740][123091] Updated weights for policy 0, policy_version 201572 (0.0005) [2023-12-26 01:11:35,797][123091] Updated weights for policy 0, policy_version 201582 (0.0005) [2023-12-26 01:11:36,427][123091] Updated weights for policy 0, policy_version 201592 (0.0005) [2023-12-26 01:11:36,495][123091] Updated weights for policy 0, policy_version 201602 (0.0006) [2023-12-26 01:11:36,567][123091] Updated weights for policy 0, policy_version 201612 (0.0006) [2023-12-26 01:11:36,640][123090] Updated weights for policy 1, policy_version 200802 (0.0009) [2023-12-26 01:11:36,713][123090] Updated weights for policy 1, policy_version 200812 (0.0010) [2023-12-26 01:11:36,772][123090] Updated weights for policy 1, policy_version 200822 (0.0010) [2023-12-26 01:11:36,831][123090] Updated weights for policy 1, policy_version 200832 (0.0010) [2023-12-26 01:11:37,193][123091] Updated weights for policy 0, policy_version 201622 (0.0006) [2023-12-26 01:11:37,253][123091] Updated weights for policy 0, policy_version 201632 (0.0007) [2023-12-26 01:11:37,307][123091] Updated weights for policy 0, policy_version 201642 (0.0010) [2023-12-26 01:11:37,625][123090] Updated weights for policy 1, policy_version 200842 (0.0011) [2023-12-26 01:11:37,687][123090] Updated weights for policy 1, policy_version 200852 (0.0007) [2023-12-26 01:11:37,744][123090] Updated weights for policy 1, policy_version 200862 (0.0006) [2023-12-26 01:11:38,098][123091] Updated weights for policy 0, policy_version 201652 (0.0011) [2023-12-26 01:11:38,149][123091] Updated weights for policy 0, policy_version 201662 (0.0010) [2023-12-26 01:11:38,200][123091] Updated weights for policy 0, policy_version 201672 (0.0010) [2023-12-26 01:11:38,404][123090] Updated weights for policy 1, policy_version 200872 (0.0008) [2023-12-26 01:11:38,460][123090] Updated weights for policy 1, policy_version 200882 (0.0008) [2023-12-26 01:11:38,526][123090] Updated weights for policy 1, policy_version 200892 (0.0008) [2023-12-26 01:11:38,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 103063552. Throughput: 0: 8835.2, 1: 9073.3. Samples: 103036348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:11:38,785][121949] Avg episode reward: [(0, '5879.095'), (1, '5132.750')] [2023-12-26 01:11:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000201680_51634176.pth... [2023-12-26 01:11:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000200896_51429376.pth... [2023-12-26 01:11:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000200656_51372032.pth [2023-12-26 01:11:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000199808_51150848.pth [2023-12-26 01:11:38,986][123091] Updated weights for policy 0, policy_version 201682 (0.0010) [2023-12-26 01:11:39,046][123091] Updated weights for policy 0, policy_version 201692 (0.0010) [2023-12-26 01:11:39,106][123091] Updated weights for policy 0, policy_version 201702 (0.0011) [2023-12-26 01:11:39,156][123090] Updated weights for policy 1, policy_version 200902 (0.0006) [2023-12-26 01:11:39,158][123091] Updated weights for policy 0, policy_version 201712 (0.0010) [2023-12-26 01:11:39,216][123090] Updated weights for policy 1, policy_version 200912 (0.0009) [2023-12-26 01:11:39,289][123090] Updated weights for policy 1, policy_version 200922 (0.0009) [2023-12-26 01:11:39,997][123091] Updated weights for policy 0, policy_version 201722 (0.0010) [2023-12-26 01:11:40,053][123091] Updated weights for policy 0, policy_version 201732 (0.0010) [2023-12-26 01:11:40,115][123091] Updated weights for policy 0, policy_version 201742 (0.0008) [2023-12-26 01:11:40,151][123090] Updated weights for policy 1, policy_version 200932 (0.0009) [2023-12-26 01:11:40,218][123090] Updated weights for policy 1, policy_version 200942 (0.0009) [2023-12-26 01:11:40,282][123090] Updated weights for policy 1, policy_version 200952 (0.0009) [2023-12-26 01:11:40,897][123091] Updated weights for policy 0, policy_version 201752 (0.0009) [2023-12-26 01:11:40,956][123091] Updated weights for policy 0, policy_version 201762 (0.0011) [2023-12-26 01:11:41,028][123091] Updated weights for policy 0, policy_version 201772 (0.0011) [2023-12-26 01:11:41,126][123090] Updated weights for policy 1, policy_version 200962 (0.0009) [2023-12-26 01:11:41,195][123090] Updated weights for policy 1, policy_version 200972 (0.0008) [2023-12-26 01:11:41,265][123090] Updated weights for policy 1, policy_version 200982 (0.0008) [2023-12-26 01:11:41,326][123090] Updated weights for policy 1, policy_version 200992 (0.0008) [2023-12-26 01:11:41,942][123091] Updated weights for policy 0, policy_version 201782 (0.0010) [2023-12-26 01:11:41,999][123091] Updated weights for policy 0, policy_version 201792 (0.0009) [2023-12-26 01:11:42,068][123091] Updated weights for policy 0, policy_version 201802 (0.0008) [2023-12-26 01:11:42,165][123090] Updated weights for policy 1, policy_version 201002 (0.0011) [2023-12-26 01:11:42,237][123090] Updated weights for policy 1, policy_version 201012 (0.0011) [2023-12-26 01:11:42,310][123090] Updated weights for policy 1, policy_version 201022 (0.0011) [2023-12-26 01:11:42,787][123091] Updated weights for policy 0, policy_version 201812 (0.0007) [2023-12-26 01:11:42,856][123091] Updated weights for policy 0, policy_version 201822 (0.0005) [2023-12-26 01:11:42,911][123091] Updated weights for policy 0, policy_version 201832 (0.0006) [2023-12-26 01:11:43,041][123090] Updated weights for policy 1, policy_version 201032 (0.0007) [2023-12-26 01:11:43,092][123090] Updated weights for policy 1, policy_version 201042 (0.0005) [2023-12-26 01:11:43,159][123090] Updated weights for policy 1, policy_version 201052 (0.0006) [2023-12-26 01:11:43,516][123091] Updated weights for policy 0, policy_version 201842 (0.0006) [2023-12-26 01:11:43,579][123091] Updated weights for policy 0, policy_version 201852 (0.0008) [2023-12-26 01:11:43,644][123091] Updated weights for policy 0, policy_version 201862 (0.0008) [2023-12-26 01:11:43,703][123091] Updated weights for policy 0, policy_version 201872 (0.0009) [2023-12-26 01:11:43,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 103153664. Throughput: 0: 8773.1, 1: 9059.6. Samples: 103143264. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:11:43,785][121949] Avg episode reward: [(0, '5873.103'), (1, '5192.040')] [2023-12-26 01:11:43,840][123090] Updated weights for policy 1, policy_version 201062 (0.0007) [2023-12-26 01:11:43,896][123090] Updated weights for policy 1, policy_version 201072 (0.0005) [2023-12-26 01:11:43,953][123090] Updated weights for policy 1, policy_version 201082 (0.0008) [2023-12-26 01:11:44,510][123091] Updated weights for policy 0, policy_version 201882 (0.0006) [2023-12-26 01:11:44,581][123091] Updated weights for policy 0, policy_version 201892 (0.0006) [2023-12-26 01:11:44,647][123091] Updated weights for policy 0, policy_version 201902 (0.0006) [2023-12-26 01:11:44,813][123090] Updated weights for policy 1, policy_version 201092 (0.0010) [2023-12-26 01:11:44,884][123090] Updated weights for policy 1, policy_version 201102 (0.0009) [2023-12-26 01:11:44,949][123090] Updated weights for policy 1, policy_version 201112 (0.0009) [2023-12-26 01:11:45,396][123091] Updated weights for policy 0, policy_version 201912 (0.0010) [2023-12-26 01:11:45,443][123091] Updated weights for policy 0, policy_version 201922 (0.0010) [2023-12-26 01:11:45,490][123091] Updated weights for policy 0, policy_version 201932 (0.0010) [2023-12-26 01:11:45,795][123090] Updated weights for policy 1, policy_version 201122 (0.0009) [2023-12-26 01:11:45,860][123090] Updated weights for policy 1, policy_version 201132 (0.0010) [2023-12-26 01:11:45,910][123090] Updated weights for policy 1, policy_version 201142 (0.0009) [2023-12-26 01:11:45,959][123090] Updated weights for policy 1, policy_version 201152 (0.0009) [2023-12-26 01:11:46,307][123091] Updated weights for policy 0, policy_version 201942 (0.0009) [2023-12-26 01:11:46,360][123091] Updated weights for policy 0, policy_version 201952 (0.0010) [2023-12-26 01:11:46,414][123091] Updated weights for policy 0, policy_version 201962 (0.0010) [2023-12-26 01:11:46,768][123090] Updated weights for policy 1, policy_version 201162 (0.0005) [2023-12-26 01:11:46,824][123090] Updated weights for policy 1, policy_version 201172 (0.0005) [2023-12-26 01:11:46,873][123090] Updated weights for policy 1, policy_version 201182 (0.0006) [2023-12-26 01:11:47,290][123091] Updated weights for policy 0, policy_version 201972 (0.0010) [2023-12-26 01:11:47,344][123091] Updated weights for policy 0, policy_version 201982 (0.0010) [2023-12-26 01:11:47,406][123091] Updated weights for policy 0, policy_version 201992 (0.0011) [2023-12-26 01:11:47,528][123090] Updated weights for policy 1, policy_version 201192 (0.0006) [2023-12-26 01:11:47,575][123090] Updated weights for policy 1, policy_version 201202 (0.0005) [2023-12-26 01:11:47,626][123090] Updated weights for policy 1, policy_version 201212 (0.0005) [2023-12-26 01:11:48,176][123091] Updated weights for policy 0, policy_version 202002 (0.0010) [2023-12-26 01:11:48,242][123091] Updated weights for policy 0, policy_version 202012 (0.0007) [2023-12-26 01:11:48,308][123091] Updated weights for policy 0, policy_version 202022 (0.0006) [2023-12-26 01:11:48,337][123090] Updated weights for policy 1, policy_version 201222 (0.0006) [2023-12-26 01:11:48,378][123091] Updated weights for policy 0, policy_version 202032 (0.0007) [2023-12-26 01:11:48,397][123090] Updated weights for policy 1, policy_version 201232 (0.0008) [2023-12-26 01:11:48,464][123090] Updated weights for policy 1, policy_version 201242 (0.0010) [2023-12-26 01:11:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 103243776. Throughput: 0: 8877.4, 1: 9114.3. Samples: 103253892. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:11:48,784][121949] Avg episode reward: [(0, '5870.416'), (1, '5518.617')] [2023-12-26 01:11:49,160][123091] Updated weights for policy 0, policy_version 202042 (0.0009) [2023-12-26 01:11:49,207][123091] Updated weights for policy 0, policy_version 202052 (0.0008) [2023-12-26 01:11:49,208][123090] Updated weights for policy 1, policy_version 201252 (0.0011) [2023-12-26 01:11:49,274][123091] Updated weights for policy 0, policy_version 202062 (0.0008) [2023-12-26 01:11:49,275][123090] Updated weights for policy 1, policy_version 201262 (0.0007) [2023-12-26 01:11:49,343][123090] Updated weights for policy 1, policy_version 201272 (0.0006) [2023-12-26 01:11:50,047][123091] Updated weights for policy 0, policy_version 202072 (0.0006) [2023-12-26 01:11:50,100][123091] Updated weights for policy 0, policy_version 202082 (0.0006) [2023-12-26 01:11:50,127][123090] Updated weights for policy 1, policy_version 201282 (0.0008) [2023-12-26 01:11:50,152][123091] Updated weights for policy 0, policy_version 202092 (0.0007) [2023-12-26 01:11:50,180][123090] Updated weights for policy 1, policy_version 201292 (0.0006) [2023-12-26 01:11:50,241][123090] Updated weights for policy 1, policy_version 201302 (0.0005) [2023-12-26 01:11:50,310][123090] Updated weights for policy 1, policy_version 201312 (0.0006) [2023-12-26 01:11:50,797][123091] Updated weights for policy 0, policy_version 202102 (0.0006) [2023-12-26 01:11:50,869][123091] Updated weights for policy 0, policy_version 202112 (0.0006) [2023-12-26 01:11:50,942][123091] Updated weights for policy 0, policy_version 202122 (0.0006) [2023-12-26 01:11:51,119][123090] Updated weights for policy 1, policy_version 201322 (0.0010) [2023-12-26 01:11:51,192][123090] Updated weights for policy 1, policy_version 201332 (0.0011) [2023-12-26 01:11:51,260][123090] Updated weights for policy 1, policy_version 201342 (0.0010) [2023-12-26 01:11:51,620][123091] Updated weights for policy 0, policy_version 202132 (0.0007) [2023-12-26 01:11:51,686][123091] Updated weights for policy 0, policy_version 202142 (0.0009) [2023-12-26 01:11:51,763][123091] Updated weights for policy 0, policy_version 202152 (0.0010) [2023-12-26 01:11:52,120][123090] Updated weights for policy 1, policy_version 201352 (0.0011) [2023-12-26 01:11:52,188][123090] Updated weights for policy 1, policy_version 201362 (0.0011) [2023-12-26 01:11:52,262][123090] Updated weights for policy 1, policy_version 201372 (0.0010) [2023-12-26 01:11:52,565][123091] Updated weights for policy 0, policy_version 202162 (0.0009) [2023-12-26 01:11:52,633][123091] Updated weights for policy 0, policy_version 202172 (0.0009) [2023-12-26 01:11:52,694][123091] Updated weights for policy 0, policy_version 202182 (0.0009) [2023-12-26 01:11:52,750][123091] Updated weights for policy 0, policy_version 202192 (0.0009) [2023-12-26 01:11:53,078][123090] Updated weights for policy 1, policy_version 201382 (0.0010) [2023-12-26 01:11:53,143][123090] Updated weights for policy 1, policy_version 201392 (0.0005) [2023-12-26 01:11:53,203][123090] Updated weights for policy 1, policy_version 201402 (0.0005) [2023-12-26 01:11:53,589][123091] Updated weights for policy 0, policy_version 202202 (0.0011) [2023-12-26 01:11:53,648][123091] Updated weights for policy 0, policy_version 202212 (0.0011) [2023-12-26 01:11:53,708][123091] Updated weights for policy 0, policy_version 202222 (0.0010) [2023-12-26 01:11:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 103333888. Throughput: 0: 8921.7, 1: 9078.9. Samples: 103309004. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:11:53,785][121949] Avg episode reward: [(0, '5831.489'), (1, '5489.442')] [2023-12-26 01:11:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000201408_51560448.pth... [2023-12-26 01:11:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000202224_51773440.pth... [2023-12-26 01:11:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000200352_51290112.pth [2023-12-26 01:11:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000201136_51494912.pth [2023-12-26 01:11:53,926][123090] Updated weights for policy 1, policy_version 201412 (0.0008) [2023-12-26 01:11:53,992][123090] Updated weights for policy 1, policy_version 201422 (0.0005) [2023-12-26 01:11:54,047][123090] Updated weights for policy 1, policy_version 201432 (0.0009) [2023-12-26 01:11:54,445][123091] Updated weights for policy 0, policy_version 202232 (0.0010) [2023-12-26 01:11:54,519][123091] Updated weights for policy 0, policy_version 202242 (0.0011) [2023-12-26 01:11:54,596][123091] Updated weights for policy 0, policy_version 202252 (0.0011) [2023-12-26 01:11:54,737][123090] Updated weights for policy 1, policy_version 201442 (0.0009) [2023-12-26 01:11:54,802][123090] Updated weights for policy 1, policy_version 201452 (0.0005) [2023-12-26 01:11:54,877][123090] Updated weights for policy 1, policy_version 201462 (0.0005) [2023-12-26 01:11:54,952][123090] Updated weights for policy 1, policy_version 201472 (0.0005) [2023-12-26 01:11:55,355][123091] Updated weights for policy 0, policy_version 202262 (0.0010) [2023-12-26 01:11:55,415][123091] Updated weights for policy 0, policy_version 202272 (0.0009) [2023-12-26 01:11:55,463][123091] Updated weights for policy 0, policy_version 202282 (0.0009) [2023-12-26 01:11:55,661][123090] Updated weights for policy 1, policy_version 201482 (0.0010) [2023-12-26 01:11:55,720][123090] Updated weights for policy 1, policy_version 201492 (0.0010) [2023-12-26 01:11:55,779][123090] Updated weights for policy 1, policy_version 201502 (0.0010) [2023-12-26 01:11:56,301][123091] Updated weights for policy 0, policy_version 202292 (0.0009) [2023-12-26 01:11:56,360][123091] Updated weights for policy 0, policy_version 202302 (0.0009) [2023-12-26 01:11:56,415][123091] Updated weights for policy 0, policy_version 202312 (0.0008) [2023-12-26 01:11:56,565][123090] Updated weights for policy 1, policy_version 201512 (0.0007) [2023-12-26 01:11:56,613][123090] Updated weights for policy 1, policy_version 201522 (0.0005) [2023-12-26 01:11:56,658][123090] Updated weights for policy 1, policy_version 201532 (0.0005) [2023-12-26 01:11:57,270][123090] Updated weights for policy 1, policy_version 201542 (0.0006) [2023-12-26 01:11:57,319][123091] Updated weights for policy 0, policy_version 202322 (0.0009) [2023-12-26 01:11:57,333][123090] Updated weights for policy 1, policy_version 201552 (0.0005) [2023-12-26 01:11:57,383][123091] Updated weights for policy 0, policy_version 202332 (0.0008) [2023-12-26 01:11:57,400][123090] Updated weights for policy 1, policy_version 201562 (0.0007) [2023-12-26 01:11:57,443][123091] Updated weights for policy 0, policy_version 202342 (0.0008) [2023-12-26 01:11:57,502][123091] Updated weights for policy 0, policy_version 202352 (0.0009) [2023-12-26 01:11:58,136][123090] Updated weights for policy 1, policy_version 201572 (0.0008) [2023-12-26 01:11:58,203][123090] Updated weights for policy 1, policy_version 201582 (0.0010) [2023-12-26 01:11:58,206][123091] Updated weights for policy 0, policy_version 202362 (0.0006) [2023-12-26 01:11:58,269][123091] Updated weights for policy 0, policy_version 202372 (0.0006) [2023-12-26 01:11:58,271][123090] Updated weights for policy 1, policy_version 201592 (0.0011) [2023-12-26 01:11:58,341][123091] Updated weights for policy 0, policy_version 202382 (0.0008) [2023-12-26 01:11:58,785][121949] Fps is (10 sec: 18021.1, 60 sec: 18022.6, 300 sec: 17744.7). Total num frames: 103424000. Throughput: 0: 8987.6, 1: 9169.3. Samples: 103417784. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:11:58,785][121949] Avg episode reward: [(0, '5889.320'), (1, '5443.364')] [2023-12-26 01:11:59,124][123090] Updated weights for policy 1, policy_version 201602 (0.0010) [2023-12-26 01:11:59,186][123090] Updated weights for policy 1, policy_version 201612 (0.0010) [2023-12-26 01:11:59,236][123091] Updated weights for policy 0, policy_version 202393 (0.0010) [2023-12-26 01:11:59,252][123090] Updated weights for policy 1, policy_version 201622 (0.0010) [2023-12-26 01:11:59,300][123091] Updated weights for policy 0, policy_version 202403 (0.0008) [2023-12-26 01:11:59,315][123090] Updated weights for policy 1, policy_version 201632 (0.0010) [2023-12-26 01:11:59,361][123091] Updated weights for policy 0, policy_version 202413 (0.0007) [2023-12-26 01:12:00,140][123091] Updated weights for policy 0, policy_version 202423 (0.0006) [2023-12-26 01:12:00,155][123090] Updated weights for policy 1, policy_version 201642 (0.0009) [2023-12-26 01:12:00,185][123091] Updated weights for policy 0, policy_version 202433 (0.0006) [2023-12-26 01:12:00,218][123090] Updated weights for policy 1, policy_version 201652 (0.0008) [2023-12-26 01:12:00,234][123091] Updated weights for policy 0, policy_version 202443 (0.0008) [2023-12-26 01:12:00,279][123090] Updated weights for policy 1, policy_version 201662 (0.0008) [2023-12-26 01:12:01,087][123091] Updated weights for policy 0, policy_version 202453 (0.0008) [2023-12-26 01:12:01,128][123090] Updated weights for policy 1, policy_version 201672 (0.0010) [2023-12-26 01:12:01,154][123091] Updated weights for policy 0, policy_version 202463 (0.0008) [2023-12-26 01:12:01,192][123090] Updated weights for policy 1, policy_version 201682 (0.0008) [2023-12-26 01:12:01,213][123091] Updated weights for policy 0, policy_version 202473 (0.0008) [2023-12-26 01:12:01,257][123090] Updated weights for policy 1, policy_version 201692 (0.0009) [2023-12-26 01:12:02,020][123091] Updated weights for policy 0, policy_version 202483 (0.0009) [2023-12-26 01:12:02,086][123091] Updated weights for policy 0, policy_version 202493 (0.0010) [2023-12-26 01:12:02,105][123090] Updated weights for policy 1, policy_version 201702 (0.0008) [2023-12-26 01:12:02,148][123091] Updated weights for policy 0, policy_version 202503 (0.0010) [2023-12-26 01:12:02,165][123090] Updated weights for policy 1, policy_version 201712 (0.0009) [2023-12-26 01:12:02,232][123090] Updated weights for policy 1, policy_version 201722 (0.0007) [2023-12-26 01:12:02,946][123091] Updated weights for policy 0, policy_version 202513 (0.0011) [2023-12-26 01:12:02,979][123090] Updated weights for policy 1, policy_version 201732 (0.0010) [2023-12-26 01:12:03,008][123091] Updated weights for policy 0, policy_version 202523 (0.0010) [2023-12-26 01:12:03,034][123090] Updated weights for policy 1, policy_version 201742 (0.0010) [2023-12-26 01:12:03,070][123091] Updated weights for policy 0, policy_version 202533 (0.0010) [2023-12-26 01:12:03,095][123090] Updated weights for policy 1, policy_version 201752 (0.0010) [2023-12-26 01:12:03,131][123091] Updated weights for policy 0, policy_version 202543 (0.0010) [2023-12-26 01:12:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 103505920. Throughput: 0: 9042.1, 1: 9079.7. Samples: 103521224. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:03,785][121949] Avg episode reward: [(0, '5881.060'), (1, '5370.086')] [2023-12-26 01:12:03,896][123090] Updated weights for policy 1, policy_version 201762 (0.0010) [2023-12-26 01:12:03,922][123091] Updated weights for policy 0, policy_version 202553 (0.0011) [2023-12-26 01:12:03,959][123090] Updated weights for policy 1, policy_version 201772 (0.0011) [2023-12-26 01:12:03,974][123091] Updated weights for policy 0, policy_version 202563 (0.0010) [2023-12-26 01:12:04,022][123090] Updated weights for policy 1, policy_version 201782 (0.0009) [2023-12-26 01:12:04,042][123091] Updated weights for policy 0, policy_version 202573 (0.0009) [2023-12-26 01:12:04,078][123090] Updated weights for policy 1, policy_version 201792 (0.0011) [2023-12-26 01:12:04,862][123090] Updated weights for policy 1, policy_version 201802 (0.0009) [2023-12-26 01:12:04,871][123091] Updated weights for policy 0, policy_version 202583 (0.0008) [2023-12-26 01:12:04,930][123090] Updated weights for policy 1, policy_version 201812 (0.0008) [2023-12-26 01:12:04,932][123091] Updated weights for policy 0, policy_version 202593 (0.0010) [2023-12-26 01:12:04,992][123090] Updated weights for policy 1, policy_version 201822 (0.0010) [2023-12-26 01:12:04,998][123091] Updated weights for policy 0, policy_version 202603 (0.0010) [2023-12-26 01:12:05,579][123090] Updated weights for policy 1, policy_version 201832 (0.0010) [2023-12-26 01:12:05,635][123090] Updated weights for policy 1, policy_version 201842 (0.0005) [2023-12-26 01:12:05,679][123091] Updated weights for policy 0, policy_version 202613 (0.0005) [2023-12-26 01:12:05,694][123090] Updated weights for policy 1, policy_version 201852 (0.0005) [2023-12-26 01:12:05,736][123091] Updated weights for policy 0, policy_version 202623 (0.0006) [2023-12-26 01:12:05,791][123091] Updated weights for policy 0, policy_version 202633 (0.0005) [2023-12-26 01:12:06,440][123090] Updated weights for policy 1, policy_version 201862 (0.0007) [2023-12-26 01:12:06,488][123091] Updated weights for policy 0, policy_version 202643 (0.0007) [2023-12-26 01:12:06,499][123090] Updated weights for policy 1, policy_version 201872 (0.0007) [2023-12-26 01:12:06,536][123091] Updated weights for policy 0, policy_version 202653 (0.0010) [2023-12-26 01:12:06,566][123090] Updated weights for policy 1, policy_version 201882 (0.0008) [2023-12-26 01:12:06,599][123091] Updated weights for policy 0, policy_version 202663 (0.0011) [2023-12-26 01:12:07,379][123090] Updated weights for policy 1, policy_version 201892 (0.0008) [2023-12-26 01:12:07,430][123091] Updated weights for policy 0, policy_version 202673 (0.0011) [2023-12-26 01:12:07,439][123090] Updated weights for policy 1, policy_version 201902 (0.0009) [2023-12-26 01:12:07,492][123091] Updated weights for policy 0, policy_version 202683 (0.0010) [2023-12-26 01:12:07,496][123090] Updated weights for policy 1, policy_version 201912 (0.0008) [2023-12-26 01:12:07,560][123091] Updated weights for policy 0, policy_version 202693 (0.0005) [2023-12-26 01:12:07,614][123091] Updated weights for policy 0, policy_version 202703 (0.0009) [2023-12-26 01:12:08,204][123090] Updated weights for policy 1, policy_version 201922 (0.0009) [2023-12-26 01:12:08,258][123090] Updated weights for policy 1, policy_version 201932 (0.0009) [2023-12-26 01:12:08,262][123091] Updated weights for policy 0, policy_version 202713 (0.0006) [2023-12-26 01:12:08,310][123090] Updated weights for policy 1, policy_version 201942 (0.0008) [2023-12-26 01:12:08,325][123091] Updated weights for policy 0, policy_version 202723 (0.0006) [2023-12-26 01:12:08,374][123090] Updated weights for policy 1, policy_version 201952 (0.0009) [2023-12-26 01:12:08,396][123091] Updated weights for policy 0, policy_version 202733 (0.0010) [2023-12-26 01:12:08,784][121949] Fps is (10 sec: 18023.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 103604224. Throughput: 0: 9114.1, 1: 9150.7. Samples: 103578952. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:08,785][121949] Avg episode reward: [(0, '5826.882'), (1, '5173.963')] [2023-12-26 01:12:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000202736_51904512.pth... [2023-12-26 01:12:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000201952_51699712.pth... [2023-12-26 01:12:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000200896_51429376.pth [2023-12-26 01:12:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000201680_51634176.pth [2023-12-26 01:12:09,184][123091] Updated weights for policy 0, policy_version 202743 (0.0011) [2023-12-26 01:12:09,220][123090] Updated weights for policy 1, policy_version 201962 (0.0006) [2023-12-26 01:12:09,243][123091] Updated weights for policy 0, policy_version 202753 (0.0009) [2023-12-26 01:12:09,293][123090] Updated weights for policy 1, policy_version 201972 (0.0008) [2023-12-26 01:12:09,311][123091] Updated weights for policy 0, policy_version 202763 (0.0006) [2023-12-26 01:12:09,367][123090] Updated weights for policy 1, policy_version 201982 (0.0008) [2023-12-26 01:12:10,151][123090] Updated weights for policy 1, policy_version 201992 (0.0009) [2023-12-26 01:12:10,173][123091] Updated weights for policy 0, policy_version 202773 (0.0009) [2023-12-26 01:12:10,217][123090] Updated weights for policy 1, policy_version 202002 (0.0008) [2023-12-26 01:12:10,227][123091] Updated weights for policy 0, policy_version 202783 (0.0009) [2023-12-26 01:12:10,284][123090] Updated weights for policy 1, policy_version 202012 (0.0010) [2023-12-26 01:12:10,286][123091] Updated weights for policy 0, policy_version 202793 (0.0007) [2023-12-26 01:12:11,039][123091] Updated weights for policy 0, policy_version 202803 (0.0008) [2023-12-26 01:12:11,075][123090] Updated weights for policy 1, policy_version 202022 (0.0008) [2023-12-26 01:12:11,105][123091] Updated weights for policy 0, policy_version 202813 (0.0007) [2023-12-26 01:12:11,133][123090] Updated weights for policy 1, policy_version 202032 (0.0009) [2023-12-26 01:12:11,177][123091] Updated weights for policy 0, policy_version 202823 (0.0008) [2023-12-26 01:12:11,213][123090] Updated weights for policy 1, policy_version 202042 (0.0007) [2023-12-26 01:12:11,982][123091] Updated weights for policy 0, policy_version 202833 (0.0009) [2023-12-26 01:12:12,034][123091] Updated weights for policy 0, policy_version 202843 (0.0011) [2023-12-26 01:12:12,081][123091] Updated weights for policy 0, policy_version 202853 (0.0010) [2023-12-26 01:12:12,096][123090] Updated weights for policy 1, policy_version 202052 (0.0008) [2023-12-26 01:12:12,141][123091] Updated weights for policy 0, policy_version 202863 (0.0011) [2023-12-26 01:12:12,160][123090] Updated weights for policy 1, policy_version 202062 (0.0006) [2023-12-26 01:12:12,224][123090] Updated weights for policy 1, policy_version 202072 (0.0009) [2023-12-26 01:12:13,009][123091] Updated weights for policy 0, policy_version 202873 (0.0010) [2023-12-26 01:12:13,066][123091] Updated weights for policy 0, policy_version 202883 (0.0010) [2023-12-26 01:12:13,111][123090] Updated weights for policy 1, policy_version 202082 (0.0008) [2023-12-26 01:12:13,124][123091] Updated weights for policy 0, policy_version 202893 (0.0009) [2023-12-26 01:12:13,175][123090] Updated weights for policy 1, policy_version 202092 (0.0010) [2023-12-26 01:12:13,239][123090] Updated weights for policy 1, policy_version 202102 (0.0010) [2023-12-26 01:12:13,294][123090] Updated weights for policy 1, policy_version 202112 (0.0009) [2023-12-26 01:12:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 103686144. Throughput: 0: 9087.9, 1: 9017.9. Samples: 103683288. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:13,785][121949] Avg episode reward: [(0, '5847.834'), (1, '5009.633')] [2023-12-26 01:12:13,969][123091] Updated weights for policy 0, policy_version 202903 (0.0009) [2023-12-26 01:12:14,027][123091] Updated weights for policy 0, policy_version 202913 (0.0009) [2023-12-26 01:12:14,073][123091] Updated weights for policy 0, policy_version 202923 (0.0008) [2023-12-26 01:12:14,097][123090] Updated weights for policy 1, policy_version 202122 (0.0008) [2023-12-26 01:12:14,153][123090] Updated weights for policy 1, policy_version 202132 (0.0009) [2023-12-26 01:12:14,202][123090] Updated weights for policy 1, policy_version 202142 (0.0009) [2023-12-26 01:12:14,920][123091] Updated weights for policy 0, policy_version 202933 (0.0010) [2023-12-26 01:12:14,980][123091] Updated weights for policy 0, policy_version 202943 (0.0008) [2023-12-26 01:12:15,042][123091] Updated weights for policy 0, policy_version 202953 (0.0010) [2023-12-26 01:12:15,053][123090] Updated weights for policy 1, policy_version 202152 (0.0007) [2023-12-26 01:12:15,119][123090] Updated weights for policy 1, policy_version 202162 (0.0009) [2023-12-26 01:12:15,173][123090] Updated weights for policy 1, policy_version 202172 (0.0009) [2023-12-26 01:12:15,842][123091] Updated weights for policy 0, policy_version 202963 (0.0007) [2023-12-26 01:12:15,889][123091] Updated weights for policy 0, policy_version 202973 (0.0005) [2023-12-26 01:12:15,951][123091] Updated weights for policy 0, policy_version 202983 (0.0006) [2023-12-26 01:12:16,027][123090] Updated weights for policy 1, policy_version 202182 (0.0007) [2023-12-26 01:12:16,080][123090] Updated weights for policy 1, policy_version 202192 (0.0005) [2023-12-26 01:12:16,144][123090] Updated weights for policy 1, policy_version 202202 (0.0005) [2023-12-26 01:12:16,766][123091] Updated weights for policy 0, policy_version 202993 (0.0010) [2023-12-26 01:12:16,814][123091] Updated weights for policy 0, policy_version 203003 (0.0006) [2023-12-26 01:12:16,868][123091] Updated weights for policy 0, policy_version 203013 (0.0006) [2023-12-26 01:12:16,924][123091] Updated weights for policy 0, policy_version 203023 (0.0010) [2023-12-26 01:12:16,926][123090] Updated weights for policy 1, policy_version 202212 (0.0007) [2023-12-26 01:12:16,978][123090] Updated weights for policy 1, policy_version 202222 (0.0008) [2023-12-26 01:12:17,035][123090] Updated weights for policy 1, policy_version 202232 (0.0009) [2023-12-26 01:12:17,756][123091] Updated weights for policy 0, policy_version 203033 (0.0011) [2023-12-26 01:12:17,818][123091] Updated weights for policy 0, policy_version 203043 (0.0011) [2023-12-26 01:12:17,833][123090] Updated weights for policy 1, policy_version 202242 (0.0007) [2023-12-26 01:12:17,873][123091] Updated weights for policy 0, policy_version 203053 (0.0010) [2023-12-26 01:12:17,885][123090] Updated weights for policy 1, policy_version 202252 (0.0010) [2023-12-26 01:12:17,941][123090] Updated weights for policy 1, policy_version 202262 (0.0010) [2023-12-26 01:12:17,989][123090] Updated weights for policy 1, policy_version 202272 (0.0010) [2023-12-26 01:12:18,654][123091] Updated weights for policy 0, policy_version 203063 (0.0010) [2023-12-26 01:12:18,726][123091] Updated weights for policy 0, policy_version 203073 (0.0009) [2023-12-26 01:12:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 103768064. Throughput: 0: 9014.1, 1: 8914.4. Samples: 103787544. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:18,785][121949] Avg episode reward: [(0, '5898.342'), (1, '4941.359')] [2023-12-26 01:12:18,793][123091] Updated weights for policy 0, policy_version 203083 (0.0009) [2023-12-26 01:12:18,821][123090] Updated weights for policy 1, policy_version 202282 (0.0011) [2023-12-26 01:12:18,882][123090] Updated weights for policy 1, policy_version 202292 (0.0010) [2023-12-26 01:12:18,952][123090] Updated weights for policy 1, policy_version 202302 (0.0009) [2023-12-26 01:12:19,659][123091] Updated weights for policy 0, policy_version 203093 (0.0008) [2023-12-26 01:12:19,720][123090] Updated weights for policy 1, policy_version 202312 (0.0006) [2023-12-26 01:12:19,729][123091] Updated weights for policy 0, policy_version 203103 (0.0008) [2023-12-26 01:12:19,786][123090] Updated weights for policy 1, policy_version 202322 (0.0005) [2023-12-26 01:12:19,797][123091] Updated weights for policy 0, policy_version 203113 (0.0008) [2023-12-26 01:12:19,861][123090] Updated weights for policy 1, policy_version 202332 (0.0008) [2023-12-26 01:12:20,618][123090] Updated weights for policy 1, policy_version 202342 (0.0008) [2023-12-26 01:12:20,683][123090] Updated weights for policy 1, policy_version 202352 (0.0009) [2023-12-26 01:12:20,696][123091] Updated weights for policy 0, policy_version 203123 (0.0007) [2023-12-26 01:12:20,754][123090] Updated weights for policy 1, policy_version 202362 (0.0010) [2023-12-26 01:12:20,759][123091] Updated weights for policy 0, policy_version 203133 (0.0008) [2023-12-26 01:12:20,823][123091] Updated weights for policy 0, policy_version 203143 (0.0011) [2023-12-26 01:12:21,614][123090] Updated weights for policy 1, policy_version 202372 (0.0008) [2023-12-26 01:12:21,620][123091] Updated weights for policy 0, policy_version 203153 (0.0010) [2023-12-26 01:12:21,684][123090] Updated weights for policy 1, policy_version 202382 (0.0009) [2023-12-26 01:12:21,691][123091] Updated weights for policy 0, policy_version 203163 (0.0008) [2023-12-26 01:12:21,759][123090] Updated weights for policy 1, policy_version 202392 (0.0009) [2023-12-26 01:12:21,761][123091] Updated weights for policy 0, policy_version 203173 (0.0009) [2023-12-26 01:12:21,833][123091] Updated weights for policy 0, policy_version 203183 (0.0008) [2023-12-26 01:12:22,584][123090] Updated weights for policy 1, policy_version 202402 (0.0008) [2023-12-26 01:12:22,646][123091] Updated weights for policy 0, policy_version 203193 (0.0009) [2023-12-26 01:12:22,657][123090] Updated weights for policy 1, policy_version 202412 (0.0010) [2023-12-26 01:12:22,715][123091] Updated weights for policy 0, policy_version 203203 (0.0008) [2023-12-26 01:12:22,727][123090] Updated weights for policy 1, policy_version 202422 (0.0008) [2023-12-26 01:12:22,782][123091] Updated weights for policy 0, policy_version 203213 (0.0008) [2023-12-26 01:12:22,792][123090] Updated weights for policy 1, policy_version 202432 (0.0005) [2023-12-26 01:12:23,552][123090] Updated weights for policy 1, policy_version 202442 (0.0010) [2023-12-26 01:12:23,598][123091] Updated weights for policy 0, policy_version 203223 (0.0008) [2023-12-26 01:12:23,601][123090] Updated weights for policy 1, policy_version 202452 (0.0010) [2023-12-26 01:12:23,646][123090] Updated weights for policy 1, policy_version 202462 (0.0010) [2023-12-26 01:12:23,657][123091] Updated weights for policy 0, policy_version 203233 (0.0008) [2023-12-26 01:12:23,713][123091] Updated weights for policy 0, policy_version 203243 (0.0009) [2023-12-26 01:12:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 103866368. Throughput: 0: 8894.2, 1: 8923.3. Samples: 103838132. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:23,785][121949] Avg episode reward: [(0, '5936.869'), (1, '5015.746')] [2023-12-26 01:12:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000202464_51830784.pth... [2023-12-26 01:12:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000203248_52035584.pth... [2023-12-26 01:12:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000201408_51560448.pth [2023-12-26 01:12:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000202224_51773440.pth [2023-12-26 01:12:24,501][123091] Updated weights for policy 0, policy_version 203253 (0.0008) [2023-12-26 01:12:24,541][123090] Updated weights for policy 1, policy_version 202472 (0.0006) [2023-12-26 01:12:24,550][123091] Updated weights for policy 0, policy_version 203263 (0.0007) [2023-12-26 01:12:24,607][123090] Updated weights for policy 1, policy_version 202482 (0.0006) [2023-12-26 01:12:24,614][123091] Updated weights for policy 0, policy_version 203273 (0.0006) [2023-12-26 01:12:24,673][123090] Updated weights for policy 1, policy_version 202492 (0.0006) [2023-12-26 01:12:25,294][123091] Updated weights for policy 0, policy_version 203283 (0.0007) [2023-12-26 01:12:25,344][123091] Updated weights for policy 0, policy_version 203293 (0.0008) [2023-12-26 01:12:25,355][123090] Updated weights for policy 1, policy_version 202502 (0.0008) [2023-12-26 01:12:25,405][123091] Updated weights for policy 0, policy_version 203303 (0.0007) [2023-12-26 01:12:25,412][123090] Updated weights for policy 1, policy_version 202512 (0.0011) [2023-12-26 01:12:25,465][123090] Updated weights for policy 1, policy_version 202522 (0.0010) [2023-12-26 01:12:26,146][123091] Updated weights for policy 0, policy_version 203313 (0.0006) [2023-12-26 01:12:26,190][123090] Updated weights for policy 1, policy_version 202532 (0.0009) [2023-12-26 01:12:26,198][123091] Updated weights for policy 0, policy_version 203323 (0.0008) [2023-12-26 01:12:26,248][123090] Updated weights for policy 1, policy_version 202542 (0.0008) [2023-12-26 01:12:26,256][123091] Updated weights for policy 0, policy_version 203333 (0.0005) [2023-12-26 01:12:26,308][123090] Updated weights for policy 1, policy_version 202552 (0.0010) [2023-12-26 01:12:26,312][123091] Updated weights for policy 0, policy_version 203343 (0.0007) [2023-12-26 01:12:27,050][123090] Updated weights for policy 1, policy_version 202562 (0.0010) [2023-12-26 01:12:27,092][123091] Updated weights for policy 0, policy_version 203353 (0.0006) [2023-12-26 01:12:27,110][123090] Updated weights for policy 1, policy_version 202572 (0.0009) [2023-12-26 01:12:27,148][123091] Updated weights for policy 0, policy_version 203363 (0.0010) [2023-12-26 01:12:27,157][123090] Updated weights for policy 1, policy_version 202582 (0.0010) [2023-12-26 01:12:27,210][123091] Updated weights for policy 0, policy_version 203373 (0.0011) [2023-12-26 01:12:27,216][123090] Updated weights for policy 1, policy_version 202592 (0.0010) [2023-12-26 01:12:27,936][123091] Updated weights for policy 0, policy_version 203383 (0.0007) [2023-12-26 01:12:27,948][123090] Updated weights for policy 1, policy_version 202602 (0.0005) [2023-12-26 01:12:27,987][123091] Updated weights for policy 0, policy_version 203393 (0.0005) [2023-12-26 01:12:28,001][123090] Updated weights for policy 1, policy_version 202612 (0.0008) [2023-12-26 01:12:28,040][123091] Updated weights for policy 0, policy_version 203403 (0.0005) [2023-12-26 01:12:28,050][123090] Updated weights for policy 1, policy_version 202622 (0.0008) [2023-12-26 01:12:28,644][123091] Updated weights for policy 0, policy_version 203413 (0.0005) [2023-12-26 01:12:28,698][123091] Updated weights for policy 0, policy_version 203423 (0.0006) [2023-12-26 01:12:28,751][123091] Updated weights for policy 0, policy_version 203433 (0.0005) [2023-12-26 01:12:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 103948288. Throughput: 0: 8901.9, 1: 8956.6. Samples: 103946896. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:28,785][121949] Avg episode reward: [(0, '5935.169'), (1, '5182.736')] [2023-12-26 01:12:28,952][123090] Updated weights for policy 1, policy_version 202632 (0.0009) [2023-12-26 01:12:29,008][123090] Updated weights for policy 1, policy_version 202642 (0.0009) [2023-12-26 01:12:29,063][123090] Updated weights for policy 1, policy_version 202652 (0.0009) [2023-12-26 01:12:29,523][123091] Updated weights for policy 0, policy_version 203443 (0.0007) [2023-12-26 01:12:29,582][123091] Updated weights for policy 0, policy_version 203453 (0.0010) [2023-12-26 01:12:29,633][123091] Updated weights for policy 0, policy_version 203463 (0.0010) [2023-12-26 01:12:29,950][123090] Updated weights for policy 1, policy_version 202662 (0.0009) [2023-12-26 01:12:30,016][123090] Updated weights for policy 1, policy_version 202672 (0.0009) [2023-12-26 01:12:30,070][123090] Updated weights for policy 1, policy_version 202682 (0.0009) [2023-12-26 01:12:30,496][123091] Updated weights for policy 0, policy_version 203473 (0.0011) [2023-12-26 01:12:30,555][123091] Updated weights for policy 0, policy_version 203483 (0.0009) [2023-12-26 01:12:30,610][123091] Updated weights for policy 0, policy_version 203493 (0.0009) [2023-12-26 01:12:30,677][123091] Updated weights for policy 0, policy_version 203503 (0.0009) [2023-12-26 01:12:30,884][123090] Updated weights for policy 1, policy_version 202692 (0.0007) [2023-12-26 01:12:30,941][123090] Updated weights for policy 1, policy_version 202702 (0.0005) [2023-12-26 01:12:30,994][123090] Updated weights for policy 1, policy_version 202712 (0.0005) [2023-12-26 01:12:31,557][123091] Updated weights for policy 0, policy_version 203513 (0.0009) [2023-12-26 01:12:31,605][123091] Updated weights for policy 0, policy_version 203523 (0.0008) [2023-12-26 01:12:31,676][123091] Updated weights for policy 0, policy_version 203533 (0.0010) [2023-12-26 01:12:31,764][123090] Updated weights for policy 1, policy_version 202722 (0.0007) [2023-12-26 01:12:31,829][123090] Updated weights for policy 1, policy_version 202732 (0.0008) [2023-12-26 01:12:31,894][123090] Updated weights for policy 1, policy_version 202742 (0.0008) [2023-12-26 01:12:31,957][123090] Updated weights for policy 1, policy_version 202752 (0.0008) [2023-12-26 01:12:32,621][123091] Updated weights for policy 0, policy_version 203543 (0.0010) [2023-12-26 01:12:32,682][123091] Updated weights for policy 0, policy_version 203553 (0.0009) [2023-12-26 01:12:32,726][123090] Updated weights for policy 1, policy_version 202762 (0.0008) [2023-12-26 01:12:32,742][123091] Updated weights for policy 0, policy_version 203563 (0.0007) [2023-12-26 01:12:32,788][123090] Updated weights for policy 1, policy_version 202772 (0.0007) [2023-12-26 01:12:32,846][123090] Updated weights for policy 1, policy_version 202782 (0.0005) [2023-12-26 01:12:33,577][123091] Updated weights for policy 0, policy_version 203573 (0.0010) [2023-12-26 01:12:33,637][123090] Updated weights for policy 1, policy_version 202792 (0.0005) [2023-12-26 01:12:33,645][123091] Updated weights for policy 0, policy_version 203583 (0.0010) [2023-12-26 01:12:33,700][123091] Updated weights for policy 0, policy_version 203593 (0.0008) [2023-12-26 01:12:33,705][123090] Updated weights for policy 1, policy_version 202802 (0.0006) [2023-12-26 01:12:33,772][123090] Updated weights for policy 1, policy_version 202812 (0.0009) [2023-12-26 01:12:33,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 104038400. Throughput: 0: 8839.0, 1: 8886.6. Samples: 104051552. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:33,785][121949] Avg episode reward: [(0, '5948.799'), (1, '5205.683')] [2023-12-26 01:12:34,536][123091] Updated weights for policy 0, policy_version 203603 (0.0009) [2023-12-26 01:12:34,540][123090] Updated weights for policy 1, policy_version 202822 (0.0009) [2023-12-26 01:12:34,604][123091] Updated weights for policy 0, policy_version 203613 (0.0009) [2023-12-26 01:12:34,604][123090] Updated weights for policy 1, policy_version 202832 (0.0006) [2023-12-26 01:12:34,664][123090] Updated weights for policy 1, policy_version 202842 (0.0007) [2023-12-26 01:12:34,667][123091] Updated weights for policy 0, policy_version 203623 (0.0008) [2023-12-26 01:12:35,435][123091] Updated weights for policy 0, policy_version 203633 (0.0009) [2023-12-26 01:12:35,480][123090] Updated weights for policy 1, policy_version 202852 (0.0008) [2023-12-26 01:12:35,492][123091] Updated weights for policy 0, policy_version 203643 (0.0007) [2023-12-26 01:12:35,538][123090] Updated weights for policy 1, policy_version 202862 (0.0009) [2023-12-26 01:12:35,549][123091] Updated weights for policy 0, policy_version 203653 (0.0008) [2023-12-26 01:12:35,604][123090] Updated weights for policy 1, policy_version 202872 (0.0007) [2023-12-26 01:12:35,612][123091] Updated weights for policy 0, policy_version 203663 (0.0008) [2023-12-26 01:12:36,394][123091] Updated weights for policy 0, policy_version 203673 (0.0006) [2023-12-26 01:12:36,459][123090] Updated weights for policy 1, policy_version 202882 (0.0008) [2023-12-26 01:12:36,462][123091] Updated weights for policy 0, policy_version 203683 (0.0008) [2023-12-26 01:12:36,519][123091] Updated weights for policy 0, policy_version 203693 (0.0009) [2023-12-26 01:12:36,521][123090] Updated weights for policy 1, policy_version 202892 (0.0008) [2023-12-26 01:12:36,585][123090] Updated weights for policy 1, policy_version 202902 (0.0009) [2023-12-26 01:12:36,650][123090] Updated weights for policy 1, policy_version 202912 (0.0010) [2023-12-26 01:12:37,295][123091] Updated weights for policy 0, policy_version 203703 (0.0010) [2023-12-26 01:12:37,353][123091] Updated weights for policy 0, policy_version 203713 (0.0010) [2023-12-26 01:12:37,409][123091] Updated weights for policy 0, policy_version 203723 (0.0010) [2023-12-26 01:12:37,481][123090] Updated weights for policy 1, policy_version 202922 (0.0008) [2023-12-26 01:12:37,542][123090] Updated weights for policy 1, policy_version 202932 (0.0009) [2023-12-26 01:12:37,602][123090] Updated weights for policy 1, policy_version 202942 (0.0009) [2023-12-26 01:12:38,247][123091] Updated weights for policy 0, policy_version 203733 (0.0010) [2023-12-26 01:12:38,317][123091] Updated weights for policy 0, policy_version 203743 (0.0010) [2023-12-26 01:12:38,388][123091] Updated weights for policy 0, policy_version 203753 (0.0011) [2023-12-26 01:12:38,448][123090] Updated weights for policy 1, policy_version 202952 (0.0008) [2023-12-26 01:12:38,516][123090] Updated weights for policy 1, policy_version 202962 (0.0008) [2023-12-26 01:12:38,580][123090] Updated weights for policy 1, policy_version 202972 (0.0009) [2023-12-26 01:12:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 104128512. Throughput: 0: 8798.0, 1: 8855.4. Samples: 104103404. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:38,785][121949] Avg episode reward: [(0, '5923.808'), (1, '5244.138')] [2023-12-26 01:12:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000203760_52166656.pth... [2023-12-26 01:12:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000202976_51961856.pth... [2023-12-26 01:12:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000201952_51699712.pth [2023-12-26 01:12:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000202736_51904512.pth [2023-12-26 01:12:39,183][123091] Updated weights for policy 0, policy_version 203763 (0.0010) [2023-12-26 01:12:39,248][123091] Updated weights for policy 0, policy_version 203773 (0.0010) [2023-12-26 01:12:39,310][123091] Updated weights for policy 0, policy_version 203783 (0.0011) [2023-12-26 01:12:39,432][123090] Updated weights for policy 1, policy_version 202982 (0.0008) [2023-12-26 01:12:39,494][123090] Updated weights for policy 1, policy_version 202992 (0.0010) [2023-12-26 01:12:39,564][123090] Updated weights for policy 1, policy_version 203002 (0.0010) [2023-12-26 01:12:40,187][123091] Updated weights for policy 0, policy_version 203793 (0.0010) [2023-12-26 01:12:40,257][123091] Updated weights for policy 0, policy_version 203803 (0.0008) [2023-12-26 01:12:40,313][123091] Updated weights for policy 0, policy_version 203813 (0.0008) [2023-12-26 01:12:40,378][123091] Updated weights for policy 0, policy_version 203823 (0.0008) [2023-12-26 01:12:40,510][123090] Updated weights for policy 1, policy_version 203012 (0.0007) [2023-12-26 01:12:40,586][123090] Updated weights for policy 1, policy_version 203022 (0.0009) [2023-12-26 01:12:40,660][123090] Updated weights for policy 1, policy_version 203032 (0.0007) [2023-12-26 01:12:41,122][123091] Updated weights for policy 0, policy_version 203833 (0.0008) [2023-12-26 01:12:41,191][123091] Updated weights for policy 0, policy_version 203843 (0.0009) [2023-12-26 01:12:41,251][123091] Updated weights for policy 0, policy_version 203853 (0.0009) [2023-12-26 01:12:41,389][123090] Updated weights for policy 1, policy_version 203042 (0.0006) [2023-12-26 01:12:41,462][123090] Updated weights for policy 1, policy_version 203052 (0.0007) [2023-12-26 01:12:41,529][123090] Updated weights for policy 1, policy_version 203062 (0.0007) [2023-12-26 01:12:41,597][123090] Updated weights for policy 1, policy_version 203072 (0.0008) [2023-12-26 01:12:42,150][123091] Updated weights for policy 0, policy_version 203863 (0.0008) [2023-12-26 01:12:42,219][123091] Updated weights for policy 0, policy_version 203873 (0.0008) [2023-12-26 01:12:42,287][123091] Updated weights for policy 0, policy_version 203883 (0.0009) [2023-12-26 01:12:42,437][123090] Updated weights for policy 1, policy_version 203082 (0.0009) [2023-12-26 01:12:42,510][123090] Updated weights for policy 1, policy_version 203092 (0.0010) [2023-12-26 01:12:42,581][123090] Updated weights for policy 1, policy_version 203102 (0.0010) [2023-12-26 01:12:43,127][123091] Updated weights for policy 0, policy_version 203893 (0.0010) [2023-12-26 01:12:43,175][123091] Updated weights for policy 0, policy_version 203903 (0.0009) [2023-12-26 01:12:43,225][123091] Updated weights for policy 0, policy_version 203913 (0.0010) [2023-12-26 01:12:43,347][123090] Updated weights for policy 1, policy_version 203112 (0.0009) [2023-12-26 01:12:43,418][123090] Updated weights for policy 1, policy_version 203122 (0.0009) [2023-12-26 01:12:43,486][123090] Updated weights for policy 1, policy_version 203132 (0.0010) [2023-12-26 01:12:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 104210432. Throughput: 0: 8773.7, 1: 8706.3. Samples: 104204372. Policy #0 lag: (min: 25.0, avg: 38.9, max: 57.0) [2023-12-26 01:12:43,785][121949] Avg episode reward: [(0, '5935.227'), (1, '5184.669')] [2023-12-26 01:12:44,056][123091] Updated weights for policy 0, policy_version 203924 (0.0010) [2023-12-26 01:12:44,113][123091] Updated weights for policy 0, policy_version 203934 (0.0009) [2023-12-26 01:12:44,169][123091] Updated weights for policy 0, policy_version 203944 (0.0009) [2023-12-26 01:12:44,272][123090] Updated weights for policy 1, policy_version 203142 (0.0009) [2023-12-26 01:12:44,342][123090] Updated weights for policy 1, policy_version 203152 (0.0009) [2023-12-26 01:12:44,401][123090] Updated weights for policy 1, policy_version 203162 (0.0009) [2023-12-26 01:12:45,007][123091] Updated weights for policy 0, policy_version 203954 (0.0009) [2023-12-26 01:12:45,065][123091] Updated weights for policy 0, policy_version 203964 (0.0009) [2023-12-26 01:12:45,118][123091] Updated weights for policy 0, policy_version 203974 (0.0010) [2023-12-26 01:12:45,204][123090] Updated weights for policy 1, policy_version 203172 (0.0009) [2023-12-26 01:12:45,266][123090] Updated weights for policy 1, policy_version 203182 (0.0009) [2023-12-26 01:12:45,320][123090] Updated weights for policy 1, policy_version 203192 (0.0009) [2023-12-26 01:12:45,973][123091] Updated weights for policy 0, policy_version 203985 (0.0009) [2023-12-26 01:12:46,037][123091] Updated weights for policy 0, policy_version 203995 (0.0008) [2023-12-26 01:12:46,095][123091] Updated weights for policy 0, policy_version 204005 (0.0010) [2023-12-26 01:12:46,111][123090] Updated weights for policy 1, policy_version 203202 (0.0008) [2023-12-26 01:12:46,148][123091] Updated weights for policy 0, policy_version 204015 (0.0009) [2023-12-26 01:12:46,169][123090] Updated weights for policy 1, policy_version 203212 (0.0006) [2023-12-26 01:12:46,227][123090] Updated weights for policy 1, policy_version 203222 (0.0007) [2023-12-26 01:12:46,287][123090] Updated weights for policy 1, policy_version 203232 (0.0005) [2023-12-26 01:12:46,915][123091] Updated weights for policy 0, policy_version 204025 (0.0005) [2023-12-26 01:12:46,962][123091] Updated weights for policy 0, policy_version 204035 (0.0006) [2023-12-26 01:12:47,023][123091] Updated weights for policy 0, policy_version 204045 (0.0005) [2023-12-26 01:12:47,105][123090] Updated weights for policy 1, policy_version 203242 (0.0010) [2023-12-26 01:12:47,168][123090] Updated weights for policy 1, policy_version 203252 (0.0011) [2023-12-26 01:12:47,231][123090] Updated weights for policy 1, policy_version 203262 (0.0011) [2023-12-26 01:12:47,730][123091] Updated weights for policy 0, policy_version 204055 (0.0006) [2023-12-26 01:12:47,800][123091] Updated weights for policy 0, policy_version 204065 (0.0008) [2023-12-26 01:12:47,852][123091] Updated weights for policy 0, policy_version 204075 (0.0010) [2023-12-26 01:12:48,021][123090] Updated weights for policy 1, policy_version 203272 (0.0011) [2023-12-26 01:12:48,088][123090] Updated weights for policy 1, policy_version 203282 (0.0010) [2023-12-26 01:12:48,147][123090] Updated weights for policy 1, policy_version 203292 (0.0010) [2023-12-26 01:12:48,573][123091] Updated weights for policy 0, policy_version 204085 (0.0011) [2023-12-26 01:12:48,640][123091] Updated weights for policy 0, policy_version 204095 (0.0011) [2023-12-26 01:12:48,710][123091] Updated weights for policy 0, policy_version 204105 (0.0011) [2023-12-26 01:12:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 104300544. Throughput: 0: 8804.8, 1: 8750.8. Samples: 104311224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:12:48,785][121949] Avg episode reward: [(0, '5922.092'), (1, '5016.369')] [2023-12-26 01:12:48,967][123090] Updated weights for policy 1, policy_version 203302 (0.0010) [2023-12-26 01:12:49,019][123090] Updated weights for policy 1, policy_version 203312 (0.0010) [2023-12-26 01:12:49,077][123090] Updated weights for policy 1, policy_version 203322 (0.0010) [2023-12-26 01:12:49,495][123091] Updated weights for policy 0, policy_version 204115 (0.0009) [2023-12-26 01:12:49,556][123091] Updated weights for policy 0, policy_version 204125 (0.0006) [2023-12-26 01:12:49,609][123091] Updated weights for policy 0, policy_version 204135 (0.0007) [2023-12-26 01:12:49,927][123090] Updated weights for policy 1, policy_version 203332 (0.0009) [2023-12-26 01:12:49,993][123090] Updated weights for policy 1, policy_version 203342 (0.0008) [2023-12-26 01:12:50,061][123090] Updated weights for policy 1, policy_version 203352 (0.0008) [2023-12-26 01:12:50,441][123091] Updated weights for policy 0, policy_version 204145 (0.0009) [2023-12-26 01:12:50,510][123091] Updated weights for policy 0, policy_version 204155 (0.0008) [2023-12-26 01:12:50,570][123091] Updated weights for policy 0, policy_version 204165 (0.0009) [2023-12-26 01:12:50,641][123091] Updated weights for policy 0, policy_version 204175 (0.0009) [2023-12-26 01:12:50,825][123090] Updated weights for policy 1, policy_version 203362 (0.0009) [2023-12-26 01:12:50,890][123090] Updated weights for policy 1, policy_version 203372 (0.0011) [2023-12-26 01:12:50,959][123090] Updated weights for policy 1, policy_version 203382 (0.0011) [2023-12-26 01:12:51,019][123090] Updated weights for policy 1, policy_version 203392 (0.0010) [2023-12-26 01:12:51,493][123091] Updated weights for policy 0, policy_version 204185 (0.0011) [2023-12-26 01:12:51,581][123091] Updated weights for policy 0, policy_version 204195 (0.0013) [2023-12-26 01:12:51,648][123091] Updated weights for policy 0, policy_version 204205 (0.0008) [2023-12-26 01:12:51,797][123090] Updated weights for policy 1, policy_version 203402 (0.0007) [2023-12-26 01:12:51,868][123090] Updated weights for policy 1, policy_version 203412 (0.0006) [2023-12-26 01:12:51,923][123090] Updated weights for policy 1, policy_version 203422 (0.0007) [2023-12-26 01:12:52,323][123091] Updated weights for policy 0, policy_version 204215 (0.0009) [2023-12-26 01:12:52,395][123091] Updated weights for policy 0, policy_version 204225 (0.0010) [2023-12-26 01:12:52,457][123091] Updated weights for policy 0, policy_version 204235 (0.0008) [2023-12-26 01:12:52,699][123090] Updated weights for policy 1, policy_version 203432 (0.0008) [2023-12-26 01:12:52,754][123090] Updated weights for policy 1, policy_version 203442 (0.0008) [2023-12-26 01:12:52,812][123090] Updated weights for policy 1, policy_version 203452 (0.0008) [2023-12-26 01:12:53,242][123091] Updated weights for policy 0, policy_version 204245 (0.0009) [2023-12-26 01:12:53,317][123091] Updated weights for policy 0, policy_version 204255 (0.0011) [2023-12-26 01:12:53,387][123091] Updated weights for policy 0, policy_version 204265 (0.0011) [2023-12-26 01:12:53,612][123090] Updated weights for policy 1, policy_version 203462 (0.0008) [2023-12-26 01:12:53,684][123090] Updated weights for policy 1, policy_version 203472 (0.0007) [2023-12-26 01:12:53,739][123090] Updated weights for policy 1, policy_version 203482 (0.0010) [2023-12-26 01:12:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17772.6). Total num frames: 104390656. Throughput: 0: 8731.0, 1: 8686.7. Samples: 104362752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:12:53,785][121949] Avg episode reward: [(0, '5916.246'), (1, '5014.133')] [2023-12-26 01:12:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000204272_52297728.pth... [2023-12-26 01:12:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000203488_52092928.pth... [2023-12-26 01:12:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000202464_51830784.pth [2023-12-26 01:12:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000203248_52035584.pth [2023-12-26 01:12:54,064][123091] Updated weights for policy 0, policy_version 204275 (0.0009) [2023-12-26 01:12:54,124][123091] Updated weights for policy 0, policy_version 204285 (0.0005) [2023-12-26 01:12:54,189][123091] Updated weights for policy 0, policy_version 204295 (0.0008) [2023-12-26 01:12:54,456][123090] Updated weights for policy 1, policy_version 203492 (0.0010) [2023-12-26 01:12:54,516][123090] Updated weights for policy 1, policy_version 203502 (0.0009) [2023-12-26 01:12:54,580][123090] Updated weights for policy 1, policy_version 203512 (0.0005) [2023-12-26 01:12:54,874][123091] Updated weights for policy 0, policy_version 204305 (0.0010) [2023-12-26 01:12:54,935][123091] Updated weights for policy 0, policy_version 204315 (0.0008) [2023-12-26 01:12:54,997][123091] Updated weights for policy 0, policy_version 204325 (0.0010) [2023-12-26 01:12:55,056][123091] Updated weights for policy 0, policy_version 204335 (0.0011) [2023-12-26 01:12:55,282][123090] Updated weights for policy 1, policy_version 203522 (0.0007) [2023-12-26 01:12:55,344][123090] Updated weights for policy 1, policy_version 203532 (0.0010) [2023-12-26 01:12:55,414][123090] Updated weights for policy 1, policy_version 203542 (0.0010) [2023-12-26 01:12:55,472][123090] Updated weights for policy 1, policy_version 203552 (0.0010) [2023-12-26 01:12:55,877][123091] Updated weights for policy 0, policy_version 204345 (0.0009) [2023-12-26 01:12:55,930][123091] Updated weights for policy 0, policy_version 204355 (0.0009) [2023-12-26 01:12:55,978][123091] Updated weights for policy 0, policy_version 204365 (0.0009) [2023-12-26 01:12:56,247][123090] Updated weights for policy 1, policy_version 203562 (0.0005) [2023-12-26 01:12:56,315][123090] Updated weights for policy 1, policy_version 203572 (0.0005) [2023-12-26 01:12:56,375][123090] Updated weights for policy 1, policy_version 203582 (0.0005) [2023-12-26 01:12:56,905][123091] Updated weights for policy 0, policy_version 204375 (0.0009) [2023-12-26 01:12:56,973][123091] Updated weights for policy 0, policy_version 204385 (0.0009) [2023-12-26 01:12:57,015][123090] Updated weights for policy 1, policy_version 203592 (0.0008) [2023-12-26 01:12:57,031][123091] Updated weights for policy 0, policy_version 204395 (0.0006) [2023-12-26 01:12:57,071][123090] Updated weights for policy 1, policy_version 203602 (0.0010) [2023-12-26 01:12:57,124][123090] Updated weights for policy 1, policy_version 203612 (0.0010) [2023-12-26 01:12:57,809][123090] Updated weights for policy 1, policy_version 203622 (0.0006) [2023-12-26 01:12:57,869][123090] Updated weights for policy 1, policy_version 203632 (0.0005) [2023-12-26 01:12:57,923][123091] Updated weights for policy 0, policy_version 204405 (0.0005) [2023-12-26 01:12:57,929][123090] Updated weights for policy 1, policy_version 203642 (0.0005) [2023-12-26 01:12:57,995][123091] Updated weights for policy 0, policy_version 204415 (0.0006) [2023-12-26 01:12:58,061][123091] Updated weights for policy 0, policy_version 204425 (0.0008) [2023-12-26 01:12:58,693][123090] Updated weights for policy 1, policy_version 203652 (0.0006) [2023-12-26 01:12:58,775][123090] Updated weights for policy 1, policy_version 203662 (0.0009) [2023-12-26 01:12:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 104472576. Throughput: 0: 8732.6, 1: 8792.3. Samples: 104471908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:12:58,785][121949] Avg episode reward: [(0, '5907.915'), (1, '5154.983')] [2023-12-26 01:12:58,836][123090] Updated weights for policy 1, policy_version 203672 (0.0009) [2023-12-26 01:12:58,889][123091] Updated weights for policy 0, policy_version 204435 (0.0008) [2023-12-26 01:12:58,956][123091] Updated weights for policy 0, policy_version 204445 (0.0009) [2023-12-26 01:12:59,027][123091] Updated weights for policy 0, policy_version 204455 (0.0007) [2023-12-26 01:12:59,722][123091] Updated weights for policy 0, policy_version 204465 (0.0007) [2023-12-26 01:12:59,760][123090] Updated weights for policy 1, policy_version 203682 (0.0008) [2023-12-26 01:12:59,787][123091] Updated weights for policy 0, policy_version 204475 (0.0008) [2023-12-26 01:12:59,827][123090] Updated weights for policy 1, policy_version 203692 (0.0009) [2023-12-26 01:12:59,842][123091] Updated weights for policy 0, policy_version 204485 (0.0007) [2023-12-26 01:12:59,888][123090] Updated weights for policy 1, policy_version 203702 (0.0007) [2023-12-26 01:12:59,895][123091] Updated weights for policy 0, policy_version 204495 (0.0008) [2023-12-26 01:12:59,962][123090] Updated weights for policy 1, policy_version 203712 (0.0009) [2023-12-26 01:13:00,607][123091] Updated weights for policy 0, policy_version 204505 (0.0007) [2023-12-26 01:13:00,660][123091] Updated weights for policy 0, policy_version 204515 (0.0007) [2023-12-26 01:13:00,709][123091] Updated weights for policy 0, policy_version 204525 (0.0007) [2023-12-26 01:13:00,725][123090] Updated weights for policy 1, policy_version 203722 (0.0010) [2023-12-26 01:13:00,788][123090] Updated weights for policy 1, policy_version 203732 (0.0010) [2023-12-26 01:13:00,850][123090] Updated weights for policy 1, policy_version 203742 (0.0007) [2023-12-26 01:13:01,511][123091] Updated weights for policy 0, policy_version 204535 (0.0008) [2023-12-26 01:13:01,563][123091] Updated weights for policy 0, policy_version 204545 (0.0009) [2023-12-26 01:13:01,612][123090] Updated weights for policy 1, policy_version 203752 (0.0009) [2023-12-26 01:13:01,624][123091] Updated weights for policy 0, policy_version 204555 (0.0007) [2023-12-26 01:13:01,680][123090] Updated weights for policy 1, policy_version 203762 (0.0011) [2023-12-26 01:13:01,744][123090] Updated weights for policy 1, policy_version 203772 (0.0010) [2023-12-26 01:13:02,443][123091] Updated weights for policy 0, policy_version 204565 (0.0008) [2023-12-26 01:13:02,506][123091] Updated weights for policy 0, policy_version 204575 (0.0009) [2023-12-26 01:13:02,528][123090] Updated weights for policy 1, policy_version 203782 (0.0008) [2023-12-26 01:13:02,562][123091] Updated weights for policy 0, policy_version 204585 (0.0009) [2023-12-26 01:13:02,601][123090] Updated weights for policy 1, policy_version 203792 (0.0005) [2023-12-26 01:13:02,664][123090] Updated weights for policy 1, policy_version 203802 (0.0005) [2023-12-26 01:13:03,197][123090] Updated weights for policy 1, policy_version 203812 (0.0005) [2023-12-26 01:13:03,267][123091] Updated weights for policy 0, policy_version 204595 (0.0009) [2023-12-26 01:13:03,268][123090] Updated weights for policy 1, policy_version 203822 (0.0005) [2023-12-26 01:13:03,324][123091] Updated weights for policy 0, policy_version 204605 (0.0007) [2023-12-26 01:13:03,335][123090] Updated weights for policy 1, policy_version 203832 (0.0005) [2023-12-26 01:13:03,375][123091] Updated weights for policy 0, policy_version 204615 (0.0010) [2023-12-26 01:13:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 104570880. Throughput: 0: 8796.7, 1: 8854.8. Samples: 104581860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:03,784][121949] Avg episode reward: [(0, '5932.006'), (1, '5258.786')] [2023-12-26 01:13:03,964][123090] Updated weights for policy 1, policy_version 203842 (0.0005) [2023-12-26 01:13:04,020][123090] Updated weights for policy 1, policy_version 203852 (0.0009) [2023-12-26 01:13:04,084][123090] Updated weights for policy 1, policy_version 203862 (0.0006) [2023-12-26 01:13:04,154][123090] Updated weights for policy 1, policy_version 203872 (0.0010) [2023-12-26 01:13:04,198][123091] Updated weights for policy 0, policy_version 204625 (0.0010) [2023-12-26 01:13:04,271][123091] Updated weights for policy 0, policy_version 204635 (0.0008) [2023-12-26 01:13:04,345][123091] Updated weights for policy 0, policy_version 204645 (0.0006) [2023-12-26 01:13:04,416][123091] Updated weights for policy 0, policy_version 204655 (0.0009) [2023-12-26 01:13:04,969][123090] Updated weights for policy 1, policy_version 203882 (0.0010) [2023-12-26 01:13:05,028][123090] Updated weights for policy 1, policy_version 203892 (0.0010) [2023-12-26 01:13:05,069][123091] Updated weights for policy 0, policy_version 204665 (0.0010) [2023-12-26 01:13:05,076][123090] Updated weights for policy 1, policy_version 203902 (0.0010) [2023-12-26 01:13:05,120][123091] Updated weights for policy 0, policy_version 204675 (0.0010) [2023-12-26 01:13:05,167][123091] Updated weights for policy 0, policy_version 204685 (0.0010) [2023-12-26 01:13:05,722][123090] Updated weights for policy 1, policy_version 203912 (0.0010) [2023-12-26 01:13:05,774][123090] Updated weights for policy 1, policy_version 203922 (0.0010) [2023-12-26 01:13:05,839][123090] Updated weights for policy 1, policy_version 203932 (0.0007) [2023-12-26 01:13:06,031][123091] Updated weights for policy 0, policy_version 204695 (0.0010) [2023-12-26 01:13:06,086][123091] Updated weights for policy 0, policy_version 204706 (0.0010) [2023-12-26 01:13:06,151][123091] Updated weights for policy 0, policy_version 204716 (0.0010) [2023-12-26 01:13:06,602][123090] Updated weights for policy 1, policy_version 203942 (0.0008) [2023-12-26 01:13:06,666][123090] Updated weights for policy 1, policy_version 203952 (0.0010) [2023-12-26 01:13:06,734][123090] Updated weights for policy 1, policy_version 203962 (0.0010) [2023-12-26 01:13:06,925][123091] Updated weights for policy 0, policy_version 204726 (0.0007) [2023-12-26 01:13:06,973][123091] Updated weights for policy 0, policy_version 204736 (0.0005) [2023-12-26 01:13:07,029][123091] Updated weights for policy 0, policy_version 204746 (0.0005) [2023-12-26 01:13:07,551][123090] Updated weights for policy 1, policy_version 203972 (0.0008) [2023-12-26 01:13:07,616][123090] Updated weights for policy 1, policy_version 203982 (0.0006) [2023-12-26 01:13:07,682][123090] Updated weights for policy 1, policy_version 203992 (0.0006) [2023-12-26 01:13:07,703][123091] Updated weights for policy 0, policy_version 204756 (0.0006) [2023-12-26 01:13:07,756][123091] Updated weights for policy 0, policy_version 204766 (0.0005) [2023-12-26 01:13:07,811][123091] Updated weights for policy 0, policy_version 204776 (0.0011) [2023-12-26 01:13:08,496][123091] Updated weights for policy 0, policy_version 204786 (0.0010) [2023-12-26 01:13:08,508][123090] Updated weights for policy 1, policy_version 204002 (0.0008) [2023-12-26 01:13:08,554][123091] Updated weights for policy 0, policy_version 204796 (0.0008) [2023-12-26 01:13:08,566][123090] Updated weights for policy 1, policy_version 204012 (0.0008) [2023-12-26 01:13:08,614][123091] Updated weights for policy 0, policy_version 204806 (0.0010) [2023-12-26 01:13:08,626][123090] Updated weights for policy 1, policy_version 204022 (0.0008) [2023-12-26 01:13:08,673][123091] Updated weights for policy 0, policy_version 204816 (0.0010) [2023-12-26 01:13:08,690][123090] Updated weights for policy 1, policy_version 204032 (0.0009) [2023-12-26 01:13:08,784][121949] Fps is (10 sec: 19661.0, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 104669184. Throughput: 0: 8830.3, 1: 8906.6. Samples: 104636292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:08,785][121949] Avg episode reward: [(0, '5905.321'), (1, '5377.576')] [2023-12-26 01:13:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000204816_52436992.pth... [2023-12-26 01:13:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000204032_52232192.pth... [2023-12-26 01:13:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000202976_51961856.pth [2023-12-26 01:13:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000203760_52166656.pth [2023-12-26 01:13:09,499][123091] Updated weights for policy 0, policy_version 204826 (0.0008) [2023-12-26 01:13:09,541][123090] Updated weights for policy 1, policy_version 204042 (0.0007) [2023-12-26 01:13:09,554][123091] Updated weights for policy 0, policy_version 204836 (0.0007) [2023-12-26 01:13:09,604][123090] Updated weights for policy 1, policy_version 204052 (0.0009) [2023-12-26 01:13:09,612][123091] Updated weights for policy 0, policy_version 204846 (0.0005) [2023-12-26 01:13:09,657][123090] Updated weights for policy 1, policy_version 204062 (0.0009) [2023-12-26 01:13:10,423][123091] Updated weights for policy 0, policy_version 204856 (0.0008) [2023-12-26 01:13:10,479][123091] Updated weights for policy 0, policy_version 204866 (0.0009) [2023-12-26 01:13:10,543][123091] Updated weights for policy 0, policy_version 204876 (0.0010) [2023-12-26 01:13:10,578][123090] Updated weights for policy 1, policy_version 204072 (0.0008) [2023-12-26 01:13:10,637][123090] Updated weights for policy 1, policy_version 204082 (0.0010) [2023-12-26 01:13:10,703][123090] Updated weights for policy 1, policy_version 204092 (0.0010) [2023-12-26 01:13:11,293][123091] Updated weights for policy 0, policy_version 204886 (0.0007) [2023-12-26 01:13:11,369][123091] Updated weights for policy 0, policy_version 204896 (0.0008) [2023-12-26 01:13:11,440][123091] Updated weights for policy 0, policy_version 204906 (0.0008) [2023-12-26 01:13:11,502][123090] Updated weights for policy 1, policy_version 204102 (0.0009) [2023-12-26 01:13:11,565][123090] Updated weights for policy 1, policy_version 204112 (0.0010) [2023-12-26 01:13:11,644][123090] Updated weights for policy 1, policy_version 204122 (0.0011) [2023-12-26 01:13:12,280][123091] Updated weights for policy 0, policy_version 204916 (0.0009) [2023-12-26 01:13:12,349][123091] Updated weights for policy 0, policy_version 204926 (0.0011) [2023-12-26 01:13:12,419][123091] Updated weights for policy 0, policy_version 204936 (0.0011) [2023-12-26 01:13:12,477][123090] Updated weights for policy 1, policy_version 204132 (0.0011) [2023-12-26 01:13:12,537][123090] Updated weights for policy 1, policy_version 204142 (0.0011) [2023-12-26 01:13:12,602][123090] Updated weights for policy 1, policy_version 204152 (0.0011) [2023-12-26 01:13:13,251][123091] Updated weights for policy 0, policy_version 204946 (0.0011) [2023-12-26 01:13:13,316][123091] Updated weights for policy 0, policy_version 204956 (0.0010) [2023-12-26 01:13:13,377][123091] Updated weights for policy 0, policy_version 204966 (0.0006) [2023-12-26 01:13:13,399][123090] Updated weights for policy 1, policy_version 204162 (0.0010) [2023-12-26 01:13:13,435][123091] Updated weights for policy 0, policy_version 204976 (0.0005) [2023-12-26 01:13:13,465][123090] Updated weights for policy 1, policy_version 204172 (0.0010) [2023-12-26 01:13:13,535][123090] Updated weights for policy 1, policy_version 204182 (0.0009) [2023-12-26 01:13:13,603][123090] Updated weights for policy 1, policy_version 204192 (0.0009) [2023-12-26 01:13:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 104751104. Throughput: 0: 8856.1, 1: 8825.8. Samples: 104742580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:13,785][121949] Avg episode reward: [(0, '5809.288'), (1, '5415.040')] [2023-12-26 01:13:14,096][123091] Updated weights for policy 0, policy_version 204986 (0.0005) [2023-12-26 01:13:14,155][123091] Updated weights for policy 0, policy_version 204996 (0.0005) [2023-12-26 01:13:14,207][123091] Updated weights for policy 0, policy_version 205006 (0.0005) [2023-12-26 01:13:14,506][123090] Updated weights for policy 1, policy_version 204202 (0.0006) [2023-12-26 01:13:14,578][123090] Updated weights for policy 1, policy_version 204212 (0.0007) [2023-12-26 01:13:14,648][123090] Updated weights for policy 1, policy_version 204222 (0.0006) [2023-12-26 01:13:14,859][123091] Updated weights for policy 0, policy_version 205016 (0.0010) [2023-12-26 01:13:14,928][123091] Updated weights for policy 0, policy_version 205026 (0.0008) [2023-12-26 01:13:15,002][123091] Updated weights for policy 0, policy_version 205036 (0.0011) [2023-12-26 01:13:15,465][123090] Updated weights for policy 1, policy_version 204232 (0.0011) [2023-12-26 01:13:15,520][123090] Updated weights for policy 1, policy_version 204242 (0.0010) [2023-12-26 01:13:15,584][123090] Updated weights for policy 1, policy_version 204252 (0.0011) [2023-12-26 01:13:15,765][123091] Updated weights for policy 0, policy_version 205046 (0.0011) [2023-12-26 01:13:15,838][123091] Updated weights for policy 0, policy_version 205056 (0.0011) [2023-12-26 01:13:15,904][123091] Updated weights for policy 0, policy_version 205066 (0.0010) [2023-12-26 01:13:16,398][123090] Updated weights for policy 1, policy_version 204262 (0.0010) [2023-12-26 01:13:16,453][123090] Updated weights for policy 1, policy_version 204272 (0.0010) [2023-12-26 01:13:16,511][123090] Updated weights for policy 1, policy_version 204282 (0.0010) [2023-12-26 01:13:16,716][123091] Updated weights for policy 0, policy_version 205076 (0.0011) [2023-12-26 01:13:16,790][123091] Updated weights for policy 0, policy_version 205086 (0.0011) [2023-12-26 01:13:16,863][123091] Updated weights for policy 0, policy_version 205096 (0.0011) [2023-12-26 01:13:17,200][123090] Updated weights for policy 1, policy_version 204292 (0.0008) [2023-12-26 01:13:17,258][123090] Updated weights for policy 1, policy_version 204302 (0.0009) [2023-12-26 01:13:17,309][123090] Updated weights for policy 1, policy_version 204312 (0.0010) [2023-12-26 01:13:17,643][123091] Updated weights for policy 0, policy_version 205106 (0.0010) [2023-12-26 01:13:17,699][123091] Updated weights for policy 0, policy_version 205116 (0.0011) [2023-12-26 01:13:17,765][123091] Updated weights for policy 0, policy_version 205126 (0.0011) [2023-12-26 01:13:17,819][123091] Updated weights for policy 0, policy_version 205136 (0.0010) [2023-12-26 01:13:18,054][123090] Updated weights for policy 1, policy_version 204322 (0.0009) [2023-12-26 01:13:18,108][123090] Updated weights for policy 1, policy_version 204332 (0.0006) [2023-12-26 01:13:18,159][123090] Updated weights for policy 1, policy_version 204342 (0.0010) [2023-12-26 01:13:18,221][123090] Updated weights for policy 1, policy_version 204352 (0.0005) [2023-12-26 01:13:18,558][123091] Updated weights for policy 0, policy_version 205146 (0.0007) [2023-12-26 01:13:18,621][123091] Updated weights for policy 0, policy_version 205156 (0.0006) [2023-12-26 01:13:18,679][123091] Updated weights for policy 0, policy_version 205166 (0.0005) [2023-12-26 01:13:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 104841216. Throughput: 0: 8919.2, 1: 8848.3. Samples: 104851088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:18,785][121949] Avg episode reward: [(0, '5822.628'), (1, '5234.635')] [2023-12-26 01:13:19,038][123090] Updated weights for policy 1, policy_version 204362 (0.0006) [2023-12-26 01:13:19,113][123090] Updated weights for policy 1, policy_version 204372 (0.0006) [2023-12-26 01:13:19,182][123090] Updated weights for policy 1, policy_version 204382 (0.0006) [2023-12-26 01:13:19,491][123091] Updated weights for policy 0, policy_version 205176 (0.0010) [2023-12-26 01:13:19,570][123091] Updated weights for policy 0, policy_version 205186 (0.0010) [2023-12-26 01:13:19,634][123091] Updated weights for policy 0, policy_version 205196 (0.0008) [2023-12-26 01:13:19,938][123090] Updated weights for policy 1, policy_version 204392 (0.0007) [2023-12-26 01:13:20,009][123090] Updated weights for policy 1, policy_version 204402 (0.0009) [2023-12-26 01:13:20,066][123090] Updated weights for policy 1, policy_version 204412 (0.0009) [2023-12-26 01:13:20,397][123091] Updated weights for policy 0, policy_version 205206 (0.0008) [2023-12-26 01:13:20,453][123091] Updated weights for policy 0, policy_version 205216 (0.0006) [2023-12-26 01:13:20,521][123091] Updated weights for policy 0, policy_version 205226 (0.0009) [2023-12-26 01:13:20,921][123090] Updated weights for policy 1, policy_version 204422 (0.0010) [2023-12-26 01:13:20,985][123090] Updated weights for policy 1, policy_version 204432 (0.0011) [2023-12-26 01:13:21,046][123090] Updated weights for policy 1, policy_version 204442 (0.0010) [2023-12-26 01:13:21,347][123091] Updated weights for policy 0, policy_version 205236 (0.0009) [2023-12-26 01:13:21,412][123091] Updated weights for policy 0, policy_version 205246 (0.0008) [2023-12-26 01:13:21,464][123091] Updated weights for policy 0, policy_version 205256 (0.0008) [2023-12-26 01:13:21,891][123090] Updated weights for policy 1, policy_version 204452 (0.0011) [2023-12-26 01:13:21,954][123090] Updated weights for policy 1, policy_version 204462 (0.0011) [2023-12-26 01:13:22,023][123090] Updated weights for policy 1, policy_version 204472 (0.0011) [2023-12-26 01:13:22,351][123091] Updated weights for policy 0, policy_version 205266 (0.0008) [2023-12-26 01:13:22,408][123091] Updated weights for policy 0, policy_version 205276 (0.0009) [2023-12-26 01:13:22,462][123091] Updated weights for policy 0, policy_version 205286 (0.0009) [2023-12-26 01:13:22,526][123091] Updated weights for policy 0, policy_version 205296 (0.0009) [2023-12-26 01:13:22,843][123090] Updated weights for policy 1, policy_version 204482 (0.0010) [2023-12-26 01:13:22,891][123090] Updated weights for policy 1, policy_version 204492 (0.0005) [2023-12-26 01:13:22,954][123090] Updated weights for policy 1, policy_version 204502 (0.0005) [2023-12-26 01:13:23,019][123090] Updated weights for policy 1, policy_version 204512 (0.0005) [2023-12-26 01:13:23,390][123091] Updated weights for policy 0, policy_version 205306 (0.0005) [2023-12-26 01:13:23,441][123091] Updated weights for policy 0, policy_version 205316 (0.0005) [2023-12-26 01:13:23,498][123091] Updated weights for policy 0, policy_version 205326 (0.0006) [2023-12-26 01:13:23,728][123090] Updated weights for policy 1, policy_version 204522 (0.0005) [2023-12-26 01:13:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 104923136. Throughput: 0: 8896.3, 1: 8863.3. Samples: 104902584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:23,785][121949] Avg episode reward: [(0, '5874.060'), (1, '5309.853')] [2023-12-26 01:13:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000205328_52568064.pth... [2023-12-26 01:13:23,794][123090] Updated weights for policy 1, policy_version 204532 (0.0005) [2023-12-26 01:13:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000204272_52297728.pth [2023-12-26 01:13:23,857][123090] Updated weights for policy 1, policy_version 204542 (0.0009) [2023-12-26 01:13:23,869][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000204544_52363264.pth... [2023-12-26 01:13:23,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000203488_52092928.pth [2023-12-26 01:13:24,165][123091] Updated weights for policy 0, policy_version 205336 (0.0008) [2023-12-26 01:13:24,222][123091] Updated weights for policy 0, policy_version 205346 (0.0009) [2023-12-26 01:13:24,271][123091] Updated weights for policy 0, policy_version 205356 (0.0009) [2023-12-26 01:13:24,589][123090] Updated weights for policy 1, policy_version 204552 (0.0007) [2023-12-26 01:13:24,634][123090] Updated weights for policy 1, policy_version 204562 (0.0005) [2023-12-26 01:13:24,679][123090] Updated weights for policy 1, policy_version 204572 (0.0005) [2023-12-26 01:13:24,978][123091] Updated weights for policy 0, policy_version 205367 (0.0009) [2023-12-26 01:13:25,048][123091] Updated weights for policy 0, policy_version 205377 (0.0010) [2023-12-26 01:13:25,113][123091] Updated weights for policy 0, policy_version 205387 (0.0009) [2023-12-26 01:13:25,372][123090] Updated weights for policy 1, policy_version 204582 (0.0005) [2023-12-26 01:13:25,433][123090] Updated weights for policy 1, policy_version 204592 (0.0006) [2023-12-26 01:13:25,487][123090] Updated weights for policy 1, policy_version 204602 (0.0006) [2023-12-26 01:13:25,795][123091] Updated weights for policy 0, policy_version 205397 (0.0010) [2023-12-26 01:13:25,854][123091] Updated weights for policy 0, policy_version 205407 (0.0010) [2023-12-26 01:13:25,908][123091] Updated weights for policy 0, policy_version 205419 (0.0010) [2023-12-26 01:13:26,103][123090] Updated weights for policy 1, policy_version 204612 (0.0005) [2023-12-26 01:13:26,166][123090] Updated weights for policy 1, policy_version 204622 (0.0006) [2023-12-26 01:13:26,218][123090] Updated weights for policy 1, policy_version 204632 (0.0009) [2023-12-26 01:13:26,727][123091] Updated weights for policy 0, policy_version 205430 (0.0010) [2023-12-26 01:13:26,777][123091] Updated weights for policy 0, policy_version 205440 (0.0009) [2023-12-26 01:13:26,824][123091] Updated weights for policy 0, policy_version 205450 (0.0008) [2023-12-26 01:13:26,981][123090] Updated weights for policy 1, policy_version 204642 (0.0008) [2023-12-26 01:13:27,042][123090] Updated weights for policy 1, policy_version 204652 (0.0006) [2023-12-26 01:13:27,097][123090] Updated weights for policy 1, policy_version 204662 (0.0005) [2023-12-26 01:13:27,151][123090] Updated weights for policy 1, policy_version 204672 (0.0005) [2023-12-26 01:13:27,753][123091] Updated weights for policy 0, policy_version 205460 (0.0009) [2023-12-26 01:13:27,801][123091] Updated weights for policy 0, policy_version 205470 (0.0009) [2023-12-26 01:13:27,806][123090] Updated weights for policy 1, policy_version 204682 (0.0007) [2023-12-26 01:13:27,846][123091] Updated weights for policy 0, policy_version 205480 (0.0010) [2023-12-26 01:13:27,853][123090] Updated weights for policy 1, policy_version 204692 (0.0010) [2023-12-26 01:13:27,896][123090] Updated weights for policy 1, policy_version 204702 (0.0010) [2023-12-26 01:13:28,596][123090] Updated weights for policy 1, policy_version 204712 (0.0010) [2023-12-26 01:13:28,647][123090] Updated weights for policy 1, policy_version 204722 (0.0010) [2023-12-26 01:13:28,707][123090] Updated weights for policy 1, policy_version 204732 (0.0005) [2023-12-26 01:13:28,772][123091] Updated weights for policy 0, policy_version 205490 (0.0006) [2023-12-26 01:13:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 105021440. Throughput: 0: 8972.3, 1: 9020.0. Samples: 105014032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:28,785][121949] Avg episode reward: [(0, '5898.244'), (1, '5347.191')] [2023-12-26 01:13:28,834][123091] Updated weights for policy 0, policy_version 205500 (0.0010) [2023-12-26 01:13:28,902][123091] Updated weights for policy 0, policy_version 205510 (0.0010) [2023-12-26 01:13:28,972][123091] Updated weights for policy 0, policy_version 205520 (0.0010) [2023-12-26 01:13:29,384][123090] Updated weights for policy 1, policy_version 204742 (0.0007) [2023-12-26 01:13:29,438][123090] Updated weights for policy 1, policy_version 204752 (0.0005) [2023-12-26 01:13:29,513][123090] Updated weights for policy 1, policy_version 204762 (0.0009) [2023-12-26 01:13:29,902][123091] Updated weights for policy 0, policy_version 205530 (0.0009) [2023-12-26 01:13:29,968][123091] Updated weights for policy 0, policy_version 205540 (0.0009) [2023-12-26 01:13:30,035][123091] Updated weights for policy 0, policy_version 205550 (0.0009) [2023-12-26 01:13:30,284][123090] Updated weights for policy 1, policy_version 204772 (0.0010) [2023-12-26 01:13:30,347][123090] Updated weights for policy 1, policy_version 204782 (0.0010) [2023-12-26 01:13:30,411][123090] Updated weights for policy 1, policy_version 204792 (0.0010) [2023-12-26 01:13:30,869][123091] Updated weights for policy 0, policy_version 205560 (0.0009) [2023-12-26 01:13:30,937][123091] Updated weights for policy 0, policy_version 205570 (0.0009) [2023-12-26 01:13:31,005][123091] Updated weights for policy 0, policy_version 205580 (0.0010) [2023-12-26 01:13:31,125][123090] Updated weights for policy 1, policy_version 204802 (0.0009) [2023-12-26 01:13:31,193][123090] Updated weights for policy 1, policy_version 204812 (0.0008) [2023-12-26 01:13:31,253][123090] Updated weights for policy 1, policy_version 204822 (0.0005) [2023-12-26 01:13:31,319][123090] Updated weights for policy 1, policy_version 204832 (0.0007) [2023-12-26 01:13:31,870][123091] Updated weights for policy 0, policy_version 205590 (0.0009) [2023-12-26 01:13:31,935][123091] Updated weights for policy 0, policy_version 205600 (0.0009) [2023-12-26 01:13:31,994][123091] Updated weights for policy 0, policy_version 205610 (0.0009) [2023-12-26 01:13:32,075][123090] Updated weights for policy 1, policy_version 204842 (0.0005) [2023-12-26 01:13:32,139][123090] Updated weights for policy 1, policy_version 204852 (0.0005) [2023-12-26 01:13:32,192][123090] Updated weights for policy 1, policy_version 204862 (0.0005) [2023-12-26 01:13:32,878][123090] Updated weights for policy 1, policy_version 204872 (0.0006) [2023-12-26 01:13:32,902][123091] Updated weights for policy 0, policy_version 205620 (0.0008) [2023-12-26 01:13:32,937][123090] Updated weights for policy 1, policy_version 204882 (0.0010) [2023-12-26 01:13:32,961][123091] Updated weights for policy 0, policy_version 205630 (0.0006) [2023-12-26 01:13:32,999][123090] Updated weights for policy 1, policy_version 204892 (0.0010) [2023-12-26 01:13:33,019][123091] Updated weights for policy 0, policy_version 205640 (0.0007) [2023-12-26 01:13:33,705][123091] Updated weights for policy 0, policy_version 205650 (0.0009) [2023-12-26 01:13:33,766][123091] Updated weights for policy 0, policy_version 205660 (0.0010) [2023-12-26 01:13:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 105103360. Throughput: 0: 8864.4, 1: 9128.9. Samples: 105120928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:33,785][121949] Avg episode reward: [(0, '5898.397'), (1, '5291.592')] [2023-12-26 01:13:33,802][123090] Updated weights for policy 1, policy_version 204902 (0.0010) [2023-12-26 01:13:33,819][123091] Updated weights for policy 0, policy_version 205670 (0.0006) [2023-12-26 01:13:33,862][123090] Updated weights for policy 1, policy_version 204912 (0.0010) [2023-12-26 01:13:33,880][123091] Updated weights for policy 0, policy_version 205680 (0.0007) [2023-12-26 01:13:33,920][123090] Updated weights for policy 1, policy_version 204922 (0.0010) [2023-12-26 01:13:34,618][123091] Updated weights for policy 0, policy_version 205690 (0.0011) [2023-12-26 01:13:34,678][123091] Updated weights for policy 0, policy_version 205700 (0.0011) [2023-12-26 01:13:34,689][123090] Updated weights for policy 1, policy_version 204932 (0.0008) [2023-12-26 01:13:34,742][123091] Updated weights for policy 0, policy_version 205710 (0.0011) [2023-12-26 01:13:34,753][123090] Updated weights for policy 1, policy_version 204942 (0.0006) [2023-12-26 01:13:34,820][123090] Updated weights for policy 1, policy_version 204952 (0.0007) [2023-12-26 01:13:35,371][123090] Updated weights for policy 1, policy_version 204962 (0.0005) [2023-12-26 01:13:35,439][123090] Updated weights for policy 1, policy_version 204972 (0.0005) [2023-12-26 01:13:35,511][123091] Updated weights for policy 0, policy_version 205720 (0.0006) [2023-12-26 01:13:35,511][123090] Updated weights for policy 1, policy_version 204982 (0.0007) [2023-12-26 01:13:35,560][123091] Updated weights for policy 0, policy_version 205730 (0.0006) [2023-12-26 01:13:35,583][123090] Updated weights for policy 1, policy_version 204992 (0.0009) [2023-12-26 01:13:35,626][123091] Updated weights for policy 0, policy_version 205740 (0.0005) [2023-12-26 01:13:36,281][123090] Updated weights for policy 1, policy_version 205002 (0.0005) [2023-12-26 01:13:36,342][123090] Updated weights for policy 1, policy_version 205012 (0.0006) [2023-12-26 01:13:36,402][123090] Updated weights for policy 1, policy_version 205022 (0.0006) [2023-12-26 01:13:36,434][123091] Updated weights for policy 0, policy_version 205750 (0.0006) [2023-12-26 01:13:36,494][123091] Updated weights for policy 0, policy_version 205760 (0.0006) [2023-12-26 01:13:36,551][123091] Updated weights for policy 0, policy_version 205770 (0.0005) [2023-12-26 01:13:37,133][123090] Updated weights for policy 1, policy_version 205032 (0.0008) [2023-12-26 01:13:37,194][123090] Updated weights for policy 1, policy_version 205042 (0.0006) [2023-12-26 01:13:37,229][123091] Updated weights for policy 0, policy_version 205780 (0.0008) [2023-12-26 01:13:37,253][123090] Updated weights for policy 1, policy_version 205052 (0.0007) [2023-12-26 01:13:37,285][123091] Updated weights for policy 0, policy_version 205790 (0.0011) [2023-12-26 01:13:37,347][123091] Updated weights for policy 0, policy_version 205800 (0.0011) [2023-12-26 01:13:38,040][123090] Updated weights for policy 1, policy_version 205062 (0.0010) [2023-12-26 01:13:38,091][123090] Updated weights for policy 1, policy_version 205072 (0.0010) [2023-12-26 01:13:38,130][123091] Updated weights for policy 0, policy_version 205810 (0.0010) [2023-12-26 01:13:38,151][123090] Updated weights for policy 1, policy_version 205082 (0.0010) [2023-12-26 01:13:38,194][123091] Updated weights for policy 0, policy_version 205820 (0.0005) [2023-12-26 01:13:38,256][123091] Updated weights for policy 0, policy_version 205830 (0.0006) [2023-12-26 01:13:38,314][123091] Updated weights for policy 0, policy_version 205840 (0.0006) [2023-12-26 01:13:38,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 105201664. Throughput: 0: 8915.3, 1: 9192.9. Samples: 105177620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:38,785][121949] Avg episode reward: [(0, '5893.683'), (1, '5311.223')] [2023-12-26 01:13:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000205088_52502528.pth... [2023-12-26 01:13:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000205840_52699136.pth... [2023-12-26 01:13:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000204032_52232192.pth [2023-12-26 01:13:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000204816_52436992.pth [2023-12-26 01:13:38,994][123090] Updated weights for policy 1, policy_version 205092 (0.0010) [2023-12-26 01:13:39,046][123090] Updated weights for policy 1, policy_version 205102 (0.0010) [2023-12-26 01:13:39,046][123091] Updated weights for policy 0, policy_version 205850 (0.0006) [2023-12-26 01:13:39,105][123090] Updated weights for policy 1, policy_version 205112 (0.0010) [2023-12-26 01:13:39,111][123091] Updated weights for policy 0, policy_version 205860 (0.0006) [2023-12-26 01:13:39,174][123091] Updated weights for policy 0, policy_version 205870 (0.0006) [2023-12-26 01:13:39,982][123090] Updated weights for policy 1, policy_version 205122 (0.0010) [2023-12-26 01:13:39,990][123091] Updated weights for policy 0, policy_version 205880 (0.0006) [2023-12-26 01:13:40,049][123090] Updated weights for policy 1, policy_version 205132 (0.0009) [2023-12-26 01:13:40,059][123091] Updated weights for policy 0, policy_version 205890 (0.0008) [2023-12-26 01:13:40,105][123090] Updated weights for policy 1, policy_version 205142 (0.0008) [2023-12-26 01:13:40,117][123091] Updated weights for policy 0, policy_version 205900 (0.0010) [2023-12-26 01:13:40,169][123090] Updated weights for policy 1, policy_version 205152 (0.0009) [2023-12-26 01:13:40,816][123091] Updated weights for policy 0, policy_version 205910 (0.0006) [2023-12-26 01:13:40,880][123091] Updated weights for policy 0, policy_version 205920 (0.0010) [2023-12-26 01:13:40,944][123091] Updated weights for policy 0, policy_version 205930 (0.0010) [2023-12-26 01:13:40,960][123090] Updated weights for policy 1, policy_version 205162 (0.0008) [2023-12-26 01:13:41,033][123090] Updated weights for policy 1, policy_version 205172 (0.0008) [2023-12-26 01:13:41,104][123090] Updated weights for policy 1, policy_version 205182 (0.0009) [2023-12-26 01:13:41,797][123091] Updated weights for policy 0, policy_version 205940 (0.0008) [2023-12-26 01:13:41,851][123091] Updated weights for policy 0, policy_version 205950 (0.0008) [2023-12-26 01:13:41,916][123091] Updated weights for policy 0, policy_version 205960 (0.0008) [2023-12-26 01:13:41,946][123090] Updated weights for policy 1, policy_version 205192 (0.0008) [2023-12-26 01:13:42,012][123090] Updated weights for policy 1, policy_version 205202 (0.0008) [2023-12-26 01:13:42,071][123090] Updated weights for policy 1, policy_version 205212 (0.0005) [2023-12-26 01:13:42,699][123091] Updated weights for policy 0, policy_version 205970 (0.0008) [2023-12-26 01:13:42,752][123091] Updated weights for policy 0, policy_version 205980 (0.0010) [2023-12-26 01:13:42,812][123091] Updated weights for policy 0, policy_version 205990 (0.0009) [2023-12-26 01:13:42,857][123090] Updated weights for policy 1, policy_version 205222 (0.0007) [2023-12-26 01:13:42,861][123091] Updated weights for policy 0, policy_version 206000 (0.0007) [2023-12-26 01:13:42,912][123090] Updated weights for policy 1, policy_version 205232 (0.0010) [2023-12-26 01:13:42,972][123090] Updated weights for policy 1, policy_version 205242 (0.0010) [2023-12-26 01:13:43,655][123091] Updated weights for policy 0, policy_version 206010 (0.0010) [2023-12-26 01:13:43,703][123091] Updated weights for policy 0, policy_version 206020 (0.0009) [2023-12-26 01:13:43,770][123091] Updated weights for policy 0, policy_version 206030 (0.0009) [2023-12-26 01:13:43,784][121949] Fps is (10 sec: 18842.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 105291776. Throughput: 0: 8963.5, 1: 9091.9. Samples: 105284396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:43,784][121949] Avg episode reward: [(0, '5863.027'), (1, '5374.934')] [2023-12-26 01:13:43,867][123090] Updated weights for policy 1, policy_version 205252 (0.0010) [2023-12-26 01:13:43,922][123090] Updated weights for policy 1, policy_version 205262 (0.0009) [2023-12-26 01:13:43,974][123090] Updated weights for policy 1, policy_version 205272 (0.0008) [2023-12-26 01:13:44,591][123091] Updated weights for policy 0, policy_version 206040 (0.0007) [2023-12-26 01:13:44,650][123091] Updated weights for policy 0, policy_version 206050 (0.0005) [2023-12-26 01:13:44,701][123091] Updated weights for policy 0, policy_version 206060 (0.0005) [2023-12-26 01:13:44,877][123090] Updated weights for policy 1, policy_version 205282 (0.0009) [2023-12-26 01:13:44,949][123090] Updated weights for policy 1, policy_version 205292 (0.0010) [2023-12-26 01:13:45,016][123090] Updated weights for policy 1, policy_version 205302 (0.0010) [2023-12-26 01:13:45,091][123090] Updated weights for policy 1, policy_version 205312 (0.0009) [2023-12-26 01:13:45,486][123091] Updated weights for policy 0, policy_version 206070 (0.0008) [2023-12-26 01:13:45,536][123091] Updated weights for policy 0, policy_version 206080 (0.0009) [2023-12-26 01:13:45,585][123091] Updated weights for policy 0, policy_version 206090 (0.0009) [2023-12-26 01:13:45,923][123090] Updated weights for policy 1, policy_version 205322 (0.0009) [2023-12-26 01:13:45,988][123090] Updated weights for policy 1, policy_version 205332 (0.0009) [2023-12-26 01:13:46,048][123090] Updated weights for policy 1, policy_version 205342 (0.0010) [2023-12-26 01:13:46,397][123091] Updated weights for policy 0, policy_version 206100 (0.0010) [2023-12-26 01:13:46,454][123091] Updated weights for policy 0, policy_version 206110 (0.0009) [2023-12-26 01:13:46,502][123091] Updated weights for policy 0, policy_version 206120 (0.0009) [2023-12-26 01:13:46,892][123090] Updated weights for policy 1, policy_version 205352 (0.0009) [2023-12-26 01:13:46,952][123090] Updated weights for policy 1, policy_version 205362 (0.0009) [2023-12-26 01:13:47,015][123090] Updated weights for policy 1, policy_version 205372 (0.0010) [2023-12-26 01:13:47,345][123091] Updated weights for policy 0, policy_version 206130 (0.0009) [2023-12-26 01:13:47,399][123091] Updated weights for policy 0, policy_version 206140 (0.0008) [2023-12-26 01:13:47,446][123091] Updated weights for policy 0, policy_version 206150 (0.0009) [2023-12-26 01:13:47,495][123091] Updated weights for policy 0, policy_version 206160 (0.0009) [2023-12-26 01:13:47,824][123090] Updated weights for policy 1, policy_version 205382 (0.0009) [2023-12-26 01:13:47,871][123090] Updated weights for policy 1, policy_version 205392 (0.0008) [2023-12-26 01:13:47,919][123090] Updated weights for policy 1, policy_version 205402 (0.0008) [2023-12-26 01:13:48,350][123091] Updated weights for policy 0, policy_version 206170 (0.0010) [2023-12-26 01:13:48,409][123091] Updated weights for policy 0, policy_version 206180 (0.0009) [2023-12-26 01:13:48,459][123091] Updated weights for policy 0, policy_version 206190 (0.0008) [2023-12-26 01:13:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 105373696. Throughput: 0: 8919.9, 1: 8981.9. Samples: 105387440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:48,785][121949] Avg episode reward: [(0, '5842.420'), (1, '5277.932')] [2023-12-26 01:13:48,792][123090] Updated weights for policy 1, policy_version 205412 (0.0009) [2023-12-26 01:13:48,855][123090] Updated weights for policy 1, policy_version 205422 (0.0009) [2023-12-26 01:13:48,918][123090] Updated weights for policy 1, policy_version 205432 (0.0010) [2023-12-26 01:13:49,270][123091] Updated weights for policy 0, policy_version 206200 (0.0008) [2023-12-26 01:13:49,337][123091] Updated weights for policy 0, policy_version 206210 (0.0010) [2023-12-26 01:13:49,406][123091] Updated weights for policy 0, policy_version 206220 (0.0011) [2023-12-26 01:13:49,735][123090] Updated weights for policy 1, policy_version 205442 (0.0008) [2023-12-26 01:13:49,801][123090] Updated weights for policy 1, policy_version 205452 (0.0010) [2023-12-26 01:13:49,871][123090] Updated weights for policy 1, policy_version 205462 (0.0011) [2023-12-26 01:13:49,944][123090] Updated weights for policy 1, policy_version 205472 (0.0008) [2023-12-26 01:13:50,211][123091] Updated weights for policy 0, policy_version 206230 (0.0009) [2023-12-26 01:13:50,261][123091] Updated weights for policy 0, policy_version 206240 (0.0009) [2023-12-26 01:13:50,314][123091] Updated weights for policy 0, policy_version 206250 (0.0009) [2023-12-26 01:13:50,745][123090] Updated weights for policy 1, policy_version 205482 (0.0011) [2023-12-26 01:13:50,805][123090] Updated weights for policy 1, policy_version 205492 (0.0009) [2023-12-26 01:13:50,866][123090] Updated weights for policy 1, policy_version 205502 (0.0009) [2023-12-26 01:13:51,144][123091] Updated weights for policy 0, policy_version 206260 (0.0009) [2023-12-26 01:13:51,216][123091] Updated weights for policy 0, policy_version 206270 (0.0008) [2023-12-26 01:13:51,285][123091] Updated weights for policy 0, policy_version 206280 (0.0009) [2023-12-26 01:13:51,760][123090] Updated weights for policy 1, policy_version 205512 (0.0009) [2023-12-26 01:13:51,818][123090] Updated weights for policy 1, policy_version 205522 (0.0010) [2023-12-26 01:13:51,880][123090] Updated weights for policy 1, policy_version 205532 (0.0009) [2023-12-26 01:13:51,942][123091] Updated weights for policy 0, policy_version 206290 (0.0009) [2023-12-26 01:13:51,993][123091] Updated weights for policy 0, policy_version 206300 (0.0008) [2023-12-26 01:13:52,058][123091] Updated weights for policy 0, policy_version 206310 (0.0010) [2023-12-26 01:13:52,130][123091] Updated weights for policy 0, policy_version 206320 (0.0008) [2023-12-26 01:13:52,752][123090] Updated weights for policy 1, policy_version 205542 (0.0010) [2023-12-26 01:13:52,807][123090] Updated weights for policy 1, policy_version 205552 (0.0009) [2023-12-26 01:13:52,871][123090] Updated weights for policy 1, policy_version 205562 (0.0009) [2023-12-26 01:13:52,949][123091] Updated weights for policy 0, policy_version 206330 (0.0008) [2023-12-26 01:13:53,016][123091] Updated weights for policy 0, policy_version 206340 (0.0007) [2023-12-26 01:13:53,079][123091] Updated weights for policy 0, policy_version 206350 (0.0009) [2023-12-26 01:13:53,637][123090] Updated weights for policy 1, policy_version 205572 (0.0009) [2023-12-26 01:13:53,700][123090] Updated weights for policy 1, policy_version 205582 (0.0009) [2023-12-26 01:13:53,759][123090] Updated weights for policy 1, policy_version 205592 (0.0010) [2023-12-26 01:13:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 105455616. Throughput: 0: 8918.5, 1: 8911.9. Samples: 105438660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:13:53,785][121949] Avg episode reward: [(0, '5944.757'), (1, '5368.979')] [2023-12-26 01:13:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000206352_52830208.pth... [2023-12-26 01:13:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000205328_52568064.pth [2023-12-26 01:13:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000206352_52830208.pth [2023-12-26 01:13:53,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000205600_52633600.pth... [2023-12-26 01:13:53,815][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000204544_52363264.pth [2023-12-26 01:13:53,816][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000205600_52633600.pth [2023-12-26 01:13:53,858][123091] Updated weights for policy 0, policy_version 206360 (0.0008) [2023-12-26 01:13:53,906][123091] Updated weights for policy 0, policy_version 206370 (0.0008) [2023-12-26 01:13:53,962][123091] Updated weights for policy 0, policy_version 206380 (0.0006) [2023-12-26 01:13:54,552][123090] Updated weights for policy 1, policy_version 205602 (0.0009) [2023-12-26 01:13:54,613][123090] Updated weights for policy 1, policy_version 205612 (0.0006) [2023-12-26 01:13:54,664][123090] Updated weights for policy 1, policy_version 205622 (0.0007) [2023-12-26 01:13:54,726][123090] Updated weights for policy 1, policy_version 205632 (0.0005) [2023-12-26 01:13:54,766][123091] Updated weights for policy 0, policy_version 206390 (0.0010) [2023-12-26 01:13:54,820][123091] Updated weights for policy 0, policy_version 206400 (0.0010) [2023-12-26 01:13:54,871][123091] Updated weights for policy 0, policy_version 206410 (0.0009) [2023-12-26 01:13:55,404][123090] Updated weights for policy 1, policy_version 205642 (0.0009) [2023-12-26 01:13:55,468][123090] Updated weights for policy 1, policy_version 205652 (0.0010) [2023-12-26 01:13:55,524][123090] Updated weights for policy 1, policy_version 205662 (0.0009) [2023-12-26 01:13:55,750][123091] Updated weights for policy 0, policy_version 206420 (0.0008) [2023-12-26 01:13:55,811][123091] Updated weights for policy 0, policy_version 206430 (0.0006) [2023-12-26 01:13:55,886][123091] Updated weights for policy 0, policy_version 206440 (0.0007) [2023-12-26 01:13:56,411][123090] Updated weights for policy 1, policy_version 205672 (0.0010) [2023-12-26 01:13:56,477][123090] Updated weights for policy 1, policy_version 205682 (0.0009) [2023-12-26 01:13:56,539][123090] Updated weights for policy 1, policy_version 205692 (0.0008) [2023-12-26 01:13:56,665][123091] Updated weights for policy 0, policy_version 206450 (0.0009) [2023-12-26 01:13:56,728][123091] Updated weights for policy 0, policy_version 206460 (0.0009) [2023-12-26 01:13:56,794][123091] Updated weights for policy 0, policy_version 206470 (0.0008) [2023-12-26 01:13:56,859][123091] Updated weights for policy 0, policy_version 206480 (0.0008) [2023-12-26 01:13:57,378][123090] Updated weights for policy 1, policy_version 205702 (0.0009) [2023-12-26 01:13:57,438][123090] Updated weights for policy 1, policy_version 205712 (0.0009) [2023-12-26 01:13:57,490][123090] Updated weights for policy 1, policy_version 205722 (0.0009) [2023-12-26 01:13:57,602][123091] Updated weights for policy 0, policy_version 206490 (0.0010) [2023-12-26 01:13:57,649][123091] Updated weights for policy 0, policy_version 206500 (0.0010) [2023-12-26 01:13:57,700][123091] Updated weights for policy 0, policy_version 206510 (0.0011) [2023-12-26 01:13:58,333][123090] Updated weights for policy 1, policy_version 205732 (0.0009) [2023-12-26 01:13:58,406][123090] Updated weights for policy 1, policy_version 205742 (0.0009) [2023-12-26 01:13:58,473][123090] Updated weights for policy 1, policy_version 205752 (0.0009) [2023-12-26 01:13:58,670][123091] Updated weights for policy 0, policy_version 206520 (0.0009) [2023-12-26 01:13:58,732][123091] Updated weights for policy 0, policy_version 206530 (0.0008) [2023-12-26 01:13:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 105545728. Throughput: 0: 8866.5, 1: 8943.5. Samples: 105544028. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:13:58,785][121949] Avg episode reward: [(0, '5826.312'), (1, '5496.699')] [2023-12-26 01:13:58,792][123091] Updated weights for policy 0, policy_version 206540 (0.0006) [2023-12-26 01:13:59,279][123090] Updated weights for policy 1, policy_version 205762 (0.0009) [2023-12-26 01:13:59,347][123090] Updated weights for policy 1, policy_version 205772 (0.0011) [2023-12-26 01:13:59,407][123090] Updated weights for policy 1, policy_version 205782 (0.0010) [2023-12-26 01:13:59,470][123090] Updated weights for policy 1, policy_version 205792 (0.0010) [2023-12-26 01:13:59,537][123091] Updated weights for policy 0, policy_version 206550 (0.0009) [2023-12-26 01:13:59,602][123091] Updated weights for policy 0, policy_version 206560 (0.0009) [2023-12-26 01:13:59,666][123091] Updated weights for policy 0, policy_version 206570 (0.0010) [2023-12-26 01:14:00,167][123090] Updated weights for policy 1, policy_version 205802 (0.0005) [2023-12-26 01:14:00,225][123090] Updated weights for policy 1, policy_version 205812 (0.0010) [2023-12-26 01:14:00,288][123090] Updated weights for policy 1, policy_version 205822 (0.0010) [2023-12-26 01:14:00,538][123091] Updated weights for policy 0, policy_version 206580 (0.0010) [2023-12-26 01:14:00,597][123091] Updated weights for policy 0, policy_version 206590 (0.0009) [2023-12-26 01:14:00,658][123091] Updated weights for policy 0, policy_version 206600 (0.0009) [2023-12-26 01:14:01,130][123090] Updated weights for policy 1, policy_version 205832 (0.0014) [2023-12-26 01:14:01,190][123090] Updated weights for policy 1, policy_version 205842 (0.0009) [2023-12-26 01:14:01,261][123090] Updated weights for policy 1, policy_version 205852 (0.0009) [2023-12-26 01:14:01,525][123091] Updated weights for policy 0, policy_version 206610 (0.0009) [2023-12-26 01:14:01,588][123091] Updated weights for policy 0, policy_version 206620 (0.0008) [2023-12-26 01:14:01,650][123091] Updated weights for policy 0, policy_version 206630 (0.0009) [2023-12-26 01:14:01,713][123091] Updated weights for policy 0, policy_version 206640 (0.0009) [2023-12-26 01:14:02,079][123090] Updated weights for policy 1, policy_version 205862 (0.0010) [2023-12-26 01:14:02,137][123090] Updated weights for policy 1, policy_version 205872 (0.0010) [2023-12-26 01:14:02,207][123090] Updated weights for policy 1, policy_version 205882 (0.0010) [2023-12-26 01:14:02,479][123091] Updated weights for policy 0, policy_version 206650 (0.0005) [2023-12-26 01:14:02,540][123091] Updated weights for policy 0, policy_version 206660 (0.0006) [2023-12-26 01:14:02,599][123091] Updated weights for policy 0, policy_version 206670 (0.0005) [2023-12-26 01:14:02,970][123090] Updated weights for policy 1, policy_version 205892 (0.0009) [2023-12-26 01:14:03,033][123090] Updated weights for policy 1, policy_version 205902 (0.0005) [2023-12-26 01:14:03,105][123090] Updated weights for policy 1, policy_version 205912 (0.0005) [2023-12-26 01:14:03,292][123091] Updated weights for policy 0, policy_version 206680 (0.0009) [2023-12-26 01:14:03,360][123091] Updated weights for policy 0, policy_version 206690 (0.0010) [2023-12-26 01:14:03,410][123091] Updated weights for policy 0, policy_version 206700 (0.0010) [2023-12-26 01:14:03,760][123090] Updated weights for policy 1, policy_version 205922 (0.0006) [2023-12-26 01:14:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 105635840. Throughput: 0: 8794.3, 1: 8947.9. Samples: 105649480. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:03,784][121949] Avg episode reward: [(0, '5836.299'), (1, '5413.059')] [2023-12-26 01:14:03,814][123090] Updated weights for policy 1, policy_version 205932 (0.0010) [2023-12-26 01:14:03,879][123090] Updated weights for policy 1, policy_version 205942 (0.0010) [2023-12-26 01:14:03,943][123090] Updated weights for policy 1, policy_version 205952 (0.0011) [2023-12-26 01:14:04,252][123091] Updated weights for policy 0, policy_version 206710 (0.0010) [2023-12-26 01:14:04,316][123091] Updated weights for policy 0, policy_version 206720 (0.0008) [2023-12-26 01:14:04,377][123091] Updated weights for policy 0, policy_version 206730 (0.0009) [2023-12-26 01:14:04,788][123090] Updated weights for policy 1, policy_version 205962 (0.0010) [2023-12-26 01:14:04,853][123090] Updated weights for policy 1, policy_version 205972 (0.0007) [2023-12-26 01:14:04,918][123090] Updated weights for policy 1, policy_version 205982 (0.0005) [2023-12-26 01:14:05,132][123091] Updated weights for policy 0, policy_version 206740 (0.0007) [2023-12-26 01:14:05,207][123091] Updated weights for policy 0, policy_version 206750 (0.0005) [2023-12-26 01:14:05,274][123091] Updated weights for policy 0, policy_version 206760 (0.0005) [2023-12-26 01:14:05,545][123090] Updated weights for policy 1, policy_version 205992 (0.0005) [2023-12-26 01:14:05,603][123090] Updated weights for policy 1, policy_version 206002 (0.0010) [2023-12-26 01:14:05,651][123090] Updated weights for policy 1, policy_version 206012 (0.0010) [2023-12-26 01:14:05,962][123091] Updated weights for policy 0, policy_version 206770 (0.0006) [2023-12-26 01:14:06,017][123091] Updated weights for policy 0, policy_version 206780 (0.0009) [2023-12-26 01:14:06,073][123091] Updated weights for policy 0, policy_version 206790 (0.0009) [2023-12-26 01:14:06,137][123091] Updated weights for policy 0, policy_version 206800 (0.0009) [2023-12-26 01:14:06,466][123090] Updated weights for policy 1, policy_version 206022 (0.0007) [2023-12-26 01:14:06,539][123090] Updated weights for policy 1, policy_version 206032 (0.0008) [2023-12-26 01:14:06,594][123090] Updated weights for policy 1, policy_version 206042 (0.0007) [2023-12-26 01:14:06,941][123091] Updated weights for policy 0, policy_version 206810 (0.0009) [2023-12-26 01:14:07,006][123091] Updated weights for policy 0, policy_version 206820 (0.0009) [2023-12-26 01:14:07,062][123091] Updated weights for policy 0, policy_version 206830 (0.0009) [2023-12-26 01:14:07,359][123090] Updated weights for policy 1, policy_version 206052 (0.0007) [2023-12-26 01:14:07,418][123090] Updated weights for policy 1, policy_version 206062 (0.0010) [2023-12-26 01:14:07,486][123090] Updated weights for policy 1, policy_version 206072 (0.0011) [2023-12-26 01:14:07,898][123091] Updated weights for policy 0, policy_version 206840 (0.0009) [2023-12-26 01:14:07,960][123091] Updated weights for policy 0, policy_version 206850 (0.0008) [2023-12-26 01:14:08,024][123091] Updated weights for policy 0, policy_version 206860 (0.0009) [2023-12-26 01:14:08,304][123090] Updated weights for policy 1, policy_version 206082 (0.0011) [2023-12-26 01:14:08,374][123090] Updated weights for policy 1, policy_version 206092 (0.0009) [2023-12-26 01:14:08,433][123090] Updated weights for policy 1, policy_version 206102 (0.0010) [2023-12-26 01:14:08,481][123090] Updated weights for policy 1, policy_version 206112 (0.0010) [2023-12-26 01:14:08,783][123091] Updated weights for policy 0, policy_version 206870 (0.0009) [2023-12-26 01:14:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 105725952. Throughput: 0: 8833.1, 1: 8988.6. Samples: 105704560. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:08,785][121949] Avg episode reward: [(0, '5923.066'), (1, '5472.012')] [2023-12-26 01:14:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000206112_52764672.pth... [2023-12-26 01:14:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000205088_52502528.pth [2023-12-26 01:14:08,836][123091] Updated weights for policy 0, policy_version 206880 (0.0009) [2023-12-26 01:14:08,896][123091] Updated weights for policy 0, policy_version 206890 (0.0008) [2023-12-26 01:14:08,932][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000206896_52969472.pth... [2023-12-26 01:14:08,935][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000205840_52699136.pth [2023-12-26 01:14:09,304][123090] Updated weights for policy 1, policy_version 206122 (0.0008) [2023-12-26 01:14:09,383][123090] Updated weights for policy 1, policy_version 206132 (0.0007) [2023-12-26 01:14:09,449][123090] Updated weights for policy 1, policy_version 206142 (0.0010) [2023-12-26 01:14:09,760][123091] Updated weights for policy 0, policy_version 206900 (0.0009) [2023-12-26 01:14:09,820][123091] Updated weights for policy 0, policy_version 206910 (0.0010) [2023-12-26 01:14:09,888][123091] Updated weights for policy 0, policy_version 206920 (0.0009) [2023-12-26 01:14:10,192][123090] Updated weights for policy 1, policy_version 206152 (0.0007) [2023-12-26 01:14:10,250][123090] Updated weights for policy 1, policy_version 206162 (0.0005) [2023-12-26 01:14:10,302][123090] Updated weights for policy 1, policy_version 206172 (0.0006) [2023-12-26 01:14:10,696][123091] Updated weights for policy 0, policy_version 206930 (0.0009) [2023-12-26 01:14:10,760][123091] Updated weights for policy 0, policy_version 206940 (0.0011) [2023-12-26 01:14:10,827][123091] Updated weights for policy 0, policy_version 206950 (0.0011) [2023-12-26 01:14:10,893][123091] Updated weights for policy 0, policy_version 206960 (0.0009) [2023-12-26 01:14:11,114][123090] Updated weights for policy 1, policy_version 206182 (0.0007) [2023-12-26 01:14:11,184][123090] Updated weights for policy 1, policy_version 206192 (0.0008) [2023-12-26 01:14:11,243][123090] Updated weights for policy 1, policy_version 206202 (0.0008) [2023-12-26 01:14:11,680][123091] Updated weights for policy 0, policy_version 206970 (0.0007) [2023-12-26 01:14:11,748][123091] Updated weights for policy 0, policy_version 206980 (0.0008) [2023-12-26 01:14:11,812][123091] Updated weights for policy 0, policy_version 206990 (0.0009) [2023-12-26 01:14:12,079][123090] Updated weights for policy 1, policy_version 206212 (0.0009) [2023-12-26 01:14:12,140][123090] Updated weights for policy 1, policy_version 206222 (0.0009) [2023-12-26 01:14:12,198][123090] Updated weights for policy 1, policy_version 206232 (0.0009) [2023-12-26 01:14:12,491][123091] Updated weights for policy 0, policy_version 207000 (0.0008) [2023-12-26 01:14:12,554][123091] Updated weights for policy 0, policy_version 207010 (0.0009) [2023-12-26 01:14:12,614][123091] Updated weights for policy 0, policy_version 207020 (0.0009) [2023-12-26 01:14:13,094][123090] Updated weights for policy 1, policy_version 206242 (0.0010) [2023-12-26 01:14:13,152][123090] Updated weights for policy 1, policy_version 206252 (0.0009) [2023-12-26 01:14:13,208][123090] Updated weights for policy 1, policy_version 206262 (0.0009) [2023-12-26 01:14:13,320][123091] Updated weights for policy 0, policy_version 207030 (0.0007) [2023-12-26 01:14:13,395][123091] Updated weights for policy 0, policy_version 207040 (0.0005) [2023-12-26 01:14:13,471][123091] Updated weights for policy 0, policy_version 207050 (0.0006) [2023-12-26 01:14:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 105816064. Throughput: 0: 8802.5, 1: 8867.3. Samples: 105809168. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:13,785][121949] Avg episode reward: [(0, '5998.083'), (1, '5448.604')] [2023-12-26 01:14:13,786][123007] Saving new best policy, reward=5998.083! [2023-12-26 01:14:14,017][123091] Updated weights for policy 0, policy_version 207060 (0.0007) [2023-12-26 01:14:14,074][123091] Updated weights for policy 0, policy_version 207070 (0.0009) [2023-12-26 01:14:14,109][123090] Updated weights for policy 1, policy_version 206273 (0.0010) [2023-12-26 01:14:14,139][123091] Updated weights for policy 0, policy_version 207081 (0.0008) [2023-12-26 01:14:14,179][123090] Updated weights for policy 1, policy_version 206283 (0.0008) [2023-12-26 01:14:14,235][123090] Updated weights for policy 1, policy_version 206293 (0.0007) [2023-12-26 01:14:14,299][123090] Updated weights for policy 1, policy_version 206303 (0.0009) [2023-12-26 01:14:14,913][123091] Updated weights for policy 0, policy_version 207091 (0.0006) [2023-12-26 01:14:14,984][123091] Updated weights for policy 0, policy_version 207101 (0.0007) [2023-12-26 01:14:15,000][123090] Updated weights for policy 1, policy_version 206313 (0.0009) [2023-12-26 01:14:15,046][123091] Updated weights for policy 0, policy_version 207111 (0.0006) [2023-12-26 01:14:15,068][123090] Updated weights for policy 1, policy_version 206323 (0.0008) [2023-12-26 01:14:15,139][123090] Updated weights for policy 1, policy_version 206333 (0.0006) [2023-12-26 01:14:15,840][123091] Updated weights for policy 0, policy_version 207121 (0.0007) [2023-12-26 01:14:15,896][123090] Updated weights for policy 1, policy_version 206343 (0.0006) [2023-12-26 01:14:15,900][123091] Updated weights for policy 0, policy_version 207131 (0.0011) [2023-12-26 01:14:15,963][123091] Updated weights for policy 0, policy_version 207141 (0.0011) [2023-12-26 01:14:15,970][123090] Updated weights for policy 1, policy_version 206353 (0.0006) [2023-12-26 01:14:16,023][123091] Updated weights for policy 0, policy_version 207151 (0.0011) [2023-12-26 01:14:16,036][123090] Updated weights for policy 1, policy_version 206363 (0.0006) [2023-12-26 01:14:16,651][123090] Updated weights for policy 1, policy_version 206373 (0.0005) [2023-12-26 01:14:16,703][123090] Updated weights for policy 1, policy_version 206383 (0.0008) [2023-12-26 01:14:16,753][123090] Updated weights for policy 1, policy_version 206394 (0.0009) [2023-12-26 01:14:16,865][123091] Updated weights for policy 0, policy_version 207161 (0.0010) [2023-12-26 01:14:16,916][123091] Updated weights for policy 0, policy_version 207171 (0.0010) [2023-12-26 01:14:16,967][123091] Updated weights for policy 0, policy_version 207181 (0.0010) [2023-12-26 01:14:17,500][123090] Updated weights for policy 1, policy_version 206404 (0.0009) [2023-12-26 01:14:17,557][123090] Updated weights for policy 1, policy_version 206415 (0.0010) [2023-12-26 01:14:17,619][123090] Updated weights for policy 1, policy_version 206425 (0.0009) [2023-12-26 01:14:17,735][123091] Updated weights for policy 0, policy_version 207191 (0.0007) [2023-12-26 01:14:17,803][123091] Updated weights for policy 0, policy_version 207201 (0.0005) [2023-12-26 01:14:17,866][123091] Updated weights for policy 0, policy_version 207211 (0.0005) [2023-12-26 01:14:18,510][123091] Updated weights for policy 0, policy_version 207221 (0.0005) [2023-12-26 01:14:18,564][123091] Updated weights for policy 0, policy_version 207231 (0.0005) [2023-12-26 01:14:18,567][123090] Updated weights for policy 1, policy_version 206435 (0.0009) [2023-12-26 01:14:18,620][123091] Updated weights for policy 0, policy_version 207241 (0.0009) [2023-12-26 01:14:18,632][123090] Updated weights for policy 1, policy_version 206445 (0.0010) [2023-12-26 01:14:18,697][123090] Updated weights for policy 1, policy_version 206455 (0.0009) [2023-12-26 01:14:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 105914368. Throughput: 0: 8991.0, 1: 8766.8. Samples: 105920024. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:18,784][121949] Avg episode reward: [(0, '6001.876'), (1, '5487.579')] [2023-12-26 01:14:18,785][123007] Saving new best policy, reward=6001.876! [2023-12-26 01:14:19,361][123091] Updated weights for policy 0, policy_version 207251 (0.0010) [2023-12-26 01:14:19,429][123091] Updated weights for policy 0, policy_version 207261 (0.0008) [2023-12-26 01:14:19,494][123091] Updated weights for policy 0, policy_version 207271 (0.0008) [2023-12-26 01:14:19,560][123090] Updated weights for policy 1, policy_version 206465 (0.0010) [2023-12-26 01:14:19,615][123090] Updated weights for policy 1, policy_version 206475 (0.0008) [2023-12-26 01:14:19,674][123090] Updated weights for policy 1, policy_version 206485 (0.0008) [2023-12-26 01:14:19,739][123090] Updated weights for policy 1, policy_version 206495 (0.0006) [2023-12-26 01:14:20,291][123091] Updated weights for policy 0, policy_version 207281 (0.0009) [2023-12-26 01:14:20,341][123091] Updated weights for policy 0, policy_version 207291 (0.0010) [2023-12-26 01:14:20,399][123091] Updated weights for policy 0, policy_version 207301 (0.0008) [2023-12-26 01:14:20,478][123091] Updated weights for policy 0, policy_version 207311 (0.0006) [2023-12-26 01:14:20,571][123090] Updated weights for policy 1, policy_version 206505 (0.0007) [2023-12-26 01:14:20,636][123090] Updated weights for policy 1, policy_version 206515 (0.0008) [2023-12-26 01:14:20,699][123090] Updated weights for policy 1, policy_version 206525 (0.0009) [2023-12-26 01:14:21,247][123091] Updated weights for policy 0, policy_version 207321 (0.0010) [2023-12-26 01:14:21,317][123091] Updated weights for policy 0, policy_version 207331 (0.0011) [2023-12-26 01:14:21,390][123091] Updated weights for policy 0, policy_version 207341 (0.0010) [2023-12-26 01:14:21,579][123090] Updated weights for policy 1, policy_version 206535 (0.0007) [2023-12-26 01:14:21,655][123090] Updated weights for policy 1, policy_version 206545 (0.0008) [2023-12-26 01:14:21,732][123090] Updated weights for policy 1, policy_version 206555 (0.0008) [2023-12-26 01:14:22,276][123091] Updated weights for policy 0, policy_version 207351 (0.0007) [2023-12-26 01:14:22,348][123091] Updated weights for policy 0, policy_version 207361 (0.0007) [2023-12-26 01:14:22,414][123091] Updated weights for policy 0, policy_version 207371 (0.0009) [2023-12-26 01:14:22,529][123090] Updated weights for policy 1, policy_version 206565 (0.0009) [2023-12-26 01:14:22,601][123090] Updated weights for policy 1, policy_version 206575 (0.0010) [2023-12-26 01:14:22,670][123090] Updated weights for policy 1, policy_version 206585 (0.0010) [2023-12-26 01:14:23,233][123091] Updated weights for policy 0, policy_version 207381 (0.0010) [2023-12-26 01:14:23,297][123091] Updated weights for policy 0, policy_version 207391 (0.0009) [2023-12-26 01:14:23,367][123091] Updated weights for policy 0, policy_version 207401 (0.0010) [2023-12-26 01:14:23,490][123090] Updated weights for policy 1, policy_version 206595 (0.0010) [2023-12-26 01:14:23,553][123090] Updated weights for policy 1, policy_version 206605 (0.0009) [2023-12-26 01:14:23,607][123090] Updated weights for policy 1, policy_version 206615 (0.0009) [2023-12-26 01:14:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 105996288. Throughput: 0: 8968.6, 1: 8672.1. Samples: 105971452. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:23,785][121949] Avg episode reward: [(0, '5981.759'), (1, '5599.669')] [2023-12-26 01:14:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000207408_53100544.pth... [2023-12-26 01:14:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000206624_52895744.pth... [2023-12-26 01:14:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000206352_52830208.pth [2023-12-26 01:14:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000205600_52633600.pth [2023-12-26 01:14:24,205][123091] Updated weights for policy 0, policy_version 207411 (0.0009) [2023-12-26 01:14:24,260][123091] Updated weights for policy 0, policy_version 207421 (0.0010) [2023-12-26 01:14:24,314][123091] Updated weights for policy 0, policy_version 207432 (0.0011) [2023-12-26 01:14:24,355][123090] Updated weights for policy 1, policy_version 206625 (0.0009) [2023-12-26 01:14:24,414][123090] Updated weights for policy 1, policy_version 206635 (0.0008) [2023-12-26 01:14:24,473][123090] Updated weights for policy 1, policy_version 206645 (0.0009) [2023-12-26 01:14:24,536][123090] Updated weights for policy 1, policy_version 206655 (0.0009) [2023-12-26 01:14:25,121][123091] Updated weights for policy 0, policy_version 207443 (0.0010) [2023-12-26 01:14:25,170][123090] Updated weights for policy 1, policy_version 206665 (0.0005) [2023-12-26 01:14:25,186][123091] Updated weights for policy 0, policy_version 207453 (0.0008) [2023-12-26 01:14:25,232][123090] Updated weights for policy 1, policy_version 206675 (0.0005) [2023-12-26 01:14:25,250][123091] Updated weights for policy 0, policy_version 207463 (0.0009) [2023-12-26 01:14:25,293][123090] Updated weights for policy 1, policy_version 206685 (0.0007) [2023-12-26 01:14:26,043][123090] Updated weights for policy 1, policy_version 206695 (0.0006) [2023-12-26 01:14:26,079][123091] Updated weights for policy 0, policy_version 207473 (0.0008) [2023-12-26 01:14:26,105][123090] Updated weights for policy 1, policy_version 206705 (0.0006) [2023-12-26 01:14:26,136][123091] Updated weights for policy 0, policy_version 207483 (0.0006) [2023-12-26 01:14:26,171][123090] Updated weights for policy 1, policy_version 206715 (0.0006) [2023-12-26 01:14:26,193][123091] Updated weights for policy 0, policy_version 207493 (0.0006) [2023-12-26 01:14:26,250][123091] Updated weights for policy 0, policy_version 207503 (0.0005) [2023-12-26 01:14:26,848][123090] Updated weights for policy 1, policy_version 206725 (0.0007) [2023-12-26 01:14:26,884][123091] Updated weights for policy 0, policy_version 207513 (0.0008) [2023-12-26 01:14:26,896][123090] Updated weights for policy 1, policy_version 206735 (0.0005) [2023-12-26 01:14:26,939][123091] Updated weights for policy 0, policy_version 207523 (0.0006) [2023-12-26 01:14:26,957][123090] Updated weights for policy 1, policy_version 206745 (0.0010) [2023-12-26 01:14:26,996][123091] Updated weights for policy 0, policy_version 207533 (0.0006) [2023-12-26 01:14:27,668][123091] Updated weights for policy 0, policy_version 207543 (0.0006) [2023-12-26 01:14:27,703][123090] Updated weights for policy 1, policy_version 206755 (0.0009) [2023-12-26 01:14:27,735][123091] Updated weights for policy 0, policy_version 207553 (0.0006) [2023-12-26 01:14:27,758][123090] Updated weights for policy 1, policy_version 206765 (0.0010) [2023-12-26 01:14:27,790][123091] Updated weights for policy 0, policy_version 207563 (0.0008) [2023-12-26 01:14:27,805][123090] Updated weights for policy 1, policy_version 206775 (0.0010) [2023-12-26 01:14:28,546][123091] Updated weights for policy 0, policy_version 207573 (0.0009) [2023-12-26 01:14:28,610][123090] Updated weights for policy 1, policy_version 206785 (0.0010) [2023-12-26 01:14:28,611][123091] Updated weights for policy 0, policy_version 207583 (0.0008) [2023-12-26 01:14:28,663][123090] Updated weights for policy 1, policy_version 206795 (0.0009) [2023-12-26 01:14:28,685][123091] Updated weights for policy 0, policy_version 207593 (0.0005) [2023-12-26 01:14:28,723][123090] Updated weights for policy 1, policy_version 206805 (0.0009) [2023-12-26 01:14:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 106086400. Throughput: 0: 8943.4, 1: 8754.8. Samples: 106080816. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:28,785][121949] Avg episode reward: [(0, '5959.461'), (1, '5550.402')] [2023-12-26 01:14:28,786][123090] Updated weights for policy 1, policy_version 206815 (0.0009) [2023-12-26 01:14:29,476][123091] Updated weights for policy 0, policy_version 207603 (0.0007) [2023-12-26 01:14:29,541][123091] Updated weights for policy 0, policy_version 207613 (0.0010) [2023-12-26 01:14:29,604][123091] Updated weights for policy 0, policy_version 207623 (0.0010) [2023-12-26 01:14:29,643][123090] Updated weights for policy 1, policy_version 206825 (0.0008) [2023-12-26 01:14:29,701][123090] Updated weights for policy 1, policy_version 206835 (0.0009) [2023-12-26 01:14:29,759][123090] Updated weights for policy 1, policy_version 206845 (0.0010) [2023-12-26 01:14:30,343][123091] Updated weights for policy 0, policy_version 207633 (0.0007) [2023-12-26 01:14:30,406][123091] Updated weights for policy 0, policy_version 207643 (0.0009) [2023-12-26 01:14:30,462][123091] Updated weights for policy 0, policy_version 207653 (0.0009) [2023-12-26 01:14:30,519][123091] Updated weights for policy 0, policy_version 207663 (0.0009) [2023-12-26 01:14:30,606][123090] Updated weights for policy 1, policy_version 206855 (0.0006) [2023-12-26 01:14:30,656][123090] Updated weights for policy 1, policy_version 206865 (0.0005) [2023-12-26 01:14:30,715][123090] Updated weights for policy 1, policy_version 206875 (0.0006) [2023-12-26 01:14:31,419][123091] Updated weights for policy 0, policy_version 207673 (0.0007) [2023-12-26 01:14:31,487][123091] Updated weights for policy 0, policy_version 207683 (0.0005) [2023-12-26 01:14:31,501][123090] Updated weights for policy 1, policy_version 206885 (0.0008) [2023-12-26 01:14:31,550][123091] Updated weights for policy 0, policy_version 207693 (0.0008) [2023-12-26 01:14:31,564][123090] Updated weights for policy 1, policy_version 206895 (0.0009) [2023-12-26 01:14:31,627][123090] Updated weights for policy 1, policy_version 206905 (0.0009) [2023-12-26 01:14:32,323][123091] Updated weights for policy 0, policy_version 207703 (0.0009) [2023-12-26 01:14:32,391][123091] Updated weights for policy 0, policy_version 207713 (0.0010) [2023-12-26 01:14:32,448][123090] Updated weights for policy 1, policy_version 206915 (0.0009) [2023-12-26 01:14:32,451][123091] Updated weights for policy 0, policy_version 207723 (0.0009) [2023-12-26 01:14:32,500][123090] Updated weights for policy 1, policy_version 206925 (0.0009) [2023-12-26 01:14:32,548][123090] Updated weights for policy 1, policy_version 206935 (0.0009) [2023-12-26 01:14:33,296][123091] Updated weights for policy 0, policy_version 207733 (0.0009) [2023-12-26 01:14:33,338][123090] Updated weights for policy 1, policy_version 206945 (0.0009) [2023-12-26 01:14:33,354][123091] Updated weights for policy 0, policy_version 207743 (0.0009) [2023-12-26 01:14:33,399][123091] Updated weights for policy 0, policy_version 207753 (0.0007) [2023-12-26 01:14:33,404][123090] Updated weights for policy 1, policy_version 206955 (0.0009) [2023-12-26 01:14:33,458][123090] Updated weights for policy 1, policy_version 206965 (0.0010) [2023-12-26 01:14:33,512][123090] Updated weights for policy 1, policy_version 206975 (0.0010) [2023-12-26 01:14:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 106176512. Throughput: 0: 8925.9, 1: 8800.2. Samples: 106185120. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:33,785][121949] Avg episode reward: [(0, '5926.114'), (1, '5439.911')] [2023-12-26 01:14:34,228][123091] Updated weights for policy 0, policy_version 207763 (0.0009) [2023-12-26 01:14:34,287][123091] Updated weights for policy 0, policy_version 207773 (0.0008) [2023-12-26 01:14:34,302][123090] Updated weights for policy 1, policy_version 206985 (0.0009) [2023-12-26 01:14:34,349][123091] Updated weights for policy 0, policy_version 207783 (0.0009) [2023-12-26 01:14:34,365][123090] Updated weights for policy 1, policy_version 206995 (0.0009) [2023-12-26 01:14:34,433][123090] Updated weights for policy 1, policy_version 207005 (0.0008) [2023-12-26 01:14:35,086][123090] Updated weights for policy 1, policy_version 207016 (0.0009) [2023-12-26 01:14:35,148][123090] Updated weights for policy 1, policy_version 207026 (0.0010) [2023-12-26 01:14:35,192][123091] Updated weights for policy 0, policy_version 207793 (0.0010) [2023-12-26 01:14:35,208][123090] Updated weights for policy 1, policy_version 207036 (0.0010) [2023-12-26 01:14:35,239][123091] Updated weights for policy 0, policy_version 207803 (0.0006) [2023-12-26 01:14:35,288][123091] Updated weights for policy 0, policy_version 207813 (0.0009) [2023-12-26 01:14:35,359][123091] Updated weights for policy 0, policy_version 207823 (0.0009) [2023-12-26 01:14:35,937][123091] Updated weights for policy 0, policy_version 207833 (0.0005) [2023-12-26 01:14:35,999][123091] Updated weights for policy 0, policy_version 207843 (0.0007) [2023-12-26 01:14:36,062][123091] Updated weights for policy 0, policy_version 207853 (0.0010) [2023-12-26 01:14:36,092][123090] Updated weights for policy 1, policy_version 207046 (0.0008) [2023-12-26 01:14:36,148][123090] Updated weights for policy 1, policy_version 207056 (0.0009) [2023-12-26 01:14:36,209][123090] Updated weights for policy 1, policy_version 207066 (0.0009) [2023-12-26 01:14:36,837][123091] Updated weights for policy 0, policy_version 207863 (0.0007) [2023-12-26 01:14:36,888][123091] Updated weights for policy 0, policy_version 207873 (0.0005) [2023-12-26 01:14:36,945][123091] Updated weights for policy 0, policy_version 207883 (0.0007) [2023-12-26 01:14:37,057][123090] Updated weights for policy 1, policy_version 207076 (0.0009) [2023-12-26 01:14:37,105][123090] Updated weights for policy 1, policy_version 207086 (0.0009) [2023-12-26 01:14:37,166][123090] Updated weights for policy 1, policy_version 207096 (0.0009) [2023-12-26 01:14:37,707][123091] Updated weights for policy 0, policy_version 207893 (0.0011) [2023-12-26 01:14:37,768][123091] Updated weights for policy 0, policy_version 207903 (0.0011) [2023-12-26 01:14:37,816][123091] Updated weights for policy 0, policy_version 207913 (0.0010) [2023-12-26 01:14:37,968][123090] Updated weights for policy 1, policy_version 207106 (0.0009) [2023-12-26 01:14:38,029][123090] Updated weights for policy 1, policy_version 207116 (0.0005) [2023-12-26 01:14:38,096][123090] Updated weights for policy 1, policy_version 207126 (0.0006) [2023-12-26 01:14:38,174][123090] Updated weights for policy 1, policy_version 207136 (0.0005) [2023-12-26 01:14:38,553][123091] Updated weights for policy 0, policy_version 207923 (0.0009) [2023-12-26 01:14:38,607][123091] Updated weights for policy 0, policy_version 207933 (0.0007) [2023-12-26 01:14:38,663][123091] Updated weights for policy 0, policy_version 207943 (0.0006) [2023-12-26 01:14:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 106266624. Throughput: 0: 8942.6, 1: 8845.2. Samples: 106239116. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:38,785][121949] Avg episode reward: [(0, '5916.694'), (1, '5415.853')] [2023-12-26 01:14:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000207952_53239808.pth... [2023-12-26 01:14:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000207136_53026816.pth... [2023-12-26 01:14:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000206896_52969472.pth [2023-12-26 01:14:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000206112_52764672.pth [2023-12-26 01:14:38,905][123090] Updated weights for policy 1, policy_version 207146 (0.0010) [2023-12-26 01:14:38,967][123090] Updated weights for policy 1, policy_version 207156 (0.0005) [2023-12-26 01:14:39,030][123090] Updated weights for policy 1, policy_version 207166 (0.0005) [2023-12-26 01:14:39,351][123091] Updated weights for policy 0, policy_version 207953 (0.0006) [2023-12-26 01:14:39,425][123091] Updated weights for policy 0, policy_version 207963 (0.0012) [2023-12-26 01:14:39,486][123091] Updated weights for policy 0, policy_version 207973 (0.0010) [2023-12-26 01:14:39,549][123091] Updated weights for policy 0, policy_version 207983 (0.0009) [2023-12-26 01:14:39,730][123090] Updated weights for policy 1, policy_version 207176 (0.0006) [2023-12-26 01:14:39,788][123090] Updated weights for policy 1, policy_version 207186 (0.0008) [2023-12-26 01:14:39,852][123090] Updated weights for policy 1, policy_version 207196 (0.0010) [2023-12-26 01:14:40,422][123091] Updated weights for policy 0, policy_version 207993 (0.0010) [2023-12-26 01:14:40,466][123091] Updated weights for policy 0, policy_version 208003 (0.0010) [2023-12-26 01:14:40,515][123091] Updated weights for policy 0, policy_version 208013 (0.0010) [2023-12-26 01:14:40,638][123090] Updated weights for policy 1, policy_version 207206 (0.0010) [2023-12-26 01:14:40,708][123090] Updated weights for policy 1, policy_version 207216 (0.0007) [2023-12-26 01:14:40,773][123090] Updated weights for policy 1, policy_version 207226 (0.0005) [2023-12-26 01:14:41,327][123091] Updated weights for policy 0, policy_version 208023 (0.0009) [2023-12-26 01:14:41,395][123091] Updated weights for policy 0, policy_version 208033 (0.0009) [2023-12-26 01:14:41,445][123091] Updated weights for policy 0, policy_version 208043 (0.0009) [2023-12-26 01:14:41,543][123090] Updated weights for policy 1, policy_version 207236 (0.0008) [2023-12-26 01:14:41,607][123090] Updated weights for policy 1, policy_version 207246 (0.0009) [2023-12-26 01:14:41,669][123090] Updated weights for policy 1, policy_version 207256 (0.0007) [2023-12-26 01:14:42,266][123091] Updated weights for policy 0, policy_version 208053 (0.0010) [2023-12-26 01:14:42,325][123091] Updated weights for policy 0, policy_version 208063 (0.0010) [2023-12-26 01:14:42,400][123091] Updated weights for policy 0, policy_version 208073 (0.0011) [2023-12-26 01:14:42,484][123090] Updated weights for policy 1, policy_version 207266 (0.0007) [2023-12-26 01:14:42,547][123090] Updated weights for policy 1, policy_version 207276 (0.0009) [2023-12-26 01:14:42,613][123090] Updated weights for policy 1, policy_version 207286 (0.0009) [2023-12-26 01:14:42,679][123090] Updated weights for policy 1, policy_version 207296 (0.0009) [2023-12-26 01:14:43,222][123091] Updated weights for policy 0, policy_version 208083 (0.0009) [2023-12-26 01:14:43,275][123091] Updated weights for policy 0, policy_version 208093 (0.0005) [2023-12-26 01:14:43,321][123091] Updated weights for policy 0, policy_version 208103 (0.0005) [2023-12-26 01:14:43,481][123090] Updated weights for policy 1, policy_version 207306 (0.0008) [2023-12-26 01:14:43,536][123090] Updated weights for policy 1, policy_version 207316 (0.0009) [2023-12-26 01:14:43,596][123090] Updated weights for policy 1, policy_version 207326 (0.0009) [2023-12-26 01:14:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 106356736. Throughput: 0: 8954.4, 1: 8887.4. Samples: 106346908. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:43,785][121949] Avg episode reward: [(0, '5928.464'), (1, '5344.042')] [2023-12-26 01:14:44,039][123091] Updated weights for policy 0, policy_version 208113 (0.0005) [2023-12-26 01:14:44,099][123091] Updated weights for policy 0, policy_version 208123 (0.0005) [2023-12-26 01:14:44,152][123091] Updated weights for policy 0, policy_version 208133 (0.0005) [2023-12-26 01:14:44,207][123091] Updated weights for policy 0, policy_version 208143 (0.0006) [2023-12-26 01:14:44,379][123090] Updated weights for policy 1, policy_version 207336 (0.0006) [2023-12-26 01:14:44,451][123090] Updated weights for policy 1, policy_version 207346 (0.0008) [2023-12-26 01:14:44,516][123090] Updated weights for policy 1, policy_version 207356 (0.0009) [2023-12-26 01:14:44,987][123091] Updated weights for policy 0, policy_version 208153 (0.0009) [2023-12-26 01:14:45,050][123091] Updated weights for policy 0, policy_version 208163 (0.0005) [2023-12-26 01:14:45,112][123091] Updated weights for policy 0, policy_version 208173 (0.0006) [2023-12-26 01:14:45,370][123090] Updated weights for policy 1, policy_version 207366 (0.0007) [2023-12-26 01:14:45,430][123090] Updated weights for policy 1, policy_version 207376 (0.0006) [2023-12-26 01:14:45,487][123090] Updated weights for policy 1, policy_version 207386 (0.0005) [2023-12-26 01:14:45,823][123091] Updated weights for policy 0, policy_version 208183 (0.0005) [2023-12-26 01:14:45,895][123091] Updated weights for policy 0, policy_version 208193 (0.0006) [2023-12-26 01:14:45,965][123091] Updated weights for policy 0, policy_version 208203 (0.0010) [2023-12-26 01:14:46,123][123090] Updated weights for policy 1, policy_version 207396 (0.0007) [2023-12-26 01:14:46,182][123090] Updated weights for policy 1, policy_version 207406 (0.0009) [2023-12-26 01:14:46,251][123090] Updated weights for policy 1, policy_version 207416 (0.0009) [2023-12-26 01:14:46,730][123091] Updated weights for policy 0, policy_version 208213 (0.0011) [2023-12-26 01:14:46,799][123091] Updated weights for policy 0, policy_version 208223 (0.0010) [2023-12-26 01:14:46,865][123091] Updated weights for policy 0, policy_version 208233 (0.0010) [2023-12-26 01:14:47,006][123090] Updated weights for policy 1, policy_version 207426 (0.0008) [2023-12-26 01:14:47,059][123090] Updated weights for policy 1, policy_version 207436 (0.0005) [2023-12-26 01:14:47,117][123090] Updated weights for policy 1, policy_version 207446 (0.0005) [2023-12-26 01:14:47,189][123090] Updated weights for policy 1, policy_version 207456 (0.0005) [2023-12-26 01:14:47,576][123091] Updated weights for policy 0, policy_version 208243 (0.0009) [2023-12-26 01:14:47,638][123091] Updated weights for policy 0, policy_version 208253 (0.0008) [2023-12-26 01:14:47,705][123091] Updated weights for policy 0, policy_version 208263 (0.0010) [2023-12-26 01:14:47,972][123090] Updated weights for policy 1, policy_version 207466 (0.0009) [2023-12-26 01:14:48,037][123090] Updated weights for policy 1, policy_version 207476 (0.0010) [2023-12-26 01:14:48,101][123090] Updated weights for policy 1, policy_version 207486 (0.0010) [2023-12-26 01:14:48,358][123091] Updated weights for policy 0, policy_version 208273 (0.0009) [2023-12-26 01:14:48,426][123091] Updated weights for policy 0, policy_version 208283 (0.0009) [2023-12-26 01:14:48,484][123091] Updated weights for policy 0, policy_version 208293 (0.0008) [2023-12-26 01:14:48,542][123091] Updated weights for policy 0, policy_version 208303 (0.0005) [2023-12-26 01:14:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 106446848. Throughput: 0: 9074.4, 1: 8919.0. Samples: 106459184. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:48,785][121949] Avg episode reward: [(0, '5970.953'), (1, '5367.225')] [2023-12-26 01:14:48,836][123090] Updated weights for policy 1, policy_version 207496 (0.0006) [2023-12-26 01:14:48,888][123090] Updated weights for policy 1, policy_version 207506 (0.0005) [2023-12-26 01:14:48,951][123090] Updated weights for policy 1, policy_version 207516 (0.0006) [2023-12-26 01:14:49,216][123091] Updated weights for policy 0, policy_version 208313 (0.0006) [2023-12-26 01:14:49,283][123091] Updated weights for policy 0, policy_version 208323 (0.0010) [2023-12-26 01:14:49,346][123091] Updated weights for policy 0, policy_version 208333 (0.0009) [2023-12-26 01:14:49,564][123090] Updated weights for policy 1, policy_version 207526 (0.0007) [2023-12-26 01:14:49,618][123090] Updated weights for policy 1, policy_version 207536 (0.0008) [2023-12-26 01:14:49,675][123090] Updated weights for policy 1, policy_version 207546 (0.0008) [2023-12-26 01:14:50,111][123091] Updated weights for policy 0, policy_version 208343 (0.0009) [2023-12-26 01:14:50,176][123091] Updated weights for policy 0, policy_version 208353 (0.0009) [2023-12-26 01:14:50,242][123091] Updated weights for policy 0, policy_version 208363 (0.0010) [2023-12-26 01:14:50,507][123090] Updated weights for policy 1, policy_version 207556 (0.0007) [2023-12-26 01:14:50,566][123090] Updated weights for policy 1, policy_version 207566 (0.0010) [2023-12-26 01:14:50,626][123090] Updated weights for policy 1, policy_version 207576 (0.0010) [2023-12-26 01:14:51,032][123091] Updated weights for policy 0, policy_version 208373 (0.0009) [2023-12-26 01:14:51,090][123091] Updated weights for policy 0, policy_version 208383 (0.0010) [2023-12-26 01:14:51,158][123091] Updated weights for policy 0, policy_version 208393 (0.0010) [2023-12-26 01:14:51,527][123090] Updated weights for policy 1, policy_version 207586 (0.0009) [2023-12-26 01:14:51,595][123090] Updated weights for policy 1, policy_version 207596 (0.0007) [2023-12-26 01:14:51,664][123090] Updated weights for policy 1, policy_version 207606 (0.0010) [2023-12-26 01:14:51,736][123090] Updated weights for policy 1, policy_version 207616 (0.0010) [2023-12-26 01:14:51,964][123091] Updated weights for policy 0, policy_version 208403 (0.0008) [2023-12-26 01:14:52,036][123091] Updated weights for policy 0, policy_version 208413 (0.0006) [2023-12-26 01:14:52,110][123091] Updated weights for policy 0, policy_version 208423 (0.0006) [2023-12-26 01:14:52,538][123090] Updated weights for policy 1, policy_version 207626 (0.0009) [2023-12-26 01:14:52,597][123090] Updated weights for policy 1, policy_version 207636 (0.0010) [2023-12-26 01:14:52,654][123090] Updated weights for policy 1, policy_version 207646 (0.0006) [2023-12-26 01:14:52,899][123091] Updated weights for policy 0, policy_version 208433 (0.0006) [2023-12-26 01:14:52,974][123091] Updated weights for policy 0, policy_version 208443 (0.0006) [2023-12-26 01:14:53,048][123091] Updated weights for policy 0, policy_version 208453 (0.0006) [2023-12-26 01:14:53,107][123091] Updated weights for policy 0, policy_version 208463 (0.0007) [2023-12-26 01:14:53,449][123090] Updated weights for policy 1, policy_version 207656 (0.0005) [2023-12-26 01:14:53,515][123090] Updated weights for policy 1, policy_version 207666 (0.0005) [2023-12-26 01:14:53,580][123090] Updated weights for policy 1, policy_version 207676 (0.0005) [2023-12-26 01:14:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 106536960. Throughput: 0: 9069.9, 1: 8899.7. Samples: 106513188. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:53,785][121949] Avg episode reward: [(0, '5983.040'), (1, '5506.522')] [2023-12-26 01:14:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000207680_53166080.pth... [2023-12-26 01:14:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000206624_52895744.pth [2023-12-26 01:14:53,831][123091] Updated weights for policy 0, policy_version 208473 (0.0009) [2023-12-26 01:14:53,894][123091] Updated weights for policy 0, policy_version 208483 (0.0010) [2023-12-26 01:14:53,961][123091] Updated weights for policy 0, policy_version 208493 (0.0010) [2023-12-26 01:14:53,981][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000208496_53379072.pth... [2023-12-26 01:14:53,986][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000207408_53100544.pth [2023-12-26 01:14:54,224][123090] Updated weights for policy 1, policy_version 207686 (0.0006) [2023-12-26 01:14:54,278][123090] Updated weights for policy 1, policy_version 207696 (0.0005) [2023-12-26 01:14:54,336][123090] Updated weights for policy 1, policy_version 207706 (0.0005) [2023-12-26 01:14:54,838][123091] Updated weights for policy 0, policy_version 208503 (0.0007) [2023-12-26 01:14:54,903][123091] Updated weights for policy 0, policy_version 208513 (0.0009) [2023-12-26 01:14:54,967][123091] Updated weights for policy 0, policy_version 208523 (0.0010) [2023-12-26 01:14:55,089][123090] Updated weights for policy 1, policy_version 207716 (0.0007) [2023-12-26 01:14:55,155][123090] Updated weights for policy 1, policy_version 207726 (0.0010) [2023-12-26 01:14:55,214][123090] Updated weights for policy 1, policy_version 207736 (0.0009) [2023-12-26 01:14:55,736][123091] Updated weights for policy 0, policy_version 208533 (0.0008) [2023-12-26 01:14:55,790][123091] Updated weights for policy 0, policy_version 208543 (0.0010) [2023-12-26 01:14:55,845][123091] Updated weights for policy 0, policy_version 208554 (0.0010) [2023-12-26 01:14:56,043][123090] Updated weights for policy 1, policy_version 207746 (0.0009) [2023-12-26 01:14:56,099][123090] Updated weights for policy 1, policy_version 207756 (0.0009) [2023-12-26 01:14:56,163][123090] Updated weights for policy 1, policy_version 207766 (0.0009) [2023-12-26 01:14:56,222][123090] Updated weights for policy 1, policy_version 207776 (0.0009) [2023-12-26 01:14:56,708][123091] Updated weights for policy 0, policy_version 208564 (0.0009) [2023-12-26 01:14:56,760][123091] Updated weights for policy 0, policy_version 208574 (0.0010) [2023-12-26 01:14:56,818][123091] Updated weights for policy 0, policy_version 208584 (0.0010) [2023-12-26 01:14:56,972][123090] Updated weights for policy 1, policy_version 207786 (0.0005) [2023-12-26 01:14:57,032][123090] Updated weights for policy 1, policy_version 207796 (0.0005) [2023-12-26 01:14:57,088][123090] Updated weights for policy 1, policy_version 207806 (0.0005) [2023-12-26 01:14:57,567][123091] Updated weights for policy 0, policy_version 208594 (0.0006) [2023-12-26 01:14:57,620][123091] Updated weights for policy 0, policy_version 208604 (0.0006) [2023-12-26 01:14:57,671][123091] Updated weights for policy 0, policy_version 208614 (0.0005) [2023-12-26 01:14:57,727][123091] Updated weights for policy 0, policy_version 208624 (0.0007) [2023-12-26 01:14:57,747][123090] Updated weights for policy 1, policy_version 207816 (0.0005) [2023-12-26 01:14:57,804][123090] Updated weights for policy 1, policy_version 207826 (0.0005) [2023-12-26 01:14:57,851][123090] Updated weights for policy 1, policy_version 207836 (0.0005) [2023-12-26 01:14:58,626][123091] Updated weights for policy 0, policy_version 208634 (0.0010) [2023-12-26 01:14:58,651][123090] Updated weights for policy 1, policy_version 207846 (0.0008) [2023-12-26 01:14:58,692][123091] Updated weights for policy 0, policy_version 208644 (0.0009) [2023-12-26 01:14:58,717][123090] Updated weights for policy 1, policy_version 207856 (0.0009) [2023-12-26 01:14:58,753][123091] Updated weights for policy 0, policy_version 208654 (0.0009) [2023-12-26 01:14:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 106627072. Throughput: 0: 9085.6, 1: 8982.9. Samples: 106622248. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:14:58,784][121949] Avg episode reward: [(0, '5962.291'), (1, '5459.991')] [2023-12-26 01:14:58,799][123090] Updated weights for policy 1, policy_version 207866 (0.0010) [2023-12-26 01:14:59,545][123090] Updated weights for policy 1, policy_version 207876 (0.0009) [2023-12-26 01:14:59,608][123090] Updated weights for policy 1, policy_version 207886 (0.0010) [2023-12-26 01:14:59,613][123091] Updated weights for policy 0, policy_version 208664 (0.0006) [2023-12-26 01:14:59,662][123091] Updated weights for policy 0, policy_version 208674 (0.0006) [2023-12-26 01:14:59,673][123090] Updated weights for policy 1, policy_version 207896 (0.0009) [2023-12-26 01:14:59,724][123091] Updated weights for policy 0, policy_version 208684 (0.0009) [2023-12-26 01:15:00,393][123090] Updated weights for policy 1, policy_version 207906 (0.0006) [2023-12-26 01:15:00,407][123091] Updated weights for policy 0, policy_version 208694 (0.0007) [2023-12-26 01:15:00,462][123090] Updated weights for policy 1, policy_version 207916 (0.0007) [2023-12-26 01:15:00,479][123091] Updated weights for policy 0, policy_version 208704 (0.0009) [2023-12-26 01:15:00,532][123090] Updated weights for policy 1, policy_version 207926 (0.0007) [2023-12-26 01:15:00,536][123091] Updated weights for policy 0, policy_version 208714 (0.0008) [2023-12-26 01:15:00,595][123090] Updated weights for policy 1, policy_version 207936 (0.0010) [2023-12-26 01:15:01,310][123091] Updated weights for policy 0, policy_version 208724 (0.0008) [2023-12-26 01:15:01,373][123091] Updated weights for policy 0, policy_version 208734 (0.0007) [2023-12-26 01:15:01,399][123090] Updated weights for policy 1, policy_version 207946 (0.0011) [2023-12-26 01:15:01,443][123091] Updated weights for policy 0, policy_version 208744 (0.0008) [2023-12-26 01:15:01,464][123090] Updated weights for policy 1, policy_version 207956 (0.0011) [2023-12-26 01:15:01,531][123090] Updated weights for policy 1, policy_version 207966 (0.0010) [2023-12-26 01:15:02,224][123091] Updated weights for policy 0, policy_version 208754 (0.0006) [2023-12-26 01:15:02,288][123091] Updated weights for policy 0, policy_version 208764 (0.0010) [2023-12-26 01:15:02,300][123090] Updated weights for policy 1, policy_version 207976 (0.0007) [2023-12-26 01:15:02,348][123091] Updated weights for policy 0, policy_version 208774 (0.0009) [2023-12-26 01:15:02,351][123090] Updated weights for policy 1, policy_version 207986 (0.0008) [2023-12-26 01:15:02,411][123091] Updated weights for policy 0, policy_version 208784 (0.0010) [2023-12-26 01:15:02,414][123090] Updated weights for policy 1, policy_version 207996 (0.0008) [2023-12-26 01:15:03,155][123090] Updated weights for policy 1, policy_version 208006 (0.0007) [2023-12-26 01:15:03,200][123090] Updated weights for policy 1, policy_version 208016 (0.0008) [2023-12-26 01:15:03,247][123091] Updated weights for policy 0, policy_version 208794 (0.0008) [2023-12-26 01:15:03,253][123090] Updated weights for policy 1, policy_version 208026 (0.0008) [2023-12-26 01:15:03,292][123091] Updated weights for policy 0, policy_version 208804 (0.0009) [2023-12-26 01:15:03,345][123091] Updated weights for policy 0, policy_version 208814 (0.0005) [2023-12-26 01:15:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 106717184. Throughput: 0: 8956.4, 1: 9029.2. Samples: 106729372. Policy #0 lag: (min: 31.0, avg: 31.1, max: 40.0) [2023-12-26 01:15:03,784][121949] Avg episode reward: [(0, '5978.501'), (1, '5351.455')] [2023-12-26 01:15:03,964][123090] Updated weights for policy 1, policy_version 208036 (0.0007) [2023-12-26 01:15:04,033][123090] Updated weights for policy 1, policy_version 208046 (0.0006) [2023-12-26 01:15:04,096][123090] Updated weights for policy 1, policy_version 208056 (0.0009) [2023-12-26 01:15:04,217][123091] Updated weights for policy 0, policy_version 208824 (0.0009) [2023-12-26 01:15:04,280][123091] Updated weights for policy 0, policy_version 208834 (0.0009) [2023-12-26 01:15:04,336][123091] Updated weights for policy 0, policy_version 208844 (0.0009) [2023-12-26 01:15:04,875][123090] Updated weights for policy 1, policy_version 208066 (0.0008) [2023-12-26 01:15:04,947][123090] Updated weights for policy 1, policy_version 208076 (0.0005) [2023-12-26 01:15:05,016][123090] Updated weights for policy 1, policy_version 208086 (0.0007) [2023-12-26 01:15:05,078][123090] Updated weights for policy 1, policy_version 208096 (0.0010) [2023-12-26 01:15:05,125][123091] Updated weights for policy 0, policy_version 208854 (0.0007) [2023-12-26 01:15:05,170][123091] Updated weights for policy 0, policy_version 208864 (0.0005) [2023-12-26 01:15:05,216][123091] Updated weights for policy 0, policy_version 208874 (0.0005) [2023-12-26 01:15:05,813][123090] Updated weights for policy 1, policy_version 208106 (0.0009) [2023-12-26 01:15:05,890][123090] Updated weights for policy 1, policy_version 208116 (0.0010) [2023-12-26 01:15:05,919][123091] Updated weights for policy 0, policy_version 208884 (0.0005) [2023-12-26 01:15:05,958][123090] Updated weights for policy 1, policy_version 208126 (0.0008) [2023-12-26 01:15:05,985][123091] Updated weights for policy 0, policy_version 208894 (0.0008) [2023-12-26 01:15:06,049][123091] Updated weights for policy 0, policy_version 208904 (0.0008) [2023-12-26 01:15:06,793][123090] Updated weights for policy 1, policy_version 208136 (0.0010) [2023-12-26 01:15:06,814][123091] Updated weights for policy 0, policy_version 208914 (0.0007) [2023-12-26 01:15:06,866][123090] Updated weights for policy 1, policy_version 208146 (0.0009) [2023-12-26 01:15:06,878][123091] Updated weights for policy 0, policy_version 208924 (0.0008) [2023-12-26 01:15:06,930][123090] Updated weights for policy 1, policy_version 208156 (0.0008) [2023-12-26 01:15:06,941][123091] Updated weights for policy 0, policy_version 208934 (0.0008) [2023-12-26 01:15:06,997][123091] Updated weights for policy 0, policy_version 208944 (0.0008) [2023-12-26 01:15:07,730][123090] Updated weights for policy 1, policy_version 208166 (0.0009) [2023-12-26 01:15:07,817][123090] Updated weights for policy 1, policy_version 208176 (0.0007) [2023-12-26 01:15:07,825][123091] Updated weights for policy 0, policy_version 208954 (0.0009) [2023-12-26 01:15:07,874][123090] Updated weights for policy 1, policy_version 208186 (0.0006) [2023-12-26 01:15:07,887][123091] Updated weights for policy 0, policy_version 208964 (0.0008) [2023-12-26 01:15:07,951][123091] Updated weights for policy 0, policy_version 208974 (0.0009) [2023-12-26 01:15:08,710][123090] Updated weights for policy 1, policy_version 208196 (0.0007) [2023-12-26 01:15:08,766][123091] Updated weights for policy 0, policy_version 208984 (0.0008) [2023-12-26 01:15:08,778][123090] Updated weights for policy 1, policy_version 208206 (0.0010) [2023-12-26 01:15:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 106799104. Throughput: 0: 8976.5, 1: 9063.2. Samples: 106783236. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:08,785][121949] Avg episode reward: [(0, '5990.364'), (1, '5486.779')] [2023-12-26 01:15:08,824][123091] Updated weights for policy 0, policy_version 208994 (0.0009) [2023-12-26 01:15:08,840][123090] Updated weights for policy 1, policy_version 208216 (0.0007) [2023-12-26 01:15:08,884][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000208224_53305344.pth... [2023-12-26 01:15:08,887][123091] Updated weights for policy 0, policy_version 209004 (0.0007) [2023-12-26 01:15:08,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000207136_53026816.pth [2023-12-26 01:15:08,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000209008_53510144.pth... [2023-12-26 01:15:08,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000207952_53239808.pth [2023-12-26 01:15:09,687][123090] Updated weights for policy 1, policy_version 208226 (0.0009) [2023-12-26 01:15:09,719][123091] Updated weights for policy 0, policy_version 209014 (0.0007) [2023-12-26 01:15:09,755][123090] Updated weights for policy 1, policy_version 208236 (0.0011) [2023-12-26 01:15:09,779][123091] Updated weights for policy 0, policy_version 209024 (0.0005) [2023-12-26 01:15:09,830][123090] Updated weights for policy 1, policy_version 208246 (0.0011) [2023-12-26 01:15:09,846][123091] Updated weights for policy 0, policy_version 209034 (0.0007) [2023-12-26 01:15:09,898][123090] Updated weights for policy 1, policy_version 208256 (0.0009) [2023-12-26 01:15:10,658][123091] Updated weights for policy 0, policy_version 209044 (0.0009) [2023-12-26 01:15:10,720][123090] Updated weights for policy 1, policy_version 208266 (0.0008) [2023-12-26 01:15:10,722][123091] Updated weights for policy 0, policy_version 209054 (0.0008) [2023-12-26 01:15:10,783][123091] Updated weights for policy 0, policy_version 209064 (0.0008) [2023-12-26 01:15:10,785][123090] Updated weights for policy 1, policy_version 208276 (0.0007) [2023-12-26 01:15:10,850][123090] Updated weights for policy 1, policy_version 208286 (0.0009) [2023-12-26 01:15:11,671][123091] Updated weights for policy 0, policy_version 209074 (0.0007) [2023-12-26 01:15:11,699][123090] Updated weights for policy 1, policy_version 208296 (0.0009) [2023-12-26 01:15:11,743][123091] Updated weights for policy 0, policy_version 209084 (0.0009) [2023-12-26 01:15:11,769][123090] Updated weights for policy 1, policy_version 208306 (0.0010) [2023-12-26 01:15:11,809][123091] Updated weights for policy 0, policy_version 209094 (0.0006) [2023-12-26 01:15:11,827][123090] Updated weights for policy 1, policy_version 208316 (0.0009) [2023-12-26 01:15:11,874][123091] Updated weights for policy 0, policy_version 209104 (0.0006) [2023-12-26 01:15:12,640][123091] Updated weights for policy 0, policy_version 209114 (0.0010) [2023-12-26 01:15:12,706][123091] Updated weights for policy 0, policy_version 209124 (0.0009) [2023-12-26 01:15:12,740][123090] Updated weights for policy 1, policy_version 208326 (0.0007) [2023-12-26 01:15:12,768][123091] Updated weights for policy 0, policy_version 209134 (0.0010) [2023-12-26 01:15:12,793][123090] Updated weights for policy 1, policy_version 208336 (0.0007) [2023-12-26 01:15:12,853][123090] Updated weights for policy 1, policy_version 208346 (0.0009) [2023-12-26 01:15:13,507][123091] Updated weights for policy 0, policy_version 209144 (0.0010) [2023-12-26 01:15:13,558][123091] Updated weights for policy 0, policy_version 209154 (0.0010) [2023-12-26 01:15:13,607][123090] Updated weights for policy 1, policy_version 208356 (0.0007) [2023-12-26 01:15:13,609][123091] Updated weights for policy 0, policy_version 209164 (0.0010) [2023-12-26 01:15:13,666][123090] Updated weights for policy 1, policy_version 208366 (0.0005) [2023-12-26 01:15:13,732][123090] Updated weights for policy 1, policy_version 208376 (0.0007) [2023-12-26 01:15:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 106897408. Throughput: 0: 8922.1, 1: 8931.2. Samples: 106884216. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:13,785][121949] Avg episode reward: [(0, '5993.155'), (1, '5480.897')] [2023-12-26 01:15:14,425][123091] Updated weights for policy 0, policy_version 209174 (0.0011) [2023-12-26 01:15:14,476][123091] Updated weights for policy 0, policy_version 209184 (0.0010) [2023-12-26 01:15:14,512][123090] Updated weights for policy 1, policy_version 208386 (0.0010) [2023-12-26 01:15:14,528][123091] Updated weights for policy 0, policy_version 209194 (0.0010) [2023-12-26 01:15:14,574][123090] Updated weights for policy 1, policy_version 208396 (0.0010) [2023-12-26 01:15:14,637][123090] Updated weights for policy 1, policy_version 208406 (0.0010) [2023-12-26 01:15:14,702][123090] Updated weights for policy 1, policy_version 208416 (0.0010) [2023-12-26 01:15:15,319][123091] Updated weights for policy 0, policy_version 209204 (0.0009) [2023-12-26 01:15:15,385][123091] Updated weights for policy 0, policy_version 209214 (0.0005) [2023-12-26 01:15:15,454][123091] Updated weights for policy 0, policy_version 209224 (0.0006) [2023-12-26 01:15:15,548][123090] Updated weights for policy 1, policy_version 208426 (0.0011) [2023-12-26 01:15:15,601][123090] Updated weights for policy 1, policy_version 208436 (0.0010) [2023-12-26 01:15:15,664][123090] Updated weights for policy 1, policy_version 208446 (0.0010) [2023-12-26 01:15:16,127][123091] Updated weights for policy 0, policy_version 209234 (0.0007) [2023-12-26 01:15:16,192][123091] Updated weights for policy 0, policy_version 209244 (0.0008) [2023-12-26 01:15:16,259][123091] Updated weights for policy 0, policy_version 209254 (0.0011) [2023-12-26 01:15:16,314][123091] Updated weights for policy 0, policy_version 209264 (0.0011) [2023-12-26 01:15:16,491][123090] Updated weights for policy 1, policy_version 208456 (0.0007) [2023-12-26 01:15:16,552][123090] Updated weights for policy 1, policy_version 208466 (0.0006) [2023-12-26 01:15:16,601][123090] Updated weights for policy 1, policy_version 208476 (0.0005) [2023-12-26 01:15:17,130][123091] Updated weights for policy 0, policy_version 209274 (0.0009) [2023-12-26 01:15:17,184][123091] Updated weights for policy 0, policy_version 209284 (0.0009) [2023-12-26 01:15:17,198][123090] Updated weights for policy 1, policy_version 208486 (0.0008) [2023-12-26 01:15:17,239][123091] Updated weights for policy 0, policy_version 209294 (0.0006) [2023-12-26 01:15:17,246][123090] Updated weights for policy 1, policy_version 208496 (0.0010) [2023-12-26 01:15:17,304][123090] Updated weights for policy 1, policy_version 208506 (0.0010) [2023-12-26 01:15:18,089][123091] Updated weights for policy 0, policy_version 209304 (0.0008) [2023-12-26 01:15:18,140][123091] Updated weights for policy 0, policy_version 209314 (0.0008) [2023-12-26 01:15:18,145][123090] Updated weights for policy 1, policy_version 208516 (0.0010) [2023-12-26 01:15:18,195][123091] Updated weights for policy 0, policy_version 209324 (0.0007) [2023-12-26 01:15:18,196][123090] Updated weights for policy 1, policy_version 208526 (0.0010) [2023-12-26 01:15:18,248][123090] Updated weights for policy 1, policy_version 208536 (0.0010) [2023-12-26 01:15:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 106979328. Throughput: 0: 8946.6, 1: 8967.1. Samples: 106991232. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:18,785][121949] Avg episode reward: [(0, '6011.971'), (1, '5301.826')] [2023-12-26 01:15:18,785][123007] Saving new best policy, reward=6011.971! [2023-12-26 01:15:19,067][123091] Updated weights for policy 0, policy_version 209334 (0.0008) [2023-12-26 01:15:19,101][123090] Updated weights for policy 1, policy_version 208546 (0.0010) [2023-12-26 01:15:19,126][123091] Updated weights for policy 0, policy_version 209344 (0.0007) [2023-12-26 01:15:19,165][123090] Updated weights for policy 1, policy_version 208556 (0.0011) [2023-12-26 01:15:19,179][123091] Updated weights for policy 0, policy_version 209354 (0.0010) [2023-12-26 01:15:19,227][123090] Updated weights for policy 1, policy_version 208566 (0.0011) [2023-12-26 01:15:19,292][123090] Updated weights for policy 1, policy_version 208576 (0.0011) [2023-12-26 01:15:20,032][123091] Updated weights for policy 0, policy_version 209364 (0.0010) [2023-12-26 01:15:20,105][123091] Updated weights for policy 0, policy_version 209374 (0.0008) [2023-12-26 01:15:20,121][123090] Updated weights for policy 1, policy_version 208586 (0.0006) [2023-12-26 01:15:20,167][123091] Updated weights for policy 0, policy_version 209384 (0.0008) [2023-12-26 01:15:20,184][123090] Updated weights for policy 1, policy_version 208596 (0.0005) [2023-12-26 01:15:20,254][123090] Updated weights for policy 1, policy_version 208606 (0.0006) [2023-12-26 01:15:20,899][123091] Updated weights for policy 0, policy_version 209394 (0.0008) [2023-12-26 01:15:20,960][123091] Updated weights for policy 0, policy_version 209404 (0.0007) [2023-12-26 01:15:21,022][123090] Updated weights for policy 1, policy_version 208616 (0.0008) [2023-12-26 01:15:21,027][123091] Updated weights for policy 0, policy_version 209414 (0.0009) [2023-12-26 01:15:21,090][123091] Updated weights for policy 0, policy_version 209424 (0.0010) [2023-12-26 01:15:21,092][123090] Updated weights for policy 1, policy_version 208626 (0.0007) [2023-12-26 01:15:21,154][123090] Updated weights for policy 1, policy_version 208636 (0.0009) [2023-12-26 01:15:21,938][123091] Updated weights for policy 0, policy_version 209434 (0.0005) [2023-12-26 01:15:22,013][123091] Updated weights for policy 0, policy_version 209444 (0.0006) [2023-12-26 01:15:22,042][123090] Updated weights for policy 1, policy_version 208646 (0.0010) [2023-12-26 01:15:22,085][123091] Updated weights for policy 0, policy_version 209454 (0.0006) [2023-12-26 01:15:22,102][123090] Updated weights for policy 1, policy_version 208656 (0.0006) [2023-12-26 01:15:22,168][123090] Updated weights for policy 1, policy_version 208666 (0.0008) [2023-12-26 01:15:22,825][123091] Updated weights for policy 0, policy_version 209464 (0.0008) [2023-12-26 01:15:22,890][123091] Updated weights for policy 0, policy_version 209474 (0.0009) [2023-12-26 01:15:22,916][123090] Updated weights for policy 1, policy_version 208676 (0.0009) [2023-12-26 01:15:22,957][123091] Updated weights for policy 0, policy_version 209484 (0.0011) [2023-12-26 01:15:22,978][123090] Updated weights for policy 1, policy_version 208686 (0.0006) [2023-12-26 01:15:23,042][123090] Updated weights for policy 1, policy_version 208696 (0.0008) [2023-12-26 01:15:23,774][123091] Updated weights for policy 0, policy_version 209494 (0.0011) [2023-12-26 01:15:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 107061248. Throughput: 0: 8922.7, 1: 8938.7. Samples: 107042876. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:23,785][121949] Avg episode reward: [(0, '5846.391'), (1, '5299.812')] [2023-12-26 01:15:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000208704_53428224.pth... [2023-12-26 01:15:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000207680_53166080.pth [2023-12-26 01:15:23,839][123091] Updated weights for policy 0, policy_version 209504 (0.0011) [2023-12-26 01:15:23,853][123090] Updated weights for policy 1, policy_version 208706 (0.0010) [2023-12-26 01:15:23,890][123091] Updated weights for policy 0, policy_version 209514 (0.0010) [2023-12-26 01:15:23,918][123090] Updated weights for policy 1, policy_version 208716 (0.0006) [2023-12-26 01:15:23,922][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000209520_53641216.pth... [2023-12-26 01:15:23,925][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000208496_53379072.pth [2023-12-26 01:15:23,975][123090] Updated weights for policy 1, policy_version 208726 (0.0005) [2023-12-26 01:15:24,039][123090] Updated weights for policy 1, policy_version 208736 (0.0007) [2023-12-26 01:15:24,653][123091] Updated weights for policy 0, policy_version 209524 (0.0009) [2023-12-26 01:15:24,685][123090] Updated weights for policy 1, policy_version 208746 (0.0009) [2023-12-26 01:15:24,720][123091] Updated weights for policy 0, policy_version 209534 (0.0007) [2023-12-26 01:15:24,753][123090] Updated weights for policy 1, policy_version 208756 (0.0009) [2023-12-26 01:15:24,778][123091] Updated weights for policy 0, policy_version 209544 (0.0010) [2023-12-26 01:15:24,819][123090] Updated weights for policy 1, policy_version 208766 (0.0008) [2023-12-26 01:15:25,476][123091] Updated weights for policy 0, policy_version 209554 (0.0009) [2023-12-26 01:15:25,530][123091] Updated weights for policy 0, policy_version 209564 (0.0006) [2023-12-26 01:15:25,575][123091] Updated weights for policy 0, policy_version 209574 (0.0005) [2023-12-26 01:15:25,628][123091] Updated weights for policy 0, policy_version 209584 (0.0006) [2023-12-26 01:15:25,638][123090] Updated weights for policy 1, policy_version 208776 (0.0009) [2023-12-26 01:15:25,696][123090] Updated weights for policy 1, policy_version 208787 (0.0010) [2023-12-26 01:15:25,755][123090] Updated weights for policy 1, policy_version 208797 (0.0010) [2023-12-26 01:15:26,315][123091] Updated weights for policy 0, policy_version 209594 (0.0005) [2023-12-26 01:15:26,378][123091] Updated weights for policy 0, policy_version 209604 (0.0007) [2023-12-26 01:15:26,450][123091] Updated weights for policy 0, policy_version 209614 (0.0005) [2023-12-26 01:15:26,631][123090] Updated weights for policy 1, policy_version 208807 (0.0010) [2023-12-26 01:15:26,697][123090] Updated weights for policy 1, policy_version 208817 (0.0010) [2023-12-26 01:15:26,764][123090] Updated weights for policy 1, policy_version 208827 (0.0010) [2023-12-26 01:15:27,101][123091] Updated weights for policy 0, policy_version 209624 (0.0007) [2023-12-26 01:15:27,151][123091] Updated weights for policy 0, policy_version 209634 (0.0010) [2023-12-26 01:15:27,201][123091] Updated weights for policy 0, policy_version 209644 (0.0010) [2023-12-26 01:15:27,614][123090] Updated weights for policy 1, policy_version 208837 (0.0008) [2023-12-26 01:15:27,669][123090] Updated weights for policy 1, policy_version 208847 (0.0008) [2023-12-26 01:15:27,717][123090] Updated weights for policy 1, policy_version 208857 (0.0009) [2023-12-26 01:15:27,957][123091] Updated weights for policy 0, policy_version 209654 (0.0007) [2023-12-26 01:15:28,009][123091] Updated weights for policy 0, policy_version 209664 (0.0005) [2023-12-26 01:15:28,055][123091] Updated weights for policy 0, policy_version 209674 (0.0005) [2023-12-26 01:15:28,658][123090] Updated weights for policy 1, policy_version 208867 (0.0008) [2023-12-26 01:15:28,675][123091] Updated weights for policy 0, policy_version 209684 (0.0007) [2023-12-26 01:15:28,719][123090] Updated weights for policy 1, policy_version 208877 (0.0009) [2023-12-26 01:15:28,741][123091] Updated weights for policy 0, policy_version 209694 (0.0011) [2023-12-26 01:15:28,782][123090] Updated weights for policy 1, policy_version 208887 (0.0006) [2023-12-26 01:15:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 107151360. Throughput: 0: 9011.6, 1: 8898.6. Samples: 107152864. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:28,784][121949] Avg episode reward: [(0, '5850.558'), (1, '5442.747')] [2023-12-26 01:15:28,800][123091] Updated weights for policy 0, policy_version 209704 (0.0010) [2023-12-26 01:15:29,575][123090] Updated weights for policy 1, policy_version 208897 (0.0006) [2023-12-26 01:15:29,617][123091] Updated weights for policy 0, policy_version 209714 (0.0010) [2023-12-26 01:15:29,628][123090] Updated weights for policy 1, policy_version 208907 (0.0005) [2023-12-26 01:15:29,683][123091] Updated weights for policy 0, policy_version 209724 (0.0011) [2023-12-26 01:15:29,690][123090] Updated weights for policy 1, policy_version 208917 (0.0006) [2023-12-26 01:15:29,742][123090] Updated weights for policy 1, policy_version 208927 (0.0005) [2023-12-26 01:15:29,746][123091] Updated weights for policy 0, policy_version 209734 (0.0011) [2023-12-26 01:15:29,808][123091] Updated weights for policy 0, policy_version 209744 (0.0011) [2023-12-26 01:15:30,567][123090] Updated weights for policy 1, policy_version 208937 (0.0010) [2023-12-26 01:15:30,617][123091] Updated weights for policy 0, policy_version 209754 (0.0010) [2023-12-26 01:15:30,628][123090] Updated weights for policy 1, policy_version 208947 (0.0007) [2023-12-26 01:15:30,668][123091] Updated weights for policy 0, policy_version 209764 (0.0010) [2023-12-26 01:15:30,694][123090] Updated weights for policy 1, policy_version 208957 (0.0005) [2023-12-26 01:15:30,715][123091] Updated weights for policy 0, policy_version 209774 (0.0010) [2023-12-26 01:15:31,408][123090] Updated weights for policy 1, policy_version 208967 (0.0007) [2023-12-26 01:15:31,483][123090] Updated weights for policy 1, policy_version 208977 (0.0008) [2023-12-26 01:15:31,545][123091] Updated weights for policy 0, policy_version 209784 (0.0008) [2023-12-26 01:15:31,558][123090] Updated weights for policy 1, policy_version 208987 (0.0008) [2023-12-26 01:15:31,599][123091] Updated weights for policy 0, policy_version 209794 (0.0009) [2023-12-26 01:15:31,657][123091] Updated weights for policy 0, policy_version 209804 (0.0010) [2023-12-26 01:15:32,302][123090] Updated weights for policy 1, policy_version 208997 (0.0009) [2023-12-26 01:15:32,370][123090] Updated weights for policy 1, policy_version 209007 (0.0011) [2023-12-26 01:15:32,429][123090] Updated weights for policy 1, policy_version 209017 (0.0010) [2023-12-26 01:15:32,518][123091] Updated weights for policy 0, policy_version 209814 (0.0007) [2023-12-26 01:15:32,568][123091] Updated weights for policy 0, policy_version 209824 (0.0005) [2023-12-26 01:15:32,633][123091] Updated weights for policy 0, policy_version 209834 (0.0005) [2023-12-26 01:15:33,172][123090] Updated weights for policy 1, policy_version 209027 (0.0009) [2023-12-26 01:15:33,220][123090] Updated weights for policy 1, policy_version 209037 (0.0005) [2023-12-26 01:15:33,277][123090] Updated weights for policy 1, policy_version 209047 (0.0005) [2023-12-26 01:15:33,457][123091] Updated weights for policy 0, policy_version 209844 (0.0007) [2023-12-26 01:15:33,513][123091] Updated weights for policy 0, policy_version 209854 (0.0005) [2023-12-26 01:15:33,566][123091] Updated weights for policy 0, policy_version 209864 (0.0005) [2023-12-26 01:15:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 107249664. Throughput: 0: 8936.5, 1: 8889.9. Samples: 107261376. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:33,785][121949] Avg episode reward: [(0, '6032.342'), (1, '5454.797')] [2023-12-26 01:15:33,787][123007] Saving new best policy, reward=6032.342! [2023-12-26 01:15:33,939][123090] Updated weights for policy 1, policy_version 209057 (0.0005) [2023-12-26 01:15:33,986][123090] Updated weights for policy 1, policy_version 209067 (0.0005) [2023-12-26 01:15:34,038][123090] Updated weights for policy 1, policy_version 209077 (0.0005) [2023-12-26 01:15:34,101][123090] Updated weights for policy 1, policy_version 209087 (0.0005) [2023-12-26 01:15:34,179][123091] Updated weights for policy 0, policy_version 209874 (0.0006) [2023-12-26 01:15:34,240][123091] Updated weights for policy 0, policy_version 209884 (0.0010) [2023-12-26 01:15:34,307][123091] Updated weights for policy 0, policy_version 209894 (0.0009) [2023-12-26 01:15:34,368][123091] Updated weights for policy 0, policy_version 209904 (0.0010) [2023-12-26 01:15:34,852][123090] Updated weights for policy 1, policy_version 209097 (0.0010) [2023-12-26 01:15:34,916][123090] Updated weights for policy 1, policy_version 209107 (0.0010) [2023-12-26 01:15:34,979][123090] Updated weights for policy 1, policy_version 209117 (0.0010) [2023-12-26 01:15:35,192][123091] Updated weights for policy 0, policy_version 209914 (0.0009) [2023-12-26 01:15:35,251][123091] Updated weights for policy 0, policy_version 209924 (0.0009) [2023-12-26 01:15:35,306][123091] Updated weights for policy 0, policy_version 209934 (0.0009) [2023-12-26 01:15:35,692][123090] Updated weights for policy 1, policy_version 209127 (0.0007) [2023-12-26 01:15:35,760][123090] Updated weights for policy 1, policy_version 209137 (0.0005) [2023-12-26 01:15:35,823][123090] Updated weights for policy 1, policy_version 209147 (0.0005) [2023-12-26 01:15:36,214][123091] Updated weights for policy 0, policy_version 209944 (0.0011) [2023-12-26 01:15:36,278][123091] Updated weights for policy 0, policy_version 209954 (0.0011) [2023-12-26 01:15:36,349][123091] Updated weights for policy 0, policy_version 209964 (0.0011) [2023-12-26 01:15:36,483][123090] Updated weights for policy 1, policy_version 209157 (0.0007) [2023-12-26 01:15:36,540][123090] Updated weights for policy 1, policy_version 209167 (0.0005) [2023-12-26 01:15:36,609][123090] Updated weights for policy 1, policy_version 209177 (0.0006) [2023-12-26 01:15:37,157][123091] Updated weights for policy 0, policy_version 209974 (0.0011) [2023-12-26 01:15:37,220][123091] Updated weights for policy 0, policy_version 209984 (0.0011) [2023-12-26 01:15:37,232][123090] Updated weights for policy 1, policy_version 209187 (0.0007) [2023-12-26 01:15:37,284][123091] Updated weights for policy 0, policy_version 209994 (0.0011) [2023-12-26 01:15:37,296][123090] Updated weights for policy 1, policy_version 209197 (0.0011) [2023-12-26 01:15:37,355][123090] Updated weights for policy 1, policy_version 209207 (0.0010) [2023-12-26 01:15:37,975][123091] Updated weights for policy 0, policy_version 210004 (0.0006) [2023-12-26 01:15:38,034][123091] Updated weights for policy 0, policy_version 210014 (0.0006) [2023-12-26 01:15:38,105][123091] Updated weights for policy 0, policy_version 210024 (0.0005) [2023-12-26 01:15:38,175][123090] Updated weights for policy 1, policy_version 209217 (0.0011) [2023-12-26 01:15:38,222][123090] Updated weights for policy 1, policy_version 209227 (0.0010) [2023-12-26 01:15:38,292][123090] Updated weights for policy 1, policy_version 209237 (0.0010) [2023-12-26 01:15:38,362][123090] Updated weights for policy 1, policy_version 209247 (0.0010) [2023-12-26 01:15:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 107339776. Throughput: 0: 8912.5, 1: 8937.6. Samples: 107316444. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:38,785][121949] Avg episode reward: [(0, '6033.154'), (1, '5527.389')] [2023-12-26 01:15:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000210032_53772288.pth... [2023-12-26 01:15:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000209248_53567488.pth... [2023-12-26 01:15:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000209008_53510144.pth [2023-12-26 01:15:38,794][123007] Saving new best policy, reward=6033.154! [2023-12-26 01:15:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000208224_53305344.pth [2023-12-26 01:15:38,828][123091] Updated weights for policy 0, policy_version 210034 (0.0007) [2023-12-26 01:15:38,895][123091] Updated weights for policy 0, policy_version 210044 (0.0010) [2023-12-26 01:15:38,959][123091] Updated weights for policy 0, policy_version 210054 (0.0011) [2023-12-26 01:15:39,011][123091] Updated weights for policy 0, policy_version 210064 (0.0011) [2023-12-26 01:15:39,240][123090] Updated weights for policy 1, policy_version 209257 (0.0010) [2023-12-26 01:15:39,307][123090] Updated weights for policy 1, policy_version 209267 (0.0010) [2023-12-26 01:15:39,376][123090] Updated weights for policy 1, policy_version 209277 (0.0010) [2023-12-26 01:15:39,832][123091] Updated weights for policy 0, policy_version 210074 (0.0010) [2023-12-26 01:15:39,900][123091] Updated weights for policy 0, policy_version 210084 (0.0011) [2023-12-26 01:15:39,968][123091] Updated weights for policy 0, policy_version 210094 (0.0010) [2023-12-26 01:15:40,160][123090] Updated weights for policy 1, policy_version 209287 (0.0010) [2023-12-26 01:15:40,229][123090] Updated weights for policy 1, policy_version 209297 (0.0009) [2023-12-26 01:15:40,290][123090] Updated weights for policy 1, policy_version 209307 (0.0009) [2023-12-26 01:15:40,793][123091] Updated weights for policy 0, policy_version 210104 (0.0011) [2023-12-26 01:15:40,845][123091] Updated weights for policy 0, policy_version 210114 (0.0010) [2023-12-26 01:15:40,900][123091] Updated weights for policy 0, policy_version 210124 (0.0010) [2023-12-26 01:15:41,112][123090] Updated weights for policy 1, policy_version 209317 (0.0008) [2023-12-26 01:15:41,181][123090] Updated weights for policy 1, policy_version 209327 (0.0009) [2023-12-26 01:15:41,241][123090] Updated weights for policy 1, policy_version 209337 (0.0010) [2023-12-26 01:15:41,714][123091] Updated weights for policy 0, policy_version 210134 (0.0009) [2023-12-26 01:15:41,782][123091] Updated weights for policy 0, policy_version 210144 (0.0010) [2023-12-26 01:15:41,852][123091] Updated weights for policy 0, policy_version 210154 (0.0009) [2023-12-26 01:15:42,114][123090] Updated weights for policy 1, policy_version 209347 (0.0009) [2023-12-26 01:15:42,182][123090] Updated weights for policy 1, policy_version 209357 (0.0009) [2023-12-26 01:15:42,237][123090] Updated weights for policy 1, policy_version 209367 (0.0009) [2023-12-26 01:15:42,626][123091] Updated weights for policy 0, policy_version 210164 (0.0008) [2023-12-26 01:15:42,695][123091] Updated weights for policy 0, policy_version 210174 (0.0005) [2023-12-26 01:15:42,777][123091] Updated weights for policy 0, policy_version 210184 (0.0007) [2023-12-26 01:15:43,153][123090] Updated weights for policy 1, policy_version 209377 (0.0010) [2023-12-26 01:15:43,213][123090] Updated weights for policy 1, policy_version 209387 (0.0008) [2023-12-26 01:15:43,262][123090] Updated weights for policy 1, policy_version 209397 (0.0009) [2023-12-26 01:15:43,309][123090] Updated weights for policy 1, policy_version 209407 (0.0009) [2023-12-26 01:15:43,458][123091] Updated weights for policy 0, policy_version 210194 (0.0007) [2023-12-26 01:15:43,523][123091] Updated weights for policy 0, policy_version 210204 (0.0007) [2023-12-26 01:15:43,578][123091] Updated weights for policy 0, policy_version 210214 (0.0009) [2023-12-26 01:15:43,633][123091] Updated weights for policy 0, policy_version 210224 (0.0009) [2023-12-26 01:15:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 107429888. Throughput: 0: 8901.1, 1: 8840.3. Samples: 107420612. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:43,784][121949] Avg episode reward: [(0, '6029.674'), (1, '5396.653')] [2023-12-26 01:15:44,151][123090] Updated weights for policy 1, policy_version 209417 (0.0010) [2023-12-26 01:15:44,214][123090] Updated weights for policy 1, policy_version 209427 (0.0010) [2023-12-26 01:15:44,280][123090] Updated weights for policy 1, policy_version 209437 (0.0009) [2023-12-26 01:15:44,413][123091] Updated weights for policy 0, policy_version 210234 (0.0005) [2023-12-26 01:15:44,474][123091] Updated weights for policy 0, policy_version 210244 (0.0005) [2023-12-26 01:15:44,544][123091] Updated weights for policy 0, policy_version 210254 (0.0005) [2023-12-26 01:15:45,206][123090] Updated weights for policy 1, policy_version 209448 (0.0007) [2023-12-26 01:15:45,274][123090] Updated weights for policy 1, policy_version 209458 (0.0010) [2023-12-26 01:15:45,286][123091] Updated weights for policy 0, policy_version 210264 (0.0007) [2023-12-26 01:15:45,336][123090] Updated weights for policy 1, policy_version 209468 (0.0006) [2023-12-26 01:15:45,349][123091] Updated weights for policy 0, policy_version 210274 (0.0008) [2023-12-26 01:15:45,418][123091] Updated weights for policy 0, policy_version 210284 (0.0009) [2023-12-26 01:15:46,136][123090] Updated weights for policy 1, policy_version 209478 (0.0008) [2023-12-26 01:15:46,186][123090] Updated weights for policy 1, policy_version 209488 (0.0009) [2023-12-26 01:15:46,194][123091] Updated weights for policy 0, policy_version 210294 (0.0007) [2023-12-26 01:15:46,239][123090] Updated weights for policy 1, policy_version 209498 (0.0009) [2023-12-26 01:15:46,252][123091] Updated weights for policy 0, policy_version 210304 (0.0005) [2023-12-26 01:15:46,304][123091] Updated weights for policy 0, policy_version 210314 (0.0005) [2023-12-26 01:15:47,073][123091] Updated weights for policy 0, policy_version 210324 (0.0007) [2023-12-26 01:15:47,115][123090] Updated weights for policy 1, policy_version 209508 (0.0010) [2023-12-26 01:15:47,122][123091] Updated weights for policy 0, policy_version 210334 (0.0008) [2023-12-26 01:15:47,167][123091] Updated weights for policy 0, policy_version 210344 (0.0008) [2023-12-26 01:15:47,174][123090] Updated weights for policy 1, policy_version 209518 (0.0007) [2023-12-26 01:15:47,233][123090] Updated weights for policy 1, policy_version 209528 (0.0009) [2023-12-26 01:15:47,918][123090] Updated weights for policy 1, policy_version 209538 (0.0009) [2023-12-26 01:15:47,971][123090] Updated weights for policy 1, policy_version 209548 (0.0006) [2023-12-26 01:15:48,029][123090] Updated weights for policy 1, policy_version 209558 (0.0006) [2023-12-26 01:15:48,031][123091] Updated weights for policy 0, policy_version 210354 (0.0007) [2023-12-26 01:15:48,084][123090] Updated weights for policy 1, policy_version 209568 (0.0006) [2023-12-26 01:15:48,087][123091] Updated weights for policy 0, policy_version 210364 (0.0009) [2023-12-26 01:15:48,155][123091] Updated weights for policy 0, policy_version 210374 (0.0006) [2023-12-26 01:15:48,227][123091] Updated weights for policy 0, policy_version 210384 (0.0009) [2023-12-26 01:15:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 107511808. Throughput: 0: 8971.4, 1: 8762.8. Samples: 107527416. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:48,785][121949] Avg episode reward: [(0, '5978.655'), (1, '5127.201')] [2023-12-26 01:15:48,883][123090] Updated weights for policy 1, policy_version 209578 (0.0006) [2023-12-26 01:15:48,920][123091] Updated weights for policy 0, policy_version 210394 (0.0010) [2023-12-26 01:15:48,948][123090] Updated weights for policy 1, policy_version 209588 (0.0006) [2023-12-26 01:15:48,968][123091] Updated weights for policy 0, policy_version 210404 (0.0010) [2023-12-26 01:15:49,009][123090] Updated weights for policy 1, policy_version 209598 (0.0009) [2023-12-26 01:15:49,021][123091] Updated weights for policy 0, policy_version 210414 (0.0010) [2023-12-26 01:15:49,833][123090] Updated weights for policy 1, policy_version 209608 (0.0008) [2023-12-26 01:15:49,880][123091] Updated weights for policy 0, policy_version 210424 (0.0010) [2023-12-26 01:15:49,895][123090] Updated weights for policy 1, policy_version 209618 (0.0008) [2023-12-26 01:15:49,944][123091] Updated weights for policy 0, policy_version 210434 (0.0010) [2023-12-26 01:15:49,975][123090] Updated weights for policy 1, policy_version 209628 (0.0007) [2023-12-26 01:15:50,011][123091] Updated weights for policy 0, policy_version 210444 (0.0011) [2023-12-26 01:15:50,818][123090] Updated weights for policy 1, policy_version 209638 (0.0007) [2023-12-26 01:15:50,819][123091] Updated weights for policy 0, policy_version 210454 (0.0007) [2023-12-26 01:15:50,875][123091] Updated weights for policy 0, policy_version 210464 (0.0006) [2023-12-26 01:15:50,889][123090] Updated weights for policy 1, policy_version 209648 (0.0007) [2023-12-26 01:15:50,939][123091] Updated weights for policy 0, policy_version 210474 (0.0006) [2023-12-26 01:15:50,963][123090] Updated weights for policy 1, policy_version 209658 (0.0007) [2023-12-26 01:15:51,679][123091] Updated weights for policy 0, policy_version 210484 (0.0006) [2023-12-26 01:15:51,750][123091] Updated weights for policy 0, policy_version 210494 (0.0007) [2023-12-26 01:15:51,762][123090] Updated weights for policy 1, policy_version 209668 (0.0009) [2023-12-26 01:15:51,798][123091] Updated weights for policy 0, policy_version 210504 (0.0006) [2023-12-26 01:15:51,834][123090] Updated weights for policy 1, policy_version 209678 (0.0005) [2023-12-26 01:15:51,909][123090] Updated weights for policy 1, policy_version 209688 (0.0005) [2023-12-26 01:15:52,586][123091] Updated weights for policy 0, policy_version 210514 (0.0005) [2023-12-26 01:15:52,612][123090] Updated weights for policy 1, policy_version 209698 (0.0006) [2023-12-26 01:15:52,648][123091] Updated weights for policy 0, policy_version 210524 (0.0008) [2023-12-26 01:15:52,681][123090] Updated weights for policy 1, policy_version 209708 (0.0007) [2023-12-26 01:15:52,713][123091] Updated weights for policy 0, policy_version 210534 (0.0008) [2023-12-26 01:15:52,753][123090] Updated weights for policy 1, policy_version 209718 (0.0007) [2023-12-26 01:15:52,777][123091] Updated weights for policy 0, policy_version 210544 (0.0005) [2023-12-26 01:15:52,825][123090] Updated weights for policy 1, policy_version 209728 (0.0007) [2023-12-26 01:15:53,517][123091] Updated weights for policy 0, policy_version 210554 (0.0005) [2023-12-26 01:15:53,573][123091] Updated weights for policy 0, policy_version 210564 (0.0005) [2023-12-26 01:15:53,637][123091] Updated weights for policy 0, policy_version 210574 (0.0007) [2023-12-26 01:15:53,662][123090] Updated weights for policy 1, policy_version 209738 (0.0008) [2023-12-26 01:15:53,723][123090] Updated weights for policy 1, policy_version 209748 (0.0010) [2023-12-26 01:15:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.1). Total num frames: 107601920. Throughput: 0: 8961.0, 1: 8736.4. Samples: 107579624. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:53,785][121949] Avg episode reward: [(0, '6003.502'), (1, '5134.238')] [2023-12-26 01:15:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000210576_53911552.pth... [2023-12-26 01:15:53,792][123090] Updated weights for policy 1, policy_version 209758 (0.0010) [2023-12-26 01:15:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000209520_53641216.pth [2023-12-26 01:15:53,806][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000209760_53698560.pth... [2023-12-26 01:15:53,811][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000208704_53428224.pth [2023-12-26 01:15:54,341][123091] Updated weights for policy 0, policy_version 210584 (0.0010) [2023-12-26 01:15:54,399][123091] Updated weights for policy 0, policy_version 210594 (0.0009) [2023-12-26 01:15:54,461][123091] Updated weights for policy 0, policy_version 210604 (0.0009) [2023-12-26 01:15:54,624][123090] Updated weights for policy 1, policy_version 209768 (0.0009) [2023-12-26 01:15:54,682][123090] Updated weights for policy 1, policy_version 209778 (0.0009) [2023-12-26 01:15:54,747][123090] Updated weights for policy 1, policy_version 209788 (0.0010) [2023-12-26 01:15:55,279][123091] Updated weights for policy 0, policy_version 210614 (0.0009) [2023-12-26 01:15:55,329][123091] Updated weights for policy 0, policy_version 210624 (0.0009) [2023-12-26 01:15:55,383][123091] Updated weights for policy 0, policy_version 210634 (0.0010) [2023-12-26 01:15:55,603][123090] Updated weights for policy 1, policy_version 209798 (0.0010) [2023-12-26 01:15:55,669][123090] Updated weights for policy 1, policy_version 209808 (0.0009) [2023-12-26 01:15:55,730][123090] Updated weights for policy 1, policy_version 209818 (0.0009) [2023-12-26 01:15:56,239][123091] Updated weights for policy 0, policy_version 210644 (0.0008) [2023-12-26 01:15:56,314][123091] Updated weights for policy 0, policy_version 210654 (0.0006) [2023-12-26 01:15:56,386][123091] Updated weights for policy 0, policy_version 210664 (0.0007) [2023-12-26 01:15:56,531][123090] Updated weights for policy 1, policy_version 209828 (0.0010) [2023-12-26 01:15:56,608][123090] Updated weights for policy 1, policy_version 209838 (0.0011) [2023-12-26 01:15:56,680][123090] Updated weights for policy 1, policy_version 209848 (0.0011) [2023-12-26 01:15:57,044][123091] Updated weights for policy 0, policy_version 210674 (0.0008) [2023-12-26 01:15:57,105][123091] Updated weights for policy 0, policy_version 210684 (0.0007) [2023-12-26 01:15:57,159][123091] Updated weights for policy 0, policy_version 210694 (0.0006) [2023-12-26 01:15:57,220][123091] Updated weights for policy 0, policy_version 210704 (0.0006) [2023-12-26 01:15:57,499][123090] Updated weights for policy 1, policy_version 209858 (0.0011) [2023-12-26 01:15:57,552][123090] Updated weights for policy 1, policy_version 209868 (0.0006) [2023-12-26 01:15:57,604][123090] Updated weights for policy 1, policy_version 209878 (0.0008) [2023-12-26 01:15:57,660][123090] Updated weights for policy 1, policy_version 209888 (0.0010) [2023-12-26 01:15:57,975][123091] Updated weights for policy 0, policy_version 210714 (0.0011) [2023-12-26 01:15:58,045][123091] Updated weights for policy 0, policy_version 210724 (0.0009) [2023-12-26 01:15:58,109][123091] Updated weights for policy 0, policy_version 210734 (0.0011) [2023-12-26 01:15:58,525][123090] Updated weights for policy 1, policy_version 209898 (0.0008) [2023-12-26 01:15:58,600][123090] Updated weights for policy 1, policy_version 209908 (0.0008) [2023-12-26 01:15:58,677][123090] Updated weights for policy 1, policy_version 209918 (0.0009) [2023-12-26 01:15:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 107692032. Throughput: 0: 9053.3, 1: 8776.1. Samples: 107686544. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:15:58,785][121949] Avg episode reward: [(0, '5976.268'), (1, '5174.999')] [2023-12-26 01:15:59,004][123091] Updated weights for policy 0, policy_version 210744 (0.0011) [2023-12-26 01:15:59,068][123091] Updated weights for policy 0, policy_version 210754 (0.0011) [2023-12-26 01:15:59,130][123091] Updated weights for policy 0, policy_version 210764 (0.0008) [2023-12-26 01:15:59,558][123090] Updated weights for policy 1, policy_version 209928 (0.0008) [2023-12-26 01:15:59,614][123090] Updated weights for policy 1, policy_version 209938 (0.0008) [2023-12-26 01:15:59,665][123090] Updated weights for policy 1, policy_version 209948 (0.0008) [2023-12-26 01:15:59,948][123091] Updated weights for policy 0, policy_version 210774 (0.0009) [2023-12-26 01:16:00,019][123091] Updated weights for policy 0, policy_version 210784 (0.0011) [2023-12-26 01:16:00,086][123091] Updated weights for policy 0, policy_version 210794 (0.0011) [2023-12-26 01:16:00,545][123090] Updated weights for policy 1, policy_version 209958 (0.0009) [2023-12-26 01:16:00,609][123090] Updated weights for policy 1, policy_version 209969 (0.0011) [2023-12-26 01:16:00,663][123090] Updated weights for policy 1, policy_version 209979 (0.0010) [2023-12-26 01:16:00,807][123091] Updated weights for policy 0, policy_version 210804 (0.0006) [2023-12-26 01:16:00,872][123091] Updated weights for policy 0, policy_version 210814 (0.0009) [2023-12-26 01:16:00,937][123091] Updated weights for policy 0, policy_version 210824 (0.0007) [2023-12-26 01:16:01,611][123090] Updated weights for policy 1, policy_version 209989 (0.0010) [2023-12-26 01:16:01,687][123090] Updated weights for policy 1, policy_version 209999 (0.0009) [2023-12-26 01:16:01,751][123090] Updated weights for policy 1, policy_version 210009 (0.0009) [2023-12-26 01:16:01,814][123091] Updated weights for policy 0, policy_version 210834 (0.0006) [2023-12-26 01:16:01,881][123091] Updated weights for policy 0, policy_version 210844 (0.0010) [2023-12-26 01:16:01,939][123091] Updated weights for policy 0, policy_version 210854 (0.0010) [2023-12-26 01:16:01,997][123091] Updated weights for policy 0, policy_version 210864 (0.0009) [2023-12-26 01:16:02,589][123090] Updated weights for policy 1, policy_version 210019 (0.0008) [2023-12-26 01:16:02,642][123090] Updated weights for policy 1, policy_version 210029 (0.0010) [2023-12-26 01:16:02,704][123090] Updated weights for policy 1, policy_version 210039 (0.0011) [2023-12-26 01:16:02,816][123091] Updated weights for policy 0, policy_version 210874 (0.0009) [2023-12-26 01:16:02,877][123091] Updated weights for policy 0, policy_version 210884 (0.0009) [2023-12-26 01:16:02,929][123091] Updated weights for policy 0, policy_version 210894 (0.0009) [2023-12-26 01:16:03,422][123090] Updated weights for policy 1, policy_version 210049 (0.0010) [2023-12-26 01:16:03,482][123090] Updated weights for policy 1, policy_version 210059 (0.0006) [2023-12-26 01:16:03,535][123090] Updated weights for policy 1, policy_version 210069 (0.0005) [2023-12-26 01:16:03,594][123090] Updated weights for policy 1, policy_version 210079 (0.0006) [2023-12-26 01:16:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 107773952. Throughput: 0: 8986.0, 1: 8706.2. Samples: 107787380. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:16:03,784][121949] Avg episode reward: [(0, '5976.034'), (1, '5019.240')] [2023-12-26 01:16:03,852][123091] Updated weights for policy 0, policy_version 210904 (0.0010) [2023-12-26 01:16:03,915][123091] Updated weights for policy 0, policy_version 210914 (0.0010) [2023-12-26 01:16:03,976][123091] Updated weights for policy 0, policy_version 210924 (0.0009) [2023-12-26 01:16:04,340][123090] Updated weights for policy 1, policy_version 210089 (0.0010) [2023-12-26 01:16:04,403][123090] Updated weights for policy 1, policy_version 210099 (0.0009) [2023-12-26 01:16:04,468][123090] Updated weights for policy 1, policy_version 210109 (0.0007) [2023-12-26 01:16:04,802][123091] Updated weights for policy 0, policy_version 210934 (0.0007) [2023-12-26 01:16:04,858][123091] Updated weights for policy 0, policy_version 210944 (0.0006) [2023-12-26 01:16:04,910][123091] Updated weights for policy 0, policy_version 210954 (0.0005) [2023-12-26 01:16:05,371][123090] Updated weights for policy 1, policy_version 210119 (0.0009) [2023-12-26 01:16:05,436][123090] Updated weights for policy 1, policy_version 210129 (0.0008) [2023-12-26 01:16:05,498][123090] Updated weights for policy 1, policy_version 210139 (0.0008) [2023-12-26 01:16:05,512][123091] Updated weights for policy 0, policy_version 210964 (0.0006) [2023-12-26 01:16:05,578][123091] Updated weights for policy 0, policy_version 210974 (0.0008) [2023-12-26 01:16:05,647][123091] Updated weights for policy 0, policy_version 210984 (0.0009) [2023-12-26 01:16:06,292][123090] Updated weights for policy 1, policy_version 210149 (0.0009) [2023-12-26 01:16:06,354][123090] Updated weights for policy 1, policy_version 210159 (0.0009) [2023-12-26 01:16:06,412][123090] Updated weights for policy 1, policy_version 210169 (0.0009) [2023-12-26 01:16:06,495][123091] Updated weights for policy 0, policy_version 210994 (0.0010) [2023-12-26 01:16:06,555][123091] Updated weights for policy 0, policy_version 211004 (0.0009) [2023-12-26 01:16:06,625][123091] Updated weights for policy 0, policy_version 211014 (0.0008) [2023-12-26 01:16:06,694][123091] Updated weights for policy 0, policy_version 211024 (0.0010) [2023-12-26 01:16:07,248][123090] Updated weights for policy 1, policy_version 210179 (0.0009) [2023-12-26 01:16:07,302][123090] Updated weights for policy 1, policy_version 210189 (0.0008) [2023-12-26 01:16:07,355][123090] Updated weights for policy 1, policy_version 210199 (0.0009) [2023-12-26 01:16:07,484][123091] Updated weights for policy 0, policy_version 211034 (0.0010) [2023-12-26 01:16:07,552][123091] Updated weights for policy 0, policy_version 211044 (0.0010) [2023-12-26 01:16:07,611][123091] Updated weights for policy 0, policy_version 211054 (0.0010) [2023-12-26 01:16:08,186][123090] Updated weights for policy 1, policy_version 210209 (0.0010) [2023-12-26 01:16:08,238][123090] Updated weights for policy 1, policy_version 210219 (0.0008) [2023-12-26 01:16:08,288][123090] Updated weights for policy 1, policy_version 210229 (0.0005) [2023-12-26 01:16:08,345][123090] Updated weights for policy 1, policy_version 210239 (0.0007) [2023-12-26 01:16:08,467][123091] Updated weights for policy 0, policy_version 211064 (0.0010) [2023-12-26 01:16:08,522][123091] Updated weights for policy 0, policy_version 211074 (0.0010) [2023-12-26 01:16:08,575][123091] Updated weights for policy 0, policy_version 211084 (0.0010) [2023-12-26 01:16:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 107864064. Throughput: 0: 8998.3, 1: 8697.1. Samples: 107839168. Policy #0 lag: (min: 21.0, avg: 33.6, max: 53.0) [2023-12-26 01:16:08,785][121949] Avg episode reward: [(0, '5966.983'), (1, '5144.578')] [2023-12-26 01:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000210240_53821440.pth... [2023-12-26 01:16:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000211088_54042624.pth... [2023-12-26 01:16:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000209248_53567488.pth [2023-12-26 01:16:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000210032_53772288.pth [2023-12-26 01:16:09,127][123090] Updated weights for policy 1, policy_version 210249 (0.0010) [2023-12-26 01:16:09,199][123090] Updated weights for policy 1, policy_version 210259 (0.0008) [2023-12-26 01:16:09,281][123090] Updated weights for policy 1, policy_version 210269 (0.0009) [2023-12-26 01:16:09,505][123091] Updated weights for policy 0, policy_version 211094 (0.0010) [2023-12-26 01:16:09,560][123091] Updated weights for policy 0, policy_version 211104 (0.0010) [2023-12-26 01:16:09,615][123091] Updated weights for policy 0, policy_version 211114 (0.0009) [2023-12-26 01:16:10,119][123090] Updated weights for policy 1, policy_version 210279 (0.0007) [2023-12-26 01:16:10,191][123090] Updated weights for policy 1, policy_version 210289 (0.0007) [2023-12-26 01:16:10,259][123090] Updated weights for policy 1, policy_version 210299 (0.0007) [2023-12-26 01:16:10,455][123091] Updated weights for policy 0, policy_version 211124 (0.0008) [2023-12-26 01:16:10,528][123091] Updated weights for policy 0, policy_version 211134 (0.0007) [2023-12-26 01:16:10,584][123091] Updated weights for policy 0, policy_version 211144 (0.0008) [2023-12-26 01:16:11,041][123090] Updated weights for policy 1, policy_version 210309 (0.0008) [2023-12-26 01:16:11,111][123090] Updated weights for policy 1, policy_version 210319 (0.0009) [2023-12-26 01:16:11,183][123090] Updated weights for policy 1, policy_version 210329 (0.0009) [2023-12-26 01:16:11,393][123091] Updated weights for policy 0, policy_version 211154 (0.0009) [2023-12-26 01:16:11,450][123091] Updated weights for policy 0, policy_version 211164 (0.0007) [2023-12-26 01:16:11,512][123091] Updated weights for policy 0, policy_version 211174 (0.0006) [2023-12-26 01:16:11,564][123091] Updated weights for policy 0, policy_version 211184 (0.0009) [2023-12-26 01:16:11,972][123090] Updated weights for policy 1, policy_version 210339 (0.0009) [2023-12-26 01:16:12,023][123090] Updated weights for policy 1, policy_version 210349 (0.0005) [2023-12-26 01:16:12,087][123090] Updated weights for policy 1, policy_version 210359 (0.0005) [2023-12-26 01:16:12,424][123091] Updated weights for policy 0, policy_version 211194 (0.0010) [2023-12-26 01:16:12,481][123091] Updated weights for policy 0, policy_version 211204 (0.0009) [2023-12-26 01:16:12,535][123091] Updated weights for policy 0, policy_version 211214 (0.0009) [2023-12-26 01:16:12,802][123090] Updated weights for policy 1, policy_version 210369 (0.0006) [2023-12-26 01:16:12,861][123090] Updated weights for policy 1, policy_version 210379 (0.0009) [2023-12-26 01:16:12,925][123090] Updated weights for policy 1, policy_version 210389 (0.0008) [2023-12-26 01:16:12,987][123090] Updated weights for policy 1, policy_version 210399 (0.0008) [2023-12-26 01:16:13,381][123091] Updated weights for policy 0, policy_version 211224 (0.0009) [2023-12-26 01:16:13,437][123091] Updated weights for policy 0, policy_version 211235 (0.0008) [2023-12-26 01:16:13,486][123091] Updated weights for policy 0, policy_version 211246 (0.0008) [2023-12-26 01:16:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 107945984. Throughput: 0: 8833.1, 1: 8697.0. Samples: 107941724. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:13,785][121949] Avg episode reward: [(0, '5988.886'), (1, '5183.830')] [2023-12-26 01:16:13,838][123090] Updated weights for policy 1, policy_version 210409 (0.0010) [2023-12-26 01:16:13,897][123090] Updated weights for policy 1, policy_version 210419 (0.0010) [2023-12-26 01:16:13,951][123090] Updated weights for policy 1, policy_version 210429 (0.0009) [2023-12-26 01:16:14,211][123091] Updated weights for policy 0, policy_version 211256 (0.0008) [2023-12-26 01:16:14,263][123091] Updated weights for policy 0, policy_version 211266 (0.0009) [2023-12-26 01:16:14,316][123091] Updated weights for policy 0, policy_version 211276 (0.0009) [2023-12-26 01:16:14,806][123090] Updated weights for policy 1, policy_version 210439 (0.0009) [2023-12-26 01:16:14,877][123090] Updated weights for policy 1, policy_version 210449 (0.0009) [2023-12-26 01:16:14,938][123090] Updated weights for policy 1, policy_version 210459 (0.0009) [2023-12-26 01:16:15,114][123091] Updated weights for policy 0, policy_version 211286 (0.0009) [2023-12-26 01:16:15,164][123091] Updated weights for policy 0, policy_version 211296 (0.0009) [2023-12-26 01:16:15,213][123091] Updated weights for policy 0, policy_version 211306 (0.0009) [2023-12-26 01:16:15,744][123090] Updated weights for policy 1, policy_version 210469 (0.0007) [2023-12-26 01:16:15,795][123090] Updated weights for policy 1, policy_version 210479 (0.0005) [2023-12-26 01:16:15,854][123090] Updated weights for policy 1, policy_version 210489 (0.0007) [2023-12-26 01:16:16,067][123091] Updated weights for policy 0, policy_version 211316 (0.0008) [2023-12-26 01:16:16,113][123091] Updated weights for policy 0, policy_version 211326 (0.0006) [2023-12-26 01:16:16,167][123091] Updated weights for policy 0, policy_version 211336 (0.0005) [2023-12-26 01:16:16,715][123090] Updated weights for policy 1, policy_version 210499 (0.0008) [2023-12-26 01:16:16,776][123090] Updated weights for policy 1, policy_version 210509 (0.0009) [2023-12-26 01:16:16,839][123090] Updated weights for policy 1, policy_version 210519 (0.0009) [2023-12-26 01:16:16,927][123091] Updated weights for policy 0, policy_version 211346 (0.0009) [2023-12-26 01:16:16,995][123091] Updated weights for policy 0, policy_version 211356 (0.0011) [2023-12-26 01:16:17,051][123091] Updated weights for policy 0, policy_version 211366 (0.0006) [2023-12-26 01:16:17,123][123091] Updated weights for policy 0, policy_version 211376 (0.0006) [2023-12-26 01:16:17,699][123090] Updated weights for policy 1, policy_version 210529 (0.0009) [2023-12-26 01:16:17,761][123090] Updated weights for policy 1, policy_version 210540 (0.0009) [2023-12-26 01:16:17,817][123090] Updated weights for policy 1, policy_version 210550 (0.0010) [2023-12-26 01:16:17,853][123091] Updated weights for policy 0, policy_version 211386 (0.0006) [2023-12-26 01:16:17,868][123090] Updated weights for policy 1, policy_version 210560 (0.0008) [2023-12-26 01:16:17,902][123091] Updated weights for policy 0, policy_version 211396 (0.0007) [2023-12-26 01:16:17,968][123091] Updated weights for policy 0, policy_version 211406 (0.0010) [2023-12-26 01:16:18,755][123091] Updated weights for policy 0, policy_version 211416 (0.0009) [2023-12-26 01:16:18,777][123090] Updated weights for policy 1, policy_version 210570 (0.0008) [2023-12-26 01:16:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 108027904. Throughput: 0: 8846.6, 1: 8594.9. Samples: 108046240. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:18,785][121949] Avg episode reward: [(0, '5958.156'), (1, '5040.617')] [2023-12-26 01:16:18,812][123091] Updated weights for policy 0, policy_version 211426 (0.0007) [2023-12-26 01:16:18,839][123090] Updated weights for policy 1, policy_version 210580 (0.0010) [2023-12-26 01:16:18,866][123091] Updated weights for policy 0, policy_version 211436 (0.0006) [2023-12-26 01:16:18,897][123090] Updated weights for policy 1, policy_version 210590 (0.0009) [2023-12-26 01:16:19,686][123091] Updated weights for policy 0, policy_version 211446 (0.0008) [2023-12-26 01:16:19,745][123091] Updated weights for policy 0, policy_version 211456 (0.0008) [2023-12-26 01:16:19,752][123090] Updated weights for policy 1, policy_version 210600 (0.0009) [2023-12-26 01:16:19,806][123091] Updated weights for policy 0, policy_version 211466 (0.0009) [2023-12-26 01:16:19,817][123090] Updated weights for policy 1, policy_version 210610 (0.0009) [2023-12-26 01:16:19,881][123090] Updated weights for policy 1, policy_version 210620 (0.0009) [2023-12-26 01:16:20,627][123091] Updated weights for policy 0, policy_version 211476 (0.0009) [2023-12-26 01:16:20,680][123091] Updated weights for policy 0, policy_version 211486 (0.0010) [2023-12-26 01:16:20,742][123090] Updated weights for policy 1, policy_version 210630 (0.0009) [2023-12-26 01:16:20,749][123091] Updated weights for policy 0, policy_version 211496 (0.0009) [2023-12-26 01:16:20,804][123090] Updated weights for policy 1, policy_version 210640 (0.0010) [2023-12-26 01:16:20,865][123090] Updated weights for policy 1, policy_version 210650 (0.0009) [2023-12-26 01:16:21,609][123091] Updated weights for policy 0, policy_version 211506 (0.0007) [2023-12-26 01:16:21,675][123091] Updated weights for policy 0, policy_version 211516 (0.0009) [2023-12-26 01:16:21,725][123090] Updated weights for policy 1, policy_version 210660 (0.0009) [2023-12-26 01:16:21,740][123091] Updated weights for policy 0, policy_version 211526 (0.0010) [2023-12-26 01:16:21,789][123090] Updated weights for policy 1, policy_version 210670 (0.0008) [2023-12-26 01:16:21,805][123091] Updated weights for policy 0, policy_version 211536 (0.0008) [2023-12-26 01:16:21,854][123090] Updated weights for policy 1, policy_version 210680 (0.0010) [2023-12-26 01:16:22,628][123091] Updated weights for policy 0, policy_version 211546 (0.0010) [2023-12-26 01:16:22,677][123091] Updated weights for policy 0, policy_version 211556 (0.0008) [2023-12-26 01:16:22,722][123090] Updated weights for policy 1, policy_version 210690 (0.0009) [2023-12-26 01:16:22,729][123091] Updated weights for policy 0, policy_version 211566 (0.0008) [2023-12-26 01:16:22,786][123090] Updated weights for policy 1, policy_version 210700 (0.0010) [2023-12-26 01:16:22,845][123090] Updated weights for policy 1, policy_version 210710 (0.0009) [2023-12-26 01:16:22,910][123090] Updated weights for policy 1, policy_version 210720 (0.0010) [2023-12-26 01:16:23,566][123091] Updated weights for policy 0, policy_version 211576 (0.0009) [2023-12-26 01:16:23,619][123091] Updated weights for policy 0, policy_version 211587 (0.0010) [2023-12-26 01:16:23,671][123091] Updated weights for policy 0, policy_version 211598 (0.0010) [2023-12-26 01:16:23,750][123090] Updated weights for policy 1, policy_version 210730 (0.0005) [2023-12-26 01:16:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 108118016. Throughput: 0: 8832.9, 1: 8496.8. Samples: 108096284. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:23,785][121949] Avg episode reward: [(0, '5913.400'), (1, '5012.262')] [2023-12-26 01:16:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000211600_54173696.pth... [2023-12-26 01:16:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000210576_53911552.pth [2023-12-26 01:16:23,808][123090] Updated weights for policy 1, policy_version 210740 (0.0006) [2023-12-26 01:16:23,863][123090] Updated weights for policy 1, policy_version 210750 (0.0005) [2023-12-26 01:16:23,874][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000210752_53952512.pth... [2023-12-26 01:16:23,877][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000209760_53698560.pth [2023-12-26 01:16:24,554][123090] Updated weights for policy 1, policy_version 210760 (0.0005) [2023-12-26 01:16:24,616][123090] Updated weights for policy 1, policy_version 210770 (0.0008) [2023-12-26 01:16:24,617][123091] Updated weights for policy 0, policy_version 211608 (0.0008) [2023-12-26 01:16:24,682][123091] Updated weights for policy 0, policy_version 211618 (0.0008) [2023-12-26 01:16:24,684][123090] Updated weights for policy 1, policy_version 210780 (0.0008) [2023-12-26 01:16:24,740][123091] Updated weights for policy 0, policy_version 211628 (0.0009) [2023-12-26 01:16:25,406][123090] Updated weights for policy 1, policy_version 210790 (0.0007) [2023-12-26 01:16:25,468][123090] Updated weights for policy 1, policy_version 210800 (0.0005) [2023-12-26 01:16:25,529][123090] Updated weights for policy 1, policy_version 210810 (0.0009) [2023-12-26 01:16:25,609][123091] Updated weights for policy 0, policy_version 211638 (0.0009) [2023-12-26 01:16:25,663][123091] Updated weights for policy 0, policy_version 211650 (0.0011) [2023-12-26 01:16:25,721][123091] Updated weights for policy 0, policy_version 211661 (0.0010) [2023-12-26 01:16:26,249][123090] Updated weights for policy 1, policy_version 210820 (0.0009) [2023-12-26 01:16:26,311][123090] Updated weights for policy 1, policy_version 210830 (0.0008) [2023-12-26 01:16:26,380][123090] Updated weights for policy 1, policy_version 210840 (0.0007) [2023-12-26 01:16:26,578][123091] Updated weights for policy 0, policy_version 211671 (0.0007) [2023-12-26 01:16:26,627][123091] Updated weights for policy 0, policy_version 211681 (0.0005) [2023-12-26 01:16:26,677][123091] Updated weights for policy 0, policy_version 211691 (0.0005) [2023-12-26 01:16:27,102][123090] Updated weights for policy 1, policy_version 210850 (0.0008) [2023-12-26 01:16:27,157][123090] Updated weights for policy 1, policy_version 210860 (0.0009) [2023-12-26 01:16:27,209][123090] Updated weights for policy 1, policy_version 210870 (0.0009) [2023-12-26 01:16:27,268][123090] Updated weights for policy 1, policy_version 210880 (0.0009) [2023-12-26 01:16:27,276][123091] Updated weights for policy 0, policy_version 211701 (0.0005) [2023-12-26 01:16:27,333][123091] Updated weights for policy 0, policy_version 211711 (0.0006) [2023-12-26 01:16:27,395][123091] Updated weights for policy 0, policy_version 211721 (0.0006) [2023-12-26 01:16:28,129][123091] Updated weights for policy 0, policy_version 211731 (0.0007) [2023-12-26 01:16:28,157][123090] Updated weights for policy 1, policy_version 210890 (0.0006) [2023-12-26 01:16:28,189][123091] Updated weights for policy 0, policy_version 211741 (0.0011) [2023-12-26 01:16:28,226][123090] Updated weights for policy 1, policy_version 210900 (0.0006) [2023-12-26 01:16:28,245][123091] Updated weights for policy 0, policy_version 211751 (0.0011) [2023-12-26 01:16:28,287][123090] Updated weights for policy 1, policy_version 210910 (0.0006) [2023-12-26 01:16:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 108208128. Throughput: 0: 8818.0, 1: 8564.9. Samples: 108202844. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:28,785][121949] Avg episode reward: [(0, '5915.312'), (1, '5181.727')] [2023-12-26 01:16:28,925][123091] Updated weights for policy 0, policy_version 211761 (0.0010) [2023-12-26 01:16:28,982][123091] Updated weights for policy 0, policy_version 211771 (0.0005) [2023-12-26 01:16:29,044][123091] Updated weights for policy 0, policy_version 211781 (0.0006) [2023-12-26 01:16:29,082][123090] Updated weights for policy 1, policy_version 210920 (0.0009) [2023-12-26 01:16:29,101][123091] Updated weights for policy 0, policy_version 211791 (0.0007) [2023-12-26 01:16:29,141][123090] Updated weights for policy 1, policy_version 210930 (0.0006) [2023-12-26 01:16:29,198][123090] Updated weights for policy 1, policy_version 210940 (0.0009) [2023-12-26 01:16:29,868][123091] Updated weights for policy 0, policy_version 211801 (0.0009) [2023-12-26 01:16:29,928][123091] Updated weights for policy 0, policy_version 211811 (0.0009) [2023-12-26 01:16:29,982][123090] Updated weights for policy 1, policy_version 210950 (0.0010) [2023-12-26 01:16:29,986][123091] Updated weights for policy 0, policy_version 211821 (0.0009) [2023-12-26 01:16:30,045][123090] Updated weights for policy 1, policy_version 210960 (0.0009) [2023-12-26 01:16:30,112][123090] Updated weights for policy 1, policy_version 210970 (0.0009) [2023-12-26 01:16:30,775][123091] Updated weights for policy 0, policy_version 211831 (0.0010) [2023-12-26 01:16:30,826][123091] Updated weights for policy 0, policy_version 211841 (0.0009) [2023-12-26 01:16:30,887][123091] Updated weights for policy 0, policy_version 211851 (0.0009) [2023-12-26 01:16:30,906][123090] Updated weights for policy 1, policy_version 210980 (0.0008) [2023-12-26 01:16:30,978][123090] Updated weights for policy 1, policy_version 210990 (0.0006) [2023-12-26 01:16:31,033][123090] Updated weights for policy 1, policy_version 211000 (0.0009) [2023-12-26 01:16:31,775][123091] Updated weights for policy 0, policy_version 211862 (0.0009) [2023-12-26 01:16:31,833][123091] Updated weights for policy 0, policy_version 211872 (0.0009) [2023-12-26 01:16:31,838][123090] Updated weights for policy 1, policy_version 211010 (0.0008) [2023-12-26 01:16:31,896][123091] Updated weights for policy 0, policy_version 211882 (0.0009) [2023-12-26 01:16:31,899][123090] Updated weights for policy 1, policy_version 211020 (0.0008) [2023-12-26 01:16:31,954][123090] Updated weights for policy 1, policy_version 211030 (0.0008) [2023-12-26 01:16:32,007][123090] Updated weights for policy 1, policy_version 211040 (0.0008) [2023-12-26 01:16:32,755][123091] Updated weights for policy 0, policy_version 211892 (0.0009) [2023-12-26 01:16:32,770][123090] Updated weights for policy 1, policy_version 211050 (0.0006) [2023-12-26 01:16:32,817][123091] Updated weights for policy 0, policy_version 211902 (0.0009) [2023-12-26 01:16:32,833][123090] Updated weights for policy 1, policy_version 211060 (0.0007) [2023-12-26 01:16:32,866][123091] Updated weights for policy 0, policy_version 211912 (0.0008) [2023-12-26 01:16:32,894][123090] Updated weights for policy 1, policy_version 211070 (0.0008) [2023-12-26 01:16:33,593][123090] Updated weights for policy 1, policy_version 211080 (0.0005) [2023-12-26 01:16:33,663][123090] Updated weights for policy 1, policy_version 211090 (0.0005) [2023-12-26 01:16:33,710][123091] Updated weights for policy 0, policy_version 211922 (0.0009) [2023-12-26 01:16:33,734][123090] Updated weights for policy 1, policy_version 211100 (0.0005) [2023-12-26 01:16:33,772][123091] Updated weights for policy 0, policy_version 211932 (0.0010) [2023-12-26 01:16:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 108298240. Throughput: 0: 8785.6, 1: 8607.8. Samples: 108310120. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:33,785][121949] Avg episode reward: [(0, '5825.078'), (1, '5131.704')] [2023-12-26 01:16:33,834][123091] Updated weights for policy 0, policy_version 211942 (0.0010) [2023-12-26 01:16:33,896][123091] Updated weights for policy 0, policy_version 211952 (0.0010) [2023-12-26 01:16:34,365][123090] Updated weights for policy 1, policy_version 211110 (0.0008) [2023-12-26 01:16:34,416][123090] Updated weights for policy 1, policy_version 211120 (0.0010) [2023-12-26 01:16:34,486][123090] Updated weights for policy 1, policy_version 211130 (0.0010) [2023-12-26 01:16:34,737][123091] Updated weights for policy 0, policy_version 211962 (0.0009) [2023-12-26 01:16:34,802][123091] Updated weights for policy 0, policy_version 211972 (0.0008) [2023-12-26 01:16:34,854][123091] Updated weights for policy 0, policy_version 211982 (0.0009) [2023-12-26 01:16:35,304][123090] Updated weights for policy 1, policy_version 211140 (0.0008) [2023-12-26 01:16:35,366][123090] Updated weights for policy 1, policy_version 211150 (0.0010) [2023-12-26 01:16:35,433][123090] Updated weights for policy 1, policy_version 211160 (0.0010) [2023-12-26 01:16:35,613][123091] Updated weights for policy 0, policy_version 211992 (0.0006) [2023-12-26 01:16:35,660][123091] Updated weights for policy 0, policy_version 212002 (0.0005) [2023-12-26 01:16:35,706][123091] Updated weights for policy 0, policy_version 212012 (0.0005) [2023-12-26 01:16:36,054][123090] Updated weights for policy 1, policy_version 211170 (0.0010) [2023-12-26 01:16:36,121][123090] Updated weights for policy 1, policy_version 211180 (0.0006) [2023-12-26 01:16:36,195][123090] Updated weights for policy 1, policy_version 211190 (0.0006) [2023-12-26 01:16:36,264][123090] Updated weights for policy 1, policy_version 211200 (0.0005) [2023-12-26 01:16:36,485][123091] Updated weights for policy 0, policy_version 212022 (0.0009) [2023-12-26 01:16:36,553][123091] Updated weights for policy 0, policy_version 212032 (0.0011) [2023-12-26 01:16:36,618][123091] Updated weights for policy 0, policy_version 212042 (0.0010) [2023-12-26 01:16:36,951][123090] Updated weights for policy 1, policy_version 211210 (0.0009) [2023-12-26 01:16:37,001][123090] Updated weights for policy 1, policy_version 211220 (0.0009) [2023-12-26 01:16:37,061][123090] Updated weights for policy 1, policy_version 211230 (0.0008) [2023-12-26 01:16:37,368][123091] Updated weights for policy 0, policy_version 212052 (0.0008) [2023-12-26 01:16:37,426][123091] Updated weights for policy 0, policy_version 212062 (0.0006) [2023-12-26 01:16:37,493][123091] Updated weights for policy 0, policy_version 212072 (0.0007) [2023-12-26 01:16:37,961][123090] Updated weights for policy 1, policy_version 211240 (0.0010) [2023-12-26 01:16:38,015][123090] Updated weights for policy 1, policy_version 211250 (0.0010) [2023-12-26 01:16:38,068][123090] Updated weights for policy 1, policy_version 211260 (0.0009) [2023-12-26 01:16:38,108][123091] Updated weights for policy 0, policy_version 212082 (0.0006) [2023-12-26 01:16:38,172][123091] Updated weights for policy 0, policy_version 212092 (0.0011) [2023-12-26 01:16:38,231][123091] Updated weights for policy 0, policy_version 212102 (0.0009) [2023-12-26 01:16:38,296][123091] Updated weights for policy 0, policy_version 212112 (0.0009) [2023-12-26 01:16:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 108388352. Throughput: 0: 8781.0, 1: 8700.7. Samples: 108366300. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:38,785][121949] Avg episode reward: [(0, '5774.409'), (1, '5141.006')] [2023-12-26 01:16:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000212112_54304768.pth... [2023-12-26 01:16:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000211264_54083584.pth... [2023-12-26 01:16:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000211088_54042624.pth [2023-12-26 01:16:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000210240_53821440.pth [2023-12-26 01:16:38,927][123090] Updated weights for policy 1, policy_version 211270 (0.0008) [2023-12-26 01:16:38,979][123090] Updated weights for policy 1, policy_version 211280 (0.0008) [2023-12-26 01:16:39,032][123090] Updated weights for policy 1, policy_version 211290 (0.0009) [2023-12-26 01:16:39,090][123091] Updated weights for policy 0, policy_version 212122 (0.0010) [2023-12-26 01:16:39,159][123091] Updated weights for policy 0, policy_version 212132 (0.0010) [2023-12-26 01:16:39,232][123091] Updated weights for policy 0, policy_version 212142 (0.0010) [2023-12-26 01:16:39,909][123090] Updated weights for policy 1, policy_version 211300 (0.0008) [2023-12-26 01:16:39,976][123090] Updated weights for policy 1, policy_version 211310 (0.0007) [2023-12-26 01:16:40,039][123091] Updated weights for policy 0, policy_version 212152 (0.0010) [2023-12-26 01:16:40,046][123090] Updated weights for policy 1, policy_version 211320 (0.0008) [2023-12-26 01:16:40,098][123091] Updated weights for policy 0, policy_version 212162 (0.0011) [2023-12-26 01:16:40,160][123091] Updated weights for policy 0, policy_version 212172 (0.0007) [2023-12-26 01:16:40,781][123090] Updated weights for policy 1, policy_version 211330 (0.0006) [2023-12-26 01:16:40,845][123090] Updated weights for policy 1, policy_version 211340 (0.0005) [2023-12-26 01:16:40,901][123091] Updated weights for policy 0, policy_version 212182 (0.0006) [2023-12-26 01:16:40,907][123090] Updated weights for policy 1, policy_version 211350 (0.0009) [2023-12-26 01:16:40,963][123090] Updated weights for policy 1, policy_version 211360 (0.0009) [2023-12-26 01:16:40,964][123091] Updated weights for policy 0, policy_version 212192 (0.0006) [2023-12-26 01:16:41,010][123091] Updated weights for policy 0, policy_version 212202 (0.0006) [2023-12-26 01:16:41,816][123090] Updated weights for policy 1, policy_version 211370 (0.0006) [2023-12-26 01:16:41,844][123091] Updated weights for policy 0, policy_version 212212 (0.0010) [2023-12-26 01:16:41,877][123090] Updated weights for policy 1, policy_version 211380 (0.0006) [2023-12-26 01:16:41,909][123091] Updated weights for policy 0, policy_version 212222 (0.0009) [2023-12-26 01:16:41,942][123090] Updated weights for policy 1, policy_version 211390 (0.0008) [2023-12-26 01:16:41,975][123091] Updated weights for policy 0, policy_version 212232 (0.0009) [2023-12-26 01:16:42,767][123090] Updated weights for policy 1, policy_version 211400 (0.0008) [2023-12-26 01:16:42,813][123091] Updated weights for policy 0, policy_version 212242 (0.0009) [2023-12-26 01:16:42,819][123090] Updated weights for policy 1, policy_version 211410 (0.0009) [2023-12-26 01:16:42,873][123090] Updated weights for policy 1, policy_version 211420 (0.0008) [2023-12-26 01:16:42,875][123091] Updated weights for policy 0, policy_version 212252 (0.0008) [2023-12-26 01:16:42,940][123091] Updated weights for policy 0, policy_version 212262 (0.0009) [2023-12-26 01:16:43,001][123091] Updated weights for policy 0, policy_version 212272 (0.0009) [2023-12-26 01:16:43,701][123090] Updated weights for policy 1, policy_version 211430 (0.0006) [2023-12-26 01:16:43,763][123091] Updated weights for policy 0, policy_version 212282 (0.0008) [2023-12-26 01:16:43,770][123090] Updated weights for policy 1, policy_version 211440 (0.0006) [2023-12-26 01:16:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 108470272. Throughput: 0: 8738.2, 1: 8693.1. Samples: 108470948. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:43,785][121949] Avg episode reward: [(0, '5906.177'), (1, '5305.865')] [2023-12-26 01:16:43,819][123091] Updated weights for policy 0, policy_version 212292 (0.0008) [2023-12-26 01:16:43,846][123090] Updated weights for policy 1, policy_version 211450 (0.0007) [2023-12-26 01:16:43,874][123091] Updated weights for policy 0, policy_version 212302 (0.0005) [2023-12-26 01:16:44,439][123090] Updated weights for policy 1, policy_version 211460 (0.0006) [2023-12-26 01:16:44,497][123090] Updated weights for policy 1, policy_version 211470 (0.0007) [2023-12-26 01:16:44,547][123090] Updated weights for policy 1, policy_version 211480 (0.0009) [2023-12-26 01:16:44,669][123091] Updated weights for policy 0, policy_version 212312 (0.0005) [2023-12-26 01:16:44,725][123091] Updated weights for policy 0, policy_version 212322 (0.0005) [2023-12-26 01:16:44,783][123091] Updated weights for policy 0, policy_version 212332 (0.0007) [2023-12-26 01:16:45,354][123090] Updated weights for policy 1, policy_version 211490 (0.0005) [2023-12-26 01:16:45,411][123090] Updated weights for policy 1, policy_version 211500 (0.0008) [2023-12-26 01:16:45,466][123090] Updated weights for policy 1, policy_version 211510 (0.0009) [2023-12-26 01:16:45,489][123091] Updated weights for policy 0, policy_version 212342 (0.0009) [2023-12-26 01:16:45,530][123090] Updated weights for policy 1, policy_version 211520 (0.0009) [2023-12-26 01:16:45,544][123091] Updated weights for policy 0, policy_version 212352 (0.0007) [2023-12-26 01:16:45,599][123091] Updated weights for policy 0, policy_version 212362 (0.0009) [2023-12-26 01:16:46,363][123090] Updated weights for policy 1, policy_version 211530 (0.0010) [2023-12-26 01:16:46,398][123091] Updated weights for policy 0, policy_version 212373 (0.0009) [2023-12-26 01:16:46,415][123090] Updated weights for policy 1, policy_version 211540 (0.0006) [2023-12-26 01:16:46,448][123091] Updated weights for policy 0, policy_version 212383 (0.0008) [2023-12-26 01:16:46,465][123090] Updated weights for policy 1, policy_version 211550 (0.0005) [2023-12-26 01:16:46,498][123091] Updated weights for policy 0, policy_version 212393 (0.0009) [2023-12-26 01:16:47,223][123090] Updated weights for policy 1, policy_version 211560 (0.0009) [2023-12-26 01:16:47,289][123090] Updated weights for policy 1, policy_version 211570 (0.0010) [2023-12-26 01:16:47,355][123090] Updated weights for policy 1, policy_version 211580 (0.0009) [2023-12-26 01:16:47,395][123091] Updated weights for policy 0, policy_version 212403 (0.0010) [2023-12-26 01:16:47,466][123091] Updated weights for policy 0, policy_version 212413 (0.0010) [2023-12-26 01:16:47,518][123091] Updated weights for policy 0, policy_version 212423 (0.0010) [2023-12-26 01:16:48,116][123090] Updated weights for policy 1, policy_version 211590 (0.0008) [2023-12-26 01:16:48,164][123090] Updated weights for policy 1, policy_version 211600 (0.0010) [2023-12-26 01:16:48,225][123090] Updated weights for policy 1, policy_version 211610 (0.0010) [2023-12-26 01:16:48,336][123091] Updated weights for policy 0, policy_version 212433 (0.0009) [2023-12-26 01:16:48,406][123091] Updated weights for policy 0, policy_version 212443 (0.0008) [2023-12-26 01:16:48,478][123091] Updated weights for policy 0, policy_version 212453 (0.0007) [2023-12-26 01:16:48,528][123091] Updated weights for policy 0, policy_version 212463 (0.0006) [2023-12-26 01:16:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 108568576. Throughput: 0: 8809.7, 1: 8792.6. Samples: 108579484. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:48,785][121949] Avg episode reward: [(0, '5800.721'), (1, '5407.266')] [2023-12-26 01:16:48,963][123090] Updated weights for policy 1, policy_version 211620 (0.0008) [2023-12-26 01:16:49,030][123090] Updated weights for policy 1, policy_version 211630 (0.0010) [2023-12-26 01:16:49,075][123090] Updated weights for policy 1, policy_version 211640 (0.0009) [2023-12-26 01:16:49,403][123091] Updated weights for policy 0, policy_version 212473 (0.0009) [2023-12-26 01:16:49,477][123091] Updated weights for policy 0, policy_version 212483 (0.0006) [2023-12-26 01:16:49,547][123091] Updated weights for policy 0, policy_version 212493 (0.0008) [2023-12-26 01:16:49,865][123090] Updated weights for policy 1, policy_version 211650 (0.0006) [2023-12-26 01:16:49,933][123090] Updated weights for policy 1, policy_version 211660 (0.0009) [2023-12-26 01:16:50,003][123090] Updated weights for policy 1, policy_version 211670 (0.0005) [2023-12-26 01:16:50,065][123090] Updated weights for policy 1, policy_version 211680 (0.0006) [2023-12-26 01:16:50,244][123091] Updated weights for policy 0, policy_version 212503 (0.0006) [2023-12-26 01:16:50,321][123091] Updated weights for policy 0, policy_version 212513 (0.0006) [2023-12-26 01:16:50,391][123091] Updated weights for policy 0, policy_version 212523 (0.0007) [2023-12-26 01:16:50,761][123090] Updated weights for policy 1, policy_version 211690 (0.0005) [2023-12-26 01:16:50,839][123090] Updated weights for policy 1, policy_version 211700 (0.0005) [2023-12-26 01:16:50,912][123090] Updated weights for policy 1, policy_version 211710 (0.0006) [2023-12-26 01:16:51,159][123091] Updated weights for policy 0, policy_version 212533 (0.0009) [2023-12-26 01:16:51,211][123091] Updated weights for policy 0, policy_version 212543 (0.0008) [2023-12-26 01:16:51,282][123091] Updated weights for policy 0, policy_version 212553 (0.0008) [2023-12-26 01:16:51,651][123090] Updated weights for policy 1, policy_version 211720 (0.0008) [2023-12-26 01:16:51,708][123090] Updated weights for policy 1, policy_version 211730 (0.0010) [2023-12-26 01:16:51,780][123090] Updated weights for policy 1, policy_version 211740 (0.0009) [2023-12-26 01:16:51,986][123091] Updated weights for policy 0, policy_version 212563 (0.0007) [2023-12-26 01:16:52,047][123091] Updated weights for policy 0, policy_version 212573 (0.0006) [2023-12-26 01:16:52,118][123091] Updated weights for policy 0, policy_version 212583 (0.0008) [2023-12-26 01:16:52,508][123090] Updated weights for policy 1, policy_version 211750 (0.0007) [2023-12-26 01:16:52,556][123090] Updated weights for policy 1, policy_version 211760 (0.0009) [2023-12-26 01:16:52,612][123090] Updated weights for policy 1, policy_version 211770 (0.0008) [2023-12-26 01:16:52,868][123091] Updated weights for policy 0, policy_version 212593 (0.0007) [2023-12-26 01:16:52,915][123091] Updated weights for policy 0, policy_version 212603 (0.0010) [2023-12-26 01:16:52,964][123091] Updated weights for policy 0, policy_version 212613 (0.0010) [2023-12-26 01:16:53,023][123091] Updated weights for policy 0, policy_version 212623 (0.0011) [2023-12-26 01:16:53,472][123090] Updated weights for policy 1, policy_version 211780 (0.0009) [2023-12-26 01:16:53,520][123090] Updated weights for policy 1, policy_version 211790 (0.0008) [2023-12-26 01:16:53,580][123090] Updated weights for policy 1, policy_version 211800 (0.0009) [2023-12-26 01:16:53,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 108658688. Throughput: 0: 8810.7, 1: 8866.2. Samples: 108634628. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:53,785][121949] Avg episode reward: [(0, '5592.208'), (1, '5542.249')] [2023-12-26 01:16:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000212624_54435840.pth... [2023-12-26 01:16:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000211808_54222848.pth... [2023-12-26 01:16:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000211600_54173696.pth [2023-12-26 01:16:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000210752_53952512.pth [2023-12-26 01:16:53,862][123091] Updated weights for policy 0, policy_version 212633 (0.0010) [2023-12-26 01:16:53,909][123091] Updated weights for policy 0, policy_version 212643 (0.0010) [2023-12-26 01:16:53,960][123091] Updated weights for policy 0, policy_version 212653 (0.0010) [2023-12-26 01:16:54,420][123090] Updated weights for policy 1, policy_version 211810 (0.0009) [2023-12-26 01:16:54,484][123090] Updated weights for policy 1, policy_version 211820 (0.0009) [2023-12-26 01:16:54,536][123090] Updated weights for policy 1, policy_version 211830 (0.0008) [2023-12-26 01:16:54,598][123090] Updated weights for policy 1, policy_version 211840 (0.0009) [2023-12-26 01:16:54,801][123091] Updated weights for policy 0, policy_version 212663 (0.0011) [2023-12-26 01:16:54,845][123091] Updated weights for policy 0, policy_version 212673 (0.0010) [2023-12-26 01:16:54,892][123091] Updated weights for policy 0, policy_version 212683 (0.0010) [2023-12-26 01:16:55,460][123090] Updated weights for policy 1, policy_version 211850 (0.0010) [2023-12-26 01:16:55,513][123090] Updated weights for policy 1, policy_version 211860 (0.0010) [2023-12-26 01:16:55,571][123090] Updated weights for policy 1, policy_version 211870 (0.0010) [2023-12-26 01:16:55,656][123091] Updated weights for policy 0, policy_version 212693 (0.0008) [2023-12-26 01:16:55,721][123091] Updated weights for policy 0, policy_version 212703 (0.0010) [2023-12-26 01:16:55,786][123091] Updated weights for policy 0, policy_version 212713 (0.0010) [2023-12-26 01:16:56,438][123090] Updated weights for policy 1, policy_version 211880 (0.0008) [2023-12-26 01:16:56,491][123090] Updated weights for policy 1, policy_version 211890 (0.0009) [2023-12-26 01:16:56,551][123090] Updated weights for policy 1, policy_version 211900 (0.0005) [2023-12-26 01:16:56,555][123091] Updated weights for policy 0, policy_version 212723 (0.0009) [2023-12-26 01:16:56,620][123091] Updated weights for policy 0, policy_version 212733 (0.0005) [2023-12-26 01:16:56,681][123091] Updated weights for policy 0, policy_version 212743 (0.0005) [2023-12-26 01:16:57,139][123090] Updated weights for policy 1, policy_version 211910 (0.0005) [2023-12-26 01:16:57,185][123090] Updated weights for policy 1, policy_version 211920 (0.0005) [2023-12-26 01:16:57,252][123090] Updated weights for policy 1, policy_version 211930 (0.0008) [2023-12-26 01:16:57,326][123091] Updated weights for policy 0, policy_version 212753 (0.0006) [2023-12-26 01:16:57,388][123091] Updated weights for policy 0, policy_version 212763 (0.0010) [2023-12-26 01:16:57,443][123091] Updated weights for policy 0, policy_version 212773 (0.0010) [2023-12-26 01:16:57,510][123091] Updated weights for policy 0, policy_version 212783 (0.0008) [2023-12-26 01:16:57,919][123090] Updated weights for policy 1, policy_version 211940 (0.0005) [2023-12-26 01:16:57,979][123090] Updated weights for policy 1, policy_version 211950 (0.0007) [2023-12-26 01:16:58,045][123090] Updated weights for policy 1, policy_version 211960 (0.0008) [2023-12-26 01:16:58,309][123091] Updated weights for policy 0, policy_version 212793 (0.0006) [2023-12-26 01:16:58,377][123091] Updated weights for policy 0, policy_version 212803 (0.0009) [2023-12-26 01:16:58,451][123091] Updated weights for policy 0, policy_version 212813 (0.0006) [2023-12-26 01:16:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 108748800. Throughput: 0: 8922.2, 1: 8885.4. Samples: 108743060. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:16:58,785][121949] Avg episode reward: [(0, '5790.766'), (1, '5562.060')] [2023-12-26 01:16:58,873][123090] Updated weights for policy 1, policy_version 211970 (0.0008) [2023-12-26 01:16:58,941][123090] Updated weights for policy 1, policy_version 211980 (0.0006) [2023-12-26 01:16:59,016][123090] Updated weights for policy 1, policy_version 211990 (0.0007) [2023-12-26 01:16:59,077][123090] Updated weights for policy 1, policy_version 212000 (0.0010) [2023-12-26 01:16:59,330][123091] Updated weights for policy 0, policy_version 212823 (0.0007) [2023-12-26 01:16:59,402][123091] Updated weights for policy 0, policy_version 212833 (0.0008) [2023-12-26 01:16:59,472][123091] Updated weights for policy 0, policy_version 212843 (0.0007) [2023-12-26 01:16:59,850][123090] Updated weights for policy 1, policy_version 212010 (0.0010) [2023-12-26 01:16:59,913][123090] Updated weights for policy 1, policy_version 212020 (0.0010) [2023-12-26 01:16:59,984][123090] Updated weights for policy 1, policy_version 212030 (0.0010) [2023-12-26 01:17:00,192][123091] Updated weights for policy 0, policy_version 212853 (0.0008) [2023-12-26 01:17:00,241][123091] Updated weights for policy 0, policy_version 212863 (0.0009) [2023-12-26 01:17:00,304][123091] Updated weights for policy 0, policy_version 212873 (0.0010) [2023-12-26 01:17:00,778][123090] Updated weights for policy 1, policy_version 212040 (0.0010) [2023-12-26 01:17:00,829][123090] Updated weights for policy 1, policy_version 212050 (0.0008) [2023-12-26 01:17:00,887][123090] Updated weights for policy 1, policy_version 212060 (0.0010) [2023-12-26 01:17:01,110][123091] Updated weights for policy 0, policy_version 212883 (0.0010) [2023-12-26 01:17:01,165][123091] Updated weights for policy 0, policy_version 212893 (0.0010) [2023-12-26 01:17:01,230][123091] Updated weights for policy 0, policy_version 212903 (0.0010) [2023-12-26 01:17:01,764][123090] Updated weights for policy 1, policy_version 212071 (0.0010) [2023-12-26 01:17:01,827][123090] Updated weights for policy 1, policy_version 212081 (0.0009) [2023-12-26 01:17:01,884][123090] Updated weights for policy 1, policy_version 212091 (0.0010) [2023-12-26 01:17:02,123][123091] Updated weights for policy 0, policy_version 212913 (0.0011) [2023-12-26 01:17:02,180][123091] Updated weights for policy 0, policy_version 212923 (0.0010) [2023-12-26 01:17:02,245][123091] Updated weights for policy 0, policy_version 212933 (0.0009) [2023-12-26 01:17:02,307][123091] Updated weights for policy 0, policy_version 212943 (0.0010) [2023-12-26 01:17:02,695][123090] Updated weights for policy 1, policy_version 212101 (0.0009) [2023-12-26 01:17:02,745][123090] Updated weights for policy 1, policy_version 212111 (0.0010) [2023-12-26 01:17:02,797][123090] Updated weights for policy 1, policy_version 212122 (0.0010) [2023-12-26 01:17:03,137][123091] Updated weights for policy 0, policy_version 212953 (0.0005) [2023-12-26 01:17:03,181][123091] Updated weights for policy 0, policy_version 212963 (0.0005) [2023-12-26 01:17:03,240][123091] Updated weights for policy 0, policy_version 212973 (0.0005) [2023-12-26 01:17:03,685][123090] Updated weights for policy 1, policy_version 212132 (0.0009) [2023-12-26 01:17:03,749][123090] Updated weights for policy 1, policy_version 212142 (0.0009) [2023-12-26 01:17:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 108830720. Throughput: 0: 8881.6, 1: 8933.7. Samples: 108847928. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:17:03,785][121949] Avg episode reward: [(0, '5986.216'), (1, '5624.194')] [2023-12-26 01:17:03,816][123090] Updated weights for policy 1, policy_version 212152 (0.0009) [2023-12-26 01:17:03,898][123091] Updated weights for policy 0, policy_version 212984 (0.0007) [2023-12-26 01:17:03,958][123091] Updated weights for policy 0, policy_version 212994 (0.0006) [2023-12-26 01:17:04,016][123091] Updated weights for policy 0, policy_version 213004 (0.0008) [2023-12-26 01:17:04,607][123090] Updated weights for policy 1, policy_version 212162 (0.0008) [2023-12-26 01:17:04,678][123090] Updated weights for policy 1, policy_version 212172 (0.0010) [2023-12-26 01:17:04,737][123090] Updated weights for policy 1, policy_version 212182 (0.0010) [2023-12-26 01:17:04,790][123090] Updated weights for policy 1, policy_version 212192 (0.0008) [2023-12-26 01:17:04,795][123091] Updated weights for policy 0, policy_version 213014 (0.0007) [2023-12-26 01:17:04,866][123091] Updated weights for policy 0, policy_version 213024 (0.0009) [2023-12-26 01:17:04,928][123091] Updated weights for policy 0, policy_version 213034 (0.0006) [2023-12-26 01:17:05,481][123090] Updated weights for policy 1, policy_version 212202 (0.0010) [2023-12-26 01:17:05,534][123090] Updated weights for policy 1, policy_version 212212 (0.0010) [2023-12-26 01:17:05,590][123091] Updated weights for policy 0, policy_version 213044 (0.0007) [2023-12-26 01:17:05,590][123090] Updated weights for policy 1, policy_version 212222 (0.0009) [2023-12-26 01:17:05,646][123091] Updated weights for policy 0, policy_version 213054 (0.0007) [2023-12-26 01:17:05,694][123091] Updated weights for policy 0, policy_version 213064 (0.0005) [2023-12-26 01:17:06,328][123090] Updated weights for policy 1, policy_version 212232 (0.0007) [2023-12-26 01:17:06,394][123090] Updated weights for policy 1, policy_version 212242 (0.0009) [2023-12-26 01:17:06,420][123091] Updated weights for policy 0, policy_version 213074 (0.0006) [2023-12-26 01:17:06,454][123090] Updated weights for policy 1, policy_version 212252 (0.0010) [2023-12-26 01:17:06,487][123091] Updated weights for policy 0, policy_version 213084 (0.0007) [2023-12-26 01:17:06,550][123091] Updated weights for policy 0, policy_version 213094 (0.0005) [2023-12-26 01:17:06,606][123091] Updated weights for policy 0, policy_version 213104 (0.0005) [2023-12-26 01:17:07,252][123090] Updated weights for policy 1, policy_version 212262 (0.0009) [2023-12-26 01:17:07,322][123090] Updated weights for policy 1, policy_version 212272 (0.0008) [2023-12-26 01:17:07,349][123091] Updated weights for policy 0, policy_version 213114 (0.0011) [2023-12-26 01:17:07,386][123090] Updated weights for policy 1, policy_version 212282 (0.0008) [2023-12-26 01:17:07,412][123091] Updated weights for policy 0, policy_version 213124 (0.0011) [2023-12-26 01:17:07,468][123091] Updated weights for policy 0, policy_version 213134 (0.0011) [2023-12-26 01:17:08,210][123090] Updated weights for policy 1, policy_version 212292 (0.0007) [2023-12-26 01:17:08,258][123091] Updated weights for policy 0, policy_version 213144 (0.0006) [2023-12-26 01:17:08,280][123090] Updated weights for policy 1, policy_version 212302 (0.0005) [2023-12-26 01:17:08,319][123091] Updated weights for policy 0, policy_version 213154 (0.0007) [2023-12-26 01:17:08,349][123090] Updated weights for policy 1, policy_version 212312 (0.0008) [2023-12-26 01:17:08,386][123091] Updated weights for policy 0, policy_version 213164 (0.0007) [2023-12-26 01:17:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 108929024. Throughput: 0: 8958.4, 1: 8996.0. Samples: 108904232. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:17:08,785][121949] Avg episode reward: [(0, '5953.365'), (1, '5685.417')] [2023-12-26 01:17:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000212320_54353920.pth... [2023-12-26 01:17:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000213168_54575104.pth... [2023-12-26 01:17:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000211264_54083584.pth [2023-12-26 01:17:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000212112_54304768.pth [2023-12-26 01:17:09,069][123090] Updated weights for policy 1, policy_version 212322 (0.0007) [2023-12-26 01:17:09,071][123091] Updated weights for policy 0, policy_version 213174 (0.0007) [2023-12-26 01:17:09,133][123090] Updated weights for policy 1, policy_version 212332 (0.0008) [2023-12-26 01:17:09,139][123091] Updated weights for policy 0, policy_version 213184 (0.0005) [2023-12-26 01:17:09,201][123090] Updated weights for policy 1, policy_version 212342 (0.0009) [2023-12-26 01:17:09,205][123091] Updated weights for policy 0, policy_version 213194 (0.0006) [2023-12-26 01:17:09,267][123090] Updated weights for policy 1, policy_version 212352 (0.0009) [2023-12-26 01:17:10,045][123091] Updated weights for policy 0, policy_version 213204 (0.0010) [2023-12-26 01:17:10,115][123091] Updated weights for policy 0, policy_version 213214 (0.0008) [2023-12-26 01:17:10,144][123090] Updated weights for policy 1, policy_version 212362 (0.0009) [2023-12-26 01:17:10,177][123091] Updated weights for policy 0, policy_version 213224 (0.0006) [2023-12-26 01:17:10,210][123090] Updated weights for policy 1, policy_version 212372 (0.0010) [2023-12-26 01:17:10,288][123090] Updated weights for policy 1, policy_version 212382 (0.0009) [2023-12-26 01:17:10,968][123091] Updated weights for policy 0, policy_version 213234 (0.0006) [2023-12-26 01:17:11,042][123091] Updated weights for policy 0, policy_version 213244 (0.0008) [2023-12-26 01:17:11,087][123090] Updated weights for policy 1, policy_version 212392 (0.0007) [2023-12-26 01:17:11,110][123091] Updated weights for policy 0, policy_version 213254 (0.0007) [2023-12-26 01:17:11,156][123090] Updated weights for policy 1, policy_version 212402 (0.0008) [2023-12-26 01:17:11,183][123091] Updated weights for policy 0, policy_version 213264 (0.0009) [2023-12-26 01:17:11,228][123090] Updated weights for policy 1, policy_version 212412 (0.0008) [2023-12-26 01:17:11,950][123091] Updated weights for policy 0, policy_version 213274 (0.0007) [2023-12-26 01:17:12,016][123091] Updated weights for policy 0, policy_version 213284 (0.0008) [2023-12-26 01:17:12,056][123090] Updated weights for policy 1, policy_version 212422 (0.0008) [2023-12-26 01:17:12,087][123091] Updated weights for policy 0, policy_version 213294 (0.0008) [2023-12-26 01:17:12,122][123090] Updated weights for policy 1, policy_version 212432 (0.0007) [2023-12-26 01:17:12,180][123090] Updated weights for policy 1, policy_version 212442 (0.0010) [2023-12-26 01:17:12,822][123091] Updated weights for policy 0, policy_version 213304 (0.0007) [2023-12-26 01:17:12,884][123091] Updated weights for policy 0, policy_version 213314 (0.0005) [2023-12-26 01:17:12,938][123091] Updated weights for policy 0, policy_version 213324 (0.0007) [2023-12-26 01:17:13,060][123090] Updated weights for policy 1, policy_version 212452 (0.0010) [2023-12-26 01:17:13,123][123090] Updated weights for policy 1, policy_version 212462 (0.0010) [2023-12-26 01:17:13,190][123090] Updated weights for policy 1, policy_version 212472 (0.0010) [2023-12-26 01:17:13,599][123091] Updated weights for policy 0, policy_version 213334 (0.0007) [2023-12-26 01:17:13,659][123091] Updated weights for policy 0, policy_version 213344 (0.0005) [2023-12-26 01:17:13,716][123091] Updated weights for policy 0, policy_version 213355 (0.0006) [2023-12-26 01:17:13,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 109019136. Throughput: 0: 9006.0, 1: 8926.2. Samples: 109009796. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:17:13,785][121949] Avg episode reward: [(0, '5951.303'), (1, '5557.055')] [2023-12-26 01:17:14,035][123090] Updated weights for policy 1, policy_version 212482 (0.0010) [2023-12-26 01:17:14,088][123090] Updated weights for policy 1, policy_version 212493 (0.0010) [2023-12-26 01:17:14,151][123090] Updated weights for policy 1, policy_version 212503 (0.0011) [2023-12-26 01:17:14,315][123091] Updated weights for policy 0, policy_version 213365 (0.0006) [2023-12-26 01:17:14,382][123091] Updated weights for policy 0, policy_version 213375 (0.0006) [2023-12-26 01:17:14,447][123091] Updated weights for policy 0, policy_version 213385 (0.0009) [2023-12-26 01:17:14,976][123090] Updated weights for policy 1, policy_version 212513 (0.0009) [2023-12-26 01:17:15,042][123090] Updated weights for policy 1, policy_version 212523 (0.0009) [2023-12-26 01:17:15,094][123090] Updated weights for policy 1, policy_version 212533 (0.0010) [2023-12-26 01:17:15,151][123090] Updated weights for policy 1, policy_version 212543 (0.0009) [2023-12-26 01:17:15,286][123091] Updated weights for policy 0, policy_version 213395 (0.0007) [2023-12-26 01:17:15,349][123091] Updated weights for policy 0, policy_version 213405 (0.0009) [2023-12-26 01:17:15,415][123091] Updated weights for policy 0, policy_version 213415 (0.0005) [2023-12-26 01:17:16,051][123090] Updated weights for policy 1, policy_version 212553 (0.0006) [2023-12-26 01:17:16,119][123090] Updated weights for policy 1, policy_version 212563 (0.0006) [2023-12-26 01:17:16,165][123091] Updated weights for policy 0, policy_version 213425 (0.0005) [2023-12-26 01:17:16,178][123090] Updated weights for policy 1, policy_version 212573 (0.0008) [2023-12-26 01:17:16,222][123091] Updated weights for policy 0, policy_version 213435 (0.0010) [2023-12-26 01:17:16,272][123091] Updated weights for policy 0, policy_version 213445 (0.0010) [2023-12-26 01:17:16,321][123091] Updated weights for policy 0, policy_version 213456 (0.0009) [2023-12-26 01:17:16,997][123090] Updated weights for policy 1, policy_version 212583 (0.0009) [2023-12-26 01:17:17,061][123090] Updated weights for policy 1, policy_version 212593 (0.0009) [2023-12-26 01:17:17,090][123091] Updated weights for policy 0, policy_version 213466 (0.0010) [2023-12-26 01:17:17,107][123090] Updated weights for policy 1, policy_version 212603 (0.0006) [2023-12-26 01:17:17,159][123091] Updated weights for policy 0, policy_version 213476 (0.0009) [2023-12-26 01:17:17,225][123091] Updated weights for policy 0, policy_version 213486 (0.0010) [2023-12-26 01:17:17,944][123090] Updated weights for policy 1, policy_version 212613 (0.0008) [2023-12-26 01:17:17,972][123091] Updated weights for policy 0, policy_version 213496 (0.0007) [2023-12-26 01:17:17,998][123090] Updated weights for policy 1, policy_version 212623 (0.0008) [2023-12-26 01:17:18,038][123091] Updated weights for policy 0, policy_version 213506 (0.0009) [2023-12-26 01:17:18,063][123090] Updated weights for policy 1, policy_version 212633 (0.0010) [2023-12-26 01:17:18,097][123091] Updated weights for policy 0, policy_version 213516 (0.0011) [2023-12-26 01:17:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 109101056. Throughput: 0: 9097.1, 1: 8848.3. Samples: 109117668. Policy #0 lag: (min: 31.0, avg: 45.9, max: 63.0) [2023-12-26 01:17:18,785][121949] Avg episode reward: [(0, '5984.913'), (1, '5529.187')] [2023-12-26 01:17:18,789][123091] Updated weights for policy 0, policy_version 213526 (0.0007) [2023-12-26 01:17:18,845][123091] Updated weights for policy 0, policy_version 213536 (0.0009) [2023-12-26 01:17:18,904][123090] Updated weights for policy 1, policy_version 212643 (0.0009) [2023-12-26 01:17:18,910][123091] Updated weights for policy 0, policy_version 213546 (0.0009) [2023-12-26 01:17:18,962][123090] Updated weights for policy 1, policy_version 212653 (0.0005) [2023-12-26 01:17:19,012][123090] Updated weights for policy 1, policy_version 212663 (0.0007) [2023-12-26 01:17:19,742][123091] Updated weights for policy 0, policy_version 213556 (0.0009) [2023-12-26 01:17:19,801][123091] Updated weights for policy 0, policy_version 213566 (0.0011) [2023-12-26 01:17:19,860][123090] Updated weights for policy 1, policy_version 212673 (0.0009) [2023-12-26 01:17:19,871][123091] Updated weights for policy 0, policy_version 213576 (0.0010) [2023-12-26 01:17:19,921][123090] Updated weights for policy 1, policy_version 212683 (0.0007) [2023-12-26 01:17:19,992][123090] Updated weights for policy 1, policy_version 212693 (0.0009) [2023-12-26 01:17:20,046][123090] Updated weights for policy 1, policy_version 212703 (0.0009) [2023-12-26 01:17:20,692][123091] Updated weights for policy 0, policy_version 213586 (0.0011) [2023-12-26 01:17:20,761][123091] Updated weights for policy 0, policy_version 213596 (0.0010) [2023-12-26 01:17:20,826][123091] Updated weights for policy 0, policy_version 213606 (0.0010) [2023-12-26 01:17:20,895][123091] Updated weights for policy 0, policy_version 213616 (0.0010) [2023-12-26 01:17:20,907][123090] Updated weights for policy 1, policy_version 212713 (0.0009) [2023-12-26 01:17:20,979][123090] Updated weights for policy 1, policy_version 212723 (0.0006) [2023-12-26 01:17:21,064][123090] Updated weights for policy 1, policy_version 212733 (0.0009) [2023-12-26 01:17:21,708][123091] Updated weights for policy 0, policy_version 213626 (0.0010) [2023-12-26 01:17:21,776][123091] Updated weights for policy 0, policy_version 213636 (0.0010) [2023-12-26 01:17:21,839][123091] Updated weights for policy 0, policy_version 213646 (0.0010) [2023-12-26 01:17:21,924][123090] Updated weights for policy 1, policy_version 212743 (0.0009) [2023-12-26 01:17:21,994][123090] Updated weights for policy 1, policy_version 212753 (0.0008) [2023-12-26 01:17:22,068][123090] Updated weights for policy 1, policy_version 212763 (0.0007) [2023-12-26 01:17:22,716][123091] Updated weights for policy 0, policy_version 213656 (0.0011) [2023-12-26 01:17:22,783][123091] Updated weights for policy 0, policy_version 213666 (0.0011) [2023-12-26 01:17:22,836][123090] Updated weights for policy 1, policy_version 212773 (0.0007) [2023-12-26 01:17:22,857][123091] Updated weights for policy 0, policy_version 213676 (0.0006) [2023-12-26 01:17:22,896][123090] Updated weights for policy 1, policy_version 212783 (0.0009) [2023-12-26 01:17:22,959][123090] Updated weights for policy 1, policy_version 212793 (0.0009) [2023-12-26 01:17:23,605][123091] Updated weights for policy 0, policy_version 213686 (0.0009) [2023-12-26 01:17:23,662][123091] Updated weights for policy 0, policy_version 213696 (0.0010) [2023-12-26 01:17:23,712][123091] Updated weights for policy 0, policy_version 213706 (0.0009) [2023-12-26 01:17:23,771][123090] Updated weights for policy 1, policy_version 212803 (0.0009) [2023-12-26 01:17:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 109191168. Throughput: 0: 9064.6, 1: 8743.5. Samples: 109167660. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:23,784][121949] Avg episode reward: [(0, '5958.398'), (1, '5633.930')] [2023-12-26 01:17:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000213712_54714368.pth... [2023-12-26 01:17:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000212624_54435840.pth [2023-12-26 01:17:23,844][123090] Updated weights for policy 1, policy_version 212813 (0.0010) [2023-12-26 01:17:23,898][123090] Updated weights for policy 1, policy_version 212823 (0.0010) [2023-12-26 01:17:23,958][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000212832_54484992.pth... [2023-12-26 01:17:23,962][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000211808_54222848.pth [2023-12-26 01:17:24,497][123091] Updated weights for policy 0, policy_version 213716 (0.0007) [2023-12-26 01:17:24,544][123091] Updated weights for policy 0, policy_version 213726 (0.0005) [2023-12-26 01:17:24,604][123091] Updated weights for policy 0, policy_version 213736 (0.0006) [2023-12-26 01:17:24,689][123090] Updated weights for policy 1, policy_version 212833 (0.0010) [2023-12-26 01:17:24,739][123090] Updated weights for policy 1, policy_version 212843 (0.0005) [2023-12-26 01:17:24,784][123090] Updated weights for policy 1, policy_version 212853 (0.0005) [2023-12-26 01:17:24,829][123090] Updated weights for policy 1, policy_version 212863 (0.0005) [2023-12-26 01:17:25,333][123091] Updated weights for policy 0, policy_version 213746 (0.0009) [2023-12-26 01:17:25,382][123091] Updated weights for policy 0, policy_version 213756 (0.0006) [2023-12-26 01:17:25,428][123091] Updated weights for policy 0, policy_version 213766 (0.0005) [2023-12-26 01:17:25,480][123091] Updated weights for policy 0, policy_version 213776 (0.0005) [2023-12-26 01:17:25,533][123090] Updated weights for policy 1, policy_version 212873 (0.0010) [2023-12-26 01:17:25,588][123090] Updated weights for policy 1, policy_version 212883 (0.0010) [2023-12-26 01:17:25,653][123090] Updated weights for policy 1, policy_version 212893 (0.0007) [2023-12-26 01:17:26,165][123091] Updated weights for policy 0, policy_version 213786 (0.0005) [2023-12-26 01:17:26,223][123091] Updated weights for policy 0, policy_version 213796 (0.0005) [2023-12-26 01:17:26,277][123091] Updated weights for policy 0, policy_version 213806 (0.0005) [2023-12-26 01:17:26,352][123090] Updated weights for policy 1, policy_version 212903 (0.0008) [2023-12-26 01:17:26,410][123090] Updated weights for policy 1, policy_version 212913 (0.0006) [2023-12-26 01:17:26,473][123090] Updated weights for policy 1, policy_version 212923 (0.0008) [2023-12-26 01:17:26,967][123091] Updated weights for policy 0, policy_version 213816 (0.0005) [2023-12-26 01:17:27,015][123091] Updated weights for policy 0, policy_version 213826 (0.0005) [2023-12-26 01:17:27,065][123091] Updated weights for policy 0, policy_version 213836 (0.0005) [2023-12-26 01:17:27,245][123090] Updated weights for policy 1, policy_version 212933 (0.0009) [2023-12-26 01:17:27,296][123090] Updated weights for policy 1, policy_version 212943 (0.0009) [2023-12-26 01:17:27,346][123090] Updated weights for policy 1, policy_version 212953 (0.0009) [2023-12-26 01:17:27,828][123091] Updated weights for policy 0, policy_version 213846 (0.0005) [2023-12-26 01:17:27,885][123091] Updated weights for policy 0, policy_version 213856 (0.0005) [2023-12-26 01:17:27,932][123091] Updated weights for policy 0, policy_version 213866 (0.0005) [2023-12-26 01:17:28,133][123090] Updated weights for policy 1, policy_version 212963 (0.0009) [2023-12-26 01:17:28,184][123090] Updated weights for policy 1, policy_version 212973 (0.0009) [2023-12-26 01:17:28,242][123090] Updated weights for policy 1, policy_version 212983 (0.0009) [2023-12-26 01:17:28,625][123091] Updated weights for policy 0, policy_version 213876 (0.0006) [2023-12-26 01:17:28,697][123091] Updated weights for policy 0, policy_version 213886 (0.0006) [2023-12-26 01:17:28,765][123091] Updated weights for policy 0, policy_version 213896 (0.0007) [2023-12-26 01:17:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 109281280. Throughput: 0: 9111.9, 1: 8828.0. Samples: 109278244. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:28,785][121949] Avg episode reward: [(0, '5861.781'), (1, '5518.196')] [2023-12-26 01:17:29,138][123090] Updated weights for policy 1, policy_version 212993 (0.0009) [2023-12-26 01:17:29,206][123090] Updated weights for policy 1, policy_version 213003 (0.0010) [2023-12-26 01:17:29,268][123090] Updated weights for policy 1, policy_version 213013 (0.0008) [2023-12-26 01:17:29,346][123090] Updated weights for policy 1, policy_version 213023 (0.0008) [2023-12-26 01:17:29,462][123091] Updated weights for policy 0, policy_version 213906 (0.0007) [2023-12-26 01:17:29,514][123091] Updated weights for policy 0, policy_version 213917 (0.0007) [2023-12-26 01:17:29,562][123091] Updated weights for policy 0, policy_version 213927 (0.0009) [2023-12-26 01:17:30,171][123090] Updated weights for policy 1, policy_version 213033 (0.0009) [2023-12-26 01:17:30,235][123090] Updated weights for policy 1, policy_version 213043 (0.0009) [2023-12-26 01:17:30,302][123090] Updated weights for policy 1, policy_version 213053 (0.0010) [2023-12-26 01:17:30,406][123091] Updated weights for policy 0, policy_version 213937 (0.0009) [2023-12-26 01:17:30,463][123091] Updated weights for policy 0, policy_version 213947 (0.0010) [2023-12-26 01:17:30,510][123091] Updated weights for policy 0, policy_version 213957 (0.0007) [2023-12-26 01:17:30,561][123091] Updated weights for policy 0, policy_version 213967 (0.0005) [2023-12-26 01:17:31,173][123090] Updated weights for policy 1, policy_version 213063 (0.0008) [2023-12-26 01:17:31,237][123090] Updated weights for policy 1, policy_version 213073 (0.0009) [2023-12-26 01:17:31,291][123091] Updated weights for policy 0, policy_version 213977 (0.0008) [2023-12-26 01:17:31,303][123090] Updated weights for policy 1, policy_version 213083 (0.0010) [2023-12-26 01:17:31,358][123091] Updated weights for policy 0, policy_version 213987 (0.0009) [2023-12-26 01:17:31,416][123091] Updated weights for policy 0, policy_version 213997 (0.0009) [2023-12-26 01:17:32,114][123090] Updated weights for policy 1, policy_version 213093 (0.0008) [2023-12-26 01:17:32,165][123090] Updated weights for policy 1, policy_version 213103 (0.0006) [2023-12-26 01:17:32,220][123090] Updated weights for policy 1, policy_version 213113 (0.0006) [2023-12-26 01:17:32,299][123091] Updated weights for policy 0, policy_version 214008 (0.0010) [2023-12-26 01:17:32,377][123091] Updated weights for policy 0, policy_version 214018 (0.0009) [2023-12-26 01:17:32,435][123091] Updated weights for policy 0, policy_version 214028 (0.0010) [2023-12-26 01:17:32,907][123090] Updated weights for policy 1, policy_version 213123 (0.0007) [2023-12-26 01:17:32,955][123090] Updated weights for policy 1, policy_version 213133 (0.0005) [2023-12-26 01:17:33,001][123090] Updated weights for policy 1, policy_version 213143 (0.0005) [2023-12-26 01:17:33,344][123091] Updated weights for policy 0, policy_version 214038 (0.0010) [2023-12-26 01:17:33,398][123091] Updated weights for policy 0, policy_version 214048 (0.0010) [2023-12-26 01:17:33,456][123091] Updated weights for policy 0, policy_version 214058 (0.0010) [2023-12-26 01:17:33,736][123090] Updated weights for policy 1, policy_version 213153 (0.0009) [2023-12-26 01:17:33,782][123090] Updated weights for policy 1, policy_version 213163 (0.0005) [2023-12-26 01:17:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 109371392. Throughput: 0: 9109.8, 1: 8775.3. Samples: 109384316. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:33,785][121949] Avg episode reward: [(0, '5796.553'), (1, '5454.536')] [2023-12-26 01:17:33,830][123090] Updated weights for policy 1, policy_version 213173 (0.0005) [2023-12-26 01:17:33,877][123090] Updated weights for policy 1, policy_version 213183 (0.0005) [2023-12-26 01:17:34,370][123091] Updated weights for policy 0, policy_version 214068 (0.0009) [2023-12-26 01:17:34,432][123091] Updated weights for policy 0, policy_version 214078 (0.0009) [2023-12-26 01:17:34,497][123091] Updated weights for policy 0, policy_version 214088 (0.0011) [2023-12-26 01:17:34,558][123090] Updated weights for policy 1, policy_version 213193 (0.0010) [2023-12-26 01:17:34,622][123090] Updated weights for policy 1, policy_version 213203 (0.0011) [2023-12-26 01:17:34,689][123090] Updated weights for policy 1, policy_version 213213 (0.0011) [2023-12-26 01:17:35,220][123091] Updated weights for policy 0, policy_version 214098 (0.0011) [2023-12-26 01:17:35,278][123091] Updated weights for policy 0, policy_version 214108 (0.0010) [2023-12-26 01:17:35,343][123091] Updated weights for policy 0, policy_version 214118 (0.0010) [2023-12-26 01:17:35,405][123091] Updated weights for policy 0, policy_version 214128 (0.0010) [2023-12-26 01:17:35,478][123090] Updated weights for policy 1, policy_version 213223 (0.0010) [2023-12-26 01:17:35,525][123090] Updated weights for policy 1, policy_version 213233 (0.0007) [2023-12-26 01:17:35,592][123090] Updated weights for policy 1, policy_version 213243 (0.0010) [2023-12-26 01:17:36,123][123091] Updated weights for policy 0, policy_version 214138 (0.0007) [2023-12-26 01:17:36,199][123091] Updated weights for policy 0, policy_version 214149 (0.0007) [2023-12-26 01:17:36,273][123091] Updated weights for policy 0, policy_version 214159 (0.0007) [2023-12-26 01:17:36,317][123090] Updated weights for policy 1, policy_version 213253 (0.0010) [2023-12-26 01:17:36,374][123090] Updated weights for policy 1, policy_version 213263 (0.0009) [2023-12-26 01:17:36,437][123090] Updated weights for policy 1, policy_version 213273 (0.0009) [2023-12-26 01:17:37,042][123091] Updated weights for policy 0, policy_version 214169 (0.0009) [2023-12-26 01:17:37,095][123091] Updated weights for policy 0, policy_version 214179 (0.0008) [2023-12-26 01:17:37,155][123091] Updated weights for policy 0, policy_version 214189 (0.0009) [2023-12-26 01:17:37,291][123090] Updated weights for policy 1, policy_version 213283 (0.0009) [2023-12-26 01:17:37,343][123090] Updated weights for policy 1, policy_version 213293 (0.0010) [2023-12-26 01:17:37,395][123090] Updated weights for policy 1, policy_version 213303 (0.0010) [2023-12-26 01:17:38,005][123091] Updated weights for policy 0, policy_version 214199 (0.0010) [2023-12-26 01:17:38,063][123091] Updated weights for policy 0, policy_version 214209 (0.0010) [2023-12-26 01:17:38,116][123091] Updated weights for policy 0, policy_version 214219 (0.0009) [2023-12-26 01:17:38,232][123090] Updated weights for policy 1, policy_version 213313 (0.0010) [2023-12-26 01:17:38,290][123090] Updated weights for policy 1, policy_version 213323 (0.0010) [2023-12-26 01:17:38,356][123090] Updated weights for policy 1, policy_version 213333 (0.0008) [2023-12-26 01:17:38,422][123090] Updated weights for policy 1, policy_version 213343 (0.0008) [2023-12-26 01:17:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 109461504. Throughput: 0: 9120.0, 1: 8758.1. Samples: 109439140. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:38,785][121949] Avg episode reward: [(0, '5782.413'), (1, '5480.547')] [2023-12-26 01:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000213344_54616064.pth... [2023-12-26 01:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000214224_54845440.pth... [2023-12-26 01:17:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000212320_54353920.pth [2023-12-26 01:17:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000213168_54575104.pth [2023-12-26 01:17:38,897][123091] Updated weights for policy 0, policy_version 214229 (0.0008) [2023-12-26 01:17:38,964][123091] Updated weights for policy 0, policy_version 214239 (0.0005) [2023-12-26 01:17:39,032][123091] Updated weights for policy 0, policy_version 214249 (0.0006) [2023-12-26 01:17:39,220][123090] Updated weights for policy 1, policy_version 213353 (0.0006) [2023-12-26 01:17:39,292][123090] Updated weights for policy 1, policy_version 213363 (0.0007) [2023-12-26 01:17:39,350][123090] Updated weights for policy 1, policy_version 213373 (0.0007) [2023-12-26 01:17:39,888][123091] Updated weights for policy 0, policy_version 214259 (0.0009) [2023-12-26 01:17:39,951][123091] Updated weights for policy 0, policy_version 214269 (0.0009) [2023-12-26 01:17:40,020][123091] Updated weights for policy 0, policy_version 214279 (0.0008) [2023-12-26 01:17:40,071][123090] Updated weights for policy 1, policy_version 213383 (0.0010) [2023-12-26 01:17:40,132][123090] Updated weights for policy 1, policy_version 213393 (0.0010) [2023-12-26 01:17:40,201][123090] Updated weights for policy 1, policy_version 213403 (0.0009) [2023-12-26 01:17:40,731][123091] Updated weights for policy 0, policy_version 214289 (0.0010) [2023-12-26 01:17:40,786][123091] Updated weights for policy 0, policy_version 214299 (0.0008) [2023-12-26 01:17:40,850][123091] Updated weights for policy 0, policy_version 214309 (0.0009) [2023-12-26 01:17:40,921][123091] Updated weights for policy 0, policy_version 214319 (0.0008) [2023-12-26 01:17:41,020][123090] Updated weights for policy 1, policy_version 213413 (0.0010) [2023-12-26 01:17:41,092][123090] Updated weights for policy 1, policy_version 213423 (0.0009) [2023-12-26 01:17:41,166][123090] Updated weights for policy 1, policy_version 213433 (0.0010) [2023-12-26 01:17:41,775][123091] Updated weights for policy 0, policy_version 214329 (0.0009) [2023-12-26 01:17:41,847][123091] Updated weights for policy 0, policy_version 214339 (0.0010) [2023-12-26 01:17:41,906][123091] Updated weights for policy 0, policy_version 214349 (0.0010) [2023-12-26 01:17:41,944][123090] Updated weights for policy 1, policy_version 213443 (0.0007) [2023-12-26 01:17:42,000][123090] Updated weights for policy 1, policy_version 213453 (0.0006) [2023-12-26 01:17:42,066][123090] Updated weights for policy 1, policy_version 213463 (0.0006) [2023-12-26 01:17:42,762][123091] Updated weights for policy 0, policy_version 214360 (0.0009) [2023-12-26 01:17:42,814][123091] Updated weights for policy 0, policy_version 214370 (0.0009) [2023-12-26 01:17:42,869][123091] Updated weights for policy 0, policy_version 214380 (0.0009) [2023-12-26 01:17:42,887][123090] Updated weights for policy 1, policy_version 213473 (0.0008) [2023-12-26 01:17:42,952][123090] Updated weights for policy 1, policy_version 213483 (0.0009) [2023-12-26 01:17:43,012][123090] Updated weights for policy 1, policy_version 213493 (0.0008) [2023-12-26 01:17:43,069][123090] Updated weights for policy 1, policy_version 213503 (0.0010) [2023-12-26 01:17:43,713][123091] Updated weights for policy 0, policy_version 214390 (0.0009) [2023-12-26 01:17:43,778][123091] Updated weights for policy 0, policy_version 214400 (0.0009) [2023-12-26 01:17:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 109543424. Throughput: 0: 9030.5, 1: 8745.3. Samples: 109542972. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:43,785][121949] Avg episode reward: [(0, '5658.875'), (1, '5490.730')] [2023-12-26 01:17:43,845][123091] Updated weights for policy 0, policy_version 214410 (0.0009) [2023-12-26 01:17:43,915][123090] Updated weights for policy 1, policy_version 213513 (0.0010) [2023-12-26 01:17:43,983][123090] Updated weights for policy 1, policy_version 213523 (0.0009) [2023-12-26 01:17:44,045][123090] Updated weights for policy 1, policy_version 213533 (0.0010) [2023-12-26 01:17:44,644][123091] Updated weights for policy 0, policy_version 214420 (0.0009) [2023-12-26 01:17:44,697][123091] Updated weights for policy 0, policy_version 214430 (0.0006) [2023-12-26 01:17:44,755][123091] Updated weights for policy 0, policy_version 214440 (0.0006) [2023-12-26 01:17:44,851][123090] Updated weights for policy 1, policy_version 213543 (0.0010) [2023-12-26 01:17:44,904][123090] Updated weights for policy 1, policy_version 213553 (0.0010) [2023-12-26 01:17:44,957][123090] Updated weights for policy 1, policy_version 213563 (0.0010) [2023-12-26 01:17:45,523][123091] Updated weights for policy 0, policy_version 214450 (0.0007) [2023-12-26 01:17:45,580][123091] Updated weights for policy 0, policy_version 214461 (0.0010) [2023-12-26 01:17:45,629][123091] Updated weights for policy 0, policy_version 214471 (0.0009) [2023-12-26 01:17:45,817][123090] Updated weights for policy 1, policy_version 213573 (0.0007) [2023-12-26 01:17:45,872][123090] Updated weights for policy 1, policy_version 213583 (0.0005) [2023-12-26 01:17:45,928][123090] Updated weights for policy 1, policy_version 213593 (0.0005) [2023-12-26 01:17:46,502][123091] Updated weights for policy 0, policy_version 214481 (0.0009) [2023-12-26 01:17:46,555][123091] Updated weights for policy 0, policy_version 214491 (0.0009) [2023-12-26 01:17:46,612][123091] Updated weights for policy 0, policy_version 214501 (0.0009) [2023-12-26 01:17:46,663][123091] Updated weights for policy 0, policy_version 214511 (0.0009) [2023-12-26 01:17:46,677][123090] Updated weights for policy 1, policy_version 213603 (0.0007) [2023-12-26 01:17:46,726][123090] Updated weights for policy 1, policy_version 213613 (0.0009) [2023-12-26 01:17:46,775][123090] Updated weights for policy 1, policy_version 213623 (0.0009) [2023-12-26 01:17:47,508][123091] Updated weights for policy 0, policy_version 214521 (0.0010) [2023-12-26 01:17:47,562][123091] Updated weights for policy 0, policy_version 214531 (0.0009) [2023-12-26 01:17:47,623][123091] Updated weights for policy 0, policy_version 214541 (0.0010) [2023-12-26 01:17:47,634][123090] Updated weights for policy 1, policy_version 213633 (0.0009) [2023-12-26 01:17:47,690][123090] Updated weights for policy 1, policy_version 213643 (0.0009) [2023-12-26 01:17:47,753][123090] Updated weights for policy 1, policy_version 213653 (0.0009) [2023-12-26 01:17:47,817][123090] Updated weights for policy 1, policy_version 213663 (0.0010) [2023-12-26 01:17:48,433][123091] Updated weights for policy 0, policy_version 214551 (0.0010) [2023-12-26 01:17:48,502][123091] Updated weights for policy 0, policy_version 214561 (0.0010) [2023-12-26 01:17:48,565][123091] Updated weights for policy 0, policy_version 214571 (0.0009) [2023-12-26 01:17:48,671][123090] Updated weights for policy 1, policy_version 213673 (0.0009) [2023-12-26 01:17:48,735][123090] Updated weights for policy 1, policy_version 213683 (0.0010) [2023-12-26 01:17:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 109633536. Throughput: 0: 9004.4, 1: 8741.0. Samples: 109646472. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:48,785][121949] Avg episode reward: [(0, '5859.440'), (1, '5503.120')] [2023-12-26 01:17:48,790][123090] Updated weights for policy 1, policy_version 213693 (0.0009) [2023-12-26 01:17:49,405][123091] Updated weights for policy 0, policy_version 214581 (0.0010) [2023-12-26 01:17:49,473][123091] Updated weights for policy 0, policy_version 214591 (0.0009) [2023-12-26 01:17:49,539][123091] Updated weights for policy 0, policy_version 214601 (0.0009) [2023-12-26 01:17:49,623][123090] Updated weights for policy 1, policy_version 213703 (0.0006) [2023-12-26 01:17:49,686][123090] Updated weights for policy 1, policy_version 213713 (0.0006) [2023-12-26 01:17:49,745][123090] Updated weights for policy 1, policy_version 213723 (0.0005) [2023-12-26 01:17:50,404][123091] Updated weights for policy 0, policy_version 214611 (0.0009) [2023-12-26 01:17:50,457][123091] Updated weights for policy 0, policy_version 214621 (0.0009) [2023-12-26 01:17:50,517][123091] Updated weights for policy 0, policy_version 214631 (0.0009) [2023-12-26 01:17:50,524][123090] Updated weights for policy 1, policy_version 213733 (0.0008) [2023-12-26 01:17:50,585][123090] Updated weights for policy 1, policy_version 213743 (0.0009) [2023-12-26 01:17:50,648][123090] Updated weights for policy 1, policy_version 213753 (0.0009) [2023-12-26 01:17:51,375][123091] Updated weights for policy 0, policy_version 214641 (0.0008) [2023-12-26 01:17:51,430][123091] Updated weights for policy 0, policy_version 214651 (0.0010) [2023-12-26 01:17:51,488][123091] Updated weights for policy 0, policy_version 214661 (0.0009) [2023-12-26 01:17:51,510][123090] Updated weights for policy 1, policy_version 213763 (0.0009) [2023-12-26 01:17:51,546][123091] Updated weights for policy 0, policy_version 214671 (0.0008) [2023-12-26 01:17:51,562][123090] Updated weights for policy 1, policy_version 213773 (0.0009) [2023-12-26 01:17:51,620][123090] Updated weights for policy 1, policy_version 213783 (0.0010) [2023-12-26 01:17:52,292][123091] Updated weights for policy 0, policy_version 214681 (0.0009) [2023-12-26 01:17:52,350][123091] Updated weights for policy 0, policy_version 214691 (0.0009) [2023-12-26 01:17:52,411][123091] Updated weights for policy 0, policy_version 214701 (0.0009) [2023-12-26 01:17:52,525][123090] Updated weights for policy 1, policy_version 213793 (0.0010) [2023-12-26 01:17:52,596][123090] Updated weights for policy 1, policy_version 213803 (0.0010) [2023-12-26 01:17:52,664][123090] Updated weights for policy 1, policy_version 213813 (0.0009) [2023-12-26 01:17:52,728][123090] Updated weights for policy 1, policy_version 213823 (0.0010) [2023-12-26 01:17:53,180][123091] Updated weights for policy 0, policy_version 214711 (0.0006) [2023-12-26 01:17:53,242][123091] Updated weights for policy 0, policy_version 214721 (0.0006) [2023-12-26 01:17:53,306][123091] Updated weights for policy 0, policy_version 214731 (0.0005) [2023-12-26 01:17:53,554][123090] Updated weights for policy 1, policy_version 213833 (0.0009) [2023-12-26 01:17:53,609][123090] Updated weights for policy 1, policy_version 213843 (0.0008) [2023-12-26 01:17:53,659][123090] Updated weights for policy 1, policy_version 213853 (0.0009) [2023-12-26 01:17:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 109723648. Throughput: 0: 8920.1, 1: 8697.4. Samples: 109697024. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:53,785][121949] Avg episode reward: [(0, '5880.871'), (1, '5401.670')] [2023-12-26 01:17:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000214736_54976512.pth... [2023-12-26 01:17:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000213856_54747136.pth... [2023-12-26 01:17:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000213712_54714368.pth [2023-12-26 01:17:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000212832_54484992.pth [2023-12-26 01:17:53,908][123091] Updated weights for policy 0, policy_version 214741 (0.0005) [2023-12-26 01:17:53,971][123091] Updated weights for policy 0, policy_version 214751 (0.0005) [2023-12-26 01:17:54,034][123091] Updated weights for policy 0, policy_version 214761 (0.0006) [2023-12-26 01:17:54,424][123090] Updated weights for policy 1, policy_version 213863 (0.0007) [2023-12-26 01:17:54,493][123090] Updated weights for policy 1, policy_version 213873 (0.0005) [2023-12-26 01:17:54,565][123090] Updated weights for policy 1, policy_version 213883 (0.0005) [2023-12-26 01:17:54,791][123091] Updated weights for policy 0, policy_version 214771 (0.0007) [2023-12-26 01:17:54,839][123091] Updated weights for policy 0, policy_version 214781 (0.0010) [2023-12-26 01:17:54,883][123091] Updated weights for policy 0, policy_version 214791 (0.0010) [2023-12-26 01:17:55,213][123090] Updated weights for policy 1, policy_version 213893 (0.0005) [2023-12-26 01:17:55,263][123090] Updated weights for policy 1, policy_version 213903 (0.0005) [2023-12-26 01:17:55,314][123090] Updated weights for policy 1, policy_version 213913 (0.0005) [2023-12-26 01:17:55,627][123091] Updated weights for policy 0, policy_version 214801 (0.0010) [2023-12-26 01:17:55,678][123091] Updated weights for policy 0, policy_version 214811 (0.0006) [2023-12-26 01:17:55,726][123091] Updated weights for policy 0, policy_version 214821 (0.0005) [2023-12-26 01:17:55,779][123091] Updated weights for policy 0, policy_version 214831 (0.0005) [2023-12-26 01:17:55,966][123090] Updated weights for policy 1, policy_version 213923 (0.0005) [2023-12-26 01:17:56,034][123090] Updated weights for policy 1, policy_version 213933 (0.0005) [2023-12-26 01:17:56,084][123090] Updated weights for policy 1, policy_version 213943 (0.0006) [2023-12-26 01:17:56,488][123091] Updated weights for policy 0, policy_version 214841 (0.0006) [2023-12-26 01:17:56,541][123091] Updated weights for policy 0, policy_version 214851 (0.0005) [2023-12-26 01:17:56,601][123091] Updated weights for policy 0, policy_version 214861 (0.0007) [2023-12-26 01:17:56,688][123090] Updated weights for policy 1, policy_version 213953 (0.0007) [2023-12-26 01:17:56,755][123090] Updated weights for policy 1, policy_version 213963 (0.0005) [2023-12-26 01:17:56,801][123090] Updated weights for policy 1, policy_version 213973 (0.0005) [2023-12-26 01:17:56,844][123090] Updated weights for policy 1, policy_version 213983 (0.0005) [2023-12-26 01:17:57,426][123091] Updated weights for policy 0, policy_version 214871 (0.0006) [2023-12-26 01:17:57,486][123091] Updated weights for policy 0, policy_version 214881 (0.0005) [2023-12-26 01:17:57,496][123090] Updated weights for policy 1, policy_version 213993 (0.0005) [2023-12-26 01:17:57,534][123091] Updated weights for policy 0, policy_version 214891 (0.0006) [2023-12-26 01:17:57,542][123090] Updated weights for policy 1, policy_version 214003 (0.0005) [2023-12-26 01:17:57,598][123090] Updated weights for policy 1, policy_version 214013 (0.0008) [2023-12-26 01:17:58,305][123091] Updated weights for policy 0, policy_version 214901 (0.0009) [2023-12-26 01:17:58,378][123091] Updated weights for policy 0, policy_version 214911 (0.0011) [2023-12-26 01:17:58,453][123091] Updated weights for policy 0, policy_version 214921 (0.0010) [2023-12-26 01:17:58,479][123090] Updated weights for policy 1, policy_version 214023 (0.0009) [2023-12-26 01:17:58,559][123090] Updated weights for policy 1, policy_version 214033 (0.0007) [2023-12-26 01:17:58,642][123090] Updated weights for policy 1, policy_version 214043 (0.0007) [2023-12-26 01:17:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 109821952. Throughput: 0: 8982.8, 1: 8842.1. Samples: 109811912. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:17:58,784][121949] Avg episode reward: [(0, '5894.741'), (1, '5448.979')] [2023-12-26 01:17:59,315][123091] Updated weights for policy 0, policy_version 214931 (0.0011) [2023-12-26 01:17:59,370][123090] Updated weights for policy 1, policy_version 214053 (0.0009) [2023-12-26 01:17:59,379][123091] Updated weights for policy 0, policy_version 214941 (0.0011) [2023-12-26 01:17:59,432][123090] Updated weights for policy 1, policy_version 214063 (0.0010) [2023-12-26 01:17:59,446][123091] Updated weights for policy 0, policy_version 214951 (0.0011) [2023-12-26 01:17:59,485][123090] Updated weights for policy 1, policy_version 214073 (0.0007) [2023-12-26 01:18:00,252][123091] Updated weights for policy 0, policy_version 214961 (0.0011) [2023-12-26 01:18:00,280][123090] Updated weights for policy 1, policy_version 214083 (0.0007) [2023-12-26 01:18:00,303][123091] Updated weights for policy 0, policy_version 214971 (0.0010) [2023-12-26 01:18:00,341][123090] Updated weights for policy 1, policy_version 214093 (0.0006) [2023-12-26 01:18:00,366][123091] Updated weights for policy 0, policy_version 214981 (0.0011) [2023-12-26 01:18:00,405][123090] Updated weights for policy 1, policy_version 214103 (0.0005) [2023-12-26 01:18:00,425][123091] Updated weights for policy 0, policy_version 214991 (0.0010) [2023-12-26 01:18:01,073][123090] Updated weights for policy 1, policy_version 214113 (0.0006) [2023-12-26 01:18:01,138][123090] Updated weights for policy 1, policy_version 214123 (0.0008) [2023-12-26 01:18:01,209][123090] Updated weights for policy 1, policy_version 214133 (0.0006) [2023-12-26 01:18:01,280][123090] Updated weights for policy 1, policy_version 214143 (0.0006) [2023-12-26 01:18:01,283][123091] Updated weights for policy 0, policy_version 215001 (0.0010) [2023-12-26 01:18:01,350][123091] Updated weights for policy 0, policy_version 215011 (0.0011) [2023-12-26 01:18:01,415][123091] Updated weights for policy 0, policy_version 215021 (0.0010) [2023-12-26 01:18:02,020][123090] Updated weights for policy 1, policy_version 214153 (0.0010) [2023-12-26 01:18:02,086][123090] Updated weights for policy 1, policy_version 214163 (0.0010) [2023-12-26 01:18:02,148][123090] Updated weights for policy 1, policy_version 214173 (0.0010) [2023-12-26 01:18:02,235][123091] Updated weights for policy 0, policy_version 215031 (0.0010) [2023-12-26 01:18:02,297][123091] Updated weights for policy 0, policy_version 215041 (0.0008) [2023-12-26 01:18:02,369][123091] Updated weights for policy 0, policy_version 215051 (0.0007) [2023-12-26 01:18:02,898][123090] Updated weights for policy 1, policy_version 214183 (0.0010) [2023-12-26 01:18:02,948][123090] Updated weights for policy 1, policy_version 214193 (0.0010) [2023-12-26 01:18:02,992][123090] Updated weights for policy 1, policy_version 214203 (0.0010) [2023-12-26 01:18:03,120][123091] Updated weights for policy 0, policy_version 215061 (0.0006) [2023-12-26 01:18:03,188][123091] Updated weights for policy 0, policy_version 215071 (0.0009) [2023-12-26 01:18:03,254][123091] Updated weights for policy 0, policy_version 215081 (0.0011) [2023-12-26 01:18:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 109903872. Throughput: 0: 8871.4, 1: 8929.2. Samples: 109918692. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:03,785][121949] Avg episode reward: [(0, '5858.581'), (1, '5408.350')] [2023-12-26 01:18:03,844][123090] Updated weights for policy 1, policy_version 214213 (0.0010) [2023-12-26 01:18:03,914][123090] Updated weights for policy 1, policy_version 214223 (0.0011) [2023-12-26 01:18:03,985][123090] Updated weights for policy 1, policy_version 214233 (0.0011) [2023-12-26 01:18:03,999][123091] Updated weights for policy 0, policy_version 215091 (0.0006) [2023-12-26 01:18:04,052][123091] Updated weights for policy 0, policy_version 215101 (0.0007) [2023-12-26 01:18:04,116][123091] Updated weights for policy 0, policy_version 215111 (0.0011) [2023-12-26 01:18:04,754][123090] Updated weights for policy 1, policy_version 214243 (0.0009) [2023-12-26 01:18:04,823][123090] Updated weights for policy 1, policy_version 214253 (0.0006) [2023-12-26 01:18:04,863][123091] Updated weights for policy 0, policy_version 215121 (0.0010) [2023-12-26 01:18:04,898][123090] Updated weights for policy 1, policy_version 214263 (0.0006) [2023-12-26 01:18:04,928][123091] Updated weights for policy 0, policy_version 215131 (0.0008) [2023-12-26 01:18:04,987][123091] Updated weights for policy 0, policy_version 215141 (0.0010) [2023-12-26 01:18:05,043][123091] Updated weights for policy 0, policy_version 215151 (0.0011) [2023-12-26 01:18:05,542][123090] Updated weights for policy 1, policy_version 214273 (0.0005) [2023-12-26 01:18:05,591][123090] Updated weights for policy 1, policy_version 214283 (0.0006) [2023-12-26 01:18:05,638][123090] Updated weights for policy 1, policy_version 214293 (0.0005) [2023-12-26 01:18:05,683][123090] Updated weights for policy 1, policy_version 214303 (0.0007) [2023-12-26 01:18:05,842][123091] Updated weights for policy 0, policy_version 215161 (0.0009) [2023-12-26 01:18:05,905][123091] Updated weights for policy 0, policy_version 215171 (0.0005) [2023-12-26 01:18:05,962][123091] Updated weights for policy 0, policy_version 215181 (0.0006) [2023-12-26 01:18:06,418][123090] Updated weights for policy 1, policy_version 214313 (0.0010) [2023-12-26 01:18:06,470][123090] Updated weights for policy 1, policy_version 214323 (0.0010) [2023-12-26 01:18:06,534][123090] Updated weights for policy 1, policy_version 214333 (0.0008) [2023-12-26 01:18:06,698][123091] Updated weights for policy 0, policy_version 215191 (0.0008) [2023-12-26 01:18:06,762][123091] Updated weights for policy 0, policy_version 215201 (0.0006) [2023-12-26 01:18:06,819][123091] Updated weights for policy 0, policy_version 215211 (0.0008) [2023-12-26 01:18:07,353][123090] Updated weights for policy 1, policy_version 214343 (0.0009) [2023-12-26 01:18:07,423][123090] Updated weights for policy 1, policy_version 214353 (0.0011) [2023-12-26 01:18:07,486][123090] Updated weights for policy 1, policy_version 214363 (0.0007) [2023-12-26 01:18:07,489][123091] Updated weights for policy 0, policy_version 215221 (0.0006) [2023-12-26 01:18:07,543][123091] Updated weights for policy 0, policy_version 215231 (0.0005) [2023-12-26 01:18:07,591][123091] Updated weights for policy 0, policy_version 215241 (0.0005) [2023-12-26 01:18:08,230][123090] Updated weights for policy 1, policy_version 214373 (0.0005) [2023-12-26 01:18:08,265][123091] Updated weights for policy 0, policy_version 215251 (0.0005) [2023-12-26 01:18:08,281][123090] Updated weights for policy 1, policy_version 214383 (0.0005) [2023-12-26 01:18:08,316][123091] Updated weights for policy 0, policy_version 215261 (0.0005) [2023-12-26 01:18:08,342][123090] Updated weights for policy 1, policy_version 214393 (0.0006) [2023-12-26 01:18:08,383][123091] Updated weights for policy 0, policy_version 215271 (0.0008) [2023-12-26 01:18:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 110002176. Throughput: 0: 8911.4, 1: 9024.3. Samples: 109974772. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:08,785][121949] Avg episode reward: [(0, '5839.120'), (1, '5446.341')] [2023-12-26 01:18:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000215280_55115776.pth... [2023-12-26 01:18:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000214400_54886400.pth... [2023-12-26 01:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000213344_54616064.pth [2023-12-26 01:18:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000214224_54845440.pth [2023-12-26 01:18:09,110][123090] Updated weights for policy 1, policy_version 214403 (0.0008) [2023-12-26 01:18:09,151][123091] Updated weights for policy 0, policy_version 215281 (0.0008) [2023-12-26 01:18:09,165][123090] Updated weights for policy 1, policy_version 214413 (0.0010) [2023-12-26 01:18:09,210][123091] Updated weights for policy 0, policy_version 215291 (0.0011) [2023-12-26 01:18:09,220][123090] Updated weights for policy 1, policy_version 214423 (0.0010) [2023-12-26 01:18:09,277][123091] Updated weights for policy 0, policy_version 215301 (0.0011) [2023-12-26 01:18:09,341][123091] Updated weights for policy 0, policy_version 215311 (0.0011) [2023-12-26 01:18:10,076][123090] Updated weights for policy 1, policy_version 214433 (0.0009) [2023-12-26 01:18:10,145][123090] Updated weights for policy 1, policy_version 214443 (0.0009) [2023-12-26 01:18:10,204][123090] Updated weights for policy 1, policy_version 214453 (0.0009) [2023-12-26 01:18:10,218][123091] Updated weights for policy 0, policy_version 215321 (0.0009) [2023-12-26 01:18:10,261][123090] Updated weights for policy 1, policy_version 214463 (0.0006) [2023-12-26 01:18:10,276][123091] Updated weights for policy 0, policy_version 215331 (0.0009) [2023-12-26 01:18:10,342][123091] Updated weights for policy 0, policy_version 215341 (0.0010) [2023-12-26 01:18:11,038][123090] Updated weights for policy 1, policy_version 214473 (0.0010) [2023-12-26 01:18:11,100][123090] Updated weights for policy 1, policy_version 214483 (0.0009) [2023-12-26 01:18:11,172][123090] Updated weights for policy 1, policy_version 214493 (0.0008) [2023-12-26 01:18:11,238][123091] Updated weights for policy 0, policy_version 215351 (0.0010) [2023-12-26 01:18:11,305][123091] Updated weights for policy 0, policy_version 215361 (0.0009) [2023-12-26 01:18:11,374][123091] Updated weights for policy 0, policy_version 215371 (0.0009) [2023-12-26 01:18:12,052][123090] Updated weights for policy 1, policy_version 214503 (0.0009) [2023-12-26 01:18:12,120][123090] Updated weights for policy 1, policy_version 214513 (0.0008) [2023-12-26 01:18:12,187][123091] Updated weights for policy 0, policy_version 215381 (0.0010) [2023-12-26 01:18:12,188][123090] Updated weights for policy 1, policy_version 214523 (0.0010) [2023-12-26 01:18:12,255][123091] Updated weights for policy 0, policy_version 215391 (0.0011) [2023-12-26 01:18:12,319][123091] Updated weights for policy 0, policy_version 215401 (0.0011) [2023-12-26 01:18:12,977][123090] Updated weights for policy 1, policy_version 214533 (0.0008) [2023-12-26 01:18:13,039][123090] Updated weights for policy 1, policy_version 214543 (0.0009) [2023-12-26 01:18:13,098][123090] Updated weights for policy 1, policy_version 214553 (0.0009) [2023-12-26 01:18:13,142][123091] Updated weights for policy 0, policy_version 215411 (0.0011) [2023-12-26 01:18:13,201][123091] Updated weights for policy 0, policy_version 215421 (0.0011) [2023-12-26 01:18:13,269][123091] Updated weights for policy 0, policy_version 215431 (0.0011) [2023-12-26 01:18:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 110084096. Throughput: 0: 8859.7, 1: 8974.6. Samples: 110080792. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:13,785][121949] Avg episode reward: [(0, '5762.071'), (1, '5541.287')] [2023-12-26 01:18:13,886][123090] Updated weights for policy 1, policy_version 214563 (0.0007) [2023-12-26 01:18:13,946][123090] Updated weights for policy 1, policy_version 214573 (0.0011) [2023-12-26 01:18:13,994][123090] Updated weights for policy 1, policy_version 214583 (0.0010) [2023-12-26 01:18:14,060][123091] Updated weights for policy 0, policy_version 215441 (0.0011) [2023-12-26 01:18:14,118][123091] Updated weights for policy 0, policy_version 215451 (0.0010) [2023-12-26 01:18:14,168][123091] Updated weights for policy 0, policy_version 215461 (0.0010) [2023-12-26 01:18:14,226][123091] Updated weights for policy 0, policy_version 215471 (0.0010) [2023-12-26 01:18:14,662][123090] Updated weights for policy 1, policy_version 214593 (0.0010) [2023-12-26 01:18:14,722][123090] Updated weights for policy 1, policy_version 214603 (0.0009) [2023-12-26 01:18:14,785][123090] Updated weights for policy 1, policy_version 214613 (0.0010) [2023-12-26 01:18:14,841][123090] Updated weights for policy 1, policy_version 214623 (0.0010) [2023-12-26 01:18:15,018][123091] Updated weights for policy 0, policy_version 215481 (0.0007) [2023-12-26 01:18:15,090][123091] Updated weights for policy 0, policy_version 215491 (0.0006) [2023-12-26 01:18:15,165][123091] Updated weights for policy 0, policy_version 215501 (0.0011) [2023-12-26 01:18:15,709][123090] Updated weights for policy 1, policy_version 214633 (0.0009) [2023-12-26 01:18:15,767][123090] Updated weights for policy 1, policy_version 214643 (0.0009) [2023-12-26 01:18:15,824][123090] Updated weights for policy 1, policy_version 214653 (0.0009) [2023-12-26 01:18:15,920][123091] Updated weights for policy 0, policy_version 215511 (0.0010) [2023-12-26 01:18:15,974][123091] Updated weights for policy 0, policy_version 215521 (0.0010) [2023-12-26 01:18:16,032][123091] Updated weights for policy 0, policy_version 215531 (0.0010) [2023-12-26 01:18:16,628][123090] Updated weights for policy 1, policy_version 214663 (0.0010) [2023-12-26 01:18:16,679][123090] Updated weights for policy 1, policy_version 214673 (0.0008) [2023-12-26 01:18:16,744][123090] Updated weights for policy 1, policy_version 214683 (0.0007) [2023-12-26 01:18:16,851][123091] Updated weights for policy 0, policy_version 215541 (0.0010) [2023-12-26 01:18:16,909][123091] Updated weights for policy 0, policy_version 215551 (0.0010) [2023-12-26 01:18:16,960][123091] Updated weights for policy 0, policy_version 215561 (0.0010) [2023-12-26 01:18:17,446][123090] Updated weights for policy 1, policy_version 214693 (0.0010) [2023-12-26 01:18:17,512][123090] Updated weights for policy 1, policy_version 214703 (0.0010) [2023-12-26 01:18:17,581][123090] Updated weights for policy 1, policy_version 214713 (0.0010) [2023-12-26 01:18:17,759][123091] Updated weights for policy 0, policy_version 215571 (0.0010) [2023-12-26 01:18:17,820][123091] Updated weights for policy 0, policy_version 215581 (0.0007) [2023-12-26 01:18:17,883][123091] Updated weights for policy 0, policy_version 215591 (0.0005) [2023-12-26 01:18:18,349][123090] Updated weights for policy 1, policy_version 214723 (0.0010) [2023-12-26 01:18:18,406][123090] Updated weights for policy 1, policy_version 214733 (0.0009) [2023-12-26 01:18:18,463][123090] Updated weights for policy 1, policy_version 214743 (0.0009) [2023-12-26 01:18:18,628][123091] Updated weights for policy 0, policy_version 215601 (0.0010) [2023-12-26 01:18:18,691][123091] Updated weights for policy 0, policy_version 215611 (0.0010) [2023-12-26 01:18:18,761][123091] Updated weights for policy 0, policy_version 215621 (0.0009) [2023-12-26 01:18:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 110174208. Throughput: 0: 8863.5, 1: 9002.7. Samples: 110188292. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:18,785][121949] Avg episode reward: [(0, '5774.398'), (1, '5535.616')] [2023-12-26 01:18:18,825][123091] Updated weights for policy 0, policy_version 215631 (0.0010) [2023-12-26 01:18:19,329][123090] Updated weights for policy 1, policy_version 214753 (0.0010) [2023-12-26 01:18:19,403][123090] Updated weights for policy 1, policy_version 214763 (0.0010) [2023-12-26 01:18:19,470][123090] Updated weights for policy 1, policy_version 214773 (0.0009) [2023-12-26 01:18:19,537][123090] Updated weights for policy 1, policy_version 214783 (0.0009) [2023-12-26 01:18:19,621][123091] Updated weights for policy 0, policy_version 215641 (0.0010) [2023-12-26 01:18:19,686][123091] Updated weights for policy 0, policy_version 215652 (0.0008) [2023-12-26 01:18:19,751][123091] Updated weights for policy 0, policy_version 215662 (0.0006) [2023-12-26 01:18:20,354][123090] Updated weights for policy 1, policy_version 214793 (0.0009) [2023-12-26 01:18:20,411][123090] Updated weights for policy 1, policy_version 214803 (0.0009) [2023-12-26 01:18:20,469][123090] Updated weights for policy 1, policy_version 214813 (0.0010) [2023-12-26 01:18:20,581][123091] Updated weights for policy 0, policy_version 215672 (0.0009) [2023-12-26 01:18:20,641][123091] Updated weights for policy 0, policy_version 215682 (0.0010) [2023-12-26 01:18:20,701][123091] Updated weights for policy 0, policy_version 215692 (0.0010) [2023-12-26 01:18:21,239][123090] Updated weights for policy 1, policy_version 214823 (0.0009) [2023-12-26 01:18:21,312][123090] Updated weights for policy 1, policy_version 214833 (0.0008) [2023-12-26 01:18:21,388][123090] Updated weights for policy 1, policy_version 214843 (0.0009) [2023-12-26 01:18:21,608][123091] Updated weights for policy 0, policy_version 215702 (0.0010) [2023-12-26 01:18:21,673][123091] Updated weights for policy 0, policy_version 215712 (0.0009) [2023-12-26 01:18:21,747][123091] Updated weights for policy 0, policy_version 215722 (0.0009) [2023-12-26 01:18:22,189][123090] Updated weights for policy 1, policy_version 214853 (0.0008) [2023-12-26 01:18:22,249][123090] Updated weights for policy 1, policy_version 214863 (0.0009) [2023-12-26 01:18:22,307][123090] Updated weights for policy 1, policy_version 214873 (0.0009) [2023-12-26 01:18:22,590][123091] Updated weights for policy 0, policy_version 215732 (0.0010) [2023-12-26 01:18:22,645][123091] Updated weights for policy 0, policy_version 215742 (0.0007) [2023-12-26 01:18:22,707][123091] Updated weights for policy 0, policy_version 215752 (0.0007) [2023-12-26 01:18:23,199][123090] Updated weights for policy 1, policy_version 214883 (0.0009) [2023-12-26 01:18:23,247][123090] Updated weights for policy 1, policy_version 214893 (0.0010) [2023-12-26 01:18:23,307][123090] Updated weights for policy 1, policy_version 214903 (0.0010) [2023-12-26 01:18:23,413][123091] Updated weights for policy 0, policy_version 215762 (0.0010) [2023-12-26 01:18:23,484][123091] Updated weights for policy 0, policy_version 215772 (0.0007) [2023-12-26 01:18:23,548][123091] Updated weights for policy 0, policy_version 215782 (0.0005) [2023-12-26 01:18:23,612][123091] Updated weights for policy 0, policy_version 215792 (0.0005) [2023-12-26 01:18:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 110264320. Throughput: 0: 8812.2, 1: 8970.6. Samples: 110239364. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:23,785][121949] Avg episode reward: [(0, '5785.329'), (1, '5328.341')] [2023-12-26 01:18:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000214912_55017472.pth... [2023-12-26 01:18:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000215792_55246848.pth... [2023-12-26 01:18:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000213856_54747136.pth [2023-12-26 01:18:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000214736_54976512.pth [2023-12-26 01:18:24,041][123090] Updated weights for policy 1, policy_version 214913 (0.0010) [2023-12-26 01:18:24,101][123090] Updated weights for policy 1, policy_version 214923 (0.0005) [2023-12-26 01:18:24,159][123090] Updated weights for policy 1, policy_version 214933 (0.0008) [2023-12-26 01:18:24,215][123090] Updated weights for policy 1, policy_version 214943 (0.0007) [2023-12-26 01:18:24,221][123091] Updated weights for policy 0, policy_version 215802 (0.0008) [2023-12-26 01:18:24,276][123091] Updated weights for policy 0, policy_version 215812 (0.0010) [2023-12-26 01:18:24,341][123091] Updated weights for policy 0, policy_version 215822 (0.0009) [2023-12-26 01:18:24,975][123090] Updated weights for policy 1, policy_version 214953 (0.0005) [2023-12-26 01:18:25,033][123091] Updated weights for policy 0, policy_version 215832 (0.0007) [2023-12-26 01:18:25,036][123090] Updated weights for policy 1, policy_version 214963 (0.0007) [2023-12-26 01:18:25,083][123091] Updated weights for policy 0, policy_version 215842 (0.0007) [2023-12-26 01:18:25,106][123090] Updated weights for policy 1, policy_version 214973 (0.0010) [2023-12-26 01:18:25,135][123091] Updated weights for policy 0, policy_version 215852 (0.0006) [2023-12-26 01:18:25,806][123090] Updated weights for policy 1, policy_version 214983 (0.0010) [2023-12-26 01:18:25,864][123090] Updated weights for policy 1, policy_version 214993 (0.0010) [2023-12-26 01:18:25,917][123091] Updated weights for policy 0, policy_version 215862 (0.0006) [2023-12-26 01:18:25,928][123090] Updated weights for policy 1, policy_version 215003 (0.0009) [2023-12-26 01:18:25,971][123091] Updated weights for policy 0, policy_version 215872 (0.0009) [2023-12-26 01:18:26,030][123091] Updated weights for policy 0, policy_version 215882 (0.0007) [2023-12-26 01:18:26,681][123090] Updated weights for policy 1, policy_version 215013 (0.0005) [2023-12-26 01:18:26,703][123091] Updated weights for policy 0, policy_version 215892 (0.0007) [2023-12-26 01:18:26,729][123090] Updated weights for policy 1, policy_version 215023 (0.0005) [2023-12-26 01:18:26,758][123091] Updated weights for policy 0, policy_version 215902 (0.0010) [2023-12-26 01:18:26,776][123090] Updated weights for policy 1, policy_version 215033 (0.0005) [2023-12-26 01:18:26,812][123091] Updated weights for policy 0, policy_version 215912 (0.0011) [2023-12-26 01:18:27,462][123090] Updated weights for policy 1, policy_version 215043 (0.0007) [2023-12-26 01:18:27,504][123091] Updated weights for policy 0, policy_version 215922 (0.0009) [2023-12-26 01:18:27,509][123090] Updated weights for policy 1, policy_version 215053 (0.0010) [2023-12-26 01:18:27,552][123090] Updated weights for policy 1, policy_version 215063 (0.0010) [2023-12-26 01:18:27,554][123091] Updated weights for policy 0, policy_version 215932 (0.0005) [2023-12-26 01:18:27,601][123091] Updated weights for policy 0, policy_version 215942 (0.0005) [2023-12-26 01:18:27,651][123091] Updated weights for policy 0, policy_version 215952 (0.0005) [2023-12-26 01:18:28,280][123091] Updated weights for policy 0, policy_version 215962 (0.0005) [2023-12-26 01:18:28,329][123091] Updated weights for policy 0, policy_version 215972 (0.0006) [2023-12-26 01:18:28,385][123091] Updated weights for policy 0, policy_version 215982 (0.0007) [2023-12-26 01:18:28,398][123090] Updated weights for policy 1, policy_version 215073 (0.0010) [2023-12-26 01:18:28,461][123090] Updated weights for policy 1, policy_version 215083 (0.0010) [2023-12-26 01:18:28,535][123090] Updated weights for policy 1, policy_version 215093 (0.0011) [2023-12-26 01:18:28,598][123090] Updated weights for policy 1, policy_version 215103 (0.0010) [2023-12-26 01:18:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 110362624. Throughput: 0: 8972.8, 1: 9020.0. Samples: 110352648. Policy #0 lag: (min: 9.0, avg: 36.3, max: 41.0) [2023-12-26 01:18:28,785][121949] Avg episode reward: [(0, '5750.891'), (1, '5229.899')] [2023-12-26 01:18:29,011][123091] Updated weights for policy 0, policy_version 215992 (0.0006) [2023-12-26 01:18:29,057][123091] Updated weights for policy 0, policy_version 216002 (0.0005) [2023-12-26 01:18:29,110][123091] Updated weights for policy 0, policy_version 216012 (0.0006) [2023-12-26 01:18:29,406][123090] Updated weights for policy 1, policy_version 215113 (0.0011) [2023-12-26 01:18:29,457][123090] Updated weights for policy 1, policy_version 215123 (0.0010) [2023-12-26 01:18:29,504][123090] Updated weights for policy 1, policy_version 215133 (0.0010) [2023-12-26 01:18:29,800][123091] Updated weights for policy 0, policy_version 216022 (0.0008) [2023-12-26 01:18:29,867][123091] Updated weights for policy 0, policy_version 216032 (0.0009) [2023-12-26 01:18:29,924][123091] Updated weights for policy 0, policy_version 216042 (0.0009) [2023-12-26 01:18:30,398][123090] Updated weights for policy 1, policy_version 215143 (0.0011) [2023-12-26 01:18:30,462][123090] Updated weights for policy 1, policy_version 215153 (0.0011) [2023-12-26 01:18:30,530][123090] Updated weights for policy 1, policy_version 215163 (0.0011) [2023-12-26 01:18:30,748][123091] Updated weights for policy 0, policy_version 216052 (0.0009) [2023-12-26 01:18:30,807][123091] Updated weights for policy 0, policy_version 216062 (0.0006) [2023-12-26 01:18:30,872][123091] Updated weights for policy 0, policy_version 216072 (0.0005) [2023-12-26 01:18:31,355][123090] Updated weights for policy 1, policy_version 215173 (0.0011) [2023-12-26 01:18:31,424][123090] Updated weights for policy 1, policy_version 215183 (0.0011) [2023-12-26 01:18:31,486][123090] Updated weights for policy 1, policy_version 215193 (0.0010) [2023-12-26 01:18:31,597][123091] Updated weights for policy 0, policy_version 216082 (0.0006) [2023-12-26 01:18:31,664][123091] Updated weights for policy 0, policy_version 216092 (0.0008) [2023-12-26 01:18:31,730][123091] Updated weights for policy 0, policy_version 216102 (0.0009) [2023-12-26 01:18:31,781][123091] Updated weights for policy 0, policy_version 216112 (0.0007) [2023-12-26 01:18:32,301][123090] Updated weights for policy 1, policy_version 215203 (0.0010) [2023-12-26 01:18:32,364][123090] Updated weights for policy 1, policy_version 215213 (0.0010) [2023-12-26 01:18:32,431][123090] Updated weights for policy 1, policy_version 215223 (0.0008) [2023-12-26 01:18:32,553][123091] Updated weights for policy 0, policy_version 216122 (0.0011) [2023-12-26 01:18:32,618][123091] Updated weights for policy 0, policy_version 216132 (0.0011) [2023-12-26 01:18:32,666][123091] Updated weights for policy 0, policy_version 216142 (0.0010) [2023-12-26 01:18:33,235][123090] Updated weights for policy 1, policy_version 215233 (0.0006) [2023-12-26 01:18:33,300][123090] Updated weights for policy 1, policy_version 215243 (0.0010) [2023-12-26 01:18:33,347][123090] Updated weights for policy 1, policy_version 215253 (0.0010) [2023-12-26 01:18:33,394][123090] Updated weights for policy 1, policy_version 215263 (0.0010) [2023-12-26 01:18:33,477][123091] Updated weights for policy 0, policy_version 216152 (0.0010) [2023-12-26 01:18:33,538][123091] Updated weights for policy 0, policy_version 216162 (0.0010) [2023-12-26 01:18:33,604][123091] Updated weights for policy 0, policy_version 216172 (0.0010) [2023-12-26 01:18:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 110452736. Throughput: 0: 9113.9, 1: 9008.5. Samples: 110461980. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:33,784][121949] Avg episode reward: [(0, '5935.900'), (1, '5355.744')] [2023-12-26 01:18:34,202][123090] Updated weights for policy 1, policy_version 215273 (0.0009) [2023-12-26 01:18:34,270][123090] Updated weights for policy 1, policy_version 215283 (0.0006) [2023-12-26 01:18:34,319][123091] Updated weights for policy 0, policy_version 216182 (0.0007) [2023-12-26 01:18:34,344][123090] Updated weights for policy 1, policy_version 215293 (0.0006) [2023-12-26 01:18:34,382][123091] Updated weights for policy 0, policy_version 216192 (0.0006) [2023-12-26 01:18:34,436][123091] Updated weights for policy 0, policy_version 216202 (0.0005) [2023-12-26 01:18:35,132][123090] Updated weights for policy 1, policy_version 215303 (0.0011) [2023-12-26 01:18:35,173][123091] Updated weights for policy 0, policy_version 216212 (0.0007) [2023-12-26 01:18:35,195][123090] Updated weights for policy 1, policy_version 215313 (0.0008) [2023-12-26 01:18:35,233][123091] Updated weights for policy 0, policy_version 216222 (0.0009) [2023-12-26 01:18:35,254][123090] Updated weights for policy 1, policy_version 215323 (0.0009) [2023-12-26 01:18:35,296][123091] Updated weights for policy 0, policy_version 216232 (0.0009) [2023-12-26 01:18:35,960][123090] Updated weights for policy 1, policy_version 215333 (0.0008) [2023-12-26 01:18:36,017][123090] Updated weights for policy 1, policy_version 215343 (0.0009) [2023-12-26 01:18:36,072][123090] Updated weights for policy 1, policy_version 215353 (0.0010) [2023-12-26 01:18:36,219][123091] Updated weights for policy 0, policy_version 216242 (0.0010) [2023-12-26 01:18:36,269][123091] Updated weights for policy 0, policy_version 216252 (0.0009) [2023-12-26 01:18:36,326][123091] Updated weights for policy 0, policy_version 216262 (0.0009) [2023-12-26 01:18:36,376][123091] Updated weights for policy 0, policy_version 216272 (0.0009) [2023-12-26 01:18:36,886][123090] Updated weights for policy 1, policy_version 215363 (0.0009) [2023-12-26 01:18:36,939][123090] Updated weights for policy 1, policy_version 215373 (0.0005) [2023-12-26 01:18:36,995][123090] Updated weights for policy 1, policy_version 215383 (0.0009) [2023-12-26 01:18:37,282][123091] Updated weights for policy 0, policy_version 216282 (0.0009) [2023-12-26 01:18:37,331][123091] Updated weights for policy 0, policy_version 216292 (0.0009) [2023-12-26 01:18:37,381][123091] Updated weights for policy 0, policy_version 216302 (0.0009) [2023-12-26 01:18:37,816][123090] Updated weights for policy 1, policy_version 215393 (0.0010) [2023-12-26 01:18:37,890][123090] Updated weights for policy 1, policy_version 215403 (0.0006) [2023-12-26 01:18:37,960][123090] Updated weights for policy 1, policy_version 215413 (0.0005) [2023-12-26 01:18:38,030][123090] Updated weights for policy 1, policy_version 215423 (0.0006) [2023-12-26 01:18:38,250][123091] Updated weights for policy 0, policy_version 216312 (0.0006) [2023-12-26 01:18:38,318][123091] Updated weights for policy 0, policy_version 216322 (0.0006) [2023-12-26 01:18:38,393][123091] Updated weights for policy 0, policy_version 216332 (0.0008) [2023-12-26 01:18:38,669][123090] Updated weights for policy 1, policy_version 215433 (0.0005) [2023-12-26 01:18:38,735][123090] Updated weights for policy 1, policy_version 215443 (0.0010) [2023-12-26 01:18:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 110534656. Throughput: 0: 9136.7, 1: 9053.4. Samples: 110515576. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:38,785][121949] Avg episode reward: [(0, '5949.686'), (1, '5503.907')] [2023-12-26 01:18:38,791][123090] Updated weights for policy 1, policy_version 215453 (0.0010) [2023-12-26 01:18:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000216336_55386112.pth... [2023-12-26 01:18:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000215280_55115776.pth [2023-12-26 01:18:38,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000215456_55156736.pth... [2023-12-26 01:18:38,815][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000214400_54886400.pth [2023-12-26 01:18:38,970][123091] Updated weights for policy 0, policy_version 216342 (0.0006) [2023-12-26 01:18:39,039][123091] Updated weights for policy 0, policy_version 216352 (0.0008) [2023-12-26 01:18:39,113][123091] Updated weights for policy 0, policy_version 216362 (0.0010) [2023-12-26 01:18:39,454][123090] Updated weights for policy 1, policy_version 215463 (0.0008) [2023-12-26 01:18:39,526][123090] Updated weights for policy 1, policy_version 215473 (0.0006) [2023-12-26 01:18:39,591][123090] Updated weights for policy 1, policy_version 215483 (0.0009) [2023-12-26 01:18:39,912][123091] Updated weights for policy 0, policy_version 216372 (0.0010) [2023-12-26 01:18:39,982][123091] Updated weights for policy 0, policy_version 216382 (0.0010) [2023-12-26 01:18:40,044][123091] Updated weights for policy 0, policy_version 216392 (0.0007) [2023-12-26 01:18:40,402][123090] Updated weights for policy 1, policy_version 215493 (0.0009) [2023-12-26 01:18:40,466][123090] Updated weights for policy 1, policy_version 215503 (0.0009) [2023-12-26 01:18:40,533][123090] Updated weights for policy 1, policy_version 215513 (0.0010) [2023-12-26 01:18:40,766][123091] Updated weights for policy 0, policy_version 216402 (0.0006) [2023-12-26 01:18:40,833][123091] Updated weights for policy 0, policy_version 216412 (0.0008) [2023-12-26 01:18:40,902][123091] Updated weights for policy 0, policy_version 216422 (0.0008) [2023-12-26 01:18:40,965][123091] Updated weights for policy 0, policy_version 216432 (0.0006) [2023-12-26 01:18:41,341][123090] Updated weights for policy 1, policy_version 215523 (0.0009) [2023-12-26 01:18:41,411][123090] Updated weights for policy 1, policy_version 215533 (0.0009) [2023-12-26 01:18:41,463][123090] Updated weights for policy 1, policy_version 215543 (0.0009) [2023-12-26 01:18:41,744][123091] Updated weights for policy 0, policy_version 216442 (0.0010) [2023-12-26 01:18:41,808][123091] Updated weights for policy 0, policy_version 216452 (0.0010) [2023-12-26 01:18:41,872][123091] Updated weights for policy 0, policy_version 216462 (0.0010) [2023-12-26 01:18:42,345][123090] Updated weights for policy 1, policy_version 215553 (0.0010) [2023-12-26 01:18:42,405][123090] Updated weights for policy 1, policy_version 215563 (0.0009) [2023-12-26 01:18:42,455][123090] Updated weights for policy 1, policy_version 215573 (0.0009) [2023-12-26 01:18:42,513][123090] Updated weights for policy 1, policy_version 215583 (0.0009) [2023-12-26 01:18:42,689][123091] Updated weights for policy 0, policy_version 216472 (0.0008) [2023-12-26 01:18:42,746][123091] Updated weights for policy 0, policy_version 216482 (0.0005) [2023-12-26 01:18:42,809][123091] Updated weights for policy 0, policy_version 216492 (0.0008) [2023-12-26 01:18:43,369][123090] Updated weights for policy 1, policy_version 215593 (0.0009) [2023-12-26 01:18:43,430][123090] Updated weights for policy 1, policy_version 215603 (0.0010) [2023-12-26 01:18:43,496][123090] Updated weights for policy 1, policy_version 215613 (0.0009) [2023-12-26 01:18:43,599][123091] Updated weights for policy 0, policy_version 216502 (0.0009) [2023-12-26 01:18:43,648][123091] Updated weights for policy 0, policy_version 216513 (0.0009) [2023-12-26 01:18:43,710][123091] Updated weights for policy 0, policy_version 216523 (0.0010) [2023-12-26 01:18:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 110632960. Throughput: 0: 9067.1, 1: 8944.4. Samples: 110622432. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:43,785][121949] Avg episode reward: [(0, '5914.011'), (1, '5373.365')] [2023-12-26 01:18:44,302][123090] Updated weights for policy 1, policy_version 215623 (0.0009) [2023-12-26 01:18:44,365][123090] Updated weights for policy 1, policy_version 215633 (0.0009) [2023-12-26 01:18:44,431][123090] Updated weights for policy 1, policy_version 215643 (0.0009) [2023-12-26 01:18:44,559][123091] Updated weights for policy 0, policy_version 216533 (0.0009) [2023-12-26 01:18:44,612][123091] Updated weights for policy 0, policy_version 216543 (0.0009) [2023-12-26 01:18:44,673][123091] Updated weights for policy 0, policy_version 216553 (0.0009) [2023-12-26 01:18:45,294][123090] Updated weights for policy 1, policy_version 215653 (0.0009) [2023-12-26 01:18:45,367][123090] Updated weights for policy 1, policy_version 215663 (0.0010) [2023-12-26 01:18:45,426][123091] Updated weights for policy 0, policy_version 216563 (0.0009) [2023-12-26 01:18:45,431][123090] Updated weights for policy 1, policy_version 215673 (0.0010) [2023-12-26 01:18:45,491][123091] Updated weights for policy 0, policy_version 216573 (0.0006) [2023-12-26 01:18:45,548][123091] Updated weights for policy 0, policy_version 216583 (0.0006) [2023-12-26 01:18:46,260][123091] Updated weights for policy 0, policy_version 216593 (0.0007) [2023-12-26 01:18:46,309][123091] Updated weights for policy 0, policy_version 216603 (0.0008) [2023-12-26 01:18:46,343][123090] Updated weights for policy 1, policy_version 215683 (0.0009) [2023-12-26 01:18:46,370][123091] Updated weights for policy 0, policy_version 216613 (0.0007) [2023-12-26 01:18:46,405][123090] Updated weights for policy 1, policy_version 215693 (0.0009) [2023-12-26 01:18:46,432][123091] Updated weights for policy 0, policy_version 216623 (0.0011) [2023-12-26 01:18:46,457][123090] Updated weights for policy 1, policy_version 215703 (0.0007) [2023-12-26 01:18:47,065][123091] Updated weights for policy 0, policy_version 216633 (0.0008) [2023-12-26 01:18:47,119][123091] Updated weights for policy 0, policy_version 216643 (0.0005) [2023-12-26 01:18:47,185][123091] Updated weights for policy 0, policy_version 216653 (0.0009) [2023-12-26 01:18:47,337][123090] Updated weights for policy 1, policy_version 215713 (0.0009) [2023-12-26 01:18:47,402][123090] Updated weights for policy 1, policy_version 215723 (0.0009) [2023-12-26 01:18:47,452][123090] Updated weights for policy 1, policy_version 215733 (0.0009) [2023-12-26 01:18:47,506][123090] Updated weights for policy 1, policy_version 215744 (0.0010) [2023-12-26 01:18:47,811][123091] Updated weights for policy 0, policy_version 216663 (0.0007) [2023-12-26 01:18:47,862][123091] Updated weights for policy 0, policy_version 216673 (0.0005) [2023-12-26 01:18:47,925][123091] Updated weights for policy 0, policy_version 216683 (0.0007) [2023-12-26 01:18:48,460][123090] Updated weights for policy 1, policy_version 215754 (0.0010) [2023-12-26 01:18:48,532][123090] Updated weights for policy 1, policy_version 215764 (0.0010) [2023-12-26 01:18:48,599][123090] Updated weights for policy 1, policy_version 215774 (0.0010) [2023-12-26 01:18:48,648][123091] Updated weights for policy 0, policy_version 216693 (0.0006) [2023-12-26 01:18:48,722][123091] Updated weights for policy 0, policy_version 216703 (0.0005) [2023-12-26 01:18:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 110714880. Throughput: 0: 9165.8, 1: 8822.0. Samples: 110728140. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:48,784][121949] Avg episode reward: [(0, '5896.192'), (1, '5270.182')] [2023-12-26 01:18:48,789][123091] Updated weights for policy 0, policy_version 216713 (0.0008) [2023-12-26 01:18:49,433][123090] Updated weights for policy 1, policy_version 215784 (0.0007) [2023-12-26 01:18:49,510][123090] Updated weights for policy 1, policy_version 215794 (0.0006) [2023-12-26 01:18:49,571][123091] Updated weights for policy 0, policy_version 216723 (0.0011) [2023-12-26 01:18:49,584][123090] Updated weights for policy 1, policy_version 215804 (0.0005) [2023-12-26 01:18:49,635][123091] Updated weights for policy 0, policy_version 216733 (0.0011) [2023-12-26 01:18:49,698][123091] Updated weights for policy 0, policy_version 216743 (0.0011) [2023-12-26 01:18:50,291][123090] Updated weights for policy 1, policy_version 215814 (0.0008) [2023-12-26 01:18:50,348][123090] Updated weights for policy 1, policy_version 215824 (0.0009) [2023-12-26 01:18:50,409][123090] Updated weights for policy 1, policy_version 215834 (0.0009) [2023-12-26 01:18:50,547][123091] Updated weights for policy 0, policy_version 216753 (0.0011) [2023-12-26 01:18:50,611][123091] Updated weights for policy 0, policy_version 216763 (0.0009) [2023-12-26 01:18:50,667][123091] Updated weights for policy 0, policy_version 216773 (0.0008) [2023-12-26 01:18:50,724][123091] Updated weights for policy 0, policy_version 216783 (0.0008) [2023-12-26 01:18:51,275][123090] Updated weights for policy 1, policy_version 215844 (0.0009) [2023-12-26 01:18:51,351][123090] Updated weights for policy 1, policy_version 215854 (0.0010) [2023-12-26 01:18:51,427][123090] Updated weights for policy 1, policy_version 215864 (0.0007) [2023-12-26 01:18:51,574][123091] Updated weights for policy 0, policy_version 216793 (0.0010) [2023-12-26 01:18:51,639][123091] Updated weights for policy 0, policy_version 216803 (0.0009) [2023-12-26 01:18:51,696][123091] Updated weights for policy 0, policy_version 216813 (0.0009) [2023-12-26 01:18:52,192][123090] Updated weights for policy 1, policy_version 215874 (0.0006) [2023-12-26 01:18:52,249][123090] Updated weights for policy 1, policy_version 215884 (0.0006) [2023-12-26 01:18:52,319][123090] Updated weights for policy 1, policy_version 215894 (0.0009) [2023-12-26 01:18:52,392][123090] Updated weights for policy 1, policy_version 215904 (0.0010) [2023-12-26 01:18:52,468][123091] Updated weights for policy 0, policy_version 216823 (0.0006) [2023-12-26 01:18:52,520][123091] Updated weights for policy 0, policy_version 216833 (0.0008) [2023-12-26 01:18:52,568][123091] Updated weights for policy 0, policy_version 216843 (0.0009) [2023-12-26 01:18:53,181][123090] Updated weights for policy 1, policy_version 215914 (0.0010) [2023-12-26 01:18:53,237][123090] Updated weights for policy 1, policy_version 215924 (0.0009) [2023-12-26 01:18:53,298][123090] Updated weights for policy 1, policy_version 215934 (0.0009) [2023-12-26 01:18:53,365][123091] Updated weights for policy 0, policy_version 216854 (0.0009) [2023-12-26 01:18:53,430][123091] Updated weights for policy 0, policy_version 216864 (0.0009) [2023-12-26 01:18:53,502][123091] Updated weights for policy 0, policy_version 216874 (0.0009) [2023-12-26 01:18:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 110804992. Throughput: 0: 9124.6, 1: 8765.6. Samples: 110779832. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:53,785][121949] Avg episode reward: [(0, '5924.322'), (1, '5309.167')] [2023-12-26 01:18:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000215936_55279616.pth... [2023-12-26 01:18:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000216880_55525376.pth... [2023-12-26 01:18:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000214912_55017472.pth [2023-12-26 01:18:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000215792_55246848.pth [2023-12-26 01:18:54,034][123090] Updated weights for policy 1, policy_version 215944 (0.0010) [2023-12-26 01:18:54,085][123090] Updated weights for policy 1, policy_version 215954 (0.0010) [2023-12-26 01:18:54,140][123090] Updated weights for policy 1, policy_version 215964 (0.0010) [2023-12-26 01:18:54,311][123091] Updated weights for policy 0, policy_version 216884 (0.0010) [2023-12-26 01:18:54,367][123091] Updated weights for policy 0, policy_version 216894 (0.0009) [2023-12-26 01:18:54,430][123091] Updated weights for policy 0, policy_version 216904 (0.0009) [2023-12-26 01:18:54,938][123090] Updated weights for policy 1, policy_version 215974 (0.0008) [2023-12-26 01:18:54,986][123090] Updated weights for policy 1, policy_version 215984 (0.0007) [2023-12-26 01:18:55,050][123090] Updated weights for policy 1, policy_version 215994 (0.0010) [2023-12-26 01:18:55,325][123091] Updated weights for policy 0, policy_version 216914 (0.0009) [2023-12-26 01:18:55,385][123091] Updated weights for policy 0, policy_version 216924 (0.0009) [2023-12-26 01:18:55,439][123091] Updated weights for policy 0, policy_version 216935 (0.0009) [2023-12-26 01:18:55,802][123090] Updated weights for policy 1, policy_version 216004 (0.0010) [2023-12-26 01:18:55,850][123090] Updated weights for policy 1, policy_version 216014 (0.0009) [2023-12-26 01:18:55,902][123090] Updated weights for policy 1, policy_version 216024 (0.0008) [2023-12-26 01:18:56,307][123091] Updated weights for policy 0, policy_version 216946 (0.0010) [2023-12-26 01:18:56,361][123091] Updated weights for policy 0, policy_version 216956 (0.0010) [2023-12-26 01:18:56,415][123091] Updated weights for policy 0, policy_version 216966 (0.0010) [2023-12-26 01:18:56,470][123091] Updated weights for policy 0, policy_version 216976 (0.0010) [2023-12-26 01:18:56,683][123090] Updated weights for policy 1, policy_version 216034 (0.0009) [2023-12-26 01:18:56,733][123090] Updated weights for policy 1, policy_version 216044 (0.0005) [2023-12-26 01:18:56,787][123090] Updated weights for policy 1, policy_version 216054 (0.0007) [2023-12-26 01:18:56,856][123090] Updated weights for policy 1, policy_version 216064 (0.0009) [2023-12-26 01:18:57,266][123091] Updated weights for policy 0, policy_version 216986 (0.0006) [2023-12-26 01:18:57,322][123091] Updated weights for policy 0, policy_version 216996 (0.0005) [2023-12-26 01:18:57,390][123091] Updated weights for policy 0, policy_version 217006 (0.0006) [2023-12-26 01:18:57,700][123090] Updated weights for policy 1, policy_version 216074 (0.0008) [2023-12-26 01:18:57,757][123090] Updated weights for policy 1, policy_version 216084 (0.0005) [2023-12-26 01:18:57,814][123090] Updated weights for policy 1, policy_version 216094 (0.0005) [2023-12-26 01:18:58,107][123091] Updated weights for policy 0, policy_version 217016 (0.0006) [2023-12-26 01:18:58,169][123091] Updated weights for policy 0, policy_version 217026 (0.0006) [2023-12-26 01:18:58,234][123091] Updated weights for policy 0, policy_version 217036 (0.0008) [2023-12-26 01:18:58,583][123090] Updated weights for policy 1, policy_version 216104 (0.0008) [2023-12-26 01:18:58,654][123090] Updated weights for policy 1, policy_version 216114 (0.0008) [2023-12-26 01:18:58,728][123090] Updated weights for policy 1, policy_version 216124 (0.0008) [2023-12-26 01:18:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 110895104. Throughput: 0: 9098.3, 1: 8795.8. Samples: 110886024. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:18:58,784][121949] Avg episode reward: [(0, '5900.618'), (1, '5401.536')] [2023-12-26 01:18:59,172][123091] Updated weights for policy 0, policy_version 217046 (0.0009) [2023-12-26 01:18:59,250][123091] Updated weights for policy 0, policy_version 217056 (0.0008) [2023-12-26 01:18:59,315][123091] Updated weights for policy 0, policy_version 217066 (0.0010) [2023-12-26 01:18:59,513][123090] Updated weights for policy 1, policy_version 216134 (0.0009) [2023-12-26 01:18:59,582][123090] Updated weights for policy 1, policy_version 216144 (0.0008) [2023-12-26 01:18:59,644][123090] Updated weights for policy 1, policy_version 216154 (0.0008) [2023-12-26 01:19:00,071][123091] Updated weights for policy 0, policy_version 217076 (0.0008) [2023-12-26 01:19:00,121][123091] Updated weights for policy 0, policy_version 217086 (0.0006) [2023-12-26 01:19:00,170][123091] Updated weights for policy 0, policy_version 217096 (0.0005) [2023-12-26 01:19:00,404][123090] Updated weights for policy 1, policy_version 216164 (0.0007) [2023-12-26 01:19:00,458][123090] Updated weights for policy 1, policy_version 216174 (0.0005) [2023-12-26 01:19:00,515][123090] Updated weights for policy 1, policy_version 216184 (0.0005) [2023-12-26 01:19:00,992][123091] Updated weights for policy 0, policy_version 217106 (0.0006) [2023-12-26 01:19:01,065][123091] Updated weights for policy 0, policy_version 217116 (0.0007) [2023-12-26 01:19:01,140][123091] Updated weights for policy 0, policy_version 217126 (0.0007) [2023-12-26 01:19:01,144][123090] Updated weights for policy 1, policy_version 216194 (0.0006) [2023-12-26 01:19:01,205][123091] Updated weights for policy 0, policy_version 217136 (0.0009) [2023-12-26 01:19:01,215][123090] Updated weights for policy 1, policy_version 216204 (0.0008) [2023-12-26 01:19:01,280][123090] Updated weights for policy 1, policy_version 216214 (0.0008) [2023-12-26 01:19:01,341][123090] Updated weights for policy 1, policy_version 216224 (0.0008) [2023-12-26 01:19:02,018][123091] Updated weights for policy 0, policy_version 217146 (0.0009) [2023-12-26 01:19:02,075][123091] Updated weights for policy 0, policy_version 217156 (0.0009) [2023-12-26 01:19:02,137][123091] Updated weights for policy 0, policy_version 217166 (0.0006) [2023-12-26 01:19:02,164][123090] Updated weights for policy 1, policy_version 216234 (0.0006) [2023-12-26 01:19:02,231][123090] Updated weights for policy 1, policy_version 216244 (0.0005) [2023-12-26 01:19:02,307][123090] Updated weights for policy 1, policy_version 216254 (0.0006) [2023-12-26 01:19:02,982][123091] Updated weights for policy 0, policy_version 217176 (0.0009) [2023-12-26 01:19:03,034][123090] Updated weights for policy 1, policy_version 216264 (0.0010) [2023-12-26 01:19:03,048][123091] Updated weights for policy 0, policy_version 217186 (0.0008) [2023-12-26 01:19:03,105][123090] Updated weights for policy 1, policy_version 216274 (0.0011) [2023-12-26 01:19:03,108][123091] Updated weights for policy 0, policy_version 217196 (0.0007) [2023-12-26 01:19:03,168][123090] Updated weights for policy 1, policy_version 216284 (0.0005) [2023-12-26 01:19:03,751][123091] Updated weights for policy 0, policy_version 217206 (0.0006) [2023-12-26 01:19:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 110977024. Throughput: 0: 9073.4, 1: 8822.5. Samples: 110993612. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:03,785][121949] Avg episode reward: [(0, '5954.674'), (1, '5392.215')] [2023-12-26 01:19:03,815][123091] Updated weights for policy 0, policy_version 217216 (0.0005) [2023-12-26 01:19:03,871][123090] Updated weights for policy 1, policy_version 216294 (0.0009) [2023-12-26 01:19:03,882][123091] Updated weights for policy 0, policy_version 217226 (0.0008) [2023-12-26 01:19:03,931][123090] Updated weights for policy 1, policy_version 216304 (0.0010) [2023-12-26 01:19:03,994][123090] Updated weights for policy 1, policy_version 216314 (0.0011) [2023-12-26 01:19:04,623][123091] Updated weights for policy 0, policy_version 217236 (0.0006) [2023-12-26 01:19:04,685][123091] Updated weights for policy 0, policy_version 217246 (0.0006) [2023-12-26 01:19:04,746][123091] Updated weights for policy 0, policy_version 217256 (0.0005) [2023-12-26 01:19:04,826][123090] Updated weights for policy 1, policy_version 216324 (0.0011) [2023-12-26 01:19:04,888][123090] Updated weights for policy 1, policy_version 216334 (0.0010) [2023-12-26 01:19:04,935][123090] Updated weights for policy 1, policy_version 216344 (0.0010) [2023-12-26 01:19:05,447][123091] Updated weights for policy 0, policy_version 217266 (0.0006) [2023-12-26 01:19:05,498][123091] Updated weights for policy 0, policy_version 217276 (0.0009) [2023-12-26 01:19:05,560][123091] Updated weights for policy 0, policy_version 217286 (0.0009) [2023-12-26 01:19:05,614][123091] Updated weights for policy 0, policy_version 217296 (0.0009) [2023-12-26 01:19:05,769][123090] Updated weights for policy 1, policy_version 216354 (0.0010) [2023-12-26 01:19:05,824][123090] Updated weights for policy 1, policy_version 216364 (0.0009) [2023-12-26 01:19:05,886][123090] Updated weights for policy 1, policy_version 216374 (0.0009) [2023-12-26 01:19:05,950][123090] Updated weights for policy 1, policy_version 216384 (0.0010) [2023-12-26 01:19:06,449][123091] Updated weights for policy 0, policy_version 217306 (0.0006) [2023-12-26 01:19:06,514][123091] Updated weights for policy 0, policy_version 217316 (0.0006) [2023-12-26 01:19:06,584][123091] Updated weights for policy 0, policy_version 217326 (0.0006) [2023-12-26 01:19:06,825][123090] Updated weights for policy 1, policy_version 216394 (0.0010) [2023-12-26 01:19:06,893][123090] Updated weights for policy 1, policy_version 216404 (0.0009) [2023-12-26 01:19:06,946][123090] Updated weights for policy 1, policy_version 216414 (0.0010) [2023-12-26 01:19:07,348][123091] Updated weights for policy 0, policy_version 217336 (0.0009) [2023-12-26 01:19:07,408][123091] Updated weights for policy 0, policy_version 217347 (0.0010) [2023-12-26 01:19:07,470][123091] Updated weights for policy 0, policy_version 217357 (0.0010) [2023-12-26 01:19:07,786][123090] Updated weights for policy 1, policy_version 216424 (0.0010) [2023-12-26 01:19:07,836][123090] Updated weights for policy 1, policy_version 216434 (0.0009) [2023-12-26 01:19:07,898][123090] Updated weights for policy 1, policy_version 216444 (0.0009) [2023-12-26 01:19:08,297][123091] Updated weights for policy 0, policy_version 217367 (0.0010) [2023-12-26 01:19:08,367][123091] Updated weights for policy 0, policy_version 217377 (0.0007) [2023-12-26 01:19:08,431][123091] Updated weights for policy 0, policy_version 217387 (0.0009) [2023-12-26 01:19:08,736][123090] Updated weights for policy 1, policy_version 216454 (0.0009) [2023-12-26 01:19:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 111067136. Throughput: 0: 9131.7, 1: 8805.8. Samples: 111046552. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:08,785][121949] Avg episode reward: [(0, '6036.441'), (1, '5338.583')] [2023-12-26 01:19:08,790][123090] Updated weights for policy 1, policy_version 216464 (0.0009) [2023-12-26 01:19:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000217392_55656448.pth... [2023-12-26 01:19:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000216336_55386112.pth [2023-12-26 01:19:08,799][123007] Saving new best policy, reward=6036.441! [2023-12-26 01:19:08,859][123090] Updated weights for policy 1, policy_version 216474 (0.0009) [2023-12-26 01:19:08,903][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000216480_55418880.pth... [2023-12-26 01:19:08,908][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000215456_55156736.pth [2023-12-26 01:19:09,248][123091] Updated weights for policy 0, policy_version 217397 (0.0009) [2023-12-26 01:19:09,317][123091] Updated weights for policy 0, policy_version 217407 (0.0010) [2023-12-26 01:19:09,384][123091] Updated weights for policy 0, policy_version 217417 (0.0009) [2023-12-26 01:19:09,696][123090] Updated weights for policy 1, policy_version 216484 (0.0010) [2023-12-26 01:19:09,762][123090] Updated weights for policy 1, policy_version 216494 (0.0010) [2023-12-26 01:19:09,826][123090] Updated weights for policy 1, policy_version 216504 (0.0008) [2023-12-26 01:19:10,260][123091] Updated weights for policy 0, policy_version 217427 (0.0012) [2023-12-26 01:19:10,321][123091] Updated weights for policy 0, policy_version 217437 (0.0011) [2023-12-26 01:19:10,376][123091] Updated weights for policy 0, policy_version 217447 (0.0011) [2023-12-26 01:19:10,717][123090] Updated weights for policy 1, policy_version 216514 (0.0009) [2023-12-26 01:19:10,782][123090] Updated weights for policy 1, policy_version 216524 (0.0009) [2023-12-26 01:19:10,838][123090] Updated weights for policy 1, policy_version 216534 (0.0009) [2023-12-26 01:19:10,898][123090] Updated weights for policy 1, policy_version 216544 (0.0008) [2023-12-26 01:19:11,218][123091] Updated weights for policy 0, policy_version 217457 (0.0011) [2023-12-26 01:19:11,286][123091] Updated weights for policy 0, policy_version 217467 (0.0009) [2023-12-26 01:19:11,349][123091] Updated weights for policy 0, policy_version 217477 (0.0008) [2023-12-26 01:19:11,414][123091] Updated weights for policy 0, policy_version 217487 (0.0008) [2023-12-26 01:19:11,765][123090] Updated weights for policy 1, policy_version 216554 (0.0011) [2023-12-26 01:19:11,834][123090] Updated weights for policy 1, policy_version 216564 (0.0009) [2023-12-26 01:19:11,907][123090] Updated weights for policy 1, policy_version 216574 (0.0009) [2023-12-26 01:19:12,250][123091] Updated weights for policy 0, policy_version 217497 (0.0010) [2023-12-26 01:19:12,316][123091] Updated weights for policy 0, policy_version 217507 (0.0008) [2023-12-26 01:19:12,388][123091] Updated weights for policy 0, policy_version 217517 (0.0008) [2023-12-26 01:19:12,698][123090] Updated weights for policy 1, policy_version 216584 (0.0006) [2023-12-26 01:19:12,753][123090] Updated weights for policy 1, policy_version 216594 (0.0005) [2023-12-26 01:19:12,803][123090] Updated weights for policy 1, policy_version 216604 (0.0010) [2023-12-26 01:19:13,181][123091] Updated weights for policy 0, policy_version 217527 (0.0009) [2023-12-26 01:19:13,231][123091] Updated weights for policy 0, policy_version 217537 (0.0006) [2023-12-26 01:19:13,284][123091] Updated weights for policy 0, policy_version 217547 (0.0005) [2023-12-26 01:19:13,602][123090] Updated weights for policy 1, policy_version 216614 (0.0010) [2023-12-26 01:19:13,660][123090] Updated weights for policy 1, policy_version 216624 (0.0010) [2023-12-26 01:19:13,725][123090] Updated weights for policy 1, policy_version 216634 (0.0010) [2023-12-26 01:19:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 111157248. Throughput: 0: 8975.0, 1: 8697.8. Samples: 111147928. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:13,785][121949] Avg episode reward: [(0, '6069.538'), (1, '5241.771')] [2023-12-26 01:19:13,786][123007] Saving new best policy, reward=6069.538! [2023-12-26 01:19:13,911][123091] Updated weights for policy 0, policy_version 217557 (0.0005) [2023-12-26 01:19:13,960][123091] Updated weights for policy 0, policy_version 217567 (0.0005) [2023-12-26 01:19:14,007][123091] Updated weights for policy 0, policy_version 217577 (0.0005) [2023-12-26 01:19:14,559][123090] Updated weights for policy 1, policy_version 216644 (0.0010) [2023-12-26 01:19:14,627][123090] Updated weights for policy 1, policy_version 216654 (0.0010) [2023-12-26 01:19:14,682][123090] Updated weights for policy 1, policy_version 216664 (0.0010) [2023-12-26 01:19:14,721][123091] Updated weights for policy 0, policy_version 217587 (0.0007) [2023-12-26 01:19:14,781][123091] Updated weights for policy 0, policy_version 217597 (0.0008) [2023-12-26 01:19:14,848][123091] Updated weights for policy 0, policy_version 217607 (0.0008) [2023-12-26 01:19:15,404][123090] Updated weights for policy 1, policy_version 216674 (0.0009) [2023-12-26 01:19:15,475][123090] Updated weights for policy 1, policy_version 216684 (0.0007) [2023-12-26 01:19:15,545][123090] Updated weights for policy 1, policy_version 216694 (0.0010) [2023-12-26 01:19:15,618][123090] Updated weights for policy 1, policy_version 216704 (0.0010) [2023-12-26 01:19:15,656][123091] Updated weights for policy 0, policy_version 217617 (0.0008) [2023-12-26 01:19:15,727][123091] Updated weights for policy 0, policy_version 217627 (0.0009) [2023-12-26 01:19:15,780][123091] Updated weights for policy 0, policy_version 217637 (0.0009) [2023-12-26 01:19:15,830][123091] Updated weights for policy 0, policy_version 217647 (0.0009) [2023-12-26 01:19:16,439][123090] Updated weights for policy 1, policy_version 216714 (0.0010) [2023-12-26 01:19:16,495][123090] Updated weights for policy 1, policy_version 216724 (0.0009) [2023-12-26 01:19:16,525][123091] Updated weights for policy 0, policy_version 217657 (0.0010) [2023-12-26 01:19:16,557][123090] Updated weights for policy 1, policy_version 216734 (0.0009) [2023-12-26 01:19:16,586][123091] Updated weights for policy 0, policy_version 217667 (0.0007) [2023-12-26 01:19:16,643][123091] Updated weights for policy 0, policy_version 217677 (0.0010) [2023-12-26 01:19:17,340][123090] Updated weights for policy 1, policy_version 216744 (0.0009) [2023-12-26 01:19:17,401][123090] Updated weights for policy 1, policy_version 216754 (0.0010) [2023-12-26 01:19:17,463][123090] Updated weights for policy 1, policy_version 216764 (0.0009) [2023-12-26 01:19:17,468][123091] Updated weights for policy 0, policy_version 217687 (0.0008) [2023-12-26 01:19:17,522][123091] Updated weights for policy 0, policy_version 217697 (0.0008) [2023-12-26 01:19:17,583][123091] Updated weights for policy 0, policy_version 217707 (0.0010) [2023-12-26 01:19:18,307][123090] Updated weights for policy 1, policy_version 216774 (0.0010) [2023-12-26 01:19:18,372][123090] Updated weights for policy 1, policy_version 216784 (0.0009) [2023-12-26 01:19:18,441][123091] Updated weights for policy 0, policy_version 217717 (0.0009) [2023-12-26 01:19:18,442][123090] Updated weights for policy 1, policy_version 216794 (0.0010) [2023-12-26 01:19:18,504][123091] Updated weights for policy 0, policy_version 217727 (0.0009) [2023-12-26 01:19:18,570][123091] Updated weights for policy 0, policy_version 217737 (0.0009) [2023-12-26 01:19:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 111247360. Throughput: 0: 8916.1, 1: 8705.5. Samples: 111254952. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:18,784][121949] Avg episode reward: [(0, '5946.578'), (1, '5337.649')] [2023-12-26 01:19:19,210][123090] Updated weights for policy 1, policy_version 216804 (0.0009) [2023-12-26 01:19:19,282][123090] Updated weights for policy 1, policy_version 216814 (0.0009) [2023-12-26 01:19:19,341][123090] Updated weights for policy 1, policy_version 216824 (0.0009) [2023-12-26 01:19:19,436][123091] Updated weights for policy 0, policy_version 217747 (0.0009) [2023-12-26 01:19:19,496][123091] Updated weights for policy 0, policy_version 217758 (0.0010) [2023-12-26 01:19:19,556][123091] Updated weights for policy 0, policy_version 217768 (0.0010) [2023-12-26 01:19:20,140][123090] Updated weights for policy 1, policy_version 216834 (0.0008) [2023-12-26 01:19:20,202][123090] Updated weights for policy 1, policy_version 216844 (0.0006) [2023-12-26 01:19:20,266][123090] Updated weights for policy 1, policy_version 216854 (0.0008) [2023-12-26 01:19:20,331][123090] Updated weights for policy 1, policy_version 216864 (0.0010) [2023-12-26 01:19:20,445][123091] Updated weights for policy 0, policy_version 217778 (0.0010) [2023-12-26 01:19:20,499][123091] Updated weights for policy 0, policy_version 217788 (0.0009) [2023-12-26 01:19:20,558][123091] Updated weights for policy 0, policy_version 217798 (0.0009) [2023-12-26 01:19:21,131][123090] Updated weights for policy 1, policy_version 216874 (0.0011) [2023-12-26 01:19:21,202][123090] Updated weights for policy 1, policy_version 216884 (0.0011) [2023-12-26 01:19:21,272][123090] Updated weights for policy 1, policy_version 216894 (0.0011) [2023-12-26 01:19:21,311][123091] Updated weights for policy 0, policy_version 217810 (0.0007) [2023-12-26 01:19:21,384][123091] Updated weights for policy 0, policy_version 217820 (0.0010) [2023-12-26 01:19:21,452][123091] Updated weights for policy 0, policy_version 217830 (0.0011) [2023-12-26 01:19:21,515][123091] Updated weights for policy 0, policy_version 217840 (0.0011) [2023-12-26 01:19:22,080][123090] Updated weights for policy 1, policy_version 216904 (0.0010) [2023-12-26 01:19:22,143][123090] Updated weights for policy 1, policy_version 216914 (0.0010) [2023-12-26 01:19:22,216][123090] Updated weights for policy 1, policy_version 216924 (0.0009) [2023-12-26 01:19:22,299][123091] Updated weights for policy 0, policy_version 217850 (0.0010) [2023-12-26 01:19:22,370][123091] Updated weights for policy 0, policy_version 217860 (0.0011) [2023-12-26 01:19:22,442][123091] Updated weights for policy 0, policy_version 217870 (0.0011) [2023-12-26 01:19:23,084][123090] Updated weights for policy 1, policy_version 216934 (0.0010) [2023-12-26 01:19:23,139][123090] Updated weights for policy 1, policy_version 216944 (0.0010) [2023-12-26 01:19:23,191][123090] Updated weights for policy 1, policy_version 216954 (0.0010) [2023-12-26 01:19:23,243][123091] Updated weights for policy 0, policy_version 217880 (0.0007) [2023-12-26 01:19:23,303][123091] Updated weights for policy 0, policy_version 217890 (0.0005) [2023-12-26 01:19:23,363][123091] Updated weights for policy 0, policy_version 217900 (0.0005) [2023-12-26 01:19:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 111329280. Throughput: 0: 8890.7, 1: 8683.8. Samples: 111306424. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:23,785][121949] Avg episode reward: [(0, '5830.980'), (1, '5270.318')] [2023-12-26 01:19:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000217904_55787520.pth... [2023-12-26 01:19:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000216960_55541760.pth... [2023-12-26 01:19:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000215936_55279616.pth [2023-12-26 01:19:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000216880_55525376.pth [2023-12-26 01:19:23,980][123090] Updated weights for policy 1, policy_version 216964 (0.0010) [2023-12-26 01:19:24,046][123090] Updated weights for policy 1, policy_version 216974 (0.0010) [2023-12-26 01:19:24,049][123091] Updated weights for policy 0, policy_version 217910 (0.0006) [2023-12-26 01:19:24,104][123091] Updated weights for policy 0, policy_version 217920 (0.0006) [2023-12-26 01:19:24,109][123090] Updated weights for policy 1, policy_version 216984 (0.0010) [2023-12-26 01:19:24,155][123091] Updated weights for policy 0, policy_version 217930 (0.0005) [2023-12-26 01:19:24,806][123091] Updated weights for policy 0, policy_version 217940 (0.0007) [2023-12-26 01:19:24,876][123091] Updated weights for policy 0, policy_version 217950 (0.0010) [2023-12-26 01:19:24,912][123090] Updated weights for policy 1, policy_version 216994 (0.0010) [2023-12-26 01:19:24,934][123091] Updated weights for policy 0, policy_version 217960 (0.0010) [2023-12-26 01:19:24,975][123090] Updated weights for policy 1, policy_version 217004 (0.0010) [2023-12-26 01:19:25,035][123090] Updated weights for policy 1, policy_version 217014 (0.0010) [2023-12-26 01:19:25,082][123090] Updated weights for policy 1, policy_version 217024 (0.0010) [2023-12-26 01:19:25,594][123091] Updated weights for policy 0, policy_version 217970 (0.0010) [2023-12-26 01:19:25,652][123091] Updated weights for policy 0, policy_version 217980 (0.0011) [2023-12-26 01:19:25,711][123091] Updated weights for policy 0, policy_version 217990 (0.0010) [2023-12-26 01:19:25,769][123091] Updated weights for policy 0, policy_version 218000 (0.0010) [2023-12-26 01:19:25,802][123090] Updated weights for policy 1, policy_version 217034 (0.0011) [2023-12-26 01:19:25,860][123090] Updated weights for policy 1, policy_version 217044 (0.0010) [2023-12-26 01:19:25,918][123090] Updated weights for policy 1, policy_version 217054 (0.0010) [2023-12-26 01:19:26,577][123091] Updated weights for policy 0, policy_version 218010 (0.0010) [2023-12-26 01:19:26,628][123091] Updated weights for policy 0, policy_version 218020 (0.0007) [2023-12-26 01:19:26,673][123091] Updated weights for policy 0, policy_version 218030 (0.0005) [2023-12-26 01:19:26,712][123090] Updated weights for policy 1, policy_version 217064 (0.0006) [2023-12-26 01:19:26,762][123090] Updated weights for policy 1, policy_version 217074 (0.0005) [2023-12-26 01:19:26,835][123090] Updated weights for policy 1, policy_version 217084 (0.0005) [2023-12-26 01:19:27,384][123091] Updated weights for policy 0, policy_version 218040 (0.0005) [2023-12-26 01:19:27,438][123091] Updated weights for policy 0, policy_version 218050 (0.0008) [2023-12-26 01:19:27,493][123091] Updated weights for policy 0, policy_version 218060 (0.0010) [2023-12-26 01:19:27,520][123090] Updated weights for policy 1, policy_version 217094 (0.0005) [2023-12-26 01:19:27,584][123090] Updated weights for policy 1, policy_version 217104 (0.0006) [2023-12-26 01:19:27,628][123090] Updated weights for policy 1, policy_version 217114 (0.0010) [2023-12-26 01:19:28,278][123091] Updated weights for policy 0, policy_version 218070 (0.0007) [2023-12-26 01:19:28,309][123090] Updated weights for policy 1, policy_version 217124 (0.0005) [2023-12-26 01:19:28,332][123091] Updated weights for policy 0, policy_version 218080 (0.0006) [2023-12-26 01:19:28,373][123090] Updated weights for policy 1, policy_version 217134 (0.0007) [2023-12-26 01:19:28,388][123091] Updated weights for policy 0, policy_version 218090 (0.0007) [2023-12-26 01:19:28,433][123090] Updated weights for policy 1, policy_version 217144 (0.0009) [2023-12-26 01:19:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 111427584. Throughput: 0: 8969.2, 1: 8711.7. Samples: 111418068. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:28,785][121949] Avg episode reward: [(0, '5801.016'), (1, '5182.638')] [2023-12-26 01:19:29,089][123090] Updated weights for policy 1, policy_version 217154 (0.0010) [2023-12-26 01:19:29,089][123091] Updated weights for policy 0, policy_version 218100 (0.0005) [2023-12-26 01:19:29,147][123091] Updated weights for policy 0, policy_version 218110 (0.0005) [2023-12-26 01:19:29,155][123090] Updated weights for policy 1, policy_version 217164 (0.0010) [2023-12-26 01:19:29,209][123090] Updated weights for policy 1, policy_version 217174 (0.0009) [2023-12-26 01:19:29,209][123091] Updated weights for policy 0, policy_version 218120 (0.0005) [2023-12-26 01:19:29,272][123090] Updated weights for policy 1, policy_version 217184 (0.0008) [2023-12-26 01:19:29,942][123091] Updated weights for policy 0, policy_version 218130 (0.0010) [2023-12-26 01:19:30,010][123091] Updated weights for policy 0, policy_version 218140 (0.0008) [2023-12-26 01:19:30,074][123091] Updated weights for policy 0, policy_version 218150 (0.0008) [2023-12-26 01:19:30,103][123090] Updated weights for policy 1, policy_version 217194 (0.0010) [2023-12-26 01:19:30,137][123091] Updated weights for policy 0, policy_version 218160 (0.0008) [2023-12-26 01:19:30,166][123090] Updated weights for policy 1, policy_version 217204 (0.0010) [2023-12-26 01:19:30,225][123090] Updated weights for policy 1, policy_version 217214 (0.0010) [2023-12-26 01:19:30,808][123091] Updated weights for policy 0, policy_version 218170 (0.0005) [2023-12-26 01:19:30,875][123091] Updated weights for policy 0, policy_version 218180 (0.0005) [2023-12-26 01:19:30,947][123091] Updated weights for policy 0, policy_version 218190 (0.0009) [2023-12-26 01:19:31,036][123090] Updated weights for policy 1, policy_version 217226 (0.0007) [2023-12-26 01:19:31,102][123090] Updated weights for policy 1, policy_version 217236 (0.0023) [2023-12-26 01:19:31,169][123090] Updated weights for policy 1, policy_version 217246 (0.0008) [2023-12-26 01:19:31,687][123091] Updated weights for policy 0, policy_version 218200 (0.0011) [2023-12-26 01:19:31,753][123091] Updated weights for policy 0, policy_version 218210 (0.0010) [2023-12-26 01:19:31,817][123091] Updated weights for policy 0, policy_version 218220 (0.0011) [2023-12-26 01:19:31,954][123090] Updated weights for policy 1, policy_version 217256 (0.0007) [2023-12-26 01:19:32,009][123090] Updated weights for policy 1, policy_version 217266 (0.0010) [2023-12-26 01:19:32,065][123090] Updated weights for policy 1, policy_version 217276 (0.0010) [2023-12-26 01:19:32,576][123091] Updated weights for policy 0, policy_version 218230 (0.0008) [2023-12-26 01:19:32,632][123091] Updated weights for policy 0, policy_version 218240 (0.0006) [2023-12-26 01:19:32,701][123091] Updated weights for policy 0, policy_version 218250 (0.0006) [2023-12-26 01:19:32,899][123090] Updated weights for policy 1, policy_version 217286 (0.0011) [2023-12-26 01:19:32,948][123090] Updated weights for policy 1, policy_version 217296 (0.0009) [2023-12-26 01:19:32,996][123090] Updated weights for policy 1, policy_version 217306 (0.0009) [2023-12-26 01:19:33,429][123091] Updated weights for policy 0, policy_version 218260 (0.0008) [2023-12-26 01:19:33,502][123091] Updated weights for policy 0, policy_version 218270 (0.0009) [2023-12-26 01:19:33,566][123091] Updated weights for policy 0, policy_version 218280 (0.0009) [2023-12-26 01:19:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 111517696. Throughput: 0: 8964.7, 1: 8824.5. Samples: 111528656. Policy #0 lag: (min: 25.0, avg: 42.9, max: 57.0) [2023-12-26 01:19:33,785][121949] Avg episode reward: [(0, '5928.789'), (1, '5042.901')] [2023-12-26 01:19:33,859][123090] Updated weights for policy 1, policy_version 217316 (0.0010) [2023-12-26 01:19:33,918][123090] Updated weights for policy 1, policy_version 217326 (0.0010) [2023-12-26 01:19:33,977][123090] Updated weights for policy 1, policy_version 217336 (0.0010) [2023-12-26 01:19:34,400][123091] Updated weights for policy 0, policy_version 218290 (0.0008) [2023-12-26 01:19:34,471][123091] Updated weights for policy 0, policy_version 218300 (0.0008) [2023-12-26 01:19:34,539][123091] Updated weights for policy 0, policy_version 218310 (0.0009) [2023-12-26 01:19:34,604][123091] Updated weights for policy 0, policy_version 218320 (0.0006) [2023-12-26 01:19:34,767][123090] Updated weights for policy 1, policy_version 217346 (0.0008) [2023-12-26 01:19:34,843][123090] Updated weights for policy 1, policy_version 217356 (0.0011) [2023-12-26 01:19:34,918][123090] Updated weights for policy 1, policy_version 217366 (0.0011) [2023-12-26 01:19:34,986][123090] Updated weights for policy 1, policy_version 217376 (0.0010) [2023-12-26 01:19:35,350][123091] Updated weights for policy 0, policy_version 218330 (0.0009) [2023-12-26 01:19:35,402][123091] Updated weights for policy 0, policy_version 218340 (0.0010) [2023-12-26 01:19:35,462][123091] Updated weights for policy 0, policy_version 218350 (0.0006) [2023-12-26 01:19:35,715][123090] Updated weights for policy 1, policy_version 217386 (0.0005) [2023-12-26 01:19:35,768][123090] Updated weights for policy 1, policy_version 217396 (0.0005) [2023-12-26 01:19:35,841][123090] Updated weights for policy 1, policy_version 217406 (0.0007) [2023-12-26 01:19:36,305][123091] Updated weights for policy 0, policy_version 218360 (0.0010) [2023-12-26 01:19:36,369][123091] Updated weights for policy 0, policy_version 218370 (0.0010) [2023-12-26 01:19:36,423][123091] Updated weights for policy 0, policy_version 218380 (0.0010) [2023-12-26 01:19:36,494][123090] Updated weights for policy 1, policy_version 217416 (0.0007) [2023-12-26 01:19:36,562][123090] Updated weights for policy 1, policy_version 217426 (0.0009) [2023-12-26 01:19:36,634][123090] Updated weights for policy 1, policy_version 217436 (0.0010) [2023-12-26 01:19:37,289][123091] Updated weights for policy 0, policy_version 218390 (0.0010) [2023-12-26 01:19:37,349][123091] Updated weights for policy 0, policy_version 218400 (0.0009) [2023-12-26 01:19:37,373][123090] Updated weights for policy 1, policy_version 217446 (0.0007) [2023-12-26 01:19:37,405][123091] Updated weights for policy 0, policy_version 218410 (0.0008) [2023-12-26 01:19:37,426][123090] Updated weights for policy 1, policy_version 217456 (0.0006) [2023-12-26 01:19:37,484][123090] Updated weights for policy 1, policy_version 217466 (0.0009) [2023-12-26 01:19:38,163][123091] Updated weights for policy 0, policy_version 218420 (0.0007) [2023-12-26 01:19:38,234][123091] Updated weights for policy 0, policy_version 218430 (0.0005) [2023-12-26 01:19:38,275][123090] Updated weights for policy 1, policy_version 217476 (0.0008) [2023-12-26 01:19:38,303][123091] Updated weights for policy 0, policy_version 218440 (0.0006) [2023-12-26 01:19:38,346][123090] Updated weights for policy 1, policy_version 217486 (0.0007) [2023-12-26 01:19:38,405][123090] Updated weights for policy 1, policy_version 217496 (0.0009) [2023-12-26 01:19:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 111607808. Throughput: 0: 8980.0, 1: 8855.3. Samples: 111582416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:19:38,785][121949] Avg episode reward: [(0, '6039.563'), (1, '5078.014')] [2023-12-26 01:19:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000218448_55926784.pth... [2023-12-26 01:19:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000217504_55681024.pth... [2023-12-26 01:19:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000216480_55418880.pth [2023-12-26 01:19:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000217392_55656448.pth [2023-12-26 01:19:39,094][123091] Updated weights for policy 0, policy_version 218450 (0.0010) [2023-12-26 01:19:39,147][123091] Updated weights for policy 0, policy_version 218460 (0.0011) [2023-12-26 01:19:39,220][123091] Updated weights for policy 0, policy_version 218470 (0.0011) [2023-12-26 01:19:39,232][123090] Updated weights for policy 1, policy_version 217506 (0.0009) [2023-12-26 01:19:39,286][123091] Updated weights for policy 0, policy_version 218480 (0.0011) [2023-12-26 01:19:39,304][123090] Updated weights for policy 1, policy_version 217516 (0.0009) [2023-12-26 01:19:39,380][123090] Updated weights for policy 1, policy_version 217526 (0.0007) [2023-12-26 01:19:39,448][123090] Updated weights for policy 1, policy_version 217536 (0.0010) [2023-12-26 01:19:40,146][123091] Updated weights for policy 0, policy_version 218490 (0.0009) [2023-12-26 01:19:40,210][123091] Updated weights for policy 0, policy_version 218500 (0.0009) [2023-12-26 01:19:40,264][123090] Updated weights for policy 1, policy_version 217546 (0.0011) [2023-12-26 01:19:40,280][123091] Updated weights for policy 0, policy_version 218510 (0.0007) [2023-12-26 01:19:40,328][123090] Updated weights for policy 1, policy_version 217556 (0.0011) [2023-12-26 01:19:40,392][123090] Updated weights for policy 1, policy_version 217566 (0.0011) [2023-12-26 01:19:41,068][123091] Updated weights for policy 0, policy_version 218520 (0.0008) [2023-12-26 01:19:41,134][123091] Updated weights for policy 0, policy_version 218530 (0.0009) [2023-12-26 01:19:41,149][123090] Updated weights for policy 1, policy_version 217576 (0.0010) [2023-12-26 01:19:41,200][123091] Updated weights for policy 0, policy_version 218540 (0.0006) [2023-12-26 01:19:41,218][123090] Updated weights for policy 1, policy_version 217586 (0.0007) [2023-12-26 01:19:41,296][123090] Updated weights for policy 1, policy_version 217596 (0.0008) [2023-12-26 01:19:42,045][123091] Updated weights for policy 0, policy_version 218550 (0.0008) [2023-12-26 01:19:42,050][123090] Updated weights for policy 1, policy_version 217606 (0.0007) [2023-12-26 01:19:42,094][123091] Updated weights for policy 0, policy_version 218560 (0.0008) [2023-12-26 01:19:42,100][123090] Updated weights for policy 1, policy_version 217616 (0.0006) [2023-12-26 01:19:42,152][123091] Updated weights for policy 0, policy_version 218570 (0.0008) [2023-12-26 01:19:42,163][123090] Updated weights for policy 1, policy_version 217626 (0.0010) [2023-12-26 01:19:42,909][123091] Updated weights for policy 0, policy_version 218580 (0.0008) [2023-12-26 01:19:42,969][123091] Updated weights for policy 0, policy_version 218590 (0.0008) [2023-12-26 01:19:42,983][123090] Updated weights for policy 1, policy_version 217636 (0.0011) [2023-12-26 01:19:43,029][123091] Updated weights for policy 0, policy_version 218600 (0.0008) [2023-12-26 01:19:43,046][123090] Updated weights for policy 1, policy_version 217646 (0.0011) [2023-12-26 01:19:43,113][123090] Updated weights for policy 1, policy_version 217656 (0.0010) [2023-12-26 01:19:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 111689728. Throughput: 0: 8961.6, 1: 8842.7. Samples: 111687220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:19:43,785][121949] Avg episode reward: [(0, '6009.196'), (1, '5165.005')] [2023-12-26 01:19:43,834][123090] Updated weights for policy 1, policy_version 217666 (0.0011) [2023-12-26 01:19:43,902][123090] Updated weights for policy 1, policy_version 217676 (0.0006) [2023-12-26 01:19:43,924][123091] Updated weights for policy 0, policy_version 218610 (0.0008) [2023-12-26 01:19:43,962][123090] Updated weights for policy 1, policy_version 217686 (0.0005) [2023-12-26 01:19:43,981][123091] Updated weights for policy 0, policy_version 218620 (0.0009) [2023-12-26 01:19:44,013][123090] Updated weights for policy 1, policy_version 217696 (0.0005) [2023-12-26 01:19:44,037][123091] Updated weights for policy 0, policy_version 218630 (0.0009) [2023-12-26 01:19:44,090][123091] Updated weights for policy 0, policy_version 218640 (0.0009) [2023-12-26 01:19:44,749][123090] Updated weights for policy 1, policy_version 217706 (0.0010) [2023-12-26 01:19:44,824][123090] Updated weights for policy 1, policy_version 217716 (0.0010) [2023-12-26 01:19:44,884][123090] Updated weights for policy 1, policy_version 217726 (0.0010) [2023-12-26 01:19:44,964][123091] Updated weights for policy 0, policy_version 218650 (0.0009) [2023-12-26 01:19:45,020][123091] Updated weights for policy 0, policy_version 218660 (0.0009) [2023-12-26 01:19:45,083][123091] Updated weights for policy 0, policy_version 218670 (0.0009) [2023-12-26 01:19:45,724][123090] Updated weights for policy 1, policy_version 217736 (0.0010) [2023-12-26 01:19:45,784][123090] Updated weights for policy 1, policy_version 217746 (0.0009) [2023-12-26 01:19:45,845][123090] Updated weights for policy 1, policy_version 217756 (0.0008) [2023-12-26 01:19:45,951][123091] Updated weights for policy 0, policy_version 218680 (0.0009) [2023-12-26 01:19:46,006][123091] Updated weights for policy 0, policy_version 218690 (0.0008) [2023-12-26 01:19:46,059][123091] Updated weights for policy 0, policy_version 218700 (0.0009) [2023-12-26 01:19:46,611][123090] Updated weights for policy 1, policy_version 217766 (0.0009) [2023-12-26 01:19:46,663][123090] Updated weights for policy 1, policy_version 217777 (0.0009) [2023-12-26 01:19:46,716][123090] Updated weights for policy 1, policy_version 217787 (0.0010) [2023-12-26 01:19:46,830][123091] Updated weights for policy 0, policy_version 218710 (0.0006) [2023-12-26 01:19:46,891][123091] Updated weights for policy 0, policy_version 218720 (0.0007) [2023-12-26 01:19:46,940][123091] Updated weights for policy 0, policy_version 218730 (0.0010) [2023-12-26 01:19:47,527][123090] Updated weights for policy 1, policy_version 217797 (0.0007) [2023-12-26 01:19:47,594][123090] Updated weights for policy 1, policy_version 217807 (0.0005) [2023-12-26 01:19:47,660][123090] Updated weights for policy 1, policy_version 217817 (0.0009) [2023-12-26 01:19:47,732][123091] Updated weights for policy 0, policy_version 218740 (0.0008) [2023-12-26 01:19:47,788][123091] Updated weights for policy 0, policy_version 218750 (0.0006) [2023-12-26 01:19:47,844][123091] Updated weights for policy 0, policy_version 218760 (0.0005) [2023-12-26 01:19:48,368][123090] Updated weights for policy 1, policy_version 217827 (0.0009) [2023-12-26 01:19:48,427][123090] Updated weights for policy 1, policy_version 217837 (0.0010) [2023-12-26 01:19:48,506][123090] Updated weights for policy 1, policy_version 217847 (0.0010) [2023-12-26 01:19:48,563][123091] Updated weights for policy 0, policy_version 218770 (0.0005) [2023-12-26 01:19:48,628][123091] Updated weights for policy 0, policy_version 218780 (0.0009) [2023-12-26 01:19:48,692][123091] Updated weights for policy 0, policy_version 218790 (0.0009) [2023-12-26 01:19:48,750][123091] Updated weights for policy 0, policy_version 218800 (0.0010) [2023-12-26 01:19:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 111788032. Throughput: 0: 8957.1, 1: 8831.1. Samples: 111794076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:19:48,784][121949] Avg episode reward: [(0, '5930.030'), (1, '5260.520')] [2023-12-26 01:19:49,358][123090] Updated weights for policy 1, policy_version 217857 (0.0009) [2023-12-26 01:19:49,421][123090] Updated weights for policy 1, policy_version 217867 (0.0009) [2023-12-26 01:19:49,478][123090] Updated weights for policy 1, policy_version 217877 (0.0008) [2023-12-26 01:19:49,530][123090] Updated weights for policy 1, policy_version 217887 (0.0009) [2023-12-26 01:19:49,615][123091] Updated weights for policy 0, policy_version 218810 (0.0010) [2023-12-26 01:19:49,680][123091] Updated weights for policy 0, policy_version 218820 (0.0010) [2023-12-26 01:19:49,738][123091] Updated weights for policy 0, policy_version 218830 (0.0009) [2023-12-26 01:19:50,381][123090] Updated weights for policy 1, policy_version 217897 (0.0010) [2023-12-26 01:19:50,436][123090] Updated weights for policy 1, policy_version 217907 (0.0008) [2023-12-26 01:19:50,485][123090] Updated weights for policy 1, policy_version 217917 (0.0009) [2023-12-26 01:19:50,551][123091] Updated weights for policy 0, policy_version 218840 (0.0007) [2023-12-26 01:19:50,613][123091] Updated weights for policy 0, policy_version 218850 (0.0008) [2023-12-26 01:19:50,670][123091] Updated weights for policy 0, policy_version 218860 (0.0009) [2023-12-26 01:19:51,394][123090] Updated weights for policy 1, policy_version 217927 (0.0009) [2023-12-26 01:19:51,415][123091] Updated weights for policy 0, policy_version 218870 (0.0009) [2023-12-26 01:19:51,456][123090] Updated weights for policy 1, policy_version 217937 (0.0008) [2023-12-26 01:19:51,472][123091] Updated weights for policy 0, policy_version 218880 (0.0006) [2023-12-26 01:19:51,512][123090] Updated weights for policy 1, policy_version 217947 (0.0008) [2023-12-26 01:19:51,522][123091] Updated weights for policy 0, policy_version 218890 (0.0010) [2023-12-26 01:19:52,338][123091] Updated weights for policy 0, policy_version 218900 (0.0009) [2023-12-26 01:19:52,386][123090] Updated weights for policy 1, policy_version 217957 (0.0008) [2023-12-26 01:19:52,404][123091] Updated weights for policy 0, policy_version 218910 (0.0008) [2023-12-26 01:19:52,454][123090] Updated weights for policy 1, policy_version 217967 (0.0010) [2023-12-26 01:19:52,482][123091] Updated weights for policy 0, policy_version 218920 (0.0007) [2023-12-26 01:19:52,509][123090] Updated weights for policy 1, policy_version 217977 (0.0008) [2023-12-26 01:19:53,176][123090] Updated weights for policy 1, policy_version 217987 (0.0010) [2023-12-26 01:19:53,236][123090] Updated weights for policy 1, policy_version 217997 (0.0009) [2023-12-26 01:19:53,293][123090] Updated weights for policy 1, policy_version 218007 (0.0009) [2023-12-26 01:19:53,306][123091] Updated weights for policy 0, policy_version 218930 (0.0008) [2023-12-26 01:19:53,371][123091] Updated weights for policy 0, policy_version 218940 (0.0009) [2023-12-26 01:19:53,422][123091] Updated weights for policy 0, policy_version 218950 (0.0008) [2023-12-26 01:19:53,480][123091] Updated weights for policy 0, policy_version 218960 (0.0010) [2023-12-26 01:19:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 111869952. Throughput: 0: 8917.4, 1: 8810.1. Samples: 111844292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:19:53,785][121949] Avg episode reward: [(0, '5819.491'), (1, '5222.437')] [2023-12-26 01:19:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000218960_56057856.pth... [2023-12-26 01:19:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000218016_55812096.pth... [2023-12-26 01:19:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000216960_55541760.pth [2023-12-26 01:19:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000217904_55787520.pth [2023-12-26 01:19:54,125][123090] Updated weights for policy 1, policy_version 218017 (0.0008) [2023-12-26 01:19:54,194][123090] Updated weights for policy 1, policy_version 218027 (0.0010) [2023-12-26 01:19:54,259][123090] Updated weights for policy 1, policy_version 218037 (0.0008) [2023-12-26 01:19:54,318][123091] Updated weights for policy 0, policy_version 218970 (0.0006) [2023-12-26 01:19:54,331][123090] Updated weights for policy 1, policy_version 218047 (0.0009) [2023-12-26 01:19:54,384][123091] Updated weights for policy 0, policy_version 218980 (0.0006) [2023-12-26 01:19:54,458][123091] Updated weights for policy 0, policy_version 218990 (0.0005) [2023-12-26 01:19:55,099][123090] Updated weights for policy 1, policy_version 218057 (0.0006) [2023-12-26 01:19:55,173][123090] Updated weights for policy 1, policy_version 218067 (0.0007) [2023-12-26 01:19:55,201][123091] Updated weights for policy 0, policy_version 219000 (0.0007) [2023-12-26 01:19:55,225][123090] Updated weights for policy 1, policy_version 218077 (0.0008) [2023-12-26 01:19:55,254][123091] Updated weights for policy 0, policy_version 219010 (0.0007) [2023-12-26 01:19:55,307][123091] Updated weights for policy 0, policy_version 219020 (0.0008) [2023-12-26 01:19:55,970][123090] Updated weights for policy 1, policy_version 218087 (0.0008) [2023-12-26 01:19:56,042][123090] Updated weights for policy 1, policy_version 218097 (0.0006) [2023-12-26 01:19:56,110][123090] Updated weights for policy 1, policy_version 218107 (0.0006) [2023-12-26 01:19:56,163][123091] Updated weights for policy 0, policy_version 219030 (0.0007) [2023-12-26 01:19:56,214][123091] Updated weights for policy 0, policy_version 219040 (0.0005) [2023-12-26 01:19:56,261][123091] Updated weights for policy 0, policy_version 219050 (0.0005) [2023-12-26 01:19:56,761][123090] Updated weights for policy 1, policy_version 218117 (0.0006) [2023-12-26 01:19:56,829][123090] Updated weights for policy 1, policy_version 218127 (0.0005) [2023-12-26 01:19:56,884][123090] Updated weights for policy 1, policy_version 218137 (0.0005) [2023-12-26 01:19:56,891][123091] Updated weights for policy 0, policy_version 219060 (0.0006) [2023-12-26 01:19:56,947][123091] Updated weights for policy 0, policy_version 219070 (0.0010) [2023-12-26 01:19:56,996][123091] Updated weights for policy 0, policy_version 219080 (0.0009) [2023-12-26 01:19:57,600][123090] Updated weights for policy 1, policy_version 218148 (0.0008) [2023-12-26 01:19:57,657][123090] Updated weights for policy 1, policy_version 218158 (0.0008) [2023-12-26 01:19:57,703][123090] Updated weights for policy 1, policy_version 218168 (0.0009) [2023-12-26 01:19:57,856][123091] Updated weights for policy 0, policy_version 219090 (0.0008) [2023-12-26 01:19:57,908][123091] Updated weights for policy 0, policy_version 219100 (0.0006) [2023-12-26 01:19:57,961][123091] Updated weights for policy 0, policy_version 219110 (0.0005) [2023-12-26 01:19:58,027][123091] Updated weights for policy 0, policy_version 219120 (0.0009) [2023-12-26 01:19:58,634][123090] Updated weights for policy 1, policy_version 218178 (0.0009) [2023-12-26 01:19:58,705][123090] Updated weights for policy 1, policy_version 218188 (0.0011) [2023-12-26 01:19:58,777][123090] Updated weights for policy 1, policy_version 218198 (0.0011) [2023-12-26 01:19:58,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 111951872. Throughput: 0: 8961.3, 1: 8929.1. Samples: 111952992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:19:58,785][121949] Avg episode reward: [(0, '5882.846'), (1, '5294.015')] [2023-12-26 01:19:58,848][123090] Updated weights for policy 1, policy_version 218208 (0.0011) [2023-12-26 01:19:58,850][123091] Updated weights for policy 0, policy_version 219130 (0.0007) [2023-12-26 01:19:58,910][123091] Updated weights for policy 0, policy_version 219140 (0.0008) [2023-12-26 01:19:58,970][123091] Updated weights for policy 0, policy_version 219150 (0.0009) [2023-12-26 01:19:59,639][123090] Updated weights for policy 1, policy_version 218218 (0.0008) [2023-12-26 01:19:59,698][123090] Updated weights for policy 1, policy_version 218228 (0.0010) [2023-12-26 01:19:59,749][123090] Updated weights for policy 1, policy_version 218238 (0.0010) [2023-12-26 01:19:59,755][123091] Updated weights for policy 0, policy_version 219160 (0.0010) [2023-12-26 01:19:59,802][123091] Updated weights for policy 0, policy_version 219170 (0.0009) [2023-12-26 01:19:59,872][123091] Updated weights for policy 0, policy_version 219180 (0.0008) [2023-12-26 01:20:00,443][123090] Updated weights for policy 1, policy_version 218248 (0.0006) [2023-12-26 01:20:00,503][123090] Updated weights for policy 1, policy_version 218258 (0.0006) [2023-12-26 01:20:00,563][123090] Updated weights for policy 1, policy_version 218268 (0.0011) [2023-12-26 01:20:00,711][123091] Updated weights for policy 0, policy_version 219190 (0.0006) [2023-12-26 01:20:00,779][123091] Updated weights for policy 0, policy_version 219200 (0.0006) [2023-12-26 01:20:00,845][123091] Updated weights for policy 0, policy_version 219210 (0.0006) [2023-12-26 01:20:01,283][123090] Updated weights for policy 1, policy_version 218278 (0.0008) [2023-12-26 01:20:01,347][123090] Updated weights for policy 1, policy_version 218288 (0.0006) [2023-12-26 01:20:01,416][123090] Updated weights for policy 1, policy_version 218298 (0.0010) [2023-12-26 01:20:01,593][123091] Updated weights for policy 0, policy_version 219220 (0.0007) [2023-12-26 01:20:01,651][123091] Updated weights for policy 0, policy_version 219230 (0.0009) [2023-12-26 01:20:01,711][123091] Updated weights for policy 0, policy_version 219240 (0.0009) [2023-12-26 01:20:02,153][123090] Updated weights for policy 1, policy_version 218308 (0.0008) [2023-12-26 01:20:02,212][123090] Updated weights for policy 1, policy_version 218318 (0.0010) [2023-12-26 01:20:02,267][123090] Updated weights for policy 1, policy_version 218328 (0.0011) [2023-12-26 01:20:02,622][123091] Updated weights for policy 0, policy_version 219250 (0.0010) [2023-12-26 01:20:02,676][123091] Updated weights for policy 0, policy_version 219260 (0.0010) [2023-12-26 01:20:02,739][123091] Updated weights for policy 0, policy_version 219270 (0.0010) [2023-12-26 01:20:02,805][123091] Updated weights for policy 0, policy_version 219280 (0.0008) [2023-12-26 01:20:02,980][123090] Updated weights for policy 1, policy_version 218338 (0.0010) [2023-12-26 01:20:03,035][123090] Updated weights for policy 1, policy_version 218349 (0.0009) [2023-12-26 01:20:03,104][123090] Updated weights for policy 1, policy_version 218359 (0.0008) [2023-12-26 01:20:03,605][123091] Updated weights for policy 0, policy_version 219290 (0.0010) [2023-12-26 01:20:03,658][123091] Updated weights for policy 0, policy_version 219300 (0.0010) [2023-12-26 01:20:03,711][123091] Updated weights for policy 0, policy_version 219310 (0.0009) [2023-12-26 01:20:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 112050176. Throughput: 0: 8890.3, 1: 8998.6. Samples: 112059952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:03,785][121949] Avg episode reward: [(0, '5873.826'), (1, '5429.225')] [2023-12-26 01:20:03,847][123090] Updated weights for policy 1, policy_version 218369 (0.0009) [2023-12-26 01:20:03,920][123090] Updated weights for policy 1, policy_version 218379 (0.0010) [2023-12-26 01:20:03,992][123090] Updated weights for policy 1, policy_version 218389 (0.0011) [2023-12-26 01:20:04,064][123090] Updated weights for policy 1, policy_version 218399 (0.0011) [2023-12-26 01:20:04,550][123091] Updated weights for policy 0, policy_version 219320 (0.0009) [2023-12-26 01:20:04,609][123091] Updated weights for policy 0, policy_version 219330 (0.0006) [2023-12-26 01:20:04,668][123091] Updated weights for policy 0, policy_version 219340 (0.0006) [2023-12-26 01:20:04,823][123090] Updated weights for policy 1, policy_version 218409 (0.0006) [2023-12-26 01:20:04,882][123090] Updated weights for policy 1, policy_version 218419 (0.0006) [2023-12-26 01:20:04,935][123090] Updated weights for policy 1, policy_version 218429 (0.0005) [2023-12-26 01:20:05,433][123091] Updated weights for policy 0, policy_version 219350 (0.0009) [2023-12-26 01:20:05,496][123091] Updated weights for policy 0, policy_version 219360 (0.0011) [2023-12-26 01:20:05,545][123091] Updated weights for policy 0, policy_version 219370 (0.0010) [2023-12-26 01:20:05,628][123090] Updated weights for policy 1, policy_version 218439 (0.0005) [2023-12-26 01:20:05,687][123090] Updated weights for policy 1, policy_version 218449 (0.0005) [2023-12-26 01:20:05,746][123090] Updated weights for policy 1, policy_version 218459 (0.0005) [2023-12-26 01:20:06,302][123091] Updated weights for policy 0, policy_version 219380 (0.0009) [2023-12-26 01:20:06,368][123091] Updated weights for policy 0, policy_version 219390 (0.0006) [2023-12-26 01:20:06,432][123091] Updated weights for policy 0, policy_version 219400 (0.0006) [2023-12-26 01:20:06,494][123090] Updated weights for policy 1, policy_version 218469 (0.0008) [2023-12-26 01:20:06,562][123090] Updated weights for policy 1, policy_version 218479 (0.0008) [2023-12-26 01:20:06,627][123090] Updated weights for policy 1, policy_version 218489 (0.0010) [2023-12-26 01:20:07,169][123091] Updated weights for policy 0, policy_version 219410 (0.0006) [2023-12-26 01:20:07,224][123091] Updated weights for policy 0, policy_version 219421 (0.0009) [2023-12-26 01:20:07,278][123091] Updated weights for policy 0, policy_version 219431 (0.0010) [2023-12-26 01:20:07,408][123090] Updated weights for policy 1, policy_version 218499 (0.0007) [2023-12-26 01:20:07,458][123090] Updated weights for policy 1, policy_version 218509 (0.0011) [2023-12-26 01:20:07,506][123090] Updated weights for policy 1, policy_version 218519 (0.0010) [2023-12-26 01:20:07,945][123091] Updated weights for policy 0, policy_version 219441 (0.0008) [2023-12-26 01:20:08,021][123091] Updated weights for policy 0, policy_version 219451 (0.0006) [2023-12-26 01:20:08,084][123091] Updated weights for policy 0, policy_version 219461 (0.0005) [2023-12-26 01:20:08,154][123091] Updated weights for policy 0, policy_version 219471 (0.0005) [2023-12-26 01:20:08,304][123090] Updated weights for policy 1, policy_version 218529 (0.0010) [2023-12-26 01:20:08,375][123090] Updated weights for policy 1, policy_version 218539 (0.0008) [2023-12-26 01:20:08,441][123090] Updated weights for policy 1, policy_version 218549 (0.0006) [2023-12-26 01:20:08,511][123090] Updated weights for policy 1, policy_version 218559 (0.0009) [2023-12-26 01:20:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 112140288. Throughput: 0: 8938.9, 1: 9040.1. Samples: 112115480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:08,785][121949] Avg episode reward: [(0, '5760.447'), (1, '5560.602')] [2023-12-26 01:20:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000219472_56188928.pth... [2023-12-26 01:20:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000218560_55951360.pth... [2023-12-26 01:20:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000218448_55926784.pth [2023-12-26 01:20:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000217504_55681024.pth [2023-12-26 01:20:08,875][123091] Updated weights for policy 0, policy_version 219481 (0.0010) [2023-12-26 01:20:08,932][123091] Updated weights for policy 0, policy_version 219491 (0.0011) [2023-12-26 01:20:08,999][123091] Updated weights for policy 0, policy_version 219501 (0.0011) [2023-12-26 01:20:09,208][123090] Updated weights for policy 1, policy_version 218569 (0.0010) [2023-12-26 01:20:09,269][123090] Updated weights for policy 1, policy_version 218579 (0.0010) [2023-12-26 01:20:09,328][123090] Updated weights for policy 1, policy_version 218589 (0.0011) [2023-12-26 01:20:09,838][123091] Updated weights for policy 0, policy_version 219511 (0.0009) [2023-12-26 01:20:09,910][123091] Updated weights for policy 0, policy_version 219521 (0.0009) [2023-12-26 01:20:09,982][123091] Updated weights for policy 0, policy_version 219531 (0.0009) [2023-12-26 01:20:10,191][123090] Updated weights for policy 1, policy_version 218599 (0.0011) [2023-12-26 01:20:10,258][123090] Updated weights for policy 1, policy_version 218609 (0.0011) [2023-12-26 01:20:10,307][123090] Updated weights for policy 1, policy_version 218619 (0.0010) [2023-12-26 01:20:10,820][123091] Updated weights for policy 0, policy_version 219541 (0.0009) [2023-12-26 01:20:10,870][123091] Updated weights for policy 0, policy_version 219551 (0.0009) [2023-12-26 01:20:10,923][123091] Updated weights for policy 0, policy_version 219561 (0.0009) [2023-12-26 01:20:11,188][123090] Updated weights for policy 1, policy_version 218629 (0.0010) [2023-12-26 01:20:11,261][123090] Updated weights for policy 1, policy_version 218639 (0.0011) [2023-12-26 01:20:11,325][123090] Updated weights for policy 1, policy_version 218649 (0.0011) [2023-12-26 01:20:11,847][123091] Updated weights for policy 0, policy_version 219571 (0.0008) [2023-12-26 01:20:11,913][123091] Updated weights for policy 0, policy_version 219581 (0.0008) [2023-12-26 01:20:11,972][123091] Updated weights for policy 0, policy_version 219591 (0.0009) [2023-12-26 01:20:12,177][123090] Updated weights for policy 1, policy_version 218659 (0.0011) [2023-12-26 01:20:12,243][123090] Updated weights for policy 1, policy_version 218669 (0.0011) [2023-12-26 01:20:12,302][123090] Updated weights for policy 1, policy_version 218679 (0.0011) [2023-12-26 01:20:12,806][123091] Updated weights for policy 0, policy_version 219601 (0.0011) [2023-12-26 01:20:12,866][123091] Updated weights for policy 0, policy_version 219611 (0.0011) [2023-12-26 01:20:12,929][123091] Updated weights for policy 0, policy_version 219621 (0.0011) [2023-12-26 01:20:12,993][123091] Updated weights for policy 0, policy_version 219631 (0.0011) [2023-12-26 01:20:13,110][123090] Updated weights for policy 1, policy_version 218689 (0.0010) [2023-12-26 01:20:13,164][123090] Updated weights for policy 1, policy_version 218699 (0.0005) [2023-12-26 01:20:13,211][123090] Updated weights for policy 1, policy_version 218709 (0.0010) [2023-12-26 01:20:13,257][123090] Updated weights for policy 1, policy_version 218719 (0.0009) [2023-12-26 01:20:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 112222208. Throughput: 0: 8830.2, 1: 8992.6. Samples: 112220092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:13,784][121949] Avg episode reward: [(0, '5712.709'), (1, '5679.042')] [2023-12-26 01:20:13,813][123091] Updated weights for policy 0, policy_version 219641 (0.0010) [2023-12-26 01:20:13,872][123091] Updated weights for policy 0, policy_version 219651 (0.0010) [2023-12-26 01:20:13,926][123090] Updated weights for policy 1, policy_version 218729 (0.0005) [2023-12-26 01:20:13,935][123091] Updated weights for policy 0, policy_version 219661 (0.0011) [2023-12-26 01:20:13,982][123090] Updated weights for policy 1, policy_version 218739 (0.0005) [2023-12-26 01:20:14,033][123090] Updated weights for policy 1, policy_version 218749 (0.0009) [2023-12-26 01:20:14,709][123091] Updated weights for policy 0, policy_version 219671 (0.0011) [2023-12-26 01:20:14,769][123091] Updated weights for policy 0, policy_version 219681 (0.0011) [2023-12-26 01:20:14,776][123090] Updated weights for policy 1, policy_version 218759 (0.0008) [2023-12-26 01:20:14,839][123090] Updated weights for policy 1, policy_version 218769 (0.0010) [2023-12-26 01:20:14,840][123091] Updated weights for policy 0, policy_version 219691 (0.0011) [2023-12-26 01:20:14,899][123090] Updated weights for policy 1, policy_version 218779 (0.0011) [2023-12-26 01:20:15,589][123091] Updated weights for policy 0, policy_version 219701 (0.0008) [2023-12-26 01:20:15,657][123091] Updated weights for policy 0, policy_version 219711 (0.0005) [2023-12-26 01:20:15,703][123090] Updated weights for policy 1, policy_version 218789 (0.0010) [2023-12-26 01:20:15,723][123091] Updated weights for policy 0, policy_version 219721 (0.0010) [2023-12-26 01:20:15,767][123090] Updated weights for policy 1, policy_version 218799 (0.0010) [2023-12-26 01:20:15,836][123090] Updated weights for policy 1, policy_version 218809 (0.0011) [2023-12-26 01:20:16,481][123091] Updated weights for policy 0, policy_version 219731 (0.0009) [2023-12-26 01:20:16,550][123091] Updated weights for policy 0, policy_version 219741 (0.0006) [2023-12-26 01:20:16,586][123090] Updated weights for policy 1, policy_version 218819 (0.0009) [2023-12-26 01:20:16,620][123091] Updated weights for policy 0, policy_version 219751 (0.0007) [2023-12-26 01:20:16,651][123090] Updated weights for policy 1, policy_version 218829 (0.0007) [2023-12-26 01:20:16,708][123090] Updated weights for policy 1, policy_version 218839 (0.0005) [2023-12-26 01:20:17,308][123091] Updated weights for policy 0, policy_version 219761 (0.0010) [2023-12-26 01:20:17,363][123091] Updated weights for policy 0, policy_version 219771 (0.0007) [2023-12-26 01:20:17,402][123090] Updated weights for policy 1, policy_version 218849 (0.0005) [2023-12-26 01:20:17,422][123091] Updated weights for policy 0, policy_version 219781 (0.0006) [2023-12-26 01:20:17,464][123090] Updated weights for policy 1, policy_version 218859 (0.0007) [2023-12-26 01:20:17,492][123091] Updated weights for policy 0, policy_version 219791 (0.0005) [2023-12-26 01:20:17,516][123090] Updated weights for policy 1, policy_version 218869 (0.0005) [2023-12-26 01:20:17,574][123090] Updated weights for policy 1, policy_version 218879 (0.0005) [2023-12-26 01:20:18,251][123091] Updated weights for policy 0, policy_version 219801 (0.0010) [2023-12-26 01:20:18,280][123090] Updated weights for policy 1, policy_version 218889 (0.0009) [2023-12-26 01:20:18,320][123091] Updated weights for policy 0, policy_version 219811 (0.0010) [2023-12-26 01:20:18,332][123090] Updated weights for policy 1, policy_version 218899 (0.0010) [2023-12-26 01:20:18,384][123091] Updated weights for policy 0, policy_version 219821 (0.0011) [2023-12-26 01:20:18,394][123090] Updated weights for policy 1, policy_version 218909 (0.0010) [2023-12-26 01:20:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 112320512. Throughput: 0: 8771.7, 1: 9067.3. Samples: 112331408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:18,785][121949] Avg episode reward: [(0, '5655.926'), (1, '5632.857')] [2023-12-26 01:20:19,172][123090] Updated weights for policy 1, policy_version 218919 (0.0008) [2023-12-26 01:20:19,175][123091] Updated weights for policy 0, policy_version 219831 (0.0010) [2023-12-26 01:20:19,233][123090] Updated weights for policy 1, policy_version 218929 (0.0008) [2023-12-26 01:20:19,235][123091] Updated weights for policy 0, policy_version 219841 (0.0010) [2023-12-26 01:20:19,292][123090] Updated weights for policy 1, policy_version 218939 (0.0007) [2023-12-26 01:20:19,295][123091] Updated weights for policy 0, policy_version 219851 (0.0010) [2023-12-26 01:20:20,104][123090] Updated weights for policy 1, policy_version 218949 (0.0009) [2023-12-26 01:20:20,158][123091] Updated weights for policy 0, policy_version 219861 (0.0008) [2023-12-26 01:20:20,161][123090] Updated weights for policy 1, policy_version 218959 (0.0009) [2023-12-26 01:20:20,207][123091] Updated weights for policy 0, policy_version 219871 (0.0007) [2023-12-26 01:20:20,224][123090] Updated weights for policy 1, policy_version 218969 (0.0009) [2023-12-26 01:20:20,257][123091] Updated weights for policy 0, policy_version 219881 (0.0008) [2023-12-26 01:20:21,030][123090] Updated weights for policy 1, policy_version 218979 (0.0008) [2023-12-26 01:20:21,098][123090] Updated weights for policy 1, policy_version 218989 (0.0008) [2023-12-26 01:20:21,168][123090] Updated weights for policy 1, policy_version 218999 (0.0008) [2023-12-26 01:20:21,175][123091] Updated weights for policy 0, policy_version 219891 (0.0010) [2023-12-26 01:20:21,242][123091] Updated weights for policy 0, policy_version 219901 (0.0009) [2023-12-26 01:20:21,311][123091] Updated weights for policy 0, policy_version 219911 (0.0009) [2023-12-26 01:20:21,906][123090] Updated weights for policy 1, policy_version 219009 (0.0008) [2023-12-26 01:20:21,958][123090] Updated weights for policy 1, policy_version 219019 (0.0008) [2023-12-26 01:20:22,013][123090] Updated weights for policy 1, policy_version 219029 (0.0009) [2023-12-26 01:20:22,071][123090] Updated weights for policy 1, policy_version 219039 (0.0009) [2023-12-26 01:20:22,110][123091] Updated weights for policy 0, policy_version 219921 (0.0009) [2023-12-26 01:20:22,178][123091] Updated weights for policy 0, policy_version 219931 (0.0006) [2023-12-26 01:20:22,256][123091] Updated weights for policy 0, policy_version 219941 (0.0006) [2023-12-26 01:20:22,332][123091] Updated weights for policy 0, policy_version 219951 (0.0007) [2023-12-26 01:20:22,985][123091] Updated weights for policy 0, policy_version 219961 (0.0007) [2023-12-26 01:20:22,995][123090] Updated weights for policy 1, policy_version 219049 (0.0008) [2023-12-26 01:20:23,047][123090] Updated weights for policy 1, policy_version 219059 (0.0007) [2023-12-26 01:20:23,048][123091] Updated weights for policy 0, policy_version 219971 (0.0008) [2023-12-26 01:20:23,105][123091] Updated weights for policy 0, policy_version 219981 (0.0009) [2023-12-26 01:20:23,110][123090] Updated weights for policy 1, policy_version 219069 (0.0005) [2023-12-26 01:20:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 112402432. Throughput: 0: 8744.8, 1: 9031.1. Samples: 112382332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:23,785][121949] Avg episode reward: [(0, '5697.824'), (1, '5630.382')] [2023-12-26 01:20:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000219984_56320000.pth... [2023-12-26 01:20:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000219072_56082432.pth... [2023-12-26 01:20:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000218016_55812096.pth [2023-12-26 01:20:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000218960_56057856.pth [2023-12-26 01:20:23,898][123091] Updated weights for policy 0, policy_version 219991 (0.0007) [2023-12-26 01:20:23,936][123090] Updated weights for policy 1, policy_version 219079 (0.0007) [2023-12-26 01:20:23,956][123091] Updated weights for policy 0, policy_version 220001 (0.0006) [2023-12-26 01:20:23,986][123090] Updated weights for policy 1, policy_version 219089 (0.0009) [2023-12-26 01:20:24,012][123091] Updated weights for policy 0, policy_version 220011 (0.0006) [2023-12-26 01:20:24,033][123090] Updated weights for policy 1, policy_version 219099 (0.0007) [2023-12-26 01:20:24,787][123091] Updated weights for policy 0, policy_version 220021 (0.0008) [2023-12-26 01:20:24,822][123090] Updated weights for policy 1, policy_version 219109 (0.0006) [2023-12-26 01:20:24,837][123091] Updated weights for policy 0, policy_version 220031 (0.0008) [2023-12-26 01:20:24,878][123090] Updated weights for policy 1, policy_version 219119 (0.0008) [2023-12-26 01:20:24,889][123091] Updated weights for policy 0, policy_version 220041 (0.0007) [2023-12-26 01:20:24,948][123090] Updated weights for policy 1, policy_version 219129 (0.0008) [2023-12-26 01:20:25,630][123091] Updated weights for policy 0, policy_version 220051 (0.0008) [2023-12-26 01:20:25,683][123091] Updated weights for policy 0, policy_version 220061 (0.0005) [2023-12-26 01:20:25,735][123091] Updated weights for policy 0, policy_version 220071 (0.0005) [2023-12-26 01:20:25,816][123090] Updated weights for policy 1, policy_version 219139 (0.0010) [2023-12-26 01:20:25,876][123090] Updated weights for policy 1, policy_version 219149 (0.0010) [2023-12-26 01:20:25,942][123090] Updated weights for policy 1, policy_version 219159 (0.0008) [2023-12-26 01:20:26,516][123091] Updated weights for policy 0, policy_version 220081 (0.0006) [2023-12-26 01:20:26,568][123091] Updated weights for policy 0, policy_version 220091 (0.0009) [2023-12-26 01:20:26,570][123090] Updated weights for policy 1, policy_version 219169 (0.0010) [2023-12-26 01:20:26,620][123091] Updated weights for policy 0, policy_version 220101 (0.0008) [2023-12-26 01:20:26,631][123090] Updated weights for policy 1, policy_version 219179 (0.0010) [2023-12-26 01:20:26,667][123091] Updated weights for policy 0, policy_version 220111 (0.0008) [2023-12-26 01:20:26,683][123090] Updated weights for policy 1, policy_version 219189 (0.0009) [2023-12-26 01:20:26,736][123090] Updated weights for policy 1, policy_version 219199 (0.0006) [2023-12-26 01:20:27,451][123090] Updated weights for policy 1, policy_version 219209 (0.0008) [2023-12-26 01:20:27,490][123091] Updated weights for policy 0, policy_version 220121 (0.0009) [2023-12-26 01:20:27,508][123090] Updated weights for policy 1, policy_version 219219 (0.0007) [2023-12-26 01:20:27,549][123091] Updated weights for policy 0, policy_version 220131 (0.0009) [2023-12-26 01:20:27,564][123090] Updated weights for policy 1, policy_version 219229 (0.0007) [2023-12-26 01:20:27,607][123091] Updated weights for policy 0, policy_version 220141 (0.0007) [2023-12-26 01:20:28,387][123091] Updated weights for policy 0, policy_version 220151 (0.0009) [2023-12-26 01:20:28,401][123090] Updated weights for policy 1, policy_version 219239 (0.0009) [2023-12-26 01:20:28,438][123091] Updated weights for policy 0, policy_version 220161 (0.0008) [2023-12-26 01:20:28,453][123090] Updated weights for policy 1, policy_version 219249 (0.0008) [2023-12-26 01:20:28,499][123091] Updated weights for policy 0, policy_version 220171 (0.0008) [2023-12-26 01:20:28,504][123090] Updated weights for policy 1, policy_version 219259 (0.0008) [2023-12-26 01:20:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 112500736. Throughput: 0: 8835.2, 1: 9033.1. Samples: 112491288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:28,784][121949] Avg episode reward: [(0, '5745.982'), (1, '5585.146')] [2023-12-26 01:20:29,184][123091] Updated weights for policy 0, policy_version 220181 (0.0007) [2023-12-26 01:20:29,239][123091] Updated weights for policy 0, policy_version 220191 (0.0006) [2023-12-26 01:20:29,298][123091] Updated weights for policy 0, policy_version 220201 (0.0009) [2023-12-26 01:20:29,343][123090] Updated weights for policy 1, policy_version 219269 (0.0009) [2023-12-26 01:20:29,412][123090] Updated weights for policy 1, policy_version 219279 (0.0010) [2023-12-26 01:20:29,483][123090] Updated weights for policy 1, policy_version 219289 (0.0011) [2023-12-26 01:20:30,181][123091] Updated weights for policy 0, policy_version 220211 (0.0010) [2023-12-26 01:20:30,237][123091] Updated weights for policy 0, policy_version 220221 (0.0010) [2023-12-26 01:20:30,248][123090] Updated weights for policy 1, policy_version 219299 (0.0009) [2023-12-26 01:20:30,301][123091] Updated weights for policy 0, policy_version 220231 (0.0009) [2023-12-26 01:20:30,311][123090] Updated weights for policy 1, policy_version 219309 (0.0006) [2023-12-26 01:20:30,377][123090] Updated weights for policy 1, policy_version 219319 (0.0006) [2023-12-26 01:20:31,101][123091] Updated weights for policy 0, policy_version 220241 (0.0009) [2023-12-26 01:20:31,107][123090] Updated weights for policy 1, policy_version 219329 (0.0006) [2023-12-26 01:20:31,170][123091] Updated weights for policy 0, policy_version 220251 (0.0009) [2023-12-26 01:20:31,172][123090] Updated weights for policy 1, policy_version 219339 (0.0010) [2023-12-26 01:20:31,240][123091] Updated weights for policy 0, policy_version 220261 (0.0006) [2023-12-26 01:20:31,241][123090] Updated weights for policy 1, policy_version 219349 (0.0011) [2023-12-26 01:20:31,304][123091] Updated weights for policy 0, policy_version 220271 (0.0009) [2023-12-26 01:20:31,306][123090] Updated weights for policy 1, policy_version 219359 (0.0008) [2023-12-26 01:20:32,059][123090] Updated weights for policy 1, policy_version 219369 (0.0009) [2023-12-26 01:20:32,091][123091] Updated weights for policy 0, policy_version 220281 (0.0007) [2023-12-26 01:20:32,113][123090] Updated weights for policy 1, policy_version 219379 (0.0006) [2023-12-26 01:20:32,157][123091] Updated weights for policy 0, policy_version 220291 (0.0005) [2023-12-26 01:20:32,169][123090] Updated weights for policy 1, policy_version 219389 (0.0005) [2023-12-26 01:20:32,225][123091] Updated weights for policy 0, policy_version 220301 (0.0005) [2023-12-26 01:20:33,002][123090] Updated weights for policy 1, policy_version 219399 (0.0007) [2023-12-26 01:20:33,005][123091] Updated weights for policy 0, policy_version 220311 (0.0008) [2023-12-26 01:20:33,057][123090] Updated weights for policy 1, policy_version 219409 (0.0010) [2023-12-26 01:20:33,068][123091] Updated weights for policy 0, policy_version 220321 (0.0007) [2023-12-26 01:20:33,123][123090] Updated weights for policy 1, policy_version 219419 (0.0008) [2023-12-26 01:20:33,133][123091] Updated weights for policy 0, policy_version 220331 (0.0008) [2023-12-26 01:20:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 112582656. Throughput: 0: 8852.0, 1: 9008.8. Samples: 112597812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:33,784][121949] Avg episode reward: [(0, '5689.772'), (1, '5509.293')] [2023-12-26 01:20:33,952][123090] Updated weights for policy 1, policy_version 219429 (0.0009) [2023-12-26 01:20:33,960][123091] Updated weights for policy 0, policy_version 220341 (0.0008) [2023-12-26 01:20:34,005][123090] Updated weights for policy 1, policy_version 219439 (0.0008) [2023-12-26 01:20:34,023][123091] Updated weights for policy 0, policy_version 220351 (0.0009) [2023-12-26 01:20:34,057][123090] Updated weights for policy 1, policy_version 219449 (0.0008) [2023-12-26 01:20:34,083][123091] Updated weights for policy 0, policy_version 220361 (0.0008) [2023-12-26 01:20:34,857][123090] Updated weights for policy 1, policy_version 219459 (0.0009) [2023-12-26 01:20:34,913][123090] Updated weights for policy 1, policy_version 219469 (0.0009) [2023-12-26 01:20:34,945][123091] Updated weights for policy 0, policy_version 220371 (0.0010) [2023-12-26 01:20:34,970][123090] Updated weights for policy 1, policy_version 219479 (0.0009) [2023-12-26 01:20:35,003][123091] Updated weights for policy 0, policy_version 220381 (0.0008) [2023-12-26 01:20:35,056][123091] Updated weights for policy 0, policy_version 220391 (0.0009) [2023-12-26 01:20:35,792][123090] Updated weights for policy 1, policy_version 219489 (0.0010) [2023-12-26 01:20:35,855][123090] Updated weights for policy 1, policy_version 219499 (0.0009) [2023-12-26 01:20:35,905][123091] Updated weights for policy 0, policy_version 220401 (0.0009) [2023-12-26 01:20:35,916][123090] Updated weights for policy 1, policy_version 219509 (0.0009) [2023-12-26 01:20:35,961][123091] Updated weights for policy 0, policy_version 220411 (0.0009) [2023-12-26 01:20:35,979][123090] Updated weights for policy 1, policy_version 219519 (0.0008) [2023-12-26 01:20:36,023][123091] Updated weights for policy 0, policy_version 220421 (0.0009) [2023-12-26 01:20:36,087][123091] Updated weights for policy 0, policy_version 220431 (0.0009) [2023-12-26 01:20:36,764][123090] Updated weights for policy 1, policy_version 219530 (0.0008) [2023-12-26 01:20:36,840][123090] Updated weights for policy 1, policy_version 219540 (0.0007) [2023-12-26 01:20:36,904][123090] Updated weights for policy 1, policy_version 219550 (0.0010) [2023-12-26 01:20:36,979][123091] Updated weights for policy 0, policy_version 220441 (0.0009) [2023-12-26 01:20:37,038][123091] Updated weights for policy 0, policy_version 220451 (0.0009) [2023-12-26 01:20:37,108][123091] Updated weights for policy 0, policy_version 220461 (0.0009) [2023-12-26 01:20:37,677][123090] Updated weights for policy 1, policy_version 219560 (0.0010) [2023-12-26 01:20:37,736][123090] Updated weights for policy 1, policy_version 219570 (0.0009) [2023-12-26 01:20:37,802][123090] Updated weights for policy 1, policy_version 219580 (0.0009) [2023-12-26 01:20:37,954][123091] Updated weights for policy 0, policy_version 220471 (0.0007) [2023-12-26 01:20:38,020][123091] Updated weights for policy 0, policy_version 220481 (0.0009) [2023-12-26 01:20:38,082][123091] Updated weights for policy 0, policy_version 220491 (0.0009) [2023-12-26 01:20:38,661][123090] Updated weights for policy 1, policy_version 219590 (0.0010) [2023-12-26 01:20:38,729][123090] Updated weights for policy 1, policy_version 219600 (0.0010) [2023-12-26 01:20:38,782][123090] Updated weights for policy 1, policy_version 219611 (0.0010) [2023-12-26 01:20:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 112664576. Throughput: 0: 8832.6, 1: 9051.6. Samples: 112649076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:38,784][121949] Avg episode reward: [(0, '5733.849'), (1, '5421.435')] [2023-12-26 01:20:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000220496_56451072.pth... [2023-12-26 01:20:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000219472_56188928.pth [2023-12-26 01:20:38,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000219616_56221696.pth... [2023-12-26 01:20:38,812][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000218560_55951360.pth [2023-12-26 01:20:38,854][123091] Updated weights for policy 0, policy_version 220501 (0.0010) [2023-12-26 01:20:38,908][123091] Updated weights for policy 0, policy_version 220511 (0.0009) [2023-12-26 01:20:38,963][123091] Updated weights for policy 0, policy_version 220521 (0.0009) [2023-12-26 01:20:39,649][123090] Updated weights for policy 1, policy_version 219621 (0.0009) [2023-12-26 01:20:39,706][123091] Updated weights for policy 0, policy_version 220531 (0.0008) [2023-12-26 01:20:39,715][123090] Updated weights for policy 1, policy_version 219631 (0.0009) [2023-12-26 01:20:39,772][123091] Updated weights for policy 0, policy_version 220541 (0.0006) [2023-12-26 01:20:39,790][123090] Updated weights for policy 1, policy_version 219641 (0.0008) [2023-12-26 01:20:39,837][123091] Updated weights for policy 0, policy_version 220551 (0.0008) [2023-12-26 01:20:40,613][123090] Updated weights for policy 1, policy_version 219651 (0.0009) [2023-12-26 01:20:40,633][123091] Updated weights for policy 0, policy_version 220561 (0.0009) [2023-12-26 01:20:40,686][123091] Updated weights for policy 0, policy_version 220571 (0.0005) [2023-12-26 01:20:40,687][123090] Updated weights for policy 1, policy_version 219661 (0.0010) [2023-12-26 01:20:40,745][123091] Updated weights for policy 0, policy_version 220581 (0.0005) [2023-12-26 01:20:40,757][123090] Updated weights for policy 1, policy_version 219671 (0.0008) [2023-12-26 01:20:40,800][123091] Updated weights for policy 0, policy_version 220591 (0.0005) [2023-12-26 01:20:41,596][123091] Updated weights for policy 0, policy_version 220601 (0.0008) [2023-12-26 01:20:41,621][123090] Updated weights for policy 1, policy_version 219681 (0.0009) [2023-12-26 01:20:41,668][123091] Updated weights for policy 0, policy_version 220611 (0.0010) [2023-12-26 01:20:41,689][123090] Updated weights for policy 1, policy_version 219691 (0.0008) [2023-12-26 01:20:41,745][123091] Updated weights for policy 0, policy_version 220621 (0.0009) [2023-12-26 01:20:41,766][123090] Updated weights for policy 1, policy_version 219701 (0.0008) [2023-12-26 01:20:41,839][123090] Updated weights for policy 1, policy_version 219711 (0.0008) [2023-12-26 01:20:42,633][123090] Updated weights for policy 1, policy_version 219721 (0.0010) [2023-12-26 01:20:42,668][123091] Updated weights for policy 0, policy_version 220631 (0.0011) [2023-12-26 01:20:42,701][123090] Updated weights for policy 1, policy_version 219731 (0.0009) [2023-12-26 01:20:42,737][123091] Updated weights for policy 0, policy_version 220641 (0.0011) [2023-12-26 01:20:42,768][123090] Updated weights for policy 1, policy_version 219741 (0.0006) [2023-12-26 01:20:42,797][123091] Updated weights for policy 0, policy_version 220651 (0.0011) [2023-12-26 01:20:43,505][123090] Updated weights for policy 1, policy_version 219751 (0.0009) [2023-12-26 01:20:43,555][123090] Updated weights for policy 1, policy_version 219761 (0.0010) [2023-12-26 01:20:43,599][123091] Updated weights for policy 0, policy_version 220661 (0.0008) [2023-12-26 01:20:43,610][123090] Updated weights for policy 1, policy_version 219771 (0.0010) [2023-12-26 01:20:43,664][123091] Updated weights for policy 0, policy_version 220671 (0.0007) [2023-12-26 01:20:43,730][123091] Updated weights for policy 0, policy_version 220681 (0.0007) [2023-12-26 01:20:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 112762880. Throughput: 0: 8802.6, 1: 8930.5. Samples: 112750980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:20:43,785][121949] Avg episode reward: [(0, '5873.589'), (1, '5487.072')] [2023-12-26 01:20:44,400][123090] Updated weights for policy 1, policy_version 219781 (0.0008) [2023-12-26 01:20:44,447][123090] Updated weights for policy 1, policy_version 219791 (0.0006) [2023-12-26 01:20:44,501][123091] Updated weights for policy 0, policy_version 220691 (0.0006) [2023-12-26 01:20:44,504][123090] Updated weights for policy 1, policy_version 219801 (0.0006) [2023-12-26 01:20:44,564][123091] Updated weights for policy 0, policy_version 220701 (0.0009) [2023-12-26 01:20:44,626][123091] Updated weights for policy 0, policy_version 220711 (0.0009) [2023-12-26 01:20:45,287][123090] Updated weights for policy 1, policy_version 219811 (0.0007) [2023-12-26 01:20:45,351][123090] Updated weights for policy 1, policy_version 219821 (0.0011) [2023-12-26 01:20:45,419][123090] Updated weights for policy 1, policy_version 219831 (0.0011) [2023-12-26 01:20:45,455][123091] Updated weights for policy 0, policy_version 220721 (0.0010) [2023-12-26 01:20:45,520][123091] Updated weights for policy 0, policy_version 220731 (0.0007) [2023-12-26 01:20:45,595][123091] Updated weights for policy 0, policy_version 220741 (0.0006) [2023-12-26 01:20:45,656][123091] Updated weights for policy 0, policy_version 220751 (0.0009) [2023-12-26 01:20:46,114][123090] Updated weights for policy 1, policy_version 219841 (0.0010) [2023-12-26 01:20:46,162][123090] Updated weights for policy 1, policy_version 219851 (0.0005) [2023-12-26 01:20:46,210][123090] Updated weights for policy 1, policy_version 219861 (0.0005) [2023-12-26 01:20:46,256][123090] Updated weights for policy 1, policy_version 219871 (0.0005) [2023-12-26 01:20:46,505][123091] Updated weights for policy 0, policy_version 220762 (0.0010) [2023-12-26 01:20:46,565][123091] Updated weights for policy 0, policy_version 220772 (0.0010) [2023-12-26 01:20:46,616][123091] Updated weights for policy 0, policy_version 220782 (0.0010) [2023-12-26 01:20:46,940][123090] Updated weights for policy 1, policy_version 219881 (0.0010) [2023-12-26 01:20:47,003][123090] Updated weights for policy 1, policy_version 219891 (0.0010) [2023-12-26 01:20:47,061][123090] Updated weights for policy 1, policy_version 219901 (0.0009) [2023-12-26 01:20:47,392][123091] Updated weights for policy 0, policy_version 220792 (0.0006) [2023-12-26 01:20:47,452][123091] Updated weights for policy 0, policy_version 220802 (0.0005) [2023-12-26 01:20:47,499][123091] Updated weights for policy 0, policy_version 220812 (0.0005) [2023-12-26 01:20:47,811][123090] Updated weights for policy 1, policy_version 219911 (0.0009) [2023-12-26 01:20:47,868][123090] Updated weights for policy 1, policy_version 219921 (0.0005) [2023-12-26 01:20:47,928][123090] Updated weights for policy 1, policy_version 219931 (0.0005) [2023-12-26 01:20:48,136][123091] Updated weights for policy 0, policy_version 220822 (0.0008) [2023-12-26 01:20:48,198][123091] Updated weights for policy 0, policy_version 220832 (0.0010) [2023-12-26 01:20:48,260][123091] Updated weights for policy 0, policy_version 220842 (0.0010) [2023-12-26 01:20:48,753][123090] Updated weights for policy 1, policy_version 219941 (0.0007) [2023-12-26 01:20:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 112844800. Throughput: 0: 8824.7, 1: 8963.2. Samples: 112860408. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:20:48,785][121949] Avg episode reward: [(0, '5871.210'), (1, '5539.346')] [2023-12-26 01:20:48,818][123090] Updated weights for policy 1, policy_version 219951 (0.0009) [2023-12-26 01:20:48,880][123090] Updated weights for policy 1, policy_version 219961 (0.0009) [2023-12-26 01:20:49,085][123091] Updated weights for policy 0, policy_version 220852 (0.0010) [2023-12-26 01:20:49,155][123091] Updated weights for policy 0, policy_version 220862 (0.0011) [2023-12-26 01:20:49,209][123091] Updated weights for policy 0, policy_version 220872 (0.0009) [2023-12-26 01:20:49,665][123090] Updated weights for policy 1, policy_version 219971 (0.0009) [2023-12-26 01:20:49,726][123090] Updated weights for policy 1, policy_version 219981 (0.0009) [2023-12-26 01:20:49,778][123090] Updated weights for policy 1, policy_version 219991 (0.0009) [2023-12-26 01:20:50,035][123091] Updated weights for policy 0, policy_version 220882 (0.0007) [2023-12-26 01:20:50,109][123091] Updated weights for policy 0, policy_version 220892 (0.0010) [2023-12-26 01:20:50,172][123091] Updated weights for policy 0, policy_version 220902 (0.0010) [2023-12-26 01:20:50,223][123091] Updated weights for policy 0, policy_version 220912 (0.0010) [2023-12-26 01:20:50,606][123090] Updated weights for policy 1, policy_version 220001 (0.0007) [2023-12-26 01:20:50,681][123090] Updated weights for policy 1, policy_version 220011 (0.0006) [2023-12-26 01:20:50,759][123090] Updated weights for policy 1, policy_version 220021 (0.0006) [2023-12-26 01:20:50,828][123090] Updated weights for policy 1, policy_version 220031 (0.0008) [2023-12-26 01:20:51,006][123091] Updated weights for policy 0, policy_version 220922 (0.0009) [2023-12-26 01:20:51,080][123091] Updated weights for policy 0, policy_version 220932 (0.0010) [2023-12-26 01:20:51,153][123091] Updated weights for policy 0, policy_version 220942 (0.0008) [2023-12-26 01:20:51,566][123090] Updated weights for policy 1, policy_version 220041 (0.0009) [2023-12-26 01:20:51,637][123090] Updated weights for policy 1, policy_version 220051 (0.0009) [2023-12-26 01:20:51,697][123090] Updated weights for policy 1, policy_version 220061 (0.0010) [2023-12-26 01:20:51,929][123091] Updated weights for policy 0, policy_version 220952 (0.0005) [2023-12-26 01:20:51,986][123091] Updated weights for policy 0, policy_version 220962 (0.0005) [2023-12-26 01:20:52,045][123091] Updated weights for policy 0, policy_version 220972 (0.0005) [2023-12-26 01:20:52,571][123090] Updated weights for policy 1, policy_version 220071 (0.0009) [2023-12-26 01:20:52,625][123090] Updated weights for policy 1, policy_version 220081 (0.0009) [2023-12-26 01:20:52,682][123090] Updated weights for policy 1, policy_version 220091 (0.0009) [2023-12-26 01:20:52,795][123091] Updated weights for policy 0, policy_version 220982 (0.0008) [2023-12-26 01:20:52,852][123091] Updated weights for policy 0, policy_version 220992 (0.0008) [2023-12-26 01:20:52,915][123091] Updated weights for policy 0, policy_version 221002 (0.0010) [2023-12-26 01:20:53,527][123090] Updated weights for policy 1, policy_version 220101 (0.0010) [2023-12-26 01:20:53,578][123090] Updated weights for policy 1, policy_version 220111 (0.0009) [2023-12-26 01:20:53,633][123090] Updated weights for policy 1, policy_version 220121 (0.0010) [2023-12-26 01:20:53,731][123091] Updated weights for policy 0, policy_version 221012 (0.0009) [2023-12-26 01:20:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 112934912. Throughput: 0: 8802.4, 1: 8914.6. Samples: 112912744. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:20:53,785][121949] Avg episode reward: [(0, '5767.411'), (1, '5570.432')] [2023-12-26 01:20:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000220128_56352768.pth... [2023-12-26 01:20:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000219072_56082432.pth [2023-12-26 01:20:53,806][123091] Updated weights for policy 0, policy_version 221022 (0.0006) [2023-12-26 01:20:53,868][123091] Updated weights for policy 0, policy_version 221032 (0.0007) [2023-12-26 01:20:53,925][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000221040_56590336.pth... [2023-12-26 01:20:53,930][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000219984_56320000.pth [2023-12-26 01:20:54,371][123090] Updated weights for policy 1, policy_version 220131 (0.0009) [2023-12-26 01:20:54,444][123090] Updated weights for policy 1, policy_version 220141 (0.0005) [2023-12-26 01:20:54,497][123090] Updated weights for policy 1, policy_version 220151 (0.0005) [2023-12-26 01:20:54,549][123091] Updated weights for policy 0, policy_version 221042 (0.0008) [2023-12-26 01:20:54,603][123091] Updated weights for policy 0, policy_version 221052 (0.0007) [2023-12-26 01:20:54,659][123091] Updated weights for policy 0, policy_version 221062 (0.0007) [2023-12-26 01:20:54,706][123091] Updated weights for policy 0, policy_version 221072 (0.0005) [2023-12-26 01:20:55,167][123090] Updated weights for policy 1, policy_version 220161 (0.0005) [2023-12-26 01:20:55,248][123090] Updated weights for policy 1, policy_version 220171 (0.0005) [2023-12-26 01:20:55,323][123090] Updated weights for policy 1, policy_version 220181 (0.0005) [2023-12-26 01:20:55,388][123090] Updated weights for policy 1, policy_version 220191 (0.0006) [2023-12-26 01:20:55,397][123091] Updated weights for policy 0, policy_version 221082 (0.0006) [2023-12-26 01:20:55,461][123091] Updated weights for policy 0, policy_version 221092 (0.0008) [2023-12-26 01:20:55,525][123091] Updated weights for policy 0, policy_version 221102 (0.0008) [2023-12-26 01:20:55,997][123090] Updated weights for policy 1, policy_version 220201 (0.0005) [2023-12-26 01:20:56,052][123090] Updated weights for policy 1, policy_version 220211 (0.0005) [2023-12-26 01:20:56,108][123090] Updated weights for policy 1, policy_version 220221 (0.0005) [2023-12-26 01:20:56,153][123091] Updated weights for policy 0, policy_version 221112 (0.0007) [2023-12-26 01:20:56,225][123091] Updated weights for policy 0, policy_version 221122 (0.0008) [2023-12-26 01:20:56,299][123091] Updated weights for policy 0, policy_version 221132 (0.0008) [2023-12-26 01:20:56,756][123090] Updated weights for policy 1, policy_version 220231 (0.0005) [2023-12-26 01:20:56,814][123090] Updated weights for policy 1, policy_version 220241 (0.0005) [2023-12-26 01:20:56,878][123090] Updated weights for policy 1, policy_version 220251 (0.0005) [2023-12-26 01:20:56,968][123091] Updated weights for policy 0, policy_version 221142 (0.0009) [2023-12-26 01:20:57,021][123091] Updated weights for policy 0, policy_version 221153 (0.0010) [2023-12-26 01:20:57,074][123091] Updated weights for policy 0, policy_version 221164 (0.0009) [2023-12-26 01:20:57,534][123090] Updated weights for policy 1, policy_version 220261 (0.0007) [2023-12-26 01:20:57,598][123090] Updated weights for policy 1, policy_version 220271 (0.0009) [2023-12-26 01:20:57,649][123090] Updated weights for policy 1, policy_version 220281 (0.0009) [2023-12-26 01:20:57,975][123091] Updated weights for policy 0, policy_version 221175 (0.0010) [2023-12-26 01:20:58,040][123091] Updated weights for policy 0, policy_version 221185 (0.0010) [2023-12-26 01:20:58,098][123091] Updated weights for policy 0, policy_version 221195 (0.0009) [2023-12-26 01:20:58,476][123090] Updated weights for policy 1, policy_version 220291 (0.0009) [2023-12-26 01:20:58,545][123090] Updated weights for policy 1, policy_version 220301 (0.0008) [2023-12-26 01:20:58,613][123090] Updated weights for policy 1, policy_version 220311 (0.0009) [2023-12-26 01:20:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 113033216. Throughput: 0: 8896.5, 1: 9041.6. Samples: 113027308. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:20:58,785][121949] Avg episode reward: [(0, '5770.270'), (1, '5616.330')] [2023-12-26 01:20:58,998][123091] Updated weights for policy 0, policy_version 221205 (0.0009) [2023-12-26 01:20:59,063][123091] Updated weights for policy 0, policy_version 221215 (0.0008) [2023-12-26 01:20:59,124][123091] Updated weights for policy 0, policy_version 221225 (0.0008) [2023-12-26 01:20:59,618][123090] Updated weights for policy 1, policy_version 220321 (0.0009) [2023-12-26 01:20:59,678][123090] Updated weights for policy 1, policy_version 220331 (0.0009) [2023-12-26 01:20:59,746][123090] Updated weights for policy 1, policy_version 220341 (0.0010) [2023-12-26 01:20:59,828][123091] Updated weights for policy 0, policy_version 221235 (0.0007) [2023-12-26 01:20:59,828][123090] Updated weights for policy 1, policy_version 220351 (0.0009) [2023-12-26 01:20:59,894][123091] Updated weights for policy 0, policy_version 221245 (0.0009) [2023-12-26 01:20:59,956][123091] Updated weights for policy 0, policy_version 221255 (0.0009) [2023-12-26 01:21:00,657][123090] Updated weights for policy 1, policy_version 220361 (0.0010) [2023-12-26 01:21:00,701][123091] Updated weights for policy 0, policy_version 221265 (0.0008) [2023-12-26 01:21:00,709][123090] Updated weights for policy 1, policy_version 220371 (0.0010) [2023-12-26 01:21:00,756][123091] Updated weights for policy 0, policy_version 221275 (0.0005) [2023-12-26 01:21:00,768][123090] Updated weights for policy 1, policy_version 220381 (0.0010) [2023-12-26 01:21:00,810][123091] Updated weights for policy 0, policy_version 221285 (0.0006) [2023-12-26 01:21:00,869][123091] Updated weights for policy 0, policy_version 221295 (0.0009) [2023-12-26 01:21:01,634][123090] Updated weights for policy 1, policy_version 220391 (0.0010) [2023-12-26 01:21:01,689][123090] Updated weights for policy 1, policy_version 220401 (0.0008) [2023-12-26 01:21:01,705][123091] Updated weights for policy 0, policy_version 221305 (0.0008) [2023-12-26 01:21:01,755][123090] Updated weights for policy 1, policy_version 220411 (0.0009) [2023-12-26 01:21:01,767][123091] Updated weights for policy 0, policy_version 221315 (0.0008) [2023-12-26 01:21:01,830][123091] Updated weights for policy 0, policy_version 221325 (0.0009) [2023-12-26 01:21:02,591][123090] Updated weights for policy 1, policy_version 220421 (0.0007) [2023-12-26 01:21:02,644][123090] Updated weights for policy 1, policy_version 220431 (0.0009) [2023-12-26 01:21:02,663][123091] Updated weights for policy 0, policy_version 221335 (0.0008) [2023-12-26 01:21:02,710][123090] Updated weights for policy 1, policy_version 220441 (0.0009) [2023-12-26 01:21:02,729][123091] Updated weights for policy 0, policy_version 221345 (0.0009) [2023-12-26 01:21:02,790][123091] Updated weights for policy 0, policy_version 221355 (0.0010) [2023-12-26 01:21:03,528][123090] Updated weights for policy 1, policy_version 220451 (0.0009) [2023-12-26 01:21:03,584][123090] Updated weights for policy 1, policy_version 220461 (0.0009) [2023-12-26 01:21:03,608][123091] Updated weights for policy 0, policy_version 221365 (0.0008) [2023-12-26 01:21:03,645][123090] Updated weights for policy 1, policy_version 220471 (0.0007) [2023-12-26 01:21:03,667][123091] Updated weights for policy 0, policy_version 221375 (0.0009) [2023-12-26 01:21:03,728][123091] Updated weights for policy 0, policy_version 221385 (0.0009) [2023-12-26 01:21:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 113123328. Throughput: 0: 8861.6, 1: 8866.5. Samples: 113129172. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:03,785][121949] Avg episode reward: [(0, '5863.844'), (1, '5619.339')] [2023-12-26 01:21:04,411][123091] Updated weights for policy 0, policy_version 221395 (0.0009) [2023-12-26 01:21:04,469][123091] Updated weights for policy 0, policy_version 221405 (0.0007) [2023-12-26 01:21:04,514][123090] Updated weights for policy 1, policy_version 220481 (0.0009) [2023-12-26 01:21:04,529][123091] Updated weights for policy 0, policy_version 221415 (0.0008) [2023-12-26 01:21:04,585][123090] Updated weights for policy 1, policy_version 220491 (0.0008) [2023-12-26 01:21:04,649][123090] Updated weights for policy 1, policy_version 220501 (0.0008) [2023-12-26 01:21:04,719][123090] Updated weights for policy 1, policy_version 220511 (0.0006) [2023-12-26 01:21:05,340][123090] Updated weights for policy 1, policy_version 220521 (0.0009) [2023-12-26 01:21:05,372][123091] Updated weights for policy 0, policy_version 221425 (0.0008) [2023-12-26 01:21:05,399][123090] Updated weights for policy 1, policy_version 220531 (0.0009) [2023-12-26 01:21:05,429][123091] Updated weights for policy 0, policy_version 221435 (0.0007) [2023-12-26 01:21:05,448][123090] Updated weights for policy 1, policy_version 220541 (0.0008) [2023-12-26 01:21:05,482][123091] Updated weights for policy 0, policy_version 221445 (0.0009) [2023-12-26 01:21:05,536][123091] Updated weights for policy 0, policy_version 221455 (0.0009) [2023-12-26 01:21:06,182][123090] Updated weights for policy 1, policy_version 220551 (0.0007) [2023-12-26 01:21:06,249][123090] Updated weights for policy 1, policy_version 220561 (0.0008) [2023-12-26 01:21:06,316][123090] Updated weights for policy 1, policy_version 220571 (0.0009) [2023-12-26 01:21:06,418][123091] Updated weights for policy 0, policy_version 221465 (0.0009) [2023-12-26 01:21:06,480][123091] Updated weights for policy 0, policy_version 221475 (0.0010) [2023-12-26 01:21:06,540][123091] Updated weights for policy 0, policy_version 221485 (0.0010) [2023-12-26 01:21:07,118][123090] Updated weights for policy 1, policy_version 220581 (0.0009) [2023-12-26 01:21:07,173][123090] Updated weights for policy 1, policy_version 220591 (0.0009) [2023-12-26 01:21:07,235][123090] Updated weights for policy 1, policy_version 220601 (0.0009) [2023-12-26 01:21:07,377][123091] Updated weights for policy 0, policy_version 221495 (0.0009) [2023-12-26 01:21:07,436][123091] Updated weights for policy 0, policy_version 221505 (0.0010) [2023-12-26 01:21:07,492][123091] Updated weights for policy 0, policy_version 221515 (0.0009) [2023-12-26 01:21:08,072][123090] Updated weights for policy 1, policy_version 220611 (0.0009) [2023-12-26 01:21:08,127][123090] Updated weights for policy 1, policy_version 220621 (0.0010) [2023-12-26 01:21:08,191][123090] Updated weights for policy 1, policy_version 220631 (0.0011) [2023-12-26 01:21:08,343][123091] Updated weights for policy 0, policy_version 221525 (0.0009) [2023-12-26 01:21:08,395][123091] Updated weights for policy 0, policy_version 221535 (0.0007) [2023-12-26 01:21:08,468][123091] Updated weights for policy 0, policy_version 221545 (0.0010) [2023-12-26 01:21:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 113205248. Throughput: 0: 8885.5, 1: 8885.9. Samples: 113182044. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:08,785][121949] Avg episode reward: [(0, '5869.570'), (1, '5642.474')] [2023-12-26 01:21:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000221552_56721408.pth... [2023-12-26 01:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000220640_56483840.pth... [2023-12-26 01:21:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000219616_56221696.pth [2023-12-26 01:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000220496_56451072.pth [2023-12-26 01:21:08,912][123090] Updated weights for policy 1, policy_version 220641 (0.0010) [2023-12-26 01:21:08,983][123090] Updated weights for policy 1, policy_version 220651 (0.0005) [2023-12-26 01:21:09,048][123090] Updated weights for policy 1, policy_version 220661 (0.0010) [2023-12-26 01:21:09,120][123090] Updated weights for policy 1, policy_version 220671 (0.0010) [2023-12-26 01:21:09,222][123091] Updated weights for policy 0, policy_version 221555 (0.0010) [2023-12-26 01:21:09,296][123091] Updated weights for policy 0, policy_version 221565 (0.0009) [2023-12-26 01:21:09,367][123091] Updated weights for policy 0, policy_version 221575 (0.0008) [2023-12-26 01:21:10,016][123090] Updated weights for policy 1, policy_version 220681 (0.0010) [2023-12-26 01:21:10,074][123090] Updated weights for policy 1, policy_version 220691 (0.0010) [2023-12-26 01:21:10,112][123091] Updated weights for policy 0, policy_version 221585 (0.0008) [2023-12-26 01:21:10,138][123090] Updated weights for policy 1, policy_version 220701 (0.0009) [2023-12-26 01:21:10,170][123091] Updated weights for policy 0, policy_version 221595 (0.0006) [2023-12-26 01:21:10,226][123091] Updated weights for policy 0, policy_version 221605 (0.0005) [2023-12-26 01:21:10,290][123091] Updated weights for policy 0, policy_version 221615 (0.0010) [2023-12-26 01:21:10,904][123090] Updated weights for policy 1, policy_version 220711 (0.0006) [2023-12-26 01:21:10,963][123091] Updated weights for policy 0, policy_version 221625 (0.0010) [2023-12-26 01:21:10,970][123090] Updated weights for policy 1, policy_version 220721 (0.0006) [2023-12-26 01:21:11,011][123091] Updated weights for policy 0, policy_version 221635 (0.0010) [2023-12-26 01:21:11,027][123090] Updated weights for policy 1, policy_version 220731 (0.0006) [2023-12-26 01:21:11,073][123091] Updated weights for policy 0, policy_version 221645 (0.0011) [2023-12-26 01:21:11,884][123090] Updated weights for policy 1, policy_version 220741 (0.0010) [2023-12-26 01:21:11,933][123090] Updated weights for policy 1, policy_version 220751 (0.0010) [2023-12-26 01:21:11,954][123091] Updated weights for policy 0, policy_version 221655 (0.0008) [2023-12-26 01:21:11,982][123090] Updated weights for policy 1, policy_version 220761 (0.0011) [2023-12-26 01:21:12,019][123091] Updated weights for policy 0, policy_version 221665 (0.0006) [2023-12-26 01:21:12,086][123091] Updated weights for policy 0, policy_version 221675 (0.0006) [2023-12-26 01:21:12,806][123091] Updated weights for policy 0, policy_version 221685 (0.0008) [2023-12-26 01:21:12,818][123090] Updated weights for policy 1, policy_version 220771 (0.0009) [2023-12-26 01:21:12,870][123090] Updated weights for policy 1, policy_version 220781 (0.0006) [2023-12-26 01:21:12,873][123091] Updated weights for policy 0, policy_version 221695 (0.0011) [2023-12-26 01:21:12,920][123090] Updated weights for policy 1, policy_version 220791 (0.0006) [2023-12-26 01:21:12,944][123091] Updated weights for policy 0, policy_version 221705 (0.0008) [2023-12-26 01:21:13,595][123091] Updated weights for policy 0, policy_version 221715 (0.0005) [2023-12-26 01:21:13,623][123090] Updated weights for policy 1, policy_version 220801 (0.0007) [2023-12-26 01:21:13,666][123091] Updated weights for policy 0, policy_version 221725 (0.0006) [2023-12-26 01:21:13,672][123090] Updated weights for policy 1, policy_version 220811 (0.0010) [2023-12-26 01:21:13,734][123090] Updated weights for policy 1, policy_version 220821 (0.0010) [2023-12-26 01:21:13,739][123091] Updated weights for policy 0, policy_version 221735 (0.0006) [2023-12-26 01:21:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 113287168. Throughput: 0: 8861.0, 1: 8854.5. Samples: 113288484. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:13,784][121949] Avg episode reward: [(0, '5893.925'), (1, '5607.100')] [2023-12-26 01:21:13,790][123090] Updated weights for policy 1, policy_version 220831 (0.0010) [2023-12-26 01:21:14,339][123091] Updated weights for policy 0, policy_version 221745 (0.0006) [2023-12-26 01:21:14,397][123091] Updated weights for policy 0, policy_version 221755 (0.0007) [2023-12-26 01:21:14,464][123091] Updated weights for policy 0, policy_version 221765 (0.0005) [2023-12-26 01:21:14,511][123091] Updated weights for policy 0, policy_version 221775 (0.0005) [2023-12-26 01:21:14,650][123090] Updated weights for policy 1, policy_version 220841 (0.0011) [2023-12-26 01:21:14,710][123090] Updated weights for policy 1, policy_version 220851 (0.0011) [2023-12-26 01:21:14,778][123090] Updated weights for policy 1, policy_version 220861 (0.0010) [2023-12-26 01:21:15,250][123091] Updated weights for policy 0, policy_version 221785 (0.0008) [2023-12-26 01:21:15,313][123091] Updated weights for policy 0, policy_version 221795 (0.0008) [2023-12-26 01:21:15,368][123091] Updated weights for policy 0, policy_version 221805 (0.0008) [2023-12-26 01:21:15,521][123090] Updated weights for policy 1, policy_version 220871 (0.0009) [2023-12-26 01:21:15,573][123090] Updated weights for policy 1, policy_version 220881 (0.0010) [2023-12-26 01:21:15,633][123090] Updated weights for policy 1, policy_version 220891 (0.0010) [2023-12-26 01:21:16,105][123091] Updated weights for policy 0, policy_version 221815 (0.0009) [2023-12-26 01:21:16,162][123091] Updated weights for policy 0, policy_version 221825 (0.0010) [2023-12-26 01:21:16,219][123091] Updated weights for policy 0, policy_version 221835 (0.0009) [2023-12-26 01:21:16,402][123090] Updated weights for policy 1, policy_version 220901 (0.0009) [2023-12-26 01:21:16,451][123090] Updated weights for policy 1, policy_version 220911 (0.0009) [2023-12-26 01:21:16,513][123090] Updated weights for policy 1, policy_version 220921 (0.0009) [2023-12-26 01:21:16,948][123091] Updated weights for policy 0, policy_version 221845 (0.0007) [2023-12-26 01:21:17,022][123091] Updated weights for policy 0, policy_version 221855 (0.0005) [2023-12-26 01:21:17,094][123091] Updated weights for policy 0, policy_version 221865 (0.0005) [2023-12-26 01:21:17,334][123090] Updated weights for policy 1, policy_version 220931 (0.0008) [2023-12-26 01:21:17,384][123090] Updated weights for policy 1, policy_version 220941 (0.0007) [2023-12-26 01:21:17,432][123090] Updated weights for policy 1, policy_version 220951 (0.0006) [2023-12-26 01:21:17,835][123091] Updated weights for policy 0, policy_version 221875 (0.0005) [2023-12-26 01:21:17,900][123091] Updated weights for policy 0, policy_version 221885 (0.0008) [2023-12-26 01:21:17,965][123091] Updated weights for policy 0, policy_version 221895 (0.0009) [2023-12-26 01:21:18,142][123090] Updated weights for policy 1, policy_version 220961 (0.0007) [2023-12-26 01:21:18,207][123090] Updated weights for policy 1, policy_version 220971 (0.0011) [2023-12-26 01:21:18,255][123090] Updated weights for policy 1, policy_version 220981 (0.0010) [2023-12-26 01:21:18,309][123090] Updated weights for policy 1, policy_version 220991 (0.0011) [2023-12-26 01:21:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 113385472. Throughput: 0: 8944.8, 1: 8876.6. Samples: 113399776. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:18,785][121949] Avg episode reward: [(0, '5905.716'), (1, '5626.702')] [2023-12-26 01:21:18,792][123091] Updated weights for policy 0, policy_version 221905 (0.0009) [2023-12-26 01:21:18,857][123091] Updated weights for policy 0, policy_version 221915 (0.0009) [2023-12-26 01:21:18,922][123091] Updated weights for policy 0, policy_version 221925 (0.0009) [2023-12-26 01:21:18,995][123091] Updated weights for policy 0, policy_version 221935 (0.0009) [2023-12-26 01:21:19,175][123090] Updated weights for policy 1, policy_version 221001 (0.0012) [2023-12-26 01:21:19,235][123090] Updated weights for policy 1, policy_version 221011 (0.0011) [2023-12-26 01:21:19,302][123090] Updated weights for policy 1, policy_version 221021 (0.0011) [2023-12-26 01:21:19,851][123091] Updated weights for policy 0, policy_version 221945 (0.0009) [2023-12-26 01:21:19,909][123091] Updated weights for policy 0, policy_version 221955 (0.0009) [2023-12-26 01:21:19,978][123091] Updated weights for policy 0, policy_version 221965 (0.0009) [2023-12-26 01:21:20,151][123090] Updated weights for policy 1, policy_version 221031 (0.0011) [2023-12-26 01:21:20,225][123090] Updated weights for policy 1, policy_version 221041 (0.0011) [2023-12-26 01:21:20,292][123090] Updated weights for policy 1, policy_version 221051 (0.0010) [2023-12-26 01:21:20,821][123091] Updated weights for policy 0, policy_version 221975 (0.0010) [2023-12-26 01:21:20,890][123091] Updated weights for policy 0, policy_version 221985 (0.0009) [2023-12-26 01:21:20,956][123091] Updated weights for policy 0, policy_version 221995 (0.0009) [2023-12-26 01:21:21,110][123090] Updated weights for policy 1, policy_version 221061 (0.0011) [2023-12-26 01:21:21,181][123090] Updated weights for policy 1, policy_version 221071 (0.0011) [2023-12-26 01:21:21,237][123090] Updated weights for policy 1, policy_version 221081 (0.0011) [2023-12-26 01:21:21,886][123091] Updated weights for policy 0, policy_version 222005 (0.0009) [2023-12-26 01:21:21,952][123091] Updated weights for policy 0, policy_version 222015 (0.0009) [2023-12-26 01:21:22,014][123091] Updated weights for policy 0, policy_version 222025 (0.0009) [2023-12-26 01:21:22,079][123090] Updated weights for policy 1, policy_version 221091 (0.0011) [2023-12-26 01:21:22,146][123090] Updated weights for policy 1, policy_version 221101 (0.0010) [2023-12-26 01:21:22,209][123090] Updated weights for policy 1, policy_version 221111 (0.0010) [2023-12-26 01:21:22,858][123091] Updated weights for policy 0, policy_version 222035 (0.0009) [2023-12-26 01:21:22,915][123091] Updated weights for policy 0, policy_version 222045 (0.0009) [2023-12-26 01:21:22,972][123091] Updated weights for policy 0, policy_version 222055 (0.0009) [2023-12-26 01:21:23,043][123090] Updated weights for policy 1, policy_version 221121 (0.0010) [2023-12-26 01:21:23,099][123090] Updated weights for policy 1, policy_version 221131 (0.0010) [2023-12-26 01:21:23,154][123090] Updated weights for policy 1, policy_version 221141 (0.0010) [2023-12-26 01:21:23,225][123090] Updated weights for policy 1, policy_version 221151 (0.0010) [2023-12-26 01:21:23,781][123091] Updated weights for policy 0, policy_version 222065 (0.0009) [2023-12-26 01:21:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 113467392. Throughput: 0: 8939.5, 1: 8841.1. Samples: 113449208. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:23,785][121949] Avg episode reward: [(0, '5933.738'), (1, '5661.516')] [2023-12-26 01:21:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000221152_56614912.pth... [2023-12-26 01:21:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000220128_56352768.pth [2023-12-26 01:21:23,833][123091] Updated weights for policy 0, policy_version 222075 (0.0005) [2023-12-26 01:21:23,895][123091] Updated weights for policy 0, policy_version 222085 (0.0005) [2023-12-26 01:21:23,940][123091] Updated weights for policy 0, policy_version 222095 (0.0005) [2023-12-26 01:21:23,944][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000222096_56860672.pth... [2023-12-26 01:21:23,947][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000221040_56590336.pth [2023-12-26 01:21:24,052][123090] Updated weights for policy 1, policy_version 221161 (0.0010) [2023-12-26 01:21:24,112][123090] Updated weights for policy 1, policy_version 221171 (0.0010) [2023-12-26 01:21:24,175][123090] Updated weights for policy 1, policy_version 221181 (0.0010) [2023-12-26 01:21:24,621][123091] Updated weights for policy 0, policy_version 222105 (0.0005) [2023-12-26 01:21:24,681][123091] Updated weights for policy 0, policy_version 222115 (0.0007) [2023-12-26 01:21:24,734][123091] Updated weights for policy 0, policy_version 222125 (0.0005) [2023-12-26 01:21:25,003][123090] Updated weights for policy 1, policy_version 221191 (0.0010) [2023-12-26 01:21:25,054][123090] Updated weights for policy 1, policy_version 221201 (0.0010) [2023-12-26 01:21:25,101][123090] Updated weights for policy 1, policy_version 221211 (0.0010) [2023-12-26 01:21:25,411][123091] Updated weights for policy 0, policy_version 222135 (0.0009) [2023-12-26 01:21:25,462][123091] Updated weights for policy 0, policy_version 222145 (0.0010) [2023-12-26 01:21:25,509][123091] Updated weights for policy 0, policy_version 222155 (0.0010) [2023-12-26 01:21:25,935][123090] Updated weights for policy 1, policy_version 221221 (0.0010) [2023-12-26 01:21:25,982][123090] Updated weights for policy 1, policy_version 221231 (0.0010) [2023-12-26 01:21:26,037][123090] Updated weights for policy 1, policy_version 221241 (0.0010) [2023-12-26 01:21:26,266][123091] Updated weights for policy 0, policy_version 222165 (0.0011) [2023-12-26 01:21:26,320][123091] Updated weights for policy 0, policy_version 222175 (0.0010) [2023-12-26 01:21:26,370][123091] Updated weights for policy 0, policy_version 222185 (0.0008) [2023-12-26 01:21:26,883][123090] Updated weights for policy 1, policy_version 221251 (0.0010) [2023-12-26 01:21:26,930][123090] Updated weights for policy 1, policy_version 221261 (0.0010) [2023-12-26 01:21:26,995][123090] Updated weights for policy 1, policy_version 221271 (0.0010) [2023-12-26 01:21:27,100][123091] Updated weights for policy 0, policy_version 222195 (0.0007) [2023-12-26 01:21:27,159][123091] Updated weights for policy 0, policy_version 222205 (0.0007) [2023-12-26 01:21:27,217][123091] Updated weights for policy 0, policy_version 222215 (0.0009) [2023-12-26 01:21:27,804][123090] Updated weights for policy 1, policy_version 221281 (0.0009) [2023-12-26 01:21:27,858][123090] Updated weights for policy 1, policy_version 221291 (0.0010) [2023-12-26 01:21:27,912][123090] Updated weights for policy 1, policy_version 221301 (0.0010) [2023-12-26 01:21:27,930][123091] Updated weights for policy 0, policy_version 222225 (0.0009) [2023-12-26 01:21:27,970][123090] Updated weights for policy 1, policy_version 221311 (0.0010) [2023-12-26 01:21:27,982][123091] Updated weights for policy 0, policy_version 222235 (0.0007) [2023-12-26 01:21:28,035][123091] Updated weights for policy 0, policy_version 222245 (0.0005) [2023-12-26 01:21:28,088][123091] Updated weights for policy 0, policy_version 222255 (0.0005) [2023-12-26 01:21:28,710][123090] Updated weights for policy 1, policy_version 221321 (0.0010) [2023-12-26 01:21:28,773][123090] Updated weights for policy 1, policy_version 221331 (0.0010) [2023-12-26 01:21:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 113557504. Throughput: 0: 9027.8, 1: 8867.9. Samples: 113556280. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:28,784][121949] Avg episode reward: [(0, '5973.468'), (1, '5527.233')] [2023-12-26 01:21:28,794][123091] Updated weights for policy 0, policy_version 222265 (0.0007) [2023-12-26 01:21:28,837][123090] Updated weights for policy 1, policy_version 221341 (0.0010) [2023-12-26 01:21:28,858][123091] Updated weights for policy 0, policy_version 222275 (0.0009) [2023-12-26 01:21:28,921][123091] Updated weights for policy 0, policy_version 222285 (0.0009) [2023-12-26 01:21:29,664][123090] Updated weights for policy 1, policy_version 221351 (0.0010) [2023-12-26 01:21:29,719][123090] Updated weights for policy 1, policy_version 221361 (0.0010) [2023-12-26 01:21:29,771][123090] Updated weights for policy 1, policy_version 221371 (0.0010) [2023-12-26 01:21:29,774][123091] Updated weights for policy 0, policy_version 222295 (0.0007) [2023-12-26 01:21:29,841][123091] Updated weights for policy 0, policy_version 222305 (0.0007) [2023-12-26 01:21:29,903][123091] Updated weights for policy 0, policy_version 222315 (0.0009) [2023-12-26 01:21:30,634][123090] Updated weights for policy 1, policy_version 221381 (0.0010) [2023-12-26 01:21:30,674][123091] Updated weights for policy 0, policy_version 222325 (0.0007) [2023-12-26 01:21:30,689][123090] Updated weights for policy 1, policy_version 221391 (0.0010) [2023-12-26 01:21:30,740][123091] Updated weights for policy 0, policy_version 222335 (0.0005) [2023-12-26 01:21:30,747][123090] Updated weights for policy 1, policy_version 221401 (0.0010) [2023-12-26 01:21:30,795][123091] Updated weights for policy 0, policy_version 222345 (0.0009) [2023-12-26 01:21:31,495][123091] Updated weights for policy 0, policy_version 222355 (0.0006) [2023-12-26 01:21:31,557][123091] Updated weights for policy 0, policy_version 222365 (0.0006) [2023-12-26 01:21:31,584][123090] Updated weights for policy 1, policy_version 221411 (0.0010) [2023-12-26 01:21:31,622][123091] Updated weights for policy 0, policy_version 222375 (0.0006) [2023-12-26 01:21:31,650][123090] Updated weights for policy 1, policy_version 221421 (0.0009) [2023-12-26 01:21:31,707][123090] Updated weights for policy 1, policy_version 221431 (0.0009) [2023-12-26 01:21:32,372][123091] Updated weights for policy 0, policy_version 222385 (0.0009) [2023-12-26 01:21:32,435][123091] Updated weights for policy 0, policy_version 222395 (0.0011) [2023-12-26 01:21:32,497][123091] Updated weights for policy 0, policy_version 222405 (0.0011) [2023-12-26 01:21:32,531][123090] Updated weights for policy 1, policy_version 221441 (0.0009) [2023-12-26 01:21:32,548][123091] Updated weights for policy 0, policy_version 222415 (0.0008) [2023-12-26 01:21:32,586][123090] Updated weights for policy 1, policy_version 221451 (0.0010) [2023-12-26 01:21:32,640][123090] Updated weights for policy 1, policy_version 221462 (0.0010) [2023-12-26 01:21:33,229][123091] Updated weights for policy 0, policy_version 222425 (0.0009) [2023-12-26 01:21:33,292][123091] Updated weights for policy 0, policy_version 222435 (0.0009) [2023-12-26 01:21:33,343][123091] Updated weights for policy 0, policy_version 222445 (0.0008) [2023-12-26 01:21:33,564][123090] Updated weights for policy 1, policy_version 221473 (0.0010) [2023-12-26 01:21:33,628][123090] Updated weights for policy 1, policy_version 221483 (0.0009) [2023-12-26 01:21:33,688][123090] Updated weights for policy 1, policy_version 221493 (0.0010) [2023-12-26 01:21:33,740][123090] Updated weights for policy 1, policy_version 221503 (0.0009) [2023-12-26 01:21:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 113655808. Throughput: 0: 9095.6, 1: 8758.2. Samples: 113663832. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:33,785][121949] Avg episode reward: [(0, '5926.062'), (1, '5496.453')] [2023-12-26 01:21:34,028][123091] Updated weights for policy 0, policy_version 222455 (0.0008) [2023-12-26 01:21:34,085][123091] Updated weights for policy 0, policy_version 222465 (0.0008) [2023-12-26 01:21:34,146][123091] Updated weights for policy 0, policy_version 222475 (0.0006) [2023-12-26 01:21:34,633][123090] Updated weights for policy 1, policy_version 221513 (0.0010) [2023-12-26 01:21:34,697][123090] Updated weights for policy 1, policy_version 221523 (0.0010) [2023-12-26 01:21:34,766][123090] Updated weights for policy 1, policy_version 221533 (0.0010) [2023-12-26 01:21:34,918][123091] Updated weights for policy 0, policy_version 222485 (0.0009) [2023-12-26 01:21:34,972][123091] Updated weights for policy 0, policy_version 222495 (0.0010) [2023-12-26 01:21:35,022][123091] Updated weights for policy 0, policy_version 222505 (0.0009) [2023-12-26 01:21:35,566][123090] Updated weights for policy 1, policy_version 221543 (0.0010) [2023-12-26 01:21:35,623][123090] Updated weights for policy 1, policy_version 221553 (0.0009) [2023-12-26 01:21:35,690][123090] Updated weights for policy 1, policy_version 221563 (0.0009) [2023-12-26 01:21:35,874][123091] Updated weights for policy 0, policy_version 222515 (0.0009) [2023-12-26 01:21:35,930][123091] Updated weights for policy 0, policy_version 222525 (0.0009) [2023-12-26 01:21:35,981][123091] Updated weights for policy 0, policy_version 222535 (0.0009) [2023-12-26 01:21:36,532][123090] Updated weights for policy 1, policy_version 221573 (0.0010) [2023-12-26 01:21:36,587][123090] Updated weights for policy 1, policy_version 221583 (0.0009) [2023-12-26 01:21:36,655][123090] Updated weights for policy 1, policy_version 221593 (0.0009) [2023-12-26 01:21:36,832][123091] Updated weights for policy 0, policy_version 222545 (0.0009) [2023-12-26 01:21:36,897][123091] Updated weights for policy 0, policy_version 222555 (0.0009) [2023-12-26 01:21:36,947][123091] Updated weights for policy 0, policy_version 222565 (0.0009) [2023-12-26 01:21:36,999][123091] Updated weights for policy 0, policy_version 222575 (0.0007) [2023-12-26 01:21:37,510][123090] Updated weights for policy 1, policy_version 221603 (0.0010) [2023-12-26 01:21:37,580][123090] Updated weights for policy 1, policy_version 221613 (0.0009) [2023-12-26 01:21:37,653][123090] Updated weights for policy 1, policy_version 221623 (0.0010) [2023-12-26 01:21:37,799][123091] Updated weights for policy 0, policy_version 222585 (0.0009) [2023-12-26 01:21:37,853][123091] Updated weights for policy 0, policy_version 222595 (0.0010) [2023-12-26 01:21:37,910][123091] Updated weights for policy 0, policy_version 222605 (0.0009) [2023-12-26 01:21:38,457][123090] Updated weights for policy 1, policy_version 221633 (0.0010) [2023-12-26 01:21:38,516][123090] Updated weights for policy 1, policy_version 221643 (0.0009) [2023-12-26 01:21:38,582][123090] Updated weights for policy 1, policy_version 221653 (0.0008) [2023-12-26 01:21:38,651][123090] Updated weights for policy 1, policy_version 221663 (0.0010) [2023-12-26 01:21:38,779][123091] Updated weights for policy 0, policy_version 222615 (0.0010) [2023-12-26 01:21:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 113737728. Throughput: 0: 9109.7, 1: 8733.7. Samples: 113715692. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:38,784][121949] Avg episode reward: [(0, '5930.729'), (1, '5548.021')] [2023-12-26 01:21:38,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000221664_56745984.pth... [2023-12-26 01:21:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000220640_56483840.pth [2023-12-26 01:21:38,844][123091] Updated weights for policy 0, policy_version 222625 (0.0009) [2023-12-26 01:21:38,900][123091] Updated weights for policy 0, policy_version 222635 (0.0009) [2023-12-26 01:21:38,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000222640_56999936.pth... [2023-12-26 01:21:38,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000221552_56721408.pth [2023-12-26 01:21:39,365][123090] Updated weights for policy 1, policy_version 221673 (0.0008) [2023-12-26 01:21:39,430][123090] Updated weights for policy 1, policy_version 221683 (0.0008) [2023-12-26 01:21:39,484][123090] Updated weights for policy 1, policy_version 221693 (0.0009) [2023-12-26 01:21:39,817][123091] Updated weights for policy 0, policy_version 222645 (0.0009) [2023-12-26 01:21:39,890][123091] Updated weights for policy 0, policy_version 222655 (0.0010) [2023-12-26 01:21:39,953][123091] Updated weights for policy 0, policy_version 222665 (0.0009) [2023-12-26 01:21:40,237][123090] Updated weights for policy 1, policy_version 221703 (0.0011) [2023-12-26 01:21:40,305][123090] Updated weights for policy 1, policy_version 221713 (0.0011) [2023-12-26 01:21:40,369][123090] Updated weights for policy 1, policy_version 221723 (0.0010) [2023-12-26 01:21:40,794][123091] Updated weights for policy 0, policy_version 222675 (0.0008) [2023-12-26 01:21:40,858][123091] Updated weights for policy 0, policy_version 222685 (0.0010) [2023-12-26 01:21:40,918][123091] Updated weights for policy 0, policy_version 222695 (0.0006) [2023-12-26 01:21:41,140][123090] Updated weights for policy 1, policy_version 221733 (0.0007) [2023-12-26 01:21:41,204][123090] Updated weights for policy 1, policy_version 221743 (0.0008) [2023-12-26 01:21:41,270][123090] Updated weights for policy 1, policy_version 221753 (0.0008) [2023-12-26 01:21:41,722][123091] Updated weights for policy 0, policy_version 222705 (0.0006) [2023-12-26 01:21:41,790][123091] Updated weights for policy 0, policy_version 222715 (0.0009) [2023-12-26 01:21:41,850][123091] Updated weights for policy 0, policy_version 222725 (0.0009) [2023-12-26 01:21:41,919][123091] Updated weights for policy 0, policy_version 222735 (0.0010) [2023-12-26 01:21:42,031][123090] Updated weights for policy 1, policy_version 221763 (0.0008) [2023-12-26 01:21:42,079][123090] Updated weights for policy 1, policy_version 221773 (0.0008) [2023-12-26 01:21:42,134][123090] Updated weights for policy 1, policy_version 221783 (0.0008) [2023-12-26 01:21:42,701][123091] Updated weights for policy 0, policy_version 222745 (0.0007) [2023-12-26 01:21:42,770][123091] Updated weights for policy 0, policy_version 222755 (0.0006) [2023-12-26 01:21:42,833][123091] Updated weights for policy 0, policy_version 222765 (0.0008) [2023-12-26 01:21:42,977][123090] Updated weights for policy 1, policy_version 221793 (0.0008) [2023-12-26 01:21:43,035][123090] Updated weights for policy 1, policy_version 221803 (0.0010) [2023-12-26 01:21:43,101][123090] Updated weights for policy 1, policy_version 221813 (0.0010) [2023-12-26 01:21:43,163][123090] Updated weights for policy 1, policy_version 221823 (0.0010) [2023-12-26 01:21:43,592][123091] Updated weights for policy 0, policy_version 222775 (0.0009) [2023-12-26 01:21:43,646][123091] Updated weights for policy 0, policy_version 222785 (0.0009) [2023-12-26 01:21:43,705][123091] Updated weights for policy 0, policy_version 222795 (0.0009) [2023-12-26 01:21:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 113827840. Throughput: 0: 8970.8, 1: 8634.1. Samples: 113819532. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:43,785][121949] Avg episode reward: [(0, '5894.521'), (1, '5534.423')] [2023-12-26 01:21:43,970][123090] Updated weights for policy 1, policy_version 221833 (0.0010) [2023-12-26 01:21:44,022][123090] Updated weights for policy 1, policy_version 221843 (0.0010) [2023-12-26 01:21:44,076][123090] Updated weights for policy 1, policy_version 221853 (0.0010) [2023-12-26 01:21:44,566][123091] Updated weights for policy 0, policy_version 222805 (0.0009) [2023-12-26 01:21:44,614][123091] Updated weights for policy 0, policy_version 222815 (0.0008) [2023-12-26 01:21:44,665][123091] Updated weights for policy 0, policy_version 222825 (0.0009) [2023-12-26 01:21:44,917][123090] Updated weights for policy 1, policy_version 221863 (0.0007) [2023-12-26 01:21:44,992][123090] Updated weights for policy 1, policy_version 221873 (0.0007) [2023-12-26 01:21:45,056][123090] Updated weights for policy 1, policy_version 221883 (0.0009) [2023-12-26 01:21:45,544][123091] Updated weights for policy 0, policy_version 222835 (0.0008) [2023-12-26 01:21:45,594][123091] Updated weights for policy 0, policy_version 222845 (0.0010) [2023-12-26 01:21:45,654][123091] Updated weights for policy 0, policy_version 222855 (0.0010) [2023-12-26 01:21:45,837][123090] Updated weights for policy 1, policy_version 221893 (0.0009) [2023-12-26 01:21:45,904][123090] Updated weights for policy 1, policy_version 221903 (0.0009) [2023-12-26 01:21:45,969][123090] Updated weights for policy 1, policy_version 221913 (0.0009) [2023-12-26 01:21:46,520][123091] Updated weights for policy 0, policy_version 222865 (0.0010) [2023-12-26 01:21:46,591][123091] Updated weights for policy 0, policy_version 222875 (0.0009) [2023-12-26 01:21:46,649][123091] Updated weights for policy 0, policy_version 222885 (0.0010) [2023-12-26 01:21:46,718][123091] Updated weights for policy 0, policy_version 222895 (0.0009) [2023-12-26 01:21:46,801][123090] Updated weights for policy 1, policy_version 221923 (0.0009) [2023-12-26 01:21:46,864][123090] Updated weights for policy 1, policy_version 221933 (0.0009) [2023-12-26 01:21:46,923][123090] Updated weights for policy 1, policy_version 221943 (0.0009) [2023-12-26 01:21:47,535][123091] Updated weights for policy 0, policy_version 222905 (0.0010) [2023-12-26 01:21:47,585][123091] Updated weights for policy 0, policy_version 222915 (0.0009) [2023-12-26 01:21:47,633][123091] Updated weights for policy 0, policy_version 222925 (0.0009) [2023-12-26 01:21:47,716][123090] Updated weights for policy 1, policy_version 221953 (0.0009) [2023-12-26 01:21:47,771][123090] Updated weights for policy 1, policy_version 221963 (0.0009) [2023-12-26 01:21:47,830][123090] Updated weights for policy 1, policy_version 221973 (0.0008) [2023-12-26 01:21:47,889][123090] Updated weights for policy 1, policy_version 221983 (0.0010) [2023-12-26 01:21:48,373][123091] Updated weights for policy 0, policy_version 222935 (0.0009) [2023-12-26 01:21:48,433][123091] Updated weights for policy 0, policy_version 222945 (0.0008) [2023-12-26 01:21:48,498][123091] Updated weights for policy 0, policy_version 222955 (0.0005) [2023-12-26 01:21:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 113909760. Throughput: 0: 8954.3, 1: 8677.9. Samples: 113922620. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:48,785][121949] Avg episode reward: [(0, '5895.584'), (1, '5506.002')] [2023-12-26 01:21:48,797][123090] Updated weights for policy 1, policy_version 221993 (0.0006) [2023-12-26 01:21:48,870][123090] Updated weights for policy 1, policy_version 222003 (0.0006) [2023-12-26 01:21:48,940][123090] Updated weights for policy 1, policy_version 222013 (0.0008) [2023-12-26 01:21:49,276][123091] Updated weights for policy 0, policy_version 222965 (0.0007) [2023-12-26 01:21:49,342][123091] Updated weights for policy 0, policy_version 222975 (0.0006) [2023-12-26 01:21:49,407][123091] Updated weights for policy 0, policy_version 222985 (0.0009) [2023-12-26 01:21:49,650][123090] Updated weights for policy 1, policy_version 222023 (0.0007) [2023-12-26 01:21:49,705][123090] Updated weights for policy 1, policy_version 222033 (0.0008) [2023-12-26 01:21:49,754][123090] Updated weights for policy 1, policy_version 222043 (0.0007) [2023-12-26 01:21:50,233][123091] Updated weights for policy 0, policy_version 222995 (0.0009) [2023-12-26 01:21:50,283][123091] Updated weights for policy 0, policy_version 223005 (0.0009) [2023-12-26 01:21:50,343][123091] Updated weights for policy 0, policy_version 223015 (0.0009) [2023-12-26 01:21:50,581][123090] Updated weights for policy 1, policy_version 222053 (0.0007) [2023-12-26 01:21:50,645][123090] Updated weights for policy 1, policy_version 222063 (0.0009) [2023-12-26 01:21:50,710][123090] Updated weights for policy 1, policy_version 222073 (0.0010) [2023-12-26 01:21:51,200][123091] Updated weights for policy 0, policy_version 223025 (0.0009) [2023-12-26 01:21:51,264][123091] Updated weights for policy 0, policy_version 223035 (0.0009) [2023-12-26 01:21:51,321][123091] Updated weights for policy 0, policy_version 223045 (0.0009) [2023-12-26 01:21:51,388][123091] Updated weights for policy 0, policy_version 223055 (0.0009) [2023-12-26 01:21:51,572][123090] Updated weights for policy 1, policy_version 222083 (0.0010) [2023-12-26 01:21:51,640][123090] Updated weights for policy 1, policy_version 222093 (0.0010) [2023-12-26 01:21:51,706][123090] Updated weights for policy 1, policy_version 222103 (0.0010) [2023-12-26 01:21:52,253][123091] Updated weights for policy 0, policy_version 223065 (0.0009) [2023-12-26 01:21:52,325][123091] Updated weights for policy 0, policy_version 223075 (0.0010) [2023-12-26 01:21:52,392][123091] Updated weights for policy 0, policy_version 223085 (0.0009) [2023-12-26 01:21:52,556][123090] Updated weights for policy 1, policy_version 222113 (0.0010) [2023-12-26 01:21:52,625][123090] Updated weights for policy 1, policy_version 222123 (0.0010) [2023-12-26 01:21:52,684][123090] Updated weights for policy 1, policy_version 222133 (0.0009) [2023-12-26 01:21:52,749][123090] Updated weights for policy 1, policy_version 222143 (0.0005) [2023-12-26 01:21:53,251][123091] Updated weights for policy 0, policy_version 223095 (0.0007) [2023-12-26 01:21:53,317][123091] Updated weights for policy 0, policy_version 223105 (0.0005) [2023-12-26 01:21:53,379][123091] Updated weights for policy 0, policy_version 223115 (0.0005) [2023-12-26 01:21:53,517][123090] Updated weights for policy 1, policy_version 222153 (0.0009) [2023-12-26 01:21:53,573][123090] Updated weights for policy 1, policy_version 222163 (0.0009) [2023-12-26 01:21:53,624][123090] Updated weights for policy 1, policy_version 222173 (0.0009) [2023-12-26 01:21:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 113999872. Throughput: 0: 8943.6, 1: 8657.2. Samples: 113974076. Policy #0 lag: (min: 22.0, avg: 23.7, max: 53.0) [2023-12-26 01:21:53,785][121949] Avg episode reward: [(0, '5696.734'), (1, '5562.928')] [2023-12-26 01:21:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000223120_57122816.pth... [2023-12-26 01:21:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000222176_56877056.pth... [2023-12-26 01:21:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000221152_56614912.pth [2023-12-26 01:21:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000222096_56860672.pth [2023-12-26 01:21:54,024][123091] Updated weights for policy 0, policy_version 223125 (0.0006) [2023-12-26 01:21:54,091][123091] Updated weights for policy 0, policy_version 223135 (0.0005) [2023-12-26 01:21:54,156][123091] Updated weights for policy 0, policy_version 223145 (0.0009) [2023-12-26 01:21:54,512][123090] Updated weights for policy 1, policy_version 222183 (0.0010) [2023-12-26 01:21:54,570][123090] Updated weights for policy 1, policy_version 222193 (0.0010) [2023-12-26 01:21:54,629][123090] Updated weights for policy 1, policy_version 222203 (0.0010) [2023-12-26 01:21:54,795][123091] Updated weights for policy 0, policy_version 223155 (0.0011) [2023-12-26 01:21:54,843][123091] Updated weights for policy 0, policy_version 223165 (0.0010) [2023-12-26 01:21:54,894][123091] Updated weights for policy 0, policy_version 223175 (0.0010) [2023-12-26 01:21:55,418][123090] Updated weights for policy 1, policy_version 222213 (0.0008) [2023-12-26 01:21:55,466][123090] Updated weights for policy 1, policy_version 222223 (0.0008) [2023-12-26 01:21:55,512][123090] Updated weights for policy 1, policy_version 222233 (0.0008) [2023-12-26 01:21:55,718][123091] Updated weights for policy 0, policy_version 223185 (0.0011) [2023-12-26 01:21:55,780][123091] Updated weights for policy 0, policy_version 223195 (0.0011) [2023-12-26 01:21:55,840][123091] Updated weights for policy 0, policy_version 223205 (0.0011) [2023-12-26 01:21:55,903][123091] Updated weights for policy 0, policy_version 223215 (0.0011) [2023-12-26 01:21:56,262][123090] Updated weights for policy 1, policy_version 222243 (0.0005) [2023-12-26 01:21:56,335][123090] Updated weights for policy 1, policy_version 222253 (0.0007) [2023-12-26 01:21:56,390][123090] Updated weights for policy 1, policy_version 222263 (0.0010) [2023-12-26 01:21:56,650][123091] Updated weights for policy 0, policy_version 223225 (0.0010) [2023-12-26 01:21:56,704][123091] Updated weights for policy 0, policy_version 223235 (0.0010) [2023-12-26 01:21:56,755][123091] Updated weights for policy 0, policy_version 223245 (0.0010) [2023-12-26 01:21:57,185][123090] Updated weights for policy 1, policy_version 222273 (0.0010) [2023-12-26 01:21:57,247][123090] Updated weights for policy 1, policy_version 222283 (0.0006) [2023-12-26 01:21:57,308][123090] Updated weights for policy 1, policy_version 222293 (0.0007) [2023-12-26 01:21:57,364][123090] Updated weights for policy 1, policy_version 222303 (0.0009) [2023-12-26 01:21:57,583][123091] Updated weights for policy 0, policy_version 223255 (0.0007) [2023-12-26 01:21:57,646][123091] Updated weights for policy 0, policy_version 223265 (0.0010) [2023-12-26 01:21:57,707][123091] Updated weights for policy 0, policy_version 223275 (0.0010) [2023-12-26 01:21:58,113][123090] Updated weights for policy 1, policy_version 222313 (0.0010) [2023-12-26 01:21:58,182][123090] Updated weights for policy 1, policy_version 222323 (0.0010) [2023-12-26 01:21:58,246][123090] Updated weights for policy 1, policy_version 222333 (0.0010) [2023-12-26 01:21:58,439][123091] Updated weights for policy 0, policy_version 223285 (0.0009) [2023-12-26 01:21:58,507][123091] Updated weights for policy 0, policy_version 223295 (0.0008) [2023-12-26 01:21:58,569][123091] Updated weights for policy 0, policy_version 223305 (0.0008) [2023-12-26 01:21:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 114089984. Throughput: 0: 8956.2, 1: 8679.7. Samples: 114082104. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:21:58,785][121949] Avg episode reward: [(0, '5760.786'), (1, '5535.127')] [2023-12-26 01:21:59,092][123090] Updated weights for policy 1, policy_version 222343 (0.0008) [2023-12-26 01:21:59,139][123090] Updated weights for policy 1, policy_version 222353 (0.0008) [2023-12-26 01:21:59,182][123090] Updated weights for policy 1, policy_version 222363 (0.0006) [2023-12-26 01:21:59,347][123091] Updated weights for policy 0, policy_version 223315 (0.0008) [2023-12-26 01:21:59,413][123091] Updated weights for policy 0, policy_version 223325 (0.0010) [2023-12-26 01:21:59,472][123091] Updated weights for policy 0, policy_version 223335 (0.0011) [2023-12-26 01:22:00,042][123090] Updated weights for policy 1, policy_version 222373 (0.0007) [2023-12-26 01:22:00,100][123090] Updated weights for policy 1, policy_version 222383 (0.0010) [2023-12-26 01:22:00,159][123090] Updated weights for policy 1, policy_version 222393 (0.0008) [2023-12-26 01:22:00,230][123091] Updated weights for policy 0, policy_version 223345 (0.0010) [2023-12-26 01:22:00,283][123091] Updated weights for policy 0, policy_version 223355 (0.0009) [2023-12-26 01:22:00,337][123091] Updated weights for policy 0, policy_version 223365 (0.0009) [2023-12-26 01:22:00,392][123091] Updated weights for policy 0, policy_version 223375 (0.0009) [2023-12-26 01:22:01,017][123090] Updated weights for policy 1, policy_version 222403 (0.0010) [2023-12-26 01:22:01,088][123090] Updated weights for policy 1, policy_version 222413 (0.0010) [2023-12-26 01:22:01,156][123090] Updated weights for policy 1, policy_version 222423 (0.0010) [2023-12-26 01:22:01,229][123091] Updated weights for policy 0, policy_version 223385 (0.0008) [2023-12-26 01:22:01,293][123091] Updated weights for policy 0, policy_version 223395 (0.0010) [2023-12-26 01:22:01,352][123091] Updated weights for policy 0, policy_version 223405 (0.0010) [2023-12-26 01:22:01,967][123090] Updated weights for policy 1, policy_version 222433 (0.0010) [2023-12-26 01:22:02,020][123090] Updated weights for policy 1, policy_version 222443 (0.0009) [2023-12-26 01:22:02,076][123090] Updated weights for policy 1, policy_version 222453 (0.0009) [2023-12-26 01:22:02,135][123090] Updated weights for policy 1, policy_version 222463 (0.0009) [2023-12-26 01:22:02,238][123091] Updated weights for policy 0, policy_version 223415 (0.0009) [2023-12-26 01:22:02,295][123091] Updated weights for policy 0, policy_version 223425 (0.0009) [2023-12-26 01:22:02,343][123091] Updated weights for policy 0, policy_version 223435 (0.0009) [2023-12-26 01:22:02,984][123090] Updated weights for policy 1, policy_version 222473 (0.0010) [2023-12-26 01:22:03,055][123090] Updated weights for policy 1, policy_version 222483 (0.0009) [2023-12-26 01:22:03,122][123090] Updated weights for policy 1, policy_version 222493 (0.0009) [2023-12-26 01:22:03,199][123091] Updated weights for policy 0, policy_version 223445 (0.0009) [2023-12-26 01:22:03,251][123091] Updated weights for policy 0, policy_version 223455 (0.0009) [2023-12-26 01:22:03,296][123091] Updated weights for policy 0, policy_version 223465 (0.0008) [2023-12-26 01:22:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 114171904. Throughput: 0: 8862.8, 1: 8590.3. Samples: 114185164. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:03,784][121949] Avg episode reward: [(0, '5874.417'), (1, '5502.514')] [2023-12-26 01:22:03,958][123090] Updated weights for policy 1, policy_version 222503 (0.0008) [2023-12-26 01:22:04,016][123090] Updated weights for policy 1, policy_version 222513 (0.0009) [2023-12-26 01:22:04,082][123090] Updated weights for policy 1, policy_version 222524 (0.0009) [2023-12-26 01:22:04,112][123091] Updated weights for policy 0, policy_version 223475 (0.0005) [2023-12-26 01:22:04,166][123091] Updated weights for policy 0, policy_version 223485 (0.0010) [2023-12-26 01:22:04,216][123091] Updated weights for policy 0, policy_version 223495 (0.0010) [2023-12-26 01:22:04,941][123090] Updated weights for policy 1, policy_version 222534 (0.0010) [2023-12-26 01:22:04,991][123090] Updated weights for policy 1, policy_version 222544 (0.0009) [2023-12-26 01:22:05,045][123090] Updated weights for policy 1, policy_version 222555 (0.0010) [2023-12-26 01:22:05,069][123091] Updated weights for policy 0, policy_version 223505 (0.0009) [2023-12-26 01:22:05,128][123091] Updated weights for policy 0, policy_version 223515 (0.0010) [2023-12-26 01:22:05,186][123091] Updated weights for policy 0, policy_version 223525 (0.0010) [2023-12-26 01:22:05,253][123091] Updated weights for policy 0, policy_version 223535 (0.0009) [2023-12-26 01:22:05,858][123090] Updated weights for policy 1, policy_version 222565 (0.0008) [2023-12-26 01:22:05,929][123090] Updated weights for policy 1, policy_version 222575 (0.0008) [2023-12-26 01:22:06,000][123090] Updated weights for policy 1, policy_version 222585 (0.0008) [2023-12-26 01:22:06,118][123091] Updated weights for policy 0, policy_version 223545 (0.0010) [2023-12-26 01:22:06,190][123091] Updated weights for policy 0, policy_version 223555 (0.0006) [2023-12-26 01:22:06,264][123091] Updated weights for policy 0, policy_version 223565 (0.0005) [2023-12-26 01:22:06,795][123090] Updated weights for policy 1, policy_version 222595 (0.0007) [2023-12-26 01:22:06,855][123090] Updated weights for policy 1, policy_version 222605 (0.0005) [2023-12-26 01:22:06,924][123090] Updated weights for policy 1, policy_version 222615 (0.0005) [2023-12-26 01:22:06,978][123091] Updated weights for policy 0, policy_version 223575 (0.0006) [2023-12-26 01:22:07,040][123091] Updated weights for policy 0, policy_version 223585 (0.0008) [2023-12-26 01:22:07,115][123091] Updated weights for policy 0, policy_version 223595 (0.0007) [2023-12-26 01:22:07,673][123090] Updated weights for policy 1, policy_version 222625 (0.0005) [2023-12-26 01:22:07,728][123090] Updated weights for policy 1, policy_version 222635 (0.0005) [2023-12-26 01:22:07,773][123090] Updated weights for policy 1, policy_version 222645 (0.0005) [2023-12-26 01:22:07,821][123090] Updated weights for policy 1, policy_version 222655 (0.0005) [2023-12-26 01:22:07,904][123091] Updated weights for policy 0, policy_version 223605 (0.0005) [2023-12-26 01:22:07,981][123091] Updated weights for policy 0, policy_version 223615 (0.0005) [2023-12-26 01:22:08,044][123091] Updated weights for policy 0, policy_version 223625 (0.0010) [2023-12-26 01:22:08,565][123090] Updated weights for policy 1, policy_version 222665 (0.0008) [2023-12-26 01:22:08,620][123090] Updated weights for policy 1, policy_version 222675 (0.0009) [2023-12-26 01:22:08,684][123090] Updated weights for policy 1, policy_version 222685 (0.0010) [2023-12-26 01:22:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 114262016. Throughput: 0: 8894.0, 1: 8607.1. Samples: 114236756. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:08,785][121949] Avg episode reward: [(0, '5837.840'), (1, '5655.826')] [2023-12-26 01:22:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000222688_57008128.pth... [2023-12-26 01:22:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000221664_56745984.pth [2023-12-26 01:22:08,800][123091] Updated weights for policy 0, policy_version 223635 (0.0010) [2023-12-26 01:22:08,872][123091] Updated weights for policy 0, policy_version 223645 (0.0010) [2023-12-26 01:22:08,935][123091] Updated weights for policy 0, policy_version 223655 (0.0009) [2023-12-26 01:22:09,007][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000223664_57262080.pth... [2023-12-26 01:22:09,011][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000222640_56999936.pth [2023-12-26 01:22:09,590][123090] Updated weights for policy 1, policy_version 222695 (0.0009) [2023-12-26 01:22:09,648][123091] Updated weights for policy 0, policy_version 223665 (0.0006) [2023-12-26 01:22:09,658][123090] Updated weights for policy 1, policy_version 222705 (0.0008) [2023-12-26 01:22:09,712][123091] Updated weights for policy 0, policy_version 223675 (0.0011) [2023-12-26 01:22:09,720][123090] Updated weights for policy 1, policy_version 222715 (0.0008) [2023-12-26 01:22:09,777][123091] Updated weights for policy 0, policy_version 223685 (0.0010) [2023-12-26 01:22:09,855][123091] Updated weights for policy 0, policy_version 223695 (0.0008) [2023-12-26 01:22:10,506][123091] Updated weights for policy 0, policy_version 223705 (0.0011) [2023-12-26 01:22:10,565][123091] Updated weights for policy 0, policy_version 223715 (0.0010) [2023-12-26 01:22:10,566][123090] Updated weights for policy 1, policy_version 222725 (0.0007) [2023-12-26 01:22:10,620][123091] Updated weights for policy 0, policy_version 223725 (0.0008) [2023-12-26 01:22:10,632][123090] Updated weights for policy 1, policy_version 222735 (0.0007) [2023-12-26 01:22:10,703][123090] Updated weights for policy 1, policy_version 222745 (0.0009) [2023-12-26 01:22:11,444][123091] Updated weights for policy 0, policy_version 223735 (0.0007) [2023-12-26 01:22:11,478][123090] Updated weights for policy 1, policy_version 222755 (0.0009) [2023-12-26 01:22:11,501][123091] Updated weights for policy 0, policy_version 223745 (0.0006) [2023-12-26 01:22:11,549][123090] Updated weights for policy 1, policy_version 222765 (0.0009) [2023-12-26 01:22:11,554][123091] Updated weights for policy 0, policy_version 223755 (0.0006) [2023-12-26 01:22:11,622][123090] Updated weights for policy 1, policy_version 222775 (0.0010) [2023-12-26 01:22:12,285][123091] Updated weights for policy 0, policy_version 223765 (0.0007) [2023-12-26 01:22:12,353][123091] Updated weights for policy 0, policy_version 223775 (0.0009) [2023-12-26 01:22:12,414][123091] Updated weights for policy 0, policy_version 223785 (0.0009) [2023-12-26 01:22:12,526][123090] Updated weights for policy 1, policy_version 222785 (0.0010) [2023-12-26 01:22:12,586][123090] Updated weights for policy 1, policy_version 222795 (0.0010) [2023-12-26 01:22:12,636][123090] Updated weights for policy 1, policy_version 222805 (0.0009) [2023-12-26 01:22:12,699][123090] Updated weights for policy 1, policy_version 222815 (0.0010) [2023-12-26 01:22:13,185][123091] Updated weights for policy 0, policy_version 223795 (0.0010) [2023-12-26 01:22:13,238][123091] Updated weights for policy 0, policy_version 223805 (0.0010) [2023-12-26 01:22:13,290][123091] Updated weights for policy 0, policy_version 223815 (0.0006) [2023-12-26 01:22:13,576][123090] Updated weights for policy 1, policy_version 222825 (0.0009) [2023-12-26 01:22:13,632][123090] Updated weights for policy 1, policy_version 222835 (0.0009) [2023-12-26 01:22:13,683][123090] Updated weights for policy 1, policy_version 222846 (0.0010) [2023-12-26 01:22:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 114352128. Throughput: 0: 8872.6, 1: 8616.7. Samples: 114343300. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:13,785][121949] Avg episode reward: [(0, '5891.752'), (1, '5597.737')] [2023-12-26 01:22:14,121][123091] Updated weights for policy 0, policy_version 223825 (0.0007) [2023-12-26 01:22:14,175][123091] Updated weights for policy 0, policy_version 223835 (0.0009) [2023-12-26 01:22:14,228][123091] Updated weights for policy 0, policy_version 223845 (0.0009) [2023-12-26 01:22:14,287][123091] Updated weights for policy 0, policy_version 223855 (0.0008) [2023-12-26 01:22:14,478][123090] Updated weights for policy 1, policy_version 222856 (0.0007) [2023-12-26 01:22:14,525][123090] Updated weights for policy 1, policy_version 222866 (0.0005) [2023-12-26 01:22:14,594][123090] Updated weights for policy 1, policy_version 222876 (0.0005) [2023-12-26 01:22:15,204][123091] Updated weights for policy 0, policy_version 223865 (0.0009) [2023-12-26 01:22:15,258][123091] Updated weights for policy 0, policy_version 223875 (0.0009) [2023-12-26 01:22:15,328][123091] Updated weights for policy 0, policy_version 223885 (0.0008) [2023-12-26 01:22:15,413][123090] Updated weights for policy 1, policy_version 222886 (0.0005) [2023-12-26 01:22:15,478][123090] Updated weights for policy 1, policy_version 222896 (0.0007) [2023-12-26 01:22:15,541][123090] Updated weights for policy 1, policy_version 222906 (0.0010) [2023-12-26 01:22:16,048][123091] Updated weights for policy 0, policy_version 223895 (0.0007) [2023-12-26 01:22:16,109][123091] Updated weights for policy 0, policy_version 223905 (0.0009) [2023-12-26 01:22:16,167][123091] Updated weights for policy 0, policy_version 223915 (0.0010) [2023-12-26 01:22:16,327][123090] Updated weights for policy 1, policy_version 222916 (0.0008) [2023-12-26 01:22:16,383][123090] Updated weights for policy 1, policy_version 222926 (0.0005) [2023-12-26 01:22:16,428][123090] Updated weights for policy 1, policy_version 222936 (0.0005) [2023-12-26 01:22:16,950][123091] Updated weights for policy 0, policy_version 223925 (0.0010) [2023-12-26 01:22:17,006][123091] Updated weights for policy 0, policy_version 223935 (0.0010) [2023-12-26 01:22:17,071][123091] Updated weights for policy 0, policy_version 223945 (0.0009) [2023-12-26 01:22:17,188][123090] Updated weights for policy 1, policy_version 222946 (0.0006) [2023-12-26 01:22:17,247][123090] Updated weights for policy 1, policy_version 222956 (0.0010) [2023-12-26 01:22:17,302][123090] Updated weights for policy 1, policy_version 222966 (0.0010) [2023-12-26 01:22:17,360][123090] Updated weights for policy 1, policy_version 222976 (0.0009) [2023-12-26 01:22:17,907][123091] Updated weights for policy 0, policy_version 223955 (0.0009) [2023-12-26 01:22:17,970][123091] Updated weights for policy 0, policy_version 223965 (0.0010) [2023-12-26 01:22:18,024][123091] Updated weights for policy 0, policy_version 223975 (0.0010) [2023-12-26 01:22:18,155][123090] Updated weights for policy 1, policy_version 222986 (0.0007) [2023-12-26 01:22:18,214][123090] Updated weights for policy 1, policy_version 222996 (0.0009) [2023-12-26 01:22:18,278][123090] Updated weights for policy 1, policy_version 223006 (0.0009) [2023-12-26 01:22:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 114434048. Throughput: 0: 8796.7, 1: 8647.6. Samples: 114448824. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:18,784][121949] Avg episode reward: [(0, '5846.544'), (1, '5429.453')] [2023-12-26 01:22:18,867][123091] Updated weights for policy 0, policy_version 223985 (0.0009) [2023-12-26 01:22:18,919][123091] Updated weights for policy 0, policy_version 223995 (0.0006) [2023-12-26 01:22:18,972][123091] Updated weights for policy 0, policy_version 224005 (0.0008) [2023-12-26 01:22:19,043][123091] Updated weights for policy 0, policy_version 224015 (0.0009) [2023-12-26 01:22:19,128][123090] Updated weights for policy 1, policy_version 223016 (0.0009) [2023-12-26 01:22:19,193][123090] Updated weights for policy 1, policy_version 223026 (0.0009) [2023-12-26 01:22:19,261][123090] Updated weights for policy 1, policy_version 223036 (0.0010) [2023-12-26 01:22:19,897][123091] Updated weights for policy 0, policy_version 224025 (0.0010) [2023-12-26 01:22:19,953][123091] Updated weights for policy 0, policy_version 224035 (0.0011) [2023-12-26 01:22:20,013][123091] Updated weights for policy 0, policy_version 224045 (0.0011) [2023-12-26 01:22:20,108][123090] Updated weights for policy 1, policy_version 223046 (0.0009) [2023-12-26 01:22:20,179][123090] Updated weights for policy 1, policy_version 223056 (0.0009) [2023-12-26 01:22:20,235][123090] Updated weights for policy 1, policy_version 223066 (0.0009) [2023-12-26 01:22:20,780][123091] Updated weights for policy 0, policy_version 224055 (0.0011) [2023-12-26 01:22:20,844][123091] Updated weights for policy 0, policy_version 224065 (0.0010) [2023-12-26 01:22:20,906][123091] Updated weights for policy 0, policy_version 224075 (0.0008) [2023-12-26 01:22:21,134][123090] Updated weights for policy 1, policy_version 223076 (0.0009) [2023-12-26 01:22:21,199][123090] Updated weights for policy 1, policy_version 223086 (0.0010) [2023-12-26 01:22:21,261][123090] Updated weights for policy 1, policy_version 223096 (0.0010) [2023-12-26 01:22:21,686][123091] Updated weights for policy 0, policy_version 224085 (0.0008) [2023-12-26 01:22:21,755][123091] Updated weights for policy 0, policy_version 224095 (0.0008) [2023-12-26 01:22:21,819][123091] Updated weights for policy 0, policy_version 224105 (0.0007) [2023-12-26 01:22:22,125][123090] Updated weights for policy 1, policy_version 223106 (0.0009) [2023-12-26 01:22:22,176][123090] Updated weights for policy 1, policy_version 223116 (0.0009) [2023-12-26 01:22:22,228][123090] Updated weights for policy 1, policy_version 223126 (0.0010) [2023-12-26 01:22:22,296][123090] Updated weights for policy 1, policy_version 223136 (0.0009) [2023-12-26 01:22:22,561][123091] Updated weights for policy 0, policy_version 224115 (0.0010) [2023-12-26 01:22:22,617][123091] Updated weights for policy 0, policy_version 224125 (0.0010) [2023-12-26 01:22:22,678][123091] Updated weights for policy 0, policy_version 224135 (0.0006) [2023-12-26 01:22:23,227][123090] Updated weights for policy 1, policy_version 223146 (0.0011) [2023-12-26 01:22:23,290][123090] Updated weights for policy 1, policy_version 223156 (0.0010) [2023-12-26 01:22:23,355][123090] Updated weights for policy 1, policy_version 223166 (0.0010) [2023-12-26 01:22:23,491][123091] Updated weights for policy 0, policy_version 224145 (0.0009) [2023-12-26 01:22:23,546][123091] Updated weights for policy 0, policy_version 224155 (0.0009) [2023-12-26 01:22:23,601][123091] Updated weights for policy 0, policy_version 224165 (0.0008) [2023-12-26 01:22:23,656][123091] Updated weights for policy 0, policy_version 224175 (0.0008) [2023-12-26 01:22:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 114524160. Throughput: 0: 8780.4, 1: 8626.8. Samples: 114499020. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:23,784][121949] Avg episode reward: [(0, '5870.739'), (1, '5382.658')] [2023-12-26 01:22:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000223168_57131008.pth... [2023-12-26 01:22:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000224176_57393152.pth... [2023-12-26 01:22:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000222176_56877056.pth [2023-12-26 01:22:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000223120_57122816.pth [2023-12-26 01:22:24,154][123090] Updated weights for policy 1, policy_version 223176 (0.0010) [2023-12-26 01:22:24,216][123090] Updated weights for policy 1, policy_version 223186 (0.0010) [2023-12-26 01:22:24,281][123090] Updated weights for policy 1, policy_version 223196 (0.0010) [2023-12-26 01:22:24,476][123091] Updated weights for policy 0, policy_version 224185 (0.0006) [2023-12-26 01:22:24,530][123091] Updated weights for policy 0, policy_version 224195 (0.0005) [2023-12-26 01:22:24,577][123091] Updated weights for policy 0, policy_version 224205 (0.0005) [2023-12-26 01:22:25,088][123090] Updated weights for policy 1, policy_version 223206 (0.0010) [2023-12-26 01:22:25,139][123090] Updated weights for policy 1, policy_version 223216 (0.0010) [2023-12-26 01:22:25,186][123090] Updated weights for policy 1, policy_version 223226 (0.0010) [2023-12-26 01:22:25,322][123091] Updated weights for policy 0, policy_version 224215 (0.0007) [2023-12-26 01:22:25,376][123091] Updated weights for policy 0, policy_version 224225 (0.0010) [2023-12-26 01:22:25,440][123091] Updated weights for policy 0, policy_version 224235 (0.0010) [2023-12-26 01:22:26,028][123090] Updated weights for policy 1, policy_version 223236 (0.0010) [2023-12-26 01:22:26,088][123090] Updated weights for policy 1, policy_version 223246 (0.0011) [2023-12-26 01:22:26,143][123090] Updated weights for policy 1, policy_version 223256 (0.0010) [2023-12-26 01:22:26,189][123091] Updated weights for policy 0, policy_version 224245 (0.0008) [2023-12-26 01:22:26,239][123091] Updated weights for policy 0, policy_version 224255 (0.0005) [2023-12-26 01:22:26,283][123091] Updated weights for policy 0, policy_version 224265 (0.0005) [2023-12-26 01:22:26,945][123090] Updated weights for policy 1, policy_version 223266 (0.0010) [2023-12-26 01:22:27,002][123090] Updated weights for policy 1, policy_version 223276 (0.0010) [2023-12-26 01:22:27,010][123091] Updated weights for policy 0, policy_version 224275 (0.0008) [2023-12-26 01:22:27,053][123090] Updated weights for policy 1, policy_version 223286 (0.0010) [2023-12-26 01:22:27,057][123091] Updated weights for policy 0, policy_version 224285 (0.0010) [2023-12-26 01:22:27,107][123090] Updated weights for policy 1, policy_version 223296 (0.0005) [2023-12-26 01:22:27,109][123091] Updated weights for policy 0, policy_version 224295 (0.0009) [2023-12-26 01:22:27,790][123091] Updated weights for policy 0, policy_version 224305 (0.0005) [2023-12-26 01:22:27,841][123091] Updated weights for policy 0, policy_version 224315 (0.0005) [2023-12-26 01:22:27,885][123090] Updated weights for policy 1, policy_version 223306 (0.0010) [2023-12-26 01:22:27,907][123091] Updated weights for policy 0, policy_version 224325 (0.0006) [2023-12-26 01:22:27,936][123090] Updated weights for policy 1, policy_version 223316 (0.0010) [2023-12-26 01:22:27,958][123091] Updated weights for policy 0, policy_version 224335 (0.0007) [2023-12-26 01:22:27,994][123090] Updated weights for policy 1, policy_version 223326 (0.0010) [2023-12-26 01:22:28,643][123091] Updated weights for policy 0, policy_version 224345 (0.0006) [2023-12-26 01:22:28,711][123091] Updated weights for policy 0, policy_version 224355 (0.0005) [2023-12-26 01:22:28,769][123091] Updated weights for policy 0, policy_version 224365 (0.0007) [2023-12-26 01:22:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 114614272. Throughput: 0: 8892.0, 1: 8591.8. Samples: 114606296. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:28,785][121949] Avg episode reward: [(0, '5881.002'), (1, '5260.913')] [2023-12-26 01:22:28,825][123090] Updated weights for policy 1, policy_version 223336 (0.0010) [2023-12-26 01:22:28,876][123090] Updated weights for policy 1, policy_version 223346 (0.0010) [2023-12-26 01:22:28,943][123090] Updated weights for policy 1, policy_version 223356 (0.0010) [2023-12-26 01:22:29,486][123091] Updated weights for policy 0, policy_version 224375 (0.0010) [2023-12-26 01:22:29,551][123091] Updated weights for policy 0, policy_version 224385 (0.0010) [2023-12-26 01:22:29,617][123091] Updated weights for policy 0, policy_version 224395 (0.0010) [2023-12-26 01:22:29,709][123090] Updated weights for policy 1, policy_version 223366 (0.0005) [2023-12-26 01:22:29,765][123090] Updated weights for policy 1, policy_version 223376 (0.0005) [2023-12-26 01:22:29,823][123090] Updated weights for policy 1, policy_version 223386 (0.0006) [2023-12-26 01:22:30,414][123091] Updated weights for policy 0, policy_version 224405 (0.0008) [2023-12-26 01:22:30,474][123091] Updated weights for policy 0, policy_version 224415 (0.0005) [2023-12-26 01:22:30,535][123091] Updated weights for policy 0, policy_version 224425 (0.0005) [2023-12-26 01:22:30,655][123090] Updated weights for policy 1, policy_version 223396 (0.0008) [2023-12-26 01:22:30,710][123090] Updated weights for policy 1, policy_version 223406 (0.0010) [2023-12-26 01:22:30,757][123090] Updated weights for policy 1, policy_version 223416 (0.0010) [2023-12-26 01:22:31,213][123091] Updated weights for policy 0, policy_version 224435 (0.0007) [2023-12-26 01:22:31,265][123091] Updated weights for policy 0, policy_version 224445 (0.0010) [2023-12-26 01:22:31,323][123091] Updated weights for policy 0, policy_version 224455 (0.0010) [2023-12-26 01:22:31,569][123090] Updated weights for policy 1, policy_version 223426 (0.0009) [2023-12-26 01:22:31,642][123090] Updated weights for policy 1, policy_version 223436 (0.0007) [2023-12-26 01:22:31,705][123090] Updated weights for policy 1, policy_version 223446 (0.0008) [2023-12-26 01:22:31,773][123090] Updated weights for policy 1, policy_version 223456 (0.0009) [2023-12-26 01:22:32,172][123091] Updated weights for policy 0, policy_version 224465 (0.0011) [2023-12-26 01:22:32,230][123091] Updated weights for policy 0, policy_version 224475 (0.0010) [2023-12-26 01:22:32,293][123091] Updated weights for policy 0, policy_version 224485 (0.0010) [2023-12-26 01:22:32,356][123091] Updated weights for policy 0, policy_version 224495 (0.0011) [2023-12-26 01:22:32,577][123090] Updated weights for policy 1, policy_version 223466 (0.0005) [2023-12-26 01:22:32,641][123090] Updated weights for policy 1, policy_version 223476 (0.0006) [2023-12-26 01:22:32,697][123090] Updated weights for policy 1, policy_version 223486 (0.0006) [2023-12-26 01:22:33,187][123091] Updated weights for policy 0, policy_version 224505 (0.0007) [2023-12-26 01:22:33,231][123091] Updated weights for policy 0, policy_version 224515 (0.0005) [2023-12-26 01:22:33,280][123091] Updated weights for policy 0, policy_version 224525 (0.0005) [2023-12-26 01:22:33,356][123090] Updated weights for policy 1, policy_version 223496 (0.0005) [2023-12-26 01:22:33,404][123090] Updated weights for policy 1, policy_version 223506 (0.0005) [2023-12-26 01:22:33,449][123090] Updated weights for policy 1, policy_version 223516 (0.0005) [2023-12-26 01:22:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 114704384. Throughput: 0: 8989.9, 1: 8655.3. Samples: 114716656. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:33,785][121949] Avg episode reward: [(0, '5842.189'), (1, '5379.361')] [2023-12-26 01:22:33,964][123091] Updated weights for policy 0, policy_version 224535 (0.0005) [2023-12-26 01:22:34,012][123091] Updated weights for policy 0, policy_version 224545 (0.0006) [2023-12-26 01:22:34,060][123091] Updated weights for policy 0, policy_version 224555 (0.0005) [2023-12-26 01:22:34,127][123090] Updated weights for policy 1, policy_version 223526 (0.0006) [2023-12-26 01:22:34,201][123090] Updated weights for policy 1, policy_version 223536 (0.0008) [2023-12-26 01:22:34,270][123090] Updated weights for policy 1, policy_version 223546 (0.0008) [2023-12-26 01:22:34,793][123091] Updated weights for policy 0, policy_version 224565 (0.0007) [2023-12-26 01:22:34,862][123091] Updated weights for policy 0, policy_version 224575 (0.0010) [2023-12-26 01:22:34,949][123091] Updated weights for policy 0, policy_version 224585 (0.0010) [2023-12-26 01:22:35,029][123090] Updated weights for policy 1, policy_version 223556 (0.0009) [2023-12-26 01:22:35,100][123090] Updated weights for policy 1, policy_version 223566 (0.0009) [2023-12-26 01:22:35,165][123090] Updated weights for policy 1, policy_version 223576 (0.0008) [2023-12-26 01:22:35,718][123091] Updated weights for policy 0, policy_version 224595 (0.0009) [2023-12-26 01:22:35,793][123091] Updated weights for policy 0, policy_version 224605 (0.0008) [2023-12-26 01:22:35,858][123091] Updated weights for policy 0, policy_version 224615 (0.0007) [2023-12-26 01:22:36,041][123090] Updated weights for policy 1, policy_version 223586 (0.0010) [2023-12-26 01:22:36,101][123090] Updated weights for policy 1, policy_version 223596 (0.0006) [2023-12-26 01:22:36,172][123090] Updated weights for policy 1, policy_version 223606 (0.0008) [2023-12-26 01:22:36,235][123090] Updated weights for policy 1, policy_version 223616 (0.0008) [2023-12-26 01:22:36,534][123091] Updated weights for policy 0, policy_version 224625 (0.0010) [2023-12-26 01:22:36,605][123091] Updated weights for policy 0, policy_version 224635 (0.0010) [2023-12-26 01:22:36,664][123091] Updated weights for policy 0, policy_version 224645 (0.0005) [2023-12-26 01:22:36,732][123091] Updated weights for policy 0, policy_version 224655 (0.0009) [2023-12-26 01:22:36,957][123090] Updated weights for policy 1, policy_version 223626 (0.0005) [2023-12-26 01:22:37,005][123090] Updated weights for policy 1, policy_version 223636 (0.0005) [2023-12-26 01:22:37,052][123090] Updated weights for policy 1, policy_version 223646 (0.0006) [2023-12-26 01:22:37,463][123091] Updated weights for policy 0, policy_version 224665 (0.0008) [2023-12-26 01:22:37,518][123091] Updated weights for policy 0, policy_version 224675 (0.0010) [2023-12-26 01:22:37,577][123091] Updated weights for policy 0, policy_version 224685 (0.0010) [2023-12-26 01:22:37,792][123090] Updated weights for policy 1, policy_version 223656 (0.0005) [2023-12-26 01:22:37,866][123090] Updated weights for policy 1, policy_version 223666 (0.0005) [2023-12-26 01:22:37,942][123090] Updated weights for policy 1, policy_version 223676 (0.0005) [2023-12-26 01:22:38,198][123091] Updated weights for policy 0, policy_version 224695 (0.0011) [2023-12-26 01:22:38,258][123091] Updated weights for policy 0, policy_version 224705 (0.0010) [2023-12-26 01:22:38,310][123091] Updated weights for policy 0, policy_version 224715 (0.0011) [2023-12-26 01:22:38,547][123090] Updated weights for policy 1, policy_version 223686 (0.0008) [2023-12-26 01:22:38,616][123090] Updated weights for policy 1, policy_version 223696 (0.0009) [2023-12-26 01:22:38,675][123090] Updated weights for policy 1, policy_version 223706 (0.0010) [2023-12-26 01:22:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 114802688. Throughput: 0: 9057.6, 1: 8669.2. Samples: 114771780. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:38,785][121949] Avg episode reward: [(0, '5867.359'), (1, '5439.041')] [2023-12-26 01:22:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000224720_57532416.pth... [2023-12-26 01:22:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000223712_57270272.pth... [2023-12-26 01:22:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000222688_57008128.pth [2023-12-26 01:22:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000223664_57262080.pth [2023-12-26 01:22:39,155][123091] Updated weights for policy 0, policy_version 224725 (0.0008) [2023-12-26 01:22:39,223][123091] Updated weights for policy 0, policy_version 224735 (0.0010) [2023-12-26 01:22:39,297][123091] Updated weights for policy 0, policy_version 224745 (0.0010) [2023-12-26 01:22:39,507][123090] Updated weights for policy 1, policy_version 223716 (0.0010) [2023-12-26 01:22:39,573][123090] Updated weights for policy 1, policy_version 223726 (0.0009) [2023-12-26 01:22:39,637][123090] Updated weights for policy 1, policy_version 223736 (0.0009) [2023-12-26 01:22:40,138][123091] Updated weights for policy 0, policy_version 224755 (0.0009) [2023-12-26 01:22:40,184][123091] Updated weights for policy 0, policy_version 224765 (0.0005) [2023-12-26 01:22:40,251][123091] Updated weights for policy 0, policy_version 224775 (0.0006) [2023-12-26 01:22:40,462][123090] Updated weights for policy 1, policy_version 223746 (0.0009) [2023-12-26 01:22:40,513][123090] Updated weights for policy 1, policy_version 223756 (0.0010) [2023-12-26 01:22:40,573][123090] Updated weights for policy 1, policy_version 223766 (0.0010) [2023-12-26 01:22:40,621][123090] Updated weights for policy 1, policy_version 223776 (0.0010) [2023-12-26 01:22:41,025][123091] Updated weights for policy 0, policy_version 224785 (0.0009) [2023-12-26 01:22:41,094][123091] Updated weights for policy 0, policy_version 224795 (0.0008) [2023-12-26 01:22:41,168][123091] Updated weights for policy 0, policy_version 224805 (0.0008) [2023-12-26 01:22:41,228][123091] Updated weights for policy 0, policy_version 224815 (0.0009) [2023-12-26 01:22:41,510][123090] Updated weights for policy 1, policy_version 223786 (0.0006) [2023-12-26 01:22:41,563][123090] Updated weights for policy 1, policy_version 223796 (0.0005) [2023-12-26 01:22:41,628][123090] Updated weights for policy 1, policy_version 223806 (0.0007) [2023-12-26 01:22:42,214][123091] Updated weights for policy 0, policy_version 224825 (0.0010) [2023-12-26 01:22:42,274][123091] Updated weights for policy 0, policy_version 224835 (0.0009) [2023-12-26 01:22:42,340][123091] Updated weights for policy 0, policy_version 224845 (0.0008) [2023-12-26 01:22:42,346][123090] Updated weights for policy 1, policy_version 223816 (0.0010) [2023-12-26 01:22:42,407][123090] Updated weights for policy 1, policy_version 223826 (0.0010) [2023-12-26 01:22:42,473][123090] Updated weights for policy 1, policy_version 223836 (0.0010) [2023-12-26 01:22:43,173][123091] Updated weights for policy 0, policy_version 224855 (0.0010) [2023-12-26 01:22:43,226][123091] Updated weights for policy 0, policy_version 224865 (0.0010) [2023-12-26 01:22:43,281][123090] Updated weights for policy 1, policy_version 223846 (0.0007) [2023-12-26 01:22:43,284][123091] Updated weights for policy 0, policy_version 224875 (0.0009) [2023-12-26 01:22:43,340][123090] Updated weights for policy 1, policy_version 223856 (0.0005) [2023-12-26 01:22:43,397][123090] Updated weights for policy 1, policy_version 223866 (0.0008) [2023-12-26 01:22:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 114884608. Throughput: 0: 8997.8, 1: 8700.8. Samples: 114878544. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:43,785][121949] Avg episode reward: [(0, '5906.225'), (1, '5247.866')] [2023-12-26 01:22:44,077][123091] Updated weights for policy 0, policy_version 224885 (0.0009) [2023-12-26 01:22:44,131][123091] Updated weights for policy 0, policy_version 224895 (0.0010) [2023-12-26 01:22:44,187][123091] Updated weights for policy 0, policy_version 224905 (0.0009) [2023-12-26 01:22:44,200][123090] Updated weights for policy 1, policy_version 223876 (0.0007) [2023-12-26 01:22:44,246][123090] Updated weights for policy 1, policy_version 223886 (0.0006) [2023-12-26 01:22:44,319][123090] Updated weights for policy 1, policy_version 223896 (0.0006) [2023-12-26 01:22:44,945][123091] Updated weights for policy 0, policy_version 224915 (0.0008) [2023-12-26 01:22:45,012][123090] Updated weights for policy 1, policy_version 223906 (0.0010) [2023-12-26 01:22:45,021][123091] Updated weights for policy 0, policy_version 224925 (0.0007) [2023-12-26 01:22:45,080][123090] Updated weights for policy 1, policy_version 223916 (0.0011) [2023-12-26 01:22:45,086][123091] Updated weights for policy 0, policy_version 224935 (0.0008) [2023-12-26 01:22:45,144][123090] Updated weights for policy 1, policy_version 223926 (0.0011) [2023-12-26 01:22:45,215][123090] Updated weights for policy 1, policy_version 223936 (0.0011) [2023-12-26 01:22:45,745][123091] Updated weights for policy 0, policy_version 224945 (0.0009) [2023-12-26 01:22:45,807][123091] Updated weights for policy 0, policy_version 224955 (0.0006) [2023-12-26 01:22:45,858][123091] Updated weights for policy 0, policy_version 224965 (0.0005) [2023-12-26 01:22:45,914][123091] Updated weights for policy 0, policy_version 224975 (0.0005) [2023-12-26 01:22:46,035][123090] Updated weights for policy 1, policy_version 223946 (0.0011) [2023-12-26 01:22:46,091][123090] Updated weights for policy 1, policy_version 223956 (0.0011) [2023-12-26 01:22:46,139][123090] Updated weights for policy 1, policy_version 223966 (0.0010) [2023-12-26 01:22:46,556][123091] Updated weights for policy 0, policy_version 224985 (0.0005) [2023-12-26 01:22:46,613][123091] Updated weights for policy 0, policy_version 224995 (0.0005) [2023-12-26 01:22:46,682][123091] Updated weights for policy 0, policy_version 225005 (0.0005) [2023-12-26 01:22:46,965][123090] Updated weights for policy 1, policy_version 223976 (0.0006) [2023-12-26 01:22:47,018][123090] Updated weights for policy 1, policy_version 223986 (0.0005) [2023-12-26 01:22:47,071][123090] Updated weights for policy 1, policy_version 223996 (0.0005) [2023-12-26 01:22:47,463][123091] Updated weights for policy 0, policy_version 225015 (0.0008) [2023-12-26 01:22:47,511][123091] Updated weights for policy 0, policy_version 225025 (0.0009) [2023-12-26 01:22:47,565][123091] Updated weights for policy 0, policy_version 225035 (0.0008) [2023-12-26 01:22:47,810][123090] Updated weights for policy 1, policy_version 224006 (0.0008) [2023-12-26 01:22:47,872][123090] Updated weights for policy 1, policy_version 224016 (0.0010) [2023-12-26 01:22:47,930][123090] Updated weights for policy 1, policy_version 224026 (0.0010) [2023-12-26 01:22:48,465][123091] Updated weights for policy 0, policy_version 225045 (0.0008) [2023-12-26 01:22:48,539][123091] Updated weights for policy 0, policy_version 225055 (0.0005) [2023-12-26 01:22:48,609][123091] Updated weights for policy 0, policy_version 225065 (0.0006) [2023-12-26 01:22:48,660][123090] Updated weights for policy 1, policy_version 224036 (0.0008) [2023-12-26 01:22:48,723][123090] Updated weights for policy 1, policy_version 224046 (0.0009) [2023-12-26 01:22:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 114974720. Throughput: 0: 9066.4, 1: 8796.6. Samples: 114989000. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:48,785][121949] Avg episode reward: [(0, '5939.181'), (1, '5231.013')] [2023-12-26 01:22:48,791][123090] Updated weights for policy 1, policy_version 224056 (0.0010) [2023-12-26 01:22:49,356][123091] Updated weights for policy 0, policy_version 225075 (0.0008) [2023-12-26 01:22:49,422][123091] Updated weights for policy 0, policy_version 225085 (0.0006) [2023-12-26 01:22:49,487][123091] Updated weights for policy 0, policy_version 225095 (0.0005) [2023-12-26 01:22:49,597][123090] Updated weights for policy 1, policy_version 224066 (0.0010) [2023-12-26 01:22:49,668][123090] Updated weights for policy 1, policy_version 224076 (0.0006) [2023-12-26 01:22:49,734][123090] Updated weights for policy 1, policy_version 224086 (0.0009) [2023-12-26 01:22:49,803][123090] Updated weights for policy 1, policy_version 224096 (0.0011) [2023-12-26 01:22:50,226][123091] Updated weights for policy 0, policy_version 225105 (0.0006) [2023-12-26 01:22:50,291][123091] Updated weights for policy 0, policy_version 225115 (0.0009) [2023-12-26 01:22:50,364][123091] Updated weights for policy 0, policy_version 225125 (0.0009) [2023-12-26 01:22:50,428][123091] Updated weights for policy 0, policy_version 225135 (0.0008) [2023-12-26 01:22:50,665][123090] Updated weights for policy 1, policy_version 224106 (0.0007) [2023-12-26 01:22:50,740][123090] Updated weights for policy 1, policy_version 224116 (0.0007) [2023-12-26 01:22:50,809][123090] Updated weights for policy 1, policy_version 224126 (0.0006) [2023-12-26 01:22:51,204][123091] Updated weights for policy 0, policy_version 225145 (0.0008) [2023-12-26 01:22:51,276][123091] Updated weights for policy 0, policy_version 225155 (0.0008) [2023-12-26 01:22:51,342][123091] Updated weights for policy 0, policy_version 225165 (0.0008) [2023-12-26 01:22:51,514][123090] Updated weights for policy 1, policy_version 224136 (0.0009) [2023-12-26 01:22:51,589][123090] Updated weights for policy 1, policy_version 224146 (0.0011) [2023-12-26 01:22:51,650][123090] Updated weights for policy 1, policy_version 224156 (0.0011) [2023-12-26 01:22:52,115][123091] Updated weights for policy 0, policy_version 225175 (0.0010) [2023-12-26 01:22:52,189][123091] Updated weights for policy 0, policy_version 225185 (0.0010) [2023-12-26 01:22:52,253][123091] Updated weights for policy 0, policy_version 225195 (0.0011) [2023-12-26 01:22:52,386][123090] Updated weights for policy 1, policy_version 224166 (0.0009) [2023-12-26 01:22:52,444][123090] Updated weights for policy 1, policy_version 224176 (0.0005) [2023-12-26 01:22:52,502][123090] Updated weights for policy 1, policy_version 224186 (0.0008) [2023-12-26 01:22:53,021][123091] Updated weights for policy 0, policy_version 225205 (0.0010) [2023-12-26 01:22:53,082][123091] Updated weights for policy 0, policy_version 225215 (0.0005) [2023-12-26 01:22:53,148][123091] Updated weights for policy 0, policy_version 225225 (0.0005) [2023-12-26 01:22:53,384][123090] Updated weights for policy 1, policy_version 224196 (0.0009) [2023-12-26 01:22:53,435][123090] Updated weights for policy 1, policy_version 224206 (0.0009) [2023-12-26 01:22:53,490][123090] Updated weights for policy 1, policy_version 224216 (0.0010) [2023-12-26 01:22:53,776][123091] Updated weights for policy 0, policy_version 225235 (0.0005) [2023-12-26 01:22:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 115064832. Throughput: 0: 9078.6, 1: 8807.5. Samples: 115041628. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:53,785][121949] Avg episode reward: [(0, '5906.795'), (1, '5440.294')] [2023-12-26 01:22:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000224224_57401344.pth... [2023-12-26 01:22:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000223168_57131008.pth [2023-12-26 01:22:53,830][123091] Updated weights for policy 0, policy_version 225245 (0.0005) [2023-12-26 01:22:53,902][123091] Updated weights for policy 0, policy_version 225255 (0.0005) [2023-12-26 01:22:53,968][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000225264_57671680.pth... [2023-12-26 01:22:53,973][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000224176_57393152.pth [2023-12-26 01:22:54,407][123090] Updated weights for policy 1, policy_version 224226 (0.0009) [2023-12-26 01:22:54,455][123090] Updated weights for policy 1, policy_version 224236 (0.0005) [2023-12-26 01:22:54,480][123091] Updated weights for policy 0, policy_version 225265 (0.0006) [2023-12-26 01:22:54,523][123090] Updated weights for policy 1, policy_version 224246 (0.0005) [2023-12-26 01:22:54,533][123091] Updated weights for policy 0, policy_version 225275 (0.0005) [2023-12-26 01:22:54,573][123090] Updated weights for policy 1, policy_version 224256 (0.0005) [2023-12-26 01:22:54,593][123091] Updated weights for policy 0, policy_version 225285 (0.0005) [2023-12-26 01:22:54,649][123091] Updated weights for policy 0, policy_version 225295 (0.0005) [2023-12-26 01:22:55,307][123090] Updated weights for policy 1, policy_version 224266 (0.0009) [2023-12-26 01:22:55,357][123090] Updated weights for policy 1, policy_version 224276 (0.0009) [2023-12-26 01:22:55,375][123091] Updated weights for policy 0, policy_version 225305 (0.0007) [2023-12-26 01:22:55,415][123090] Updated weights for policy 1, policy_version 224287 (0.0009) [2023-12-26 01:22:55,437][123091] Updated weights for policy 0, policy_version 225315 (0.0010) [2023-12-26 01:22:55,502][123091] Updated weights for policy 0, policy_version 225325 (0.0010) [2023-12-26 01:22:56,287][123090] Updated weights for policy 1, policy_version 224297 (0.0006) [2023-12-26 01:22:56,302][123091] Updated weights for policy 0, policy_version 225335 (0.0010) [2023-12-26 01:22:56,342][123090] Updated weights for policy 1, policy_version 224307 (0.0007) [2023-12-26 01:22:56,360][123091] Updated weights for policy 0, policy_version 225345 (0.0010) [2023-12-26 01:22:56,392][123090] Updated weights for policy 1, policy_version 224317 (0.0008) [2023-12-26 01:22:56,411][123091] Updated weights for policy 0, policy_version 225355 (0.0010) [2023-12-26 01:22:57,013][123091] Updated weights for policy 0, policy_version 225365 (0.0008) [2023-12-26 01:22:57,062][123091] Updated weights for policy 0, policy_version 225375 (0.0005) [2023-12-26 01:22:57,113][123091] Updated weights for policy 0, policy_version 225385 (0.0006) [2023-12-26 01:22:57,220][123090] Updated weights for policy 1, policy_version 224327 (0.0007) [2023-12-26 01:22:57,274][123090] Updated weights for policy 1, policy_version 224337 (0.0007) [2023-12-26 01:22:57,332][123090] Updated weights for policy 1, policy_version 224347 (0.0005) [2023-12-26 01:22:57,870][123091] Updated weights for policy 0, policy_version 225395 (0.0008) [2023-12-26 01:22:57,927][123091] Updated weights for policy 0, policy_version 225405 (0.0007) [2023-12-26 01:22:57,982][123091] Updated weights for policy 0, policy_version 225415 (0.0007) [2023-12-26 01:22:58,011][123090] Updated weights for policy 1, policy_version 224357 (0.0006) [2023-12-26 01:22:58,072][123090] Updated weights for policy 1, policy_version 224367 (0.0008) [2023-12-26 01:22:58,135][123090] Updated weights for policy 1, policy_version 224377 (0.0010) [2023-12-26 01:22:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 115154944. Throughput: 0: 9145.3, 1: 8808.0. Samples: 115151196. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:22:58,785][121949] Avg episode reward: [(0, '5873.199'), (1, '5371.540')] [2023-12-26 01:22:58,846][123091] Updated weights for policy 0, policy_version 225425 (0.0010) [2023-12-26 01:22:58,911][123091] Updated weights for policy 0, policy_version 225435 (0.0008) [2023-12-26 01:22:58,976][123091] Updated weights for policy 0, policy_version 225445 (0.0008) [2023-12-26 01:22:59,049][123091] Updated weights for policy 0, policy_version 225455 (0.0008) [2023-12-26 01:22:59,055][123090] Updated weights for policy 1, policy_version 224387 (0.0010) [2023-12-26 01:22:59,114][123090] Updated weights for policy 1, policy_version 224397 (0.0007) [2023-12-26 01:22:59,176][123090] Updated weights for policy 1, policy_version 224407 (0.0005) [2023-12-26 01:22:59,836][123091] Updated weights for policy 0, policy_version 225465 (0.0009) [2023-12-26 01:22:59,896][123091] Updated weights for policy 0, policy_version 225475 (0.0009) [2023-12-26 01:22:59,913][123090] Updated weights for policy 1, policy_version 224417 (0.0007) [2023-12-26 01:22:59,963][123091] Updated weights for policy 0, policy_version 225485 (0.0009) [2023-12-26 01:22:59,980][123090] Updated weights for policy 1, policy_version 224427 (0.0008) [2023-12-26 01:23:00,042][123090] Updated weights for policy 1, policy_version 224437 (0.0009) [2023-12-26 01:23:00,108][123090] Updated weights for policy 1, policy_version 224447 (0.0009) [2023-12-26 01:23:00,760][123091] Updated weights for policy 0, policy_version 225495 (0.0005) [2023-12-26 01:23:00,836][123091] Updated weights for policy 0, policy_version 225505 (0.0005) [2023-12-26 01:23:00,908][123091] Updated weights for policy 0, policy_version 225515 (0.0005) [2023-12-26 01:23:00,959][123090] Updated weights for policy 1, policy_version 224457 (0.0006) [2023-12-26 01:23:01,027][123090] Updated weights for policy 1, policy_version 224467 (0.0006) [2023-12-26 01:23:01,089][123090] Updated weights for policy 1, policy_version 224477 (0.0007) [2023-12-26 01:23:01,601][123091] Updated weights for policy 0, policy_version 225525 (0.0007) [2023-12-26 01:23:01,662][123091] Updated weights for policy 0, policy_version 225535 (0.0009) [2023-12-26 01:23:01,731][123091] Updated weights for policy 0, policy_version 225545 (0.0009) [2023-12-26 01:23:01,942][123090] Updated weights for policy 1, policy_version 224487 (0.0006) [2023-12-26 01:23:02,009][123090] Updated weights for policy 1, policy_version 224497 (0.0005) [2023-12-26 01:23:02,078][123090] Updated weights for policy 1, policy_version 224507 (0.0008) [2023-12-26 01:23:02,573][123091] Updated weights for policy 0, policy_version 225555 (0.0009) [2023-12-26 01:23:02,621][123091] Updated weights for policy 0, policy_version 225565 (0.0008) [2023-12-26 01:23:02,670][123091] Updated weights for policy 0, policy_version 225575 (0.0009) [2023-12-26 01:23:02,838][123090] Updated weights for policy 1, policy_version 224517 (0.0009) [2023-12-26 01:23:02,892][123090] Updated weights for policy 1, policy_version 224527 (0.0009) [2023-12-26 01:23:02,948][123090] Updated weights for policy 1, policy_version 224537 (0.0009) [2023-12-26 01:23:03,438][123091] Updated weights for policy 0, policy_version 225585 (0.0009) [2023-12-26 01:23:03,487][123091] Updated weights for policy 0, policy_version 225595 (0.0005) [2023-12-26 01:23:03,541][123091] Updated weights for policy 0, policy_version 225605 (0.0008) [2023-12-26 01:23:03,595][123091] Updated weights for policy 0, policy_version 225616 (0.0009) [2023-12-26 01:23:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 115245056. Throughput: 0: 9181.8, 1: 8781.0. Samples: 115257148. Policy #0 lag: (min: 26.0, avg: 37.1, max: 58.0) [2023-12-26 01:23:03,785][121949] Avg episode reward: [(0, '5926.453'), (1, '5285.837')] [2023-12-26 01:23:03,839][123090] Updated weights for policy 1, policy_version 224547 (0.0009) [2023-12-26 01:23:03,902][123090] Updated weights for policy 1, policy_version 224557 (0.0006) [2023-12-26 01:23:03,962][123090] Updated weights for policy 1, policy_version 224567 (0.0006) [2023-12-26 01:23:04,385][123091] Updated weights for policy 0, policy_version 225626 (0.0010) [2023-12-26 01:23:04,452][123091] Updated weights for policy 0, policy_version 225636 (0.0010) [2023-12-26 01:23:04,515][123091] Updated weights for policy 0, policy_version 225646 (0.0010) [2023-12-26 01:23:04,698][123090] Updated weights for policy 1, policy_version 224577 (0.0007) [2023-12-26 01:23:04,753][123090] Updated weights for policy 1, policy_version 224587 (0.0009) [2023-12-26 01:23:04,803][123090] Updated weights for policy 1, policy_version 224597 (0.0010) [2023-12-26 01:23:04,854][123090] Updated weights for policy 1, policy_version 224607 (0.0009) [2023-12-26 01:23:05,324][123091] Updated weights for policy 0, policy_version 225656 (0.0009) [2023-12-26 01:23:05,393][123091] Updated weights for policy 0, policy_version 225666 (0.0006) [2023-12-26 01:23:05,455][123091] Updated weights for policy 0, policy_version 225676 (0.0009) [2023-12-26 01:23:05,740][123090] Updated weights for policy 1, policy_version 224617 (0.0008) [2023-12-26 01:23:05,811][123090] Updated weights for policy 1, policy_version 224627 (0.0008) [2023-12-26 01:23:05,865][123090] Updated weights for policy 1, policy_version 224637 (0.0008) [2023-12-26 01:23:06,266][123091] Updated weights for policy 0, policy_version 225686 (0.0010) [2023-12-26 01:23:06,328][123091] Updated weights for policy 0, policy_version 225696 (0.0010) [2023-12-26 01:23:06,389][123091] Updated weights for policy 0, policy_version 225706 (0.0009) [2023-12-26 01:23:06,680][123090] Updated weights for policy 1, policy_version 224647 (0.0006) [2023-12-26 01:23:06,745][123090] Updated weights for policy 1, policy_version 224657 (0.0005) [2023-12-26 01:23:06,817][123090] Updated weights for policy 1, policy_version 224667 (0.0008) [2023-12-26 01:23:07,254][123091] Updated weights for policy 0, policy_version 225716 (0.0010) [2023-12-26 01:23:07,314][123091] Updated weights for policy 0, policy_version 225726 (0.0009) [2023-12-26 01:23:07,370][123091] Updated weights for policy 0, policy_version 225737 (0.0009) [2023-12-26 01:23:07,595][123090] Updated weights for policy 1, policy_version 224677 (0.0010) [2023-12-26 01:23:07,657][123090] Updated weights for policy 1, policy_version 224687 (0.0010) [2023-12-26 01:23:07,718][123090] Updated weights for policy 1, policy_version 224697 (0.0009) [2023-12-26 01:23:08,107][123091] Updated weights for policy 0, policy_version 225747 (0.0009) [2023-12-26 01:23:08,153][123091] Updated weights for policy 0, policy_version 225757 (0.0008) [2023-12-26 01:23:08,212][123091] Updated weights for policy 0, policy_version 225767 (0.0005) [2023-12-26 01:23:08,560][123090] Updated weights for policy 1, policy_version 224707 (0.0010) [2023-12-26 01:23:08,628][123090] Updated weights for policy 1, policy_version 224717 (0.0009) [2023-12-26 01:23:08,686][123090] Updated weights for policy 1, policy_version 224727 (0.0010) [2023-12-26 01:23:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 115335168. Throughput: 0: 9165.5, 1: 8823.7. Samples: 115308536. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:08,785][121949] Avg episode reward: [(0, '5910.619'), (1, '5425.439')] [2023-12-26 01:23:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000225776_57802752.pth... [2023-12-26 01:23:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000224736_57532416.pth... [2023-12-26 01:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000224720_57532416.pth [2023-12-26 01:23:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000223712_57270272.pth [2023-12-26 01:23:08,984][123091] Updated weights for policy 0, policy_version 225777 (0.0006) [2023-12-26 01:23:09,037][123091] Updated weights for policy 0, policy_version 225787 (0.0009) [2023-12-26 01:23:09,087][123091] Updated weights for policy 0, policy_version 225797 (0.0009) [2023-12-26 01:23:09,134][123091] Updated weights for policy 0, policy_version 225807 (0.0009) [2023-12-26 01:23:09,530][123090] Updated weights for policy 1, policy_version 224737 (0.0010) [2023-12-26 01:23:09,584][123090] Updated weights for policy 1, policy_version 224747 (0.0009) [2023-12-26 01:23:09,642][123090] Updated weights for policy 1, policy_version 224757 (0.0010) [2023-12-26 01:23:09,703][123090] Updated weights for policy 1, policy_version 224767 (0.0010) [2023-12-26 01:23:10,046][123091] Updated weights for policy 0, policy_version 225817 (0.0009) [2023-12-26 01:23:10,111][123091] Updated weights for policy 0, policy_version 225827 (0.0010) [2023-12-26 01:23:10,177][123091] Updated weights for policy 0, policy_version 225837 (0.0010) [2023-12-26 01:23:10,566][123090] Updated weights for policy 1, policy_version 224777 (0.0009) [2023-12-26 01:23:10,627][123090] Updated weights for policy 1, policy_version 224787 (0.0009) [2023-12-26 01:23:10,684][123090] Updated weights for policy 1, policy_version 224797 (0.0009) [2023-12-26 01:23:11,015][123091] Updated weights for policy 0, policy_version 225847 (0.0010) [2023-12-26 01:23:11,085][123091] Updated weights for policy 0, policy_version 225857 (0.0009) [2023-12-26 01:23:11,157][123091] Updated weights for policy 0, policy_version 225867 (0.0009) [2023-12-26 01:23:11,533][123090] Updated weights for policy 1, policy_version 224807 (0.0007) [2023-12-26 01:23:11,606][123090] Updated weights for policy 1, policy_version 224817 (0.0006) [2023-12-26 01:23:11,684][123090] Updated weights for policy 1, policy_version 224827 (0.0009) [2023-12-26 01:23:12,041][123091] Updated weights for policy 0, policy_version 225877 (0.0007) [2023-12-26 01:23:12,111][123091] Updated weights for policy 0, policy_version 225887 (0.0008) [2023-12-26 01:23:12,171][123091] Updated weights for policy 0, policy_version 225897 (0.0010) [2023-12-26 01:23:12,398][123090] Updated weights for policy 1, policy_version 224837 (0.0009) [2023-12-26 01:23:12,453][123090] Updated weights for policy 1, policy_version 224847 (0.0009) [2023-12-26 01:23:12,503][123090] Updated weights for policy 1, policy_version 224857 (0.0009) [2023-12-26 01:23:12,933][123091] Updated weights for policy 0, policy_version 225907 (0.0008) [2023-12-26 01:23:12,988][123091] Updated weights for policy 0, policy_version 225917 (0.0009) [2023-12-26 01:23:13,050][123091] Updated weights for policy 0, policy_version 225927 (0.0010) [2023-12-26 01:23:13,409][123090] Updated weights for policy 1, policy_version 224867 (0.0009) [2023-12-26 01:23:13,460][123090] Updated weights for policy 1, policy_version 224877 (0.0008) [2023-12-26 01:23:13,514][123090] Updated weights for policy 1, policy_version 224887 (0.0008) [2023-12-26 01:23:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 115417088. Throughput: 0: 9058.9, 1: 8812.0. Samples: 115410488. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:13,784][121949] Avg episode reward: [(0, '5871.661'), (1, '5536.137')] [2023-12-26 01:23:13,839][123091] Updated weights for policy 0, policy_version 225937 (0.0006) [2023-12-26 01:23:13,915][123091] Updated weights for policy 0, policy_version 225947 (0.0010) [2023-12-26 01:23:13,980][123091] Updated weights for policy 0, policy_version 225957 (0.0009) [2023-12-26 01:23:14,030][123091] Updated weights for policy 0, policy_version 225967 (0.0009) [2023-12-26 01:23:14,225][123090] Updated weights for policy 1, policy_version 224897 (0.0010) [2023-12-26 01:23:14,286][123090] Updated weights for policy 1, policy_version 224907 (0.0010) [2023-12-26 01:23:14,348][123090] Updated weights for policy 1, policy_version 224917 (0.0005) [2023-12-26 01:23:14,413][123090] Updated weights for policy 1, policy_version 224927 (0.0005) [2023-12-26 01:23:14,929][123091] Updated weights for policy 0, policy_version 225977 (0.0006) [2023-12-26 01:23:15,003][123091] Updated weights for policy 0, policy_version 225987 (0.0008) [2023-12-26 01:23:15,077][123091] Updated weights for policy 0, policy_version 225997 (0.0008) [2023-12-26 01:23:15,089][123090] Updated weights for policy 1, policy_version 224937 (0.0008) [2023-12-26 01:23:15,154][123090] Updated weights for policy 1, policy_version 224947 (0.0010) [2023-12-26 01:23:15,214][123090] Updated weights for policy 1, policy_version 224957 (0.0007) [2023-12-26 01:23:15,720][123091] Updated weights for policy 0, policy_version 226007 (0.0010) [2023-12-26 01:23:15,775][123091] Updated weights for policy 0, policy_version 226017 (0.0010) [2023-12-26 01:23:15,822][123091] Updated weights for policy 0, policy_version 226027 (0.0010) [2023-12-26 01:23:16,028][123090] Updated weights for policy 1, policy_version 224967 (0.0009) [2023-12-26 01:23:16,084][123090] Updated weights for policy 1, policy_version 224977 (0.0010) [2023-12-26 01:23:16,135][123090] Updated weights for policy 1, policy_version 224987 (0.0010) [2023-12-26 01:23:16,617][123091] Updated weights for policy 0, policy_version 226037 (0.0008) [2023-12-26 01:23:16,671][123091] Updated weights for policy 0, policy_version 226047 (0.0005) [2023-12-26 01:23:16,732][123091] Updated weights for policy 0, policy_version 226057 (0.0006) [2023-12-26 01:23:16,966][123090] Updated weights for policy 1, policy_version 224997 (0.0008) [2023-12-26 01:23:17,025][123090] Updated weights for policy 1, policy_version 225007 (0.0006) [2023-12-26 01:23:17,074][123090] Updated weights for policy 1, policy_version 225017 (0.0005) [2023-12-26 01:23:17,420][123091] Updated weights for policy 0, policy_version 226067 (0.0009) [2023-12-26 01:23:17,466][123091] Updated weights for policy 0, policy_version 226077 (0.0008) [2023-12-26 01:23:17,517][123091] Updated weights for policy 0, policy_version 226087 (0.0010) [2023-12-26 01:23:17,795][123090] Updated weights for policy 1, policy_version 225027 (0.0005) [2023-12-26 01:23:17,845][123090] Updated weights for policy 1, policy_version 225037 (0.0010) [2023-12-26 01:23:17,899][123090] Updated weights for policy 1, policy_version 225047 (0.0010) [2023-12-26 01:23:18,390][123091] Updated weights for policy 0, policy_version 226097 (0.0010) [2023-12-26 01:23:18,452][123091] Updated weights for policy 0, policy_version 226107 (0.0008) [2023-12-26 01:23:18,513][123091] Updated weights for policy 0, policy_version 226117 (0.0005) [2023-12-26 01:23:18,582][123091] Updated weights for policy 0, policy_version 226127 (0.0007) [2023-12-26 01:23:18,639][123090] Updated weights for policy 1, policy_version 225057 (0.0010) [2023-12-26 01:23:18,712][123090] Updated weights for policy 1, policy_version 225067 (0.0006) [2023-12-26 01:23:18,780][123090] Updated weights for policy 1, policy_version 225077 (0.0009) [2023-12-26 01:23:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 115507200. Throughput: 0: 9019.4, 1: 8841.6. Samples: 115520400. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:18,785][121949] Avg episode reward: [(0, '5872.346'), (1, '5360.196')] [2023-12-26 01:23:18,859][123090] Updated weights for policy 1, policy_version 225087 (0.0006) [2023-12-26 01:23:19,398][123091] Updated weights for policy 0, policy_version 226137 (0.0009) [2023-12-26 01:23:19,459][123091] Updated weights for policy 0, policy_version 226147 (0.0009) [2023-12-26 01:23:19,524][123091] Updated weights for policy 0, policy_version 226157 (0.0009) [2023-12-26 01:23:19,564][123090] Updated weights for policy 1, policy_version 225097 (0.0010) [2023-12-26 01:23:19,633][123090] Updated weights for policy 1, policy_version 225107 (0.0011) [2023-12-26 01:23:19,693][123090] Updated weights for policy 1, policy_version 225117 (0.0011) [2023-12-26 01:23:20,382][123091] Updated weights for policy 0, policy_version 226167 (0.0009) [2023-12-26 01:23:20,457][123091] Updated weights for policy 0, policy_version 226177 (0.0009) [2023-12-26 01:23:20,531][123091] Updated weights for policy 0, policy_version 226187 (0.0009) [2023-12-26 01:23:20,533][123090] Updated weights for policy 1, policy_version 225127 (0.0009) [2023-12-26 01:23:20,603][123090] Updated weights for policy 1, policy_version 225137 (0.0009) [2023-12-26 01:23:20,670][123090] Updated weights for policy 1, policy_version 225147 (0.0008) [2023-12-26 01:23:21,501][123091] Updated weights for policy 0, policy_version 226197 (0.0010) [2023-12-26 01:23:21,533][123090] Updated weights for policy 1, policy_version 225157 (0.0008) [2023-12-26 01:23:21,549][123091] Updated weights for policy 0, policy_version 226207 (0.0010) [2023-12-26 01:23:21,581][123090] Updated weights for policy 1, policy_version 225167 (0.0006) [2023-12-26 01:23:21,603][123091] Updated weights for policy 0, policy_version 226218 (0.0010) [2023-12-26 01:23:21,646][123090] Updated weights for policy 1, policy_version 225177 (0.0006) [2023-12-26 01:23:22,483][123091] Updated weights for policy 0, policy_version 226228 (0.0009) [2023-12-26 01:23:22,518][123090] Updated weights for policy 1, policy_version 225187 (0.0007) [2023-12-26 01:23:22,539][123091] Updated weights for policy 0, policy_version 226238 (0.0008) [2023-12-26 01:23:22,577][123090] Updated weights for policy 1, policy_version 225197 (0.0009) [2023-12-26 01:23:22,603][123091] Updated weights for policy 0, policy_version 226248 (0.0008) [2023-12-26 01:23:22,628][123090] Updated weights for policy 1, policy_version 225207 (0.0009) [2023-12-26 01:23:23,334][123091] Updated weights for policy 0, policy_version 226258 (0.0008) [2023-12-26 01:23:23,388][123091] Updated weights for policy 0, policy_version 226268 (0.0005) [2023-12-26 01:23:23,442][123091] Updated weights for policy 0, policy_version 226278 (0.0008) [2023-12-26 01:23:23,498][123091] Updated weights for policy 0, policy_version 226288 (0.0011) [2023-12-26 01:23:23,525][123090] Updated weights for policy 1, policy_version 225217 (0.0008) [2023-12-26 01:23:23,574][123090] Updated weights for policy 1, policy_version 225227 (0.0008) [2023-12-26 01:23:23,627][123090] Updated weights for policy 1, policy_version 225237 (0.0009) [2023-12-26 01:23:23,687][123090] Updated weights for policy 1, policy_version 225247 (0.0009) [2023-12-26 01:23:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 115597312. Throughput: 0: 8926.9, 1: 8823.6. Samples: 115570556. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:23,784][121949] Avg episode reward: [(0, '5869.383'), (1, '5116.952')] [2023-12-26 01:23:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000226288_57933824.pth... [2023-12-26 01:23:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000225248_57663488.pth... [2023-12-26 01:23:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000225264_57671680.pth [2023-12-26 01:23:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000224224_57401344.pth [2023-12-26 01:23:24,201][123091] Updated weights for policy 0, policy_version 226298 (0.0010) [2023-12-26 01:23:24,270][123091] Updated weights for policy 0, policy_version 226308 (0.0011) [2023-12-26 01:23:24,335][123091] Updated weights for policy 0, policy_version 226318 (0.0011) [2023-12-26 01:23:24,603][123090] Updated weights for policy 1, policy_version 225257 (0.0009) [2023-12-26 01:23:24,661][123090] Updated weights for policy 1, policy_version 225267 (0.0010) [2023-12-26 01:23:24,713][123090] Updated weights for policy 1, policy_version 225277 (0.0009) [2023-12-26 01:23:25,019][123091] Updated weights for policy 0, policy_version 226328 (0.0010) [2023-12-26 01:23:25,088][123091] Updated weights for policy 0, policy_version 226338 (0.0010) [2023-12-26 01:23:25,157][123091] Updated weights for policy 0, policy_version 226348 (0.0010) [2023-12-26 01:23:25,500][123090] Updated weights for policy 1, policy_version 225287 (0.0009) [2023-12-26 01:23:25,562][123090] Updated weights for policy 1, policy_version 225297 (0.0010) [2023-12-26 01:23:25,638][123090] Updated weights for policy 1, policy_version 225307 (0.0005) [2023-12-26 01:23:25,948][123091] Updated weights for policy 0, policy_version 226358 (0.0011) [2023-12-26 01:23:25,999][123091] Updated weights for policy 0, policy_version 226368 (0.0010) [2023-12-26 01:23:26,059][123091] Updated weights for policy 0, policy_version 226378 (0.0010) [2023-12-26 01:23:26,297][123090] Updated weights for policy 1, policy_version 225317 (0.0005) [2023-12-26 01:23:26,351][123090] Updated weights for policy 1, policy_version 225327 (0.0005) [2023-12-26 01:23:26,406][123090] Updated weights for policy 1, policy_version 225337 (0.0005) [2023-12-26 01:23:26,895][123091] Updated weights for policy 0, policy_version 226388 (0.0010) [2023-12-26 01:23:26,941][123091] Updated weights for policy 0, policy_version 226398 (0.0010) [2023-12-26 01:23:26,984][123091] Updated weights for policy 0, policy_version 226408 (0.0010) [2023-12-26 01:23:27,039][123090] Updated weights for policy 1, policy_version 225347 (0.0007) [2023-12-26 01:23:27,101][123090] Updated weights for policy 1, policy_version 225357 (0.0010) [2023-12-26 01:23:27,148][123090] Updated weights for policy 1, policy_version 225367 (0.0010) [2023-12-26 01:23:27,791][123090] Updated weights for policy 1, policy_version 225377 (0.0010) [2023-12-26 01:23:27,827][123091] Updated weights for policy 0, policy_version 226418 (0.0010) [2023-12-26 01:23:27,856][123090] Updated weights for policy 1, policy_version 225387 (0.0010) [2023-12-26 01:23:27,882][123091] Updated weights for policy 0, policy_version 226428 (0.0010) [2023-12-26 01:23:27,911][123090] Updated weights for policy 1, policy_version 225397 (0.0010) [2023-12-26 01:23:27,929][123091] Updated weights for policy 0, policy_version 226438 (0.0010) [2023-12-26 01:23:27,958][123090] Updated weights for policy 1, policy_version 225407 (0.0010) [2023-12-26 01:23:27,976][123091] Updated weights for policy 0, policy_version 226448 (0.0010) [2023-12-26 01:23:28,719][123090] Updated weights for policy 1, policy_version 225417 (0.0006) [2023-12-26 01:23:28,773][123090] Updated weights for policy 1, policy_version 225427 (0.0007) [2023-12-26 01:23:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 115679232. Throughput: 0: 8981.4, 1: 8814.5. Samples: 115679356. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:28,784][121949] Avg episode reward: [(0, '5828.031'), (1, '5090.532')] [2023-12-26 01:23:28,819][123091] Updated weights for policy 0, policy_version 226458 (0.0010) [2023-12-26 01:23:28,828][123090] Updated weights for policy 1, policy_version 225437 (0.0010) [2023-12-26 01:23:28,885][123091] Updated weights for policy 0, policy_version 226468 (0.0010) [2023-12-26 01:23:28,954][123091] Updated weights for policy 0, policy_version 226478 (0.0011) [2023-12-26 01:23:29,600][123090] Updated weights for policy 1, policy_version 225447 (0.0010) [2023-12-26 01:23:29,663][123090] Updated weights for policy 1, policy_version 225457 (0.0010) [2023-12-26 01:23:29,727][123090] Updated weights for policy 1, policy_version 225467 (0.0010) [2023-12-26 01:23:29,755][123091] Updated weights for policy 0, policy_version 226488 (0.0011) [2023-12-26 01:23:29,821][123091] Updated weights for policy 0, policy_version 226498 (0.0011) [2023-12-26 01:23:29,886][123091] Updated weights for policy 0, policy_version 226508 (0.0011) [2023-12-26 01:23:30,548][123090] Updated weights for policy 1, policy_version 225477 (0.0010) [2023-12-26 01:23:30,608][123090] Updated weights for policy 1, policy_version 225487 (0.0010) [2023-12-26 01:23:30,655][123091] Updated weights for policy 0, policy_version 226518 (0.0008) [2023-12-26 01:23:30,667][123090] Updated weights for policy 1, policy_version 225497 (0.0009) [2023-12-26 01:23:30,701][123091] Updated weights for policy 0, policy_version 226528 (0.0007) [2023-12-26 01:23:30,769][123091] Updated weights for policy 0, policy_version 226538 (0.0005) [2023-12-26 01:23:31,500][123090] Updated weights for policy 1, policy_version 225507 (0.0009) [2023-12-26 01:23:31,566][123090] Updated weights for policy 1, policy_version 225517 (0.0010) [2023-12-26 01:23:31,578][123091] Updated weights for policy 0, policy_version 226548 (0.0007) [2023-12-26 01:23:31,632][123090] Updated weights for policy 1, policy_version 225528 (0.0010) [2023-12-26 01:23:31,646][123091] Updated weights for policy 0, policy_version 226558 (0.0008) [2023-12-26 01:23:31,714][123091] Updated weights for policy 0, policy_version 226568 (0.0007) [2023-12-26 01:23:32,421][123090] Updated weights for policy 1, policy_version 225538 (0.0007) [2023-12-26 01:23:32,467][123091] Updated weights for policy 0, policy_version 226578 (0.0006) [2023-12-26 01:23:32,479][123090] Updated weights for policy 1, policy_version 225548 (0.0005) [2023-12-26 01:23:32,520][123091] Updated weights for policy 0, policy_version 226588 (0.0009) [2023-12-26 01:23:32,533][123090] Updated weights for policy 1, policy_version 225558 (0.0005) [2023-12-26 01:23:32,580][123091] Updated weights for policy 0, policy_version 226598 (0.0009) [2023-12-26 01:23:32,592][123090] Updated weights for policy 1, policy_version 225568 (0.0006) [2023-12-26 01:23:32,643][123091] Updated weights for policy 0, policy_version 226608 (0.0009) [2023-12-26 01:23:33,276][123090] Updated weights for policy 1, policy_version 225578 (0.0005) [2023-12-26 01:23:33,340][123090] Updated weights for policy 1, policy_version 225588 (0.0007) [2023-12-26 01:23:33,415][123090] Updated weights for policy 1, policy_version 225598 (0.0006) [2023-12-26 01:23:33,550][123091] Updated weights for policy 0, policy_version 226618 (0.0010) [2023-12-26 01:23:33,603][123091] Updated weights for policy 0, policy_version 226628 (0.0009) [2023-12-26 01:23:33,665][123091] Updated weights for policy 0, policy_version 226639 (0.0009) [2023-12-26 01:23:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 115777536. Throughput: 0: 8886.9, 1: 8844.3. Samples: 115786904. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:33,784][121949] Avg episode reward: [(0, '5759.869'), (1, '5176.682')] [2023-12-26 01:23:34,080][123090] Updated weights for policy 1, policy_version 225608 (0.0005) [2023-12-26 01:23:34,152][123090] Updated weights for policy 1, policy_version 225618 (0.0006) [2023-12-26 01:23:34,216][123090] Updated weights for policy 1, policy_version 225628 (0.0007) [2023-12-26 01:23:34,643][123091] Updated weights for policy 0, policy_version 226649 (0.0009) [2023-12-26 01:23:34,713][123091] Updated weights for policy 0, policy_version 226659 (0.0009) [2023-12-26 01:23:34,776][123091] Updated weights for policy 0, policy_version 226669 (0.0009) [2023-12-26 01:23:34,800][123090] Updated weights for policy 1, policy_version 225638 (0.0006) [2023-12-26 01:23:34,860][123090] Updated weights for policy 1, policy_version 225648 (0.0005) [2023-12-26 01:23:34,922][123090] Updated weights for policy 1, policy_version 225658 (0.0005) [2023-12-26 01:23:35,503][123090] Updated weights for policy 1, policy_version 225668 (0.0005) [2023-12-26 01:23:35,566][123090] Updated weights for policy 1, policy_version 225678 (0.0007) [2023-12-26 01:23:35,636][123090] Updated weights for policy 1, policy_version 225688 (0.0010) [2023-12-26 01:23:35,661][123091] Updated weights for policy 0, policy_version 226679 (0.0008) [2023-12-26 01:23:35,712][123091] Updated weights for policy 0, policy_version 226689 (0.0008) [2023-12-26 01:23:35,775][123091] Updated weights for policy 0, policy_version 226699 (0.0009) [2023-12-26 01:23:36,456][123090] Updated weights for policy 1, policy_version 225698 (0.0011) [2023-12-26 01:23:36,529][123090] Updated weights for policy 1, policy_version 225708 (0.0011) [2023-12-26 01:23:36,587][123090] Updated weights for policy 1, policy_version 225718 (0.0010) [2023-12-26 01:23:36,599][123091] Updated weights for policy 0, policy_version 226709 (0.0009) [2023-12-26 01:23:36,646][123090] Updated weights for policy 1, policy_version 225728 (0.0010) [2023-12-26 01:23:36,663][123091] Updated weights for policy 0, policy_version 226719 (0.0007) [2023-12-26 01:23:36,730][123091] Updated weights for policy 0, policy_version 226729 (0.0009) [2023-12-26 01:23:37,464][123090] Updated weights for policy 1, policy_version 225738 (0.0009) [2023-12-26 01:23:37,512][123090] Updated weights for policy 1, policy_version 225748 (0.0008) [2023-12-26 01:23:37,573][123090] Updated weights for policy 1, policy_version 225758 (0.0008) [2023-12-26 01:23:37,584][123091] Updated weights for policy 0, policy_version 226739 (0.0009) [2023-12-26 01:23:37,646][123091] Updated weights for policy 0, policy_version 226749 (0.0009) [2023-12-26 01:23:37,707][123091] Updated weights for policy 0, policy_version 226759 (0.0009) [2023-12-26 01:23:38,375][123090] Updated weights for policy 1, policy_version 225768 (0.0008) [2023-12-26 01:23:38,435][123090] Updated weights for policy 1, policy_version 225778 (0.0005) [2023-12-26 01:23:38,501][123090] Updated weights for policy 1, policy_version 225788 (0.0006) [2023-12-26 01:23:38,563][123091] Updated weights for policy 0, policy_version 226769 (0.0009) [2023-12-26 01:23:38,624][123091] Updated weights for policy 0, policy_version 226779 (0.0009) [2023-12-26 01:23:38,678][123091] Updated weights for policy 0, policy_version 226789 (0.0009) [2023-12-26 01:23:38,733][123091] Updated weights for policy 0, policy_version 226799 (0.0009) [2023-12-26 01:23:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 115867648. Throughput: 0: 8842.1, 1: 8904.7. Samples: 115840236. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:38,785][121949] Avg episode reward: [(0, '5640.089'), (1, '5179.944')] [2023-12-26 01:23:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000226800_58064896.pth... [2023-12-26 01:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000225792_57802752.pth... [2023-12-26 01:23:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000225776_57802752.pth [2023-12-26 01:23:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000224736_57532416.pth [2023-12-26 01:23:39,258][123090] Updated weights for policy 1, policy_version 225798 (0.0009) [2023-12-26 01:23:39,314][123090] Updated weights for policy 1, policy_version 225808 (0.0010) [2023-12-26 01:23:39,383][123090] Updated weights for policy 1, policy_version 225818 (0.0010) [2023-12-26 01:23:39,564][123091] Updated weights for policy 0, policy_version 226809 (0.0010) [2023-12-26 01:23:39,617][123091] Updated weights for policy 0, policy_version 226819 (0.0009) [2023-12-26 01:23:39,675][123091] Updated weights for policy 0, policy_version 226829 (0.0009) [2023-12-26 01:23:40,190][123090] Updated weights for policy 1, policy_version 225828 (0.0008) [2023-12-26 01:23:40,238][123090] Updated weights for policy 1, policy_version 225838 (0.0005) [2023-12-26 01:23:40,297][123090] Updated weights for policy 1, policy_version 225848 (0.0007) [2023-12-26 01:23:40,566][123091] Updated weights for policy 0, policy_version 226839 (0.0010) [2023-12-26 01:23:40,634][123091] Updated weights for policy 0, policy_version 226849 (0.0010) [2023-12-26 01:23:40,704][123091] Updated weights for policy 0, policy_version 226859 (0.0010) [2023-12-26 01:23:41,115][123090] Updated weights for policy 1, policy_version 225858 (0.0009) [2023-12-26 01:23:41,190][123090] Updated weights for policy 1, policy_version 225868 (0.0010) [2023-12-26 01:23:41,258][123090] Updated weights for policy 1, policy_version 225878 (0.0009) [2023-12-26 01:23:41,324][123090] Updated weights for policy 1, policy_version 225888 (0.0009) [2023-12-26 01:23:41,532][123091] Updated weights for policy 0, policy_version 226869 (0.0008) [2023-12-26 01:23:41,603][123091] Updated weights for policy 0, policy_version 226879 (0.0008) [2023-12-26 01:23:41,673][123091] Updated weights for policy 0, policy_version 226889 (0.0009) [2023-12-26 01:23:42,205][123090] Updated weights for policy 1, policy_version 225898 (0.0009) [2023-12-26 01:23:42,263][123090] Updated weights for policy 1, policy_version 225908 (0.0009) [2023-12-26 01:23:42,326][123090] Updated weights for policy 1, policy_version 225918 (0.0010) [2023-12-26 01:23:42,484][123091] Updated weights for policy 0, policy_version 226899 (0.0009) [2023-12-26 01:23:42,556][123091] Updated weights for policy 0, policy_version 226909 (0.0010) [2023-12-26 01:23:42,621][123091] Updated weights for policy 0, policy_version 226919 (0.0010) [2023-12-26 01:23:43,189][123090] Updated weights for policy 1, policy_version 225928 (0.0010) [2023-12-26 01:23:43,254][123090] Updated weights for policy 1, policy_version 225938 (0.0009) [2023-12-26 01:23:43,321][123090] Updated weights for policy 1, policy_version 225948 (0.0009) [2023-12-26 01:23:43,399][123091] Updated weights for policy 0, policy_version 226929 (0.0010) [2023-12-26 01:23:43,448][123091] Updated weights for policy 0, policy_version 226939 (0.0009) [2023-12-26 01:23:43,508][123091] Updated weights for policy 0, policy_version 226949 (0.0006) [2023-12-26 01:23:43,569][123091] Updated weights for policy 0, policy_version 226959 (0.0005) [2023-12-26 01:23:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 115949568. Throughput: 0: 8659.9, 1: 8906.4. Samples: 115941680. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:43,785][121949] Avg episode reward: [(0, '5796.583'), (1, '5168.631')] [2023-12-26 01:23:44,046][123090] Updated weights for policy 1, policy_version 225958 (0.0006) [2023-12-26 01:23:44,114][123090] Updated weights for policy 1, policy_version 225968 (0.0006) [2023-12-26 01:23:44,170][123090] Updated weights for policy 1, policy_version 225978 (0.0006) [2023-12-26 01:23:44,278][123091] Updated weights for policy 0, policy_version 226969 (0.0009) [2023-12-26 01:23:44,335][123091] Updated weights for policy 0, policy_version 226979 (0.0010) [2023-12-26 01:23:44,391][123091] Updated weights for policy 0, policy_version 226989 (0.0009) [2023-12-26 01:23:44,780][123090] Updated weights for policy 1, policy_version 225988 (0.0008) [2023-12-26 01:23:44,846][123090] Updated weights for policy 1, policy_version 225998 (0.0010) [2023-12-26 01:23:44,901][123090] Updated weights for policy 1, policy_version 226008 (0.0010) [2023-12-26 01:23:45,267][123091] Updated weights for policy 0, policy_version 226999 (0.0007) [2023-12-26 01:23:45,326][123091] Updated weights for policy 0, policy_version 227009 (0.0008) [2023-12-26 01:23:45,385][123091] Updated weights for policy 0, policy_version 227019 (0.0009) [2023-12-26 01:23:45,773][123090] Updated weights for policy 1, policy_version 226018 (0.0010) [2023-12-26 01:23:45,828][123090] Updated weights for policy 1, policy_version 226028 (0.0010) [2023-12-26 01:23:45,888][123090] Updated weights for policy 1, policy_version 226038 (0.0010) [2023-12-26 01:23:46,063][123091] Updated weights for policy 0, policy_version 227029 (0.0007) [2023-12-26 01:23:46,116][123091] Updated weights for policy 0, policy_version 227039 (0.0005) [2023-12-26 01:23:46,177][123091] Updated weights for policy 0, policy_version 227049 (0.0006) [2023-12-26 01:23:46,785][123090] Updated weights for policy 1, policy_version 226049 (0.0010) [2023-12-26 01:23:46,838][123090] Updated weights for policy 1, policy_version 226059 (0.0009) [2023-12-26 01:23:46,890][123090] Updated weights for policy 1, policy_version 226069 (0.0009) [2023-12-26 01:23:46,926][123091] Updated weights for policy 0, policy_version 227059 (0.0005) [2023-12-26 01:23:46,943][123090] Updated weights for policy 1, policy_version 226079 (0.0009) [2023-12-26 01:23:46,980][123091] Updated weights for policy 0, policy_version 227069 (0.0005) [2023-12-26 01:23:47,034][123091] Updated weights for policy 0, policy_version 227079 (0.0008) [2023-12-26 01:23:47,806][123090] Updated weights for policy 1, policy_version 226089 (0.0010) [2023-12-26 01:23:47,841][123091] Updated weights for policy 0, policy_version 227089 (0.0009) [2023-12-26 01:23:47,857][123090] Updated weights for policy 1, policy_version 226099 (0.0008) [2023-12-26 01:23:47,892][123091] Updated weights for policy 0, policy_version 227099 (0.0008) [2023-12-26 01:23:47,913][123090] Updated weights for policy 1, policy_version 226109 (0.0008) [2023-12-26 01:23:47,943][123091] Updated weights for policy 0, policy_version 227109 (0.0009) [2023-12-26 01:23:47,997][123091] Updated weights for policy 0, policy_version 227119 (0.0009) [2023-12-26 01:23:48,767][123090] Updated weights for policy 1, policy_version 226119 (0.0009) [2023-12-26 01:23:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 116031488. Throughput: 0: 8661.1, 1: 8930.0. Samples: 116048744. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:48,785][121949] Avg episode reward: [(0, '5868.894'), (1, '5148.508')] [2023-12-26 01:23:48,857][123091] Updated weights for policy 0, policy_version 227129 (0.0010) [2023-12-26 01:23:48,859][123090] Updated weights for policy 1, policy_version 226129 (0.0007) [2023-12-26 01:23:48,918][123090] Updated weights for policy 1, policy_version 226139 (0.0006) [2023-12-26 01:23:48,920][123091] Updated weights for policy 0, policy_version 227139 (0.0009) [2023-12-26 01:23:48,987][123091] Updated weights for policy 0, policy_version 227149 (0.0008) [2023-12-26 01:23:49,721][123090] Updated weights for policy 1, policy_version 226149 (0.0009) [2023-12-26 01:23:49,782][123090] Updated weights for policy 1, policy_version 226159 (0.0009) [2023-12-26 01:23:49,795][123091] Updated weights for policy 0, policy_version 227159 (0.0009) [2023-12-26 01:23:49,850][123090] Updated weights for policy 1, policy_version 226169 (0.0010) [2023-12-26 01:23:49,863][123091] Updated weights for policy 0, policy_version 227169 (0.0009) [2023-12-26 01:23:49,924][123091] Updated weights for policy 0, policy_version 227179 (0.0007) [2023-12-26 01:23:50,623][123091] Updated weights for policy 0, policy_version 227189 (0.0008) [2023-12-26 01:23:50,684][123091] Updated weights for policy 0, policy_version 227199 (0.0009) [2023-12-26 01:23:50,739][123090] Updated weights for policy 1, policy_version 226179 (0.0009) [2023-12-26 01:23:50,743][123091] Updated weights for policy 0, policy_version 227209 (0.0009) [2023-12-26 01:23:50,802][123090] Updated weights for policy 1, policy_version 226189 (0.0009) [2023-12-26 01:23:50,862][123090] Updated weights for policy 1, policy_version 226199 (0.0010) [2023-12-26 01:23:51,583][123091] Updated weights for policy 0, policy_version 227219 (0.0009) [2023-12-26 01:23:51,660][123091] Updated weights for policy 0, policy_version 227229 (0.0010) [2023-12-26 01:23:51,731][123091] Updated weights for policy 0, policy_version 227239 (0.0011) [2023-12-26 01:23:51,781][123090] Updated weights for policy 1, policy_version 226209 (0.0009) [2023-12-26 01:23:51,849][123090] Updated weights for policy 1, policy_version 226219 (0.0008) [2023-12-26 01:23:51,916][123090] Updated weights for policy 1, policy_version 226229 (0.0009) [2023-12-26 01:23:51,990][123090] Updated weights for policy 1, policy_version 226239 (0.0009) [2023-12-26 01:23:52,575][123091] Updated weights for policy 0, policy_version 227249 (0.0011) [2023-12-26 01:23:52,631][123091] Updated weights for policy 0, policy_version 227259 (0.0011) [2023-12-26 01:23:52,687][123091] Updated weights for policy 0, policy_version 227269 (0.0011) [2023-12-26 01:23:52,751][123091] Updated weights for policy 0, policy_version 227279 (0.0011) [2023-12-26 01:23:52,786][123090] Updated weights for policy 1, policy_version 226249 (0.0006) [2023-12-26 01:23:52,864][123090] Updated weights for policy 1, policy_version 226259 (0.0006) [2023-12-26 01:23:52,940][123090] Updated weights for policy 1, policy_version 226269 (0.0005) [2023-12-26 01:23:53,573][123091] Updated weights for policy 0, policy_version 227289 (0.0006) [2023-12-26 01:23:53,618][123090] Updated weights for policy 1, policy_version 226279 (0.0005) [2023-12-26 01:23:53,621][123091] Updated weights for policy 0, policy_version 227299 (0.0005) [2023-12-26 01:23:53,667][123091] Updated weights for policy 0, policy_version 227309 (0.0005) [2023-12-26 01:23:53,675][123090] Updated weights for policy 1, policy_version 226289 (0.0008) [2023-12-26 01:23:53,731][123090] Updated weights for policy 1, policy_version 226299 (0.0009) [2023-12-26 01:23:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 116129792. Throughput: 0: 8690.2, 1: 8888.1. Samples: 116099564. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:53,785][121949] Avg episode reward: [(0, '5952.656'), (1, '5034.275')] [2023-12-26 01:23:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000227312_58195968.pth... [2023-12-26 01:23:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000226304_57933824.pth... [2023-12-26 01:23:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000226288_57933824.pth [2023-12-26 01:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000225248_57663488.pth [2023-12-26 01:23:54,359][123091] Updated weights for policy 0, policy_version 227319 (0.0007) [2023-12-26 01:23:54,420][123091] Updated weights for policy 0, policy_version 227329 (0.0010) [2023-12-26 01:23:54,482][123091] Updated weights for policy 0, policy_version 227339 (0.0010) [2023-12-26 01:23:54,606][123090] Updated weights for policy 1, policy_version 226310 (0.0007) [2023-12-26 01:23:54,666][123090] Updated weights for policy 1, policy_version 226320 (0.0005) [2023-12-26 01:23:54,730][123090] Updated weights for policy 1, policy_version 226330 (0.0005) [2023-12-26 01:23:55,249][123091] Updated weights for policy 0, policy_version 227349 (0.0010) [2023-12-26 01:23:55,311][123091] Updated weights for policy 0, policy_version 227359 (0.0009) [2023-12-26 01:23:55,366][123091] Updated weights for policy 0, policy_version 227369 (0.0007) [2023-12-26 01:23:55,387][123090] Updated weights for policy 1, policy_version 226340 (0.0005) [2023-12-26 01:23:55,450][123090] Updated weights for policy 1, policy_version 226350 (0.0006) [2023-12-26 01:23:55,519][123090] Updated weights for policy 1, policy_version 226360 (0.0006) [2023-12-26 01:23:56,088][123091] Updated weights for policy 0, policy_version 227379 (0.0009) [2023-12-26 01:23:56,137][123091] Updated weights for policy 0, policy_version 227389 (0.0005) [2023-12-26 01:23:56,186][123091] Updated weights for policy 0, policy_version 227399 (0.0005) [2023-12-26 01:23:56,390][123090] Updated weights for policy 1, policy_version 226370 (0.0009) [2023-12-26 01:23:56,466][123090] Updated weights for policy 1, policy_version 226380 (0.0005) [2023-12-26 01:23:56,526][123090] Updated weights for policy 1, policy_version 226390 (0.0005) [2023-12-26 01:23:56,596][123090] Updated weights for policy 1, policy_version 226400 (0.0010) [2023-12-26 01:23:56,859][123091] Updated weights for policy 0, policy_version 227409 (0.0005) [2023-12-26 01:23:56,914][123091] Updated weights for policy 0, policy_version 227419 (0.0005) [2023-12-26 01:23:56,981][123091] Updated weights for policy 0, policy_version 227429 (0.0005) [2023-12-26 01:23:57,049][123091] Updated weights for policy 0, policy_version 227439 (0.0008) [2023-12-26 01:23:57,371][123090] Updated weights for policy 1, policy_version 226410 (0.0009) [2023-12-26 01:23:57,419][123090] Updated weights for policy 1, policy_version 226420 (0.0009) [2023-12-26 01:23:57,476][123090] Updated weights for policy 1, policy_version 226431 (0.0009) [2023-12-26 01:23:57,737][123091] Updated weights for policy 0, policy_version 227449 (0.0010) [2023-12-26 01:23:57,788][123091] Updated weights for policy 0, policy_version 227459 (0.0008) [2023-12-26 01:23:57,855][123091] Updated weights for policy 0, policy_version 227469 (0.0010) [2023-12-26 01:23:58,328][123090] Updated weights for policy 1, policy_version 226441 (0.0006) [2023-12-26 01:23:58,396][123090] Updated weights for policy 1, policy_version 226451 (0.0007) [2023-12-26 01:23:58,464][123090] Updated weights for policy 1, policy_version 226461 (0.0010) [2023-12-26 01:23:58,766][123091] Updated weights for policy 0, policy_version 227479 (0.0007) [2023-12-26 01:23:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 116211712. Throughput: 0: 8813.7, 1: 8942.2. Samples: 116209504. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:23:58,785][121949] Avg episode reward: [(0, '5995.408'), (1, '4786.261')] [2023-12-26 01:23:58,830][123091] Updated weights for policy 0, policy_version 227489 (0.0006) [2023-12-26 01:23:58,890][123091] Updated weights for policy 0, policy_version 227499 (0.0008) [2023-12-26 01:23:59,290][123090] Updated weights for policy 1, policy_version 226471 (0.0009) [2023-12-26 01:23:59,351][123090] Updated weights for policy 1, policy_version 226481 (0.0009) [2023-12-26 01:23:59,411][123090] Updated weights for policy 1, policy_version 226491 (0.0008) [2023-12-26 01:23:59,641][123091] Updated weights for policy 0, policy_version 227509 (0.0007) [2023-12-26 01:23:59,714][123091] Updated weights for policy 0, policy_version 227519 (0.0008) [2023-12-26 01:23:59,768][123091] Updated weights for policy 0, policy_version 227529 (0.0009) [2023-12-26 01:24:00,189][123090] Updated weights for policy 1, policy_version 226501 (0.0009) [2023-12-26 01:24:00,248][123090] Updated weights for policy 1, policy_version 226511 (0.0008) [2023-12-26 01:24:00,307][123090] Updated weights for policy 1, policy_version 226521 (0.0006) [2023-12-26 01:24:00,614][123091] Updated weights for policy 0, policy_version 227539 (0.0009) [2023-12-26 01:24:00,669][123091] Updated weights for policy 0, policy_version 227549 (0.0009) [2023-12-26 01:24:00,730][123091] Updated weights for policy 0, policy_version 227559 (0.0007) [2023-12-26 01:24:01,046][123090] Updated weights for policy 1, policy_version 226531 (0.0006) [2023-12-26 01:24:01,117][123090] Updated weights for policy 1, policy_version 226541 (0.0009) [2023-12-26 01:24:01,181][123090] Updated weights for policy 1, policy_version 226551 (0.0006) [2023-12-26 01:24:01,412][123091] Updated weights for policy 0, policy_version 227569 (0.0006) [2023-12-26 01:24:01,482][123091] Updated weights for policy 0, policy_version 227579 (0.0010) [2023-12-26 01:24:01,547][123091] Updated weights for policy 0, policy_version 227589 (0.0010) [2023-12-26 01:24:01,617][123091] Updated weights for policy 0, policy_version 227599 (0.0011) [2023-12-26 01:24:01,924][123090] Updated weights for policy 1, policy_version 226561 (0.0006) [2023-12-26 01:24:01,987][123090] Updated weights for policy 1, policy_version 226571 (0.0006) [2023-12-26 01:24:02,055][123090] Updated weights for policy 1, policy_version 226581 (0.0007) [2023-12-26 01:24:02,114][123090] Updated weights for policy 1, policy_version 226591 (0.0010) [2023-12-26 01:24:02,393][123091] Updated weights for policy 0, policy_version 227609 (0.0010) [2023-12-26 01:24:02,458][123091] Updated weights for policy 0, policy_version 227619 (0.0010) [2023-12-26 01:24:02,517][123091] Updated weights for policy 0, policy_version 227629 (0.0010) [2023-12-26 01:24:02,867][123090] Updated weights for policy 1, policy_version 226601 (0.0006) [2023-12-26 01:24:02,932][123090] Updated weights for policy 1, policy_version 226611 (0.0005) [2023-12-26 01:24:02,986][123090] Updated weights for policy 1, policy_version 226621 (0.0005) [2023-12-26 01:24:03,344][123091] Updated weights for policy 0, policy_version 227639 (0.0009) [2023-12-26 01:24:03,391][123091] Updated weights for policy 0, policy_version 227649 (0.0008) [2023-12-26 01:24:03,448][123091] Updated weights for policy 0, policy_version 227659 (0.0008) [2023-12-26 01:24:03,666][123090] Updated weights for policy 1, policy_version 226631 (0.0009) [2023-12-26 01:24:03,721][123090] Updated weights for policy 1, policy_version 226641 (0.0008) [2023-12-26 01:24:03,769][123090] Updated weights for policy 1, policy_version 226651 (0.0009) [2023-12-26 01:24:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 116301824. Throughput: 0: 8765.6, 1: 8918.6. Samples: 116316188. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:24:03,785][121949] Avg episode reward: [(0, '5952.994'), (1, '4677.066')] [2023-12-26 01:24:04,315][123091] Updated weights for policy 0, policy_version 227669 (0.0009) [2023-12-26 01:24:04,385][123091] Updated weights for policy 0, policy_version 227680 (0.0010) [2023-12-26 01:24:04,449][123091] Updated weights for policy 0, policy_version 227690 (0.0009) [2023-12-26 01:24:04,603][123090] Updated weights for policy 1, policy_version 226661 (0.0009) [2023-12-26 01:24:04,653][123090] Updated weights for policy 1, policy_version 226671 (0.0009) [2023-12-26 01:24:04,717][123090] Updated weights for policy 1, policy_version 226681 (0.0009) [2023-12-26 01:24:05,201][123091] Updated weights for policy 0, policy_version 227700 (0.0008) [2023-12-26 01:24:05,251][123091] Updated weights for policy 0, policy_version 227710 (0.0009) [2023-12-26 01:24:05,299][123091] Updated weights for policy 0, policy_version 227720 (0.0010) [2023-12-26 01:24:05,624][123090] Updated weights for policy 1, policy_version 226691 (0.0009) [2023-12-26 01:24:05,690][123090] Updated weights for policy 1, policy_version 226701 (0.0009) [2023-12-26 01:24:05,757][123090] Updated weights for policy 1, policy_version 226711 (0.0010) [2023-12-26 01:24:05,976][123091] Updated weights for policy 0, policy_version 227730 (0.0009) [2023-12-26 01:24:06,043][123091] Updated weights for policy 0, policy_version 227740 (0.0009) [2023-12-26 01:24:06,110][123091] Updated weights for policy 0, policy_version 227750 (0.0009) [2023-12-26 01:24:06,166][123091] Updated weights for policy 0, policy_version 227760 (0.0010) [2023-12-26 01:24:06,624][123090] Updated weights for policy 1, policy_version 226721 (0.0009) [2023-12-26 01:24:06,693][123090] Updated weights for policy 1, policy_version 226731 (0.0009) [2023-12-26 01:24:06,759][123090] Updated weights for policy 1, policy_version 226741 (0.0009) [2023-12-26 01:24:06,826][123090] Updated weights for policy 1, policy_version 226751 (0.0008) [2023-12-26 01:24:07,019][123091] Updated weights for policy 0, policy_version 227770 (0.0011) [2023-12-26 01:24:07,090][123091] Updated weights for policy 0, policy_version 227780 (0.0011) [2023-12-26 01:24:07,165][123091] Updated weights for policy 0, policy_version 227790 (0.0011) [2023-12-26 01:24:07,596][123090] Updated weights for policy 1, policy_version 226761 (0.0010) [2023-12-26 01:24:07,664][123090] Updated weights for policy 1, policy_version 226771 (0.0011) [2023-12-26 01:24:07,730][123090] Updated weights for policy 1, policy_version 226781 (0.0006) [2023-12-26 01:24:07,962][123091] Updated weights for policy 0, policy_version 227800 (0.0011) [2023-12-26 01:24:08,026][123091] Updated weights for policy 0, policy_version 227810 (0.0011) [2023-12-26 01:24:08,079][123091] Updated weights for policy 0, policy_version 227820 (0.0010) [2023-12-26 01:24:08,477][123090] Updated weights for policy 1, policy_version 226791 (0.0009) [2023-12-26 01:24:08,529][123090] Updated weights for policy 1, policy_version 226801 (0.0010) [2023-12-26 01:24:08,588][123090] Updated weights for policy 1, policy_version 226811 (0.0010) [2023-12-26 01:24:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 116391936. Throughput: 0: 8833.0, 1: 8894.7. Samples: 116368300. Policy #0 lag: (min: 31.0, avg: 43.2, max: 63.0) [2023-12-26 01:24:08,785][121949] Avg episode reward: [(0, '5888.156'), (1, '4821.191')] [2023-12-26 01:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000227824_58327040.pth... [2023-12-26 01:24:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000226816_58064896.pth... [2023-12-26 01:24:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000226800_58064896.pth [2023-12-26 01:24:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000225792_57802752.pth [2023-12-26 01:24:08,904][123091] Updated weights for policy 0, policy_version 227830 (0.0011) [2023-12-26 01:24:08,966][123091] Updated weights for policy 0, policy_version 227840 (0.0011) [2023-12-26 01:24:09,037][123091] Updated weights for policy 0, policy_version 227850 (0.0010) [2023-12-26 01:24:09,327][123090] Updated weights for policy 1, policy_version 226821 (0.0007) [2023-12-26 01:24:09,398][123090] Updated weights for policy 1, policy_version 226831 (0.0008) [2023-12-26 01:24:09,458][123090] Updated weights for policy 1, policy_version 226841 (0.0010) [2023-12-26 01:24:09,854][123091] Updated weights for policy 0, policy_version 227860 (0.0010) [2023-12-26 01:24:09,917][123091] Updated weights for policy 0, policy_version 227870 (0.0008) [2023-12-26 01:24:09,990][123091] Updated weights for policy 0, policy_version 227880 (0.0010) [2023-12-26 01:24:10,353][123090] Updated weights for policy 1, policy_version 226851 (0.0011) [2023-12-26 01:24:10,415][123090] Updated weights for policy 1, policy_version 226861 (0.0010) [2023-12-26 01:24:10,484][123090] Updated weights for policy 1, policy_version 226871 (0.0010) [2023-12-26 01:24:10,721][123091] Updated weights for policy 0, policy_version 227890 (0.0010) [2023-12-26 01:24:10,789][123091] Updated weights for policy 0, policy_version 227900 (0.0009) [2023-12-26 01:24:10,860][123091] Updated weights for policy 0, policy_version 227910 (0.0006) [2023-12-26 01:24:10,920][123091] Updated weights for policy 0, policy_version 227920 (0.0010) [2023-12-26 01:24:11,316][123090] Updated weights for policy 1, policy_version 226881 (0.0009) [2023-12-26 01:24:11,388][123090] Updated weights for policy 1, policy_version 226891 (0.0010) [2023-12-26 01:24:11,457][123090] Updated weights for policy 1, policy_version 226901 (0.0009) [2023-12-26 01:24:11,524][123090] Updated weights for policy 1, policy_version 226911 (0.0010) [2023-12-26 01:24:11,711][123091] Updated weights for policy 0, policy_version 227930 (0.0007) [2023-12-26 01:24:11,784][123091] Updated weights for policy 0, policy_version 227940 (0.0008) [2023-12-26 01:24:11,852][123091] Updated weights for policy 0, policy_version 227950 (0.0009) [2023-12-26 01:24:12,420][123090] Updated weights for policy 1, policy_version 226921 (0.0009) [2023-12-26 01:24:12,469][123090] Updated weights for policy 1, policy_version 226931 (0.0010) [2023-12-26 01:24:12,528][123090] Updated weights for policy 1, policy_version 226941 (0.0009) [2023-12-26 01:24:12,577][123091] Updated weights for policy 0, policy_version 227960 (0.0010) [2023-12-26 01:24:12,651][123091] Updated weights for policy 0, policy_version 227970 (0.0010) [2023-12-26 01:24:12,722][123091] Updated weights for policy 0, policy_version 227980 (0.0006) [2023-12-26 01:24:13,283][123090] Updated weights for policy 1, policy_version 226951 (0.0006) [2023-12-26 01:24:13,335][123090] Updated weights for policy 1, policy_version 226961 (0.0005) [2023-12-26 01:24:13,352][123091] Updated weights for policy 0, policy_version 227990 (0.0006) [2023-12-26 01:24:13,394][123090] Updated weights for policy 1, policy_version 226971 (0.0005) [2023-12-26 01:24:13,413][123091] Updated weights for policy 0, policy_version 228000 (0.0005) [2023-12-26 01:24:13,479][123091] Updated weights for policy 0, policy_version 228010 (0.0005) [2023-12-26 01:24:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 116482048. Throughput: 0: 8770.7, 1: 8827.8. Samples: 116471292. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:13,785][121949] Avg episode reward: [(0, '5997.104'), (1, '4751.707')] [2023-12-26 01:24:14,110][123090] Updated weights for policy 1, policy_version 226981 (0.0007) [2023-12-26 01:24:14,159][123090] Updated weights for policy 1, policy_version 226991 (0.0009) [2023-12-26 01:24:14,210][123090] Updated weights for policy 1, policy_version 227001 (0.0009) [2023-12-26 01:24:14,218][123091] Updated weights for policy 0, policy_version 228020 (0.0007) [2023-12-26 01:24:14,274][123091] Updated weights for policy 0, policy_version 228030 (0.0010) [2023-12-26 01:24:14,328][123091] Updated weights for policy 0, policy_version 228040 (0.0010) [2023-12-26 01:24:15,077][123091] Updated weights for policy 0, policy_version 228050 (0.0010) [2023-12-26 01:24:15,092][123090] Updated weights for policy 1, policy_version 227011 (0.0009) [2023-12-26 01:24:15,152][123091] Updated weights for policy 0, policy_version 228060 (0.0009) [2023-12-26 01:24:15,161][123090] Updated weights for policy 1, policy_version 227021 (0.0006) [2023-12-26 01:24:15,224][123091] Updated weights for policy 0, policy_version 228070 (0.0009) [2023-12-26 01:24:15,231][123090] Updated weights for policy 1, policy_version 227031 (0.0008) [2023-12-26 01:24:15,286][123091] Updated weights for policy 0, policy_version 228080 (0.0008) [2023-12-26 01:24:15,930][123090] Updated weights for policy 1, policy_version 227041 (0.0008) [2023-12-26 01:24:15,985][123090] Updated weights for policy 1, policy_version 227051 (0.0009) [2023-12-26 01:24:16,042][123090] Updated weights for policy 1, policy_version 227061 (0.0009) [2023-12-26 01:24:16,085][123091] Updated weights for policy 0, policy_version 228090 (0.0005) [2023-12-26 01:24:16,090][123090] Updated weights for policy 1, policy_version 227071 (0.0009) [2023-12-26 01:24:16,141][123091] Updated weights for policy 0, policy_version 228100 (0.0010) [2023-12-26 01:24:16,204][123091] Updated weights for policy 0, policy_version 228110 (0.0010) [2023-12-26 01:24:16,926][123090] Updated weights for policy 1, policy_version 227081 (0.0008) [2023-12-26 01:24:16,974][123090] Updated weights for policy 1, policy_version 227091 (0.0009) [2023-12-26 01:24:17,011][123091] Updated weights for policy 0, policy_version 228120 (0.0010) [2023-12-26 01:24:17,026][123090] Updated weights for policy 1, policy_version 227101 (0.0006) [2023-12-26 01:24:17,062][123091] Updated weights for policy 0, policy_version 228130 (0.0010) [2023-12-26 01:24:17,109][123091] Updated weights for policy 0, policy_version 228140 (0.0010) [2023-12-26 01:24:17,902][123091] Updated weights for policy 0, policy_version 228150 (0.0008) [2023-12-26 01:24:17,923][123090] Updated weights for policy 1, policy_version 227111 (0.0007) [2023-12-26 01:24:17,963][123091] Updated weights for policy 0, policy_version 228160 (0.0006) [2023-12-26 01:24:17,982][123090] Updated weights for policy 1, policy_version 227121 (0.0009) [2023-12-26 01:24:18,012][123091] Updated weights for policy 0, policy_version 228170 (0.0005) [2023-12-26 01:24:18,048][123090] Updated weights for policy 1, policy_version 227131 (0.0008) [2023-12-26 01:24:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 116563968. Throughput: 0: 8874.9, 1: 8790.1. Samples: 116581832. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:18,784][121949] Avg episode reward: [(0, '6087.286'), (1, '4731.968')] [2023-12-26 01:24:18,800][123091] Updated weights for policy 0, policy_version 228180 (0.0007) [2023-12-26 01:24:18,819][123090] Updated weights for policy 1, policy_version 227141 (0.0009) [2023-12-26 01:24:18,857][123091] Updated weights for policy 0, policy_version 228190 (0.0007) [2023-12-26 01:24:18,878][123090] Updated weights for policy 1, policy_version 227151 (0.0008) [2023-12-26 01:24:18,919][123091] Updated weights for policy 0, policy_version 228200 (0.0008) [2023-12-26 01:24:18,937][123090] Updated weights for policy 1, policy_version 227161 (0.0008) [2023-12-26 01:24:18,963][123007] Saving new best policy, reward=6087.286! [2023-12-26 01:24:19,630][123090] Updated weights for policy 1, policy_version 227171 (0.0008) [2023-12-26 01:24:19,691][123090] Updated weights for policy 1, policy_version 227181 (0.0007) [2023-12-26 01:24:19,754][123090] Updated weights for policy 1, policy_version 227191 (0.0009) [2023-12-26 01:24:19,822][123091] Updated weights for policy 0, policy_version 228210 (0.0006) [2023-12-26 01:24:19,882][123091] Updated weights for policy 0, policy_version 228220 (0.0006) [2023-12-26 01:24:19,950][123091] Updated weights for policy 0, policy_version 228230 (0.0008) [2023-12-26 01:24:20,006][123091] Updated weights for policy 0, policy_version 228240 (0.0009) [2023-12-26 01:24:20,587][123090] Updated weights for policy 1, policy_version 227201 (0.0009) [2023-12-26 01:24:20,644][123090] Updated weights for policy 1, policy_version 227211 (0.0009) [2023-12-26 01:24:20,697][123090] Updated weights for policy 1, policy_version 227221 (0.0009) [2023-12-26 01:24:20,766][123090] Updated weights for policy 1, policy_version 227231 (0.0009) [2023-12-26 01:24:20,863][123091] Updated weights for policy 0, policy_version 228250 (0.0009) [2023-12-26 01:24:20,936][123091] Updated weights for policy 0, policy_version 228260 (0.0009) [2023-12-26 01:24:21,000][123091] Updated weights for policy 0, policy_version 228270 (0.0010) [2023-12-26 01:24:21,613][123090] Updated weights for policy 1, policy_version 227241 (0.0010) [2023-12-26 01:24:21,692][123090] Updated weights for policy 1, policy_version 227251 (0.0009) [2023-12-26 01:24:21,764][123090] Updated weights for policy 1, policy_version 227261 (0.0010) [2023-12-26 01:24:21,828][123091] Updated weights for policy 0, policy_version 228280 (0.0010) [2023-12-26 01:24:21,896][123091] Updated weights for policy 0, policy_version 228290 (0.0009) [2023-12-26 01:24:21,964][123091] Updated weights for policy 0, policy_version 228300 (0.0010) [2023-12-26 01:24:22,597][123090] Updated weights for policy 1, policy_version 227271 (0.0010) [2023-12-26 01:24:22,655][123090] Updated weights for policy 1, policy_version 227281 (0.0009) [2023-12-26 01:24:22,720][123090] Updated weights for policy 1, policy_version 227291 (0.0008) [2023-12-26 01:24:22,802][123091] Updated weights for policy 0, policy_version 228310 (0.0010) [2023-12-26 01:24:22,863][123091] Updated weights for policy 0, policy_version 228320 (0.0009) [2023-12-26 01:24:22,929][123091] Updated weights for policy 0, policy_version 228330 (0.0009) [2023-12-26 01:24:23,536][123090] Updated weights for policy 1, policy_version 227301 (0.0008) [2023-12-26 01:24:23,591][123090] Updated weights for policy 1, policy_version 227311 (0.0005) [2023-12-26 01:24:23,644][123090] Updated weights for policy 1, policy_version 227321 (0.0005) [2023-12-26 01:24:23,772][123091] Updated weights for policy 0, policy_version 228340 (0.0011) [2023-12-26 01:24:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 116654080. Throughput: 0: 8873.3, 1: 8726.8. Samples: 116632244. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:23,785][121949] Avg episode reward: [(0, '6104.028'), (1, '4777.750')] [2023-12-26 01:24:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000227328_58195968.pth... [2023-12-26 01:24:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000226304_57933824.pth [2023-12-26 01:24:23,835][123091] Updated weights for policy 0, policy_version 228350 (0.0011) [2023-12-26 01:24:23,887][123091] Updated weights for policy 0, policy_version 228360 (0.0011) [2023-12-26 01:24:23,921][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000228368_58466304.pth... [2023-12-26 01:24:23,924][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000227312_58195968.pth [2023-12-26 01:24:23,925][123007] Saving new best policy, reward=6104.028! [2023-12-26 01:24:24,465][123090] Updated weights for policy 1, policy_version 227331 (0.0010) [2023-12-26 01:24:24,536][123090] Updated weights for policy 1, policy_version 227341 (0.0011) [2023-12-26 01:24:24,603][123090] Updated weights for policy 1, policy_version 227351 (0.0011) [2023-12-26 01:24:24,639][123091] Updated weights for policy 0, policy_version 228370 (0.0009) [2023-12-26 01:24:24,709][123091] Updated weights for policy 0, policy_version 228380 (0.0005) [2023-12-26 01:24:24,772][123091] Updated weights for policy 0, policy_version 228390 (0.0005) [2023-12-26 01:24:24,821][123091] Updated weights for policy 0, policy_version 228400 (0.0005) [2023-12-26 01:24:25,436][123090] Updated weights for policy 1, policy_version 227361 (0.0011) [2023-12-26 01:24:25,460][123091] Updated weights for policy 0, policy_version 228410 (0.0008) [2023-12-26 01:24:25,491][123090] Updated weights for policy 1, policy_version 227371 (0.0010) [2023-12-26 01:24:25,507][123091] Updated weights for policy 0, policy_version 228420 (0.0006) [2023-12-26 01:24:25,549][123090] Updated weights for policy 1, policy_version 227381 (0.0010) [2023-12-26 01:24:25,561][123091] Updated weights for policy 0, policy_version 228430 (0.0008) [2023-12-26 01:24:25,600][123090] Updated weights for policy 1, policy_version 227391 (0.0010) [2023-12-26 01:24:26,196][123091] Updated weights for policy 0, policy_version 228440 (0.0006) [2023-12-26 01:24:26,244][123091] Updated weights for policy 0, policy_version 228450 (0.0005) [2023-12-26 01:24:26,293][123091] Updated weights for policy 0, policy_version 228460 (0.0006) [2023-12-26 01:24:26,428][123090] Updated weights for policy 1, policy_version 227401 (0.0010) [2023-12-26 01:24:26,476][123090] Updated weights for policy 1, policy_version 227411 (0.0010) [2023-12-26 01:24:26,523][123090] Updated weights for policy 1, policy_version 227421 (0.0010) [2023-12-26 01:24:26,912][123091] Updated weights for policy 0, policy_version 228470 (0.0007) [2023-12-26 01:24:26,971][123091] Updated weights for policy 0, policy_version 228480 (0.0005) [2023-12-26 01:24:27,036][123091] Updated weights for policy 0, policy_version 228490 (0.0005) [2023-12-26 01:24:27,381][123090] Updated weights for policy 1, policy_version 227431 (0.0010) [2023-12-26 01:24:27,446][123090] Updated weights for policy 1, policy_version 227441 (0.0010) [2023-12-26 01:24:27,496][123090] Updated weights for policy 1, policy_version 227451 (0.0010) [2023-12-26 01:24:27,716][123091] Updated weights for policy 0, policy_version 228500 (0.0007) [2023-12-26 01:24:27,784][123091] Updated weights for policy 0, policy_version 228510 (0.0009) [2023-12-26 01:24:27,837][123091] Updated weights for policy 0, policy_version 228520 (0.0009) [2023-12-26 01:24:28,312][123090] Updated weights for policy 1, policy_version 227461 (0.0010) [2023-12-26 01:24:28,375][123090] Updated weights for policy 1, policy_version 227471 (0.0011) [2023-12-26 01:24:28,429][123090] Updated weights for policy 1, policy_version 227481 (0.0010) [2023-12-26 01:24:28,664][123091] Updated weights for policy 0, policy_version 228530 (0.0009) [2023-12-26 01:24:28,718][123091] Updated weights for policy 0, policy_version 228540 (0.0008) [2023-12-26 01:24:28,768][123091] Updated weights for policy 0, policy_version 228551 (0.0009) [2023-12-26 01:24:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 116744192. Throughput: 0: 9054.4, 1: 8713.0. Samples: 116741216. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:28,785][121949] Avg episode reward: [(0, '6062.143'), (1, '4740.853')] [2023-12-26 01:24:29,263][123090] Updated weights for policy 1, policy_version 227491 (0.0010) [2023-12-26 01:24:29,340][123090] Updated weights for policy 1, policy_version 227501 (0.0011) [2023-12-26 01:24:29,402][123090] Updated weights for policy 1, policy_version 227511 (0.0010) [2023-12-26 01:24:29,661][123091] Updated weights for policy 0, policy_version 228561 (0.0009) [2023-12-26 01:24:29,729][123091] Updated weights for policy 0, policy_version 228571 (0.0009) [2023-12-26 01:24:29,791][123091] Updated weights for policy 0, policy_version 228581 (0.0009) [2023-12-26 01:24:29,857][123091] Updated weights for policy 0, policy_version 228591 (0.0009) [2023-12-26 01:24:30,031][123090] Updated weights for policy 1, policy_version 227521 (0.0007) [2023-12-26 01:24:30,081][123090] Updated weights for policy 1, policy_version 227531 (0.0008) [2023-12-26 01:24:30,136][123090] Updated weights for policy 1, policy_version 227541 (0.0008) [2023-12-26 01:24:30,194][123090] Updated weights for policy 1, policy_version 227551 (0.0008) [2023-12-26 01:24:30,716][123091] Updated weights for policy 0, policy_version 228601 (0.0010) [2023-12-26 01:24:30,779][123091] Updated weights for policy 0, policy_version 228611 (0.0009) [2023-12-26 01:24:30,835][123091] Updated weights for policy 0, policy_version 228621 (0.0009) [2023-12-26 01:24:30,951][123090] Updated weights for policy 1, policy_version 227561 (0.0008) [2023-12-26 01:24:31,020][123090] Updated weights for policy 1, policy_version 227571 (0.0009) [2023-12-26 01:24:31,086][123090] Updated weights for policy 1, policy_version 227581 (0.0008) [2023-12-26 01:24:31,699][123091] Updated weights for policy 0, policy_version 228631 (0.0010) [2023-12-26 01:24:31,766][123091] Updated weights for policy 0, policy_version 228641 (0.0010) [2023-12-26 01:24:31,820][123091] Updated weights for policy 0, policy_version 228651 (0.0009) [2023-12-26 01:24:31,905][123090] Updated weights for policy 1, policy_version 227591 (0.0009) [2023-12-26 01:24:31,960][123090] Updated weights for policy 1, policy_version 227601 (0.0008) [2023-12-26 01:24:32,008][123090] Updated weights for policy 1, policy_version 227611 (0.0008) [2023-12-26 01:24:32,576][123091] Updated weights for policy 0, policy_version 228661 (0.0008) [2023-12-26 01:24:32,636][123091] Updated weights for policy 0, policy_version 228671 (0.0010) [2023-12-26 01:24:32,680][123091] Updated weights for policy 0, policy_version 228681 (0.0010) [2023-12-26 01:24:32,875][123090] Updated weights for policy 1, policy_version 227621 (0.0009) [2023-12-26 01:24:32,937][123090] Updated weights for policy 1, policy_version 227631 (0.0010) [2023-12-26 01:24:33,006][123090] Updated weights for policy 1, policy_version 227641 (0.0010) [2023-12-26 01:24:33,328][123091] Updated weights for policy 0, policy_version 228691 (0.0007) [2023-12-26 01:24:33,384][123091] Updated weights for policy 0, policy_version 228701 (0.0005) [2023-12-26 01:24:33,440][123091] Updated weights for policy 0, policy_version 228711 (0.0005) [2023-12-26 01:24:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 116834304. Throughput: 0: 9007.0, 1: 8718.6. Samples: 116846396. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:33,785][121949] Avg episode reward: [(0, '6051.509'), (1, '4746.249')] [2023-12-26 01:24:33,800][123090] Updated weights for policy 1, policy_version 227651 (0.0010) [2023-12-26 01:24:33,860][123090] Updated weights for policy 1, policy_version 227661 (0.0010) [2023-12-26 01:24:33,926][123090] Updated weights for policy 1, policy_version 227671 (0.0010) [2023-12-26 01:24:34,059][123091] Updated weights for policy 0, policy_version 228721 (0.0006) [2023-12-26 01:24:34,112][123091] Updated weights for policy 0, policy_version 228731 (0.0007) [2023-12-26 01:24:34,179][123091] Updated weights for policy 0, policy_version 228741 (0.0009) [2023-12-26 01:24:34,244][123091] Updated weights for policy 0, policy_version 228751 (0.0006) [2023-12-26 01:24:34,774][123090] Updated weights for policy 1, policy_version 227681 (0.0010) [2023-12-26 01:24:34,840][123090] Updated weights for policy 1, policy_version 227691 (0.0010) [2023-12-26 01:24:34,904][123090] Updated weights for policy 1, policy_version 227701 (0.0010) [2023-12-26 01:24:34,966][123090] Updated weights for policy 1, policy_version 227711 (0.0010) [2023-12-26 01:24:35,052][123091] Updated weights for policy 0, policy_version 228761 (0.0009) [2023-12-26 01:24:35,103][123091] Updated weights for policy 0, policy_version 228771 (0.0009) [2023-12-26 01:24:35,162][123091] Updated weights for policy 0, policy_version 228781 (0.0009) [2023-12-26 01:24:35,776][123090] Updated weights for policy 1, policy_version 227721 (0.0009) [2023-12-26 01:24:35,832][123090] Updated weights for policy 1, policy_version 227731 (0.0009) [2023-12-26 01:24:35,885][123090] Updated weights for policy 1, policy_version 227741 (0.0008) [2023-12-26 01:24:36,005][123091] Updated weights for policy 0, policy_version 228791 (0.0010) [2023-12-26 01:24:36,063][123091] Updated weights for policy 0, policy_version 228802 (0.0010) [2023-12-26 01:24:36,123][123091] Updated weights for policy 0, policy_version 228812 (0.0010) [2023-12-26 01:24:36,711][123090] Updated weights for policy 1, policy_version 227751 (0.0007) [2023-12-26 01:24:36,779][123090] Updated weights for policy 1, policy_version 227761 (0.0010) [2023-12-26 01:24:36,833][123090] Updated weights for policy 1, policy_version 227771 (0.0007) [2023-12-26 01:24:37,045][123091] Updated weights for policy 0, policy_version 228822 (0.0010) [2023-12-26 01:24:37,103][123091] Updated weights for policy 0, policy_version 228832 (0.0010) [2023-12-26 01:24:37,156][123091] Updated weights for policy 0, policy_version 228842 (0.0010) [2023-12-26 01:24:37,533][123090] Updated weights for policy 1, policy_version 227781 (0.0007) [2023-12-26 01:24:37,590][123090] Updated weights for policy 1, policy_version 227791 (0.0009) [2023-12-26 01:24:37,650][123090] Updated weights for policy 1, policy_version 227801 (0.0010) [2023-12-26 01:24:38,043][123091] Updated weights for policy 0, policy_version 228852 (0.0010) [2023-12-26 01:24:38,098][123091] Updated weights for policy 0, policy_version 228862 (0.0010) [2023-12-26 01:24:38,155][123091] Updated weights for policy 0, policy_version 228872 (0.0009) [2023-12-26 01:24:38,543][123090] Updated weights for policy 1, policy_version 227811 (0.0010) [2023-12-26 01:24:38,602][123090] Updated weights for policy 1, policy_version 227821 (0.0009) [2023-12-26 01:24:38,664][123090] Updated weights for policy 1, policy_version 227831 (0.0010) [2023-12-26 01:24:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 116924416. Throughput: 0: 9010.0, 1: 8750.6. Samples: 116898788. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:38,785][121949] Avg episode reward: [(0, '6056.779'), (1, '4839.532')] [2023-12-26 01:24:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000228880_58597376.pth... [2023-12-26 01:24:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000227840_58327040.pth... [2023-12-26 01:24:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000227824_58327040.pth [2023-12-26 01:24:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000226816_58064896.pth [2023-12-26 01:24:39,000][123091] Updated weights for policy 0, policy_version 228882 (0.0009) [2023-12-26 01:24:39,056][123091] Updated weights for policy 0, policy_version 228892 (0.0010) [2023-12-26 01:24:39,124][123091] Updated weights for policy 0, policy_version 228902 (0.0009) [2023-12-26 01:24:39,187][123091] Updated weights for policy 0, policy_version 228912 (0.0009) [2023-12-26 01:24:39,495][123090] Updated weights for policy 1, policy_version 227841 (0.0010) [2023-12-26 01:24:39,552][123090] Updated weights for policy 1, policy_version 227851 (0.0008) [2023-12-26 01:24:39,608][123090] Updated weights for policy 1, policy_version 227861 (0.0008) [2023-12-26 01:24:39,669][123090] Updated weights for policy 1, policy_version 227871 (0.0009) [2023-12-26 01:24:40,058][123091] Updated weights for policy 0, policy_version 228922 (0.0010) [2023-12-26 01:24:40,124][123091] Updated weights for policy 0, policy_version 228932 (0.0010) [2023-12-26 01:24:40,178][123091] Updated weights for policy 0, policy_version 228942 (0.0009) [2023-12-26 01:24:40,533][123090] Updated weights for policy 1, policy_version 227881 (0.0009) [2023-12-26 01:24:40,600][123090] Updated weights for policy 1, policy_version 227891 (0.0010) [2023-12-26 01:24:40,665][123090] Updated weights for policy 1, policy_version 227901 (0.0009) [2023-12-26 01:24:40,874][123091] Updated weights for policy 0, policy_version 228952 (0.0006) [2023-12-26 01:24:40,925][123091] Updated weights for policy 0, policy_version 228962 (0.0005) [2023-12-26 01:24:40,979][123091] Updated weights for policy 0, policy_version 228972 (0.0005) [2023-12-26 01:24:41,546][123090] Updated weights for policy 1, policy_version 227911 (0.0009) [2023-12-26 01:24:41,599][123090] Updated weights for policy 1, policy_version 227921 (0.0009) [2023-12-26 01:24:41,669][123090] Updated weights for policy 1, policy_version 227931 (0.0010) [2023-12-26 01:24:41,795][123091] Updated weights for policy 0, policy_version 228982 (0.0007) [2023-12-26 01:24:41,859][123091] Updated weights for policy 0, policy_version 228992 (0.0009) [2023-12-26 01:24:41,917][123091] Updated weights for policy 0, policy_version 229002 (0.0010) [2023-12-26 01:24:42,459][123090] Updated weights for policy 1, policy_version 227941 (0.0006) [2023-12-26 01:24:42,540][123090] Updated weights for policy 1, policy_version 227951 (0.0005) [2023-12-26 01:24:42,618][123090] Updated weights for policy 1, policy_version 227961 (0.0006) [2023-12-26 01:24:42,635][123091] Updated weights for policy 0, policy_version 229012 (0.0008) [2023-12-26 01:24:42,698][123091] Updated weights for policy 0, policy_version 229022 (0.0006) [2023-12-26 01:24:42,772][123091] Updated weights for policy 0, policy_version 229032 (0.0007) [2023-12-26 01:24:43,372][123090] Updated weights for policy 1, policy_version 227971 (0.0007) [2023-12-26 01:24:43,440][123090] Updated weights for policy 1, policy_version 227981 (0.0009) [2023-12-26 01:24:43,469][123091] Updated weights for policy 0, policy_version 229042 (0.0010) [2023-12-26 01:24:43,491][123090] Updated weights for policy 1, policy_version 227991 (0.0009) [2023-12-26 01:24:43,538][123091] Updated weights for policy 0, policy_version 229052 (0.0009) [2023-12-26 01:24:43,608][123091] Updated weights for policy 0, policy_version 229062 (0.0006) [2023-12-26 01:24:43,676][123091] Updated weights for policy 0, policy_version 229072 (0.0007) [2023-12-26 01:24:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 117014528. Throughput: 0: 8909.7, 1: 8726.1. Samples: 117003116. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:43,785][121949] Avg episode reward: [(0, '6007.289'), (1, '4691.213')] [2023-12-26 01:24:44,291][123090] Updated weights for policy 1, policy_version 228001 (0.0009) [2023-12-26 01:24:44,354][123090] Updated weights for policy 1, policy_version 228011 (0.0009) [2023-12-26 01:24:44,412][123090] Updated weights for policy 1, policy_version 228021 (0.0008) [2023-12-26 01:24:44,427][123091] Updated weights for policy 0, policy_version 229082 (0.0011) [2023-12-26 01:24:44,469][123090] Updated weights for policy 1, policy_version 228031 (0.0007) [2023-12-26 01:24:44,475][123091] Updated weights for policy 0, policy_version 229092 (0.0010) [2023-12-26 01:24:44,533][123091] Updated weights for policy 0, policy_version 229102 (0.0010) [2023-12-26 01:24:45,342][123090] Updated weights for policy 1, policy_version 228041 (0.0009) [2023-12-26 01:24:45,348][123091] Updated weights for policy 0, policy_version 229112 (0.0011) [2023-12-26 01:24:45,405][123091] Updated weights for policy 0, policy_version 229122 (0.0010) [2023-12-26 01:24:45,407][123090] Updated weights for policy 1, policy_version 228051 (0.0007) [2023-12-26 01:24:45,460][123091] Updated weights for policy 0, policy_version 229132 (0.0009) [2023-12-26 01:24:45,467][123090] Updated weights for policy 1, policy_version 228061 (0.0008) [2023-12-26 01:24:46,202][123091] Updated weights for policy 0, policy_version 229142 (0.0009) [2023-12-26 01:24:46,271][123091] Updated weights for policy 0, policy_version 229152 (0.0011) [2023-12-26 01:24:46,337][123091] Updated weights for policy 0, policy_version 229162 (0.0010) [2023-12-26 01:24:46,344][123090] Updated weights for policy 1, policy_version 228071 (0.0007) [2023-12-26 01:24:46,401][123090] Updated weights for policy 1, policy_version 228081 (0.0008) [2023-12-26 01:24:46,481][123090] Updated weights for policy 1, policy_version 228091 (0.0009) [2023-12-26 01:24:47,049][123091] Updated weights for policy 0, policy_version 229172 (0.0009) [2023-12-26 01:24:47,110][123091] Updated weights for policy 0, policy_version 229182 (0.0005) [2023-12-26 01:24:47,171][123091] Updated weights for policy 0, policy_version 229192 (0.0006) [2023-12-26 01:24:47,289][123090] Updated weights for policy 1, policy_version 228101 (0.0008) [2023-12-26 01:24:47,337][123090] Updated weights for policy 1, policy_version 228111 (0.0005) [2023-12-26 01:24:47,409][123090] Updated weights for policy 1, policy_version 228121 (0.0006) [2023-12-26 01:24:47,767][123091] Updated weights for policy 0, policy_version 229202 (0.0005) [2023-12-26 01:24:47,838][123091] Updated weights for policy 0, policy_version 229212 (0.0005) [2023-12-26 01:24:47,914][123091] Updated weights for policy 0, policy_version 229222 (0.0006) [2023-12-26 01:24:47,972][123091] Updated weights for policy 0, policy_version 229232 (0.0011) [2023-12-26 01:24:48,131][123090] Updated weights for policy 1, policy_version 228131 (0.0010) [2023-12-26 01:24:48,192][123090] Updated weights for policy 1, policy_version 228141 (0.0007) [2023-12-26 01:24:48,241][123090] Updated weights for policy 1, policy_version 228151 (0.0006) [2023-12-26 01:24:48,704][123091] Updated weights for policy 0, policy_version 229242 (0.0011) [2023-12-26 01:24:48,763][123091] Updated weights for policy 0, policy_version 229252 (0.0011) [2023-12-26 01:24:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 117096448. Throughput: 0: 9035.8, 1: 8668.6. Samples: 117112884. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:48,784][121949] Avg episode reward: [(0, '6024.268'), (1, '4738.101')] [2023-12-26 01:24:48,823][123091] Updated weights for policy 0, policy_version 229262 (0.0011) [2023-12-26 01:24:49,059][123090] Updated weights for policy 1, policy_version 228161 (0.0010) [2023-12-26 01:24:49,121][123090] Updated weights for policy 1, policy_version 228171 (0.0010) [2023-12-26 01:24:49,187][123090] Updated weights for policy 1, policy_version 228181 (0.0010) [2023-12-26 01:24:49,257][123090] Updated weights for policy 1, policy_version 228191 (0.0010) [2023-12-26 01:24:49,667][123091] Updated weights for policy 0, policy_version 229272 (0.0008) [2023-12-26 01:24:49,726][123091] Updated weights for policy 0, policy_version 229282 (0.0006) [2023-12-26 01:24:49,782][123091] Updated weights for policy 0, policy_version 229292 (0.0006) [2023-12-26 01:24:49,977][123090] Updated weights for policy 1, policy_version 228201 (0.0010) [2023-12-26 01:24:50,037][123090] Updated weights for policy 1, policy_version 228211 (0.0010) [2023-12-26 01:24:50,100][123090] Updated weights for policy 1, policy_version 228221 (0.0010) [2023-12-26 01:24:50,601][123091] Updated weights for policy 0, policy_version 229302 (0.0008) [2023-12-26 01:24:50,664][123091] Updated weights for policy 0, policy_version 229312 (0.0010) [2023-12-26 01:24:50,715][123091] Updated weights for policy 0, policy_version 229322 (0.0009) [2023-12-26 01:24:50,875][123090] Updated weights for policy 1, policy_version 228231 (0.0011) [2023-12-26 01:24:50,935][123090] Updated weights for policy 1, policy_version 228241 (0.0011) [2023-12-26 01:24:50,995][123090] Updated weights for policy 1, policy_version 228251 (0.0010) [2023-12-26 01:24:51,596][123091] Updated weights for policy 0, policy_version 229332 (0.0009) [2023-12-26 01:24:51,658][123091] Updated weights for policy 0, policy_version 229342 (0.0009) [2023-12-26 01:24:51,720][123091] Updated weights for policy 0, policy_version 229352 (0.0009) [2023-12-26 01:24:51,862][123090] Updated weights for policy 1, policy_version 228261 (0.0011) [2023-12-26 01:24:51,927][123090] Updated weights for policy 1, policy_version 228271 (0.0010) [2023-12-26 01:24:51,995][123090] Updated weights for policy 1, policy_version 228281 (0.0009) [2023-12-26 01:24:52,614][123091] Updated weights for policy 0, policy_version 229362 (0.0010) [2023-12-26 01:24:52,667][123091] Updated weights for policy 0, policy_version 229372 (0.0009) [2023-12-26 01:24:52,738][123091] Updated weights for policy 0, policy_version 229382 (0.0006) [2023-12-26 01:24:52,785][123090] Updated weights for policy 1, policy_version 228291 (0.0010) [2023-12-26 01:24:52,803][123091] Updated weights for policy 0, policy_version 229392 (0.0006) [2023-12-26 01:24:52,841][123090] Updated weights for policy 1, policy_version 228301 (0.0010) [2023-12-26 01:24:52,899][123090] Updated weights for policy 1, policy_version 228311 (0.0010) [2023-12-26 01:24:53,555][123091] Updated weights for policy 0, policy_version 229403 (0.0010) [2023-12-26 01:24:53,605][123091] Updated weights for policy 0, policy_version 229413 (0.0009) [2023-12-26 01:24:53,644][123090] Updated weights for policy 1, policy_version 228321 (0.0010) [2023-12-26 01:24:53,658][123091] Updated weights for policy 0, policy_version 229423 (0.0008) [2023-12-26 01:24:53,694][123090] Updated weights for policy 1, policy_version 228331 (0.0005) [2023-12-26 01:24:53,749][123090] Updated weights for policy 1, policy_version 228341 (0.0005) [2023-12-26 01:24:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 117186560. Throughput: 0: 8987.2, 1: 8708.6. Samples: 117164616. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:53,785][121949] Avg episode reward: [(0, '6078.399'), (1, '4892.777')] [2023-12-26 01:24:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000229424_58736640.pth... [2023-12-26 01:24:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000228368_58466304.pth [2023-12-26 01:24:53,807][123090] Updated weights for policy 1, policy_version 228351 (0.0006) [2023-12-26 01:24:53,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000228352_58458112.pth... [2023-12-26 01:24:53,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000227328_58195968.pth [2023-12-26 01:24:54,517][123091] Updated weights for policy 0, policy_version 229433 (0.0009) [2023-12-26 01:24:54,572][123091] Updated weights for policy 0, policy_version 229443 (0.0010) [2023-12-26 01:24:54,582][123090] Updated weights for policy 1, policy_version 228361 (0.0010) [2023-12-26 01:24:54,628][123091] Updated weights for policy 0, policy_version 229453 (0.0010) [2023-12-26 01:24:54,641][123090] Updated weights for policy 1, policy_version 228371 (0.0010) [2023-12-26 01:24:54,699][123090] Updated weights for policy 1, policy_version 228381 (0.0010) [2023-12-26 01:24:55,347][123091] Updated weights for policy 0, policy_version 229463 (0.0007) [2023-12-26 01:24:55,355][123090] Updated weights for policy 1, policy_version 228391 (0.0005) [2023-12-26 01:24:55,412][123091] Updated weights for policy 0, policy_version 229473 (0.0005) [2023-12-26 01:24:55,419][123090] Updated weights for policy 1, policy_version 228401 (0.0005) [2023-12-26 01:24:55,461][123091] Updated weights for policy 0, policy_version 229483 (0.0005) [2023-12-26 01:24:55,482][123090] Updated weights for policy 1, policy_version 228411 (0.0007) [2023-12-26 01:24:56,153][123091] Updated weights for policy 0, policy_version 229493 (0.0005) [2023-12-26 01:24:56,186][123090] Updated weights for policy 1, policy_version 228421 (0.0008) [2023-12-26 01:24:56,215][123091] Updated weights for policy 0, policy_version 229503 (0.0005) [2023-12-26 01:24:56,241][123090] Updated weights for policy 1, policy_version 228431 (0.0010) [2023-12-26 01:24:56,280][123091] Updated weights for policy 0, policy_version 229513 (0.0006) [2023-12-26 01:24:56,309][123090] Updated weights for policy 1, policy_version 228441 (0.0011) [2023-12-26 01:24:56,784][123091] Updated weights for policy 0, policy_version 229523 (0.0005) [2023-12-26 01:24:56,836][123091] Updated weights for policy 0, policy_version 229533 (0.0006) [2023-12-26 01:24:56,883][123091] Updated weights for policy 0, policy_version 229543 (0.0010) [2023-12-26 01:24:57,067][123090] Updated weights for policy 1, policy_version 228451 (0.0009) [2023-12-26 01:24:57,116][123090] Updated weights for policy 1, policy_version 228461 (0.0005) [2023-12-26 01:24:57,166][123090] Updated weights for policy 1, policy_version 228471 (0.0005) [2023-12-26 01:24:57,614][123091] Updated weights for policy 0, policy_version 229553 (0.0010) [2023-12-26 01:24:57,668][123091] Updated weights for policy 0, policy_version 229563 (0.0005) [2023-12-26 01:24:57,720][123091] Updated weights for policy 0, policy_version 229573 (0.0005) [2023-12-26 01:24:57,775][123091] Updated weights for policy 0, policy_version 229583 (0.0005) [2023-12-26 01:24:57,850][123090] Updated weights for policy 1, policy_version 228481 (0.0005) [2023-12-26 01:24:57,905][123090] Updated weights for policy 1, policy_version 228491 (0.0005) [2023-12-26 01:24:57,956][123090] Updated weights for policy 1, policy_version 228501 (0.0008) [2023-12-26 01:24:58,020][123090] Updated weights for policy 1, policy_version 228511 (0.0008) [2023-12-26 01:24:58,551][123091] Updated weights for policy 0, policy_version 229593 (0.0010) [2023-12-26 01:24:58,632][123091] Updated weights for policy 0, policy_version 229603 (0.0009) [2023-12-26 01:24:58,703][123091] Updated weights for policy 0, policy_version 229613 (0.0010) [2023-12-26 01:24:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 117284864. Throughput: 0: 9088.8, 1: 8822.4. Samples: 117277288. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:24:58,784][121949] Avg episode reward: [(0, '6033.404'), (1, '4946.975')] [2023-12-26 01:24:58,832][123090] Updated weights for policy 1, policy_version 228521 (0.0008) [2023-12-26 01:24:58,897][123090] Updated weights for policy 1, policy_version 228531 (0.0008) [2023-12-26 01:24:58,967][123090] Updated weights for policy 1, policy_version 228541 (0.0008) [2023-12-26 01:24:59,684][123091] Updated weights for policy 0, policy_version 229623 (0.0011) [2023-12-26 01:24:59,740][123090] Updated weights for policy 1, policy_version 228551 (0.0008) [2023-12-26 01:24:59,749][123091] Updated weights for policy 0, policy_version 229633 (0.0009) [2023-12-26 01:24:59,799][123090] Updated weights for policy 1, policy_version 228561 (0.0010) [2023-12-26 01:24:59,817][123091] Updated weights for policy 0, policy_version 229643 (0.0006) [2023-12-26 01:24:59,864][123090] Updated weights for policy 1, policy_version 228571 (0.0008) [2023-12-26 01:25:00,575][123090] Updated weights for policy 1, policy_version 228581 (0.0008) [2023-12-26 01:25:00,642][123090] Updated weights for policy 1, policy_version 228591 (0.0010) [2023-12-26 01:25:00,672][123091] Updated weights for policy 0, policy_version 229653 (0.0009) [2023-12-26 01:25:00,707][123090] Updated weights for policy 1, policy_version 228601 (0.0006) [2023-12-26 01:25:00,730][123091] Updated weights for policy 0, policy_version 229663 (0.0008) [2023-12-26 01:25:00,782][123091] Updated weights for policy 0, policy_version 229673 (0.0009) [2023-12-26 01:25:01,422][123090] Updated weights for policy 1, policy_version 228611 (0.0007) [2023-12-26 01:25:01,477][123090] Updated weights for policy 1, policy_version 228621 (0.0010) [2023-12-26 01:25:01,532][123090] Updated weights for policy 1, policy_version 228631 (0.0010) [2023-12-26 01:25:01,635][123091] Updated weights for policy 0, policy_version 229683 (0.0010) [2023-12-26 01:25:01,692][123091] Updated weights for policy 0, policy_version 229693 (0.0009) [2023-12-26 01:25:01,762][123091] Updated weights for policy 0, policy_version 229703 (0.0009) [2023-12-26 01:25:02,275][123090] Updated weights for policy 1, policy_version 228641 (0.0010) [2023-12-26 01:25:02,336][123090] Updated weights for policy 1, policy_version 228651 (0.0006) [2023-12-26 01:25:02,407][123090] Updated weights for policy 1, policy_version 228661 (0.0007) [2023-12-26 01:25:02,464][123090] Updated weights for policy 1, policy_version 228671 (0.0006) [2023-12-26 01:25:02,508][123091] Updated weights for policy 0, policy_version 229714 (0.0010) [2023-12-26 01:25:02,558][123091] Updated weights for policy 0, policy_version 229724 (0.0007) [2023-12-26 01:25:02,613][123091] Updated weights for policy 0, policy_version 229734 (0.0010) [2023-12-26 01:25:02,664][123091] Updated weights for policy 0, policy_version 229744 (0.0006) [2023-12-26 01:25:03,236][123090] Updated weights for policy 1, policy_version 228681 (0.0006) [2023-12-26 01:25:03,284][123090] Updated weights for policy 1, policy_version 228691 (0.0005) [2023-12-26 01:25:03,339][123090] Updated weights for policy 1, policy_version 228701 (0.0005) [2023-12-26 01:25:03,343][123091] Updated weights for policy 0, policy_version 229754 (0.0005) [2023-12-26 01:25:03,398][123091] Updated weights for policy 0, policy_version 229764 (0.0005) [2023-12-26 01:25:03,456][123091] Updated weights for policy 0, policy_version 229774 (0.0005) [2023-12-26 01:25:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 117374976. Throughput: 0: 9023.8, 1: 8858.7. Samples: 117386548. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:25:03,785][121949] Avg episode reward: [(0, '5937.881'), (1, '5039.938')] [2023-12-26 01:25:04,024][123090] Updated weights for policy 1, policy_version 228711 (0.0005) [2023-12-26 01:25:04,082][123090] Updated weights for policy 1, policy_version 228721 (0.0005) [2023-12-26 01:25:04,135][123091] Updated weights for policy 0, policy_version 229784 (0.0008) [2023-12-26 01:25:04,145][123090] Updated weights for policy 1, policy_version 228731 (0.0007) [2023-12-26 01:25:04,202][123091] Updated weights for policy 0, policy_version 229794 (0.0011) [2023-12-26 01:25:04,262][123091] Updated weights for policy 0, policy_version 229804 (0.0011) [2023-12-26 01:25:04,894][123090] Updated weights for policy 1, policy_version 228741 (0.0008) [2023-12-26 01:25:04,950][123090] Updated weights for policy 1, policy_version 228751 (0.0005) [2023-12-26 01:25:05,010][123091] Updated weights for policy 0, policy_version 229814 (0.0010) [2023-12-26 01:25:05,012][123090] Updated weights for policy 1, policy_version 228761 (0.0006) [2023-12-26 01:25:05,054][123091] Updated weights for policy 0, policy_version 229824 (0.0010) [2023-12-26 01:25:05,105][123091] Updated weights for policy 0, policy_version 229834 (0.0010) [2023-12-26 01:25:05,805][123090] Updated weights for policy 1, policy_version 228771 (0.0010) [2023-12-26 01:25:05,820][123091] Updated weights for policy 0, policy_version 229844 (0.0009) [2023-12-26 01:25:05,852][123090] Updated weights for policy 1, policy_version 228781 (0.0010) [2023-12-26 01:25:05,888][123091] Updated weights for policy 0, policy_version 229854 (0.0009) [2023-12-26 01:25:05,904][123090] Updated weights for policy 1, policy_version 228791 (0.0010) [2023-12-26 01:25:05,954][123091] Updated weights for policy 0, policy_version 229864 (0.0011) [2023-12-26 01:25:06,709][123091] Updated weights for policy 0, policy_version 229874 (0.0010) [2023-12-26 01:25:06,761][123090] Updated weights for policy 1, policy_version 228801 (0.0010) [2023-12-26 01:25:06,781][123091] Updated weights for policy 0, policy_version 229884 (0.0008) [2023-12-26 01:25:06,825][123090] Updated weights for policy 1, policy_version 228811 (0.0010) [2023-12-26 01:25:06,842][123091] Updated weights for policy 0, policy_version 229894 (0.0006) [2023-12-26 01:25:06,884][123090] Updated weights for policy 1, policy_version 228821 (0.0010) [2023-12-26 01:25:06,899][123091] Updated weights for policy 0, policy_version 229904 (0.0009) [2023-12-26 01:25:06,935][123090] Updated weights for policy 1, policy_version 228831 (0.0010) [2023-12-26 01:25:07,616][123091] Updated weights for policy 0, policy_version 229914 (0.0009) [2023-12-26 01:25:07,680][123091] Updated weights for policy 0, policy_version 229924 (0.0005) [2023-12-26 01:25:07,739][123091] Updated weights for policy 0, policy_version 229934 (0.0006) [2023-12-26 01:25:07,781][123090] Updated weights for policy 1, policy_version 228841 (0.0010) [2023-12-26 01:25:07,852][123090] Updated weights for policy 1, policy_version 228851 (0.0010) [2023-12-26 01:25:07,904][123090] Updated weights for policy 1, policy_version 228861 (0.0010) [2023-12-26 01:25:08,474][123091] Updated weights for policy 0, policy_version 229944 (0.0010) [2023-12-26 01:25:08,533][123091] Updated weights for policy 0, policy_version 229954 (0.0011) [2023-12-26 01:25:08,595][123091] Updated weights for policy 0, policy_version 229964 (0.0010) [2023-12-26 01:25:08,723][123090] Updated weights for policy 1, policy_version 228871 (0.0007) [2023-12-26 01:25:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 117465088. Throughput: 0: 9124.5, 1: 8894.2. Samples: 117443084. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:25:08,785][121949] Avg episode reward: [(0, '5984.667'), (1, '4972.574')] [2023-12-26 01:25:08,789][123090] Updated weights for policy 1, policy_version 228881 (0.0006) [2023-12-26 01:25:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000229968_58875904.pth... [2023-12-26 01:25:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000228880_58597376.pth [2023-12-26 01:25:08,854][123090] Updated weights for policy 1, policy_version 228891 (0.0010) [2023-12-26 01:25:08,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000228896_58597376.pth... [2023-12-26 01:25:08,890][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000227840_58327040.pth [2023-12-26 01:25:09,325][123091] Updated weights for policy 0, policy_version 229974 (0.0009) [2023-12-26 01:25:09,402][123091] Updated weights for policy 0, policy_version 229984 (0.0010) [2023-12-26 01:25:09,469][123091] Updated weights for policy 0, policy_version 229994 (0.0011) [2023-12-26 01:25:09,641][123090] Updated weights for policy 1, policy_version 228901 (0.0008) [2023-12-26 01:25:09,715][123090] Updated weights for policy 1, policy_version 228911 (0.0006) [2023-12-26 01:25:09,775][123090] Updated weights for policy 1, policy_version 228921 (0.0006) [2023-12-26 01:25:10,328][123091] Updated weights for policy 0, policy_version 230004 (0.0009) [2023-12-26 01:25:10,392][123091] Updated weights for policy 0, policy_version 230014 (0.0007) [2023-12-26 01:25:10,452][123091] Updated weights for policy 0, policy_version 230024 (0.0008) [2023-12-26 01:25:10,578][123090] Updated weights for policy 1, policy_version 228931 (0.0007) [2023-12-26 01:25:10,651][123090] Updated weights for policy 1, policy_version 228941 (0.0006) [2023-12-26 01:25:10,717][123090] Updated weights for policy 1, policy_version 228951 (0.0005) [2023-12-26 01:25:11,204][123091] Updated weights for policy 0, policy_version 230034 (0.0009) [2023-12-26 01:25:11,264][123091] Updated weights for policy 0, policy_version 230044 (0.0009) [2023-12-26 01:25:11,324][123091] Updated weights for policy 0, policy_version 230054 (0.0010) [2023-12-26 01:25:11,392][123091] Updated weights for policy 0, policy_version 230064 (0.0008) [2023-12-26 01:25:11,496][123090] Updated weights for policy 1, policy_version 228961 (0.0008) [2023-12-26 01:25:11,566][123090] Updated weights for policy 1, policy_version 228971 (0.0009) [2023-12-26 01:25:11,636][123090] Updated weights for policy 1, policy_version 228981 (0.0009) [2023-12-26 01:25:11,704][123090] Updated weights for policy 1, policy_version 228991 (0.0011) [2023-12-26 01:25:12,259][123091] Updated weights for policy 0, policy_version 230074 (0.0009) [2023-12-26 01:25:12,326][123091] Updated weights for policy 0, policy_version 230084 (0.0008) [2023-12-26 01:25:12,388][123091] Updated weights for policy 0, policy_version 230094 (0.0010) [2023-12-26 01:25:12,537][123090] Updated weights for policy 1, policy_version 229001 (0.0010) [2023-12-26 01:25:12,605][123090] Updated weights for policy 1, policy_version 229011 (0.0011) [2023-12-26 01:25:12,676][123090] Updated weights for policy 1, policy_version 229021 (0.0011) [2023-12-26 01:25:13,160][123091] Updated weights for policy 0, policy_version 230104 (0.0005) [2023-12-26 01:25:13,216][123091] Updated weights for policy 0, policy_version 230114 (0.0005) [2023-12-26 01:25:13,264][123091] Updated weights for policy 0, policy_version 230124 (0.0008) [2023-12-26 01:25:13,489][123090] Updated weights for policy 1, policy_version 229031 (0.0010) [2023-12-26 01:25:13,563][123090] Updated weights for policy 1, policy_version 229041 (0.0011) [2023-12-26 01:25:13,633][123090] Updated weights for policy 1, policy_version 229051 (0.0010) [2023-12-26 01:25:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 117555200. Throughput: 0: 9047.7, 1: 8890.2. Samples: 117548416. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:25:13,784][121949] Avg episode reward: [(0, '6100.306'), (1, '4900.300')] [2023-12-26 01:25:13,896][123091] Updated weights for policy 0, policy_version 230134 (0.0007) [2023-12-26 01:25:13,947][123091] Updated weights for policy 0, policy_version 230144 (0.0005) [2023-12-26 01:25:14,009][123091] Updated weights for policy 0, policy_version 230154 (0.0007) [2023-12-26 01:25:14,370][123090] Updated weights for policy 1, policy_version 229061 (0.0008) [2023-12-26 01:25:14,422][123090] Updated weights for policy 1, policy_version 229071 (0.0005) [2023-12-26 01:25:14,483][123090] Updated weights for policy 1, policy_version 229081 (0.0006) [2023-12-26 01:25:14,881][123091] Updated weights for policy 0, policy_version 230164 (0.0009) [2023-12-26 01:25:14,945][123091] Updated weights for policy 0, policy_version 230174 (0.0009) [2023-12-26 01:25:15,018][123091] Updated weights for policy 0, policy_version 230184 (0.0010) [2023-12-26 01:25:15,239][123090] Updated weights for policy 1, policy_version 229091 (0.0009) [2023-12-26 01:25:15,297][123090] Updated weights for policy 1, policy_version 229101 (0.0009) [2023-12-26 01:25:15,360][123090] Updated weights for policy 1, policy_version 229111 (0.0008) [2023-12-26 01:25:15,897][123091] Updated weights for policy 0, policy_version 230194 (0.0010) [2023-12-26 01:25:15,954][123091] Updated weights for policy 0, policy_version 230204 (0.0010) [2023-12-26 01:25:16,007][123091] Updated weights for policy 0, policy_version 230214 (0.0010) [2023-12-26 01:25:16,062][123091] Updated weights for policy 0, policy_version 230224 (0.0010) [2023-12-26 01:25:16,108][123090] Updated weights for policy 1, policy_version 229121 (0.0005) [2023-12-26 01:25:16,154][123090] Updated weights for policy 1, policy_version 229131 (0.0005) [2023-12-26 01:25:16,208][123090] Updated weights for policy 1, policy_version 229141 (0.0006) [2023-12-26 01:25:16,268][123090] Updated weights for policy 1, policy_version 229151 (0.0005) [2023-12-26 01:25:16,938][123091] Updated weights for policy 0, policy_version 230234 (0.0005) [2023-12-26 01:25:17,001][123091] Updated weights for policy 0, policy_version 230244 (0.0006) [2023-12-26 01:25:17,013][123090] Updated weights for policy 1, policy_version 229161 (0.0009) [2023-12-26 01:25:17,064][123091] Updated weights for policy 0, policy_version 230254 (0.0007) [2023-12-26 01:25:17,072][123090] Updated weights for policy 1, policy_version 229171 (0.0007) [2023-12-26 01:25:17,129][123090] Updated weights for policy 1, policy_version 229181 (0.0009) [2023-12-26 01:25:17,803][123090] Updated weights for policy 1, policy_version 229191 (0.0008) [2023-12-26 01:25:17,855][123090] Updated weights for policy 1, policy_version 229201 (0.0009) [2023-12-26 01:25:17,876][123091] Updated weights for policy 0, policy_version 230264 (0.0008) [2023-12-26 01:25:17,902][123090] Updated weights for policy 1, policy_version 229211 (0.0005) [2023-12-26 01:25:17,931][123091] Updated weights for policy 0, policy_version 230274 (0.0007) [2023-12-26 01:25:17,983][123091] Updated weights for policy 0, policy_version 230284 (0.0005) [2023-12-26 01:25:18,686][123090] Updated weights for policy 1, policy_version 229221 (0.0007) [2023-12-26 01:25:18,734][123090] Updated weights for policy 1, policy_version 229231 (0.0009) [2023-12-26 01:25:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 117637120. Throughput: 0: 9037.4, 1: 8972.2. Samples: 117656824. Policy #0 lag: (min: 31.0, avg: 41.1, max: 63.0) [2023-12-26 01:25:18,784][123090] Updated weights for policy 1, policy_version 229241 (0.0009) [2023-12-26 01:25:18,784][121949] Avg episode reward: [(0, '6151.239'), (1, '5070.049')] [2023-12-26 01:25:18,785][123007] Saving new best policy, reward=6151.239! [2023-12-26 01:25:18,862][123091] Updated weights for policy 0, policy_version 230294 (0.0009) [2023-12-26 01:25:18,932][123091] Updated weights for policy 0, policy_version 230304 (0.0010) [2023-12-26 01:25:18,995][123091] Updated weights for policy 0, policy_version 230314 (0.0009) [2023-12-26 01:25:19,599][123090] Updated weights for policy 1, policy_version 229251 (0.0010) [2023-12-26 01:25:19,652][123090] Updated weights for policy 1, policy_version 229261 (0.0009) [2023-12-26 01:25:19,710][123090] Updated weights for policy 1, policy_version 229271 (0.0009) [2023-12-26 01:25:19,857][123091] Updated weights for policy 0, policy_version 230324 (0.0010) [2023-12-26 01:25:19,918][123091] Updated weights for policy 0, policy_version 230334 (0.0008) [2023-12-26 01:25:19,977][123091] Updated weights for policy 0, policy_version 230344 (0.0009) [2023-12-26 01:25:20,463][123090] Updated weights for policy 1, policy_version 229281 (0.0009) [2023-12-26 01:25:20,523][123090] Updated weights for policy 1, policy_version 229291 (0.0009) [2023-12-26 01:25:20,591][123090] Updated weights for policy 1, policy_version 229301 (0.0010) [2023-12-26 01:25:20,652][123090] Updated weights for policy 1, policy_version 229311 (0.0009) [2023-12-26 01:25:20,808][123091] Updated weights for policy 0, policy_version 230354 (0.0009) [2023-12-26 01:25:20,875][123091] Updated weights for policy 0, policy_version 230364 (0.0009) [2023-12-26 01:25:20,942][123091] Updated weights for policy 0, policy_version 230374 (0.0010) [2023-12-26 01:25:21,006][123091] Updated weights for policy 0, policy_version 230384 (0.0010) [2023-12-26 01:25:21,480][123090] Updated weights for policy 1, policy_version 229321 (0.0006) [2023-12-26 01:25:21,537][123090] Updated weights for policy 1, policy_version 229331 (0.0005) [2023-12-26 01:25:21,599][123090] Updated weights for policy 1, policy_version 229341 (0.0006) [2023-12-26 01:25:21,840][123091] Updated weights for policy 0, policy_version 230394 (0.0008) [2023-12-26 01:25:21,906][123091] Updated weights for policy 0, policy_version 230404 (0.0008) [2023-12-26 01:25:21,976][123091] Updated weights for policy 0, policy_version 230414 (0.0008) [2023-12-26 01:25:22,478][123090] Updated weights for policy 1, policy_version 229351 (0.0009) [2023-12-26 01:25:22,539][123090] Updated weights for policy 1, policy_version 229361 (0.0009) [2023-12-26 01:25:22,600][123090] Updated weights for policy 1, policy_version 229371 (0.0009) [2023-12-26 01:25:22,767][123091] Updated weights for policy 0, policy_version 230424 (0.0010) [2023-12-26 01:25:22,835][123091] Updated weights for policy 0, policy_version 230434 (0.0011) [2023-12-26 01:25:22,895][123091] Updated weights for policy 0, policy_version 230444 (0.0011) [2023-12-26 01:25:23,435][123090] Updated weights for policy 1, policy_version 229381 (0.0009) [2023-12-26 01:25:23,492][123090] Updated weights for policy 1, policy_version 229391 (0.0009) [2023-12-26 01:25:23,563][123090] Updated weights for policy 1, policy_version 229401 (0.0008) [2023-12-26 01:25:23,680][123091] Updated weights for policy 0, policy_version 230454 (0.0008) [2023-12-26 01:25:23,727][123091] Updated weights for policy 0, policy_version 230464 (0.0009) [2023-12-26 01:25:23,775][123091] Updated weights for policy 0, policy_version 230474 (0.0009) [2023-12-26 01:25:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 117727232. Throughput: 0: 8982.9, 1: 8985.4. Samples: 117707360. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:23,785][121949] Avg episode reward: [(0, '6184.265'), (1, '5245.366')] [2023-12-26 01:25:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000229408_58728448.pth... [2023-12-26 01:25:23,791][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000228352_58458112.pth [2023-12-26 01:25:23,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000230480_59006976.pth... [2023-12-26 01:25:23,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000229424_58736640.pth [2023-12-26 01:25:23,806][123007] Saving new best policy, reward=6184.265! [2023-12-26 01:25:24,385][123090] Updated weights for policy 1, policy_version 229411 (0.0010) [2023-12-26 01:25:24,442][123090] Updated weights for policy 1, policy_version 229421 (0.0009) [2023-12-26 01:25:24,500][123090] Updated weights for policy 1, policy_version 229431 (0.0009) [2023-12-26 01:25:24,613][123091] Updated weights for policy 0, policy_version 230484 (0.0009) [2023-12-26 01:25:24,671][123091] Updated weights for policy 0, policy_version 230494 (0.0009) [2023-12-26 01:25:24,735][123091] Updated weights for policy 0, policy_version 230504 (0.0009) [2023-12-26 01:25:25,344][123090] Updated weights for policy 1, policy_version 229441 (0.0009) [2023-12-26 01:25:25,397][123090] Updated weights for policy 1, policy_version 229451 (0.0009) [2023-12-26 01:25:25,451][123090] Updated weights for policy 1, policy_version 229461 (0.0009) [2023-12-26 01:25:25,504][123090] Updated weights for policy 1, policy_version 229471 (0.0009) [2023-12-26 01:25:25,554][123091] Updated weights for policy 0, policy_version 230514 (0.0010) [2023-12-26 01:25:25,605][123091] Updated weights for policy 0, policy_version 230524 (0.0009) [2023-12-26 01:25:25,665][123091] Updated weights for policy 0, policy_version 230534 (0.0009) [2023-12-26 01:25:25,714][123091] Updated weights for policy 0, policy_version 230544 (0.0009) [2023-12-26 01:25:26,337][123090] Updated weights for policy 1, policy_version 229481 (0.0010) [2023-12-26 01:25:26,399][123090] Updated weights for policy 1, policy_version 229491 (0.0009) [2023-12-26 01:25:26,462][123090] Updated weights for policy 1, policy_version 229501 (0.0009) [2023-12-26 01:25:26,482][123091] Updated weights for policy 0, policy_version 230554 (0.0008) [2023-12-26 01:25:26,544][123091] Updated weights for policy 0, policy_version 230564 (0.0005) [2023-12-26 01:25:26,623][123091] Updated weights for policy 0, policy_version 230574 (0.0005) [2023-12-26 01:25:27,282][123091] Updated weights for policy 0, policy_version 230584 (0.0009) [2023-12-26 01:25:27,340][123091] Updated weights for policy 0, policy_version 230594 (0.0007) [2023-12-26 01:25:27,341][123090] Updated weights for policy 1, policy_version 229511 (0.0010) [2023-12-26 01:25:27,394][123091] Updated weights for policy 0, policy_version 230604 (0.0008) [2023-12-26 01:25:27,409][123090] Updated weights for policy 1, policy_version 229521 (0.0008) [2023-12-26 01:25:27,474][123090] Updated weights for policy 1, policy_version 229531 (0.0009) [2023-12-26 01:25:28,238][123091] Updated weights for policy 0, policy_version 230614 (0.0009) [2023-12-26 01:25:28,255][123090] Updated weights for policy 1, policy_version 229541 (0.0008) [2023-12-26 01:25:28,283][123091] Updated weights for policy 0, policy_version 230624 (0.0009) [2023-12-26 01:25:28,317][123090] Updated weights for policy 1, policy_version 229551 (0.0008) [2023-12-26 01:25:28,334][123091] Updated weights for policy 0, policy_version 230634 (0.0009) [2023-12-26 01:25:28,382][123090] Updated weights for policy 1, policy_version 229561 (0.0007) [2023-12-26 01:25:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 117817344. Throughput: 0: 9006.8, 1: 8934.9. Samples: 117810492. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:28,785][121949] Avg episode reward: [(0, '6180.042'), (1, '5246.601')] [2023-12-26 01:25:29,189][123091] Updated weights for policy 0, policy_version 230644 (0.0009) [2023-12-26 01:25:29,205][123090] Updated weights for policy 1, policy_version 229571 (0.0008) [2023-12-26 01:25:29,247][123091] Updated weights for policy 0, policy_version 230654 (0.0009) [2023-12-26 01:25:29,268][123090] Updated weights for policy 1, policy_version 229581 (0.0008) [2023-12-26 01:25:29,317][123091] Updated weights for policy 0, policy_version 230664 (0.0009) [2023-12-26 01:25:29,324][123090] Updated weights for policy 1, policy_version 229591 (0.0007) [2023-12-26 01:25:30,106][123091] Updated weights for policy 0, policy_version 230674 (0.0010) [2023-12-26 01:25:30,163][123091] Updated weights for policy 0, policy_version 230684 (0.0006) [2023-12-26 01:25:30,181][123090] Updated weights for policy 1, policy_version 229601 (0.0009) [2023-12-26 01:25:30,228][123091] Updated weights for policy 0, policy_version 230694 (0.0008) [2023-12-26 01:25:30,241][123090] Updated weights for policy 1, policy_version 229611 (0.0008) [2023-12-26 01:25:30,286][123091] Updated weights for policy 0, policy_version 230704 (0.0009) [2023-12-26 01:25:30,305][123090] Updated weights for policy 1, policy_version 229621 (0.0008) [2023-12-26 01:25:30,360][123090] Updated weights for policy 1, policy_version 229631 (0.0009) [2023-12-26 01:25:30,955][123091] Updated weights for policy 0, policy_version 230714 (0.0005) [2023-12-26 01:25:31,010][123091] Updated weights for policy 0, policy_version 230724 (0.0007) [2023-12-26 01:25:31,074][123091] Updated weights for policy 0, policy_version 230734 (0.0008) [2023-12-26 01:25:31,258][123090] Updated weights for policy 1, policy_version 229641 (0.0009) [2023-12-26 01:25:31,311][123090] Updated weights for policy 1, policy_version 229651 (0.0009) [2023-12-26 01:25:31,376][123090] Updated weights for policy 1, policy_version 229661 (0.0009) [2023-12-26 01:25:31,813][123091] Updated weights for policy 0, policy_version 230744 (0.0008) [2023-12-26 01:25:31,862][123091] Updated weights for policy 0, policy_version 230754 (0.0009) [2023-12-26 01:25:31,915][123091] Updated weights for policy 0, policy_version 230764 (0.0009) [2023-12-26 01:25:32,231][123090] Updated weights for policy 1, policy_version 229671 (0.0010) [2023-12-26 01:25:32,291][123090] Updated weights for policy 1, policy_version 229681 (0.0010) [2023-12-26 01:25:32,354][123090] Updated weights for policy 1, policy_version 229691 (0.0010) [2023-12-26 01:25:32,565][123091] Updated weights for policy 0, policy_version 230774 (0.0008) [2023-12-26 01:25:32,615][123091] Updated weights for policy 0, policy_version 230784 (0.0010) [2023-12-26 01:25:32,673][123091] Updated weights for policy 0, policy_version 230794 (0.0009) [2023-12-26 01:25:33,220][123090] Updated weights for policy 1, policy_version 229701 (0.0010) [2023-12-26 01:25:33,275][123090] Updated weights for policy 1, policy_version 229711 (0.0008) [2023-12-26 01:25:33,325][123090] Updated weights for policy 1, policy_version 229721 (0.0009) [2023-12-26 01:25:33,516][123091] Updated weights for policy 0, policy_version 230804 (0.0009) [2023-12-26 01:25:33,567][123091] Updated weights for policy 0, policy_version 230814 (0.0009) [2023-12-26 01:25:33,620][123091] Updated weights for policy 0, policy_version 230825 (0.0010) [2023-12-26 01:25:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 117907456. Throughput: 0: 8924.1, 1: 8899.0. Samples: 117914924. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:33,785][121949] Avg episode reward: [(0, '6142.322'), (1, '5195.188')] [2023-12-26 01:25:34,054][123090] Updated weights for policy 1, policy_version 229731 (0.0008) [2023-12-26 01:25:34,104][123090] Updated weights for policy 1, policy_version 229741 (0.0005) [2023-12-26 01:25:34,161][123090] Updated weights for policy 1, policy_version 229751 (0.0006) [2023-12-26 01:25:34,514][123091] Updated weights for policy 0, policy_version 230835 (0.0009) [2023-12-26 01:25:34,585][123091] Updated weights for policy 0, policy_version 230845 (0.0007) [2023-12-26 01:25:34,663][123091] Updated weights for policy 0, policy_version 230855 (0.0006) [2023-12-26 01:25:34,858][123090] Updated weights for policy 1, policy_version 229761 (0.0007) [2023-12-26 01:25:34,928][123090] Updated weights for policy 1, policy_version 229771 (0.0006) [2023-12-26 01:25:35,002][123090] Updated weights for policy 1, policy_version 229781 (0.0006) [2023-12-26 01:25:35,068][123090] Updated weights for policy 1, policy_version 229791 (0.0008) [2023-12-26 01:25:35,320][123091] Updated weights for policy 0, policy_version 230865 (0.0006) [2023-12-26 01:25:35,394][123091] Updated weights for policy 0, policy_version 230875 (0.0006) [2023-12-26 01:25:35,449][123091] Updated weights for policy 0, policy_version 230885 (0.0006) [2023-12-26 01:25:35,497][123091] Updated weights for policy 0, policy_version 230895 (0.0006) [2023-12-26 01:25:35,742][123090] Updated weights for policy 1, policy_version 229801 (0.0008) [2023-12-26 01:25:35,807][123090] Updated weights for policy 1, policy_version 229811 (0.0006) [2023-12-26 01:25:35,863][123090] Updated weights for policy 1, policy_version 229821 (0.0005) [2023-12-26 01:25:36,202][123091] Updated weights for policy 0, policy_version 230905 (0.0008) [2023-12-26 01:25:36,264][123091] Updated weights for policy 0, policy_version 230915 (0.0009) [2023-12-26 01:25:36,312][123091] Updated weights for policy 0, policy_version 230925 (0.0009) [2023-12-26 01:25:36,553][123090] Updated weights for policy 1, policy_version 229831 (0.0011) [2023-12-26 01:25:36,622][123090] Updated weights for policy 1, policy_version 229841 (0.0010) [2023-12-26 01:25:36,689][123090] Updated weights for policy 1, policy_version 229851 (0.0010) [2023-12-26 01:25:37,142][123091] Updated weights for policy 0, policy_version 230935 (0.0009) [2023-12-26 01:25:37,199][123091] Updated weights for policy 0, policy_version 230945 (0.0009) [2023-12-26 01:25:37,262][123091] Updated weights for policy 0, policy_version 230955 (0.0009) [2023-12-26 01:25:37,514][123090] Updated weights for policy 1, policy_version 229861 (0.0011) [2023-12-26 01:25:37,585][123090] Updated weights for policy 1, policy_version 229871 (0.0011) [2023-12-26 01:25:37,653][123090] Updated weights for policy 1, policy_version 229881 (0.0010) [2023-12-26 01:25:38,006][123091] Updated weights for policy 0, policy_version 230965 (0.0007) [2023-12-26 01:25:38,063][123091] Updated weights for policy 0, policy_version 230975 (0.0005) [2023-12-26 01:25:38,131][123091] Updated weights for policy 0, policy_version 230985 (0.0005) [2023-12-26 01:25:38,463][123090] Updated weights for policy 1, policy_version 229891 (0.0011) [2023-12-26 01:25:38,519][123090] Updated weights for policy 1, policy_version 229901 (0.0010) [2023-12-26 01:25:38,567][123090] Updated weights for policy 1, policy_version 229911 (0.0010) [2023-12-26 01:25:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 117997568. Throughput: 0: 8985.6, 1: 8970.1. Samples: 117972620. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:38,785][121949] Avg episode reward: [(0, '6072.383'), (1, '5204.811')] [2023-12-26 01:25:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000230992_59138048.pth... [2023-12-26 01:25:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000229920_58859520.pth... [2023-12-26 01:25:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000229968_58875904.pth [2023-12-26 01:25:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000228896_58597376.pth [2023-12-26 01:25:38,903][123091] Updated weights for policy 0, policy_version 230995 (0.0006) [2023-12-26 01:25:38,965][123091] Updated weights for policy 0, policy_version 231005 (0.0009) [2023-12-26 01:25:39,025][123091] Updated weights for policy 0, policy_version 231015 (0.0009) [2023-12-26 01:25:39,304][123090] Updated weights for policy 1, policy_version 229921 (0.0008) [2023-12-26 01:25:39,384][123090] Updated weights for policy 1, policy_version 229931 (0.0012) [2023-12-26 01:25:39,452][123090] Updated weights for policy 1, policy_version 229941 (0.0010) [2023-12-26 01:25:39,518][123090] Updated weights for policy 1, policy_version 229951 (0.0011) [2023-12-26 01:25:39,880][123091] Updated weights for policy 0, policy_version 231025 (0.0009) [2023-12-26 01:25:39,955][123091] Updated weights for policy 0, policy_version 231035 (0.0010) [2023-12-26 01:25:40,020][123091] Updated weights for policy 0, policy_version 231045 (0.0009) [2023-12-26 01:25:40,085][123091] Updated weights for policy 0, policy_version 231055 (0.0009) [2023-12-26 01:25:40,331][123090] Updated weights for policy 1, policy_version 229961 (0.0006) [2023-12-26 01:25:40,399][123090] Updated weights for policy 1, policy_version 229971 (0.0006) [2023-12-26 01:25:40,460][123090] Updated weights for policy 1, policy_version 229981 (0.0007) [2023-12-26 01:25:40,996][123091] Updated weights for policy 0, policy_version 231065 (0.0009) [2023-12-26 01:25:41,068][123091] Updated weights for policy 0, policy_version 231075 (0.0010) [2023-12-26 01:25:41,138][123090] Updated weights for policy 1, policy_version 229991 (0.0006) [2023-12-26 01:25:41,139][123091] Updated weights for policy 0, policy_version 231085 (0.0008) [2023-12-26 01:25:41,213][123090] Updated weights for policy 1, policy_version 230001 (0.0007) [2023-12-26 01:25:41,281][123090] Updated weights for policy 1, policy_version 230011 (0.0010) [2023-12-26 01:25:41,921][123091] Updated weights for policy 0, policy_version 231095 (0.0009) [2023-12-26 01:25:41,990][123091] Updated weights for policy 0, policy_version 231105 (0.0008) [2023-12-26 01:25:42,024][123090] Updated weights for policy 1, policy_version 230021 (0.0011) [2023-12-26 01:25:42,057][123091] Updated weights for policy 0, policy_version 231115 (0.0007) [2023-12-26 01:25:42,085][123090] Updated weights for policy 1, policy_version 230031 (0.0011) [2023-12-26 01:25:42,156][123090] Updated weights for policy 1, policy_version 230041 (0.0010) [2023-12-26 01:25:42,863][123090] Updated weights for policy 1, policy_version 230051 (0.0009) [2023-12-26 01:25:42,877][123091] Updated weights for policy 0, policy_version 231125 (0.0007) [2023-12-26 01:25:42,911][123090] Updated weights for policy 1, policy_version 230061 (0.0005) [2023-12-26 01:25:42,939][123091] Updated weights for policy 0, policy_version 231135 (0.0009) [2023-12-26 01:25:42,965][123090] Updated weights for policy 1, policy_version 230071 (0.0005) [2023-12-26 01:25:42,998][123091] Updated weights for policy 0, policy_version 231145 (0.0009) [2023-12-26 01:25:43,736][123091] Updated weights for policy 0, policy_version 231155 (0.0008) [2023-12-26 01:25:43,749][123090] Updated weights for policy 1, policy_version 230081 (0.0006) [2023-12-26 01:25:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 118079488. Throughput: 0: 8887.6, 1: 8915.3. Samples: 118078416. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:43,785][121949] Avg episode reward: [(0, '6089.061'), (1, '5338.625')] [2023-12-26 01:25:43,794][123091] Updated weights for policy 0, policy_version 231165 (0.0005) [2023-12-26 01:25:43,819][123090] Updated weights for policy 1, policy_version 230091 (0.0011) [2023-12-26 01:25:43,857][123091] Updated weights for policy 0, policy_version 231175 (0.0009) [2023-12-26 01:25:43,874][123090] Updated weights for policy 1, policy_version 230101 (0.0010) [2023-12-26 01:25:43,925][123090] Updated weights for policy 1, policy_version 230111 (0.0010) [2023-12-26 01:25:44,626][123091] Updated weights for policy 0, policy_version 231185 (0.0010) [2023-12-26 01:25:44,680][123091] Updated weights for policy 0, policy_version 231195 (0.0005) [2023-12-26 01:25:44,725][123091] Updated weights for policy 0, policy_version 231205 (0.0005) [2023-12-26 01:25:44,756][123090] Updated weights for policy 1, policy_version 230121 (0.0010) [2023-12-26 01:25:44,780][123091] Updated weights for policy 0, policy_version 231215 (0.0006) [2023-12-26 01:25:44,834][123090] Updated weights for policy 1, policy_version 230131 (0.0010) [2023-12-26 01:25:44,899][123090] Updated weights for policy 1, policy_version 230141 (0.0010) [2023-12-26 01:25:45,536][123091] Updated weights for policy 0, policy_version 231225 (0.0008) [2023-12-26 01:25:45,604][123091] Updated weights for policy 0, policy_version 231235 (0.0011) [2023-12-26 01:25:45,666][123091] Updated weights for policy 0, policy_version 231245 (0.0011) [2023-12-26 01:25:45,750][123090] Updated weights for policy 1, policy_version 230151 (0.0009) [2023-12-26 01:25:45,799][123090] Updated weights for policy 1, policy_version 230161 (0.0009) [2023-12-26 01:25:45,852][123090] Updated weights for policy 1, policy_version 230171 (0.0008) [2023-12-26 01:25:46,406][123091] Updated weights for policy 0, policy_version 231255 (0.0007) [2023-12-26 01:25:46,454][123091] Updated weights for policy 0, policy_version 231265 (0.0006) [2023-12-26 01:25:46,508][123091] Updated weights for policy 0, policy_version 231276 (0.0006) [2023-12-26 01:25:46,644][123090] Updated weights for policy 1, policy_version 230181 (0.0007) [2023-12-26 01:25:46,709][123090] Updated weights for policy 1, policy_version 230191 (0.0005) [2023-12-26 01:25:46,771][123090] Updated weights for policy 1, policy_version 230201 (0.0005) [2023-12-26 01:25:47,293][123091] Updated weights for policy 0, policy_version 231286 (0.0008) [2023-12-26 01:25:47,352][123091] Updated weights for policy 0, policy_version 231296 (0.0010) [2023-12-26 01:25:47,407][123091] Updated weights for policy 0, policy_version 231306 (0.0010) [2023-12-26 01:25:47,417][123090] Updated weights for policy 1, policy_version 230211 (0.0005) [2023-12-26 01:25:47,472][123090] Updated weights for policy 1, policy_version 230221 (0.0005) [2023-12-26 01:25:47,517][123090] Updated weights for policy 1, policy_version 230231 (0.0005) [2023-12-26 01:25:48,238][123091] Updated weights for policy 0, policy_version 231316 (0.0010) [2023-12-26 01:25:48,296][123091] Updated weights for policy 0, policy_version 231326 (0.0011) [2023-12-26 01:25:48,321][123090] Updated weights for policy 1, policy_version 230241 (0.0006) [2023-12-26 01:25:48,370][123091] Updated weights for policy 0, policy_version 231336 (0.0011) [2023-12-26 01:25:48,386][123090] Updated weights for policy 1, policy_version 230251 (0.0008) [2023-12-26 01:25:48,451][123090] Updated weights for policy 1, policy_version 230261 (0.0008) [2023-12-26 01:25:48,520][123090] Updated weights for policy 1, policy_version 230271 (0.0009) [2023-12-26 01:25:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 118177792. Throughput: 0: 8910.7, 1: 8882.7. Samples: 118187248. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:48,784][121949] Avg episode reward: [(0, '6092.864'), (1, '5505.812')] [2023-12-26 01:25:49,106][123091] Updated weights for policy 0, policy_version 231346 (0.0011) [2023-12-26 01:25:49,171][123091] Updated weights for policy 0, policy_version 231356 (0.0011) [2023-12-26 01:25:49,186][123090] Updated weights for policy 1, policy_version 230281 (0.0006) [2023-12-26 01:25:49,237][123091] Updated weights for policy 0, policy_version 231366 (0.0010) [2023-12-26 01:25:49,247][123090] Updated weights for policy 1, policy_version 230291 (0.0007) [2023-12-26 01:25:49,300][123091] Updated weights for policy 0, policy_version 231376 (0.0011) [2023-12-26 01:25:49,310][123090] Updated weights for policy 1, policy_version 230301 (0.0008) [2023-12-26 01:25:50,023][123091] Updated weights for policy 0, policy_version 231386 (0.0006) [2023-12-26 01:25:50,087][123091] Updated weights for policy 0, policy_version 231396 (0.0006) [2023-12-26 01:25:50,089][123090] Updated weights for policy 1, policy_version 230311 (0.0008) [2023-12-26 01:25:50,150][123091] Updated weights for policy 0, policy_version 231406 (0.0007) [2023-12-26 01:25:50,152][123090] Updated weights for policy 1, policy_version 230321 (0.0008) [2023-12-26 01:25:50,212][123090] Updated weights for policy 1, policy_version 230331 (0.0008) [2023-12-26 01:25:50,894][123091] Updated weights for policy 0, policy_version 231416 (0.0011) [2023-12-26 01:25:50,961][123091] Updated weights for policy 0, policy_version 231426 (0.0011) [2023-12-26 01:25:51,032][123091] Updated weights for policy 0, policy_version 231436 (0.0011) [2023-12-26 01:25:51,035][123090] Updated weights for policy 1, policy_version 230341 (0.0007) [2023-12-26 01:25:51,105][123090] Updated weights for policy 1, policy_version 230351 (0.0009) [2023-12-26 01:25:51,172][123090] Updated weights for policy 1, policy_version 230361 (0.0010) [2023-12-26 01:25:51,830][123091] Updated weights for policy 0, policy_version 231446 (0.0009) [2023-12-26 01:25:51,887][123091] Updated weights for policy 0, policy_version 231456 (0.0009) [2023-12-26 01:25:51,951][123091] Updated weights for policy 0, policy_version 231466 (0.0010) [2023-12-26 01:25:52,043][123090] Updated weights for policy 1, policy_version 230371 (0.0010) [2023-12-26 01:25:52,108][123090] Updated weights for policy 1, policy_version 230381 (0.0006) [2023-12-26 01:25:52,178][123090] Updated weights for policy 1, policy_version 230391 (0.0011) [2023-12-26 01:25:52,727][123091] Updated weights for policy 0, policy_version 231476 (0.0011) [2023-12-26 01:25:52,794][123091] Updated weights for policy 0, policy_version 231486 (0.0006) [2023-12-26 01:25:52,866][123091] Updated weights for policy 0, policy_version 231496 (0.0008) [2023-12-26 01:25:52,888][123090] Updated weights for policy 1, policy_version 230401 (0.0010) [2023-12-26 01:25:52,947][123090] Updated weights for policy 1, policy_version 230411 (0.0011) [2023-12-26 01:25:53,025][123090] Updated weights for policy 1, policy_version 230421 (0.0011) [2023-12-26 01:25:53,077][123090] Updated weights for policy 1, policy_version 230431 (0.0010) [2023-12-26 01:25:53,559][123091] Updated weights for policy 0, policy_version 231506 (0.0010) [2023-12-26 01:25:53,608][123091] Updated weights for policy 0, policy_version 231516 (0.0005) [2023-12-26 01:25:53,656][123091] Updated weights for policy 0, policy_version 231526 (0.0005) [2023-12-26 01:25:53,711][123091] Updated weights for policy 0, policy_version 231536 (0.0006) [2023-12-26 01:25:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 118267904. Throughput: 0: 8887.2, 1: 8851.4. Samples: 118241320. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:53,785][121949] Avg episode reward: [(0, '6193.436'), (1, '5454.131')] [2023-12-26 01:25:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000231536_59277312.pth... [2023-12-26 01:25:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000230480_59006976.pth [2023-12-26 01:25:53,795][123007] Saving new best policy, reward=6193.436! [2023-12-26 01:25:53,862][123090] Updated weights for policy 1, policy_version 230441 (0.0006) [2023-12-26 01:25:53,927][123090] Updated weights for policy 1, policy_version 230451 (0.0006) [2023-12-26 01:25:53,985][123090] Updated weights for policy 1, policy_version 230461 (0.0005) [2023-12-26 01:25:54,000][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000230464_58998784.pth... [2023-12-26 01:25:54,004][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000229408_58728448.pth [2023-12-26 01:25:54,489][123091] Updated weights for policy 0, policy_version 231546 (0.0010) [2023-12-26 01:25:54,544][123091] Updated weights for policy 0, policy_version 231556 (0.0011) [2023-12-26 01:25:54,607][123091] Updated weights for policy 0, policy_version 231566 (0.0011) [2023-12-26 01:25:54,686][123090] Updated weights for policy 1, policy_version 230471 (0.0008) [2023-12-26 01:25:54,756][123090] Updated weights for policy 1, policy_version 230481 (0.0007) [2023-12-26 01:25:54,816][123090] Updated weights for policy 1, policy_version 230491 (0.0006) [2023-12-26 01:25:55,405][123091] Updated weights for policy 0, policy_version 231576 (0.0010) [2023-12-26 01:25:55,461][123090] Updated weights for policy 1, policy_version 230501 (0.0006) [2023-12-26 01:25:55,464][123091] Updated weights for policy 0, policy_version 231586 (0.0010) [2023-12-26 01:25:55,519][123090] Updated weights for policy 1, policy_version 230511 (0.0007) [2023-12-26 01:25:55,524][123091] Updated weights for policy 0, policy_version 231596 (0.0009) [2023-12-26 01:25:55,571][123090] Updated weights for policy 1, policy_version 230521 (0.0006) [2023-12-26 01:25:56,214][123091] Updated weights for policy 0, policy_version 231606 (0.0006) [2023-12-26 01:25:56,245][123090] Updated weights for policy 1, policy_version 230531 (0.0006) [2023-12-26 01:25:56,273][123091] Updated weights for policy 0, policy_version 231616 (0.0005) [2023-12-26 01:25:56,311][123090] Updated weights for policy 1, policy_version 230541 (0.0009) [2023-12-26 01:25:56,332][123091] Updated weights for policy 0, policy_version 231626 (0.0005) [2023-12-26 01:25:56,367][123090] Updated weights for policy 1, policy_version 230551 (0.0009) [2023-12-26 01:25:57,030][123091] Updated weights for policy 0, policy_version 231636 (0.0006) [2023-12-26 01:25:57,083][123091] Updated weights for policy 0, policy_version 231648 (0.0008) [2023-12-26 01:25:57,132][123091] Updated weights for policy 0, policy_version 231658 (0.0009) [2023-12-26 01:25:57,194][123090] Updated weights for policy 1, policy_version 230561 (0.0009) [2023-12-26 01:25:57,250][123090] Updated weights for policy 1, policy_version 230571 (0.0009) [2023-12-26 01:25:57,312][123090] Updated weights for policy 1, policy_version 230581 (0.0009) [2023-12-26 01:25:57,363][123090] Updated weights for policy 1, policy_version 230591 (0.0009) [2023-12-26 01:25:57,940][123091] Updated weights for policy 0, policy_version 231668 (0.0008) [2023-12-26 01:25:58,000][123091] Updated weights for policy 0, policy_version 231678 (0.0007) [2023-12-26 01:25:58,062][123091] Updated weights for policy 0, policy_version 231688 (0.0010) [2023-12-26 01:25:58,136][123090] Updated weights for policy 1, policy_version 230601 (0.0010) [2023-12-26 01:25:58,207][123090] Updated weights for policy 1, policy_version 230611 (0.0009) [2023-12-26 01:25:58,273][123090] Updated weights for policy 1, policy_version 230621 (0.0009) [2023-12-26 01:25:58,785][121949] Fps is (10 sec: 18020.5, 60 sec: 17885.5, 300 sec: 17744.6). Total num frames: 118358016. Throughput: 0: 8929.8, 1: 8965.0. Samples: 118353704. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:25:58,786][121949] Avg episode reward: [(0, '6180.069'), (1, '5522.132')] [2023-12-26 01:25:58,967][123091] Updated weights for policy 0, policy_version 231698 (0.0009) [2023-12-26 01:25:59,037][123091] Updated weights for policy 0, policy_version 231708 (0.0009) [2023-12-26 01:25:59,094][123091] Updated weights for policy 0, policy_version 231718 (0.0009) [2023-12-26 01:25:59,148][123091] Updated weights for policy 0, policy_version 231728 (0.0009) [2023-12-26 01:25:59,260][123090] Updated weights for policy 1, policy_version 230631 (0.0009) [2023-12-26 01:25:59,315][123090] Updated weights for policy 1, policy_version 230641 (0.0009) [2023-12-26 01:25:59,380][123090] Updated weights for policy 1, policy_version 230651 (0.0008) [2023-12-26 01:26:00,017][123091] Updated weights for policy 0, policy_version 231738 (0.0009) [2023-12-26 01:26:00,072][123091] Updated weights for policy 0, policy_version 231749 (0.0011) [2023-12-26 01:26:00,130][123091] Updated weights for policy 0, policy_version 231759 (0.0010) [2023-12-26 01:26:00,185][123090] Updated weights for policy 1, policy_version 230661 (0.0010) [2023-12-26 01:26:00,238][123090] Updated weights for policy 1, policy_version 230671 (0.0007) [2023-12-26 01:26:00,288][123090] Updated weights for policy 1, policy_version 230681 (0.0009) [2023-12-26 01:26:00,870][123091] Updated weights for policy 0, policy_version 231769 (0.0010) [2023-12-26 01:26:00,926][123091] Updated weights for policy 0, policy_version 231779 (0.0009) [2023-12-26 01:26:00,979][123091] Updated weights for policy 0, policy_version 231789 (0.0010) [2023-12-26 01:26:01,001][123090] Updated weights for policy 1, policy_version 230691 (0.0008) [2023-12-26 01:26:01,078][123090] Updated weights for policy 1, policy_version 230701 (0.0008) [2023-12-26 01:26:01,147][123090] Updated weights for policy 1, policy_version 230711 (0.0008) [2023-12-26 01:26:01,825][123091] Updated weights for policy 0, policy_version 231799 (0.0007) [2023-12-26 01:26:01,877][123091] Updated weights for policy 0, policy_version 231809 (0.0005) [2023-12-26 01:26:01,925][123091] Updated weights for policy 0, policy_version 231819 (0.0005) [2023-12-26 01:26:01,933][123090] Updated weights for policy 1, policy_version 230721 (0.0010) [2023-12-26 01:26:01,988][123090] Updated weights for policy 1, policy_version 230731 (0.0009) [2023-12-26 01:26:02,050][123090] Updated weights for policy 1, policy_version 230741 (0.0007) [2023-12-26 01:26:02,116][123090] Updated weights for policy 1, policy_version 230751 (0.0008) [2023-12-26 01:26:02,736][123091] Updated weights for policy 0, policy_version 231829 (0.0007) [2023-12-26 01:26:02,795][123091] Updated weights for policy 0, policy_version 231839 (0.0006) [2023-12-26 01:26:02,855][123090] Updated weights for policy 1, policy_version 230761 (0.0006) [2023-12-26 01:26:02,864][123091] Updated weights for policy 0, policy_version 231849 (0.0008) [2023-12-26 01:26:02,928][123090] Updated weights for policy 1, policy_version 230771 (0.0006) [2023-12-26 01:26:02,989][123090] Updated weights for policy 1, policy_version 230781 (0.0006) [2023-12-26 01:26:03,499][123091] Updated weights for policy 0, policy_version 231859 (0.0006) [2023-12-26 01:26:03,548][123091] Updated weights for policy 0, policy_version 231869 (0.0005) [2023-12-26 01:26:03,558][123090] Updated weights for policy 1, policy_version 230791 (0.0006) [2023-12-26 01:26:03,597][123091] Updated weights for policy 0, policy_version 231879 (0.0005) [2023-12-26 01:26:03,614][123090] Updated weights for policy 1, policy_version 230801 (0.0006) [2023-12-26 01:26:03,665][123090] Updated weights for policy 1, policy_version 230811 (0.0006) [2023-12-26 01:26:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 118456320. Throughput: 0: 8955.4, 1: 8925.7. Samples: 118461472. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:03,785][121949] Avg episode reward: [(0, '6150.322'), (1, '5600.478')] [2023-12-26 01:26:04,391][123091] Updated weights for policy 0, policy_version 231889 (0.0006) [2023-12-26 01:26:04,427][123090] Updated weights for policy 1, policy_version 230821 (0.0007) [2023-12-26 01:26:04,458][123091] Updated weights for policy 0, policy_version 231899 (0.0008) [2023-12-26 01:26:04,495][123090] Updated weights for policy 1, policy_version 230831 (0.0008) [2023-12-26 01:26:04,525][123091] Updated weights for policy 0, policy_version 231909 (0.0009) [2023-12-26 01:26:04,561][123090] Updated weights for policy 1, policy_version 230841 (0.0010) [2023-12-26 01:26:04,586][123091] Updated weights for policy 0, policy_version 231919 (0.0008) [2023-12-26 01:26:05,370][123091] Updated weights for policy 0, policy_version 231929 (0.0007) [2023-12-26 01:26:05,384][123090] Updated weights for policy 1, policy_version 230851 (0.0008) [2023-12-26 01:26:05,430][123091] Updated weights for policy 0, policy_version 231939 (0.0007) [2023-12-26 01:26:05,451][123090] Updated weights for policy 1, policy_version 230861 (0.0009) [2023-12-26 01:26:05,491][123091] Updated weights for policy 0, policy_version 231949 (0.0007) [2023-12-26 01:26:05,517][123090] Updated weights for policy 1, policy_version 230871 (0.0008) [2023-12-26 01:26:06,183][123090] Updated weights for policy 1, policy_version 230881 (0.0006) [2023-12-26 01:26:06,241][123091] Updated weights for policy 0, policy_version 231959 (0.0009) [2023-12-26 01:26:06,250][123090] Updated weights for policy 1, policy_version 230891 (0.0009) [2023-12-26 01:26:06,294][123091] Updated weights for policy 0, policy_version 231969 (0.0010) [2023-12-26 01:26:06,312][123090] Updated weights for policy 1, policy_version 230901 (0.0008) [2023-12-26 01:26:06,341][123091] Updated weights for policy 0, policy_version 231979 (0.0009) [2023-12-26 01:26:06,377][123090] Updated weights for policy 1, policy_version 230911 (0.0006) [2023-12-26 01:26:07,175][123090] Updated weights for policy 1, policy_version 230921 (0.0009) [2023-12-26 01:26:07,239][123090] Updated weights for policy 1, policy_version 230931 (0.0010) [2023-12-26 01:26:07,241][123091] Updated weights for policy 0, policy_version 231989 (0.0007) [2023-12-26 01:26:07,288][123090] Updated weights for policy 1, policy_version 230941 (0.0007) [2023-12-26 01:26:07,294][123091] Updated weights for policy 0, policy_version 231999 (0.0007) [2023-12-26 01:26:07,349][123091] Updated weights for policy 0, policy_version 232009 (0.0010) [2023-12-26 01:26:08,107][123090] Updated weights for policy 1, policy_version 230951 (0.0009) [2023-12-26 01:26:08,109][123091] Updated weights for policy 0, policy_version 232019 (0.0008) [2023-12-26 01:26:08,164][123091] Updated weights for policy 0, policy_version 232029 (0.0005) [2023-12-26 01:26:08,170][123090] Updated weights for policy 1, policy_version 230961 (0.0008) [2023-12-26 01:26:08,223][123091] Updated weights for policy 0, policy_version 232039 (0.0005) [2023-12-26 01:26:08,224][123090] Updated weights for policy 1, policy_version 230971 (0.0008) [2023-12-26 01:26:08,784][121949] Fps is (10 sec: 18024.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 118538240. Throughput: 0: 9002.2, 1: 8950.4. Samples: 118515228. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:08,785][121949] Avg episode reward: [(0, '6118.875'), (1, '5514.417')] [2023-12-26 01:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000232048_59408384.pth... [2023-12-26 01:26:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000230976_59129856.pth... [2023-12-26 01:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000230992_59138048.pth [2023-12-26 01:26:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000229920_58859520.pth [2023-12-26 01:26:09,059][123091] Updated weights for policy 0, policy_version 232049 (0.0006) [2023-12-26 01:26:09,066][123090] Updated weights for policy 1, policy_version 230981 (0.0008) [2023-12-26 01:26:09,121][123091] Updated weights for policy 0, policy_version 232059 (0.0009) [2023-12-26 01:26:09,123][123090] Updated weights for policy 1, policy_version 230991 (0.0006) [2023-12-26 01:26:09,176][123090] Updated weights for policy 1, policy_version 231001 (0.0005) [2023-12-26 01:26:09,179][123091] Updated weights for policy 0, policy_version 232069 (0.0008) [2023-12-26 01:26:09,244][123091] Updated weights for policy 0, policy_version 232079 (0.0008) [2023-12-26 01:26:10,027][123090] Updated weights for policy 1, policy_version 231011 (0.0007) [2023-12-26 01:26:10,101][123090] Updated weights for policy 1, policy_version 231021 (0.0006) [2023-12-26 01:26:10,116][123091] Updated weights for policy 0, policy_version 232089 (0.0010) [2023-12-26 01:26:10,179][123090] Updated weights for policy 1, policy_version 231031 (0.0008) [2023-12-26 01:26:10,185][123091] Updated weights for policy 0, policy_version 232099 (0.0011) [2023-12-26 01:26:10,253][123091] Updated weights for policy 0, policy_version 232109 (0.0011) [2023-12-26 01:26:10,958][123090] Updated weights for policy 1, policy_version 231041 (0.0010) [2023-12-26 01:26:11,022][123090] Updated weights for policy 1, policy_version 231051 (0.0006) [2023-12-26 01:26:11,028][123091] Updated weights for policy 0, policy_version 232119 (0.0007) [2023-12-26 01:26:11,089][123090] Updated weights for policy 1, policy_version 231061 (0.0007) [2023-12-26 01:26:11,090][123091] Updated weights for policy 0, policy_version 232129 (0.0011) [2023-12-26 01:26:11,158][123091] Updated weights for policy 0, policy_version 232139 (0.0006) [2023-12-26 01:26:11,161][123090] Updated weights for policy 1, policy_version 231071 (0.0008) [2023-12-26 01:26:11,992][123090] Updated weights for policy 1, policy_version 231081 (0.0011) [2023-12-26 01:26:12,042][123091] Updated weights for policy 0, policy_version 232149 (0.0008) [2023-12-26 01:26:12,052][123090] Updated weights for policy 1, policy_version 231091 (0.0010) [2023-12-26 01:26:12,106][123091] Updated weights for policy 0, policy_version 232159 (0.0006) [2023-12-26 01:26:12,116][123090] Updated weights for policy 1, policy_version 231101 (0.0011) [2023-12-26 01:26:12,172][123091] Updated weights for policy 0, policy_version 232169 (0.0008) [2023-12-26 01:26:12,953][123090] Updated weights for policy 1, policy_version 231111 (0.0008) [2023-12-26 01:26:13,009][123091] Updated weights for policy 0, policy_version 232179 (0.0009) [2023-12-26 01:26:13,020][123090] Updated weights for policy 1, policy_version 231121 (0.0011) [2023-12-26 01:26:13,072][123091] Updated weights for policy 0, policy_version 232189 (0.0011) [2023-12-26 01:26:13,084][123090] Updated weights for policy 1, policy_version 231131 (0.0011) [2023-12-26 01:26:13,139][123091] Updated weights for policy 0, policy_version 232199 (0.0011) [2023-12-26 01:26:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 118620160. Throughput: 0: 8964.3, 1: 8976.9. Samples: 118617844. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:13,784][121949] Avg episode reward: [(0, '6088.700'), (1, '5386.746')] [2023-12-26 01:26:13,875][123090] Updated weights for policy 1, policy_version 231141 (0.0011) [2023-12-26 01:26:13,935][123090] Updated weights for policy 1, policy_version 231151 (0.0010) [2023-12-26 01:26:13,942][123091] Updated weights for policy 0, policy_version 232209 (0.0010) [2023-12-26 01:26:14,003][123091] Updated weights for policy 0, policy_version 232219 (0.0005) [2023-12-26 01:26:14,006][123090] Updated weights for policy 1, policy_version 231161 (0.0010) [2023-12-26 01:26:14,057][123091] Updated weights for policy 0, policy_version 232229 (0.0005) [2023-12-26 01:26:14,104][123091] Updated weights for policy 0, policy_version 232239 (0.0005) [2023-12-26 01:26:14,746][123091] Updated weights for policy 0, policy_version 232249 (0.0008) [2023-12-26 01:26:14,799][123090] Updated weights for policy 1, policy_version 231171 (0.0011) [2023-12-26 01:26:14,813][123091] Updated weights for policy 0, policy_version 232259 (0.0009) [2023-12-26 01:26:14,851][123090] Updated weights for policy 1, policy_version 231181 (0.0010) [2023-12-26 01:26:14,876][123091] Updated weights for policy 0, policy_version 232269 (0.0007) [2023-12-26 01:26:14,914][123090] Updated weights for policy 1, policy_version 231191 (0.0011) [2023-12-26 01:26:15,655][123091] Updated weights for policy 0, policy_version 232279 (0.0006) [2023-12-26 01:26:15,715][123090] Updated weights for policy 1, policy_version 231201 (0.0010) [2023-12-26 01:26:15,729][123091] Updated weights for policy 0, policy_version 232289 (0.0006) [2023-12-26 01:26:15,768][123090] Updated weights for policy 1, policy_version 231211 (0.0005) [2023-12-26 01:26:15,794][123091] Updated weights for policy 0, policy_version 232299 (0.0011) [2023-12-26 01:26:15,830][123090] Updated weights for policy 1, policy_version 231221 (0.0009) [2023-12-26 01:26:15,886][123090] Updated weights for policy 1, policy_version 231231 (0.0007) [2023-12-26 01:26:16,540][123091] Updated weights for policy 0, policy_version 232309 (0.0008) [2023-12-26 01:26:16,562][123090] Updated weights for policy 1, policy_version 231241 (0.0005) [2023-12-26 01:26:16,592][123091] Updated weights for policy 0, policy_version 232319 (0.0005) [2023-12-26 01:26:16,615][123090] Updated weights for policy 1, policy_version 231251 (0.0005) [2023-12-26 01:26:16,650][123091] Updated weights for policy 0, policy_version 232329 (0.0007) [2023-12-26 01:26:16,672][123090] Updated weights for policy 1, policy_version 231261 (0.0006) [2023-12-26 01:26:17,305][123090] Updated weights for policy 1, policy_version 231271 (0.0005) [2023-12-26 01:26:17,360][123090] Updated weights for policy 1, policy_version 231281 (0.0005) [2023-12-26 01:26:17,402][123091] Updated weights for policy 0, policy_version 232339 (0.0010) [2023-12-26 01:26:17,421][123090] Updated weights for policy 1, policy_version 231291 (0.0005) [2023-12-26 01:26:17,446][123091] Updated weights for policy 0, policy_version 232349 (0.0010) [2023-12-26 01:26:17,493][123091] Updated weights for policy 0, policy_version 232359 (0.0008) [2023-12-26 01:26:18,230][123090] Updated weights for policy 1, policy_version 231301 (0.0010) [2023-12-26 01:26:18,282][123090] Updated weights for policy 1, policy_version 231311 (0.0010) [2023-12-26 01:26:18,335][123090] Updated weights for policy 1, policy_version 231321 (0.0010) [2023-12-26 01:26:18,349][123091] Updated weights for policy 0, policy_version 232369 (0.0008) [2023-12-26 01:26:18,415][123091] Updated weights for policy 0, policy_version 232379 (0.0008) [2023-12-26 01:26:18,478][123091] Updated weights for policy 0, policy_version 232389 (0.0008) [2023-12-26 01:26:18,546][123091] Updated weights for policy 0, policy_version 232399 (0.0009) [2023-12-26 01:26:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 118718464. Throughput: 0: 8959.8, 1: 9080.1. Samples: 118726720. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:18,785][121949] Avg episode reward: [(0, '6121.408'), (1, '5307.926')] [2023-12-26 01:26:19,173][123090] Updated weights for policy 1, policy_version 231331 (0.0009) [2023-12-26 01:26:19,245][123090] Updated weights for policy 1, policy_version 231341 (0.0007) [2023-12-26 01:26:19,307][123090] Updated weights for policy 1, policy_version 231351 (0.0010) [2023-12-26 01:26:19,415][123091] Updated weights for policy 0, policy_version 232409 (0.0009) [2023-12-26 01:26:19,471][123091] Updated weights for policy 0, policy_version 232419 (0.0009) [2023-12-26 01:26:19,541][123091] Updated weights for policy 0, policy_version 232429 (0.0008) [2023-12-26 01:26:20,095][123090] Updated weights for policy 1, policy_version 231361 (0.0008) [2023-12-26 01:26:20,169][123090] Updated weights for policy 1, policy_version 231371 (0.0008) [2023-12-26 01:26:20,230][123090] Updated weights for policy 1, policy_version 231381 (0.0009) [2023-12-26 01:26:20,288][123090] Updated weights for policy 1, policy_version 231391 (0.0009) [2023-12-26 01:26:20,407][123091] Updated weights for policy 0, policy_version 232439 (0.0010) [2023-12-26 01:26:20,477][123091] Updated weights for policy 0, policy_version 232449 (0.0009) [2023-12-26 01:26:20,544][123091] Updated weights for policy 0, policy_version 232459 (0.0009) [2023-12-26 01:26:21,149][123090] Updated weights for policy 1, policy_version 231401 (0.0007) [2023-12-26 01:26:21,209][123090] Updated weights for policy 1, policy_version 231411 (0.0006) [2023-12-26 01:26:21,276][123090] Updated weights for policy 1, policy_version 231421 (0.0009) [2023-12-26 01:26:21,393][123091] Updated weights for policy 0, policy_version 232469 (0.0009) [2023-12-26 01:26:21,471][123091] Updated weights for policy 0, policy_version 232479 (0.0009) [2023-12-26 01:26:21,539][123091] Updated weights for policy 0, policy_version 232489 (0.0009) [2023-12-26 01:26:22,126][123090] Updated weights for policy 1, policy_version 231431 (0.0009) [2023-12-26 01:26:22,195][123090] Updated weights for policy 1, policy_version 231441 (0.0009) [2023-12-26 01:26:22,255][123090] Updated weights for policy 1, policy_version 231451 (0.0009) [2023-12-26 01:26:22,386][123091] Updated weights for policy 0, policy_version 232499 (0.0009) [2023-12-26 01:26:22,451][123091] Updated weights for policy 0, policy_version 232509 (0.0010) [2023-12-26 01:26:22,515][123091] Updated weights for policy 0, policy_version 232519 (0.0010) [2023-12-26 01:26:23,085][123090] Updated weights for policy 1, policy_version 231461 (0.0007) [2023-12-26 01:26:23,145][123090] Updated weights for policy 1, policy_version 231471 (0.0005) [2023-12-26 01:26:23,210][123090] Updated weights for policy 1, policy_version 231481 (0.0006) [2023-12-26 01:26:23,387][123091] Updated weights for policy 0, policy_version 232529 (0.0010) [2023-12-26 01:26:23,460][123091] Updated weights for policy 0, policy_version 232539 (0.0009) [2023-12-26 01:26:23,526][123091] Updated weights for policy 0, policy_version 232549 (0.0009) [2023-12-26 01:26:23,588][123091] Updated weights for policy 0, policy_version 232559 (0.0010) [2023-12-26 01:26:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 118800384. Throughput: 0: 8881.3, 1: 8993.4. Samples: 118776976. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:23,784][121949] Avg episode reward: [(0, '6189.033'), (1, '5066.287')] [2023-12-26 01:26:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000231488_59260928.pth... [2023-12-26 01:26:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000232560_59539456.pth... [2023-12-26 01:26:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000230464_58998784.pth [2023-12-26 01:26:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000231536_59277312.pth [2023-12-26 01:26:23,880][123090] Updated weights for policy 1, policy_version 231491 (0.0007) [2023-12-26 01:26:23,944][123090] Updated weights for policy 1, policy_version 231501 (0.0010) [2023-12-26 01:26:24,007][123090] Updated weights for policy 1, policy_version 231511 (0.0010) [2023-12-26 01:26:24,412][123091] Updated weights for policy 0, policy_version 232569 (0.0006) [2023-12-26 01:26:24,472][123091] Updated weights for policy 0, policy_version 232579 (0.0005) [2023-12-26 01:26:24,543][123091] Updated weights for policy 0, policy_version 232589 (0.0009) [2023-12-26 01:26:24,744][123090] Updated weights for policy 1, policy_version 231521 (0.0006) [2023-12-26 01:26:24,797][123090] Updated weights for policy 1, policy_version 231531 (0.0008) [2023-12-26 01:26:24,848][123090] Updated weights for policy 1, policy_version 231541 (0.0005) [2023-12-26 01:26:24,908][123090] Updated weights for policy 1, policy_version 231551 (0.0007) [2023-12-26 01:26:25,310][123091] Updated weights for policy 0, policy_version 232599 (0.0010) [2023-12-26 01:26:25,365][123091] Updated weights for policy 0, policy_version 232611 (0.0011) [2023-12-26 01:26:25,430][123091] Updated weights for policy 0, policy_version 232621 (0.0009) [2023-12-26 01:26:25,635][123090] Updated weights for policy 1, policy_version 231561 (0.0010) [2023-12-26 01:26:25,682][123090] Updated weights for policy 1, policy_version 231571 (0.0010) [2023-12-26 01:26:25,745][123090] Updated weights for policy 1, policy_version 231581 (0.0010) [2023-12-26 01:26:26,301][123091] Updated weights for policy 0, policy_version 232631 (0.0010) [2023-12-26 01:26:26,352][123091] Updated weights for policy 0, policy_version 232641 (0.0010) [2023-12-26 01:26:26,400][123091] Updated weights for policy 0, policy_version 232651 (0.0010) [2023-12-26 01:26:26,560][123090] Updated weights for policy 1, policy_version 231591 (0.0007) [2023-12-26 01:26:26,624][123090] Updated weights for policy 1, policy_version 231601 (0.0005) [2023-12-26 01:26:26,681][123090] Updated weights for policy 1, policy_version 231611 (0.0005) [2023-12-26 01:26:27,241][123091] Updated weights for policy 0, policy_version 232661 (0.0010) [2023-12-26 01:26:27,280][123090] Updated weights for policy 1, policy_version 231621 (0.0005) [2023-12-26 01:26:27,300][123091] Updated weights for policy 0, policy_version 232671 (0.0011) [2023-12-26 01:26:27,339][123090] Updated weights for policy 1, policy_version 231631 (0.0005) [2023-12-26 01:26:27,359][123091] Updated weights for policy 0, policy_version 232681 (0.0011) [2023-12-26 01:26:27,386][123090] Updated weights for policy 1, policy_version 231641 (0.0006) [2023-12-26 01:26:28,042][123091] Updated weights for policy 0, policy_version 232691 (0.0009) [2023-12-26 01:26:28,054][123090] Updated weights for policy 1, policy_version 231651 (0.0006) [2023-12-26 01:26:28,093][123091] Updated weights for policy 0, policy_version 232701 (0.0005) [2023-12-26 01:26:28,118][123090] Updated weights for policy 1, policy_version 231661 (0.0005) [2023-12-26 01:26:28,149][123091] Updated weights for policy 0, policy_version 232711 (0.0005) [2023-12-26 01:26:28,172][123090] Updated weights for policy 1, policy_version 231671 (0.0005) [2023-12-26 01:26:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 118890496. Throughput: 0: 8852.6, 1: 9068.6. Samples: 118884872. Policy #0 lag: (min: 22.0, avg: 35.8, max: 54.0) [2023-12-26 01:26:28,785][121949] Avg episode reward: [(0, '6193.024'), (1, '4844.722')] [2023-12-26 01:26:28,849][123091] Updated weights for policy 0, policy_version 232721 (0.0006) [2023-12-26 01:26:28,910][123091] Updated weights for policy 0, policy_version 232731 (0.0010) [2023-12-26 01:26:28,976][123091] Updated weights for policy 0, policy_version 232741 (0.0009) [2023-12-26 01:26:28,994][123090] Updated weights for policy 1, policy_version 231681 (0.0007) [2023-12-26 01:26:29,037][123091] Updated weights for policy 0, policy_version 232751 (0.0008) [2023-12-26 01:26:29,063][123090] Updated weights for policy 1, policy_version 231691 (0.0008) [2023-12-26 01:26:29,134][123090] Updated weights for policy 1, policy_version 231701 (0.0006) [2023-12-26 01:26:29,199][123090] Updated weights for policy 1, policy_version 231711 (0.0008) [2023-12-26 01:26:29,810][123091] Updated weights for policy 0, policy_version 232761 (0.0011) [2023-12-26 01:26:29,875][123091] Updated weights for policy 0, policy_version 232771 (0.0010) [2023-12-26 01:26:29,932][123090] Updated weights for policy 1, policy_version 231721 (0.0010) [2023-12-26 01:26:29,944][123091] Updated weights for policy 0, policy_version 232781 (0.0011) [2023-12-26 01:26:29,996][123090] Updated weights for policy 1, policy_version 231731 (0.0010) [2023-12-26 01:26:30,066][123090] Updated weights for policy 1, policy_version 231741 (0.0010) [2023-12-26 01:26:30,784][123091] Updated weights for policy 0, policy_version 232791 (0.0011) [2023-12-26 01:26:30,790][123090] Updated weights for policy 1, policy_version 231751 (0.0007) [2023-12-26 01:26:30,844][123091] Updated weights for policy 0, policy_version 232801 (0.0011) [2023-12-26 01:26:30,856][123090] Updated weights for policy 1, policy_version 231761 (0.0009) [2023-12-26 01:26:30,903][123091] Updated weights for policy 0, policy_version 232811 (0.0010) [2023-12-26 01:26:30,908][123090] Updated weights for policy 1, policy_version 231771 (0.0010) [2023-12-26 01:26:31,651][123091] Updated weights for policy 0, policy_version 232821 (0.0011) [2023-12-26 01:26:31,679][123090] Updated weights for policy 1, policy_version 231781 (0.0011) [2023-12-26 01:26:31,711][123091] Updated weights for policy 0, policy_version 232831 (0.0010) [2023-12-26 01:26:31,745][123090] Updated weights for policy 1, policy_version 231791 (0.0011) [2023-12-26 01:26:31,770][123091] Updated weights for policy 0, policy_version 232841 (0.0008) [2023-12-26 01:26:31,808][123090] Updated weights for policy 1, policy_version 231801 (0.0010) [2023-12-26 01:26:32,548][123091] Updated weights for policy 0, policy_version 232851 (0.0008) [2023-12-26 01:26:32,612][123091] Updated weights for policy 0, policy_version 232861 (0.0006) [2023-12-26 01:26:32,638][123090] Updated weights for policy 1, policy_version 231811 (0.0011) [2023-12-26 01:26:32,671][123091] Updated weights for policy 0, policy_version 232871 (0.0007) [2023-12-26 01:26:32,710][123090] Updated weights for policy 1, policy_version 231821 (0.0008) [2023-12-26 01:26:32,777][123090] Updated weights for policy 1, policy_version 231831 (0.0010) [2023-12-26 01:26:33,441][123091] Updated weights for policy 0, policy_version 232881 (0.0006) [2023-12-26 01:26:33,511][123091] Updated weights for policy 0, policy_version 232891 (0.0005) [2023-12-26 01:26:33,562][123090] Updated weights for policy 1, policy_version 231841 (0.0009) [2023-12-26 01:26:33,576][123091] Updated weights for policy 0, policy_version 232901 (0.0007) [2023-12-26 01:26:33,622][123090] Updated weights for policy 1, policy_version 231851 (0.0008) [2023-12-26 01:26:33,629][123091] Updated weights for policy 0, policy_version 232911 (0.0006) [2023-12-26 01:26:33,679][123090] Updated weights for policy 1, policy_version 231861 (0.0008) [2023-12-26 01:26:33,731][123090] Updated weights for policy 1, policy_version 231871 (0.0010) [2023-12-26 01:26:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 118988800. Throughput: 0: 8882.9, 1: 9062.1. Samples: 118994776. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:33,785][121949] Avg episode reward: [(0, '6116.324'), (1, '4929.374')] [2023-12-26 01:26:34,269][123091] Updated weights for policy 0, policy_version 232921 (0.0008) [2023-12-26 01:26:34,340][123091] Updated weights for policy 0, policy_version 232931 (0.0008) [2023-12-26 01:26:34,408][123091] Updated weights for policy 0, policy_version 232941 (0.0008) [2023-12-26 01:26:34,626][123090] Updated weights for policy 1, policy_version 231881 (0.0009) [2023-12-26 01:26:34,686][123090] Updated weights for policy 1, policy_version 231891 (0.0008) [2023-12-26 01:26:34,751][123090] Updated weights for policy 1, policy_version 231901 (0.0009) [2023-12-26 01:26:35,202][123091] Updated weights for policy 0, policy_version 232951 (0.0009) [2023-12-26 01:26:35,245][123091] Updated weights for policy 0, policy_version 232961 (0.0010) [2023-12-26 01:26:35,296][123091] Updated weights for policy 0, policy_version 232971 (0.0010) [2023-12-26 01:26:35,594][123090] Updated weights for policy 1, policy_version 231911 (0.0009) [2023-12-26 01:26:35,654][123090] Updated weights for policy 1, policy_version 231921 (0.0009) [2023-12-26 01:26:35,717][123090] Updated weights for policy 1, policy_version 231931 (0.0008) [2023-12-26 01:26:36,093][123091] Updated weights for policy 0, policy_version 232981 (0.0008) [2023-12-26 01:26:36,167][123091] Updated weights for policy 0, policy_version 232991 (0.0008) [2023-12-26 01:26:36,238][123091] Updated weights for policy 0, policy_version 233001 (0.0011) [2023-12-26 01:26:36,558][123090] Updated weights for policy 1, policy_version 231941 (0.0007) [2023-12-26 01:26:36,632][123090] Updated weights for policy 1, policy_version 231951 (0.0006) [2023-12-26 01:26:36,691][123090] Updated weights for policy 1, policy_version 231961 (0.0006) [2023-12-26 01:26:36,959][123091] Updated weights for policy 0, policy_version 233011 (0.0009) [2023-12-26 01:26:37,026][123091] Updated weights for policy 0, policy_version 233021 (0.0012) [2023-12-26 01:26:37,082][123091] Updated weights for policy 0, policy_version 233031 (0.0005) [2023-12-26 01:26:37,454][123090] Updated weights for policy 1, policy_version 231971 (0.0007) [2023-12-26 01:26:37,525][123090] Updated weights for policy 1, policy_version 231981 (0.0011) [2023-12-26 01:26:37,589][123090] Updated weights for policy 1, policy_version 231991 (0.0011) [2023-12-26 01:26:37,865][123091] Updated weights for policy 0, policy_version 233041 (0.0006) [2023-12-26 01:26:37,927][123091] Updated weights for policy 0, policy_version 233051 (0.0010) [2023-12-26 01:26:37,985][123091] Updated weights for policy 0, policy_version 233061 (0.0010) [2023-12-26 01:26:38,036][123091] Updated weights for policy 0, policy_version 233071 (0.0010) [2023-12-26 01:26:38,348][123090] Updated weights for policy 1, policy_version 232001 (0.0010) [2023-12-26 01:26:38,414][123090] Updated weights for policy 1, policy_version 232011 (0.0010) [2023-12-26 01:26:38,475][123090] Updated weights for policy 1, policy_version 232021 (0.0009) [2023-12-26 01:26:38,534][123090] Updated weights for policy 1, policy_version 232031 (0.0010) [2023-12-26 01:26:38,781][123091] Updated weights for policy 0, policy_version 233081 (0.0010) [2023-12-26 01:26:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 119070720. Throughput: 0: 8880.9, 1: 9030.5. Samples: 119047332. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:38,784][121949] Avg episode reward: [(0, '6111.795'), (1, '5112.720')] [2023-12-26 01:26:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000232032_59400192.pth... [2023-12-26 01:26:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000230976_59129856.pth [2023-12-26 01:26:38,837][123091] Updated weights for policy 0, policy_version 233091 (0.0010) [2023-12-26 01:26:38,892][123091] Updated weights for policy 0, policy_version 233101 (0.0010) [2023-12-26 01:26:38,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000233104_59678720.pth... [2023-12-26 01:26:38,915][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000232048_59408384.pth [2023-12-26 01:26:39,217][123090] Updated weights for policy 1, policy_version 232041 (0.0008) [2023-12-26 01:26:39,289][123090] Updated weights for policy 1, policy_version 232051 (0.0011) [2023-12-26 01:26:39,359][123090] Updated weights for policy 1, policy_version 232061 (0.0010) [2023-12-26 01:26:39,738][123091] Updated weights for policy 0, policy_version 233111 (0.0010) [2023-12-26 01:26:39,801][123091] Updated weights for policy 0, policy_version 233121 (0.0010) [2023-12-26 01:26:39,872][123091] Updated weights for policy 0, policy_version 233131 (0.0011) [2023-12-26 01:26:40,193][123090] Updated weights for policy 1, policy_version 232071 (0.0008) [2023-12-26 01:26:40,260][123090] Updated weights for policy 1, policy_version 232081 (0.0010) [2023-12-26 01:26:40,329][123090] Updated weights for policy 1, policy_version 232091 (0.0010) [2023-12-26 01:26:40,587][123091] Updated weights for policy 0, policy_version 233141 (0.0008) [2023-12-26 01:26:40,653][123091] Updated weights for policy 0, policy_version 233151 (0.0009) [2023-12-26 01:26:40,713][123091] Updated weights for policy 0, policy_version 233161 (0.0011) [2023-12-26 01:26:41,150][123090] Updated weights for policy 1, policy_version 232101 (0.0009) [2023-12-26 01:26:41,233][123090] Updated weights for policy 1, policy_version 232111 (0.0009) [2023-12-26 01:26:41,295][123090] Updated weights for policy 1, policy_version 232121 (0.0009) [2023-12-26 01:26:41,519][123091] Updated weights for policy 0, policy_version 233171 (0.0011) [2023-12-26 01:26:41,576][123091] Updated weights for policy 0, policy_version 233181 (0.0011) [2023-12-26 01:26:41,637][123091] Updated weights for policy 0, policy_version 233191 (0.0010) [2023-12-26 01:26:42,103][123090] Updated weights for policy 1, policy_version 232131 (0.0010) [2023-12-26 01:26:42,163][123090] Updated weights for policy 1, policy_version 232141 (0.0010) [2023-12-26 01:26:42,241][123090] Updated weights for policy 1, policy_version 232151 (0.0010) [2023-12-26 01:26:42,445][123091] Updated weights for policy 0, policy_version 233201 (0.0011) [2023-12-26 01:26:42,506][123091] Updated weights for policy 0, policy_version 233211 (0.0009) [2023-12-26 01:26:42,563][123091] Updated weights for policy 0, policy_version 233221 (0.0009) [2023-12-26 01:26:42,633][123091] Updated weights for policy 0, policy_version 233231 (0.0006) [2023-12-26 01:26:43,050][123090] Updated weights for policy 1, policy_version 232161 (0.0009) [2023-12-26 01:26:43,105][123090] Updated weights for policy 1, policy_version 232171 (0.0010) [2023-12-26 01:26:43,167][123090] Updated weights for policy 1, policy_version 232181 (0.0010) [2023-12-26 01:26:43,211][123090] Updated weights for policy 1, policy_version 232191 (0.0010) [2023-12-26 01:26:43,313][123091] Updated weights for policy 0, policy_version 233241 (0.0005) [2023-12-26 01:26:43,364][123091] Updated weights for policy 0, policy_version 233251 (0.0005) [2023-12-26 01:26:43,410][123091] Updated weights for policy 0, policy_version 233261 (0.0005) [2023-12-26 01:26:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 119160832. Throughput: 0: 8826.7, 1: 8946.3. Samples: 119153472. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:43,785][121949] Avg episode reward: [(0, '6143.284'), (1, '5256.116')] [2023-12-26 01:26:44,050][123090] Updated weights for policy 1, policy_version 232201 (0.0006) [2023-12-26 01:26:44,056][123091] Updated weights for policy 0, policy_version 233271 (0.0005) [2023-12-26 01:26:44,108][123091] Updated weights for policy 0, policy_version 233281 (0.0006) [2023-12-26 01:26:44,108][123090] Updated weights for policy 1, policy_version 232211 (0.0007) [2023-12-26 01:26:44,156][123091] Updated weights for policy 0, policy_version 233291 (0.0005) [2023-12-26 01:26:44,159][123090] Updated weights for policy 1, policy_version 232221 (0.0005) [2023-12-26 01:26:44,892][123090] Updated weights for policy 1, policy_version 232231 (0.0007) [2023-12-26 01:26:44,959][123090] Updated weights for policy 1, policy_version 232241 (0.0005) [2023-12-26 01:26:44,959][123091] Updated weights for policy 0, policy_version 233301 (0.0007) [2023-12-26 01:26:45,024][123091] Updated weights for policy 0, policy_version 233311 (0.0008) [2023-12-26 01:26:45,029][123090] Updated weights for policy 1, policy_version 232251 (0.0007) [2023-12-26 01:26:45,092][123091] Updated weights for policy 0, policy_version 233321 (0.0008) [2023-12-26 01:26:45,709][123090] Updated weights for policy 1, policy_version 232261 (0.0006) [2023-12-26 01:26:45,756][123090] Updated weights for policy 1, policy_version 232271 (0.0005) [2023-12-26 01:26:45,806][123091] Updated weights for policy 0, policy_version 233331 (0.0007) [2023-12-26 01:26:45,808][123090] Updated weights for policy 1, policy_version 232281 (0.0005) [2023-12-26 01:26:45,858][123091] Updated weights for policy 0, policy_version 233341 (0.0009) [2023-12-26 01:26:45,915][123091] Updated weights for policy 0, policy_version 233351 (0.0009) [2023-12-26 01:26:46,464][123090] Updated weights for policy 1, policy_version 232291 (0.0005) [2023-12-26 01:26:46,526][123090] Updated weights for policy 1, policy_version 232301 (0.0008) [2023-12-26 01:26:46,581][123090] Updated weights for policy 1, policy_version 232311 (0.0010) [2023-12-26 01:26:46,707][123091] Updated weights for policy 0, policy_version 233361 (0.0010) [2023-12-26 01:26:46,771][123091] Updated weights for policy 0, policy_version 233371 (0.0009) [2023-12-26 01:26:46,824][123091] Updated weights for policy 0, policy_version 233381 (0.0009) [2023-12-26 01:26:46,872][123091] Updated weights for policy 0, policy_version 233391 (0.0009) [2023-12-26 01:26:47,373][123090] Updated weights for policy 1, policy_version 232321 (0.0010) [2023-12-26 01:26:47,432][123090] Updated weights for policy 1, policy_version 232331 (0.0005) [2023-12-26 01:26:47,494][123090] Updated weights for policy 1, policy_version 232341 (0.0008) [2023-12-26 01:26:47,553][123090] Updated weights for policy 1, policy_version 232351 (0.0009) [2023-12-26 01:26:47,708][123091] Updated weights for policy 0, policy_version 233401 (0.0006) [2023-12-26 01:26:47,765][123091] Updated weights for policy 0, policy_version 233411 (0.0009) [2023-12-26 01:26:47,825][123091] Updated weights for policy 0, policy_version 233421 (0.0008) [2023-12-26 01:26:48,374][123090] Updated weights for policy 1, policy_version 232361 (0.0007) [2023-12-26 01:26:48,432][123090] Updated weights for policy 1, policy_version 232371 (0.0005) [2023-12-26 01:26:48,488][123090] Updated weights for policy 1, policy_version 232381 (0.0006) [2023-12-26 01:26:48,670][123091] Updated weights for policy 0, policy_version 233431 (0.0010) [2023-12-26 01:26:48,741][123091] Updated weights for policy 0, policy_version 233441 (0.0009) [2023-12-26 01:26:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 119250944. Throughput: 0: 8907.0, 1: 8967.8. Samples: 119265840. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:48,785][121949] Avg episode reward: [(0, '6078.447'), (1, '5149.847')] [2023-12-26 01:26:48,805][123091] Updated weights for policy 0, policy_version 233451 (0.0009) [2023-12-26 01:26:49,210][123090] Updated weights for policy 1, policy_version 232391 (0.0006) [2023-12-26 01:26:49,275][123090] Updated weights for policy 1, policy_version 232401 (0.0010) [2023-12-26 01:26:49,344][123090] Updated weights for policy 1, policy_version 232411 (0.0009) [2023-12-26 01:26:49,626][123091] Updated weights for policy 0, policy_version 233461 (0.0009) [2023-12-26 01:26:49,682][123091] Updated weights for policy 0, policy_version 233471 (0.0008) [2023-12-26 01:26:49,740][123091] Updated weights for policy 0, policy_version 233481 (0.0010) [2023-12-26 01:26:50,144][123090] Updated weights for policy 1, policy_version 232421 (0.0008) [2023-12-26 01:26:50,205][123090] Updated weights for policy 1, policy_version 232431 (0.0006) [2023-12-26 01:26:50,279][123090] Updated weights for policy 1, policy_version 232441 (0.0009) [2023-12-26 01:26:50,636][123091] Updated weights for policy 0, policy_version 233491 (0.0009) [2023-12-26 01:26:50,691][123091] Updated weights for policy 0, policy_version 233501 (0.0009) [2023-12-26 01:26:50,756][123091] Updated weights for policy 0, policy_version 233511 (0.0010) [2023-12-26 01:26:51,047][123090] Updated weights for policy 1, policy_version 232451 (0.0009) [2023-12-26 01:26:51,111][123090] Updated weights for policy 1, policy_version 232461 (0.0010) [2023-12-26 01:26:51,171][123090] Updated weights for policy 1, policy_version 232471 (0.0009) [2023-12-26 01:26:51,597][123091] Updated weights for policy 0, policy_version 233521 (0.0008) [2023-12-26 01:26:51,662][123091] Updated weights for policy 0, policy_version 233531 (0.0009) [2023-12-26 01:26:51,736][123091] Updated weights for policy 0, policy_version 233541 (0.0009) [2023-12-26 01:26:51,803][123091] Updated weights for policy 0, policy_version 233551 (0.0009) [2023-12-26 01:26:52,038][123090] Updated weights for policy 1, policy_version 232481 (0.0010) [2023-12-26 01:26:52,099][123090] Updated weights for policy 1, policy_version 232491 (0.0010) [2023-12-26 01:26:52,151][123090] Updated weights for policy 1, policy_version 232501 (0.0009) [2023-12-26 01:26:52,202][123090] Updated weights for policy 1, policy_version 232511 (0.0008) [2023-12-26 01:26:52,585][123091] Updated weights for policy 0, policy_version 233562 (0.0011) [2023-12-26 01:26:52,644][123091] Updated weights for policy 0, policy_version 233572 (0.0010) [2023-12-26 01:26:52,710][123091] Updated weights for policy 0, policy_version 233582 (0.0010) [2023-12-26 01:26:52,951][123090] Updated weights for policy 1, policy_version 232521 (0.0005) [2023-12-26 01:26:53,012][123090] Updated weights for policy 1, policy_version 232531 (0.0009) [2023-12-26 01:26:53,065][123090] Updated weights for policy 1, policy_version 232541 (0.0009) [2023-12-26 01:26:53,492][123091] Updated weights for policy 0, policy_version 233592 (0.0007) [2023-12-26 01:26:53,560][123091] Updated weights for policy 0, policy_version 233602 (0.0010) [2023-12-26 01:26:53,619][123091] Updated weights for policy 0, policy_version 233612 (0.0011) [2023-12-26 01:26:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 119341056. Throughput: 0: 8865.6, 1: 8952.2. Samples: 119317028. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:53,785][121949] Avg episode reward: [(0, '6046.459'), (1, '5097.968')] [2023-12-26 01:26:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000233616_59809792.pth... [2023-12-26 01:26:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000232544_59531264.pth... [2023-12-26 01:26:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000232560_59539456.pth [2023-12-26 01:26:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000231488_59260928.pth [2023-12-26 01:26:53,866][123090] Updated weights for policy 1, policy_version 232551 (0.0006) [2023-12-26 01:26:53,915][123090] Updated weights for policy 1, policy_version 232561 (0.0005) [2023-12-26 01:26:53,962][123090] Updated weights for policy 1, policy_version 232571 (0.0005) [2023-12-26 01:26:54,323][123091] Updated weights for policy 0, policy_version 233622 (0.0007) [2023-12-26 01:26:54,379][123091] Updated weights for policy 0, policy_version 233632 (0.0005) [2023-12-26 01:26:54,435][123091] Updated weights for policy 0, policy_version 233642 (0.0005) [2023-12-26 01:26:54,727][123090] Updated weights for policy 1, policy_version 232581 (0.0007) [2023-12-26 01:26:54,779][123090] Updated weights for policy 1, policy_version 232591 (0.0009) [2023-12-26 01:26:54,836][123090] Updated weights for policy 1, policy_version 232601 (0.0008) [2023-12-26 01:26:55,154][123091] Updated weights for policy 0, policy_version 233652 (0.0007) [2023-12-26 01:26:55,226][123091] Updated weights for policy 0, policy_version 233662 (0.0010) [2023-12-26 01:26:55,291][123091] Updated weights for policy 0, policy_version 233672 (0.0009) [2023-12-26 01:26:55,616][123090] Updated weights for policy 1, policy_version 232611 (0.0010) [2023-12-26 01:26:55,676][123090] Updated weights for policy 1, policy_version 232621 (0.0009) [2023-12-26 01:26:55,738][123090] Updated weights for policy 1, policy_version 232631 (0.0010) [2023-12-26 01:26:55,993][123091] Updated weights for policy 0, policy_version 233682 (0.0008) [2023-12-26 01:26:56,046][123091] Updated weights for policy 0, policy_version 233692 (0.0006) [2023-12-26 01:26:56,095][123091] Updated weights for policy 0, policy_version 233702 (0.0009) [2023-12-26 01:26:56,149][123091] Updated weights for policy 0, policy_version 233712 (0.0010) [2023-12-26 01:26:56,611][123090] Updated weights for policy 1, policy_version 232642 (0.0010) [2023-12-26 01:26:56,658][123090] Updated weights for policy 1, policy_version 232652 (0.0008) [2023-12-26 01:26:56,704][123090] Updated weights for policy 1, policy_version 232662 (0.0009) [2023-12-26 01:26:56,759][123090] Updated weights for policy 1, policy_version 232672 (0.0010) [2023-12-26 01:26:56,977][123091] Updated weights for policy 0, policy_version 233722 (0.0009) [2023-12-26 01:26:57,035][123091] Updated weights for policy 0, policy_version 233732 (0.0007) [2023-12-26 01:26:57,088][123091] Updated weights for policy 0, policy_version 233742 (0.0006) [2023-12-26 01:26:57,517][123090] Updated weights for policy 1, policy_version 232682 (0.0009) [2023-12-26 01:26:57,588][123090] Updated weights for policy 1, policy_version 232692 (0.0006) [2023-12-26 01:26:57,652][123090] Updated weights for policy 1, policy_version 232702 (0.0006) [2023-12-26 01:26:57,825][123091] Updated weights for policy 0, policy_version 233752 (0.0009) [2023-12-26 01:26:57,878][123091] Updated weights for policy 0, policy_version 233762 (0.0007) [2023-12-26 01:26:57,937][123091] Updated weights for policy 0, policy_version 233772 (0.0005) [2023-12-26 01:26:58,341][123090] Updated weights for policy 1, policy_version 232712 (0.0007) [2023-12-26 01:26:58,419][123090] Updated weights for policy 1, policy_version 232722 (0.0010) [2023-12-26 01:26:58,495][123090] Updated weights for policy 1, policy_version 232732 (0.0011) [2023-12-26 01:26:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17886.2, 300 sec: 17828.0). Total num frames: 119431168. Throughput: 0: 8945.5, 1: 9008.9. Samples: 119425792. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:26:58,785][121949] Avg episode reward: [(0, '6021.016'), (1, '5049.019')] [2023-12-26 01:26:58,846][123091] Updated weights for policy 0, policy_version 233782 (0.0008) [2023-12-26 01:26:58,913][123091] Updated weights for policy 0, policy_version 233792 (0.0011) [2023-12-26 01:26:58,981][123091] Updated weights for policy 0, policy_version 233802 (0.0011) [2023-12-26 01:26:59,314][123090] Updated weights for policy 1, policy_version 232742 (0.0011) [2023-12-26 01:26:59,386][123090] Updated weights for policy 1, policy_version 232752 (0.0010) [2023-12-26 01:26:59,450][123090] Updated weights for policy 1, policy_version 232762 (0.0009) [2023-12-26 01:26:59,867][123091] Updated weights for policy 0, policy_version 233812 (0.0010) [2023-12-26 01:26:59,930][123091] Updated weights for policy 0, policy_version 233822 (0.0010) [2023-12-26 01:26:59,986][123091] Updated weights for policy 0, policy_version 233832 (0.0006) [2023-12-26 01:27:00,181][123090] Updated weights for policy 1, policy_version 232772 (0.0007) [2023-12-26 01:27:00,232][123090] Updated weights for policy 1, policy_version 232782 (0.0009) [2023-12-26 01:27:00,291][123090] Updated weights for policy 1, policy_version 232792 (0.0010) [2023-12-26 01:27:00,626][123091] Updated weights for policy 0, policy_version 233842 (0.0006) [2023-12-26 01:27:00,679][123091] Updated weights for policy 0, policy_version 233852 (0.0006) [2023-12-26 01:27:00,737][123091] Updated weights for policy 0, policy_version 233862 (0.0005) [2023-12-26 01:27:00,809][123091] Updated weights for policy 0, policy_version 233872 (0.0005) [2023-12-26 01:27:01,261][123090] Updated weights for policy 1, policy_version 232802 (0.0010) [2023-12-26 01:27:01,313][123090] Updated weights for policy 1, policy_version 232812 (0.0010) [2023-12-26 01:27:01,375][123090] Updated weights for policy 1, policy_version 232822 (0.0009) [2023-12-26 01:27:01,444][123090] Updated weights for policy 1, policy_version 232832 (0.0008) [2023-12-26 01:27:01,449][123091] Updated weights for policy 0, policy_version 233882 (0.0006) [2023-12-26 01:27:01,511][123091] Updated weights for policy 0, policy_version 233892 (0.0005) [2023-12-26 01:27:01,574][123091] Updated weights for policy 0, policy_version 233902 (0.0006) [2023-12-26 01:27:02,247][123090] Updated weights for policy 1, policy_version 232842 (0.0006) [2023-12-26 01:27:02,251][123091] Updated weights for policy 0, policy_version 233912 (0.0008) [2023-12-26 01:27:02,316][123091] Updated weights for policy 0, policy_version 233922 (0.0008) [2023-12-26 01:27:02,321][123090] Updated weights for policy 1, policy_version 232852 (0.0010) [2023-12-26 01:27:02,381][123091] Updated weights for policy 0, policy_version 233932 (0.0009) [2023-12-26 01:27:02,387][123090] Updated weights for policy 1, policy_version 232862 (0.0008) [2023-12-26 01:27:03,090][123090] Updated weights for policy 1, policy_version 232872 (0.0010) [2023-12-26 01:27:03,134][123091] Updated weights for policy 0, policy_version 233942 (0.0005) [2023-12-26 01:27:03,152][123090] Updated weights for policy 1, policy_version 232882 (0.0008) [2023-12-26 01:27:03,184][123091] Updated weights for policy 0, policy_version 233952 (0.0010) [2023-12-26 01:27:03,207][123090] Updated weights for policy 1, policy_version 232892 (0.0005) [2023-12-26 01:27:03,230][123091] Updated weights for policy 0, policy_version 233962 (0.0010) [2023-12-26 01:27:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 119521280. Throughput: 0: 8965.1, 1: 8993.3. Samples: 119534852. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:03,785][121949] Avg episode reward: [(0, '5918.061'), (1, '5059.291')] [2023-12-26 01:27:03,869][123090] Updated weights for policy 1, policy_version 232902 (0.0007) [2023-12-26 01:27:03,922][123090] Updated weights for policy 1, policy_version 232912 (0.0006) [2023-12-26 01:27:03,977][123090] Updated weights for policy 1, policy_version 232922 (0.0007) [2023-12-26 01:27:04,041][123091] Updated weights for policy 0, policy_version 233972 (0.0010) [2023-12-26 01:27:04,116][123091] Updated weights for policy 0, policy_version 233982 (0.0009) [2023-12-26 01:27:04,187][123091] Updated weights for policy 0, policy_version 233992 (0.0006) [2023-12-26 01:27:04,763][123090] Updated weights for policy 1, policy_version 232932 (0.0009) [2023-12-26 01:27:04,817][123090] Updated weights for policy 1, policy_version 232942 (0.0011) [2023-12-26 01:27:04,829][123091] Updated weights for policy 0, policy_version 234002 (0.0005) [2023-12-26 01:27:04,871][123090] Updated weights for policy 1, policy_version 232952 (0.0008) [2023-12-26 01:27:04,878][123091] Updated weights for policy 0, policy_version 234012 (0.0005) [2023-12-26 01:27:04,926][123091] Updated weights for policy 0, policy_version 234022 (0.0005) [2023-12-26 01:27:04,972][123091] Updated weights for policy 0, policy_version 234032 (0.0005) [2023-12-26 01:27:05,653][123091] Updated weights for policy 0, policy_version 234042 (0.0010) [2023-12-26 01:27:05,707][123091] Updated weights for policy 0, policy_version 234052 (0.0010) [2023-12-26 01:27:05,762][123091] Updated weights for policy 0, policy_version 234062 (0.0010) [2023-12-26 01:27:05,786][123090] Updated weights for policy 1, policy_version 232962 (0.0008) [2023-12-26 01:27:05,843][123090] Updated weights for policy 1, policy_version 232972 (0.0009) [2023-12-26 01:27:05,898][123090] Updated weights for policy 1, policy_version 232982 (0.0008) [2023-12-26 01:27:05,945][123090] Updated weights for policy 1, policy_version 232992 (0.0008) [2023-12-26 01:27:06,584][123091] Updated weights for policy 0, policy_version 234072 (0.0006) [2023-12-26 01:27:06,657][123091] Updated weights for policy 0, policy_version 234082 (0.0007) [2023-12-26 01:27:06,723][123091] Updated weights for policy 0, policy_version 234092 (0.0009) [2023-12-26 01:27:06,838][123090] Updated weights for policy 1, policy_version 233002 (0.0008) [2023-12-26 01:27:06,904][123090] Updated weights for policy 1, policy_version 233012 (0.0008) [2023-12-26 01:27:06,975][123090] Updated weights for policy 1, policy_version 233022 (0.0007) [2023-12-26 01:27:07,528][123091] Updated weights for policy 0, policy_version 234102 (0.0011) [2023-12-26 01:27:07,593][123091] Updated weights for policy 0, policy_version 234112 (0.0009) [2023-12-26 01:27:07,656][123091] Updated weights for policy 0, policy_version 234122 (0.0009) [2023-12-26 01:27:07,771][123090] Updated weights for policy 1, policy_version 233032 (0.0008) [2023-12-26 01:27:07,835][123090] Updated weights for policy 1, policy_version 233042 (0.0010) [2023-12-26 01:27:07,906][123090] Updated weights for policy 1, policy_version 233052 (0.0010) [2023-12-26 01:27:08,452][123091] Updated weights for policy 0, policy_version 234132 (0.0009) [2023-12-26 01:27:08,533][123091] Updated weights for policy 0, policy_version 234142 (0.0010) [2023-12-26 01:27:08,586][123091] Updated weights for policy 0, policy_version 234152 (0.0009) [2023-12-26 01:27:08,752][123090] Updated weights for policy 1, policy_version 233062 (0.0010) [2023-12-26 01:27:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 119611392. Throughput: 0: 9076.2, 1: 8975.3. Samples: 119589292. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:08,784][121949] Avg episode reward: [(0, '5820.612'), (1, '4975.335')] [2023-12-26 01:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000234160_59949056.pth... [2023-12-26 01:27:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000233104_59678720.pth [2023-12-26 01:27:08,807][123090] Updated weights for policy 1, policy_version 233072 (0.0008) [2023-12-26 01:27:08,862][123090] Updated weights for policy 1, policy_version 233082 (0.0010) [2023-12-26 01:27:08,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000233088_59670528.pth... [2023-12-26 01:27:08,895][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000232032_59400192.pth [2023-12-26 01:27:09,415][123091] Updated weights for policy 0, policy_version 234162 (0.0009) [2023-12-26 01:27:09,490][123091] Updated weights for policy 0, policy_version 234172 (0.0006) [2023-12-26 01:27:09,562][123091] Updated weights for policy 0, policy_version 234182 (0.0005) [2023-12-26 01:27:09,629][123091] Updated weights for policy 0, policy_version 234192 (0.0007) [2023-12-26 01:27:09,777][123090] Updated weights for policy 1, policy_version 233092 (0.0010) [2023-12-26 01:27:09,850][123090] Updated weights for policy 1, policy_version 233102 (0.0010) [2023-12-26 01:27:09,913][123090] Updated weights for policy 1, policy_version 233112 (0.0010) [2023-12-26 01:27:10,385][123091] Updated weights for policy 0, policy_version 234202 (0.0010) [2023-12-26 01:27:10,446][123091] Updated weights for policy 0, policy_version 234212 (0.0009) [2023-12-26 01:27:10,503][123091] Updated weights for policy 0, policy_version 234222 (0.0009) [2023-12-26 01:27:10,635][123090] Updated weights for policy 1, policy_version 233122 (0.0008) [2023-12-26 01:27:10,690][123090] Updated weights for policy 1, policy_version 233132 (0.0005) [2023-12-26 01:27:10,737][123090] Updated weights for policy 1, policy_version 233142 (0.0005) [2023-12-26 01:27:10,794][123090] Updated weights for policy 1, policy_version 233152 (0.0006) [2023-12-26 01:27:11,430][123091] Updated weights for policy 0, policy_version 234232 (0.0008) [2023-12-26 01:27:11,486][123091] Updated weights for policy 0, policy_version 234242 (0.0010) [2023-12-26 01:27:11,551][123091] Updated weights for policy 0, policy_version 234252 (0.0009) [2023-12-26 01:27:11,652][123090] Updated weights for policy 1, policy_version 233162 (0.0010) [2023-12-26 01:27:11,722][123090] Updated weights for policy 1, policy_version 233172 (0.0010) [2023-12-26 01:27:11,792][123090] Updated weights for policy 1, policy_version 233182 (0.0009) [2023-12-26 01:27:12,409][123091] Updated weights for policy 0, policy_version 234262 (0.0008) [2023-12-26 01:27:12,470][123091] Updated weights for policy 0, policy_version 234272 (0.0006) [2023-12-26 01:27:12,539][123091] Updated weights for policy 0, policy_version 234282 (0.0007) [2023-12-26 01:27:12,644][123090] Updated weights for policy 1, policy_version 233192 (0.0006) [2023-12-26 01:27:12,709][123090] Updated weights for policy 1, policy_version 233202 (0.0006) [2023-12-26 01:27:12,770][123090] Updated weights for policy 1, policy_version 233212 (0.0006) [2023-12-26 01:27:13,234][123091] Updated weights for policy 0, policy_version 234292 (0.0009) [2023-12-26 01:27:13,308][123091] Updated weights for policy 0, policy_version 234302 (0.0006) [2023-12-26 01:27:13,370][123091] Updated weights for policy 0, policy_version 234312 (0.0008) [2023-12-26 01:27:13,449][123090] Updated weights for policy 1, policy_version 233222 (0.0008) [2023-12-26 01:27:13,506][123090] Updated weights for policy 1, policy_version 233232 (0.0009) [2023-12-26 01:27:13,554][123090] Updated weights for policy 1, policy_version 233242 (0.0009) [2023-12-26 01:27:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 119701504. Throughput: 0: 9065.1, 1: 8842.0. Samples: 119690688. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:13,785][121949] Avg episode reward: [(0, '5835.005'), (1, '4901.085')] [2023-12-26 01:27:14,071][123091] Updated weights for policy 0, policy_version 234322 (0.0009) [2023-12-26 01:27:14,133][123091] Updated weights for policy 0, policy_version 234332 (0.0008) [2023-12-26 01:27:14,207][123091] Updated weights for policy 0, policy_version 234342 (0.0006) [2023-12-26 01:27:14,274][123091] Updated weights for policy 0, policy_version 234352 (0.0007) [2023-12-26 01:27:14,326][123090] Updated weights for policy 1, policy_version 233252 (0.0007) [2023-12-26 01:27:14,384][123090] Updated weights for policy 1, policy_version 233262 (0.0005) [2023-12-26 01:27:14,449][123090] Updated weights for policy 1, policy_version 233272 (0.0005) [2023-12-26 01:27:14,982][123091] Updated weights for policy 0, policy_version 234362 (0.0008) [2023-12-26 01:27:15,052][123091] Updated weights for policy 0, policy_version 234372 (0.0008) [2023-12-26 01:27:15,119][123091] Updated weights for policy 0, policy_version 234382 (0.0009) [2023-12-26 01:27:15,244][123090] Updated weights for policy 1, policy_version 233282 (0.0009) [2023-12-26 01:27:15,320][123090] Updated weights for policy 1, policy_version 233292 (0.0007) [2023-12-26 01:27:15,386][123090] Updated weights for policy 1, policy_version 233302 (0.0010) [2023-12-26 01:27:15,446][123090] Updated weights for policy 1, policy_version 233312 (0.0010) [2023-12-26 01:27:15,851][123091] Updated weights for policy 0, policy_version 234392 (0.0006) [2023-12-26 01:27:15,917][123091] Updated weights for policy 0, policy_version 234402 (0.0008) [2023-12-26 01:27:15,983][123091] Updated weights for policy 0, policy_version 234412 (0.0010) [2023-12-26 01:27:16,269][123090] Updated weights for policy 1, policy_version 233322 (0.0006) [2023-12-26 01:27:16,333][123090] Updated weights for policy 1, policy_version 233332 (0.0007) [2023-12-26 01:27:16,397][123090] Updated weights for policy 1, policy_version 233342 (0.0009) [2023-12-26 01:27:16,718][123091] Updated weights for policy 0, policy_version 234422 (0.0008) [2023-12-26 01:27:16,770][123091] Updated weights for policy 0, policy_version 234432 (0.0009) [2023-12-26 01:27:16,828][123091] Updated weights for policy 0, policy_version 234442 (0.0010) [2023-12-26 01:27:17,077][123090] Updated weights for policy 1, policy_version 233352 (0.0009) [2023-12-26 01:27:17,136][123090] Updated weights for policy 1, policy_version 233362 (0.0009) [2023-12-26 01:27:17,197][123090] Updated weights for policy 1, policy_version 233372 (0.0009) [2023-12-26 01:27:17,555][123091] Updated weights for policy 0, policy_version 234452 (0.0008) [2023-12-26 01:27:17,602][123091] Updated weights for policy 0, policy_version 234462 (0.0005) [2023-12-26 01:27:17,657][123091] Updated weights for policy 0, policy_version 234472 (0.0008) [2023-12-26 01:27:17,955][123090] Updated weights for policy 1, policy_version 233382 (0.0007) [2023-12-26 01:27:18,021][123090] Updated weights for policy 1, policy_version 233392 (0.0005) [2023-12-26 01:27:18,083][123090] Updated weights for policy 1, policy_version 233402 (0.0008) [2023-12-26 01:27:18,503][123091] Updated weights for policy 0, policy_version 234482 (0.0009) [2023-12-26 01:27:18,559][123091] Updated weights for policy 0, policy_version 234492 (0.0010) [2023-12-26 01:27:18,610][123091] Updated weights for policy 0, policy_version 234502 (0.0010) [2023-12-26 01:27:18,660][123091] Updated weights for policy 0, policy_version 234512 (0.0010) [2023-12-26 01:27:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 119791616. Throughput: 0: 9074.5, 1: 8858.9. Samples: 119801780. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:18,785][121949] Avg episode reward: [(0, '5835.027'), (1, '4849.458')] [2023-12-26 01:27:18,872][123090] Updated weights for policy 1, policy_version 233412 (0.0009) [2023-12-26 01:27:18,938][123090] Updated weights for policy 1, policy_version 233422 (0.0009) [2023-12-26 01:27:19,002][123090] Updated weights for policy 1, policy_version 233432 (0.0009) [2023-12-26 01:27:19,544][123091] Updated weights for policy 0, policy_version 234522 (0.0008) [2023-12-26 01:27:19,613][123091] Updated weights for policy 0, policy_version 234532 (0.0007) [2023-12-26 01:27:19,676][123091] Updated weights for policy 0, policy_version 234542 (0.0008) [2023-12-26 01:27:19,898][123090] Updated weights for policy 1, policy_version 233442 (0.0010) [2023-12-26 01:27:19,968][123090] Updated weights for policy 1, policy_version 233452 (0.0010) [2023-12-26 01:27:20,036][123090] Updated weights for policy 1, policy_version 233462 (0.0010) [2023-12-26 01:27:20,092][123090] Updated weights for policy 1, policy_version 233472 (0.0009) [2023-12-26 01:27:20,410][123091] Updated weights for policy 0, policy_version 234552 (0.0009) [2023-12-26 01:27:20,474][123091] Updated weights for policy 0, policy_version 234562 (0.0009) [2023-12-26 01:27:20,540][123091] Updated weights for policy 0, policy_version 234572 (0.0010) [2023-12-26 01:27:20,930][123090] Updated weights for policy 1, policy_version 233482 (0.0010) [2023-12-26 01:27:20,992][123090] Updated weights for policy 1, policy_version 233492 (0.0009) [2023-12-26 01:27:21,062][123090] Updated weights for policy 1, policy_version 233502 (0.0008) [2023-12-26 01:27:21,403][123091] Updated weights for policy 0, policy_version 234582 (0.0010) [2023-12-26 01:27:21,462][123091] Updated weights for policy 0, policy_version 234592 (0.0010) [2023-12-26 01:27:21,516][123091] Updated weights for policy 0, policy_version 234602 (0.0010) [2023-12-26 01:27:21,886][123090] Updated weights for policy 1, policy_version 233512 (0.0009) [2023-12-26 01:27:21,941][123090] Updated weights for policy 1, policy_version 233522 (0.0009) [2023-12-26 01:27:22,009][123090] Updated weights for policy 1, policy_version 233532 (0.0010) [2023-12-26 01:27:22,333][123091] Updated weights for policy 0, policy_version 234613 (0.0009) [2023-12-26 01:27:22,398][123091] Updated weights for policy 0, policy_version 234623 (0.0007) [2023-12-26 01:27:22,466][123091] Updated weights for policy 0, policy_version 234633 (0.0006) [2023-12-26 01:27:22,853][123090] Updated weights for policy 1, policy_version 233542 (0.0009) [2023-12-26 01:27:22,915][123090] Updated weights for policy 1, policy_version 233552 (0.0010) [2023-12-26 01:27:22,981][123090] Updated weights for policy 1, policy_version 233562 (0.0009) [2023-12-26 01:27:23,250][123091] Updated weights for policy 0, policy_version 234643 (0.0007) [2023-12-26 01:27:23,313][123091] Updated weights for policy 0, policy_version 234653 (0.0009) [2023-12-26 01:27:23,374][123091] Updated weights for policy 0, policy_version 234663 (0.0009) [2023-12-26 01:27:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 119873536. Throughput: 0: 9023.3, 1: 8862.1. Samples: 119852176. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:23,785][121949] Avg episode reward: [(0, '5900.990'), (1, '4764.639')] [2023-12-26 01:27:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000234672_60080128.pth... [2023-12-26 01:27:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000233616_59809792.pth [2023-12-26 01:27:23,814][123090] Updated weights for policy 1, policy_version 233572 (0.0009) [2023-12-26 01:27:23,871][123090] Updated weights for policy 1, policy_version 233582 (0.0008) [2023-12-26 01:27:23,923][123090] Updated weights for policy 1, policy_version 233592 (0.0009) [2023-12-26 01:27:23,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000233600_59801600.pth... [2023-12-26 01:27:23,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000232544_59531264.pth [2023-12-26 01:27:24,201][123091] Updated weights for policy 0, policy_version 234673 (0.0009) [2023-12-26 01:27:24,259][123091] Updated weights for policy 0, policy_version 234683 (0.0010) [2023-12-26 01:27:24,311][123091] Updated weights for policy 0, policy_version 234693 (0.0010) [2023-12-26 01:27:24,369][123091] Updated weights for policy 0, policy_version 234703 (0.0014) [2023-12-26 01:27:24,589][123090] Updated weights for policy 1, policy_version 233602 (0.0009) [2023-12-26 01:27:24,643][123090] Updated weights for policy 1, policy_version 233612 (0.0008) [2023-12-26 01:27:24,700][123090] Updated weights for policy 1, policy_version 233622 (0.0009) [2023-12-26 01:27:24,754][123090] Updated weights for policy 1, policy_version 233632 (0.0009) [2023-12-26 01:27:25,275][123091] Updated weights for policy 0, policy_version 234713 (0.0010) [2023-12-26 01:27:25,332][123091] Updated weights for policy 0, policy_version 234723 (0.0009) [2023-12-26 01:27:25,396][123091] Updated weights for policy 0, policy_version 234733 (0.0008) [2023-12-26 01:27:25,501][123090] Updated weights for policy 1, policy_version 233642 (0.0010) [2023-12-26 01:27:25,555][123090] Updated weights for policy 1, policy_version 233652 (0.0005) [2023-12-26 01:27:25,603][123090] Updated weights for policy 1, policy_version 233662 (0.0005) [2023-12-26 01:27:26,254][123091] Updated weights for policy 0, policy_version 234743 (0.0010) [2023-12-26 01:27:26,308][123091] Updated weights for policy 0, policy_version 234753 (0.0007) [2023-12-26 01:27:26,380][123091] Updated weights for policy 0, policy_version 234763 (0.0007) [2023-12-26 01:27:26,392][123090] Updated weights for policy 1, policy_version 233672 (0.0005) [2023-12-26 01:27:26,448][123090] Updated weights for policy 1, policy_version 233682 (0.0005) [2023-12-26 01:27:26,497][123090] Updated weights for policy 1, policy_version 233692 (0.0005) [2023-12-26 01:27:27,121][123091] Updated weights for policy 0, policy_version 234773 (0.0008) [2023-12-26 01:27:27,179][123091] Updated weights for policy 0, policy_version 234783 (0.0009) [2023-12-26 01:27:27,183][123090] Updated weights for policy 1, policy_version 233702 (0.0008) [2023-12-26 01:27:27,236][123090] Updated weights for policy 1, policy_version 233712 (0.0008) [2023-12-26 01:27:27,243][123091] Updated weights for policy 0, policy_version 234793 (0.0007) [2023-12-26 01:27:27,282][123090] Updated weights for policy 1, policy_version 233722 (0.0010) [2023-12-26 01:27:27,961][123091] Updated weights for policy 0, policy_version 234803 (0.0005) [2023-12-26 01:27:28,020][123091] Updated weights for policy 0, policy_version 234813 (0.0005) [2023-12-26 01:27:28,073][123091] Updated weights for policy 0, policy_version 234823 (0.0005) [2023-12-26 01:27:28,093][123090] Updated weights for policy 1, policy_version 233732 (0.0008) [2023-12-26 01:27:28,160][123090] Updated weights for policy 1, policy_version 233742 (0.0005) [2023-12-26 01:27:28,217][123090] Updated weights for policy 1, policy_version 233752 (0.0005) [2023-12-26 01:27:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 119963648. Throughput: 0: 8984.2, 1: 8906.1. Samples: 119958536. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:28,784][121949] Avg episode reward: [(0, '5992.700'), (1, '4709.102')] [2023-12-26 01:27:28,845][123091] Updated weights for policy 0, policy_version 234833 (0.0006) [2023-12-26 01:27:28,881][123090] Updated weights for policy 1, policy_version 233762 (0.0006) [2023-12-26 01:27:28,909][123091] Updated weights for policy 0, policy_version 234843 (0.0008) [2023-12-26 01:27:28,942][123090] Updated weights for policy 1, policy_version 233772 (0.0011) [2023-12-26 01:27:28,970][123091] Updated weights for policy 0, policy_version 234853 (0.0006) [2023-12-26 01:27:29,006][123090] Updated weights for policy 1, policy_version 233782 (0.0011) [2023-12-26 01:27:29,037][123091] Updated weights for policy 0, policy_version 234863 (0.0006) [2023-12-26 01:27:29,072][123090] Updated weights for policy 1, policy_version 233792 (0.0010) [2023-12-26 01:27:29,857][123091] Updated weights for policy 0, policy_version 234873 (0.0010) [2023-12-26 01:27:29,923][123091] Updated weights for policy 0, policy_version 234883 (0.0010) [2023-12-26 01:27:29,924][123090] Updated weights for policy 1, policy_version 233802 (0.0008) [2023-12-26 01:27:29,983][123091] Updated weights for policy 0, policy_version 234893 (0.0010) [2023-12-26 01:27:29,986][123090] Updated weights for policy 1, policy_version 233812 (0.0011) [2023-12-26 01:27:30,045][123090] Updated weights for policy 1, policy_version 233822 (0.0010) [2023-12-26 01:27:30,672][123091] Updated weights for policy 0, policy_version 234903 (0.0007) [2023-12-26 01:27:30,721][123091] Updated weights for policy 0, policy_version 234913 (0.0005) [2023-12-26 01:27:30,774][123091] Updated weights for policy 0, policy_version 234923 (0.0005) [2023-12-26 01:27:30,876][123090] Updated weights for policy 1, policy_version 233832 (0.0006) [2023-12-26 01:27:30,924][123090] Updated weights for policy 1, policy_version 233842 (0.0005) [2023-12-26 01:27:30,983][123090] Updated weights for policy 1, policy_version 233852 (0.0007) [2023-12-26 01:27:31,572][123091] Updated weights for policy 0, policy_version 234933 (0.0007) [2023-12-26 01:27:31,625][123091] Updated weights for policy 0, policy_version 234943 (0.0009) [2023-12-26 01:27:31,680][123091] Updated weights for policy 0, policy_version 234953 (0.0010) [2023-12-26 01:27:31,800][123090] Updated weights for policy 1, policy_version 233862 (0.0008) [2023-12-26 01:27:31,855][123090] Updated weights for policy 1, policy_version 233872 (0.0005) [2023-12-26 01:27:31,908][123090] Updated weights for policy 1, policy_version 233882 (0.0005) [2023-12-26 01:27:32,560][123091] Updated weights for policy 0, policy_version 234963 (0.0009) [2023-12-26 01:27:32,612][123091] Updated weights for policy 0, policy_version 234973 (0.0007) [2023-12-26 01:27:32,671][123090] Updated weights for policy 1, policy_version 233892 (0.0007) [2023-12-26 01:27:32,673][123091] Updated weights for policy 0, policy_version 234983 (0.0006) [2023-12-26 01:27:32,730][123090] Updated weights for policy 1, policy_version 233902 (0.0010) [2023-12-26 01:27:32,781][123090] Updated weights for policy 1, policy_version 233912 (0.0008) [2023-12-26 01:27:33,453][123091] Updated weights for policy 0, policy_version 234993 (0.0006) [2023-12-26 01:27:33,516][123091] Updated weights for policy 0, policy_version 235003 (0.0009) [2023-12-26 01:27:33,577][123091] Updated weights for policy 0, policy_version 235013 (0.0009) [2023-12-26 01:27:33,581][123090] Updated weights for policy 1, policy_version 233922 (0.0009) [2023-12-26 01:27:33,628][123091] Updated weights for policy 0, policy_version 235023 (0.0009) [2023-12-26 01:27:33,636][123090] Updated weights for policy 1, policy_version 233932 (0.0008) [2023-12-26 01:27:33,693][123090] Updated weights for policy 1, policy_version 233942 (0.0008) [2023-12-26 01:27:33,761][123090] Updated weights for policy 1, policy_version 233952 (0.0005) [2023-12-26 01:27:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 120061952. Throughput: 0: 8928.1, 1: 8860.8. Samples: 120066340. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:33,785][121949] Avg episode reward: [(0, '5961.447'), (1, '5038.117')] [2023-12-26 01:27:34,520][123091] Updated weights for policy 0, policy_version 235033 (0.0009) [2023-12-26 01:27:34,543][123090] Updated weights for policy 1, policy_version 233962 (0.0009) [2023-12-26 01:27:34,582][123091] Updated weights for policy 0, policy_version 235043 (0.0009) [2023-12-26 01:27:34,605][123090] Updated weights for policy 1, policy_version 233972 (0.0009) [2023-12-26 01:27:34,647][123091] Updated weights for policy 0, policy_version 235053 (0.0009) [2023-12-26 01:27:34,667][123090] Updated weights for policy 1, policy_version 233982 (0.0009) [2023-12-26 01:27:35,465][123091] Updated weights for policy 0, policy_version 235063 (0.0006) [2023-12-26 01:27:35,509][123090] Updated weights for policy 1, policy_version 233992 (0.0009) [2023-12-26 01:27:35,512][123091] Updated weights for policy 0, policy_version 235073 (0.0005) [2023-12-26 01:27:35,557][123090] Updated weights for policy 1, policy_version 234002 (0.0005) [2023-12-26 01:27:35,558][123091] Updated weights for policy 0, policy_version 235083 (0.0010) [2023-12-26 01:27:35,610][123090] Updated weights for policy 1, policy_version 234012 (0.0009) [2023-12-26 01:27:36,237][123091] Updated weights for policy 0, policy_version 235093 (0.0007) [2023-12-26 01:27:36,293][123091] Updated weights for policy 0, policy_version 235103 (0.0008) [2023-12-26 01:27:36,347][123091] Updated weights for policy 0, policy_version 235113 (0.0008) [2023-12-26 01:27:36,480][123090] Updated weights for policy 1, policy_version 234022 (0.0010) [2023-12-26 01:27:36,553][123090] Updated weights for policy 1, policy_version 234032 (0.0010) [2023-12-26 01:27:36,619][123090] Updated weights for policy 1, policy_version 234042 (0.0009) [2023-12-26 01:27:37,178][123091] Updated weights for policy 0, policy_version 235123 (0.0009) [2023-12-26 01:27:37,240][123091] Updated weights for policy 0, policy_version 235133 (0.0010) [2023-12-26 01:27:37,292][123091] Updated weights for policy 0, policy_version 235143 (0.0009) [2023-12-26 01:27:37,347][123090] Updated weights for policy 1, policy_version 234052 (0.0009) [2023-12-26 01:27:37,401][123090] Updated weights for policy 1, policy_version 234062 (0.0010) [2023-12-26 01:27:37,472][123090] Updated weights for policy 1, policy_version 234072 (0.0010) [2023-12-26 01:27:38,122][123091] Updated weights for policy 0, policy_version 235153 (0.0010) [2023-12-26 01:27:38,189][123091] Updated weights for policy 0, policy_version 235164 (0.0009) [2023-12-26 01:27:38,237][123091] Updated weights for policy 0, policy_version 235174 (0.0009) [2023-12-26 01:27:38,320][123090] Updated weights for policy 1, policy_version 234082 (0.0008) [2023-12-26 01:27:38,385][123090] Updated weights for policy 1, policy_version 234092 (0.0009) [2023-12-26 01:27:38,440][123090] Updated weights for policy 1, policy_version 234102 (0.0009) [2023-12-26 01:27:38,495][123090] Updated weights for policy 1, policy_version 234112 (0.0010) [2023-12-26 01:27:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 120143872. Throughput: 0: 8974.0, 1: 8846.5. Samples: 120118952. Policy #0 lag: (min: 6.0, avg: 17.5, max: 38.0) [2023-12-26 01:27:38,785][121949] Avg episode reward: [(0, '6001.584'), (1, '5173.115')] [2023-12-26 01:27:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000235184_60211200.pth... [2023-12-26 01:27:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000234112_59932672.pth... [2023-12-26 01:27:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000233088_59670528.pth [2023-12-26 01:27:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000234160_59949056.pth [2023-12-26 01:27:39,114][123091] Updated weights for policy 0, policy_version 235185 (0.0010) [2023-12-26 01:27:39,176][123091] Updated weights for policy 0, policy_version 235195 (0.0009) [2023-12-26 01:27:39,247][123091] Updated weights for policy 0, policy_version 235205 (0.0009) [2023-12-26 01:27:39,308][123091] Updated weights for policy 0, policy_version 235215 (0.0006) [2023-12-26 01:27:39,326][123090] Updated weights for policy 1, policy_version 234122 (0.0008) [2023-12-26 01:27:39,402][123090] Updated weights for policy 1, policy_version 234132 (0.0010) [2023-12-26 01:27:39,478][123090] Updated weights for policy 1, policy_version 234142 (0.0009) [2023-12-26 01:27:40,109][123091] Updated weights for policy 0, policy_version 235225 (0.0010) [2023-12-26 01:27:40,174][123091] Updated weights for policy 0, policy_version 235235 (0.0010) [2023-12-26 01:27:40,240][123091] Updated weights for policy 0, policy_version 235245 (0.0009) [2023-12-26 01:27:40,351][123090] Updated weights for policy 1, policy_version 234152 (0.0010) [2023-12-26 01:27:40,401][123090] Updated weights for policy 1, policy_version 234162 (0.0008) [2023-12-26 01:27:40,459][123090] Updated weights for policy 1, policy_version 234172 (0.0007) [2023-12-26 01:27:41,115][123091] Updated weights for policy 0, policy_version 235255 (0.0010) [2023-12-26 01:27:41,183][123091] Updated weights for policy 0, policy_version 235265 (0.0009) [2023-12-26 01:27:41,246][123091] Updated weights for policy 0, policy_version 235275 (0.0009) [2023-12-26 01:27:41,339][123090] Updated weights for policy 1, policy_version 234182 (0.0010) [2023-12-26 01:27:41,414][123090] Updated weights for policy 1, policy_version 234192 (0.0009) [2023-12-26 01:27:41,484][123090] Updated weights for policy 1, policy_version 234202 (0.0006) [2023-12-26 01:27:42,109][123091] Updated weights for policy 0, policy_version 235285 (0.0009) [2023-12-26 01:27:42,177][123091] Updated weights for policy 0, policy_version 235295 (0.0009) [2023-12-26 01:27:42,244][123091] Updated weights for policy 0, policy_version 235305 (0.0009) [2023-12-26 01:27:42,267][123090] Updated weights for policy 1, policy_version 234212 (0.0006) [2023-12-26 01:27:42,342][123090] Updated weights for policy 1, policy_version 234222 (0.0010) [2023-12-26 01:27:42,412][123090] Updated weights for policy 1, policy_version 234232 (0.0010) [2023-12-26 01:27:43,112][123091] Updated weights for policy 0, policy_version 235315 (0.0009) [2023-12-26 01:27:43,172][123091] Updated weights for policy 0, policy_version 235325 (0.0010) [2023-12-26 01:27:43,179][123090] Updated weights for policy 1, policy_version 234242 (0.0008) [2023-12-26 01:27:43,231][123091] Updated weights for policy 0, policy_version 235335 (0.0010) [2023-12-26 01:27:43,234][123090] Updated weights for policy 1, policy_version 234252 (0.0006) [2023-12-26 01:27:43,293][123090] Updated weights for policy 1, policy_version 234262 (0.0006) [2023-12-26 01:27:43,345][123090] Updated weights for policy 1, policy_version 234272 (0.0008) [2023-12-26 01:27:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 120225792. Throughput: 0: 8855.2, 1: 8781.4. Samples: 120219440. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:27:43,785][121949] Avg episode reward: [(0, '6050.752'), (1, '5277.359')] [2023-12-26 01:27:43,939][123091] Updated weights for policy 0, policy_version 235345 (0.0010) [2023-12-26 01:27:43,994][123091] Updated weights for policy 0, policy_version 235355 (0.0005) [2023-12-26 01:27:44,046][123091] Updated weights for policy 0, policy_version 235365 (0.0005) [2023-12-26 01:27:44,104][123091] Updated weights for policy 0, policy_version 235375 (0.0006) [2023-12-26 01:27:44,262][123090] Updated weights for policy 1, policy_version 234282 (0.0010) [2023-12-26 01:27:44,315][123090] Updated weights for policy 1, policy_version 234292 (0.0010) [2023-12-26 01:27:44,367][123090] Updated weights for policy 1, policy_version 234302 (0.0010) [2023-12-26 01:27:44,832][123091] Updated weights for policy 0, policy_version 235385 (0.0009) [2023-12-26 01:27:44,902][123091] Updated weights for policy 0, policy_version 235395 (0.0010) [2023-12-26 01:27:44,971][123091] Updated weights for policy 0, policy_version 235405 (0.0010) [2023-12-26 01:27:45,239][123090] Updated weights for policy 1, policy_version 234312 (0.0010) [2023-12-26 01:27:45,312][123090] Updated weights for policy 1, policy_version 234322 (0.0010) [2023-12-26 01:27:45,378][123090] Updated weights for policy 1, policy_version 234332 (0.0010) [2023-12-26 01:27:45,875][123091] Updated weights for policy 0, policy_version 235415 (0.0010) [2023-12-26 01:27:45,933][123091] Updated weights for policy 0, policy_version 235425 (0.0010) [2023-12-26 01:27:45,987][123091] Updated weights for policy 0, policy_version 235435 (0.0009) [2023-12-26 01:27:46,128][123090] Updated weights for policy 1, policy_version 234342 (0.0007) [2023-12-26 01:27:46,184][123090] Updated weights for policy 1, policy_version 234352 (0.0008) [2023-12-26 01:27:46,238][123090] Updated weights for policy 1, policy_version 234362 (0.0008) [2023-12-26 01:27:46,860][123091] Updated weights for policy 0, policy_version 235445 (0.0010) [2023-12-26 01:27:46,923][123091] Updated weights for policy 0, policy_version 235455 (0.0010) [2023-12-26 01:27:46,946][123090] Updated weights for policy 1, policy_version 234372 (0.0008) [2023-12-26 01:27:46,981][123091] Updated weights for policy 0, policy_version 235465 (0.0009) [2023-12-26 01:27:47,017][123090] Updated weights for policy 1, policy_version 234382 (0.0006) [2023-12-26 01:27:47,071][123090] Updated weights for policy 1, policy_version 234392 (0.0008) [2023-12-26 01:27:47,715][123091] Updated weights for policy 0, policy_version 235475 (0.0011) [2023-12-26 01:27:47,766][123091] Updated weights for policy 0, policy_version 235485 (0.0010) [2023-12-26 01:27:47,818][123091] Updated weights for policy 0, policy_version 235495 (0.0009) [2023-12-26 01:27:47,825][123090] Updated weights for policy 1, policy_version 234402 (0.0008) [2023-12-26 01:27:47,890][123090] Updated weights for policy 1, policy_version 234412 (0.0010) [2023-12-26 01:27:47,949][123090] Updated weights for policy 1, policy_version 234422 (0.0010) [2023-12-26 01:27:48,014][123090] Updated weights for policy 1, policy_version 234432 (0.0008) [2023-12-26 01:27:48,535][123091] Updated weights for policy 0, policy_version 235505 (0.0008) [2023-12-26 01:27:48,604][123091] Updated weights for policy 0, policy_version 235515 (0.0009) [2023-12-26 01:27:48,667][123091] Updated weights for policy 0, policy_version 235525 (0.0011) [2023-12-26 01:27:48,690][123090] Updated weights for policy 1, policy_version 234442 (0.0008) [2023-12-26 01:27:48,733][123091] Updated weights for policy 0, policy_version 235535 (0.0011) [2023-12-26 01:27:48,759][123090] Updated weights for policy 1, policy_version 234452 (0.0008) [2023-12-26 01:27:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 120315904. Throughput: 0: 8837.6, 1: 8766.2. Samples: 120327016. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:27:48,785][121949] Avg episode reward: [(0, '6063.384'), (1, '5445.141')] [2023-12-26 01:27:48,824][123090] Updated weights for policy 1, policy_version 234462 (0.0007) [2023-12-26 01:27:49,542][123091] Updated weights for policy 0, policy_version 235545 (0.0011) [2023-12-26 01:27:49,571][123090] Updated weights for policy 1, policy_version 234472 (0.0007) [2023-12-26 01:27:49,601][123091] Updated weights for policy 0, policy_version 235555 (0.0010) [2023-12-26 01:27:49,630][123090] Updated weights for policy 1, policy_version 234482 (0.0008) [2023-12-26 01:27:49,648][123091] Updated weights for policy 0, policy_version 235565 (0.0010) [2023-12-26 01:27:49,689][123090] Updated weights for policy 1, policy_version 234492 (0.0008) [2023-12-26 01:27:50,470][123091] Updated weights for policy 0, policy_version 235575 (0.0010) [2023-12-26 01:27:50,525][123091] Updated weights for policy 0, policy_version 235585 (0.0010) [2023-12-26 01:27:50,554][123090] Updated weights for policy 1, policy_version 234502 (0.0007) [2023-12-26 01:27:50,589][123091] Updated weights for policy 0, policy_version 235595 (0.0008) [2023-12-26 01:27:50,620][123090] Updated weights for policy 1, policy_version 234512 (0.0007) [2023-12-26 01:27:50,674][123090] Updated weights for policy 1, policy_version 234523 (0.0010) [2023-12-26 01:27:51,337][123091] Updated weights for policy 0, policy_version 235605 (0.0010) [2023-12-26 01:27:51,405][123091] Updated weights for policy 0, policy_version 235615 (0.0011) [2023-12-26 01:27:51,470][123091] Updated weights for policy 0, policy_version 235625 (0.0006) [2023-12-26 01:27:51,589][123090] Updated weights for policy 1, policy_version 234534 (0.0008) [2023-12-26 01:27:51,658][123090] Updated weights for policy 1, policy_version 234544 (0.0010) [2023-12-26 01:27:51,733][123090] Updated weights for policy 1, policy_version 234554 (0.0009) [2023-12-26 01:27:52,284][123091] Updated weights for policy 0, policy_version 235635 (0.0007) [2023-12-26 01:27:52,358][123091] Updated weights for policy 0, policy_version 235645 (0.0011) [2023-12-26 01:27:52,413][123091] Updated weights for policy 0, policy_version 235655 (0.0010) [2023-12-26 01:27:52,529][123090] Updated weights for policy 1, policy_version 234564 (0.0008) [2023-12-26 01:27:52,595][123090] Updated weights for policy 1, policy_version 234574 (0.0009) [2023-12-26 01:27:52,665][123090] Updated weights for policy 1, policy_version 234584 (0.0009) [2023-12-26 01:27:53,212][123091] Updated weights for policy 0, policy_version 235665 (0.0010) [2023-12-26 01:27:53,266][123091] Updated weights for policy 0, policy_version 235675 (0.0010) [2023-12-26 01:27:53,316][123091] Updated weights for policy 0, policy_version 235685 (0.0010) [2023-12-26 01:27:53,371][123091] Updated weights for policy 0, policy_version 235695 (0.0010) [2023-12-26 01:27:53,480][123090] Updated weights for policy 1, policy_version 234594 (0.0009) [2023-12-26 01:27:53,528][123090] Updated weights for policy 1, policy_version 234604 (0.0009) [2023-12-26 01:27:53,580][123090] Updated weights for policy 1, policy_version 234614 (0.0009) [2023-12-26 01:27:53,631][123090] Updated weights for policy 1, policy_version 234624 (0.0010) [2023-12-26 01:27:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 120406016. Throughput: 0: 8778.8, 1: 8779.1. Samples: 120379400. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:27:53,785][121949] Avg episode reward: [(0, '6114.581'), (1, '5457.391')] [2023-12-26 01:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000235696_60342272.pth... [2023-12-26 01:27:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000234624_60063744.pth... [2023-12-26 01:27:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000233600_59801600.pth [2023-12-26 01:27:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000234672_60080128.pth [2023-12-26 01:27:54,201][123091] Updated weights for policy 0, policy_version 235705 (0.0007) [2023-12-26 01:27:54,255][123091] Updated weights for policy 0, policy_version 235715 (0.0010) [2023-12-26 01:27:54,321][123091] Updated weights for policy 0, policy_version 235725 (0.0010) [2023-12-26 01:27:54,436][123090] Updated weights for policy 1, policy_version 234634 (0.0010) [2023-12-26 01:27:54,498][123090] Updated weights for policy 1, policy_version 234644 (0.0006) [2023-12-26 01:27:54,573][123090] Updated weights for policy 1, policy_version 234654 (0.0005) [2023-12-26 01:27:55,121][123091] Updated weights for policy 0, policy_version 235735 (0.0007) [2023-12-26 01:27:55,188][123091] Updated weights for policy 0, policy_version 235745 (0.0005) [2023-12-26 01:27:55,242][123090] Updated weights for policy 1, policy_version 234664 (0.0005) [2023-12-26 01:27:55,249][123091] Updated weights for policy 0, policy_version 235755 (0.0006) [2023-12-26 01:27:55,297][123090] Updated weights for policy 1, policy_version 234674 (0.0005) [2023-12-26 01:27:55,349][123090] Updated weights for policy 1, policy_version 234684 (0.0006) [2023-12-26 01:27:55,990][123091] Updated weights for policy 0, policy_version 235765 (0.0007) [2023-12-26 01:27:56,006][123090] Updated weights for policy 1, policy_version 234694 (0.0008) [2023-12-26 01:27:56,058][123091] Updated weights for policy 0, policy_version 235775 (0.0006) [2023-12-26 01:27:56,063][123090] Updated weights for policy 1, policy_version 234704 (0.0010) [2023-12-26 01:27:56,115][123091] Updated weights for policy 0, policy_version 235785 (0.0009) [2023-12-26 01:27:56,124][123090] Updated weights for policy 1, policy_version 234714 (0.0011) [2023-12-26 01:27:56,727][123091] Updated weights for policy 0, policy_version 235795 (0.0005) [2023-12-26 01:27:56,780][123091] Updated weights for policy 0, policy_version 235805 (0.0005) [2023-12-26 01:27:56,795][123090] Updated weights for policy 1, policy_version 234724 (0.0008) [2023-12-26 01:27:56,838][123091] Updated weights for policy 0, policy_version 235815 (0.0010) [2023-12-26 01:27:56,855][123090] Updated weights for policy 1, policy_version 234734 (0.0005) [2023-12-26 01:27:56,908][123090] Updated weights for policy 1, policy_version 234744 (0.0005) [2023-12-26 01:27:57,549][123091] Updated weights for policy 0, policy_version 235825 (0.0010) [2023-12-26 01:27:57,577][123090] Updated weights for policy 1, policy_version 234754 (0.0005) [2023-12-26 01:27:57,603][123091] Updated weights for policy 0, policy_version 235835 (0.0005) [2023-12-26 01:27:57,633][123090] Updated weights for policy 1, policy_version 234764 (0.0005) [2023-12-26 01:27:57,647][123091] Updated weights for policy 0, policy_version 235845 (0.0005) [2023-12-26 01:27:57,682][123090] Updated weights for policy 1, policy_version 234774 (0.0007) [2023-12-26 01:27:57,703][123091] Updated weights for policy 0, policy_version 235855 (0.0005) [2023-12-26 01:27:57,738][123090] Updated weights for policy 1, policy_version 234784 (0.0006) [2023-12-26 01:27:58,423][123091] Updated weights for policy 0, policy_version 235865 (0.0008) [2023-12-26 01:27:58,489][123090] Updated weights for policy 1, policy_version 234794 (0.0011) [2023-12-26 01:27:58,494][123091] Updated weights for policy 0, policy_version 235875 (0.0008) [2023-12-26 01:27:58,553][123090] Updated weights for policy 1, policy_version 234804 (0.0010) [2023-12-26 01:27:58,558][123091] Updated weights for policy 0, policy_version 235885 (0.0008) [2023-12-26 01:27:58,633][123090] Updated weights for policy 1, policy_version 234814 (0.0008) [2023-12-26 01:27:58,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 120504320. Throughput: 0: 8885.8, 1: 8917.7. Samples: 120491848. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:27:58,785][121949] Avg episode reward: [(0, '6069.242'), (1, '5401.429')] [2023-12-26 01:27:59,436][123091] Updated weights for policy 0, policy_version 235895 (0.0010) [2023-12-26 01:27:59,500][123091] Updated weights for policy 0, policy_version 235905 (0.0008) [2023-12-26 01:27:59,507][123090] Updated weights for policy 1, policy_version 234824 (0.0006) [2023-12-26 01:27:59,567][123090] Updated weights for policy 1, policy_version 234834 (0.0007) [2023-12-26 01:27:59,569][123091] Updated weights for policy 0, policy_version 235915 (0.0010) [2023-12-26 01:27:59,623][123090] Updated weights for policy 1, policy_version 234844 (0.0010) [2023-12-26 01:28:00,343][123091] Updated weights for policy 0, policy_version 235925 (0.0010) [2023-12-26 01:28:00,406][123091] Updated weights for policy 0, policy_version 235935 (0.0005) [2023-12-26 01:28:00,412][123090] Updated weights for policy 1, policy_version 234854 (0.0009) [2023-12-26 01:28:00,461][123090] Updated weights for policy 1, policy_version 234864 (0.0010) [2023-12-26 01:28:00,468][123091] Updated weights for policy 0, policy_version 235945 (0.0005) [2023-12-26 01:28:00,513][123090] Updated weights for policy 1, policy_version 234874 (0.0007) [2023-12-26 01:28:01,171][123091] Updated weights for policy 0, policy_version 235955 (0.0009) [2023-12-26 01:28:01,223][123091] Updated weights for policy 0, policy_version 235965 (0.0006) [2023-12-26 01:28:01,288][123091] Updated weights for policy 0, policy_version 235975 (0.0007) [2023-12-26 01:28:01,306][123090] Updated weights for policy 1, policy_version 234884 (0.0009) [2023-12-26 01:28:01,366][123090] Updated weights for policy 1, policy_version 234894 (0.0007) [2023-12-26 01:28:01,439][123090] Updated weights for policy 1, policy_version 234904 (0.0008) [2023-12-26 01:28:02,103][123091] Updated weights for policy 0, policy_version 235985 (0.0006) [2023-12-26 01:28:02,159][123091] Updated weights for policy 0, policy_version 235995 (0.0005) [2023-12-26 01:28:02,209][123090] Updated weights for policy 1, policy_version 234914 (0.0009) [2023-12-26 01:28:02,211][123091] Updated weights for policy 0, policy_version 236005 (0.0006) [2023-12-26 01:28:02,270][123090] Updated weights for policy 1, policy_version 234924 (0.0009) [2023-12-26 01:28:02,271][123091] Updated weights for policy 0, policy_version 236015 (0.0008) [2023-12-26 01:28:02,327][123090] Updated weights for policy 1, policy_version 234934 (0.0009) [2023-12-26 01:28:02,398][123090] Updated weights for policy 1, policy_version 234944 (0.0011) [2023-12-26 01:28:03,063][123091] Updated weights for policy 0, policy_version 236025 (0.0010) [2023-12-26 01:28:03,118][123091] Updated weights for policy 0, policy_version 236035 (0.0010) [2023-12-26 01:28:03,125][123090] Updated weights for policy 1, policy_version 234954 (0.0006) [2023-12-26 01:28:03,161][123091] Updated weights for policy 0, policy_version 236045 (0.0010) [2023-12-26 01:28:03,197][123090] Updated weights for policy 1, policy_version 234964 (0.0005) [2023-12-26 01:28:03,262][123090] Updated weights for policy 1, policy_version 234974 (0.0006) [2023-12-26 01:28:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 120586240. Throughput: 0: 8850.8, 1: 8914.4. Samples: 120601216. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:03,785][121949] Avg episode reward: [(0, '6030.844'), (1, '5316.368')] [2023-12-26 01:28:03,891][123091] Updated weights for policy 0, policy_version 236055 (0.0009) [2023-12-26 01:28:03,908][123090] Updated weights for policy 1, policy_version 234984 (0.0006) [2023-12-26 01:28:03,953][123091] Updated weights for policy 0, policy_version 236065 (0.0008) [2023-12-26 01:28:03,974][123090] Updated weights for policy 1, policy_version 234994 (0.0007) [2023-12-26 01:28:04,012][123091] Updated weights for policy 0, policy_version 236075 (0.0008) [2023-12-26 01:28:04,036][123090] Updated weights for policy 1, policy_version 235004 (0.0007) [2023-12-26 01:28:04,761][123091] Updated weights for policy 0, policy_version 236085 (0.0007) [2023-12-26 01:28:04,824][123091] Updated weights for policy 0, policy_version 236095 (0.0006) [2023-12-26 01:28:04,861][123090] Updated weights for policy 1, policy_version 235014 (0.0010) [2023-12-26 01:28:04,887][123091] Updated weights for policy 0, policy_version 236105 (0.0009) [2023-12-26 01:28:04,924][123090] Updated weights for policy 1, policy_version 235024 (0.0011) [2023-12-26 01:28:04,993][123090] Updated weights for policy 1, policy_version 235034 (0.0010) [2023-12-26 01:28:05,593][123090] Updated weights for policy 1, policy_version 235044 (0.0006) [2023-12-26 01:28:05,661][123090] Updated weights for policy 1, policy_version 235054 (0.0005) [2023-12-26 01:28:05,693][123091] Updated weights for policy 0, policy_version 236115 (0.0011) [2023-12-26 01:28:05,732][123090] Updated weights for policy 1, policy_version 235064 (0.0005) [2023-12-26 01:28:05,741][123091] Updated weights for policy 0, policy_version 236125 (0.0011) [2023-12-26 01:28:05,795][123091] Updated weights for policy 0, policy_version 236135 (0.0008) [2023-12-26 01:28:06,535][123090] Updated weights for policy 1, policy_version 235074 (0.0007) [2023-12-26 01:28:06,579][123091] Updated weights for policy 0, policy_version 236145 (0.0006) [2023-12-26 01:28:06,592][123090] Updated weights for policy 1, policy_version 235084 (0.0011) [2023-12-26 01:28:06,647][123091] Updated weights for policy 0, policy_version 236155 (0.0011) [2023-12-26 01:28:06,655][123090] Updated weights for policy 1, policy_version 235094 (0.0011) [2023-12-26 01:28:06,710][123091] Updated weights for policy 0, policy_version 236165 (0.0010) [2023-12-26 01:28:06,719][123090] Updated weights for policy 1, policy_version 235104 (0.0011) [2023-12-26 01:28:06,773][123091] Updated weights for policy 0, policy_version 236175 (0.0010) [2023-12-26 01:28:07,551][123090] Updated weights for policy 1, policy_version 235114 (0.0010) [2023-12-26 01:28:07,586][123091] Updated weights for policy 0, policy_version 236185 (0.0010) [2023-12-26 01:28:07,610][123090] Updated weights for policy 1, policy_version 235124 (0.0010) [2023-12-26 01:28:07,641][123091] Updated weights for policy 0, policy_version 236195 (0.0010) [2023-12-26 01:28:07,665][123090] Updated weights for policy 1, policy_version 235134 (0.0010) [2023-12-26 01:28:07,703][123091] Updated weights for policy 0, policy_version 236205 (0.0011) [2023-12-26 01:28:08,511][123090] Updated weights for policy 1, policy_version 235144 (0.0010) [2023-12-26 01:28:08,511][123091] Updated weights for policy 0, policy_version 236215 (0.0007) [2023-12-26 01:28:08,575][123090] Updated weights for policy 1, policy_version 235154 (0.0011) [2023-12-26 01:28:08,580][123091] Updated weights for policy 0, policy_version 236225 (0.0005) [2023-12-26 01:28:08,636][123090] Updated weights for policy 1, policy_version 235164 (0.0011) [2023-12-26 01:28:08,643][123091] Updated weights for policy 0, policy_version 236235 (0.0005) [2023-12-26 01:28:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 120684544. Throughput: 0: 8895.1, 1: 8967.7. Samples: 120656000. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:08,785][121949] Avg episode reward: [(0, '6067.484'), (1, '5293.307')] [2023-12-26 01:28:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000236240_60481536.pth... [2023-12-26 01:28:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000235168_60203008.pth... [2023-12-26 01:28:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000235184_60211200.pth [2023-12-26 01:28:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000234112_59932672.pth [2023-12-26 01:28:09,289][123091] Updated weights for policy 0, policy_version 236245 (0.0005) [2023-12-26 01:28:09,350][123091] Updated weights for policy 0, policy_version 236255 (0.0007) [2023-12-26 01:28:09,421][123091] Updated weights for policy 0, policy_version 236265 (0.0008) [2023-12-26 01:28:09,472][123090] Updated weights for policy 1, policy_version 235174 (0.0010) [2023-12-26 01:28:09,540][123090] Updated weights for policy 1, policy_version 235184 (0.0011) [2023-12-26 01:28:09,600][123090] Updated weights for policy 1, policy_version 235194 (0.0009) [2023-12-26 01:28:10,256][123091] Updated weights for policy 0, policy_version 236275 (0.0011) [2023-12-26 01:28:10,312][123091] Updated weights for policy 0, policy_version 236285 (0.0011) [2023-12-26 01:28:10,371][123091] Updated weights for policy 0, policy_version 236295 (0.0010) [2023-12-26 01:28:10,435][123090] Updated weights for policy 1, policy_version 235204 (0.0009) [2023-12-26 01:28:10,509][123090] Updated weights for policy 1, policy_version 235214 (0.0009) [2023-12-26 01:28:10,585][123090] Updated weights for policy 1, policy_version 235224 (0.0010) [2023-12-26 01:28:11,099][123091] Updated weights for policy 0, policy_version 236305 (0.0006) [2023-12-26 01:28:11,188][123091] Updated weights for policy 0, policy_version 236315 (0.0008) [2023-12-26 01:28:11,255][123091] Updated weights for policy 0, policy_version 236325 (0.0010) [2023-12-26 01:28:11,317][123091] Updated weights for policy 0, policy_version 236335 (0.0010) [2023-12-26 01:28:11,500][123090] Updated weights for policy 1, policy_version 235234 (0.0009) [2023-12-26 01:28:11,566][123090] Updated weights for policy 1, policy_version 235244 (0.0009) [2023-12-26 01:28:11,636][123090] Updated weights for policy 1, policy_version 235254 (0.0009) [2023-12-26 01:28:11,704][123090] Updated weights for policy 1, policy_version 235264 (0.0010) [2023-12-26 01:28:12,118][123091] Updated weights for policy 0, policy_version 236345 (0.0006) [2023-12-26 01:28:12,192][123091] Updated weights for policy 0, policy_version 236355 (0.0005) [2023-12-26 01:28:12,249][123091] Updated weights for policy 0, policy_version 236365 (0.0006) [2023-12-26 01:28:12,495][123090] Updated weights for policy 1, policy_version 235274 (0.0009) [2023-12-26 01:28:12,544][123090] Updated weights for policy 1, policy_version 235284 (0.0009) [2023-12-26 01:28:12,594][123090] Updated weights for policy 1, policy_version 235294 (0.0009) [2023-12-26 01:28:13,043][123091] Updated weights for policy 0, policy_version 236375 (0.0010) [2023-12-26 01:28:13,102][123091] Updated weights for policy 0, policy_version 236385 (0.0011) [2023-12-26 01:28:13,165][123091] Updated weights for policy 0, policy_version 236395 (0.0011) [2023-12-26 01:28:13,403][123090] Updated weights for policy 1, policy_version 235304 (0.0006) [2023-12-26 01:28:13,464][123090] Updated weights for policy 1, policy_version 235314 (0.0005) [2023-12-26 01:28:13,534][123090] Updated weights for policy 1, policy_version 235324 (0.0006) [2023-12-26 01:28:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 120766464. Throughput: 0: 8948.6, 1: 8860.5. Samples: 120759944. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:13,784][121949] Avg episode reward: [(0, '6104.949'), (1, '5332.274')] [2023-12-26 01:28:13,924][123091] Updated weights for policy 0, policy_version 236405 (0.0010) [2023-12-26 01:28:13,982][123091] Updated weights for policy 0, policy_version 236415 (0.0010) [2023-12-26 01:28:14,041][123091] Updated weights for policy 0, policy_version 236425 (0.0010) [2023-12-26 01:28:14,169][123090] Updated weights for policy 1, policy_version 235334 (0.0008) [2023-12-26 01:28:14,216][123090] Updated weights for policy 1, policy_version 235344 (0.0008) [2023-12-26 01:28:14,263][123090] Updated weights for policy 1, policy_version 235354 (0.0008) [2023-12-26 01:28:14,858][123091] Updated weights for policy 0, policy_version 236435 (0.0010) [2023-12-26 01:28:14,921][123091] Updated weights for policy 0, policy_version 236445 (0.0010) [2023-12-26 01:28:14,982][123091] Updated weights for policy 0, policy_version 236455 (0.0008) [2023-12-26 01:28:15,078][123090] Updated weights for policy 1, policy_version 235364 (0.0008) [2023-12-26 01:28:15,141][123090] Updated weights for policy 1, policy_version 235374 (0.0009) [2023-12-26 01:28:15,201][123090] Updated weights for policy 1, policy_version 235384 (0.0009) [2023-12-26 01:28:15,786][123091] Updated weights for policy 0, policy_version 236465 (0.0010) [2023-12-26 01:28:15,850][123091] Updated weights for policy 0, policy_version 236475 (0.0011) [2023-12-26 01:28:15,916][123091] Updated weights for policy 0, policy_version 236485 (0.0011) [2023-12-26 01:28:15,984][123091] Updated weights for policy 0, policy_version 236495 (0.0010) [2023-12-26 01:28:16,045][123090] Updated weights for policy 1, policy_version 235394 (0.0009) [2023-12-26 01:28:16,097][123090] Updated weights for policy 1, policy_version 235404 (0.0008) [2023-12-26 01:28:16,153][123090] Updated weights for policy 1, policy_version 235414 (0.0009) [2023-12-26 01:28:16,207][123090] Updated weights for policy 1, policy_version 235424 (0.0009) [2023-12-26 01:28:16,801][123091] Updated weights for policy 0, policy_version 236505 (0.0010) [2023-12-26 01:28:16,858][123091] Updated weights for policy 0, policy_version 236515 (0.0010) [2023-12-26 01:28:16,920][123091] Updated weights for policy 0, policy_version 236525 (0.0010) [2023-12-26 01:28:17,086][123090] Updated weights for policy 1, policy_version 235434 (0.0009) [2023-12-26 01:28:17,134][123090] Updated weights for policy 1, policy_version 235444 (0.0008) [2023-12-26 01:28:17,183][123090] Updated weights for policy 1, policy_version 235454 (0.0009) [2023-12-26 01:28:17,736][123091] Updated weights for policy 0, policy_version 236535 (0.0010) [2023-12-26 01:28:17,797][123091] Updated weights for policy 0, policy_version 236545 (0.0010) [2023-12-26 01:28:17,855][123091] Updated weights for policy 0, policy_version 236555 (0.0010) [2023-12-26 01:28:18,029][123090] Updated weights for policy 1, policy_version 235464 (0.0009) [2023-12-26 01:28:18,082][123090] Updated weights for policy 1, policy_version 235474 (0.0009) [2023-12-26 01:28:18,146][123090] Updated weights for policy 1, policy_version 235484 (0.0009) [2023-12-26 01:28:18,657][123091] Updated weights for policy 0, policy_version 236565 (0.0010) [2023-12-26 01:28:18,724][123091] Updated weights for policy 0, policy_version 236575 (0.0010) [2023-12-26 01:28:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 120848384. Throughput: 0: 8906.9, 1: 8843.9. Samples: 120865124. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:18,785][121949] Avg episode reward: [(0, '6120.780'), (1, '5363.326')] [2023-12-26 01:28:18,786][123091] Updated weights for policy 0, policy_version 236585 (0.0011) [2023-12-26 01:28:19,031][123090] Updated weights for policy 1, policy_version 235494 (0.0010) [2023-12-26 01:28:19,092][123090] Updated weights for policy 1, policy_version 235504 (0.0009) [2023-12-26 01:28:19,144][123090] Updated weights for policy 1, policy_version 235514 (0.0009) [2023-12-26 01:28:19,614][123091] Updated weights for policy 0, policy_version 236595 (0.0010) [2023-12-26 01:28:19,680][123091] Updated weights for policy 0, policy_version 236605 (0.0007) [2023-12-26 01:28:19,755][123091] Updated weights for policy 0, policy_version 236615 (0.0009) [2023-12-26 01:28:20,019][123090] Updated weights for policy 1, policy_version 235524 (0.0009) [2023-12-26 01:28:20,087][123090] Updated weights for policy 1, policy_version 235534 (0.0006) [2023-12-26 01:28:20,147][123090] Updated weights for policy 1, policy_version 235544 (0.0009) [2023-12-26 01:28:20,462][123091] Updated weights for policy 0, policy_version 236625 (0.0011) [2023-12-26 01:28:20,514][123091] Updated weights for policy 0, policy_version 236635 (0.0011) [2023-12-26 01:28:20,567][123091] Updated weights for policy 0, policy_version 236645 (0.0009) [2023-12-26 01:28:20,627][123091] Updated weights for policy 0, policy_version 236655 (0.0010) [2023-12-26 01:28:20,970][123090] Updated weights for policy 1, policy_version 235554 (0.0010) [2023-12-26 01:28:21,022][123090] Updated weights for policy 1, policy_version 235564 (0.0008) [2023-12-26 01:28:21,088][123090] Updated weights for policy 1, policy_version 235574 (0.0008) [2023-12-26 01:28:21,160][123090] Updated weights for policy 1, policy_version 235584 (0.0009) [2023-12-26 01:28:21,501][123091] Updated weights for policy 0, policy_version 236665 (0.0010) [2023-12-26 01:28:21,564][123091] Updated weights for policy 0, policy_version 236675 (0.0011) [2023-12-26 01:28:21,634][123091] Updated weights for policy 0, policy_version 236685 (0.0010) [2023-12-26 01:28:21,984][123090] Updated weights for policy 1, policy_version 235594 (0.0008) [2023-12-26 01:28:22,043][123090] Updated weights for policy 1, policy_version 235604 (0.0005) [2023-12-26 01:28:22,105][123090] Updated weights for policy 1, policy_version 235614 (0.0009) [2023-12-26 01:28:22,439][123091] Updated weights for policy 0, policy_version 236695 (0.0009) [2023-12-26 01:28:22,502][123091] Updated weights for policy 0, policy_version 236705 (0.0009) [2023-12-26 01:28:22,562][123091] Updated weights for policy 0, policy_version 236715 (0.0009) [2023-12-26 01:28:22,952][123090] Updated weights for policy 1, policy_version 235624 (0.0010) [2023-12-26 01:28:23,012][123090] Updated weights for policy 1, policy_version 235634 (0.0010) [2023-12-26 01:28:23,067][123090] Updated weights for policy 1, policy_version 235644 (0.0010) [2023-12-26 01:28:23,374][123091] Updated weights for policy 0, policy_version 236725 (0.0009) [2023-12-26 01:28:23,430][123091] Updated weights for policy 0, policy_version 236735 (0.0005) [2023-12-26 01:28:23,501][123091] Updated weights for policy 0, policy_version 236745 (0.0005) [2023-12-26 01:28:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 120938496. Throughput: 0: 8883.8, 1: 8824.3. Samples: 120915816. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:23,785][121949] Avg episode reward: [(0, '6082.597'), (1, '5429.007')] [2023-12-26 01:28:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000235648_60325888.pth... [2023-12-26 01:28:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000236752_60612608.pth... [2023-12-26 01:28:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000234624_60063744.pth [2023-12-26 01:28:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000235696_60342272.pth [2023-12-26 01:28:24,008][123090] Updated weights for policy 1, policy_version 235654 (0.0010) [2023-12-26 01:28:24,071][123090] Updated weights for policy 1, policy_version 235664 (0.0010) [2023-12-26 01:28:24,133][123090] Updated weights for policy 1, policy_version 235674 (0.0009) [2023-12-26 01:28:24,202][123091] Updated weights for policy 0, policy_version 236755 (0.0005) [2023-12-26 01:28:24,273][123091] Updated weights for policy 0, policy_version 236765 (0.0008) [2023-12-26 01:28:24,334][123091] Updated weights for policy 0, policy_version 236775 (0.0008) [2023-12-26 01:28:25,007][123091] Updated weights for policy 0, policy_version 236785 (0.0009) [2023-12-26 01:28:25,015][123090] Updated weights for policy 1, policy_version 235684 (0.0009) [2023-12-26 01:28:25,078][123090] Updated weights for policy 1, policy_version 235694 (0.0010) [2023-12-26 01:28:25,079][123091] Updated weights for policy 0, policy_version 236795 (0.0005) [2023-12-26 01:28:25,137][123090] Updated weights for policy 1, policy_version 235704 (0.0009) [2023-12-26 01:28:25,153][123091] Updated weights for policy 0, policy_version 236805 (0.0005) [2023-12-26 01:28:25,227][123091] Updated weights for policy 0, policy_version 236815 (0.0005) [2023-12-26 01:28:25,863][123091] Updated weights for policy 0, policy_version 236825 (0.0006) [2023-12-26 01:28:25,926][123091] Updated weights for policy 0, policy_version 236835 (0.0006) [2023-12-26 01:28:25,982][123091] Updated weights for policy 0, policy_version 236845 (0.0006) [2023-12-26 01:28:25,984][123090] Updated weights for policy 1, policy_version 235714 (0.0008) [2023-12-26 01:28:26,038][123090] Updated weights for policy 1, policy_version 235724 (0.0010) [2023-12-26 01:28:26,103][123090] Updated weights for policy 1, policy_version 235734 (0.0009) [2023-12-26 01:28:26,151][123090] Updated weights for policy 1, policy_version 235744 (0.0009) [2023-12-26 01:28:26,710][123091] Updated weights for policy 0, policy_version 236855 (0.0006) [2023-12-26 01:28:26,764][123091] Updated weights for policy 0, policy_version 236866 (0.0010) [2023-12-26 01:28:26,818][123091] Updated weights for policy 0, policy_version 236876 (0.0006) [2023-12-26 01:28:27,003][123090] Updated weights for policy 1, policy_version 235754 (0.0008) [2023-12-26 01:28:27,066][123090] Updated weights for policy 1, policy_version 235764 (0.0011) [2023-12-26 01:28:27,129][123090] Updated weights for policy 1, policy_version 235774 (0.0010) [2023-12-26 01:28:27,502][123091] Updated weights for policy 0, policy_version 236886 (0.0008) [2023-12-26 01:28:27,555][123091] Updated weights for policy 0, policy_version 236896 (0.0010) [2023-12-26 01:28:27,616][123091] Updated weights for policy 0, policy_version 236906 (0.0007) [2023-12-26 01:28:27,847][123090] Updated weights for policy 1, policy_version 235784 (0.0006) [2023-12-26 01:28:27,894][123090] Updated weights for policy 1, policy_version 235794 (0.0005) [2023-12-26 01:28:27,951][123090] Updated weights for policy 1, policy_version 235805 (0.0007) [2023-12-26 01:28:28,343][123091] Updated weights for policy 0, policy_version 236916 (0.0006) [2023-12-26 01:28:28,411][123091] Updated weights for policy 0, policy_version 236926 (0.0008) [2023-12-26 01:28:28,485][123091] Updated weights for policy 0, policy_version 236936 (0.0005) [2023-12-26 01:28:28,619][123090] Updated weights for policy 1, policy_version 235815 (0.0007) [2023-12-26 01:28:28,680][123090] Updated weights for policy 1, policy_version 235825 (0.0008) [2023-12-26 01:28:28,752][123090] Updated weights for policy 1, policy_version 235835 (0.0009) [2023-12-26 01:28:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 121028608. Throughput: 0: 9036.5, 1: 8810.6. Samples: 121022556. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:28,785][121949] Avg episode reward: [(0, '6076.946'), (1, '5340.621')] [2023-12-26 01:28:29,180][123091] Updated weights for policy 0, policy_version 236946 (0.0008) [2023-12-26 01:28:29,246][123091] Updated weights for policy 0, policy_version 236956 (0.0006) [2023-12-26 01:28:29,298][123091] Updated weights for policy 0, policy_version 236966 (0.0005) [2023-12-26 01:28:29,358][123091] Updated weights for policy 0, policy_version 236976 (0.0006) [2023-12-26 01:28:29,499][123090] Updated weights for policy 1, policy_version 235845 (0.0008) [2023-12-26 01:28:29,553][123090] Updated weights for policy 1, policy_version 235855 (0.0006) [2023-12-26 01:28:29,628][123090] Updated weights for policy 1, policy_version 235865 (0.0009) [2023-12-26 01:28:30,136][123091] Updated weights for policy 0, policy_version 236986 (0.0005) [2023-12-26 01:28:30,196][123091] Updated weights for policy 0, policy_version 236996 (0.0009) [2023-12-26 01:28:30,259][123091] Updated weights for policy 0, policy_version 237006 (0.0009) [2023-12-26 01:28:30,410][123090] Updated weights for policy 1, policy_version 235875 (0.0010) [2023-12-26 01:28:30,475][123090] Updated weights for policy 1, policy_version 235885 (0.0010) [2023-12-26 01:28:30,537][123090] Updated weights for policy 1, policy_version 235895 (0.0010) [2023-12-26 01:28:31,059][123091] Updated weights for policy 0, policy_version 237016 (0.0010) [2023-12-26 01:28:31,126][123091] Updated weights for policy 0, policy_version 237026 (0.0011) [2023-12-26 01:28:31,189][123091] Updated weights for policy 0, policy_version 237036 (0.0011) [2023-12-26 01:28:31,241][123090] Updated weights for policy 1, policy_version 235905 (0.0006) [2023-12-26 01:28:31,299][123090] Updated weights for policy 1, policy_version 235915 (0.0013) [2023-12-26 01:28:31,357][123090] Updated weights for policy 1, policy_version 235925 (0.0010) [2023-12-26 01:28:31,428][123090] Updated weights for policy 1, policy_version 235935 (0.0010) [2023-12-26 01:28:31,968][123091] Updated weights for policy 0, policy_version 237046 (0.0010) [2023-12-26 01:28:32,023][123091] Updated weights for policy 0, policy_version 237056 (0.0010) [2023-12-26 01:28:32,085][123091] Updated weights for policy 0, policy_version 237066 (0.0010) [2023-12-26 01:28:32,252][123090] Updated weights for policy 1, policy_version 235945 (0.0010) [2023-12-26 01:28:32,312][123090] Updated weights for policy 1, policy_version 235955 (0.0010) [2023-12-26 01:28:32,385][123090] Updated weights for policy 1, policy_version 235965 (0.0010) [2023-12-26 01:28:32,903][123091] Updated weights for policy 0, policy_version 237076 (0.0010) [2023-12-26 01:28:32,953][123091] Updated weights for policy 0, policy_version 237086 (0.0010) [2023-12-26 01:28:33,000][123091] Updated weights for policy 0, policy_version 237096 (0.0010) [2023-12-26 01:28:33,192][123090] Updated weights for policy 1, policy_version 235975 (0.0010) [2023-12-26 01:28:33,250][123090] Updated weights for policy 1, policy_version 235985 (0.0010) [2023-12-26 01:28:33,304][123090] Updated weights for policy 1, policy_version 235995 (0.0010) [2023-12-26 01:28:33,731][123091] Updated weights for policy 0, policy_version 237106 (0.0009) [2023-12-26 01:28:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 121118720. Throughput: 0: 9074.8, 1: 8847.5. Samples: 121133520. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:33,784][121949] Avg episode reward: [(0, '6107.264'), (1, '5478.833')] [2023-12-26 01:28:33,787][123091] Updated weights for policy 0, policy_version 237116 (0.0006) [2023-12-26 01:28:33,843][123091] Updated weights for policy 0, policy_version 237126 (0.0005) [2023-12-26 01:28:33,895][123091] Updated weights for policy 0, policy_version 237136 (0.0005) [2023-12-26 01:28:34,140][123090] Updated weights for policy 1, policy_version 236005 (0.0010) [2023-12-26 01:28:34,206][123090] Updated weights for policy 1, policy_version 236015 (0.0011) [2023-12-26 01:28:34,277][123090] Updated weights for policy 1, policy_version 236025 (0.0011) [2023-12-26 01:28:34,559][123091] Updated weights for policy 0, policy_version 237146 (0.0006) [2023-12-26 01:28:34,629][123091] Updated weights for policy 0, policy_version 237156 (0.0006) [2023-12-26 01:28:34,695][123091] Updated weights for policy 0, policy_version 237166 (0.0009) [2023-12-26 01:28:35,099][123090] Updated weights for policy 1, policy_version 236035 (0.0011) [2023-12-26 01:28:35,173][123090] Updated weights for policy 1, policy_version 236045 (0.0010) [2023-12-26 01:28:35,254][123090] Updated weights for policy 1, policy_version 236055 (0.0009) [2023-12-26 01:28:35,318][123091] Updated weights for policy 0, policy_version 237176 (0.0005) [2023-12-26 01:28:35,375][123091] Updated weights for policy 0, policy_version 237186 (0.0005) [2023-12-26 01:28:35,432][123091] Updated weights for policy 0, policy_version 237196 (0.0005) [2023-12-26 01:28:35,902][123090] Updated weights for policy 1, policy_version 236065 (0.0011) [2023-12-26 01:28:35,953][123090] Updated weights for policy 1, policy_version 236075 (0.0010) [2023-12-26 01:28:36,004][123090] Updated weights for policy 1, policy_version 236085 (0.0010) [2023-12-26 01:28:36,052][123090] Updated weights for policy 1, policy_version 236095 (0.0010) [2023-12-26 01:28:36,069][123091] Updated weights for policy 0, policy_version 237206 (0.0005) [2023-12-26 01:28:36,126][123091] Updated weights for policy 0, policy_version 237216 (0.0008) [2023-12-26 01:28:36,192][123091] Updated weights for policy 0, policy_version 237226 (0.0009) [2023-12-26 01:28:36,890][123090] Updated weights for policy 1, policy_version 236105 (0.0009) [2023-12-26 01:28:36,960][123090] Updated weights for policy 1, policy_version 236115 (0.0010) [2023-12-26 01:28:36,996][123091] Updated weights for policy 0, policy_version 237236 (0.0010) [2023-12-26 01:28:37,021][123090] Updated weights for policy 1, policy_version 236125 (0.0007) [2023-12-26 01:28:37,072][123091] Updated weights for policy 0, policy_version 237246 (0.0011) [2023-12-26 01:28:37,143][123091] Updated weights for policy 0, policy_version 237256 (0.0011) [2023-12-26 01:28:37,817][123090] Updated weights for policy 1, policy_version 236135 (0.0008) [2023-12-26 01:28:37,879][123090] Updated weights for policy 1, policy_version 236145 (0.0009) [2023-12-26 01:28:37,942][123090] Updated weights for policy 1, policy_version 236155 (0.0009) [2023-12-26 01:28:37,949][123091] Updated weights for policy 0, policy_version 237266 (0.0008) [2023-12-26 01:28:38,022][123091] Updated weights for policy 0, policy_version 237276 (0.0008) [2023-12-26 01:28:38,082][123091] Updated weights for policy 0, policy_version 237286 (0.0011) [2023-12-26 01:28:38,142][123091] Updated weights for policy 0, policy_version 237296 (0.0011) [2023-12-26 01:28:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 121208832. Throughput: 0: 9160.8, 1: 8872.5. Samples: 121190896. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:38,785][121949] Avg episode reward: [(0, '6014.572'), (1, '5579.509')] [2023-12-26 01:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000237296_60751872.pth... [2023-12-26 01:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000236240_60481536.pth [2023-12-26 01:28:38,840][123090] Updated weights for policy 1, policy_version 236165 (0.0007) [2023-12-26 01:28:38,879][123091] Updated weights for policy 0, policy_version 237306 (0.0006) [2023-12-26 01:28:38,909][123090] Updated weights for policy 1, policy_version 236175 (0.0007) [2023-12-26 01:28:38,932][123091] Updated weights for policy 0, policy_version 237316 (0.0005) [2023-12-26 01:28:38,963][123090] Updated weights for policy 1, policy_version 236185 (0.0009) [2023-12-26 01:28:38,996][123091] Updated weights for policy 0, policy_version 237326 (0.0007) [2023-12-26 01:28:38,997][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000236192_60465152.pth... [2023-12-26 01:28:39,000][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000235168_60203008.pth [2023-12-26 01:28:39,718][123091] Updated weights for policy 0, policy_version 237336 (0.0006) [2023-12-26 01:28:39,777][123091] Updated weights for policy 0, policy_version 237346 (0.0006) [2023-12-26 01:28:39,798][123090] Updated weights for policy 1, policy_version 236195 (0.0007) [2023-12-26 01:28:39,833][123091] Updated weights for policy 0, policy_version 237356 (0.0008) [2023-12-26 01:28:39,859][123090] Updated weights for policy 1, policy_version 236205 (0.0009) [2023-12-26 01:28:39,917][123090] Updated weights for policy 1, policy_version 236215 (0.0008) [2023-12-26 01:28:40,515][123091] Updated weights for policy 0, policy_version 237366 (0.0007) [2023-12-26 01:28:40,582][123091] Updated weights for policy 0, policy_version 237376 (0.0011) [2023-12-26 01:28:40,657][123091] Updated weights for policy 0, policy_version 237386 (0.0011) [2023-12-26 01:28:40,781][123090] Updated weights for policy 1, policy_version 236225 (0.0009) [2023-12-26 01:28:40,833][123090] Updated weights for policy 1, policy_version 236235 (0.0009) [2023-12-26 01:28:40,881][123090] Updated weights for policy 1, policy_version 236245 (0.0009) [2023-12-26 01:28:40,944][123090] Updated weights for policy 1, policy_version 236255 (0.0010) [2023-12-26 01:28:41,459][123091] Updated weights for policy 0, policy_version 237396 (0.0010) [2023-12-26 01:28:41,521][123091] Updated weights for policy 0, policy_version 237406 (0.0007) [2023-12-26 01:28:41,586][123091] Updated weights for policy 0, policy_version 237416 (0.0005) [2023-12-26 01:28:41,832][123090] Updated weights for policy 1, policy_version 236265 (0.0010) [2023-12-26 01:28:41,899][123090] Updated weights for policy 1, policy_version 236275 (0.0010) [2023-12-26 01:28:41,969][123090] Updated weights for policy 1, policy_version 236285 (0.0008) [2023-12-26 01:28:42,393][123091] Updated weights for policy 0, policy_version 237426 (0.0007) [2023-12-26 01:28:42,448][123091] Updated weights for policy 0, policy_version 237436 (0.0010) [2023-12-26 01:28:42,500][123091] Updated weights for policy 0, policy_version 237446 (0.0009) [2023-12-26 01:28:42,565][123091] Updated weights for policy 0, policy_version 237456 (0.0010) [2023-12-26 01:28:42,823][123090] Updated weights for policy 1, policy_version 236295 (0.0009) [2023-12-26 01:28:42,875][123090] Updated weights for policy 1, policy_version 236305 (0.0009) [2023-12-26 01:28:42,948][123090] Updated weights for policy 1, policy_version 236315 (0.0009) [2023-12-26 01:28:43,365][123091] Updated weights for policy 0, policy_version 237466 (0.0005) [2023-12-26 01:28:43,421][123091] Updated weights for policy 0, policy_version 237476 (0.0009) [2023-12-26 01:28:43,465][123091] Updated weights for policy 0, policy_version 237486 (0.0010) [2023-12-26 01:28:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 121298944. Throughput: 0: 9130.6, 1: 8706.8. Samples: 121294528. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:43,785][121949] Avg episode reward: [(0, '6036.951'), (1, '5457.954')] [2023-12-26 01:28:43,795][123090] Updated weights for policy 1, policy_version 236325 (0.0009) [2023-12-26 01:28:43,844][123090] Updated weights for policy 1, policy_version 236335 (0.0005) [2023-12-26 01:28:43,896][123090] Updated weights for policy 1, policy_version 236345 (0.0005) [2023-12-26 01:28:44,227][123091] Updated weights for policy 0, policy_version 237496 (0.0010) [2023-12-26 01:28:44,278][123091] Updated weights for policy 0, policy_version 237506 (0.0010) [2023-12-26 01:28:44,326][123091] Updated weights for policy 0, policy_version 237516 (0.0009) [2023-12-26 01:28:44,579][123090] Updated weights for policy 1, policy_version 236355 (0.0006) [2023-12-26 01:28:44,633][123090] Updated weights for policy 1, policy_version 236365 (0.0010) [2023-12-26 01:28:44,691][123090] Updated weights for policy 1, policy_version 236375 (0.0009) [2023-12-26 01:28:45,055][123091] Updated weights for policy 0, policy_version 237526 (0.0007) [2023-12-26 01:28:45,119][123091] Updated weights for policy 0, policy_version 237536 (0.0007) [2023-12-26 01:28:45,178][123091] Updated weights for policy 0, policy_version 237546 (0.0010) [2023-12-26 01:28:45,646][123090] Updated weights for policy 1, policy_version 236386 (0.0010) [2023-12-26 01:28:45,703][123090] Updated weights for policy 1, policy_version 236396 (0.0009) [2023-12-26 01:28:45,761][123090] Updated weights for policy 1, policy_version 236406 (0.0010) [2023-12-26 01:28:45,814][123090] Updated weights for policy 1, policy_version 236416 (0.0011) [2023-12-26 01:28:45,832][123091] Updated weights for policy 0, policy_version 237556 (0.0008) [2023-12-26 01:28:45,892][123091] Updated weights for policy 0, policy_version 237566 (0.0005) [2023-12-26 01:28:45,958][123091] Updated weights for policy 0, policy_version 237576 (0.0005) [2023-12-26 01:28:46,672][123091] Updated weights for policy 0, policy_version 237586 (0.0005) [2023-12-26 01:28:46,705][123090] Updated weights for policy 1, policy_version 236426 (0.0010) [2023-12-26 01:28:46,721][123091] Updated weights for policy 0, policy_version 237596 (0.0006) [2023-12-26 01:28:46,756][123090] Updated weights for policy 1, policy_version 236436 (0.0009) [2023-12-26 01:28:46,777][123091] Updated weights for policy 0, policy_version 237606 (0.0005) [2023-12-26 01:28:46,814][123090] Updated weights for policy 1, policy_version 236446 (0.0005) [2023-12-26 01:28:46,831][123091] Updated weights for policy 0, policy_version 237616 (0.0005) [2023-12-26 01:28:47,524][123090] Updated weights for policy 1, policy_version 236456 (0.0005) [2023-12-26 01:28:47,546][123091] Updated weights for policy 0, policy_version 237626 (0.0005) [2023-12-26 01:28:47,590][123090] Updated weights for policy 1, policy_version 236466 (0.0005) [2023-12-26 01:28:47,607][123091] Updated weights for policy 0, policy_version 237636 (0.0010) [2023-12-26 01:28:47,648][123090] Updated weights for policy 1, policy_version 236476 (0.0005) [2023-12-26 01:28:47,666][123091] Updated weights for policy 0, policy_version 237646 (0.0010) [2023-12-26 01:28:48,362][123090] Updated weights for policy 1, policy_version 236486 (0.0008) [2023-12-26 01:28:48,415][123090] Updated weights for policy 1, policy_version 236496 (0.0010) [2023-12-26 01:28:48,469][123091] Updated weights for policy 0, policy_version 237656 (0.0011) [2023-12-26 01:28:48,477][123090] Updated weights for policy 1, policy_version 236506 (0.0007) [2023-12-26 01:28:48,535][123091] Updated weights for policy 0, policy_version 237666 (0.0011) [2023-12-26 01:28:48,598][123091] Updated weights for policy 0, policy_version 237676 (0.0011) [2023-12-26 01:28:48,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 121397248. Throughput: 0: 9192.5, 1: 8676.7. Samples: 121405332. Policy #0 lag: (min: 24.0, avg: 49.8, max: 56.0) [2023-12-26 01:28:48,785][121949] Avg episode reward: [(0, '6143.722'), (1, '5380.902')] [2023-12-26 01:28:49,243][123090] Updated weights for policy 1, policy_version 236516 (0.0008) [2023-12-26 01:28:49,310][123090] Updated weights for policy 1, policy_version 236526 (0.0011) [2023-12-26 01:28:49,383][123090] Updated weights for policy 1, policy_version 236536 (0.0011) [2023-12-26 01:28:49,435][123091] Updated weights for policy 0, policy_version 237686 (0.0011) [2023-12-26 01:28:49,502][123091] Updated weights for policy 0, policy_version 237696 (0.0011) [2023-12-26 01:28:49,564][123091] Updated weights for policy 0, policy_version 237706 (0.0011) [2023-12-26 01:28:50,171][123090] Updated weights for policy 1, policy_version 236546 (0.0009) [2023-12-26 01:28:50,245][123090] Updated weights for policy 1, policy_version 236556 (0.0005) [2023-12-26 01:28:50,308][123090] Updated weights for policy 1, policy_version 236566 (0.0006) [2023-12-26 01:28:50,336][123091] Updated weights for policy 0, policy_version 237716 (0.0009) [2023-12-26 01:28:50,368][123090] Updated weights for policy 1, policy_version 236576 (0.0007) [2023-12-26 01:28:50,389][123091] Updated weights for policy 0, policy_version 237726 (0.0008) [2023-12-26 01:28:50,446][123091] Updated weights for policy 0, policy_version 237736 (0.0010) [2023-12-26 01:28:51,099][123090] Updated weights for policy 1, policy_version 236586 (0.0008) [2023-12-26 01:28:51,172][123090] Updated weights for policy 1, policy_version 236596 (0.0009) [2023-12-26 01:28:51,229][123090] Updated weights for policy 1, policy_version 236606 (0.0006) [2023-12-26 01:28:51,317][123091] Updated weights for policy 0, policy_version 237746 (0.0010) [2023-12-26 01:28:51,389][123091] Updated weights for policy 0, policy_version 237756 (0.0008) [2023-12-26 01:28:51,450][123091] Updated weights for policy 0, policy_version 237766 (0.0006) [2023-12-26 01:28:51,503][123091] Updated weights for policy 0, policy_version 237776 (0.0007) [2023-12-26 01:28:52,068][123090] Updated weights for policy 1, policy_version 236617 (0.0006) [2023-12-26 01:28:52,137][123090] Updated weights for policy 1, policy_version 236627 (0.0008) [2023-12-26 01:28:52,194][123090] Updated weights for policy 1, policy_version 236637 (0.0009) [2023-12-26 01:28:52,291][123091] Updated weights for policy 0, policy_version 237786 (0.0011) [2023-12-26 01:28:52,357][123091] Updated weights for policy 0, policy_version 237796 (0.0010) [2023-12-26 01:28:52,423][123091] Updated weights for policy 0, policy_version 237806 (0.0006) [2023-12-26 01:28:53,050][123090] Updated weights for policy 1, policy_version 236647 (0.0009) [2023-12-26 01:28:53,102][123090] Updated weights for policy 1, policy_version 236657 (0.0009) [2023-12-26 01:28:53,145][123091] Updated weights for policy 0, policy_version 237816 (0.0008) [2023-12-26 01:28:53,159][123090] Updated weights for policy 1, policy_version 236667 (0.0009) [2023-12-26 01:28:53,223][123091] Updated weights for policy 0, policy_version 237826 (0.0005) [2023-12-26 01:28:53,286][123091] Updated weights for policy 0, policy_version 237836 (0.0005) [2023-12-26 01:28:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 121479168. Throughput: 0: 9159.7, 1: 8669.9. Samples: 121458332. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:28:53,785][121949] Avg episode reward: [(0, '6129.658'), (1, '5387.110')] [2023-12-26 01:28:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000237840_60891136.pth... [2023-12-26 01:28:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000236672_60588032.pth... [2023-12-26 01:28:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000236752_60612608.pth [2023-12-26 01:28:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000235648_60325888.pth [2023-12-26 01:28:54,016][123091] Updated weights for policy 0, policy_version 237846 (0.0008) [2023-12-26 01:28:54,053][123090] Updated weights for policy 1, policy_version 236677 (0.0008) [2023-12-26 01:28:54,069][123091] Updated weights for policy 0, policy_version 237856 (0.0009) [2023-12-26 01:28:54,105][123090] Updated weights for policy 1, policy_version 236687 (0.0008) [2023-12-26 01:28:54,117][123091] Updated weights for policy 0, policy_version 237866 (0.0008) [2023-12-26 01:28:54,160][123090] Updated weights for policy 1, policy_version 236697 (0.0008) [2023-12-26 01:28:54,842][123090] Updated weights for policy 1, policy_version 236707 (0.0007) [2023-12-26 01:28:54,897][123090] Updated weights for policy 1, policy_version 236717 (0.0010) [2023-12-26 01:28:54,961][123090] Updated weights for policy 1, policy_version 236727 (0.0009) [2023-12-26 01:28:54,991][123091] Updated weights for policy 0, policy_version 237876 (0.0007) [2023-12-26 01:28:55,053][123091] Updated weights for policy 0, policy_version 237886 (0.0008) [2023-12-26 01:28:55,118][123091] Updated weights for policy 0, policy_version 237896 (0.0008) [2023-12-26 01:28:55,754][123091] Updated weights for policy 0, policy_version 237906 (0.0009) [2023-12-26 01:28:55,816][123091] Updated weights for policy 0, policy_version 237916 (0.0005) [2023-12-26 01:28:55,845][123090] Updated weights for policy 1, policy_version 236737 (0.0009) [2023-12-26 01:28:55,872][123091] Updated weights for policy 0, policy_version 237926 (0.0008) [2023-12-26 01:28:55,896][123090] Updated weights for policy 1, policy_version 236747 (0.0006) [2023-12-26 01:28:55,923][123091] Updated weights for policy 0, policy_version 237936 (0.0010) [2023-12-26 01:28:55,952][123090] Updated weights for policy 1, policy_version 236757 (0.0007) [2023-12-26 01:28:55,999][123090] Updated weights for policy 1, policy_version 236767 (0.0008) [2023-12-26 01:28:56,599][123091] Updated weights for policy 0, policy_version 237946 (0.0005) [2023-12-26 01:28:56,651][123091] Updated weights for policy 0, policy_version 237956 (0.0009) [2023-12-26 01:28:56,702][123091] Updated weights for policy 0, policy_version 237966 (0.0010) [2023-12-26 01:28:56,880][123090] Updated weights for policy 1, policy_version 236777 (0.0009) [2023-12-26 01:28:56,936][123090] Updated weights for policy 1, policy_version 236787 (0.0009) [2023-12-26 01:28:56,989][123090] Updated weights for policy 1, policy_version 236797 (0.0009) [2023-12-26 01:28:57,484][123091] Updated weights for policy 0, policy_version 237976 (0.0011) [2023-12-26 01:28:57,532][123091] Updated weights for policy 0, policy_version 237986 (0.0010) [2023-12-26 01:28:57,579][123091] Updated weights for policy 0, policy_version 237996 (0.0010) [2023-12-26 01:28:57,843][123090] Updated weights for policy 1, policy_version 236807 (0.0009) [2023-12-26 01:28:57,891][123090] Updated weights for policy 1, policy_version 236817 (0.0008) [2023-12-26 01:28:57,938][123090] Updated weights for policy 1, policy_version 236827 (0.0008) [2023-12-26 01:28:58,445][123091] Updated weights for policy 0, policy_version 238006 (0.0010) [2023-12-26 01:28:58,509][123091] Updated weights for policy 0, policy_version 238016 (0.0010) [2023-12-26 01:28:58,575][123091] Updated weights for policy 0, policy_version 238026 (0.0008) [2023-12-26 01:28:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 121569280. Throughput: 0: 9190.3, 1: 8692.9. Samples: 121564688. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:28:58,785][121949] Avg episode reward: [(0, '6054.585'), (1, '5434.126')] [2023-12-26 01:28:58,878][123090] Updated weights for policy 1, policy_version 236837 (0.0008) [2023-12-26 01:28:58,944][123090] Updated weights for policy 1, policy_version 236847 (0.0008) [2023-12-26 01:28:59,013][123090] Updated weights for policy 1, policy_version 236857 (0.0008) [2023-12-26 01:28:59,505][123091] Updated weights for policy 0, policy_version 238036 (0.0009) [2023-12-26 01:28:59,562][123091] Updated weights for policy 0, policy_version 238046 (0.0007) [2023-12-26 01:28:59,630][123091] Updated weights for policy 0, policy_version 238056 (0.0009) [2023-12-26 01:28:59,735][123090] Updated weights for policy 1, policy_version 236867 (0.0007) [2023-12-26 01:28:59,786][123090] Updated weights for policy 1, policy_version 236877 (0.0005) [2023-12-26 01:28:59,848][123090] Updated weights for policy 1, policy_version 236887 (0.0008) [2023-12-26 01:29:00,376][123091] Updated weights for policy 0, policy_version 238066 (0.0009) [2023-12-26 01:29:00,430][123091] Updated weights for policy 0, policy_version 238076 (0.0006) [2023-12-26 01:29:00,493][123091] Updated weights for policy 0, policy_version 238086 (0.0005) [2023-12-26 01:29:00,568][123091] Updated weights for policy 0, policy_version 238096 (0.0005) [2023-12-26 01:29:00,717][123090] Updated weights for policy 1, policy_version 236897 (0.0009) [2023-12-26 01:29:00,767][123090] Updated weights for policy 1, policy_version 236907 (0.0005) [2023-12-26 01:29:00,815][123090] Updated weights for policy 1, policy_version 236917 (0.0005) [2023-12-26 01:29:00,873][123090] Updated weights for policy 1, policy_version 236927 (0.0005) [2023-12-26 01:29:01,206][123091] Updated weights for policy 0, policy_version 238106 (0.0007) [2023-12-26 01:29:01,272][123091] Updated weights for policy 0, policy_version 238116 (0.0008) [2023-12-26 01:29:01,324][123091] Updated weights for policy 0, policy_version 238126 (0.0008) [2023-12-26 01:29:01,668][123090] Updated weights for policy 1, policy_version 236937 (0.0008) [2023-12-26 01:29:01,737][123090] Updated weights for policy 1, policy_version 236947 (0.0008) [2023-12-26 01:29:01,804][123090] Updated weights for policy 1, policy_version 236957 (0.0008) [2023-12-26 01:29:02,087][123091] Updated weights for policy 0, policy_version 238136 (0.0010) [2023-12-26 01:29:02,141][123091] Updated weights for policy 0, policy_version 238147 (0.0010) [2023-12-26 01:29:02,204][123091] Updated weights for policy 0, policy_version 238157 (0.0010) [2023-12-26 01:29:02,519][123090] Updated weights for policy 1, policy_version 236967 (0.0010) [2023-12-26 01:29:02,583][123090] Updated weights for policy 1, policy_version 236977 (0.0011) [2023-12-26 01:29:02,646][123090] Updated weights for policy 1, policy_version 236987 (0.0010) [2023-12-26 01:29:02,958][123091] Updated weights for policy 0, policy_version 238167 (0.0007) [2023-12-26 01:29:03,028][123091] Updated weights for policy 0, policy_version 238177 (0.0005) [2023-12-26 01:29:03,099][123091] Updated weights for policy 0, policy_version 238187 (0.0005) [2023-12-26 01:29:03,399][123090] Updated weights for policy 1, policy_version 236997 (0.0010) [2023-12-26 01:29:03,460][123090] Updated weights for policy 1, policy_version 237007 (0.0010) [2023-12-26 01:29:03,515][123090] Updated weights for policy 1, policy_version 237017 (0.0010) [2023-12-26 01:29:03,726][123091] Updated weights for policy 0, policy_version 238197 (0.0005) [2023-12-26 01:29:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 121659392. Throughput: 0: 9251.8, 1: 8687.5. Samples: 121672396. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:03,785][121949] Avg episode reward: [(0, '5907.474'), (1, '5462.802')] [2023-12-26 01:29:03,795][123091] Updated weights for policy 0, policy_version 238207 (0.0005) [2023-12-26 01:29:03,861][123091] Updated weights for policy 0, policy_version 238217 (0.0007) [2023-12-26 01:29:04,376][123090] Updated weights for policy 1, policy_version 237027 (0.0010) [2023-12-26 01:29:04,447][123090] Updated weights for policy 1, policy_version 237037 (0.0011) [2023-12-26 01:29:04,510][123090] Updated weights for policy 1, policy_version 237047 (0.0011) [2023-12-26 01:29:04,637][123091] Updated weights for policy 0, policy_version 238227 (0.0009) [2023-12-26 01:29:04,702][123091] Updated weights for policy 0, policy_version 238237 (0.0009) [2023-12-26 01:29:04,762][123091] Updated weights for policy 0, policy_version 238247 (0.0009) [2023-12-26 01:29:05,264][123090] Updated weights for policy 1, policy_version 237057 (0.0010) [2023-12-26 01:29:05,327][123090] Updated weights for policy 1, policy_version 237067 (0.0005) [2023-12-26 01:29:05,381][123090] Updated weights for policy 1, policy_version 237077 (0.0005) [2023-12-26 01:29:05,438][123090] Updated weights for policy 1, policy_version 237087 (0.0005) [2023-12-26 01:29:05,659][123091] Updated weights for policy 0, policy_version 238257 (0.0009) [2023-12-26 01:29:05,717][123091] Updated weights for policy 0, policy_version 238267 (0.0010) [2023-12-26 01:29:05,776][123091] Updated weights for policy 0, policy_version 238277 (0.0009) [2023-12-26 01:29:05,832][123091] Updated weights for policy 0, policy_version 238287 (0.0009) [2023-12-26 01:29:06,149][123090] Updated weights for policy 1, policy_version 237097 (0.0010) [2023-12-26 01:29:06,216][123090] Updated weights for policy 1, policy_version 237107 (0.0010) [2023-12-26 01:29:06,280][123090] Updated weights for policy 1, policy_version 237117 (0.0011) [2023-12-26 01:29:06,592][123091] Updated weights for policy 0, policy_version 238297 (0.0010) [2023-12-26 01:29:06,660][123091] Updated weights for policy 0, policy_version 238307 (0.0010) [2023-12-26 01:29:06,727][123091] Updated weights for policy 0, policy_version 238317 (0.0010) [2023-12-26 01:29:06,990][123090] Updated weights for policy 1, policy_version 237127 (0.0007) [2023-12-26 01:29:07,043][123090] Updated weights for policy 1, policy_version 237137 (0.0009) [2023-12-26 01:29:07,091][123090] Updated weights for policy 1, policy_version 237147 (0.0006) [2023-12-26 01:29:07,479][123091] Updated weights for policy 0, policy_version 238327 (0.0009) [2023-12-26 01:29:07,533][123091] Updated weights for policy 0, policy_version 238337 (0.0010) [2023-12-26 01:29:07,591][123091] Updated weights for policy 0, policy_version 238347 (0.0010) [2023-12-26 01:29:07,745][123090] Updated weights for policy 1, policy_version 237157 (0.0008) [2023-12-26 01:29:07,798][123090] Updated weights for policy 1, policy_version 237167 (0.0005) [2023-12-26 01:29:07,860][123090] Updated weights for policy 1, policy_version 237177 (0.0005) [2023-12-26 01:29:08,438][123091] Updated weights for policy 0, policy_version 238357 (0.0009) [2023-12-26 01:29:08,504][123091] Updated weights for policy 0, policy_version 238367 (0.0009) [2023-12-26 01:29:08,569][123091] Updated weights for policy 0, policy_version 238377 (0.0009) [2023-12-26 01:29:08,633][123090] Updated weights for policy 1, policy_version 237187 (0.0010) [2023-12-26 01:29:08,704][123090] Updated weights for policy 1, policy_version 237197 (0.0011) [2023-12-26 01:29:08,774][123090] Updated weights for policy 1, policy_version 237207 (0.0011) [2023-12-26 01:29:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17855.8). Total num frames: 121749504. Throughput: 0: 9253.7, 1: 8739.6. Samples: 121725516. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:08,785][121949] Avg episode reward: [(0, '5873.047'), (1, '5451.530')] [2023-12-26 01:29:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000238384_61030400.pth... [2023-12-26 01:29:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000237296_60751872.pth [2023-12-26 01:29:08,829][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000237216_60727296.pth... [2023-12-26 01:29:08,834][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000236192_60465152.pth [2023-12-26 01:29:09,433][123091] Updated weights for policy 0, policy_version 238387 (0.0009) [2023-12-26 01:29:09,489][123091] Updated weights for policy 0, policy_version 238397 (0.0010) [2023-12-26 01:29:09,548][123091] Updated weights for policy 0, policy_version 238407 (0.0010) [2023-12-26 01:29:09,612][123090] Updated weights for policy 1, policy_version 237217 (0.0011) [2023-12-26 01:29:09,685][123090] Updated weights for policy 1, policy_version 237227 (0.0008) [2023-12-26 01:29:09,740][123090] Updated weights for policy 1, policy_version 237237 (0.0008) [2023-12-26 01:29:09,804][123090] Updated weights for policy 1, policy_version 237247 (0.0010) [2023-12-26 01:29:10,450][123091] Updated weights for policy 0, policy_version 238417 (0.0010) [2023-12-26 01:29:10,516][123091] Updated weights for policy 0, policy_version 238427 (0.0010) [2023-12-26 01:29:10,564][123091] Updated weights for policy 0, policy_version 238437 (0.0008) [2023-12-26 01:29:10,619][123091] Updated weights for policy 0, policy_version 238447 (0.0009) [2023-12-26 01:29:10,640][123090] Updated weights for policy 1, policy_version 237257 (0.0009) [2023-12-26 01:29:10,710][123090] Updated weights for policy 1, policy_version 237267 (0.0010) [2023-12-26 01:29:10,772][123090] Updated weights for policy 1, policy_version 237277 (0.0009) [2023-12-26 01:29:11,519][123091] Updated weights for policy 0, policy_version 238457 (0.0008) [2023-12-26 01:29:11,560][123090] Updated weights for policy 1, policy_version 237287 (0.0010) [2023-12-26 01:29:11,585][123091] Updated weights for policy 0, policy_version 238467 (0.0008) [2023-12-26 01:29:11,622][123090] Updated weights for policy 1, policy_version 237297 (0.0009) [2023-12-26 01:29:11,652][123091] Updated weights for policy 0, policy_version 238477 (0.0008) [2023-12-26 01:29:11,689][123090] Updated weights for policy 1, policy_version 237307 (0.0009) [2023-12-26 01:29:12,496][123091] Updated weights for policy 0, policy_version 238487 (0.0010) [2023-12-26 01:29:12,553][123090] Updated weights for policy 1, policy_version 237317 (0.0008) [2023-12-26 01:29:12,562][123091] Updated weights for policy 0, policy_version 238497 (0.0009) [2023-12-26 01:29:12,625][123090] Updated weights for policy 1, policy_version 237327 (0.0008) [2023-12-26 01:29:12,626][123091] Updated weights for policy 0, policy_version 238507 (0.0007) [2023-12-26 01:29:12,683][123090] Updated weights for policy 1, policy_version 237337 (0.0009) [2023-12-26 01:29:13,345][123091] Updated weights for policy 0, policy_version 238517 (0.0007) [2023-12-26 01:29:13,410][123091] Updated weights for policy 0, policy_version 238527 (0.0008) [2023-12-26 01:29:13,488][123091] Updated weights for policy 0, policy_version 238537 (0.0009) [2023-12-26 01:29:13,514][123090] Updated weights for policy 1, policy_version 237347 (0.0008) [2023-12-26 01:29:13,565][123090] Updated weights for policy 1, policy_version 237357 (0.0005) [2023-12-26 01:29:13,618][123090] Updated weights for policy 1, policy_version 237367 (0.0005) [2023-12-26 01:29:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 121839616. Throughput: 0: 9119.4, 1: 8803.5. Samples: 121829084. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:13,785][121949] Avg episode reward: [(0, '6066.024'), (1, '5335.629')] [2023-12-26 01:29:14,182][123091] Updated weights for policy 0, policy_version 238547 (0.0009) [2023-12-26 01:29:14,237][123091] Updated weights for policy 0, policy_version 238557 (0.0005) [2023-12-26 01:29:14,295][123091] Updated weights for policy 0, policy_version 238567 (0.0005) [2023-12-26 01:29:14,441][123090] Updated weights for policy 1, policy_version 237377 (0.0006) [2023-12-26 01:29:14,509][123090] Updated weights for policy 1, policy_version 237387 (0.0009) [2023-12-26 01:29:14,572][123090] Updated weights for policy 1, policy_version 237397 (0.0006) [2023-12-26 01:29:14,631][123090] Updated weights for policy 1, policy_version 237407 (0.0007) [2023-12-26 01:29:14,964][123091] Updated weights for policy 0, policy_version 238577 (0.0006) [2023-12-26 01:29:15,020][123091] Updated weights for policy 0, policy_version 238587 (0.0008) [2023-12-26 01:29:15,086][123091] Updated weights for policy 0, policy_version 238597 (0.0008) [2023-12-26 01:29:15,139][123091] Updated weights for policy 0, policy_version 238607 (0.0008) [2023-12-26 01:29:15,517][123090] Updated weights for policy 1, policy_version 237417 (0.0008) [2023-12-26 01:29:15,583][123090] Updated weights for policy 1, policy_version 237427 (0.0009) [2023-12-26 01:29:15,647][123090] Updated weights for policy 1, policy_version 237437 (0.0009) [2023-12-26 01:29:15,869][123091] Updated weights for policy 0, policy_version 238617 (0.0006) [2023-12-26 01:29:15,925][123091] Updated weights for policy 0, policy_version 238627 (0.0006) [2023-12-26 01:29:15,982][123091] Updated weights for policy 0, policy_version 238637 (0.0006) [2023-12-26 01:29:16,477][123090] Updated weights for policy 1, policy_version 237447 (0.0010) [2023-12-26 01:29:16,535][123090] Updated weights for policy 1, policy_version 237457 (0.0010) [2023-12-26 01:29:16,594][123090] Updated weights for policy 1, policy_version 237467 (0.0010) [2023-12-26 01:29:16,684][123091] Updated weights for policy 0, policy_version 238647 (0.0008) [2023-12-26 01:29:16,734][123091] Updated weights for policy 0, policy_version 238657 (0.0008) [2023-12-26 01:29:16,784][123091] Updated weights for policy 0, policy_version 238667 (0.0005) [2023-12-26 01:29:17,455][123090] Updated weights for policy 1, policy_version 237477 (0.0009) [2023-12-26 01:29:17,521][123090] Updated weights for policy 1, policy_version 237487 (0.0010) [2023-12-26 01:29:17,584][123090] Updated weights for policy 1, policy_version 237497 (0.0009) [2023-12-26 01:29:17,588][123091] Updated weights for policy 0, policy_version 238677 (0.0007) [2023-12-26 01:29:17,636][123091] Updated weights for policy 0, policy_version 238687 (0.0010) [2023-12-26 01:29:17,689][123091] Updated weights for policy 0, policy_version 238697 (0.0009) [2023-12-26 01:29:18,420][123090] Updated weights for policy 1, policy_version 237507 (0.0008) [2023-12-26 01:29:18,470][123091] Updated weights for policy 0, policy_version 238707 (0.0009) [2023-12-26 01:29:18,491][123090] Updated weights for policy 1, policy_version 237517 (0.0007) [2023-12-26 01:29:18,529][123091] Updated weights for policy 0, policy_version 238717 (0.0011) [2023-12-26 01:29:18,553][123090] Updated weights for policy 1, policy_version 237527 (0.0005) [2023-12-26 01:29:18,592][123091] Updated weights for policy 0, policy_version 238727 (0.0011) [2023-12-26 01:29:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 121929728. Throughput: 0: 9151.8, 1: 8703.1. Samples: 121936996. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:18,785][121949] Avg episode reward: [(0, '6077.170'), (1, '5334.127')] [2023-12-26 01:29:19,333][123090] Updated weights for policy 1, policy_version 237537 (0.0006) [2023-12-26 01:29:19,409][123090] Updated weights for policy 1, policy_version 237547 (0.0008) [2023-12-26 01:29:19,425][123091] Updated weights for policy 0, policy_version 238737 (0.0011) [2023-12-26 01:29:19,467][123090] Updated weights for policy 1, policy_version 237557 (0.0006) [2023-12-26 01:29:19,481][123091] Updated weights for policy 0, policy_version 238747 (0.0010) [2023-12-26 01:29:19,532][123090] Updated weights for policy 1, policy_version 237567 (0.0007) [2023-12-26 01:29:19,546][123091] Updated weights for policy 0, policy_version 238757 (0.0010) [2023-12-26 01:29:19,609][123091] Updated weights for policy 0, policy_version 238767 (0.0011) [2023-12-26 01:29:20,376][123090] Updated weights for policy 1, policy_version 237577 (0.0009) [2023-12-26 01:29:20,439][123090] Updated weights for policy 1, policy_version 237587 (0.0010) [2023-12-26 01:29:20,446][123091] Updated weights for policy 0, policy_version 238777 (0.0011) [2023-12-26 01:29:20,494][123091] Updated weights for policy 0, policy_version 238787 (0.0010) [2023-12-26 01:29:20,503][123090] Updated weights for policy 1, policy_version 237597 (0.0007) [2023-12-26 01:29:20,546][123091] Updated weights for policy 0, policy_version 238797 (0.0010) [2023-12-26 01:29:21,366][123090] Updated weights for policy 1, policy_version 237607 (0.0009) [2023-12-26 01:29:21,431][123090] Updated weights for policy 1, policy_version 237617 (0.0008) [2023-12-26 01:29:21,444][123091] Updated weights for policy 0, policy_version 238807 (0.0011) [2023-12-26 01:29:21,496][123090] Updated weights for policy 1, policy_version 237627 (0.0009) [2023-12-26 01:29:21,509][123091] Updated weights for policy 0, policy_version 238817 (0.0010) [2023-12-26 01:29:21,568][123091] Updated weights for policy 0, policy_version 238827 (0.0011) [2023-12-26 01:29:22,334][123090] Updated weights for policy 1, policy_version 237637 (0.0008) [2023-12-26 01:29:22,388][123091] Updated weights for policy 0, policy_version 238837 (0.0009) [2023-12-26 01:29:22,405][123090] Updated weights for policy 1, policy_version 237647 (0.0007) [2023-12-26 01:29:22,450][123091] Updated weights for policy 0, policy_version 238847 (0.0006) [2023-12-26 01:29:22,468][123090] Updated weights for policy 1, policy_version 237657 (0.0006) [2023-12-26 01:29:22,519][123091] Updated weights for policy 0, policy_version 238857 (0.0006) [2023-12-26 01:29:23,211][123090] Updated weights for policy 1, policy_version 237667 (0.0007) [2023-12-26 01:29:23,235][123091] Updated weights for policy 0, policy_version 238867 (0.0007) [2023-12-26 01:29:23,268][123090] Updated weights for policy 1, policy_version 237677 (0.0006) [2023-12-26 01:29:23,291][123091] Updated weights for policy 0, policy_version 238877 (0.0011) [2023-12-26 01:29:23,329][123090] Updated weights for policy 1, policy_version 237687 (0.0006) [2023-12-26 01:29:23,340][123091] Updated weights for policy 0, policy_version 238887 (0.0011) [2023-12-26 01:29:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 122011648. Throughput: 0: 9029.4, 1: 8660.9. Samples: 121986964. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:23,785][121949] Avg episode reward: [(0, '6021.343'), (1, '5329.939')] [2023-12-26 01:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000237696_60850176.pth... [2023-12-26 01:29:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000238896_61161472.pth... [2023-12-26 01:29:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000236672_60588032.pth [2023-12-26 01:29:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000237840_60891136.pth [2023-12-26 01:29:24,176][123091] Updated weights for policy 0, policy_version 238897 (0.0011) [2023-12-26 01:29:24,199][123090] Updated weights for policy 1, policy_version 237697 (0.0009) [2023-12-26 01:29:24,244][123091] Updated weights for policy 0, policy_version 238907 (0.0011) [2023-12-26 01:29:24,264][123090] Updated weights for policy 1, policy_version 237707 (0.0009) [2023-12-26 01:29:24,307][123091] Updated weights for policy 0, policy_version 238917 (0.0011) [2023-12-26 01:29:24,327][123090] Updated weights for policy 1, policy_version 237717 (0.0009) [2023-12-26 01:29:24,374][123091] Updated weights for policy 0, policy_version 238927 (0.0011) [2023-12-26 01:29:24,391][123090] Updated weights for policy 1, policy_version 237727 (0.0009) [2023-12-26 01:29:25,186][123091] Updated weights for policy 0, policy_version 238937 (0.0011) [2023-12-26 01:29:25,223][123090] Updated weights for policy 1, policy_version 237737 (0.0006) [2023-12-26 01:29:25,250][123091] Updated weights for policy 0, policy_version 238947 (0.0011) [2023-12-26 01:29:25,286][123090] Updated weights for policy 1, policy_version 237747 (0.0008) [2023-12-26 01:29:25,316][123091] Updated weights for policy 0, policy_version 238957 (0.0011) [2023-12-26 01:29:25,350][123090] Updated weights for policy 1, policy_version 237757 (0.0009) [2023-12-26 01:29:26,119][123091] Updated weights for policy 0, policy_version 238967 (0.0011) [2023-12-26 01:29:26,152][123090] Updated weights for policy 1, policy_version 237767 (0.0006) [2023-12-26 01:29:26,163][123091] Updated weights for policy 0, policy_version 238977 (0.0010) [2023-12-26 01:29:26,196][123090] Updated weights for policy 1, policy_version 237777 (0.0005) [2023-12-26 01:29:26,210][123091] Updated weights for policy 0, policy_version 238987 (0.0010) [2023-12-26 01:29:26,244][123090] Updated weights for policy 1, policy_version 237787 (0.0006) [2023-12-26 01:29:26,997][123090] Updated weights for policy 1, policy_version 237797 (0.0008) [2023-12-26 01:29:27,054][123091] Updated weights for policy 0, policy_version 238997 (0.0010) [2023-12-26 01:29:27,063][123090] Updated weights for policy 1, policy_version 237807 (0.0007) [2023-12-26 01:29:27,109][123091] Updated weights for policy 0, policy_version 239007 (0.0010) [2023-12-26 01:29:27,132][123090] Updated weights for policy 1, policy_version 237817 (0.0007) [2023-12-26 01:29:27,171][123091] Updated weights for policy 0, policy_version 239017 (0.0011) [2023-12-26 01:29:27,691][123090] Updated weights for policy 1, policy_version 237827 (0.0007) [2023-12-26 01:29:27,755][123090] Updated weights for policy 1, policy_version 237837 (0.0005) [2023-12-26 01:29:27,827][123090] Updated weights for policy 1, policy_version 237847 (0.0005) [2023-12-26 01:29:27,836][123091] Updated weights for policy 0, policy_version 239027 (0.0010) [2023-12-26 01:29:27,891][123091] Updated weights for policy 0, policy_version 239037 (0.0010) [2023-12-26 01:29:27,947][123091] Updated weights for policy 0, policy_version 239047 (0.0010) [2023-12-26 01:29:28,468][123090] Updated weights for policy 1, policy_version 237857 (0.0005) [2023-12-26 01:29:28,538][123090] Updated weights for policy 1, policy_version 237867 (0.0005) [2023-12-26 01:29:28,606][123090] Updated weights for policy 1, policy_version 237877 (0.0005) [2023-12-26 01:29:28,672][123090] Updated weights for policy 1, policy_version 237887 (0.0005) [2023-12-26 01:29:28,782][123091] Updated weights for policy 0, policy_version 239057 (0.0010) [2023-12-26 01:29:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 122101760. Throughput: 0: 9023.4, 1: 8739.0. Samples: 122093836. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:28,784][121949] Avg episode reward: [(0, '5967.706'), (1, '5498.210')] [2023-12-26 01:29:28,844][123091] Updated weights for policy 0, policy_version 239067 (0.0011) [2023-12-26 01:29:28,910][123091] Updated weights for policy 0, policy_version 239077 (0.0011) [2023-12-26 01:29:28,975][123091] Updated weights for policy 0, policy_version 239087 (0.0010) [2023-12-26 01:29:29,296][123090] Updated weights for policy 1, policy_version 237897 (0.0007) [2023-12-26 01:29:29,361][123090] Updated weights for policy 1, policy_version 237907 (0.0006) [2023-12-26 01:29:29,425][123090] Updated weights for policy 1, policy_version 237917 (0.0010) [2023-12-26 01:29:29,717][123091] Updated weights for policy 0, policy_version 239097 (0.0006) [2023-12-26 01:29:29,768][123091] Updated weights for policy 0, policy_version 239107 (0.0005) [2023-12-26 01:29:29,841][123091] Updated weights for policy 0, policy_version 239117 (0.0008) [2023-12-26 01:29:30,169][123090] Updated weights for policy 1, policy_version 237927 (0.0010) [2023-12-26 01:29:30,230][123090] Updated weights for policy 1, policy_version 237937 (0.0009) [2023-12-26 01:29:30,295][123090] Updated weights for policy 1, policy_version 237947 (0.0009) [2023-12-26 01:29:30,613][123091] Updated weights for policy 0, policy_version 239127 (0.0011) [2023-12-26 01:29:30,656][123091] Updated weights for policy 0, policy_version 239137 (0.0010) [2023-12-26 01:29:30,707][123091] Updated weights for policy 0, policy_version 239147 (0.0010) [2023-12-26 01:29:31,076][123090] Updated weights for policy 1, policy_version 237957 (0.0007) [2023-12-26 01:29:31,145][123090] Updated weights for policy 1, policy_version 237967 (0.0009) [2023-12-26 01:29:31,210][123090] Updated weights for policy 1, policy_version 237977 (0.0009) [2023-12-26 01:29:31,524][123091] Updated weights for policy 0, policy_version 239157 (0.0010) [2023-12-26 01:29:31,586][123091] Updated weights for policy 0, policy_version 239167 (0.0008) [2023-12-26 01:29:31,653][123091] Updated weights for policy 0, policy_version 239177 (0.0011) [2023-12-26 01:29:32,043][123090] Updated weights for policy 1, policy_version 237987 (0.0010) [2023-12-26 01:29:32,112][123090] Updated weights for policy 1, policy_version 237997 (0.0009) [2023-12-26 01:29:32,184][123090] Updated weights for policy 1, policy_version 238007 (0.0009) [2023-12-26 01:29:32,486][123091] Updated weights for policy 0, policy_version 239187 (0.0011) [2023-12-26 01:29:32,552][123091] Updated weights for policy 0, policy_version 239197 (0.0011) [2023-12-26 01:29:32,618][123091] Updated weights for policy 0, policy_version 239207 (0.0010) [2023-12-26 01:29:32,975][123090] Updated weights for policy 1, policy_version 238017 (0.0008) [2023-12-26 01:29:33,041][123090] Updated weights for policy 1, policy_version 238027 (0.0007) [2023-12-26 01:29:33,103][123090] Updated weights for policy 1, policy_version 238037 (0.0008) [2023-12-26 01:29:33,158][123090] Updated weights for policy 1, policy_version 238047 (0.0008) [2023-12-26 01:29:33,426][123091] Updated weights for policy 0, policy_version 239217 (0.0011) [2023-12-26 01:29:33,470][123091] Updated weights for policy 0, policy_version 239227 (0.0010) [2023-12-26 01:29:33,520][123091] Updated weights for policy 0, policy_version 239237 (0.0010) [2023-12-26 01:29:33,579][123091] Updated weights for policy 0, policy_version 239247 (0.0010) [2023-12-26 01:29:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 122191872. Throughput: 0: 8919.2, 1: 8802.0. Samples: 122202784. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:33,785][121949] Avg episode reward: [(0, '6043.465'), (1, '5525.449')] [2023-12-26 01:29:33,860][123090] Updated weights for policy 1, policy_version 238057 (0.0006) [2023-12-26 01:29:33,919][123090] Updated weights for policy 1, policy_version 238067 (0.0005) [2023-12-26 01:29:33,966][123090] Updated weights for policy 1, policy_version 238077 (0.0005) [2023-12-26 01:29:34,286][123091] Updated weights for policy 0, policy_version 239257 (0.0006) [2023-12-26 01:29:34,352][123091] Updated weights for policy 0, policy_version 239267 (0.0007) [2023-12-26 01:29:34,415][123091] Updated weights for policy 0, policy_version 239277 (0.0011) [2023-12-26 01:29:34,685][123090] Updated weights for policy 1, policy_version 238087 (0.0006) [2023-12-26 01:29:34,761][123090] Updated weights for policy 1, policy_version 238097 (0.0010) [2023-12-26 01:29:34,810][123090] Updated weights for policy 1, policy_version 238107 (0.0009) [2023-12-26 01:29:35,116][123091] Updated weights for policy 0, policy_version 239287 (0.0008) [2023-12-26 01:29:35,164][123091] Updated weights for policy 0, policy_version 239297 (0.0007) [2023-12-26 01:29:35,230][123091] Updated weights for policy 0, policy_version 239307 (0.0006) [2023-12-26 01:29:35,567][123090] Updated weights for policy 1, policy_version 238117 (0.0007) [2023-12-26 01:29:35,617][123090] Updated weights for policy 1, policy_version 238127 (0.0005) [2023-12-26 01:29:35,662][123090] Updated weights for policy 1, policy_version 238137 (0.0005) [2023-12-26 01:29:35,960][123091] Updated weights for policy 0, policy_version 239317 (0.0007) [2023-12-26 01:29:36,024][123091] Updated weights for policy 0, policy_version 239327 (0.0010) [2023-12-26 01:29:36,075][123091] Updated weights for policy 0, policy_version 239337 (0.0005) [2023-12-26 01:29:36,438][123090] Updated weights for policy 1, policy_version 238147 (0.0008) [2023-12-26 01:29:36,503][123090] Updated weights for policy 1, policy_version 238157 (0.0007) [2023-12-26 01:29:36,568][123090] Updated weights for policy 1, policy_version 238167 (0.0005) [2023-12-26 01:29:36,850][123091] Updated weights for policy 0, policy_version 239347 (0.0007) [2023-12-26 01:29:36,903][123091] Updated weights for policy 0, policy_version 239357 (0.0009) [2023-12-26 01:29:36,964][123091] Updated weights for policy 0, policy_version 239367 (0.0009) [2023-12-26 01:29:37,334][123090] Updated weights for policy 1, policy_version 238177 (0.0006) [2023-12-26 01:29:37,386][123090] Updated weights for policy 1, policy_version 238187 (0.0006) [2023-12-26 01:29:37,447][123090] Updated weights for policy 1, policy_version 238197 (0.0009) [2023-12-26 01:29:37,501][123090] Updated weights for policy 1, policy_version 238207 (0.0010) [2023-12-26 01:29:37,687][123091] Updated weights for policy 0, policy_version 239377 (0.0008) [2023-12-26 01:29:37,747][123091] Updated weights for policy 0, policy_version 239387 (0.0006) [2023-12-26 01:29:37,799][123091] Updated weights for policy 0, policy_version 239397 (0.0005) [2023-12-26 01:29:37,855][123091] Updated weights for policy 0, policy_version 239407 (0.0005) [2023-12-26 01:29:38,234][123090] Updated weights for policy 1, policy_version 238217 (0.0010) [2023-12-26 01:29:38,289][123090] Updated weights for policy 1, policy_version 238227 (0.0010) [2023-12-26 01:29:38,356][123090] Updated weights for policy 1, policy_version 238237 (0.0011) [2023-12-26 01:29:38,605][123091] Updated weights for policy 0, policy_version 239417 (0.0006) [2023-12-26 01:29:38,671][123091] Updated weights for policy 0, policy_version 239427 (0.0007) [2023-12-26 01:29:38,729][123091] Updated weights for policy 0, policy_version 239437 (0.0006) [2023-12-26 01:29:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 122290176. Throughput: 0: 9008.2, 1: 8819.7. Samples: 122260588. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:38,784][121949] Avg episode reward: [(0, '6109.275'), (1, '5558.980')] [2023-12-26 01:29:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000239440_61300736.pth... [2023-12-26 01:29:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000238240_60989440.pth... [2023-12-26 01:29:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000238384_61030400.pth [2023-12-26 01:29:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000237216_60727296.pth [2023-12-26 01:29:39,214][123090] Updated weights for policy 1, policy_version 238247 (0.0010) [2023-12-26 01:29:39,277][123090] Updated weights for policy 1, policy_version 238257 (0.0010) [2023-12-26 01:29:39,346][123090] Updated weights for policy 1, policy_version 238267 (0.0011) [2023-12-26 01:29:39,549][123091] Updated weights for policy 0, policy_version 239447 (0.0009) [2023-12-26 01:29:39,600][123091] Updated weights for policy 0, policy_version 239457 (0.0009) [2023-12-26 01:29:39,658][123091] Updated weights for policy 0, policy_version 239467 (0.0009) [2023-12-26 01:29:40,189][123090] Updated weights for policy 1, policy_version 238277 (0.0010) [2023-12-26 01:29:40,250][123090] Updated weights for policy 1, policy_version 238287 (0.0009) [2023-12-26 01:29:40,300][123090] Updated weights for policy 1, policy_version 238297 (0.0010) [2023-12-26 01:29:40,503][123091] Updated weights for policy 0, policy_version 239477 (0.0010) [2023-12-26 01:29:40,572][123091] Updated weights for policy 0, policy_version 239487 (0.0009) [2023-12-26 01:29:40,634][123091] Updated weights for policy 0, policy_version 239497 (0.0009) [2023-12-26 01:29:41,172][123090] Updated weights for policy 1, policy_version 238307 (0.0009) [2023-12-26 01:29:41,237][123090] Updated weights for policy 1, policy_version 238317 (0.0009) [2023-12-26 01:29:41,296][123090] Updated weights for policy 1, policy_version 238327 (0.0010) [2023-12-26 01:29:41,478][123091] Updated weights for policy 0, policy_version 239507 (0.0010) [2023-12-26 01:29:41,530][123091] Updated weights for policy 0, policy_version 239517 (0.0010) [2023-12-26 01:29:41,578][123091] Updated weights for policy 0, policy_version 239527 (0.0009) [2023-12-26 01:29:42,222][123090] Updated weights for policy 1, policy_version 238337 (0.0010) [2023-12-26 01:29:42,293][123090] Updated weights for policy 1, policy_version 238347 (0.0010) [2023-12-26 01:29:42,362][123090] Updated weights for policy 1, policy_version 238357 (0.0010) [2023-12-26 01:29:42,373][123091] Updated weights for policy 0, policy_version 239537 (0.0008) [2023-12-26 01:29:42,432][123090] Updated weights for policy 1, policy_version 238367 (0.0008) [2023-12-26 01:29:42,438][123091] Updated weights for policy 0, policy_version 239547 (0.0007) [2023-12-26 01:29:42,505][123091] Updated weights for policy 0, policy_version 239557 (0.0009) [2023-12-26 01:29:42,575][123091] Updated weights for policy 0, policy_version 239567 (0.0009) [2023-12-26 01:29:43,248][123090] Updated weights for policy 1, policy_version 238377 (0.0010) [2023-12-26 01:29:43,302][123090] Updated weights for policy 1, policy_version 238387 (0.0009) [2023-12-26 01:29:43,327][123091] Updated weights for policy 0, policy_version 239577 (0.0010) [2023-12-26 01:29:43,365][123090] Updated weights for policy 1, policy_version 238397 (0.0009) [2023-12-26 01:29:43,377][123091] Updated weights for policy 0, policy_version 239587 (0.0008) [2023-12-26 01:29:43,428][123091] Updated weights for policy 0, policy_version 239597 (0.0008) [2023-12-26 01:29:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 122372096. Throughput: 0: 8940.5, 1: 8823.9. Samples: 122364084. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:43,784][121949] Avg episode reward: [(0, '6072.908'), (1, '5648.092')] [2023-12-26 01:29:44,196][123090] Updated weights for policy 1, policy_version 238407 (0.0008) [2023-12-26 01:29:44,254][123090] Updated weights for policy 1, policy_version 238417 (0.0008) [2023-12-26 01:29:44,256][123091] Updated weights for policy 0, policy_version 239607 (0.0009) [2023-12-26 01:29:44,308][123090] Updated weights for policy 1, policy_version 238427 (0.0006) [2023-12-26 01:29:44,319][123091] Updated weights for policy 0, policy_version 239617 (0.0010) [2023-12-26 01:29:44,387][123091] Updated weights for policy 0, policy_version 239627 (0.0009) [2023-12-26 01:29:45,125][123090] Updated weights for policy 1, policy_version 238437 (0.0008) [2023-12-26 01:29:45,194][123090] Updated weights for policy 1, policy_version 238447 (0.0010) [2023-12-26 01:29:45,248][123091] Updated weights for policy 0, policy_version 239637 (0.0009) [2023-12-26 01:29:45,261][123090] Updated weights for policy 1, policy_version 238457 (0.0007) [2023-12-26 01:29:45,311][123091] Updated weights for policy 0, policy_version 239647 (0.0008) [2023-12-26 01:29:45,379][123091] Updated weights for policy 0, policy_version 239657 (0.0009) [2023-12-26 01:29:46,008][123090] Updated weights for policy 1, policy_version 238467 (0.0009) [2023-12-26 01:29:46,071][123090] Updated weights for policy 1, policy_version 238477 (0.0008) [2023-12-26 01:29:46,128][123090] Updated weights for policy 1, policy_version 238487 (0.0008) [2023-12-26 01:29:46,223][123091] Updated weights for policy 0, policy_version 239667 (0.0010) [2023-12-26 01:29:46,285][123091] Updated weights for policy 0, policy_version 239677 (0.0010) [2023-12-26 01:29:46,350][123091] Updated weights for policy 0, policy_version 239687 (0.0009) [2023-12-26 01:29:46,810][123090] Updated weights for policy 1, policy_version 238497 (0.0008) [2023-12-26 01:29:46,873][123090] Updated weights for policy 1, policy_version 238507 (0.0005) [2023-12-26 01:29:46,923][123090] Updated weights for policy 1, policy_version 238517 (0.0005) [2023-12-26 01:29:46,980][123090] Updated weights for policy 1, policy_version 238527 (0.0005) [2023-12-26 01:29:47,207][123091] Updated weights for policy 0, policy_version 239697 (0.0009) [2023-12-26 01:29:47,268][123091] Updated weights for policy 0, policy_version 239707 (0.0005) [2023-12-26 01:29:47,334][123091] Updated weights for policy 0, policy_version 239717 (0.0008) [2023-12-26 01:29:47,410][123091] Updated weights for policy 0, policy_version 239727 (0.0005) [2023-12-26 01:29:47,669][123090] Updated weights for policy 1, policy_version 238537 (0.0005) [2023-12-26 01:29:47,732][123090] Updated weights for policy 1, policy_version 238547 (0.0007) [2023-12-26 01:29:47,803][123090] Updated weights for policy 1, policy_version 238557 (0.0008) [2023-12-26 01:29:48,051][123091] Updated weights for policy 0, policy_version 239737 (0.0005) [2023-12-26 01:29:48,101][123091] Updated weights for policy 0, policy_version 239747 (0.0005) [2023-12-26 01:29:48,156][123091] Updated weights for policy 0, policy_version 239757 (0.0006) [2023-12-26 01:29:48,534][123090] Updated weights for policy 1, policy_version 238567 (0.0008) [2023-12-26 01:29:48,600][123090] Updated weights for policy 1, policy_version 238577 (0.0010) [2023-12-26 01:29:48,655][123090] Updated weights for policy 1, policy_version 238587 (0.0010) [2023-12-26 01:29:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 122462208. Throughput: 0: 8904.4, 1: 8884.7. Samples: 122472904. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:48,785][121949] Avg episode reward: [(0, '5924.381'), (1, '5553.196')] [2023-12-26 01:29:48,944][123091] Updated weights for policy 0, policy_version 239767 (0.0008) [2023-12-26 01:29:48,998][123091] Updated weights for policy 0, policy_version 239777 (0.0009) [2023-12-26 01:29:49,051][123091] Updated weights for policy 0, policy_version 239787 (0.0009) [2023-12-26 01:29:49,460][123090] Updated weights for policy 1, policy_version 238597 (0.0011) [2023-12-26 01:29:49,513][123090] Updated weights for policy 1, policy_version 238607 (0.0010) [2023-12-26 01:29:49,569][123090] Updated weights for policy 1, policy_version 238617 (0.0010) [2023-12-26 01:29:49,947][123091] Updated weights for policy 0, policy_version 239797 (0.0009) [2023-12-26 01:29:50,005][123091] Updated weights for policy 0, policy_version 239807 (0.0009) [2023-12-26 01:29:50,069][123091] Updated weights for policy 0, policy_version 239817 (0.0009) [2023-12-26 01:29:50,403][123090] Updated weights for policy 1, policy_version 238627 (0.0010) [2023-12-26 01:29:50,474][123090] Updated weights for policy 1, policy_version 238637 (0.0011) [2023-12-26 01:29:50,530][123090] Updated weights for policy 1, policy_version 238647 (0.0010) [2023-12-26 01:29:50,886][123091] Updated weights for policy 0, policy_version 239827 (0.0009) [2023-12-26 01:29:50,938][123091] Updated weights for policy 0, policy_version 239837 (0.0009) [2023-12-26 01:29:50,990][123091] Updated weights for policy 0, policy_version 239848 (0.0009) [2023-12-26 01:29:51,297][123090] Updated weights for policy 1, policy_version 238657 (0.0010) [2023-12-26 01:29:51,371][123090] Updated weights for policy 1, policy_version 238667 (0.0008) [2023-12-26 01:29:51,435][123090] Updated weights for policy 1, policy_version 238677 (0.0009) [2023-12-26 01:29:51,498][123090] Updated weights for policy 1, policy_version 238687 (0.0006) [2023-12-26 01:29:51,853][123091] Updated weights for policy 0, policy_version 239858 (0.0009) [2023-12-26 01:29:51,920][123091] Updated weights for policy 0, policy_version 239868 (0.0009) [2023-12-26 01:29:51,977][123091] Updated weights for policy 0, policy_version 239878 (0.0009) [2023-12-26 01:29:52,043][123091] Updated weights for policy 0, policy_version 239888 (0.0010) [2023-12-26 01:29:52,332][123090] Updated weights for policy 1, policy_version 238697 (0.0009) [2023-12-26 01:29:52,403][123090] Updated weights for policy 1, policy_version 238707 (0.0009) [2023-12-26 01:29:52,469][123090] Updated weights for policy 1, policy_version 238717 (0.0010) [2023-12-26 01:29:52,752][123091] Updated weights for policy 0, policy_version 239898 (0.0005) [2023-12-26 01:29:52,800][123091] Updated weights for policy 0, policy_version 239908 (0.0005) [2023-12-26 01:29:52,852][123091] Updated weights for policy 0, policy_version 239918 (0.0006) [2023-12-26 01:29:53,299][123090] Updated weights for policy 1, policy_version 238727 (0.0007) [2023-12-26 01:29:53,352][123090] Updated weights for policy 1, policy_version 238737 (0.0005) [2023-12-26 01:29:53,408][123090] Updated weights for policy 1, policy_version 238747 (0.0005) [2023-12-26 01:29:53,609][123091] Updated weights for policy 0, policy_version 239928 (0.0009) [2023-12-26 01:29:53,663][123091] Updated weights for policy 0, policy_version 239939 (0.0010) [2023-12-26 01:29:53,734][123091] Updated weights for policy 0, policy_version 239949 (0.0009) [2023-12-26 01:29:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 122552320. Throughput: 0: 8895.1, 1: 8860.5. Samples: 122524512. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:53,785][121949] Avg episode reward: [(0, '5974.217'), (1, '5597.785')] [2023-12-26 01:29:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000238752_61120512.pth... [2023-12-26 01:29:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000239952_61431808.pth... [2023-12-26 01:29:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000237696_60850176.pth [2023-12-26 01:29:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000238896_61161472.pth [2023-12-26 01:29:54,144][123090] Updated weights for policy 1, policy_version 238757 (0.0008) [2023-12-26 01:29:54,207][123090] Updated weights for policy 1, policy_version 238767 (0.0009) [2023-12-26 01:29:54,271][123090] Updated weights for policy 1, policy_version 238777 (0.0008) [2023-12-26 01:29:54,624][123091] Updated weights for policy 0, policy_version 239959 (0.0009) [2023-12-26 01:29:54,692][123091] Updated weights for policy 0, policy_version 239969 (0.0010) [2023-12-26 01:29:54,754][123091] Updated weights for policy 0, policy_version 239979 (0.0009) [2023-12-26 01:29:55,094][123090] Updated weights for policy 1, policy_version 238787 (0.0010) [2023-12-26 01:29:55,143][123090] Updated weights for policy 1, policy_version 238797 (0.0009) [2023-12-26 01:29:55,193][123090] Updated weights for policy 1, policy_version 238807 (0.0009) [2023-12-26 01:29:55,583][123091] Updated weights for policy 0, policy_version 239989 (0.0009) [2023-12-26 01:29:55,646][123091] Updated weights for policy 0, policy_version 239999 (0.0009) [2023-12-26 01:29:55,702][123091] Updated weights for policy 0, policy_version 240009 (0.0008) [2023-12-26 01:29:56,019][123090] Updated weights for policy 1, policy_version 238817 (0.0009) [2023-12-26 01:29:56,080][123090] Updated weights for policy 1, policy_version 238827 (0.0009) [2023-12-26 01:29:56,133][123090] Updated weights for policy 1, policy_version 238837 (0.0009) [2023-12-26 01:29:56,187][123090] Updated weights for policy 1, policy_version 238847 (0.0006) [2023-12-26 01:29:56,575][123091] Updated weights for policy 0, policy_version 240019 (0.0010) [2023-12-26 01:29:56,638][123091] Updated weights for policy 0, policy_version 240029 (0.0009) [2023-12-26 01:29:56,703][123091] Updated weights for policy 0, policy_version 240039 (0.0009) [2023-12-26 01:29:56,915][123090] Updated weights for policy 1, policy_version 238857 (0.0010) [2023-12-26 01:29:56,985][123090] Updated weights for policy 1, policy_version 238867 (0.0009) [2023-12-26 01:29:57,039][123090] Updated weights for policy 1, policy_version 238877 (0.0007) [2023-12-26 01:29:57,560][123091] Updated weights for policy 0, policy_version 240049 (0.0010) [2023-12-26 01:29:57,619][123091] Updated weights for policy 0, policy_version 240060 (0.0008) [2023-12-26 01:29:57,675][123091] Updated weights for policy 0, policy_version 240070 (0.0009) [2023-12-26 01:29:57,730][123091] Updated weights for policy 0, policy_version 240080 (0.0009) [2023-12-26 01:29:57,748][123090] Updated weights for policy 1, policy_version 238887 (0.0007) [2023-12-26 01:29:57,793][123090] Updated weights for policy 1, policy_version 238897 (0.0008) [2023-12-26 01:29:57,840][123090] Updated weights for policy 1, policy_version 238907 (0.0009) [2023-12-26 01:29:58,627][123091] Updated weights for policy 0, policy_version 240090 (0.0007) [2023-12-26 01:29:58,711][123091] Updated weights for policy 0, policy_version 240100 (0.0007) [2023-12-26 01:29:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 122626048. Throughput: 0: 8903.7, 1: 8878.7. Samples: 122629296. Policy #0 lag: (min: 15.0, avg: 24.2, max: 47.0) [2023-12-26 01:29:58,785][121949] Avg episode reward: [(0, '5890.906'), (1, '5653.382')] [2023-12-26 01:29:58,795][123091] Updated weights for policy 0, policy_version 240110 (0.0008) [2023-12-26 01:29:58,872][123090] Updated weights for policy 1, policy_version 238917 (0.0008) [2023-12-26 01:29:58,942][123090] Updated weights for policy 1, policy_version 238927 (0.0008) [2023-12-26 01:29:58,997][123090] Updated weights for policy 1, policy_version 238937 (0.0008) [2023-12-26 01:29:59,653][123091] Updated weights for policy 0, policy_version 240120 (0.0010) [2023-12-26 01:29:59,740][123091] Updated weights for policy 0, policy_version 240130 (0.0006) [2023-12-26 01:29:59,778][123090] Updated weights for policy 1, policy_version 238947 (0.0007) [2023-12-26 01:29:59,805][123091] Updated weights for policy 0, policy_version 240140 (0.0009) [2023-12-26 01:29:59,844][123090] Updated weights for policy 1, policy_version 238957 (0.0006) [2023-12-26 01:29:59,909][123090] Updated weights for policy 1, policy_version 238968 (0.0010) [2023-12-26 01:30:00,559][123091] Updated weights for policy 0, policy_version 240150 (0.0010) [2023-12-26 01:30:00,612][123091] Updated weights for policy 0, policy_version 240160 (0.0010) [2023-12-26 01:30:00,668][123091] Updated weights for policy 0, policy_version 240170 (0.0010) [2023-12-26 01:30:00,703][123090] Updated weights for policy 1, policy_version 238978 (0.0009) [2023-12-26 01:30:00,761][123090] Updated weights for policy 1, policy_version 238988 (0.0006) [2023-12-26 01:30:00,835][123090] Updated weights for policy 1, policy_version 238998 (0.0007) [2023-12-26 01:30:00,904][123090] Updated weights for policy 1, policy_version 239008 (0.0010) [2023-12-26 01:30:01,497][123091] Updated weights for policy 0, policy_version 240180 (0.0009) [2023-12-26 01:30:01,550][123091] Updated weights for policy 0, policy_version 240190 (0.0009) [2023-12-26 01:30:01,606][123091] Updated weights for policy 0, policy_version 240200 (0.0009) [2023-12-26 01:30:01,673][123090] Updated weights for policy 1, policy_version 239018 (0.0009) [2023-12-26 01:30:01,733][123090] Updated weights for policy 1, policy_version 239028 (0.0009) [2023-12-26 01:30:01,793][123090] Updated weights for policy 1, policy_version 239038 (0.0007) [2023-12-26 01:30:02,325][123091] Updated weights for policy 0, policy_version 240210 (0.0008) [2023-12-26 01:30:02,393][123091] Updated weights for policy 0, policy_version 240220 (0.0008) [2023-12-26 01:30:02,457][123091] Updated weights for policy 0, policy_version 240230 (0.0010) [2023-12-26 01:30:02,519][123091] Updated weights for policy 0, policy_version 240240 (0.0008) [2023-12-26 01:30:02,531][123090] Updated weights for policy 1, policy_version 239048 (0.0007) [2023-12-26 01:30:02,588][123090] Updated weights for policy 1, policy_version 239058 (0.0009) [2023-12-26 01:30:02,641][123090] Updated weights for policy 1, policy_version 239068 (0.0009) [2023-12-26 01:30:03,249][123091] Updated weights for policy 0, policy_version 240250 (0.0008) [2023-12-26 01:30:03,312][123091] Updated weights for policy 0, policy_version 240260 (0.0009) [2023-12-26 01:30:03,364][123091] Updated weights for policy 0, policy_version 240270 (0.0009) [2023-12-26 01:30:03,488][123090] Updated weights for policy 1, policy_version 239078 (0.0009) [2023-12-26 01:30:03,548][123090] Updated weights for policy 1, policy_version 239088 (0.0010) [2023-12-26 01:30:03,616][123090] Updated weights for policy 1, policy_version 239098 (0.0008) [2023-12-26 01:30:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 122724352. Throughput: 0: 8799.5, 1: 8900.8. Samples: 122733504. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:03,785][121949] Avg episode reward: [(0, '5766.900'), (1, '5701.291')] [2023-12-26 01:30:04,193][123091] Updated weights for policy 0, policy_version 240280 (0.0009) [2023-12-26 01:30:04,255][123091] Updated weights for policy 0, policy_version 240290 (0.0010) [2023-12-26 01:30:04,313][123091] Updated weights for policy 0, policy_version 240300 (0.0009) [2023-12-26 01:30:04,350][123090] Updated weights for policy 1, policy_version 239108 (0.0008) [2023-12-26 01:30:04,421][123090] Updated weights for policy 1, policy_version 239118 (0.0008) [2023-12-26 01:30:04,488][123090] Updated weights for policy 1, policy_version 239128 (0.0008) [2023-12-26 01:30:05,182][123090] Updated weights for policy 1, policy_version 239138 (0.0008) [2023-12-26 01:30:05,206][123091] Updated weights for policy 0, policy_version 240310 (0.0009) [2023-12-26 01:30:05,245][123090] Updated weights for policy 1, policy_version 239148 (0.0007) [2023-12-26 01:30:05,269][123091] Updated weights for policy 0, policy_version 240320 (0.0007) [2023-12-26 01:30:05,311][123090] Updated weights for policy 1, policy_version 239158 (0.0006) [2023-12-26 01:30:05,330][123091] Updated weights for policy 0, policy_version 240330 (0.0005) [2023-12-26 01:30:05,373][123090] Updated weights for policy 1, policy_version 239168 (0.0007) [2023-12-26 01:30:05,995][123091] Updated weights for policy 0, policy_version 240340 (0.0005) [2023-12-26 01:30:06,036][123090] Updated weights for policy 1, policy_version 239178 (0.0009) [2023-12-26 01:30:06,053][123091] Updated weights for policy 0, policy_version 240350 (0.0005) [2023-12-26 01:30:06,095][123090] Updated weights for policy 1, policy_version 239188 (0.0008) [2023-12-26 01:30:06,114][123091] Updated weights for policy 0, policy_version 240360 (0.0006) [2023-12-26 01:30:06,162][123090] Updated weights for policy 1, policy_version 239198 (0.0009) [2023-12-26 01:30:06,763][123091] Updated weights for policy 0, policy_version 240370 (0.0008) [2023-12-26 01:30:06,815][123091] Updated weights for policy 0, policy_version 240380 (0.0007) [2023-12-26 01:30:06,873][123091] Updated weights for policy 0, policy_version 240390 (0.0008) [2023-12-26 01:30:06,929][123091] Updated weights for policy 0, policy_version 240400 (0.0006) [2023-12-26 01:30:07,060][123090] Updated weights for policy 1, policy_version 239208 (0.0006) [2023-12-26 01:30:07,128][123090] Updated weights for policy 1, policy_version 239218 (0.0005) [2023-12-26 01:30:07,186][123090] Updated weights for policy 1, policy_version 239228 (0.0005) [2023-12-26 01:30:07,662][123091] Updated weights for policy 0, policy_version 240410 (0.0006) [2023-12-26 01:30:07,732][123091] Updated weights for policy 0, policy_version 240420 (0.0010) [2023-12-26 01:30:07,802][123091] Updated weights for policy 0, policy_version 240430 (0.0011) [2023-12-26 01:30:07,841][123090] Updated weights for policy 1, policy_version 239238 (0.0005) [2023-12-26 01:30:07,900][123090] Updated weights for policy 1, policy_version 239248 (0.0008) [2023-12-26 01:30:07,964][123090] Updated weights for policy 1, policy_version 239258 (0.0008) [2023-12-26 01:30:08,535][123091] Updated weights for policy 0, policy_version 240440 (0.0009) [2023-12-26 01:30:08,602][123091] Updated weights for policy 0, policy_version 240450 (0.0009) [2023-12-26 01:30:08,657][123091] Updated weights for policy 0, policy_version 240460 (0.0005) [2023-12-26 01:30:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 122814464. Throughput: 0: 8861.4, 1: 8963.4. Samples: 122789076. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:08,785][121949] Avg episode reward: [(0, '5756.166'), (1, '5764.529')] [2023-12-26 01:30:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000240464_61562880.pth... [2023-12-26 01:30:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000239264_61251584.pth... [2023-12-26 01:30:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000239440_61300736.pth [2023-12-26 01:30:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000238240_60989440.pth [2023-12-26 01:30:08,848][123090] Updated weights for policy 1, policy_version 239268 (0.0010) [2023-12-26 01:30:08,907][123090] Updated weights for policy 1, policy_version 239278 (0.0009) [2023-12-26 01:30:08,962][123090] Updated weights for policy 1, policy_version 239289 (0.0011) [2023-12-26 01:30:09,439][123091] Updated weights for policy 0, policy_version 240470 (0.0008) [2023-12-26 01:30:09,501][123091] Updated weights for policy 0, policy_version 240480 (0.0009) [2023-12-26 01:30:09,552][123091] Updated weights for policy 0, policy_version 240490 (0.0010) [2023-12-26 01:30:09,818][123090] Updated weights for policy 1, policy_version 239299 (0.0010) [2023-12-26 01:30:09,885][123090] Updated weights for policy 1, policy_version 239309 (0.0010) [2023-12-26 01:30:09,956][123090] Updated weights for policy 1, policy_version 239319 (0.0008) [2023-12-26 01:30:10,419][123091] Updated weights for policy 0, policy_version 240500 (0.0010) [2023-12-26 01:30:10,471][123091] Updated weights for policy 0, policy_version 240510 (0.0011) [2023-12-26 01:30:10,519][123091] Updated weights for policy 0, policy_version 240520 (0.0010) [2023-12-26 01:30:10,774][123090] Updated weights for policy 1, policy_version 239329 (0.0008) [2023-12-26 01:30:10,834][123090] Updated weights for policy 1, policy_version 239339 (0.0009) [2023-12-26 01:30:10,890][123090] Updated weights for policy 1, policy_version 239349 (0.0009) [2023-12-26 01:30:10,944][123090] Updated weights for policy 1, policy_version 239359 (0.0009) [2023-12-26 01:30:11,259][123091] Updated weights for policy 0, policy_version 240530 (0.0010) [2023-12-26 01:30:11,310][123091] Updated weights for policy 0, policy_version 240540 (0.0010) [2023-12-26 01:30:11,376][123091] Updated weights for policy 0, policy_version 240550 (0.0009) [2023-12-26 01:30:11,452][123091] Updated weights for policy 0, policy_version 240560 (0.0009) [2023-12-26 01:30:11,870][123090] Updated weights for policy 1, policy_version 239369 (0.0006) [2023-12-26 01:30:11,927][123090] Updated weights for policy 1, policy_version 239379 (0.0005) [2023-12-26 01:30:11,993][123090] Updated weights for policy 1, policy_version 239389 (0.0006) [2023-12-26 01:30:12,340][123091] Updated weights for policy 0, policy_version 240570 (0.0007) [2023-12-26 01:30:12,408][123091] Updated weights for policy 0, policy_version 240580 (0.0010) [2023-12-26 01:30:12,473][123091] Updated weights for policy 0, policy_version 240590 (0.0009) [2023-12-26 01:30:12,681][123090] Updated weights for policy 1, policy_version 239399 (0.0008) [2023-12-26 01:30:12,739][123090] Updated weights for policy 1, policy_version 239409 (0.0006) [2023-12-26 01:30:12,800][123090] Updated weights for policy 1, policy_version 239419 (0.0006) [2023-12-26 01:30:13,305][123091] Updated weights for policy 0, policy_version 240600 (0.0009) [2023-12-26 01:30:13,361][123091] Updated weights for policy 0, policy_version 240610 (0.0009) [2023-12-26 01:30:13,422][123091] Updated weights for policy 0, policy_version 240620 (0.0009) [2023-12-26 01:30:13,433][123090] Updated weights for policy 1, policy_version 239429 (0.0007) [2023-12-26 01:30:13,487][123090] Updated weights for policy 1, policy_version 239439 (0.0005) [2023-12-26 01:30:13,555][123090] Updated weights for policy 1, policy_version 239449 (0.0005) [2023-12-26 01:30:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 122904576. Throughput: 0: 8850.3, 1: 8947.4. Samples: 122894736. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:13,785][121949] Avg episode reward: [(0, '5924.054'), (1, '5663.770')] [2023-12-26 01:30:14,126][123091] Updated weights for policy 0, policy_version 240630 (0.0008) [2023-12-26 01:30:14,174][123091] Updated weights for policy 0, policy_version 240640 (0.0010) [2023-12-26 01:30:14,233][123091] Updated weights for policy 0, policy_version 240650 (0.0010) [2023-12-26 01:30:14,313][123090] Updated weights for policy 1, policy_version 239459 (0.0007) [2023-12-26 01:30:14,366][123090] Updated weights for policy 1, policy_version 239469 (0.0010) [2023-12-26 01:30:14,428][123090] Updated weights for policy 1, policy_version 239479 (0.0010) [2023-12-26 01:30:15,035][123091] Updated weights for policy 0, policy_version 240660 (0.0009) [2023-12-26 01:30:15,088][123091] Updated weights for policy 0, policy_version 240670 (0.0005) [2023-12-26 01:30:15,155][123091] Updated weights for policy 0, policy_version 240680 (0.0006) [2023-12-26 01:30:15,178][123090] Updated weights for policy 1, policy_version 239489 (0.0010) [2023-12-26 01:30:15,254][123090] Updated weights for policy 1, policy_version 239499 (0.0007) [2023-12-26 01:30:15,325][123090] Updated weights for policy 1, policy_version 239509 (0.0011) [2023-12-26 01:30:15,393][123090] Updated weights for policy 1, policy_version 239519 (0.0011) [2023-12-26 01:30:15,797][123091] Updated weights for policy 0, policy_version 240690 (0.0008) [2023-12-26 01:30:15,870][123091] Updated weights for policy 0, policy_version 240700 (0.0006) [2023-12-26 01:30:15,933][123091] Updated weights for policy 0, policy_version 240710 (0.0006) [2023-12-26 01:30:16,001][123091] Updated weights for policy 0, policy_version 240720 (0.0006) [2023-12-26 01:30:16,099][123090] Updated weights for policy 1, policy_version 239529 (0.0006) [2023-12-26 01:30:16,173][123090] Updated weights for policy 1, policy_version 239539 (0.0008) [2023-12-26 01:30:16,240][123090] Updated weights for policy 1, policy_version 239549 (0.0005) [2023-12-26 01:30:16,617][123091] Updated weights for policy 0, policy_version 240730 (0.0005) [2023-12-26 01:30:16,687][123091] Updated weights for policy 0, policy_version 240740 (0.0005) [2023-12-26 01:30:16,756][123091] Updated weights for policy 0, policy_version 240750 (0.0005) [2023-12-26 01:30:16,912][123090] Updated weights for policy 1, policy_version 239559 (0.0005) [2023-12-26 01:30:16,981][123090] Updated weights for policy 1, policy_version 239569 (0.0005) [2023-12-26 01:30:17,044][123090] Updated weights for policy 1, policy_version 239579 (0.0010) [2023-12-26 01:30:17,494][123091] Updated weights for policy 0, policy_version 240760 (0.0005) [2023-12-26 01:30:17,556][123091] Updated weights for policy 0, policy_version 240770 (0.0006) [2023-12-26 01:30:17,619][123091] Updated weights for policy 0, policy_version 240780 (0.0009) [2023-12-26 01:30:17,785][123090] Updated weights for policy 1, policy_version 239589 (0.0010) [2023-12-26 01:30:17,854][123090] Updated weights for policy 1, policy_version 239599 (0.0010) [2023-12-26 01:30:17,924][123090] Updated weights for policy 1, policy_version 239609 (0.0010) [2023-12-26 01:30:18,297][123091] Updated weights for policy 0, policy_version 240790 (0.0008) [2023-12-26 01:30:18,358][123091] Updated weights for policy 0, policy_version 240800 (0.0011) [2023-12-26 01:30:18,428][123091] Updated weights for policy 0, policy_version 240810 (0.0010) [2023-12-26 01:30:18,754][123090] Updated weights for policy 1, policy_version 239619 (0.0010) [2023-12-26 01:30:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 122994688. Throughput: 0: 8958.5, 1: 8942.4. Samples: 123008324. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:18,784][121949] Avg episode reward: [(0, '6010.181'), (1, '5630.296')] [2023-12-26 01:30:18,819][123090] Updated weights for policy 1, policy_version 239629 (0.0009) [2023-12-26 01:30:18,880][123090] Updated weights for policy 1, policy_version 239639 (0.0009) [2023-12-26 01:30:19,284][123091] Updated weights for policy 0, policy_version 240820 (0.0010) [2023-12-26 01:30:19,345][123091] Updated weights for policy 0, policy_version 240830 (0.0008) [2023-12-26 01:30:19,414][123091] Updated weights for policy 0, policy_version 240840 (0.0008) [2023-12-26 01:30:19,747][123090] Updated weights for policy 1, policy_version 239649 (0.0009) [2023-12-26 01:30:19,812][123090] Updated weights for policy 1, policy_version 239659 (0.0006) [2023-12-26 01:30:19,885][123090] Updated weights for policy 1, policy_version 239669 (0.0009) [2023-12-26 01:30:19,959][123090] Updated weights for policy 1, policy_version 239679 (0.0009) [2023-12-26 01:30:20,195][123091] Updated weights for policy 0, policy_version 240850 (0.0008) [2023-12-26 01:30:20,255][123091] Updated weights for policy 0, policy_version 240860 (0.0010) [2023-12-26 01:30:20,321][123091] Updated weights for policy 0, policy_version 240870 (0.0010) [2023-12-26 01:30:20,388][123091] Updated weights for policy 0, policy_version 240880 (0.0010) [2023-12-26 01:30:20,750][123090] Updated weights for policy 1, policy_version 239689 (0.0010) [2023-12-26 01:30:20,819][123090] Updated weights for policy 1, policy_version 239699 (0.0011) [2023-12-26 01:30:20,888][123090] Updated weights for policy 1, policy_version 239709 (0.0010) [2023-12-26 01:30:21,229][123091] Updated weights for policy 0, policy_version 240890 (0.0010) [2023-12-26 01:30:21,295][123091] Updated weights for policy 0, policy_version 240900 (0.0010) [2023-12-26 01:30:21,364][123091] Updated weights for policy 0, policy_version 240910 (0.0010) [2023-12-26 01:30:21,760][123090] Updated weights for policy 1, policy_version 239719 (0.0009) [2023-12-26 01:30:21,819][123090] Updated weights for policy 1, policy_version 239729 (0.0009) [2023-12-26 01:30:21,881][123090] Updated weights for policy 1, policy_version 239739 (0.0009) [2023-12-26 01:30:22,240][123091] Updated weights for policy 0, policy_version 240920 (0.0009) [2023-12-26 01:30:22,303][123091] Updated weights for policy 0, policy_version 240930 (0.0009) [2023-12-26 01:30:22,368][123091] Updated weights for policy 0, policy_version 240940 (0.0010) [2023-12-26 01:30:22,742][123090] Updated weights for policy 1, policy_version 239749 (0.0009) [2023-12-26 01:30:22,808][123090] Updated weights for policy 1, policy_version 239759 (0.0010) [2023-12-26 01:30:22,873][123090] Updated weights for policy 1, policy_version 239769 (0.0009) [2023-12-26 01:30:23,217][123091] Updated weights for policy 0, policy_version 240950 (0.0010) [2023-12-26 01:30:23,284][123091] Updated weights for policy 0, policy_version 240960 (0.0010) [2023-12-26 01:30:23,338][123091] Updated weights for policy 0, policy_version 240970 (0.0010) [2023-12-26 01:30:23,639][123090] Updated weights for policy 1, policy_version 239779 (0.0009) [2023-12-26 01:30:23,687][123090] Updated weights for policy 1, policy_version 239789 (0.0009) [2023-12-26 01:30:23,737][123090] Updated weights for policy 1, policy_version 239799 (0.0009) [2023-12-26 01:30:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17886.0, 300 sec: 17855.8). Total num frames: 123084800. Throughput: 0: 8854.8, 1: 8881.4. Samples: 123058716. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:23,784][121949] Avg episode reward: [(0, '6031.599'), (1, '5559.207')] [2023-12-26 01:30:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000240976_61693952.pth... [2023-12-26 01:30:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000239808_61390848.pth... [2023-12-26 01:30:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000238752_61120512.pth [2023-12-26 01:30:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000239952_61431808.pth [2023-12-26 01:30:24,177][123091] Updated weights for policy 0, policy_version 240980 (0.0009) [2023-12-26 01:30:24,243][123091] Updated weights for policy 0, policy_version 240990 (0.0009) [2023-12-26 01:30:24,308][123091] Updated weights for policy 0, policy_version 241000 (0.0009) [2023-12-26 01:30:24,592][123090] Updated weights for policy 1, policy_version 239809 (0.0009) [2023-12-26 01:30:24,653][123090] Updated weights for policy 1, policy_version 239819 (0.0008) [2023-12-26 01:30:24,710][123090] Updated weights for policy 1, policy_version 239829 (0.0009) [2023-12-26 01:30:24,764][123090] Updated weights for policy 1, policy_version 239839 (0.0009) [2023-12-26 01:30:25,144][123091] Updated weights for policy 0, policy_version 241010 (0.0009) [2023-12-26 01:30:25,197][123091] Updated weights for policy 0, policy_version 241020 (0.0009) [2023-12-26 01:30:25,250][123091] Updated weights for policy 0, policy_version 241030 (0.0010) [2023-12-26 01:30:25,309][123091] Updated weights for policy 0, policy_version 241040 (0.0008) [2023-12-26 01:30:25,590][123090] Updated weights for policy 1, policy_version 239849 (0.0009) [2023-12-26 01:30:25,653][123090] Updated weights for policy 1, policy_version 239859 (0.0009) [2023-12-26 01:30:25,715][123090] Updated weights for policy 1, policy_version 239869 (0.0009) [2023-12-26 01:30:26,189][123091] Updated weights for policy 0, policy_version 241050 (0.0010) [2023-12-26 01:30:26,242][123091] Updated weights for policy 0, policy_version 241060 (0.0009) [2023-12-26 01:30:26,304][123091] Updated weights for policy 0, policy_version 241071 (0.0010) [2023-12-26 01:30:26,445][123090] Updated weights for policy 1, policy_version 239879 (0.0007) [2023-12-26 01:30:26,509][123090] Updated weights for policy 1, policy_version 239889 (0.0009) [2023-12-26 01:30:26,561][123090] Updated weights for policy 1, policy_version 239899 (0.0008) [2023-12-26 01:30:27,141][123091] Updated weights for policy 0, policy_version 241081 (0.0010) [2023-12-26 01:30:27,196][123091] Updated weights for policy 0, policy_version 241091 (0.0009) [2023-12-26 01:30:27,249][123091] Updated weights for policy 0, policy_version 241101 (0.0009) [2023-12-26 01:30:27,382][123090] Updated weights for policy 1, policy_version 239909 (0.0009) [2023-12-26 01:30:27,443][123090] Updated weights for policy 1, policy_version 239919 (0.0008) [2023-12-26 01:30:27,494][123090] Updated weights for policy 1, policy_version 239929 (0.0009) [2023-12-26 01:30:28,082][123091] Updated weights for policy 0, policy_version 241111 (0.0010) [2023-12-26 01:30:28,140][123091] Updated weights for policy 0, policy_version 241122 (0.0009) [2023-12-26 01:30:28,196][123091] Updated weights for policy 0, policy_version 241133 (0.0010) [2023-12-26 01:30:28,293][123090] Updated weights for policy 1, policy_version 239939 (0.0009) [2023-12-26 01:30:28,352][123090] Updated weights for policy 1, policy_version 239949 (0.0009) [2023-12-26 01:30:28,412][123090] Updated weights for policy 1, policy_version 239959 (0.0009) [2023-12-26 01:30:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 123166720. Throughput: 0: 8803.8, 1: 8914.5. Samples: 123161408. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:28,785][121949] Avg episode reward: [(0, '6092.102'), (1, '5627.044')] [2023-12-26 01:30:29,068][123091] Updated weights for policy 0, policy_version 241143 (0.0009) [2023-12-26 01:30:29,120][123091] Updated weights for policy 0, policy_version 241153 (0.0009) [2023-12-26 01:30:29,176][123091] Updated weights for policy 0, policy_version 241163 (0.0009) [2023-12-26 01:30:29,248][123090] Updated weights for policy 1, policy_version 239969 (0.0009) [2023-12-26 01:30:29,301][123090] Updated weights for policy 1, policy_version 239979 (0.0008) [2023-12-26 01:30:29,374][123090] Updated weights for policy 1, policy_version 239989 (0.0008) [2023-12-26 01:30:29,432][123090] Updated weights for policy 1, policy_version 239999 (0.0008) [2023-12-26 01:30:30,061][123091] Updated weights for policy 0, policy_version 241173 (0.0010) [2023-12-26 01:30:30,114][123091] Updated weights for policy 0, policy_version 241183 (0.0008) [2023-12-26 01:30:30,171][123091] Updated weights for policy 0, policy_version 241193 (0.0009) [2023-12-26 01:30:30,263][123090] Updated weights for policy 1, policy_version 240009 (0.0009) [2023-12-26 01:30:30,317][123090] Updated weights for policy 1, policy_version 240019 (0.0009) [2023-12-26 01:30:30,379][123090] Updated weights for policy 1, policy_version 240029 (0.0009) [2023-12-26 01:30:31,000][123091] Updated weights for policy 0, policy_version 241203 (0.0010) [2023-12-26 01:30:31,068][123091] Updated weights for policy 0, policy_version 241213 (0.0009) [2023-12-26 01:30:31,118][123091] Updated weights for policy 0, policy_version 241223 (0.0009) [2023-12-26 01:30:31,207][123090] Updated weights for policy 1, policy_version 240039 (0.0009) [2023-12-26 01:30:31,275][123090] Updated weights for policy 1, policy_version 240049 (0.0010) [2023-12-26 01:30:31,330][123090] Updated weights for policy 1, policy_version 240059 (0.0010) [2023-12-26 01:30:31,875][123091] Updated weights for policy 0, policy_version 241233 (0.0009) [2023-12-26 01:30:31,930][123091] Updated weights for policy 0, policy_version 241243 (0.0010) [2023-12-26 01:30:31,982][123091] Updated weights for policy 0, policy_version 241253 (0.0010) [2023-12-26 01:30:32,028][123091] Updated weights for policy 0, policy_version 241263 (0.0005) [2023-12-26 01:30:32,173][123090] Updated weights for policy 1, policy_version 240069 (0.0010) [2023-12-26 01:30:32,230][123090] Updated weights for policy 1, policy_version 240079 (0.0010) [2023-12-26 01:30:32,293][123090] Updated weights for policy 1, policy_version 240089 (0.0009) [2023-12-26 01:30:32,791][123091] Updated weights for policy 0, policy_version 241273 (0.0006) [2023-12-26 01:30:32,844][123091] Updated weights for policy 0, policy_version 241283 (0.0006) [2023-12-26 01:30:32,902][123091] Updated weights for policy 0, policy_version 241293 (0.0007) [2023-12-26 01:30:33,159][123090] Updated weights for policy 1, policy_version 240099 (0.0008) [2023-12-26 01:30:33,208][123090] Updated weights for policy 1, policy_version 240109 (0.0005) [2023-12-26 01:30:33,259][123090] Updated weights for policy 1, policy_version 240119 (0.0005) [2023-12-26 01:30:33,709][123091] Updated weights for policy 0, policy_version 241303 (0.0006) [2023-12-26 01:30:33,761][123091] Updated weights for policy 0, policy_version 241313 (0.0005) [2023-12-26 01:30:33,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 123248640. Throughput: 0: 8780.5, 1: 8850.7. Samples: 123266304. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:33,785][121949] Avg episode reward: [(0, '6001.071'), (1, '5615.489')] [2023-12-26 01:30:33,819][123091] Updated weights for policy 0, policy_version 241323 (0.0005) [2023-12-26 01:30:33,829][123090] Updated weights for policy 1, policy_version 240129 (0.0005) [2023-12-26 01:30:33,885][123090] Updated weights for policy 1, policy_version 240139 (0.0005) [2023-12-26 01:30:33,935][123090] Updated weights for policy 1, policy_version 240149 (0.0005) [2023-12-26 01:30:33,992][123090] Updated weights for policy 1, policy_version 240159 (0.0005) [2023-12-26 01:30:34,526][123091] Updated weights for policy 0, policy_version 241333 (0.0008) [2023-12-26 01:30:34,592][123091] Updated weights for policy 0, policy_version 241343 (0.0009) [2023-12-26 01:30:34,658][123091] Updated weights for policy 0, policy_version 241353 (0.0007) [2023-12-26 01:30:34,683][123090] Updated weights for policy 1, policy_version 240169 (0.0009) [2023-12-26 01:30:34,757][123090] Updated weights for policy 1, policy_version 240179 (0.0006) [2023-12-26 01:30:34,830][123090] Updated weights for policy 1, policy_version 240189 (0.0006) [2023-12-26 01:30:35,474][123090] Updated weights for policy 1, policy_version 240199 (0.0007) [2023-12-26 01:30:35,517][123091] Updated weights for policy 0, policy_version 241363 (0.0008) [2023-12-26 01:30:35,540][123090] Updated weights for policy 1, policy_version 240209 (0.0010) [2023-12-26 01:30:35,583][123091] Updated weights for policy 0, policy_version 241373 (0.0008) [2023-12-26 01:30:35,601][123090] Updated weights for policy 1, policy_version 240219 (0.0009) [2023-12-26 01:30:35,638][123091] Updated weights for policy 0, policy_version 241383 (0.0011) [2023-12-26 01:30:36,416][123090] Updated weights for policy 1, policy_version 240229 (0.0009) [2023-12-26 01:30:36,457][123091] Updated weights for policy 0, policy_version 241393 (0.0010) [2023-12-26 01:30:36,467][123090] Updated weights for policy 1, policy_version 240239 (0.0006) [2023-12-26 01:30:36,524][123091] Updated weights for policy 0, policy_version 241403 (0.0011) [2023-12-26 01:30:36,531][123090] Updated weights for policy 1, policy_version 240249 (0.0005) [2023-12-26 01:30:36,595][123091] Updated weights for policy 0, policy_version 241413 (0.0011) [2023-12-26 01:30:36,666][123091] Updated weights for policy 0, policy_version 241423 (0.0011) [2023-12-26 01:30:37,373][123090] Updated weights for policy 1, policy_version 240259 (0.0007) [2023-12-26 01:30:37,431][123091] Updated weights for policy 0, policy_version 241433 (0.0006) [2023-12-26 01:30:37,439][123090] Updated weights for policy 1, policy_version 240269 (0.0008) [2023-12-26 01:30:37,489][123090] Updated weights for policy 1, policy_version 240279 (0.0009) [2023-12-26 01:30:37,490][123091] Updated weights for policy 0, policy_version 241443 (0.0005) [2023-12-26 01:30:37,553][123091] Updated weights for policy 0, policy_version 241453 (0.0006) [2023-12-26 01:30:38,219][123091] Updated weights for policy 0, policy_version 241463 (0.0009) [2023-12-26 01:30:38,269][123091] Updated weights for policy 0, policy_version 241473 (0.0010) [2023-12-26 01:30:38,324][123091] Updated weights for policy 0, policy_version 241483 (0.0010) [2023-12-26 01:30:38,372][123090] Updated weights for policy 1, policy_version 240289 (0.0009) [2023-12-26 01:30:38,436][123090] Updated weights for policy 1, policy_version 240299 (0.0009) [2023-12-26 01:30:38,504][123090] Updated weights for policy 1, policy_version 240309 (0.0009) [2023-12-26 01:30:38,560][123090] Updated weights for policy 1, policy_version 240319 (0.0009) [2023-12-26 01:30:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 123346944. Throughput: 0: 8792.0, 1: 8912.4. Samples: 123321208. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:38,785][121949] Avg episode reward: [(0, '6056.349'), (1, '5592.623')] [2023-12-26 01:30:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000241488_61825024.pth... [2023-12-26 01:30:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000240320_61521920.pth... [2023-12-26 01:30:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000240464_61562880.pth [2023-12-26 01:30:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000239264_61251584.pth [2023-12-26 01:30:39,160][123091] Updated weights for policy 0, policy_version 241493 (0.0011) [2023-12-26 01:30:39,224][123091] Updated weights for policy 0, policy_version 241503 (0.0010) [2023-12-26 01:30:39,291][123091] Updated weights for policy 0, policy_version 241513 (0.0006) [2023-12-26 01:30:39,440][123090] Updated weights for policy 1, policy_version 240329 (0.0008) [2023-12-26 01:30:39,509][123090] Updated weights for policy 1, policy_version 240339 (0.0010) [2023-12-26 01:30:39,565][123090] Updated weights for policy 1, policy_version 240349 (0.0010) [2023-12-26 01:30:40,070][123091] Updated weights for policy 0, policy_version 241523 (0.0008) [2023-12-26 01:30:40,128][123091] Updated weights for policy 0, policy_version 241533 (0.0007) [2023-12-26 01:30:40,186][123091] Updated weights for policy 0, policy_version 241543 (0.0009) [2023-12-26 01:30:40,443][123090] Updated weights for policy 1, policy_version 240359 (0.0010) [2023-12-26 01:30:40,505][123090] Updated weights for policy 1, policy_version 240369 (0.0009) [2023-12-26 01:30:40,584][123090] Updated weights for policy 1, policy_version 240379 (0.0010) [2023-12-26 01:30:40,948][123091] Updated weights for policy 0, policy_version 241553 (0.0009) [2023-12-26 01:30:41,016][123091] Updated weights for policy 0, policy_version 241563 (0.0008) [2023-12-26 01:30:41,089][123091] Updated weights for policy 0, policy_version 241573 (0.0008) [2023-12-26 01:30:41,164][123091] Updated weights for policy 0, policy_version 241583 (0.0007) [2023-12-26 01:30:41,510][123090] Updated weights for policy 1, policy_version 240390 (0.0010) [2023-12-26 01:30:41,575][123090] Updated weights for policy 1, policy_version 240400 (0.0009) [2023-12-26 01:30:41,644][123090] Updated weights for policy 1, policy_version 240410 (0.0009) [2023-12-26 01:30:41,928][123091] Updated weights for policy 0, policy_version 241593 (0.0010) [2023-12-26 01:30:41,996][123091] Updated weights for policy 0, policy_version 241604 (0.0010) [2023-12-26 01:30:42,064][123091] Updated weights for policy 0, policy_version 241614 (0.0008) [2023-12-26 01:30:42,517][123090] Updated weights for policy 1, policy_version 240420 (0.0010) [2023-12-26 01:30:42,571][123090] Updated weights for policy 1, policy_version 240431 (0.0010) [2023-12-26 01:30:42,628][123090] Updated weights for policy 1, policy_version 240442 (0.0009) [2023-12-26 01:30:42,865][123091] Updated weights for policy 0, policy_version 241624 (0.0009) [2023-12-26 01:30:42,923][123091] Updated weights for policy 0, policy_version 241634 (0.0009) [2023-12-26 01:30:42,995][123091] Updated weights for policy 0, policy_version 241644 (0.0009) [2023-12-26 01:30:43,486][123090] Updated weights for policy 1, policy_version 240452 (0.0009) [2023-12-26 01:30:43,545][123090] Updated weights for policy 1, policy_version 240462 (0.0009) [2023-12-26 01:30:43,610][123090] Updated weights for policy 1, policy_version 240472 (0.0010) [2023-12-26 01:30:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 123428864. Throughput: 0: 8866.3, 1: 8782.6. Samples: 123423496. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:43,785][121949] Avg episode reward: [(0, '6020.536'), (1, '5684.765')] [2023-12-26 01:30:43,826][123091] Updated weights for policy 0, policy_version 241654 (0.0006) [2023-12-26 01:30:43,881][123091] Updated weights for policy 0, policy_version 241664 (0.0007) [2023-12-26 01:30:43,934][123091] Updated weights for policy 0, policy_version 241674 (0.0009) [2023-12-26 01:30:44,455][123090] Updated weights for policy 1, policy_version 240482 (0.0008) [2023-12-26 01:30:44,535][123090] Updated weights for policy 1, policy_version 240492 (0.0005) [2023-12-26 01:30:44,609][123090] Updated weights for policy 1, policy_version 240502 (0.0008) [2023-12-26 01:30:44,674][123090] Updated weights for policy 1, policy_version 240512 (0.0009) [2023-12-26 01:30:44,737][123091] Updated weights for policy 0, policy_version 241684 (0.0008) [2023-12-26 01:30:44,810][123091] Updated weights for policy 0, policy_version 241694 (0.0008) [2023-12-26 01:30:44,885][123091] Updated weights for policy 0, policy_version 241704 (0.0008) [2023-12-26 01:30:45,437][123090] Updated weights for policy 1, policy_version 240522 (0.0009) [2023-12-26 01:30:45,500][123090] Updated weights for policy 1, policy_version 240532 (0.0009) [2023-12-26 01:30:45,555][123090] Updated weights for policy 1, policy_version 240542 (0.0010) [2023-12-26 01:30:45,586][123091] Updated weights for policy 0, policy_version 241714 (0.0006) [2023-12-26 01:30:45,646][123091] Updated weights for policy 0, policy_version 241724 (0.0007) [2023-12-26 01:30:45,704][123091] Updated weights for policy 0, policy_version 241734 (0.0006) [2023-12-26 01:30:45,762][123091] Updated weights for policy 0, policy_version 241744 (0.0006) [2023-12-26 01:30:46,446][123090] Updated weights for policy 1, policy_version 240552 (0.0009) [2023-12-26 01:30:46,499][123090] Updated weights for policy 1, policy_version 240562 (0.0008) [2023-12-26 01:30:46,534][123091] Updated weights for policy 0, policy_version 241754 (0.0010) [2023-12-26 01:30:46,548][123090] Updated weights for policy 1, policy_version 240572 (0.0010) [2023-12-26 01:30:46,585][123091] Updated weights for policy 0, policy_version 241764 (0.0010) [2023-12-26 01:30:46,640][123091] Updated weights for policy 0, policy_version 241774 (0.0010) [2023-12-26 01:30:47,405][123091] Updated weights for policy 0, policy_version 241784 (0.0007) [2023-12-26 01:30:47,453][123091] Updated weights for policy 0, policy_version 241794 (0.0006) [2023-12-26 01:30:47,457][123090] Updated weights for policy 1, policy_version 240582 (0.0008) [2023-12-26 01:30:47,515][123090] Updated weights for policy 1, policy_version 240592 (0.0008) [2023-12-26 01:30:47,516][123091] Updated weights for policy 0, policy_version 241804 (0.0008) [2023-12-26 01:30:47,568][123090] Updated weights for policy 1, policy_version 240602 (0.0007) [2023-12-26 01:30:48,158][123091] Updated weights for policy 0, policy_version 241814 (0.0007) [2023-12-26 01:30:48,231][123091] Updated weights for policy 0, policy_version 241824 (0.0005) [2023-12-26 01:30:48,294][123091] Updated weights for policy 0, policy_version 241834 (0.0009) [2023-12-26 01:30:48,496][123090] Updated weights for policy 1, policy_version 240612 (0.0009) [2023-12-26 01:30:48,548][123090] Updated weights for policy 1, policy_version 240622 (0.0009) [2023-12-26 01:30:48,597][123090] Updated weights for policy 1, policy_version 240632 (0.0009) [2023-12-26 01:30:48,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 123518976. Throughput: 0: 8940.4, 1: 8729.0. Samples: 123528632. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:48,785][121949] Avg episode reward: [(0, '5930.039'), (1, '5649.292')] [2023-12-26 01:30:49,068][123091] Updated weights for policy 0, policy_version 241844 (0.0010) [2023-12-26 01:30:49,115][123091] Updated weights for policy 0, policy_version 241854 (0.0010) [2023-12-26 01:30:49,159][123091] Updated weights for policy 0, policy_version 241864 (0.0009) [2023-12-26 01:30:49,469][123090] Updated weights for policy 1, policy_version 240642 (0.0009) [2023-12-26 01:30:49,536][123090] Updated weights for policy 1, policy_version 240652 (0.0010) [2023-12-26 01:30:49,611][123090] Updated weights for policy 1, policy_version 240662 (0.0009) [2023-12-26 01:30:49,673][123090] Updated weights for policy 1, policy_version 240672 (0.0006) [2023-12-26 01:30:49,973][123091] Updated weights for policy 0, policy_version 241874 (0.0010) [2023-12-26 01:30:50,042][123091] Updated weights for policy 0, policy_version 241884 (0.0011) [2023-12-26 01:30:50,109][123091] Updated weights for policy 0, policy_version 241894 (0.0011) [2023-12-26 01:30:50,168][123091] Updated weights for policy 0, policy_version 241904 (0.0011) [2023-12-26 01:30:50,527][123090] Updated weights for policy 1, policy_version 240682 (0.0009) [2023-12-26 01:30:50,595][123090] Updated weights for policy 1, policy_version 240692 (0.0009) [2023-12-26 01:30:50,659][123090] Updated weights for policy 1, policy_version 240702 (0.0009) [2023-12-26 01:30:51,006][123091] Updated weights for policy 0, policy_version 241914 (0.0011) [2023-12-26 01:30:51,078][123091] Updated weights for policy 0, policy_version 241924 (0.0011) [2023-12-26 01:30:51,143][123091] Updated weights for policy 0, policy_version 241934 (0.0011) [2023-12-26 01:30:51,476][123090] Updated weights for policy 1, policy_version 240712 (0.0008) [2023-12-26 01:30:51,533][123090] Updated weights for policy 1, policy_version 240722 (0.0008) [2023-12-26 01:30:51,586][123090] Updated weights for policy 1, policy_version 240732 (0.0008) [2023-12-26 01:30:51,984][123091] Updated weights for policy 0, policy_version 241944 (0.0011) [2023-12-26 01:30:52,048][123091] Updated weights for policy 0, policy_version 241954 (0.0011) [2023-12-26 01:30:52,117][123091] Updated weights for policy 0, policy_version 241964 (0.0011) [2023-12-26 01:30:52,476][123090] Updated weights for policy 1, policy_version 240742 (0.0008) [2023-12-26 01:30:52,543][123090] Updated weights for policy 1, policy_version 240752 (0.0006) [2023-12-26 01:30:52,617][123090] Updated weights for policy 1, policy_version 240762 (0.0007) [2023-12-26 01:30:52,943][123091] Updated weights for policy 0, policy_version 241974 (0.0011) [2023-12-26 01:30:53,011][123091] Updated weights for policy 0, policy_version 241984 (0.0011) [2023-12-26 01:30:53,070][123091] Updated weights for policy 0, policy_version 241994 (0.0011) [2023-12-26 01:30:53,345][123090] Updated weights for policy 1, policy_version 240772 (0.0008) [2023-12-26 01:30:53,396][123090] Updated weights for policy 1, policy_version 240782 (0.0009) [2023-12-26 01:30:53,444][123090] Updated weights for policy 1, policy_version 240792 (0.0009) [2023-12-26 01:30:53,782][123091] Updated weights for policy 0, policy_version 242004 (0.0008) [2023-12-26 01:30:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 123600896. Throughput: 0: 8889.1, 1: 8662.7. Samples: 123578908. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:53,785][121949] Avg episode reward: [(0, '6032.962'), (1, '5653.891')] [2023-12-26 01:30:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000240800_61644800.pth... [2023-12-26 01:30:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000239808_61390848.pth [2023-12-26 01:30:53,850][123091] Updated weights for policy 0, policy_version 242014 (0.0009) [2023-12-26 01:30:53,916][123091] Updated weights for policy 0, policy_version 242024 (0.0009) [2023-12-26 01:30:53,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000242032_61964288.pth... [2023-12-26 01:30:53,968][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000240976_61693952.pth [2023-12-26 01:30:54,333][123090] Updated weights for policy 1, policy_version 240802 (0.0009) [2023-12-26 01:30:54,405][123090] Updated weights for policy 1, policy_version 240812 (0.0010) [2023-12-26 01:30:54,474][123090] Updated weights for policy 1, policy_version 240822 (0.0009) [2023-12-26 01:30:54,540][123090] Updated weights for policy 1, policy_version 240832 (0.0010) [2023-12-26 01:30:54,703][123091] Updated weights for policy 0, policy_version 242034 (0.0009) [2023-12-26 01:30:54,765][123091] Updated weights for policy 0, policy_version 242044 (0.0009) [2023-12-26 01:30:54,817][123091] Updated weights for policy 0, policy_version 242054 (0.0009) [2023-12-26 01:30:54,882][123091] Updated weights for policy 0, policy_version 242064 (0.0009) [2023-12-26 01:30:55,411][123090] Updated weights for policy 1, policy_version 240842 (0.0010) [2023-12-26 01:30:55,470][123090] Updated weights for policy 1, policy_version 240852 (0.0008) [2023-12-26 01:30:55,530][123090] Updated weights for policy 1, policy_version 240862 (0.0009) [2023-12-26 01:30:55,712][123091] Updated weights for policy 0, policy_version 242074 (0.0008) [2023-12-26 01:30:55,772][123091] Updated weights for policy 0, policy_version 242084 (0.0005) [2023-12-26 01:30:55,844][123091] Updated weights for policy 0, policy_version 242094 (0.0008) [2023-12-26 01:30:56,337][123090] Updated weights for policy 1, policy_version 240872 (0.0008) [2023-12-26 01:30:56,402][123090] Updated weights for policy 1, policy_version 240882 (0.0009) [2023-12-26 01:30:56,466][123090] Updated weights for policy 1, policy_version 240892 (0.0009) [2023-12-26 01:30:56,612][123091] Updated weights for policy 0, policy_version 242104 (0.0011) [2023-12-26 01:30:56,680][123091] Updated weights for policy 0, policy_version 242114 (0.0011) [2023-12-26 01:30:56,744][123091] Updated weights for policy 0, policy_version 242124 (0.0011) [2023-12-26 01:30:57,248][123090] Updated weights for policy 1, policy_version 240902 (0.0009) [2023-12-26 01:30:57,316][123090] Updated weights for policy 1, policy_version 240912 (0.0009) [2023-12-26 01:30:57,381][123090] Updated weights for policy 1, policy_version 240922 (0.0009) [2023-12-26 01:30:57,518][123091] Updated weights for policy 0, policy_version 242134 (0.0010) [2023-12-26 01:30:57,573][123091] Updated weights for policy 0, policy_version 242144 (0.0010) [2023-12-26 01:30:57,618][123091] Updated weights for policy 0, policy_version 242154 (0.0010) [2023-12-26 01:30:58,198][123090] Updated weights for policy 1, policy_version 240932 (0.0010) [2023-12-26 01:30:58,261][123090] Updated weights for policy 1, policy_version 240942 (0.0009) [2023-12-26 01:30:58,334][123090] Updated weights for policy 1, policy_version 240952 (0.0009) [2023-12-26 01:30:58,495][123091] Updated weights for policy 0, policy_version 242164 (0.0009) [2023-12-26 01:30:58,567][123091] Updated weights for policy 0, policy_version 242174 (0.0008) [2023-12-26 01:30:58,634][123091] Updated weights for policy 0, policy_version 242184 (0.0008) [2023-12-26 01:30:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 123691008. Throughput: 0: 8882.1, 1: 8628.4. Samples: 123682712. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:30:58,785][121949] Avg episode reward: [(0, '6027.341'), (1, '5613.644')] [2023-12-26 01:30:59,206][123090] Updated weights for policy 1, policy_version 240962 (0.0009) [2023-12-26 01:30:59,278][123090] Updated weights for policy 1, policy_version 240972 (0.0008) [2023-12-26 01:30:59,356][123090] Updated weights for policy 1, policy_version 240982 (0.0009) [2023-12-26 01:30:59,423][123090] Updated weights for policy 1, policy_version 240992 (0.0010) [2023-12-26 01:30:59,533][123091] Updated weights for policy 0, policy_version 242194 (0.0008) [2023-12-26 01:30:59,593][123091] Updated weights for policy 0, policy_version 242204 (0.0009) [2023-12-26 01:30:59,658][123091] Updated weights for policy 0, policy_version 242214 (0.0010) [2023-12-26 01:30:59,729][123091] Updated weights for policy 0, policy_version 242224 (0.0010) [2023-12-26 01:31:00,305][123090] Updated weights for policy 1, policy_version 241002 (0.0009) [2023-12-26 01:31:00,367][123090] Updated weights for policy 1, policy_version 241012 (0.0009) [2023-12-26 01:31:00,435][123090] Updated weights for policy 1, policy_version 241022 (0.0009) [2023-12-26 01:31:00,559][123091] Updated weights for policy 0, policy_version 242234 (0.0010) [2023-12-26 01:31:00,620][123091] Updated weights for policy 0, policy_version 242244 (0.0010) [2023-12-26 01:31:00,675][123091] Updated weights for policy 0, policy_version 242254 (0.0008) [2023-12-26 01:31:01,397][123090] Updated weights for policy 1, policy_version 241032 (0.0009) [2023-12-26 01:31:01,433][123091] Updated weights for policy 0, policy_version 242264 (0.0007) [2023-12-26 01:31:01,463][123090] Updated weights for policy 1, policy_version 241042 (0.0009) [2023-12-26 01:31:01,499][123091] Updated weights for policy 0, policy_version 242274 (0.0008) [2023-12-26 01:31:01,524][123090] Updated weights for policy 1, policy_version 241052 (0.0006) [2023-12-26 01:31:01,552][123091] Updated weights for policy 0, policy_version 242284 (0.0008) [2023-12-26 01:31:02,296][123090] Updated weights for policy 1, policy_version 241062 (0.0008) [2023-12-26 01:31:02,363][123090] Updated weights for policy 1, policy_version 241072 (0.0008) [2023-12-26 01:31:02,408][123091] Updated weights for policy 0, policy_version 242294 (0.0009) [2023-12-26 01:31:02,425][123090] Updated weights for policy 1, policy_version 241082 (0.0008) [2023-12-26 01:31:02,473][123091] Updated weights for policy 0, policy_version 242304 (0.0009) [2023-12-26 01:31:02,542][123091] Updated weights for policy 0, policy_version 242314 (0.0009) [2023-12-26 01:31:03,119][123090] Updated weights for policy 1, policy_version 241092 (0.0006) [2023-12-26 01:31:03,184][123090] Updated weights for policy 1, policy_version 241102 (0.0005) [2023-12-26 01:31:03,236][123090] Updated weights for policy 1, policy_version 241112 (0.0006) [2023-12-26 01:31:03,436][123091] Updated weights for policy 0, policy_version 242324 (0.0009) [2023-12-26 01:31:03,490][123091] Updated weights for policy 0, policy_version 242334 (0.0010) [2023-12-26 01:31:03,544][123091] Updated weights for policy 0, policy_version 242344 (0.0010) [2023-12-26 01:31:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 123772928. Throughput: 0: 8698.8, 1: 8522.3. Samples: 123783276. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:31:03,784][121949] Avg episode reward: [(0, '6075.787'), (1, '5655.104')] [2023-12-26 01:31:03,865][123090] Updated weights for policy 1, policy_version 241122 (0.0006) [2023-12-26 01:31:03,932][123090] Updated weights for policy 1, policy_version 241132 (0.0007) [2023-12-26 01:31:04,005][123090] Updated weights for policy 1, policy_version 241142 (0.0008) [2023-12-26 01:31:04,073][123090] Updated weights for policy 1, policy_version 241152 (0.0011) [2023-12-26 01:31:04,439][123091] Updated weights for policy 0, policy_version 242354 (0.0010) [2023-12-26 01:31:04,491][123091] Updated weights for policy 0, policy_version 242364 (0.0009) [2023-12-26 01:31:04,542][123091] Updated weights for policy 0, policy_version 242374 (0.0009) [2023-12-26 01:31:04,599][123091] Updated weights for policy 0, policy_version 242384 (0.0009) [2023-12-26 01:31:04,894][123090] Updated weights for policy 1, policy_version 241162 (0.0005) [2023-12-26 01:31:04,965][123090] Updated weights for policy 1, policy_version 241172 (0.0009) [2023-12-26 01:31:05,029][123090] Updated weights for policy 1, policy_version 241182 (0.0010) [2023-12-26 01:31:05,485][123091] Updated weights for policy 0, policy_version 242394 (0.0005) [2023-12-26 01:31:05,531][123091] Updated weights for policy 0, policy_version 242404 (0.0005) [2023-12-26 01:31:05,578][123091] Updated weights for policy 0, policy_version 242414 (0.0005) [2023-12-26 01:31:05,696][123090] Updated weights for policy 1, policy_version 241192 (0.0007) [2023-12-26 01:31:05,754][123090] Updated weights for policy 1, policy_version 241202 (0.0006) [2023-12-26 01:31:05,811][123090] Updated weights for policy 1, policy_version 241212 (0.0006) [2023-12-26 01:31:06,296][123091] Updated weights for policy 0, policy_version 242424 (0.0009) [2023-12-26 01:31:06,354][123091] Updated weights for policy 0, policy_version 242434 (0.0011) [2023-12-26 01:31:06,415][123091] Updated weights for policy 0, policy_version 242444 (0.0010) [2023-12-26 01:31:06,520][123090] Updated weights for policy 1, policy_version 241222 (0.0005) [2023-12-26 01:31:06,577][123090] Updated weights for policy 1, policy_version 241232 (0.0006) [2023-12-26 01:31:06,643][123090] Updated weights for policy 1, policy_version 241242 (0.0007) [2023-12-26 01:31:07,245][123091] Updated weights for policy 0, policy_version 242454 (0.0007) [2023-12-26 01:31:07,300][123091] Updated weights for policy 0, policy_version 242464 (0.0005) [2023-12-26 01:31:07,353][123091] Updated weights for policy 0, policy_version 242474 (0.0005) [2023-12-26 01:31:07,389][123090] Updated weights for policy 1, policy_version 241252 (0.0010) [2023-12-26 01:31:07,447][123090] Updated weights for policy 1, policy_version 241262 (0.0010) [2023-12-26 01:31:07,500][123090] Updated weights for policy 1, policy_version 241272 (0.0010) [2023-12-26 01:31:08,032][123091] Updated weights for policy 0, policy_version 242484 (0.0005) [2023-12-26 01:31:08,080][123091] Updated weights for policy 0, policy_version 242494 (0.0006) [2023-12-26 01:31:08,140][123091] Updated weights for policy 0, policy_version 242504 (0.0009) [2023-12-26 01:31:08,180][123090] Updated weights for policy 1, policy_version 241282 (0.0006) [2023-12-26 01:31:08,253][123090] Updated weights for policy 1, policy_version 241292 (0.0008) [2023-12-26 01:31:08,328][123090] Updated weights for policy 1, policy_version 241302 (0.0008) [2023-12-26 01:31:08,394][123090] Updated weights for policy 1, policy_version 241312 (0.0007) [2023-12-26 01:31:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 123863040. Throughput: 0: 8723.9, 1: 8603.6. Samples: 123838456. Policy #0 lag: (min: 6.0, avg: 19.4, max: 38.0) [2023-12-26 01:31:08,785][121949] Avg episode reward: [(0, '6147.584'), (1, '5755.460')] [2023-12-26 01:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000242512_62087168.pth... [2023-12-26 01:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000241312_61775872.pth... [2023-12-26 01:31:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000241488_61825024.pth [2023-12-26 01:31:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000240320_61521920.pth [2023-12-26 01:31:08,858][123091] Updated weights for policy 0, policy_version 242514 (0.0009) [2023-12-26 01:31:08,933][123091] Updated weights for policy 0, policy_version 242524 (0.0006) [2023-12-26 01:31:08,979][123090] Updated weights for policy 1, policy_version 241322 (0.0006) [2023-12-26 01:31:08,994][123091] Updated weights for policy 0, policy_version 242534 (0.0009) [2023-12-26 01:31:09,039][123090] Updated weights for policy 1, policy_version 241332 (0.0005) [2023-12-26 01:31:09,053][123091] Updated weights for policy 0, policy_version 242544 (0.0007) [2023-12-26 01:31:09,095][123090] Updated weights for policy 1, policy_version 241342 (0.0005) [2023-12-26 01:31:09,816][123091] Updated weights for policy 0, policy_version 242554 (0.0009) [2023-12-26 01:31:09,845][123090] Updated weights for policy 1, policy_version 241352 (0.0008) [2023-12-26 01:31:09,883][123091] Updated weights for policy 0, policy_version 242564 (0.0008) [2023-12-26 01:31:09,916][123090] Updated weights for policy 1, policy_version 241362 (0.0009) [2023-12-26 01:31:09,945][123091] Updated weights for policy 0, policy_version 242574 (0.0009) [2023-12-26 01:31:09,985][123090] Updated weights for policy 1, policy_version 241372 (0.0010) [2023-12-26 01:31:10,600][123091] Updated weights for policy 0, policy_version 242584 (0.0007) [2023-12-26 01:31:10,655][123091] Updated weights for policy 0, policy_version 242594 (0.0005) [2023-12-26 01:31:10,727][123091] Updated weights for policy 0, policy_version 242604 (0.0005) [2023-12-26 01:31:10,866][123090] Updated weights for policy 1, policy_version 241382 (0.0010) [2023-12-26 01:31:10,921][123090] Updated weights for policy 1, policy_version 241392 (0.0010) [2023-12-26 01:31:10,975][123090] Updated weights for policy 1, policy_version 241402 (0.0009) [2023-12-26 01:31:11,519][123091] Updated weights for policy 0, policy_version 242614 (0.0006) [2023-12-26 01:31:11,578][123091] Updated weights for policy 0, policy_version 242624 (0.0006) [2023-12-26 01:31:11,645][123091] Updated weights for policy 0, policy_version 242634 (0.0006) [2023-12-26 01:31:11,888][123090] Updated weights for policy 1, policy_version 241412 (0.0010) [2023-12-26 01:31:11,962][123090] Updated weights for policy 1, policy_version 241422 (0.0011) [2023-12-26 01:31:12,026][123090] Updated weights for policy 1, policy_version 241432 (0.0011) [2023-12-26 01:31:12,387][123091] Updated weights for policy 0, policy_version 242644 (0.0008) [2023-12-26 01:31:12,443][123091] Updated weights for policy 0, policy_version 242654 (0.0011) [2023-12-26 01:31:12,499][123091] Updated weights for policy 0, policy_version 242664 (0.0010) [2023-12-26 01:31:12,801][123090] Updated weights for policy 1, policy_version 241442 (0.0008) [2023-12-26 01:31:12,851][123090] Updated weights for policy 1, policy_version 241452 (0.0009) [2023-12-26 01:31:12,902][123090] Updated weights for policy 1, policy_version 241462 (0.0009) [2023-12-26 01:31:12,961][123090] Updated weights for policy 1, policy_version 241472 (0.0009) [2023-12-26 01:31:13,355][123091] Updated weights for policy 0, policy_version 242674 (0.0009) [2023-12-26 01:31:13,414][123091] Updated weights for policy 0, policy_version 242684 (0.0008) [2023-12-26 01:31:13,484][123091] Updated weights for policy 0, policy_version 242694 (0.0010) [2023-12-26 01:31:13,553][123091] Updated weights for policy 0, policy_version 242704 (0.0006) [2023-12-26 01:31:13,745][123090] Updated weights for policy 1, policy_version 241482 (0.0005) [2023-12-26 01:31:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 123953152. Throughput: 0: 8856.6, 1: 8656.4. Samples: 123949492. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:13,785][121949] Avg episode reward: [(0, '6143.938'), (1, '5809.842')] [2023-12-26 01:31:13,814][123090] Updated weights for policy 1, policy_version 241492 (0.0005) [2023-12-26 01:31:13,880][123090] Updated weights for policy 1, policy_version 241502 (0.0005) [2023-12-26 01:31:14,285][123091] Updated weights for policy 0, policy_version 242714 (0.0006) [2023-12-26 01:31:14,356][123091] Updated weights for policy 0, policy_version 242724 (0.0005) [2023-12-26 01:31:14,429][123091] Updated weights for policy 0, policy_version 242734 (0.0006) [2023-12-26 01:31:14,466][123090] Updated weights for policy 1, policy_version 241512 (0.0009) [2023-12-26 01:31:14,527][123090] Updated weights for policy 1, policy_version 241522 (0.0006) [2023-12-26 01:31:14,597][123090] Updated weights for policy 1, policy_version 241532 (0.0005) [2023-12-26 01:31:15,163][123091] Updated weights for policy 0, policy_version 242744 (0.0008) [2023-12-26 01:31:15,233][123091] Updated weights for policy 0, policy_version 242754 (0.0009) [2023-12-26 01:31:15,278][123090] Updated weights for policy 1, policy_version 241542 (0.0009) [2023-12-26 01:31:15,295][123091] Updated weights for policy 0, policy_version 242764 (0.0006) [2023-12-26 01:31:15,345][123090] Updated weights for policy 1, policy_version 241552 (0.0008) [2023-12-26 01:31:15,417][123090] Updated weights for policy 1, policy_version 241562 (0.0009) [2023-12-26 01:31:16,158][123091] Updated weights for policy 0, policy_version 242774 (0.0009) [2023-12-26 01:31:16,221][123091] Updated weights for policy 0, policy_version 242784 (0.0009) [2023-12-26 01:31:16,231][123090] Updated weights for policy 1, policy_version 241572 (0.0011) [2023-12-26 01:31:16,274][123091] Updated weights for policy 0, policy_version 242794 (0.0008) [2023-12-26 01:31:16,291][123090] Updated weights for policy 1, policy_version 241582 (0.0010) [2023-12-26 01:31:16,357][123090] Updated weights for policy 1, policy_version 241592 (0.0010) [2023-12-26 01:31:17,117][123091] Updated weights for policy 0, policy_version 242804 (0.0008) [2023-12-26 01:31:17,176][123090] Updated weights for policy 1, policy_version 241602 (0.0010) [2023-12-26 01:31:17,178][123091] Updated weights for policy 0, policy_version 242814 (0.0009) [2023-12-26 01:31:17,235][123091] Updated weights for policy 0, policy_version 242824 (0.0007) [2023-12-26 01:31:17,243][123090] Updated weights for policy 1, policy_version 241612 (0.0010) [2023-12-26 01:31:17,301][123090] Updated weights for policy 1, policy_version 241622 (0.0010) [2023-12-26 01:31:17,371][123090] Updated weights for policy 1, policy_version 241632 (0.0011) [2023-12-26 01:31:18,090][123091] Updated weights for policy 0, policy_version 242834 (0.0008) [2023-12-26 01:31:18,145][123091] Updated weights for policy 0, policy_version 242844 (0.0009) [2023-12-26 01:31:18,172][123090] Updated weights for policy 1, policy_version 241642 (0.0010) [2023-12-26 01:31:18,204][123091] Updated weights for policy 0, policy_version 242854 (0.0005) [2023-12-26 01:31:18,235][123090] Updated weights for policy 1, policy_version 241652 (0.0010) [2023-12-26 01:31:18,260][123091] Updated weights for policy 0, policy_version 242864 (0.0007) [2023-12-26 01:31:18,298][123090] Updated weights for policy 1, policy_version 241662 (0.0010) [2023-12-26 01:31:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 124043264. Throughput: 0: 8841.1, 1: 8690.0. Samples: 124055200. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:18,784][121949] Avg episode reward: [(0, '6118.254'), (1, '5743.363')] [2023-12-26 01:31:19,114][123091] Updated weights for policy 0, policy_version 242874 (0.0009) [2023-12-26 01:31:19,147][123090] Updated weights for policy 1, policy_version 241672 (0.0011) [2023-12-26 01:31:19,177][123091] Updated weights for policy 0, policy_version 242884 (0.0011) [2023-12-26 01:31:19,203][123090] Updated weights for policy 1, policy_version 241682 (0.0010) [2023-12-26 01:31:19,244][123091] Updated weights for policy 0, policy_version 242894 (0.0009) [2023-12-26 01:31:19,270][123090] Updated weights for policy 1, policy_version 241692 (0.0011) [2023-12-26 01:31:20,031][123091] Updated weights for policy 0, policy_version 242904 (0.0011) [2023-12-26 01:31:20,091][123091] Updated weights for policy 0, policy_version 242914 (0.0011) [2023-12-26 01:31:20,135][123090] Updated weights for policy 1, policy_version 241702 (0.0011) [2023-12-26 01:31:20,147][123091] Updated weights for policy 0, policy_version 242924 (0.0011) [2023-12-26 01:31:20,206][123090] Updated weights for policy 1, policy_version 241712 (0.0011) [2023-12-26 01:31:20,274][123090] Updated weights for policy 1, policy_version 241722 (0.0011) [2023-12-26 01:31:20,987][123091] Updated weights for policy 0, policy_version 242934 (0.0011) [2023-12-26 01:31:21,043][123091] Updated weights for policy 0, policy_version 242944 (0.0011) [2023-12-26 01:31:21,077][123090] Updated weights for policy 1, policy_version 241732 (0.0010) [2023-12-26 01:31:21,107][123091] Updated weights for policy 0, policy_version 242954 (0.0011) [2023-12-26 01:31:21,147][123090] Updated weights for policy 1, policy_version 241742 (0.0009) [2023-12-26 01:31:21,211][123090] Updated weights for policy 1, policy_version 241752 (0.0010) [2023-12-26 01:31:21,975][123091] Updated weights for policy 0, policy_version 242964 (0.0010) [2023-12-26 01:31:22,035][123091] Updated weights for policy 0, policy_version 242974 (0.0009) [2023-12-26 01:31:22,069][123090] Updated weights for policy 1, policy_version 241762 (0.0010) [2023-12-26 01:31:22,095][123091] Updated weights for policy 0, policy_version 242984 (0.0009) [2023-12-26 01:31:22,123][123090] Updated weights for policy 1, policy_version 241772 (0.0008) [2023-12-26 01:31:22,186][123090] Updated weights for policy 1, policy_version 241782 (0.0010) [2023-12-26 01:31:22,249][123090] Updated weights for policy 1, policy_version 241792 (0.0010) [2023-12-26 01:31:22,956][123091] Updated weights for policy 0, policy_version 242994 (0.0009) [2023-12-26 01:31:23,013][123091] Updated weights for policy 0, policy_version 243004 (0.0005) [2023-12-26 01:31:23,072][123091] Updated weights for policy 0, policy_version 243014 (0.0007) [2023-12-26 01:31:23,125][123090] Updated weights for policy 1, policy_version 241802 (0.0008) [2023-12-26 01:31:23,129][123091] Updated weights for policy 0, policy_version 243024 (0.0006) [2023-12-26 01:31:23,178][123090] Updated weights for policy 1, policy_version 241812 (0.0010) [2023-12-26 01:31:23,245][123090] Updated weights for policy 1, policy_version 241822 (0.0010) [2023-12-26 01:31:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17744.7). Total num frames: 124125184. Throughput: 0: 8834.0, 1: 8603.9. Samples: 124105916. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:23,784][121949] Avg episode reward: [(0, '6033.131'), (1, '5608.185')] [2023-12-26 01:31:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000241824_61906944.pth... [2023-12-26 01:31:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000240800_61644800.pth [2023-12-26 01:31:23,817][123091] Updated weights for policy 0, policy_version 243034 (0.0008) [2023-12-26 01:31:23,887][123091] Updated weights for policy 0, policy_version 243044 (0.0009) [2023-12-26 01:31:23,951][123091] Updated weights for policy 0, policy_version 243054 (0.0009) [2023-12-26 01:31:23,961][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000243056_62226432.pth... [2023-12-26 01:31:23,966][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000242032_61964288.pth [2023-12-26 01:31:24,107][123090] Updated weights for policy 1, policy_version 241832 (0.0010) [2023-12-26 01:31:24,165][123090] Updated weights for policy 1, policy_version 241842 (0.0006) [2023-12-26 01:31:24,236][123090] Updated weights for policy 1, policy_version 241852 (0.0005) [2023-12-26 01:31:24,797][123091] Updated weights for policy 0, policy_version 243064 (0.0009) [2023-12-26 01:31:24,865][123091] Updated weights for policy 0, policy_version 243074 (0.0009) [2023-12-26 01:31:24,925][123091] Updated weights for policy 0, policy_version 243084 (0.0009) [2023-12-26 01:31:24,976][123090] Updated weights for policy 1, policy_version 241862 (0.0006) [2023-12-26 01:31:25,046][123090] Updated weights for policy 1, policy_version 241872 (0.0006) [2023-12-26 01:31:25,100][123090] Updated weights for policy 1, policy_version 241882 (0.0005) [2023-12-26 01:31:25,736][123090] Updated weights for policy 1, policy_version 241892 (0.0007) [2023-12-26 01:31:25,737][123091] Updated weights for policy 0, policy_version 243094 (0.0007) [2023-12-26 01:31:25,783][123091] Updated weights for policy 0, policy_version 243104 (0.0005) [2023-12-26 01:31:25,794][123090] Updated weights for policy 1, policy_version 241902 (0.0010) [2023-12-26 01:31:25,838][123091] Updated weights for policy 0, policy_version 243114 (0.0005) [2023-12-26 01:31:25,850][123090] Updated weights for policy 1, policy_version 241912 (0.0010) [2023-12-26 01:31:26,446][123091] Updated weights for policy 0, policy_version 243124 (0.0006) [2023-12-26 01:31:26,497][123091] Updated weights for policy 0, policy_version 243134 (0.0009) [2023-12-26 01:31:26,558][123091] Updated weights for policy 0, policy_version 243144 (0.0010) [2023-12-26 01:31:26,654][123090] Updated weights for policy 1, policy_version 241922 (0.0009) [2023-12-26 01:31:26,720][123090] Updated weights for policy 1, policy_version 241932 (0.0005) [2023-12-26 01:31:26,773][123090] Updated weights for policy 1, policy_version 241942 (0.0008) [2023-12-26 01:31:26,826][123090] Updated weights for policy 1, policy_version 241952 (0.0008) [2023-12-26 01:31:27,328][123091] Updated weights for policy 0, policy_version 243154 (0.0010) [2023-12-26 01:31:27,380][123091] Updated weights for policy 0, policy_version 243164 (0.0010) [2023-12-26 01:31:27,441][123091] Updated weights for policy 0, policy_version 243174 (0.0010) [2023-12-26 01:31:27,489][123090] Updated weights for policy 1, policy_version 241962 (0.0005) [2023-12-26 01:31:27,499][123091] Updated weights for policy 0, policy_version 243184 (0.0010) [2023-12-26 01:31:27,541][123090] Updated weights for policy 1, policy_version 241972 (0.0008) [2023-12-26 01:31:27,589][123090] Updated weights for policy 1, policy_version 241982 (0.0009) [2023-12-26 01:31:28,228][123091] Updated weights for policy 0, policy_version 243194 (0.0005) [2023-12-26 01:31:28,286][123091] Updated weights for policy 0, policy_version 243204 (0.0005) [2023-12-26 01:31:28,360][123091] Updated weights for policy 0, policy_version 243214 (0.0007) [2023-12-26 01:31:28,412][123090] Updated weights for policy 1, policy_version 241992 (0.0008) [2023-12-26 01:31:28,470][123090] Updated weights for policy 1, policy_version 242002 (0.0010) [2023-12-26 01:31:28,524][123090] Updated weights for policy 1, policy_version 242012 (0.0010) [2023-12-26 01:31:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 124223488. Throughput: 0: 8834.6, 1: 8755.3. Samples: 124215040. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:28,785][121949] Avg episode reward: [(0, '6037.062'), (1, '5494.740')] [2023-12-26 01:31:29,108][123091] Updated weights for policy 0, policy_version 243224 (0.0010) [2023-12-26 01:31:29,163][123091] Updated weights for policy 0, policy_version 243234 (0.0010) [2023-12-26 01:31:29,221][123091] Updated weights for policy 0, policy_version 243244 (0.0011) [2023-12-26 01:31:29,363][123090] Updated weights for policy 1, policy_version 242022 (0.0009) [2023-12-26 01:31:29,433][123090] Updated weights for policy 1, policy_version 242032 (0.0006) [2023-12-26 01:31:29,508][123090] Updated weights for policy 1, policy_version 242042 (0.0007) [2023-12-26 01:31:30,024][123091] Updated weights for policy 0, policy_version 243254 (0.0008) [2023-12-26 01:31:30,088][123091] Updated weights for policy 0, policy_version 243264 (0.0007) [2023-12-26 01:31:30,151][123091] Updated weights for policy 0, policy_version 243274 (0.0011) [2023-12-26 01:31:30,280][123090] Updated weights for policy 1, policy_version 242052 (0.0009) [2023-12-26 01:31:30,328][123090] Updated weights for policy 1, policy_version 242062 (0.0008) [2023-12-26 01:31:30,385][123090] Updated weights for policy 1, policy_version 242072 (0.0009) [2023-12-26 01:31:30,895][123091] Updated weights for policy 0, policy_version 243284 (0.0010) [2023-12-26 01:31:30,945][123091] Updated weights for policy 0, policy_version 243294 (0.0010) [2023-12-26 01:31:31,003][123091] Updated weights for policy 0, policy_version 243304 (0.0011) [2023-12-26 01:31:31,222][123090] Updated weights for policy 1, policy_version 242082 (0.0008) [2023-12-26 01:31:31,285][123090] Updated weights for policy 1, policy_version 242092 (0.0006) [2023-12-26 01:31:31,356][123090] Updated weights for policy 1, policy_version 242102 (0.0006) [2023-12-26 01:31:31,414][123090] Updated weights for policy 1, policy_version 242112 (0.0006) [2023-12-26 01:31:31,835][123091] Updated weights for policy 0, policy_version 243314 (0.0010) [2023-12-26 01:31:31,892][123091] Updated weights for policy 0, policy_version 243324 (0.0008) [2023-12-26 01:31:31,946][123091] Updated weights for policy 0, policy_version 243334 (0.0010) [2023-12-26 01:31:31,994][123091] Updated weights for policy 0, policy_version 243344 (0.0010) [2023-12-26 01:31:32,153][123090] Updated weights for policy 1, policy_version 242122 (0.0009) [2023-12-26 01:31:32,201][123090] Updated weights for policy 1, policy_version 242132 (0.0008) [2023-12-26 01:31:32,249][123090] Updated weights for policy 1, policy_version 242142 (0.0008) [2023-12-26 01:31:32,826][123091] Updated weights for policy 0, policy_version 243354 (0.0011) [2023-12-26 01:31:32,896][123091] Updated weights for policy 0, policy_version 243364 (0.0011) [2023-12-26 01:31:32,967][123091] Updated weights for policy 0, policy_version 243374 (0.0011) [2023-12-26 01:31:33,105][123090] Updated weights for policy 1, policy_version 242152 (0.0009) [2023-12-26 01:31:33,153][123090] Updated weights for policy 1, policy_version 242162 (0.0008) [2023-12-26 01:31:33,204][123090] Updated weights for policy 1, policy_version 242172 (0.0009) [2023-12-26 01:31:33,753][123091] Updated weights for policy 0, policy_version 243384 (0.0010) [2023-12-26 01:31:33,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 124305408. Throughput: 0: 8790.2, 1: 8827.5. Samples: 124321432. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:33,786][121949] Avg episode reward: [(0, '6161.251'), (1, '5334.645')] [2023-12-26 01:31:33,800][123091] Updated weights for policy 0, policy_version 243394 (0.0010) [2023-12-26 01:31:33,847][123091] Updated weights for policy 0, policy_version 243404 (0.0010) [2023-12-26 01:31:34,047][123090] Updated weights for policy 1, policy_version 242183 (0.0007) [2023-12-26 01:31:34,103][123090] Updated weights for policy 1, policy_version 242193 (0.0006) [2023-12-26 01:31:34,174][123090] Updated weights for policy 1, policy_version 242203 (0.0007) [2023-12-26 01:31:34,703][123091] Updated weights for policy 0, policy_version 243414 (0.0010) [2023-12-26 01:31:34,755][123091] Updated weights for policy 0, policy_version 243424 (0.0011) [2023-12-26 01:31:34,803][123091] Updated weights for policy 0, policy_version 243434 (0.0010) [2023-12-26 01:31:34,867][123090] Updated weights for policy 1, policy_version 242213 (0.0006) [2023-12-26 01:31:34,925][123090] Updated weights for policy 1, policy_version 242223 (0.0007) [2023-12-26 01:31:34,974][123090] Updated weights for policy 1, policy_version 242233 (0.0009) [2023-12-26 01:31:35,654][123091] Updated weights for policy 0, policy_version 243444 (0.0011) [2023-12-26 01:31:35,716][123091] Updated weights for policy 0, policy_version 243454 (0.0010) [2023-12-26 01:31:35,739][123090] Updated weights for policy 1, policy_version 242243 (0.0008) [2023-12-26 01:31:35,767][123091] Updated weights for policy 0, policy_version 243464 (0.0010) [2023-12-26 01:31:35,789][123090] Updated weights for policy 1, policy_version 242253 (0.0006) [2023-12-26 01:31:35,837][123090] Updated weights for policy 1, policy_version 242263 (0.0005) [2023-12-26 01:31:36,515][123090] Updated weights for policy 1, policy_version 242273 (0.0006) [2023-12-26 01:31:36,574][123090] Updated weights for policy 1, policy_version 242283 (0.0011) [2023-12-26 01:31:36,593][123091] Updated weights for policy 0, policy_version 243474 (0.0011) [2023-12-26 01:31:36,643][123090] Updated weights for policy 1, policy_version 242293 (0.0011) [2023-12-26 01:31:36,653][123091] Updated weights for policy 0, policy_version 243484 (0.0011) [2023-12-26 01:31:36,708][123090] Updated weights for policy 1, policy_version 242303 (0.0011) [2023-12-26 01:31:36,720][123091] Updated weights for policy 0, policy_version 243494 (0.0011) [2023-12-26 01:31:36,784][123091] Updated weights for policy 0, policy_version 243504 (0.0011) [2023-12-26 01:31:37,456][123090] Updated weights for policy 1, policy_version 242313 (0.0006) [2023-12-26 01:31:37,513][123090] Updated weights for policy 1, policy_version 242323 (0.0005) [2023-12-26 01:31:37,581][123090] Updated weights for policy 1, policy_version 242333 (0.0006) [2023-12-26 01:31:37,600][123091] Updated weights for policy 0, policy_version 243514 (0.0011) [2023-12-26 01:31:37,663][123091] Updated weights for policy 0, policy_version 243524 (0.0011) [2023-12-26 01:31:37,727][123091] Updated weights for policy 0, policy_version 243534 (0.0011) [2023-12-26 01:31:38,372][123090] Updated weights for policy 1, policy_version 242343 (0.0008) [2023-12-26 01:31:38,438][123090] Updated weights for policy 1, policy_version 242353 (0.0007) [2023-12-26 01:31:38,514][123090] Updated weights for policy 1, policy_version 242363 (0.0005) [2023-12-26 01:31:38,555][123091] Updated weights for policy 0, policy_version 243544 (0.0009) [2023-12-26 01:31:38,618][123091] Updated weights for policy 0, policy_version 243554 (0.0007) [2023-12-26 01:31:38,674][123091] Updated weights for policy 0, policy_version 243564 (0.0011) [2023-12-26 01:31:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 124403712. Throughput: 0: 8794.9, 1: 8921.4. Samples: 124376140. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:38,784][121949] Avg episode reward: [(0, '6200.212'), (1, '5319.305')] [2023-12-26 01:31:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000243568_62357504.pth... [2023-12-26 01:31:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000242368_62046208.pth... [2023-12-26 01:31:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000242512_62087168.pth [2023-12-26 01:31:38,794][123007] Saving new best policy, reward=6200.212! [2023-12-26 01:31:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000241312_61775872.pth [2023-12-26 01:31:39,154][123090] Updated weights for policy 1, policy_version 242373 (0.0006) [2023-12-26 01:31:39,205][123090] Updated weights for policy 1, policy_version 242383 (0.0007) [2023-12-26 01:31:39,270][123090] Updated weights for policy 1, policy_version 242393 (0.0010) [2023-12-26 01:31:39,515][123091] Updated weights for policy 0, policy_version 243574 (0.0008) [2023-12-26 01:31:39,573][123091] Updated weights for policy 0, policy_version 243584 (0.0005) [2023-12-26 01:31:39,622][123091] Updated weights for policy 0, policy_version 243594 (0.0005) [2023-12-26 01:31:40,087][123090] Updated weights for policy 1, policy_version 242403 (0.0011) [2023-12-26 01:31:40,155][123090] Updated weights for policy 1, policy_version 242413 (0.0011) [2023-12-26 01:31:40,222][123090] Updated weights for policy 1, policy_version 242423 (0.0011) [2023-12-26 01:31:40,421][123091] Updated weights for policy 0, policy_version 243604 (0.0008) [2023-12-26 01:31:40,476][123091] Updated weights for policy 0, policy_version 243614 (0.0007) [2023-12-26 01:31:40,531][123091] Updated weights for policy 0, policy_version 243624 (0.0009) [2023-12-26 01:31:41,046][123090] Updated weights for policy 1, policy_version 242433 (0.0010) [2023-12-26 01:31:41,122][123090] Updated weights for policy 1, policy_version 242443 (0.0010) [2023-12-26 01:31:41,194][123090] Updated weights for policy 1, policy_version 242453 (0.0009) [2023-12-26 01:31:41,254][123090] Updated weights for policy 1, policy_version 242463 (0.0008) [2023-12-26 01:31:41,374][123091] Updated weights for policy 0, policy_version 243634 (0.0010) [2023-12-26 01:31:41,439][123091] Updated weights for policy 0, policy_version 243644 (0.0010) [2023-12-26 01:31:41,501][123091] Updated weights for policy 0, policy_version 243654 (0.0009) [2023-12-26 01:31:41,562][123091] Updated weights for policy 0, policy_version 243664 (0.0010) [2023-12-26 01:31:42,078][123090] Updated weights for policy 1, policy_version 242473 (0.0010) [2023-12-26 01:31:42,145][123090] Updated weights for policy 1, policy_version 242483 (0.0011) [2023-12-26 01:31:42,209][123090] Updated weights for policy 1, policy_version 242493 (0.0009) [2023-12-26 01:31:42,443][123091] Updated weights for policy 0, policy_version 243674 (0.0006) [2023-12-26 01:31:42,518][123091] Updated weights for policy 0, policy_version 243684 (0.0007) [2023-12-26 01:31:42,588][123091] Updated weights for policy 0, policy_version 243694 (0.0009) [2023-12-26 01:31:42,983][123090] Updated weights for policy 1, policy_version 242503 (0.0010) [2023-12-26 01:31:43,045][123090] Updated weights for policy 1, policy_version 242513 (0.0010) [2023-12-26 01:31:43,100][123090] Updated weights for policy 1, policy_version 242523 (0.0009) [2023-12-26 01:31:43,390][123091] Updated weights for policy 0, policy_version 243704 (0.0010) [2023-12-26 01:31:43,445][123091] Updated weights for policy 0, policy_version 243714 (0.0010) [2023-12-26 01:31:43,500][123091] Updated weights for policy 0, policy_version 243724 (0.0009) [2023-12-26 01:31:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 124485632. Throughput: 0: 8760.1, 1: 8959.4. Samples: 124480088. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:43,785][121949] Avg episode reward: [(0, '6167.742'), (1, '5314.723')] [2023-12-26 01:31:43,813][123090] Updated weights for policy 1, policy_version 242533 (0.0005) [2023-12-26 01:31:43,865][123090] Updated weights for policy 1, policy_version 242543 (0.0005) [2023-12-26 01:31:43,924][123090] Updated weights for policy 1, policy_version 242553 (0.0006) [2023-12-26 01:31:44,272][123091] Updated weights for policy 0, policy_version 243734 (0.0010) [2023-12-26 01:31:44,343][123091] Updated weights for policy 0, policy_version 243744 (0.0010) [2023-12-26 01:31:44,404][123091] Updated weights for policy 0, policy_version 243754 (0.0008) [2023-12-26 01:31:44,649][123090] Updated weights for policy 1, policy_version 242563 (0.0006) [2023-12-26 01:31:44,712][123090] Updated weights for policy 1, policy_version 242573 (0.0005) [2023-12-26 01:31:44,771][123090] Updated weights for policy 1, policy_version 242583 (0.0006) [2023-12-26 01:31:45,126][123091] Updated weights for policy 0, policy_version 243764 (0.0006) [2023-12-26 01:31:45,194][123091] Updated weights for policy 0, policy_version 243774 (0.0006) [2023-12-26 01:31:45,263][123091] Updated weights for policy 0, policy_version 243784 (0.0006) [2023-12-26 01:31:45,402][123090] Updated weights for policy 1, policy_version 242593 (0.0006) [2023-12-26 01:31:45,473][123090] Updated weights for policy 1, policy_version 242603 (0.0009) [2023-12-26 01:31:45,539][123090] Updated weights for policy 1, policy_version 242613 (0.0005) [2023-12-26 01:31:45,605][123090] Updated weights for policy 1, policy_version 242623 (0.0006) [2023-12-26 01:31:45,952][123091] Updated weights for policy 0, policy_version 243794 (0.0008) [2023-12-26 01:31:46,003][123091] Updated weights for policy 0, policy_version 243804 (0.0005) [2023-12-26 01:31:46,053][123091] Updated weights for policy 0, policy_version 243814 (0.0005) [2023-12-26 01:31:46,119][123091] Updated weights for policy 0, policy_version 243824 (0.0006) [2023-12-26 01:31:46,312][123090] Updated weights for policy 1, policy_version 242633 (0.0006) [2023-12-26 01:31:46,386][123090] Updated weights for policy 1, policy_version 242643 (0.0005) [2023-12-26 01:31:46,436][123090] Updated weights for policy 1, policy_version 242653 (0.0005) [2023-12-26 01:31:46,872][123091] Updated weights for policy 0, policy_version 243834 (0.0009) [2023-12-26 01:31:46,934][123091] Updated weights for policy 0, policy_version 243844 (0.0008) [2023-12-26 01:31:46,998][123091] Updated weights for policy 0, policy_version 243854 (0.0009) [2023-12-26 01:31:47,109][123090] Updated weights for policy 1, policy_version 242663 (0.0009) [2023-12-26 01:31:47,164][123090] Updated weights for policy 1, policy_version 242673 (0.0010) [2023-12-26 01:31:47,212][123090] Updated weights for policy 1, policy_version 242683 (0.0010) [2023-12-26 01:31:47,815][123091] Updated weights for policy 0, policy_version 243864 (0.0009) [2023-12-26 01:31:47,868][123091] Updated weights for policy 0, policy_version 243874 (0.0009) [2023-12-26 01:31:47,925][123091] Updated weights for policy 0, policy_version 243884 (0.0009) [2023-12-26 01:31:48,052][123090] Updated weights for policy 1, policy_version 242693 (0.0008) [2023-12-26 01:31:48,106][123090] Updated weights for policy 1, policy_version 242703 (0.0010) [2023-12-26 01:31:48,158][123090] Updated weights for policy 1, policy_version 242713 (0.0010) [2023-12-26 01:31:48,743][123091] Updated weights for policy 0, policy_version 243894 (0.0007) [2023-12-26 01:31:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 124575744. Throughput: 0: 8870.9, 1: 9108.7. Samples: 124592360. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:48,785][121949] Avg episode reward: [(0, '6084.016'), (1, '5314.040')] [2023-12-26 01:31:48,813][123091] Updated weights for policy 0, policy_version 243904 (0.0005) [2023-12-26 01:31:48,886][123091] Updated weights for policy 0, policy_version 243914 (0.0006) [2023-12-26 01:31:48,896][123090] Updated weights for policy 1, policy_version 242723 (0.0008) [2023-12-26 01:31:48,956][123090] Updated weights for policy 1, policy_version 242733 (0.0011) [2023-12-26 01:31:49,026][123090] Updated weights for policy 1, policy_version 242743 (0.0011) [2023-12-26 01:31:49,648][123091] Updated weights for policy 0, policy_version 243924 (0.0008) [2023-12-26 01:31:49,707][123091] Updated weights for policy 0, policy_version 243934 (0.0009) [2023-12-26 01:31:49,763][123091] Updated weights for policy 0, policy_version 243944 (0.0009) [2023-12-26 01:31:49,787][123090] Updated weights for policy 1, policy_version 242753 (0.0010) [2023-12-26 01:31:49,857][123090] Updated weights for policy 1, policy_version 242763 (0.0008) [2023-12-26 01:31:49,934][123090] Updated weights for policy 1, policy_version 242773 (0.0010) [2023-12-26 01:31:49,998][123090] Updated weights for policy 1, policy_version 242783 (0.0008) [2023-12-26 01:31:50,676][123091] Updated weights for policy 0, policy_version 243954 (0.0008) [2023-12-26 01:31:50,676][123090] Updated weights for policy 1, policy_version 242793 (0.0006) [2023-12-26 01:31:50,730][123091] Updated weights for policy 0, policy_version 243964 (0.0007) [2023-12-26 01:31:50,731][123090] Updated weights for policy 1, policy_version 242803 (0.0008) [2023-12-26 01:31:50,782][123090] Updated weights for policy 1, policy_version 242813 (0.0008) [2023-12-26 01:31:50,790][123091] Updated weights for policy 0, policy_version 243974 (0.0009) [2023-12-26 01:31:50,851][123091] Updated weights for policy 0, policy_version 243984 (0.0009) [2023-12-26 01:31:51,573][123090] Updated weights for policy 1, policy_version 242823 (0.0008) [2023-12-26 01:31:51,639][123090] Updated weights for policy 1, policy_version 242833 (0.0006) [2023-12-26 01:31:51,648][123091] Updated weights for policy 0, policy_version 243994 (0.0008) [2023-12-26 01:31:51,707][123090] Updated weights for policy 1, policy_version 242843 (0.0006) [2023-12-26 01:31:51,730][123091] Updated weights for policy 0, policy_version 244004 (0.0009) [2023-12-26 01:31:51,790][123091] Updated weights for policy 0, policy_version 244014 (0.0009) [2023-12-26 01:31:52,433][123091] Updated weights for policy 0, policy_version 244024 (0.0009) [2023-12-26 01:31:52,499][123091] Updated weights for policy 0, policy_version 244034 (0.0010) [2023-12-26 01:31:52,562][123091] Updated weights for policy 0, policy_version 244044 (0.0009) [2023-12-26 01:31:52,599][123090] Updated weights for policy 1, policy_version 242853 (0.0009) [2023-12-26 01:31:52,653][123090] Updated weights for policy 1, policy_version 242863 (0.0009) [2023-12-26 01:31:52,703][123090] Updated weights for policy 1, policy_version 242873 (0.0009) [2023-12-26 01:31:53,346][123091] Updated weights for policy 0, policy_version 244054 (0.0008) [2023-12-26 01:31:53,417][123091] Updated weights for policy 0, policy_version 244064 (0.0007) [2023-12-26 01:31:53,488][123091] Updated weights for policy 0, policy_version 244074 (0.0005) [2023-12-26 01:31:53,559][123090] Updated weights for policy 1, policy_version 242883 (0.0010) [2023-12-26 01:31:53,611][123090] Updated weights for policy 1, policy_version 242893 (0.0010) [2023-12-26 01:31:53,673][123090] Updated weights for policy 1, policy_version 242903 (0.0009) [2023-12-26 01:31:53,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 124674048. Throughput: 0: 8857.0, 1: 9087.6. Samples: 124645960. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:53,785][121949] Avg episode reward: [(0, '6116.351'), (1, '5486.261')] [2023-12-26 01:31:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000244080_62488576.pth... [2023-12-26 01:31:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000242912_62185472.pth... [2023-12-26 01:31:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000243056_62226432.pth [2023-12-26 01:31:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000241824_61906944.pth [2023-12-26 01:31:54,131][123091] Updated weights for policy 0, policy_version 244084 (0.0008) [2023-12-26 01:31:54,186][123091] Updated weights for policy 0, policy_version 244094 (0.0011) [2023-12-26 01:31:54,246][123091] Updated weights for policy 0, policy_version 244104 (0.0011) [2023-12-26 01:31:54,527][123090] Updated weights for policy 1, policy_version 242913 (0.0010) [2023-12-26 01:31:54,586][123090] Updated weights for policy 1, policy_version 242923 (0.0010) [2023-12-26 01:31:54,645][123090] Updated weights for policy 1, policy_version 242934 (0.0010) [2023-12-26 01:31:55,009][123091] Updated weights for policy 0, policy_version 244114 (0.0011) [2023-12-26 01:31:55,074][123091] Updated weights for policy 0, policy_version 244124 (0.0008) [2023-12-26 01:31:55,143][123091] Updated weights for policy 0, policy_version 244134 (0.0009) [2023-12-26 01:31:55,209][123091] Updated weights for policy 0, policy_version 244144 (0.0010) [2023-12-26 01:31:55,553][123090] Updated weights for policy 1, policy_version 242945 (0.0010) [2023-12-26 01:31:55,610][123090] Updated weights for policy 1, policy_version 242955 (0.0009) [2023-12-26 01:31:55,663][123090] Updated weights for policy 1, policy_version 242966 (0.0008) [2023-12-26 01:31:55,719][123090] Updated weights for policy 1, policy_version 242976 (0.0010) [2023-12-26 01:31:55,971][123091] Updated weights for policy 0, policy_version 244154 (0.0006) [2023-12-26 01:31:56,022][123091] Updated weights for policy 0, policy_version 244164 (0.0007) [2023-12-26 01:31:56,075][123091] Updated weights for policy 0, policy_version 244174 (0.0008) [2023-12-26 01:31:56,583][123090] Updated weights for policy 1, policy_version 242986 (0.0009) [2023-12-26 01:31:56,635][123090] Updated weights for policy 1, policy_version 242996 (0.0009) [2023-12-26 01:31:56,686][123090] Updated weights for policy 1, policy_version 243007 (0.0010) [2023-12-26 01:31:56,873][123091] Updated weights for policy 0, policy_version 244184 (0.0009) [2023-12-26 01:31:56,942][123091] Updated weights for policy 0, policy_version 244194 (0.0009) [2023-12-26 01:31:56,999][123091] Updated weights for policy 0, policy_version 244204 (0.0009) [2023-12-26 01:31:57,535][123090] Updated weights for policy 1, policy_version 243017 (0.0008) [2023-12-26 01:31:57,583][123090] Updated weights for policy 1, policy_version 243027 (0.0009) [2023-12-26 01:31:57,634][123090] Updated weights for policy 1, policy_version 243038 (0.0008) [2023-12-26 01:31:57,829][123091] Updated weights for policy 0, policy_version 244214 (0.0009) [2023-12-26 01:31:57,878][123091] Updated weights for policy 0, policy_version 244224 (0.0009) [2023-12-26 01:31:57,926][123091] Updated weights for policy 0, policy_version 244234 (0.0009) [2023-12-26 01:31:58,465][123090] Updated weights for policy 1, policy_version 243048 (0.0008) [2023-12-26 01:31:58,531][123090] Updated weights for policy 1, policy_version 243058 (0.0008) [2023-12-26 01:31:58,603][123090] Updated weights for policy 1, policy_version 243068 (0.0007) [2023-12-26 01:31:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 124755968. Throughput: 0: 8824.1, 1: 8980.8. Samples: 124750712. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:31:58,785][121949] Avg episode reward: [(0, '6025.292'), (1, '5427.030')] [2023-12-26 01:31:58,899][123091] Updated weights for policy 0, policy_version 244244 (0.0010) [2023-12-26 01:31:58,961][123091] Updated weights for policy 0, policy_version 244254 (0.0009) [2023-12-26 01:31:59,030][123091] Updated weights for policy 0, policy_version 244265 (0.0009) [2023-12-26 01:31:59,489][123090] Updated weights for policy 1, policy_version 243078 (0.0009) [2023-12-26 01:31:59,543][123090] Updated weights for policy 1, policy_version 243089 (0.0009) [2023-12-26 01:31:59,598][123090] Updated weights for policy 1, policy_version 243099 (0.0009) [2023-12-26 01:31:59,846][123091] Updated weights for policy 0, policy_version 244275 (0.0010) [2023-12-26 01:31:59,911][123091] Updated weights for policy 0, policy_version 244285 (0.0009) [2023-12-26 01:31:59,976][123091] Updated weights for policy 0, policy_version 244295 (0.0009) [2023-12-26 01:32:00,524][123090] Updated weights for policy 1, policy_version 243109 (0.0009) [2023-12-26 01:32:00,589][123090] Updated weights for policy 1, policy_version 243119 (0.0009) [2023-12-26 01:32:00,649][123091] Updated weights for policy 0, policy_version 244305 (0.0009) [2023-12-26 01:32:00,655][123090] Updated weights for policy 1, policy_version 243129 (0.0009) [2023-12-26 01:32:00,692][123091] Updated weights for policy 0, policy_version 244315 (0.0005) [2023-12-26 01:32:00,738][123091] Updated weights for policy 0, policy_version 244325 (0.0005) [2023-12-26 01:32:00,788][123091] Updated weights for policy 0, policy_version 244335 (0.0006) [2023-12-26 01:32:01,464][123090] Updated weights for policy 1, policy_version 243139 (0.0008) [2023-12-26 01:32:01,532][123090] Updated weights for policy 1, policy_version 243149 (0.0007) [2023-12-26 01:32:01,555][123091] Updated weights for policy 0, policy_version 244345 (0.0010) [2023-12-26 01:32:01,592][123090] Updated weights for policy 1, policy_version 243159 (0.0006) [2023-12-26 01:32:01,615][123091] Updated weights for policy 0, policy_version 244355 (0.0010) [2023-12-26 01:32:01,684][123091] Updated weights for policy 0, policy_version 244365 (0.0008) [2023-12-26 01:32:02,454][123091] Updated weights for policy 0, policy_version 244375 (0.0009) [2023-12-26 01:32:02,471][123090] Updated weights for policy 1, policy_version 243169 (0.0008) [2023-12-26 01:32:02,521][123091] Updated weights for policy 0, policy_version 244385 (0.0006) [2023-12-26 01:32:02,527][123090] Updated weights for policy 1, policy_version 243179 (0.0009) [2023-12-26 01:32:02,585][123091] Updated weights for policy 0, policy_version 244395 (0.0008) [2023-12-26 01:32:02,594][123090] Updated weights for policy 1, policy_version 243189 (0.0008) [2023-12-26 01:32:02,651][123090] Updated weights for policy 1, policy_version 243199 (0.0009) [2023-12-26 01:32:03,348][123091] Updated weights for policy 0, policy_version 244405 (0.0010) [2023-12-26 01:32:03,402][123091] Updated weights for policy 0, policy_version 244415 (0.0010) [2023-12-26 01:32:03,445][123091] Updated weights for policy 0, policy_version 244425 (0.0010) [2023-12-26 01:32:03,486][123090] Updated weights for policy 1, policy_version 243209 (0.0009) [2023-12-26 01:32:03,538][123090] Updated weights for policy 1, policy_version 243219 (0.0008) [2023-12-26 01:32:03,594][123090] Updated weights for policy 1, policy_version 243229 (0.0008) [2023-12-26 01:32:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 124846080. Throughput: 0: 8871.2, 1: 8881.7. Samples: 124854084. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:32:03,785][121949] Avg episode reward: [(0, '5937.869'), (1, '5306.180')] [2023-12-26 01:32:04,276][123091] Updated weights for policy 0, policy_version 244435 (0.0010) [2023-12-26 01:32:04,342][123091] Updated weights for policy 0, policy_version 244445 (0.0010) [2023-12-26 01:32:04,387][123090] Updated weights for policy 1, policy_version 243239 (0.0007) [2023-12-26 01:32:04,409][123091] Updated weights for policy 0, policy_version 244455 (0.0011) [2023-12-26 01:32:04,450][123090] Updated weights for policy 1, policy_version 243249 (0.0007) [2023-12-26 01:32:04,513][123090] Updated weights for policy 1, policy_version 243259 (0.0008) [2023-12-26 01:32:05,190][123091] Updated weights for policy 0, policy_version 244465 (0.0010) [2023-12-26 01:32:05,238][123091] Updated weights for policy 0, policy_version 244475 (0.0009) [2023-12-26 01:32:05,286][123091] Updated weights for policy 0, policy_version 244486 (0.0009) [2023-12-26 01:32:05,287][123090] Updated weights for policy 1, policy_version 243269 (0.0008) [2023-12-26 01:32:05,332][123091] Updated weights for policy 0, policy_version 244496 (0.0009) [2023-12-26 01:32:05,356][123090] Updated weights for policy 1, policy_version 243279 (0.0008) [2023-12-26 01:32:05,409][123090] Updated weights for policy 1, policy_version 243289 (0.0009) [2023-12-26 01:32:06,105][123091] Updated weights for policy 0, policy_version 244506 (0.0008) [2023-12-26 01:32:06,162][123091] Updated weights for policy 0, policy_version 244516 (0.0008) [2023-12-26 01:32:06,224][123091] Updated weights for policy 0, policy_version 244526 (0.0008) [2023-12-26 01:32:06,253][123090] Updated weights for policy 1, policy_version 243299 (0.0008) [2023-12-26 01:32:06,312][123090] Updated weights for policy 1, policy_version 243309 (0.0009) [2023-12-26 01:32:06,372][123090] Updated weights for policy 1, policy_version 243319 (0.0010) [2023-12-26 01:32:06,952][123091] Updated weights for policy 0, policy_version 244536 (0.0009) [2023-12-26 01:32:07,019][123091] Updated weights for policy 0, policy_version 244546 (0.0010) [2023-12-26 01:32:07,075][123091] Updated weights for policy 0, policy_version 244556 (0.0010) [2023-12-26 01:32:07,256][123090] Updated weights for policy 1, policy_version 243329 (0.0009) [2023-12-26 01:32:07,315][123090] Updated weights for policy 1, policy_version 243339 (0.0009) [2023-12-26 01:32:07,373][123090] Updated weights for policy 1, policy_version 243349 (0.0009) [2023-12-26 01:32:07,436][123090] Updated weights for policy 1, policy_version 243359 (0.0009) [2023-12-26 01:32:07,913][123091] Updated weights for policy 0, policy_version 244566 (0.0010) [2023-12-26 01:32:07,960][123091] Updated weights for policy 0, policy_version 244576 (0.0008) [2023-12-26 01:32:08,014][123091] Updated weights for policy 0, policy_version 244586 (0.0009) [2023-12-26 01:32:08,265][123090] Updated weights for policy 1, policy_version 243369 (0.0009) [2023-12-26 01:32:08,332][123090] Updated weights for policy 1, policy_version 243379 (0.0009) [2023-12-26 01:32:08,399][123090] Updated weights for policy 1, policy_version 243389 (0.0008) [2023-12-26 01:32:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 124928000. Throughput: 0: 8899.9, 1: 8900.2. Samples: 124906920. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:32:08,785][121949] Avg episode reward: [(0, '6082.250'), (1, '5301.491')] [2023-12-26 01:32:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000244592_62619648.pth... [2023-12-26 01:32:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000243392_62308352.pth... [2023-12-26 01:32:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000243568_62357504.pth [2023-12-26 01:32:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000242368_62046208.pth [2023-12-26 01:32:08,867][123091] Updated weights for policy 0, policy_version 244596 (0.0008) [2023-12-26 01:32:08,920][123091] Updated weights for policy 0, policy_version 244606 (0.0009) [2023-12-26 01:32:08,974][123091] Updated weights for policy 0, policy_version 244616 (0.0009) [2023-12-26 01:32:09,241][123090] Updated weights for policy 1, policy_version 243399 (0.0009) [2023-12-26 01:32:09,318][123090] Updated weights for policy 1, policy_version 243409 (0.0006) [2023-12-26 01:32:09,394][123090] Updated weights for policy 1, policy_version 243419 (0.0009) [2023-12-26 01:32:09,875][123091] Updated weights for policy 0, policy_version 244626 (0.0010) [2023-12-26 01:32:09,937][123091] Updated weights for policy 0, policy_version 244636 (0.0009) [2023-12-26 01:32:10,010][123091] Updated weights for policy 0, policy_version 244646 (0.0007) [2023-12-26 01:32:10,070][123091] Updated weights for policy 0, policy_version 244656 (0.0007) [2023-12-26 01:32:10,213][123090] Updated weights for policy 1, policy_version 243429 (0.0009) [2023-12-26 01:32:10,269][123090] Updated weights for policy 1, policy_version 243439 (0.0009) [2023-12-26 01:32:10,329][123090] Updated weights for policy 1, policy_version 243449 (0.0008) [2023-12-26 01:32:10,861][123091] Updated weights for policy 0, policy_version 244666 (0.0006) [2023-12-26 01:32:10,941][123091] Updated weights for policy 0, policy_version 244676 (0.0005) [2023-12-26 01:32:10,997][123091] Updated weights for policy 0, policy_version 244686 (0.0005) [2023-12-26 01:32:11,196][123090] Updated weights for policy 1, policy_version 243459 (0.0009) [2023-12-26 01:32:11,257][123090] Updated weights for policy 1, policy_version 243469 (0.0009) [2023-12-26 01:32:11,320][123090] Updated weights for policy 1, policy_version 243479 (0.0010) [2023-12-26 01:32:11,773][123091] Updated weights for policy 0, policy_version 244696 (0.0010) [2023-12-26 01:32:11,851][123091] Updated weights for policy 0, policy_version 244706 (0.0010) [2023-12-26 01:32:11,917][123091] Updated weights for policy 0, policy_version 244716 (0.0008) [2023-12-26 01:32:12,187][123090] Updated weights for policy 1, policy_version 243489 (0.0009) [2023-12-26 01:32:12,258][123090] Updated weights for policy 1, policy_version 243499 (0.0009) [2023-12-26 01:32:12,336][123090] Updated weights for policy 1, policy_version 243509 (0.0010) [2023-12-26 01:32:12,399][123090] Updated weights for policy 1, policy_version 243519 (0.0007) [2023-12-26 01:32:12,673][123091] Updated weights for policy 0, policy_version 244726 (0.0009) [2023-12-26 01:32:12,741][123091] Updated weights for policy 0, policy_version 244736 (0.0009) [2023-12-26 01:32:12,802][123091] Updated weights for policy 0, policy_version 244746 (0.0009) [2023-12-26 01:32:13,205][123090] Updated weights for policy 1, policy_version 243529 (0.0009) [2023-12-26 01:32:13,286][123090] Updated weights for policy 1, policy_version 243539 (0.0010) [2023-12-26 01:32:13,357][123090] Updated weights for policy 1, policy_version 243549 (0.0010) [2023-12-26 01:32:13,598][123091] Updated weights for policy 0, policy_version 244756 (0.0008) [2023-12-26 01:32:13,655][123091] Updated weights for policy 0, policy_version 244766 (0.0009) [2023-12-26 01:32:13,712][123091] Updated weights for policy 0, policy_version 244776 (0.0010) [2023-12-26 01:32:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 125018112. Throughput: 0: 8863.7, 1: 8783.3. Samples: 125009152. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:32:13,784][121949] Avg episode reward: [(0, '6049.508'), (1, '5552.444')] [2023-12-26 01:32:14,135][123090] Updated weights for policy 1, policy_version 243559 (0.0009) [2023-12-26 01:32:14,198][123090] Updated weights for policy 1, policy_version 243569 (0.0008) [2023-12-26 01:32:14,261][123090] Updated weights for policy 1, policy_version 243579 (0.0010) [2023-12-26 01:32:14,552][123091] Updated weights for policy 0, policy_version 244786 (0.0010) [2023-12-26 01:32:14,605][123091] Updated weights for policy 0, policy_version 244796 (0.0009) [2023-12-26 01:32:14,676][123091] Updated weights for policy 0, policy_version 244806 (0.0006) [2023-12-26 01:32:14,747][123091] Updated weights for policy 0, policy_version 244816 (0.0010) [2023-12-26 01:32:15,089][123090] Updated weights for policy 1, policy_version 243589 (0.0009) [2023-12-26 01:32:15,156][123090] Updated weights for policy 1, policy_version 243599 (0.0009) [2023-12-26 01:32:15,218][123090] Updated weights for policy 1, policy_version 243609 (0.0008) [2023-12-26 01:32:15,561][123091] Updated weights for policy 0, policy_version 244826 (0.0009) [2023-12-26 01:32:15,628][123091] Updated weights for policy 0, policy_version 244836 (0.0008) [2023-12-26 01:32:15,679][123091] Updated weights for policy 0, policy_version 244846 (0.0009) [2023-12-26 01:32:16,037][123090] Updated weights for policy 1, policy_version 243619 (0.0010) [2023-12-26 01:32:16,092][123090] Updated weights for policy 1, policy_version 243629 (0.0008) [2023-12-26 01:32:16,156][123090] Updated weights for policy 1, policy_version 243640 (0.0009) [2023-12-26 01:32:16,511][123091] Updated weights for policy 0, policy_version 244856 (0.0009) [2023-12-26 01:32:16,567][123091] Updated weights for policy 0, policy_version 244866 (0.0009) [2023-12-26 01:32:16,619][123091] Updated weights for policy 0, policy_version 244876 (0.0009) [2023-12-26 01:32:16,996][123090] Updated weights for policy 1, policy_version 243650 (0.0008) [2023-12-26 01:32:17,067][123090] Updated weights for policy 1, policy_version 243660 (0.0005) [2023-12-26 01:32:17,127][123090] Updated weights for policy 1, policy_version 243670 (0.0005) [2023-12-26 01:32:17,178][123090] Updated weights for policy 1, policy_version 243680 (0.0007) [2023-12-26 01:32:17,500][123091] Updated weights for policy 0, policy_version 244886 (0.0009) [2023-12-26 01:32:17,570][123091] Updated weights for policy 0, policy_version 244896 (0.0010) [2023-12-26 01:32:17,629][123091] Updated weights for policy 0, policy_version 244906 (0.0008) [2023-12-26 01:32:17,914][123090] Updated weights for policy 1, policy_version 243690 (0.0006) [2023-12-26 01:32:17,976][123090] Updated weights for policy 1, policy_version 243700 (0.0005) [2023-12-26 01:32:18,044][123090] Updated weights for policy 1, policy_version 243710 (0.0009) [2023-12-26 01:32:18,441][123091] Updated weights for policy 0, policy_version 244916 (0.0009) [2023-12-26 01:32:18,505][123091] Updated weights for policy 0, policy_version 244926 (0.0009) [2023-12-26 01:32:18,576][123091] Updated weights for policy 0, policy_version 244936 (0.0010) [2023-12-26 01:32:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 125100032. Throughput: 0: 8789.3, 1: 8789.1. Samples: 125112456. Policy #0 lag: (min: 31.0, avg: 33.8, max: 62.0) [2023-12-26 01:32:18,785][121949] Avg episode reward: [(0, '5989.638'), (1, '5584.556')] [2023-12-26 01:32:18,822][123090] Updated weights for policy 1, policy_version 243720 (0.0007) [2023-12-26 01:32:18,897][123090] Updated weights for policy 1, policy_version 243730 (0.0008) [2023-12-26 01:32:18,968][123090] Updated weights for policy 1, policy_version 243740 (0.0006) [2023-12-26 01:32:19,360][123091] Updated weights for policy 0, policy_version 244946 (0.0009) [2023-12-26 01:32:19,433][123091] Updated weights for policy 0, policy_version 244956 (0.0005) [2023-12-26 01:32:19,509][123091] Updated weights for policy 0, policy_version 244966 (0.0007) [2023-12-26 01:32:19,572][123091] Updated weights for policy 0, policy_version 244976 (0.0008) [2023-12-26 01:32:19,715][123090] Updated weights for policy 1, policy_version 243750 (0.0006) [2023-12-26 01:32:19,783][123090] Updated weights for policy 1, policy_version 243760 (0.0007) [2023-12-26 01:32:19,860][123090] Updated weights for policy 1, policy_version 243770 (0.0009) [2023-12-26 01:32:20,369][123091] Updated weights for policy 0, policy_version 244986 (0.0010) [2023-12-26 01:32:20,437][123091] Updated weights for policy 0, policy_version 244996 (0.0007) [2023-12-26 01:32:20,503][123091] Updated weights for policy 0, policy_version 245006 (0.0010) [2023-12-26 01:32:20,622][123090] Updated weights for policy 1, policy_version 243780 (0.0011) [2023-12-26 01:32:20,687][123090] Updated weights for policy 1, policy_version 243790 (0.0010) [2023-12-26 01:32:20,747][123090] Updated weights for policy 1, policy_version 243800 (0.0011) [2023-12-26 01:32:21,433][123091] Updated weights for policy 0, policy_version 245016 (0.0008) [2023-12-26 01:32:21,500][123091] Updated weights for policy 0, policy_version 245026 (0.0008) [2023-12-26 01:32:21,564][123091] Updated weights for policy 0, policy_version 245036 (0.0008) [2023-12-26 01:32:21,574][123090] Updated weights for policy 1, policy_version 243810 (0.0011) [2023-12-26 01:32:21,641][123090] Updated weights for policy 1, policy_version 243820 (0.0012) [2023-12-26 01:32:21,715][123090] Updated weights for policy 1, policy_version 243830 (0.0008) [2023-12-26 01:32:21,778][123090] Updated weights for policy 1, policy_version 243840 (0.0010) [2023-12-26 01:32:22,363][123091] Updated weights for policy 0, policy_version 245046 (0.0008) [2023-12-26 01:32:22,428][123091] Updated weights for policy 0, policy_version 245056 (0.0010) [2023-12-26 01:32:22,492][123091] Updated weights for policy 0, policy_version 245066 (0.0006) [2023-12-26 01:32:22,645][123090] Updated weights for policy 1, policy_version 243850 (0.0011) [2023-12-26 01:32:22,712][123090] Updated weights for policy 1, policy_version 243860 (0.0011) [2023-12-26 01:32:22,776][123090] Updated weights for policy 1, policy_version 243870 (0.0011) [2023-12-26 01:32:23,212][123091] Updated weights for policy 0, policy_version 245076 (0.0005) [2023-12-26 01:32:23,260][123091] Updated weights for policy 0, policy_version 245086 (0.0005) [2023-12-26 01:32:23,314][123091] Updated weights for policy 0, policy_version 245096 (0.0005) [2023-12-26 01:32:23,509][123090] Updated weights for policy 1, policy_version 243880 (0.0009) [2023-12-26 01:32:23,571][123090] Updated weights for policy 1, policy_version 243890 (0.0011) [2023-12-26 01:32:23,627][123090] Updated weights for policy 1, policy_version 243900 (0.0011) [2023-12-26 01:32:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 125190144. Throughput: 0: 8788.4, 1: 8730.3. Samples: 125164484. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:23,785][121949] Avg episode reward: [(0, '5992.637'), (1, '5474.594')] [2023-12-26 01:32:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000245104_62750720.pth... [2023-12-26 01:32:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000243904_62439424.pth... [2023-12-26 01:32:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000242912_62185472.pth [2023-12-26 01:32:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000244080_62488576.pth [2023-12-26 01:32:24,016][123091] Updated weights for policy 0, policy_version 245106 (0.0006) [2023-12-26 01:32:24,081][123091] Updated weights for policy 0, policy_version 245116 (0.0009) [2023-12-26 01:32:24,143][123091] Updated weights for policy 0, policy_version 245126 (0.0010) [2023-12-26 01:32:24,206][123091] Updated weights for policy 0, policy_version 245136 (0.0009) [2023-12-26 01:32:24,347][123090] Updated weights for policy 1, policy_version 243910 (0.0010) [2023-12-26 01:32:24,431][123090] Updated weights for policy 1, policy_version 243920 (0.0009) [2023-12-26 01:32:24,490][123090] Updated weights for policy 1, policy_version 243930 (0.0010) [2023-12-26 01:32:24,914][123091] Updated weights for policy 0, policy_version 245146 (0.0006) [2023-12-26 01:32:24,972][123091] Updated weights for policy 0, policy_version 245156 (0.0006) [2023-12-26 01:32:25,030][123091] Updated weights for policy 0, policy_version 245166 (0.0006) [2023-12-26 01:32:25,393][123090] Updated weights for policy 1, policy_version 243940 (0.0009) [2023-12-26 01:32:25,457][123090] Updated weights for policy 1, policy_version 243950 (0.0010) [2023-12-26 01:32:25,510][123090] Updated weights for policy 1, policy_version 243960 (0.0010) [2023-12-26 01:32:25,718][123091] Updated weights for policy 0, policy_version 245176 (0.0007) [2023-12-26 01:32:25,773][123091] Updated weights for policy 0, policy_version 245186 (0.0005) [2023-12-26 01:32:25,842][123091] Updated weights for policy 0, policy_version 245196 (0.0005) [2023-12-26 01:32:26,177][123090] Updated weights for policy 1, policy_version 243970 (0.0009) [2023-12-26 01:32:26,225][123090] Updated weights for policy 1, policy_version 243980 (0.0005) [2023-12-26 01:32:26,270][123090] Updated weights for policy 1, policy_version 243990 (0.0005) [2023-12-26 01:32:26,333][123090] Updated weights for policy 1, policy_version 244000 (0.0005) [2023-12-26 01:32:26,423][123091] Updated weights for policy 0, policy_version 245206 (0.0005) [2023-12-26 01:32:26,477][123091] Updated weights for policy 0, policy_version 245216 (0.0005) [2023-12-26 01:32:26,534][123091] Updated weights for policy 0, policy_version 245226 (0.0010) [2023-12-26 01:32:27,015][123090] Updated weights for policy 1, policy_version 244010 (0.0006) [2023-12-26 01:32:27,071][123090] Updated weights for policy 1, policy_version 244020 (0.0010) [2023-12-26 01:32:27,131][123090] Updated weights for policy 1, policy_version 244030 (0.0010) [2023-12-26 01:32:27,170][123091] Updated weights for policy 0, policy_version 245236 (0.0008) [2023-12-26 01:32:27,239][123091] Updated weights for policy 0, policy_version 245246 (0.0005) [2023-12-26 01:32:27,302][123091] Updated weights for policy 0, policy_version 245256 (0.0005) [2023-12-26 01:32:27,879][123090] Updated weights for policy 1, policy_version 244040 (0.0008) [2023-12-26 01:32:27,931][123090] Updated weights for policy 1, policy_version 244051 (0.0009) [2023-12-26 01:32:27,987][123091] Updated weights for policy 0, policy_version 245266 (0.0009) [2023-12-26 01:32:27,994][123090] Updated weights for policy 1, policy_version 244061 (0.0008) [2023-12-26 01:32:28,062][123091] Updated weights for policy 0, policy_version 245276 (0.0010) [2023-12-26 01:32:28,143][123091] Updated weights for policy 0, policy_version 245286 (0.0010) [2023-12-26 01:32:28,214][123091] Updated weights for policy 0, policy_version 245296 (0.0009) [2023-12-26 01:32:28,762][123090] Updated weights for policy 1, policy_version 244071 (0.0009) [2023-12-26 01:32:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 125280256. Throughput: 0: 8960.3, 1: 8748.0. Samples: 125276960. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:28,785][121949] Avg episode reward: [(0, '6010.057'), (1, '5328.217')] [2023-12-26 01:32:28,810][123090] Updated weights for policy 1, policy_version 244081 (0.0010) [2023-12-26 01:32:28,866][123090] Updated weights for policy 1, policy_version 244091 (0.0010) [2023-12-26 01:32:29,033][123091] Updated weights for policy 0, policy_version 245306 (0.0009) [2023-12-26 01:32:29,094][123091] Updated weights for policy 0, policy_version 245316 (0.0009) [2023-12-26 01:32:29,160][123091] Updated weights for policy 0, policy_version 245326 (0.0008) [2023-12-26 01:32:29,720][123090] Updated weights for policy 1, policy_version 244101 (0.0010) [2023-12-26 01:32:29,767][123090] Updated weights for policy 1, policy_version 244111 (0.0010) [2023-12-26 01:32:29,820][123090] Updated weights for policy 1, policy_version 244121 (0.0010) [2023-12-26 01:32:30,003][123091] Updated weights for policy 0, policy_version 245336 (0.0009) [2023-12-26 01:32:30,067][123091] Updated weights for policy 0, policy_version 245346 (0.0009) [2023-12-26 01:32:30,127][123091] Updated weights for policy 0, policy_version 245356 (0.0009) [2023-12-26 01:32:30,692][123090] Updated weights for policy 1, policy_version 244131 (0.0010) [2023-12-26 01:32:30,748][123090] Updated weights for policy 1, policy_version 244141 (0.0009) [2023-12-26 01:32:30,808][123090] Updated weights for policy 1, policy_version 244151 (0.0006) [2023-12-26 01:32:30,918][123091] Updated weights for policy 0, policy_version 245366 (0.0010) [2023-12-26 01:32:30,969][123091] Updated weights for policy 0, policy_version 245376 (0.0010) [2023-12-26 01:32:31,028][123091] Updated weights for policy 0, policy_version 245386 (0.0009) [2023-12-26 01:32:31,572][123090] Updated weights for policy 1, policy_version 244161 (0.0008) [2023-12-26 01:32:31,637][123090] Updated weights for policy 1, policy_version 244171 (0.0007) [2023-12-26 01:32:31,695][123090] Updated weights for policy 1, policy_version 244181 (0.0010) [2023-12-26 01:32:31,766][123090] Updated weights for policy 1, policy_version 244191 (0.0009) [2023-12-26 01:32:31,849][123091] Updated weights for policy 0, policy_version 245396 (0.0008) [2023-12-26 01:32:31,911][123091] Updated weights for policy 0, policy_version 245406 (0.0007) [2023-12-26 01:32:31,982][123091] Updated weights for policy 0, policy_version 245416 (0.0006) [2023-12-26 01:32:32,526][123090] Updated weights for policy 1, policy_version 244201 (0.0009) [2023-12-26 01:32:32,584][123090] Updated weights for policy 1, policy_version 244211 (0.0009) [2023-12-26 01:32:32,643][123090] Updated weights for policy 1, policy_version 244221 (0.0010) [2023-12-26 01:32:32,718][123091] Updated weights for policy 0, policy_version 245426 (0.0008) [2023-12-26 01:32:32,766][123091] Updated weights for policy 0, policy_version 245436 (0.0005) [2023-12-26 01:32:32,811][123091] Updated weights for policy 0, policy_version 245446 (0.0005) [2023-12-26 01:32:32,888][123091] Updated weights for policy 0, policy_version 245456 (0.0007) [2023-12-26 01:32:33,393][123090] Updated weights for policy 1, policy_version 244231 (0.0010) [2023-12-26 01:32:33,455][123090] Updated weights for policy 1, policy_version 244241 (0.0010) [2023-12-26 01:32:33,513][123090] Updated weights for policy 1, policy_version 244251 (0.0010) [2023-12-26 01:32:33,637][123091] Updated weights for policy 0, policy_version 245466 (0.0005) [2023-12-26 01:32:33,699][123091] Updated weights for policy 0, policy_version 245476 (0.0005) [2023-12-26 01:32:33,761][123091] Updated weights for policy 0, policy_version 245486 (0.0008) [2023-12-26 01:32:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 125378560. Throughput: 0: 8936.6, 1: 8661.4. Samples: 125384272. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:33,785][121949] Avg episode reward: [(0, '6118.257'), (1, '5402.467')] [2023-12-26 01:32:34,382][123090] Updated weights for policy 1, policy_version 244261 (0.0010) [2023-12-26 01:32:34,446][123091] Updated weights for policy 0, policy_version 245496 (0.0008) [2023-12-26 01:32:34,447][123090] Updated weights for policy 1, policy_version 244271 (0.0008) [2023-12-26 01:32:34,504][123091] Updated weights for policy 0, policy_version 245506 (0.0008) [2023-12-26 01:32:34,511][123090] Updated weights for policy 1, policy_version 244281 (0.0008) [2023-12-26 01:32:34,562][123091] Updated weights for policy 0, policy_version 245516 (0.0007) [2023-12-26 01:32:35,304][123090] Updated weights for policy 1, policy_version 244291 (0.0010) [2023-12-26 01:32:35,359][123090] Updated weights for policy 1, policy_version 244301 (0.0009) [2023-12-26 01:32:35,409][123091] Updated weights for policy 0, policy_version 245526 (0.0008) [2023-12-26 01:32:35,419][123090] Updated weights for policy 1, policy_version 244311 (0.0010) [2023-12-26 01:32:35,460][123091] Updated weights for policy 0, policy_version 245536 (0.0008) [2023-12-26 01:32:35,524][123091] Updated weights for policy 0, policy_version 245546 (0.0009) [2023-12-26 01:32:36,246][123090] Updated weights for policy 1, policy_version 244321 (0.0008) [2023-12-26 01:32:36,305][123090] Updated weights for policy 1, policy_version 244331 (0.0009) [2023-12-26 01:32:36,356][123091] Updated weights for policy 0, policy_version 245556 (0.0008) [2023-12-26 01:32:36,370][123090] Updated weights for policy 1, policy_version 244341 (0.0010) [2023-12-26 01:32:36,412][123091] Updated weights for policy 0, policy_version 245566 (0.0008) [2023-12-26 01:32:36,428][123090] Updated weights for policy 1, policy_version 244351 (0.0007) [2023-12-26 01:32:36,471][123091] Updated weights for policy 0, policy_version 245576 (0.0010) [2023-12-26 01:32:37,242][123090] Updated weights for policy 1, policy_version 244361 (0.0005) [2023-12-26 01:32:37,310][123090] Updated weights for policy 1, policy_version 244371 (0.0005) [2023-12-26 01:32:37,336][123091] Updated weights for policy 0, policy_version 245586 (0.0009) [2023-12-26 01:32:37,372][123090] Updated weights for policy 1, policy_version 244381 (0.0010) [2023-12-26 01:32:37,392][123091] Updated weights for policy 0, policy_version 245596 (0.0005) [2023-12-26 01:32:37,458][123091] Updated weights for policy 0, policy_version 245606 (0.0006) [2023-12-26 01:32:37,507][123091] Updated weights for policy 0, policy_version 245616 (0.0005) [2023-12-26 01:32:38,094][123090] Updated weights for policy 1, policy_version 244391 (0.0007) [2023-12-26 01:32:38,162][123090] Updated weights for policy 1, policy_version 244401 (0.0011) [2023-12-26 01:32:38,229][123090] Updated weights for policy 1, policy_version 244411 (0.0011) [2023-12-26 01:32:38,268][123091] Updated weights for policy 0, policy_version 245626 (0.0008) [2023-12-26 01:32:38,342][123091] Updated weights for policy 0, policy_version 245636 (0.0009) [2023-12-26 01:32:38,404][123091] Updated weights for policy 0, policy_version 245646 (0.0009) [2023-12-26 01:32:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 125460480. Throughput: 0: 8956.5, 1: 8617.0. Samples: 125436768. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:38,785][121949] Avg episode reward: [(0, '6106.976'), (1, '5416.381')] [2023-12-26 01:32:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000245648_62889984.pth... [2023-12-26 01:32:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000244416_62570496.pth... [2023-12-26 01:32:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000244592_62619648.pth [2023-12-26 01:32:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000243392_62308352.pth [2023-12-26 01:32:39,047][123090] Updated weights for policy 1, policy_version 244421 (0.0010) [2023-12-26 01:32:39,108][123090] Updated weights for policy 1, policy_version 244431 (0.0010) [2023-12-26 01:32:39,178][123090] Updated weights for policy 1, policy_version 244441 (0.0010) [2023-12-26 01:32:39,211][123091] Updated weights for policy 0, policy_version 245656 (0.0008) [2023-12-26 01:32:39,282][123091] Updated weights for policy 0, policy_version 245666 (0.0009) [2023-12-26 01:32:39,355][123091] Updated weights for policy 0, policy_version 245676 (0.0009) [2023-12-26 01:32:39,949][123090] Updated weights for policy 1, policy_version 244451 (0.0009) [2023-12-26 01:32:40,018][123090] Updated weights for policy 1, policy_version 244461 (0.0011) [2023-12-26 01:32:40,085][123090] Updated weights for policy 1, policy_version 244471 (0.0007) [2023-12-26 01:32:40,219][123091] Updated weights for policy 0, policy_version 245686 (0.0008) [2023-12-26 01:32:40,297][123091] Updated weights for policy 0, policy_version 245696 (0.0009) [2023-12-26 01:32:40,356][123091] Updated weights for policy 0, policy_version 245706 (0.0009) [2023-12-26 01:32:40,888][123090] Updated weights for policy 1, policy_version 244481 (0.0005) [2023-12-26 01:32:40,938][123090] Updated weights for policy 1, policy_version 244491 (0.0005) [2023-12-26 01:32:40,992][123090] Updated weights for policy 1, policy_version 244501 (0.0005) [2023-12-26 01:32:41,057][123090] Updated weights for policy 1, policy_version 244511 (0.0009) [2023-12-26 01:32:41,196][123091] Updated weights for policy 0, policy_version 245716 (0.0008) [2023-12-26 01:32:41,262][123091] Updated weights for policy 0, policy_version 245726 (0.0008) [2023-12-26 01:32:41,333][123091] Updated weights for policy 0, policy_version 245736 (0.0009) [2023-12-26 01:32:41,870][123090] Updated weights for policy 1, policy_version 244521 (0.0011) [2023-12-26 01:32:41,933][123090] Updated weights for policy 1, policy_version 244531 (0.0010) [2023-12-26 01:32:41,996][123090] Updated weights for policy 1, policy_version 244541 (0.0011) [2023-12-26 01:32:42,104][123091] Updated weights for policy 0, policy_version 245746 (0.0008) [2023-12-26 01:32:42,157][123091] Updated weights for policy 0, policy_version 245756 (0.0006) [2023-12-26 01:32:42,216][123091] Updated weights for policy 0, policy_version 245766 (0.0006) [2023-12-26 01:32:42,282][123091] Updated weights for policy 0, policy_version 245776 (0.0009) [2023-12-26 01:32:42,811][123090] Updated weights for policy 1, policy_version 244551 (0.0011) [2023-12-26 01:32:42,877][123090] Updated weights for policy 1, policy_version 244561 (0.0010) [2023-12-26 01:32:42,943][123090] Updated weights for policy 1, policy_version 244571 (0.0010) [2023-12-26 01:32:43,111][123091] Updated weights for policy 0, policy_version 245786 (0.0009) [2023-12-26 01:32:43,166][123091] Updated weights for policy 0, policy_version 245796 (0.0008) [2023-12-26 01:32:43,230][123091] Updated weights for policy 0, policy_version 245806 (0.0009) [2023-12-26 01:32:43,761][123090] Updated weights for policy 1, policy_version 244581 (0.0010) [2023-12-26 01:32:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 125542400. Throughput: 0: 8871.8, 1: 8688.7. Samples: 125540932. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:43,784][121949] Avg episode reward: [(0, '6142.534'), (1, '5241.003')] [2023-12-26 01:32:43,815][123090] Updated weights for policy 1, policy_version 244591 (0.0010) [2023-12-26 01:32:43,870][123090] Updated weights for policy 1, policy_version 244601 (0.0010) [2023-12-26 01:32:44,063][123091] Updated weights for policy 0, policy_version 245816 (0.0009) [2023-12-26 01:32:44,111][123091] Updated weights for policy 0, policy_version 245826 (0.0009) [2023-12-26 01:32:44,159][123091] Updated weights for policy 0, policy_version 245837 (0.0009) [2023-12-26 01:32:44,698][123090] Updated weights for policy 1, policy_version 244611 (0.0010) [2023-12-26 01:32:44,764][123090] Updated weights for policy 1, policy_version 244621 (0.0010) [2023-12-26 01:32:44,833][123090] Updated weights for policy 1, policy_version 244631 (0.0008) [2023-12-26 01:32:45,026][123091] Updated weights for policy 0, policy_version 245847 (0.0009) [2023-12-26 01:32:45,085][123091] Updated weights for policy 0, policy_version 245857 (0.0007) [2023-12-26 01:32:45,135][123091] Updated weights for policy 0, policy_version 245867 (0.0006) [2023-12-26 01:32:45,614][123090] Updated weights for policy 1, policy_version 244641 (0.0010) [2023-12-26 01:32:45,680][123090] Updated weights for policy 1, policy_version 244651 (0.0009) [2023-12-26 01:32:45,744][123090] Updated weights for policy 1, policy_version 244661 (0.0009) [2023-12-26 01:32:45,798][123090] Updated weights for policy 1, policy_version 244671 (0.0010) [2023-12-26 01:32:45,984][123091] Updated weights for policy 0, policy_version 245877 (0.0009) [2023-12-26 01:32:46,035][123091] Updated weights for policy 0, policy_version 245887 (0.0009) [2023-12-26 01:32:46,090][123091] Updated weights for policy 0, policy_version 245897 (0.0010) [2023-12-26 01:32:46,479][123090] Updated weights for policy 1, policy_version 244681 (0.0008) [2023-12-26 01:32:46,532][123090] Updated weights for policy 1, policy_version 244691 (0.0011) [2023-12-26 01:32:46,592][123090] Updated weights for policy 1, policy_version 244701 (0.0010) [2023-12-26 01:32:46,986][123091] Updated weights for policy 0, policy_version 245908 (0.0010) [2023-12-26 01:32:47,035][123091] Updated weights for policy 0, policy_version 245918 (0.0008) [2023-12-26 01:32:47,090][123091] Updated weights for policy 0, policy_version 245928 (0.0009) [2023-12-26 01:32:47,369][123090] Updated weights for policy 1, policy_version 244711 (0.0007) [2023-12-26 01:32:47,416][123090] Updated weights for policy 1, policy_version 244721 (0.0005) [2023-12-26 01:32:47,471][123090] Updated weights for policy 1, policy_version 244731 (0.0005) [2023-12-26 01:32:47,966][123091] Updated weights for policy 0, policy_version 245938 (0.0009) [2023-12-26 01:32:48,015][123091] Updated weights for policy 0, policy_version 245948 (0.0009) [2023-12-26 01:32:48,064][123091] Updated weights for policy 0, policy_version 245958 (0.0009) [2023-12-26 01:32:48,120][123091] Updated weights for policy 0, policy_version 245968 (0.0009) [2023-12-26 01:32:48,230][123090] Updated weights for policy 1, policy_version 244741 (0.0005) [2023-12-26 01:32:48,289][123090] Updated weights for policy 1, policy_version 244751 (0.0006) [2023-12-26 01:32:48,349][123090] Updated weights for policy 1, policy_version 244761 (0.0007) [2023-12-26 01:32:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 125632512. Throughput: 0: 8787.6, 1: 8786.7. Samples: 125644924. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:48,785][121949] Avg episode reward: [(0, '6124.923'), (1, '5142.358')] [2023-12-26 01:32:49,070][123090] Updated weights for policy 1, policy_version 244771 (0.0006) [2023-12-26 01:32:49,072][123091] Updated weights for policy 0, policy_version 245978 (0.0009) [2023-12-26 01:32:49,132][123091] Updated weights for policy 0, policy_version 245988 (0.0009) [2023-12-26 01:32:49,134][123090] Updated weights for policy 1, policy_version 244781 (0.0006) [2023-12-26 01:32:49,190][123091] Updated weights for policy 0, policy_version 245998 (0.0008) [2023-12-26 01:32:49,191][123090] Updated weights for policy 1, policy_version 244791 (0.0006) [2023-12-26 01:32:49,961][123090] Updated weights for policy 1, policy_version 244801 (0.0007) [2023-12-26 01:32:50,025][123090] Updated weights for policy 1, policy_version 244811 (0.0010) [2023-12-26 01:32:50,083][123090] Updated weights for policy 1, policy_version 244821 (0.0010) [2023-12-26 01:32:50,144][123090] Updated weights for policy 1, policy_version 244831 (0.0011) [2023-12-26 01:32:50,155][123091] Updated weights for policy 0, policy_version 246008 (0.0007) [2023-12-26 01:32:50,227][123091] Updated weights for policy 0, policy_version 246018 (0.0009) [2023-12-26 01:32:50,299][123091] Updated weights for policy 0, policy_version 246028 (0.0009) [2023-12-26 01:32:50,943][123090] Updated weights for policy 1, policy_version 244841 (0.0008) [2023-12-26 01:32:51,000][123090] Updated weights for policy 1, policy_version 244851 (0.0010) [2023-12-26 01:32:51,071][123090] Updated weights for policy 1, policy_version 244861 (0.0008) [2023-12-26 01:32:51,099][123091] Updated weights for policy 0, policy_version 246038 (0.0008) [2023-12-26 01:32:51,165][123091] Updated weights for policy 0, policy_version 246048 (0.0009) [2023-12-26 01:32:51,239][123091] Updated weights for policy 0, policy_version 246058 (0.0008) [2023-12-26 01:32:51,858][123090] Updated weights for policy 1, policy_version 244871 (0.0009) [2023-12-26 01:32:51,923][123090] Updated weights for policy 1, policy_version 244881 (0.0010) [2023-12-26 01:32:51,984][123090] Updated weights for policy 1, policy_version 244891 (0.0009) [2023-12-26 01:32:52,084][123091] Updated weights for policy 0, policy_version 246068 (0.0009) [2023-12-26 01:32:52,147][123091] Updated weights for policy 0, policy_version 246078 (0.0009) [2023-12-26 01:32:52,210][123091] Updated weights for policy 0, policy_version 246088 (0.0010) [2023-12-26 01:32:52,838][123090] Updated weights for policy 1, policy_version 244901 (0.0007) [2023-12-26 01:32:52,897][123090] Updated weights for policy 1, policy_version 244911 (0.0005) [2023-12-26 01:32:52,964][123090] Updated weights for policy 1, policy_version 244921 (0.0006) [2023-12-26 01:32:53,065][123091] Updated weights for policy 0, policy_version 246098 (0.0010) [2023-12-26 01:32:53,146][123091] Updated weights for policy 0, policy_version 246108 (0.0009) [2023-12-26 01:32:53,213][123091] Updated weights for policy 0, policy_version 246118 (0.0009) [2023-12-26 01:32:53,265][123091] Updated weights for policy 0, policy_version 246128 (0.0008) [2023-12-26 01:32:53,606][123090] Updated weights for policy 1, policy_version 244931 (0.0007) [2023-12-26 01:32:53,655][123090] Updated weights for policy 1, policy_version 244941 (0.0006) [2023-12-26 01:32:53,705][123090] Updated weights for policy 1, policy_version 244951 (0.0005) [2023-12-26 01:32:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 125722624. Throughput: 0: 8719.4, 1: 8818.5. Samples: 125696124. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:53,785][121949] Avg episode reward: [(0, '6063.273'), (1, '4865.857')] [2023-12-26 01:32:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000246128_63012864.pth... [2023-12-26 01:32:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000244960_62709760.pth... [2023-12-26 01:32:53,791][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000245104_62750720.pth [2023-12-26 01:32:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000243904_62439424.pth [2023-12-26 01:32:54,118][123091] Updated weights for policy 0, policy_version 246138 (0.0009) [2023-12-26 01:32:54,178][123091] Updated weights for policy 0, policy_version 246148 (0.0008) [2023-12-26 01:32:54,233][123091] Updated weights for policy 0, policy_version 246158 (0.0008) [2023-12-26 01:32:54,472][123090] Updated weights for policy 1, policy_version 244961 (0.0006) [2023-12-26 01:32:54,531][123090] Updated weights for policy 1, policy_version 244971 (0.0010) [2023-12-26 01:32:54,590][123090] Updated weights for policy 1, policy_version 244981 (0.0010) [2023-12-26 01:32:54,660][123090] Updated weights for policy 1, policy_version 244991 (0.0010) [2023-12-26 01:32:55,099][123091] Updated weights for policy 0, policy_version 246168 (0.0009) [2023-12-26 01:32:55,166][123091] Updated weights for policy 0, policy_version 246178 (0.0009) [2023-12-26 01:32:55,230][123091] Updated weights for policy 0, policy_version 246188 (0.0008) [2023-12-26 01:32:55,446][123090] Updated weights for policy 1, policy_version 245001 (0.0010) [2023-12-26 01:32:55,511][123090] Updated weights for policy 1, policy_version 245011 (0.0011) [2023-12-26 01:32:55,574][123090] Updated weights for policy 1, policy_version 245021 (0.0011) [2023-12-26 01:32:55,968][123091] Updated weights for policy 0, policy_version 246198 (0.0007) [2023-12-26 01:32:56,028][123091] Updated weights for policy 0, policy_version 246208 (0.0006) [2023-12-26 01:32:56,090][123091] Updated weights for policy 0, policy_version 246218 (0.0005) [2023-12-26 01:32:56,385][123090] Updated weights for policy 1, policy_version 245031 (0.0010) [2023-12-26 01:32:56,436][123090] Updated weights for policy 1, policy_version 245041 (0.0010) [2023-12-26 01:32:56,488][123090] Updated weights for policy 1, policy_version 245051 (0.0010) [2023-12-26 01:32:56,755][123091] Updated weights for policy 0, policy_version 246228 (0.0006) [2023-12-26 01:32:56,808][123091] Updated weights for policy 0, policy_version 246238 (0.0005) [2023-12-26 01:32:56,868][123091] Updated weights for policy 0, policy_version 246248 (0.0010) [2023-12-26 01:32:57,227][123090] Updated weights for policy 1, policy_version 245061 (0.0008) [2023-12-26 01:32:57,286][123090] Updated weights for policy 1, policy_version 245071 (0.0007) [2023-12-26 01:32:57,349][123090] Updated weights for policy 1, policy_version 245081 (0.0010) [2023-12-26 01:32:57,674][123091] Updated weights for policy 0, policy_version 246258 (0.0010) [2023-12-26 01:32:57,739][123091] Updated weights for policy 0, policy_version 246268 (0.0010) [2023-12-26 01:32:57,786][123091] Updated weights for policy 0, policy_version 246278 (0.0010) [2023-12-26 01:32:57,836][123091] Updated weights for policy 0, policy_version 246288 (0.0010) [2023-12-26 01:32:58,104][123090] Updated weights for policy 1, policy_version 245091 (0.0010) [2023-12-26 01:32:58,160][123090] Updated weights for policy 1, policy_version 245101 (0.0008) [2023-12-26 01:32:58,220][123090] Updated weights for policy 1, policy_version 245111 (0.0010) [2023-12-26 01:32:58,747][123091] Updated weights for policy 0, policy_version 246298 (0.0009) [2023-12-26 01:32:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 125804544. Throughput: 0: 8736.9, 1: 8918.4. Samples: 125803640. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:32:58,785][121949] Avg episode reward: [(0, '6035.637'), (1, '4793.067')] [2023-12-26 01:32:58,802][123091] Updated weights for policy 0, policy_version 246309 (0.0009) [2023-12-26 01:32:58,854][123091] Updated weights for policy 0, policy_version 246319 (0.0008) [2023-12-26 01:32:59,121][123090] Updated weights for policy 1, policy_version 245121 (0.0009) [2023-12-26 01:32:59,188][123090] Updated weights for policy 1, policy_version 245131 (0.0010) [2023-12-26 01:32:59,250][123090] Updated weights for policy 1, policy_version 245141 (0.0011) [2023-12-26 01:32:59,309][123090] Updated weights for policy 1, policy_version 245151 (0.0010) [2023-12-26 01:32:59,691][123091] Updated weights for policy 0, policy_version 246329 (0.0010) [2023-12-26 01:32:59,742][123091] Updated weights for policy 0, policy_version 246339 (0.0011) [2023-12-26 01:32:59,792][123091] Updated weights for policy 0, policy_version 246350 (0.0009) [2023-12-26 01:33:00,073][123090] Updated weights for policy 1, policy_version 245161 (0.0010) [2023-12-26 01:33:00,126][123090] Updated weights for policy 1, policy_version 245171 (0.0009) [2023-12-26 01:33:00,185][123090] Updated weights for policy 1, policy_version 245182 (0.0011) [2023-12-26 01:33:00,671][123091] Updated weights for policy 0, policy_version 246360 (0.0009) [2023-12-26 01:33:00,723][123091] Updated weights for policy 0, policy_version 246370 (0.0009) [2023-12-26 01:33:00,780][123091] Updated weights for policy 0, policy_version 246380 (0.0009) [2023-12-26 01:33:01,030][123090] Updated weights for policy 1, policy_version 245192 (0.0010) [2023-12-26 01:33:01,090][123090] Updated weights for policy 1, policy_version 245202 (0.0010) [2023-12-26 01:33:01,142][123090] Updated weights for policy 1, policy_version 245212 (0.0010) [2023-12-26 01:33:01,567][123091] Updated weights for policy 0, policy_version 246390 (0.0007) [2023-12-26 01:33:01,630][123091] Updated weights for policy 0, policy_version 246400 (0.0008) [2023-12-26 01:33:01,698][123091] Updated weights for policy 0, policy_version 246410 (0.0008) [2023-12-26 01:33:01,976][123090] Updated weights for policy 1, policy_version 245222 (0.0011) [2023-12-26 01:33:02,043][123090] Updated weights for policy 1, policy_version 245232 (0.0010) [2023-12-26 01:33:02,105][123090] Updated weights for policy 1, policy_version 245242 (0.0010) [2023-12-26 01:33:02,445][123091] Updated weights for policy 0, policy_version 246420 (0.0009) [2023-12-26 01:33:02,502][123091] Updated weights for policy 0, policy_version 246430 (0.0008) [2023-12-26 01:33:02,564][123091] Updated weights for policy 0, policy_version 246440 (0.0009) [2023-12-26 01:33:02,916][123090] Updated weights for policy 1, policy_version 245252 (0.0010) [2023-12-26 01:33:02,975][123090] Updated weights for policy 1, policy_version 245262 (0.0010) [2023-12-26 01:33:03,038][123090] Updated weights for policy 1, policy_version 245272 (0.0011) [2023-12-26 01:33:03,370][123091] Updated weights for policy 0, policy_version 246450 (0.0008) [2023-12-26 01:33:03,422][123091] Updated weights for policy 0, policy_version 246460 (0.0005) [2023-12-26 01:33:03,481][123091] Updated weights for policy 0, policy_version 246470 (0.0006) [2023-12-26 01:33:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 125894656. Throughput: 0: 8759.2, 1: 8898.4. Samples: 125907048. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:03,784][121949] Avg episode reward: [(0, '6107.215'), (1, '4246.559')] [2023-12-26 01:33:03,802][123090] Updated weights for policy 1, policy_version 245282 (0.0009) [2023-12-26 01:33:03,870][123090] Updated weights for policy 1, policy_version 245292 (0.0010) [2023-12-26 01:33:03,926][123090] Updated weights for policy 1, policy_version 245302 (0.0010) [2023-12-26 01:33:03,978][123090] Updated weights for policy 1, policy_version 245312 (0.0010) [2023-12-26 01:33:04,329][123091] Updated weights for policy 0, policy_version 246481 (0.0010) [2023-12-26 01:33:04,385][123091] Updated weights for policy 0, policy_version 246491 (0.0009) [2023-12-26 01:33:04,449][123091] Updated weights for policy 0, policy_version 246501 (0.0009) [2023-12-26 01:33:04,511][123091] Updated weights for policy 0, policy_version 246511 (0.0007) [2023-12-26 01:33:04,787][123090] Updated weights for policy 1, policy_version 245322 (0.0009) [2023-12-26 01:33:04,835][123090] Updated weights for policy 1, policy_version 245332 (0.0010) [2023-12-26 01:33:04,883][123090] Updated weights for policy 1, policy_version 245342 (0.0010) [2023-12-26 01:33:05,237][123091] Updated weights for policy 0, policy_version 246521 (0.0008) [2023-12-26 01:33:05,299][123091] Updated weights for policy 0, policy_version 246531 (0.0009) [2023-12-26 01:33:05,347][123091] Updated weights for policy 0, policy_version 246541 (0.0009) [2023-12-26 01:33:05,683][123090] Updated weights for policy 1, policy_version 245352 (0.0010) [2023-12-26 01:33:05,737][123090] Updated weights for policy 1, policy_version 245362 (0.0010) [2023-12-26 01:33:05,799][123090] Updated weights for policy 1, policy_version 245372 (0.0010) [2023-12-26 01:33:06,154][123091] Updated weights for policy 0, policy_version 246551 (0.0008) [2023-12-26 01:33:06,211][123091] Updated weights for policy 0, policy_version 246561 (0.0006) [2023-12-26 01:33:06,274][123091] Updated weights for policy 0, policy_version 246571 (0.0006) [2023-12-26 01:33:06,647][123090] Updated weights for policy 1, policy_version 245382 (0.0010) [2023-12-26 01:33:06,711][123090] Updated weights for policy 1, policy_version 245392 (0.0010) [2023-12-26 01:33:06,778][123090] Updated weights for policy 1, policy_version 245402 (0.0010) [2023-12-26 01:33:06,882][123091] Updated weights for policy 0, policy_version 246581 (0.0007) [2023-12-26 01:33:06,945][123091] Updated weights for policy 0, policy_version 246591 (0.0009) [2023-12-26 01:33:07,010][123091] Updated weights for policy 0, policy_version 246601 (0.0009) [2023-12-26 01:33:07,608][123090] Updated weights for policy 1, policy_version 245412 (0.0010) [2023-12-26 01:33:07,665][123090] Updated weights for policy 1, policy_version 245422 (0.0010) [2023-12-26 01:33:07,684][123091] Updated weights for policy 0, policy_version 246611 (0.0006) [2023-12-26 01:33:07,713][123090] Updated weights for policy 1, policy_version 245432 (0.0010) [2023-12-26 01:33:07,751][123091] Updated weights for policy 0, policy_version 246621 (0.0006) [2023-12-26 01:33:07,816][123091] Updated weights for policy 0, policy_version 246631 (0.0005) [2023-12-26 01:33:08,549][123091] Updated weights for policy 0, policy_version 246641 (0.0006) [2023-12-26 01:33:08,561][123090] Updated weights for policy 1, policy_version 245442 (0.0010) [2023-12-26 01:33:08,615][123091] Updated weights for policy 0, policy_version 246651 (0.0009) [2023-12-26 01:33:08,625][123090] Updated weights for policy 1, policy_version 245452 (0.0010) [2023-12-26 01:33:08,679][123091] Updated weights for policy 0, policy_version 246661 (0.0006) [2023-12-26 01:33:08,689][123090] Updated weights for policy 1, policy_version 245462 (0.0010) [2023-12-26 01:33:08,743][123091] Updated weights for policy 0, policy_version 246671 (0.0006) [2023-12-26 01:33:08,748][123090] Updated weights for policy 1, policy_version 245472 (0.0010) [2023-12-26 01:33:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 125992960. Throughput: 0: 8797.7, 1: 8902.0. Samples: 125960968. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:08,784][121949] Avg episode reward: [(0, '6123.431'), (1, '4509.344')] [2023-12-26 01:33:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000245472_62840832.pth... [2023-12-26 01:33:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000246672_63152128.pth... [2023-12-26 01:33:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000244416_62570496.pth [2023-12-26 01:33:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000245648_62889984.pth [2023-12-26 01:33:09,531][123091] Updated weights for policy 0, policy_version 246681 (0.0008) [2023-12-26 01:33:09,577][123090] Updated weights for policy 1, policy_version 245482 (0.0008) [2023-12-26 01:33:09,594][123091] Updated weights for policy 0, policy_version 246691 (0.0008) [2023-12-26 01:33:09,641][123090] Updated weights for policy 1, policy_version 245492 (0.0008) [2023-12-26 01:33:09,657][123091] Updated weights for policy 0, policy_version 246701 (0.0008) [2023-12-26 01:33:09,712][123090] Updated weights for policy 1, policy_version 245502 (0.0008) [2023-12-26 01:33:10,447][123091] Updated weights for policy 0, policy_version 246711 (0.0009) [2023-12-26 01:33:10,510][123091] Updated weights for policy 0, policy_version 246721 (0.0008) [2023-12-26 01:33:10,511][123090] Updated weights for policy 1, policy_version 245512 (0.0008) [2023-12-26 01:33:10,579][123090] Updated weights for policy 1, policy_version 245522 (0.0009) [2023-12-26 01:33:10,581][123091] Updated weights for policy 0, policy_version 246731 (0.0007) [2023-12-26 01:33:10,640][123090] Updated weights for policy 1, policy_version 245532 (0.0010) [2023-12-26 01:33:11,358][123091] Updated weights for policy 0, policy_version 246741 (0.0008) [2023-12-26 01:33:11,431][123091] Updated weights for policy 0, policy_version 246751 (0.0009) [2023-12-26 01:33:11,497][123091] Updated weights for policy 0, policy_version 246761 (0.0010) [2023-12-26 01:33:11,512][123090] Updated weights for policy 1, policy_version 245542 (0.0009) [2023-12-26 01:33:11,573][123090] Updated weights for policy 1, policy_version 245552 (0.0007) [2023-12-26 01:33:11,648][123090] Updated weights for policy 1, policy_version 245562 (0.0010) [2023-12-26 01:33:12,357][123091] Updated weights for policy 0, policy_version 246771 (0.0009) [2023-12-26 01:33:12,420][123091] Updated weights for policy 0, policy_version 246781 (0.0010) [2023-12-26 01:33:12,460][123090] Updated weights for policy 1, policy_version 245572 (0.0009) [2023-12-26 01:33:12,482][123091] Updated weights for policy 0, policy_version 246791 (0.0010) [2023-12-26 01:33:12,523][123090] Updated weights for policy 1, policy_version 245582 (0.0009) [2023-12-26 01:33:12,576][123090] Updated weights for policy 1, policy_version 245592 (0.0010) [2023-12-26 01:33:13,328][123091] Updated weights for policy 0, policy_version 246801 (0.0008) [2023-12-26 01:33:13,395][123091] Updated weights for policy 0, policy_version 246811 (0.0009) [2023-12-26 01:33:13,403][123090] Updated weights for policy 1, policy_version 245602 (0.0009) [2023-12-26 01:33:13,456][123091] Updated weights for policy 0, policy_version 246821 (0.0008) [2023-12-26 01:33:13,468][123090] Updated weights for policy 1, policy_version 245612 (0.0008) [2023-12-26 01:33:13,519][123091] Updated weights for policy 0, policy_version 246831 (0.0010) [2023-12-26 01:33:13,532][123090] Updated weights for policy 1, policy_version 245622 (0.0009) [2023-12-26 01:33:13,594][123090] Updated weights for policy 1, policy_version 245632 (0.0009) [2023-12-26 01:33:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 126074880. Throughput: 0: 8678.0, 1: 8828.1. Samples: 126064732. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:13,785][121949] Avg episode reward: [(0, '6030.044'), (1, '3971.218')] [2023-12-26 01:33:14,299][123091] Updated weights for policy 0, policy_version 246841 (0.0010) [2023-12-26 01:33:14,357][123091] Updated weights for policy 0, policy_version 246851 (0.0009) [2023-12-26 01:33:14,392][123090] Updated weights for policy 1, policy_version 245642 (0.0009) [2023-12-26 01:33:14,421][123091] Updated weights for policy 0, policy_version 246861 (0.0008) [2023-12-26 01:33:14,450][123090] Updated weights for policy 1, policy_version 245652 (0.0008) [2023-12-26 01:33:14,512][123090] Updated weights for policy 1, policy_version 245662 (0.0009) [2023-12-26 01:33:15,220][123091] Updated weights for policy 0, policy_version 246871 (0.0009) [2023-12-26 01:33:15,283][123091] Updated weights for policy 0, policy_version 246881 (0.0009) [2023-12-26 01:33:15,344][123091] Updated weights for policy 0, policy_version 246891 (0.0008) [2023-12-26 01:33:15,360][123090] Updated weights for policy 1, policy_version 245672 (0.0008) [2023-12-26 01:33:15,410][123090] Updated weights for policy 1, policy_version 245682 (0.0010) [2023-12-26 01:33:15,472][123090] Updated weights for policy 1, policy_version 245693 (0.0010) [2023-12-26 01:33:16,126][123090] Updated weights for policy 1, policy_version 245703 (0.0007) [2023-12-26 01:33:16,186][123090] Updated weights for policy 1, policy_version 245713 (0.0005) [2023-12-26 01:33:16,240][123091] Updated weights for policy 0, policy_version 246901 (0.0008) [2023-12-26 01:33:16,242][123090] Updated weights for policy 1, policy_version 245723 (0.0009) [2023-12-26 01:33:16,298][123091] Updated weights for policy 0, policy_version 246911 (0.0008) [2023-12-26 01:33:16,347][123091] Updated weights for policy 0, policy_version 246921 (0.0009) [2023-12-26 01:33:17,029][123090] Updated weights for policy 1, policy_version 245733 (0.0010) [2023-12-26 01:33:17,080][123090] Updated weights for policy 1, policy_version 245743 (0.0010) [2023-12-26 01:33:17,130][123090] Updated weights for policy 1, policy_version 245753 (0.0010) [2023-12-26 01:33:17,177][123091] Updated weights for policy 0, policy_version 246931 (0.0008) [2023-12-26 01:33:17,233][123091] Updated weights for policy 0, policy_version 246941 (0.0009) [2023-12-26 01:33:17,293][123091] Updated weights for policy 0, policy_version 246951 (0.0009) [2023-12-26 01:33:17,964][123090] Updated weights for policy 1, policy_version 245763 (0.0010) [2023-12-26 01:33:18,023][123090] Updated weights for policy 1, policy_version 245773 (0.0010) [2023-12-26 01:33:18,071][123090] Updated weights for policy 1, policy_version 245783 (0.0010) [2023-12-26 01:33:18,115][123091] Updated weights for policy 0, policy_version 246961 (0.0008) [2023-12-26 01:33:18,174][123091] Updated weights for policy 0, policy_version 246971 (0.0007) [2023-12-26 01:33:18,230][123091] Updated weights for policy 0, policy_version 246981 (0.0009) [2023-12-26 01:33:18,292][123091] Updated weights for policy 0, policy_version 246991 (0.0010) [2023-12-26 01:33:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 126156800. Throughput: 0: 8630.9, 1: 8805.2. Samples: 126168892. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:18,785][121949] Avg episode reward: [(0, '6040.432'), (1, '4033.812')] [2023-12-26 01:33:18,889][123090] Updated weights for policy 1, policy_version 245793 (0.0010) [2023-12-26 01:33:18,945][123090] Updated weights for policy 1, policy_version 245803 (0.0009) [2023-12-26 01:33:18,992][123090] Updated weights for policy 1, policy_version 245813 (0.0008) [2023-12-26 01:33:19,057][123090] Updated weights for policy 1, policy_version 245823 (0.0009) [2023-12-26 01:33:19,139][123091] Updated weights for policy 0, policy_version 247001 (0.0009) [2023-12-26 01:33:19,204][123091] Updated weights for policy 0, policy_version 247011 (0.0009) [2023-12-26 01:33:19,271][123091] Updated weights for policy 0, policy_version 247021 (0.0008) [2023-12-26 01:33:19,939][123090] Updated weights for policy 1, policy_version 245833 (0.0010) [2023-12-26 01:33:20,004][123090] Updated weights for policy 1, policy_version 245843 (0.0008) [2023-12-26 01:33:20,077][123090] Updated weights for policy 1, policy_version 245853 (0.0007) [2023-12-26 01:33:20,155][123091] Updated weights for policy 0, policy_version 247031 (0.0009) [2023-12-26 01:33:20,222][123091] Updated weights for policy 0, policy_version 247041 (0.0009) [2023-12-26 01:33:20,280][123091] Updated weights for policy 0, policy_version 247051 (0.0010) [2023-12-26 01:33:20,844][123090] Updated weights for policy 1, policy_version 245863 (0.0009) [2023-12-26 01:33:20,905][123090] Updated weights for policy 1, policy_version 245873 (0.0009) [2023-12-26 01:33:20,967][123090] Updated weights for policy 1, policy_version 245883 (0.0009) [2023-12-26 01:33:21,153][123091] Updated weights for policy 0, policy_version 247061 (0.0009) [2023-12-26 01:33:21,223][123091] Updated weights for policy 0, policy_version 247071 (0.0008) [2023-12-26 01:33:21,297][123091] Updated weights for policy 0, policy_version 247081 (0.0007) [2023-12-26 01:33:21,861][123090] Updated weights for policy 1, policy_version 245893 (0.0009) [2023-12-26 01:33:21,932][123090] Updated weights for policy 1, policy_version 245903 (0.0010) [2023-12-26 01:33:21,995][123090] Updated weights for policy 1, policy_version 245913 (0.0009) [2023-12-26 01:33:22,063][123091] Updated weights for policy 0, policy_version 247091 (0.0007) [2023-12-26 01:33:22,118][123091] Updated weights for policy 0, policy_version 247101 (0.0010) [2023-12-26 01:33:22,186][123091] Updated weights for policy 0, policy_version 247111 (0.0009) [2023-12-26 01:33:22,802][123090] Updated weights for policy 1, policy_version 245923 (0.0008) [2023-12-26 01:33:22,857][123090] Updated weights for policy 1, policy_version 245934 (0.0009) [2023-12-26 01:33:22,911][123090] Updated weights for policy 1, policy_version 245944 (0.0009) [2023-12-26 01:33:23,057][123091] Updated weights for policy 0, policy_version 247121 (0.0010) [2023-12-26 01:33:23,120][123091] Updated weights for policy 0, policy_version 247131 (0.0010) [2023-12-26 01:33:23,177][123091] Updated weights for policy 0, policy_version 247141 (0.0009) [2023-12-26 01:33:23,244][123091] Updated weights for policy 0, policy_version 247151 (0.0010) [2023-12-26 01:33:23,760][123090] Updated weights for policy 1, policy_version 245954 (0.0009) [2023-12-26 01:33:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 126238720. Throughput: 0: 8593.9, 1: 8800.6. Samples: 126219520. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:23,785][121949] Avg episode reward: [(0, '6009.662'), (1, '4656.052')] [2023-12-26 01:33:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000247152_63275008.pth... [2023-12-26 01:33:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000246128_63012864.pth [2023-12-26 01:33:23,811][123090] Updated weights for policy 1, policy_version 245964 (0.0009) [2023-12-26 01:33:23,869][123090] Updated weights for policy 1, policy_version 245974 (0.0010) [2023-12-26 01:33:23,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000245984_62971904.pth... [2023-12-26 01:33:23,917][123090] Updated weights for policy 1, policy_version 245984 (0.0009) [2023-12-26 01:33:23,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000244960_62709760.pth [2023-12-26 01:33:24,099][123091] Updated weights for policy 0, policy_version 247161 (0.0010) [2023-12-26 01:33:24,167][123091] Updated weights for policy 0, policy_version 247171 (0.0009) [2023-12-26 01:33:24,226][123091] Updated weights for policy 0, policy_version 247181 (0.0009) [2023-12-26 01:33:24,777][123090] Updated weights for policy 1, policy_version 245994 (0.0005) [2023-12-26 01:33:24,833][123090] Updated weights for policy 1, policy_version 246004 (0.0005) [2023-12-26 01:33:24,883][123090] Updated weights for policy 1, policy_version 246014 (0.0005) [2023-12-26 01:33:25,080][123091] Updated weights for policy 0, policy_version 247191 (0.0010) [2023-12-26 01:33:25,132][123091] Updated weights for policy 0, policy_version 247201 (0.0009) [2023-12-26 01:33:25,181][123091] Updated weights for policy 0, policy_version 247211 (0.0009) [2023-12-26 01:33:25,537][123090] Updated weights for policy 1, policy_version 246024 (0.0009) [2023-12-26 01:33:25,588][123090] Updated weights for policy 1, policy_version 246034 (0.0009) [2023-12-26 01:33:25,642][123090] Updated weights for policy 1, policy_version 246044 (0.0013) [2023-12-26 01:33:25,948][123091] Updated weights for policy 0, policy_version 247221 (0.0010) [2023-12-26 01:33:26,003][123091] Updated weights for policy 0, policy_version 247231 (0.0011) [2023-12-26 01:33:26,069][123091] Updated weights for policy 0, policy_version 247241 (0.0011) [2023-12-26 01:33:26,549][123090] Updated weights for policy 1, policy_version 246054 (0.0009) [2023-12-26 01:33:26,611][123090] Updated weights for policy 1, policy_version 246064 (0.0009) [2023-12-26 01:33:26,664][123090] Updated weights for policy 1, policy_version 246074 (0.0009) [2023-12-26 01:33:26,844][123091] Updated weights for policy 0, policy_version 247251 (0.0011) [2023-12-26 01:33:26,902][123091] Updated weights for policy 0, policy_version 247261 (0.0009) [2023-12-26 01:33:26,969][123091] Updated weights for policy 0, policy_version 247271 (0.0006) [2023-12-26 01:33:27,552][123090] Updated weights for policy 1, policy_version 246084 (0.0009) [2023-12-26 01:33:27,621][123090] Updated weights for policy 1, policy_version 246094 (0.0010) [2023-12-26 01:33:27,651][123091] Updated weights for policy 0, policy_version 247281 (0.0005) [2023-12-26 01:33:27,681][123090] Updated weights for policy 1, policy_version 246104 (0.0008) [2023-12-26 01:33:27,717][123091] Updated weights for policy 0, policy_version 247291 (0.0005) [2023-12-26 01:33:27,783][123091] Updated weights for policy 0, policy_version 247301 (0.0008) [2023-12-26 01:33:27,839][123091] Updated weights for policy 0, policy_version 247311 (0.0010) [2023-12-26 01:33:28,532][123090] Updated weights for policy 1, policy_version 246114 (0.0008) [2023-12-26 01:33:28,595][123090] Updated weights for policy 1, policy_version 246124 (0.0008) [2023-12-26 01:33:28,608][123091] Updated weights for policy 0, policy_version 247321 (0.0010) [2023-12-26 01:33:28,644][123090] Updated weights for policy 1, policy_version 246134 (0.0010) [2023-12-26 01:33:28,663][123091] Updated weights for policy 0, policy_version 247331 (0.0010) [2023-12-26 01:33:28,704][123090] Updated weights for policy 1, policy_version 246144 (0.0006) [2023-12-26 01:33:28,722][123091] Updated weights for policy 0, policy_version 247341 (0.0010) [2023-12-26 01:33:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 126337024. Throughput: 0: 8641.8, 1: 8756.3. Samples: 126323848. Policy #0 lag: (min: 5.0, avg: 5.7, max: 24.0) [2023-12-26 01:33:28,785][121949] Avg episode reward: [(0, '6076.879'), (1, '4798.513')] [2023-12-26 01:33:29,549][123090] Updated weights for policy 1, policy_version 246154 (0.0008) [2023-12-26 01:33:29,554][123091] Updated weights for policy 0, policy_version 247351 (0.0011) [2023-12-26 01:33:29,609][123090] Updated weights for policy 1, policy_version 246164 (0.0010) [2023-12-26 01:33:29,616][123091] Updated weights for policy 0, policy_version 247361 (0.0010) [2023-12-26 01:33:29,673][123090] Updated weights for policy 1, policy_version 246174 (0.0008) [2023-12-26 01:33:29,675][123091] Updated weights for policy 0, policy_version 247371 (0.0010) [2023-12-26 01:33:30,479][123091] Updated weights for policy 0, policy_version 247381 (0.0010) [2023-12-26 01:33:30,491][123090] Updated weights for policy 1, policy_version 246184 (0.0006) [2023-12-26 01:33:30,542][123091] Updated weights for policy 0, policy_version 247391 (0.0011) [2023-12-26 01:33:30,549][123090] Updated weights for policy 1, policy_version 246194 (0.0008) [2023-12-26 01:33:30,596][123091] Updated weights for policy 0, policy_version 247401 (0.0010) [2023-12-26 01:33:30,601][123090] Updated weights for policy 1, policy_version 246204 (0.0010) [2023-12-26 01:33:31,342][123090] Updated weights for policy 1, policy_version 246214 (0.0008) [2023-12-26 01:33:31,366][123091] Updated weights for policy 0, policy_version 247411 (0.0011) [2023-12-26 01:33:31,412][123090] Updated weights for policy 1, policy_version 246224 (0.0009) [2023-12-26 01:33:31,427][123091] Updated weights for policy 0, policy_version 247421 (0.0011) [2023-12-26 01:33:31,469][123090] Updated weights for policy 1, policy_version 246234 (0.0009) [2023-12-26 01:33:31,483][123091] Updated weights for policy 0, policy_version 247431 (0.0007) [2023-12-26 01:33:32,290][123091] Updated weights for policy 0, policy_version 247441 (0.0010) [2023-12-26 01:33:32,317][123090] Updated weights for policy 1, policy_version 246244 (0.0009) [2023-12-26 01:33:32,351][123091] Updated weights for policy 0, policy_version 247451 (0.0006) [2023-12-26 01:33:32,381][123090] Updated weights for policy 1, policy_version 246254 (0.0010) [2023-12-26 01:33:32,419][123091] Updated weights for policy 0, policy_version 247461 (0.0008) [2023-12-26 01:33:32,437][123090] Updated weights for policy 1, policy_version 246264 (0.0008) [2023-12-26 01:33:32,479][123091] Updated weights for policy 0, policy_version 247471 (0.0010) [2023-12-26 01:33:33,239][123091] Updated weights for policy 0, policy_version 247481 (0.0005) [2023-12-26 01:33:33,291][123090] Updated weights for policy 1, policy_version 246274 (0.0007) [2023-12-26 01:33:33,294][123091] Updated weights for policy 0, policy_version 247491 (0.0005) [2023-12-26 01:33:33,353][123090] Updated weights for policy 1, policy_version 246284 (0.0005) [2023-12-26 01:33:33,361][123091] Updated weights for policy 0, policy_version 247501 (0.0005) [2023-12-26 01:33:33,413][123090] Updated weights for policy 1, policy_version 246294 (0.0005) [2023-12-26 01:33:33,471][123090] Updated weights for policy 1, policy_version 246304 (0.0005) [2023-12-26 01:33:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 126418944. Throughput: 0: 8741.0, 1: 8728.3. Samples: 126431044. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:33,785][121949] Avg episode reward: [(0, '5966.358'), (1, '4758.093')] [2023-12-26 01:33:33,971][123091] Updated weights for policy 0, policy_version 247511 (0.0008) [2023-12-26 01:33:34,028][123091] Updated weights for policy 0, policy_version 247521 (0.0010) [2023-12-26 01:33:34,084][123091] Updated weights for policy 0, policy_version 247531 (0.0009) [2023-12-26 01:33:34,117][123090] Updated weights for policy 1, policy_version 246314 (0.0006) [2023-12-26 01:33:34,188][123090] Updated weights for policy 1, policy_version 246324 (0.0007) [2023-12-26 01:33:34,265][123090] Updated weights for policy 1, policy_version 246334 (0.0008) [2023-12-26 01:33:34,832][123091] Updated weights for policy 0, policy_version 247541 (0.0008) [2023-12-26 01:33:34,891][123091] Updated weights for policy 0, policy_version 247551 (0.0005) [2023-12-26 01:33:34,935][123091] Updated weights for policy 0, policy_version 247561 (0.0005) [2023-12-26 01:33:35,051][123090] Updated weights for policy 1, policy_version 246344 (0.0011) [2023-12-26 01:33:35,117][123090] Updated weights for policy 1, policy_version 246354 (0.0010) [2023-12-26 01:33:35,176][123090] Updated weights for policy 1, policy_version 246364 (0.0010) [2023-12-26 01:33:35,656][123091] Updated weights for policy 0, policy_version 247571 (0.0006) [2023-12-26 01:33:35,707][123091] Updated weights for policy 0, policy_version 247581 (0.0009) [2023-12-26 01:33:35,760][123091] Updated weights for policy 0, policy_version 247592 (0.0009) [2023-12-26 01:33:35,898][123090] Updated weights for policy 1, policy_version 246374 (0.0010) [2023-12-26 01:33:35,945][123090] Updated weights for policy 1, policy_version 246384 (0.0010) [2023-12-26 01:33:36,004][123090] Updated weights for policy 1, policy_version 246394 (0.0010) [2023-12-26 01:33:36,473][123091] Updated weights for policy 0, policy_version 247602 (0.0006) [2023-12-26 01:33:36,536][123091] Updated weights for policy 0, policy_version 247612 (0.0006) [2023-12-26 01:33:36,600][123091] Updated weights for policy 0, policy_version 247622 (0.0008) [2023-12-26 01:33:36,671][123091] Updated weights for policy 0, policy_version 247632 (0.0008) [2023-12-26 01:33:36,795][123090] Updated weights for policy 1, policy_version 246404 (0.0008) [2023-12-26 01:33:36,866][123090] Updated weights for policy 1, policy_version 246414 (0.0006) [2023-12-26 01:33:36,924][123090] Updated weights for policy 1, policy_version 246424 (0.0005) [2023-12-26 01:33:37,285][123091] Updated weights for policy 0, policy_version 247642 (0.0009) [2023-12-26 01:33:37,343][123091] Updated weights for policy 0, policy_version 247652 (0.0010) [2023-12-26 01:33:37,410][123091] Updated weights for policy 0, policy_version 247662 (0.0010) [2023-12-26 01:33:37,555][123090] Updated weights for policy 1, policy_version 246434 (0.0005) [2023-12-26 01:33:37,615][123090] Updated weights for policy 1, policy_version 246444 (0.0005) [2023-12-26 01:33:37,687][123090] Updated weights for policy 1, policy_version 246454 (0.0008) [2023-12-26 01:33:37,747][123090] Updated weights for policy 1, policy_version 246464 (0.0007) [2023-12-26 01:33:38,120][123091] Updated weights for policy 0, policy_version 247672 (0.0006) [2023-12-26 01:33:38,191][123091] Updated weights for policy 0, policy_version 247682 (0.0005) [2023-12-26 01:33:38,259][123091] Updated weights for policy 0, policy_version 247692 (0.0005) [2023-12-26 01:33:38,442][123090] Updated weights for policy 1, policy_version 246474 (0.0011) [2023-12-26 01:33:38,497][123090] Updated weights for policy 1, policy_version 246484 (0.0010) [2023-12-26 01:33:38,550][123090] Updated weights for policy 1, policy_version 246494 (0.0010) [2023-12-26 01:33:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 126517248. Throughput: 0: 8861.3, 1: 8734.8. Samples: 126487952. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:38,786][121949] Avg episode reward: [(0, '5923.094'), (1, '4921.038')] [2023-12-26 01:33:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000247696_63414272.pth... [2023-12-26 01:33:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000246496_63102976.pth... [2023-12-26 01:33:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000246672_63152128.pth [2023-12-26 01:33:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000245472_62840832.pth [2023-12-26 01:33:38,954][123091] Updated weights for policy 0, policy_version 247702 (0.0007) [2023-12-26 01:33:39,023][123091] Updated weights for policy 0, policy_version 247712 (0.0005) [2023-12-26 01:33:39,093][123091] Updated weights for policy 0, policy_version 247722 (0.0007) [2023-12-26 01:33:39,399][123090] Updated weights for policy 1, policy_version 246504 (0.0010) [2023-12-26 01:33:39,468][123090] Updated weights for policy 1, policy_version 246514 (0.0009) [2023-12-26 01:33:39,531][123090] Updated weights for policy 1, policy_version 246524 (0.0010) [2023-12-26 01:33:39,905][123091] Updated weights for policy 0, policy_version 247732 (0.0007) [2023-12-26 01:33:39,979][123091] Updated weights for policy 0, policy_version 247742 (0.0010) [2023-12-26 01:33:40,037][123091] Updated weights for policy 0, policy_version 247752 (0.0010) [2023-12-26 01:33:40,359][123090] Updated weights for policy 1, policy_version 246534 (0.0009) [2023-12-26 01:33:40,421][123090] Updated weights for policy 1, policy_version 246544 (0.0009) [2023-12-26 01:33:40,481][123090] Updated weights for policy 1, policy_version 246554 (0.0009) [2023-12-26 01:33:40,848][123091] Updated weights for policy 0, policy_version 247762 (0.0010) [2023-12-26 01:33:40,907][123091] Updated weights for policy 0, policy_version 247772 (0.0008) [2023-12-26 01:33:40,962][123091] Updated weights for policy 0, policy_version 247782 (0.0008) [2023-12-26 01:33:41,021][123091] Updated weights for policy 0, policy_version 247792 (0.0008) [2023-12-26 01:33:41,243][123090] Updated weights for policy 1, policy_version 246564 (0.0009) [2023-12-26 01:33:41,313][123090] Updated weights for policy 1, policy_version 246574 (0.0008) [2023-12-26 01:33:41,386][123090] Updated weights for policy 1, policy_version 246584 (0.0009) [2023-12-26 01:33:41,834][123091] Updated weights for policy 0, policy_version 247802 (0.0010) [2023-12-26 01:33:41,905][123091] Updated weights for policy 0, policy_version 247812 (0.0009) [2023-12-26 01:33:41,972][123091] Updated weights for policy 0, policy_version 247822 (0.0009) [2023-12-26 01:33:42,202][123090] Updated weights for policy 1, policy_version 246594 (0.0009) [2023-12-26 01:33:42,264][123090] Updated weights for policy 1, policy_version 246604 (0.0009) [2023-12-26 01:33:42,339][123090] Updated weights for policy 1, policy_version 246614 (0.0009) [2023-12-26 01:33:42,412][123090] Updated weights for policy 1, policy_version 246624 (0.0010) [2023-12-26 01:33:42,810][123091] Updated weights for policy 0, policy_version 247832 (0.0010) [2023-12-26 01:33:42,864][123091] Updated weights for policy 0, policy_version 247842 (0.0010) [2023-12-26 01:33:42,915][123091] Updated weights for policy 0, policy_version 247852 (0.0010) [2023-12-26 01:33:43,261][123090] Updated weights for policy 1, policy_version 246634 (0.0005) [2023-12-26 01:33:43,315][123090] Updated weights for policy 1, policy_version 246644 (0.0005) [2023-12-26 01:33:43,370][123090] Updated weights for policy 1, policy_version 246654 (0.0006) [2023-12-26 01:33:43,691][123091] Updated weights for policy 0, policy_version 247862 (0.0011) [2023-12-26 01:33:43,742][123091] Updated weights for policy 0, policy_version 247872 (0.0010) [2023-12-26 01:33:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 126599168. Throughput: 0: 8894.9, 1: 8724.5. Samples: 126596516. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:43,785][121949] Avg episode reward: [(0, '5892.670'), (1, '5113.089')] [2023-12-26 01:33:43,797][123091] Updated weights for policy 0, policy_version 247882 (0.0010) [2023-12-26 01:33:44,100][123090] Updated weights for policy 1, policy_version 246664 (0.0005) [2023-12-26 01:33:44,153][123090] Updated weights for policy 1, policy_version 246674 (0.0005) [2023-12-26 01:33:44,217][123090] Updated weights for policy 1, policy_version 246684 (0.0005) [2023-12-26 01:33:44,476][123091] Updated weights for policy 0, policy_version 247892 (0.0008) [2023-12-26 01:33:44,535][123091] Updated weights for policy 0, policy_version 247902 (0.0007) [2023-12-26 01:33:44,602][123091] Updated weights for policy 0, policy_version 247912 (0.0005) [2023-12-26 01:33:45,017][123090] Updated weights for policy 1, policy_version 246694 (0.0007) [2023-12-26 01:33:45,082][123090] Updated weights for policy 1, policy_version 246704 (0.0009) [2023-12-26 01:33:45,148][123090] Updated weights for policy 1, policy_version 246714 (0.0007) [2023-12-26 01:33:45,398][123091] Updated weights for policy 0, policy_version 247922 (0.0008) [2023-12-26 01:33:45,445][123091] Updated weights for policy 0, policy_version 247932 (0.0007) [2023-12-26 01:33:45,496][123091] Updated weights for policy 0, policy_version 247942 (0.0006) [2023-12-26 01:33:45,551][123091] Updated weights for policy 0, policy_version 247952 (0.0005) [2023-12-26 01:33:45,825][123090] Updated weights for policy 1, policy_version 246724 (0.0007) [2023-12-26 01:33:45,876][123090] Updated weights for policy 1, policy_version 246734 (0.0010) [2023-12-26 01:33:45,929][123090] Updated weights for policy 1, policy_version 246744 (0.0006) [2023-12-26 01:33:46,250][123091] Updated weights for policy 0, policy_version 247962 (0.0006) [2023-12-26 01:33:46,321][123091] Updated weights for policy 0, policy_version 247972 (0.0006) [2023-12-26 01:33:46,395][123091] Updated weights for policy 0, policy_version 247982 (0.0006) [2023-12-26 01:33:46,628][123090] Updated weights for policy 1, policy_version 246754 (0.0005) [2023-12-26 01:33:46,697][123090] Updated weights for policy 1, policy_version 246764 (0.0005) [2023-12-26 01:33:46,770][123090] Updated weights for policy 1, policy_version 246774 (0.0006) [2023-12-26 01:33:46,835][123090] Updated weights for policy 1, policy_version 246784 (0.0007) [2023-12-26 01:33:47,099][123091] Updated weights for policy 0, policy_version 247992 (0.0005) [2023-12-26 01:33:47,150][123091] Updated weights for policy 0, policy_version 248002 (0.0007) [2023-12-26 01:33:47,197][123091] Updated weights for policy 0, policy_version 248012 (0.0010) [2023-12-26 01:33:47,487][123090] Updated weights for policy 1, policy_version 246794 (0.0005) [2023-12-26 01:33:47,551][123090] Updated weights for policy 1, policy_version 246804 (0.0005) [2023-12-26 01:33:47,618][123090] Updated weights for policy 1, policy_version 246814 (0.0006) [2023-12-26 01:33:48,023][123091] Updated weights for policy 0, policy_version 248022 (0.0011) [2023-12-26 01:33:48,081][123091] Updated weights for policy 0, policy_version 248032 (0.0010) [2023-12-26 01:33:48,128][123091] Updated weights for policy 0, policy_version 248042 (0.0010) [2023-12-26 01:33:48,379][123090] Updated weights for policy 1, policy_version 246824 (0.0009) [2023-12-26 01:33:48,442][123090] Updated weights for policy 1, policy_version 246834 (0.0010) [2023-12-26 01:33:48,496][123090] Updated weights for policy 1, policy_version 246844 (0.0010) [2023-12-26 01:33:48,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 126697472. Throughput: 0: 9009.6, 1: 8822.0. Samples: 126709472. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:48,784][121949] Avg episode reward: [(0, '5785.138'), (1, '5219.419')] [2023-12-26 01:33:48,862][123091] Updated weights for policy 0, policy_version 248052 (0.0009) [2023-12-26 01:33:48,929][123091] Updated weights for policy 0, policy_version 248062 (0.0008) [2023-12-26 01:33:48,999][123091] Updated weights for policy 0, policy_version 248072 (0.0008) [2023-12-26 01:33:49,385][123090] Updated weights for policy 1, policy_version 246854 (0.0008) [2023-12-26 01:33:49,452][123090] Updated weights for policy 1, policy_version 246864 (0.0008) [2023-12-26 01:33:49,505][123090] Updated weights for policy 1, policy_version 246874 (0.0009) [2023-12-26 01:33:49,803][123091] Updated weights for policy 0, policy_version 248082 (0.0009) [2023-12-26 01:33:49,866][123091] Updated weights for policy 0, policy_version 248092 (0.0011) [2023-12-26 01:33:49,933][123091] Updated weights for policy 0, policy_version 248102 (0.0011) [2023-12-26 01:33:50,009][123091] Updated weights for policy 0, policy_version 248112 (0.0010) [2023-12-26 01:33:50,346][123090] Updated weights for policy 1, policy_version 246884 (0.0009) [2023-12-26 01:33:50,410][123090] Updated weights for policy 1, policy_version 246894 (0.0010) [2023-12-26 01:33:50,466][123090] Updated weights for policy 1, policy_version 246904 (0.0010) [2023-12-26 01:33:50,736][123091] Updated weights for policy 0, policy_version 248122 (0.0010) [2023-12-26 01:33:50,804][123091] Updated weights for policy 0, policy_version 248132 (0.0011) [2023-12-26 01:33:50,868][123091] Updated weights for policy 0, policy_version 248142 (0.0009) [2023-12-26 01:33:51,394][123090] Updated weights for policy 1, policy_version 246914 (0.0010) [2023-12-26 01:33:51,466][123090] Updated weights for policy 1, policy_version 246924 (0.0009) [2023-12-26 01:33:51,534][123090] Updated weights for policy 1, policy_version 246934 (0.0009) [2023-12-26 01:33:51,609][123090] Updated weights for policy 1, policy_version 246944 (0.0009) [2023-12-26 01:33:51,643][123091] Updated weights for policy 0, policy_version 248152 (0.0007) [2023-12-26 01:33:51,706][123091] Updated weights for policy 0, policy_version 248162 (0.0010) [2023-12-26 01:33:51,772][123091] Updated weights for policy 0, policy_version 248172 (0.0009) [2023-12-26 01:33:52,427][123090] Updated weights for policy 1, policy_version 246954 (0.0009) [2023-12-26 01:33:52,488][123090] Updated weights for policy 1, policy_version 246964 (0.0010) [2023-12-26 01:33:52,545][123090] Updated weights for policy 1, policy_version 246974 (0.0009) [2023-12-26 01:33:52,574][123091] Updated weights for policy 0, policy_version 248182 (0.0010) [2023-12-26 01:33:52,641][123091] Updated weights for policy 0, policy_version 248192 (0.0010) [2023-12-26 01:33:52,706][123091] Updated weights for policy 0, policy_version 248202 (0.0010) [2023-12-26 01:33:53,397][123090] Updated weights for policy 1, policy_version 246984 (0.0008) [2023-12-26 01:33:53,454][123090] Updated weights for policy 1, policy_version 246994 (0.0009) [2023-12-26 01:33:53,504][123091] Updated weights for policy 0, policy_version 248212 (0.0010) [2023-12-26 01:33:53,514][123090] Updated weights for policy 1, policy_version 247004 (0.0008) [2023-12-26 01:33:53,569][123091] Updated weights for policy 0, policy_version 248222 (0.0009) [2023-12-26 01:33:53,630][123091] Updated weights for policy 0, policy_version 248232 (0.0009) [2023-12-26 01:33:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 126787584. Throughput: 0: 9001.4, 1: 8768.1. Samples: 126760600. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:53,785][121949] Avg episode reward: [(0, '5865.522'), (1, '5451.987')] [2023-12-26 01:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000248240_63553536.pth... [2023-12-26 01:33:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000247008_63234048.pth... [2023-12-26 01:33:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000247152_63275008.pth [2023-12-26 01:33:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000248240_63553536.pth [2023-12-26 01:33:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000245984_62971904.pth [2023-12-26 01:33:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000247008_63234048.pth [2023-12-26 01:33:54,339][123090] Updated weights for policy 1, policy_version 247014 (0.0009) [2023-12-26 01:33:54,402][123090] Updated weights for policy 1, policy_version 247024 (0.0008) [2023-12-26 01:33:54,467][123090] Updated weights for policy 1, policy_version 247034 (0.0008) [2023-12-26 01:33:54,475][123091] Updated weights for policy 0, policy_version 248242 (0.0009) [2023-12-26 01:33:54,532][123091] Updated weights for policy 0, policy_version 248252 (0.0009) [2023-12-26 01:33:54,589][123091] Updated weights for policy 0, policy_version 248263 (0.0010) [2023-12-26 01:33:55,310][123090] Updated weights for policy 1, policy_version 247044 (0.0009) [2023-12-26 01:33:55,363][123090] Updated weights for policy 1, policy_version 247054 (0.0010) [2023-12-26 01:33:55,389][123091] Updated weights for policy 0, policy_version 248273 (0.0009) [2023-12-26 01:33:55,419][123090] Updated weights for policy 1, policy_version 247064 (0.0009) [2023-12-26 01:33:55,439][123091] Updated weights for policy 0, policy_version 248283 (0.0007) [2023-12-26 01:33:55,486][123091] Updated weights for policy 0, policy_version 248293 (0.0009) [2023-12-26 01:33:55,546][123091] Updated weights for policy 0, policy_version 248303 (0.0010) [2023-12-26 01:33:56,284][123090] Updated weights for policy 1, policy_version 247074 (0.0009) [2023-12-26 01:33:56,348][123090] Updated weights for policy 1, policy_version 247084 (0.0009) [2023-12-26 01:33:56,398][123091] Updated weights for policy 0, policy_version 248313 (0.0010) [2023-12-26 01:33:56,405][123090] Updated weights for policy 1, policy_version 247094 (0.0006) [2023-12-26 01:33:56,450][123091] Updated weights for policy 0, policy_version 248323 (0.0011) [2023-12-26 01:33:56,471][123090] Updated weights for policy 1, policy_version 247104 (0.0007) [2023-12-26 01:33:56,496][123091] Updated weights for policy 0, policy_version 248333 (0.0008) [2023-12-26 01:33:57,212][123091] Updated weights for policy 0, policy_version 248343 (0.0007) [2023-12-26 01:33:57,237][123090] Updated weights for policy 1, policy_version 247114 (0.0005) [2023-12-26 01:33:57,270][123091] Updated weights for policy 0, policy_version 248353 (0.0005) [2023-12-26 01:33:57,284][123090] Updated weights for policy 1, policy_version 247124 (0.0005) [2023-12-26 01:33:57,328][123091] Updated weights for policy 0, policy_version 248363 (0.0010) [2023-12-26 01:33:57,340][123090] Updated weights for policy 1, policy_version 247134 (0.0006) [2023-12-26 01:33:57,966][123091] Updated weights for policy 0, policy_version 248373 (0.0008) [2023-12-26 01:33:57,990][123090] Updated weights for policy 1, policy_version 247144 (0.0007) [2023-12-26 01:33:58,047][123091] Updated weights for policy 0, policy_version 248383 (0.0008) [2023-12-26 01:33:58,060][123090] Updated weights for policy 1, policy_version 247154 (0.0008) [2023-12-26 01:33:58,114][123091] Updated weights for policy 0, policy_version 248393 (0.0011) [2023-12-26 01:33:58,127][123090] Updated weights for policy 1, policy_version 247164 (0.0008) [2023-12-26 01:33:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 126869504. Throughput: 0: 8999.4, 1: 8819.9. Samples: 126866604. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:33:58,785][121949] Avg episode reward: [(0, '5996.486'), (1, '5395.458')] [2023-12-26 01:33:58,931][123090] Updated weights for policy 1, policy_version 247174 (0.0008) [2023-12-26 01:33:58,999][123090] Updated weights for policy 1, policy_version 247184 (0.0009) [2023-12-26 01:33:59,000][123091] Updated weights for policy 0, policy_version 248403 (0.0011) [2023-12-26 01:33:59,064][123091] Updated weights for policy 0, policy_version 248413 (0.0011) [2023-12-26 01:33:59,066][123090] Updated weights for policy 1, policy_version 247194 (0.0006) [2023-12-26 01:33:59,132][123091] Updated weights for policy 0, policy_version 248423 (0.0011) [2023-12-26 01:33:59,848][123091] Updated weights for policy 0, policy_version 248433 (0.0010) [2023-12-26 01:33:59,911][123091] Updated weights for policy 0, policy_version 248443 (0.0010) [2023-12-26 01:33:59,946][123090] Updated weights for policy 1, policy_version 247204 (0.0007) [2023-12-26 01:33:59,967][123091] Updated weights for policy 0, policy_version 248453 (0.0010) [2023-12-26 01:34:00,010][123090] Updated weights for policy 1, policy_version 247214 (0.0008) [2023-12-26 01:34:00,027][123091] Updated weights for policy 0, policy_version 248463 (0.0011) [2023-12-26 01:34:00,064][123090] Updated weights for policy 1, policy_version 247224 (0.0009) [2023-12-26 01:34:00,843][123091] Updated weights for policy 0, policy_version 248473 (0.0010) [2023-12-26 01:34:00,890][123090] Updated weights for policy 1, policy_version 247234 (0.0009) [2023-12-26 01:34:00,897][123091] Updated weights for policy 0, policy_version 248483 (0.0010) [2023-12-26 01:34:00,940][123091] Updated weights for policy 0, policy_version 248493 (0.0010) [2023-12-26 01:34:00,943][123090] Updated weights for policy 1, policy_version 247244 (0.0007) [2023-12-26 01:34:00,998][123090] Updated weights for policy 1, policy_version 247254 (0.0008) [2023-12-26 01:34:01,063][123090] Updated weights for policy 1, policy_version 247264 (0.0008) [2023-12-26 01:34:01,777][123091] Updated weights for policy 0, policy_version 248503 (0.0007) [2023-12-26 01:34:01,834][123091] Updated weights for policy 0, policy_version 248513 (0.0005) [2023-12-26 01:34:01,882][123091] Updated weights for policy 0, policy_version 248523 (0.0008) [2023-12-26 01:34:01,908][123090] Updated weights for policy 1, policy_version 247274 (0.0008) [2023-12-26 01:34:01,967][123090] Updated weights for policy 1, policy_version 247284 (0.0009) [2023-12-26 01:34:02,024][123090] Updated weights for policy 1, policy_version 247294 (0.0009) [2023-12-26 01:34:02,642][123091] Updated weights for policy 0, policy_version 248533 (0.0009) [2023-12-26 01:34:02,700][123091] Updated weights for policy 0, policy_version 248543 (0.0010) [2023-12-26 01:34:02,717][123090] Updated weights for policy 1, policy_version 247304 (0.0006) [2023-12-26 01:34:02,760][123091] Updated weights for policy 0, policy_version 248553 (0.0011) [2023-12-26 01:34:02,772][123090] Updated weights for policy 1, policy_version 247314 (0.0007) [2023-12-26 01:34:02,829][123090] Updated weights for policy 1, policy_version 247324 (0.0009) [2023-12-26 01:34:03,534][123091] Updated weights for policy 0, policy_version 248563 (0.0007) [2023-12-26 01:34:03,591][123091] Updated weights for policy 0, policy_version 248573 (0.0005) [2023-12-26 01:34:03,649][123090] Updated weights for policy 1, policy_version 247334 (0.0009) [2023-12-26 01:34:03,652][123091] Updated weights for policy 0, policy_version 248583 (0.0005) [2023-12-26 01:34:03,705][123090] Updated weights for policy 1, policy_version 247344 (0.0009) [2023-12-26 01:34:03,761][123090] Updated weights for policy 1, policy_version 247354 (0.0010) [2023-12-26 01:34:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 126959616. Throughput: 0: 9052.2, 1: 8806.5. Samples: 126972540. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:03,785][121949] Avg episode reward: [(0, '6032.720'), (1, '5245.334')] [2023-12-26 01:34:04,416][123091] Updated weights for policy 0, policy_version 248593 (0.0006) [2023-12-26 01:34:04,482][123091] Updated weights for policy 0, policy_version 248603 (0.0008) [2023-12-26 01:34:04,557][123091] Updated weights for policy 0, policy_version 248613 (0.0010) [2023-12-26 01:34:04,609][123090] Updated weights for policy 1, policy_version 247364 (0.0008) [2023-12-26 01:34:04,621][123091] Updated weights for policy 0, policy_version 248623 (0.0010) [2023-12-26 01:34:04,681][123090] Updated weights for policy 1, policy_version 247374 (0.0006) [2023-12-26 01:34:04,740][123090] Updated weights for policy 1, policy_version 247384 (0.0009) [2023-12-26 01:34:05,395][123091] Updated weights for policy 0, policy_version 248633 (0.0006) [2023-12-26 01:34:05,446][123091] Updated weights for policy 0, policy_version 248643 (0.0006) [2023-12-26 01:34:05,511][123091] Updated weights for policy 0, policy_version 248653 (0.0006) [2023-12-26 01:34:05,518][123090] Updated weights for policy 1, policy_version 247394 (0.0009) [2023-12-26 01:34:05,587][123090] Updated weights for policy 1, policy_version 247404 (0.0009) [2023-12-26 01:34:05,640][123090] Updated weights for policy 1, policy_version 247414 (0.0010) [2023-12-26 01:34:06,229][123091] Updated weights for policy 0, policy_version 248663 (0.0010) [2023-12-26 01:34:06,292][123091] Updated weights for policy 0, policy_version 248673 (0.0011) [2023-12-26 01:34:06,351][123091] Updated weights for policy 0, policy_version 248683 (0.0011) [2023-12-26 01:34:06,522][123090] Updated weights for policy 1, policy_version 247425 (0.0009) [2023-12-26 01:34:06,587][123090] Updated weights for policy 1, policy_version 247435 (0.0010) [2023-12-26 01:34:06,644][123090] Updated weights for policy 1, policy_version 247445 (0.0011) [2023-12-26 01:34:06,700][123090] Updated weights for policy 1, policy_version 247455 (0.0010) [2023-12-26 01:34:07,097][123091] Updated weights for policy 0, policy_version 248693 (0.0011) [2023-12-26 01:34:07,144][123091] Updated weights for policy 0, policy_version 248703 (0.0010) [2023-12-26 01:34:07,192][123091] Updated weights for policy 0, policy_version 248713 (0.0010) [2023-12-26 01:34:07,556][123090] Updated weights for policy 1, policy_version 247465 (0.0006) [2023-12-26 01:34:07,627][123090] Updated weights for policy 1, policy_version 247475 (0.0008) [2023-12-26 01:34:07,683][123090] Updated weights for policy 1, policy_version 247485 (0.0005) [2023-12-26 01:34:07,964][123091] Updated weights for policy 0, policy_version 248723 (0.0009) [2023-12-26 01:34:08,018][123091] Updated weights for policy 0, policy_version 248733 (0.0005) [2023-12-26 01:34:08,071][123091] Updated weights for policy 0, policy_version 248743 (0.0005) [2023-12-26 01:34:08,513][123090] Updated weights for policy 1, policy_version 247495 (0.0008) [2023-12-26 01:34:08,567][123090] Updated weights for policy 1, policy_version 247505 (0.0008) [2023-12-26 01:34:08,633][123090] Updated weights for policy 1, policy_version 247515 (0.0009) [2023-12-26 01:34:08,769][123091] Updated weights for policy 0, policy_version 248753 (0.0006) [2023-12-26 01:34:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 127049728. Throughput: 0: 9089.7, 1: 8801.7. Samples: 127024632. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:08,785][121949] Avg episode reward: [(0, '6028.319'), (1, '5045.822')] [2023-12-26 01:34:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000247520_63365120.pth... [2023-12-26 01:34:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000246496_63102976.pth [2023-12-26 01:34:08,818][123091] Updated weights for policy 0, policy_version 248763 (0.0005) [2023-12-26 01:34:08,877][123091] Updated weights for policy 0, policy_version 248773 (0.0006) [2023-12-26 01:34:08,938][123091] Updated weights for policy 0, policy_version 248783 (0.0006) [2023-12-26 01:34:08,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000248784_63692800.pth... [2023-12-26 01:34:08,947][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000247696_63414272.pth [2023-12-26 01:34:09,543][123090] Updated weights for policy 1, policy_version 247525 (0.0010) [2023-12-26 01:34:09,601][123090] Updated weights for policy 1, policy_version 247535 (0.0010) [2023-12-26 01:34:09,667][123091] Updated weights for policy 0, policy_version 248793 (0.0007) [2023-12-26 01:34:09,669][123090] Updated weights for policy 1, policy_version 247545 (0.0010) [2023-12-26 01:34:09,723][123091] Updated weights for policy 0, policy_version 248803 (0.0006) [2023-12-26 01:34:09,773][123091] Updated weights for policy 0, policy_version 248813 (0.0007) [2023-12-26 01:34:10,447][123090] Updated weights for policy 1, policy_version 247555 (0.0007) [2023-12-26 01:34:10,507][123090] Updated weights for policy 1, policy_version 247565 (0.0005) [2023-12-26 01:34:10,560][123090] Updated weights for policy 1, policy_version 247575 (0.0005) [2023-12-26 01:34:10,596][123091] Updated weights for policy 0, policy_version 248823 (0.0008) [2023-12-26 01:34:10,653][123091] Updated weights for policy 0, policy_version 248833 (0.0009) [2023-12-26 01:34:10,703][123091] Updated weights for policy 0, policy_version 248843 (0.0010) [2023-12-26 01:34:11,318][123090] Updated weights for policy 1, policy_version 247585 (0.0009) [2023-12-26 01:34:11,389][123090] Updated weights for policy 1, policy_version 247595 (0.0007) [2023-12-26 01:34:11,460][123090] Updated weights for policy 1, policy_version 247605 (0.0009) [2023-12-26 01:34:11,522][123090] Updated weights for policy 1, policy_version 247615 (0.0010) [2023-12-26 01:34:11,584][123091] Updated weights for policy 0, policy_version 248853 (0.0010) [2023-12-26 01:34:11,646][123091] Updated weights for policy 0, policy_version 248863 (0.0010) [2023-12-26 01:34:11,702][123091] Updated weights for policy 0, policy_version 248873 (0.0009) [2023-12-26 01:34:12,326][123090] Updated weights for policy 1, policy_version 247625 (0.0008) [2023-12-26 01:34:12,402][123090] Updated weights for policy 1, policy_version 247635 (0.0009) [2023-12-26 01:34:12,462][123090] Updated weights for policy 1, policy_version 247645 (0.0009) [2023-12-26 01:34:12,606][123091] Updated weights for policy 0, policy_version 248883 (0.0010) [2023-12-26 01:34:12,673][123091] Updated weights for policy 0, policy_version 248893 (0.0009) [2023-12-26 01:34:12,735][123091] Updated weights for policy 0, policy_version 248903 (0.0010) [2023-12-26 01:34:13,285][123090] Updated weights for policy 1, policy_version 247655 (0.0010) [2023-12-26 01:34:13,349][123090] Updated weights for policy 1, policy_version 247665 (0.0009) [2023-12-26 01:34:13,420][123090] Updated weights for policy 1, policy_version 247675 (0.0009) [2023-12-26 01:34:13,527][123091] Updated weights for policy 0, policy_version 248913 (0.0008) [2023-12-26 01:34:13,606][123091] Updated weights for policy 0, policy_version 248923 (0.0005) [2023-12-26 01:34:13,677][123091] Updated weights for policy 0, policy_version 248933 (0.0005) [2023-12-26 01:34:13,752][123091] Updated weights for policy 0, policy_version 248943 (0.0005) [2023-12-26 01:34:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 127139840. Throughput: 0: 9120.0, 1: 8806.3. Samples: 127130532. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:13,785][121949] Avg episode reward: [(0, '5903.306'), (1, '5095.057')] [2023-12-26 01:34:14,299][123090] Updated weights for policy 1, policy_version 247685 (0.0008) [2023-12-26 01:34:14,343][123091] Updated weights for policy 0, policy_version 248953 (0.0005) [2023-12-26 01:34:14,347][123090] Updated weights for policy 1, policy_version 247695 (0.0009) [2023-12-26 01:34:14,397][123090] Updated weights for policy 1, policy_version 247705 (0.0009) [2023-12-26 01:34:14,410][123091] Updated weights for policy 0, policy_version 248963 (0.0005) [2023-12-26 01:34:14,482][123091] Updated weights for policy 0, policy_version 248973 (0.0006) [2023-12-26 01:34:15,206][123091] Updated weights for policy 0, policy_version 248983 (0.0009) [2023-12-26 01:34:15,261][123090] Updated weights for policy 1, policy_version 247715 (0.0008) [2023-12-26 01:34:15,272][123091] Updated weights for policy 0, policy_version 248993 (0.0010) [2023-12-26 01:34:15,326][123090] Updated weights for policy 1, policy_version 247725 (0.0009) [2023-12-26 01:34:15,337][123091] Updated weights for policy 0, policy_version 249003 (0.0008) [2023-12-26 01:34:15,388][123090] Updated weights for policy 1, policy_version 247735 (0.0009) [2023-12-26 01:34:16,092][123091] Updated weights for policy 0, policy_version 249013 (0.0008) [2023-12-26 01:34:16,157][123091] Updated weights for policy 0, policy_version 249023 (0.0010) [2023-12-26 01:34:16,206][123091] Updated weights for policy 0, policy_version 249033 (0.0009) [2023-12-26 01:34:16,277][123090] Updated weights for policy 1, policy_version 247745 (0.0010) [2023-12-26 01:34:16,328][123090] Updated weights for policy 1, policy_version 247755 (0.0009) [2023-12-26 01:34:16,378][123090] Updated weights for policy 1, policy_version 247765 (0.0010) [2023-12-26 01:34:16,435][123090] Updated weights for policy 1, policy_version 247776 (0.0009) [2023-12-26 01:34:16,983][123091] Updated weights for policy 0, policy_version 249043 (0.0008) [2023-12-26 01:34:17,044][123091] Updated weights for policy 0, policy_version 249053 (0.0005) [2023-12-26 01:34:17,111][123091] Updated weights for policy 0, policy_version 249063 (0.0005) [2023-12-26 01:34:17,308][123090] Updated weights for policy 1, policy_version 247786 (0.0005) [2023-12-26 01:34:17,375][123090] Updated weights for policy 1, policy_version 247796 (0.0005) [2023-12-26 01:34:17,452][123090] Updated weights for policy 1, policy_version 247806 (0.0005) [2023-12-26 01:34:17,742][123091] Updated weights for policy 0, policy_version 249073 (0.0006) [2023-12-26 01:34:17,805][123091] Updated weights for policy 0, policy_version 249083 (0.0009) [2023-12-26 01:34:17,873][123091] Updated weights for policy 0, policy_version 249093 (0.0009) [2023-12-26 01:34:17,931][123091] Updated weights for policy 0, policy_version 249103 (0.0009) [2023-12-26 01:34:18,130][123090] Updated weights for policy 1, policy_version 247816 (0.0008) [2023-12-26 01:34:18,184][123090] Updated weights for policy 1, policy_version 247826 (0.0009) [2023-12-26 01:34:18,231][123090] Updated weights for policy 1, policy_version 247836 (0.0008) [2023-12-26 01:34:18,765][123091] Updated weights for policy 0, policy_version 249113 (0.0009) [2023-12-26 01:34:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 127221760. Throughput: 0: 9167.2, 1: 8770.8. Samples: 127238252. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:18,785][121949] Avg episode reward: [(0, '5763.210'), (1, '5257.173')] [2023-12-26 01:34:18,827][123091] Updated weights for policy 0, policy_version 249123 (0.0009) [2023-12-26 01:34:18,889][123091] Updated weights for policy 0, policy_version 249133 (0.0010) [2023-12-26 01:34:19,071][123090] Updated weights for policy 1, policy_version 247846 (0.0008) [2023-12-26 01:34:19,150][123090] Updated weights for policy 1, policy_version 247856 (0.0009) [2023-12-26 01:34:19,227][123090] Updated weights for policy 1, policy_version 247866 (0.0009) [2023-12-26 01:34:19,651][123091] Updated weights for policy 0, policy_version 249143 (0.0009) [2023-12-26 01:34:19,720][123091] Updated weights for policy 0, policy_version 249153 (0.0009) [2023-12-26 01:34:19,786][123091] Updated weights for policy 0, policy_version 249163 (0.0009) [2023-12-26 01:34:20,069][123090] Updated weights for policy 1, policy_version 247876 (0.0009) [2023-12-26 01:34:20,134][123090] Updated weights for policy 1, policy_version 247886 (0.0010) [2023-12-26 01:34:20,209][123090] Updated weights for policy 1, policy_version 247896 (0.0009) [2023-12-26 01:34:20,586][123091] Updated weights for policy 0, policy_version 249173 (0.0010) [2023-12-26 01:34:20,653][123091] Updated weights for policy 0, policy_version 249183 (0.0007) [2023-12-26 01:34:20,732][123091] Updated weights for policy 0, policy_version 249193 (0.0006) [2023-12-26 01:34:21,044][123090] Updated weights for policy 1, policy_version 247906 (0.0009) [2023-12-26 01:34:21,121][123090] Updated weights for policy 1, policy_version 247916 (0.0009) [2023-12-26 01:34:21,187][123090] Updated weights for policy 1, policy_version 247926 (0.0012) [2023-12-26 01:34:21,260][123090] Updated weights for policy 1, policy_version 247936 (0.0009) [2023-12-26 01:34:21,521][123091] Updated weights for policy 0, policy_version 249203 (0.0010) [2023-12-26 01:34:21,586][123091] Updated weights for policy 0, policy_version 249213 (0.0009) [2023-12-26 01:34:21,649][123091] Updated weights for policy 0, policy_version 249223 (0.0008) [2023-12-26 01:34:22,051][123090] Updated weights for policy 1, policy_version 247946 (0.0005) [2023-12-26 01:34:22,112][123090] Updated weights for policy 1, policy_version 247956 (0.0006) [2023-12-26 01:34:22,194][123090] Updated weights for policy 1, policy_version 247966 (0.0006) [2023-12-26 01:34:22,461][123091] Updated weights for policy 0, policy_version 249233 (0.0008) [2023-12-26 01:34:22,525][123091] Updated weights for policy 0, policy_version 249243 (0.0009) [2023-12-26 01:34:22,588][123091] Updated weights for policy 0, policy_version 249253 (0.0010) [2023-12-26 01:34:22,655][123091] Updated weights for policy 0, policy_version 249263 (0.0009) [2023-12-26 01:34:22,889][123090] Updated weights for policy 1, policy_version 247976 (0.0006) [2023-12-26 01:34:22,961][123090] Updated weights for policy 1, policy_version 247986 (0.0005) [2023-12-26 01:34:23,027][123090] Updated weights for policy 1, policy_version 247996 (0.0005) [2023-12-26 01:34:23,442][123091] Updated weights for policy 0, policy_version 249273 (0.0009) [2023-12-26 01:34:23,495][123091] Updated weights for policy 0, policy_version 249283 (0.0010) [2023-12-26 01:34:23,548][123091] Updated weights for policy 0, policy_version 249293 (0.0010) [2023-12-26 01:34:23,708][123090] Updated weights for policy 1, policy_version 248006 (0.0006) [2023-12-26 01:34:23,771][123090] Updated weights for policy 1, policy_version 248016 (0.0005) [2023-12-26 01:34:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 127311872. Throughput: 0: 9092.7, 1: 8698.3. Samples: 127288540. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:23,785][121949] Avg episode reward: [(0, '5840.829'), (1, '5035.703')] [2023-12-26 01:34:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000249296_63823872.pth... [2023-12-26 01:34:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000248240_63553536.pth [2023-12-26 01:34:23,833][123090] Updated weights for policy 1, policy_version 248026 (0.0005) [2023-12-26 01:34:23,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000248032_63496192.pth... [2023-12-26 01:34:23,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000247008_63234048.pth [2023-12-26 01:34:24,469][123091] Updated weights for policy 0, policy_version 249303 (0.0009) [2023-12-26 01:34:24,518][123091] Updated weights for policy 0, policy_version 249313 (0.0009) [2023-12-26 01:34:24,544][123090] Updated weights for policy 1, policy_version 248036 (0.0007) [2023-12-26 01:34:24,573][123091] Updated weights for policy 0, policy_version 249323 (0.0007) [2023-12-26 01:34:24,605][123090] Updated weights for policy 1, policy_version 248046 (0.0011) [2023-12-26 01:34:24,668][123090] Updated weights for policy 1, policy_version 248056 (0.0011) [2023-12-26 01:34:25,333][123090] Updated weights for policy 1, policy_version 248066 (0.0009) [2023-12-26 01:34:25,388][123090] Updated weights for policy 1, policy_version 248076 (0.0005) [2023-12-26 01:34:25,447][123090] Updated weights for policy 1, policy_version 248087 (0.0007) [2023-12-26 01:34:25,469][123091] Updated weights for policy 0, policy_version 249333 (0.0008) [2023-12-26 01:34:25,528][123091] Updated weights for policy 0, policy_version 249343 (0.0008) [2023-12-26 01:34:25,594][123091] Updated weights for policy 0, policy_version 249353 (0.0009) [2023-12-26 01:34:26,185][123090] Updated weights for policy 1, policy_version 248097 (0.0006) [2023-12-26 01:34:26,251][123090] Updated weights for policy 1, policy_version 248107 (0.0009) [2023-12-26 01:34:26,317][123090] Updated weights for policy 1, policy_version 248117 (0.0009) [2023-12-26 01:34:26,375][123090] Updated weights for policy 1, policy_version 248127 (0.0010) [2023-12-26 01:34:26,429][123091] Updated weights for policy 0, policy_version 249363 (0.0009) [2023-12-26 01:34:26,492][123091] Updated weights for policy 0, policy_version 249373 (0.0009) [2023-12-26 01:34:26,559][123091] Updated weights for policy 0, policy_version 249383 (0.0010) [2023-12-26 01:34:27,157][123090] Updated weights for policy 1, policy_version 248137 (0.0006) [2023-12-26 01:34:27,228][123090] Updated weights for policy 1, policy_version 248147 (0.0005) [2023-12-26 01:34:27,280][123090] Updated weights for policy 1, policy_version 248157 (0.0005) [2023-12-26 01:34:27,435][123091] Updated weights for policy 0, policy_version 249393 (0.0009) [2023-12-26 01:34:27,494][123091] Updated weights for policy 0, policy_version 249403 (0.0009) [2023-12-26 01:34:27,543][123091] Updated weights for policy 0, policy_version 249413 (0.0009) [2023-12-26 01:34:27,594][123091] Updated weights for policy 0, policy_version 249424 (0.0010) [2023-12-26 01:34:28,013][123090] Updated weights for policy 1, policy_version 248167 (0.0009) [2023-12-26 01:34:28,077][123090] Updated weights for policy 1, policy_version 248177 (0.0009) [2023-12-26 01:34:28,138][123090] Updated weights for policy 1, policy_version 248187 (0.0009) [2023-12-26 01:34:28,460][123091] Updated weights for policy 0, policy_version 249434 (0.0007) [2023-12-26 01:34:28,507][123091] Updated weights for policy 0, policy_version 249444 (0.0005) [2023-12-26 01:34:28,553][123091] Updated weights for policy 0, policy_version 249454 (0.0005) [2023-12-26 01:34:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 127401984. Throughput: 0: 8977.3, 1: 8778.7. Samples: 127395536. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:28,785][121949] Avg episode reward: [(0, '5896.359'), (1, '4591.454')] [2023-12-26 01:34:28,902][123090] Updated weights for policy 1, policy_version 248197 (0.0007) [2023-12-26 01:34:28,952][123090] Updated weights for policy 1, policy_version 248207 (0.0009) [2023-12-26 01:34:29,021][123090] Updated weights for policy 1, policy_version 248217 (0.0010) [2023-12-26 01:34:29,332][123091] Updated weights for policy 0, policy_version 249464 (0.0009) [2023-12-26 01:34:29,403][123091] Updated weights for policy 0, policy_version 249474 (0.0009) [2023-12-26 01:34:29,464][123091] Updated weights for policy 0, policy_version 249484 (0.0009) [2023-12-26 01:34:29,865][123090] Updated weights for policy 1, policy_version 248227 (0.0009) [2023-12-26 01:34:29,925][123090] Updated weights for policy 1, policy_version 248237 (0.0006) [2023-12-26 01:34:30,001][123090] Updated weights for policy 1, policy_version 248247 (0.0006) [2023-12-26 01:34:30,325][123091] Updated weights for policy 0, policy_version 249494 (0.0010) [2023-12-26 01:34:30,396][123091] Updated weights for policy 0, policy_version 249504 (0.0009) [2023-12-26 01:34:30,443][123091] Updated weights for policy 0, policy_version 249514 (0.0009) [2023-12-26 01:34:30,689][123090] Updated weights for policy 1, policy_version 248257 (0.0006) [2023-12-26 01:34:30,751][123090] Updated weights for policy 1, policy_version 248267 (0.0009) [2023-12-26 01:34:30,806][123090] Updated weights for policy 1, policy_version 248277 (0.0008) [2023-12-26 01:34:30,853][123090] Updated weights for policy 1, policy_version 248287 (0.0008) [2023-12-26 01:34:31,269][123091] Updated weights for policy 0, policy_version 249524 (0.0008) [2023-12-26 01:34:31,328][123091] Updated weights for policy 0, policy_version 249534 (0.0005) [2023-12-26 01:34:31,400][123091] Updated weights for policy 0, policy_version 249544 (0.0011) [2023-12-26 01:34:31,688][123090] Updated weights for policy 1, policy_version 248297 (0.0008) [2023-12-26 01:34:31,759][123090] Updated weights for policy 1, policy_version 248307 (0.0011) [2023-12-26 01:34:31,826][123090] Updated weights for policy 1, policy_version 248317 (0.0010) [2023-12-26 01:34:32,108][123091] Updated weights for policy 0, policy_version 249554 (0.0010) [2023-12-26 01:34:32,162][123091] Updated weights for policy 0, policy_version 249564 (0.0009) [2023-12-26 01:34:32,222][123091] Updated weights for policy 0, policy_version 249574 (0.0010) [2023-12-26 01:34:32,277][123091] Updated weights for policy 0, policy_version 249584 (0.0008) [2023-12-26 01:34:32,630][123090] Updated weights for policy 1, policy_version 248327 (0.0010) [2023-12-26 01:34:32,683][123090] Updated weights for policy 1, policy_version 248337 (0.0008) [2023-12-26 01:34:32,742][123090] Updated weights for policy 1, policy_version 248347 (0.0005) [2023-12-26 01:34:33,101][123091] Updated weights for policy 0, policy_version 249594 (0.0010) [2023-12-26 01:34:33,151][123091] Updated weights for policy 0, policy_version 249604 (0.0010) [2023-12-26 01:34:33,210][123091] Updated weights for policy 0, policy_version 249614 (0.0010) [2023-12-26 01:34:33,442][123090] Updated weights for policy 1, policy_version 248357 (0.0008) [2023-12-26 01:34:33,496][123090] Updated weights for policy 1, policy_version 248367 (0.0010) [2023-12-26 01:34:33,553][123090] Updated weights for policy 1, policy_version 248377 (0.0010) [2023-12-26 01:34:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 127492096. Throughput: 0: 8907.3, 1: 8727.3. Samples: 127503028. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:33,785][121949] Avg episode reward: [(0, '5954.620'), (1, '4532.361')] [2023-12-26 01:34:33,867][123091] Updated weights for policy 0, policy_version 249624 (0.0006) [2023-12-26 01:34:33,924][123091] Updated weights for policy 0, policy_version 249634 (0.0005) [2023-12-26 01:34:33,996][123091] Updated weights for policy 0, policy_version 249644 (0.0006) [2023-12-26 01:34:34,358][123090] Updated weights for policy 1, policy_version 248387 (0.0009) [2023-12-26 01:34:34,433][123090] Updated weights for policy 1, policy_version 248397 (0.0006) [2023-12-26 01:34:34,512][123090] Updated weights for policy 1, policy_version 248407 (0.0008) [2023-12-26 01:34:34,740][123091] Updated weights for policy 0, policy_version 249654 (0.0009) [2023-12-26 01:34:34,796][123091] Updated weights for policy 0, policy_version 249664 (0.0011) [2023-12-26 01:34:34,853][123091] Updated weights for policy 0, policy_version 249674 (0.0008) [2023-12-26 01:34:35,250][123090] Updated weights for policy 1, policy_version 248417 (0.0007) [2023-12-26 01:34:35,312][123090] Updated weights for policy 1, policy_version 248427 (0.0010) [2023-12-26 01:34:35,372][123090] Updated weights for policy 1, policy_version 248437 (0.0009) [2023-12-26 01:34:35,426][123090] Updated weights for policy 1, policy_version 248447 (0.0009) [2023-12-26 01:34:35,560][123091] Updated weights for policy 0, policy_version 249684 (0.0006) [2023-12-26 01:34:35,616][123091] Updated weights for policy 0, policy_version 249694 (0.0006) [2023-12-26 01:34:35,689][123091] Updated weights for policy 0, policy_version 249704 (0.0006) [2023-12-26 01:34:36,167][123090] Updated weights for policy 1, policy_version 248457 (0.0007) [2023-12-26 01:34:36,228][123090] Updated weights for policy 1, policy_version 248467 (0.0007) [2023-12-26 01:34:36,284][123090] Updated weights for policy 1, policy_version 248477 (0.0010) [2023-12-26 01:34:36,408][123091] Updated weights for policy 0, policy_version 249714 (0.0007) [2023-12-26 01:34:36,467][123091] Updated weights for policy 0, policy_version 249724 (0.0010) [2023-12-26 01:34:36,524][123091] Updated weights for policy 0, policy_version 249734 (0.0009) [2023-12-26 01:34:36,585][123091] Updated weights for policy 0, policy_version 249744 (0.0010) [2023-12-26 01:34:37,136][123090] Updated weights for policy 1, policy_version 248487 (0.0009) [2023-12-26 01:34:37,201][123090] Updated weights for policy 1, policy_version 248497 (0.0008) [2023-12-26 01:34:37,270][123090] Updated weights for policy 1, policy_version 248507 (0.0009) [2023-12-26 01:34:37,358][123091] Updated weights for policy 0, policy_version 249754 (0.0006) [2023-12-26 01:34:37,412][123091] Updated weights for policy 0, policy_version 249764 (0.0005) [2023-12-26 01:34:37,465][123091] Updated weights for policy 0, policy_version 249774 (0.0005) [2023-12-26 01:34:38,026][123090] Updated weights for policy 1, policy_version 248517 (0.0010) [2023-12-26 01:34:38,094][123090] Updated weights for policy 1, policy_version 248527 (0.0010) [2023-12-26 01:34:38,153][123090] Updated weights for policy 1, policy_version 248537 (0.0010) [2023-12-26 01:34:38,251][123091] Updated weights for policy 0, policy_version 249784 (0.0008) [2023-12-26 01:34:38,303][123091] Updated weights for policy 0, policy_version 249794 (0.0009) [2023-12-26 01:34:38,369][123091] Updated weights for policy 0, policy_version 249804 (0.0010) [2023-12-26 01:34:38,785][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 127582208. Throughput: 0: 8936.9, 1: 8802.8. Samples: 127558892. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:34:38,786][121949] Avg episode reward: [(0, '5879.217'), (1, '4738.286')] [2023-12-26 01:34:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000249808_63954944.pth... [2023-12-26 01:34:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000248544_63627264.pth... [2023-12-26 01:34:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000248784_63692800.pth [2023-12-26 01:34:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000247520_63365120.pth [2023-12-26 01:34:38,957][123090] Updated weights for policy 1, policy_version 248547 (0.0008) [2023-12-26 01:34:39,021][123090] Updated weights for policy 1, policy_version 248557 (0.0006) [2023-12-26 01:34:39,072][123090] Updated weights for policy 1, policy_version 248567 (0.0009) [2023-12-26 01:34:39,110][123091] Updated weights for policy 0, policy_version 249814 (0.0009) [2023-12-26 01:34:39,158][123091] Updated weights for policy 0, policy_version 249825 (0.0010) [2023-12-26 01:34:39,210][123091] Updated weights for policy 0, policy_version 249835 (0.0010) [2023-12-26 01:34:39,892][123090] Updated weights for policy 1, policy_version 248577 (0.0008) [2023-12-26 01:34:39,967][123090] Updated weights for policy 1, policy_version 248587 (0.0009) [2023-12-26 01:34:39,974][123091] Updated weights for policy 0, policy_version 249845 (0.0008) [2023-12-26 01:34:40,029][123090] Updated weights for policy 1, policy_version 248597 (0.0009) [2023-12-26 01:34:40,039][123091] Updated weights for policy 0, policy_version 249855 (0.0008) [2023-12-26 01:34:40,086][123090] Updated weights for policy 1, policy_version 248607 (0.0007) [2023-12-26 01:34:40,098][123091] Updated weights for policy 0, policy_version 249865 (0.0009) [2023-12-26 01:34:40,875][123090] Updated weights for policy 1, policy_version 248617 (0.0010) [2023-12-26 01:34:40,929][123091] Updated weights for policy 0, policy_version 249875 (0.0008) [2023-12-26 01:34:40,931][123090] Updated weights for policy 1, policy_version 248627 (0.0009) [2023-12-26 01:34:40,986][123090] Updated weights for policy 1, policy_version 248637 (0.0009) [2023-12-26 01:34:40,997][123091] Updated weights for policy 0, policy_version 249885 (0.0005) [2023-12-26 01:34:41,058][123091] Updated weights for policy 0, policy_version 249895 (0.0007) [2023-12-26 01:34:41,873][123090] Updated weights for policy 1, policy_version 248647 (0.0009) [2023-12-26 01:34:41,909][123091] Updated weights for policy 0, policy_version 249905 (0.0008) [2023-12-26 01:34:41,933][123090] Updated weights for policy 1, policy_version 248657 (0.0009) [2023-12-26 01:34:41,971][123091] Updated weights for policy 0, policy_version 249915 (0.0009) [2023-12-26 01:34:41,988][123090] Updated weights for policy 1, policy_version 248667 (0.0008) [2023-12-26 01:34:42,026][123091] Updated weights for policy 0, policy_version 249925 (0.0008) [2023-12-26 01:34:42,083][123091] Updated weights for policy 0, policy_version 249935 (0.0009) [2023-12-26 01:34:42,836][123090] Updated weights for policy 1, policy_version 248677 (0.0009) [2023-12-26 01:34:42,900][123090] Updated weights for policy 1, policy_version 248687 (0.0011) [2023-12-26 01:34:42,955][123091] Updated weights for policy 0, policy_version 249945 (0.0008) [2023-12-26 01:34:42,966][123090] Updated weights for policy 1, policy_version 248697 (0.0011) [2023-12-26 01:34:43,013][123091] Updated weights for policy 0, policy_version 249955 (0.0006) [2023-12-26 01:34:43,091][123091] Updated weights for policy 0, policy_version 249965 (0.0010) [2023-12-26 01:34:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 127664128. Throughput: 0: 8939.3, 1: 8765.6. Samples: 127663324. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:34:43,785][121949] Avg episode reward: [(0, '5746.321'), (1, '4377.920')] [2023-12-26 01:34:43,800][123090] Updated weights for policy 1, policy_version 248707 (0.0010) [2023-12-26 01:34:43,845][123091] Updated weights for policy 0, policy_version 249975 (0.0007) [2023-12-26 01:34:43,868][123090] Updated weights for policy 1, policy_version 248717 (0.0010) [2023-12-26 01:34:43,907][123091] Updated weights for policy 0, policy_version 249985 (0.0005) [2023-12-26 01:34:43,935][123090] Updated weights for policy 1, policy_version 248727 (0.0010) [2023-12-26 01:34:43,965][123091] Updated weights for policy 0, policy_version 249995 (0.0005) [2023-12-26 01:34:44,622][123091] Updated weights for policy 0, policy_version 250005 (0.0005) [2023-12-26 01:34:44,680][123091] Updated weights for policy 0, policy_version 250015 (0.0005) [2023-12-26 01:34:44,744][123091] Updated weights for policy 0, policy_version 250025 (0.0007) [2023-12-26 01:34:44,747][123090] Updated weights for policy 1, policy_version 248737 (0.0010) [2023-12-26 01:34:44,810][123090] Updated weights for policy 1, policy_version 248747 (0.0013) [2023-12-26 01:34:44,868][123090] Updated weights for policy 1, policy_version 248757 (0.0007) [2023-12-26 01:34:44,936][123090] Updated weights for policy 1, policy_version 248767 (0.0011) [2023-12-26 01:34:45,421][123091] Updated weights for policy 0, policy_version 250035 (0.0010) [2023-12-26 01:34:45,474][123091] Updated weights for policy 0, policy_version 250045 (0.0009) [2023-12-26 01:34:45,527][123091] Updated weights for policy 0, policy_version 250055 (0.0010) [2023-12-26 01:34:45,636][123090] Updated weights for policy 1, policy_version 248777 (0.0006) [2023-12-26 01:34:45,691][123090] Updated weights for policy 1, policy_version 248787 (0.0005) [2023-12-26 01:34:45,748][123090] Updated weights for policy 1, policy_version 248797 (0.0005) [2023-12-26 01:34:46,367][123090] Updated weights for policy 1, policy_version 248807 (0.0005) [2023-12-26 01:34:46,419][123090] Updated weights for policy 1, policy_version 248817 (0.0005) [2023-12-26 01:34:46,466][123091] Updated weights for policy 0, policy_version 250065 (0.0009) [2023-12-26 01:34:46,471][123090] Updated weights for policy 1, policy_version 248827 (0.0005) [2023-12-26 01:34:46,520][123091] Updated weights for policy 0, policy_version 250075 (0.0009) [2023-12-26 01:34:46,574][123091] Updated weights for policy 0, policy_version 250086 (0.0010) [2023-12-26 01:34:46,626][123091] Updated weights for policy 0, policy_version 250096 (0.0010) [2023-12-26 01:34:47,114][123090] Updated weights for policy 1, policy_version 248837 (0.0005) [2023-12-26 01:34:47,186][123090] Updated weights for policy 1, policy_version 248847 (0.0007) [2023-12-26 01:34:47,255][123090] Updated weights for policy 1, policy_version 248857 (0.0006) [2023-12-26 01:34:47,538][123091] Updated weights for policy 0, policy_version 250106 (0.0009) [2023-12-26 01:34:47,597][123091] Updated weights for policy 0, policy_version 250116 (0.0009) [2023-12-26 01:34:47,652][123091] Updated weights for policy 0, policy_version 250127 (0.0011) [2023-12-26 01:34:47,927][123090] Updated weights for policy 1, policy_version 248867 (0.0009) [2023-12-26 01:34:47,991][123090] Updated weights for policy 1, policy_version 248877 (0.0006) [2023-12-26 01:34:48,054][123090] Updated weights for policy 1, policy_version 248887 (0.0009) [2023-12-26 01:34:48,527][123091] Updated weights for policy 0, policy_version 250137 (0.0009) [2023-12-26 01:34:48,579][123091] Updated weights for policy 0, policy_version 250147 (0.0006) [2023-12-26 01:34:48,649][123091] Updated weights for policy 0, policy_version 250157 (0.0007) [2023-12-26 01:34:48,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 127762432. Throughput: 0: 8923.4, 1: 8875.4. Samples: 127773484. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:34:48,785][121949] Avg episode reward: [(0, '5826.117'), (1, '4213.122')] [2023-12-26 01:34:48,846][123090] Updated weights for policy 1, policy_version 248897 (0.0010) [2023-12-26 01:34:48,924][123090] Updated weights for policy 1, policy_version 248907 (0.0009) [2023-12-26 01:34:48,982][123090] Updated weights for policy 1, policy_version 248917 (0.0006) [2023-12-26 01:34:49,055][123090] Updated weights for policy 1, policy_version 248927 (0.0006) [2023-12-26 01:34:49,318][123091] Updated weights for policy 0, policy_version 250167 (0.0007) [2023-12-26 01:34:49,391][123091] Updated weights for policy 0, policy_version 250177 (0.0007) [2023-12-26 01:34:49,451][123091] Updated weights for policy 0, policy_version 250187 (0.0005) [2023-12-26 01:34:49,738][123090] Updated weights for policy 1, policy_version 248937 (0.0006) [2023-12-26 01:34:49,808][123090] Updated weights for policy 1, policy_version 248947 (0.0007) [2023-12-26 01:34:49,881][123090] Updated weights for policy 1, policy_version 248957 (0.0008) [2023-12-26 01:34:50,191][123091] Updated weights for policy 0, policy_version 250197 (0.0008) [2023-12-26 01:34:50,251][123091] Updated weights for policy 0, policy_version 250207 (0.0011) [2023-12-26 01:34:50,307][123091] Updated weights for policy 0, policy_version 250217 (0.0011) [2023-12-26 01:34:50,681][123090] Updated weights for policy 1, policy_version 248967 (0.0008) [2023-12-26 01:34:50,745][123090] Updated weights for policy 1, policy_version 248977 (0.0011) [2023-12-26 01:34:50,814][123090] Updated weights for policy 1, policy_version 248987 (0.0011) [2023-12-26 01:34:51,048][123091] Updated weights for policy 0, policy_version 250227 (0.0011) [2023-12-26 01:34:51,118][123091] Updated weights for policy 0, policy_version 250237 (0.0011) [2023-12-26 01:34:51,187][123091] Updated weights for policy 0, policy_version 250247 (0.0010) [2023-12-26 01:34:51,584][123090] Updated weights for policy 1, policy_version 248997 (0.0010) [2023-12-26 01:34:51,645][123090] Updated weights for policy 1, policy_version 249007 (0.0010) [2023-12-26 01:34:51,711][123090] Updated weights for policy 1, policy_version 249017 (0.0008) [2023-12-26 01:34:52,018][123091] Updated weights for policy 0, policy_version 250257 (0.0011) [2023-12-26 01:34:52,086][123091] Updated weights for policy 0, policy_version 250267 (0.0011) [2023-12-26 01:34:52,149][123091] Updated weights for policy 0, policy_version 250277 (0.0010) [2023-12-26 01:34:52,213][123091] Updated weights for policy 0, policy_version 250287 (0.0011) [2023-12-26 01:34:52,573][123090] Updated weights for policy 1, policy_version 249027 (0.0009) [2023-12-26 01:34:52,626][123090] Updated weights for policy 1, policy_version 249037 (0.0010) [2023-12-26 01:34:52,686][123090] Updated weights for policy 1, policy_version 249047 (0.0011) [2023-12-26 01:34:52,997][123091] Updated weights for policy 0, policy_version 250297 (0.0006) [2023-12-26 01:34:53,061][123091] Updated weights for policy 0, policy_version 250307 (0.0009) [2023-12-26 01:34:53,109][123091] Updated weights for policy 0, policy_version 250317 (0.0010) [2023-12-26 01:34:53,529][123090] Updated weights for policy 1, policy_version 249057 (0.0010) [2023-12-26 01:34:53,592][123090] Updated weights for policy 1, policy_version 249067 (0.0011) [2023-12-26 01:34:53,655][123090] Updated weights for policy 1, policy_version 249077 (0.0011) [2023-12-26 01:34:53,715][123090] Updated weights for policy 1, policy_version 249087 (0.0009) [2023-12-26 01:34:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 127852544. Throughput: 0: 8947.3, 1: 8907.6. Samples: 127828108. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:34:53,785][121949] Avg episode reward: [(0, '5873.667'), (1, '4496.785')] [2023-12-26 01:34:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000249088_63766528.pth... [2023-12-26 01:34:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000248032_63496192.pth [2023-12-26 01:34:53,831][123091] Updated weights for policy 0, policy_version 250327 (0.0007) [2023-12-26 01:34:53,895][123091] Updated weights for policy 0, policy_version 250337 (0.0006) [2023-12-26 01:34:53,963][123091] Updated weights for policy 0, policy_version 250347 (0.0005) [2023-12-26 01:34:53,985][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000250352_64094208.pth... [2023-12-26 01:34:53,992][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000249296_63823872.pth [2023-12-26 01:34:54,430][123090] Updated weights for policy 1, policy_version 249097 (0.0010) [2023-12-26 01:34:54,481][123090] Updated weights for policy 1, policy_version 249107 (0.0010) [2023-12-26 01:34:54,537][123090] Updated weights for policy 1, policy_version 249117 (0.0010) [2023-12-26 01:34:54,676][123091] Updated weights for policy 0, policy_version 250357 (0.0008) [2023-12-26 01:34:54,723][123091] Updated weights for policy 0, policy_version 250367 (0.0010) [2023-12-26 01:34:54,786][123091] Updated weights for policy 0, policy_version 250377 (0.0011) [2023-12-26 01:34:55,294][123090] Updated weights for policy 1, policy_version 249127 (0.0006) [2023-12-26 01:34:55,350][123090] Updated weights for policy 1, policy_version 249137 (0.0005) [2023-12-26 01:34:55,399][123090] Updated weights for policy 1, policy_version 249147 (0.0005) [2023-12-26 01:34:55,517][123091] Updated weights for policy 0, policy_version 250387 (0.0009) [2023-12-26 01:34:55,570][123091] Updated weights for policy 0, policy_version 250397 (0.0005) [2023-12-26 01:34:55,618][123091] Updated weights for policy 0, policy_version 250407 (0.0005) [2023-12-26 01:34:56,084][123090] Updated weights for policy 1, policy_version 249157 (0.0005) [2023-12-26 01:34:56,142][123090] Updated weights for policy 1, policy_version 249167 (0.0010) [2023-12-26 01:34:56,209][123090] Updated weights for policy 1, policy_version 249177 (0.0011) [2023-12-26 01:34:56,315][123091] Updated weights for policy 0, policy_version 250417 (0.0005) [2023-12-26 01:34:56,373][123091] Updated weights for policy 0, policy_version 250427 (0.0005) [2023-12-26 01:34:56,435][123091] Updated weights for policy 0, policy_version 250437 (0.0007) [2023-12-26 01:34:56,495][123091] Updated weights for policy 0, policy_version 250447 (0.0007) [2023-12-26 01:34:56,948][123090] Updated weights for policy 1, policy_version 249187 (0.0010) [2023-12-26 01:34:57,009][123090] Updated weights for policy 1, policy_version 249197 (0.0006) [2023-12-26 01:34:57,056][123090] Updated weights for policy 1, policy_version 249207 (0.0005) [2023-12-26 01:34:57,248][123091] Updated weights for policy 0, policy_version 250457 (0.0010) [2023-12-26 01:34:57,299][123091] Updated weights for policy 0, policy_version 250467 (0.0010) [2023-12-26 01:34:57,361][123091] Updated weights for policy 0, policy_version 250477 (0.0010) [2023-12-26 01:34:57,694][123090] Updated weights for policy 1, policy_version 249217 (0.0010) [2023-12-26 01:34:57,748][123090] Updated weights for policy 1, policy_version 249227 (0.0005) [2023-12-26 01:34:57,795][123090] Updated weights for policy 1, policy_version 249237 (0.0005) [2023-12-26 01:34:57,842][123090] Updated weights for policy 1, policy_version 249247 (0.0005) [2023-12-26 01:34:58,189][123091] Updated weights for policy 0, policy_version 250487 (0.0007) [2023-12-26 01:34:58,256][123091] Updated weights for policy 0, policy_version 250497 (0.0007) [2023-12-26 01:34:58,314][123091] Updated weights for policy 0, policy_version 250507 (0.0011) [2023-12-26 01:34:58,679][123090] Updated weights for policy 1, policy_version 249257 (0.0010) [2023-12-26 01:34:58,744][123090] Updated weights for policy 1, policy_version 249267 (0.0010) [2023-12-26 01:34:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 127942656. Throughput: 0: 8994.6, 1: 9020.5. Samples: 127941212. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:34:58,784][121949] Avg episode reward: [(0, '6003.379'), (1, '4405.742')] [2023-12-26 01:34:58,811][123090] Updated weights for policy 1, policy_version 249277 (0.0009) [2023-12-26 01:34:59,154][123091] Updated weights for policy 0, policy_version 250517 (0.0009) [2023-12-26 01:34:59,205][123091] Updated weights for policy 0, policy_version 250527 (0.0009) [2023-12-26 01:34:59,273][123091] Updated weights for policy 0, policy_version 250537 (0.0009) [2023-12-26 01:34:59,624][123090] Updated weights for policy 1, policy_version 249287 (0.0009) [2023-12-26 01:34:59,688][123090] Updated weights for policy 1, policy_version 249297 (0.0009) [2023-12-26 01:34:59,745][123090] Updated weights for policy 1, policy_version 249307 (0.0013) [2023-12-26 01:35:00,119][123091] Updated weights for policy 0, policy_version 250547 (0.0008) [2023-12-26 01:35:00,190][123091] Updated weights for policy 0, policy_version 250557 (0.0006) [2023-12-26 01:35:00,254][123091] Updated weights for policy 0, policy_version 250567 (0.0005) [2023-12-26 01:35:00,543][123090] Updated weights for policy 1, policy_version 249317 (0.0010) [2023-12-26 01:35:00,608][123090] Updated weights for policy 1, policy_version 249327 (0.0009) [2023-12-26 01:35:00,679][123090] Updated weights for policy 1, policy_version 249337 (0.0009) [2023-12-26 01:35:00,848][123091] Updated weights for policy 0, policy_version 250577 (0.0005) [2023-12-26 01:35:00,907][123091] Updated weights for policy 0, policy_version 250587 (0.0006) [2023-12-26 01:35:00,969][123091] Updated weights for policy 0, policy_version 250597 (0.0009) [2023-12-26 01:35:01,027][123091] Updated weights for policy 0, policy_version 250607 (0.0010) [2023-12-26 01:35:01,559][123090] Updated weights for policy 1, policy_version 249347 (0.0010) [2023-12-26 01:35:01,627][123090] Updated weights for policy 1, policy_version 249357 (0.0009) [2023-12-26 01:35:01,690][123090] Updated weights for policy 1, policy_version 249367 (0.0009) [2023-12-26 01:35:01,822][123091] Updated weights for policy 0, policy_version 250617 (0.0010) [2023-12-26 01:35:01,870][123091] Updated weights for policy 0, policy_version 250627 (0.0010) [2023-12-26 01:35:01,921][123091] Updated weights for policy 0, policy_version 250637 (0.0010) [2023-12-26 01:35:02,516][123090] Updated weights for policy 1, policy_version 249377 (0.0009) [2023-12-26 01:35:02,571][123090] Updated weights for policy 1, policy_version 249387 (0.0009) [2023-12-26 01:35:02,627][123090] Updated weights for policy 1, policy_version 249397 (0.0009) [2023-12-26 01:35:02,693][123090] Updated weights for policy 1, policy_version 249407 (0.0009) [2023-12-26 01:35:02,759][123091] Updated weights for policy 0, policy_version 250647 (0.0010) [2023-12-26 01:35:02,806][123091] Updated weights for policy 0, policy_version 250657 (0.0010) [2023-12-26 01:35:02,857][123091] Updated weights for policy 0, policy_version 250667 (0.0010) [2023-12-26 01:35:03,523][123090] Updated weights for policy 1, policy_version 249417 (0.0009) [2023-12-26 01:35:03,584][123090] Updated weights for policy 1, policy_version 249427 (0.0008) [2023-12-26 01:35:03,647][123090] Updated weights for policy 1, policy_version 249437 (0.0010) [2023-12-26 01:35:03,699][123091] Updated weights for policy 0, policy_version 250677 (0.0008) [2023-12-26 01:35:03,764][123091] Updated weights for policy 0, policy_version 250687 (0.0009) [2023-12-26 01:35:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 128032768. Throughput: 0: 8916.6, 1: 9025.0. Samples: 128045624. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:03,785][121949] Avg episode reward: [(0, '6092.646'), (1, '4610.093')] [2023-12-26 01:35:03,825][123091] Updated weights for policy 0, policy_version 250697 (0.0009) [2023-12-26 01:35:04,492][123090] Updated weights for policy 1, policy_version 249447 (0.0009) [2023-12-26 01:35:04,552][123090] Updated weights for policy 1, policy_version 249457 (0.0010) [2023-12-26 01:35:04,596][123090] Updated weights for policy 1, policy_version 249467 (0.0010) [2023-12-26 01:35:04,629][123091] Updated weights for policy 0, policy_version 250707 (0.0011) [2023-12-26 01:35:04,687][123091] Updated weights for policy 0, policy_version 250717 (0.0010) [2023-12-26 01:35:04,737][123091] Updated weights for policy 0, policy_version 250727 (0.0010) [2023-12-26 01:35:05,293][123090] Updated weights for policy 1, policy_version 249477 (0.0008) [2023-12-26 01:35:05,356][123090] Updated weights for policy 1, policy_version 249487 (0.0006) [2023-12-26 01:35:05,408][123090] Updated weights for policy 1, policy_version 249497 (0.0005) [2023-12-26 01:35:05,552][123091] Updated weights for policy 0, policy_version 250737 (0.0011) [2023-12-26 01:35:05,618][123091] Updated weights for policy 0, policy_version 250747 (0.0011) [2023-12-26 01:35:05,686][123091] Updated weights for policy 0, policy_version 250757 (0.0011) [2023-12-26 01:35:05,749][123091] Updated weights for policy 0, policy_version 250767 (0.0011) [2023-12-26 01:35:06,156][123090] Updated weights for policy 1, policy_version 249507 (0.0009) [2023-12-26 01:35:06,213][123090] Updated weights for policy 1, policy_version 249517 (0.0009) [2023-12-26 01:35:06,276][123090] Updated weights for policy 1, policy_version 249527 (0.0009) [2023-12-26 01:35:06,536][123091] Updated weights for policy 0, policy_version 250777 (0.0011) [2023-12-26 01:35:06,592][123091] Updated weights for policy 0, policy_version 250787 (0.0011) [2023-12-26 01:35:06,649][123091] Updated weights for policy 0, policy_version 250797 (0.0011) [2023-12-26 01:35:07,118][123090] Updated weights for policy 1, policy_version 249537 (0.0009) [2023-12-26 01:35:07,185][123090] Updated weights for policy 1, policy_version 249547 (0.0008) [2023-12-26 01:35:07,239][123090] Updated weights for policy 1, policy_version 249557 (0.0008) [2023-12-26 01:35:07,301][123090] Updated weights for policy 1, policy_version 249567 (0.0005) [2023-12-26 01:35:07,350][123091] Updated weights for policy 0, policy_version 250807 (0.0007) [2023-12-26 01:35:07,419][123091] Updated weights for policy 0, policy_version 250817 (0.0005) [2023-12-26 01:35:07,478][123091] Updated weights for policy 0, policy_version 250827 (0.0005) [2023-12-26 01:35:08,083][123090] Updated weights for policy 1, policy_version 249577 (0.0005) [2023-12-26 01:35:08,148][123090] Updated weights for policy 1, policy_version 249587 (0.0006) [2023-12-26 01:35:08,208][123090] Updated weights for policy 1, policy_version 249597 (0.0005) [2023-12-26 01:35:08,222][123091] Updated weights for policy 0, policy_version 250837 (0.0008) [2023-12-26 01:35:08,266][123091] Updated weights for policy 0, policy_version 250847 (0.0010) [2023-12-26 01:35:08,318][123091] Updated weights for policy 0, policy_version 250857 (0.0010) [2023-12-26 01:35:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 128122880. Throughput: 0: 8923.0, 1: 9079.4. Samples: 128098644. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:08,785][121949] Avg episode reward: [(0, '6104.149'), (1, '4985.777')] [2023-12-26 01:35:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000250864_64225280.pth... [2023-12-26 01:35:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000249600_63897600.pth... [2023-12-26 01:35:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000248544_63627264.pth [2023-12-26 01:35:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000249808_63954944.pth [2023-12-26 01:35:08,900][123090] Updated weights for policy 1, policy_version 249607 (0.0009) [2023-12-26 01:35:08,952][123090] Updated weights for policy 1, policy_version 249617 (0.0010) [2023-12-26 01:35:09,008][123090] Updated weights for policy 1, policy_version 249627 (0.0010) [2023-12-26 01:35:09,012][123091] Updated weights for policy 0, policy_version 250867 (0.0013) [2023-12-26 01:35:09,063][123091] Updated weights for policy 0, policy_version 250877 (0.0009) [2023-12-26 01:35:09,116][123091] Updated weights for policy 0, policy_version 250888 (0.0009) [2023-12-26 01:35:09,871][123090] Updated weights for policy 1, policy_version 249637 (0.0010) [2023-12-26 01:35:09,933][123090] Updated weights for policy 1, policy_version 249647 (0.0009) [2023-12-26 01:35:10,003][123091] Updated weights for policy 0, policy_version 250898 (0.0010) [2023-12-26 01:35:10,010][123090] Updated weights for policy 1, policy_version 249657 (0.0008) [2023-12-26 01:35:10,067][123091] Updated weights for policy 0, policy_version 250908 (0.0010) [2023-12-26 01:35:10,128][123091] Updated weights for policy 0, policy_version 250918 (0.0008) [2023-12-26 01:35:10,195][123091] Updated weights for policy 0, policy_version 250928 (0.0007) [2023-12-26 01:35:10,739][123090] Updated weights for policy 1, policy_version 249667 (0.0006) [2023-12-26 01:35:10,792][123090] Updated weights for policy 1, policy_version 249677 (0.0009) [2023-12-26 01:35:10,848][123090] Updated weights for policy 1, policy_version 249687 (0.0005) [2023-12-26 01:35:10,986][123091] Updated weights for policy 0, policy_version 250938 (0.0011) [2023-12-26 01:35:11,061][123091] Updated weights for policy 0, policy_version 250948 (0.0009) [2023-12-26 01:35:11,136][123091] Updated weights for policy 0, policy_version 250958 (0.0008) [2023-12-26 01:35:11,659][123090] Updated weights for policy 1, policy_version 249697 (0.0006) [2023-12-26 01:35:11,727][123090] Updated weights for policy 1, policy_version 249707 (0.0007) [2023-12-26 01:35:11,799][123090] Updated weights for policy 1, policy_version 249717 (0.0005) [2023-12-26 01:35:11,860][123090] Updated weights for policy 1, policy_version 249727 (0.0005) [2023-12-26 01:35:11,913][123091] Updated weights for policy 0, policy_version 250968 (0.0006) [2023-12-26 01:35:11,971][123091] Updated weights for policy 0, policy_version 250978 (0.0005) [2023-12-26 01:35:12,041][123091] Updated weights for policy 0, policy_version 250988 (0.0006) [2023-12-26 01:35:12,615][123090] Updated weights for policy 1, policy_version 249737 (0.0009) [2023-12-26 01:35:12,671][123090] Updated weights for policy 1, policy_version 249747 (0.0008) [2023-12-26 01:35:12,728][123090] Updated weights for policy 1, policy_version 249757 (0.0010) [2023-12-26 01:35:12,771][123091] Updated weights for policy 0, policy_version 250998 (0.0011) [2023-12-26 01:35:12,831][123091] Updated weights for policy 0, policy_version 251008 (0.0011) [2023-12-26 01:35:12,893][123091] Updated weights for policy 0, policy_version 251018 (0.0011) [2023-12-26 01:35:13,503][123090] Updated weights for policy 1, policy_version 249767 (0.0010) [2023-12-26 01:35:13,568][123090] Updated weights for policy 1, policy_version 249777 (0.0010) [2023-12-26 01:35:13,620][123091] Updated weights for policy 0, policy_version 251028 (0.0009) [2023-12-26 01:35:13,635][123090] Updated weights for policy 1, policy_version 249787 (0.0008) [2023-12-26 01:35:13,686][123091] Updated weights for policy 0, policy_version 251038 (0.0009) [2023-12-26 01:35:13,761][123091] Updated weights for policy 0, policy_version 251048 (0.0010) [2023-12-26 01:35:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 128212992. Throughput: 0: 9032.0, 1: 9007.4. Samples: 128207300. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:13,784][121949] Avg episode reward: [(0, '6112.842'), (1, '4618.303')] [2023-12-26 01:35:14,348][123090] Updated weights for policy 1, policy_version 249797 (0.0008) [2023-12-26 01:35:14,406][123090] Updated weights for policy 1, policy_version 249807 (0.0009) [2023-12-26 01:35:14,461][123090] Updated weights for policy 1, policy_version 249817 (0.0009) [2023-12-26 01:35:14,605][123091] Updated weights for policy 0, policy_version 251058 (0.0010) [2023-12-26 01:35:14,672][123091] Updated weights for policy 0, policy_version 251068 (0.0007) [2023-12-26 01:35:14,732][123091] Updated weights for policy 0, policy_version 251078 (0.0011) [2023-12-26 01:35:14,801][123091] Updated weights for policy 0, policy_version 251088 (0.0011) [2023-12-26 01:35:15,290][123090] Updated weights for policy 1, policy_version 249827 (0.0008) [2023-12-26 01:35:15,361][123090] Updated weights for policy 1, policy_version 249837 (0.0005) [2023-12-26 01:35:15,427][123090] Updated weights for policy 1, policy_version 249847 (0.0005) [2023-12-26 01:35:15,631][123091] Updated weights for policy 0, policy_version 251098 (0.0011) [2023-12-26 01:35:15,690][123091] Updated weights for policy 0, policy_version 251108 (0.0011) [2023-12-26 01:35:15,749][123091] Updated weights for policy 0, policy_version 251118 (0.0011) [2023-12-26 01:35:16,177][123090] Updated weights for policy 1, policy_version 249857 (0.0006) [2023-12-26 01:35:16,240][123090] Updated weights for policy 1, policy_version 249867 (0.0010) [2023-12-26 01:35:16,305][123090] Updated weights for policy 1, policy_version 249877 (0.0010) [2023-12-26 01:35:16,361][123090] Updated weights for policy 1, policy_version 249887 (0.0010) [2023-12-26 01:35:16,528][123091] Updated weights for policy 0, policy_version 251128 (0.0006) [2023-12-26 01:35:16,587][123091] Updated weights for policy 0, policy_version 251138 (0.0005) [2023-12-26 01:35:16,648][123091] Updated weights for policy 0, policy_version 251148 (0.0005) [2023-12-26 01:35:17,165][123090] Updated weights for policy 1, policy_version 249897 (0.0010) [2023-12-26 01:35:17,249][123090] Updated weights for policy 1, policy_version 249907 (0.0010) [2023-12-26 01:35:17,283][123091] Updated weights for policy 0, policy_version 251158 (0.0008) [2023-12-26 01:35:17,304][123090] Updated weights for policy 1, policy_version 249917 (0.0010) [2023-12-26 01:35:17,343][123091] Updated weights for policy 0, policy_version 251168 (0.0009) [2023-12-26 01:35:17,402][123091] Updated weights for policy 0, policy_version 251178 (0.0009) [2023-12-26 01:35:18,089][123090] Updated weights for policy 1, policy_version 249927 (0.0010) [2023-12-26 01:35:18,140][123090] Updated weights for policy 1, policy_version 249937 (0.0010) [2023-12-26 01:35:18,199][123090] Updated weights for policy 1, policy_version 249947 (0.0010) [2023-12-26 01:35:18,210][123091] Updated weights for policy 0, policy_version 251188 (0.0008) [2023-12-26 01:35:18,268][123091] Updated weights for policy 0, policy_version 251198 (0.0005) [2023-12-26 01:35:18,341][123091] Updated weights for policy 0, policy_version 251208 (0.0007) [2023-12-26 01:35:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 128303104. Throughput: 0: 9046.5, 1: 8991.9. Samples: 128314756. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:18,785][121949] Avg episode reward: [(0, '6141.724'), (1, '4546.928')] [2023-12-26 01:35:19,062][123090] Updated weights for policy 1, policy_version 249957 (0.0010) [2023-12-26 01:35:19,079][123091] Updated weights for policy 0, policy_version 251218 (0.0009) [2023-12-26 01:35:19,123][123091] Updated weights for policy 0, policy_version 251228 (0.0010) [2023-12-26 01:35:19,125][123090] Updated weights for policy 1, policy_version 249967 (0.0010) [2023-12-26 01:35:19,171][123091] Updated weights for policy 0, policy_version 251238 (0.0010) [2023-12-26 01:35:19,183][123090] Updated weights for policy 1, policy_version 249977 (0.0010) [2023-12-26 01:35:19,235][123091] Updated weights for policy 0, policy_version 251248 (0.0010) [2023-12-26 01:35:19,950][123090] Updated weights for policy 1, policy_version 249987 (0.0010) [2023-12-26 01:35:20,012][123090] Updated weights for policy 1, policy_version 249997 (0.0009) [2023-12-26 01:35:20,062][123090] Updated weights for policy 1, policy_version 250007 (0.0009) [2023-12-26 01:35:20,096][123091] Updated weights for policy 0, policy_version 251258 (0.0009) [2023-12-26 01:35:20,155][123091] Updated weights for policy 0, policy_version 251268 (0.0009) [2023-12-26 01:35:20,222][123091] Updated weights for policy 0, policy_version 251278 (0.0009) [2023-12-26 01:35:20,942][123090] Updated weights for policy 1, policy_version 250017 (0.0009) [2023-12-26 01:35:21,015][123090] Updated weights for policy 1, policy_version 250027 (0.0010) [2023-12-26 01:35:21,086][123090] Updated weights for policy 1, policy_version 250037 (0.0010) [2023-12-26 01:35:21,126][123091] Updated weights for policy 0, policy_version 251288 (0.0010) [2023-12-26 01:35:21,157][123090] Updated weights for policy 1, policy_version 250047 (0.0008) [2023-12-26 01:35:21,199][123091] Updated weights for policy 0, policy_version 251298 (0.0010) [2023-12-26 01:35:21,266][123091] Updated weights for policy 0, policy_version 251308 (0.0009) [2023-12-26 01:35:21,945][123090] Updated weights for policy 1, policy_version 250057 (0.0009) [2023-12-26 01:35:22,008][123090] Updated weights for policy 1, policy_version 250067 (0.0010) [2023-12-26 01:35:22,071][123090] Updated weights for policy 1, policy_version 250077 (0.0009) [2023-12-26 01:35:22,181][123091] Updated weights for policy 0, policy_version 251318 (0.0009) [2023-12-26 01:35:22,249][123091] Updated weights for policy 0, policy_version 251328 (0.0010) [2023-12-26 01:35:22,317][123091] Updated weights for policy 0, policy_version 251338 (0.0009) [2023-12-26 01:35:22,841][123090] Updated weights for policy 1, policy_version 250087 (0.0010) [2023-12-26 01:35:22,909][123090] Updated weights for policy 1, policy_version 250097 (0.0009) [2023-12-26 01:35:22,979][123090] Updated weights for policy 1, policy_version 250107 (0.0006) [2023-12-26 01:35:23,211][123091] Updated weights for policy 0, policy_version 251348 (0.0010) [2023-12-26 01:35:23,260][123091] Updated weights for policy 0, policy_version 251358 (0.0008) [2023-12-26 01:35:23,317][123091] Updated weights for policy 0, policy_version 251368 (0.0009) [2023-12-26 01:35:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 128385024. Throughput: 0: 8966.1, 1: 8949.4. Samples: 128365084. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:23,785][121949] Avg episode reward: [(0, '6110.523'), (1, '4705.907')] [2023-12-26 01:35:23,788][123090] Updated weights for policy 1, policy_version 250117 (0.0008) [2023-12-26 01:35:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000251376_64356352.pth... [2023-12-26 01:35:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000250352_64094208.pth [2023-12-26 01:35:23,846][123090] Updated weights for policy 1, policy_version 250127 (0.0010) [2023-12-26 01:35:23,919][123090] Updated weights for policy 1, policy_version 250137 (0.0010) [2023-12-26 01:35:23,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000250144_64036864.pth... [2023-12-26 01:35:23,971][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000249088_63766528.pth [2023-12-26 01:35:24,201][123091] Updated weights for policy 0, policy_version 251378 (0.0009) [2023-12-26 01:35:24,253][123091] Updated weights for policy 0, policy_version 251388 (0.0009) [2023-12-26 01:35:24,305][123091] Updated weights for policy 0, policy_version 251398 (0.0009) [2023-12-26 01:35:24,683][123090] Updated weights for policy 1, policy_version 250147 (0.0007) [2023-12-26 01:35:24,737][123090] Updated weights for policy 1, policy_version 250157 (0.0010) [2023-12-26 01:35:24,796][123090] Updated weights for policy 1, policy_version 250167 (0.0006) [2023-12-26 01:35:25,123][123091] Updated weights for policy 0, policy_version 251409 (0.0010) [2023-12-26 01:35:25,181][123091] Updated weights for policy 0, policy_version 251419 (0.0010) [2023-12-26 01:35:25,246][123091] Updated weights for policy 0, policy_version 251429 (0.0010) [2023-12-26 01:35:25,309][123091] Updated weights for policy 0, policy_version 251439 (0.0009) [2023-12-26 01:35:25,489][123090] Updated weights for policy 1, policy_version 250177 (0.0006) [2023-12-26 01:35:25,559][123090] Updated weights for policy 1, policy_version 250187 (0.0009) [2023-12-26 01:35:25,624][123090] Updated weights for policy 1, policy_version 250197 (0.0009) [2023-12-26 01:35:25,687][123090] Updated weights for policy 1, policy_version 250207 (0.0009) [2023-12-26 01:35:26,113][123091] Updated weights for policy 0, policy_version 251449 (0.0010) [2023-12-26 01:35:26,164][123091] Updated weights for policy 0, policy_version 251459 (0.0010) [2023-12-26 01:35:26,223][123091] Updated weights for policy 0, policy_version 251469 (0.0011) [2023-12-26 01:35:26,432][123090] Updated weights for policy 1, policy_version 250217 (0.0007) [2023-12-26 01:35:26,491][123090] Updated weights for policy 1, policy_version 250227 (0.0009) [2023-12-26 01:35:26,547][123090] Updated weights for policy 1, policy_version 250237 (0.0009) [2023-12-26 01:35:27,023][123091] Updated weights for policy 0, policy_version 251479 (0.0007) [2023-12-26 01:35:27,083][123091] Updated weights for policy 0, policy_version 251489 (0.0009) [2023-12-26 01:35:27,144][123091] Updated weights for policy 0, policy_version 251499 (0.0009) [2023-12-26 01:35:27,317][123090] Updated weights for policy 1, policy_version 250247 (0.0009) [2023-12-26 01:35:27,384][123090] Updated weights for policy 1, policy_version 250257 (0.0009) [2023-12-26 01:35:27,449][123090] Updated weights for policy 1, policy_version 250267 (0.0010) [2023-12-26 01:35:27,882][123091] Updated weights for policy 0, policy_version 251509 (0.0008) [2023-12-26 01:35:27,949][123091] Updated weights for policy 0, policy_version 251519 (0.0009) [2023-12-26 01:35:28,018][123091] Updated weights for policy 0, policy_version 251529 (0.0010) [2023-12-26 01:35:28,150][123090] Updated weights for policy 1, policy_version 250277 (0.0009) [2023-12-26 01:35:28,207][123090] Updated weights for policy 1, policy_version 250287 (0.0009) [2023-12-26 01:35:28,260][123090] Updated weights for policy 1, policy_version 250297 (0.0008) [2023-12-26 01:35:28,782][123091] Updated weights for policy 0, policy_version 251539 (0.0009) [2023-12-26 01:35:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 128475136. Throughput: 0: 8917.2, 1: 9019.4. Samples: 128470468. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:28,785][121949] Avg episode reward: [(0, '5933.273'), (1, '5102.074')] [2023-12-26 01:35:28,836][123091] Updated weights for policy 0, policy_version 251549 (0.0005) [2023-12-26 01:35:28,895][123091] Updated weights for policy 0, policy_version 251559 (0.0008) [2023-12-26 01:35:29,131][123090] Updated weights for policy 1, policy_version 250307 (0.0009) [2023-12-26 01:35:29,202][123090] Updated weights for policy 1, policy_version 250317 (0.0008) [2023-12-26 01:35:29,280][123090] Updated weights for policy 1, policy_version 250327 (0.0008) [2023-12-26 01:35:29,637][123091] Updated weights for policy 0, policy_version 251569 (0.0008) [2023-12-26 01:35:29,694][123091] Updated weights for policy 0, policy_version 251579 (0.0009) [2023-12-26 01:35:29,753][123091] Updated weights for policy 0, policy_version 251589 (0.0006) [2023-12-26 01:35:29,810][123091] Updated weights for policy 0, policy_version 251599 (0.0005) [2023-12-26 01:35:30,032][123090] Updated weights for policy 1, policy_version 250337 (0.0008) [2023-12-26 01:35:30,088][123090] Updated weights for policy 1, policy_version 250347 (0.0009) [2023-12-26 01:35:30,141][123090] Updated weights for policy 1, policy_version 250357 (0.0009) [2023-12-26 01:35:30,200][123090] Updated weights for policy 1, policy_version 250367 (0.0009) [2023-12-26 01:35:30,586][123091] Updated weights for policy 0, policy_version 251609 (0.0009) [2023-12-26 01:35:30,634][123091] Updated weights for policy 0, policy_version 251620 (0.0010) [2023-12-26 01:35:30,681][123091] Updated weights for policy 0, policy_version 251630 (0.0009) [2023-12-26 01:35:31,075][123090] Updated weights for policy 1, policy_version 250377 (0.0010) [2023-12-26 01:35:31,125][123090] Updated weights for policy 1, policy_version 250387 (0.0009) [2023-12-26 01:35:31,185][123090] Updated weights for policy 1, policy_version 250397 (0.0009) [2023-12-26 01:35:31,484][123091] Updated weights for policy 0, policy_version 251640 (0.0010) [2023-12-26 01:35:31,536][123091] Updated weights for policy 0, policy_version 251651 (0.0009) [2023-12-26 01:35:31,602][123091] Updated weights for policy 0, policy_version 251661 (0.0009) [2023-12-26 01:35:32,052][123090] Updated weights for policy 1, policy_version 250407 (0.0010) [2023-12-26 01:35:32,113][123090] Updated weights for policy 1, policy_version 250417 (0.0009) [2023-12-26 01:35:32,170][123090] Updated weights for policy 1, policy_version 250428 (0.0009) [2023-12-26 01:35:32,404][123091] Updated weights for policy 0, policy_version 251671 (0.0010) [2023-12-26 01:35:32,466][123091] Updated weights for policy 0, policy_version 251681 (0.0009) [2023-12-26 01:35:32,527][123091] Updated weights for policy 0, policy_version 251691 (0.0009) [2023-12-26 01:35:33,010][123090] Updated weights for policy 1, policy_version 250438 (0.0010) [2023-12-26 01:35:33,061][123090] Updated weights for policy 1, policy_version 250448 (0.0010) [2023-12-26 01:35:33,112][123090] Updated weights for policy 1, policy_version 250458 (0.0010) [2023-12-26 01:35:33,296][123091] Updated weights for policy 0, policy_version 251701 (0.0008) [2023-12-26 01:35:33,346][123091] Updated weights for policy 0, policy_version 251711 (0.0005) [2023-12-26 01:35:33,405][123091] Updated weights for policy 0, policy_version 251721 (0.0005) [2023-12-26 01:35:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 128565248. Throughput: 0: 8959.8, 1: 8898.6. Samples: 128577112. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:33,785][121949] Avg episode reward: [(0, '5762.702'), (1, '5129.830')] [2023-12-26 01:35:33,956][123090] Updated weights for policy 1, policy_version 250468 (0.0010) [2023-12-26 01:35:34,014][123090] Updated weights for policy 1, policy_version 250478 (0.0010) [2023-12-26 01:35:34,072][123090] Updated weights for policy 1, policy_version 250488 (0.0010) [2023-12-26 01:35:34,192][123091] Updated weights for policy 0, policy_version 251731 (0.0007) [2023-12-26 01:35:34,259][123091] Updated weights for policy 0, policy_version 251741 (0.0011) [2023-12-26 01:35:34,325][123091] Updated weights for policy 0, policy_version 251751 (0.0011) [2023-12-26 01:35:34,909][123090] Updated weights for policy 1, policy_version 250498 (0.0010) [2023-12-26 01:35:34,972][123090] Updated weights for policy 1, policy_version 250508 (0.0011) [2023-12-26 01:35:35,025][123091] Updated weights for policy 0, policy_version 251761 (0.0010) [2023-12-26 01:35:35,038][123090] Updated weights for policy 1, policy_version 250518 (0.0011) [2023-12-26 01:35:35,077][123091] Updated weights for policy 0, policy_version 251771 (0.0005) [2023-12-26 01:35:35,094][123090] Updated weights for policy 1, policy_version 250528 (0.0010) [2023-12-26 01:35:35,146][123091] Updated weights for policy 0, policy_version 251781 (0.0005) [2023-12-26 01:35:35,210][123091] Updated weights for policy 0, policy_version 251791 (0.0005) [2023-12-26 01:35:35,799][123090] Updated weights for policy 1, policy_version 250538 (0.0005) [2023-12-26 01:35:35,848][123090] Updated weights for policy 1, policy_version 250548 (0.0005) [2023-12-26 01:35:35,868][123091] Updated weights for policy 0, policy_version 251801 (0.0005) [2023-12-26 01:35:35,907][123090] Updated weights for policy 1, policy_version 250558 (0.0008) [2023-12-26 01:35:35,940][123091] Updated weights for policy 0, policy_version 251811 (0.0006) [2023-12-26 01:35:35,995][123091] Updated weights for policy 0, policy_version 251821 (0.0011) [2023-12-26 01:35:36,771][123090] Updated weights for policy 1, policy_version 250568 (0.0010) [2023-12-26 01:35:36,808][123091] Updated weights for policy 0, policy_version 251831 (0.0008) [2023-12-26 01:35:36,840][123090] Updated weights for policy 1, policy_version 250578 (0.0010) [2023-12-26 01:35:36,874][123091] Updated weights for policy 0, policy_version 251841 (0.0008) [2023-12-26 01:35:36,894][123090] Updated weights for policy 1, policy_version 250588 (0.0006) [2023-12-26 01:35:36,939][123091] Updated weights for policy 0, policy_version 251851 (0.0010) [2023-12-26 01:35:37,732][123090] Updated weights for policy 1, policy_version 250598 (0.0009) [2023-12-26 01:35:37,745][123091] Updated weights for policy 0, policy_version 251861 (0.0007) [2023-12-26 01:35:37,781][123090] Updated weights for policy 1, policy_version 250608 (0.0009) [2023-12-26 01:35:37,793][123091] Updated weights for policy 0, policy_version 251871 (0.0005) [2023-12-26 01:35:37,833][123090] Updated weights for policy 1, policy_version 250618 (0.0010) [2023-12-26 01:35:37,853][123091] Updated weights for policy 0, policy_version 251881 (0.0006) [2023-12-26 01:35:38,663][123091] Updated weights for policy 0, policy_version 251891 (0.0007) [2023-12-26 01:35:38,682][123090] Updated weights for policy 1, policy_version 250628 (0.0010) [2023-12-26 01:35:38,716][123091] Updated weights for policy 0, policy_version 251901 (0.0006) [2023-12-26 01:35:38,746][123090] Updated weights for policy 1, policy_version 250638 (0.0010) [2023-12-26 01:35:38,774][123091] Updated weights for policy 0, policy_version 251911 (0.0005) [2023-12-26 01:35:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 128647168. Throughput: 0: 8968.5, 1: 8888.5. Samples: 128631668. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:38,785][121949] Avg episode reward: [(0, '5952.193'), (1, '4820.878')] [2023-12-26 01:35:38,813][123090] Updated weights for policy 1, policy_version 250648 (0.0010) [2023-12-26 01:35:38,829][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000251920_64495616.pth... [2023-12-26 01:35:38,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000250864_64225280.pth [2023-12-26 01:35:38,857][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000250656_64167936.pth... [2023-12-26 01:35:38,860][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000249600_63897600.pth [2023-12-26 01:35:39,476][123091] Updated weights for policy 0, policy_version 251921 (0.0008) [2023-12-26 01:35:39,533][123091] Updated weights for policy 0, policy_version 251931 (0.0010) [2023-12-26 01:35:39,570][123090] Updated weights for policy 1, policy_version 250658 (0.0010) [2023-12-26 01:35:39,596][123091] Updated weights for policy 0, policy_version 251941 (0.0010) [2023-12-26 01:35:39,632][123090] Updated weights for policy 1, policy_version 250668 (0.0006) [2023-12-26 01:35:39,658][123091] Updated weights for policy 0, policy_version 251951 (0.0009) [2023-12-26 01:35:39,706][123090] Updated weights for policy 1, policy_version 250678 (0.0006) [2023-12-26 01:35:39,779][123090] Updated weights for policy 1, policy_version 250688 (0.0007) [2023-12-26 01:35:40,489][123091] Updated weights for policy 0, policy_version 251961 (0.0009) [2023-12-26 01:35:40,524][123090] Updated weights for policy 1, policy_version 250698 (0.0008) [2023-12-26 01:35:40,548][123091] Updated weights for policy 0, policy_version 251971 (0.0007) [2023-12-26 01:35:40,588][123090] Updated weights for policy 1, policy_version 250708 (0.0007) [2023-12-26 01:35:40,611][123091] Updated weights for policy 0, policy_version 251981 (0.0008) [2023-12-26 01:35:40,652][123090] Updated weights for policy 1, policy_version 250718 (0.0007) [2023-12-26 01:35:41,371][123091] Updated weights for policy 0, policy_version 251991 (0.0010) [2023-12-26 01:35:41,439][123091] Updated weights for policy 0, policy_version 252001 (0.0010) [2023-12-26 01:35:41,481][123090] Updated weights for policy 1, policy_version 250728 (0.0009) [2023-12-26 01:35:41,492][123091] Updated weights for policy 0, policy_version 252011 (0.0008) [2023-12-26 01:35:41,537][123090] Updated weights for policy 1, policy_version 250738 (0.0009) [2023-12-26 01:35:41,586][123090] Updated weights for policy 1, policy_version 250748 (0.0006) [2023-12-26 01:35:42,336][123091] Updated weights for policy 0, policy_version 252021 (0.0008) [2023-12-26 01:35:42,403][123091] Updated weights for policy 0, policy_version 252031 (0.0008) [2023-12-26 01:35:42,406][123090] Updated weights for policy 1, policy_version 250758 (0.0008) [2023-12-26 01:35:42,464][123091] Updated weights for policy 0, policy_version 252041 (0.0008) [2023-12-26 01:35:42,467][123090] Updated weights for policy 1, policy_version 250768 (0.0008) [2023-12-26 01:35:42,526][123090] Updated weights for policy 1, policy_version 250778 (0.0006) [2023-12-26 01:35:43,196][123091] Updated weights for policy 0, policy_version 252051 (0.0007) [2023-12-26 01:35:43,268][123091] Updated weights for policy 0, policy_version 252061 (0.0005) [2023-12-26 01:35:43,329][123091] Updated weights for policy 0, policy_version 252071 (0.0009) [2023-12-26 01:35:43,397][123090] Updated weights for policy 1, policy_version 250788 (0.0009) [2023-12-26 01:35:43,452][123090] Updated weights for policy 1, policy_version 250798 (0.0009) [2023-12-26 01:35:43,514][123090] Updated weights for policy 1, policy_version 250808 (0.0009) [2023-12-26 01:35:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17717.0). Total num frames: 128745472. Throughput: 0: 8891.0, 1: 8791.4. Samples: 128736920. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:43,784][121949] Avg episode reward: [(0, '6118.906'), (1, '4702.970')] [2023-12-26 01:35:43,940][123091] Updated weights for policy 0, policy_version 252081 (0.0009) [2023-12-26 01:35:44,001][123091] Updated weights for policy 0, policy_version 252091 (0.0005) [2023-12-26 01:35:44,089][123091] Updated weights for policy 0, policy_version 252101 (0.0008) [2023-12-26 01:35:44,141][123091] Updated weights for policy 0, policy_version 252111 (0.0009) [2023-12-26 01:35:44,356][123090] Updated weights for policy 1, policy_version 250818 (0.0009) [2023-12-26 01:35:44,411][123090] Updated weights for policy 1, policy_version 250828 (0.0009) [2023-12-26 01:35:44,470][123090] Updated weights for policy 1, policy_version 250838 (0.0009) [2023-12-26 01:35:44,523][123090] Updated weights for policy 1, policy_version 250848 (0.0009) [2023-12-26 01:35:44,848][123091] Updated weights for policy 0, policy_version 252121 (0.0010) [2023-12-26 01:35:44,909][123091] Updated weights for policy 0, policy_version 252131 (0.0009) [2023-12-26 01:35:44,978][123091] Updated weights for policy 0, policy_version 252142 (0.0010) [2023-12-26 01:35:45,373][123090] Updated weights for policy 1, policy_version 250858 (0.0007) [2023-12-26 01:35:45,442][123090] Updated weights for policy 1, policy_version 250868 (0.0005) [2023-12-26 01:35:45,511][123090] Updated weights for policy 1, policy_version 250878 (0.0008) [2023-12-26 01:35:45,819][123091] Updated weights for policy 0, policy_version 252152 (0.0006) [2023-12-26 01:35:45,879][123091] Updated weights for policy 0, policy_version 252162 (0.0007) [2023-12-26 01:35:45,948][123091] Updated weights for policy 0, policy_version 252172 (0.0008) [2023-12-26 01:35:46,329][123090] Updated weights for policy 1, policy_version 250888 (0.0008) [2023-12-26 01:35:46,380][123090] Updated weights for policy 1, policy_version 250898 (0.0009) [2023-12-26 01:35:46,447][123090] Updated weights for policy 1, policy_version 250908 (0.0009) [2023-12-26 01:35:46,745][123091] Updated weights for policy 0, policy_version 252182 (0.0009) [2023-12-26 01:35:46,795][123091] Updated weights for policy 0, policy_version 252192 (0.0009) [2023-12-26 01:35:46,864][123091] Updated weights for policy 0, policy_version 252202 (0.0010) [2023-12-26 01:35:47,296][123090] Updated weights for policy 1, policy_version 250918 (0.0010) [2023-12-26 01:35:47,354][123090] Updated weights for policy 1, policy_version 250928 (0.0010) [2023-12-26 01:35:47,409][123090] Updated weights for policy 1, policy_version 250938 (0.0010) [2023-12-26 01:35:47,631][123091] Updated weights for policy 0, policy_version 252212 (0.0008) [2023-12-26 01:35:47,697][123091] Updated weights for policy 0, policy_version 252222 (0.0005) [2023-12-26 01:35:47,756][123091] Updated weights for policy 0, policy_version 252232 (0.0005) [2023-12-26 01:35:48,307][123090] Updated weights for policy 1, policy_version 250948 (0.0009) [2023-12-26 01:35:48,373][123090] Updated weights for policy 1, policy_version 250958 (0.0009) [2023-12-26 01:35:48,435][123090] Updated weights for policy 1, policy_version 250968 (0.0010) [2023-12-26 01:35:48,504][123091] Updated weights for policy 0, policy_version 252242 (0.0005) [2023-12-26 01:35:48,569][123091] Updated weights for policy 0, policy_version 252252 (0.0005) [2023-12-26 01:35:48,637][123091] Updated weights for policy 0, policy_version 252262 (0.0006) [2023-12-26 01:35:48,698][123091] Updated weights for policy 0, policy_version 252272 (0.0005) [2023-12-26 01:35:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 128835584. Throughput: 0: 8967.5, 1: 8752.8. Samples: 128843036. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:48,785][121949] Avg episode reward: [(0, '6137.830'), (1, '4580.165')] [2023-12-26 01:35:49,218][123090] Updated weights for policy 1, policy_version 250978 (0.0008) [2023-12-26 01:35:49,292][123090] Updated weights for policy 1, policy_version 250988 (0.0006) [2023-12-26 01:35:49,354][123090] Updated weights for policy 1, policy_version 250998 (0.0009) [2023-12-26 01:35:49,375][123091] Updated weights for policy 0, policy_version 252282 (0.0009) [2023-12-26 01:35:49,419][123090] Updated weights for policy 1, policy_version 251008 (0.0010) [2023-12-26 01:35:49,441][123091] Updated weights for policy 0, policy_version 252292 (0.0008) [2023-12-26 01:35:49,495][123091] Updated weights for policy 0, policy_version 252302 (0.0009) [2023-12-26 01:35:50,131][123090] Updated weights for policy 1, policy_version 251018 (0.0009) [2023-12-26 01:35:50,195][123090] Updated weights for policy 1, policy_version 251028 (0.0009) [2023-12-26 01:35:50,210][123091] Updated weights for policy 0, policy_version 252312 (0.0008) [2023-12-26 01:35:50,256][123090] Updated weights for policy 1, policy_version 251038 (0.0007) [2023-12-26 01:35:50,276][123091] Updated weights for policy 0, policy_version 252322 (0.0007) [2023-12-26 01:35:50,332][123091] Updated weights for policy 0, policy_version 252332 (0.0009) [2023-12-26 01:35:51,134][123090] Updated weights for policy 1, policy_version 251048 (0.0008) [2023-12-26 01:35:51,151][123091] Updated weights for policy 0, policy_version 252342 (0.0008) [2023-12-26 01:35:51,194][123090] Updated weights for policy 1, policy_version 251058 (0.0008) [2023-12-26 01:35:51,215][123091] Updated weights for policy 0, policy_version 252352 (0.0008) [2023-12-26 01:35:51,260][123090] Updated weights for policy 1, policy_version 251068 (0.0008) [2023-12-26 01:35:51,282][123091] Updated weights for policy 0, policy_version 252362 (0.0009) [2023-12-26 01:35:52,048][123090] Updated weights for policy 1, policy_version 251078 (0.0007) [2023-12-26 01:35:52,113][123090] Updated weights for policy 1, policy_version 251088 (0.0007) [2023-12-26 01:35:52,150][123091] Updated weights for policy 0, policy_version 252372 (0.0009) [2023-12-26 01:35:52,180][123090] Updated weights for policy 1, policy_version 251098 (0.0009) [2023-12-26 01:35:52,202][123091] Updated weights for policy 0, policy_version 252382 (0.0009) [2023-12-26 01:35:52,263][123091] Updated weights for policy 0, policy_version 252392 (0.0009) [2023-12-26 01:35:52,856][123090] Updated weights for policy 1, policy_version 251108 (0.0009) [2023-12-26 01:35:52,905][123090] Updated weights for policy 1, policy_version 251118 (0.0005) [2023-12-26 01:35:52,969][123090] Updated weights for policy 1, policy_version 251128 (0.0009) [2023-12-26 01:35:53,133][123091] Updated weights for policy 0, policy_version 252402 (0.0010) [2023-12-26 01:35:53,200][123091] Updated weights for policy 0, policy_version 252412 (0.0009) [2023-12-26 01:35:53,268][123091] Updated weights for policy 0, policy_version 252422 (0.0005) [2023-12-26 01:35:53,328][123091] Updated weights for policy 0, policy_version 252432 (0.0007) [2023-12-26 01:35:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 128917504. Throughput: 0: 8994.5, 1: 8754.8. Samples: 128897364. Policy #0 lag: (min: 28.0, avg: 36.0, max: 60.0) [2023-12-26 01:35:53,785][121949] Avg episode reward: [(0, '6156.272'), (1, '4516.866')] [2023-12-26 01:35:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000252432_64626688.pth... [2023-12-26 01:35:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000251136_64290816.pth... [2023-12-26 01:35:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000251376_64356352.pth [2023-12-26 01:35:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000250144_64036864.pth [2023-12-26 01:35:53,825][123090] Updated weights for policy 1, policy_version 251138 (0.0009) [2023-12-26 01:35:53,878][123090] Updated weights for policy 1, policy_version 251148 (0.0009) [2023-12-26 01:35:53,927][123090] Updated weights for policy 1, policy_version 251158 (0.0009) [2023-12-26 01:35:53,979][123090] Updated weights for policy 1, policy_version 251168 (0.0009) [2023-12-26 01:35:54,055][123091] Updated weights for policy 0, policy_version 252442 (0.0010) [2023-12-26 01:35:54,109][123091] Updated weights for policy 0, policy_version 252452 (0.0005) [2023-12-26 01:35:54,160][123091] Updated weights for policy 0, policy_version 252462 (0.0008) [2023-12-26 01:35:54,730][123090] Updated weights for policy 1, policy_version 251178 (0.0009) [2023-12-26 01:35:54,797][123090] Updated weights for policy 1, policy_version 251188 (0.0010) [2023-12-26 01:35:54,856][123090] Updated weights for policy 1, policy_version 251198 (0.0010) [2023-12-26 01:35:55,040][123091] Updated weights for policy 0, policy_version 252472 (0.0010) [2023-12-26 01:35:55,100][123091] Updated weights for policy 0, policy_version 252482 (0.0009) [2023-12-26 01:35:55,155][123091] Updated weights for policy 0, policy_version 252492 (0.0008) [2023-12-26 01:35:55,609][123090] Updated weights for policy 1, policy_version 251208 (0.0006) [2023-12-26 01:35:55,663][123090] Updated weights for policy 1, policy_version 251218 (0.0005) [2023-12-26 01:35:55,710][123090] Updated weights for policy 1, policy_version 251228 (0.0005) [2023-12-26 01:35:55,894][123091] Updated weights for policy 0, policy_version 252502 (0.0007) [2023-12-26 01:35:55,968][123091] Updated weights for policy 0, policy_version 252512 (0.0005) [2023-12-26 01:35:56,030][123091] Updated weights for policy 0, policy_version 252522 (0.0006) [2023-12-26 01:35:56,373][123090] Updated weights for policy 1, policy_version 251238 (0.0008) [2023-12-26 01:35:56,436][123090] Updated weights for policy 1, policy_version 251248 (0.0010) [2023-12-26 01:35:56,497][123090] Updated weights for policy 1, policy_version 251258 (0.0010) [2023-12-26 01:35:56,788][123091] Updated weights for policy 0, policy_version 252532 (0.0009) [2023-12-26 01:35:56,848][123091] Updated weights for policy 0, policy_version 252542 (0.0009) [2023-12-26 01:35:56,893][123091] Updated weights for policy 0, policy_version 252552 (0.0008) [2023-12-26 01:35:57,253][123090] Updated weights for policy 1, policy_version 251268 (0.0009) [2023-12-26 01:35:57,312][123090] Updated weights for policy 1, policy_version 251278 (0.0006) [2023-12-26 01:35:57,379][123090] Updated weights for policy 1, policy_version 251288 (0.0006) [2023-12-26 01:35:57,822][123091] Updated weights for policy 0, policy_version 252563 (0.0010) [2023-12-26 01:35:57,877][123091] Updated weights for policy 0, policy_version 252573 (0.0010) [2023-12-26 01:35:57,935][123091] Updated weights for policy 0, policy_version 252584 (0.0010) [2023-12-26 01:35:57,997][123090] Updated weights for policy 1, policy_version 251298 (0.0006) [2023-12-26 01:35:58,069][123090] Updated weights for policy 1, policy_version 251308 (0.0011) [2023-12-26 01:35:58,136][123090] Updated weights for policy 1, policy_version 251318 (0.0011) [2023-12-26 01:35:58,208][123090] Updated weights for policy 1, policy_version 251328 (0.0010) [2023-12-26 01:35:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 129007616. Throughput: 0: 8933.3, 1: 8801.5. Samples: 129005368. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:35:58,785][121949] Avg episode reward: [(0, '6099.605'), (1, '4049.302')] [2023-12-26 01:35:58,883][123091] Updated weights for policy 0, policy_version 252594 (0.0009) [2023-12-26 01:35:58,951][123091] Updated weights for policy 0, policy_version 252604 (0.0007) [2023-12-26 01:35:59,017][123091] Updated weights for policy 0, policy_version 252614 (0.0007) [2023-12-26 01:35:59,086][123091] Updated weights for policy 0, policy_version 252624 (0.0008) [2023-12-26 01:35:59,124][123090] Updated weights for policy 1, policy_version 251338 (0.0008) [2023-12-26 01:35:59,179][123090] Updated weights for policy 1, policy_version 251348 (0.0008) [2023-12-26 01:35:59,257][123090] Updated weights for policy 1, policy_version 251358 (0.0008) [2023-12-26 01:35:59,858][123091] Updated weights for policy 0, policy_version 252634 (0.0007) [2023-12-26 01:35:59,918][123091] Updated weights for policy 0, policy_version 252644 (0.0007) [2023-12-26 01:35:59,972][123091] Updated weights for policy 0, policy_version 252654 (0.0007) [2023-12-26 01:36:00,094][123090] Updated weights for policy 1, policy_version 251368 (0.0010) [2023-12-26 01:36:00,156][123090] Updated weights for policy 1, policy_version 251378 (0.0009) [2023-12-26 01:36:00,232][123090] Updated weights for policy 1, policy_version 251388 (0.0006) [2023-12-26 01:36:00,635][123091] Updated weights for policy 0, policy_version 252664 (0.0006) [2023-12-26 01:36:00,714][123091] Updated weights for policy 0, policy_version 252674 (0.0005) [2023-12-26 01:36:00,786][123091] Updated weights for policy 0, policy_version 252684 (0.0006) [2023-12-26 01:36:00,930][123090] Updated weights for policy 1, policy_version 251398 (0.0006) [2023-12-26 01:36:00,987][123090] Updated weights for policy 1, policy_version 251408 (0.0005) [2023-12-26 01:36:01,056][123090] Updated weights for policy 1, policy_version 251418 (0.0006) [2023-12-26 01:36:01,512][123091] Updated weights for policy 0, policy_version 252694 (0.0009) [2023-12-26 01:36:01,558][123091] Updated weights for policy 0, policy_version 252704 (0.0005) [2023-12-26 01:36:01,618][123091] Updated weights for policy 0, policy_version 252714 (0.0006) [2023-12-26 01:36:01,750][123090] Updated weights for policy 1, policy_version 251428 (0.0008) [2023-12-26 01:36:01,808][123090] Updated weights for policy 1, policy_version 251438 (0.0006) [2023-12-26 01:36:01,877][123090] Updated weights for policy 1, policy_version 251448 (0.0006) [2023-12-26 01:36:02,440][123091] Updated weights for policy 0, policy_version 252724 (0.0010) [2023-12-26 01:36:02,507][123091] Updated weights for policy 0, policy_version 252734 (0.0011) [2023-12-26 01:36:02,570][123091] Updated weights for policy 0, policy_version 252744 (0.0011) [2023-12-26 01:36:02,584][123090] Updated weights for policy 1, policy_version 251458 (0.0005) [2023-12-26 01:36:02,645][123090] Updated weights for policy 1, policy_version 251468 (0.0006) [2023-12-26 01:36:02,703][123090] Updated weights for policy 1, policy_version 251478 (0.0006) [2023-12-26 01:36:02,763][123090] Updated weights for policy 1, policy_version 251488 (0.0008) [2023-12-26 01:36:03,386][123091] Updated weights for policy 0, policy_version 252754 (0.0011) [2023-12-26 01:36:03,435][123090] Updated weights for policy 1, policy_version 251498 (0.0006) [2023-12-26 01:36:03,437][123091] Updated weights for policy 0, policy_version 252764 (0.0010) [2023-12-26 01:36:03,484][123091] Updated weights for policy 0, policy_version 252774 (0.0010) [2023-12-26 01:36:03,491][123090] Updated weights for policy 1, policy_version 251508 (0.0005) [2023-12-26 01:36:03,539][123091] Updated weights for policy 0, policy_version 252784 (0.0010) [2023-12-26 01:36:03,553][123090] Updated weights for policy 1, policy_version 251518 (0.0005) [2023-12-26 01:36:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 129105920. Throughput: 0: 8904.7, 1: 8854.6. Samples: 129113924. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:03,784][121949] Avg episode reward: [(0, '6094.582'), (1, '4093.185')] [2023-12-26 01:36:04,303][123090] Updated weights for policy 1, policy_version 251528 (0.0009) [2023-12-26 01:36:04,324][123091] Updated weights for policy 0, policy_version 252794 (0.0011) [2023-12-26 01:36:04,370][123090] Updated weights for policy 1, policy_version 251538 (0.0010) [2023-12-26 01:36:04,388][123091] Updated weights for policy 0, policy_version 252804 (0.0008) [2023-12-26 01:36:04,429][123090] Updated weights for policy 1, policy_version 251548 (0.0009) [2023-12-26 01:36:04,445][123091] Updated weights for policy 0, policy_version 252814 (0.0006) [2023-12-26 01:36:05,106][123091] Updated weights for policy 0, policy_version 252824 (0.0008) [2023-12-26 01:36:05,158][123091] Updated weights for policy 0, policy_version 252834 (0.0008) [2023-12-26 01:36:05,208][123091] Updated weights for policy 0, policy_version 252844 (0.0009) [2023-12-26 01:36:05,322][123090] Updated weights for policy 1, policy_version 251558 (0.0010) [2023-12-26 01:36:05,373][123090] Updated weights for policy 1, policy_version 251568 (0.0009) [2023-12-26 01:36:05,437][123090] Updated weights for policy 1, policy_version 251578 (0.0009) [2023-12-26 01:36:05,943][123091] Updated weights for policy 0, policy_version 252854 (0.0009) [2023-12-26 01:36:05,996][123091] Updated weights for policy 0, policy_version 252865 (0.0010) [2023-12-26 01:36:06,050][123091] Updated weights for policy 0, policy_version 252875 (0.0010) [2023-12-26 01:36:06,258][123090] Updated weights for policy 1, policy_version 251588 (0.0010) [2023-12-26 01:36:06,329][123090] Updated weights for policy 1, policy_version 251598 (0.0010) [2023-12-26 01:36:06,396][123090] Updated weights for policy 1, policy_version 251608 (0.0009) [2023-12-26 01:36:06,913][123091] Updated weights for policy 0, policy_version 252885 (0.0010) [2023-12-26 01:36:06,979][123091] Updated weights for policy 0, policy_version 252895 (0.0009) [2023-12-26 01:36:07,037][123091] Updated weights for policy 0, policy_version 252905 (0.0009) [2023-12-26 01:36:07,245][123090] Updated weights for policy 1, policy_version 251618 (0.0009) [2023-12-26 01:36:07,311][123090] Updated weights for policy 1, policy_version 251628 (0.0009) [2023-12-26 01:36:07,376][123090] Updated weights for policy 1, policy_version 251638 (0.0010) [2023-12-26 01:36:07,436][123090] Updated weights for policy 1, policy_version 251648 (0.0010) [2023-12-26 01:36:07,833][123091] Updated weights for policy 0, policy_version 252915 (0.0010) [2023-12-26 01:36:07,894][123091] Updated weights for policy 0, policy_version 252925 (0.0010) [2023-12-26 01:36:07,961][123091] Updated weights for policy 0, policy_version 252935 (0.0005) [2023-12-26 01:36:08,310][123090] Updated weights for policy 1, policy_version 251658 (0.0010) [2023-12-26 01:36:08,390][123090] Updated weights for policy 1, policy_version 251668 (0.0010) [2023-12-26 01:36:08,458][123090] Updated weights for policy 1, policy_version 251678 (0.0010) [2023-12-26 01:36:08,672][123091] Updated weights for policy 0, policy_version 252945 (0.0005) [2023-12-26 01:36:08,744][123091] Updated weights for policy 0, policy_version 252955 (0.0005) [2023-12-26 01:36:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 129187840. Throughput: 0: 8971.9, 1: 8847.4. Samples: 129166948. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:08,785][121949] Avg episode reward: [(0, '6029.056'), (1, '4347.986')] [2023-12-26 01:36:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000251680_64430080.pth... [2023-12-26 01:36:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000250656_64167936.pth [2023-12-26 01:36:08,816][123091] Updated weights for policy 0, policy_version 252965 (0.0008) [2023-12-26 01:36:08,869][123091] Updated weights for policy 0, policy_version 252975 (0.0009) [2023-12-26 01:36:08,870][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000252976_64765952.pth... [2023-12-26 01:36:08,873][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000251920_64495616.pth [2023-12-26 01:36:09,271][123090] Updated weights for policy 1, policy_version 251688 (0.0010) [2023-12-26 01:36:09,340][123090] Updated weights for policy 1, policy_version 251698 (0.0010) [2023-12-26 01:36:09,415][123090] Updated weights for policy 1, policy_version 251708 (0.0008) [2023-12-26 01:36:09,671][123091] Updated weights for policy 0, policy_version 252985 (0.0010) [2023-12-26 01:36:09,740][123091] Updated weights for policy 0, policy_version 252995 (0.0010) [2023-12-26 01:36:09,801][123091] Updated weights for policy 0, policy_version 253005 (0.0010) [2023-12-26 01:36:10,158][123090] Updated weights for policy 1, policy_version 251718 (0.0009) [2023-12-26 01:36:10,223][123090] Updated weights for policy 1, policy_version 251728 (0.0009) [2023-12-26 01:36:10,287][123090] Updated weights for policy 1, policy_version 251738 (0.0009) [2023-12-26 01:36:10,641][123091] Updated weights for policy 0, policy_version 253015 (0.0010) [2023-12-26 01:36:10,700][123091] Updated weights for policy 0, policy_version 253026 (0.0010) [2023-12-26 01:36:10,752][123091] Updated weights for policy 0, policy_version 253036 (0.0010) [2023-12-26 01:36:11,088][123090] Updated weights for policy 1, policy_version 251748 (0.0009) [2023-12-26 01:36:11,159][123090] Updated weights for policy 1, policy_version 251758 (0.0009) [2023-12-26 01:36:11,232][123090] Updated weights for policy 1, policy_version 251768 (0.0008) [2023-12-26 01:36:11,643][123091] Updated weights for policy 0, policy_version 253046 (0.0015) [2023-12-26 01:36:11,709][123091] Updated weights for policy 0, policy_version 253056 (0.0007) [2023-12-26 01:36:11,776][123091] Updated weights for policy 0, policy_version 253066 (0.0013) [2023-12-26 01:36:12,042][123090] Updated weights for policy 1, policy_version 251778 (0.0009) [2023-12-26 01:36:12,101][123090] Updated weights for policy 1, policy_version 251788 (0.0006) [2023-12-26 01:36:12,168][123090] Updated weights for policy 1, policy_version 251798 (0.0008) [2023-12-26 01:36:12,220][123090] Updated weights for policy 1, policy_version 251808 (0.0008) [2023-12-26 01:36:12,630][123091] Updated weights for policy 0, policy_version 253076 (0.0011) [2023-12-26 01:36:12,693][123091] Updated weights for policy 0, policy_version 253086 (0.0011) [2023-12-26 01:36:12,755][123091] Updated weights for policy 0, policy_version 253096 (0.0010) [2023-12-26 01:36:12,982][123090] Updated weights for policy 1, policy_version 251818 (0.0010) [2023-12-26 01:36:13,050][123090] Updated weights for policy 1, policy_version 251828 (0.0010) [2023-12-26 01:36:13,116][123090] Updated weights for policy 1, policy_version 251838 (0.0010) [2023-12-26 01:36:13,514][123091] Updated weights for policy 0, policy_version 253106 (0.0010) [2023-12-26 01:36:13,584][123091] Updated weights for policy 0, policy_version 253116 (0.0010) [2023-12-26 01:36:13,646][123091] Updated weights for policy 0, policy_version 253126 (0.0011) [2023-12-26 01:36:13,703][123091] Updated weights for policy 0, policy_version 253136 (0.0010) [2023-12-26 01:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 129277952. Throughput: 0: 8964.4, 1: 8799.8. Samples: 129269860. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:13,784][121949] Avg episode reward: [(0, '5975.252'), (1, '4344.160')] [2023-12-26 01:36:13,984][123090] Updated weights for policy 1, policy_version 251848 (0.0008) [2023-12-26 01:36:14,038][123090] Updated weights for policy 1, policy_version 251858 (0.0009) [2023-12-26 01:36:14,096][123090] Updated weights for policy 1, policy_version 251868 (0.0010) [2023-12-26 01:36:14,443][123091] Updated weights for policy 0, policy_version 253146 (0.0009) [2023-12-26 01:36:14,517][123091] Updated weights for policy 0, policy_version 253156 (0.0009) [2023-12-26 01:36:14,581][123091] Updated weights for policy 0, policy_version 253166 (0.0007) [2023-12-26 01:36:14,919][123090] Updated weights for policy 1, policy_version 251878 (0.0007) [2023-12-26 01:36:14,971][123090] Updated weights for policy 1, policy_version 251888 (0.0005) [2023-12-26 01:36:15,027][123090] Updated weights for policy 1, policy_version 251898 (0.0007) [2023-12-26 01:36:15,393][123091] Updated weights for policy 0, policy_version 253176 (0.0008) [2023-12-26 01:36:15,457][123091] Updated weights for policy 0, policy_version 253186 (0.0008) [2023-12-26 01:36:15,516][123091] Updated weights for policy 0, policy_version 253196 (0.0008) [2023-12-26 01:36:15,777][123090] Updated weights for policy 1, policy_version 251908 (0.0007) [2023-12-26 01:36:15,826][123090] Updated weights for policy 1, policy_version 251918 (0.0008) [2023-12-26 01:36:15,880][123090] Updated weights for policy 1, policy_version 251928 (0.0005) [2023-12-26 01:36:16,232][123091] Updated weights for policy 0, policy_version 253206 (0.0006) [2023-12-26 01:36:16,296][123091] Updated weights for policy 0, policy_version 253216 (0.0007) [2023-12-26 01:36:16,361][123091] Updated weights for policy 0, policy_version 253226 (0.0008) [2023-12-26 01:36:16,731][123090] Updated weights for policy 1, policy_version 251938 (0.0006) [2023-12-26 01:36:16,789][123090] Updated weights for policy 1, policy_version 251948 (0.0009) [2023-12-26 01:36:16,842][123090] Updated weights for policy 1, policy_version 251958 (0.0010) [2023-12-26 01:36:16,904][123090] Updated weights for policy 1, policy_version 251968 (0.0010) [2023-12-26 01:36:16,950][123091] Updated weights for policy 0, policy_version 253236 (0.0007) [2023-12-26 01:36:16,995][123091] Updated weights for policy 0, policy_version 253246 (0.0005) [2023-12-26 01:36:17,057][123091] Updated weights for policy 0, policy_version 253256 (0.0005) [2023-12-26 01:36:17,732][123090] Updated weights for policy 1, policy_version 251978 (0.0010) [2023-12-26 01:36:17,795][123090] Updated weights for policy 1, policy_version 251988 (0.0009) [2023-12-26 01:36:17,830][123091] Updated weights for policy 0, policy_version 253266 (0.0006) [2023-12-26 01:36:17,851][123090] Updated weights for policy 1, policy_version 251998 (0.0009) [2023-12-26 01:36:17,885][123091] Updated weights for policy 0, policy_version 253276 (0.0006) [2023-12-26 01:36:17,938][123091] Updated weights for policy 0, policy_version 253286 (0.0009) [2023-12-26 01:36:17,984][123091] Updated weights for policy 0, policy_version 253296 (0.0007) [2023-12-26 01:36:18,730][123090] Updated weights for policy 1, policy_version 252008 (0.0008) [2023-12-26 01:36:18,763][123091] Updated weights for policy 0, policy_version 253306 (0.0009) [2023-12-26 01:36:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 129359872. Throughput: 0: 9026.5, 1: 8774.9. Samples: 129378176. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:18,784][121949] Avg episode reward: [(0, '5985.593'), (1, '4440.708')] [2023-12-26 01:36:18,795][123090] Updated weights for policy 1, policy_version 252018 (0.0009) [2023-12-26 01:36:18,824][123091] Updated weights for policy 0, policy_version 253316 (0.0007) [2023-12-26 01:36:18,857][123090] Updated weights for policy 1, policy_version 252028 (0.0008) [2023-12-26 01:36:18,886][123091] Updated weights for policy 0, policy_version 253326 (0.0008) [2023-12-26 01:36:19,658][123091] Updated weights for policy 0, policy_version 253336 (0.0009) [2023-12-26 01:36:19,699][123090] Updated weights for policy 1, policy_version 252038 (0.0009) [2023-12-26 01:36:19,723][123091] Updated weights for policy 0, policy_version 253346 (0.0008) [2023-12-26 01:36:19,764][123090] Updated weights for policy 1, policy_version 252048 (0.0008) [2023-12-26 01:36:19,787][123091] Updated weights for policy 0, policy_version 253356 (0.0006) [2023-12-26 01:36:19,835][123090] Updated weights for policy 1, policy_version 252058 (0.0008) [2023-12-26 01:36:20,587][123091] Updated weights for policy 0, policy_version 253366 (0.0007) [2023-12-26 01:36:20,653][123091] Updated weights for policy 0, policy_version 253376 (0.0006) [2023-12-26 01:36:20,702][123090] Updated weights for policy 1, policy_version 252068 (0.0010) [2023-12-26 01:36:20,719][123091] Updated weights for policy 0, policy_version 253386 (0.0006) [2023-12-26 01:36:20,768][123090] Updated weights for policy 1, policy_version 252078 (0.0009) [2023-12-26 01:36:20,837][123090] Updated weights for policy 1, policy_version 252088 (0.0010) [2023-12-26 01:36:21,520][123091] Updated weights for policy 0, policy_version 253396 (0.0007) [2023-12-26 01:36:21,575][123091] Updated weights for policy 0, policy_version 253406 (0.0010) [2023-12-26 01:36:21,642][123091] Updated weights for policy 0, policy_version 253417 (0.0009) [2023-12-26 01:36:21,682][123090] Updated weights for policy 1, policy_version 252098 (0.0009) [2023-12-26 01:36:21,759][123090] Updated weights for policy 1, policy_version 252108 (0.0008) [2023-12-26 01:36:21,829][123090] Updated weights for policy 1, policy_version 252118 (0.0006) [2023-12-26 01:36:21,900][123090] Updated weights for policy 1, policy_version 252128 (0.0006) [2023-12-26 01:36:22,486][123091] Updated weights for policy 0, policy_version 253427 (0.0009) [2023-12-26 01:36:22,559][123091] Updated weights for policy 0, policy_version 253437 (0.0007) [2023-12-26 01:36:22,622][123091] Updated weights for policy 0, policy_version 253447 (0.0007) [2023-12-26 01:36:22,719][123090] Updated weights for policy 1, policy_version 252138 (0.0006) [2023-12-26 01:36:22,787][123090] Updated weights for policy 1, policy_version 252148 (0.0006) [2023-12-26 01:36:22,841][123090] Updated weights for policy 1, policy_version 252158 (0.0006) [2023-12-26 01:36:23,237][123091] Updated weights for policy 0, policy_version 253457 (0.0006) [2023-12-26 01:36:23,306][123091] Updated weights for policy 0, policy_version 253467 (0.0006) [2023-12-26 01:36:23,383][123091] Updated weights for policy 0, policy_version 253477 (0.0006) [2023-12-26 01:36:23,456][123091] Updated weights for policy 0, policy_version 253487 (0.0006) [2023-12-26 01:36:23,510][123090] Updated weights for policy 1, policy_version 252168 (0.0006) [2023-12-26 01:36:23,571][123090] Updated weights for policy 1, policy_version 252178 (0.0008) [2023-12-26 01:36:23,623][123090] Updated weights for policy 1, policy_version 252188 (0.0007) [2023-12-26 01:36:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 129458176. Throughput: 0: 8986.5, 1: 8744.1. Samples: 129429544. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:23,785][121949] Avg episode reward: [(0, '6017.123'), (1, '3993.331')] [2023-12-26 01:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000253488_64897024.pth... [2023-12-26 01:36:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000252192_64561152.pth... [2023-12-26 01:36:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000251136_64290816.pth [2023-12-26 01:36:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000252432_64626688.pth [2023-12-26 01:36:24,273][123091] Updated weights for policy 0, policy_version 253497 (0.0008) [2023-12-26 01:36:24,335][123091] Updated weights for policy 0, policy_version 253507 (0.0010) [2023-12-26 01:36:24,360][123090] Updated weights for policy 1, policy_version 252198 (0.0007) [2023-12-26 01:36:24,384][123091] Updated weights for policy 0, policy_version 253517 (0.0007) [2023-12-26 01:36:24,423][123090] Updated weights for policy 1, policy_version 252208 (0.0009) [2023-12-26 01:36:24,487][123090] Updated weights for policy 1, policy_version 252218 (0.0008) [2023-12-26 01:36:25,203][123090] Updated weights for policy 1, policy_version 252228 (0.0009) [2023-12-26 01:36:25,248][123091] Updated weights for policy 0, policy_version 253527 (0.0008) [2023-12-26 01:36:25,258][123090] Updated weights for policy 1, policy_version 252238 (0.0009) [2023-12-26 01:36:25,303][123091] Updated weights for policy 0, policy_version 253537 (0.0009) [2023-12-26 01:36:25,314][123090] Updated weights for policy 1, policy_version 252248 (0.0007) [2023-12-26 01:36:25,369][123091] Updated weights for policy 0, policy_version 253547 (0.0007) [2023-12-26 01:36:26,059][123090] Updated weights for policy 1, policy_version 252258 (0.0006) [2023-12-26 01:36:26,116][123090] Updated weights for policy 1, policy_version 252268 (0.0005) [2023-12-26 01:36:26,179][123090] Updated weights for policy 1, policy_version 252278 (0.0007) [2023-12-26 01:36:26,217][123091] Updated weights for policy 0, policy_version 253557 (0.0009) [2023-12-26 01:36:26,245][123090] Updated weights for policy 1, policy_version 252288 (0.0008) [2023-12-26 01:36:26,272][123091] Updated weights for policy 0, policy_version 253567 (0.0009) [2023-12-26 01:36:26,325][123091] Updated weights for policy 0, policy_version 253577 (0.0010) [2023-12-26 01:36:26,997][123090] Updated weights for policy 1, policy_version 252298 (0.0009) [2023-12-26 01:36:27,050][123090] Updated weights for policy 1, policy_version 252308 (0.0009) [2023-12-26 01:36:27,105][123090] Updated weights for policy 1, policy_version 252318 (0.0009) [2023-12-26 01:36:27,171][123091] Updated weights for policy 0, policy_version 253587 (0.0008) [2023-12-26 01:36:27,244][123091] Updated weights for policy 0, policy_version 253597 (0.0006) [2023-12-26 01:36:27,309][123091] Updated weights for policy 0, policy_version 253607 (0.0008) [2023-12-26 01:36:27,993][123090] Updated weights for policy 1, policy_version 252328 (0.0006) [2023-12-26 01:36:28,039][123090] Updated weights for policy 1, policy_version 252338 (0.0005) [2023-12-26 01:36:28,045][123091] Updated weights for policy 0, policy_version 253618 (0.0008) [2023-12-26 01:36:28,089][123090] Updated weights for policy 1, policy_version 252348 (0.0005) [2023-12-26 01:36:28,108][123091] Updated weights for policy 0, policy_version 253628 (0.0007) [2023-12-26 01:36:28,183][123091] Updated weights for policy 0, policy_version 253638 (0.0008) [2023-12-26 01:36:28,249][123091] Updated weights for policy 0, policy_version 253648 (0.0010) [2023-12-26 01:36:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 129540096. Throughput: 0: 8970.4, 1: 8813.0. Samples: 129537172. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:28,785][121949] Avg episode reward: [(0, '5885.850'), (1, '3722.669')] [2023-12-26 01:36:28,859][123090] Updated weights for policy 1, policy_version 252358 (0.0007) [2023-12-26 01:36:28,912][123090] Updated weights for policy 1, policy_version 252368 (0.0009) [2023-12-26 01:36:28,961][123090] Updated weights for policy 1, policy_version 252378 (0.0009) [2023-12-26 01:36:29,020][123091] Updated weights for policy 0, policy_version 253658 (0.0011) [2023-12-26 01:36:29,078][123091] Updated weights for policy 0, policy_version 253668 (0.0010) [2023-12-26 01:36:29,133][123091] Updated weights for policy 0, policy_version 253678 (0.0011) [2023-12-26 01:36:29,840][123090] Updated weights for policy 1, policy_version 252388 (0.0008) [2023-12-26 01:36:29,903][123090] Updated weights for policy 1, policy_version 252398 (0.0009) [2023-12-26 01:36:29,973][123090] Updated weights for policy 1, policy_version 252408 (0.0009) [2023-12-26 01:36:29,996][123091] Updated weights for policy 0, policy_version 253688 (0.0010) [2023-12-26 01:36:30,055][123091] Updated weights for policy 0, policy_version 253698 (0.0010) [2023-12-26 01:36:30,109][123091] Updated weights for policy 0, policy_version 253708 (0.0007) [2023-12-26 01:36:30,742][123090] Updated weights for policy 1, policy_version 252418 (0.0006) [2023-12-26 01:36:30,807][123090] Updated weights for policy 1, policy_version 252428 (0.0009) [2023-12-26 01:36:30,859][123090] Updated weights for policy 1, policy_version 252438 (0.0009) [2023-12-26 01:36:30,920][123090] Updated weights for policy 1, policy_version 252448 (0.0010) [2023-12-26 01:36:30,936][123091] Updated weights for policy 0, policy_version 253718 (0.0009) [2023-12-26 01:36:31,003][123091] Updated weights for policy 0, policy_version 253728 (0.0006) [2023-12-26 01:36:31,070][123091] Updated weights for policy 0, policy_version 253738 (0.0008) [2023-12-26 01:36:31,712][123090] Updated weights for policy 1, policy_version 252458 (0.0010) [2023-12-26 01:36:31,779][123090] Updated weights for policy 1, policy_version 252468 (0.0009) [2023-12-26 01:36:31,836][123090] Updated weights for policy 1, policy_version 252478 (0.0007) [2023-12-26 01:36:31,898][123091] Updated weights for policy 0, policy_version 253748 (0.0009) [2023-12-26 01:36:31,950][123091] Updated weights for policy 0, policy_version 253758 (0.0010) [2023-12-26 01:36:32,003][123091] Updated weights for policy 0, policy_version 253768 (0.0009) [2023-12-26 01:36:32,654][123090] Updated weights for policy 1, policy_version 252488 (0.0008) [2023-12-26 01:36:32,706][123090] Updated weights for policy 1, policy_version 252498 (0.0009) [2023-12-26 01:36:32,754][123090] Updated weights for policy 1, policy_version 252508 (0.0009) [2023-12-26 01:36:32,838][123091] Updated weights for policy 0, policy_version 253778 (0.0009) [2023-12-26 01:36:32,891][123091] Updated weights for policy 0, policy_version 253788 (0.0009) [2023-12-26 01:36:32,961][123091] Updated weights for policy 0, policy_version 253798 (0.0009) [2023-12-26 01:36:33,023][123091] Updated weights for policy 0, policy_version 253808 (0.0007) [2023-12-26 01:36:33,655][123090] Updated weights for policy 1, policy_version 252518 (0.0009) [2023-12-26 01:36:33,672][123091] Updated weights for policy 0, policy_version 253818 (0.0006) [2023-12-26 01:36:33,713][123090] Updated weights for policy 1, policy_version 252528 (0.0009) [2023-12-26 01:36:33,730][123091] Updated weights for policy 0, policy_version 253828 (0.0008) [2023-12-26 01:36:33,759][123090] Updated weights for policy 1, policy_version 252538 (0.0009) [2023-12-26 01:36:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 129630208. Throughput: 0: 8889.2, 1: 8858.9. Samples: 129641704. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:33,785][121949] Avg episode reward: [(0, '5866.813'), (1, '4213.151')] [2023-12-26 01:36:33,791][123091] Updated weights for policy 0, policy_version 253838 (0.0007) [2023-12-26 01:36:34,514][123091] Updated weights for policy 0, policy_version 253848 (0.0009) [2023-12-26 01:36:34,567][123091] Updated weights for policy 0, policy_version 253858 (0.0008) [2023-12-26 01:36:34,615][123090] Updated weights for policy 1, policy_version 252548 (0.0008) [2023-12-26 01:36:34,627][123091] Updated weights for policy 0, policy_version 253868 (0.0005) [2023-12-26 01:36:34,674][123090] Updated weights for policy 1, policy_version 252558 (0.0009) [2023-12-26 01:36:34,754][123090] Updated weights for policy 1, policy_version 252568 (0.0009) [2023-12-26 01:36:35,287][123091] Updated weights for policy 0, policy_version 253878 (0.0007) [2023-12-26 01:36:35,350][123091] Updated weights for policy 0, policy_version 253888 (0.0009) [2023-12-26 01:36:35,410][123091] Updated weights for policy 0, policy_version 253898 (0.0009) [2023-12-26 01:36:35,604][123090] Updated weights for policy 1, policy_version 252578 (0.0010) [2023-12-26 01:36:35,664][123090] Updated weights for policy 1, policy_version 252588 (0.0009) [2023-12-26 01:36:35,733][123090] Updated weights for policy 1, policy_version 252598 (0.0009) [2023-12-26 01:36:35,791][123090] Updated weights for policy 1, policy_version 252608 (0.0008) [2023-12-26 01:36:36,211][123091] Updated weights for policy 0, policy_version 253908 (0.0008) [2023-12-26 01:36:36,283][123091] Updated weights for policy 0, policy_version 253918 (0.0006) [2023-12-26 01:36:36,340][123091] Updated weights for policy 0, policy_version 253928 (0.0007) [2023-12-26 01:36:36,654][123090] Updated weights for policy 1, policy_version 252618 (0.0008) [2023-12-26 01:36:36,724][123090] Updated weights for policy 1, policy_version 252628 (0.0009) [2023-12-26 01:36:36,791][123090] Updated weights for policy 1, policy_version 252638 (0.0009) [2023-12-26 01:36:37,089][123091] Updated weights for policy 0, policy_version 253938 (0.0008) [2023-12-26 01:36:37,140][123091] Updated weights for policy 0, policy_version 253948 (0.0005) [2023-12-26 01:36:37,188][123091] Updated weights for policy 0, policy_version 253958 (0.0005) [2023-12-26 01:36:37,255][123091] Updated weights for policy 0, policy_version 253968 (0.0008) [2023-12-26 01:36:37,541][123090] Updated weights for policy 1, policy_version 252648 (0.0010) [2023-12-26 01:36:37,596][123090] Updated weights for policy 1, policy_version 252658 (0.0010) [2023-12-26 01:36:37,654][123090] Updated weights for policy 1, policy_version 252668 (0.0010) [2023-12-26 01:36:38,024][123091] Updated weights for policy 0, policy_version 253978 (0.0008) [2023-12-26 01:36:38,075][123091] Updated weights for policy 0, policy_version 253988 (0.0009) [2023-12-26 01:36:38,124][123091] Updated weights for policy 0, policy_version 253998 (0.0009) [2023-12-26 01:36:38,514][123090] Updated weights for policy 1, policy_version 252678 (0.0009) [2023-12-26 01:36:38,584][123090] Updated weights for policy 1, policy_version 252688 (0.0010) [2023-12-26 01:36:38,656][123090] Updated weights for policy 1, policy_version 252698 (0.0010) [2023-12-26 01:36:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 129720320. Throughput: 0: 8916.0, 1: 8809.7. Samples: 129695020. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:38,785][121949] Avg episode reward: [(0, '5836.566'), (1, '4311.465')] [2023-12-26 01:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000254000_65028096.pth... [2023-12-26 01:36:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000252704_64692224.pth... [2023-12-26 01:36:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000252976_64765952.pth [2023-12-26 01:36:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000251680_64430080.pth [2023-12-26 01:36:38,962][123091] Updated weights for policy 0, policy_version 254008 (0.0010) [2023-12-26 01:36:39,028][123091] Updated weights for policy 0, policy_version 254018 (0.0010) [2023-12-26 01:36:39,100][123091] Updated weights for policy 0, policy_version 254028 (0.0010) [2023-12-26 01:36:39,426][123090] Updated weights for policy 1, policy_version 252708 (0.0010) [2023-12-26 01:36:39,498][123090] Updated weights for policy 1, policy_version 252718 (0.0010) [2023-12-26 01:36:39,568][123090] Updated weights for policy 1, policy_version 252728 (0.0009) [2023-12-26 01:36:39,982][123091] Updated weights for policy 0, policy_version 254038 (0.0009) [2023-12-26 01:36:40,043][123091] Updated weights for policy 0, policy_version 254048 (0.0008) [2023-12-26 01:36:40,108][123091] Updated weights for policy 0, policy_version 254058 (0.0009) [2023-12-26 01:36:40,379][123090] Updated weights for policy 1, policy_version 252738 (0.0008) [2023-12-26 01:36:40,445][123090] Updated weights for policy 1, policy_version 252748 (0.0008) [2023-12-26 01:36:40,512][123090] Updated weights for policy 1, policy_version 252758 (0.0010) [2023-12-26 01:36:40,576][123090] Updated weights for policy 1, policy_version 252768 (0.0010) [2023-12-26 01:36:40,945][123091] Updated weights for policy 0, policy_version 254068 (0.0010) [2023-12-26 01:36:41,013][123091] Updated weights for policy 0, policy_version 254078 (0.0010) [2023-12-26 01:36:41,073][123091] Updated weights for policy 0, policy_version 254088 (0.0010) [2023-12-26 01:36:41,379][123090] Updated weights for policy 1, policy_version 252778 (0.0009) [2023-12-26 01:36:41,449][123090] Updated weights for policy 1, policy_version 252788 (0.0008) [2023-12-26 01:36:41,511][123090] Updated weights for policy 1, policy_version 252798 (0.0008) [2023-12-26 01:36:41,868][123091] Updated weights for policy 0, policy_version 254098 (0.0008) [2023-12-26 01:36:41,931][123091] Updated weights for policy 0, policy_version 254108 (0.0006) [2023-12-26 01:36:41,994][123091] Updated weights for policy 0, policy_version 254118 (0.0006) [2023-12-26 01:36:42,062][123091] Updated weights for policy 0, policy_version 254128 (0.0007) [2023-12-26 01:36:42,296][123090] Updated weights for policy 1, policy_version 252808 (0.0009) [2023-12-26 01:36:42,359][123090] Updated weights for policy 1, policy_version 252818 (0.0011) [2023-12-26 01:36:42,427][123090] Updated weights for policy 1, policy_version 252828 (0.0011) [2023-12-26 01:36:42,817][123091] Updated weights for policy 0, policy_version 254138 (0.0006) [2023-12-26 01:36:42,887][123091] Updated weights for policy 0, policy_version 254148 (0.0008) [2023-12-26 01:36:42,949][123091] Updated weights for policy 0, policy_version 254158 (0.0005) [2023-12-26 01:36:43,174][123090] Updated weights for policy 1, policy_version 252838 (0.0007) [2023-12-26 01:36:43,219][123090] Updated weights for policy 1, policy_version 252848 (0.0005) [2023-12-26 01:36:43,272][123090] Updated weights for policy 1, policy_version 252858 (0.0006) [2023-12-26 01:36:43,563][123091] Updated weights for policy 0, policy_version 254168 (0.0005) [2023-12-26 01:36:43,625][123091] Updated weights for policy 0, policy_version 254178 (0.0010) [2023-12-26 01:36:43,679][123091] Updated weights for policy 0, policy_version 254188 (0.0010) [2023-12-26 01:36:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 129810432. Throughput: 0: 8929.4, 1: 8716.4. Samples: 129799432. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:43,785][121949] Avg episode reward: [(0, '5845.850'), (1, '4025.191')] [2023-12-26 01:36:43,986][123090] Updated weights for policy 1, policy_version 252868 (0.0009) [2023-12-26 01:36:44,045][123090] Updated weights for policy 1, policy_version 252878 (0.0010) [2023-12-26 01:36:44,108][123090] Updated weights for policy 1, policy_version 252888 (0.0010) [2023-12-26 01:36:44,517][123091] Updated weights for policy 0, policy_version 254198 (0.0010) [2023-12-26 01:36:44,577][123091] Updated weights for policy 0, policy_version 254208 (0.0009) [2023-12-26 01:36:44,637][123091] Updated weights for policy 0, policy_version 254218 (0.0009) [2023-12-26 01:36:44,906][123090] Updated weights for policy 1, policy_version 252898 (0.0010) [2023-12-26 01:36:44,980][123090] Updated weights for policy 1, policy_version 252908 (0.0006) [2023-12-26 01:36:45,050][123090] Updated weights for policy 1, policy_version 252918 (0.0007) [2023-12-26 01:36:45,115][123090] Updated weights for policy 1, policy_version 252928 (0.0008) [2023-12-26 01:36:45,564][123091] Updated weights for policy 0, policy_version 254228 (0.0009) [2023-12-26 01:36:45,622][123091] Updated weights for policy 0, policy_version 254238 (0.0009) [2023-12-26 01:36:45,672][123091] Updated weights for policy 0, policy_version 254248 (0.0009) [2023-12-26 01:36:45,755][123090] Updated weights for policy 1, policy_version 252938 (0.0005) [2023-12-26 01:36:45,818][123090] Updated weights for policy 1, policy_version 252948 (0.0005) [2023-12-26 01:36:45,879][123090] Updated weights for policy 1, policy_version 252958 (0.0005) [2023-12-26 01:36:46,495][123090] Updated weights for policy 1, policy_version 252968 (0.0008) [2023-12-26 01:36:46,511][123091] Updated weights for policy 0, policy_version 254258 (0.0008) [2023-12-26 01:36:46,561][123091] Updated weights for policy 0, policy_version 254268 (0.0005) [2023-12-26 01:36:46,563][123090] Updated weights for policy 1, policy_version 252978 (0.0007) [2023-12-26 01:36:46,616][123091] Updated weights for policy 0, policy_version 254278 (0.0006) [2023-12-26 01:36:46,624][123090] Updated weights for policy 1, policy_version 252988 (0.0007) [2023-12-26 01:36:46,689][123091] Updated weights for policy 0, policy_version 254288 (0.0009) [2023-12-26 01:36:47,316][123090] Updated weights for policy 1, policy_version 252998 (0.0006) [2023-12-26 01:36:47,366][123090] Updated weights for policy 1, policy_version 253008 (0.0005) [2023-12-26 01:36:47,437][123090] Updated weights for policy 1, policy_version 253018 (0.0005) [2023-12-26 01:36:47,513][123091] Updated weights for policy 0, policy_version 254298 (0.0009) [2023-12-26 01:36:47,569][123091] Updated weights for policy 0, policy_version 254309 (0.0010) [2023-12-26 01:36:47,634][123091] Updated weights for policy 0, policy_version 254319 (0.0009) [2023-12-26 01:36:48,153][123090] Updated weights for policy 1, policy_version 253028 (0.0005) [2023-12-26 01:36:48,223][123090] Updated weights for policy 1, policy_version 253038 (0.0005) [2023-12-26 01:36:48,287][123090] Updated weights for policy 1, policy_version 253048 (0.0006) [2023-12-26 01:36:48,528][123091] Updated weights for policy 0, policy_version 254329 (0.0008) [2023-12-26 01:36:48,589][123091] Updated weights for policy 0, policy_version 254339 (0.0009) [2023-12-26 01:36:48,649][123091] Updated weights for policy 0, policy_version 254349 (0.0006) [2023-12-26 01:36:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 129900544. Throughput: 0: 8901.9, 1: 8792.7. Samples: 129910184. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:48,785][121949] Avg episode reward: [(0, '5924.297'), (1, '4334.351')] [2023-12-26 01:36:49,107][123090] Updated weights for policy 1, policy_version 253058 (0.0007) [2023-12-26 01:36:49,175][123090] Updated weights for policy 1, policy_version 253068 (0.0009) [2023-12-26 01:36:49,244][123090] Updated weights for policy 1, policy_version 253078 (0.0010) [2023-12-26 01:36:49,313][123090] Updated weights for policy 1, policy_version 253088 (0.0010) [2023-12-26 01:36:49,356][123091] Updated weights for policy 0, policy_version 254359 (0.0009) [2023-12-26 01:36:49,427][123091] Updated weights for policy 0, policy_version 254369 (0.0009) [2023-12-26 01:36:49,490][123091] Updated weights for policy 0, policy_version 254379 (0.0010) [2023-12-26 01:36:50,062][123090] Updated weights for policy 1, policy_version 253098 (0.0007) [2023-12-26 01:36:50,127][123090] Updated weights for policy 1, policy_version 253108 (0.0007) [2023-12-26 01:36:50,185][123090] Updated weights for policy 1, policy_version 253118 (0.0008) [2023-12-26 01:36:50,334][123091] Updated weights for policy 0, policy_version 254389 (0.0009) [2023-12-26 01:36:50,399][123091] Updated weights for policy 0, policy_version 254399 (0.0008) [2023-12-26 01:36:50,468][123091] Updated weights for policy 0, policy_version 254409 (0.0008) [2023-12-26 01:36:50,912][123090] Updated weights for policy 1, policy_version 253128 (0.0010) [2023-12-26 01:36:50,978][123090] Updated weights for policy 1, policy_version 253138 (0.0009) [2023-12-26 01:36:51,044][123090] Updated weights for policy 1, policy_version 253148 (0.0009) [2023-12-26 01:36:51,152][123091] Updated weights for policy 0, policy_version 254419 (0.0010) [2023-12-26 01:36:51,218][123091] Updated weights for policy 0, policy_version 254429 (0.0010) [2023-12-26 01:36:51,287][123091] Updated weights for policy 0, policy_version 254439 (0.0009) [2023-12-26 01:36:51,917][123090] Updated weights for policy 1, policy_version 253158 (0.0009) [2023-12-26 01:36:51,982][123090] Updated weights for policy 1, policy_version 253168 (0.0010) [2023-12-26 01:36:52,050][123090] Updated weights for policy 1, policy_version 253178 (0.0008) [2023-12-26 01:36:52,126][123091] Updated weights for policy 0, policy_version 254449 (0.0009) [2023-12-26 01:36:52,179][123091] Updated weights for policy 0, policy_version 254459 (0.0010) [2023-12-26 01:36:52,232][123091] Updated weights for policy 0, policy_version 254469 (0.0010) [2023-12-26 01:36:52,295][123091] Updated weights for policy 0, policy_version 254479 (0.0010) [2023-12-26 01:36:52,812][123090] Updated weights for policy 1, policy_version 253188 (0.0009) [2023-12-26 01:36:52,875][123090] Updated weights for policy 1, policy_version 253198 (0.0010) [2023-12-26 01:36:52,935][123090] Updated weights for policy 1, policy_version 253208 (0.0010) [2023-12-26 01:36:53,176][123091] Updated weights for policy 0, policy_version 254489 (0.0010) [2023-12-26 01:36:53,245][123091] Updated weights for policy 0, policy_version 254499 (0.0009) [2023-12-26 01:36:53,308][123091] Updated weights for policy 0, policy_version 254509 (0.0010) [2023-12-26 01:36:53,730][123090] Updated weights for policy 1, policy_version 253218 (0.0009) [2023-12-26 01:36:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 129982464. Throughput: 0: 8885.6, 1: 8802.9. Samples: 129962932. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:53,785][121949] Avg episode reward: [(0, '6034.848'), (1, '4027.921')] [2023-12-26 01:36:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000254512_65159168.pth... [2023-12-26 01:36:53,793][123090] Updated weights for policy 1, policy_version 253228 (0.0009) [2023-12-26 01:36:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000253488_64897024.pth [2023-12-26 01:36:53,852][123090] Updated weights for policy 1, policy_version 253238 (0.0010) [2023-12-26 01:36:53,908][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000253248_64831488.pth... [2023-12-26 01:36:53,908][123090] Updated weights for policy 1, policy_version 253248 (0.0008) [2023-12-26 01:36:53,911][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000252192_64561152.pth [2023-12-26 01:36:54,071][123091] Updated weights for policy 0, policy_version 254519 (0.0007) [2023-12-26 01:36:54,136][123091] Updated weights for policy 0, policy_version 254529 (0.0005) [2023-12-26 01:36:54,198][123091] Updated weights for policy 0, policy_version 254539 (0.0005) [2023-12-26 01:36:54,653][123090] Updated weights for policy 1, policy_version 253258 (0.0009) [2023-12-26 01:36:54,715][123090] Updated weights for policy 1, policy_version 253268 (0.0005) [2023-12-26 01:36:54,793][123090] Updated weights for policy 1, policy_version 253278 (0.0005) [2023-12-26 01:36:54,871][123091] Updated weights for policy 0, policy_version 254549 (0.0005) [2023-12-26 01:36:54,929][123091] Updated weights for policy 0, policy_version 254559 (0.0006) [2023-12-26 01:36:54,983][123091] Updated weights for policy 0, policy_version 254569 (0.0005) [2023-12-26 01:36:55,506][123090] Updated weights for policy 1, policy_version 253288 (0.0009) [2023-12-26 01:36:55,560][123090] Updated weights for policy 1, policy_version 253298 (0.0005) [2023-12-26 01:36:55,614][123090] Updated weights for policy 1, policy_version 253308 (0.0005) [2023-12-26 01:36:55,662][123091] Updated weights for policy 0, policy_version 254579 (0.0006) [2023-12-26 01:36:55,717][123091] Updated weights for policy 0, policy_version 254589 (0.0005) [2023-12-26 01:36:55,774][123091] Updated weights for policy 0, policy_version 254599 (0.0005) [2023-12-26 01:36:56,350][123090] Updated weights for policy 1, policy_version 253318 (0.0007) [2023-12-26 01:36:56,418][123090] Updated weights for policy 1, policy_version 253328 (0.0008) [2023-12-26 01:36:56,421][123091] Updated weights for policy 0, policy_version 254609 (0.0006) [2023-12-26 01:36:56,472][123091] Updated weights for policy 0, policy_version 254619 (0.0010) [2023-12-26 01:36:56,485][123090] Updated weights for policy 1, policy_version 253338 (0.0007) [2023-12-26 01:36:56,531][123091] Updated weights for policy 0, policy_version 254629 (0.0010) [2023-12-26 01:36:56,579][123091] Updated weights for policy 0, policy_version 254639 (0.0010) [2023-12-26 01:36:57,162][123090] Updated weights for policy 1, policy_version 253348 (0.0006) [2023-12-26 01:36:57,209][123090] Updated weights for policy 1, policy_version 253358 (0.0005) [2023-12-26 01:36:57,255][123090] Updated weights for policy 1, policy_version 253368 (0.0005) [2023-12-26 01:36:57,294][123091] Updated weights for policy 0, policy_version 254649 (0.0006) [2023-12-26 01:36:57,352][123091] Updated weights for policy 0, policy_version 254659 (0.0006) [2023-12-26 01:36:57,419][123091] Updated weights for policy 0, policy_version 254669 (0.0005) [2023-12-26 01:36:58,072][123090] Updated weights for policy 1, policy_version 253378 (0.0006) [2023-12-26 01:36:58,137][123090] Updated weights for policy 1, policy_version 253388 (0.0009) [2023-12-26 01:36:58,186][123091] Updated weights for policy 0, policy_version 254679 (0.0007) [2023-12-26 01:36:58,201][123090] Updated weights for policy 1, policy_version 253398 (0.0009) [2023-12-26 01:36:58,248][123091] Updated weights for policy 0, policy_version 254689 (0.0006) [2023-12-26 01:36:58,262][123090] Updated weights for policy 1, policy_version 253408 (0.0009) [2023-12-26 01:36:58,311][123091] Updated weights for policy 0, policy_version 254699 (0.0006) [2023-12-26 01:36:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 130080768. Throughput: 0: 9012.4, 1: 8907.0. Samples: 130076236. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:36:58,785][121949] Avg episode reward: [(0, '5990.635'), (1, '4197.515')] [2023-12-26 01:36:59,028][123091] Updated weights for policy 0, policy_version 254709 (0.0007) [2023-12-26 01:36:59,080][123091] Updated weights for policy 0, policy_version 254719 (0.0005) [2023-12-26 01:36:59,128][123091] Updated weights for policy 0, policy_version 254729 (0.0005) [2023-12-26 01:36:59,204][123090] Updated weights for policy 1, policy_version 253418 (0.0008) [2023-12-26 01:36:59,277][123090] Updated weights for policy 1, policy_version 253428 (0.0007) [2023-12-26 01:36:59,353][123090] Updated weights for policy 1, policy_version 253438 (0.0008) [2023-12-26 01:36:59,919][123091] Updated weights for policy 0, policy_version 254739 (0.0006) [2023-12-26 01:36:59,995][123091] Updated weights for policy 0, policy_version 254749 (0.0007) [2023-12-26 01:37:00,065][123091] Updated weights for policy 0, policy_version 254759 (0.0006) [2023-12-26 01:37:00,139][123090] Updated weights for policy 1, policy_version 253448 (0.0006) [2023-12-26 01:37:00,195][123090] Updated weights for policy 1, policy_version 253458 (0.0007) [2023-12-26 01:37:00,255][123090] Updated weights for policy 1, policy_version 253468 (0.0009) [2023-12-26 01:37:00,817][123091] Updated weights for policy 0, policy_version 254769 (0.0006) [2023-12-26 01:37:00,864][123091] Updated weights for policy 0, policy_version 254779 (0.0010) [2023-12-26 01:37:00,911][123091] Updated weights for policy 0, policy_version 254789 (0.0010) [2023-12-26 01:37:00,965][123091] Updated weights for policy 0, policy_version 254799 (0.0010) [2023-12-26 01:37:01,042][123090] Updated weights for policy 1, policy_version 253478 (0.0008) [2023-12-26 01:37:01,117][123090] Updated weights for policy 1, policy_version 253488 (0.0010) [2023-12-26 01:37:01,174][123090] Updated weights for policy 1, policy_version 253498 (0.0008) [2023-12-26 01:37:01,833][123091] Updated weights for policy 0, policy_version 254809 (0.0009) [2023-12-26 01:37:01,893][123091] Updated weights for policy 0, policy_version 254819 (0.0009) [2023-12-26 01:37:01,943][123091] Updated weights for policy 0, policy_version 254830 (0.0009) [2023-12-26 01:37:01,948][123090] Updated weights for policy 1, policy_version 253508 (0.0007) [2023-12-26 01:37:02,000][123090] Updated weights for policy 1, policy_version 253518 (0.0006) [2023-12-26 01:37:02,054][123090] Updated weights for policy 1, policy_version 253528 (0.0009) [2023-12-26 01:37:02,794][123091] Updated weights for policy 0, policy_version 254840 (0.0009) [2023-12-26 01:37:02,848][123090] Updated weights for policy 1, policy_version 253538 (0.0009) [2023-12-26 01:37:02,867][123091] Updated weights for policy 0, policy_version 254850 (0.0010) [2023-12-26 01:37:02,907][123090] Updated weights for policy 1, policy_version 253548 (0.0005) [2023-12-26 01:37:02,926][123091] Updated weights for policy 0, policy_version 254860 (0.0009) [2023-12-26 01:37:02,965][123090] Updated weights for policy 1, policy_version 253558 (0.0005) [2023-12-26 01:37:03,025][123090] Updated weights for policy 1, policy_version 253568 (0.0005) [2023-12-26 01:37:03,632][123090] Updated weights for policy 1, policy_version 253578 (0.0005) [2023-12-26 01:37:03,682][123090] Updated weights for policy 1, policy_version 253588 (0.0005) [2023-12-26 01:37:03,743][123090] Updated weights for policy 1, policy_version 253598 (0.0006) [2023-12-26 01:37:03,782][123091] Updated weights for policy 0, policy_version 254870 (0.0010) [2023-12-26 01:37:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 130170880. Throughput: 0: 8912.4, 1: 8961.2. Samples: 130182484. Policy #0 lag: (min: 31.0, avg: 38.3, max: 63.0) [2023-12-26 01:37:03,784][121949] Avg episode reward: [(0, '5961.553'), (1, '4312.435')] [2023-12-26 01:37:03,831][123091] Updated weights for policy 0, policy_version 254880 (0.0009) [2023-12-26 01:37:03,908][123091] Updated weights for policy 0, policy_version 254890 (0.0008) [2023-12-26 01:37:04,474][123090] Updated weights for policy 1, policy_version 253608 (0.0007) [2023-12-26 01:37:04,534][123090] Updated weights for policy 1, policy_version 253618 (0.0005) [2023-12-26 01:37:04,592][123090] Updated weights for policy 1, policy_version 253628 (0.0005) [2023-12-26 01:37:04,707][123091] Updated weights for policy 0, policy_version 254900 (0.0008) [2023-12-26 01:37:04,770][123091] Updated weights for policy 0, policy_version 254910 (0.0010) [2023-12-26 01:37:04,822][123091] Updated weights for policy 0, policy_version 254920 (0.0010) [2023-12-26 01:37:05,275][123090] Updated weights for policy 1, policy_version 253638 (0.0005) [2023-12-26 01:37:05,322][123090] Updated weights for policy 1, policy_version 253648 (0.0008) [2023-12-26 01:37:05,370][123090] Updated weights for policy 1, policy_version 253658 (0.0009) [2023-12-26 01:37:05,658][123091] Updated weights for policy 0, policy_version 254930 (0.0009) [2023-12-26 01:37:05,717][123091] Updated weights for policy 0, policy_version 254940 (0.0005) [2023-12-26 01:37:05,763][123091] Updated weights for policy 0, policy_version 254950 (0.0005) [2023-12-26 01:37:05,812][123091] Updated weights for policy 0, policy_version 254960 (0.0005) [2023-12-26 01:37:06,074][123090] Updated weights for policy 1, policy_version 253668 (0.0008) [2023-12-26 01:37:06,156][123090] Updated weights for policy 1, policy_version 253678 (0.0007) [2023-12-26 01:37:06,232][123090] Updated weights for policy 1, policy_version 253688 (0.0006) [2023-12-26 01:37:06,505][123091] Updated weights for policy 0, policy_version 254970 (0.0011) [2023-12-26 01:37:06,576][123091] Updated weights for policy 0, policy_version 254980 (0.0010) [2023-12-26 01:37:06,649][123091] Updated weights for policy 0, policy_version 254990 (0.0011) [2023-12-26 01:37:06,846][123090] Updated weights for policy 1, policy_version 253698 (0.0007) [2023-12-26 01:37:06,894][123090] Updated weights for policy 1, policy_version 253708 (0.0010) [2023-12-26 01:37:06,949][123090] Updated weights for policy 1, policy_version 253718 (0.0010) [2023-12-26 01:37:07,011][123090] Updated weights for policy 1, policy_version 253728 (0.0009) [2023-12-26 01:37:07,431][123091] Updated weights for policy 0, policy_version 255000 (0.0006) [2023-12-26 01:37:07,499][123091] Updated weights for policy 0, policy_version 255010 (0.0006) [2023-12-26 01:37:07,565][123091] Updated weights for policy 0, policy_version 255020 (0.0010) [2023-12-26 01:37:07,690][123090] Updated weights for policy 1, policy_version 253738 (0.0006) [2023-12-26 01:37:07,739][123090] Updated weights for policy 1, policy_version 253748 (0.0009) [2023-12-26 01:37:07,788][123090] Updated weights for policy 1, policy_version 253758 (0.0010) [2023-12-26 01:37:08,351][123091] Updated weights for policy 0, policy_version 255030 (0.0009) [2023-12-26 01:37:08,416][123091] Updated weights for policy 0, policy_version 255040 (0.0010) [2023-12-26 01:37:08,467][123091] Updated weights for policy 0, policy_version 255050 (0.0010) [2023-12-26 01:37:08,652][123090] Updated weights for policy 1, policy_version 253768 (0.0010) [2023-12-26 01:37:08,709][123090] Updated weights for policy 1, policy_version 253778 (0.0011) [2023-12-26 01:37:08,768][123090] Updated weights for policy 1, policy_version 253788 (0.0011) [2023-12-26 01:37:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 130260992. Throughput: 0: 8926.5, 1: 9066.2. Samples: 130239212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:08,784][121949] Avg episode reward: [(0, '6022.577'), (1, '4101.502')] [2023-12-26 01:37:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000255056_65298432.pth... [2023-12-26 01:37:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000253792_64970752.pth... [2023-12-26 01:37:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000254000_65028096.pth [2023-12-26 01:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000252704_64692224.pth [2023-12-26 01:37:09,255][123091] Updated weights for policy 0, policy_version 255060 (0.0010) [2023-12-26 01:37:09,308][123091] Updated weights for policy 0, policy_version 255070 (0.0010) [2023-12-26 01:37:09,366][123091] Updated weights for policy 0, policy_version 255080 (0.0009) [2023-12-26 01:37:09,640][123090] Updated weights for policy 1, policy_version 253798 (0.0011) [2023-12-26 01:37:09,707][123090] Updated weights for policy 1, policy_version 253808 (0.0009) [2023-12-26 01:37:09,779][123090] Updated weights for policy 1, policy_version 253818 (0.0011) [2023-12-26 01:37:10,254][123091] Updated weights for policy 0, policy_version 255090 (0.0009) [2023-12-26 01:37:10,308][123091] Updated weights for policy 0, policy_version 255100 (0.0009) [2023-12-26 01:37:10,358][123091] Updated weights for policy 0, policy_version 255110 (0.0009) [2023-12-26 01:37:10,412][123091] Updated weights for policy 0, policy_version 255120 (0.0009) [2023-12-26 01:37:10,609][123090] Updated weights for policy 1, policy_version 253828 (0.0011) [2023-12-26 01:37:10,668][123090] Updated weights for policy 1, policy_version 253838 (0.0010) [2023-12-26 01:37:10,715][123090] Updated weights for policy 1, policy_version 253848 (0.0010) [2023-12-26 01:37:11,346][123091] Updated weights for policy 0, policy_version 255130 (0.0010) [2023-12-26 01:37:11,419][123091] Updated weights for policy 0, policy_version 255140 (0.0009) [2023-12-26 01:37:11,484][123091] Updated weights for policy 0, policy_version 255150 (0.0009) [2023-12-26 01:37:11,581][123090] Updated weights for policy 1, policy_version 253858 (0.0010) [2023-12-26 01:37:11,653][123090] Updated weights for policy 1, policy_version 253868 (0.0011) [2023-12-26 01:37:11,722][123090] Updated weights for policy 1, policy_version 253878 (0.0011) [2023-12-26 01:37:11,793][123090] Updated weights for policy 1, policy_version 253888 (0.0008) [2023-12-26 01:37:12,394][123091] Updated weights for policy 0, policy_version 255160 (0.0009) [2023-12-26 01:37:12,447][123091] Updated weights for policy 0, policy_version 255170 (0.0009) [2023-12-26 01:37:12,494][123091] Updated weights for policy 0, policy_version 255180 (0.0009) [2023-12-26 01:37:12,495][123090] Updated weights for policy 1, policy_version 253898 (0.0008) [2023-12-26 01:37:12,559][123090] Updated weights for policy 1, policy_version 253908 (0.0009) [2023-12-26 01:37:12,633][123090] Updated weights for policy 1, policy_version 253918 (0.0010) [2023-12-26 01:37:13,263][123091] Updated weights for policy 0, policy_version 255190 (0.0006) [2023-12-26 01:37:13,324][123091] Updated weights for policy 0, policy_version 255200 (0.0005) [2023-12-26 01:37:13,396][123091] Updated weights for policy 0, policy_version 255210 (0.0005) [2023-12-26 01:37:13,498][123090] Updated weights for policy 1, policy_version 253928 (0.0009) [2023-12-26 01:37:13,551][123090] Updated weights for policy 1, policy_version 253938 (0.0009) [2023-12-26 01:37:13,609][123090] Updated weights for policy 1, policy_version 253948 (0.0010) [2023-12-26 01:37:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 130351104. Throughput: 0: 8870.2, 1: 9012.1. Samples: 130341876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:13,784][121949] Avg episode reward: [(0, '6071.525'), (1, '3719.620')] [2023-12-26 01:37:14,066][123091] Updated weights for policy 0, policy_version 255220 (0.0007) [2023-12-26 01:37:14,134][123091] Updated weights for policy 0, policy_version 255230 (0.0009) [2023-12-26 01:37:14,194][123091] Updated weights for policy 0, policy_version 255240 (0.0010) [2023-12-26 01:37:14,428][123090] Updated weights for policy 1, policy_version 253958 (0.0010) [2023-12-26 01:37:14,478][123090] Updated weights for policy 1, policy_version 253968 (0.0008) [2023-12-26 01:37:14,528][123090] Updated weights for policy 1, policy_version 253978 (0.0009) [2023-12-26 01:37:15,022][123091] Updated weights for policy 0, policy_version 255250 (0.0009) [2023-12-26 01:37:15,088][123091] Updated weights for policy 0, policy_version 255260 (0.0007) [2023-12-26 01:37:15,141][123091] Updated weights for policy 0, policy_version 255270 (0.0009) [2023-12-26 01:37:15,199][123091] Updated weights for policy 0, policy_version 255280 (0.0009) [2023-12-26 01:37:15,424][123090] Updated weights for policy 1, policy_version 253988 (0.0009) [2023-12-26 01:37:15,500][123090] Updated weights for policy 1, policy_version 253998 (0.0010) [2023-12-26 01:37:15,570][123090] Updated weights for policy 1, policy_version 254008 (0.0009) [2023-12-26 01:37:15,957][123091] Updated weights for policy 0, policy_version 255290 (0.0005) [2023-12-26 01:37:16,012][123091] Updated weights for policy 0, policy_version 255300 (0.0005) [2023-12-26 01:37:16,064][123091] Updated weights for policy 0, policy_version 255310 (0.0005) [2023-12-26 01:37:16,451][123090] Updated weights for policy 1, policy_version 254018 (0.0010) [2023-12-26 01:37:16,505][123090] Updated weights for policy 1, policy_version 254028 (0.0010) [2023-12-26 01:37:16,564][123090] Updated weights for policy 1, policy_version 254039 (0.0011) [2023-12-26 01:37:16,683][123091] Updated weights for policy 0, policy_version 255320 (0.0008) [2023-12-26 01:37:16,747][123091] Updated weights for policy 0, policy_version 255330 (0.0009) [2023-12-26 01:37:16,805][123091] Updated weights for policy 0, policy_version 255340 (0.0005) [2023-12-26 01:37:17,342][123090] Updated weights for policy 1, policy_version 254050 (0.0009) [2023-12-26 01:37:17,410][123090] Updated weights for policy 1, policy_version 254060 (0.0008) [2023-12-26 01:37:17,459][123090] Updated weights for policy 1, policy_version 254070 (0.0009) [2023-12-26 01:37:17,492][123091] Updated weights for policy 0, policy_version 255350 (0.0008) [2023-12-26 01:37:17,518][123090] Updated weights for policy 1, policy_version 254080 (0.0007) [2023-12-26 01:37:17,546][123091] Updated weights for policy 0, policy_version 255360 (0.0008) [2023-12-26 01:37:17,598][123091] Updated weights for policy 0, policy_version 255371 (0.0009) [2023-12-26 01:37:18,380][123090] Updated weights for policy 1, policy_version 254090 (0.0007) [2023-12-26 01:37:18,432][123091] Updated weights for policy 0, policy_version 255381 (0.0007) [2023-12-26 01:37:18,447][123090] Updated weights for policy 1, policy_version 254100 (0.0009) [2023-12-26 01:37:18,492][123091] Updated weights for policy 0, policy_version 255391 (0.0007) [2023-12-26 01:37:18,496][123090] Updated weights for policy 1, policy_version 254110 (0.0008) [2023-12-26 01:37:18,551][123091] Updated weights for policy 0, policy_version 255401 (0.0009) [2023-12-26 01:37:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 130441216. Throughput: 0: 8944.0, 1: 8986.0. Samples: 130448556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:18,785][121949] Avg episode reward: [(0, '6022.606'), (1, '3624.733')] [2023-12-26 01:37:19,180][123090] Updated weights for policy 1, policy_version 254120 (0.0009) [2023-12-26 01:37:19,248][123090] Updated weights for policy 1, policy_version 254130 (0.0009) [2023-12-26 01:37:19,306][123090] Updated weights for policy 1, policy_version 254140 (0.0008) [2023-12-26 01:37:19,453][123091] Updated weights for policy 0, policy_version 255411 (0.0007) [2023-12-26 01:37:19,531][123091] Updated weights for policy 0, policy_version 255421 (0.0008) [2023-12-26 01:37:19,599][123091] Updated weights for policy 0, policy_version 255431 (0.0011) [2023-12-26 01:37:20,092][123090] Updated weights for policy 1, policy_version 254150 (0.0009) [2023-12-26 01:37:20,151][123090] Updated weights for policy 1, policy_version 254160 (0.0010) [2023-12-26 01:37:20,207][123090] Updated weights for policy 1, policy_version 254170 (0.0010) [2023-12-26 01:37:20,418][123091] Updated weights for policy 0, policy_version 255441 (0.0010) [2023-12-26 01:37:20,482][123091] Updated weights for policy 0, policy_version 255451 (0.0010) [2023-12-26 01:37:20,553][123091] Updated weights for policy 0, policy_version 255461 (0.0011) [2023-12-26 01:37:20,621][123091] Updated weights for policy 0, policy_version 255471 (0.0011) [2023-12-26 01:37:21,085][123090] Updated weights for policy 1, policy_version 254180 (0.0010) [2023-12-26 01:37:21,155][123090] Updated weights for policy 1, policy_version 254190 (0.0010) [2023-12-26 01:37:21,216][123090] Updated weights for policy 1, policy_version 254200 (0.0010) [2023-12-26 01:37:21,420][123091] Updated weights for policy 0, policy_version 255481 (0.0009) [2023-12-26 01:37:21,481][123091] Updated weights for policy 0, policy_version 255491 (0.0009) [2023-12-26 01:37:21,536][123091] Updated weights for policy 0, policy_version 255501 (0.0008) [2023-12-26 01:37:22,012][123090] Updated weights for policy 1, policy_version 254210 (0.0011) [2023-12-26 01:37:22,082][123090] Updated weights for policy 1, policy_version 254220 (0.0009) [2023-12-26 01:37:22,147][123090] Updated weights for policy 1, policy_version 254230 (0.0008) [2023-12-26 01:37:22,215][123090] Updated weights for policy 1, policy_version 254240 (0.0008) [2023-12-26 01:37:22,449][123091] Updated weights for policy 0, policy_version 255511 (0.0010) [2023-12-26 01:37:22,502][123091] Updated weights for policy 0, policy_version 255521 (0.0009) [2023-12-26 01:37:22,558][123091] Updated weights for policy 0, policy_version 255531 (0.0009) [2023-12-26 01:37:23,019][123090] Updated weights for policy 1, policy_version 254250 (0.0010) [2023-12-26 01:37:23,073][123090] Updated weights for policy 1, policy_version 254260 (0.0010) [2023-12-26 01:37:23,128][123090] Updated weights for policy 1, policy_version 254270 (0.0010) [2023-12-26 01:37:23,345][123091] Updated weights for policy 0, policy_version 255541 (0.0007) [2023-12-26 01:37:23,401][123091] Updated weights for policy 0, policy_version 255551 (0.0011) [2023-12-26 01:37:23,449][123091] Updated weights for policy 0, policy_version 255561 (0.0011) [2023-12-26 01:37:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 130523136. Throughput: 0: 8864.6, 1: 9023.0. Samples: 130499960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:23,785][121949] Avg episode reward: [(0, '6116.465'), (1, '4044.604')] [2023-12-26 01:37:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000255568_65429504.pth... [2023-12-26 01:37:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000254272_65093632.pth... [2023-12-26 01:37:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000253248_64831488.pth [2023-12-26 01:37:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000254512_65159168.pth [2023-12-26 01:37:24,098][123090] Updated weights for policy 1, policy_version 254280 (0.0009) [2023-12-26 01:37:24,154][123090] Updated weights for policy 1, policy_version 254290 (0.0009) [2023-12-26 01:37:24,183][123091] Updated weights for policy 0, policy_version 255571 (0.0009) [2023-12-26 01:37:24,204][123090] Updated weights for policy 1, policy_version 254300 (0.0009) [2023-12-26 01:37:24,237][123091] Updated weights for policy 0, policy_version 255581 (0.0005) [2023-12-26 01:37:24,295][123091] Updated weights for policy 0, policy_version 255591 (0.0010) [2023-12-26 01:37:25,008][123091] Updated weights for policy 0, policy_version 255601 (0.0010) [2023-12-26 01:37:25,074][123091] Updated weights for policy 0, policy_version 255611 (0.0007) [2023-12-26 01:37:25,092][123090] Updated weights for policy 1, policy_version 254310 (0.0009) [2023-12-26 01:37:25,141][123091] Updated weights for policy 0, policy_version 255621 (0.0009) [2023-12-26 01:37:25,148][123090] Updated weights for policy 1, policy_version 254320 (0.0007) [2023-12-26 01:37:25,207][123091] Updated weights for policy 0, policy_version 255631 (0.0011) [2023-12-26 01:37:25,215][123090] Updated weights for policy 1, policy_version 254330 (0.0006) [2023-12-26 01:37:25,951][123090] Updated weights for policy 1, policy_version 254340 (0.0007) [2023-12-26 01:37:25,951][123091] Updated weights for policy 0, policy_version 255641 (0.0006) [2023-12-26 01:37:26,019][123090] Updated weights for policy 1, policy_version 254350 (0.0009) [2023-12-26 01:37:26,019][123091] Updated weights for policy 0, policy_version 255651 (0.0005) [2023-12-26 01:37:26,084][123090] Updated weights for policy 1, policy_version 254360 (0.0007) [2023-12-26 01:37:26,089][123091] Updated weights for policy 0, policy_version 255661 (0.0009) [2023-12-26 01:37:26,710][123091] Updated weights for policy 0, policy_version 255671 (0.0007) [2023-12-26 01:37:26,746][123090] Updated weights for policy 1, policy_version 254370 (0.0008) [2023-12-26 01:37:26,775][123091] Updated weights for policy 0, policy_version 255681 (0.0005) [2023-12-26 01:37:26,808][123090] Updated weights for policy 1, policy_version 254380 (0.0009) [2023-12-26 01:37:26,843][123091] Updated weights for policy 0, policy_version 255691 (0.0010) [2023-12-26 01:37:26,871][123090] Updated weights for policy 1, policy_version 254390 (0.0006) [2023-12-26 01:37:26,935][123090] Updated weights for policy 1, policy_version 254400 (0.0009) [2023-12-26 01:37:27,497][123091] Updated weights for policy 0, policy_version 255701 (0.0010) [2023-12-26 01:37:27,543][123091] Updated weights for policy 0, policy_version 255711 (0.0010) [2023-12-26 01:37:27,610][123091] Updated weights for policy 0, policy_version 255721 (0.0010) [2023-12-26 01:37:27,774][123090] Updated weights for policy 1, policy_version 254410 (0.0009) [2023-12-26 01:37:27,834][123090] Updated weights for policy 1, policy_version 254420 (0.0008) [2023-12-26 01:37:27,901][123090] Updated weights for policy 1, policy_version 254430 (0.0009) [2023-12-26 01:37:28,362][123091] Updated weights for policy 0, policy_version 255731 (0.0009) [2023-12-26 01:37:28,420][123091] Updated weights for policy 0, policy_version 255741 (0.0005) [2023-12-26 01:37:28,488][123091] Updated weights for policy 0, policy_version 255751 (0.0010) [2023-12-26 01:37:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 130613248. Throughput: 0: 8953.6, 1: 9010.0. Samples: 130607796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:28,785][121949] Avg episode reward: [(0, '6097.461'), (1, '3950.966')] [2023-12-26 01:37:28,807][123090] Updated weights for policy 1, policy_version 254440 (0.0009) [2023-12-26 01:37:28,877][123090] Updated weights for policy 1, policy_version 254450 (0.0008) [2023-12-26 01:37:28,941][123090] Updated weights for policy 1, policy_version 254460 (0.0009) [2023-12-26 01:37:29,219][123091] Updated weights for policy 0, policy_version 255761 (0.0010) [2023-12-26 01:37:29,285][123091] Updated weights for policy 0, policy_version 255771 (0.0007) [2023-12-26 01:37:29,360][123091] Updated weights for policy 0, policy_version 255781 (0.0007) [2023-12-26 01:37:29,436][123091] Updated weights for policy 0, policy_version 255791 (0.0005) [2023-12-26 01:37:29,842][123090] Updated weights for policy 1, policy_version 254470 (0.0009) [2023-12-26 01:37:29,900][123090] Updated weights for policy 1, policy_version 254480 (0.0010) [2023-12-26 01:37:29,968][123090] Updated weights for policy 1, policy_version 254490 (0.0008) [2023-12-26 01:37:30,039][123091] Updated weights for policy 0, policy_version 255801 (0.0010) [2023-12-26 01:37:30,105][123091] Updated weights for policy 0, policy_version 255811 (0.0010) [2023-12-26 01:37:30,165][123091] Updated weights for policy 0, policy_version 255821 (0.0009) [2023-12-26 01:37:30,694][123090] Updated weights for policy 1, policy_version 254500 (0.0007) [2023-12-26 01:37:30,743][123090] Updated weights for policy 1, policy_version 254510 (0.0009) [2023-12-26 01:37:30,798][123090] Updated weights for policy 1, policy_version 254520 (0.0009) [2023-12-26 01:37:30,971][123091] Updated weights for policy 0, policy_version 255831 (0.0010) [2023-12-26 01:37:31,033][123091] Updated weights for policy 0, policy_version 255841 (0.0010) [2023-12-26 01:37:31,106][123091] Updated weights for policy 0, policy_version 255851 (0.0011) [2023-12-26 01:37:31,632][123090] Updated weights for policy 1, policy_version 254530 (0.0008) [2023-12-26 01:37:31,693][123090] Updated weights for policy 1, policy_version 254540 (0.0006) [2023-12-26 01:37:31,762][123090] Updated weights for policy 1, policy_version 254550 (0.0008) [2023-12-26 01:37:31,828][123090] Updated weights for policy 1, policy_version 254560 (0.0006) [2023-12-26 01:37:31,946][123091] Updated weights for policy 0, policy_version 255861 (0.0010) [2023-12-26 01:37:31,997][123091] Updated weights for policy 0, policy_version 255871 (0.0009) [2023-12-26 01:37:32,072][123091] Updated weights for policy 0, policy_version 255881 (0.0005) [2023-12-26 01:37:32,530][123090] Updated weights for policy 1, policy_version 254570 (0.0006) [2023-12-26 01:37:32,594][123090] Updated weights for policy 1, policy_version 254580 (0.0010) [2023-12-26 01:37:32,664][123090] Updated weights for policy 1, policy_version 254590 (0.0010) [2023-12-26 01:37:32,840][123091] Updated weights for policy 0, policy_version 255891 (0.0009) [2023-12-26 01:37:32,902][123091] Updated weights for policy 0, policy_version 255901 (0.0010) [2023-12-26 01:37:32,967][123091] Updated weights for policy 0, policy_version 255911 (0.0010) [2023-12-26 01:37:33,428][123090] Updated weights for policy 1, policy_version 254600 (0.0006) [2023-12-26 01:37:33,490][123090] Updated weights for policy 1, policy_version 254610 (0.0005) [2023-12-26 01:37:33,562][123090] Updated weights for policy 1, policy_version 254620 (0.0005) [2023-12-26 01:37:33,768][123091] Updated weights for policy 0, policy_version 255921 (0.0010) [2023-12-26 01:37:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 130703360. Throughput: 0: 9031.0, 1: 8874.9. Samples: 130715952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:33,784][121949] Avg episode reward: [(0, '6017.397'), (1, '3874.136')] [2023-12-26 01:37:33,815][123091] Updated weights for policy 0, policy_version 255931 (0.0010) [2023-12-26 01:37:33,858][123091] Updated weights for policy 0, policy_version 255941 (0.0010) [2023-12-26 01:37:33,902][123091] Updated weights for policy 0, policy_version 255951 (0.0010) [2023-12-26 01:37:34,209][123090] Updated weights for policy 1, policy_version 254630 (0.0008) [2023-12-26 01:37:34,277][123090] Updated weights for policy 1, policy_version 254640 (0.0011) [2023-12-26 01:37:34,345][123090] Updated weights for policy 1, policy_version 254650 (0.0011) [2023-12-26 01:37:34,809][123091] Updated weights for policy 0, policy_version 255961 (0.0009) [2023-12-26 01:37:34,883][123091] Updated weights for policy 0, policy_version 255971 (0.0010) [2023-12-26 01:37:34,953][123091] Updated weights for policy 0, policy_version 255981 (0.0010) [2023-12-26 01:37:35,091][123090] Updated weights for policy 1, policy_version 254660 (0.0009) [2023-12-26 01:37:35,158][123090] Updated weights for policy 1, policy_version 254670 (0.0005) [2023-12-26 01:37:35,219][123090] Updated weights for policy 1, policy_version 254680 (0.0007) [2023-12-26 01:37:35,801][123091] Updated weights for policy 0, policy_version 255991 (0.0009) [2023-12-26 01:37:35,866][123091] Updated weights for policy 0, policy_version 256001 (0.0009) [2023-12-26 01:37:35,924][123091] Updated weights for policy 0, policy_version 256011 (0.0009) [2023-12-26 01:37:35,996][123090] Updated weights for policy 1, policy_version 254690 (0.0010) [2023-12-26 01:37:36,063][123090] Updated weights for policy 1, policy_version 254700 (0.0011) [2023-12-26 01:37:36,114][123090] Updated weights for policy 1, policy_version 254710 (0.0010) [2023-12-26 01:37:36,172][123090] Updated weights for policy 1, policy_version 254720 (0.0010) [2023-12-26 01:37:36,692][123091] Updated weights for policy 0, policy_version 256021 (0.0006) [2023-12-26 01:37:36,753][123091] Updated weights for policy 0, policy_version 256031 (0.0005) [2023-12-26 01:37:36,821][123091] Updated weights for policy 0, policy_version 256041 (0.0005) [2023-12-26 01:37:37,013][123090] Updated weights for policy 1, policy_version 254730 (0.0006) [2023-12-26 01:37:37,081][123090] Updated weights for policy 1, policy_version 254740 (0.0005) [2023-12-26 01:37:37,159][123090] Updated weights for policy 1, policy_version 254750 (0.0006) [2023-12-26 01:37:37,461][123091] Updated weights for policy 0, policy_version 256051 (0.0007) [2023-12-26 01:37:37,518][123091] Updated weights for policy 0, policy_version 256061 (0.0008) [2023-12-26 01:37:37,566][123091] Updated weights for policy 0, policy_version 256071 (0.0005) [2023-12-26 01:37:37,829][123090] Updated weights for policy 1, policy_version 254760 (0.0010) [2023-12-26 01:37:37,882][123090] Updated weights for policy 1, policy_version 254770 (0.0011) [2023-12-26 01:37:37,931][123090] Updated weights for policy 1, policy_version 254780 (0.0010) [2023-12-26 01:37:38,221][123091] Updated weights for policy 0, policy_version 256081 (0.0006) [2023-12-26 01:37:38,278][123091] Updated weights for policy 0, policy_version 256091 (0.0009) [2023-12-26 01:37:38,341][123091] Updated weights for policy 0, policy_version 256101 (0.0009) [2023-12-26 01:37:38,412][123091] Updated weights for policy 0, policy_version 256111 (0.0010) [2023-12-26 01:37:38,750][123090] Updated weights for policy 1, policy_version 254790 (0.0008) [2023-12-26 01:37:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 130793472. Throughput: 0: 8999.4, 1: 8917.1. Samples: 130769176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:38,785][121949] Avg episode reward: [(0, '6014.775'), (1, '3932.604')] [2023-12-26 01:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000256112_65568768.pth... [2023-12-26 01:37:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000255056_65298432.pth [2023-12-26 01:37:38,815][123090] Updated weights for policy 1, policy_version 254800 (0.0010) [2023-12-26 01:37:38,883][123090] Updated weights for policy 1, policy_version 254810 (0.0011) [2023-12-26 01:37:38,921][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000254816_65232896.pth... [2023-12-26 01:37:38,925][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000253792_64970752.pth [2023-12-26 01:37:39,191][123091] Updated weights for policy 0, policy_version 256121 (0.0006) [2023-12-26 01:37:39,257][123091] Updated weights for policy 0, policy_version 256132 (0.0008) [2023-12-26 01:37:39,317][123091] Updated weights for policy 0, policy_version 256142 (0.0009) [2023-12-26 01:37:39,668][123090] Updated weights for policy 1, policy_version 254820 (0.0009) [2023-12-26 01:37:39,738][123090] Updated weights for policy 1, policy_version 254830 (0.0007) [2023-12-26 01:37:39,811][123090] Updated weights for policy 1, policy_version 254840 (0.0006) [2023-12-26 01:37:40,189][123091] Updated weights for policy 0, policy_version 256152 (0.0009) [2023-12-26 01:37:40,243][123091] Updated weights for policy 0, policy_version 256162 (0.0010) [2023-12-26 01:37:40,307][123091] Updated weights for policy 0, policy_version 256172 (0.0010) [2023-12-26 01:37:40,481][123090] Updated weights for policy 1, policy_version 254850 (0.0007) [2023-12-26 01:37:40,535][123090] Updated weights for policy 1, policy_version 254860 (0.0005) [2023-12-26 01:37:40,598][123090] Updated weights for policy 1, policy_version 254870 (0.0006) [2023-12-26 01:37:40,665][123090] Updated weights for policy 1, policy_version 254880 (0.0006) [2023-12-26 01:37:41,277][123091] Updated weights for policy 0, policy_version 256182 (0.0009) [2023-12-26 01:37:41,344][123091] Updated weights for policy 0, policy_version 256192 (0.0006) [2023-12-26 01:37:41,389][123090] Updated weights for policy 1, policy_version 254890 (0.0009) [2023-12-26 01:37:41,419][123091] Updated weights for policy 0, policy_version 256202 (0.0009) [2023-12-26 01:37:41,459][123090] Updated weights for policy 1, policy_version 254900 (0.0011) [2023-12-26 01:37:41,534][123090] Updated weights for policy 1, policy_version 254910 (0.0011) [2023-12-26 01:37:42,146][123091] Updated weights for policy 0, policy_version 256212 (0.0007) [2023-12-26 01:37:42,206][123091] Updated weights for policy 0, policy_version 256222 (0.0010) [2023-12-26 01:37:42,268][123091] Updated weights for policy 0, policy_version 256232 (0.0009) [2023-12-26 01:37:42,352][123090] Updated weights for policy 1, policy_version 254920 (0.0009) [2023-12-26 01:37:42,420][123090] Updated weights for policy 1, policy_version 254930 (0.0009) [2023-12-26 01:37:42,487][123090] Updated weights for policy 1, policy_version 254940 (0.0010) [2023-12-26 01:37:43,024][123091] Updated weights for policy 0, policy_version 256242 (0.0009) [2023-12-26 01:37:43,090][123091] Updated weights for policy 0, policy_version 256252 (0.0010) [2023-12-26 01:37:43,155][123091] Updated weights for policy 0, policy_version 256262 (0.0010) [2023-12-26 01:37:43,223][123091] Updated weights for policy 0, policy_version 256272 (0.0009) [2023-12-26 01:37:43,300][123090] Updated weights for policy 1, policy_version 254950 (0.0010) [2023-12-26 01:37:43,365][123090] Updated weights for policy 1, policy_version 254960 (0.0009) [2023-12-26 01:37:43,435][123090] Updated weights for policy 1, policy_version 254970 (0.0010) [2023-12-26 01:37:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 130883584. Throughput: 0: 8920.9, 1: 8857.9. Samples: 130876284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:43,785][121949] Avg episode reward: [(0, '6115.810'), (1, '3997.469')] [2023-12-26 01:37:44,013][123091] Updated weights for policy 0, policy_version 256282 (0.0006) [2023-12-26 01:37:44,067][123091] Updated weights for policy 0, policy_version 256292 (0.0006) [2023-12-26 01:37:44,124][123091] Updated weights for policy 0, policy_version 256302 (0.0007) [2023-12-26 01:37:44,143][123090] Updated weights for policy 1, policy_version 254980 (0.0009) [2023-12-26 01:37:44,213][123090] Updated weights for policy 1, policy_version 254990 (0.0008) [2023-12-26 01:37:44,265][123090] Updated weights for policy 1, policy_version 255000 (0.0005) [2023-12-26 01:37:44,875][123091] Updated weights for policy 0, policy_version 256312 (0.0008) [2023-12-26 01:37:44,930][123091] Updated weights for policy 0, policy_version 256322 (0.0008) [2023-12-26 01:37:44,994][123091] Updated weights for policy 0, policy_version 256332 (0.0008) [2023-12-26 01:37:45,036][123090] Updated weights for policy 1, policy_version 255010 (0.0006) [2023-12-26 01:37:45,111][123090] Updated weights for policy 1, policy_version 255020 (0.0010) [2023-12-26 01:37:45,170][123090] Updated weights for policy 1, policy_version 255030 (0.0010) [2023-12-26 01:37:45,234][123090] Updated weights for policy 1, policy_version 255040 (0.0010) [2023-12-26 01:37:45,808][123091] Updated weights for policy 0, policy_version 256342 (0.0008) [2023-12-26 01:37:45,871][123091] Updated weights for policy 0, policy_version 256352 (0.0009) [2023-12-26 01:37:45,933][123091] Updated weights for policy 0, policy_version 256362 (0.0008) [2023-12-26 01:37:46,018][123090] Updated weights for policy 1, policy_version 255050 (0.0011) [2023-12-26 01:37:46,074][123090] Updated weights for policy 1, policy_version 255060 (0.0010) [2023-12-26 01:37:46,123][123090] Updated weights for policy 1, policy_version 255070 (0.0010) [2023-12-26 01:37:46,745][123091] Updated weights for policy 0, policy_version 256372 (0.0009) [2023-12-26 01:37:46,797][123091] Updated weights for policy 0, policy_version 256382 (0.0009) [2023-12-26 01:37:46,845][123091] Updated weights for policy 0, policy_version 256392 (0.0009) [2023-12-26 01:37:46,924][123090] Updated weights for policy 1, policy_version 255080 (0.0010) [2023-12-26 01:37:46,983][123090] Updated weights for policy 1, policy_version 255090 (0.0010) [2023-12-26 01:37:47,042][123090] Updated weights for policy 1, policy_version 255100 (0.0010) [2023-12-26 01:37:47,691][123091] Updated weights for policy 0, policy_version 256402 (0.0009) [2023-12-26 01:37:47,740][123091] Updated weights for policy 0, policy_version 256412 (0.0009) [2023-12-26 01:37:47,741][123090] Updated weights for policy 1, policy_version 255110 (0.0010) [2023-12-26 01:37:47,791][123091] Updated weights for policy 0, policy_version 256422 (0.0007) [2023-12-26 01:37:47,805][123090] Updated weights for policy 1, policy_version 255120 (0.0010) [2023-12-26 01:37:47,845][123091] Updated weights for policy 0, policy_version 256432 (0.0009) [2023-12-26 01:37:47,859][123090] Updated weights for policy 1, policy_version 255130 (0.0010) [2023-12-26 01:37:48,580][123090] Updated weights for policy 1, policy_version 255140 (0.0008) [2023-12-26 01:37:48,599][123091] Updated weights for policy 0, policy_version 256442 (0.0010) [2023-12-26 01:37:48,645][123090] Updated weights for policy 1, policy_version 255150 (0.0007) [2023-12-26 01:37:48,659][123091] Updated weights for policy 0, policy_version 256452 (0.0011) [2023-12-26 01:37:48,712][123090] Updated weights for policy 1, policy_version 255160 (0.0007) [2023-12-26 01:37:48,718][123091] Updated weights for policy 0, policy_version 256462 (0.0010) [2023-12-26 01:37:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 130981888. Throughput: 0: 8954.5, 1: 8904.9. Samples: 130986160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:48,785][121949] Avg episode reward: [(0, '6058.849'), (1, '3754.153')] [2023-12-26 01:37:49,439][123091] Updated weights for policy 0, policy_version 256472 (0.0007) [2023-12-26 01:37:49,511][123091] Updated weights for policy 0, policy_version 256482 (0.0009) [2023-12-26 01:37:49,572][123090] Updated weights for policy 1, policy_version 255170 (0.0008) [2023-12-26 01:37:49,574][123091] Updated weights for policy 0, policy_version 256492 (0.0011) [2023-12-26 01:37:49,621][123090] Updated weights for policy 1, policy_version 255180 (0.0006) [2023-12-26 01:37:49,676][123090] Updated weights for policy 1, policy_version 255190 (0.0009) [2023-12-26 01:37:49,741][123090] Updated weights for policy 1, policy_version 255200 (0.0008) [2023-12-26 01:37:50,337][123091] Updated weights for policy 0, policy_version 256502 (0.0011) [2023-12-26 01:37:50,394][123091] Updated weights for policy 0, policy_version 256512 (0.0009) [2023-12-26 01:37:50,451][123091] Updated weights for policy 0, policy_version 256522 (0.0006) [2023-12-26 01:37:50,486][123090] Updated weights for policy 1, policy_version 255210 (0.0006) [2023-12-26 01:37:50,562][123090] Updated weights for policy 1, policy_version 255220 (0.0007) [2023-12-26 01:37:50,637][123090] Updated weights for policy 1, policy_version 255230 (0.0007) [2023-12-26 01:37:51,285][123091] Updated weights for policy 0, policy_version 256532 (0.0006) [2023-12-26 01:37:51,339][123090] Updated weights for policy 1, policy_version 255240 (0.0010) [2023-12-26 01:37:51,365][123091] Updated weights for policy 0, policy_version 256542 (0.0007) [2023-12-26 01:37:51,428][123090] Updated weights for policy 1, policy_version 255250 (0.0009) [2023-12-26 01:37:51,433][123091] Updated weights for policy 0, policy_version 256552 (0.0009) [2023-12-26 01:37:51,493][123090] Updated weights for policy 1, policy_version 255260 (0.0007) [2023-12-26 01:37:52,191][123091] Updated weights for policy 0, policy_version 256562 (0.0008) [2023-12-26 01:37:52,264][123091] Updated weights for policy 0, policy_version 256572 (0.0006) [2023-12-26 01:37:52,311][123090] Updated weights for policy 1, policy_version 255270 (0.0008) [2023-12-26 01:37:52,322][123091] Updated weights for policy 0, policy_version 256582 (0.0008) [2023-12-26 01:37:52,376][123090] Updated weights for policy 1, policy_version 255280 (0.0011) [2023-12-26 01:37:52,389][123091] Updated weights for policy 0, policy_version 256592 (0.0009) [2023-12-26 01:37:52,432][123090] Updated weights for policy 1, policy_version 255290 (0.0010) [2023-12-26 01:37:53,118][123090] Updated weights for policy 1, policy_version 255300 (0.0005) [2023-12-26 01:37:53,185][123090] Updated weights for policy 1, policy_version 255310 (0.0005) [2023-12-26 01:37:53,189][123091] Updated weights for policy 0, policy_version 256602 (0.0011) [2023-12-26 01:37:53,252][123091] Updated weights for policy 0, policy_version 256612 (0.0011) [2023-12-26 01:37:53,258][123090] Updated weights for policy 1, policy_version 255320 (0.0005) [2023-12-26 01:37:53,316][123091] Updated weights for policy 0, policy_version 256622 (0.0011) [2023-12-26 01:37:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 131063808. Throughput: 0: 8957.3, 1: 8849.3. Samples: 131040512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:53,785][121949] Avg episode reward: [(0, '5913.097'), (1, '3613.521')] [2023-12-26 01:37:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000256624_65699840.pth... [2023-12-26 01:37:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000255328_65363968.pth... [2023-12-26 01:37:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000255568_65429504.pth [2023-12-26 01:37:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000254272_65093632.pth [2023-12-26 01:37:53,932][123090] Updated weights for policy 1, policy_version 255330 (0.0007) [2023-12-26 01:37:53,997][123090] Updated weights for policy 1, policy_version 255340 (0.0007) [2023-12-26 01:37:54,057][123090] Updated weights for policy 1, policy_version 255350 (0.0005) [2023-12-26 01:37:54,122][123090] Updated weights for policy 1, policy_version 255360 (0.0006) [2023-12-26 01:37:54,126][123091] Updated weights for policy 0, policy_version 256632 (0.0010) [2023-12-26 01:37:54,177][123091] Updated weights for policy 0, policy_version 256642 (0.0005) [2023-12-26 01:37:54,232][123091] Updated weights for policy 0, policy_version 256652 (0.0006) [2023-12-26 01:37:54,823][123090] Updated weights for policy 1, policy_version 255370 (0.0010) [2023-12-26 01:37:54,877][123090] Updated weights for policy 1, policy_version 255380 (0.0010) [2023-12-26 01:37:54,929][123090] Updated weights for policy 1, policy_version 255390 (0.0008) [2023-12-26 01:37:54,949][123091] Updated weights for policy 0, policy_version 256662 (0.0006) [2023-12-26 01:37:55,014][123091] Updated weights for policy 0, policy_version 256672 (0.0006) [2023-12-26 01:37:55,064][123091] Updated weights for policy 0, policy_version 256682 (0.0005) [2023-12-26 01:37:55,744][123091] Updated weights for policy 0, policy_version 256692 (0.0007) [2023-12-26 01:37:55,807][123091] Updated weights for policy 0, policy_version 256702 (0.0009) [2023-12-26 01:37:55,811][123090] Updated weights for policy 1, policy_version 255400 (0.0010) [2023-12-26 01:37:55,872][123091] Updated weights for policy 0, policy_version 256712 (0.0010) [2023-12-26 01:37:55,875][123090] Updated weights for policy 1, policy_version 255410 (0.0008) [2023-12-26 01:37:55,940][123090] Updated weights for policy 1, policy_version 255420 (0.0009) [2023-12-26 01:37:56,708][123091] Updated weights for policy 0, policy_version 256722 (0.0009) [2023-12-26 01:37:56,742][123090] Updated weights for policy 1, policy_version 255430 (0.0009) [2023-12-26 01:37:56,759][123091] Updated weights for policy 0, policy_version 256732 (0.0008) [2023-12-26 01:37:56,795][123090] Updated weights for policy 1, policy_version 255440 (0.0010) [2023-12-26 01:37:56,810][123091] Updated weights for policy 0, policy_version 256742 (0.0008) [2023-12-26 01:37:56,844][123090] Updated weights for policy 1, policy_version 255450 (0.0008) [2023-12-26 01:37:56,862][123091] Updated weights for policy 0, policy_version 256752 (0.0009) [2023-12-26 01:37:57,665][123091] Updated weights for policy 0, policy_version 256762 (0.0010) [2023-12-26 01:37:57,682][123090] Updated weights for policy 1, policy_version 255460 (0.0008) [2023-12-26 01:37:57,715][123091] Updated weights for policy 0, policy_version 256772 (0.0009) [2023-12-26 01:37:57,744][123090] Updated weights for policy 1, policy_version 255470 (0.0008) [2023-12-26 01:37:57,763][123091] Updated weights for policy 0, policy_version 256782 (0.0007) [2023-12-26 01:37:57,794][123090] Updated weights for policy 1, policy_version 255480 (0.0008) [2023-12-26 01:37:58,661][123091] Updated weights for policy 0, policy_version 256792 (0.0009) [2023-12-26 01:37:58,664][123090] Updated weights for policy 1, policy_version 255490 (0.0009) [2023-12-26 01:37:58,725][123091] Updated weights for policy 0, policy_version 256802 (0.0008) [2023-12-26 01:37:58,734][123090] Updated weights for policy 1, policy_version 255500 (0.0008) [2023-12-26 01:37:58,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 131145728. Throughput: 0: 9053.2, 1: 8894.4. Samples: 131149516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:37:58,786][121949] Avg episode reward: [(0, '5933.909'), (1, '3883.335')] [2023-12-26 01:37:58,792][123091] Updated weights for policy 0, policy_version 256812 (0.0008) [2023-12-26 01:37:58,801][123090] Updated weights for policy 1, policy_version 255510 (0.0008) [2023-12-26 01:37:58,869][123090] Updated weights for policy 1, policy_version 255520 (0.0007) [2023-12-26 01:37:59,519][123091] Updated weights for policy 0, policy_version 256822 (0.0008) [2023-12-26 01:37:59,589][123091] Updated weights for policy 0, policy_version 256832 (0.0008) [2023-12-26 01:37:59,618][123090] Updated weights for policy 1, policy_version 255530 (0.0006) [2023-12-26 01:37:59,649][123091] Updated weights for policy 0, policy_version 256842 (0.0008) [2023-12-26 01:37:59,672][123090] Updated weights for policy 1, policy_version 255540 (0.0008) [2023-12-26 01:37:59,736][123090] Updated weights for policy 1, policy_version 255550 (0.0008) [2023-12-26 01:38:00,312][123091] Updated weights for policy 0, policy_version 256852 (0.0007) [2023-12-26 01:38:00,365][123091] Updated weights for policy 0, policy_version 256862 (0.0009) [2023-12-26 01:38:00,418][123091] Updated weights for policy 0, policy_version 256873 (0.0009) [2023-12-26 01:38:00,550][123090] Updated weights for policy 1, policy_version 255560 (0.0006) [2023-12-26 01:38:00,597][123090] Updated weights for policy 1, policy_version 255570 (0.0005) [2023-12-26 01:38:00,656][123090] Updated weights for policy 1, policy_version 255580 (0.0005) [2023-12-26 01:38:01,188][123091] Updated weights for policy 0, policy_version 256883 (0.0008) [2023-12-26 01:38:01,248][123091] Updated weights for policy 0, policy_version 256893 (0.0006) [2023-12-26 01:38:01,315][123091] Updated weights for policy 0, policy_version 256903 (0.0008) [2023-12-26 01:38:01,338][123090] Updated weights for policy 1, policy_version 255590 (0.0008) [2023-12-26 01:38:01,415][123090] Updated weights for policy 1, policy_version 255600 (0.0010) [2023-12-26 01:38:01,481][123090] Updated weights for policy 1, policy_version 255610 (0.0010) [2023-12-26 01:38:02,130][123091] Updated weights for policy 0, policy_version 256913 (0.0008) [2023-12-26 01:38:02,194][123091] Updated weights for policy 0, policy_version 256923 (0.0009) [2023-12-26 01:38:02,264][123091] Updated weights for policy 0, policy_version 256933 (0.0007) [2023-12-26 01:38:02,265][123090] Updated weights for policy 1, policy_version 255620 (0.0010) [2023-12-26 01:38:02,332][123091] Updated weights for policy 0, policy_version 256943 (0.0006) [2023-12-26 01:38:02,335][123090] Updated weights for policy 1, policy_version 255630 (0.0008) [2023-12-26 01:38:02,402][123090] Updated weights for policy 1, policy_version 255640 (0.0008) [2023-12-26 01:38:03,101][123091] Updated weights for policy 0, policy_version 256953 (0.0008) [2023-12-26 01:38:03,148][123091] Updated weights for policy 0, policy_version 256963 (0.0008) [2023-12-26 01:38:03,199][123091] Updated weights for policy 0, policy_version 256973 (0.0009) [2023-12-26 01:38:03,202][123090] Updated weights for policy 1, policy_version 255650 (0.0008) [2023-12-26 01:38:03,256][123090] Updated weights for policy 1, policy_version 255660 (0.0010) [2023-12-26 01:38:03,304][123090] Updated weights for policy 1, policy_version 255670 (0.0010) [2023-12-26 01:38:03,347][123090] Updated weights for policy 1, policy_version 255680 (0.0010) [2023-12-26 01:38:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 131244032. Throughput: 0: 8995.8, 1: 8956.0. Samples: 131256388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:38:03,785][121949] Avg episode reward: [(0, '5995.421'), (1, '3845.098')] [2023-12-26 01:38:04,058][123090] Updated weights for policy 1, policy_version 255690 (0.0008) [2023-12-26 01:38:04,109][123091] Updated weights for policy 0, policy_version 256983 (0.0007) [2023-12-26 01:38:04,123][123090] Updated weights for policy 1, policy_version 255700 (0.0011) [2023-12-26 01:38:04,169][123091] Updated weights for policy 0, policy_version 256993 (0.0007) [2023-12-26 01:38:04,187][123090] Updated weights for policy 1, policy_version 255710 (0.0011) [2023-12-26 01:38:04,217][123091] Updated weights for policy 0, policy_version 257003 (0.0010) [2023-12-26 01:38:04,945][123091] Updated weights for policy 0, policy_version 257013 (0.0007) [2023-12-26 01:38:04,956][123090] Updated weights for policy 1, policy_version 255720 (0.0009) [2023-12-26 01:38:04,996][123091] Updated weights for policy 0, policy_version 257023 (0.0005) [2023-12-26 01:38:05,015][123090] Updated weights for policy 1, policy_version 255730 (0.0010) [2023-12-26 01:38:05,048][123091] Updated weights for policy 0, policy_version 257033 (0.0006) [2023-12-26 01:38:05,075][123090] Updated weights for policy 1, policy_version 255740 (0.0010) [2023-12-26 01:38:05,634][123091] Updated weights for policy 0, policy_version 257043 (0.0005) [2023-12-26 01:38:05,682][123091] Updated weights for policy 0, policy_version 257053 (0.0005) [2023-12-26 01:38:05,732][123091] Updated weights for policy 0, policy_version 257063 (0.0005) [2023-12-26 01:38:05,743][123090] Updated weights for policy 1, policy_version 255750 (0.0007) [2023-12-26 01:38:05,807][123090] Updated weights for policy 1, policy_version 255760 (0.0005) [2023-12-26 01:38:05,881][123090] Updated weights for policy 1, policy_version 255770 (0.0007) [2023-12-26 01:38:06,511][123091] Updated weights for policy 0, policy_version 257073 (0.0005) [2023-12-26 01:38:06,574][123091] Updated weights for policy 0, policy_version 257083 (0.0006) [2023-12-26 01:38:06,637][123091] Updated weights for policy 0, policy_version 257093 (0.0007) [2023-12-26 01:38:06,686][123091] Updated weights for policy 0, policy_version 257103 (0.0008) [2023-12-26 01:38:06,717][123090] Updated weights for policy 1, policy_version 255780 (0.0009) [2023-12-26 01:38:06,778][123090] Updated weights for policy 1, policy_version 255790 (0.0009) [2023-12-26 01:38:06,836][123090] Updated weights for policy 1, policy_version 255800 (0.0009) [2023-12-26 01:38:07,450][123091] Updated weights for policy 0, policy_version 257113 (0.0009) [2023-12-26 01:38:07,519][123091] Updated weights for policy 0, policy_version 257123 (0.0007) [2023-12-26 01:38:07,581][123091] Updated weights for policy 0, policy_version 257133 (0.0006) [2023-12-26 01:38:07,747][123090] Updated weights for policy 1, policy_version 255810 (0.0010) [2023-12-26 01:38:07,797][123090] Updated weights for policy 1, policy_version 255820 (0.0008) [2023-12-26 01:38:07,845][123090] Updated weights for policy 1, policy_version 255830 (0.0005) [2023-12-26 01:38:07,901][123090] Updated weights for policy 1, policy_version 255840 (0.0006) [2023-12-26 01:38:08,290][123091] Updated weights for policy 0, policy_version 257143 (0.0008) [2023-12-26 01:38:08,345][123091] Updated weights for policy 0, policy_version 257153 (0.0008) [2023-12-26 01:38:08,413][123091] Updated weights for policy 0, policy_version 257163 (0.0010) [2023-12-26 01:38:08,687][123090] Updated weights for policy 1, policy_version 255850 (0.0008) [2023-12-26 01:38:08,760][123090] Updated weights for policy 1, policy_version 255860 (0.0010) [2023-12-26 01:38:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 131334144. Throughput: 0: 9073.9, 1: 8989.0. Samples: 131312792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:38:08,785][121949] Avg episode reward: [(0, '6059.805'), (1, '3891.463')] [2023-12-26 01:38:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000257168_65839104.pth... [2023-12-26 01:38:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000256112_65568768.pth [2023-12-26 01:38:08,825][123090] Updated weights for policy 1, policy_version 255870 (0.0009) [2023-12-26 01:38:08,838][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000255872_65503232.pth... [2023-12-26 01:38:08,843][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000254816_65232896.pth [2023-12-26 01:38:09,092][123091] Updated weights for policy 0, policy_version 257173 (0.0007) [2023-12-26 01:38:09,164][123091] Updated weights for policy 0, policy_version 257183 (0.0008) [2023-12-26 01:38:09,232][123091] Updated weights for policy 0, policy_version 257193 (0.0008) [2023-12-26 01:38:09,534][123090] Updated weights for policy 1, policy_version 255880 (0.0008) [2023-12-26 01:38:09,629][123090] Updated weights for policy 1, policy_version 255890 (0.0008) [2023-12-26 01:38:09,700][123090] Updated weights for policy 1, policy_version 255900 (0.0007) [2023-12-26 01:38:10,070][123091] Updated weights for policy 0, policy_version 257203 (0.0009) [2023-12-26 01:38:10,130][123091] Updated weights for policy 0, policy_version 257213 (0.0010) [2023-12-26 01:38:10,185][123091] Updated weights for policy 0, policy_version 257223 (0.0010) [2023-12-26 01:38:10,412][123090] Updated weights for policy 1, policy_version 255910 (0.0006) [2023-12-26 01:38:10,492][123090] Updated weights for policy 1, policy_version 255920 (0.0006) [2023-12-26 01:38:10,553][123090] Updated weights for policy 1, policy_version 255930 (0.0005) [2023-12-26 01:38:11,056][123091] Updated weights for policy 0, policy_version 257233 (0.0010) [2023-12-26 01:38:11,122][123091] Updated weights for policy 0, policy_version 257243 (0.0010) [2023-12-26 01:38:11,190][123091] Updated weights for policy 0, policy_version 257253 (0.0010) [2023-12-26 01:38:11,193][123090] Updated weights for policy 1, policy_version 255940 (0.0006) [2023-12-26 01:38:11,247][123091] Updated weights for policy 0, policy_version 257263 (0.0010) [2023-12-26 01:38:11,255][123090] Updated weights for policy 1, policy_version 255951 (0.0006) [2023-12-26 01:38:11,307][123090] Updated weights for policy 1, policy_version 255961 (0.0006) [2023-12-26 01:38:12,110][123090] Updated weights for policy 1, policy_version 255971 (0.0008) [2023-12-26 01:38:12,136][123091] Updated weights for policy 0, policy_version 257273 (0.0009) [2023-12-26 01:38:12,173][123090] Updated weights for policy 1, policy_version 255981 (0.0008) [2023-12-26 01:38:12,188][123091] Updated weights for policy 0, policy_version 257284 (0.0008) [2023-12-26 01:38:12,237][123090] Updated weights for policy 1, policy_version 255991 (0.0006) [2023-12-26 01:38:12,239][123091] Updated weights for policy 0, policy_version 257294 (0.0009) [2023-12-26 01:38:13,013][123090] Updated weights for policy 1, policy_version 256001 (0.0007) [2023-12-26 01:38:13,083][123090] Updated weights for policy 1, policy_version 256011 (0.0005) [2023-12-26 01:38:13,101][123091] Updated weights for policy 0, policy_version 257304 (0.0007) [2023-12-26 01:38:13,149][123090] Updated weights for policy 1, policy_version 256021 (0.0008) [2023-12-26 01:38:13,162][123091] Updated weights for policy 0, policy_version 257314 (0.0006) [2023-12-26 01:38:13,209][123090] Updated weights for policy 1, policy_version 256031 (0.0007) [2023-12-26 01:38:13,231][123091] Updated weights for policy 0, policy_version 257324 (0.0007) [2023-12-26 01:38:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 131424256. Throughput: 0: 8994.3, 1: 9054.8. Samples: 131420004. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:38:13,785][121949] Avg episode reward: [(0, '6154.301'), (1, '4262.244')] [2023-12-26 01:38:13,936][123091] Updated weights for policy 0, policy_version 257334 (0.0007) [2023-12-26 01:38:13,938][123090] Updated weights for policy 1, policy_version 256041 (0.0006) [2023-12-26 01:38:13,996][123091] Updated weights for policy 0, policy_version 257344 (0.0005) [2023-12-26 01:38:14,004][123090] Updated weights for policy 1, policy_version 256051 (0.0005) [2023-12-26 01:38:14,058][123090] Updated weights for policy 1, policy_version 256061 (0.0008) [2023-12-26 01:38:14,058][123091] Updated weights for policy 0, policy_version 257354 (0.0009) [2023-12-26 01:38:14,783][123091] Updated weights for policy 0, policy_version 257364 (0.0009) [2023-12-26 01:38:14,843][123090] Updated weights for policy 1, policy_version 256071 (0.0007) [2023-12-26 01:38:14,854][123091] Updated weights for policy 0, policy_version 257374 (0.0007) [2023-12-26 01:38:14,909][123090] Updated weights for policy 1, policy_version 256081 (0.0008) [2023-12-26 01:38:14,920][123091] Updated weights for policy 0, policy_version 257384 (0.0008) [2023-12-26 01:38:14,979][123090] Updated weights for policy 1, policy_version 256091 (0.0008) [2023-12-26 01:38:15,753][123091] Updated weights for policy 0, policy_version 257394 (0.0007) [2023-12-26 01:38:15,773][123090] Updated weights for policy 1, policy_version 256101 (0.0009) [2023-12-26 01:38:15,819][123091] Updated weights for policy 0, policy_version 257404 (0.0007) [2023-12-26 01:38:15,835][123090] Updated weights for policy 1, policy_version 256111 (0.0008) [2023-12-26 01:38:15,880][123091] Updated weights for policy 0, policy_version 257414 (0.0008) [2023-12-26 01:38:15,899][123090] Updated weights for policy 1, policy_version 256121 (0.0008) [2023-12-26 01:38:15,944][123091] Updated weights for policy 0, policy_version 257424 (0.0009) [2023-12-26 01:38:16,682][123090] Updated weights for policy 1, policy_version 256131 (0.0006) [2023-12-26 01:38:16,745][123090] Updated weights for policy 1, policy_version 256141 (0.0008) [2023-12-26 01:38:16,760][123091] Updated weights for policy 0, policy_version 257434 (0.0005) [2023-12-26 01:38:16,797][123090] Updated weights for policy 1, policy_version 256151 (0.0008) [2023-12-26 01:38:16,812][123091] Updated weights for policy 0, policy_version 257444 (0.0005) [2023-12-26 01:38:16,859][123091] Updated weights for policy 0, policy_version 257454 (0.0008) [2023-12-26 01:38:17,636][123090] Updated weights for policy 1, policy_version 256161 (0.0008) [2023-12-26 01:38:17,644][123091] Updated weights for policy 0, policy_version 257464 (0.0009) [2023-12-26 01:38:17,692][123090] Updated weights for policy 1, policy_version 256171 (0.0008) [2023-12-26 01:38:17,707][123091] Updated weights for policy 0, policy_version 257474 (0.0009) [2023-12-26 01:38:17,745][123090] Updated weights for policy 1, policy_version 256181 (0.0007) [2023-12-26 01:38:17,756][123091] Updated weights for policy 0, policy_version 257484 (0.0009) [2023-12-26 01:38:17,790][123090] Updated weights for policy 1, policy_version 256191 (0.0009) [2023-12-26 01:38:18,602][123091] Updated weights for policy 0, policy_version 257494 (0.0009) [2023-12-26 01:38:18,638][123090] Updated weights for policy 1, policy_version 256201 (0.0007) [2023-12-26 01:38:18,663][123091] Updated weights for policy 0, policy_version 257504 (0.0010) [2023-12-26 01:38:18,705][123090] Updated weights for policy 1, policy_version 256211 (0.0008) [2023-12-26 01:38:18,735][123091] Updated weights for policy 0, policy_version 257514 (0.0009) [2023-12-26 01:38:18,765][123090] Updated weights for policy 1, policy_version 256221 (0.0007) [2023-12-26 01:38:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 131522560. Throughput: 0: 8958.2, 1: 9065.3. Samples: 131527012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:18,785][121949] Avg episode reward: [(0, '6139.820'), (1, '4098.305')] [2023-12-26 01:38:19,584][123090] Updated weights for policy 1, policy_version 256231 (0.0008) [2023-12-26 01:38:19,598][123091] Updated weights for policy 0, policy_version 257524 (0.0010) [2023-12-26 01:38:19,648][123091] Updated weights for policy 0, policy_version 257534 (0.0008) [2023-12-26 01:38:19,649][123090] Updated weights for policy 1, policy_version 256241 (0.0009) [2023-12-26 01:38:19,713][123091] Updated weights for policy 0, policy_version 257544 (0.0007) [2023-12-26 01:38:19,715][123090] Updated weights for policy 1, policy_version 256251 (0.0010) [2023-12-26 01:38:20,536][123090] Updated weights for policy 1, policy_version 256261 (0.0009) [2023-12-26 01:38:20,597][123091] Updated weights for policy 0, policy_version 257554 (0.0009) [2023-12-26 01:38:20,600][123090] Updated weights for policy 1, policy_version 256271 (0.0007) [2023-12-26 01:38:20,661][123091] Updated weights for policy 0, policy_version 257564 (0.0007) [2023-12-26 01:38:20,664][123090] Updated weights for policy 1, policy_version 256281 (0.0008) [2023-12-26 01:38:20,723][123091] Updated weights for policy 0, policy_version 257574 (0.0010) [2023-12-26 01:38:20,781][123091] Updated weights for policy 0, policy_version 257584 (0.0010) [2023-12-26 01:38:21,564][123090] Updated weights for policy 1, policy_version 256291 (0.0008) [2023-12-26 01:38:21,615][123091] Updated weights for policy 0, policy_version 257594 (0.0006) [2023-12-26 01:38:21,629][123090] Updated weights for policy 1, policy_version 256301 (0.0008) [2023-12-26 01:38:21,681][123091] Updated weights for policy 0, policy_version 257604 (0.0008) [2023-12-26 01:38:21,696][123090] Updated weights for policy 1, policy_version 256311 (0.0008) [2023-12-26 01:38:21,747][123091] Updated weights for policy 0, policy_version 257614 (0.0007) [2023-12-26 01:38:22,412][123090] Updated weights for policy 1, policy_version 256321 (0.0008) [2023-12-26 01:38:22,481][123090] Updated weights for policy 1, policy_version 256331 (0.0009) [2023-12-26 01:38:22,551][123090] Updated weights for policy 1, policy_version 256341 (0.0009) [2023-12-26 01:38:22,596][123091] Updated weights for policy 0, policy_version 257624 (0.0011) [2023-12-26 01:38:22,612][123090] Updated weights for policy 1, policy_version 256351 (0.0006) [2023-12-26 01:38:22,662][123091] Updated weights for policy 0, policy_version 257634 (0.0009) [2023-12-26 01:38:22,727][123091] Updated weights for policy 0, policy_version 257644 (0.0011) [2023-12-26 01:38:23,445][123091] Updated weights for policy 0, policy_version 257654 (0.0007) [2023-12-26 01:38:23,517][123091] Updated weights for policy 0, policy_version 257664 (0.0011) [2023-12-26 01:38:23,527][123090] Updated weights for policy 1, policy_version 256361 (0.0006) [2023-12-26 01:38:23,571][123091] Updated weights for policy 0, policy_version 257674 (0.0009) [2023-12-26 01:38:23,594][123090] Updated weights for policy 1, policy_version 256371 (0.0008) [2023-12-26 01:38:23,659][123090] Updated weights for policy 1, policy_version 256381 (0.0010) [2023-12-26 01:38:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 131604480. Throughput: 0: 8947.3, 1: 9007.7. Samples: 131577156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:23,785][121949] Avg episode reward: [(0, '6133.661'), (1, '4228.938')] [2023-12-26 01:38:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000256384_65634304.pth... [2023-12-26 01:38:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000257680_65970176.pth... [2023-12-26 01:38:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000255328_65363968.pth [2023-12-26 01:38:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000256624_65699840.pth [2023-12-26 01:38:24,207][123091] Updated weights for policy 0, policy_version 257684 (0.0005) [2023-12-26 01:38:24,259][123091] Updated weights for policy 0, policy_version 257694 (0.0005) [2023-12-26 01:38:24,309][123091] Updated weights for policy 0, policy_version 257704 (0.0005) [2023-12-26 01:38:24,484][123090] Updated weights for policy 1, policy_version 256391 (0.0009) [2023-12-26 01:38:24,548][123090] Updated weights for policy 1, policy_version 256401 (0.0008) [2023-12-26 01:38:24,616][123090] Updated weights for policy 1, policy_version 256411 (0.0008) [2023-12-26 01:38:25,109][123091] Updated weights for policy 0, policy_version 257714 (0.0008) [2023-12-26 01:38:25,157][123091] Updated weights for policy 0, policy_version 257724 (0.0009) [2023-12-26 01:38:25,205][123091] Updated weights for policy 0, policy_version 257734 (0.0009) [2023-12-26 01:38:25,255][123091] Updated weights for policy 0, policy_version 257744 (0.0010) [2023-12-26 01:38:25,449][123090] Updated weights for policy 1, policy_version 256421 (0.0009) [2023-12-26 01:38:25,518][123090] Updated weights for policy 1, policy_version 256431 (0.0010) [2023-12-26 01:38:25,586][123090] Updated weights for policy 1, policy_version 256441 (0.0010) [2023-12-26 01:38:26,055][123091] Updated weights for policy 0, policy_version 257754 (0.0010) [2023-12-26 01:38:26,104][123091] Updated weights for policy 0, policy_version 257764 (0.0010) [2023-12-26 01:38:26,151][123091] Updated weights for policy 0, policy_version 257774 (0.0010) [2023-12-26 01:38:26,434][123090] Updated weights for policy 1, policy_version 256451 (0.0009) [2023-12-26 01:38:26,495][123090] Updated weights for policy 1, policy_version 256461 (0.0008) [2023-12-26 01:38:26,551][123090] Updated weights for policy 1, policy_version 256471 (0.0009) [2023-12-26 01:38:27,001][123091] Updated weights for policy 0, policy_version 257784 (0.0010) [2023-12-26 01:38:27,051][123091] Updated weights for policy 0, policy_version 257794 (0.0010) [2023-12-26 01:38:27,098][123091] Updated weights for policy 0, policy_version 257804 (0.0010) [2023-12-26 01:38:27,404][123090] Updated weights for policy 1, policy_version 256481 (0.0009) [2023-12-26 01:38:27,470][123090] Updated weights for policy 1, policy_version 256491 (0.0009) [2023-12-26 01:38:27,530][123090] Updated weights for policy 1, policy_version 256501 (0.0009) [2023-12-26 01:38:27,590][123090] Updated weights for policy 1, policy_version 256511 (0.0009) [2023-12-26 01:38:27,849][123091] Updated weights for policy 0, policy_version 257814 (0.0007) [2023-12-26 01:38:27,898][123091] Updated weights for policy 0, policy_version 257824 (0.0008) [2023-12-26 01:38:27,944][123091] Updated weights for policy 0, policy_version 257834 (0.0008) [2023-12-26 01:38:28,381][123090] Updated weights for policy 1, policy_version 256521 (0.0007) [2023-12-26 01:38:28,445][123090] Updated weights for policy 1, policy_version 256531 (0.0009) [2023-12-26 01:38:28,506][123090] Updated weights for policy 1, policy_version 256541 (0.0008) [2023-12-26 01:38:28,676][123091] Updated weights for policy 0, policy_version 257844 (0.0009) [2023-12-26 01:38:28,739][123091] Updated weights for policy 0, policy_version 257854 (0.0009) [2023-12-26 01:38:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 131686400. Throughput: 0: 8969.2, 1: 8904.6. Samples: 131680600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:28,784][121949] Avg episode reward: [(0, '6160.204'), (1, '4008.381')] [2023-12-26 01:38:28,808][123091] Updated weights for policy 0, policy_version 257864 (0.0009) [2023-12-26 01:38:29,266][123090] Updated weights for policy 1, policy_version 256551 (0.0009) [2023-12-26 01:38:29,330][123090] Updated weights for policy 1, policy_version 256561 (0.0009) [2023-12-26 01:38:29,397][123090] Updated weights for policy 1, policy_version 256571 (0.0007) [2023-12-26 01:38:29,663][123091] Updated weights for policy 0, policy_version 257874 (0.0009) [2023-12-26 01:38:29,730][123091] Updated weights for policy 0, policy_version 257884 (0.0010) [2023-12-26 01:38:29,801][123091] Updated weights for policy 0, policy_version 257894 (0.0010) [2023-12-26 01:38:29,868][123091] Updated weights for policy 0, policy_version 257904 (0.0009) [2023-12-26 01:38:30,154][123090] Updated weights for policy 1, policy_version 256581 (0.0005) [2023-12-26 01:38:30,215][123090] Updated weights for policy 1, policy_version 256591 (0.0006) [2023-12-26 01:38:30,268][123090] Updated weights for policy 1, policy_version 256601 (0.0005) [2023-12-26 01:38:30,733][123091] Updated weights for policy 0, policy_version 257914 (0.0011) [2023-12-26 01:38:30,784][123091] Updated weights for policy 0, policy_version 257924 (0.0010) [2023-12-26 01:38:30,831][123091] Updated weights for policy 0, policy_version 257934 (0.0010) [2023-12-26 01:38:31,012][123090] Updated weights for policy 1, policy_version 256611 (0.0007) [2023-12-26 01:38:31,083][123090] Updated weights for policy 1, policy_version 256621 (0.0010) [2023-12-26 01:38:31,137][123090] Updated weights for policy 1, policy_version 256631 (0.0010) [2023-12-26 01:38:31,586][123091] Updated weights for policy 0, policy_version 257944 (0.0010) [2023-12-26 01:38:31,656][123091] Updated weights for policy 0, policy_version 257954 (0.0011) [2023-12-26 01:38:31,725][123091] Updated weights for policy 0, policy_version 257964 (0.0007) [2023-12-26 01:38:32,046][123090] Updated weights for policy 1, policy_version 256641 (0.0009) [2023-12-26 01:38:32,106][123090] Updated weights for policy 1, policy_version 256651 (0.0010) [2023-12-26 01:38:32,167][123090] Updated weights for policy 1, policy_version 256661 (0.0009) [2023-12-26 01:38:32,235][123090] Updated weights for policy 1, policy_version 256671 (0.0009) [2023-12-26 01:38:32,475][123091] Updated weights for policy 0, policy_version 257974 (0.0010) [2023-12-26 01:38:32,538][123091] Updated weights for policy 0, policy_version 257984 (0.0008) [2023-12-26 01:38:32,611][123091] Updated weights for policy 0, policy_version 257994 (0.0005) [2023-12-26 01:38:33,161][123090] Updated weights for policy 1, policy_version 256681 (0.0010) [2023-12-26 01:38:33,218][123090] Updated weights for policy 1, policy_version 256691 (0.0009) [2023-12-26 01:38:33,259][123091] Updated weights for policy 0, policy_version 258004 (0.0006) [2023-12-26 01:38:33,266][123090] Updated weights for policy 1, policy_version 256701 (0.0009) [2023-12-26 01:38:33,319][123091] Updated weights for policy 0, policy_version 258014 (0.0006) [2023-12-26 01:38:33,376][123091] Updated weights for policy 0, policy_version 258024 (0.0008) [2023-12-26 01:38:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 131776512. Throughput: 0: 8991.0, 1: 8813.3. Samples: 131787352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:33,785][121949] Avg episode reward: [(0, '6104.339'), (1, '4038.400')] [2023-12-26 01:38:34,085][123090] Updated weights for policy 1, policy_version 256711 (0.0006) [2023-12-26 01:38:34,101][123091] Updated weights for policy 0, policy_version 258034 (0.0009) [2023-12-26 01:38:34,153][123090] Updated weights for policy 1, policy_version 256721 (0.0006) [2023-12-26 01:38:34,165][123091] Updated weights for policy 0, policy_version 258044 (0.0006) [2023-12-26 01:38:34,210][123090] Updated weights for policy 1, policy_version 256731 (0.0010) [2023-12-26 01:38:34,222][123091] Updated weights for policy 0, policy_version 258054 (0.0010) [2023-12-26 01:38:34,286][123091] Updated weights for policy 0, policy_version 258064 (0.0010) [2023-12-26 01:38:34,976][123090] Updated weights for policy 1, policy_version 256741 (0.0008) [2023-12-26 01:38:35,041][123090] Updated weights for policy 1, policy_version 256751 (0.0006) [2023-12-26 01:38:35,076][123091] Updated weights for policy 0, policy_version 258074 (0.0006) [2023-12-26 01:38:35,093][123090] Updated weights for policy 1, policy_version 256761 (0.0005) [2023-12-26 01:38:35,132][123091] Updated weights for policy 0, policy_version 258084 (0.0006) [2023-12-26 01:38:35,221][123091] Updated weights for policy 0, policy_version 258094 (0.0006) [2023-12-26 01:38:35,831][123090] Updated weights for policy 1, policy_version 256771 (0.0006) [2023-12-26 01:38:35,871][123091] Updated weights for policy 0, policy_version 258104 (0.0007) [2023-12-26 01:38:35,888][123090] Updated weights for policy 1, policy_version 256781 (0.0006) [2023-12-26 01:38:35,918][123091] Updated weights for policy 0, policy_version 258114 (0.0009) [2023-12-26 01:38:35,946][123090] Updated weights for policy 1, policy_version 256791 (0.0005) [2023-12-26 01:38:35,978][123091] Updated weights for policy 0, policy_version 258124 (0.0010) [2023-12-26 01:38:36,642][123090] Updated weights for policy 1, policy_version 256801 (0.0006) [2023-12-26 01:38:36,718][123090] Updated weights for policy 1, policy_version 256811 (0.0006) [2023-12-26 01:38:36,792][123090] Updated weights for policy 1, policy_version 256821 (0.0006) [2023-12-26 01:38:36,829][123091] Updated weights for policy 0, policy_version 258134 (0.0011) [2023-12-26 01:38:36,856][123090] Updated weights for policy 1, policy_version 256831 (0.0006) [2023-12-26 01:38:36,891][123091] Updated weights for policy 0, policy_version 258144 (0.0010) [2023-12-26 01:38:36,953][123091] Updated weights for policy 0, policy_version 258154 (0.0010) [2023-12-26 01:38:37,626][123090] Updated weights for policy 1, policy_version 256841 (0.0009) [2023-12-26 01:38:37,637][123091] Updated weights for policy 0, policy_version 258164 (0.0007) [2023-12-26 01:38:37,689][123091] Updated weights for policy 0, policy_version 258174 (0.0006) [2023-12-26 01:38:37,692][123090] Updated weights for policy 1, policy_version 256851 (0.0008) [2023-12-26 01:38:37,749][123091] Updated weights for policy 0, policy_version 258184 (0.0011) [2023-12-26 01:38:37,761][123090] Updated weights for policy 1, policy_version 256861 (0.0007) [2023-12-26 01:38:38,548][123091] Updated weights for policy 0, policy_version 258194 (0.0011) [2023-12-26 01:38:38,585][123090] Updated weights for policy 1, policy_version 256871 (0.0007) [2023-12-26 01:38:38,608][123091] Updated weights for policy 0, policy_version 258204 (0.0011) [2023-12-26 01:38:38,650][123090] Updated weights for policy 1, policy_version 256881 (0.0006) [2023-12-26 01:38:38,661][123091] Updated weights for policy 0, policy_version 258214 (0.0011) [2023-12-26 01:38:38,715][123090] Updated weights for policy 1, policy_version 256891 (0.0007) [2023-12-26 01:38:38,720][123091] Updated weights for policy 0, policy_version 258224 (0.0011) [2023-12-26 01:38:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 131874816. Throughput: 0: 9007.0, 1: 8854.0. Samples: 131844252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:38,786][121949] Avg episode reward: [(0, '6091.567'), (1, '4187.078')] [2023-12-26 01:38:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000258224_66109440.pth... [2023-12-26 01:38:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000256896_65765376.pth... [2023-12-26 01:38:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000257168_65839104.pth [2023-12-26 01:38:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000255872_65503232.pth [2023-12-26 01:38:39,482][123091] Updated weights for policy 0, policy_version 258234 (0.0013) [2023-12-26 01:38:39,550][123091] Updated weights for policy 0, policy_version 258244 (0.0011) [2023-12-26 01:38:39,617][123091] Updated weights for policy 0, policy_version 258254 (0.0011) [2023-12-26 01:38:39,642][123090] Updated weights for policy 1, policy_version 256901 (0.0009) [2023-12-26 01:38:39,699][123090] Updated weights for policy 1, policy_version 256911 (0.0009) [2023-12-26 01:38:39,768][123090] Updated weights for policy 1, policy_version 256921 (0.0009) [2023-12-26 01:38:40,461][123091] Updated weights for policy 0, policy_version 258264 (0.0007) [2023-12-26 01:38:40,538][123091] Updated weights for policy 0, policy_version 258274 (0.0006) [2023-12-26 01:38:40,609][123091] Updated weights for policy 0, policy_version 258284 (0.0006) [2023-12-26 01:38:40,638][123090] Updated weights for policy 1, policy_version 256931 (0.0008) [2023-12-26 01:38:40,711][123090] Updated weights for policy 1, policy_version 256941 (0.0005) [2023-12-26 01:38:40,773][123090] Updated weights for policy 1, policy_version 256951 (0.0006) [2023-12-26 01:38:41,281][123091] Updated weights for policy 0, policy_version 258294 (0.0008) [2023-12-26 01:38:41,345][123091] Updated weights for policy 0, policy_version 258304 (0.0011) [2023-12-26 01:38:41,421][123091] Updated weights for policy 0, policy_version 258314 (0.0008) [2023-12-26 01:38:41,478][123090] Updated weights for policy 1, policy_version 256961 (0.0006) [2023-12-26 01:38:41,552][123090] Updated weights for policy 1, policy_version 256971 (0.0010) [2023-12-26 01:38:41,628][123090] Updated weights for policy 1, policy_version 256981 (0.0010) [2023-12-26 01:38:41,697][123090] Updated weights for policy 1, policy_version 256991 (0.0007) [2023-12-26 01:38:42,234][123091] Updated weights for policy 0, policy_version 258324 (0.0007) [2023-12-26 01:38:42,306][123091] Updated weights for policy 0, policy_version 258334 (0.0010) [2023-12-26 01:38:42,377][123091] Updated weights for policy 0, policy_version 258344 (0.0015) [2023-12-26 01:38:42,502][123090] Updated weights for policy 1, policy_version 257001 (0.0011) [2023-12-26 01:38:42,555][123090] Updated weights for policy 1, policy_version 257011 (0.0011) [2023-12-26 01:38:42,608][123090] Updated weights for policy 1, policy_version 257021 (0.0010) [2023-12-26 01:38:43,198][123091] Updated weights for policy 0, policy_version 258354 (0.0011) [2023-12-26 01:38:43,254][123091] Updated weights for policy 0, policy_version 258364 (0.0009) [2023-12-26 01:38:43,309][123091] Updated weights for policy 0, policy_version 258374 (0.0008) [2023-12-26 01:38:43,366][123091] Updated weights for policy 0, policy_version 258384 (0.0009) [2023-12-26 01:38:43,488][123090] Updated weights for policy 1, policy_version 257031 (0.0009) [2023-12-26 01:38:43,558][123090] Updated weights for policy 1, policy_version 257041 (0.0006) [2023-12-26 01:38:43,630][123090] Updated weights for policy 1, policy_version 257051 (0.0008) [2023-12-26 01:38:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 131956736. Throughput: 0: 8980.6, 1: 8774.4. Samples: 131948492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:43,784][121949] Avg episode reward: [(0, '6224.038'), (1, '4023.529')] [2023-12-26 01:38:43,785][123007] Saving new best policy, reward=6224.038! [2023-12-26 01:38:44,180][123091] Updated weights for policy 0, policy_version 258394 (0.0010) [2023-12-26 01:38:44,238][123091] Updated weights for policy 0, policy_version 258404 (0.0010) [2023-12-26 01:38:44,298][123091] Updated weights for policy 0, policy_version 258414 (0.0009) [2023-12-26 01:38:44,346][123090] Updated weights for policy 1, policy_version 257061 (0.0007) [2023-12-26 01:38:44,415][123090] Updated weights for policy 1, policy_version 257071 (0.0006) [2023-12-26 01:38:44,470][123090] Updated weights for policy 1, policy_version 257081 (0.0005) [2023-12-26 01:38:45,175][123091] Updated weights for policy 0, policy_version 258424 (0.0010) [2023-12-26 01:38:45,189][123090] Updated weights for policy 1, policy_version 257091 (0.0009) [2023-12-26 01:38:45,238][123091] Updated weights for policy 0, policy_version 258434 (0.0008) [2023-12-26 01:38:45,249][123090] Updated weights for policy 1, policy_version 257101 (0.0009) [2023-12-26 01:38:45,295][123091] Updated weights for policy 0, policy_version 258444 (0.0007) [2023-12-26 01:38:45,317][123090] Updated weights for policy 1, policy_version 257111 (0.0011) [2023-12-26 01:38:46,112][123091] Updated weights for policy 0, policy_version 258454 (0.0007) [2023-12-26 01:38:46,128][123090] Updated weights for policy 1, policy_version 257121 (0.0011) [2023-12-26 01:38:46,164][123091] Updated weights for policy 0, policy_version 258464 (0.0005) [2023-12-26 01:38:46,175][123090] Updated weights for policy 1, policy_version 257131 (0.0010) [2023-12-26 01:38:46,224][123091] Updated weights for policy 0, policy_version 258474 (0.0006) [2023-12-26 01:38:46,227][123090] Updated weights for policy 1, policy_version 257141 (0.0010) [2023-12-26 01:38:46,277][123090] Updated weights for policy 1, policy_version 257151 (0.0009) [2023-12-26 01:38:47,008][123091] Updated weights for policy 0, policy_version 258484 (0.0008) [2023-12-26 01:38:47,063][123091] Updated weights for policy 0, policy_version 258494 (0.0008) [2023-12-26 01:38:47,079][123090] Updated weights for policy 1, policy_version 257161 (0.0009) [2023-12-26 01:38:47,116][123091] Updated weights for policy 0, policy_version 258504 (0.0006) [2023-12-26 01:38:47,136][123090] Updated weights for policy 1, policy_version 257171 (0.0010) [2023-12-26 01:38:47,197][123090] Updated weights for policy 1, policy_version 257181 (0.0006) [2023-12-26 01:38:47,856][123090] Updated weights for policy 1, policy_version 257191 (0.0008) [2023-12-26 01:38:47,917][123090] Updated weights for policy 1, policy_version 257201 (0.0009) [2023-12-26 01:38:47,988][123090] Updated weights for policy 1, policy_version 257211 (0.0010) [2023-12-26 01:38:48,010][123091] Updated weights for policy 0, policy_version 258514 (0.0008) [2023-12-26 01:38:48,069][123091] Updated weights for policy 0, policy_version 258524 (0.0006) [2023-12-26 01:38:48,127][123091] Updated weights for policy 0, policy_version 258534 (0.0005) [2023-12-26 01:38:48,174][123091] Updated weights for policy 0, policy_version 258544 (0.0005) [2023-12-26 01:38:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17800.3). Total num frames: 132038656. Throughput: 0: 8962.8, 1: 8780.0. Samples: 132054812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:48,784][121949] Avg episode reward: [(0, '6213.561'), (1, '3952.260')] [2023-12-26 01:38:48,830][123091] Updated weights for policy 0, policy_version 258554 (0.0009) [2023-12-26 01:38:48,884][123090] Updated weights for policy 1, policy_version 257221 (0.0008) [2023-12-26 01:38:48,895][123091] Updated weights for policy 0, policy_version 258564 (0.0010) [2023-12-26 01:38:48,932][123090] Updated weights for policy 1, policy_version 257231 (0.0009) [2023-12-26 01:38:48,950][123091] Updated weights for policy 0, policy_version 258574 (0.0007) [2023-12-26 01:38:48,986][123090] Updated weights for policy 1, policy_version 257241 (0.0008) [2023-12-26 01:38:49,721][123091] Updated weights for policy 0, policy_version 258584 (0.0008) [2023-12-26 01:38:49,785][123091] Updated weights for policy 0, policy_version 258594 (0.0009) [2023-12-26 01:38:49,848][123091] Updated weights for policy 0, policy_version 258604 (0.0009) [2023-12-26 01:38:49,854][123090] Updated weights for policy 1, policy_version 257251 (0.0010) [2023-12-26 01:38:49,929][123090] Updated weights for policy 1, policy_version 257261 (0.0009) [2023-12-26 01:38:49,987][123090] Updated weights for policy 1, policy_version 257271 (0.0009) [2023-12-26 01:38:50,663][123091] Updated weights for policy 0, policy_version 258614 (0.0009) [2023-12-26 01:38:50,731][123091] Updated weights for policy 0, policy_version 258624 (0.0010) [2023-12-26 01:38:50,791][123091] Updated weights for policy 0, policy_version 258634 (0.0010) [2023-12-26 01:38:50,846][123090] Updated weights for policy 1, policy_version 257281 (0.0010) [2023-12-26 01:38:50,914][123090] Updated weights for policy 1, policy_version 257291 (0.0010) [2023-12-26 01:38:50,982][123090] Updated weights for policy 1, policy_version 257301 (0.0009) [2023-12-26 01:38:51,053][123090] Updated weights for policy 1, policy_version 257311 (0.0010) [2023-12-26 01:38:51,610][123091] Updated weights for policy 0, policy_version 258644 (0.0008) [2023-12-26 01:38:51,679][123091] Updated weights for policy 0, policy_version 258654 (0.0007) [2023-12-26 01:38:51,755][123091] Updated weights for policy 0, policy_version 258664 (0.0009) [2023-12-26 01:38:51,880][123090] Updated weights for policy 1, policy_version 257321 (0.0010) [2023-12-26 01:38:51,931][123090] Updated weights for policy 1, policy_version 257331 (0.0009) [2023-12-26 01:38:51,982][123090] Updated weights for policy 1, policy_version 257341 (0.0009) [2023-12-26 01:38:52,604][123091] Updated weights for policy 0, policy_version 258674 (0.0010) [2023-12-26 01:38:52,667][123091] Updated weights for policy 0, policy_version 258684 (0.0009) [2023-12-26 01:38:52,736][123091] Updated weights for policy 0, policy_version 258694 (0.0009) [2023-12-26 01:38:52,798][123091] Updated weights for policy 0, policy_version 258704 (0.0010) [2023-12-26 01:38:52,815][123090] Updated weights for policy 1, policy_version 257351 (0.0009) [2023-12-26 01:38:52,868][123090] Updated weights for policy 1, policy_version 257361 (0.0009) [2023-12-26 01:38:52,926][123090] Updated weights for policy 1, policy_version 257371 (0.0009) [2023-12-26 01:38:53,628][123091] Updated weights for policy 0, policy_version 258714 (0.0011) [2023-12-26 01:38:53,678][123091] Updated weights for policy 0, policy_version 258724 (0.0010) [2023-12-26 01:38:53,729][123091] Updated weights for policy 0, policy_version 258734 (0.0010) [2023-12-26 01:38:53,777][123090] Updated weights for policy 1, policy_version 257381 (0.0008) [2023-12-26 01:38:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 132128768. Throughput: 0: 8911.6, 1: 8711.1. Samples: 132105816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:53,785][121949] Avg episode reward: [(0, '6120.041'), (1, '3891.417')] [2023-12-26 01:38:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000258736_66240512.pth... [2023-12-26 01:38:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000257680_65970176.pth [2023-12-26 01:38:53,829][123090] Updated weights for policy 1, policy_version 257391 (0.0005) [2023-12-26 01:38:53,885][123090] Updated weights for policy 1, policy_version 257401 (0.0005) [2023-12-26 01:38:53,927][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000257408_65896448.pth... [2023-12-26 01:38:53,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000256384_65634304.pth [2023-12-26 01:38:54,468][123091] Updated weights for policy 0, policy_version 258744 (0.0011) [2023-12-26 01:38:54,530][123091] Updated weights for policy 0, policy_version 258754 (0.0010) [2023-12-26 01:38:54,593][123091] Updated weights for policy 0, policy_version 258764 (0.0011) [2023-12-26 01:38:54,638][123090] Updated weights for policy 1, policy_version 257411 (0.0005) [2023-12-26 01:38:54,693][123090] Updated weights for policy 1, policy_version 257421 (0.0005) [2023-12-26 01:38:54,741][123090] Updated weights for policy 1, policy_version 257431 (0.0005) [2023-12-26 01:38:55,401][123091] Updated weights for policy 0, policy_version 258774 (0.0011) [2023-12-26 01:38:55,453][123091] Updated weights for policy 0, policy_version 258784 (0.0010) [2023-12-26 01:38:55,474][123090] Updated weights for policy 1, policy_version 257441 (0.0006) [2023-12-26 01:38:55,509][123091] Updated weights for policy 0, policy_version 258794 (0.0010) [2023-12-26 01:38:55,526][123090] Updated weights for policy 1, policy_version 257451 (0.0005) [2023-12-26 01:38:55,576][123090] Updated weights for policy 1, policy_version 257461 (0.0005) [2023-12-26 01:38:55,624][123090] Updated weights for policy 1, policy_version 257471 (0.0005) [2023-12-26 01:38:56,334][123091] Updated weights for policy 0, policy_version 258804 (0.0011) [2023-12-26 01:38:56,393][123091] Updated weights for policy 0, policy_version 258814 (0.0010) [2023-12-26 01:38:56,403][123090] Updated weights for policy 1, policy_version 257481 (0.0006) [2023-12-26 01:38:56,448][123091] Updated weights for policy 0, policy_version 258824 (0.0011) [2023-12-26 01:38:56,456][123090] Updated weights for policy 1, policy_version 257491 (0.0006) [2023-12-26 01:38:56,518][123090] Updated weights for policy 1, policy_version 257501 (0.0006) [2023-12-26 01:38:57,257][123090] Updated weights for policy 1, policy_version 257511 (0.0008) [2023-12-26 01:38:57,272][123091] Updated weights for policy 0, policy_version 258834 (0.0010) [2023-12-26 01:38:57,305][123090] Updated weights for policy 1, policy_version 257521 (0.0008) [2023-12-26 01:38:57,335][123091] Updated weights for policy 0, policy_version 258844 (0.0010) [2023-12-26 01:38:57,357][123090] Updated weights for policy 1, policy_version 257531 (0.0008) [2023-12-26 01:38:57,382][123091] Updated weights for policy 0, policy_version 258854 (0.0010) [2023-12-26 01:38:57,429][123091] Updated weights for policy 0, policy_version 258864 (0.0010) [2023-12-26 01:38:58,072][123090] Updated weights for policy 1, policy_version 257541 (0.0007) [2023-12-26 01:38:58,141][123090] Updated weights for policy 1, policy_version 257551 (0.0008) [2023-12-26 01:38:58,213][123090] Updated weights for policy 1, policy_version 257561 (0.0008) [2023-12-26 01:38:58,272][123091] Updated weights for policy 0, policy_version 258874 (0.0011) [2023-12-26 01:38:58,340][123091] Updated weights for policy 0, policy_version 258884 (0.0010) [2023-12-26 01:38:58,411][123091] Updated weights for policy 0, policy_version 258894 (0.0009) [2023-12-26 01:38:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 132218880. Throughput: 0: 8886.5, 1: 8722.3. Samples: 132212400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:38:58,785][121949] Avg episode reward: [(0, '6147.261'), (1, '4217.045')] [2023-12-26 01:38:59,029][123090] Updated weights for policy 1, policy_version 257571 (0.0007) [2023-12-26 01:38:59,090][123090] Updated weights for policy 1, policy_version 257581 (0.0006) [2023-12-26 01:38:59,159][123090] Updated weights for policy 1, policy_version 257591 (0.0008) [2023-12-26 01:38:59,375][123091] Updated weights for policy 0, policy_version 258904 (0.0008) [2023-12-26 01:38:59,431][123091] Updated weights for policy 0, policy_version 258914 (0.0009) [2023-12-26 01:38:59,483][123091] Updated weights for policy 0, policy_version 258924 (0.0008) [2023-12-26 01:38:59,982][123090] Updated weights for policy 1, policy_version 257601 (0.0010) [2023-12-26 01:39:00,046][123090] Updated weights for policy 1, policy_version 257611 (0.0011) [2023-12-26 01:39:00,109][123090] Updated weights for policy 1, policy_version 257621 (0.0010) [2023-12-26 01:39:00,176][123090] Updated weights for policy 1, policy_version 257631 (0.0011) [2023-12-26 01:39:00,342][123091] Updated weights for policy 0, policy_version 258934 (0.0009) [2023-12-26 01:39:00,394][123091] Updated weights for policy 0, policy_version 258944 (0.0009) [2023-12-26 01:39:00,456][123091] Updated weights for policy 0, policy_version 258954 (0.0009) [2023-12-26 01:39:01,000][123090] Updated weights for policy 1, policy_version 257641 (0.0006) [2023-12-26 01:39:01,075][123090] Updated weights for policy 1, policy_version 257651 (0.0010) [2023-12-26 01:39:01,143][123090] Updated weights for policy 1, policy_version 257661 (0.0011) [2023-12-26 01:39:01,258][123091] Updated weights for policy 0, policy_version 258964 (0.0009) [2023-12-26 01:39:01,306][123091] Updated weights for policy 0, policy_version 258974 (0.0009) [2023-12-26 01:39:01,372][123091] Updated weights for policy 0, policy_version 258984 (0.0008) [2023-12-26 01:39:01,847][123090] Updated weights for policy 1, policy_version 257671 (0.0009) [2023-12-26 01:39:01,898][123090] Updated weights for policy 1, policy_version 257681 (0.0009) [2023-12-26 01:39:01,959][123090] Updated weights for policy 1, policy_version 257691 (0.0009) [2023-12-26 01:39:02,184][123091] Updated weights for policy 0, policy_version 258994 (0.0006) [2023-12-26 01:39:02,247][123091] Updated weights for policy 0, policy_version 259004 (0.0005) [2023-12-26 01:39:02,315][123091] Updated weights for policy 0, policy_version 259014 (0.0010) [2023-12-26 01:39:02,395][123091] Updated weights for policy 0, policy_version 259024 (0.0010) [2023-12-26 01:39:02,822][123090] Updated weights for policy 1, policy_version 257701 (0.0007) [2023-12-26 01:39:02,886][123090] Updated weights for policy 1, policy_version 257711 (0.0009) [2023-12-26 01:39:02,949][123090] Updated weights for policy 1, policy_version 257721 (0.0009) [2023-12-26 01:39:03,168][123091] Updated weights for policy 0, policy_version 259034 (0.0009) [2023-12-26 01:39:03,218][123091] Updated weights for policy 0, policy_version 259044 (0.0009) [2023-12-26 01:39:03,267][123091] Updated weights for policy 0, policy_version 259055 (0.0010) [2023-12-26 01:39:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 132300800. Throughput: 0: 8845.1, 1: 8687.8. Samples: 132315996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:39:03,785][121949] Avg episode reward: [(0, '6240.514'), (1, '4157.664')] [2023-12-26 01:39:03,786][123007] Saving new best policy, reward=6240.514! [2023-12-26 01:39:03,809][123090] Updated weights for policy 1, policy_version 257731 (0.0009) [2023-12-26 01:39:03,879][123090] Updated weights for policy 1, policy_version 257741 (0.0010) [2023-12-26 01:39:03,944][123090] Updated weights for policy 1, policy_version 257751 (0.0010) [2023-12-26 01:39:03,971][123091] Updated weights for policy 0, policy_version 259065 (0.0008) [2023-12-26 01:39:04,038][123091] Updated weights for policy 0, policy_version 259075 (0.0009) [2023-12-26 01:39:04,092][123091] Updated weights for policy 0, policy_version 259085 (0.0009) [2023-12-26 01:39:04,770][123090] Updated weights for policy 1, policy_version 257761 (0.0009) [2023-12-26 01:39:04,823][123090] Updated weights for policy 1, policy_version 257771 (0.0009) [2023-12-26 01:39:04,872][123090] Updated weights for policy 1, policy_version 257781 (0.0009) [2023-12-26 01:39:04,898][123091] Updated weights for policy 0, policy_version 259095 (0.0007) [2023-12-26 01:39:04,931][123090] Updated weights for policy 1, policy_version 257791 (0.0009) [2023-12-26 01:39:04,965][123091] Updated weights for policy 0, policy_version 259105 (0.0009) [2023-12-26 01:39:05,032][123091] Updated weights for policy 0, policy_version 259115 (0.0009) [2023-12-26 01:39:05,792][123090] Updated weights for policy 1, policy_version 257801 (0.0010) [2023-12-26 01:39:05,818][123091] Updated weights for policy 0, policy_version 259125 (0.0009) [2023-12-26 01:39:05,843][123090] Updated weights for policy 1, policy_version 257811 (0.0007) [2023-12-26 01:39:05,877][123091] Updated weights for policy 0, policy_version 259135 (0.0009) [2023-12-26 01:39:05,901][123090] Updated weights for policy 1, policy_version 257821 (0.0009) [2023-12-26 01:39:05,943][123091] Updated weights for policy 0, policy_version 259145 (0.0008) [2023-12-26 01:39:06,686][123091] Updated weights for policy 0, policy_version 259155 (0.0009) [2023-12-26 01:39:06,747][123091] Updated weights for policy 0, policy_version 259165 (0.0009) [2023-12-26 01:39:06,779][123090] Updated weights for policy 1, policy_version 257831 (0.0007) [2023-12-26 01:39:06,803][123091] Updated weights for policy 0, policy_version 259175 (0.0007) [2023-12-26 01:39:06,848][123090] Updated weights for policy 1, policy_version 257841 (0.0005) [2023-12-26 01:39:06,921][123090] Updated weights for policy 1, policy_version 257851 (0.0005) [2023-12-26 01:39:07,581][123091] Updated weights for policy 0, policy_version 259185 (0.0005) [2023-12-26 01:39:07,647][123091] Updated weights for policy 0, policy_version 259195 (0.0006) [2023-12-26 01:39:07,710][123091] Updated weights for policy 0, policy_version 259205 (0.0006) [2023-12-26 01:39:07,741][123090] Updated weights for policy 1, policy_version 257861 (0.0008) [2023-12-26 01:39:07,769][123091] Updated weights for policy 0, policy_version 259215 (0.0005) [2023-12-26 01:39:07,812][123090] Updated weights for policy 1, policy_version 257871 (0.0009) [2023-12-26 01:39:07,877][123090] Updated weights for policy 1, policy_version 257881 (0.0009) [2023-12-26 01:39:08,424][123091] Updated weights for policy 0, policy_version 259225 (0.0005) [2023-12-26 01:39:08,479][123091] Updated weights for policy 0, policy_version 259235 (0.0005) [2023-12-26 01:39:08,535][123091] Updated weights for policy 0, policy_version 259245 (0.0010) [2023-12-26 01:39:08,748][123090] Updated weights for policy 1, policy_version 257891 (0.0010) [2023-12-26 01:39:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 132390912. Throughput: 0: 8882.9, 1: 8683.6. Samples: 132367644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:39:08,785][121949] Avg episode reward: [(0, '6166.617'), (1, '4290.529')] [2023-12-26 01:39:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000259248_66371584.pth... [2023-12-26 01:39:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000258224_66109440.pth [2023-12-26 01:39:08,806][123090] Updated weights for policy 1, policy_version 257901 (0.0010) [2023-12-26 01:39:08,868][123090] Updated weights for policy 1, policy_version 257911 (0.0010) [2023-12-26 01:39:08,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000257920_66027520.pth... [2023-12-26 01:39:08,945][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000256896_65765376.pth [2023-12-26 01:39:09,263][123091] Updated weights for policy 0, policy_version 259255 (0.0010) [2023-12-26 01:39:09,338][123091] Updated weights for policy 0, policy_version 259265 (0.0009) [2023-12-26 01:39:09,410][123091] Updated weights for policy 0, policy_version 259275 (0.0010) [2023-12-26 01:39:09,742][123090] Updated weights for policy 1, policy_version 257921 (0.0009) [2023-12-26 01:39:09,803][123090] Updated weights for policy 1, policy_version 257931 (0.0010) [2023-12-26 01:39:09,865][123090] Updated weights for policy 1, policy_version 257941 (0.0009) [2023-12-26 01:39:09,926][123090] Updated weights for policy 1, policy_version 257951 (0.0009) [2023-12-26 01:39:10,190][123091] Updated weights for policy 0, policy_version 259285 (0.0009) [2023-12-26 01:39:10,249][123091] Updated weights for policy 0, policy_version 259295 (0.0010) [2023-12-26 01:39:10,304][123091] Updated weights for policy 0, policy_version 259305 (0.0010) [2023-12-26 01:39:10,813][123090] Updated weights for policy 1, policy_version 257961 (0.0007) [2023-12-26 01:39:10,869][123090] Updated weights for policy 1, policy_version 257971 (0.0005) [2023-12-26 01:39:10,922][123090] Updated weights for policy 1, policy_version 257981 (0.0010) [2023-12-26 01:39:11,215][123091] Updated weights for policy 0, policy_version 259315 (0.0009) [2023-12-26 01:39:11,289][123091] Updated weights for policy 0, policy_version 259325 (0.0009) [2023-12-26 01:39:11,357][123091] Updated weights for policy 0, policy_version 259335 (0.0009) [2023-12-26 01:39:11,815][123090] Updated weights for policy 1, policy_version 257991 (0.0010) [2023-12-26 01:39:11,884][123090] Updated weights for policy 1, policy_version 258001 (0.0009) [2023-12-26 01:39:11,952][123090] Updated weights for policy 1, policy_version 258011 (0.0008) [2023-12-26 01:39:12,202][123091] Updated weights for policy 0, policy_version 259345 (0.0009) [2023-12-26 01:39:12,257][123091] Updated weights for policy 0, policy_version 259355 (0.0009) [2023-12-26 01:39:12,324][123091] Updated weights for policy 0, policy_version 259365 (0.0010) [2023-12-26 01:39:12,394][123091] Updated weights for policy 0, policy_version 259375 (0.0008) [2023-12-26 01:39:12,814][123090] Updated weights for policy 1, policy_version 258021 (0.0010) [2023-12-26 01:39:12,878][123090] Updated weights for policy 1, policy_version 258031 (0.0011) [2023-12-26 01:39:12,943][123090] Updated weights for policy 1, policy_version 258041 (0.0011) [2023-12-26 01:39:13,191][123091] Updated weights for policy 0, policy_version 259385 (0.0009) [2023-12-26 01:39:13,260][123091] Updated weights for policy 0, policy_version 259395 (0.0010) [2023-12-26 01:39:13,321][123091] Updated weights for policy 0, policy_version 259405 (0.0009) [2023-12-26 01:39:13,704][123090] Updated weights for policy 1, policy_version 258051 (0.0010) [2023-12-26 01:39:13,769][123090] Updated weights for policy 1, policy_version 258061 (0.0008) [2023-12-26 01:39:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 132472832. Throughput: 0: 8883.4, 1: 8679.2. Samples: 132470916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:39:13,784][121949] Avg episode reward: [(0, '6072.181'), (1, '4737.021')] [2023-12-26 01:39:13,832][123090] Updated weights for policy 1, policy_version 258071 (0.0007) [2023-12-26 01:39:14,146][123091] Updated weights for policy 0, policy_version 259415 (0.0009) [2023-12-26 01:39:14,216][123091] Updated weights for policy 0, policy_version 259425 (0.0010) [2023-12-26 01:39:14,282][123091] Updated weights for policy 0, policy_version 259435 (0.0009) [2023-12-26 01:39:14,601][123090] Updated weights for policy 1, policy_version 258081 (0.0008) [2023-12-26 01:39:14,648][123090] Updated weights for policy 1, policy_version 258091 (0.0005) [2023-12-26 01:39:14,709][123090] Updated weights for policy 1, policy_version 258101 (0.0005) [2023-12-26 01:39:14,781][123090] Updated weights for policy 1, policy_version 258111 (0.0006) [2023-12-26 01:39:15,154][123091] Updated weights for policy 0, policy_version 259445 (0.0009) [2023-12-26 01:39:15,220][123091] Updated weights for policy 0, policy_version 259455 (0.0010) [2023-12-26 01:39:15,282][123091] Updated weights for policy 0, policy_version 259465 (0.0009) [2023-12-26 01:39:15,495][123090] Updated weights for policy 1, policy_version 258121 (0.0009) [2023-12-26 01:39:15,559][123090] Updated weights for policy 1, policy_version 258131 (0.0009) [2023-12-26 01:39:15,631][123090] Updated weights for policy 1, policy_version 258141 (0.0009) [2023-12-26 01:39:16,118][123091] Updated weights for policy 0, policy_version 259475 (0.0009) [2023-12-26 01:39:16,182][123091] Updated weights for policy 0, policy_version 259485 (0.0009) [2023-12-26 01:39:16,236][123091] Updated weights for policy 0, policy_version 259495 (0.0007) [2023-12-26 01:39:16,478][123090] Updated weights for policy 1, policy_version 258151 (0.0010) [2023-12-26 01:39:16,532][123090] Updated weights for policy 1, policy_version 258161 (0.0009) [2023-12-26 01:39:16,592][123090] Updated weights for policy 1, policy_version 258171 (0.0009) [2023-12-26 01:39:17,031][123091] Updated weights for policy 0, policy_version 259505 (0.0005) [2023-12-26 01:39:17,098][123091] Updated weights for policy 0, policy_version 259515 (0.0005) [2023-12-26 01:39:17,151][123091] Updated weights for policy 0, policy_version 259525 (0.0005) [2023-12-26 01:39:17,207][123091] Updated weights for policy 0, policy_version 259535 (0.0005) [2023-12-26 01:39:17,457][123090] Updated weights for policy 1, policy_version 258181 (0.0010) [2023-12-26 01:39:17,510][123090] Updated weights for policy 1, policy_version 258191 (0.0009) [2023-12-26 01:39:17,567][123090] Updated weights for policy 1, policy_version 258201 (0.0009) [2023-12-26 01:39:17,937][123091] Updated weights for policy 0, policy_version 259545 (0.0009) [2023-12-26 01:39:17,996][123091] Updated weights for policy 0, policy_version 259556 (0.0009) [2023-12-26 01:39:18,054][123091] Updated weights for policy 0, policy_version 259566 (0.0008) [2023-12-26 01:39:18,381][123090] Updated weights for policy 1, policy_version 258211 (0.0009) [2023-12-26 01:39:18,451][123090] Updated weights for policy 1, policy_version 258221 (0.0008) [2023-12-26 01:39:18,518][123090] Updated weights for policy 1, policy_version 258231 (0.0009) [2023-12-26 01:39:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17800.3). Total num frames: 132562944. Throughput: 0: 8797.5, 1: 8705.3. Samples: 132574976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:39:18,785][121949] Avg episode reward: [(0, '6140.850'), (1, '4709.865')] [2023-12-26 01:39:18,954][123091] Updated weights for policy 0, policy_version 259576 (0.0009) [2023-12-26 01:39:19,025][123091] Updated weights for policy 0, policy_version 259586 (0.0010) [2023-12-26 01:39:19,098][123091] Updated weights for policy 0, policy_version 259596 (0.0010) [2023-12-26 01:39:19,221][123090] Updated weights for policy 1, policy_version 258241 (0.0008) [2023-12-26 01:39:19,282][123090] Updated weights for policy 1, policy_version 258251 (0.0010) [2023-12-26 01:39:19,342][123090] Updated weights for policy 1, policy_version 258261 (0.0010) [2023-12-26 01:39:19,406][123090] Updated weights for policy 1, policy_version 258271 (0.0009) [2023-12-26 01:39:19,911][123091] Updated weights for policy 0, policy_version 259606 (0.0010) [2023-12-26 01:39:19,983][123091] Updated weights for policy 0, policy_version 259616 (0.0011) [2023-12-26 01:39:20,051][123091] Updated weights for policy 0, policy_version 259626 (0.0011) [2023-12-26 01:39:20,262][123090] Updated weights for policy 1, policy_version 258281 (0.0009) [2023-12-26 01:39:20,325][123090] Updated weights for policy 1, policy_version 258291 (0.0009) [2023-12-26 01:39:20,386][123090] Updated weights for policy 1, policy_version 258301 (0.0009) [2023-12-26 01:39:20,866][123091] Updated weights for policy 0, policy_version 259636 (0.0011) [2023-12-26 01:39:20,933][123091] Updated weights for policy 0, policy_version 259646 (0.0011) [2023-12-26 01:39:20,997][123091] Updated weights for policy 0, policy_version 259656 (0.0011) [2023-12-26 01:39:21,248][123090] Updated weights for policy 1, policy_version 258311 (0.0008) [2023-12-26 01:39:21,320][123090] Updated weights for policy 1, policy_version 258321 (0.0006) [2023-12-26 01:39:21,395][123090] Updated weights for policy 1, policy_version 258331 (0.0008) [2023-12-26 01:39:21,848][123091] Updated weights for policy 0, policy_version 259666 (0.0011) [2023-12-26 01:39:21,918][123091] Updated weights for policy 0, policy_version 259676 (0.0011) [2023-12-26 01:39:21,980][123091] Updated weights for policy 0, policy_version 259686 (0.0010) [2023-12-26 01:39:22,042][123091] Updated weights for policy 0, policy_version 259696 (0.0010) [2023-12-26 01:39:22,156][123090] Updated weights for policy 1, policy_version 258341 (0.0008) [2023-12-26 01:39:22,228][123090] Updated weights for policy 1, policy_version 258351 (0.0009) [2023-12-26 01:39:22,303][123090] Updated weights for policy 1, policy_version 258361 (0.0010) [2023-12-26 01:39:22,796][123091] Updated weights for policy 0, policy_version 259706 (0.0010) [2023-12-26 01:39:22,857][123091] Updated weights for policy 0, policy_version 259716 (0.0010) [2023-12-26 01:39:22,910][123091] Updated weights for policy 0, policy_version 259726 (0.0009) [2023-12-26 01:39:23,102][123090] Updated weights for policy 1, policy_version 258371 (0.0010) [2023-12-26 01:39:23,163][123090] Updated weights for policy 1, policy_version 258381 (0.0010) [2023-12-26 01:39:23,235][123090] Updated weights for policy 1, policy_version 258391 (0.0009) [2023-12-26 01:39:23,717][123091] Updated weights for policy 0, policy_version 259736 (0.0006) [2023-12-26 01:39:23,782][123091] Updated weights for policy 0, policy_version 259746 (0.0009) [2023-12-26 01:39:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17772.5). Total num frames: 132644864. Throughput: 0: 8735.7, 1: 8652.2. Samples: 132626704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 01:39:23,784][121949] Avg episode reward: [(0, '6247.278'), (1, '4377.157')] [2023-12-26 01:39:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000258400_66150400.pth... [2023-12-26 01:39:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000257408_65896448.pth [2023-12-26 01:39:23,833][123091] Updated weights for policy 0, policy_version 259756 (0.0009) [2023-12-26 01:39:23,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000259760_66502656.pth... [2023-12-26 01:39:23,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000258736_66240512.pth [2023-12-26 01:39:23,861][123007] Saving new best policy, reward=6247.278! [2023-12-26 01:39:24,107][123090] Updated weights for policy 1, policy_version 258401 (0.0009) [2023-12-26 01:39:24,165][123090] Updated weights for policy 1, policy_version 258411 (0.0005) [2023-12-26 01:39:24,211][123090] Updated weights for policy 1, policy_version 258421 (0.0005) [2023-12-26 01:39:24,266][123090] Updated weights for policy 1, policy_version 258431 (0.0005) [2023-12-26 01:39:24,493][123091] Updated weights for policy 0, policy_version 259766 (0.0005) [2023-12-26 01:39:24,550][123091] Updated weights for policy 0, policy_version 259776 (0.0005) [2023-12-26 01:39:24,608][123091] Updated weights for policy 0, policy_version 259786 (0.0007) [2023-12-26 01:39:24,977][123090] Updated weights for policy 1, policy_version 258441 (0.0010) [2023-12-26 01:39:25,030][123090] Updated weights for policy 1, policy_version 258451 (0.0010) [2023-12-26 01:39:25,078][123090] Updated weights for policy 1, policy_version 258461 (0.0010) [2023-12-26 01:39:25,281][123091] Updated weights for policy 0, policy_version 259796 (0.0005) [2023-12-26 01:39:25,332][123091] Updated weights for policy 0, policy_version 259806 (0.0005) [2023-12-26 01:39:25,385][123091] Updated weights for policy 0, policy_version 259816 (0.0005) [2023-12-26 01:39:25,871][123090] Updated weights for policy 1, policy_version 258471 (0.0007) [2023-12-26 01:39:25,917][123090] Updated weights for policy 1, policy_version 258481 (0.0005) [2023-12-26 01:39:25,942][123091] Updated weights for policy 0, policy_version 259826 (0.0005) [2023-12-26 01:39:25,977][123090] Updated weights for policy 1, policy_version 258491 (0.0006) [2023-12-26 01:39:25,989][123091] Updated weights for policy 0, policy_version 259836 (0.0005) [2023-12-26 01:39:26,039][123091] Updated weights for policy 0, policy_version 259846 (0.0008) [2023-12-26 01:39:26,086][123091] Updated weights for policy 0, policy_version 259856 (0.0010) [2023-12-26 01:39:26,739][123090] Updated weights for policy 1, policy_version 258501 (0.0007) [2023-12-26 01:39:26,788][123090] Updated weights for policy 1, policy_version 258511 (0.0009) [2023-12-26 01:39:26,839][123090] Updated weights for policy 1, policy_version 258521 (0.0008) [2023-12-26 01:39:26,899][123091] Updated weights for policy 0, policy_version 259866 (0.0011) [2023-12-26 01:39:26,955][123091] Updated weights for policy 0, policy_version 259876 (0.0007) [2023-12-26 01:39:27,017][123091] Updated weights for policy 0, policy_version 259886 (0.0005) [2023-12-26 01:39:27,643][123091] Updated weights for policy 0, policy_version 259896 (0.0006) [2023-12-26 01:39:27,706][123091] Updated weights for policy 0, policy_version 259906 (0.0005) [2023-12-26 01:39:27,756][123090] Updated weights for policy 1, policy_version 258531 (0.0009) [2023-12-26 01:39:27,777][123091] Updated weights for policy 0, policy_version 259916 (0.0006) [2023-12-26 01:39:27,818][123090] Updated weights for policy 1, policy_version 258541 (0.0009) [2023-12-26 01:39:27,876][123090] Updated weights for policy 1, policy_version 258551 (0.0009) [2023-12-26 01:39:28,532][123091] Updated weights for policy 0, policy_version 259926 (0.0006) [2023-12-26 01:39:28,584][123091] Updated weights for policy 0, policy_version 259936 (0.0008) [2023-12-26 01:39:28,640][123091] Updated weights for policy 0, policy_version 259946 (0.0009) [2023-12-26 01:39:28,721][123090] Updated weights for policy 1, policy_version 258561 (0.0009) [2023-12-26 01:39:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 132743168. Throughput: 0: 8849.1, 1: 8698.2. Samples: 132738120. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:28,785][121949] Avg episode reward: [(0, '6131.732'), (1, '4685.790')] [2023-12-26 01:39:28,787][123090] Updated weights for policy 1, policy_version 258571 (0.0009) [2023-12-26 01:39:28,844][123090] Updated weights for policy 1, policy_version 258581 (0.0009) [2023-12-26 01:39:28,914][123090] Updated weights for policy 1, policy_version 258591 (0.0010) [2023-12-26 01:39:29,390][123091] Updated weights for policy 0, policy_version 259956 (0.0008) [2023-12-26 01:39:29,447][123091] Updated weights for policy 0, policy_version 259966 (0.0008) [2023-12-26 01:39:29,509][123091] Updated weights for policy 0, policy_version 259976 (0.0008) [2023-12-26 01:39:29,787][123090] Updated weights for policy 1, policy_version 258601 (0.0010) [2023-12-26 01:39:29,861][123090] Updated weights for policy 1, policy_version 258611 (0.0008) [2023-12-26 01:39:29,932][123090] Updated weights for policy 1, policy_version 258621 (0.0009) [2023-12-26 01:39:30,318][123091] Updated weights for policy 0, policy_version 259986 (0.0007) [2023-12-26 01:39:30,382][123091] Updated weights for policy 0, policy_version 259996 (0.0005) [2023-12-26 01:39:30,437][123091] Updated weights for policy 0, policy_version 260006 (0.0005) [2023-12-26 01:39:30,492][123091] Updated weights for policy 0, policy_version 260016 (0.0005) [2023-12-26 01:39:30,785][123090] Updated weights for policy 1, policy_version 258631 (0.0009) [2023-12-26 01:39:30,847][123090] Updated weights for policy 1, policy_version 258641 (0.0009) [2023-12-26 01:39:30,899][123090] Updated weights for policy 1, policy_version 258651 (0.0009) [2023-12-26 01:39:31,183][123091] Updated weights for policy 0, policy_version 260026 (0.0007) [2023-12-26 01:39:31,234][123091] Updated weights for policy 0, policy_version 260036 (0.0006) [2023-12-26 01:39:31,297][123091] Updated weights for policy 0, policy_version 260046 (0.0007) [2023-12-26 01:39:31,773][123090] Updated weights for policy 1, policy_version 258661 (0.0010) [2023-12-26 01:39:31,835][123090] Updated weights for policy 1, policy_version 258671 (0.0009) [2023-12-26 01:39:31,903][123090] Updated weights for policy 1, policy_version 258681 (0.0008) [2023-12-26 01:39:32,110][123091] Updated weights for policy 0, policy_version 260056 (0.0006) [2023-12-26 01:39:32,161][123091] Updated weights for policy 0, policy_version 260066 (0.0010) [2023-12-26 01:39:32,216][123091] Updated weights for policy 0, policy_version 260076 (0.0008) [2023-12-26 01:39:32,757][123090] Updated weights for policy 1, policy_version 258691 (0.0010) [2023-12-26 01:39:32,819][123090] Updated weights for policy 1, policy_version 258701 (0.0009) [2023-12-26 01:39:32,888][123090] Updated weights for policy 1, policy_version 258711 (0.0010) [2023-12-26 01:39:32,907][123091] Updated weights for policy 0, policy_version 260086 (0.0006) [2023-12-26 01:39:32,973][123091] Updated weights for policy 0, policy_version 260096 (0.0007) [2023-12-26 01:39:33,033][123091] Updated weights for policy 0, policy_version 260106 (0.0010) [2023-12-26 01:39:33,551][123090] Updated weights for policy 1, policy_version 258721 (0.0008) [2023-12-26 01:39:33,603][123090] Updated weights for policy 1, policy_version 258731 (0.0005) [2023-12-26 01:39:33,649][123090] Updated weights for policy 1, policy_version 258741 (0.0005) [2023-12-26 01:39:33,696][123090] Updated weights for policy 1, policy_version 258751 (0.0007) [2023-12-26 01:39:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 132833280. Throughput: 0: 8906.0, 1: 8624.3. Samples: 132843676. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:33,785][121949] Avg episode reward: [(0, '6116.510'), (1, '4763.567')] [2023-12-26 01:39:33,870][123091] Updated weights for policy 0, policy_version 260116 (0.0010) [2023-12-26 01:39:33,936][123091] Updated weights for policy 0, policy_version 260126 (0.0009) [2023-12-26 01:39:34,000][123091] Updated weights for policy 0, policy_version 260136 (0.0009) [2023-12-26 01:39:34,504][123090] Updated weights for policy 1, policy_version 258761 (0.0010) [2023-12-26 01:39:34,568][123090] Updated weights for policy 1, policy_version 258771 (0.0009) [2023-12-26 01:39:34,634][123090] Updated weights for policy 1, policy_version 258781 (0.0010) [2023-12-26 01:39:34,756][123091] Updated weights for policy 0, policy_version 260146 (0.0009) [2023-12-26 01:39:34,807][123091] Updated weights for policy 0, policy_version 260156 (0.0008) [2023-12-26 01:39:34,864][123091] Updated weights for policy 0, policy_version 260166 (0.0009) [2023-12-26 01:39:34,930][123091] Updated weights for policy 0, policy_version 260176 (0.0009) [2023-12-26 01:39:35,419][123090] Updated weights for policy 1, policy_version 258791 (0.0010) [2023-12-26 01:39:35,480][123090] Updated weights for policy 1, policy_version 258801 (0.0009) [2023-12-26 01:39:35,546][123090] Updated weights for policy 1, policy_version 258811 (0.0009) [2023-12-26 01:39:35,778][123091] Updated weights for policy 0, policy_version 260186 (0.0005) [2023-12-26 01:39:35,837][123091] Updated weights for policy 0, policy_version 260196 (0.0005) [2023-12-26 01:39:35,900][123091] Updated weights for policy 0, policy_version 260206 (0.0005) [2023-12-26 01:39:36,412][123090] Updated weights for policy 1, policy_version 258821 (0.0009) [2023-12-26 01:39:36,469][123090] Updated weights for policy 1, policy_version 258831 (0.0009) [2023-12-26 01:39:36,531][123090] Updated weights for policy 1, policy_version 258841 (0.0009) [2023-12-26 01:39:36,658][123091] Updated weights for policy 0, policy_version 260216 (0.0009) [2023-12-26 01:39:36,716][123091] Updated weights for policy 0, policy_version 260226 (0.0009) [2023-12-26 01:39:36,779][123091] Updated weights for policy 0, policy_version 260236 (0.0009) [2023-12-26 01:39:37,382][123090] Updated weights for policy 1, policy_version 258851 (0.0009) [2023-12-26 01:39:37,454][123090] Updated weights for policy 1, policy_version 258861 (0.0009) [2023-12-26 01:39:37,529][123090] Updated weights for policy 1, policy_version 258871 (0.0009) [2023-12-26 01:39:37,560][123091] Updated weights for policy 0, policy_version 260246 (0.0007) [2023-12-26 01:39:37,620][123091] Updated weights for policy 0, policy_version 260256 (0.0006) [2023-12-26 01:39:37,683][123091] Updated weights for policy 0, policy_version 260266 (0.0005) [2023-12-26 01:39:38,263][123091] Updated weights for policy 0, policy_version 260276 (0.0008) [2023-12-26 01:39:38,326][123091] Updated weights for policy 0, policy_version 260286 (0.0010) [2023-12-26 01:39:38,387][123091] Updated weights for policy 0, policy_version 260296 (0.0008) [2023-12-26 01:39:38,396][123090] Updated weights for policy 1, policy_version 258881 (0.0008) [2023-12-26 01:39:38,464][123090] Updated weights for policy 1, policy_version 258891 (0.0009) [2023-12-26 01:39:38,523][123090] Updated weights for policy 1, policy_version 258901 (0.0010) [2023-12-26 01:39:38,582][123090] Updated weights for policy 1, policy_version 258911 (0.0010) [2023-12-26 01:39:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 132923392. Throughput: 0: 8922.2, 1: 8644.2. Samples: 132896304. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:38,785][121949] Avg episode reward: [(0, '6195.529'), (1, '4725.869')] [2023-12-26 01:39:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000258912_66281472.pth... [2023-12-26 01:39:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000260304_66641920.pth... [2023-12-26 01:39:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000259248_66371584.pth [2023-12-26 01:39:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000257920_66027520.pth [2023-12-26 01:39:39,106][123091] Updated weights for policy 0, policy_version 260306 (0.0005) [2023-12-26 01:39:39,162][123091] Updated weights for policy 0, policy_version 260316 (0.0006) [2023-12-26 01:39:39,232][123091] Updated weights for policy 0, policy_version 260326 (0.0006) [2023-12-26 01:39:39,300][123091] Updated weights for policy 0, policy_version 260336 (0.0009) [2023-12-26 01:39:39,463][123090] Updated weights for policy 1, policy_version 258921 (0.0009) [2023-12-26 01:39:39,531][123090] Updated weights for policy 1, policy_version 258932 (0.0010) [2023-12-26 01:39:39,599][123090] Updated weights for policy 1, policy_version 258942 (0.0009) [2023-12-26 01:39:40,076][123091] Updated weights for policy 0, policy_version 260346 (0.0009) [2023-12-26 01:39:40,141][123091] Updated weights for policy 0, policy_version 260356 (0.0010) [2023-12-26 01:39:40,209][123091] Updated weights for policy 0, policy_version 260366 (0.0010) [2023-12-26 01:39:40,429][123090] Updated weights for policy 1, policy_version 258952 (0.0009) [2023-12-26 01:39:40,486][123090] Updated weights for policy 1, policy_version 258962 (0.0009) [2023-12-26 01:39:40,542][123090] Updated weights for policy 1, policy_version 258972 (0.0009) [2023-12-26 01:39:41,014][123091] Updated weights for policy 0, policy_version 260376 (0.0010) [2023-12-26 01:39:41,081][123091] Updated weights for policy 0, policy_version 260386 (0.0007) [2023-12-26 01:39:41,149][123091] Updated weights for policy 0, policy_version 260396 (0.0014) [2023-12-26 01:39:41,403][123090] Updated weights for policy 1, policy_version 258982 (0.0009) [2023-12-26 01:39:41,468][123090] Updated weights for policy 1, policy_version 258992 (0.0009) [2023-12-26 01:39:41,535][123090] Updated weights for policy 1, policy_version 259002 (0.0009) [2023-12-26 01:39:42,083][123091] Updated weights for policy 0, policy_version 260406 (0.0009) [2023-12-26 01:39:42,138][123091] Updated weights for policy 0, policy_version 260416 (0.0009) [2023-12-26 01:39:42,192][123091] Updated weights for policy 0, policy_version 260426 (0.0009) [2023-12-26 01:39:42,391][123090] Updated weights for policy 1, policy_version 259012 (0.0010) [2023-12-26 01:39:42,447][123090] Updated weights for policy 1, policy_version 259022 (0.0010) [2023-12-26 01:39:42,495][123090] Updated weights for policy 1, policy_version 259032 (0.0010) [2023-12-26 01:39:43,058][123091] Updated weights for policy 0, policy_version 260436 (0.0009) [2023-12-26 01:39:43,122][123091] Updated weights for policy 0, policy_version 260446 (0.0009) [2023-12-26 01:39:43,184][123091] Updated weights for policy 0, policy_version 260456 (0.0009) [2023-12-26 01:39:43,345][123090] Updated weights for policy 1, policy_version 259042 (0.0009) [2023-12-26 01:39:43,411][123090] Updated weights for policy 1, policy_version 259052 (0.0005) [2023-12-26 01:39:43,494][123090] Updated weights for policy 1, policy_version 259062 (0.0005) [2023-12-26 01:39:43,573][123090] Updated weights for policy 1, policy_version 259072 (0.0009) [2023-12-26 01:39:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 133005312. Throughput: 0: 8953.8, 1: 8518.4. Samples: 132998652. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:43,785][121949] Avg episode reward: [(0, '6156.842'), (1, '4822.800')] [2023-12-26 01:39:43,913][123091] Updated weights for policy 0, policy_version 260466 (0.0009) [2023-12-26 01:39:43,962][123091] Updated weights for policy 0, policy_version 260476 (0.0009) [2023-12-26 01:39:44,023][123091] Updated weights for policy 0, policy_version 260486 (0.0009) [2023-12-26 01:39:44,085][123091] Updated weights for policy 0, policy_version 260496 (0.0008) [2023-12-26 01:39:44,283][123090] Updated weights for policy 1, policy_version 259082 (0.0005) [2023-12-26 01:39:44,346][123090] Updated weights for policy 1, policy_version 259092 (0.0005) [2023-12-26 01:39:44,405][123090] Updated weights for policy 1, policy_version 259102 (0.0005) [2023-12-26 01:39:44,843][123091] Updated weights for policy 0, policy_version 260506 (0.0009) [2023-12-26 01:39:44,908][123091] Updated weights for policy 0, policy_version 260516 (0.0007) [2023-12-26 01:39:44,977][123091] Updated weights for policy 0, policy_version 260526 (0.0009) [2023-12-26 01:39:45,167][123090] Updated weights for policy 1, policy_version 259112 (0.0009) [2023-12-26 01:39:45,222][123090] Updated weights for policy 1, policy_version 259122 (0.0010) [2023-12-26 01:39:45,277][123090] Updated weights for policy 1, policy_version 259132 (0.0008) [2023-12-26 01:39:45,775][123091] Updated weights for policy 0, policy_version 260536 (0.0008) [2023-12-26 01:39:45,830][123091] Updated weights for policy 0, policy_version 260546 (0.0006) [2023-12-26 01:39:45,880][123091] Updated weights for policy 0, policy_version 260556 (0.0006) [2023-12-26 01:39:46,019][123090] Updated weights for policy 1, policy_version 259142 (0.0011) [2023-12-26 01:39:46,070][123090] Updated weights for policy 1, policy_version 259152 (0.0010) [2023-12-26 01:39:46,130][123090] Updated weights for policy 1, policy_version 259162 (0.0010) [2023-12-26 01:39:46,580][123091] Updated weights for policy 0, policy_version 260566 (0.0006) [2023-12-26 01:39:46,626][123091] Updated weights for policy 0, policy_version 260576 (0.0005) [2023-12-26 01:39:46,671][123091] Updated weights for policy 0, policy_version 260586 (0.0005) [2023-12-26 01:39:46,835][123090] Updated weights for policy 1, policy_version 259172 (0.0010) [2023-12-26 01:39:46,893][123090] Updated weights for policy 1, policy_version 259182 (0.0010) [2023-12-26 01:39:46,952][123090] Updated weights for policy 1, policy_version 259192 (0.0010) [2023-12-26 01:39:47,322][123091] Updated weights for policy 0, policy_version 260596 (0.0005) [2023-12-26 01:39:47,372][123091] Updated weights for policy 0, policy_version 260606 (0.0006) [2023-12-26 01:39:47,430][123091] Updated weights for policy 0, policy_version 260616 (0.0005) [2023-12-26 01:39:47,753][123090] Updated weights for policy 1, policy_version 259202 (0.0009) [2023-12-26 01:39:47,812][123090] Updated weights for policy 1, policy_version 259212 (0.0005) [2023-12-26 01:39:47,860][123090] Updated weights for policy 1, policy_version 259222 (0.0005) [2023-12-26 01:39:47,916][123090] Updated weights for policy 1, policy_version 259232 (0.0005) [2023-12-26 01:39:48,093][123091] Updated weights for policy 0, policy_version 260626 (0.0005) [2023-12-26 01:39:48,138][123091] Updated weights for policy 0, policy_version 260636 (0.0005) [2023-12-26 01:39:48,188][123091] Updated weights for policy 0, policy_version 260646 (0.0005) [2023-12-26 01:39:48,236][123091] Updated weights for policy 0, policy_version 260656 (0.0006) [2023-12-26 01:39:48,628][123090] Updated weights for policy 1, policy_version 259242 (0.0011) [2023-12-26 01:39:48,691][123090] Updated weights for policy 1, policy_version 259252 (0.0011) [2023-12-26 01:39:48,753][123090] Updated weights for policy 1, policy_version 259262 (0.0010) [2023-12-26 01:39:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 133103616. Throughput: 0: 9112.5, 1: 8609.7. Samples: 133113496. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:48,785][121949] Avg episode reward: [(0, '6077.059'), (1, '4805.231')] [2023-12-26 01:39:48,960][123091] Updated weights for policy 0, policy_version 260666 (0.0011) [2023-12-26 01:39:49,019][123091] Updated weights for policy 0, policy_version 260676 (0.0011) [2023-12-26 01:39:49,076][123091] Updated weights for policy 0, policy_version 260686 (0.0005) [2023-12-26 01:39:49,581][123090] Updated weights for policy 1, policy_version 259272 (0.0008) [2023-12-26 01:39:49,652][123090] Updated weights for policy 1, policy_version 259282 (0.0010) [2023-12-26 01:39:49,704][123090] Updated weights for policy 1, policy_version 259292 (0.0010) [2023-12-26 01:39:49,805][123091] Updated weights for policy 0, policy_version 260696 (0.0006) [2023-12-26 01:39:49,874][123091] Updated weights for policy 0, policy_version 260706 (0.0009) [2023-12-26 01:39:49,941][123091] Updated weights for policy 0, policy_version 260716 (0.0010) [2023-12-26 01:39:50,425][123090] Updated weights for policy 1, policy_version 259302 (0.0009) [2023-12-26 01:39:50,488][123090] Updated weights for policy 1, policy_version 259312 (0.0009) [2023-12-26 01:39:50,549][123090] Updated weights for policy 1, policy_version 259322 (0.0009) [2023-12-26 01:39:50,621][123091] Updated weights for policy 0, policy_version 260726 (0.0008) [2023-12-26 01:39:50,677][123091] Updated weights for policy 0, policy_version 260736 (0.0008) [2023-12-26 01:39:50,740][123091] Updated weights for policy 0, policy_version 260746 (0.0008) [2023-12-26 01:39:51,400][123090] Updated weights for policy 1, policy_version 259332 (0.0009) [2023-12-26 01:39:51,471][123090] Updated weights for policy 1, policy_version 259342 (0.0010) [2023-12-26 01:39:51,536][123090] Updated weights for policy 1, policy_version 259352 (0.0010) [2023-12-26 01:39:51,563][123091] Updated weights for policy 0, policy_version 260756 (0.0007) [2023-12-26 01:39:51,620][123091] Updated weights for policy 0, policy_version 260766 (0.0009) [2023-12-26 01:39:51,688][123091] Updated weights for policy 0, policy_version 260776 (0.0010) [2023-12-26 01:39:52,338][123090] Updated weights for policy 1, policy_version 259362 (0.0009) [2023-12-26 01:39:52,407][123090] Updated weights for policy 1, policy_version 259372 (0.0007) [2023-12-26 01:39:52,474][123090] Updated weights for policy 1, policy_version 259382 (0.0006) [2023-12-26 01:39:52,547][123090] Updated weights for policy 1, policy_version 259392 (0.0006) [2023-12-26 01:39:52,548][123091] Updated weights for policy 0, policy_version 260786 (0.0010) [2023-12-26 01:39:52,616][123091] Updated weights for policy 0, policy_version 260796 (0.0010) [2023-12-26 01:39:52,676][123091] Updated weights for policy 0, policy_version 260806 (0.0010) [2023-12-26 01:39:52,741][123091] Updated weights for policy 0, policy_version 260816 (0.0009) [2023-12-26 01:39:53,220][123090] Updated weights for policy 1, policy_version 259402 (0.0010) [2023-12-26 01:39:53,290][123090] Updated weights for policy 1, policy_version 259412 (0.0010) [2023-12-26 01:39:53,357][123090] Updated weights for policy 1, policy_version 259422 (0.0011) [2023-12-26 01:39:53,617][123091] Updated weights for policy 0, policy_version 260826 (0.0009) [2023-12-26 01:39:53,665][123091] Updated weights for policy 0, policy_version 260836 (0.0009) [2023-12-26 01:39:53,732][123091] Updated weights for policy 0, policy_version 260846 (0.0009) [2023-12-26 01:39:53,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 133193728. Throughput: 0: 9146.6, 1: 8619.7. Samples: 133167128. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:53,785][121949] Avg episode reward: [(0, '6152.472'), (1, '4992.469')] [2023-12-26 01:39:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000260848_66781184.pth... [2023-12-26 01:39:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000259424_66412544.pth... [2023-12-26 01:39:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000259760_66502656.pth [2023-12-26 01:39:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000258400_66150400.pth [2023-12-26 01:39:54,089][123090] Updated weights for policy 1, policy_version 259432 (0.0006) [2023-12-26 01:39:54,147][123090] Updated weights for policy 1, policy_version 259442 (0.0005) [2023-12-26 01:39:54,210][123090] Updated weights for policy 1, policy_version 259452 (0.0007) [2023-12-26 01:39:54,609][123091] Updated weights for policy 0, policy_version 260856 (0.0009) [2023-12-26 01:39:54,662][123091] Updated weights for policy 0, policy_version 260866 (0.0010) [2023-12-26 01:39:54,721][123091] Updated weights for policy 0, policy_version 260878 (0.0011) [2023-12-26 01:39:54,961][123090] Updated weights for policy 1, policy_version 259462 (0.0009) [2023-12-26 01:39:55,034][123090] Updated weights for policy 1, policy_version 259472 (0.0009) [2023-12-26 01:39:55,092][123090] Updated weights for policy 1, policy_version 259482 (0.0009) [2023-12-26 01:39:55,588][123091] Updated weights for policy 0, policy_version 260888 (0.0010) [2023-12-26 01:39:55,649][123091] Updated weights for policy 0, policy_version 260898 (0.0009) [2023-12-26 01:39:55,715][123091] Updated weights for policy 0, policy_version 260908 (0.0009) [2023-12-26 01:39:55,900][123090] Updated weights for policy 1, policy_version 259492 (0.0009) [2023-12-26 01:39:55,955][123090] Updated weights for policy 1, policy_version 259502 (0.0010) [2023-12-26 01:39:56,006][123090] Updated weights for policy 1, policy_version 259512 (0.0010) [2023-12-26 01:39:56,443][123091] Updated weights for policy 0, policy_version 260918 (0.0008) [2023-12-26 01:39:56,490][123091] Updated weights for policy 0, policy_version 260928 (0.0008) [2023-12-26 01:39:56,542][123091] Updated weights for policy 0, policy_version 260938 (0.0009) [2023-12-26 01:39:56,834][123090] Updated weights for policy 1, policy_version 259522 (0.0009) [2023-12-26 01:39:56,896][123090] Updated weights for policy 1, policy_version 259532 (0.0005) [2023-12-26 01:39:56,948][123090] Updated weights for policy 1, policy_version 259542 (0.0005) [2023-12-26 01:39:57,000][123090] Updated weights for policy 1, policy_version 259552 (0.0005) [2023-12-26 01:39:57,307][123091] Updated weights for policy 0, policy_version 260948 (0.0010) [2023-12-26 01:39:57,366][123091] Updated weights for policy 0, policy_version 260958 (0.0006) [2023-12-26 01:39:57,427][123091] Updated weights for policy 0, policy_version 260968 (0.0005) [2023-12-26 01:39:57,784][123090] Updated weights for policy 1, policy_version 259562 (0.0010) [2023-12-26 01:39:57,842][123090] Updated weights for policy 1, policy_version 259572 (0.0010) [2023-12-26 01:39:57,902][123090] Updated weights for policy 1, policy_version 259582 (0.0010) [2023-12-26 01:39:58,115][123091] Updated weights for policy 0, policy_version 260978 (0.0006) [2023-12-26 01:39:58,179][123091] Updated weights for policy 0, policy_version 260988 (0.0008) [2023-12-26 01:39:58,239][123091] Updated weights for policy 0, policy_version 260998 (0.0008) [2023-12-26 01:39:58,292][123091] Updated weights for policy 0, policy_version 261008 (0.0008) [2023-12-26 01:39:58,770][123090] Updated weights for policy 1, policy_version 259592 (0.0009) [2023-12-26 01:39:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 133275648. Throughput: 0: 9097.8, 1: 8767.3. Samples: 133274844. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:39:58,784][121949] Avg episode reward: [(0, '6067.413'), (1, '5234.499')] [2023-12-26 01:39:58,838][123090] Updated weights for policy 1, policy_version 259602 (0.0007) [2023-12-26 01:39:58,905][123090] Updated weights for policy 1, policy_version 259612 (0.0008) [2023-12-26 01:39:59,123][123091] Updated weights for policy 0, policy_version 261018 (0.0011) [2023-12-26 01:39:59,208][123091] Updated weights for policy 0, policy_version 261028 (0.0010) [2023-12-26 01:39:59,276][123091] Updated weights for policy 0, policy_version 261038 (0.0011) [2023-12-26 01:39:59,692][123090] Updated weights for policy 1, policy_version 259622 (0.0008) [2023-12-26 01:39:59,757][123090] Updated weights for policy 1, policy_version 259632 (0.0010) [2023-12-26 01:39:59,818][123090] Updated weights for policy 1, policy_version 259642 (0.0010) [2023-12-26 01:40:00,084][123091] Updated weights for policy 0, policy_version 261048 (0.0010) [2023-12-26 01:40:00,132][123091] Updated weights for policy 0, policy_version 261058 (0.0010) [2023-12-26 01:40:00,184][123091] Updated weights for policy 0, policy_version 261068 (0.0007) [2023-12-26 01:40:00,637][123090] Updated weights for policy 1, policy_version 259652 (0.0010) [2023-12-26 01:40:00,707][123090] Updated weights for policy 1, policy_version 259662 (0.0011) [2023-12-26 01:40:00,763][123090] Updated weights for policy 1, policy_version 259672 (0.0010) [2023-12-26 01:40:00,927][123091] Updated weights for policy 0, policy_version 261078 (0.0005) [2023-12-26 01:40:00,991][123091] Updated weights for policy 0, policy_version 261088 (0.0007) [2023-12-26 01:40:01,080][123091] Updated weights for policy 0, policy_version 261098 (0.0010) [2023-12-26 01:40:01,614][123090] Updated weights for policy 1, policy_version 259682 (0.0010) [2023-12-26 01:40:01,667][123090] Updated weights for policy 1, policy_version 259692 (0.0009) [2023-12-26 01:40:01,731][123091] Updated weights for policy 0, policy_version 261108 (0.0011) [2023-12-26 01:40:01,738][123090] Updated weights for policy 1, policy_version 259702 (0.0008) [2023-12-26 01:40:01,782][123091] Updated weights for policy 0, policy_version 261118 (0.0010) [2023-12-26 01:40:01,806][123090] Updated weights for policy 1, policy_version 259712 (0.0006) [2023-12-26 01:40:01,844][123091] Updated weights for policy 0, policy_version 261128 (0.0008) [2023-12-26 01:40:02,571][123091] Updated weights for policy 0, policy_version 261138 (0.0005) [2023-12-26 01:40:02,621][123090] Updated weights for policy 1, policy_version 259722 (0.0006) [2023-12-26 01:40:02,637][123091] Updated weights for policy 0, policy_version 261148 (0.0007) [2023-12-26 01:40:02,672][123090] Updated weights for policy 1, policy_version 259732 (0.0008) [2023-12-26 01:40:02,702][123091] Updated weights for policy 0, policy_version 261158 (0.0009) [2023-12-26 01:40:02,722][123090] Updated weights for policy 1, policy_version 259742 (0.0007) [2023-12-26 01:40:02,757][123091] Updated weights for policy 0, policy_version 261168 (0.0010) [2023-12-26 01:40:03,428][123091] Updated weights for policy 0, policy_version 261178 (0.0005) [2023-12-26 01:40:03,490][123091] Updated weights for policy 0, policy_version 261188 (0.0005) [2023-12-26 01:40:03,498][123090] Updated weights for policy 1, policy_version 259752 (0.0005) [2023-12-26 01:40:03,549][123091] Updated weights for policy 0, policy_version 261198 (0.0007) [2023-12-26 01:40:03,562][123090] Updated weights for policy 1, policy_version 259762 (0.0005) [2023-12-26 01:40:03,608][123090] Updated weights for policy 1, policy_version 259772 (0.0005) [2023-12-26 01:40:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 133373952. Throughput: 0: 9186.2, 1: 8750.3. Samples: 133382120. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:03,785][121949] Avg episode reward: [(0, '5780.270'), (1, '5087.592')] [2023-12-26 01:40:04,205][123090] Updated weights for policy 1, policy_version 259782 (0.0008) [2023-12-26 01:40:04,230][123091] Updated weights for policy 0, policy_version 261208 (0.0006) [2023-12-26 01:40:04,267][123090] Updated weights for policy 1, policy_version 259792 (0.0008) [2023-12-26 01:40:04,292][123091] Updated weights for policy 0, policy_version 261218 (0.0006) [2023-12-26 01:40:04,332][123090] Updated weights for policy 1, policy_version 259802 (0.0009) [2023-12-26 01:40:04,352][123091] Updated weights for policy 0, policy_version 261228 (0.0006) [2023-12-26 01:40:05,029][123091] Updated weights for policy 0, policy_version 261238 (0.0006) [2023-12-26 01:40:05,082][123091] Updated weights for policy 0, policy_version 261248 (0.0005) [2023-12-26 01:40:05,114][123090] Updated weights for policy 1, policy_version 259812 (0.0009) [2023-12-26 01:40:05,138][123091] Updated weights for policy 0, policy_version 261258 (0.0005) [2023-12-26 01:40:05,166][123090] Updated weights for policy 1, policy_version 259822 (0.0008) [2023-12-26 01:40:05,215][123090] Updated weights for policy 1, policy_version 259832 (0.0009) [2023-12-26 01:40:05,801][123091] Updated weights for policy 0, policy_version 261268 (0.0008) [2023-12-26 01:40:05,867][123091] Updated weights for policy 0, policy_version 261278 (0.0008) [2023-12-26 01:40:05,932][123091] Updated weights for policy 0, policy_version 261288 (0.0008) [2023-12-26 01:40:06,059][123090] Updated weights for policy 1, policy_version 259842 (0.0010) [2023-12-26 01:40:06,123][123090] Updated weights for policy 1, policy_version 259852 (0.0008) [2023-12-26 01:40:06,189][123090] Updated weights for policy 1, policy_version 259862 (0.0009) [2023-12-26 01:40:06,251][123090] Updated weights for policy 1, policy_version 259872 (0.0009) [2023-12-26 01:40:06,700][123091] Updated weights for policy 0, policy_version 261298 (0.0006) [2023-12-26 01:40:06,775][123091] Updated weights for policy 0, policy_version 261308 (0.0008) [2023-12-26 01:40:06,840][123091] Updated weights for policy 0, policy_version 261318 (0.0006) [2023-12-26 01:40:06,906][123091] Updated weights for policy 0, policy_version 261328 (0.0006) [2023-12-26 01:40:07,100][123090] Updated weights for policy 1, policy_version 259882 (0.0005) [2023-12-26 01:40:07,168][123090] Updated weights for policy 1, policy_version 259892 (0.0009) [2023-12-26 01:40:07,233][123090] Updated weights for policy 1, policy_version 259902 (0.0009) [2023-12-26 01:40:07,641][123091] Updated weights for policy 0, policy_version 261338 (0.0005) [2023-12-26 01:40:07,704][123091] Updated weights for policy 0, policy_version 261348 (0.0006) [2023-12-26 01:40:07,767][123091] Updated weights for policy 0, policy_version 261358 (0.0011) [2023-12-26 01:40:08,025][123090] Updated weights for policy 1, policy_version 259912 (0.0006) [2023-12-26 01:40:08,081][123090] Updated weights for policy 1, policy_version 259922 (0.0005) [2023-12-26 01:40:08,131][123090] Updated weights for policy 1, policy_version 259932 (0.0007) [2023-12-26 01:40:08,519][123091] Updated weights for policy 0, policy_version 261368 (0.0011) [2023-12-26 01:40:08,586][123091] Updated weights for policy 0, policy_version 261378 (0.0011) [2023-12-26 01:40:08,652][123091] Updated weights for policy 0, policy_version 261388 (0.0011) [2023-12-26 01:40:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 133464064. Throughput: 0: 9292.0, 1: 8745.1. Samples: 133438376. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:08,785][121949] Avg episode reward: [(0, '5592.666'), (1, '4896.137')] [2023-12-26 01:40:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000261392_66920448.pth... [2023-12-26 01:40:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000259936_66543616.pth... [2023-12-26 01:40:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000260304_66641920.pth [2023-12-26 01:40:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000258912_66281472.pth [2023-12-26 01:40:08,931][123090] Updated weights for policy 1, policy_version 259942 (0.0008) [2023-12-26 01:40:08,990][123090] Updated weights for policy 1, policy_version 259952 (0.0010) [2023-12-26 01:40:09,064][123090] Updated weights for policy 1, policy_version 259962 (0.0011) [2023-12-26 01:40:09,499][123091] Updated weights for policy 0, policy_version 261398 (0.0010) [2023-12-26 01:40:09,564][123091] Updated weights for policy 0, policy_version 261408 (0.0009) [2023-12-26 01:40:09,630][123091] Updated weights for policy 0, policy_version 261418 (0.0009) [2023-12-26 01:40:09,892][123090] Updated weights for policy 1, policy_version 259972 (0.0010) [2023-12-26 01:40:09,960][123090] Updated weights for policy 1, policy_version 259982 (0.0010) [2023-12-26 01:40:10,023][123090] Updated weights for policy 1, policy_version 259992 (0.0010) [2023-12-26 01:40:10,502][123091] Updated weights for policy 0, policy_version 261428 (0.0009) [2023-12-26 01:40:10,564][123091] Updated weights for policy 0, policy_version 261438 (0.0009) [2023-12-26 01:40:10,618][123091] Updated weights for policy 0, policy_version 261448 (0.0009) [2023-12-26 01:40:10,843][123090] Updated weights for policy 1, policy_version 260003 (0.0008) [2023-12-26 01:40:10,903][123090] Updated weights for policy 1, policy_version 260013 (0.0007) [2023-12-26 01:40:10,986][123090] Updated weights for policy 1, policy_version 260023 (0.0006) [2023-12-26 01:40:11,551][123091] Updated weights for policy 0, policy_version 261458 (0.0007) [2023-12-26 01:40:11,610][123091] Updated weights for policy 0, policy_version 261468 (0.0009) [2023-12-26 01:40:11,677][123091] Updated weights for policy 0, policy_version 261478 (0.0010) [2023-12-26 01:40:11,741][123091] Updated weights for policy 0, policy_version 261488 (0.0010) [2023-12-26 01:40:11,798][123090] Updated weights for policy 1, policy_version 260033 (0.0011) [2023-12-26 01:40:11,871][123090] Updated weights for policy 1, policy_version 260043 (0.0008) [2023-12-26 01:40:11,920][123090] Updated weights for policy 1, policy_version 260053 (0.0010) [2023-12-26 01:40:11,976][123090] Updated weights for policy 1, policy_version 260063 (0.0010) [2023-12-26 01:40:12,628][123091] Updated weights for policy 0, policy_version 261498 (0.0006) [2023-12-26 01:40:12,695][123091] Updated weights for policy 0, policy_version 261508 (0.0009) [2023-12-26 01:40:12,756][123091] Updated weights for policy 0, policy_version 261518 (0.0010) [2023-12-26 01:40:12,803][123090] Updated weights for policy 1, policy_version 260073 (0.0009) [2023-12-26 01:40:12,858][123090] Updated weights for policy 1, policy_version 260083 (0.0006) [2023-12-26 01:40:12,907][123090] Updated weights for policy 1, policy_version 260093 (0.0005) [2023-12-26 01:40:13,541][123091] Updated weights for policy 0, policy_version 261528 (0.0010) [2023-12-26 01:40:13,601][123091] Updated weights for policy 0, policy_version 261538 (0.0009) [2023-12-26 01:40:13,658][123091] Updated weights for policy 0, policy_version 261548 (0.0009) [2023-12-26 01:40:13,751][123090] Updated weights for policy 1, policy_version 260103 (0.0010) [2023-12-26 01:40:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 133545984. Throughput: 0: 9115.8, 1: 8730.9. Samples: 133541224. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:13,785][121949] Avg episode reward: [(0, '5637.921'), (1, '4850.772')] [2023-12-26 01:40:13,806][123090] Updated weights for policy 1, policy_version 260113 (0.0009) [2023-12-26 01:40:13,862][123090] Updated weights for policy 1, policy_version 260123 (0.0009) [2023-12-26 01:40:14,506][123091] Updated weights for policy 0, policy_version 261558 (0.0008) [2023-12-26 01:40:14,561][123091] Updated weights for policy 0, policy_version 261568 (0.0006) [2023-12-26 01:40:14,614][123091] Updated weights for policy 0, policy_version 261578 (0.0010) [2023-12-26 01:40:14,718][123090] Updated weights for policy 1, policy_version 260133 (0.0008) [2023-12-26 01:40:14,787][123090] Updated weights for policy 1, policy_version 260143 (0.0008) [2023-12-26 01:40:14,848][123090] Updated weights for policy 1, policy_version 260153 (0.0009) [2023-12-26 01:40:15,461][123091] Updated weights for policy 0, policy_version 261588 (0.0010) [2023-12-26 01:40:15,522][123091] Updated weights for policy 0, policy_version 261598 (0.0009) [2023-12-26 01:40:15,587][123091] Updated weights for policy 0, policy_version 261608 (0.0009) [2023-12-26 01:40:15,688][123090] Updated weights for policy 1, policy_version 260163 (0.0009) [2023-12-26 01:40:15,750][123090] Updated weights for policy 1, policy_version 260173 (0.0010) [2023-12-26 01:40:15,820][123090] Updated weights for policy 1, policy_version 260183 (0.0010) [2023-12-26 01:40:16,422][123091] Updated weights for policy 0, policy_version 261618 (0.0010) [2023-12-26 01:40:16,482][123091] Updated weights for policy 0, policy_version 261628 (0.0010) [2023-12-26 01:40:16,542][123091] Updated weights for policy 0, policy_version 261638 (0.0010) [2023-12-26 01:40:16,608][123091] Updated weights for policy 0, policy_version 261648 (0.0009) [2023-12-26 01:40:16,655][123090] Updated weights for policy 1, policy_version 260193 (0.0010) [2023-12-26 01:40:16,719][123090] Updated weights for policy 1, policy_version 260203 (0.0010) [2023-12-26 01:40:16,783][123090] Updated weights for policy 1, policy_version 260213 (0.0009) [2023-12-26 01:40:16,849][123090] Updated weights for policy 1, policy_version 260223 (0.0010) [2023-12-26 01:40:17,436][123091] Updated weights for policy 0, policy_version 261658 (0.0010) [2023-12-26 01:40:17,486][123091] Updated weights for policy 0, policy_version 261668 (0.0009) [2023-12-26 01:40:17,532][123091] Updated weights for policy 0, policy_version 261678 (0.0008) [2023-12-26 01:40:17,673][123090] Updated weights for policy 1, policy_version 260233 (0.0009) [2023-12-26 01:40:17,744][123090] Updated weights for policy 1, policy_version 260243 (0.0009) [2023-12-26 01:40:17,805][123090] Updated weights for policy 1, policy_version 260253 (0.0009) [2023-12-26 01:40:18,439][123091] Updated weights for policy 0, policy_version 261688 (0.0009) [2023-12-26 01:40:18,491][123091] Updated weights for policy 0, policy_version 261698 (0.0009) [2023-12-26 01:40:18,511][123090] Updated weights for policy 1, policy_version 260263 (0.0009) [2023-12-26 01:40:18,541][123091] Updated weights for policy 0, policy_version 261708 (0.0008) [2023-12-26 01:40:18,561][123090] Updated weights for policy 1, policy_version 260273 (0.0009) [2023-12-26 01:40:18,625][123090] Updated weights for policy 1, policy_version 260283 (0.0010) [2023-12-26 01:40:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 133636096. Throughput: 0: 9004.4, 1: 8765.9. Samples: 133643340. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:18,785][121949] Avg episode reward: [(0, '5771.896'), (1, '4358.916')] [2023-12-26 01:40:19,308][123091] Updated weights for policy 0, policy_version 261718 (0.0009) [2023-12-26 01:40:19,380][123091] Updated weights for policy 0, policy_version 261728 (0.0009) [2023-12-26 01:40:19,442][123091] Updated weights for policy 0, policy_version 261738 (0.0010) [2023-12-26 01:40:19,532][123090] Updated weights for policy 1, policy_version 260293 (0.0008) [2023-12-26 01:40:19,592][123090] Updated weights for policy 1, policy_version 260303 (0.0010) [2023-12-26 01:40:19,656][123090] Updated weights for policy 1, policy_version 260313 (0.0009) [2023-12-26 01:40:20,353][123091] Updated weights for policy 0, policy_version 261748 (0.0010) [2023-12-26 01:40:20,386][123090] Updated weights for policy 1, policy_version 260323 (0.0009) [2023-12-26 01:40:20,418][123091] Updated weights for policy 0, policy_version 261758 (0.0010) [2023-12-26 01:40:20,448][123090] Updated weights for policy 1, policy_version 260333 (0.0006) [2023-12-26 01:40:20,485][123091] Updated weights for policy 0, policy_version 261768 (0.0008) [2023-12-26 01:40:20,505][123090] Updated weights for policy 1, policy_version 260343 (0.0008) [2023-12-26 01:40:21,332][123090] Updated weights for policy 1, policy_version 260353 (0.0008) [2023-12-26 01:40:21,337][123091] Updated weights for policy 0, policy_version 261778 (0.0009) [2023-12-26 01:40:21,404][123090] Updated weights for policy 1, policy_version 260363 (0.0008) [2023-12-26 01:40:21,410][123091] Updated weights for policy 0, policy_version 261788 (0.0010) [2023-12-26 01:40:21,474][123091] Updated weights for policy 0, policy_version 261798 (0.0008) [2023-12-26 01:40:21,477][123090] Updated weights for policy 1, policy_version 260373 (0.0006) [2023-12-26 01:40:21,540][123091] Updated weights for policy 0, policy_version 261808 (0.0009) [2023-12-26 01:40:21,546][123090] Updated weights for policy 1, policy_version 260383 (0.0005) [2023-12-26 01:40:22,276][123090] Updated weights for policy 1, policy_version 260393 (0.0009) [2023-12-26 01:40:22,334][123091] Updated weights for policy 0, policy_version 261818 (0.0009) [2023-12-26 01:40:22,340][123090] Updated weights for policy 1, policy_version 260403 (0.0008) [2023-12-26 01:40:22,399][123091] Updated weights for policy 0, policy_version 261828 (0.0008) [2023-12-26 01:40:22,409][123090] Updated weights for policy 1, policy_version 260413 (0.0010) [2023-12-26 01:40:22,451][123091] Updated weights for policy 0, policy_version 261838 (0.0008) [2023-12-26 01:40:23,201][123090] Updated weights for policy 1, policy_version 260423 (0.0010) [2023-12-26 01:40:23,252][123090] Updated weights for policy 1, policy_version 260433 (0.0010) [2023-12-26 01:40:23,272][123091] Updated weights for policy 0, policy_version 261848 (0.0007) [2023-12-26 01:40:23,300][123090] Updated weights for policy 1, policy_version 260443 (0.0010) [2023-12-26 01:40:23,316][123091] Updated weights for policy 0, policy_version 261858 (0.0006) [2023-12-26 01:40:23,363][123091] Updated weights for policy 0, policy_version 261868 (0.0009) [2023-12-26 01:40:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 133718016. Throughput: 0: 8963.5, 1: 8763.9. Samples: 133694036. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:23,785][121949] Avg episode reward: [(0, '5997.562'), (1, '4200.199')] [2023-12-26 01:40:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000261872_67043328.pth... [2023-12-26 01:40:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000260448_66674688.pth... [2023-12-26 01:40:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000260848_66781184.pth [2023-12-26 01:40:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000259424_66412544.pth [2023-12-26 01:40:24,142][123090] Updated weights for policy 1, policy_version 260453 (0.0010) [2023-12-26 01:40:24,194][123090] Updated weights for policy 1, policy_version 260463 (0.0010) [2023-12-26 01:40:24,222][123091] Updated weights for policy 0, policy_version 261878 (0.0008) [2023-12-26 01:40:24,256][123090] Updated weights for policy 1, policy_version 260473 (0.0010) [2023-12-26 01:40:24,288][123091] Updated weights for policy 0, policy_version 261888 (0.0007) [2023-12-26 01:40:24,351][123091] Updated weights for policy 0, policy_version 261898 (0.0008) [2023-12-26 01:40:25,026][123090] Updated weights for policy 1, policy_version 260483 (0.0009) [2023-12-26 01:40:25,080][123090] Updated weights for policy 1, policy_version 260493 (0.0005) [2023-12-26 01:40:25,128][123090] Updated weights for policy 1, policy_version 260503 (0.0005) [2023-12-26 01:40:25,218][123091] Updated weights for policy 0, policy_version 261908 (0.0009) [2023-12-26 01:40:25,276][123091] Updated weights for policy 0, policy_version 261918 (0.0010) [2023-12-26 01:40:25,335][123091] Updated weights for policy 0, policy_version 261928 (0.0010) [2023-12-26 01:40:25,825][123090] Updated weights for policy 1, policy_version 260513 (0.0006) [2023-12-26 01:40:25,886][123090] Updated weights for policy 1, policy_version 260523 (0.0009) [2023-12-26 01:40:25,951][123090] Updated weights for policy 1, policy_version 260533 (0.0010) [2023-12-26 01:40:26,014][123090] Updated weights for policy 1, policy_version 260543 (0.0009) [2023-12-26 01:40:26,095][123091] Updated weights for policy 0, policy_version 261938 (0.0009) [2023-12-26 01:40:26,150][123091] Updated weights for policy 0, policy_version 261948 (0.0009) [2023-12-26 01:40:26,207][123091] Updated weights for policy 0, policy_version 261958 (0.0008) [2023-12-26 01:40:26,265][123091] Updated weights for policy 0, policy_version 261968 (0.0009) [2023-12-26 01:40:26,833][123090] Updated weights for policy 1, policy_version 260553 (0.0006) [2023-12-26 01:40:26,906][123090] Updated weights for policy 1, policy_version 260563 (0.0005) [2023-12-26 01:40:26,976][123090] Updated weights for policy 1, policy_version 260573 (0.0005) [2023-12-26 01:40:27,106][123091] Updated weights for policy 0, policy_version 261978 (0.0010) [2023-12-26 01:40:27,173][123091] Updated weights for policy 0, policy_version 261988 (0.0010) [2023-12-26 01:40:27,239][123091] Updated weights for policy 0, policy_version 261998 (0.0010) [2023-12-26 01:40:27,628][123090] Updated weights for policy 1, policy_version 260583 (0.0008) [2023-12-26 01:40:27,690][123090] Updated weights for policy 1, policy_version 260593 (0.0008) [2023-12-26 01:40:27,752][123090] Updated weights for policy 1, policy_version 260603 (0.0009) [2023-12-26 01:40:28,062][123091] Updated weights for policy 0, policy_version 262008 (0.0010) [2023-12-26 01:40:28,117][123091] Updated weights for policy 0, policy_version 262018 (0.0010) [2023-12-26 01:40:28,169][123091] Updated weights for policy 0, policy_version 262028 (0.0009) [2023-12-26 01:40:28,499][123090] Updated weights for policy 1, policy_version 260613 (0.0008) [2023-12-26 01:40:28,558][123090] Updated weights for policy 1, policy_version 260623 (0.0009) [2023-12-26 01:40:28,621][123090] Updated weights for policy 1, policy_version 260633 (0.0009) [2023-12-26 01:40:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 133808128. Throughput: 0: 8917.6, 1: 8879.9. Samples: 133799532. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:28,785][121949] Avg episode reward: [(0, '6034.204'), (1, '4251.101')] [2023-12-26 01:40:29,082][123091] Updated weights for policy 0, policy_version 262038 (0.0008) [2023-12-26 01:40:29,135][123091] Updated weights for policy 0, policy_version 262048 (0.0005) [2023-12-26 01:40:29,201][123091] Updated weights for policy 0, policy_version 262058 (0.0005) [2023-12-26 01:40:29,360][123090] Updated weights for policy 1, policy_version 260643 (0.0009) [2023-12-26 01:40:29,425][123090] Updated weights for policy 1, policy_version 260653 (0.0011) [2023-12-26 01:40:29,483][123090] Updated weights for policy 1, policy_version 260663 (0.0012) [2023-12-26 01:40:29,903][123091] Updated weights for policy 0, policy_version 262068 (0.0008) [2023-12-26 01:40:29,975][123091] Updated weights for policy 0, policy_version 262078 (0.0011) [2023-12-26 01:40:30,038][123091] Updated weights for policy 0, policy_version 262088 (0.0010) [2023-12-26 01:40:30,212][123090] Updated weights for policy 1, policy_version 260673 (0.0009) [2023-12-26 01:40:30,276][123090] Updated weights for policy 1, policy_version 260683 (0.0006) [2023-12-26 01:40:30,337][123090] Updated weights for policy 1, policy_version 260693 (0.0005) [2023-12-26 01:40:30,395][123090] Updated weights for policy 1, policy_version 260703 (0.0005) [2023-12-26 01:40:30,851][123091] Updated weights for policy 0, policy_version 262098 (0.0011) [2023-12-26 01:40:30,901][123091] Updated weights for policy 0, policy_version 262108 (0.0010) [2023-12-26 01:40:30,956][123091] Updated weights for policy 0, policy_version 262118 (0.0010) [2023-12-26 01:40:31,014][123091] Updated weights for policy 0, policy_version 262128 (0.0010) [2023-12-26 01:40:31,046][123090] Updated weights for policy 1, policy_version 260713 (0.0010) [2023-12-26 01:40:31,098][123090] Updated weights for policy 1, policy_version 260723 (0.0010) [2023-12-26 01:40:31,170][123090] Updated weights for policy 1, policy_version 260733 (0.0009) [2023-12-26 01:40:31,772][123091] Updated weights for policy 0, policy_version 262138 (0.0011) [2023-12-26 01:40:31,824][123091] Updated weights for policy 0, policy_version 262148 (0.0010) [2023-12-26 01:40:31,882][123091] Updated weights for policy 0, policy_version 262158 (0.0010) [2023-12-26 01:40:32,024][123090] Updated weights for policy 1, policy_version 260743 (0.0010) [2023-12-26 01:40:32,094][123090] Updated weights for policy 1, policy_version 260753 (0.0010) [2023-12-26 01:40:32,142][123090] Updated weights for policy 1, policy_version 260763 (0.0010) [2023-12-26 01:40:32,697][123091] Updated weights for policy 0, policy_version 262168 (0.0006) [2023-12-26 01:40:32,760][123091] Updated weights for policy 0, policy_version 262178 (0.0006) [2023-12-26 01:40:32,821][123091] Updated weights for policy 0, policy_version 262188 (0.0007) [2023-12-26 01:40:32,949][123090] Updated weights for policy 1, policy_version 260773 (0.0009) [2023-12-26 01:40:33,016][123090] Updated weights for policy 1, policy_version 260783 (0.0010) [2023-12-26 01:40:33,075][123090] Updated weights for policy 1, policy_version 260793 (0.0010) [2023-12-26 01:40:33,515][123091] Updated weights for policy 0, policy_version 262198 (0.0007) [2023-12-26 01:40:33,567][123091] Updated weights for policy 0, policy_version 262208 (0.0005) [2023-12-26 01:40:33,618][123091] Updated weights for policy 0, policy_version 262219 (0.0008) [2023-12-26 01:40:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 133898240. Throughput: 0: 8812.4, 1: 8853.3. Samples: 133908452. Policy #0 lag: (min: 31.0, avg: 41.5, max: 63.0) [2023-12-26 01:40:33,785][121949] Avg episode reward: [(0, '6103.737'), (1, '4416.662')] [2023-12-26 01:40:33,794][123090] Updated weights for policy 1, policy_version 260803 (0.0010) [2023-12-26 01:40:33,850][123090] Updated weights for policy 1, policy_version 260813 (0.0009) [2023-12-26 01:40:33,912][123090] Updated weights for policy 1, policy_version 260823 (0.0008) [2023-12-26 01:40:34,461][123091] Updated weights for policy 0, policy_version 262229 (0.0010) [2023-12-26 01:40:34,505][123091] Updated weights for policy 0, policy_version 262239 (0.0010) [2023-12-26 01:40:34,561][123091] Updated weights for policy 0, policy_version 262249 (0.0010) [2023-12-26 01:40:34,754][123090] Updated weights for policy 1, policy_version 260833 (0.0009) [2023-12-26 01:40:34,827][123090] Updated weights for policy 1, policy_version 260843 (0.0009) [2023-12-26 01:40:34,887][123090] Updated weights for policy 1, policy_version 260853 (0.0010) [2023-12-26 01:40:34,948][123090] Updated weights for policy 1, policy_version 260863 (0.0009) [2023-12-26 01:40:35,312][123091] Updated weights for policy 0, policy_version 262259 (0.0009) [2023-12-26 01:40:35,373][123091] Updated weights for policy 0, policy_version 262269 (0.0009) [2023-12-26 01:40:35,428][123091] Updated weights for policy 0, policy_version 262280 (0.0010) [2023-12-26 01:40:35,717][123090] Updated weights for policy 1, policy_version 260873 (0.0005) [2023-12-26 01:40:35,768][123090] Updated weights for policy 1, policy_version 260883 (0.0005) [2023-12-26 01:40:35,823][123090] Updated weights for policy 1, policy_version 260893 (0.0008) [2023-12-26 01:40:36,315][123091] Updated weights for policy 0, policy_version 262291 (0.0010) [2023-12-26 01:40:36,375][123091] Updated weights for policy 0, policy_version 262301 (0.0011) [2023-12-26 01:40:36,438][123091] Updated weights for policy 0, policy_version 262311 (0.0011) [2023-12-26 01:40:36,657][123090] Updated weights for policy 1, policy_version 260903 (0.0009) [2023-12-26 01:40:36,713][123090] Updated weights for policy 1, policy_version 260913 (0.0009) [2023-12-26 01:40:36,774][123090] Updated weights for policy 1, policy_version 260923 (0.0009) [2023-12-26 01:40:37,252][123091] Updated weights for policy 0, policy_version 262321 (0.0010) [2023-12-26 01:40:37,315][123091] Updated weights for policy 0, policy_version 262331 (0.0005) [2023-12-26 01:40:37,374][123091] Updated weights for policy 0, policy_version 262341 (0.0005) [2023-12-26 01:40:37,435][123091] Updated weights for policy 0, policy_version 262351 (0.0010) [2023-12-26 01:40:37,639][123090] Updated weights for policy 1, policy_version 260933 (0.0008) [2023-12-26 01:40:37,707][123090] Updated weights for policy 1, policy_version 260943 (0.0009) [2023-12-26 01:40:37,768][123090] Updated weights for policy 1, policy_version 260953 (0.0009) [2023-12-26 01:40:38,147][123091] Updated weights for policy 0, policy_version 262361 (0.0006) [2023-12-26 01:40:38,211][123091] Updated weights for policy 0, policy_version 262371 (0.0005) [2023-12-26 01:40:38,278][123091] Updated weights for policy 0, policy_version 262381 (0.0007) [2023-12-26 01:40:38,674][123090] Updated weights for policy 1, policy_version 260963 (0.0009) [2023-12-26 01:40:38,730][123090] Updated weights for policy 1, policy_version 260973 (0.0009) [2023-12-26 01:40:38,779][123090] Updated weights for policy 1, policy_version 260983 (0.0009) [2023-12-26 01:40:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 133980160. Throughput: 0: 8761.0, 1: 8872.5. Samples: 133960636. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:40:38,785][121949] Avg episode reward: [(0, '6038.052'), (1, '4734.928')] [2023-12-26 01:40:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000262384_67174400.pth... [2023-12-26 01:40:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000261392_66920448.pth [2023-12-26 01:40:38,826][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000260992_66813952.pth... [2023-12-26 01:40:38,830][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000259936_66543616.pth [2023-12-26 01:40:39,043][123091] Updated weights for policy 0, policy_version 262391 (0.0009) [2023-12-26 01:40:39,105][123091] Updated weights for policy 0, policy_version 262401 (0.0010) [2023-12-26 01:40:39,152][123091] Updated weights for policy 0, policy_version 262411 (0.0010) [2023-12-26 01:40:39,642][123090] Updated weights for policy 1, policy_version 260993 (0.0009) [2023-12-26 01:40:39,697][123090] Updated weights for policy 1, policy_version 261003 (0.0009) [2023-12-26 01:40:39,749][123090] Updated weights for policy 1, policy_version 261013 (0.0009) [2023-12-26 01:40:39,841][123090] Updated weights for policy 1, policy_version 261023 (0.0009) [2023-12-26 01:40:40,063][123091] Updated weights for policy 0, policy_version 262421 (0.0010) [2023-12-26 01:40:40,130][123091] Updated weights for policy 0, policy_version 262431 (0.0011) [2023-12-26 01:40:40,198][123091] Updated weights for policy 0, policy_version 262441 (0.0011) [2023-12-26 01:40:40,678][123090] Updated weights for policy 1, policy_version 261033 (0.0009) [2023-12-26 01:40:40,745][123090] Updated weights for policy 1, policy_version 261043 (0.0008) [2023-12-26 01:40:40,805][123090] Updated weights for policy 1, policy_version 261053 (0.0009) [2023-12-26 01:40:41,025][123091] Updated weights for policy 0, policy_version 262451 (0.0011) [2023-12-26 01:40:41,092][123091] Updated weights for policy 0, policy_version 262461 (0.0011) [2023-12-26 01:40:41,159][123091] Updated weights for policy 0, policy_version 262471 (0.0011) [2023-12-26 01:40:41,628][123090] Updated weights for policy 1, policy_version 261063 (0.0007) [2023-12-26 01:40:41,700][123090] Updated weights for policy 1, policy_version 261073 (0.0007) [2023-12-26 01:40:41,770][123090] Updated weights for policy 1, policy_version 261083 (0.0009) [2023-12-26 01:40:41,994][123091] Updated weights for policy 0, policy_version 262481 (0.0010) [2023-12-26 01:40:42,065][123091] Updated weights for policy 0, policy_version 262491 (0.0006) [2023-12-26 01:40:42,130][123091] Updated weights for policy 0, policy_version 262501 (0.0006) [2023-12-26 01:40:42,196][123091] Updated weights for policy 0, policy_version 262511 (0.0005) [2023-12-26 01:40:42,519][123090] Updated weights for policy 1, policy_version 261093 (0.0008) [2023-12-26 01:40:42,583][123090] Updated weights for policy 1, policy_version 261103 (0.0009) [2023-12-26 01:40:42,655][123090] Updated weights for policy 1, policy_version 261113 (0.0010) [2023-12-26 01:40:42,901][123091] Updated weights for policy 0, policy_version 262521 (0.0006) [2023-12-26 01:40:42,968][123091] Updated weights for policy 0, policy_version 262531 (0.0006) [2023-12-26 01:40:43,035][123091] Updated weights for policy 0, policy_version 262541 (0.0006) [2023-12-26 01:40:43,518][123090] Updated weights for policy 1, policy_version 261123 (0.0010) [2023-12-26 01:40:43,576][123090] Updated weights for policy 1, policy_version 261133 (0.0009) [2023-12-26 01:40:43,639][123090] Updated weights for policy 1, policy_version 261143 (0.0008) [2023-12-26 01:40:43,672][123091] Updated weights for policy 0, policy_version 262551 (0.0008) [2023-12-26 01:40:43,735][123091] Updated weights for policy 0, policy_version 262561 (0.0008) [2023-12-26 01:40:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 134070272. Throughput: 0: 8773.1, 1: 8751.8. Samples: 134063468. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:40:43,785][121949] Avg episode reward: [(0, '6105.125'), (1, '4809.962')] [2023-12-26 01:40:43,801][123091] Updated weights for policy 0, policy_version 262571 (0.0010) [2023-12-26 01:40:44,483][123090] Updated weights for policy 1, policy_version 261153 (0.0010) [2023-12-26 01:40:44,545][123090] Updated weights for policy 1, policy_version 261163 (0.0010) [2023-12-26 01:40:44,567][123091] Updated weights for policy 0, policy_version 262581 (0.0007) [2023-12-26 01:40:44,605][123090] Updated weights for policy 1, policy_version 261173 (0.0009) [2023-12-26 01:40:44,632][123091] Updated weights for policy 0, policy_version 262591 (0.0006) [2023-12-26 01:40:44,670][123090] Updated weights for policy 1, policy_version 261183 (0.0008) [2023-12-26 01:40:44,693][123091] Updated weights for policy 0, policy_version 262601 (0.0006) [2023-12-26 01:40:45,502][123091] Updated weights for policy 0, policy_version 262611 (0.0009) [2023-12-26 01:40:45,560][123090] Updated weights for policy 1, policy_version 261193 (0.0007) [2023-12-26 01:40:45,562][123091] Updated weights for policy 0, policy_version 262621 (0.0008) [2023-12-26 01:40:45,626][123091] Updated weights for policy 0, policy_version 262631 (0.0009) [2023-12-26 01:40:45,629][123090] Updated weights for policy 1, policy_version 261203 (0.0008) [2023-12-26 01:40:45,694][123090] Updated weights for policy 1, policy_version 261213 (0.0009) [2023-12-26 01:40:46,474][123091] Updated weights for policy 0, policy_version 262641 (0.0008) [2023-12-26 01:40:46,489][123090] Updated weights for policy 1, policy_version 261223 (0.0008) [2023-12-26 01:40:46,525][123091] Updated weights for policy 0, policy_version 262651 (0.0009) [2023-12-26 01:40:46,540][123090] Updated weights for policy 1, policy_version 261233 (0.0006) [2023-12-26 01:40:46,580][123091] Updated weights for policy 0, policy_version 262661 (0.0010) [2023-12-26 01:40:46,600][123090] Updated weights for policy 1, policy_version 261243 (0.0005) [2023-12-26 01:40:46,631][123091] Updated weights for policy 0, policy_version 262671 (0.0010) [2023-12-26 01:40:47,313][123091] Updated weights for policy 0, policy_version 262681 (0.0006) [2023-12-26 01:40:47,373][123091] Updated weights for policy 0, policy_version 262691 (0.0006) [2023-12-26 01:40:47,411][123090] Updated weights for policy 1, policy_version 261253 (0.0006) [2023-12-26 01:40:47,434][123091] Updated weights for policy 0, policy_version 262701 (0.0006) [2023-12-26 01:40:47,479][123090] Updated weights for policy 1, policy_version 261263 (0.0008) [2023-12-26 01:40:47,549][123090] Updated weights for policy 1, policy_version 261273 (0.0006) [2023-12-26 01:40:48,219][123090] Updated weights for policy 1, policy_version 261283 (0.0006) [2023-12-26 01:40:48,239][123091] Updated weights for policy 0, policy_version 262711 (0.0008) [2023-12-26 01:40:48,284][123090] Updated weights for policy 1, policy_version 261293 (0.0009) [2023-12-26 01:40:48,288][123091] Updated weights for policy 0, policy_version 262721 (0.0008) [2023-12-26 01:40:48,346][123091] Updated weights for policy 0, policy_version 262731 (0.0009) [2023-12-26 01:40:48,352][123090] Updated weights for policy 1, policy_version 261303 (0.0007) [2023-12-26 01:40:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 134160384. Throughput: 0: 8768.3, 1: 8745.5. Samples: 134170240. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:40:48,785][121949] Avg episode reward: [(0, '6184.195'), (1, '5041.700')] [2023-12-26 01:40:49,173][123091] Updated weights for policy 0, policy_version 262741 (0.0008) [2023-12-26 01:40:49,197][123090] Updated weights for policy 1, policy_version 261313 (0.0010) [2023-12-26 01:40:49,243][123091] Updated weights for policy 0, policy_version 262751 (0.0008) [2023-12-26 01:40:49,264][123090] Updated weights for policy 1, policy_version 261323 (0.0007) [2023-12-26 01:40:49,309][123091] Updated weights for policy 0, policy_version 262761 (0.0008) [2023-12-26 01:40:49,326][123090] Updated weights for policy 1, policy_version 261333 (0.0009) [2023-12-26 01:40:49,395][123090] Updated weights for policy 1, policy_version 261343 (0.0007) [2023-12-26 01:40:50,036][123091] Updated weights for policy 0, policy_version 262771 (0.0008) [2023-12-26 01:40:50,100][123091] Updated weights for policy 0, policy_version 262781 (0.0005) [2023-12-26 01:40:50,165][123091] Updated weights for policy 0, policy_version 262791 (0.0006) [2023-12-26 01:40:50,248][123090] Updated weights for policy 1, policy_version 261353 (0.0008) [2023-12-26 01:40:50,317][123090] Updated weights for policy 1, policy_version 261363 (0.0007) [2023-12-26 01:40:50,383][123090] Updated weights for policy 1, policy_version 261373 (0.0005) [2023-12-26 01:40:50,963][123091] Updated weights for policy 0, policy_version 262801 (0.0008) [2023-12-26 01:40:51,022][123091] Updated weights for policy 0, policy_version 262811 (0.0010) [2023-12-26 01:40:51,085][123091] Updated weights for policy 0, policy_version 262822 (0.0011) [2023-12-26 01:40:51,103][123090] Updated weights for policy 1, policy_version 261383 (0.0007) [2023-12-26 01:40:51,144][123091] Updated weights for policy 0, policy_version 262832 (0.0008) [2023-12-26 01:40:51,169][123090] Updated weights for policy 1, policy_version 261393 (0.0009) [2023-12-26 01:40:51,234][123090] Updated weights for policy 1, policy_version 261403 (0.0009) [2023-12-26 01:40:52,019][123091] Updated weights for policy 0, policy_version 262842 (0.0010) [2023-12-26 01:40:52,049][123090] Updated weights for policy 1, policy_version 261413 (0.0010) [2023-12-26 01:40:52,070][123091] Updated weights for policy 0, policy_version 262852 (0.0008) [2023-12-26 01:40:52,108][123090] Updated weights for policy 1, policy_version 261423 (0.0007) [2023-12-26 01:40:52,119][123091] Updated weights for policy 0, policy_version 262862 (0.0009) [2023-12-26 01:40:52,159][123090] Updated weights for policy 1, policy_version 261433 (0.0009) [2023-12-26 01:40:52,962][123091] Updated weights for policy 0, policy_version 262872 (0.0009) [2023-12-26 01:40:53,013][123091] Updated weights for policy 0, policy_version 262883 (0.0010) [2023-12-26 01:40:53,029][123090] Updated weights for policy 1, policy_version 261443 (0.0009) [2023-12-26 01:40:53,075][123091] Updated weights for policy 0, policy_version 262893 (0.0007) [2023-12-26 01:40:53,083][123090] Updated weights for policy 1, policy_version 261453 (0.0007) [2023-12-26 01:40:53,138][123090] Updated weights for policy 1, policy_version 261463 (0.0008) [2023-12-26 01:40:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 134242304. Throughput: 0: 8701.9, 1: 8725.0. Samples: 134222592. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:40:53,785][121949] Avg episode reward: [(0, '6102.137'), (1, '5139.160')] [2023-12-26 01:40:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000262896_67305472.pth... [2023-12-26 01:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000261472_66936832.pth... [2023-12-26 01:40:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000261872_67043328.pth [2023-12-26 01:40:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000260448_66674688.pth [2023-12-26 01:40:53,947][123091] Updated weights for policy 0, policy_version 262903 (0.0010) [2023-12-26 01:40:53,970][123090] Updated weights for policy 1, policy_version 261473 (0.0009) [2023-12-26 01:40:54,009][123091] Updated weights for policy 0, policy_version 262913 (0.0007) [2023-12-26 01:40:54,024][123090] Updated weights for policy 1, policy_version 261483 (0.0010) [2023-12-26 01:40:54,060][123091] Updated weights for policy 0, policy_version 262923 (0.0008) [2023-12-26 01:40:54,084][123090] Updated weights for policy 1, policy_version 261493 (0.0008) [2023-12-26 01:40:54,153][123090] Updated weights for policy 1, policy_version 261503 (0.0009) [2023-12-26 01:40:54,849][123091] Updated weights for policy 0, policy_version 262933 (0.0007) [2023-12-26 01:40:54,914][123091] Updated weights for policy 0, policy_version 262943 (0.0007) [2023-12-26 01:40:54,977][123091] Updated weights for policy 0, policy_version 262953 (0.0008) [2023-12-26 01:40:55,021][123090] Updated weights for policy 1, policy_version 261513 (0.0006) [2023-12-26 01:40:55,090][123090] Updated weights for policy 1, policy_version 261523 (0.0005) [2023-12-26 01:40:55,154][123090] Updated weights for policy 1, policy_version 261533 (0.0005) [2023-12-26 01:40:55,748][123091] Updated weights for policy 0, policy_version 262963 (0.0007) [2023-12-26 01:40:55,815][123091] Updated weights for policy 0, policy_version 262973 (0.0005) [2023-12-26 01:40:55,882][123090] Updated weights for policy 1, policy_version 261543 (0.0008) [2023-12-26 01:40:55,887][123091] Updated weights for policy 0, policy_version 262983 (0.0005) [2023-12-26 01:40:55,943][123090] Updated weights for policy 1, policy_version 261553 (0.0008) [2023-12-26 01:40:56,007][123090] Updated weights for policy 1, policy_version 261563 (0.0009) [2023-12-26 01:40:56,439][123091] Updated weights for policy 0, policy_version 262993 (0.0007) [2023-12-26 01:40:56,494][123091] Updated weights for policy 0, policy_version 263003 (0.0008) [2023-12-26 01:40:56,544][123091] Updated weights for policy 0, policy_version 263013 (0.0005) [2023-12-26 01:40:56,593][123091] Updated weights for policy 0, policy_version 263023 (0.0005) [2023-12-26 01:40:56,904][123090] Updated weights for policy 1, policy_version 261573 (0.0009) [2023-12-26 01:40:56,964][123090] Updated weights for policy 1, policy_version 261583 (0.0008) [2023-12-26 01:40:57,026][123090] Updated weights for policy 1, policy_version 261593 (0.0009) [2023-12-26 01:40:57,336][123091] Updated weights for policy 0, policy_version 263033 (0.0008) [2023-12-26 01:40:57,386][123091] Updated weights for policy 0, policy_version 263043 (0.0010) [2023-12-26 01:40:57,432][123091] Updated weights for policy 0, policy_version 263053 (0.0008) [2023-12-26 01:40:57,926][123090] Updated weights for policy 1, policy_version 261603 (0.0009) [2023-12-26 01:40:58,000][123090] Updated weights for policy 1, policy_version 261613 (0.0009) [2023-12-26 01:40:58,069][123090] Updated weights for policy 1, policy_version 261623 (0.0009) [2023-12-26 01:40:58,125][123091] Updated weights for policy 0, policy_version 263063 (0.0007) [2023-12-26 01:40:58,185][123091] Updated weights for policy 0, policy_version 263073 (0.0008) [2023-12-26 01:40:58,250][123091] Updated weights for policy 0, policy_version 263083 (0.0008) [2023-12-26 01:40:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 134332416. Throughput: 0: 8793.2, 1: 8678.0. Samples: 134327424. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:40:58,785][121949] Avg episode reward: [(0, '6179.363'), (1, '5151.562')] [2023-12-26 01:40:59,013][123090] Updated weights for policy 1, policy_version 261633 (0.0009) [2023-12-26 01:40:59,083][123090] Updated weights for policy 1, policy_version 261643 (0.0009) [2023-12-26 01:40:59,093][123091] Updated weights for policy 0, policy_version 263093 (0.0008) [2023-12-26 01:40:59,148][123090] Updated weights for policy 1, policy_version 261653 (0.0009) [2023-12-26 01:40:59,166][123091] Updated weights for policy 0, policy_version 263103 (0.0008) [2023-12-26 01:40:59,212][123090] Updated weights for policy 1, policy_version 261663 (0.0008) [2023-12-26 01:40:59,230][123091] Updated weights for policy 0, policy_version 263113 (0.0008) [2023-12-26 01:41:00,044][123090] Updated weights for policy 1, policy_version 261673 (0.0008) [2023-12-26 01:41:00,046][123091] Updated weights for policy 0, policy_version 263123 (0.0007) [2023-12-26 01:41:00,097][123091] Updated weights for policy 0, policy_version 263133 (0.0005) [2023-12-26 01:41:00,107][123090] Updated weights for policy 1, policy_version 261683 (0.0007) [2023-12-26 01:41:00,157][123091] Updated weights for policy 0, policy_version 263143 (0.0006) [2023-12-26 01:41:00,166][123090] Updated weights for policy 1, policy_version 261693 (0.0007) [2023-12-26 01:41:00,903][123090] Updated weights for policy 1, policy_version 261703 (0.0006) [2023-12-26 01:41:00,924][123091] Updated weights for policy 0, policy_version 263153 (0.0006) [2023-12-26 01:41:00,960][123090] Updated weights for policy 1, policy_version 261713 (0.0009) [2023-12-26 01:41:00,983][123091] Updated weights for policy 0, policy_version 263163 (0.0008) [2023-12-26 01:41:01,023][123090] Updated weights for policy 1, policy_version 261723 (0.0008) [2023-12-26 01:41:01,047][123091] Updated weights for policy 0, policy_version 263173 (0.0007) [2023-12-26 01:41:01,107][123091] Updated weights for policy 0, policy_version 263183 (0.0009) [2023-12-26 01:41:01,758][123090] Updated weights for policy 1, policy_version 261733 (0.0009) [2023-12-26 01:41:01,818][123090] Updated weights for policy 1, policy_version 261743 (0.0009) [2023-12-26 01:41:01,885][123090] Updated weights for policy 1, policy_version 261753 (0.0009) [2023-12-26 01:41:01,998][123091] Updated weights for policy 0, policy_version 263193 (0.0010) [2023-12-26 01:41:02,047][123091] Updated weights for policy 0, policy_version 263203 (0.0009) [2023-12-26 01:41:02,095][123091] Updated weights for policy 0, policy_version 263213 (0.0008) [2023-12-26 01:41:02,704][123090] Updated weights for policy 1, policy_version 261763 (0.0010) [2023-12-26 01:41:02,759][123090] Updated weights for policy 1, policy_version 261773 (0.0009) [2023-12-26 01:41:02,815][123090] Updated weights for policy 1, policy_version 261783 (0.0009) [2023-12-26 01:41:02,932][123091] Updated weights for policy 0, policy_version 263223 (0.0010) [2023-12-26 01:41:02,987][123091] Updated weights for policy 0, policy_version 263234 (0.0010) [2023-12-26 01:41:03,050][123091] Updated weights for policy 0, policy_version 263244 (0.0010) [2023-12-26 01:41:03,638][123090] Updated weights for policy 1, policy_version 261793 (0.0009) [2023-12-26 01:41:03,694][123090] Updated weights for policy 1, policy_version 261803 (0.0009) [2023-12-26 01:41:03,754][123090] Updated weights for policy 1, policy_version 261813 (0.0009) [2023-12-26 01:41:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17716.9). Total num frames: 134414336. Throughput: 0: 8838.2, 1: 8674.8. Samples: 134431424. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:03,784][121949] Avg episode reward: [(0, '6265.683'), (1, '5331.024')] [2023-12-26 01:41:03,785][123007] Saving new best policy, reward=6265.683! [2023-12-26 01:41:03,804][123090] Updated weights for policy 1, policy_version 261823 (0.0008) [2023-12-26 01:41:03,899][123091] Updated weights for policy 0, policy_version 263254 (0.0010) [2023-12-26 01:41:03,962][123091] Updated weights for policy 0, policy_version 263264 (0.0009) [2023-12-26 01:41:04,016][123091] Updated weights for policy 0, policy_version 263274 (0.0010) [2023-12-26 01:41:04,682][123090] Updated weights for policy 1, policy_version 261833 (0.0010) [2023-12-26 01:41:04,730][123090] Updated weights for policy 1, policy_version 261843 (0.0010) [2023-12-26 01:41:04,776][123090] Updated weights for policy 1, policy_version 261853 (0.0010) [2023-12-26 01:41:04,881][123091] Updated weights for policy 0, policy_version 263284 (0.0010) [2023-12-26 01:41:04,933][123091] Updated weights for policy 0, policy_version 263294 (0.0009) [2023-12-26 01:41:04,989][123091] Updated weights for policy 0, policy_version 263304 (0.0008) [2023-12-26 01:41:05,573][123090] Updated weights for policy 1, policy_version 261863 (0.0007) [2023-12-26 01:41:05,618][123090] Updated weights for policy 1, policy_version 261873 (0.0005) [2023-12-26 01:41:05,669][123090] Updated weights for policy 1, policy_version 261883 (0.0005) [2023-12-26 01:41:05,737][123091] Updated weights for policy 0, policy_version 263314 (0.0009) [2023-12-26 01:41:05,794][123091] Updated weights for policy 0, policy_version 263324 (0.0010) [2023-12-26 01:41:05,862][123091] Updated weights for policy 0, policy_version 263334 (0.0009) [2023-12-26 01:41:05,918][123091] Updated weights for policy 0, policy_version 263344 (0.0009) [2023-12-26 01:41:06,340][123090] Updated weights for policy 1, policy_version 261893 (0.0007) [2023-12-26 01:41:06,399][123090] Updated weights for policy 1, policy_version 261903 (0.0008) [2023-12-26 01:41:06,455][123090] Updated weights for policy 1, policy_version 261913 (0.0008) [2023-12-26 01:41:06,833][123091] Updated weights for policy 0, policy_version 263354 (0.0011) [2023-12-26 01:41:06,886][123091] Updated weights for policy 0, policy_version 263365 (0.0010) [2023-12-26 01:41:06,940][123091] Updated weights for policy 0, policy_version 263376 (0.0010) [2023-12-26 01:41:07,200][123090] Updated weights for policy 1, policy_version 261923 (0.0009) [2023-12-26 01:41:07,262][123090] Updated weights for policy 1, policy_version 261933 (0.0010) [2023-12-26 01:41:07,328][123090] Updated weights for policy 1, policy_version 261943 (0.0010) [2023-12-26 01:41:07,825][123091] Updated weights for policy 0, policy_version 263386 (0.0010) [2023-12-26 01:41:07,882][123091] Updated weights for policy 0, policy_version 263396 (0.0009) [2023-12-26 01:41:07,939][123091] Updated weights for policy 0, policy_version 263406 (0.0009) [2023-12-26 01:41:08,102][123090] Updated weights for policy 1, policy_version 261953 (0.0010) [2023-12-26 01:41:08,157][123090] Updated weights for policy 1, policy_version 261963 (0.0006) [2023-12-26 01:41:08,211][123090] Updated weights for policy 1, policy_version 261973 (0.0006) [2023-12-26 01:41:08,260][123090] Updated weights for policy 1, policy_version 261983 (0.0005) [2023-12-26 01:41:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 134504448. Throughput: 0: 8855.2, 1: 8716.3. Samples: 134484748. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:08,784][121949] Avg episode reward: [(0, '6228.227'), (1, '5348.206')] [2023-12-26 01:41:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000261984_67067904.pth... [2023-12-26 01:41:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000260992_66813952.pth [2023-12-26 01:41:08,827][123091] Updated weights for policy 0, policy_version 263416 (0.0008) [2023-12-26 01:41:08,886][123091] Updated weights for policy 0, policy_version 263426 (0.0010) [2023-12-26 01:41:08,947][123091] Updated weights for policy 0, policy_version 263436 (0.0010) [2023-12-26 01:41:08,967][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000263440_67444736.pth... [2023-12-26 01:41:08,972][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000262384_67174400.pth [2023-12-26 01:41:09,024][123090] Updated weights for policy 1, policy_version 261993 (0.0005) [2023-12-26 01:41:09,079][123090] Updated weights for policy 1, policy_version 262003 (0.0005) [2023-12-26 01:41:09,130][123090] Updated weights for policy 1, policy_version 262013 (0.0005) [2023-12-26 01:41:09,863][123091] Updated weights for policy 0, policy_version 263446 (0.0009) [2023-12-26 01:41:09,909][123090] Updated weights for policy 1, policy_version 262023 (0.0006) [2023-12-26 01:41:09,934][123091] Updated weights for policy 0, policy_version 263456 (0.0009) [2023-12-26 01:41:09,976][123090] Updated weights for policy 1, policy_version 262033 (0.0008) [2023-12-26 01:41:10,000][123091] Updated weights for policy 0, policy_version 263466 (0.0006) [2023-12-26 01:41:10,032][123090] Updated weights for policy 1, policy_version 262043 (0.0008) [2023-12-26 01:41:10,831][123091] Updated weights for policy 0, policy_version 263476 (0.0006) [2023-12-26 01:41:10,833][123090] Updated weights for policy 1, policy_version 262053 (0.0009) [2023-12-26 01:41:10,885][123091] Updated weights for policy 0, policy_version 263486 (0.0009) [2023-12-26 01:41:10,897][123090] Updated weights for policy 1, policy_version 262063 (0.0008) [2023-12-26 01:41:10,935][123091] Updated weights for policy 0, policy_version 263496 (0.0008) [2023-12-26 01:41:10,956][123090] Updated weights for policy 1, policy_version 262073 (0.0006) [2023-12-26 01:41:11,799][123090] Updated weights for policy 1, policy_version 262083 (0.0008) [2023-12-26 01:41:11,833][123091] Updated weights for policy 0, policy_version 263506 (0.0009) [2023-12-26 01:41:11,861][123090] Updated weights for policy 1, policy_version 262093 (0.0009) [2023-12-26 01:41:11,899][123091] Updated weights for policy 0, policy_version 263516 (0.0008) [2023-12-26 01:41:11,925][123090] Updated weights for policy 1, policy_version 262103 (0.0009) [2023-12-26 01:41:11,966][123091] Updated weights for policy 0, policy_version 263526 (0.0009) [2023-12-26 01:41:12,030][123091] Updated weights for policy 0, policy_version 263536 (0.0009) [2023-12-26 01:41:12,745][123090] Updated weights for policy 1, policy_version 262113 (0.0007) [2023-12-26 01:41:12,813][123090] Updated weights for policy 1, policy_version 262123 (0.0010) [2023-12-26 01:41:12,848][123091] Updated weights for policy 0, policy_version 263546 (0.0006) [2023-12-26 01:41:12,870][123090] Updated weights for policy 1, policy_version 262133 (0.0011) [2023-12-26 01:41:12,903][123091] Updated weights for policy 0, policy_version 263556 (0.0007) [2023-12-26 01:41:12,926][123090] Updated weights for policy 1, policy_version 262143 (0.0010) [2023-12-26 01:41:12,957][123091] Updated weights for policy 0, policy_version 263566 (0.0006) [2023-12-26 01:41:13,599][123091] Updated weights for policy 0, policy_version 263576 (0.0009) [2023-12-26 01:41:13,660][123091] Updated weights for policy 0, policy_version 263586 (0.0009) [2023-12-26 01:41:13,728][123091] Updated weights for policy 0, policy_version 263596 (0.0009) [2023-12-26 01:41:13,734][123090] Updated weights for policy 1, policy_version 262153 (0.0008) [2023-12-26 01:41:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 134594560. Throughput: 0: 8809.0, 1: 8718.6. Samples: 134588272. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:13,785][121949] Avg episode reward: [(0, '6220.169'), (1, '5522.302')] [2023-12-26 01:41:13,800][123090] Updated weights for policy 1, policy_version 262163 (0.0006) [2023-12-26 01:41:13,864][123090] Updated weights for policy 1, policy_version 262173 (0.0008) [2023-12-26 01:41:14,553][123091] Updated weights for policy 0, policy_version 263606 (0.0008) [2023-12-26 01:41:14,611][123091] Updated weights for policy 0, policy_version 263616 (0.0007) [2023-12-26 01:41:14,648][123090] Updated weights for policy 1, policy_version 262183 (0.0010) [2023-12-26 01:41:14,674][123091] Updated weights for policy 0, policy_version 263626 (0.0007) [2023-12-26 01:41:14,714][123090] Updated weights for policy 1, policy_version 262193 (0.0011) [2023-12-26 01:41:14,788][123090] Updated weights for policy 1, policy_version 262203 (0.0010) [2023-12-26 01:41:15,534][123091] Updated weights for policy 0, policy_version 263636 (0.0009) [2023-12-26 01:41:15,556][123090] Updated weights for policy 1, policy_version 262213 (0.0007) [2023-12-26 01:41:15,591][123091] Updated weights for policy 0, policy_version 263646 (0.0010) [2023-12-26 01:41:15,606][123090] Updated weights for policy 1, policy_version 262223 (0.0008) [2023-12-26 01:41:15,653][123091] Updated weights for policy 0, policy_version 263656 (0.0007) [2023-12-26 01:41:15,659][123090] Updated weights for policy 1, policy_version 262233 (0.0010) [2023-12-26 01:41:16,487][123090] Updated weights for policy 1, policy_version 262243 (0.0009) [2023-12-26 01:41:16,494][123091] Updated weights for policy 0, policy_version 263666 (0.0009) [2023-12-26 01:41:16,541][123090] Updated weights for policy 1, policy_version 262253 (0.0009) [2023-12-26 01:41:16,543][123091] Updated weights for policy 0, policy_version 263676 (0.0006) [2023-12-26 01:41:16,592][123090] Updated weights for policy 1, policy_version 262263 (0.0005) [2023-12-26 01:41:16,596][123091] Updated weights for policy 0, policy_version 263686 (0.0005) [2023-12-26 01:41:16,651][123091] Updated weights for policy 0, policy_version 263696 (0.0006) [2023-12-26 01:41:17,409][123090] Updated weights for policy 1, policy_version 262273 (0.0008) [2023-12-26 01:41:17,461][123090] Updated weights for policy 1, policy_version 262283 (0.0007) [2023-12-26 01:41:17,462][123091] Updated weights for policy 0, policy_version 263706 (0.0010) [2023-12-26 01:41:17,509][123090] Updated weights for policy 1, policy_version 262293 (0.0007) [2023-12-26 01:41:17,515][123091] Updated weights for policy 0, policy_version 263716 (0.0010) [2023-12-26 01:41:17,569][123090] Updated weights for policy 1, policy_version 262303 (0.0008) [2023-12-26 01:41:17,572][123091] Updated weights for policy 0, policy_version 263726 (0.0008) [2023-12-26 01:41:18,402][123090] Updated weights for policy 1, policy_version 262313 (0.0009) [2023-12-26 01:41:18,430][123091] Updated weights for policy 0, policy_version 263736 (0.0010) [2023-12-26 01:41:18,466][123090] Updated weights for policy 1, policy_version 262323 (0.0009) [2023-12-26 01:41:18,487][123091] Updated weights for policy 0, policy_version 263746 (0.0007) [2023-12-26 01:41:18,532][123090] Updated weights for policy 1, policy_version 262333 (0.0009) [2023-12-26 01:41:18,552][123091] Updated weights for policy 0, policy_version 263756 (0.0007) [2023-12-26 01:41:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 134684672. Throughput: 0: 8767.1, 1: 8681.2. Samples: 134693628. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:18,785][121949] Avg episode reward: [(0, '6137.712'), (1, '5360.694')] [2023-12-26 01:41:19,353][123090] Updated weights for policy 1, policy_version 262343 (0.0009) [2023-12-26 01:41:19,406][123091] Updated weights for policy 0, policy_version 263766 (0.0009) [2023-12-26 01:41:19,419][123090] Updated weights for policy 1, policy_version 262353 (0.0007) [2023-12-26 01:41:19,464][123091] Updated weights for policy 0, policy_version 263776 (0.0008) [2023-12-26 01:41:19,465][123090] Updated weights for policy 1, policy_version 262363 (0.0009) [2023-12-26 01:41:19,534][123091] Updated weights for policy 0, policy_version 263786 (0.0009) [2023-12-26 01:41:20,303][123090] Updated weights for policy 1, policy_version 262373 (0.0009) [2023-12-26 01:41:20,360][123090] Updated weights for policy 1, policy_version 262383 (0.0010) [2023-12-26 01:41:20,424][123090] Updated weights for policy 1, policy_version 262393 (0.0011) [2023-12-26 01:41:20,447][123091] Updated weights for policy 0, policy_version 263796 (0.0010) [2023-12-26 01:41:20,517][123091] Updated weights for policy 0, policy_version 263806 (0.0010) [2023-12-26 01:41:20,588][123091] Updated weights for policy 0, policy_version 263816 (0.0010) [2023-12-26 01:41:21,196][123090] Updated weights for policy 1, policy_version 262403 (0.0007) [2023-12-26 01:41:21,269][123090] Updated weights for policy 1, policy_version 262413 (0.0009) [2023-12-26 01:41:21,339][123090] Updated weights for policy 1, policy_version 262423 (0.0009) [2023-12-26 01:41:21,434][123091] Updated weights for policy 0, policy_version 263826 (0.0009) [2023-12-26 01:41:21,492][123091] Updated weights for policy 0, policy_version 263836 (0.0010) [2023-12-26 01:41:21,556][123091] Updated weights for policy 0, policy_version 263846 (0.0009) [2023-12-26 01:41:21,626][123091] Updated weights for policy 0, policy_version 263856 (0.0010) [2023-12-26 01:41:22,099][123090] Updated weights for policy 1, policy_version 262433 (0.0009) [2023-12-26 01:41:22,163][123090] Updated weights for policy 1, policy_version 262443 (0.0009) [2023-12-26 01:41:22,231][123090] Updated weights for policy 1, policy_version 262453 (0.0010) [2023-12-26 01:41:22,301][123090] Updated weights for policy 1, policy_version 262463 (0.0008) [2023-12-26 01:41:22,476][123091] Updated weights for policy 0, policy_version 263866 (0.0009) [2023-12-26 01:41:22,531][123091] Updated weights for policy 0, policy_version 263876 (0.0009) [2023-12-26 01:41:22,583][123091] Updated weights for policy 0, policy_version 263886 (0.0009) [2023-12-26 01:41:23,033][123090] Updated weights for policy 1, policy_version 262473 (0.0005) [2023-12-26 01:41:23,095][123090] Updated weights for policy 1, policy_version 262483 (0.0005) [2023-12-26 01:41:23,154][123090] Updated weights for policy 1, policy_version 262493 (0.0009) [2023-12-26 01:41:23,462][123091] Updated weights for policy 0, policy_version 263896 (0.0009) [2023-12-26 01:41:23,530][123091] Updated weights for policy 0, policy_version 263906 (0.0009) [2023-12-26 01:41:23,582][123091] Updated weights for policy 0, policy_version 263916 (0.0009) [2023-12-26 01:41:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 134766592. Throughput: 0: 8732.3, 1: 8669.8. Samples: 134743728. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:23,785][121949] Avg episode reward: [(0, '6049.652'), (1, '5231.540')] [2023-12-26 01:41:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000262496_67198976.pth... [2023-12-26 01:41:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000263920_67567616.pth... [2023-12-26 01:41:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000262896_67305472.pth [2023-12-26 01:41:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000261472_66936832.pth [2023-12-26 01:41:23,871][123090] Updated weights for policy 1, policy_version 262503 (0.0007) [2023-12-26 01:41:23,924][123090] Updated weights for policy 1, policy_version 262513 (0.0005) [2023-12-26 01:41:23,988][123090] Updated weights for policy 1, policy_version 262523 (0.0008) [2023-12-26 01:41:24,454][123091] Updated weights for policy 0, policy_version 263926 (0.0009) [2023-12-26 01:41:24,509][123091] Updated weights for policy 0, policy_version 263936 (0.0009) [2023-12-26 01:41:24,568][123091] Updated weights for policy 0, policy_version 263946 (0.0009) [2023-12-26 01:41:24,734][123090] Updated weights for policy 1, policy_version 262533 (0.0007) [2023-12-26 01:41:24,785][123090] Updated weights for policy 1, policy_version 262543 (0.0010) [2023-12-26 01:41:24,847][123090] Updated weights for policy 1, policy_version 262553 (0.0010) [2023-12-26 01:41:25,404][123091] Updated weights for policy 0, policy_version 263956 (0.0010) [2023-12-26 01:41:25,457][123091] Updated weights for policy 0, policy_version 263966 (0.0008) [2023-12-26 01:41:25,516][123091] Updated weights for policy 0, policy_version 263976 (0.0009) [2023-12-26 01:41:25,686][123090] Updated weights for policy 1, policy_version 262563 (0.0010) [2023-12-26 01:41:25,755][123090] Updated weights for policy 1, policy_version 262573 (0.0010) [2023-12-26 01:41:25,809][123090] Updated weights for policy 1, policy_version 262583 (0.0010) [2023-12-26 01:41:26,380][123091] Updated weights for policy 0, policy_version 263987 (0.0010) [2023-12-26 01:41:26,445][123091] Updated weights for policy 0, policy_version 263997 (0.0009) [2023-12-26 01:41:26,502][123091] Updated weights for policy 0, policy_version 264007 (0.0009) [2023-12-26 01:41:26,523][123090] Updated weights for policy 1, policy_version 262593 (0.0010) [2023-12-26 01:41:26,582][123090] Updated weights for policy 1, policy_version 262603 (0.0005) [2023-12-26 01:41:26,642][123090] Updated weights for policy 1, policy_version 262613 (0.0007) [2023-12-26 01:41:26,693][123090] Updated weights for policy 1, policy_version 262623 (0.0008) [2023-12-26 01:41:27,364][123091] Updated weights for policy 0, policy_version 264017 (0.0009) [2023-12-26 01:41:27,413][123090] Updated weights for policy 1, policy_version 262633 (0.0007) [2023-12-26 01:41:27,435][123091] Updated weights for policy 0, policy_version 264027 (0.0009) [2023-12-26 01:41:27,470][123090] Updated weights for policy 1, policy_version 262643 (0.0005) [2023-12-26 01:41:27,500][123091] Updated weights for policy 0, policy_version 264037 (0.0009) [2023-12-26 01:41:27,519][123090] Updated weights for policy 1, policy_version 262653 (0.0005) [2023-12-26 01:41:27,569][123091] Updated weights for policy 0, policy_version 264047 (0.0008) [2023-12-26 01:41:28,157][123090] Updated weights for policy 1, policy_version 262663 (0.0008) [2023-12-26 01:41:28,212][123090] Updated weights for policy 1, policy_version 262673 (0.0009) [2023-12-26 01:41:28,267][123090] Updated weights for policy 1, policy_version 262684 (0.0008) [2023-12-26 01:41:28,449][123091] Updated weights for policy 0, policy_version 264057 (0.0008) [2023-12-26 01:41:28,520][123091] Updated weights for policy 0, policy_version 264067 (0.0009) [2023-12-26 01:41:28,614][123091] Updated weights for policy 0, policy_version 264077 (0.0009) [2023-12-26 01:41:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 134856704. Throughput: 0: 8665.2, 1: 8786.8. Samples: 134848804. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:28,785][121949] Avg episode reward: [(0, '6058.134'), (1, '5398.388')] [2023-12-26 01:41:29,088][123090] Updated weights for policy 1, policy_version 262694 (0.0008) [2023-12-26 01:41:29,156][123090] Updated weights for policy 1, policy_version 262704 (0.0009) [2023-12-26 01:41:29,220][123090] Updated weights for policy 1, policy_version 262714 (0.0009) [2023-12-26 01:41:29,430][123091] Updated weights for policy 0, policy_version 264087 (0.0010) [2023-12-26 01:41:29,494][123091] Updated weights for policy 0, policy_version 264097 (0.0009) [2023-12-26 01:41:29,569][123091] Updated weights for policy 0, policy_version 264107 (0.0010) [2023-12-26 01:41:29,974][123090] Updated weights for policy 1, policy_version 262724 (0.0008) [2023-12-26 01:41:30,048][123090] Updated weights for policy 1, policy_version 262734 (0.0008) [2023-12-26 01:41:30,113][123090] Updated weights for policy 1, policy_version 262744 (0.0008) [2023-12-26 01:41:30,441][123091] Updated weights for policy 0, policy_version 264117 (0.0009) [2023-12-26 01:41:30,512][123091] Updated weights for policy 0, policy_version 264127 (0.0010) [2023-12-26 01:41:30,574][123091] Updated weights for policy 0, policy_version 264137 (0.0010) [2023-12-26 01:41:30,853][123090] Updated weights for policy 1, policy_version 262754 (0.0008) [2023-12-26 01:41:30,933][123090] Updated weights for policy 1, policy_version 262764 (0.0005) [2023-12-26 01:41:30,998][123090] Updated weights for policy 1, policy_version 262774 (0.0005) [2023-12-26 01:41:31,065][123090] Updated weights for policy 1, policy_version 262784 (0.0007) [2023-12-26 01:41:31,486][123091] Updated weights for policy 0, policy_version 264147 (0.0010) [2023-12-26 01:41:31,545][123091] Updated weights for policy 0, policy_version 264157 (0.0009) [2023-12-26 01:41:31,598][123091] Updated weights for policy 0, policy_version 264167 (0.0009) [2023-12-26 01:41:31,728][123090] Updated weights for policy 1, policy_version 262794 (0.0007) [2023-12-26 01:41:31,784][123090] Updated weights for policy 1, policy_version 262804 (0.0006) [2023-12-26 01:41:31,836][123090] Updated weights for policy 1, policy_version 262814 (0.0005) [2023-12-26 01:41:32,471][123091] Updated weights for policy 0, policy_version 264177 (0.0009) [2023-12-26 01:41:32,520][123091] Updated weights for policy 0, policy_version 264187 (0.0010) [2023-12-26 01:41:32,578][123091] Updated weights for policy 0, policy_version 264197 (0.0012) [2023-12-26 01:41:32,611][123090] Updated weights for policy 1, policy_version 262824 (0.0006) [2023-12-26 01:41:32,635][123091] Updated weights for policy 0, policy_version 264208 (0.0009) [2023-12-26 01:41:32,672][123090] Updated weights for policy 1, policy_version 262834 (0.0006) [2023-12-26 01:41:32,730][123090] Updated weights for policy 1, policy_version 262844 (0.0006) [2023-12-26 01:41:33,423][123090] Updated weights for policy 1, policy_version 262854 (0.0006) [2023-12-26 01:41:33,461][123091] Updated weights for policy 0, policy_version 264218 (0.0005) [2023-12-26 01:41:33,496][123090] Updated weights for policy 1, policy_version 262864 (0.0006) [2023-12-26 01:41:33,514][123091] Updated weights for policy 0, policy_version 264228 (0.0006) [2023-12-26 01:41:33,547][123090] Updated weights for policy 1, policy_version 262874 (0.0009) [2023-12-26 01:41:33,572][123091] Updated weights for policy 0, policy_version 264238 (0.0005) [2023-12-26 01:41:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 134946816. Throughput: 0: 8544.9, 1: 8911.2. Samples: 134955764. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:33,785][121949] Avg episode reward: [(0, '6033.486'), (1, '5328.127')] [2023-12-26 01:41:34,236][123091] Updated weights for policy 0, policy_version 264248 (0.0009) [2023-12-26 01:41:34,301][123091] Updated weights for policy 0, policy_version 264258 (0.0011) [2023-12-26 01:41:34,328][123090] Updated weights for policy 1, policy_version 262885 (0.0010) [2023-12-26 01:41:34,365][123091] Updated weights for policy 0, policy_version 264268 (0.0007) [2023-12-26 01:41:34,397][123090] Updated weights for policy 1, policy_version 262895 (0.0010) [2023-12-26 01:41:34,463][123090] Updated weights for policy 1, policy_version 262905 (0.0009) [2023-12-26 01:41:35,144][123090] Updated weights for policy 1, policy_version 262915 (0.0008) [2023-12-26 01:41:35,195][123091] Updated weights for policy 0, policy_version 264278 (0.0009) [2023-12-26 01:41:35,202][123090] Updated weights for policy 1, policy_version 262925 (0.0005) [2023-12-26 01:41:35,250][123091] Updated weights for policy 0, policy_version 264288 (0.0005) [2023-12-26 01:41:35,257][123090] Updated weights for policy 1, policy_version 262935 (0.0007) [2023-12-26 01:41:35,305][123091] Updated weights for policy 0, policy_version 264298 (0.0006) [2023-12-26 01:41:36,081][123090] Updated weights for policy 1, policy_version 262945 (0.0009) [2023-12-26 01:41:36,109][123091] Updated weights for policy 0, policy_version 264308 (0.0009) [2023-12-26 01:41:36,151][123090] Updated weights for policy 1, policy_version 262955 (0.0007) [2023-12-26 01:41:36,177][123091] Updated weights for policy 0, policy_version 264318 (0.0010) [2023-12-26 01:41:36,215][123090] Updated weights for policy 1, policy_version 262965 (0.0008) [2023-12-26 01:41:36,244][123091] Updated weights for policy 0, policy_version 264328 (0.0009) [2023-12-26 01:41:36,273][123090] Updated weights for policy 1, policy_version 262975 (0.0008) [2023-12-26 01:41:36,975][123091] Updated weights for policy 0, policy_version 264338 (0.0009) [2023-12-26 01:41:37,041][123091] Updated weights for policy 0, policy_version 264348 (0.0007) [2023-12-26 01:41:37,103][123091] Updated weights for policy 0, policy_version 264358 (0.0009) [2023-12-26 01:41:37,117][123090] Updated weights for policy 1, policy_version 262985 (0.0007) [2023-12-26 01:41:37,167][123090] Updated weights for policy 1, policy_version 262995 (0.0006) [2023-12-26 01:41:37,171][123091] Updated weights for policy 0, policy_version 264368 (0.0007) [2023-12-26 01:41:37,230][123090] Updated weights for policy 1, policy_version 263005 (0.0007) [2023-12-26 01:41:37,823][123091] Updated weights for policy 0, policy_version 264378 (0.0005) [2023-12-26 01:41:37,883][123091] Updated weights for policy 0, policy_version 264388 (0.0005) [2023-12-26 01:41:37,931][123091] Updated weights for policy 0, policy_version 264398 (0.0005) [2023-12-26 01:41:37,935][123090] Updated weights for policy 1, policy_version 263015 (0.0010) [2023-12-26 01:41:38,006][123090] Updated weights for policy 1, policy_version 263025 (0.0009) [2023-12-26 01:41:38,060][123090] Updated weights for policy 1, policy_version 263035 (0.0009) [2023-12-26 01:41:38,613][123091] Updated weights for policy 0, policy_version 264408 (0.0005) [2023-12-26 01:41:38,680][123091] Updated weights for policy 0, policy_version 264418 (0.0005) [2023-12-26 01:41:38,740][123091] Updated weights for policy 0, policy_version 264428 (0.0006) [2023-12-26 01:41:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 135036928. Throughput: 0: 8529.2, 1: 8934.4. Samples: 135008452. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:38,785][121949] Avg episode reward: [(0, '6069.924'), (1, '5361.416')] [2023-12-26 01:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000264432_67698688.pth... [2023-12-26 01:41:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000263040_67338240.pth... [2023-12-26 01:41:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000261984_67067904.pth [2023-12-26 01:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000263440_67444736.pth [2023-12-26 01:41:38,927][123090] Updated weights for policy 1, policy_version 263045 (0.0007) [2023-12-26 01:41:38,993][123090] Updated weights for policy 1, policy_version 263055 (0.0010) [2023-12-26 01:41:39,059][123090] Updated weights for policy 1, policy_version 263065 (0.0009) [2023-12-26 01:41:39,517][123091] Updated weights for policy 0, policy_version 264438 (0.0008) [2023-12-26 01:41:39,568][123091] Updated weights for policy 0, policy_version 264448 (0.0008) [2023-12-26 01:41:39,631][123091] Updated weights for policy 0, policy_version 264458 (0.0008) [2023-12-26 01:41:39,888][123090] Updated weights for policy 1, policy_version 263075 (0.0010) [2023-12-26 01:41:39,953][123090] Updated weights for policy 1, policy_version 263085 (0.0009) [2023-12-26 01:41:40,023][123090] Updated weights for policy 1, policy_version 263095 (0.0009) [2023-12-26 01:41:40,469][123091] Updated weights for policy 0, policy_version 264468 (0.0008) [2023-12-26 01:41:40,534][123091] Updated weights for policy 0, policy_version 264478 (0.0009) [2023-12-26 01:41:40,586][123091] Updated weights for policy 0, policy_version 264488 (0.0009) [2023-12-26 01:41:40,848][123090] Updated weights for policy 1, policy_version 263105 (0.0006) [2023-12-26 01:41:40,919][123090] Updated weights for policy 1, policy_version 263115 (0.0009) [2023-12-26 01:41:40,999][123090] Updated weights for policy 1, policy_version 263125 (0.0010) [2023-12-26 01:41:41,072][123090] Updated weights for policy 1, policy_version 263135 (0.0009) [2023-12-26 01:41:41,407][123091] Updated weights for policy 0, policy_version 264498 (0.0009) [2023-12-26 01:41:41,481][123091] Updated weights for policy 0, policy_version 264508 (0.0006) [2023-12-26 01:41:41,553][123091] Updated weights for policy 0, policy_version 264518 (0.0005) [2023-12-26 01:41:41,629][123091] Updated weights for policy 0, policy_version 264528 (0.0006) [2023-12-26 01:41:41,940][123090] Updated weights for policy 1, policy_version 263145 (0.0010) [2023-12-26 01:41:42,004][123090] Updated weights for policy 1, policy_version 263155 (0.0010) [2023-12-26 01:41:42,066][123090] Updated weights for policy 1, policy_version 263165 (0.0010) [2023-12-26 01:41:42,377][123091] Updated weights for policy 0, policy_version 264538 (0.0010) [2023-12-26 01:41:42,448][123091] Updated weights for policy 0, policy_version 264548 (0.0009) [2023-12-26 01:41:42,513][123091] Updated weights for policy 0, policy_version 264558 (0.0009) [2023-12-26 01:41:42,919][123090] Updated weights for policy 1, policy_version 263175 (0.0010) [2023-12-26 01:41:42,978][123090] Updated weights for policy 1, policy_version 263185 (0.0010) [2023-12-26 01:41:43,041][123090] Updated weights for policy 1, policy_version 263195 (0.0006) [2023-12-26 01:41:43,353][123091] Updated weights for policy 0, policy_version 264568 (0.0009) [2023-12-26 01:41:43,414][123091] Updated weights for policy 0, policy_version 264578 (0.0010) [2023-12-26 01:41:43,467][123091] Updated weights for policy 0, policy_version 264588 (0.0009) [2023-12-26 01:41:43,766][123090] Updated weights for policy 1, policy_version 263205 (0.0005) [2023-12-26 01:41:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 135118848. Throughput: 0: 8555.5, 1: 8944.1. Samples: 135114908. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:43,785][121949] Avg episode reward: [(0, '6134.466'), (1, '5304.136')] [2023-12-26 01:41:43,846][123090] Updated weights for policy 1, policy_version 263215 (0.0006) [2023-12-26 01:41:43,912][123090] Updated weights for policy 1, policy_version 263225 (0.0005) [2023-12-26 01:41:44,337][123091] Updated weights for policy 0, policy_version 264598 (0.0010) [2023-12-26 01:41:44,402][123091] Updated weights for policy 0, policy_version 264608 (0.0009) [2023-12-26 01:41:44,457][123091] Updated weights for policy 0, policy_version 264618 (0.0009) [2023-12-26 01:41:44,625][123090] Updated weights for policy 1, policy_version 263235 (0.0006) [2023-12-26 01:41:44,697][123090] Updated weights for policy 1, policy_version 263245 (0.0005) [2023-12-26 01:41:44,768][123090] Updated weights for policy 1, policy_version 263255 (0.0008) [2023-12-26 01:41:45,322][123091] Updated weights for policy 0, policy_version 264628 (0.0010) [2023-12-26 01:41:45,384][123091] Updated weights for policy 0, policy_version 264638 (0.0009) [2023-12-26 01:41:45,448][123091] Updated weights for policy 0, policy_version 264648 (0.0008) [2023-12-26 01:41:45,537][123090] Updated weights for policy 1, policy_version 263265 (0.0010) [2023-12-26 01:41:45,595][123090] Updated weights for policy 1, policy_version 263275 (0.0009) [2023-12-26 01:41:45,652][123090] Updated weights for policy 1, policy_version 263285 (0.0009) [2023-12-26 01:41:45,716][123090] Updated weights for policy 1, policy_version 263295 (0.0010) [2023-12-26 01:41:46,225][123091] Updated weights for policy 0, policy_version 264658 (0.0007) [2023-12-26 01:41:46,282][123091] Updated weights for policy 0, policy_version 264668 (0.0009) [2023-12-26 01:41:46,345][123091] Updated weights for policy 0, policy_version 264678 (0.0009) [2023-12-26 01:41:46,400][123091] Updated weights for policy 0, policy_version 264688 (0.0008) [2023-12-26 01:41:46,556][123090] Updated weights for policy 1, policy_version 263305 (0.0009) [2023-12-26 01:41:46,610][123090] Updated weights for policy 1, policy_version 263315 (0.0008) [2023-12-26 01:41:46,674][123090] Updated weights for policy 1, policy_version 263325 (0.0009) [2023-12-26 01:41:47,184][123091] Updated weights for policy 0, policy_version 264698 (0.0008) [2023-12-26 01:41:47,236][123091] Updated weights for policy 0, policy_version 264708 (0.0010) [2023-12-26 01:41:47,303][123091] Updated weights for policy 0, policy_version 264718 (0.0008) [2023-12-26 01:41:47,542][123090] Updated weights for policy 1, policy_version 263335 (0.0007) [2023-12-26 01:41:47,611][123090] Updated weights for policy 1, policy_version 263345 (0.0005) [2023-12-26 01:41:47,677][123090] Updated weights for policy 1, policy_version 263355 (0.0005) [2023-12-26 01:41:48,010][123091] Updated weights for policy 0, policy_version 264728 (0.0005) [2023-12-26 01:41:48,067][123091] Updated weights for policy 0, policy_version 264738 (0.0005) [2023-12-26 01:41:48,131][123091] Updated weights for policy 0, policy_version 264748 (0.0010) [2023-12-26 01:41:48,336][123090] Updated weights for policy 1, policy_version 263365 (0.0006) [2023-12-26 01:41:48,407][123090] Updated weights for policy 1, policy_version 263375 (0.0007) [2023-12-26 01:41:48,482][123090] Updated weights for policy 1, policy_version 263385 (0.0006) [2023-12-26 01:41:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 135208960. Throughput: 0: 8557.0, 1: 9013.3. Samples: 135222088. Policy #0 lag: (min: 16.0, avg: 41.7, max: 48.0) [2023-12-26 01:41:48,784][121949] Avg episode reward: [(0, '6092.473'), (1, '5314.610')] [2023-12-26 01:41:48,919][123091] Updated weights for policy 0, policy_version 264758 (0.0008) [2023-12-26 01:41:48,999][123091] Updated weights for policy 0, policy_version 264768 (0.0006) [2023-12-26 01:41:49,064][123091] Updated weights for policy 0, policy_version 264778 (0.0006) [2023-12-26 01:41:49,164][123090] Updated weights for policy 1, policy_version 263395 (0.0006) [2023-12-26 01:41:49,224][123090] Updated weights for policy 1, policy_version 263405 (0.0006) [2023-12-26 01:41:49,287][123090] Updated weights for policy 1, policy_version 263415 (0.0009) [2023-12-26 01:41:49,858][123091] Updated weights for policy 0, policy_version 264788 (0.0009) [2023-12-26 01:41:49,915][123091] Updated weights for policy 0, policy_version 264798 (0.0009) [2023-12-26 01:41:49,980][123091] Updated weights for policy 0, policy_version 264808 (0.0009) [2023-12-26 01:41:50,139][123090] Updated weights for policy 1, policy_version 263425 (0.0011) [2023-12-26 01:41:50,200][123090] Updated weights for policy 1, policy_version 263435 (0.0009) [2023-12-26 01:41:50,268][123090] Updated weights for policy 1, policy_version 263445 (0.0009) [2023-12-26 01:41:50,331][123090] Updated weights for policy 1, policy_version 263455 (0.0009) [2023-12-26 01:41:50,829][123091] Updated weights for policy 0, policy_version 264818 (0.0006) [2023-12-26 01:41:50,902][123091] Updated weights for policy 0, policy_version 264828 (0.0007) [2023-12-26 01:41:50,966][123091] Updated weights for policy 0, policy_version 264838 (0.0008) [2023-12-26 01:41:51,034][123091] Updated weights for policy 0, policy_version 264848 (0.0009) [2023-12-26 01:41:51,056][123090] Updated weights for policy 1, policy_version 263465 (0.0009) [2023-12-26 01:41:51,121][123090] Updated weights for policy 1, policy_version 263475 (0.0008) [2023-12-26 01:41:51,202][123090] Updated weights for policy 1, policy_version 263485 (0.0009) [2023-12-26 01:41:51,786][123091] Updated weights for policy 0, policy_version 264858 (0.0008) [2023-12-26 01:41:51,835][123091] Updated weights for policy 0, policy_version 264868 (0.0008) [2023-12-26 01:41:51,880][123091] Updated weights for policy 0, policy_version 264878 (0.0008) [2023-12-26 01:41:51,996][123090] Updated weights for policy 1, policy_version 263495 (0.0009) [2023-12-26 01:41:52,058][123090] Updated weights for policy 1, policy_version 263505 (0.0009) [2023-12-26 01:41:52,113][123090] Updated weights for policy 1, policy_version 263515 (0.0009) [2023-12-26 01:41:52,687][123091] Updated weights for policy 0, policy_version 264888 (0.0008) [2023-12-26 01:41:52,734][123091] Updated weights for policy 0, policy_version 264898 (0.0010) [2023-12-26 01:41:52,786][123091] Updated weights for policy 0, policy_version 264908 (0.0010) [2023-12-26 01:41:52,948][123090] Updated weights for policy 1, policy_version 263525 (0.0010) [2023-12-26 01:41:52,998][123090] Updated weights for policy 1, policy_version 263535 (0.0008) [2023-12-26 01:41:53,061][123090] Updated weights for policy 1, policy_version 263545 (0.0009) [2023-12-26 01:41:53,571][123091] Updated weights for policy 0, policy_version 264918 (0.0010) [2023-12-26 01:41:53,622][123091] Updated weights for policy 0, policy_version 264928 (0.0007) [2023-12-26 01:41:53,667][123091] Updated weights for policy 0, policy_version 264938 (0.0005) [2023-12-26 01:41:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 135299072. Throughput: 0: 8559.9, 1: 8981.5. Samples: 135274120. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:41:53,786][121949] Avg episode reward: [(0, '6060.677'), (1, '5306.130')] [2023-12-26 01:41:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000263552_67469312.pth... [2023-12-26 01:41:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000264944_67829760.pth... [2023-12-26 01:41:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000262496_67198976.pth [2023-12-26 01:41:53,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000263920_67567616.pth [2023-12-26 01:41:53,859][123090] Updated weights for policy 1, policy_version 263555 (0.0010) [2023-12-26 01:41:53,906][123090] Updated weights for policy 1, policy_version 263565 (0.0010) [2023-12-26 01:41:53,953][123090] Updated weights for policy 1, policy_version 263575 (0.0010) [2023-12-26 01:41:54,482][123091] Updated weights for policy 0, policy_version 264948 (0.0007) [2023-12-26 01:41:54,543][123091] Updated weights for policy 0, policy_version 264958 (0.0009) [2023-12-26 01:41:54,606][123091] Updated weights for policy 0, policy_version 264968 (0.0009) [2023-12-26 01:41:54,723][123090] Updated weights for policy 1, policy_version 263585 (0.0010) [2023-12-26 01:41:54,785][123090] Updated weights for policy 1, policy_version 263595 (0.0009) [2023-12-26 01:41:54,833][123090] Updated weights for policy 1, policy_version 263605 (0.0009) [2023-12-26 01:41:54,880][123090] Updated weights for policy 1, policy_version 263616 (0.0008) [2023-12-26 01:41:55,450][123091] Updated weights for policy 0, policy_version 264978 (0.0008) [2023-12-26 01:41:55,514][123091] Updated weights for policy 0, policy_version 264988 (0.0008) [2023-12-26 01:41:55,583][123091] Updated weights for policy 0, policy_version 264998 (0.0009) [2023-12-26 01:41:55,628][123090] Updated weights for policy 1, policy_version 263626 (0.0010) [2023-12-26 01:41:55,643][123091] Updated weights for policy 0, policy_version 265008 (0.0008) [2023-12-26 01:41:55,681][123090] Updated weights for policy 1, policy_version 263636 (0.0008) [2023-12-26 01:41:55,735][123090] Updated weights for policy 1, policy_version 263647 (0.0010) [2023-12-26 01:41:56,295][123091] Updated weights for policy 0, policy_version 265018 (0.0005) [2023-12-26 01:41:56,352][123091] Updated weights for policy 0, policy_version 265028 (0.0005) [2023-12-26 01:41:56,398][123091] Updated weights for policy 0, policy_version 265038 (0.0005) [2023-12-26 01:41:56,566][123090] Updated weights for policy 1, policy_version 263657 (0.0006) [2023-12-26 01:41:56,615][123090] Updated weights for policy 1, policy_version 263667 (0.0005) [2023-12-26 01:41:56,672][123090] Updated weights for policy 1, policy_version 263677 (0.0005) [2023-12-26 01:41:57,021][123091] Updated weights for policy 0, policy_version 265048 (0.0006) [2023-12-26 01:41:57,081][123091] Updated weights for policy 0, policy_version 265058 (0.0006) [2023-12-26 01:41:57,140][123091] Updated weights for policy 0, policy_version 265068 (0.0007) [2023-12-26 01:41:57,405][123090] Updated weights for policy 1, policy_version 263687 (0.0005) [2023-12-26 01:41:57,452][123090] Updated weights for policy 1, policy_version 263697 (0.0006) [2023-12-26 01:41:57,501][123090] Updated weights for policy 1, policy_version 263707 (0.0005) [2023-12-26 01:41:57,938][123091] Updated weights for policy 0, policy_version 265078 (0.0010) [2023-12-26 01:41:57,995][123091] Updated weights for policy 0, policy_version 265088 (0.0010) [2023-12-26 01:41:58,055][123091] Updated weights for policy 0, policy_version 265098 (0.0010) [2023-12-26 01:41:58,172][123090] Updated weights for policy 1, policy_version 263717 (0.0008) [2023-12-26 01:41:58,240][123090] Updated weights for policy 1, policy_version 263727 (0.0008) [2023-12-26 01:41:58,304][123090] Updated weights for policy 1, policy_version 263737 (0.0008) [2023-12-26 01:41:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 135389184. Throughput: 0: 8698.6, 1: 8992.9. Samples: 135384396. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:41:58,785][121949] Avg episode reward: [(0, '6053.341'), (1, '5181.140')] [2023-12-26 01:41:59,003][123091] Updated weights for policy 0, policy_version 265108 (0.0008) [2023-12-26 01:41:59,069][123091] Updated weights for policy 0, policy_version 265118 (0.0010) [2023-12-26 01:41:59,129][123091] Updated weights for policy 0, policy_version 265128 (0.0008) [2023-12-26 01:41:59,182][123090] Updated weights for policy 1, policy_version 263747 (0.0008) [2023-12-26 01:41:59,239][123090] Updated weights for policy 1, policy_version 263757 (0.0010) [2023-12-26 01:41:59,290][123090] Updated weights for policy 1, policy_version 263767 (0.0008) [2023-12-26 01:41:59,943][123091] Updated weights for policy 0, policy_version 265138 (0.0009) [2023-12-26 01:42:00,002][123091] Updated weights for policy 0, policy_version 265148 (0.0010) [2023-12-26 01:42:00,063][123091] Updated weights for policy 0, policy_version 265158 (0.0009) [2023-12-26 01:42:00,132][123091] Updated weights for policy 0, policy_version 265168 (0.0009) [2023-12-26 01:42:00,161][123090] Updated weights for policy 1, policy_version 263777 (0.0010) [2023-12-26 01:42:00,218][123090] Updated weights for policy 1, policy_version 263787 (0.0010) [2023-12-26 01:42:00,276][123090] Updated weights for policy 1, policy_version 263797 (0.0009) [2023-12-26 01:42:00,335][123090] Updated weights for policy 1, policy_version 263807 (0.0010) [2023-12-26 01:42:00,958][123091] Updated weights for policy 0, policy_version 265178 (0.0010) [2023-12-26 01:42:01,018][123091] Updated weights for policy 0, policy_version 265188 (0.0011) [2023-12-26 01:42:01,085][123091] Updated weights for policy 0, policy_version 265198 (0.0011) [2023-12-26 01:42:01,191][123090] Updated weights for policy 1, policy_version 263817 (0.0009) [2023-12-26 01:42:01,258][123090] Updated weights for policy 1, policy_version 263827 (0.0009) [2023-12-26 01:42:01,324][123090] Updated weights for policy 1, policy_version 263837 (0.0010) [2023-12-26 01:42:01,972][123091] Updated weights for policy 0, policy_version 265208 (0.0010) [2023-12-26 01:42:02,034][123091] Updated weights for policy 0, policy_version 265218 (0.0010) [2023-12-26 01:42:02,094][123090] Updated weights for policy 1, policy_version 263847 (0.0006) [2023-12-26 01:42:02,097][123091] Updated weights for policy 0, policy_version 265228 (0.0008) [2023-12-26 01:42:02,146][123090] Updated weights for policy 1, policy_version 263857 (0.0005) [2023-12-26 01:42:02,207][123090] Updated weights for policy 1, policy_version 263867 (0.0005) [2023-12-26 01:42:02,805][123091] Updated weights for policy 0, policy_version 265238 (0.0007) [2023-12-26 01:42:02,876][123091] Updated weights for policy 0, policy_version 265248 (0.0005) [2023-12-26 01:42:02,953][123091] Updated weights for policy 0, policy_version 265258 (0.0005) [2023-12-26 01:42:02,973][123090] Updated weights for policy 1, policy_version 263877 (0.0005) [2023-12-26 01:42:03,047][123090] Updated weights for policy 1, policy_version 263887 (0.0006) [2023-12-26 01:42:03,111][123090] Updated weights for policy 1, policy_version 263897 (0.0008) [2023-12-26 01:42:03,564][123091] Updated weights for policy 0, policy_version 265268 (0.0006) [2023-12-26 01:42:03,627][123091] Updated weights for policy 0, policy_version 265278 (0.0008) [2023-12-26 01:42:03,692][123091] Updated weights for policy 0, policy_version 265288 (0.0007) [2023-12-26 01:42:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 135479296. Throughput: 0: 8694.1, 1: 8977.2. Samples: 135488836. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:03,785][121949] Avg episode reward: [(0, '6088.406'), (1, '5139.129')] [2023-12-26 01:42:03,871][123090] Updated weights for policy 1, policy_version 263907 (0.0010) [2023-12-26 01:42:03,935][123090] Updated weights for policy 1, policy_version 263917 (0.0006) [2023-12-26 01:42:03,990][123090] Updated weights for policy 1, policy_version 263927 (0.0005) [2023-12-26 01:42:04,545][123091] Updated weights for policy 0, policy_version 265298 (0.0009) [2023-12-26 01:42:04,600][123091] Updated weights for policy 0, policy_version 265308 (0.0010) [2023-12-26 01:42:04,653][123091] Updated weights for policy 0, policy_version 265318 (0.0009) [2023-12-26 01:42:04,715][123091] Updated weights for policy 0, policy_version 265328 (0.0009) [2023-12-26 01:42:04,766][123090] Updated weights for policy 1, policy_version 263937 (0.0010) [2023-12-26 01:42:04,825][123090] Updated weights for policy 1, policy_version 263947 (0.0008) [2023-12-26 01:42:04,887][123090] Updated weights for policy 1, policy_version 263957 (0.0005) [2023-12-26 01:42:04,960][123090] Updated weights for policy 1, policy_version 263967 (0.0005) [2023-12-26 01:42:05,570][123091] Updated weights for policy 0, policy_version 265338 (0.0009) [2023-12-26 01:42:05,624][123091] Updated weights for policy 0, policy_version 265349 (0.0010) [2023-12-26 01:42:05,676][123091] Updated weights for policy 0, policy_version 265359 (0.0009) [2023-12-26 01:42:05,717][123090] Updated weights for policy 1, policy_version 263977 (0.0005) [2023-12-26 01:42:05,783][123090] Updated weights for policy 1, policy_version 263987 (0.0005) [2023-12-26 01:42:05,849][123090] Updated weights for policy 1, policy_version 263997 (0.0009) [2023-12-26 01:42:06,560][123091] Updated weights for policy 0, policy_version 265369 (0.0006) [2023-12-26 01:42:06,621][123091] Updated weights for policy 0, policy_version 265379 (0.0006) [2023-12-26 01:42:06,665][123090] Updated weights for policy 1, policy_version 264007 (0.0009) [2023-12-26 01:42:06,696][123091] Updated weights for policy 0, policy_version 265389 (0.0005) [2023-12-26 01:42:06,737][123090] Updated weights for policy 1, policy_version 264017 (0.0010) [2023-12-26 01:42:06,809][123090] Updated weights for policy 1, policy_version 264027 (0.0011) [2023-12-26 01:42:07,465][123091] Updated weights for policy 0, policy_version 265399 (0.0007) [2023-12-26 01:42:07,526][123091] Updated weights for policy 0, policy_version 265409 (0.0006) [2023-12-26 01:42:07,586][123091] Updated weights for policy 0, policy_version 265419 (0.0007) [2023-12-26 01:42:07,629][123090] Updated weights for policy 1, policy_version 264037 (0.0011) [2023-12-26 01:42:07,673][123090] Updated weights for policy 1, policy_version 264047 (0.0010) [2023-12-26 01:42:07,725][123090] Updated weights for policy 1, policy_version 264057 (0.0010) [2023-12-26 01:42:08,402][123091] Updated weights for policy 0, policy_version 265429 (0.0008) [2023-12-26 01:42:08,455][123091] Updated weights for policy 0, policy_version 265439 (0.0009) [2023-12-26 01:42:08,511][123090] Updated weights for policy 1, policy_version 264067 (0.0010) [2023-12-26 01:42:08,512][123091] Updated weights for policy 0, policy_version 265449 (0.0007) [2023-12-26 01:42:08,578][123090] Updated weights for policy 1, policy_version 264077 (0.0010) [2023-12-26 01:42:08,645][123090] Updated weights for policy 1, policy_version 264087 (0.0010) [2023-12-26 01:42:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 135569408. Throughput: 0: 8709.0, 1: 9001.2. Samples: 135540684. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:08,785][121949] Avg episode reward: [(0, '6069.286'), (1, '5211.902')] [2023-12-26 01:42:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000264096_67608576.pth... [2023-12-26 01:42:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000265456_67960832.pth... [2023-12-26 01:42:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000263040_67338240.pth [2023-12-26 01:42:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000264432_67698688.pth [2023-12-26 01:42:09,324][123091] Updated weights for policy 0, policy_version 265459 (0.0006) [2023-12-26 01:42:09,390][123091] Updated weights for policy 0, policy_version 265469 (0.0008) [2023-12-26 01:42:09,462][123091] Updated weights for policy 0, policy_version 265479 (0.0008) [2023-12-26 01:42:09,501][123090] Updated weights for policy 1, policy_version 264097 (0.0010) [2023-12-26 01:42:09,572][123090] Updated weights for policy 1, policy_version 264107 (0.0009) [2023-12-26 01:42:09,640][123090] Updated weights for policy 1, policy_version 264117 (0.0006) [2023-12-26 01:42:09,704][123090] Updated weights for policy 1, policy_version 264127 (0.0006) [2023-12-26 01:42:10,321][123091] Updated weights for policy 0, policy_version 265489 (0.0009) [2023-12-26 01:42:10,390][123091] Updated weights for policy 0, policy_version 265499 (0.0010) [2023-12-26 01:42:10,454][123091] Updated weights for policy 0, policy_version 265509 (0.0010) [2023-12-26 01:42:10,470][123090] Updated weights for policy 1, policy_version 264137 (0.0006) [2023-12-26 01:42:10,520][123091] Updated weights for policy 0, policy_version 265519 (0.0009) [2023-12-26 01:42:10,523][123090] Updated weights for policy 1, policy_version 264147 (0.0008) [2023-12-26 01:42:10,577][123090] Updated weights for policy 1, policy_version 264157 (0.0009) [2023-12-26 01:42:11,359][123091] Updated weights for policy 0, policy_version 265529 (0.0008) [2023-12-26 01:42:11,419][123091] Updated weights for policy 0, policy_version 265539 (0.0009) [2023-12-26 01:42:11,476][123090] Updated weights for policy 1, policy_version 264167 (0.0008) [2023-12-26 01:42:11,480][123091] Updated weights for policy 0, policy_version 265549 (0.0009) [2023-12-26 01:42:11,542][123090] Updated weights for policy 1, policy_version 264177 (0.0007) [2023-12-26 01:42:11,619][123090] Updated weights for policy 1, policy_version 264187 (0.0007) [2023-12-26 01:42:12,282][123091] Updated weights for policy 0, policy_version 265559 (0.0010) [2023-12-26 01:42:12,343][123091] Updated weights for policy 0, policy_version 265569 (0.0009) [2023-12-26 01:42:12,412][123091] Updated weights for policy 0, policy_version 265579 (0.0010) [2023-12-26 01:42:12,487][123090] Updated weights for policy 1, policy_version 264197 (0.0009) [2023-12-26 01:42:12,559][123090] Updated weights for policy 1, policy_version 264207 (0.0009) [2023-12-26 01:42:12,627][123090] Updated weights for policy 1, policy_version 264217 (0.0009) [2023-12-26 01:42:13,222][123091] Updated weights for policy 0, policy_version 265589 (0.0010) [2023-12-26 01:42:13,273][123091] Updated weights for policy 0, policy_version 265599 (0.0010) [2023-12-26 01:42:13,326][123091] Updated weights for policy 0, policy_version 265609 (0.0010) [2023-12-26 01:42:13,442][123090] Updated weights for policy 1, policy_version 264227 (0.0010) [2023-12-26 01:42:13,493][123090] Updated weights for policy 1, policy_version 264237 (0.0008) [2023-12-26 01:42:13,553][123090] Updated weights for policy 1, policy_version 264247 (0.0009) [2023-12-26 01:42:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 135651328. Throughput: 0: 8754.8, 1: 8886.8. Samples: 135642680. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:13,784][121949] Avg episode reward: [(0, '6040.390'), (1, '5173.473')] [2023-12-26 01:42:14,040][123091] Updated weights for policy 0, policy_version 265619 (0.0009) [2023-12-26 01:42:14,085][123091] Updated weights for policy 0, policy_version 265629 (0.0005) [2023-12-26 01:42:14,133][123091] Updated weights for policy 0, policy_version 265639 (0.0006) [2023-12-26 01:42:14,433][123090] Updated weights for policy 1, policy_version 264257 (0.0008) [2023-12-26 01:42:14,511][123090] Updated weights for policy 1, policy_version 264267 (0.0005) [2023-12-26 01:42:14,587][123090] Updated weights for policy 1, policy_version 264277 (0.0005) [2023-12-26 01:42:14,663][123090] Updated weights for policy 1, policy_version 264287 (0.0007) [2023-12-26 01:42:14,948][123091] Updated weights for policy 0, policy_version 265649 (0.0008) [2023-12-26 01:42:15,011][123091] Updated weights for policy 0, policy_version 265659 (0.0006) [2023-12-26 01:42:15,065][123091] Updated weights for policy 0, policy_version 265669 (0.0010) [2023-12-26 01:42:15,122][123091] Updated weights for policy 0, policy_version 265679 (0.0010) [2023-12-26 01:42:15,304][123090] Updated weights for policy 1, policy_version 264297 (0.0010) [2023-12-26 01:42:15,365][123090] Updated weights for policy 1, policy_version 264307 (0.0009) [2023-12-26 01:42:15,419][123090] Updated weights for policy 1, policy_version 264317 (0.0009) [2023-12-26 01:42:15,900][123091] Updated weights for policy 0, policy_version 265689 (0.0007) [2023-12-26 01:42:15,957][123091] Updated weights for policy 0, policy_version 265699 (0.0008) [2023-12-26 01:42:16,023][123091] Updated weights for policy 0, policy_version 265709 (0.0009) [2023-12-26 01:42:16,137][123090] Updated weights for policy 1, policy_version 264327 (0.0009) [2023-12-26 01:42:16,200][123090] Updated weights for policy 1, policy_version 264337 (0.0008) [2023-12-26 01:42:16,263][123090] Updated weights for policy 1, policy_version 264347 (0.0008) [2023-12-26 01:42:16,736][123091] Updated weights for policy 0, policy_version 265719 (0.0006) [2023-12-26 01:42:16,784][123091] Updated weights for policy 0, policy_version 265729 (0.0005) [2023-12-26 01:42:16,831][123091] Updated weights for policy 0, policy_version 265739 (0.0005) [2023-12-26 01:42:16,967][123090] Updated weights for policy 1, policy_version 264357 (0.0009) [2023-12-26 01:42:17,023][123090] Updated weights for policy 1, policy_version 264367 (0.0010) [2023-12-26 01:42:17,078][123090] Updated weights for policy 1, policy_version 264377 (0.0010) [2023-12-26 01:42:17,566][123091] Updated weights for policy 0, policy_version 265749 (0.0008) [2023-12-26 01:42:17,620][123091] Updated weights for policy 0, policy_version 265759 (0.0010) [2023-12-26 01:42:17,682][123091] Updated weights for policy 0, policy_version 265769 (0.0010) [2023-12-26 01:42:17,850][123090] Updated weights for policy 1, policy_version 264387 (0.0009) [2023-12-26 01:42:17,918][123090] Updated weights for policy 1, policy_version 264397 (0.0006) [2023-12-26 01:42:17,972][123090] Updated weights for policy 1, policy_version 264407 (0.0006) [2023-12-26 01:42:18,433][123091] Updated weights for policy 0, policy_version 265779 (0.0009) [2023-12-26 01:42:18,482][123091] Updated weights for policy 0, policy_version 265789 (0.0007) [2023-12-26 01:42:18,533][123091] Updated weights for policy 0, policy_version 265799 (0.0010) [2023-12-26 01:42:18,724][123090] Updated weights for policy 1, policy_version 264417 (0.0006) [2023-12-26 01:42:18,784][123090] Updated weights for policy 1, policy_version 264427 (0.0011) [2023-12-26 01:42:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 135741440. Throughput: 0: 8882.3, 1: 8848.6. Samples: 135753656. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:18,785][121949] Avg episode reward: [(0, '6034.283'), (1, '5085.840')] [2023-12-26 01:42:18,851][123090] Updated weights for policy 1, policy_version 264437 (0.0011) [2023-12-26 01:42:18,919][123090] Updated weights for policy 1, policy_version 264447 (0.0011) [2023-12-26 01:42:19,295][123091] Updated weights for policy 0, policy_version 265809 (0.0010) [2023-12-26 01:42:19,356][123091] Updated weights for policy 0, policy_version 265819 (0.0008) [2023-12-26 01:42:19,414][123091] Updated weights for policy 0, policy_version 265829 (0.0008) [2023-12-26 01:42:19,481][123091] Updated weights for policy 0, policy_version 265839 (0.0008) [2023-12-26 01:42:19,711][123090] Updated weights for policy 1, policy_version 264457 (0.0006) [2023-12-26 01:42:19,784][123090] Updated weights for policy 1, policy_version 264467 (0.0007) [2023-12-26 01:42:19,850][123090] Updated weights for policy 1, policy_version 264477 (0.0011) [2023-12-26 01:42:20,350][123091] Updated weights for policy 0, policy_version 265849 (0.0009) [2023-12-26 01:42:20,428][123091] Updated weights for policy 0, policy_version 265859 (0.0011) [2023-12-26 01:42:20,503][123091] Updated weights for policy 0, policy_version 265869 (0.0011) [2023-12-26 01:42:20,618][123090] Updated weights for policy 1, policy_version 264487 (0.0007) [2023-12-26 01:42:20,690][123090] Updated weights for policy 1, policy_version 264497 (0.0011) [2023-12-26 01:42:20,762][123090] Updated weights for policy 1, policy_version 264507 (0.0011) [2023-12-26 01:42:21,340][123091] Updated weights for policy 0, policy_version 265879 (0.0009) [2023-12-26 01:42:21,411][123091] Updated weights for policy 0, policy_version 265889 (0.0008) [2023-12-26 01:42:21,471][123091] Updated weights for policy 0, policy_version 265899 (0.0010) [2023-12-26 01:42:21,583][123090] Updated weights for policy 1, policy_version 264517 (0.0009) [2023-12-26 01:42:21,652][123090] Updated weights for policy 1, policy_version 264527 (0.0009) [2023-12-26 01:42:21,725][123090] Updated weights for policy 1, policy_version 264537 (0.0010) [2023-12-26 01:42:22,301][123091] Updated weights for policy 0, policy_version 265909 (0.0010) [2023-12-26 01:42:22,356][123091] Updated weights for policy 0, policy_version 265919 (0.0010) [2023-12-26 01:42:22,426][123091] Updated weights for policy 0, policy_version 265929 (0.0010) [2023-12-26 01:42:22,549][123090] Updated weights for policy 1, policy_version 264547 (0.0010) [2023-12-26 01:42:22,605][123090] Updated weights for policy 1, policy_version 264557 (0.0009) [2023-12-26 01:42:22,662][123090] Updated weights for policy 1, policy_version 264567 (0.0010) [2023-12-26 01:42:23,198][123091] Updated weights for policy 0, policy_version 265939 (0.0008) [2023-12-26 01:42:23,248][123091] Updated weights for policy 0, policy_version 265949 (0.0006) [2023-12-26 01:42:23,299][123091] Updated weights for policy 0, policy_version 265959 (0.0007) [2023-12-26 01:42:23,457][123090] Updated weights for policy 1, policy_version 264577 (0.0009) [2023-12-26 01:42:23,516][123090] Updated weights for policy 1, policy_version 264587 (0.0010) [2023-12-26 01:42:23,570][123090] Updated weights for policy 1, policy_version 264597 (0.0009) [2023-12-26 01:42:23,630][123090] Updated weights for policy 1, policy_version 264607 (0.0007) [2023-12-26 01:42:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 135831552. Throughput: 0: 8881.1, 1: 8827.6. Samples: 135805348. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:23,785][121949] Avg episode reward: [(0, '6085.886'), (1, '5161.588')] [2023-12-26 01:42:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000265968_68091904.pth... [2023-12-26 01:42:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000264608_67739648.pth... [2023-12-26 01:42:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000264944_67829760.pth [2023-12-26 01:42:23,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000263552_67469312.pth [2023-12-26 01:42:23,896][123091] Updated weights for policy 0, policy_version 265969 (0.0010) [2023-12-26 01:42:23,968][123091] Updated weights for policy 0, policy_version 265979 (0.0006) [2023-12-26 01:42:24,021][123091] Updated weights for policy 0, policy_version 265989 (0.0005) [2023-12-26 01:42:24,090][123091] Updated weights for policy 0, policy_version 265999 (0.0005) [2023-12-26 01:42:24,388][123090] Updated weights for policy 1, policy_version 264617 (0.0006) [2023-12-26 01:42:24,457][123090] Updated weights for policy 1, policy_version 264627 (0.0006) [2023-12-26 01:42:24,529][123090] Updated weights for policy 1, policy_version 264637 (0.0005) [2023-12-26 01:42:24,768][123091] Updated weights for policy 0, policy_version 266009 (0.0009) [2023-12-26 01:42:24,826][123091] Updated weights for policy 0, policy_version 266019 (0.0010) [2023-12-26 01:42:24,879][123091] Updated weights for policy 0, policy_version 266029 (0.0006) [2023-12-26 01:42:25,093][123090] Updated weights for policy 1, policy_version 264647 (0.0006) [2023-12-26 01:42:25,157][123090] Updated weights for policy 1, policy_version 264657 (0.0006) [2023-12-26 01:42:25,224][123090] Updated weights for policy 1, policy_version 264667 (0.0006) [2023-12-26 01:42:25,690][123091] Updated weights for policy 0, policy_version 266039 (0.0008) [2023-12-26 01:42:25,750][123091] Updated weights for policy 0, policy_version 266049 (0.0009) [2023-12-26 01:42:25,812][123091] Updated weights for policy 0, policy_version 266059 (0.0009) [2023-12-26 01:42:25,883][123090] Updated weights for policy 1, policy_version 264677 (0.0006) [2023-12-26 01:42:25,932][123090] Updated weights for policy 1, policy_version 264687 (0.0006) [2023-12-26 01:42:25,986][123090] Updated weights for policy 1, policy_version 264697 (0.0005) [2023-12-26 01:42:26,637][123090] Updated weights for policy 1, policy_version 264707 (0.0005) [2023-12-26 01:42:26,684][123091] Updated weights for policy 0, policy_version 266069 (0.0010) [2023-12-26 01:42:26,701][123090] Updated weights for policy 1, policy_version 264717 (0.0005) [2023-12-26 01:42:26,728][123091] Updated weights for policy 0, policy_version 266079 (0.0010) [2023-12-26 01:42:26,756][123090] Updated weights for policy 1, policy_version 264727 (0.0005) [2023-12-26 01:42:26,777][123091] Updated weights for policy 0, policy_version 266089 (0.0011) [2023-12-26 01:42:27,379][123090] Updated weights for policy 1, policy_version 264737 (0.0005) [2023-12-26 01:42:27,439][123090] Updated weights for policy 1, policy_version 264747 (0.0005) [2023-12-26 01:42:27,508][123090] Updated weights for policy 1, policy_version 264757 (0.0005) [2023-12-26 01:42:27,524][123091] Updated weights for policy 0, policy_version 266099 (0.0009) [2023-12-26 01:42:27,563][123090] Updated weights for policy 1, policy_version 264767 (0.0009) [2023-12-26 01:42:27,568][123091] Updated weights for policy 0, policy_version 266109 (0.0005) [2023-12-26 01:42:27,614][123091] Updated weights for policy 0, policy_version 266119 (0.0005) [2023-12-26 01:42:28,259][123090] Updated weights for policy 1, policy_version 264777 (0.0006) [2023-12-26 01:42:28,297][123091] Updated weights for policy 0, policy_version 266129 (0.0005) [2023-12-26 01:42:28,305][123090] Updated weights for policy 1, policy_version 264787 (0.0005) [2023-12-26 01:42:28,355][123091] Updated weights for policy 0, policy_version 266139 (0.0006) [2023-12-26 01:42:28,368][123090] Updated weights for policy 1, policy_version 264797 (0.0008) [2023-12-26 01:42:28,409][123091] Updated weights for policy 0, policy_version 266149 (0.0009) [2023-12-26 01:42:28,466][123091] Updated weights for policy 0, policy_version 266159 (0.0007) [2023-12-26 01:42:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 135929856. Throughput: 0: 8874.6, 1: 9022.3. Samples: 135920268. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:28,785][121949] Avg episode reward: [(0, '6144.626'), (1, '5131.968')] [2023-12-26 01:42:29,035][123090] Updated weights for policy 1, policy_version 264807 (0.0009) [2023-12-26 01:42:29,093][123090] Updated weights for policy 1, policy_version 264817 (0.0007) [2023-12-26 01:42:29,116][123091] Updated weights for policy 0, policy_version 266169 (0.0009) [2023-12-26 01:42:29,140][123090] Updated weights for policy 1, policy_version 264827 (0.0007) [2023-12-26 01:42:29,172][123091] Updated weights for policy 0, policy_version 266179 (0.0008) [2023-12-26 01:42:29,248][123091] Updated weights for policy 0, policy_version 266189 (0.0009) [2023-12-26 01:42:29,934][123090] Updated weights for policy 1, policy_version 264837 (0.0006) [2023-12-26 01:42:29,988][123090] Updated weights for policy 1, policy_version 264847 (0.0008) [2023-12-26 01:42:30,057][123090] Updated weights for policy 1, policy_version 264857 (0.0008) [2023-12-26 01:42:30,103][123091] Updated weights for policy 0, policy_version 266199 (0.0008) [2023-12-26 01:42:30,153][123091] Updated weights for policy 0, policy_version 266209 (0.0009) [2023-12-26 01:42:30,203][123091] Updated weights for policy 0, policy_version 266219 (0.0009) [2023-12-26 01:42:30,839][123090] Updated weights for policy 1, policy_version 264867 (0.0009) [2023-12-26 01:42:30,890][123090] Updated weights for policy 1, policy_version 264877 (0.0010) [2023-12-26 01:42:30,938][123090] Updated weights for policy 1, policy_version 264887 (0.0010) [2023-12-26 01:42:31,066][123091] Updated weights for policy 0, policy_version 266229 (0.0009) [2023-12-26 01:42:31,133][123091] Updated weights for policy 0, policy_version 266239 (0.0009) [2023-12-26 01:42:31,193][123091] Updated weights for policy 0, policy_version 266249 (0.0009) [2023-12-26 01:42:31,808][123090] Updated weights for policy 1, policy_version 264897 (0.0010) [2023-12-26 01:42:31,868][123090] Updated weights for policy 1, policy_version 264907 (0.0010) [2023-12-26 01:42:31,929][123090] Updated weights for policy 1, policy_version 264917 (0.0010) [2023-12-26 01:42:31,992][123090] Updated weights for policy 1, policy_version 264927 (0.0010) [2023-12-26 01:42:32,031][123091] Updated weights for policy 0, policy_version 266259 (0.0009) [2023-12-26 01:42:32,097][123091] Updated weights for policy 0, policy_version 266269 (0.0008) [2023-12-26 01:42:32,154][123091] Updated weights for policy 0, policy_version 266279 (0.0007) [2023-12-26 01:42:32,833][123090] Updated weights for policy 1, policy_version 264937 (0.0010) [2023-12-26 01:42:32,878][123091] Updated weights for policy 0, policy_version 266289 (0.0006) [2023-12-26 01:42:32,896][123090] Updated weights for policy 1, policy_version 264947 (0.0010) [2023-12-26 01:42:32,937][123091] Updated weights for policy 0, policy_version 266299 (0.0005) [2023-12-26 01:42:32,966][123090] Updated weights for policy 1, policy_version 264957 (0.0010) [2023-12-26 01:42:33,001][123091] Updated weights for policy 0, policy_version 266309 (0.0005) [2023-12-26 01:42:33,046][123091] Updated weights for policy 0, policy_version 266319 (0.0005) [2023-12-26 01:42:33,685][123090] Updated weights for policy 1, policy_version 264967 (0.0007) [2023-12-26 01:42:33,717][123091] Updated weights for policy 0, policy_version 266329 (0.0008) [2023-12-26 01:42:33,752][123090] Updated weights for policy 1, policy_version 264977 (0.0006) [2023-12-26 01:42:33,760][123091] Updated weights for policy 0, policy_version 266339 (0.0009) [2023-12-26 01:42:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 136011776. Throughput: 0: 8954.8, 1: 9024.9. Samples: 136031184. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:33,786][121949] Avg episode reward: [(0, '6108.962'), (1, '5288.456')] [2023-12-26 01:42:33,807][123091] Updated weights for policy 0, policy_version 266349 (0.0010) [2023-12-26 01:42:33,812][123090] Updated weights for policy 1, policy_version 264987 (0.0006) [2023-12-26 01:42:34,593][123090] Updated weights for policy 1, policy_version 264997 (0.0009) [2023-12-26 01:42:34,656][123090] Updated weights for policy 1, policy_version 265007 (0.0010) [2023-12-26 01:42:34,665][123091] Updated weights for policy 0, policy_version 266359 (0.0010) [2023-12-26 01:42:34,720][123091] Updated weights for policy 0, policy_version 266369 (0.0010) [2023-12-26 01:42:34,723][123090] Updated weights for policy 1, policy_version 265017 (0.0010) [2023-12-26 01:42:34,779][123091] Updated weights for policy 0, policy_version 266379 (0.0011) [2023-12-26 01:42:35,475][123091] Updated weights for policy 0, policy_version 266389 (0.0008) [2023-12-26 01:42:35,541][123091] Updated weights for policy 0, policy_version 266399 (0.0005) [2023-12-26 01:42:35,549][123090] Updated weights for policy 1, policy_version 265027 (0.0010) [2023-12-26 01:42:35,597][123091] Updated weights for policy 0, policy_version 266409 (0.0005) [2023-12-26 01:42:35,612][123090] Updated weights for policy 1, policy_version 265037 (0.0010) [2023-12-26 01:42:35,670][123090] Updated weights for policy 1, policy_version 265047 (0.0010) [2023-12-26 01:42:36,325][123091] Updated weights for policy 0, policy_version 266419 (0.0005) [2023-12-26 01:42:36,399][123091] Updated weights for policy 0, policy_version 266429 (0.0008) [2023-12-26 01:42:36,463][123091] Updated weights for policy 0, policy_version 266439 (0.0011) [2023-12-26 01:42:36,494][123090] Updated weights for policy 1, policy_version 265057 (0.0010) [2023-12-26 01:42:36,562][123090] Updated weights for policy 1, policy_version 265067 (0.0010) [2023-12-26 01:42:36,635][123090] Updated weights for policy 1, policy_version 265077 (0.0007) [2023-12-26 01:42:36,709][123090] Updated weights for policy 1, policy_version 265087 (0.0006) [2023-12-26 01:42:37,223][123091] Updated weights for policy 0, policy_version 266449 (0.0010) [2023-12-26 01:42:37,283][123091] Updated weights for policy 0, policy_version 266459 (0.0010) [2023-12-26 01:42:37,338][123091] Updated weights for policy 0, policy_version 266469 (0.0010) [2023-12-26 01:42:37,401][123091] Updated weights for policy 0, policy_version 266479 (0.0008) [2023-12-26 01:42:37,504][123090] Updated weights for policy 1, policy_version 265097 (0.0010) [2023-12-26 01:42:37,566][123090] Updated weights for policy 1, policy_version 265107 (0.0010) [2023-12-26 01:42:37,633][123090] Updated weights for policy 1, policy_version 265117 (0.0010) [2023-12-26 01:42:38,221][123091] Updated weights for policy 0, policy_version 266489 (0.0008) [2023-12-26 01:42:38,286][123091] Updated weights for policy 0, policy_version 266499 (0.0011) [2023-12-26 01:42:38,358][123091] Updated weights for policy 0, policy_version 266509 (0.0011) [2023-12-26 01:42:38,432][123090] Updated weights for policy 1, policy_version 265127 (0.0010) [2023-12-26 01:42:38,494][123090] Updated weights for policy 1, policy_version 265137 (0.0010) [2023-12-26 01:42:38,556][123090] Updated weights for policy 1, policy_version 265147 (0.0010) [2023-12-26 01:42:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 136110080. Throughput: 0: 8992.2, 1: 9020.5. Samples: 136084684. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:38,785][121949] Avg episode reward: [(0, '6005.797'), (1, '5211.710')] [2023-12-26 01:42:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000265152_67878912.pth... [2023-12-26 01:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000266512_68231168.pth... [2023-12-26 01:42:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000264096_67608576.pth [2023-12-26 01:42:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000265456_67960832.pth [2023-12-26 01:42:39,152][123091] Updated weights for policy 0, policy_version 266519 (0.0011) [2023-12-26 01:42:39,203][123091] Updated weights for policy 0, policy_version 266529 (0.0010) [2023-12-26 01:42:39,263][123091] Updated weights for policy 0, policy_version 266539 (0.0010) [2023-12-26 01:42:39,366][123090] Updated weights for policy 1, policy_version 265157 (0.0010) [2023-12-26 01:42:39,437][123090] Updated weights for policy 1, policy_version 265167 (0.0010) [2023-12-26 01:42:39,508][123090] Updated weights for policy 1, policy_version 265177 (0.0009) [2023-12-26 01:42:40,129][123091] Updated weights for policy 0, policy_version 266549 (0.0011) [2023-12-26 01:42:40,177][123091] Updated weights for policy 0, policy_version 266559 (0.0010) [2023-12-26 01:42:40,240][123091] Updated weights for policy 0, policy_version 266569 (0.0010) [2023-12-26 01:42:40,350][123090] Updated weights for policy 1, policy_version 265187 (0.0009) [2023-12-26 01:42:40,404][123090] Updated weights for policy 1, policy_version 265197 (0.0009) [2023-12-26 01:42:40,472][123090] Updated weights for policy 1, policy_version 265207 (0.0009) [2023-12-26 01:42:41,037][123091] Updated weights for policy 0, policy_version 266579 (0.0010) [2023-12-26 01:42:41,102][123091] Updated weights for policy 0, policy_version 266589 (0.0008) [2023-12-26 01:42:41,175][123091] Updated weights for policy 0, policy_version 266599 (0.0008) [2023-12-26 01:42:41,345][123090] Updated weights for policy 1, policy_version 265217 (0.0009) [2023-12-26 01:42:41,409][123090] Updated weights for policy 1, policy_version 265227 (0.0008) [2023-12-26 01:42:41,467][123090] Updated weights for policy 1, policy_version 265237 (0.0006) [2023-12-26 01:42:41,526][123090] Updated weights for policy 1, policy_version 265247 (0.0006) [2023-12-26 01:42:41,985][123091] Updated weights for policy 0, policy_version 266609 (0.0008) [2023-12-26 01:42:42,044][123091] Updated weights for policy 0, policy_version 266619 (0.0006) [2023-12-26 01:42:42,104][123091] Updated weights for policy 0, policy_version 266629 (0.0008) [2023-12-26 01:42:42,171][123091] Updated weights for policy 0, policy_version 266639 (0.0008) [2023-12-26 01:42:42,319][123090] Updated weights for policy 1, policy_version 265257 (0.0009) [2023-12-26 01:42:42,387][123090] Updated weights for policy 1, policy_version 265267 (0.0010) [2023-12-26 01:42:42,448][123090] Updated weights for policy 1, policy_version 265277 (0.0010) [2023-12-26 01:42:42,904][123091] Updated weights for policy 0, policy_version 266649 (0.0009) [2023-12-26 01:42:42,959][123091] Updated weights for policy 0, policy_version 266659 (0.0009) [2023-12-26 01:42:43,018][123091] Updated weights for policy 0, policy_version 266669 (0.0009) [2023-12-26 01:42:43,339][123090] Updated weights for policy 1, policy_version 265287 (0.0009) [2023-12-26 01:42:43,398][123090] Updated weights for policy 1, policy_version 265297 (0.0008) [2023-12-26 01:42:43,455][123090] Updated weights for policy 1, policy_version 265307 (0.0010) [2023-12-26 01:42:43,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 136192000. Throughput: 0: 8931.8, 1: 8911.1. Samples: 136187324. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:43,785][121949] Avg episode reward: [(0, '5876.625'), (1, '4753.775')] [2023-12-26 01:42:43,805][123091] Updated weights for policy 0, policy_version 266679 (0.0006) [2023-12-26 01:42:43,870][123091] Updated weights for policy 0, policy_version 266689 (0.0005) [2023-12-26 01:42:43,920][123091] Updated weights for policy 0, policy_version 266699 (0.0005) [2023-12-26 01:42:44,373][123090] Updated weights for policy 1, policy_version 265317 (0.0009) [2023-12-26 01:42:44,435][123090] Updated weights for policy 1, policy_version 265327 (0.0010) [2023-12-26 01:42:44,492][123090] Updated weights for policy 1, policy_version 265337 (0.0009) [2023-12-26 01:42:44,593][123091] Updated weights for policy 0, policy_version 266709 (0.0005) [2023-12-26 01:42:44,651][123091] Updated weights for policy 0, policy_version 266719 (0.0009) [2023-12-26 01:42:44,706][123091] Updated weights for policy 0, policy_version 266729 (0.0010) [2023-12-26 01:42:45,363][123091] Updated weights for policy 0, policy_version 266739 (0.0009) [2023-12-26 01:42:45,393][123090] Updated weights for policy 1, policy_version 265348 (0.0010) [2023-12-26 01:42:45,419][123091] Updated weights for policy 0, policy_version 266749 (0.0005) [2023-12-26 01:42:45,450][123090] Updated weights for policy 1, policy_version 265358 (0.0008) [2023-12-26 01:42:45,487][123091] Updated weights for policy 0, policy_version 266759 (0.0008) [2023-12-26 01:42:45,517][123090] Updated weights for policy 1, policy_version 265368 (0.0009) [2023-12-26 01:42:46,131][123091] Updated weights for policy 0, policy_version 266769 (0.0006) [2023-12-26 01:42:46,183][123091] Updated weights for policy 0, policy_version 266779 (0.0005) [2023-12-26 01:42:46,235][123091] Updated weights for policy 0, policy_version 266789 (0.0005) [2023-12-26 01:42:46,289][123091] Updated weights for policy 0, policy_version 266799 (0.0005) [2023-12-26 01:42:46,465][123090] Updated weights for policy 1, policy_version 265378 (0.0009) [2023-12-26 01:42:46,521][123090] Updated weights for policy 1, policy_version 265388 (0.0009) [2023-12-26 01:42:46,582][123090] Updated weights for policy 1, policy_version 265398 (0.0009) [2023-12-26 01:42:46,640][123090] Updated weights for policy 1, policy_version 265408 (0.0010) [2023-12-26 01:42:46,982][123091] Updated weights for policy 0, policy_version 266809 (0.0006) [2023-12-26 01:42:47,051][123091] Updated weights for policy 0, policy_version 266819 (0.0005) [2023-12-26 01:42:47,111][123091] Updated weights for policy 0, policy_version 266829 (0.0005) [2023-12-26 01:42:47,488][123090] Updated weights for policy 1, policy_version 265418 (0.0009) [2023-12-26 01:42:47,541][123090] Updated weights for policy 1, policy_version 265428 (0.0009) [2023-12-26 01:42:47,612][123090] Updated weights for policy 1, policy_version 265438 (0.0009) [2023-12-26 01:42:47,826][123091] Updated weights for policy 0, policy_version 266839 (0.0007) [2023-12-26 01:42:47,878][123091] Updated weights for policy 0, policy_version 266849 (0.0010) [2023-12-26 01:42:47,929][123091] Updated weights for policy 0, policy_version 266859 (0.0010) [2023-12-26 01:42:48,492][123090] Updated weights for policy 1, policy_version 265448 (0.0009) [2023-12-26 01:42:48,556][123090] Updated weights for policy 1, policy_version 265458 (0.0009) [2023-12-26 01:42:48,618][123090] Updated weights for policy 1, policy_version 265468 (0.0008) [2023-12-26 01:42:48,759][123091] Updated weights for policy 0, policy_version 266869 (0.0010) [2023-12-26 01:42:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 136282112. Throughput: 0: 9077.2, 1: 8819.3. Samples: 136294180. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:48,785][121949] Avg episode reward: [(0, '6003.569'), (1, '4440.649')] [2023-12-26 01:42:48,812][123091] Updated weights for policy 0, policy_version 266879 (0.0005) [2023-12-26 01:42:48,868][123091] Updated weights for policy 0, policy_version 266889 (0.0006) [2023-12-26 01:42:49,404][123090] Updated weights for policy 1, policy_version 265478 (0.0009) [2023-12-26 01:42:49,466][123090] Updated weights for policy 1, policy_version 265488 (0.0010) [2023-12-26 01:42:49,533][123090] Updated weights for policy 1, policy_version 265498 (0.0009) [2023-12-26 01:42:49,698][123091] Updated weights for policy 0, policy_version 266899 (0.0008) [2023-12-26 01:42:49,769][123091] Updated weights for policy 0, policy_version 266909 (0.0006) [2023-12-26 01:42:49,832][123091] Updated weights for policy 0, policy_version 266919 (0.0007) [2023-12-26 01:42:50,353][123090] Updated weights for policy 1, policy_version 265508 (0.0010) [2023-12-26 01:42:50,405][123090] Updated weights for policy 1, policy_version 265518 (0.0009) [2023-12-26 01:42:50,461][123090] Updated weights for policy 1, policy_version 265528 (0.0009) [2023-12-26 01:42:50,618][123091] Updated weights for policy 0, policy_version 266929 (0.0007) [2023-12-26 01:42:50,676][123091] Updated weights for policy 0, policy_version 266939 (0.0008) [2023-12-26 01:42:50,736][123091] Updated weights for policy 0, policy_version 266949 (0.0009) [2023-12-26 01:42:50,798][123091] Updated weights for policy 0, policy_version 266959 (0.0007) [2023-12-26 01:42:51,338][123090] Updated weights for policy 1, policy_version 265538 (0.0008) [2023-12-26 01:42:51,408][123090] Updated weights for policy 1, policy_version 265548 (0.0009) [2023-12-26 01:42:51,466][123090] Updated weights for policy 1, policy_version 265558 (0.0009) [2023-12-26 01:42:51,521][123090] Updated weights for policy 1, policy_version 265568 (0.0009) [2023-12-26 01:42:51,599][123091] Updated weights for policy 0, policy_version 266969 (0.0009) [2023-12-26 01:42:51,671][123091] Updated weights for policy 0, policy_version 266979 (0.0008) [2023-12-26 01:42:51,736][123091] Updated weights for policy 0, policy_version 266989 (0.0010) [2023-12-26 01:42:52,344][123090] Updated weights for policy 1, policy_version 265578 (0.0008) [2023-12-26 01:42:52,420][123090] Updated weights for policy 1, policy_version 265588 (0.0006) [2023-12-26 01:42:52,484][123090] Updated weights for policy 1, policy_version 265598 (0.0007) [2023-12-26 01:42:52,589][123091] Updated weights for policy 0, policy_version 266999 (0.0008) [2023-12-26 01:42:52,650][123091] Updated weights for policy 0, policy_version 267009 (0.0006) [2023-12-26 01:42:52,710][123091] Updated weights for policy 0, policy_version 267019 (0.0006) [2023-12-26 01:42:53,286][123090] Updated weights for policy 1, policy_version 265608 (0.0007) [2023-12-26 01:42:53,335][123090] Updated weights for policy 1, policy_version 265618 (0.0006) [2023-12-26 01:42:53,383][123090] Updated weights for policy 1, policy_version 265628 (0.0010) [2023-12-26 01:42:53,416][123091] Updated weights for policy 0, policy_version 267029 (0.0008) [2023-12-26 01:42:53,476][123091] Updated weights for policy 0, policy_version 267039 (0.0009) [2023-12-26 01:42:53,534][123091] Updated weights for policy 0, policy_version 267049 (0.0008) [2023-12-26 01:42:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 136372224. Throughput: 0: 9105.9, 1: 8781.0. Samples: 136345592. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:53,785][121949] Avg episode reward: [(0, '6111.836'), (1, '4528.897')] [2023-12-26 01:42:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000267056_68370432.pth... [2023-12-26 01:42:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000265632_68001792.pth... [2023-12-26 01:42:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000265968_68091904.pth [2023-12-26 01:42:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000264608_67739648.pth [2023-12-26 01:42:54,214][123090] Updated weights for policy 1, policy_version 265638 (0.0010) [2023-12-26 01:42:54,275][123090] Updated weights for policy 1, policy_version 265648 (0.0010) [2023-12-26 01:42:54,286][123091] Updated weights for policy 0, policy_version 267059 (0.0009) [2023-12-26 01:42:54,323][123090] Updated weights for policy 1, policy_version 265658 (0.0010) [2023-12-26 01:42:54,348][123091] Updated weights for policy 0, policy_version 267069 (0.0008) [2023-12-26 01:42:54,400][123091] Updated weights for policy 0, policy_version 267079 (0.0009) [2023-12-26 01:42:55,128][123090] Updated weights for policy 1, policy_version 265668 (0.0009) [2023-12-26 01:42:55,179][123090] Updated weights for policy 1, policy_version 265678 (0.0009) [2023-12-26 01:42:55,235][123090] Updated weights for policy 1, policy_version 265688 (0.0012) [2023-12-26 01:42:55,235][123091] Updated weights for policy 0, policy_version 267089 (0.0008) [2023-12-26 01:42:55,297][123091] Updated weights for policy 0, policy_version 267099 (0.0010) [2023-12-26 01:42:55,367][123091] Updated weights for policy 0, policy_version 267109 (0.0009) [2023-12-26 01:42:55,421][123091] Updated weights for policy 0, policy_version 267119 (0.0010) [2023-12-26 01:42:55,988][123090] Updated weights for policy 1, policy_version 265698 (0.0008) [2023-12-26 01:42:56,043][123090] Updated weights for policy 1, policy_version 265708 (0.0009) [2023-12-26 01:42:56,090][123090] Updated weights for policy 1, policy_version 265718 (0.0009) [2023-12-26 01:42:56,172][123091] Updated weights for policy 0, policy_version 267129 (0.0010) [2023-12-26 01:42:56,225][123091] Updated weights for policy 0, policy_version 267139 (0.0010) [2023-12-26 01:42:56,278][123091] Updated weights for policy 0, policy_version 267149 (0.0010) [2023-12-26 01:42:56,858][123090] Updated weights for policy 1, policy_version 265729 (0.0007) [2023-12-26 01:42:56,918][123090] Updated weights for policy 1, policy_version 265739 (0.0006) [2023-12-26 01:42:56,986][123090] Updated weights for policy 1, policy_version 265749 (0.0005) [2023-12-26 01:42:57,058][123090] Updated weights for policy 1, policy_version 265759 (0.0005) [2023-12-26 01:42:57,191][123091] Updated weights for policy 0, policy_version 267160 (0.0009) [2023-12-26 01:42:57,239][123091] Updated weights for policy 0, policy_version 267170 (0.0009) [2023-12-26 01:42:57,287][123091] Updated weights for policy 0, policy_version 267180 (0.0009) [2023-12-26 01:42:57,778][123090] Updated weights for policy 1, policy_version 265769 (0.0010) [2023-12-26 01:42:57,825][123090] Updated weights for policy 1, policy_version 265779 (0.0010) [2023-12-26 01:42:57,875][123090] Updated weights for policy 1, policy_version 265789 (0.0010) [2023-12-26 01:42:58,065][123091] Updated weights for policy 0, policy_version 267190 (0.0009) [2023-12-26 01:42:58,126][123091] Updated weights for policy 0, policy_version 267200 (0.0009) [2023-12-26 01:42:58,195][123091] Updated weights for policy 0, policy_version 267210 (0.0008) [2023-12-26 01:42:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 136454144. Throughput: 0: 9129.2, 1: 8873.4. Samples: 136452800. Policy #0 lag: (min: 2.0, avg: 13.2, max: 34.0) [2023-12-26 01:42:58,785][121949] Avg episode reward: [(0, '6067.159'), (1, '4575.724')] [2023-12-26 01:42:58,789][123090] Updated weights for policy 1, policy_version 265799 (0.0009) [2023-12-26 01:42:58,852][123090] Updated weights for policy 1, policy_version 265809 (0.0009) [2023-12-26 01:42:58,916][123090] Updated weights for policy 1, policy_version 265819 (0.0010) [2023-12-26 01:42:59,095][123091] Updated weights for policy 0, policy_version 267220 (0.0010) [2023-12-26 01:42:59,161][123091] Updated weights for policy 0, policy_version 267230 (0.0010) [2023-12-26 01:42:59,230][123091] Updated weights for policy 0, policy_version 267240 (0.0010) [2023-12-26 01:42:59,748][123090] Updated weights for policy 1, policy_version 265829 (0.0009) [2023-12-26 01:42:59,795][123090] Updated weights for policy 1, policy_version 265839 (0.0008) [2023-12-26 01:42:59,856][123090] Updated weights for policy 1, policy_version 265849 (0.0009) [2023-12-26 01:43:00,089][123091] Updated weights for policy 0, policy_version 267250 (0.0007) [2023-12-26 01:43:00,152][123091] Updated weights for policy 0, policy_version 267260 (0.0010) [2023-12-26 01:43:00,210][123091] Updated weights for policy 0, policy_version 267270 (0.0010) [2023-12-26 01:43:00,258][123091] Updated weights for policy 0, policy_version 267280 (0.0010) [2023-12-26 01:43:00,696][123090] Updated weights for policy 1, policy_version 265859 (0.0009) [2023-12-26 01:43:00,757][123090] Updated weights for policy 1, policy_version 265869 (0.0009) [2023-12-26 01:43:00,820][123090] Updated weights for policy 1, policy_version 265879 (0.0009) [2023-12-26 01:43:01,097][123091] Updated weights for policy 0, policy_version 267290 (0.0011) [2023-12-26 01:43:01,161][123091] Updated weights for policy 0, policy_version 267300 (0.0010) [2023-12-26 01:43:01,230][123091] Updated weights for policy 0, policy_version 267310 (0.0011) [2023-12-26 01:43:01,662][123090] Updated weights for policy 1, policy_version 265889 (0.0009) [2023-12-26 01:43:01,723][123090] Updated weights for policy 1, policy_version 265899 (0.0008) [2023-12-26 01:43:01,782][123090] Updated weights for policy 1, policy_version 265909 (0.0008) [2023-12-26 01:43:01,829][123090] Updated weights for policy 1, policy_version 265919 (0.0009) [2023-12-26 01:43:02,053][123091] Updated weights for policy 0, policy_version 267320 (0.0011) [2023-12-26 01:43:02,108][123091] Updated weights for policy 0, policy_version 267330 (0.0010) [2023-12-26 01:43:02,160][123091] Updated weights for policy 0, policy_version 267340 (0.0010) [2023-12-26 01:43:02,701][123090] Updated weights for policy 1, policy_version 265929 (0.0006) [2023-12-26 01:43:02,773][123090] Updated weights for policy 1, policy_version 265939 (0.0009) [2023-12-26 01:43:02,847][123090] Updated weights for policy 1, policy_version 265949 (0.0009) [2023-12-26 01:43:02,978][123091] Updated weights for policy 0, policy_version 267350 (0.0011) [2023-12-26 01:43:03,044][123091] Updated weights for policy 0, policy_version 267360 (0.0009) [2023-12-26 01:43:03,111][123091] Updated weights for policy 0, policy_version 267370 (0.0005) [2023-12-26 01:43:03,706][123090] Updated weights for policy 1, policy_version 265959 (0.0009) [2023-12-26 01:43:03,756][123090] Updated weights for policy 1, policy_version 265969 (0.0009) [2023-12-26 01:43:03,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 136536064. Throughput: 0: 9051.8, 1: 8750.0. Samples: 136554740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:03,785][121949] Avg episode reward: [(0, '5992.013'), (1, '4784.259')] [2023-12-26 01:43:03,792][123091] Updated weights for policy 0, policy_version 267380 (0.0007) [2023-12-26 01:43:03,806][123090] Updated weights for policy 1, policy_version 265979 (0.0009) [2023-12-26 01:43:03,852][123091] Updated weights for policy 0, policy_version 267390 (0.0008) [2023-12-26 01:43:03,914][123091] Updated weights for policy 0, policy_version 267400 (0.0007) [2023-12-26 01:43:04,563][123091] Updated weights for policy 0, policy_version 267410 (0.0005) [2023-12-26 01:43:04,622][123091] Updated weights for policy 0, policy_version 267420 (0.0007) [2023-12-26 01:43:04,677][123091] Updated weights for policy 0, policy_version 267430 (0.0009) [2023-12-26 01:43:04,730][123091] Updated weights for policy 0, policy_version 267440 (0.0009) [2023-12-26 01:43:04,746][123090] Updated weights for policy 1, policy_version 265989 (0.0009) [2023-12-26 01:43:04,799][123090] Updated weights for policy 1, policy_version 265999 (0.0005) [2023-12-26 01:43:04,853][123090] Updated weights for policy 1, policy_version 266009 (0.0005) [2023-12-26 01:43:05,529][123091] Updated weights for policy 0, policy_version 267450 (0.0010) [2023-12-26 01:43:05,581][123091] Updated weights for policy 0, policy_version 267460 (0.0009) [2023-12-26 01:43:05,639][123090] Updated weights for policy 1, policy_version 266019 (0.0007) [2023-12-26 01:43:05,639][123091] Updated weights for policy 0, policy_version 267471 (0.0010) [2023-12-26 01:43:05,700][123090] Updated weights for policy 1, policy_version 266029 (0.0009) [2023-12-26 01:43:05,764][123090] Updated weights for policy 1, policy_version 266039 (0.0009) [2023-12-26 01:43:06,432][123091] Updated weights for policy 0, policy_version 267481 (0.0007) [2023-12-26 01:43:06,489][123091] Updated weights for policy 0, policy_version 267491 (0.0010) [2023-12-26 01:43:06,547][123091] Updated weights for policy 0, policy_version 267501 (0.0010) [2023-12-26 01:43:06,592][123090] Updated weights for policy 1, policy_version 266049 (0.0009) [2023-12-26 01:43:06,657][123090] Updated weights for policy 1, policy_version 266059 (0.0009) [2023-12-26 01:43:06,725][123090] Updated weights for policy 1, policy_version 266069 (0.0005) [2023-12-26 01:43:06,794][123090] Updated weights for policy 1, policy_version 266079 (0.0006) [2023-12-26 01:43:07,284][123091] Updated weights for policy 0, policy_version 267511 (0.0010) [2023-12-26 01:43:07,340][123091] Updated weights for policy 0, policy_version 267521 (0.0010) [2023-12-26 01:43:07,390][123091] Updated weights for policy 0, policy_version 267531 (0.0009) [2023-12-26 01:43:07,600][123090] Updated weights for policy 1, policy_version 266089 (0.0010) [2023-12-26 01:43:07,658][123090] Updated weights for policy 1, policy_version 266099 (0.0009) [2023-12-26 01:43:07,715][123090] Updated weights for policy 1, policy_version 266109 (0.0009) [2023-12-26 01:43:08,248][123091] Updated weights for policy 0, policy_version 267541 (0.0010) [2023-12-26 01:43:08,309][123091] Updated weights for policy 0, policy_version 267551 (0.0010) [2023-12-26 01:43:08,376][123091] Updated weights for policy 0, policy_version 267561 (0.0009) [2023-12-26 01:43:08,555][123090] Updated weights for policy 1, policy_version 266119 (0.0009) [2023-12-26 01:43:08,623][123090] Updated weights for policy 1, policy_version 266129 (0.0010) [2023-12-26 01:43:08,692][123090] Updated weights for policy 1, policy_version 266139 (0.0010) [2023-12-26 01:43:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 136634368. Throughput: 0: 9085.1, 1: 8742.2. Samples: 136607576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:08,785][121949] Avg episode reward: [(0, '6151.725'), (1, '4830.826')] [2023-12-26 01:43:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000267568_68501504.pth... [2023-12-26 01:43:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000266144_68132864.pth... [2023-12-26 01:43:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000266512_68231168.pth [2023-12-26 01:43:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000265152_67878912.pth [2023-12-26 01:43:09,188][123091] Updated weights for policy 0, policy_version 267571 (0.0009) [2023-12-26 01:43:09,257][123091] Updated weights for policy 0, policy_version 267581 (0.0009) [2023-12-26 01:43:09,308][123091] Updated weights for policy 0, policy_version 267591 (0.0009) [2023-12-26 01:43:09,532][123090] Updated weights for policy 1, policy_version 266149 (0.0009) [2023-12-26 01:43:09,588][123090] Updated weights for policy 1, policy_version 266159 (0.0009) [2023-12-26 01:43:09,652][123090] Updated weights for policy 1, policy_version 266169 (0.0010) [2023-12-26 01:43:10,093][123091] Updated weights for policy 0, policy_version 267601 (0.0009) [2023-12-26 01:43:10,158][123091] Updated weights for policy 0, policy_version 267611 (0.0008) [2023-12-26 01:43:10,214][123091] Updated weights for policy 0, policy_version 267621 (0.0008) [2023-12-26 01:43:10,269][123091] Updated weights for policy 0, policy_version 267631 (0.0008) [2023-12-26 01:43:10,425][123090] Updated weights for policy 1, policy_version 266179 (0.0007) [2023-12-26 01:43:10,482][123090] Updated weights for policy 1, policy_version 266189 (0.0010) [2023-12-26 01:43:10,545][123090] Updated weights for policy 1, policy_version 266200 (0.0010) [2023-12-26 01:43:11,082][123091] Updated weights for policy 0, policy_version 267641 (0.0007) [2023-12-26 01:43:11,152][123091] Updated weights for policy 0, policy_version 267651 (0.0008) [2023-12-26 01:43:11,222][123091] Updated weights for policy 0, policy_version 267661 (0.0009) [2023-12-26 01:43:11,421][123090] Updated weights for policy 1, policy_version 266210 (0.0009) [2023-12-26 01:43:11,482][123090] Updated weights for policy 1, policy_version 266220 (0.0009) [2023-12-26 01:43:11,552][123090] Updated weights for policy 1, policy_version 266230 (0.0010) [2023-12-26 01:43:11,621][123090] Updated weights for policy 1, policy_version 266240 (0.0009) [2023-12-26 01:43:12,065][123091] Updated weights for policy 0, policy_version 267671 (0.0010) [2023-12-26 01:43:12,128][123091] Updated weights for policy 0, policy_version 267681 (0.0009) [2023-12-26 01:43:12,189][123091] Updated weights for policy 0, policy_version 267691 (0.0009) [2023-12-26 01:43:12,479][123090] Updated weights for policy 1, policy_version 266250 (0.0009) [2023-12-26 01:43:12,543][123090] Updated weights for policy 1, policy_version 266260 (0.0009) [2023-12-26 01:43:12,594][123090] Updated weights for policy 1, policy_version 266270 (0.0009) [2023-12-26 01:43:13,029][123091] Updated weights for policy 0, policy_version 267701 (0.0009) [2023-12-26 01:43:13,084][123091] Updated weights for policy 0, policy_version 267711 (0.0010) [2023-12-26 01:43:13,136][123091] Updated weights for policy 0, policy_version 267721 (0.0009) [2023-12-26 01:43:13,432][123090] Updated weights for policy 1, policy_version 266280 (0.0008) [2023-12-26 01:43:13,483][123090] Updated weights for policy 1, policy_version 266290 (0.0010) [2023-12-26 01:43:13,536][123090] Updated weights for policy 1, policy_version 266300 (0.0007) [2023-12-26 01:43:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 136716288. Throughput: 0: 9005.2, 1: 8535.9. Samples: 136709620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:13,785][121949] Avg episode reward: [(0, '6123.553'), (1, '4612.839')] [2023-12-26 01:43:13,918][123091] Updated weights for policy 0, policy_version 267731 (0.0010) [2023-12-26 01:43:13,979][123091] Updated weights for policy 0, policy_version 267741 (0.0009) [2023-12-26 01:43:14,043][123091] Updated weights for policy 0, policy_version 267751 (0.0009) [2023-12-26 01:43:14,329][123090] Updated weights for policy 1, policy_version 266310 (0.0007) [2023-12-26 01:43:14,399][123090] Updated weights for policy 1, policy_version 266320 (0.0005) [2023-12-26 01:43:14,461][123090] Updated weights for policy 1, policy_version 266330 (0.0006) [2023-12-26 01:43:14,948][123091] Updated weights for policy 0, policy_version 267761 (0.0009) [2023-12-26 01:43:15,003][123091] Updated weights for policy 0, policy_version 267771 (0.0009) [2023-12-26 01:43:15,062][123091] Updated weights for policy 0, policy_version 267781 (0.0010) [2023-12-26 01:43:15,120][123090] Updated weights for policy 1, policy_version 266340 (0.0007) [2023-12-26 01:43:15,122][123091] Updated weights for policy 0, policy_version 267791 (0.0008) [2023-12-26 01:43:15,176][123090] Updated weights for policy 1, policy_version 266350 (0.0009) [2023-12-26 01:43:15,237][123090] Updated weights for policy 1, policy_version 266360 (0.0008) [2023-12-26 01:43:15,990][123090] Updated weights for policy 1, policy_version 266370 (0.0006) [2023-12-26 01:43:16,007][123091] Updated weights for policy 0, policy_version 267801 (0.0009) [2023-12-26 01:43:16,061][123091] Updated weights for policy 0, policy_version 267811 (0.0009) [2023-12-26 01:43:16,064][123090] Updated weights for policy 1, policy_version 266380 (0.0007) [2023-12-26 01:43:16,114][123091] Updated weights for policy 0, policy_version 267821 (0.0009) [2023-12-26 01:43:16,137][123090] Updated weights for policy 1, policy_version 266390 (0.0006) [2023-12-26 01:43:16,201][123090] Updated weights for policy 1, policy_version 266400 (0.0008) [2023-12-26 01:43:16,865][123090] Updated weights for policy 1, policy_version 266410 (0.0005) [2023-12-26 01:43:16,919][123090] Updated weights for policy 1, policy_version 266420 (0.0005) [2023-12-26 01:43:16,990][123090] Updated weights for policy 1, policy_version 266430 (0.0007) [2023-12-26 01:43:17,039][123091] Updated weights for policy 0, policy_version 267831 (0.0009) [2023-12-26 01:43:17,096][123091] Updated weights for policy 0, policy_version 267842 (0.0010) [2023-12-26 01:43:17,153][123091] Updated weights for policy 0, policy_version 267852 (0.0010) [2023-12-26 01:43:17,643][123090] Updated weights for policy 1, policy_version 266440 (0.0008) [2023-12-26 01:43:17,721][123090] Updated weights for policy 1, policy_version 266450 (0.0006) [2023-12-26 01:43:17,785][123090] Updated weights for policy 1, policy_version 266460 (0.0011) [2023-12-26 01:43:18,064][123091] Updated weights for policy 0, policy_version 267862 (0.0009) [2023-12-26 01:43:18,120][123091] Updated weights for policy 0, policy_version 267872 (0.0009) [2023-12-26 01:43:18,176][123091] Updated weights for policy 0, policy_version 267882 (0.0009) [2023-12-26 01:43:18,539][123090] Updated weights for policy 1, policy_version 266470 (0.0007) [2023-12-26 01:43:18,606][123090] Updated weights for policy 1, policy_version 266480 (0.0009) [2023-12-26 01:43:18,674][123090] Updated weights for policy 1, policy_version 266490 (0.0011) [2023-12-26 01:43:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 136806400. Throughput: 0: 8849.0, 1: 8587.1. Samples: 136815804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:18,785][121949] Avg episode reward: [(0, '6165.991'), (1, '4872.811')] [2023-12-26 01:43:19,056][123091] Updated weights for policy 0, policy_version 267892 (0.0010) [2023-12-26 01:43:19,104][123091] Updated weights for policy 0, policy_version 267902 (0.0009) [2023-12-26 01:43:19,158][123091] Updated weights for policy 0, policy_version 267912 (0.0010) [2023-12-26 01:43:19,433][123090] Updated weights for policy 1, policy_version 266500 (0.0008) [2023-12-26 01:43:19,509][123090] Updated weights for policy 1, policy_version 266510 (0.0008) [2023-12-26 01:43:19,579][123090] Updated weights for policy 1, policy_version 266520 (0.0008) [2023-12-26 01:43:20,038][123091] Updated weights for policy 0, policy_version 267922 (0.0009) [2023-12-26 01:43:20,098][123091] Updated weights for policy 0, policy_version 267932 (0.0006) [2023-12-26 01:43:20,159][123091] Updated weights for policy 0, policy_version 267942 (0.0006) [2023-12-26 01:43:20,217][123091] Updated weights for policy 0, policy_version 267952 (0.0010) [2023-12-26 01:43:20,406][123090] Updated weights for policy 1, policy_version 266530 (0.0009) [2023-12-26 01:43:20,461][123090] Updated weights for policy 1, policy_version 266540 (0.0010) [2023-12-26 01:43:20,511][123090] Updated weights for policy 1, policy_version 266550 (0.0009) [2023-12-26 01:43:20,563][123090] Updated weights for policy 1, policy_version 266560 (0.0009) [2023-12-26 01:43:20,986][123091] Updated weights for policy 0, policy_version 267962 (0.0010) [2023-12-26 01:43:21,053][123091] Updated weights for policy 0, policy_version 267972 (0.0010) [2023-12-26 01:43:21,117][123091] Updated weights for policy 0, policy_version 267982 (0.0010) [2023-12-26 01:43:21,498][123090] Updated weights for policy 1, policy_version 266570 (0.0009) [2023-12-26 01:43:21,555][123090] Updated weights for policy 1, policy_version 266580 (0.0009) [2023-12-26 01:43:21,609][123090] Updated weights for policy 1, policy_version 266590 (0.0009) [2023-12-26 01:43:22,011][123091] Updated weights for policy 0, policy_version 267992 (0.0009) [2023-12-26 01:43:22,081][123091] Updated weights for policy 0, policy_version 268002 (0.0010) [2023-12-26 01:43:22,146][123091] Updated weights for policy 0, policy_version 268012 (0.0010) [2023-12-26 01:43:22,538][123090] Updated weights for policy 1, policy_version 266600 (0.0009) [2023-12-26 01:43:22,602][123090] Updated weights for policy 1, policy_version 266610 (0.0009) [2023-12-26 01:43:22,660][123090] Updated weights for policy 1, policy_version 266620 (0.0009) [2023-12-26 01:43:22,963][123091] Updated weights for policy 0, policy_version 268022 (0.0006) [2023-12-26 01:43:23,028][123091] Updated weights for policy 0, policy_version 268032 (0.0006) [2023-12-26 01:43:23,081][123091] Updated weights for policy 0, policy_version 268042 (0.0007) [2023-12-26 01:43:23,508][123090] Updated weights for policy 1, policy_version 266630 (0.0010) [2023-12-26 01:43:23,574][123090] Updated weights for policy 1, policy_version 266640 (0.0009) [2023-12-26 01:43:23,632][123090] Updated weights for policy 1, policy_version 266650 (0.0009) [2023-12-26 01:43:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 136888320. Throughput: 0: 8799.5, 1: 8563.3. Samples: 136866012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:23,785][121949] Avg episode reward: [(0, '6170.564'), (1, '5254.697')] [2023-12-26 01:43:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000266656_68263936.pth... [2023-12-26 01:43:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000268048_68624384.pth... [2023-12-26 01:43:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000265632_68001792.pth [2023-12-26 01:43:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000267056_68370432.pth [2023-12-26 01:43:23,872][123091] Updated weights for policy 0, policy_version 268052 (0.0010) [2023-12-26 01:43:23,921][123091] Updated weights for policy 0, policy_version 268063 (0.0009) [2023-12-26 01:43:23,978][123091] Updated weights for policy 0, policy_version 268073 (0.0008) [2023-12-26 01:43:24,502][123090] Updated weights for policy 1, policy_version 266660 (0.0008) [2023-12-26 01:43:24,572][123090] Updated weights for policy 1, policy_version 266670 (0.0009) [2023-12-26 01:43:24,633][123090] Updated weights for policy 1, policy_version 266680 (0.0009) [2023-12-26 01:43:24,751][123091] Updated weights for policy 0, policy_version 268083 (0.0005) [2023-12-26 01:43:24,802][123091] Updated weights for policy 0, policy_version 268093 (0.0009) [2023-12-26 01:43:24,848][123091] Updated weights for policy 0, policy_version 268103 (0.0006) [2023-12-26 01:43:25,453][123090] Updated weights for policy 1, policy_version 266690 (0.0009) [2023-12-26 01:43:25,508][123090] Updated weights for policy 1, policy_version 266700 (0.0010) [2023-12-26 01:43:25,562][123090] Updated weights for policy 1, policy_version 266710 (0.0010) [2023-12-26 01:43:25,573][123091] Updated weights for policy 0, policy_version 268113 (0.0007) [2023-12-26 01:43:25,625][123090] Updated weights for policy 1, policy_version 266720 (0.0010) [2023-12-26 01:43:25,630][123091] Updated weights for policy 0, policy_version 268123 (0.0010) [2023-12-26 01:43:25,681][123091] Updated weights for policy 0, policy_version 268133 (0.0010) [2023-12-26 01:43:25,731][123091] Updated weights for policy 0, policy_version 268143 (0.0010) [2023-12-26 01:43:26,443][123090] Updated weights for policy 1, policy_version 266730 (0.0008) [2023-12-26 01:43:26,504][123090] Updated weights for policy 1, policy_version 266740 (0.0007) [2023-12-26 01:43:26,537][123091] Updated weights for policy 0, policy_version 268153 (0.0007) [2023-12-26 01:43:26,568][123090] Updated weights for policy 1, policy_version 266750 (0.0006) [2023-12-26 01:43:26,594][123091] Updated weights for policy 0, policy_version 268163 (0.0009) [2023-12-26 01:43:26,664][123091] Updated weights for policy 0, policy_version 268173 (0.0010) [2023-12-26 01:43:27,237][123090] Updated weights for policy 1, policy_version 266760 (0.0005) [2023-12-26 01:43:27,292][123090] Updated weights for policy 1, policy_version 266770 (0.0005) [2023-12-26 01:43:27,336][123091] Updated weights for policy 0, policy_version 268183 (0.0008) [2023-12-26 01:43:27,343][123090] Updated weights for policy 1, policy_version 266780 (0.0005) [2023-12-26 01:43:27,392][123091] Updated weights for policy 0, policy_version 268193 (0.0008) [2023-12-26 01:43:27,444][123091] Updated weights for policy 0, policy_version 268203 (0.0009) [2023-12-26 01:43:27,965][123090] Updated weights for policy 1, policy_version 266790 (0.0006) [2023-12-26 01:43:28,026][123090] Updated weights for policy 1, policy_version 266800 (0.0005) [2023-12-26 01:43:28,091][123090] Updated weights for policy 1, policy_version 266810 (0.0005) [2023-12-26 01:43:28,182][123091] Updated weights for policy 0, policy_version 268213 (0.0007) [2023-12-26 01:43:28,239][123091] Updated weights for policy 0, policy_version 268223 (0.0006) [2023-12-26 01:43:28,302][123091] Updated weights for policy 0, policy_version 268233 (0.0008) [2023-12-26 01:43:28,736][123090] Updated weights for policy 1, policy_version 266820 (0.0005) [2023-12-26 01:43:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 136978432. Throughput: 0: 8852.2, 1: 8619.9. Samples: 136973568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:28,785][121949] Avg episode reward: [(0, '6040.494'), (1, '5156.361')] [2023-12-26 01:43:28,796][123090] Updated weights for policy 1, policy_version 266830 (0.0005) [2023-12-26 01:43:28,852][123090] Updated weights for policy 1, policy_version 266840 (0.0005) [2023-12-26 01:43:29,118][123091] Updated weights for policy 0, policy_version 268243 (0.0009) [2023-12-26 01:43:29,174][123091] Updated weights for policy 0, policy_version 268253 (0.0009) [2023-12-26 01:43:29,233][123091] Updated weights for policy 0, policy_version 268263 (0.0010) [2023-12-26 01:43:29,491][123090] Updated weights for policy 1, policy_version 266850 (0.0007) [2023-12-26 01:43:29,556][123090] Updated weights for policy 1, policy_version 266860 (0.0009) [2023-12-26 01:43:29,621][123090] Updated weights for policy 1, policy_version 266870 (0.0009) [2023-12-26 01:43:29,688][123090] Updated weights for policy 1, policy_version 266880 (0.0008) [2023-12-26 01:43:30,022][123091] Updated weights for policy 0, policy_version 268273 (0.0011) [2023-12-26 01:43:30,077][123091] Updated weights for policy 0, policy_version 268283 (0.0010) [2023-12-26 01:43:30,139][123091] Updated weights for policy 0, policy_version 268293 (0.0010) [2023-12-26 01:43:30,201][123091] Updated weights for policy 0, policy_version 268303 (0.0010) [2023-12-26 01:43:30,430][123090] Updated weights for policy 1, policy_version 266890 (0.0009) [2023-12-26 01:43:30,484][123090] Updated weights for policy 1, policy_version 266901 (0.0010) [2023-12-26 01:43:30,541][123090] Updated weights for policy 1, policy_version 266911 (0.0007) [2023-12-26 01:43:30,873][123091] Updated weights for policy 0, policy_version 268313 (0.0008) [2023-12-26 01:43:30,933][123091] Updated weights for policy 0, policy_version 268323 (0.0010) [2023-12-26 01:43:30,985][123091] Updated weights for policy 0, policy_version 268333 (0.0009) [2023-12-26 01:43:31,277][123090] Updated weights for policy 1, policy_version 266921 (0.0010) [2023-12-26 01:43:31,340][123090] Updated weights for policy 1, policy_version 266931 (0.0009) [2023-12-26 01:43:31,406][123090] Updated weights for policy 1, policy_version 266941 (0.0009) [2023-12-26 01:43:31,785][123091] Updated weights for policy 0, policy_version 268343 (0.0007) [2023-12-26 01:43:31,847][123091] Updated weights for policy 0, policy_version 268353 (0.0006) [2023-12-26 01:43:31,903][123091] Updated weights for policy 0, policy_version 268363 (0.0005) [2023-12-26 01:43:32,257][123090] Updated weights for policy 1, policy_version 266951 (0.0009) [2023-12-26 01:43:32,325][123090] Updated weights for policy 1, policy_version 266961 (0.0007) [2023-12-26 01:43:32,403][123090] Updated weights for policy 1, policy_version 266971 (0.0009) [2023-12-26 01:43:32,680][123091] Updated weights for policy 0, policy_version 268373 (0.0008) [2023-12-26 01:43:32,732][123091] Updated weights for policy 0, policy_version 268383 (0.0009) [2023-12-26 01:43:32,786][123091] Updated weights for policy 0, policy_version 268393 (0.0009) [2023-12-26 01:43:33,217][123090] Updated weights for policy 1, policy_version 266981 (0.0009) [2023-12-26 01:43:33,280][123090] Updated weights for policy 1, policy_version 266991 (0.0009) [2023-12-26 01:43:33,335][123090] Updated weights for policy 1, policy_version 267001 (0.0010) [2023-12-26 01:43:33,577][123091] Updated weights for policy 0, policy_version 268403 (0.0008) [2023-12-26 01:43:33,628][123091] Updated weights for policy 0, policy_version 268413 (0.0006) [2023-12-26 01:43:33,692][123091] Updated weights for policy 0, policy_version 268423 (0.0006) [2023-12-26 01:43:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 137076736. Throughput: 0: 8777.7, 1: 8769.7. Samples: 137083816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:33,785][121949] Avg episode reward: [(0, '6069.547'), (1, '5104.931')] [2023-12-26 01:43:34,191][123090] Updated weights for policy 1, policy_version 267011 (0.0008) [2023-12-26 01:43:34,260][123090] Updated weights for policy 1, policy_version 267021 (0.0006) [2023-12-26 01:43:34,318][123090] Updated weights for policy 1, policy_version 267031 (0.0005) [2023-12-26 01:43:34,514][123091] Updated weights for policy 0, policy_version 268433 (0.0006) [2023-12-26 01:43:34,569][123091] Updated weights for policy 0, policy_version 268443 (0.0011) [2023-12-26 01:43:34,628][123091] Updated weights for policy 0, policy_version 268453 (0.0011) [2023-12-26 01:43:34,691][123091] Updated weights for policy 0, policy_version 268463 (0.0011) [2023-12-26 01:43:35,037][123090] Updated weights for policy 1, policy_version 267041 (0.0006) [2023-12-26 01:43:35,095][123090] Updated weights for policy 1, policy_version 267052 (0.0009) [2023-12-26 01:43:35,143][123090] Updated weights for policy 1, policy_version 267062 (0.0008) [2023-12-26 01:43:35,203][123090] Updated weights for policy 1, policy_version 267072 (0.0008) [2023-12-26 01:43:35,510][123091] Updated weights for policy 0, policy_version 268473 (0.0006) [2023-12-26 01:43:35,574][123091] Updated weights for policy 0, policy_version 268483 (0.0005) [2023-12-26 01:43:35,635][123091] Updated weights for policy 0, policy_version 268493 (0.0007) [2023-12-26 01:43:35,976][123090] Updated weights for policy 1, policy_version 267082 (0.0010) [2023-12-26 01:43:36,032][123090] Updated weights for policy 1, policy_version 267092 (0.0010) [2023-12-26 01:43:36,080][123090] Updated weights for policy 1, policy_version 267102 (0.0010) [2023-12-26 01:43:36,325][123091] Updated weights for policy 0, policy_version 268503 (0.0009) [2023-12-26 01:43:36,397][123091] Updated weights for policy 0, policy_version 268513 (0.0011) [2023-12-26 01:43:36,452][123091] Updated weights for policy 0, policy_version 268523 (0.0011) [2023-12-26 01:43:36,888][123090] Updated weights for policy 1, policy_version 267112 (0.0006) [2023-12-26 01:43:36,963][123090] Updated weights for policy 1, policy_version 267122 (0.0009) [2023-12-26 01:43:37,035][123090] Updated weights for policy 1, policy_version 267132 (0.0008) [2023-12-26 01:43:37,274][123091] Updated weights for policy 0, policy_version 268533 (0.0011) [2023-12-26 01:43:37,334][123091] Updated weights for policy 0, policy_version 268543 (0.0011) [2023-12-26 01:43:37,397][123091] Updated weights for policy 0, policy_version 268553 (0.0011) [2023-12-26 01:43:37,702][123090] Updated weights for policy 1, policy_version 267142 (0.0008) [2023-12-26 01:43:37,760][123090] Updated weights for policy 1, policy_version 267152 (0.0009) [2023-12-26 01:43:37,819][123090] Updated weights for policy 1, policy_version 267162 (0.0007) [2023-12-26 01:43:38,225][123091] Updated weights for policy 0, policy_version 268563 (0.0011) [2023-12-26 01:43:38,272][123091] Updated weights for policy 0, policy_version 268573 (0.0010) [2023-12-26 01:43:38,327][123091] Updated weights for policy 0, policy_version 268583 (0.0011) [2023-12-26 01:43:38,624][123090] Updated weights for policy 1, policy_version 267172 (0.0007) [2023-12-26 01:43:38,681][123090] Updated weights for policy 1, policy_version 267182 (0.0009) [2023-12-26 01:43:38,752][123090] Updated weights for policy 1, policy_version 267192 (0.0009) [2023-12-26 01:43:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 137158656. Throughput: 0: 8790.3, 1: 8820.2. Samples: 137138060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:38,784][121949] Avg episode reward: [(0, '6097.768'), (1, '5298.369')] [2023-12-26 01:43:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000268592_68763648.pth... [2023-12-26 01:43:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000267568_68501504.pth [2023-12-26 01:43:38,804][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000267200_68403200.pth... [2023-12-26 01:43:38,809][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000266144_68132864.pth [2023-12-26 01:43:39,179][123091] Updated weights for policy 0, policy_version 268593 (0.0011) [2023-12-26 01:43:39,234][123091] Updated weights for policy 0, policy_version 268603 (0.0009) [2023-12-26 01:43:39,295][123091] Updated weights for policy 0, policy_version 268613 (0.0010) [2023-12-26 01:43:39,358][123091] Updated weights for policy 0, policy_version 268623 (0.0010) [2023-12-26 01:43:39,593][123090] Updated weights for policy 1, policy_version 267202 (0.0008) [2023-12-26 01:43:39,654][123090] Updated weights for policy 1, policy_version 267212 (0.0007) [2023-12-26 01:43:39,714][123090] Updated weights for policy 1, policy_version 267222 (0.0009) [2023-12-26 01:43:39,771][123090] Updated weights for policy 1, policy_version 267232 (0.0009) [2023-12-26 01:43:40,206][123091] Updated weights for policy 0, policy_version 268633 (0.0008) [2023-12-26 01:43:40,254][123091] Updated weights for policy 0, policy_version 268643 (0.0008) [2023-12-26 01:43:40,324][123091] Updated weights for policy 0, policy_version 268653 (0.0008) [2023-12-26 01:43:40,643][123090] Updated weights for policy 1, policy_version 267242 (0.0010) [2023-12-26 01:43:40,709][123090] Updated weights for policy 1, policy_version 267252 (0.0010) [2023-12-26 01:43:40,766][123090] Updated weights for policy 1, policy_version 267262 (0.0009) [2023-12-26 01:43:40,992][123091] Updated weights for policy 0, policy_version 268663 (0.0005) [2023-12-26 01:43:41,062][123091] Updated weights for policy 0, policy_version 268673 (0.0008) [2023-12-26 01:43:41,124][123091] Updated weights for policy 0, policy_version 268683 (0.0010) [2023-12-26 01:43:41,652][123090] Updated weights for policy 1, policy_version 267272 (0.0009) [2023-12-26 01:43:41,716][123090] Updated weights for policy 1, policy_version 267282 (0.0010) [2023-12-26 01:43:41,782][123090] Updated weights for policy 1, policy_version 267292 (0.0009) [2023-12-26 01:43:41,943][123091] Updated weights for policy 0, policy_version 268693 (0.0010) [2023-12-26 01:43:42,013][123091] Updated weights for policy 0, policy_version 268703 (0.0005) [2023-12-26 01:43:42,084][123091] Updated weights for policy 0, policy_version 268713 (0.0006) [2023-12-26 01:43:42,609][123090] Updated weights for policy 1, policy_version 267302 (0.0010) [2023-12-26 01:43:42,674][123090] Updated weights for policy 1, policy_version 267312 (0.0011) [2023-12-26 01:43:42,738][123090] Updated weights for policy 1, policy_version 267322 (0.0011) [2023-12-26 01:43:42,745][123091] Updated weights for policy 0, policy_version 268723 (0.0006) [2023-12-26 01:43:42,802][123091] Updated weights for policy 0, policy_version 268733 (0.0008) [2023-12-26 01:43:42,857][123091] Updated weights for policy 0, policy_version 268744 (0.0010) [2023-12-26 01:43:43,462][123090] Updated weights for policy 1, policy_version 267332 (0.0010) [2023-12-26 01:43:43,520][123090] Updated weights for policy 1, policy_version 267342 (0.0008) [2023-12-26 01:43:43,586][123090] Updated weights for policy 1, policy_version 267352 (0.0005) [2023-12-26 01:43:43,751][123091] Updated weights for policy 0, policy_version 268754 (0.0009) [2023-12-26 01:43:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 137248768. Throughput: 0: 8802.6, 1: 8747.5. Samples: 137242556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:43,785][121949] Avg episode reward: [(0, '6058.708'), (1, '5292.686')] [2023-12-26 01:43:43,799][123091] Updated weights for policy 0, policy_version 268764 (0.0009) [2023-12-26 01:43:43,856][123091] Updated weights for policy 0, policy_version 268774 (0.0010) [2023-12-26 01:43:43,924][123091] Updated weights for policy 0, policy_version 268784 (0.0009) [2023-12-26 01:43:44,307][123090] Updated weights for policy 1, policy_version 267362 (0.0006) [2023-12-26 01:43:44,367][123090] Updated weights for policy 1, policy_version 267372 (0.0007) [2023-12-26 01:43:44,442][123090] Updated weights for policy 1, policy_version 267382 (0.0005) [2023-12-26 01:43:44,505][123090] Updated weights for policy 1, policy_version 267392 (0.0006) [2023-12-26 01:43:44,838][123091] Updated weights for policy 0, policy_version 268794 (0.0007) [2023-12-26 01:43:44,913][123091] Updated weights for policy 0, policy_version 268804 (0.0005) [2023-12-26 01:43:44,990][123091] Updated weights for policy 0, policy_version 268814 (0.0006) [2023-12-26 01:43:45,208][123090] Updated weights for policy 1, policy_version 267402 (0.0006) [2023-12-26 01:43:45,263][123090] Updated weights for policy 1, policy_version 267412 (0.0007) [2023-12-26 01:43:45,316][123090] Updated weights for policy 1, policy_version 267422 (0.0006) [2023-12-26 01:43:45,717][123091] Updated weights for policy 0, policy_version 268824 (0.0008) [2023-12-26 01:43:45,780][123091] Updated weights for policy 0, policy_version 268834 (0.0006) [2023-12-26 01:43:45,826][123091] Updated weights for policy 0, policy_version 268844 (0.0005) [2023-12-26 01:43:46,021][123090] Updated weights for policy 1, policy_version 267432 (0.0006) [2023-12-26 01:43:46,099][123090] Updated weights for policy 1, policy_version 267442 (0.0007) [2023-12-26 01:43:46,167][123090] Updated weights for policy 1, policy_version 267452 (0.0007) [2023-12-26 01:43:46,549][123091] Updated weights for policy 0, policy_version 268854 (0.0007) [2023-12-26 01:43:46,604][123091] Updated weights for policy 0, policy_version 268864 (0.0009) [2023-12-26 01:43:46,665][123091] Updated weights for policy 0, policy_version 268874 (0.0009) [2023-12-26 01:43:46,851][123090] Updated weights for policy 1, policy_version 267462 (0.0008) [2023-12-26 01:43:46,923][123090] Updated weights for policy 1, policy_version 267472 (0.0009) [2023-12-26 01:43:46,982][123090] Updated weights for policy 1, policy_version 267482 (0.0010) [2023-12-26 01:43:47,504][123091] Updated weights for policy 0, policy_version 268884 (0.0009) [2023-12-26 01:43:47,572][123091] Updated weights for policy 0, policy_version 268894 (0.0005) [2023-12-26 01:43:47,648][123091] Updated weights for policy 0, policy_version 268904 (0.0007) [2023-12-26 01:43:47,678][123090] Updated weights for policy 1, policy_version 267492 (0.0008) [2023-12-26 01:43:47,730][123090] Updated weights for policy 1, policy_version 267502 (0.0007) [2023-12-26 01:43:47,792][123090] Updated weights for policy 1, policy_version 267512 (0.0010) [2023-12-26 01:43:48,296][123091] Updated weights for policy 0, policy_version 268914 (0.0008) [2023-12-26 01:43:48,368][123091] Updated weights for policy 0, policy_version 268924 (0.0007) [2023-12-26 01:43:48,433][123091] Updated weights for policy 0, policy_version 268934 (0.0008) [2023-12-26 01:43:48,502][123091] Updated weights for policy 0, policy_version 268944 (0.0008) [2023-12-26 01:43:48,584][123090] Updated weights for policy 1, policy_version 267522 (0.0009) [2023-12-26 01:43:48,657][123090] Updated weights for policy 1, policy_version 267532 (0.0006) [2023-12-26 01:43:48,718][123090] Updated weights for policy 1, policy_version 267542 (0.0010) [2023-12-26 01:43:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 137338880. Throughput: 0: 8825.2, 1: 8940.7. Samples: 137354200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:48,785][121949] Avg episode reward: [(0, '5905.855'), (1, '5203.274')] [2023-12-26 01:43:48,786][123090] Updated weights for policy 1, policy_version 267552 (0.0011) [2023-12-26 01:43:49,244][123091] Updated weights for policy 0, policy_version 268954 (0.0007) [2023-12-26 01:43:49,312][123091] Updated weights for policy 0, policy_version 268964 (0.0006) [2023-12-26 01:43:49,377][123091] Updated weights for policy 0, policy_version 268974 (0.0009) [2023-12-26 01:43:49,514][123090] Updated weights for policy 1, policy_version 267562 (0.0005) [2023-12-26 01:43:49,579][123090] Updated weights for policy 1, policy_version 267572 (0.0006) [2023-12-26 01:43:49,639][123090] Updated weights for policy 1, policy_version 267582 (0.0006) [2023-12-26 01:43:50,183][123091] Updated weights for policy 0, policy_version 268984 (0.0009) [2023-12-26 01:43:50,249][123091] Updated weights for policy 0, policy_version 268994 (0.0008) [2023-12-26 01:43:50,311][123091] Updated weights for policy 0, policy_version 269004 (0.0009) [2023-12-26 01:43:50,373][123090] Updated weights for policy 1, policy_version 267592 (0.0006) [2023-12-26 01:43:50,430][123090] Updated weights for policy 1, policy_version 267602 (0.0006) [2023-12-26 01:43:50,484][123090] Updated weights for policy 1, policy_version 267612 (0.0005) [2023-12-26 01:43:51,166][123091] Updated weights for policy 0, policy_version 269014 (0.0009) [2023-12-26 01:43:51,228][123091] Updated weights for policy 0, policy_version 269024 (0.0009) [2023-12-26 01:43:51,248][123090] Updated weights for policy 1, policy_version 267622 (0.0008) [2023-12-26 01:43:51,296][123091] Updated weights for policy 0, policy_version 269034 (0.0008) [2023-12-26 01:43:51,316][123090] Updated weights for policy 1, policy_version 267632 (0.0007) [2023-12-26 01:43:51,388][123090] Updated weights for policy 1, policy_version 267642 (0.0008) [2023-12-26 01:43:52,119][123091] Updated weights for policy 0, policy_version 269044 (0.0010) [2023-12-26 01:43:52,182][123090] Updated weights for policy 1, policy_version 267652 (0.0008) [2023-12-26 01:43:52,185][123091] Updated weights for policy 0, policy_version 269054 (0.0009) [2023-12-26 01:43:52,237][123090] Updated weights for policy 1, policy_version 267662 (0.0006) [2023-12-26 01:43:52,257][123091] Updated weights for policy 0, policy_version 269064 (0.0010) [2023-12-26 01:43:52,297][123090] Updated weights for policy 1, policy_version 267672 (0.0006) [2023-12-26 01:43:53,053][123090] Updated weights for policy 1, policy_version 267682 (0.0006) [2023-12-26 01:43:53,102][123091] Updated weights for policy 0, policy_version 269074 (0.0009) [2023-12-26 01:43:53,123][123090] Updated weights for policy 1, policy_version 267692 (0.0006) [2023-12-26 01:43:53,152][123091] Updated weights for policy 0, policy_version 269084 (0.0009) [2023-12-26 01:43:53,188][123090] Updated weights for policy 1, policy_version 267702 (0.0008) [2023-12-26 01:43:53,201][123091] Updated weights for policy 0, policy_version 269094 (0.0008) [2023-12-26 01:43:53,237][123090] Updated weights for policy 1, policy_version 267712 (0.0009) [2023-12-26 01:43:53,256][123091] Updated weights for policy 0, policy_version 269104 (0.0008) [2023-12-26 01:43:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 137428992. Throughput: 0: 8784.6, 1: 8986.2. Samples: 137407260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:53,785][121949] Avg episode reward: [(0, '5916.023'), (1, '5127.167')] [2023-12-26 01:43:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000267712_68534272.pth... [2023-12-26 01:43:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000269104_68894720.pth... [2023-12-26 01:43:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000266656_68263936.pth [2023-12-26 01:43:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000268048_68624384.pth [2023-12-26 01:43:53,999][123090] Updated weights for policy 1, policy_version 267722 (0.0009) [2023-12-26 01:43:54,054][123090] Updated weights for policy 1, policy_version 267732 (0.0009) [2023-12-26 01:43:54,095][123091] Updated weights for policy 0, policy_version 269114 (0.0009) [2023-12-26 01:43:54,102][123090] Updated weights for policy 1, policy_version 267742 (0.0006) [2023-12-26 01:43:54,149][123091] Updated weights for policy 0, policy_version 269124 (0.0009) [2023-12-26 01:43:54,202][123091] Updated weights for policy 0, policy_version 269134 (0.0010) [2023-12-26 01:43:54,946][123090] Updated weights for policy 1, policy_version 267752 (0.0006) [2023-12-26 01:43:55,014][123090] Updated weights for policy 1, policy_version 267762 (0.0007) [2023-12-26 01:43:55,036][123091] Updated weights for policy 0, policy_version 269144 (0.0009) [2023-12-26 01:43:55,084][123090] Updated weights for policy 1, policy_version 267772 (0.0009) [2023-12-26 01:43:55,087][123091] Updated weights for policy 0, policy_version 269154 (0.0009) [2023-12-26 01:43:55,142][123091] Updated weights for policy 0, policy_version 269164 (0.0008) [2023-12-26 01:43:55,837][123090] Updated weights for policy 1, policy_version 267782 (0.0009) [2023-12-26 01:43:55,885][123090] Updated weights for policy 1, policy_version 267792 (0.0009) [2023-12-26 01:43:55,935][123090] Updated weights for policy 1, policy_version 267803 (0.0009) [2023-12-26 01:43:55,999][123091] Updated weights for policy 0, policy_version 269175 (0.0009) [2023-12-26 01:43:56,059][123091] Updated weights for policy 0, policy_version 269185 (0.0010) [2023-12-26 01:43:56,114][123091] Updated weights for policy 0, policy_version 269195 (0.0009) [2023-12-26 01:43:56,767][123090] Updated weights for policy 1, policy_version 267813 (0.0006) [2023-12-26 01:43:56,825][123090] Updated weights for policy 1, policy_version 267823 (0.0005) [2023-12-26 01:43:56,873][123091] Updated weights for policy 0, policy_version 269205 (0.0009) [2023-12-26 01:43:56,876][123090] Updated weights for policy 1, policy_version 267833 (0.0005) [2023-12-26 01:43:56,932][123091] Updated weights for policy 0, policy_version 269215 (0.0010) [2023-12-26 01:43:56,986][123091] Updated weights for policy 0, policy_version 269225 (0.0010) [2023-12-26 01:43:57,650][123090] Updated weights for policy 1, policy_version 267843 (0.0005) [2023-12-26 01:43:57,705][123091] Updated weights for policy 0, policy_version 269235 (0.0009) [2023-12-26 01:43:57,709][123090] Updated weights for policy 1, policy_version 267853 (0.0006) [2023-12-26 01:43:57,752][123091] Updated weights for policy 0, policy_version 269245 (0.0005) [2023-12-26 01:43:57,773][123090] Updated weights for policy 1, policy_version 267863 (0.0008) [2023-12-26 01:43:57,802][123091] Updated weights for policy 0, policy_version 269255 (0.0005) [2023-12-26 01:43:58,525][123090] Updated weights for policy 1, policy_version 267873 (0.0008) [2023-12-26 01:43:58,571][123091] Updated weights for policy 0, policy_version 269266 (0.0006) [2023-12-26 01:43:58,595][123090] Updated weights for policy 1, policy_version 267883 (0.0008) [2023-12-26 01:43:58,645][123091] Updated weights for policy 0, policy_version 269276 (0.0009) [2023-12-26 01:43:58,664][123090] Updated weights for policy 1, policy_version 267893 (0.0007) [2023-12-26 01:43:58,714][123091] Updated weights for policy 0, policy_version 269286 (0.0010) [2023-12-26 01:43:58,732][123090] Updated weights for policy 1, policy_version 267903 (0.0008) [2023-12-26 01:43:58,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 137519104. Throughput: 0: 8787.5, 1: 9066.2. Samples: 137513040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:43:58,785][121949] Avg episode reward: [(0, '6129.459'), (1, '5307.226')] [2023-12-26 01:43:58,785][123091] Updated weights for policy 0, policy_version 269296 (0.0009) [2023-12-26 01:43:59,559][123091] Updated weights for policy 0, policy_version 269306 (0.0011) [2023-12-26 01:43:59,615][123091] Updated weights for policy 0, policy_version 269316 (0.0007) [2023-12-26 01:43:59,635][123090] Updated weights for policy 1, policy_version 267913 (0.0005) [2023-12-26 01:43:59,674][123091] Updated weights for policy 0, policy_version 269326 (0.0007) [2023-12-26 01:43:59,704][123090] Updated weights for policy 1, policy_version 267923 (0.0006) [2023-12-26 01:43:59,772][123090] Updated weights for policy 1, policy_version 267933 (0.0005) [2023-12-26 01:44:00,473][123091] Updated weights for policy 0, policy_version 269336 (0.0008) [2023-12-26 01:44:00,495][123090] Updated weights for policy 1, policy_version 267943 (0.0007) [2023-12-26 01:44:00,519][123091] Updated weights for policy 0, policy_version 269346 (0.0009) [2023-12-26 01:44:00,539][123090] Updated weights for policy 1, policy_version 267953 (0.0005) [2023-12-26 01:44:00,565][123091] Updated weights for policy 0, policy_version 269356 (0.0010) [2023-12-26 01:44:00,591][123090] Updated weights for policy 1, policy_version 267964 (0.0008) [2023-12-26 01:44:01,419][123091] Updated weights for policy 0, policy_version 269366 (0.0008) [2023-12-26 01:44:01,472][123090] Updated weights for policy 1, policy_version 267974 (0.0008) [2023-12-26 01:44:01,483][123091] Updated weights for policy 0, policy_version 269376 (0.0006) [2023-12-26 01:44:01,529][123090] Updated weights for policy 1, policy_version 267984 (0.0009) [2023-12-26 01:44:01,541][123091] Updated weights for policy 0, policy_version 269386 (0.0005) [2023-12-26 01:44:01,589][123090] Updated weights for policy 1, policy_version 267994 (0.0009) [2023-12-26 01:44:02,344][123091] Updated weights for policy 0, policy_version 269396 (0.0009) [2023-12-26 01:44:02,403][123090] Updated weights for policy 1, policy_version 268004 (0.0010) [2023-12-26 01:44:02,414][123091] Updated weights for policy 0, policy_version 269406 (0.0008) [2023-12-26 01:44:02,455][123090] Updated weights for policy 1, policy_version 268014 (0.0010) [2023-12-26 01:44:02,466][123091] Updated weights for policy 0, policy_version 269416 (0.0006) [2023-12-26 01:44:02,517][123090] Updated weights for policy 1, policy_version 268024 (0.0010) [2023-12-26 01:44:03,118][123091] Updated weights for policy 0, policy_version 269426 (0.0007) [2023-12-26 01:44:03,188][123091] Updated weights for policy 0, policy_version 269436 (0.0005) [2023-12-26 01:44:03,253][123091] Updated weights for policy 0, policy_version 269446 (0.0005) [2023-12-26 01:44:03,307][123091] Updated weights for policy 0, policy_version 269456 (0.0005) [2023-12-26 01:44:03,347][123090] Updated weights for policy 1, policy_version 268034 (0.0010) [2023-12-26 01:44:03,393][123090] Updated weights for policy 1, policy_version 268044 (0.0010) [2023-12-26 01:44:03,440][123090] Updated weights for policy 1, policy_version 268054 (0.0010) [2023-12-26 01:44:03,484][123090] Updated weights for policy 1, policy_version 268064 (0.0010) [2023-12-26 01:44:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 137609216. Throughput: 0: 8914.8, 1: 8947.6. Samples: 137619608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:44:03,785][121949] Avg episode reward: [(0, '6154.770'), (1, '5396.362')] [2023-12-26 01:44:04,040][123091] Updated weights for policy 0, policy_version 269466 (0.0009) [2023-12-26 01:44:04,107][123091] Updated weights for policy 0, policy_version 269476 (0.0009) [2023-12-26 01:44:04,174][123091] Updated weights for policy 0, policy_version 269486 (0.0010) [2023-12-26 01:44:04,352][123090] Updated weights for policy 1, policy_version 268074 (0.0010) [2023-12-26 01:44:04,422][123090] Updated weights for policy 1, policy_version 268084 (0.0010) [2023-12-26 01:44:04,482][123090] Updated weights for policy 1, policy_version 268094 (0.0009) [2023-12-26 01:44:04,994][123091] Updated weights for policy 0, policy_version 269496 (0.0008) [2023-12-26 01:44:05,052][123091] Updated weights for policy 0, policy_version 269506 (0.0010) [2023-12-26 01:44:05,126][123091] Updated weights for policy 0, policy_version 269516 (0.0007) [2023-12-26 01:44:05,320][123090] Updated weights for policy 1, policy_version 268104 (0.0008) [2023-12-26 01:44:05,380][123090] Updated weights for policy 1, policy_version 268114 (0.0006) [2023-12-26 01:44:05,446][123090] Updated weights for policy 1, policy_version 268124 (0.0005) [2023-12-26 01:44:05,814][123091] Updated weights for policy 0, policy_version 269526 (0.0008) [2023-12-26 01:44:05,871][123091] Updated weights for policy 0, policy_version 269536 (0.0010) [2023-12-26 01:44:05,934][123091] Updated weights for policy 0, policy_version 269546 (0.0005) [2023-12-26 01:44:06,179][123090] Updated weights for policy 1, policy_version 268134 (0.0011) [2023-12-26 01:44:06,243][123090] Updated weights for policy 1, policy_version 268144 (0.0011) [2023-12-26 01:44:06,300][123090] Updated weights for policy 1, policy_version 268154 (0.0011) [2023-12-26 01:44:06,583][123091] Updated weights for policy 0, policy_version 269556 (0.0006) [2023-12-26 01:44:06,648][123091] Updated weights for policy 0, policy_version 269566 (0.0009) [2023-12-26 01:44:06,714][123091] Updated weights for policy 0, policy_version 269576 (0.0009) [2023-12-26 01:44:07,134][123090] Updated weights for policy 1, policy_version 268164 (0.0011) [2023-12-26 01:44:07,193][123090] Updated weights for policy 1, policy_version 268174 (0.0010) [2023-12-26 01:44:07,251][123090] Updated weights for policy 1, policy_version 268184 (0.0010) [2023-12-26 01:44:07,505][123091] Updated weights for policy 0, policy_version 269586 (0.0008) [2023-12-26 01:44:07,557][123091] Updated weights for policy 0, policy_version 269596 (0.0006) [2023-12-26 01:44:07,615][123091] Updated weights for policy 0, policy_version 269606 (0.0006) [2023-12-26 01:44:07,672][123091] Updated weights for policy 0, policy_version 269616 (0.0006) [2023-12-26 01:44:08,052][123090] Updated weights for policy 1, policy_version 268194 (0.0009) [2023-12-26 01:44:08,112][123090] Updated weights for policy 1, policy_version 268204 (0.0010) [2023-12-26 01:44:08,174][123090] Updated weights for policy 1, policy_version 268214 (0.0010) [2023-12-26 01:44:08,232][123090] Updated weights for policy 1, policy_version 268224 (0.0008) [2023-12-26 01:44:08,397][123091] Updated weights for policy 0, policy_version 269626 (0.0006) [2023-12-26 01:44:08,456][123091] Updated weights for policy 0, policy_version 269636 (0.0009) [2023-12-26 01:44:08,504][123091] Updated weights for policy 0, policy_version 269646 (0.0010) [2023-12-26 01:44:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 137699328. Throughput: 0: 8983.2, 1: 8976.0. Samples: 137674176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:44:08,785][121949] Avg episode reward: [(0, '6096.419'), (1, '5279.405')] [2023-12-26 01:44:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000269648_69033984.pth... [2023-12-26 01:44:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000268224_68665344.pth... [2023-12-26 01:44:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000268592_68763648.pth [2023-12-26 01:44:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000267200_68403200.pth [2023-12-26 01:44:09,027][123090] Updated weights for policy 1, policy_version 268234 (0.0009) [2023-12-26 01:44:09,080][123090] Updated weights for policy 1, policy_version 268244 (0.0009) [2023-12-26 01:44:09,133][123090] Updated weights for policy 1, policy_version 268254 (0.0009) [2023-12-26 01:44:09,351][123091] Updated weights for policy 0, policy_version 269656 (0.0011) [2023-12-26 01:44:09,417][123091] Updated weights for policy 0, policy_version 269666 (0.0011) [2023-12-26 01:44:09,485][123091] Updated weights for policy 0, policy_version 269676 (0.0011) [2023-12-26 01:44:10,018][123090] Updated weights for policy 1, policy_version 268264 (0.0007) [2023-12-26 01:44:10,086][123090] Updated weights for policy 1, policy_version 268274 (0.0005) [2023-12-26 01:44:10,139][123090] Updated weights for policy 1, policy_version 268284 (0.0006) [2023-12-26 01:44:10,357][123091] Updated weights for policy 0, policy_version 269686 (0.0011) [2023-12-26 01:44:10,420][123091] Updated weights for policy 0, policy_version 269696 (0.0011) [2023-12-26 01:44:10,468][123091] Updated weights for policy 0, policy_version 269706 (0.0009) [2023-12-26 01:44:10,843][123090] Updated weights for policy 1, policy_version 268294 (0.0006) [2023-12-26 01:44:10,905][123090] Updated weights for policy 1, policy_version 268304 (0.0005) [2023-12-26 01:44:10,967][123090] Updated weights for policy 1, policy_version 268314 (0.0005) [2023-12-26 01:44:11,283][123091] Updated weights for policy 0, policy_version 269716 (0.0010) [2023-12-26 01:44:11,344][123091] Updated weights for policy 0, policy_version 269726 (0.0007) [2023-12-26 01:44:11,412][123091] Updated weights for policy 0, policy_version 269736 (0.0010) [2023-12-26 01:44:11,757][123090] Updated weights for policy 1, policy_version 268324 (0.0007) [2023-12-26 01:44:11,808][123090] Updated weights for policy 1, policy_version 268334 (0.0010) [2023-12-26 01:44:11,866][123090] Updated weights for policy 1, policy_version 268344 (0.0010) [2023-12-26 01:44:12,264][123091] Updated weights for policy 0, policy_version 269746 (0.0010) [2023-12-26 01:44:12,332][123091] Updated weights for policy 0, policy_version 269756 (0.0009) [2023-12-26 01:44:12,402][123091] Updated weights for policy 0, policy_version 269766 (0.0008) [2023-12-26 01:44:12,469][123091] Updated weights for policy 0, policy_version 269776 (0.0010) [2023-12-26 01:44:12,691][123090] Updated weights for policy 1, policy_version 268354 (0.0008) [2023-12-26 01:44:12,747][123090] Updated weights for policy 1, policy_version 268364 (0.0009) [2023-12-26 01:44:12,815][123090] Updated weights for policy 1, policy_version 268375 (0.0010) [2023-12-26 01:44:13,299][123091] Updated weights for policy 0, policy_version 269786 (0.0010) [2023-12-26 01:44:13,343][123091] Updated weights for policy 0, policy_version 269796 (0.0010) [2023-12-26 01:44:13,398][123091] Updated weights for policy 0, policy_version 269806 (0.0010) [2023-12-26 01:44:13,561][123090] Updated weights for policy 1, policy_version 268385 (0.0006) [2023-12-26 01:44:13,623][123090] Updated weights for policy 1, policy_version 268395 (0.0005) [2023-12-26 01:44:13,691][123090] Updated weights for policy 1, policy_version 268405 (0.0005) [2023-12-26 01:44:13,746][123090] Updated weights for policy 1, policy_version 268415 (0.0005) [2023-12-26 01:44:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 137789440. Throughput: 0: 8917.2, 1: 8977.6. Samples: 137778832. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:13,785][121949] Avg episode reward: [(0, '6122.741'), (1, '5325.185')] [2023-12-26 01:44:14,059][123091] Updated weights for policy 0, policy_version 269816 (0.0009) [2023-12-26 01:44:14,119][123091] Updated weights for policy 0, policy_version 269826 (0.0010) [2023-12-26 01:44:14,187][123091] Updated weights for policy 0, policy_version 269836 (0.0010) [2023-12-26 01:44:14,433][123090] Updated weights for policy 1, policy_version 268425 (0.0006) [2023-12-26 01:44:14,487][123090] Updated weights for policy 1, policy_version 268435 (0.0005) [2023-12-26 01:44:14,549][123090] Updated weights for policy 1, policy_version 268445 (0.0005) [2023-12-26 01:44:15,012][123091] Updated weights for policy 0, policy_version 269846 (0.0011) [2023-12-26 01:44:15,060][123091] Updated weights for policy 0, policy_version 269856 (0.0010) [2023-12-26 01:44:15,117][123091] Updated weights for policy 0, policy_version 269866 (0.0011) [2023-12-26 01:44:15,320][123090] Updated weights for policy 1, policy_version 268455 (0.0008) [2023-12-26 01:44:15,384][123090] Updated weights for policy 1, policy_version 268465 (0.0008) [2023-12-26 01:44:15,442][123090] Updated weights for policy 1, policy_version 268475 (0.0009) [2023-12-26 01:44:15,970][123091] Updated weights for policy 0, policy_version 269876 (0.0011) [2023-12-26 01:44:16,024][123091] Updated weights for policy 0, policy_version 269886 (0.0010) [2023-12-26 01:44:16,075][123091] Updated weights for policy 0, policy_version 269896 (0.0010) [2023-12-26 01:44:16,286][123090] Updated weights for policy 1, policy_version 268485 (0.0010) [2023-12-26 01:44:16,347][123090] Updated weights for policy 1, policy_version 268495 (0.0009) [2023-12-26 01:44:16,414][123090] Updated weights for policy 1, policy_version 268505 (0.0009) [2023-12-26 01:44:16,905][123091] Updated weights for policy 0, policy_version 269906 (0.0010) [2023-12-26 01:44:16,964][123091] Updated weights for policy 0, policy_version 269916 (0.0010) [2023-12-26 01:44:17,016][123091] Updated weights for policy 0, policy_version 269926 (0.0007) [2023-12-26 01:44:17,070][123091] Updated weights for policy 0, policy_version 269936 (0.0008) [2023-12-26 01:44:17,252][123090] Updated weights for policy 1, policy_version 268515 (0.0008) [2023-12-26 01:44:17,310][123090] Updated weights for policy 1, policy_version 268525 (0.0008) [2023-12-26 01:44:17,381][123090] Updated weights for policy 1, policy_version 268535 (0.0009) [2023-12-26 01:44:17,891][123091] Updated weights for policy 0, policy_version 269946 (0.0010) [2023-12-26 01:44:17,949][123091] Updated weights for policy 0, policy_version 269957 (0.0010) [2023-12-26 01:44:18,002][123091] Updated weights for policy 0, policy_version 269967 (0.0010) [2023-12-26 01:44:18,169][123090] Updated weights for policy 1, policy_version 268545 (0.0009) [2023-12-26 01:44:18,226][123090] Updated weights for policy 1, policy_version 268555 (0.0009) [2023-12-26 01:44:18,274][123090] Updated weights for policy 1, policy_version 268565 (0.0009) [2023-12-26 01:44:18,327][123090] Updated weights for policy 1, policy_version 268576 (0.0010) [2023-12-26 01:44:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 137871360. Throughput: 0: 8858.5, 1: 8932.1. Samples: 137884392. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:18,785][121949] Avg episode reward: [(0, '6063.920'), (1, '5305.257')] [2023-12-26 01:44:18,894][123091] Updated weights for policy 0, policy_version 269977 (0.0010) [2023-12-26 01:44:18,962][123091] Updated weights for policy 0, policy_version 269987 (0.0011) [2023-12-26 01:44:19,021][123091] Updated weights for policy 0, policy_version 269997 (0.0011) [2023-12-26 01:44:19,168][123090] Updated weights for policy 1, policy_version 268586 (0.0009) [2023-12-26 01:44:19,228][123090] Updated weights for policy 1, policy_version 268596 (0.0008) [2023-12-26 01:44:19,290][123090] Updated weights for policy 1, policy_version 268606 (0.0009) [2023-12-26 01:44:19,876][123091] Updated weights for policy 0, policy_version 270007 (0.0009) [2023-12-26 01:44:19,943][123091] Updated weights for policy 0, policy_version 270017 (0.0009) [2023-12-26 01:44:20,018][123091] Updated weights for policy 0, policy_version 270027 (0.0010) [2023-12-26 01:44:20,185][123090] Updated weights for policy 1, policy_version 268616 (0.0009) [2023-12-26 01:44:20,251][123090] Updated weights for policy 1, policy_version 268626 (0.0009) [2023-12-26 01:44:20,322][123090] Updated weights for policy 1, policy_version 268636 (0.0009) [2023-12-26 01:44:20,795][123091] Updated weights for policy 0, policy_version 270037 (0.0006) [2023-12-26 01:44:20,858][123091] Updated weights for policy 0, policy_version 270047 (0.0006) [2023-12-26 01:44:20,919][123091] Updated weights for policy 0, policy_version 270057 (0.0006) [2023-12-26 01:44:21,166][123090] Updated weights for policy 1, policy_version 268646 (0.0009) [2023-12-26 01:44:21,236][123090] Updated weights for policy 1, policy_version 268656 (0.0009) [2023-12-26 01:44:21,306][123090] Updated weights for policy 1, policy_version 268666 (0.0010) [2023-12-26 01:44:21,711][123091] Updated weights for policy 0, policy_version 270067 (0.0007) [2023-12-26 01:44:21,778][123091] Updated weights for policy 0, policy_version 270077 (0.0010) [2023-12-26 01:44:21,833][123091] Updated weights for policy 0, policy_version 270087 (0.0009) [2023-12-26 01:44:22,105][123090] Updated weights for policy 1, policy_version 268676 (0.0008) [2023-12-26 01:44:22,161][123090] Updated weights for policy 1, policy_version 268686 (0.0005) [2023-12-26 01:44:22,230][123090] Updated weights for policy 1, policy_version 268696 (0.0005) [2023-12-26 01:44:22,739][123091] Updated weights for policy 0, policy_version 270097 (0.0009) [2023-12-26 01:44:22,813][123091] Updated weights for policy 0, policy_version 270107 (0.0006) [2023-12-26 01:44:22,881][123091] Updated weights for policy 0, policy_version 270117 (0.0005) [2023-12-26 01:44:22,949][123091] Updated weights for policy 0, policy_version 270127 (0.0006) [2023-12-26 01:44:22,963][123090] Updated weights for policy 1, policy_version 268706 (0.0007) [2023-12-26 01:44:23,022][123090] Updated weights for policy 1, policy_version 268716 (0.0007) [2023-12-26 01:44:23,088][123090] Updated weights for policy 1, policy_version 268726 (0.0007) [2023-12-26 01:44:23,147][123090] Updated weights for policy 1, policy_version 268736 (0.0006) [2023-12-26 01:44:23,607][123091] Updated weights for policy 0, policy_version 270137 (0.0008) [2023-12-26 01:44:23,662][123091] Updated weights for policy 0, policy_version 270147 (0.0007) [2023-12-26 01:44:23,730][123091] Updated weights for policy 0, policy_version 270157 (0.0006) [2023-12-26 01:44:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 137961472. Throughput: 0: 8836.7, 1: 8877.0. Samples: 137935180. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:23,785][121949] Avg episode reward: [(0, '5838.785'), (1, '5290.724')] [2023-12-26 01:44:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000270160_69165056.pth... [2023-12-26 01:44:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000269104_68894720.pth [2023-12-26 01:44:23,847][123090] Updated weights for policy 1, policy_version 268746 (0.0008) [2023-12-26 01:44:23,905][123090] Updated weights for policy 1, policy_version 268756 (0.0008) [2023-12-26 01:44:23,964][123090] Updated weights for policy 1, policy_version 268766 (0.0009) [2023-12-26 01:44:23,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000268768_68804608.pth... [2023-12-26 01:44:23,974][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000267712_68534272.pth [2023-12-26 01:44:24,499][123091] Updated weights for policy 0, policy_version 270167 (0.0008) [2023-12-26 01:44:24,547][123091] Updated weights for policy 0, policy_version 270177 (0.0010) [2023-12-26 01:44:24,595][123091] Updated weights for policy 0, policy_version 270187 (0.0010) [2023-12-26 01:44:24,731][123090] Updated weights for policy 1, policy_version 268776 (0.0009) [2023-12-26 01:44:24,789][123090] Updated weights for policy 1, policy_version 268786 (0.0009) [2023-12-26 01:44:24,850][123090] Updated weights for policy 1, policy_version 268796 (0.0009) [2023-12-26 01:44:25,297][123091] Updated weights for policy 0, policy_version 270197 (0.0011) [2023-12-26 01:44:25,365][123091] Updated weights for policy 0, policy_version 270207 (0.0011) [2023-12-26 01:44:25,421][123091] Updated weights for policy 0, policy_version 270217 (0.0011) [2023-12-26 01:44:25,719][123090] Updated weights for policy 1, policy_version 268806 (0.0008) [2023-12-26 01:44:25,766][123090] Updated weights for policy 1, policy_version 268816 (0.0007) [2023-12-26 01:44:25,822][123090] Updated weights for policy 1, policy_version 268826 (0.0005) [2023-12-26 01:44:26,213][123091] Updated weights for policy 0, policy_version 270227 (0.0010) [2023-12-26 01:44:26,261][123091] Updated weights for policy 0, policy_version 270237 (0.0010) [2023-12-26 01:44:26,324][123091] Updated weights for policy 0, policy_version 270247 (0.0011) [2023-12-26 01:44:26,574][123090] Updated weights for policy 1, policy_version 268836 (0.0007) [2023-12-26 01:44:26,623][123090] Updated weights for policy 1, policy_version 268846 (0.0009) [2023-12-26 01:44:26,686][123090] Updated weights for policy 1, policy_version 268856 (0.0008) [2023-12-26 01:44:27,148][123091] Updated weights for policy 0, policy_version 270257 (0.0011) [2023-12-26 01:44:27,210][123091] Updated weights for policy 0, policy_version 270267 (0.0010) [2023-12-26 01:44:27,256][123091] Updated weights for policy 0, policy_version 270277 (0.0010) [2023-12-26 01:44:27,311][123091] Updated weights for policy 0, policy_version 270287 (0.0010) [2023-12-26 01:44:27,480][123090] Updated weights for policy 1, policy_version 268866 (0.0006) [2023-12-26 01:44:27,542][123090] Updated weights for policy 1, policy_version 268876 (0.0009) [2023-12-26 01:44:27,598][123090] Updated weights for policy 1, policy_version 268886 (0.0008) [2023-12-26 01:44:27,660][123090] Updated weights for policy 1, policy_version 268896 (0.0009) [2023-12-26 01:44:28,072][123091] Updated weights for policy 0, policy_version 270297 (0.0006) [2023-12-26 01:44:28,120][123091] Updated weights for policy 0, policy_version 270307 (0.0005) [2023-12-26 01:44:28,171][123091] Updated weights for policy 0, policy_version 270317 (0.0005) [2023-12-26 01:44:28,555][123090] Updated weights for policy 1, policy_version 268906 (0.0009) [2023-12-26 01:44:28,606][123090] Updated weights for policy 1, policy_version 268916 (0.0008) [2023-12-26 01:44:28,662][123090] Updated weights for policy 1, policy_version 268926 (0.0009) [2023-12-26 01:44:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 138051584. Throughput: 0: 8838.5, 1: 8960.4. Samples: 138043504. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:28,785][121949] Avg episode reward: [(0, '5761.355'), (1, '5247.431')] [2023-12-26 01:44:28,916][123091] Updated weights for policy 0, policy_version 270327 (0.0009) [2023-12-26 01:44:28,964][123091] Updated weights for policy 0, policy_version 270337 (0.0010) [2023-12-26 01:44:29,011][123091] Updated weights for policy 0, policy_version 270347 (0.0010) [2023-12-26 01:44:29,518][123090] Updated weights for policy 1, policy_version 268936 (0.0009) [2023-12-26 01:44:29,582][123090] Updated weights for policy 1, policy_version 268946 (0.0009) [2023-12-26 01:44:29,642][123090] Updated weights for policy 1, policy_version 268956 (0.0009) [2023-12-26 01:44:29,863][123091] Updated weights for policy 0, policy_version 270357 (0.0009) [2023-12-26 01:44:29,928][123091] Updated weights for policy 0, policy_version 270367 (0.0008) [2023-12-26 01:44:29,996][123091] Updated weights for policy 0, policy_version 270377 (0.0008) [2023-12-26 01:44:30,476][123090] Updated weights for policy 1, policy_version 268966 (0.0010) [2023-12-26 01:44:30,544][123090] Updated weights for policy 1, policy_version 268976 (0.0009) [2023-12-26 01:44:30,612][123090] Updated weights for policy 1, policy_version 268986 (0.0008) [2023-12-26 01:44:30,747][123091] Updated weights for policy 0, policy_version 270387 (0.0009) [2023-12-26 01:44:30,804][123091] Updated weights for policy 0, policy_version 270397 (0.0007) [2023-12-26 01:44:30,854][123091] Updated weights for policy 0, policy_version 270407 (0.0010) [2023-12-26 01:44:31,468][123090] Updated weights for policy 1, policy_version 268996 (0.0009) [2023-12-26 01:44:31,526][123090] Updated weights for policy 1, policy_version 269006 (0.0010) [2023-12-26 01:44:31,599][123090] Updated weights for policy 1, policy_version 269016 (0.0010) [2023-12-26 01:44:31,648][123091] Updated weights for policy 0, policy_version 270417 (0.0010) [2023-12-26 01:44:31,700][123091] Updated weights for policy 0, policy_version 270427 (0.0008) [2023-12-26 01:44:31,766][123091] Updated weights for policy 0, policy_version 270437 (0.0008) [2023-12-26 01:44:31,831][123091] Updated weights for policy 0, policy_version 270447 (0.0008) [2023-12-26 01:44:32,492][123090] Updated weights for policy 1, policy_version 269026 (0.0009) [2023-12-26 01:44:32,544][123090] Updated weights for policy 1, policy_version 269036 (0.0008) [2023-12-26 01:44:32,578][123091] Updated weights for policy 0, policy_version 270457 (0.0008) [2023-12-26 01:44:32,599][123090] Updated weights for policy 1, policy_version 269046 (0.0009) [2023-12-26 01:44:32,636][123091] Updated weights for policy 0, policy_version 270467 (0.0005) [2023-12-26 01:44:32,648][123090] Updated weights for policy 1, policy_version 269056 (0.0009) [2023-12-26 01:44:32,705][123091] Updated weights for policy 0, policy_version 270477 (0.0006) [2023-12-26 01:44:33,441][123091] Updated weights for policy 0, policy_version 270487 (0.0008) [2023-12-26 01:44:33,501][123091] Updated weights for policy 0, policy_version 270497 (0.0005) [2023-12-26 01:44:33,543][123090] Updated weights for policy 1, policy_version 269066 (0.0008) [2023-12-26 01:44:33,553][123091] Updated weights for policy 0, policy_version 270507 (0.0006) [2023-12-26 01:44:33,594][123090] Updated weights for policy 1, policy_version 269076 (0.0010) [2023-12-26 01:44:33,637][123090] Updated weights for policy 1, policy_version 269086 (0.0010) [2023-12-26 01:44:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 138141696. Throughput: 0: 8906.9, 1: 8754.3. Samples: 138148956. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:33,785][121949] Avg episode reward: [(0, '5788.336'), (1, '5335.185')] [2023-12-26 01:44:34,324][123090] Updated weights for policy 1, policy_version 269096 (0.0010) [2023-12-26 01:44:34,395][123090] Updated weights for policy 1, policy_version 269106 (0.0011) [2023-12-26 01:44:34,428][123091] Updated weights for policy 0, policy_version 270517 (0.0008) [2023-12-26 01:44:34,461][123090] Updated weights for policy 1, policy_version 269116 (0.0010) [2023-12-26 01:44:34,489][123091] Updated weights for policy 0, policy_version 270527 (0.0009) [2023-12-26 01:44:34,556][123091] Updated weights for policy 0, policy_version 270537 (0.0010) [2023-12-26 01:44:35,196][123090] Updated weights for policy 1, policy_version 269126 (0.0006) [2023-12-26 01:44:35,265][123090] Updated weights for policy 1, policy_version 269136 (0.0005) [2023-12-26 01:44:35,312][123090] Updated weights for policy 1, policy_version 269146 (0.0005) [2023-12-26 01:44:35,448][123091] Updated weights for policy 0, policy_version 270547 (0.0009) [2023-12-26 01:44:35,505][123091] Updated weights for policy 0, policy_version 270557 (0.0010) [2023-12-26 01:44:35,573][123091] Updated weights for policy 0, policy_version 270567 (0.0008) [2023-12-26 01:44:36,078][123090] Updated weights for policy 1, policy_version 269156 (0.0007) [2023-12-26 01:44:36,142][123090] Updated weights for policy 1, policy_version 269166 (0.0009) [2023-12-26 01:44:36,202][123090] Updated weights for policy 1, policy_version 269176 (0.0010) [2023-12-26 01:44:36,399][123091] Updated weights for policy 0, policy_version 270577 (0.0009) [2023-12-26 01:44:36,467][123091] Updated weights for policy 0, policy_version 270588 (0.0009) [2023-12-26 01:44:36,528][123091] Updated weights for policy 0, policy_version 270598 (0.0009) [2023-12-26 01:44:36,593][123091] Updated weights for policy 0, policy_version 270608 (0.0009) [2023-12-26 01:44:37,040][123090] Updated weights for policy 1, policy_version 269186 (0.0008) [2023-12-26 01:44:37,092][123090] Updated weights for policy 1, policy_version 269196 (0.0005) [2023-12-26 01:44:37,143][123090] Updated weights for policy 1, policy_version 269206 (0.0005) [2023-12-26 01:44:37,201][123090] Updated weights for policy 1, policy_version 269216 (0.0009) [2023-12-26 01:44:37,446][123091] Updated weights for policy 0, policy_version 270618 (0.0010) [2023-12-26 01:44:37,511][123091] Updated weights for policy 0, policy_version 270628 (0.0009) [2023-12-26 01:44:37,573][123091] Updated weights for policy 0, policy_version 270638 (0.0009) [2023-12-26 01:44:37,964][123090] Updated weights for policy 1, policy_version 269226 (0.0009) [2023-12-26 01:44:38,022][123090] Updated weights for policy 1, policy_version 269236 (0.0009) [2023-12-26 01:44:38,087][123090] Updated weights for policy 1, policy_version 269246 (0.0009) [2023-12-26 01:44:38,456][123091] Updated weights for policy 0, policy_version 270648 (0.0009) [2023-12-26 01:44:38,524][123091] Updated weights for policy 0, policy_version 270658 (0.0010) [2023-12-26 01:44:38,595][123091] Updated weights for policy 0, policy_version 270668 (0.0009) [2023-12-26 01:44:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 138223616. Throughput: 0: 8875.9, 1: 8770.1. Samples: 138201332. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:38,785][121949] Avg episode reward: [(0, '5835.683'), (1, '5411.114')] [2023-12-26 01:44:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000270672_69296128.pth... [2023-12-26 01:44:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000269248_68927488.pth... [2023-12-26 01:44:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000269648_69033984.pth [2023-12-26 01:44:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000268224_68665344.pth [2023-12-26 01:44:38,917][123090] Updated weights for policy 1, policy_version 269256 (0.0009) [2023-12-26 01:44:38,985][123090] Updated weights for policy 1, policy_version 269266 (0.0005) [2023-12-26 01:44:39,055][123090] Updated weights for policy 1, policy_version 269276 (0.0005) [2023-12-26 01:44:39,478][123091] Updated weights for policy 0, policy_version 270678 (0.0009) [2023-12-26 01:44:39,535][123091] Updated weights for policy 0, policy_version 270688 (0.0010) [2023-12-26 01:44:39,605][123091] Updated weights for policy 0, policy_version 270698 (0.0009) [2023-12-26 01:44:39,750][123090] Updated weights for policy 1, policy_version 269286 (0.0009) [2023-12-26 01:44:39,814][123090] Updated weights for policy 1, policy_version 269296 (0.0011) [2023-12-26 01:44:39,889][123090] Updated weights for policy 1, policy_version 269306 (0.0008) [2023-12-26 01:44:40,494][123091] Updated weights for policy 0, policy_version 270708 (0.0010) [2023-12-26 01:44:40,561][123091] Updated weights for policy 0, policy_version 270718 (0.0008) [2023-12-26 01:44:40,630][123091] Updated weights for policy 0, policy_version 270728 (0.0010) [2023-12-26 01:44:40,680][123090] Updated weights for policy 1, policy_version 269316 (0.0007) [2023-12-26 01:44:40,741][123090] Updated weights for policy 1, policy_version 269326 (0.0007) [2023-12-26 01:44:40,795][123090] Updated weights for policy 1, policy_version 269336 (0.0010) [2023-12-26 01:44:41,483][123091] Updated weights for policy 0, policy_version 270738 (0.0009) [2023-12-26 01:44:41,543][123091] Updated weights for policy 0, policy_version 270748 (0.0007) [2023-12-26 01:44:41,597][123091] Updated weights for policy 0, policy_version 270758 (0.0009) [2023-12-26 01:44:41,602][123090] Updated weights for policy 1, policy_version 269346 (0.0010) [2023-12-26 01:44:41,665][123091] Updated weights for policy 0, policy_version 270768 (0.0008) [2023-12-26 01:44:41,667][123090] Updated weights for policy 1, policy_version 269356 (0.0009) [2023-12-26 01:44:41,740][123090] Updated weights for policy 1, policy_version 269366 (0.0009) [2023-12-26 01:44:41,815][123090] Updated weights for policy 1, policy_version 269376 (0.0010) [2023-12-26 01:44:42,365][123091] Updated weights for policy 0, policy_version 270778 (0.0009) [2023-12-26 01:44:42,430][123091] Updated weights for policy 0, policy_version 270788 (0.0006) [2023-12-26 01:44:42,491][123091] Updated weights for policy 0, policy_version 270798 (0.0005) [2023-12-26 01:44:42,701][123090] Updated weights for policy 1, policy_version 269386 (0.0010) [2023-12-26 01:44:42,767][123090] Updated weights for policy 1, policy_version 269396 (0.0010) [2023-12-26 01:44:42,840][123090] Updated weights for policy 1, policy_version 269406 (0.0010) [2023-12-26 01:44:43,273][123091] Updated weights for policy 0, policy_version 270808 (0.0009) [2023-12-26 01:44:43,331][123091] Updated weights for policy 0, policy_version 270818 (0.0009) [2023-12-26 01:44:43,387][123091] Updated weights for policy 0, policy_version 270828 (0.0009) [2023-12-26 01:44:43,616][123090] Updated weights for policy 1, policy_version 269416 (0.0009) [2023-12-26 01:44:43,672][123090] Updated weights for policy 1, policy_version 269426 (0.0009) [2023-12-26 01:44:43,723][123090] Updated weights for policy 1, policy_version 269436 (0.0009) [2023-12-26 01:44:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 138313728. Throughput: 0: 8832.7, 1: 8745.0. Samples: 138304036. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:43,785][121949] Avg episode reward: [(0, '5871.674'), (1, '5429.250')] [2023-12-26 01:44:44,220][123091] Updated weights for policy 0, policy_version 270838 (0.0009) [2023-12-26 01:44:44,272][123091] Updated weights for policy 0, policy_version 270848 (0.0009) [2023-12-26 01:44:44,325][123091] Updated weights for policy 0, policy_version 270858 (0.0011) [2023-12-26 01:44:44,561][123090] Updated weights for policy 1, policy_version 269446 (0.0009) [2023-12-26 01:44:44,616][123090] Updated weights for policy 1, policy_version 269456 (0.0008) [2023-12-26 01:44:44,673][123090] Updated weights for policy 1, policy_version 269466 (0.0009) [2023-12-26 01:44:45,203][123091] Updated weights for policy 0, policy_version 270868 (0.0009) [2023-12-26 01:44:45,263][123091] Updated weights for policy 0, policy_version 270878 (0.0010) [2023-12-26 01:44:45,325][123091] Updated weights for policy 0, policy_version 270888 (0.0009) [2023-12-26 01:44:45,483][123090] Updated weights for policy 1, policy_version 269476 (0.0007) [2023-12-26 01:44:45,549][123090] Updated weights for policy 1, policy_version 269486 (0.0005) [2023-12-26 01:44:45,622][123090] Updated weights for policy 1, policy_version 269496 (0.0006) [2023-12-26 01:44:46,176][123091] Updated weights for policy 0, policy_version 270898 (0.0010) [2023-12-26 01:44:46,231][123091] Updated weights for policy 0, policy_version 270908 (0.0010) [2023-12-26 01:44:46,286][123091] Updated weights for policy 0, policy_version 270918 (0.0008) [2023-12-26 01:44:46,349][123091] Updated weights for policy 0, policy_version 270928 (0.0009) [2023-12-26 01:44:46,378][123090] Updated weights for policy 1, policy_version 269506 (0.0010) [2023-12-26 01:44:46,434][123090] Updated weights for policy 1, policy_version 269517 (0.0009) [2023-12-26 01:44:46,503][123090] Updated weights for policy 1, policy_version 269527 (0.0008) [2023-12-26 01:44:47,181][123091] Updated weights for policy 0, policy_version 270938 (0.0005) [2023-12-26 01:44:47,230][123091] Updated weights for policy 0, policy_version 270948 (0.0005) [2023-12-26 01:44:47,241][123090] Updated weights for policy 1, policy_version 269537 (0.0008) [2023-12-26 01:44:47,279][123091] Updated weights for policy 0, policy_version 270958 (0.0006) [2023-12-26 01:44:47,295][123090] Updated weights for policy 1, policy_version 269547 (0.0010) [2023-12-26 01:44:47,349][123090] Updated weights for policy 1, policy_version 269557 (0.0010) [2023-12-26 01:44:47,403][123090] Updated weights for policy 1, policy_version 269567 (0.0006) [2023-12-26 01:44:47,969][123091] Updated weights for policy 0, policy_version 270968 (0.0006) [2023-12-26 01:44:48,044][123091] Updated weights for policy 0, policy_version 270978 (0.0006) [2023-12-26 01:44:48,103][123091] Updated weights for policy 0, policy_version 270988 (0.0006) [2023-12-26 01:44:48,115][123090] Updated weights for policy 1, policy_version 269577 (0.0005) [2023-12-26 01:44:48,166][123090] Updated weights for policy 1, policy_version 269587 (0.0005) [2023-12-26 01:44:48,215][123090] Updated weights for policy 1, policy_version 269597 (0.0005) [2023-12-26 01:44:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 138395648. Throughput: 0: 8799.9, 1: 8805.2. Samples: 138411836. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:48,785][121949] Avg episode reward: [(0, '6174.181'), (1, '5262.259')] [2023-12-26 01:44:48,816][123091] Updated weights for policy 0, policy_version 270998 (0.0011) [2023-12-26 01:44:48,886][123091] Updated weights for policy 0, policy_version 271008 (0.0011) [2023-12-26 01:44:48,932][123090] Updated weights for policy 1, policy_version 269607 (0.0005) [2023-12-26 01:44:48,945][123091] Updated weights for policy 0, policy_version 271018 (0.0011) [2023-12-26 01:44:48,982][123090] Updated weights for policy 1, policy_version 269617 (0.0005) [2023-12-26 01:44:49,034][123090] Updated weights for policy 1, policy_version 269627 (0.0005) [2023-12-26 01:44:49,610][123091] Updated weights for policy 0, policy_version 271028 (0.0008) [2023-12-26 01:44:49,674][123091] Updated weights for policy 0, policy_version 271038 (0.0006) [2023-12-26 01:44:49,739][123091] Updated weights for policy 0, policy_version 271048 (0.0007) [2023-12-26 01:44:49,771][123090] Updated weights for policy 1, policy_version 269637 (0.0008) [2023-12-26 01:44:49,840][123090] Updated weights for policy 1, policy_version 269647 (0.0011) [2023-12-26 01:44:49,909][123090] Updated weights for policy 1, policy_version 269657 (0.0010) [2023-12-26 01:44:50,492][123091] Updated weights for policy 0, policy_version 271058 (0.0010) [2023-12-26 01:44:50,545][123091] Updated weights for policy 0, policy_version 271068 (0.0005) [2023-12-26 01:44:50,601][123090] Updated weights for policy 1, policy_version 269667 (0.0010) [2023-12-26 01:44:50,605][123091] Updated weights for policy 0, policy_version 271078 (0.0008) [2023-12-26 01:44:50,655][123091] Updated weights for policy 0, policy_version 271088 (0.0006) [2023-12-26 01:44:50,669][123090] Updated weights for policy 1, policy_version 269677 (0.0011) [2023-12-26 01:44:50,733][123090] Updated weights for policy 1, policy_version 269687 (0.0010) [2023-12-26 01:44:51,445][123091] Updated weights for policy 0, policy_version 271098 (0.0010) [2023-12-26 01:44:51,497][123091] Updated weights for policy 0, policy_version 271108 (0.0010) [2023-12-26 01:44:51,553][123091] Updated weights for policy 0, policy_version 271118 (0.0010) [2023-12-26 01:44:51,573][123090] Updated weights for policy 1, policy_version 269697 (0.0011) [2023-12-26 01:44:51,629][123090] Updated weights for policy 1, policy_version 269707 (0.0008) [2023-12-26 01:44:51,704][123090] Updated weights for policy 1, policy_version 269717 (0.0008) [2023-12-26 01:44:51,779][123090] Updated weights for policy 1, policy_version 269727 (0.0010) [2023-12-26 01:44:52,418][123091] Updated weights for policy 0, policy_version 271128 (0.0011) [2023-12-26 01:44:52,476][123091] Updated weights for policy 0, policy_version 271138 (0.0010) [2023-12-26 01:44:52,539][123091] Updated weights for policy 0, policy_version 271148 (0.0008) [2023-12-26 01:44:52,605][123090] Updated weights for policy 1, policy_version 269737 (0.0006) [2023-12-26 01:44:52,677][123090] Updated weights for policy 1, policy_version 269747 (0.0005) [2023-12-26 01:44:52,755][123090] Updated weights for policy 1, policy_version 269757 (0.0005) [2023-12-26 01:44:53,275][123091] Updated weights for policy 0, policy_version 271158 (0.0006) [2023-12-26 01:44:53,319][123091] Updated weights for policy 0, policy_version 271168 (0.0005) [2023-12-26 01:44:53,372][123091] Updated weights for policy 0, policy_version 271178 (0.0006) [2023-12-26 01:44:53,472][123090] Updated weights for policy 1, policy_version 269767 (0.0009) [2023-12-26 01:44:53,520][123090] Updated weights for policy 1, policy_version 269777 (0.0010) [2023-12-26 01:44:53,587][123090] Updated weights for policy 1, policy_version 269787 (0.0010) [2023-12-26 01:44:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 138493952. Throughput: 0: 8775.6, 1: 8844.5. Samples: 138467084. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:53,785][121949] Avg episode reward: [(0, '6036.723'), (1, '5397.862')] [2023-12-26 01:44:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000271184_69427200.pth... [2023-12-26 01:44:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000269792_69066752.pth... [2023-12-26 01:44:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000270160_69165056.pth [2023-12-26 01:44:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000268768_68804608.pth [2023-12-26 01:44:54,012][123091] Updated weights for policy 0, policy_version 271188 (0.0005) [2023-12-26 01:44:54,061][123091] Updated weights for policy 0, policy_version 271198 (0.0006) [2023-12-26 01:44:54,108][123091] Updated weights for policy 0, policy_version 271208 (0.0010) [2023-12-26 01:44:54,374][123090] Updated weights for policy 1, policy_version 269797 (0.0009) [2023-12-26 01:44:54,430][123090] Updated weights for policy 1, policy_version 269807 (0.0010) [2023-12-26 01:44:54,492][123090] Updated weights for policy 1, policy_version 269817 (0.0010) [2023-12-26 01:44:54,913][123091] Updated weights for policy 0, policy_version 271218 (0.0010) [2023-12-26 01:44:54,990][123091] Updated weights for policy 0, policy_version 271228 (0.0010) [2023-12-26 01:44:55,048][123091] Updated weights for policy 0, policy_version 271238 (0.0007) [2023-12-26 01:44:55,096][123091] Updated weights for policy 0, policy_version 271248 (0.0005) [2023-12-26 01:44:55,193][123090] Updated weights for policy 1, policy_version 269827 (0.0006) [2023-12-26 01:44:55,263][123090] Updated weights for policy 1, policy_version 269837 (0.0005) [2023-12-26 01:44:55,325][123090] Updated weights for policy 1, policy_version 269847 (0.0005) [2023-12-26 01:44:55,784][123091] Updated weights for policy 0, policy_version 271258 (0.0005) [2023-12-26 01:44:55,838][123091] Updated weights for policy 0, policy_version 271268 (0.0005) [2023-12-26 01:44:55,886][123091] Updated weights for policy 0, policy_version 271278 (0.0010) [2023-12-26 01:44:55,987][123090] Updated weights for policy 1, policy_version 269857 (0.0006) [2023-12-26 01:44:56,051][123090] Updated weights for policy 1, policy_version 269867 (0.0009) [2023-12-26 01:44:56,119][123090] Updated weights for policy 1, policy_version 269877 (0.0006) [2023-12-26 01:44:56,188][123090] Updated weights for policy 1, policy_version 269887 (0.0005) [2023-12-26 01:44:56,685][123091] Updated weights for policy 0, policy_version 271288 (0.0010) [2023-12-26 01:44:56,747][123091] Updated weights for policy 0, policy_version 271298 (0.0011) [2023-12-26 01:44:56,798][123090] Updated weights for policy 1, policy_version 269897 (0.0005) [2023-12-26 01:44:56,817][123091] Updated weights for policy 0, policy_version 271308 (0.0010) [2023-12-26 01:44:56,848][123090] Updated weights for policy 1, policy_version 269907 (0.0005) [2023-12-26 01:44:56,909][123090] Updated weights for policy 1, policy_version 269917 (0.0005) [2023-12-26 01:44:57,605][123091] Updated weights for policy 0, policy_version 271318 (0.0010) [2023-12-26 01:44:57,621][123090] Updated weights for policy 1, policy_version 269927 (0.0005) [2023-12-26 01:44:57,675][123091] Updated weights for policy 0, policy_version 271328 (0.0011) [2023-12-26 01:44:57,691][123090] Updated weights for policy 1, policy_version 269937 (0.0005) [2023-12-26 01:44:57,726][123091] Updated weights for policy 0, policy_version 271338 (0.0010) [2023-12-26 01:44:57,765][123090] Updated weights for policy 1, policy_version 269947 (0.0006) [2023-12-26 01:44:58,509][123091] Updated weights for policy 0, policy_version 271348 (0.0010) [2023-12-26 01:44:58,580][123091] Updated weights for policy 0, policy_version 271358 (0.0007) [2023-12-26 01:44:58,580][123090] Updated weights for policy 1, policy_version 269957 (0.0008) [2023-12-26 01:44:58,650][123091] Updated weights for policy 0, policy_version 271368 (0.0010) [2023-12-26 01:44:58,652][123090] Updated weights for policy 1, policy_version 269967 (0.0011) [2023-12-26 01:44:58,734][123090] Updated weights for policy 1, policy_version 269978 (0.0007) [2023-12-26 01:44:58,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 138592256. Throughput: 0: 8878.3, 1: 8941.0. Samples: 138580704. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:44:58,785][121949] Avg episode reward: [(0, '6033.861'), (1, '5402.876')] [2023-12-26 01:44:59,369][123091] Updated weights for policy 0, policy_version 271378 (0.0009) [2023-12-26 01:44:59,437][123091] Updated weights for policy 0, policy_version 271388 (0.0005) [2023-12-26 01:44:59,478][123090] Updated weights for policy 1, policy_version 269988 (0.0008) [2023-12-26 01:44:59,498][123091] Updated weights for policy 0, policy_version 271398 (0.0008) [2023-12-26 01:44:59,543][123090] Updated weights for policy 1, policy_version 269998 (0.0008) [2023-12-26 01:44:59,560][123091] Updated weights for policy 0, policy_version 271408 (0.0008) [2023-12-26 01:44:59,598][123090] Updated weights for policy 1, policy_version 270008 (0.0005) [2023-12-26 01:45:00,249][123090] Updated weights for policy 1, policy_version 270018 (0.0006) [2023-12-26 01:45:00,316][123090] Updated weights for policy 1, policy_version 270028 (0.0008) [2023-12-26 01:45:00,360][123091] Updated weights for policy 0, policy_version 271418 (0.0008) [2023-12-26 01:45:00,377][123090] Updated weights for policy 1, policy_version 270038 (0.0009) [2023-12-26 01:45:00,425][123091] Updated weights for policy 0, policy_version 271428 (0.0008) [2023-12-26 01:45:00,449][123090] Updated weights for policy 1, policy_version 270048 (0.0009) [2023-12-26 01:45:00,491][123091] Updated weights for policy 0, policy_version 271438 (0.0008) [2023-12-26 01:45:01,130][123090] Updated weights for policy 1, policy_version 270058 (0.0008) [2023-12-26 01:45:01,132][123091] Updated weights for policy 0, policy_version 271448 (0.0008) [2023-12-26 01:45:01,196][123091] Updated weights for policy 0, policy_version 271458 (0.0008) [2023-12-26 01:45:01,199][123090] Updated weights for policy 1, policy_version 270068 (0.0008) [2023-12-26 01:45:01,255][123090] Updated weights for policy 1, policy_version 270079 (0.0009) [2023-12-26 01:45:01,257][123091] Updated weights for policy 0, policy_version 271468 (0.0008) [2023-12-26 01:45:02,030][123091] Updated weights for policy 0, policy_version 271478 (0.0009) [2023-12-26 01:45:02,086][123091] Updated weights for policy 0, policy_version 271488 (0.0009) [2023-12-26 01:45:02,144][123091] Updated weights for policy 0, policy_version 271498 (0.0009) [2023-12-26 01:45:02,156][123090] Updated weights for policy 1, policy_version 270089 (0.0007) [2023-12-26 01:45:02,209][123090] Updated weights for policy 1, policy_version 270099 (0.0008) [2023-12-26 01:45:02,272][123090] Updated weights for policy 1, policy_version 270109 (0.0008) [2023-12-26 01:45:02,879][123091] Updated weights for policy 0, policy_version 271508 (0.0008) [2023-12-26 01:45:02,926][123091] Updated weights for policy 0, policy_version 271518 (0.0008) [2023-12-26 01:45:02,974][123091] Updated weights for policy 0, policy_version 271528 (0.0010) [2023-12-26 01:45:03,121][123090] Updated weights for policy 1, policy_version 270119 (0.0009) [2023-12-26 01:45:03,168][123090] Updated weights for policy 1, policy_version 270129 (0.0009) [2023-12-26 01:45:03,226][123090] Updated weights for policy 1, policy_version 270139 (0.0009) [2023-12-26 01:45:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 138674176. Throughput: 0: 8939.6, 1: 8944.3. Samples: 138689164. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:45:03,785][121949] Avg episode reward: [(0, '5882.089'), (1, '5181.310')] [2023-12-26 01:45:03,810][123091] Updated weights for policy 0, policy_version 271538 (0.0010) [2023-12-26 01:45:03,871][123091] Updated weights for policy 0, policy_version 271548 (0.0008) [2023-12-26 01:45:03,947][123091] Updated weights for policy 0, policy_version 271558 (0.0006) [2023-12-26 01:45:04,011][123091] Updated weights for policy 0, policy_version 271568 (0.0006) [2023-12-26 01:45:04,046][123090] Updated weights for policy 1, policy_version 270149 (0.0010) [2023-12-26 01:45:04,098][123090] Updated weights for policy 1, policy_version 270159 (0.0010) [2023-12-26 01:45:04,160][123090] Updated weights for policy 1, policy_version 270169 (0.0005) [2023-12-26 01:45:04,699][123091] Updated weights for policy 0, policy_version 271578 (0.0008) [2023-12-26 01:45:04,757][123091] Updated weights for policy 0, policy_version 271588 (0.0007) [2023-12-26 01:45:04,807][123091] Updated weights for policy 0, policy_version 271598 (0.0006) [2023-12-26 01:45:04,861][123090] Updated weights for policy 1, policy_version 270179 (0.0007) [2023-12-26 01:45:04,909][123090] Updated weights for policy 1, policy_version 270189 (0.0010) [2023-12-26 01:45:04,972][123090] Updated weights for policy 1, policy_version 270199 (0.0011) [2023-12-26 01:45:05,442][123091] Updated weights for policy 0, policy_version 271608 (0.0006) [2023-12-26 01:45:05,504][123091] Updated weights for policy 0, policy_version 271618 (0.0005) [2023-12-26 01:45:05,568][123091] Updated weights for policy 0, policy_version 271628 (0.0005) [2023-12-26 01:45:05,753][123090] Updated weights for policy 1, policy_version 270209 (0.0010) [2023-12-26 01:45:05,809][123090] Updated weights for policy 1, policy_version 270219 (0.0006) [2023-12-26 01:45:05,866][123090] Updated weights for policy 1, policy_version 270229 (0.0006) [2023-12-26 01:45:05,918][123090] Updated weights for policy 1, policy_version 270239 (0.0007) [2023-12-26 01:45:06,285][123091] Updated weights for policy 0, policy_version 271638 (0.0006) [2023-12-26 01:45:06,357][123091] Updated weights for policy 0, policy_version 271648 (0.0006) [2023-12-26 01:45:06,428][123091] Updated weights for policy 0, policy_version 271658 (0.0009) [2023-12-26 01:45:06,775][123090] Updated weights for policy 1, policy_version 270249 (0.0009) [2023-12-26 01:45:06,845][123090] Updated weights for policy 1, policy_version 270259 (0.0009) [2023-12-26 01:45:06,919][123090] Updated weights for policy 1, policy_version 270269 (0.0009) [2023-12-26 01:45:07,216][123091] Updated weights for policy 0, policy_version 271668 (0.0011) [2023-12-26 01:45:07,283][123091] Updated weights for policy 0, policy_version 271678 (0.0011) [2023-12-26 01:45:07,338][123091] Updated weights for policy 0, policy_version 271688 (0.0010) [2023-12-26 01:45:07,746][123090] Updated weights for policy 1, policy_version 270279 (0.0009) [2023-12-26 01:45:07,802][123090] Updated weights for policy 1, policy_version 270289 (0.0009) [2023-12-26 01:45:07,858][123090] Updated weights for policy 1, policy_version 270299 (0.0009) [2023-12-26 01:45:08,159][123091] Updated weights for policy 0, policy_version 271698 (0.0011) [2023-12-26 01:45:08,226][123091] Updated weights for policy 0, policy_version 271708 (0.0010) [2023-12-26 01:45:08,287][123091] Updated weights for policy 0, policy_version 271718 (0.0010) [2023-12-26 01:45:08,354][123091] Updated weights for policy 0, policy_version 271728 (0.0011) [2023-12-26 01:45:08,725][123090] Updated weights for policy 1, policy_version 270309 (0.0008) [2023-12-26 01:45:08,784][123090] Updated weights for policy 1, policy_version 270319 (0.0006) [2023-12-26 01:45:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 138764288. Throughput: 0: 9014.7, 1: 9003.7. Samples: 138746004. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:45:08,785][121949] Avg episode reward: [(0, '5828.429'), (1, '5240.977')] [2023-12-26 01:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000271728_69566464.pth... [2023-12-26 01:45:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000270672_69296128.pth [2023-12-26 01:45:08,844][123090] Updated weights for policy 1, policy_version 270329 (0.0006) [2023-12-26 01:45:08,878][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000270336_69206016.pth... [2023-12-26 01:45:08,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000269248_68927488.pth [2023-12-26 01:45:09,110][123091] Updated weights for policy 0, policy_version 271738 (0.0007) [2023-12-26 01:45:09,166][123091] Updated weights for policy 0, policy_version 271748 (0.0009) [2023-12-26 01:45:09,227][123091] Updated weights for policy 0, policy_version 271758 (0.0009) [2023-12-26 01:45:09,704][123090] Updated weights for policy 1, policy_version 270339 (0.0007) [2023-12-26 01:45:09,764][123090] Updated weights for policy 1, policy_version 270349 (0.0009) [2023-12-26 01:45:09,830][123090] Updated weights for policy 1, policy_version 270359 (0.0009) [2023-12-26 01:45:09,986][123091] Updated weights for policy 0, policy_version 271768 (0.0008) [2023-12-26 01:45:10,042][123091] Updated weights for policy 0, policy_version 271778 (0.0008) [2023-12-26 01:45:10,098][123091] Updated weights for policy 0, policy_version 271788 (0.0008) [2023-12-26 01:45:10,639][123090] Updated weights for policy 1, policy_version 270369 (0.0006) [2023-12-26 01:45:10,693][123090] Updated weights for policy 1, policy_version 270379 (0.0005) [2023-12-26 01:45:10,750][123090] Updated weights for policy 1, policy_version 270389 (0.0007) [2023-12-26 01:45:10,806][123090] Updated weights for policy 1, policy_version 270399 (0.0009) [2023-12-26 01:45:10,911][123091] Updated weights for policy 0, policy_version 271798 (0.0009) [2023-12-26 01:45:10,958][123091] Updated weights for policy 0, policy_version 271808 (0.0008) [2023-12-26 01:45:11,019][123091] Updated weights for policy 0, policy_version 271818 (0.0009) [2023-12-26 01:45:11,698][123090] Updated weights for policy 1, policy_version 270409 (0.0008) [2023-12-26 01:45:11,765][123090] Updated weights for policy 1, policy_version 270419 (0.0009) [2023-12-26 01:45:11,827][123090] Updated weights for policy 1, policy_version 270429 (0.0009) [2023-12-26 01:45:11,853][123091] Updated weights for policy 0, policy_version 271828 (0.0007) [2023-12-26 01:45:11,913][123091] Updated weights for policy 0, policy_version 271838 (0.0007) [2023-12-26 01:45:11,981][123091] Updated weights for policy 0, policy_version 271848 (0.0006) [2023-12-26 01:45:12,674][123090] Updated weights for policy 1, policy_version 270439 (0.0009) [2023-12-26 01:45:12,732][123090] Updated weights for policy 1, policy_version 270449 (0.0010) [2023-12-26 01:45:12,750][123091] Updated weights for policy 0, policy_version 271858 (0.0009) [2023-12-26 01:45:12,792][123090] Updated weights for policy 1, policy_version 270459 (0.0007) [2023-12-26 01:45:12,812][123091] Updated weights for policy 0, policy_version 271868 (0.0009) [2023-12-26 01:45:12,871][123091] Updated weights for policy 0, policy_version 271879 (0.0009) [2023-12-26 01:45:13,629][123091] Updated weights for policy 0, policy_version 271889 (0.0011) [2023-12-26 01:45:13,691][123091] Updated weights for policy 0, policy_version 271899 (0.0009) [2023-12-26 01:45:13,699][123090] Updated weights for policy 1, policy_version 270469 (0.0007) [2023-12-26 01:45:13,751][123091] Updated weights for policy 0, policy_version 271909 (0.0008) [2023-12-26 01:45:13,762][123090] Updated weights for policy 1, policy_version 270479 (0.0008) [2023-12-26 01:45:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 138846208. Throughput: 0: 8998.7, 1: 8896.8. Samples: 138848804. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:45:13,785][121949] Avg episode reward: [(0, '6014.091'), (1, '5358.641')] [2023-12-26 01:45:13,808][123091] Updated weights for policy 0, policy_version 271919 (0.0008) [2023-12-26 01:45:13,822][123090] Updated weights for policy 1, policy_version 270489 (0.0008) [2023-12-26 01:45:14,435][123091] Updated weights for policy 0, policy_version 271929 (0.0005) [2023-12-26 01:45:14,489][123091] Updated weights for policy 0, policy_version 271939 (0.0005) [2023-12-26 01:45:14,534][123091] Updated weights for policy 0, policy_version 271949 (0.0005) [2023-12-26 01:45:14,713][123090] Updated weights for policy 1, policy_version 270499 (0.0009) [2023-12-26 01:45:14,777][123090] Updated weights for policy 1, policy_version 270509 (0.0009) [2023-12-26 01:45:14,842][123090] Updated weights for policy 1, policy_version 270519 (0.0009) [2023-12-26 01:45:15,326][123091] Updated weights for policy 0, policy_version 271959 (0.0009) [2023-12-26 01:45:15,385][123091] Updated weights for policy 0, policy_version 271969 (0.0009) [2023-12-26 01:45:15,446][123091] Updated weights for policy 0, policy_version 271979 (0.0010) [2023-12-26 01:45:15,676][123090] Updated weights for policy 1, policy_version 270529 (0.0009) [2023-12-26 01:45:15,750][123090] Updated weights for policy 1, policy_version 270539 (0.0005) [2023-12-26 01:45:15,828][123090] Updated weights for policy 1, policy_version 270549 (0.0005) [2023-12-26 01:45:15,901][123090] Updated weights for policy 1, policy_version 270559 (0.0006) [2023-12-26 01:45:16,321][123091] Updated weights for policy 0, policy_version 271989 (0.0009) [2023-12-26 01:45:16,372][123091] Updated weights for policy 0, policy_version 271999 (0.0008) [2023-12-26 01:45:16,436][123091] Updated weights for policy 0, policy_version 272009 (0.0010) [2023-12-26 01:45:16,536][123090] Updated weights for policy 1, policy_version 270569 (0.0008) [2023-12-26 01:45:16,602][123090] Updated weights for policy 1, policy_version 270579 (0.0005) [2023-12-26 01:45:16,656][123090] Updated weights for policy 1, policy_version 270589 (0.0005) [2023-12-26 01:45:17,315][123091] Updated weights for policy 0, policy_version 272019 (0.0009) [2023-12-26 01:45:17,338][123090] Updated weights for policy 1, policy_version 270599 (0.0009) [2023-12-26 01:45:17,366][123091] Updated weights for policy 0, policy_version 272029 (0.0006) [2023-12-26 01:45:17,401][123090] Updated weights for policy 1, policy_version 270609 (0.0010) [2023-12-26 01:45:17,412][123091] Updated weights for policy 0, policy_version 272039 (0.0005) [2023-12-26 01:45:17,456][123090] Updated weights for policy 1, policy_version 270619 (0.0010) [2023-12-26 01:45:18,158][123090] Updated weights for policy 1, policy_version 270629 (0.0006) [2023-12-26 01:45:18,215][123090] Updated weights for policy 1, policy_version 270639 (0.0005) [2023-12-26 01:45:18,283][123090] Updated weights for policy 1, policy_version 270649 (0.0006) [2023-12-26 01:45:18,298][123091] Updated weights for policy 0, policy_version 272049 (0.0006) [2023-12-26 01:45:18,362][123091] Updated weights for policy 0, policy_version 272059 (0.0010) [2023-12-26 01:45:18,417][123091] Updated weights for policy 0, policy_version 272069 (0.0010) [2023-12-26 01:45:18,472][123091] Updated weights for policy 0, policy_version 272079 (0.0010) [2023-12-26 01:45:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 138944512. Throughput: 0: 8903.6, 1: 8980.6. Samples: 138953740. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:45:18,785][121949] Avg episode reward: [(0, '5942.016'), (1, '5435.999')] [2023-12-26 01:45:19,015][123090] Updated weights for policy 1, policy_version 270659 (0.0008) [2023-12-26 01:45:19,063][123090] Updated weights for policy 1, policy_version 270669 (0.0010) [2023-12-26 01:45:19,119][123090] Updated weights for policy 1, policy_version 270679 (0.0010) [2023-12-26 01:45:19,376][123091] Updated weights for policy 0, policy_version 272089 (0.0009) [2023-12-26 01:45:19,434][123091] Updated weights for policy 0, policy_version 272099 (0.0010) [2023-12-26 01:45:19,497][123091] Updated weights for policy 0, policy_version 272109 (0.0008) [2023-12-26 01:45:19,969][123090] Updated weights for policy 1, policy_version 270689 (0.0010) [2023-12-26 01:45:20,038][123090] Updated weights for policy 1, policy_version 270699 (0.0008) [2023-12-26 01:45:20,107][123090] Updated weights for policy 1, policy_version 270709 (0.0006) [2023-12-26 01:45:20,177][123090] Updated weights for policy 1, policy_version 270719 (0.0006) [2023-12-26 01:45:20,257][123091] Updated weights for policy 0, policy_version 272119 (0.0005) [2023-12-26 01:45:20,327][123091] Updated weights for policy 0, policy_version 272129 (0.0006) [2023-12-26 01:45:20,391][123091] Updated weights for policy 0, policy_version 272139 (0.0009) [2023-12-26 01:45:20,904][123090] Updated weights for policy 1, policy_version 270729 (0.0007) [2023-12-26 01:45:20,970][123090] Updated weights for policy 1, policy_version 270739 (0.0009) [2023-12-26 01:45:21,042][123090] Updated weights for policy 1, policy_version 270749 (0.0007) [2023-12-26 01:45:21,228][123091] Updated weights for policy 0, policy_version 272149 (0.0009) [2023-12-26 01:45:21,288][123091] Updated weights for policy 0, policy_version 272159 (0.0010) [2023-12-26 01:45:21,359][123091] Updated weights for policy 0, policy_version 272169 (0.0009) [2023-12-26 01:45:21,830][123090] Updated weights for policy 1, policy_version 270759 (0.0009) [2023-12-26 01:45:21,900][123090] Updated weights for policy 1, policy_version 270769 (0.0007) [2023-12-26 01:45:21,966][123090] Updated weights for policy 1, policy_version 270779 (0.0009) [2023-12-26 01:45:22,146][123091] Updated weights for policy 0, policy_version 272179 (0.0009) [2023-12-26 01:45:22,215][123091] Updated weights for policy 0, policy_version 272189 (0.0011) [2023-12-26 01:45:22,285][123091] Updated weights for policy 0, policy_version 272199 (0.0011) [2023-12-26 01:45:22,807][123090] Updated weights for policy 1, policy_version 270789 (0.0009) [2023-12-26 01:45:22,865][123090] Updated weights for policy 1, policy_version 270799 (0.0010) [2023-12-26 01:45:22,923][123090] Updated weights for policy 1, policy_version 270809 (0.0009) [2023-12-26 01:45:23,000][123091] Updated weights for policy 0, policy_version 272209 (0.0010) [2023-12-26 01:45:23,065][123091] Updated weights for policy 0, policy_version 272219 (0.0006) [2023-12-26 01:45:23,132][123091] Updated weights for policy 0, policy_version 272229 (0.0005) [2023-12-26 01:45:23,204][123091] Updated weights for policy 0, policy_version 272239 (0.0006) [2023-12-26 01:45:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 139026432. Throughput: 0: 8946.9, 1: 8952.3. Samples: 139006792. Policy #0 lag: (min: 24.0, avg: 50.6, max: 56.0) [2023-12-26 01:45:23,785][121949] Avg episode reward: [(0, '5914.883'), (1, '5459.166')] [2023-12-26 01:45:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000270816_69328896.pth... [2023-12-26 01:45:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000269792_69066752.pth [2023-12-26 01:45:23,825][123090] Updated weights for policy 1, policy_version 270819 (0.0010) [2023-12-26 01:45:23,841][123091] Updated weights for policy 0, policy_version 272249 (0.0005) [2023-12-26 01:45:23,873][123090] Updated weights for policy 1, policy_version 270829 (0.0009) [2023-12-26 01:45:23,888][123091] Updated weights for policy 0, policy_version 272259 (0.0007) [2023-12-26 01:45:23,917][123090] Updated weights for policy 1, policy_version 270839 (0.0005) [2023-12-26 01:45:23,935][123091] Updated weights for policy 0, policy_version 272269 (0.0007) [2023-12-26 01:45:23,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000272272_69705728.pth... [2023-12-26 01:45:23,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000271184_69427200.pth [2023-12-26 01:45:24,601][123091] Updated weights for policy 0, policy_version 272280 (0.0009) [2023-12-26 01:45:24,660][123091] Updated weights for policy 0, policy_version 272290 (0.0011) [2023-12-26 01:45:24,723][123091] Updated weights for policy 0, policy_version 272300 (0.0010) [2023-12-26 01:45:24,725][123090] Updated weights for policy 1, policy_version 270849 (0.0005) [2023-12-26 01:45:24,781][123090] Updated weights for policy 1, policy_version 270859 (0.0005) [2023-12-26 01:45:24,844][123090] Updated weights for policy 1, policy_version 270869 (0.0005) [2023-12-26 01:45:24,910][123090] Updated weights for policy 1, policy_version 270879 (0.0005) [2023-12-26 01:45:25,512][123091] Updated weights for policy 0, policy_version 272310 (0.0006) [2023-12-26 01:45:25,558][123091] Updated weights for policy 0, policy_version 272320 (0.0005) [2023-12-26 01:45:25,609][123091] Updated weights for policy 0, policy_version 272330 (0.0005) [2023-12-26 01:45:25,702][123090] Updated weights for policy 1, policy_version 270889 (0.0009) [2023-12-26 01:45:25,757][123090] Updated weights for policy 1, policy_version 270900 (0.0011) [2023-12-26 01:45:25,812][123090] Updated weights for policy 1, policy_version 270911 (0.0010) [2023-12-26 01:45:26,280][123091] Updated weights for policy 0, policy_version 272340 (0.0005) [2023-12-26 01:45:26,333][123091] Updated weights for policy 0, policy_version 272350 (0.0005) [2023-12-26 01:45:26,388][123091] Updated weights for policy 0, policy_version 272360 (0.0006) [2023-12-26 01:45:26,688][123090] Updated weights for policy 1, policy_version 270921 (0.0008) [2023-12-26 01:45:26,750][123090] Updated weights for policy 1, policy_version 270931 (0.0010) [2023-12-26 01:45:26,809][123090] Updated weights for policy 1, policy_version 270941 (0.0010) [2023-12-26 01:45:27,053][123091] Updated weights for policy 0, policy_version 272370 (0.0005) [2023-12-26 01:45:27,107][123091] Updated weights for policy 0, policy_version 272380 (0.0005) [2023-12-26 01:45:27,162][123091] Updated weights for policy 0, policy_version 272390 (0.0005) [2023-12-26 01:45:27,218][123091] Updated weights for policy 0, policy_version 272400 (0.0005) [2023-12-26 01:45:27,616][123090] Updated weights for policy 1, policy_version 270951 (0.0007) [2023-12-26 01:45:27,669][123090] Updated weights for policy 1, policy_version 270961 (0.0005) [2023-12-26 01:45:27,721][123090] Updated weights for policy 1, policy_version 270971 (0.0006) [2023-12-26 01:45:27,891][123091] Updated weights for policy 0, policy_version 272410 (0.0005) [2023-12-26 01:45:27,954][123091] Updated weights for policy 0, policy_version 272420 (0.0005) [2023-12-26 01:45:28,019][123091] Updated weights for policy 0, policy_version 272430 (0.0005) [2023-12-26 01:45:28,453][123090] Updated weights for policy 1, policy_version 270981 (0.0008) [2023-12-26 01:45:28,526][123090] Updated weights for policy 1, policy_version 270991 (0.0010) [2023-12-26 01:45:28,598][123090] Updated weights for policy 1, policy_version 271001 (0.0009) [2023-12-26 01:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 139124736. Throughput: 0: 9166.6, 1: 8921.3. Samples: 139117988. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:28,784][121949] Avg episode reward: [(0, '5996.217'), (1, '5397.171')] [2023-12-26 01:45:28,789][123091] Updated weights for policy 0, policy_version 272440 (0.0011) [2023-12-26 01:45:28,849][123091] Updated weights for policy 0, policy_version 272450 (0.0011) [2023-12-26 01:45:28,914][123091] Updated weights for policy 0, policy_version 272460 (0.0011) [2023-12-26 01:45:29,385][123090] Updated weights for policy 1, policy_version 271011 (0.0008) [2023-12-26 01:45:29,445][123090] Updated weights for policy 1, policy_version 271021 (0.0005) [2023-12-26 01:45:29,505][123090] Updated weights for policy 1, policy_version 271031 (0.0006) [2023-12-26 01:45:29,761][123091] Updated weights for policy 0, policy_version 272470 (0.0011) [2023-12-26 01:45:29,834][123091] Updated weights for policy 0, policy_version 272480 (0.0011) [2023-12-26 01:45:29,898][123091] Updated weights for policy 0, policy_version 272490 (0.0011) [2023-12-26 01:45:30,285][123090] Updated weights for policy 1, policy_version 271041 (0.0007) [2023-12-26 01:45:30,349][123090] Updated weights for policy 1, policy_version 271051 (0.0009) [2023-12-26 01:45:30,404][123090] Updated weights for policy 1, policy_version 271061 (0.0009) [2023-12-26 01:45:30,463][123090] Updated weights for policy 1, policy_version 271071 (0.0009) [2023-12-26 01:45:30,700][123091] Updated weights for policy 0, policy_version 272501 (0.0011) [2023-12-26 01:45:30,755][123091] Updated weights for policy 0, policy_version 272512 (0.0011) [2023-12-26 01:45:30,818][123091] Updated weights for policy 0, policy_version 272523 (0.0010) [2023-12-26 01:45:31,221][123090] Updated weights for policy 1, policy_version 271081 (0.0009) [2023-12-26 01:45:31,282][123090] Updated weights for policy 1, policy_version 271091 (0.0007) [2023-12-26 01:45:31,350][123090] Updated weights for policy 1, policy_version 271101 (0.0008) [2023-12-26 01:45:31,741][123091] Updated weights for policy 0, policy_version 272533 (0.0009) [2023-12-26 01:45:31,805][123091] Updated weights for policy 0, policy_version 272543 (0.0006) [2023-12-26 01:45:31,872][123091] Updated weights for policy 0, policy_version 272553 (0.0007) [2023-12-26 01:45:32,189][123090] Updated weights for policy 1, policy_version 271111 (0.0009) [2023-12-26 01:45:32,250][123090] Updated weights for policy 1, policy_version 271121 (0.0010) [2023-12-26 01:45:32,307][123090] Updated weights for policy 1, policy_version 271131 (0.0008) [2023-12-26 01:45:32,601][123091] Updated weights for policy 0, policy_version 272563 (0.0008) [2023-12-26 01:45:32,661][123091] Updated weights for policy 0, policy_version 272573 (0.0010) [2023-12-26 01:45:32,712][123091] Updated weights for policy 0, policy_version 272583 (0.0009) [2023-12-26 01:45:33,118][123090] Updated weights for policy 1, policy_version 271141 (0.0010) [2023-12-26 01:45:33,196][123090] Updated weights for policy 1, policy_version 271151 (0.0008) [2023-12-26 01:45:33,276][123090] Updated weights for policy 1, policy_version 271161 (0.0009) [2023-12-26 01:45:33,442][123091] Updated weights for policy 0, policy_version 272593 (0.0009) [2023-12-26 01:45:33,497][123091] Updated weights for policy 0, policy_version 272604 (0.0008) [2023-12-26 01:45:33,548][123091] Updated weights for policy 0, policy_version 272614 (0.0009) [2023-12-26 01:45:33,607][123091] Updated weights for policy 0, policy_version 272624 (0.0010) [2023-12-26 01:45:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 139214848. Throughput: 0: 9159.7, 1: 8907.9. Samples: 139224880. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:33,784][121949] Avg episode reward: [(0, '5820.317'), (1, '5397.114')] [2023-12-26 01:45:33,956][123090] Updated weights for policy 1, policy_version 271171 (0.0010) [2023-12-26 01:45:34,023][123090] Updated weights for policy 1, policy_version 271181 (0.0011) [2023-12-26 01:45:34,090][123090] Updated weights for policy 1, policy_version 271191 (0.0010) [2023-12-26 01:45:34,397][123091] Updated weights for policy 0, policy_version 272634 (0.0011) [2023-12-26 01:45:34,457][123091] Updated weights for policy 0, policy_version 272644 (0.0011) [2023-12-26 01:45:34,522][123091] Updated weights for policy 0, policy_version 272654 (0.0010) [2023-12-26 01:45:34,905][123090] Updated weights for policy 1, policy_version 271201 (0.0010) [2023-12-26 01:45:34,954][123090] Updated weights for policy 1, policy_version 271211 (0.0010) [2023-12-26 01:45:35,006][123090] Updated weights for policy 1, policy_version 271221 (0.0010) [2023-12-26 01:45:35,074][123090] Updated weights for policy 1, policy_version 271231 (0.0011) [2023-12-26 01:45:35,374][123091] Updated weights for policy 0, policy_version 272664 (0.0011) [2023-12-26 01:45:35,426][123091] Updated weights for policy 0, policy_version 272674 (0.0010) [2023-12-26 01:45:35,477][123091] Updated weights for policy 0, policy_version 272684 (0.0010) [2023-12-26 01:45:35,742][123090] Updated weights for policy 1, policy_version 271241 (0.0006) [2023-12-26 01:45:35,794][123090] Updated weights for policy 1, policy_version 271251 (0.0005) [2023-12-26 01:45:35,847][123090] Updated weights for policy 1, policy_version 271261 (0.0005) [2023-12-26 01:45:36,259][123091] Updated weights for policy 0, policy_version 272694 (0.0010) [2023-12-26 01:45:36,330][123091] Updated weights for policy 0, policy_version 272704 (0.0009) [2023-12-26 01:45:36,388][123091] Updated weights for policy 0, policy_version 272714 (0.0009) [2023-12-26 01:45:36,570][123090] Updated weights for policy 1, policy_version 271271 (0.0005) [2023-12-26 01:45:36,645][123090] Updated weights for policy 1, policy_version 271281 (0.0006) [2023-12-26 01:45:36,711][123090] Updated weights for policy 1, policy_version 271291 (0.0006) [2023-12-26 01:45:37,228][123091] Updated weights for policy 0, policy_version 272724 (0.0010) [2023-12-26 01:45:37,290][123091] Updated weights for policy 0, policy_version 272734 (0.0011) [2023-12-26 01:45:37,352][123091] Updated weights for policy 0, policy_version 272744 (0.0010) [2023-12-26 01:45:37,441][123090] Updated weights for policy 1, policy_version 271301 (0.0008) [2023-12-26 01:45:37,496][123090] Updated weights for policy 1, policy_version 271311 (0.0010) [2023-12-26 01:45:37,555][123090] Updated weights for policy 1, policy_version 271321 (0.0010) [2023-12-26 01:45:38,158][123091] Updated weights for policy 0, policy_version 272754 (0.0010) [2023-12-26 01:45:38,209][123091] Updated weights for policy 0, policy_version 272764 (0.0008) [2023-12-26 01:45:38,257][123091] Updated weights for policy 0, policy_version 272774 (0.0009) [2023-12-26 01:45:38,308][123090] Updated weights for policy 1, policy_version 271331 (0.0009) [2023-12-26 01:45:38,312][123091] Updated weights for policy 0, policy_version 272784 (0.0009) [2023-12-26 01:45:38,374][123090] Updated weights for policy 1, policy_version 271341 (0.0010) [2023-12-26 01:45:38,436][123090] Updated weights for policy 1, policy_version 271351 (0.0010) [2023-12-26 01:45:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 139304960. Throughput: 0: 9128.3, 1: 8928.2. Samples: 139279624. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:38,785][121949] Avg episode reward: [(0, '5668.374'), (1, '5149.271')] [2023-12-26 01:45:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000272784_69836800.pth... [2023-12-26 01:45:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000271360_69468160.pth... [2023-12-26 01:45:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000270336_69206016.pth [2023-12-26 01:45:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000271728_69566464.pth [2023-12-26 01:45:39,151][123091] Updated weights for policy 0, policy_version 272794 (0.0010) [2023-12-26 01:45:39,211][123091] Updated weights for policy 0, policy_version 272804 (0.0006) [2023-12-26 01:45:39,264][123090] Updated weights for policy 1, policy_version 271361 (0.0009) [2023-12-26 01:45:39,272][123091] Updated weights for policy 0, policy_version 272814 (0.0009) [2023-12-26 01:45:39,326][123090] Updated weights for policy 1, policy_version 271371 (0.0008) [2023-12-26 01:45:39,397][123090] Updated weights for policy 1, policy_version 271381 (0.0009) [2023-12-26 01:45:39,460][123090] Updated weights for policy 1, policy_version 271391 (0.0008) [2023-12-26 01:45:40,087][123091] Updated weights for policy 0, policy_version 272824 (0.0009) [2023-12-26 01:45:40,151][123091] Updated weights for policy 0, policy_version 272834 (0.0006) [2023-12-26 01:45:40,219][123091] Updated weights for policy 0, policy_version 272844 (0.0006) [2023-12-26 01:45:40,335][123090] Updated weights for policy 1, policy_version 271401 (0.0009) [2023-12-26 01:45:40,404][123090] Updated weights for policy 1, policy_version 271411 (0.0010) [2023-12-26 01:45:40,456][123090] Updated weights for policy 1, policy_version 271421 (0.0009) [2023-12-26 01:45:40,907][123091] Updated weights for policy 0, policy_version 272854 (0.0006) [2023-12-26 01:45:40,972][123091] Updated weights for policy 0, policy_version 272864 (0.0006) [2023-12-26 01:45:41,027][123091] Updated weights for policy 0, policy_version 272874 (0.0006) [2023-12-26 01:45:41,424][123090] Updated weights for policy 1, policy_version 271431 (0.0010) [2023-12-26 01:45:41,494][123090] Updated weights for policy 1, policy_version 271441 (0.0009) [2023-12-26 01:45:41,554][123090] Updated weights for policy 1, policy_version 271451 (0.0007) [2023-12-26 01:45:41,847][123091] Updated weights for policy 0, policy_version 272885 (0.0010) [2023-12-26 01:45:41,901][123091] Updated weights for policy 0, policy_version 272895 (0.0009) [2023-12-26 01:45:41,968][123091] Updated weights for policy 0, policy_version 272905 (0.0009) [2023-12-26 01:45:42,428][123090] Updated weights for policy 1, policy_version 271461 (0.0009) [2023-12-26 01:45:42,485][123090] Updated weights for policy 1, policy_version 271471 (0.0010) [2023-12-26 01:45:42,544][123090] Updated weights for policy 1, policy_version 271481 (0.0008) [2023-12-26 01:45:42,795][123091] Updated weights for policy 0, policy_version 272915 (0.0008) [2023-12-26 01:45:42,850][123091] Updated weights for policy 0, policy_version 272925 (0.0005) [2023-12-26 01:45:42,905][123091] Updated weights for policy 0, policy_version 272935 (0.0005) [2023-12-26 01:45:43,427][123090] Updated weights for policy 1, policy_version 271491 (0.0010) [2023-12-26 01:45:43,490][123090] Updated weights for policy 1, policy_version 271501 (0.0008) [2023-12-26 01:45:43,565][123090] Updated weights for policy 1, policy_version 271511 (0.0006) [2023-12-26 01:45:43,620][123091] Updated weights for policy 0, policy_version 272945 (0.0006) [2023-12-26 01:45:43,674][123091] Updated weights for policy 0, policy_version 272955 (0.0010) [2023-12-26 01:45:43,740][123091] Updated weights for policy 0, policy_version 272965 (0.0010) [2023-12-26 01:45:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 139386880. Throughput: 0: 9063.4, 1: 8779.2. Samples: 139383620. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:43,785][121949] Avg episode reward: [(0, '5750.909'), (1, '4997.966')] [2023-12-26 01:45:43,791][123091] Updated weights for policy 0, policy_version 272975 (0.0010) [2023-12-26 01:45:44,323][123090] Updated weights for policy 1, policy_version 271521 (0.0009) [2023-12-26 01:45:44,380][123090] Updated weights for policy 1, policy_version 271531 (0.0009) [2023-12-26 01:45:44,443][123090] Updated weights for policy 1, policy_version 271541 (0.0005) [2023-12-26 01:45:44,502][123090] Updated weights for policy 1, policy_version 271551 (0.0005) [2023-12-26 01:45:44,634][123091] Updated weights for policy 0, policy_version 272985 (0.0009) [2023-12-26 01:45:44,705][123091] Updated weights for policy 0, policy_version 272995 (0.0006) [2023-12-26 01:45:44,775][123091] Updated weights for policy 0, policy_version 273005 (0.0006) [2023-12-26 01:45:45,241][123090] Updated weights for policy 1, policy_version 271561 (0.0010) [2023-12-26 01:45:45,304][123090] Updated weights for policy 1, policy_version 271571 (0.0011) [2023-12-26 01:45:45,352][123090] Updated weights for policy 1, policy_version 271581 (0.0010) [2023-12-26 01:45:45,510][123091] Updated weights for policy 0, policy_version 273015 (0.0009) [2023-12-26 01:45:45,574][123091] Updated weights for policy 0, policy_version 273025 (0.0010) [2023-12-26 01:45:45,633][123091] Updated weights for policy 0, policy_version 273035 (0.0010) [2023-12-26 01:45:46,066][123090] Updated weights for policy 1, policy_version 271591 (0.0010) [2023-12-26 01:45:46,130][123090] Updated weights for policy 1, policy_version 271601 (0.0011) [2023-12-26 01:45:46,193][123090] Updated weights for policy 1, policy_version 271611 (0.0011) [2023-12-26 01:45:46,418][123091] Updated weights for policy 0, policy_version 273045 (0.0010) [2023-12-26 01:45:46,465][123091] Updated weights for policy 0, policy_version 273055 (0.0010) [2023-12-26 01:45:46,512][123091] Updated weights for policy 0, policy_version 273065 (0.0010) [2023-12-26 01:45:47,016][123090] Updated weights for policy 1, policy_version 271621 (0.0011) [2023-12-26 01:45:47,082][123090] Updated weights for policy 1, policy_version 271631 (0.0011) [2023-12-26 01:45:47,146][123090] Updated weights for policy 1, policy_version 271641 (0.0011) [2023-12-26 01:45:47,343][123091] Updated weights for policy 0, policy_version 273075 (0.0010) [2023-12-26 01:45:47,410][123091] Updated weights for policy 0, policy_version 273085 (0.0008) [2023-12-26 01:45:47,478][123091] Updated weights for policy 0, policy_version 273095 (0.0008) [2023-12-26 01:45:47,969][123090] Updated weights for policy 1, policy_version 271651 (0.0010) [2023-12-26 01:45:48,022][123090] Updated weights for policy 1, policy_version 271661 (0.0009) [2023-12-26 01:45:48,096][123090] Updated weights for policy 1, policy_version 271671 (0.0008) [2023-12-26 01:45:48,261][123091] Updated weights for policy 0, policy_version 273105 (0.0009) [2023-12-26 01:45:48,309][123091] Updated weights for policy 0, policy_version 273115 (0.0010) [2023-12-26 01:45:48,372][123091] Updated weights for policy 0, policy_version 273125 (0.0010) [2023-12-26 01:45:48,435][123091] Updated weights for policy 0, policy_version 273135 (0.0011) [2023-12-26 01:45:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 139476992. Throughput: 0: 9024.0, 1: 8765.9. Samples: 139489708. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:48,785][121949] Avg episode reward: [(0, '5839.107'), (1, '4981.077')] [2023-12-26 01:45:48,882][123090] Updated weights for policy 1, policy_version 271681 (0.0010) [2023-12-26 01:45:48,961][123090] Updated weights for policy 1, policy_version 271691 (0.0005) [2023-12-26 01:45:49,034][123090] Updated weights for policy 1, policy_version 271701 (0.0010) [2023-12-26 01:45:49,109][123090] Updated weights for policy 1, policy_version 271711 (0.0010) [2023-12-26 01:45:49,189][123091] Updated weights for policy 0, policy_version 273145 (0.0009) [2023-12-26 01:45:49,261][123091] Updated weights for policy 0, policy_version 273155 (0.0009) [2023-12-26 01:45:49,331][123091] Updated weights for policy 0, policy_version 273165 (0.0007) [2023-12-26 01:45:49,863][123090] Updated weights for policy 1, policy_version 271721 (0.0010) [2023-12-26 01:45:49,931][123090] Updated weights for policy 1, policy_version 271731 (0.0010) [2023-12-26 01:45:49,999][123090] Updated weights for policy 1, policy_version 271741 (0.0009) [2023-12-26 01:45:50,082][123091] Updated weights for policy 0, policy_version 273175 (0.0006) [2023-12-26 01:45:50,140][123091] Updated weights for policy 0, policy_version 273185 (0.0006) [2023-12-26 01:45:50,206][123091] Updated weights for policy 0, policy_version 273195 (0.0006) [2023-12-26 01:45:50,832][123090] Updated weights for policy 1, policy_version 271751 (0.0011) [2023-12-26 01:45:50,832][123091] Updated weights for policy 0, policy_version 273205 (0.0006) [2023-12-26 01:45:50,887][123090] Updated weights for policy 1, policy_version 271761 (0.0010) [2023-12-26 01:45:50,890][123091] Updated weights for policy 0, policy_version 273215 (0.0006) [2023-12-26 01:45:50,939][123090] Updated weights for policy 1, policy_version 271771 (0.0010) [2023-12-26 01:45:50,950][123091] Updated weights for policy 0, policy_version 273225 (0.0005) [2023-12-26 01:45:51,780][123090] Updated weights for policy 1, policy_version 271781 (0.0009) [2023-12-26 01:45:51,834][123091] Updated weights for policy 0, policy_version 273235 (0.0007) [2023-12-26 01:45:51,843][123090] Updated weights for policy 1, policy_version 271791 (0.0010) [2023-12-26 01:45:51,885][123091] Updated weights for policy 0, policy_version 273245 (0.0008) [2023-12-26 01:45:51,895][123090] Updated weights for policy 1, policy_version 271801 (0.0010) [2023-12-26 01:45:51,940][123091] Updated weights for policy 0, policy_version 273255 (0.0008) [2023-12-26 01:45:52,741][123090] Updated weights for policy 1, policy_version 271811 (0.0010) [2023-12-26 01:45:52,753][123091] Updated weights for policy 0, policy_version 273265 (0.0009) [2023-12-26 01:45:52,801][123090] Updated weights for policy 1, policy_version 271821 (0.0010) [2023-12-26 01:45:52,812][123091] Updated weights for policy 0, policy_version 273275 (0.0006) [2023-12-26 01:45:52,868][123090] Updated weights for policy 1, policy_version 271831 (0.0010) [2023-12-26 01:45:52,873][123091] Updated weights for policy 0, policy_version 273285 (0.0006) [2023-12-26 01:45:52,929][123091] Updated weights for policy 0, policy_version 273295 (0.0010) [2023-12-26 01:45:53,615][123090] Updated weights for policy 1, policy_version 271841 (0.0010) [2023-12-26 01:45:53,665][123091] Updated weights for policy 0, policy_version 273305 (0.0011) [2023-12-26 01:45:53,669][123090] Updated weights for policy 1, policy_version 271851 (0.0007) [2023-12-26 01:45:53,713][123091] Updated weights for policy 0, policy_version 273315 (0.0010) [2023-12-26 01:45:53,718][123090] Updated weights for policy 1, policy_version 271861 (0.0005) [2023-12-26 01:45:53,771][123091] Updated weights for policy 0, policy_version 273325 (0.0010) [2023-12-26 01:45:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 139558912. Throughput: 0: 8972.2, 1: 8739.9. Samples: 139543048. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:53,785][123090] Updated weights for policy 1, policy_version 271871 (0.0005) [2023-12-26 01:45:53,785][121949] Avg episode reward: [(0, '6004.478'), (1, '5142.919')] [2023-12-26 01:45:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000273328_69976064.pth... [2023-12-26 01:45:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000271872_69599232.pth... [2023-12-26 01:45:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000272272_69705728.pth [2023-12-26 01:45:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000270816_69328896.pth [2023-12-26 01:45:54,456][123090] Updated weights for policy 1, policy_version 271881 (0.0005) [2023-12-26 01:45:54,518][123090] Updated weights for policy 1, policy_version 271891 (0.0005) [2023-12-26 01:45:54,582][123090] Updated weights for policy 1, policy_version 271901 (0.0007) [2023-12-26 01:45:54,607][123091] Updated weights for policy 0, policy_version 273335 (0.0009) [2023-12-26 01:45:54,671][123091] Updated weights for policy 0, policy_version 273345 (0.0010) [2023-12-26 01:45:54,730][123091] Updated weights for policy 0, policy_version 273355 (0.0010) [2023-12-26 01:45:55,257][123090] Updated weights for policy 1, policy_version 271911 (0.0006) [2023-12-26 01:45:55,313][123090] Updated weights for policy 1, policy_version 271921 (0.0005) [2023-12-26 01:45:55,384][123090] Updated weights for policy 1, policy_version 271931 (0.0006) [2023-12-26 01:45:55,555][123091] Updated weights for policy 0, policy_version 273365 (0.0006) [2023-12-26 01:45:55,625][123091] Updated weights for policy 0, policy_version 273375 (0.0005) [2023-12-26 01:45:55,695][123091] Updated weights for policy 0, policy_version 273385 (0.0007) [2023-12-26 01:45:56,140][123090] Updated weights for policy 1, policy_version 271941 (0.0010) [2023-12-26 01:45:56,188][123090] Updated weights for policy 1, policy_version 271951 (0.0008) [2023-12-26 01:45:56,237][123090] Updated weights for policy 1, policy_version 271961 (0.0009) [2023-12-26 01:45:56,451][123091] Updated weights for policy 0, policy_version 273395 (0.0010) [2023-12-26 01:45:56,502][123091] Updated weights for policy 0, policy_version 273405 (0.0010) [2023-12-26 01:45:56,549][123091] Updated weights for policy 0, policy_version 273415 (0.0010) [2023-12-26 01:45:57,119][123090] Updated weights for policy 1, policy_version 271971 (0.0008) [2023-12-26 01:45:57,170][123090] Updated weights for policy 1, policy_version 271981 (0.0009) [2023-12-26 01:45:57,218][123090] Updated weights for policy 1, policy_version 271991 (0.0009) [2023-12-26 01:45:57,347][123091] Updated weights for policy 0, policy_version 273425 (0.0010) [2023-12-26 01:45:57,408][123091] Updated weights for policy 0, policy_version 273435 (0.0010) [2023-12-26 01:45:57,463][123091] Updated weights for policy 0, policy_version 273445 (0.0010) [2023-12-26 01:45:57,514][123091] Updated weights for policy 0, policy_version 273455 (0.0010) [2023-12-26 01:45:58,015][123090] Updated weights for policy 1, policy_version 272001 (0.0009) [2023-12-26 01:45:58,079][123090] Updated weights for policy 1, policy_version 272011 (0.0009) [2023-12-26 01:45:58,148][123090] Updated weights for policy 1, policy_version 272021 (0.0009) [2023-12-26 01:45:58,213][123090] Updated weights for policy 1, policy_version 272031 (0.0009) [2023-12-26 01:45:58,386][123091] Updated weights for policy 0, policy_version 273465 (0.0011) [2023-12-26 01:45:58,454][123091] Updated weights for policy 0, policy_version 273475 (0.0009) [2023-12-26 01:45:58,522][123091] Updated weights for policy 0, policy_version 273485 (0.0011) [2023-12-26 01:45:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 139657216. Throughput: 0: 8981.7, 1: 8830.0. Samples: 139650328. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:45:58,785][121949] Avg episode reward: [(0, '6045.424'), (1, '5247.570')] [2023-12-26 01:45:59,102][123090] Updated weights for policy 1, policy_version 272041 (0.0009) [2023-12-26 01:45:59,162][123090] Updated weights for policy 1, policy_version 272051 (0.0007) [2023-12-26 01:45:59,236][123090] Updated weights for policy 1, policy_version 272061 (0.0009) [2023-12-26 01:45:59,378][123091] Updated weights for policy 0, policy_version 273495 (0.0009) [2023-12-26 01:45:59,455][123091] Updated weights for policy 0, policy_version 273505 (0.0007) [2023-12-26 01:45:59,535][123091] Updated weights for policy 0, policy_version 273515 (0.0006) [2023-12-26 01:46:00,132][123090] Updated weights for policy 1, policy_version 272071 (0.0010) [2023-12-26 01:46:00,191][123090] Updated weights for policy 1, policy_version 272082 (0.0010) [2023-12-26 01:46:00,256][123090] Updated weights for policy 1, policy_version 272092 (0.0010) [2023-12-26 01:46:00,263][123091] Updated weights for policy 0, policy_version 273525 (0.0006) [2023-12-26 01:46:00,330][123091] Updated weights for policy 0, policy_version 273535 (0.0009) [2023-12-26 01:46:00,389][123091] Updated weights for policy 0, policy_version 273545 (0.0009) [2023-12-26 01:46:01,166][123090] Updated weights for policy 1, policy_version 272102 (0.0009) [2023-12-26 01:46:01,232][123090] Updated weights for policy 1, policy_version 272112 (0.0009) [2023-12-26 01:46:01,235][123091] Updated weights for policy 0, policy_version 273555 (0.0009) [2023-12-26 01:46:01,302][123090] Updated weights for policy 1, policy_version 272122 (0.0007) [2023-12-26 01:46:01,303][123091] Updated weights for policy 0, policy_version 273565 (0.0009) [2023-12-26 01:46:01,372][123091] Updated weights for policy 0, policy_version 273575 (0.0009) [2023-12-26 01:46:02,115][123090] Updated weights for policy 1, policy_version 272132 (0.0009) [2023-12-26 01:46:02,157][123091] Updated weights for policy 0, policy_version 273585 (0.0008) [2023-12-26 01:46:02,182][123090] Updated weights for policy 1, policy_version 272142 (0.0008) [2023-12-26 01:46:02,214][123091] Updated weights for policy 0, policy_version 273595 (0.0009) [2023-12-26 01:46:02,252][123090] Updated weights for policy 1, policy_version 272152 (0.0008) [2023-12-26 01:46:02,273][123091] Updated weights for policy 0, policy_version 273605 (0.0008) [2023-12-26 01:46:02,328][123091] Updated weights for policy 0, policy_version 273615 (0.0008) [2023-12-26 01:46:03,012][123090] Updated weights for policy 1, policy_version 272162 (0.0008) [2023-12-26 01:46:03,074][123090] Updated weights for policy 1, policy_version 272172 (0.0008) [2023-12-26 01:46:03,123][123091] Updated weights for policy 0, policy_version 273625 (0.0008) [2023-12-26 01:46:03,138][123090] Updated weights for policy 1, policy_version 272182 (0.0009) [2023-12-26 01:46:03,184][123091] Updated weights for policy 0, policy_version 273635 (0.0007) [2023-12-26 01:46:03,200][123090] Updated weights for policy 1, policy_version 272192 (0.0009) [2023-12-26 01:46:03,245][123091] Updated weights for policy 0, policy_version 273645 (0.0009) [2023-12-26 01:46:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 139739136. Throughput: 0: 8973.5, 1: 8770.6. Samples: 139752228. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:03,785][121949] Avg episode reward: [(0, '5911.563'), (1, '5073.616')] [2023-12-26 01:46:04,069][123090] Updated weights for policy 1, policy_version 272202 (0.0007) [2023-12-26 01:46:04,071][123091] Updated weights for policy 0, policy_version 273655 (0.0009) [2023-12-26 01:46:04,138][123091] Updated weights for policy 0, policy_version 273665 (0.0008) [2023-12-26 01:46:04,140][123090] Updated weights for policy 1, policy_version 272212 (0.0008) [2023-12-26 01:46:04,203][123090] Updated weights for policy 1, policy_version 272222 (0.0010) [2023-12-26 01:46:04,211][123091] Updated weights for policy 0, policy_version 273675 (0.0007) [2023-12-26 01:46:05,004][123091] Updated weights for policy 0, policy_version 273685 (0.0008) [2023-12-26 01:46:05,018][123090] Updated weights for policy 1, policy_version 272232 (0.0009) [2023-12-26 01:46:05,067][123091] Updated weights for policy 0, policy_version 273695 (0.0005) [2023-12-26 01:46:05,075][123090] Updated weights for policy 1, policy_version 272242 (0.0009) [2023-12-26 01:46:05,130][123090] Updated weights for policy 1, policy_version 272252 (0.0009) [2023-12-26 01:46:05,132][123091] Updated weights for policy 0, policy_version 273705 (0.0007) [2023-12-26 01:46:05,871][123091] Updated weights for policy 0, policy_version 273715 (0.0008) [2023-12-26 01:46:05,879][123090] Updated weights for policy 1, policy_version 272262 (0.0008) [2023-12-26 01:46:05,924][123091] Updated weights for policy 0, policy_version 273725 (0.0006) [2023-12-26 01:46:05,937][123090] Updated weights for policy 1, policy_version 272272 (0.0009) [2023-12-26 01:46:05,985][123091] Updated weights for policy 0, policy_version 273735 (0.0008) [2023-12-26 01:46:06,000][123090] Updated weights for policy 1, policy_version 272282 (0.0007) [2023-12-26 01:46:06,757][123090] Updated weights for policy 1, policy_version 272292 (0.0009) [2023-12-26 01:46:06,822][123090] Updated weights for policy 1, policy_version 272302 (0.0011) [2023-12-26 01:46:06,869][123091] Updated weights for policy 0, policy_version 273745 (0.0009) [2023-12-26 01:46:06,885][123090] Updated weights for policy 1, policy_version 272312 (0.0008) [2023-12-26 01:46:06,932][123091] Updated weights for policy 0, policy_version 273755 (0.0009) [2023-12-26 01:46:07,003][123091] Updated weights for policy 0, policy_version 273765 (0.0009) [2023-12-26 01:46:07,072][123091] Updated weights for policy 0, policy_version 273775 (0.0010) [2023-12-26 01:46:07,635][123090] Updated weights for policy 1, policy_version 272322 (0.0008) [2023-12-26 01:46:07,689][123090] Updated weights for policy 1, policy_version 272332 (0.0006) [2023-12-26 01:46:07,747][123090] Updated weights for policy 1, policy_version 272342 (0.0005) [2023-12-26 01:46:07,826][123090] Updated weights for policy 1, policy_version 272352 (0.0005) [2023-12-26 01:46:07,933][123091] Updated weights for policy 0, policy_version 273785 (0.0009) [2023-12-26 01:46:08,003][123091] Updated weights for policy 0, policy_version 273795 (0.0007) [2023-12-26 01:46:08,073][123091] Updated weights for policy 0, policy_version 273805 (0.0009) [2023-12-26 01:46:08,600][123090] Updated weights for policy 1, policy_version 272362 (0.0010) [2023-12-26 01:46:08,675][123090] Updated weights for policy 1, policy_version 272372 (0.0009) [2023-12-26 01:46:08,744][123090] Updated weights for policy 1, policy_version 272382 (0.0008) [2023-12-26 01:46:08,761][123091] Updated weights for policy 0, policy_version 273815 (0.0008) [2023-12-26 01:46:08,785][121949] Fps is (10 sec: 17202.1, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 139829248. Throughput: 0: 8979.4, 1: 8761.1. Samples: 139805128. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:08,786][121949] Avg episode reward: [(0, '5924.873'), (1, '4908.746')] [2023-12-26 01:46:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000272384_69730304.pth... [2023-12-26 01:46:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000271360_69468160.pth [2023-12-26 01:46:08,830][123091] Updated weights for policy 0, policy_version 273825 (0.0010) [2023-12-26 01:46:08,886][123091] Updated weights for policy 0, policy_version 273835 (0.0009) [2023-12-26 01:46:08,915][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000273840_70107136.pth... [2023-12-26 01:46:08,919][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000272784_69836800.pth [2023-12-26 01:46:09,540][123090] Updated weights for policy 1, policy_version 272392 (0.0008) [2023-12-26 01:46:09,604][123090] Updated weights for policy 1, policy_version 272402 (0.0006) [2023-12-26 01:46:09,677][123090] Updated weights for policy 1, policy_version 272412 (0.0009) [2023-12-26 01:46:09,692][123091] Updated weights for policy 0, policy_version 273845 (0.0008) [2023-12-26 01:46:09,760][123091] Updated weights for policy 0, policy_version 273855 (0.0010) [2023-12-26 01:46:09,827][123091] Updated weights for policy 0, policy_version 273865 (0.0009) [2023-12-26 01:46:10,487][123090] Updated weights for policy 1, policy_version 272422 (0.0010) [2023-12-26 01:46:10,557][123090] Updated weights for policy 1, policy_version 272432 (0.0009) [2023-12-26 01:46:10,619][123090] Updated weights for policy 1, policy_version 272442 (0.0008) [2023-12-26 01:46:10,703][123091] Updated weights for policy 0, policy_version 273875 (0.0010) [2023-12-26 01:46:10,763][123091] Updated weights for policy 0, policy_version 273885 (0.0010) [2023-12-26 01:46:10,823][123091] Updated weights for policy 0, policy_version 273895 (0.0009) [2023-12-26 01:46:11,450][123090] Updated weights for policy 1, policy_version 272452 (0.0010) [2023-12-26 01:46:11,516][123090] Updated weights for policy 1, policy_version 272462 (0.0009) [2023-12-26 01:46:11,582][123090] Updated weights for policy 1, policy_version 272472 (0.0009) [2023-12-26 01:46:11,741][123091] Updated weights for policy 0, policy_version 273905 (0.0009) [2023-12-26 01:46:11,806][123091] Updated weights for policy 0, policy_version 273915 (0.0006) [2023-12-26 01:46:11,879][123091] Updated weights for policy 0, policy_version 273925 (0.0007) [2023-12-26 01:46:11,930][123091] Updated weights for policy 0, policy_version 273935 (0.0010) [2023-12-26 01:46:12,407][123090] Updated weights for policy 1, policy_version 272482 (0.0008) [2023-12-26 01:46:12,463][123090] Updated weights for policy 1, policy_version 272492 (0.0005) [2023-12-26 01:46:12,518][123090] Updated weights for policy 1, policy_version 272502 (0.0005) [2023-12-26 01:46:12,583][123090] Updated weights for policy 1, policy_version 272512 (0.0005) [2023-12-26 01:46:12,774][123091] Updated weights for policy 0, policy_version 273945 (0.0009) [2023-12-26 01:46:12,843][123091] Updated weights for policy 0, policy_version 273955 (0.0007) [2023-12-26 01:46:12,902][123091] Updated weights for policy 0, policy_version 273965 (0.0008) [2023-12-26 01:46:13,389][123090] Updated weights for policy 1, policy_version 272522 (0.0009) [2023-12-26 01:46:13,441][123090] Updated weights for policy 1, policy_version 272532 (0.0009) [2023-12-26 01:46:13,501][123090] Updated weights for policy 1, policy_version 272542 (0.0010) [2023-12-26 01:46:13,614][123091] Updated weights for policy 0, policy_version 273975 (0.0006) [2023-12-26 01:46:13,667][123091] Updated weights for policy 0, policy_version 273985 (0.0005) [2023-12-26 01:46:13,714][123091] Updated weights for policy 0, policy_version 273995 (0.0005) [2023-12-26 01:46:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 139919360. Throughput: 0: 8766.3, 1: 8791.0. Samples: 139908068. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:13,785][121949] Avg episode reward: [(0, '5950.435'), (1, '4980.450')] [2023-12-26 01:46:14,410][123090] Updated weights for policy 1, policy_version 272552 (0.0009) [2023-12-26 01:46:14,430][123091] Updated weights for policy 0, policy_version 274005 (0.0008) [2023-12-26 01:46:14,466][123090] Updated weights for policy 1, policy_version 272562 (0.0008) [2023-12-26 01:46:14,486][123091] Updated weights for policy 0, policy_version 274015 (0.0007) [2023-12-26 01:46:14,538][123091] Updated weights for policy 0, policy_version 274025 (0.0005) [2023-12-26 01:46:14,539][123090] Updated weights for policy 1, policy_version 272572 (0.0009) [2023-12-26 01:46:15,196][123091] Updated weights for policy 0, policy_version 274035 (0.0007) [2023-12-26 01:46:15,252][123091] Updated weights for policy 0, policy_version 274045 (0.0010) [2023-12-26 01:46:15,307][123091] Updated weights for policy 0, policy_version 274055 (0.0009) [2023-12-26 01:46:15,377][123090] Updated weights for policy 1, policy_version 272582 (0.0008) [2023-12-26 01:46:15,445][123090] Updated weights for policy 1, policy_version 272592 (0.0010) [2023-12-26 01:46:15,515][123090] Updated weights for policy 1, policy_version 272602 (0.0009) [2023-12-26 01:46:16,076][123091] Updated weights for policy 0, policy_version 274065 (0.0009) [2023-12-26 01:46:16,128][123091] Updated weights for policy 0, policy_version 274075 (0.0005) [2023-12-26 01:46:16,185][123091] Updated weights for policy 0, policy_version 274085 (0.0005) [2023-12-26 01:46:16,241][123091] Updated weights for policy 0, policy_version 274095 (0.0006) [2023-12-26 01:46:16,396][123090] Updated weights for policy 1, policy_version 272612 (0.0009) [2023-12-26 01:46:16,450][123090] Updated weights for policy 1, policy_version 272622 (0.0009) [2023-12-26 01:46:16,516][123090] Updated weights for policy 1, policy_version 272632 (0.0009) [2023-12-26 01:46:16,958][123091] Updated weights for policy 0, policy_version 274105 (0.0006) [2023-12-26 01:46:17,020][123091] Updated weights for policy 0, policy_version 274115 (0.0006) [2023-12-26 01:46:17,082][123091] Updated weights for policy 0, policy_version 274125 (0.0006) [2023-12-26 01:46:17,440][123090] Updated weights for policy 1, policy_version 272642 (0.0009) [2023-12-26 01:46:17,503][123090] Updated weights for policy 1, policy_version 272652 (0.0010) [2023-12-26 01:46:17,557][123090] Updated weights for policy 1, policy_version 272662 (0.0009) [2023-12-26 01:46:17,609][123090] Updated weights for policy 1, policy_version 272672 (0.0009) [2023-12-26 01:46:17,730][123091] Updated weights for policy 0, policy_version 274135 (0.0009) [2023-12-26 01:46:17,785][123091] Updated weights for policy 0, policy_version 274145 (0.0010) [2023-12-26 01:46:17,856][123091] Updated weights for policy 0, policy_version 274155 (0.0006) [2023-12-26 01:46:18,560][123090] Updated weights for policy 1, policy_version 272682 (0.0008) [2023-12-26 01:46:18,565][123091] Updated weights for policy 0, policy_version 274165 (0.0007) [2023-12-26 01:46:18,616][123090] Updated weights for policy 1, policy_version 272692 (0.0007) [2023-12-26 01:46:18,633][123091] Updated weights for policy 0, policy_version 274175 (0.0008) [2023-12-26 01:46:18,676][123090] Updated weights for policy 1, policy_version 272702 (0.0007) [2023-12-26 01:46:18,701][123091] Updated weights for policy 0, policy_version 274185 (0.0008) [2023-12-26 01:46:18,784][121949] Fps is (10 sec: 18023.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 140009472. Throughput: 0: 8919.7, 1: 8659.7. Samples: 140015956. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:18,785][121949] Avg episode reward: [(0, '5994.108'), (1, '5111.389')] [2023-12-26 01:46:19,355][123091] Updated weights for policy 0, policy_version 274195 (0.0008) [2023-12-26 01:46:19,415][123091] Updated weights for policy 0, policy_version 274205 (0.0009) [2023-12-26 01:46:19,475][123091] Updated weights for policy 0, policy_version 274215 (0.0011) [2023-12-26 01:46:19,537][123090] Updated weights for policy 1, policy_version 272712 (0.0007) [2023-12-26 01:46:19,601][123090] Updated weights for policy 1, policy_version 272722 (0.0009) [2023-12-26 01:46:19,665][123090] Updated weights for policy 1, policy_version 272732 (0.0009) [2023-12-26 01:46:20,285][123091] Updated weights for policy 0, policy_version 274225 (0.0011) [2023-12-26 01:46:20,355][123091] Updated weights for policy 0, policy_version 274235 (0.0011) [2023-12-26 01:46:20,412][123091] Updated weights for policy 0, policy_version 274245 (0.0010) [2023-12-26 01:46:20,475][123091] Updated weights for policy 0, policy_version 274255 (0.0011) [2023-12-26 01:46:20,516][123090] Updated weights for policy 1, policy_version 272742 (0.0009) [2023-12-26 01:46:20,582][123090] Updated weights for policy 1, policy_version 272752 (0.0010) [2023-12-26 01:46:20,642][123090] Updated weights for policy 1, policy_version 272762 (0.0011) [2023-12-26 01:46:21,204][123091] Updated weights for policy 0, policy_version 274265 (0.0011) [2023-12-26 01:46:21,268][123091] Updated weights for policy 0, policy_version 274275 (0.0011) [2023-12-26 01:46:21,343][123091] Updated weights for policy 0, policy_version 274285 (0.0010) [2023-12-26 01:46:21,505][123090] Updated weights for policy 1, policy_version 272772 (0.0010) [2023-12-26 01:46:21,568][123090] Updated weights for policy 1, policy_version 272782 (0.0009) [2023-12-26 01:46:21,633][123090] Updated weights for policy 1, policy_version 272792 (0.0009) [2023-12-26 01:46:22,131][123091] Updated weights for policy 0, policy_version 274295 (0.0006) [2023-12-26 01:46:22,192][123091] Updated weights for policy 0, policy_version 274305 (0.0009) [2023-12-26 01:46:22,265][123091] Updated weights for policy 0, policy_version 274315 (0.0013) [2023-12-26 01:46:22,524][123090] Updated weights for policy 1, policy_version 272802 (0.0009) [2023-12-26 01:46:22,586][123090] Updated weights for policy 1, policy_version 272812 (0.0009) [2023-12-26 01:46:22,652][123090] Updated weights for policy 1, policy_version 272822 (0.0009) [2023-12-26 01:46:22,712][123090] Updated weights for policy 1, policy_version 272832 (0.0009) [2023-12-26 01:46:22,975][123091] Updated weights for policy 0, policy_version 274325 (0.0008) [2023-12-26 01:46:23,027][123091] Updated weights for policy 0, policy_version 274335 (0.0009) [2023-12-26 01:46:23,093][123091] Updated weights for policy 0, policy_version 274345 (0.0010) [2023-12-26 01:46:23,543][123090] Updated weights for policy 1, policy_version 272842 (0.0010) [2023-12-26 01:46:23,595][123090] Updated weights for policy 1, policy_version 272852 (0.0009) [2023-12-26 01:46:23,647][123090] Updated weights for policy 1, policy_version 272862 (0.0010) [2023-12-26 01:46:23,778][123091] Updated weights for policy 0, policy_version 274355 (0.0009) [2023-12-26 01:46:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 140091392. Throughput: 0: 8966.3, 1: 8567.1. Samples: 140068628. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:23,785][121949] Avg episode reward: [(0, '5970.615'), (1, '5186.933')] [2023-12-26 01:46:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000272864_69853184.pth... [2023-12-26 01:46:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000271872_69599232.pth [2023-12-26 01:46:23,831][123091] Updated weights for policy 0, policy_version 274365 (0.0009) [2023-12-26 01:46:23,884][123091] Updated weights for policy 0, policy_version 274375 (0.0009) [2023-12-26 01:46:23,940][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000274384_70246400.pth... [2023-12-26 01:46:23,945][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000273328_69976064.pth [2023-12-26 01:46:24,524][123090] Updated weights for policy 1, policy_version 272872 (0.0009) [2023-12-26 01:46:24,573][123090] Updated weights for policy 1, policy_version 272882 (0.0005) [2023-12-26 01:46:24,619][123090] Updated weights for policy 1, policy_version 272892 (0.0005) [2023-12-26 01:46:24,670][123091] Updated weights for policy 0, policy_version 274385 (0.0009) [2023-12-26 01:46:24,728][123091] Updated weights for policy 0, policy_version 274395 (0.0010) [2023-12-26 01:46:24,785][123091] Updated weights for policy 0, policy_version 274405 (0.0010) [2023-12-26 01:46:24,830][123091] Updated weights for policy 0, policy_version 274415 (0.0007) [2023-12-26 01:46:25,449][123090] Updated weights for policy 1, policy_version 272902 (0.0005) [2023-12-26 01:46:25,511][123090] Updated weights for policy 1, policy_version 272912 (0.0007) [2023-12-26 01:46:25,549][123091] Updated weights for policy 0, policy_version 274425 (0.0005) [2023-12-26 01:46:25,567][123090] Updated weights for policy 1, policy_version 272922 (0.0009) [2023-12-26 01:46:25,600][123091] Updated weights for policy 0, policy_version 274435 (0.0005) [2023-12-26 01:46:25,663][123091] Updated weights for policy 0, policy_version 274445 (0.0005) [2023-12-26 01:46:26,320][123091] Updated weights for policy 0, policy_version 274455 (0.0005) [2023-12-26 01:46:26,330][123090] Updated weights for policy 1, policy_version 272932 (0.0008) [2023-12-26 01:46:26,386][123091] Updated weights for policy 0, policy_version 274465 (0.0010) [2023-12-26 01:46:26,400][123090] Updated weights for policy 1, policy_version 272942 (0.0006) [2023-12-26 01:46:26,457][123091] Updated weights for policy 0, policy_version 274475 (0.0005) [2023-12-26 01:46:26,476][123090] Updated weights for policy 1, policy_version 272952 (0.0008) [2023-12-26 01:46:27,049][123091] Updated weights for policy 0, policy_version 274485 (0.0005) [2023-12-26 01:46:27,104][123091] Updated weights for policy 0, policy_version 274495 (0.0007) [2023-12-26 01:46:27,113][123090] Updated weights for policy 1, policy_version 272962 (0.0008) [2023-12-26 01:46:27,156][123091] Updated weights for policy 0, policy_version 274505 (0.0008) [2023-12-26 01:46:27,165][123090] Updated weights for policy 1, policy_version 272972 (0.0010) [2023-12-26 01:46:27,213][123090] Updated weights for policy 1, policy_version 272982 (0.0010) [2023-12-26 01:46:27,293][123090] Updated weights for policy 1, policy_version 272992 (0.0009) [2023-12-26 01:46:27,900][123091] Updated weights for policy 0, policy_version 274515 (0.0007) [2023-12-26 01:46:27,957][123091] Updated weights for policy 0, policy_version 274525 (0.0008) [2023-12-26 01:46:27,981][123090] Updated weights for policy 1, policy_version 273002 (0.0005) [2023-12-26 01:46:28,004][123091] Updated weights for policy 0, policy_version 274535 (0.0008) [2023-12-26 01:46:28,032][123090] Updated weights for policy 1, policy_version 273012 (0.0005) [2023-12-26 01:46:28,085][123090] Updated weights for policy 1, policy_version 273022 (0.0005) [2023-12-26 01:46:28,757][123091] Updated weights for policy 0, policy_version 274545 (0.0009) [2023-12-26 01:46:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 140181504. Throughput: 0: 9060.9, 1: 8622.5. Samples: 140179372. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:28,784][121949] Avg episode reward: [(0, '5978.370'), (1, '5433.366')] [2023-12-26 01:46:28,802][123090] Updated weights for policy 1, policy_version 273032 (0.0007) [2023-12-26 01:46:28,811][123091] Updated weights for policy 0, policy_version 274555 (0.0007) [2023-12-26 01:46:28,863][123090] Updated weights for policy 1, policy_version 273042 (0.0005) [2023-12-26 01:46:28,873][123091] Updated weights for policy 0, policy_version 274565 (0.0008) [2023-12-26 01:46:28,927][123090] Updated weights for policy 1, policy_version 273052 (0.0006) [2023-12-26 01:46:28,937][123091] Updated weights for policy 0, policy_version 274575 (0.0009) [2023-12-26 01:46:29,656][123090] Updated weights for policy 1, policy_version 273062 (0.0006) [2023-12-26 01:46:29,718][123090] Updated weights for policy 1, policy_version 273072 (0.0006) [2023-12-26 01:46:29,733][123091] Updated weights for policy 0, policy_version 274585 (0.0006) [2023-12-26 01:46:29,782][123090] Updated weights for policy 1, policy_version 273082 (0.0006) [2023-12-26 01:46:29,797][123091] Updated weights for policy 0, policy_version 274595 (0.0009) [2023-12-26 01:46:29,861][123091] Updated weights for policy 0, policy_version 274605 (0.0009) [2023-12-26 01:46:30,531][123091] Updated weights for policy 0, policy_version 274615 (0.0006) [2023-12-26 01:46:30,561][123090] Updated weights for policy 1, policy_version 273092 (0.0006) [2023-12-26 01:46:30,590][123091] Updated weights for policy 0, policy_version 274625 (0.0005) [2023-12-26 01:46:30,611][123090] Updated weights for policy 1, policy_version 273102 (0.0007) [2023-12-26 01:46:30,649][123091] Updated weights for policy 0, policy_version 274635 (0.0005) [2023-12-26 01:46:30,660][123090] Updated weights for policy 1, policy_version 273112 (0.0010) [2023-12-26 01:46:31,408][123091] Updated weights for policy 0, policy_version 274645 (0.0008) [2023-12-26 01:46:31,476][123091] Updated weights for policy 0, policy_version 274655 (0.0007) [2023-12-26 01:46:31,507][123090] Updated weights for policy 1, policy_version 273122 (0.0009) [2023-12-26 01:46:31,529][123091] Updated weights for policy 0, policy_version 274665 (0.0009) [2023-12-26 01:46:31,558][123090] Updated weights for policy 1, policy_version 273132 (0.0007) [2023-12-26 01:46:31,614][123090] Updated weights for policy 1, policy_version 273142 (0.0010) [2023-12-26 01:46:31,669][123090] Updated weights for policy 1, policy_version 273152 (0.0008) [2023-12-26 01:46:32,303][123091] Updated weights for policy 0, policy_version 274675 (0.0007) [2023-12-26 01:46:32,379][123091] Updated weights for policy 0, policy_version 274685 (0.0006) [2023-12-26 01:46:32,451][123091] Updated weights for policy 0, policy_version 274695 (0.0008) [2023-12-26 01:46:32,548][123090] Updated weights for policy 1, policy_version 273162 (0.0011) [2023-12-26 01:46:32,605][123090] Updated weights for policy 1, policy_version 273172 (0.0009) [2023-12-26 01:46:32,674][123090] Updated weights for policy 1, policy_version 273182 (0.0006) [2023-12-26 01:46:33,267][123091] Updated weights for policy 0, policy_version 274705 (0.0008) [2023-12-26 01:46:33,330][123091] Updated weights for policy 0, policy_version 274715 (0.0011) [2023-12-26 01:46:33,347][123090] Updated weights for policy 1, policy_version 273192 (0.0005) [2023-12-26 01:46:33,378][123091] Updated weights for policy 0, policy_version 274725 (0.0010) [2023-12-26 01:46:33,412][123090] Updated weights for policy 1, policy_version 273202 (0.0005) [2023-12-26 01:46:33,432][123091] Updated weights for policy 0, policy_version 274735 (0.0010) [2023-12-26 01:46:33,477][123090] Updated weights for policy 1, policy_version 273212 (0.0005) [2023-12-26 01:46:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 140279808. Throughput: 0: 9087.0, 1: 8688.3. Samples: 140289600. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 01:46:33,785][121949] Avg episode reward: [(0, '6132.772'), (1, '5203.073')] [2023-12-26 01:46:34,060][123090] Updated weights for policy 1, policy_version 273222 (0.0005) [2023-12-26 01:46:34,082][123091] Updated weights for policy 0, policy_version 274745 (0.0006) [2023-12-26 01:46:34,113][123090] Updated weights for policy 1, policy_version 273232 (0.0006) [2023-12-26 01:46:34,144][123091] Updated weights for policy 0, policy_version 274755 (0.0009) [2023-12-26 01:46:34,180][123090] Updated weights for policy 1, policy_version 273242 (0.0009) [2023-12-26 01:46:34,214][123091] Updated weights for policy 0, policy_version 274765 (0.0010) [2023-12-26 01:46:34,891][123090] Updated weights for policy 1, policy_version 273252 (0.0011) [2023-12-26 01:46:34,965][123090] Updated weights for policy 1, policy_version 273262 (0.0011) [2023-12-26 01:46:35,028][123090] Updated weights for policy 1, policy_version 273272 (0.0010) [2023-12-26 01:46:35,046][123091] Updated weights for policy 0, policy_version 274775 (0.0008) [2023-12-26 01:46:35,101][123091] Updated weights for policy 0, policy_version 274785 (0.0011) [2023-12-26 01:46:35,163][123091] Updated weights for policy 0, policy_version 274795 (0.0011) [2023-12-26 01:46:35,791][123090] Updated weights for policy 1, policy_version 273282 (0.0010) [2023-12-26 01:46:35,853][123090] Updated weights for policy 1, policy_version 273292 (0.0009) [2023-12-26 01:46:35,913][123090] Updated weights for policy 1, policy_version 273302 (0.0008) [2023-12-26 01:46:35,970][123090] Updated weights for policy 1, policy_version 273312 (0.0008) [2023-12-26 01:46:35,975][123091] Updated weights for policy 0, policy_version 274805 (0.0010) [2023-12-26 01:46:36,040][123091] Updated weights for policy 0, policy_version 274815 (0.0007) [2023-12-26 01:46:36,119][123091] Updated weights for policy 0, policy_version 274825 (0.0006) [2023-12-26 01:46:36,786][123090] Updated weights for policy 1, policy_version 273322 (0.0009) [2023-12-26 01:46:36,841][123090] Updated weights for policy 1, policy_version 273332 (0.0009) [2023-12-26 01:46:36,894][123090] Updated weights for policy 1, policy_version 273342 (0.0009) [2023-12-26 01:46:36,909][123091] Updated weights for policy 0, policy_version 274835 (0.0009) [2023-12-26 01:46:36,970][123091] Updated weights for policy 0, policy_version 274845 (0.0010) [2023-12-26 01:46:37,037][123091] Updated weights for policy 0, policy_version 274855 (0.0006) [2023-12-26 01:46:37,764][123090] Updated weights for policy 1, policy_version 273352 (0.0008) [2023-12-26 01:46:37,826][123090] Updated weights for policy 1, policy_version 273362 (0.0009) [2023-12-26 01:46:37,829][123091] Updated weights for policy 0, policy_version 274865 (0.0010) [2023-12-26 01:46:37,889][123090] Updated weights for policy 1, policy_version 273372 (0.0008) [2023-12-26 01:46:37,889][123091] Updated weights for policy 0, policy_version 274875 (0.0010) [2023-12-26 01:46:37,950][123091] Updated weights for policy 0, policy_version 274885 (0.0011) [2023-12-26 01:46:38,000][123091] Updated weights for policy 0, policy_version 274895 (0.0010) [2023-12-26 01:46:38,728][123090] Updated weights for policy 1, policy_version 273382 (0.0009) [2023-12-26 01:46:38,780][123090] Updated weights for policy 1, policy_version 273392 (0.0008) [2023-12-26 01:46:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 140361728. Throughput: 0: 9092.8, 1: 8739.2. Samples: 140345488. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:46:38,785][121949] Avg episode reward: [(0, '6097.842'), (1, '5155.925')] [2023-12-26 01:46:38,810][123091] Updated weights for policy 0, policy_version 274905 (0.0009) [2023-12-26 01:46:38,836][123090] Updated weights for policy 1, policy_version 273402 (0.0009) [2023-12-26 01:46:38,865][123091] Updated weights for policy 0, policy_version 274915 (0.0010) [2023-12-26 01:46:38,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000273408_69992448.pth... [2023-12-26 01:46:38,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000272384_69730304.pth [2023-12-26 01:46:38,920][123091] Updated weights for policy 0, policy_version 274925 (0.0007) [2023-12-26 01:46:38,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000274928_70385664.pth... [2023-12-26 01:46:38,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000273840_70107136.pth [2023-12-26 01:46:39,669][123090] Updated weights for policy 1, policy_version 273412 (0.0009) [2023-12-26 01:46:39,693][123091] Updated weights for policy 0, policy_version 274935 (0.0006) [2023-12-26 01:46:39,734][123090] Updated weights for policy 1, policy_version 273422 (0.0011) [2023-12-26 01:46:39,755][123091] Updated weights for policy 0, policy_version 274945 (0.0007) [2023-12-26 01:46:39,801][123090] Updated weights for policy 1, policy_version 273432 (0.0008) [2023-12-26 01:46:39,814][123091] Updated weights for policy 0, policy_version 274955 (0.0007) [2023-12-26 01:46:40,543][123091] Updated weights for policy 0, policy_version 274965 (0.0007) [2023-12-26 01:46:40,597][123091] Updated weights for policy 0, policy_version 274975 (0.0005) [2023-12-26 01:46:40,664][123091] Updated weights for policy 0, policy_version 274985 (0.0005) [2023-12-26 01:46:40,721][123090] Updated weights for policy 1, policy_version 273442 (0.0009) [2023-12-26 01:46:40,775][123090] Updated weights for policy 1, policy_version 273452 (0.0009) [2023-12-26 01:46:40,827][123090] Updated weights for policy 1, policy_version 273462 (0.0010) [2023-12-26 01:46:40,881][123090] Updated weights for policy 1, policy_version 273472 (0.0005) [2023-12-26 01:46:41,333][123091] Updated weights for policy 0, policy_version 274995 (0.0007) [2023-12-26 01:46:41,402][123091] Updated weights for policy 0, policy_version 275005 (0.0013) [2023-12-26 01:46:41,471][123091] Updated weights for policy 0, policy_version 275015 (0.0011) [2023-12-26 01:46:41,728][123090] Updated weights for policy 1, policy_version 273482 (0.0011) [2023-12-26 01:46:41,792][123090] Updated weights for policy 1, policy_version 273492 (0.0011) [2023-12-26 01:46:41,856][123090] Updated weights for policy 1, policy_version 273502 (0.0010) [2023-12-26 01:46:42,319][123091] Updated weights for policy 0, policy_version 275025 (0.0010) [2023-12-26 01:46:42,389][123091] Updated weights for policy 0, policy_version 275035 (0.0008) [2023-12-26 01:46:42,455][123091] Updated weights for policy 0, policy_version 275045 (0.0008) [2023-12-26 01:46:42,513][123091] Updated weights for policy 0, policy_version 275055 (0.0008) [2023-12-26 01:46:42,655][123090] Updated weights for policy 1, policy_version 273512 (0.0010) [2023-12-26 01:46:42,708][123090] Updated weights for policy 1, policy_version 273522 (0.0008) [2023-12-26 01:46:42,762][123090] Updated weights for policy 1, policy_version 273533 (0.0010) [2023-12-26 01:46:43,284][123091] Updated weights for policy 0, policy_version 275065 (0.0009) [2023-12-26 01:46:43,351][123091] Updated weights for policy 0, policy_version 275075 (0.0010) [2023-12-26 01:46:43,412][123091] Updated weights for policy 0, policy_version 275085 (0.0010) [2023-12-26 01:46:43,518][123090] Updated weights for policy 1, policy_version 273543 (0.0008) [2023-12-26 01:46:43,567][123090] Updated weights for policy 1, policy_version 273553 (0.0005) [2023-12-26 01:46:43,615][123090] Updated weights for policy 1, policy_version 273563 (0.0005) [2023-12-26 01:46:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 140460032. Throughput: 0: 9113.8, 1: 8636.6. Samples: 140449096. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:46:43,785][121949] Avg episode reward: [(0, '6058.000'), (1, '5434.955')] [2023-12-26 01:46:44,226][123091] Updated weights for policy 0, policy_version 275096 (0.0007) [2023-12-26 01:46:44,258][123090] Updated weights for policy 1, policy_version 273573 (0.0006) [2023-12-26 01:46:44,281][123091] Updated weights for policy 0, policy_version 275106 (0.0005) [2023-12-26 01:46:44,314][123090] Updated weights for policy 1, policy_version 273583 (0.0011) [2023-12-26 01:46:44,330][123091] Updated weights for policy 0, policy_version 275116 (0.0005) [2023-12-26 01:46:44,373][123090] Updated weights for policy 1, policy_version 273593 (0.0010) [2023-12-26 01:46:45,116][123091] Updated weights for policy 0, policy_version 275126 (0.0007) [2023-12-26 01:46:45,155][123090] Updated weights for policy 1, policy_version 273603 (0.0011) [2023-12-26 01:46:45,180][123091] Updated weights for policy 0, policy_version 275136 (0.0009) [2023-12-26 01:46:45,217][123090] Updated weights for policy 1, policy_version 273613 (0.0011) [2023-12-26 01:46:45,247][123091] Updated weights for policy 0, policy_version 275146 (0.0010) [2023-12-26 01:46:45,270][123090] Updated weights for policy 1, policy_version 273623 (0.0011) [2023-12-26 01:46:46,060][123090] Updated weights for policy 1, policy_version 273633 (0.0010) [2023-12-26 01:46:46,065][123091] Updated weights for policy 0, policy_version 275156 (0.0009) [2023-12-26 01:46:46,131][123091] Updated weights for policy 0, policy_version 275166 (0.0006) [2023-12-26 01:46:46,134][123090] Updated weights for policy 1, policy_version 273643 (0.0006) [2023-12-26 01:46:46,183][123091] Updated weights for policy 0, policy_version 275176 (0.0010) [2023-12-26 01:46:46,191][123090] Updated weights for policy 1, policy_version 273653 (0.0007) [2023-12-26 01:46:46,249][123090] Updated weights for policy 1, policy_version 273663 (0.0005) [2023-12-26 01:46:46,940][123091] Updated weights for policy 0, policy_version 275186 (0.0010) [2023-12-26 01:46:46,991][123091] Updated weights for policy 0, policy_version 275196 (0.0010) [2023-12-26 01:46:47,024][123090] Updated weights for policy 1, policy_version 273673 (0.0007) [2023-12-26 01:46:47,042][123091] Updated weights for policy 0, policy_version 275206 (0.0010) [2023-12-26 01:46:47,087][123090] Updated weights for policy 1, policy_version 273683 (0.0006) [2023-12-26 01:46:47,097][123091] Updated weights for policy 0, policy_version 275216 (0.0010) [2023-12-26 01:46:47,152][123090] Updated weights for policy 1, policy_version 273693 (0.0008) [2023-12-26 01:46:47,924][123091] Updated weights for policy 0, policy_version 275226 (0.0005) [2023-12-26 01:46:47,944][123090] Updated weights for policy 1, policy_version 273703 (0.0009) [2023-12-26 01:46:47,976][123091] Updated weights for policy 0, policy_version 275236 (0.0005) [2023-12-26 01:46:48,005][123090] Updated weights for policy 1, policy_version 273713 (0.0008) [2023-12-26 01:46:48,040][123091] Updated weights for policy 0, policy_version 275246 (0.0006) [2023-12-26 01:46:48,070][123090] Updated weights for policy 1, policy_version 273723 (0.0010) [2023-12-26 01:46:48,774][123091] Updated weights for policy 0, policy_version 275256 (0.0005) [2023-12-26 01:46:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 140541952. Throughput: 0: 9172.1, 1: 8735.4. Samples: 140558064. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:46:48,784][121949] Avg episode reward: [(0, '6065.347'), (1, '5454.913')] [2023-12-26 01:46:48,835][123091] Updated weights for policy 0, policy_version 275266 (0.0006) [2023-12-26 01:46:48,884][123091] Updated weights for policy 0, policy_version 275276 (0.0009) [2023-12-26 01:46:48,957][123090] Updated weights for policy 1, policy_version 273734 (0.0009) [2023-12-26 01:46:49,025][123090] Updated weights for policy 1, policy_version 273744 (0.0009) [2023-12-26 01:46:49,085][123090] Updated weights for policy 1, policy_version 273754 (0.0009) [2023-12-26 01:46:49,659][123091] Updated weights for policy 0, policy_version 275286 (0.0007) [2023-12-26 01:46:49,730][123091] Updated weights for policy 0, policy_version 275296 (0.0007) [2023-12-26 01:46:49,804][123091] Updated weights for policy 0, policy_version 275306 (0.0008) [2023-12-26 01:46:49,968][123090] Updated weights for policy 1, policy_version 273764 (0.0010) [2023-12-26 01:46:50,034][123090] Updated weights for policy 1, policy_version 273774 (0.0009) [2023-12-26 01:46:50,098][123090] Updated weights for policy 1, policy_version 273784 (0.0009) [2023-12-26 01:46:50,571][123091] Updated weights for policy 0, policy_version 275316 (0.0008) [2023-12-26 01:46:50,638][123091] Updated weights for policy 0, policy_version 275326 (0.0010) [2023-12-26 01:46:50,696][123091] Updated weights for policy 0, policy_version 275336 (0.0007) [2023-12-26 01:46:50,948][123090] Updated weights for policy 1, policy_version 273794 (0.0008) [2023-12-26 01:46:51,014][123090] Updated weights for policy 1, policy_version 273804 (0.0009) [2023-12-26 01:46:51,082][123090] Updated weights for policy 1, policy_version 273814 (0.0009) [2023-12-26 01:46:51,144][123090] Updated weights for policy 1, policy_version 273824 (0.0010) [2023-12-26 01:46:51,396][123091] Updated weights for policy 0, policy_version 275346 (0.0005) [2023-12-26 01:46:51,461][123091] Updated weights for policy 0, policy_version 275356 (0.0006) [2023-12-26 01:46:51,534][123091] Updated weights for policy 0, policy_version 275366 (0.0006) [2023-12-26 01:46:51,598][123091] Updated weights for policy 0, policy_version 275376 (0.0009) [2023-12-26 01:46:52,067][123090] Updated weights for policy 1, policy_version 273834 (0.0010) [2023-12-26 01:46:52,126][123090] Updated weights for policy 1, policy_version 273845 (0.0010) [2023-12-26 01:46:52,196][123090] Updated weights for policy 1, policy_version 273855 (0.0009) [2023-12-26 01:46:52,395][123091] Updated weights for policy 0, policy_version 275386 (0.0007) [2023-12-26 01:46:52,446][123091] Updated weights for policy 0, policy_version 275396 (0.0009) [2023-12-26 01:46:52,500][123091] Updated weights for policy 0, policy_version 275406 (0.0009) [2023-12-26 01:46:53,052][123090] Updated weights for policy 1, policy_version 273865 (0.0010) [2023-12-26 01:46:53,118][123090] Updated weights for policy 1, policy_version 273875 (0.0010) [2023-12-26 01:46:53,176][123090] Updated weights for policy 1, policy_version 273885 (0.0009) [2023-12-26 01:46:53,232][123091] Updated weights for policy 0, policy_version 275416 (0.0006) [2023-12-26 01:46:53,291][123091] Updated weights for policy 0, policy_version 275426 (0.0005) [2023-12-26 01:46:53,337][123091] Updated weights for policy 0, policy_version 275436 (0.0005) [2023-12-26 01:46:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 140632064. Throughput: 0: 9189.8, 1: 8685.9. Samples: 140609524. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:46:53,785][121949] Avg episode reward: [(0, '6026.347'), (1, '5558.386')] [2023-12-26 01:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000275440_70516736.pth... [2023-12-26 01:46:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000273888_70115328.pth... [2023-12-26 01:46:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000272864_69853184.pth [2023-12-26 01:46:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000274384_70246400.pth [2023-12-26 01:46:53,989][123091] Updated weights for policy 0, policy_version 275446 (0.0008) [2023-12-26 01:46:54,051][123091] Updated weights for policy 0, policy_version 275456 (0.0009) [2023-12-26 01:46:54,093][123090] Updated weights for policy 1, policy_version 273895 (0.0009) [2023-12-26 01:46:54,102][123091] Updated weights for policy 0, policy_version 275466 (0.0007) [2023-12-26 01:46:54,144][123090] Updated weights for policy 1, policy_version 273905 (0.0010) [2023-12-26 01:46:54,202][123090] Updated weights for policy 1, policy_version 273915 (0.0009) [2023-12-26 01:46:54,851][123091] Updated weights for policy 0, policy_version 275476 (0.0007) [2023-12-26 01:46:54,907][123091] Updated weights for policy 0, policy_version 275486 (0.0008) [2023-12-26 01:46:54,931][123090] Updated weights for policy 1, policy_version 273925 (0.0007) [2023-12-26 01:46:54,979][123091] Updated weights for policy 0, policy_version 275496 (0.0006) [2023-12-26 01:46:54,999][123090] Updated weights for policy 1, policy_version 273935 (0.0006) [2023-12-26 01:46:55,066][123090] Updated weights for policy 1, policy_version 273945 (0.0005) [2023-12-26 01:46:55,737][123091] Updated weights for policy 0, policy_version 275506 (0.0007) [2023-12-26 01:46:55,750][123090] Updated weights for policy 1, policy_version 273955 (0.0007) [2023-12-26 01:46:55,794][123091] Updated weights for policy 0, policy_version 275516 (0.0009) [2023-12-26 01:46:55,804][123090] Updated weights for policy 1, policy_version 273965 (0.0005) [2023-12-26 01:46:55,842][123091] Updated weights for policy 0, policy_version 275526 (0.0008) [2023-12-26 01:46:55,863][123090] Updated weights for policy 1, policy_version 273975 (0.0005) [2023-12-26 01:46:55,892][123091] Updated weights for policy 0, policy_version 275536 (0.0009) [2023-12-26 01:46:56,494][123090] Updated weights for policy 1, policy_version 273985 (0.0005) [2023-12-26 01:46:56,538][123090] Updated weights for policy 1, policy_version 273995 (0.0005) [2023-12-26 01:46:56,595][123090] Updated weights for policy 1, policy_version 274005 (0.0005) [2023-12-26 01:46:56,647][123090] Updated weights for policy 1, policy_version 274015 (0.0005) [2023-12-26 01:46:56,703][123091] Updated weights for policy 0, policy_version 275546 (0.0009) [2023-12-26 01:46:56,763][123091] Updated weights for policy 0, policy_version 275556 (0.0010) [2023-12-26 01:46:56,818][123091] Updated weights for policy 0, policy_version 275566 (0.0010) [2023-12-26 01:46:57,251][123090] Updated weights for policy 1, policy_version 274025 (0.0005) [2023-12-26 01:46:57,299][123090] Updated weights for policy 1, policy_version 274035 (0.0005) [2023-12-26 01:46:57,346][123090] Updated weights for policy 1, policy_version 274045 (0.0008) [2023-12-26 01:46:57,653][123091] Updated weights for policy 0, policy_version 275576 (0.0006) [2023-12-26 01:46:57,719][123091] Updated weights for policy 0, policy_version 275586 (0.0006) [2023-12-26 01:46:57,775][123091] Updated weights for policy 0, policy_version 275596 (0.0010) [2023-12-26 01:46:58,112][123090] Updated weights for policy 1, policy_version 274055 (0.0008) [2023-12-26 01:46:58,181][123090] Updated weights for policy 1, policy_version 274065 (0.0008) [2023-12-26 01:46:58,235][123090] Updated weights for policy 1, policy_version 274075 (0.0006) [2023-12-26 01:46:58,602][123091] Updated weights for policy 0, policy_version 275606 (0.0009) [2023-12-26 01:46:58,669][123091] Updated weights for policy 0, policy_version 275616 (0.0008) [2023-12-26 01:46:58,735][123091] Updated weights for policy 0, policy_version 275626 (0.0006) [2023-12-26 01:46:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 140730368. Throughput: 0: 9313.2, 1: 8762.5. Samples: 140721472. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:46:58,785][121949] Avg episode reward: [(0, '6047.761'), (1, '5374.362')] [2023-12-26 01:46:59,030][123090] Updated weights for policy 1, policy_version 274085 (0.0008) [2023-12-26 01:46:59,095][123090] Updated weights for policy 1, policy_version 274095 (0.0009) [2023-12-26 01:46:59,147][123090] Updated weights for policy 1, policy_version 274105 (0.0008) [2023-12-26 01:46:59,541][123091] Updated weights for policy 0, policy_version 275636 (0.0008) [2023-12-26 01:46:59,590][123091] Updated weights for policy 0, policy_version 275646 (0.0005) [2023-12-26 01:46:59,646][123091] Updated weights for policy 0, policy_version 275656 (0.0005) [2023-12-26 01:46:59,952][123090] Updated weights for policy 1, policy_version 274115 (0.0009) [2023-12-26 01:47:00,015][123090] Updated weights for policy 1, policy_version 274125 (0.0007) [2023-12-26 01:47:00,074][123090] Updated weights for policy 1, policy_version 274135 (0.0007) [2023-12-26 01:47:00,441][123091] Updated weights for policy 0, policy_version 275666 (0.0006) [2023-12-26 01:47:00,494][123091] Updated weights for policy 0, policy_version 275676 (0.0009) [2023-12-26 01:47:00,561][123091] Updated weights for policy 0, policy_version 275686 (0.0009) [2023-12-26 01:47:00,617][123091] Updated weights for policy 0, policy_version 275696 (0.0009) [2023-12-26 01:47:00,839][123090] Updated weights for policy 1, policy_version 274145 (0.0008) [2023-12-26 01:47:00,894][123090] Updated weights for policy 1, policy_version 274155 (0.0005) [2023-12-26 01:47:00,942][123090] Updated weights for policy 1, policy_version 274165 (0.0005) [2023-12-26 01:47:00,999][123090] Updated weights for policy 1, policy_version 274175 (0.0005) [2023-12-26 01:47:01,526][123091] Updated weights for policy 0, policy_version 275706 (0.0009) [2023-12-26 01:47:01,579][123091] Updated weights for policy 0, policy_version 275716 (0.0008) [2023-12-26 01:47:01,648][123091] Updated weights for policy 0, policy_version 275726 (0.0009) [2023-12-26 01:47:01,724][123090] Updated weights for policy 1, policy_version 274185 (0.0010) [2023-12-26 01:47:01,795][123090] Updated weights for policy 1, policy_version 274195 (0.0010) [2023-12-26 01:47:01,866][123090] Updated weights for policy 1, policy_version 274205 (0.0011) [2023-12-26 01:47:02,378][123091] Updated weights for policy 0, policy_version 275736 (0.0009) [2023-12-26 01:47:02,440][123091] Updated weights for policy 0, policy_version 275746 (0.0009) [2023-12-26 01:47:02,502][123091] Updated weights for policy 0, policy_version 275756 (0.0010) [2023-12-26 01:47:02,718][123090] Updated weights for policy 1, policy_version 274215 (0.0009) [2023-12-26 01:47:02,778][123090] Updated weights for policy 1, policy_version 274225 (0.0009) [2023-12-26 01:47:02,834][123090] Updated weights for policy 1, policy_version 274235 (0.0009) [2023-12-26 01:47:03,373][123091] Updated weights for policy 0, policy_version 275766 (0.0009) [2023-12-26 01:47:03,429][123091] Updated weights for policy 0, policy_version 275776 (0.0009) [2023-12-26 01:47:03,489][123091] Updated weights for policy 0, policy_version 275786 (0.0010) [2023-12-26 01:47:03,557][123090] Updated weights for policy 1, policy_version 274245 (0.0009) [2023-12-26 01:47:03,616][123090] Updated weights for policy 1, policy_version 274255 (0.0009) [2023-12-26 01:47:03,668][123090] Updated weights for policy 1, policy_version 274265 (0.0010) [2023-12-26 01:47:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 140820480. Throughput: 0: 9129.2, 1: 8915.0. Samples: 140827944. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:03,785][121949] Avg episode reward: [(0, '6082.112'), (1, '5135.651')] [2023-12-26 01:47:04,374][123091] Updated weights for policy 0, policy_version 275796 (0.0009) [2023-12-26 01:47:04,441][123091] Updated weights for policy 0, policy_version 275806 (0.0009) [2023-12-26 01:47:04,466][123090] Updated weights for policy 1, policy_version 274275 (0.0008) [2023-12-26 01:47:04,503][123091] Updated weights for policy 0, policy_version 275816 (0.0009) [2023-12-26 01:47:04,519][123090] Updated weights for policy 1, policy_version 274285 (0.0008) [2023-12-26 01:47:04,580][123090] Updated weights for policy 1, policy_version 274295 (0.0008) [2023-12-26 01:47:05,321][123091] Updated weights for policy 0, policy_version 275826 (0.0010) [2023-12-26 01:47:05,369][123091] Updated weights for policy 0, policy_version 275836 (0.0009) [2023-12-26 01:47:05,417][123090] Updated weights for policy 1, policy_version 274305 (0.0009) [2023-12-26 01:47:05,419][123091] Updated weights for policy 0, policy_version 275846 (0.0009) [2023-12-26 01:47:05,472][123091] Updated weights for policy 0, policy_version 275856 (0.0008) [2023-12-26 01:47:05,475][123090] Updated weights for policy 1, policy_version 274315 (0.0007) [2023-12-26 01:47:05,536][123090] Updated weights for policy 1, policy_version 274325 (0.0009) [2023-12-26 01:47:05,595][123090] Updated weights for policy 1, policy_version 274335 (0.0009) [2023-12-26 01:47:06,350][123091] Updated weights for policy 0, policy_version 275866 (0.0010) [2023-12-26 01:47:06,408][123091] Updated weights for policy 0, policy_version 275876 (0.0009) [2023-12-26 01:47:06,416][123090] Updated weights for policy 1, policy_version 274345 (0.0006) [2023-12-26 01:47:06,469][123091] Updated weights for policy 0, policy_version 275886 (0.0009) [2023-12-26 01:47:06,489][123090] Updated weights for policy 1, policy_version 274355 (0.0006) [2023-12-26 01:47:06,541][123090] Updated weights for policy 1, policy_version 274365 (0.0009) [2023-12-26 01:47:07,266][123091] Updated weights for policy 0, policy_version 275896 (0.0009) [2023-12-26 01:47:07,312][123091] Updated weights for policy 0, policy_version 275906 (0.0007) [2023-12-26 01:47:07,320][123090] Updated weights for policy 1, policy_version 274375 (0.0009) [2023-12-26 01:47:07,364][123091] Updated weights for policy 0, policy_version 275916 (0.0009) [2023-12-26 01:47:07,387][123090] Updated weights for policy 1, policy_version 274385 (0.0008) [2023-12-26 01:47:07,449][123090] Updated weights for policy 1, policy_version 274395 (0.0009) [2023-12-26 01:47:08,233][123091] Updated weights for policy 0, policy_version 275926 (0.0008) [2023-12-26 01:47:08,259][123090] Updated weights for policy 1, policy_version 274405 (0.0008) [2023-12-26 01:47:08,297][123091] Updated weights for policy 0, policy_version 275936 (0.0009) [2023-12-26 01:47:08,327][123090] Updated weights for policy 1, policy_version 274415 (0.0008) [2023-12-26 01:47:08,361][123091] Updated weights for policy 0, policy_version 275946 (0.0008) [2023-12-26 01:47:08,390][123090] Updated weights for policy 1, policy_version 274425 (0.0009) [2023-12-26 01:47:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17886.1, 300 sec: 17800.2). Total num frames: 140902400. Throughput: 0: 9066.8, 1: 8949.4. Samples: 140879356. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:08,785][121949] Avg episode reward: [(0, '6084.229'), (1, '4977.497')] [2023-12-26 01:47:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000275952_70647808.pth... [2023-12-26 01:47:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000274432_70254592.pth... [2023-12-26 01:47:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000274928_70385664.pth [2023-12-26 01:47:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000273408_69992448.pth [2023-12-26 01:47:09,206][123091] Updated weights for policy 0, policy_version 275956 (0.0010) [2023-12-26 01:47:09,228][123090] Updated weights for policy 1, policy_version 274435 (0.0009) [2023-12-26 01:47:09,275][123091] Updated weights for policy 0, policy_version 275966 (0.0009) [2023-12-26 01:47:09,300][123090] Updated weights for policy 1, policy_version 274445 (0.0008) [2023-12-26 01:47:09,338][123091] Updated weights for policy 0, policy_version 275976 (0.0008) [2023-12-26 01:47:09,365][123090] Updated weights for policy 1, policy_version 274455 (0.0009) [2023-12-26 01:47:10,234][123091] Updated weights for policy 0, policy_version 275986 (0.0008) [2023-12-26 01:47:10,259][123090] Updated weights for policy 1, policy_version 274465 (0.0009) [2023-12-26 01:47:10,283][123091] Updated weights for policy 0, policy_version 275996 (0.0010) [2023-12-26 01:47:10,316][123090] Updated weights for policy 1, policy_version 274475 (0.0009) [2023-12-26 01:47:10,349][123091] Updated weights for policy 0, policy_version 276006 (0.0008) [2023-12-26 01:47:10,383][123090] Updated weights for policy 1, policy_version 274485 (0.0009) [2023-12-26 01:47:10,416][123091] Updated weights for policy 0, policy_version 276016 (0.0008) [2023-12-26 01:47:10,454][123090] Updated weights for policy 1, policy_version 274495 (0.0010) [2023-12-26 01:47:11,250][123090] Updated weights for policy 1, policy_version 274505 (0.0011) [2023-12-26 01:47:11,282][123091] Updated weights for policy 0, policy_version 276026 (0.0008) [2023-12-26 01:47:11,315][123090] Updated weights for policy 1, policy_version 274515 (0.0011) [2023-12-26 01:47:11,336][123091] Updated weights for policy 0, policy_version 276036 (0.0006) [2023-12-26 01:47:11,385][123090] Updated weights for policy 1, policy_version 274525 (0.0010) [2023-12-26 01:47:11,407][123091] Updated weights for policy 0, policy_version 276046 (0.0008) [2023-12-26 01:47:12,170][123090] Updated weights for policy 1, policy_version 274535 (0.0009) [2023-12-26 01:47:12,196][123091] Updated weights for policy 0, policy_version 276056 (0.0009) [2023-12-26 01:47:12,237][123090] Updated weights for policy 1, policy_version 274545 (0.0009) [2023-12-26 01:47:12,260][123091] Updated weights for policy 0, policy_version 276066 (0.0008) [2023-12-26 01:47:12,301][123090] Updated weights for policy 1, policy_version 274555 (0.0009) [2023-12-26 01:47:12,328][123091] Updated weights for policy 0, policy_version 276076 (0.0008) [2023-12-26 01:47:13,064][123090] Updated weights for policy 1, policy_version 274565 (0.0007) [2023-12-26 01:47:13,067][123091] Updated weights for policy 0, policy_version 276086 (0.0009) [2023-12-26 01:47:13,117][123090] Updated weights for policy 1, policy_version 274575 (0.0005) [2023-12-26 01:47:13,138][123091] Updated weights for policy 0, policy_version 276096 (0.0007) [2023-12-26 01:47:13,175][123090] Updated weights for policy 1, policy_version 274585 (0.0007) [2023-12-26 01:47:13,182][123091] Updated weights for policy 0, policy_version 276106 (0.0006) [2023-12-26 01:47:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 140984320. Throughput: 0: 8906.8, 1: 8905.5. Samples: 140980928. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:13,785][121949] Avg episode reward: [(0, '6131.428'), (1, '5216.805')] [2023-12-26 01:47:13,858][123090] Updated weights for policy 1, policy_version 274595 (0.0007) [2023-12-26 01:47:13,919][123090] Updated weights for policy 1, policy_version 274605 (0.0005) [2023-12-26 01:47:13,969][123091] Updated weights for policy 0, policy_version 276116 (0.0007) [2023-12-26 01:47:13,983][123090] Updated weights for policy 1, policy_version 274615 (0.0007) [2023-12-26 01:47:14,055][123091] Updated weights for policy 0, policy_version 276126 (0.0010) [2023-12-26 01:47:14,120][123091] Updated weights for policy 0, policy_version 276136 (0.0010) [2023-12-26 01:47:14,764][123090] Updated weights for policy 1, policy_version 274625 (0.0007) [2023-12-26 01:47:14,837][123090] Updated weights for policy 1, policy_version 274635 (0.0010) [2023-12-26 01:47:14,905][123090] Updated weights for policy 1, policy_version 274645 (0.0010) [2023-12-26 01:47:14,919][123091] Updated weights for policy 0, policy_version 276146 (0.0009) [2023-12-26 01:47:14,972][123090] Updated weights for policy 1, policy_version 274655 (0.0009) [2023-12-26 01:47:14,976][123091] Updated weights for policy 0, policy_version 276156 (0.0009) [2023-12-26 01:47:15,037][123091] Updated weights for policy 0, policy_version 276166 (0.0010) [2023-12-26 01:47:15,100][123091] Updated weights for policy 0, policy_version 276176 (0.0010) [2023-12-26 01:47:15,747][123090] Updated weights for policy 1, policy_version 274665 (0.0007) [2023-12-26 01:47:15,815][123090] Updated weights for policy 1, policy_version 274675 (0.0005) [2023-12-26 01:47:15,880][123090] Updated weights for policy 1, policy_version 274685 (0.0006) [2023-12-26 01:47:15,986][123091] Updated weights for policy 0, policy_version 276186 (0.0010) [2023-12-26 01:47:16,036][123091] Updated weights for policy 0, policy_version 276196 (0.0008) [2023-12-26 01:47:16,087][123091] Updated weights for policy 0, policy_version 276206 (0.0010) [2023-12-26 01:47:16,487][123090] Updated weights for policy 1, policy_version 274695 (0.0009) [2023-12-26 01:47:16,550][123090] Updated weights for policy 1, policy_version 274705 (0.0010) [2023-12-26 01:47:16,615][123090] Updated weights for policy 1, policy_version 274715 (0.0010) [2023-12-26 01:47:16,947][123091] Updated weights for policy 0, policy_version 276216 (0.0010) [2023-12-26 01:47:16,999][123091] Updated weights for policy 0, policy_version 276226 (0.0009) [2023-12-26 01:47:17,056][123091] Updated weights for policy 0, policy_version 276236 (0.0010) [2023-12-26 01:47:17,298][123090] Updated weights for policy 1, policy_version 274725 (0.0008) [2023-12-26 01:47:17,371][123090] Updated weights for policy 1, policy_version 274735 (0.0005) [2023-12-26 01:47:17,437][123090] Updated weights for policy 1, policy_version 274745 (0.0005) [2023-12-26 01:47:17,955][123091] Updated weights for policy 0, policy_version 276246 (0.0010) [2023-12-26 01:47:18,023][123091] Updated weights for policy 0, policy_version 276256 (0.0010) [2023-12-26 01:47:18,075][123091] Updated weights for policy 0, policy_version 276266 (0.0010) [2023-12-26 01:47:18,174][123090] Updated weights for policy 1, policy_version 274755 (0.0007) [2023-12-26 01:47:18,226][123090] Updated weights for policy 1, policy_version 274765 (0.0009) [2023-12-26 01:47:18,278][123090] Updated weights for policy 1, policy_version 274775 (0.0009) [2023-12-26 01:47:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 141074432. Throughput: 0: 8816.2, 1: 8928.6. Samples: 141088116. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:18,785][121949] Avg episode reward: [(0, '6107.542'), (1, '5245.069')] [2023-12-26 01:47:18,942][123091] Updated weights for policy 0, policy_version 276276 (0.0010) [2023-12-26 01:47:19,007][123091] Updated weights for policy 0, policy_version 276286 (0.0009) [2023-12-26 01:47:19,071][123091] Updated weights for policy 0, policy_version 276296 (0.0008) [2023-12-26 01:47:19,109][123090] Updated weights for policy 1, policy_version 274785 (0.0008) [2023-12-26 01:47:19,167][123090] Updated weights for policy 1, policy_version 274795 (0.0009) [2023-12-26 01:47:19,226][123090] Updated weights for policy 1, policy_version 274805 (0.0009) [2023-12-26 01:47:19,298][123090] Updated weights for policy 1, policy_version 274815 (0.0006) [2023-12-26 01:47:19,931][123091] Updated weights for policy 0, policy_version 276306 (0.0008) [2023-12-26 01:47:20,002][123091] Updated weights for policy 0, policy_version 276316 (0.0009) [2023-12-26 01:47:20,070][123091] Updated weights for policy 0, policy_version 276326 (0.0011) [2023-12-26 01:47:20,140][123090] Updated weights for policy 1, policy_version 274825 (0.0009) [2023-12-26 01:47:20,213][123090] Updated weights for policy 1, policy_version 274835 (0.0009) [2023-12-26 01:47:20,271][123090] Updated weights for policy 1, policy_version 274845 (0.0007) [2023-12-26 01:47:20,898][123091] Updated weights for policy 0, policy_version 276337 (0.0009) [2023-12-26 01:47:20,965][123091] Updated weights for policy 0, policy_version 276347 (0.0008) [2023-12-26 01:47:20,967][123090] Updated weights for policy 1, policy_version 274855 (0.0011) [2023-12-26 01:47:21,033][123091] Updated weights for policy 0, policy_version 276357 (0.0007) [2023-12-26 01:47:21,045][123090] Updated weights for policy 1, policy_version 274865 (0.0011) [2023-12-26 01:47:21,100][123091] Updated weights for policy 0, policy_version 276367 (0.0007) [2023-12-26 01:47:21,115][123090] Updated weights for policy 1, policy_version 274875 (0.0010) [2023-12-26 01:47:21,874][123091] Updated weights for policy 0, policy_version 276377 (0.0008) [2023-12-26 01:47:21,921][123091] Updated weights for policy 0, policy_version 276387 (0.0009) [2023-12-26 01:47:21,974][123091] Updated weights for policy 0, policy_version 276397 (0.0009) [2023-12-26 01:47:21,997][123090] Updated weights for policy 1, policy_version 274885 (0.0008) [2023-12-26 01:47:22,065][123090] Updated weights for policy 1, policy_version 274895 (0.0010) [2023-12-26 01:47:22,124][123090] Updated weights for policy 1, policy_version 274905 (0.0009) [2023-12-26 01:47:22,806][123091] Updated weights for policy 0, policy_version 276407 (0.0011) [2023-12-26 01:47:22,859][123091] Updated weights for policy 0, policy_version 276417 (0.0010) [2023-12-26 01:47:22,913][123091] Updated weights for policy 0, policy_version 276427 (0.0009) [2023-12-26 01:47:22,952][123090] Updated weights for policy 1, policy_version 274915 (0.0009) [2023-12-26 01:47:23,020][123090] Updated weights for policy 1, policy_version 274925 (0.0009) [2023-12-26 01:47:23,091][123090] Updated weights for policy 1, policy_version 274935 (0.0009) [2023-12-26 01:47:23,663][123091] Updated weights for policy 0, policy_version 276437 (0.0007) [2023-12-26 01:47:23,722][123091] Updated weights for policy 0, policy_version 276447 (0.0006) [2023-12-26 01:47:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 141156352. Throughput: 0: 8766.8, 1: 8870.2. Samples: 141139156. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:23,785][121949] Avg episode reward: [(0, '5961.701'), (1, '5192.718')] [2023-12-26 01:47:23,789][123091] Updated weights for policy 0, policy_version 276457 (0.0009) [2023-12-26 01:47:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000274944_70385664.pth... [2023-12-26 01:47:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000273888_70115328.pth [2023-12-26 01:47:23,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000276464_70778880.pth... [2023-12-26 01:47:23,830][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000275440_70516736.pth [2023-12-26 01:47:23,938][123090] Updated weights for policy 1, policy_version 274945 (0.0009) [2023-12-26 01:47:24,008][123090] Updated weights for policy 1, policy_version 274955 (0.0006) [2023-12-26 01:47:24,069][123090] Updated weights for policy 1, policy_version 274965 (0.0007) [2023-12-26 01:47:24,129][123090] Updated weights for policy 1, policy_version 274975 (0.0008) [2023-12-26 01:47:24,578][123091] Updated weights for policy 0, policy_version 276467 (0.0008) [2023-12-26 01:47:24,628][123091] Updated weights for policy 0, policy_version 276477 (0.0008) [2023-12-26 01:47:24,685][123091] Updated weights for policy 0, policy_version 276487 (0.0009) [2023-12-26 01:47:24,938][123090] Updated weights for policy 1, policy_version 274986 (0.0011) [2023-12-26 01:47:24,985][123090] Updated weights for policy 1, policy_version 274996 (0.0005) [2023-12-26 01:47:25,039][123090] Updated weights for policy 1, policy_version 275006 (0.0005) [2023-12-26 01:47:25,514][123091] Updated weights for policy 0, policy_version 276498 (0.0010) [2023-12-26 01:47:25,560][123091] Updated weights for policy 0, policy_version 276508 (0.0010) [2023-12-26 01:47:25,608][123091] Updated weights for policy 0, policy_version 276518 (0.0010) [2023-12-26 01:47:25,651][123091] Updated weights for policy 0, policy_version 276528 (0.0010) [2023-12-26 01:47:25,812][123090] Updated weights for policy 1, policy_version 275016 (0.0005) [2023-12-26 01:47:25,870][123090] Updated weights for policy 1, policy_version 275026 (0.0006) [2023-12-26 01:47:25,940][123090] Updated weights for policy 1, policy_version 275036 (0.0005) [2023-12-26 01:47:26,513][123091] Updated weights for policy 0, policy_version 276538 (0.0011) [2023-12-26 01:47:26,581][123091] Updated weights for policy 0, policy_version 276548 (0.0011) [2023-12-26 01:47:26,612][123090] Updated weights for policy 1, policy_version 275046 (0.0006) [2023-12-26 01:47:26,637][123091] Updated weights for policy 0, policy_version 276558 (0.0011) [2023-12-26 01:47:26,673][123090] Updated weights for policy 1, policy_version 275056 (0.0006) [2023-12-26 01:47:26,732][123090] Updated weights for policy 1, policy_version 275066 (0.0008) [2023-12-26 01:47:27,425][123091] Updated weights for policy 0, policy_version 276568 (0.0006) [2023-12-26 01:47:27,473][123091] Updated weights for policy 0, policy_version 276578 (0.0010) [2023-12-26 01:47:27,497][123090] Updated weights for policy 1, policy_version 275076 (0.0008) [2023-12-26 01:47:27,534][123091] Updated weights for policy 0, policy_version 276588 (0.0010) [2023-12-26 01:47:27,549][123090] Updated weights for policy 1, policy_version 275086 (0.0008) [2023-12-26 01:47:27,597][123090] Updated weights for policy 1, policy_version 275096 (0.0008) [2023-12-26 01:47:28,354][123091] Updated weights for policy 0, policy_version 276598 (0.0010) [2023-12-26 01:47:28,414][123091] Updated weights for policy 0, policy_version 276608 (0.0011) [2023-12-26 01:47:28,445][123090] Updated weights for policy 1, policy_version 275106 (0.0008) [2023-12-26 01:47:28,478][123091] Updated weights for policy 0, policy_version 276618 (0.0005) [2023-12-26 01:47:28,502][123090] Updated weights for policy 1, policy_version 275116 (0.0006) [2023-12-26 01:47:28,549][123090] Updated weights for policy 1, policy_version 275126 (0.0005) [2023-12-26 01:47:28,600][123090] Updated weights for policy 1, policy_version 275136 (0.0005) [2023-12-26 01:47:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 141254656. Throughput: 0: 8751.8, 1: 8948.3. Samples: 141245604. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:28,785][121949] Avg episode reward: [(0, '5942.951'), (1, '5358.755')] [2023-12-26 01:47:29,215][123090] Updated weights for policy 1, policy_version 275146 (0.0009) [2023-12-26 01:47:29,237][123091] Updated weights for policy 0, policy_version 276628 (0.0008) [2023-12-26 01:47:29,281][123090] Updated weights for policy 1, policy_version 275156 (0.0006) [2023-12-26 01:47:29,303][123091] Updated weights for policy 0, policy_version 276638 (0.0011) [2023-12-26 01:47:29,353][123090] Updated weights for policy 1, policy_version 275166 (0.0007) [2023-12-26 01:47:29,372][123091] Updated weights for policy 0, policy_version 276648 (0.0011) [2023-12-26 01:47:30,181][123091] Updated weights for policy 0, policy_version 276658 (0.0010) [2023-12-26 01:47:30,196][123090] Updated weights for policy 1, policy_version 275176 (0.0007) [2023-12-26 01:47:30,247][123091] Updated weights for policy 0, policy_version 276668 (0.0009) [2023-12-26 01:47:30,255][123090] Updated weights for policy 1, policy_version 275186 (0.0009) [2023-12-26 01:47:30,304][123091] Updated weights for policy 0, policy_version 276678 (0.0009) [2023-12-26 01:47:30,317][123090] Updated weights for policy 1, policy_version 275196 (0.0007) [2023-12-26 01:47:30,369][123091] Updated weights for policy 0, policy_version 276688 (0.0008) [2023-12-26 01:47:31,099][123091] Updated weights for policy 0, policy_version 276698 (0.0008) [2023-12-26 01:47:31,141][123090] Updated weights for policy 1, policy_version 275206 (0.0008) [2023-12-26 01:47:31,164][123091] Updated weights for policy 0, policy_version 276708 (0.0008) [2023-12-26 01:47:31,201][123090] Updated weights for policy 1, policy_version 275216 (0.0007) [2023-12-26 01:47:31,215][123091] Updated weights for policy 0, policy_version 276718 (0.0008) [2023-12-26 01:47:31,268][123090] Updated weights for policy 1, policy_version 275226 (0.0007) [2023-12-26 01:47:32,040][123091] Updated weights for policy 0, policy_version 276728 (0.0010) [2023-12-26 01:47:32,098][123090] Updated weights for policy 1, policy_version 275236 (0.0008) [2023-12-26 01:47:32,107][123091] Updated weights for policy 0, policy_version 276738 (0.0009) [2023-12-26 01:47:32,165][123090] Updated weights for policy 1, policy_version 275246 (0.0005) [2023-12-26 01:47:32,168][123091] Updated weights for policy 0, policy_version 276748 (0.0009) [2023-12-26 01:47:32,228][123090] Updated weights for policy 1, policy_version 275256 (0.0006) [2023-12-26 01:47:32,862][123091] Updated weights for policy 0, policy_version 276758 (0.0007) [2023-12-26 01:47:32,916][123091] Updated weights for policy 0, policy_version 276768 (0.0007) [2023-12-26 01:47:32,953][123090] Updated weights for policy 1, policy_version 275266 (0.0007) [2023-12-26 01:47:32,974][123091] Updated weights for policy 0, policy_version 276778 (0.0008) [2023-12-26 01:47:33,030][123090] Updated weights for policy 1, policy_version 275276 (0.0005) [2023-12-26 01:47:33,101][123090] Updated weights for policy 1, policy_version 275286 (0.0005) [2023-12-26 01:47:33,176][123090] Updated weights for policy 1, policy_version 275296 (0.0006) [2023-12-26 01:47:33,746][123091] Updated weights for policy 0, policy_version 276788 (0.0007) [2023-12-26 01:47:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 141336576. Throughput: 0: 8741.9, 1: 8945.0. Samples: 141353972. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:33,784][121949] Avg episode reward: [(0, '5948.673'), (1, '5282.916')] [2023-12-26 01:47:33,803][123091] Updated weights for policy 0, policy_version 276798 (0.0010) [2023-12-26 01:47:33,866][123091] Updated weights for policy 0, policy_version 276808 (0.0010) [2023-12-26 01:47:33,885][123090] Updated weights for policy 1, policy_version 275306 (0.0010) [2023-12-26 01:47:33,932][123090] Updated weights for policy 1, policy_version 275316 (0.0010) [2023-12-26 01:47:33,983][123090] Updated weights for policy 1, policy_version 275326 (0.0010) [2023-12-26 01:47:34,661][123091] Updated weights for policy 0, policy_version 276818 (0.0007) [2023-12-26 01:47:34,722][123091] Updated weights for policy 0, policy_version 276828 (0.0006) [2023-12-26 01:47:34,784][123090] Updated weights for policy 1, policy_version 275336 (0.0010) [2023-12-26 01:47:34,789][123091] Updated weights for policy 0, policy_version 276838 (0.0008) [2023-12-26 01:47:34,835][123090] Updated weights for policy 1, policy_version 275346 (0.0010) [2023-12-26 01:47:34,851][123091] Updated weights for policy 0, policy_version 276848 (0.0011) [2023-12-26 01:47:34,886][123090] Updated weights for policy 1, policy_version 275356 (0.0010) [2023-12-26 01:47:35,634][123091] Updated weights for policy 0, policy_version 276858 (0.0011) [2023-12-26 01:47:35,694][123091] Updated weights for policy 0, policy_version 276868 (0.0011) [2023-12-26 01:47:35,728][123090] Updated weights for policy 1, policy_version 275366 (0.0010) [2023-12-26 01:47:35,746][123091] Updated weights for policy 0, policy_version 276878 (0.0011) [2023-12-26 01:47:35,800][123090] Updated weights for policy 1, policy_version 275376 (0.0011) [2023-12-26 01:47:35,872][123090] Updated weights for policy 1, policy_version 275386 (0.0011) [2023-12-26 01:47:36,533][123091] Updated weights for policy 0, policy_version 276888 (0.0006) [2023-12-26 01:47:36,601][123091] Updated weights for policy 0, policy_version 276898 (0.0005) [2023-12-26 01:47:36,660][123091] Updated weights for policy 0, policy_version 276908 (0.0006) [2023-12-26 01:47:36,663][123090] Updated weights for policy 1, policy_version 275396 (0.0011) [2023-12-26 01:47:36,723][123090] Updated weights for policy 1, policy_version 275406 (0.0011) [2023-12-26 01:47:36,788][123090] Updated weights for policy 1, policy_version 275416 (0.0011) [2023-12-26 01:47:37,442][123091] Updated weights for policy 0, policy_version 276918 (0.0009) [2023-12-26 01:47:37,500][123091] Updated weights for policy 0, policy_version 276928 (0.0011) [2023-12-26 01:47:37,573][123091] Updated weights for policy 0, policy_version 276938 (0.0011) [2023-12-26 01:47:37,591][123090] Updated weights for policy 1, policy_version 275426 (0.0010) [2023-12-26 01:47:37,641][123090] Updated weights for policy 1, policy_version 275436 (0.0005) [2023-12-26 01:47:37,703][123090] Updated weights for policy 1, policy_version 275446 (0.0005) [2023-12-26 01:47:37,772][123090] Updated weights for policy 1, policy_version 275456 (0.0005) [2023-12-26 01:47:38,280][123091] Updated weights for policy 0, policy_version 276948 (0.0008) [2023-12-26 01:47:38,352][123091] Updated weights for policy 0, policy_version 276958 (0.0007) [2023-12-26 01:47:38,415][123091] Updated weights for policy 0, policy_version 276968 (0.0006) [2023-12-26 01:47:38,460][123090] Updated weights for policy 1, policy_version 275466 (0.0006) [2023-12-26 01:47:38,526][123090] Updated weights for policy 1, policy_version 275476 (0.0005) [2023-12-26 01:47:38,584][123090] Updated weights for policy 1, policy_version 275486 (0.0005) [2023-12-26 01:47:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 141434880. Throughput: 0: 8731.7, 1: 8994.5. Samples: 141407204. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:38,785][121949] Avg episode reward: [(0, '6018.750'), (1, '5124.926')] [2023-12-26 01:47:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000275488_70524928.pth... [2023-12-26 01:47:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000276976_70909952.pth... [2023-12-26 01:47:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000274432_70254592.pth [2023-12-26 01:47:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000275952_70647808.pth [2023-12-26 01:47:39,212][123091] Updated weights for policy 0, policy_version 276978 (0.0006) [2023-12-26 01:47:39,279][123091] Updated weights for policy 0, policy_version 276988 (0.0009) [2023-12-26 01:47:39,335][123091] Updated weights for policy 0, policy_version 276998 (0.0008) [2023-12-26 01:47:39,352][123090] Updated weights for policy 1, policy_version 275496 (0.0008) [2023-12-26 01:47:39,414][123091] Updated weights for policy 0, policy_version 277008 (0.0008) [2023-12-26 01:47:39,416][123090] Updated weights for policy 1, policy_version 275506 (0.0009) [2023-12-26 01:47:39,479][123090] Updated weights for policy 1, policy_version 275516 (0.0009) [2023-12-26 01:47:40,231][123091] Updated weights for policy 0, policy_version 277018 (0.0010) [2023-12-26 01:47:40,298][123091] Updated weights for policy 0, policy_version 277028 (0.0009) [2023-12-26 01:47:40,300][123090] Updated weights for policy 1, policy_version 275526 (0.0009) [2023-12-26 01:47:40,365][123091] Updated weights for policy 0, policy_version 277038 (0.0010) [2023-12-26 01:47:40,366][123090] Updated weights for policy 1, policy_version 275536 (0.0007) [2023-12-26 01:47:40,436][123090] Updated weights for policy 1, policy_version 275546 (0.0005) [2023-12-26 01:47:41,064][123090] Updated weights for policy 1, policy_version 275556 (0.0006) [2023-12-26 01:47:41,140][123090] Updated weights for policy 1, policy_version 275566 (0.0009) [2023-12-26 01:47:41,214][123090] Updated weights for policy 1, policy_version 275576 (0.0008) [2023-12-26 01:47:41,237][123091] Updated weights for policy 0, policy_version 277048 (0.0009) [2023-12-26 01:47:41,310][123091] Updated weights for policy 0, policy_version 277058 (0.0010) [2023-12-26 01:47:41,374][123091] Updated weights for policy 0, policy_version 277068 (0.0008) [2023-12-26 01:47:42,075][123090] Updated weights for policy 1, policy_version 275586 (0.0008) [2023-12-26 01:47:42,131][123090] Updated weights for policy 1, policy_version 275596 (0.0009) [2023-12-26 01:47:42,194][123090] Updated weights for policy 1, policy_version 275606 (0.0009) [2023-12-26 01:47:42,219][123091] Updated weights for policy 0, policy_version 277078 (0.0008) [2023-12-26 01:47:42,255][123090] Updated weights for policy 1, policy_version 275616 (0.0009) [2023-12-26 01:47:42,290][123091] Updated weights for policy 0, policy_version 277088 (0.0007) [2023-12-26 01:47:42,361][123091] Updated weights for policy 0, policy_version 277098 (0.0009) [2023-12-26 01:47:43,050][123091] Updated weights for policy 0, policy_version 277108 (0.0009) [2023-12-26 01:47:43,061][123090] Updated weights for policy 1, policy_version 275626 (0.0006) [2023-12-26 01:47:43,113][123091] Updated weights for policy 0, policy_version 277118 (0.0011) [2023-12-26 01:47:43,120][123090] Updated weights for policy 1, policy_version 275636 (0.0005) [2023-12-26 01:47:43,171][123091] Updated weights for policy 0, policy_version 277128 (0.0011) [2023-12-26 01:47:43,183][123090] Updated weights for policy 1, policy_version 275646 (0.0007) [2023-12-26 01:47:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 141516800. Throughput: 0: 8647.5, 1: 8946.9. Samples: 141513224. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:43,785][121949] Avg episode reward: [(0, '6004.824'), (1, '5267.522')] [2023-12-26 01:47:43,846][123091] Updated weights for policy 0, policy_version 277138 (0.0009) [2023-12-26 01:47:43,900][123091] Updated weights for policy 0, policy_version 277148 (0.0005) [2023-12-26 01:47:43,944][123090] Updated weights for policy 1, policy_version 275656 (0.0006) [2023-12-26 01:47:43,955][123091] Updated weights for policy 0, policy_version 277158 (0.0005) [2023-12-26 01:47:44,009][123090] Updated weights for policy 1, policy_version 275666 (0.0005) [2023-12-26 01:47:44,015][123091] Updated weights for policy 0, policy_version 277168 (0.0005) [2023-12-26 01:47:44,066][123090] Updated weights for policy 1, policy_version 275676 (0.0005) [2023-12-26 01:47:44,642][123091] Updated weights for policy 0, policy_version 277178 (0.0005) [2023-12-26 01:47:44,682][123090] Updated weights for policy 1, policy_version 275686 (0.0006) [2023-12-26 01:47:44,689][123091] Updated weights for policy 0, policy_version 277188 (0.0005) [2023-12-26 01:47:44,737][123091] Updated weights for policy 0, policy_version 277198 (0.0005) [2023-12-26 01:47:44,747][123090] Updated weights for policy 1, policy_version 275696 (0.0005) [2023-12-26 01:47:44,819][123090] Updated weights for policy 1, policy_version 275706 (0.0007) [2023-12-26 01:47:45,480][123091] Updated weights for policy 0, policy_version 277208 (0.0006) [2023-12-26 01:47:45,539][123091] Updated weights for policy 0, policy_version 277218 (0.0006) [2023-12-26 01:47:45,596][123090] Updated weights for policy 1, policy_version 275716 (0.0008) [2023-12-26 01:47:45,600][123091] Updated weights for policy 0, policy_version 277228 (0.0008) [2023-12-26 01:47:45,649][123090] Updated weights for policy 1, policy_version 275726 (0.0009) [2023-12-26 01:47:45,709][123090] Updated weights for policy 1, policy_version 275736 (0.0009) [2023-12-26 01:47:46,324][123091] Updated weights for policy 0, policy_version 277238 (0.0005) [2023-12-26 01:47:46,374][123091] Updated weights for policy 0, policy_version 277248 (0.0006) [2023-12-26 01:47:46,435][123091] Updated weights for policy 0, policy_version 277258 (0.0006) [2023-12-26 01:47:46,556][123090] Updated weights for policy 1, policy_version 275746 (0.0008) [2023-12-26 01:47:46,623][123090] Updated weights for policy 1, policy_version 275756 (0.0009) [2023-12-26 01:47:46,686][123090] Updated weights for policy 1, policy_version 275766 (0.0010) [2023-12-26 01:47:46,748][123090] Updated weights for policy 1, policy_version 275776 (0.0007) [2023-12-26 01:47:47,144][123091] Updated weights for policy 0, policy_version 277268 (0.0007) [2023-12-26 01:47:47,206][123091] Updated weights for policy 0, policy_version 277278 (0.0005) [2023-12-26 01:47:47,270][123091] Updated weights for policy 0, policy_version 277288 (0.0005) [2023-12-26 01:47:47,475][123090] Updated weights for policy 1, policy_version 275786 (0.0006) [2023-12-26 01:47:47,541][123090] Updated weights for policy 1, policy_version 275796 (0.0005) [2023-12-26 01:47:47,610][123090] Updated weights for policy 1, policy_version 275806 (0.0005) [2023-12-26 01:47:47,921][123091] Updated weights for policy 0, policy_version 277298 (0.0006) [2023-12-26 01:47:47,986][123091] Updated weights for policy 0, policy_version 277308 (0.0005) [2023-12-26 01:47:48,056][123091] Updated weights for policy 0, policy_version 277318 (0.0007) [2023-12-26 01:47:48,120][123091] Updated weights for policy 0, policy_version 277328 (0.0008) [2023-12-26 01:47:48,300][123090] Updated weights for policy 1, policy_version 275816 (0.0009) [2023-12-26 01:47:48,366][123090] Updated weights for policy 1, policy_version 275826 (0.0011) [2023-12-26 01:47:48,430][123090] Updated weights for policy 1, policy_version 275836 (0.0007) [2023-12-26 01:47:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 141615104. Throughput: 0: 8828.4, 1: 8965.2. Samples: 141628652. Policy #0 lag: (min: 1.0, avg: 17.7, max: 33.0) [2023-12-26 01:47:48,784][121949] Avg episode reward: [(0, '6164.780'), (1, '5395.589')] [2023-12-26 01:47:48,859][123091] Updated weights for policy 0, policy_version 277338 (0.0010) [2023-12-26 01:47:48,918][123091] Updated weights for policy 0, policy_version 277349 (0.0011) [2023-12-26 01:47:48,977][123091] Updated weights for policy 0, policy_version 277359 (0.0010) [2023-12-26 01:47:49,139][123090] Updated weights for policy 1, policy_version 275846 (0.0007) [2023-12-26 01:47:49,187][123090] Updated weights for policy 1, policy_version 275856 (0.0005) [2023-12-26 01:47:49,242][123090] Updated weights for policy 1, policy_version 275866 (0.0007) [2023-12-26 01:47:49,877][123091] Updated weights for policy 0, policy_version 277369 (0.0009) [2023-12-26 01:47:49,947][123091] Updated weights for policy 0, policy_version 277379 (0.0010) [2023-12-26 01:47:50,000][123091] Updated weights for policy 0, policy_version 277389 (0.0009) [2023-12-26 01:47:50,048][123090] Updated weights for policy 1, policy_version 275876 (0.0010) [2023-12-26 01:47:50,110][123090] Updated weights for policy 1, policy_version 275886 (0.0008) [2023-12-26 01:47:50,175][123090] Updated weights for policy 1, policy_version 275896 (0.0006) [2023-12-26 01:47:50,895][123091] Updated weights for policy 0, policy_version 277399 (0.0009) [2023-12-26 01:47:50,948][123091] Updated weights for policy 0, policy_version 277409 (0.0009) [2023-12-26 01:47:50,984][123090] Updated weights for policy 1, policy_version 275906 (0.0009) [2023-12-26 01:47:50,999][123091] Updated weights for policy 0, policy_version 277419 (0.0008) [2023-12-26 01:47:51,046][123090] Updated weights for policy 1, policy_version 275916 (0.0008) [2023-12-26 01:47:51,101][123090] Updated weights for policy 1, policy_version 275926 (0.0009) [2023-12-26 01:47:51,155][123090] Updated weights for policy 1, policy_version 275936 (0.0009) [2023-12-26 01:47:51,844][123091] Updated weights for policy 0, policy_version 277429 (0.0009) [2023-12-26 01:47:51,894][123091] Updated weights for policy 0, policy_version 277439 (0.0010) [2023-12-26 01:47:51,946][123091] Updated weights for policy 0, policy_version 277449 (0.0010) [2023-12-26 01:47:52,034][123090] Updated weights for policy 1, policy_version 275946 (0.0009) [2023-12-26 01:47:52,113][123090] Updated weights for policy 1, policy_version 275956 (0.0008) [2023-12-26 01:47:52,183][123090] Updated weights for policy 1, policy_version 275966 (0.0005) [2023-12-26 01:47:52,857][123091] Updated weights for policy 0, policy_version 277459 (0.0008) [2023-12-26 01:47:52,889][123090] Updated weights for policy 1, policy_version 275976 (0.0008) [2023-12-26 01:47:52,919][123091] Updated weights for policy 0, policy_version 277469 (0.0008) [2023-12-26 01:47:52,948][123090] Updated weights for policy 1, policy_version 275986 (0.0007) [2023-12-26 01:47:52,980][123091] Updated weights for policy 0, policy_version 277479 (0.0010) [2023-12-26 01:47:53,008][123090] Updated weights for policy 1, policy_version 275996 (0.0008) [2023-12-26 01:47:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 141697024. Throughput: 0: 8813.3, 1: 8980.2. Samples: 141680068. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:47:53,785][121949] Avg episode reward: [(0, '6152.953'), (1, '5327.311')] [2023-12-26 01:47:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000277488_71041024.pth... [2023-12-26 01:47:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000276464_70778880.pth [2023-12-26 01:47:53,797][123090] Updated weights for policy 1, policy_version 276006 (0.0008) [2023-12-26 01:47:53,816][123091] Updated weights for policy 0, policy_version 277489 (0.0008) [2023-12-26 01:47:53,862][123090] Updated weights for policy 1, policy_version 276016 (0.0008) [2023-12-26 01:47:53,878][123091] Updated weights for policy 0, policy_version 277499 (0.0009) [2023-12-26 01:47:53,926][123090] Updated weights for policy 1, policy_version 276026 (0.0006) [2023-12-26 01:47:53,936][123091] Updated weights for policy 0, policy_version 277509 (0.0010) [2023-12-26 01:47:53,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000276032_70664192.pth... [2023-12-26 01:47:53,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000274944_70385664.pth [2023-12-26 01:47:53,992][123091] Updated weights for policy 0, policy_version 277519 (0.0009) [2023-12-26 01:47:54,698][123090] Updated weights for policy 1, policy_version 276036 (0.0009) [2023-12-26 01:47:54,749][123090] Updated weights for policy 1, policy_version 276046 (0.0009) [2023-12-26 01:47:54,810][123090] Updated weights for policy 1, policy_version 276056 (0.0006) [2023-12-26 01:47:54,852][123091] Updated weights for policy 0, policy_version 277529 (0.0009) [2023-12-26 01:47:54,905][123091] Updated weights for policy 0, policy_version 277540 (0.0009) [2023-12-26 01:47:54,961][123091] Updated weights for policy 0, policy_version 277550 (0.0010) [2023-12-26 01:47:55,588][123090] Updated weights for policy 1, policy_version 276066 (0.0006) [2023-12-26 01:47:55,636][123090] Updated weights for policy 1, policy_version 276076 (0.0005) [2023-12-26 01:47:55,687][123090] Updated weights for policy 1, policy_version 276086 (0.0008) [2023-12-26 01:47:55,738][123090] Updated weights for policy 1, policy_version 276096 (0.0010) [2023-12-26 01:47:55,831][123091] Updated weights for policy 0, policy_version 277560 (0.0009) [2023-12-26 01:47:55,882][123091] Updated weights for policy 0, policy_version 277570 (0.0009) [2023-12-26 01:47:55,950][123091] Updated weights for policy 0, policy_version 277580 (0.0010) [2023-12-26 01:47:56,518][123090] Updated weights for policy 1, policy_version 276106 (0.0010) [2023-12-26 01:47:56,572][123090] Updated weights for policy 1, policy_version 276116 (0.0009) [2023-12-26 01:47:56,625][123090] Updated weights for policy 1, policy_version 276126 (0.0009) [2023-12-26 01:47:56,682][123091] Updated weights for policy 0, policy_version 277591 (0.0007) [2023-12-26 01:47:56,749][123091] Updated weights for policy 0, policy_version 277601 (0.0008) [2023-12-26 01:47:56,804][123091] Updated weights for policy 0, policy_version 277611 (0.0010) [2023-12-26 01:47:57,453][123090] Updated weights for policy 1, policy_version 276136 (0.0010) [2023-12-26 01:47:57,500][123090] Updated weights for policy 1, policy_version 276146 (0.0008) [2023-12-26 01:47:57,558][123090] Updated weights for policy 1, policy_version 276156 (0.0008) [2023-12-26 01:47:57,658][123091] Updated weights for policy 0, policy_version 277621 (0.0009) [2023-12-26 01:47:57,727][123091] Updated weights for policy 0, policy_version 277631 (0.0008) [2023-12-26 01:47:57,788][123091] Updated weights for policy 0, policy_version 277641 (0.0007) [2023-12-26 01:47:58,351][123090] Updated weights for policy 1, policy_version 276166 (0.0009) [2023-12-26 01:47:58,421][123090] Updated weights for policy 1, policy_version 276176 (0.0008) [2023-12-26 01:47:58,486][123090] Updated weights for policy 1, policy_version 276186 (0.0007) [2023-12-26 01:47:58,694][123091] Updated weights for policy 0, policy_version 277651 (0.0010) [2023-12-26 01:47:58,769][123091] Updated weights for policy 0, policy_version 277662 (0.0013) [2023-12-26 01:47:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 141787136. Throughput: 0: 8814.4, 1: 9040.4. Samples: 141784396. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:47:58,785][121949] Avg episode reward: [(0, '6116.835'), (1, '5227.173')] [2023-12-26 01:47:58,829][123091] Updated weights for policy 0, policy_version 277672 (0.0008) [2023-12-26 01:47:59,254][123090] Updated weights for policy 1, policy_version 276196 (0.0007) [2023-12-26 01:47:59,322][123090] Updated weights for policy 1, policy_version 276206 (0.0008) [2023-12-26 01:47:59,392][123090] Updated weights for policy 1, policy_version 276216 (0.0009) [2023-12-26 01:47:59,650][123091] Updated weights for policy 0, policy_version 277682 (0.0006) [2023-12-26 01:47:59,711][123091] Updated weights for policy 0, policy_version 277692 (0.0006) [2023-12-26 01:47:59,773][123091] Updated weights for policy 0, policy_version 277702 (0.0009) [2023-12-26 01:47:59,831][123091] Updated weights for policy 0, policy_version 277712 (0.0009) [2023-12-26 01:48:00,180][123090] Updated weights for policy 1, policy_version 276226 (0.0010) [2023-12-26 01:48:00,241][123090] Updated weights for policy 1, policy_version 276236 (0.0007) [2023-12-26 01:48:00,314][123090] Updated weights for policy 1, policy_version 276246 (0.0006) [2023-12-26 01:48:00,373][123090] Updated weights for policy 1, policy_version 276256 (0.0006) [2023-12-26 01:48:00,680][123091] Updated weights for policy 0, policy_version 277722 (0.0009) [2023-12-26 01:48:00,736][123091] Updated weights for policy 0, policy_version 277732 (0.0010) [2023-12-26 01:48:00,794][123091] Updated weights for policy 0, policy_version 277742 (0.0010) [2023-12-26 01:48:01,000][123090] Updated weights for policy 1, policy_version 276266 (0.0005) [2023-12-26 01:48:01,068][123090] Updated weights for policy 1, policy_version 276276 (0.0006) [2023-12-26 01:48:01,135][123090] Updated weights for policy 1, policy_version 276286 (0.0009) [2023-12-26 01:48:01,639][123091] Updated weights for policy 0, policy_version 277752 (0.0010) [2023-12-26 01:48:01,701][123091] Updated weights for policy 0, policy_version 277762 (0.0009) [2023-12-26 01:48:01,765][123091] Updated weights for policy 0, policy_version 277772 (0.0014) [2023-12-26 01:48:01,938][123090] Updated weights for policy 1, policy_version 276296 (0.0006) [2023-12-26 01:48:02,005][123090] Updated weights for policy 1, policy_version 276306 (0.0006) [2023-12-26 01:48:02,064][123090] Updated weights for policy 1, policy_version 276316 (0.0005) [2023-12-26 01:48:02,652][123091] Updated weights for policy 0, policy_version 277782 (0.0010) [2023-12-26 01:48:02,705][123091] Updated weights for policy 0, policy_version 277792 (0.0010) [2023-12-26 01:48:02,747][123090] Updated weights for policy 1, policy_version 276326 (0.0006) [2023-12-26 01:48:02,771][123091] Updated weights for policy 0, policy_version 277802 (0.0009) [2023-12-26 01:48:02,810][123090] Updated weights for policy 1, policy_version 276336 (0.0005) [2023-12-26 01:48:02,875][123090] Updated weights for policy 1, policy_version 276346 (0.0006) [2023-12-26 01:48:03,584][123090] Updated weights for policy 1, policy_version 276356 (0.0008) [2023-12-26 01:48:03,649][123090] Updated weights for policy 1, policy_version 276366 (0.0009) [2023-12-26 01:48:03,656][123091] Updated weights for policy 0, policy_version 277812 (0.0008) [2023-12-26 01:48:03,708][123090] Updated weights for policy 1, policy_version 276376 (0.0009) [2023-12-26 01:48:03,717][123091] Updated weights for policy 0, policy_version 277822 (0.0008) [2023-12-26 01:48:03,782][123091] Updated weights for policy 0, policy_version 277832 (0.0009) [2023-12-26 01:48:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 141877248. Throughput: 0: 8784.2, 1: 9017.7. Samples: 141889200. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:03,785][121949] Avg episode reward: [(0, '6051.694'), (1, '5017.837')] [2023-12-26 01:48:04,507][123090] Updated weights for policy 1, policy_version 276386 (0.0009) [2023-12-26 01:48:04,570][123090] Updated weights for policy 1, policy_version 276396 (0.0009) [2023-12-26 01:48:04,631][123091] Updated weights for policy 0, policy_version 277842 (0.0009) [2023-12-26 01:48:04,638][123090] Updated weights for policy 1, policy_version 276406 (0.0008) [2023-12-26 01:48:04,687][123091] Updated weights for policy 0, policy_version 277852 (0.0011) [2023-12-26 01:48:04,702][123090] Updated weights for policy 1, policy_version 276416 (0.0006) [2023-12-26 01:48:04,742][123091] Updated weights for policy 0, policy_version 277862 (0.0010) [2023-12-26 01:48:04,808][123091] Updated weights for policy 0, policy_version 277872 (0.0010) [2023-12-26 01:48:05,428][123091] Updated weights for policy 0, policy_version 277882 (0.0005) [2023-12-26 01:48:05,441][123090] Updated weights for policy 1, policy_version 276426 (0.0005) [2023-12-26 01:48:05,481][123091] Updated weights for policy 0, policy_version 277892 (0.0010) [2023-12-26 01:48:05,498][123090] Updated weights for policy 1, policy_version 276436 (0.0005) [2023-12-26 01:48:05,540][123091] Updated weights for policy 0, policy_version 277902 (0.0011) [2023-12-26 01:48:05,553][123090] Updated weights for policy 1, policy_version 276446 (0.0005) [2023-12-26 01:48:06,242][123090] Updated weights for policy 1, policy_version 276456 (0.0010) [2023-12-26 01:48:06,310][123090] Updated weights for policy 1, policy_version 276466 (0.0011) [2023-12-26 01:48:06,315][123091] Updated weights for policy 0, policy_version 277912 (0.0010) [2023-12-26 01:48:06,378][123090] Updated weights for policy 1, policy_version 276476 (0.0011) [2023-12-26 01:48:06,382][123091] Updated weights for policy 0, policy_version 277922 (0.0011) [2023-12-26 01:48:06,450][123091] Updated weights for policy 0, policy_version 277932 (0.0011) [2023-12-26 01:48:07,192][123090] Updated weights for policy 1, policy_version 276486 (0.0009) [2023-12-26 01:48:07,230][123091] Updated weights for policy 0, policy_version 277942 (0.0010) [2023-12-26 01:48:07,260][123090] Updated weights for policy 1, policy_version 276496 (0.0005) [2023-12-26 01:48:07,295][123091] Updated weights for policy 0, policy_version 277952 (0.0008) [2023-12-26 01:48:07,324][123090] Updated weights for policy 1, policy_version 276506 (0.0005) [2023-12-26 01:48:07,363][123091] Updated weights for policy 0, policy_version 277962 (0.0006) [2023-12-26 01:48:08,032][123091] Updated weights for policy 0, policy_version 277972 (0.0005) [2023-12-26 01:48:08,082][123090] Updated weights for policy 1, policy_version 276516 (0.0007) [2023-12-26 01:48:08,093][123091] Updated weights for policy 0, policy_version 277982 (0.0005) [2023-12-26 01:48:08,146][123090] Updated weights for policy 1, policy_version 276526 (0.0011) [2023-12-26 01:48:08,152][123091] Updated weights for policy 0, policy_version 277992 (0.0010) [2023-12-26 01:48:08,205][123090] Updated weights for policy 1, policy_version 276536 (0.0010) [2023-12-26 01:48:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 141967360. Throughput: 0: 8832.4, 1: 9058.7. Samples: 141944260. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:08,785][121949] Avg episode reward: [(0, '5977.699'), (1, '4933.246')] [2023-12-26 01:48:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000278000_71172096.pth... [2023-12-26 01:48:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000276544_70795264.pth... [2023-12-26 01:48:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000275488_70524928.pth [2023-12-26 01:48:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000276976_70909952.pth [2023-12-26 01:48:08,933][123091] Updated weights for policy 0, policy_version 278002 (0.0010) [2023-12-26 01:48:08,989][123091] Updated weights for policy 0, policy_version 278012 (0.0010) [2023-12-26 01:48:08,994][123090] Updated weights for policy 1, policy_version 276546 (0.0010) [2023-12-26 01:48:09,047][123091] Updated weights for policy 0, policy_version 278022 (0.0009) [2023-12-26 01:48:09,060][123090] Updated weights for policy 1, policy_version 276556 (0.0005) [2023-12-26 01:48:09,101][123091] Updated weights for policy 0, policy_version 278032 (0.0009) [2023-12-26 01:48:09,128][123090] Updated weights for policy 1, policy_version 276566 (0.0007) [2023-12-26 01:48:09,199][123090] Updated weights for policy 1, policy_version 276576 (0.0011) [2023-12-26 01:48:10,005][123091] Updated weights for policy 0, policy_version 278042 (0.0010) [2023-12-26 01:48:10,023][123090] Updated weights for policy 1, policy_version 276586 (0.0011) [2023-12-26 01:48:10,061][123091] Updated weights for policy 0, policy_version 278052 (0.0008) [2023-12-26 01:48:10,083][123090] Updated weights for policy 1, policy_version 276596 (0.0011) [2023-12-26 01:48:10,124][123091] Updated weights for policy 0, policy_version 278062 (0.0007) [2023-12-26 01:48:10,154][123090] Updated weights for policy 1, policy_version 276606 (0.0011) [2023-12-26 01:48:10,841][123091] Updated weights for policy 0, policy_version 278072 (0.0006) [2023-12-26 01:48:10,907][123091] Updated weights for policy 0, policy_version 278082 (0.0007) [2023-12-26 01:48:10,918][123090] Updated weights for policy 1, policy_version 276616 (0.0009) [2023-12-26 01:48:10,958][123091] Updated weights for policy 0, policy_version 278092 (0.0009) [2023-12-26 01:48:10,982][123090] Updated weights for policy 1, policy_version 276626 (0.0009) [2023-12-26 01:48:11,051][123090] Updated weights for policy 1, policy_version 276636 (0.0008) [2023-12-26 01:48:11,791][123091] Updated weights for policy 0, policy_version 278102 (0.0008) [2023-12-26 01:48:11,850][123091] Updated weights for policy 0, policy_version 278112 (0.0008) [2023-12-26 01:48:11,863][123090] Updated weights for policy 1, policy_version 276646 (0.0007) [2023-12-26 01:48:11,910][123091] Updated weights for policy 0, policy_version 278122 (0.0006) [2023-12-26 01:48:11,927][123090] Updated weights for policy 1, policy_version 276656 (0.0007) [2023-12-26 01:48:11,993][123090] Updated weights for policy 1, policy_version 276666 (0.0008) [2023-12-26 01:48:12,693][123091] Updated weights for policy 0, policy_version 278132 (0.0008) [2023-12-26 01:48:12,739][123091] Updated weights for policy 0, policy_version 278142 (0.0005) [2023-12-26 01:48:12,788][123091] Updated weights for policy 0, policy_version 278152 (0.0006) [2023-12-26 01:48:12,867][123090] Updated weights for policy 1, policy_version 276676 (0.0008) [2023-12-26 01:48:12,933][123090] Updated weights for policy 1, policy_version 276686 (0.0009) [2023-12-26 01:48:12,997][123090] Updated weights for policy 1, policy_version 276696 (0.0010) [2023-12-26 01:48:13,454][123091] Updated weights for policy 0, policy_version 278162 (0.0006) [2023-12-26 01:48:13,520][123091] Updated weights for policy 0, policy_version 278172 (0.0005) [2023-12-26 01:48:13,589][123091] Updated weights for policy 0, policy_version 278182 (0.0005) [2023-12-26 01:48:13,648][123091] Updated weights for policy 0, policy_version 278192 (0.0005) [2023-12-26 01:48:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 142057472. Throughput: 0: 8850.9, 1: 9026.2. Samples: 142050076. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:13,785][121949] Avg episode reward: [(0, '6049.219'), (1, '5047.043')] [2023-12-26 01:48:13,897][123090] Updated weights for policy 1, policy_version 276706 (0.0009) [2023-12-26 01:48:13,960][123090] Updated weights for policy 1, policy_version 276716 (0.0009) [2023-12-26 01:48:14,029][123090] Updated weights for policy 1, policy_version 276726 (0.0009) [2023-12-26 01:48:14,101][123090] Updated weights for policy 1, policy_version 276736 (0.0009) [2023-12-26 01:48:14,360][123091] Updated weights for policy 0, policy_version 278202 (0.0010) [2023-12-26 01:48:14,421][123091] Updated weights for policy 0, policy_version 278212 (0.0010) [2023-12-26 01:48:14,482][123091] Updated weights for policy 0, policy_version 278222 (0.0011) [2023-12-26 01:48:14,940][123090] Updated weights for policy 1, policy_version 276746 (0.0010) [2023-12-26 01:48:15,012][123090] Updated weights for policy 1, policy_version 276756 (0.0010) [2023-12-26 01:48:15,070][123090] Updated weights for policy 1, policy_version 276766 (0.0010) [2023-12-26 01:48:15,241][123091] Updated weights for policy 0, policy_version 278232 (0.0006) [2023-12-26 01:48:15,307][123091] Updated weights for policy 0, policy_version 278242 (0.0005) [2023-12-26 01:48:15,378][123091] Updated weights for policy 0, policy_version 278252 (0.0006) [2023-12-26 01:48:16,017][123090] Updated weights for policy 1, policy_version 276776 (0.0009) [2023-12-26 01:48:16,049][123091] Updated weights for policy 0, policy_version 278262 (0.0006) [2023-12-26 01:48:16,082][123090] Updated weights for policy 1, policy_version 276786 (0.0008) [2023-12-26 01:48:16,099][123091] Updated weights for policy 0, policy_version 278272 (0.0007) [2023-12-26 01:48:16,146][123091] Updated weights for policy 0, policy_version 278282 (0.0007) [2023-12-26 01:48:16,155][123090] Updated weights for policy 1, policy_version 276796 (0.0009) [2023-12-26 01:48:16,876][123091] Updated weights for policy 0, policy_version 278292 (0.0006) [2023-12-26 01:48:16,939][123091] Updated weights for policy 0, policy_version 278302 (0.0005) [2023-12-26 01:48:17,000][123091] Updated weights for policy 0, policy_version 278312 (0.0006) [2023-12-26 01:48:17,035][123090] Updated weights for policy 1, policy_version 276806 (0.0007) [2023-12-26 01:48:17,104][123090] Updated weights for policy 1, policy_version 276816 (0.0009) [2023-12-26 01:48:17,175][123090] Updated weights for policy 1, policy_version 276826 (0.0005) [2023-12-26 01:48:17,580][123091] Updated weights for policy 0, policy_version 278322 (0.0007) [2023-12-26 01:48:17,635][123091] Updated weights for policy 0, policy_version 278332 (0.0005) [2023-12-26 01:48:17,690][123091] Updated weights for policy 0, policy_version 278342 (0.0005) [2023-12-26 01:48:17,756][123091] Updated weights for policy 0, policy_version 278352 (0.0006) [2023-12-26 01:48:17,949][123090] Updated weights for policy 1, policy_version 276836 (0.0008) [2023-12-26 01:48:18,014][123090] Updated weights for policy 1, policy_version 276846 (0.0010) [2023-12-26 01:48:18,085][123090] Updated weights for policy 1, policy_version 276856 (0.0009) [2023-12-26 01:48:18,472][123091] Updated weights for policy 0, policy_version 278362 (0.0010) [2023-12-26 01:48:18,529][123091] Updated weights for policy 0, policy_version 278372 (0.0009) [2023-12-26 01:48:18,580][123091] Updated weights for policy 0, policy_version 278382 (0.0010) [2023-12-26 01:48:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 142147584. Throughput: 0: 8959.5, 1: 8890.1. Samples: 142157204. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:18,785][121949] Avg episode reward: [(0, '6192.416'), (1, '5165.430')] [2023-12-26 01:48:18,856][123090] Updated weights for policy 1, policy_version 276866 (0.0009) [2023-12-26 01:48:18,924][123090] Updated weights for policy 1, policy_version 276876 (0.0005) [2023-12-26 01:48:18,979][123090] Updated weights for policy 1, policy_version 276886 (0.0005) [2023-12-26 01:48:19,041][123090] Updated weights for policy 1, policy_version 276896 (0.0006) [2023-12-26 01:48:19,319][123091] Updated weights for policy 0, policy_version 278392 (0.0008) [2023-12-26 01:48:19,376][123091] Updated weights for policy 0, policy_version 278402 (0.0010) [2023-12-26 01:48:19,431][123091] Updated weights for policy 0, policy_version 278412 (0.0009) [2023-12-26 01:48:19,779][123090] Updated weights for policy 1, policy_version 276906 (0.0008) [2023-12-26 01:48:19,852][123090] Updated weights for policy 1, policy_version 276916 (0.0010) [2023-12-26 01:48:19,920][123090] Updated weights for policy 1, policy_version 276926 (0.0010) [2023-12-26 01:48:20,260][123091] Updated weights for policy 0, policy_version 278422 (0.0007) [2023-12-26 01:48:20,340][123091] Updated weights for policy 0, policy_version 278432 (0.0006) [2023-12-26 01:48:20,414][123091] Updated weights for policy 0, policy_version 278442 (0.0007) [2023-12-26 01:48:20,664][123090] Updated weights for policy 1, policy_version 276936 (0.0008) [2023-12-26 01:48:20,735][123090] Updated weights for policy 1, policy_version 276946 (0.0008) [2023-12-26 01:48:20,799][123090] Updated weights for policy 1, policy_version 276956 (0.0008) [2023-12-26 01:48:21,210][123091] Updated weights for policy 0, policy_version 278452 (0.0008) [2023-12-26 01:48:21,266][123091] Updated weights for policy 0, policy_version 278462 (0.0009) [2023-12-26 01:48:21,334][123091] Updated weights for policy 0, policy_version 278472 (0.0010) [2023-12-26 01:48:21,576][123090] Updated weights for policy 1, policy_version 276966 (0.0008) [2023-12-26 01:48:21,647][123090] Updated weights for policy 1, policy_version 276976 (0.0008) [2023-12-26 01:48:21,714][123090] Updated weights for policy 1, policy_version 276986 (0.0008) [2023-12-26 01:48:22,183][123091] Updated weights for policy 0, policy_version 278482 (0.0008) [2023-12-26 01:48:22,235][123091] Updated weights for policy 0, policy_version 278492 (0.0009) [2023-12-26 01:48:22,299][123091] Updated weights for policy 0, policy_version 278503 (0.0010) [2023-12-26 01:48:22,508][123090] Updated weights for policy 1, policy_version 276996 (0.0009) [2023-12-26 01:48:22,576][123090] Updated weights for policy 1, policy_version 277006 (0.0007) [2023-12-26 01:48:22,646][123090] Updated weights for policy 1, policy_version 277016 (0.0006) [2023-12-26 01:48:23,123][123091] Updated weights for policy 0, policy_version 278513 (0.0009) [2023-12-26 01:48:23,176][123091] Updated weights for policy 0, policy_version 278523 (0.0006) [2023-12-26 01:48:23,228][123090] Updated weights for policy 1, policy_version 277026 (0.0005) [2023-12-26 01:48:23,242][123091] Updated weights for policy 0, policy_version 278533 (0.0008) [2023-12-26 01:48:23,297][123090] Updated weights for policy 1, policy_version 277036 (0.0005) [2023-12-26 01:48:23,303][123091] Updated weights for policy 0, policy_version 278543 (0.0009) [2023-12-26 01:48:23,361][123090] Updated weights for policy 1, policy_version 277046 (0.0007) [2023-12-26 01:48:23,416][123090] Updated weights for policy 1, policy_version 277056 (0.0009) [2023-12-26 01:48:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 142237696. Throughput: 0: 8965.9, 1: 8945.7. Samples: 142213224. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:23,785][121949] Avg episode reward: [(0, '6205.033'), (1, '5304.371')] [2023-12-26 01:48:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000278544_71311360.pth... [2023-12-26 01:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000277056_70926336.pth... [2023-12-26 01:48:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000277488_71041024.pth [2023-12-26 01:48:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000276032_70664192.pth [2023-12-26 01:48:24,071][123091] Updated weights for policy 0, policy_version 278553 (0.0010) [2023-12-26 01:48:24,123][123090] Updated weights for policy 1, policy_version 277066 (0.0006) [2023-12-26 01:48:24,123][123091] Updated weights for policy 0, policy_version 278563 (0.0011) [2023-12-26 01:48:24,183][123091] Updated weights for policy 0, policy_version 278573 (0.0011) [2023-12-26 01:48:24,194][123090] Updated weights for policy 1, policy_version 277076 (0.0006) [2023-12-26 01:48:24,245][123090] Updated weights for policy 1, policy_version 277086 (0.0008) [2023-12-26 01:48:25,019][123091] Updated weights for policy 0, policy_version 278583 (0.0011) [2023-12-26 01:48:25,042][123090] Updated weights for policy 1, policy_version 277096 (0.0006) [2023-12-26 01:48:25,081][123091] Updated weights for policy 0, policy_version 278593 (0.0011) [2023-12-26 01:48:25,108][123090] Updated weights for policy 1, policy_version 277106 (0.0007) [2023-12-26 01:48:25,141][123091] Updated weights for policy 0, policy_version 278603 (0.0008) [2023-12-26 01:48:25,172][123090] Updated weights for policy 1, policy_version 277116 (0.0009) [2023-12-26 01:48:25,889][123091] Updated weights for policy 0, policy_version 278613 (0.0008) [2023-12-26 01:48:25,944][123091] Updated weights for policy 0, policy_version 278623 (0.0010) [2023-12-26 01:48:25,972][123090] Updated weights for policy 1, policy_version 277126 (0.0008) [2023-12-26 01:48:26,006][123091] Updated weights for policy 0, policy_version 278633 (0.0011) [2023-12-26 01:48:26,030][123090] Updated weights for policy 1, policy_version 277136 (0.0006) [2023-12-26 01:48:26,091][123090] Updated weights for policy 1, policy_version 277146 (0.0008) [2023-12-26 01:48:26,826][123091] Updated weights for policy 0, policy_version 278643 (0.0011) [2023-12-26 01:48:26,858][123090] Updated weights for policy 1, policy_version 277156 (0.0007) [2023-12-26 01:48:26,877][123091] Updated weights for policy 0, policy_version 278653 (0.0010) [2023-12-26 01:48:26,914][123090] Updated weights for policy 1, policy_version 277166 (0.0006) [2023-12-26 01:48:26,927][123091] Updated weights for policy 0, policy_version 278663 (0.0010) [2023-12-26 01:48:26,965][123090] Updated weights for policy 1, policy_version 277176 (0.0010) [2023-12-26 01:48:27,649][123090] Updated weights for policy 1, policy_version 277186 (0.0009) [2023-12-26 01:48:27,697][123090] Updated weights for policy 1, policy_version 277196 (0.0007) [2023-12-26 01:48:27,701][123091] Updated weights for policy 0, policy_version 278673 (0.0010) [2023-12-26 01:48:27,755][123091] Updated weights for policy 0, policy_version 278683 (0.0005) [2023-12-26 01:48:27,764][123090] Updated weights for policy 1, policy_version 277206 (0.0007) [2023-12-26 01:48:27,808][123091] Updated weights for policy 0, policy_version 278693 (0.0005) [2023-12-26 01:48:27,831][123090] Updated weights for policy 1, policy_version 277216 (0.0005) [2023-12-26 01:48:27,867][123091] Updated weights for policy 0, policy_version 278703 (0.0005) [2023-12-26 01:48:28,438][123090] Updated weights for policy 1, policy_version 277226 (0.0006) [2023-12-26 01:48:28,460][123091] Updated weights for policy 0, policy_version 278713 (0.0006) [2023-12-26 01:48:28,490][123090] Updated weights for policy 1, policy_version 277236 (0.0005) [2023-12-26 01:48:28,524][123091] Updated weights for policy 0, policy_version 278723 (0.0005) [2023-12-26 01:48:28,560][123090] Updated weights for policy 1, policy_version 277246 (0.0008) [2023-12-26 01:48:28,587][123091] Updated weights for policy 0, policy_version 278733 (0.0006) [2023-12-26 01:48:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 142336000. Throughput: 0: 8983.2, 1: 8985.6. Samples: 142321820. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:28,785][121949] Avg episode reward: [(0, '6160.976'), (1, '5290.397')] [2023-12-26 01:48:29,285][123091] Updated weights for policy 0, policy_version 278743 (0.0008) [2023-12-26 01:48:29,347][123091] Updated weights for policy 0, policy_version 278753 (0.0011) [2023-12-26 01:48:29,375][123090] Updated weights for policy 1, policy_version 277256 (0.0009) [2023-12-26 01:48:29,410][123091] Updated weights for policy 0, policy_version 278763 (0.0010) [2023-12-26 01:48:29,424][123090] Updated weights for policy 1, policy_version 277266 (0.0008) [2023-12-26 01:48:29,476][123090] Updated weights for policy 1, policy_version 277276 (0.0008) [2023-12-26 01:48:30,227][123091] Updated weights for policy 0, policy_version 278773 (0.0011) [2023-12-26 01:48:30,278][123091] Updated weights for policy 0, policy_version 278783 (0.0010) [2023-12-26 01:48:30,298][123090] Updated weights for policy 1, policy_version 277286 (0.0006) [2023-12-26 01:48:30,344][123091] Updated weights for policy 0, policy_version 278793 (0.0010) [2023-12-26 01:48:30,364][123090] Updated weights for policy 1, policy_version 277296 (0.0007) [2023-12-26 01:48:30,426][123090] Updated weights for policy 1, policy_version 277306 (0.0008) [2023-12-26 01:48:31,112][123091] Updated weights for policy 0, policy_version 278803 (0.0011) [2023-12-26 01:48:31,184][123091] Updated weights for policy 0, policy_version 278813 (0.0011) [2023-12-26 01:48:31,250][123091] Updated weights for policy 0, policy_version 278823 (0.0011) [2023-12-26 01:48:31,253][123090] Updated weights for policy 1, policy_version 277316 (0.0008) [2023-12-26 01:48:31,320][123090] Updated weights for policy 1, policy_version 277326 (0.0007) [2023-12-26 01:48:31,383][123090] Updated weights for policy 1, policy_version 277336 (0.0009) [2023-12-26 01:48:32,026][123091] Updated weights for policy 0, policy_version 278833 (0.0011) [2023-12-26 01:48:32,092][123091] Updated weights for policy 0, policy_version 278843 (0.0011) [2023-12-26 01:48:32,140][123091] Updated weights for policy 0, policy_version 278853 (0.0010) [2023-12-26 01:48:32,186][123091] Updated weights for policy 0, policy_version 278863 (0.0010) [2023-12-26 01:48:32,212][123090] Updated weights for policy 1, policy_version 277346 (0.0009) [2023-12-26 01:48:32,264][123090] Updated weights for policy 1, policy_version 277356 (0.0009) [2023-12-26 01:48:32,327][123090] Updated weights for policy 1, policy_version 277366 (0.0009) [2023-12-26 01:48:32,386][123090] Updated weights for policy 1, policy_version 277376 (0.0008) [2023-12-26 01:48:33,022][123091] Updated weights for policy 0, policy_version 278873 (0.0006) [2023-12-26 01:48:33,091][123091] Updated weights for policy 0, policy_version 278883 (0.0005) [2023-12-26 01:48:33,128][123090] Updated weights for policy 1, policy_version 277386 (0.0009) [2023-12-26 01:48:33,151][123091] Updated weights for policy 0, policy_version 278893 (0.0006) [2023-12-26 01:48:33,180][123090] Updated weights for policy 1, policy_version 277397 (0.0009) [2023-12-26 01:48:33,234][123090] Updated weights for policy 1, policy_version 277408 (0.0010) [2023-12-26 01:48:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 142417920. Throughput: 0: 8913.1, 1: 8934.3. Samples: 142431784. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:33,784][121949] Avg episode reward: [(0, '6150.184'), (1, '5189.611')] [2023-12-26 01:48:33,835][123091] Updated weights for policy 0, policy_version 278903 (0.0008) [2023-12-26 01:48:33,886][123091] Updated weights for policy 0, policy_version 278913 (0.0010) [2023-12-26 01:48:33,938][123091] Updated weights for policy 0, policy_version 278923 (0.0010) [2023-12-26 01:48:34,071][123090] Updated weights for policy 1, policy_version 277418 (0.0010) [2023-12-26 01:48:34,130][123090] Updated weights for policy 1, policy_version 277428 (0.0010) [2023-12-26 01:48:34,211][123090] Updated weights for policy 1, policy_version 277438 (0.0010) [2023-12-26 01:48:34,747][123091] Updated weights for policy 0, policy_version 278933 (0.0010) [2023-12-26 01:48:34,813][123091] Updated weights for policy 0, policy_version 278944 (0.0010) [2023-12-26 01:48:34,873][123091] Updated weights for policy 0, policy_version 278954 (0.0009) [2023-12-26 01:48:35,074][123090] Updated weights for policy 1, policy_version 277448 (0.0009) [2023-12-26 01:48:35,134][123090] Updated weights for policy 1, policy_version 277458 (0.0009) [2023-12-26 01:48:35,195][123090] Updated weights for policy 1, policy_version 277468 (0.0009) [2023-12-26 01:48:35,655][123091] Updated weights for policy 0, policy_version 278964 (0.0010) [2023-12-26 01:48:35,709][123091] Updated weights for policy 0, policy_version 278974 (0.0010) [2023-12-26 01:48:35,767][123091] Updated weights for policy 0, policy_version 278984 (0.0009) [2023-12-26 01:48:36,039][123090] Updated weights for policy 1, policy_version 277478 (0.0009) [2023-12-26 01:48:36,088][123090] Updated weights for policy 1, policy_version 277488 (0.0009) [2023-12-26 01:48:36,157][123090] Updated weights for policy 1, policy_version 277498 (0.0008) [2023-12-26 01:48:36,582][123091] Updated weights for policy 0, policy_version 278994 (0.0009) [2023-12-26 01:48:36,645][123091] Updated weights for policy 0, policy_version 279004 (0.0011) [2023-12-26 01:48:36,707][123091] Updated weights for policy 0, policy_version 279014 (0.0011) [2023-12-26 01:48:36,773][123091] Updated weights for policy 0, policy_version 279024 (0.0011) [2023-12-26 01:48:36,983][123090] Updated weights for policy 1, policy_version 277508 (0.0009) [2023-12-26 01:48:37,043][123090] Updated weights for policy 1, policy_version 277518 (0.0009) [2023-12-26 01:48:37,107][123090] Updated weights for policy 1, policy_version 277528 (0.0010) [2023-12-26 01:48:37,561][123091] Updated weights for policy 0, policy_version 279034 (0.0010) [2023-12-26 01:48:37,617][123091] Updated weights for policy 0, policy_version 279044 (0.0009) [2023-12-26 01:48:37,664][123091] Updated weights for policy 0, policy_version 279054 (0.0009) [2023-12-26 01:48:37,943][123090] Updated weights for policy 1, policy_version 277538 (0.0009) [2023-12-26 01:48:37,990][123090] Updated weights for policy 1, policy_version 277548 (0.0009) [2023-12-26 01:48:38,038][123090] Updated weights for policy 1, policy_version 277558 (0.0009) [2023-12-26 01:48:38,087][123090] Updated weights for policy 1, policy_version 277568 (0.0009) [2023-12-26 01:48:38,514][123091] Updated weights for policy 0, policy_version 279064 (0.0007) [2023-12-26 01:48:38,576][123091] Updated weights for policy 0, policy_version 279074 (0.0006) [2023-12-26 01:48:38,632][123091] Updated weights for policy 0, policy_version 279084 (0.0006) [2023-12-26 01:48:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 142508032. Throughput: 0: 8970.6, 1: 8896.4. Samples: 142484084. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:38,785][121949] Avg episode reward: [(0, '6168.293'), (1, '5339.966')] [2023-12-26 01:48:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000277568_71057408.pth... [2023-12-26 01:48:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000279088_71450624.pth... [2023-12-26 01:48:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000276544_70795264.pth [2023-12-26 01:48:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000278000_71172096.pth [2023-12-26 01:48:39,035][123090] Updated weights for policy 1, policy_version 277578 (0.0009) [2023-12-26 01:48:39,105][123090] Updated weights for policy 1, policy_version 277588 (0.0010) [2023-12-26 01:48:39,170][123090] Updated weights for policy 1, policy_version 277598 (0.0009) [2023-12-26 01:48:39,378][123091] Updated weights for policy 0, policy_version 279095 (0.0008) [2023-12-26 01:48:39,454][123091] Updated weights for policy 0, policy_version 279105 (0.0011) [2023-12-26 01:48:39,523][123091] Updated weights for policy 0, policy_version 279115 (0.0011) [2023-12-26 01:48:40,016][123090] Updated weights for policy 1, policy_version 277608 (0.0009) [2023-12-26 01:48:40,085][123090] Updated weights for policy 1, policy_version 277618 (0.0008) [2023-12-26 01:48:40,149][123090] Updated weights for policy 1, policy_version 277628 (0.0006) [2023-12-26 01:48:40,390][123091] Updated weights for policy 0, policy_version 279125 (0.0010) [2023-12-26 01:48:40,445][123091] Updated weights for policy 0, policy_version 279136 (0.0011) [2023-12-26 01:48:40,504][123091] Updated weights for policy 0, policy_version 279146 (0.0009) [2023-12-26 01:48:40,824][123090] Updated weights for policy 1, policy_version 277638 (0.0008) [2023-12-26 01:48:40,896][123090] Updated weights for policy 1, policy_version 277648 (0.0011) [2023-12-26 01:48:40,955][123090] Updated weights for policy 1, policy_version 277658 (0.0010) [2023-12-26 01:48:41,347][123091] Updated weights for policy 0, policy_version 279156 (0.0009) [2023-12-26 01:48:41,424][123091] Updated weights for policy 0, policy_version 279166 (0.0009) [2023-12-26 01:48:41,492][123091] Updated weights for policy 0, policy_version 279176 (0.0010) [2023-12-26 01:48:41,784][123090] Updated weights for policy 1, policy_version 277668 (0.0009) [2023-12-26 01:48:41,842][123090] Updated weights for policy 1, policy_version 277678 (0.0010) [2023-12-26 01:48:41,900][123090] Updated weights for policy 1, policy_version 277688 (0.0010) [2023-12-26 01:48:42,356][123091] Updated weights for policy 0, policy_version 279186 (0.0010) [2023-12-26 01:48:42,414][123091] Updated weights for policy 0, policy_version 279196 (0.0010) [2023-12-26 01:48:42,483][123091] Updated weights for policy 0, policy_version 279206 (0.0009) [2023-12-26 01:48:42,554][123091] Updated weights for policy 0, policy_version 279216 (0.0009) [2023-12-26 01:48:42,669][123090] Updated weights for policy 1, policy_version 277698 (0.0010) [2023-12-26 01:48:42,733][123090] Updated weights for policy 1, policy_version 277708 (0.0008) [2023-12-26 01:48:42,784][123090] Updated weights for policy 1, policy_version 277718 (0.0010) [2023-12-26 01:48:42,833][123090] Updated weights for policy 1, policy_version 277728 (0.0009) [2023-12-26 01:48:43,368][123091] Updated weights for policy 0, policy_version 279226 (0.0009) [2023-12-26 01:48:43,420][123091] Updated weights for policy 0, policy_version 279236 (0.0009) [2023-12-26 01:48:43,473][123091] Updated weights for policy 0, policy_version 279246 (0.0009) [2023-12-26 01:48:43,625][123090] Updated weights for policy 1, policy_version 277738 (0.0005) [2023-12-26 01:48:43,686][123090] Updated weights for policy 1, policy_version 277748 (0.0006) [2023-12-26 01:48:43,751][123090] Updated weights for policy 1, policy_version 277758 (0.0009) [2023-12-26 01:48:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 142598144. Throughput: 0: 8954.0, 1: 8862.1. Samples: 142586124. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:43,785][121949] Avg episode reward: [(0, '6232.750'), (1, '5299.176')] [2023-12-26 01:48:44,347][123091] Updated weights for policy 0, policy_version 279256 (0.0010) [2023-12-26 01:48:44,403][123091] Updated weights for policy 0, policy_version 279266 (0.0010) [2023-12-26 01:48:44,472][123091] Updated weights for policy 0, policy_version 279276 (0.0007) [2023-12-26 01:48:44,496][123090] Updated weights for policy 1, policy_version 277768 (0.0010) [2023-12-26 01:48:44,547][123090] Updated weights for policy 1, policy_version 277778 (0.0009) [2023-12-26 01:48:44,595][123090] Updated weights for policy 1, policy_version 277788 (0.0009) [2023-12-26 01:48:45,333][123091] Updated weights for policy 0, policy_version 279286 (0.0008) [2023-12-26 01:48:45,388][123091] Updated weights for policy 0, policy_version 279297 (0.0010) [2023-12-26 01:48:45,390][123090] Updated weights for policy 1, policy_version 277798 (0.0008) [2023-12-26 01:48:45,443][123091] Updated weights for policy 0, policy_version 279307 (0.0009) [2023-12-26 01:48:45,446][123090] Updated weights for policy 1, policy_version 277808 (0.0007) [2023-12-26 01:48:45,496][123090] Updated weights for policy 1, policy_version 277818 (0.0007) [2023-12-26 01:48:46,299][123091] Updated weights for policy 0, policy_version 279317 (0.0010) [2023-12-26 01:48:46,340][123090] Updated weights for policy 1, policy_version 277828 (0.0009) [2023-12-26 01:48:46,357][123091] Updated weights for policy 0, policy_version 279327 (0.0007) [2023-12-26 01:48:46,400][123090] Updated weights for policy 1, policy_version 277838 (0.0007) [2023-12-26 01:48:46,416][123091] Updated weights for policy 0, policy_version 279337 (0.0008) [2023-12-26 01:48:46,459][123090] Updated weights for policy 1, policy_version 277848 (0.0009) [2023-12-26 01:48:47,184][123090] Updated weights for policy 1, policy_version 277858 (0.0009) [2023-12-26 01:48:47,251][123090] Updated weights for policy 1, policy_version 277868 (0.0009) [2023-12-26 01:48:47,304][123091] Updated weights for policy 0, policy_version 279347 (0.0008) [2023-12-26 01:48:47,310][123090] Updated weights for policy 1, policy_version 277878 (0.0009) [2023-12-26 01:48:47,372][123091] Updated weights for policy 0, policy_version 279357 (0.0008) [2023-12-26 01:48:47,374][123090] Updated weights for policy 1, policy_version 277888 (0.0008) [2023-12-26 01:48:47,433][123091] Updated weights for policy 0, policy_version 279367 (0.0009) [2023-12-26 01:48:48,202][123090] Updated weights for policy 1, policy_version 277898 (0.0010) [2023-12-26 01:48:48,262][123091] Updated weights for policy 0, policy_version 279377 (0.0009) [2023-12-26 01:48:48,265][123090] Updated weights for policy 1, policy_version 277908 (0.0009) [2023-12-26 01:48:48,316][123091] Updated weights for policy 0, policy_version 279387 (0.0009) [2023-12-26 01:48:48,319][123090] Updated weights for policy 1, policy_version 277918 (0.0007) [2023-12-26 01:48:48,378][123091] Updated weights for policy 0, policy_version 279397 (0.0009) [2023-12-26 01:48:48,442][123091] Updated weights for policy 0, policy_version 279407 (0.0010) [2023-12-26 01:48:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 142680064. Throughput: 0: 8973.6, 1: 8815.2. Samples: 142689696. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:48,785][121949] Avg episode reward: [(0, '6171.801'), (1, '5419.102')] [2023-12-26 01:48:49,184][123090] Updated weights for policy 1, policy_version 277928 (0.0009) [2023-12-26 01:48:49,253][123090] Updated weights for policy 1, policy_version 277938 (0.0008) [2023-12-26 01:48:49,290][123091] Updated weights for policy 0, policy_version 279417 (0.0010) [2023-12-26 01:48:49,322][123090] Updated weights for policy 1, policy_version 277948 (0.0008) [2023-12-26 01:48:49,360][123091] Updated weights for policy 0, policy_version 279427 (0.0008) [2023-12-26 01:48:49,424][123091] Updated weights for policy 0, policy_version 279437 (0.0009) [2023-12-26 01:48:50,147][123090] Updated weights for policy 1, policy_version 277958 (0.0009) [2023-12-26 01:48:50,197][123090] Updated weights for policy 1, policy_version 277968 (0.0009) [2023-12-26 01:48:50,254][123090] Updated weights for policy 1, policy_version 277978 (0.0010) [2023-12-26 01:48:50,256][123091] Updated weights for policy 0, policy_version 279447 (0.0007) [2023-12-26 01:48:50,307][123091] Updated weights for policy 0, policy_version 279457 (0.0009) [2023-12-26 01:48:50,356][123091] Updated weights for policy 0, policy_version 279467 (0.0009) [2023-12-26 01:48:51,120][123090] Updated weights for policy 1, policy_version 277988 (0.0010) [2023-12-26 01:48:51,188][123090] Updated weights for policy 1, policy_version 277998 (0.0009) [2023-12-26 01:48:51,227][123091] Updated weights for policy 0, policy_version 279478 (0.0009) [2023-12-26 01:48:51,249][123090] Updated weights for policy 1, policy_version 278008 (0.0009) [2023-12-26 01:48:51,288][123091] Updated weights for policy 0, policy_version 279488 (0.0007) [2023-12-26 01:48:51,354][123091] Updated weights for policy 0, policy_version 279498 (0.0010) [2023-12-26 01:48:52,098][123090] Updated weights for policy 1, policy_version 278018 (0.0009) [2023-12-26 01:48:52,160][123090] Updated weights for policy 1, policy_version 278028 (0.0008) [2023-12-26 01:48:52,199][123091] Updated weights for policy 0, policy_version 279508 (0.0010) [2023-12-26 01:48:52,223][123090] Updated weights for policy 1, policy_version 278038 (0.0009) [2023-12-26 01:48:52,260][123091] Updated weights for policy 0, policy_version 279518 (0.0009) [2023-12-26 01:48:52,285][123090] Updated weights for policy 1, policy_version 278048 (0.0008) [2023-12-26 01:48:52,314][123091] Updated weights for policy 0, policy_version 279528 (0.0009) [2023-12-26 01:48:53,078][123091] Updated weights for policy 0, policy_version 279538 (0.0010) [2023-12-26 01:48:53,129][123091] Updated weights for policy 0, policy_version 279548 (0.0008) [2023-12-26 01:48:53,178][123091] Updated weights for policy 0, policy_version 279558 (0.0005) [2023-12-26 01:48:53,187][123090] Updated weights for policy 1, policy_version 278058 (0.0008) [2023-12-26 01:48:53,230][123091] Updated weights for policy 0, policy_version 279568 (0.0005) [2023-12-26 01:48:53,254][123090] Updated weights for policy 1, policy_version 278068 (0.0009) [2023-12-26 01:48:53,311][123090] Updated weights for policy 1, policy_version 278078 (0.0010) [2023-12-26 01:48:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 142761984. Throughput: 0: 8919.8, 1: 8752.1. Samples: 142739496. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:53,785][121949] Avg episode reward: [(0, '6174.580'), (1, '5524.952')] [2023-12-26 01:48:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000278080_71188480.pth... [2023-12-26 01:48:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000279568_71573504.pth... [2023-12-26 01:48:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000277056_70926336.pth [2023-12-26 01:48:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000278544_71311360.pth [2023-12-26 01:48:53,924][123091] Updated weights for policy 0, policy_version 279578 (0.0005) [2023-12-26 01:48:53,996][123091] Updated weights for policy 0, policy_version 279588 (0.0006) [2023-12-26 01:48:54,046][123091] Updated weights for policy 0, policy_version 279598 (0.0008) [2023-12-26 01:48:54,175][123090] Updated weights for policy 1, policy_version 278088 (0.0006) [2023-12-26 01:48:54,239][123090] Updated weights for policy 1, policy_version 278098 (0.0005) [2023-12-26 01:48:54,309][123090] Updated weights for policy 1, policy_version 278108 (0.0006) [2023-12-26 01:48:54,824][123091] Updated weights for policy 0, policy_version 279608 (0.0011) [2023-12-26 01:48:54,875][123091] Updated weights for policy 0, policy_version 279618 (0.0011) [2023-12-26 01:48:54,939][123091] Updated weights for policy 0, policy_version 279628 (0.0011) [2023-12-26 01:48:55,048][123090] Updated weights for policy 1, policy_version 278118 (0.0009) [2023-12-26 01:48:55,100][123090] Updated weights for policy 1, policy_version 278128 (0.0008) [2023-12-26 01:48:55,155][123090] Updated weights for policy 1, policy_version 278138 (0.0008) [2023-12-26 01:48:55,727][123091] Updated weights for policy 0, policy_version 279638 (0.0008) [2023-12-26 01:48:55,798][123091] Updated weights for policy 0, policy_version 279648 (0.0005) [2023-12-26 01:48:55,871][123091] Updated weights for policy 0, policy_version 279658 (0.0005) [2023-12-26 01:48:56,080][123090] Updated weights for policy 1, policy_version 278148 (0.0009) [2023-12-26 01:48:56,135][123090] Updated weights for policy 1, policy_version 278158 (0.0011) [2023-12-26 01:48:56,198][123090] Updated weights for policy 1, policy_version 278169 (0.0010) [2023-12-26 01:48:56,453][123091] Updated weights for policy 0, policy_version 279668 (0.0006) [2023-12-26 01:48:56,524][123091] Updated weights for policy 0, policy_version 279678 (0.0005) [2023-12-26 01:48:56,582][123091] Updated weights for policy 0, policy_version 279688 (0.0010) [2023-12-26 01:48:57,140][123090] Updated weights for policy 1, policy_version 278180 (0.0011) [2023-12-26 01:48:57,198][123090] Updated weights for policy 1, policy_version 278190 (0.0009) [2023-12-26 01:48:57,223][123091] Updated weights for policy 0, policy_version 279698 (0.0009) [2023-12-26 01:48:57,248][123090] Updated weights for policy 1, policy_version 278200 (0.0009) [2023-12-26 01:48:57,288][123091] Updated weights for policy 0, policy_version 279708 (0.0005) [2023-12-26 01:48:57,351][123091] Updated weights for policy 0, policy_version 279718 (0.0007) [2023-12-26 01:48:57,402][123091] Updated weights for policy 0, policy_version 279728 (0.0008) [2023-12-26 01:48:58,107][123090] Updated weights for policy 1, policy_version 278210 (0.0009) [2023-12-26 01:48:58,135][123091] Updated weights for policy 0, policy_version 279738 (0.0011) [2023-12-26 01:48:58,172][123090] Updated weights for policy 1, policy_version 278220 (0.0008) [2023-12-26 01:48:58,198][123091] Updated weights for policy 0, policy_version 279748 (0.0011) [2023-12-26 01:48:58,240][123090] Updated weights for policy 1, policy_version 278230 (0.0008) [2023-12-26 01:48:58,261][123091] Updated weights for policy 0, policy_version 279758 (0.0008) [2023-12-26 01:48:58,302][123090] Updated weights for policy 1, policy_version 278240 (0.0009) [2023-12-26 01:48:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 142852096. Throughput: 0: 9015.0, 1: 8679.6. Samples: 142846332. Policy #0 lag: (min: 9.0, avg: 32.3, max: 41.0) [2023-12-26 01:48:58,785][121949] Avg episode reward: [(0, '6255.434'), (1, '5560.839')] [2023-12-26 01:48:59,192][123090] Updated weights for policy 1, policy_version 278250 (0.0009) [2023-12-26 01:48:59,206][123091] Updated weights for policy 0, policy_version 279768 (0.0009) [2023-12-26 01:48:59,269][123090] Updated weights for policy 1, policy_version 278260 (0.0008) [2023-12-26 01:48:59,277][123091] Updated weights for policy 0, policy_version 279778 (0.0008) [2023-12-26 01:48:59,342][123091] Updated weights for policy 0, policy_version 279788 (0.0007) [2023-12-26 01:48:59,342][123090] Updated weights for policy 1, policy_version 278270 (0.0008) [2023-12-26 01:49:00,057][123091] Updated weights for policy 0, policy_version 279798 (0.0008) [2023-12-26 01:49:00,122][123091] Updated weights for policy 0, policy_version 279808 (0.0008) [2023-12-26 01:49:00,180][123091] Updated weights for policy 0, policy_version 279818 (0.0006) [2023-12-26 01:49:00,248][123090] Updated weights for policy 1, policy_version 278280 (0.0008) [2023-12-26 01:49:00,324][123090] Updated weights for policy 1, policy_version 278290 (0.0010) [2023-12-26 01:49:00,389][123090] Updated weights for policy 1, policy_version 278300 (0.0009) [2023-12-26 01:49:00,898][123091] Updated weights for policy 0, policy_version 279828 (0.0006) [2023-12-26 01:49:00,972][123091] Updated weights for policy 0, policy_version 279838 (0.0005) [2023-12-26 01:49:01,038][123091] Updated weights for policy 0, policy_version 279848 (0.0009) [2023-12-26 01:49:01,242][123090] Updated weights for policy 1, policy_version 278310 (0.0010) [2023-12-26 01:49:01,308][123090] Updated weights for policy 1, policy_version 278320 (0.0010) [2023-12-26 01:49:01,375][123090] Updated weights for policy 1, policy_version 278330 (0.0010) [2023-12-26 01:49:01,825][123091] Updated weights for policy 0, policy_version 279858 (0.0009) [2023-12-26 01:49:01,880][123091] Updated weights for policy 0, policy_version 279868 (0.0009) [2023-12-26 01:49:01,937][123091] Updated weights for policy 0, policy_version 279878 (0.0010) [2023-12-26 01:49:01,990][123091] Updated weights for policy 0, policy_version 279888 (0.0010) [2023-12-26 01:49:02,138][123090] Updated weights for policy 1, policy_version 278340 (0.0008) [2023-12-26 01:49:02,187][123090] Updated weights for policy 1, policy_version 278350 (0.0005) [2023-12-26 01:49:02,236][123090] Updated weights for policy 1, policy_version 278360 (0.0005) [2023-12-26 01:49:02,924][123091] Updated weights for policy 0, policy_version 279898 (0.0009) [2023-12-26 01:49:02,937][123090] Updated weights for policy 1, policy_version 278370 (0.0006) [2023-12-26 01:49:02,971][123091] Updated weights for policy 0, policy_version 279909 (0.0007) [2023-12-26 01:49:02,997][123090] Updated weights for policy 1, policy_version 278380 (0.0005) [2023-12-26 01:49:03,027][123091] Updated weights for policy 0, policy_version 279919 (0.0007) [2023-12-26 01:49:03,055][123090] Updated weights for policy 1, policy_version 278390 (0.0005) [2023-12-26 01:49:03,117][123090] Updated weights for policy 1, policy_version 278400 (0.0005) [2023-12-26 01:49:03,770][123090] Updated weights for policy 1, policy_version 278410 (0.0008) [2023-12-26 01:49:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 142934016. Throughput: 0: 8865.4, 1: 8761.9. Samples: 142950432. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:03,785][121949] Avg episode reward: [(0, '6253.766'), (1, '5501.893')] [2023-12-26 01:49:03,834][123090] Updated weights for policy 1, policy_version 278420 (0.0011) [2023-12-26 01:49:03,878][123091] Updated weights for policy 0, policy_version 279929 (0.0008) [2023-12-26 01:49:03,893][123090] Updated weights for policy 1, policy_version 278430 (0.0010) [2023-12-26 01:49:03,936][123091] Updated weights for policy 0, policy_version 279939 (0.0007) [2023-12-26 01:49:03,985][123091] Updated weights for policy 0, policy_version 279949 (0.0009) [2023-12-26 01:49:04,737][123090] Updated weights for policy 1, policy_version 278440 (0.0010) [2023-12-26 01:49:04,786][123091] Updated weights for policy 0, policy_version 279959 (0.0008) [2023-12-26 01:49:04,803][123090] Updated weights for policy 1, policy_version 278450 (0.0008) [2023-12-26 01:49:04,836][123091] Updated weights for policy 0, policy_version 279969 (0.0008) [2023-12-26 01:49:04,860][123090] Updated weights for policy 1, policy_version 278460 (0.0010) [2023-12-26 01:49:04,885][123091] Updated weights for policy 0, policy_version 279979 (0.0008) [2023-12-26 01:49:05,690][123090] Updated weights for policy 1, policy_version 278470 (0.0006) [2023-12-26 01:49:05,710][123091] Updated weights for policy 0, policy_version 279989 (0.0009) [2023-12-26 01:49:05,752][123090] Updated weights for policy 1, policy_version 278480 (0.0008) [2023-12-26 01:49:05,764][123091] Updated weights for policy 0, policy_version 279999 (0.0006) [2023-12-26 01:49:05,810][123090] Updated weights for policy 1, policy_version 278490 (0.0009) [2023-12-26 01:49:05,822][123091] Updated weights for policy 0, policy_version 280009 (0.0007) [2023-12-26 01:49:06,570][123090] Updated weights for policy 1, policy_version 278500 (0.0008) [2023-12-26 01:49:06,634][123090] Updated weights for policy 1, policy_version 278510 (0.0005) [2023-12-26 01:49:06,703][123090] Updated weights for policy 1, policy_version 278520 (0.0007) [2023-12-26 01:49:06,723][123091] Updated weights for policy 0, policy_version 280019 (0.0008) [2023-12-26 01:49:06,784][123091] Updated weights for policy 0, policy_version 280029 (0.0008) [2023-12-26 01:49:06,847][123091] Updated weights for policy 0, policy_version 280039 (0.0010) [2023-12-26 01:49:07,379][123090] Updated weights for policy 1, policy_version 278530 (0.0010) [2023-12-26 01:49:07,434][123090] Updated weights for policy 1, policy_version 278540 (0.0009) [2023-12-26 01:49:07,489][123090] Updated weights for policy 1, policy_version 278550 (0.0010) [2023-12-26 01:49:07,547][123090] Updated weights for policy 1, policy_version 278560 (0.0010) [2023-12-26 01:49:07,759][123091] Updated weights for policy 0, policy_version 280049 (0.0010) [2023-12-26 01:49:07,815][123091] Updated weights for policy 0, policy_version 280059 (0.0009) [2023-12-26 01:49:07,878][123091] Updated weights for policy 0, policy_version 280069 (0.0010) [2023-12-26 01:49:07,936][123091] Updated weights for policy 0, policy_version 280079 (0.0009) [2023-12-26 01:49:08,323][123090] Updated weights for policy 1, policy_version 278570 (0.0010) [2023-12-26 01:49:08,386][123090] Updated weights for policy 1, policy_version 278580 (0.0010) [2023-12-26 01:49:08,447][123090] Updated weights for policy 1, policy_version 278590 (0.0010) [2023-12-26 01:49:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 143024128. Throughput: 0: 8822.5, 1: 8720.2. Samples: 143002644. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:08,785][121949] Avg episode reward: [(0, '6270.594'), (1, '5408.590')] [2023-12-26 01:49:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000278592_71319552.pth... [2023-12-26 01:49:08,794][123091] Updated weights for policy 0, policy_version 280089 (0.0011) [2023-12-26 01:49:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000277568_71057408.pth [2023-12-26 01:49:08,866][123091] Updated weights for policy 0, policy_version 280099 (0.0010) [2023-12-26 01:49:08,926][123091] Updated weights for policy 0, policy_version 280109 (0.0009) [2023-12-26 01:49:08,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000280112_71712768.pth... [2023-12-26 01:49:08,943][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000279088_71450624.pth [2023-12-26 01:49:08,944][123007] Saving new best policy, reward=6270.594! [2023-12-26 01:49:09,288][123090] Updated weights for policy 1, policy_version 278600 (0.0008) [2023-12-26 01:49:09,345][123090] Updated weights for policy 1, policy_version 278610 (0.0006) [2023-12-26 01:49:09,418][123090] Updated weights for policy 1, policy_version 278620 (0.0011) [2023-12-26 01:49:09,721][123091] Updated weights for policy 0, policy_version 280119 (0.0006) [2023-12-26 01:49:09,777][123091] Updated weights for policy 0, policy_version 280129 (0.0005) [2023-12-26 01:49:09,838][123091] Updated weights for policy 0, policy_version 280139 (0.0010) [2023-12-26 01:49:10,173][123090] Updated weights for policy 1, policy_version 278630 (0.0009) [2023-12-26 01:49:10,234][123090] Updated weights for policy 1, policy_version 278640 (0.0011) [2023-12-26 01:49:10,289][123090] Updated weights for policy 1, policy_version 278650 (0.0007) [2023-12-26 01:49:10,661][123091] Updated weights for policy 0, policy_version 280149 (0.0013) [2023-12-26 01:49:10,738][123091] Updated weights for policy 0, policy_version 280159 (0.0009) [2023-12-26 01:49:10,802][123091] Updated weights for policy 0, policy_version 280169 (0.0010) [2023-12-26 01:49:11,082][123090] Updated weights for policy 1, policy_version 278660 (0.0006) [2023-12-26 01:49:11,154][123090] Updated weights for policy 1, policy_version 278670 (0.0008) [2023-12-26 01:49:11,224][123090] Updated weights for policy 1, policy_version 278680 (0.0008) [2023-12-26 01:49:11,710][123091] Updated weights for policy 0, policy_version 280179 (0.0010) [2023-12-26 01:49:11,775][123091] Updated weights for policy 0, policy_version 280189 (0.0010) [2023-12-26 01:49:11,824][123091] Updated weights for policy 0, policy_version 280199 (0.0010) [2023-12-26 01:49:12,095][123090] Updated weights for policy 1, policy_version 278690 (0.0009) [2023-12-26 01:49:12,163][123090] Updated weights for policy 1, policy_version 278700 (0.0009) [2023-12-26 01:49:12,232][123090] Updated weights for policy 1, policy_version 278710 (0.0010) [2023-12-26 01:49:12,300][123090] Updated weights for policy 1, policy_version 278720 (0.0010) [2023-12-26 01:49:12,618][123091] Updated weights for policy 0, policy_version 280209 (0.0008) [2023-12-26 01:49:12,686][123091] Updated weights for policy 0, policy_version 280219 (0.0005) [2023-12-26 01:49:12,749][123091] Updated weights for policy 0, policy_version 280229 (0.0010) [2023-12-26 01:49:12,812][123091] Updated weights for policy 0, policy_version 280239 (0.0010) [2023-12-26 01:49:13,170][123090] Updated weights for policy 1, policy_version 278730 (0.0005) [2023-12-26 01:49:13,220][123090] Updated weights for policy 1, policy_version 278740 (0.0005) [2023-12-26 01:49:13,276][123090] Updated weights for policy 1, policy_version 278750 (0.0005) [2023-12-26 01:49:13,453][123091] Updated weights for policy 0, policy_version 280249 (0.0005) [2023-12-26 01:49:13,507][123091] Updated weights for policy 0, policy_version 280259 (0.0010) [2023-12-26 01:49:13,555][123091] Updated weights for policy 0, policy_version 280269 (0.0010) [2023-12-26 01:49:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 143114240. Throughput: 0: 8764.0, 1: 8651.4. Samples: 143105516. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:13,785][121949] Avg episode reward: [(0, '6201.732'), (1, '5228.730')] [2023-12-26 01:49:14,013][123090] Updated weights for policy 1, policy_version 278760 (0.0009) [2023-12-26 01:49:14,069][123090] Updated weights for policy 1, policy_version 278770 (0.0009) [2023-12-26 01:49:14,124][123090] Updated weights for policy 1, policy_version 278781 (0.0010) [2023-12-26 01:49:14,313][123091] Updated weights for policy 0, policy_version 280279 (0.0009) [2023-12-26 01:49:14,365][123091] Updated weights for policy 0, policy_version 280290 (0.0010) [2023-12-26 01:49:14,421][123091] Updated weights for policy 0, policy_version 280300 (0.0009) [2023-12-26 01:49:14,998][123090] Updated weights for policy 1, policy_version 278792 (0.0010) [2023-12-26 01:49:15,071][123090] Updated weights for policy 1, policy_version 278802 (0.0010) [2023-12-26 01:49:15,135][123090] Updated weights for policy 1, policy_version 278812 (0.0010) [2023-12-26 01:49:15,239][123091] Updated weights for policy 0, policy_version 280310 (0.0009) [2023-12-26 01:49:15,302][123091] Updated weights for policy 0, policy_version 280320 (0.0009) [2023-12-26 01:49:15,367][123091] Updated weights for policy 0, policy_version 280330 (0.0010) [2023-12-26 01:49:15,836][123090] Updated weights for policy 1, policy_version 278822 (0.0007) [2023-12-26 01:49:15,895][123090] Updated weights for policy 1, policy_version 278832 (0.0005) [2023-12-26 01:49:15,947][123090] Updated weights for policy 1, policy_version 278842 (0.0005) [2023-12-26 01:49:16,261][123091] Updated weights for policy 0, policy_version 280340 (0.0008) [2023-12-26 01:49:16,309][123091] Updated weights for policy 0, policy_version 280350 (0.0005) [2023-12-26 01:49:16,358][123091] Updated weights for policy 0, policy_version 280360 (0.0006) [2023-12-26 01:49:16,529][123090] Updated weights for policy 1, policy_version 278852 (0.0007) [2023-12-26 01:49:16,580][123090] Updated weights for policy 1, policy_version 278862 (0.0009) [2023-12-26 01:49:16,634][123090] Updated weights for policy 1, policy_version 278872 (0.0010) [2023-12-26 01:49:17,151][123091] Updated weights for policy 0, policy_version 280370 (0.0009) [2023-12-26 01:49:17,201][123091] Updated weights for policy 0, policy_version 280380 (0.0010) [2023-12-26 01:49:17,253][123091] Updated weights for policy 0, policy_version 280390 (0.0010) [2023-12-26 01:49:17,308][123091] Updated weights for policy 0, policy_version 280400 (0.0010) [2023-12-26 01:49:17,413][123090] Updated weights for policy 1, policy_version 278882 (0.0009) [2023-12-26 01:49:17,472][123090] Updated weights for policy 1, policy_version 278892 (0.0009) [2023-12-26 01:49:17,532][123090] Updated weights for policy 1, policy_version 278902 (0.0008) [2023-12-26 01:49:17,596][123090] Updated weights for policy 1, policy_version 278912 (0.0009) [2023-12-26 01:49:18,101][123091] Updated weights for policy 0, policy_version 280410 (0.0010) [2023-12-26 01:49:18,155][123091] Updated weights for policy 0, policy_version 280420 (0.0010) [2023-12-26 01:49:18,223][123091] Updated weights for policy 0, policy_version 280430 (0.0010) [2023-12-26 01:49:18,450][123090] Updated weights for policy 1, policy_version 278922 (0.0008) [2023-12-26 01:49:18,513][123090] Updated weights for policy 1, policy_version 278932 (0.0009) [2023-12-26 01:49:18,582][123090] Updated weights for policy 1, policy_version 278942 (0.0009) [2023-12-26 01:49:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 143204352. Throughput: 0: 8711.2, 1: 8686.6. Samples: 143214684. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:18,784][121949] Avg episode reward: [(0, '6170.518'), (1, '5253.377')] [2023-12-26 01:49:19,044][123091] Updated weights for policy 0, policy_version 280440 (0.0010) [2023-12-26 01:49:19,113][123091] Updated weights for policy 0, policy_version 280450 (0.0010) [2023-12-26 01:49:19,178][123091] Updated weights for policy 0, policy_version 280460 (0.0011) [2023-12-26 01:49:19,387][123090] Updated weights for policy 1, policy_version 278952 (0.0009) [2023-12-26 01:49:19,455][123090] Updated weights for policy 1, policy_version 278962 (0.0009) [2023-12-26 01:49:19,524][123090] Updated weights for policy 1, policy_version 278972 (0.0009) [2023-12-26 01:49:20,024][123091] Updated weights for policy 0, policy_version 280470 (0.0011) [2023-12-26 01:49:20,087][123091] Updated weights for policy 0, policy_version 280480 (0.0011) [2023-12-26 01:49:20,151][123091] Updated weights for policy 0, policy_version 280490 (0.0011) [2023-12-26 01:49:20,334][123090] Updated weights for policy 1, policy_version 278982 (0.0010) [2023-12-26 01:49:20,395][123090] Updated weights for policy 1, policy_version 278992 (0.0011) [2023-12-26 01:49:20,443][123090] Updated weights for policy 1, policy_version 279002 (0.0010) [2023-12-26 01:49:20,992][123091] Updated weights for policy 0, policy_version 280500 (0.0010) [2023-12-26 01:49:21,059][123091] Updated weights for policy 0, policy_version 280510 (0.0009) [2023-12-26 01:49:21,123][123091] Updated weights for policy 0, policy_version 280520 (0.0010) [2023-12-26 01:49:21,290][123090] Updated weights for policy 1, policy_version 279012 (0.0010) [2023-12-26 01:49:21,359][123090] Updated weights for policy 1, policy_version 279022 (0.0009) [2023-12-26 01:49:21,438][123090] Updated weights for policy 1, policy_version 279032 (0.0008) [2023-12-26 01:49:22,008][123091] Updated weights for policy 0, policy_version 280530 (0.0010) [2023-12-26 01:49:22,071][123091] Updated weights for policy 0, policy_version 280540 (0.0011) [2023-12-26 01:49:22,131][123091] Updated weights for policy 0, policy_version 280550 (0.0011) [2023-12-26 01:49:22,206][123091] Updated weights for policy 0, policy_version 280560 (0.0011) [2023-12-26 01:49:22,210][123090] Updated weights for policy 1, policy_version 279042 (0.0008) [2023-12-26 01:49:22,285][123090] Updated weights for policy 1, policy_version 279052 (0.0007) [2023-12-26 01:49:22,348][123090] Updated weights for policy 1, policy_version 279062 (0.0007) [2023-12-26 01:49:22,419][123090] Updated weights for policy 1, policy_version 279072 (0.0007) [2023-12-26 01:49:23,048][123091] Updated weights for policy 0, policy_version 280570 (0.0011) [2023-12-26 01:49:23,104][123091] Updated weights for policy 0, policy_version 280580 (0.0011) [2023-12-26 01:49:23,148][123090] Updated weights for policy 1, policy_version 279082 (0.0005) [2023-12-26 01:49:23,167][123091] Updated weights for policy 0, policy_version 280590 (0.0011) [2023-12-26 01:49:23,219][123090] Updated weights for policy 1, policy_version 279092 (0.0006) [2023-12-26 01:49:23,278][123090] Updated weights for policy 1, policy_version 279102 (0.0007) [2023-12-26 01:49:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 143286272. Throughput: 0: 8661.1, 1: 8688.5. Samples: 143264812. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:23,784][121949] Avg episode reward: [(0, '6150.435'), (1, '5321.531')] [2023-12-26 01:49:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000279104_71450624.pth... [2023-12-26 01:49:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000280592_71835648.pth... [2023-12-26 01:49:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000278080_71188480.pth [2023-12-26 01:49:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000279568_71573504.pth [2023-12-26 01:49:23,991][123091] Updated weights for policy 0, policy_version 280600 (0.0011) [2023-12-26 01:49:23,995][123090] Updated weights for policy 1, policy_version 279112 (0.0010) [2023-12-26 01:49:24,039][123091] Updated weights for policy 0, policy_version 280610 (0.0010) [2023-12-26 01:49:24,043][123090] Updated weights for policy 1, policy_version 279122 (0.0010) [2023-12-26 01:49:24,098][123091] Updated weights for policy 0, policy_version 280620 (0.0011) [2023-12-26 01:49:24,111][123090] Updated weights for policy 1, policy_version 279132 (0.0008) [2023-12-26 01:49:24,902][123091] Updated weights for policy 0, policy_version 280630 (0.0007) [2023-12-26 01:49:24,932][123090] Updated weights for policy 1, policy_version 279142 (0.0010) [2023-12-26 01:49:24,964][123091] Updated weights for policy 0, policy_version 280640 (0.0009) [2023-12-26 01:49:24,991][123090] Updated weights for policy 1, policy_version 279152 (0.0009) [2023-12-26 01:49:25,024][123091] Updated weights for policy 0, policy_version 280650 (0.0009) [2023-12-26 01:49:25,048][123090] Updated weights for policy 1, policy_version 279162 (0.0009) [2023-12-26 01:49:25,840][123090] Updated weights for policy 1, policy_version 279172 (0.0007) [2023-12-26 01:49:25,881][123091] Updated weights for policy 0, policy_version 280660 (0.0009) [2023-12-26 01:49:25,889][123090] Updated weights for policy 1, policy_version 279182 (0.0005) [2023-12-26 01:49:25,942][123091] Updated weights for policy 0, policy_version 280670 (0.0009) [2023-12-26 01:49:25,943][123090] Updated weights for policy 1, policy_version 279192 (0.0005) [2023-12-26 01:49:26,004][123091] Updated weights for policy 0, policy_version 280680 (0.0008) [2023-12-26 01:49:26,748][123090] Updated weights for policy 1, policy_version 279202 (0.0009) [2023-12-26 01:49:26,807][123090] Updated weights for policy 1, policy_version 279212 (0.0010) [2023-12-26 01:49:26,840][123091] Updated weights for policy 0, policy_version 280690 (0.0008) [2023-12-26 01:49:26,862][123090] Updated weights for policy 1, policy_version 279222 (0.0010) [2023-12-26 01:49:26,899][123091] Updated weights for policy 0, policy_version 280700 (0.0006) [2023-12-26 01:49:26,923][123090] Updated weights for policy 1, policy_version 279232 (0.0008) [2023-12-26 01:49:26,956][123091] Updated weights for policy 0, policy_version 280710 (0.0009) [2023-12-26 01:49:27,015][123091] Updated weights for policy 0, policy_version 280720 (0.0009) [2023-12-26 01:49:27,714][123090] Updated weights for policy 1, policy_version 279242 (0.0009) [2023-12-26 01:49:27,765][123090] Updated weights for policy 1, policy_version 279252 (0.0008) [2023-12-26 01:49:27,818][123090] Updated weights for policy 1, policy_version 279262 (0.0009) [2023-12-26 01:49:27,865][123091] Updated weights for policy 0, policy_version 280730 (0.0010) [2023-12-26 01:49:27,912][123091] Updated weights for policy 0, policy_version 280740 (0.0010) [2023-12-26 01:49:27,962][123091] Updated weights for policy 0, policy_version 280750 (0.0010) [2023-12-26 01:49:28,606][123090] Updated weights for policy 1, policy_version 279272 (0.0007) [2023-12-26 01:49:28,662][123090] Updated weights for policy 1, policy_version 279282 (0.0006) [2023-12-26 01:49:28,711][123091] Updated weights for policy 0, policy_version 280760 (0.0010) [2023-12-26 01:49:28,722][123090] Updated weights for policy 1, policy_version 279292 (0.0005) [2023-12-26 01:49:28,766][123091] Updated weights for policy 0, policy_version 280770 (0.0010) [2023-12-26 01:49:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17744.7). Total num frames: 143376384. Throughput: 0: 8679.7, 1: 8747.9. Samples: 143370368. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:28,785][121949] Avg episode reward: [(0, '6249.732'), (1, '5326.117')] [2023-12-26 01:49:28,812][123091] Updated weights for policy 0, policy_version 280780 (0.0008) [2023-12-26 01:49:29,431][123090] Updated weights for policy 1, policy_version 279302 (0.0008) [2023-12-26 01:49:29,496][123090] Updated weights for policy 1, policy_version 279312 (0.0010) [2023-12-26 01:49:29,570][123090] Updated weights for policy 1, policy_version 279322 (0.0010) [2023-12-26 01:49:29,575][123091] Updated weights for policy 0, policy_version 280790 (0.0007) [2023-12-26 01:49:29,634][123091] Updated weights for policy 0, policy_version 280800 (0.0007) [2023-12-26 01:49:29,698][123091] Updated weights for policy 0, policy_version 280810 (0.0009) [2023-12-26 01:49:30,306][123090] Updated weights for policy 1, policy_version 279332 (0.0008) [2023-12-26 01:49:30,365][123090] Updated weights for policy 1, policy_version 279342 (0.0008) [2023-12-26 01:49:30,417][123090] Updated weights for policy 1, policy_version 279352 (0.0010) [2023-12-26 01:49:30,502][123091] Updated weights for policy 0, policy_version 280820 (0.0009) [2023-12-26 01:49:30,560][123091] Updated weights for policy 0, policy_version 280830 (0.0009) [2023-12-26 01:49:30,610][123091] Updated weights for policy 0, policy_version 280840 (0.0007) [2023-12-26 01:49:31,189][123090] Updated weights for policy 1, policy_version 279362 (0.0009) [2023-12-26 01:49:31,259][123090] Updated weights for policy 1, policy_version 279372 (0.0006) [2023-12-26 01:49:31,328][123090] Updated weights for policy 1, policy_version 279382 (0.0009) [2023-12-26 01:49:31,343][123091] Updated weights for policy 0, policy_version 280850 (0.0006) [2023-12-26 01:49:31,404][123090] Updated weights for policy 1, policy_version 279392 (0.0010) [2023-12-26 01:49:31,420][123091] Updated weights for policy 0, policy_version 280860 (0.0008) [2023-12-26 01:49:31,479][123091] Updated weights for policy 0, policy_version 280870 (0.0009) [2023-12-26 01:49:31,528][123091] Updated weights for policy 0, policy_version 280880 (0.0009) [2023-12-26 01:49:32,215][123090] Updated weights for policy 1, policy_version 279402 (0.0010) [2023-12-26 01:49:32,281][123090] Updated weights for policy 1, policy_version 279412 (0.0011) [2023-12-26 01:49:32,327][123091] Updated weights for policy 0, policy_version 280890 (0.0007) [2023-12-26 01:49:32,348][123090] Updated weights for policy 1, policy_version 279422 (0.0010) [2023-12-26 01:49:32,392][123091] Updated weights for policy 0, policy_version 280900 (0.0009) [2023-12-26 01:49:32,459][123091] Updated weights for policy 0, policy_version 280910 (0.0009) [2023-12-26 01:49:33,103][123090] Updated weights for policy 1, policy_version 279432 (0.0010) [2023-12-26 01:49:33,157][123090] Updated weights for policy 1, policy_version 279442 (0.0010) [2023-12-26 01:49:33,214][123090] Updated weights for policy 1, policy_version 279452 (0.0010) [2023-12-26 01:49:33,309][123091] Updated weights for policy 0, policy_version 280920 (0.0009) [2023-12-26 01:49:33,360][123091] Updated weights for policy 0, policy_version 280930 (0.0008) [2023-12-26 01:49:33,410][123091] Updated weights for policy 0, policy_version 280940 (0.0008) [2023-12-26 01:49:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 143466496. Throughput: 0: 8753.4, 1: 8778.4. Samples: 143478624. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:33,784][121949] Avg episode reward: [(0, '6251.630'), (1, '5446.667')] [2023-12-26 01:49:33,950][123090] Updated weights for policy 1, policy_version 279462 (0.0010) [2023-12-26 01:49:34,011][123090] Updated weights for policy 1, policy_version 279472 (0.0009) [2023-12-26 01:49:34,078][123090] Updated weights for policy 1, policy_version 279482 (0.0009) [2023-12-26 01:49:34,228][123091] Updated weights for policy 0, policy_version 280950 (0.0008) [2023-12-26 01:49:34,284][123091] Updated weights for policy 0, policy_version 280960 (0.0008) [2023-12-26 01:49:34,339][123091] Updated weights for policy 0, policy_version 280970 (0.0008) [2023-12-26 01:49:34,908][123090] Updated weights for policy 1, policy_version 279492 (0.0008) [2023-12-26 01:49:34,963][123090] Updated weights for policy 1, policy_version 279502 (0.0008) [2023-12-26 01:49:35,009][123090] Updated weights for policy 1, policy_version 279512 (0.0006) [2023-12-26 01:49:35,082][123091] Updated weights for policy 0, policy_version 280980 (0.0007) [2023-12-26 01:49:35,134][123091] Updated weights for policy 0, policy_version 280990 (0.0005) [2023-12-26 01:49:35,189][123091] Updated weights for policy 0, policy_version 281000 (0.0005) [2023-12-26 01:49:35,812][123091] Updated weights for policy 0, policy_version 281010 (0.0005) [2023-12-26 01:49:35,875][123091] Updated weights for policy 0, policy_version 281020 (0.0005) [2023-12-26 01:49:35,901][123090] Updated weights for policy 1, policy_version 279522 (0.0007) [2023-12-26 01:49:35,939][123091] Updated weights for policy 0, policy_version 281030 (0.0007) [2023-12-26 01:49:35,949][123090] Updated weights for policy 1, policy_version 279532 (0.0009) [2023-12-26 01:49:35,997][123090] Updated weights for policy 1, policy_version 279542 (0.0008) [2023-12-26 01:49:36,001][123091] Updated weights for policy 0, policy_version 281040 (0.0010) [2023-12-26 01:49:36,056][123090] Updated weights for policy 1, policy_version 279552 (0.0008) [2023-12-26 01:49:36,729][123091] Updated weights for policy 0, policy_version 281050 (0.0009) [2023-12-26 01:49:36,802][123091] Updated weights for policy 0, policy_version 281060 (0.0006) [2023-12-26 01:49:36,871][123091] Updated weights for policy 0, policy_version 281070 (0.0005) [2023-12-26 01:49:36,995][123090] Updated weights for policy 1, policy_version 279562 (0.0010) [2023-12-26 01:49:37,062][123090] Updated weights for policy 1, policy_version 279572 (0.0010) [2023-12-26 01:49:37,125][123090] Updated weights for policy 1, policy_version 279582 (0.0009) [2023-12-26 01:49:37,581][123091] Updated weights for policy 0, policy_version 281080 (0.0010) [2023-12-26 01:49:37,645][123091] Updated weights for policy 0, policy_version 281090 (0.0011) [2023-12-26 01:49:37,698][123091] Updated weights for policy 0, policy_version 281100 (0.0010) [2023-12-26 01:49:37,994][123090] Updated weights for policy 1, policy_version 279592 (0.0009) [2023-12-26 01:49:38,047][123090] Updated weights for policy 1, policy_version 279602 (0.0009) [2023-12-26 01:49:38,107][123090] Updated weights for policy 1, policy_version 279612 (0.0009) [2023-12-26 01:49:38,499][123091] Updated weights for policy 0, policy_version 281110 (0.0011) [2023-12-26 01:49:38,566][123091] Updated weights for policy 0, policy_version 281120 (0.0011) [2023-12-26 01:49:38,629][123091] Updated weights for policy 0, policy_version 281130 (0.0011) [2023-12-26 01:49:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 143556608. Throughput: 0: 8851.7, 1: 8785.6. Samples: 143533172. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:38,784][121949] Avg episode reward: [(0, '6282.060'), (1, '5476.019')] [2023-12-26 01:49:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000281136_71974912.pth... [2023-12-26 01:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000279616_71581696.pth... [2023-12-26 01:49:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000280112_71712768.pth [2023-12-26 01:49:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000278592_71319552.pth [2023-12-26 01:49:38,803][123007] Saving new best policy, reward=6282.060! [2023-12-26 01:49:38,943][123090] Updated weights for policy 1, policy_version 279622 (0.0009) [2023-12-26 01:49:39,004][123090] Updated weights for policy 1, policy_version 279632 (0.0009) [2023-12-26 01:49:39,057][123090] Updated weights for policy 1, policy_version 279642 (0.0009) [2023-12-26 01:49:39,451][123091] Updated weights for policy 0, policy_version 281140 (0.0010) [2023-12-26 01:49:39,517][123091] Updated weights for policy 0, policy_version 281150 (0.0010) [2023-12-26 01:49:39,584][123091] Updated weights for policy 0, policy_version 281160 (0.0010) [2023-12-26 01:49:39,944][123090] Updated weights for policy 1, policy_version 279652 (0.0009) [2023-12-26 01:49:40,010][123090] Updated weights for policy 1, policy_version 279662 (0.0009) [2023-12-26 01:49:40,081][123090] Updated weights for policy 1, policy_version 279672 (0.0010) [2023-12-26 01:49:40,380][123091] Updated weights for policy 0, policy_version 281170 (0.0010) [2023-12-26 01:49:40,442][123091] Updated weights for policy 0, policy_version 281180 (0.0009) [2023-12-26 01:49:40,496][123091] Updated weights for policy 0, policy_version 281190 (0.0009) [2023-12-26 01:49:40,551][123091] Updated weights for policy 0, policy_version 281200 (0.0010) [2023-12-26 01:49:40,843][123090] Updated weights for policy 1, policy_version 279682 (0.0008) [2023-12-26 01:49:40,899][123090] Updated weights for policy 1, policy_version 279692 (0.0007) [2023-12-26 01:49:40,961][123090] Updated weights for policy 1, policy_version 279702 (0.0008) [2023-12-26 01:49:41,019][123090] Updated weights for policy 1, policy_version 279712 (0.0006) [2023-12-26 01:49:41,517][123091] Updated weights for policy 0, policy_version 281210 (0.0009) [2023-12-26 01:49:41,589][123091] Updated weights for policy 0, policy_version 281220 (0.0008) [2023-12-26 01:49:41,667][123091] Updated weights for policy 0, policy_version 281230 (0.0008) [2023-12-26 01:49:41,819][123090] Updated weights for policy 1, policy_version 279722 (0.0010) [2023-12-26 01:49:41,888][123090] Updated weights for policy 1, policy_version 279732 (0.0010) [2023-12-26 01:49:41,962][123090] Updated weights for policy 1, policy_version 279742 (0.0010) [2023-12-26 01:49:42,330][123091] Updated weights for policy 0, policy_version 281240 (0.0008) [2023-12-26 01:49:42,398][123091] Updated weights for policy 0, policy_version 281250 (0.0009) [2023-12-26 01:49:42,463][123091] Updated weights for policy 0, policy_version 281260 (0.0009) [2023-12-26 01:49:42,788][123090] Updated weights for policy 1, policy_version 279752 (0.0009) [2023-12-26 01:49:42,847][123090] Updated weights for policy 1, policy_version 279762 (0.0009) [2023-12-26 01:49:42,915][123090] Updated weights for policy 1, policy_version 279772 (0.0010) [2023-12-26 01:49:43,224][123091] Updated weights for policy 0, policy_version 281270 (0.0009) [2023-12-26 01:49:43,286][123091] Updated weights for policy 0, policy_version 281280 (0.0009) [2023-12-26 01:49:43,352][123091] Updated weights for policy 0, policy_version 281290 (0.0010) [2023-12-26 01:49:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17772.5). Total num frames: 143638528. Throughput: 0: 8709.5, 1: 8829.2. Samples: 143635572. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:43,784][121949] Avg episode reward: [(0, '6286.683'), (1, '5554.897')] [2023-12-26 01:49:43,785][123007] Saving new best policy, reward=6286.683! [2023-12-26 01:49:43,790][123090] Updated weights for policy 1, policy_version 279782 (0.0009) [2023-12-26 01:49:43,850][123090] Updated weights for policy 1, policy_version 279792 (0.0009) [2023-12-26 01:49:43,917][123090] Updated weights for policy 1, policy_version 279802 (0.0009) [2023-12-26 01:49:44,091][123091] Updated weights for policy 0, policy_version 281300 (0.0007) [2023-12-26 01:49:44,148][123091] Updated weights for policy 0, policy_version 281310 (0.0005) [2023-12-26 01:49:44,201][123091] Updated weights for policy 0, policy_version 281320 (0.0005) [2023-12-26 01:49:44,728][123090] Updated weights for policy 1, policy_version 279812 (0.0008) [2023-12-26 01:49:44,789][123090] Updated weights for policy 1, policy_version 279822 (0.0006) [2023-12-26 01:49:44,855][123090] Updated weights for policy 1, policy_version 279832 (0.0010) [2023-12-26 01:49:45,028][123091] Updated weights for policy 0, policy_version 281330 (0.0010) [2023-12-26 01:49:45,082][123091] Updated weights for policy 0, policy_version 281340 (0.0009) [2023-12-26 01:49:45,145][123091] Updated weights for policy 0, policy_version 281350 (0.0010) [2023-12-26 01:49:45,210][123091] Updated weights for policy 0, policy_version 281360 (0.0010) [2023-12-26 01:49:45,657][123090] Updated weights for policy 1, policy_version 279842 (0.0010) [2023-12-26 01:49:45,710][123090] Updated weights for policy 1, policy_version 279852 (0.0009) [2023-12-26 01:49:45,762][123090] Updated weights for policy 1, policy_version 279862 (0.0009) [2023-12-26 01:49:45,816][123090] Updated weights for policy 1, policy_version 279872 (0.0010) [2023-12-26 01:49:46,075][123091] Updated weights for policy 0, policy_version 281370 (0.0010) [2023-12-26 01:49:46,125][123091] Updated weights for policy 0, policy_version 281381 (0.0010) [2023-12-26 01:49:46,176][123091] Updated weights for policy 0, policy_version 281391 (0.0010) [2023-12-26 01:49:46,634][123090] Updated weights for policy 1, policy_version 279882 (0.0010) [2023-12-26 01:49:46,701][123090] Updated weights for policy 1, policy_version 279892 (0.0009) [2023-12-26 01:49:46,765][123090] Updated weights for policy 1, policy_version 279902 (0.0009) [2023-12-26 01:49:47,045][123091] Updated weights for policy 0, policy_version 281401 (0.0008) [2023-12-26 01:49:47,099][123091] Updated weights for policy 0, policy_version 281411 (0.0006) [2023-12-26 01:49:47,158][123091] Updated weights for policy 0, policy_version 281421 (0.0006) [2023-12-26 01:49:47,631][123090] Updated weights for policy 1, policy_version 279912 (0.0009) [2023-12-26 01:49:47,713][123090] Updated weights for policy 1, policy_version 279922 (0.0010) [2023-12-26 01:49:47,794][123090] Updated weights for policy 1, policy_version 279932 (0.0009) [2023-12-26 01:49:47,905][123091] Updated weights for policy 0, policy_version 281431 (0.0008) [2023-12-26 01:49:47,970][123091] Updated weights for policy 0, policy_version 281441 (0.0008) [2023-12-26 01:49:48,035][123091] Updated weights for policy 0, policy_version 281451 (0.0008) [2023-12-26 01:49:48,642][123090] Updated weights for policy 1, policy_version 279942 (0.0009) [2023-12-26 01:49:48,670][123091] Updated weights for policy 0, policy_version 281461 (0.0008) [2023-12-26 01:49:48,701][123090] Updated weights for policy 1, policy_version 279952 (0.0009) [2023-12-26 01:49:48,738][123091] Updated weights for policy 0, policy_version 281471 (0.0007) [2023-12-26 01:49:48,752][123090] Updated weights for policy 1, policy_version 279962 (0.0008) [2023-12-26 01:49:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17717.0). Total num frames: 143720448. Throughput: 0: 8774.4, 1: 8787.6. Samples: 143740720. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:48,785][121949] Avg episode reward: [(0, '6374.160'), (1, '5562.464')] [2023-12-26 01:49:48,803][123091] Updated weights for policy 0, policy_version 281481 (0.0010) [2023-12-26 01:49:48,837][123007] Saving new best policy, reward=6374.160! [2023-12-26 01:49:49,584][123090] Updated weights for policy 1, policy_version 279972 (0.0008) [2023-12-26 01:49:49,595][123091] Updated weights for policy 0, policy_version 281491 (0.0008) [2023-12-26 01:49:49,657][123091] Updated weights for policy 0, policy_version 281501 (0.0007) [2023-12-26 01:49:49,659][123090] Updated weights for policy 1, policy_version 279982 (0.0005) [2023-12-26 01:49:49,717][123091] Updated weights for policy 0, policy_version 281511 (0.0009) [2023-12-26 01:49:49,730][123090] Updated weights for policy 1, policy_version 279992 (0.0006) [2023-12-26 01:49:50,400][123091] Updated weights for policy 0, policy_version 281521 (0.0006) [2023-12-26 01:49:50,432][123090] Updated weights for policy 1, policy_version 280002 (0.0006) [2023-12-26 01:49:50,464][123091] Updated weights for policy 0, policy_version 281531 (0.0009) [2023-12-26 01:49:50,481][123090] Updated weights for policy 1, policy_version 280012 (0.0005) [2023-12-26 01:49:50,521][123091] Updated weights for policy 0, policy_version 281541 (0.0010) [2023-12-26 01:49:50,528][123090] Updated weights for policy 1, policy_version 280022 (0.0005) [2023-12-26 01:49:50,575][123091] Updated weights for policy 0, policy_version 281551 (0.0008) [2023-12-26 01:49:50,603][123090] Updated weights for policy 1, policy_version 280032 (0.0008) [2023-12-26 01:49:51,422][123091] Updated weights for policy 0, policy_version 281561 (0.0010) [2023-12-26 01:49:51,456][123090] Updated weights for policy 1, policy_version 280042 (0.0008) [2023-12-26 01:49:51,480][123091] Updated weights for policy 0, policy_version 281571 (0.0008) [2023-12-26 01:49:51,519][123090] Updated weights for policy 1, policy_version 280052 (0.0010) [2023-12-26 01:49:51,538][123091] Updated weights for policy 0, policy_version 281581 (0.0008) [2023-12-26 01:49:51,582][123090] Updated weights for policy 1, policy_version 280062 (0.0007) [2023-12-26 01:49:52,371][123090] Updated weights for policy 1, policy_version 280072 (0.0008) [2023-12-26 01:49:52,425][123091] Updated weights for policy 0, policy_version 281591 (0.0009) [2023-12-26 01:49:52,433][123090] Updated weights for policy 1, policy_version 280082 (0.0008) [2023-12-26 01:49:52,483][123090] Updated weights for policy 1, policy_version 280092 (0.0008) [2023-12-26 01:49:52,484][123091] Updated weights for policy 0, policy_version 281601 (0.0009) [2023-12-26 01:49:52,534][123091] Updated weights for policy 0, policy_version 281611 (0.0009) [2023-12-26 01:49:53,247][123090] Updated weights for policy 1, policy_version 280102 (0.0005) [2023-12-26 01:49:53,314][123090] Updated weights for policy 1, policy_version 280112 (0.0008) [2023-12-26 01:49:53,382][123090] Updated weights for policy 1, policy_version 280122 (0.0009) [2023-12-26 01:49:53,389][123091] Updated weights for policy 0, policy_version 281621 (0.0008) [2023-12-26 01:49:53,445][123091] Updated weights for policy 0, policy_version 281631 (0.0008) [2023-12-26 01:49:53,503][123091] Updated weights for policy 0, policy_version 281641 (0.0010) [2023-12-26 01:49:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 143818752. Throughput: 0: 8811.7, 1: 8786.1. Samples: 143794544. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:53,785][121949] Avg episode reward: [(0, '6328.743'), (1, '5630.617')] [2023-12-26 01:49:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000281648_72105984.pth... [2023-12-26 01:49:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000280128_71712768.pth... [2023-12-26 01:49:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000280592_71835648.pth [2023-12-26 01:49:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000279104_71450624.pth [2023-12-26 01:49:54,033][123090] Updated weights for policy 1, policy_version 280132 (0.0009) [2023-12-26 01:49:54,091][123090] Updated weights for policy 1, policy_version 280142 (0.0009) [2023-12-26 01:49:54,144][123090] Updated weights for policy 1, policy_version 280152 (0.0010) [2023-12-26 01:49:54,368][123091] Updated weights for policy 0, policy_version 281651 (0.0010) [2023-12-26 01:49:54,415][123091] Updated weights for policy 0, policy_version 281661 (0.0009) [2023-12-26 01:49:54,471][123091] Updated weights for policy 0, policy_version 281671 (0.0009) [2023-12-26 01:49:54,906][123090] Updated weights for policy 1, policy_version 280162 (0.0009) [2023-12-26 01:49:54,967][123090] Updated weights for policy 1, policy_version 280172 (0.0006) [2023-12-26 01:49:55,029][123090] Updated weights for policy 1, policy_version 280182 (0.0006) [2023-12-26 01:49:55,087][123090] Updated weights for policy 1, policy_version 280192 (0.0005) [2023-12-26 01:49:55,392][123091] Updated weights for policy 0, policy_version 281681 (0.0010) [2023-12-26 01:49:55,447][123091] Updated weights for policy 0, policy_version 281691 (0.0009) [2023-12-26 01:49:55,502][123091] Updated weights for policy 0, policy_version 281701 (0.0008) [2023-12-26 01:49:55,548][123091] Updated weights for policy 0, policy_version 281711 (0.0008) [2023-12-26 01:49:55,658][123090] Updated weights for policy 1, policy_version 280202 (0.0010) [2023-12-26 01:49:55,712][123090] Updated weights for policy 1, policy_version 280212 (0.0010) [2023-12-26 01:49:55,779][123090] Updated weights for policy 1, policy_version 280222 (0.0009) [2023-12-26 01:49:56,405][123091] Updated weights for policy 0, policy_version 281721 (0.0010) [2023-12-26 01:49:56,462][123090] Updated weights for policy 1, policy_version 280232 (0.0006) [2023-12-26 01:49:56,462][123091] Updated weights for policy 0, policy_version 281731 (0.0009) [2023-12-26 01:49:56,514][123090] Updated weights for policy 1, policy_version 280242 (0.0005) [2023-12-26 01:49:56,516][123091] Updated weights for policy 0, policy_version 281741 (0.0009) [2023-12-26 01:49:56,580][123090] Updated weights for policy 1, policy_version 280252 (0.0007) [2023-12-26 01:49:57,361][123091] Updated weights for policy 0, policy_version 281752 (0.0008) [2023-12-26 01:49:57,376][123090] Updated weights for policy 1, policy_version 280262 (0.0009) [2023-12-26 01:49:57,409][123091] Updated weights for policy 0, policy_version 281762 (0.0009) [2023-12-26 01:49:57,425][123090] Updated weights for policy 1, policy_version 280272 (0.0005) [2023-12-26 01:49:57,460][123091] Updated weights for policy 0, policy_version 281772 (0.0009) [2023-12-26 01:49:57,478][123090] Updated weights for policy 1, policy_version 280282 (0.0005) [2023-12-26 01:49:58,235][123090] Updated weights for policy 1, policy_version 280292 (0.0007) [2023-12-26 01:49:58,288][123090] Updated weights for policy 1, policy_version 280302 (0.0010) [2023-12-26 01:49:58,357][123090] Updated weights for policy 1, policy_version 280312 (0.0009) [2023-12-26 01:49:58,367][123091] Updated weights for policy 0, policy_version 281782 (0.0008) [2023-12-26 01:49:58,441][123091] Updated weights for policy 0, policy_version 281793 (0.0009) [2023-12-26 01:49:58,498][123091] Updated weights for policy 0, policy_version 281803 (0.0010) [2023-12-26 01:49:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 143908864. Throughput: 0: 8799.6, 1: 8880.8. Samples: 143901128. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:49:58,784][121949] Avg episode reward: [(0, '6318.469'), (1, '5438.886')] [2023-12-26 01:49:59,168][123090] Updated weights for policy 1, policy_version 280322 (0.0007) [2023-12-26 01:49:59,231][123090] Updated weights for policy 1, policy_version 280332 (0.0006) [2023-12-26 01:49:59,298][123090] Updated weights for policy 1, policy_version 280342 (0.0008) [2023-12-26 01:49:59,376][123090] Updated weights for policy 1, policy_version 280352 (0.0008) [2023-12-26 01:49:59,409][123091] Updated weights for policy 0, policy_version 281813 (0.0007) [2023-12-26 01:49:59,464][123091] Updated weights for policy 0, policy_version 281823 (0.0005) [2023-12-26 01:49:59,520][123091] Updated weights for policy 0, policy_version 281833 (0.0006) [2023-12-26 01:50:00,188][123091] Updated weights for policy 0, policy_version 281843 (0.0005) [2023-12-26 01:50:00,197][123090] Updated weights for policy 1, policy_version 280362 (0.0008) [2023-12-26 01:50:00,245][123091] Updated weights for policy 0, policy_version 281853 (0.0006) [2023-12-26 01:50:00,266][123090] Updated weights for policy 1, policy_version 280372 (0.0008) [2023-12-26 01:50:00,299][123091] Updated weights for policy 0, policy_version 281863 (0.0006) [2023-12-26 01:50:00,324][123090] Updated weights for policy 1, policy_version 280382 (0.0008) [2023-12-26 01:50:01,019][123091] Updated weights for policy 0, policy_version 281873 (0.0006) [2023-12-26 01:50:01,078][123091] Updated weights for policy 0, policy_version 281883 (0.0011) [2023-12-26 01:50:01,125][123090] Updated weights for policy 1, policy_version 280392 (0.0008) [2023-12-26 01:50:01,135][123091] Updated weights for policy 0, policy_version 281893 (0.0008) [2023-12-26 01:50:01,187][123091] Updated weights for policy 0, policy_version 281903 (0.0007) [2023-12-26 01:50:01,194][123090] Updated weights for policy 1, policy_version 280402 (0.0008) [2023-12-26 01:50:01,260][123090] Updated weights for policy 1, policy_version 280412 (0.0008) [2023-12-26 01:50:01,965][123091] Updated weights for policy 0, policy_version 281913 (0.0007) [2023-12-26 01:50:02,019][123090] Updated weights for policy 1, policy_version 280422 (0.0008) [2023-12-26 01:50:02,028][123091] Updated weights for policy 0, policy_version 281923 (0.0007) [2023-12-26 01:50:02,092][123090] Updated weights for policy 1, policy_version 280432 (0.0007) [2023-12-26 01:50:02,095][123091] Updated weights for policy 0, policy_version 281933 (0.0006) [2023-12-26 01:50:02,144][123090] Updated weights for policy 1, policy_version 280442 (0.0010) [2023-12-26 01:50:02,825][123091] Updated weights for policy 0, policy_version 281943 (0.0006) [2023-12-26 01:50:02,892][123091] Updated weights for policy 0, policy_version 281953 (0.0005) [2023-12-26 01:50:02,919][123090] Updated weights for policy 1, policy_version 280452 (0.0009) [2023-12-26 01:50:02,952][123091] Updated weights for policy 0, policy_version 281963 (0.0005) [2023-12-26 01:50:02,989][123090] Updated weights for policy 1, policy_version 280462 (0.0008) [2023-12-26 01:50:03,050][123090] Updated weights for policy 1, policy_version 280472 (0.0008) [2023-12-26 01:50:03,676][123090] Updated weights for policy 1, policy_version 280482 (0.0007) [2023-12-26 01:50:03,702][123091] Updated weights for policy 0, policy_version 281973 (0.0006) [2023-12-26 01:50:03,738][123090] Updated weights for policy 1, policy_version 280492 (0.0005) [2023-12-26 01:50:03,760][123091] Updated weights for policy 0, policy_version 281983 (0.0006) [2023-12-26 01:50:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 143990784. Throughput: 0: 8811.1, 1: 8875.9. Samples: 144010600. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:50:03,785][121949] Avg episode reward: [(0, '6366.583'), (1, '5433.192')] [2023-12-26 01:50:03,797][123090] Updated weights for policy 1, policy_version 280502 (0.0005) [2023-12-26 01:50:03,816][123091] Updated weights for policy 0, policy_version 281993 (0.0007) [2023-12-26 01:50:03,867][123090] Updated weights for policy 1, policy_version 280512 (0.0007) [2023-12-26 01:50:04,543][123091] Updated weights for policy 0, policy_version 282003 (0.0009) [2023-12-26 01:50:04,602][123090] Updated weights for policy 1, policy_version 280522 (0.0007) [2023-12-26 01:50:04,606][123091] Updated weights for policy 0, policy_version 282013 (0.0011) [2023-12-26 01:50:04,668][123090] Updated weights for policy 1, policy_version 280532 (0.0009) [2023-12-26 01:50:04,677][123091] Updated weights for policy 0, policy_version 282023 (0.0009) [2023-12-26 01:50:04,734][123090] Updated weights for policy 1, policy_version 280542 (0.0007) [2023-12-26 01:50:05,435][123090] Updated weights for policy 1, policy_version 280552 (0.0005) [2023-12-26 01:50:05,496][123090] Updated weights for policy 1, policy_version 280563 (0.0008) [2023-12-26 01:50:05,499][123091] Updated weights for policy 0, policy_version 282033 (0.0009) [2023-12-26 01:50:05,559][123091] Updated weights for policy 0, policy_version 282043 (0.0008) [2023-12-26 01:50:05,560][123090] Updated weights for policy 1, policy_version 280573 (0.0005) [2023-12-26 01:50:05,622][123091] Updated weights for policy 0, policy_version 282053 (0.0009) [2023-12-26 01:50:05,693][123091] Updated weights for policy 0, policy_version 282063 (0.0009) [2023-12-26 01:50:06,271][123090] Updated weights for policy 1, policy_version 280583 (0.0008) [2023-12-26 01:50:06,343][123090] Updated weights for policy 1, policy_version 280593 (0.0009) [2023-12-26 01:50:06,413][123090] Updated weights for policy 1, policy_version 280603 (0.0009) [2023-12-26 01:50:06,570][123091] Updated weights for policy 0, policy_version 282073 (0.0010) [2023-12-26 01:50:06,633][123091] Updated weights for policy 0, policy_version 282083 (0.0009) [2023-12-26 01:50:06,701][123091] Updated weights for policy 0, policy_version 282093 (0.0010) [2023-12-26 01:50:07,212][123090] Updated weights for policy 1, policy_version 280613 (0.0009) [2023-12-26 01:50:07,286][123090] Updated weights for policy 1, policy_version 280623 (0.0008) [2023-12-26 01:50:07,348][123090] Updated weights for policy 1, policy_version 280633 (0.0008) [2023-12-26 01:50:07,537][123091] Updated weights for policy 0, policy_version 282103 (0.0010) [2023-12-26 01:50:07,612][123091] Updated weights for policy 0, policy_version 282113 (0.0009) [2023-12-26 01:50:07,663][123091] Updated weights for policy 0, policy_version 282123 (0.0009) [2023-12-26 01:50:08,085][123090] Updated weights for policy 1, policy_version 280643 (0.0008) [2023-12-26 01:50:08,145][123090] Updated weights for policy 1, policy_version 280653 (0.0005) [2023-12-26 01:50:08,200][123090] Updated weights for policy 1, policy_version 280663 (0.0005) [2023-12-26 01:50:08,442][123091] Updated weights for policy 0, policy_version 282133 (0.0010) [2023-12-26 01:50:08,495][123091] Updated weights for policy 0, policy_version 282143 (0.0009) [2023-12-26 01:50:08,561][123091] Updated weights for policy 0, policy_version 282153 (0.0007) [2023-12-26 01:50:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 144089088. Throughput: 0: 8823.2, 1: 8945.0. Samples: 144064380. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:50:08,785][121949] Avg episode reward: [(0, '6324.857'), (1, '5560.799')] [2023-12-26 01:50:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000282160_72237056.pth... [2023-12-26 01:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000280672_71852032.pth... [2023-12-26 01:50:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000281136_71974912.pth [2023-12-26 01:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000279616_71581696.pth [2023-12-26 01:50:08,969][123090] Updated weights for policy 1, policy_version 280673 (0.0006) [2023-12-26 01:50:09,026][123090] Updated weights for policy 1, policy_version 280683 (0.0010) [2023-12-26 01:50:09,075][123090] Updated weights for policy 1, policy_version 280693 (0.0009) [2023-12-26 01:50:09,142][123090] Updated weights for policy 1, policy_version 280703 (0.0009) [2023-12-26 01:50:09,343][123091] Updated weights for policy 0, policy_version 282163 (0.0009) [2023-12-26 01:50:09,420][123091] Updated weights for policy 0, policy_version 282173 (0.0010) [2023-12-26 01:50:09,484][123091] Updated weights for policy 0, policy_version 282183 (0.0008) [2023-12-26 01:50:09,948][123090] Updated weights for policy 1, policy_version 280713 (0.0008) [2023-12-26 01:50:10,009][123090] Updated weights for policy 1, policy_version 280723 (0.0013) [2023-12-26 01:50:10,067][123090] Updated weights for policy 1, policy_version 280733 (0.0009) [2023-12-26 01:50:10,321][123091] Updated weights for policy 0, policy_version 282193 (0.0006) [2023-12-26 01:50:10,386][123091] Updated weights for policy 0, policy_version 282203 (0.0008) [2023-12-26 01:50:10,445][123091] Updated weights for policy 0, policy_version 282213 (0.0005) [2023-12-26 01:50:10,495][123091] Updated weights for policy 0, policy_version 282223 (0.0005) [2023-12-26 01:50:10,771][123090] Updated weights for policy 1, policy_version 280743 (0.0007) [2023-12-26 01:50:10,832][123090] Updated weights for policy 1, policy_version 280753 (0.0005) [2023-12-26 01:50:10,907][123090] Updated weights for policy 1, policy_version 280763 (0.0006) [2023-12-26 01:50:11,334][123091] Updated weights for policy 0, policy_version 282233 (0.0009) [2023-12-26 01:50:11,401][123091] Updated weights for policy 0, policy_version 282243 (0.0009) [2023-12-26 01:50:11,465][123091] Updated weights for policy 0, policy_version 282253 (0.0008) [2023-12-26 01:50:11,643][123090] Updated weights for policy 1, policy_version 280773 (0.0007) [2023-12-26 01:50:11,710][123090] Updated weights for policy 1, policy_version 280783 (0.0009) [2023-12-26 01:50:11,790][123090] Updated weights for policy 1, policy_version 280793 (0.0008) [2023-12-26 01:50:12,345][123091] Updated weights for policy 0, policy_version 282263 (0.0009) [2023-12-26 01:50:12,416][123091] Updated weights for policy 0, policy_version 282273 (0.0009) [2023-12-26 01:50:12,475][123091] Updated weights for policy 0, policy_version 282283 (0.0010) [2023-12-26 01:50:12,625][123090] Updated weights for policy 1, policy_version 280803 (0.0009) [2023-12-26 01:50:12,688][123090] Updated weights for policy 1, policy_version 280813 (0.0010) [2023-12-26 01:50:12,759][123090] Updated weights for policy 1, policy_version 280823 (0.0009) [2023-12-26 01:50:13,228][123091] Updated weights for policy 0, policy_version 282293 (0.0009) [2023-12-26 01:50:13,297][123091] Updated weights for policy 0, policy_version 282303 (0.0009) [2023-12-26 01:50:13,370][123091] Updated weights for policy 0, policy_version 282313 (0.0009) [2023-12-26 01:50:13,590][123090] Updated weights for policy 1, policy_version 280833 (0.0010) [2023-12-26 01:50:13,640][123090] Updated weights for policy 1, policy_version 280843 (0.0009) [2023-12-26 01:50:13,697][123090] Updated weights for policy 1, policy_version 280853 (0.0010) [2023-12-26 01:50:13,760][123090] Updated weights for policy 1, policy_version 280863 (0.0010) [2023-12-26 01:50:13,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 144179200. Throughput: 0: 8833.5, 1: 8915.1. Samples: 144169056. Policy #0 lag: (min: 7.0, avg: 31.2, max: 32.0) [2023-12-26 01:50:13,785][121949] Avg episode reward: [(0, '6324.896'), (1, '5512.000')] [2023-12-26 01:50:14,149][123091] Updated weights for policy 0, policy_version 282323 (0.0009) [2023-12-26 01:50:14,215][123091] Updated weights for policy 0, policy_version 282333 (0.0010) [2023-12-26 01:50:14,277][123091] Updated weights for policy 0, policy_version 282343 (0.0009) [2023-12-26 01:50:14,592][123090] Updated weights for policy 1, policy_version 280873 (0.0009) [2023-12-26 01:50:14,648][123090] Updated weights for policy 1, policy_version 280883 (0.0009) [2023-12-26 01:50:14,702][123090] Updated weights for policy 1, policy_version 280893 (0.0009) [2023-12-26 01:50:15,103][123091] Updated weights for policy 0, policy_version 282353 (0.0010) [2023-12-26 01:50:15,162][123091] Updated weights for policy 0, policy_version 282363 (0.0010) [2023-12-26 01:50:15,231][123091] Updated weights for policy 0, policy_version 282373 (0.0009) [2023-12-26 01:50:15,298][123091] Updated weights for policy 0, policy_version 282383 (0.0010) [2023-12-26 01:50:15,543][123090] Updated weights for policy 1, policy_version 280903 (0.0009) [2023-12-26 01:50:15,608][123090] Updated weights for policy 1, policy_version 280913 (0.0009) [2023-12-26 01:50:15,676][123090] Updated weights for policy 1, policy_version 280923 (0.0005) [2023-12-26 01:50:16,141][123091] Updated weights for policy 0, policy_version 282393 (0.0010) [2023-12-26 01:50:16,189][123091] Updated weights for policy 0, policy_version 282403 (0.0009) [2023-12-26 01:50:16,242][123091] Updated weights for policy 0, policy_version 282413 (0.0009) [2023-12-26 01:50:16,456][123090] Updated weights for policy 1, policy_version 280933 (0.0006) [2023-12-26 01:50:16,514][123090] Updated weights for policy 1, policy_version 280943 (0.0005) [2023-12-26 01:50:16,577][123090] Updated weights for policy 1, policy_version 280953 (0.0008) [2023-12-26 01:50:17,049][123091] Updated weights for policy 0, policy_version 282424 (0.0010) [2023-12-26 01:50:17,100][123091] Updated weights for policy 0, policy_version 282434 (0.0009) [2023-12-26 01:50:17,154][123091] Updated weights for policy 0, policy_version 282444 (0.0008) [2023-12-26 01:50:17,384][123090] Updated weights for policy 1, policy_version 280963 (0.0009) [2023-12-26 01:50:17,443][123090] Updated weights for policy 1, policy_version 280974 (0.0010) [2023-12-26 01:50:17,491][123090] Updated weights for policy 1, policy_version 280984 (0.0009) [2023-12-26 01:50:17,963][123091] Updated weights for policy 0, policy_version 282454 (0.0009) [2023-12-26 01:50:18,020][123091] Updated weights for policy 0, policy_version 282464 (0.0009) [2023-12-26 01:50:18,075][123091] Updated weights for policy 0, policy_version 282474 (0.0009) [2023-12-26 01:50:18,347][123090] Updated weights for policy 1, policy_version 280994 (0.0009) [2023-12-26 01:50:18,396][123090] Updated weights for policy 1, policy_version 281004 (0.0010) [2023-12-26 01:50:18,446][123090] Updated weights for policy 1, policy_version 281014 (0.0009) [2023-12-26 01:50:18,496][123090] Updated weights for policy 1, policy_version 281024 (0.0008) [2023-12-26 01:50:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 144261120. Throughput: 0: 8799.8, 1: 8842.3. Samples: 144272520. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:18,785][121949] Avg episode reward: [(0, '6350.848'), (1, '5506.831')] [2023-12-26 01:50:18,949][123091] Updated weights for policy 0, policy_version 282484 (0.0010) [2023-12-26 01:50:19,003][123091] Updated weights for policy 0, policy_version 282494 (0.0010) [2023-12-26 01:50:19,059][123091] Updated weights for policy 0, policy_version 282504 (0.0013) [2023-12-26 01:50:19,244][123090] Updated weights for policy 1, policy_version 281034 (0.0007) [2023-12-26 01:50:19,305][123090] Updated weights for policy 1, policy_version 281044 (0.0006) [2023-12-26 01:50:19,373][123090] Updated weights for policy 1, policy_version 281054 (0.0009) [2023-12-26 01:50:19,964][123091] Updated weights for policy 0, policy_version 282514 (0.0009) [2023-12-26 01:50:20,034][123091] Updated weights for policy 0, policy_version 282524 (0.0008) [2023-12-26 01:50:20,093][123091] Updated weights for policy 0, policy_version 282534 (0.0007) [2023-12-26 01:50:20,111][123090] Updated weights for policy 1, policy_version 281064 (0.0009) [2023-12-26 01:50:20,159][123091] Updated weights for policy 0, policy_version 282544 (0.0009) [2023-12-26 01:50:20,172][123090] Updated weights for policy 1, policy_version 281074 (0.0006) [2023-12-26 01:50:20,241][123090] Updated weights for policy 1, policy_version 281084 (0.0006) [2023-12-26 01:50:20,991][123090] Updated weights for policy 1, policy_version 281094 (0.0010) [2023-12-26 01:50:21,025][123091] Updated weights for policy 0, policy_version 282554 (0.0008) [2023-12-26 01:50:21,061][123090] Updated weights for policy 1, policy_version 281104 (0.0008) [2023-12-26 01:50:21,095][123091] Updated weights for policy 0, policy_version 282564 (0.0009) [2023-12-26 01:50:21,128][123090] Updated weights for policy 1, policy_version 281114 (0.0008) [2023-12-26 01:50:21,165][123091] Updated weights for policy 0, policy_version 282574 (0.0009) [2023-12-26 01:50:21,897][123090] Updated weights for policy 1, policy_version 281124 (0.0008) [2023-12-26 01:50:21,957][123090] Updated weights for policy 1, policy_version 281134 (0.0008) [2023-12-26 01:50:22,005][123091] Updated weights for policy 0, policy_version 282584 (0.0007) [2023-12-26 01:50:22,028][123090] Updated weights for policy 1, policy_version 281144 (0.0008) [2023-12-26 01:50:22,065][123091] Updated weights for policy 0, policy_version 282594 (0.0006) [2023-12-26 01:50:22,123][123091] Updated weights for policy 0, policy_version 282604 (0.0006) [2023-12-26 01:50:22,860][123091] Updated weights for policy 0, policy_version 282614 (0.0006) [2023-12-26 01:50:22,910][123090] Updated weights for policy 1, policy_version 281154 (0.0008) [2023-12-26 01:50:22,922][123091] Updated weights for policy 0, policy_version 282624 (0.0006) [2023-12-26 01:50:22,981][123090] Updated weights for policy 1, policy_version 281164 (0.0009) [2023-12-26 01:50:22,985][123091] Updated weights for policy 0, policy_version 282634 (0.0006) [2023-12-26 01:50:23,054][123090] Updated weights for policy 1, policy_version 281174 (0.0009) [2023-12-26 01:50:23,114][123090] Updated weights for policy 1, policy_version 281184 (0.0010) [2023-12-26 01:50:23,744][123091] Updated weights for policy 0, policy_version 282644 (0.0006) [2023-12-26 01:50:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 144343040. Throughput: 0: 8673.2, 1: 8904.1. Samples: 144324152. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:23,785][121949] Avg episode reward: [(0, '6317.354'), (1, '5388.797')] [2023-12-26 01:50:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000281184_71983104.pth... [2023-12-26 01:50:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000280128_71712768.pth [2023-12-26 01:50:23,804][123091] Updated weights for policy 0, policy_version 282654 (0.0006) [2023-12-26 01:50:23,857][123091] Updated weights for policy 0, policy_version 282664 (0.0010) [2023-12-26 01:50:23,896][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000282672_72368128.pth... [2023-12-26 01:50:23,899][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000281648_72105984.pth [2023-12-26 01:50:23,941][123090] Updated weights for policy 1, policy_version 281194 (0.0005) [2023-12-26 01:50:23,992][123090] Updated weights for policy 1, policy_version 281204 (0.0006) [2023-12-26 01:50:24,041][123090] Updated weights for policy 1, policy_version 281214 (0.0009) [2023-12-26 01:50:24,716][123091] Updated weights for policy 0, policy_version 282674 (0.0010) [2023-12-26 01:50:24,755][123090] Updated weights for policy 1, policy_version 281224 (0.0006) [2023-12-26 01:50:24,764][123091] Updated weights for policy 0, policy_version 282684 (0.0008) [2023-12-26 01:50:24,821][123090] Updated weights for policy 1, policy_version 281234 (0.0006) [2023-12-26 01:50:24,828][123091] Updated weights for policy 0, policy_version 282694 (0.0008) [2023-12-26 01:50:24,875][123091] Updated weights for policy 0, policy_version 282704 (0.0006) [2023-12-26 01:50:24,878][123090] Updated weights for policy 1, policy_version 281244 (0.0010) [2023-12-26 01:50:25,662][123090] Updated weights for policy 1, policy_version 281254 (0.0009) [2023-12-26 01:50:25,702][123091] Updated weights for policy 0, policy_version 282714 (0.0009) [2023-12-26 01:50:25,719][123090] Updated weights for policy 1, policy_version 281264 (0.0007) [2023-12-26 01:50:25,751][123091] Updated weights for policy 0, policy_version 282724 (0.0009) [2023-12-26 01:50:25,771][123090] Updated weights for policy 1, policy_version 281274 (0.0009) [2023-12-26 01:50:25,808][123091] Updated weights for policy 0, policy_version 282734 (0.0009) [2023-12-26 01:50:26,608][123090] Updated weights for policy 1, policy_version 281284 (0.0009) [2023-12-26 01:50:26,658][123091] Updated weights for policy 0, policy_version 282744 (0.0009) [2023-12-26 01:50:26,665][123090] Updated weights for policy 1, policy_version 281294 (0.0009) [2023-12-26 01:50:26,718][123091] Updated weights for policy 0, policy_version 282754 (0.0009) [2023-12-26 01:50:26,729][123090] Updated weights for policy 1, policy_version 281304 (0.0008) [2023-12-26 01:50:26,781][123091] Updated weights for policy 0, policy_version 282764 (0.0008) [2023-12-26 01:50:27,517][123090] Updated weights for policy 1, policy_version 281314 (0.0009) [2023-12-26 01:50:27,564][123090] Updated weights for policy 1, policy_version 281324 (0.0005) [2023-12-26 01:50:27,609][123090] Updated weights for policy 1, policy_version 281334 (0.0005) [2023-12-26 01:50:27,631][123091] Updated weights for policy 0, policy_version 282774 (0.0010) [2023-12-26 01:50:27,654][123090] Updated weights for policy 1, policy_version 281344 (0.0005) [2023-12-26 01:50:27,684][123091] Updated weights for policy 0, policy_version 282784 (0.0009) [2023-12-26 01:50:27,740][123091] Updated weights for policy 0, policy_version 282794 (0.0009) [2023-12-26 01:50:28,483][123090] Updated weights for policy 1, policy_version 281354 (0.0010) [2023-12-26 01:50:28,517][123091] Updated weights for policy 0, policy_version 282805 (0.0008) [2023-12-26 01:50:28,550][123090] Updated weights for policy 1, policy_version 281364 (0.0008) [2023-12-26 01:50:28,578][123091] Updated weights for policy 0, policy_version 282815 (0.0005) [2023-12-26 01:50:28,614][123090] Updated weights for policy 1, policy_version 281374 (0.0009) [2023-12-26 01:50:28,642][123091] Updated weights for policy 0, policy_version 282825 (0.0006) [2023-12-26 01:50:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 144441344. Throughput: 0: 8692.7, 1: 8958.4. Samples: 144429880. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:28,785][121949] Avg episode reward: [(0, '6319.096'), (1, '5355.650')] [2023-12-26 01:50:29,386][123091] Updated weights for policy 0, policy_version 282835 (0.0008) [2023-12-26 01:50:29,446][123091] Updated weights for policy 0, policy_version 282845 (0.0009) [2023-12-26 01:50:29,449][123090] Updated weights for policy 1, policy_version 281384 (0.0008) [2023-12-26 01:50:29,506][123090] Updated weights for policy 1, policy_version 281394 (0.0008) [2023-12-26 01:50:29,512][123091] Updated weights for policy 0, policy_version 282855 (0.0009) [2023-12-26 01:50:29,560][123090] Updated weights for policy 1, policy_version 281404 (0.0008) [2023-12-26 01:50:30,343][123091] Updated weights for policy 0, policy_version 282865 (0.0009) [2023-12-26 01:50:30,397][123091] Updated weights for policy 0, policy_version 282875 (0.0008) [2023-12-26 01:50:30,400][123090] Updated weights for policy 1, policy_version 281414 (0.0009) [2023-12-26 01:50:30,458][123091] Updated weights for policy 0, policy_version 282885 (0.0009) [2023-12-26 01:50:30,458][123090] Updated weights for policy 1, policy_version 281424 (0.0009) [2023-12-26 01:50:30,516][123090] Updated weights for policy 1, policy_version 281434 (0.0009) [2023-12-26 01:50:30,518][123091] Updated weights for policy 0, policy_version 282895 (0.0008) [2023-12-26 01:50:31,309][123091] Updated weights for policy 0, policy_version 282905 (0.0006) [2023-12-26 01:50:31,376][123090] Updated weights for policy 1, policy_version 281444 (0.0009) [2023-12-26 01:50:31,382][123091] Updated weights for policy 0, policy_version 282915 (0.0009) [2023-12-26 01:50:31,436][123090] Updated weights for policy 1, policy_version 281454 (0.0006) [2023-12-26 01:50:31,440][123091] Updated weights for policy 0, policy_version 282925 (0.0010) [2023-12-26 01:50:31,501][123090] Updated weights for policy 1, policy_version 281464 (0.0009) [2023-12-26 01:50:32,275][123091] Updated weights for policy 0, policy_version 282935 (0.0010) [2023-12-26 01:50:32,308][123090] Updated weights for policy 1, policy_version 281474 (0.0008) [2023-12-26 01:50:32,335][123091] Updated weights for policy 0, policy_version 282945 (0.0009) [2023-12-26 01:50:32,368][123090] Updated weights for policy 1, policy_version 281484 (0.0006) [2023-12-26 01:50:32,396][123091] Updated weights for policy 0, policy_version 282955 (0.0009) [2023-12-26 01:50:32,432][123090] Updated weights for policy 1, policy_version 281494 (0.0006) [2023-12-26 01:50:32,494][123090] Updated weights for policy 1, policy_version 281504 (0.0007) [2023-12-26 01:50:33,229][123091] Updated weights for policy 0, policy_version 282965 (0.0009) [2023-12-26 01:50:33,292][123091] Updated weights for policy 0, policy_version 282975 (0.0008) [2023-12-26 01:50:33,303][123090] Updated weights for policy 1, policy_version 281514 (0.0009) [2023-12-26 01:50:33,345][123091] Updated weights for policy 0, policy_version 282985 (0.0007) [2023-12-26 01:50:33,355][123090] Updated weights for policy 1, policy_version 281524 (0.0009) [2023-12-26 01:50:33,405][123090] Updated weights for policy 1, policy_version 281534 (0.0008) [2023-12-26 01:50:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 144523264. Throughput: 0: 8635.6, 1: 8977.2. Samples: 144533300. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:33,785][121949] Avg episode reward: [(0, '6267.690'), (1, '5401.258')] [2023-12-26 01:50:34,159][123091] Updated weights for policy 0, policy_version 282995 (0.0008) [2023-12-26 01:50:34,221][123091] Updated weights for policy 0, policy_version 283005 (0.0009) [2023-12-26 01:50:34,265][123090] Updated weights for policy 1, policy_version 281544 (0.0009) [2023-12-26 01:50:34,282][123091] Updated weights for policy 0, policy_version 283015 (0.0007) [2023-12-26 01:50:34,324][123090] Updated weights for policy 1, policy_version 281554 (0.0009) [2023-12-26 01:50:34,379][123090] Updated weights for policy 1, policy_version 281564 (0.0009) [2023-12-26 01:50:35,104][123091] Updated weights for policy 0, policy_version 283025 (0.0007) [2023-12-26 01:50:35,156][123091] Updated weights for policy 0, policy_version 283035 (0.0010) [2023-12-26 01:50:35,202][123090] Updated weights for policy 1, policy_version 281574 (0.0009) [2023-12-26 01:50:35,212][123091] Updated weights for policy 0, policy_version 283045 (0.0009) [2023-12-26 01:50:35,253][123090] Updated weights for policy 1, policy_version 281584 (0.0007) [2023-12-26 01:50:35,259][123091] Updated weights for policy 0, policy_version 283055 (0.0008) [2023-12-26 01:50:35,314][123090] Updated weights for policy 1, policy_version 281594 (0.0009) [2023-12-26 01:50:36,110][123091] Updated weights for policy 0, policy_version 283065 (0.0010) [2023-12-26 01:50:36,146][123090] Updated weights for policy 1, policy_version 281604 (0.0008) [2023-12-26 01:50:36,173][123091] Updated weights for policy 0, policy_version 283075 (0.0009) [2023-12-26 01:50:36,210][123090] Updated weights for policy 1, policy_version 281614 (0.0006) [2023-12-26 01:50:36,236][123091] Updated weights for policy 0, policy_version 283085 (0.0010) [2023-12-26 01:50:36,271][123090] Updated weights for policy 1, policy_version 281624 (0.0007) [2023-12-26 01:50:37,059][123090] Updated weights for policy 1, policy_version 281634 (0.0010) [2023-12-26 01:50:37,071][123091] Updated weights for policy 0, policy_version 283095 (0.0009) [2023-12-26 01:50:37,119][123090] Updated weights for policy 1, policy_version 281644 (0.0010) [2023-12-26 01:50:37,132][123091] Updated weights for policy 0, policy_version 283105 (0.0007) [2023-12-26 01:50:37,182][123090] Updated weights for policy 1, policy_version 281654 (0.0008) [2023-12-26 01:50:37,186][123091] Updated weights for policy 0, policy_version 283115 (0.0008) [2023-12-26 01:50:37,246][123090] Updated weights for policy 1, policy_version 281664 (0.0008) [2023-12-26 01:50:37,965][123090] Updated weights for policy 1, policy_version 281674 (0.0005) [2023-12-26 01:50:38,015][123090] Updated weights for policy 1, policy_version 281684 (0.0005) [2023-12-26 01:50:38,068][123090] Updated weights for policy 1, policy_version 281694 (0.0007) [2023-12-26 01:50:38,071][123091] Updated weights for policy 0, policy_version 283125 (0.0008) [2023-12-26 01:50:38,128][123091] Updated weights for policy 0, policy_version 283135 (0.0010) [2023-12-26 01:50:38,181][123091] Updated weights for policy 0, policy_version 283145 (0.0010) [2023-12-26 01:50:38,775][123090] Updated weights for policy 1, policy_version 281704 (0.0006) [2023-12-26 01:50:38,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 144605184. Throughput: 0: 8608.3, 1: 8961.2. Samples: 144585168. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:38,785][121949] Avg episode reward: [(0, '6277.540'), (1, '5346.460')] [2023-12-26 01:50:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000283152_72491008.pth... [2023-12-26 01:50:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000282160_72237056.pth [2023-12-26 01:50:38,826][123090] Updated weights for policy 1, policy_version 281714 (0.0006) [2023-12-26 01:50:38,887][123090] Updated weights for policy 1, policy_version 281724 (0.0009) [2023-12-26 01:50:38,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000281728_72122368.pth... [2023-12-26 01:50:38,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000280672_71852032.pth [2023-12-26 01:50:38,977][123091] Updated weights for policy 0, policy_version 283155 (0.0010) [2023-12-26 01:50:39,054][123091] Updated weights for policy 0, policy_version 283165 (0.0010) [2023-12-26 01:50:39,113][123091] Updated weights for policy 0, policy_version 283175 (0.0010) [2023-12-26 01:50:39,698][123090] Updated weights for policy 1, policy_version 281734 (0.0009) [2023-12-26 01:50:39,761][123090] Updated weights for policy 1, policy_version 281744 (0.0009) [2023-12-26 01:50:39,831][123090] Updated weights for policy 1, policy_version 281754 (0.0008) [2023-12-26 01:50:39,875][123091] Updated weights for policy 0, policy_version 283185 (0.0006) [2023-12-26 01:50:39,931][123091] Updated weights for policy 0, policy_version 283195 (0.0010) [2023-12-26 01:50:39,995][123091] Updated weights for policy 0, policy_version 283205 (0.0009) [2023-12-26 01:50:40,065][123091] Updated weights for policy 0, policy_version 283215 (0.0009) [2023-12-26 01:50:40,572][123090] Updated weights for policy 1, policy_version 281764 (0.0007) [2023-12-26 01:50:40,638][123090] Updated weights for policy 1, policy_version 281774 (0.0005) [2023-12-26 01:50:40,695][123090] Updated weights for policy 1, policy_version 281784 (0.0009) [2023-12-26 01:50:40,921][123091] Updated weights for policy 0, policy_version 283225 (0.0010) [2023-12-26 01:50:40,980][123091] Updated weights for policy 0, policy_version 283235 (0.0010) [2023-12-26 01:50:41,041][123091] Updated weights for policy 0, policy_version 283245 (0.0007) [2023-12-26 01:50:41,474][123090] Updated weights for policy 1, policy_version 281794 (0.0008) [2023-12-26 01:50:41,538][123090] Updated weights for policy 1, policy_version 281804 (0.0006) [2023-12-26 01:50:41,606][123090] Updated weights for policy 1, policy_version 281814 (0.0006) [2023-12-26 01:50:41,675][123090] Updated weights for policy 1, policy_version 281824 (0.0010) [2023-12-26 01:50:41,815][123091] Updated weights for policy 0, policy_version 283255 (0.0008) [2023-12-26 01:50:41,870][123091] Updated weights for policy 0, policy_version 283265 (0.0006) [2023-12-26 01:50:41,935][123091] Updated weights for policy 0, policy_version 283275 (0.0006) [2023-12-26 01:50:42,470][123090] Updated weights for policy 1, policy_version 281834 (0.0009) [2023-12-26 01:50:42,533][123090] Updated weights for policy 1, policy_version 281844 (0.0009) [2023-12-26 01:50:42,596][123090] Updated weights for policy 1, policy_version 281854 (0.0010) [2023-12-26 01:50:42,760][123091] Updated weights for policy 0, policy_version 283285 (0.0008) [2023-12-26 01:50:42,821][123091] Updated weights for policy 0, policy_version 283295 (0.0011) [2023-12-26 01:50:42,884][123091] Updated weights for policy 0, policy_version 283305 (0.0011) [2023-12-26 01:50:43,289][123090] Updated weights for policy 1, policy_version 281864 (0.0008) [2023-12-26 01:50:43,350][123090] Updated weights for policy 1, policy_version 281874 (0.0009) [2023-12-26 01:50:43,407][123090] Updated weights for policy 1, policy_version 281884 (0.0009) [2023-12-26 01:50:43,716][123091] Updated weights for policy 0, policy_version 283315 (0.0011) [2023-12-26 01:50:43,779][123091] Updated weights for policy 0, policy_version 283325 (0.0010) [2023-12-26 01:50:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 144695296. Throughput: 0: 8650.7, 1: 8917.0. Samples: 144691676. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:43,785][121949] Avg episode reward: [(0, '6202.371'), (1, '5432.465')] [2023-12-26 01:50:43,846][123091] Updated weights for policy 0, policy_version 283335 (0.0006) [2023-12-26 01:50:44,060][123090] Updated weights for policy 1, policy_version 281894 (0.0006) [2023-12-26 01:50:44,110][123090] Updated weights for policy 1, policy_version 281904 (0.0008) [2023-12-26 01:50:44,161][123090] Updated weights for policy 1, policy_version 281914 (0.0009) [2023-12-26 01:50:44,567][123091] Updated weights for policy 0, policy_version 283345 (0.0010) [2023-12-26 01:50:44,631][123091] Updated weights for policy 0, policy_version 283355 (0.0011) [2023-12-26 01:50:44,695][123091] Updated weights for policy 0, policy_version 283365 (0.0009) [2023-12-26 01:50:44,759][123091] Updated weights for policy 0, policy_version 283375 (0.0011) [2023-12-26 01:50:45,062][123090] Updated weights for policy 1, policy_version 281924 (0.0008) [2023-12-26 01:50:45,130][123090] Updated weights for policy 1, policy_version 281934 (0.0008) [2023-12-26 01:50:45,192][123090] Updated weights for policy 1, policy_version 281944 (0.0009) [2023-12-26 01:50:45,521][123091] Updated weights for policy 0, policy_version 283385 (0.0010) [2023-12-26 01:50:45,596][123091] Updated weights for policy 0, policy_version 283395 (0.0011) [2023-12-26 01:50:45,668][123091] Updated weights for policy 0, policy_version 283405 (0.0011) [2023-12-26 01:50:45,858][123090] Updated weights for policy 1, policy_version 281954 (0.0005) [2023-12-26 01:50:45,927][123090] Updated weights for policy 1, policy_version 281964 (0.0006) [2023-12-26 01:50:45,985][123090] Updated weights for policy 1, policy_version 281974 (0.0009) [2023-12-26 01:50:46,043][123090] Updated weights for policy 1, policy_version 281984 (0.0009) [2023-12-26 01:50:46,426][123091] Updated weights for policy 0, policy_version 283415 (0.0011) [2023-12-26 01:50:46,495][123091] Updated weights for policy 0, policy_version 283425 (0.0008) [2023-12-26 01:50:46,557][123091] Updated weights for policy 0, policy_version 283435 (0.0006) [2023-12-26 01:50:46,878][123090] Updated weights for policy 1, policy_version 281994 (0.0010) [2023-12-26 01:50:46,945][123090] Updated weights for policy 1, policy_version 282004 (0.0010) [2023-12-26 01:50:47,011][123090] Updated weights for policy 1, policy_version 282014 (0.0010) [2023-12-26 01:50:47,354][123091] Updated weights for policy 0, policy_version 283445 (0.0010) [2023-12-26 01:50:47,412][123091] Updated weights for policy 0, policy_version 283455 (0.0010) [2023-12-26 01:50:47,474][123091] Updated weights for policy 0, policy_version 283465 (0.0011) [2023-12-26 01:50:47,802][123090] Updated weights for policy 1, policy_version 282024 (0.0009) [2023-12-26 01:50:47,859][123090] Updated weights for policy 1, policy_version 282034 (0.0009) [2023-12-26 01:50:47,908][123090] Updated weights for policy 1, policy_version 282044 (0.0009) [2023-12-26 01:50:48,293][123091] Updated weights for policy 0, policy_version 283475 (0.0011) [2023-12-26 01:50:48,368][123091] Updated weights for policy 0, policy_version 283485 (0.0011) [2023-12-26 01:50:48,431][123091] Updated weights for policy 0, policy_version 283495 (0.0011) [2023-12-26 01:50:48,739][123090] Updated weights for policy 1, policy_version 282054 (0.0007) [2023-12-26 01:50:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 144785408. Throughput: 0: 8618.2, 1: 8914.5. Samples: 144799572. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:48,784][121949] Avg episode reward: [(0, '6253.009'), (1, '5470.958')] [2023-12-26 01:50:48,806][123090] Updated weights for policy 1, policy_version 282064 (0.0008) [2023-12-26 01:50:48,871][123090] Updated weights for policy 1, policy_version 282074 (0.0009) [2023-12-26 01:50:49,221][123091] Updated weights for policy 0, policy_version 283505 (0.0011) [2023-12-26 01:50:49,282][123091] Updated weights for policy 0, policy_version 283515 (0.0009) [2023-12-26 01:50:49,335][123091] Updated weights for policy 0, policy_version 283525 (0.0007) [2023-12-26 01:50:49,392][123091] Updated weights for policy 0, policy_version 283535 (0.0010) [2023-12-26 01:50:49,581][123090] Updated weights for policy 1, policy_version 282084 (0.0009) [2023-12-26 01:50:49,644][123090] Updated weights for policy 1, policy_version 282094 (0.0010) [2023-12-26 01:50:49,697][123090] Updated weights for policy 1, policy_version 282105 (0.0010) [2023-12-26 01:50:50,183][123091] Updated weights for policy 0, policy_version 283545 (0.0008) [2023-12-26 01:50:50,235][123091] Updated weights for policy 0, policy_version 283555 (0.0011) [2023-12-26 01:50:50,280][123091] Updated weights for policy 0, policy_version 283565 (0.0010) [2023-12-26 01:50:50,620][123090] Updated weights for policy 1, policy_version 282115 (0.0009) [2023-12-26 01:50:50,679][123090] Updated weights for policy 1, policy_version 282125 (0.0009) [2023-12-26 01:50:50,743][123090] Updated weights for policy 1, policy_version 282135 (0.0009) [2023-12-26 01:50:51,088][123091] Updated weights for policy 0, policy_version 283575 (0.0008) [2023-12-26 01:50:51,144][123091] Updated weights for policy 0, policy_version 283585 (0.0009) [2023-12-26 01:50:51,213][123091] Updated weights for policy 0, policy_version 283595 (0.0009) [2023-12-26 01:50:51,589][123090] Updated weights for policy 1, policy_version 282145 (0.0009) [2023-12-26 01:50:51,664][123090] Updated weights for policy 1, policy_version 282155 (0.0008) [2023-12-26 01:50:51,722][123090] Updated weights for policy 1, policy_version 282165 (0.0010) [2023-12-26 01:50:51,805][123090] Updated weights for policy 1, policy_version 282175 (0.0008) [2023-12-26 01:50:52,023][123091] Updated weights for policy 0, policy_version 283605 (0.0009) [2023-12-26 01:50:52,085][123091] Updated weights for policy 0, policy_version 283615 (0.0010) [2023-12-26 01:50:52,149][123091] Updated weights for policy 0, policy_version 283625 (0.0006) [2023-12-26 01:50:52,595][123090] Updated weights for policy 1, policy_version 282185 (0.0008) [2023-12-26 01:50:52,648][123090] Updated weights for policy 1, policy_version 282195 (0.0009) [2023-12-26 01:50:52,702][123090] Updated weights for policy 1, policy_version 282205 (0.0010) [2023-12-26 01:50:52,909][123091] Updated weights for policy 0, policy_version 283635 (0.0007) [2023-12-26 01:50:52,959][123091] Updated weights for policy 0, policy_version 283645 (0.0009) [2023-12-26 01:50:53,007][123091] Updated weights for policy 0, policy_version 283655 (0.0009) [2023-12-26 01:50:53,564][123090] Updated weights for policy 1, policy_version 282215 (0.0010) [2023-12-26 01:50:53,624][123090] Updated weights for policy 1, policy_version 282225 (0.0010) [2023-12-26 01:50:53,688][123090] Updated weights for policy 1, policy_version 282235 (0.0009) [2023-12-26 01:50:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 144875520. Throughput: 0: 8634.8, 1: 8854.4. Samples: 144851396. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:53,784][121949] Avg episode reward: [(0, '6389.830'), (1, '5311.818')] [2023-12-26 01:50:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000282240_72253440.pth... [2023-12-26 01:50:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000283664_72622080.pth... [2023-12-26 01:50:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000281184_71983104.pth [2023-12-26 01:50:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000282672_72368128.pth [2023-12-26 01:50:53,796][123007] Saving new best policy, reward=6389.830! [2023-12-26 01:50:53,845][123091] Updated weights for policy 0, policy_version 283665 (0.0009) [2023-12-26 01:50:53,899][123091] Updated weights for policy 0, policy_version 283675 (0.0009) [2023-12-26 01:50:53,951][123091] Updated weights for policy 0, policy_version 283685 (0.0010) [2023-12-26 01:50:53,998][123091] Updated weights for policy 0, policy_version 283695 (0.0010) [2023-12-26 01:50:54,521][123090] Updated weights for policy 1, policy_version 282245 (0.0008) [2023-12-26 01:50:54,585][123090] Updated weights for policy 1, policy_version 282255 (0.0007) [2023-12-26 01:50:54,661][123090] Updated weights for policy 1, policy_version 282265 (0.0006) [2023-12-26 01:50:54,795][123091] Updated weights for policy 0, policy_version 283705 (0.0006) [2023-12-26 01:50:54,860][123091] Updated weights for policy 0, policy_version 283715 (0.0010) [2023-12-26 01:50:54,920][123091] Updated weights for policy 0, policy_version 283725 (0.0011) [2023-12-26 01:50:55,366][123090] Updated weights for policy 1, policy_version 282275 (0.0008) [2023-12-26 01:50:55,434][123090] Updated weights for policy 1, policy_version 282285 (0.0006) [2023-12-26 01:50:55,484][123090] Updated weights for policy 1, policy_version 282295 (0.0005) [2023-12-26 01:50:55,802][123091] Updated weights for policy 0, policy_version 283735 (0.0010) [2023-12-26 01:50:55,854][123091] Updated weights for policy 0, policy_version 283746 (0.0010) [2023-12-26 01:50:55,907][123091] Updated weights for policy 0, policy_version 283756 (0.0010) [2023-12-26 01:50:56,107][123090] Updated weights for policy 1, policy_version 282305 (0.0005) [2023-12-26 01:50:56,177][123090] Updated weights for policy 1, policy_version 282315 (0.0005) [2023-12-26 01:50:56,245][123090] Updated weights for policy 1, policy_version 282325 (0.0006) [2023-12-26 01:50:56,302][123090] Updated weights for policy 1, policy_version 282335 (0.0005) [2023-12-26 01:50:56,833][123091] Updated weights for policy 0, policy_version 283766 (0.0010) [2023-12-26 01:50:56,894][123091] Updated weights for policy 0, policy_version 283776 (0.0009) [2023-12-26 01:50:56,905][123090] Updated weights for policy 1, policy_version 282345 (0.0005) [2023-12-26 01:50:56,952][123091] Updated weights for policy 0, policy_version 283786 (0.0010) [2023-12-26 01:50:56,960][123090] Updated weights for policy 1, policy_version 282355 (0.0005) [2023-12-26 01:50:57,013][123090] Updated weights for policy 1, policy_version 282365 (0.0005) [2023-12-26 01:50:57,663][123090] Updated weights for policy 1, policy_version 282375 (0.0005) [2023-12-26 01:50:57,718][123090] Updated weights for policy 1, policy_version 282385 (0.0006) [2023-12-26 01:50:57,762][123090] Updated weights for policy 1, policy_version 282395 (0.0005) [2023-12-26 01:50:57,872][123091] Updated weights for policy 0, policy_version 283796 (0.0009) [2023-12-26 01:50:57,926][123091] Updated weights for policy 0, policy_version 283807 (0.0010) [2023-12-26 01:50:57,989][123091] Updated weights for policy 0, policy_version 283818 (0.0010) [2023-12-26 01:50:58,472][123090] Updated weights for policy 1, policy_version 282405 (0.0008) [2023-12-26 01:50:58,539][123090] Updated weights for policy 1, policy_version 282415 (0.0010) [2023-12-26 01:50:58,620][123090] Updated weights for policy 1, policy_version 282425 (0.0013) [2023-12-26 01:50:58,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 144965632. Throughput: 0: 8621.8, 1: 8932.1. Samples: 144958988. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:50:58,785][121949] Avg episode reward: [(0, '6399.539'), (1, '5219.480')] [2023-12-26 01:50:58,786][123007] Saving new best policy, reward=6399.539! [2023-12-26 01:50:59,042][123091] Updated weights for policy 0, policy_version 283828 (0.0009) [2023-12-26 01:50:59,108][123091] Updated weights for policy 0, policy_version 283838 (0.0010) [2023-12-26 01:50:59,157][123091] Updated weights for policy 0, policy_version 283848 (0.0009) [2023-12-26 01:50:59,461][123090] Updated weights for policy 1, policy_version 282435 (0.0009) [2023-12-26 01:50:59,532][123090] Updated weights for policy 1, policy_version 282445 (0.0011) [2023-12-26 01:50:59,598][123090] Updated weights for policy 1, policy_version 282455 (0.0010) [2023-12-26 01:51:00,051][123091] Updated weights for policy 0, policy_version 283858 (0.0009) [2023-12-26 01:51:00,103][123091] Updated weights for policy 0, policy_version 283868 (0.0009) [2023-12-26 01:51:00,155][123091] Updated weights for policy 0, policy_version 283878 (0.0009) [2023-12-26 01:51:00,208][123091] Updated weights for policy 0, policy_version 283888 (0.0009) [2023-12-26 01:51:00,405][123090] Updated weights for policy 1, policy_version 282465 (0.0010) [2023-12-26 01:51:00,460][123090] Updated weights for policy 1, policy_version 282475 (0.0010) [2023-12-26 01:51:00,523][123090] Updated weights for policy 1, policy_version 282485 (0.0011) [2023-12-26 01:51:00,584][123090] Updated weights for policy 1, policy_version 282495 (0.0010) [2023-12-26 01:51:01,035][123091] Updated weights for policy 0, policy_version 283898 (0.0009) [2023-12-26 01:51:01,095][123091] Updated weights for policy 0, policy_version 283908 (0.0009) [2023-12-26 01:51:01,165][123091] Updated weights for policy 0, policy_version 283918 (0.0009) [2023-12-26 01:51:01,412][123090] Updated weights for policy 1, policy_version 282505 (0.0008) [2023-12-26 01:51:01,465][123090] Updated weights for policy 1, policy_version 282515 (0.0005) [2023-12-26 01:51:01,527][123090] Updated weights for policy 1, policy_version 282525 (0.0007) [2023-12-26 01:51:01,970][123091] Updated weights for policy 0, policy_version 283928 (0.0006) [2023-12-26 01:51:02,035][123091] Updated weights for policy 0, policy_version 283938 (0.0009) [2023-12-26 01:51:02,099][123091] Updated weights for policy 0, policy_version 283948 (0.0010) [2023-12-26 01:51:02,279][123090] Updated weights for policy 1, policy_version 282535 (0.0007) [2023-12-26 01:51:02,344][123090] Updated weights for policy 1, policy_version 282545 (0.0008) [2023-12-26 01:51:02,410][123090] Updated weights for policy 1, policy_version 282555 (0.0009) [2023-12-26 01:51:02,894][123091] Updated weights for policy 0, policy_version 283958 (0.0007) [2023-12-26 01:51:02,940][123091] Updated weights for policy 0, policy_version 283968 (0.0006) [2023-12-26 01:51:02,996][123091] Updated weights for policy 0, policy_version 283978 (0.0005) [2023-12-26 01:51:03,249][123090] Updated weights for policy 1, policy_version 282565 (0.0009) [2023-12-26 01:51:03,297][123090] Updated weights for policy 1, policy_version 282575 (0.0009) [2023-12-26 01:51:03,356][123090] Updated weights for policy 1, policy_version 282585 (0.0009) [2023-12-26 01:51:03,718][123091] Updated weights for policy 0, policy_version 283988 (0.0005) [2023-12-26 01:51:03,780][123091] Updated weights for policy 0, policy_version 283998 (0.0006) [2023-12-26 01:51:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 145047552. Throughput: 0: 8590.7, 1: 8953.4. Samples: 145062000. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:51:03,785][121949] Avg episode reward: [(0, '6386.966'), (1, '5301.160')] [2023-12-26 01:51:03,839][123091] Updated weights for policy 0, policy_version 284008 (0.0006) [2023-12-26 01:51:04,258][123090] Updated weights for policy 1, policy_version 282595 (0.0009) [2023-12-26 01:51:04,328][123090] Updated weights for policy 1, policy_version 282605 (0.0010) [2023-12-26 01:51:04,398][123090] Updated weights for policy 1, policy_version 282615 (0.0009) [2023-12-26 01:51:04,484][123091] Updated weights for policy 0, policy_version 284018 (0.0007) [2023-12-26 01:51:04,553][123091] Updated weights for policy 0, policy_version 284028 (0.0007) [2023-12-26 01:51:04,612][123091] Updated weights for policy 0, policy_version 284038 (0.0005) [2023-12-26 01:51:04,668][123091] Updated weights for policy 0, policy_version 284048 (0.0008) [2023-12-26 01:51:05,211][123090] Updated weights for policy 1, policy_version 282625 (0.0010) [2023-12-26 01:51:05,264][123090] Updated weights for policy 1, policy_version 282635 (0.0010) [2023-12-26 01:51:05,317][123090] Updated weights for policy 1, policy_version 282645 (0.0010) [2023-12-26 01:51:05,368][123090] Updated weights for policy 1, policy_version 282656 (0.0010) [2023-12-26 01:51:05,486][123091] Updated weights for policy 0, policy_version 284058 (0.0009) [2023-12-26 01:51:05,552][123091] Updated weights for policy 0, policy_version 284068 (0.0008) [2023-12-26 01:51:05,617][123091] Updated weights for policy 0, policy_version 284078 (0.0008) [2023-12-26 01:51:06,262][123090] Updated weights for policy 1, policy_version 282666 (0.0010) [2023-12-26 01:51:06,329][123090] Updated weights for policy 1, policy_version 282676 (0.0009) [2023-12-26 01:51:06,374][123091] Updated weights for policy 0, policy_version 284088 (0.0009) [2023-12-26 01:51:06,392][123090] Updated weights for policy 1, policy_version 282686 (0.0008) [2023-12-26 01:51:06,431][123091] Updated weights for policy 0, policy_version 284098 (0.0008) [2023-12-26 01:51:06,491][123091] Updated weights for policy 0, policy_version 284108 (0.0010) [2023-12-26 01:51:07,242][123090] Updated weights for policy 1, policy_version 282696 (0.0010) [2023-12-26 01:51:07,299][123090] Updated weights for policy 1, policy_version 282706 (0.0009) [2023-12-26 01:51:07,355][123090] Updated weights for policy 1, policy_version 282716 (0.0009) [2023-12-26 01:51:07,356][123091] Updated weights for policy 0, policy_version 284118 (0.0009) [2023-12-26 01:51:07,419][123091] Updated weights for policy 0, policy_version 284128 (0.0008) [2023-12-26 01:51:07,471][123091] Updated weights for policy 0, policy_version 284138 (0.0009) [2023-12-26 01:51:08,189][123090] Updated weights for policy 1, policy_version 282726 (0.0009) [2023-12-26 01:51:08,238][123090] Updated weights for policy 1, policy_version 282736 (0.0008) [2023-12-26 01:51:08,297][123090] Updated weights for policy 1, policy_version 282746 (0.0009) [2023-12-26 01:51:08,300][123091] Updated weights for policy 0, policy_version 284148 (0.0008) [2023-12-26 01:51:08,368][123091] Updated weights for policy 0, policy_version 284158 (0.0010) [2023-12-26 01:51:08,423][123091] Updated weights for policy 0, policy_version 284168 (0.0009) [2023-12-26 01:51:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 145137664. Throughput: 0: 8678.8, 1: 8879.9. Samples: 145114296. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:51:08,785][121949] Avg episode reward: [(0, '6398.042'), (1, '5505.917')] [2023-12-26 01:51:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000282752_72384512.pth... [2023-12-26 01:51:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000284176_72753152.pth... [2023-12-26 01:51:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000281728_72122368.pth [2023-12-26 01:51:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000283152_72491008.pth [2023-12-26 01:51:09,168][123090] Updated weights for policy 1, policy_version 282756 (0.0009) [2023-12-26 01:51:09,229][123090] Updated weights for policy 1, policy_version 282766 (0.0008) [2023-12-26 01:51:09,267][123091] Updated weights for policy 0, policy_version 284178 (0.0008) [2023-12-26 01:51:09,291][123090] Updated weights for policy 1, policy_version 282776 (0.0009) [2023-12-26 01:51:09,327][123091] Updated weights for policy 0, policy_version 284188 (0.0009) [2023-12-26 01:51:09,397][123091] Updated weights for policy 0, policy_version 284198 (0.0009) [2023-12-26 01:51:09,472][123091] Updated weights for policy 0, policy_version 284208 (0.0010) [2023-12-26 01:51:10,195][123090] Updated weights for policy 1, policy_version 282786 (0.0007) [2023-12-26 01:51:10,261][123090] Updated weights for policy 1, policy_version 282796 (0.0008) [2023-12-26 01:51:10,281][123091] Updated weights for policy 0, policy_version 284218 (0.0009) [2023-12-26 01:51:10,325][123090] Updated weights for policy 1, policy_version 282806 (0.0009) [2023-12-26 01:51:10,341][123091] Updated weights for policy 0, policy_version 284228 (0.0008) [2023-12-26 01:51:10,382][123090] Updated weights for policy 1, policy_version 282816 (0.0008) [2023-12-26 01:51:10,402][123091] Updated weights for policy 0, policy_version 284238 (0.0009) [2023-12-26 01:51:11,201][123090] Updated weights for policy 1, policy_version 282826 (0.0009) [2023-12-26 01:51:11,235][123091] Updated weights for policy 0, policy_version 284248 (0.0009) [2023-12-26 01:51:11,270][123090] Updated weights for policy 1, policy_version 282836 (0.0008) [2023-12-26 01:51:11,304][123091] Updated weights for policy 0, policy_version 284258 (0.0010) [2023-12-26 01:51:11,336][123090] Updated weights for policy 1, policy_version 282846 (0.0007) [2023-12-26 01:51:11,392][123091] Updated weights for policy 0, policy_version 284268 (0.0009) [2023-12-26 01:51:12,094][123090] Updated weights for policy 1, policy_version 282856 (0.0009) [2023-12-26 01:51:12,163][123090] Updated weights for policy 1, policy_version 282866 (0.0009) [2023-12-26 01:51:12,230][123090] Updated weights for policy 1, policy_version 282876 (0.0009) [2023-12-26 01:51:12,265][123091] Updated weights for policy 0, policy_version 284278 (0.0009) [2023-12-26 01:51:12,334][123091] Updated weights for policy 0, policy_version 284288 (0.0010) [2023-12-26 01:51:12,391][123091] Updated weights for policy 0, policy_version 284298 (0.0010) [2023-12-26 01:51:13,054][123090] Updated weights for policy 1, policy_version 282886 (0.0009) [2023-12-26 01:51:13,117][123090] Updated weights for policy 1, policy_version 282896 (0.0010) [2023-12-26 01:51:13,166][123091] Updated weights for policy 0, policy_version 284308 (0.0009) [2023-12-26 01:51:13,173][123090] Updated weights for policy 1, policy_version 282906 (0.0009) [2023-12-26 01:51:13,235][123091] Updated weights for policy 0, policy_version 284318 (0.0009) [2023-12-26 01:51:13,296][123091] Updated weights for policy 0, policy_version 284328 (0.0009) [2023-12-26 01:51:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 145219584. Throughput: 0: 8624.9, 1: 8829.1. Samples: 145215304. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:51:13,784][121949] Avg episode reward: [(0, '6334.803'), (1, '5431.756')] [2023-12-26 01:51:13,980][123090] Updated weights for policy 1, policy_version 282916 (0.0008) [2023-12-26 01:51:14,029][123090] Updated weights for policy 1, policy_version 282926 (0.0009) [2023-12-26 01:51:14,088][123090] Updated weights for policy 1, policy_version 282936 (0.0009) [2023-12-26 01:51:14,106][123091] Updated weights for policy 0, policy_version 284338 (0.0008) [2023-12-26 01:51:14,164][123091] Updated weights for policy 0, policy_version 284348 (0.0008) [2023-12-26 01:51:14,216][123091] Updated weights for policy 0, policy_version 284358 (0.0009) [2023-12-26 01:51:14,273][123091] Updated weights for policy 0, policy_version 284368 (0.0009) [2023-12-26 01:51:14,928][123090] Updated weights for policy 1, policy_version 282946 (0.0009) [2023-12-26 01:51:15,009][123090] Updated weights for policy 1, policy_version 282956 (0.0010) [2023-12-26 01:51:15,069][123090] Updated weights for policy 1, policy_version 282966 (0.0008) [2023-12-26 01:51:15,091][123091] Updated weights for policy 0, policy_version 284378 (0.0009) [2023-12-26 01:51:15,138][123090] Updated weights for policy 1, policy_version 282976 (0.0009) [2023-12-26 01:51:15,157][123091] Updated weights for policy 0, policy_version 284388 (0.0010) [2023-12-26 01:51:15,221][123091] Updated weights for policy 0, policy_version 284398 (0.0010) [2023-12-26 01:51:15,933][123090] Updated weights for policy 1, policy_version 282986 (0.0009) [2023-12-26 01:51:15,986][123090] Updated weights for policy 1, policy_version 282996 (0.0010) [2023-12-26 01:51:16,041][123090] Updated weights for policy 1, policy_version 283006 (0.0008) [2023-12-26 01:51:16,043][123091] Updated weights for policy 0, policy_version 284409 (0.0010) [2023-12-26 01:51:16,092][123091] Updated weights for policy 0, policy_version 284419 (0.0009) [2023-12-26 01:51:16,140][123091] Updated weights for policy 0, policy_version 284429 (0.0010) [2023-12-26 01:51:16,757][123090] Updated weights for policy 1, policy_version 283016 (0.0008) [2023-12-26 01:51:16,813][123090] Updated weights for policy 1, policy_version 283026 (0.0008) [2023-12-26 01:51:16,883][123090] Updated weights for policy 1, policy_version 283036 (0.0007) [2023-12-26 01:51:17,055][123091] Updated weights for policy 0, policy_version 284439 (0.0006) [2023-12-26 01:51:17,108][123091] Updated weights for policy 0, policy_version 284449 (0.0006) [2023-12-26 01:51:17,169][123091] Updated weights for policy 0, policy_version 284459 (0.0009) [2023-12-26 01:51:17,746][123090] Updated weights for policy 1, policy_version 283046 (0.0009) [2023-12-26 01:51:17,799][123090] Updated weights for policy 1, policy_version 283056 (0.0009) [2023-12-26 01:51:17,839][123091] Updated weights for policy 0, policy_version 284469 (0.0006) [2023-12-26 01:51:17,851][123090] Updated weights for policy 1, policy_version 283066 (0.0010) [2023-12-26 01:51:17,892][123091] Updated weights for policy 0, policy_version 284479 (0.0006) [2023-12-26 01:51:17,939][123091] Updated weights for policy 0, policy_version 284489 (0.0010) [2023-12-26 01:51:18,668][123090] Updated weights for policy 1, policy_version 283076 (0.0007) [2023-12-26 01:51:18,737][123090] Updated weights for policy 1, policy_version 283086 (0.0005) [2023-12-26 01:51:18,750][123091] Updated weights for policy 0, policy_version 284499 (0.0009) [2023-12-26 01:51:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 145301504. Throughput: 0: 8640.6, 1: 8849.8. Samples: 145320368. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:51:18,785][121949] Avg episode reward: [(0, '6241.818'), (1, '5343.234')] [2023-12-26 01:51:18,813][123090] Updated weights for policy 1, policy_version 283096 (0.0007) [2023-12-26 01:51:18,819][123091] Updated weights for policy 0, policy_version 284509 (0.0006) [2023-12-26 01:51:18,879][123091] Updated weights for policy 0, policy_version 284519 (0.0010) [2023-12-26 01:51:19,527][123090] Updated weights for policy 1, policy_version 283106 (0.0008) [2023-12-26 01:51:19,584][123090] Updated weights for policy 1, policy_version 283116 (0.0009) [2023-12-26 01:51:19,652][123090] Updated weights for policy 1, policy_version 283126 (0.0009) [2023-12-26 01:51:19,709][123091] Updated weights for policy 0, policy_version 284529 (0.0011) [2023-12-26 01:51:19,716][123090] Updated weights for policy 1, policy_version 283136 (0.0009) [2023-12-26 01:51:19,773][123091] Updated weights for policy 0, policy_version 284539 (0.0009) [2023-12-26 01:51:19,849][123091] Updated weights for policy 0, policy_version 284549 (0.0010) [2023-12-26 01:51:19,918][123091] Updated weights for policy 0, policy_version 284559 (0.0009) [2023-12-26 01:51:20,570][123090] Updated weights for policy 1, policy_version 283146 (0.0008) [2023-12-26 01:51:20,640][123090] Updated weights for policy 1, policy_version 283156 (0.0009) [2023-12-26 01:51:20,703][123090] Updated weights for policy 1, policy_version 283166 (0.0009) [2023-12-26 01:51:20,748][123091] Updated weights for policy 0, policy_version 284569 (0.0010) [2023-12-26 01:51:20,809][123091] Updated weights for policy 0, policy_version 284579 (0.0011) [2023-12-26 01:51:20,862][123091] Updated weights for policy 0, policy_version 284589 (0.0011) [2023-12-26 01:51:21,574][123090] Updated weights for policy 1, policy_version 283176 (0.0009) [2023-12-26 01:51:21,641][123090] Updated weights for policy 1, policy_version 283186 (0.0009) [2023-12-26 01:51:21,663][123091] Updated weights for policy 0, policy_version 284599 (0.0009) [2023-12-26 01:51:21,713][123090] Updated weights for policy 1, policy_version 283196 (0.0009) [2023-12-26 01:51:21,736][123091] Updated weights for policy 0, policy_version 284609 (0.0009) [2023-12-26 01:51:21,803][123091] Updated weights for policy 0, policy_version 284619 (0.0011) [2023-12-26 01:51:22,439][123090] Updated weights for policy 1, policy_version 283206 (0.0006) [2023-12-26 01:51:22,516][123090] Updated weights for policy 1, policy_version 283216 (0.0006) [2023-12-26 01:51:22,569][123091] Updated weights for policy 0, policy_version 284629 (0.0011) [2023-12-26 01:51:22,581][123090] Updated weights for policy 1, policy_version 283226 (0.0009) [2023-12-26 01:51:22,637][123091] Updated weights for policy 0, policy_version 284639 (0.0011) [2023-12-26 01:51:22,700][123091] Updated weights for policy 0, policy_version 284649 (0.0011) [2023-12-26 01:51:23,260][123090] Updated weights for policy 1, policy_version 283236 (0.0007) [2023-12-26 01:51:23,326][123090] Updated weights for policy 1, policy_version 283246 (0.0008) [2023-12-26 01:51:23,377][123090] Updated weights for policy 1, policy_version 283256 (0.0010) [2023-12-26 01:51:23,437][123091] Updated weights for policy 0, policy_version 284659 (0.0009) [2023-12-26 01:51:23,492][123091] Updated weights for policy 0, policy_version 284669 (0.0008) [2023-12-26 01:51:23,540][123091] Updated weights for policy 0, policy_version 284679 (0.0010) [2023-12-26 01:51:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 145399808. Throughput: 0: 8639.4, 1: 8832.1. Samples: 145371392. Policy #0 lag: (min: 31.0, avg: 38.8, max: 63.0) [2023-12-26 01:51:23,785][121949] Avg episode reward: [(0, '6271.199'), (1, '5217.437')] [2023-12-26 01:51:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000283264_72515584.pth... [2023-12-26 01:51:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000284688_72884224.pth... [2023-12-26 01:51:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000282240_72253440.pth [2023-12-26 01:51:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000283664_72622080.pth [2023-12-26 01:51:24,137][123090] Updated weights for policy 1, policy_version 283266 (0.0009) [2023-12-26 01:51:24,189][123090] Updated weights for policy 1, policy_version 283276 (0.0005) [2023-12-26 01:51:24,254][123090] Updated weights for policy 1, policy_version 283286 (0.0009) [2023-12-26 01:51:24,317][123091] Updated weights for policy 0, policy_version 284689 (0.0010) [2023-12-26 01:51:24,374][123091] Updated weights for policy 0, policy_version 284699 (0.0006) [2023-12-26 01:51:24,423][123091] Updated weights for policy 0, policy_version 284709 (0.0005) [2023-12-26 01:51:24,480][123091] Updated weights for policy 0, policy_version 284719 (0.0006) [2023-12-26 01:51:24,945][123090] Updated weights for policy 1, policy_version 283297 (0.0007) [2023-12-26 01:51:25,005][123090] Updated weights for policy 1, policy_version 283307 (0.0009) [2023-12-26 01:51:25,057][123090] Updated weights for policy 1, policy_version 283317 (0.0009) [2023-12-26 01:51:25,117][123090] Updated weights for policy 1, policy_version 283327 (0.0010) [2023-12-26 01:51:25,226][123091] Updated weights for policy 0, policy_version 284729 (0.0010) [2023-12-26 01:51:25,281][123091] Updated weights for policy 0, policy_version 284740 (0.0010) [2023-12-26 01:51:25,327][123091] Updated weights for policy 0, policy_version 284750 (0.0006) [2023-12-26 01:51:25,903][123090] Updated weights for policy 1, policy_version 283337 (0.0007) [2023-12-26 01:51:25,952][123090] Updated weights for policy 1, policy_version 283347 (0.0007) [2023-12-26 01:51:25,998][123091] Updated weights for policy 0, policy_version 284760 (0.0007) [2023-12-26 01:51:26,003][123090] Updated weights for policy 1, policy_version 283357 (0.0010) [2023-12-26 01:51:26,050][123091] Updated weights for policy 0, policy_version 284770 (0.0007) [2023-12-26 01:51:26,099][123091] Updated weights for policy 0, policy_version 284780 (0.0005) [2023-12-26 01:51:26,829][123091] Updated weights for policy 0, policy_version 284790 (0.0009) [2023-12-26 01:51:26,830][123090] Updated weights for policy 1, policy_version 283367 (0.0010) [2023-12-26 01:51:26,881][123091] Updated weights for policy 0, policy_version 284800 (0.0010) [2023-12-26 01:51:26,892][123090] Updated weights for policy 1, policy_version 283377 (0.0009) [2023-12-26 01:51:26,932][123091] Updated weights for policy 0, policy_version 284810 (0.0010) [2023-12-26 01:51:26,947][123090] Updated weights for policy 1, policy_version 283387 (0.0010) [2023-12-26 01:51:27,686][123090] Updated weights for policy 1, policy_version 283397 (0.0009) [2023-12-26 01:51:27,755][123090] Updated weights for policy 1, policy_version 283407 (0.0005) [2023-12-26 01:51:27,774][123091] Updated weights for policy 0, policy_version 284820 (0.0011) [2023-12-26 01:51:27,820][123090] Updated weights for policy 1, policy_version 283417 (0.0005) [2023-12-26 01:51:27,847][123091] Updated weights for policy 0, policy_version 284830 (0.0011) [2023-12-26 01:51:27,905][123091] Updated weights for policy 0, policy_version 284840 (0.0010) [2023-12-26 01:51:28,480][123090] Updated weights for policy 1, policy_version 283427 (0.0006) [2023-12-26 01:51:28,545][123090] Updated weights for policy 1, policy_version 283437 (0.0009) [2023-12-26 01:51:28,610][123090] Updated weights for policy 1, policy_version 283447 (0.0009) [2023-12-26 01:51:28,665][123091] Updated weights for policy 0, policy_version 284850 (0.0010) [2023-12-26 01:51:28,734][123091] Updated weights for policy 0, policy_version 284860 (0.0009) [2023-12-26 01:51:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 145489920. Throughput: 0: 8740.4, 1: 8872.8. Samples: 145484268. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:28,785][121949] Avg episode reward: [(0, '6311.682'), (1, '5290.375')] [2023-12-26 01:51:28,802][123091] Updated weights for policy 0, policy_version 284870 (0.0010) [2023-12-26 01:51:28,861][123091] Updated weights for policy 0, policy_version 284880 (0.0009) [2023-12-26 01:51:29,332][123090] Updated weights for policy 1, policy_version 283457 (0.0008) [2023-12-26 01:51:29,406][123090] Updated weights for policy 1, policy_version 283467 (0.0008) [2023-12-26 01:51:29,478][123090] Updated weights for policy 1, policy_version 283477 (0.0008) [2023-12-26 01:51:29,553][123090] Updated weights for policy 1, policy_version 283487 (0.0008) [2023-12-26 01:51:29,686][123091] Updated weights for policy 0, policy_version 284890 (0.0005) [2023-12-26 01:51:29,738][123091] Updated weights for policy 0, policy_version 284900 (0.0006) [2023-12-26 01:51:29,798][123091] Updated weights for policy 0, policy_version 284910 (0.0007) [2023-12-26 01:51:30,288][123090] Updated weights for policy 1, policy_version 283497 (0.0010) [2023-12-26 01:51:30,358][123090] Updated weights for policy 1, policy_version 283507 (0.0010) [2023-12-26 01:51:30,429][123090] Updated weights for policy 1, policy_version 283517 (0.0011) [2023-12-26 01:51:30,562][123091] Updated weights for policy 0, policy_version 284920 (0.0009) [2023-12-26 01:51:30,626][123091] Updated weights for policy 0, policy_version 284930 (0.0009) [2023-12-26 01:51:30,680][123091] Updated weights for policy 0, policy_version 284940 (0.0007) [2023-12-26 01:51:31,145][123090] Updated weights for policy 1, policy_version 283527 (0.0007) [2023-12-26 01:51:31,218][123090] Updated weights for policy 1, policy_version 283537 (0.0009) [2023-12-26 01:51:31,287][123090] Updated weights for policy 1, policy_version 283547 (0.0008) [2023-12-26 01:51:31,485][123091] Updated weights for policy 0, policy_version 284950 (0.0007) [2023-12-26 01:51:31,547][123091] Updated weights for policy 0, policy_version 284960 (0.0007) [2023-12-26 01:51:31,615][123091] Updated weights for policy 0, policy_version 284970 (0.0006) [2023-12-26 01:51:32,076][123090] Updated weights for policy 1, policy_version 283557 (0.0010) [2023-12-26 01:51:32,142][123090] Updated weights for policy 1, policy_version 283567 (0.0010) [2023-12-26 01:51:32,207][123090] Updated weights for policy 1, policy_version 283577 (0.0007) [2023-12-26 01:51:32,416][123091] Updated weights for policy 0, policy_version 284980 (0.0008) [2023-12-26 01:51:32,478][123091] Updated weights for policy 0, policy_version 284990 (0.0007) [2023-12-26 01:51:32,525][123091] Updated weights for policy 0, policy_version 285000 (0.0006) [2023-12-26 01:51:32,868][123090] Updated weights for policy 1, policy_version 283587 (0.0005) [2023-12-26 01:51:32,917][123090] Updated weights for policy 1, policy_version 283597 (0.0005) [2023-12-26 01:51:32,966][123090] Updated weights for policy 1, policy_version 283607 (0.0005) [2023-12-26 01:51:33,219][123091] Updated weights for policy 0, policy_version 285010 (0.0005) [2023-12-26 01:51:33,278][123091] Updated weights for policy 0, policy_version 285020 (0.0005) [2023-12-26 01:51:33,343][123091] Updated weights for policy 0, policy_version 285030 (0.0005) [2023-12-26 01:51:33,398][123091] Updated weights for policy 0, policy_version 285040 (0.0005) [2023-12-26 01:51:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 145580032. Throughput: 0: 8771.8, 1: 8910.4. Samples: 145595276. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:33,785][121949] Avg episode reward: [(0, '6315.017'), (1, '5382.694')] [2023-12-26 01:51:33,794][123090] Updated weights for policy 1, policy_version 283617 (0.0006) [2023-12-26 01:51:33,860][123090] Updated weights for policy 1, policy_version 283627 (0.0010) [2023-12-26 01:51:33,917][123090] Updated weights for policy 1, policy_version 283637 (0.0010) [2023-12-26 01:51:33,978][123090] Updated weights for policy 1, policy_version 283647 (0.0009) [2023-12-26 01:51:34,023][123091] Updated weights for policy 0, policy_version 285050 (0.0007) [2023-12-26 01:51:34,082][123091] Updated weights for policy 0, policy_version 285060 (0.0010) [2023-12-26 01:51:34,133][123091] Updated weights for policy 0, policy_version 285070 (0.0010) [2023-12-26 01:51:34,843][123091] Updated weights for policy 0, policy_version 285080 (0.0006) [2023-12-26 01:51:34,914][123091] Updated weights for policy 0, policy_version 285090 (0.0005) [2023-12-26 01:51:34,928][123090] Updated weights for policy 1, policy_version 283657 (0.0008) [2023-12-26 01:51:34,979][123091] Updated weights for policy 0, policy_version 285100 (0.0012) [2023-12-26 01:51:34,989][123090] Updated weights for policy 1, policy_version 283667 (0.0008) [2023-12-26 01:51:35,049][123090] Updated weights for policy 1, policy_version 283677 (0.0009) [2023-12-26 01:51:35,624][123091] Updated weights for policy 0, policy_version 285110 (0.0008) [2023-12-26 01:51:35,686][123091] Updated weights for policy 0, policy_version 285120 (0.0006) [2023-12-26 01:51:35,753][123091] Updated weights for policy 0, policy_version 285130 (0.0005) [2023-12-26 01:51:35,779][123090] Updated weights for policy 1, policy_version 283687 (0.0009) [2023-12-26 01:51:35,831][123090] Updated weights for policy 1, policy_version 283697 (0.0010) [2023-12-26 01:51:35,883][123090] Updated weights for policy 1, policy_version 283707 (0.0010) [2023-12-26 01:51:36,487][123091] Updated weights for policy 0, policy_version 285140 (0.0007) [2023-12-26 01:51:36,542][123091] Updated weights for policy 0, policy_version 285150 (0.0007) [2023-12-26 01:51:36,589][123091] Updated weights for policy 0, policy_version 285160 (0.0006) [2023-12-26 01:51:36,746][123090] Updated weights for policy 1, policy_version 283717 (0.0010) [2023-12-26 01:51:36,816][123090] Updated weights for policy 1, policy_version 283727 (0.0010) [2023-12-26 01:51:36,882][123090] Updated weights for policy 1, policy_version 283737 (0.0010) [2023-12-26 01:51:37,425][123091] Updated weights for policy 0, policy_version 285170 (0.0007) [2023-12-26 01:51:37,494][123091] Updated weights for policy 0, policy_version 285180 (0.0010) [2023-12-26 01:51:37,560][123091] Updated weights for policy 0, policy_version 285190 (0.0009) [2023-12-26 01:51:37,628][123091] Updated weights for policy 0, policy_version 285200 (0.0009) [2023-12-26 01:51:37,634][123090] Updated weights for policy 1, policy_version 283747 (0.0010) [2023-12-26 01:51:37,694][123090] Updated weights for policy 1, policy_version 283757 (0.0006) [2023-12-26 01:51:37,764][123090] Updated weights for policy 1, policy_version 283767 (0.0005) [2023-12-26 01:51:38,469][123090] Updated weights for policy 1, policy_version 283777 (0.0005) [2023-12-26 01:51:38,508][123091] Updated weights for policy 0, policy_version 285210 (0.0009) [2023-12-26 01:51:38,534][123090] Updated weights for policy 1, policy_version 283787 (0.0008) [2023-12-26 01:51:38,573][123091] Updated weights for policy 0, policy_version 285220 (0.0008) [2023-12-26 01:51:38,598][123090] Updated weights for policy 1, policy_version 283797 (0.0010) [2023-12-26 01:51:38,637][123091] Updated weights for policy 0, policy_version 285230 (0.0009) [2023-12-26 01:51:38,661][123090] Updated weights for policy 1, policy_version 283807 (0.0010) [2023-12-26 01:51:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 145678336. Throughput: 0: 8852.7, 1: 8899.4. Samples: 145650240. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:38,785][121949] Avg episode reward: [(0, '6316.048'), (1, '5435.600')] [2023-12-26 01:51:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000285232_73023488.pth... [2023-12-26 01:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000283808_72654848.pth... [2023-12-26 01:51:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000284176_72753152.pth [2023-12-26 01:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000282752_72384512.pth [2023-12-26 01:51:39,414][123090] Updated weights for policy 1, policy_version 283817 (0.0008) [2023-12-26 01:51:39,448][123091] Updated weights for policy 0, policy_version 285240 (0.0008) [2023-12-26 01:51:39,489][123090] Updated weights for policy 1, policy_version 283827 (0.0006) [2023-12-26 01:51:39,512][123091] Updated weights for policy 0, policy_version 285250 (0.0008) [2023-12-26 01:51:39,549][123090] Updated weights for policy 1, policy_version 283837 (0.0009) [2023-12-26 01:51:39,573][123091] Updated weights for policy 0, policy_version 285260 (0.0008) [2023-12-26 01:51:40,369][123090] Updated weights for policy 1, policy_version 283847 (0.0006) [2023-12-26 01:51:40,419][123091] Updated weights for policy 0, policy_version 285270 (0.0009) [2023-12-26 01:51:40,429][123090] Updated weights for policy 1, policy_version 283857 (0.0008) [2023-12-26 01:51:40,481][123091] Updated weights for policy 0, policy_version 285280 (0.0007) [2023-12-26 01:51:40,490][123090] Updated weights for policy 1, policy_version 283867 (0.0009) [2023-12-26 01:51:40,542][123091] Updated weights for policy 0, policy_version 285290 (0.0008) [2023-12-26 01:51:41,201][123090] Updated weights for policy 1, policy_version 283878 (0.0011) [2023-12-26 01:51:41,249][123090] Updated weights for policy 1, policy_version 283888 (0.0009) [2023-12-26 01:51:41,313][123090] Updated weights for policy 1, policy_version 283898 (0.0010) [2023-12-26 01:51:41,447][123091] Updated weights for policy 0, policy_version 285300 (0.0009) [2023-12-26 01:51:41,516][123091] Updated weights for policy 0, policy_version 285310 (0.0010) [2023-12-26 01:51:41,586][123091] Updated weights for policy 0, policy_version 285320 (0.0009) [2023-12-26 01:51:42,148][123090] Updated weights for policy 1, policy_version 283908 (0.0008) [2023-12-26 01:51:42,221][123090] Updated weights for policy 1, policy_version 283918 (0.0006) [2023-12-26 01:51:42,286][123090] Updated weights for policy 1, policy_version 283928 (0.0009) [2023-12-26 01:51:42,341][123091] Updated weights for policy 0, policy_version 285330 (0.0009) [2023-12-26 01:51:42,416][123091] Updated weights for policy 0, policy_version 285340 (0.0007) [2023-12-26 01:51:42,477][123091] Updated weights for policy 0, policy_version 285350 (0.0005) [2023-12-26 01:51:42,538][123091] Updated weights for policy 0, policy_version 285360 (0.0008) [2023-12-26 01:51:43,078][123090] Updated weights for policy 1, policy_version 283938 (0.0010) [2023-12-26 01:51:43,134][123090] Updated weights for policy 1, policy_version 283948 (0.0009) [2023-12-26 01:51:43,192][123090] Updated weights for policy 1, policy_version 283958 (0.0009) [2023-12-26 01:51:43,256][123090] Updated weights for policy 1, policy_version 283968 (0.0009) [2023-12-26 01:51:43,275][123091] Updated weights for policy 0, policy_version 285370 (0.0005) [2023-12-26 01:51:43,323][123091] Updated weights for policy 0, policy_version 285380 (0.0007) [2023-12-26 01:51:43,370][123091] Updated weights for policy 0, policy_version 285390 (0.0005) [2023-12-26 01:51:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 145760256. Throughput: 0: 8838.0, 1: 8836.9. Samples: 145754352. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:43,784][121949] Avg episode reward: [(0, '6243.515'), (1, '5472.007')] [2023-12-26 01:51:44,001][123090] Updated weights for policy 1, policy_version 283978 (0.0005) [2023-12-26 01:51:44,047][123090] Updated weights for policy 1, policy_version 283988 (0.0005) [2023-12-26 01:51:44,062][123091] Updated weights for policy 0, policy_version 285400 (0.0005) [2023-12-26 01:51:44,096][123090] Updated weights for policy 1, policy_version 283998 (0.0005) [2023-12-26 01:51:44,118][123091] Updated weights for policy 0, policy_version 285410 (0.0007) [2023-12-26 01:51:44,179][123091] Updated weights for policy 0, policy_version 285420 (0.0009) [2023-12-26 01:51:44,790][123090] Updated weights for policy 1, policy_version 284008 (0.0008) [2023-12-26 01:51:44,855][123090] Updated weights for policy 1, policy_version 284018 (0.0009) [2023-12-26 01:51:44,929][123090] Updated weights for policy 1, policy_version 284028 (0.0009) [2023-12-26 01:51:45,010][123091] Updated weights for policy 0, policy_version 285430 (0.0011) [2023-12-26 01:51:45,075][123091] Updated weights for policy 0, policy_version 285440 (0.0008) [2023-12-26 01:51:45,150][123091] Updated weights for policy 0, policy_version 285450 (0.0006) [2023-12-26 01:51:45,815][123090] Updated weights for policy 1, policy_version 284038 (0.0009) [2023-12-26 01:51:45,868][123090] Updated weights for policy 1, policy_version 284048 (0.0008) [2023-12-26 01:51:45,909][123091] Updated weights for policy 0, policy_version 285460 (0.0008) [2023-12-26 01:51:45,928][123090] Updated weights for policy 1, policy_version 284058 (0.0008) [2023-12-26 01:51:45,975][123091] Updated weights for policy 0, policy_version 285470 (0.0011) [2023-12-26 01:51:46,034][123091] Updated weights for policy 0, policy_version 285480 (0.0011) [2023-12-26 01:51:46,720][123090] Updated weights for policy 1, policy_version 284068 (0.0007) [2023-12-26 01:51:46,777][123090] Updated weights for policy 1, policy_version 284078 (0.0009) [2023-12-26 01:51:46,834][123090] Updated weights for policy 1, policy_version 284088 (0.0010) [2023-12-26 01:51:46,849][123091] Updated weights for policy 0, policy_version 285490 (0.0009) [2023-12-26 01:51:46,902][123091] Updated weights for policy 0, policy_version 285500 (0.0005) [2023-12-26 01:51:46,947][123091] Updated weights for policy 0, policy_version 285510 (0.0005) [2023-12-26 01:51:46,996][123091] Updated weights for policy 0, policy_version 285520 (0.0005) [2023-12-26 01:51:47,638][123091] Updated weights for policy 0, policy_version 285530 (0.0005) [2023-12-26 01:51:47,689][123091] Updated weights for policy 0, policy_version 285540 (0.0005) [2023-12-26 01:51:47,754][123091] Updated weights for policy 0, policy_version 285550 (0.0010) [2023-12-26 01:51:47,764][123090] Updated weights for policy 1, policy_version 284098 (0.0009) [2023-12-26 01:51:47,822][123090] Updated weights for policy 1, policy_version 284108 (0.0008) [2023-12-26 01:51:47,890][123090] Updated weights for policy 1, policy_version 284118 (0.0005) [2023-12-26 01:51:47,962][123090] Updated weights for policy 1, policy_version 284128 (0.0005) [2023-12-26 01:51:48,559][123091] Updated weights for policy 0, policy_version 285560 (0.0011) [2023-12-26 01:51:48,578][123090] Updated weights for policy 1, policy_version 284138 (0.0008) [2023-12-26 01:51:48,616][123091] Updated weights for policy 0, policy_version 285570 (0.0011) [2023-12-26 01:51:48,633][123090] Updated weights for policy 1, policy_version 284148 (0.0011) [2023-12-26 01:51:48,680][123091] Updated weights for policy 0, policy_version 285580 (0.0011) [2023-12-26 01:51:48,694][123090] Updated weights for policy 1, policy_version 284158 (0.0011) [2023-12-26 01:51:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 145858560. Throughput: 0: 8964.2, 1: 8863.1. Samples: 145864228. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:48,784][121949] Avg episode reward: [(0, '6259.647'), (1, '5442.047')] [2023-12-26 01:51:49,503][123091] Updated weights for policy 0, policy_version 285590 (0.0011) [2023-12-26 01:51:49,506][123090] Updated weights for policy 1, policy_version 284168 (0.0009) [2023-12-26 01:51:49,561][123091] Updated weights for policy 0, policy_version 285600 (0.0010) [2023-12-26 01:51:49,561][123090] Updated weights for policy 1, policy_version 284178 (0.0008) [2023-12-26 01:51:49,623][123091] Updated weights for policy 0, policy_version 285610 (0.0010) [2023-12-26 01:51:49,627][123090] Updated weights for policy 1, policy_version 284188 (0.0008) [2023-12-26 01:51:50,447][123091] Updated weights for policy 0, policy_version 285620 (0.0009) [2023-12-26 01:51:50,476][123090] Updated weights for policy 1, policy_version 284198 (0.0008) [2023-12-26 01:51:50,510][123091] Updated weights for policy 0, policy_version 285630 (0.0008) [2023-12-26 01:51:50,543][123090] Updated weights for policy 1, policy_version 284208 (0.0008) [2023-12-26 01:51:50,578][123091] Updated weights for policy 0, policy_version 285640 (0.0008) [2023-12-26 01:51:50,612][123090] Updated weights for policy 1, policy_version 284218 (0.0008) [2023-12-26 01:51:51,411][123091] Updated weights for policy 0, policy_version 285650 (0.0008) [2023-12-26 01:51:51,467][123091] Updated weights for policy 0, policy_version 285660 (0.0009) [2023-12-26 01:51:51,473][123090] Updated weights for policy 1, policy_version 284228 (0.0008) [2023-12-26 01:51:51,524][123091] Updated weights for policy 0, policy_version 285670 (0.0009) [2023-12-26 01:51:51,545][123090] Updated weights for policy 1, policy_version 284238 (0.0006) [2023-12-26 01:51:51,579][123091] Updated weights for policy 0, policy_version 285680 (0.0009) [2023-12-26 01:51:51,615][123090] Updated weights for policy 1, policy_version 284248 (0.0008) [2023-12-26 01:51:52,341][123090] Updated weights for policy 1, policy_version 284258 (0.0009) [2023-12-26 01:51:52,407][123090] Updated weights for policy 1, policy_version 284268 (0.0007) [2023-12-26 01:51:52,409][123091] Updated weights for policy 0, policy_version 285690 (0.0007) [2023-12-26 01:51:52,474][123090] Updated weights for policy 1, policy_version 284278 (0.0006) [2023-12-26 01:51:52,474][123091] Updated weights for policy 0, policy_version 285700 (0.0007) [2023-12-26 01:51:52,541][123091] Updated weights for policy 0, policy_version 285710 (0.0006) [2023-12-26 01:51:52,549][123090] Updated weights for policy 1, policy_version 284288 (0.0006) [2023-12-26 01:51:53,173][123090] Updated weights for policy 1, policy_version 284298 (0.0010) [2023-12-26 01:51:53,227][123090] Updated weights for policy 1, policy_version 284309 (0.0010) [2023-12-26 01:51:53,280][123091] Updated weights for policy 0, policy_version 285720 (0.0007) [2023-12-26 01:51:53,292][123090] Updated weights for policy 1, policy_version 284319 (0.0010) [2023-12-26 01:51:53,329][123091] Updated weights for policy 0, policy_version 285730 (0.0008) [2023-12-26 01:51:53,380][123091] Updated weights for policy 0, policy_version 285740 (0.0008) [2023-12-26 01:51:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 145940480. Throughput: 0: 8911.2, 1: 8881.3. Samples: 145914960. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:53,785][121949] Avg episode reward: [(0, '6267.226'), (1, '5304.071')] [2023-12-26 01:51:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000285744_73154560.pth... [2023-12-26 01:51:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000284320_72785920.pth... [2023-12-26 01:51:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000283264_72515584.pth [2023-12-26 01:51:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000284688_72884224.pth [2023-12-26 01:51:54,148][123090] Updated weights for policy 1, policy_version 284329 (0.0010) [2023-12-26 01:51:54,208][123091] Updated weights for policy 0, policy_version 285750 (0.0010) [2023-12-26 01:51:54,211][123090] Updated weights for policy 1, policy_version 284339 (0.0010) [2023-12-26 01:51:54,256][123091] Updated weights for policy 0, policy_version 285760 (0.0009) [2023-12-26 01:51:54,259][123090] Updated weights for policy 1, policy_version 284349 (0.0010) [2023-12-26 01:51:54,314][123091] Updated weights for policy 0, policy_version 285770 (0.0008) [2023-12-26 01:51:55,015][123090] Updated weights for policy 1, policy_version 284359 (0.0008) [2023-12-26 01:51:55,081][123090] Updated weights for policy 1, policy_version 284369 (0.0009) [2023-12-26 01:51:55,145][123090] Updated weights for policy 1, policy_version 284379 (0.0008) [2023-12-26 01:51:55,196][123091] Updated weights for policy 0, policy_version 285780 (0.0010) [2023-12-26 01:51:55,267][123091] Updated weights for policy 0, policy_version 285790 (0.0009) [2023-12-26 01:51:55,327][123091] Updated weights for policy 0, policy_version 285800 (0.0009) [2023-12-26 01:51:55,899][123090] Updated weights for policy 1, policy_version 284389 (0.0008) [2023-12-26 01:51:55,948][123090] Updated weights for policy 1, policy_version 284399 (0.0009) [2023-12-26 01:51:56,001][123090] Updated weights for policy 1, policy_version 284410 (0.0010) [2023-12-26 01:51:56,141][123091] Updated weights for policy 0, policy_version 285810 (0.0010) [2023-12-26 01:51:56,210][123091] Updated weights for policy 0, policy_version 285820 (0.0010) [2023-12-26 01:51:56,277][123091] Updated weights for policy 0, policy_version 285830 (0.0009) [2023-12-26 01:51:56,333][123091] Updated weights for policy 0, policy_version 285840 (0.0010) [2023-12-26 01:51:56,857][123090] Updated weights for policy 1, policy_version 284420 (0.0008) [2023-12-26 01:51:56,914][123090] Updated weights for policy 1, policy_version 284430 (0.0005) [2023-12-26 01:51:56,962][123090] Updated weights for policy 1, policy_version 284440 (0.0005) [2023-12-26 01:51:57,188][123091] Updated weights for policy 0, policy_version 285850 (0.0010) [2023-12-26 01:51:57,239][123091] Updated weights for policy 0, policy_version 285860 (0.0009) [2023-12-26 01:51:57,294][123091] Updated weights for policy 0, policy_version 285870 (0.0009) [2023-12-26 01:51:57,740][123090] Updated weights for policy 1, policy_version 284450 (0.0008) [2023-12-26 01:51:57,805][123090] Updated weights for policy 1, policy_version 284460 (0.0009) [2023-12-26 01:51:57,858][123090] Updated weights for policy 1, policy_version 284470 (0.0009) [2023-12-26 01:51:57,904][123090] Updated weights for policy 1, policy_version 284480 (0.0009) [2023-12-26 01:51:58,101][123091] Updated weights for policy 0, policy_version 285880 (0.0010) [2023-12-26 01:51:58,153][123091] Updated weights for policy 0, policy_version 285890 (0.0009) [2023-12-26 01:51:58,215][123091] Updated weights for policy 0, policy_version 285900 (0.0010) [2023-12-26 01:51:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 146022400. Throughput: 0: 8937.3, 1: 8972.1. Samples: 146021228. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:51:58,785][121949] Avg episode reward: [(0, '6330.097'), (1, '5233.179')] [2023-12-26 01:51:58,892][123090] Updated weights for policy 1, policy_version 284490 (0.0009) [2023-12-26 01:51:58,965][123090] Updated weights for policy 1, policy_version 284500 (0.0008) [2023-12-26 01:51:59,039][123090] Updated weights for policy 1, policy_version 284510 (0.0008) [2023-12-26 01:51:59,132][123091] Updated weights for policy 0, policy_version 285910 (0.0009) [2023-12-26 01:51:59,198][123091] Updated weights for policy 0, policy_version 285920 (0.0010) [2023-12-26 01:51:59,270][123091] Updated weights for policy 0, policy_version 285930 (0.0010) [2023-12-26 01:51:59,737][123090] Updated weights for policy 1, policy_version 284520 (0.0008) [2023-12-26 01:51:59,790][123090] Updated weights for policy 1, policy_version 284530 (0.0008) [2023-12-26 01:51:59,864][123090] Updated weights for policy 1, policy_version 284540 (0.0007) [2023-12-26 01:52:00,126][123091] Updated weights for policy 0, policy_version 285940 (0.0009) [2023-12-26 01:52:00,187][123091] Updated weights for policy 0, policy_version 285950 (0.0008) [2023-12-26 01:52:00,251][123091] Updated weights for policy 0, policy_version 285960 (0.0010) [2023-12-26 01:52:00,559][123090] Updated weights for policy 1, policy_version 284550 (0.0005) [2023-12-26 01:52:00,615][123090] Updated weights for policy 1, policy_version 284560 (0.0005) [2023-12-26 01:52:00,679][123090] Updated weights for policy 1, policy_version 284570 (0.0005) [2023-12-26 01:52:01,099][123091] Updated weights for policy 0, policy_version 285970 (0.0009) [2023-12-26 01:52:01,157][123091] Updated weights for policy 0, policy_version 285980 (0.0008) [2023-12-26 01:52:01,217][123091] Updated weights for policy 0, policy_version 285990 (0.0009) [2023-12-26 01:52:01,281][123091] Updated weights for policy 0, policy_version 286000 (0.0009) [2023-12-26 01:52:01,451][123090] Updated weights for policy 1, policy_version 284580 (0.0007) [2023-12-26 01:52:01,513][123090] Updated weights for policy 1, policy_version 284590 (0.0010) [2023-12-26 01:52:01,576][123090] Updated weights for policy 1, policy_version 284600 (0.0010) [2023-12-26 01:52:02,090][123091] Updated weights for policy 0, policy_version 286010 (0.0009) [2023-12-26 01:52:02,152][123091] Updated weights for policy 0, policy_version 286020 (0.0009) [2023-12-26 01:52:02,211][123091] Updated weights for policy 0, policy_version 286030 (0.0008) [2023-12-26 01:52:02,402][123090] Updated weights for policy 1, policy_version 284610 (0.0011) [2023-12-26 01:52:02,460][123090] Updated weights for policy 1, policy_version 284620 (0.0006) [2023-12-26 01:52:02,519][123090] Updated weights for policy 1, policy_version 284630 (0.0005) [2023-12-26 01:52:02,570][123090] Updated weights for policy 1, policy_version 284640 (0.0010) [2023-12-26 01:52:02,980][123091] Updated weights for policy 0, policy_version 286040 (0.0009) [2023-12-26 01:52:03,043][123091] Updated weights for policy 0, policy_version 286050 (0.0011) [2023-12-26 01:52:03,090][123091] Updated weights for policy 0, policy_version 286060 (0.0010) [2023-12-26 01:52:03,328][123090] Updated weights for policy 1, policy_version 284650 (0.0005) [2023-12-26 01:52:03,386][123090] Updated weights for policy 1, policy_version 284660 (0.0005) [2023-12-26 01:52:03,451][123090] Updated weights for policy 1, policy_version 284670 (0.0005) [2023-12-26 01:52:03,781][123091] Updated weights for policy 0, policy_version 286070 (0.0006) [2023-12-26 01:52:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 146112512. Throughput: 0: 8920.5, 1: 9015.3. Samples: 146127476. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:03,784][121949] Avg episode reward: [(0, '6377.928'), (1, '5427.035')] [2023-12-26 01:52:03,829][123091] Updated weights for policy 0, policy_version 286080 (0.0010) [2023-12-26 01:52:03,900][123091] Updated weights for policy 0, policy_version 286090 (0.0010) [2023-12-26 01:52:04,165][123090] Updated weights for policy 1, policy_version 284680 (0.0009) [2023-12-26 01:52:04,228][123090] Updated weights for policy 1, policy_version 284690 (0.0011) [2023-12-26 01:52:04,291][123090] Updated weights for policy 1, policy_version 284700 (0.0011) [2023-12-26 01:52:04,684][123091] Updated weights for policy 0, policy_version 286100 (0.0010) [2023-12-26 01:52:04,746][123091] Updated weights for policy 0, policy_version 286110 (0.0006) [2023-12-26 01:52:04,822][123091] Updated weights for policy 0, policy_version 286120 (0.0005) [2023-12-26 01:52:05,100][123090] Updated weights for policy 1, policy_version 284710 (0.0007) [2023-12-26 01:52:05,156][123090] Updated weights for policy 1, policy_version 284720 (0.0005) [2023-12-26 01:52:05,216][123090] Updated weights for policy 1, policy_version 284730 (0.0006) [2023-12-26 01:52:05,621][123091] Updated weights for policy 0, policy_version 286130 (0.0006) [2023-12-26 01:52:05,682][123091] Updated weights for policy 0, policy_version 286140 (0.0009) [2023-12-26 01:52:05,744][123091] Updated weights for policy 0, policy_version 286150 (0.0011) [2023-12-26 01:52:05,796][123091] Updated weights for policy 0, policy_version 286160 (0.0011) [2023-12-26 01:52:05,967][123090] Updated weights for policy 1, policy_version 284740 (0.0008) [2023-12-26 01:52:06,027][123090] Updated weights for policy 1, policy_version 284750 (0.0010) [2023-12-26 01:52:06,090][123090] Updated weights for policy 1, policy_version 284760 (0.0010) [2023-12-26 01:52:06,606][123091] Updated weights for policy 0, policy_version 286170 (0.0011) [2023-12-26 01:52:06,671][123091] Updated weights for policy 0, policy_version 286180 (0.0010) [2023-12-26 01:52:06,730][123091] Updated weights for policy 0, policy_version 286190 (0.0005) [2023-12-26 01:52:06,934][123090] Updated weights for policy 1, policy_version 284770 (0.0011) [2023-12-26 01:52:06,999][123090] Updated weights for policy 1, policy_version 284780 (0.0009) [2023-12-26 01:52:07,062][123090] Updated weights for policy 1, policy_version 284790 (0.0010) [2023-12-26 01:52:07,132][123090] Updated weights for policy 1, policy_version 284800 (0.0010) [2023-12-26 01:52:07,512][123091] Updated weights for policy 0, policy_version 286200 (0.0010) [2023-12-26 01:52:07,569][123091] Updated weights for policy 0, policy_version 286210 (0.0009) [2023-12-26 01:52:07,623][123091] Updated weights for policy 0, policy_version 286220 (0.0009) [2023-12-26 01:52:07,884][123090] Updated weights for policy 1, policy_version 284810 (0.0005) [2023-12-26 01:52:07,951][123090] Updated weights for policy 1, policy_version 284820 (0.0005) [2023-12-26 01:52:08,026][123090] Updated weights for policy 1, policy_version 284830 (0.0008) [2023-12-26 01:52:08,359][123091] Updated weights for policy 0, policy_version 286230 (0.0009) [2023-12-26 01:52:08,419][123091] Updated weights for policy 0, policy_version 286240 (0.0008) [2023-12-26 01:52:08,476][123091] Updated weights for policy 0, policy_version 286250 (0.0009) [2023-12-26 01:52:08,762][123090] Updated weights for policy 1, policy_version 284840 (0.0009) [2023-12-26 01:52:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 146202624. Throughput: 0: 8937.3, 1: 9044.3. Samples: 146180560. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:08,785][121949] Avg episode reward: [(0, '6437.842'), (1, '5498.538')] [2023-12-26 01:52:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000286256_73285632.pth... [2023-12-26 01:52:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000285232_73023488.pth [2023-12-26 01:52:08,797][123007] Saving new best policy, reward=6437.842! [2023-12-26 01:52:08,819][123090] Updated weights for policy 1, policy_version 284850 (0.0005) [2023-12-26 01:52:08,878][123090] Updated weights for policy 1, policy_version 284860 (0.0005) [2023-12-26 01:52:08,905][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000284864_72925184.pth... [2023-12-26 01:52:08,910][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000283808_72654848.pth [2023-12-26 01:52:09,188][123091] Updated weights for policy 0, policy_version 286260 (0.0009) [2023-12-26 01:52:09,253][123091] Updated weights for policy 0, policy_version 286270 (0.0007) [2023-12-26 01:52:09,318][123091] Updated weights for policy 0, policy_version 286280 (0.0008) [2023-12-26 01:52:09,617][123090] Updated weights for policy 1, policy_version 284870 (0.0005) [2023-12-26 01:52:09,691][123090] Updated weights for policy 1, policy_version 284880 (0.0006) [2023-12-26 01:52:09,770][123090] Updated weights for policy 1, policy_version 284890 (0.0007) [2023-12-26 01:52:10,066][123091] Updated weights for policy 0, policy_version 286290 (0.0008) [2023-12-26 01:52:10,134][123091] Updated weights for policy 0, policy_version 286300 (0.0007) [2023-12-26 01:52:10,191][123091] Updated weights for policy 0, policy_version 286310 (0.0006) [2023-12-26 01:52:10,250][123091] Updated weights for policy 0, policy_version 286320 (0.0006) [2023-12-26 01:52:10,551][123090] Updated weights for policy 1, policy_version 284900 (0.0011) [2023-12-26 01:52:10,619][123090] Updated weights for policy 1, policy_version 284910 (0.0011) [2023-12-26 01:52:10,675][123090] Updated weights for policy 1, policy_version 284920 (0.0010) [2023-12-26 01:52:10,908][123091] Updated weights for policy 0, policy_version 286330 (0.0005) [2023-12-26 01:52:10,969][123091] Updated weights for policy 0, policy_version 286340 (0.0005) [2023-12-26 01:52:11,028][123091] Updated weights for policy 0, policy_version 286350 (0.0008) [2023-12-26 01:52:11,520][123090] Updated weights for policy 1, policy_version 284930 (0.0009) [2023-12-26 01:52:11,587][123090] Updated weights for policy 1, policy_version 284940 (0.0010) [2023-12-26 01:52:11,651][123090] Updated weights for policy 1, policy_version 284950 (0.0011) [2023-12-26 01:52:11,709][123090] Updated weights for policy 1, policy_version 284960 (0.0010) [2023-12-26 01:52:11,787][123091] Updated weights for policy 0, policy_version 286360 (0.0009) [2023-12-26 01:52:11,849][123091] Updated weights for policy 0, policy_version 286370 (0.0009) [2023-12-26 01:52:11,909][123091] Updated weights for policy 0, policy_version 286380 (0.0009) [2023-12-26 01:52:12,573][123090] Updated weights for policy 1, policy_version 284970 (0.0005) [2023-12-26 01:52:12,640][123090] Updated weights for policy 1, policy_version 284980 (0.0005) [2023-12-26 01:52:12,711][123090] Updated weights for policy 1, policy_version 284990 (0.0005) [2023-12-26 01:52:12,747][123091] Updated weights for policy 0, policy_version 286390 (0.0009) [2023-12-26 01:52:12,800][123091] Updated weights for policy 0, policy_version 286400 (0.0010) [2023-12-26 01:52:12,857][123091] Updated weights for policy 0, policy_version 286410 (0.0009) [2023-12-26 01:52:13,393][123090] Updated weights for policy 1, policy_version 285000 (0.0009) [2023-12-26 01:52:13,448][123090] Updated weights for policy 1, policy_version 285010 (0.0010) [2023-12-26 01:52:13,507][123090] Updated weights for policy 1, policy_version 285020 (0.0010) [2023-12-26 01:52:13,730][123091] Updated weights for policy 0, policy_version 286420 (0.0010) [2023-12-26 01:52:13,782][123091] Updated weights for policy 0, policy_version 286431 (0.0009) [2023-12-26 01:52:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 146292736. Throughput: 0: 8918.7, 1: 8957.6. Samples: 146288704. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:13,785][121949] Avg episode reward: [(0, '6334.364'), (1, '5239.299')] [2023-12-26 01:52:13,844][123091] Updated weights for policy 0, policy_version 286441 (0.0009) [2023-12-26 01:52:14,158][123090] Updated weights for policy 1, policy_version 285030 (0.0008) [2023-12-26 01:52:14,206][123090] Updated weights for policy 1, policy_version 285040 (0.0007) [2023-12-26 01:52:14,253][123090] Updated weights for policy 1, policy_version 285050 (0.0005) [2023-12-26 01:52:14,742][123091] Updated weights for policy 0, policy_version 286451 (0.0009) [2023-12-26 01:52:14,814][123091] Updated weights for policy 0, policy_version 286461 (0.0008) [2023-12-26 01:52:14,878][123091] Updated weights for policy 0, policy_version 286471 (0.0009) [2023-12-26 01:52:15,035][123090] Updated weights for policy 1, policy_version 285060 (0.0009) [2023-12-26 01:52:15,091][123090] Updated weights for policy 1, policy_version 285070 (0.0010) [2023-12-26 01:52:15,156][123090] Updated weights for policy 1, policy_version 285080 (0.0011) [2023-12-26 01:52:15,693][123091] Updated weights for policy 0, policy_version 286481 (0.0009) [2023-12-26 01:52:15,747][123091] Updated weights for policy 0, policy_version 286491 (0.0010) [2023-12-26 01:52:15,808][123091] Updated weights for policy 0, policy_version 286501 (0.0010) [2023-12-26 01:52:15,875][123091] Updated weights for policy 0, policy_version 286511 (0.0010) [2023-12-26 01:52:15,949][123090] Updated weights for policy 1, policy_version 285090 (0.0010) [2023-12-26 01:52:16,000][123090] Updated weights for policy 1, policy_version 285100 (0.0005) [2023-12-26 01:52:16,048][123090] Updated weights for policy 1, policy_version 285110 (0.0005) [2023-12-26 01:52:16,103][123090] Updated weights for policy 1, policy_version 285120 (0.0005) [2023-12-26 01:52:16,650][123091] Updated weights for policy 0, policy_version 286521 (0.0009) [2023-12-26 01:52:16,728][123091] Updated weights for policy 0, policy_version 286531 (0.0006) [2023-12-26 01:52:16,784][123091] Updated weights for policy 0, policy_version 286541 (0.0005) [2023-12-26 01:52:16,818][123090] Updated weights for policy 1, policy_version 285130 (0.0010) [2023-12-26 01:52:16,877][123090] Updated weights for policy 1, policy_version 285140 (0.0010) [2023-12-26 01:52:16,933][123090] Updated weights for policy 1, policy_version 285150 (0.0010) [2023-12-26 01:52:17,573][123090] Updated weights for policy 1, policy_version 285160 (0.0008) [2023-12-26 01:52:17,597][123091] Updated weights for policy 0, policy_version 286551 (0.0007) [2023-12-26 01:52:17,632][123090] Updated weights for policy 1, policy_version 285170 (0.0005) [2023-12-26 01:52:17,649][123091] Updated weights for policy 0, policy_version 286561 (0.0009) [2023-12-26 01:52:17,698][123090] Updated weights for policy 1, policy_version 285180 (0.0005) [2023-12-26 01:52:17,699][123091] Updated weights for policy 0, policy_version 286571 (0.0009) [2023-12-26 01:52:18,330][123090] Updated weights for policy 1, policy_version 285190 (0.0009) [2023-12-26 01:52:18,393][123090] Updated weights for policy 1, policy_version 285200 (0.0010) [2023-12-26 01:52:18,453][123090] Updated weights for policy 1, policy_version 285210 (0.0011) [2023-12-26 01:52:18,628][123091] Updated weights for policy 0, policy_version 286581 (0.0009) [2023-12-26 01:52:18,690][123091] Updated weights for policy 0, policy_version 286591 (0.0010) [2023-12-26 01:52:18,756][123091] Updated weights for policy 0, policy_version 286601 (0.0009) [2023-12-26 01:52:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 146382848. Throughput: 0: 8835.5, 1: 8992.5. Samples: 146397532. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:18,784][121949] Avg episode reward: [(0, '6271.500'), (1, '5250.295')] [2023-12-26 01:52:19,210][123090] Updated weights for policy 1, policy_version 285220 (0.0009) [2023-12-26 01:52:19,283][123090] Updated weights for policy 1, policy_version 285230 (0.0008) [2023-12-26 01:52:19,351][123090] Updated weights for policy 1, policy_version 285240 (0.0007) [2023-12-26 01:52:19,655][123091] Updated weights for policy 0, policy_version 286611 (0.0010) [2023-12-26 01:52:19,723][123091] Updated weights for policy 0, policy_version 286621 (0.0010) [2023-12-26 01:52:19,785][123091] Updated weights for policy 0, policy_version 286631 (0.0010) [2023-12-26 01:52:20,199][123090] Updated weights for policy 1, policy_version 285250 (0.0009) [2023-12-26 01:52:20,261][123090] Updated weights for policy 1, policy_version 285260 (0.0009) [2023-12-26 01:52:20,333][123090] Updated weights for policy 1, policy_version 285270 (0.0009) [2023-12-26 01:52:20,405][123090] Updated weights for policy 1, policy_version 285280 (0.0009) [2023-12-26 01:52:20,630][123091] Updated weights for policy 0, policy_version 286641 (0.0009) [2023-12-26 01:52:20,698][123091] Updated weights for policy 0, policy_version 286651 (0.0010) [2023-12-26 01:52:20,755][123091] Updated weights for policy 0, policy_version 286661 (0.0009) [2023-12-26 01:52:20,822][123091] Updated weights for policy 0, policy_version 286671 (0.0010) [2023-12-26 01:52:21,228][123090] Updated weights for policy 1, policy_version 285290 (0.0010) [2023-12-26 01:52:21,284][123090] Updated weights for policy 1, policy_version 285300 (0.0009) [2023-12-26 01:52:21,341][123090] Updated weights for policy 1, policy_version 285310 (0.0009) [2023-12-26 01:52:21,717][123091] Updated weights for policy 0, policy_version 286681 (0.0009) [2023-12-26 01:52:21,793][123091] Updated weights for policy 0, policy_version 286691 (0.0008) [2023-12-26 01:52:21,860][123091] Updated weights for policy 0, policy_version 286701 (0.0008) [2023-12-26 01:52:22,228][123090] Updated weights for policy 1, policy_version 285320 (0.0008) [2023-12-26 01:52:22,296][123090] Updated weights for policy 1, policy_version 285330 (0.0007) [2023-12-26 01:52:22,373][123090] Updated weights for policy 1, policy_version 285340 (0.0007) [2023-12-26 01:52:22,636][123091] Updated weights for policy 0, policy_version 286711 (0.0009) [2023-12-26 01:52:22,707][123091] Updated weights for policy 0, policy_version 286721 (0.0009) [2023-12-26 01:52:22,769][123091] Updated weights for policy 0, policy_version 286731 (0.0008) [2023-12-26 01:52:23,055][123090] Updated weights for policy 1, policy_version 285350 (0.0006) [2023-12-26 01:52:23,114][123090] Updated weights for policy 1, policy_version 285360 (0.0009) [2023-12-26 01:52:23,171][123090] Updated weights for policy 1, policy_version 285370 (0.0010) [2023-12-26 01:52:23,468][123091] Updated weights for policy 0, policy_version 286741 (0.0005) [2023-12-26 01:52:23,528][123091] Updated weights for policy 0, policy_version 286751 (0.0005) [2023-12-26 01:52:23,582][123091] Updated weights for policy 0, policy_version 286761 (0.0005) [2023-12-26 01:52:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 146472960. Throughput: 0: 8705.4, 1: 9006.4. Samples: 146447272. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:23,785][121949] Avg episode reward: [(0, '6337.962'), (1, '5391.172')] [2023-12-26 01:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000285376_73056256.pth... [2023-12-26 01:52:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000286768_73416704.pth... [2023-12-26 01:52:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000284320_72785920.pth [2023-12-26 01:52:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000285744_73154560.pth [2023-12-26 01:52:23,892][123090] Updated weights for policy 1, policy_version 285380 (0.0009) [2023-12-26 01:52:23,939][123090] Updated weights for policy 1, policy_version 285390 (0.0010) [2023-12-26 01:52:23,994][123090] Updated weights for policy 1, policy_version 285400 (0.0010) [2023-12-26 01:52:24,322][123091] Updated weights for policy 0, policy_version 286771 (0.0005) [2023-12-26 01:52:24,379][123091] Updated weights for policy 0, policy_version 286781 (0.0007) [2023-12-26 01:52:24,441][123091] Updated weights for policy 0, policy_version 286791 (0.0010) [2023-12-26 01:52:24,745][123090] Updated weights for policy 1, policy_version 285410 (0.0009) [2023-12-26 01:52:24,810][123090] Updated weights for policy 1, policy_version 285420 (0.0007) [2023-12-26 01:52:24,876][123090] Updated weights for policy 1, policy_version 285430 (0.0006) [2023-12-26 01:52:24,933][123090] Updated weights for policy 1, policy_version 285440 (0.0007) [2023-12-26 01:52:25,241][123091] Updated weights for policy 0, policy_version 286802 (0.0011) [2023-12-26 01:52:25,292][123091] Updated weights for policy 0, policy_version 286812 (0.0010) [2023-12-26 01:52:25,339][123091] Updated weights for policy 0, policy_version 286822 (0.0010) [2023-12-26 01:52:25,387][123091] Updated weights for policy 0, policy_version 286832 (0.0010) [2023-12-26 01:52:25,618][123090] Updated weights for policy 1, policy_version 285450 (0.0010) [2023-12-26 01:52:25,665][123090] Updated weights for policy 1, policy_version 285460 (0.0010) [2023-12-26 01:52:25,727][123090] Updated weights for policy 1, policy_version 285470 (0.0010) [2023-12-26 01:52:26,130][123091] Updated weights for policy 0, policy_version 286842 (0.0009) [2023-12-26 01:52:26,185][123091] Updated weights for policy 0, policy_version 286852 (0.0010) [2023-12-26 01:52:26,232][123091] Updated weights for policy 0, policy_version 286862 (0.0010) [2023-12-26 01:52:26,521][123090] Updated weights for policy 1, policy_version 285480 (0.0010) [2023-12-26 01:52:26,573][123090] Updated weights for policy 1, policy_version 285490 (0.0010) [2023-12-26 01:52:26,635][123090] Updated weights for policy 1, policy_version 285500 (0.0010) [2023-12-26 01:52:27,049][123091] Updated weights for policy 0, policy_version 286872 (0.0010) [2023-12-26 01:52:27,101][123091] Updated weights for policy 0, policy_version 286882 (0.0010) [2023-12-26 01:52:27,155][123091] Updated weights for policy 0, policy_version 286892 (0.0010) [2023-12-26 01:52:27,474][123090] Updated weights for policy 1, policy_version 285510 (0.0010) [2023-12-26 01:52:27,541][123090] Updated weights for policy 1, policy_version 285520 (0.0010) [2023-12-26 01:52:27,593][123090] Updated weights for policy 1, policy_version 285530 (0.0010) [2023-12-26 01:52:27,864][123091] Updated weights for policy 0, policy_version 286902 (0.0007) [2023-12-26 01:52:27,932][123091] Updated weights for policy 0, policy_version 286912 (0.0005) [2023-12-26 01:52:27,991][123091] Updated weights for policy 0, policy_version 286922 (0.0005) [2023-12-26 01:52:28,403][123090] Updated weights for policy 1, policy_version 285540 (0.0010) [2023-12-26 01:52:28,476][123090] Updated weights for policy 1, policy_version 285550 (0.0010) [2023-12-26 01:52:28,539][123090] Updated weights for policy 1, policy_version 285560 (0.0010) [2023-12-26 01:52:28,546][123091] Updated weights for policy 0, policy_version 286932 (0.0008) [2023-12-26 01:52:28,604][123091] Updated weights for policy 0, policy_version 286942 (0.0010) [2023-12-26 01:52:28,665][123091] Updated weights for policy 0, policy_version 286952 (0.0013) [2023-12-26 01:52:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 146571264. Throughput: 0: 8826.7, 1: 9037.5. Samples: 146558244. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:28,785][121949] Avg episode reward: [(0, '6356.290'), (1, '5276.905')] [2023-12-26 01:52:29,356][123090] Updated weights for policy 1, policy_version 285570 (0.0010) [2023-12-26 01:52:29,416][123090] Updated weights for policy 1, policy_version 285580 (0.0009) [2023-12-26 01:52:29,460][123091] Updated weights for policy 0, policy_version 286962 (0.0010) [2023-12-26 01:52:29,472][123090] Updated weights for policy 1, policy_version 285590 (0.0008) [2023-12-26 01:52:29,516][123091] Updated weights for policy 0, policy_version 286972 (0.0011) [2023-12-26 01:52:29,531][123090] Updated weights for policy 1, policy_version 285600 (0.0006) [2023-12-26 01:52:29,583][123091] Updated weights for policy 0, policy_version 286982 (0.0011) [2023-12-26 01:52:29,647][123091] Updated weights for policy 0, policy_version 286992 (0.0011) [2023-12-26 01:52:30,348][123090] Updated weights for policy 1, policy_version 285610 (0.0010) [2023-12-26 01:52:30,398][123090] Updated weights for policy 1, policy_version 285620 (0.0010) [2023-12-26 01:52:30,453][123090] Updated weights for policy 1, policy_version 285630 (0.0010) [2023-12-26 01:52:30,460][123091] Updated weights for policy 0, policy_version 287002 (0.0010) [2023-12-26 01:52:30,522][123091] Updated weights for policy 0, policy_version 287012 (0.0010) [2023-12-26 01:52:30,586][123091] Updated weights for policy 0, policy_version 287022 (0.0010) [2023-12-26 01:52:31,214][123090] Updated weights for policy 1, policy_version 285640 (0.0010) [2023-12-26 01:52:31,278][123090] Updated weights for policy 1, policy_version 285650 (0.0010) [2023-12-26 01:52:31,344][123090] Updated weights for policy 1, policy_version 285660 (0.0006) [2023-12-26 01:52:31,409][123091] Updated weights for policy 0, policy_version 287032 (0.0007) [2023-12-26 01:52:31,474][123091] Updated weights for policy 0, policy_version 287042 (0.0008) [2023-12-26 01:52:31,537][123091] Updated weights for policy 0, policy_version 287052 (0.0011) [2023-12-26 01:52:32,153][123090] Updated weights for policy 1, policy_version 285670 (0.0010) [2023-12-26 01:52:32,215][123090] Updated weights for policy 1, policy_version 285680 (0.0010) [2023-12-26 01:52:32,273][123090] Updated weights for policy 1, policy_version 285690 (0.0009) [2023-12-26 01:52:32,276][123091] Updated weights for policy 0, policy_version 287062 (0.0010) [2023-12-26 01:52:32,333][123091] Updated weights for policy 0, policy_version 287072 (0.0010) [2023-12-26 01:52:32,401][123091] Updated weights for policy 0, policy_version 287082 (0.0010) [2023-12-26 01:52:33,084][123090] Updated weights for policy 1, policy_version 285700 (0.0008) [2023-12-26 01:52:33,146][123091] Updated weights for policy 0, policy_version 287092 (0.0009) [2023-12-26 01:52:33,162][123090] Updated weights for policy 1, policy_version 285710 (0.0010) [2023-12-26 01:52:33,215][123091] Updated weights for policy 0, policy_version 287102 (0.0005) [2023-12-26 01:52:33,228][123090] Updated weights for policy 1, policy_version 285720 (0.0010) [2023-12-26 01:52:33,283][123091] Updated weights for policy 0, policy_version 287112 (0.0007) [2023-12-26 01:52:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 146653184. Throughput: 0: 8825.2, 1: 9016.5. Samples: 146667108. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:33,785][121949] Avg episode reward: [(0, '6367.308'), (1, '5359.284')] [2023-12-26 01:52:33,842][123090] Updated weights for policy 1, policy_version 285730 (0.0008) [2023-12-26 01:52:33,917][123090] Updated weights for policy 1, policy_version 285740 (0.0005) [2023-12-26 01:52:33,973][123091] Updated weights for policy 0, policy_version 287122 (0.0007) [2023-12-26 01:52:33,985][123090] Updated weights for policy 1, policy_version 285750 (0.0008) [2023-12-26 01:52:34,024][123091] Updated weights for policy 0, policy_version 287132 (0.0005) [2023-12-26 01:52:34,040][123090] Updated weights for policy 1, policy_version 285760 (0.0009) [2023-12-26 01:52:34,079][123091] Updated weights for policy 0, policy_version 287142 (0.0005) [2023-12-26 01:52:34,127][123091] Updated weights for policy 0, policy_version 287152 (0.0006) [2023-12-26 01:52:34,832][123090] Updated weights for policy 1, policy_version 285770 (0.0005) [2023-12-26 01:52:34,885][123090] Updated weights for policy 1, policy_version 285781 (0.0006) [2023-12-26 01:52:34,934][123091] Updated weights for policy 0, policy_version 287162 (0.0008) [2023-12-26 01:52:34,936][123090] Updated weights for policy 1, policy_version 285791 (0.0009) [2023-12-26 01:52:35,000][123091] Updated weights for policy 0, policy_version 287172 (0.0010) [2023-12-26 01:52:35,074][123091] Updated weights for policy 0, policy_version 287182 (0.0010) [2023-12-26 01:52:35,680][123090] Updated weights for policy 1, policy_version 285801 (0.0009) [2023-12-26 01:52:35,740][123090] Updated weights for policy 1, policy_version 285811 (0.0009) [2023-12-26 01:52:35,801][123090] Updated weights for policy 1, policy_version 285821 (0.0009) [2023-12-26 01:52:35,903][123091] Updated weights for policy 0, policy_version 287192 (0.0010) [2023-12-26 01:52:35,964][123091] Updated weights for policy 0, policy_version 287202 (0.0010) [2023-12-26 01:52:36,028][123091] Updated weights for policy 0, policy_version 287212 (0.0010) [2023-12-26 01:52:36,644][123090] Updated weights for policy 1, policy_version 285831 (0.0010) [2023-12-26 01:52:36,702][123090] Updated weights for policy 1, policy_version 285841 (0.0010) [2023-12-26 01:52:36,758][123090] Updated weights for policy 1, policy_version 285851 (0.0009) [2023-12-26 01:52:36,846][123091] Updated weights for policy 0, policy_version 287222 (0.0007) [2023-12-26 01:52:36,897][123091] Updated weights for policy 0, policy_version 287232 (0.0005) [2023-12-26 01:52:36,952][123091] Updated weights for policy 0, policy_version 287242 (0.0005) [2023-12-26 01:52:37,641][123091] Updated weights for policy 0, policy_version 287252 (0.0006) [2023-12-26 01:52:37,654][123090] Updated weights for policy 1, policy_version 285861 (0.0010) [2023-12-26 01:52:37,699][123091] Updated weights for policy 0, policy_version 287262 (0.0008) [2023-12-26 01:52:37,715][123090] Updated weights for policy 1, policy_version 285871 (0.0009) [2023-12-26 01:52:37,753][123091] Updated weights for policy 0, policy_version 287272 (0.0009) [2023-12-26 01:52:37,773][123090] Updated weights for policy 1, policy_version 285881 (0.0006) [2023-12-26 01:52:38,462][123091] Updated weights for policy 0, policy_version 287282 (0.0009) [2023-12-26 01:52:38,527][123091] Updated weights for policy 0, policy_version 287292 (0.0009) [2023-12-26 01:52:38,579][123091] Updated weights for policy 0, policy_version 287302 (0.0009) [2023-12-26 01:52:38,585][123090] Updated weights for policy 1, policy_version 285891 (0.0010) [2023-12-26 01:52:38,626][123091] Updated weights for policy 0, policy_version 287312 (0.0009) [2023-12-26 01:52:38,648][123090] Updated weights for policy 1, policy_version 285901 (0.0009) [2023-12-26 01:52:38,706][123090] Updated weights for policy 1, policy_version 285911 (0.0010) [2023-12-26 01:52:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 146751488. Throughput: 0: 8848.7, 1: 9055.4. Samples: 146720644. Policy #0 lag: (min: 26.0, avg: 31.9, max: 32.0) [2023-12-26 01:52:38,785][121949] Avg episode reward: [(0, '6327.890'), (1, '5328.696')] [2023-12-26 01:52:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000287312_73555968.pth... [2023-12-26 01:52:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000285920_73195520.pth... [2023-12-26 01:52:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000286256_73285632.pth [2023-12-26 01:52:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000284864_72925184.pth [2023-12-26 01:52:39,460][123091] Updated weights for policy 0, policy_version 287322 (0.0009) [2023-12-26 01:52:39,516][123091] Updated weights for policy 0, policy_version 287332 (0.0009) [2023-12-26 01:52:39,554][123090] Updated weights for policy 1, policy_version 285921 (0.0009) [2023-12-26 01:52:39,587][123091] Updated weights for policy 0, policy_version 287342 (0.0010) [2023-12-26 01:52:39,614][123090] Updated weights for policy 1, policy_version 285931 (0.0009) [2023-12-26 01:52:39,684][123090] Updated weights for policy 1, policy_version 285941 (0.0010) [2023-12-26 01:52:39,751][123090] Updated weights for policy 1, policy_version 285951 (0.0010) [2023-12-26 01:52:40,418][123091] Updated weights for policy 0, policy_version 287352 (0.0006) [2023-12-26 01:52:40,488][123091] Updated weights for policy 0, policy_version 287362 (0.0006) [2023-12-26 01:52:40,558][123091] Updated weights for policy 0, policy_version 287372 (0.0006) [2023-12-26 01:52:40,606][123090] Updated weights for policy 1, policy_version 285961 (0.0009) [2023-12-26 01:52:40,657][123090] Updated weights for policy 1, policy_version 285971 (0.0009) [2023-12-26 01:52:40,716][123090] Updated weights for policy 1, policy_version 285981 (0.0010) [2023-12-26 01:52:41,164][123091] Updated weights for policy 0, policy_version 287382 (0.0007) [2023-12-26 01:52:41,238][123091] Updated weights for policy 0, policy_version 287392 (0.0010) [2023-12-26 01:52:41,303][123091] Updated weights for policy 0, policy_version 287402 (0.0009) [2023-12-26 01:52:41,608][123090] Updated weights for policy 1, policy_version 285991 (0.0009) [2023-12-26 01:52:41,683][123090] Updated weights for policy 1, policy_version 286001 (0.0010) [2023-12-26 01:52:41,770][123090] Updated weights for policy 1, policy_version 286011 (0.0010) [2023-12-26 01:52:42,102][123091] Updated weights for policy 0, policy_version 287412 (0.0009) [2023-12-26 01:52:42,164][123091] Updated weights for policy 0, policy_version 287422 (0.0009) [2023-12-26 01:52:42,217][123091] Updated weights for policy 0, policy_version 287432 (0.0009) [2023-12-26 01:52:42,594][123090] Updated weights for policy 1, policy_version 286021 (0.0009) [2023-12-26 01:52:42,651][123090] Updated weights for policy 1, policy_version 286031 (0.0010) [2023-12-26 01:52:42,714][123090] Updated weights for policy 1, policy_version 286041 (0.0009) [2023-12-26 01:52:43,080][123091] Updated weights for policy 0, policy_version 287442 (0.0009) [2023-12-26 01:52:43,147][123091] Updated weights for policy 0, policy_version 287452 (0.0010) [2023-12-26 01:52:43,215][123091] Updated weights for policy 0, policy_version 287462 (0.0009) [2023-12-26 01:52:43,278][123091] Updated weights for policy 0, policy_version 287472 (0.0010) [2023-12-26 01:52:43,583][123090] Updated weights for policy 1, policy_version 286051 (0.0010) [2023-12-26 01:52:43,642][123090] Updated weights for policy 1, policy_version 286061 (0.0009) [2023-12-26 01:52:43,703][123090] Updated weights for policy 1, policy_version 286071 (0.0007) [2023-12-26 01:52:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 146833408. Throughput: 0: 8906.4, 1: 8934.1. Samples: 146824052. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:52:43,784][121949] Avg episode reward: [(0, '6326.719'), (1, '5377.630')] [2023-12-26 01:52:44,074][123091] Updated weights for policy 0, policy_version 287482 (0.0009) [2023-12-26 01:52:44,134][123091] Updated weights for policy 0, policy_version 287492 (0.0009) [2023-12-26 01:52:44,192][123091] Updated weights for policy 0, policy_version 287502 (0.0010) [2023-12-26 01:52:44,455][123090] Updated weights for policy 1, policy_version 286081 (0.0005) [2023-12-26 01:52:44,524][123090] Updated weights for policy 1, policy_version 286091 (0.0005) [2023-12-26 01:52:44,596][123090] Updated weights for policy 1, policy_version 286101 (0.0005) [2023-12-26 01:52:44,651][123090] Updated weights for policy 1, policy_version 286111 (0.0005) [2023-12-26 01:52:45,089][123091] Updated weights for policy 0, policy_version 287512 (0.0010) [2023-12-26 01:52:45,150][123091] Updated weights for policy 0, policy_version 287522 (0.0009) [2023-12-26 01:52:45,207][123091] Updated weights for policy 0, policy_version 287532 (0.0009) [2023-12-26 01:52:45,387][123090] Updated weights for policy 1, policy_version 286121 (0.0010) [2023-12-26 01:52:45,447][123090] Updated weights for policy 1, policy_version 286131 (0.0010) [2023-12-26 01:52:45,503][123090] Updated weights for policy 1, policy_version 286141 (0.0010) [2023-12-26 01:52:46,063][123091] Updated weights for policy 0, policy_version 287542 (0.0009) [2023-12-26 01:52:46,123][123091] Updated weights for policy 0, policy_version 287552 (0.0009) [2023-12-26 01:52:46,176][123091] Updated weights for policy 0, policy_version 287562 (0.0009) [2023-12-26 01:52:46,350][123090] Updated weights for policy 1, policy_version 286151 (0.0010) [2023-12-26 01:52:46,404][123090] Updated weights for policy 1, policy_version 286161 (0.0008) [2023-12-26 01:52:46,461][123090] Updated weights for policy 1, policy_version 286171 (0.0007) [2023-12-26 01:52:46,977][123091] Updated weights for policy 0, policy_version 287572 (0.0009) [2023-12-26 01:52:47,035][123091] Updated weights for policy 0, policy_version 287583 (0.0011) [2023-12-26 01:52:47,089][123091] Updated weights for policy 0, policy_version 287593 (0.0010) [2023-12-26 01:52:47,167][123090] Updated weights for policy 1, policy_version 286181 (0.0008) [2023-12-26 01:52:47,227][123090] Updated weights for policy 1, policy_version 286191 (0.0005) [2023-12-26 01:52:47,287][123090] Updated weights for policy 1, policy_version 286201 (0.0006) [2023-12-26 01:52:47,995][123090] Updated weights for policy 1, policy_version 286211 (0.0009) [2023-12-26 01:52:48,007][123091] Updated weights for policy 0, policy_version 287604 (0.0010) [2023-12-26 01:52:48,055][123090] Updated weights for policy 1, policy_version 286221 (0.0005) [2023-12-26 01:52:48,061][123091] Updated weights for policy 0, policy_version 287614 (0.0010) [2023-12-26 01:52:48,110][123091] Updated weights for policy 0, policy_version 287624 (0.0009) [2023-12-26 01:52:48,118][123090] Updated weights for policy 1, policy_version 286231 (0.0005) [2023-12-26 01:52:48,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 146915328. Throughput: 0: 8849.2, 1: 8964.5. Samples: 146929092. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:52:48,784][121949] Avg episode reward: [(0, '6266.066'), (1, '5247.106')] [2023-12-26 01:52:48,788][123090] Updated weights for policy 1, policy_version 286241 (0.0006) [2023-12-26 01:52:48,857][123090] Updated weights for policy 1, policy_version 286251 (0.0006) [2023-12-26 01:52:48,907][123090] Updated weights for policy 1, policy_version 286261 (0.0006) [2023-12-26 01:52:48,960][123090] Updated weights for policy 1, policy_version 286271 (0.0005) [2023-12-26 01:52:49,049][123091] Updated weights for policy 0, policy_version 287634 (0.0009) [2023-12-26 01:52:49,112][123091] Updated weights for policy 0, policy_version 287644 (0.0010) [2023-12-26 01:52:49,176][123091] Updated weights for policy 0, policy_version 287654 (0.0009) [2023-12-26 01:52:49,235][123091] Updated weights for policy 0, policy_version 287664 (0.0009) [2023-12-26 01:52:49,737][123090] Updated weights for policy 1, policy_version 286281 (0.0009) [2023-12-26 01:52:49,806][123090] Updated weights for policy 1, policy_version 286291 (0.0009) [2023-12-26 01:52:49,878][123090] Updated weights for policy 1, policy_version 286301 (0.0009) [2023-12-26 01:52:50,071][123091] Updated weights for policy 0, policy_version 287674 (0.0008) [2023-12-26 01:52:50,123][123091] Updated weights for policy 0, policy_version 287684 (0.0008) [2023-12-26 01:52:50,182][123091] Updated weights for policy 0, policy_version 287694 (0.0008) [2023-12-26 01:52:50,714][123090] Updated weights for policy 1, policy_version 286311 (0.0010) [2023-12-26 01:52:50,778][123090] Updated weights for policy 1, policy_version 286321 (0.0009) [2023-12-26 01:52:50,845][123090] Updated weights for policy 1, policy_version 286331 (0.0009) [2023-12-26 01:52:51,014][123091] Updated weights for policy 0, policy_version 287704 (0.0009) [2023-12-26 01:52:51,078][123091] Updated weights for policy 0, policy_version 287714 (0.0009) [2023-12-26 01:52:51,139][123091] Updated weights for policy 0, policy_version 287724 (0.0009) [2023-12-26 01:52:51,686][123090] Updated weights for policy 1, policy_version 286341 (0.0010) [2023-12-26 01:52:51,759][123090] Updated weights for policy 1, policy_version 286351 (0.0010) [2023-12-26 01:52:51,828][123090] Updated weights for policy 1, policy_version 286361 (0.0008) [2023-12-26 01:52:52,036][123091] Updated weights for policy 0, policy_version 287734 (0.0008) [2023-12-26 01:52:52,101][123091] Updated weights for policy 0, policy_version 287744 (0.0009) [2023-12-26 01:52:52,163][123091] Updated weights for policy 0, policy_version 287754 (0.0009) [2023-12-26 01:52:52,680][123090] Updated weights for policy 1, policy_version 286371 (0.0009) [2023-12-26 01:52:52,745][123090] Updated weights for policy 1, policy_version 286381 (0.0009) [2023-12-26 01:52:52,810][123090] Updated weights for policy 1, policy_version 286391 (0.0009) [2023-12-26 01:52:53,021][123091] Updated weights for policy 0, policy_version 287764 (0.0010) [2023-12-26 01:52:53,072][123091] Updated weights for policy 0, policy_version 287774 (0.0010) [2023-12-26 01:52:53,123][123091] Updated weights for policy 0, policy_version 287785 (0.0010) [2023-12-26 01:52:53,617][123090] Updated weights for policy 1, policy_version 286401 (0.0009) [2023-12-26 01:52:53,672][123090] Updated weights for policy 1, policy_version 286411 (0.0009) [2023-12-26 01:52:53,729][123090] Updated weights for policy 1, policy_version 286421 (0.0009) [2023-12-26 01:52:53,781][123090] Updated weights for policy 1, policy_version 286431 (0.0009) [2023-12-26 01:52:53,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 147005440. Throughput: 0: 8806.8, 1: 8955.2. Samples: 146979856. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:52:53,785][121949] Avg episode reward: [(0, '6238.493'), (1, '5249.301')] [2023-12-26 01:52:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000287792_73678848.pth... [2023-12-26 01:52:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000286432_73326592.pth... [2023-12-26 01:52:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000286768_73416704.pth [2023-12-26 01:52:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000285376_73056256.pth [2023-12-26 01:52:54,023][123091] Updated weights for policy 0, policy_version 287795 (0.0010) [2023-12-26 01:52:54,090][123091] Updated weights for policy 0, policy_version 287805 (0.0009) [2023-12-26 01:52:54,156][123091] Updated weights for policy 0, policy_version 287815 (0.0009) [2023-12-26 01:52:54,542][123090] Updated weights for policy 1, policy_version 286441 (0.0006) [2023-12-26 01:52:54,603][123090] Updated weights for policy 1, policy_version 286451 (0.0005) [2023-12-26 01:52:54,669][123090] Updated weights for policy 1, policy_version 286461 (0.0009) [2023-12-26 01:52:55,031][123091] Updated weights for policy 0, policy_version 287825 (0.0009) [2023-12-26 01:52:55,087][123091] Updated weights for policy 0, policy_version 287835 (0.0009) [2023-12-26 01:52:55,145][123091] Updated weights for policy 0, policy_version 287845 (0.0008) [2023-12-26 01:52:55,195][123091] Updated weights for policy 0, policy_version 287855 (0.0009) [2023-12-26 01:52:55,383][123090] Updated weights for policy 1, policy_version 286471 (0.0008) [2023-12-26 01:52:55,441][123090] Updated weights for policy 1, policy_version 286481 (0.0005) [2023-12-26 01:52:55,492][123090] Updated weights for policy 1, policy_version 286491 (0.0005) [2023-12-26 01:52:55,983][123091] Updated weights for policy 0, policy_version 287865 (0.0006) [2023-12-26 01:52:56,032][123091] Updated weights for policy 0, policy_version 287875 (0.0005) [2023-12-26 01:52:56,079][123091] Updated weights for policy 0, policy_version 287885 (0.0005) [2023-12-26 01:52:56,213][123090] Updated weights for policy 1, policy_version 286501 (0.0008) [2023-12-26 01:52:56,271][123090] Updated weights for policy 1, policy_version 286511 (0.0010) [2023-12-26 01:52:56,322][123090] Updated weights for policy 1, policy_version 286521 (0.0009) [2023-12-26 01:52:56,827][123091] Updated weights for policy 0, policy_version 287895 (0.0008) [2023-12-26 01:52:56,879][123091] Updated weights for policy 0, policy_version 287905 (0.0009) [2023-12-26 01:52:56,926][123091] Updated weights for policy 0, policy_version 287915 (0.0009) [2023-12-26 01:52:57,161][123090] Updated weights for policy 1, policy_version 286531 (0.0007) [2023-12-26 01:52:57,218][123090] Updated weights for policy 1, policy_version 286541 (0.0009) [2023-12-26 01:52:57,273][123090] Updated weights for policy 1, policy_version 286551 (0.0009) [2023-12-26 01:52:57,786][123091] Updated weights for policy 0, policy_version 287925 (0.0009) [2023-12-26 01:52:57,838][123091] Updated weights for policy 0, policy_version 287935 (0.0009) [2023-12-26 01:52:57,887][123091] Updated weights for policy 0, policy_version 287945 (0.0008) [2023-12-26 01:52:58,108][123090] Updated weights for policy 1, policy_version 286561 (0.0010) [2023-12-26 01:52:58,179][123090] Updated weights for policy 1, policy_version 286571 (0.0009) [2023-12-26 01:52:58,246][123090] Updated weights for policy 1, policy_version 286581 (0.0008) [2023-12-26 01:52:58,318][123090] Updated weights for policy 1, policy_version 286591 (0.0008) [2023-12-26 01:52:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 147087360. Throughput: 0: 8739.3, 1: 8971.2. Samples: 147085676. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:52:58,785][121949] Avg episode reward: [(0, '6230.354'), (1, '5551.700')] [2023-12-26 01:52:58,815][123091] Updated weights for policy 0, policy_version 287955 (0.0009) [2023-12-26 01:52:58,869][123091] Updated weights for policy 0, policy_version 287965 (0.0009) [2023-12-26 01:52:58,931][123091] Updated weights for policy 0, policy_version 287975 (0.0009) [2023-12-26 01:52:59,195][123090] Updated weights for policy 1, policy_version 286601 (0.0010) [2023-12-26 01:52:59,261][123090] Updated weights for policy 1, policy_version 286611 (0.0009) [2023-12-26 01:52:59,326][123090] Updated weights for policy 1, policy_version 286621 (0.0009) [2023-12-26 01:52:59,726][123091] Updated weights for policy 0, policy_version 287985 (0.0009) [2023-12-26 01:52:59,787][123091] Updated weights for policy 0, policy_version 287995 (0.0006) [2023-12-26 01:52:59,852][123091] Updated weights for policy 0, policy_version 288005 (0.0010) [2023-12-26 01:52:59,911][123091] Updated weights for policy 0, policy_version 288015 (0.0011) [2023-12-26 01:53:00,201][123090] Updated weights for policy 1, policy_version 286631 (0.0010) [2023-12-26 01:53:00,261][123090] Updated weights for policy 1, policy_version 286641 (0.0011) [2023-12-26 01:53:00,317][123090] Updated weights for policy 1, policy_version 286651 (0.0010) [2023-12-26 01:53:00,617][123091] Updated weights for policy 0, policy_version 288025 (0.0009) [2023-12-26 01:53:00,672][123091] Updated weights for policy 0, policy_version 288035 (0.0010) [2023-12-26 01:53:00,719][123091] Updated weights for policy 0, policy_version 288045 (0.0010) [2023-12-26 01:53:00,964][123090] Updated weights for policy 1, policy_version 286661 (0.0008) [2023-12-26 01:53:01,032][123090] Updated weights for policy 1, policy_version 286671 (0.0006) [2023-12-26 01:53:01,088][123090] Updated weights for policy 1, policy_version 286681 (0.0007) [2023-12-26 01:53:01,558][123091] Updated weights for policy 0, policy_version 288055 (0.0010) [2023-12-26 01:53:01,625][123091] Updated weights for policy 0, policy_version 288065 (0.0008) [2023-12-26 01:53:01,701][123091] Updated weights for policy 0, policy_version 288075 (0.0009) [2023-12-26 01:53:01,834][123090] Updated weights for policy 1, policy_version 286691 (0.0008) [2023-12-26 01:53:01,896][123090] Updated weights for policy 1, policy_version 286701 (0.0010) [2023-12-26 01:53:01,955][123090] Updated weights for policy 1, policy_version 286711 (0.0010) [2023-12-26 01:53:02,525][123091] Updated weights for policy 0, policy_version 288085 (0.0009) [2023-12-26 01:53:02,606][123091] Updated weights for policy 0, policy_version 288095 (0.0009) [2023-12-26 01:53:02,662][123091] Updated weights for policy 0, policy_version 288105 (0.0008) [2023-12-26 01:53:02,782][123090] Updated weights for policy 1, policy_version 286721 (0.0010) [2023-12-26 01:53:02,844][123090] Updated weights for policy 1, policy_version 286731 (0.0010) [2023-12-26 01:53:02,888][123090] Updated weights for policy 1, policy_version 286741 (0.0010) [2023-12-26 01:53:02,936][123090] Updated weights for policy 1, policy_version 286751 (0.0009) [2023-12-26 01:53:03,409][123091] Updated weights for policy 0, policy_version 288115 (0.0008) [2023-12-26 01:53:03,477][123091] Updated weights for policy 0, policy_version 288125 (0.0006) [2023-12-26 01:53:03,548][123091] Updated weights for policy 0, policy_version 288135 (0.0006) [2023-12-26 01:53:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 147177472. Throughput: 0: 8772.7, 1: 8846.8. Samples: 147190412. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:03,785][121949] Avg episode reward: [(0, '6305.292'), (1, '5403.538')] [2023-12-26 01:53:03,797][123090] Updated weights for policy 1, policy_version 286761 (0.0005) [2023-12-26 01:53:03,873][123090] Updated weights for policy 1, policy_version 286771 (0.0007) [2023-12-26 01:53:03,935][123090] Updated weights for policy 1, policy_version 286781 (0.0009) [2023-12-26 01:53:04,313][123091] Updated weights for policy 0, policy_version 288145 (0.0010) [2023-12-26 01:53:04,370][123091] Updated weights for policy 0, policy_version 288155 (0.0010) [2023-12-26 01:53:04,443][123091] Updated weights for policy 0, policy_version 288165 (0.0011) [2023-12-26 01:53:04,506][123091] Updated weights for policy 0, policy_version 288175 (0.0011) [2023-12-26 01:53:04,736][123090] Updated weights for policy 1, policy_version 286791 (0.0010) [2023-12-26 01:53:04,812][123090] Updated weights for policy 1, policy_version 286801 (0.0010) [2023-12-26 01:53:04,884][123090] Updated weights for policy 1, policy_version 286811 (0.0009) [2023-12-26 01:53:05,164][123091] Updated weights for policy 0, policy_version 288185 (0.0006) [2023-12-26 01:53:05,208][123091] Updated weights for policy 0, policy_version 288195 (0.0005) [2023-12-26 01:53:05,253][123091] Updated weights for policy 0, policy_version 288205 (0.0005) [2023-12-26 01:53:05,744][123090] Updated weights for policy 1, policy_version 286821 (0.0009) [2023-12-26 01:53:05,794][123090] Updated weights for policy 1, policy_version 286831 (0.0009) [2023-12-26 01:53:05,843][123090] Updated weights for policy 1, policy_version 286841 (0.0009) [2023-12-26 01:53:05,901][123091] Updated weights for policy 0, policy_version 288215 (0.0008) [2023-12-26 01:53:05,956][123091] Updated weights for policy 0, policy_version 288225 (0.0008) [2023-12-26 01:53:06,009][123091] Updated weights for policy 0, policy_version 288235 (0.0009) [2023-12-26 01:53:06,659][123090] Updated weights for policy 1, policy_version 286851 (0.0008) [2023-12-26 01:53:06,721][123090] Updated weights for policy 1, policy_version 286861 (0.0010) [2023-12-26 01:53:06,778][123090] Updated weights for policy 1, policy_version 286871 (0.0009) [2023-12-26 01:53:06,884][123091] Updated weights for policy 0, policy_version 288245 (0.0010) [2023-12-26 01:53:06,953][123091] Updated weights for policy 0, policy_version 288255 (0.0010) [2023-12-26 01:53:07,018][123091] Updated weights for policy 0, policy_version 288265 (0.0010) [2023-12-26 01:53:07,604][123090] Updated weights for policy 1, policy_version 286881 (0.0009) [2023-12-26 01:53:07,665][123090] Updated weights for policy 1, policy_version 286891 (0.0005) [2023-12-26 01:53:07,715][123090] Updated weights for policy 1, policy_version 286901 (0.0005) [2023-12-26 01:53:07,726][123091] Updated weights for policy 0, policy_version 288275 (0.0008) [2023-12-26 01:53:07,772][123090] Updated weights for policy 1, policy_version 286911 (0.0005) [2023-12-26 01:53:07,775][123091] Updated weights for policy 0, policy_version 288285 (0.0006) [2023-12-26 01:53:07,832][123091] Updated weights for policy 0, policy_version 288295 (0.0010) [2023-12-26 01:53:08,431][123090] Updated weights for policy 1, policy_version 286921 (0.0009) [2023-12-26 01:53:08,495][123090] Updated weights for policy 1, policy_version 286931 (0.0009) [2023-12-26 01:53:08,564][123090] Updated weights for policy 1, policy_version 286941 (0.0009) [2023-12-26 01:53:08,612][123091] Updated weights for policy 0, policy_version 288305 (0.0010) [2023-12-26 01:53:08,671][123091] Updated weights for policy 0, policy_version 288315 (0.0008) [2023-12-26 01:53:08,731][123091] Updated weights for policy 0, policy_version 288325 (0.0008) [2023-12-26 01:53:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 147267584. Throughput: 0: 8860.2, 1: 8843.7. Samples: 147243944. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:08,784][121949] Avg episode reward: [(0, '6401.957'), (1, '5289.667')] [2023-12-26 01:53:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000286944_73457664.pth... [2023-12-26 01:53:08,792][123091] Updated weights for policy 0, policy_version 288335 (0.0009) [2023-12-26 01:53:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000285920_73195520.pth [2023-12-26 01:53:08,797][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000288336_73818112.pth... [2023-12-26 01:53:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000287312_73555968.pth [2023-12-26 01:53:09,348][123090] Updated weights for policy 1, policy_version 286951 (0.0007) [2023-12-26 01:53:09,431][123090] Updated weights for policy 1, policy_version 286961 (0.0010) [2023-12-26 01:53:09,492][123090] Updated weights for policy 1, policy_version 286971 (0.0011) [2023-12-26 01:53:09,672][123091] Updated weights for policy 0, policy_version 288345 (0.0007) [2023-12-26 01:53:09,734][123091] Updated weights for policy 0, policy_version 288355 (0.0006) [2023-12-26 01:53:09,795][123091] Updated weights for policy 0, policy_version 288365 (0.0006) [2023-12-26 01:53:10,214][123090] Updated weights for policy 1, policy_version 286981 (0.0008) [2023-12-26 01:53:10,292][123090] Updated weights for policy 1, policy_version 286991 (0.0006) [2023-12-26 01:53:10,383][123090] Updated weights for policy 1, policy_version 287001 (0.0006) [2023-12-26 01:53:10,497][123091] Updated weights for policy 0, policy_version 288375 (0.0006) [2023-12-26 01:53:10,554][123091] Updated weights for policy 0, policy_version 288385 (0.0006) [2023-12-26 01:53:10,617][123091] Updated weights for policy 0, policy_version 288395 (0.0006) [2023-12-26 01:53:10,995][123090] Updated weights for policy 1, policy_version 287011 (0.0006) [2023-12-26 01:53:11,070][123090] Updated weights for policy 1, policy_version 287021 (0.0007) [2023-12-26 01:53:11,130][123090] Updated weights for policy 1, policy_version 287031 (0.0009) [2023-12-26 01:53:11,410][123091] Updated weights for policy 0, policy_version 288405 (0.0008) [2023-12-26 01:53:11,475][123091] Updated weights for policy 0, policy_version 288415 (0.0009) [2023-12-26 01:53:11,545][123091] Updated weights for policy 0, policy_version 288425 (0.0009) [2023-12-26 01:53:11,918][123090] Updated weights for policy 1, policy_version 287041 (0.0009) [2023-12-26 01:53:11,982][123090] Updated weights for policy 1, policy_version 287051 (0.0006) [2023-12-26 01:53:12,050][123090] Updated weights for policy 1, policy_version 287061 (0.0006) [2023-12-26 01:53:12,105][123090] Updated weights for policy 1, policy_version 287071 (0.0009) [2023-12-26 01:53:12,415][123091] Updated weights for policy 0, policy_version 288435 (0.0010) [2023-12-26 01:53:12,463][123091] Updated weights for policy 0, policy_version 288445 (0.0009) [2023-12-26 01:53:12,514][123091] Updated weights for policy 0, policy_version 288455 (0.0009) [2023-12-26 01:53:12,895][123090] Updated weights for policy 1, policy_version 287081 (0.0009) [2023-12-26 01:53:12,971][123090] Updated weights for policy 1, policy_version 287091 (0.0010) [2023-12-26 01:53:13,036][123090] Updated weights for policy 1, policy_version 287101 (0.0008) [2023-12-26 01:53:13,378][123091] Updated weights for policy 0, policy_version 288465 (0.0009) [2023-12-26 01:53:13,437][123091] Updated weights for policy 0, policy_version 288475 (0.0008) [2023-12-26 01:53:13,504][123091] Updated weights for policy 0, policy_version 288485 (0.0005) [2023-12-26 01:53:13,560][123091] Updated weights for policy 0, policy_version 288495 (0.0005) [2023-12-26 01:53:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 147357696. Throughput: 0: 8811.6, 1: 8843.3. Samples: 147352712. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:13,785][121949] Avg episode reward: [(0, '6386.084'), (1, '5289.970')] [2023-12-26 01:53:13,835][123090] Updated weights for policy 1, policy_version 287111 (0.0010) [2023-12-26 01:53:13,888][123090] Updated weights for policy 1, policy_version 287121 (0.0009) [2023-12-26 01:53:13,936][123090] Updated weights for policy 1, policy_version 287131 (0.0010) [2023-12-26 01:53:14,230][123091] Updated weights for policy 0, policy_version 288505 (0.0005) [2023-12-26 01:53:14,288][123091] Updated weights for policy 0, policy_version 288515 (0.0008) [2023-12-26 01:53:14,343][123091] Updated weights for policy 0, policy_version 288525 (0.0011) [2023-12-26 01:53:14,723][123090] Updated weights for policy 1, policy_version 287141 (0.0011) [2023-12-26 01:53:14,813][123090] Updated weights for policy 1, policy_version 287151 (0.0010) [2023-12-26 01:53:14,872][123090] Updated weights for policy 1, policy_version 287161 (0.0009) [2023-12-26 01:53:15,084][123091] Updated weights for policy 0, policy_version 288535 (0.0008) [2023-12-26 01:53:15,143][123091] Updated weights for policy 0, policy_version 288545 (0.0010) [2023-12-26 01:53:15,206][123091] Updated weights for policy 0, policy_version 288555 (0.0011) [2023-12-26 01:53:15,668][123090] Updated weights for policy 1, policy_version 287171 (0.0007) [2023-12-26 01:53:15,728][123090] Updated weights for policy 1, policy_version 287181 (0.0010) [2023-12-26 01:53:15,783][123090] Updated weights for policy 1, policy_version 287191 (0.0009) [2023-12-26 01:53:16,018][123091] Updated weights for policy 0, policy_version 288565 (0.0008) [2023-12-26 01:53:16,066][123091] Updated weights for policy 0, policy_version 288575 (0.0005) [2023-12-26 01:53:16,123][123091] Updated weights for policy 0, policy_version 288585 (0.0005) [2023-12-26 01:53:16,489][123090] Updated weights for policy 1, policy_version 287201 (0.0006) [2023-12-26 01:53:16,552][123090] Updated weights for policy 1, policy_version 287211 (0.0009) [2023-12-26 01:53:16,620][123090] Updated weights for policy 1, policy_version 287221 (0.0009) [2023-12-26 01:53:16,678][123090] Updated weights for policy 1, policy_version 287231 (0.0009) [2023-12-26 01:53:16,768][123091] Updated weights for policy 0, policy_version 288595 (0.0005) [2023-12-26 01:53:16,816][123091] Updated weights for policy 0, policy_version 288605 (0.0005) [2023-12-26 01:53:16,883][123091] Updated weights for policy 0, policy_version 288615 (0.0009) [2023-12-26 01:53:17,519][123090] Updated weights for policy 1, policy_version 287241 (0.0010) [2023-12-26 01:53:17,569][123090] Updated weights for policy 1, policy_version 287251 (0.0010) [2023-12-26 01:53:17,590][123091] Updated weights for policy 0, policy_version 288625 (0.0009) [2023-12-26 01:53:17,627][123090] Updated weights for policy 1, policy_version 287261 (0.0007) [2023-12-26 01:53:17,640][123091] Updated weights for policy 0, policy_version 288635 (0.0006) [2023-12-26 01:53:17,700][123091] Updated weights for policy 0, policy_version 288645 (0.0005) [2023-12-26 01:53:17,761][123091] Updated weights for policy 0, policy_version 288655 (0.0005) [2023-12-26 01:53:18,361][123090] Updated weights for policy 1, policy_version 287271 (0.0008) [2023-12-26 01:53:18,426][123090] Updated weights for policy 1, policy_version 287281 (0.0010) [2023-12-26 01:53:18,464][123091] Updated weights for policy 0, policy_version 288665 (0.0006) [2023-12-26 01:53:18,490][123090] Updated weights for policy 1, policy_version 287291 (0.0008) [2023-12-26 01:53:18,517][123091] Updated weights for policy 0, policy_version 288675 (0.0006) [2023-12-26 01:53:18,576][123091] Updated weights for policy 0, policy_version 288685 (0.0007) [2023-12-26 01:53:18,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 147456000. Throughput: 0: 8854.2, 1: 8857.1. Samples: 147464116. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:18,785][121949] Avg episode reward: [(0, '6347.814'), (1, '5419.046')] [2023-12-26 01:53:19,165][123091] Updated weights for policy 0, policy_version 288695 (0.0006) [2023-12-26 01:53:19,219][123091] Updated weights for policy 0, policy_version 288705 (0.0006) [2023-12-26 01:53:19,286][123091] Updated weights for policy 0, policy_version 288715 (0.0007) [2023-12-26 01:53:19,316][123090] Updated weights for policy 1, policy_version 287301 (0.0009) [2023-12-26 01:53:19,390][123090] Updated weights for policy 1, policy_version 287311 (0.0010) [2023-12-26 01:53:19,459][123090] Updated weights for policy 1, policy_version 287321 (0.0010) [2023-12-26 01:53:20,051][123091] Updated weights for policy 0, policy_version 288725 (0.0009) [2023-12-26 01:53:20,115][123091] Updated weights for policy 0, policy_version 288735 (0.0009) [2023-12-26 01:53:20,183][123091] Updated weights for policy 0, policy_version 288745 (0.0010) [2023-12-26 01:53:20,308][123090] Updated weights for policy 1, policy_version 287331 (0.0010) [2023-12-26 01:53:20,363][123090] Updated weights for policy 1, policy_version 287341 (0.0009) [2023-12-26 01:53:20,432][123090] Updated weights for policy 1, policy_version 287351 (0.0009) [2023-12-26 01:53:20,957][123091] Updated weights for policy 0, policy_version 288755 (0.0010) [2023-12-26 01:53:21,023][123091] Updated weights for policy 0, policy_version 288765 (0.0010) [2023-12-26 01:53:21,086][123091] Updated weights for policy 0, policy_version 288775 (0.0009) [2023-12-26 01:53:21,322][123090] Updated weights for policy 1, policy_version 287361 (0.0009) [2023-12-26 01:53:21,400][123090] Updated weights for policy 1, policy_version 287371 (0.0009) [2023-12-26 01:53:21,475][123090] Updated weights for policy 1, policy_version 287381 (0.0006) [2023-12-26 01:53:21,546][123090] Updated weights for policy 1, policy_version 287391 (0.0008) [2023-12-26 01:53:21,930][123091] Updated weights for policy 0, policy_version 288785 (0.0008) [2023-12-26 01:53:21,980][123091] Updated weights for policy 0, policy_version 288795 (0.0009) [2023-12-26 01:53:22,031][123091] Updated weights for policy 0, policy_version 288805 (0.0010) [2023-12-26 01:53:22,091][123091] Updated weights for policy 0, policy_version 288815 (0.0009) [2023-12-26 01:53:22,347][123090] Updated weights for policy 1, policy_version 287401 (0.0010) [2023-12-26 01:53:22,414][123090] Updated weights for policy 1, policy_version 287411 (0.0010) [2023-12-26 01:53:22,477][123090] Updated weights for policy 1, policy_version 287421 (0.0009) [2023-12-26 01:53:22,952][123091] Updated weights for policy 0, policy_version 288825 (0.0009) [2023-12-26 01:53:23,018][123091] Updated weights for policy 0, policy_version 288835 (0.0011) [2023-12-26 01:53:23,082][123091] Updated weights for policy 0, policy_version 288845 (0.0011) [2023-12-26 01:53:23,303][123090] Updated weights for policy 1, policy_version 287431 (0.0010) [2023-12-26 01:53:23,370][123090] Updated weights for policy 1, policy_version 287441 (0.0009) [2023-12-26 01:53:23,440][123090] Updated weights for policy 1, policy_version 287451 (0.0009) [2023-12-26 01:53:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 147537920. Throughput: 0: 8891.3, 1: 8802.1. Samples: 147516848. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:23,785][121949] Avg episode reward: [(0, '6269.816'), (1, '5401.590')] [2023-12-26 01:53:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000287456_73588736.pth... [2023-12-26 01:53:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000288848_73949184.pth... [2023-12-26 01:53:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000286432_73326592.pth [2023-12-26 01:53:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000287792_73678848.pth [2023-12-26 01:53:23,860][123091] Updated weights for policy 0, policy_version 288855 (0.0007) [2023-12-26 01:53:23,921][123091] Updated weights for policy 0, policy_version 288865 (0.0005) [2023-12-26 01:53:23,982][123091] Updated weights for policy 0, policy_version 288875 (0.0006) [2023-12-26 01:53:24,244][123090] Updated weights for policy 1, policy_version 287461 (0.0010) [2023-12-26 01:53:24,309][123090] Updated weights for policy 1, policy_version 287471 (0.0010) [2023-12-26 01:53:24,371][123090] Updated weights for policy 1, policy_version 287481 (0.0010) [2023-12-26 01:53:24,668][123091] Updated weights for policy 0, policy_version 288885 (0.0006) [2023-12-26 01:53:24,723][123091] Updated weights for policy 0, policy_version 288895 (0.0009) [2023-12-26 01:53:24,784][123091] Updated weights for policy 0, policy_version 288905 (0.0010) [2023-12-26 01:53:25,270][123090] Updated weights for policy 1, policy_version 287491 (0.0010) [2023-12-26 01:53:25,327][123090] Updated weights for policy 1, policy_version 287501 (0.0009) [2023-12-26 01:53:25,391][123090] Updated weights for policy 1, policy_version 287511 (0.0010) [2023-12-26 01:53:25,558][123091] Updated weights for policy 0, policy_version 288915 (0.0008) [2023-12-26 01:53:25,621][123091] Updated weights for policy 0, policy_version 288925 (0.0006) [2023-12-26 01:53:25,672][123091] Updated weights for policy 0, policy_version 288935 (0.0009) [2023-12-26 01:53:26,251][123090] Updated weights for policy 1, policy_version 287521 (0.0010) [2023-12-26 01:53:26,319][123090] Updated weights for policy 1, policy_version 287531 (0.0009) [2023-12-26 01:53:26,382][123090] Updated weights for policy 1, policy_version 287541 (0.0009) [2023-12-26 01:53:26,445][123090] Updated weights for policy 1, policy_version 287551 (0.0010) [2023-12-26 01:53:26,482][123091] Updated weights for policy 0, policy_version 288945 (0.0009) [2023-12-26 01:53:26,535][123091] Updated weights for policy 0, policy_version 288955 (0.0009) [2023-12-26 01:53:26,590][123091] Updated weights for policy 0, policy_version 288965 (0.0010) [2023-12-26 01:53:26,638][123091] Updated weights for policy 0, policy_version 288975 (0.0009) [2023-12-26 01:53:27,306][123090] Updated weights for policy 1, policy_version 287561 (0.0008) [2023-12-26 01:53:27,348][123091] Updated weights for policy 0, policy_version 288985 (0.0009) [2023-12-26 01:53:27,364][123090] Updated weights for policy 1, policy_version 287571 (0.0008) [2023-12-26 01:53:27,404][123091] Updated weights for policy 0, policy_version 288995 (0.0009) [2023-12-26 01:53:27,419][123090] Updated weights for policy 1, policy_version 287581 (0.0008) [2023-12-26 01:53:27,450][123091] Updated weights for policy 0, policy_version 289005 (0.0006) [2023-12-26 01:53:28,180][123090] Updated weights for policy 1, policy_version 287591 (0.0009) [2023-12-26 01:53:28,184][123091] Updated weights for policy 0, policy_version 289015 (0.0006) [2023-12-26 01:53:28,229][123090] Updated weights for policy 1, policy_version 287602 (0.0009) [2023-12-26 01:53:28,241][123091] Updated weights for policy 0, policy_version 289025 (0.0005) [2023-12-26 01:53:28,294][123090] Updated weights for policy 1, policy_version 287612 (0.0009) [2023-12-26 01:53:28,301][123091] Updated weights for policy 0, policy_version 289035 (0.0005) [2023-12-26 01:53:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 147628032. Throughput: 0: 8908.4, 1: 8810.4. Samples: 147621404. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:28,785][121949] Avg episode reward: [(0, '6311.727'), (1, '5500.344')] [2023-12-26 01:53:28,971][123091] Updated weights for policy 0, policy_version 289045 (0.0007) [2023-12-26 01:53:28,980][123090] Updated weights for policy 1, policy_version 287622 (0.0007) [2023-12-26 01:53:29,034][123091] Updated weights for policy 0, policy_version 289055 (0.0005) [2023-12-26 01:53:29,035][123090] Updated weights for policy 1, policy_version 287632 (0.0006) [2023-12-26 01:53:29,089][123090] Updated weights for policy 1, policy_version 287642 (0.0007) [2023-12-26 01:53:29,101][123091] Updated weights for policy 0, policy_version 289065 (0.0005) [2023-12-26 01:53:29,804][123090] Updated weights for policy 1, policy_version 287652 (0.0006) [2023-12-26 01:53:29,874][123090] Updated weights for policy 1, policy_version 287662 (0.0008) [2023-12-26 01:53:29,885][123091] Updated weights for policy 0, policy_version 289075 (0.0007) [2023-12-26 01:53:29,940][123090] Updated weights for policy 1, policy_version 287672 (0.0007) [2023-12-26 01:53:29,951][123091] Updated weights for policy 0, policy_version 289085 (0.0009) [2023-12-26 01:53:30,007][123091] Updated weights for policy 0, policy_version 289095 (0.0007) [2023-12-26 01:53:30,692][123090] Updated weights for policy 1, policy_version 287682 (0.0008) [2023-12-26 01:53:30,720][123091] Updated weights for policy 0, policy_version 289105 (0.0006) [2023-12-26 01:53:30,754][123090] Updated weights for policy 1, policy_version 287692 (0.0006) [2023-12-26 01:53:30,768][123091] Updated weights for policy 0, policy_version 289115 (0.0011) [2023-12-26 01:53:30,815][123090] Updated weights for policy 1, policy_version 287702 (0.0006) [2023-12-26 01:53:30,824][123091] Updated weights for policy 0, policy_version 289125 (0.0011) [2023-12-26 01:53:30,875][123090] Updated weights for policy 1, policy_version 287712 (0.0007) [2023-12-26 01:53:30,883][123091] Updated weights for policy 0, policy_version 289135 (0.0011) [2023-12-26 01:53:31,682][123090] Updated weights for policy 1, policy_version 287722 (0.0009) [2023-12-26 01:53:31,739][123091] Updated weights for policy 0, policy_version 289145 (0.0009) [2023-12-26 01:53:31,749][123090] Updated weights for policy 1, policy_version 287732 (0.0009) [2023-12-26 01:53:31,793][123091] Updated weights for policy 0, policy_version 289155 (0.0008) [2023-12-26 01:53:31,817][123090] Updated weights for policy 1, policy_version 287742 (0.0008) [2023-12-26 01:53:31,862][123091] Updated weights for policy 0, policy_version 289165 (0.0008) [2023-12-26 01:53:32,608][123090] Updated weights for policy 1, policy_version 287752 (0.0006) [2023-12-26 01:53:32,641][123091] Updated weights for policy 0, policy_version 289175 (0.0007) [2023-12-26 01:53:32,661][123090] Updated weights for policy 1, policy_version 287762 (0.0006) [2023-12-26 01:53:32,694][123091] Updated weights for policy 0, policy_version 289185 (0.0009) [2023-12-26 01:53:32,718][123090] Updated weights for policy 1, policy_version 287772 (0.0006) [2023-12-26 01:53:32,753][123091] Updated weights for policy 0, policy_version 289195 (0.0007) [2023-12-26 01:53:33,420][123091] Updated weights for policy 0, policy_version 289205 (0.0006) [2023-12-26 01:53:33,455][123090] Updated weights for policy 1, policy_version 287782 (0.0008) [2023-12-26 01:53:33,477][123091] Updated weights for policy 0, policy_version 289215 (0.0005) [2023-12-26 01:53:33,513][123090] Updated weights for policy 1, policy_version 287792 (0.0010) [2023-12-26 01:53:33,535][123091] Updated weights for policy 0, policy_version 289225 (0.0005) [2023-12-26 01:53:33,581][123090] Updated weights for policy 1, policy_version 287802 (0.0010) [2023-12-26 01:53:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 147726336. Throughput: 0: 9059.1, 1: 8808.4. Samples: 147733132. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:33,784][121949] Avg episode reward: [(0, '6405.837'), (1, '5675.169')] [2023-12-26 01:53:34,283][123091] Updated weights for policy 0, policy_version 289235 (0.0007) [2023-12-26 01:53:34,347][123091] Updated weights for policy 0, policy_version 289245 (0.0011) [2023-12-26 01:53:34,371][123090] Updated weights for policy 1, policy_version 287813 (0.0009) [2023-12-26 01:53:34,411][123091] Updated weights for policy 0, policy_version 289255 (0.0010) [2023-12-26 01:53:34,431][123090] Updated weights for policy 1, policy_version 287823 (0.0008) [2023-12-26 01:53:34,485][123090] Updated weights for policy 1, policy_version 287833 (0.0007) [2023-12-26 01:53:35,182][123091] Updated weights for policy 0, policy_version 289265 (0.0010) [2023-12-26 01:53:35,255][123091] Updated weights for policy 0, policy_version 289275 (0.0006) [2023-12-26 01:53:35,325][123091] Updated weights for policy 0, policy_version 289285 (0.0006) [2023-12-26 01:53:35,347][123090] Updated weights for policy 1, policy_version 287843 (0.0009) [2023-12-26 01:53:35,388][123091] Updated weights for policy 0, policy_version 289295 (0.0006) [2023-12-26 01:53:35,399][123090] Updated weights for policy 1, policy_version 287853 (0.0009) [2023-12-26 01:53:35,461][123090] Updated weights for policy 1, policy_version 287863 (0.0009) [2023-12-26 01:53:36,036][123091] Updated weights for policy 0, policy_version 289305 (0.0006) [2023-12-26 01:53:36,092][123091] Updated weights for policy 0, policy_version 289315 (0.0006) [2023-12-26 01:53:36,157][123091] Updated weights for policy 0, policy_version 289325 (0.0008) [2023-12-26 01:53:36,395][123090] Updated weights for policy 1, policy_version 287873 (0.0009) [2023-12-26 01:53:36,456][123090] Updated weights for policy 1, policy_version 287883 (0.0010) [2023-12-26 01:53:36,511][123090] Updated weights for policy 1, policy_version 287893 (0.0010) [2023-12-26 01:53:36,568][123090] Updated weights for policy 1, policy_version 287903 (0.0009) [2023-12-26 01:53:36,907][123091] Updated weights for policy 0, policy_version 289335 (0.0008) [2023-12-26 01:53:36,970][123091] Updated weights for policy 0, policy_version 289345 (0.0010) [2023-12-26 01:53:37,028][123091] Updated weights for policy 0, policy_version 289355 (0.0010) [2023-12-26 01:53:37,372][123090] Updated weights for policy 1, policy_version 287913 (0.0010) [2023-12-26 01:53:37,436][123090] Updated weights for policy 1, policy_version 287923 (0.0010) [2023-12-26 01:53:37,505][123090] Updated weights for policy 1, policy_version 287933 (0.0010) [2023-12-26 01:53:37,838][123091] Updated weights for policy 0, policy_version 289365 (0.0010) [2023-12-26 01:53:37,904][123091] Updated weights for policy 0, policy_version 289375 (0.0010) [2023-12-26 01:53:37,973][123091] Updated weights for policy 0, policy_version 289385 (0.0009) [2023-12-26 01:53:38,335][123090] Updated weights for policy 1, policy_version 287943 (0.0010) [2023-12-26 01:53:38,387][123090] Updated weights for policy 1, policy_version 287953 (0.0010) [2023-12-26 01:53:38,444][123090] Updated weights for policy 1, policy_version 287963 (0.0010) [2023-12-26 01:53:38,698][123091] Updated weights for policy 0, policy_version 289395 (0.0007) [2023-12-26 01:53:38,766][123091] Updated weights for policy 0, policy_version 289405 (0.0007) [2023-12-26 01:53:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 147808256. Throughput: 0: 9161.5, 1: 8770.9. Samples: 147786808. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:38,785][121949] Avg episode reward: [(0, '6384.617'), (1, '5570.183')] [2023-12-26 01:53:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000287968_73719808.pth... [2023-12-26 01:53:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000286944_73457664.pth [2023-12-26 01:53:38,843][123091] Updated weights for policy 0, policy_version 289415 (0.0006) [2023-12-26 01:53:38,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000289424_74096640.pth... [2023-12-26 01:53:38,903][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000288336_73818112.pth [2023-12-26 01:53:39,245][123090] Updated weights for policy 1, policy_version 287973 (0.0008) [2023-12-26 01:53:39,308][123090] Updated weights for policy 1, policy_version 287983 (0.0009) [2023-12-26 01:53:39,372][123090] Updated weights for policy 1, policy_version 287993 (0.0009) [2023-12-26 01:53:39,535][123091] Updated weights for policy 0, policy_version 289425 (0.0006) [2023-12-26 01:53:39,597][123091] Updated weights for policy 0, policy_version 289435 (0.0010) [2023-12-26 01:53:39,663][123091] Updated weights for policy 0, policy_version 289445 (0.0009) [2023-12-26 01:53:39,722][123091] Updated weights for policy 0, policy_version 289455 (0.0010) [2023-12-26 01:53:40,225][123090] Updated weights for policy 1, policy_version 288003 (0.0010) [2023-12-26 01:53:40,289][123090] Updated weights for policy 1, policy_version 288013 (0.0010) [2023-12-26 01:53:40,337][123090] Updated weights for policy 1, policy_version 288023 (0.0010) [2023-12-26 01:53:40,596][123091] Updated weights for policy 0, policy_version 289465 (0.0009) [2023-12-26 01:53:40,649][123091] Updated weights for policy 0, policy_version 289475 (0.0009) [2023-12-26 01:53:40,709][123091] Updated weights for policy 0, policy_version 289485 (0.0010) [2023-12-26 01:53:41,034][123090] Updated weights for policy 1, policy_version 288033 (0.0010) [2023-12-26 01:53:41,095][123090] Updated weights for policy 1, policy_version 288043 (0.0010) [2023-12-26 01:53:41,177][123090] Updated weights for policy 1, policy_version 288053 (0.0010) [2023-12-26 01:53:41,242][123090] Updated weights for policy 1, policy_version 288063 (0.0009) [2023-12-26 01:53:41,567][123091] Updated weights for policy 0, policy_version 289495 (0.0007) [2023-12-26 01:53:41,630][123091] Updated weights for policy 0, policy_version 289506 (0.0010) [2023-12-26 01:53:41,698][123091] Updated weights for policy 0, policy_version 289516 (0.0010) [2023-12-26 01:53:42,063][123090] Updated weights for policy 1, policy_version 288073 (0.0009) [2023-12-26 01:53:42,132][123090] Updated weights for policy 1, policy_version 288083 (0.0010) [2023-12-26 01:53:42,200][123090] Updated weights for policy 1, policy_version 288093 (0.0010) [2023-12-26 01:53:42,588][123091] Updated weights for policy 0, policy_version 289526 (0.0010) [2023-12-26 01:53:42,642][123091] Updated weights for policy 0, policy_version 289536 (0.0009) [2023-12-26 01:53:42,708][123091] Updated weights for policy 0, policy_version 289546 (0.0009) [2023-12-26 01:53:43,005][123090] Updated weights for policy 1, policy_version 288103 (0.0009) [2023-12-26 01:53:43,054][123090] Updated weights for policy 1, policy_version 288113 (0.0009) [2023-12-26 01:53:43,115][123090] Updated weights for policy 1, policy_version 288123 (0.0009) [2023-12-26 01:53:43,507][123091] Updated weights for policy 0, policy_version 289556 (0.0010) [2023-12-26 01:53:43,558][123091] Updated weights for policy 0, policy_version 289566 (0.0007) [2023-12-26 01:53:43,615][123091] Updated weights for policy 0, policy_version 289576 (0.0006) [2023-12-26 01:53:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 147898368. Throughput: 0: 9146.7, 1: 8755.2. Samples: 147891260. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:43,785][121949] Avg episode reward: [(0, '6319.300'), (1, '5396.231')] [2023-12-26 01:53:43,999][123090] Updated weights for policy 1, policy_version 288133 (0.0007) [2023-12-26 01:53:44,061][123090] Updated weights for policy 1, policy_version 288143 (0.0005) [2023-12-26 01:53:44,129][123090] Updated weights for policy 1, policy_version 288153 (0.0007) [2023-12-26 01:53:44,378][123091] Updated weights for policy 0, policy_version 289586 (0.0008) [2023-12-26 01:53:44,432][123091] Updated weights for policy 0, policy_version 289596 (0.0009) [2023-12-26 01:53:44,488][123091] Updated weights for policy 0, policy_version 289606 (0.0009) [2023-12-26 01:53:44,548][123091] Updated weights for policy 0, policy_version 289616 (0.0010) [2023-12-26 01:53:44,843][123090] Updated weights for policy 1, policy_version 288163 (0.0008) [2023-12-26 01:53:44,907][123090] Updated weights for policy 1, policy_version 288173 (0.0007) [2023-12-26 01:53:44,975][123090] Updated weights for policy 1, policy_version 288183 (0.0005) [2023-12-26 01:53:45,416][123091] Updated weights for policy 0, policy_version 289626 (0.0009) [2023-12-26 01:53:45,478][123091] Updated weights for policy 0, policy_version 289636 (0.0010) [2023-12-26 01:53:45,548][123091] Updated weights for policy 0, policy_version 289646 (0.0009) [2023-12-26 01:53:45,721][123090] Updated weights for policy 1, policy_version 288193 (0.0007) [2023-12-26 01:53:45,770][123090] Updated weights for policy 1, policy_version 288203 (0.0009) [2023-12-26 01:53:45,839][123090] Updated weights for policy 1, policy_version 288213 (0.0008) [2023-12-26 01:53:45,899][123090] Updated weights for policy 1, policy_version 288223 (0.0009) [2023-12-26 01:53:46,384][123091] Updated weights for policy 0, policy_version 289656 (0.0010) [2023-12-26 01:53:46,452][123091] Updated weights for policy 0, policy_version 289666 (0.0010) [2023-12-26 01:53:46,511][123091] Updated weights for policy 0, policy_version 289676 (0.0011) [2023-12-26 01:53:46,697][123090] Updated weights for policy 1, policy_version 288233 (0.0009) [2023-12-26 01:53:46,763][123090] Updated weights for policy 1, policy_version 288243 (0.0010) [2023-12-26 01:53:46,829][123090] Updated weights for policy 1, policy_version 288253 (0.0010) [2023-12-26 01:53:47,195][123091] Updated weights for policy 0, policy_version 289686 (0.0007) [2023-12-26 01:53:47,244][123091] Updated weights for policy 0, policy_version 289696 (0.0005) [2023-12-26 01:53:47,295][123091] Updated weights for policy 0, policy_version 289706 (0.0005) [2023-12-26 01:53:47,748][123090] Updated weights for policy 1, policy_version 288263 (0.0010) [2023-12-26 01:53:47,805][123090] Updated weights for policy 1, policy_version 288273 (0.0010) [2023-12-26 01:53:47,864][123091] Updated weights for policy 0, policy_version 289716 (0.0005) [2023-12-26 01:53:47,876][123090] Updated weights for policy 1, policy_version 288283 (0.0008) [2023-12-26 01:53:47,922][123091] Updated weights for policy 0, policy_version 289726 (0.0006) [2023-12-26 01:53:47,973][123091] Updated weights for policy 0, policy_version 289736 (0.0006) [2023-12-26 01:53:48,678][123090] Updated weights for policy 1, policy_version 288293 (0.0009) [2023-12-26 01:53:48,736][123090] Updated weights for policy 1, policy_version 288303 (0.0009) [2023-12-26 01:53:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 147980288. Throughput: 0: 9203.2, 1: 8744.4. Samples: 147998052. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:48,785][121949] Avg episode reward: [(0, '6370.720'), (1, '5377.142')] [2023-12-26 01:53:48,799][123090] Updated weights for policy 1, policy_version 288313 (0.0009) [2023-12-26 01:53:48,801][123091] Updated weights for policy 0, policy_version 289746 (0.0010) [2023-12-26 01:53:48,866][123091] Updated weights for policy 0, policy_version 289756 (0.0009) [2023-12-26 01:53:48,917][123091] Updated weights for policy 0, policy_version 289766 (0.0009) [2023-12-26 01:53:48,972][123091] Updated weights for policy 0, policy_version 289776 (0.0009) [2023-12-26 01:53:49,676][123090] Updated weights for policy 1, policy_version 288323 (0.0009) [2023-12-26 01:53:49,733][123090] Updated weights for policy 1, policy_version 288333 (0.0009) [2023-12-26 01:53:49,773][123091] Updated weights for policy 0, policy_version 289786 (0.0007) [2023-12-26 01:53:49,798][123090] Updated weights for policy 1, policy_version 288343 (0.0009) [2023-12-26 01:53:49,825][123091] Updated weights for policy 0, policy_version 289796 (0.0008) [2023-12-26 01:53:49,886][123091] Updated weights for policy 0, policy_version 289806 (0.0009) [2023-12-26 01:53:50,631][123090] Updated weights for policy 1, policy_version 288353 (0.0008) [2023-12-26 01:53:50,685][123090] Updated weights for policy 1, policy_version 288363 (0.0010) [2023-12-26 01:53:50,750][123090] Updated weights for policy 1, policy_version 288373 (0.0008) [2023-12-26 01:53:50,774][123091] Updated weights for policy 0, policy_version 289816 (0.0009) [2023-12-26 01:53:50,812][123090] Updated weights for policy 1, policy_version 288383 (0.0007) [2023-12-26 01:53:50,839][123091] Updated weights for policy 0, policy_version 289826 (0.0010) [2023-12-26 01:53:50,910][123091] Updated weights for policy 0, policy_version 289836 (0.0010) [2023-12-26 01:53:51,708][123090] Updated weights for policy 1, policy_version 288393 (0.0007) [2023-12-26 01:53:51,735][123091] Updated weights for policy 0, policy_version 289846 (0.0009) [2023-12-26 01:53:51,781][123090] Updated weights for policy 1, policy_version 288403 (0.0006) [2023-12-26 01:53:51,809][123091] Updated weights for policy 0, policy_version 289857 (0.0010) [2023-12-26 01:53:51,841][123090] Updated weights for policy 1, policy_version 288413 (0.0006) [2023-12-26 01:53:51,871][123091] Updated weights for policy 0, policy_version 289867 (0.0010) [2023-12-26 01:53:52,590][123090] Updated weights for policy 1, policy_version 288423 (0.0009) [2023-12-26 01:53:52,641][123090] Updated weights for policy 1, policy_version 288433 (0.0010) [2023-12-26 01:53:52,696][123090] Updated weights for policy 1, policy_version 288444 (0.0010) [2023-12-26 01:53:52,721][123091] Updated weights for policy 0, policy_version 289877 (0.0009) [2023-12-26 01:53:52,773][123091] Updated weights for policy 0, policy_version 289887 (0.0009) [2023-12-26 01:53:52,829][123091] Updated weights for policy 0, policy_version 289897 (0.0009) [2023-12-26 01:53:53,567][123090] Updated weights for policy 1, policy_version 288454 (0.0010) [2023-12-26 01:53:53,622][123090] Updated weights for policy 1, policy_version 288464 (0.0009) [2023-12-26 01:53:53,644][123091] Updated weights for policy 0, policy_version 289907 (0.0006) [2023-12-26 01:53:53,685][123090] Updated weights for policy 1, policy_version 288474 (0.0009) [2023-12-26 01:53:53,695][123091] Updated weights for policy 0, policy_version 289917 (0.0009) [2023-12-26 01:53:53,750][123091] Updated weights for policy 0, policy_version 289927 (0.0008) [2023-12-26 01:53:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 148070400. Throughput: 0: 9144.1, 1: 8731.6. Samples: 148048352. Policy #0 lag: (min: 20.0, avg: 34.1, max: 52.0) [2023-12-26 01:53:53,785][121949] Avg episode reward: [(0, '6386.548'), (1, '5513.375')] [2023-12-26 01:53:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000288480_73850880.pth... [2023-12-26 01:53:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000287456_73588736.pth [2023-12-26 01:53:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000288480_73850880.pth [2023-12-26 01:53:53,811][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000289936_74227712.pth... [2023-12-26 01:53:53,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000288848_73949184.pth [2023-12-26 01:53:53,817][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000289936_74227712.pth [2023-12-26 01:53:54,494][123090] Updated weights for policy 1, policy_version 288484 (0.0008) [2023-12-26 01:53:54,556][123090] Updated weights for policy 1, policy_version 288494 (0.0006) [2023-12-26 01:53:54,613][123091] Updated weights for policy 0, policy_version 289937 (0.0009) [2023-12-26 01:53:54,623][123090] Updated weights for policy 1, policy_version 288504 (0.0005) [2023-12-26 01:53:54,672][123091] Updated weights for policy 0, policy_version 289947 (0.0009) [2023-12-26 01:53:54,725][123091] Updated weights for policy 0, policy_version 289957 (0.0009) [2023-12-26 01:53:54,782][123091] Updated weights for policy 0, policy_version 289967 (0.0009) [2023-12-26 01:53:55,398][123090] Updated weights for policy 1, policy_version 288514 (0.0006) [2023-12-26 01:53:55,461][123090] Updated weights for policy 1, policy_version 288524 (0.0007) [2023-12-26 01:53:55,523][123090] Updated weights for policy 1, policy_version 288534 (0.0008) [2023-12-26 01:53:55,587][123090] Updated weights for policy 1, policy_version 288544 (0.0010) [2023-12-26 01:53:55,683][123091] Updated weights for policy 0, policy_version 289977 (0.0009) [2023-12-26 01:53:55,745][123091] Updated weights for policy 0, policy_version 289987 (0.0010) [2023-12-26 01:53:55,806][123091] Updated weights for policy 0, policy_version 289997 (0.0010) [2023-12-26 01:53:56,304][123090] Updated weights for policy 1, policy_version 288554 (0.0009) [2023-12-26 01:53:56,371][123090] Updated weights for policy 1, policy_version 288564 (0.0009) [2023-12-26 01:53:56,443][123090] Updated weights for policy 1, policy_version 288574 (0.0008) [2023-12-26 01:53:56,643][123091] Updated weights for policy 0, policy_version 290007 (0.0007) [2023-12-26 01:53:56,706][123091] Updated weights for policy 0, policy_version 290017 (0.0005) [2023-12-26 01:53:56,772][123091] Updated weights for policy 0, policy_version 290027 (0.0007) [2023-12-26 01:53:57,199][123090] Updated weights for policy 1, policy_version 288584 (0.0005) [2023-12-26 01:53:57,263][123090] Updated weights for policy 1, policy_version 288594 (0.0008) [2023-12-26 01:53:57,324][123090] Updated weights for policy 1, policy_version 288604 (0.0008) [2023-12-26 01:53:57,509][123091] Updated weights for policy 0, policy_version 290037 (0.0009) [2023-12-26 01:53:57,562][123091] Updated weights for policy 0, policy_version 290047 (0.0010) [2023-12-26 01:53:57,621][123091] Updated weights for policy 0, policy_version 290057 (0.0009) [2023-12-26 01:53:57,904][123090] Updated weights for policy 1, policy_version 288614 (0.0006) [2023-12-26 01:53:57,949][123090] Updated weights for policy 1, policy_version 288624 (0.0005) [2023-12-26 01:53:58,016][123090] Updated weights for policy 1, policy_version 288634 (0.0009) [2023-12-26 01:53:58,459][123091] Updated weights for policy 0, policy_version 290067 (0.0008) [2023-12-26 01:53:58,524][123091] Updated weights for policy 0, policy_version 290077 (0.0008) [2023-12-26 01:53:58,604][123091] Updated weights for policy 0, policy_version 290087 (0.0009) [2023-12-26 01:53:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 148160512. Throughput: 0: 9091.9, 1: 8714.8. Samples: 148154012. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:53:58,785][121949] Avg episode reward: [(0, '6317.361'), (1, '5554.677')] [2023-12-26 01:53:58,886][123090] Updated weights for policy 1, policy_version 288644 (0.0010) [2023-12-26 01:53:58,953][123090] Updated weights for policy 1, policy_version 288654 (0.0010) [2023-12-26 01:53:59,014][123090] Updated weights for policy 1, policy_version 288664 (0.0009) [2023-12-26 01:53:59,456][123091] Updated weights for policy 0, policy_version 290097 (0.0008) [2023-12-26 01:53:59,524][123091] Updated weights for policy 0, policy_version 290107 (0.0005) [2023-12-26 01:53:59,581][123091] Updated weights for policy 0, policy_version 290117 (0.0006) [2023-12-26 01:53:59,627][123091] Updated weights for policy 0, policy_version 290127 (0.0009) [2023-12-26 01:53:59,875][123090] Updated weights for policy 1, policy_version 288674 (0.0010) [2023-12-26 01:53:59,940][123090] Updated weights for policy 1, policy_version 288685 (0.0008) [2023-12-26 01:54:00,005][123090] Updated weights for policy 1, policy_version 288695 (0.0009) [2023-12-26 01:54:00,323][123091] Updated weights for policy 0, policy_version 290137 (0.0006) [2023-12-26 01:54:00,394][123091] Updated weights for policy 0, policy_version 290147 (0.0006) [2023-12-26 01:54:00,458][123091] Updated weights for policy 0, policy_version 290157 (0.0008) [2023-12-26 01:54:00,800][123090] Updated weights for policy 1, policy_version 288705 (0.0009) [2023-12-26 01:54:00,865][123090] Updated weights for policy 1, policy_version 288715 (0.0009) [2023-12-26 01:54:00,929][123090] Updated weights for policy 1, policy_version 288725 (0.0009) [2023-12-26 01:54:00,998][123090] Updated weights for policy 1, policy_version 288735 (0.0008) [2023-12-26 01:54:01,243][123091] Updated weights for policy 0, policy_version 290167 (0.0010) [2023-12-26 01:54:01,310][123091] Updated weights for policy 0, policy_version 290177 (0.0006) [2023-12-26 01:54:01,383][123091] Updated weights for policy 0, policy_version 290187 (0.0009) [2023-12-26 01:54:01,882][123090] Updated weights for policy 1, policy_version 288745 (0.0009) [2023-12-26 01:54:01,941][123090] Updated weights for policy 1, policy_version 288755 (0.0009) [2023-12-26 01:54:02,010][123090] Updated weights for policy 1, policy_version 288765 (0.0009) [2023-12-26 01:54:02,128][123091] Updated weights for policy 0, policy_version 290197 (0.0008) [2023-12-26 01:54:02,184][123091] Updated weights for policy 0, policy_version 290207 (0.0010) [2023-12-26 01:54:02,252][123091] Updated weights for policy 0, policy_version 290217 (0.0010) [2023-12-26 01:54:02,798][123090] Updated weights for policy 1, policy_version 288775 (0.0008) [2023-12-26 01:54:02,854][123090] Updated weights for policy 1, policy_version 288785 (0.0009) [2023-12-26 01:54:02,925][123090] Updated weights for policy 1, policy_version 288795 (0.0007) [2023-12-26 01:54:03,043][123091] Updated weights for policy 0, policy_version 290227 (0.0008) [2023-12-26 01:54:03,089][123091] Updated weights for policy 0, policy_version 290237 (0.0005) [2023-12-26 01:54:03,142][123091] Updated weights for policy 0, policy_version 290247 (0.0005) [2023-12-26 01:54:03,616][123090] Updated weights for policy 1, policy_version 288805 (0.0005) [2023-12-26 01:54:03,673][123090] Updated weights for policy 1, policy_version 288815 (0.0005) [2023-12-26 01:54:03,728][123090] Updated weights for policy 1, policy_version 288825 (0.0005) [2023-12-26 01:54:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 148250624. Throughput: 0: 8996.0, 1: 8698.4. Samples: 148260364. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:03,785][121949] Avg episode reward: [(0, '6191.079'), (1, '5671.955')] [2023-12-26 01:54:03,888][123091] Updated weights for policy 0, policy_version 290257 (0.0006) [2023-12-26 01:54:03,943][123091] Updated weights for policy 0, policy_version 290267 (0.0006) [2023-12-26 01:54:04,005][123091] Updated weights for policy 0, policy_version 290277 (0.0007) [2023-12-26 01:54:04,066][123091] Updated weights for policy 0, policy_version 290287 (0.0009) [2023-12-26 01:54:04,466][123090] Updated weights for policy 1, policy_version 288835 (0.0007) [2023-12-26 01:54:04,532][123090] Updated weights for policy 1, policy_version 288845 (0.0010) [2023-12-26 01:54:04,602][123090] Updated weights for policy 1, policy_version 288855 (0.0010) [2023-12-26 01:54:04,742][123091] Updated weights for policy 0, policy_version 290297 (0.0009) [2023-12-26 01:54:04,799][123091] Updated weights for policy 0, policy_version 290307 (0.0009) [2023-12-26 01:54:04,860][123091] Updated weights for policy 0, policy_version 290317 (0.0009) [2023-12-26 01:54:05,384][123090] Updated weights for policy 1, policy_version 288865 (0.0011) [2023-12-26 01:54:05,442][123090] Updated weights for policy 1, policy_version 288875 (0.0010) [2023-12-26 01:54:05,503][123090] Updated weights for policy 1, policy_version 288885 (0.0010) [2023-12-26 01:54:05,561][123090] Updated weights for policy 1, policy_version 288895 (0.0005) [2023-12-26 01:54:05,731][123091] Updated weights for policy 0, policy_version 290327 (0.0010) [2023-12-26 01:54:05,797][123091] Updated weights for policy 0, policy_version 290337 (0.0007) [2023-12-26 01:54:05,863][123091] Updated weights for policy 0, policy_version 290347 (0.0010) [2023-12-26 01:54:06,266][123090] Updated weights for policy 1, policy_version 288905 (0.0008) [2023-12-26 01:54:06,335][123090] Updated weights for policy 1, policy_version 288915 (0.0008) [2023-12-26 01:54:06,410][123090] Updated weights for policy 1, policy_version 288925 (0.0006) [2023-12-26 01:54:06,735][123091] Updated weights for policy 0, policy_version 290357 (0.0010) [2023-12-26 01:54:06,815][123091] Updated weights for policy 0, policy_version 290367 (0.0007) [2023-12-26 01:54:06,890][123091] Updated weights for policy 0, policy_version 290377 (0.0008) [2023-12-26 01:54:07,077][123090] Updated weights for policy 1, policy_version 288935 (0.0007) [2023-12-26 01:54:07,140][123090] Updated weights for policy 1, policy_version 288945 (0.0008) [2023-12-26 01:54:07,211][123090] Updated weights for policy 1, policy_version 288955 (0.0007) [2023-12-26 01:54:07,558][123091] Updated weights for policy 0, policy_version 290387 (0.0010) [2023-12-26 01:54:07,623][123091] Updated weights for policy 0, policy_version 290397 (0.0009) [2023-12-26 01:54:07,672][123091] Updated weights for policy 0, policy_version 290407 (0.0009) [2023-12-26 01:54:07,938][123090] Updated weights for policy 1, policy_version 288965 (0.0008) [2023-12-26 01:54:07,993][123090] Updated weights for policy 1, policy_version 288975 (0.0010) [2023-12-26 01:54:08,052][123090] Updated weights for policy 1, policy_version 288985 (0.0010) [2023-12-26 01:54:08,494][123091] Updated weights for policy 0, policy_version 290417 (0.0009) [2023-12-26 01:54:08,546][123091] Updated weights for policy 0, policy_version 290427 (0.0009) [2023-12-26 01:54:08,594][123091] Updated weights for policy 0, policy_version 290437 (0.0008) [2023-12-26 01:54:08,647][123091] Updated weights for policy 0, policy_version 290447 (0.0009) [2023-12-26 01:54:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 148340736. Throughput: 0: 8964.5, 1: 8769.9. Samples: 148314896. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:08,785][121949] Avg episode reward: [(0, '6068.025'), (1, '5724.714')] [2023-12-26 01:54:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000288992_73981952.pth... [2023-12-26 01:54:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000290448_74358784.pth... [2023-12-26 01:54:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000289424_74096640.pth [2023-12-26 01:54:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000287968_73719808.pth [2023-12-26 01:54:08,886][123090] Updated weights for policy 1, policy_version 288995 (0.0011) [2023-12-26 01:54:08,946][123090] Updated weights for policy 1, policy_version 289005 (0.0011) [2023-12-26 01:54:08,998][123090] Updated weights for policy 1, policy_version 289015 (0.0010) [2023-12-26 01:54:09,461][123091] Updated weights for policy 0, policy_version 290458 (0.0009) [2023-12-26 01:54:09,524][123091] Updated weights for policy 0, policy_version 290468 (0.0008) [2023-12-26 01:54:09,577][123091] Updated weights for policy 0, policy_version 290478 (0.0008) [2023-12-26 01:54:09,849][123090] Updated weights for policy 1, policy_version 289025 (0.0010) [2023-12-26 01:54:09,915][123090] Updated weights for policy 1, policy_version 289035 (0.0006) [2023-12-26 01:54:09,978][123090] Updated weights for policy 1, policy_version 289045 (0.0008) [2023-12-26 01:54:10,038][123090] Updated weights for policy 1, policy_version 289055 (0.0010) [2023-12-26 01:54:10,379][123091] Updated weights for policy 0, policy_version 290488 (0.0010) [2023-12-26 01:54:10,444][123091] Updated weights for policy 0, policy_version 290498 (0.0009) [2023-12-26 01:54:10,513][123091] Updated weights for policy 0, policy_version 290508 (0.0011) [2023-12-26 01:54:10,807][123090] Updated weights for policy 1, policy_version 289065 (0.0009) [2023-12-26 01:54:10,873][123090] Updated weights for policy 1, policy_version 289075 (0.0010) [2023-12-26 01:54:10,943][123090] Updated weights for policy 1, policy_version 289085 (0.0009) [2023-12-26 01:54:11,364][123091] Updated weights for policy 0, policy_version 290518 (0.0009) [2023-12-26 01:54:11,425][123091] Updated weights for policy 0, policy_version 290528 (0.0010) [2023-12-26 01:54:11,492][123091] Updated weights for policy 0, policy_version 290538 (0.0009) [2023-12-26 01:54:11,769][123090] Updated weights for policy 1, policy_version 289095 (0.0010) [2023-12-26 01:54:11,829][123090] Updated weights for policy 1, policy_version 289105 (0.0007) [2023-12-26 01:54:11,894][123090] Updated weights for policy 1, policy_version 289115 (0.0009) [2023-12-26 01:54:12,308][123091] Updated weights for policy 0, policy_version 290548 (0.0008) [2023-12-26 01:54:12,384][123091] Updated weights for policy 0, policy_version 290558 (0.0007) [2023-12-26 01:54:12,453][123091] Updated weights for policy 0, policy_version 290568 (0.0007) [2023-12-26 01:54:12,638][123090] Updated weights for policy 1, policy_version 289125 (0.0008) [2023-12-26 01:54:12,718][123090] Updated weights for policy 1, policy_version 289135 (0.0005) [2023-12-26 01:54:12,788][123090] Updated weights for policy 1, policy_version 289145 (0.0009) [2023-12-26 01:54:13,213][123091] Updated weights for policy 0, policy_version 290578 (0.0007) [2023-12-26 01:54:13,279][123091] Updated weights for policy 0, policy_version 290588 (0.0006) [2023-12-26 01:54:13,338][123091] Updated weights for policy 0, policy_version 290598 (0.0007) [2023-12-26 01:54:13,415][123091] Updated weights for policy 0, policy_version 290608 (0.0005) [2023-12-26 01:54:13,422][123090] Updated weights for policy 1, policy_version 289155 (0.0008) [2023-12-26 01:54:13,477][123090] Updated weights for policy 1, policy_version 289165 (0.0005) [2023-12-26 01:54:13,542][123090] Updated weights for policy 1, policy_version 289175 (0.0005) [2023-12-26 01:54:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 148430848. Throughput: 0: 8916.5, 1: 8852.0. Samples: 148420984. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:13,785][121949] Avg episode reward: [(0, '6000.564'), (1, '5634.917')] [2023-12-26 01:54:14,018][123091] Updated weights for policy 0, policy_version 290618 (0.0006) [2023-12-26 01:54:14,098][123091] Updated weights for policy 0, policy_version 290628 (0.0005) [2023-12-26 01:54:14,129][123090] Updated weights for policy 1, policy_version 289185 (0.0006) [2023-12-26 01:54:14,169][123091] Updated weights for policy 0, policy_version 290638 (0.0005) [2023-12-26 01:54:14,212][123090] Updated weights for policy 1, policy_version 289195 (0.0005) [2023-12-26 01:54:14,276][123090] Updated weights for policy 1, policy_version 289205 (0.0006) [2023-12-26 01:54:14,326][123090] Updated weights for policy 1, policy_version 289215 (0.0005) [2023-12-26 01:54:14,743][123091] Updated weights for policy 0, policy_version 290648 (0.0005) [2023-12-26 01:54:14,804][123091] Updated weights for policy 0, policy_version 290658 (0.0007) [2023-12-26 01:54:14,867][123091] Updated weights for policy 0, policy_version 290668 (0.0008) [2023-12-26 01:54:15,050][123090] Updated weights for policy 1, policy_version 289225 (0.0006) [2023-12-26 01:54:15,116][123090] Updated weights for policy 1, policy_version 289235 (0.0006) [2023-12-26 01:54:15,173][123090] Updated weights for policy 1, policy_version 289245 (0.0010) [2023-12-26 01:54:15,706][123091] Updated weights for policy 0, policy_version 290678 (0.0009) [2023-12-26 01:54:15,763][123091] Updated weights for policy 0, policy_version 290688 (0.0009) [2023-12-26 01:54:15,825][123091] Updated weights for policy 0, policy_version 290698 (0.0009) [2023-12-26 01:54:15,886][123090] Updated weights for policy 1, policy_version 289256 (0.0006) [2023-12-26 01:54:15,931][123090] Updated weights for policy 1, policy_version 289266 (0.0005) [2023-12-26 01:54:15,977][123090] Updated weights for policy 1, policy_version 289276 (0.0005) [2023-12-26 01:54:16,648][123091] Updated weights for policy 0, policy_version 290708 (0.0009) [2023-12-26 01:54:16,707][123091] Updated weights for policy 0, policy_version 290718 (0.0009) [2023-12-26 01:54:16,709][123090] Updated weights for policy 1, policy_version 289286 (0.0006) [2023-12-26 01:54:16,755][123090] Updated weights for policy 1, policy_version 289296 (0.0006) [2023-12-26 01:54:16,763][123091] Updated weights for policy 0, policy_version 290728 (0.0009) [2023-12-26 01:54:16,804][123090] Updated weights for policy 1, policy_version 289306 (0.0005) [2023-12-26 01:54:17,574][123090] Updated weights for policy 1, policy_version 289316 (0.0007) [2023-12-26 01:54:17,630][123091] Updated weights for policy 0, policy_version 290738 (0.0009) [2023-12-26 01:54:17,631][123090] Updated weights for policy 1, policy_version 289326 (0.0010) [2023-12-26 01:54:17,683][123091] Updated weights for policy 0, policy_version 290748 (0.0008) [2023-12-26 01:54:17,690][123090] Updated weights for policy 1, policy_version 289336 (0.0008) [2023-12-26 01:54:17,739][123091] Updated weights for policy 0, policy_version 290758 (0.0007) [2023-12-26 01:54:17,802][123091] Updated weights for policy 0, policy_version 290768 (0.0009) [2023-12-26 01:54:18,492][123090] Updated weights for policy 1, policy_version 289346 (0.0010) [2023-12-26 01:54:18,551][123090] Updated weights for policy 1, policy_version 289356 (0.0010) [2023-12-26 01:54:18,601][123090] Updated weights for policy 1, policy_version 289366 (0.0009) [2023-12-26 01:54:18,646][123091] Updated weights for policy 0, policy_version 290778 (0.0007) [2023-12-26 01:54:18,657][123090] Updated weights for policy 1, policy_version 289376 (0.0008) [2023-12-26 01:54:18,704][123091] Updated weights for policy 0, policy_version 290788 (0.0009) [2023-12-26 01:54:18,754][123091] Updated weights for policy 0, policy_version 290798 (0.0009) [2023-12-26 01:54:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 148529152. Throughput: 0: 8865.5, 1: 8922.9. Samples: 148533612. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:18,785][121949] Avg episode reward: [(0, '5940.607'), (1, '5534.870')] [2023-12-26 01:54:19,518][123090] Updated weights for policy 1, policy_version 289386 (0.0009) [2023-12-26 01:54:19,577][123090] Updated weights for policy 1, policy_version 289396 (0.0009) [2023-12-26 01:54:19,641][123090] Updated weights for policy 1, policy_version 289406 (0.0007) [2023-12-26 01:54:19,643][123091] Updated weights for policy 0, policy_version 290808 (0.0010) [2023-12-26 01:54:19,695][123091] Updated weights for policy 0, policy_version 290818 (0.0009) [2023-12-26 01:54:19,751][123091] Updated weights for policy 0, policy_version 290828 (0.0010) [2023-12-26 01:54:20,480][123090] Updated weights for policy 1, policy_version 289416 (0.0010) [2023-12-26 01:54:20,537][123090] Updated weights for policy 1, policy_version 289426 (0.0009) [2023-12-26 01:54:20,606][123091] Updated weights for policy 0, policy_version 290838 (0.0009) [2023-12-26 01:54:20,609][123090] Updated weights for policy 1, policy_version 289436 (0.0009) [2023-12-26 01:54:20,666][123091] Updated weights for policy 0, policy_version 290848 (0.0008) [2023-12-26 01:54:20,734][123091] Updated weights for policy 0, policy_version 290858 (0.0010) [2023-12-26 01:54:21,484][123090] Updated weights for policy 1, policy_version 289446 (0.0009) [2023-12-26 01:54:21,535][123091] Updated weights for policy 0, policy_version 290868 (0.0009) [2023-12-26 01:54:21,547][123090] Updated weights for policy 1, policy_version 289456 (0.0009) [2023-12-26 01:54:21,604][123091] Updated weights for policy 0, policy_version 290878 (0.0006) [2023-12-26 01:54:21,616][123090] Updated weights for policy 1, policy_version 289466 (0.0008) [2023-12-26 01:54:21,674][123091] Updated weights for policy 0, policy_version 290888 (0.0008) [2023-12-26 01:54:22,514][123091] Updated weights for policy 0, policy_version 290898 (0.0007) [2023-12-26 01:54:22,524][123090] Updated weights for policy 1, policy_version 289478 (0.0010) [2023-12-26 01:54:22,566][123091] Updated weights for policy 0, policy_version 290908 (0.0008) [2023-12-26 01:54:22,584][123090] Updated weights for policy 1, policy_version 289488 (0.0009) [2023-12-26 01:54:22,627][123091] Updated weights for policy 0, policy_version 290918 (0.0010) [2023-12-26 01:54:22,648][123090] Updated weights for policy 1, policy_version 289498 (0.0008) [2023-12-26 01:54:22,686][123091] Updated weights for policy 0, policy_version 290928 (0.0009) [2023-12-26 01:54:23,399][123090] Updated weights for policy 1, policy_version 289508 (0.0008) [2023-12-26 01:54:23,448][123090] Updated weights for policy 1, policy_version 289518 (0.0005) [2023-12-26 01:54:23,506][123090] Updated weights for policy 1, policy_version 289528 (0.0009) [2023-12-26 01:54:23,565][123091] Updated weights for policy 0, policy_version 290938 (0.0007) [2023-12-26 01:54:23,617][123091] Updated weights for policy 0, policy_version 290948 (0.0009) [2023-12-26 01:54:23,674][123091] Updated weights for policy 0, policy_version 290958 (0.0009) [2023-12-26 01:54:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 148611072. Throughput: 0: 8783.4, 1: 8926.1. Samples: 148583740. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:23,785][121949] Avg episode reward: [(0, '5999.000'), (1, '5507.603')] [2023-12-26 01:54:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000290960_74489856.pth... [2023-12-26 01:54:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000289536_74121216.pth... [2023-12-26 01:54:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000289936_74227712.pth [2023-12-26 01:54:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000288480_73850880.pth [2023-12-26 01:54:24,290][123090] Updated weights for policy 1, policy_version 289538 (0.0010) [2023-12-26 01:54:24,343][123090] Updated weights for policy 1, policy_version 289548 (0.0009) [2023-12-26 01:54:24,401][123090] Updated weights for policy 1, policy_version 289558 (0.0009) [2023-12-26 01:54:24,459][123090] Updated weights for policy 1, policy_version 289568 (0.0010) [2023-12-26 01:54:24,536][123091] Updated weights for policy 0, policy_version 290968 (0.0009) [2023-12-26 01:54:24,594][123091] Updated weights for policy 0, policy_version 290978 (0.0008) [2023-12-26 01:54:24,664][123091] Updated weights for policy 0, policy_version 290988 (0.0005) [2023-12-26 01:54:25,202][123090] Updated weights for policy 1, policy_version 289578 (0.0005) [2023-12-26 01:54:25,260][123090] Updated weights for policy 1, policy_version 289588 (0.0005) [2023-12-26 01:54:25,306][123090] Updated weights for policy 1, policy_version 289598 (0.0006) [2023-12-26 01:54:25,527][123091] Updated weights for policy 0, policy_version 290998 (0.0009) [2023-12-26 01:54:25,590][123091] Updated weights for policy 0, policy_version 291008 (0.0010) [2023-12-26 01:54:25,661][123091] Updated weights for policy 0, policy_version 291018 (0.0010) [2023-12-26 01:54:25,968][123090] Updated weights for policy 1, policy_version 289608 (0.0009) [2023-12-26 01:54:26,016][123090] Updated weights for policy 1, policy_version 289618 (0.0010) [2023-12-26 01:54:26,063][123090] Updated weights for policy 1, policy_version 289628 (0.0010) [2023-12-26 01:54:26,465][123091] Updated weights for policy 0, policy_version 291028 (0.0009) [2023-12-26 01:54:26,518][123091] Updated weights for policy 0, policy_version 291038 (0.0009) [2023-12-26 01:54:26,565][123091] Updated weights for policy 0, policy_version 291048 (0.0009) [2023-12-26 01:54:26,880][123090] Updated weights for policy 1, policy_version 289638 (0.0007) [2023-12-26 01:54:26,950][123090] Updated weights for policy 1, policy_version 289648 (0.0009) [2023-12-26 01:54:27,012][123090] Updated weights for policy 1, policy_version 289658 (0.0010) [2023-12-26 01:54:27,426][123091] Updated weights for policy 0, policy_version 291058 (0.0009) [2023-12-26 01:54:27,477][123091] Updated weights for policy 0, policy_version 291068 (0.0008) [2023-12-26 01:54:27,526][123091] Updated weights for policy 0, policy_version 291078 (0.0009) [2023-12-26 01:54:27,574][123091] Updated weights for policy 0, policy_version 291088 (0.0009) [2023-12-26 01:54:27,797][123090] Updated weights for policy 1, policy_version 289668 (0.0010) [2023-12-26 01:54:27,849][123090] Updated weights for policy 1, policy_version 289678 (0.0010) [2023-12-26 01:54:27,922][123090] Updated weights for policy 1, policy_version 289688 (0.0011) [2023-12-26 01:54:28,419][123091] Updated weights for policy 0, policy_version 291098 (0.0008) [2023-12-26 01:54:28,480][123091] Updated weights for policy 0, policy_version 291108 (0.0008) [2023-12-26 01:54:28,531][123091] Updated weights for policy 0, policy_version 291118 (0.0008) [2023-12-26 01:54:28,729][123090] Updated weights for policy 1, policy_version 289698 (0.0010) [2023-12-26 01:54:28,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 148692992. Throughput: 0: 8745.5, 1: 8978.6. Samples: 148688840. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:28,785][121949] Avg episode reward: [(0, '6100.242'), (1, '5655.735')] [2023-12-26 01:54:28,785][123090] Updated weights for policy 1, policy_version 289708 (0.0011) [2023-12-26 01:54:28,851][123090] Updated weights for policy 1, policy_version 289718 (0.0006) [2023-12-26 01:54:28,923][123090] Updated weights for policy 1, policy_version 289728 (0.0007) [2023-12-26 01:54:29,357][123091] Updated weights for policy 0, policy_version 291128 (0.0010) [2023-12-26 01:54:29,418][123091] Updated weights for policy 0, policy_version 291138 (0.0009) [2023-12-26 01:54:29,477][123091] Updated weights for policy 0, policy_version 291148 (0.0008) [2023-12-26 01:54:29,726][123090] Updated weights for policy 1, policy_version 289738 (0.0010) [2023-12-26 01:54:29,802][123090] Updated weights for policy 1, policy_version 289748 (0.0010) [2023-12-26 01:54:29,873][123090] Updated weights for policy 1, policy_version 289758 (0.0009) [2023-12-26 01:54:30,310][123091] Updated weights for policy 0, policy_version 291158 (0.0009) [2023-12-26 01:54:30,372][123091] Updated weights for policy 0, policy_version 291168 (0.0009) [2023-12-26 01:54:30,438][123091] Updated weights for policy 0, policy_version 291178 (0.0008) [2023-12-26 01:54:30,668][123090] Updated weights for policy 1, policy_version 289768 (0.0009) [2023-12-26 01:54:30,721][123090] Updated weights for policy 1, policy_version 289778 (0.0010) [2023-12-26 01:54:30,777][123090] Updated weights for policy 1, policy_version 289788 (0.0010) [2023-12-26 01:54:31,166][123091] Updated weights for policy 0, policy_version 291188 (0.0006) [2023-12-26 01:54:31,233][123091] Updated weights for policy 0, policy_version 291198 (0.0006) [2023-12-26 01:54:31,304][123091] Updated weights for policy 0, policy_version 291208 (0.0007) [2023-12-26 01:54:31,599][123090] Updated weights for policy 1, policy_version 289798 (0.0007) [2023-12-26 01:54:31,666][123090] Updated weights for policy 1, policy_version 289808 (0.0010) [2023-12-26 01:54:31,739][123090] Updated weights for policy 1, policy_version 289818 (0.0010) [2023-12-26 01:54:32,081][123091] Updated weights for policy 0, policy_version 291218 (0.0007) [2023-12-26 01:54:32,147][123091] Updated weights for policy 0, policy_version 291228 (0.0009) [2023-12-26 01:54:32,206][123091] Updated weights for policy 0, policy_version 291238 (0.0009) [2023-12-26 01:54:32,270][123091] Updated weights for policy 0, policy_version 291248 (0.0010) [2023-12-26 01:54:32,545][123090] Updated weights for policy 1, policy_version 289828 (0.0009) [2023-12-26 01:54:32,611][123090] Updated weights for policy 1, policy_version 289838 (0.0010) [2023-12-26 01:54:32,677][123090] Updated weights for policy 1, policy_version 289848 (0.0009) [2023-12-26 01:54:33,085][123091] Updated weights for policy 0, policy_version 291258 (0.0008) [2023-12-26 01:54:33,136][123091] Updated weights for policy 0, policy_version 291269 (0.0010) [2023-12-26 01:54:33,186][123091] Updated weights for policy 0, policy_version 291280 (0.0010) [2023-12-26 01:54:33,485][123090] Updated weights for policy 1, policy_version 289858 (0.0009) [2023-12-26 01:54:33,529][123090] Updated weights for policy 1, policy_version 289868 (0.0006) [2023-12-26 01:54:33,582][123090] Updated weights for policy 1, policy_version 289878 (0.0009) [2023-12-26 01:54:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 148783104. Throughput: 0: 8714.4, 1: 8966.7. Samples: 148793704. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:33,786][121949] Avg episode reward: [(0, '6142.250'), (1, '5689.047')] [2023-12-26 01:54:34,028][123091] Updated weights for policy 0, policy_version 291290 (0.0009) [2023-12-26 01:54:34,075][123091] Updated weights for policy 0, policy_version 291300 (0.0009) [2023-12-26 01:54:34,137][123091] Updated weights for policy 0, policy_version 291310 (0.0009) [2023-12-26 01:54:34,431][123090] Updated weights for policy 1, policy_version 289889 (0.0007) [2023-12-26 01:54:34,496][123090] Updated weights for policy 1, policy_version 289899 (0.0009) [2023-12-26 01:54:34,554][123090] Updated weights for policy 1, policy_version 289909 (0.0009) [2023-12-26 01:54:34,612][123090] Updated weights for policy 1, policy_version 289919 (0.0009) [2023-12-26 01:54:34,963][123091] Updated weights for policy 0, policy_version 291320 (0.0010) [2023-12-26 01:54:35,030][123091] Updated weights for policy 0, policy_version 291330 (0.0010) [2023-12-26 01:54:35,087][123091] Updated weights for policy 0, policy_version 291340 (0.0009) [2023-12-26 01:54:35,433][123090] Updated weights for policy 1, policy_version 289929 (0.0008) [2023-12-26 01:54:35,497][123090] Updated weights for policy 1, policy_version 289939 (0.0009) [2023-12-26 01:54:35,567][123090] Updated weights for policy 1, policy_version 289949 (0.0009) [2023-12-26 01:54:35,907][123091] Updated weights for policy 0, policy_version 291350 (0.0009) [2023-12-26 01:54:35,961][123091] Updated weights for policy 0, policy_version 291360 (0.0009) [2023-12-26 01:54:36,012][123091] Updated weights for policy 0, policy_version 291370 (0.0010) [2023-12-26 01:54:36,312][123090] Updated weights for policy 1, policy_version 289959 (0.0008) [2023-12-26 01:54:36,375][123090] Updated weights for policy 1, policy_version 289969 (0.0008) [2023-12-26 01:54:36,437][123090] Updated weights for policy 1, policy_version 289979 (0.0008) [2023-12-26 01:54:36,877][123091] Updated weights for policy 0, policy_version 291380 (0.0009) [2023-12-26 01:54:36,938][123091] Updated weights for policy 0, policy_version 291390 (0.0010) [2023-12-26 01:54:36,991][123091] Updated weights for policy 0, policy_version 291400 (0.0010) [2023-12-26 01:54:37,224][123090] Updated weights for policy 1, policy_version 289989 (0.0009) [2023-12-26 01:54:37,284][123090] Updated weights for policy 1, policy_version 289999 (0.0010) [2023-12-26 01:54:37,347][123090] Updated weights for policy 1, policy_version 290009 (0.0011) [2023-12-26 01:54:37,768][123091] Updated weights for policy 0, policy_version 291410 (0.0009) [2023-12-26 01:54:37,821][123091] Updated weights for policy 0, policy_version 291420 (0.0008) [2023-12-26 01:54:37,886][123091] Updated weights for policy 0, policy_version 291430 (0.0010) [2023-12-26 01:54:37,937][123091] Updated weights for policy 0, policy_version 291440 (0.0008) [2023-12-26 01:54:38,184][123090] Updated weights for policy 1, policy_version 290019 (0.0010) [2023-12-26 01:54:38,248][123090] Updated weights for policy 1, policy_version 290029 (0.0009) [2023-12-26 01:54:38,308][123090] Updated weights for policy 1, policy_version 290039 (0.0009) [2023-12-26 01:54:38,758][123091] Updated weights for policy 0, policy_version 291450 (0.0007) [2023-12-26 01:54:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 148865024. Throughput: 0: 8720.5, 1: 8992.1. Samples: 148845420. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:38,785][121949] Avg episode reward: [(0, '6225.699'), (1, '5478.399')] [2023-12-26 01:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000290048_74252288.pth... [2023-12-26 01:54:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000288992_73981952.pth [2023-12-26 01:54:38,825][123091] Updated weights for policy 0, policy_version 291460 (0.0007) [2023-12-26 01:54:38,900][123091] Updated weights for policy 0, policy_version 291470 (0.0006) [2023-12-26 01:54:38,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000291472_74620928.pth... [2023-12-26 01:54:38,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000290448_74358784.pth [2023-12-26 01:54:39,116][123090] Updated weights for policy 1, policy_version 290049 (0.0009) [2023-12-26 01:54:39,168][123090] Updated weights for policy 1, policy_version 290059 (0.0007) [2023-12-26 01:54:39,216][123090] Updated weights for policy 1, policy_version 290069 (0.0010) [2023-12-26 01:54:39,280][123090] Updated weights for policy 1, policy_version 290079 (0.0007) [2023-12-26 01:54:39,611][123091] Updated weights for policy 0, policy_version 291480 (0.0010) [2023-12-26 01:54:39,682][123091] Updated weights for policy 0, policy_version 291490 (0.0011) [2023-12-26 01:54:39,745][123091] Updated weights for policy 0, policy_version 291500 (0.0011) [2023-12-26 01:54:40,132][123090] Updated weights for policy 1, policy_version 290089 (0.0010) [2023-12-26 01:54:40,188][123090] Updated weights for policy 1, policy_version 290099 (0.0008) [2023-12-26 01:54:40,251][123090] Updated weights for policy 1, policy_version 290109 (0.0006) [2023-12-26 01:54:40,499][123091] Updated weights for policy 0, policy_version 291510 (0.0008) [2023-12-26 01:54:40,565][123091] Updated weights for policy 0, policy_version 291520 (0.0005) [2023-12-26 01:54:40,642][123091] Updated weights for policy 0, policy_version 291530 (0.0005) [2023-12-26 01:54:40,948][123090] Updated weights for policy 1, policy_version 290119 (0.0009) [2023-12-26 01:54:41,006][123090] Updated weights for policy 1, policy_version 290129 (0.0010) [2023-12-26 01:54:41,077][123090] Updated weights for policy 1, policy_version 290139 (0.0008) [2023-12-26 01:54:41,227][123091] Updated weights for policy 0, policy_version 291540 (0.0006) [2023-12-26 01:54:41,298][123091] Updated weights for policy 0, policy_version 291550 (0.0007) [2023-12-26 01:54:41,370][123091] Updated weights for policy 0, policy_version 291560 (0.0011) [2023-12-26 01:54:41,897][123090] Updated weights for policy 1, policy_version 290149 (0.0011) [2023-12-26 01:54:41,959][123090] Updated weights for policy 1, policy_version 290159 (0.0006) [2023-12-26 01:54:42,028][123090] Updated weights for policy 1, policy_version 290169 (0.0010) [2023-12-26 01:54:42,139][123091] Updated weights for policy 0, policy_version 291570 (0.0011) [2023-12-26 01:54:42,199][123091] Updated weights for policy 0, policy_version 291580 (0.0010) [2023-12-26 01:54:42,263][123091] Updated weights for policy 0, policy_version 291590 (0.0011) [2023-12-26 01:54:42,324][123091] Updated weights for policy 0, policy_version 291600 (0.0011) [2023-12-26 01:54:42,774][123090] Updated weights for policy 1, policy_version 290179 (0.0009) [2023-12-26 01:54:42,847][123090] Updated weights for policy 1, policy_version 290189 (0.0006) [2023-12-26 01:54:42,913][123090] Updated weights for policy 1, policy_version 290199 (0.0005) [2023-12-26 01:54:43,155][123091] Updated weights for policy 0, policy_version 291610 (0.0010) [2023-12-26 01:54:43,216][123091] Updated weights for policy 0, policy_version 291620 (0.0010) [2023-12-26 01:54:43,279][123091] Updated weights for policy 0, policy_version 291630 (0.0010) [2023-12-26 01:54:43,535][123090] Updated weights for policy 1, policy_version 290209 (0.0006) [2023-12-26 01:54:43,582][123090] Updated weights for policy 1, policy_version 290219 (0.0005) [2023-12-26 01:54:43,630][123090] Updated weights for policy 1, policy_version 290229 (0.0005) [2023-12-26 01:54:43,691][123090] Updated weights for policy 1, policy_version 290239 (0.0005) [2023-12-26 01:54:43,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 148963328. Throughput: 0: 8801.3, 1: 8946.6. Samples: 148952664. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:43,784][121949] Avg episode reward: [(0, '6327.074'), (1, '5474.438')] [2023-12-26 01:54:44,038][123091] Updated weights for policy 0, policy_version 291640 (0.0010) [2023-12-26 01:54:44,089][123091] Updated weights for policy 0, policy_version 291650 (0.0010) [2023-12-26 01:54:44,137][123091] Updated weights for policy 0, policy_version 291660 (0.0010) [2023-12-26 01:54:44,423][123090] Updated weights for policy 1, policy_version 290249 (0.0008) [2023-12-26 01:54:44,480][123090] Updated weights for policy 1, policy_version 290259 (0.0007) [2023-12-26 01:54:44,547][123090] Updated weights for policy 1, policy_version 290269 (0.0006) [2023-12-26 01:54:44,972][123091] Updated weights for policy 0, policy_version 291670 (0.0007) [2023-12-26 01:54:45,036][123091] Updated weights for policy 0, policy_version 291680 (0.0006) [2023-12-26 01:54:45,102][123091] Updated weights for policy 0, policy_version 291690 (0.0006) [2023-12-26 01:54:45,283][123090] Updated weights for policy 1, policy_version 290279 (0.0007) [2023-12-26 01:54:45,350][123090] Updated weights for policy 1, policy_version 290289 (0.0006) [2023-12-26 01:54:45,417][123090] Updated weights for policy 1, policy_version 290299 (0.0006) [2023-12-26 01:54:45,838][123091] Updated weights for policy 0, policy_version 291700 (0.0007) [2023-12-26 01:54:45,896][123091] Updated weights for policy 0, policy_version 291710 (0.0010) [2023-12-26 01:54:45,958][123091] Updated weights for policy 0, policy_version 291720 (0.0010) [2023-12-26 01:54:46,091][123090] Updated weights for policy 1, policy_version 290309 (0.0007) [2023-12-26 01:54:46,143][123090] Updated weights for policy 1, policy_version 290319 (0.0008) [2023-12-26 01:54:46,201][123090] Updated weights for policy 1, policy_version 290329 (0.0009) [2023-12-26 01:54:46,774][123091] Updated weights for policy 0, policy_version 291730 (0.0010) [2023-12-26 01:54:46,839][123091] Updated weights for policy 0, policy_version 291740 (0.0010) [2023-12-26 01:54:46,846][123090] Updated weights for policy 1, policy_version 290339 (0.0005) [2023-12-26 01:54:46,901][123091] Updated weights for policy 0, policy_version 291750 (0.0010) [2023-12-26 01:54:46,910][123090] Updated weights for policy 1, policy_version 290349 (0.0010) [2023-12-26 01:54:46,963][123091] Updated weights for policy 0, policy_version 291760 (0.0010) [2023-12-26 01:54:46,970][123090] Updated weights for policy 1, policy_version 290359 (0.0006) [2023-12-26 01:54:47,782][123091] Updated weights for policy 0, policy_version 291770 (0.0010) [2023-12-26 01:54:47,799][123090] Updated weights for policy 1, policy_version 290369 (0.0009) [2023-12-26 01:54:47,839][123091] Updated weights for policy 0, policy_version 291780 (0.0010) [2023-12-26 01:54:47,851][123090] Updated weights for policy 1, policy_version 290379 (0.0007) [2023-12-26 01:54:47,897][123091] Updated weights for policy 0, policy_version 291790 (0.0010) [2023-12-26 01:54:47,905][123090] Updated weights for policy 1, policy_version 290389 (0.0007) [2023-12-26 01:54:47,972][123090] Updated weights for policy 1, policy_version 290399 (0.0009) [2023-12-26 01:54:48,712][123091] Updated weights for policy 0, policy_version 291800 (0.0010) [2023-12-26 01:54:48,772][123091] Updated weights for policy 0, policy_version 291810 (0.0011) [2023-12-26 01:54:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 149045248. Throughput: 0: 8781.8, 1: 9064.7. Samples: 149063456. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:48,785][121949] Avg episode reward: [(0, '6271.331'), (1, '5665.933')] [2023-12-26 01:54:48,792][123090] Updated weights for policy 1, policy_version 290409 (0.0010) [2023-12-26 01:54:48,827][123091] Updated weights for policy 0, policy_version 291820 (0.0010) [2023-12-26 01:54:48,850][123090] Updated weights for policy 1, policy_version 290419 (0.0010) [2023-12-26 01:54:48,919][123090] Updated weights for policy 1, policy_version 290429 (0.0009) [2023-12-26 01:54:49,651][123090] Updated weights for policy 1, policy_version 290439 (0.0009) [2023-12-26 01:54:49,670][123091] Updated weights for policy 0, policy_version 291830 (0.0011) [2023-12-26 01:54:49,716][123090] Updated weights for policy 1, policy_version 290449 (0.0011) [2023-12-26 01:54:49,734][123091] Updated weights for policy 0, policy_version 291840 (0.0011) [2023-12-26 01:54:49,780][123090] Updated weights for policy 1, policy_version 290459 (0.0010) [2023-12-26 01:54:49,798][123091] Updated weights for policy 0, policy_version 291850 (0.0011) [2023-12-26 01:54:50,496][123091] Updated weights for policy 0, policy_version 291860 (0.0011) [2023-12-26 01:54:50,527][123090] Updated weights for policy 1, policy_version 290469 (0.0007) [2023-12-26 01:54:50,544][123091] Updated weights for policy 0, policy_version 291870 (0.0010) [2023-12-26 01:54:50,594][123090] Updated weights for policy 1, policy_version 290479 (0.0007) [2023-12-26 01:54:50,610][123091] Updated weights for policy 0, policy_version 291880 (0.0009) [2023-12-26 01:54:50,663][123090] Updated weights for policy 1, policy_version 290489 (0.0008) [2023-12-26 01:54:51,364][123091] Updated weights for policy 0, policy_version 291890 (0.0009) [2023-12-26 01:54:51,424][123091] Updated weights for policy 0, policy_version 291900 (0.0008) [2023-12-26 01:54:51,472][123090] Updated weights for policy 1, policy_version 290499 (0.0009) [2023-12-26 01:54:51,493][123091] Updated weights for policy 0, policy_version 291910 (0.0008) [2023-12-26 01:54:51,530][123090] Updated weights for policy 1, policy_version 290509 (0.0009) [2023-12-26 01:54:51,555][123091] Updated weights for policy 0, policy_version 291920 (0.0008) [2023-12-26 01:54:51,590][123090] Updated weights for policy 1, policy_version 290519 (0.0008) [2023-12-26 01:54:52,321][123091] Updated weights for policy 0, policy_version 291930 (0.0009) [2023-12-26 01:54:52,387][123091] Updated weights for policy 0, policy_version 291940 (0.0010) [2023-12-26 01:54:52,452][123091] Updated weights for policy 0, policy_version 291950 (0.0010) [2023-12-26 01:54:52,481][123090] Updated weights for policy 1, policy_version 290529 (0.0007) [2023-12-26 01:54:52,541][123090] Updated weights for policy 1, policy_version 290539 (0.0010) [2023-12-26 01:54:52,608][123090] Updated weights for policy 1, policy_version 290549 (0.0009) [2023-12-26 01:54:52,673][123090] Updated weights for policy 1, policy_version 290559 (0.0010) [2023-12-26 01:54:53,319][123091] Updated weights for policy 0, policy_version 291960 (0.0009) [2023-12-26 01:54:53,334][123090] Updated weights for policy 1, policy_version 290569 (0.0007) [2023-12-26 01:54:53,376][123091] Updated weights for policy 0, policy_version 291970 (0.0005) [2023-12-26 01:54:53,403][123090] Updated weights for policy 1, policy_version 290579 (0.0009) [2023-12-26 01:54:53,441][123091] Updated weights for policy 0, policy_version 291980 (0.0005) [2023-12-26 01:54:53,455][123090] Updated weights for policy 1, policy_version 290589 (0.0008) [2023-12-26 01:54:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 149143552. Throughput: 0: 8786.3, 1: 9042.2. Samples: 149117180. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:53,785][121949] Avg episode reward: [(0, '6218.501'), (1, '5685.250')] [2023-12-26 01:54:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000291984_74752000.pth... [2023-12-26 01:54:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000290592_74391552.pth... [2023-12-26 01:54:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000289536_74121216.pth [2023-12-26 01:54:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000290960_74489856.pth [2023-12-26 01:54:54,099][123091] Updated weights for policy 0, policy_version 291990 (0.0006) [2023-12-26 01:54:54,129][123090] Updated weights for policy 1, policy_version 290599 (0.0010) [2023-12-26 01:54:54,157][123091] Updated weights for policy 0, policy_version 292000 (0.0005) [2023-12-26 01:54:54,186][123090] Updated weights for policy 1, policy_version 290609 (0.0008) [2023-12-26 01:54:54,221][123091] Updated weights for policy 0, policy_version 292010 (0.0010) [2023-12-26 01:54:54,247][123090] Updated weights for policy 1, policy_version 290619 (0.0007) [2023-12-26 01:54:54,865][123091] Updated weights for policy 0, policy_version 292020 (0.0006) [2023-12-26 01:54:54,927][123091] Updated weights for policy 0, policy_version 292030 (0.0007) [2023-12-26 01:54:54,992][123091] Updated weights for policy 0, policy_version 292040 (0.0010) [2023-12-26 01:54:55,079][123090] Updated weights for policy 1, policy_version 290629 (0.0009) [2023-12-26 01:54:55,141][123090] Updated weights for policy 1, policy_version 290639 (0.0006) [2023-12-26 01:54:55,200][123090] Updated weights for policy 1, policy_version 290649 (0.0009) [2023-12-26 01:54:55,697][123091] Updated weights for policy 0, policy_version 292050 (0.0009) [2023-12-26 01:54:55,746][123091] Updated weights for policy 0, policy_version 292060 (0.0005) [2023-12-26 01:54:55,792][123091] Updated weights for policy 0, policy_version 292070 (0.0005) [2023-12-26 01:54:55,847][123091] Updated weights for policy 0, policy_version 292080 (0.0005) [2023-12-26 01:54:55,905][123090] Updated weights for policy 1, policy_version 290659 (0.0009) [2023-12-26 01:54:55,972][123090] Updated weights for policy 1, policy_version 290669 (0.0005) [2023-12-26 01:54:56,033][123090] Updated weights for policy 1, policy_version 290679 (0.0006) [2023-12-26 01:54:56,607][123091] Updated weights for policy 0, policy_version 292090 (0.0011) [2023-12-26 01:54:56,666][123090] Updated weights for policy 1, policy_version 290689 (0.0006) [2023-12-26 01:54:56,669][123091] Updated weights for policy 0, policy_version 292100 (0.0010) [2023-12-26 01:54:56,722][123090] Updated weights for policy 1, policy_version 290700 (0.0007) [2023-12-26 01:54:56,735][123091] Updated weights for policy 0, policy_version 292110 (0.0010) [2023-12-26 01:54:56,774][123090] Updated weights for policy 1, policy_version 290710 (0.0005) [2023-12-26 01:54:56,830][123090] Updated weights for policy 1, policy_version 290720 (0.0005) [2023-12-26 01:54:57,498][123090] Updated weights for policy 1, policy_version 290730 (0.0006) [2023-12-26 01:54:57,505][123091] Updated weights for policy 0, policy_version 292120 (0.0008) [2023-12-26 01:54:57,556][123091] Updated weights for policy 0, policy_version 292130 (0.0006) [2023-12-26 01:54:57,562][123090] Updated weights for policy 1, policy_version 290740 (0.0009) [2023-12-26 01:54:57,613][123091] Updated weights for policy 0, policy_version 292140 (0.0006) [2023-12-26 01:54:57,623][123090] Updated weights for policy 1, policy_version 290750 (0.0009) [2023-12-26 01:54:58,350][123091] Updated weights for policy 0, policy_version 292150 (0.0008) [2023-12-26 01:54:58,423][123091] Updated weights for policy 0, policy_version 292160 (0.0008) [2023-12-26 01:54:58,479][123090] Updated weights for policy 1, policy_version 290760 (0.0008) [2023-12-26 01:54:58,498][123091] Updated weights for policy 0, policy_version 292170 (0.0006) [2023-12-26 01:54:58,558][123090] Updated weights for policy 1, policy_version 290770 (0.0008) [2023-12-26 01:54:58,628][123090] Updated weights for policy 1, policy_version 290780 (0.0009) [2023-12-26 01:54:58,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 149241856. Throughput: 0: 8873.9, 1: 9147.7. Samples: 149231952. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:54:58,785][121949] Avg episode reward: [(0, '6165.725'), (1, '5689.631')] [2023-12-26 01:54:59,355][123091] Updated weights for policy 0, policy_version 292180 (0.0008) [2023-12-26 01:54:59,421][123091] Updated weights for policy 0, policy_version 292190 (0.0010) [2023-12-26 01:54:59,461][123090] Updated weights for policy 1, policy_version 290790 (0.0009) [2023-12-26 01:54:59,485][123091] Updated weights for policy 0, policy_version 292200 (0.0009) [2023-12-26 01:54:59,518][123090] Updated weights for policy 1, policy_version 290800 (0.0008) [2023-12-26 01:54:59,588][123090] Updated weights for policy 1, policy_version 290810 (0.0009) [2023-12-26 01:55:00,267][123091] Updated weights for policy 0, policy_version 292210 (0.0007) [2023-12-26 01:55:00,316][123091] Updated weights for policy 0, policy_version 292220 (0.0005) [2023-12-26 01:55:00,369][123091] Updated weights for policy 0, policy_version 292230 (0.0005) [2023-12-26 01:55:00,424][123091] Updated weights for policy 0, policy_version 292240 (0.0005) [2023-12-26 01:55:00,472][123090] Updated weights for policy 1, policy_version 290820 (0.0007) [2023-12-26 01:55:00,533][123090] Updated weights for policy 1, policy_version 290830 (0.0005) [2023-12-26 01:55:00,596][123090] Updated weights for policy 1, policy_version 290841 (0.0009) [2023-12-26 01:55:01,116][123091] Updated weights for policy 0, policy_version 292250 (0.0007) [2023-12-26 01:55:01,187][123091] Updated weights for policy 0, policy_version 292260 (0.0006) [2023-12-26 01:55:01,245][123091] Updated weights for policy 0, policy_version 292270 (0.0009) [2023-12-26 01:55:01,458][123090] Updated weights for policy 1, policy_version 290851 (0.0008) [2023-12-26 01:55:01,531][123090] Updated weights for policy 1, policy_version 290861 (0.0005) [2023-12-26 01:55:01,607][123090] Updated weights for policy 1, policy_version 290871 (0.0006) [2023-12-26 01:55:01,982][123091] Updated weights for policy 0, policy_version 292280 (0.0011) [2023-12-26 01:55:02,038][123091] Updated weights for policy 0, policy_version 292290 (0.0010) [2023-12-26 01:55:02,092][123091] Updated weights for policy 0, policy_version 292300 (0.0010) [2023-12-26 01:55:02,201][123090] Updated weights for policy 1, policy_version 290881 (0.0007) [2023-12-26 01:55:02,274][123090] Updated weights for policy 1, policy_version 290891 (0.0008) [2023-12-26 01:55:02,335][123090] Updated weights for policy 1, policy_version 290901 (0.0010) [2023-12-26 01:55:02,399][123090] Updated weights for policy 1, policy_version 290911 (0.0011) [2023-12-26 01:55:02,905][123091] Updated weights for policy 0, policy_version 292310 (0.0010) [2023-12-26 01:55:02,956][123091] Updated weights for policy 0, policy_version 292321 (0.0010) [2023-12-26 01:55:03,011][123091] Updated weights for policy 0, policy_version 292331 (0.0010) [2023-12-26 01:55:03,127][123090] Updated weights for policy 1, policy_version 290921 (0.0006) [2023-12-26 01:55:03,176][123090] Updated weights for policy 1, policy_version 290931 (0.0006) [2023-12-26 01:55:03,240][123090] Updated weights for policy 1, policy_version 290941 (0.0007) [2023-12-26 01:55:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 149323776. Throughput: 0: 8866.3, 1: 9021.2. Samples: 149338552. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 01:55:03,785][121949] Avg episode reward: [(0, '6167.641'), (1, '5573.821')] [2023-12-26 01:55:03,908][123090] Updated weights for policy 1, policy_version 290951 (0.0006) [2023-12-26 01:55:03,967][123090] Updated weights for policy 1, policy_version 290961 (0.0006) [2023-12-26 01:55:03,971][123091] Updated weights for policy 0, policy_version 292341 (0.0009) [2023-12-26 01:55:04,031][123091] Updated weights for policy 0, policy_version 292351 (0.0007) [2023-12-26 01:55:04,033][123090] Updated weights for policy 1, policy_version 290971 (0.0010) [2023-12-26 01:55:04,086][123091] Updated weights for policy 0, policy_version 292361 (0.0008) [2023-12-26 01:55:04,794][123090] Updated weights for policy 1, policy_version 290981 (0.0007) [2023-12-26 01:55:04,867][123090] Updated weights for policy 1, policy_version 290991 (0.0005) [2023-12-26 01:55:04,936][123090] Updated weights for policy 1, policy_version 291001 (0.0008) [2023-12-26 01:55:04,951][123091] Updated weights for policy 0, policy_version 292371 (0.0009) [2023-12-26 01:55:05,002][123091] Updated weights for policy 0, policy_version 292381 (0.0009) [2023-12-26 01:55:05,055][123091] Updated weights for policy 0, policy_version 292391 (0.0009) [2023-12-26 01:55:05,684][123090] Updated weights for policy 1, policy_version 291011 (0.0010) [2023-12-26 01:55:05,754][123090] Updated weights for policy 1, policy_version 291021 (0.0011) [2023-12-26 01:55:05,821][123090] Updated weights for policy 1, policy_version 291031 (0.0010) [2023-12-26 01:55:05,922][123091] Updated weights for policy 0, policy_version 292402 (0.0010) [2023-12-26 01:55:05,969][123091] Updated weights for policy 0, policy_version 292412 (0.0008) [2023-12-26 01:55:06,018][123091] Updated weights for policy 0, policy_version 292422 (0.0009) [2023-12-26 01:55:06,078][123091] Updated weights for policy 0, policy_version 292432 (0.0009) [2023-12-26 01:55:06,628][123090] Updated weights for policy 1, policy_version 291041 (0.0011) [2023-12-26 01:55:06,691][123090] Updated weights for policy 1, policy_version 291051 (0.0010) [2023-12-26 01:55:06,759][123090] Updated weights for policy 1, policy_version 291061 (0.0008) [2023-12-26 01:55:06,831][123090] Updated weights for policy 1, policy_version 291071 (0.0009) [2023-12-26 01:55:06,955][123091] Updated weights for policy 0, policy_version 292442 (0.0009) [2023-12-26 01:55:07,016][123091] Updated weights for policy 0, policy_version 292452 (0.0009) [2023-12-26 01:55:07,082][123091] Updated weights for policy 0, policy_version 292462 (0.0009) [2023-12-26 01:55:07,626][123090] Updated weights for policy 1, policy_version 291081 (0.0005) [2023-12-26 01:55:07,674][123090] Updated weights for policy 1, policy_version 291091 (0.0005) [2023-12-26 01:55:07,721][123090] Updated weights for policy 1, policy_version 291101 (0.0005) [2023-12-26 01:55:07,971][123091] Updated weights for policy 0, policy_version 292472 (0.0009) [2023-12-26 01:55:08,034][123091] Updated weights for policy 0, policy_version 292482 (0.0007) [2023-12-26 01:55:08,083][123091] Updated weights for policy 0, policy_version 292492 (0.0009) [2023-12-26 01:55:08,497][123090] Updated weights for policy 1, policy_version 291111 (0.0008) [2023-12-26 01:55:08,557][123090] Updated weights for policy 1, policy_version 291121 (0.0009) [2023-12-26 01:55:08,629][123090] Updated weights for policy 1, policy_version 291131 (0.0008) [2023-12-26 01:55:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 149413888. Throughput: 0: 8852.0, 1: 9067.6. Samples: 149390120. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:08,785][121949] Avg episode reward: [(0, '6213.518'), (1, '5649.817')] [2023-12-26 01:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000292496_74883072.pth... [2023-12-26 01:55:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000291136_74530816.pth... [2023-12-26 01:55:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000290048_74252288.pth [2023-12-26 01:55:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000291472_74620928.pth [2023-12-26 01:55:08,888][123091] Updated weights for policy 0, policy_version 292502 (0.0009) [2023-12-26 01:55:08,941][123091] Updated weights for policy 0, policy_version 292512 (0.0011) [2023-12-26 01:55:09,011][123091] Updated weights for policy 0, policy_version 292522 (0.0010) [2023-12-26 01:55:09,451][123090] Updated weights for policy 1, policy_version 291141 (0.0009) [2023-12-26 01:55:09,521][123090] Updated weights for policy 1, policy_version 291151 (0.0009) [2023-12-26 01:55:09,596][123090] Updated weights for policy 1, policy_version 291161 (0.0006) [2023-12-26 01:55:09,810][123091] Updated weights for policy 0, policy_version 292532 (0.0009) [2023-12-26 01:55:09,890][123091] Updated weights for policy 0, policy_version 292542 (0.0011) [2023-12-26 01:55:09,958][123091] Updated weights for policy 0, policy_version 292552 (0.0009) [2023-12-26 01:55:10,384][123090] Updated weights for policy 1, policy_version 291171 (0.0007) [2023-12-26 01:55:10,442][123090] Updated weights for policy 1, policy_version 291181 (0.0008) [2023-12-26 01:55:10,498][123090] Updated weights for policy 1, policy_version 291191 (0.0009) [2023-12-26 01:55:10,718][123091] Updated weights for policy 0, policy_version 292562 (0.0008) [2023-12-26 01:55:10,780][123091] Updated weights for policy 0, policy_version 292572 (0.0010) [2023-12-26 01:55:10,851][123091] Updated weights for policy 0, policy_version 292582 (0.0007) [2023-12-26 01:55:10,911][123091] Updated weights for policy 0, policy_version 292592 (0.0010) [2023-12-26 01:55:11,323][123090] Updated weights for policy 1, policy_version 291201 (0.0008) [2023-12-26 01:55:11,395][123090] Updated weights for policy 1, policy_version 291211 (0.0008) [2023-12-26 01:55:11,464][123090] Updated weights for policy 1, policy_version 291221 (0.0010) [2023-12-26 01:55:11,532][123090] Updated weights for policy 1, policy_version 291231 (0.0009) [2023-12-26 01:55:11,704][123091] Updated weights for policy 0, policy_version 292602 (0.0007) [2023-12-26 01:55:11,773][123091] Updated weights for policy 0, policy_version 292612 (0.0007) [2023-12-26 01:55:11,846][123091] Updated weights for policy 0, policy_version 292622 (0.0006) [2023-12-26 01:55:12,389][123090] Updated weights for policy 1, policy_version 291241 (0.0009) [2023-12-26 01:55:12,448][123090] Updated weights for policy 1, policy_version 291251 (0.0008) [2023-12-26 01:55:12,500][123090] Updated weights for policy 1, policy_version 291261 (0.0008) [2023-12-26 01:55:12,573][123091] Updated weights for policy 0, policy_version 292632 (0.0010) [2023-12-26 01:55:12,641][123091] Updated weights for policy 0, policy_version 292642 (0.0010) [2023-12-26 01:55:12,704][123091] Updated weights for policy 0, policy_version 292652 (0.0010) [2023-12-26 01:55:13,290][123090] Updated weights for policy 1, policy_version 291271 (0.0009) [2023-12-26 01:55:13,352][123090] Updated weights for policy 1, policy_version 291281 (0.0009) [2023-12-26 01:55:13,420][123090] Updated weights for policy 1, policy_version 291291 (0.0008) [2023-12-26 01:55:13,527][123091] Updated weights for policy 0, policy_version 292662 (0.0007) [2023-12-26 01:55:13,581][123091] Updated weights for policy 0, policy_version 292672 (0.0005) [2023-12-26 01:55:13,626][123091] Updated weights for policy 0, policy_version 292682 (0.0005) [2023-12-26 01:55:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 149504000. Throughput: 0: 8901.8, 1: 8997.7. Samples: 149494316. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:13,785][121949] Avg episode reward: [(0, '6320.594'), (1, '5667.553')] [2023-12-26 01:55:14,277][123090] Updated weights for policy 1, policy_version 291301 (0.0008) [2023-12-26 01:55:14,328][123090] Updated weights for policy 1, policy_version 291311 (0.0009) [2023-12-26 01:55:14,369][123091] Updated weights for policy 0, policy_version 292692 (0.0008) [2023-12-26 01:55:14,399][123090] Updated weights for policy 1, policy_version 291321 (0.0008) [2023-12-26 01:55:14,422][123091] Updated weights for policy 0, policy_version 292702 (0.0010) [2023-12-26 01:55:14,480][123091] Updated weights for policy 0, policy_version 292712 (0.0008) [2023-12-26 01:55:15,230][123090] Updated weights for policy 1, policy_version 291331 (0.0007) [2023-12-26 01:55:15,238][123091] Updated weights for policy 0, policy_version 292722 (0.0009) [2023-12-26 01:55:15,291][123090] Updated weights for policy 1, policy_version 291341 (0.0006) [2023-12-26 01:55:15,308][123091] Updated weights for policy 0, policy_version 292732 (0.0006) [2023-12-26 01:55:15,358][123090] Updated weights for policy 1, policy_version 291351 (0.0006) [2023-12-26 01:55:15,373][123091] Updated weights for policy 0, policy_version 292742 (0.0011) [2023-12-26 01:55:15,440][123091] Updated weights for policy 0, policy_version 292752 (0.0011) [2023-12-26 01:55:16,088][123090] Updated weights for policy 1, policy_version 291361 (0.0006) [2023-12-26 01:55:16,136][123090] Updated weights for policy 1, policy_version 291371 (0.0009) [2023-12-26 01:55:16,198][123090] Updated weights for policy 1, policy_version 291381 (0.0009) [2023-12-26 01:55:16,211][123091] Updated weights for policy 0, policy_version 292762 (0.0009) [2023-12-26 01:55:16,262][123090] Updated weights for policy 1, policy_version 291391 (0.0009) [2023-12-26 01:55:16,277][123091] Updated weights for policy 0, policy_version 292772 (0.0007) [2023-12-26 01:55:16,347][123091] Updated weights for policy 0, policy_version 292782 (0.0011) [2023-12-26 01:55:17,026][123091] Updated weights for policy 0, policy_version 292792 (0.0006) [2023-12-26 01:55:17,074][123091] Updated weights for policy 0, policy_version 292802 (0.0005) [2023-12-26 01:55:17,120][123090] Updated weights for policy 1, policy_version 291401 (0.0010) [2023-12-26 01:55:17,123][123091] Updated weights for policy 0, policy_version 292812 (0.0005) [2023-12-26 01:55:17,175][123090] Updated weights for policy 1, policy_version 291411 (0.0010) [2023-12-26 01:55:17,219][123090] Updated weights for policy 1, policy_version 291421 (0.0010) [2023-12-26 01:55:17,888][123091] Updated weights for policy 0, policy_version 292822 (0.0007) [2023-12-26 01:55:17,943][123091] Updated weights for policy 0, policy_version 292832 (0.0009) [2023-12-26 01:55:17,994][123091] Updated weights for policy 0, policy_version 292843 (0.0009) [2023-12-26 01:55:18,059][123090] Updated weights for policy 1, policy_version 291431 (0.0007) [2023-12-26 01:55:18,124][123090] Updated weights for policy 1, policy_version 291441 (0.0006) [2023-12-26 01:55:18,182][123090] Updated weights for policy 1, policy_version 291451 (0.0005) [2023-12-26 01:55:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 149585920. Throughput: 0: 8936.5, 1: 9017.5. Samples: 149601628. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:18,785][121949] Avg episode reward: [(0, '6263.805'), (1, '5666.107')] [2023-12-26 01:55:18,904][123091] Updated weights for policy 0, policy_version 292853 (0.0010) [2023-12-26 01:55:18,915][123090] Updated weights for policy 1, policy_version 291461 (0.0006) [2023-12-26 01:55:18,961][123091] Updated weights for policy 0, policy_version 292863 (0.0009) [2023-12-26 01:55:18,982][123090] Updated weights for policy 1, policy_version 291471 (0.0007) [2023-12-26 01:55:19,017][123091] Updated weights for policy 0, policy_version 292873 (0.0009) [2023-12-26 01:55:19,045][123090] Updated weights for policy 1, policy_version 291481 (0.0007) [2023-12-26 01:55:19,850][123090] Updated weights for policy 1, policy_version 291491 (0.0009) [2023-12-26 01:55:19,902][123091] Updated weights for policy 0, policy_version 292883 (0.0009) [2023-12-26 01:55:19,924][123090] Updated weights for policy 1, policy_version 291501 (0.0009) [2023-12-26 01:55:19,970][123091] Updated weights for policy 0, policy_version 292893 (0.0008) [2023-12-26 01:55:19,985][123090] Updated weights for policy 1, policy_version 291511 (0.0007) [2023-12-26 01:55:20,037][123091] Updated weights for policy 0, policy_version 292903 (0.0007) [2023-12-26 01:55:20,814][123090] Updated weights for policy 1, policy_version 291521 (0.0010) [2023-12-26 01:55:20,886][123090] Updated weights for policy 1, policy_version 291531 (0.0010) [2023-12-26 01:55:20,886][123091] Updated weights for policy 0, policy_version 292913 (0.0010) [2023-12-26 01:55:20,952][123090] Updated weights for policy 1, policy_version 291541 (0.0009) [2023-12-26 01:55:20,953][123091] Updated weights for policy 0, policy_version 292923 (0.0008) [2023-12-26 01:55:21,020][123091] Updated weights for policy 0, policy_version 292933 (0.0008) [2023-12-26 01:55:21,021][123090] Updated weights for policy 1, policy_version 291551 (0.0009) [2023-12-26 01:55:21,094][123091] Updated weights for policy 0, policy_version 292943 (0.0009) [2023-12-26 01:55:21,856][123090] Updated weights for policy 1, policy_version 291561 (0.0007) [2023-12-26 01:55:21,920][123090] Updated weights for policy 1, policy_version 291571 (0.0009) [2023-12-26 01:55:21,941][123091] Updated weights for policy 0, policy_version 292953 (0.0008) [2023-12-26 01:55:21,979][123090] Updated weights for policy 1, policy_version 291581 (0.0008) [2023-12-26 01:55:21,995][123091] Updated weights for policy 0, policy_version 292963 (0.0009) [2023-12-26 01:55:22,053][123091] Updated weights for policy 0, policy_version 292974 (0.0009) [2023-12-26 01:55:22,749][123090] Updated weights for policy 1, policy_version 291591 (0.0009) [2023-12-26 01:55:22,816][123090] Updated weights for policy 1, policy_version 291601 (0.0005) [2023-12-26 01:55:22,876][123090] Updated weights for policy 1, policy_version 291611 (0.0006) [2023-12-26 01:55:22,960][123091] Updated weights for policy 0, policy_version 292984 (0.0009) [2023-12-26 01:55:23,021][123091] Updated weights for policy 0, policy_version 292994 (0.0010) [2023-12-26 01:55:23,074][123091] Updated weights for policy 0, policy_version 293004 (0.0010) [2023-12-26 01:55:23,612][123090] Updated weights for policy 1, policy_version 291621 (0.0006) [2023-12-26 01:55:23,681][123090] Updated weights for policy 1, policy_version 291631 (0.0007) [2023-12-26 01:55:23,756][123090] Updated weights for policy 1, policy_version 291641 (0.0006) [2023-12-26 01:55:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 149667840. Throughput: 0: 8903.5, 1: 9009.7. Samples: 149651516. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:23,785][121949] Avg episode reward: [(0, '6276.268'), (1, '5653.654')] [2023-12-26 01:55:23,796][123091] Updated weights for policy 0, policy_version 293014 (0.0009) [2023-12-26 01:55:23,800][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000291648_74661888.pth... [2023-12-26 01:55:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000290592_74391552.pth [2023-12-26 01:55:23,848][123091] Updated weights for policy 0, policy_version 293024 (0.0009) [2023-12-26 01:55:23,912][123091] Updated weights for policy 0, policy_version 293034 (0.0009) [2023-12-26 01:55:23,952][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000293040_75022336.pth... [2023-12-26 01:55:23,956][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000291984_74752000.pth [2023-12-26 01:55:24,436][123090] Updated weights for policy 1, policy_version 291651 (0.0007) [2023-12-26 01:55:24,501][123090] Updated weights for policy 1, policy_version 291661 (0.0007) [2023-12-26 01:55:24,567][123090] Updated weights for policy 1, policy_version 291671 (0.0007) [2023-12-26 01:55:24,768][123091] Updated weights for policy 0, policy_version 293044 (0.0010) [2023-12-26 01:55:24,829][123091] Updated weights for policy 0, policy_version 293054 (0.0010) [2023-12-26 01:55:24,880][123091] Updated weights for policy 0, policy_version 293064 (0.0010) [2023-12-26 01:55:25,282][123090] Updated weights for policy 1, policy_version 291681 (0.0009) [2023-12-26 01:55:25,349][123090] Updated weights for policy 1, policy_version 291691 (0.0005) [2023-12-26 01:55:25,404][123090] Updated weights for policy 1, policy_version 291701 (0.0005) [2023-12-26 01:55:25,459][123090] Updated weights for policy 1, policy_version 291711 (0.0005) [2023-12-26 01:55:25,741][123091] Updated weights for policy 0, policy_version 293074 (0.0009) [2023-12-26 01:55:25,792][123091] Updated weights for policy 0, policy_version 293084 (0.0010) [2023-12-26 01:55:25,843][123091] Updated weights for policy 0, policy_version 293094 (0.0009) [2023-12-26 01:55:26,115][123090] Updated weights for policy 1, policy_version 291721 (0.0005) [2023-12-26 01:55:26,171][123090] Updated weights for policy 1, policy_version 291731 (0.0006) [2023-12-26 01:55:26,240][123090] Updated weights for policy 1, policy_version 291741 (0.0009) [2023-12-26 01:55:26,753][123091] Updated weights for policy 0, policy_version 293105 (0.0010) [2023-12-26 01:55:26,821][123091] Updated weights for policy 0, policy_version 293115 (0.0010) [2023-12-26 01:55:26,885][123091] Updated weights for policy 0, policy_version 293125 (0.0009) [2023-12-26 01:55:26,941][123091] Updated weights for policy 0, policy_version 293135 (0.0009) [2023-12-26 01:55:26,983][123090] Updated weights for policy 1, policy_version 291751 (0.0010) [2023-12-26 01:55:27,050][123090] Updated weights for policy 1, policy_version 291761 (0.0009) [2023-12-26 01:55:27,114][123090] Updated weights for policy 1, policy_version 291771 (0.0010) [2023-12-26 01:55:27,722][123091] Updated weights for policy 0, policy_version 293145 (0.0009) [2023-12-26 01:55:27,770][123091] Updated weights for policy 0, policy_version 293155 (0.0009) [2023-12-26 01:55:27,830][123091] Updated weights for policy 0, policy_version 293166 (0.0009) [2023-12-26 01:55:27,949][123090] Updated weights for policy 1, policy_version 291781 (0.0010) [2023-12-26 01:55:28,014][123090] Updated weights for policy 1, policy_version 291791 (0.0009) [2023-12-26 01:55:28,078][123090] Updated weights for policy 1, policy_version 291801 (0.0007) [2023-12-26 01:55:28,711][123091] Updated weights for policy 0, policy_version 293176 (0.0010) [2023-12-26 01:55:28,769][123091] Updated weights for policy 0, policy_version 293186 (0.0009) [2023-12-26 01:55:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 149757952. Throughput: 0: 8820.5, 1: 9090.3. Samples: 149758652. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:28,784][121949] Avg episode reward: [(0, '6269.770'), (1, '5616.457')] [2023-12-26 01:55:28,826][123091] Updated weights for policy 0, policy_version 293196 (0.0009) [2023-12-26 01:55:28,831][123090] Updated weights for policy 1, policy_version 291811 (0.0007) [2023-12-26 01:55:28,890][123090] Updated weights for policy 1, policy_version 291821 (0.0009) [2023-12-26 01:55:28,947][123090] Updated weights for policy 1, policy_version 291831 (0.0010) [2023-12-26 01:55:29,660][123091] Updated weights for policy 0, policy_version 293206 (0.0009) [2023-12-26 01:55:29,712][123091] Updated weights for policy 0, policy_version 293216 (0.0009) [2023-12-26 01:55:29,761][123091] Updated weights for policy 0, policy_version 293226 (0.0009) [2023-12-26 01:55:29,816][123090] Updated weights for policy 1, policy_version 291841 (0.0009) [2023-12-26 01:55:29,891][123090] Updated weights for policy 1, policy_version 291851 (0.0010) [2023-12-26 01:55:29,961][123090] Updated weights for policy 1, policy_version 291861 (0.0010) [2023-12-26 01:55:30,034][123090] Updated weights for policy 1, policy_version 291871 (0.0010) [2023-12-26 01:55:30,559][123091] Updated weights for policy 0, policy_version 293236 (0.0007) [2023-12-26 01:55:30,609][123091] Updated weights for policy 0, policy_version 293246 (0.0005) [2023-12-26 01:55:30,655][123091] Updated weights for policy 0, policy_version 293256 (0.0005) [2023-12-26 01:55:30,876][123090] Updated weights for policy 1, policy_version 291881 (0.0010) [2023-12-26 01:55:30,927][123090] Updated weights for policy 1, policy_version 291891 (0.0010) [2023-12-26 01:55:30,986][123090] Updated weights for policy 1, policy_version 291901 (0.0010) [2023-12-26 01:55:31,483][123091] Updated weights for policy 0, policy_version 293266 (0.0005) [2023-12-26 01:55:31,533][123091] Updated weights for policy 0, policy_version 293276 (0.0005) [2023-12-26 01:55:31,579][123091] Updated weights for policy 0, policy_version 293286 (0.0005) [2023-12-26 01:55:31,642][123091] Updated weights for policy 0, policy_version 293296 (0.0006) [2023-12-26 01:55:31,759][123090] Updated weights for policy 1, policy_version 291911 (0.0010) [2023-12-26 01:55:31,823][123090] Updated weights for policy 1, policy_version 291921 (0.0010) [2023-12-26 01:55:31,888][123090] Updated weights for policy 1, policy_version 291931 (0.0009) [2023-12-26 01:55:32,266][123091] Updated weights for policy 0, policy_version 293306 (0.0006) [2023-12-26 01:55:32,329][123091] Updated weights for policy 0, policy_version 293316 (0.0007) [2023-12-26 01:55:32,395][123091] Updated weights for policy 0, policy_version 293326 (0.0009) [2023-12-26 01:55:32,748][123090] Updated weights for policy 1, policy_version 291941 (0.0010) [2023-12-26 01:55:32,802][123090] Updated weights for policy 1, policy_version 291951 (0.0010) [2023-12-26 01:55:32,855][123090] Updated weights for policy 1, policy_version 291962 (0.0010) [2023-12-26 01:55:33,097][123091] Updated weights for policy 0, policy_version 293336 (0.0010) [2023-12-26 01:55:33,156][123091] Updated weights for policy 0, policy_version 293346 (0.0011) [2023-12-26 01:55:33,217][123091] Updated weights for policy 0, policy_version 293356 (0.0010) [2023-12-26 01:55:33,710][123090] Updated weights for policy 1, policy_version 291972 (0.0010) [2023-12-26 01:55:33,771][123090] Updated weights for policy 1, policy_version 291982 (0.0009) [2023-12-26 01:55:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 149848064. Throughput: 0: 8861.0, 1: 8947.8. Samples: 149864848. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:33,785][121949] Avg episode reward: [(0, '6205.226'), (1, '5678.666')] [2023-12-26 01:55:33,833][123090] Updated weights for policy 1, policy_version 291992 (0.0009) [2023-12-26 01:55:34,024][123091] Updated weights for policy 0, policy_version 293366 (0.0008) [2023-12-26 01:55:34,076][123091] Updated weights for policy 0, policy_version 293376 (0.0005) [2023-12-26 01:55:34,146][123091] Updated weights for policy 0, policy_version 293386 (0.0006) [2023-12-26 01:55:34,659][123090] Updated weights for policy 1, policy_version 292002 (0.0008) [2023-12-26 01:55:34,721][123090] Updated weights for policy 1, policy_version 292012 (0.0010) [2023-12-26 01:55:34,780][123090] Updated weights for policy 1, policy_version 292022 (0.0010) [2023-12-26 01:55:34,835][123090] Updated weights for policy 1, policy_version 292032 (0.0009) [2023-12-26 01:55:34,899][123091] Updated weights for policy 0, policy_version 293396 (0.0007) [2023-12-26 01:55:34,966][123091] Updated weights for policy 0, policy_version 293406 (0.0005) [2023-12-26 01:55:35,034][123091] Updated weights for policy 0, policy_version 293416 (0.0006) [2023-12-26 01:55:35,623][123091] Updated weights for policy 0, policy_version 293426 (0.0006) [2023-12-26 01:55:35,684][123091] Updated weights for policy 0, policy_version 293436 (0.0010) [2023-12-26 01:55:35,728][123090] Updated weights for policy 1, policy_version 292042 (0.0006) [2023-12-26 01:55:35,747][123091] Updated weights for policy 0, policy_version 293446 (0.0011) [2023-12-26 01:55:35,791][123090] Updated weights for policy 1, policy_version 292052 (0.0006) [2023-12-26 01:55:35,809][123091] Updated weights for policy 0, policy_version 293456 (0.0011) [2023-12-26 01:55:35,857][123090] Updated weights for policy 1, policy_version 292062 (0.0009) [2023-12-26 01:55:36,633][123091] Updated weights for policy 0, policy_version 293466 (0.0009) [2023-12-26 01:55:36,681][123090] Updated weights for policy 1, policy_version 292072 (0.0007) [2023-12-26 01:55:36,695][123091] Updated weights for policy 0, policy_version 293476 (0.0010) [2023-12-26 01:55:36,744][123090] Updated weights for policy 1, policy_version 292082 (0.0009) [2023-12-26 01:55:36,764][123091] Updated weights for policy 0, policy_version 293486 (0.0007) [2023-12-26 01:55:36,812][123090] Updated weights for policy 1, policy_version 292092 (0.0010) [2023-12-26 01:55:37,604][123091] Updated weights for policy 0, policy_version 293496 (0.0006) [2023-12-26 01:55:37,668][123090] Updated weights for policy 1, policy_version 292102 (0.0009) [2023-12-26 01:55:37,670][123091] Updated weights for policy 0, policy_version 293506 (0.0006) [2023-12-26 01:55:37,731][123091] Updated weights for policy 0, policy_version 293516 (0.0006) [2023-12-26 01:55:37,737][123090] Updated weights for policy 1, policy_version 292112 (0.0008) [2023-12-26 01:55:37,799][123090] Updated weights for policy 1, policy_version 292122 (0.0007) [2023-12-26 01:55:38,453][123091] Updated weights for policy 0, policy_version 293526 (0.0008) [2023-12-26 01:55:38,512][123091] Updated weights for policy 0, policy_version 293536 (0.0009) [2023-12-26 01:55:38,582][123091] Updated weights for policy 0, policy_version 293546 (0.0010) [2023-12-26 01:55:38,648][123090] Updated weights for policy 1, policy_version 292132 (0.0009) [2023-12-26 01:55:38,721][123090] Updated weights for policy 1, policy_version 292142 (0.0009) [2023-12-26 01:55:38,783][123090] Updated weights for policy 1, policy_version 292152 (0.0010) [2023-12-26 01:55:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 149938176. Throughput: 0: 8880.6, 1: 8903.6. Samples: 149917468. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:38,785][121949] Avg episode reward: [(0, '6213.440'), (1, '5711.627')] [2023-12-26 01:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000293552_75153408.pth... [2023-12-26 01:55:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000292496_74883072.pth [2023-12-26 01:55:38,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000292160_74792960.pth... [2023-12-26 01:55:38,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000291136_74530816.pth [2023-12-26 01:55:39,400][123091] Updated weights for policy 0, policy_version 293556 (0.0008) [2023-12-26 01:55:39,470][123091] Updated weights for policy 0, policy_version 293566 (0.0010) [2023-12-26 01:55:39,535][123091] Updated weights for policy 0, policy_version 293576 (0.0009) [2023-12-26 01:55:39,607][123090] Updated weights for policy 1, policy_version 292162 (0.0009) [2023-12-26 01:55:39,667][123090] Updated weights for policy 1, policy_version 292172 (0.0009) [2023-12-26 01:55:39,733][123090] Updated weights for policy 1, policy_version 292182 (0.0010) [2023-12-26 01:55:39,806][123090] Updated weights for policy 1, policy_version 292192 (0.0010) [2023-12-26 01:55:40,336][123091] Updated weights for policy 0, policy_version 293586 (0.0009) [2023-12-26 01:55:40,397][123091] Updated weights for policy 0, policy_version 293596 (0.0007) [2023-12-26 01:55:40,450][123091] Updated weights for policy 0, policy_version 293606 (0.0008) [2023-12-26 01:55:40,508][123091] Updated weights for policy 0, policy_version 293616 (0.0010) [2023-12-26 01:55:40,666][123090] Updated weights for policy 1, policy_version 292202 (0.0009) [2023-12-26 01:55:40,736][123090] Updated weights for policy 1, policy_version 292212 (0.0010) [2023-12-26 01:55:40,805][123090] Updated weights for policy 1, policy_version 292222 (0.0009) [2023-12-26 01:55:41,254][123091] Updated weights for policy 0, policy_version 293626 (0.0009) [2023-12-26 01:55:41,320][123091] Updated weights for policy 0, policy_version 293636 (0.0009) [2023-12-26 01:55:41,388][123091] Updated weights for policy 0, policy_version 293646 (0.0009) [2023-12-26 01:55:41,626][123090] Updated weights for policy 1, policy_version 292232 (0.0009) [2023-12-26 01:55:41,698][123090] Updated weights for policy 1, policy_version 292242 (0.0009) [2023-12-26 01:55:41,765][123090] Updated weights for policy 1, policy_version 292252 (0.0008) [2023-12-26 01:55:42,241][123091] Updated weights for policy 0, policy_version 293656 (0.0010) [2023-12-26 01:55:42,312][123091] Updated weights for policy 0, policy_version 293666 (0.0007) [2023-12-26 01:55:42,383][123091] Updated weights for policy 0, policy_version 293676 (0.0009) [2023-12-26 01:55:42,612][123090] Updated weights for policy 1, policy_version 292262 (0.0010) [2023-12-26 01:55:42,678][123090] Updated weights for policy 1, policy_version 292272 (0.0009) [2023-12-26 01:55:42,745][123090] Updated weights for policy 1, policy_version 292282 (0.0009) [2023-12-26 01:55:43,132][123091] Updated weights for policy 0, policy_version 293686 (0.0007) [2023-12-26 01:55:43,187][123091] Updated weights for policy 0, policy_version 293696 (0.0005) [2023-12-26 01:55:43,247][123091] Updated weights for policy 0, policy_version 293706 (0.0005) [2023-12-26 01:55:43,625][123090] Updated weights for policy 1, policy_version 292292 (0.0009) [2023-12-26 01:55:43,668][123090] Updated weights for policy 1, policy_version 292302 (0.0010) [2023-12-26 01:55:43,727][123090] Updated weights for policy 1, policy_version 292312 (0.0010) [2023-12-26 01:55:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 150028288. Throughput: 0: 8801.2, 1: 8709.8. Samples: 150019944. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:43,785][121949] Avg episode reward: [(0, '6155.170'), (1, '5721.907')] [2023-12-26 01:55:43,886][123091] Updated weights for policy 0, policy_version 293716 (0.0005) [2023-12-26 01:55:43,931][123091] Updated weights for policy 0, policy_version 293726 (0.0005) [2023-12-26 01:55:43,979][123091] Updated weights for policy 0, policy_version 293736 (0.0005) [2023-12-26 01:55:44,480][123090] Updated weights for policy 1, policy_version 292322 (0.0010) [2023-12-26 01:55:44,542][123090] Updated weights for policy 1, policy_version 292332 (0.0008) [2023-12-26 01:55:44,609][123090] Updated weights for policy 1, policy_version 292342 (0.0008) [2023-12-26 01:55:44,672][123090] Updated weights for policy 1, policy_version 292352 (0.0008) [2023-12-26 01:55:44,736][123091] Updated weights for policy 0, policy_version 293746 (0.0006) [2023-12-26 01:55:44,819][123091] Updated weights for policy 0, policy_version 293756 (0.0008) [2023-12-26 01:55:44,888][123091] Updated weights for policy 0, policy_version 293766 (0.0009) [2023-12-26 01:55:44,953][123091] Updated weights for policy 0, policy_version 293776 (0.0009) [2023-12-26 01:55:45,503][123090] Updated weights for policy 1, policy_version 292362 (0.0011) [2023-12-26 01:55:45,562][123090] Updated weights for policy 1, policy_version 292372 (0.0010) [2023-12-26 01:55:45,618][123090] Updated weights for policy 1, policy_version 292382 (0.0010) [2023-12-26 01:55:45,731][123091] Updated weights for policy 0, policy_version 293786 (0.0010) [2023-12-26 01:55:45,782][123091] Updated weights for policy 0, policy_version 293796 (0.0010) [2023-12-26 01:55:45,836][123091] Updated weights for policy 0, policy_version 293806 (0.0010) [2023-12-26 01:55:46,456][123090] Updated weights for policy 1, policy_version 292392 (0.0010) [2023-12-26 01:55:46,514][123090] Updated weights for policy 1, policy_version 292402 (0.0010) [2023-12-26 01:55:46,568][123090] Updated weights for policy 1, policy_version 292412 (0.0010) [2023-12-26 01:55:46,606][123091] Updated weights for policy 0, policy_version 293816 (0.0010) [2023-12-26 01:55:46,650][123091] Updated weights for policy 0, policy_version 293826 (0.0010) [2023-12-26 01:55:46,697][123091] Updated weights for policy 0, policy_version 293836 (0.0010) [2023-12-26 01:55:47,336][123090] Updated weights for policy 1, policy_version 292422 (0.0008) [2023-12-26 01:55:47,396][123090] Updated weights for policy 1, policy_version 292432 (0.0008) [2023-12-26 01:55:47,460][123090] Updated weights for policy 1, policy_version 292442 (0.0009) [2023-12-26 01:55:47,541][123091] Updated weights for policy 0, policy_version 293846 (0.0010) [2023-12-26 01:55:47,600][123091] Updated weights for policy 0, policy_version 293856 (0.0010) [2023-12-26 01:55:47,647][123091] Updated weights for policy 0, policy_version 293866 (0.0010) [2023-12-26 01:55:48,194][123090] Updated weights for policy 1, policy_version 292452 (0.0008) [2023-12-26 01:55:48,244][123090] Updated weights for policy 1, policy_version 292462 (0.0005) [2023-12-26 01:55:48,303][123090] Updated weights for policy 1, policy_version 292472 (0.0005) [2023-12-26 01:55:48,488][123091] Updated weights for policy 0, policy_version 293876 (0.0010) [2023-12-26 01:55:48,550][123091] Updated weights for policy 0, policy_version 293886 (0.0011) [2023-12-26 01:55:48,614][123091] Updated weights for policy 0, policy_version 293896 (0.0010) [2023-12-26 01:55:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 150118400. Throughput: 0: 8831.1, 1: 8713.7. Samples: 150128064. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:48,785][121949] Avg episode reward: [(0, '6187.794'), (1, '5678.743')] [2023-12-26 01:55:49,041][123090] Updated weights for policy 1, policy_version 292482 (0.0007) [2023-12-26 01:55:49,100][123090] Updated weights for policy 1, policy_version 292492 (0.0005) [2023-12-26 01:55:49,154][123090] Updated weights for policy 1, policy_version 292502 (0.0006) [2023-12-26 01:55:49,225][123090] Updated weights for policy 1, policy_version 292512 (0.0011) [2023-12-26 01:55:49,390][123091] Updated weights for policy 0, policy_version 293906 (0.0010) [2023-12-26 01:55:49,449][123091] Updated weights for policy 0, policy_version 293916 (0.0010) [2023-12-26 01:55:49,517][123091] Updated weights for policy 0, policy_version 293926 (0.0011) [2023-12-26 01:55:49,579][123091] Updated weights for policy 0, policy_version 293936 (0.0010) [2023-12-26 01:55:50,031][123090] Updated weights for policy 1, policy_version 292522 (0.0009) [2023-12-26 01:55:50,093][123090] Updated weights for policy 1, policy_version 292532 (0.0005) [2023-12-26 01:55:50,145][123090] Updated weights for policy 1, policy_version 292542 (0.0005) [2023-12-26 01:55:50,406][123091] Updated weights for policy 0, policy_version 293946 (0.0010) [2023-12-26 01:55:50,469][123091] Updated weights for policy 0, policy_version 293956 (0.0010) [2023-12-26 01:55:50,535][123091] Updated weights for policy 0, policy_version 293966 (0.0010) [2023-12-26 01:55:50,820][123090] Updated weights for policy 1, policy_version 292552 (0.0006) [2023-12-26 01:55:50,891][123090] Updated weights for policy 1, policy_version 292562 (0.0008) [2023-12-26 01:55:50,965][123090] Updated weights for policy 1, policy_version 292572 (0.0011) [2023-12-26 01:55:51,338][123091] Updated weights for policy 0, policy_version 293976 (0.0009) [2023-12-26 01:55:51,411][123091] Updated weights for policy 0, policy_version 293986 (0.0010) [2023-12-26 01:55:51,479][123091] Updated weights for policy 0, policy_version 293996 (0.0011) [2023-12-26 01:55:51,752][123090] Updated weights for policy 1, policy_version 292582 (0.0011) [2023-12-26 01:55:51,827][123090] Updated weights for policy 1, policy_version 292592 (0.0011) [2023-12-26 01:55:51,895][123090] Updated weights for policy 1, policy_version 292602 (0.0011) [2023-12-26 01:55:52,193][123091] Updated weights for policy 0, policy_version 294006 (0.0007) [2023-12-26 01:55:52,263][123091] Updated weights for policy 0, policy_version 294016 (0.0010) [2023-12-26 01:55:52,333][123091] Updated weights for policy 0, policy_version 294026 (0.0010) [2023-12-26 01:55:52,706][123090] Updated weights for policy 1, policy_version 292612 (0.0008) [2023-12-26 01:55:52,770][123090] Updated weights for policy 1, policy_version 292622 (0.0010) [2023-12-26 01:55:52,841][123090] Updated weights for policy 1, policy_version 292632 (0.0010) [2023-12-26 01:55:53,048][123091] Updated weights for policy 0, policy_version 294036 (0.0009) [2023-12-26 01:55:53,103][123091] Updated weights for policy 0, policy_version 294046 (0.0009) [2023-12-26 01:55:53,162][123091] Updated weights for policy 0, policy_version 294056 (0.0009) [2023-12-26 01:55:53,597][123090] Updated weights for policy 1, policy_version 292642 (0.0009) [2023-12-26 01:55:53,662][123090] Updated weights for policy 1, policy_version 292652 (0.0006) [2023-12-26 01:55:53,726][123090] Updated weights for policy 1, policy_version 292662 (0.0006) [2023-12-26 01:55:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 150200320. Throughput: 0: 8849.9, 1: 8733.6. Samples: 150181380. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:53,785][121949] Avg episode reward: [(0, '6209.317'), (1, '5769.728')] [2023-12-26 01:55:53,786][123090] Updated weights for policy 1, policy_version 292672 (0.0006) [2023-12-26 01:55:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000294064_75284480.pth... [2023-12-26 01:55:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000292672_74924032.pth... [2023-12-26 01:55:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000291648_74661888.pth [2023-12-26 01:55:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000293040_75022336.pth [2023-12-26 01:55:53,983][123091] Updated weights for policy 0, policy_version 294066 (0.0009) [2023-12-26 01:55:54,036][123091] Updated weights for policy 0, policy_version 294076 (0.0009) [2023-12-26 01:55:54,094][123091] Updated weights for policy 0, policy_version 294086 (0.0008) [2023-12-26 01:55:54,151][123091] Updated weights for policy 0, policy_version 294096 (0.0009) [2023-12-26 01:55:54,466][123090] Updated weights for policy 1, policy_version 292682 (0.0009) [2023-12-26 01:55:54,521][123090] Updated weights for policy 1, policy_version 292692 (0.0009) [2023-12-26 01:55:54,578][123090] Updated weights for policy 1, policy_version 292703 (0.0009) [2023-12-26 01:55:55,006][123091] Updated weights for policy 0, policy_version 294106 (0.0010) [2023-12-26 01:55:55,072][123091] Updated weights for policy 0, policy_version 294116 (0.0009) [2023-12-26 01:55:55,130][123091] Updated weights for policy 0, policy_version 294126 (0.0009) [2023-12-26 01:55:55,389][123090] Updated weights for policy 1, policy_version 292713 (0.0009) [2023-12-26 01:55:55,445][123090] Updated weights for policy 1, policy_version 292723 (0.0009) [2023-12-26 01:55:55,493][123090] Updated weights for policy 1, policy_version 292733 (0.0009) [2023-12-26 01:55:55,905][123091] Updated weights for policy 0, policy_version 294136 (0.0009) [2023-12-26 01:55:55,954][123091] Updated weights for policy 0, policy_version 294146 (0.0009) [2023-12-26 01:55:56,014][123091] Updated weights for policy 0, policy_version 294157 (0.0010) [2023-12-26 01:55:56,327][123090] Updated weights for policy 1, policy_version 292743 (0.0009) [2023-12-26 01:55:56,371][123090] Updated weights for policy 1, policy_version 292753 (0.0005) [2023-12-26 01:55:56,441][123090] Updated weights for policy 1, policy_version 292763 (0.0006) [2023-12-26 01:55:56,831][123091] Updated weights for policy 0, policy_version 294167 (0.0006) [2023-12-26 01:55:56,888][123091] Updated weights for policy 0, policy_version 294177 (0.0005) [2023-12-26 01:55:56,935][123091] Updated weights for policy 0, policy_version 294187 (0.0006) [2023-12-26 01:55:57,235][123090] Updated weights for policy 1, policy_version 292773 (0.0007) [2023-12-26 01:55:57,311][123090] Updated weights for policy 1, policy_version 292783 (0.0007) [2023-12-26 01:55:57,379][123090] Updated weights for policy 1, policy_version 292793 (0.0010) [2023-12-26 01:55:57,679][123091] Updated weights for policy 0, policy_version 294197 (0.0007) [2023-12-26 01:55:57,727][123091] Updated weights for policy 0, policy_version 294207 (0.0007) [2023-12-26 01:55:57,774][123091] Updated weights for policy 0, policy_version 294217 (0.0009) [2023-12-26 01:55:58,179][123090] Updated weights for policy 1, policy_version 292803 (0.0010) [2023-12-26 01:55:58,246][123090] Updated weights for policy 1, policy_version 292813 (0.0011) [2023-12-26 01:55:58,317][123090] Updated weights for policy 1, policy_version 292823 (0.0011) [2023-12-26 01:55:58,598][123091] Updated weights for policy 0, policy_version 294227 (0.0009) [2023-12-26 01:55:58,675][123091] Updated weights for policy 0, policy_version 294237 (0.0007) [2023-12-26 01:55:58,747][123091] Updated weights for policy 0, policy_version 294247 (0.0009) [2023-12-26 01:55:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 150290432. Throughput: 0: 8896.8, 1: 8759.1. Samples: 150288832. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:55:58,785][121949] Avg episode reward: [(0, '6264.307'), (1, '5798.935')] [2023-12-26 01:55:59,264][123090] Updated weights for policy 1, policy_version 292833 (0.0010) [2023-12-26 01:55:59,336][123090] Updated weights for policy 1, policy_version 292843 (0.0011) [2023-12-26 01:55:59,395][123090] Updated weights for policy 1, policy_version 292853 (0.0010) [2023-12-26 01:55:59,448][123090] Updated weights for policy 1, policy_version 292863 (0.0010) [2023-12-26 01:55:59,610][123091] Updated weights for policy 0, policy_version 294257 (0.0009) [2023-12-26 01:55:59,663][123091] Updated weights for policy 0, policy_version 294267 (0.0009) [2023-12-26 01:55:59,720][123091] Updated weights for policy 0, policy_version 294277 (0.0009) [2023-12-26 01:55:59,776][123091] Updated weights for policy 0, policy_version 294287 (0.0009) [2023-12-26 01:56:00,289][123090] Updated weights for policy 1, policy_version 292873 (0.0010) [2023-12-26 01:56:00,348][123090] Updated weights for policy 1, policy_version 292883 (0.0011) [2023-12-26 01:56:00,396][123090] Updated weights for policy 1, policy_version 292893 (0.0010) [2023-12-26 01:56:00,640][123091] Updated weights for policy 0, policy_version 294297 (0.0009) [2023-12-26 01:56:00,691][123091] Updated weights for policy 0, policy_version 294307 (0.0008) [2023-12-26 01:56:00,739][123091] Updated weights for policy 0, policy_version 294317 (0.0009) [2023-12-26 01:56:01,223][123090] Updated weights for policy 1, policy_version 292903 (0.0010) [2023-12-26 01:56:01,281][123090] Updated weights for policy 1, policy_version 292913 (0.0008) [2023-12-26 01:56:01,338][123090] Updated weights for policy 1, policy_version 292923 (0.0007) [2023-12-26 01:56:01,529][123091] Updated weights for policy 0, policy_version 294327 (0.0009) [2023-12-26 01:56:01,601][123091] Updated weights for policy 0, policy_version 294337 (0.0006) [2023-12-26 01:56:01,667][123091] Updated weights for policy 0, policy_version 294347 (0.0007) [2023-12-26 01:56:02,228][123090] Updated weights for policy 1, policy_version 292933 (0.0010) [2023-12-26 01:56:02,297][123090] Updated weights for policy 1, policy_version 292943 (0.0011) [2023-12-26 01:56:02,353][123090] Updated weights for policy 1, policy_version 292953 (0.0010) [2023-12-26 01:56:02,439][123091] Updated weights for policy 0, policy_version 294357 (0.0009) [2023-12-26 01:56:02,497][123091] Updated weights for policy 0, policy_version 294367 (0.0010) [2023-12-26 01:56:02,554][123091] Updated weights for policy 0, policy_version 294377 (0.0005) [2023-12-26 01:56:03,165][123090] Updated weights for policy 1, policy_version 292963 (0.0011) [2023-12-26 01:56:03,230][123090] Updated weights for policy 1, policy_version 292973 (0.0010) [2023-12-26 01:56:03,292][123090] Updated weights for policy 1, policy_version 292983 (0.0010) [2023-12-26 01:56:03,338][123091] Updated weights for policy 0, policy_version 294387 (0.0005) [2023-12-26 01:56:03,388][123091] Updated weights for policy 0, policy_version 294397 (0.0005) [2023-12-26 01:56:03,437][123091] Updated weights for policy 0, policy_version 294407 (0.0007) [2023-12-26 01:56:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 150380544. Throughput: 0: 8821.3, 1: 8710.9. Samples: 150390580. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:56:03,785][121949] Avg episode reward: [(0, '6364.861'), (1, '5767.166')] [2023-12-26 01:56:04,114][123090] Updated weights for policy 1, policy_version 292993 (0.0010) [2023-12-26 01:56:04,174][123090] Updated weights for policy 1, policy_version 293003 (0.0009) [2023-12-26 01:56:04,245][123090] Updated weights for policy 1, policy_version 293013 (0.0010) [2023-12-26 01:56:04,247][123091] Updated weights for policy 0, policy_version 294417 (0.0008) [2023-12-26 01:56:04,308][123091] Updated weights for policy 0, policy_version 294427 (0.0008) [2023-12-26 01:56:04,315][123090] Updated weights for policy 1, policy_version 293023 (0.0008) [2023-12-26 01:56:04,378][123091] Updated weights for policy 0, policy_version 294437 (0.0009) [2023-12-26 01:56:04,445][123091] Updated weights for policy 0, policy_version 294447 (0.0009) [2023-12-26 01:56:05,131][123090] Updated weights for policy 1, policy_version 293033 (0.0011) [2023-12-26 01:56:05,173][123091] Updated weights for policy 0, policy_version 294457 (0.0010) [2023-12-26 01:56:05,195][123090] Updated weights for policy 1, policy_version 293043 (0.0011) [2023-12-26 01:56:05,230][123091] Updated weights for policy 0, policy_version 294467 (0.0008) [2023-12-26 01:56:05,263][123090] Updated weights for policy 1, policy_version 293053 (0.0011) [2023-12-26 01:56:05,289][123091] Updated weights for policy 0, policy_version 294477 (0.0008) [2023-12-26 01:56:05,912][123090] Updated weights for policy 1, policy_version 293063 (0.0007) [2023-12-26 01:56:05,956][123090] Updated weights for policy 1, policy_version 293073 (0.0005) [2023-12-26 01:56:05,968][123091] Updated weights for policy 0, policy_version 294488 (0.0009) [2023-12-26 01:56:06,005][123090] Updated weights for policy 1, policy_version 293083 (0.0007) [2023-12-26 01:56:06,016][123091] Updated weights for policy 0, policy_version 294498 (0.0009) [2023-12-26 01:56:06,072][123091] Updated weights for policy 0, policy_version 294508 (0.0008) [2023-12-26 01:56:06,742][123090] Updated weights for policy 1, policy_version 293093 (0.0011) [2023-12-26 01:56:06,791][123090] Updated weights for policy 1, policy_version 293103 (0.0010) [2023-12-26 01:56:06,846][123090] Updated weights for policy 1, policy_version 293113 (0.0010) [2023-12-26 01:56:06,896][123091] Updated weights for policy 0, policy_version 294518 (0.0006) [2023-12-26 01:56:06,956][123091] Updated weights for policy 0, policy_version 294528 (0.0009) [2023-12-26 01:56:07,020][123091] Updated weights for policy 0, policy_version 294538 (0.0007) [2023-12-26 01:56:07,726][123090] Updated weights for policy 1, policy_version 293123 (0.0011) [2023-12-26 01:56:07,771][123091] Updated weights for policy 0, policy_version 294548 (0.0006) [2023-12-26 01:56:07,793][123090] Updated weights for policy 1, policy_version 293133 (0.0011) [2023-12-26 01:56:07,831][123091] Updated weights for policy 0, policy_version 294558 (0.0006) [2023-12-26 01:56:07,853][123090] Updated weights for policy 1, policy_version 293143 (0.0010) [2023-12-26 01:56:07,887][123091] Updated weights for policy 0, policy_version 294568 (0.0006) [2023-12-26 01:56:08,603][123090] Updated weights for policy 1, policy_version 293153 (0.0010) [2023-12-26 01:56:08,677][123090] Updated weights for policy 1, policy_version 293163 (0.0011) [2023-12-26 01:56:08,688][123091] Updated weights for policy 0, policy_version 294578 (0.0009) [2023-12-26 01:56:08,729][123090] Updated weights for policy 1, policy_version 293173 (0.0010) [2023-12-26 01:56:08,747][123091] Updated weights for policy 0, policy_version 294588 (0.0011) [2023-12-26 01:56:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 150462464. Throughput: 0: 8910.6, 1: 8746.8. Samples: 150446096. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:56:08,785][121949] Avg episode reward: [(0, '6348.917'), (1, '5665.004')] [2023-12-26 01:56:08,790][123090] Updated weights for policy 1, policy_version 293183 (0.0011) [2023-12-26 01:56:08,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000293184_75055104.pth... [2023-12-26 01:56:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000292160_74792960.pth [2023-12-26 01:56:08,803][123091] Updated weights for policy 0, policy_version 294598 (0.0011) [2023-12-26 01:56:08,859][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000294608_75423744.pth... [2023-12-26 01:56:08,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000293552_75153408.pth [2023-12-26 01:56:08,863][123091] Updated weights for policy 0, policy_version 294608 (0.0011) [2023-12-26 01:56:09,634][123091] Updated weights for policy 0, policy_version 294618 (0.0008) [2023-12-26 01:56:09,643][123090] Updated weights for policy 1, policy_version 293193 (0.0011) [2023-12-26 01:56:09,693][123091] Updated weights for policy 0, policy_version 294628 (0.0008) [2023-12-26 01:56:09,711][123090] Updated weights for policy 1, policy_version 293203 (0.0011) [2023-12-26 01:56:09,761][123091] Updated weights for policy 0, policy_version 294638 (0.0008) [2023-12-26 01:56:09,768][123090] Updated weights for policy 1, policy_version 293213 (0.0011) [2023-12-26 01:56:10,613][123090] Updated weights for policy 1, policy_version 293223 (0.0010) [2023-12-26 01:56:10,616][123091] Updated weights for policy 0, policy_version 294648 (0.0007) [2023-12-26 01:56:10,677][123090] Updated weights for policy 1, policy_version 293233 (0.0010) [2023-12-26 01:56:10,678][123091] Updated weights for policy 0, policy_version 294658 (0.0006) [2023-12-26 01:56:10,725][123090] Updated weights for policy 1, policy_version 293243 (0.0008) [2023-12-26 01:56:10,735][123091] Updated weights for policy 0, policy_version 294668 (0.0007) [2023-12-26 01:56:11,520][123090] Updated weights for policy 1, policy_version 293253 (0.0007) [2023-12-26 01:56:11,590][123090] Updated weights for policy 1, policy_version 293263 (0.0005) [2023-12-26 01:56:11,656][123090] Updated weights for policy 1, policy_version 293273 (0.0009) [2023-12-26 01:56:11,663][123091] Updated weights for policy 0, policy_version 294678 (0.0009) [2023-12-26 01:56:11,719][123091] Updated weights for policy 0, policy_version 294688 (0.0011) [2023-12-26 01:56:11,791][123091] Updated weights for policy 0, policy_version 294698 (0.0011) [2023-12-26 01:56:12,441][123090] Updated weights for policy 1, policy_version 293283 (0.0007) [2023-12-26 01:56:12,493][123090] Updated weights for policy 1, policy_version 293293 (0.0006) [2023-12-26 01:56:12,543][123090] Updated weights for policy 1, policy_version 293303 (0.0005) [2023-12-26 01:56:12,660][123091] Updated weights for policy 0, policy_version 294708 (0.0010) [2023-12-26 01:56:12,708][123091] Updated weights for policy 0, policy_version 294718 (0.0009) [2023-12-26 01:56:12,768][123091] Updated weights for policy 0, policy_version 294729 (0.0010) [2023-12-26 01:56:13,352][123090] Updated weights for policy 1, policy_version 293313 (0.0006) [2023-12-26 01:56:13,421][123090] Updated weights for policy 1, policy_version 293323 (0.0008) [2023-12-26 01:56:13,468][123090] Updated weights for policy 1, policy_version 293333 (0.0010) [2023-12-26 01:56:13,516][123090] Updated weights for policy 1, policy_version 293343 (0.0010) [2023-12-26 01:56:13,531][123091] Updated weights for policy 0, policy_version 294739 (0.0010) [2023-12-26 01:56:13,578][123091] Updated weights for policy 0, policy_version 294749 (0.0010) [2023-12-26 01:56:13,640][123091] Updated weights for policy 0, policy_version 294759 (0.0009) [2023-12-26 01:56:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 150560768. Throughput: 0: 8933.9, 1: 8653.5. Samples: 150550088. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:56:13,785][121949] Avg episode reward: [(0, '6303.629'), (1, '5705.608')] [2023-12-26 01:56:14,354][123090] Updated weights for policy 1, policy_version 293353 (0.0010) [2023-12-26 01:56:14,422][123090] Updated weights for policy 1, policy_version 293363 (0.0010) [2023-12-26 01:56:14,442][123091] Updated weights for policy 0, policy_version 294769 (0.0008) [2023-12-26 01:56:14,484][123090] Updated weights for policy 1, policy_version 293373 (0.0008) [2023-12-26 01:56:14,500][123091] Updated weights for policy 0, policy_version 294779 (0.0007) [2023-12-26 01:56:14,554][123091] Updated weights for policy 0, policy_version 294789 (0.0010) [2023-12-26 01:56:14,612][123091] Updated weights for policy 0, policy_version 294799 (0.0009) [2023-12-26 01:56:15,338][123090] Updated weights for policy 1, policy_version 293383 (0.0009) [2023-12-26 01:56:15,387][123091] Updated weights for policy 0, policy_version 294809 (0.0008) [2023-12-26 01:56:15,409][123090] Updated weights for policy 1, policy_version 293393 (0.0008) [2023-12-26 01:56:15,442][123091] Updated weights for policy 0, policy_version 294819 (0.0009) [2023-12-26 01:56:15,475][123090] Updated weights for policy 1, policy_version 293403 (0.0008) [2023-12-26 01:56:15,499][123091] Updated weights for policy 0, policy_version 294829 (0.0008) [2023-12-26 01:56:16,279][123090] Updated weights for policy 1, policy_version 293413 (0.0008) [2023-12-26 01:56:16,335][123090] Updated weights for policy 1, policy_version 293423 (0.0007) [2023-12-26 01:56:16,338][123091] Updated weights for policy 0, policy_version 294839 (0.0008) [2023-12-26 01:56:16,398][123091] Updated weights for policy 0, policy_version 294849 (0.0008) [2023-12-26 01:56:16,400][123090] Updated weights for policy 1, policy_version 293433 (0.0007) [2023-12-26 01:56:16,446][123091] Updated weights for policy 0, policy_version 294859 (0.0007) [2023-12-26 01:56:17,226][123090] Updated weights for policy 1, policy_version 293443 (0.0009) [2023-12-26 01:56:17,274][123091] Updated weights for policy 0, policy_version 294869 (0.0009) [2023-12-26 01:56:17,283][123090] Updated weights for policy 1, policy_version 293453 (0.0008) [2023-12-26 01:56:17,319][123091] Updated weights for policy 0, policy_version 294879 (0.0009) [2023-12-26 01:56:17,334][123090] Updated weights for policy 1, policy_version 293463 (0.0008) [2023-12-26 01:56:17,371][123091] Updated weights for policy 0, policy_version 294889 (0.0008) [2023-12-26 01:56:18,186][123091] Updated weights for policy 0, policy_version 294899 (0.0009) [2023-12-26 01:56:18,196][123090] Updated weights for policy 1, policy_version 293473 (0.0007) [2023-12-26 01:56:18,247][123091] Updated weights for policy 0, policy_version 294909 (0.0011) [2023-12-26 01:56:18,255][123090] Updated weights for policy 1, policy_version 293483 (0.0007) [2023-12-26 01:56:18,316][123091] Updated weights for policy 0, policy_version 294919 (0.0010) [2023-12-26 01:56:18,322][123090] Updated weights for policy 1, policy_version 293493 (0.0007) [2023-12-26 01:56:18,385][123090] Updated weights for policy 1, policy_version 293503 (0.0008) [2023-12-26 01:56:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 150642688. Throughput: 0: 8889.6, 1: 8638.1. Samples: 150653596. Policy #0 lag: (min: 31.0, avg: 32.4, max: 63.0) [2023-12-26 01:56:18,785][121949] Avg episode reward: [(0, '6339.406'), (1, '5844.263')] [2023-12-26 01:56:18,786][123008] Saving new best policy, reward=5844.263! [2023-12-26 01:56:18,971][123091] Updated weights for policy 0, policy_version 294929 (0.0010) [2023-12-26 01:56:19,035][123091] Updated weights for policy 0, policy_version 294939 (0.0006) [2023-12-26 01:56:19,105][123091] Updated weights for policy 0, policy_version 294949 (0.0005) [2023-12-26 01:56:19,157][123091] Updated weights for policy 0, policy_version 294959 (0.0005) [2023-12-26 01:56:19,289][123090] Updated weights for policy 1, policy_version 293513 (0.0009) [2023-12-26 01:56:19,363][123090] Updated weights for policy 1, policy_version 293523 (0.0009) [2023-12-26 01:56:19,418][123090] Updated weights for policy 1, policy_version 293533 (0.0009) [2023-12-26 01:56:19,937][123091] Updated weights for policy 0, policy_version 294969 (0.0009) [2023-12-26 01:56:20,001][123091] Updated weights for policy 0, policy_version 294979 (0.0009) [2023-12-26 01:56:20,060][123091] Updated weights for policy 0, policy_version 294989 (0.0010) [2023-12-26 01:56:20,307][123090] Updated weights for policy 1, policy_version 293543 (0.0010) [2023-12-26 01:56:20,386][123090] Updated weights for policy 1, policy_version 293553 (0.0010) [2023-12-26 01:56:20,446][123090] Updated weights for policy 1, policy_version 293563 (0.0009) [2023-12-26 01:56:20,915][123091] Updated weights for policy 0, policy_version 294999 (0.0009) [2023-12-26 01:56:20,982][123091] Updated weights for policy 0, policy_version 295009 (0.0010) [2023-12-26 01:56:21,053][123091] Updated weights for policy 0, policy_version 295019 (0.0010) [2023-12-26 01:56:21,287][123090] Updated weights for policy 1, policy_version 293573 (0.0010) [2023-12-26 01:56:21,358][123090] Updated weights for policy 1, policy_version 293583 (0.0010) [2023-12-26 01:56:21,431][123090] Updated weights for policy 1, policy_version 293593 (0.0007) [2023-12-26 01:56:21,933][123091] Updated weights for policy 0, policy_version 295029 (0.0009) [2023-12-26 01:56:22,007][123091] Updated weights for policy 0, policy_version 295039 (0.0009) [2023-12-26 01:56:22,073][123091] Updated weights for policy 0, policy_version 295049 (0.0009) [2023-12-26 01:56:22,201][123090] Updated weights for policy 1, policy_version 293603 (0.0010) [2023-12-26 01:56:22,250][123090] Updated weights for policy 1, policy_version 293613 (0.0009) [2023-12-26 01:56:22,311][123090] Updated weights for policy 1, policy_version 293623 (0.0009) [2023-12-26 01:56:22,920][123091] Updated weights for policy 0, policy_version 295059 (0.0009) [2023-12-26 01:56:22,980][123091] Updated weights for policy 0, policy_version 295069 (0.0010) [2023-12-26 01:56:23,042][123091] Updated weights for policy 0, policy_version 295079 (0.0009) [2023-12-26 01:56:23,154][123090] Updated weights for policy 1, policy_version 293633 (0.0010) [2023-12-26 01:56:23,210][123090] Updated weights for policy 1, policy_version 293643 (0.0009) [2023-12-26 01:56:23,274][123090] Updated weights for policy 1, policy_version 293653 (0.0009) [2023-12-26 01:56:23,327][123090] Updated weights for policy 1, policy_version 293663 (0.0009) [2023-12-26 01:56:23,755][123091] Updated weights for policy 0, policy_version 295089 (0.0009) [2023-12-26 01:56:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 150724608. Throughput: 0: 8869.8, 1: 8616.1. Samples: 150704332. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:23,785][121949] Avg episode reward: [(0, '6285.209'), (1, '5866.703')] [2023-12-26 01:56:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000293664_75177984.pth... [2023-12-26 01:56:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000292672_74924032.pth [2023-12-26 01:56:23,798][123008] Saving new best policy, reward=5866.703! [2023-12-26 01:56:23,807][123091] Updated weights for policy 0, policy_version 295099 (0.0005) [2023-12-26 01:56:23,853][123091] Updated weights for policy 0, policy_version 295109 (0.0006) [2023-12-26 01:56:23,901][123091] Updated weights for policy 0, policy_version 295119 (0.0010) [2023-12-26 01:56:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000295120_75554816.pth... [2023-12-26 01:56:23,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000294064_75284480.pth [2023-12-26 01:56:24,096][123090] Updated weights for policy 1, policy_version 293673 (0.0009) [2023-12-26 01:56:24,171][123090] Updated weights for policy 1, policy_version 293683 (0.0006) [2023-12-26 01:56:24,233][123090] Updated weights for policy 1, policy_version 293693 (0.0006) [2023-12-26 01:56:24,629][123091] Updated weights for policy 0, policy_version 295129 (0.0006) [2023-12-26 01:56:24,696][123091] Updated weights for policy 0, policy_version 295139 (0.0006) [2023-12-26 01:56:24,753][123091] Updated weights for policy 0, policy_version 295149 (0.0005) [2023-12-26 01:56:24,885][123090] Updated weights for policy 1, policy_version 293703 (0.0005) [2023-12-26 01:56:24,945][123090] Updated weights for policy 1, policy_version 293713 (0.0005) [2023-12-26 01:56:25,018][123090] Updated weights for policy 1, policy_version 293723 (0.0006) [2023-12-26 01:56:25,372][123091] Updated weights for policy 0, policy_version 295159 (0.0005) [2023-12-26 01:56:25,436][123091] Updated weights for policy 0, policy_version 295169 (0.0005) [2023-12-26 01:56:25,495][123091] Updated weights for policy 0, policy_version 295179 (0.0010) [2023-12-26 01:56:25,670][123090] Updated weights for policy 1, policy_version 293733 (0.0005) [2023-12-26 01:56:25,733][123090] Updated weights for policy 1, policy_version 293743 (0.0005) [2023-12-26 01:56:25,800][123090] Updated weights for policy 1, policy_version 293753 (0.0005) [2023-12-26 01:56:26,187][123091] Updated weights for policy 0, policy_version 295189 (0.0008) [2023-12-26 01:56:26,248][123091] Updated weights for policy 0, policy_version 295199 (0.0005) [2023-12-26 01:56:26,302][123091] Updated weights for policy 0, policy_version 295209 (0.0005) [2023-12-26 01:56:26,508][123090] Updated weights for policy 1, policy_version 293763 (0.0007) [2023-12-26 01:56:26,575][123090] Updated weights for policy 1, policy_version 293773 (0.0011) [2023-12-26 01:56:26,638][123090] Updated weights for policy 1, policy_version 293783 (0.0010) [2023-12-26 01:56:26,953][123091] Updated weights for policy 0, policy_version 295219 (0.0005) [2023-12-26 01:56:27,000][123091] Updated weights for policy 0, policy_version 295229 (0.0005) [2023-12-26 01:56:27,050][123091] Updated weights for policy 0, policy_version 295239 (0.0005) [2023-12-26 01:56:27,346][123090] Updated weights for policy 1, policy_version 293793 (0.0011) [2023-12-26 01:56:27,411][123090] Updated weights for policy 1, policy_version 293803 (0.0007) [2023-12-26 01:56:27,471][123090] Updated weights for policy 1, policy_version 293813 (0.0005) [2023-12-26 01:56:27,533][123090] Updated weights for policy 1, policy_version 293823 (0.0005) [2023-12-26 01:56:27,712][123091] Updated weights for policy 0, policy_version 295249 (0.0005) [2023-12-26 01:56:27,773][123091] Updated weights for policy 0, policy_version 295259 (0.0005) [2023-12-26 01:56:27,826][123091] Updated weights for policy 0, policy_version 295269 (0.0005) [2023-12-26 01:56:27,880][123091] Updated weights for policy 0, policy_version 295279 (0.0005) [2023-12-26 01:56:28,223][123090] Updated weights for policy 1, policy_version 293833 (0.0010) [2023-12-26 01:56:28,276][123090] Updated weights for policy 1, policy_version 293843 (0.0010) [2023-12-26 01:56:28,345][123090] Updated weights for policy 1, policy_version 293853 (0.0010) [2023-12-26 01:56:28,599][123091] Updated weights for policy 0, policy_version 295289 (0.0008) [2023-12-26 01:56:28,664][123091] Updated weights for policy 0, policy_version 295299 (0.0010) [2023-12-26 01:56:28,719][123091] Updated weights for policy 0, policy_version 295309 (0.0009) [2023-12-26 01:56:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 150831104. Throughput: 0: 8980.5, 1: 8782.2. Samples: 150819268. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:28,785][121949] Avg episode reward: [(0, '6206.118'), (1, '5849.004')] [2023-12-26 01:56:29,145][123090] Updated weights for policy 1, policy_version 293863 (0.0007) [2023-12-26 01:56:29,224][123090] Updated weights for policy 1, policy_version 293873 (0.0010) [2023-12-26 01:56:29,282][123090] Updated weights for policy 1, policy_version 293883 (0.0007) [2023-12-26 01:56:29,454][123091] Updated weights for policy 0, policy_version 295319 (0.0008) [2023-12-26 01:56:29,508][123091] Updated weights for policy 0, policy_version 295329 (0.0008) [2023-12-26 01:56:29,563][123091] Updated weights for policy 0, policy_version 295339 (0.0008) [2023-12-26 01:56:29,974][123090] Updated weights for policy 1, policy_version 293893 (0.0008) [2023-12-26 01:56:30,036][123090] Updated weights for policy 1, policy_version 293903 (0.0008) [2023-12-26 01:56:30,104][123090] Updated weights for policy 1, policy_version 293913 (0.0008) [2023-12-26 01:56:30,329][123091] Updated weights for policy 0, policy_version 295349 (0.0009) [2023-12-26 01:56:30,381][123091] Updated weights for policy 0, policy_version 295359 (0.0010) [2023-12-26 01:56:30,448][123091] Updated weights for policy 0, policy_version 295369 (0.0011) [2023-12-26 01:56:30,895][123090] Updated weights for policy 1, policy_version 293923 (0.0009) [2023-12-26 01:56:30,965][123090] Updated weights for policy 1, policy_version 293933 (0.0010) [2023-12-26 01:56:31,034][123090] Updated weights for policy 1, policy_version 293943 (0.0010) [2023-12-26 01:56:31,242][123091] Updated weights for policy 0, policy_version 295379 (0.0009) [2023-12-26 01:56:31,310][123091] Updated weights for policy 0, policy_version 295389 (0.0007) [2023-12-26 01:56:31,380][123091] Updated weights for policy 0, policy_version 295399 (0.0008) [2023-12-26 01:56:31,826][123090] Updated weights for policy 1, policy_version 293953 (0.0011) [2023-12-26 01:56:31,883][123090] Updated weights for policy 1, policy_version 293963 (0.0006) [2023-12-26 01:56:31,939][123090] Updated weights for policy 1, policy_version 293973 (0.0006) [2023-12-26 01:56:31,996][123090] Updated weights for policy 1, policy_version 293983 (0.0009) [2023-12-26 01:56:32,087][123091] Updated weights for policy 0, policy_version 295409 (0.0008) [2023-12-26 01:56:32,132][123091] Updated weights for policy 0, policy_version 295419 (0.0005) [2023-12-26 01:56:32,181][123091] Updated weights for policy 0, policy_version 295429 (0.0005) [2023-12-26 01:56:32,229][123091] Updated weights for policy 0, policy_version 295439 (0.0005) [2023-12-26 01:56:32,794][123090] Updated weights for policy 1, policy_version 293993 (0.0010) [2023-12-26 01:56:32,845][123090] Updated weights for policy 1, policy_version 294003 (0.0010) [2023-12-26 01:56:32,901][123090] Updated weights for policy 1, policy_version 294013 (0.0007) [2023-12-26 01:56:33,007][123091] Updated weights for policy 0, policy_version 295449 (0.0006) [2023-12-26 01:56:33,057][123091] Updated weights for policy 0, policy_version 295459 (0.0006) [2023-12-26 01:56:33,118][123091] Updated weights for policy 0, policy_version 295469 (0.0008) [2023-12-26 01:56:33,708][123090] Updated weights for policy 1, policy_version 294023 (0.0009) [2023-12-26 01:56:33,770][123090] Updated weights for policy 1, policy_version 294033 (0.0010) [2023-12-26 01:56:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 150913024. Throughput: 0: 9026.8, 1: 8817.9. Samples: 150931076. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:33,785][121949] Avg episode reward: [(0, '6229.062'), (1, '5870.093')] [2023-12-26 01:56:33,818][123090] Updated weights for policy 1, policy_version 294043 (0.0010) [2023-12-26 01:56:33,838][123008] Saving new best policy, reward=5870.093! [2023-12-26 01:56:33,906][123091] Updated weights for policy 0, policy_version 295479 (0.0006) [2023-12-26 01:56:33,986][123091] Updated weights for policy 0, policy_version 295490 (0.0007) [2023-12-26 01:56:34,060][123091] Updated weights for policy 0, policy_version 295500 (0.0006) [2023-12-26 01:56:34,665][123090] Updated weights for policy 1, policy_version 294053 (0.0008) [2023-12-26 01:56:34,744][123090] Updated weights for policy 1, policy_version 294063 (0.0007) [2023-12-26 01:56:34,778][123091] Updated weights for policy 0, policy_version 295510 (0.0006) [2023-12-26 01:56:34,810][123090] Updated weights for policy 1, policy_version 294073 (0.0007) [2023-12-26 01:56:34,847][123091] Updated weights for policy 0, policy_version 295520 (0.0006) [2023-12-26 01:56:34,920][123091] Updated weights for policy 0, policy_version 295530 (0.0005) [2023-12-26 01:56:35,456][123090] Updated weights for policy 1, policy_version 294083 (0.0007) [2023-12-26 01:56:35,493][123091] Updated weights for policy 0, policy_version 295540 (0.0007) [2023-12-26 01:56:35,519][123090] Updated weights for policy 1, policy_version 294093 (0.0009) [2023-12-26 01:56:35,546][123091] Updated weights for policy 0, policy_version 295550 (0.0008) [2023-12-26 01:56:35,587][123090] Updated weights for policy 1, policy_version 294103 (0.0009) [2023-12-26 01:56:35,597][123091] Updated weights for policy 0, policy_version 295560 (0.0005) [2023-12-26 01:56:36,381][123091] Updated weights for policy 0, policy_version 295570 (0.0010) [2023-12-26 01:56:36,392][123090] Updated weights for policy 1, policy_version 294113 (0.0006) [2023-12-26 01:56:36,443][123091] Updated weights for policy 0, policy_version 295580 (0.0011) [2023-12-26 01:56:36,446][123090] Updated weights for policy 1, policy_version 294123 (0.0006) [2023-12-26 01:56:36,503][123091] Updated weights for policy 0, policy_version 295590 (0.0011) [2023-12-26 01:56:36,503][123090] Updated weights for policy 1, policy_version 294133 (0.0010) [2023-12-26 01:56:36,558][123090] Updated weights for policy 1, policy_version 294143 (0.0007) [2023-12-26 01:56:36,563][123091] Updated weights for policy 0, policy_version 295600 (0.0011) [2023-12-26 01:56:37,318][123091] Updated weights for policy 0, policy_version 295610 (0.0009) [2023-12-26 01:56:37,367][123091] Updated weights for policy 0, policy_version 295620 (0.0009) [2023-12-26 01:56:37,420][123091] Updated weights for policy 0, policy_version 295630 (0.0009) [2023-12-26 01:56:37,448][123090] Updated weights for policy 1, policy_version 294153 (0.0007) [2023-12-26 01:56:37,510][123090] Updated weights for policy 1, policy_version 294163 (0.0008) [2023-12-26 01:56:37,586][123090] Updated weights for policy 1, policy_version 294173 (0.0007) [2023-12-26 01:56:38,307][123091] Updated weights for policy 0, policy_version 295640 (0.0009) [2023-12-26 01:56:38,370][123091] Updated weights for policy 0, policy_version 295650 (0.0009) [2023-12-26 01:56:38,400][123090] Updated weights for policy 1, policy_version 294183 (0.0010) [2023-12-26 01:56:38,438][123091] Updated weights for policy 0, policy_version 295660 (0.0008) [2023-12-26 01:56:38,465][123090] Updated weights for policy 1, policy_version 294193 (0.0011) [2023-12-26 01:56:38,533][123090] Updated weights for policy 1, policy_version 294203 (0.0011) [2023-12-26 01:56:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 151011328. Throughput: 0: 9083.1, 1: 8798.7. Samples: 150986060. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:38,785][121949] Avg episode reward: [(0, '6227.879'), (1, '5878.502')] [2023-12-26 01:56:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000295664_75694080.pth... [2023-12-26 01:56:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000294208_75317248.pth... [2023-12-26 01:56:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000294608_75423744.pth [2023-12-26 01:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000293184_75055104.pth [2023-12-26 01:56:38,797][123008] Saving new best policy, reward=5878.502! [2023-12-26 01:56:39,232][123090] Updated weights for policy 1, policy_version 294213 (0.0010) [2023-12-26 01:56:39,286][123091] Updated weights for policy 0, policy_version 295670 (0.0009) [2023-12-26 01:56:39,298][123090] Updated weights for policy 1, policy_version 294223 (0.0008) [2023-12-26 01:56:39,351][123091] Updated weights for policy 0, policy_version 295680 (0.0010) [2023-12-26 01:56:39,363][123090] Updated weights for policy 1, policy_version 294233 (0.0008) [2023-12-26 01:56:39,419][123091] Updated weights for policy 0, policy_version 295690 (0.0008) [2023-12-26 01:56:40,211][123090] Updated weights for policy 1, policy_version 294243 (0.0008) [2023-12-26 01:56:40,272][123091] Updated weights for policy 0, policy_version 295700 (0.0008) [2023-12-26 01:56:40,276][123090] Updated weights for policy 1, policy_version 294253 (0.0006) [2023-12-26 01:56:40,337][123091] Updated weights for policy 0, policy_version 295710 (0.0008) [2023-12-26 01:56:40,339][123090] Updated weights for policy 1, policy_version 294263 (0.0006) [2023-12-26 01:56:40,401][123091] Updated weights for policy 0, policy_version 295720 (0.0008) [2023-12-26 01:56:41,147][123090] Updated weights for policy 1, policy_version 294273 (0.0009) [2023-12-26 01:56:41,184][123091] Updated weights for policy 0, policy_version 295730 (0.0008) [2023-12-26 01:56:41,222][123090] Updated weights for policy 1, policy_version 294283 (0.0009) [2023-12-26 01:56:41,243][123091] Updated weights for policy 0, policy_version 295740 (0.0007) [2023-12-26 01:56:41,286][123090] Updated weights for policy 1, policy_version 294293 (0.0008) [2023-12-26 01:56:41,306][123091] Updated weights for policy 0, policy_version 295750 (0.0008) [2023-12-26 01:56:41,348][123090] Updated weights for policy 1, policy_version 294303 (0.0008) [2023-12-26 01:56:41,364][123091] Updated weights for policy 0, policy_version 295760 (0.0008) [2023-12-26 01:56:42,162][123090] Updated weights for policy 1, policy_version 294313 (0.0009) [2023-12-26 01:56:42,199][123091] Updated weights for policy 0, policy_version 295770 (0.0008) [2023-12-26 01:56:42,231][123090] Updated weights for policy 1, policy_version 294323 (0.0010) [2023-12-26 01:56:42,262][123091] Updated weights for policy 0, policy_version 295780 (0.0008) [2023-12-26 01:56:42,298][123090] Updated weights for policy 1, policy_version 294333 (0.0007) [2023-12-26 01:56:42,338][123091] Updated weights for policy 0, policy_version 295790 (0.0009) [2023-12-26 01:56:43,040][123090] Updated weights for policy 1, policy_version 294343 (0.0010) [2023-12-26 01:56:43,094][123090] Updated weights for policy 1, policy_version 294354 (0.0010) [2023-12-26 01:56:43,154][123090] Updated weights for policy 1, policy_version 294365 (0.0010) [2023-12-26 01:56:43,162][123091] Updated weights for policy 0, policy_version 295800 (0.0008) [2023-12-26 01:56:43,210][123091] Updated weights for policy 0, policy_version 295810 (0.0009) [2023-12-26 01:56:43,257][123091] Updated weights for policy 0, policy_version 295820 (0.0009) [2023-12-26 01:56:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 151093248. Throughput: 0: 9003.8, 1: 8752.5. Samples: 151087864. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:43,785][121949] Avg episode reward: [(0, '6306.399'), (1, '5864.115')] [2023-12-26 01:56:44,006][123090] Updated weights for policy 1, policy_version 294375 (0.0009) [2023-12-26 01:56:44,057][123090] Updated weights for policy 1, policy_version 294385 (0.0009) [2023-12-26 01:56:44,110][123090] Updated weights for policy 1, policy_version 294395 (0.0008) [2023-12-26 01:56:44,112][123091] Updated weights for policy 0, policy_version 295830 (0.0009) [2023-12-26 01:56:44,169][123091] Updated weights for policy 0, policy_version 295840 (0.0010) [2023-12-26 01:56:44,221][123091] Updated weights for policy 0, policy_version 295850 (0.0010) [2023-12-26 01:56:44,879][123090] Updated weights for policy 1, policy_version 294405 (0.0007) [2023-12-26 01:56:44,952][123090] Updated weights for policy 1, policy_version 294415 (0.0008) [2023-12-26 01:56:44,982][123091] Updated weights for policy 0, policy_version 295860 (0.0009) [2023-12-26 01:56:45,012][123090] Updated weights for policy 1, policy_version 294425 (0.0008) [2023-12-26 01:56:45,043][123091] Updated weights for policy 0, policy_version 295870 (0.0007) [2023-12-26 01:56:45,094][123091] Updated weights for policy 0, policy_version 295880 (0.0011) [2023-12-26 01:56:45,817][123090] Updated weights for policy 1, policy_version 294435 (0.0007) [2023-12-26 01:56:45,871][123090] Updated weights for policy 1, policy_version 294445 (0.0009) [2023-12-26 01:56:45,924][123091] Updated weights for policy 0, policy_version 295890 (0.0010) [2023-12-26 01:56:45,929][123090] Updated weights for policy 1, policy_version 294455 (0.0005) [2023-12-26 01:56:45,984][123091] Updated weights for policy 0, policy_version 295900 (0.0008) [2023-12-26 01:56:46,036][123091] Updated weights for policy 0, policy_version 295910 (0.0010) [2023-12-26 01:56:46,124][123091] Updated weights for policy 0, policy_version 295920 (0.0009) [2023-12-26 01:56:46,696][123090] Updated weights for policy 1, policy_version 294465 (0.0005) [2023-12-26 01:56:46,752][123090] Updated weights for policy 1, policy_version 294475 (0.0005) [2023-12-26 01:56:46,815][123090] Updated weights for policy 1, policy_version 294485 (0.0005) [2023-12-26 01:56:46,901][123090] Updated weights for policy 1, policy_version 294495 (0.0005) [2023-12-26 01:56:46,906][123091] Updated weights for policy 0, policy_version 295930 (0.0006) [2023-12-26 01:56:46,971][123091] Updated weights for policy 0, policy_version 295940 (0.0005) [2023-12-26 01:56:47,039][123091] Updated weights for policy 0, policy_version 295950 (0.0006) [2023-12-26 01:56:47,491][123090] Updated weights for policy 1, policy_version 294505 (0.0005) [2023-12-26 01:56:47,560][123090] Updated weights for policy 1, policy_version 294515 (0.0005) [2023-12-26 01:56:47,625][123090] Updated weights for policy 1, policy_version 294525 (0.0005) [2023-12-26 01:56:47,656][123091] Updated weights for policy 0, policy_version 295960 (0.0005) [2023-12-26 01:56:47,701][123091] Updated weights for policy 0, policy_version 295970 (0.0008) [2023-12-26 01:56:47,756][123091] Updated weights for policy 0, policy_version 295980 (0.0010) [2023-12-26 01:56:48,218][123090] Updated weights for policy 1, policy_version 294535 (0.0005) [2023-12-26 01:56:48,284][123090] Updated weights for policy 1, policy_version 294545 (0.0009) [2023-12-26 01:56:48,347][123090] Updated weights for policy 1, policy_version 294555 (0.0009) [2023-12-26 01:56:48,597][123091] Updated weights for policy 0, policy_version 295990 (0.0010) [2023-12-26 01:56:48,668][123091] Updated weights for policy 0, policy_version 296000 (0.0010) [2023-12-26 01:56:48,723][123091] Updated weights for policy 0, policy_version 296010 (0.0010) [2023-12-26 01:56:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 151191552. Throughput: 0: 9072.7, 1: 8896.1. Samples: 151199176. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:48,785][121949] Avg episode reward: [(0, '6347.986'), (1, '5760.189')] [2023-12-26 01:56:49,132][123090] Updated weights for policy 1, policy_version 294565 (0.0009) [2023-12-26 01:56:49,194][123090] Updated weights for policy 1, policy_version 294575 (0.0009) [2023-12-26 01:56:49,262][123090] Updated weights for policy 1, policy_version 294585 (0.0010) [2023-12-26 01:56:49,546][123091] Updated weights for policy 0, policy_version 296020 (0.0010) [2023-12-26 01:56:49,604][123091] Updated weights for policy 0, policy_version 296030 (0.0009) [2023-12-26 01:56:49,653][123091] Updated weights for policy 0, policy_version 296040 (0.0009) [2023-12-26 01:56:50,137][123090] Updated weights for policy 1, policy_version 294595 (0.0009) [2023-12-26 01:56:50,200][123090] Updated weights for policy 1, policy_version 294605 (0.0009) [2023-12-26 01:56:50,258][123090] Updated weights for policy 1, policy_version 294615 (0.0009) [2023-12-26 01:56:50,521][123091] Updated weights for policy 0, policy_version 296050 (0.0010) [2023-12-26 01:56:50,588][123091] Updated weights for policy 0, policy_version 296060 (0.0010) [2023-12-26 01:56:50,643][123091] Updated weights for policy 0, policy_version 296070 (0.0009) [2023-12-26 01:56:50,715][123091] Updated weights for policy 0, policy_version 296080 (0.0011) [2023-12-26 01:56:51,016][123090] Updated weights for policy 1, policy_version 294625 (0.0010) [2023-12-26 01:56:51,091][123090] Updated weights for policy 1, policy_version 294636 (0.0010) [2023-12-26 01:56:51,156][123090] Updated weights for policy 1, policy_version 294646 (0.0009) [2023-12-26 01:56:51,223][123090] Updated weights for policy 1, policy_version 294656 (0.0009) [2023-12-26 01:56:51,566][123091] Updated weights for policy 0, policy_version 296090 (0.0009) [2023-12-26 01:56:51,634][123091] Updated weights for policy 0, policy_version 296100 (0.0010) [2023-12-26 01:56:51,695][123091] Updated weights for policy 0, policy_version 296110 (0.0009) [2023-12-26 01:56:52,059][123090] Updated weights for policy 1, policy_version 294666 (0.0009) [2023-12-26 01:56:52,128][123090] Updated weights for policy 1, policy_version 294676 (0.0007) [2023-12-26 01:56:52,200][123090] Updated weights for policy 1, policy_version 294686 (0.0007) [2023-12-26 01:56:52,534][123091] Updated weights for policy 0, policy_version 296120 (0.0009) [2023-12-26 01:56:52,592][123091] Updated weights for policy 0, policy_version 296130 (0.0009) [2023-12-26 01:56:52,645][123091] Updated weights for policy 0, policy_version 296140 (0.0009) [2023-12-26 01:56:52,999][123090] Updated weights for policy 1, policy_version 294696 (0.0010) [2023-12-26 01:56:53,066][123090] Updated weights for policy 1, policy_version 294706 (0.0010) [2023-12-26 01:56:53,129][123090] Updated weights for policy 1, policy_version 294716 (0.0010) [2023-12-26 01:56:53,372][123091] Updated weights for policy 0, policy_version 296150 (0.0008) [2023-12-26 01:56:53,428][123091] Updated weights for policy 0, policy_version 296160 (0.0009) [2023-12-26 01:56:53,476][123091] Updated weights for policy 0, policy_version 296170 (0.0008) [2023-12-26 01:56:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 151273472. Throughput: 0: 9003.3, 1: 8858.2. Samples: 151249864. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:53,785][121949] Avg episode reward: [(0, '6392.317'), (1, '5561.846')] [2023-12-26 01:56:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000294720_75448320.pth... [2023-12-26 01:56:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000296176_75825152.pth... [2023-12-26 01:56:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000293664_75177984.pth [2023-12-26 01:56:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000295120_75554816.pth [2023-12-26 01:56:53,938][123090] Updated weights for policy 1, policy_version 294726 (0.0007) [2023-12-26 01:56:54,009][123090] Updated weights for policy 1, policy_version 294736 (0.0005) [2023-12-26 01:56:54,086][123090] Updated weights for policy 1, policy_version 294746 (0.0006) [2023-12-26 01:56:54,307][123091] Updated weights for policy 0, policy_version 296180 (0.0010) [2023-12-26 01:56:54,370][123091] Updated weights for policy 0, policy_version 296190 (0.0010) [2023-12-26 01:56:54,439][123091] Updated weights for policy 0, policy_version 296200 (0.0011) [2023-12-26 01:56:54,779][123090] Updated weights for policy 1, policy_version 294756 (0.0010) [2023-12-26 01:56:54,831][123090] Updated weights for policy 1, policy_version 294766 (0.0010) [2023-12-26 01:56:54,902][123090] Updated weights for policy 1, policy_version 294776 (0.0006) [2023-12-26 01:56:55,182][123091] Updated weights for policy 0, policy_version 296210 (0.0010) [2023-12-26 01:56:55,247][123091] Updated weights for policy 0, policy_version 296220 (0.0010) [2023-12-26 01:56:55,316][123091] Updated weights for policy 0, policy_version 296230 (0.0008) [2023-12-26 01:56:55,380][123091] Updated weights for policy 0, policy_version 296240 (0.0005) [2023-12-26 01:56:55,619][123090] Updated weights for policy 1, policy_version 294786 (0.0007) [2023-12-26 01:56:55,679][123090] Updated weights for policy 1, policy_version 294796 (0.0006) [2023-12-26 01:56:55,753][123090] Updated weights for policy 1, policy_version 294806 (0.0006) [2023-12-26 01:56:55,810][123090] Updated weights for policy 1, policy_version 294816 (0.0006) [2023-12-26 01:56:56,008][123091] Updated weights for policy 0, policy_version 296250 (0.0007) [2023-12-26 01:56:56,080][123091] Updated weights for policy 0, policy_version 296260 (0.0009) [2023-12-26 01:56:56,136][123091] Updated weights for policy 0, policy_version 296270 (0.0010) [2023-12-26 01:56:56,509][123090] Updated weights for policy 1, policy_version 294826 (0.0005) [2023-12-26 01:56:56,580][123090] Updated weights for policy 1, policy_version 294836 (0.0006) [2023-12-26 01:56:56,643][123090] Updated weights for policy 1, policy_version 294846 (0.0010) [2023-12-26 01:56:56,963][123091] Updated weights for policy 0, policy_version 296280 (0.0010) [2023-12-26 01:56:57,022][123091] Updated weights for policy 0, policy_version 296290 (0.0009) [2023-12-26 01:56:57,082][123091] Updated weights for policy 0, policy_version 296300 (0.0009) [2023-12-26 01:56:57,340][123090] Updated weights for policy 1, policy_version 294856 (0.0010) [2023-12-26 01:56:57,395][123090] Updated weights for policy 1, policy_version 294866 (0.0010) [2023-12-26 01:56:57,446][123090] Updated weights for policy 1, policy_version 294876 (0.0010) [2023-12-26 01:56:57,868][123091] Updated weights for policy 0, policy_version 296310 (0.0006) [2023-12-26 01:56:57,933][123091] Updated weights for policy 0, policy_version 296320 (0.0005) [2023-12-26 01:56:58,002][123091] Updated weights for policy 0, policy_version 296330 (0.0006) [2023-12-26 01:56:58,276][123090] Updated weights for policy 1, policy_version 294886 (0.0010) [2023-12-26 01:56:58,340][123090] Updated weights for policy 1, policy_version 294896 (0.0009) [2023-12-26 01:56:58,409][123090] Updated weights for policy 1, policy_version 294906 (0.0009) [2023-12-26 01:56:58,771][123091] Updated weights for policy 0, policy_version 296340 (0.0009) [2023-12-26 01:56:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 151363584. Throughput: 0: 9046.3, 1: 8952.9. Samples: 151360052. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:56:58,785][121949] Avg episode reward: [(0, '6345.376'), (1, '5557.264')] [2023-12-26 01:56:58,828][123091] Updated weights for policy 0, policy_version 296350 (0.0008) [2023-12-26 01:56:58,889][123091] Updated weights for policy 0, policy_version 296360 (0.0008) [2023-12-26 01:56:59,291][123090] Updated weights for policy 1, policy_version 294916 (0.0008) [2023-12-26 01:56:59,346][123090] Updated weights for policy 1, policy_version 294926 (0.0008) [2023-12-26 01:56:59,415][123090] Updated weights for policy 1, policy_version 294936 (0.0008) [2023-12-26 01:56:59,776][123091] Updated weights for policy 0, policy_version 296370 (0.0008) [2023-12-26 01:56:59,840][123091] Updated weights for policy 0, policy_version 296381 (0.0009) [2023-12-26 01:56:59,903][123091] Updated weights for policy 0, policy_version 296391 (0.0007) [2023-12-26 01:57:00,136][123090] Updated weights for policy 1, policy_version 294946 (0.0008) [2023-12-26 01:57:00,198][123090] Updated weights for policy 1, policy_version 294956 (0.0010) [2023-12-26 01:57:00,253][123090] Updated weights for policy 1, policy_version 294966 (0.0009) [2023-12-26 01:57:00,318][123090] Updated weights for policy 1, policy_version 294976 (0.0005) [2023-12-26 01:57:00,630][123091] Updated weights for policy 0, policy_version 296401 (0.0006) [2023-12-26 01:57:00,705][123091] Updated weights for policy 0, policy_version 296411 (0.0007) [2023-12-26 01:57:00,771][123091] Updated weights for policy 0, policy_version 296421 (0.0009) [2023-12-26 01:57:00,824][123091] Updated weights for policy 0, policy_version 296431 (0.0010) [2023-12-26 01:57:01,030][123090] Updated weights for policy 1, policy_version 294986 (0.0007) [2023-12-26 01:57:01,087][123090] Updated weights for policy 1, policy_version 294996 (0.0009) [2023-12-26 01:57:01,151][123090] Updated weights for policy 1, policy_version 295006 (0.0008) [2023-12-26 01:57:01,565][123091] Updated weights for policy 0, policy_version 296441 (0.0010) [2023-12-26 01:57:01,620][123091] Updated weights for policy 0, policy_version 296451 (0.0009) [2023-12-26 01:57:01,676][123091] Updated weights for policy 0, policy_version 296461 (0.0008) [2023-12-26 01:57:01,871][123090] Updated weights for policy 1, policy_version 295016 (0.0008) [2023-12-26 01:57:01,938][123090] Updated weights for policy 1, policy_version 295027 (0.0007) [2023-12-26 01:57:02,002][123090] Updated weights for policy 1, policy_version 295037 (0.0006) [2023-12-26 01:57:02,436][123091] Updated weights for policy 0, policy_version 296471 (0.0008) [2023-12-26 01:57:02,484][123091] Updated weights for policy 0, policy_version 296481 (0.0009) [2023-12-26 01:57:02,531][123091] Updated weights for policy 0, policy_version 296491 (0.0007) [2023-12-26 01:57:02,743][123090] Updated weights for policy 1, policy_version 295047 (0.0005) [2023-12-26 01:57:02,808][123090] Updated weights for policy 1, policy_version 295057 (0.0007) [2023-12-26 01:57:02,878][123090] Updated weights for policy 1, policy_version 295067 (0.0010) [2023-12-26 01:57:03,307][123091] Updated weights for policy 0, policy_version 296501 (0.0008) [2023-12-26 01:57:03,371][123091] Updated weights for policy 0, policy_version 296511 (0.0010) [2023-12-26 01:57:03,425][123091] Updated weights for policy 0, policy_version 296521 (0.0010) [2023-12-26 01:57:03,587][123090] Updated weights for policy 1, policy_version 295077 (0.0009) [2023-12-26 01:57:03,647][123090] Updated weights for policy 1, policy_version 295087 (0.0009) [2023-12-26 01:57:03,694][123090] Updated weights for policy 1, policy_version 295097 (0.0008) [2023-12-26 01:57:03,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 151461888. Throughput: 0: 9083.5, 1: 9045.1. Samples: 151469388. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:03,785][121949] Avg episode reward: [(0, '6341.057'), (1, '5637.212')] [2023-12-26 01:57:04,169][123091] Updated weights for policy 0, policy_version 296531 (0.0009) [2023-12-26 01:57:04,237][123091] Updated weights for policy 0, policy_version 296541 (0.0006) [2023-12-26 01:57:04,303][123091] Updated weights for policy 0, policy_version 296551 (0.0009) [2023-12-26 01:57:04,612][123090] Updated weights for policy 1, policy_version 295107 (0.0009) [2023-12-26 01:57:04,681][123090] Updated weights for policy 1, policy_version 295117 (0.0009) [2023-12-26 01:57:04,746][123090] Updated weights for policy 1, policy_version 295127 (0.0009) [2023-12-26 01:57:05,050][123091] Updated weights for policy 0, policy_version 296561 (0.0010) [2023-12-26 01:57:05,111][123091] Updated weights for policy 0, policy_version 296571 (0.0006) [2023-12-26 01:57:05,170][123091] Updated weights for policy 0, policy_version 296581 (0.0006) [2023-12-26 01:57:05,232][123091] Updated weights for policy 0, policy_version 296591 (0.0005) [2023-12-26 01:57:05,634][123090] Updated weights for policy 1, policy_version 295137 (0.0009) [2023-12-26 01:57:05,694][123090] Updated weights for policy 1, policy_version 295147 (0.0009) [2023-12-26 01:57:05,762][123090] Updated weights for policy 1, policy_version 295157 (0.0009) [2023-12-26 01:57:05,822][123090] Updated weights for policy 1, policy_version 295167 (0.0006) [2023-12-26 01:57:05,939][123091] Updated weights for policy 0, policy_version 296601 (0.0010) [2023-12-26 01:57:05,986][123091] Updated weights for policy 0, policy_version 296611 (0.0010) [2023-12-26 01:57:06,056][123091] Updated weights for policy 0, policy_version 296621 (0.0007) [2023-12-26 01:57:06,614][123090] Updated weights for policy 1, policy_version 295177 (0.0009) [2023-12-26 01:57:06,679][123090] Updated weights for policy 1, policy_version 295187 (0.0009) [2023-12-26 01:57:06,748][123090] Updated weights for policy 1, policy_version 295197 (0.0009) [2023-12-26 01:57:06,863][123091] Updated weights for policy 0, policy_version 296631 (0.0011) [2023-12-26 01:57:06,921][123091] Updated weights for policy 0, policy_version 296641 (0.0010) [2023-12-26 01:57:06,969][123091] Updated weights for policy 0, policy_version 296651 (0.0009) [2023-12-26 01:57:07,636][123090] Updated weights for policy 1, policy_version 295207 (0.0009) [2023-12-26 01:57:07,684][123090] Updated weights for policy 1, policy_version 295217 (0.0009) [2023-12-26 01:57:07,716][123091] Updated weights for policy 0, policy_version 296661 (0.0007) [2023-12-26 01:57:07,735][123090] Updated weights for policy 1, policy_version 295227 (0.0009) [2023-12-26 01:57:07,780][123091] Updated weights for policy 0, policy_version 296671 (0.0008) [2023-12-26 01:57:07,829][123091] Updated weights for policy 0, policy_version 296681 (0.0009) [2023-12-26 01:57:08,594][123090] Updated weights for policy 1, policy_version 295237 (0.0010) [2023-12-26 01:57:08,642][123090] Updated weights for policy 1, policy_version 295247 (0.0009) [2023-12-26 01:57:08,662][123091] Updated weights for policy 0, policy_version 296691 (0.0009) [2023-12-26 01:57:08,708][123090] Updated weights for policy 1, policy_version 295257 (0.0007) [2023-12-26 01:57:08,710][123091] Updated weights for policy 0, policy_version 296701 (0.0009) [2023-12-26 01:57:08,775][123091] Updated weights for policy 0, policy_version 296711 (0.0007) [2023-12-26 01:57:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 151543808. Throughput: 0: 9111.7, 1: 9062.7. Samples: 151522180. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:08,785][121949] Avg episode reward: [(0, '6264.361'), (1, '5441.541')] [2023-12-26 01:57:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000295264_75587584.pth... [2023-12-26 01:57:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000294208_75317248.pth [2023-12-26 01:57:08,835][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000296720_75964416.pth... [2023-12-26 01:57:08,839][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000295664_75694080.pth [2023-12-26 01:57:09,556][123090] Updated weights for policy 1, policy_version 295267 (0.0009) [2023-12-26 01:57:09,625][123090] Updated weights for policy 1, policy_version 295277 (0.0010) [2023-12-26 01:57:09,641][123091] Updated weights for policy 0, policy_version 296721 (0.0009) [2023-12-26 01:57:09,696][123090] Updated weights for policy 1, policy_version 295287 (0.0011) [2023-12-26 01:57:09,705][123091] Updated weights for policy 0, policy_version 296731 (0.0010) [2023-12-26 01:57:09,760][123091] Updated weights for policy 0, policy_version 296741 (0.0010) [2023-12-26 01:57:09,822][123091] Updated weights for policy 0, policy_version 296751 (0.0010) [2023-12-26 01:57:10,494][123090] Updated weights for policy 1, policy_version 295297 (0.0011) [2023-12-26 01:57:10,561][123090] Updated weights for policy 1, policy_version 295307 (0.0009) [2023-12-26 01:57:10,630][123090] Updated weights for policy 1, policy_version 295317 (0.0010) [2023-12-26 01:57:10,679][123090] Updated weights for policy 1, policy_version 295327 (0.0008) [2023-12-26 01:57:10,684][123091] Updated weights for policy 0, policy_version 296761 (0.0006) [2023-12-26 01:57:10,758][123091] Updated weights for policy 0, policy_version 296771 (0.0006) [2023-12-26 01:57:10,822][123091] Updated weights for policy 0, policy_version 296781 (0.0010) [2023-12-26 01:57:11,562][123090] Updated weights for policy 1, policy_version 295337 (0.0009) [2023-12-26 01:57:11,588][123091] Updated weights for policy 0, policy_version 296791 (0.0006) [2023-12-26 01:57:11,639][123090] Updated weights for policy 1, policy_version 295347 (0.0009) [2023-12-26 01:57:11,657][123091] Updated weights for policy 0, policy_version 296801 (0.0013) [2023-12-26 01:57:11,711][123090] Updated weights for policy 1, policy_version 295357 (0.0008) [2023-12-26 01:57:11,722][123091] Updated weights for policy 0, policy_version 296811 (0.0011) [2023-12-26 01:57:12,484][123091] Updated weights for policy 0, policy_version 296821 (0.0007) [2023-12-26 01:57:12,548][123091] Updated weights for policy 0, policy_version 296831 (0.0006) [2023-12-26 01:57:12,564][123090] Updated weights for policy 1, policy_version 295367 (0.0009) [2023-12-26 01:57:12,608][123091] Updated weights for policy 0, policy_version 296841 (0.0007) [2023-12-26 01:57:12,631][123090] Updated weights for policy 1, policy_version 295377 (0.0008) [2023-12-26 01:57:12,695][123090] Updated weights for policy 1, policy_version 295387 (0.0009) [2023-12-26 01:57:13,355][123090] Updated weights for policy 1, policy_version 295397 (0.0006) [2023-12-26 01:57:13,403][123090] Updated weights for policy 1, policy_version 295407 (0.0005) [2023-12-26 01:57:13,454][123090] Updated weights for policy 1, policy_version 295417 (0.0005) [2023-12-26 01:57:13,467][123091] Updated weights for policy 0, policy_version 296851 (0.0007) [2023-12-26 01:57:13,523][123091] Updated weights for policy 0, policy_version 296861 (0.0009) [2023-12-26 01:57:13,576][123091] Updated weights for policy 0, policy_version 296871 (0.0010) [2023-12-26 01:57:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 151633920. Throughput: 0: 8991.1, 1: 8885.8. Samples: 151623732. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:13,785][121949] Avg episode reward: [(0, '6224.383'), (1, '5263.251')] [2023-12-26 01:57:14,160][123090] Updated weights for policy 1, policy_version 295427 (0.0005) [2023-12-26 01:57:14,215][123090] Updated weights for policy 1, policy_version 295437 (0.0006) [2023-12-26 01:57:14,274][123090] Updated weights for policy 1, policy_version 295447 (0.0007) [2023-12-26 01:57:14,496][123091] Updated weights for policy 0, policy_version 296881 (0.0009) [2023-12-26 01:57:14,562][123091] Updated weights for policy 0, policy_version 296891 (0.0010) [2023-12-26 01:57:14,632][123091] Updated weights for policy 0, policy_version 296901 (0.0009) [2023-12-26 01:57:14,691][123091] Updated weights for policy 0, policy_version 296911 (0.0008) [2023-12-26 01:57:14,994][123090] Updated weights for policy 1, policy_version 295457 (0.0006) [2023-12-26 01:57:15,061][123090] Updated weights for policy 1, policy_version 295467 (0.0010) [2023-12-26 01:57:15,120][123090] Updated weights for policy 1, policy_version 295477 (0.0011) [2023-12-26 01:57:15,181][123090] Updated weights for policy 1, policy_version 295487 (0.0011) [2023-12-26 01:57:15,514][123091] Updated weights for policy 0, policy_version 296921 (0.0009) [2023-12-26 01:57:15,566][123091] Updated weights for policy 0, policy_version 296931 (0.0008) [2023-12-26 01:57:15,616][123091] Updated weights for policy 0, policy_version 296941 (0.0009) [2023-12-26 01:57:15,955][123090] Updated weights for policy 1, policy_version 295497 (0.0008) [2023-12-26 01:57:16,018][123090] Updated weights for policy 1, policy_version 295507 (0.0010) [2023-12-26 01:57:16,069][123090] Updated weights for policy 1, policy_version 295517 (0.0010) [2023-12-26 01:57:16,514][123091] Updated weights for policy 0, policy_version 296951 (0.0009) [2023-12-26 01:57:16,572][123091] Updated weights for policy 0, policy_version 296961 (0.0009) [2023-12-26 01:57:16,622][123091] Updated weights for policy 0, policy_version 296971 (0.0009) [2023-12-26 01:57:16,877][123090] Updated weights for policy 1, policy_version 295527 (0.0010) [2023-12-26 01:57:16,928][123090] Updated weights for policy 1, policy_version 295537 (0.0009) [2023-12-26 01:57:16,978][123090] Updated weights for policy 1, policy_version 295547 (0.0010) [2023-12-26 01:57:17,483][123091] Updated weights for policy 0, policy_version 296981 (0.0010) [2023-12-26 01:57:17,552][123091] Updated weights for policy 0, policy_version 296991 (0.0009) [2023-12-26 01:57:17,623][123091] Updated weights for policy 0, policy_version 297001 (0.0010) [2023-12-26 01:57:17,654][123090] Updated weights for policy 1, policy_version 295557 (0.0007) [2023-12-26 01:57:17,717][123090] Updated weights for policy 1, policy_version 295567 (0.0005) [2023-12-26 01:57:17,785][123090] Updated weights for policy 1, policy_version 295577 (0.0006) [2023-12-26 01:57:18,472][123091] Updated weights for policy 0, policy_version 297011 (0.0010) [2023-12-26 01:57:18,536][123091] Updated weights for policy 0, policy_version 297021 (0.0009) [2023-12-26 01:57:18,550][123090] Updated weights for policy 1, policy_version 295587 (0.0009) [2023-12-26 01:57:18,596][123091] Updated weights for policy 0, policy_version 297031 (0.0009) [2023-12-26 01:57:18,607][123090] Updated weights for policy 1, policy_version 295597 (0.0006) [2023-12-26 01:57:18,672][123090] Updated weights for policy 1, policy_version 295607 (0.0009) [2023-12-26 01:57:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 151724032. Throughput: 0: 8804.8, 1: 8940.6. Samples: 151729612. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:18,785][121949] Avg episode reward: [(0, '6117.479'), (1, '5222.429')] [2023-12-26 01:57:19,424][123091] Updated weights for policy 0, policy_version 297041 (0.0007) [2023-12-26 01:57:19,495][123091] Updated weights for policy 0, policy_version 297051 (0.0009) [2023-12-26 01:57:19,510][123090] Updated weights for policy 1, policy_version 295617 (0.0009) [2023-12-26 01:57:19,563][123091] Updated weights for policy 0, policy_version 297061 (0.0009) [2023-12-26 01:57:19,582][123090] Updated weights for policy 1, policy_version 295627 (0.0009) [2023-12-26 01:57:19,627][123091] Updated weights for policy 0, policy_version 297071 (0.0010) [2023-12-26 01:57:19,652][123090] Updated weights for policy 1, policy_version 295637 (0.0008) [2023-12-26 01:57:19,715][123090] Updated weights for policy 1, policy_version 295647 (0.0009) [2023-12-26 01:57:20,446][123091] Updated weights for policy 0, policy_version 297081 (0.0009) [2023-12-26 01:57:20,514][123091] Updated weights for policy 0, policy_version 297091 (0.0009) [2023-12-26 01:57:20,543][123090] Updated weights for policy 1, policy_version 295657 (0.0008) [2023-12-26 01:57:20,577][123091] Updated weights for policy 0, policy_version 297101 (0.0009) [2023-12-26 01:57:20,618][123090] Updated weights for policy 1, policy_version 295667 (0.0010) [2023-12-26 01:57:20,674][123090] Updated weights for policy 1, policy_version 295677 (0.0009) [2023-12-26 01:57:21,389][123091] Updated weights for policy 0, policy_version 297111 (0.0008) [2023-12-26 01:57:21,446][123091] Updated weights for policy 0, policy_version 297121 (0.0006) [2023-12-26 01:57:21,498][123091] Updated weights for policy 0, policy_version 297131 (0.0005) [2023-12-26 01:57:21,575][123090] Updated weights for policy 1, policy_version 295687 (0.0009) [2023-12-26 01:57:21,641][123090] Updated weights for policy 1, policy_version 295698 (0.0010) [2023-12-26 01:57:21,710][123090] Updated weights for policy 1, policy_version 295708 (0.0009) [2023-12-26 01:57:22,266][123091] Updated weights for policy 0, policy_version 297141 (0.0007) [2023-12-26 01:57:22,337][123091] Updated weights for policy 0, policy_version 297151 (0.0009) [2023-12-26 01:57:22,403][123091] Updated weights for policy 0, policy_version 297161 (0.0010) [2023-12-26 01:57:22,639][123090] Updated weights for policy 1, policy_version 295718 (0.0010) [2023-12-26 01:57:22,700][123090] Updated weights for policy 1, policy_version 295728 (0.0009) [2023-12-26 01:57:22,765][123090] Updated weights for policy 1, policy_version 295738 (0.0010) [2023-12-26 01:57:23,203][123091] Updated weights for policy 0, policy_version 297171 (0.0006) [2023-12-26 01:57:23,275][123091] Updated weights for policy 0, policy_version 297181 (0.0008) [2023-12-26 01:57:23,342][123091] Updated weights for policy 0, policy_version 297191 (0.0008) [2023-12-26 01:57:23,623][123090] Updated weights for policy 1, policy_version 295748 (0.0009) [2023-12-26 01:57:23,698][123090] Updated weights for policy 1, policy_version 295758 (0.0005) [2023-12-26 01:57:23,770][123090] Updated weights for policy 1, policy_version 295768 (0.0005) [2023-12-26 01:57:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 151797760. Throughput: 0: 8753.1, 1: 8884.8. Samples: 151779764. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:23,785][121949] Avg episode reward: [(0, '6103.116'), (1, '5171.133')] [2023-12-26 01:57:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000297200_76087296.pth... [2023-12-26 01:57:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000296176_75825152.pth [2023-12-26 01:57:23,817][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000295776_75718656.pth... [2023-12-26 01:57:23,821][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000294720_75448320.pth [2023-12-26 01:57:24,024][123091] Updated weights for policy 0, policy_version 297201 (0.0008) [2023-12-26 01:57:24,075][123091] Updated weights for policy 0, policy_version 297211 (0.0009) [2023-12-26 01:57:24,129][123091] Updated weights for policy 0, policy_version 297221 (0.0008) [2023-12-26 01:57:24,193][123091] Updated weights for policy 0, policy_version 297231 (0.0006) [2023-12-26 01:57:24,477][123090] Updated weights for policy 1, policy_version 295778 (0.0007) [2023-12-26 01:57:24,542][123090] Updated weights for policy 1, policy_version 295788 (0.0005) [2023-12-26 01:57:24,599][123090] Updated weights for policy 1, policy_version 295798 (0.0005) [2023-12-26 01:57:24,651][123090] Updated weights for policy 1, policy_version 295808 (0.0005) [2023-12-26 01:57:24,912][123091] Updated weights for policy 0, policy_version 297241 (0.0005) [2023-12-26 01:57:24,963][123091] Updated weights for policy 0, policy_version 297251 (0.0005) [2023-12-26 01:57:25,017][123091] Updated weights for policy 0, policy_version 297261 (0.0005) [2023-12-26 01:57:25,331][123090] Updated weights for policy 1, policy_version 295818 (0.0005) [2023-12-26 01:57:25,388][123090] Updated weights for policy 1, policy_version 295828 (0.0005) [2023-12-26 01:57:25,448][123090] Updated weights for policy 1, policy_version 295838 (0.0005) [2023-12-26 01:57:25,787][123091] Updated weights for policy 0, policy_version 297271 (0.0005) [2023-12-26 01:57:25,856][123091] Updated weights for policy 0, policy_version 297281 (0.0005) [2023-12-26 01:57:25,920][123091] Updated weights for policy 0, policy_version 297291 (0.0005) [2023-12-26 01:57:26,134][123090] Updated weights for policy 1, policy_version 295848 (0.0009) [2023-12-26 01:57:26,187][123090] Updated weights for policy 1, policy_version 295858 (0.0010) [2023-12-26 01:57:26,246][123090] Updated weights for policy 1, policy_version 295868 (0.0010) [2023-12-26 01:57:26,604][123091] Updated weights for policy 0, policy_version 297301 (0.0005) [2023-12-26 01:57:26,663][123091] Updated weights for policy 0, policy_version 297311 (0.0005) [2023-12-26 01:57:26,709][123091] Updated weights for policy 0, policy_version 297321 (0.0005) [2023-12-26 01:57:27,067][123090] Updated weights for policy 1, policy_version 295878 (0.0007) [2023-12-26 01:57:27,116][123090] Updated weights for policy 1, policy_version 295888 (0.0005) [2023-12-26 01:57:27,163][123090] Updated weights for policy 1, policy_version 295898 (0.0005) [2023-12-26 01:57:27,336][123091] Updated weights for policy 0, policy_version 297331 (0.0005) [2023-12-26 01:57:27,404][123091] Updated weights for policy 0, policy_version 297341 (0.0010) [2023-12-26 01:57:27,465][123091] Updated weights for policy 0, policy_version 297351 (0.0007) [2023-12-26 01:57:27,927][123090] Updated weights for policy 1, policy_version 295908 (0.0007) [2023-12-26 01:57:27,982][123091] Updated weights for policy 0, policy_version 297361 (0.0005) [2023-12-26 01:57:27,982][123090] Updated weights for policy 1, policy_version 295918 (0.0009) [2023-12-26 01:57:28,035][123090] Updated weights for policy 1, policy_version 295928 (0.0009) [2023-12-26 01:57:28,042][123091] Updated weights for policy 0, policy_version 297371 (0.0005) [2023-12-26 01:57:28,105][123091] Updated weights for policy 0, policy_version 297381 (0.0005) [2023-12-26 01:57:28,170][123091] Updated weights for policy 0, policy_version 297391 (0.0005) [2023-12-26 01:57:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 151896064. Throughput: 0: 8920.4, 1: 8964.0. Samples: 151892664. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:28,784][121949] Avg episode reward: [(0, '6143.131'), (1, '5140.979')] [2023-12-26 01:57:28,835][123091] Updated weights for policy 0, policy_version 297401 (0.0008) [2023-12-26 01:57:28,889][123091] Updated weights for policy 0, policy_version 297411 (0.0009) [2023-12-26 01:57:28,942][123091] Updated weights for policy 0, policy_version 297421 (0.0007) [2023-12-26 01:57:28,972][123090] Updated weights for policy 1, policy_version 295938 (0.0008) [2023-12-26 01:57:29,032][123090] Updated weights for policy 1, policy_version 295948 (0.0008) [2023-12-26 01:57:29,080][123090] Updated weights for policy 1, policy_version 295958 (0.0009) [2023-12-26 01:57:29,132][123090] Updated weights for policy 1, policy_version 295968 (0.0009) [2023-12-26 01:57:29,704][123091] Updated weights for policy 0, policy_version 297431 (0.0007) [2023-12-26 01:57:29,767][123091] Updated weights for policy 0, policy_version 297441 (0.0005) [2023-12-26 01:57:29,829][123091] Updated weights for policy 0, policy_version 297451 (0.0006) [2023-12-26 01:57:29,951][123090] Updated weights for policy 1, policy_version 295978 (0.0007) [2023-12-26 01:57:30,004][123090] Updated weights for policy 1, policy_version 295988 (0.0006) [2023-12-26 01:57:30,053][123090] Updated weights for policy 1, policy_version 295998 (0.0007) [2023-12-26 01:57:30,529][123091] Updated weights for policy 0, policy_version 297461 (0.0010) [2023-12-26 01:57:30,598][123091] Updated weights for policy 0, policy_version 297471 (0.0010) [2023-12-26 01:57:30,645][123091] Updated weights for policy 0, policy_version 297481 (0.0010) [2023-12-26 01:57:30,886][123090] Updated weights for policy 1, policy_version 296008 (0.0009) [2023-12-26 01:57:30,947][123090] Updated weights for policy 1, policy_version 296018 (0.0009) [2023-12-26 01:57:31,004][123090] Updated weights for policy 1, policy_version 296028 (0.0009) [2023-12-26 01:57:31,389][123091] Updated weights for policy 0, policy_version 297491 (0.0010) [2023-12-26 01:57:31,451][123091] Updated weights for policy 0, policy_version 297501 (0.0006) [2023-12-26 01:57:31,507][123091] Updated weights for policy 0, policy_version 297511 (0.0005) [2023-12-26 01:57:31,904][123090] Updated weights for policy 1, policy_version 296039 (0.0009) [2023-12-26 01:57:31,974][123090] Updated weights for policy 1, policy_version 296049 (0.0009) [2023-12-26 01:57:32,034][123090] Updated weights for policy 1, policy_version 296059 (0.0008) [2023-12-26 01:57:32,259][123091] Updated weights for policy 0, policy_version 297521 (0.0006) [2023-12-26 01:57:32,313][123091] Updated weights for policy 0, policy_version 297531 (0.0010) [2023-12-26 01:57:32,369][123091] Updated weights for policy 0, policy_version 297541 (0.0011) [2023-12-26 01:57:32,423][123091] Updated weights for policy 0, policy_version 297551 (0.0010) [2023-12-26 01:57:32,914][123090] Updated weights for policy 1, policy_version 296069 (0.0009) [2023-12-26 01:57:32,982][123090] Updated weights for policy 1, policy_version 296079 (0.0007) [2023-12-26 01:57:33,058][123090] Updated weights for policy 1, policy_version 296089 (0.0007) [2023-12-26 01:57:33,100][123091] Updated weights for policy 0, policy_version 297561 (0.0010) [2023-12-26 01:57:33,155][123091] Updated weights for policy 0, policy_version 297571 (0.0010) [2023-12-26 01:57:33,198][123091] Updated weights for policy 0, policy_version 297581 (0.0010) [2023-12-26 01:57:33,743][123090] Updated weights for policy 1, policy_version 296099 (0.0006) [2023-12-26 01:57:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 151986176. Throughput: 0: 9029.7, 1: 8818.9. Samples: 152002360. Policy #0 lag: (min: 31.0, avg: 32.7, max: 63.0) [2023-12-26 01:57:33,784][121949] Avg episode reward: [(0, '6101.101'), (1, '5348.910')] [2023-12-26 01:57:33,795][123090] Updated weights for policy 1, policy_version 296109 (0.0005) [2023-12-26 01:57:33,848][123090] Updated weights for policy 1, policy_version 296119 (0.0005) [2023-12-26 01:57:33,899][123091] Updated weights for policy 0, policy_version 297591 (0.0007) [2023-12-26 01:57:33,947][123091] Updated weights for policy 0, policy_version 297601 (0.0006) [2023-12-26 01:57:33,997][123091] Updated weights for policy 0, policy_version 297611 (0.0005) [2023-12-26 01:57:34,609][123090] Updated weights for policy 1, policy_version 296129 (0.0005) [2023-12-26 01:57:34,678][123090] Updated weights for policy 1, policy_version 296139 (0.0008) [2023-12-26 01:57:34,740][123090] Updated weights for policy 1, policy_version 296149 (0.0010) [2023-12-26 01:57:34,747][123091] Updated weights for policy 0, policy_version 297621 (0.0006) [2023-12-26 01:57:34,802][123090] Updated weights for policy 1, policy_version 296159 (0.0008) [2023-12-26 01:57:34,808][123091] Updated weights for policy 0, policy_version 297631 (0.0008) [2023-12-26 01:57:34,868][123091] Updated weights for policy 0, policy_version 297641 (0.0009) [2023-12-26 01:57:35,470][123091] Updated weights for policy 0, policy_version 297651 (0.0010) [2023-12-26 01:57:35,524][123091] Updated weights for policy 0, policy_version 297661 (0.0009) [2023-12-26 01:57:35,547][123090] Updated weights for policy 1, policy_version 296169 (0.0006) [2023-12-26 01:57:35,585][123091] Updated weights for policy 0, policy_version 297671 (0.0010) [2023-12-26 01:57:35,606][123090] Updated weights for policy 1, policy_version 296179 (0.0010) [2023-12-26 01:57:35,667][123090] Updated weights for policy 1, policy_version 296189 (0.0011) [2023-12-26 01:57:36,393][123091] Updated weights for policy 0, policy_version 297681 (0.0007) [2023-12-26 01:57:36,415][123090] Updated weights for policy 1, policy_version 296199 (0.0011) [2023-12-26 01:57:36,452][123091] Updated weights for policy 0, policy_version 297691 (0.0006) [2023-12-26 01:57:36,481][123090] Updated weights for policy 1, policy_version 296209 (0.0009) [2023-12-26 01:57:36,514][123091] Updated weights for policy 0, policy_version 297701 (0.0006) [2023-12-26 01:57:36,545][123090] Updated weights for policy 1, policy_version 296219 (0.0011) [2023-12-26 01:57:36,581][123091] Updated weights for policy 0, policy_version 297711 (0.0006) [2023-12-26 01:57:37,322][123091] Updated weights for policy 0, policy_version 297721 (0.0005) [2023-12-26 01:57:37,355][123090] Updated weights for policy 1, policy_version 296229 (0.0008) [2023-12-26 01:57:37,371][123091] Updated weights for policy 0, policy_version 297731 (0.0006) [2023-12-26 01:57:37,412][123090] Updated weights for policy 1, policy_version 296239 (0.0005) [2023-12-26 01:57:37,432][123091] Updated weights for policy 0, policy_version 297741 (0.0009) [2023-12-26 01:57:37,474][123090] Updated weights for policy 1, policy_version 296249 (0.0005) [2023-12-26 01:57:38,184][123091] Updated weights for policy 0, policy_version 297751 (0.0009) [2023-12-26 01:57:38,245][123091] Updated weights for policy 0, policy_version 297761 (0.0010) [2023-12-26 01:57:38,309][123091] Updated weights for policy 0, policy_version 297771 (0.0010) [2023-12-26 01:57:38,309][123090] Updated weights for policy 1, policy_version 296259 (0.0007) [2023-12-26 01:57:38,371][123090] Updated weights for policy 1, policy_version 296269 (0.0010) [2023-12-26 01:57:38,432][123090] Updated weights for policy 1, policy_version 296279 (0.0010) [2023-12-26 01:57:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 152084480. Throughput: 0: 9112.9, 1: 8859.4. Samples: 152058620. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:57:38,785][121949] Avg episode reward: [(0, '6001.050'), (1, '5407.433')] [2023-12-26 01:57:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000297776_76234752.pth... [2023-12-26 01:57:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000296288_75849728.pth... [2023-12-26 01:57:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000296720_75964416.pth [2023-12-26 01:57:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000295264_75587584.pth [2023-12-26 01:57:39,110][123091] Updated weights for policy 0, policy_version 297781 (0.0009) [2023-12-26 01:57:39,177][123091] Updated weights for policy 0, policy_version 297791 (0.0009) [2023-12-26 01:57:39,243][123091] Updated weights for policy 0, policy_version 297801 (0.0010) [2023-12-26 01:57:39,265][123090] Updated weights for policy 1, policy_version 296289 (0.0008) [2023-12-26 01:57:39,324][123090] Updated weights for policy 1, policy_version 296300 (0.0009) [2023-12-26 01:57:39,393][123090] Updated weights for policy 1, policy_version 296310 (0.0009) [2023-12-26 01:57:39,458][123090] Updated weights for policy 1, policy_version 296320 (0.0009) [2023-12-26 01:57:40,058][123091] Updated weights for policy 0, policy_version 297811 (0.0010) [2023-12-26 01:57:40,111][123091] Updated weights for policy 0, policy_version 297821 (0.0009) [2023-12-26 01:57:40,169][123091] Updated weights for policy 0, policy_version 297831 (0.0005) [2023-12-26 01:57:40,302][123090] Updated weights for policy 1, policy_version 296330 (0.0009) [2023-12-26 01:57:40,367][123090] Updated weights for policy 1, policy_version 296340 (0.0006) [2023-12-26 01:57:40,430][123090] Updated weights for policy 1, policy_version 296350 (0.0011) [2023-12-26 01:57:40,887][123091] Updated weights for policy 0, policy_version 297841 (0.0006) [2023-12-26 01:57:40,946][123091] Updated weights for policy 0, policy_version 297851 (0.0010) [2023-12-26 01:57:41,009][123091] Updated weights for policy 0, policy_version 297861 (0.0010) [2023-12-26 01:57:41,073][123091] Updated weights for policy 0, policy_version 297871 (0.0010) [2023-12-26 01:57:41,277][123090] Updated weights for policy 1, policy_version 296360 (0.0010) [2023-12-26 01:57:41,340][123090] Updated weights for policy 1, policy_version 296370 (0.0008) [2023-12-26 01:57:41,416][123090] Updated weights for policy 1, policy_version 296380 (0.0008) [2023-12-26 01:57:41,917][123091] Updated weights for policy 0, policy_version 297881 (0.0011) [2023-12-26 01:57:41,970][123091] Updated weights for policy 0, policy_version 297891 (0.0011) [2023-12-26 01:57:42,034][123091] Updated weights for policy 0, policy_version 297901 (0.0011) [2023-12-26 01:57:42,236][123090] Updated weights for policy 1, policy_version 296390 (0.0009) [2023-12-26 01:57:42,307][123090] Updated weights for policy 1, policy_version 296400 (0.0008) [2023-12-26 01:57:42,379][123090] Updated weights for policy 1, policy_version 296410 (0.0009) [2023-12-26 01:57:42,879][123091] Updated weights for policy 0, policy_version 297911 (0.0011) [2023-12-26 01:57:42,927][123091] Updated weights for policy 0, policy_version 297921 (0.0010) [2023-12-26 01:57:42,986][123091] Updated weights for policy 0, policy_version 297931 (0.0010) [2023-12-26 01:57:43,204][123090] Updated weights for policy 1, policy_version 296420 (0.0009) [2023-12-26 01:57:43,252][123090] Updated weights for policy 1, policy_version 296430 (0.0009) [2023-12-26 01:57:43,300][123090] Updated weights for policy 1, policy_version 296440 (0.0008) [2023-12-26 01:57:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 152166400. Throughput: 0: 9106.1, 1: 8727.1. Samples: 152162548. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:57:43,785][121949] Avg episode reward: [(0, '6049.037'), (1, '5553.501')] [2023-12-26 01:57:43,833][123091] Updated weights for policy 0, policy_version 297941 (0.0008) [2023-12-26 01:57:43,902][123091] Updated weights for policy 0, policy_version 297951 (0.0005) [2023-12-26 01:57:43,976][123091] Updated weights for policy 0, policy_version 297961 (0.0005) [2023-12-26 01:57:44,158][123090] Updated weights for policy 1, policy_version 296450 (0.0008) [2023-12-26 01:57:44,206][123090] Updated weights for policy 1, policy_version 296460 (0.0005) [2023-12-26 01:57:44,257][123090] Updated weights for policy 1, policy_version 296470 (0.0006) [2023-12-26 01:57:44,312][123090] Updated weights for policy 1, policy_version 296480 (0.0008) [2023-12-26 01:57:44,582][123091] Updated weights for policy 0, policy_version 297971 (0.0006) [2023-12-26 01:57:44,632][123091] Updated weights for policy 0, policy_version 297981 (0.0005) [2023-12-26 01:57:44,682][123091] Updated weights for policy 0, policy_version 297991 (0.0005) [2023-12-26 01:57:45,107][123090] Updated weights for policy 1, policy_version 296490 (0.0007) [2023-12-26 01:57:45,181][123090] Updated weights for policy 1, policy_version 296500 (0.0010) [2023-12-26 01:57:45,254][123090] Updated weights for policy 1, policy_version 296510 (0.0009) [2023-12-26 01:57:45,461][123091] Updated weights for policy 0, policy_version 298001 (0.0006) [2023-12-26 01:57:45,514][123091] Updated weights for policy 0, policy_version 298011 (0.0005) [2023-12-26 01:57:45,574][123091] Updated weights for policy 0, policy_version 298021 (0.0005) [2023-12-26 01:57:45,623][123091] Updated weights for policy 0, policy_version 298031 (0.0005) [2023-12-26 01:57:46,144][123090] Updated weights for policy 1, policy_version 296520 (0.0010) [2023-12-26 01:57:46,210][123090] Updated weights for policy 1, policy_version 296530 (0.0010) [2023-12-26 01:57:46,273][123090] Updated weights for policy 1, policy_version 296540 (0.0009) [2023-12-26 01:57:46,283][123091] Updated weights for policy 0, policy_version 298041 (0.0005) [2023-12-26 01:57:46,348][123091] Updated weights for policy 0, policy_version 298051 (0.0005) [2023-12-26 01:57:46,407][123091] Updated weights for policy 0, policy_version 298061 (0.0005) [2023-12-26 01:57:47,063][123091] Updated weights for policy 0, policy_version 298071 (0.0005) [2023-12-26 01:57:47,122][123091] Updated weights for policy 0, policy_version 298081 (0.0005) [2023-12-26 01:57:47,184][123091] Updated weights for policy 0, policy_version 298091 (0.0005) [2023-12-26 01:57:47,212][123090] Updated weights for policy 1, policy_version 296550 (0.0007) [2023-12-26 01:57:47,264][123090] Updated weights for policy 1, policy_version 296560 (0.0005) [2023-12-26 01:57:47,333][123090] Updated weights for policy 1, policy_version 296570 (0.0008) [2023-12-26 01:57:47,912][123091] Updated weights for policy 0, policy_version 298101 (0.0008) [2023-12-26 01:57:47,967][123091] Updated weights for policy 0, policy_version 298111 (0.0011) [2023-12-26 01:57:48,014][123091] Updated weights for policy 0, policy_version 298121 (0.0010) [2023-12-26 01:57:48,113][123090] Updated weights for policy 1, policy_version 296580 (0.0010) [2023-12-26 01:57:48,160][123090] Updated weights for policy 1, policy_version 296590 (0.0006) [2023-12-26 01:57:48,211][123090] Updated weights for policy 1, policy_version 296600 (0.0007) [2023-12-26 01:57:48,768][123091] Updated weights for policy 0, policy_version 298131 (0.0009) [2023-12-26 01:57:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 152256512. Throughput: 0: 9190.1, 1: 8620.6. Samples: 152270868. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:57:48,785][121949] Avg episode reward: [(0, '6153.018'), (1, '5590.210')] [2023-12-26 01:57:48,838][123091] Updated weights for policy 0, policy_version 298141 (0.0006) [2023-12-26 01:57:48,896][123091] Updated weights for policy 0, policy_version 298151 (0.0006) [2023-12-26 01:57:49,109][123090] Updated weights for policy 1, policy_version 296610 (0.0009) [2023-12-26 01:57:49,174][123090] Updated weights for policy 1, policy_version 296620 (0.0009) [2023-12-26 01:57:49,253][123090] Updated weights for policy 1, policy_version 296630 (0.0009) [2023-12-26 01:57:49,317][123090] Updated weights for policy 1, policy_version 296640 (0.0009) [2023-12-26 01:57:49,661][123091] Updated weights for policy 0, policy_version 298161 (0.0006) [2023-12-26 01:57:49,727][123091] Updated weights for policy 0, policy_version 298171 (0.0011) [2023-12-26 01:57:49,796][123091] Updated weights for policy 0, policy_version 298181 (0.0010) [2023-12-26 01:57:49,864][123091] Updated weights for policy 0, policy_version 298191 (0.0007) [2023-12-26 01:57:50,125][123090] Updated weights for policy 1, policy_version 296650 (0.0006) [2023-12-26 01:57:50,187][123090] Updated weights for policy 1, policy_version 296660 (0.0006) [2023-12-26 01:57:50,251][123090] Updated weights for policy 1, policy_version 296670 (0.0010) [2023-12-26 01:57:50,603][123091] Updated weights for policy 0, policy_version 298201 (0.0010) [2023-12-26 01:57:50,662][123091] Updated weights for policy 0, policy_version 298211 (0.0011) [2023-12-26 01:57:50,725][123091] Updated weights for policy 0, policy_version 298221 (0.0011) [2023-12-26 01:57:50,980][123090] Updated weights for policy 1, policy_version 296680 (0.0011) [2023-12-26 01:57:51,048][123090] Updated weights for policy 1, policy_version 296690 (0.0010) [2023-12-26 01:57:51,123][123090] Updated weights for policy 1, policy_version 296700 (0.0009) [2023-12-26 01:57:51,547][123091] Updated weights for policy 0, policy_version 298231 (0.0011) [2023-12-26 01:57:51,591][123091] Updated weights for policy 0, policy_version 298241 (0.0010) [2023-12-26 01:57:51,659][123091] Updated weights for policy 0, policy_version 298251 (0.0011) [2023-12-26 01:57:51,900][123090] Updated weights for policy 1, policy_version 296710 (0.0010) [2023-12-26 01:57:51,953][123090] Updated weights for policy 1, policy_version 296720 (0.0009) [2023-12-26 01:57:52,023][123090] Updated weights for policy 1, policy_version 296730 (0.0009) [2023-12-26 01:57:52,474][123091] Updated weights for policy 0, policy_version 298261 (0.0008) [2023-12-26 01:57:52,521][123091] Updated weights for policy 0, policy_version 298271 (0.0005) [2023-12-26 01:57:52,575][123091] Updated weights for policy 0, policy_version 298281 (0.0005) [2023-12-26 01:57:52,922][123090] Updated weights for policy 1, policy_version 296740 (0.0009) [2023-12-26 01:57:52,988][123090] Updated weights for policy 1, policy_version 296750 (0.0010) [2023-12-26 01:57:53,058][123090] Updated weights for policy 1, policy_version 296760 (0.0010) [2023-12-26 01:57:53,259][123091] Updated weights for policy 0, policy_version 298291 (0.0007) [2023-12-26 01:57:53,321][123091] Updated weights for policy 0, policy_version 298301 (0.0010) [2023-12-26 01:57:53,379][123091] Updated weights for policy 0, policy_version 298311 (0.0009) [2023-12-26 01:57:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 152346624. Throughput: 0: 9170.8, 1: 8640.2. Samples: 152323676. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:57:53,785][121949] Avg episode reward: [(0, '6154.601'), (1, '5408.041')] [2023-12-26 01:57:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000296768_75972608.pth... [2023-12-26 01:57:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000298320_76374016.pth... [2023-12-26 01:57:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000295776_75718656.pth [2023-12-26 01:57:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000297200_76087296.pth [2023-12-26 01:57:54,015][123090] Updated weights for policy 1, policy_version 296770 (0.0010) [2023-12-26 01:57:54,046][123091] Updated weights for policy 0, policy_version 298321 (0.0009) [2023-12-26 01:57:54,078][123090] Updated weights for policy 1, policy_version 296780 (0.0010) [2023-12-26 01:57:54,109][123091] Updated weights for policy 0, policy_version 298331 (0.0006) [2023-12-26 01:57:54,146][123090] Updated weights for policy 1, policy_version 296790 (0.0008) [2023-12-26 01:57:54,169][123091] Updated weights for policy 0, policy_version 298341 (0.0006) [2023-12-26 01:57:54,205][123090] Updated weights for policy 1, policy_version 296800 (0.0008) [2023-12-26 01:57:54,231][123091] Updated weights for policy 0, policy_version 298351 (0.0006) [2023-12-26 01:57:55,022][123091] Updated weights for policy 0, policy_version 298361 (0.0006) [2023-12-26 01:57:55,055][123090] Updated weights for policy 1, policy_version 296810 (0.0009) [2023-12-26 01:57:55,082][123091] Updated weights for policy 0, policy_version 298371 (0.0005) [2023-12-26 01:57:55,113][123090] Updated weights for policy 1, policy_version 296820 (0.0008) [2023-12-26 01:57:55,147][123091] Updated weights for policy 0, policy_version 298381 (0.0006) [2023-12-26 01:57:55,163][123090] Updated weights for policy 1, policy_version 296830 (0.0009) [2023-12-26 01:57:55,811][123091] Updated weights for policy 0, policy_version 298391 (0.0010) [2023-12-26 01:57:55,881][123091] Updated weights for policy 0, policy_version 298401 (0.0011) [2023-12-26 01:57:55,951][123091] Updated weights for policy 0, policy_version 298411 (0.0011) [2023-12-26 01:57:56,074][123090] Updated weights for policy 1, policy_version 296840 (0.0009) [2023-12-26 01:57:56,131][123090] Updated weights for policy 1, policy_version 296850 (0.0009) [2023-12-26 01:57:56,192][123090] Updated weights for policy 1, policy_version 296860 (0.0009) [2023-12-26 01:57:56,658][123091] Updated weights for policy 0, policy_version 298421 (0.0011) [2023-12-26 01:57:56,712][123091] Updated weights for policy 0, policy_version 298431 (0.0010) [2023-12-26 01:57:56,762][123091] Updated weights for policy 0, policy_version 298441 (0.0010) [2023-12-26 01:57:57,054][123090] Updated weights for policy 1, policy_version 296870 (0.0009) [2023-12-26 01:57:57,113][123090] Updated weights for policy 1, policy_version 296880 (0.0008) [2023-12-26 01:57:57,184][123090] Updated weights for policy 1, policy_version 296890 (0.0008) [2023-12-26 01:57:57,483][123091] Updated weights for policy 0, policy_version 298451 (0.0010) [2023-12-26 01:57:57,551][123091] Updated weights for policy 0, policy_version 298461 (0.0010) [2023-12-26 01:57:57,624][123091] Updated weights for policy 0, policy_version 298471 (0.0010) [2023-12-26 01:57:58,064][123090] Updated weights for policy 1, policy_version 296900 (0.0009) [2023-12-26 01:57:58,125][123090] Updated weights for policy 1, policy_version 296910 (0.0009) [2023-12-26 01:57:58,193][123090] Updated weights for policy 1, policy_version 296920 (0.0008) [2023-12-26 01:57:58,341][123091] Updated weights for policy 0, policy_version 298481 (0.0010) [2023-12-26 01:57:58,426][123091] Updated weights for policy 0, policy_version 298491 (0.0007) [2023-12-26 01:57:58,495][123091] Updated weights for policy 0, policy_version 298501 (0.0008) [2023-12-26 01:57:58,558][123091] Updated weights for policy 0, policy_version 298511 (0.0007) [2023-12-26 01:57:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 152436736. Throughput: 0: 9287.2, 1: 8627.2. Samples: 152429880. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:57:58,785][121949] Avg episode reward: [(0, '6157.239'), (1, '5287.718')] [2023-12-26 01:57:59,082][123090] Updated weights for policy 1, policy_version 296930 (0.0010) [2023-12-26 01:57:59,141][123090] Updated weights for policy 1, policy_version 296940 (0.0008) [2023-12-26 01:57:59,206][123090] Updated weights for policy 1, policy_version 296950 (0.0007) [2023-12-26 01:57:59,276][123090] Updated weights for policy 1, policy_version 296960 (0.0009) [2023-12-26 01:57:59,442][123091] Updated weights for policy 0, policy_version 298521 (0.0009) [2023-12-26 01:57:59,501][123091] Updated weights for policy 0, policy_version 298531 (0.0009) [2023-12-26 01:57:59,559][123091] Updated weights for policy 0, policy_version 298541 (0.0009) [2023-12-26 01:58:00,043][123090] Updated weights for policy 1, policy_version 296970 (0.0008) [2023-12-26 01:58:00,107][123090] Updated weights for policy 1, policy_version 296980 (0.0010) [2023-12-26 01:58:00,172][123090] Updated weights for policy 1, policy_version 296990 (0.0009) [2023-12-26 01:58:00,428][123091] Updated weights for policy 0, policy_version 298551 (0.0009) [2023-12-26 01:58:00,480][123091] Updated weights for policy 0, policy_version 298561 (0.0009) [2023-12-26 01:58:00,529][123091] Updated weights for policy 0, policy_version 298571 (0.0010) [2023-12-26 01:58:00,962][123090] Updated weights for policy 1, policy_version 297000 (0.0009) [2023-12-26 01:58:01,019][123090] Updated weights for policy 1, policy_version 297010 (0.0008) [2023-12-26 01:58:01,084][123090] Updated weights for policy 1, policy_version 297020 (0.0007) [2023-12-26 01:58:01,223][123091] Updated weights for policy 0, policy_version 298581 (0.0009) [2023-12-26 01:58:01,289][123091] Updated weights for policy 0, policy_version 298591 (0.0013) [2023-12-26 01:58:01,348][123091] Updated weights for policy 0, policy_version 298601 (0.0010) [2023-12-26 01:58:01,834][123090] Updated weights for policy 1, policy_version 297030 (0.0010) [2023-12-26 01:58:01,900][123090] Updated weights for policy 1, policy_version 297040 (0.0008) [2023-12-26 01:58:01,972][123090] Updated weights for policy 1, policy_version 297050 (0.0008) [2023-12-26 01:58:02,174][123091] Updated weights for policy 0, policy_version 298611 (0.0009) [2023-12-26 01:58:02,233][123091] Updated weights for policy 0, policy_version 298621 (0.0010) [2023-12-26 01:58:02,296][123091] Updated weights for policy 0, policy_version 298631 (0.0011) [2023-12-26 01:58:02,746][123090] Updated weights for policy 1, policy_version 297060 (0.0010) [2023-12-26 01:58:02,800][123090] Updated weights for policy 1, policy_version 297070 (0.0010) [2023-12-26 01:58:02,854][123090] Updated weights for policy 1, policy_version 297080 (0.0010) [2023-12-26 01:58:03,075][123091] Updated weights for policy 0, policy_version 298641 (0.0010) [2023-12-26 01:58:03,129][123091] Updated weights for policy 0, policy_version 298651 (0.0005) [2023-12-26 01:58:03,190][123091] Updated weights for policy 0, policy_version 298661 (0.0006) [2023-12-26 01:58:03,247][123091] Updated weights for policy 0, policy_version 298671 (0.0008) [2023-12-26 01:58:03,553][123090] Updated weights for policy 1, policy_version 297090 (0.0009) [2023-12-26 01:58:03,611][123090] Updated weights for policy 1, policy_version 297100 (0.0005) [2023-12-26 01:58:03,665][123090] Updated weights for policy 1, policy_version 297110 (0.0005) [2023-12-26 01:58:03,715][123090] Updated weights for policy 1, policy_version 297120 (0.0005) [2023-12-26 01:58:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 152526848. Throughput: 0: 9378.1, 1: 8552.2. Samples: 152536484. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:03,785][121949] Avg episode reward: [(0, '6231.978'), (1, '5235.453')] [2023-12-26 01:58:04,010][123091] Updated weights for policy 0, policy_version 298681 (0.0009) [2023-12-26 01:58:04,067][123091] Updated weights for policy 0, policy_version 298691 (0.0009) [2023-12-26 01:58:04,116][123091] Updated weights for policy 0, policy_version 298701 (0.0009) [2023-12-26 01:58:04,513][123090] Updated weights for policy 1, policy_version 297130 (0.0010) [2023-12-26 01:58:04,580][123090] Updated weights for policy 1, policy_version 297140 (0.0010) [2023-12-26 01:58:04,643][123090] Updated weights for policy 1, policy_version 297150 (0.0011) [2023-12-26 01:58:04,985][123091] Updated weights for policy 0, policy_version 298711 (0.0010) [2023-12-26 01:58:05,043][123091] Updated weights for policy 0, policy_version 298721 (0.0010) [2023-12-26 01:58:05,094][123091] Updated weights for policy 0, policy_version 298731 (0.0010) [2023-12-26 01:58:05,453][123090] Updated weights for policy 1, policy_version 297160 (0.0007) [2023-12-26 01:58:05,514][123090] Updated weights for policy 1, policy_version 297170 (0.0007) [2023-12-26 01:58:05,575][123090] Updated weights for policy 1, policy_version 297180 (0.0007) [2023-12-26 01:58:05,919][123091] Updated weights for policy 0, policy_version 298741 (0.0010) [2023-12-26 01:58:05,980][123091] Updated weights for policy 0, policy_version 298751 (0.0006) [2023-12-26 01:58:06,031][123091] Updated weights for policy 0, policy_version 298761 (0.0005) [2023-12-26 01:58:06,312][123090] Updated weights for policy 1, policy_version 297190 (0.0009) [2023-12-26 01:58:06,373][123090] Updated weights for policy 1, policy_version 297200 (0.0009) [2023-12-26 01:58:06,425][123090] Updated weights for policy 1, policy_version 297210 (0.0009) [2023-12-26 01:58:06,798][123091] Updated weights for policy 0, policy_version 298771 (0.0006) [2023-12-26 01:58:06,858][123091] Updated weights for policy 0, policy_version 298781 (0.0008) [2023-12-26 01:58:06,913][123091] Updated weights for policy 0, policy_version 298791 (0.0005) [2023-12-26 01:58:07,338][123090] Updated weights for policy 1, policy_version 297220 (0.0009) [2023-12-26 01:58:07,386][123090] Updated weights for policy 1, policy_version 297230 (0.0010) [2023-12-26 01:58:07,434][123090] Updated weights for policy 1, policy_version 297240 (0.0010) [2023-12-26 01:58:07,585][123091] Updated weights for policy 0, policy_version 298801 (0.0006) [2023-12-26 01:58:07,654][123091] Updated weights for policy 0, policy_version 298811 (0.0009) [2023-12-26 01:58:07,711][123091] Updated weights for policy 0, policy_version 298821 (0.0005) [2023-12-26 01:58:07,762][123091] Updated weights for policy 0, policy_version 298831 (0.0005) [2023-12-26 01:58:08,291][123090] Updated weights for policy 1, policy_version 297250 (0.0010) [2023-12-26 01:58:08,361][123090] Updated weights for policy 1, policy_version 297260 (0.0009) [2023-12-26 01:58:08,432][123090] Updated weights for policy 1, policy_version 297270 (0.0010) [2023-12-26 01:58:08,493][123091] Updated weights for policy 0, policy_version 298841 (0.0009) [2023-12-26 01:58:08,497][123090] Updated weights for policy 1, policy_version 297280 (0.0011) [2023-12-26 01:58:08,557][123091] Updated weights for policy 0, policy_version 298851 (0.0011) [2023-12-26 01:58:08,616][123091] Updated weights for policy 0, policy_version 298861 (0.0010) [2023-12-26 01:58:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 152616960. Throughput: 0: 9384.6, 1: 8592.1. Samples: 152588724. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:08,785][121949] Avg episode reward: [(0, '6262.607'), (1, '5472.909')] [2023-12-26 01:58:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000297280_76103680.pth... [2023-12-26 01:58:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000298864_76513280.pth... [2023-12-26 01:58:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000297776_76234752.pth [2023-12-26 01:58:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000296288_75849728.pth [2023-12-26 01:58:09,340][123090] Updated weights for policy 1, policy_version 297290 (0.0010) [2023-12-26 01:58:09,403][123091] Updated weights for policy 0, policy_version 298871 (0.0008) [2023-12-26 01:58:09,420][123090] Updated weights for policy 1, policy_version 297300 (0.0008) [2023-12-26 01:58:09,472][123091] Updated weights for policy 0, policy_version 298881 (0.0008) [2023-12-26 01:58:09,487][123090] Updated weights for policy 1, policy_version 297310 (0.0009) [2023-12-26 01:58:09,539][123091] Updated weights for policy 0, policy_version 298891 (0.0008) [2023-12-26 01:58:10,314][123091] Updated weights for policy 0, policy_version 298901 (0.0008) [2023-12-26 01:58:10,327][123090] Updated weights for policy 1, policy_version 297320 (0.0008) [2023-12-26 01:58:10,376][123091] Updated weights for policy 0, policy_version 298911 (0.0009) [2023-12-26 01:58:10,389][123090] Updated weights for policy 1, policy_version 297330 (0.0007) [2023-12-26 01:58:10,439][123090] Updated weights for policy 1, policy_version 297340 (0.0005) [2023-12-26 01:58:10,453][123091] Updated weights for policy 0, policy_version 298921 (0.0008) [2023-12-26 01:58:11,152][123091] Updated weights for policy 0, policy_version 298931 (0.0009) [2023-12-26 01:58:11,223][123091] Updated weights for policy 0, policy_version 298941 (0.0009) [2023-12-26 01:58:11,255][123090] Updated weights for policy 1, policy_version 297350 (0.0009) [2023-12-26 01:58:11,286][123091] Updated weights for policy 0, policy_version 298951 (0.0007) [2023-12-26 01:58:11,315][123090] Updated weights for policy 1, policy_version 297360 (0.0011) [2023-12-26 01:58:11,386][123090] Updated weights for policy 1, policy_version 297370 (0.0010) [2023-12-26 01:58:12,101][123091] Updated weights for policy 0, policy_version 298961 (0.0009) [2023-12-26 01:58:12,169][123091] Updated weights for policy 0, policy_version 298971 (0.0008) [2023-12-26 01:58:12,212][123090] Updated weights for policy 1, policy_version 297380 (0.0011) [2023-12-26 01:58:12,224][123091] Updated weights for policy 0, policy_version 298981 (0.0008) [2023-12-26 01:58:12,275][123090] Updated weights for policy 1, policy_version 297390 (0.0008) [2023-12-26 01:58:12,285][123091] Updated weights for policy 0, policy_version 298991 (0.0008) [2023-12-26 01:58:12,344][123090] Updated weights for policy 1, policy_version 297400 (0.0009) [2023-12-26 01:58:12,972][123091] Updated weights for policy 0, policy_version 299001 (0.0009) [2023-12-26 01:58:13,025][123091] Updated weights for policy 0, policy_version 299011 (0.0009) [2023-12-26 01:58:13,077][123091] Updated weights for policy 0, policy_version 299021 (0.0009) [2023-12-26 01:58:13,211][123090] Updated weights for policy 1, policy_version 297410 (0.0010) [2023-12-26 01:58:13,275][123090] Updated weights for policy 1, policy_version 297420 (0.0009) [2023-12-26 01:58:13,338][123090] Updated weights for policy 1, policy_version 297430 (0.0005) [2023-12-26 01:58:13,400][123090] Updated weights for policy 1, policy_version 297440 (0.0005) [2023-12-26 01:58:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 152698880. Throughput: 0: 9317.4, 1: 8493.5. Samples: 152694156. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:13,785][121949] Avg episode reward: [(0, '6298.712'), (1, '5559.170')] [2023-12-26 01:58:13,897][123091] Updated weights for policy 0, policy_version 299031 (0.0010) [2023-12-26 01:58:13,948][123091] Updated weights for policy 0, policy_version 299041 (0.0010) [2023-12-26 01:58:14,017][123091] Updated weights for policy 0, policy_version 299051 (0.0010) [2023-12-26 01:58:14,102][123090] Updated weights for policy 1, policy_version 297450 (0.0005) [2023-12-26 01:58:14,165][123090] Updated weights for policy 1, policy_version 297460 (0.0009) [2023-12-26 01:58:14,233][123090] Updated weights for policy 1, policy_version 297470 (0.0011) [2023-12-26 01:58:14,734][123091] Updated weights for policy 0, policy_version 299061 (0.0008) [2023-12-26 01:58:14,802][123091] Updated weights for policy 0, policy_version 299071 (0.0008) [2023-12-26 01:58:14,873][123091] Updated weights for policy 0, policy_version 299081 (0.0006) [2023-12-26 01:58:14,997][123090] Updated weights for policy 1, policy_version 297480 (0.0006) [2023-12-26 01:58:15,069][123090] Updated weights for policy 1, policy_version 297490 (0.0005) [2023-12-26 01:58:15,145][123090] Updated weights for policy 1, policy_version 297500 (0.0005) [2023-12-26 01:58:15,589][123091] Updated weights for policy 0, policy_version 299091 (0.0009) [2023-12-26 01:58:15,642][123091] Updated weights for policy 0, policy_version 299101 (0.0010) [2023-12-26 01:58:15,704][123091] Updated weights for policy 0, policy_version 299111 (0.0010) [2023-12-26 01:58:15,753][123090] Updated weights for policy 1, policy_version 297510 (0.0005) [2023-12-26 01:58:15,813][123090] Updated weights for policy 1, policy_version 297520 (0.0005) [2023-12-26 01:58:15,884][123090] Updated weights for policy 1, policy_version 297530 (0.0006) [2023-12-26 01:58:16,525][123091] Updated weights for policy 0, policy_version 299121 (0.0010) [2023-12-26 01:58:16,572][123091] Updated weights for policy 0, policy_version 299131 (0.0005) [2023-12-26 01:58:16,623][123091] Updated weights for policy 0, policy_version 299141 (0.0006) [2023-12-26 01:58:16,660][123090] Updated weights for policy 1, policy_version 297540 (0.0010) [2023-12-26 01:58:16,692][123091] Updated weights for policy 0, policy_version 299151 (0.0005) [2023-12-26 01:58:16,716][123090] Updated weights for policy 1, policy_version 297550 (0.0008) [2023-12-26 01:58:16,782][123090] Updated weights for policy 1, policy_version 297560 (0.0005) [2023-12-26 01:58:17,442][123091] Updated weights for policy 0, policy_version 299161 (0.0009) [2023-12-26 01:58:17,489][123091] Updated weights for policy 0, policy_version 299171 (0.0008) [2023-12-26 01:58:17,531][123090] Updated weights for policy 1, policy_version 297570 (0.0006) [2023-12-26 01:58:17,543][123091] Updated weights for policy 0, policy_version 299181 (0.0007) [2023-12-26 01:58:17,586][123090] Updated weights for policy 1, policy_version 297580 (0.0010) [2023-12-26 01:58:17,633][123090] Updated weights for policy 1, policy_version 297590 (0.0010) [2023-12-26 01:58:17,699][123090] Updated weights for policy 1, policy_version 297600 (0.0010) [2023-12-26 01:58:18,380][123091] Updated weights for policy 0, policy_version 299191 (0.0007) [2023-12-26 01:58:18,439][123091] Updated weights for policy 0, policy_version 299201 (0.0006) [2023-12-26 01:58:18,493][123091] Updated weights for policy 0, policy_version 299211 (0.0005) [2023-12-26 01:58:18,548][123090] Updated weights for policy 1, policy_version 297610 (0.0008) [2023-12-26 01:58:18,620][123090] Updated weights for policy 1, policy_version 297620 (0.0008) [2023-12-26 01:58:18,695][123090] Updated weights for policy 1, policy_version 297630 (0.0006) [2023-12-26 01:58:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 152797184. Throughput: 0: 9214.5, 1: 8593.6. Samples: 152803732. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:18,785][121949] Avg episode reward: [(0, '6172.236'), (1, '5289.849')] [2023-12-26 01:58:19,259][123091] Updated weights for policy 0, policy_version 299221 (0.0007) [2023-12-26 01:58:19,325][123091] Updated weights for policy 0, policy_version 299231 (0.0006) [2023-12-26 01:58:19,396][123091] Updated weights for policy 0, policy_version 299241 (0.0007) [2023-12-26 01:58:19,483][123090] Updated weights for policy 1, policy_version 297640 (0.0010) [2023-12-26 01:58:19,549][123090] Updated weights for policy 1, policy_version 297650 (0.0010) [2023-12-26 01:58:19,615][123090] Updated weights for policy 1, policy_version 297660 (0.0010) [2023-12-26 01:58:20,227][123091] Updated weights for policy 0, policy_version 299251 (0.0007) [2023-12-26 01:58:20,287][123091] Updated weights for policy 0, policy_version 299261 (0.0009) [2023-12-26 01:58:20,350][123091] Updated weights for policy 0, policy_version 299271 (0.0009) [2023-12-26 01:58:20,439][123090] Updated weights for policy 1, policy_version 297670 (0.0008) [2023-12-26 01:58:20,497][123090] Updated weights for policy 1, policy_version 297680 (0.0005) [2023-12-26 01:58:20,551][123090] Updated weights for policy 1, policy_version 297690 (0.0006) [2023-12-26 01:58:21,231][123091] Updated weights for policy 0, policy_version 299281 (0.0009) [2023-12-26 01:58:21,299][123091] Updated weights for policy 0, policy_version 299291 (0.0010) [2023-12-26 01:58:21,361][123091] Updated weights for policy 0, policy_version 299301 (0.0010) [2023-12-26 01:58:21,378][123090] Updated weights for policy 1, policy_version 297700 (0.0009) [2023-12-26 01:58:21,435][123091] Updated weights for policy 0, policy_version 299311 (0.0008) [2023-12-26 01:58:21,453][123090] Updated weights for policy 1, policy_version 297710 (0.0009) [2023-12-26 01:58:21,524][123090] Updated weights for policy 1, policy_version 297720 (0.0007) [2023-12-26 01:58:22,310][123091] Updated weights for policy 0, policy_version 299321 (0.0008) [2023-12-26 01:58:22,327][123090] Updated weights for policy 1, policy_version 297730 (0.0007) [2023-12-26 01:58:22,377][123091] Updated weights for policy 0, policy_version 299331 (0.0008) [2023-12-26 01:58:22,393][123090] Updated weights for policy 1, policy_version 297740 (0.0008) [2023-12-26 01:58:22,440][123091] Updated weights for policy 0, policy_version 299341 (0.0008) [2023-12-26 01:58:22,462][123090] Updated weights for policy 1, policy_version 297750 (0.0007) [2023-12-26 01:58:22,512][123090] Updated weights for policy 1, policy_version 297760 (0.0009) [2023-12-26 01:58:23,278][123091] Updated weights for policy 0, policy_version 299351 (0.0008) [2023-12-26 01:58:23,300][123090] Updated weights for policy 1, policy_version 297770 (0.0010) [2023-12-26 01:58:23,347][123091] Updated weights for policy 0, policy_version 299361 (0.0007) [2023-12-26 01:58:23,361][123090] Updated weights for policy 1, policy_version 297780 (0.0010) [2023-12-26 01:58:23,412][123091] Updated weights for policy 0, policy_version 299371 (0.0006) [2023-12-26 01:58:23,414][123090] Updated weights for policy 1, policy_version 297790 (0.0011) [2023-12-26 01:58:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 152879104. Throughput: 0: 9138.8, 1: 8558.4. Samples: 152854992. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:23,785][121949] Avg episode reward: [(0, '6195.989'), (1, '5296.804')] [2023-12-26 01:58:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000297792_76234752.pth... [2023-12-26 01:58:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000299376_76644352.pth... [2023-12-26 01:58:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000296768_75972608.pth [2023-12-26 01:58:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000298320_76374016.pth [2023-12-26 01:58:24,220][123091] Updated weights for policy 0, policy_version 299381 (0.0009) [2023-12-26 01:58:24,254][123090] Updated weights for policy 1, policy_version 297800 (0.0011) [2023-12-26 01:58:24,270][123091] Updated weights for policy 0, policy_version 299391 (0.0007) [2023-12-26 01:58:24,320][123091] Updated weights for policy 0, policy_version 299401 (0.0010) [2023-12-26 01:58:24,322][123090] Updated weights for policy 1, policy_version 297810 (0.0011) [2023-12-26 01:58:24,379][123090] Updated weights for policy 1, policy_version 297820 (0.0010) [2023-12-26 01:58:25,084][123091] Updated weights for policy 0, policy_version 299411 (0.0006) [2023-12-26 01:58:25,149][123091] Updated weights for policy 0, policy_version 299421 (0.0006) [2023-12-26 01:58:25,214][123090] Updated weights for policy 1, policy_version 297830 (0.0010) [2023-12-26 01:58:25,217][123091] Updated weights for policy 0, policy_version 299431 (0.0007) [2023-12-26 01:58:25,278][123090] Updated weights for policy 1, policy_version 297840 (0.0010) [2023-12-26 01:58:25,344][123090] Updated weights for policy 1, policy_version 297850 (0.0010) [2023-12-26 01:58:25,919][123091] Updated weights for policy 0, policy_version 299441 (0.0006) [2023-12-26 01:58:25,983][123091] Updated weights for policy 0, policy_version 299451 (0.0005) [2023-12-26 01:58:26,034][123091] Updated weights for policy 0, policy_version 299461 (0.0005) [2023-12-26 01:58:26,081][123091] Updated weights for policy 0, policy_version 299471 (0.0006) [2023-12-26 01:58:26,156][123090] Updated weights for policy 1, policy_version 297860 (0.0010) [2023-12-26 01:58:26,222][123090] Updated weights for policy 1, policy_version 297870 (0.0011) [2023-12-26 01:58:26,282][123090] Updated weights for policy 1, policy_version 297880 (0.0010) [2023-12-26 01:58:26,765][123091] Updated weights for policy 0, policy_version 299481 (0.0008) [2023-12-26 01:58:26,818][123091] Updated weights for policy 0, policy_version 299491 (0.0010) [2023-12-26 01:58:26,870][123091] Updated weights for policy 0, policy_version 299501 (0.0009) [2023-12-26 01:58:27,039][123090] Updated weights for policy 1, policy_version 297890 (0.0009) [2023-12-26 01:58:27,095][123090] Updated weights for policy 1, policy_version 297900 (0.0005) [2023-12-26 01:58:27,145][123090] Updated weights for policy 1, policy_version 297910 (0.0005) [2023-12-26 01:58:27,194][123090] Updated weights for policy 1, policy_version 297920 (0.0005) [2023-12-26 01:58:27,577][123091] Updated weights for policy 0, policy_version 299511 (0.0006) [2023-12-26 01:58:27,620][123091] Updated weights for policy 0, policy_version 299521 (0.0010) [2023-12-26 01:58:27,667][123091] Updated weights for policy 0, policy_version 299531 (0.0010) [2023-12-26 01:58:27,800][123090] Updated weights for policy 1, policy_version 297930 (0.0010) [2023-12-26 01:58:27,859][123090] Updated weights for policy 1, policy_version 297940 (0.0010) [2023-12-26 01:58:27,922][123090] Updated weights for policy 1, policy_version 297950 (0.0008) [2023-12-26 01:58:28,504][123091] Updated weights for policy 0, policy_version 299541 (0.0010) [2023-12-26 01:58:28,568][123091] Updated weights for policy 0, policy_version 299551 (0.0007) [2023-12-26 01:58:28,628][123090] Updated weights for policy 1, policy_version 297960 (0.0006) [2023-12-26 01:58:28,628][123091] Updated weights for policy 0, policy_version 299561 (0.0006) [2023-12-26 01:58:28,687][123090] Updated weights for policy 1, policy_version 297970 (0.0005) [2023-12-26 01:58:28,747][123090] Updated weights for policy 1, policy_version 297980 (0.0005) [2023-12-26 01:58:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 152977408. Throughput: 0: 9172.2, 1: 8631.4. Samples: 152963708. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:28,785][121949] Avg episode reward: [(0, '6270.003'), (1, '5297.019')] [2023-12-26 01:58:29,397][123090] Updated weights for policy 1, policy_version 297990 (0.0009) [2023-12-26 01:58:29,461][123090] Updated weights for policy 1, policy_version 298000 (0.0009) [2023-12-26 01:58:29,466][123091] Updated weights for policy 0, policy_version 299571 (0.0007) [2023-12-26 01:58:29,516][123091] Updated weights for policy 0, policy_version 299581 (0.0008) [2023-12-26 01:58:29,521][123090] Updated weights for policy 1, policy_version 298010 (0.0005) [2023-12-26 01:58:29,564][123091] Updated weights for policy 0, policy_version 299591 (0.0009) [2023-12-26 01:58:30,289][123090] Updated weights for policy 1, policy_version 298020 (0.0007) [2023-12-26 01:58:30,344][123090] Updated weights for policy 1, policy_version 298030 (0.0009) [2023-12-26 01:58:30,365][123091] Updated weights for policy 0, policy_version 299601 (0.0010) [2023-12-26 01:58:30,397][123090] Updated weights for policy 1, policy_version 298040 (0.0008) [2023-12-26 01:58:30,417][123091] Updated weights for policy 0, policy_version 299611 (0.0007) [2023-12-26 01:58:30,480][123091] Updated weights for policy 0, policy_version 299621 (0.0006) [2023-12-26 01:58:30,538][123091] Updated weights for policy 0, policy_version 299631 (0.0006) [2023-12-26 01:58:31,115][123090] Updated weights for policy 1, policy_version 298050 (0.0009) [2023-12-26 01:58:31,177][123090] Updated weights for policy 1, policy_version 298060 (0.0010) [2023-12-26 01:58:31,213][123091] Updated weights for policy 0, policy_version 299641 (0.0010) [2023-12-26 01:58:31,230][123090] Updated weights for policy 1, policy_version 298070 (0.0008) [2023-12-26 01:58:31,276][123091] Updated weights for policy 0, policy_version 299651 (0.0010) [2023-12-26 01:58:31,293][123090] Updated weights for policy 1, policy_version 298080 (0.0010) [2023-12-26 01:58:31,339][123091] Updated weights for policy 0, policy_version 299661 (0.0010) [2023-12-26 01:58:32,170][123091] Updated weights for policy 0, policy_version 299671 (0.0010) [2023-12-26 01:58:32,177][123090] Updated weights for policy 1, policy_version 298090 (0.0007) [2023-12-26 01:58:32,232][123091] Updated weights for policy 0, policy_version 299681 (0.0010) [2023-12-26 01:58:32,241][123090] Updated weights for policy 1, policy_version 298100 (0.0007) [2023-12-26 01:58:32,302][123091] Updated weights for policy 0, policy_version 299691 (0.0008) [2023-12-26 01:58:32,303][123090] Updated weights for policy 1, policy_version 298110 (0.0005) [2023-12-26 01:58:32,983][123090] Updated weights for policy 1, policy_version 298120 (0.0005) [2023-12-26 01:58:33,032][123090] Updated weights for policy 1, policy_version 298130 (0.0010) [2023-12-26 01:58:33,075][123090] Updated weights for policy 1, policy_version 298140 (0.0010) [2023-12-26 01:58:33,099][123091] Updated weights for policy 0, policy_version 299701 (0.0010) [2023-12-26 01:58:33,149][123091] Updated weights for policy 0, policy_version 299711 (0.0010) [2023-12-26 01:58:33,203][123091] Updated weights for policy 0, policy_version 299721 (0.0010) [2023-12-26 01:58:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 153059328. Throughput: 0: 9053.1, 1: 8787.9. Samples: 153073712. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:33,785][121949] Avg episode reward: [(0, '6160.465'), (1, '5278.442')] [2023-12-26 01:58:33,833][123090] Updated weights for policy 1, policy_version 298150 (0.0007) [2023-12-26 01:58:33,885][123090] Updated weights for policy 1, policy_version 298160 (0.0005) [2023-12-26 01:58:33,931][123090] Updated weights for policy 1, policy_version 298170 (0.0010) [2023-12-26 01:58:34,018][123091] Updated weights for policy 0, policy_version 299731 (0.0010) [2023-12-26 01:58:34,082][123091] Updated weights for policy 0, policy_version 299741 (0.0010) [2023-12-26 01:58:34,149][123091] Updated weights for policy 0, policy_version 299751 (0.0010) [2023-12-26 01:58:34,684][123090] Updated weights for policy 1, policy_version 298180 (0.0009) [2023-12-26 01:58:34,753][123090] Updated weights for policy 1, policy_version 298190 (0.0008) [2023-12-26 01:58:34,811][123090] Updated weights for policy 1, policy_version 298200 (0.0008) [2023-12-26 01:58:34,965][123091] Updated weights for policy 0, policy_version 299761 (0.0008) [2023-12-26 01:58:35,022][123091] Updated weights for policy 0, policy_version 299771 (0.0010) [2023-12-26 01:58:35,073][123091] Updated weights for policy 0, policy_version 299781 (0.0005) [2023-12-26 01:58:35,146][123091] Updated weights for policy 0, policy_version 299791 (0.0005) [2023-12-26 01:58:35,442][123090] Updated weights for policy 1, policy_version 298210 (0.0007) [2023-12-26 01:58:35,491][123090] Updated weights for policy 1, policy_version 298220 (0.0005) [2023-12-26 01:58:35,538][123090] Updated weights for policy 1, policy_version 298230 (0.0005) [2023-12-26 01:58:35,589][123090] Updated weights for policy 1, policy_version 298240 (0.0005) [2023-12-26 01:58:35,958][123091] Updated weights for policy 0, policy_version 299801 (0.0009) [2023-12-26 01:58:36,011][123091] Updated weights for policy 0, policy_version 299811 (0.0010) [2023-12-26 01:58:36,064][123091] Updated weights for policy 0, policy_version 299822 (0.0010) [2023-12-26 01:58:36,309][123090] Updated weights for policy 1, policy_version 298250 (0.0007) [2023-12-26 01:58:36,384][123090] Updated weights for policy 1, policy_version 298260 (0.0011) [2023-12-26 01:58:36,447][123090] Updated weights for policy 1, policy_version 298270 (0.0011) [2023-12-26 01:58:37,000][123091] Updated weights for policy 0, policy_version 299832 (0.0010) [2023-12-26 01:58:37,066][123091] Updated weights for policy 0, policy_version 299842 (0.0009) [2023-12-26 01:58:37,132][123091] Updated weights for policy 0, policy_version 299852 (0.0009) [2023-12-26 01:58:37,206][123090] Updated weights for policy 1, policy_version 298280 (0.0010) [2023-12-26 01:58:37,266][123090] Updated weights for policy 1, policy_version 298290 (0.0010) [2023-12-26 01:58:37,325][123090] Updated weights for policy 1, policy_version 298300 (0.0010) [2023-12-26 01:58:37,916][123090] Updated weights for policy 1, policy_version 298310 (0.0007) [2023-12-26 01:58:37,942][123091] Updated weights for policy 0, policy_version 299862 (0.0009) [2023-12-26 01:58:37,985][123090] Updated weights for policy 1, policy_version 298320 (0.0006) [2023-12-26 01:58:38,001][123091] Updated weights for policy 0, policy_version 299872 (0.0009) [2023-12-26 01:58:38,043][123090] Updated weights for policy 1, policy_version 298330 (0.0010) [2023-12-26 01:58:38,054][123091] Updated weights for policy 0, policy_version 299882 (0.0005) [2023-12-26 01:58:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 153149440. Throughput: 0: 9020.0, 1: 8889.8. Samples: 153129616. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:38,785][121949] Avg episode reward: [(0, '6047.158'), (1, '5196.900')] [2023-12-26 01:58:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000299888_76775424.pth... [2023-12-26 01:58:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000298864_76513280.pth [2023-12-26 01:58:38,810][123090] Updated weights for policy 1, policy_version 298340 (0.0009) [2023-12-26 01:58:38,873][123090] Updated weights for policy 1, policy_version 298350 (0.0007) [2023-12-26 01:58:38,894][123091] Updated weights for policy 0, policy_version 299892 (0.0006) [2023-12-26 01:58:38,937][123090] Updated weights for policy 1, policy_version 298360 (0.0008) [2023-12-26 01:58:38,956][123091] Updated weights for policy 0, policy_version 299902 (0.0005) [2023-12-26 01:58:38,979][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000298368_76382208.pth... [2023-12-26 01:58:38,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000297280_76103680.pth [2023-12-26 01:58:39,026][123091] Updated weights for policy 0, policy_version 299912 (0.0011) [2023-12-26 01:58:39,679][123090] Updated weights for policy 1, policy_version 298370 (0.0009) [2023-12-26 01:58:39,744][123090] Updated weights for policy 1, policy_version 298380 (0.0011) [2023-12-26 01:58:39,794][123091] Updated weights for policy 0, policy_version 299922 (0.0010) [2023-12-26 01:58:39,800][123090] Updated weights for policy 1, policy_version 298390 (0.0011) [2023-12-26 01:58:39,863][123091] Updated weights for policy 0, policy_version 299932 (0.0007) [2023-12-26 01:58:39,874][123090] Updated weights for policy 1, policy_version 298400 (0.0014) [2023-12-26 01:58:39,932][123091] Updated weights for policy 0, policy_version 299942 (0.0009) [2023-12-26 01:58:39,995][123091] Updated weights for policy 0, policy_version 299952 (0.0006) [2023-12-26 01:58:40,732][123090] Updated weights for policy 1, policy_version 298410 (0.0011) [2023-12-26 01:58:40,757][123091] Updated weights for policy 0, policy_version 299962 (0.0008) [2023-12-26 01:58:40,796][123090] Updated weights for policy 1, policy_version 298420 (0.0011) [2023-12-26 01:58:40,814][123091] Updated weights for policy 0, policy_version 299972 (0.0010) [2023-12-26 01:58:40,864][123090] Updated weights for policy 1, policy_version 298430 (0.0011) [2023-12-26 01:58:40,872][123091] Updated weights for policy 0, policy_version 299982 (0.0007) [2023-12-26 01:58:41,687][123090] Updated weights for policy 1, policy_version 298440 (0.0010) [2023-12-26 01:58:41,705][123091] Updated weights for policy 0, policy_version 299992 (0.0009) [2023-12-26 01:58:41,751][123090] Updated weights for policy 1, policy_version 298450 (0.0008) [2023-12-26 01:58:41,783][123091] Updated weights for policy 0, policy_version 300002 (0.0008) [2023-12-26 01:58:41,811][123090] Updated weights for policy 1, policy_version 298460 (0.0007) [2023-12-26 01:58:41,851][123091] Updated weights for policy 0, policy_version 300012 (0.0010) [2023-12-26 01:58:42,638][123090] Updated weights for policy 1, policy_version 298470 (0.0008) [2023-12-26 01:58:42,697][123090] Updated weights for policy 1, policy_version 298480 (0.0010) [2023-12-26 01:58:42,709][123091] Updated weights for policy 0, policy_version 300022 (0.0009) [2023-12-26 01:58:42,757][123090] Updated weights for policy 1, policy_version 298490 (0.0010) [2023-12-26 01:58:42,776][123091] Updated weights for policy 0, policy_version 300032 (0.0007) [2023-12-26 01:58:42,842][123091] Updated weights for policy 0, policy_version 300042 (0.0005) [2023-12-26 01:58:43,553][123091] Updated weights for policy 0, policy_version 300052 (0.0006) [2023-12-26 01:58:43,611][123091] Updated weights for policy 0, policy_version 300062 (0.0007) [2023-12-26 01:58:43,618][123090] Updated weights for policy 1, policy_version 298500 (0.0008) [2023-12-26 01:58:43,672][123091] Updated weights for policy 0, policy_version 300072 (0.0009) [2023-12-26 01:58:43,684][123090] Updated weights for policy 1, policy_version 298510 (0.0005) [2023-12-26 01:58:43,748][123090] Updated weights for policy 1, policy_version 298520 (0.0008) [2023-12-26 01:58:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 153239552. Throughput: 0: 8869.7, 1: 9012.2. Samples: 153234564. Policy #0 lag: (min: 14.0, avg: 17.8, max: 46.0) [2023-12-26 01:58:43,785][121949] Avg episode reward: [(0, '6003.833'), (1, '5101.168')] [2023-12-26 01:58:44,420][123090] Updated weights for policy 1, policy_version 298530 (0.0009) [2023-12-26 01:58:44,448][123091] Updated weights for policy 0, policy_version 300082 (0.0010) [2023-12-26 01:58:44,478][123090] Updated weights for policy 1, policy_version 298540 (0.0005) [2023-12-26 01:58:44,501][123091] Updated weights for policy 0, policy_version 300092 (0.0009) [2023-12-26 01:58:44,541][123090] Updated weights for policy 1, policy_version 298550 (0.0005) [2023-12-26 01:58:44,563][123091] Updated weights for policy 0, policy_version 300102 (0.0008) [2023-12-26 01:58:44,596][123090] Updated weights for policy 1, policy_version 298560 (0.0005) [2023-12-26 01:58:44,631][123091] Updated weights for policy 0, policy_version 300112 (0.0010) [2023-12-26 01:58:45,393][123090] Updated weights for policy 1, policy_version 298570 (0.0011) [2023-12-26 01:58:45,421][123091] Updated weights for policy 0, policy_version 300122 (0.0011) [2023-12-26 01:58:45,457][123090] Updated weights for policy 1, policy_version 298580 (0.0010) [2023-12-26 01:58:45,477][123091] Updated weights for policy 0, policy_version 300132 (0.0011) [2023-12-26 01:58:45,513][123090] Updated weights for policy 1, policy_version 298590 (0.0010) [2023-12-26 01:58:45,525][123091] Updated weights for policy 0, policy_version 300142 (0.0010) [2023-12-26 01:58:46,354][123090] Updated weights for policy 1, policy_version 298600 (0.0010) [2023-12-26 01:58:46,374][123091] Updated weights for policy 0, policy_version 300152 (0.0011) [2023-12-26 01:58:46,415][123090] Updated weights for policy 1, policy_version 298610 (0.0007) [2023-12-26 01:58:46,433][123091] Updated weights for policy 0, policy_version 300162 (0.0010) [2023-12-26 01:58:46,463][123090] Updated weights for policy 1, policy_version 298620 (0.0009) [2023-12-26 01:58:46,488][123091] Updated weights for policy 0, policy_version 300172 (0.0010) [2023-12-26 01:58:47,296][123090] Updated weights for policy 1, policy_version 298630 (0.0008) [2023-12-26 01:58:47,316][123091] Updated weights for policy 0, policy_version 300182 (0.0010) [2023-12-26 01:58:47,351][123090] Updated weights for policy 1, policy_version 298640 (0.0009) [2023-12-26 01:58:47,360][123091] Updated weights for policy 0, policy_version 300192 (0.0010) [2023-12-26 01:58:47,403][123091] Updated weights for policy 0, policy_version 300202 (0.0010) [2023-12-26 01:58:47,409][123090] Updated weights for policy 1, policy_version 298650 (0.0007) [2023-12-26 01:58:48,197][123090] Updated weights for policy 1, policy_version 298660 (0.0008) [2023-12-26 01:58:48,216][123091] Updated weights for policy 0, policy_version 300212 (0.0008) [2023-12-26 01:58:48,249][123090] Updated weights for policy 1, policy_version 298670 (0.0008) [2023-12-26 01:58:48,270][123091] Updated weights for policy 0, policy_version 300222 (0.0005) [2023-12-26 01:58:48,304][123090] Updated weights for policy 1, policy_version 298680 (0.0010) [2023-12-26 01:58:48,340][123091] Updated weights for policy 0, policy_version 300232 (0.0009) [2023-12-26 01:58:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 153329664. Throughput: 0: 8878.8, 1: 8994.5. Samples: 153340784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:58:48,786][121949] Avg episode reward: [(0, '5935.411'), (1, '5320.183')] [2023-12-26 01:58:49,138][123090] Updated weights for policy 1, policy_version 298690 (0.0010) [2023-12-26 01:58:49,140][123091] Updated weights for policy 0, policy_version 300242 (0.0010) [2023-12-26 01:58:49,190][123091] Updated weights for policy 0, policy_version 300252 (0.0005) [2023-12-26 01:58:49,193][123090] Updated weights for policy 1, policy_version 298700 (0.0010) [2023-12-26 01:58:49,250][123091] Updated weights for policy 0, policy_version 300262 (0.0007) [2023-12-26 01:58:49,253][123090] Updated weights for policy 1, policy_version 298710 (0.0010) [2023-12-26 01:58:49,312][123090] Updated weights for policy 1, policy_version 298720 (0.0010) [2023-12-26 01:58:49,317][123091] Updated weights for policy 0, policy_version 300272 (0.0008) [2023-12-26 01:58:50,077][123091] Updated weights for policy 0, policy_version 300282 (0.0011) [2023-12-26 01:58:50,141][123091] Updated weights for policy 0, policy_version 300292 (0.0011) [2023-12-26 01:58:50,183][123090] Updated weights for policy 1, policy_version 298730 (0.0010) [2023-12-26 01:58:50,209][123091] Updated weights for policy 0, policy_version 300302 (0.0011) [2023-12-26 01:58:50,235][123090] Updated weights for policy 1, policy_version 298740 (0.0010) [2023-12-26 01:58:50,294][123090] Updated weights for policy 1, policy_version 298750 (0.0010) [2023-12-26 01:58:50,996][123091] Updated weights for policy 0, policy_version 300312 (0.0006) [2023-12-26 01:58:51,069][123091] Updated weights for policy 0, policy_version 300322 (0.0008) [2023-12-26 01:58:51,110][123090] Updated weights for policy 1, policy_version 298760 (0.0010) [2023-12-26 01:58:51,131][123091] Updated weights for policy 0, policy_version 300332 (0.0010) [2023-12-26 01:58:51,174][123090] Updated weights for policy 1, policy_version 298770 (0.0011) [2023-12-26 01:58:51,249][123090] Updated weights for policy 1, policy_version 298780 (0.0011) [2023-12-26 01:58:51,997][123091] Updated weights for policy 0, policy_version 300342 (0.0009) [2023-12-26 01:58:52,013][123090] Updated weights for policy 1, policy_version 298790 (0.0011) [2023-12-26 01:58:52,067][123091] Updated weights for policy 0, policy_version 300352 (0.0007) [2023-12-26 01:58:52,068][123090] Updated weights for policy 1, policy_version 298800 (0.0010) [2023-12-26 01:58:52,119][123091] Updated weights for policy 0, policy_version 300362 (0.0006) [2023-12-26 01:58:52,121][123090] Updated weights for policy 1, policy_version 298810 (0.0007) [2023-12-26 01:58:52,950][123091] Updated weights for policy 0, policy_version 300372 (0.0007) [2023-12-26 01:58:52,968][123090] Updated weights for policy 1, policy_version 298820 (0.0011) [2023-12-26 01:58:53,013][123091] Updated weights for policy 0, policy_version 300382 (0.0008) [2023-12-26 01:58:53,028][123090] Updated weights for policy 1, policy_version 298830 (0.0010) [2023-12-26 01:58:53,070][123091] Updated weights for policy 0, policy_version 300392 (0.0006) [2023-12-26 01:58:53,076][123090] Updated weights for policy 1, policy_version 298840 (0.0009) [2023-12-26 01:58:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 153411584. Throughput: 0: 8885.4, 1: 8988.2. Samples: 153393032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:58:53,785][121949] Avg episode reward: [(0, '6077.618'), (1, '5367.569')] [2023-12-26 01:58:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000300400_76906496.pth... [2023-12-26 01:58:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000298848_76505088.pth... [2023-12-26 01:58:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000297792_76234752.pth [2023-12-26 01:58:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000299376_76644352.pth [2023-12-26 01:58:53,887][123090] Updated weights for policy 1, policy_version 298850 (0.0010) [2023-12-26 01:58:53,928][123091] Updated weights for policy 0, policy_version 300402 (0.0007) [2023-12-26 01:58:53,952][123090] Updated weights for policy 1, policy_version 298860 (0.0008) [2023-12-26 01:58:53,993][123091] Updated weights for policy 0, policy_version 300412 (0.0008) [2023-12-26 01:58:54,017][123090] Updated weights for policy 1, policy_version 298870 (0.0007) [2023-12-26 01:58:54,050][123091] Updated weights for policy 0, policy_version 300422 (0.0007) [2023-12-26 01:58:54,077][123090] Updated weights for policy 1, policy_version 298880 (0.0009) [2023-12-26 01:58:54,114][123091] Updated weights for policy 0, policy_version 300432 (0.0008) [2023-12-26 01:58:54,866][123090] Updated weights for policy 1, policy_version 298890 (0.0010) [2023-12-26 01:58:54,920][123090] Updated weights for policy 1, policy_version 298900 (0.0010) [2023-12-26 01:58:54,960][123091] Updated weights for policy 0, policy_version 300442 (0.0008) [2023-12-26 01:58:54,971][123090] Updated weights for policy 1, policy_version 298910 (0.0009) [2023-12-26 01:58:55,022][123091] Updated weights for policy 0, policy_version 300452 (0.0009) [2023-12-26 01:58:55,080][123091] Updated weights for policy 0, policy_version 300462 (0.0007) [2023-12-26 01:58:55,731][123090] Updated weights for policy 1, policy_version 298920 (0.0009) [2023-12-26 01:58:55,785][123090] Updated weights for policy 1, policy_version 298930 (0.0010) [2023-12-26 01:58:55,840][123090] Updated weights for policy 1, policy_version 298940 (0.0009) [2023-12-26 01:58:55,867][123091] Updated weights for policy 0, policy_version 300472 (0.0005) [2023-12-26 01:58:55,935][123091] Updated weights for policy 0, policy_version 300482 (0.0006) [2023-12-26 01:58:55,999][123091] Updated weights for policy 0, policy_version 300492 (0.0005) [2023-12-26 01:58:56,572][123091] Updated weights for policy 0, policy_version 300502 (0.0005) [2023-12-26 01:58:56,638][123091] Updated weights for policy 0, policy_version 300512 (0.0007) [2023-12-26 01:58:56,698][123090] Updated weights for policy 1, policy_version 298950 (0.0009) [2023-12-26 01:58:56,716][123091] Updated weights for policy 0, policy_version 300522 (0.0005) [2023-12-26 01:58:56,758][123090] Updated weights for policy 1, policy_version 298961 (0.0009) [2023-12-26 01:58:56,815][123090] Updated weights for policy 1, policy_version 298971 (0.0010) [2023-12-26 01:58:57,391][123091] Updated weights for policy 0, policy_version 300532 (0.0007) [2023-12-26 01:58:57,442][123091] Updated weights for policy 0, policy_version 300542 (0.0009) [2023-12-26 01:58:57,491][123091] Updated weights for policy 0, policy_version 300552 (0.0009) [2023-12-26 01:58:57,703][123090] Updated weights for policy 1, policy_version 298981 (0.0010) [2023-12-26 01:58:57,761][123090] Updated weights for policy 1, policy_version 298991 (0.0010) [2023-12-26 01:58:57,819][123090] Updated weights for policy 1, policy_version 299001 (0.0010) [2023-12-26 01:58:58,317][123091] Updated weights for policy 0, policy_version 300562 (0.0008) [2023-12-26 01:58:58,381][123091] Updated weights for policy 0, policy_version 300572 (0.0006) [2023-12-26 01:58:58,448][123091] Updated weights for policy 0, policy_version 300582 (0.0010) [2023-12-26 01:58:58,514][123091] Updated weights for policy 0, policy_version 300592 (0.0010) [2023-12-26 01:58:58,728][123090] Updated weights for policy 1, policy_version 299011 (0.0009) [2023-12-26 01:58:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 153501696. Throughput: 0: 8858.9, 1: 9029.4. Samples: 153499132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:58:58,785][121949] Avg episode reward: [(0, '6196.863'), (1, '5448.324')] [2023-12-26 01:58:58,802][123090] Updated weights for policy 1, policy_version 299021 (0.0008) [2023-12-26 01:58:58,867][123090] Updated weights for policy 1, policy_version 299031 (0.0007) [2023-12-26 01:58:59,412][123091] Updated weights for policy 0, policy_version 300602 (0.0010) [2023-12-26 01:58:59,460][123091] Updated weights for policy 0, policy_version 300612 (0.0009) [2023-12-26 01:58:59,520][123091] Updated weights for policy 0, policy_version 300622 (0.0010) [2023-12-26 01:58:59,642][123090] Updated weights for policy 1, policy_version 299041 (0.0007) [2023-12-26 01:58:59,715][123090] Updated weights for policy 1, policy_version 299051 (0.0009) [2023-12-26 01:58:59,780][123090] Updated weights for policy 1, policy_version 299061 (0.0009) [2023-12-26 01:58:59,850][123090] Updated weights for policy 1, policy_version 299071 (0.0008) [2023-12-26 01:59:00,294][123091] Updated weights for policy 0, policy_version 300632 (0.0010) [2023-12-26 01:59:00,355][123091] Updated weights for policy 0, policy_version 300642 (0.0009) [2023-12-26 01:59:00,407][123091] Updated weights for policy 0, policy_version 300652 (0.0009) [2023-12-26 01:59:00,595][123090] Updated weights for policy 1, policy_version 299081 (0.0008) [2023-12-26 01:59:00,651][123090] Updated weights for policy 1, policy_version 299091 (0.0007) [2023-12-26 01:59:00,716][123090] Updated weights for policy 1, policy_version 299101 (0.0008) [2023-12-26 01:59:01,228][123091] Updated weights for policy 0, policy_version 300662 (0.0010) [2023-12-26 01:59:01,297][123091] Updated weights for policy 0, policy_version 300673 (0.0011) [2023-12-26 01:59:01,367][123091] Updated weights for policy 0, policy_version 300683 (0.0011) [2023-12-26 01:59:01,438][123090] Updated weights for policy 1, policy_version 299111 (0.0007) [2023-12-26 01:59:01,507][123090] Updated weights for policy 1, policy_version 299121 (0.0005) [2023-12-26 01:59:01,573][123090] Updated weights for policy 1, policy_version 299131 (0.0005) [2023-12-26 01:59:02,139][123091] Updated weights for policy 0, policy_version 300693 (0.0009) [2023-12-26 01:59:02,188][123091] Updated weights for policy 0, policy_version 300703 (0.0009) [2023-12-26 01:59:02,242][123091] Updated weights for policy 0, policy_version 300713 (0.0010) [2023-12-26 01:59:02,393][123090] Updated weights for policy 1, policy_version 299141 (0.0008) [2023-12-26 01:59:02,464][123090] Updated weights for policy 1, policy_version 299151 (0.0010) [2023-12-26 01:59:02,535][123090] Updated weights for policy 1, policy_version 299161 (0.0009) [2023-12-26 01:59:03,047][123091] Updated weights for policy 0, policy_version 300723 (0.0009) [2023-12-26 01:59:03,093][123091] Updated weights for policy 0, policy_version 300733 (0.0008) [2023-12-26 01:59:03,141][123091] Updated weights for policy 0, policy_version 300743 (0.0010) [2023-12-26 01:59:03,360][123090] Updated weights for policy 1, policy_version 299171 (0.0008) [2023-12-26 01:59:03,415][123090] Updated weights for policy 1, policy_version 299181 (0.0010) [2023-12-26 01:59:03,459][123090] Updated weights for policy 1, policy_version 299191 (0.0010) [2023-12-26 01:59:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 153591808. Throughput: 0: 8799.3, 1: 8962.0. Samples: 153602988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:03,785][121949] Avg episode reward: [(0, '6187.254'), (1, '5404.772')] [2023-12-26 01:59:03,996][123091] Updated weights for policy 0, policy_version 300753 (0.0010) [2023-12-26 01:59:04,054][123091] Updated weights for policy 0, policy_version 300763 (0.0010) [2023-12-26 01:59:04,106][123091] Updated weights for policy 0, policy_version 300773 (0.0010) [2023-12-26 01:59:04,170][123090] Updated weights for policy 1, policy_version 299201 (0.0010) [2023-12-26 01:59:04,177][123091] Updated weights for policy 0, policy_version 300783 (0.0011) [2023-12-26 01:59:04,228][123090] Updated weights for policy 1, policy_version 299211 (0.0005) [2023-12-26 01:59:04,298][123090] Updated weights for policy 1, policy_version 299221 (0.0005) [2023-12-26 01:59:04,369][123090] Updated weights for policy 1, policy_version 299231 (0.0007) [2023-12-26 01:59:04,941][123091] Updated weights for policy 0, policy_version 300793 (0.0006) [2023-12-26 01:59:04,988][123091] Updated weights for policy 0, policy_version 300803 (0.0006) [2023-12-26 01:59:05,022][123090] Updated weights for policy 1, policy_version 299241 (0.0007) [2023-12-26 01:59:05,050][123091] Updated weights for policy 0, policy_version 300813 (0.0006) [2023-12-26 01:59:05,078][123090] Updated weights for policy 1, policy_version 299251 (0.0008) [2023-12-26 01:59:05,130][123090] Updated weights for policy 1, policy_version 299261 (0.0009) [2023-12-26 01:59:05,683][123091] Updated weights for policy 0, policy_version 300823 (0.0005) [2023-12-26 01:59:05,729][123091] Updated weights for policy 0, policy_version 300833 (0.0005) [2023-12-26 01:59:05,778][123091] Updated weights for policy 0, policy_version 300843 (0.0006) [2023-12-26 01:59:06,060][123090] Updated weights for policy 1, policy_version 299271 (0.0010) [2023-12-26 01:59:06,125][123090] Updated weights for policy 1, policy_version 299281 (0.0008) [2023-12-26 01:59:06,194][123090] Updated weights for policy 1, policy_version 299291 (0.0008) [2023-12-26 01:59:06,527][123091] Updated weights for policy 0, policy_version 300853 (0.0008) [2023-12-26 01:59:06,593][123091] Updated weights for policy 0, policy_version 300863 (0.0010) [2023-12-26 01:59:06,662][123091] Updated weights for policy 0, policy_version 300873 (0.0011) [2023-12-26 01:59:06,983][123090] Updated weights for policy 1, policy_version 299301 (0.0007) [2023-12-26 01:59:07,050][123090] Updated weights for policy 1, policy_version 299311 (0.0005) [2023-12-26 01:59:07,100][123090] Updated weights for policy 1, policy_version 299321 (0.0005) [2023-12-26 01:59:07,325][123091] Updated weights for policy 0, policy_version 300883 (0.0008) [2023-12-26 01:59:07,393][123091] Updated weights for policy 0, policy_version 300893 (0.0007) [2023-12-26 01:59:07,448][123091] Updated weights for policy 0, policy_version 300903 (0.0010) [2023-12-26 01:59:07,876][123090] Updated weights for policy 1, policy_version 299331 (0.0007) [2023-12-26 01:59:07,945][123090] Updated weights for policy 1, policy_version 299341 (0.0009) [2023-12-26 01:59:08,005][123090] Updated weights for policy 1, policy_version 299351 (0.0009) [2023-12-26 01:59:08,129][123091] Updated weights for policy 0, policy_version 300913 (0.0010) [2023-12-26 01:59:08,189][123091] Updated weights for policy 0, policy_version 300923 (0.0005) [2023-12-26 01:59:08,237][123091] Updated weights for policy 0, policy_version 300933 (0.0005) [2023-12-26 01:59:08,284][123091] Updated weights for policy 0, policy_version 300943 (0.0005) [2023-12-26 01:59:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 153681920. Throughput: 0: 8878.1, 1: 8998.0. Samples: 153659412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:08,785][121949] Avg episode reward: [(0, '6110.902'), (1, '5425.976')] [2023-12-26 01:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000300944_77045760.pth... [2023-12-26 01:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000299360_76636160.pth... [2023-12-26 01:59:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000299888_76775424.pth [2023-12-26 01:59:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000298368_76382208.pth [2023-12-26 01:59:08,898][123090] Updated weights for policy 1, policy_version 299361 (0.0010) [2023-12-26 01:59:08,968][123090] Updated weights for policy 1, policy_version 299371 (0.0008) [2023-12-26 01:59:08,975][123091] Updated weights for policy 0, policy_version 300953 (0.0009) [2023-12-26 01:59:09,027][123091] Updated weights for policy 0, policy_version 300963 (0.0009) [2023-12-26 01:59:09,031][123090] Updated weights for policy 1, policy_version 299381 (0.0008) [2023-12-26 01:59:09,077][123091] Updated weights for policy 0, policy_version 300973 (0.0007) [2023-12-26 01:59:09,087][123090] Updated weights for policy 1, policy_version 299391 (0.0009) [2023-12-26 01:59:09,941][123090] Updated weights for policy 1, policy_version 299401 (0.0009) [2023-12-26 01:59:09,968][123091] Updated weights for policy 0, policy_version 300983 (0.0008) [2023-12-26 01:59:10,000][123090] Updated weights for policy 1, policy_version 299411 (0.0005) [2023-12-26 01:59:10,028][123091] Updated weights for policy 0, policy_version 300993 (0.0009) [2023-12-26 01:59:10,068][123090] Updated weights for policy 1, policy_version 299421 (0.0007) [2023-12-26 01:59:10,097][123091] Updated weights for policy 0, policy_version 301003 (0.0009) [2023-12-26 01:59:10,818][123090] Updated weights for policy 1, policy_version 299431 (0.0008) [2023-12-26 01:59:10,879][123090] Updated weights for policy 1, policy_version 299441 (0.0009) [2023-12-26 01:59:10,937][123090] Updated weights for policy 1, policy_version 299451 (0.0009) [2023-12-26 01:59:10,975][123091] Updated weights for policy 0, policy_version 301013 (0.0009) [2023-12-26 01:59:11,039][123091] Updated weights for policy 0, policy_version 301023 (0.0009) [2023-12-26 01:59:11,107][123091] Updated weights for policy 0, policy_version 301033 (0.0009) [2023-12-26 01:59:11,799][123090] Updated weights for policy 1, policy_version 299461 (0.0009) [2023-12-26 01:59:11,867][123090] Updated weights for policy 1, policy_version 299471 (0.0009) [2023-12-26 01:59:11,938][123090] Updated weights for policy 1, policy_version 299481 (0.0010) [2023-12-26 01:59:11,944][123091] Updated weights for policy 0, policy_version 301043 (0.0010) [2023-12-26 01:59:12,013][123091] Updated weights for policy 0, policy_version 301053 (0.0007) [2023-12-26 01:59:12,076][123091] Updated weights for policy 0, policy_version 301063 (0.0010) [2023-12-26 01:59:12,721][123090] Updated weights for policy 1, policy_version 299491 (0.0009) [2023-12-26 01:59:12,774][123090] Updated weights for policy 1, policy_version 299501 (0.0008) [2023-12-26 01:59:12,841][123090] Updated weights for policy 1, policy_version 299511 (0.0008) [2023-12-26 01:59:12,986][123091] Updated weights for policy 0, policy_version 301073 (0.0010) [2023-12-26 01:59:13,042][123091] Updated weights for policy 0, policy_version 301083 (0.0010) [2023-12-26 01:59:13,096][123091] Updated weights for policy 0, policy_version 301093 (0.0009) [2023-12-26 01:59:13,151][123091] Updated weights for policy 0, policy_version 301103 (0.0009) [2023-12-26 01:59:13,529][123090] Updated weights for policy 1, policy_version 299521 (0.0008) [2023-12-26 01:59:13,579][123090] Updated weights for policy 1, policy_version 299531 (0.0005) [2023-12-26 01:59:13,631][123090] Updated weights for policy 1, policy_version 299541 (0.0005) [2023-12-26 01:59:13,699][123090] Updated weights for policy 1, policy_version 299551 (0.0005) [2023-12-26 01:59:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 153772032. Throughput: 0: 8839.8, 1: 8955.2. Samples: 153764484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:13,785][121949] Avg episode reward: [(0, '6076.252'), (1, '5562.094')] [2023-12-26 01:59:14,078][123091] Updated weights for policy 0, policy_version 301113 (0.0006) [2023-12-26 01:59:14,146][123091] Updated weights for policy 0, policy_version 301123 (0.0006) [2023-12-26 01:59:14,208][123091] Updated weights for policy 0, policy_version 301133 (0.0005) [2023-12-26 01:59:14,451][123090] Updated weights for policy 1, policy_version 299561 (0.0009) [2023-12-26 01:59:14,504][123090] Updated weights for policy 1, policy_version 299571 (0.0010) [2023-12-26 01:59:14,561][123090] Updated weights for policy 1, policy_version 299581 (0.0009) [2023-12-26 01:59:14,855][123091] Updated weights for policy 0, policy_version 301143 (0.0008) [2023-12-26 01:59:14,919][123091] Updated weights for policy 0, policy_version 301153 (0.0009) [2023-12-26 01:59:14,978][123091] Updated weights for policy 0, policy_version 301163 (0.0009) [2023-12-26 01:59:15,496][123090] Updated weights for policy 1, policy_version 299591 (0.0010) [2023-12-26 01:59:15,562][123090] Updated weights for policy 1, policy_version 299601 (0.0010) [2023-12-26 01:59:15,627][123090] Updated weights for policy 1, policy_version 299611 (0.0010) [2023-12-26 01:59:15,746][123091] Updated weights for policy 0, policy_version 301173 (0.0010) [2023-12-26 01:59:15,803][123091] Updated weights for policy 0, policy_version 301183 (0.0009) [2023-12-26 01:59:15,854][123091] Updated weights for policy 0, policy_version 301193 (0.0009) [2023-12-26 01:59:16,458][123090] Updated weights for policy 1, policy_version 299622 (0.0010) [2023-12-26 01:59:16,517][123090] Updated weights for policy 1, policy_version 299632 (0.0008) [2023-12-26 01:59:16,572][123090] Updated weights for policy 1, policy_version 299642 (0.0009) [2023-12-26 01:59:16,673][123091] Updated weights for policy 0, policy_version 301203 (0.0009) [2023-12-26 01:59:16,724][123091] Updated weights for policy 0, policy_version 301213 (0.0007) [2023-12-26 01:59:16,780][123091] Updated weights for policy 0, policy_version 301223 (0.0006) [2023-12-26 01:59:17,388][123090] Updated weights for policy 1, policy_version 299652 (0.0008) [2023-12-26 01:59:17,443][123090] Updated weights for policy 1, policy_version 299662 (0.0008) [2023-12-26 01:59:17,490][123090] Updated weights for policy 1, policy_version 299672 (0.0009) [2023-12-26 01:59:17,607][123091] Updated weights for policy 0, policy_version 301233 (0.0009) [2023-12-26 01:59:17,669][123091] Updated weights for policy 0, policy_version 301243 (0.0009) [2023-12-26 01:59:17,721][123091] Updated weights for policy 0, policy_version 301253 (0.0009) [2023-12-26 01:59:17,776][123091] Updated weights for policy 0, policy_version 301263 (0.0009) [2023-12-26 01:59:18,323][123090] Updated weights for policy 1, policy_version 299682 (0.0009) [2023-12-26 01:59:18,395][123090] Updated weights for policy 1, policy_version 299692 (0.0009) [2023-12-26 01:59:18,465][123090] Updated weights for policy 1, policy_version 299702 (0.0009) [2023-12-26 01:59:18,526][123090] Updated weights for policy 1, policy_version 299712 (0.0009) [2023-12-26 01:59:18,608][123091] Updated weights for policy 0, policy_version 301273 (0.0009) [2023-12-26 01:59:18,661][123091] Updated weights for policy 0, policy_version 301283 (0.0009) [2023-12-26 01:59:18,719][123091] Updated weights for policy 0, policy_version 301294 (0.0010) [2023-12-26 01:59:18,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 153862144. Throughput: 0: 8828.7, 1: 8839.0. Samples: 153868764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:18,786][121949] Avg episode reward: [(0, '6021.652'), (1, '5626.846')] [2023-12-26 01:59:19,350][123090] Updated weights for policy 1, policy_version 299722 (0.0010) [2023-12-26 01:59:19,427][123090] Updated weights for policy 1, policy_version 299732 (0.0010) [2023-12-26 01:59:19,494][123090] Updated weights for policy 1, policy_version 299742 (0.0009) [2023-12-26 01:59:19,517][123091] Updated weights for policy 0, policy_version 301304 (0.0010) [2023-12-26 01:59:19,572][123091] Updated weights for policy 0, policy_version 301314 (0.0009) [2023-12-26 01:59:19,636][123091] Updated weights for policy 0, policy_version 301324 (0.0010) [2023-12-26 01:59:20,399][123090] Updated weights for policy 1, policy_version 299752 (0.0008) [2023-12-26 01:59:20,413][123091] Updated weights for policy 0, policy_version 301334 (0.0009) [2023-12-26 01:59:20,459][123090] Updated weights for policy 1, policy_version 299762 (0.0005) [2023-12-26 01:59:20,477][123091] Updated weights for policy 0, policy_version 301344 (0.0011) [2023-12-26 01:59:20,519][123090] Updated weights for policy 1, policy_version 299772 (0.0007) [2023-12-26 01:59:20,536][123091] Updated weights for policy 0, policy_version 301354 (0.0011) [2023-12-26 01:59:21,380][123090] Updated weights for policy 1, policy_version 299782 (0.0008) [2023-12-26 01:59:21,397][123091] Updated weights for policy 0, policy_version 301364 (0.0008) [2023-12-26 01:59:21,446][123090] Updated weights for policy 1, policy_version 299792 (0.0007) [2023-12-26 01:59:21,465][123091] Updated weights for policy 0, policy_version 301374 (0.0006) [2023-12-26 01:59:21,510][123090] Updated weights for policy 1, policy_version 299802 (0.0008) [2023-12-26 01:59:21,528][123091] Updated weights for policy 0, policy_version 301384 (0.0009) [2023-12-26 01:59:22,319][123090] Updated weights for policy 1, policy_version 299812 (0.0007) [2023-12-26 01:59:22,367][123091] Updated weights for policy 0, policy_version 301394 (0.0008) [2023-12-26 01:59:22,392][123090] Updated weights for policy 1, policy_version 299822 (0.0009) [2023-12-26 01:59:22,427][123091] Updated weights for policy 0, policy_version 301404 (0.0009) [2023-12-26 01:59:22,458][123090] Updated weights for policy 1, policy_version 299832 (0.0009) [2023-12-26 01:59:22,482][123091] Updated weights for policy 0, policy_version 301414 (0.0009) [2023-12-26 01:59:22,532][123091] Updated weights for policy 0, policy_version 301424 (0.0005) [2023-12-26 01:59:23,216][123090] Updated weights for policy 1, policy_version 299842 (0.0009) [2023-12-26 01:59:23,278][123090] Updated weights for policy 1, policy_version 299852 (0.0010) [2023-12-26 01:59:23,330][123090] Updated weights for policy 1, policy_version 299862 (0.0010) [2023-12-26 01:59:23,381][123091] Updated weights for policy 0, policy_version 301434 (0.0009) [2023-12-26 01:59:23,384][123090] Updated weights for policy 1, policy_version 299872 (0.0007) [2023-12-26 01:59:23,442][123091] Updated weights for policy 0, policy_version 301444 (0.0009) [2023-12-26 01:59:23,506][123091] Updated weights for policy 0, policy_version 301454 (0.0009) [2023-12-26 01:59:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 153944064. Throughput: 0: 8834.7, 1: 8711.3. Samples: 153919192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:23,785][121949] Avg episode reward: [(0, '6147.125'), (1, '5594.025')] [2023-12-26 01:59:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000299872_76767232.pth... [2023-12-26 01:59:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000301456_77176832.pth... [2023-12-26 01:59:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000298848_76505088.pth [2023-12-26 01:59:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000300400_76906496.pth [2023-12-26 01:59:24,256][123091] Updated weights for policy 0, policy_version 301464 (0.0009) [2023-12-26 01:59:24,264][123090] Updated weights for policy 1, policy_version 299882 (0.0007) [2023-12-26 01:59:24,323][123091] Updated weights for policy 0, policy_version 301474 (0.0010) [2023-12-26 01:59:24,331][123090] Updated weights for policy 1, policy_version 299892 (0.0006) [2023-12-26 01:59:24,378][123091] Updated weights for policy 0, policy_version 301484 (0.0009) [2023-12-26 01:59:24,397][123090] Updated weights for policy 1, policy_version 299902 (0.0008) [2023-12-26 01:59:25,177][123091] Updated weights for policy 0, policy_version 301494 (0.0008) [2023-12-26 01:59:25,217][123090] Updated weights for policy 1, policy_version 299912 (0.0009) [2023-12-26 01:59:25,233][123091] Updated weights for policy 0, policy_version 301504 (0.0005) [2023-12-26 01:59:25,278][123090] Updated weights for policy 1, policy_version 299922 (0.0008) [2023-12-26 01:59:25,294][123091] Updated weights for policy 0, policy_version 301514 (0.0005) [2023-12-26 01:59:25,332][123090] Updated weights for policy 1, policy_version 299932 (0.0009) [2023-12-26 01:59:26,072][123091] Updated weights for policy 0, policy_version 301524 (0.0007) [2023-12-26 01:59:26,093][123090] Updated weights for policy 1, policy_version 299942 (0.0005) [2023-12-26 01:59:26,127][123091] Updated weights for policy 0, policy_version 301534 (0.0007) [2023-12-26 01:59:26,150][123090] Updated weights for policy 1, policy_version 299952 (0.0010) [2023-12-26 01:59:26,178][123091] Updated weights for policy 0, policy_version 301544 (0.0007) [2023-12-26 01:59:26,208][123090] Updated weights for policy 1, policy_version 299962 (0.0010) [2023-12-26 01:59:26,930][123090] Updated weights for policy 1, policy_version 299972 (0.0008) [2023-12-26 01:59:26,993][123090] Updated weights for policy 1, policy_version 299982 (0.0005) [2023-12-26 01:59:27,055][123090] Updated weights for policy 1, policy_version 299992 (0.0005) [2023-12-26 01:59:27,102][123091] Updated weights for policy 0, policy_version 301554 (0.0010) [2023-12-26 01:59:27,163][123091] Updated weights for policy 0, policy_version 301564 (0.0009) [2023-12-26 01:59:27,231][123091] Updated weights for policy 0, policy_version 301574 (0.0009) [2023-12-26 01:59:27,284][123091] Updated weights for policy 0, policy_version 301584 (0.0009) [2023-12-26 01:59:27,748][123090] Updated weights for policy 1, policy_version 300002 (0.0005) [2023-12-26 01:59:27,810][123090] Updated weights for policy 1, policy_version 300012 (0.0005) [2023-12-26 01:59:27,885][123090] Updated weights for policy 1, policy_version 300022 (0.0006) [2023-12-26 01:59:27,932][123090] Updated weights for policy 1, policy_version 300032 (0.0005) [2023-12-26 01:59:28,185][123091] Updated weights for policy 0, policy_version 301594 (0.0009) [2023-12-26 01:59:28,231][123091] Updated weights for policy 0, policy_version 301604 (0.0008) [2023-12-26 01:59:28,279][123091] Updated weights for policy 0, policy_version 301614 (0.0009) [2023-12-26 01:59:28,698][123090] Updated weights for policy 1, policy_version 300042 (0.0009) [2023-12-26 01:59:28,755][123090] Updated weights for policy 1, policy_version 300052 (0.0010) [2023-12-26 01:59:28,784][121949] Fps is (10 sec: 16384.7, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 154025984. Throughput: 0: 8841.7, 1: 8717.4. Samples: 154024724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:28,784][121949] Avg episode reward: [(0, '6241.381'), (1, '5407.868')] [2023-12-26 01:59:28,820][123090] Updated weights for policy 1, policy_version 300062 (0.0009) [2023-12-26 01:59:29,087][123091] Updated weights for policy 0, policy_version 301624 (0.0010) [2023-12-26 01:59:29,155][123091] Updated weights for policy 0, policy_version 301634 (0.0009) [2023-12-26 01:59:29,214][123091] Updated weights for policy 0, policy_version 301644 (0.0010) [2023-12-26 01:59:29,596][123090] Updated weights for policy 1, policy_version 300072 (0.0007) [2023-12-26 01:59:29,654][123090] Updated weights for policy 1, policy_version 300082 (0.0006) [2023-12-26 01:59:29,721][123090] Updated weights for policy 1, policy_version 300092 (0.0006) [2023-12-26 01:59:30,032][123091] Updated weights for policy 0, policy_version 301654 (0.0007) [2023-12-26 01:59:30,089][123091] Updated weights for policy 0, policy_version 301664 (0.0006) [2023-12-26 01:59:30,160][123091] Updated weights for policy 0, policy_version 301674 (0.0006) [2023-12-26 01:59:30,419][123090] Updated weights for policy 1, policy_version 300102 (0.0006) [2023-12-26 01:59:30,489][123090] Updated weights for policy 1, policy_version 300112 (0.0005) [2023-12-26 01:59:30,559][123090] Updated weights for policy 1, policy_version 300122 (0.0006) [2023-12-26 01:59:30,944][123091] Updated weights for policy 0, policy_version 301684 (0.0007) [2023-12-26 01:59:30,993][123091] Updated weights for policy 0, policy_version 301695 (0.0009) [2023-12-26 01:59:31,049][123091] Updated weights for policy 0, policy_version 301706 (0.0010) [2023-12-26 01:59:31,164][123090] Updated weights for policy 1, policy_version 300132 (0.0007) [2023-12-26 01:59:31,227][123090] Updated weights for policy 1, policy_version 300142 (0.0011) [2023-12-26 01:59:31,295][123090] Updated weights for policy 1, policy_version 300152 (0.0010) [2023-12-26 01:59:31,907][123091] Updated weights for policy 0, policy_version 301716 (0.0006) [2023-12-26 01:59:31,969][123091] Updated weights for policy 0, policy_version 301726 (0.0005) [2023-12-26 01:59:32,044][123091] Updated weights for policy 0, policy_version 301736 (0.0005) [2023-12-26 01:59:32,044][123090] Updated weights for policy 1, policy_version 300162 (0.0010) [2023-12-26 01:59:32,109][123090] Updated weights for policy 1, policy_version 300172 (0.0008) [2023-12-26 01:59:32,165][123090] Updated weights for policy 1, policy_version 300182 (0.0009) [2023-12-26 01:59:32,220][123090] Updated weights for policy 1, policy_version 300192 (0.0009) [2023-12-26 01:59:32,807][123091] Updated weights for policy 0, policy_version 301746 (0.0009) [2023-12-26 01:59:32,860][123091] Updated weights for policy 0, policy_version 301756 (0.0009) [2023-12-26 01:59:32,915][123091] Updated weights for policy 0, policy_version 301766 (0.0009) [2023-12-26 01:59:32,963][123091] Updated weights for policy 0, policy_version 301776 (0.0009) [2023-12-26 01:59:33,036][123090] Updated weights for policy 1, policy_version 300202 (0.0010) [2023-12-26 01:59:33,087][123090] Updated weights for policy 1, policy_version 300212 (0.0008) [2023-12-26 01:59:33,139][123090] Updated weights for policy 1, policy_version 300223 (0.0008) [2023-12-26 01:59:33,767][123091] Updated weights for policy 0, policy_version 301786 (0.0005) [2023-12-26 01:59:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 154116096. Throughput: 0: 8817.9, 1: 8756.2. Samples: 154131616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:33,785][121949] Avg episode reward: [(0, '6284.458'), (1, '5269.449')] [2023-12-26 01:59:33,813][123091] Updated weights for policy 0, policy_version 301796 (0.0005) [2023-12-26 01:59:33,876][123091] Updated weights for policy 0, policy_version 301806 (0.0005) [2023-12-26 01:59:33,989][123090] Updated weights for policy 1, policy_version 300233 (0.0009) [2023-12-26 01:59:34,042][123090] Updated weights for policy 1, policy_version 300243 (0.0009) [2023-12-26 01:59:34,090][123090] Updated weights for policy 1, policy_version 300253 (0.0008) [2023-12-26 01:59:34,678][123091] Updated weights for policy 0, policy_version 301816 (0.0009) [2023-12-26 01:59:34,740][123091] Updated weights for policy 0, policy_version 301826 (0.0007) [2023-12-26 01:59:34,800][123091] Updated weights for policy 0, policy_version 301836 (0.0005) [2023-12-26 01:59:34,883][123090] Updated weights for policy 1, policy_version 300263 (0.0008) [2023-12-26 01:59:34,941][123090] Updated weights for policy 1, policy_version 300273 (0.0010) [2023-12-26 01:59:34,997][123090] Updated weights for policy 1, policy_version 300283 (0.0013) [2023-12-26 01:59:35,574][123091] Updated weights for policy 0, policy_version 301846 (0.0007) [2023-12-26 01:59:35,626][123091] Updated weights for policy 0, policy_version 301856 (0.0009) [2023-12-26 01:59:35,685][123091] Updated weights for policy 0, policy_version 301866 (0.0009) [2023-12-26 01:59:35,825][123090] Updated weights for policy 1, policy_version 300293 (0.0010) [2023-12-26 01:59:35,888][123090] Updated weights for policy 1, policy_version 300303 (0.0007) [2023-12-26 01:59:35,940][123090] Updated weights for policy 1, policy_version 300313 (0.0005) [2023-12-26 01:59:36,556][123091] Updated weights for policy 0, policy_version 301876 (0.0009) [2023-12-26 01:59:36,626][123091] Updated weights for policy 0, policy_version 301886 (0.0010) [2023-12-26 01:59:36,696][123091] Updated weights for policy 0, policy_version 301896 (0.0009) [2023-12-26 01:59:36,763][123090] Updated weights for policy 1, policy_version 300323 (0.0006) [2023-12-26 01:59:36,825][123090] Updated weights for policy 1, policy_version 300333 (0.0009) [2023-12-26 01:59:36,880][123090] Updated weights for policy 1, policy_version 300343 (0.0009) [2023-12-26 01:59:37,502][123091] Updated weights for policy 0, policy_version 301906 (0.0008) [2023-12-26 01:59:37,556][123091] Updated weights for policy 0, policy_version 301916 (0.0009) [2023-12-26 01:59:37,616][123091] Updated weights for policy 0, policy_version 301926 (0.0010) [2023-12-26 01:59:37,682][123091] Updated weights for policy 0, policy_version 301936 (0.0010) [2023-12-26 01:59:37,704][123090] Updated weights for policy 1, policy_version 300353 (0.0009) [2023-12-26 01:59:37,776][123090] Updated weights for policy 1, policy_version 300363 (0.0005) [2023-12-26 01:59:37,850][123090] Updated weights for policy 1, policy_version 300373 (0.0007) [2023-12-26 01:59:37,920][123090] Updated weights for policy 1, policy_version 300383 (0.0010) [2023-12-26 01:59:38,531][123091] Updated weights for policy 0, policy_version 301946 (0.0008) [2023-12-26 01:59:38,592][123091] Updated weights for policy 0, policy_version 301956 (0.0007) [2023-12-26 01:59:38,650][123090] Updated weights for policy 1, policy_version 300393 (0.0006) [2023-12-26 01:59:38,662][123091] Updated weights for policy 0, policy_version 301966 (0.0007) [2023-12-26 01:59:38,713][123090] Updated weights for policy 1, policy_version 300403 (0.0005) [2023-12-26 01:59:38,780][123090] Updated weights for policy 1, policy_version 300413 (0.0006) [2023-12-26 01:59:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 154206208. Throughput: 0: 8818.2, 1: 8772.9. Samples: 154184632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:38,785][121949] Avg episode reward: [(0, '6196.564'), (1, '5388.395')] [2023-12-26 01:59:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000301968_77307904.pth... [2023-12-26 01:59:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000300944_77045760.pth [2023-12-26 01:59:38,800][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000300416_76906496.pth... [2023-12-26 01:59:38,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000299360_76636160.pth [2023-12-26 01:59:39,479][123091] Updated weights for policy 0, policy_version 301976 (0.0008) [2023-12-26 01:59:39,543][123090] Updated weights for policy 1, policy_version 300423 (0.0006) [2023-12-26 01:59:39,549][123091] Updated weights for policy 0, policy_version 301986 (0.0008) [2023-12-26 01:59:39,593][123090] Updated weights for policy 1, policy_version 300433 (0.0006) [2023-12-26 01:59:39,619][123091] Updated weights for policy 0, policy_version 301996 (0.0008) [2023-12-26 01:59:39,653][123090] Updated weights for policy 1, policy_version 300443 (0.0006) [2023-12-26 01:59:40,309][123091] Updated weights for policy 0, policy_version 302006 (0.0009) [2023-12-26 01:59:40,367][123091] Updated weights for policy 0, policy_version 302016 (0.0008) [2023-12-26 01:59:40,391][123090] Updated weights for policy 1, policy_version 300453 (0.0007) [2023-12-26 01:59:40,433][123091] Updated weights for policy 0, policy_version 302026 (0.0009) [2023-12-26 01:59:40,451][123090] Updated weights for policy 1, policy_version 300463 (0.0006) [2023-12-26 01:59:40,510][123090] Updated weights for policy 1, policy_version 300473 (0.0008) [2023-12-26 01:59:41,272][123090] Updated weights for policy 1, policy_version 300483 (0.0007) [2023-12-26 01:59:41,340][123090] Updated weights for policy 1, policy_version 300493 (0.0009) [2023-12-26 01:59:41,350][123091] Updated weights for policy 0, policy_version 302036 (0.0009) [2023-12-26 01:59:41,404][123090] Updated weights for policy 1, policy_version 300503 (0.0009) [2023-12-26 01:59:41,420][123091] Updated weights for policy 0, policy_version 302046 (0.0008) [2023-12-26 01:59:41,474][123091] Updated weights for policy 0, policy_version 302056 (0.0009) [2023-12-26 01:59:42,239][123090] Updated weights for policy 1, policy_version 300513 (0.0008) [2023-12-26 01:59:42,280][123091] Updated weights for policy 0, policy_version 302066 (0.0010) [2023-12-26 01:59:42,298][123090] Updated weights for policy 1, policy_version 300523 (0.0009) [2023-12-26 01:59:42,350][123091] Updated weights for policy 0, policy_version 302076 (0.0008) [2023-12-26 01:59:42,371][123090] Updated weights for policy 1, policy_version 300533 (0.0009) [2023-12-26 01:59:42,407][123091] Updated weights for policy 0, policy_version 302086 (0.0009) [2023-12-26 01:59:42,428][123090] Updated weights for policy 1, policy_version 300543 (0.0009) [2023-12-26 01:59:42,457][123091] Updated weights for policy 0, policy_version 302096 (0.0008) [2023-12-26 01:59:43,280][123090] Updated weights for policy 1, policy_version 300553 (0.0009) [2023-12-26 01:59:43,291][123091] Updated weights for policy 0, policy_version 302106 (0.0008) [2023-12-26 01:59:43,334][123090] Updated weights for policy 1, policy_version 300563 (0.0006) [2023-12-26 01:59:43,348][123091] Updated weights for policy 0, policy_version 302116 (0.0010) [2023-12-26 01:59:43,390][123090] Updated weights for policy 1, policy_version 300573 (0.0009) [2023-12-26 01:59:43,402][123091] Updated weights for policy 0, policy_version 302126 (0.0008) [2023-12-26 01:59:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 154296320. Throughput: 0: 8752.0, 1: 8809.9. Samples: 154289416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:43,785][121949] Avg episode reward: [(0, '6091.143'), (1, '5509.820')] [2023-12-26 01:59:44,104][123090] Updated weights for policy 1, policy_version 300583 (0.0008) [2023-12-26 01:59:44,158][123090] Updated weights for policy 1, policy_version 300593 (0.0008) [2023-12-26 01:59:44,218][123090] Updated weights for policy 1, policy_version 300603 (0.0007) [2023-12-26 01:59:44,282][123091] Updated weights for policy 0, policy_version 302136 (0.0010) [2023-12-26 01:59:44,339][123091] Updated weights for policy 0, policy_version 302146 (0.0009) [2023-12-26 01:59:44,409][123091] Updated weights for policy 0, policy_version 302156 (0.0009) [2023-12-26 01:59:45,037][123090] Updated weights for policy 1, policy_version 300613 (0.0006) [2023-12-26 01:59:45,105][123090] Updated weights for policy 1, policy_version 300623 (0.0009) [2023-12-26 01:59:45,172][123090] Updated weights for policy 1, policy_version 300633 (0.0010) [2023-12-26 01:59:45,254][123091] Updated weights for policy 0, policy_version 302166 (0.0009) [2023-12-26 01:59:45,317][123091] Updated weights for policy 0, policy_version 302176 (0.0009) [2023-12-26 01:59:45,371][123091] Updated weights for policy 0, policy_version 302186 (0.0010) [2023-12-26 01:59:45,955][123090] Updated weights for policy 1, policy_version 300643 (0.0010) [2023-12-26 01:59:46,014][123090] Updated weights for policy 1, policy_version 300653 (0.0010) [2023-12-26 01:59:46,072][123090] Updated weights for policy 1, policy_version 300663 (0.0010) [2023-12-26 01:59:46,150][123091] Updated weights for policy 0, policy_version 302197 (0.0008) [2023-12-26 01:59:46,204][123091] Updated weights for policy 0, policy_version 302207 (0.0005) [2023-12-26 01:59:46,264][123091] Updated weights for policy 0, policy_version 302217 (0.0009) [2023-12-26 01:59:46,914][123090] Updated weights for policy 1, policy_version 300673 (0.0009) [2023-12-26 01:59:46,963][123090] Updated weights for policy 1, policy_version 300683 (0.0009) [2023-12-26 01:59:47,024][123090] Updated weights for policy 1, policy_version 300693 (0.0008) [2023-12-26 01:59:47,031][123091] Updated weights for policy 0, policy_version 302227 (0.0009) [2023-12-26 01:59:47,087][123090] Updated weights for policy 1, policy_version 300703 (0.0007) [2023-12-26 01:59:47,097][123091] Updated weights for policy 0, policy_version 302237 (0.0009) [2023-12-26 01:59:47,166][123091] Updated weights for policy 0, policy_version 302247 (0.0009) [2023-12-26 01:59:47,899][123091] Updated weights for policy 0, policy_version 302257 (0.0008) [2023-12-26 01:59:47,949][123090] Updated weights for policy 1, policy_version 300713 (0.0008) [2023-12-26 01:59:47,960][123091] Updated weights for policy 0, policy_version 302267 (0.0009) [2023-12-26 01:59:48,017][123090] Updated weights for policy 1, policy_version 300723 (0.0007) [2023-12-26 01:59:48,024][123091] Updated weights for policy 0, policy_version 302277 (0.0009) [2023-12-26 01:59:48,072][123090] Updated weights for policy 1, policy_version 300733 (0.0008) [2023-12-26 01:59:48,090][123091] Updated weights for policy 0, policy_version 302287 (0.0008) [2023-12-26 01:59:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 154378240. Throughput: 0: 8764.7, 1: 8814.6. Samples: 154394060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:48,785][121949] Avg episode reward: [(0, '6101.520'), (1, '5328.321')] [2023-12-26 01:59:48,785][123091] Updated weights for policy 0, policy_version 302297 (0.0005) [2023-12-26 01:59:48,851][123091] Updated weights for policy 0, policy_version 302307 (0.0006) [2023-12-26 01:59:48,908][123091] Updated weights for policy 0, policy_version 302317 (0.0006) [2023-12-26 01:59:48,995][123090] Updated weights for policy 1, policy_version 300743 (0.0009) [2023-12-26 01:59:49,061][123090] Updated weights for policy 1, policy_version 300753 (0.0007) [2023-12-26 01:59:49,120][123090] Updated weights for policy 1, policy_version 300763 (0.0010) [2023-12-26 01:59:49,546][123091] Updated weights for policy 0, policy_version 302327 (0.0009) [2023-12-26 01:59:49,612][123091] Updated weights for policy 0, policy_version 302337 (0.0006) [2023-12-26 01:59:49,671][123091] Updated weights for policy 0, policy_version 302347 (0.0006) [2023-12-26 01:59:50,003][123090] Updated weights for policy 1, policy_version 300773 (0.0010) [2023-12-26 01:59:50,068][123090] Updated weights for policy 1, policy_version 300783 (0.0010) [2023-12-26 01:59:50,126][123090] Updated weights for policy 1, policy_version 300793 (0.0009) [2023-12-26 01:59:50,475][123091] Updated weights for policy 0, policy_version 302357 (0.0006) [2023-12-26 01:59:50,535][123091] Updated weights for policy 0, policy_version 302367 (0.0007) [2023-12-26 01:59:50,595][123091] Updated weights for policy 0, policy_version 302377 (0.0007) [2023-12-26 01:59:50,959][123090] Updated weights for policy 1, policy_version 300803 (0.0009) [2023-12-26 01:59:51,027][123090] Updated weights for policy 1, policy_version 300813 (0.0010) [2023-12-26 01:59:51,100][123090] Updated weights for policy 1, policy_version 300823 (0.0010) [2023-12-26 01:59:51,365][123091] Updated weights for policy 0, policy_version 302387 (0.0007) [2023-12-26 01:59:51,424][123091] Updated weights for policy 0, policy_version 302397 (0.0008) [2023-12-26 01:59:51,479][123091] Updated weights for policy 0, policy_version 302407 (0.0008) [2023-12-26 01:59:51,926][123090] Updated weights for policy 1, policy_version 300833 (0.0008) [2023-12-26 01:59:51,998][123090] Updated weights for policy 1, policy_version 300843 (0.0009) [2023-12-26 01:59:52,063][123090] Updated weights for policy 1, policy_version 300853 (0.0010) [2023-12-26 01:59:52,124][123090] Updated weights for policy 1, policy_version 300863 (0.0009) [2023-12-26 01:59:52,256][123091] Updated weights for policy 0, policy_version 302417 (0.0008) [2023-12-26 01:59:52,325][123091] Updated weights for policy 0, policy_version 302427 (0.0008) [2023-12-26 01:59:52,389][123091] Updated weights for policy 0, policy_version 302437 (0.0009) [2023-12-26 01:59:52,441][123091] Updated weights for policy 0, policy_version 302447 (0.0008) [2023-12-26 01:59:52,930][123090] Updated weights for policy 1, policy_version 300873 (0.0010) [2023-12-26 01:59:53,001][123090] Updated weights for policy 1, policy_version 300883 (0.0010) [2023-12-26 01:59:53,073][123090] Updated weights for policy 1, policy_version 300893 (0.0009) [2023-12-26 01:59:53,203][123091] Updated weights for policy 0, policy_version 302457 (0.0006) [2023-12-26 01:59:53,270][123091] Updated weights for policy 0, policy_version 302467 (0.0005) [2023-12-26 01:59:53,333][123091] Updated weights for policy 0, policy_version 302477 (0.0005) [2023-12-26 01:59:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 154468352. Throughput: 0: 8743.1, 1: 8761.4. Samples: 154447116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:53,785][121949] Avg episode reward: [(0, '6240.208'), (1, '5117.660')] [2023-12-26 01:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000302480_77438976.pth... [2023-12-26 01:59:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000300896_77029376.pth... [2023-12-26 01:59:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000301456_77176832.pth [2023-12-26 01:59:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000299872_76767232.pth [2023-12-26 01:59:53,973][123090] Updated weights for policy 1, policy_version 300903 (0.0009) [2023-12-26 01:59:53,986][123091] Updated weights for policy 0, policy_version 302487 (0.0007) [2023-12-26 01:59:54,029][123090] Updated weights for policy 1, policy_version 300913 (0.0009) [2023-12-26 01:59:54,031][123091] Updated weights for policy 0, policy_version 302497 (0.0006) [2023-12-26 01:59:54,077][123090] Updated weights for policy 1, policy_version 300923 (0.0009) [2023-12-26 01:59:54,087][123091] Updated weights for policy 0, policy_version 302507 (0.0006) [2023-12-26 01:59:54,794][123090] Updated weights for policy 1, policy_version 300933 (0.0009) [2023-12-26 01:59:54,858][123090] Updated weights for policy 1, policy_version 300943 (0.0010) [2023-12-26 01:59:54,925][123091] Updated weights for policy 0, policy_version 302517 (0.0007) [2023-12-26 01:59:54,928][123090] Updated weights for policy 1, policy_version 300953 (0.0009) [2023-12-26 01:59:54,985][123091] Updated weights for policy 0, policy_version 302527 (0.0010) [2023-12-26 01:59:55,043][123091] Updated weights for policy 0, policy_version 302537 (0.0009) [2023-12-26 01:59:55,657][123090] Updated weights for policy 1, policy_version 300963 (0.0007) [2023-12-26 01:59:55,704][123090] Updated weights for policy 1, policy_version 300973 (0.0008) [2023-12-26 01:59:55,755][123090] Updated weights for policy 1, policy_version 300983 (0.0009) [2023-12-26 01:59:55,824][123091] Updated weights for policy 0, policy_version 302547 (0.0008) [2023-12-26 01:59:55,894][123091] Updated weights for policy 0, policy_version 302557 (0.0005) [2023-12-26 01:59:55,951][123091] Updated weights for policy 0, policy_version 302567 (0.0005) [2023-12-26 01:59:56,650][123090] Updated weights for policy 1, policy_version 300993 (0.0009) [2023-12-26 01:59:56,662][123091] Updated weights for policy 0, policy_version 302577 (0.0006) [2023-12-26 01:59:56,714][123091] Updated weights for policy 0, policy_version 302587 (0.0010) [2023-12-26 01:59:56,719][123090] Updated weights for policy 1, policy_version 301003 (0.0005) [2023-12-26 01:59:56,774][123091] Updated weights for policy 0, policy_version 302597 (0.0011) [2023-12-26 01:59:56,793][123090] Updated weights for policy 1, policy_version 301013 (0.0005) [2023-12-26 01:59:56,825][123091] Updated weights for policy 0, policy_version 302607 (0.0010) [2023-12-26 01:59:56,867][123090] Updated weights for policy 1, policy_version 301023 (0.0005) [2023-12-26 01:59:57,370][123090] Updated weights for policy 1, policy_version 301033 (0.0005) [2023-12-26 01:59:57,432][123090] Updated weights for policy 1, policy_version 301043 (0.0005) [2023-12-26 01:59:57,486][123090] Updated weights for policy 1, policy_version 301053 (0.0005) [2023-12-26 01:59:57,591][123091] Updated weights for policy 0, policy_version 302617 (0.0007) [2023-12-26 01:59:57,642][123091] Updated weights for policy 0, policy_version 302628 (0.0010) [2023-12-26 01:59:57,693][123091] Updated weights for policy 0, policy_version 302638 (0.0010) [2023-12-26 01:59:58,215][123090] Updated weights for policy 1, policy_version 301063 (0.0008) [2023-12-26 01:59:58,280][123090] Updated weights for policy 1, policy_version 301073 (0.0009) [2023-12-26 01:59:58,347][123090] Updated weights for policy 1, policy_version 301083 (0.0009) [2023-12-26 01:59:58,562][123091] Updated weights for policy 0, policy_version 302648 (0.0011) [2023-12-26 01:59:58,629][123091] Updated weights for policy 0, policy_version 302658 (0.0011) [2023-12-26 01:59:58,703][123091] Updated weights for policy 0, policy_version 302668 (0.0009) [2023-12-26 01:59:58,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 154566656. Throughput: 0: 8822.3, 1: 8812.8. Samples: 154558060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 01:59:58,784][121949] Avg episode reward: [(0, '6310.676'), (1, '5277.912')] [2023-12-26 01:59:59,259][123090] Updated weights for policy 1, policy_version 301093 (0.0008) [2023-12-26 01:59:59,327][123090] Updated weights for policy 1, policy_version 301103 (0.0008) [2023-12-26 01:59:59,395][123090] Updated weights for policy 1, policy_version 301113 (0.0012) [2023-12-26 01:59:59,544][123091] Updated weights for policy 0, policy_version 302678 (0.0008) [2023-12-26 01:59:59,613][123091] Updated weights for policy 0, policy_version 302688 (0.0006) [2023-12-26 01:59:59,675][123091] Updated weights for policy 0, policy_version 302698 (0.0008) [2023-12-26 02:00:00,209][123090] Updated weights for policy 1, policy_version 301123 (0.0009) [2023-12-26 02:00:00,278][123090] Updated weights for policy 1, policy_version 301133 (0.0010) [2023-12-26 02:00:00,342][123090] Updated weights for policy 1, policy_version 301143 (0.0011) [2023-12-26 02:00:00,361][123091] Updated weights for policy 0, policy_version 302708 (0.0006) [2023-12-26 02:00:00,419][123091] Updated weights for policy 0, policy_version 302718 (0.0007) [2023-12-26 02:00:00,467][123091] Updated weights for policy 0, policy_version 302728 (0.0009) [2023-12-26 02:00:01,134][123090] Updated weights for policy 1, policy_version 301153 (0.0010) [2023-12-26 02:00:01,194][123090] Updated weights for policy 1, policy_version 301163 (0.0007) [2023-12-26 02:00:01,250][123090] Updated weights for policy 1, policy_version 301173 (0.0005) [2023-12-26 02:00:01,282][123091] Updated weights for policy 0, policy_version 302738 (0.0008) [2023-12-26 02:00:01,308][123090] Updated weights for policy 1, policy_version 301183 (0.0008) [2023-12-26 02:00:01,360][123091] Updated weights for policy 0, policy_version 302748 (0.0008) [2023-12-26 02:00:01,429][123091] Updated weights for policy 0, policy_version 302758 (0.0011) [2023-12-26 02:00:01,480][123091] Updated weights for policy 0, policy_version 302768 (0.0010) [2023-12-26 02:00:02,077][123090] Updated weights for policy 1, policy_version 301193 (0.0008) [2023-12-26 02:00:02,128][123090] Updated weights for policy 1, policy_version 301203 (0.0005) [2023-12-26 02:00:02,181][123090] Updated weights for policy 1, policy_version 301213 (0.0005) [2023-12-26 02:00:02,314][123091] Updated weights for policy 0, policy_version 302778 (0.0011) [2023-12-26 02:00:02,380][123091] Updated weights for policy 0, policy_version 302788 (0.0010) [2023-12-26 02:00:02,452][123091] Updated weights for policy 0, policy_version 302798 (0.0011) [2023-12-26 02:00:02,935][123090] Updated weights for policy 1, policy_version 301223 (0.0005) [2023-12-26 02:00:02,987][123090] Updated weights for policy 1, policy_version 301233 (0.0005) [2023-12-26 02:00:03,033][123090] Updated weights for policy 1, policy_version 301243 (0.0005) [2023-12-26 02:00:03,293][123091] Updated weights for policy 0, policy_version 302808 (0.0010) [2023-12-26 02:00:03,344][123091] Updated weights for policy 0, policy_version 302818 (0.0010) [2023-12-26 02:00:03,398][123091] Updated weights for policy 0, policy_version 302828 (0.0011) [2023-12-26 02:00:03,693][123090] Updated weights for policy 1, policy_version 301253 (0.0005) [2023-12-26 02:00:03,746][123090] Updated weights for policy 1, policy_version 301263 (0.0005) [2023-12-26 02:00:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 154648576. Throughput: 0: 8796.8, 1: 8847.1. Samples: 154662736. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:03,785][121949] Avg episode reward: [(0, '6180.386'), (1, '5480.790')] [2023-12-26 02:00:03,794][123090] Updated weights for policy 1, policy_version 301273 (0.0005) [2023-12-26 02:00:04,197][123091] Updated weights for policy 0, policy_version 302838 (0.0010) [2023-12-26 02:00:04,264][123091] Updated weights for policy 0, policy_version 302848 (0.0011) [2023-12-26 02:00:04,327][123091] Updated weights for policy 0, policy_version 302858 (0.0011) [2023-12-26 02:00:04,552][123090] Updated weights for policy 1, policy_version 301283 (0.0006) [2023-12-26 02:00:04,606][123090] Updated weights for policy 1, policy_version 301293 (0.0005) [2023-12-26 02:00:04,663][123090] Updated weights for policy 1, policy_version 301303 (0.0006) [2023-12-26 02:00:05,116][123091] Updated weights for policy 0, policy_version 302868 (0.0009) [2023-12-26 02:00:05,162][123091] Updated weights for policy 0, policy_version 302878 (0.0005) [2023-12-26 02:00:05,207][123091] Updated weights for policy 0, policy_version 302888 (0.0005) [2023-12-26 02:00:05,358][123090] Updated weights for policy 1, policy_version 301313 (0.0008) [2023-12-26 02:00:05,424][123090] Updated weights for policy 1, policy_version 301323 (0.0006) [2023-12-26 02:00:05,495][123090] Updated weights for policy 1, policy_version 301333 (0.0005) [2023-12-26 02:00:05,563][123090] Updated weights for policy 1, policy_version 301343 (0.0006) [2023-12-26 02:00:05,952][123091] Updated weights for policy 0, policy_version 302898 (0.0006) [2023-12-26 02:00:06,006][123091] Updated weights for policy 0, policy_version 302908 (0.0010) [2023-12-26 02:00:06,054][123091] Updated weights for policy 0, policy_version 302918 (0.0010) [2023-12-26 02:00:06,111][123091] Updated weights for policy 0, policy_version 302928 (0.0010) [2023-12-26 02:00:06,313][123090] Updated weights for policy 1, policy_version 301353 (0.0006) [2023-12-26 02:00:06,386][123090] Updated weights for policy 1, policy_version 301363 (0.0006) [2023-12-26 02:00:06,458][123090] Updated weights for policy 1, policy_version 301373 (0.0008) [2023-12-26 02:00:06,943][123091] Updated weights for policy 0, policy_version 302938 (0.0011) [2023-12-26 02:00:07,006][123091] Updated weights for policy 0, policy_version 302948 (0.0011) [2023-12-26 02:00:07,078][123091] Updated weights for policy 0, policy_version 302958 (0.0011) [2023-12-26 02:00:07,183][123090] Updated weights for policy 1, policy_version 301383 (0.0008) [2023-12-26 02:00:07,234][123090] Updated weights for policy 1, policy_version 301393 (0.0005) [2023-12-26 02:00:07,285][123090] Updated weights for policy 1, policy_version 301403 (0.0006) [2023-12-26 02:00:07,814][123091] Updated weights for policy 0, policy_version 302968 (0.0007) [2023-12-26 02:00:07,880][123091] Updated weights for policy 0, policy_version 302978 (0.0009) [2023-12-26 02:00:07,957][123091] Updated weights for policy 0, policy_version 302988 (0.0010) [2023-12-26 02:00:07,984][123090] Updated weights for policy 1, policy_version 301413 (0.0008) [2023-12-26 02:00:08,043][123090] Updated weights for policy 1, policy_version 301423 (0.0006) [2023-12-26 02:00:08,105][123090] Updated weights for policy 1, policy_version 301433 (0.0005) [2023-12-26 02:00:08,687][123091] Updated weights for policy 0, policy_version 302998 (0.0010) [2023-12-26 02:00:08,742][123091] Updated weights for policy 0, policy_version 303008 (0.0010) [2023-12-26 02:00:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 154738688. Throughput: 0: 8832.7, 1: 8943.9. Samples: 154719132. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:08,785][121949] Avg episode reward: [(0, '6087.743'), (1, '5555.225')] [2023-12-26 02:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000301440_77168640.pth... [2023-12-26 02:00:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000300416_76906496.pth [2023-12-26 02:00:08,806][123091] Updated weights for policy 0, policy_version 303018 (0.0011) [2023-12-26 02:00:08,827][123090] Updated weights for policy 1, policy_version 301443 (0.0006) [2023-12-26 02:00:08,844][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000303024_77578240.pth... [2023-12-26 02:00:08,848][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000301968_77307904.pth [2023-12-26 02:00:08,895][123090] Updated weights for policy 1, policy_version 301453 (0.0008) [2023-12-26 02:00:08,962][123090] Updated weights for policy 1, policy_version 301463 (0.0009) [2023-12-26 02:00:09,642][123091] Updated weights for policy 0, policy_version 303028 (0.0011) [2023-12-26 02:00:09,705][123091] Updated weights for policy 0, policy_version 303038 (0.0010) [2023-12-26 02:00:09,760][123091] Updated weights for policy 0, policy_version 303048 (0.0011) [2023-12-26 02:00:09,811][123090] Updated weights for policy 1, policy_version 301473 (0.0009) [2023-12-26 02:00:09,882][123090] Updated weights for policy 1, policy_version 301483 (0.0010) [2023-12-26 02:00:09,948][123090] Updated weights for policy 1, policy_version 301493 (0.0009) [2023-12-26 02:00:10,006][123090] Updated weights for policy 1, policy_version 301503 (0.0009) [2023-12-26 02:00:10,586][123091] Updated weights for policy 0, policy_version 303058 (0.0010) [2023-12-26 02:00:10,640][123091] Updated weights for policy 0, policy_version 303068 (0.0006) [2023-12-26 02:00:10,696][123091] Updated weights for policy 0, policy_version 303078 (0.0008) [2023-12-26 02:00:10,759][123091] Updated weights for policy 0, policy_version 303088 (0.0005) [2023-12-26 02:00:10,808][123090] Updated weights for policy 1, policy_version 301513 (0.0006) [2023-12-26 02:00:10,870][123090] Updated weights for policy 1, policy_version 301523 (0.0006) [2023-12-26 02:00:10,919][123090] Updated weights for policy 1, policy_version 301533 (0.0006) [2023-12-26 02:00:11,510][123091] Updated weights for policy 0, policy_version 303098 (0.0008) [2023-12-26 02:00:11,565][123091] Updated weights for policy 0, policy_version 303108 (0.0008) [2023-12-26 02:00:11,631][123091] Updated weights for policy 0, policy_version 303118 (0.0008) [2023-12-26 02:00:11,727][123090] Updated weights for policy 1, policy_version 301543 (0.0008) [2023-12-26 02:00:11,781][123090] Updated weights for policy 1, policy_version 301553 (0.0010) [2023-12-26 02:00:11,843][123090] Updated weights for policy 1, policy_version 301563 (0.0010) [2023-12-26 02:00:12,498][123091] Updated weights for policy 0, policy_version 303128 (0.0010) [2023-12-26 02:00:12,561][123091] Updated weights for policy 0, policy_version 303138 (0.0010) [2023-12-26 02:00:12,628][123091] Updated weights for policy 0, policy_version 303148 (0.0009) [2023-12-26 02:00:12,652][123090] Updated weights for policy 1, policy_version 301573 (0.0008) [2023-12-26 02:00:12,705][123090] Updated weights for policy 1, policy_version 301583 (0.0009) [2023-12-26 02:00:12,764][123090] Updated weights for policy 1, policy_version 301593 (0.0009) [2023-12-26 02:00:13,416][123091] Updated weights for policy 0, policy_version 303158 (0.0006) [2023-12-26 02:00:13,481][123091] Updated weights for policy 0, policy_version 303168 (0.0005) [2023-12-26 02:00:13,536][123091] Updated weights for policy 0, policy_version 303178 (0.0005) [2023-12-26 02:00:13,639][123090] Updated weights for policy 1, policy_version 301603 (0.0010) [2023-12-26 02:00:13,699][123090] Updated weights for policy 1, policy_version 301613 (0.0005) [2023-12-26 02:00:13,759][123090] Updated weights for policy 1, policy_version 301623 (0.0006) [2023-12-26 02:00:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 154828800. Throughput: 0: 8862.3, 1: 8945.5. Samples: 154826076. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:13,784][121949] Avg episode reward: [(0, '6142.171'), (1, '5594.914')] [2023-12-26 02:00:14,195][123091] Updated weights for policy 0, policy_version 303188 (0.0005) [2023-12-26 02:00:14,256][123091] Updated weights for policy 0, policy_version 303198 (0.0005) [2023-12-26 02:00:14,323][123091] Updated weights for policy 0, policy_version 303208 (0.0005) [2023-12-26 02:00:14,555][123090] Updated weights for policy 1, policy_version 301633 (0.0007) [2023-12-26 02:00:14,612][123090] Updated weights for policy 1, policy_version 301643 (0.0010) [2023-12-26 02:00:14,668][123090] Updated weights for policy 1, policy_version 301653 (0.0009) [2023-12-26 02:00:14,725][123090] Updated weights for policy 1, policy_version 301663 (0.0010) [2023-12-26 02:00:14,970][123091] Updated weights for policy 0, policy_version 303218 (0.0005) [2023-12-26 02:00:15,038][123091] Updated weights for policy 0, policy_version 303228 (0.0006) [2023-12-26 02:00:15,112][123091] Updated weights for policy 0, policy_version 303238 (0.0010) [2023-12-26 02:00:15,168][123091] Updated weights for policy 0, policy_version 303248 (0.0010) [2023-12-26 02:00:15,563][123090] Updated weights for policy 1, policy_version 301673 (0.0010) [2023-12-26 02:00:15,622][123090] Updated weights for policy 1, policy_version 301684 (0.0009) [2023-12-26 02:00:15,667][123090] Updated weights for policy 1, policy_version 301694 (0.0010) [2023-12-26 02:00:15,970][123091] Updated weights for policy 0, policy_version 303258 (0.0009) [2023-12-26 02:00:16,030][123091] Updated weights for policy 0, policy_version 303268 (0.0009) [2023-12-26 02:00:16,099][123091] Updated weights for policy 0, policy_version 303278 (0.0009) [2023-12-26 02:00:16,517][123090] Updated weights for policy 1, policy_version 301704 (0.0006) [2023-12-26 02:00:16,591][123090] Updated weights for policy 1, policy_version 301714 (0.0008) [2023-12-26 02:00:16,666][123090] Updated weights for policy 1, policy_version 301724 (0.0007) [2023-12-26 02:00:16,995][123091] Updated weights for policy 0, policy_version 303288 (0.0008) [2023-12-26 02:00:17,043][123091] Updated weights for policy 0, policy_version 303298 (0.0009) [2023-12-26 02:00:17,092][123091] Updated weights for policy 0, policy_version 303308 (0.0009) [2023-12-26 02:00:17,263][123090] Updated weights for policy 1, policy_version 301734 (0.0008) [2023-12-26 02:00:17,329][123090] Updated weights for policy 1, policy_version 301744 (0.0009) [2023-12-26 02:00:17,387][123090] Updated weights for policy 1, policy_version 301754 (0.0005) [2023-12-26 02:00:17,989][123090] Updated weights for policy 1, policy_version 301764 (0.0005) [2023-12-26 02:00:18,019][123091] Updated weights for policy 0, policy_version 303318 (0.0009) [2023-12-26 02:00:18,047][123090] Updated weights for policy 1, policy_version 301774 (0.0006) [2023-12-26 02:00:18,074][123091] Updated weights for policy 0, policy_version 303328 (0.0010) [2023-12-26 02:00:18,103][123090] Updated weights for policy 1, policy_version 301784 (0.0005) [2023-12-26 02:00:18,121][123091] Updated weights for policy 0, policy_version 303338 (0.0008) [2023-12-26 02:00:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 154918912. Throughput: 0: 8873.5, 1: 8926.5. Samples: 154932616. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:18,785][121949] Avg episode reward: [(0, '6030.474'), (1, '5725.739')] [2023-12-26 02:00:18,896][123090] Updated weights for policy 1, policy_version 301794 (0.0010) [2023-12-26 02:00:18,966][123090] Updated weights for policy 1, policy_version 301804 (0.0010) [2023-12-26 02:00:18,999][123091] Updated weights for policy 0, policy_version 303348 (0.0009) [2023-12-26 02:00:19,027][123090] Updated weights for policy 1, policy_version 301814 (0.0006) [2023-12-26 02:00:19,051][123091] Updated weights for policy 0, policy_version 303358 (0.0011) [2023-12-26 02:00:19,087][123090] Updated weights for policy 1, policy_version 301824 (0.0007) [2023-12-26 02:00:19,107][123091] Updated weights for policy 0, policy_version 303368 (0.0011) [2023-12-26 02:00:19,928][123090] Updated weights for policy 1, policy_version 301834 (0.0010) [2023-12-26 02:00:19,951][123091] Updated weights for policy 0, policy_version 303378 (0.0010) [2023-12-26 02:00:19,998][123090] Updated weights for policy 1, policy_version 301844 (0.0009) [2023-12-26 02:00:20,018][123091] Updated weights for policy 0, policy_version 303388 (0.0009) [2023-12-26 02:00:20,071][123090] Updated weights for policy 1, policy_version 301854 (0.0008) [2023-12-26 02:00:20,081][123091] Updated weights for policy 0, policy_version 303398 (0.0006) [2023-12-26 02:00:20,153][123091] Updated weights for policy 0, policy_version 303408 (0.0006) [2023-12-26 02:00:20,863][123091] Updated weights for policy 0, policy_version 303418 (0.0007) [2023-12-26 02:00:20,921][123091] Updated weights for policy 0, policy_version 303428 (0.0006) [2023-12-26 02:00:20,946][123090] Updated weights for policy 1, policy_version 301864 (0.0010) [2023-12-26 02:00:20,980][123091] Updated weights for policy 0, policy_version 303438 (0.0007) [2023-12-26 02:00:21,010][123090] Updated weights for policy 1, policy_version 301874 (0.0009) [2023-12-26 02:00:21,082][123090] Updated weights for policy 1, policy_version 301884 (0.0010) [2023-12-26 02:00:21,708][123091] Updated weights for policy 0, policy_version 303448 (0.0007) [2023-12-26 02:00:21,777][123091] Updated weights for policy 0, policy_version 303458 (0.0009) [2023-12-26 02:00:21,844][123091] Updated weights for policy 0, policy_version 303468 (0.0006) [2023-12-26 02:00:21,906][123090] Updated weights for policy 1, policy_version 301894 (0.0007) [2023-12-26 02:00:21,977][123090] Updated weights for policy 1, policy_version 301904 (0.0005) [2023-12-26 02:00:22,046][123090] Updated weights for policy 1, policy_version 301914 (0.0008) [2023-12-26 02:00:22,663][123091] Updated weights for policy 0, policy_version 303478 (0.0008) [2023-12-26 02:00:22,723][123091] Updated weights for policy 0, policy_version 303488 (0.0009) [2023-12-26 02:00:22,776][123091] Updated weights for policy 0, policy_version 303498 (0.0009) [2023-12-26 02:00:22,841][123090] Updated weights for policy 1, policy_version 301924 (0.0010) [2023-12-26 02:00:22,905][123090] Updated weights for policy 1, policy_version 301934 (0.0011) [2023-12-26 02:00:22,977][123090] Updated weights for policy 1, policy_version 301944 (0.0011) [2023-12-26 02:00:23,632][123091] Updated weights for policy 0, policy_version 303508 (0.0009) [2023-12-26 02:00:23,692][123091] Updated weights for policy 0, policy_version 303518 (0.0009) [2023-12-26 02:00:23,742][123091] Updated weights for policy 0, policy_version 303528 (0.0009) [2023-12-26 02:00:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 155000832. Throughput: 0: 8880.9, 1: 8879.0. Samples: 154983824. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:23,784][121949] Avg episode reward: [(0, '6022.109'), (1, '5555.325')] [2023-12-26 02:00:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000303536_77709312.pth... [2023-12-26 02:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000302480_77438976.pth [2023-12-26 02:00:23,796][123090] Updated weights for policy 1, policy_version 301954 (0.0011) [2023-12-26 02:00:23,851][123090] Updated weights for policy 1, policy_version 301964 (0.0010) [2023-12-26 02:00:23,905][123090] Updated weights for policy 1, policy_version 301974 (0.0010) [2023-12-26 02:00:23,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000301984_77307904.pth... [2023-12-26 02:00:23,962][123090] Updated weights for policy 1, policy_version 301984 (0.0009) [2023-12-26 02:00:23,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000300896_77029376.pth [2023-12-26 02:00:24,601][123091] Updated weights for policy 0, policy_version 303538 (0.0009) [2023-12-26 02:00:24,672][123091] Updated weights for policy 0, policy_version 303548 (0.0008) [2023-12-26 02:00:24,720][123090] Updated weights for policy 1, policy_version 301994 (0.0008) [2023-12-26 02:00:24,727][123091] Updated weights for policy 0, policy_version 303558 (0.0010) [2023-12-26 02:00:24,773][123090] Updated weights for policy 1, policy_version 302004 (0.0008) [2023-12-26 02:00:24,779][123091] Updated weights for policy 0, policy_version 303568 (0.0008) [2023-12-26 02:00:24,834][123090] Updated weights for policy 1, policy_version 302014 (0.0008) [2023-12-26 02:00:25,616][123091] Updated weights for policy 0, policy_version 303578 (0.0009) [2023-12-26 02:00:25,673][123091] Updated weights for policy 0, policy_version 303588 (0.0007) [2023-12-26 02:00:25,680][123090] Updated weights for policy 1, policy_version 302024 (0.0010) [2023-12-26 02:00:25,740][123091] Updated weights for policy 0, policy_version 303598 (0.0009) [2023-12-26 02:00:25,745][123090] Updated weights for policy 1, policy_version 302034 (0.0008) [2023-12-26 02:00:25,793][123090] Updated weights for policy 1, policy_version 302044 (0.0009) [2023-12-26 02:00:26,548][123090] Updated weights for policy 1, policy_version 302054 (0.0009) [2023-12-26 02:00:26,598][123090] Updated weights for policy 1, policy_version 302064 (0.0008) [2023-12-26 02:00:26,600][123091] Updated weights for policy 0, policy_version 303608 (0.0008) [2023-12-26 02:00:26,652][123090] Updated weights for policy 1, policy_version 302074 (0.0007) [2023-12-26 02:00:26,661][123091] Updated weights for policy 0, policy_version 303618 (0.0008) [2023-12-26 02:00:26,717][123091] Updated weights for policy 0, policy_version 303628 (0.0009) [2023-12-26 02:00:27,501][123090] Updated weights for policy 1, policy_version 302084 (0.0009) [2023-12-26 02:00:27,548][123091] Updated weights for policy 0, policy_version 303638 (0.0008) [2023-12-26 02:00:27,562][123090] Updated weights for policy 1, policy_version 302094 (0.0008) [2023-12-26 02:00:27,608][123091] Updated weights for policy 0, policy_version 303648 (0.0008) [2023-12-26 02:00:27,628][123090] Updated weights for policy 1, policy_version 302104 (0.0008) [2023-12-26 02:00:27,668][123091] Updated weights for policy 0, policy_version 303658 (0.0008) [2023-12-26 02:00:28,443][123090] Updated weights for policy 1, policy_version 302114 (0.0008) [2023-12-26 02:00:28,491][123091] Updated weights for policy 0, policy_version 303668 (0.0009) [2023-12-26 02:00:28,496][123090] Updated weights for policy 1, policy_version 302124 (0.0005) [2023-12-26 02:00:28,551][123090] Updated weights for policy 1, policy_version 302134 (0.0005) [2023-12-26 02:00:28,551][123091] Updated weights for policy 0, policy_version 303678 (0.0008) [2023-12-26 02:00:28,612][123090] Updated weights for policy 1, policy_version 302144 (0.0005) [2023-12-26 02:00:28,612][123091] Updated weights for policy 0, policy_version 303688 (0.0009) [2023-12-26 02:00:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 155099136. Throughput: 0: 8865.4, 1: 8845.8. Samples: 155086424. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:28,785][121949] Avg episode reward: [(0, '6094.033'), (1, '5341.294')] [2023-12-26 02:00:29,349][123090] Updated weights for policy 1, policy_version 302154 (0.0009) [2023-12-26 02:00:29,415][123090] Updated weights for policy 1, policy_version 302164 (0.0009) [2023-12-26 02:00:29,469][123090] Updated weights for policy 1, policy_version 302174 (0.0008) [2023-12-26 02:00:29,491][123091] Updated weights for policy 0, policy_version 303698 (0.0010) [2023-12-26 02:00:29,548][123091] Updated weights for policy 0, policy_version 303708 (0.0009) [2023-12-26 02:00:29,602][123091] Updated weights for policy 0, policy_version 303718 (0.0010) [2023-12-26 02:00:29,659][123091] Updated weights for policy 0, policy_version 303728 (0.0010) [2023-12-26 02:00:30,306][123090] Updated weights for policy 1, policy_version 302184 (0.0010) [2023-12-26 02:00:30,378][123090] Updated weights for policy 1, policy_version 302194 (0.0009) [2023-12-26 02:00:30,444][123090] Updated weights for policy 1, policy_version 302204 (0.0010) [2023-12-26 02:00:30,524][123091] Updated weights for policy 0, policy_version 303738 (0.0009) [2023-12-26 02:00:30,572][123091] Updated weights for policy 0, policy_version 303748 (0.0009) [2023-12-26 02:00:30,620][123091] Updated weights for policy 0, policy_version 303758 (0.0008) [2023-12-26 02:00:31,281][123090] Updated weights for policy 1, policy_version 302214 (0.0009) [2023-12-26 02:00:31,345][123090] Updated weights for policy 1, policy_version 302224 (0.0009) [2023-12-26 02:00:31,414][123090] Updated weights for policy 1, policy_version 302234 (0.0010) [2023-12-26 02:00:31,517][123091] Updated weights for policy 0, policy_version 303768 (0.0009) [2023-12-26 02:00:31,581][123091] Updated weights for policy 0, policy_version 303778 (0.0010) [2023-12-26 02:00:31,645][123091] Updated weights for policy 0, policy_version 303788 (0.0010) [2023-12-26 02:00:32,155][123090] Updated weights for policy 1, policy_version 302244 (0.0006) [2023-12-26 02:00:32,206][123090] Updated weights for policy 1, policy_version 302254 (0.0008) [2023-12-26 02:00:32,261][123090] Updated weights for policy 1, policy_version 302264 (0.0008) [2023-12-26 02:00:32,498][123091] Updated weights for policy 0, policy_version 303798 (0.0007) [2023-12-26 02:00:32,557][123091] Updated weights for policy 0, policy_version 303808 (0.0008) [2023-12-26 02:00:32,626][123091] Updated weights for policy 0, policy_version 303818 (0.0005) [2023-12-26 02:00:33,080][123090] Updated weights for policy 1, policy_version 302274 (0.0007) [2023-12-26 02:00:33,142][123090] Updated weights for policy 1, policy_version 302284 (0.0007) [2023-12-26 02:00:33,204][123090] Updated weights for policy 1, policy_version 302294 (0.0009) [2023-12-26 02:00:33,267][123090] Updated weights for policy 1, policy_version 302304 (0.0007) [2023-12-26 02:00:33,278][123091] Updated weights for policy 0, policy_version 303828 (0.0007) [2023-12-26 02:00:33,343][123091] Updated weights for policy 0, policy_version 303838 (0.0009) [2023-12-26 02:00:33,413][123091] Updated weights for policy 0, policy_version 303848 (0.0009) [2023-12-26 02:00:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 155181056. Throughput: 0: 8836.8, 1: 8887.6. Samples: 155191656. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:33,785][121949] Avg episode reward: [(0, '6190.900'), (1, '5403.596')] [2023-12-26 02:00:34,004][123090] Updated weights for policy 1, policy_version 302314 (0.0005) [2023-12-26 02:00:34,062][123090] Updated weights for policy 1, policy_version 302324 (0.0005) [2023-12-26 02:00:34,122][123090] Updated weights for policy 1, policy_version 302334 (0.0005) [2023-12-26 02:00:34,270][123091] Updated weights for policy 0, policy_version 303858 (0.0008) [2023-12-26 02:00:34,332][123091] Updated weights for policy 0, policy_version 303868 (0.0010) [2023-12-26 02:00:34,390][123091] Updated weights for policy 0, policy_version 303878 (0.0009) [2023-12-26 02:00:34,459][123091] Updated weights for policy 0, policy_version 303888 (0.0009) [2023-12-26 02:00:34,920][123090] Updated weights for policy 1, policy_version 302344 (0.0009) [2023-12-26 02:00:34,990][123090] Updated weights for policy 1, policy_version 302354 (0.0005) [2023-12-26 02:00:35,059][123090] Updated weights for policy 1, policy_version 302364 (0.0005) [2023-12-26 02:00:35,279][123091] Updated weights for policy 0, policy_version 303898 (0.0010) [2023-12-26 02:00:35,337][123091] Updated weights for policy 0, policy_version 303908 (0.0009) [2023-12-26 02:00:35,389][123091] Updated weights for policy 0, policy_version 303919 (0.0009) [2023-12-26 02:00:35,771][123090] Updated weights for policy 1, policy_version 302374 (0.0005) [2023-12-26 02:00:35,845][123090] Updated weights for policy 1, policy_version 302384 (0.0005) [2023-12-26 02:00:35,916][123090] Updated weights for policy 1, policy_version 302394 (0.0005) [2023-12-26 02:00:36,284][123091] Updated weights for policy 0, policy_version 303929 (0.0006) [2023-12-26 02:00:36,338][123091] Updated weights for policy 0, policy_version 303939 (0.0008) [2023-12-26 02:00:36,397][123091] Updated weights for policy 0, policy_version 303949 (0.0009) [2023-12-26 02:00:36,554][123090] Updated weights for policy 1, policy_version 302404 (0.0005) [2023-12-26 02:00:36,618][123090] Updated weights for policy 1, policy_version 302414 (0.0007) [2023-12-26 02:00:36,689][123090] Updated weights for policy 1, policy_version 302424 (0.0010) [2023-12-26 02:00:37,227][123091] Updated weights for policy 0, policy_version 303959 (0.0009) [2023-12-26 02:00:37,291][123091] Updated weights for policy 0, policy_version 303969 (0.0009) [2023-12-26 02:00:37,347][123091] Updated weights for policy 0, policy_version 303979 (0.0009) [2023-12-26 02:00:37,482][123090] Updated weights for policy 1, policy_version 302434 (0.0009) [2023-12-26 02:00:37,560][123090] Updated weights for policy 1, policy_version 302444 (0.0005) [2023-12-26 02:00:37,622][123090] Updated weights for policy 1, policy_version 302454 (0.0006) [2023-12-26 02:00:37,681][123090] Updated weights for policy 1, policy_version 302464 (0.0006) [2023-12-26 02:00:38,039][123091] Updated weights for policy 0, policy_version 303989 (0.0007) [2023-12-26 02:00:38,092][123091] Updated weights for policy 0, policy_version 303999 (0.0005) [2023-12-26 02:00:38,153][123091] Updated weights for policy 0, policy_version 304009 (0.0005) [2023-12-26 02:00:38,414][123090] Updated weights for policy 1, policy_version 302477 (0.0007) [2023-12-26 02:00:38,486][123090] Updated weights for policy 1, policy_version 302487 (0.0005) [2023-12-26 02:00:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 155271168. Throughput: 0: 8768.1, 1: 8972.3. Samples: 155245432. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:38,785][121949] Avg episode reward: [(0, '6186.248'), (1, '5410.979')] [2023-12-26 02:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000304016_77832192.pth... [2023-12-26 02:00:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000302496_77438976.pth... [2023-12-26 02:00:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000301440_77168640.pth [2023-12-26 02:00:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000303024_77578240.pth [2023-12-26 02:00:38,921][123091] Updated weights for policy 0, policy_version 304019 (0.0005) [2023-12-26 02:00:38,977][123091] Updated weights for policy 0, policy_version 304029 (0.0006) [2023-12-26 02:00:39,037][123091] Updated weights for policy 0, policy_version 304039 (0.0008) [2023-12-26 02:00:39,336][123090] Updated weights for policy 1, policy_version 302497 (0.0009) [2023-12-26 02:00:39,404][123090] Updated weights for policy 1, policy_version 302507 (0.0009) [2023-12-26 02:00:39,476][123090] Updated weights for policy 1, policy_version 302517 (0.0007) [2023-12-26 02:00:39,550][123090] Updated weights for policy 1, policy_version 302527 (0.0006) [2023-12-26 02:00:39,918][123091] Updated weights for policy 0, policy_version 304049 (0.0010) [2023-12-26 02:00:39,978][123091] Updated weights for policy 0, policy_version 304059 (0.0010) [2023-12-26 02:00:40,040][123091] Updated weights for policy 0, policy_version 304069 (0.0010) [2023-12-26 02:00:40,103][123091] Updated weights for policy 0, policy_version 304079 (0.0009) [2023-12-26 02:00:40,319][123090] Updated weights for policy 1, policy_version 302537 (0.0005) [2023-12-26 02:00:40,380][123090] Updated weights for policy 1, policy_version 302547 (0.0009) [2023-12-26 02:00:40,441][123090] Updated weights for policy 1, policy_version 302557 (0.0009) [2023-12-26 02:00:40,837][123091] Updated weights for policy 0, policy_version 304089 (0.0005) [2023-12-26 02:00:40,892][123091] Updated weights for policy 0, policy_version 304099 (0.0005) [2023-12-26 02:00:40,964][123091] Updated weights for policy 0, policy_version 304109 (0.0005) [2023-12-26 02:00:41,290][123090] Updated weights for policy 1, policy_version 302567 (0.0008) [2023-12-26 02:00:41,349][123090] Updated weights for policy 1, policy_version 302577 (0.0009) [2023-12-26 02:00:41,416][123090] Updated weights for policy 1, policy_version 302587 (0.0010) [2023-12-26 02:00:41,770][123091] Updated weights for policy 0, policy_version 304119 (0.0008) [2023-12-26 02:00:41,842][123091] Updated weights for policy 0, policy_version 304129 (0.0010) [2023-12-26 02:00:41,908][123091] Updated weights for policy 0, policy_version 304139 (0.0009) [2023-12-26 02:00:42,260][123090] Updated weights for policy 1, policy_version 302597 (0.0009) [2023-12-26 02:00:42,324][123090] Updated weights for policy 1, policy_version 302607 (0.0009) [2023-12-26 02:00:42,391][123090] Updated weights for policy 1, policy_version 302617 (0.0008) [2023-12-26 02:00:42,780][123091] Updated weights for policy 0, policy_version 304149 (0.0009) [2023-12-26 02:00:42,846][123091] Updated weights for policy 0, policy_version 304159 (0.0009) [2023-12-26 02:00:42,914][123091] Updated weights for policy 0, policy_version 304169 (0.0006) [2023-12-26 02:00:43,231][123090] Updated weights for policy 1, policy_version 302627 (0.0008) [2023-12-26 02:00:43,283][123090] Updated weights for policy 1, policy_version 302637 (0.0006) [2023-12-26 02:00:43,335][123090] Updated weights for policy 1, policy_version 302647 (0.0008) [2023-12-26 02:00:43,657][123091] Updated weights for policy 0, policy_version 304179 (0.0007) [2023-12-26 02:00:43,709][123091] Updated weights for policy 0, policy_version 304189 (0.0009) [2023-12-26 02:00:43,760][123091] Updated weights for policy 0, policy_version 304199 (0.0008) [2023-12-26 02:00:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 155353088. Throughput: 0: 8688.9, 1: 8919.9. Samples: 155350456. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:43,785][121949] Avg episode reward: [(0, '6258.376'), (1, '5424.004')] [2023-12-26 02:00:44,179][123090] Updated weights for policy 1, policy_version 302657 (0.0009) [2023-12-26 02:00:44,242][123090] Updated weights for policy 1, policy_version 302667 (0.0009) [2023-12-26 02:00:44,299][123090] Updated weights for policy 1, policy_version 302677 (0.0010) [2023-12-26 02:00:44,351][123090] Updated weights for policy 1, policy_version 302687 (0.0010) [2023-12-26 02:00:44,592][123091] Updated weights for policy 0, policy_version 304209 (0.0010) [2023-12-26 02:00:44,645][123091] Updated weights for policy 0, policy_version 304219 (0.0009) [2023-12-26 02:00:44,703][123091] Updated weights for policy 0, policy_version 304229 (0.0009) [2023-12-26 02:00:44,764][123091] Updated weights for policy 0, policy_version 304239 (0.0008) [2023-12-26 02:00:45,186][123090] Updated weights for policy 1, policy_version 302697 (0.0009) [2023-12-26 02:00:45,246][123090] Updated weights for policy 1, policy_version 302707 (0.0010) [2023-12-26 02:00:45,307][123090] Updated weights for policy 1, policy_version 302717 (0.0010) [2023-12-26 02:00:45,510][123091] Updated weights for policy 0, policy_version 304249 (0.0006) [2023-12-26 02:00:45,584][123091] Updated weights for policy 0, policy_version 304259 (0.0005) [2023-12-26 02:00:45,652][123091] Updated weights for policy 0, policy_version 304269 (0.0005) [2023-12-26 02:00:46,201][123090] Updated weights for policy 1, policy_version 302727 (0.0008) [2023-12-26 02:00:46,249][123090] Updated weights for policy 1, policy_version 302737 (0.0008) [2023-12-26 02:00:46,297][123090] Updated weights for policy 1, policy_version 302747 (0.0008) [2023-12-26 02:00:46,376][123091] Updated weights for policy 0, policy_version 304279 (0.0009) [2023-12-26 02:00:46,441][123091] Updated weights for policy 0, policy_version 304289 (0.0010) [2023-12-26 02:00:46,503][123091] Updated weights for policy 0, policy_version 304299 (0.0010) [2023-12-26 02:00:47,063][123090] Updated weights for policy 1, policy_version 302757 (0.0007) [2023-12-26 02:00:47,130][123090] Updated weights for policy 1, policy_version 302767 (0.0008) [2023-12-26 02:00:47,186][123090] Updated weights for policy 1, policy_version 302777 (0.0005) [2023-12-26 02:00:47,305][123091] Updated weights for policy 0, policy_version 304309 (0.0010) [2023-12-26 02:00:47,352][123091] Updated weights for policy 0, policy_version 304319 (0.0010) [2023-12-26 02:00:47,399][123091] Updated weights for policy 0, policy_version 304329 (0.0010) [2023-12-26 02:00:47,974][123090] Updated weights for policy 1, policy_version 302787 (0.0008) [2023-12-26 02:00:48,042][123090] Updated weights for policy 1, policy_version 302797 (0.0009) [2023-12-26 02:00:48,105][123090] Updated weights for policy 1, policy_version 302807 (0.0010) [2023-12-26 02:00:48,211][123091] Updated weights for policy 0, policy_version 304339 (0.0011) [2023-12-26 02:00:48,274][123091] Updated weights for policy 0, policy_version 304349 (0.0008) [2023-12-26 02:00:48,331][123091] Updated weights for policy 0, policy_version 304359 (0.0008) [2023-12-26 02:00:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 155443200. Throughput: 0: 8739.8, 1: 8877.4. Samples: 155455504. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:48,785][121949] Avg episode reward: [(0, '6048.592'), (1, '5611.462')] [2023-12-26 02:00:48,941][123090] Updated weights for policy 1, policy_version 302817 (0.0009) [2023-12-26 02:00:48,990][123090] Updated weights for policy 1, policy_version 302827 (0.0008) [2023-12-26 02:00:49,050][123090] Updated weights for policy 1, policy_version 302837 (0.0009) [2023-12-26 02:00:49,115][123090] Updated weights for policy 1, policy_version 302847 (0.0009) [2023-12-26 02:00:49,156][123091] Updated weights for policy 0, policy_version 304369 (0.0011) [2023-12-26 02:00:49,223][123091] Updated weights for policy 0, policy_version 304379 (0.0011) [2023-12-26 02:00:49,292][123091] Updated weights for policy 0, policy_version 304389 (0.0011) [2023-12-26 02:00:49,350][123091] Updated weights for policy 0, policy_version 304399 (0.0010) [2023-12-26 02:00:50,019][123090] Updated weights for policy 1, policy_version 302857 (0.0010) [2023-12-26 02:00:50,068][123090] Updated weights for policy 1, policy_version 302867 (0.0009) [2023-12-26 02:00:50,129][123090] Updated weights for policy 1, policy_version 302877 (0.0009) [2023-12-26 02:00:50,143][123091] Updated weights for policy 0, policy_version 304409 (0.0006) [2023-12-26 02:00:50,210][123091] Updated weights for policy 0, policy_version 304419 (0.0007) [2023-12-26 02:00:50,274][123091] Updated weights for policy 0, policy_version 304429 (0.0009) [2023-12-26 02:00:51,032][123090] Updated weights for policy 1, policy_version 302887 (0.0009) [2023-12-26 02:00:51,102][123090] Updated weights for policy 1, policy_version 302897 (0.0009) [2023-12-26 02:00:51,121][123091] Updated weights for policy 0, policy_version 304439 (0.0009) [2023-12-26 02:00:51,172][123090] Updated weights for policy 1, policy_version 302907 (0.0010) [2023-12-26 02:00:51,186][123091] Updated weights for policy 0, policy_version 304449 (0.0006) [2023-12-26 02:00:51,250][123091] Updated weights for policy 0, policy_version 304459 (0.0006) [2023-12-26 02:00:52,016][123091] Updated weights for policy 0, policy_version 304469 (0.0009) [2023-12-26 02:00:52,036][123090] Updated weights for policy 1, policy_version 302917 (0.0008) [2023-12-26 02:00:52,072][123091] Updated weights for policy 0, policy_version 304479 (0.0010) [2023-12-26 02:00:52,100][123090] Updated weights for policy 1, policy_version 302927 (0.0007) [2023-12-26 02:00:52,141][123091] Updated weights for policy 0, policy_version 304489 (0.0010) [2023-12-26 02:00:52,161][123090] Updated weights for policy 1, policy_version 302937 (0.0007) [2023-12-26 02:00:52,990][123091] Updated weights for policy 0, policy_version 304499 (0.0008) [2023-12-26 02:00:53,031][123090] Updated weights for policy 1, policy_version 302947 (0.0008) [2023-12-26 02:00:53,047][123091] Updated weights for policy 0, policy_version 304509 (0.0009) [2023-12-26 02:00:53,095][123090] Updated weights for policy 1, policy_version 302957 (0.0010) [2023-12-26 02:00:53,111][123091] Updated weights for policy 0, policy_version 304519 (0.0007) [2023-12-26 02:00:53,161][123090] Updated weights for policy 1, policy_version 302967 (0.0008) [2023-12-26 02:00:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 155525120. Throughput: 0: 8710.9, 1: 8772.8. Samples: 155505896. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:53,785][121949] Avg episode reward: [(0, '5972.333'), (1, '5526.868')] [2023-12-26 02:00:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000302976_77561856.pth... [2023-12-26 02:00:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000304528_77963264.pth... [2023-12-26 02:00:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000301984_77307904.pth [2023-12-26 02:00:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000303536_77709312.pth [2023-12-26 02:00:53,866][123090] Updated weights for policy 1, policy_version 302977 (0.0008) [2023-12-26 02:00:53,929][123090] Updated weights for policy 1, policy_version 302987 (0.0006) [2023-12-26 02:00:53,972][123091] Updated weights for policy 0, policy_version 304529 (0.0008) [2023-12-26 02:00:53,990][123090] Updated weights for policy 1, policy_version 302997 (0.0009) [2023-12-26 02:00:54,034][123091] Updated weights for policy 0, policy_version 304539 (0.0006) [2023-12-26 02:00:54,048][123090] Updated weights for policy 1, policy_version 303007 (0.0009) [2023-12-26 02:00:54,087][123091] Updated weights for policy 0, policy_version 304549 (0.0006) [2023-12-26 02:00:54,149][123091] Updated weights for policy 0, policy_version 304559 (0.0006) [2023-12-26 02:00:54,824][123091] Updated weights for policy 0, policy_version 304569 (0.0006) [2023-12-26 02:00:54,839][123090] Updated weights for policy 1, policy_version 303017 (0.0009) [2023-12-26 02:00:54,883][123091] Updated weights for policy 0, policy_version 304579 (0.0006) [2023-12-26 02:00:54,899][123090] Updated weights for policy 1, policy_version 303027 (0.0009) [2023-12-26 02:00:54,960][123091] Updated weights for policy 0, policy_version 304589 (0.0008) [2023-12-26 02:00:54,975][123090] Updated weights for policy 1, policy_version 303037 (0.0007) [2023-12-26 02:00:55,763][123090] Updated weights for policy 1, policy_version 303047 (0.0007) [2023-12-26 02:00:55,809][123091] Updated weights for policy 0, policy_version 304599 (0.0010) [2023-12-26 02:00:55,837][123090] Updated weights for policy 1, policy_version 303057 (0.0006) [2023-12-26 02:00:55,875][123091] Updated weights for policy 0, policy_version 304609 (0.0011) [2023-12-26 02:00:55,906][123090] Updated weights for policy 1, policy_version 303067 (0.0007) [2023-12-26 02:00:55,943][123091] Updated weights for policy 0, policy_version 304619 (0.0011) [2023-12-26 02:00:56,551][123090] Updated weights for policy 1, policy_version 303077 (0.0010) [2023-12-26 02:00:56,614][123090] Updated weights for policy 1, policy_version 303087 (0.0010) [2023-12-26 02:00:56,672][123090] Updated weights for policy 1, policy_version 303097 (0.0010) [2023-12-26 02:00:56,753][123091] Updated weights for policy 0, policy_version 304629 (0.0011) [2023-12-26 02:00:56,806][123091] Updated weights for policy 0, policy_version 304639 (0.0008) [2023-12-26 02:00:56,859][123091] Updated weights for policy 0, policy_version 304649 (0.0007) [2023-12-26 02:00:57,387][123090] Updated weights for policy 1, policy_version 303107 (0.0009) [2023-12-26 02:00:57,438][123090] Updated weights for policy 1, policy_version 303117 (0.0007) [2023-12-26 02:00:57,482][123090] Updated weights for policy 1, policy_version 303127 (0.0008) [2023-12-26 02:00:57,609][123091] Updated weights for policy 0, policy_version 304659 (0.0007) [2023-12-26 02:00:57,653][123091] Updated weights for policy 0, policy_version 304669 (0.0010) [2023-12-26 02:00:57,701][123091] Updated weights for policy 0, policy_version 304679 (0.0010) [2023-12-26 02:00:58,172][123090] Updated weights for policy 1, policy_version 303137 (0.0005) [2023-12-26 02:00:58,244][123090] Updated weights for policy 1, policy_version 303147 (0.0009) [2023-12-26 02:00:58,319][123090] Updated weights for policy 1, policy_version 303157 (0.0011) [2023-12-26 02:00:58,396][123090] Updated weights for policy 1, policy_version 303168 (0.0010) [2023-12-26 02:00:58,506][123091] Updated weights for policy 0, policy_version 304689 (0.0010) [2023-12-26 02:00:58,568][123091] Updated weights for policy 0, policy_version 304699 (0.0009) [2023-12-26 02:00:58,637][123091] Updated weights for policy 0, policy_version 304709 (0.0008) [2023-12-26 02:00:58,709][123091] Updated weights for policy 0, policy_version 304719 (0.0010) [2023-12-26 02:00:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 155623424. Throughput: 0: 8712.0, 1: 8771.8. Samples: 155612848. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:00:58,785][121949] Avg episode reward: [(0, '6106.906'), (1, '5508.468')] [2023-12-26 02:00:59,334][123090] Updated weights for policy 1, policy_version 303178 (0.0008) [2023-12-26 02:00:59,401][123090] Updated weights for policy 1, policy_version 303188 (0.0008) [2023-12-26 02:00:59,471][123090] Updated weights for policy 1, policy_version 303198 (0.0008) [2023-12-26 02:00:59,602][123091] Updated weights for policy 0, policy_version 304729 (0.0008) [2023-12-26 02:00:59,659][123091] Updated weights for policy 0, policy_version 304739 (0.0008) [2023-12-26 02:00:59,715][123091] Updated weights for policy 0, policy_version 304749 (0.0009) [2023-12-26 02:01:00,296][123090] Updated weights for policy 1, policy_version 303208 (0.0009) [2023-12-26 02:01:00,356][123090] Updated weights for policy 1, policy_version 303218 (0.0009) [2023-12-26 02:01:00,426][123090] Updated weights for policy 1, policy_version 303228 (0.0010) [2023-12-26 02:01:00,546][123091] Updated weights for policy 0, policy_version 304759 (0.0010) [2023-12-26 02:01:00,601][123091] Updated weights for policy 0, policy_version 304771 (0.0010) [2023-12-26 02:01:00,653][123091] Updated weights for policy 0, policy_version 304783 (0.0009) [2023-12-26 02:01:01,220][123090] Updated weights for policy 1, policy_version 303238 (0.0009) [2023-12-26 02:01:01,291][123090] Updated weights for policy 1, policy_version 303248 (0.0008) [2023-12-26 02:01:01,358][123090] Updated weights for policy 1, policy_version 303258 (0.0008) [2023-12-26 02:01:01,487][123091] Updated weights for policy 0, policy_version 304793 (0.0007) [2023-12-26 02:01:01,538][123091] Updated weights for policy 0, policy_version 304803 (0.0005) [2023-12-26 02:01:01,591][123091] Updated weights for policy 0, policy_version 304813 (0.0008) [2023-12-26 02:01:02,141][123090] Updated weights for policy 1, policy_version 303268 (0.0007) [2023-12-26 02:01:02,194][123090] Updated weights for policy 1, policy_version 303278 (0.0005) [2023-12-26 02:01:02,258][123090] Updated weights for policy 1, policy_version 303288 (0.0009) [2023-12-26 02:01:02,438][123091] Updated weights for policy 0, policy_version 304823 (0.0010) [2023-12-26 02:01:02,496][123091] Updated weights for policy 0, policy_version 304833 (0.0010) [2023-12-26 02:01:02,558][123091] Updated weights for policy 0, policy_version 304843 (0.0010) [2023-12-26 02:01:02,990][123090] Updated weights for policy 1, policy_version 303298 (0.0009) [2023-12-26 02:01:03,045][123090] Updated weights for policy 1, policy_version 303308 (0.0010) [2023-12-26 02:01:03,110][123090] Updated weights for policy 1, policy_version 303318 (0.0010) [2023-12-26 02:01:03,176][123090] Updated weights for policy 1, policy_version 303328 (0.0009) [2023-12-26 02:01:03,451][123091] Updated weights for policy 0, policy_version 304853 (0.0009) [2023-12-26 02:01:03,508][123091] Updated weights for policy 0, policy_version 304863 (0.0010) [2023-12-26 02:01:03,572][123091] Updated weights for policy 0, policy_version 304873 (0.0010) [2023-12-26 02:01:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 155705344. Throughput: 0: 8657.4, 1: 8734.0. Samples: 155715224. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:01:03,785][121949] Avg episode reward: [(0, '6103.519'), (1, '5467.518')] [2023-12-26 02:01:04,050][123090] Updated weights for policy 1, policy_version 303338 (0.0009) [2023-12-26 02:01:04,120][123090] Updated weights for policy 1, policy_version 303348 (0.0009) [2023-12-26 02:01:04,172][123090] Updated weights for policy 1, policy_version 303358 (0.0009) [2023-12-26 02:01:04,377][123091] Updated weights for policy 0, policy_version 304883 (0.0007) [2023-12-26 02:01:04,442][123091] Updated weights for policy 0, policy_version 304893 (0.0010) [2023-12-26 02:01:04,508][123091] Updated weights for policy 0, policy_version 304903 (0.0010) [2023-12-26 02:01:05,027][123090] Updated weights for policy 1, policy_version 303368 (0.0010) [2023-12-26 02:01:05,091][123090] Updated weights for policy 1, policy_version 303378 (0.0009) [2023-12-26 02:01:05,157][123090] Updated weights for policy 1, policy_version 303388 (0.0008) [2023-12-26 02:01:05,362][123091] Updated weights for policy 0, policy_version 304913 (0.0010) [2023-12-26 02:01:05,430][123091] Updated weights for policy 0, policy_version 304923 (0.0009) [2023-12-26 02:01:05,494][123091] Updated weights for policy 0, policy_version 304933 (0.0009) [2023-12-26 02:01:05,559][123091] Updated weights for policy 0, policy_version 304943 (0.0010) [2023-12-26 02:01:05,973][123090] Updated weights for policy 1, policy_version 303398 (0.0009) [2023-12-26 02:01:06,038][123090] Updated weights for policy 1, policy_version 303408 (0.0007) [2023-12-26 02:01:06,096][123090] Updated weights for policy 1, policy_version 303418 (0.0005) [2023-12-26 02:01:06,318][123091] Updated weights for policy 0, policy_version 304953 (0.0008) [2023-12-26 02:01:06,381][123091] Updated weights for policy 0, policy_version 304963 (0.0008) [2023-12-26 02:01:06,446][123091] Updated weights for policy 0, policy_version 304973 (0.0008) [2023-12-26 02:01:06,938][123090] Updated weights for policy 1, policy_version 303428 (0.0009) [2023-12-26 02:01:06,997][123090] Updated weights for policy 1, policy_version 303438 (0.0010) [2023-12-26 02:01:07,048][123090] Updated weights for policy 1, policy_version 303448 (0.0009) [2023-12-26 02:01:07,196][123091] Updated weights for policy 0, policy_version 304983 (0.0006) [2023-12-26 02:01:07,260][123091] Updated weights for policy 0, policy_version 304993 (0.0010) [2023-12-26 02:01:07,318][123091] Updated weights for policy 0, policy_version 305003 (0.0009) [2023-12-26 02:01:07,908][123090] Updated weights for policy 1, policy_version 303458 (0.0008) [2023-12-26 02:01:07,969][123090] Updated weights for policy 1, policy_version 303468 (0.0005) [2023-12-26 02:01:08,027][123090] Updated weights for policy 1, policy_version 303478 (0.0005) [2023-12-26 02:01:08,096][123090] Updated weights for policy 1, policy_version 303488 (0.0006) [2023-12-26 02:01:08,116][123091] Updated weights for policy 0, policy_version 305013 (0.0009) [2023-12-26 02:01:08,174][123091] Updated weights for policy 0, policy_version 305023 (0.0009) [2023-12-26 02:01:08,236][123091] Updated weights for policy 0, policy_version 305033 (0.0009) [2023-12-26 02:01:08,770][123090] Updated weights for policy 1, policy_version 303498 (0.0008) [2023-12-26 02:01:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 155787264. Throughput: 0: 8650.2, 1: 8747.5. Samples: 155766724. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:01:08,785][121949] Avg episode reward: [(0, '6185.464'), (1, '5560.372')] [2023-12-26 02:01:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000305040_78094336.pth... [2023-12-26 02:01:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000304016_77832192.pth [2023-12-26 02:01:08,832][123090] Updated weights for policy 1, policy_version 303508 (0.0010) [2023-12-26 02:01:08,888][123090] Updated weights for policy 1, policy_version 303518 (0.0010) [2023-12-26 02:01:08,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000303520_77701120.pth... [2023-12-26 02:01:08,902][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000302496_77438976.pth [2023-12-26 02:01:09,152][123091] Updated weights for policy 0, policy_version 305043 (0.0009) [2023-12-26 02:01:09,226][123091] Updated weights for policy 0, policy_version 305053 (0.0009) [2023-12-26 02:01:09,293][123091] Updated weights for policy 0, policy_version 305063 (0.0009) [2023-12-26 02:01:09,628][123090] Updated weights for policy 1, policy_version 303528 (0.0010) [2023-12-26 02:01:09,685][123090] Updated weights for policy 1, policy_version 303538 (0.0010) [2023-12-26 02:01:09,745][123090] Updated weights for policy 1, policy_version 303548 (0.0010) [2023-12-26 02:01:10,118][123091] Updated weights for policy 0, policy_version 305073 (0.0008) [2023-12-26 02:01:10,190][123091] Updated weights for policy 0, policy_version 305083 (0.0010) [2023-12-26 02:01:10,264][123091] Updated weights for policy 0, policy_version 305093 (0.0009) [2023-12-26 02:01:10,324][123091] Updated weights for policy 0, policy_version 305103 (0.0010) [2023-12-26 02:01:10,539][123090] Updated weights for policy 1, policy_version 303558 (0.0010) [2023-12-26 02:01:10,609][123090] Updated weights for policy 1, policy_version 303568 (0.0009) [2023-12-26 02:01:10,678][123090] Updated weights for policy 1, policy_version 303578 (0.0007) [2023-12-26 02:01:11,217][123091] Updated weights for policy 0, policy_version 305113 (0.0010) [2023-12-26 02:01:11,287][123091] Updated weights for policy 0, policy_version 305123 (0.0009) [2023-12-26 02:01:11,350][123091] Updated weights for policy 0, policy_version 305133 (0.0009) [2023-12-26 02:01:11,453][123090] Updated weights for policy 1, policy_version 303588 (0.0007) [2023-12-26 02:01:11,514][123090] Updated weights for policy 1, policy_version 303598 (0.0009) [2023-12-26 02:01:11,570][123090] Updated weights for policy 1, policy_version 303608 (0.0009) [2023-12-26 02:01:12,120][123091] Updated weights for policy 0, policy_version 305143 (0.0009) [2023-12-26 02:01:12,183][123091] Updated weights for policy 0, policy_version 305153 (0.0011) [2023-12-26 02:01:12,253][123091] Updated weights for policy 0, policy_version 305163 (0.0009) [2023-12-26 02:01:12,455][123090] Updated weights for policy 1, policy_version 303618 (0.0010) [2023-12-26 02:01:12,508][123090] Updated weights for policy 1, policy_version 303628 (0.0008) [2023-12-26 02:01:12,569][123090] Updated weights for policy 1, policy_version 303638 (0.0007) [2023-12-26 02:01:12,638][123090] Updated weights for policy 1, policy_version 303648 (0.0005) [2023-12-26 02:01:13,082][123091] Updated weights for policy 0, policy_version 305173 (0.0010) [2023-12-26 02:01:13,131][123091] Updated weights for policy 0, policy_version 305183 (0.0006) [2023-12-26 02:01:13,180][123091] Updated weights for policy 0, policy_version 305193 (0.0005) [2023-12-26 02:01:13,418][123090] Updated weights for policy 1, policy_version 303658 (0.0009) [2023-12-26 02:01:13,473][123090] Updated weights for policy 1, policy_version 303669 (0.0011) [2023-12-26 02:01:13,529][123090] Updated weights for policy 1, policy_version 303680 (0.0010) [2023-12-26 02:01:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 155877376. Throughput: 0: 8644.3, 1: 8763.2. Samples: 155869760. Policy #0 lag: (min: 31.0, avg: 34.6, max: 63.0) [2023-12-26 02:01:13,785][121949] Avg episode reward: [(0, '6237.695'), (1, '5549.908')] [2023-12-26 02:01:13,873][123091] Updated weights for policy 0, policy_version 305203 (0.0005) [2023-12-26 02:01:13,917][123091] Updated weights for policy 0, policy_version 305213 (0.0005) [2023-12-26 02:01:13,973][123091] Updated weights for policy 0, policy_version 305223 (0.0006) [2023-12-26 02:01:14,271][123090] Updated weights for policy 1, policy_version 303690 (0.0005) [2023-12-26 02:01:14,337][123090] Updated weights for policy 1, policy_version 303700 (0.0008) [2023-12-26 02:01:14,392][123090] Updated weights for policy 1, policy_version 303710 (0.0010) [2023-12-26 02:01:14,695][123091] Updated weights for policy 0, policy_version 305233 (0.0007) [2023-12-26 02:01:14,746][123091] Updated weights for policy 0, policy_version 305243 (0.0009) [2023-12-26 02:01:14,811][123091] Updated weights for policy 0, policy_version 305253 (0.0010) [2023-12-26 02:01:14,864][123091] Updated weights for policy 0, policy_version 305263 (0.0009) [2023-12-26 02:01:15,192][123090] Updated weights for policy 1, policy_version 303720 (0.0007) [2023-12-26 02:01:15,261][123090] Updated weights for policy 1, policy_version 303730 (0.0006) [2023-12-26 02:01:15,331][123090] Updated weights for policy 1, policy_version 303740 (0.0006) [2023-12-26 02:01:15,658][123091] Updated weights for policy 0, policy_version 305273 (0.0009) [2023-12-26 02:01:15,722][123091] Updated weights for policy 0, policy_version 305283 (0.0007) [2023-12-26 02:01:15,790][123091] Updated weights for policy 0, policy_version 305293 (0.0009) [2023-12-26 02:01:16,044][123090] Updated weights for policy 1, policy_version 303750 (0.0008) [2023-12-26 02:01:16,093][123090] Updated weights for policy 1, policy_version 303760 (0.0009) [2023-12-26 02:01:16,142][123090] Updated weights for policy 1, policy_version 303770 (0.0009) [2023-12-26 02:01:16,628][123091] Updated weights for policy 0, policy_version 305303 (0.0010) [2023-12-26 02:01:16,689][123091] Updated weights for policy 0, policy_version 305313 (0.0010) [2023-12-26 02:01:16,743][123091] Updated weights for policy 0, policy_version 305323 (0.0010) [2023-12-26 02:01:17,016][123090] Updated weights for policy 1, policy_version 303780 (0.0007) [2023-12-26 02:01:17,082][123090] Updated weights for policy 1, policy_version 303790 (0.0005) [2023-12-26 02:01:17,129][123090] Updated weights for policy 1, policy_version 303800 (0.0005) [2023-12-26 02:01:17,548][123091] Updated weights for policy 0, policy_version 305333 (0.0010) [2023-12-26 02:01:17,612][123091] Updated weights for policy 0, policy_version 305343 (0.0010) [2023-12-26 02:01:17,678][123091] Updated weights for policy 0, policy_version 305353 (0.0011) [2023-12-26 02:01:17,818][123090] Updated weights for policy 1, policy_version 303810 (0.0005) [2023-12-26 02:01:17,877][123090] Updated weights for policy 1, policy_version 303820 (0.0007) [2023-12-26 02:01:17,931][123090] Updated weights for policy 1, policy_version 303830 (0.0008) [2023-12-26 02:01:17,986][123090] Updated weights for policy 1, policy_version 303840 (0.0009) [2023-12-26 02:01:18,484][123091] Updated weights for policy 0, policy_version 305363 (0.0011) [2023-12-26 02:01:18,531][123091] Updated weights for policy 0, policy_version 305373 (0.0010) [2023-12-26 02:01:18,582][123091] Updated weights for policy 0, policy_version 305383 (0.0010) [2023-12-26 02:01:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 155967488. Throughput: 0: 8690.1, 1: 8801.0. Samples: 155978756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:18,785][121949] Avg episode reward: [(0, '6084.246'), (1, '5603.975')] [2023-12-26 02:01:18,787][123090] Updated weights for policy 1, policy_version 303850 (0.0011) [2023-12-26 02:01:18,854][123090] Updated weights for policy 1, policy_version 303860 (0.0007) [2023-12-26 02:01:18,932][123090] Updated weights for policy 1, policy_version 303870 (0.0006) [2023-12-26 02:01:19,443][123091] Updated weights for policy 0, policy_version 305393 (0.0010) [2023-12-26 02:01:19,516][123091] Updated weights for policy 0, policy_version 305403 (0.0008) [2023-12-26 02:01:19,579][123091] Updated weights for policy 0, policy_version 305413 (0.0011) [2023-12-26 02:01:19,650][123091] Updated weights for policy 0, policy_version 305423 (0.0011) [2023-12-26 02:01:19,666][123090] Updated weights for policy 1, policy_version 303880 (0.0009) [2023-12-26 02:01:19,722][123090] Updated weights for policy 1, policy_version 303890 (0.0008) [2023-12-26 02:01:19,778][123090] Updated weights for policy 1, policy_version 303900 (0.0008) [2023-12-26 02:01:20,464][123091] Updated weights for policy 0, policy_version 305433 (0.0011) [2023-12-26 02:01:20,531][123091] Updated weights for policy 0, policy_version 305443 (0.0011) [2023-12-26 02:01:20,588][123090] Updated weights for policy 1, policy_version 303910 (0.0008) [2023-12-26 02:01:20,598][123091] Updated weights for policy 0, policy_version 305453 (0.0011) [2023-12-26 02:01:20,654][123090] Updated weights for policy 1, policy_version 303920 (0.0006) [2023-12-26 02:01:20,720][123090] Updated weights for policy 1, policy_version 303930 (0.0009) [2023-12-26 02:01:21,388][123091] Updated weights for policy 0, policy_version 305463 (0.0010) [2023-12-26 02:01:21,454][123091] Updated weights for policy 0, policy_version 305473 (0.0010) [2023-12-26 02:01:21,507][123091] Updated weights for policy 0, policy_version 305483 (0.0011) [2023-12-26 02:01:21,530][123090] Updated weights for policy 1, policy_version 303940 (0.0011) [2023-12-26 02:01:21,590][123090] Updated weights for policy 1, policy_version 303950 (0.0009) [2023-12-26 02:01:21,657][123090] Updated weights for policy 1, policy_version 303960 (0.0009) [2023-12-26 02:01:22,416][123091] Updated weights for policy 0, policy_version 305493 (0.0010) [2023-12-26 02:01:22,482][123091] Updated weights for policy 0, policy_version 305503 (0.0010) [2023-12-26 02:01:22,512][123090] Updated weights for policy 1, policy_version 303970 (0.0009) [2023-12-26 02:01:22,541][123091] Updated weights for policy 0, policy_version 305513 (0.0009) [2023-12-26 02:01:22,566][123090] Updated weights for policy 1, policy_version 303980 (0.0008) [2023-12-26 02:01:22,619][123090] Updated weights for policy 1, policy_version 303990 (0.0009) [2023-12-26 02:01:22,669][123090] Updated weights for policy 1, policy_version 304000 (0.0009) [2023-12-26 02:01:23,306][123091] Updated weights for policy 0, policy_version 305523 (0.0007) [2023-12-26 02:01:23,359][123091] Updated weights for policy 0, policy_version 305533 (0.0009) [2023-12-26 02:01:23,406][123091] Updated weights for policy 0, policy_version 305543 (0.0009) [2023-12-26 02:01:23,581][123090] Updated weights for policy 1, policy_version 304010 (0.0009) [2023-12-26 02:01:23,656][123090] Updated weights for policy 1, policy_version 304020 (0.0010) [2023-12-26 02:01:23,716][123090] Updated weights for policy 1, policy_version 304030 (0.0009) [2023-12-26 02:01:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 156057600. Throughput: 0: 8708.2, 1: 8747.1. Samples: 156030920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:23,785][121949] Avg episode reward: [(0, '5865.244'), (1, '5692.975')] [2023-12-26 02:01:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000305552_78225408.pth... [2023-12-26 02:01:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000304032_77832192.pth... [2023-12-26 02:01:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000304528_77963264.pth [2023-12-26 02:01:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000302976_77561856.pth [2023-12-26 02:01:24,175][123091] Updated weights for policy 0, policy_version 305553 (0.0007) [2023-12-26 02:01:24,234][123091] Updated weights for policy 0, policy_version 305563 (0.0006) [2023-12-26 02:01:24,281][123091] Updated weights for policy 0, policy_version 305573 (0.0005) [2023-12-26 02:01:24,329][123091] Updated weights for policy 0, policy_version 305583 (0.0005) [2023-12-26 02:01:24,570][123090] Updated weights for policy 1, policy_version 304040 (0.0010) [2023-12-26 02:01:24,627][123090] Updated weights for policy 1, policy_version 304050 (0.0008) [2023-12-26 02:01:24,693][123090] Updated weights for policy 1, policy_version 304060 (0.0007) [2023-12-26 02:01:25,103][123091] Updated weights for policy 0, policy_version 305593 (0.0006) [2023-12-26 02:01:25,162][123091] Updated weights for policy 0, policy_version 305603 (0.0007) [2023-12-26 02:01:25,218][123091] Updated weights for policy 0, policy_version 305613 (0.0009) [2023-12-26 02:01:25,533][123090] Updated weights for policy 1, policy_version 304070 (0.0010) [2023-12-26 02:01:25,588][123090] Updated weights for policy 1, policy_version 304080 (0.0010) [2023-12-26 02:01:25,647][123090] Updated weights for policy 1, policy_version 304090 (0.0008) [2023-12-26 02:01:26,021][123091] Updated weights for policy 0, policy_version 305623 (0.0009) [2023-12-26 02:01:26,069][123091] Updated weights for policy 0, policy_version 305633 (0.0008) [2023-12-26 02:01:26,147][123091] Updated weights for policy 0, policy_version 305643 (0.0005) [2023-12-26 02:01:26,530][123090] Updated weights for policy 1, policy_version 304100 (0.0009) [2023-12-26 02:01:26,597][123090] Updated weights for policy 1, policy_version 304110 (0.0009) [2023-12-26 02:01:26,662][123090] Updated weights for policy 1, policy_version 304120 (0.0010) [2023-12-26 02:01:26,819][123091] Updated weights for policy 0, policy_version 305653 (0.0005) [2023-12-26 02:01:26,877][123091] Updated weights for policy 0, policy_version 305663 (0.0005) [2023-12-26 02:01:26,921][123091] Updated weights for policy 0, policy_version 305673 (0.0005) [2023-12-26 02:01:27,539][123090] Updated weights for policy 1, policy_version 304130 (0.0010) [2023-12-26 02:01:27,607][123090] Updated weights for policy 1, policy_version 304140 (0.0009) [2023-12-26 02:01:27,635][123091] Updated weights for policy 0, policy_version 305683 (0.0005) [2023-12-26 02:01:27,666][123090] Updated weights for policy 1, policy_version 304150 (0.0009) [2023-12-26 02:01:27,690][123091] Updated weights for policy 0, policy_version 305693 (0.0008) [2023-12-26 02:01:27,727][123090] Updated weights for policy 1, policy_version 304160 (0.0008) [2023-12-26 02:01:27,744][123091] Updated weights for policy 0, policy_version 305703 (0.0008) [2023-12-26 02:01:28,493][123091] Updated weights for policy 0, policy_version 305713 (0.0009) [2023-12-26 02:01:28,548][123091] Updated weights for policy 0, policy_version 305723 (0.0008) [2023-12-26 02:01:28,566][123090] Updated weights for policy 1, policy_version 304170 (0.0009) [2023-12-26 02:01:28,600][123091] Updated weights for policy 0, policy_version 305733 (0.0006) [2023-12-26 02:01:28,615][123090] Updated weights for policy 1, policy_version 304180 (0.0007) [2023-12-26 02:01:28,661][123090] Updated weights for policy 1, policy_version 304190 (0.0005) [2023-12-26 02:01:28,664][123091] Updated weights for policy 0, policy_version 305743 (0.0009) [2023-12-26 02:01:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 156147712. Throughput: 0: 8757.6, 1: 8688.0. Samples: 156135508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:28,785][121949] Avg episode reward: [(0, '5773.879'), (1, '5635.554')] [2023-12-26 02:01:29,435][123091] Updated weights for policy 0, policy_version 305753 (0.0010) [2023-12-26 02:01:29,500][123091] Updated weights for policy 0, policy_version 305763 (0.0010) [2023-12-26 02:01:29,515][123090] Updated weights for policy 1, policy_version 304200 (0.0006) [2023-12-26 02:01:29,557][123091] Updated weights for policy 0, policy_version 305773 (0.0008) [2023-12-26 02:01:29,571][123090] Updated weights for policy 1, policy_version 304210 (0.0007) [2023-12-26 02:01:29,636][123090] Updated weights for policy 1, policy_version 304220 (0.0009) [2023-12-26 02:01:30,415][123091] Updated weights for policy 0, policy_version 305783 (0.0008) [2023-12-26 02:01:30,455][123090] Updated weights for policy 1, policy_version 304230 (0.0009) [2023-12-26 02:01:30,476][123091] Updated weights for policy 0, policy_version 305793 (0.0007) [2023-12-26 02:01:30,508][123090] Updated weights for policy 1, policy_version 304240 (0.0009) [2023-12-26 02:01:30,528][123091] Updated weights for policy 0, policy_version 305803 (0.0007) [2023-12-26 02:01:30,570][123090] Updated weights for policy 1, policy_version 304250 (0.0008) [2023-12-26 02:01:31,360][123091] Updated weights for policy 0, policy_version 305813 (0.0010) [2023-12-26 02:01:31,400][123090] Updated weights for policy 1, policy_version 304260 (0.0010) [2023-12-26 02:01:31,428][123091] Updated weights for policy 0, policy_version 305823 (0.0009) [2023-12-26 02:01:31,469][123090] Updated weights for policy 1, policy_version 304270 (0.0008) [2023-12-26 02:01:31,495][123091] Updated weights for policy 0, policy_version 305833 (0.0009) [2023-12-26 02:01:31,532][123090] Updated weights for policy 1, policy_version 304280 (0.0009) [2023-12-26 02:01:32,328][123090] Updated weights for policy 1, policy_version 304290 (0.0009) [2023-12-26 02:01:32,345][123091] Updated weights for policy 0, policy_version 305843 (0.0007) [2023-12-26 02:01:32,395][123090] Updated weights for policy 1, policy_version 304300 (0.0008) [2023-12-26 02:01:32,407][123091] Updated weights for policy 0, policy_version 305853 (0.0009) [2023-12-26 02:01:32,444][123090] Updated weights for policy 1, policy_version 304310 (0.0008) [2023-12-26 02:01:32,465][123091] Updated weights for policy 0, policy_version 305863 (0.0007) [2023-12-26 02:01:32,493][123090] Updated weights for policy 1, policy_version 304320 (0.0008) [2023-12-26 02:01:33,308][123091] Updated weights for policy 0, policy_version 305873 (0.0010) [2023-12-26 02:01:33,323][123090] Updated weights for policy 1, policy_version 304330 (0.0008) [2023-12-26 02:01:33,353][123091] Updated weights for policy 0, policy_version 305883 (0.0009) [2023-12-26 02:01:33,370][123090] Updated weights for policy 1, policy_version 304340 (0.0008) [2023-12-26 02:01:33,404][123091] Updated weights for policy 0, policy_version 305893 (0.0008) [2023-12-26 02:01:33,425][123090] Updated weights for policy 1, policy_version 304350 (0.0009) [2023-12-26 02:01:33,472][123091] Updated weights for policy 0, policy_version 305903 (0.0008) [2023-12-26 02:01:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 156229632. Throughput: 0: 8719.2, 1: 8684.5. Samples: 156238672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:33,785][121949] Avg episode reward: [(0, '5811.833'), (1, '5543.131')] [2023-12-26 02:01:34,275][123090] Updated weights for policy 1, policy_version 304360 (0.0009) [2023-12-26 02:01:34,321][123091] Updated weights for policy 0, policy_version 305913 (0.0008) [2023-12-26 02:01:34,335][123090] Updated weights for policy 1, policy_version 304370 (0.0009) [2023-12-26 02:01:34,381][123091] Updated weights for policy 0, policy_version 305923 (0.0007) [2023-12-26 02:01:34,396][123090] Updated weights for policy 1, policy_version 304380 (0.0009) [2023-12-26 02:01:34,443][123091] Updated weights for policy 0, policy_version 305933 (0.0008) [2023-12-26 02:01:35,142][123090] Updated weights for policy 1, policy_version 304390 (0.0008) [2023-12-26 02:01:35,194][123090] Updated weights for policy 1, policy_version 304400 (0.0009) [2023-12-26 02:01:35,250][123090] Updated weights for policy 1, policy_version 304410 (0.0009) [2023-12-26 02:01:35,295][123091] Updated weights for policy 0, policy_version 305943 (0.0008) [2023-12-26 02:01:35,355][123091] Updated weights for policy 0, policy_version 305953 (0.0009) [2023-12-26 02:01:35,422][123091] Updated weights for policy 0, policy_version 305963 (0.0010) [2023-12-26 02:01:36,049][123090] Updated weights for policy 1, policy_version 304420 (0.0010) [2023-12-26 02:01:36,101][123090] Updated weights for policy 1, policy_version 304430 (0.0009) [2023-12-26 02:01:36,166][123090] Updated weights for policy 1, policy_version 304440 (0.0009) [2023-12-26 02:01:36,256][123091] Updated weights for policy 0, policy_version 305973 (0.0010) [2023-12-26 02:01:36,322][123091] Updated weights for policy 0, policy_version 305983 (0.0009) [2023-12-26 02:01:36,393][123091] Updated weights for policy 0, policy_version 305993 (0.0009) [2023-12-26 02:01:36,996][123090] Updated weights for policy 1, policy_version 304450 (0.0009) [2023-12-26 02:01:37,064][123090] Updated weights for policy 1, policy_version 304460 (0.0010) [2023-12-26 02:01:37,114][123090] Updated weights for policy 1, policy_version 304470 (0.0010) [2023-12-26 02:01:37,219][123091] Updated weights for policy 0, policy_version 306003 (0.0009) [2023-12-26 02:01:37,284][123091] Updated weights for policy 0, policy_version 306013 (0.0010) [2023-12-26 02:01:37,352][123091] Updated weights for policy 0, policy_version 306023 (0.0009) [2023-12-26 02:01:37,955][123090] Updated weights for policy 1, policy_version 304481 (0.0010) [2023-12-26 02:01:38,011][123090] Updated weights for policy 1, policy_version 304491 (0.0009) [2023-12-26 02:01:38,060][123090] Updated weights for policy 1, policy_version 304501 (0.0009) [2023-12-26 02:01:38,116][123090] Updated weights for policy 1, policy_version 304511 (0.0009) [2023-12-26 02:01:38,194][123091] Updated weights for policy 0, policy_version 306033 (0.0009) [2023-12-26 02:01:38,252][123091] Updated weights for policy 0, policy_version 306043 (0.0009) [2023-12-26 02:01:38,303][123091] Updated weights for policy 0, policy_version 306053 (0.0008) [2023-12-26 02:01:38,366][123091] Updated weights for policy 0, policy_version 306063 (0.0009) [2023-12-26 02:01:38,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 156311552. Throughput: 0: 8691.0, 1: 8743.7. Samples: 156290456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:38,785][121949] Avg episode reward: [(0, '5807.846'), (1, '5423.150')] [2023-12-26 02:01:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000306064_78356480.pth... [2023-12-26 02:01:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000304512_77955072.pth... [2023-12-26 02:01:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000305040_78094336.pth [2023-12-26 02:01:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000303520_77701120.pth [2023-12-26 02:01:38,892][123090] Updated weights for policy 1, policy_version 304521 (0.0010) [2023-12-26 02:01:38,954][123090] Updated weights for policy 1, policy_version 304531 (0.0010) [2023-12-26 02:01:39,018][123090] Updated weights for policy 1, policy_version 304541 (0.0006) [2023-12-26 02:01:39,266][123091] Updated weights for policy 0, policy_version 306073 (0.0009) [2023-12-26 02:01:39,333][123091] Updated weights for policy 0, policy_version 306083 (0.0009) [2023-12-26 02:01:39,408][123091] Updated weights for policy 0, policy_version 306093 (0.0009) [2023-12-26 02:01:39,689][123090] Updated weights for policy 1, policy_version 304551 (0.0008) [2023-12-26 02:01:39,752][123090] Updated weights for policy 1, policy_version 304561 (0.0010) [2023-12-26 02:01:39,814][123090] Updated weights for policy 1, policy_version 304571 (0.0010) [2023-12-26 02:01:40,262][123091] Updated weights for policy 0, policy_version 306103 (0.0008) [2023-12-26 02:01:40,336][123091] Updated weights for policy 0, policy_version 306113 (0.0008) [2023-12-26 02:01:40,416][123091] Updated weights for policy 0, policy_version 306123 (0.0007) [2023-12-26 02:01:40,712][123090] Updated weights for policy 1, policy_version 304581 (0.0010) [2023-12-26 02:01:40,781][123090] Updated weights for policy 1, policy_version 304591 (0.0009) [2023-12-26 02:01:40,846][123090] Updated weights for policy 1, policy_version 304601 (0.0009) [2023-12-26 02:01:41,112][123091] Updated weights for policy 0, policy_version 306133 (0.0008) [2023-12-26 02:01:41,182][123091] Updated weights for policy 0, policy_version 306143 (0.0010) [2023-12-26 02:01:41,249][123091] Updated weights for policy 0, policy_version 306153 (0.0009) [2023-12-26 02:01:41,710][123090] Updated weights for policy 1, policy_version 304611 (0.0008) [2023-12-26 02:01:41,780][123090] Updated weights for policy 1, policy_version 304621 (0.0008) [2023-12-26 02:01:41,845][123090] Updated weights for policy 1, policy_version 304631 (0.0008) [2023-12-26 02:01:42,061][123091] Updated weights for policy 0, policy_version 306163 (0.0008) [2023-12-26 02:01:42,129][123091] Updated weights for policy 0, policy_version 306173 (0.0007) [2023-12-26 02:01:42,198][123091] Updated weights for policy 0, policy_version 306183 (0.0009) [2023-12-26 02:01:42,707][123090] Updated weights for policy 1, policy_version 304641 (0.0009) [2023-12-26 02:01:42,778][123090] Updated weights for policy 1, policy_version 304651 (0.0010) [2023-12-26 02:01:42,842][123090] Updated weights for policy 1, policy_version 304661 (0.0010) [2023-12-26 02:01:42,913][123090] Updated weights for policy 1, policy_version 304671 (0.0010) [2023-12-26 02:01:43,019][123091] Updated weights for policy 0, policy_version 306193 (0.0009) [2023-12-26 02:01:43,080][123091] Updated weights for policy 0, policy_version 306203 (0.0009) [2023-12-26 02:01:43,149][123091] Updated weights for policy 0, policy_version 306213 (0.0009) [2023-12-26 02:01:43,210][123091] Updated weights for policy 0, policy_version 306223 (0.0009) [2023-12-26 02:01:43,712][123090] Updated weights for policy 1, policy_version 304681 (0.0008) [2023-12-26 02:01:43,771][123090] Updated weights for policy 1, policy_version 304691 (0.0005) [2023-12-26 02:01:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 156393472. Throughput: 0: 8653.7, 1: 8676.9. Samples: 156392724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:43,785][121949] Avg episode reward: [(0, '5826.000'), (1, '5293.509')] [2023-12-26 02:01:43,833][123090] Updated weights for policy 1, policy_version 304701 (0.0005) [2023-12-26 02:01:44,057][123091] Updated weights for policy 0, policy_version 306233 (0.0008) [2023-12-26 02:01:44,110][123091] Updated weights for policy 0, policy_version 306243 (0.0009) [2023-12-26 02:01:44,165][123091] Updated weights for policy 0, policy_version 306253 (0.0010) [2023-12-26 02:01:44,546][123090] Updated weights for policy 1, policy_version 304711 (0.0009) [2023-12-26 02:01:44,605][123090] Updated weights for policy 1, policy_version 304721 (0.0010) [2023-12-26 02:01:44,670][123090] Updated weights for policy 1, policy_version 304731 (0.0010) [2023-12-26 02:01:44,981][123091] Updated weights for policy 0, policy_version 306263 (0.0010) [2023-12-26 02:01:45,049][123091] Updated weights for policy 0, policy_version 306273 (0.0009) [2023-12-26 02:01:45,110][123091] Updated weights for policy 0, policy_version 306283 (0.0009) [2023-12-26 02:01:45,477][123090] Updated weights for policy 1, policy_version 304741 (0.0010) [2023-12-26 02:01:45,540][123090] Updated weights for policy 1, policy_version 304751 (0.0010) [2023-12-26 02:01:45,604][123090] Updated weights for policy 1, policy_version 304761 (0.0010) [2023-12-26 02:01:45,948][123091] Updated weights for policy 0, policy_version 306293 (0.0009) [2023-12-26 02:01:46,020][123091] Updated weights for policy 0, policy_version 306303 (0.0009) [2023-12-26 02:01:46,088][123091] Updated weights for policy 0, policy_version 306313 (0.0009) [2023-12-26 02:01:46,423][123090] Updated weights for policy 1, policy_version 304771 (0.0010) [2023-12-26 02:01:46,481][123090] Updated weights for policy 1, policy_version 304781 (0.0010) [2023-12-26 02:01:46,529][123090] Updated weights for policy 1, policy_version 304791 (0.0010) [2023-12-26 02:01:46,914][123091] Updated weights for policy 0, policy_version 306323 (0.0009) [2023-12-26 02:01:46,974][123091] Updated weights for policy 0, policy_version 306333 (0.0009) [2023-12-26 02:01:47,034][123091] Updated weights for policy 0, policy_version 306343 (0.0009) [2023-12-26 02:01:47,357][123090] Updated weights for policy 1, policy_version 304801 (0.0010) [2023-12-26 02:01:47,414][123090] Updated weights for policy 1, policy_version 304811 (0.0011) [2023-12-26 02:01:47,467][123090] Updated weights for policy 1, policy_version 304821 (0.0010) [2023-12-26 02:01:47,531][123090] Updated weights for policy 1, policy_version 304831 (0.0011) [2023-12-26 02:01:47,899][123091] Updated weights for policy 0, policy_version 306353 (0.0009) [2023-12-26 02:01:47,955][123091] Updated weights for policy 0, policy_version 306363 (0.0009) [2023-12-26 02:01:48,020][123091] Updated weights for policy 0, policy_version 306373 (0.0009) [2023-12-26 02:01:48,084][123091] Updated weights for policy 0, policy_version 306383 (0.0009) [2023-12-26 02:01:48,366][123090] Updated weights for policy 1, policy_version 304841 (0.0008) [2023-12-26 02:01:48,427][123090] Updated weights for policy 1, policy_version 304851 (0.0009) [2023-12-26 02:01:48,483][123090] Updated weights for policy 1, policy_version 304861 (0.0010) [2023-12-26 02:01:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 156483584. Throughput: 0: 8659.3, 1: 8685.3. Samples: 156495732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:48,785][121949] Avg episode reward: [(0, '5988.239'), (1, '5262.895')] [2023-12-26 02:01:48,937][123091] Updated weights for policy 0, policy_version 306393 (0.0009) [2023-12-26 02:01:48,997][123091] Updated weights for policy 0, policy_version 306403 (0.0009) [2023-12-26 02:01:49,066][123091] Updated weights for policy 0, policy_version 306413 (0.0009) [2023-12-26 02:01:49,316][123090] Updated weights for policy 1, policy_version 304871 (0.0010) [2023-12-26 02:01:49,386][123090] Updated weights for policy 1, policy_version 304881 (0.0010) [2023-12-26 02:01:49,444][123090] Updated weights for policy 1, policy_version 304891 (0.0009) [2023-12-26 02:01:49,911][123091] Updated weights for policy 0, policy_version 306423 (0.0010) [2023-12-26 02:01:49,977][123091] Updated weights for policy 0, policy_version 306433 (0.0009) [2023-12-26 02:01:50,041][123091] Updated weights for policy 0, policy_version 306443 (0.0010) [2023-12-26 02:01:50,298][123090] Updated weights for policy 1, policy_version 304901 (0.0009) [2023-12-26 02:01:50,363][123090] Updated weights for policy 1, policy_version 304911 (0.0009) [2023-12-26 02:01:50,417][123090] Updated weights for policy 1, policy_version 304921 (0.0010) [2023-12-26 02:01:50,833][123091] Updated weights for policy 0, policy_version 306453 (0.0009) [2023-12-26 02:01:50,889][123091] Updated weights for policy 0, policy_version 306463 (0.0009) [2023-12-26 02:01:50,952][123091] Updated weights for policy 0, policy_version 306473 (0.0009) [2023-12-26 02:01:51,264][123090] Updated weights for policy 1, policy_version 304931 (0.0010) [2023-12-26 02:01:51,320][123090] Updated weights for policy 1, policy_version 304941 (0.0010) [2023-12-26 02:01:51,389][123090] Updated weights for policy 1, policy_version 304951 (0.0009) [2023-12-26 02:01:51,845][123091] Updated weights for policy 0, policy_version 306483 (0.0010) [2023-12-26 02:01:51,906][123091] Updated weights for policy 0, policy_version 306493 (0.0005) [2023-12-26 02:01:51,969][123091] Updated weights for policy 0, policy_version 306503 (0.0009) [2023-12-26 02:01:52,241][123090] Updated weights for policy 1, policy_version 304961 (0.0009) [2023-12-26 02:01:52,304][123090] Updated weights for policy 1, policy_version 304971 (0.0010) [2023-12-26 02:01:52,369][123090] Updated weights for policy 1, policy_version 304981 (0.0009) [2023-12-26 02:01:52,436][123090] Updated weights for policy 1, policy_version 304991 (0.0009) [2023-12-26 02:01:52,788][123091] Updated weights for policy 0, policy_version 306513 (0.0009) [2023-12-26 02:01:52,856][123091] Updated weights for policy 0, policy_version 306523 (0.0010) [2023-12-26 02:01:52,913][123091] Updated weights for policy 0, policy_version 306533 (0.0009) [2023-12-26 02:01:52,959][123091] Updated weights for policy 0, policy_version 306543 (0.0008) [2023-12-26 02:01:53,207][123090] Updated weights for policy 1, policy_version 305001 (0.0010) [2023-12-26 02:01:53,256][123090] Updated weights for policy 1, policy_version 305011 (0.0009) [2023-12-26 02:01:53,316][123090] Updated weights for policy 1, policy_version 305021 (0.0009) [2023-12-26 02:01:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 156565504. Throughput: 0: 8633.5, 1: 8691.1. Samples: 156546332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:53,785][121949] Avg episode reward: [(0, '5788.710'), (1, '5232.952')] [2023-12-26 02:01:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000305024_78086144.pth... [2023-12-26 02:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000304032_77832192.pth [2023-12-26 02:01:53,817][123091] Updated weights for policy 0, policy_version 306553 (0.0009) [2023-12-26 02:01:53,865][123091] Updated weights for policy 0, policy_version 306563 (0.0009) [2023-12-26 02:01:53,916][123091] Updated weights for policy 0, policy_version 306573 (0.0009) [2023-12-26 02:01:53,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000306576_78487552.pth... [2023-12-26 02:01:53,940][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000305552_78225408.pth [2023-12-26 02:01:54,131][123090] Updated weights for policy 1, policy_version 305031 (0.0007) [2023-12-26 02:01:54,188][123090] Updated weights for policy 1, policy_version 305041 (0.0006) [2023-12-26 02:01:54,265][123090] Updated weights for policy 1, policy_version 305051 (0.0009) [2023-12-26 02:01:54,808][123091] Updated weights for policy 0, policy_version 306583 (0.0009) [2023-12-26 02:01:54,873][123091] Updated weights for policy 0, policy_version 306593 (0.0009) [2023-12-26 02:01:54,925][123090] Updated weights for policy 1, policy_version 305061 (0.0010) [2023-12-26 02:01:54,940][123091] Updated weights for policy 0, policy_version 306603 (0.0008) [2023-12-26 02:01:54,994][123090] Updated weights for policy 1, policy_version 305071 (0.0009) [2023-12-26 02:01:55,062][123090] Updated weights for policy 1, policy_version 305081 (0.0010) [2023-12-26 02:01:55,758][123091] Updated weights for policy 0, policy_version 306613 (0.0009) [2023-12-26 02:01:55,820][123091] Updated weights for policy 0, policy_version 306623 (0.0010) [2023-12-26 02:01:55,874][123090] Updated weights for policy 1, policy_version 305091 (0.0009) [2023-12-26 02:01:55,884][123091] Updated weights for policy 0, policy_version 306633 (0.0010) [2023-12-26 02:01:55,942][123090] Updated weights for policy 1, policy_version 305101 (0.0009) [2023-12-26 02:01:56,008][123090] Updated weights for policy 1, policy_version 305111 (0.0009) [2023-12-26 02:01:56,685][123091] Updated weights for policy 0, policy_version 306643 (0.0007) [2023-12-26 02:01:56,734][123091] Updated weights for policy 0, policy_version 306653 (0.0009) [2023-12-26 02:01:56,789][123091] Updated weights for policy 0, policy_version 306663 (0.0010) [2023-12-26 02:01:56,838][123090] Updated weights for policy 1, policy_version 305121 (0.0010) [2023-12-26 02:01:56,905][123090] Updated weights for policy 1, policy_version 305131 (0.0009) [2023-12-26 02:01:56,960][123090] Updated weights for policy 1, policy_version 305141 (0.0009) [2023-12-26 02:01:57,010][123090] Updated weights for policy 1, policy_version 305152 (0.0009) [2023-12-26 02:01:57,636][123091] Updated weights for policy 0, policy_version 306674 (0.0010) [2023-12-26 02:01:57,702][123091] Updated weights for policy 0, policy_version 306684 (0.0010) [2023-12-26 02:01:57,774][123091] Updated weights for policy 0, policy_version 306694 (0.0009) [2023-12-26 02:01:57,839][123091] Updated weights for policy 0, policy_version 306704 (0.0009) [2023-12-26 02:01:57,843][123090] Updated weights for policy 1, policy_version 305162 (0.0007) [2023-12-26 02:01:57,902][123090] Updated weights for policy 1, policy_version 305172 (0.0010) [2023-12-26 02:01:57,958][123090] Updated weights for policy 1, policy_version 305182 (0.0010) [2023-12-26 02:01:58,602][123091] Updated weights for policy 0, policy_version 306714 (0.0007) [2023-12-26 02:01:58,676][123091] Updated weights for policy 0, policy_version 306724 (0.0007) [2023-12-26 02:01:58,765][123091] Updated weights for policy 0, policy_version 306734 (0.0007) [2023-12-26 02:01:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 156655616. Throughput: 0: 8654.6, 1: 8679.7. Samples: 156649800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:01:58,784][121949] Avg episode reward: [(0, '5670.927'), (1, '5224.421')] [2023-12-26 02:01:59,004][123090] Updated weights for policy 1, policy_version 305192 (0.0010) [2023-12-26 02:01:59,082][123090] Updated weights for policy 1, policy_version 305202 (0.0007) [2023-12-26 02:01:59,151][123090] Updated weights for policy 1, policy_version 305212 (0.0007) [2023-12-26 02:01:59,622][123091] Updated weights for policy 0, policy_version 306744 (0.0010) [2023-12-26 02:01:59,681][123091] Updated weights for policy 0, policy_version 306754 (0.0010) [2023-12-26 02:01:59,728][123091] Updated weights for policy 0, policy_version 306764 (0.0010) [2023-12-26 02:01:59,890][123090] Updated weights for policy 1, policy_version 305222 (0.0008) [2023-12-26 02:01:59,950][123090] Updated weights for policy 1, policy_version 305232 (0.0008) [2023-12-26 02:02:00,018][123090] Updated weights for policy 1, policy_version 305242 (0.0008) [2023-12-26 02:02:00,528][123091] Updated weights for policy 0, policy_version 306774 (0.0007) [2023-12-26 02:02:00,585][123091] Updated weights for policy 0, policy_version 306784 (0.0005) [2023-12-26 02:02:00,640][123091] Updated weights for policy 0, policy_version 306794 (0.0005) [2023-12-26 02:02:00,783][123090] Updated weights for policy 1, policy_version 305252 (0.0009) [2023-12-26 02:02:00,836][123090] Updated weights for policy 1, policy_version 305262 (0.0009) [2023-12-26 02:02:00,883][123090] Updated weights for policy 1, policy_version 305272 (0.0008) [2023-12-26 02:02:01,476][123091] Updated weights for policy 0, policy_version 306804 (0.0009) [2023-12-26 02:02:01,529][123091] Updated weights for policy 0, policy_version 306814 (0.0009) [2023-12-26 02:02:01,589][123090] Updated weights for policy 1, policy_version 305282 (0.0009) [2023-12-26 02:02:01,592][123091] Updated weights for policy 0, policy_version 306824 (0.0009) [2023-12-26 02:02:01,654][123090] Updated weights for policy 1, policy_version 305292 (0.0008) [2023-12-26 02:02:01,722][123090] Updated weights for policy 1, policy_version 305302 (0.0009) [2023-12-26 02:02:01,789][123090] Updated weights for policy 1, policy_version 305312 (0.0009) [2023-12-26 02:02:02,415][123091] Updated weights for policy 0, policy_version 306834 (0.0009) [2023-12-26 02:02:02,477][123091] Updated weights for policy 0, policy_version 306844 (0.0009) [2023-12-26 02:02:02,539][123091] Updated weights for policy 0, policy_version 306854 (0.0008) [2023-12-26 02:02:02,542][123090] Updated weights for policy 1, policy_version 305322 (0.0009) [2023-12-26 02:02:02,597][123090] Updated weights for policy 1, policy_version 305332 (0.0010) [2023-12-26 02:02:02,606][123091] Updated weights for policy 0, policy_version 306864 (0.0008) [2023-12-26 02:02:02,651][123090] Updated weights for policy 1, policy_version 305342 (0.0010) [2023-12-26 02:02:03,404][123091] Updated weights for policy 0, policy_version 306874 (0.0009) [2023-12-26 02:02:03,458][123091] Updated weights for policy 0, policy_version 306884 (0.0009) [2023-12-26 02:02:03,494][123090] Updated weights for policy 1, policy_version 305352 (0.0010) [2023-12-26 02:02:03,516][123091] Updated weights for policy 0, policy_version 306894 (0.0007) [2023-12-26 02:02:03,551][123090] Updated weights for policy 1, policy_version 305362 (0.0008) [2023-12-26 02:02:03,601][123090] Updated weights for policy 1, policy_version 305372 (0.0008) [2023-12-26 02:02:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 156745728. Throughput: 0: 8601.8, 1: 8585.0. Samples: 156752160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:03,784][121949] Avg episode reward: [(0, '5766.089'), (1, '5250.158')] [2023-12-26 02:02:04,360][123091] Updated weights for policy 0, policy_version 306904 (0.0010) [2023-12-26 02:02:04,427][123091] Updated weights for policy 0, policy_version 306914 (0.0009) [2023-12-26 02:02:04,449][123090] Updated weights for policy 1, policy_version 305382 (0.0009) [2023-12-26 02:02:04,482][123091] Updated weights for policy 0, policy_version 306924 (0.0008) [2023-12-26 02:02:04,514][123090] Updated weights for policy 1, policy_version 305392 (0.0009) [2023-12-26 02:02:04,574][123090] Updated weights for policy 1, policy_version 305402 (0.0009) [2023-12-26 02:02:05,243][123091] Updated weights for policy 0, policy_version 306934 (0.0006) [2023-12-26 02:02:05,299][123091] Updated weights for policy 0, policy_version 306944 (0.0005) [2023-12-26 02:02:05,349][123091] Updated weights for policy 0, policy_version 306954 (0.0005) [2023-12-26 02:02:05,415][123090] Updated weights for policy 1, policy_version 305412 (0.0010) [2023-12-26 02:02:05,474][123090] Updated weights for policy 1, policy_version 305422 (0.0010) [2023-12-26 02:02:05,537][123090] Updated weights for policy 1, policy_version 305432 (0.0010) [2023-12-26 02:02:06,134][123091] Updated weights for policy 0, policy_version 306964 (0.0007) [2023-12-26 02:02:06,199][123091] Updated weights for policy 0, policy_version 306974 (0.0008) [2023-12-26 02:02:06,263][123091] Updated weights for policy 0, policy_version 306984 (0.0009) [2023-12-26 02:02:06,360][123090] Updated weights for policy 1, policy_version 305442 (0.0009) [2023-12-26 02:02:06,418][123090] Updated weights for policy 1, policy_version 305452 (0.0009) [2023-12-26 02:02:06,470][123090] Updated weights for policy 1, policy_version 305462 (0.0009) [2023-12-26 02:02:06,535][123090] Updated weights for policy 1, policy_version 305472 (0.0008) [2023-12-26 02:02:07,078][123091] Updated weights for policy 0, policy_version 306994 (0.0009) [2023-12-26 02:02:07,139][123091] Updated weights for policy 0, policy_version 307004 (0.0009) [2023-12-26 02:02:07,187][123091] Updated weights for policy 0, policy_version 307014 (0.0008) [2023-12-26 02:02:07,242][123091] Updated weights for policy 0, policy_version 307024 (0.0011) [2023-12-26 02:02:07,282][123090] Updated weights for policy 1, policy_version 305482 (0.0006) [2023-12-26 02:02:07,343][123090] Updated weights for policy 1, policy_version 305492 (0.0007) [2023-12-26 02:02:07,393][123090] Updated weights for policy 1, policy_version 305502 (0.0005) [2023-12-26 02:02:07,991][123091] Updated weights for policy 0, policy_version 307034 (0.0006) [2023-12-26 02:02:08,045][123091] Updated weights for policy 0, policy_version 307044 (0.0006) [2023-12-26 02:02:08,059][123090] Updated weights for policy 1, policy_version 305512 (0.0005) [2023-12-26 02:02:08,095][123091] Updated weights for policy 0, policy_version 307054 (0.0007) [2023-12-26 02:02:08,129][123090] Updated weights for policy 1, policy_version 305522 (0.0008) [2023-12-26 02:02:08,201][123090] Updated weights for policy 1, policy_version 305532 (0.0008) [2023-12-26 02:02:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 156827648. Throughput: 0: 8629.2, 1: 8562.4. Samples: 156804544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:08,785][121949] Avg episode reward: [(0, '5748.933'), (1, '5297.333')] [2023-12-26 02:02:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000305536_78217216.pth... [2023-12-26 02:02:08,794][123091] Updated weights for policy 0, policy_version 307064 (0.0008) [2023-12-26 02:02:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000304512_77955072.pth [2023-12-26 02:02:08,858][123091] Updated weights for policy 0, policy_version 307074 (0.0009) [2023-12-26 02:02:08,924][123091] Updated weights for policy 0, policy_version 307084 (0.0009) [2023-12-26 02:02:08,949][123090] Updated weights for policy 1, policy_version 305542 (0.0008) [2023-12-26 02:02:08,950][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000307088_78618624.pth... [2023-12-26 02:02:08,954][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000306064_78356480.pth [2023-12-26 02:02:09,015][123090] Updated weights for policy 1, policy_version 305552 (0.0009) [2023-12-26 02:02:09,086][123090] Updated weights for policy 1, policy_version 305562 (0.0011) [2023-12-26 02:02:09,762][123091] Updated weights for policy 0, policy_version 307094 (0.0006) [2023-12-26 02:02:09,822][123091] Updated weights for policy 0, policy_version 307104 (0.0006) [2023-12-26 02:02:09,891][123091] Updated weights for policy 0, policy_version 307114 (0.0009) [2023-12-26 02:02:09,934][123090] Updated weights for policy 1, policy_version 305572 (0.0009) [2023-12-26 02:02:10,009][123090] Updated weights for policy 1, policy_version 305582 (0.0006) [2023-12-26 02:02:10,078][123090] Updated weights for policy 1, policy_version 305592 (0.0006) [2023-12-26 02:02:10,768][123091] Updated weights for policy 0, policy_version 307124 (0.0009) [2023-12-26 02:02:10,830][123091] Updated weights for policy 0, policy_version 307134 (0.0009) [2023-12-26 02:02:10,843][123090] Updated weights for policy 1, policy_version 305602 (0.0007) [2023-12-26 02:02:10,896][123091] Updated weights for policy 0, policy_version 307144 (0.0009) [2023-12-26 02:02:10,910][123090] Updated weights for policy 1, policy_version 305612 (0.0009) [2023-12-26 02:02:10,973][123090] Updated weights for policy 1, policy_version 305622 (0.0009) [2023-12-26 02:02:11,050][123090] Updated weights for policy 1, policy_version 305632 (0.0009) [2023-12-26 02:02:11,726][123091] Updated weights for policy 0, policy_version 307154 (0.0009) [2023-12-26 02:02:11,797][123091] Updated weights for policy 0, policy_version 307164 (0.0008) [2023-12-26 02:02:11,872][123091] Updated weights for policy 0, policy_version 307174 (0.0006) [2023-12-26 02:02:11,894][123090] Updated weights for policy 1, policy_version 305642 (0.0009) [2023-12-26 02:02:11,945][123091] Updated weights for policy 0, policy_version 307184 (0.0006) [2023-12-26 02:02:11,960][123090] Updated weights for policy 1, policy_version 305652 (0.0009) [2023-12-26 02:02:12,020][123090] Updated weights for policy 1, policy_version 305662 (0.0010) [2023-12-26 02:02:12,752][123091] Updated weights for policy 0, policy_version 307194 (0.0009) [2023-12-26 02:02:12,779][123090] Updated weights for policy 1, policy_version 305672 (0.0006) [2023-12-26 02:02:12,805][123091] Updated weights for policy 0, policy_version 307204 (0.0008) [2023-12-26 02:02:12,837][123090] Updated weights for policy 1, policy_version 305682 (0.0005) [2023-12-26 02:02:12,867][123091] Updated weights for policy 0, policy_version 307214 (0.0009) [2023-12-26 02:02:12,901][123090] Updated weights for policy 1, policy_version 305692 (0.0005) [2023-12-26 02:02:13,634][123090] Updated weights for policy 1, policy_version 305702 (0.0007) [2023-12-26 02:02:13,690][123090] Updated weights for policy 1, policy_version 305712 (0.0009) [2023-12-26 02:02:13,745][123090] Updated weights for policy 1, policy_version 305722 (0.0009) [2023-12-26 02:02:13,755][123091] Updated weights for policy 0, policy_version 307224 (0.0008) [2023-12-26 02:02:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17605.8). Total num frames: 156917760. Throughput: 0: 8565.0, 1: 8679.4. Samples: 156911504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:13,785][121949] Avg episode reward: [(0, '5728.116'), (1, '5410.720')] [2023-12-26 02:02:13,809][123091] Updated weights for policy 0, policy_version 307234 (0.0009) [2023-12-26 02:02:13,881][123091] Updated weights for policy 0, policy_version 307244 (0.0009) [2023-12-26 02:02:14,578][123090] Updated weights for policy 1, policy_version 305732 (0.0008) [2023-12-26 02:02:14,635][123090] Updated weights for policy 1, policy_version 305742 (0.0009) [2023-12-26 02:02:14,697][123090] Updated weights for policy 1, policy_version 305752 (0.0010) [2023-12-26 02:02:14,708][123091] Updated weights for policy 0, policy_version 307254 (0.0008) [2023-12-26 02:02:14,774][123091] Updated weights for policy 0, policy_version 307264 (0.0007) [2023-12-26 02:02:14,842][123091] Updated weights for policy 0, policy_version 307274 (0.0007) [2023-12-26 02:02:15,484][123091] Updated weights for policy 0, policy_version 307284 (0.0007) [2023-12-26 02:02:15,544][123091] Updated weights for policy 0, policy_version 307294 (0.0009) [2023-12-26 02:02:15,569][123090] Updated weights for policy 1, policy_version 305762 (0.0008) [2023-12-26 02:02:15,610][123091] Updated weights for policy 0, policy_version 307304 (0.0005) [2023-12-26 02:02:15,637][123090] Updated weights for policy 1, policy_version 305772 (0.0008) [2023-12-26 02:02:15,700][123090] Updated weights for policy 1, policy_version 305782 (0.0010) [2023-12-26 02:02:15,766][123090] Updated weights for policy 1, policy_version 305792 (0.0008) [2023-12-26 02:02:16,420][123091] Updated weights for policy 0, policy_version 307314 (0.0007) [2023-12-26 02:02:16,477][123090] Updated weights for policy 1, policy_version 305802 (0.0006) [2023-12-26 02:02:16,486][123091] Updated weights for policy 0, policy_version 307324 (0.0009) [2023-12-26 02:02:16,536][123090] Updated weights for policy 1, policy_version 305812 (0.0005) [2023-12-26 02:02:16,544][123091] Updated weights for policy 0, policy_version 307334 (0.0009) [2023-12-26 02:02:16,607][123091] Updated weights for policy 0, policy_version 307344 (0.0008) [2023-12-26 02:02:16,607][123090] Updated weights for policy 1, policy_version 305822 (0.0006) [2023-12-26 02:02:17,270][123090] Updated weights for policy 1, policy_version 305832 (0.0005) [2023-12-26 02:02:17,332][123090] Updated weights for policy 1, policy_version 305842 (0.0005) [2023-12-26 02:02:17,385][123090] Updated weights for policy 1, policy_version 305852 (0.0008) [2023-12-26 02:02:17,451][123091] Updated weights for policy 0, policy_version 307354 (0.0006) [2023-12-26 02:02:17,512][123091] Updated weights for policy 0, policy_version 307364 (0.0009) [2023-12-26 02:02:17,563][123091] Updated weights for policy 0, policy_version 307374 (0.0010) [2023-12-26 02:02:18,164][123090] Updated weights for policy 1, policy_version 305862 (0.0007) [2023-12-26 02:02:18,215][123090] Updated weights for policy 1, policy_version 305872 (0.0005) [2023-12-26 02:02:18,262][123090] Updated weights for policy 1, policy_version 305882 (0.0005) [2023-12-26 02:02:18,419][123091] Updated weights for policy 0, policy_version 307384 (0.0010) [2023-12-26 02:02:18,476][123091] Updated weights for policy 0, policy_version 307394 (0.0010) [2023-12-26 02:02:18,546][123091] Updated weights for policy 0, policy_version 307404 (0.0009) [2023-12-26 02:02:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 157007872. Throughput: 0: 8549.6, 1: 8786.0. Samples: 157018768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:18,785][121949] Avg episode reward: [(0, '5682.585'), (1, '5492.955')] [2023-12-26 02:02:19,057][123090] Updated weights for policy 1, policy_version 305892 (0.0007) [2023-12-26 02:02:19,109][123090] Updated weights for policy 1, policy_version 305902 (0.0010) [2023-12-26 02:02:19,163][123090] Updated weights for policy 1, policy_version 305912 (0.0010) [2023-12-26 02:02:19,411][123091] Updated weights for policy 0, policy_version 307414 (0.0008) [2023-12-26 02:02:19,476][123091] Updated weights for policy 0, policy_version 307424 (0.0006) [2023-12-26 02:02:19,546][123091] Updated weights for policy 0, policy_version 307434 (0.0007) [2023-12-26 02:02:20,059][123090] Updated weights for policy 1, policy_version 305922 (0.0010) [2023-12-26 02:02:20,122][123090] Updated weights for policy 1, policy_version 305932 (0.0010) [2023-12-26 02:02:20,181][123090] Updated weights for policy 1, policy_version 305942 (0.0010) [2023-12-26 02:02:20,239][123090] Updated weights for policy 1, policy_version 305952 (0.0010) [2023-12-26 02:02:20,259][123091] Updated weights for policy 0, policy_version 307444 (0.0007) [2023-12-26 02:02:20,328][123091] Updated weights for policy 0, policy_version 307454 (0.0007) [2023-12-26 02:02:20,388][123091] Updated weights for policy 0, policy_version 307464 (0.0010) [2023-12-26 02:02:21,148][123090] Updated weights for policy 1, policy_version 305962 (0.0007) [2023-12-26 02:02:21,203][123091] Updated weights for policy 0, policy_version 307474 (0.0010) [2023-12-26 02:02:21,215][123090] Updated weights for policy 1, policy_version 305972 (0.0008) [2023-12-26 02:02:21,263][123091] Updated weights for policy 0, policy_version 307484 (0.0008) [2023-12-26 02:02:21,279][123090] Updated weights for policy 1, policy_version 305982 (0.0007) [2023-12-26 02:02:21,322][123091] Updated weights for policy 0, policy_version 307494 (0.0008) [2023-12-26 02:02:21,394][123091] Updated weights for policy 0, policy_version 307504 (0.0008) [2023-12-26 02:02:22,154][123090] Updated weights for policy 1, policy_version 305992 (0.0007) [2023-12-26 02:02:22,164][123091] Updated weights for policy 0, policy_version 307514 (0.0005) [2023-12-26 02:02:22,212][123090] Updated weights for policy 1, policy_version 306002 (0.0008) [2023-12-26 02:02:22,218][123091] Updated weights for policy 0, policy_version 307524 (0.0008) [2023-12-26 02:02:22,280][123090] Updated weights for policy 1, policy_version 306012 (0.0007) [2023-12-26 02:02:22,285][123091] Updated weights for policy 0, policy_version 307534 (0.0008) [2023-12-26 02:02:23,101][123090] Updated weights for policy 1, policy_version 306022 (0.0010) [2023-12-26 02:02:23,146][123091] Updated weights for policy 0, policy_version 307544 (0.0009) [2023-12-26 02:02:23,161][123090] Updated weights for policy 1, policy_version 306032 (0.0006) [2023-12-26 02:02:23,197][123091] Updated weights for policy 0, policy_version 307554 (0.0007) [2023-12-26 02:02:23,227][123090] Updated weights for policy 1, policy_version 306042 (0.0009) [2023-12-26 02:02:23,247][123091] Updated weights for policy 0, policy_version 307564 (0.0009) [2023-12-26 02:02:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 157089792. Throughput: 0: 8587.7, 1: 8731.2. Samples: 157069808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:23,785][121949] Avg episode reward: [(0, '5682.483'), (1, '5605.469')] [2023-12-26 02:02:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000307568_78741504.pth... [2023-12-26 02:02:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000306048_78348288.pth... [2023-12-26 02:02:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000306576_78487552.pth [2023-12-26 02:02:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000305024_78086144.pth [2023-12-26 02:02:23,983][123090] Updated weights for policy 1, policy_version 306052 (0.0008) [2023-12-26 02:02:24,035][123090] Updated weights for policy 1, policy_version 306062 (0.0009) [2023-12-26 02:02:24,070][123091] Updated weights for policy 0, policy_version 307574 (0.0005) [2023-12-26 02:02:24,084][123090] Updated weights for policy 1, policy_version 306072 (0.0008) [2023-12-26 02:02:24,130][123091] Updated weights for policy 0, policy_version 307584 (0.0007) [2023-12-26 02:02:24,186][123091] Updated weights for policy 0, policy_version 307594 (0.0009) [2023-12-26 02:02:24,951][123091] Updated weights for policy 0, policy_version 307604 (0.0008) [2023-12-26 02:02:24,958][123090] Updated weights for policy 1, policy_version 306082 (0.0009) [2023-12-26 02:02:25,018][123091] Updated weights for policy 0, policy_version 307614 (0.0006) [2023-12-26 02:02:25,023][123090] Updated weights for policy 1, policy_version 306092 (0.0010) [2023-12-26 02:02:25,070][123091] Updated weights for policy 0, policy_version 307624 (0.0005) [2023-12-26 02:02:25,079][123090] Updated weights for policy 1, policy_version 306102 (0.0009) [2023-12-26 02:02:25,134][123090] Updated weights for policy 1, policy_version 306112 (0.0009) [2023-12-26 02:02:25,666][123091] Updated weights for policy 0, policy_version 307634 (0.0007) [2023-12-26 02:02:25,728][123091] Updated weights for policy 0, policy_version 307644 (0.0010) [2023-12-26 02:02:25,792][123091] Updated weights for policy 0, policy_version 307654 (0.0013) [2023-12-26 02:02:25,852][123091] Updated weights for policy 0, policy_version 307664 (0.0011) [2023-12-26 02:02:26,023][123090] Updated weights for policy 1, policy_version 306122 (0.0010) [2023-12-26 02:02:26,082][123090] Updated weights for policy 1, policy_version 306132 (0.0009) [2023-12-26 02:02:26,144][123090] Updated weights for policy 1, policy_version 306142 (0.0010) [2023-12-26 02:02:26,506][123091] Updated weights for policy 0, policy_version 307674 (0.0009) [2023-12-26 02:02:26,557][123091] Updated weights for policy 0, policy_version 307684 (0.0010) [2023-12-26 02:02:26,620][123091] Updated weights for policy 0, policy_version 307694 (0.0009) [2023-12-26 02:02:27,017][123090] Updated weights for policy 1, policy_version 306152 (0.0009) [2023-12-26 02:02:27,070][123090] Updated weights for policy 1, policy_version 306162 (0.0009) [2023-12-26 02:02:27,118][123090] Updated weights for policy 1, policy_version 306172 (0.0008) [2023-12-26 02:02:27,455][123091] Updated weights for policy 0, policy_version 307704 (0.0010) [2023-12-26 02:02:27,505][123091] Updated weights for policy 0, policy_version 307715 (0.0010) [2023-12-26 02:02:27,555][123091] Updated weights for policy 0, policy_version 307725 (0.0010) [2023-12-26 02:02:27,930][123090] Updated weights for policy 1, policy_version 306182 (0.0007) [2023-12-26 02:02:27,983][123090] Updated weights for policy 1, policy_version 306192 (0.0005) [2023-12-26 02:02:28,040][123090] Updated weights for policy 1, policy_version 306202 (0.0005) [2023-12-26 02:02:28,329][123091] Updated weights for policy 0, policy_version 307735 (0.0008) [2023-12-26 02:02:28,388][123091] Updated weights for policy 0, policy_version 307745 (0.0006) [2023-12-26 02:02:28,458][123091] Updated weights for policy 0, policy_version 307755 (0.0007) [2023-12-26 02:02:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17605.9). Total num frames: 157179904. Throughput: 0: 8655.1, 1: 8711.1. Samples: 157174204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:02:28,785][121949] Avg episode reward: [(0, '5798.589'), (1, '5648.468')] [2023-12-26 02:02:28,820][123090] Updated weights for policy 1, policy_version 306212 (0.0005) [2023-12-26 02:02:28,885][123090] Updated weights for policy 1, policy_version 306222 (0.0006) [2023-12-26 02:02:28,949][123090] Updated weights for policy 1, policy_version 306232 (0.0008) [2023-12-26 02:02:29,160][123091] Updated weights for policy 0, policy_version 307765 (0.0009) [2023-12-26 02:02:29,225][123091] Updated weights for policy 0, policy_version 307775 (0.0009) [2023-12-26 02:02:29,293][123091] Updated weights for policy 0, policy_version 307785 (0.0006) [2023-12-26 02:02:29,753][123090] Updated weights for policy 1, policy_version 306242 (0.0009) [2023-12-26 02:02:29,815][123090] Updated weights for policy 1, policy_version 306252 (0.0010) [2023-12-26 02:02:29,881][123090] Updated weights for policy 1, policy_version 306262 (0.0008) [2023-12-26 02:02:29,952][123090] Updated weights for policy 1, policy_version 306272 (0.0010) [2023-12-26 02:02:30,085][123091] Updated weights for policy 0, policy_version 307795 (0.0008) [2023-12-26 02:02:30,144][123091] Updated weights for policy 0, policy_version 307805 (0.0005) [2023-12-26 02:02:30,200][123091] Updated weights for policy 0, policy_version 307815 (0.0005) [2023-12-26 02:02:30,677][123090] Updated weights for policy 1, policy_version 306282 (0.0005) [2023-12-26 02:02:30,736][123090] Updated weights for policy 1, policy_version 306292 (0.0005) [2023-12-26 02:02:30,784][123090] Updated weights for policy 1, policy_version 306302 (0.0005) [2023-12-26 02:02:30,880][123091] Updated weights for policy 0, policy_version 307825 (0.0006) [2023-12-26 02:02:30,927][123091] Updated weights for policy 0, policy_version 307835 (0.0010) [2023-12-26 02:02:30,970][123091] Updated weights for policy 0, policy_version 307845 (0.0010) [2023-12-26 02:02:31,035][123091] Updated weights for policy 0, policy_version 307855 (0.0009) [2023-12-26 02:02:31,566][123090] Updated weights for policy 1, policy_version 306312 (0.0009) [2023-12-26 02:02:31,629][123090] Updated weights for policy 1, policy_version 306322 (0.0009) [2023-12-26 02:02:31,707][123090] Updated weights for policy 1, policy_version 306332 (0.0010) [2023-12-26 02:02:31,843][123091] Updated weights for policy 0, policy_version 307865 (0.0007) [2023-12-26 02:02:31,907][123091] Updated weights for policy 0, policy_version 307876 (0.0010) [2023-12-26 02:02:31,959][123091] Updated weights for policy 0, policy_version 307886 (0.0009) [2023-12-26 02:02:32,478][123090] Updated weights for policy 1, policy_version 306342 (0.0007) [2023-12-26 02:02:32,541][123090] Updated weights for policy 1, policy_version 306352 (0.0005) [2023-12-26 02:02:32,598][123090] Updated weights for policy 1, policy_version 306362 (0.0005) [2023-12-26 02:02:32,722][123091] Updated weights for policy 0, policy_version 307896 (0.0009) [2023-12-26 02:02:32,779][123091] Updated weights for policy 0, policy_version 307906 (0.0009) [2023-12-26 02:02:32,827][123091] Updated weights for policy 0, policy_version 307916 (0.0007) [2023-12-26 02:02:33,321][123090] Updated weights for policy 1, policy_version 306372 (0.0007) [2023-12-26 02:02:33,389][123090] Updated weights for policy 1, policy_version 306382 (0.0005) [2023-12-26 02:02:33,446][123090] Updated weights for policy 1, policy_version 306392 (0.0007) [2023-12-26 02:02:33,480][123091] Updated weights for policy 0, policy_version 307926 (0.0005) [2023-12-26 02:02:33,528][123091] Updated weights for policy 0, policy_version 307936 (0.0005) [2023-12-26 02:02:33,572][123091] Updated weights for policy 0, policy_version 307946 (0.0005) [2023-12-26 02:02:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 157278208. Throughput: 0: 8813.4, 1: 8754.4. Samples: 157286284. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:33,785][121949] Avg episode reward: [(0, '5721.939'), (1, '5605.854')] [2023-12-26 02:02:34,089][123090] Updated weights for policy 1, policy_version 306402 (0.0005) [2023-12-26 02:02:34,164][123090] Updated weights for policy 1, policy_version 306412 (0.0008) [2023-12-26 02:02:34,229][123090] Updated weights for policy 1, policy_version 306422 (0.0010) [2023-12-26 02:02:34,302][123090] Updated weights for policy 1, policy_version 306432 (0.0008) [2023-12-26 02:02:34,369][123091] Updated weights for policy 0, policy_version 307956 (0.0005) [2023-12-26 02:02:34,436][123091] Updated weights for policy 0, policy_version 307966 (0.0006) [2023-12-26 02:02:34,493][123091] Updated weights for policy 0, policy_version 307976 (0.0005) [2023-12-26 02:02:35,088][123090] Updated weights for policy 1, policy_version 306442 (0.0010) [2023-12-26 02:02:35,142][123090] Updated weights for policy 1, policy_version 306452 (0.0010) [2023-12-26 02:02:35,200][123090] Updated weights for policy 1, policy_version 306462 (0.0010) [2023-12-26 02:02:35,281][123091] Updated weights for policy 0, policy_version 307986 (0.0006) [2023-12-26 02:02:35,328][123091] Updated weights for policy 0, policy_version 307996 (0.0009) [2023-12-26 02:02:35,384][123091] Updated weights for policy 0, policy_version 308006 (0.0009) [2023-12-26 02:02:35,435][123091] Updated weights for policy 0, policy_version 308016 (0.0009) [2023-12-26 02:02:36,073][123090] Updated weights for policy 1, policy_version 306472 (0.0010) [2023-12-26 02:02:36,131][123090] Updated weights for policy 1, policy_version 306482 (0.0010) [2023-12-26 02:02:36,199][123090] Updated weights for policy 1, policy_version 306492 (0.0011) [2023-12-26 02:02:36,297][123091] Updated weights for policy 0, policy_version 308026 (0.0009) [2023-12-26 02:02:36,350][123091] Updated weights for policy 0, policy_version 308036 (0.0009) [2023-12-26 02:02:36,398][123091] Updated weights for policy 0, policy_version 308046 (0.0009) [2023-12-26 02:02:36,918][123090] Updated weights for policy 1, policy_version 306502 (0.0008) [2023-12-26 02:02:36,970][123090] Updated weights for policy 1, policy_version 306512 (0.0005) [2023-12-26 02:02:37,036][123090] Updated weights for policy 1, policy_version 306522 (0.0010) [2023-12-26 02:02:37,230][123091] Updated weights for policy 0, policy_version 308056 (0.0009) [2023-12-26 02:02:37,282][123091] Updated weights for policy 0, policy_version 308066 (0.0009) [2023-12-26 02:02:37,338][123091] Updated weights for policy 0, policy_version 308076 (0.0009) [2023-12-26 02:02:37,755][123090] Updated weights for policy 1, policy_version 306532 (0.0010) [2023-12-26 02:02:37,810][123090] Updated weights for policy 1, policy_version 306542 (0.0010) [2023-12-26 02:02:37,873][123090] Updated weights for policy 1, policy_version 306552 (0.0008) [2023-12-26 02:02:38,212][123091] Updated weights for policy 0, policy_version 308086 (0.0006) [2023-12-26 02:02:38,259][123091] Updated weights for policy 0, policy_version 308096 (0.0005) [2023-12-26 02:02:38,313][123091] Updated weights for policy 0, policy_version 308106 (0.0006) [2023-12-26 02:02:38,690][123090] Updated weights for policy 1, policy_version 306562 (0.0006) [2023-12-26 02:02:38,758][123090] Updated weights for policy 1, policy_version 306572 (0.0010) [2023-12-26 02:02:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 157360128. Throughput: 0: 8831.3, 1: 8774.5. Samples: 157338600. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:38,786][121949] Avg episode reward: [(0, '5922.037'), (1, '5609.808')] [2023-12-26 02:02:38,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000308112_78880768.pth... [2023-12-26 02:02:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000307088_78618624.pth [2023-12-26 02:02:38,818][123090] Updated weights for policy 1, policy_version 306582 (0.0010) [2023-12-26 02:02:38,879][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000306592_78487552.pth... [2023-12-26 02:02:38,881][123090] Updated weights for policy 1, policy_version 306592 (0.0010) [2023-12-26 02:02:38,883][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000305536_78217216.pth [2023-12-26 02:02:39,048][123091] Updated weights for policy 0, policy_version 308116 (0.0009) [2023-12-26 02:02:39,096][123091] Updated weights for policy 0, policy_version 308126 (0.0009) [2023-12-26 02:02:39,160][123091] Updated weights for policy 0, policy_version 308136 (0.0009) [2023-12-26 02:02:39,733][123090] Updated weights for policy 1, policy_version 306602 (0.0009) [2023-12-26 02:02:39,793][123090] Updated weights for policy 1, policy_version 306612 (0.0010) [2023-12-26 02:02:39,862][123090] Updated weights for policy 1, policy_version 306622 (0.0011) [2023-12-26 02:02:40,033][123091] Updated weights for policy 0, policy_version 308146 (0.0009) [2023-12-26 02:02:40,101][123091] Updated weights for policy 0, policy_version 308156 (0.0011) [2023-12-26 02:02:40,173][123091] Updated weights for policy 0, policy_version 308166 (0.0011) [2023-12-26 02:02:40,238][123091] Updated weights for policy 0, policy_version 308176 (0.0011) [2023-12-26 02:02:40,700][123090] Updated weights for policy 1, policy_version 306632 (0.0006) [2023-12-26 02:02:40,769][123090] Updated weights for policy 1, policy_version 306642 (0.0005) [2023-12-26 02:02:40,844][123090] Updated weights for policy 1, policy_version 306652 (0.0005) [2023-12-26 02:02:41,046][123091] Updated weights for policy 0, policy_version 308186 (0.0009) [2023-12-26 02:02:41,113][123091] Updated weights for policy 0, policy_version 308196 (0.0010) [2023-12-26 02:02:41,169][123091] Updated weights for policy 0, policy_version 308206 (0.0007) [2023-12-26 02:02:41,618][123090] Updated weights for policy 1, policy_version 306662 (0.0009) [2023-12-26 02:02:41,689][123090] Updated weights for policy 1, policy_version 306672 (0.0009) [2023-12-26 02:02:41,759][123090] Updated weights for policy 1, policy_version 306682 (0.0009) [2023-12-26 02:02:41,965][123091] Updated weights for policy 0, policy_version 308216 (0.0008) [2023-12-26 02:02:42,031][123091] Updated weights for policy 0, policy_version 308226 (0.0010) [2023-12-26 02:02:42,101][123091] Updated weights for policy 0, policy_version 308236 (0.0010) [2023-12-26 02:02:42,588][123090] Updated weights for policy 1, policy_version 306692 (0.0008) [2023-12-26 02:02:42,648][123090] Updated weights for policy 1, policy_version 306702 (0.0006) [2023-12-26 02:02:42,721][123090] Updated weights for policy 1, policy_version 306712 (0.0006) [2023-12-26 02:02:42,907][123091] Updated weights for policy 0, policy_version 308246 (0.0010) [2023-12-26 02:02:42,962][123091] Updated weights for policy 0, policy_version 308256 (0.0005) [2023-12-26 02:02:43,025][123091] Updated weights for policy 0, policy_version 308266 (0.0006) [2023-12-26 02:02:43,456][123090] Updated weights for policy 1, policy_version 306722 (0.0009) [2023-12-26 02:02:43,517][123090] Updated weights for policy 1, policy_version 306732 (0.0010) [2023-12-26 02:02:43,582][123090] Updated weights for policy 1, policy_version 306742 (0.0009) [2023-12-26 02:02:43,637][123090] Updated weights for policy 1, policy_version 306752 (0.0009) [2023-12-26 02:02:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 157450240. Throughput: 0: 8855.2, 1: 8780.5. Samples: 157443408. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:43,785][121949] Avg episode reward: [(0, '6063.536'), (1, '5684.123')] [2023-12-26 02:02:43,865][123091] Updated weights for policy 0, policy_version 308276 (0.0009) [2023-12-26 02:02:43,919][123091] Updated weights for policy 0, policy_version 308286 (0.0010) [2023-12-26 02:02:43,977][123091] Updated weights for policy 0, policy_version 308297 (0.0010) [2023-12-26 02:02:44,273][123090] Updated weights for policy 1, policy_version 306762 (0.0005) [2023-12-26 02:02:44,344][123090] Updated weights for policy 1, policy_version 306772 (0.0006) [2023-12-26 02:02:44,399][123090] Updated weights for policy 1, policy_version 306782 (0.0005) [2023-12-26 02:02:44,901][123091] Updated weights for policy 0, policy_version 308307 (0.0010) [2023-12-26 02:02:44,955][123091] Updated weights for policy 0, policy_version 308317 (0.0009) [2023-12-26 02:02:45,013][123091] Updated weights for policy 0, policy_version 308327 (0.0009) [2023-12-26 02:02:45,118][123090] Updated weights for policy 1, policy_version 306792 (0.0009) [2023-12-26 02:02:45,184][123090] Updated weights for policy 1, policy_version 306802 (0.0010) [2023-12-26 02:02:45,256][123090] Updated weights for policy 1, policy_version 306812 (0.0012) [2023-12-26 02:02:45,882][123091] Updated weights for policy 0, policy_version 308337 (0.0009) [2023-12-26 02:02:45,945][123091] Updated weights for policy 0, policy_version 308347 (0.0009) [2023-12-26 02:02:45,993][123091] Updated weights for policy 0, policy_version 308357 (0.0008) [2023-12-26 02:02:46,047][123091] Updated weights for policy 0, policy_version 308367 (0.0009) [2023-12-26 02:02:46,074][123090] Updated weights for policy 1, policy_version 306822 (0.0009) [2023-12-26 02:02:46,126][123090] Updated weights for policy 1, policy_version 306832 (0.0008) [2023-12-26 02:02:46,186][123090] Updated weights for policy 1, policy_version 306842 (0.0009) [2023-12-26 02:02:46,877][123091] Updated weights for policy 0, policy_version 308377 (0.0006) [2023-12-26 02:02:46,920][123090] Updated weights for policy 1, policy_version 306852 (0.0008) [2023-12-26 02:02:46,928][123091] Updated weights for policy 0, policy_version 308387 (0.0006) [2023-12-26 02:02:46,976][123090] Updated weights for policy 1, policy_version 306862 (0.0009) [2023-12-26 02:02:46,983][123091] Updated weights for policy 0, policy_version 308397 (0.0007) [2023-12-26 02:02:47,023][123090] Updated weights for policy 1, policy_version 306872 (0.0009) [2023-12-26 02:02:47,820][123091] Updated weights for policy 0, policy_version 308407 (0.0008) [2023-12-26 02:02:47,849][123090] Updated weights for policy 1, policy_version 306882 (0.0009) [2023-12-26 02:02:47,877][123091] Updated weights for policy 0, policy_version 308417 (0.0008) [2023-12-26 02:02:47,906][123090] Updated weights for policy 1, policy_version 306892 (0.0008) [2023-12-26 02:02:47,936][123091] Updated weights for policy 0, policy_version 308427 (0.0006) [2023-12-26 02:02:47,966][123090] Updated weights for policy 1, policy_version 306902 (0.0008) [2023-12-26 02:02:48,027][123090] Updated weights for policy 1, policy_version 306912 (0.0009) [2023-12-26 02:02:48,748][123091] Updated weights for policy 0, policy_version 308437 (0.0009) [2023-12-26 02:02:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 157532160. Throughput: 0: 8839.9, 1: 8875.3. Samples: 157549344. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:48,785][121949] Avg episode reward: [(0, '6094.944'), (1, '5770.526')] [2023-12-26 02:02:48,817][123091] Updated weights for policy 0, policy_version 308447 (0.0007) [2023-12-26 02:02:48,879][123090] Updated weights for policy 1, policy_version 306922 (0.0006) [2023-12-26 02:02:48,887][123091] Updated weights for policy 0, policy_version 308457 (0.0009) [2023-12-26 02:02:48,929][123090] Updated weights for policy 1, policy_version 306932 (0.0005) [2023-12-26 02:02:48,981][123090] Updated weights for policy 1, policy_version 306942 (0.0007) [2023-12-26 02:02:49,600][123091] Updated weights for policy 0, policy_version 308467 (0.0007) [2023-12-26 02:02:49,656][123091] Updated weights for policy 0, policy_version 308477 (0.0009) [2023-12-26 02:02:49,715][123091] Updated weights for policy 0, policy_version 308487 (0.0010) [2023-12-26 02:02:49,860][123090] Updated weights for policy 1, policy_version 306952 (0.0010) [2023-12-26 02:02:49,927][123090] Updated weights for policy 1, policy_version 306962 (0.0010) [2023-12-26 02:02:49,988][123090] Updated weights for policy 1, policy_version 306972 (0.0010) [2023-12-26 02:02:50,519][123091] Updated weights for policy 0, policy_version 308497 (0.0010) [2023-12-26 02:02:50,583][123091] Updated weights for policy 0, policy_version 308507 (0.0008) [2023-12-26 02:02:50,651][123091] Updated weights for policy 0, policy_version 308517 (0.0007) [2023-12-26 02:02:50,718][123091] Updated weights for policy 0, policy_version 308527 (0.0010) [2023-12-26 02:02:50,882][123090] Updated weights for policy 1, policy_version 306982 (0.0009) [2023-12-26 02:02:50,950][123090] Updated weights for policy 1, policy_version 306992 (0.0009) [2023-12-26 02:02:51,024][123090] Updated weights for policy 1, policy_version 307002 (0.0009) [2023-12-26 02:02:51,480][123091] Updated weights for policy 0, policy_version 308537 (0.0009) [2023-12-26 02:02:51,534][123091] Updated weights for policy 0, policy_version 308547 (0.0010) [2023-12-26 02:02:51,590][123091] Updated weights for policy 0, policy_version 308557 (0.0009) [2023-12-26 02:02:51,809][123090] Updated weights for policy 1, policy_version 307012 (0.0010) [2023-12-26 02:02:51,876][123090] Updated weights for policy 1, policy_version 307022 (0.0009) [2023-12-26 02:02:51,951][123090] Updated weights for policy 1, policy_version 307032 (0.0009) [2023-12-26 02:02:52,445][123091] Updated weights for policy 0, policy_version 308567 (0.0010) [2023-12-26 02:02:52,502][123091] Updated weights for policy 0, policy_version 308577 (0.0010) [2023-12-26 02:02:52,570][123091] Updated weights for policy 0, policy_version 308587 (0.0009) [2023-12-26 02:02:52,788][123090] Updated weights for policy 1, policy_version 307042 (0.0009) [2023-12-26 02:02:52,849][123090] Updated weights for policy 1, policy_version 307052 (0.0009) [2023-12-26 02:02:52,914][123090] Updated weights for policy 1, policy_version 307062 (0.0009) [2023-12-26 02:02:53,357][123091] Updated weights for policy 0, policy_version 308597 (0.0007) [2023-12-26 02:02:53,420][123091] Updated weights for policy 0, policy_version 308607 (0.0005) [2023-12-26 02:02:53,477][123091] Updated weights for policy 0, policy_version 308617 (0.0005) [2023-12-26 02:02:53,750][123090] Updated weights for policy 1, policy_version 307073 (0.0010) [2023-12-26 02:02:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 157622272. Throughput: 0: 8834.9, 1: 8859.0. Samples: 157600772. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:53,785][121949] Avg episode reward: [(0, '6007.408'), (1, '5722.212')] [2023-12-26 02:02:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000308624_79011840.pth... [2023-12-26 02:02:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000307568_78741504.pth [2023-12-26 02:02:53,809][123090] Updated weights for policy 1, policy_version 307083 (0.0006) [2023-12-26 02:02:53,867][123090] Updated weights for policy 1, policy_version 307093 (0.0010) [2023-12-26 02:02:53,934][123090] Updated weights for policy 1, policy_version 307103 (0.0010) [2023-12-26 02:02:53,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000307104_78618624.pth... [2023-12-26 02:02:53,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000306048_78348288.pth [2023-12-26 02:02:54,099][123091] Updated weights for policy 0, policy_version 308627 (0.0005) [2023-12-26 02:02:54,159][123091] Updated weights for policy 0, policy_version 308637 (0.0006) [2023-12-26 02:02:54,225][123091] Updated weights for policy 0, policy_version 308647 (0.0005) [2023-12-26 02:02:54,715][123090] Updated weights for policy 1, policy_version 307113 (0.0011) [2023-12-26 02:02:54,781][123090] Updated weights for policy 1, policy_version 307123 (0.0010) [2023-12-26 02:02:54,839][123090] Updated weights for policy 1, policy_version 307133 (0.0010) [2023-12-26 02:02:54,890][123091] Updated weights for policy 0, policy_version 308657 (0.0006) [2023-12-26 02:02:54,961][123091] Updated weights for policy 0, policy_version 308667 (0.0009) [2023-12-26 02:02:55,016][123091] Updated weights for policy 0, policy_version 308677 (0.0009) [2023-12-26 02:02:55,074][123091] Updated weights for policy 0, policy_version 308687 (0.0009) [2023-12-26 02:02:55,668][123090] Updated weights for policy 1, policy_version 307143 (0.0008) [2023-12-26 02:02:55,711][123090] Updated weights for policy 1, policy_version 307153 (0.0005) [2023-12-26 02:02:55,757][123090] Updated weights for policy 1, policy_version 307163 (0.0005) [2023-12-26 02:02:55,828][123091] Updated weights for policy 0, policy_version 308697 (0.0009) [2023-12-26 02:02:55,889][123091] Updated weights for policy 0, policy_version 308707 (0.0007) [2023-12-26 02:02:55,945][123091] Updated weights for policy 0, policy_version 308717 (0.0005) [2023-12-26 02:02:56,534][123090] Updated weights for policy 1, policy_version 307173 (0.0008) [2023-12-26 02:02:56,594][123090] Updated weights for policy 1, policy_version 307183 (0.0009) [2023-12-26 02:02:56,645][123090] Updated weights for policy 1, policy_version 307193 (0.0008) [2023-12-26 02:02:56,726][123091] Updated weights for policy 0, policy_version 308727 (0.0006) [2023-12-26 02:02:56,794][123091] Updated weights for policy 0, policy_version 308737 (0.0008) [2023-12-26 02:02:56,861][123091] Updated weights for policy 0, policy_version 308747 (0.0006) [2023-12-26 02:02:57,328][123090] Updated weights for policy 1, policy_version 307203 (0.0005) [2023-12-26 02:02:57,380][123090] Updated weights for policy 1, policy_version 307213 (0.0005) [2023-12-26 02:02:57,428][123090] Updated weights for policy 1, policy_version 307223 (0.0005) [2023-12-26 02:02:57,529][123091] Updated weights for policy 0, policy_version 308757 (0.0008) [2023-12-26 02:02:57,586][123091] Updated weights for policy 0, policy_version 308767 (0.0008) [2023-12-26 02:02:57,653][123091] Updated weights for policy 0, policy_version 308777 (0.0007) [2023-12-26 02:02:58,052][123090] Updated weights for policy 1, policy_version 307233 (0.0005) [2023-12-26 02:02:58,116][123090] Updated weights for policy 1, policy_version 307243 (0.0006) [2023-12-26 02:02:58,172][123090] Updated weights for policy 1, policy_version 307253 (0.0009) [2023-12-26 02:02:58,239][123090] Updated weights for policy 1, policy_version 307263 (0.0009) [2023-12-26 02:02:58,435][123091] Updated weights for policy 0, policy_version 308787 (0.0008) [2023-12-26 02:02:58,501][123091] Updated weights for policy 0, policy_version 308797 (0.0008) [2023-12-26 02:02:58,569][123091] Updated weights for policy 0, policy_version 308807 (0.0008) [2023-12-26 02:02:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 157720576. Throughput: 0: 8939.5, 1: 8852.7. Samples: 157712156. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:02:58,785][121949] Avg episode reward: [(0, '5932.290'), (1, '5740.201')] [2023-12-26 02:02:59,132][123090] Updated weights for policy 1, policy_version 307273 (0.0006) [2023-12-26 02:02:59,197][123090] Updated weights for policy 1, policy_version 307283 (0.0008) [2023-12-26 02:02:59,262][123090] Updated weights for policy 1, policy_version 307293 (0.0009) [2023-12-26 02:02:59,431][123091] Updated weights for policy 0, policy_version 308817 (0.0008) [2023-12-26 02:02:59,494][123091] Updated weights for policy 0, policy_version 308827 (0.0005) [2023-12-26 02:02:59,562][123091] Updated weights for policy 0, policy_version 308837 (0.0006) [2023-12-26 02:02:59,624][123091] Updated weights for policy 0, policy_version 308847 (0.0006) [2023-12-26 02:03:00,044][123090] Updated weights for policy 1, policy_version 307303 (0.0007) [2023-12-26 02:03:00,092][123090] Updated weights for policy 1, policy_version 307313 (0.0008) [2023-12-26 02:03:00,140][123090] Updated weights for policy 1, policy_version 307323 (0.0008) [2023-12-26 02:03:00,395][123091] Updated weights for policy 0, policy_version 308857 (0.0006) [2023-12-26 02:03:00,471][123091] Updated weights for policy 0, policy_version 308867 (0.0005) [2023-12-26 02:03:00,536][123091] Updated weights for policy 0, policy_version 308877 (0.0005) [2023-12-26 02:03:00,905][123090] Updated weights for policy 1, policy_version 307333 (0.0007) [2023-12-26 02:03:00,975][123090] Updated weights for policy 1, policy_version 307343 (0.0005) [2023-12-26 02:03:01,049][123090] Updated weights for policy 1, policy_version 307353 (0.0007) [2023-12-26 02:03:01,093][123091] Updated weights for policy 0, policy_version 308887 (0.0006) [2023-12-26 02:03:01,151][123091] Updated weights for policy 0, policy_version 308897 (0.0007) [2023-12-26 02:03:01,225][123091] Updated weights for policy 0, policy_version 308907 (0.0008) [2023-12-26 02:03:01,805][123090] Updated weights for policy 1, policy_version 307363 (0.0010) [2023-12-26 02:03:01,864][123090] Updated weights for policy 1, policy_version 307373 (0.0008) [2023-12-26 02:03:01,930][123090] Updated weights for policy 1, policy_version 307383 (0.0009) [2023-12-26 02:03:02,008][123091] Updated weights for policy 0, policy_version 308917 (0.0009) [2023-12-26 02:03:02,064][123091] Updated weights for policy 0, policy_version 308927 (0.0009) [2023-12-26 02:03:02,117][123091] Updated weights for policy 0, policy_version 308937 (0.0009) [2023-12-26 02:03:02,757][123090] Updated weights for policy 1, policy_version 307393 (0.0009) [2023-12-26 02:03:02,828][123090] Updated weights for policy 1, policy_version 307403 (0.0005) [2023-12-26 02:03:02,895][123090] Updated weights for policy 1, policy_version 307413 (0.0005) [2023-12-26 02:03:02,901][123091] Updated weights for policy 0, policy_version 308947 (0.0007) [2023-12-26 02:03:02,956][123090] Updated weights for policy 1, policy_version 307423 (0.0007) [2023-12-26 02:03:02,967][123091] Updated weights for policy 0, policy_version 308957 (0.0011) [2023-12-26 02:03:03,032][123091] Updated weights for policy 0, policy_version 308967 (0.0007) [2023-12-26 02:03:03,711][123090] Updated weights for policy 1, policy_version 307433 (0.0010) [2023-12-26 02:03:03,754][123090] Updated weights for policy 1, policy_version 307443 (0.0010) [2023-12-26 02:03:03,777][123091] Updated weights for policy 0, policy_version 308977 (0.0010) [2023-12-26 02:03:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 157802496. Throughput: 0: 9024.0, 1: 8803.1. Samples: 157820992. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:03,785][121949] Avg episode reward: [(0, '5971.777'), (1, '5694.799')] [2023-12-26 02:03:03,812][123090] Updated weights for policy 1, policy_version 307453 (0.0010) [2023-12-26 02:03:03,837][123091] Updated weights for policy 0, policy_version 308987 (0.0006) [2023-12-26 02:03:03,906][123091] Updated weights for policy 0, policy_version 308997 (0.0009) [2023-12-26 02:03:03,972][123091] Updated weights for policy 0, policy_version 309007 (0.0009) [2023-12-26 02:03:04,666][123090] Updated weights for policy 1, policy_version 307463 (0.0011) [2023-12-26 02:03:04,715][123090] Updated weights for policy 1, policy_version 307473 (0.0011) [2023-12-26 02:03:04,769][123091] Updated weights for policy 0, policy_version 309017 (0.0006) [2023-12-26 02:03:04,778][123090] Updated weights for policy 1, policy_version 307483 (0.0010) [2023-12-26 02:03:04,825][123091] Updated weights for policy 0, policy_version 309027 (0.0008) [2023-12-26 02:03:04,873][123091] Updated weights for policy 0, policy_version 309037 (0.0009) [2023-12-26 02:03:05,566][123090] Updated weights for policy 1, policy_version 307493 (0.0008) [2023-12-26 02:03:05,613][123090] Updated weights for policy 1, policy_version 307503 (0.0005) [2023-12-26 02:03:05,680][123090] Updated weights for policy 1, policy_version 307513 (0.0005) [2023-12-26 02:03:05,744][123091] Updated weights for policy 0, policy_version 309047 (0.0009) [2023-12-26 02:03:05,797][123091] Updated weights for policy 0, policy_version 309057 (0.0010) [2023-12-26 02:03:05,854][123091] Updated weights for policy 0, policy_version 309067 (0.0010) [2023-12-26 02:03:06,430][123090] Updated weights for policy 1, policy_version 307523 (0.0007) [2023-12-26 02:03:06,500][123090] Updated weights for policy 1, policy_version 307533 (0.0010) [2023-12-26 02:03:06,567][123090] Updated weights for policy 1, policy_version 307543 (0.0010) [2023-12-26 02:03:06,764][123091] Updated weights for policy 0, policy_version 309077 (0.0010) [2023-12-26 02:03:06,828][123091] Updated weights for policy 0, policy_version 309087 (0.0010) [2023-12-26 02:03:06,895][123091] Updated weights for policy 0, policy_version 309097 (0.0009) [2023-12-26 02:03:07,381][123090] Updated weights for policy 1, policy_version 307553 (0.0008) [2023-12-26 02:03:07,436][123090] Updated weights for policy 1, policy_version 307563 (0.0010) [2023-12-26 02:03:07,495][123090] Updated weights for policy 1, policy_version 307573 (0.0009) [2023-12-26 02:03:07,549][123090] Updated weights for policy 1, policy_version 307583 (0.0009) [2023-12-26 02:03:07,732][123091] Updated weights for policy 0, policy_version 309107 (0.0010) [2023-12-26 02:03:07,789][123091] Updated weights for policy 0, policy_version 309117 (0.0008) [2023-12-26 02:03:07,852][123091] Updated weights for policy 0, policy_version 309127 (0.0008) [2023-12-26 02:03:08,386][123090] Updated weights for policy 1, policy_version 307593 (0.0008) [2023-12-26 02:03:08,447][123090] Updated weights for policy 1, policy_version 307603 (0.0010) [2023-12-26 02:03:08,516][123090] Updated weights for policy 1, policy_version 307613 (0.0008) [2023-12-26 02:03:08,516][123091] Updated weights for policy 0, policy_version 309137 (0.0006) [2023-12-26 02:03:08,569][123091] Updated weights for policy 0, policy_version 309147 (0.0006) [2023-12-26 02:03:08,632][123091] Updated weights for policy 0, policy_version 309157 (0.0006) [2023-12-26 02:03:08,707][123091] Updated weights for policy 0, policy_version 309167 (0.0005) [2023-12-26 02:03:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 157900800. Throughput: 0: 8997.5, 1: 8850.5. Samples: 157872972. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:08,785][121949] Avg episode reward: [(0, '5896.410'), (1, '5700.140')] [2023-12-26 02:03:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000309168_79151104.pth... [2023-12-26 02:03:08,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000307616_78749696.pth... [2023-12-26 02:03:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000308112_78880768.pth [2023-12-26 02:03:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000306592_78487552.pth [2023-12-26 02:03:09,246][123090] Updated weights for policy 1, policy_version 307623 (0.0008) [2023-12-26 02:03:09,302][123090] Updated weights for policy 1, policy_version 307633 (0.0010) [2023-12-26 02:03:09,368][123090] Updated weights for policy 1, policy_version 307643 (0.0010) [2023-12-26 02:03:09,531][123091] Updated weights for policy 0, policy_version 309177 (0.0010) [2023-12-26 02:03:09,607][123091] Updated weights for policy 0, policy_version 309187 (0.0009) [2023-12-26 02:03:09,674][123091] Updated weights for policy 0, policy_version 309197 (0.0009) [2023-12-26 02:03:10,143][123090] Updated weights for policy 1, policy_version 307653 (0.0009) [2023-12-26 02:03:10,212][123090] Updated weights for policy 1, policy_version 307663 (0.0009) [2023-12-26 02:03:10,285][123090] Updated weights for policy 1, policy_version 307673 (0.0010) [2023-12-26 02:03:10,524][123091] Updated weights for policy 0, policy_version 309207 (0.0007) [2023-12-26 02:03:10,576][123091] Updated weights for policy 0, policy_version 309217 (0.0006) [2023-12-26 02:03:10,645][123091] Updated weights for policy 0, policy_version 309227 (0.0005) [2023-12-26 02:03:11,116][123090] Updated weights for policy 1, policy_version 307683 (0.0010) [2023-12-26 02:03:11,187][123090] Updated weights for policy 1, policy_version 307693 (0.0009) [2023-12-26 02:03:11,245][123090] Updated weights for policy 1, policy_version 307703 (0.0009) [2023-12-26 02:03:11,434][123091] Updated weights for policy 0, policy_version 309237 (0.0008) [2023-12-26 02:03:11,491][123091] Updated weights for policy 0, policy_version 309247 (0.0010) [2023-12-26 02:03:11,546][123091] Updated weights for policy 0, policy_version 309257 (0.0010) [2023-12-26 02:03:12,039][123090] Updated weights for policy 1, policy_version 307713 (0.0008) [2023-12-26 02:03:12,101][123090] Updated weights for policy 1, policy_version 307723 (0.0005) [2023-12-26 02:03:12,151][123090] Updated weights for policy 1, policy_version 307733 (0.0005) [2023-12-26 02:03:12,200][123090] Updated weights for policy 1, policy_version 307743 (0.0006) [2023-12-26 02:03:12,414][123091] Updated weights for policy 0, policy_version 309267 (0.0009) [2023-12-26 02:03:12,473][123091] Updated weights for policy 0, policy_version 309277 (0.0009) [2023-12-26 02:03:12,537][123091] Updated weights for policy 0, policy_version 309287 (0.0010) [2023-12-26 02:03:12,951][123090] Updated weights for policy 1, policy_version 307753 (0.0007) [2023-12-26 02:03:13,013][123090] Updated weights for policy 1, policy_version 307763 (0.0005) [2023-12-26 02:03:13,075][123090] Updated weights for policy 1, policy_version 307773 (0.0005) [2023-12-26 02:03:13,442][123091] Updated weights for policy 0, policy_version 309297 (0.0010) [2023-12-26 02:03:13,512][123091] Updated weights for policy 0, policy_version 309307 (0.0009) [2023-12-26 02:03:13,567][123091] Updated weights for policy 0, policy_version 309317 (0.0009) [2023-12-26 02:03:13,615][123091] Updated weights for policy 0, policy_version 309327 (0.0009) [2023-12-26 02:03:13,775][123090] Updated weights for policy 1, policy_version 307783 (0.0008) [2023-12-26 02:03:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 157982720. Throughput: 0: 8934.8, 1: 8911.4. Samples: 157977280. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:13,785][121949] Avg episode reward: [(0, '6013.618'), (1, '5829.524')] [2023-12-26 02:03:13,830][123090] Updated weights for policy 1, policy_version 307793 (0.0009) [2023-12-26 02:03:13,889][123090] Updated weights for policy 1, policy_version 307803 (0.0010) [2023-12-26 02:03:14,327][123091] Updated weights for policy 0, policy_version 309337 (0.0010) [2023-12-26 02:03:14,383][123091] Updated weights for policy 0, policy_version 309347 (0.0009) [2023-12-26 02:03:14,437][123091] Updated weights for policy 0, policy_version 309357 (0.0009) [2023-12-26 02:03:14,744][123090] Updated weights for policy 1, policy_version 307814 (0.0010) [2023-12-26 02:03:14,818][123090] Updated weights for policy 1, policy_version 307824 (0.0008) [2023-12-26 02:03:14,878][123090] Updated weights for policy 1, policy_version 307834 (0.0009) [2023-12-26 02:03:15,317][123091] Updated weights for policy 0, policy_version 309367 (0.0010) [2023-12-26 02:03:15,372][123091] Updated weights for policy 0, policy_version 309377 (0.0010) [2023-12-26 02:03:15,432][123091] Updated weights for policy 0, policy_version 309387 (0.0010) [2023-12-26 02:03:15,626][123090] Updated weights for policy 1, policy_version 307844 (0.0009) [2023-12-26 02:03:15,678][123090] Updated weights for policy 1, policy_version 307854 (0.0009) [2023-12-26 02:03:15,738][123090] Updated weights for policy 1, policy_version 307864 (0.0009) [2023-12-26 02:03:16,314][123091] Updated weights for policy 0, policy_version 309397 (0.0010) [2023-12-26 02:03:16,381][123091] Updated weights for policy 0, policy_version 309407 (0.0008) [2023-12-26 02:03:16,452][123091] Updated weights for policy 0, policy_version 309417 (0.0009) [2023-12-26 02:03:16,564][123090] Updated weights for policy 1, policy_version 307874 (0.0009) [2023-12-26 02:03:16,621][123090] Updated weights for policy 1, policy_version 307884 (0.0009) [2023-12-26 02:03:16,678][123090] Updated weights for policy 1, policy_version 307894 (0.0009) [2023-12-26 02:03:16,736][123090] Updated weights for policy 1, policy_version 307904 (0.0009) [2023-12-26 02:03:17,278][123091] Updated weights for policy 0, policy_version 309427 (0.0009) [2023-12-26 02:03:17,335][123091] Updated weights for policy 0, policy_version 309437 (0.0009) [2023-12-26 02:03:17,390][123091] Updated weights for policy 0, policy_version 309447 (0.0009) [2023-12-26 02:03:17,542][123090] Updated weights for policy 1, policy_version 307914 (0.0009) [2023-12-26 02:03:17,601][123090] Updated weights for policy 1, policy_version 307924 (0.0009) [2023-12-26 02:03:17,655][123090] Updated weights for policy 1, policy_version 307935 (0.0010) [2023-12-26 02:03:18,258][123091] Updated weights for policy 0, policy_version 309457 (0.0009) [2023-12-26 02:03:18,319][123091] Updated weights for policy 0, policy_version 309467 (0.0009) [2023-12-26 02:03:18,336][123090] Updated weights for policy 1, policy_version 307945 (0.0007) [2023-12-26 02:03:18,388][123091] Updated weights for policy 0, policy_version 309477 (0.0008) [2023-12-26 02:03:18,394][123090] Updated weights for policy 1, policy_version 307955 (0.0007) [2023-12-26 02:03:18,448][123091] Updated weights for policy 0, policy_version 309487 (0.0007) [2023-12-26 02:03:18,460][123090] Updated weights for policy 1, policy_version 307965 (0.0007) [2023-12-26 02:03:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 158072832. Throughput: 0: 8772.3, 1: 8911.0. Samples: 158082032. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:18,785][121949] Avg episode reward: [(0, '6069.629'), (1, '5785.702')] [2023-12-26 02:03:19,284][123090] Updated weights for policy 1, policy_version 307975 (0.0010) [2023-12-26 02:03:19,296][123091] Updated weights for policy 0, policy_version 309497 (0.0010) [2023-12-26 02:03:19,350][123090] Updated weights for policy 1, policy_version 307985 (0.0008) [2023-12-26 02:03:19,362][123091] Updated weights for policy 0, policy_version 309507 (0.0009) [2023-12-26 02:03:19,415][123090] Updated weights for policy 1, policy_version 307995 (0.0009) [2023-12-26 02:03:19,421][123091] Updated weights for policy 0, policy_version 309517 (0.0006) [2023-12-26 02:03:20,169][123091] Updated weights for policy 0, policy_version 309527 (0.0006) [2023-12-26 02:03:20,233][123091] Updated weights for policy 0, policy_version 309537 (0.0010) [2023-12-26 02:03:20,289][123090] Updated weights for policy 1, policy_version 308005 (0.0007) [2023-12-26 02:03:20,296][123091] Updated weights for policy 0, policy_version 309547 (0.0008) [2023-12-26 02:03:20,347][123090] Updated weights for policy 1, policy_version 308015 (0.0008) [2023-12-26 02:03:20,409][123090] Updated weights for policy 1, policy_version 308025 (0.0009) [2023-12-26 02:03:21,156][123091] Updated weights for policy 0, policy_version 309557 (0.0010) [2023-12-26 02:03:21,218][123091] Updated weights for policy 0, policy_version 309567 (0.0010) [2023-12-26 02:03:21,238][123090] Updated weights for policy 1, policy_version 308035 (0.0008) [2023-12-26 02:03:21,280][123091] Updated weights for policy 0, policy_version 309577 (0.0009) [2023-12-26 02:03:21,308][123090] Updated weights for policy 1, policy_version 308045 (0.0008) [2023-12-26 02:03:21,377][123090] Updated weights for policy 1, policy_version 308055 (0.0010) [2023-12-26 02:03:22,098][123091] Updated weights for policy 0, policy_version 309587 (0.0009) [2023-12-26 02:03:22,157][123091] Updated weights for policy 0, policy_version 309597 (0.0010) [2023-12-26 02:03:22,210][123091] Updated weights for policy 0, policy_version 309607 (0.0009) [2023-12-26 02:03:22,243][123090] Updated weights for policy 1, policy_version 308065 (0.0009) [2023-12-26 02:03:22,311][123090] Updated weights for policy 1, policy_version 308075 (0.0009) [2023-12-26 02:03:22,387][123090] Updated weights for policy 1, policy_version 308085 (0.0009) [2023-12-26 02:03:22,453][123090] Updated weights for policy 1, policy_version 308095 (0.0009) [2023-12-26 02:03:22,974][123091] Updated weights for policy 0, policy_version 309617 (0.0009) [2023-12-26 02:03:23,029][123091] Updated weights for policy 0, policy_version 309627 (0.0010) [2023-12-26 02:03:23,080][123091] Updated weights for policy 0, policy_version 309637 (0.0009) [2023-12-26 02:03:23,132][123091] Updated weights for policy 0, policy_version 309647 (0.0009) [2023-12-26 02:03:23,310][123090] Updated weights for policy 1, policy_version 308105 (0.0009) [2023-12-26 02:03:23,381][123090] Updated weights for policy 1, policy_version 308115 (0.0009) [2023-12-26 02:03:23,442][123090] Updated weights for policy 1, policy_version 308125 (0.0009) [2023-12-26 02:03:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 158154752. Throughput: 0: 8773.1, 1: 8878.9. Samples: 158132936. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:23,785][121949] Avg episode reward: [(0, '6005.757'), (1, '5745.601')] [2023-12-26 02:03:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000309648_79273984.pth... [2023-12-26 02:03:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000308128_78880768.pth... [2023-12-26 02:03:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000308624_79011840.pth [2023-12-26 02:03:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000307104_78618624.pth [2023-12-26 02:03:23,944][123091] Updated weights for policy 0, policy_version 309657 (0.0006) [2023-12-26 02:03:24,001][123091] Updated weights for policy 0, policy_version 309667 (0.0005) [2023-12-26 02:03:24,056][123091] Updated weights for policy 0, policy_version 309677 (0.0005) [2023-12-26 02:03:24,329][123090] Updated weights for policy 1, policy_version 308135 (0.0009) [2023-12-26 02:03:24,396][123090] Updated weights for policy 1, policy_version 308145 (0.0008) [2023-12-26 02:03:24,463][123090] Updated weights for policy 1, policy_version 308155 (0.0010) [2023-12-26 02:03:24,720][123091] Updated weights for policy 0, policy_version 309687 (0.0006) [2023-12-26 02:03:24,776][123091] Updated weights for policy 0, policy_version 309697 (0.0005) [2023-12-26 02:03:24,851][123091] Updated weights for policy 0, policy_version 309707 (0.0005) [2023-12-26 02:03:25,193][123090] Updated weights for policy 1, policy_version 308165 (0.0007) [2023-12-26 02:03:25,249][123090] Updated weights for policy 1, policy_version 308175 (0.0007) [2023-12-26 02:03:25,299][123090] Updated weights for policy 1, policy_version 308185 (0.0008) [2023-12-26 02:03:25,478][123091] Updated weights for policy 0, policy_version 309717 (0.0007) [2023-12-26 02:03:25,531][123091] Updated weights for policy 0, policy_version 309727 (0.0005) [2023-12-26 02:03:25,588][123091] Updated weights for policy 0, policy_version 309737 (0.0005) [2023-12-26 02:03:25,929][123090] Updated weights for policy 1, policy_version 308195 (0.0005) [2023-12-26 02:03:25,984][123090] Updated weights for policy 1, policy_version 308205 (0.0006) [2023-12-26 02:03:26,052][123090] Updated weights for policy 1, policy_version 308215 (0.0007) [2023-12-26 02:03:26,355][123091] Updated weights for policy 0, policy_version 309747 (0.0005) [2023-12-26 02:03:26,424][123091] Updated weights for policy 0, policy_version 309757 (0.0006) [2023-12-26 02:03:26,492][123091] Updated weights for policy 0, policy_version 309767 (0.0006) [2023-12-26 02:03:26,760][123090] Updated weights for policy 1, policy_version 308225 (0.0006) [2023-12-26 02:03:26,826][123090] Updated weights for policy 1, policy_version 308235 (0.0009) [2023-12-26 02:03:26,890][123090] Updated weights for policy 1, policy_version 308245 (0.0006) [2023-12-26 02:03:26,956][123090] Updated weights for policy 1, policy_version 308255 (0.0007) [2023-12-26 02:03:27,143][123091] Updated weights for policy 0, policy_version 309777 (0.0006) [2023-12-26 02:03:27,200][123091] Updated weights for policy 0, policy_version 309787 (0.0005) [2023-12-26 02:03:27,243][123091] Updated weights for policy 0, policy_version 309797 (0.0005) [2023-12-26 02:03:27,295][123091] Updated weights for policy 0, policy_version 309807 (0.0006) [2023-12-26 02:03:27,670][123090] Updated weights for policy 1, policy_version 308265 (0.0007) [2023-12-26 02:03:27,735][123090] Updated weights for policy 1, policy_version 308275 (0.0006) [2023-12-26 02:03:27,795][123090] Updated weights for policy 1, policy_version 308285 (0.0008) [2023-12-26 02:03:27,979][123091] Updated weights for policy 0, policy_version 309817 (0.0008) [2023-12-26 02:03:28,034][123091] Updated weights for policy 0, policy_version 309827 (0.0006) [2023-12-26 02:03:28,102][123091] Updated weights for policy 0, policy_version 309837 (0.0006) [2023-12-26 02:03:28,549][123090] Updated weights for policy 1, policy_version 308295 (0.0008) [2023-12-26 02:03:28,619][123090] Updated weights for policy 1, policy_version 308305 (0.0007) [2023-12-26 02:03:28,694][123090] Updated weights for policy 1, policy_version 308315 (0.0006) [2023-12-26 02:03:28,775][123091] Updated weights for policy 0, policy_version 309847 (0.0008) [2023-12-26 02:03:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17605.9). Total num frames: 158253056. Throughput: 0: 8889.1, 1: 8911.6. Samples: 158244444. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:28,785][121949] Avg episode reward: [(0, '6001.498'), (1, '5723.194')] [2023-12-26 02:03:28,843][123091] Updated weights for policy 0, policy_version 309857 (0.0008) [2023-12-26 02:03:28,914][123091] Updated weights for policy 0, policy_version 309867 (0.0011) [2023-12-26 02:03:29,481][123090] Updated weights for policy 1, policy_version 308325 (0.0007) [2023-12-26 02:03:29,552][123090] Updated weights for policy 1, policy_version 308335 (0.0009) [2023-12-26 02:03:29,620][123090] Updated weights for policy 1, policy_version 308345 (0.0009) [2023-12-26 02:03:29,726][123091] Updated weights for policy 0, policy_version 309877 (0.0011) [2023-12-26 02:03:29,788][123091] Updated weights for policy 0, policy_version 309887 (0.0011) [2023-12-26 02:03:29,854][123091] Updated weights for policy 0, policy_version 309897 (0.0011) [2023-12-26 02:03:30,463][123090] Updated weights for policy 1, policy_version 308355 (0.0009) [2023-12-26 02:03:30,516][123090] Updated weights for policy 1, policy_version 308365 (0.0010) [2023-12-26 02:03:30,575][123090] Updated weights for policy 1, policy_version 308375 (0.0010) [2023-12-26 02:03:30,590][123091] Updated weights for policy 0, policy_version 309907 (0.0009) [2023-12-26 02:03:30,648][123091] Updated weights for policy 0, policy_version 309917 (0.0008) [2023-12-26 02:03:30,715][123091] Updated weights for policy 0, policy_version 309927 (0.0009) [2023-12-26 02:03:31,460][123090] Updated weights for policy 1, policy_version 308385 (0.0010) [2023-12-26 02:03:31,516][123091] Updated weights for policy 0, policy_version 309937 (0.0008) [2023-12-26 02:03:31,517][123090] Updated weights for policy 1, policy_version 308395 (0.0010) [2023-12-26 02:03:31,566][123090] Updated weights for policy 1, policy_version 308405 (0.0009) [2023-12-26 02:03:31,570][123091] Updated weights for policy 0, policy_version 309947 (0.0005) [2023-12-26 02:03:31,621][123090] Updated weights for policy 1, policy_version 308416 (0.0009) [2023-12-26 02:03:31,625][123091] Updated weights for policy 0, policy_version 309957 (0.0005) [2023-12-26 02:03:31,688][123091] Updated weights for policy 0, policy_version 309967 (0.0006) [2023-12-26 02:03:32,403][123091] Updated weights for policy 0, policy_version 309977 (0.0010) [2023-12-26 02:03:32,418][123090] Updated weights for policy 1, policy_version 308426 (0.0006) [2023-12-26 02:03:32,463][123091] Updated weights for policy 0, policy_version 309987 (0.0011) [2023-12-26 02:03:32,482][123090] Updated weights for policy 1, policy_version 308436 (0.0006) [2023-12-26 02:03:32,533][123091] Updated weights for policy 0, policy_version 309997 (0.0011) [2023-12-26 02:03:32,544][123090] Updated weights for policy 1, policy_version 308446 (0.0006) [2023-12-26 02:03:33,337][123091] Updated weights for policy 0, policy_version 310007 (0.0010) [2023-12-26 02:03:33,375][123090] Updated weights for policy 1, policy_version 308456 (0.0007) [2023-12-26 02:03:33,392][123091] Updated weights for policy 0, policy_version 310017 (0.0008) [2023-12-26 02:03:33,426][123090] Updated weights for policy 1, policy_version 308466 (0.0008) [2023-12-26 02:03:33,441][123091] Updated weights for policy 0, policy_version 310027 (0.0010) [2023-12-26 02:03:33,493][123090] Updated weights for policy 1, policy_version 308476 (0.0007) [2023-12-26 02:03:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 158343168. Throughput: 0: 9008.5, 1: 8830.0. Samples: 158352080. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:33,785][121949] Avg episode reward: [(0, '6039.306'), (1, '5638.627')] [2023-12-26 02:03:34,247][123091] Updated weights for policy 0, policy_version 310037 (0.0009) [2023-12-26 02:03:34,265][123090] Updated weights for policy 1, policy_version 308486 (0.0008) [2023-12-26 02:03:34,316][123091] Updated weights for policy 0, policy_version 310047 (0.0009) [2023-12-26 02:03:34,332][123090] Updated weights for policy 1, policy_version 308496 (0.0009) [2023-12-26 02:03:34,367][123091] Updated weights for policy 0, policy_version 310057 (0.0011) [2023-12-26 02:03:34,396][123090] Updated weights for policy 1, policy_version 308506 (0.0007) [2023-12-26 02:03:35,173][123091] Updated weights for policy 0, policy_version 310067 (0.0010) [2023-12-26 02:03:35,178][123090] Updated weights for policy 1, policy_version 308516 (0.0007) [2023-12-26 02:03:35,228][123091] Updated weights for policy 0, policy_version 310077 (0.0007) [2023-12-26 02:03:35,251][123090] Updated weights for policy 1, policy_version 308526 (0.0005) [2023-12-26 02:03:35,277][123091] Updated weights for policy 0, policy_version 310087 (0.0006) [2023-12-26 02:03:35,322][123090] Updated weights for policy 1, policy_version 308536 (0.0006) [2023-12-26 02:03:35,868][123091] Updated weights for policy 0, policy_version 310097 (0.0008) [2023-12-26 02:03:35,926][123091] Updated weights for policy 0, policy_version 310107 (0.0006) [2023-12-26 02:03:35,982][123091] Updated weights for policy 0, policy_version 310117 (0.0007) [2023-12-26 02:03:36,043][123091] Updated weights for policy 0, policy_version 310127 (0.0008) [2023-12-26 02:03:36,121][123090] Updated weights for policy 1, policy_version 308546 (0.0009) [2023-12-26 02:03:36,185][123090] Updated weights for policy 1, policy_version 308556 (0.0010) [2023-12-26 02:03:36,251][123090] Updated weights for policy 1, policy_version 308566 (0.0010) [2023-12-26 02:03:36,320][123090] Updated weights for policy 1, policy_version 308576 (0.0008) [2023-12-26 02:03:36,840][123091] Updated weights for policy 0, policy_version 310137 (0.0010) [2023-12-26 02:03:36,889][123091] Updated weights for policy 0, policy_version 310147 (0.0011) [2023-12-26 02:03:36,940][123091] Updated weights for policy 0, policy_version 310157 (0.0010) [2023-12-26 02:03:37,151][123090] Updated weights for policy 1, policy_version 308586 (0.0009) [2023-12-26 02:03:37,207][123090] Updated weights for policy 1, policy_version 308596 (0.0009) [2023-12-26 02:03:37,265][123090] Updated weights for policy 1, policy_version 308606 (0.0009) [2023-12-26 02:03:37,800][123091] Updated weights for policy 0, policy_version 310167 (0.0010) [2023-12-26 02:03:37,859][123091] Updated weights for policy 0, policy_version 310177 (0.0005) [2023-12-26 02:03:37,916][123091] Updated weights for policy 0, policy_version 310187 (0.0005) [2023-12-26 02:03:38,069][123090] Updated weights for policy 1, policy_version 308616 (0.0010) [2023-12-26 02:03:38,135][123090] Updated weights for policy 1, policy_version 308626 (0.0010) [2023-12-26 02:03:38,201][123090] Updated weights for policy 1, policy_version 308636 (0.0010) [2023-12-26 02:03:38,576][123091] Updated weights for policy 0, policy_version 310197 (0.0006) [2023-12-26 02:03:38,638][123091] Updated weights for policy 0, policy_version 310207 (0.0006) [2023-12-26 02:03:38,684][123091] Updated weights for policy 0, policy_version 310217 (0.0005) [2023-12-26 02:03:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 158433280. Throughput: 0: 9033.7, 1: 8860.4. Samples: 158406008. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:38,785][121949] Avg episode reward: [(0, '6100.180'), (1, '5685.444')] [2023-12-26 02:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000310224_79421440.pth... [2023-12-26 02:03:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000308640_79011840.pth... [2023-12-26 02:03:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000309168_79151104.pth [2023-12-26 02:03:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000307616_78749696.pth [2023-12-26 02:03:39,105][123090] Updated weights for policy 1, policy_version 308646 (0.0010) [2023-12-26 02:03:39,168][123090] Updated weights for policy 1, policy_version 308656 (0.0010) [2023-12-26 02:03:39,243][123090] Updated weights for policy 1, policy_version 308666 (0.0011) [2023-12-26 02:03:39,362][123091] Updated weights for policy 0, policy_version 310227 (0.0006) [2023-12-26 02:03:39,433][123091] Updated weights for policy 0, policy_version 310237 (0.0008) [2023-12-26 02:03:39,496][123091] Updated weights for policy 0, policy_version 310247 (0.0008) [2023-12-26 02:03:39,993][123090] Updated weights for policy 1, policy_version 308676 (0.0009) [2023-12-26 02:03:40,060][123090] Updated weights for policy 1, policy_version 308686 (0.0008) [2023-12-26 02:03:40,118][123090] Updated weights for policy 1, policy_version 308696 (0.0009) [2023-12-26 02:03:40,328][123091] Updated weights for policy 0, policy_version 310257 (0.0008) [2023-12-26 02:03:40,393][123091] Updated weights for policy 0, policy_version 310267 (0.0010) [2023-12-26 02:03:40,462][123091] Updated weights for policy 0, policy_version 310277 (0.0010) [2023-12-26 02:03:40,520][123091] Updated weights for policy 0, policy_version 310287 (0.0009) [2023-12-26 02:03:40,891][123090] Updated weights for policy 1, policy_version 308706 (0.0008) [2023-12-26 02:03:40,971][123090] Updated weights for policy 1, policy_version 308716 (0.0005) [2023-12-26 02:03:41,030][123090] Updated weights for policy 1, policy_version 308726 (0.0006) [2023-12-26 02:03:41,089][123090] Updated weights for policy 1, policy_version 308736 (0.0008) [2023-12-26 02:03:41,401][123091] Updated weights for policy 0, policy_version 310297 (0.0008) [2023-12-26 02:03:41,473][123091] Updated weights for policy 0, policy_version 310307 (0.0009) [2023-12-26 02:03:41,541][123091] Updated weights for policy 0, policy_version 310317 (0.0009) [2023-12-26 02:03:41,797][123090] Updated weights for policy 1, policy_version 308746 (0.0009) [2023-12-26 02:03:41,868][123090] Updated weights for policy 1, policy_version 308756 (0.0009) [2023-12-26 02:03:41,932][123090] Updated weights for policy 1, policy_version 308766 (0.0010) [2023-12-26 02:03:42,310][123091] Updated weights for policy 0, policy_version 310327 (0.0007) [2023-12-26 02:03:42,384][123091] Updated weights for policy 0, policy_version 310337 (0.0007) [2023-12-26 02:03:42,456][123091] Updated weights for policy 0, policy_version 310347 (0.0007) [2023-12-26 02:03:42,811][123090] Updated weights for policy 1, policy_version 308776 (0.0010) [2023-12-26 02:03:42,871][123090] Updated weights for policy 1, policy_version 308786 (0.0009) [2023-12-26 02:03:42,934][123090] Updated weights for policy 1, policy_version 308796 (0.0009) [2023-12-26 02:03:43,205][123091] Updated weights for policy 0, policy_version 310357 (0.0006) [2023-12-26 02:03:43,275][123091] Updated weights for policy 0, policy_version 310367 (0.0006) [2023-12-26 02:03:43,333][123091] Updated weights for policy 0, policy_version 310377 (0.0006) [2023-12-26 02:03:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 158515200. Throughput: 0: 8947.4, 1: 8811.8. Samples: 158511320. Policy #0 lag: (min: 31.0, avg: 33.9, max: 63.0) [2023-12-26 02:03:43,785][121949] Avg episode reward: [(0, '6062.393'), (1, '5621.359')] [2023-12-26 02:03:43,844][123090] Updated weights for policy 1, policy_version 308806 (0.0009) [2023-12-26 02:03:43,907][123090] Updated weights for policy 1, policy_version 308816 (0.0009) [2023-12-26 02:03:43,955][123090] Updated weights for policy 1, policy_version 308826 (0.0008) [2023-12-26 02:03:44,089][123091] Updated weights for policy 0, policy_version 310387 (0.0008) [2023-12-26 02:03:44,148][123091] Updated weights for policy 0, policy_version 310397 (0.0010) [2023-12-26 02:03:44,211][123091] Updated weights for policy 0, policy_version 310407 (0.0007) [2023-12-26 02:03:44,660][123090] Updated weights for policy 1, policy_version 308836 (0.0005) [2023-12-26 02:03:44,714][123090] Updated weights for policy 1, policy_version 308846 (0.0005) [2023-12-26 02:03:44,775][123090] Updated weights for policy 1, policy_version 308856 (0.0006) [2023-12-26 02:03:45,004][123091] Updated weights for policy 0, policy_version 310417 (0.0006) [2023-12-26 02:03:45,068][123091] Updated weights for policy 0, policy_version 310427 (0.0011) [2023-12-26 02:03:45,132][123091] Updated weights for policy 0, policy_version 310437 (0.0011) [2023-12-26 02:03:45,203][123091] Updated weights for policy 0, policy_version 310447 (0.0011) [2023-12-26 02:03:45,484][123090] Updated weights for policy 1, policy_version 308866 (0.0008) [2023-12-26 02:03:45,544][123090] Updated weights for policy 1, policy_version 308876 (0.0010) [2023-12-26 02:03:45,593][123090] Updated weights for policy 1, policy_version 308886 (0.0010) [2023-12-26 02:03:45,649][123090] Updated weights for policy 1, policy_version 308896 (0.0010) [2023-12-26 02:03:45,860][123091] Updated weights for policy 0, policy_version 310457 (0.0010) [2023-12-26 02:03:45,911][123091] Updated weights for policy 0, policy_version 310467 (0.0010) [2023-12-26 02:03:45,966][123091] Updated weights for policy 0, policy_version 310477 (0.0010) [2023-12-26 02:03:46,423][123090] Updated weights for policy 1, policy_version 308906 (0.0005) [2023-12-26 02:03:46,471][123090] Updated weights for policy 1, policy_version 308916 (0.0005) [2023-12-26 02:03:46,536][123090] Updated weights for policy 1, policy_version 308926 (0.0005) [2023-12-26 02:03:46,743][123091] Updated weights for policy 0, policy_version 310487 (0.0007) [2023-12-26 02:03:46,799][123091] Updated weights for policy 0, policy_version 310497 (0.0005) [2023-12-26 02:03:46,859][123091] Updated weights for policy 0, policy_version 310507 (0.0006) [2023-12-26 02:03:47,155][123090] Updated weights for policy 1, policy_version 308936 (0.0005) [2023-12-26 02:03:47,208][123090] Updated weights for policy 1, policy_version 308946 (0.0005) [2023-12-26 02:03:47,267][123090] Updated weights for policy 1, policy_version 308956 (0.0005) [2023-12-26 02:03:47,501][123091] Updated weights for policy 0, policy_version 310517 (0.0008) [2023-12-26 02:03:47,565][123091] Updated weights for policy 0, policy_version 310527 (0.0011) [2023-12-26 02:03:47,612][123091] Updated weights for policy 0, policy_version 310537 (0.0010) [2023-12-26 02:03:47,954][123090] Updated weights for policy 1, policy_version 308966 (0.0005) [2023-12-26 02:03:48,025][123090] Updated weights for policy 1, policy_version 308976 (0.0005) [2023-12-26 02:03:48,088][123090] Updated weights for policy 1, policy_version 308986 (0.0005) [2023-12-26 02:03:48,427][123091] Updated weights for policy 0, policy_version 310547 (0.0010) [2023-12-26 02:03:48,490][123091] Updated weights for policy 0, policy_version 310557 (0.0011) [2023-12-26 02:03:48,556][123091] Updated weights for policy 0, policy_version 310567 (0.0011) [2023-12-26 02:03:48,761][123090] Updated weights for policy 1, policy_version 308996 (0.0005) [2023-12-26 02:03:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 158613504. Throughput: 0: 8963.5, 1: 8902.7. Samples: 158624968. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:03:48,785][121949] Avg episode reward: [(0, '6031.859'), (1, '5461.742')] [2023-12-26 02:03:48,828][123090] Updated weights for policy 1, policy_version 309006 (0.0008) [2023-12-26 02:03:48,895][123090] Updated weights for policy 1, policy_version 309016 (0.0006) [2023-12-26 02:03:49,396][123091] Updated weights for policy 0, policy_version 310577 (0.0010) [2023-12-26 02:03:49,459][123091] Updated weights for policy 0, policy_version 310587 (0.0009) [2023-12-26 02:03:49,520][123091] Updated weights for policy 0, policy_version 310597 (0.0009) [2023-12-26 02:03:49,584][123091] Updated weights for policy 0, policy_version 310607 (0.0009) [2023-12-26 02:03:49,653][123090] Updated weights for policy 1, policy_version 309026 (0.0005) [2023-12-26 02:03:49,728][123090] Updated weights for policy 1, policy_version 309036 (0.0006) [2023-12-26 02:03:49,792][123090] Updated weights for policy 1, policy_version 309046 (0.0005) [2023-12-26 02:03:49,864][123090] Updated weights for policy 1, policy_version 309056 (0.0007) [2023-12-26 02:03:50,381][123091] Updated weights for policy 0, policy_version 310617 (0.0006) [2023-12-26 02:03:50,441][123091] Updated weights for policy 0, policy_version 310627 (0.0006) [2023-12-26 02:03:50,495][123091] Updated weights for policy 0, policy_version 310637 (0.0010) [2023-12-26 02:03:50,510][123090] Updated weights for policy 1, policy_version 309066 (0.0010) [2023-12-26 02:03:50,571][123090] Updated weights for policy 1, policy_version 309076 (0.0008) [2023-12-26 02:03:50,646][123090] Updated weights for policy 1, policy_version 309086 (0.0007) [2023-12-26 02:03:51,295][123091] Updated weights for policy 0, policy_version 310647 (0.0011) [2023-12-26 02:03:51,370][123091] Updated weights for policy 0, policy_version 310657 (0.0010) [2023-12-26 02:03:51,438][123091] Updated weights for policy 0, policy_version 310667 (0.0008) [2023-12-26 02:03:51,462][123090] Updated weights for policy 1, policy_version 309096 (0.0009) [2023-12-26 02:03:51,522][123090] Updated weights for policy 1, policy_version 309106 (0.0008) [2023-12-26 02:03:51,579][123090] Updated weights for policy 1, policy_version 309116 (0.0008) [2023-12-26 02:03:52,286][123091] Updated weights for policy 0, policy_version 310677 (0.0009) [2023-12-26 02:03:52,345][123091] Updated weights for policy 0, policy_version 310687 (0.0009) [2023-12-26 02:03:52,407][123091] Updated weights for policy 0, policy_version 310697 (0.0009) [2023-12-26 02:03:52,425][123090] Updated weights for policy 1, policy_version 309126 (0.0008) [2023-12-26 02:03:52,490][123090] Updated weights for policy 1, policy_version 309136 (0.0010) [2023-12-26 02:03:52,562][123090] Updated weights for policy 1, policy_version 309146 (0.0009) [2023-12-26 02:03:53,174][123091] Updated weights for policy 0, policy_version 310707 (0.0009) [2023-12-26 02:03:53,238][123091] Updated weights for policy 0, policy_version 310717 (0.0009) [2023-12-26 02:03:53,294][123091] Updated weights for policy 0, policy_version 310727 (0.0009) [2023-12-26 02:03:53,373][123090] Updated weights for policy 1, policy_version 309156 (0.0008) [2023-12-26 02:03:53,438][123090] Updated weights for policy 1, policy_version 309166 (0.0005) [2023-12-26 02:03:53,511][123090] Updated weights for policy 1, policy_version 309176 (0.0006) [2023-12-26 02:03:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 158703616. Throughput: 0: 8989.7, 1: 8911.7. Samples: 158678532. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:03:53,785][121949] Avg episode reward: [(0, '6011.723'), (1, '5526.890')] [2023-12-26 02:03:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000309184_79151104.pth... [2023-12-26 02:03:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000310736_79552512.pth... [2023-12-26 02:03:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000308128_78880768.pth [2023-12-26 02:03:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000309648_79273984.pth [2023-12-26 02:03:54,064][123091] Updated weights for policy 0, policy_version 310737 (0.0009) [2023-12-26 02:03:54,127][123091] Updated weights for policy 0, policy_version 310747 (0.0006) [2023-12-26 02:03:54,189][123091] Updated weights for policy 0, policy_version 310757 (0.0006) [2023-12-26 02:03:54,212][123090] Updated weights for policy 1, policy_version 309186 (0.0010) [2023-12-26 02:03:54,248][123091] Updated weights for policy 0, policy_version 310767 (0.0005) [2023-12-26 02:03:54,274][123090] Updated weights for policy 1, policy_version 309196 (0.0011) [2023-12-26 02:03:54,334][123090] Updated weights for policy 1, policy_version 309206 (0.0010) [2023-12-26 02:03:54,378][123090] Updated weights for policy 1, policy_version 309216 (0.0008) [2023-12-26 02:03:54,922][123091] Updated weights for policy 0, policy_version 310777 (0.0006) [2023-12-26 02:03:54,977][123091] Updated weights for policy 0, policy_version 310787 (0.0005) [2023-12-26 02:03:55,032][123091] Updated weights for policy 0, policy_version 310797 (0.0005) [2023-12-26 02:03:55,242][123090] Updated weights for policy 1, policy_version 309226 (0.0008) [2023-12-26 02:03:55,294][123090] Updated weights for policy 1, policy_version 309236 (0.0005) [2023-12-26 02:03:55,356][123090] Updated weights for policy 1, policy_version 309246 (0.0005) [2023-12-26 02:03:55,750][123091] Updated weights for policy 0, policy_version 310807 (0.0006) [2023-12-26 02:03:55,802][123091] Updated weights for policy 0, policy_version 310817 (0.0005) [2023-12-26 02:03:55,851][123091] Updated weights for policy 0, policy_version 310827 (0.0005) [2023-12-26 02:03:56,011][123090] Updated weights for policy 1, policy_version 309256 (0.0005) [2023-12-26 02:03:56,088][123090] Updated weights for policy 1, policy_version 309266 (0.0006) [2023-12-26 02:03:56,141][123090] Updated weights for policy 1, policy_version 309276 (0.0006) [2023-12-26 02:03:56,583][123091] Updated weights for policy 0, policy_version 310837 (0.0007) [2023-12-26 02:03:56,642][123091] Updated weights for policy 0, policy_version 310847 (0.0008) [2023-12-26 02:03:56,689][123091] Updated weights for policy 0, policy_version 310857 (0.0008) [2023-12-26 02:03:56,816][123090] Updated weights for policy 1, policy_version 309286 (0.0008) [2023-12-26 02:03:56,864][123090] Updated weights for policy 1, policy_version 309296 (0.0010) [2023-12-26 02:03:56,930][123090] Updated weights for policy 1, policy_version 309306 (0.0010) [2023-12-26 02:03:57,471][123091] Updated weights for policy 0, policy_version 310867 (0.0006) [2023-12-26 02:03:57,520][123091] Updated weights for policy 0, policy_version 310877 (0.0005) [2023-12-26 02:03:57,569][123091] Updated weights for policy 0, policy_version 310887 (0.0010) [2023-12-26 02:03:57,702][123090] Updated weights for policy 1, policy_version 309316 (0.0008) [2023-12-26 02:03:57,768][123090] Updated weights for policy 1, policy_version 309326 (0.0005) [2023-12-26 02:03:57,817][123090] Updated weights for policy 1, policy_version 309336 (0.0005) [2023-12-26 02:03:58,368][123091] Updated weights for policy 0, policy_version 310898 (0.0011) [2023-12-26 02:03:58,441][123091] Updated weights for policy 0, policy_version 310908 (0.0011) [2023-12-26 02:03:58,508][123091] Updated weights for policy 0, policy_version 310918 (0.0010) [2023-12-26 02:03:58,573][123090] Updated weights for policy 1, policy_version 309346 (0.0006) [2023-12-26 02:03:58,578][123091] Updated weights for policy 0, policy_version 310928 (0.0010) [2023-12-26 02:03:58,644][123090] Updated weights for policy 1, policy_version 309356 (0.0007) [2023-12-26 02:03:58,717][123090] Updated weights for policy 1, policy_version 309366 (0.0009) [2023-12-26 02:03:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 158793728. Throughput: 0: 9124.1, 1: 8975.0. Samples: 158791740. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:03:58,785][121949] Avg episode reward: [(0, '6061.439'), (1, '5629.860')] [2023-12-26 02:03:58,787][123090] Updated weights for policy 1, policy_version 309376 (0.0009) [2023-12-26 02:03:59,430][123091] Updated weights for policy 0, policy_version 310938 (0.0008) [2023-12-26 02:03:59,493][123091] Updated weights for policy 0, policy_version 310948 (0.0006) [2023-12-26 02:03:59,555][123091] Updated weights for policy 0, policy_version 310958 (0.0009) [2023-12-26 02:03:59,574][123090] Updated weights for policy 1, policy_version 309386 (0.0010) [2023-12-26 02:03:59,623][123090] Updated weights for policy 1, policy_version 309396 (0.0009) [2023-12-26 02:03:59,686][123090] Updated weights for policy 1, policy_version 309406 (0.0007) [2023-12-26 02:04:00,367][123091] Updated weights for policy 0, policy_version 310968 (0.0009) [2023-12-26 02:04:00,418][123091] Updated weights for policy 0, policy_version 310978 (0.0010) [2023-12-26 02:04:00,477][123091] Updated weights for policy 0, policy_version 310988 (0.0010) [2023-12-26 02:04:00,479][123090] Updated weights for policy 1, policy_version 309416 (0.0010) [2023-12-26 02:04:00,524][123090] Updated weights for policy 1, policy_version 309426 (0.0008) [2023-12-26 02:04:00,576][123090] Updated weights for policy 1, policy_version 309436 (0.0010) [2023-12-26 02:04:01,291][123091] Updated weights for policy 0, policy_version 310998 (0.0010) [2023-12-26 02:04:01,346][123091] Updated weights for policy 0, policy_version 311008 (0.0010) [2023-12-26 02:04:01,406][123090] Updated weights for policy 1, policy_version 309446 (0.0009) [2023-12-26 02:04:01,418][123091] Updated weights for policy 0, policy_version 311018 (0.0009) [2023-12-26 02:04:01,466][123090] Updated weights for policy 1, policy_version 309456 (0.0007) [2023-12-26 02:04:01,528][123090] Updated weights for policy 1, policy_version 309466 (0.0006) [2023-12-26 02:04:02,285][123091] Updated weights for policy 0, policy_version 311028 (0.0010) [2023-12-26 02:04:02,299][123090] Updated weights for policy 1, policy_version 309476 (0.0007) [2023-12-26 02:04:02,350][123091] Updated weights for policy 0, policy_version 311038 (0.0007) [2023-12-26 02:04:02,368][123090] Updated weights for policy 1, policy_version 309486 (0.0010) [2023-12-26 02:04:02,412][123091] Updated weights for policy 0, policy_version 311048 (0.0008) [2023-12-26 02:04:02,422][123090] Updated weights for policy 1, policy_version 309496 (0.0009) [2023-12-26 02:04:03,203][123090] Updated weights for policy 1, policy_version 309506 (0.0009) [2023-12-26 02:04:03,240][123091] Updated weights for policy 0, policy_version 311058 (0.0007) [2023-12-26 02:04:03,261][123090] Updated weights for policy 1, policy_version 309516 (0.0008) [2023-12-26 02:04:03,303][123091] Updated weights for policy 0, policy_version 311068 (0.0008) [2023-12-26 02:04:03,318][123090] Updated weights for policy 1, policy_version 309526 (0.0006) [2023-12-26 02:04:03,368][123091] Updated weights for policy 0, policy_version 311078 (0.0008) [2023-12-26 02:04:03,387][123090] Updated weights for policy 1, policy_version 309536 (0.0009) [2023-12-26 02:04:03,417][123091] Updated weights for policy 0, policy_version 311088 (0.0009) [2023-12-26 02:04:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 158883840. Throughput: 0: 9122.9, 1: 8947.5. Samples: 158895204. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:03,785][121949] Avg episode reward: [(0, '6043.226'), (1, '5753.353')] [2023-12-26 02:04:04,131][123091] Updated weights for policy 0, policy_version 311098 (0.0006) [2023-12-26 02:04:04,148][123090] Updated weights for policy 1, policy_version 309546 (0.0006) [2023-12-26 02:04:04,187][123091] Updated weights for policy 0, policy_version 311108 (0.0006) [2023-12-26 02:04:04,224][123090] Updated weights for policy 1, policy_version 309556 (0.0007) [2023-12-26 02:04:04,253][123091] Updated weights for policy 0, policy_version 311118 (0.0006) [2023-12-26 02:04:04,283][123090] Updated weights for policy 1, policy_version 309566 (0.0010) [2023-12-26 02:04:04,884][123091] Updated weights for policy 0, policy_version 311128 (0.0006) [2023-12-26 02:04:04,932][123091] Updated weights for policy 0, policy_version 311138 (0.0005) [2023-12-26 02:04:04,984][123091] Updated weights for policy 0, policy_version 311148 (0.0006) [2023-12-26 02:04:05,123][123090] Updated weights for policy 1, policy_version 309576 (0.0010) [2023-12-26 02:04:05,187][123090] Updated weights for policy 1, policy_version 309586 (0.0006) [2023-12-26 02:04:05,244][123090] Updated weights for policy 1, policy_version 309596 (0.0005) [2023-12-26 02:04:05,626][123091] Updated weights for policy 0, policy_version 311158 (0.0005) [2023-12-26 02:04:05,673][123091] Updated weights for policy 0, policy_version 311168 (0.0005) [2023-12-26 02:04:05,726][123091] Updated weights for policy 0, policy_version 311178 (0.0006) [2023-12-26 02:04:05,875][123090] Updated weights for policy 1, policy_version 309606 (0.0005) [2023-12-26 02:04:05,929][123090] Updated weights for policy 1, policy_version 309616 (0.0007) [2023-12-26 02:04:05,976][123090] Updated weights for policy 1, policy_version 309626 (0.0010) [2023-12-26 02:04:06,563][123091] Updated weights for policy 0, policy_version 311188 (0.0008) [2023-12-26 02:04:06,628][123091] Updated weights for policy 0, policy_version 311198 (0.0009) [2023-12-26 02:04:06,676][123090] Updated weights for policy 1, policy_version 309636 (0.0010) [2023-12-26 02:04:06,692][123091] Updated weights for policy 0, policy_version 311208 (0.0008) [2023-12-26 02:04:06,728][123090] Updated weights for policy 1, policy_version 309646 (0.0011) [2023-12-26 02:04:06,780][123090] Updated weights for policy 1, policy_version 309656 (0.0010) [2023-12-26 02:04:07,541][123091] Updated weights for policy 0, policy_version 311218 (0.0005) [2023-12-26 02:04:07,593][123091] Updated weights for policy 0, policy_version 311228 (0.0005) [2023-12-26 02:04:07,629][123090] Updated weights for policy 1, policy_version 309666 (0.0010) [2023-12-26 02:04:07,665][123091] Updated weights for policy 0, policy_version 311238 (0.0006) [2023-12-26 02:04:07,689][123090] Updated weights for policy 1, policy_version 309676 (0.0010) [2023-12-26 02:04:07,721][123091] Updated weights for policy 0, policy_version 311248 (0.0005) [2023-12-26 02:04:07,752][123090] Updated weights for policy 1, policy_version 309686 (0.0010) [2023-12-26 02:04:07,817][123090] Updated weights for policy 1, policy_version 309696 (0.0010) [2023-12-26 02:04:08,473][123091] Updated weights for policy 0, policy_version 311258 (0.0009) [2023-12-26 02:04:08,522][123091] Updated weights for policy 0, policy_version 311268 (0.0009) [2023-12-26 02:04:08,586][123091] Updated weights for policy 0, policy_version 311278 (0.0008) [2023-12-26 02:04:08,627][123090] Updated weights for policy 1, policy_version 309706 (0.0011) [2023-12-26 02:04:08,674][123090] Updated weights for policy 1, policy_version 309716 (0.0010) [2023-12-26 02:04:08,727][123090] Updated weights for policy 1, policy_version 309726 (0.0010) [2023-12-26 02:04:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17661.4). Total num frames: 158982144. Throughput: 0: 9206.6, 1: 9026.7. Samples: 158953432. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:08,785][121949] Avg episode reward: [(0, '5932.554'), (1, '5683.634')] [2023-12-26 02:04:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000311280_79691776.pth... [2023-12-26 02:04:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000309728_79290368.pth... [2023-12-26 02:04:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000310224_79421440.pth [2023-12-26 02:04:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000308640_79011840.pth [2023-12-26 02:04:09,369][123091] Updated weights for policy 0, policy_version 311289 (0.0008) [2023-12-26 02:04:09,441][123091] Updated weights for policy 0, policy_version 311299 (0.0007) [2023-12-26 02:04:09,515][123091] Updated weights for policy 0, policy_version 311309 (0.0006) [2023-12-26 02:04:09,619][123090] Updated weights for policy 1, policy_version 309736 (0.0007) [2023-12-26 02:04:09,693][123090] Updated weights for policy 1, policy_version 309746 (0.0007) [2023-12-26 02:04:09,770][123090] Updated weights for policy 1, policy_version 309756 (0.0011) [2023-12-26 02:04:10,346][123091] Updated weights for policy 0, policy_version 311319 (0.0009) [2023-12-26 02:04:10,408][123091] Updated weights for policy 0, policy_version 311329 (0.0007) [2023-12-26 02:04:10,477][123091] Updated weights for policy 0, policy_version 311339 (0.0008) [2023-12-26 02:04:10,571][123090] Updated weights for policy 1, policy_version 309766 (0.0011) [2023-12-26 02:04:10,635][123090] Updated weights for policy 1, policy_version 309776 (0.0009) [2023-12-26 02:04:10,694][123090] Updated weights for policy 1, policy_version 309786 (0.0009) [2023-12-26 02:04:11,219][123091] Updated weights for policy 0, policy_version 311349 (0.0008) [2023-12-26 02:04:11,285][123091] Updated weights for policy 0, policy_version 311359 (0.0008) [2023-12-26 02:04:11,347][123091] Updated weights for policy 0, policy_version 311369 (0.0007) [2023-12-26 02:04:11,584][123090] Updated weights for policy 1, policy_version 309796 (0.0010) [2023-12-26 02:04:11,654][123090] Updated weights for policy 1, policy_version 309806 (0.0008) [2023-12-26 02:04:11,726][123090] Updated weights for policy 1, policy_version 309816 (0.0009) [2023-12-26 02:04:12,168][123091] Updated weights for policy 0, policy_version 311379 (0.0008) [2023-12-26 02:04:12,232][123091] Updated weights for policy 0, policy_version 311389 (0.0008) [2023-12-26 02:04:12,297][123091] Updated weights for policy 0, policy_version 311399 (0.0007) [2023-12-26 02:04:12,574][123090] Updated weights for policy 1, policy_version 309826 (0.0010) [2023-12-26 02:04:12,629][123090] Updated weights for policy 1, policy_version 309836 (0.0009) [2023-12-26 02:04:12,687][123090] Updated weights for policy 1, policy_version 309846 (0.0009) [2023-12-26 02:04:12,746][123090] Updated weights for policy 1, policy_version 309856 (0.0009) [2023-12-26 02:04:13,046][123091] Updated weights for policy 0, policy_version 311409 (0.0008) [2023-12-26 02:04:13,114][123091] Updated weights for policy 0, policy_version 311419 (0.0009) [2023-12-26 02:04:13,160][123091] Updated weights for policy 0, policy_version 311429 (0.0009) [2023-12-26 02:04:13,206][123091] Updated weights for policy 0, policy_version 311439 (0.0008) [2023-12-26 02:04:13,569][123090] Updated weights for policy 1, policy_version 309866 (0.0005) [2023-12-26 02:04:13,624][123090] Updated weights for policy 1, policy_version 309876 (0.0005) [2023-12-26 02:04:13,680][123090] Updated weights for policy 1, policy_version 309886 (0.0006) [2023-12-26 02:04:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17633.6). Total num frames: 159064064. Throughput: 0: 9101.9, 1: 8933.4. Samples: 159056036. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:13,786][121949] Avg episode reward: [(0, '6074.000'), (1, '5682.846')] [2023-12-26 02:04:13,964][123091] Updated weights for policy 0, policy_version 311449 (0.0006) [2023-12-26 02:04:14,029][123091] Updated weights for policy 0, policy_version 311459 (0.0005) [2023-12-26 02:04:14,087][123091] Updated weights for policy 0, policy_version 311469 (0.0005) [2023-12-26 02:04:14,443][123090] Updated weights for policy 1, policy_version 309896 (0.0008) [2023-12-26 02:04:14,495][123090] Updated weights for policy 1, policy_version 309906 (0.0009) [2023-12-26 02:04:14,546][123090] Updated weights for policy 1, policy_version 309916 (0.0008) [2023-12-26 02:04:14,861][123091] Updated weights for policy 0, policy_version 311479 (0.0006) [2023-12-26 02:04:14,937][123091] Updated weights for policy 0, policy_version 311489 (0.0006) [2023-12-26 02:04:15,004][123091] Updated weights for policy 0, policy_version 311499 (0.0009) [2023-12-26 02:04:15,403][123090] Updated weights for policy 1, policy_version 309926 (0.0008) [2023-12-26 02:04:15,458][123090] Updated weights for policy 1, policy_version 309937 (0.0010) [2023-12-26 02:04:15,513][123090] Updated weights for policy 1, policy_version 309947 (0.0010) [2023-12-26 02:04:15,689][123091] Updated weights for policy 0, policy_version 311509 (0.0008) [2023-12-26 02:04:15,740][123091] Updated weights for policy 0, policy_version 311519 (0.0006) [2023-12-26 02:04:15,796][123091] Updated weights for policy 0, policy_version 311529 (0.0010) [2023-12-26 02:04:16,358][123090] Updated weights for policy 1, policy_version 309957 (0.0010) [2023-12-26 02:04:16,421][123090] Updated weights for policy 1, policy_version 309967 (0.0008) [2023-12-26 02:04:16,474][123090] Updated weights for policy 1, policy_version 309977 (0.0009) [2023-12-26 02:04:16,626][123091] Updated weights for policy 0, policy_version 311539 (0.0009) [2023-12-26 02:04:16,685][123091] Updated weights for policy 0, policy_version 311549 (0.0009) [2023-12-26 02:04:16,751][123091] Updated weights for policy 0, policy_version 311559 (0.0009) [2023-12-26 02:04:17,286][123090] Updated weights for policy 1, policy_version 309987 (0.0009) [2023-12-26 02:04:17,350][123090] Updated weights for policy 1, policy_version 309997 (0.0009) [2023-12-26 02:04:17,399][123090] Updated weights for policy 1, policy_version 310007 (0.0009) [2023-12-26 02:04:17,562][123091] Updated weights for policy 0, policy_version 311569 (0.0009) [2023-12-26 02:04:17,609][123091] Updated weights for policy 0, policy_version 311579 (0.0005) [2023-12-26 02:04:17,662][123091] Updated weights for policy 0, policy_version 311589 (0.0010) [2023-12-26 02:04:17,711][123091] Updated weights for policy 0, policy_version 311599 (0.0006) [2023-12-26 02:04:18,228][123090] Updated weights for policy 1, policy_version 310017 (0.0008) [2023-12-26 02:04:18,284][123090] Updated weights for policy 1, policy_version 310027 (0.0005) [2023-12-26 02:04:18,345][123090] Updated weights for policy 1, policy_version 310037 (0.0007) [2023-12-26 02:04:18,405][123090] Updated weights for policy 1, policy_version 310047 (0.0009) [2023-12-26 02:04:18,550][123091] Updated weights for policy 0, policy_version 311609 (0.0010) [2023-12-26 02:04:18,608][123091] Updated weights for policy 0, policy_version 311619 (0.0010) [2023-12-26 02:04:18,660][123091] Updated weights for policy 0, policy_version 311629 (0.0009) [2023-12-26 02:04:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 159154176. Throughput: 0: 9065.3, 1: 8956.4. Samples: 159163052. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:18,784][121949] Avg episode reward: [(0, '6201.797'), (1, '5902.101')] [2023-12-26 02:04:18,785][123008] Saving new best policy, reward=5902.101! [2023-12-26 02:04:19,204][123090] Updated weights for policy 1, policy_version 310057 (0.0008) [2023-12-26 02:04:19,277][123090] Updated weights for policy 1, policy_version 310067 (0.0007) [2023-12-26 02:04:19,360][123090] Updated weights for policy 1, policy_version 310077 (0.0006) [2023-12-26 02:04:19,512][123091] Updated weights for policy 0, policy_version 311639 (0.0009) [2023-12-26 02:04:19,574][123091] Updated weights for policy 0, policy_version 311649 (0.0009) [2023-12-26 02:04:19,641][123091] Updated weights for policy 0, policy_version 311659 (0.0009) [2023-12-26 02:04:20,130][123090] Updated weights for policy 1, policy_version 310087 (0.0008) [2023-12-26 02:04:20,194][123090] Updated weights for policy 1, policy_version 310097 (0.0009) [2023-12-26 02:04:20,265][123090] Updated weights for policy 1, policy_version 310107 (0.0009) [2023-12-26 02:04:20,461][123091] Updated weights for policy 0, policy_version 311669 (0.0009) [2023-12-26 02:04:20,524][123091] Updated weights for policy 0, policy_version 311679 (0.0008) [2023-12-26 02:04:20,598][123091] Updated weights for policy 0, policy_version 311689 (0.0008) [2023-12-26 02:04:21,131][123090] Updated weights for policy 1, policy_version 310117 (0.0010) [2023-12-26 02:04:21,193][123090] Updated weights for policy 1, policy_version 310127 (0.0009) [2023-12-26 02:04:21,256][123090] Updated weights for policy 1, policy_version 310137 (0.0010) [2023-12-26 02:04:21,401][123091] Updated weights for policy 0, policy_version 311699 (0.0009) [2023-12-26 02:04:21,463][123091] Updated weights for policy 0, policy_version 311709 (0.0007) [2023-12-26 02:04:21,521][123091] Updated weights for policy 0, policy_version 311719 (0.0006) [2023-12-26 02:04:22,165][123090] Updated weights for policy 1, policy_version 310147 (0.0010) [2023-12-26 02:04:22,229][123090] Updated weights for policy 1, policy_version 310157 (0.0009) [2023-12-26 02:04:22,247][123091] Updated weights for policy 0, policy_version 311729 (0.0006) [2023-12-26 02:04:22,292][123090] Updated weights for policy 1, policy_version 310167 (0.0008) [2023-12-26 02:04:22,307][123091] Updated weights for policy 0, policy_version 311739 (0.0008) [2023-12-26 02:04:22,371][123091] Updated weights for policy 0, policy_version 311749 (0.0009) [2023-12-26 02:04:22,422][123091] Updated weights for policy 0, policy_version 311759 (0.0006) [2023-12-26 02:04:23,167][123091] Updated weights for policy 0, policy_version 311769 (0.0007) [2023-12-26 02:04:23,195][123090] Updated weights for policy 1, policy_version 310177 (0.0007) [2023-12-26 02:04:23,230][123091] Updated weights for policy 0, policy_version 311779 (0.0007) [2023-12-26 02:04:23,250][123090] Updated weights for policy 1, policy_version 310187 (0.0007) [2023-12-26 02:04:23,294][123091] Updated weights for policy 0, policy_version 311789 (0.0008) [2023-12-26 02:04:23,309][123090] Updated weights for policy 1, policy_version 310197 (0.0009) [2023-12-26 02:04:23,371][123090] Updated weights for policy 1, policy_version 310207 (0.0009) [2023-12-26 02:04:23,784][121949] Fps is (10 sec: 17203.7, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 159236096. Throughput: 0: 9029.3, 1: 8925.3. Samples: 159213960. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:23,785][121949] Avg episode reward: [(0, '6055.663'), (1, '5862.329')] [2023-12-26 02:04:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000311792_79822848.pth... [2023-12-26 02:04:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000310208_79413248.pth... [2023-12-26 02:04:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000310736_79552512.pth [2023-12-26 02:04:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000309184_79151104.pth [2023-12-26 02:04:24,039][123091] Updated weights for policy 0, policy_version 311799 (0.0009) [2023-12-26 02:04:24,106][123091] Updated weights for policy 0, policy_version 311809 (0.0007) [2023-12-26 02:04:24,171][123091] Updated weights for policy 0, policy_version 311819 (0.0006) [2023-12-26 02:04:24,227][123090] Updated weights for policy 1, policy_version 310217 (0.0011) [2023-12-26 02:04:24,298][123090] Updated weights for policy 1, policy_version 310227 (0.0010) [2023-12-26 02:04:24,369][123090] Updated weights for policy 1, policy_version 310237 (0.0011) [2023-12-26 02:04:24,915][123091] Updated weights for policy 0, policy_version 311829 (0.0006) [2023-12-26 02:04:24,964][123091] Updated weights for policy 0, policy_version 311839 (0.0009) [2023-12-26 02:04:25,015][123091] Updated weights for policy 0, policy_version 311849 (0.0008) [2023-12-26 02:04:25,072][123090] Updated weights for policy 1, policy_version 310247 (0.0010) [2023-12-26 02:04:25,134][123090] Updated weights for policy 1, policy_version 310257 (0.0007) [2023-12-26 02:04:25,198][123090] Updated weights for policy 1, policy_version 310267 (0.0008) [2023-12-26 02:04:25,767][123091] Updated weights for policy 0, policy_version 311859 (0.0007) [2023-12-26 02:04:25,837][123091] Updated weights for policy 0, policy_version 311869 (0.0006) [2023-12-26 02:04:25,912][123091] Updated weights for policy 0, policy_version 311879 (0.0006) [2023-12-26 02:04:25,930][123090] Updated weights for policy 1, policy_version 310277 (0.0009) [2023-12-26 02:04:25,984][123090] Updated weights for policy 1, policy_version 310287 (0.0007) [2023-12-26 02:04:26,035][123090] Updated weights for policy 1, policy_version 310297 (0.0010) [2023-12-26 02:04:26,582][123091] Updated weights for policy 0, policy_version 311889 (0.0006) [2023-12-26 02:04:26,636][123091] Updated weights for policy 0, policy_version 311899 (0.0007) [2023-12-26 02:04:26,698][123091] Updated weights for policy 0, policy_version 311909 (0.0007) [2023-12-26 02:04:26,767][123091] Updated weights for policy 0, policy_version 311919 (0.0010) [2023-12-26 02:04:26,858][123090] Updated weights for policy 1, policy_version 310307 (0.0009) [2023-12-26 02:04:26,920][123090] Updated weights for policy 1, policy_version 310317 (0.0008) [2023-12-26 02:04:26,982][123090] Updated weights for policy 1, policy_version 310327 (0.0009) [2023-12-26 02:04:27,475][123091] Updated weights for policy 0, policy_version 311929 (0.0006) [2023-12-26 02:04:27,523][123091] Updated weights for policy 0, policy_version 311939 (0.0006) [2023-12-26 02:04:27,574][123091] Updated weights for policy 0, policy_version 311949 (0.0005) [2023-12-26 02:04:27,800][123090] Updated weights for policy 1, policy_version 310337 (0.0009) [2023-12-26 02:04:27,850][123090] Updated weights for policy 1, policy_version 310347 (0.0005) [2023-12-26 02:04:27,901][123090] Updated weights for policy 1, policy_version 310357 (0.0005) [2023-12-26 02:04:27,962][123090] Updated weights for policy 1, policy_version 310367 (0.0005) [2023-12-26 02:04:28,227][123091] Updated weights for policy 0, policy_version 311959 (0.0006) [2023-12-26 02:04:28,294][123091] Updated weights for policy 0, policy_version 311969 (0.0009) [2023-12-26 02:04:28,360][123091] Updated weights for policy 0, policy_version 311979 (0.0009) [2023-12-26 02:04:28,699][123090] Updated weights for policy 1, policy_version 310377 (0.0006) [2023-12-26 02:04:28,765][123090] Updated weights for policy 1, policy_version 310387 (0.0005) [2023-12-26 02:04:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 159326208. Throughput: 0: 9107.0, 1: 8926.8. Samples: 159322836. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:28,785][121949] Avg episode reward: [(0, '5839.531'), (1, '5850.780')] [2023-12-26 02:04:28,835][123090] Updated weights for policy 1, policy_version 310397 (0.0011) [2023-12-26 02:04:29,170][123091] Updated weights for policy 0, policy_version 311989 (0.0009) [2023-12-26 02:04:29,238][123091] Updated weights for policy 0, policy_version 311999 (0.0009) [2023-12-26 02:04:29,304][123091] Updated weights for policy 0, policy_version 312009 (0.0009) [2023-12-26 02:04:29,589][123090] Updated weights for policy 1, policy_version 310407 (0.0009) [2023-12-26 02:04:29,642][123090] Updated weights for policy 1, policy_version 310417 (0.0009) [2023-12-26 02:04:29,700][123090] Updated weights for policy 1, policy_version 310427 (0.0010) [2023-12-26 02:04:30,140][123091] Updated weights for policy 0, policy_version 312019 (0.0010) [2023-12-26 02:04:30,201][123091] Updated weights for policy 0, policy_version 312029 (0.0009) [2023-12-26 02:04:30,276][123091] Updated weights for policy 0, policy_version 312039 (0.0005) [2023-12-26 02:04:30,568][123090] Updated weights for policy 1, policy_version 310437 (0.0010) [2023-12-26 02:04:30,619][123090] Updated weights for policy 1, policy_version 310447 (0.0009) [2023-12-26 02:04:30,676][123090] Updated weights for policy 1, policy_version 310457 (0.0009) [2023-12-26 02:04:30,955][123091] Updated weights for policy 0, policy_version 312049 (0.0005) [2023-12-26 02:04:31,018][123091] Updated weights for policy 0, policy_version 312059 (0.0006) [2023-12-26 02:04:31,086][123091] Updated weights for policy 0, policy_version 312069 (0.0007) [2023-12-26 02:04:31,154][123091] Updated weights for policy 0, policy_version 312079 (0.0007) [2023-12-26 02:04:31,495][123090] Updated weights for policy 1, policy_version 310467 (0.0010) [2023-12-26 02:04:31,552][123090] Updated weights for policy 1, policy_version 310477 (0.0009) [2023-12-26 02:04:31,616][123090] Updated weights for policy 1, policy_version 310487 (0.0010) [2023-12-26 02:04:31,948][123091] Updated weights for policy 0, policy_version 312089 (0.0009) [2023-12-26 02:04:32,004][123091] Updated weights for policy 0, policy_version 312099 (0.0008) [2023-12-26 02:04:32,056][123091] Updated weights for policy 0, policy_version 312109 (0.0005) [2023-12-26 02:04:32,462][123090] Updated weights for policy 1, policy_version 310497 (0.0009) [2023-12-26 02:04:32,513][123090] Updated weights for policy 1, policy_version 310507 (0.0005) [2023-12-26 02:04:32,564][123090] Updated weights for policy 1, policy_version 310517 (0.0005) [2023-12-26 02:04:32,613][123090] Updated weights for policy 1, policy_version 310527 (0.0005) [2023-12-26 02:04:32,754][123091] Updated weights for policy 0, policy_version 312119 (0.0007) [2023-12-26 02:04:32,802][123091] Updated weights for policy 0, policy_version 312129 (0.0005) [2023-12-26 02:04:32,869][123091] Updated weights for policy 0, policy_version 312139 (0.0005) [2023-12-26 02:04:33,308][123090] Updated weights for policy 1, policy_version 310537 (0.0005) [2023-12-26 02:04:33,356][123090] Updated weights for policy 1, policy_version 310547 (0.0005) [2023-12-26 02:04:33,405][123090] Updated weights for policy 1, policy_version 310557 (0.0005) [2023-12-26 02:04:33,477][123091] Updated weights for policy 0, policy_version 312149 (0.0005) [2023-12-26 02:04:33,531][123091] Updated weights for policy 0, policy_version 312159 (0.0007) [2023-12-26 02:04:33,589][123091] Updated weights for policy 0, policy_version 312169 (0.0010) [2023-12-26 02:04:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 159424512. Throughput: 0: 9130.3, 1: 8844.6. Samples: 159433840. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:33,785][121949] Avg episode reward: [(0, '5925.689'), (1, '5898.552')] [2023-12-26 02:04:34,153][123090] Updated weights for policy 1, policy_version 310567 (0.0005) [2023-12-26 02:04:34,215][123090] Updated weights for policy 1, policy_version 310577 (0.0009) [2023-12-26 02:04:34,277][123090] Updated weights for policy 1, policy_version 310587 (0.0008) [2023-12-26 02:04:34,315][123091] Updated weights for policy 0, policy_version 312179 (0.0010) [2023-12-26 02:04:34,388][123091] Updated weights for policy 0, policy_version 312189 (0.0010) [2023-12-26 02:04:34,455][123091] Updated weights for policy 0, policy_version 312199 (0.0011) [2023-12-26 02:04:34,884][123090] Updated weights for policy 1, policy_version 310597 (0.0006) [2023-12-26 02:04:34,938][123090] Updated weights for policy 1, policy_version 310607 (0.0005) [2023-12-26 02:04:34,993][123090] Updated weights for policy 1, policy_version 310617 (0.0009) [2023-12-26 02:04:35,205][123091] Updated weights for policy 0, policy_version 312209 (0.0008) [2023-12-26 02:04:35,257][123091] Updated weights for policy 0, policy_version 312219 (0.0009) [2023-12-26 02:04:35,306][123091] Updated weights for policy 0, policy_version 312229 (0.0008) [2023-12-26 02:04:35,354][123091] Updated weights for policy 0, policy_version 312239 (0.0009) [2023-12-26 02:04:35,797][123090] Updated weights for policy 1, policy_version 310627 (0.0010) [2023-12-26 02:04:35,854][123090] Updated weights for policy 1, policy_version 310637 (0.0010) [2023-12-26 02:04:35,913][123090] Updated weights for policy 1, policy_version 310647 (0.0010) [2023-12-26 02:04:36,176][123091] Updated weights for policy 0, policy_version 312249 (0.0007) [2023-12-26 02:04:36,227][123091] Updated weights for policy 0, policy_version 312259 (0.0006) [2023-12-26 02:04:36,275][123091] Updated weights for policy 0, policy_version 312269 (0.0006) [2023-12-26 02:04:36,752][123090] Updated weights for policy 1, policy_version 310657 (0.0011) [2023-12-26 02:04:36,822][123090] Updated weights for policy 1, policy_version 310667 (0.0011) [2023-12-26 02:04:36,885][123090] Updated weights for policy 1, policy_version 310677 (0.0011) [2023-12-26 02:04:36,945][123090] Updated weights for policy 1, policy_version 310687 (0.0010) [2023-12-26 02:04:37,036][123091] Updated weights for policy 0, policy_version 312279 (0.0005) [2023-12-26 02:04:37,113][123091] Updated weights for policy 0, policy_version 312289 (0.0009) [2023-12-26 02:04:37,163][123091] Updated weights for policy 0, policy_version 312299 (0.0009) [2023-12-26 02:04:37,766][123090] Updated weights for policy 1, policy_version 310697 (0.0010) [2023-12-26 02:04:37,814][123090] Updated weights for policy 1, policy_version 310707 (0.0010) [2023-12-26 02:04:37,860][123091] Updated weights for policy 0, policy_version 312309 (0.0006) [2023-12-26 02:04:37,869][123090] Updated weights for policy 1, policy_version 310717 (0.0010) [2023-12-26 02:04:37,913][123091] Updated weights for policy 0, policy_version 312319 (0.0009) [2023-12-26 02:04:37,969][123091] Updated weights for policy 0, policy_version 312329 (0.0009) [2023-12-26 02:04:38,703][123090] Updated weights for policy 1, policy_version 310727 (0.0009) [2023-12-26 02:04:38,766][123090] Updated weights for policy 1, policy_version 310737 (0.0009) [2023-12-26 02:04:38,782][123091] Updated weights for policy 0, policy_version 312339 (0.0010) [2023-12-26 02:04:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 159506432. Throughput: 0: 9158.6, 1: 8852.8. Samples: 159489044. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:38,785][121949] Avg episode reward: [(0, '6092.771'), (1, '5909.877')] [2023-12-26 02:04:38,820][123090] Updated weights for policy 1, policy_version 310747 (0.0006) [2023-12-26 02:04:38,845][123091] Updated weights for policy 0, policy_version 312349 (0.0011) [2023-12-26 02:04:38,849][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000310752_79552512.pth... [2023-12-26 02:04:38,853][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000309728_79290368.pth [2023-12-26 02:04:38,854][123008] Saving new best policy, reward=5909.877! [2023-12-26 02:04:38,894][123091] Updated weights for policy 0, policy_version 312359 (0.0010) [2023-12-26 02:04:38,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000312368_79970304.pth... [2023-12-26 02:04:38,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000311280_79691776.pth [2023-12-26 02:04:39,696][123091] Updated weights for policy 0, policy_version 312369 (0.0010) [2023-12-26 02:04:39,708][123090] Updated weights for policy 1, policy_version 310757 (0.0008) [2023-12-26 02:04:39,752][123091] Updated weights for policy 0, policy_version 312379 (0.0010) [2023-12-26 02:04:39,776][123090] Updated weights for policy 1, policy_version 310767 (0.0008) [2023-12-26 02:04:39,810][123091] Updated weights for policy 0, policy_version 312389 (0.0006) [2023-12-26 02:04:39,845][123090] Updated weights for policy 1, policy_version 310777 (0.0010) [2023-12-26 02:04:39,880][123091] Updated weights for policy 0, policy_version 312399 (0.0007) [2023-12-26 02:04:40,696][123090] Updated weights for policy 1, policy_version 310787 (0.0009) [2023-12-26 02:04:40,720][123091] Updated weights for policy 0, policy_version 312409 (0.0009) [2023-12-26 02:04:40,758][123090] Updated weights for policy 1, policy_version 310797 (0.0008) [2023-12-26 02:04:40,775][123091] Updated weights for policy 0, policy_version 312419 (0.0005) [2023-12-26 02:04:40,810][123090] Updated weights for policy 1, policy_version 310807 (0.0009) [2023-12-26 02:04:40,836][123091] Updated weights for policy 0, policy_version 312429 (0.0007) [2023-12-26 02:04:41,675][123090] Updated weights for policy 1, policy_version 310817 (0.0009) [2023-12-26 02:04:41,700][123091] Updated weights for policy 0, policy_version 312439 (0.0008) [2023-12-26 02:04:41,747][123090] Updated weights for policy 1, policy_version 310827 (0.0009) [2023-12-26 02:04:41,776][123091] Updated weights for policy 0, policy_version 312449 (0.0008) [2023-12-26 02:04:41,815][123090] Updated weights for policy 1, policy_version 310837 (0.0010) [2023-12-26 02:04:41,844][123091] Updated weights for policy 0, policy_version 312459 (0.0009) [2023-12-26 02:04:41,880][123090] Updated weights for policy 1, policy_version 310847 (0.0007) [2023-12-26 02:04:42,643][123091] Updated weights for policy 0, policy_version 312469 (0.0009) [2023-12-26 02:04:42,708][123091] Updated weights for policy 0, policy_version 312479 (0.0009) [2023-12-26 02:04:42,727][123090] Updated weights for policy 1, policy_version 310857 (0.0009) [2023-12-26 02:04:42,768][123091] Updated weights for policy 0, policy_version 312489 (0.0008) [2023-12-26 02:04:42,792][123090] Updated weights for policy 1, policy_version 310867 (0.0007) [2023-12-26 02:04:42,853][123090] Updated weights for policy 1, policy_version 310877 (0.0009) [2023-12-26 02:04:43,570][123091] Updated weights for policy 0, policy_version 312499 (0.0008) [2023-12-26 02:04:43,578][123090] Updated weights for policy 1, policy_version 310887 (0.0009) [2023-12-26 02:04:43,637][123090] Updated weights for policy 1, policy_version 310897 (0.0008) [2023-12-26 02:04:43,639][123091] Updated weights for policy 0, policy_version 312509 (0.0005) [2023-12-26 02:04:43,693][123090] Updated weights for policy 1, policy_version 310907 (0.0010) [2023-12-26 02:04:43,704][123091] Updated weights for policy 0, policy_version 312519 (0.0006) [2023-12-26 02:04:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 159604736. Throughput: 0: 9063.3, 1: 8721.7. Samples: 159592064. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:43,785][121949] Avg episode reward: [(0, '6139.779'), (1, '5776.637')] [2023-12-26 02:04:44,253][123091] Updated weights for policy 0, policy_version 312529 (0.0006) [2023-12-26 02:04:44,309][123091] Updated weights for policy 0, policy_version 312539 (0.0009) [2023-12-26 02:04:44,369][123091] Updated weights for policy 0, policy_version 312549 (0.0009) [2023-12-26 02:04:44,428][123091] Updated weights for policy 0, policy_version 312559 (0.0008) [2023-12-26 02:04:44,438][123090] Updated weights for policy 1, policy_version 310917 (0.0009) [2023-12-26 02:04:44,495][123090] Updated weights for policy 1, policy_version 310927 (0.0011) [2023-12-26 02:04:44,557][123090] Updated weights for policy 1, policy_version 310937 (0.0010) [2023-12-26 02:04:45,266][123090] Updated weights for policy 1, policy_version 310947 (0.0006) [2023-12-26 02:04:45,315][123091] Updated weights for policy 0, policy_version 312569 (0.0007) [2023-12-26 02:04:45,334][123090] Updated weights for policy 1, policy_version 310957 (0.0006) [2023-12-26 02:04:45,380][123091] Updated weights for policy 0, policy_version 312579 (0.0008) [2023-12-26 02:04:45,392][123090] Updated weights for policy 1, policy_version 310967 (0.0007) [2023-12-26 02:04:45,432][123091] Updated weights for policy 0, policy_version 312589 (0.0010) [2023-12-26 02:04:46,152][123090] Updated weights for policy 1, policy_version 310977 (0.0007) [2023-12-26 02:04:46,213][123090] Updated weights for policy 1, policy_version 310987 (0.0009) [2023-12-26 02:04:46,280][123090] Updated weights for policy 1, policy_version 310997 (0.0010) [2023-12-26 02:04:46,286][123091] Updated weights for policy 0, policy_version 312599 (0.0009) [2023-12-26 02:04:46,344][123090] Updated weights for policy 1, policy_version 311007 (0.0008) [2023-12-26 02:04:46,346][123091] Updated weights for policy 0, policy_version 312609 (0.0007) [2023-12-26 02:04:46,411][123091] Updated weights for policy 0, policy_version 312619 (0.0009) [2023-12-26 02:04:47,060][123090] Updated weights for policy 1, policy_version 311017 (0.0008) [2023-12-26 02:04:47,110][123090] Updated weights for policy 1, policy_version 311027 (0.0009) [2023-12-26 02:04:47,167][123090] Updated weights for policy 1, policy_version 311037 (0.0009) [2023-12-26 02:04:47,251][123091] Updated weights for policy 0, policy_version 312629 (0.0010) [2023-12-26 02:04:47,307][123091] Updated weights for policy 0, policy_version 312639 (0.0010) [2023-12-26 02:04:47,355][123091] Updated weights for policy 0, policy_version 312649 (0.0009) [2023-12-26 02:04:47,938][123090] Updated weights for policy 1, policy_version 311047 (0.0009) [2023-12-26 02:04:48,003][123090] Updated weights for policy 1, policy_version 311057 (0.0009) [2023-12-26 02:04:48,069][123090] Updated weights for policy 1, policy_version 311067 (0.0009) [2023-12-26 02:04:48,219][123091] Updated weights for policy 0, policy_version 312659 (0.0009) [2023-12-26 02:04:48,279][123091] Updated weights for policy 0, policy_version 312669 (0.0009) [2023-12-26 02:04:48,344][123091] Updated weights for policy 0, policy_version 312679 (0.0011) [2023-12-26 02:04:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 159686656. Throughput: 0: 9093.0, 1: 8788.4. Samples: 159699868. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:48,785][121949] Avg episode reward: [(0, '6125.899'), (1, '5790.234')] [2023-12-26 02:04:48,824][123090] Updated weights for policy 1, policy_version 311077 (0.0009) [2023-12-26 02:04:48,886][123090] Updated weights for policy 1, policy_version 311087 (0.0008) [2023-12-26 02:04:48,943][123090] Updated weights for policy 1, policy_version 311097 (0.0010) [2023-12-26 02:04:49,140][123091] Updated weights for policy 0, policy_version 312689 (0.0009) [2023-12-26 02:04:49,208][123091] Updated weights for policy 0, policy_version 312699 (0.0009) [2023-12-26 02:04:49,273][123091] Updated weights for policy 0, policy_version 312709 (0.0010) [2023-12-26 02:04:49,331][123091] Updated weights for policy 0, policy_version 312719 (0.0009) [2023-12-26 02:04:49,676][123090] Updated weights for policy 1, policy_version 311107 (0.0009) [2023-12-26 02:04:49,748][123090] Updated weights for policy 1, policy_version 311117 (0.0006) [2023-12-26 02:04:49,819][123090] Updated weights for policy 1, policy_version 311127 (0.0008) [2023-12-26 02:04:50,195][123091] Updated weights for policy 0, policy_version 312729 (0.0009) [2023-12-26 02:04:50,256][123091] Updated weights for policy 0, policy_version 312739 (0.0008) [2023-12-26 02:04:50,309][123091] Updated weights for policy 0, policy_version 312749 (0.0005) [2023-12-26 02:04:50,524][123090] Updated weights for policy 1, policy_version 311137 (0.0009) [2023-12-26 02:04:50,595][123090] Updated weights for policy 1, policy_version 311147 (0.0007) [2023-12-26 02:04:50,670][123090] Updated weights for policy 1, policy_version 311157 (0.0006) [2023-12-26 02:04:50,739][123090] Updated weights for policy 1, policy_version 311167 (0.0010) [2023-12-26 02:04:51,098][123091] Updated weights for policy 0, policy_version 312759 (0.0007) [2023-12-26 02:04:51,168][123091] Updated weights for policy 0, policy_version 312769 (0.0010) [2023-12-26 02:04:51,220][123091] Updated weights for policy 0, policy_version 312779 (0.0010) [2023-12-26 02:04:51,559][123090] Updated weights for policy 1, policy_version 311177 (0.0009) [2023-12-26 02:04:51,622][123090] Updated weights for policy 1, policy_version 311187 (0.0010) [2023-12-26 02:04:51,689][123090] Updated weights for policy 1, policy_version 311197 (0.0009) [2023-12-26 02:04:52,073][123091] Updated weights for policy 0, policy_version 312789 (0.0009) [2023-12-26 02:04:52,125][123091] Updated weights for policy 0, policy_version 312799 (0.0006) [2023-12-26 02:04:52,191][123091] Updated weights for policy 0, policy_version 312809 (0.0005) [2023-12-26 02:04:52,483][123090] Updated weights for policy 1, policy_version 311207 (0.0010) [2023-12-26 02:04:52,538][123090] Updated weights for policy 1, policy_version 311217 (0.0009) [2023-12-26 02:04:52,590][123090] Updated weights for policy 1, policy_version 311227 (0.0009) [2023-12-26 02:04:52,943][123091] Updated weights for policy 0, policy_version 312819 (0.0007) [2023-12-26 02:04:52,996][123091] Updated weights for policy 0, policy_version 312829 (0.0009) [2023-12-26 02:04:53,046][123091] Updated weights for policy 0, policy_version 312839 (0.0010) [2023-12-26 02:04:53,418][123090] Updated weights for policy 1, policy_version 311237 (0.0009) [2023-12-26 02:04:53,488][123090] Updated weights for policy 1, policy_version 311248 (0.0009) [2023-12-26 02:04:53,540][123090] Updated weights for policy 1, policy_version 311258 (0.0009) [2023-12-26 02:04:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 159776768. Throughput: 0: 9015.6, 1: 8763.4. Samples: 159753488. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:53,785][121949] Avg episode reward: [(0, '6222.542'), (1, '5784.415')] [2023-12-26 02:04:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000311264_79683584.pth... [2023-12-26 02:04:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000312848_80093184.pth... [2023-12-26 02:04:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000311792_79822848.pth [2023-12-26 02:04:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000310208_79413248.pth [2023-12-26 02:04:53,875][123091] Updated weights for policy 0, policy_version 312849 (0.0010) [2023-12-26 02:04:53,927][123091] Updated weights for policy 0, policy_version 312859 (0.0009) [2023-12-26 02:04:53,990][123091] Updated weights for policy 0, policy_version 312869 (0.0009) [2023-12-26 02:04:54,051][123091] Updated weights for policy 0, policy_version 312879 (0.0010) [2023-12-26 02:04:54,338][123090] Updated weights for policy 1, policy_version 311268 (0.0008) [2023-12-26 02:04:54,408][123090] Updated weights for policy 1, policy_version 311278 (0.0009) [2023-12-26 02:04:54,472][123090] Updated weights for policy 1, policy_version 311288 (0.0010) [2023-12-26 02:04:54,920][123091] Updated weights for policy 0, policy_version 312889 (0.0009) [2023-12-26 02:04:54,978][123091] Updated weights for policy 0, policy_version 312899 (0.0010) [2023-12-26 02:04:55,030][123091] Updated weights for policy 0, policy_version 312909 (0.0010) [2023-12-26 02:04:55,183][123090] Updated weights for policy 1, policy_version 311298 (0.0009) [2023-12-26 02:04:55,249][123090] Updated weights for policy 1, policy_version 311308 (0.0009) [2023-12-26 02:04:55,308][123090] Updated weights for policy 1, policy_version 311318 (0.0009) [2023-12-26 02:04:55,360][123090] Updated weights for policy 1, policy_version 311328 (0.0008) [2023-12-26 02:04:55,838][123091] Updated weights for policy 0, policy_version 312919 (0.0008) [2023-12-26 02:04:55,902][123091] Updated weights for policy 0, policy_version 312929 (0.0009) [2023-12-26 02:04:55,956][123091] Updated weights for policy 0, policy_version 312939 (0.0009) [2023-12-26 02:04:56,041][123090] Updated weights for policy 1, policy_version 311338 (0.0009) [2023-12-26 02:04:56,108][123090] Updated weights for policy 1, policy_version 311348 (0.0010) [2023-12-26 02:04:56,172][123090] Updated weights for policy 1, policy_version 311358 (0.0010) [2023-12-26 02:04:56,624][123091] Updated weights for policy 0, policy_version 312949 (0.0008) [2023-12-26 02:04:56,676][123091] Updated weights for policy 0, policy_version 312959 (0.0008) [2023-12-26 02:04:56,730][123091] Updated weights for policy 0, policy_version 312969 (0.0010) [2023-12-26 02:04:57,035][123090] Updated weights for policy 1, policy_version 311368 (0.0010) [2023-12-26 02:04:57,100][123090] Updated weights for policy 1, policy_version 311378 (0.0009) [2023-12-26 02:04:57,165][123090] Updated weights for policy 1, policy_version 311388 (0.0009) [2023-12-26 02:04:57,551][123091] Updated weights for policy 0, policy_version 312979 (0.0009) [2023-12-26 02:04:57,621][123091] Updated weights for policy 0, policy_version 312989 (0.0008) [2023-12-26 02:04:57,688][123091] Updated weights for policy 0, policy_version 312999 (0.0010) [2023-12-26 02:04:57,982][123090] Updated weights for policy 1, policy_version 311398 (0.0009) [2023-12-26 02:04:58,050][123090] Updated weights for policy 1, policy_version 311408 (0.0010) [2023-12-26 02:04:58,116][123090] Updated weights for policy 1, policy_version 311418 (0.0009) [2023-12-26 02:04:58,539][123091] Updated weights for policy 0, policy_version 313009 (0.0006) [2023-12-26 02:04:58,609][123091] Updated weights for policy 0, policy_version 313019 (0.0009) [2023-12-26 02:04:58,678][123091] Updated weights for policy 0, policy_version 313029 (0.0010) [2023-12-26 02:04:58,746][123091] Updated weights for policy 0, policy_version 313039 (0.0010) [2023-12-26 02:04:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 159866880. Throughput: 0: 9015.7, 1: 8834.4. Samples: 159859284. Policy #0 lag: (min: 24.0, avg: 48.6, max: 56.0) [2023-12-26 02:04:58,784][121949] Avg episode reward: [(0, '6262.650'), (1, '5785.812')] [2023-12-26 02:04:58,953][123090] Updated weights for policy 1, policy_version 311428 (0.0009) [2023-12-26 02:04:59,008][123090] Updated weights for policy 1, policy_version 311438 (0.0007) [2023-12-26 02:04:59,076][123090] Updated weights for policy 1, policy_version 311448 (0.0007) [2023-12-26 02:04:59,569][123091] Updated weights for policy 0, policy_version 313049 (0.0009) [2023-12-26 02:04:59,635][123091] Updated weights for policy 0, policy_version 313059 (0.0008) [2023-12-26 02:04:59,703][123091] Updated weights for policy 0, policy_version 313069 (0.0010) [2023-12-26 02:04:59,897][123090] Updated weights for policy 1, policy_version 311458 (0.0009) [2023-12-26 02:04:59,975][123090] Updated weights for policy 1, policy_version 311468 (0.0009) [2023-12-26 02:05:00,047][123090] Updated weights for policy 1, policy_version 311478 (0.0010) [2023-12-26 02:05:00,113][123090] Updated weights for policy 1, policy_version 311488 (0.0010) [2023-12-26 02:05:00,512][123091] Updated weights for policy 0, policy_version 313079 (0.0008) [2023-12-26 02:05:00,560][123091] Updated weights for policy 0, policy_version 313089 (0.0009) [2023-12-26 02:05:00,611][123091] Updated weights for policy 0, policy_version 313099 (0.0010) [2023-12-26 02:05:00,892][123090] Updated weights for policy 1, policy_version 311498 (0.0010) [2023-12-26 02:05:00,945][123090] Updated weights for policy 1, policy_version 311508 (0.0009) [2023-12-26 02:05:00,993][123090] Updated weights for policy 1, policy_version 311518 (0.0009) [2023-12-26 02:05:01,471][123091] Updated weights for policy 0, policy_version 313109 (0.0010) [2023-12-26 02:05:01,525][123091] Updated weights for policy 0, policy_version 313119 (0.0010) [2023-12-26 02:05:01,580][123091] Updated weights for policy 0, policy_version 313130 (0.0009) [2023-12-26 02:05:01,855][123090] Updated weights for policy 1, policy_version 311528 (0.0009) [2023-12-26 02:05:01,912][123090] Updated weights for policy 1, policy_version 311538 (0.0010) [2023-12-26 02:05:01,982][123090] Updated weights for policy 1, policy_version 311548 (0.0010) [2023-12-26 02:05:02,430][123091] Updated weights for policy 0, policy_version 313140 (0.0009) [2023-12-26 02:05:02,502][123091] Updated weights for policy 0, policy_version 313150 (0.0009) [2023-12-26 02:05:02,570][123091] Updated weights for policy 0, policy_version 313160 (0.0008) [2023-12-26 02:05:02,876][123090] Updated weights for policy 1, policy_version 311558 (0.0009) [2023-12-26 02:05:02,931][123090] Updated weights for policy 1, policy_version 311568 (0.0010) [2023-12-26 02:05:02,994][123090] Updated weights for policy 1, policy_version 311578 (0.0010) [2023-12-26 02:05:03,325][123091] Updated weights for policy 0, policy_version 313170 (0.0009) [2023-12-26 02:05:03,371][123091] Updated weights for policy 0, policy_version 313180 (0.0010) [2023-12-26 02:05:03,415][123091] Updated weights for policy 0, policy_version 313190 (0.0010) [2023-12-26 02:05:03,469][123091] Updated weights for policy 0, policy_version 313200 (0.0010) [2023-12-26 02:05:03,699][123090] Updated weights for policy 1, policy_version 311588 (0.0008) [2023-12-26 02:05:03,766][123090] Updated weights for policy 1, policy_version 311598 (0.0005) [2023-12-26 02:05:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 159948800. Throughput: 0: 8956.8, 1: 8813.8. Samples: 159962732. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:03,785][121949] Avg episode reward: [(0, '6345.368'), (1, '5687.326')] [2023-12-26 02:05:03,815][123090] Updated weights for policy 1, policy_version 311608 (0.0005) [2023-12-26 02:05:04,273][123091] Updated weights for policy 0, policy_version 313210 (0.0011) [2023-12-26 02:05:04,340][123091] Updated weights for policy 0, policy_version 313220 (0.0011) [2023-12-26 02:05:04,403][123091] Updated weights for policy 0, policy_version 313230 (0.0011) [2023-12-26 02:05:04,598][123090] Updated weights for policy 1, policy_version 311618 (0.0008) [2023-12-26 02:05:04,665][123090] Updated weights for policy 1, policy_version 311628 (0.0008) [2023-12-26 02:05:04,725][123090] Updated weights for policy 1, policy_version 311638 (0.0006) [2023-12-26 02:05:04,794][123090] Updated weights for policy 1, policy_version 311648 (0.0010) [2023-12-26 02:05:05,210][123091] Updated weights for policy 0, policy_version 313240 (0.0007) [2023-12-26 02:05:05,271][123091] Updated weights for policy 0, policy_version 313250 (0.0010) [2023-12-26 02:05:05,329][123091] Updated weights for policy 0, policy_version 313260 (0.0010) [2023-12-26 02:05:05,588][123090] Updated weights for policy 1, policy_version 311658 (0.0006) [2023-12-26 02:05:05,641][123090] Updated weights for policy 1, policy_version 311668 (0.0005) [2023-12-26 02:05:05,687][123090] Updated weights for policy 1, policy_version 311678 (0.0005) [2023-12-26 02:05:06,132][123091] Updated weights for policy 0, policy_version 313270 (0.0011) [2023-12-26 02:05:06,203][123091] Updated weights for policy 0, policy_version 313280 (0.0011) [2023-12-26 02:05:06,271][123091] Updated weights for policy 0, policy_version 313290 (0.0011) [2023-12-26 02:05:06,543][123090] Updated weights for policy 1, policy_version 311688 (0.0009) [2023-12-26 02:05:06,611][123090] Updated weights for policy 1, policy_version 311698 (0.0009) [2023-12-26 02:05:06,670][123090] Updated weights for policy 1, policy_version 311708 (0.0009) [2023-12-26 02:05:06,954][123091] Updated weights for policy 0, policy_version 313300 (0.0011) [2023-12-26 02:05:07,020][123091] Updated weights for policy 0, policy_version 313310 (0.0007) [2023-12-26 02:05:07,093][123091] Updated weights for policy 0, policy_version 313320 (0.0006) [2023-12-26 02:05:07,559][123090] Updated weights for policy 1, policy_version 311718 (0.0009) [2023-12-26 02:05:07,616][123090] Updated weights for policy 1, policy_version 311728 (0.0006) [2023-12-26 02:05:07,670][123090] Updated weights for policy 1, policy_version 311738 (0.0005) [2023-12-26 02:05:07,790][123091] Updated weights for policy 0, policy_version 313330 (0.0009) [2023-12-26 02:05:07,844][123091] Updated weights for policy 0, policy_version 313340 (0.0005) [2023-12-26 02:05:07,897][123091] Updated weights for policy 0, policy_version 313350 (0.0005) [2023-12-26 02:05:07,947][123091] Updated weights for policy 0, policy_version 313360 (0.0005) [2023-12-26 02:05:08,358][123090] Updated weights for policy 1, policy_version 311748 (0.0009) [2023-12-26 02:05:08,425][123090] Updated weights for policy 1, policy_version 311758 (0.0010) [2023-12-26 02:05:08,491][123090] Updated weights for policy 1, policy_version 311768 (0.0008) [2023-12-26 02:05:08,681][123091] Updated weights for policy 0, policy_version 313370 (0.0009) [2023-12-26 02:05:08,737][123091] Updated weights for policy 0, policy_version 313380 (0.0009) [2023-12-26 02:05:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 160038912. Throughput: 0: 8982.2, 1: 8852.4. Samples: 160016516. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:08,785][121949] Avg episode reward: [(0, '6348.732'), (1, '5749.678')] [2023-12-26 02:05:08,790][123091] Updated weights for policy 0, policy_version 313390 (0.0009) [2023-12-26 02:05:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000311776_79814656.pth... [2023-12-26 02:05:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000310752_79552512.pth [2023-12-26 02:05:08,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000313392_80232448.pth... [2023-12-26 02:05:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000312368_79970304.pth [2023-12-26 02:05:09,320][123090] Updated weights for policy 1, policy_version 311778 (0.0010) [2023-12-26 02:05:09,392][123090] Updated weights for policy 1, policy_version 311788 (0.0010) [2023-12-26 02:05:09,459][123090] Updated weights for policy 1, policy_version 311798 (0.0009) [2023-12-26 02:05:09,511][123090] Updated weights for policy 1, policy_version 311808 (0.0010) [2023-12-26 02:05:09,634][123091] Updated weights for policy 0, policy_version 313400 (0.0008) [2023-12-26 02:05:09,688][123091] Updated weights for policy 0, policy_version 313410 (0.0010) [2023-12-26 02:05:09,750][123091] Updated weights for policy 0, policy_version 313420 (0.0010) [2023-12-26 02:05:10,352][123090] Updated weights for policy 1, policy_version 311818 (0.0009) [2023-12-26 02:05:10,406][123090] Updated weights for policy 1, policy_version 311828 (0.0010) [2023-12-26 02:05:10,459][123090] Updated weights for policy 1, policy_version 311838 (0.0009) [2023-12-26 02:05:10,542][123091] Updated weights for policy 0, policy_version 313430 (0.0008) [2023-12-26 02:05:10,605][123091] Updated weights for policy 0, policy_version 313440 (0.0006) [2023-12-26 02:05:10,665][123091] Updated weights for policy 0, policy_version 313450 (0.0008) [2023-12-26 02:05:11,381][123091] Updated weights for policy 0, policy_version 313460 (0.0009) [2023-12-26 02:05:11,393][123090] Updated weights for policy 1, policy_version 311848 (0.0009) [2023-12-26 02:05:11,452][123091] Updated weights for policy 0, policy_version 313470 (0.0009) [2023-12-26 02:05:11,458][123090] Updated weights for policy 1, policy_version 311858 (0.0006) [2023-12-26 02:05:11,519][123091] Updated weights for policy 0, policy_version 313480 (0.0009) [2023-12-26 02:05:11,526][123090] Updated weights for policy 1, policy_version 311868 (0.0006) [2023-12-26 02:05:12,349][123091] Updated weights for policy 0, policy_version 313490 (0.0009) [2023-12-26 02:05:12,351][123090] Updated weights for policy 1, policy_version 311878 (0.0008) [2023-12-26 02:05:12,414][123090] Updated weights for policy 1, policy_version 311888 (0.0009) [2023-12-26 02:05:12,419][123091] Updated weights for policy 0, policy_version 313500 (0.0008) [2023-12-26 02:05:12,468][123090] Updated weights for policy 1, policy_version 311898 (0.0006) [2023-12-26 02:05:12,482][123091] Updated weights for policy 0, policy_version 313510 (0.0010) [2023-12-26 02:05:12,548][123091] Updated weights for policy 0, policy_version 313520 (0.0010) [2023-12-26 02:05:13,325][123090] Updated weights for policy 1, policy_version 311908 (0.0007) [2023-12-26 02:05:13,353][123091] Updated weights for policy 0, policy_version 313530 (0.0006) [2023-12-26 02:05:13,374][123090] Updated weights for policy 1, policy_version 311918 (0.0009) [2023-12-26 02:05:13,400][123091] Updated weights for policy 0, policy_version 313540 (0.0005) [2023-12-26 02:05:13,423][123090] Updated weights for policy 1, policy_version 311928 (0.0009) [2023-12-26 02:05:13,457][123091] Updated weights for policy 0, policy_version 313550 (0.0007) [2023-12-26 02:05:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 160129024. Throughput: 0: 8890.4, 1: 8803.6. Samples: 160119068. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:13,785][121949] Avg episode reward: [(0, '6337.353'), (1, '5862.925')] [2023-12-26 02:05:14,187][123091] Updated weights for policy 0, policy_version 313560 (0.0006) [2023-12-26 02:05:14,197][123090] Updated weights for policy 1, policy_version 311938 (0.0008) [2023-12-26 02:05:14,249][123091] Updated weights for policy 0, policy_version 313570 (0.0007) [2023-12-26 02:05:14,258][123090] Updated weights for policy 1, policy_version 311948 (0.0009) [2023-12-26 02:05:14,312][123091] Updated weights for policy 0, policy_version 313580 (0.0006) [2023-12-26 02:05:14,312][123090] Updated weights for policy 1, policy_version 311958 (0.0009) [2023-12-26 02:05:14,370][123090] Updated weights for policy 1, policy_version 311968 (0.0009) [2023-12-26 02:05:15,066][123091] Updated weights for policy 0, policy_version 313590 (0.0009) [2023-12-26 02:05:15,132][123091] Updated weights for policy 0, policy_version 313600 (0.0009) [2023-12-26 02:05:15,197][123091] Updated weights for policy 0, policy_version 313610 (0.0009) [2023-12-26 02:05:15,224][123090] Updated weights for policy 1, policy_version 311978 (0.0007) [2023-12-26 02:05:15,277][123090] Updated weights for policy 1, policy_version 311988 (0.0009) [2023-12-26 02:05:15,331][123090] Updated weights for policy 1, policy_version 311998 (0.0009) [2023-12-26 02:05:16,024][123091] Updated weights for policy 0, policy_version 313620 (0.0007) [2023-12-26 02:05:16,078][123091] Updated weights for policy 0, policy_version 313630 (0.0005) [2023-12-26 02:05:16,133][123091] Updated weights for policy 0, policy_version 313640 (0.0008) [2023-12-26 02:05:16,192][123090] Updated weights for policy 1, policy_version 312008 (0.0009) [2023-12-26 02:05:16,246][123090] Updated weights for policy 1, policy_version 312018 (0.0010) [2023-12-26 02:05:16,309][123090] Updated weights for policy 1, policy_version 312028 (0.0010) [2023-12-26 02:05:16,790][123091] Updated weights for policy 0, policy_version 313650 (0.0008) [2023-12-26 02:05:16,851][123091] Updated weights for policy 0, policy_version 313660 (0.0005) [2023-12-26 02:05:16,911][123091] Updated weights for policy 0, policy_version 313670 (0.0005) [2023-12-26 02:05:16,962][123091] Updated weights for policy 0, policy_version 313680 (0.0005) [2023-12-26 02:05:17,203][123090] Updated weights for policy 1, policy_version 312038 (0.0007) [2023-12-26 02:05:17,275][123090] Updated weights for policy 1, policy_version 312048 (0.0007) [2023-12-26 02:05:17,331][123090] Updated weights for policy 1, policy_version 312058 (0.0007) [2023-12-26 02:05:17,612][123091] Updated weights for policy 0, policy_version 313690 (0.0005) [2023-12-26 02:05:17,668][123091] Updated weights for policy 0, policy_version 313700 (0.0007) [2023-12-26 02:05:17,729][123091] Updated weights for policy 0, policy_version 313710 (0.0006) [2023-12-26 02:05:18,033][123090] Updated weights for policy 1, policy_version 312068 (0.0007) [2023-12-26 02:05:18,084][123090] Updated weights for policy 1, policy_version 312078 (0.0009) [2023-12-26 02:05:18,139][123090] Updated weights for policy 1, policy_version 312088 (0.0010) [2023-12-26 02:05:18,406][123091] Updated weights for policy 0, policy_version 313720 (0.0008) [2023-12-26 02:05:18,464][123091] Updated weights for policy 0, policy_version 313730 (0.0008) [2023-12-26 02:05:18,519][123091] Updated weights for policy 0, policy_version 313740 (0.0008) [2023-12-26 02:05:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 160219136. Throughput: 0: 8917.5, 1: 8751.4. Samples: 160228936. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:18,785][121949] Avg episode reward: [(0, '6348.176'), (1, '5862.076')] [2023-12-26 02:05:18,986][123090] Updated weights for policy 1, policy_version 312098 (0.0010) [2023-12-26 02:05:19,049][123090] Updated weights for policy 1, policy_version 312108 (0.0010) [2023-12-26 02:05:19,116][123090] Updated weights for policy 1, policy_version 312118 (0.0011) [2023-12-26 02:05:19,179][123090] Updated weights for policy 1, policy_version 312128 (0.0010) [2023-12-26 02:05:19,290][123091] Updated weights for policy 0, policy_version 313750 (0.0009) [2023-12-26 02:05:19,357][123091] Updated weights for policy 0, policy_version 313760 (0.0010) [2023-12-26 02:05:19,425][123091] Updated weights for policy 0, policy_version 313770 (0.0009) [2023-12-26 02:05:20,003][123090] Updated weights for policy 1, policy_version 312138 (0.0006) [2023-12-26 02:05:20,053][123090] Updated weights for policy 1, policy_version 312148 (0.0006) [2023-12-26 02:05:20,107][123090] Updated weights for policy 1, policy_version 312158 (0.0009) [2023-12-26 02:05:20,276][123091] Updated weights for policy 0, policy_version 313780 (0.0009) [2023-12-26 02:05:20,333][123091] Updated weights for policy 0, policy_version 313790 (0.0006) [2023-12-26 02:05:20,403][123091] Updated weights for policy 0, policy_version 313800 (0.0006) [2023-12-26 02:05:21,021][123090] Updated weights for policy 1, policy_version 312168 (0.0010) [2023-12-26 02:05:21,091][123090] Updated weights for policy 1, policy_version 312178 (0.0010) [2023-12-26 02:05:21,107][123091] Updated weights for policy 0, policy_version 313810 (0.0006) [2023-12-26 02:05:21,153][123090] Updated weights for policy 1, policy_version 312188 (0.0008) [2023-12-26 02:05:21,174][123091] Updated weights for policy 0, policy_version 313820 (0.0008) [2023-12-26 02:05:21,240][123091] Updated weights for policy 0, policy_version 313830 (0.0009) [2023-12-26 02:05:21,315][123091] Updated weights for policy 0, policy_version 313840 (0.0010) [2023-12-26 02:05:21,932][123090] Updated weights for policy 1, policy_version 312198 (0.0007) [2023-12-26 02:05:21,991][123090] Updated weights for policy 1, policy_version 312208 (0.0005) [2023-12-26 02:05:22,056][123090] Updated weights for policy 1, policy_version 312218 (0.0005) [2023-12-26 02:05:22,220][123091] Updated weights for policy 0, policy_version 313850 (0.0010) [2023-12-26 02:05:22,282][123091] Updated weights for policy 0, policy_version 313860 (0.0007) [2023-12-26 02:05:22,345][123091] Updated weights for policy 0, policy_version 313870 (0.0006) [2023-12-26 02:05:22,895][123090] Updated weights for policy 1, policy_version 312228 (0.0008) [2023-12-26 02:05:22,968][123090] Updated weights for policy 1, policy_version 312238 (0.0006) [2023-12-26 02:05:23,041][123090] Updated weights for policy 1, policy_version 312248 (0.0006) [2023-12-26 02:05:23,223][123091] Updated weights for policy 0, policy_version 313880 (0.0006) [2023-12-26 02:05:23,290][123091] Updated weights for policy 0, policy_version 313890 (0.0005) [2023-12-26 02:05:23,354][123091] Updated weights for policy 0, policy_version 313900 (0.0006) [2023-12-26 02:05:23,741][123090] Updated weights for policy 1, policy_version 312258 (0.0007) [2023-12-26 02:05:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 160301056. Throughput: 0: 8886.1, 1: 8701.8. Samples: 160280500. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:23,785][121949] Avg episode reward: [(0, '6292.228'), (1, '5840.525')] [2023-12-26 02:05:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000313904_80363520.pth... [2023-12-26 02:05:23,793][123090] Updated weights for policy 1, policy_version 312268 (0.0010) [2023-12-26 02:05:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000312848_80093184.pth [2023-12-26 02:05:23,844][123090] Updated weights for policy 1, policy_version 312278 (0.0010) [2023-12-26 02:05:23,906][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000312288_79945728.pth... [2023-12-26 02:05:23,906][123090] Updated weights for policy 1, policy_version 312288 (0.0010) [2023-12-26 02:05:23,911][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000311264_79683584.pth [2023-12-26 02:05:24,087][123091] Updated weights for policy 0, policy_version 313910 (0.0009) [2023-12-26 02:05:24,159][123091] Updated weights for policy 0, policy_version 313920 (0.0006) [2023-12-26 02:05:24,227][123091] Updated weights for policy 0, policy_version 313930 (0.0005) [2023-12-26 02:05:24,720][123090] Updated weights for policy 1, policy_version 312298 (0.0005) [2023-12-26 02:05:24,775][123090] Updated weights for policy 1, policy_version 312308 (0.0005) [2023-12-26 02:05:24,827][123090] Updated weights for policy 1, policy_version 312318 (0.0008) [2023-12-26 02:05:24,955][123091] Updated weights for policy 0, policy_version 313940 (0.0008) [2023-12-26 02:05:25,009][123091] Updated weights for policy 0, policy_version 313950 (0.0010) [2023-12-26 02:05:25,078][123091] Updated weights for policy 0, policy_version 313960 (0.0005) [2023-12-26 02:05:25,550][123090] Updated weights for policy 1, policy_version 312328 (0.0006) [2023-12-26 02:05:25,605][123090] Updated weights for policy 1, policy_version 312338 (0.0005) [2023-12-26 02:05:25,663][123090] Updated weights for policy 1, policy_version 312348 (0.0005) [2023-12-26 02:05:25,736][123091] Updated weights for policy 0, policy_version 313970 (0.0005) [2023-12-26 02:05:25,805][123091] Updated weights for policy 0, policy_version 313980 (0.0005) [2023-12-26 02:05:25,867][123091] Updated weights for policy 0, policy_version 313990 (0.0005) [2023-12-26 02:05:25,925][123091] Updated weights for policy 0, policy_version 314000 (0.0005) [2023-12-26 02:05:26,314][123090] Updated weights for policy 1, policy_version 312358 (0.0005) [2023-12-26 02:05:26,366][123090] Updated weights for policy 1, policy_version 312368 (0.0008) [2023-12-26 02:05:26,423][123090] Updated weights for policy 1, policy_version 312378 (0.0008) [2023-12-26 02:05:26,635][123091] Updated weights for policy 0, policy_version 314010 (0.0010) [2023-12-26 02:05:26,705][123091] Updated weights for policy 0, policy_version 314020 (0.0010) [2023-12-26 02:05:26,775][123091] Updated weights for policy 0, policy_version 314030 (0.0011) [2023-12-26 02:05:27,248][123090] Updated weights for policy 1, policy_version 312388 (0.0009) [2023-12-26 02:05:27,314][123090] Updated weights for policy 1, policy_version 312398 (0.0009) [2023-12-26 02:05:27,384][123090] Updated weights for policy 1, policy_version 312408 (0.0006) [2023-12-26 02:05:27,526][123091] Updated weights for policy 0, policy_version 314040 (0.0008) [2023-12-26 02:05:27,592][123091] Updated weights for policy 0, policy_version 314050 (0.0009) [2023-12-26 02:05:27,655][123091] Updated weights for policy 0, policy_version 314060 (0.0011) [2023-12-26 02:05:28,178][123090] Updated weights for policy 1, policy_version 312418 (0.0006) [2023-12-26 02:05:28,243][123090] Updated weights for policy 1, policy_version 312429 (0.0010) [2023-12-26 02:05:28,299][123090] Updated weights for policy 1, policy_version 312439 (0.0010) [2023-12-26 02:05:28,431][123091] Updated weights for policy 0, policy_version 314070 (0.0010) [2023-12-26 02:05:28,494][123091] Updated weights for policy 0, policy_version 314080 (0.0010) [2023-12-26 02:05:28,545][123091] Updated weights for policy 0, policy_version 314090 (0.0009) [2023-12-26 02:05:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 160399360. Throughput: 0: 8929.0, 1: 8828.7. Samples: 160391160. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:28,785][121949] Avg episode reward: [(0, '6293.976'), (1, '5878.960')] [2023-12-26 02:05:29,157][123090] Updated weights for policy 1, policy_version 312449 (0.0010) [2023-12-26 02:05:29,253][123090] Updated weights for policy 1, policy_version 312459 (0.0010) [2023-12-26 02:05:29,315][123090] Updated weights for policy 1, policy_version 312469 (0.0009) [2023-12-26 02:05:29,375][123091] Updated weights for policy 0, policy_version 314100 (0.0008) [2023-12-26 02:05:29,390][123090] Updated weights for policy 1, policy_version 312480 (0.0010) [2023-12-26 02:05:29,451][123091] Updated weights for policy 0, policy_version 314110 (0.0010) [2023-12-26 02:05:29,518][123091] Updated weights for policy 0, policy_version 314120 (0.0011) [2023-12-26 02:05:30,120][123090] Updated weights for policy 1, policy_version 312490 (0.0009) [2023-12-26 02:05:30,172][123090] Updated weights for policy 1, policy_version 312500 (0.0009) [2023-12-26 02:05:30,228][123090] Updated weights for policy 1, policy_version 312510 (0.0009) [2023-12-26 02:05:30,319][123091] Updated weights for policy 0, policy_version 314130 (0.0011) [2023-12-26 02:05:30,372][123091] Updated weights for policy 0, policy_version 314140 (0.0010) [2023-12-26 02:05:30,415][123091] Updated weights for policy 0, policy_version 314150 (0.0010) [2023-12-26 02:05:30,464][123091] Updated weights for policy 0, policy_version 314160 (0.0011) [2023-12-26 02:05:31,080][123090] Updated weights for policy 1, policy_version 312520 (0.0009) [2023-12-26 02:05:31,139][123090] Updated weights for policy 1, policy_version 312530 (0.0009) [2023-12-26 02:05:31,206][123090] Updated weights for policy 1, policy_version 312540 (0.0009) [2023-12-26 02:05:31,317][123091] Updated weights for policy 0, policy_version 314170 (0.0011) [2023-12-26 02:05:31,396][123091] Updated weights for policy 0, policy_version 314180 (0.0010) [2023-12-26 02:05:31,448][123091] Updated weights for policy 0, policy_version 314190 (0.0010) [2023-12-26 02:05:32,073][123090] Updated weights for policy 1, policy_version 312550 (0.0009) [2023-12-26 02:05:32,133][123090] Updated weights for policy 1, policy_version 312560 (0.0009) [2023-12-26 02:05:32,189][123090] Updated weights for policy 1, policy_version 312570 (0.0008) [2023-12-26 02:05:32,273][123091] Updated weights for policy 0, policy_version 314200 (0.0010) [2023-12-26 02:05:32,325][123091] Updated weights for policy 0, policy_version 314210 (0.0010) [2023-12-26 02:05:32,395][123091] Updated weights for policy 0, policy_version 314220 (0.0011) [2023-12-26 02:05:33,055][123090] Updated weights for policy 1, policy_version 312580 (0.0009) [2023-12-26 02:05:33,116][123090] Updated weights for policy 1, policy_version 312590 (0.0009) [2023-12-26 02:05:33,193][123090] Updated weights for policy 1, policy_version 312600 (0.0009) [2023-12-26 02:05:33,250][123091] Updated weights for policy 0, policy_version 314230 (0.0008) [2023-12-26 02:05:33,313][123091] Updated weights for policy 0, policy_version 314240 (0.0009) [2023-12-26 02:05:33,367][123091] Updated weights for policy 0, policy_version 314250 (0.0009) [2023-12-26 02:05:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 160481280. Throughput: 0: 8943.1, 1: 8707.5. Samples: 160494144. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:33,785][121949] Avg episode reward: [(0, '6345.674'), (1, '5874.722')] [2023-12-26 02:05:33,951][123091] Updated weights for policy 0, policy_version 314260 (0.0006) [2023-12-26 02:05:34,005][123091] Updated weights for policy 0, policy_version 314270 (0.0010) [2023-12-26 02:05:34,017][123090] Updated weights for policy 1, policy_version 312610 (0.0008) [2023-12-26 02:05:34,052][123091] Updated weights for policy 0, policy_version 314280 (0.0010) [2023-12-26 02:05:34,073][123090] Updated weights for policy 1, policy_version 312620 (0.0009) [2023-12-26 02:05:34,136][123090] Updated weights for policy 1, policy_version 312630 (0.0010) [2023-12-26 02:05:34,204][123090] Updated weights for policy 1, policy_version 312640 (0.0011) [2023-12-26 02:05:34,900][123091] Updated weights for policy 0, policy_version 314290 (0.0010) [2023-12-26 02:05:34,947][123091] Updated weights for policy 0, policy_version 314300 (0.0010) [2023-12-26 02:05:34,996][123091] Updated weights for policy 0, policy_version 314310 (0.0010) [2023-12-26 02:05:35,020][123090] Updated weights for policy 1, policy_version 312650 (0.0006) [2023-12-26 02:05:35,040][123091] Updated weights for policy 0, policy_version 314320 (0.0010) [2023-12-26 02:05:35,066][123090] Updated weights for policy 1, policy_version 312660 (0.0007) [2023-12-26 02:05:35,134][123090] Updated weights for policy 1, policy_version 312670 (0.0009) [2023-12-26 02:05:35,877][123090] Updated weights for policy 1, policy_version 312680 (0.0006) [2023-12-26 02:05:35,906][123091] Updated weights for policy 0, policy_version 314330 (0.0011) [2023-12-26 02:05:35,937][123090] Updated weights for policy 1, policy_version 312690 (0.0005) [2023-12-26 02:05:35,969][123091] Updated weights for policy 0, policy_version 314340 (0.0010) [2023-12-26 02:05:35,993][123090] Updated weights for policy 1, policy_version 312700 (0.0005) [2023-12-26 02:05:36,032][123091] Updated weights for policy 0, policy_version 314350 (0.0008) [2023-12-26 02:05:36,705][123090] Updated weights for policy 1, policy_version 312710 (0.0006) [2023-12-26 02:05:36,765][123090] Updated weights for policy 1, policy_version 312720 (0.0005) [2023-12-26 02:05:36,808][123091] Updated weights for policy 0, policy_version 314360 (0.0010) [2023-12-26 02:05:36,821][123090] Updated weights for policy 1, policy_version 312730 (0.0005) [2023-12-26 02:05:36,860][123091] Updated weights for policy 0, policy_version 314370 (0.0011) [2023-12-26 02:05:36,908][123091] Updated weights for policy 0, policy_version 314380 (0.0010) [2023-12-26 02:05:37,442][123090] Updated weights for policy 1, policy_version 312740 (0.0005) [2023-12-26 02:05:37,522][123090] Updated weights for policy 1, policy_version 312750 (0.0006) [2023-12-26 02:05:37,600][123090] Updated weights for policy 1, policy_version 312760 (0.0006) [2023-12-26 02:05:37,719][123091] Updated weights for policy 0, policy_version 314390 (0.0008) [2023-12-26 02:05:37,781][123091] Updated weights for policy 0, policy_version 314400 (0.0005) [2023-12-26 02:05:37,841][123091] Updated weights for policy 0, policy_version 314410 (0.0005) [2023-12-26 02:05:38,258][123090] Updated weights for policy 1, policy_version 312770 (0.0005) [2023-12-26 02:05:38,312][123090] Updated weights for policy 1, policy_version 312780 (0.0006) [2023-12-26 02:05:38,381][123090] Updated weights for policy 1, policy_version 312790 (0.0008) [2023-12-26 02:05:38,448][123090] Updated weights for policy 1, policy_version 312800 (0.0008) [2023-12-26 02:05:38,640][123091] Updated weights for policy 0, policy_version 314420 (0.0007) [2023-12-26 02:05:38,698][123091] Updated weights for policy 0, policy_version 314430 (0.0010) [2023-12-26 02:05:38,760][123091] Updated weights for policy 0, policy_version 314440 (0.0010) [2023-12-26 02:05:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 160571392. Throughput: 0: 8953.9, 1: 8708.0. Samples: 160548272. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:38,785][121949] Avg episode reward: [(0, '6312.069'), (1, '5821.665')] [2023-12-26 02:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000312800_80076800.pth... [2023-12-26 02:05:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000311776_79814656.pth [2023-12-26 02:05:38,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000314448_80502784.pth... [2023-12-26 02:05:38,808][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000313392_80232448.pth [2023-12-26 02:05:39,135][123090] Updated weights for policy 1, policy_version 312810 (0.0008) [2023-12-26 02:05:39,202][123090] Updated weights for policy 1, policy_version 312820 (0.0007) [2023-12-26 02:05:39,265][123090] Updated weights for policy 1, policy_version 312830 (0.0011) [2023-12-26 02:05:39,695][123091] Updated weights for policy 0, policy_version 314450 (0.0009) [2023-12-26 02:05:39,763][123091] Updated weights for policy 0, policy_version 314460 (0.0006) [2023-12-26 02:05:39,820][123091] Updated weights for policy 0, policy_version 314470 (0.0006) [2023-12-26 02:05:39,895][123091] Updated weights for policy 0, policy_version 314480 (0.0008) [2023-12-26 02:05:39,992][123090] Updated weights for policy 1, policy_version 312840 (0.0011) [2023-12-26 02:05:40,062][123090] Updated weights for policy 1, policy_version 312850 (0.0011) [2023-12-26 02:05:40,125][123090] Updated weights for policy 1, policy_version 312860 (0.0010) [2023-12-26 02:05:40,679][123091] Updated weights for policy 0, policy_version 314490 (0.0010) [2023-12-26 02:05:40,749][123091] Updated weights for policy 0, policy_version 314500 (0.0010) [2023-12-26 02:05:40,817][123091] Updated weights for policy 0, policy_version 314510 (0.0009) [2023-12-26 02:05:40,976][123090] Updated weights for policy 1, policy_version 312870 (0.0010) [2023-12-26 02:05:41,031][123090] Updated weights for policy 1, policy_version 312880 (0.0010) [2023-12-26 02:05:41,098][123090] Updated weights for policy 1, policy_version 312890 (0.0009) [2023-12-26 02:05:41,640][123091] Updated weights for policy 0, policy_version 314520 (0.0009) [2023-12-26 02:05:41,709][123091] Updated weights for policy 0, policy_version 314530 (0.0008) [2023-12-26 02:05:41,780][123091] Updated weights for policy 0, policy_version 314540 (0.0012) [2023-12-26 02:05:42,014][123090] Updated weights for policy 1, policy_version 312900 (0.0010) [2023-12-26 02:05:42,077][123090] Updated weights for policy 1, policy_version 312910 (0.0010) [2023-12-26 02:05:42,141][123090] Updated weights for policy 1, policy_version 312920 (0.0010) [2023-12-26 02:05:42,487][123091] Updated weights for policy 0, policy_version 314550 (0.0009) [2023-12-26 02:05:42,543][123091] Updated weights for policy 0, policy_version 314560 (0.0011) [2023-12-26 02:05:42,611][123091] Updated weights for policy 0, policy_version 314570 (0.0011) [2023-12-26 02:05:43,012][123090] Updated weights for policy 1, policy_version 312930 (0.0010) [2023-12-26 02:05:43,061][123090] Updated weights for policy 1, policy_version 312940 (0.0010) [2023-12-26 02:05:43,105][123090] Updated weights for policy 1, policy_version 312950 (0.0010) [2023-12-26 02:05:43,160][123090] Updated weights for policy 1, policy_version 312960 (0.0010) [2023-12-26 02:05:43,280][123091] Updated weights for policy 0, policy_version 314580 (0.0007) [2023-12-26 02:05:43,340][123091] Updated weights for policy 0, policy_version 314590 (0.0005) [2023-12-26 02:05:43,396][123091] Updated weights for policy 0, policy_version 314600 (0.0006) [2023-12-26 02:05:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 160661504. Throughput: 0: 8945.0, 1: 8748.2. Samples: 160655484. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:43,785][121949] Avg episode reward: [(0, '6310.380'), (1, '5865.866')] [2023-12-26 02:05:43,921][123090] Updated weights for policy 1, policy_version 312970 (0.0006) [2023-12-26 02:05:43,964][123091] Updated weights for policy 0, policy_version 314610 (0.0005) [2023-12-26 02:05:43,983][123090] Updated weights for policy 1, policy_version 312980 (0.0006) [2023-12-26 02:05:44,035][123091] Updated weights for policy 0, policy_version 314620 (0.0006) [2023-12-26 02:05:44,036][123090] Updated weights for policy 1, policy_version 312990 (0.0006) [2023-12-26 02:05:44,096][123091] Updated weights for policy 0, policy_version 314630 (0.0005) [2023-12-26 02:05:44,161][123091] Updated weights for policy 0, policy_version 314640 (0.0006) [2023-12-26 02:05:44,710][123090] Updated weights for policy 1, policy_version 313000 (0.0006) [2023-12-26 02:05:44,769][123090] Updated weights for policy 1, policy_version 313010 (0.0007) [2023-12-26 02:05:44,820][123091] Updated weights for policy 0, policy_version 314650 (0.0009) [2023-12-26 02:05:44,835][123090] Updated weights for policy 1, policy_version 313020 (0.0008) [2023-12-26 02:05:44,880][123091] Updated weights for policy 0, policy_version 314660 (0.0009) [2023-12-26 02:05:44,943][123091] Updated weights for policy 0, policy_version 314670 (0.0009) [2023-12-26 02:05:45,645][123090] Updated weights for policy 1, policy_version 313030 (0.0008) [2023-12-26 02:05:45,704][123090] Updated weights for policy 1, policy_version 313040 (0.0010) [2023-12-26 02:05:45,754][123091] Updated weights for policy 0, policy_version 314680 (0.0008) [2023-12-26 02:05:45,758][123090] Updated weights for policy 1, policy_version 313050 (0.0008) [2023-12-26 02:05:45,810][123091] Updated weights for policy 0, policy_version 314690 (0.0007) [2023-12-26 02:05:45,861][123091] Updated weights for policy 0, policy_version 314700 (0.0009) [2023-12-26 02:05:46,613][123090] Updated weights for policy 1, policy_version 313060 (0.0010) [2023-12-26 02:05:46,680][123091] Updated weights for policy 0, policy_version 314710 (0.0007) [2023-12-26 02:05:46,683][123090] Updated weights for policy 1, policy_version 313070 (0.0009) [2023-12-26 02:05:46,746][123090] Updated weights for policy 1, policy_version 313080 (0.0008) [2023-12-26 02:05:46,747][123091] Updated weights for policy 0, policy_version 314720 (0.0008) [2023-12-26 02:05:46,806][123091] Updated weights for policy 0, policy_version 314730 (0.0009) [2023-12-26 02:05:47,505][123091] Updated weights for policy 0, policy_version 314740 (0.0008) [2023-12-26 02:05:47,558][123091] Updated weights for policy 0, policy_version 314750 (0.0006) [2023-12-26 02:05:47,608][123090] Updated weights for policy 1, policy_version 313090 (0.0007) [2023-12-26 02:05:47,615][123091] Updated weights for policy 0, policy_version 314760 (0.0005) [2023-12-26 02:05:47,674][123090] Updated weights for policy 1, policy_version 313100 (0.0008) [2023-12-26 02:05:47,729][123090] Updated weights for policy 1, policy_version 313110 (0.0009) [2023-12-26 02:05:47,783][123090] Updated weights for policy 1, policy_version 313120 (0.0010) [2023-12-26 02:05:48,373][123091] Updated weights for policy 0, policy_version 314770 (0.0006) [2023-12-26 02:05:48,439][123091] Updated weights for policy 0, policy_version 314780 (0.0008) [2023-12-26 02:05:48,504][123091] Updated weights for policy 0, policy_version 314790 (0.0008) [2023-12-26 02:05:48,577][123091] Updated weights for policy 0, policy_version 314800 (0.0008) [2023-12-26 02:05:48,622][123090] Updated weights for policy 1, policy_version 313130 (0.0010) [2023-12-26 02:05:48,688][123090] Updated weights for policy 1, policy_version 313140 (0.0006) [2023-12-26 02:05:48,751][123090] Updated weights for policy 1, policy_version 313150 (0.0009) [2023-12-26 02:05:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 160759808. Throughput: 0: 9081.5, 1: 8778.7. Samples: 160766436. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:48,785][121949] Avg episode reward: [(0, '6380.839'), (1, '5870.319')] [2023-12-26 02:05:49,319][123091] Updated weights for policy 0, policy_version 314810 (0.0010) [2023-12-26 02:05:49,389][123091] Updated weights for policy 0, policy_version 314820 (0.0009) [2023-12-26 02:05:49,453][123091] Updated weights for policy 0, policy_version 314830 (0.0010) [2023-12-26 02:05:49,548][123090] Updated weights for policy 1, policy_version 313160 (0.0009) [2023-12-26 02:05:49,611][123090] Updated weights for policy 1, policy_version 313170 (0.0008) [2023-12-26 02:05:49,665][123090] Updated weights for policy 1, policy_version 313180 (0.0010) [2023-12-26 02:05:50,279][123091] Updated weights for policy 0, policy_version 314840 (0.0008) [2023-12-26 02:05:50,345][123091] Updated weights for policy 0, policy_version 314850 (0.0008) [2023-12-26 02:05:50,410][123091] Updated weights for policy 0, policy_version 314860 (0.0006) [2023-12-26 02:05:50,490][123090] Updated weights for policy 1, policy_version 313190 (0.0008) [2023-12-26 02:05:50,555][123090] Updated weights for policy 1, policy_version 313200 (0.0010) [2023-12-26 02:05:50,629][123090] Updated weights for policy 1, policy_version 313210 (0.0010) [2023-12-26 02:05:51,187][123091] Updated weights for policy 0, policy_version 314870 (0.0008) [2023-12-26 02:05:51,257][123091] Updated weights for policy 0, policy_version 314880 (0.0010) [2023-12-26 02:05:51,322][123091] Updated weights for policy 0, policy_version 314890 (0.0009) [2023-12-26 02:05:51,454][123090] Updated weights for policy 1, policy_version 313220 (0.0009) [2023-12-26 02:05:51,522][123090] Updated weights for policy 1, policy_version 313230 (0.0009) [2023-12-26 02:05:51,580][123090] Updated weights for policy 1, policy_version 313240 (0.0009) [2023-12-26 02:05:52,142][123091] Updated weights for policy 0, policy_version 314900 (0.0009) [2023-12-26 02:05:52,209][123091] Updated weights for policy 0, policy_version 314910 (0.0009) [2023-12-26 02:05:52,284][123091] Updated weights for policy 0, policy_version 314920 (0.0010) [2023-12-26 02:05:52,416][123090] Updated weights for policy 1, policy_version 313250 (0.0009) [2023-12-26 02:05:52,480][123090] Updated weights for policy 1, policy_version 313260 (0.0010) [2023-12-26 02:05:52,547][123090] Updated weights for policy 1, policy_version 313270 (0.0009) [2023-12-26 02:05:52,615][123090] Updated weights for policy 1, policy_version 313280 (0.0009) [2023-12-26 02:05:53,145][123091] Updated weights for policy 0, policy_version 314930 (0.0009) [2023-12-26 02:05:53,204][123091] Updated weights for policy 0, policy_version 314940 (0.0009) [2023-12-26 02:05:53,247][123090] Updated weights for policy 1, policy_version 313290 (0.0007) [2023-12-26 02:05:53,260][123091] Updated weights for policy 0, policy_version 314950 (0.0009) [2023-12-26 02:05:53,306][123090] Updated weights for policy 1, policy_version 313300 (0.0009) [2023-12-26 02:05:53,309][123091] Updated weights for policy 0, policy_version 314960 (0.0008) [2023-12-26 02:05:53,372][123090] Updated weights for policy 1, policy_version 313310 (0.0008) [2023-12-26 02:05:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 160841728. Throughput: 0: 9057.9, 1: 8758.9. Samples: 160818276. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:53,785][121949] Avg episode reward: [(0, '6384.317'), (1, '5778.707')] [2023-12-26 02:05:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000314960_80633856.pth... [2023-12-26 02:05:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000313312_80207872.pth... [2023-12-26 02:05:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000313904_80363520.pth [2023-12-26 02:05:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000312288_79945728.pth [2023-12-26 02:05:54,077][123090] Updated weights for policy 1, policy_version 313320 (0.0010) [2023-12-26 02:05:54,126][123091] Updated weights for policy 0, policy_version 314970 (0.0010) [2023-12-26 02:05:54,136][123090] Updated weights for policy 1, policy_version 313330 (0.0010) [2023-12-26 02:05:54,173][123091] Updated weights for policy 0, policy_version 314980 (0.0010) [2023-12-26 02:05:54,202][123090] Updated weights for policy 1, policy_version 313340 (0.0011) [2023-12-26 02:05:54,220][123091] Updated weights for policy 0, policy_version 314990 (0.0010) [2023-12-26 02:05:54,960][123091] Updated weights for policy 0, policy_version 315000 (0.0007) [2023-12-26 02:05:55,001][123090] Updated weights for policy 1, policy_version 313350 (0.0010) [2023-12-26 02:05:55,021][123091] Updated weights for policy 0, policy_version 315011 (0.0008) [2023-12-26 02:05:55,065][123090] Updated weights for policy 1, policy_version 313360 (0.0011) [2023-12-26 02:05:55,074][123091] Updated weights for policy 0, policy_version 315021 (0.0005) [2023-12-26 02:05:55,117][123090] Updated weights for policy 1, policy_version 313370 (0.0010) [2023-12-26 02:05:55,723][123091] Updated weights for policy 0, policy_version 315031 (0.0005) [2023-12-26 02:05:55,781][123091] Updated weights for policy 0, policy_version 315041 (0.0005) [2023-12-26 02:05:55,837][123091] Updated weights for policy 0, policy_version 315051 (0.0006) [2023-12-26 02:05:55,957][123090] Updated weights for policy 1, policy_version 313380 (0.0010) [2023-12-26 02:05:56,016][123090] Updated weights for policy 1, policy_version 313390 (0.0009) [2023-12-26 02:05:56,076][123090] Updated weights for policy 1, policy_version 313400 (0.0010) [2023-12-26 02:05:56,504][123091] Updated weights for policy 0, policy_version 315061 (0.0005) [2023-12-26 02:05:56,550][123091] Updated weights for policy 0, policy_version 315071 (0.0005) [2023-12-26 02:05:56,599][123091] Updated weights for policy 0, policy_version 315081 (0.0005) [2023-12-26 02:05:56,900][123090] Updated weights for policy 1, policy_version 313410 (0.0011) [2023-12-26 02:05:56,948][123090] Updated weights for policy 1, policy_version 313420 (0.0010) [2023-12-26 02:05:56,996][123090] Updated weights for policy 1, policy_version 313430 (0.0010) [2023-12-26 02:05:57,058][123090] Updated weights for policy 1, policy_version 313440 (0.0005) [2023-12-26 02:05:57,245][123091] Updated weights for policy 0, policy_version 315091 (0.0005) [2023-12-26 02:05:57,308][123091] Updated weights for policy 0, policy_version 315101 (0.0007) [2023-12-26 02:05:57,367][123091] Updated weights for policy 0, policy_version 315111 (0.0006) [2023-12-26 02:05:57,741][123090] Updated weights for policy 1, policy_version 313450 (0.0011) [2023-12-26 02:05:57,818][123090] Updated weights for policy 1, policy_version 313460 (0.0011) [2023-12-26 02:05:57,869][123090] Updated weights for policy 1, policy_version 313470 (0.0010) [2023-12-26 02:05:58,021][123091] Updated weights for policy 0, policy_version 315121 (0.0006) [2023-12-26 02:05:58,085][123091] Updated weights for policy 0, policy_version 315131 (0.0009) [2023-12-26 02:05:58,148][123091] Updated weights for policy 0, policy_version 315141 (0.0007) [2023-12-26 02:05:58,212][123091] Updated weights for policy 0, policy_version 315151 (0.0009) [2023-12-26 02:05:58,647][123090] Updated weights for policy 1, policy_version 313480 (0.0009) [2023-12-26 02:05:58,731][123090] Updated weights for policy 1, policy_version 313490 (0.0008) [2023-12-26 02:05:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 160931840. Throughput: 0: 9157.4, 1: 8867.0. Samples: 160930168. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:05:58,785][121949] Avg episode reward: [(0, '6341.729'), (1, '5724.890')] [2023-12-26 02:05:58,805][123090] Updated weights for policy 1, policy_version 313500 (0.0012) [2023-12-26 02:05:59,101][123091] Updated weights for policy 0, policy_version 315161 (0.0009) [2023-12-26 02:05:59,166][123091] Updated weights for policy 0, policy_version 315171 (0.0011) [2023-12-26 02:05:59,242][123091] Updated weights for policy 0, policy_version 315181 (0.0010) [2023-12-26 02:05:59,683][123090] Updated weights for policy 1, policy_version 313510 (0.0009) [2023-12-26 02:05:59,752][123090] Updated weights for policy 1, policy_version 313520 (0.0009) [2023-12-26 02:05:59,824][123090] Updated weights for policy 1, policy_version 313530 (0.0009) [2023-12-26 02:06:00,079][123091] Updated weights for policy 0, policy_version 315191 (0.0010) [2023-12-26 02:06:00,133][123091] Updated weights for policy 0, policy_version 315201 (0.0008) [2023-12-26 02:06:00,186][123091] Updated weights for policy 0, policy_version 315211 (0.0007) [2023-12-26 02:06:00,659][123090] Updated weights for policy 1, policy_version 313540 (0.0009) [2023-12-26 02:06:00,716][123090] Updated weights for policy 1, policy_version 313550 (0.0009) [2023-12-26 02:06:00,776][123090] Updated weights for policy 1, policy_version 313560 (0.0009) [2023-12-26 02:06:01,000][123091] Updated weights for policy 0, policy_version 315221 (0.0009) [2023-12-26 02:06:01,064][123091] Updated weights for policy 0, policy_version 315231 (0.0010) [2023-12-26 02:06:01,131][123091] Updated weights for policy 0, policy_version 315241 (0.0009) [2023-12-26 02:06:01,557][123090] Updated weights for policy 1, policy_version 313570 (0.0009) [2023-12-26 02:06:01,622][123090] Updated weights for policy 1, policy_version 313580 (0.0009) [2023-12-26 02:06:01,694][123090] Updated weights for policy 1, policy_version 313590 (0.0009) [2023-12-26 02:06:01,766][123090] Updated weights for policy 1, policy_version 313600 (0.0010) [2023-12-26 02:06:01,960][123091] Updated weights for policy 0, policy_version 315251 (0.0009) [2023-12-26 02:06:02,020][123091] Updated weights for policy 0, policy_version 315261 (0.0006) [2023-12-26 02:06:02,083][123091] Updated weights for policy 0, policy_version 315271 (0.0007) [2023-12-26 02:06:02,583][123090] Updated weights for policy 1, policy_version 313610 (0.0009) [2023-12-26 02:06:02,637][123090] Updated weights for policy 1, policy_version 313620 (0.0009) [2023-12-26 02:06:02,688][123090] Updated weights for policy 1, policy_version 313630 (0.0009) [2023-12-26 02:06:02,861][123091] Updated weights for policy 0, policy_version 315281 (0.0009) [2023-12-26 02:06:02,913][123091] Updated weights for policy 0, policy_version 315291 (0.0009) [2023-12-26 02:06:02,966][123091] Updated weights for policy 0, policy_version 315301 (0.0010) [2023-12-26 02:06:03,031][123091] Updated weights for policy 0, policy_version 315311 (0.0009) [2023-12-26 02:06:03,517][123090] Updated weights for policy 1, policy_version 313640 (0.0010) [2023-12-26 02:06:03,583][123090] Updated weights for policy 1, policy_version 313650 (0.0007) [2023-12-26 02:06:03,637][123090] Updated weights for policy 1, policy_version 313660 (0.0009) [2023-12-26 02:06:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 161021952. Throughput: 0: 9012.9, 1: 8838.7. Samples: 161032256. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:06:03,785][121949] Avg episode reward: [(0, '6261.656'), (1, '5559.893')] [2023-12-26 02:06:03,881][123091] Updated weights for policy 0, policy_version 315321 (0.0009) [2023-12-26 02:06:03,949][123091] Updated weights for policy 0, policy_version 315331 (0.0009) [2023-12-26 02:06:04,023][123091] Updated weights for policy 0, policy_version 315341 (0.0008) [2023-12-26 02:06:04,484][123090] Updated weights for policy 1, policy_version 313670 (0.0010) [2023-12-26 02:06:04,555][123090] Updated weights for policy 1, policy_version 313680 (0.0009) [2023-12-26 02:06:04,614][123090] Updated weights for policy 1, policy_version 313690 (0.0009) [2023-12-26 02:06:04,845][123091] Updated weights for policy 0, policy_version 315351 (0.0010) [2023-12-26 02:06:04,893][123091] Updated weights for policy 0, policy_version 315361 (0.0009) [2023-12-26 02:06:04,962][123091] Updated weights for policy 0, policy_version 315371 (0.0005) [2023-12-26 02:06:05,401][123090] Updated weights for policy 1, policy_version 313700 (0.0008) [2023-12-26 02:06:05,447][123090] Updated weights for policy 1, policy_version 313710 (0.0005) [2023-12-26 02:06:05,508][123090] Updated weights for policy 1, policy_version 313720 (0.0005) [2023-12-26 02:06:05,801][123091] Updated weights for policy 0, policy_version 315381 (0.0008) [2023-12-26 02:06:05,860][123091] Updated weights for policy 0, policy_version 315391 (0.0010) [2023-12-26 02:06:05,917][123091] Updated weights for policy 0, policy_version 315401 (0.0009) [2023-12-26 02:06:06,209][123090] Updated weights for policy 1, policy_version 313730 (0.0006) [2023-12-26 02:06:06,262][123090] Updated weights for policy 1, policy_version 313740 (0.0009) [2023-12-26 02:06:06,328][123090] Updated weights for policy 1, policy_version 313750 (0.0009) [2023-12-26 02:06:06,393][123090] Updated weights for policy 1, policy_version 313760 (0.0009) [2023-12-26 02:06:06,776][123091] Updated weights for policy 0, policy_version 315411 (0.0009) [2023-12-26 02:06:06,856][123091] Updated weights for policy 0, policy_version 315421 (0.0009) [2023-12-26 02:06:06,918][123091] Updated weights for policy 0, policy_version 315431 (0.0010) [2023-12-26 02:06:07,209][123090] Updated weights for policy 1, policy_version 313770 (0.0009) [2023-12-26 02:06:07,269][123090] Updated weights for policy 1, policy_version 313780 (0.0010) [2023-12-26 02:06:07,325][123090] Updated weights for policy 1, policy_version 313790 (0.0009) [2023-12-26 02:06:07,708][123091] Updated weights for policy 0, policy_version 315441 (0.0009) [2023-12-26 02:06:07,763][123091] Updated weights for policy 0, policy_version 315451 (0.0009) [2023-12-26 02:06:07,815][123091] Updated weights for policy 0, policy_version 315461 (0.0009) [2023-12-26 02:06:07,872][123091] Updated weights for policy 0, policy_version 315471 (0.0006) [2023-12-26 02:06:08,183][123090] Updated weights for policy 1, policy_version 313800 (0.0010) [2023-12-26 02:06:08,245][123090] Updated weights for policy 1, policy_version 313810 (0.0010) [2023-12-26 02:06:08,304][123090] Updated weights for policy 1, policy_version 313820 (0.0010) [2023-12-26 02:06:08,596][123091] Updated weights for policy 0, policy_version 315481 (0.0010) [2023-12-26 02:06:08,652][123091] Updated weights for policy 0, policy_version 315491 (0.0011) [2023-12-26 02:06:08,715][123091] Updated weights for policy 0, policy_version 315501 (0.0011) [2023-12-26 02:06:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 161112064. Throughput: 0: 8984.0, 1: 8871.2. Samples: 161083992. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:06:08,785][121949] Avg episode reward: [(0, '6183.612'), (1, '5581.312')] [2023-12-26 02:06:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000315504_80773120.pth... [2023-12-26 02:06:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000313824_80338944.pth... [2023-12-26 02:06:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000314448_80502784.pth [2023-12-26 02:06:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000312800_80076800.pth [2023-12-26 02:06:09,136][123090] Updated weights for policy 1, policy_version 313830 (0.0009) [2023-12-26 02:06:09,190][123090] Updated weights for policy 1, policy_version 313841 (0.0010) [2023-12-26 02:06:09,248][123090] Updated weights for policy 1, policy_version 313851 (0.0010) [2023-12-26 02:06:09,516][123091] Updated weights for policy 0, policy_version 315511 (0.0009) [2023-12-26 02:06:09,572][123091] Updated weights for policy 0, policy_version 315521 (0.0008) [2023-12-26 02:06:09,642][123091] Updated weights for policy 0, policy_version 315531 (0.0009) [2023-12-26 02:06:10,166][123090] Updated weights for policy 1, policy_version 313861 (0.0009) [2023-12-26 02:06:10,222][123090] Updated weights for policy 1, policy_version 313871 (0.0009) [2023-12-26 02:06:10,290][123090] Updated weights for policy 1, policy_version 313881 (0.0009) [2023-12-26 02:06:10,462][123091] Updated weights for policy 0, policy_version 315541 (0.0009) [2023-12-26 02:06:10,513][123091] Updated weights for policy 0, policy_version 315551 (0.0010) [2023-12-26 02:06:10,574][123091] Updated weights for policy 0, policy_version 315561 (0.0010) [2023-12-26 02:06:11,148][123090] Updated weights for policy 1, policy_version 313891 (0.0009) [2023-12-26 02:06:11,214][123090] Updated weights for policy 1, policy_version 313901 (0.0010) [2023-12-26 02:06:11,280][123090] Updated weights for policy 1, policy_version 313911 (0.0009) [2023-12-26 02:06:11,425][123091] Updated weights for policy 0, policy_version 315571 (0.0010) [2023-12-26 02:06:11,487][123091] Updated weights for policy 0, policy_version 315581 (0.0010) [2023-12-26 02:06:11,550][123091] Updated weights for policy 0, policy_version 315591 (0.0010) [2023-12-26 02:06:12,134][123090] Updated weights for policy 1, policy_version 313921 (0.0010) [2023-12-26 02:06:12,194][123090] Updated weights for policy 1, policy_version 313931 (0.0008) [2023-12-26 02:06:12,266][123090] Updated weights for policy 1, policy_version 313941 (0.0008) [2023-12-26 02:06:12,341][123090] Updated weights for policy 1, policy_version 313951 (0.0007) [2023-12-26 02:06:12,427][123091] Updated weights for policy 0, policy_version 315601 (0.0010) [2023-12-26 02:06:12,487][123091] Updated weights for policy 0, policy_version 315611 (0.0009) [2023-12-26 02:06:12,552][123091] Updated weights for policy 0, policy_version 315621 (0.0009) [2023-12-26 02:06:12,629][123091] Updated weights for policy 0, policy_version 315631 (0.0009) [2023-12-26 02:06:13,140][123090] Updated weights for policy 1, policy_version 313961 (0.0010) [2023-12-26 02:06:13,207][123090] Updated weights for policy 1, policy_version 313971 (0.0009) [2023-12-26 02:06:13,268][123090] Updated weights for policy 1, policy_version 313981 (0.0009) [2023-12-26 02:06:13,445][123091] Updated weights for policy 0, policy_version 315641 (0.0010) [2023-12-26 02:06:13,502][123091] Updated weights for policy 0, policy_version 315651 (0.0010) [2023-12-26 02:06:13,557][123091] Updated weights for policy 0, policy_version 315662 (0.0010) [2023-12-26 02:06:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 161193984. Throughput: 0: 8909.8, 1: 8753.9. Samples: 161186024. Policy #0 lag: (min: 25.0, avg: 47.1, max: 57.0) [2023-12-26 02:06:13,785][121949] Avg episode reward: [(0, '6318.234'), (1, '5626.688')] [2023-12-26 02:06:14,013][123090] Updated weights for policy 1, policy_version 313992 (0.0007) [2023-12-26 02:06:14,068][123090] Updated weights for policy 1, policy_version 314002 (0.0005) [2023-12-26 02:06:14,135][123090] Updated weights for policy 1, policy_version 314012 (0.0005) [2023-12-26 02:06:14,402][123091] Updated weights for policy 0, policy_version 315672 (0.0006) [2023-12-26 02:06:14,471][123091] Updated weights for policy 0, policy_version 315682 (0.0009) [2023-12-26 02:06:14,525][123091] Updated weights for policy 0, policy_version 315692 (0.0009) [2023-12-26 02:06:14,947][123090] Updated weights for policy 1, policy_version 314022 (0.0008) [2023-12-26 02:06:15,010][123090] Updated weights for policy 1, policy_version 314032 (0.0010) [2023-12-26 02:06:15,067][123090] Updated weights for policy 1, policy_version 314042 (0.0009) [2023-12-26 02:06:15,332][123091] Updated weights for policy 0, policy_version 315702 (0.0010) [2023-12-26 02:06:15,390][123091] Updated weights for policy 0, policy_version 315712 (0.0008) [2023-12-26 02:06:15,457][123091] Updated weights for policy 0, policy_version 315722 (0.0011) [2023-12-26 02:06:15,968][123090] Updated weights for policy 1, policy_version 314052 (0.0009) [2023-12-26 02:06:16,036][123090] Updated weights for policy 1, policy_version 314062 (0.0010) [2023-12-26 02:06:16,100][123090] Updated weights for policy 1, policy_version 314072 (0.0010) [2023-12-26 02:06:16,170][123091] Updated weights for policy 0, policy_version 315732 (0.0009) [2023-12-26 02:06:16,225][123091] Updated weights for policy 0, policy_version 315742 (0.0010) [2023-12-26 02:06:16,286][123091] Updated weights for policy 0, policy_version 315752 (0.0008) [2023-12-26 02:06:16,885][123090] Updated weights for policy 1, policy_version 314082 (0.0008) [2023-12-26 02:06:16,948][123090] Updated weights for policy 1, policy_version 314092 (0.0008) [2023-12-26 02:06:17,007][123090] Updated weights for policy 1, policy_version 314102 (0.0009) [2023-12-26 02:06:17,061][123090] Updated weights for policy 1, policy_version 314112 (0.0009) [2023-12-26 02:06:17,063][123091] Updated weights for policy 0, policy_version 315762 (0.0006) [2023-12-26 02:06:17,111][123091] Updated weights for policy 0, policy_version 315772 (0.0010) [2023-12-26 02:06:17,166][123091] Updated weights for policy 0, policy_version 315782 (0.0010) [2023-12-26 02:06:17,221][123091] Updated weights for policy 0, policy_version 315792 (0.0010) [2023-12-26 02:06:17,910][123090] Updated weights for policy 1, policy_version 314122 (0.0010) [2023-12-26 02:06:17,963][123091] Updated weights for policy 0, policy_version 315802 (0.0005) [2023-12-26 02:06:17,966][123090] Updated weights for policy 1, policy_version 314132 (0.0008) [2023-12-26 02:06:18,017][123091] Updated weights for policy 0, policy_version 315812 (0.0006) [2023-12-26 02:06:18,022][123090] Updated weights for policy 1, policy_version 314142 (0.0009) [2023-12-26 02:06:18,073][123091] Updated weights for policy 0, policy_version 315822 (0.0005) [2023-12-26 02:06:18,781][123091] Updated weights for policy 0, policy_version 315832 (0.0007) [2023-12-26 02:06:18,784][121949] Fps is (10 sec: 16384.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 161275904. Throughput: 0: 8992.4, 1: 8770.6. Samples: 161293476. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:18,784][121949] Avg episode reward: [(0, '6376.605'), (1, '5668.116')] [2023-12-26 02:06:18,844][123091] Updated weights for policy 0, policy_version 315842 (0.0005) [2023-12-26 02:06:18,910][123091] Updated weights for policy 0, policy_version 315852 (0.0008) [2023-12-26 02:06:18,954][123090] Updated weights for policy 1, policy_version 314152 (0.0009) [2023-12-26 02:06:19,014][123090] Updated weights for policy 1, policy_version 314162 (0.0010) [2023-12-26 02:06:19,068][123090] Updated weights for policy 1, policy_version 314172 (0.0010) [2023-12-26 02:06:19,644][123091] Updated weights for policy 0, policy_version 315862 (0.0009) [2023-12-26 02:06:19,711][123091] Updated weights for policy 0, policy_version 315872 (0.0011) [2023-12-26 02:06:19,774][123091] Updated weights for policy 0, policy_version 315882 (0.0011) [2023-12-26 02:06:19,929][123090] Updated weights for policy 1, policy_version 314182 (0.0009) [2023-12-26 02:06:20,003][123090] Updated weights for policy 1, policy_version 314192 (0.0010) [2023-12-26 02:06:20,061][123090] Updated weights for policy 1, policy_version 314202 (0.0009) [2023-12-26 02:06:20,604][123091] Updated weights for policy 0, policy_version 315892 (0.0011) [2023-12-26 02:06:20,667][123091] Updated weights for policy 0, policy_version 315902 (0.0011) [2023-12-26 02:06:20,739][123091] Updated weights for policy 0, policy_version 315912 (0.0011) [2023-12-26 02:06:20,911][123090] Updated weights for policy 1, policy_version 314212 (0.0009) [2023-12-26 02:06:20,971][123090] Updated weights for policy 1, policy_version 314222 (0.0011) [2023-12-26 02:06:21,032][123090] Updated weights for policy 1, policy_version 314232 (0.0011) [2023-12-26 02:06:21,438][123091] Updated weights for policy 0, policy_version 315922 (0.0011) [2023-12-26 02:06:21,497][123091] Updated weights for policy 0, policy_version 315932 (0.0010) [2023-12-26 02:06:21,552][123091] Updated weights for policy 0, policy_version 315942 (0.0010) [2023-12-26 02:06:21,604][123091] Updated weights for policy 0, policy_version 315952 (0.0010) [2023-12-26 02:06:21,901][123090] Updated weights for policy 1, policy_version 314242 (0.0010) [2023-12-26 02:06:21,958][123090] Updated weights for policy 1, policy_version 314252 (0.0008) [2023-12-26 02:06:22,014][123090] Updated weights for policy 1, policy_version 314262 (0.0008) [2023-12-26 02:06:22,063][123090] Updated weights for policy 1, policy_version 314272 (0.0008) [2023-12-26 02:06:22,466][123091] Updated weights for policy 0, policy_version 315962 (0.0010) [2023-12-26 02:06:22,522][123091] Updated weights for policy 0, policy_version 315972 (0.0010) [2023-12-26 02:06:22,592][123091] Updated weights for policy 0, policy_version 315982 (0.0011) [2023-12-26 02:06:22,947][123090] Updated weights for policy 1, policy_version 314282 (0.0010) [2023-12-26 02:06:23,016][123090] Updated weights for policy 1, policy_version 314292 (0.0010) [2023-12-26 02:06:23,079][123090] Updated weights for policy 1, policy_version 314302 (0.0009) [2023-12-26 02:06:23,347][123091] Updated weights for policy 0, policy_version 315992 (0.0011) [2023-12-26 02:06:23,395][123091] Updated weights for policy 0, policy_version 316002 (0.0010) [2023-12-26 02:06:23,444][123091] Updated weights for policy 0, policy_version 316012 (0.0010) [2023-12-26 02:06:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 161366016. Throughput: 0: 8991.3, 1: 8709.6. Samples: 161344812. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:23,785][121949] Avg episode reward: [(0, '6326.002'), (1, '5634.922')] [2023-12-26 02:06:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000316016_80904192.pth... [2023-12-26 02:06:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000314304_80461824.pth... [2023-12-26 02:06:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000313312_80207872.pth [2023-12-26 02:06:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000314960_80633856.pth [2023-12-26 02:06:23,912][123090] Updated weights for policy 1, policy_version 314312 (0.0006) [2023-12-26 02:06:23,979][123090] Updated weights for policy 1, policy_version 314322 (0.0007) [2023-12-26 02:06:24,044][123090] Updated weights for policy 1, policy_version 314332 (0.0005) [2023-12-26 02:06:24,198][123091] Updated weights for policy 0, policy_version 316022 (0.0007) [2023-12-26 02:06:24,245][123091] Updated weights for policy 0, policy_version 316032 (0.0005) [2023-12-26 02:06:24,304][123091] Updated weights for policy 0, policy_version 316042 (0.0005) [2023-12-26 02:06:24,755][123090] Updated weights for policy 1, policy_version 314342 (0.0008) [2023-12-26 02:06:24,829][123090] Updated weights for policy 1, policy_version 314352 (0.0010) [2023-12-26 02:06:24,898][123090] Updated weights for policy 1, policy_version 314362 (0.0010) [2023-12-26 02:06:24,983][123091] Updated weights for policy 0, policy_version 316052 (0.0007) [2023-12-26 02:06:25,035][123091] Updated weights for policy 0, policy_version 316062 (0.0010) [2023-12-26 02:06:25,085][123091] Updated weights for policy 0, policy_version 316072 (0.0010) [2023-12-26 02:06:25,684][123090] Updated weights for policy 1, policy_version 314372 (0.0007) [2023-12-26 02:06:25,732][123090] Updated weights for policy 1, policy_version 314382 (0.0005) [2023-12-26 02:06:25,780][123090] Updated weights for policy 1, policy_version 314392 (0.0005) [2023-12-26 02:06:25,789][123091] Updated weights for policy 0, policy_version 316082 (0.0009) [2023-12-26 02:06:25,836][123091] Updated weights for policy 0, policy_version 316092 (0.0009) [2023-12-26 02:06:25,886][123091] Updated weights for policy 0, policy_version 316102 (0.0010) [2023-12-26 02:06:25,941][123091] Updated weights for policy 0, policy_version 316112 (0.0010) [2023-12-26 02:06:26,528][123090] Updated weights for policy 1, policy_version 314402 (0.0006) [2023-12-26 02:06:26,575][123090] Updated weights for policy 1, policy_version 314412 (0.0008) [2023-12-26 02:06:26,626][123090] Updated weights for policy 1, policy_version 314422 (0.0009) [2023-12-26 02:06:26,674][123090] Updated weights for policy 1, policy_version 314432 (0.0008) [2023-12-26 02:06:26,775][123091] Updated weights for policy 0, policy_version 316122 (0.0010) [2023-12-26 02:06:26,826][123091] Updated weights for policy 0, policy_version 316132 (0.0010) [2023-12-26 02:06:26,881][123091] Updated weights for policy 0, policy_version 316142 (0.0010) [2023-12-26 02:06:27,534][123090] Updated weights for policy 1, policy_version 314442 (0.0005) [2023-12-26 02:06:27,598][123090] Updated weights for policy 1, policy_version 314452 (0.0005) [2023-12-26 02:06:27,651][123090] Updated weights for policy 1, policy_version 314462 (0.0006) [2023-12-26 02:06:27,728][123091] Updated weights for policy 0, policy_version 316152 (0.0010) [2023-12-26 02:06:27,790][123091] Updated weights for policy 0, policy_version 316162 (0.0011) [2023-12-26 02:06:27,842][123091] Updated weights for policy 0, policy_version 316172 (0.0010) [2023-12-26 02:06:28,313][123090] Updated weights for policy 1, policy_version 314472 (0.0009) [2023-12-26 02:06:28,385][123090] Updated weights for policy 1, policy_version 314482 (0.0011) [2023-12-26 02:06:28,449][123090] Updated weights for policy 1, policy_version 314492 (0.0010) [2023-12-26 02:06:28,654][123091] Updated weights for policy 0, policy_version 316182 (0.0011) [2023-12-26 02:06:28,715][123091] Updated weights for policy 0, policy_version 316192 (0.0010) [2023-12-26 02:06:28,776][123091] Updated weights for policy 0, policy_version 316202 (0.0010) [2023-12-26 02:06:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 161456128. Throughput: 0: 9064.2, 1: 8652.2. Samples: 161452728. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:28,785][121949] Avg episode reward: [(0, '6256.922'), (1, '5744.109')] [2023-12-26 02:06:29,122][123090] Updated weights for policy 1, policy_version 314502 (0.0008) [2023-12-26 02:06:29,178][123090] Updated weights for policy 1, policy_version 314512 (0.0006) [2023-12-26 02:06:29,239][123090] Updated weights for policy 1, policy_version 314522 (0.0008) [2023-12-26 02:06:29,608][123091] Updated weights for policy 0, policy_version 316212 (0.0011) [2023-12-26 02:06:29,655][123091] Updated weights for policy 0, policy_version 316222 (0.0010) [2023-12-26 02:06:29,706][123091] Updated weights for policy 0, policy_version 316232 (0.0010) [2023-12-26 02:06:30,008][123090] Updated weights for policy 1, policy_version 314532 (0.0009) [2023-12-26 02:06:30,058][123090] Updated weights for policy 1, policy_version 314542 (0.0008) [2023-12-26 02:06:30,118][123090] Updated weights for policy 1, policy_version 314552 (0.0007) [2023-12-26 02:06:30,553][123091] Updated weights for policy 0, policy_version 316242 (0.0010) [2023-12-26 02:06:30,605][123091] Updated weights for policy 0, policy_version 316252 (0.0009) [2023-12-26 02:06:30,653][123091] Updated weights for policy 0, policy_version 316262 (0.0009) [2023-12-26 02:06:30,704][123091] Updated weights for policy 0, policy_version 316272 (0.0008) [2023-12-26 02:06:30,838][123090] Updated weights for policy 1, policy_version 314562 (0.0005) [2023-12-26 02:06:30,891][123090] Updated weights for policy 1, policy_version 314572 (0.0006) [2023-12-26 02:06:30,947][123090] Updated weights for policy 1, policy_version 314582 (0.0010) [2023-12-26 02:06:31,018][123090] Updated weights for policy 1, policy_version 314592 (0.0008) [2023-12-26 02:06:31,515][123091] Updated weights for policy 0, policy_version 316283 (0.0010) [2023-12-26 02:06:31,562][123091] Updated weights for policy 0, policy_version 316293 (0.0009) [2023-12-26 02:06:31,619][123091] Updated weights for policy 0, policy_version 316303 (0.0009) [2023-12-26 02:06:31,828][123090] Updated weights for policy 1, policy_version 314602 (0.0009) [2023-12-26 02:06:31,881][123090] Updated weights for policy 1, policy_version 314612 (0.0008) [2023-12-26 02:06:31,926][123090] Updated weights for policy 1, policy_version 314622 (0.0005) [2023-12-26 02:06:32,534][123091] Updated weights for policy 0, policy_version 316314 (0.0010) [2023-12-26 02:06:32,595][123091] Updated weights for policy 0, policy_version 316324 (0.0007) [2023-12-26 02:06:32,608][123090] Updated weights for policy 1, policy_version 314632 (0.0008) [2023-12-26 02:06:32,652][123091] Updated weights for policy 0, policy_version 316334 (0.0009) [2023-12-26 02:06:32,668][123090] Updated weights for policy 1, policy_version 314642 (0.0008) [2023-12-26 02:06:32,738][123090] Updated weights for policy 1, policy_version 314652 (0.0009) [2023-12-26 02:06:33,344][123091] Updated weights for policy 0, policy_version 316344 (0.0006) [2023-12-26 02:06:33,405][123091] Updated weights for policy 0, policy_version 316354 (0.0005) [2023-12-26 02:06:33,455][123091] Updated weights for policy 0, policy_version 316364 (0.0005) [2023-12-26 02:06:33,627][123090] Updated weights for policy 1, policy_version 314662 (0.0009) [2023-12-26 02:06:33,674][123090] Updated weights for policy 1, policy_version 314672 (0.0009) [2023-12-26 02:06:33,729][123090] Updated weights for policy 1, policy_version 314682 (0.0009) [2023-12-26 02:06:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 161554432. Throughput: 0: 8950.4, 1: 8704.0. Samples: 161560892. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:33,785][121949] Avg episode reward: [(0, '6203.270'), (1, '5532.544')] [2023-12-26 02:06:34,172][123091] Updated weights for policy 0, policy_version 316374 (0.0008) [2023-12-26 02:06:34,228][123091] Updated weights for policy 0, policy_version 316384 (0.0006) [2023-12-26 02:06:34,284][123091] Updated weights for policy 0, policy_version 316394 (0.0006) [2023-12-26 02:06:34,623][123090] Updated weights for policy 1, policy_version 314692 (0.0009) [2023-12-26 02:06:34,674][123090] Updated weights for policy 1, policy_version 314702 (0.0010) [2023-12-26 02:06:34,735][123090] Updated weights for policy 1, policy_version 314713 (0.0009) [2023-12-26 02:06:35,093][123091] Updated weights for policy 0, policy_version 316404 (0.0007) [2023-12-26 02:06:35,143][123091] Updated weights for policy 0, policy_version 316414 (0.0009) [2023-12-26 02:06:35,196][123091] Updated weights for policy 0, policy_version 316424 (0.0009) [2023-12-26 02:06:35,612][123090] Updated weights for policy 1, policy_version 314723 (0.0010) [2023-12-26 02:06:35,672][123090] Updated weights for policy 1, policy_version 314733 (0.0010) [2023-12-26 02:06:35,730][123090] Updated weights for policy 1, policy_version 314743 (0.0009) [2023-12-26 02:06:35,997][123091] Updated weights for policy 0, policy_version 316434 (0.0009) [2023-12-26 02:06:36,062][123091] Updated weights for policy 0, policy_version 316444 (0.0009) [2023-12-26 02:06:36,133][123091] Updated weights for policy 0, policy_version 316454 (0.0009) [2023-12-26 02:06:36,187][123091] Updated weights for policy 0, policy_version 316464 (0.0009) [2023-12-26 02:06:36,587][123090] Updated weights for policy 1, policy_version 314753 (0.0010) [2023-12-26 02:06:36,647][123090] Updated weights for policy 1, policy_version 314763 (0.0010) [2023-12-26 02:06:36,707][123090] Updated weights for policy 1, policy_version 314773 (0.0009) [2023-12-26 02:06:36,759][123090] Updated weights for policy 1, policy_version 314783 (0.0010) [2023-12-26 02:06:37,002][123091] Updated weights for policy 0, policy_version 316474 (0.0010) [2023-12-26 02:06:37,070][123091] Updated weights for policy 0, policy_version 316484 (0.0010) [2023-12-26 02:06:37,128][123091] Updated weights for policy 0, policy_version 316494 (0.0009) [2023-12-26 02:06:37,632][123090] Updated weights for policy 1, policy_version 314793 (0.0010) [2023-12-26 02:06:37,685][123090] Updated weights for policy 1, policy_version 314803 (0.0009) [2023-12-26 02:06:37,746][123090] Updated weights for policy 1, policy_version 314813 (0.0010) [2023-12-26 02:06:37,970][123091] Updated weights for policy 0, policy_version 316504 (0.0010) [2023-12-26 02:06:38,023][123091] Updated weights for policy 0, policy_version 316514 (0.0009) [2023-12-26 02:06:38,090][123091] Updated weights for policy 0, policy_version 316524 (0.0009) [2023-12-26 02:06:38,577][123090] Updated weights for policy 1, policy_version 314823 (0.0010) [2023-12-26 02:06:38,634][123090] Updated weights for policy 1, policy_version 314833 (0.0009) [2023-12-26 02:06:38,692][123090] Updated weights for policy 1, policy_version 314843 (0.0010) [2023-12-26 02:06:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 161636352. Throughput: 0: 8952.5, 1: 8682.9. Samples: 161611872. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:38,785][121949] Avg episode reward: [(0, '6166.159'), (1, '5537.783')] [2023-12-26 02:06:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000316528_81035264.pth... [2023-12-26 02:06:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000314848_80601088.pth... [2023-12-26 02:06:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000315504_80773120.pth [2023-12-26 02:06:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000313824_80338944.pth [2023-12-26 02:06:38,928][123091] Updated weights for policy 0, policy_version 316534 (0.0010) [2023-12-26 02:06:38,995][123091] Updated weights for policy 0, policy_version 316544 (0.0010) [2023-12-26 02:06:39,045][123091] Updated weights for policy 0, policy_version 316554 (0.0009) [2023-12-26 02:06:39,564][123090] Updated weights for policy 1, policy_version 314853 (0.0009) [2023-12-26 02:06:39,634][123090] Updated weights for policy 1, policy_version 314863 (0.0010) [2023-12-26 02:06:39,699][123090] Updated weights for policy 1, policy_version 314873 (0.0009) [2023-12-26 02:06:39,894][123091] Updated weights for policy 0, policy_version 316564 (0.0008) [2023-12-26 02:06:39,961][123091] Updated weights for policy 0, policy_version 316574 (0.0008) [2023-12-26 02:06:40,029][123091] Updated weights for policy 0, policy_version 316584 (0.0009) [2023-12-26 02:06:40,595][123090] Updated weights for policy 1, policy_version 314883 (0.0010) [2023-12-26 02:06:40,647][123090] Updated weights for policy 1, policy_version 314893 (0.0010) [2023-12-26 02:06:40,707][123090] Updated weights for policy 1, policy_version 314903 (0.0010) [2023-12-26 02:06:40,868][123091] Updated weights for policy 0, policy_version 316594 (0.0009) [2023-12-26 02:06:40,923][123091] Updated weights for policy 0, policy_version 316604 (0.0008) [2023-12-26 02:06:40,976][123091] Updated weights for policy 0, policy_version 316614 (0.0009) [2023-12-26 02:06:41,036][123091] Updated weights for policy 0, policy_version 316624 (0.0009) [2023-12-26 02:06:41,583][123090] Updated weights for policy 1, policy_version 314913 (0.0010) [2023-12-26 02:06:41,651][123090] Updated weights for policy 1, policy_version 314923 (0.0008) [2023-12-26 02:06:41,725][123090] Updated weights for policy 1, policy_version 314933 (0.0008) [2023-12-26 02:06:41,789][123090] Updated weights for policy 1, policy_version 314943 (0.0008) [2023-12-26 02:06:41,854][123091] Updated weights for policy 0, policy_version 316634 (0.0010) [2023-12-26 02:06:41,918][123091] Updated weights for policy 0, policy_version 316644 (0.0009) [2023-12-26 02:06:41,981][123091] Updated weights for policy 0, policy_version 316654 (0.0009) [2023-12-26 02:06:42,618][123090] Updated weights for policy 1, policy_version 314953 (0.0009) [2023-12-26 02:06:42,675][123090] Updated weights for policy 1, policy_version 314963 (0.0008) [2023-12-26 02:06:42,741][123090] Updated weights for policy 1, policy_version 314973 (0.0005) [2023-12-26 02:06:42,821][123091] Updated weights for policy 0, policy_version 316664 (0.0010) [2023-12-26 02:06:42,887][123091] Updated weights for policy 0, policy_version 316674 (0.0007) [2023-12-26 02:06:42,939][123091] Updated weights for policy 0, policy_version 316684 (0.0006) [2023-12-26 02:06:43,428][123090] Updated weights for policy 1, policy_version 314983 (0.0005) [2023-12-26 02:06:43,492][123090] Updated weights for policy 1, policy_version 314993 (0.0006) [2023-12-26 02:06:43,550][123090] Updated weights for policy 1, policy_version 315003 (0.0006) [2023-12-26 02:06:43,643][123091] Updated weights for policy 0, policy_version 316694 (0.0007) [2023-12-26 02:06:43,701][123091] Updated weights for policy 0, policy_version 316704 (0.0005) [2023-12-26 02:06:43,758][123091] Updated weights for policy 0, policy_version 316714 (0.0008) [2023-12-26 02:06:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 161718272. Throughput: 0: 8817.4, 1: 8580.9. Samples: 161713092. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:43,785][121949] Avg episode reward: [(0, '6354.115'), (1, '5869.732')] [2023-12-26 02:06:44,385][123090] Updated weights for policy 1, policy_version 315013 (0.0010) [2023-12-26 02:06:44,456][123090] Updated weights for policy 1, policy_version 315023 (0.0010) [2023-12-26 02:06:44,494][123091] Updated weights for policy 0, policy_version 316725 (0.0008) [2023-12-26 02:06:44,521][123090] Updated weights for policy 1, policy_version 315033 (0.0009) [2023-12-26 02:06:44,552][123091] Updated weights for policy 0, policy_version 316735 (0.0008) [2023-12-26 02:06:44,608][123091] Updated weights for policy 0, policy_version 316745 (0.0009) [2023-12-26 02:06:45,308][123091] Updated weights for policy 0, policy_version 316755 (0.0009) [2023-12-26 02:06:45,361][123091] Updated weights for policy 0, policy_version 316765 (0.0006) [2023-12-26 02:06:45,364][123090] Updated weights for policy 1, policy_version 315043 (0.0008) [2023-12-26 02:06:45,414][123090] Updated weights for policy 1, policy_version 315054 (0.0010) [2023-12-26 02:06:45,416][123091] Updated weights for policy 0, policy_version 316775 (0.0006) [2023-12-26 02:06:45,466][123090] Updated weights for policy 1, policy_version 315064 (0.0009) [2023-12-26 02:06:46,097][123091] Updated weights for policy 0, policy_version 316785 (0.0006) [2023-12-26 02:06:46,160][123091] Updated weights for policy 0, policy_version 316795 (0.0005) [2023-12-26 02:06:46,216][123090] Updated weights for policy 1, policy_version 315074 (0.0009) [2023-12-26 02:06:46,232][123091] Updated weights for policy 0, policy_version 316805 (0.0005) [2023-12-26 02:06:46,276][123090] Updated weights for policy 1, policy_version 315084 (0.0005) [2023-12-26 02:06:46,283][123091] Updated weights for policy 0, policy_version 316815 (0.0008) [2023-12-26 02:06:46,335][123090] Updated weights for policy 1, policy_version 315094 (0.0005) [2023-12-26 02:06:46,395][123090] Updated weights for policy 1, policy_version 315104 (0.0007) [2023-12-26 02:06:46,903][123091] Updated weights for policy 0, policy_version 316825 (0.0005) [2023-12-26 02:06:46,971][123091] Updated weights for policy 0, policy_version 316835 (0.0005) [2023-12-26 02:06:47,042][123091] Updated weights for policy 0, policy_version 316845 (0.0005) [2023-12-26 02:06:47,156][123090] Updated weights for policy 1, policy_version 315114 (0.0009) [2023-12-26 02:06:47,223][123090] Updated weights for policy 1, policy_version 315124 (0.0009) [2023-12-26 02:06:47,278][123090] Updated weights for policy 1, policy_version 315134 (0.0008) [2023-12-26 02:06:47,799][123091] Updated weights for policy 0, policy_version 316855 (0.0010) [2023-12-26 02:06:47,862][123091] Updated weights for policy 0, policy_version 316865 (0.0011) [2023-12-26 02:06:47,921][123091] Updated weights for policy 0, policy_version 316875 (0.0011) [2023-12-26 02:06:48,073][123090] Updated weights for policy 1, policy_version 315144 (0.0009) [2023-12-26 02:06:48,121][123090] Updated weights for policy 1, policy_version 315154 (0.0009) [2023-12-26 02:06:48,170][123090] Updated weights for policy 1, policy_version 315164 (0.0009) [2023-12-26 02:06:48,709][123091] Updated weights for policy 0, policy_version 316885 (0.0011) [2023-12-26 02:06:48,774][123091] Updated weights for policy 0, policy_version 316895 (0.0007) [2023-12-26 02:06:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 161808384. Throughput: 0: 8962.0, 1: 8654.1. Samples: 161824984. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:48,785][121949] Avg episode reward: [(0, '6360.714'), (1, '5865.693')] [2023-12-26 02:06:48,841][123091] Updated weights for policy 0, policy_version 316905 (0.0010) [2023-12-26 02:06:49,018][123090] Updated weights for policy 1, policy_version 315174 (0.0007) [2023-12-26 02:06:49,074][123090] Updated weights for policy 1, policy_version 315184 (0.0008) [2023-12-26 02:06:49,122][123090] Updated weights for policy 1, policy_version 315194 (0.0008) [2023-12-26 02:06:49,672][123091] Updated weights for policy 0, policy_version 316915 (0.0011) [2023-12-26 02:06:49,727][123091] Updated weights for policy 0, policy_version 316925 (0.0010) [2023-12-26 02:06:49,779][123091] Updated weights for policy 0, policy_version 316935 (0.0006) [2023-12-26 02:06:49,965][123090] Updated weights for policy 1, policy_version 315204 (0.0010) [2023-12-26 02:06:50,038][123090] Updated weights for policy 1, policy_version 315214 (0.0009) [2023-12-26 02:06:50,099][123090] Updated weights for policy 1, policy_version 315224 (0.0007) [2023-12-26 02:06:50,462][123091] Updated weights for policy 0, policy_version 316945 (0.0006) [2023-12-26 02:06:50,520][123091] Updated weights for policy 0, policy_version 316955 (0.0009) [2023-12-26 02:06:50,591][123091] Updated weights for policy 0, policy_version 316965 (0.0009) [2023-12-26 02:06:50,649][123091] Updated weights for policy 0, policy_version 316975 (0.0010) [2023-12-26 02:06:50,879][123090] Updated weights for policy 1, policy_version 315234 (0.0009) [2023-12-26 02:06:50,940][123090] Updated weights for policy 1, policy_version 315244 (0.0009) [2023-12-26 02:06:51,004][123090] Updated weights for policy 1, policy_version 315254 (0.0009) [2023-12-26 02:06:51,075][123090] Updated weights for policy 1, policy_version 315264 (0.0008) [2023-12-26 02:06:51,469][123091] Updated weights for policy 0, policy_version 316985 (0.0010) [2023-12-26 02:06:51,526][123091] Updated weights for policy 0, policy_version 316996 (0.0009) [2023-12-26 02:06:51,574][123091] Updated weights for policy 0, policy_version 317006 (0.0009) [2023-12-26 02:06:51,912][123090] Updated weights for policy 1, policy_version 315274 (0.0010) [2023-12-26 02:06:51,974][123090] Updated weights for policy 1, policy_version 315284 (0.0009) [2023-12-26 02:06:52,032][123090] Updated weights for policy 1, policy_version 315294 (0.0009) [2023-12-26 02:06:52,419][123091] Updated weights for policy 0, policy_version 317016 (0.0009) [2023-12-26 02:06:52,471][123091] Updated weights for policy 0, policy_version 317026 (0.0009) [2023-12-26 02:06:52,534][123091] Updated weights for policy 0, policy_version 317036 (0.0009) [2023-12-26 02:06:52,860][123090] Updated weights for policy 1, policy_version 315304 (0.0010) [2023-12-26 02:06:52,923][123090] Updated weights for policy 1, policy_version 315314 (0.0011) [2023-12-26 02:06:52,987][123090] Updated weights for policy 1, policy_version 315324 (0.0011) [2023-12-26 02:06:53,418][123091] Updated weights for policy 0, policy_version 317046 (0.0009) [2023-12-26 02:06:53,486][123091] Updated weights for policy 0, policy_version 317056 (0.0010) [2023-12-26 02:06:53,544][123091] Updated weights for policy 0, policy_version 317066 (0.0010) [2023-12-26 02:06:53,721][123090] Updated weights for policy 1, policy_version 315334 (0.0008) [2023-12-26 02:06:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 161898496. Throughput: 0: 8982.9, 1: 8632.8. Samples: 161876696. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:53,785][121949] Avg episode reward: [(0, '6279.115'), (1, '5660.234')] [2023-12-26 02:06:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000317072_81174528.pth... [2023-12-26 02:06:53,791][123090] Updated weights for policy 1, policy_version 315344 (0.0006) [2023-12-26 02:06:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000316016_80904192.pth [2023-12-26 02:06:53,846][123090] Updated weights for policy 1, policy_version 315354 (0.0006) [2023-12-26 02:06:53,882][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000315360_80732160.pth... [2023-12-26 02:06:53,885][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000314304_80461824.pth [2023-12-26 02:06:54,445][123090] Updated weights for policy 1, policy_version 315364 (0.0005) [2023-12-26 02:06:54,460][123091] Updated weights for policy 0, policy_version 317076 (0.0009) [2023-12-26 02:06:54,497][123090] Updated weights for policy 1, policy_version 315374 (0.0010) [2023-12-26 02:06:54,516][123091] Updated weights for policy 0, policy_version 317086 (0.0007) [2023-12-26 02:06:54,552][123090] Updated weights for policy 1, policy_version 315384 (0.0010) [2023-12-26 02:06:54,572][123091] Updated weights for policy 0, policy_version 317096 (0.0007) [2023-12-26 02:06:55,339][123090] Updated weights for policy 1, policy_version 315394 (0.0010) [2023-12-26 02:06:55,388][123090] Updated weights for policy 1, policy_version 315404 (0.0005) [2023-12-26 02:06:55,440][123091] Updated weights for policy 0, policy_version 317106 (0.0008) [2023-12-26 02:06:55,441][123090] Updated weights for policy 1, policy_version 315414 (0.0005) [2023-12-26 02:06:55,487][123091] Updated weights for policy 0, policy_version 317116 (0.0008) [2023-12-26 02:06:55,504][123090] Updated weights for policy 1, policy_version 315424 (0.0005) [2023-12-26 02:06:55,552][123091] Updated weights for policy 0, policy_version 317126 (0.0008) [2023-12-26 02:06:55,612][123091] Updated weights for policy 0, policy_version 317136 (0.0010) [2023-12-26 02:06:56,129][123090] Updated weights for policy 1, policy_version 315434 (0.0005) [2023-12-26 02:06:56,179][123090] Updated weights for policy 1, policy_version 315444 (0.0006) [2023-12-26 02:06:56,230][123090] Updated weights for policy 1, policy_version 315454 (0.0010) [2023-12-26 02:06:56,504][123091] Updated weights for policy 0, policy_version 317146 (0.0009) [2023-12-26 02:06:56,556][123091] Updated weights for policy 0, policy_version 317156 (0.0008) [2023-12-26 02:06:56,633][123091] Updated weights for policy 0, policy_version 317166 (0.0009) [2023-12-26 02:06:57,006][123090] Updated weights for policy 1, policy_version 315464 (0.0009) [2023-12-26 02:06:57,064][123090] Updated weights for policy 1, policy_version 315474 (0.0009) [2023-12-26 02:06:57,130][123090] Updated weights for policy 1, policy_version 315484 (0.0010) [2023-12-26 02:06:57,462][123091] Updated weights for policy 0, policy_version 317176 (0.0009) [2023-12-26 02:06:57,520][123091] Updated weights for policy 0, policy_version 317186 (0.0010) [2023-12-26 02:06:57,578][123091] Updated weights for policy 0, policy_version 317196 (0.0010) [2023-12-26 02:06:57,890][123090] Updated weights for policy 1, policy_version 315494 (0.0006) [2023-12-26 02:06:57,946][123090] Updated weights for policy 1, policy_version 315504 (0.0006) [2023-12-26 02:06:58,009][123090] Updated weights for policy 1, policy_version 315514 (0.0010) [2023-12-26 02:06:58,497][123091] Updated weights for policy 0, policy_version 317207 (0.0009) [2023-12-26 02:06:58,565][123091] Updated weights for policy 0, policy_version 317217 (0.0009) [2023-12-26 02:06:58,631][123091] Updated weights for policy 0, policy_version 317227 (0.0009) [2023-12-26 02:06:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 161988608. Throughput: 0: 8926.8, 1: 8775.4. Samples: 161982624. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:06:58,785][121949] Avg episode reward: [(0, '6298.934'), (1, '5538.561')] [2023-12-26 02:06:58,900][123090] Updated weights for policy 1, policy_version 315524 (0.0009) [2023-12-26 02:06:58,962][123090] Updated weights for policy 1, policy_version 315534 (0.0009) [2023-12-26 02:06:59,022][123090] Updated weights for policy 1, policy_version 315544 (0.0010) [2023-12-26 02:06:59,457][123091] Updated weights for policy 0, policy_version 317237 (0.0010) [2023-12-26 02:06:59,523][123091] Updated weights for policy 0, policy_version 317247 (0.0009) [2023-12-26 02:06:59,590][123091] Updated weights for policy 0, policy_version 317257 (0.0009) [2023-12-26 02:06:59,880][123090] Updated weights for policy 1, policy_version 315554 (0.0009) [2023-12-26 02:06:59,940][123090] Updated weights for policy 1, policy_version 315564 (0.0009) [2023-12-26 02:06:59,999][123090] Updated weights for policy 1, policy_version 315574 (0.0010) [2023-12-26 02:07:00,072][123090] Updated weights for policy 1, policy_version 315584 (0.0005) [2023-12-26 02:07:00,438][123091] Updated weights for policy 0, policy_version 317267 (0.0009) [2023-12-26 02:07:00,491][123091] Updated weights for policy 0, policy_version 317277 (0.0009) [2023-12-26 02:07:00,541][123091] Updated weights for policy 0, policy_version 317287 (0.0009) [2023-12-26 02:07:00,865][123090] Updated weights for policy 1, policy_version 315594 (0.0009) [2023-12-26 02:07:00,930][123090] Updated weights for policy 1, policy_version 315604 (0.0009) [2023-12-26 02:07:00,993][123090] Updated weights for policy 1, policy_version 315614 (0.0010) [2023-12-26 02:07:01,408][123091] Updated weights for policy 0, policy_version 317297 (0.0009) [2023-12-26 02:07:01,466][123091] Updated weights for policy 0, policy_version 317307 (0.0009) [2023-12-26 02:07:01,516][123091] Updated weights for policy 0, policy_version 317317 (0.0009) [2023-12-26 02:07:01,573][123091] Updated weights for policy 0, policy_version 317327 (0.0009) [2023-12-26 02:07:01,827][123090] Updated weights for policy 1, policy_version 315624 (0.0009) [2023-12-26 02:07:01,877][123090] Updated weights for policy 1, policy_version 315634 (0.0009) [2023-12-26 02:07:01,936][123090] Updated weights for policy 1, policy_version 315644 (0.0008) [2023-12-26 02:07:02,445][123091] Updated weights for policy 0, policy_version 317337 (0.0009) [2023-12-26 02:07:02,509][123091] Updated weights for policy 0, policy_version 317347 (0.0009) [2023-12-26 02:07:02,559][123091] Updated weights for policy 0, policy_version 317357 (0.0010) [2023-12-26 02:07:02,819][123090] Updated weights for policy 1, policy_version 315654 (0.0009) [2023-12-26 02:07:02,880][123090] Updated weights for policy 1, policy_version 315664 (0.0009) [2023-12-26 02:07:02,940][123090] Updated weights for policy 1, policy_version 315674 (0.0009) [2023-12-26 02:07:03,399][123091] Updated weights for policy 0, policy_version 317367 (0.0010) [2023-12-26 02:07:03,450][123091] Updated weights for policy 0, policy_version 317377 (0.0009) [2023-12-26 02:07:03,506][123091] Updated weights for policy 0, policy_version 317387 (0.0009) [2023-12-26 02:07:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 162070528. Throughput: 0: 8791.8, 1: 8764.9. Samples: 162083528. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:03,785][121949] Avg episode reward: [(0, '6303.429'), (1, '5651.393')] [2023-12-26 02:07:03,808][123090] Updated weights for policy 1, policy_version 315684 (0.0009) [2023-12-26 02:07:03,868][123090] Updated weights for policy 1, policy_version 315694 (0.0009) [2023-12-26 02:07:03,928][123090] Updated weights for policy 1, policy_version 315704 (0.0009) [2023-12-26 02:07:04,240][123091] Updated weights for policy 0, policy_version 317397 (0.0010) [2023-12-26 02:07:04,307][123091] Updated weights for policy 0, policy_version 317407 (0.0010) [2023-12-26 02:07:04,377][123091] Updated weights for policy 0, policy_version 317417 (0.0011) [2023-12-26 02:07:04,836][123090] Updated weights for policy 1, policy_version 315714 (0.0008) [2023-12-26 02:07:04,900][123090] Updated weights for policy 1, policy_version 315724 (0.0009) [2023-12-26 02:07:04,947][123090] Updated weights for policy 1, policy_version 315734 (0.0008) [2023-12-26 02:07:05,011][123090] Updated weights for policy 1, policy_version 315744 (0.0009) [2023-12-26 02:07:05,183][123091] Updated weights for policy 0, policy_version 317427 (0.0011) [2023-12-26 02:07:05,234][123091] Updated weights for policy 0, policy_version 317437 (0.0010) [2023-12-26 02:07:05,285][123091] Updated weights for policy 0, policy_version 317447 (0.0010) [2023-12-26 02:07:05,869][123090] Updated weights for policy 1, policy_version 315754 (0.0010) [2023-12-26 02:07:05,921][123090] Updated weights for policy 1, policy_version 315765 (0.0010) [2023-12-26 02:07:05,972][123090] Updated weights for policy 1, policy_version 315776 (0.0009) [2023-12-26 02:07:06,039][123091] Updated weights for policy 0, policy_version 317457 (0.0010) [2023-12-26 02:07:06,103][123091] Updated weights for policy 0, policy_version 317467 (0.0008) [2023-12-26 02:07:06,171][123091] Updated weights for policy 0, policy_version 317477 (0.0009) [2023-12-26 02:07:06,243][123091] Updated weights for policy 0, policy_version 317487 (0.0007) [2023-12-26 02:07:06,886][123090] Updated weights for policy 1, policy_version 315786 (0.0005) [2023-12-26 02:07:06,943][123090] Updated weights for policy 1, policy_version 315796 (0.0007) [2023-12-26 02:07:06,986][123091] Updated weights for policy 0, policy_version 317497 (0.0008) [2023-12-26 02:07:07,007][123090] Updated weights for policy 1, policy_version 315806 (0.0008) [2023-12-26 02:07:07,053][123091] Updated weights for policy 0, policy_version 317507 (0.0010) [2023-12-26 02:07:07,117][123091] Updated weights for policy 0, policy_version 317517 (0.0010) [2023-12-26 02:07:07,843][123090] Updated weights for policy 1, policy_version 315816 (0.0010) [2023-12-26 02:07:07,908][123090] Updated weights for policy 1, policy_version 315826 (0.0005) [2023-12-26 02:07:07,978][123090] Updated weights for policy 1, policy_version 315836 (0.0007) [2023-12-26 02:07:07,980][123091] Updated weights for policy 0, policy_version 317527 (0.0009) [2023-12-26 02:07:08,044][123091] Updated weights for policy 0, policy_version 317537 (0.0009) [2023-12-26 02:07:08,115][123091] Updated weights for policy 0, policy_version 317547 (0.0010) [2023-12-26 02:07:08,609][123090] Updated weights for policy 1, policy_version 315846 (0.0009) [2023-12-26 02:07:08,675][123090] Updated weights for policy 1, policy_version 315856 (0.0009) [2023-12-26 02:07:08,735][123090] Updated weights for policy 1, policy_version 315866 (0.0011) [2023-12-26 02:07:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 162160640. Throughput: 0: 8817.0, 1: 8754.7. Samples: 162135544. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:08,786][121949] Avg episode reward: [(0, '6359.940'), (1, '5789.436')] [2023-12-26 02:07:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000317552_81297408.pth... [2023-12-26 02:07:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000315872_80863232.pth... [2023-12-26 02:07:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000316528_81035264.pth [2023-12-26 02:07:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000314848_80601088.pth [2023-12-26 02:07:08,935][123091] Updated weights for policy 0, policy_version 317557 (0.0009) [2023-12-26 02:07:08,999][123091] Updated weights for policy 0, policy_version 317567 (0.0008) [2023-12-26 02:07:09,059][123091] Updated weights for policy 0, policy_version 317577 (0.0009) [2023-12-26 02:07:09,574][123090] Updated weights for policy 1, policy_version 315876 (0.0010) [2023-12-26 02:07:09,639][123090] Updated weights for policy 1, policy_version 315886 (0.0011) [2023-12-26 02:07:09,702][123090] Updated weights for policy 1, policy_version 315896 (0.0010) [2023-12-26 02:07:09,888][123091] Updated weights for policy 0, policy_version 317587 (0.0009) [2023-12-26 02:07:09,958][123091] Updated weights for policy 0, policy_version 317597 (0.0009) [2023-12-26 02:07:10,028][123091] Updated weights for policy 0, policy_version 317607 (0.0010) [2023-12-26 02:07:10,420][123090] Updated weights for policy 1, policy_version 315906 (0.0011) [2023-12-26 02:07:10,474][123090] Updated weights for policy 1, policy_version 315916 (0.0010) [2023-12-26 02:07:10,535][123090] Updated weights for policy 1, policy_version 315926 (0.0009) [2023-12-26 02:07:10,871][123091] Updated weights for policy 0, policy_version 317617 (0.0010) [2023-12-26 02:07:10,923][123091] Updated weights for policy 0, policy_version 317627 (0.0009) [2023-12-26 02:07:10,971][123091] Updated weights for policy 0, policy_version 317638 (0.0009) [2023-12-26 02:07:11,022][123091] Updated weights for policy 0, policy_version 317648 (0.0010) [2023-12-26 02:07:11,372][123090] Updated weights for policy 1, policy_version 315937 (0.0009) [2023-12-26 02:07:11,446][123090] Updated weights for policy 1, policy_version 315947 (0.0007) [2023-12-26 02:07:11,516][123090] Updated weights for policy 1, policy_version 315957 (0.0006) [2023-12-26 02:07:11,590][123090] Updated weights for policy 1, policy_version 315967 (0.0005) [2023-12-26 02:07:11,886][123091] Updated weights for policy 0, policy_version 317658 (0.0006) [2023-12-26 02:07:11,955][123091] Updated weights for policy 0, policy_version 317668 (0.0006) [2023-12-26 02:07:12,008][123091] Updated weights for policy 0, policy_version 317678 (0.0008) [2023-12-26 02:07:12,331][123090] Updated weights for policy 1, policy_version 315977 (0.0006) [2023-12-26 02:07:12,405][123090] Updated weights for policy 1, policy_version 315987 (0.0007) [2023-12-26 02:07:12,467][123090] Updated weights for policy 1, policy_version 315997 (0.0007) [2023-12-26 02:07:12,801][123091] Updated weights for policy 0, policy_version 317688 (0.0006) [2023-12-26 02:07:12,865][123091] Updated weights for policy 0, policy_version 317698 (0.0006) [2023-12-26 02:07:12,942][123091] Updated weights for policy 0, policy_version 317708 (0.0005) [2023-12-26 02:07:13,347][123090] Updated weights for policy 1, policy_version 316007 (0.0008) [2023-12-26 02:07:13,408][123090] Updated weights for policy 1, policy_version 316017 (0.0007) [2023-12-26 02:07:13,482][123090] Updated weights for policy 1, policy_version 316027 (0.0005) [2023-12-26 02:07:13,685][123091] Updated weights for policy 0, policy_version 317718 (0.0008) [2023-12-26 02:07:13,749][123091] Updated weights for policy 0, policy_version 317728 (0.0008) [2023-12-26 02:07:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 162242560. Throughput: 0: 8706.2, 1: 8757.0. Samples: 162238568. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:13,785][121949] Avg episode reward: [(0, '6367.866'), (1, '5762.062')] [2023-12-26 02:07:13,813][123091] Updated weights for policy 0, policy_version 317738 (0.0009) [2023-12-26 02:07:14,245][123090] Updated weights for policy 1, policy_version 316037 (0.0006) [2023-12-26 02:07:14,298][123090] Updated weights for policy 1, policy_version 316047 (0.0005) [2023-12-26 02:07:14,364][123090] Updated weights for policy 1, policy_version 316057 (0.0005) [2023-12-26 02:07:14,674][123091] Updated weights for policy 0, policy_version 317748 (0.0009) [2023-12-26 02:07:14,734][123091] Updated weights for policy 0, policy_version 317758 (0.0009) [2023-12-26 02:07:14,802][123091] Updated weights for policy 0, policy_version 317768 (0.0009) [2023-12-26 02:07:15,146][123090] Updated weights for policy 1, policy_version 316067 (0.0007) [2023-12-26 02:07:15,215][123090] Updated weights for policy 1, policy_version 316077 (0.0011) [2023-12-26 02:07:15,280][123090] Updated weights for policy 1, policy_version 316087 (0.0011) [2023-12-26 02:07:15,647][123091] Updated weights for policy 0, policy_version 317778 (0.0009) [2023-12-26 02:07:15,695][123091] Updated weights for policy 0, policy_version 317788 (0.0009) [2023-12-26 02:07:15,743][123091] Updated weights for policy 0, policy_version 317798 (0.0009) [2023-12-26 02:07:15,798][123091] Updated weights for policy 0, policy_version 317808 (0.0009) [2023-12-26 02:07:16,089][123090] Updated weights for policy 1, policy_version 316097 (0.0011) [2023-12-26 02:07:16,161][123090] Updated weights for policy 1, policy_version 316107 (0.0009) [2023-12-26 02:07:16,225][123090] Updated weights for policy 1, policy_version 316117 (0.0009) [2023-12-26 02:07:16,290][123090] Updated weights for policy 1, policy_version 316127 (0.0010) [2023-12-26 02:07:16,646][123091] Updated weights for policy 0, policy_version 317818 (0.0011) [2023-12-26 02:07:16,690][123091] Updated weights for policy 0, policy_version 317828 (0.0010) [2023-12-26 02:07:16,737][123091] Updated weights for policy 0, policy_version 317838 (0.0010) [2023-12-26 02:07:16,998][123090] Updated weights for policy 1, policy_version 316137 (0.0006) [2023-12-26 02:07:17,069][123090] Updated weights for policy 1, policy_version 316147 (0.0006) [2023-12-26 02:07:17,143][123090] Updated weights for policy 1, policy_version 316157 (0.0006) [2023-12-26 02:07:17,635][123091] Updated weights for policy 0, policy_version 317848 (0.0009) [2023-12-26 02:07:17,701][123091] Updated weights for policy 0, policy_version 317858 (0.0009) [2023-12-26 02:07:17,736][123090] Updated weights for policy 1, policy_version 316167 (0.0008) [2023-12-26 02:07:17,753][123091] Updated weights for policy 0, policy_version 317868 (0.0009) [2023-12-26 02:07:17,797][123090] Updated weights for policy 1, policy_version 316177 (0.0009) [2023-12-26 02:07:17,864][123090] Updated weights for policy 1, policy_version 316187 (0.0009) [2023-12-26 02:07:18,550][123091] Updated weights for policy 0, policy_version 317878 (0.0008) [2023-12-26 02:07:18,603][123091] Updated weights for policy 0, policy_version 317888 (0.0011) [2023-12-26 02:07:18,629][123090] Updated weights for policy 1, policy_version 316197 (0.0009) [2023-12-26 02:07:18,662][123091] Updated weights for policy 0, policy_version 317898 (0.0011) [2023-12-26 02:07:18,700][123090] Updated weights for policy 1, policy_version 316207 (0.0007) [2023-12-26 02:07:18,763][123090] Updated weights for policy 1, policy_version 316217 (0.0009) [2023-12-26 02:07:18,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 162332672. Throughput: 0: 8695.4, 1: 8754.0. Samples: 162346112. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:18,784][121949] Avg episode reward: [(0, '6382.791'), (1, '5786.125')] [2023-12-26 02:07:19,498][123091] Updated weights for policy 0, policy_version 317908 (0.0011) [2023-12-26 02:07:19,526][123090] Updated weights for policy 1, policy_version 316227 (0.0009) [2023-12-26 02:07:19,554][123091] Updated weights for policy 0, policy_version 317918 (0.0011) [2023-12-26 02:07:19,587][123090] Updated weights for policy 1, policy_version 316237 (0.0008) [2023-12-26 02:07:19,609][123091] Updated weights for policy 0, policy_version 317928 (0.0013) [2023-12-26 02:07:19,652][123090] Updated weights for policy 1, policy_version 316247 (0.0009) [2023-12-26 02:07:20,397][123091] Updated weights for policy 0, policy_version 317938 (0.0011) [2023-12-26 02:07:20,444][123090] Updated weights for policy 1, policy_version 316257 (0.0009) [2023-12-26 02:07:20,464][123091] Updated weights for policy 0, policy_version 317948 (0.0009) [2023-12-26 02:07:20,504][123090] Updated weights for policy 1, policy_version 316267 (0.0007) [2023-12-26 02:07:20,533][123091] Updated weights for policy 0, policy_version 317958 (0.0010) [2023-12-26 02:07:20,563][123090] Updated weights for policy 1, policy_version 316277 (0.0008) [2023-12-26 02:07:20,605][123091] Updated weights for policy 0, policy_version 317968 (0.0007) [2023-12-26 02:07:20,624][123090] Updated weights for policy 1, policy_version 316287 (0.0007) [2023-12-26 02:07:21,337][123090] Updated weights for policy 1, policy_version 316297 (0.0010) [2023-12-26 02:07:21,417][123090] Updated weights for policy 1, policy_version 316307 (0.0009) [2023-12-26 02:07:21,447][123091] Updated weights for policy 0, policy_version 317978 (0.0009) [2023-12-26 02:07:21,471][123090] Updated weights for policy 1, policy_version 316317 (0.0009) [2023-12-26 02:07:21,497][123091] Updated weights for policy 0, policy_version 317988 (0.0009) [2023-12-26 02:07:21,554][123091] Updated weights for policy 0, policy_version 317998 (0.0009) [2023-12-26 02:07:22,369][123090] Updated weights for policy 1, policy_version 316327 (0.0010) [2023-12-26 02:07:22,381][123091] Updated weights for policy 0, policy_version 318008 (0.0009) [2023-12-26 02:07:22,430][123090] Updated weights for policy 1, policy_version 316337 (0.0010) [2023-12-26 02:07:22,438][123091] Updated weights for policy 0, policy_version 318018 (0.0007) [2023-12-26 02:07:22,495][123090] Updated weights for policy 1, policy_version 316347 (0.0009) [2023-12-26 02:07:22,503][123091] Updated weights for policy 0, policy_version 318028 (0.0007) [2023-12-26 02:07:23,181][123090] Updated weights for policy 1, policy_version 316357 (0.0008) [2023-12-26 02:07:23,233][123090] Updated weights for policy 1, policy_version 316367 (0.0009) [2023-12-26 02:07:23,287][123090] Updated weights for policy 1, policy_version 316377 (0.0010) [2023-12-26 02:07:23,347][123091] Updated weights for policy 0, policy_version 318038 (0.0006) [2023-12-26 02:07:23,393][123091] Updated weights for policy 0, policy_version 318048 (0.0005) [2023-12-26 02:07:23,441][123091] Updated weights for policy 0, policy_version 318058 (0.0005) [2023-12-26 02:07:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 162422784. Throughput: 0: 8665.0, 1: 8795.9. Samples: 162397608. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:23,784][121949] Avg episode reward: [(0, '6364.615'), (1, '5776.607')] [2023-12-26 02:07:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000318064_81428480.pth... [2023-12-26 02:07:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000316384_80994304.pth... [2023-12-26 02:07:23,791][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000317072_81174528.pth [2023-12-26 02:07:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000315360_80732160.pth [2023-12-26 02:07:23,964][123090] Updated weights for policy 1, policy_version 316387 (0.0006) [2023-12-26 02:07:24,035][123090] Updated weights for policy 1, policy_version 316397 (0.0009) [2023-12-26 02:07:24,101][123090] Updated weights for policy 1, policy_version 316407 (0.0009) [2023-12-26 02:07:24,182][123091] Updated weights for policy 0, policy_version 318068 (0.0007) [2023-12-26 02:07:24,249][123091] Updated weights for policy 0, policy_version 318078 (0.0010) [2023-12-26 02:07:24,310][123091] Updated weights for policy 0, policy_version 318088 (0.0010) [2023-12-26 02:07:24,819][123090] Updated weights for policy 1, policy_version 316417 (0.0006) [2023-12-26 02:07:24,898][123090] Updated weights for policy 1, policy_version 316427 (0.0005) [2023-12-26 02:07:24,967][123090] Updated weights for policy 1, policy_version 316437 (0.0006) [2023-12-26 02:07:25,023][123090] Updated weights for policy 1, policy_version 316447 (0.0006) [2023-12-26 02:07:25,170][123091] Updated weights for policy 0, policy_version 318098 (0.0009) [2023-12-26 02:07:25,230][123091] Updated weights for policy 0, policy_version 318108 (0.0005) [2023-12-26 02:07:25,290][123091] Updated weights for policy 0, policy_version 318118 (0.0007) [2023-12-26 02:07:25,346][123091] Updated weights for policy 0, policy_version 318128 (0.0009) [2023-12-26 02:07:25,690][123090] Updated weights for policy 1, policy_version 316457 (0.0008) [2023-12-26 02:07:25,751][123090] Updated weights for policy 1, policy_version 316467 (0.0009) [2023-12-26 02:07:25,818][123090] Updated weights for policy 1, policy_version 316477 (0.0009) [2023-12-26 02:07:26,155][123091] Updated weights for policy 0, policy_version 318138 (0.0005) [2023-12-26 02:07:26,201][123091] Updated weights for policy 0, policy_version 318148 (0.0005) [2023-12-26 02:07:26,246][123091] Updated weights for policy 0, policy_version 318158 (0.0005) [2023-12-26 02:07:26,666][123090] Updated weights for policy 1, policy_version 316487 (0.0010) [2023-12-26 02:07:26,723][123090] Updated weights for policy 1, policy_version 316497 (0.0009) [2023-12-26 02:07:26,777][123090] Updated weights for policy 1, policy_version 316507 (0.0008) [2023-12-26 02:07:27,038][123091] Updated weights for policy 0, policy_version 318168 (0.0009) [2023-12-26 02:07:27,095][123091] Updated weights for policy 0, policy_version 318178 (0.0009) [2023-12-26 02:07:27,156][123091] Updated weights for policy 0, policy_version 318188 (0.0009) [2023-12-26 02:07:27,610][123090] Updated weights for policy 1, policy_version 316517 (0.0009) [2023-12-26 02:07:27,663][123090] Updated weights for policy 1, policy_version 316528 (0.0009) [2023-12-26 02:07:27,717][123090] Updated weights for policy 1, policy_version 316539 (0.0009) [2023-12-26 02:07:27,961][123091] Updated weights for policy 0, policy_version 318198 (0.0009) [2023-12-26 02:07:28,023][123091] Updated weights for policy 0, policy_version 318208 (0.0009) [2023-12-26 02:07:28,087][123091] Updated weights for policy 0, policy_version 318218 (0.0009) [2023-12-26 02:07:28,561][123090] Updated weights for policy 1, policy_version 316549 (0.0009) [2023-12-26 02:07:28,613][123090] Updated weights for policy 1, policy_version 316559 (0.0009) [2023-12-26 02:07:28,665][123090] Updated weights for policy 1, policy_version 316569 (0.0010) [2023-12-26 02:07:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 162512896. Throughput: 0: 8697.7, 1: 8903.6. Samples: 162505148. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 02:07:28,785][121949] Avg episode reward: [(0, '6301.844'), (1, '5763.493')] [2023-12-26 02:07:28,914][123091] Updated weights for policy 0, policy_version 318228 (0.0007) [2023-12-26 02:07:28,976][123091] Updated weights for policy 0, policy_version 318238 (0.0005) [2023-12-26 02:07:29,043][123091] Updated weights for policy 0, policy_version 318248 (0.0005) [2023-12-26 02:07:29,610][123090] Updated weights for policy 1, policy_version 316580 (0.0010) [2023-12-26 02:07:29,669][123090] Updated weights for policy 1, policy_version 316590 (0.0006) [2023-12-26 02:07:29,696][123091] Updated weights for policy 0, policy_version 318258 (0.0007) [2023-12-26 02:07:29,729][123090] Updated weights for policy 1, policy_version 316600 (0.0006) [2023-12-26 02:07:29,763][123091] Updated weights for policy 0, policy_version 318268 (0.0011) [2023-12-26 02:07:29,829][123091] Updated weights for policy 0, policy_version 318278 (0.0011) [2023-12-26 02:07:29,895][123091] Updated weights for policy 0, policy_version 318288 (0.0011) [2023-12-26 02:07:30,464][123090] Updated weights for policy 1, policy_version 316610 (0.0005) [2023-12-26 02:07:30,521][123090] Updated weights for policy 1, policy_version 316620 (0.0005) [2023-12-26 02:07:30,578][123090] Updated weights for policy 1, policy_version 316630 (0.0005) [2023-12-26 02:07:30,635][123090] Updated weights for policy 1, policy_version 316640 (0.0008) [2023-12-26 02:07:30,682][123091] Updated weights for policy 0, policy_version 318298 (0.0010) [2023-12-26 02:07:30,740][123091] Updated weights for policy 0, policy_version 318308 (0.0010) [2023-12-26 02:07:30,787][123091] Updated weights for policy 0, policy_version 318318 (0.0010) [2023-12-26 02:07:31,467][123090] Updated weights for policy 1, policy_version 316650 (0.0007) [2023-12-26 02:07:31,535][123090] Updated weights for policy 1, policy_version 316660 (0.0009) [2023-12-26 02:07:31,594][123090] Updated weights for policy 1, policy_version 316670 (0.0010) [2023-12-26 02:07:31,638][123091] Updated weights for policy 0, policy_version 318328 (0.0010) [2023-12-26 02:07:31,706][123091] Updated weights for policy 0, policy_version 318338 (0.0009) [2023-12-26 02:07:31,771][123091] Updated weights for policy 0, policy_version 318348 (0.0010) [2023-12-26 02:07:32,383][123090] Updated weights for policy 1, policy_version 316680 (0.0009) [2023-12-26 02:07:32,442][123090] Updated weights for policy 1, policy_version 316690 (0.0010) [2023-12-26 02:07:32,492][123091] Updated weights for policy 0, policy_version 318358 (0.0008) [2023-12-26 02:07:32,509][123090] Updated weights for policy 1, policy_version 316700 (0.0007) [2023-12-26 02:07:32,556][123091] Updated weights for policy 0, policy_version 318368 (0.0006) [2023-12-26 02:07:32,614][123091] Updated weights for policy 0, policy_version 318378 (0.0006) [2023-12-26 02:07:33,333][123090] Updated weights for policy 1, policy_version 316710 (0.0009) [2023-12-26 02:07:33,382][123090] Updated weights for policy 1, policy_version 316720 (0.0008) [2023-12-26 02:07:33,402][123091] Updated weights for policy 0, policy_version 318388 (0.0010) [2023-12-26 02:07:33,434][123090] Updated weights for policy 1, policy_version 316730 (0.0008) [2023-12-26 02:07:33,463][123091] Updated weights for policy 0, policy_version 318398 (0.0009) [2023-12-26 02:07:33,540][123091] Updated weights for policy 0, policy_version 318408 (0.0009) [2023-12-26 02:07:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 162603008. Throughput: 0: 8609.2, 1: 8868.9. Samples: 162611496. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:33,784][121949] Avg episode reward: [(0, '6265.041'), (1, '5764.504')] [2023-12-26 02:07:34,267][123090] Updated weights for policy 1, policy_version 316740 (0.0008) [2023-12-26 02:07:34,336][123090] Updated weights for policy 1, policy_version 316750 (0.0010) [2023-12-26 02:07:34,372][123091] Updated weights for policy 0, policy_version 318418 (0.0008) [2023-12-26 02:07:34,388][123090] Updated weights for policy 1, policy_version 316760 (0.0009) [2023-12-26 02:07:34,433][123091] Updated weights for policy 0, policy_version 318428 (0.0008) [2023-12-26 02:07:34,492][123091] Updated weights for policy 0, policy_version 318438 (0.0005) [2023-12-26 02:07:34,563][123091] Updated weights for policy 0, policy_version 318448 (0.0006) [2023-12-26 02:07:35,238][123090] Updated weights for policy 1, policy_version 316770 (0.0009) [2023-12-26 02:07:35,289][123090] Updated weights for policy 1, policy_version 316780 (0.0010) [2023-12-26 02:07:35,351][123090] Updated weights for policy 1, policy_version 316790 (0.0008) [2023-12-26 02:07:35,366][123091] Updated weights for policy 0, policy_version 318458 (0.0010) [2023-12-26 02:07:35,397][123090] Updated weights for policy 1, policy_version 316800 (0.0006) [2023-12-26 02:07:35,425][123091] Updated weights for policy 0, policy_version 318468 (0.0009) [2023-12-26 02:07:35,475][123091] Updated weights for policy 0, policy_version 318478 (0.0010) [2023-12-26 02:07:36,211][123090] Updated weights for policy 1, policy_version 316810 (0.0010) [2023-12-26 02:07:36,269][123090] Updated weights for policy 1, policy_version 316820 (0.0006) [2023-12-26 02:07:36,321][123091] Updated weights for policy 0, policy_version 318488 (0.0010) [2023-12-26 02:07:36,332][123090] Updated weights for policy 1, policy_version 316830 (0.0008) [2023-12-26 02:07:36,388][123091] Updated weights for policy 0, policy_version 318498 (0.0011) [2023-12-26 02:07:36,457][123091] Updated weights for policy 0, policy_version 318508 (0.0011) [2023-12-26 02:07:37,177][123090] Updated weights for policy 1, policy_version 316840 (0.0008) [2023-12-26 02:07:37,244][123090] Updated weights for policy 1, policy_version 316850 (0.0009) [2023-12-26 02:07:37,276][123091] Updated weights for policy 0, policy_version 318518 (0.0011) [2023-12-26 02:07:37,299][123090] Updated weights for policy 1, policy_version 316860 (0.0005) [2023-12-26 02:07:37,338][123091] Updated weights for policy 0, policy_version 318528 (0.0011) [2023-12-26 02:07:37,412][123091] Updated weights for policy 0, policy_version 318538 (0.0011) [2023-12-26 02:07:38,097][123090] Updated weights for policy 1, policy_version 316870 (0.0008) [2023-12-26 02:07:38,158][123090] Updated weights for policy 1, policy_version 316880 (0.0009) [2023-12-26 02:07:38,218][123090] Updated weights for policy 1, policy_version 316890 (0.0009) [2023-12-26 02:07:38,222][123091] Updated weights for policy 0, policy_version 318548 (0.0011) [2023-12-26 02:07:38,286][123091] Updated weights for policy 0, policy_version 318558 (0.0011) [2023-12-26 02:07:38,365][123091] Updated weights for policy 0, policy_version 318568 (0.0011) [2023-12-26 02:07:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17744.7). Total num frames: 162684928. Throughput: 0: 8602.1, 1: 8875.4. Samples: 162663180. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:38,785][121949] Avg episode reward: [(0, '6271.772'), (1, '5760.034')] [2023-12-26 02:07:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000316896_81125376.pth... [2023-12-26 02:07:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000318576_81559552.pth... [2023-12-26 02:07:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000315872_80863232.pth [2023-12-26 02:07:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000317552_81297408.pth [2023-12-26 02:07:38,986][123090] Updated weights for policy 1, policy_version 316900 (0.0007) [2023-12-26 02:07:39,051][123090] Updated weights for policy 1, policy_version 316910 (0.0009) [2023-12-26 02:07:39,115][123090] Updated weights for policy 1, policy_version 316920 (0.0009) [2023-12-26 02:07:39,192][123091] Updated weights for policy 0, policy_version 318578 (0.0011) [2023-12-26 02:07:39,272][123091] Updated weights for policy 0, policy_version 318588 (0.0008) [2023-12-26 02:07:39,344][123091] Updated weights for policy 0, policy_version 318598 (0.0010) [2023-12-26 02:07:39,421][123091] Updated weights for policy 0, policy_version 318608 (0.0008) [2023-12-26 02:07:39,956][123090] Updated weights for policy 1, policy_version 316930 (0.0009) [2023-12-26 02:07:40,017][123090] Updated weights for policy 1, policy_version 316940 (0.0010) [2023-12-26 02:07:40,071][123090] Updated weights for policy 1, policy_version 316950 (0.0009) [2023-12-26 02:07:40,129][123090] Updated weights for policy 1, policy_version 316960 (0.0010) [2023-12-26 02:07:40,291][123091] Updated weights for policy 0, policy_version 318618 (0.0010) [2023-12-26 02:07:40,359][123091] Updated weights for policy 0, policy_version 318628 (0.0010) [2023-12-26 02:07:40,422][123091] Updated weights for policy 0, policy_version 318638 (0.0010) [2023-12-26 02:07:40,971][123090] Updated weights for policy 1, policy_version 316970 (0.0006) [2023-12-26 02:07:41,039][123090] Updated weights for policy 1, policy_version 316980 (0.0007) [2023-12-26 02:07:41,104][123090] Updated weights for policy 1, policy_version 316990 (0.0009) [2023-12-26 02:07:41,108][123091] Updated weights for policy 0, policy_version 318648 (0.0008) [2023-12-26 02:07:41,180][123091] Updated weights for policy 0, policy_version 318658 (0.0008) [2023-12-26 02:07:41,247][123091] Updated weights for policy 0, policy_version 318668 (0.0010) [2023-12-26 02:07:41,932][123090] Updated weights for policy 1, policy_version 317000 (0.0010) [2023-12-26 02:07:41,990][123090] Updated weights for policy 1, policy_version 317010 (0.0009) [2023-12-26 02:07:42,055][123090] Updated weights for policy 1, policy_version 317020 (0.0009) [2023-12-26 02:07:42,133][123091] Updated weights for policy 0, policy_version 318678 (0.0010) [2023-12-26 02:07:42,186][123091] Updated weights for policy 0, policy_version 318689 (0.0010) [2023-12-26 02:07:42,244][123091] Updated weights for policy 0, policy_version 318699 (0.0009) [2023-12-26 02:07:42,742][123090] Updated weights for policy 1, policy_version 317030 (0.0007) [2023-12-26 02:07:42,799][123090] Updated weights for policy 1, policy_version 317040 (0.0006) [2023-12-26 02:07:42,866][123090] Updated weights for policy 1, policy_version 317050 (0.0006) [2023-12-26 02:07:43,116][123091] Updated weights for policy 0, policy_version 318709 (0.0007) [2023-12-26 02:07:43,180][123091] Updated weights for policy 0, policy_version 318719 (0.0005) [2023-12-26 02:07:43,242][123091] Updated weights for policy 0, policy_version 318729 (0.0006) [2023-12-26 02:07:43,488][123090] Updated weights for policy 1, policy_version 317060 (0.0007) [2023-12-26 02:07:43,553][123090] Updated weights for policy 1, policy_version 317070 (0.0006) [2023-12-26 02:07:43,609][123090] Updated weights for policy 1, policy_version 317080 (0.0005) [2023-12-26 02:07:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 162775040. Throughput: 0: 8620.5, 1: 8772.2. Samples: 162765296. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:43,785][121949] Avg episode reward: [(0, '6193.121'), (1, '5773.585')] [2023-12-26 02:07:44,065][123091] Updated weights for policy 0, policy_version 318739 (0.0005) [2023-12-26 02:07:44,114][123091] Updated weights for policy 0, policy_version 318749 (0.0005) [2023-12-26 02:07:44,185][123091] Updated weights for policy 0, policy_version 318759 (0.0007) [2023-12-26 02:07:44,343][123090] Updated weights for policy 1, policy_version 317090 (0.0006) [2023-12-26 02:07:44,413][123090] Updated weights for policy 1, policy_version 317100 (0.0009) [2023-12-26 02:07:44,482][123090] Updated weights for policy 1, policy_version 317110 (0.0009) [2023-12-26 02:07:44,554][123090] Updated weights for policy 1, policy_version 317120 (0.0008) [2023-12-26 02:07:44,967][123091] Updated weights for policy 0, policy_version 318769 (0.0010) [2023-12-26 02:07:45,040][123091] Updated weights for policy 0, policy_version 318779 (0.0009) [2023-12-26 02:07:45,106][123091] Updated weights for policy 0, policy_version 318789 (0.0010) [2023-12-26 02:07:45,171][123091] Updated weights for policy 0, policy_version 318799 (0.0009) [2023-12-26 02:07:45,386][123090] Updated weights for policy 1, policy_version 317130 (0.0010) [2023-12-26 02:07:45,459][123090] Updated weights for policy 1, policy_version 317140 (0.0010) [2023-12-26 02:07:45,530][123090] Updated weights for policy 1, policy_version 317150 (0.0010) [2023-12-26 02:07:45,988][123091] Updated weights for policy 0, policy_version 318809 (0.0007) [2023-12-26 02:07:46,066][123091] Updated weights for policy 0, policy_version 318819 (0.0005) [2023-12-26 02:07:46,139][123091] Updated weights for policy 0, policy_version 318829 (0.0005) [2023-12-26 02:07:46,346][123090] Updated weights for policy 1, policy_version 317160 (0.0009) [2023-12-26 02:07:46,396][123090] Updated weights for policy 1, policy_version 317170 (0.0009) [2023-12-26 02:07:46,464][123090] Updated weights for policy 1, policy_version 317180 (0.0006) [2023-12-26 02:07:46,862][123091] Updated weights for policy 0, policy_version 318839 (0.0010) [2023-12-26 02:07:46,918][123091] Updated weights for policy 0, policy_version 318849 (0.0009) [2023-12-26 02:07:46,970][123091] Updated weights for policy 0, policy_version 318859 (0.0007) [2023-12-26 02:07:47,279][123090] Updated weights for policy 1, policy_version 317191 (0.0009) [2023-12-26 02:07:47,332][123090] Updated weights for policy 1, policy_version 317201 (0.0010) [2023-12-26 02:07:47,385][123090] Updated weights for policy 1, policy_version 317211 (0.0009) [2023-12-26 02:07:47,708][123091] Updated weights for policy 0, policy_version 318869 (0.0008) [2023-12-26 02:07:47,774][123091] Updated weights for policy 0, policy_version 318879 (0.0010) [2023-12-26 02:07:47,833][123091] Updated weights for policy 0, policy_version 318889 (0.0011) [2023-12-26 02:07:48,241][123090] Updated weights for policy 1, policy_version 317221 (0.0009) [2023-12-26 02:07:48,302][123090] Updated weights for policy 1, policy_version 317231 (0.0010) [2023-12-26 02:07:48,373][123090] Updated weights for policy 1, policy_version 317241 (0.0007) [2023-12-26 02:07:48,679][123091] Updated weights for policy 0, policy_version 318899 (0.0010) [2023-12-26 02:07:48,748][123091] Updated weights for policy 0, policy_version 318909 (0.0009) [2023-12-26 02:07:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 162856960. Throughput: 0: 8690.6, 1: 8831.3. Samples: 162872012. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:48,785][121949] Avg episode reward: [(0, '6184.828'), (1, '5740.744')] [2023-12-26 02:07:48,814][123091] Updated weights for policy 0, policy_version 318919 (0.0010) [2023-12-26 02:07:49,182][123090] Updated weights for policy 1, policy_version 317251 (0.0009) [2023-12-26 02:07:49,256][123090] Updated weights for policy 1, policy_version 317261 (0.0009) [2023-12-26 02:07:49,319][123090] Updated weights for policy 1, policy_version 317271 (0.0008) [2023-12-26 02:07:49,638][123091] Updated weights for policy 0, policy_version 318929 (0.0010) [2023-12-26 02:07:49,690][123091] Updated weights for policy 0, policy_version 318939 (0.0010) [2023-12-26 02:07:49,745][123091] Updated weights for policy 0, policy_version 318949 (0.0009) [2023-12-26 02:07:49,796][123091] Updated weights for policy 0, policy_version 318959 (0.0008) [2023-12-26 02:07:50,108][123090] Updated weights for policy 1, policy_version 317281 (0.0009) [2023-12-26 02:07:50,176][123090] Updated weights for policy 1, policy_version 317291 (0.0009) [2023-12-26 02:07:50,245][123090] Updated weights for policy 1, policy_version 317301 (0.0009) [2023-12-26 02:07:50,305][123090] Updated weights for policy 1, policy_version 317311 (0.0009) [2023-12-26 02:07:50,633][123091] Updated weights for policy 0, policy_version 318969 (0.0010) [2023-12-26 02:07:50,690][123091] Updated weights for policy 0, policy_version 318979 (0.0009) [2023-12-26 02:07:50,747][123091] Updated weights for policy 0, policy_version 318991 (0.0010) [2023-12-26 02:07:51,130][123090] Updated weights for policy 1, policy_version 317321 (0.0009) [2023-12-26 02:07:51,184][123090] Updated weights for policy 1, policy_version 317331 (0.0009) [2023-12-26 02:07:51,249][123090] Updated weights for policy 1, policy_version 317341 (0.0009) [2023-12-26 02:07:51,664][123091] Updated weights for policy 0, policy_version 319001 (0.0010) [2023-12-26 02:07:51,732][123091] Updated weights for policy 0, policy_version 319012 (0.0008) [2023-12-26 02:07:51,804][123091] Updated weights for policy 0, policy_version 319022 (0.0009) [2023-12-26 02:07:52,085][123090] Updated weights for policy 1, policy_version 317351 (0.0009) [2023-12-26 02:07:52,148][123090] Updated weights for policy 1, policy_version 317361 (0.0010) [2023-12-26 02:07:52,204][123090] Updated weights for policy 1, policy_version 317371 (0.0009) [2023-12-26 02:07:52,550][123091] Updated weights for policy 0, policy_version 319032 (0.0007) [2023-12-26 02:07:52,611][123091] Updated weights for policy 0, policy_version 319042 (0.0005) [2023-12-26 02:07:52,662][123091] Updated weights for policy 0, policy_version 319052 (0.0010) [2023-12-26 02:07:53,078][123090] Updated weights for policy 1, policy_version 317381 (0.0009) [2023-12-26 02:07:53,133][123090] Updated weights for policy 1, policy_version 317391 (0.0010) [2023-12-26 02:07:53,188][123090] Updated weights for policy 1, policy_version 317401 (0.0010) [2023-12-26 02:07:53,338][123091] Updated weights for policy 0, policy_version 319062 (0.0007) [2023-12-26 02:07:53,404][123091] Updated weights for policy 0, policy_version 319072 (0.0010) [2023-12-26 02:07:53,463][123091] Updated weights for policy 0, policy_version 319082 (0.0010) [2023-12-26 02:07:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 162947072. Throughput: 0: 8627.4, 1: 8866.4. Samples: 162922760. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:53,785][121949] Avg episode reward: [(0, '6282.059'), (1, '5856.479')] [2023-12-26 02:07:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000319088_81690624.pth... [2023-12-26 02:07:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000317408_81256448.pth... [2023-12-26 02:07:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000318064_81428480.pth [2023-12-26 02:07:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000316384_80994304.pth [2023-12-26 02:07:54,098][123090] Updated weights for policy 1, policy_version 317411 (0.0010) [2023-12-26 02:07:54,152][123090] Updated weights for policy 1, policy_version 317421 (0.0010) [2023-12-26 02:07:54,181][123091] Updated weights for policy 0, policy_version 319092 (0.0008) [2023-12-26 02:07:54,202][123090] Updated weights for policy 1, policy_version 317431 (0.0009) [2023-12-26 02:07:54,246][123091] Updated weights for policy 0, policy_version 319102 (0.0005) [2023-12-26 02:07:54,315][123091] Updated weights for policy 0, policy_version 319112 (0.0005) [2023-12-26 02:07:55,054][123091] Updated weights for policy 0, policy_version 319122 (0.0005) [2023-12-26 02:07:55,096][123090] Updated weights for policy 1, policy_version 317441 (0.0008) [2023-12-26 02:07:55,118][123091] Updated weights for policy 0, policy_version 319132 (0.0005) [2023-12-26 02:07:55,166][123090] Updated weights for policy 1, policy_version 317451 (0.0008) [2023-12-26 02:07:55,186][123091] Updated weights for policy 0, policy_version 319142 (0.0005) [2023-12-26 02:07:55,234][123090] Updated weights for policy 1, policy_version 317461 (0.0010) [2023-12-26 02:07:55,247][123091] Updated weights for policy 0, policy_version 319152 (0.0005) [2023-12-26 02:07:55,292][123090] Updated weights for policy 1, policy_version 317471 (0.0010) [2023-12-26 02:07:55,974][123091] Updated weights for policy 0, policy_version 319162 (0.0010) [2023-12-26 02:07:56,021][123091] Updated weights for policy 0, policy_version 319172 (0.0010) [2023-12-26 02:07:56,073][123091] Updated weights for policy 0, policy_version 319182 (0.0010) [2023-12-26 02:07:56,128][123090] Updated weights for policy 1, policy_version 317481 (0.0006) [2023-12-26 02:07:56,200][123090] Updated weights for policy 1, policy_version 317491 (0.0005) [2023-12-26 02:07:56,269][123090] Updated weights for policy 1, policy_version 317501 (0.0008) [2023-12-26 02:07:56,767][123091] Updated weights for policy 0, policy_version 319192 (0.0010) [2023-12-26 02:07:56,825][123091] Updated weights for policy 0, policy_version 319202 (0.0010) [2023-12-26 02:07:56,879][123091] Updated weights for policy 0, policy_version 319212 (0.0010) [2023-12-26 02:07:57,011][123090] Updated weights for policy 1, policy_version 317511 (0.0009) [2023-12-26 02:07:57,063][123090] Updated weights for policy 1, policy_version 317521 (0.0008) [2023-12-26 02:07:57,110][123090] Updated weights for policy 1, policy_version 317531 (0.0008) [2023-12-26 02:07:57,694][123091] Updated weights for policy 0, policy_version 319222 (0.0010) [2023-12-26 02:07:57,771][123091] Updated weights for policy 0, policy_version 319232 (0.0010) [2023-12-26 02:07:57,838][123091] Updated weights for policy 0, policy_version 319242 (0.0010) [2023-12-26 02:07:57,896][123090] Updated weights for policy 1, policy_version 317541 (0.0009) [2023-12-26 02:07:57,944][123090] Updated weights for policy 1, policy_version 317551 (0.0008) [2023-12-26 02:07:58,001][123090] Updated weights for policy 1, policy_version 317561 (0.0009) [2023-12-26 02:07:58,720][123091] Updated weights for policy 0, policy_version 319252 (0.0010) [2023-12-26 02:07:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17717.0). Total num frames: 163028992. Throughput: 0: 8769.6, 1: 8810.0. Samples: 163029648. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:07:58,784][121949] Avg episode reward: [(0, '6326.750'), (1, '5897.477')] [2023-12-26 02:07:58,798][123091] Updated weights for policy 0, policy_version 319262 (0.0009) [2023-12-26 02:07:58,868][123091] Updated weights for policy 0, policy_version 319272 (0.0009) [2023-12-26 02:07:58,996][123090] Updated weights for policy 1, policy_version 317571 (0.0009) [2023-12-26 02:07:59,060][123090] Updated weights for policy 1, policy_version 317581 (0.0008) [2023-12-26 02:07:59,118][123090] Updated weights for policy 1, policy_version 317591 (0.0006) [2023-12-26 02:07:59,749][123091] Updated weights for policy 0, policy_version 319282 (0.0009) [2023-12-26 02:07:59,818][123091] Updated weights for policy 0, policy_version 319292 (0.0010) [2023-12-26 02:07:59,877][123091] Updated weights for policy 0, policy_version 319302 (0.0010) [2023-12-26 02:07:59,878][123090] Updated weights for policy 1, policy_version 317601 (0.0006) [2023-12-26 02:07:59,945][123090] Updated weights for policy 1, policy_version 317611 (0.0008) [2023-12-26 02:08:00,004][123090] Updated weights for policy 1, policy_version 317621 (0.0009) [2023-12-26 02:08:00,067][123090] Updated weights for policy 1, policy_version 317631 (0.0009) [2023-12-26 02:08:00,688][123091] Updated weights for policy 0, policy_version 319313 (0.0008) [2023-12-26 02:08:00,743][123091] Updated weights for policy 0, policy_version 319323 (0.0009) [2023-12-26 02:08:00,796][123091] Updated weights for policy 0, policy_version 319333 (0.0009) [2023-12-26 02:08:00,844][123091] Updated weights for policy 0, policy_version 319343 (0.0009) [2023-12-26 02:08:00,909][123090] Updated weights for policy 1, policy_version 317641 (0.0009) [2023-12-26 02:08:00,969][123090] Updated weights for policy 1, policy_version 317651 (0.0009) [2023-12-26 02:08:01,030][123090] Updated weights for policy 1, policy_version 317661 (0.0009) [2023-12-26 02:08:01,699][123091] Updated weights for policy 0, policy_version 319353 (0.0009) [2023-12-26 02:08:01,771][123091] Updated weights for policy 0, policy_version 319363 (0.0009) [2023-12-26 02:08:01,826][123091] Updated weights for policy 0, policy_version 319373 (0.0009) [2023-12-26 02:08:01,939][123090] Updated weights for policy 1, policy_version 317671 (0.0009) [2023-12-26 02:08:01,989][123090] Updated weights for policy 1, policy_version 317681 (0.0009) [2023-12-26 02:08:02,041][123090] Updated weights for policy 1, policy_version 317691 (0.0009) [2023-12-26 02:08:02,650][123091] Updated weights for policy 0, policy_version 319383 (0.0010) [2023-12-26 02:08:02,718][123091] Updated weights for policy 0, policy_version 319393 (0.0010) [2023-12-26 02:08:02,789][123091] Updated weights for policy 0, policy_version 319403 (0.0010) [2023-12-26 02:08:02,833][123090] Updated weights for policy 1, policy_version 317701 (0.0006) [2023-12-26 02:08:02,889][123090] Updated weights for policy 1, policy_version 317711 (0.0005) [2023-12-26 02:08:02,950][123090] Updated weights for policy 1, policy_version 317721 (0.0006) [2023-12-26 02:08:03,563][123090] Updated weights for policy 1, policy_version 317731 (0.0006) [2023-12-26 02:08:03,591][123091] Updated weights for policy 0, policy_version 319413 (0.0007) [2023-12-26 02:08:03,627][123090] Updated weights for policy 1, policy_version 317741 (0.0008) [2023-12-26 02:08:03,636][123091] Updated weights for policy 0, policy_version 319423 (0.0005) [2023-12-26 02:08:03,690][123090] Updated weights for policy 1, policy_version 317751 (0.0009) [2023-12-26 02:08:03,696][123091] Updated weights for policy 0, policy_version 319433 (0.0005) [2023-12-26 02:08:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 163127296. Throughput: 0: 8720.0, 1: 8749.2. Samples: 163132232. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:03,785][121949] Avg episode reward: [(0, '6275.777'), (1, '5875.819')] [2023-12-26 02:08:04,495][123090] Updated weights for policy 1, policy_version 317761 (0.0008) [2023-12-26 02:08:04,504][123091] Updated weights for policy 0, policy_version 319443 (0.0005) [2023-12-26 02:08:04,545][123090] Updated weights for policy 1, policy_version 317771 (0.0009) [2023-12-26 02:08:04,577][123091] Updated weights for policy 0, policy_version 319453 (0.0007) [2023-12-26 02:08:04,602][123090] Updated weights for policy 1, policy_version 317781 (0.0009) [2023-12-26 02:08:04,624][123091] Updated weights for policy 0, policy_version 319463 (0.0010) [2023-12-26 02:08:04,658][123090] Updated weights for policy 1, policy_version 317791 (0.0008) [2023-12-26 02:08:05,458][123091] Updated weights for policy 0, policy_version 319473 (0.0007) [2023-12-26 02:08:05,469][123090] Updated weights for policy 1, policy_version 317801 (0.0009) [2023-12-26 02:08:05,515][123091] Updated weights for policy 0, policy_version 319483 (0.0007) [2023-12-26 02:08:05,533][123090] Updated weights for policy 1, policy_version 317811 (0.0008) [2023-12-26 02:08:05,579][123091] Updated weights for policy 0, policy_version 319493 (0.0008) [2023-12-26 02:08:05,598][123090] Updated weights for policy 1, policy_version 317821 (0.0008) [2023-12-26 02:08:05,633][123091] Updated weights for policy 0, policy_version 319503 (0.0008) [2023-12-26 02:08:06,334][123091] Updated weights for policy 0, policy_version 319513 (0.0009) [2023-12-26 02:08:06,395][123091] Updated weights for policy 0, policy_version 319523 (0.0009) [2023-12-26 02:08:06,461][123091] Updated weights for policy 0, policy_version 319533 (0.0008) [2023-12-26 02:08:06,474][123090] Updated weights for policy 1, policy_version 317831 (0.0007) [2023-12-26 02:08:06,541][123090] Updated weights for policy 1, policy_version 317841 (0.0009) [2023-12-26 02:08:06,625][123090] Updated weights for policy 1, policy_version 317851 (0.0006) [2023-12-26 02:08:07,237][123091] Updated weights for policy 0, policy_version 319543 (0.0010) [2023-12-26 02:08:07,281][123091] Updated weights for policy 0, policy_version 319553 (0.0010) [2023-12-26 02:08:07,332][123091] Updated weights for policy 0, policy_version 319563 (0.0010) [2023-12-26 02:08:07,391][123090] Updated weights for policy 1, policy_version 317861 (0.0008) [2023-12-26 02:08:07,444][123090] Updated weights for policy 1, policy_version 317871 (0.0009) [2023-12-26 02:08:07,502][123090] Updated weights for policy 1, policy_version 317881 (0.0009) [2023-12-26 02:08:08,178][123091] Updated weights for policy 0, policy_version 319573 (0.0010) [2023-12-26 02:08:08,230][123091] Updated weights for policy 0, policy_version 319583 (0.0011) [2023-12-26 02:08:08,297][123091] Updated weights for policy 0, policy_version 319593 (0.0011) [2023-12-26 02:08:08,366][123090] Updated weights for policy 1, policy_version 317891 (0.0009) [2023-12-26 02:08:08,431][123090] Updated weights for policy 1, policy_version 317901 (0.0009) [2023-12-26 02:08:08,491][123090] Updated weights for policy 1, policy_version 317911 (0.0008) [2023-12-26 02:08:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 163209216. Throughput: 0: 8771.2, 1: 8744.4. Samples: 163185812. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:08,785][121949] Avg episode reward: [(0, '6211.953'), (1, '5744.926')] [2023-12-26 02:08:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000317920_81387520.pth... [2023-12-26 02:08:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000319600_81821696.pth... [2023-12-26 02:08:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000316896_81125376.pth [2023-12-26 02:08:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000318576_81559552.pth [2023-12-26 02:08:09,130][123091] Updated weights for policy 0, policy_version 319603 (0.0011) [2023-12-26 02:08:09,196][123091] Updated weights for policy 0, policy_version 319613 (0.0010) [2023-12-26 02:08:09,266][123091] Updated weights for policy 0, policy_version 319623 (0.0010) [2023-12-26 02:08:09,335][123090] Updated weights for policy 1, policy_version 317921 (0.0009) [2023-12-26 02:08:09,407][123090] Updated weights for policy 1, policy_version 317931 (0.0009) [2023-12-26 02:08:09,463][123090] Updated weights for policy 1, policy_version 317941 (0.0009) [2023-12-26 02:08:09,529][123090] Updated weights for policy 1, policy_version 317951 (0.0009) [2023-12-26 02:08:10,098][123091] Updated weights for policy 0, policy_version 319633 (0.0010) [2023-12-26 02:08:10,178][123091] Updated weights for policy 0, policy_version 319643 (0.0005) [2023-12-26 02:08:10,256][123091] Updated weights for policy 0, policy_version 319653 (0.0006) [2023-12-26 02:08:10,320][123091] Updated weights for policy 0, policy_version 319663 (0.0006) [2023-12-26 02:08:10,429][123090] Updated weights for policy 1, policy_version 317961 (0.0010) [2023-12-26 02:08:10,495][123090] Updated weights for policy 1, policy_version 317971 (0.0010) [2023-12-26 02:08:10,553][123090] Updated weights for policy 1, policy_version 317981 (0.0010) [2023-12-26 02:08:11,046][123091] Updated weights for policy 0, policy_version 319673 (0.0009) [2023-12-26 02:08:11,112][123091] Updated weights for policy 0, policy_version 319683 (0.0011) [2023-12-26 02:08:11,183][123091] Updated weights for policy 0, policy_version 319693 (0.0010) [2023-12-26 02:08:11,277][123090] Updated weights for policy 1, policy_version 317991 (0.0008) [2023-12-26 02:08:11,349][123090] Updated weights for policy 1, policy_version 318001 (0.0007) [2023-12-26 02:08:11,422][123090] Updated weights for policy 1, policy_version 318011 (0.0008) [2023-12-26 02:08:12,085][123091] Updated weights for policy 0, policy_version 319703 (0.0009) [2023-12-26 02:08:12,137][123091] Updated weights for policy 0, policy_version 319713 (0.0009) [2023-12-26 02:08:12,197][123091] Updated weights for policy 0, policy_version 319723 (0.0010) [2023-12-26 02:08:12,276][123090] Updated weights for policy 1, policy_version 318021 (0.0009) [2023-12-26 02:08:12,333][123090] Updated weights for policy 1, policy_version 318031 (0.0009) [2023-12-26 02:08:12,393][123090] Updated weights for policy 1, policy_version 318041 (0.0009) [2023-12-26 02:08:13,051][123091] Updated weights for policy 0, policy_version 319733 (0.0011) [2023-12-26 02:08:13,114][123091] Updated weights for policy 0, policy_version 319743 (0.0011) [2023-12-26 02:08:13,173][123091] Updated weights for policy 0, policy_version 319753 (0.0010) [2023-12-26 02:08:13,221][123090] Updated weights for policy 1, policy_version 318051 (0.0009) [2023-12-26 02:08:13,272][123090] Updated weights for policy 1, policy_version 318061 (0.0008) [2023-12-26 02:08:13,320][123090] Updated weights for policy 1, policy_version 318071 (0.0008) [2023-12-26 02:08:13,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 163291136. Throughput: 0: 8726.1, 1: 8633.0. Samples: 163286304. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:13,785][121949] Avg episode reward: [(0, '6241.473'), (1, '5645.246')] [2023-12-26 02:08:13,939][123091] Updated weights for policy 0, policy_version 319763 (0.0010) [2023-12-26 02:08:14,005][123091] Updated weights for policy 0, policy_version 319773 (0.0009) [2023-12-26 02:08:14,075][123091] Updated weights for policy 0, policy_version 319783 (0.0011) [2023-12-26 02:08:14,112][123090] Updated weights for policy 1, policy_version 318081 (0.0009) [2023-12-26 02:08:14,173][123090] Updated weights for policy 1, policy_version 318091 (0.0008) [2023-12-26 02:08:14,244][123090] Updated weights for policy 1, policy_version 318101 (0.0010) [2023-12-26 02:08:14,296][123090] Updated weights for policy 1, policy_version 318111 (0.0009) [2023-12-26 02:08:14,876][123091] Updated weights for policy 0, policy_version 319793 (0.0011) [2023-12-26 02:08:14,927][123091] Updated weights for policy 0, policy_version 319803 (0.0010) [2023-12-26 02:08:14,994][123091] Updated weights for policy 0, policy_version 319813 (0.0009) [2023-12-26 02:08:15,069][123091] Updated weights for policy 0, policy_version 319823 (0.0010) [2023-12-26 02:08:15,103][123090] Updated weights for policy 1, policy_version 318121 (0.0006) [2023-12-26 02:08:15,174][123090] Updated weights for policy 1, policy_version 318131 (0.0005) [2023-12-26 02:08:15,239][123090] Updated weights for policy 1, policy_version 318141 (0.0005) [2023-12-26 02:08:15,901][123091] Updated weights for policy 0, policy_version 319833 (0.0009) [2023-12-26 02:08:15,953][123091] Updated weights for policy 0, policy_version 319844 (0.0008) [2023-12-26 02:08:15,959][123090] Updated weights for policy 1, policy_version 318151 (0.0008) [2023-12-26 02:08:16,003][123091] Updated weights for policy 0, policy_version 319854 (0.0007) [2023-12-26 02:08:16,010][123090] Updated weights for policy 1, policy_version 318161 (0.0008) [2023-12-26 02:08:16,074][123090] Updated weights for policy 1, policy_version 318171 (0.0008) [2023-12-26 02:08:16,765][123091] Updated weights for policy 0, policy_version 319864 (0.0006) [2023-12-26 02:08:16,863][123091] Updated weights for policy 0, policy_version 319874 (0.0005) [2023-12-26 02:08:16,923][123091] Updated weights for policy 0, policy_version 319884 (0.0007) [2023-12-26 02:08:16,938][123090] Updated weights for policy 1, policy_version 318181 (0.0009) [2023-12-26 02:08:17,006][123090] Updated weights for policy 1, policy_version 318191 (0.0009) [2023-12-26 02:08:17,068][123090] Updated weights for policy 1, policy_version 318201 (0.0010) [2023-12-26 02:08:17,626][123091] Updated weights for policy 0, policy_version 319894 (0.0009) [2023-12-26 02:08:17,674][123091] Updated weights for policy 0, policy_version 319904 (0.0009) [2023-12-26 02:08:17,727][123091] Updated weights for policy 0, policy_version 319914 (0.0010) [2023-12-26 02:08:17,871][123090] Updated weights for policy 1, policy_version 318211 (0.0009) [2023-12-26 02:08:17,924][123090] Updated weights for policy 1, policy_version 318221 (0.0010) [2023-12-26 02:08:17,978][123090] Updated weights for policy 1, policy_version 318231 (0.0010) [2023-12-26 02:08:18,462][123091] Updated weights for policy 0, policy_version 319924 (0.0010) [2023-12-26 02:08:18,532][123091] Updated weights for policy 0, policy_version 319934 (0.0010) [2023-12-26 02:08:18,593][123091] Updated weights for policy 0, policy_version 319944 (0.0009) [2023-12-26 02:08:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 163381248. Throughput: 0: 8723.6, 1: 8630.8. Samples: 163392448. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:18,785][121949] Avg episode reward: [(0, '6245.792'), (1, '5685.038')] [2023-12-26 02:08:18,873][123090] Updated weights for policy 1, policy_version 318241 (0.0010) [2023-12-26 02:08:18,945][123090] Updated weights for policy 1, policy_version 318251 (0.0009) [2023-12-26 02:08:19,016][123090] Updated weights for policy 1, policy_version 318261 (0.0010) [2023-12-26 02:08:19,089][123090] Updated weights for policy 1, policy_version 318271 (0.0009) [2023-12-26 02:08:19,431][123091] Updated weights for policy 0, policy_version 319954 (0.0010) [2023-12-26 02:08:19,499][123091] Updated weights for policy 0, policy_version 319964 (0.0010) [2023-12-26 02:08:19,566][123091] Updated weights for policy 0, policy_version 319974 (0.0009) [2023-12-26 02:08:19,626][123091] Updated weights for policy 0, policy_version 319984 (0.0009) [2023-12-26 02:08:19,894][123090] Updated weights for policy 1, policy_version 318281 (0.0010) [2023-12-26 02:08:19,956][123090] Updated weights for policy 1, policy_version 318291 (0.0010) [2023-12-26 02:08:20,021][123090] Updated weights for policy 1, policy_version 318301 (0.0011) [2023-12-26 02:08:20,466][123091] Updated weights for policy 0, policy_version 319994 (0.0009) [2023-12-26 02:08:20,519][123091] Updated weights for policy 0, policy_version 320004 (0.0008) [2023-12-26 02:08:20,587][123091] Updated weights for policy 0, policy_version 320014 (0.0007) [2023-12-26 02:08:20,901][123090] Updated weights for policy 1, policy_version 318311 (0.0010) [2023-12-26 02:08:20,969][123090] Updated weights for policy 1, policy_version 318321 (0.0011) [2023-12-26 02:08:21,031][123090] Updated weights for policy 1, policy_version 318331 (0.0011) [2023-12-26 02:08:21,408][123091] Updated weights for policy 0, policy_version 320024 (0.0009) [2023-12-26 02:08:21,475][123091] Updated weights for policy 0, policy_version 320034 (0.0010) [2023-12-26 02:08:21,534][123091] Updated weights for policy 0, policy_version 320044 (0.0011) [2023-12-26 02:08:21,834][123090] Updated weights for policy 1, policy_version 318341 (0.0011) [2023-12-26 02:08:21,886][123090] Updated weights for policy 1, policy_version 318351 (0.0011) [2023-12-26 02:08:21,938][123090] Updated weights for policy 1, policy_version 318361 (0.0010) [2023-12-26 02:08:22,391][123091] Updated weights for policy 0, policy_version 320054 (0.0010) [2023-12-26 02:08:22,460][123091] Updated weights for policy 0, policy_version 320064 (0.0009) [2023-12-26 02:08:22,516][123091] Updated weights for policy 0, policy_version 320074 (0.0009) [2023-12-26 02:08:22,795][123090] Updated weights for policy 1, policy_version 318371 (0.0010) [2023-12-26 02:08:22,858][123090] Updated weights for policy 1, policy_version 318381 (0.0010) [2023-12-26 02:08:22,921][123090] Updated weights for policy 1, policy_version 318391 (0.0010) [2023-12-26 02:08:23,354][123091] Updated weights for policy 0, policy_version 320084 (0.0008) [2023-12-26 02:08:23,427][123091] Updated weights for policy 0, policy_version 320094 (0.0005) [2023-12-26 02:08:23,498][123091] Updated weights for policy 0, policy_version 320104 (0.0005) [2023-12-26 02:08:23,696][123090] Updated weights for policy 1, policy_version 318401 (0.0011) [2023-12-26 02:08:23,759][123090] Updated weights for policy 1, policy_version 318411 (0.0011) [2023-12-26 02:08:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 163463168. Throughput: 0: 8708.0, 1: 8611.7. Samples: 163442568. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:23,785][121949] Avg episode reward: [(0, '6277.173'), (1, '5650.110')] [2023-12-26 02:08:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000320112_81952768.pth... [2023-12-26 02:08:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000319088_81690624.pth [2023-12-26 02:08:23,815][123090] Updated weights for policy 1, policy_version 318421 (0.0011) [2023-12-26 02:08:23,879][123090] Updated weights for policy 1, policy_version 318431 (0.0011) [2023-12-26 02:08:23,884][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000318432_81518592.pth... [2023-12-26 02:08:23,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000317408_81256448.pth [2023-12-26 02:08:24,200][123091] Updated weights for policy 0, policy_version 320114 (0.0006) [2023-12-26 02:08:24,256][123091] Updated weights for policy 0, policy_version 320124 (0.0010) [2023-12-26 02:08:24,311][123091] Updated weights for policy 0, policy_version 320134 (0.0010) [2023-12-26 02:08:24,367][123091] Updated weights for policy 0, policy_version 320144 (0.0010) [2023-12-26 02:08:24,744][123090] Updated weights for policy 1, policy_version 318441 (0.0009) [2023-12-26 02:08:24,803][123090] Updated weights for policy 1, policy_version 318451 (0.0009) [2023-12-26 02:08:24,871][123090] Updated weights for policy 1, policy_version 318461 (0.0009) [2023-12-26 02:08:25,155][123091] Updated weights for policy 0, policy_version 320154 (0.0009) [2023-12-26 02:08:25,209][123091] Updated weights for policy 0, policy_version 320164 (0.0009) [2023-12-26 02:08:25,256][123091] Updated weights for policy 0, policy_version 320174 (0.0008) [2023-12-26 02:08:25,687][123090] Updated weights for policy 1, policy_version 318471 (0.0009) [2023-12-26 02:08:25,753][123090] Updated weights for policy 1, policy_version 318481 (0.0008) [2023-12-26 02:08:25,817][123090] Updated weights for policy 1, policy_version 318491 (0.0009) [2023-12-26 02:08:26,109][123091] Updated weights for policy 0, policy_version 320184 (0.0009) [2023-12-26 02:08:26,166][123091] Updated weights for policy 0, policy_version 320194 (0.0010) [2023-12-26 02:08:26,220][123091] Updated weights for policy 0, policy_version 320204 (0.0010) [2023-12-26 02:08:26,467][123090] Updated weights for policy 1, policy_version 318501 (0.0009) [2023-12-26 02:08:26,531][123090] Updated weights for policy 1, policy_version 318511 (0.0007) [2023-12-26 02:08:26,602][123090] Updated weights for policy 1, policy_version 318521 (0.0008) [2023-12-26 02:08:26,999][123091] Updated weights for policy 0, policy_version 320214 (0.0006) [2023-12-26 02:08:27,068][123091] Updated weights for policy 0, policy_version 320224 (0.0005) [2023-12-26 02:08:27,136][123091] Updated weights for policy 0, policy_version 320234 (0.0006) [2023-12-26 02:08:27,265][123090] Updated weights for policy 1, policy_version 318531 (0.0009) [2023-12-26 02:08:27,327][123090] Updated weights for policy 1, policy_version 318541 (0.0007) [2023-12-26 02:08:27,385][123090] Updated weights for policy 1, policy_version 318551 (0.0010) [2023-12-26 02:08:27,810][123091] Updated weights for policy 0, policy_version 320244 (0.0008) [2023-12-26 02:08:27,858][123091] Updated weights for policy 0, policy_version 320254 (0.0010) [2023-12-26 02:08:27,900][123091] Updated weights for policy 0, policy_version 320264 (0.0009) [2023-12-26 02:08:28,208][123090] Updated weights for policy 1, policy_version 318562 (0.0010) [2023-12-26 02:08:28,259][123090] Updated weights for policy 1, policy_version 318572 (0.0005) [2023-12-26 02:08:28,310][123090] Updated weights for policy 1, policy_version 318582 (0.0005) [2023-12-26 02:08:28,375][123090] Updated weights for policy 1, policy_version 318592 (0.0007) [2023-12-26 02:08:28,586][123091] Updated weights for policy 0, policy_version 320274 (0.0006) [2023-12-26 02:08:28,650][123091] Updated weights for policy 0, policy_version 320284 (0.0010) [2023-12-26 02:08:28,710][123091] Updated weights for policy 0, policy_version 320294 (0.0010) [2023-12-26 02:08:28,774][123091] Updated weights for policy 0, policy_version 320304 (0.0005) [2023-12-26 02:08:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 163561472. Throughput: 0: 8801.4, 1: 8631.6. Samples: 163549780. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:28,785][121949] Avg episode reward: [(0, '6261.291'), (1, '5548.632')] [2023-12-26 02:08:29,194][123090] Updated weights for policy 1, policy_version 318602 (0.0009) [2023-12-26 02:08:29,260][123090] Updated weights for policy 1, policy_version 318612 (0.0008) [2023-12-26 02:08:29,320][123090] Updated weights for policy 1, policy_version 318622 (0.0009) [2023-12-26 02:08:29,576][123091] Updated weights for policy 0, policy_version 320314 (0.0011) [2023-12-26 02:08:29,650][123091] Updated weights for policy 0, policy_version 320324 (0.0010) [2023-12-26 02:08:29,715][123091] Updated weights for policy 0, policy_version 320334 (0.0010) [2023-12-26 02:08:30,133][123090] Updated weights for policy 1, policy_version 318632 (0.0009) [2023-12-26 02:08:30,206][123090] Updated weights for policy 1, policy_version 318642 (0.0006) [2023-12-26 02:08:30,282][123090] Updated weights for policy 1, policy_version 318652 (0.0006) [2023-12-26 02:08:30,508][123091] Updated weights for policy 0, policy_version 320344 (0.0006) [2023-12-26 02:08:30,562][123091] Updated weights for policy 0, policy_version 320354 (0.0005) [2023-12-26 02:08:30,623][123091] Updated weights for policy 0, policy_version 320364 (0.0005) [2023-12-26 02:08:31,073][123090] Updated weights for policy 1, policy_version 318662 (0.0006) [2023-12-26 02:08:31,128][123090] Updated weights for policy 1, policy_version 318672 (0.0008) [2023-12-26 02:08:31,191][123090] Updated weights for policy 1, policy_version 318682 (0.0009) [2023-12-26 02:08:31,307][123091] Updated weights for policy 0, policy_version 320374 (0.0008) [2023-12-26 02:08:31,375][123091] Updated weights for policy 0, policy_version 320384 (0.0011) [2023-12-26 02:08:31,437][123091] Updated weights for policy 0, policy_version 320394 (0.0010) [2023-12-26 02:08:32,057][123090] Updated weights for policy 1, policy_version 318692 (0.0009) [2023-12-26 02:08:32,120][123090] Updated weights for policy 1, policy_version 318702 (0.0010) [2023-12-26 02:08:32,179][123090] Updated weights for policy 1, policy_version 318712 (0.0010) [2023-12-26 02:08:32,240][123091] Updated weights for policy 0, policy_version 320404 (0.0008) [2023-12-26 02:08:32,308][123091] Updated weights for policy 0, policy_version 320414 (0.0010) [2023-12-26 02:08:32,371][123091] Updated weights for policy 0, policy_version 320424 (0.0009) [2023-12-26 02:08:32,998][123090] Updated weights for policy 1, policy_version 318722 (0.0010) [2023-12-26 02:08:33,046][123090] Updated weights for policy 1, policy_version 318732 (0.0009) [2023-12-26 02:08:33,098][123090] Updated weights for policy 1, policy_version 318742 (0.0009) [2023-12-26 02:08:33,147][123090] Updated weights for policy 1, policy_version 318752 (0.0008) [2023-12-26 02:08:33,174][123091] Updated weights for policy 0, policy_version 320434 (0.0009) [2023-12-26 02:08:33,225][123091] Updated weights for policy 0, policy_version 320444 (0.0009) [2023-12-26 02:08:33,274][123091] Updated weights for policy 0, policy_version 320455 (0.0009) [2023-12-26 02:08:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 163643392. Throughput: 0: 8831.1, 1: 8590.6. Samples: 163655988. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:33,785][121949] Avg episode reward: [(0, '6155.500'), (1, '5535.552')] [2023-12-26 02:08:33,920][123090] Updated weights for policy 1, policy_version 318762 (0.0006) [2023-12-26 02:08:33,970][123090] Updated weights for policy 1, policy_version 318772 (0.0005) [2023-12-26 02:08:34,018][123090] Updated weights for policy 1, policy_version 318782 (0.0005) [2023-12-26 02:08:34,159][123091] Updated weights for policy 0, policy_version 320465 (0.0008) [2023-12-26 02:08:34,219][123091] Updated weights for policy 0, policy_version 320475 (0.0007) [2023-12-26 02:08:34,279][123091] Updated weights for policy 0, policy_version 320485 (0.0006) [2023-12-26 02:08:34,345][123091] Updated weights for policy 0, policy_version 320495 (0.0006) [2023-12-26 02:08:34,829][123090] Updated weights for policy 1, policy_version 318792 (0.0009) [2023-12-26 02:08:34,902][123090] Updated weights for policy 1, policy_version 318802 (0.0010) [2023-12-26 02:08:34,968][123090] Updated weights for policy 1, policy_version 318812 (0.0010) [2023-12-26 02:08:35,113][123091] Updated weights for policy 0, policy_version 320505 (0.0006) [2023-12-26 02:08:35,166][123091] Updated weights for policy 0, policy_version 320515 (0.0005) [2023-12-26 02:08:35,214][123091] Updated weights for policy 0, policy_version 320525 (0.0005) [2023-12-26 02:08:35,756][123090] Updated weights for policy 1, policy_version 318822 (0.0007) [2023-12-26 02:08:35,820][123090] Updated weights for policy 1, policy_version 318832 (0.0007) [2023-12-26 02:08:35,872][123090] Updated weights for policy 1, policy_version 318842 (0.0009) [2023-12-26 02:08:35,899][123091] Updated weights for policy 0, policy_version 320535 (0.0009) [2023-12-26 02:08:35,958][123091] Updated weights for policy 0, policy_version 320545 (0.0009) [2023-12-26 02:08:36,012][123091] Updated weights for policy 0, policy_version 320555 (0.0009) [2023-12-26 02:08:36,602][123090] Updated weights for policy 1, policy_version 318852 (0.0009) [2023-12-26 02:08:36,673][123090] Updated weights for policy 1, policy_version 318862 (0.0007) [2023-12-26 02:08:36,743][123090] Updated weights for policy 1, policy_version 318872 (0.0007) [2023-12-26 02:08:36,916][123091] Updated weights for policy 0, policy_version 320565 (0.0010) [2023-12-26 02:08:36,965][123091] Updated weights for policy 0, policy_version 320575 (0.0009) [2023-12-26 02:08:37,021][123091] Updated weights for policy 0, policy_version 320585 (0.0009) [2023-12-26 02:08:37,391][123090] Updated weights for policy 1, policy_version 318882 (0.0007) [2023-12-26 02:08:37,449][123090] Updated weights for policy 1, policy_version 318892 (0.0005) [2023-12-26 02:08:37,506][123090] Updated weights for policy 1, policy_version 318902 (0.0005) [2023-12-26 02:08:37,562][123090] Updated weights for policy 1, policy_version 318912 (0.0006) [2023-12-26 02:08:37,850][123091] Updated weights for policy 0, policy_version 320595 (0.0009) [2023-12-26 02:08:37,911][123091] Updated weights for policy 0, policy_version 320605 (0.0005) [2023-12-26 02:08:37,968][123091] Updated weights for policy 0, policy_version 320615 (0.0005) [2023-12-26 02:08:38,429][123090] Updated weights for policy 1, policy_version 318922 (0.0010) [2023-12-26 02:08:38,484][123090] Updated weights for policy 1, policy_version 318932 (0.0009) [2023-12-26 02:08:38,539][123090] Updated weights for policy 1, policy_version 318942 (0.0009) [2023-12-26 02:08:38,555][123091] Updated weights for policy 0, policy_version 320625 (0.0006) [2023-12-26 02:08:38,620][123091] Updated weights for policy 0, policy_version 320635 (0.0010) [2023-12-26 02:08:38,682][123091] Updated weights for policy 0, policy_version 320645 (0.0009) [2023-12-26 02:08:38,746][123091] Updated weights for policy 0, policy_version 320655 (0.0009) [2023-12-26 02:08:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 163741696. Throughput: 0: 8879.2, 1: 8637.6. Samples: 163711016. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:38,785][121949] Avg episode reward: [(0, '6202.695'), (1, '5427.695')] [2023-12-26 02:08:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000320656_82092032.pth... [2023-12-26 02:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000318944_81649664.pth... [2023-12-26 02:08:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000319600_81821696.pth [2023-12-26 02:08:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000317920_81387520.pth [2023-12-26 02:08:39,437][123090] Updated weights for policy 1, policy_version 318952 (0.0010) [2023-12-26 02:08:39,503][123090] Updated weights for policy 1, policy_version 318962 (0.0009) [2023-12-26 02:08:39,513][123091] Updated weights for policy 0, policy_version 320665 (0.0006) [2023-12-26 02:08:39,568][123090] Updated weights for policy 1, policy_version 318972 (0.0006) [2023-12-26 02:08:39,581][123091] Updated weights for policy 0, policy_version 320675 (0.0009) [2023-12-26 02:08:39,648][123091] Updated weights for policy 0, policy_version 320685 (0.0009) [2023-12-26 02:08:40,388][123090] Updated weights for policy 1, policy_version 318982 (0.0008) [2023-12-26 02:08:40,452][123090] Updated weights for policy 1, policy_version 318992 (0.0009) [2023-12-26 02:08:40,515][123091] Updated weights for policy 0, policy_version 320695 (0.0011) [2023-12-26 02:08:40,518][123090] Updated weights for policy 1, policy_version 319002 (0.0007) [2023-12-26 02:08:40,574][123091] Updated weights for policy 0, policy_version 320705 (0.0011) [2023-12-26 02:08:40,637][123091] Updated weights for policy 0, policy_version 320715 (0.0011) [2023-12-26 02:08:41,327][123090] Updated weights for policy 1, policy_version 319012 (0.0007) [2023-12-26 02:08:41,402][123090] Updated weights for policy 1, policy_version 319022 (0.0008) [2023-12-26 02:08:41,462][123091] Updated weights for policy 0, policy_version 320725 (0.0009) [2023-12-26 02:08:41,473][123090] Updated weights for policy 1, policy_version 319032 (0.0009) [2023-12-26 02:08:41,530][123091] Updated weights for policy 0, policy_version 320735 (0.0010) [2023-12-26 02:08:41,589][123091] Updated weights for policy 0, policy_version 320745 (0.0011) [2023-12-26 02:08:42,286][123090] Updated weights for policy 1, policy_version 319042 (0.0009) [2023-12-26 02:08:42,328][123091] Updated weights for policy 0, policy_version 320755 (0.0009) [2023-12-26 02:08:42,362][123090] Updated weights for policy 1, policy_version 319052 (0.0008) [2023-12-26 02:08:42,398][123091] Updated weights for policy 0, policy_version 320765 (0.0009) [2023-12-26 02:08:42,429][123090] Updated weights for policy 1, policy_version 319062 (0.0008) [2023-12-26 02:08:42,461][123091] Updated weights for policy 0, policy_version 320775 (0.0010) [2023-12-26 02:08:42,490][123090] Updated weights for policy 1, policy_version 319072 (0.0008) [2023-12-26 02:08:43,226][123091] Updated weights for policy 0, policy_version 320785 (0.0011) [2023-12-26 02:08:43,252][123090] Updated weights for policy 1, policy_version 319082 (0.0005) [2023-12-26 02:08:43,274][123091] Updated weights for policy 0, policy_version 320795 (0.0006) [2023-12-26 02:08:43,317][123090] Updated weights for policy 1, policy_version 319092 (0.0006) [2023-12-26 02:08:43,321][123091] Updated weights for policy 0, policy_version 320805 (0.0010) [2023-12-26 02:08:43,365][123091] Updated weights for policy 0, policy_version 320815 (0.0010) [2023-12-26 02:08:43,379][123090] Updated weights for policy 1, policy_version 319102 (0.0007) [2023-12-26 02:08:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 163823616. Throughput: 0: 8795.1, 1: 8668.2. Samples: 163815496. Policy #0 lag: (min: 31.0, avg: 42.5, max: 63.0) [2023-12-26 02:08:43,785][121949] Avg episode reward: [(0, '6243.926'), (1, '5608.350')] [2023-12-26 02:08:44,153][123090] Updated weights for policy 1, policy_version 319112 (0.0009) [2023-12-26 02:08:44,201][123090] Updated weights for policy 1, policy_version 319122 (0.0009) [2023-12-26 02:08:44,236][123091] Updated weights for policy 0, policy_version 320825 (0.0011) [2023-12-26 02:08:44,258][123090] Updated weights for policy 1, policy_version 319132 (0.0010) [2023-12-26 02:08:44,296][123091] Updated weights for policy 0, policy_version 320835 (0.0011) [2023-12-26 02:08:44,355][123091] Updated weights for policy 0, policy_version 320845 (0.0011) [2023-12-26 02:08:45,085][123090] Updated weights for policy 1, policy_version 319142 (0.0007) [2023-12-26 02:08:45,154][123090] Updated weights for policy 1, policy_version 319152 (0.0006) [2023-12-26 02:08:45,187][123091] Updated weights for policy 0, policy_version 320855 (0.0011) [2023-12-26 02:08:45,217][123090] Updated weights for policy 1, policy_version 319162 (0.0006) [2023-12-26 02:08:45,255][123091] Updated weights for policy 0, policy_version 320865 (0.0011) [2023-12-26 02:08:45,320][123091] Updated weights for policy 0, policy_version 320875 (0.0011) [2023-12-26 02:08:45,950][123090] Updated weights for policy 1, policy_version 319172 (0.0007) [2023-12-26 02:08:46,001][123090] Updated weights for policy 1, policy_version 319182 (0.0009) [2023-12-26 02:08:46,050][123090] Updated weights for policy 1, policy_version 319192 (0.0008) [2023-12-26 02:08:46,055][123091] Updated weights for policy 0, policy_version 320885 (0.0008) [2023-12-26 02:08:46,113][123091] Updated weights for policy 0, policy_version 320895 (0.0006) [2023-12-26 02:08:46,179][123091] Updated weights for policy 0, policy_version 320905 (0.0006) [2023-12-26 02:08:46,913][123091] Updated weights for policy 0, policy_version 320915 (0.0005) [2023-12-26 02:08:46,970][123090] Updated weights for policy 1, policy_version 319202 (0.0010) [2023-12-26 02:08:46,974][123091] Updated weights for policy 0, policy_version 320925 (0.0005) [2023-12-26 02:08:47,036][123090] Updated weights for policy 1, policy_version 319212 (0.0009) [2023-12-26 02:08:47,041][123091] Updated weights for policy 0, policy_version 320935 (0.0005) [2023-12-26 02:08:47,108][123090] Updated weights for policy 1, policy_version 319222 (0.0006) [2023-12-26 02:08:47,184][123090] Updated weights for policy 1, policy_version 319232 (0.0005) [2023-12-26 02:08:47,783][123091] Updated weights for policy 0, policy_version 320945 (0.0006) [2023-12-26 02:08:47,845][123091] Updated weights for policy 0, policy_version 320955 (0.0010) [2023-12-26 02:08:47,908][123091] Updated weights for policy 0, policy_version 320965 (0.0011) [2023-12-26 02:08:47,931][123090] Updated weights for policy 1, policy_version 319242 (0.0007) [2023-12-26 02:08:47,959][123091] Updated weights for policy 0, policy_version 320975 (0.0011) [2023-12-26 02:08:47,984][123090] Updated weights for policy 1, policy_version 319252 (0.0007) [2023-12-26 02:08:48,036][123090] Updated weights for policy 1, policy_version 319262 (0.0008) [2023-12-26 02:08:48,710][123091] Updated weights for policy 0, policy_version 320985 (0.0008) [2023-12-26 02:08:48,762][123091] Updated weights for policy 0, policy_version 320995 (0.0009) [2023-12-26 02:08:48,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 163905536. Throughput: 0: 8905.5, 1: 8666.3. Samples: 163922956. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:08:48,785][121949] Avg episode reward: [(0, '6237.053'), (1, '5659.054')] [2023-12-26 02:08:48,832][123091] Updated weights for policy 0, policy_version 321005 (0.0008) [2023-12-26 02:08:48,911][123090] Updated weights for policy 1, policy_version 319272 (0.0006) [2023-12-26 02:08:48,967][123090] Updated weights for policy 1, policy_version 319282 (0.0005) [2023-12-26 02:08:49,020][123090] Updated weights for policy 1, policy_version 319292 (0.0006) [2023-12-26 02:08:49,636][123091] Updated weights for policy 0, policy_version 321015 (0.0010) [2023-12-26 02:08:49,700][123091] Updated weights for policy 0, policy_version 321025 (0.0009) [2023-12-26 02:08:49,752][123091] Updated weights for policy 0, policy_version 321035 (0.0009) [2023-12-26 02:08:49,828][123090] Updated weights for policy 1, policy_version 319302 (0.0009) [2023-12-26 02:08:49,902][123090] Updated weights for policy 1, policy_version 319312 (0.0009) [2023-12-26 02:08:49,975][123090] Updated weights for policy 1, policy_version 319322 (0.0010) [2023-12-26 02:08:50,572][123091] Updated weights for policy 0, policy_version 321045 (0.0010) [2023-12-26 02:08:50,645][123091] Updated weights for policy 0, policy_version 321055 (0.0010) [2023-12-26 02:08:50,713][123091] Updated weights for policy 0, policy_version 321065 (0.0010) [2023-12-26 02:08:50,817][123090] Updated weights for policy 1, policy_version 319332 (0.0009) [2023-12-26 02:08:50,875][123090] Updated weights for policy 1, policy_version 319342 (0.0010) [2023-12-26 02:08:50,945][123090] Updated weights for policy 1, policy_version 319352 (0.0009) [2023-12-26 02:08:51,574][123091] Updated weights for policy 0, policy_version 321075 (0.0010) [2023-12-26 02:08:51,636][123091] Updated weights for policy 0, policy_version 321085 (0.0010) [2023-12-26 02:08:51,699][123091] Updated weights for policy 0, policy_version 321095 (0.0011) [2023-12-26 02:08:51,827][123090] Updated weights for policy 1, policy_version 319362 (0.0009) [2023-12-26 02:08:51,887][123090] Updated weights for policy 1, policy_version 319372 (0.0006) [2023-12-26 02:08:51,958][123090] Updated weights for policy 1, policy_version 319382 (0.0009) [2023-12-26 02:08:52,015][123090] Updated weights for policy 1, policy_version 319392 (0.0010) [2023-12-26 02:08:52,380][123091] Updated weights for policy 0, policy_version 321105 (0.0009) [2023-12-26 02:08:52,446][123091] Updated weights for policy 0, policy_version 321115 (0.0008) [2023-12-26 02:08:52,514][123091] Updated weights for policy 0, policy_version 321125 (0.0008) [2023-12-26 02:08:52,569][123091] Updated weights for policy 0, policy_version 321135 (0.0008) [2023-12-26 02:08:52,857][123090] Updated weights for policy 1, policy_version 319402 (0.0005) [2023-12-26 02:08:52,907][123090] Updated weights for policy 1, policy_version 319412 (0.0005) [2023-12-26 02:08:52,956][123090] Updated weights for policy 1, policy_version 319422 (0.0005) [2023-12-26 02:08:53,275][123091] Updated weights for policy 0, policy_version 321145 (0.0006) [2023-12-26 02:08:53,331][123091] Updated weights for policy 0, policy_version 321155 (0.0005) [2023-12-26 02:08:53,380][123091] Updated weights for policy 0, policy_version 321165 (0.0005) [2023-12-26 02:08:53,672][123090] Updated weights for policy 1, policy_version 319432 (0.0005) [2023-12-26 02:08:53,721][123090] Updated weights for policy 1, policy_version 319442 (0.0005) [2023-12-26 02:08:53,771][123090] Updated weights for policy 1, policy_version 319452 (0.0005) [2023-12-26 02:08:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 163995648. Throughput: 0: 8868.4, 1: 8639.2. Samples: 163973656. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:08:53,785][121949] Avg episode reward: [(0, '6257.469'), (1, '5788.664')] [2023-12-26 02:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000321168_82223104.pth... [2023-12-26 02:08:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000319456_81780736.pth... [2023-12-26 02:08:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000318432_81518592.pth [2023-12-26 02:08:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000320112_81952768.pth [2023-12-26 02:08:54,093][123091] Updated weights for policy 0, policy_version 321175 (0.0009) [2023-12-26 02:08:54,151][123091] Updated weights for policy 0, policy_version 321185 (0.0011) [2023-12-26 02:08:54,203][123091] Updated weights for policy 0, policy_version 321195 (0.0009) [2023-12-26 02:08:54,450][123090] Updated weights for policy 1, policy_version 319462 (0.0009) [2023-12-26 02:08:54,509][123090] Updated weights for policy 1, policy_version 319472 (0.0010) [2023-12-26 02:08:54,571][123090] Updated weights for policy 1, policy_version 319482 (0.0010) [2023-12-26 02:08:54,959][123091] Updated weights for policy 0, policy_version 321205 (0.0007) [2023-12-26 02:08:55,022][123091] Updated weights for policy 0, policy_version 321215 (0.0008) [2023-12-26 02:08:55,083][123091] Updated weights for policy 0, policy_version 321225 (0.0008) [2023-12-26 02:08:55,386][123090] Updated weights for policy 1, policy_version 319492 (0.0008) [2023-12-26 02:08:55,440][123090] Updated weights for policy 1, policy_version 319502 (0.0008) [2023-12-26 02:08:55,495][123090] Updated weights for policy 1, policy_version 319512 (0.0010) [2023-12-26 02:08:55,813][123091] Updated weights for policy 0, policy_version 321235 (0.0009) [2023-12-26 02:08:55,867][123091] Updated weights for policy 0, policy_version 321245 (0.0010) [2023-12-26 02:08:55,922][123091] Updated weights for policy 0, policy_version 321255 (0.0010) [2023-12-26 02:08:56,182][123090] Updated weights for policy 1, policy_version 319522 (0.0006) [2023-12-26 02:08:56,248][123090] Updated weights for policy 1, policy_version 319532 (0.0009) [2023-12-26 02:08:56,306][123090] Updated weights for policy 1, policy_version 319542 (0.0009) [2023-12-26 02:08:56,359][123090] Updated weights for policy 1, policy_version 319552 (0.0005) [2023-12-26 02:08:56,728][123091] Updated weights for policy 0, policy_version 321265 (0.0009) [2023-12-26 02:08:56,787][123091] Updated weights for policy 0, policy_version 321275 (0.0005) [2023-12-26 02:08:56,842][123091] Updated weights for policy 0, policy_version 321285 (0.0009) [2023-12-26 02:08:56,897][123091] Updated weights for policy 0, policy_version 321296 (0.0009) [2023-12-26 02:08:57,066][123090] Updated weights for policy 1, policy_version 319562 (0.0007) [2023-12-26 02:08:57,125][123090] Updated weights for policy 1, policy_version 319572 (0.0009) [2023-12-26 02:08:57,193][123090] Updated weights for policy 1, policy_version 319582 (0.0006) [2023-12-26 02:08:57,658][123091] Updated weights for policy 0, policy_version 321306 (0.0008) [2023-12-26 02:08:57,717][123091] Updated weights for policy 0, policy_version 321316 (0.0008) [2023-12-26 02:08:57,783][123091] Updated weights for policy 0, policy_version 321326 (0.0009) [2023-12-26 02:08:57,919][123090] Updated weights for policy 1, policy_version 319592 (0.0005) [2023-12-26 02:08:57,984][123090] Updated weights for policy 1, policy_version 319602 (0.0006) [2023-12-26 02:08:58,050][123090] Updated weights for policy 1, policy_version 319612 (0.0008) [2023-12-26 02:08:58,639][123091] Updated weights for policy 0, policy_version 321336 (0.0007) [2023-12-26 02:08:58,713][123091] Updated weights for policy 0, policy_version 321346 (0.0008) [2023-12-26 02:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 164085760. Throughput: 0: 9005.0, 1: 8789.9. Samples: 164087072. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:08:58,785][121949] Avg episode reward: [(0, '6337.419'), (1, '5794.664')] [2023-12-26 02:08:58,788][123091] Updated weights for policy 0, policy_version 321356 (0.0008) [2023-12-26 02:08:58,918][123090] Updated weights for policy 1, policy_version 319622 (0.0010) [2023-12-26 02:08:58,993][123090] Updated weights for policy 1, policy_version 319632 (0.0009) [2023-12-26 02:08:59,061][123090] Updated weights for policy 1, policy_version 319642 (0.0009) [2023-12-26 02:08:59,566][123091] Updated weights for policy 0, policy_version 321366 (0.0007) [2023-12-26 02:08:59,624][123091] Updated weights for policy 0, policy_version 321376 (0.0005) [2023-12-26 02:08:59,682][123091] Updated weights for policy 0, policy_version 321386 (0.0005) [2023-12-26 02:08:59,872][123090] Updated weights for policy 1, policy_version 319652 (0.0009) [2023-12-26 02:08:59,940][123090] Updated weights for policy 1, policy_version 319662 (0.0007) [2023-12-26 02:08:59,997][123090] Updated weights for policy 1, policy_version 319672 (0.0007) [2023-12-26 02:09:00,431][123091] Updated weights for policy 0, policy_version 321396 (0.0005) [2023-12-26 02:09:00,480][123091] Updated weights for policy 0, policy_version 321406 (0.0006) [2023-12-26 02:09:00,533][123091] Updated weights for policy 0, policy_version 321416 (0.0006) [2023-12-26 02:09:00,661][123090] Updated weights for policy 1, policy_version 319682 (0.0009) [2023-12-26 02:09:00,709][123090] Updated weights for policy 1, policy_version 319692 (0.0005) [2023-12-26 02:09:00,762][123090] Updated weights for policy 1, policy_version 319702 (0.0005) [2023-12-26 02:09:00,808][123090] Updated weights for policy 1, policy_version 319712 (0.0005) [2023-12-26 02:09:01,201][123091] Updated weights for policy 0, policy_version 321426 (0.0006) [2023-12-26 02:09:01,267][123091] Updated weights for policy 0, policy_version 321436 (0.0010) [2023-12-26 02:09:01,336][123091] Updated weights for policy 0, policy_version 321447 (0.0009) [2023-12-26 02:09:01,539][123090] Updated weights for policy 1, policy_version 319722 (0.0010) [2023-12-26 02:09:01,592][123090] Updated weights for policy 1, policy_version 319733 (0.0010) [2023-12-26 02:09:01,656][123090] Updated weights for policy 1, policy_version 319743 (0.0010) [2023-12-26 02:09:02,105][123091] Updated weights for policy 0, policy_version 321457 (0.0008) [2023-12-26 02:09:02,158][123091] Updated weights for policy 0, policy_version 321467 (0.0007) [2023-12-26 02:09:02,213][123091] Updated weights for policy 0, policy_version 321477 (0.0006) [2023-12-26 02:09:02,266][123091] Updated weights for policy 0, policy_version 321487 (0.0007) [2023-12-26 02:09:02,590][123090] Updated weights for policy 1, policy_version 319753 (0.0006) [2023-12-26 02:09:02,656][123090] Updated weights for policy 1, policy_version 319763 (0.0006) [2023-12-26 02:09:02,715][123090] Updated weights for policy 1, policy_version 319773 (0.0009) [2023-12-26 02:09:03,051][123091] Updated weights for policy 0, policy_version 321497 (0.0009) [2023-12-26 02:09:03,107][123091] Updated weights for policy 0, policy_version 321507 (0.0009) [2023-12-26 02:09:03,159][123091] Updated weights for policy 0, policy_version 321517 (0.0009) [2023-12-26 02:09:03,427][123090] Updated weights for policy 1, policy_version 319783 (0.0009) [2023-12-26 02:09:03,483][123090] Updated weights for policy 1, policy_version 319793 (0.0009) [2023-12-26 02:09:03,535][123090] Updated weights for policy 1, policy_version 319803 (0.0006) [2023-12-26 02:09:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 164184064. Throughput: 0: 9024.4, 1: 8816.7. Samples: 164195296. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:03,784][121949] Avg episode reward: [(0, '6362.836'), (1, '5777.301')] [2023-12-26 02:09:03,834][123091] Updated weights for policy 0, policy_version 321527 (0.0007) [2023-12-26 02:09:03,927][123091] Updated weights for policy 0, policy_version 321537 (0.0008) [2023-12-26 02:09:03,992][123091] Updated weights for policy 0, policy_version 321547 (0.0008) [2023-12-26 02:09:04,398][123090] Updated weights for policy 1, policy_version 319813 (0.0005) [2023-12-26 02:09:04,459][123090] Updated weights for policy 1, policy_version 319823 (0.0007) [2023-12-26 02:09:04,515][123090] Updated weights for policy 1, policy_version 319833 (0.0009) [2023-12-26 02:09:04,762][123091] Updated weights for policy 0, policy_version 321557 (0.0008) [2023-12-26 02:09:04,824][123091] Updated weights for policy 0, policy_version 321567 (0.0010) [2023-12-26 02:09:04,887][123091] Updated weights for policy 0, policy_version 321577 (0.0010) [2023-12-26 02:09:05,249][123090] Updated weights for policy 1, policy_version 319843 (0.0009) [2023-12-26 02:09:05,304][123090] Updated weights for policy 1, policy_version 319853 (0.0008) [2023-12-26 02:09:05,375][123090] Updated weights for policy 1, policy_version 319863 (0.0010) [2023-12-26 02:09:05,705][123091] Updated weights for policy 0, policy_version 321587 (0.0009) [2023-12-26 02:09:05,762][123091] Updated weights for policy 0, policy_version 321597 (0.0005) [2023-12-26 02:09:05,824][123091] Updated weights for policy 0, policy_version 321607 (0.0006) [2023-12-26 02:09:06,271][123090] Updated weights for policy 1, policy_version 319873 (0.0009) [2023-12-26 02:09:06,322][123090] Updated weights for policy 1, policy_version 319883 (0.0010) [2023-12-26 02:09:06,388][123090] Updated weights for policy 1, policy_version 319893 (0.0009) [2023-12-26 02:09:06,465][123090] Updated weights for policy 1, policy_version 319903 (0.0008) [2023-12-26 02:09:06,560][123091] Updated weights for policy 0, policy_version 321617 (0.0006) [2023-12-26 02:09:06,628][123091] Updated weights for policy 0, policy_version 321627 (0.0009) [2023-12-26 02:09:06,694][123091] Updated weights for policy 0, policy_version 321637 (0.0009) [2023-12-26 02:09:06,760][123091] Updated weights for policy 0, policy_version 321647 (0.0008) [2023-12-26 02:09:07,340][123090] Updated weights for policy 1, policy_version 319913 (0.0009) [2023-12-26 02:09:07,389][123090] Updated weights for policy 1, policy_version 319923 (0.0009) [2023-12-26 02:09:07,460][123090] Updated weights for policy 1, policy_version 319933 (0.0009) [2023-12-26 02:09:07,559][123091] Updated weights for policy 0, policy_version 321657 (0.0006) [2023-12-26 02:09:07,621][123091] Updated weights for policy 0, policy_version 321667 (0.0007) [2023-12-26 02:09:07,686][123091] Updated weights for policy 0, policy_version 321677 (0.0010) [2023-12-26 02:09:08,291][123091] Updated weights for policy 0, policy_version 321687 (0.0009) [2023-12-26 02:09:08,360][123091] Updated weights for policy 0, policy_version 321697 (0.0008) [2023-12-26 02:09:08,367][123090] Updated weights for policy 1, policy_version 319943 (0.0008) [2023-12-26 02:09:08,423][123090] Updated weights for policy 1, policy_version 319953 (0.0008) [2023-12-26 02:09:08,424][123091] Updated weights for policy 0, policy_version 321707 (0.0009) [2023-12-26 02:09:08,487][123090] Updated weights for policy 1, policy_version 319963 (0.0008) [2023-12-26 02:09:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 164274176. Throughput: 0: 9083.5, 1: 8814.6. Samples: 164247984. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:08,785][121949] Avg episode reward: [(0, '6307.917'), (1, '5732.499')] [2023-12-26 02:09:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000321712_82362368.pth... [2023-12-26 02:09:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000319968_81911808.pth... [2023-12-26 02:09:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000318944_81649664.pth [2023-12-26 02:09:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000320656_82092032.pth [2023-12-26 02:09:09,193][123091] Updated weights for policy 0, policy_version 321717 (0.0008) [2023-12-26 02:09:09,261][123091] Updated weights for policy 0, policy_version 321727 (0.0010) [2023-12-26 02:09:09,325][123091] Updated weights for policy 0, policy_version 321737 (0.0009) [2023-12-26 02:09:09,334][123090] Updated weights for policy 1, policy_version 319973 (0.0009) [2023-12-26 02:09:09,402][123090] Updated weights for policy 1, policy_version 319983 (0.0011) [2023-12-26 02:09:09,473][123090] Updated weights for policy 1, policy_version 319993 (0.0010) [2023-12-26 02:09:10,166][123091] Updated weights for policy 0, policy_version 321747 (0.0009) [2023-12-26 02:09:10,231][123091] Updated weights for policy 0, policy_version 321757 (0.0010) [2023-12-26 02:09:10,271][123090] Updated weights for policy 1, policy_version 320003 (0.0010) [2023-12-26 02:09:10,302][123091] Updated weights for policy 0, policy_version 321767 (0.0011) [2023-12-26 02:09:10,344][123090] Updated weights for policy 1, policy_version 320013 (0.0007) [2023-12-26 02:09:10,407][123090] Updated weights for policy 1, policy_version 320023 (0.0009) [2023-12-26 02:09:11,068][123091] Updated weights for policy 0, policy_version 321777 (0.0007) [2023-12-26 02:09:11,145][123091] Updated weights for policy 0, policy_version 321787 (0.0009) [2023-12-26 02:09:11,210][123091] Updated weights for policy 0, policy_version 321797 (0.0007) [2023-12-26 02:09:11,219][123090] Updated weights for policy 1, policy_version 320033 (0.0009) [2023-12-26 02:09:11,279][123091] Updated weights for policy 0, policy_version 321807 (0.0009) [2023-12-26 02:09:11,282][123090] Updated weights for policy 1, policy_version 320043 (0.0008) [2023-12-26 02:09:11,345][123090] Updated weights for policy 1, policy_version 320053 (0.0007) [2023-12-26 02:09:11,415][123090] Updated weights for policy 1, policy_version 320063 (0.0010) [2023-12-26 02:09:12,140][123091] Updated weights for policy 0, policy_version 321817 (0.0010) [2023-12-26 02:09:12,211][123091] Updated weights for policy 0, policy_version 321827 (0.0009) [2023-12-26 02:09:12,225][123090] Updated weights for policy 1, policy_version 320073 (0.0008) [2023-12-26 02:09:12,278][123091] Updated weights for policy 0, policy_version 321837 (0.0008) [2023-12-26 02:09:12,294][123090] Updated weights for policy 1, policy_version 320083 (0.0009) [2023-12-26 02:09:12,367][123090] Updated weights for policy 1, policy_version 320093 (0.0009) [2023-12-26 02:09:13,072][123091] Updated weights for policy 0, policy_version 321847 (0.0009) [2023-12-26 02:09:13,138][123091] Updated weights for policy 0, policy_version 321857 (0.0008) [2023-12-26 02:09:13,208][123091] Updated weights for policy 0, policy_version 321867 (0.0008) [2023-12-26 02:09:13,220][123090] Updated weights for policy 1, policy_version 320103 (0.0009) [2023-12-26 02:09:13,274][123090] Updated weights for policy 1, policy_version 320113 (0.0009) [2023-12-26 02:09:13,330][123090] Updated weights for policy 1, policy_version 320123 (0.0009) [2023-12-26 02:09:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 164356096. Throughput: 0: 9036.4, 1: 8748.6. Samples: 164350104. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:13,784][121949] Avg episode reward: [(0, '6337.504'), (1, '5615.891')] [2023-12-26 02:09:13,849][123091] Updated weights for policy 0, policy_version 321877 (0.0007) [2023-12-26 02:09:13,919][123091] Updated weights for policy 0, policy_version 321887 (0.0008) [2023-12-26 02:09:13,984][123091] Updated weights for policy 0, policy_version 321897 (0.0008) [2023-12-26 02:09:14,200][123090] Updated weights for policy 1, policy_version 320133 (0.0010) [2023-12-26 02:09:14,263][123090] Updated weights for policy 1, policy_version 320143 (0.0011) [2023-12-26 02:09:14,328][123090] Updated weights for policy 1, policy_version 320153 (0.0011) [2023-12-26 02:09:14,726][123091] Updated weights for policy 0, policy_version 321907 (0.0007) [2023-12-26 02:09:14,792][123091] Updated weights for policy 0, policy_version 321917 (0.0008) [2023-12-26 02:09:14,854][123091] Updated weights for policy 0, policy_version 321927 (0.0010) [2023-12-26 02:09:15,214][123090] Updated weights for policy 1, policy_version 320163 (0.0010) [2023-12-26 02:09:15,284][123090] Updated weights for policy 1, policy_version 320173 (0.0010) [2023-12-26 02:09:15,345][123090] Updated weights for policy 1, policy_version 320183 (0.0009) [2023-12-26 02:09:15,647][123091] Updated weights for policy 0, policy_version 321937 (0.0009) [2023-12-26 02:09:15,707][123091] Updated weights for policy 0, policy_version 321947 (0.0010) [2023-12-26 02:09:15,766][123091] Updated weights for policy 0, policy_version 321958 (0.0010) [2023-12-26 02:09:16,097][123090] Updated weights for policy 1, policy_version 320193 (0.0009) [2023-12-26 02:09:16,160][123090] Updated weights for policy 1, policy_version 320203 (0.0010) [2023-12-26 02:09:16,214][123090] Updated weights for policy 1, policy_version 320213 (0.0009) [2023-12-26 02:09:16,278][123090] Updated weights for policy 1, policy_version 320223 (0.0009) [2023-12-26 02:09:16,660][123091] Updated weights for policy 0, policy_version 321969 (0.0009) [2023-12-26 02:09:16,720][123091] Updated weights for policy 0, policy_version 321979 (0.0010) [2023-12-26 02:09:16,772][123091] Updated weights for policy 0, policy_version 321989 (0.0010) [2023-12-26 02:09:16,827][123091] Updated weights for policy 0, policy_version 321999 (0.0010) [2023-12-26 02:09:16,980][123090] Updated weights for policy 1, policy_version 320233 (0.0008) [2023-12-26 02:09:17,034][123090] Updated weights for policy 1, policy_version 320243 (0.0009) [2023-12-26 02:09:17,090][123090] Updated weights for policy 1, policy_version 320253 (0.0010) [2023-12-26 02:09:17,716][123091] Updated weights for policy 0, policy_version 322009 (0.0010) [2023-12-26 02:09:17,775][123091] Updated weights for policy 0, policy_version 322020 (0.0009) [2023-12-26 02:09:17,824][123091] Updated weights for policy 0, policy_version 322031 (0.0009) [2023-12-26 02:09:17,899][123090] Updated weights for policy 1, policy_version 320263 (0.0010) [2023-12-26 02:09:17,953][123090] Updated weights for policy 1, policy_version 320273 (0.0010) [2023-12-26 02:09:18,019][123090] Updated weights for policy 1, policy_version 320283 (0.0010) [2023-12-26 02:09:18,568][123091] Updated weights for policy 0, policy_version 322041 (0.0011) [2023-12-26 02:09:18,614][123091] Updated weights for policy 0, policy_version 322051 (0.0009) [2023-12-26 02:09:18,664][123091] Updated weights for policy 0, policy_version 322061 (0.0005) [2023-12-26 02:09:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 164446208. Throughput: 0: 9026.3, 1: 8749.2. Samples: 164455884. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:18,785][121949] Avg episode reward: [(0, '6364.033'), (1, '5505.766')] [2023-12-26 02:09:18,919][123090] Updated weights for policy 1, policy_version 320293 (0.0009) [2023-12-26 02:09:18,984][123090] Updated weights for policy 1, policy_version 320303 (0.0010) [2023-12-26 02:09:19,044][123090] Updated weights for policy 1, policy_version 320313 (0.0010) [2023-12-26 02:09:19,498][123091] Updated weights for policy 0, policy_version 322071 (0.0007) [2023-12-26 02:09:19,565][123091] Updated weights for policy 0, policy_version 322081 (0.0006) [2023-12-26 02:09:19,632][123091] Updated weights for policy 0, policy_version 322091 (0.0010) [2023-12-26 02:09:19,919][123090] Updated weights for policy 1, policy_version 320323 (0.0009) [2023-12-26 02:09:19,983][123090] Updated weights for policy 1, policy_version 320333 (0.0009) [2023-12-26 02:09:20,034][123090] Updated weights for policy 1, policy_version 320343 (0.0010) [2023-12-26 02:09:20,436][123091] Updated weights for policy 0, policy_version 322101 (0.0009) [2023-12-26 02:09:20,507][123091] Updated weights for policy 0, policy_version 322111 (0.0010) [2023-12-26 02:09:20,572][123091] Updated weights for policy 0, policy_version 322121 (0.0010) [2023-12-26 02:09:20,890][123090] Updated weights for policy 1, policy_version 320353 (0.0009) [2023-12-26 02:09:20,958][123090] Updated weights for policy 1, policy_version 320363 (0.0009) [2023-12-26 02:09:21,019][123090] Updated weights for policy 1, policy_version 320373 (0.0009) [2023-12-26 02:09:21,088][123090] Updated weights for policy 1, policy_version 320383 (0.0009) [2023-12-26 02:09:21,415][123091] Updated weights for policy 0, policy_version 322131 (0.0011) [2023-12-26 02:09:21,465][123091] Updated weights for policy 0, policy_version 322141 (0.0010) [2023-12-26 02:09:21,514][123091] Updated weights for policy 0, policy_version 322151 (0.0011) [2023-12-26 02:09:21,927][123090] Updated weights for policy 1, policy_version 320393 (0.0009) [2023-12-26 02:09:21,984][123090] Updated weights for policy 1, policy_version 320403 (0.0009) [2023-12-26 02:09:22,040][123090] Updated weights for policy 1, policy_version 320413 (0.0009) [2023-12-26 02:09:22,397][123091] Updated weights for policy 0, policy_version 322161 (0.0011) [2023-12-26 02:09:22,465][123091] Updated weights for policy 0, policy_version 322171 (0.0011) [2023-12-26 02:09:22,530][123091] Updated weights for policy 0, policy_version 322181 (0.0011) [2023-12-26 02:09:22,591][123091] Updated weights for policy 0, policy_version 322191 (0.0011) [2023-12-26 02:09:22,908][123090] Updated weights for policy 1, policy_version 320423 (0.0008) [2023-12-26 02:09:22,971][123090] Updated weights for policy 1, policy_version 320433 (0.0009) [2023-12-26 02:09:23,039][123090] Updated weights for policy 1, policy_version 320443 (0.0009) [2023-12-26 02:09:23,402][123091] Updated weights for policy 0, policy_version 322201 (0.0011) [2023-12-26 02:09:23,466][123091] Updated weights for policy 0, policy_version 322211 (0.0011) [2023-12-26 02:09:23,525][123091] Updated weights for policy 0, policy_version 322221 (0.0011) [2023-12-26 02:09:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 164528128. Throughput: 0: 8989.4, 1: 8683.7. Samples: 164506300. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:23,785][121949] Avg episode reward: [(0, '6410.509'), (1, '5474.714')] [2023-12-26 02:09:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000322224_82493440.pth... [2023-12-26 02:09:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000320448_82034688.pth... [2023-12-26 02:09:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000321168_82223104.pth [2023-12-26 02:09:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000319456_81780736.pth [2023-12-26 02:09:23,827][123090] Updated weights for policy 1, policy_version 320453 (0.0007) [2023-12-26 02:09:23,885][123090] Updated weights for policy 1, policy_version 320463 (0.0008) [2023-12-26 02:09:23,940][123090] Updated weights for policy 1, policy_version 320473 (0.0010) [2023-12-26 02:09:24,233][123091] Updated weights for policy 0, policy_version 322231 (0.0007) [2023-12-26 02:09:24,296][123091] Updated weights for policy 0, policy_version 322241 (0.0005) [2023-12-26 02:09:24,366][123091] Updated weights for policy 0, policy_version 322251 (0.0008) [2023-12-26 02:09:24,652][123090] Updated weights for policy 1, policy_version 320483 (0.0008) [2023-12-26 02:09:24,721][123090] Updated weights for policy 1, policy_version 320493 (0.0010) [2023-12-26 02:09:24,791][123090] Updated weights for policy 1, policy_version 320503 (0.0010) [2023-12-26 02:09:25,038][123091] Updated weights for policy 0, policy_version 322261 (0.0007) [2023-12-26 02:09:25,105][123091] Updated weights for policy 0, policy_version 322271 (0.0008) [2023-12-26 02:09:25,174][123091] Updated weights for policy 0, policy_version 322281 (0.0009) [2023-12-26 02:09:25,486][123090] Updated weights for policy 1, policy_version 320513 (0.0010) [2023-12-26 02:09:25,539][123090] Updated weights for policy 1, policy_version 320523 (0.0005) [2023-12-26 02:09:25,594][123090] Updated weights for policy 1, policy_version 320533 (0.0009) [2023-12-26 02:09:25,642][123090] Updated weights for policy 1, policy_version 320543 (0.0008) [2023-12-26 02:09:25,935][123091] Updated weights for policy 0, policy_version 322291 (0.0010) [2023-12-26 02:09:25,982][123091] Updated weights for policy 0, policy_version 322301 (0.0007) [2023-12-26 02:09:26,037][123091] Updated weights for policy 0, policy_version 322311 (0.0009) [2023-12-26 02:09:26,331][123090] Updated weights for policy 1, policy_version 320553 (0.0010) [2023-12-26 02:09:26,393][123090] Updated weights for policy 1, policy_version 320563 (0.0010) [2023-12-26 02:09:26,449][123090] Updated weights for policy 1, policy_version 320573 (0.0010) [2023-12-26 02:09:26,828][123091] Updated weights for policy 0, policy_version 322321 (0.0010) [2023-12-26 02:09:26,877][123091] Updated weights for policy 0, policy_version 322331 (0.0007) [2023-12-26 02:09:26,925][123091] Updated weights for policy 0, policy_version 322341 (0.0009) [2023-12-26 02:09:26,989][123091] Updated weights for policy 0, policy_version 322351 (0.0006) [2023-12-26 02:09:27,217][123090] Updated weights for policy 1, policy_version 320583 (0.0007) [2023-12-26 02:09:27,264][123090] Updated weights for policy 1, policy_version 320593 (0.0005) [2023-12-26 02:09:27,310][123090] Updated weights for policy 1, policy_version 320603 (0.0008) [2023-12-26 02:09:27,678][123091] Updated weights for policy 0, policy_version 322361 (0.0006) [2023-12-26 02:09:27,735][123091] Updated weights for policy 0, policy_version 322371 (0.0006) [2023-12-26 02:09:27,796][123091] Updated weights for policy 0, policy_version 322381 (0.0005) [2023-12-26 02:09:28,134][123090] Updated weights for policy 1, policy_version 320613 (0.0010) [2023-12-26 02:09:28,193][123090] Updated weights for policy 1, policy_version 320624 (0.0011) [2023-12-26 02:09:28,255][123090] Updated weights for policy 1, policy_version 320634 (0.0005) [2023-12-26 02:09:28,473][123091] Updated weights for policy 0, policy_version 322391 (0.0007) [2023-12-26 02:09:28,528][123091] Updated weights for policy 0, policy_version 322401 (0.0008) [2023-12-26 02:09:28,601][123091] Updated weights for policy 0, policy_version 322411 (0.0008) [2023-12-26 02:09:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 164626432. Throughput: 0: 9046.2, 1: 8778.2. Samples: 164617592. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:28,784][121949] Avg episode reward: [(0, '6446.179'), (1, '5578.888')] [2023-12-26 02:09:28,785][123007] Saving new best policy, reward=6446.179! [2023-12-26 02:09:28,959][123090] Updated weights for policy 1, policy_version 320644 (0.0005) [2023-12-26 02:09:29,011][123090] Updated weights for policy 1, policy_version 320654 (0.0005) [2023-12-26 02:09:29,060][123090] Updated weights for policy 1, policy_version 320664 (0.0005) [2023-12-26 02:09:29,396][123091] Updated weights for policy 0, policy_version 322421 (0.0008) [2023-12-26 02:09:29,471][123091] Updated weights for policy 0, policy_version 322431 (0.0008) [2023-12-26 02:09:29,534][123091] Updated weights for policy 0, policy_version 322441 (0.0008) [2023-12-26 02:09:29,762][123090] Updated weights for policy 1, policy_version 320674 (0.0006) [2023-12-26 02:09:29,835][123090] Updated weights for policy 1, policy_version 320684 (0.0006) [2023-12-26 02:09:29,902][123090] Updated weights for policy 1, policy_version 320694 (0.0010) [2023-12-26 02:09:29,963][123090] Updated weights for policy 1, policy_version 320704 (0.0011) [2023-12-26 02:09:30,214][123091] Updated weights for policy 0, policy_version 322451 (0.0007) [2023-12-26 02:09:30,285][123091] Updated weights for policy 0, policy_version 322461 (0.0006) [2023-12-26 02:09:30,347][123091] Updated weights for policy 0, policy_version 322471 (0.0005) [2023-12-26 02:09:30,637][123090] Updated weights for policy 1, policy_version 320714 (0.0005) [2023-12-26 02:09:30,711][123090] Updated weights for policy 1, policy_version 320724 (0.0010) [2023-12-26 02:09:30,773][123090] Updated weights for policy 1, policy_version 320734 (0.0010) [2023-12-26 02:09:30,992][123091] Updated weights for policy 0, policy_version 322481 (0.0006) [2023-12-26 02:09:31,052][123091] Updated weights for policy 0, policy_version 322491 (0.0008) [2023-12-26 02:09:31,121][123091] Updated weights for policy 0, policy_version 322501 (0.0007) [2023-12-26 02:09:31,183][123091] Updated weights for policy 0, policy_version 322511 (0.0007) [2023-12-26 02:09:31,548][123090] Updated weights for policy 1, policy_version 320744 (0.0008) [2023-12-26 02:09:31,613][123090] Updated weights for policy 1, policy_version 320754 (0.0007) [2023-12-26 02:09:31,683][123090] Updated weights for policy 1, policy_version 320764 (0.0010) [2023-12-26 02:09:31,962][123091] Updated weights for policy 0, policy_version 322521 (0.0010) [2023-12-26 02:09:32,017][123091] Updated weights for policy 0, policy_version 322531 (0.0010) [2023-12-26 02:09:32,083][123091] Updated weights for policy 0, policy_version 322541 (0.0010) [2023-12-26 02:09:32,434][123090] Updated weights for policy 1, policy_version 320774 (0.0006) [2023-12-26 02:09:32,503][123090] Updated weights for policy 1, policy_version 320784 (0.0008) [2023-12-26 02:09:32,558][123090] Updated weights for policy 1, policy_version 320794 (0.0010) [2023-12-26 02:09:32,875][123091] Updated weights for policy 0, policy_version 322551 (0.0011) [2023-12-26 02:09:32,934][123091] Updated weights for policy 0, policy_version 322561 (0.0010) [2023-12-26 02:09:32,993][123091] Updated weights for policy 0, policy_version 322571 (0.0010) [2023-12-26 02:09:33,315][123090] Updated weights for policy 1, policy_version 320804 (0.0008) [2023-12-26 02:09:33,360][123090] Updated weights for policy 1, policy_version 320814 (0.0005) [2023-12-26 02:09:33,419][123090] Updated weights for policy 1, policy_version 320824 (0.0005) [2023-12-26 02:09:33,762][123091] Updated weights for policy 0, policy_version 322581 (0.0008) [2023-12-26 02:09:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 164716544. Throughput: 0: 9071.1, 1: 8849.8. Samples: 164729396. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:33,785][121949] Avg episode reward: [(0, '6398.734'), (1, '5753.062')] [2023-12-26 02:09:33,818][123091] Updated weights for policy 0, policy_version 322591 (0.0009) [2023-12-26 02:09:33,879][123091] Updated weights for policy 0, policy_version 322601 (0.0010) [2023-12-26 02:09:34,124][123090] Updated weights for policy 1, policy_version 320834 (0.0005) [2023-12-26 02:09:34,187][123090] Updated weights for policy 1, policy_version 320844 (0.0008) [2023-12-26 02:09:34,252][123090] Updated weights for policy 1, policy_version 320854 (0.0008) [2023-12-26 02:09:34,318][123090] Updated weights for policy 1, policy_version 320864 (0.0008) [2023-12-26 02:09:34,642][123091] Updated weights for policy 0, policy_version 322611 (0.0007) [2023-12-26 02:09:34,701][123091] Updated weights for policy 0, policy_version 322621 (0.0011) [2023-12-26 02:09:34,764][123091] Updated weights for policy 0, policy_version 322631 (0.0011) [2023-12-26 02:09:35,113][123090] Updated weights for policy 1, policy_version 320874 (0.0009) [2023-12-26 02:09:35,179][123090] Updated weights for policy 1, policy_version 320884 (0.0009) [2023-12-26 02:09:35,245][123090] Updated weights for policy 1, policy_version 320894 (0.0010) [2023-12-26 02:09:35,547][123091] Updated weights for policy 0, policy_version 322641 (0.0011) [2023-12-26 02:09:35,595][123091] Updated weights for policy 0, policy_version 322651 (0.0010) [2023-12-26 02:09:35,657][123091] Updated weights for policy 0, policy_version 322661 (0.0010) [2023-12-26 02:09:35,712][123091] Updated weights for policy 0, policy_version 322671 (0.0010) [2023-12-26 02:09:36,072][123090] Updated weights for policy 1, policy_version 320904 (0.0009) [2023-12-26 02:09:36,145][123090] Updated weights for policy 1, policy_version 320914 (0.0009) [2023-12-26 02:09:36,214][123090] Updated weights for policy 1, policy_version 320924 (0.0009) [2023-12-26 02:09:36,568][123091] Updated weights for policy 0, policy_version 322681 (0.0011) [2023-12-26 02:09:36,636][123091] Updated weights for policy 0, policy_version 322691 (0.0011) [2023-12-26 02:09:36,695][123091] Updated weights for policy 0, policy_version 322701 (0.0007) [2023-12-26 02:09:37,068][123090] Updated weights for policy 1, policy_version 320934 (0.0010) [2023-12-26 02:09:37,131][123090] Updated weights for policy 1, policy_version 320945 (0.0010) [2023-12-26 02:09:37,197][123090] Updated weights for policy 1, policy_version 320955 (0.0009) [2023-12-26 02:09:37,376][123091] Updated weights for policy 0, policy_version 322711 (0.0005) [2023-12-26 02:09:37,429][123091] Updated weights for policy 0, policy_version 322721 (0.0005) [2023-12-26 02:09:37,503][123091] Updated weights for policy 0, policy_version 322731 (0.0005) [2023-12-26 02:09:38,084][123090] Updated weights for policy 1, policy_version 320965 (0.0010) [2023-12-26 02:09:38,144][123090] Updated weights for policy 1, policy_version 320975 (0.0010) [2023-12-26 02:09:38,204][123090] Updated weights for policy 1, policy_version 320985 (0.0010) [2023-12-26 02:09:38,244][123091] Updated weights for policy 0, policy_version 322741 (0.0006) [2023-12-26 02:09:38,315][123091] Updated weights for policy 0, policy_version 322751 (0.0006) [2023-12-26 02:09:38,378][123091] Updated weights for policy 0, policy_version 322761 (0.0009) [2023-12-26 02:09:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 164806656. Throughput: 0: 9084.1, 1: 8869.4. Samples: 164781564. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:38,785][121949] Avg episode reward: [(0, '6411.489'), (1, '5663.107')] [2023-12-26 02:09:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000322768_82632704.pth... [2023-12-26 02:09:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000320992_82173952.pth... [2023-12-26 02:09:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000321712_82362368.pth [2023-12-26 02:09:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000319968_81911808.pth [2023-12-26 02:09:39,083][123090] Updated weights for policy 1, policy_version 320995 (0.0009) [2023-12-26 02:09:39,137][123091] Updated weights for policy 0, policy_version 322771 (0.0007) [2023-12-26 02:09:39,146][123090] Updated weights for policy 1, policy_version 321005 (0.0008) [2023-12-26 02:09:39,184][123091] Updated weights for policy 0, policy_version 322781 (0.0007) [2023-12-26 02:09:39,211][123090] Updated weights for policy 1, policy_version 321015 (0.0008) [2023-12-26 02:09:39,248][123091] Updated weights for policy 0, policy_version 322791 (0.0008) [2023-12-26 02:09:40,034][123091] Updated weights for policy 0, policy_version 322801 (0.0011) [2023-12-26 02:09:40,084][123090] Updated weights for policy 1, policy_version 321025 (0.0008) [2023-12-26 02:09:40,101][123091] Updated weights for policy 0, policy_version 322811 (0.0011) [2023-12-26 02:09:40,142][123090] Updated weights for policy 1, policy_version 321035 (0.0006) [2023-12-26 02:09:40,176][123091] Updated weights for policy 0, policy_version 322821 (0.0011) [2023-12-26 02:09:40,198][123090] Updated weights for policy 1, policy_version 321045 (0.0007) [2023-12-26 02:09:40,235][123091] Updated weights for policy 0, policy_version 322831 (0.0011) [2023-12-26 02:09:40,262][123090] Updated weights for policy 1, policy_version 321055 (0.0008) [2023-12-26 02:09:41,013][123090] Updated weights for policy 1, policy_version 321065 (0.0007) [2023-12-26 02:09:41,042][123091] Updated weights for policy 0, policy_version 322841 (0.0011) [2023-12-26 02:09:41,085][123090] Updated weights for policy 1, policy_version 321075 (0.0008) [2023-12-26 02:09:41,106][123091] Updated weights for policy 0, policy_version 322851 (0.0011) [2023-12-26 02:09:41,161][123090] Updated weights for policy 1, policy_version 321085 (0.0007) [2023-12-26 02:09:41,166][123091] Updated weights for policy 0, policy_version 322861 (0.0011) [2023-12-26 02:09:41,932][123090] Updated weights for policy 1, policy_version 321095 (0.0006) [2023-12-26 02:09:42,009][123090] Updated weights for policy 1, policy_version 321105 (0.0005) [2023-12-26 02:09:42,026][123091] Updated weights for policy 0, policy_version 322871 (0.0011) [2023-12-26 02:09:42,072][123090] Updated weights for policy 1, policy_version 321115 (0.0005) [2023-12-26 02:09:42,086][123091] Updated weights for policy 0, policy_version 322881 (0.0011) [2023-12-26 02:09:42,146][123091] Updated weights for policy 0, policy_version 322891 (0.0011) [2023-12-26 02:09:42,867][123090] Updated weights for policy 1, policy_version 321125 (0.0007) [2023-12-26 02:09:42,890][123091] Updated weights for policy 0, policy_version 322901 (0.0010) [2023-12-26 02:09:42,919][123090] Updated weights for policy 1, policy_version 321135 (0.0007) [2023-12-26 02:09:42,953][123091] Updated weights for policy 0, policy_version 322911 (0.0011) [2023-12-26 02:09:42,974][123090] Updated weights for policy 1, policy_version 321145 (0.0009) [2023-12-26 02:09:43,015][123091] Updated weights for policy 0, policy_version 322921 (0.0010) [2023-12-26 02:09:43,722][123090] Updated weights for policy 1, policy_version 321155 (0.0008) [2023-12-26 02:09:43,767][123090] Updated weights for policy 1, policy_version 321165 (0.0010) [2023-12-26 02:09:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 164888576. Throughput: 0: 9037.7, 1: 8753.1. Samples: 164887656. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:43,784][121949] Avg episode reward: [(0, '6418.915'), (1, '5616.833')] [2023-12-26 02:09:43,794][123091] Updated weights for policy 0, policy_version 322931 (0.0011) [2023-12-26 02:09:43,826][123090] Updated weights for policy 1, policy_version 321175 (0.0010) [2023-12-26 02:09:43,852][123091] Updated weights for policy 0, policy_version 322941 (0.0010) [2023-12-26 02:09:43,905][123091] Updated weights for policy 0, policy_version 322951 (0.0007) [2023-12-26 02:09:44,583][123091] Updated weights for policy 0, policy_version 322961 (0.0006) [2023-12-26 02:09:44,652][123091] Updated weights for policy 0, policy_version 322971 (0.0010) [2023-12-26 02:09:44,689][123090] Updated weights for policy 1, policy_version 321185 (0.0010) [2023-12-26 02:09:44,712][123091] Updated weights for policy 0, policy_version 322981 (0.0007) [2023-12-26 02:09:44,751][123090] Updated weights for policy 1, policy_version 321195 (0.0010) [2023-12-26 02:09:44,777][123091] Updated weights for policy 0, policy_version 322991 (0.0007) [2023-12-26 02:09:44,826][123090] Updated weights for policy 1, policy_version 321205 (0.0011) [2023-12-26 02:09:44,896][123090] Updated weights for policy 1, policy_version 321215 (0.0010) [2023-12-26 02:09:45,585][123090] Updated weights for policy 1, policy_version 321225 (0.0006) [2023-12-26 02:09:45,586][123091] Updated weights for policy 0, policy_version 323001 (0.0009) [2023-12-26 02:09:45,636][123090] Updated weights for policy 1, policy_version 321235 (0.0005) [2023-12-26 02:09:45,653][123091] Updated weights for policy 0, policy_version 323011 (0.0009) [2023-12-26 02:09:45,702][123090] Updated weights for policy 1, policy_version 321245 (0.0006) [2023-12-26 02:09:45,723][123091] Updated weights for policy 0, policy_version 323021 (0.0009) [2023-12-26 02:09:46,424][123090] Updated weights for policy 1, policy_version 321255 (0.0007) [2023-12-26 02:09:46,473][123090] Updated weights for policy 1, policy_version 321265 (0.0005) [2023-12-26 02:09:46,484][123091] Updated weights for policy 0, policy_version 323031 (0.0009) [2023-12-26 02:09:46,521][123090] Updated weights for policy 1, policy_version 321275 (0.0007) [2023-12-26 02:09:46,553][123091] Updated weights for policy 0, policy_version 323041 (0.0009) [2023-12-26 02:09:46,624][123091] Updated weights for policy 0, policy_version 323051 (0.0009) [2023-12-26 02:09:47,344][123090] Updated weights for policy 1, policy_version 321285 (0.0010) [2023-12-26 02:09:47,398][123091] Updated weights for policy 0, policy_version 323061 (0.0008) [2023-12-26 02:09:47,410][123090] Updated weights for policy 1, policy_version 321295 (0.0010) [2023-12-26 02:09:47,451][123091] Updated weights for policy 0, policy_version 323071 (0.0008) [2023-12-26 02:09:47,469][123090] Updated weights for policy 1, policy_version 321305 (0.0010) [2023-12-26 02:09:47,511][123091] Updated weights for policy 0, policy_version 323081 (0.0009) [2023-12-26 02:09:48,245][123091] Updated weights for policy 0, policy_version 323091 (0.0008) [2023-12-26 02:09:48,287][123090] Updated weights for policy 1, policy_version 321315 (0.0010) [2023-12-26 02:09:48,297][123091] Updated weights for policy 0, policy_version 323101 (0.0005) [2023-12-26 02:09:48,356][123090] Updated weights for policy 1, policy_version 321325 (0.0011) [2023-12-26 02:09:48,361][123091] Updated weights for policy 0, policy_version 323111 (0.0008) [2023-12-26 02:09:48,423][123090] Updated weights for policy 1, policy_version 321335 (0.0011) [2023-12-26 02:09:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 164986880. Throughput: 0: 9062.6, 1: 8752.9. Samples: 164996996. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:48,785][121949] Avg episode reward: [(0, '6446.696'), (1, '5576.788')] [2023-12-26 02:09:48,786][123007] Saving new best policy, reward=6446.696! [2023-12-26 02:09:49,084][123091] Updated weights for policy 0, policy_version 323121 (0.0010) [2023-12-26 02:09:49,145][123091] Updated weights for policy 0, policy_version 323131 (0.0006) [2023-12-26 02:09:49,218][123091] Updated weights for policy 0, policy_version 323141 (0.0006) [2023-12-26 02:09:49,219][123090] Updated weights for policy 1, policy_version 321345 (0.0010) [2023-12-26 02:09:49,282][123091] Updated weights for policy 0, policy_version 323151 (0.0008) [2023-12-26 02:09:49,289][123090] Updated weights for policy 1, policy_version 321355 (0.0008) [2023-12-26 02:09:49,367][123090] Updated weights for policy 1, policy_version 321365 (0.0008) [2023-12-26 02:09:49,432][123090] Updated weights for policy 1, policy_version 321375 (0.0006) [2023-12-26 02:09:50,088][123091] Updated weights for policy 0, policy_version 323161 (0.0011) [2023-12-26 02:09:50,152][123091] Updated weights for policy 0, policy_version 323171 (0.0008) [2023-12-26 02:09:50,154][123090] Updated weights for policy 1, policy_version 321385 (0.0008) [2023-12-26 02:09:50,219][123091] Updated weights for policy 0, policy_version 323181 (0.0010) [2023-12-26 02:09:50,221][123090] Updated weights for policy 1, policy_version 321395 (0.0007) [2023-12-26 02:09:50,283][123090] Updated weights for policy 1, policy_version 321405 (0.0009) [2023-12-26 02:09:51,026][123091] Updated weights for policy 0, policy_version 323191 (0.0009) [2023-12-26 02:09:51,099][123091] Updated weights for policy 0, policy_version 323201 (0.0010) [2023-12-26 02:09:51,145][123090] Updated weights for policy 1, policy_version 321415 (0.0009) [2023-12-26 02:09:51,161][123091] Updated weights for policy 0, policy_version 323211 (0.0008) [2023-12-26 02:09:51,208][123090] Updated weights for policy 1, policy_version 321425 (0.0008) [2023-12-26 02:09:51,271][123090] Updated weights for policy 1, policy_version 321435 (0.0009) [2023-12-26 02:09:52,056][123091] Updated weights for policy 0, policy_version 323221 (0.0009) [2023-12-26 02:09:52,069][123090] Updated weights for policy 1, policy_version 321445 (0.0007) [2023-12-26 02:09:52,121][123091] Updated weights for policy 0, policy_version 323231 (0.0009) [2023-12-26 02:09:52,126][123090] Updated weights for policy 1, policy_version 321455 (0.0005) [2023-12-26 02:09:52,175][123091] Updated weights for policy 0, policy_version 323241 (0.0010) [2023-12-26 02:09:52,178][123090] Updated weights for policy 1, policy_version 321465 (0.0005) [2023-12-26 02:09:52,908][123090] Updated weights for policy 1, policy_version 321475 (0.0006) [2023-12-26 02:09:52,943][123091] Updated weights for policy 0, policy_version 323251 (0.0008) [2023-12-26 02:09:52,976][123090] Updated weights for policy 1, policy_version 321485 (0.0011) [2023-12-26 02:09:53,001][123091] Updated weights for policy 0, policy_version 323261 (0.0006) [2023-12-26 02:09:53,033][123090] Updated weights for policy 1, policy_version 321495 (0.0011) [2023-12-26 02:09:53,057][123091] Updated weights for policy 0, policy_version 323271 (0.0006) [2023-12-26 02:09:53,782][123090] Updated weights for policy 1, policy_version 321505 (0.0010) [2023-12-26 02:09:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 165068800. Throughput: 0: 9029.0, 1: 8779.3. Samples: 165049356. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:53,784][121949] Avg episode reward: [(0, '6461.568'), (1, '5566.399')] [2023-12-26 02:09:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000323280_82763776.pth... [2023-12-26 02:09:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000322224_82493440.pth [2023-12-26 02:09:53,799][123007] Saving new best policy, reward=6461.568! [2023-12-26 02:09:53,831][123090] Updated weights for policy 1, policy_version 321515 (0.0007) [2023-12-26 02:09:53,884][123090] Updated weights for policy 1, policy_version 321525 (0.0006) [2023-12-26 02:09:53,908][123091] Updated weights for policy 0, policy_version 323281 (0.0009) [2023-12-26 02:09:53,951][123090] Updated weights for policy 1, policy_version 321535 (0.0005) [2023-12-26 02:09:53,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000321536_82313216.pth... [2023-12-26 02:09:53,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000320448_82034688.pth [2023-12-26 02:09:53,977][123091] Updated weights for policy 0, policy_version 323291 (0.0009) [2023-12-26 02:09:54,056][123091] Updated weights for policy 0, policy_version 323301 (0.0010) [2023-12-26 02:09:54,121][123091] Updated weights for policy 0, policy_version 323311 (0.0009) [2023-12-26 02:09:54,601][123090] Updated weights for policy 1, policy_version 321545 (0.0009) [2023-12-26 02:09:54,649][123090] Updated weights for policy 1, policy_version 321555 (0.0010) [2023-12-26 02:09:54,702][123090] Updated weights for policy 1, policy_version 321565 (0.0010) [2023-12-26 02:09:54,928][123091] Updated weights for policy 0, policy_version 323321 (0.0007) [2023-12-26 02:09:54,977][123091] Updated weights for policy 0, policy_version 323331 (0.0006) [2023-12-26 02:09:55,032][123091] Updated weights for policy 0, policy_version 323341 (0.0005) [2023-12-26 02:09:55,463][123090] Updated weights for policy 1, policy_version 321575 (0.0009) [2023-12-26 02:09:55,511][123090] Updated weights for policy 1, policy_version 321585 (0.0010) [2023-12-26 02:09:55,559][123090] Updated weights for policy 1, policy_version 321595 (0.0010) [2023-12-26 02:09:55,743][123091] Updated weights for policy 0, policy_version 323351 (0.0005) [2023-12-26 02:09:55,801][123091] Updated weights for policy 0, policy_version 323361 (0.0005) [2023-12-26 02:09:55,849][123091] Updated weights for policy 0, policy_version 323371 (0.0005) [2023-12-26 02:09:56,348][123090] Updated weights for policy 1, policy_version 321605 (0.0008) [2023-12-26 02:09:56,399][123090] Updated weights for policy 1, policy_version 321615 (0.0005) [2023-12-26 02:09:56,452][123090] Updated weights for policy 1, policy_version 321625 (0.0005) [2023-12-26 02:09:56,556][123091] Updated weights for policy 0, policy_version 323381 (0.0008) [2023-12-26 02:09:56,606][123091] Updated weights for policy 0, policy_version 323391 (0.0010) [2023-12-26 02:09:56,661][123091] Updated weights for policy 0, policy_version 323401 (0.0010) [2023-12-26 02:09:57,133][123090] Updated weights for policy 1, policy_version 321635 (0.0005) [2023-12-26 02:09:57,188][123090] Updated weights for policy 1, policy_version 321645 (0.0005) [2023-12-26 02:09:57,247][123090] Updated weights for policy 1, policy_version 321655 (0.0007) [2023-12-26 02:09:57,497][123091] Updated weights for policy 0, policy_version 323411 (0.0009) [2023-12-26 02:09:57,547][123091] Updated weights for policy 0, policy_version 323421 (0.0005) [2023-12-26 02:09:57,601][123091] Updated weights for policy 0, policy_version 323431 (0.0005) [2023-12-26 02:09:57,927][123090] Updated weights for policy 1, policy_version 321665 (0.0006) [2023-12-26 02:09:57,983][123090] Updated weights for policy 1, policy_version 321676 (0.0009) [2023-12-26 02:09:58,052][123090] Updated weights for policy 1, policy_version 321686 (0.0009) [2023-12-26 02:09:58,117][123090] Updated weights for policy 1, policy_version 321696 (0.0009) [2023-12-26 02:09:58,240][123091] Updated weights for policy 0, policy_version 323441 (0.0006) [2023-12-26 02:09:58,299][123091] Updated weights for policy 0, policy_version 323451 (0.0011) [2023-12-26 02:09:58,356][123091] Updated weights for policy 0, policy_version 323461 (0.0011) [2023-12-26 02:09:58,418][123091] Updated weights for policy 0, policy_version 323471 (0.0009) [2023-12-26 02:09:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 165167104. Throughput: 0: 9062.8, 1: 8968.1. Samples: 165161496. Policy #0 lag: (min: 16.0, avg: 43.7, max: 48.0) [2023-12-26 02:09:58,785][121949] Avg episode reward: [(0, '6406.811'), (1, '5545.874')] [2023-12-26 02:09:58,985][123090] Updated weights for policy 1, policy_version 321706 (0.0010) [2023-12-26 02:09:59,044][123090] Updated weights for policy 1, policy_version 321716 (0.0008) [2023-12-26 02:09:59,112][123090] Updated weights for policy 1, policy_version 321726 (0.0009) [2023-12-26 02:09:59,267][123091] Updated weights for policy 0, policy_version 323481 (0.0010) [2023-12-26 02:09:59,331][123091] Updated weights for policy 0, policy_version 323491 (0.0009) [2023-12-26 02:09:59,401][123091] Updated weights for policy 0, policy_version 323501 (0.0011) [2023-12-26 02:09:59,973][123090] Updated weights for policy 1, policy_version 321736 (0.0009) [2023-12-26 02:10:00,047][123090] Updated weights for policy 1, policy_version 321746 (0.0006) [2023-12-26 02:10:00,117][123090] Updated weights for policy 1, policy_version 321756 (0.0005) [2023-12-26 02:10:00,204][123091] Updated weights for policy 0, policy_version 323511 (0.0011) [2023-12-26 02:10:00,273][123091] Updated weights for policy 0, policy_version 323521 (0.0011) [2023-12-26 02:10:00,336][123091] Updated weights for policy 0, policy_version 323531 (0.0011) [2023-12-26 02:10:00,792][123090] Updated weights for policy 1, policy_version 321766 (0.0006) [2023-12-26 02:10:00,843][123090] Updated weights for policy 1, policy_version 321776 (0.0005) [2023-12-26 02:10:00,890][123090] Updated weights for policy 1, policy_version 321786 (0.0010) [2023-12-26 02:10:00,981][123091] Updated weights for policy 0, policy_version 323541 (0.0008) [2023-12-26 02:10:01,045][123091] Updated weights for policy 0, policy_version 323551 (0.0007) [2023-12-26 02:10:01,104][123091] Updated weights for policy 0, policy_version 323561 (0.0006) [2023-12-26 02:10:01,710][123090] Updated weights for policy 1, policy_version 321796 (0.0010) [2023-12-26 02:10:01,787][123090] Updated weights for policy 1, policy_version 321806 (0.0010) [2023-12-26 02:10:01,850][123090] Updated weights for policy 1, policy_version 321816 (0.0009) [2023-12-26 02:10:01,852][123091] Updated weights for policy 0, policy_version 323571 (0.0007) [2023-12-26 02:10:01,899][123091] Updated weights for policy 0, policy_version 323581 (0.0006) [2023-12-26 02:10:01,948][123091] Updated weights for policy 0, policy_version 323591 (0.0005) [2023-12-26 02:10:02,660][123090] Updated weights for policy 1, policy_version 321826 (0.0009) [2023-12-26 02:10:02,719][123091] Updated weights for policy 0, policy_version 323601 (0.0007) [2023-12-26 02:10:02,720][123090] Updated weights for policy 1, policy_version 321836 (0.0010) [2023-12-26 02:10:02,765][123090] Updated weights for policy 1, policy_version 321846 (0.0007) [2023-12-26 02:10:02,778][123091] Updated weights for policy 0, policy_version 323611 (0.0010) [2023-12-26 02:10:02,814][123090] Updated weights for policy 1, policy_version 321856 (0.0005) [2023-12-26 02:10:02,843][123091] Updated weights for policy 0, policy_version 323621 (0.0011) [2023-12-26 02:10:02,905][123091] Updated weights for policy 0, policy_version 323631 (0.0010) [2023-12-26 02:10:03,602][123090] Updated weights for policy 1, policy_version 321866 (0.0009) [2023-12-26 02:10:03,653][123090] Updated weights for policy 1, policy_version 321876 (0.0008) [2023-12-26 02:10:03,710][123091] Updated weights for policy 0, policy_version 323641 (0.0010) [2023-12-26 02:10:03,714][123090] Updated weights for policy 1, policy_version 321886 (0.0007) [2023-12-26 02:10:03,778][123091] Updated weights for policy 0, policy_version 323651 (0.0005) [2023-12-26 02:10:03,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 165257216. Throughput: 0: 9086.6, 1: 9004.8. Samples: 165270000. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:03,785][121949] Avg episode reward: [(0, '6410.859'), (1, '5634.877')] [2023-12-26 02:10:03,852][123091] Updated weights for policy 0, policy_version 323661 (0.0007) [2023-12-26 02:10:04,505][123090] Updated weights for policy 1, policy_version 321896 (0.0008) [2023-12-26 02:10:04,533][123091] Updated weights for policy 0, policy_version 323671 (0.0007) [2023-12-26 02:10:04,564][123090] Updated weights for policy 1, policy_version 321906 (0.0008) [2023-12-26 02:10:04,601][123091] Updated weights for policy 0, policy_version 323681 (0.0007) [2023-12-26 02:10:04,632][123090] Updated weights for policy 1, policy_version 321916 (0.0008) [2023-12-26 02:10:04,662][123091] Updated weights for policy 0, policy_version 323691 (0.0010) [2023-12-26 02:10:05,275][123090] Updated weights for policy 1, policy_version 321926 (0.0007) [2023-12-26 02:10:05,319][123090] Updated weights for policy 1, policy_version 321936 (0.0007) [2023-12-26 02:10:05,365][123090] Updated weights for policy 1, policy_version 321946 (0.0005) [2023-12-26 02:10:05,421][123091] Updated weights for policy 0, policy_version 323701 (0.0010) [2023-12-26 02:10:05,464][123091] Updated weights for policy 0, policy_version 323711 (0.0010) [2023-12-26 02:10:05,512][123091] Updated weights for policy 0, policy_version 323721 (0.0005) [2023-12-26 02:10:05,983][123090] Updated weights for policy 1, policy_version 321956 (0.0007) [2023-12-26 02:10:06,035][123090] Updated weights for policy 1, policy_version 321966 (0.0010) [2023-12-26 02:10:06,092][123090] Updated weights for policy 1, policy_version 321976 (0.0011) [2023-12-26 02:10:06,235][123091] Updated weights for policy 0, policy_version 323731 (0.0007) [2023-12-26 02:10:06,311][123091] Updated weights for policy 0, policy_version 323741 (0.0011) [2023-12-26 02:10:06,371][123091] Updated weights for policy 0, policy_version 323751 (0.0011) [2023-12-26 02:10:06,919][123090] Updated weights for policy 1, policy_version 321986 (0.0010) [2023-12-26 02:10:06,981][123090] Updated weights for policy 1, policy_version 321996 (0.0009) [2023-12-26 02:10:07,036][123090] Updated weights for policy 1, policy_version 322006 (0.0009) [2023-12-26 02:10:07,094][123090] Updated weights for policy 1, policy_version 322016 (0.0009) [2023-12-26 02:10:07,207][123091] Updated weights for policy 0, policy_version 323761 (0.0010) [2023-12-26 02:10:07,271][123091] Updated weights for policy 0, policy_version 323771 (0.0011) [2023-12-26 02:10:07,334][123091] Updated weights for policy 0, policy_version 323781 (0.0011) [2023-12-26 02:10:07,395][123091] Updated weights for policy 0, policy_version 323791 (0.0010) [2023-12-26 02:10:07,993][123090] Updated weights for policy 1, policy_version 322026 (0.0006) [2023-12-26 02:10:08,049][123090] Updated weights for policy 1, policy_version 322036 (0.0008) [2023-12-26 02:10:08,111][123090] Updated weights for policy 1, policy_version 322046 (0.0010) [2023-12-26 02:10:08,160][123091] Updated weights for policy 0, policy_version 323801 (0.0006) [2023-12-26 02:10:08,203][123091] Updated weights for policy 0, policy_version 323811 (0.0006) [2023-12-26 02:10:08,254][123091] Updated weights for policy 0, policy_version 323821 (0.0006) [2023-12-26 02:10:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 165347328. Throughput: 0: 9148.4, 1: 9091.1. Samples: 165327080. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:08,785][121949] Avg episode reward: [(0, '6372.950'), (1, '5685.793')] [2023-12-26 02:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000323824_82903040.pth... [2023-12-26 02:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000322048_82444288.pth... [2023-12-26 02:10:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000322768_82632704.pth [2023-12-26 02:10:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000320992_82173952.pth [2023-12-26 02:10:08,882][123090] Updated weights for policy 1, policy_version 322056 (0.0010) [2023-12-26 02:10:08,948][123090] Updated weights for policy 1, policy_version 322066 (0.0010) [2023-12-26 02:10:09,011][123090] Updated weights for policy 1, policy_version 322076 (0.0010) [2023-12-26 02:10:09,027][123091] Updated weights for policy 0, policy_version 323831 (0.0007) [2023-12-26 02:10:09,094][123091] Updated weights for policy 0, policy_version 323841 (0.0008) [2023-12-26 02:10:09,162][123091] Updated weights for policy 0, policy_version 323851 (0.0009) [2023-12-26 02:10:09,774][123090] Updated weights for policy 1, policy_version 322086 (0.0010) [2023-12-26 02:10:09,843][123090] Updated weights for policy 1, policy_version 322096 (0.0009) [2023-12-26 02:10:09,907][123090] Updated weights for policy 1, policy_version 322106 (0.0010) [2023-12-26 02:10:10,022][123091] Updated weights for policy 0, policy_version 323861 (0.0010) [2023-12-26 02:10:10,083][123091] Updated weights for policy 0, policy_version 323871 (0.0011) [2023-12-26 02:10:10,151][123091] Updated weights for policy 0, policy_version 323881 (0.0011) [2023-12-26 02:10:10,732][123090] Updated weights for policy 1, policy_version 322116 (0.0010) [2023-12-26 02:10:10,779][123090] Updated weights for policy 1, policy_version 322126 (0.0010) [2023-12-26 02:10:10,831][123090] Updated weights for policy 1, policy_version 322136 (0.0010) [2023-12-26 02:10:10,889][123091] Updated weights for policy 0, policy_version 323891 (0.0009) [2023-12-26 02:10:10,944][123091] Updated weights for policy 0, policy_version 323901 (0.0005) [2023-12-26 02:10:11,000][123091] Updated weights for policy 0, policy_version 323911 (0.0007) [2023-12-26 02:10:11,676][123090] Updated weights for policy 1, policy_version 322146 (0.0010) [2023-12-26 02:10:11,751][123090] Updated weights for policy 1, policy_version 322156 (0.0011) [2023-12-26 02:10:11,803][123091] Updated weights for policy 0, policy_version 323921 (0.0009) [2023-12-26 02:10:11,822][123090] Updated weights for policy 1, policy_version 322166 (0.0011) [2023-12-26 02:10:11,866][123091] Updated weights for policy 0, policy_version 323931 (0.0007) [2023-12-26 02:10:11,883][123090] Updated weights for policy 1, policy_version 322176 (0.0011) [2023-12-26 02:10:11,929][123091] Updated weights for policy 0, policy_version 323941 (0.0011) [2023-12-26 02:10:12,002][123091] Updated weights for policy 0, policy_version 323951 (0.0011) [2023-12-26 02:10:12,739][123090] Updated weights for policy 1, policy_version 322186 (0.0009) [2023-12-26 02:10:12,773][123091] Updated weights for policy 0, policy_version 323961 (0.0006) [2023-12-26 02:10:12,806][123090] Updated weights for policy 1, policy_version 322196 (0.0009) [2023-12-26 02:10:12,839][123091] Updated weights for policy 0, policy_version 323971 (0.0006) [2023-12-26 02:10:12,865][123090] Updated weights for policy 1, policy_version 322206 (0.0009) [2023-12-26 02:10:12,904][123091] Updated weights for policy 0, policy_version 323981 (0.0006) [2023-12-26 02:10:13,662][123091] Updated weights for policy 0, policy_version 323991 (0.0009) [2023-12-26 02:10:13,713][123091] Updated weights for policy 0, policy_version 324001 (0.0010) [2023-12-26 02:10:13,724][123090] Updated weights for policy 1, policy_version 322216 (0.0006) [2023-12-26 02:10:13,768][123091] Updated weights for policy 0, policy_version 324011 (0.0010) [2023-12-26 02:10:13,780][123090] Updated weights for policy 1, policy_version 322226 (0.0006) [2023-12-26 02:10:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 165429248. Throughput: 0: 9091.2, 1: 9006.6. Samples: 165431996. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:13,785][121949] Avg episode reward: [(0, '6350.680'), (1, '5690.455')] [2023-12-26 02:10:13,845][123090] Updated weights for policy 1, policy_version 322236 (0.0008) [2023-12-26 02:10:14,607][123091] Updated weights for policy 0, policy_version 324021 (0.0011) [2023-12-26 02:10:14,669][123091] Updated weights for policy 0, policy_version 324031 (0.0010) [2023-12-26 02:10:14,676][123090] Updated weights for policy 1, policy_version 322246 (0.0007) [2023-12-26 02:10:14,721][123091] Updated weights for policy 0, policy_version 324041 (0.0011) [2023-12-26 02:10:14,732][123090] Updated weights for policy 1, policy_version 322256 (0.0005) [2023-12-26 02:10:14,802][123090] Updated weights for policy 1, policy_version 322266 (0.0008) [2023-12-26 02:10:15,522][123091] Updated weights for policy 0, policy_version 324051 (0.0010) [2023-12-26 02:10:15,590][123091] Updated weights for policy 0, policy_version 324061 (0.0011) [2023-12-26 02:10:15,644][123090] Updated weights for policy 1, policy_version 322276 (0.0008) [2023-12-26 02:10:15,651][123091] Updated weights for policy 0, policy_version 324071 (0.0011) [2023-12-26 02:10:15,710][123090] Updated weights for policy 1, policy_version 322286 (0.0006) [2023-12-26 02:10:15,766][123090] Updated weights for policy 1, policy_version 322296 (0.0010) [2023-12-26 02:10:16,326][123091] Updated weights for policy 0, policy_version 324081 (0.0010) [2023-12-26 02:10:16,398][123091] Updated weights for policy 0, policy_version 324091 (0.0005) [2023-12-26 02:10:16,456][123091] Updated weights for policy 0, policy_version 324101 (0.0007) [2023-12-26 02:10:16,518][123091] Updated weights for policy 0, policy_version 324111 (0.0007) [2023-12-26 02:10:16,667][123090] Updated weights for policy 1, policy_version 322306 (0.0009) [2023-12-26 02:10:16,722][123090] Updated weights for policy 1, policy_version 322316 (0.0010) [2023-12-26 02:10:16,776][123090] Updated weights for policy 1, policy_version 322326 (0.0010) [2023-12-26 02:10:16,830][123090] Updated weights for policy 1, policy_version 322336 (0.0010) [2023-12-26 02:10:17,142][123091] Updated weights for policy 0, policy_version 324121 (0.0010) [2023-12-26 02:10:17,208][123091] Updated weights for policy 0, policy_version 324131 (0.0011) [2023-12-26 02:10:17,271][123091] Updated weights for policy 0, policy_version 324141 (0.0011) [2023-12-26 02:10:17,742][123090] Updated weights for policy 1, policy_version 322346 (0.0009) [2023-12-26 02:10:17,809][123090] Updated weights for policy 1, policy_version 322356 (0.0009) [2023-12-26 02:10:17,867][123090] Updated weights for policy 1, policy_version 322366 (0.0009) [2023-12-26 02:10:18,080][123091] Updated weights for policy 0, policy_version 324151 (0.0011) [2023-12-26 02:10:18,140][123091] Updated weights for policy 0, policy_version 324161 (0.0011) [2023-12-26 02:10:18,202][123091] Updated weights for policy 0, policy_version 324171 (0.0011) [2023-12-26 02:10:18,681][123090] Updated weights for policy 1, policy_version 322376 (0.0009) [2023-12-26 02:10:18,728][123090] Updated weights for policy 1, policy_version 322386 (0.0008) [2023-12-26 02:10:18,777][123090] Updated weights for policy 1, policy_version 322396 (0.0009) [2023-12-26 02:10:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 165519360. Throughput: 0: 9061.9, 1: 8864.3. Samples: 165536072. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:18,785][121949] Avg episode reward: [(0, '6393.159'), (1, '5731.153')] [2023-12-26 02:10:19,029][123091] Updated weights for policy 0, policy_version 324181 (0.0008) [2023-12-26 02:10:19,085][123091] Updated weights for policy 0, policy_version 324191 (0.0005) [2023-12-26 02:10:19,152][123091] Updated weights for policy 0, policy_version 324201 (0.0005) [2023-12-26 02:10:19,569][123090] Updated weights for policy 1, policy_version 322406 (0.0009) [2023-12-26 02:10:19,630][123090] Updated weights for policy 1, policy_version 322416 (0.0009) [2023-12-26 02:10:19,694][123090] Updated weights for policy 1, policy_version 322426 (0.0009) [2023-12-26 02:10:19,973][123091] Updated weights for policy 0, policy_version 324211 (0.0006) [2023-12-26 02:10:20,048][123091] Updated weights for policy 0, policy_version 324221 (0.0007) [2023-12-26 02:10:20,120][123091] Updated weights for policy 0, policy_version 324231 (0.0009) [2023-12-26 02:10:20,551][123090] Updated weights for policy 1, policy_version 322436 (0.0008) [2023-12-26 02:10:20,613][123090] Updated weights for policy 1, policy_version 322446 (0.0009) [2023-12-26 02:10:20,674][123090] Updated weights for policy 1, policy_version 322456 (0.0009) [2023-12-26 02:10:20,871][123091] Updated weights for policy 0, policy_version 324241 (0.0010) [2023-12-26 02:10:20,940][123091] Updated weights for policy 0, policy_version 324251 (0.0011) [2023-12-26 02:10:21,007][123091] Updated weights for policy 0, policy_version 324261 (0.0011) [2023-12-26 02:10:21,074][123091] Updated weights for policy 0, policy_version 324271 (0.0008) [2023-12-26 02:10:21,604][123090] Updated weights for policy 1, policy_version 322466 (0.0009) [2023-12-26 02:10:21,679][123090] Updated weights for policy 1, policy_version 322476 (0.0008) [2023-12-26 02:10:21,757][123090] Updated weights for policy 1, policy_version 322486 (0.0007) [2023-12-26 02:10:21,820][123090] Updated weights for policy 1, policy_version 322496 (0.0006) [2023-12-26 02:10:21,923][123091] Updated weights for policy 0, policy_version 324281 (0.0010) [2023-12-26 02:10:21,993][123091] Updated weights for policy 0, policy_version 324291 (0.0010) [2023-12-26 02:10:22,065][123091] Updated weights for policy 0, policy_version 324301 (0.0009) [2023-12-26 02:10:22,513][123090] Updated weights for policy 1, policy_version 322506 (0.0010) [2023-12-26 02:10:22,565][123090] Updated weights for policy 1, policy_version 322516 (0.0008) [2023-12-26 02:10:22,616][123090] Updated weights for policy 1, policy_version 322526 (0.0009) [2023-12-26 02:10:22,851][123091] Updated weights for policy 0, policy_version 324311 (0.0006) [2023-12-26 02:10:22,913][123091] Updated weights for policy 0, policy_version 324321 (0.0005) [2023-12-26 02:10:22,972][123091] Updated weights for policy 0, policy_version 324331 (0.0005) [2023-12-26 02:10:23,498][123090] Updated weights for policy 1, policy_version 322536 (0.0009) [2023-12-26 02:10:23,546][123090] Updated weights for policy 1, policy_version 322546 (0.0009) [2023-12-26 02:10:23,595][123090] Updated weights for policy 1, policy_version 322556 (0.0008) [2023-12-26 02:10:23,715][123091] Updated weights for policy 0, policy_version 324341 (0.0009) [2023-12-26 02:10:23,774][123091] Updated weights for policy 0, policy_version 324351 (0.0010) [2023-12-26 02:10:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 165609472. Throughput: 0: 9064.1, 1: 8830.6. Samples: 165586828. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:23,785][121949] Avg episode reward: [(0, '6399.381'), (1, '5778.244')] [2023-12-26 02:10:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000322560_82575360.pth... [2023-12-26 02:10:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000321536_82313216.pth [2023-12-26 02:10:23,834][123091] Updated weights for policy 0, policy_version 324361 (0.0009) [2023-12-26 02:10:23,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000324368_83042304.pth... [2023-12-26 02:10:23,872][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000323280_82763776.pth [2023-12-26 02:10:24,414][123090] Updated weights for policy 1, policy_version 322566 (0.0009) [2023-12-26 02:10:24,486][123090] Updated weights for policy 1, policy_version 322576 (0.0006) [2023-12-26 02:10:24,559][123090] Updated weights for policy 1, policy_version 322586 (0.0005) [2023-12-26 02:10:24,666][123091] Updated weights for policy 0, policy_version 324371 (0.0008) [2023-12-26 02:10:24,725][123091] Updated weights for policy 0, policy_version 324381 (0.0006) [2023-12-26 02:10:24,777][123091] Updated weights for policy 0, policy_version 324391 (0.0005) [2023-12-26 02:10:25,191][123090] Updated weights for policy 1, policy_version 322596 (0.0007) [2023-12-26 02:10:25,239][123090] Updated weights for policy 1, policy_version 322606 (0.0008) [2023-12-26 02:10:25,287][123090] Updated weights for policy 1, policy_version 322616 (0.0009) [2023-12-26 02:10:25,595][123091] Updated weights for policy 0, policy_version 324401 (0.0009) [2023-12-26 02:10:25,655][123091] Updated weights for policy 0, policy_version 324411 (0.0007) [2023-12-26 02:10:25,702][123091] Updated weights for policy 0, policy_version 324421 (0.0009) [2023-12-26 02:10:25,756][123091] Updated weights for policy 0, policy_version 324431 (0.0009) [2023-12-26 02:10:26,030][123090] Updated weights for policy 1, policy_version 322626 (0.0006) [2023-12-26 02:10:26,074][123090] Updated weights for policy 1, policy_version 322636 (0.0009) [2023-12-26 02:10:26,126][123090] Updated weights for policy 1, policy_version 322646 (0.0005) [2023-12-26 02:10:26,178][123090] Updated weights for policy 1, policy_version 322656 (0.0006) [2023-12-26 02:10:26,585][123091] Updated weights for policy 0, policy_version 324441 (0.0005) [2023-12-26 02:10:26,635][123091] Updated weights for policy 0, policy_version 324451 (0.0005) [2023-12-26 02:10:26,688][123091] Updated weights for policy 0, policy_version 324461 (0.0005) [2023-12-26 02:10:27,019][123090] Updated weights for policy 1, policy_version 322666 (0.0009) [2023-12-26 02:10:27,081][123090] Updated weights for policy 1, policy_version 322676 (0.0009) [2023-12-26 02:10:27,138][123090] Updated weights for policy 1, policy_version 322686 (0.0010) [2023-12-26 02:10:27,425][123091] Updated weights for policy 0, policy_version 324471 (0.0008) [2023-12-26 02:10:27,473][123091] Updated weights for policy 0, policy_version 324482 (0.0010) [2023-12-26 02:10:27,523][123091] Updated weights for policy 0, policy_version 324492 (0.0009) [2023-12-26 02:10:27,937][123090] Updated weights for policy 1, policy_version 322696 (0.0007) [2023-12-26 02:10:28,000][123090] Updated weights for policy 1, policy_version 322706 (0.0005) [2023-12-26 02:10:28,053][123090] Updated weights for policy 1, policy_version 322716 (0.0005) [2023-12-26 02:10:28,309][123091] Updated weights for policy 0, policy_version 324502 (0.0007) [2023-12-26 02:10:28,377][123091] Updated weights for policy 0, policy_version 324512 (0.0008) [2023-12-26 02:10:28,443][123091] Updated weights for policy 0, policy_version 324522 (0.0009) [2023-12-26 02:10:28,764][123090] Updated weights for policy 1, policy_version 322726 (0.0006) [2023-12-26 02:10:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 165699584. Throughput: 0: 9026.4, 1: 8895.4. Samples: 165694136. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:28,785][121949] Avg episode reward: [(0, '6400.253'), (1, '5804.424')] [2023-12-26 02:10:28,820][123090] Updated weights for policy 1, policy_version 322736 (0.0007) [2023-12-26 02:10:28,869][123090] Updated weights for policy 1, policy_version 322746 (0.0008) [2023-12-26 02:10:29,255][123091] Updated weights for policy 0, policy_version 324532 (0.0009) [2023-12-26 02:10:29,307][123091] Updated weights for policy 0, policy_version 324542 (0.0010) [2023-12-26 02:10:29,370][123091] Updated weights for policy 0, policy_version 324552 (0.0011) [2023-12-26 02:10:29,712][123090] Updated weights for policy 1, policy_version 322756 (0.0009) [2023-12-26 02:10:29,778][123090] Updated weights for policy 1, policy_version 322766 (0.0010) [2023-12-26 02:10:29,845][123090] Updated weights for policy 1, policy_version 322776 (0.0009) [2023-12-26 02:10:30,159][123091] Updated weights for policy 0, policy_version 324562 (0.0011) [2023-12-26 02:10:30,211][123091] Updated weights for policy 0, policy_version 324572 (0.0010) [2023-12-26 02:10:30,255][123091] Updated weights for policy 0, policy_version 324582 (0.0009) [2023-12-26 02:10:30,314][123091] Updated weights for policy 0, policy_version 324592 (0.0005) [2023-12-26 02:10:30,699][123090] Updated weights for policy 1, policy_version 322786 (0.0010) [2023-12-26 02:10:30,771][123090] Updated weights for policy 1, policy_version 322796 (0.0006) [2023-12-26 02:10:30,838][123090] Updated weights for policy 1, policy_version 322806 (0.0008) [2023-12-26 02:10:30,915][123090] Updated weights for policy 1, policy_version 322816 (0.0010) [2023-12-26 02:10:31,083][123091] Updated weights for policy 0, policy_version 324602 (0.0009) [2023-12-26 02:10:31,150][123091] Updated weights for policy 0, policy_version 324612 (0.0008) [2023-12-26 02:10:31,214][123091] Updated weights for policy 0, policy_version 324622 (0.0010) [2023-12-26 02:10:31,694][123090] Updated weights for policy 1, policy_version 322826 (0.0008) [2023-12-26 02:10:31,768][123090] Updated weights for policy 1, policy_version 322836 (0.0007) [2023-12-26 02:10:31,842][123090] Updated weights for policy 1, policy_version 322846 (0.0005) [2023-12-26 02:10:32,066][123091] Updated weights for policy 0, policy_version 324632 (0.0009) [2023-12-26 02:10:32,120][123091] Updated weights for policy 0, policy_version 324643 (0.0010) [2023-12-26 02:10:32,186][123091] Updated weights for policy 0, policy_version 324654 (0.0011) [2023-12-26 02:10:32,470][123090] Updated weights for policy 1, policy_version 322856 (0.0006) [2023-12-26 02:10:32,527][123090] Updated weights for policy 1, policy_version 322866 (0.0009) [2023-12-26 02:10:32,578][123090] Updated weights for policy 1, policy_version 322876 (0.0009) [2023-12-26 02:10:33,009][123091] Updated weights for policy 0, policy_version 324664 (0.0010) [2023-12-26 02:10:33,064][123091] Updated weights for policy 0, policy_version 324674 (0.0010) [2023-12-26 02:10:33,116][123091] Updated weights for policy 0, policy_version 324684 (0.0010) [2023-12-26 02:10:33,296][123090] Updated weights for policy 1, policy_version 322886 (0.0007) [2023-12-26 02:10:33,345][123090] Updated weights for policy 1, policy_version 322896 (0.0009) [2023-12-26 02:10:33,409][123090] Updated weights for policy 1, policy_version 322908 (0.0008) [2023-12-26 02:10:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 165789696. Throughput: 0: 8971.5, 1: 8935.4. Samples: 165802804. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:33,785][121949] Avg episode reward: [(0, '6407.569'), (1, '5739.577')] [2023-12-26 02:10:33,802][123091] Updated weights for policy 0, policy_version 324694 (0.0008) [2023-12-26 02:10:33,866][123091] Updated weights for policy 0, policy_version 324704 (0.0011) [2023-12-26 02:10:33,924][123091] Updated weights for policy 0, policy_version 324714 (0.0010) [2023-12-26 02:10:34,181][123090] Updated weights for policy 1, policy_version 322918 (0.0008) [2023-12-26 02:10:34,247][123090] Updated weights for policy 1, policy_version 322928 (0.0009) [2023-12-26 02:10:34,311][123090] Updated weights for policy 1, policy_version 322938 (0.0009) [2023-12-26 02:10:34,721][123091] Updated weights for policy 0, policy_version 324724 (0.0008) [2023-12-26 02:10:34,789][123091] Updated weights for policy 0, policy_version 324734 (0.0005) [2023-12-26 02:10:34,855][123091] Updated weights for policy 0, policy_version 324744 (0.0009) [2023-12-26 02:10:35,152][123090] Updated weights for policy 1, policy_version 322948 (0.0009) [2023-12-26 02:10:35,200][123090] Updated weights for policy 1, policy_version 322958 (0.0006) [2023-12-26 02:10:35,266][123090] Updated weights for policy 1, policy_version 322968 (0.0007) [2023-12-26 02:10:35,528][123091] Updated weights for policy 0, policy_version 324754 (0.0010) [2023-12-26 02:10:35,595][123091] Updated weights for policy 0, policy_version 324764 (0.0005) [2023-12-26 02:10:35,655][123091] Updated weights for policy 0, policy_version 324774 (0.0005) [2023-12-26 02:10:35,709][123091] Updated weights for policy 0, policy_version 324784 (0.0005) [2023-12-26 02:10:35,988][123090] Updated weights for policy 1, policy_version 322978 (0.0007) [2023-12-26 02:10:36,040][123090] Updated weights for policy 1, policy_version 322988 (0.0006) [2023-12-26 02:10:36,087][123090] Updated weights for policy 1, policy_version 322998 (0.0010) [2023-12-26 02:10:36,164][123090] Updated weights for policy 1, policy_version 323008 (0.0007) [2023-12-26 02:10:36,471][123091] Updated weights for policy 0, policy_version 324794 (0.0008) [2023-12-26 02:10:36,545][123091] Updated weights for policy 0, policy_version 324804 (0.0009) [2023-12-26 02:10:36,610][123091] Updated weights for policy 0, policy_version 324814 (0.0009) [2023-12-26 02:10:36,981][123090] Updated weights for policy 1, policy_version 323018 (0.0010) [2023-12-26 02:10:37,049][123090] Updated weights for policy 1, policy_version 323028 (0.0007) [2023-12-26 02:10:37,110][123090] Updated weights for policy 1, policy_version 323038 (0.0008) [2023-12-26 02:10:37,433][123091] Updated weights for policy 0, policy_version 324824 (0.0010) [2023-12-26 02:10:37,486][123091] Updated weights for policy 0, policy_version 324834 (0.0010) [2023-12-26 02:10:37,541][123091] Updated weights for policy 0, policy_version 324844 (0.0010) [2023-12-26 02:10:37,738][123090] Updated weights for policy 1, policy_version 323048 (0.0010) [2023-12-26 02:10:37,797][123090] Updated weights for policy 1, policy_version 323058 (0.0010) [2023-12-26 02:10:37,850][123090] Updated weights for policy 1, policy_version 323068 (0.0010) [2023-12-26 02:10:38,429][123091] Updated weights for policy 0, policy_version 324854 (0.0010) [2023-12-26 02:10:38,483][123091] Updated weights for policy 0, policy_version 324864 (0.0010) [2023-12-26 02:10:38,549][123091] Updated weights for policy 0, policy_version 324874 (0.0010) [2023-12-26 02:10:38,608][123090] Updated weights for policy 1, policy_version 323078 (0.0007) [2023-12-26 02:10:38,655][123090] Updated weights for policy 1, policy_version 323088 (0.0006) [2023-12-26 02:10:38,714][123090] Updated weights for policy 1, policy_version 323098 (0.0010) [2023-12-26 02:10:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 165888000. Throughput: 0: 9010.7, 1: 8958.7. Samples: 165857984. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:38,785][121949] Avg episode reward: [(0, '6436.458'), (1, '5672.669')] [2023-12-26 02:10:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000324880_83173376.pth... [2023-12-26 02:10:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000323104_82714624.pth... [2023-12-26 02:10:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000323824_82903040.pth [2023-12-26 02:10:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000322048_82444288.pth [2023-12-26 02:10:39,484][123091] Updated weights for policy 0, policy_version 324884 (0.0009) [2023-12-26 02:10:39,553][123091] Updated weights for policy 0, policy_version 324894 (0.0008) [2023-12-26 02:10:39,558][123090] Updated weights for policy 1, policy_version 323108 (0.0010) [2023-12-26 02:10:39,615][123091] Updated weights for policy 0, policy_version 324904 (0.0007) [2023-12-26 02:10:39,616][123090] Updated weights for policy 1, policy_version 323118 (0.0010) [2023-12-26 02:10:39,680][123090] Updated weights for policy 1, policy_version 323128 (0.0010) [2023-12-26 02:10:40,435][123091] Updated weights for policy 0, policy_version 324914 (0.0008) [2023-12-26 02:10:40,498][123091] Updated weights for policy 0, policy_version 324924 (0.0009) [2023-12-26 02:10:40,504][123090] Updated weights for policy 1, policy_version 323138 (0.0010) [2023-12-26 02:10:40,561][123091] Updated weights for policy 0, policy_version 324934 (0.0009) [2023-12-26 02:10:40,564][123090] Updated weights for policy 1, policy_version 323148 (0.0006) [2023-12-26 02:10:40,618][123090] Updated weights for policy 1, policy_version 323158 (0.0008) [2023-12-26 02:10:40,622][123091] Updated weights for policy 0, policy_version 324944 (0.0009) [2023-12-26 02:10:40,673][123090] Updated weights for policy 1, policy_version 323168 (0.0007) [2023-12-26 02:10:41,471][123090] Updated weights for policy 1, policy_version 323178 (0.0008) [2023-12-26 02:10:41,477][123091] Updated weights for policy 0, policy_version 324954 (0.0011) [2023-12-26 02:10:41,529][123091] Updated weights for policy 0, policy_version 324964 (0.0011) [2023-12-26 02:10:41,534][123090] Updated weights for policy 1, policy_version 323188 (0.0008) [2023-12-26 02:10:41,577][123091] Updated weights for policy 0, policy_version 324974 (0.0010) [2023-12-26 02:10:41,601][123090] Updated weights for policy 1, policy_version 323198 (0.0009) [2023-12-26 02:10:42,467][123091] Updated weights for policy 0, policy_version 324984 (0.0007) [2023-12-26 02:10:42,501][123090] Updated weights for policy 1, policy_version 323208 (0.0008) [2023-12-26 02:10:42,537][123091] Updated weights for policy 0, policy_version 324994 (0.0010) [2023-12-26 02:10:42,568][123090] Updated weights for policy 1, policy_version 323218 (0.0006) [2023-12-26 02:10:42,606][123091] Updated weights for policy 0, policy_version 325004 (0.0011) [2023-12-26 02:10:42,633][123090] Updated weights for policy 1, policy_version 323228 (0.0008) [2023-12-26 02:10:43,305][123091] Updated weights for policy 0, policy_version 325014 (0.0009) [2023-12-26 02:10:43,382][123091] Updated weights for policy 0, policy_version 325024 (0.0008) [2023-12-26 02:10:43,403][123090] Updated weights for policy 1, policy_version 323238 (0.0009) [2023-12-26 02:10:43,442][123091] Updated weights for policy 0, policy_version 325034 (0.0007) [2023-12-26 02:10:43,455][123090] Updated weights for policy 1, policy_version 323248 (0.0008) [2023-12-26 02:10:43,515][123090] Updated weights for policy 1, policy_version 323258 (0.0010) [2023-12-26 02:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 165969920. Throughput: 0: 8911.2, 1: 8834.7. Samples: 165960060. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:43,785][121949] Avg episode reward: [(0, '6349.424'), (1, '5602.576')] [2023-12-26 02:10:44,196][123091] Updated weights for policy 0, policy_version 325044 (0.0007) [2023-12-26 02:10:44,251][123091] Updated weights for policy 0, policy_version 325054 (0.0010) [2023-12-26 02:10:44,267][123090] Updated weights for policy 1, policy_version 323268 (0.0009) [2023-12-26 02:10:44,313][123091] Updated weights for policy 0, policy_version 325064 (0.0010) [2023-12-26 02:10:44,325][123090] Updated weights for policy 1, policy_version 323278 (0.0008) [2023-12-26 02:10:44,401][123090] Updated weights for policy 1, policy_version 323288 (0.0009) [2023-12-26 02:10:45,110][123091] Updated weights for policy 0, policy_version 325074 (0.0007) [2023-12-26 02:10:45,175][123091] Updated weights for policy 0, policy_version 325084 (0.0009) [2023-12-26 02:10:45,194][123090] Updated weights for policy 1, policy_version 323298 (0.0010) [2023-12-26 02:10:45,245][123091] Updated weights for policy 0, policy_version 325094 (0.0008) [2023-12-26 02:10:45,260][123090] Updated weights for policy 1, policy_version 323308 (0.0009) [2023-12-26 02:10:45,313][123091] Updated weights for policy 0, policy_version 325104 (0.0006) [2023-12-26 02:10:45,320][123090] Updated weights for policy 1, policy_version 323318 (0.0011) [2023-12-26 02:10:45,373][123090] Updated weights for policy 1, policy_version 323328 (0.0010) [2023-12-26 02:10:46,075][123091] Updated weights for policy 0, policy_version 325114 (0.0009) [2023-12-26 02:10:46,140][123091] Updated weights for policy 0, policy_version 325124 (0.0007) [2023-12-26 02:10:46,193][123091] Updated weights for policy 0, policy_version 325134 (0.0007) [2023-12-26 02:10:46,196][123090] Updated weights for policy 1, policy_version 323338 (0.0011) [2023-12-26 02:10:46,245][123090] Updated weights for policy 1, policy_version 323348 (0.0010) [2023-12-26 02:10:46,300][123090] Updated weights for policy 1, policy_version 323358 (0.0010) [2023-12-26 02:10:46,928][123091] Updated weights for policy 0, policy_version 325144 (0.0009) [2023-12-26 02:10:46,983][123091] Updated weights for policy 0, policy_version 325154 (0.0010) [2023-12-26 02:10:47,045][123091] Updated weights for policy 0, policy_version 325164 (0.0010) [2023-12-26 02:10:47,102][123090] Updated weights for policy 1, policy_version 323368 (0.0010) [2023-12-26 02:10:47,173][123090] Updated weights for policy 1, policy_version 323378 (0.0010) [2023-12-26 02:10:47,244][123090] Updated weights for policy 1, policy_version 323388 (0.0011) [2023-12-26 02:10:47,785][123091] Updated weights for policy 0, policy_version 325174 (0.0006) [2023-12-26 02:10:47,844][123091] Updated weights for policy 0, policy_version 325184 (0.0010) [2023-12-26 02:10:47,903][123091] Updated weights for policy 0, policy_version 325194 (0.0011) [2023-12-26 02:10:47,907][123090] Updated weights for policy 1, policy_version 323398 (0.0008) [2023-12-26 02:10:47,969][123090] Updated weights for policy 1, policy_version 323408 (0.0006) [2023-12-26 02:10:48,038][123090] Updated weights for policy 1, policy_version 323418 (0.0006) [2023-12-26 02:10:48,754][123091] Updated weights for policy 0, policy_version 325204 (0.0010) [2023-12-26 02:10:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 166051840. Throughput: 0: 8889.6, 1: 8854.7. Samples: 166068492. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:48,785][121949] Avg episode reward: [(0, '6260.284'), (1, '5502.853')] [2023-12-26 02:10:48,816][123091] Updated weights for policy 0, policy_version 325214 (0.0009) [2023-12-26 02:10:48,817][123090] Updated weights for policy 1, policy_version 323428 (0.0005) [2023-12-26 02:10:48,882][123091] Updated weights for policy 0, policy_version 325224 (0.0010) [2023-12-26 02:10:48,888][123090] Updated weights for policy 1, policy_version 323438 (0.0006) [2023-12-26 02:10:48,943][123090] Updated weights for policy 1, policy_version 323448 (0.0008) [2023-12-26 02:10:49,664][123090] Updated weights for policy 1, policy_version 323458 (0.0005) [2023-12-26 02:10:49,715][123090] Updated weights for policy 1, policy_version 323468 (0.0005) [2023-12-26 02:10:49,779][123090] Updated weights for policy 1, policy_version 323478 (0.0006) [2023-12-26 02:10:49,785][123091] Updated weights for policy 0, policy_version 325234 (0.0008) [2023-12-26 02:10:49,854][123091] Updated weights for policy 0, policy_version 325244 (0.0007) [2023-12-26 02:10:49,857][123090] Updated weights for policy 1, policy_version 323488 (0.0008) [2023-12-26 02:10:49,907][123091] Updated weights for policy 0, policy_version 325254 (0.0009) [2023-12-26 02:10:49,973][123091] Updated weights for policy 0, policy_version 325264 (0.0010) [2023-12-26 02:10:50,651][123090] Updated weights for policy 1, policy_version 323498 (0.0009) [2023-12-26 02:10:50,704][123090] Updated weights for policy 1, policy_version 323508 (0.0009) [2023-12-26 02:10:50,759][123091] Updated weights for policy 0, policy_version 325274 (0.0006) [2023-12-26 02:10:50,765][123090] Updated weights for policy 1, policy_version 323518 (0.0009) [2023-12-26 02:10:50,824][123091] Updated weights for policy 0, policy_version 325284 (0.0006) [2023-12-26 02:10:50,885][123091] Updated weights for policy 0, policy_version 325294 (0.0005) [2023-12-26 02:10:51,681][123091] Updated weights for policy 0, policy_version 325304 (0.0009) [2023-12-26 02:10:51,714][123090] Updated weights for policy 1, policy_version 323528 (0.0007) [2023-12-26 02:10:51,749][123091] Updated weights for policy 0, policy_version 325314 (0.0009) [2023-12-26 02:10:51,790][123090] Updated weights for policy 1, policy_version 323538 (0.0007) [2023-12-26 02:10:51,817][123091] Updated weights for policy 0, policy_version 325324 (0.0008) [2023-12-26 02:10:51,857][123090] Updated weights for policy 1, policy_version 323548 (0.0007) [2023-12-26 02:10:52,562][123090] Updated weights for policy 1, policy_version 323558 (0.0010) [2023-12-26 02:10:52,563][123091] Updated weights for policy 0, policy_version 325334 (0.0009) [2023-12-26 02:10:52,624][123090] Updated weights for policy 1, policy_version 323568 (0.0008) [2023-12-26 02:10:52,634][123091] Updated weights for policy 0, policy_version 325344 (0.0006) [2023-12-26 02:10:52,688][123090] Updated weights for policy 1, policy_version 323578 (0.0009) [2023-12-26 02:10:52,706][123091] Updated weights for policy 0, policy_version 325354 (0.0006) [2023-12-26 02:10:53,318][123091] Updated weights for policy 0, policy_version 325364 (0.0006) [2023-12-26 02:10:53,364][123091] Updated weights for policy 0, policy_version 325374 (0.0005) [2023-12-26 02:10:53,430][123091] Updated weights for policy 0, policy_version 325384 (0.0005) [2023-12-26 02:10:53,538][123090] Updated weights for policy 1, policy_version 323588 (0.0009) [2023-12-26 02:10:53,587][123090] Updated weights for policy 1, policy_version 323598 (0.0009) [2023-12-26 02:10:53,645][123090] Updated weights for policy 1, policy_version 323608 (0.0009) [2023-12-26 02:10:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 166150144. Throughput: 0: 8830.0, 1: 8797.5. Samples: 166120316. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:53,785][121949] Avg episode reward: [(0, '6337.052'), (1, '5499.623')] [2023-12-26 02:10:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000323616_82845696.pth... [2023-12-26 02:10:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000325392_83304448.pth... [2023-12-26 02:10:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000322560_82575360.pth [2023-12-26 02:10:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000324368_83042304.pth [2023-12-26 02:10:54,213][123091] Updated weights for policy 0, policy_version 325394 (0.0006) [2023-12-26 02:10:54,279][123091] Updated weights for policy 0, policy_version 325404 (0.0010) [2023-12-26 02:10:54,346][123091] Updated weights for policy 0, policy_version 325414 (0.0010) [2023-12-26 02:10:54,407][123091] Updated weights for policy 0, policy_version 325424 (0.0009) [2023-12-26 02:10:54,482][123090] Updated weights for policy 1, policy_version 323618 (0.0010) [2023-12-26 02:10:54,540][123090] Updated weights for policy 1, policy_version 323628 (0.0009) [2023-12-26 02:10:54,596][123090] Updated weights for policy 1, policy_version 323639 (0.0009) [2023-12-26 02:10:55,197][123091] Updated weights for policy 0, policy_version 325434 (0.0010) [2023-12-26 02:10:55,259][123091] Updated weights for policy 0, policy_version 325444 (0.0010) [2023-12-26 02:10:55,319][123090] Updated weights for policy 1, policy_version 323649 (0.0009) [2023-12-26 02:10:55,328][123091] Updated weights for policy 0, policy_version 325454 (0.0010) [2023-12-26 02:10:55,379][123090] Updated weights for policy 1, policy_version 323659 (0.0007) [2023-12-26 02:10:55,438][123090] Updated weights for policy 1, policy_version 323669 (0.0009) [2023-12-26 02:10:55,498][123090] Updated weights for policy 1, policy_version 323679 (0.0008) [2023-12-26 02:10:56,081][123091] Updated weights for policy 0, policy_version 325464 (0.0010) [2023-12-26 02:10:56,150][123091] Updated weights for policy 0, policy_version 325474 (0.0010) [2023-12-26 02:10:56,219][123091] Updated weights for policy 0, policy_version 325484 (0.0010) [2023-12-26 02:10:56,307][123090] Updated weights for policy 1, policy_version 323689 (0.0010) [2023-12-26 02:10:56,358][123090] Updated weights for policy 1, policy_version 323699 (0.0010) [2023-12-26 02:10:56,406][123090] Updated weights for policy 1, policy_version 323709 (0.0010) [2023-12-26 02:10:57,012][123091] Updated weights for policy 0, policy_version 325494 (0.0007) [2023-12-26 02:10:57,068][123091] Updated weights for policy 0, policy_version 325504 (0.0005) [2023-12-26 02:10:57,109][123090] Updated weights for policy 1, policy_version 323719 (0.0007) [2023-12-26 02:10:57,121][123091] Updated weights for policy 0, policy_version 325514 (0.0005) [2023-12-26 02:10:57,177][123090] Updated weights for policy 1, policy_version 323729 (0.0005) [2023-12-26 02:10:57,255][123090] Updated weights for policy 1, policy_version 323739 (0.0005) [2023-12-26 02:10:57,846][123090] Updated weights for policy 1, policy_version 323749 (0.0005) [2023-12-26 02:10:57,880][123091] Updated weights for policy 0, policy_version 325524 (0.0008) [2023-12-26 02:10:57,903][123090] Updated weights for policy 1, policy_version 323759 (0.0005) [2023-12-26 02:10:57,938][123091] Updated weights for policy 0, policy_version 325534 (0.0010) [2023-12-26 02:10:57,970][123090] Updated weights for policy 1, policy_version 323769 (0.0010) [2023-12-26 02:10:58,000][123091] Updated weights for policy 0, policy_version 325544 (0.0009) [2023-12-26 02:10:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 166232064. Throughput: 0: 8888.9, 1: 8867.1. Samples: 166231016. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:10:58,785][121949] Avg episode reward: [(0, '6329.590'), (1, '5553.077')] [2023-12-26 02:10:58,805][123091] Updated weights for policy 0, policy_version 325554 (0.0008) [2023-12-26 02:10:58,816][123090] Updated weights for policy 1, policy_version 323779 (0.0009) [2023-12-26 02:10:58,857][123091] Updated weights for policy 0, policy_version 325564 (0.0007) [2023-12-26 02:10:58,872][123090] Updated weights for policy 1, policy_version 323789 (0.0007) [2023-12-26 02:10:58,923][123091] Updated weights for policy 0, policy_version 325574 (0.0008) [2023-12-26 02:10:58,941][123090] Updated weights for policy 1, policy_version 323799 (0.0008) [2023-12-26 02:10:58,986][123091] Updated weights for policy 0, policy_version 325584 (0.0008) [2023-12-26 02:10:59,700][123090] Updated weights for policy 1, policy_version 323809 (0.0007) [2023-12-26 02:10:59,760][123090] Updated weights for policy 1, policy_version 323819 (0.0009) [2023-12-26 02:10:59,827][123090] Updated weights for policy 1, policy_version 323829 (0.0009) [2023-12-26 02:10:59,847][123091] Updated weights for policy 0, policy_version 325594 (0.0007) [2023-12-26 02:10:59,892][123090] Updated weights for policy 1, policy_version 323839 (0.0006) [2023-12-26 02:10:59,908][123091] Updated weights for policy 0, policy_version 325604 (0.0011) [2023-12-26 02:10:59,978][123091] Updated weights for policy 0, policy_version 325614 (0.0008) [2023-12-26 02:11:00,687][123090] Updated weights for policy 1, policy_version 323849 (0.0007) [2023-12-26 02:11:00,740][123090] Updated weights for policy 1, policy_version 323859 (0.0009) [2023-12-26 02:11:00,752][123091] Updated weights for policy 0, policy_version 325624 (0.0006) [2023-12-26 02:11:00,788][123090] Updated weights for policy 1, policy_version 323869 (0.0005) [2023-12-26 02:11:00,800][123091] Updated weights for policy 0, policy_version 325634 (0.0009) [2023-12-26 02:11:00,853][123091] Updated weights for policy 0, policy_version 325644 (0.0010) [2023-12-26 02:11:01,589][123090] Updated weights for policy 1, policy_version 323879 (0.0008) [2023-12-26 02:11:01,658][123090] Updated weights for policy 1, policy_version 323889 (0.0009) [2023-12-26 02:11:01,712][123091] Updated weights for policy 0, policy_version 325654 (0.0007) [2023-12-26 02:11:01,724][123090] Updated weights for policy 1, policy_version 323899 (0.0009) [2023-12-26 02:11:01,772][123091] Updated weights for policy 0, policy_version 325664 (0.0006) [2023-12-26 02:11:01,822][123091] Updated weights for policy 0, policy_version 325674 (0.0005) [2023-12-26 02:11:02,560][123091] Updated weights for policy 0, policy_version 325684 (0.0007) [2023-12-26 02:11:02,617][123091] Updated weights for policy 0, policy_version 325694 (0.0007) [2023-12-26 02:11:02,619][123090] Updated weights for policy 1, policy_version 323909 (0.0010) [2023-12-26 02:11:02,683][123091] Updated weights for policy 0, policy_version 325704 (0.0007) [2023-12-26 02:11:02,684][123090] Updated weights for policy 1, policy_version 323919 (0.0009) [2023-12-26 02:11:02,751][123090] Updated weights for policy 1, policy_version 323929 (0.0007) [2023-12-26 02:11:03,377][123091] Updated weights for policy 0, policy_version 325714 (0.0010) [2023-12-26 02:11:03,440][123091] Updated weights for policy 0, policy_version 325724 (0.0009) [2023-12-26 02:11:03,499][123091] Updated weights for policy 0, policy_version 325734 (0.0009) [2023-12-26 02:11:03,547][123090] Updated weights for policy 1, policy_version 323939 (0.0007) [2023-12-26 02:11:03,552][123091] Updated weights for policy 0, policy_version 325744 (0.0008) [2023-12-26 02:11:03,603][123090] Updated weights for policy 1, policy_version 323949 (0.0010) [2023-12-26 02:11:03,666][123090] Updated weights for policy 1, policy_version 323959 (0.0010) [2023-12-26 02:11:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 166330368. Throughput: 0: 8846.4, 1: 8929.9. Samples: 166336008. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:11:03,785][121949] Avg episode reward: [(0, '6309.052'), (1, '5447.227')] [2023-12-26 02:11:04,341][123091] Updated weights for policy 0, policy_version 325754 (0.0009) [2023-12-26 02:11:04,400][123091] Updated weights for policy 0, policy_version 325764 (0.0009) [2023-12-26 02:11:04,454][123091] Updated weights for policy 0, policy_version 325774 (0.0009) [2023-12-26 02:11:04,488][123090] Updated weights for policy 1, policy_version 323969 (0.0010) [2023-12-26 02:11:04,544][123090] Updated weights for policy 1, policy_version 323979 (0.0011) [2023-12-26 02:11:04,604][123090] Updated weights for policy 1, policy_version 323989 (0.0011) [2023-12-26 02:11:04,671][123090] Updated weights for policy 1, policy_version 323999 (0.0011) [2023-12-26 02:11:05,333][123091] Updated weights for policy 0, policy_version 325784 (0.0009) [2023-12-26 02:11:05,400][123091] Updated weights for policy 0, policy_version 325794 (0.0009) [2023-12-26 02:11:05,438][123090] Updated weights for policy 1, policy_version 324009 (0.0010) [2023-12-26 02:11:05,462][123091] Updated weights for policy 0, policy_version 325804 (0.0007) [2023-12-26 02:11:05,490][123090] Updated weights for policy 1, policy_version 324019 (0.0010) [2023-12-26 02:11:05,538][123090] Updated weights for policy 1, policy_version 324029 (0.0010) [2023-12-26 02:11:06,249][123091] Updated weights for policy 0, policy_version 325814 (0.0008) [2023-12-26 02:11:06,317][123091] Updated weights for policy 0, policy_version 325824 (0.0009) [2023-12-26 02:11:06,322][123090] Updated weights for policy 1, policy_version 324039 (0.0007) [2023-12-26 02:11:06,370][123091] Updated weights for policy 0, policy_version 325834 (0.0009) [2023-12-26 02:11:06,382][123090] Updated weights for policy 1, policy_version 324049 (0.0006) [2023-12-26 02:11:06,444][123090] Updated weights for policy 1, policy_version 324059 (0.0006) [2023-12-26 02:11:07,173][123091] Updated weights for policy 0, policy_version 325844 (0.0009) [2023-12-26 02:11:07,205][123090] Updated weights for policy 1, policy_version 324069 (0.0008) [2023-12-26 02:11:07,230][123091] Updated weights for policy 0, policy_version 325854 (0.0008) [2023-12-26 02:11:07,261][123090] Updated weights for policy 1, policy_version 324079 (0.0011) [2023-12-26 02:11:07,314][123091] Updated weights for policy 0, policy_version 325864 (0.0008) [2023-12-26 02:11:07,326][123090] Updated weights for policy 1, policy_version 324089 (0.0011) [2023-12-26 02:11:07,971][123091] Updated weights for policy 0, policy_version 325874 (0.0008) [2023-12-26 02:11:08,021][123091] Updated weights for policy 0, policy_version 325884 (0.0007) [2023-12-26 02:11:08,089][123091] Updated weights for policy 0, policy_version 325894 (0.0009) [2023-12-26 02:11:08,156][123090] Updated weights for policy 1, policy_version 324099 (0.0011) [2023-12-26 02:11:08,163][123091] Updated weights for policy 0, policy_version 325904 (0.0008) [2023-12-26 02:11:08,213][123090] Updated weights for policy 1, policy_version 324109 (0.0009) [2023-12-26 02:11:08,282][123090] Updated weights for policy 1, policy_version 324119 (0.0010) [2023-12-26 02:11:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 166412288. Throughput: 0: 8825.0, 1: 8990.7. Samples: 166388536. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:11:08,785][121949] Avg episode reward: [(0, '6283.078'), (1, '5410.252')] [2023-12-26 02:11:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000324128_82976768.pth... [2023-12-26 02:11:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000325904_83435520.pth... [2023-12-26 02:11:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000323104_82714624.pth [2023-12-26 02:11:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000324880_83173376.pth [2023-12-26 02:11:08,944][123091] Updated weights for policy 0, policy_version 325914 (0.0005) [2023-12-26 02:11:08,990][123091] Updated weights for policy 0, policy_version 325924 (0.0005) [2023-12-26 02:11:09,042][123091] Updated weights for policy 0, policy_version 325934 (0.0006) [2023-12-26 02:11:09,173][123090] Updated weights for policy 1, policy_version 324129 (0.0009) [2023-12-26 02:11:09,244][123090] Updated weights for policy 1, policy_version 324139 (0.0010) [2023-12-26 02:11:09,310][123090] Updated weights for policy 1, policy_version 324149 (0.0010) [2023-12-26 02:11:09,378][123090] Updated weights for policy 1, policy_version 324159 (0.0011) [2023-12-26 02:11:09,765][123091] Updated weights for policy 0, policy_version 325944 (0.0007) [2023-12-26 02:11:09,836][123091] Updated weights for policy 0, policy_version 325954 (0.0007) [2023-12-26 02:11:09,910][123091] Updated weights for policy 0, policy_version 325964 (0.0007) [2023-12-26 02:11:10,275][123090] Updated weights for policy 1, policy_version 324169 (0.0008) [2023-12-26 02:11:10,336][123090] Updated weights for policy 1, policy_version 324179 (0.0008) [2023-12-26 02:11:10,402][123090] Updated weights for policy 1, policy_version 324189 (0.0010) [2023-12-26 02:11:10,653][123091] Updated weights for policy 0, policy_version 325974 (0.0007) [2023-12-26 02:11:10,720][123091] Updated weights for policy 0, policy_version 325984 (0.0005) [2023-12-26 02:11:10,780][123091] Updated weights for policy 0, policy_version 325994 (0.0008) [2023-12-26 02:11:11,208][123090] Updated weights for policy 1, policy_version 324199 (0.0007) [2023-12-26 02:11:11,279][123090] Updated weights for policy 1, policy_version 324209 (0.0006) [2023-12-26 02:11:11,350][123090] Updated weights for policy 1, policy_version 324219 (0.0008) [2023-12-26 02:11:11,562][123091] Updated weights for policy 0, policy_version 326004 (0.0009) [2023-12-26 02:11:11,621][123091] Updated weights for policy 0, policy_version 326014 (0.0008) [2023-12-26 02:11:11,686][123091] Updated weights for policy 0, policy_version 326024 (0.0011) [2023-12-26 02:11:12,156][123090] Updated weights for policy 1, policy_version 324229 (0.0007) [2023-12-26 02:11:12,232][123090] Updated weights for policy 1, policy_version 324239 (0.0005) [2023-12-26 02:11:12,310][123090] Updated weights for policy 1, policy_version 324249 (0.0010) [2023-12-26 02:11:12,532][123091] Updated weights for policy 0, policy_version 326034 (0.0008) [2023-12-26 02:11:12,584][123091] Updated weights for policy 0, policy_version 326044 (0.0009) [2023-12-26 02:11:12,649][123091] Updated weights for policy 0, policy_version 326054 (0.0009) [2023-12-26 02:11:12,702][123091] Updated weights for policy 0, policy_version 326064 (0.0009) [2023-12-26 02:11:13,101][123090] Updated weights for policy 1, policy_version 324259 (0.0010) [2023-12-26 02:11:13,149][123090] Updated weights for policy 1, policy_version 324269 (0.0010) [2023-12-26 02:11:13,206][123090] Updated weights for policy 1, policy_version 324279 (0.0009) [2023-12-26 02:11:13,576][123091] Updated weights for policy 0, policy_version 326074 (0.0009) [2023-12-26 02:11:13,644][123091] Updated weights for policy 0, policy_version 326084 (0.0009) [2023-12-26 02:11:13,703][123091] Updated weights for policy 0, policy_version 326094 (0.0010) [2023-12-26 02:11:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 166502400. Throughput: 0: 8882.2, 1: 8900.7. Samples: 166494364. Policy #0 lag: (min: 31.0, avg: 36.5, max: 63.0) [2023-12-26 02:11:13,785][121949] Avg episode reward: [(0, '6326.543'), (1, '5264.918')] [2023-12-26 02:11:13,994][123090] Updated weights for policy 1, policy_version 324289 (0.0006) [2023-12-26 02:11:14,064][123090] Updated weights for policy 1, policy_version 324299 (0.0010) [2023-12-26 02:11:14,120][123090] Updated weights for policy 1, policy_version 324309 (0.0010) [2023-12-26 02:11:14,174][123090] Updated weights for policy 1, policy_version 324319 (0.0006) [2023-12-26 02:11:14,543][123091] Updated weights for policy 0, policy_version 326104 (0.0009) [2023-12-26 02:11:14,606][123091] Updated weights for policy 0, policy_version 326114 (0.0010) [2023-12-26 02:11:14,668][123091] Updated weights for policy 0, policy_version 326124 (0.0010) [2023-12-26 02:11:14,896][123090] Updated weights for policy 1, policy_version 324329 (0.0005) [2023-12-26 02:11:14,966][123090] Updated weights for policy 1, policy_version 324339 (0.0006) [2023-12-26 02:11:15,045][123090] Updated weights for policy 1, policy_version 324349 (0.0006) [2023-12-26 02:11:15,573][123091] Updated weights for policy 0, policy_version 326134 (0.0010) [2023-12-26 02:11:15,622][123090] Updated weights for policy 1, policy_version 324359 (0.0006) [2023-12-26 02:11:15,634][123091] Updated weights for policy 0, policy_version 326144 (0.0009) [2023-12-26 02:11:15,689][123090] Updated weights for policy 1, policy_version 324369 (0.0009) [2023-12-26 02:11:15,701][123091] Updated weights for policy 0, policy_version 326154 (0.0007) [2023-12-26 02:11:15,748][123090] Updated weights for policy 1, policy_version 324379 (0.0010) [2023-12-26 02:11:16,397][123091] Updated weights for policy 0, policy_version 326164 (0.0006) [2023-12-26 02:11:16,462][123091] Updated weights for policy 0, policy_version 326174 (0.0005) [2023-12-26 02:11:16,524][123091] Updated weights for policy 0, policy_version 326184 (0.0005) [2023-12-26 02:11:16,530][123090] Updated weights for policy 1, policy_version 324389 (0.0008) [2023-12-26 02:11:16,597][123090] Updated weights for policy 1, policy_version 324399 (0.0008) [2023-12-26 02:11:16,664][123090] Updated weights for policy 1, policy_version 324409 (0.0007) [2023-12-26 02:11:17,232][123091] Updated weights for policy 0, policy_version 326194 (0.0006) [2023-12-26 02:11:17,291][123091] Updated weights for policy 0, policy_version 326204 (0.0009) [2023-12-26 02:11:17,323][123090] Updated weights for policy 1, policy_version 324419 (0.0009) [2023-12-26 02:11:17,338][123091] Updated weights for policy 0, policy_version 326214 (0.0009) [2023-12-26 02:11:17,393][123091] Updated weights for policy 0, policy_version 326224 (0.0009) [2023-12-26 02:11:17,416][123090] Updated weights for policy 1, policy_version 324429 (0.0010) [2023-12-26 02:11:17,485][123090] Updated weights for policy 1, policy_version 324439 (0.0010) [2023-12-26 02:11:18,175][123091] Updated weights for policy 0, policy_version 326234 (0.0010) [2023-12-26 02:11:18,229][123091] Updated weights for policy 0, policy_version 326244 (0.0010) [2023-12-26 02:11:18,244][123090] Updated weights for policy 1, policy_version 324449 (0.0010) [2023-12-26 02:11:18,285][123091] Updated weights for policy 0, policy_version 326254 (0.0010) [2023-12-26 02:11:18,307][123090] Updated weights for policy 1, policy_version 324459 (0.0005) [2023-12-26 02:11:18,379][123090] Updated weights for policy 1, policy_version 324469 (0.0009) [2023-12-26 02:11:18,454][123090] Updated weights for policy 1, policy_version 324479 (0.0011) [2023-12-26 02:11:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 166592512. Throughput: 0: 8870.7, 1: 8918.8. Samples: 166603328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:18,785][121949] Avg episode reward: [(0, '6258.138'), (1, '5327.772')] [2023-12-26 02:11:19,049][123091] Updated weights for policy 0, policy_version 326264 (0.0006) [2023-12-26 02:11:19,101][123091] Updated weights for policy 0, policy_version 326274 (0.0005) [2023-12-26 02:11:19,158][123091] Updated weights for policy 0, policy_version 326284 (0.0006) [2023-12-26 02:11:19,252][123090] Updated weights for policy 1, policy_version 324489 (0.0011) [2023-12-26 02:11:19,311][123090] Updated weights for policy 1, policy_version 324499 (0.0010) [2023-12-26 02:11:19,383][123090] Updated weights for policy 1, policy_version 324509 (0.0011) [2023-12-26 02:11:19,885][123091] Updated weights for policy 0, policy_version 326294 (0.0009) [2023-12-26 02:11:19,946][123091] Updated weights for policy 0, policy_version 326304 (0.0009) [2023-12-26 02:11:20,010][123091] Updated weights for policy 0, policy_version 326314 (0.0009) [2023-12-26 02:11:20,231][123090] Updated weights for policy 1, policy_version 324519 (0.0009) [2023-12-26 02:11:20,285][123090] Updated weights for policy 1, policy_version 324529 (0.0009) [2023-12-26 02:11:20,351][123090] Updated weights for policy 1, policy_version 324539 (0.0006) [2023-12-26 02:11:20,855][123091] Updated weights for policy 0, policy_version 326324 (0.0007) [2023-12-26 02:11:20,925][123091] Updated weights for policy 0, policy_version 326334 (0.0009) [2023-12-26 02:11:20,988][123091] Updated weights for policy 0, policy_version 326344 (0.0010) [2023-12-26 02:11:21,100][123090] Updated weights for policy 1, policy_version 324549 (0.0007) [2023-12-26 02:11:21,168][123090] Updated weights for policy 1, policy_version 324559 (0.0009) [2023-12-26 02:11:21,237][123090] Updated weights for policy 1, policy_version 324569 (0.0011) [2023-12-26 02:11:21,798][123091] Updated weights for policy 0, policy_version 326354 (0.0009) [2023-12-26 02:11:21,875][123091] Updated weights for policy 0, policy_version 326364 (0.0005) [2023-12-26 02:11:21,944][123091] Updated weights for policy 0, policy_version 326374 (0.0005) [2023-12-26 02:11:22,022][123091] Updated weights for policy 0, policy_version 326384 (0.0006) [2023-12-26 02:11:22,143][123090] Updated weights for policy 1, policy_version 324579 (0.0010) [2023-12-26 02:11:22,217][123090] Updated weights for policy 1, policy_version 324589 (0.0009) [2023-12-26 02:11:22,296][123090] Updated weights for policy 1, policy_version 324599 (0.0010) [2023-12-26 02:11:22,712][123091] Updated weights for policy 0, policy_version 326394 (0.0010) [2023-12-26 02:11:22,765][123091] Updated weights for policy 0, policy_version 326404 (0.0010) [2023-12-26 02:11:22,836][123091] Updated weights for policy 0, policy_version 326414 (0.0009) [2023-12-26 02:11:23,065][123090] Updated weights for policy 1, policy_version 324609 (0.0010) [2023-12-26 02:11:23,123][123090] Updated weights for policy 1, policy_version 324619 (0.0009) [2023-12-26 02:11:23,177][123090] Updated weights for policy 1, policy_version 324629 (0.0009) [2023-12-26 02:11:23,239][123090] Updated weights for policy 1, policy_version 324639 (0.0010) [2023-12-26 02:11:23,690][123091] Updated weights for policy 0, policy_version 326424 (0.0006) [2023-12-26 02:11:23,741][123091] Updated weights for policy 0, policy_version 326434 (0.0008) [2023-12-26 02:11:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 166674432. Throughput: 0: 8853.8, 1: 8871.7. Samples: 166655632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:23,785][121949] Avg episode reward: [(0, '6309.197'), (1, '5489.370')] [2023-12-26 02:11:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000324640_83107840.pth... [2023-12-26 02:11:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000323616_82845696.pth [2023-12-26 02:11:23,805][123091] Updated weights for policy 0, policy_version 326444 (0.0009) [2023-12-26 02:11:23,821][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000326448_83574784.pth... [2023-12-26 02:11:23,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000325392_83304448.pth [2023-12-26 02:11:24,009][123090] Updated weights for policy 1, policy_version 324649 (0.0009) [2023-12-26 02:11:24,069][123090] Updated weights for policy 1, policy_version 324659 (0.0010) [2023-12-26 02:11:24,132][123090] Updated weights for policy 1, policy_version 324669 (0.0008) [2023-12-26 02:11:24,594][123091] Updated weights for policy 0, policy_version 326454 (0.0010) [2023-12-26 02:11:24,645][123091] Updated weights for policy 0, policy_version 326465 (0.0011) [2023-12-26 02:11:24,700][123091] Updated weights for policy 0, policy_version 326475 (0.0010) [2023-12-26 02:11:24,958][123090] Updated weights for policy 1, policy_version 324679 (0.0009) [2023-12-26 02:11:25,019][123090] Updated weights for policy 1, policy_version 324689 (0.0010) [2023-12-26 02:11:25,082][123090] Updated weights for policy 1, policy_version 324699 (0.0010) [2023-12-26 02:11:25,563][123091] Updated weights for policy 0, policy_version 326485 (0.0009) [2023-12-26 02:11:25,616][123091] Updated weights for policy 0, policy_version 326495 (0.0009) [2023-12-26 02:11:25,673][123091] Updated weights for policy 0, policy_version 326505 (0.0009) [2023-12-26 02:11:25,862][123090] Updated weights for policy 1, policy_version 324709 (0.0009) [2023-12-26 02:11:25,930][123090] Updated weights for policy 1, policy_version 324719 (0.0008) [2023-12-26 02:11:25,995][123090] Updated weights for policy 1, policy_version 324729 (0.0009) [2023-12-26 02:11:26,539][123091] Updated weights for policy 0, policy_version 326515 (0.0009) [2023-12-26 02:11:26,596][123091] Updated weights for policy 0, policy_version 326525 (0.0009) [2023-12-26 02:11:26,643][123091] Updated weights for policy 0, policy_version 326535 (0.0009) [2023-12-26 02:11:26,774][123090] Updated weights for policy 1, policy_version 324739 (0.0009) [2023-12-26 02:11:26,840][123090] Updated weights for policy 1, policy_version 324749 (0.0006) [2023-12-26 02:11:26,897][123090] Updated weights for policy 1, policy_version 324759 (0.0009) [2023-12-26 02:11:27,415][123091] Updated weights for policy 0, policy_version 326545 (0.0009) [2023-12-26 02:11:27,465][123091] Updated weights for policy 0, policy_version 326555 (0.0010) [2023-12-26 02:11:27,530][123091] Updated weights for policy 0, policy_version 326565 (0.0006) [2023-12-26 02:11:27,591][123091] Updated weights for policy 0, policy_version 326575 (0.0005) [2023-12-26 02:11:27,771][123090] Updated weights for policy 1, policy_version 324769 (0.0009) [2023-12-26 02:11:27,823][123090] Updated weights for policy 1, policy_version 324779 (0.0009) [2023-12-26 02:11:27,881][123090] Updated weights for policy 1, policy_version 324789 (0.0008) [2023-12-26 02:11:27,938][123090] Updated weights for policy 1, policy_version 324799 (0.0009) [2023-12-26 02:11:28,331][123091] Updated weights for policy 0, policy_version 326585 (0.0008) [2023-12-26 02:11:28,390][123091] Updated weights for policy 0, policy_version 326595 (0.0009) [2023-12-26 02:11:28,442][123091] Updated weights for policy 0, policy_version 326605 (0.0009) [2023-12-26 02:11:28,775][123090] Updated weights for policy 1, policy_version 324809 (0.0009) [2023-12-26 02:11:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 166764544. Throughput: 0: 8917.2, 1: 8851.7. Samples: 166759660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:28,785][121949] Avg episode reward: [(0, '6390.027'), (1, '5602.752')] [2023-12-26 02:11:28,826][123090] Updated weights for policy 1, policy_version 324819 (0.0009) [2023-12-26 02:11:28,879][123090] Updated weights for policy 1, policy_version 324830 (0.0010) [2023-12-26 02:11:29,274][123091] Updated weights for policy 0, policy_version 326615 (0.0010) [2023-12-26 02:11:29,331][123091] Updated weights for policy 0, policy_version 326625 (0.0009) [2023-12-26 02:11:29,400][123091] Updated weights for policy 0, policy_version 326635 (0.0009) [2023-12-26 02:11:29,751][123090] Updated weights for policy 1, policy_version 324840 (0.0010) [2023-12-26 02:11:29,809][123090] Updated weights for policy 1, policy_version 324850 (0.0009) [2023-12-26 02:11:29,874][123090] Updated weights for policy 1, policy_version 324860 (0.0007) [2023-12-26 02:11:30,181][123091] Updated weights for policy 0, policy_version 326645 (0.0008) [2023-12-26 02:11:30,242][123091] Updated weights for policy 0, policy_version 326655 (0.0006) [2023-12-26 02:11:30,307][123091] Updated weights for policy 0, policy_version 326665 (0.0006) [2023-12-26 02:11:30,589][123090] Updated weights for policy 1, policy_version 324870 (0.0007) [2023-12-26 02:11:30,664][123090] Updated weights for policy 1, policy_version 324880 (0.0008) [2023-12-26 02:11:30,728][123090] Updated weights for policy 1, policy_version 324890 (0.0008) [2023-12-26 02:11:30,968][123091] Updated weights for policy 0, policy_version 326675 (0.0005) [2023-12-26 02:11:31,016][123091] Updated weights for policy 0, policy_version 326685 (0.0005) [2023-12-26 02:11:31,082][123091] Updated weights for policy 0, policy_version 326695 (0.0008) [2023-12-26 02:11:31,457][123090] Updated weights for policy 1, policy_version 324900 (0.0006) [2023-12-26 02:11:31,534][123090] Updated weights for policy 1, policy_version 324910 (0.0005) [2023-12-26 02:11:31,612][123090] Updated weights for policy 1, policy_version 324920 (0.0006) [2023-12-26 02:11:31,845][123091] Updated weights for policy 0, policy_version 326705 (0.0011) [2023-12-26 02:11:31,911][123091] Updated weights for policy 0, policy_version 326715 (0.0011) [2023-12-26 02:11:31,973][123091] Updated weights for policy 0, policy_version 326725 (0.0010) [2023-12-26 02:11:32,038][123091] Updated weights for policy 0, policy_version 326735 (0.0009) [2023-12-26 02:11:32,368][123090] Updated weights for policy 1, policy_version 324930 (0.0010) [2023-12-26 02:11:32,428][123090] Updated weights for policy 1, policy_version 324940 (0.0009) [2023-12-26 02:11:32,482][123090] Updated weights for policy 1, policy_version 324950 (0.0007) [2023-12-26 02:11:32,538][123090] Updated weights for policy 1, policy_version 324960 (0.0008) [2023-12-26 02:11:32,833][123091] Updated weights for policy 0, policy_version 326745 (0.0010) [2023-12-26 02:11:32,885][123091] Updated weights for policy 0, policy_version 326755 (0.0011) [2023-12-26 02:11:32,948][123091] Updated weights for policy 0, policy_version 326765 (0.0011) [2023-12-26 02:11:33,289][123090] Updated weights for policy 1, policy_version 324970 (0.0009) [2023-12-26 02:11:33,338][123090] Updated weights for policy 1, policy_version 324980 (0.0009) [2023-12-26 02:11:33,386][123090] Updated weights for policy 1, policy_version 324991 (0.0009) [2023-12-26 02:11:33,749][123091] Updated weights for policy 0, policy_version 326775 (0.0007) [2023-12-26 02:11:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 166854656. Throughput: 0: 8938.8, 1: 8824.6. Samples: 166867840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:33,784][121949] Avg episode reward: [(0, '6257.259'), (1, '5458.991')] [2023-12-26 02:11:33,812][123091] Updated weights for policy 0, policy_version 326785 (0.0006) [2023-12-26 02:11:33,857][123091] Updated weights for policy 0, policy_version 326795 (0.0005) [2023-12-26 02:11:34,239][123090] Updated weights for policy 1, policy_version 325001 (0.0009) [2023-12-26 02:11:34,292][123090] Updated weights for policy 1, policy_version 325011 (0.0009) [2023-12-26 02:11:34,345][123090] Updated weights for policy 1, policy_version 325021 (0.0009) [2023-12-26 02:11:34,618][123091] Updated weights for policy 0, policy_version 326805 (0.0006) [2023-12-26 02:11:34,675][123091] Updated weights for policy 0, policy_version 326815 (0.0010) [2023-12-26 02:11:34,735][123091] Updated weights for policy 0, policy_version 326825 (0.0006) [2023-12-26 02:11:35,244][123090] Updated weights for policy 1, policy_version 325031 (0.0010) [2023-12-26 02:11:35,297][123090] Updated weights for policy 1, policy_version 325041 (0.0009) [2023-12-26 02:11:35,350][123090] Updated weights for policy 1, policy_version 325051 (0.0009) [2023-12-26 02:11:35,392][123091] Updated weights for policy 0, policy_version 326835 (0.0006) [2023-12-26 02:11:35,440][123091] Updated weights for policy 0, policy_version 326845 (0.0006) [2023-12-26 02:11:35,494][123091] Updated weights for policy 0, policy_version 326855 (0.0005) [2023-12-26 02:11:36,128][123091] Updated weights for policy 0, policy_version 326865 (0.0006) [2023-12-26 02:11:36,183][123091] Updated weights for policy 0, policy_version 326875 (0.0008) [2023-12-26 02:11:36,238][123091] Updated weights for policy 0, policy_version 326885 (0.0010) [2023-12-26 02:11:36,276][123090] Updated weights for policy 1, policy_version 325061 (0.0008) [2023-12-26 02:11:36,296][123091] Updated weights for policy 0, policy_version 326895 (0.0008) [2023-12-26 02:11:36,335][123090] Updated weights for policy 1, policy_version 325071 (0.0009) [2023-12-26 02:11:36,397][123090] Updated weights for policy 1, policy_version 325081 (0.0010) [2023-12-26 02:11:37,110][123091] Updated weights for policy 0, policy_version 326905 (0.0006) [2023-12-26 02:11:37,180][123091] Updated weights for policy 0, policy_version 326915 (0.0005) [2023-12-26 02:11:37,250][123091] Updated weights for policy 0, policy_version 326925 (0.0005) [2023-12-26 02:11:37,255][123090] Updated weights for policy 1, policy_version 325091 (0.0009) [2023-12-26 02:11:37,323][123090] Updated weights for policy 1, policy_version 325101 (0.0009) [2023-12-26 02:11:37,374][123090] Updated weights for policy 1, policy_version 325111 (0.0010) [2023-12-26 02:11:37,992][123091] Updated weights for policy 0, policy_version 326935 (0.0009) [2023-12-26 02:11:38,042][123091] Updated weights for policy 0, policy_version 326945 (0.0009) [2023-12-26 02:11:38,099][123091] Updated weights for policy 0, policy_version 326955 (0.0011) [2023-12-26 02:11:38,211][123090] Updated weights for policy 1, policy_version 325121 (0.0009) [2023-12-26 02:11:38,263][123090] Updated weights for policy 1, policy_version 325131 (0.0008) [2023-12-26 02:11:38,326][123090] Updated weights for policy 1, policy_version 325141 (0.0008) [2023-12-26 02:11:38,395][123090] Updated weights for policy 1, policy_version 325151 (0.0006) [2023-12-26 02:11:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 166944768. Throughput: 0: 9025.1, 1: 8783.2. Samples: 166921692. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:38,785][121949] Avg episode reward: [(0, '6210.386'), (1, '5268.915')] [2023-12-26 02:11:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000325152_83238912.pth... [2023-12-26 02:11:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000326960_83705856.pth... [2023-12-26 02:11:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000324128_82976768.pth [2023-12-26 02:11:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000325904_83435520.pth [2023-12-26 02:11:38,872][123091] Updated weights for policy 0, policy_version 326965 (0.0011) [2023-12-26 02:11:38,924][123091] Updated weights for policy 0, policy_version 326975 (0.0010) [2023-12-26 02:11:38,987][123091] Updated weights for policy 0, policy_version 326985 (0.0011) [2023-12-26 02:11:39,234][123090] Updated weights for policy 1, policy_version 325161 (0.0008) [2023-12-26 02:11:39,302][123090] Updated weights for policy 1, policy_version 325171 (0.0009) [2023-12-26 02:11:39,373][123090] Updated weights for policy 1, policy_version 325181 (0.0009) [2023-12-26 02:11:39,801][123091] Updated weights for policy 0, policy_version 326995 (0.0009) [2023-12-26 02:11:39,876][123091] Updated weights for policy 0, policy_version 327005 (0.0007) [2023-12-26 02:11:39,948][123091] Updated weights for policy 0, policy_version 327015 (0.0010) [2023-12-26 02:11:40,193][123090] Updated weights for policy 1, policy_version 325191 (0.0009) [2023-12-26 02:11:40,251][123090] Updated weights for policy 1, policy_version 325201 (0.0009) [2023-12-26 02:11:40,313][123090] Updated weights for policy 1, policy_version 325211 (0.0009) [2023-12-26 02:11:40,734][123091] Updated weights for policy 0, policy_version 327025 (0.0010) [2023-12-26 02:11:40,779][123091] Updated weights for policy 0, policy_version 327035 (0.0008) [2023-12-26 02:11:40,851][123091] Updated weights for policy 0, policy_version 327045 (0.0006) [2023-12-26 02:11:40,917][123091] Updated weights for policy 0, policy_version 327055 (0.0006) [2023-12-26 02:11:41,127][123090] Updated weights for policy 1, policy_version 325221 (0.0009) [2023-12-26 02:11:41,197][123090] Updated weights for policy 1, policy_version 325231 (0.0010) [2023-12-26 02:11:41,265][123090] Updated weights for policy 1, policy_version 325241 (0.0009) [2023-12-26 02:11:41,638][123091] Updated weights for policy 0, policy_version 327066 (0.0010) [2023-12-26 02:11:41,707][123091] Updated weights for policy 0, policy_version 327076 (0.0009) [2023-12-26 02:11:41,780][123091] Updated weights for policy 0, policy_version 327086 (0.0009) [2023-12-26 02:11:42,162][123090] Updated weights for policy 1, policy_version 325251 (0.0010) [2023-12-26 02:11:42,209][123090] Updated weights for policy 1, policy_version 325261 (0.0009) [2023-12-26 02:11:42,275][123090] Updated weights for policy 1, policy_version 325271 (0.0009) [2023-12-26 02:11:42,602][123091] Updated weights for policy 0, policy_version 327096 (0.0010) [2023-12-26 02:11:42,665][123091] Updated weights for policy 0, policy_version 327106 (0.0009) [2023-12-26 02:11:42,728][123091] Updated weights for policy 0, policy_version 327116 (0.0010) [2023-12-26 02:11:43,103][123090] Updated weights for policy 1, policy_version 325281 (0.0008) [2023-12-26 02:11:43,154][123090] Updated weights for policy 1, policy_version 325291 (0.0006) [2023-12-26 02:11:43,204][123090] Updated weights for policy 1, policy_version 325301 (0.0007) [2023-12-26 02:11:43,251][123090] Updated weights for policy 1, policy_version 325311 (0.0008) [2023-12-26 02:11:43,563][123091] Updated weights for policy 0, policy_version 327126 (0.0007) [2023-12-26 02:11:43,633][123091] Updated weights for policy 0, policy_version 327136 (0.0005) [2023-12-26 02:11:43,702][123091] Updated weights for policy 0, policy_version 327146 (0.0006) [2023-12-26 02:11:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 167034880. Throughput: 0: 8986.4, 1: 8676.4. Samples: 167025840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:43,784][121949] Avg episode reward: [(0, '6279.576'), (1, '5303.102')] [2023-12-26 02:11:44,157][123090] Updated weights for policy 1, policy_version 325321 (0.0009) [2023-12-26 02:11:44,221][123090] Updated weights for policy 1, policy_version 325331 (0.0010) [2023-12-26 02:11:44,269][123091] Updated weights for policy 0, policy_version 327156 (0.0007) [2023-12-26 02:11:44,269][123090] Updated weights for policy 1, policy_version 325341 (0.0008) [2023-12-26 02:11:44,333][123091] Updated weights for policy 0, policy_version 327166 (0.0008) [2023-12-26 02:11:44,395][123091] Updated weights for policy 0, policy_version 327176 (0.0008) [2023-12-26 02:11:45,004][123090] Updated weights for policy 1, policy_version 325351 (0.0007) [2023-12-26 02:11:45,074][123090] Updated weights for policy 1, policy_version 325361 (0.0008) [2023-12-26 02:11:45,121][123091] Updated weights for policy 0, policy_version 327186 (0.0008) [2023-12-26 02:11:45,138][123090] Updated weights for policy 1, policy_version 325371 (0.0008) [2023-12-26 02:11:45,189][123091] Updated weights for policy 0, policy_version 327196 (0.0010) [2023-12-26 02:11:45,258][123091] Updated weights for policy 0, policy_version 327206 (0.0009) [2023-12-26 02:11:45,330][123091] Updated weights for policy 0, policy_version 327216 (0.0010) [2023-12-26 02:11:45,952][123090] Updated weights for policy 1, policy_version 325381 (0.0009) [2023-12-26 02:11:46,012][123090] Updated weights for policy 1, policy_version 325391 (0.0009) [2023-12-26 02:11:46,072][123090] Updated weights for policy 1, policy_version 325401 (0.0009) [2023-12-26 02:11:46,120][123091] Updated weights for policy 0, policy_version 327226 (0.0007) [2023-12-26 02:11:46,186][123091] Updated weights for policy 0, policy_version 327236 (0.0010) [2023-12-26 02:11:46,247][123091] Updated weights for policy 0, policy_version 327246 (0.0010) [2023-12-26 02:11:46,927][123090] Updated weights for policy 1, policy_version 325411 (0.0010) [2023-12-26 02:11:46,977][123090] Updated weights for policy 1, policy_version 325421 (0.0009) [2023-12-26 02:11:47,040][123090] Updated weights for policy 1, policy_version 325431 (0.0010) [2023-12-26 02:11:47,059][123091] Updated weights for policy 0, policy_version 327256 (0.0008) [2023-12-26 02:11:47,116][123091] Updated weights for policy 0, policy_version 327266 (0.0009) [2023-12-26 02:11:47,181][123091] Updated weights for policy 0, policy_version 327276 (0.0009) [2023-12-26 02:11:47,847][123090] Updated weights for policy 1, policy_version 325441 (0.0008) [2023-12-26 02:11:47,906][123090] Updated weights for policy 1, policy_version 325451 (0.0006) [2023-12-26 02:11:47,977][123090] Updated weights for policy 1, policy_version 325461 (0.0005) [2023-12-26 02:11:48,018][123091] Updated weights for policy 0, policy_version 327286 (0.0009) [2023-12-26 02:11:48,044][123090] Updated weights for policy 1, policy_version 325471 (0.0006) [2023-12-26 02:11:48,081][123091] Updated weights for policy 0, policy_version 327296 (0.0010) [2023-12-26 02:11:48,134][123091] Updated weights for policy 0, policy_version 327306 (0.0008) [2023-12-26 02:11:48,732][123090] Updated weights for policy 1, policy_version 325481 (0.0010) [2023-12-26 02:11:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 167116800. Throughput: 0: 9007.8, 1: 8702.6. Samples: 167132972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:48,784][121949] Avg episode reward: [(0, '6303.251'), (1, '5407.396')] [2023-12-26 02:11:48,807][123090] Updated weights for policy 1, policy_version 325491 (0.0011) [2023-12-26 02:11:48,873][123090] Updated weights for policy 1, policy_version 325501 (0.0009) [2023-12-26 02:11:48,944][123091] Updated weights for policy 0, policy_version 327316 (0.0005) [2023-12-26 02:11:49,010][123091] Updated weights for policy 0, policy_version 327326 (0.0008) [2023-12-26 02:11:49,074][123091] Updated weights for policy 0, policy_version 327336 (0.0005) [2023-12-26 02:11:49,693][123090] Updated weights for policy 1, policy_version 325511 (0.0008) [2023-12-26 02:11:49,745][123090] Updated weights for policy 1, policy_version 325521 (0.0005) [2023-12-26 02:11:49,811][123090] Updated weights for policy 1, policy_version 325531 (0.0007) [2023-12-26 02:11:49,853][123091] Updated weights for policy 0, policy_version 327346 (0.0006) [2023-12-26 02:11:49,918][123091] Updated weights for policy 0, policy_version 327356 (0.0008) [2023-12-26 02:11:49,987][123091] Updated weights for policy 0, policy_version 327366 (0.0007) [2023-12-26 02:11:50,065][123091] Updated weights for policy 0, policy_version 327376 (0.0006) [2023-12-26 02:11:50,614][123090] Updated weights for policy 1, policy_version 325541 (0.0009) [2023-12-26 02:11:50,679][123090] Updated weights for policy 1, policy_version 325551 (0.0010) [2023-12-26 02:11:50,691][123091] Updated weights for policy 0, policy_version 327386 (0.0009) [2023-12-26 02:11:50,742][123090] Updated weights for policy 1, policy_version 325561 (0.0008) [2023-12-26 02:11:50,754][123091] Updated weights for policy 0, policy_version 327396 (0.0009) [2023-12-26 02:11:50,821][123091] Updated weights for policy 0, policy_version 327406 (0.0008) [2023-12-26 02:11:51,568][123090] Updated weights for policy 1, policy_version 325571 (0.0010) [2023-12-26 02:11:51,626][123090] Updated weights for policy 1, policy_version 325581 (0.0009) [2023-12-26 02:11:51,682][123091] Updated weights for policy 0, policy_version 327416 (0.0010) [2023-12-26 02:11:51,692][123090] Updated weights for policy 1, policy_version 325591 (0.0008) [2023-12-26 02:11:51,758][123091] Updated weights for policy 0, policy_version 327426 (0.0007) [2023-12-26 02:11:51,828][123091] Updated weights for policy 0, policy_version 327436 (0.0006) [2023-12-26 02:11:52,535][123090] Updated weights for policy 1, policy_version 325601 (0.0009) [2023-12-26 02:11:52,598][123091] Updated weights for policy 0, policy_version 327446 (0.0007) [2023-12-26 02:11:52,600][123090] Updated weights for policy 1, policy_version 325611 (0.0009) [2023-12-26 02:11:52,662][123090] Updated weights for policy 1, policy_version 325621 (0.0007) [2023-12-26 02:11:52,664][123091] Updated weights for policy 0, policy_version 327456 (0.0009) [2023-12-26 02:11:52,732][123090] Updated weights for policy 1, policy_version 325631 (0.0006) [2023-12-26 02:11:52,734][123091] Updated weights for policy 0, policy_version 327466 (0.0009) [2023-12-26 02:11:53,422][123090] Updated weights for policy 1, policy_version 325641 (0.0010) [2023-12-26 02:11:53,494][123090] Updated weights for policy 1, policy_version 325651 (0.0007) [2023-12-26 02:11:53,536][123091] Updated weights for policy 0, policy_version 327476 (0.0009) [2023-12-26 02:11:53,556][123090] Updated weights for policy 1, policy_version 325661 (0.0007) [2023-12-26 02:11:53,594][123091] Updated weights for policy 0, policy_version 327486 (0.0010) [2023-12-26 02:11:53,669][123091] Updated weights for policy 0, policy_version 327496 (0.0009) [2023-12-26 02:11:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 167215104. Throughput: 0: 9046.3, 1: 8675.1. Samples: 167186000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:53,784][121949] Avg episode reward: [(0, '6279.641'), (1, '5380.340')] [2023-12-26 02:11:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000327504_83845120.pth... [2023-12-26 02:11:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000325664_83369984.pth... [2023-12-26 02:11:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000326448_83574784.pth [2023-12-26 02:11:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000324640_83107840.pth [2023-12-26 02:11:54,280][123090] Updated weights for policy 1, policy_version 325671 (0.0005) [2023-12-26 02:11:54,342][123090] Updated weights for policy 1, policy_version 325681 (0.0005) [2023-12-26 02:11:54,404][123090] Updated weights for policy 1, policy_version 325691 (0.0005) [2023-12-26 02:11:54,543][123091] Updated weights for policy 0, policy_version 327506 (0.0010) [2023-12-26 02:11:54,600][123091] Updated weights for policy 0, policy_version 327516 (0.0010) [2023-12-26 02:11:54,655][123091] Updated weights for policy 0, policy_version 327527 (0.0010) [2023-12-26 02:11:55,090][123090] Updated weights for policy 1, policy_version 325701 (0.0007) [2023-12-26 02:11:55,150][123090] Updated weights for policy 1, policy_version 325711 (0.0009) [2023-12-26 02:11:55,215][123090] Updated weights for policy 1, policy_version 325721 (0.0008) [2023-12-26 02:11:55,526][123091] Updated weights for policy 0, policy_version 327537 (0.0008) [2023-12-26 02:11:55,585][123091] Updated weights for policy 0, policy_version 327547 (0.0010) [2023-12-26 02:11:55,650][123091] Updated weights for policy 0, policy_version 327557 (0.0009) [2023-12-26 02:11:55,712][123091] Updated weights for policy 0, policy_version 327567 (0.0009) [2023-12-26 02:11:56,012][123090] Updated weights for policy 1, policy_version 325731 (0.0010) [2023-12-26 02:11:56,077][123090] Updated weights for policy 1, policy_version 325741 (0.0009) [2023-12-26 02:11:56,140][123090] Updated weights for policy 1, policy_version 325751 (0.0009) [2023-12-26 02:11:56,533][123091] Updated weights for policy 0, policy_version 327577 (0.0009) [2023-12-26 02:11:56,590][123091] Updated weights for policy 0, policy_version 327587 (0.0010) [2023-12-26 02:11:56,637][123091] Updated weights for policy 0, policy_version 327597 (0.0009) [2023-12-26 02:11:56,976][123090] Updated weights for policy 1, policy_version 325761 (0.0009) [2023-12-26 02:11:57,023][123090] Updated weights for policy 1, policy_version 325771 (0.0010) [2023-12-26 02:11:57,078][123090] Updated weights for policy 1, policy_version 325781 (0.0010) [2023-12-26 02:11:57,137][123090] Updated weights for policy 1, policy_version 325791 (0.0010) [2023-12-26 02:11:57,369][123091] Updated weights for policy 0, policy_version 327607 (0.0010) [2023-12-26 02:11:57,423][123091] Updated weights for policy 0, policy_version 327617 (0.0009) [2023-12-26 02:11:57,472][123091] Updated weights for policy 0, policy_version 327627 (0.0009) [2023-12-26 02:11:57,936][123090] Updated weights for policy 1, policy_version 325801 (0.0006) [2023-12-26 02:11:58,009][123090] Updated weights for policy 1, policy_version 325811 (0.0006) [2023-12-26 02:11:58,081][123090] Updated weights for policy 1, policy_version 325821 (0.0006) [2023-12-26 02:11:58,347][123091] Updated weights for policy 0, policy_version 327637 (0.0009) [2023-12-26 02:11:58,417][123091] Updated weights for policy 0, policy_version 327647 (0.0008) [2023-12-26 02:11:58,489][123091] Updated weights for policy 0, policy_version 327657 (0.0006) [2023-12-26 02:11:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 167297024. Throughput: 0: 8956.6, 1: 8771.6. Samples: 167292136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:11:58,785][121949] Avg episode reward: [(0, '6233.746'), (1, '5410.358')] [2023-12-26 02:11:58,982][123090] Updated weights for policy 1, policy_version 325831 (0.0008) [2023-12-26 02:11:59,052][123090] Updated weights for policy 1, policy_version 325841 (0.0010) [2023-12-26 02:11:59,118][123090] Updated weights for policy 1, policy_version 325851 (0.0009) [2023-12-26 02:11:59,346][123091] Updated weights for policy 0, policy_version 327667 (0.0007) [2023-12-26 02:11:59,411][123091] Updated weights for policy 0, policy_version 327677 (0.0010) [2023-12-26 02:11:59,463][123091] Updated weights for policy 0, policy_version 327687 (0.0009) [2023-12-26 02:11:59,865][123090] Updated weights for policy 1, policy_version 325861 (0.0008) [2023-12-26 02:11:59,929][123090] Updated weights for policy 1, policy_version 325871 (0.0007) [2023-12-26 02:12:00,000][123090] Updated weights for policy 1, policy_version 325881 (0.0006) [2023-12-26 02:12:00,240][123091] Updated weights for policy 0, policy_version 327697 (0.0009) [2023-12-26 02:12:00,302][123091] Updated weights for policy 0, policy_version 327707 (0.0006) [2023-12-26 02:12:00,352][123091] Updated weights for policy 0, policy_version 327717 (0.0007) [2023-12-26 02:12:00,408][123091] Updated weights for policy 0, policy_version 327727 (0.0008) [2023-12-26 02:12:00,768][123090] Updated weights for policy 1, policy_version 325891 (0.0006) [2023-12-26 02:12:00,826][123090] Updated weights for policy 1, policy_version 325901 (0.0009) [2023-12-26 02:12:00,875][123090] Updated weights for policy 1, policy_version 325911 (0.0009) [2023-12-26 02:12:01,249][123091] Updated weights for policy 0, policy_version 327737 (0.0010) [2023-12-26 02:12:01,303][123091] Updated weights for policy 0, policy_version 327747 (0.0009) [2023-12-26 02:12:01,369][123091] Updated weights for policy 0, policy_version 327758 (0.0010) [2023-12-26 02:12:01,690][123090] Updated weights for policy 1, policy_version 325921 (0.0007) [2023-12-26 02:12:01,758][123090] Updated weights for policy 1, policy_version 325931 (0.0009) [2023-12-26 02:12:01,823][123090] Updated weights for policy 1, policy_version 325941 (0.0008) [2023-12-26 02:12:01,886][123090] Updated weights for policy 1, policy_version 325951 (0.0009) [2023-12-26 02:12:02,321][123091] Updated weights for policy 0, policy_version 327768 (0.0010) [2023-12-26 02:12:02,391][123091] Updated weights for policy 0, policy_version 327778 (0.0010) [2023-12-26 02:12:02,444][123091] Updated weights for policy 0, policy_version 327788 (0.0009) [2023-12-26 02:12:02,579][123090] Updated weights for policy 1, policy_version 325961 (0.0005) [2023-12-26 02:12:02,643][123090] Updated weights for policy 1, policy_version 325971 (0.0006) [2023-12-26 02:12:02,717][123090] Updated weights for policy 1, policy_version 325981 (0.0008) [2023-12-26 02:12:03,239][123091] Updated weights for policy 0, policy_version 327799 (0.0007) [2023-12-26 02:12:03,312][123091] Updated weights for policy 0, policy_version 327809 (0.0005) [2023-12-26 02:12:03,330][123090] Updated weights for policy 1, policy_version 325991 (0.0007) [2023-12-26 02:12:03,364][123091] Updated weights for policy 0, policy_version 327819 (0.0005) [2023-12-26 02:12:03,393][123090] Updated weights for policy 1, policy_version 326001 (0.0008) [2023-12-26 02:12:03,452][123090] Updated weights for policy 1, policy_version 326011 (0.0009) [2023-12-26 02:12:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 167387136. Throughput: 0: 8934.1, 1: 8743.5. Samples: 167398820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:03,785][121949] Avg episode reward: [(0, '6382.770'), (1, '5252.230')] [2023-12-26 02:12:03,852][123091] Updated weights for policy 0, policy_version 327829 (0.0006) [2023-12-26 02:12:03,920][123091] Updated weights for policy 0, policy_version 327839 (0.0009) [2023-12-26 02:12:03,985][123091] Updated weights for policy 0, policy_version 327849 (0.0010) [2023-12-26 02:12:04,322][123090] Updated weights for policy 1, policy_version 326021 (0.0009) [2023-12-26 02:12:04,391][123090] Updated weights for policy 1, policy_version 326031 (0.0009) [2023-12-26 02:12:04,458][123090] Updated weights for policy 1, policy_version 326041 (0.0009) [2023-12-26 02:12:04,800][123091] Updated weights for policy 0, policy_version 327859 (0.0010) [2023-12-26 02:12:04,852][123091] Updated weights for policy 0, policy_version 327869 (0.0008) [2023-12-26 02:12:04,902][123091] Updated weights for policy 0, policy_version 327879 (0.0009) [2023-12-26 02:12:05,324][123090] Updated weights for policy 1, policy_version 326051 (0.0008) [2023-12-26 02:12:05,378][123090] Updated weights for policy 1, policy_version 326061 (0.0010) [2023-12-26 02:12:05,427][123090] Updated weights for policy 1, policy_version 326071 (0.0008) [2023-12-26 02:12:05,630][123091] Updated weights for policy 0, policy_version 327889 (0.0008) [2023-12-26 02:12:05,678][123091] Updated weights for policy 0, policy_version 327899 (0.0005) [2023-12-26 02:12:05,723][123091] Updated weights for policy 0, policy_version 327909 (0.0005) [2023-12-26 02:12:05,771][123091] Updated weights for policy 0, policy_version 327919 (0.0005) [2023-12-26 02:12:06,248][123090] Updated weights for policy 1, policy_version 326081 (0.0009) [2023-12-26 02:12:06,315][123090] Updated weights for policy 1, policy_version 326091 (0.0008) [2023-12-26 02:12:06,371][123090] Updated weights for policy 1, policy_version 326101 (0.0008) [2023-12-26 02:12:06,432][123090] Updated weights for policy 1, policy_version 326111 (0.0009) [2023-12-26 02:12:06,598][123091] Updated weights for policy 0, policy_version 327929 (0.0010) [2023-12-26 02:12:06,666][123091] Updated weights for policy 0, policy_version 327939 (0.0011) [2023-12-26 02:12:06,733][123091] Updated weights for policy 0, policy_version 327949 (0.0010) [2023-12-26 02:12:07,278][123090] Updated weights for policy 1, policy_version 326121 (0.0006) [2023-12-26 02:12:07,350][123090] Updated weights for policy 1, policy_version 326131 (0.0005) [2023-12-26 02:12:07,422][123090] Updated weights for policy 1, policy_version 326141 (0.0005) [2023-12-26 02:12:07,545][123091] Updated weights for policy 0, policy_version 327959 (0.0011) [2023-12-26 02:12:07,601][123091] Updated weights for policy 0, policy_version 327969 (0.0010) [2023-12-26 02:12:07,655][123091] Updated weights for policy 0, policy_version 327979 (0.0010) [2023-12-26 02:12:08,049][123090] Updated weights for policy 1, policy_version 326151 (0.0005) [2023-12-26 02:12:08,103][123090] Updated weights for policy 1, policy_version 326161 (0.0006) [2023-12-26 02:12:08,156][123090] Updated weights for policy 1, policy_version 326171 (0.0005) [2023-12-26 02:12:08,497][123091] Updated weights for policy 0, policy_version 327989 (0.0010) [2023-12-26 02:12:08,558][123091] Updated weights for policy 0, policy_version 327999 (0.0009) [2023-12-26 02:12:08,621][123091] Updated weights for policy 0, policy_version 328009 (0.0010) [2023-12-26 02:12:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 167477248. Throughput: 0: 8950.5, 1: 8740.7. Samples: 167451732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:08,784][121949] Avg episode reward: [(0, '6333.935'), (1, '5215.336')] [2023-12-26 02:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000326176_83501056.pth... [2023-12-26 02:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000328016_83976192.pth... [2023-12-26 02:12:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000325152_83238912.pth [2023-12-26 02:12:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000326960_83705856.pth [2023-12-26 02:12:08,959][123090] Updated weights for policy 1, policy_version 326181 (0.0007) [2023-12-26 02:12:09,027][123090] Updated weights for policy 1, policy_version 326191 (0.0010) [2023-12-26 02:12:09,091][123090] Updated weights for policy 1, policy_version 326201 (0.0009) [2023-12-26 02:12:09,462][123091] Updated weights for policy 0, policy_version 328019 (0.0009) [2023-12-26 02:12:09,529][123091] Updated weights for policy 0, policy_version 328029 (0.0010) [2023-12-26 02:12:09,595][123091] Updated weights for policy 0, policy_version 328039 (0.0007) [2023-12-26 02:12:09,968][123090] Updated weights for policy 1, policy_version 326211 (0.0010) [2023-12-26 02:12:10,039][123090] Updated weights for policy 1, policy_version 326221 (0.0010) [2023-12-26 02:12:10,113][123090] Updated weights for policy 1, policy_version 326231 (0.0010) [2023-12-26 02:12:10,389][123091] Updated weights for policy 0, policy_version 328049 (0.0005) [2023-12-26 02:12:10,448][123091] Updated weights for policy 0, policy_version 328059 (0.0005) [2023-12-26 02:12:10,512][123091] Updated weights for policy 0, policy_version 328069 (0.0007) [2023-12-26 02:12:10,575][123091] Updated weights for policy 0, policy_version 328079 (0.0010) [2023-12-26 02:12:10,953][123090] Updated weights for policy 1, policy_version 326241 (0.0009) [2023-12-26 02:12:11,015][123090] Updated weights for policy 1, policy_version 326251 (0.0009) [2023-12-26 02:12:11,094][123090] Updated weights for policy 1, policy_version 326261 (0.0009) [2023-12-26 02:12:11,161][123090] Updated weights for policy 1, policy_version 326271 (0.0009) [2023-12-26 02:12:11,401][123091] Updated weights for policy 0, policy_version 328089 (0.0008) [2023-12-26 02:12:11,473][123091] Updated weights for policy 0, policy_version 328099 (0.0007) [2023-12-26 02:12:11,533][123091] Updated weights for policy 0, policy_version 328109 (0.0010) [2023-12-26 02:12:12,030][123090] Updated weights for policy 1, policy_version 326281 (0.0009) [2023-12-26 02:12:12,100][123090] Updated weights for policy 1, policy_version 326291 (0.0009) [2023-12-26 02:12:12,167][123090] Updated weights for policy 1, policy_version 326301 (0.0010) [2023-12-26 02:12:12,325][123091] Updated weights for policy 0, policy_version 328119 (0.0008) [2023-12-26 02:12:12,398][123091] Updated weights for policy 0, policy_version 328129 (0.0008) [2023-12-26 02:12:12,459][123091] Updated weights for policy 0, policy_version 328139 (0.0010) [2023-12-26 02:12:12,967][123090] Updated weights for policy 1, policy_version 326311 (0.0009) [2023-12-26 02:12:13,017][123090] Updated weights for policy 1, policy_version 326321 (0.0009) [2023-12-26 02:12:13,074][123090] Updated weights for policy 1, policy_version 326331 (0.0009) [2023-12-26 02:12:13,269][123091] Updated weights for policy 0, policy_version 328149 (0.0010) [2023-12-26 02:12:13,334][123091] Updated weights for policy 0, policy_version 328159 (0.0009) [2023-12-26 02:12:13,387][123091] Updated weights for policy 0, policy_version 328169 (0.0009) [2023-12-26 02:12:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 167559168. Throughput: 0: 8940.3, 1: 8721.5. Samples: 167554444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:13,785][121949] Avg episode reward: [(0, '6156.997'), (1, '5379.650')] [2023-12-26 02:12:13,905][123090] Updated weights for policy 1, policy_version 326341 (0.0007) [2023-12-26 02:12:13,964][123090] Updated weights for policy 1, policy_version 326351 (0.0005) [2023-12-26 02:12:14,019][123090] Updated weights for policy 1, policy_version 326361 (0.0005) [2023-12-26 02:12:14,192][123091] Updated weights for policy 0, policy_version 328180 (0.0010) [2023-12-26 02:12:14,251][123091] Updated weights for policy 0, policy_version 328190 (0.0010) [2023-12-26 02:12:14,311][123091] Updated weights for policy 0, policy_version 328200 (0.0009) [2023-12-26 02:12:14,780][123090] Updated weights for policy 1, policy_version 326371 (0.0006) [2023-12-26 02:12:14,850][123090] Updated weights for policy 1, policy_version 326381 (0.0006) [2023-12-26 02:12:14,925][123090] Updated weights for policy 1, policy_version 326391 (0.0006) [2023-12-26 02:12:15,184][123091] Updated weights for policy 0, policy_version 328210 (0.0010) [2023-12-26 02:12:15,252][123091] Updated weights for policy 0, policy_version 328220 (0.0009) [2023-12-26 02:12:15,317][123091] Updated weights for policy 0, policy_version 328230 (0.0009) [2023-12-26 02:12:15,378][123091] Updated weights for policy 0, policy_version 328240 (0.0010) [2023-12-26 02:12:15,671][123090] Updated weights for policy 1, policy_version 326401 (0.0008) [2023-12-26 02:12:15,733][123090] Updated weights for policy 1, policy_version 326411 (0.0009) [2023-12-26 02:12:15,794][123090] Updated weights for policy 1, policy_version 326421 (0.0009) [2023-12-26 02:12:15,865][123090] Updated weights for policy 1, policy_version 326431 (0.0009) [2023-12-26 02:12:16,192][123091] Updated weights for policy 0, policy_version 328250 (0.0009) [2023-12-26 02:12:16,240][123091] Updated weights for policy 0, policy_version 328260 (0.0009) [2023-12-26 02:12:16,290][123091] Updated weights for policy 0, policy_version 328270 (0.0009) [2023-12-26 02:12:16,710][123090] Updated weights for policy 1, policy_version 326441 (0.0009) [2023-12-26 02:12:16,773][123090] Updated weights for policy 1, policy_version 326451 (0.0009) [2023-12-26 02:12:16,838][123090] Updated weights for policy 1, policy_version 326461 (0.0009) [2023-12-26 02:12:17,183][123091] Updated weights for policy 0, policy_version 328280 (0.0009) [2023-12-26 02:12:17,241][123091] Updated weights for policy 0, policy_version 328290 (0.0010) [2023-12-26 02:12:17,297][123091] Updated weights for policy 0, policy_version 328300 (0.0009) [2023-12-26 02:12:17,521][123090] Updated weights for policy 1, policy_version 326471 (0.0007) [2023-12-26 02:12:17,584][123090] Updated weights for policy 1, policy_version 326481 (0.0010) [2023-12-26 02:12:17,646][123090] Updated weights for policy 1, policy_version 326491 (0.0010) [2023-12-26 02:12:18,161][123091] Updated weights for policy 0, policy_version 328310 (0.0009) [2023-12-26 02:12:18,213][123091] Updated weights for policy 0, policy_version 328320 (0.0008) [2023-12-26 02:12:18,280][123091] Updated weights for policy 0, policy_version 328330 (0.0009) [2023-12-26 02:12:18,452][123090] Updated weights for policy 1, policy_version 326501 (0.0009) [2023-12-26 02:12:18,506][123090] Updated weights for policy 1, policy_version 326511 (0.0009) [2023-12-26 02:12:18,568][123090] Updated weights for policy 1, policy_version 326521 (0.0009) [2023-12-26 02:12:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 167649280. Throughput: 0: 8832.0, 1: 8723.3. Samples: 167657828. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:18,784][121949] Avg episode reward: [(0, '6278.551'), (1, '5693.351')] [2023-12-26 02:12:19,125][123091] Updated weights for policy 0, policy_version 328340 (0.0009) [2023-12-26 02:12:19,174][123091] Updated weights for policy 0, policy_version 328350 (0.0009) [2023-12-26 02:12:19,230][123091] Updated weights for policy 0, policy_version 328360 (0.0008) [2023-12-26 02:12:19,427][123090] Updated weights for policy 1, policy_version 326531 (0.0010) [2023-12-26 02:12:19,488][123090] Updated weights for policy 1, policy_version 326541 (0.0007) [2023-12-26 02:12:19,550][123090] Updated weights for policy 1, policy_version 326551 (0.0006) [2023-12-26 02:12:20,093][123091] Updated weights for policy 0, policy_version 328370 (0.0010) [2023-12-26 02:12:20,146][123091] Updated weights for policy 0, policy_version 328380 (0.0009) [2023-12-26 02:12:20,204][123091] Updated weights for policy 0, policy_version 328390 (0.0005) [2023-12-26 02:12:20,268][123091] Updated weights for policy 0, policy_version 328400 (0.0008) [2023-12-26 02:12:20,376][123090] Updated weights for policy 1, policy_version 326561 (0.0006) [2023-12-26 02:12:20,437][123090] Updated weights for policy 1, policy_version 326571 (0.0011) [2023-12-26 02:12:20,488][123090] Updated weights for policy 1, policy_version 326581 (0.0010) [2023-12-26 02:12:20,540][123090] Updated weights for policy 1, policy_version 326591 (0.0010) [2023-12-26 02:12:21,063][123091] Updated weights for policy 0, policy_version 328410 (0.0010) [2023-12-26 02:12:21,135][123091] Updated weights for policy 0, policy_version 328420 (0.0011) [2023-12-26 02:12:21,200][123091] Updated weights for policy 0, policy_version 328430 (0.0006) [2023-12-26 02:12:21,453][123090] Updated weights for policy 1, policy_version 326601 (0.0008) [2023-12-26 02:12:21,524][123090] Updated weights for policy 1, policy_version 326611 (0.0011) [2023-12-26 02:12:21,584][123090] Updated weights for policy 1, policy_version 326621 (0.0011) [2023-12-26 02:12:22,007][123091] Updated weights for policy 0, policy_version 328440 (0.0010) [2023-12-26 02:12:22,071][123091] Updated weights for policy 0, policy_version 328450 (0.0011) [2023-12-26 02:12:22,135][123091] Updated weights for policy 0, policy_version 328460 (0.0011) [2023-12-26 02:12:22,452][123090] Updated weights for policy 1, policy_version 326631 (0.0008) [2023-12-26 02:12:22,509][123090] Updated weights for policy 1, policy_version 326641 (0.0007) [2023-12-26 02:12:22,572][123090] Updated weights for policy 1, policy_version 326651 (0.0007) [2023-12-26 02:12:22,960][123091] Updated weights for policy 0, policy_version 328470 (0.0010) [2023-12-26 02:12:23,024][123091] Updated weights for policy 0, policy_version 328480 (0.0011) [2023-12-26 02:12:23,081][123091] Updated weights for policy 0, policy_version 328490 (0.0006) [2023-12-26 02:12:23,330][123090] Updated weights for policy 1, policy_version 326661 (0.0007) [2023-12-26 02:12:23,389][123090] Updated weights for policy 1, policy_version 326671 (0.0010) [2023-12-26 02:12:23,438][123090] Updated weights for policy 1, policy_version 326681 (0.0010) [2023-12-26 02:12:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 167731200. Throughput: 0: 8752.9, 1: 8741.7. Samples: 167708948. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:23,785][121949] Avg episode reward: [(0, '6273.706'), (1, '5736.267')] [2023-12-26 02:12:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000328496_84099072.pth... [2023-12-26 02:12:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000326688_83632128.pth... [2023-12-26 02:12:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000327504_83845120.pth [2023-12-26 02:12:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000325664_83369984.pth [2023-12-26 02:12:23,837][123091] Updated weights for policy 0, policy_version 328500 (0.0011) [2023-12-26 02:12:23,904][123091] Updated weights for policy 0, policy_version 328510 (0.0011) [2023-12-26 02:12:23,967][123091] Updated weights for policy 0, policy_version 328520 (0.0011) [2023-12-26 02:12:24,244][123090] Updated weights for policy 1, policy_version 326691 (0.0010) [2023-12-26 02:12:24,310][123090] Updated weights for policy 1, policy_version 326701 (0.0006) [2023-12-26 02:12:24,377][123090] Updated weights for policy 1, policy_version 326711 (0.0006) [2023-12-26 02:12:24,733][123091] Updated weights for policy 0, policy_version 328530 (0.0010) [2023-12-26 02:12:24,793][123091] Updated weights for policy 0, policy_version 328540 (0.0009) [2023-12-26 02:12:24,840][123091] Updated weights for policy 0, policy_version 328550 (0.0010) [2023-12-26 02:12:24,900][123091] Updated weights for policy 0, policy_version 328560 (0.0011) [2023-12-26 02:12:25,065][123090] Updated weights for policy 1, policy_version 326721 (0.0006) [2023-12-26 02:12:25,113][123090] Updated weights for policy 1, policy_version 326731 (0.0006) [2023-12-26 02:12:25,165][123090] Updated weights for policy 1, policy_version 326741 (0.0010) [2023-12-26 02:12:25,213][123090] Updated weights for policy 1, policy_version 326751 (0.0010) [2023-12-26 02:12:25,596][123091] Updated weights for policy 0, policy_version 328570 (0.0008) [2023-12-26 02:12:25,643][123091] Updated weights for policy 0, policy_version 328580 (0.0008) [2023-12-26 02:12:25,691][123091] Updated weights for policy 0, policy_version 328591 (0.0009) [2023-12-26 02:12:26,054][123090] Updated weights for policy 1, policy_version 326761 (0.0006) [2023-12-26 02:12:26,111][123090] Updated weights for policy 1, policy_version 326771 (0.0009) [2023-12-26 02:12:26,168][123090] Updated weights for policy 1, policy_version 326781 (0.0009) [2023-12-26 02:12:26,485][123091] Updated weights for policy 0, policy_version 328601 (0.0005) [2023-12-26 02:12:26,534][123091] Updated weights for policy 0, policy_version 328611 (0.0005) [2023-12-26 02:12:26,587][123091] Updated weights for policy 0, policy_version 328621 (0.0005) [2023-12-26 02:12:26,869][123090] Updated weights for policy 1, policy_version 326791 (0.0009) [2023-12-26 02:12:26,925][123090] Updated weights for policy 1, policy_version 326801 (0.0007) [2023-12-26 02:12:26,993][123090] Updated weights for policy 1, policy_version 326811 (0.0005) [2023-12-26 02:12:27,364][123091] Updated weights for policy 0, policy_version 328631 (0.0008) [2023-12-26 02:12:27,416][123091] Updated weights for policy 0, policy_version 328641 (0.0009) [2023-12-26 02:12:27,464][123091] Updated weights for policy 0, policy_version 328651 (0.0009) [2023-12-26 02:12:27,718][123090] Updated weights for policy 1, policy_version 326821 (0.0007) [2023-12-26 02:12:27,777][123090] Updated weights for policy 1, policy_version 326831 (0.0010) [2023-12-26 02:12:27,825][123090] Updated weights for policy 1, policy_version 326841 (0.0010) [2023-12-26 02:12:28,300][123091] Updated weights for policy 0, policy_version 328661 (0.0009) [2023-12-26 02:12:28,361][123091] Updated weights for policy 0, policy_version 328671 (0.0010) [2023-12-26 02:12:28,414][123091] Updated weights for policy 0, policy_version 328681 (0.0010) [2023-12-26 02:12:28,602][123090] Updated weights for policy 1, policy_version 326851 (0.0010) [2023-12-26 02:12:28,657][123090] Updated weights for policy 1, policy_version 326861 (0.0010) [2023-12-26 02:12:28,715][123090] Updated weights for policy 1, policy_version 326871 (0.0010) [2023-12-26 02:12:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 167829504. Throughput: 0: 8769.2, 1: 8845.5. Samples: 167818504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 02:12:28,785][121949] Avg episode reward: [(0, '6248.058'), (1, '5638.917')] [2023-12-26 02:12:29,272][123091] Updated weights for policy 0, policy_version 328691 (0.0008) [2023-12-26 02:12:29,337][123091] Updated weights for policy 0, policy_version 328701 (0.0007) [2023-12-26 02:12:29,398][123091] Updated weights for policy 0, policy_version 328711 (0.0007) [2023-12-26 02:12:29,577][123090] Updated weights for policy 1, policy_version 326881 (0.0010) [2023-12-26 02:12:29,644][123090] Updated weights for policy 1, policy_version 326891 (0.0008) [2023-12-26 02:12:29,707][123090] Updated weights for policy 1, policy_version 326901 (0.0010) [2023-12-26 02:12:29,769][123090] Updated weights for policy 1, policy_version 326911 (0.0010) [2023-12-26 02:12:30,139][123091] Updated weights for policy 0, policy_version 328721 (0.0006) [2023-12-26 02:12:30,198][123091] Updated weights for policy 0, policy_version 328731 (0.0006) [2023-12-26 02:12:30,259][123091] Updated weights for policy 0, policy_version 328741 (0.0006) [2023-12-26 02:12:30,319][123091] Updated weights for policy 0, policy_version 328751 (0.0006) [2023-12-26 02:12:30,557][123090] Updated weights for policy 1, policy_version 326921 (0.0009) [2023-12-26 02:12:30,611][123090] Updated weights for policy 1, policy_version 326931 (0.0009) [2023-12-26 02:12:30,668][123090] Updated weights for policy 1, policy_version 326941 (0.0009) [2023-12-26 02:12:31,066][123091] Updated weights for policy 0, policy_version 328761 (0.0010) [2023-12-26 02:12:31,132][123091] Updated weights for policy 0, policy_version 328771 (0.0010) [2023-12-26 02:12:31,189][123091] Updated weights for policy 0, policy_version 328781 (0.0009) [2023-12-26 02:12:31,456][123090] Updated weights for policy 1, policy_version 326951 (0.0008) [2023-12-26 02:12:31,529][123090] Updated weights for policy 1, policy_version 326961 (0.0006) [2023-12-26 02:12:31,601][123090] Updated weights for policy 1, policy_version 326971 (0.0006) [2023-12-26 02:12:32,044][123091] Updated weights for policy 0, policy_version 328791 (0.0009) [2023-12-26 02:12:32,096][123091] Updated weights for policy 0, policy_version 328802 (0.0008) [2023-12-26 02:12:32,151][123091] Updated weights for policy 0, policy_version 328813 (0.0009) [2023-12-26 02:12:32,390][123090] Updated weights for policy 1, policy_version 326981 (0.0009) [2023-12-26 02:12:32,453][123090] Updated weights for policy 1, policy_version 326991 (0.0010) [2023-12-26 02:12:32,511][123090] Updated weights for policy 1, policy_version 327001 (0.0009) [2023-12-26 02:12:32,991][123091] Updated weights for policy 0, policy_version 328823 (0.0010) [2023-12-26 02:12:33,056][123091] Updated weights for policy 0, policy_version 328833 (0.0009) [2023-12-26 02:12:33,118][123091] Updated weights for policy 0, policy_version 328843 (0.0008) [2023-12-26 02:12:33,362][123090] Updated weights for policy 1, policy_version 327011 (0.0010) [2023-12-26 02:12:33,419][123090] Updated weights for policy 1, policy_version 327021 (0.0010) [2023-12-26 02:12:33,494][123090] Updated weights for policy 1, policy_version 327031 (0.0009) [2023-12-26 02:12:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 167911424. Throughput: 0: 8766.2, 1: 8822.2. Samples: 167924452. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:33,785][121949] Avg episode reward: [(0, '6330.631'), (1, '5488.239')] [2023-12-26 02:12:33,915][123091] Updated weights for policy 0, policy_version 328853 (0.0010) [2023-12-26 02:12:33,970][123091] Updated weights for policy 0, policy_version 328864 (0.0010) [2023-12-26 02:12:34,019][123091] Updated weights for policy 0, policy_version 328874 (0.0009) [2023-12-26 02:12:34,295][123090] Updated weights for policy 1, policy_version 327041 (0.0009) [2023-12-26 02:12:34,368][123090] Updated weights for policy 1, policy_version 327051 (0.0007) [2023-12-26 02:12:34,437][123090] Updated weights for policy 1, policy_version 327061 (0.0007) [2023-12-26 02:12:34,498][123090] Updated weights for policy 1, policy_version 327071 (0.0007) [2023-12-26 02:12:34,960][123091] Updated weights for policy 0, policy_version 328885 (0.0010) [2023-12-26 02:12:35,023][123091] Updated weights for policy 0, policy_version 328895 (0.0009) [2023-12-26 02:12:35,078][123091] Updated weights for policy 0, policy_version 328905 (0.0009) [2023-12-26 02:12:35,155][123090] Updated weights for policy 1, policy_version 327081 (0.0009) [2023-12-26 02:12:35,206][123090] Updated weights for policy 1, policy_version 327091 (0.0010) [2023-12-26 02:12:35,253][123090] Updated weights for policy 1, policy_version 327101 (0.0008) [2023-12-26 02:12:35,893][123091] Updated weights for policy 0, policy_version 328915 (0.0010) [2023-12-26 02:12:35,945][123091] Updated weights for policy 0, policy_version 328925 (0.0009) [2023-12-26 02:12:36,003][123091] Updated weights for policy 0, policy_version 328935 (0.0010) [2023-12-26 02:12:36,112][123090] Updated weights for policy 1, policy_version 327111 (0.0009) [2023-12-26 02:12:36,173][123090] Updated weights for policy 1, policy_version 327121 (0.0009) [2023-12-26 02:12:36,234][123090] Updated weights for policy 1, policy_version 327132 (0.0009) [2023-12-26 02:12:36,844][123091] Updated weights for policy 0, policy_version 328945 (0.0010) [2023-12-26 02:12:36,906][123091] Updated weights for policy 0, policy_version 328955 (0.0010) [2023-12-26 02:12:36,968][123091] Updated weights for policy 0, policy_version 328965 (0.0009) [2023-12-26 02:12:37,032][123091] Updated weights for policy 0, policy_version 328975 (0.0010) [2023-12-26 02:12:37,053][123090] Updated weights for policy 1, policy_version 327142 (0.0008) [2023-12-26 02:12:37,121][123090] Updated weights for policy 1, policy_version 327152 (0.0010) [2023-12-26 02:12:37,188][123090] Updated weights for policy 1, policy_version 327162 (0.0009) [2023-12-26 02:12:37,861][123091] Updated weights for policy 0, policy_version 328985 (0.0010) [2023-12-26 02:12:37,910][123091] Updated weights for policy 0, policy_version 328995 (0.0009) [2023-12-26 02:12:37,968][123091] Updated weights for policy 0, policy_version 329005 (0.0009) [2023-12-26 02:12:37,993][123090] Updated weights for policy 1, policy_version 327172 (0.0008) [2023-12-26 02:12:38,042][123090] Updated weights for policy 1, policy_version 327182 (0.0009) [2023-12-26 02:12:38,092][123090] Updated weights for policy 1, policy_version 327192 (0.0008) [2023-12-26 02:12:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 167993344. Throughput: 0: 8715.5, 1: 8850.9. Samples: 167976488. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:38,785][121949] Avg episode reward: [(0, '6206.007'), (1, '5147.858')] [2023-12-26 02:12:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000327200_83763200.pth... [2023-12-26 02:12:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000326176_83501056.pth [2023-12-26 02:12:38,810][123091] Updated weights for policy 0, policy_version 329015 (0.0011) [2023-12-26 02:12:38,866][123091] Updated weights for policy 0, policy_version 329025 (0.0009) [2023-12-26 02:12:38,919][123091] Updated weights for policy 0, policy_version 329035 (0.0010) [2023-12-26 02:12:38,936][123090] Updated weights for policy 1, policy_version 327202 (0.0008) [2023-12-26 02:12:38,955][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000329040_84238336.pth... [2023-12-26 02:12:38,960][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000328016_83976192.pth [2023-12-26 02:12:39,005][123090] Updated weights for policy 1, policy_version 327212 (0.0010) [2023-12-26 02:12:39,076][123090] Updated weights for policy 1, policy_version 327222 (0.0009) [2023-12-26 02:12:39,125][123090] Updated weights for policy 1, policy_version 327232 (0.0009) [2023-12-26 02:12:39,775][123091] Updated weights for policy 0, policy_version 329045 (0.0010) [2023-12-26 02:12:39,837][123091] Updated weights for policy 0, policy_version 329055 (0.0010) [2023-12-26 02:12:39,905][123091] Updated weights for policy 0, policy_version 329065 (0.0010) [2023-12-26 02:12:39,983][123090] Updated weights for policy 1, policy_version 327242 (0.0009) [2023-12-26 02:12:40,046][123090] Updated weights for policy 1, policy_version 327252 (0.0007) [2023-12-26 02:12:40,115][123090] Updated weights for policy 1, policy_version 327262 (0.0008) [2023-12-26 02:12:40,753][123091] Updated weights for policy 0, policy_version 329075 (0.0010) [2023-12-26 02:12:40,803][123091] Updated weights for policy 0, policy_version 329085 (0.0009) [2023-12-26 02:12:40,859][123091] Updated weights for policy 0, policy_version 329095 (0.0010) [2023-12-26 02:12:40,914][123090] Updated weights for policy 1, policy_version 327272 (0.0008) [2023-12-26 02:12:40,966][123090] Updated weights for policy 1, policy_version 327282 (0.0009) [2023-12-26 02:12:41,025][123090] Updated weights for policy 1, policy_version 327292 (0.0009) [2023-12-26 02:12:41,762][123091] Updated weights for policy 0, policy_version 329105 (0.0008) [2023-12-26 02:12:41,828][123091] Updated weights for policy 0, policy_version 329115 (0.0010) [2023-12-26 02:12:41,893][123091] Updated weights for policy 0, policy_version 329125 (0.0009) [2023-12-26 02:12:41,908][123090] Updated weights for policy 1, policy_version 327302 (0.0009) [2023-12-26 02:12:41,963][123091] Updated weights for policy 0, policy_version 329135 (0.0009) [2023-12-26 02:12:41,978][123090] Updated weights for policy 1, policy_version 327312 (0.0007) [2023-12-26 02:12:42,046][123090] Updated weights for policy 1, policy_version 327322 (0.0010) [2023-12-26 02:12:42,796][123091] Updated weights for policy 0, policy_version 329145 (0.0009) [2023-12-26 02:12:42,855][123091] Updated weights for policy 0, policy_version 329155 (0.0009) [2023-12-26 02:12:42,878][123090] Updated weights for policy 1, policy_version 327332 (0.0008) [2023-12-26 02:12:42,902][123091] Updated weights for policy 0, policy_version 329165 (0.0008) [2023-12-26 02:12:42,939][123090] Updated weights for policy 1, policy_version 327342 (0.0009) [2023-12-26 02:12:43,005][123090] Updated weights for policy 1, policy_version 327352 (0.0007) [2023-12-26 02:12:43,698][123090] Updated weights for policy 1, policy_version 327362 (0.0006) [2023-12-26 02:12:43,748][123091] Updated weights for policy 0, policy_version 329175 (0.0009) [2023-12-26 02:12:43,763][123090] Updated weights for policy 1, policy_version 327372 (0.0008) [2023-12-26 02:12:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 168075264. Throughput: 0: 8670.9, 1: 8749.0. Samples: 168076032. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:43,785][121949] Avg episode reward: [(0, '6216.235'), (1, '5185.387')] [2023-12-26 02:12:43,801][123091] Updated weights for policy 0, policy_version 329185 (0.0007) [2023-12-26 02:12:43,828][123090] Updated weights for policy 1, policy_version 327382 (0.0009) [2023-12-26 02:12:43,865][123091] Updated weights for policy 0, policy_version 329195 (0.0008) [2023-12-26 02:12:43,891][123090] Updated weights for policy 1, policy_version 327392 (0.0009) [2023-12-26 02:12:44,651][123091] Updated weights for policy 0, policy_version 329205 (0.0010) [2023-12-26 02:12:44,705][123091] Updated weights for policy 0, policy_version 329215 (0.0009) [2023-12-26 02:12:44,730][123090] Updated weights for policy 1, policy_version 327402 (0.0005) [2023-12-26 02:12:44,757][123091] Updated weights for policy 0, policy_version 329225 (0.0009) [2023-12-26 02:12:44,806][123090] Updated weights for policy 1, policy_version 327412 (0.0007) [2023-12-26 02:12:44,876][123090] Updated weights for policy 1, policy_version 327422 (0.0008) [2023-12-26 02:12:45,645][123091] Updated weights for policy 0, policy_version 329235 (0.0010) [2023-12-26 02:12:45,651][123090] Updated weights for policy 1, policy_version 327432 (0.0008) [2023-12-26 02:12:45,718][123090] Updated weights for policy 1, policy_version 327442 (0.0006) [2023-12-26 02:12:45,719][123091] Updated weights for policy 0, policy_version 329245 (0.0010) [2023-12-26 02:12:45,772][123090] Updated weights for policy 1, policy_version 327452 (0.0006) [2023-12-26 02:12:45,788][123091] Updated weights for policy 0, policy_version 329255 (0.0010) [2023-12-26 02:12:46,552][123090] Updated weights for policy 1, policy_version 327462 (0.0009) [2023-12-26 02:12:46,603][123091] Updated weights for policy 0, policy_version 329265 (0.0008) [2023-12-26 02:12:46,609][123090] Updated weights for policy 1, policy_version 327472 (0.0006) [2023-12-26 02:12:46,659][123090] Updated weights for policy 1, policy_version 327482 (0.0007) [2023-12-26 02:12:46,672][123091] Updated weights for policy 0, policy_version 329275 (0.0008) [2023-12-26 02:12:46,722][123091] Updated weights for policy 0, policy_version 329285 (0.0007) [2023-12-26 02:12:46,783][123091] Updated weights for policy 0, policy_version 329295 (0.0009) [2023-12-26 02:12:47,462][123090] Updated weights for policy 1, policy_version 327492 (0.0010) [2023-12-26 02:12:47,516][123090] Updated weights for policy 1, policy_version 327502 (0.0009) [2023-12-26 02:12:47,569][123090] Updated weights for policy 1, policy_version 327512 (0.0009) [2023-12-26 02:12:47,608][123091] Updated weights for policy 0, policy_version 329305 (0.0007) [2023-12-26 02:12:47,660][123091] Updated weights for policy 0, policy_version 329315 (0.0005) [2023-12-26 02:12:47,719][123091] Updated weights for policy 0, policy_version 329325 (0.0007) [2023-12-26 02:12:48,427][123090] Updated weights for policy 1, policy_version 327522 (0.0008) [2023-12-26 02:12:48,482][123090] Updated weights for policy 1, policy_version 327532 (0.0009) [2023-12-26 02:12:48,527][123091] Updated weights for policy 0, policy_version 329335 (0.0009) [2023-12-26 02:12:48,543][123090] Updated weights for policy 1, policy_version 327542 (0.0007) [2023-12-26 02:12:48,593][123091] Updated weights for policy 0, policy_version 329345 (0.0010) [2023-12-26 02:12:48,610][123090] Updated weights for policy 1, policy_version 327552 (0.0006) [2023-12-26 02:12:48,657][123091] Updated weights for policy 0, policy_version 329355 (0.0008) [2023-12-26 02:12:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 168173568. Throughput: 0: 8650.8, 1: 8687.2. Samples: 168179028. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:48,785][121949] Avg episode reward: [(0, '6158.243'), (1, '5392.890')] [2023-12-26 02:12:49,461][123091] Updated weights for policy 0, policy_version 329365 (0.0006) [2023-12-26 02:12:49,512][123090] Updated weights for policy 1, policy_version 327562 (0.0009) [2023-12-26 02:12:49,535][123091] Updated weights for policy 0, policy_version 329375 (0.0006) [2023-12-26 02:12:49,578][123090] Updated weights for policy 1, policy_version 327572 (0.0008) [2023-12-26 02:12:49,604][123091] Updated weights for policy 0, policy_version 329385 (0.0006) [2023-12-26 02:12:49,644][123090] Updated weights for policy 1, policy_version 327582 (0.0010) [2023-12-26 02:12:50,341][123091] Updated weights for policy 0, policy_version 329395 (0.0007) [2023-12-26 02:12:50,399][123091] Updated weights for policy 0, policy_version 329405 (0.0009) [2023-12-26 02:12:50,461][123091] Updated weights for policy 0, policy_version 329415 (0.0009) [2023-12-26 02:12:50,473][123090] Updated weights for policy 1, policy_version 327592 (0.0009) [2023-12-26 02:12:50,539][123090] Updated weights for policy 1, policy_version 327602 (0.0008) [2023-12-26 02:12:50,612][123090] Updated weights for policy 1, policy_version 327612 (0.0007) [2023-12-26 02:12:51,358][123091] Updated weights for policy 0, policy_version 329425 (0.0008) [2023-12-26 02:12:51,429][123091] Updated weights for policy 0, policy_version 329435 (0.0009) [2023-12-26 02:12:51,481][123091] Updated weights for policy 0, policy_version 329445 (0.0009) [2023-12-26 02:12:51,484][123090] Updated weights for policy 1, policy_version 327622 (0.0009) [2023-12-26 02:12:51,540][123091] Updated weights for policy 0, policy_version 329455 (0.0008) [2023-12-26 02:12:51,547][123090] Updated weights for policy 1, policy_version 327632 (0.0008) [2023-12-26 02:12:51,613][123090] Updated weights for policy 1, policy_version 327642 (0.0010) [2023-12-26 02:12:52,416][123091] Updated weights for policy 0, policy_version 329465 (0.0009) [2023-12-26 02:12:52,481][123091] Updated weights for policy 0, policy_version 329475 (0.0009) [2023-12-26 02:12:52,508][123090] Updated weights for policy 1, policy_version 327652 (0.0009) [2023-12-26 02:12:52,548][123091] Updated weights for policy 0, policy_version 329485 (0.0009) [2023-12-26 02:12:52,576][123090] Updated weights for policy 1, policy_version 327662 (0.0008) [2023-12-26 02:12:52,644][123090] Updated weights for policy 1, policy_version 327672 (0.0009) [2023-12-26 02:12:53,331][123091] Updated weights for policy 0, policy_version 329495 (0.0006) [2023-12-26 02:12:53,381][123091] Updated weights for policy 0, policy_version 329505 (0.0005) [2023-12-26 02:12:53,432][123091] Updated weights for policy 0, policy_version 329515 (0.0005) [2023-12-26 02:12:53,549][123090] Updated weights for policy 1, policy_version 327682 (0.0010) [2023-12-26 02:12:53,615][123090] Updated weights for policy 1, policy_version 327692 (0.0010) [2023-12-26 02:12:53,686][123090] Updated weights for policy 1, policy_version 327702 (0.0010) [2023-12-26 02:12:53,756][123090] Updated weights for policy 1, policy_version 327712 (0.0006) [2023-12-26 02:12:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17339.6, 300 sec: 17716.9). Total num frames: 168255488. Throughput: 0: 8591.0, 1: 8679.6. Samples: 168228916. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:53,786][121949] Avg episode reward: [(0, '6130.910'), (1, '5116.281')] [2023-12-26 02:12:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000329520_84361216.pth... [2023-12-26 02:12:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000327712_83894272.pth... [2023-12-26 02:12:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000326688_83632128.pth [2023-12-26 02:12:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000328496_84099072.pth [2023-12-26 02:12:54,136][123091] Updated weights for policy 0, policy_version 329525 (0.0007) [2023-12-26 02:12:54,208][123091] Updated weights for policy 0, policy_version 329535 (0.0009) [2023-12-26 02:12:54,276][123091] Updated weights for policy 0, policy_version 329545 (0.0006) [2023-12-26 02:12:54,493][123090] Updated weights for policy 1, policy_version 327722 (0.0006) [2023-12-26 02:12:54,562][123090] Updated weights for policy 1, policy_version 327732 (0.0006) [2023-12-26 02:12:54,631][123090] Updated weights for policy 1, policy_version 327742 (0.0007) [2023-12-26 02:12:55,047][123091] Updated weights for policy 0, policy_version 329555 (0.0007) [2023-12-26 02:12:55,110][123091] Updated weights for policy 0, policy_version 329565 (0.0008) [2023-12-26 02:12:55,174][123091] Updated weights for policy 0, policy_version 329575 (0.0007) [2023-12-26 02:12:55,392][123090] Updated weights for policy 1, policy_version 327752 (0.0009) [2023-12-26 02:12:55,444][123090] Updated weights for policy 1, policy_version 327762 (0.0010) [2023-12-26 02:12:55,491][123090] Updated weights for policy 1, policy_version 327772 (0.0010) [2023-12-26 02:12:55,981][123091] Updated weights for policy 0, policy_version 329585 (0.0008) [2023-12-26 02:12:56,047][123091] Updated weights for policy 0, policy_version 329595 (0.0009) [2023-12-26 02:12:56,098][123091] Updated weights for policy 0, policy_version 329606 (0.0010) [2023-12-26 02:12:56,148][123091] Updated weights for policy 0, policy_version 329616 (0.0008) [2023-12-26 02:12:56,330][123090] Updated weights for policy 1, policy_version 327782 (0.0009) [2023-12-26 02:12:56,398][123090] Updated weights for policy 1, policy_version 327792 (0.0009) [2023-12-26 02:12:56,452][123090] Updated weights for policy 1, policy_version 327802 (0.0010) [2023-12-26 02:12:56,884][123091] Updated weights for policy 0, policy_version 329626 (0.0008) [2023-12-26 02:12:56,947][123091] Updated weights for policy 0, policy_version 329636 (0.0009) [2023-12-26 02:12:56,996][123091] Updated weights for policy 0, policy_version 329646 (0.0007) [2023-12-26 02:12:57,301][123090] Updated weights for policy 1, policy_version 327812 (0.0008) [2023-12-26 02:12:57,370][123090] Updated weights for policy 1, policy_version 327822 (0.0005) [2023-12-26 02:12:57,425][123090] Updated weights for policy 1, policy_version 327832 (0.0005) [2023-12-26 02:12:57,699][123091] Updated weights for policy 0, policy_version 329656 (0.0005) [2023-12-26 02:12:57,762][123091] Updated weights for policy 0, policy_version 329666 (0.0011) [2023-12-26 02:12:57,824][123091] Updated weights for policy 0, policy_version 329676 (0.0010) [2023-12-26 02:12:58,229][123090] Updated weights for policy 1, policy_version 327842 (0.0006) [2023-12-26 02:12:58,293][123090] Updated weights for policy 1, policy_version 327852 (0.0008) [2023-12-26 02:12:58,363][123090] Updated weights for policy 1, policy_version 327862 (0.0008) [2023-12-26 02:12:58,433][123090] Updated weights for policy 1, policy_version 327872 (0.0009) [2023-12-26 02:12:58,625][123091] Updated weights for policy 0, policy_version 329686 (0.0009) [2023-12-26 02:12:58,695][123091] Updated weights for policy 0, policy_version 329696 (0.0007) [2023-12-26 02:12:58,773][123091] Updated weights for policy 0, policy_version 329706 (0.0008) [2023-12-26 02:12:58,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 168337408. Throughput: 0: 8681.6, 1: 8696.8. Samples: 168336472. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:12:58,785][121949] Avg episode reward: [(0, '6261.672'), (1, '5203.565')] [2023-12-26 02:12:59,293][123090] Updated weights for policy 1, policy_version 327882 (0.0008) [2023-12-26 02:12:59,368][123090] Updated weights for policy 1, policy_version 327892 (0.0009) [2023-12-26 02:12:59,440][123090] Updated weights for policy 1, policy_version 327902 (0.0009) [2023-12-26 02:12:59,594][123091] Updated weights for policy 0, policy_version 329716 (0.0009) [2023-12-26 02:12:59,651][123091] Updated weights for policy 0, policy_version 329726 (0.0006) [2023-12-26 02:12:59,726][123091] Updated weights for policy 0, policy_version 329736 (0.0006) [2023-12-26 02:13:00,163][123090] Updated weights for policy 1, policy_version 327912 (0.0008) [2023-12-26 02:13:00,228][123090] Updated weights for policy 1, policy_version 327922 (0.0008) [2023-12-26 02:13:00,297][123090] Updated weights for policy 1, policy_version 327932 (0.0005) [2023-12-26 02:13:00,437][123091] Updated weights for policy 0, policy_version 329746 (0.0007) [2023-12-26 02:13:00,502][123091] Updated weights for policy 0, policy_version 329756 (0.0005) [2023-12-26 02:13:00,566][123091] Updated weights for policy 0, policy_version 329766 (0.0005) [2023-12-26 02:13:00,617][123091] Updated weights for policy 0, policy_version 329776 (0.0005) [2023-12-26 02:13:00,964][123090] Updated weights for policy 1, policy_version 327942 (0.0007) [2023-12-26 02:13:01,017][123090] Updated weights for policy 1, policy_version 327953 (0.0009) [2023-12-26 02:13:01,087][123090] Updated weights for policy 1, policy_version 327963 (0.0010) [2023-12-26 02:13:01,303][123091] Updated weights for policy 0, policy_version 329786 (0.0009) [2023-12-26 02:13:01,374][123091] Updated weights for policy 0, policy_version 329796 (0.0008) [2023-12-26 02:13:01,445][123091] Updated weights for policy 0, policy_version 329806 (0.0005) [2023-12-26 02:13:01,960][123090] Updated weights for policy 1, policy_version 327973 (0.0008) [2023-12-26 02:13:02,024][123090] Updated weights for policy 1, policy_version 327983 (0.0007) [2023-12-26 02:13:02,095][123090] Updated weights for policy 1, policy_version 327993 (0.0009) [2023-12-26 02:13:02,133][123091] Updated weights for policy 0, policy_version 329816 (0.0005) [2023-12-26 02:13:02,186][123091] Updated weights for policy 0, policy_version 329826 (0.0006) [2023-12-26 02:13:02,238][123091] Updated weights for policy 0, policy_version 329836 (0.0005) [2023-12-26 02:13:02,868][123090] Updated weights for policy 1, policy_version 328003 (0.0008) [2023-12-26 02:13:02,922][123090] Updated weights for policy 1, policy_version 328013 (0.0005) [2023-12-26 02:13:02,972][123091] Updated weights for policy 0, policy_version 329846 (0.0009) [2023-12-26 02:13:02,988][123090] Updated weights for policy 1, policy_version 328023 (0.0005) [2023-12-26 02:13:03,030][123091] Updated weights for policy 0, policy_version 329856 (0.0010) [2023-12-26 02:13:03,078][123091] Updated weights for policy 0, policy_version 329866 (0.0010) [2023-12-26 02:13:03,612][123090] Updated weights for policy 1, policy_version 328033 (0.0007) [2023-12-26 02:13:03,671][123090] Updated weights for policy 1, policy_version 328043 (0.0006) [2023-12-26 02:13:03,721][123090] Updated weights for policy 1, policy_version 328053 (0.0005) [2023-12-26 02:13:03,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 168427520. Throughput: 0: 8808.9, 1: 8709.4. Samples: 168446152. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:03,784][121949] Avg episode reward: [(0, '6385.908'), (1, '5345.513')] [2023-12-26 02:13:03,789][123090] Updated weights for policy 1, policy_version 328063 (0.0007) [2023-12-26 02:13:03,835][123091] Updated weights for policy 0, policy_version 329876 (0.0010) [2023-12-26 02:13:03,896][123091] Updated weights for policy 0, policy_version 329886 (0.0007) [2023-12-26 02:13:03,950][123091] Updated weights for policy 0, policy_version 329896 (0.0005) [2023-12-26 02:13:04,580][123090] Updated weights for policy 1, policy_version 328073 (0.0010) [2023-12-26 02:13:04,650][123090] Updated weights for policy 1, policy_version 328083 (0.0008) [2023-12-26 02:13:04,716][123090] Updated weights for policy 1, policy_version 328093 (0.0010) [2023-12-26 02:13:04,759][123091] Updated weights for policy 0, policy_version 329906 (0.0008) [2023-12-26 02:13:04,824][123091] Updated weights for policy 0, policy_version 329916 (0.0010) [2023-12-26 02:13:04,892][123091] Updated weights for policy 0, policy_version 329926 (0.0009) [2023-12-26 02:13:04,957][123091] Updated weights for policy 0, policy_version 329936 (0.0010) [2023-12-26 02:13:05,515][123090] Updated weights for policy 1, policy_version 328103 (0.0007) [2023-12-26 02:13:05,581][123090] Updated weights for policy 1, policy_version 328113 (0.0005) [2023-12-26 02:13:05,639][123091] Updated weights for policy 0, policy_version 329946 (0.0008) [2023-12-26 02:13:05,642][123090] Updated weights for policy 1, policy_version 328123 (0.0005) [2023-12-26 02:13:05,697][123091] Updated weights for policy 0, policy_version 329956 (0.0008) [2023-12-26 02:13:05,754][123091] Updated weights for policy 0, policy_version 329966 (0.0010) [2023-12-26 02:13:06,311][123090] Updated weights for policy 1, policy_version 328133 (0.0008) [2023-12-26 02:13:06,375][123090] Updated weights for policy 1, policy_version 328143 (0.0009) [2023-12-26 02:13:06,446][123090] Updated weights for policy 1, policy_version 328153 (0.0009) [2023-12-26 02:13:06,620][123091] Updated weights for policy 0, policy_version 329976 (0.0009) [2023-12-26 02:13:06,686][123091] Updated weights for policy 0, policy_version 329986 (0.0010) [2023-12-26 02:13:06,757][123091] Updated weights for policy 0, policy_version 329996 (0.0010) [2023-12-26 02:13:07,265][123090] Updated weights for policy 1, policy_version 328163 (0.0009) [2023-12-26 02:13:07,316][123090] Updated weights for policy 1, policy_version 328173 (0.0008) [2023-12-26 02:13:07,387][123090] Updated weights for policy 1, policy_version 328183 (0.0009) [2023-12-26 02:13:07,540][123091] Updated weights for policy 0, policy_version 330006 (0.0010) [2023-12-26 02:13:07,598][123091] Updated weights for policy 0, policy_version 330016 (0.0010) [2023-12-26 02:13:07,656][123091] Updated weights for policy 0, policy_version 330026 (0.0010) [2023-12-26 02:13:08,124][123090] Updated weights for policy 1, policy_version 328193 (0.0006) [2023-12-26 02:13:08,190][123090] Updated weights for policy 1, policy_version 328203 (0.0005) [2023-12-26 02:13:08,256][123090] Updated weights for policy 1, policy_version 328213 (0.0005) [2023-12-26 02:13:08,330][123090] Updated weights for policy 1, policy_version 328223 (0.0006) [2023-12-26 02:13:08,556][123091] Updated weights for policy 0, policy_version 330036 (0.0010) [2023-12-26 02:13:08,619][123091] Updated weights for policy 0, policy_version 330046 (0.0010) [2023-12-26 02:13:08,680][123091] Updated weights for policy 0, policy_version 330056 (0.0009) [2023-12-26 02:13:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 168525824. Throughput: 0: 8834.3, 1: 8746.0. Samples: 168500060. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:08,785][121949] Avg episode reward: [(0, '6289.694'), (1, '5184.588')] [2023-12-26 02:13:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000330064_84500480.pth... [2023-12-26 02:13:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000328224_84025344.pth... [2023-12-26 02:13:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000327200_83763200.pth [2023-12-26 02:13:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000329040_84238336.pth [2023-12-26 02:13:09,069][123090] Updated weights for policy 1, policy_version 328233 (0.0007) [2023-12-26 02:13:09,131][123090] Updated weights for policy 1, policy_version 328243 (0.0009) [2023-12-26 02:13:09,185][123090] Updated weights for policy 1, policy_version 328253 (0.0009) [2023-12-26 02:13:09,552][123091] Updated weights for policy 0, policy_version 330066 (0.0010) [2023-12-26 02:13:09,617][123091] Updated weights for policy 0, policy_version 330076 (0.0009) [2023-12-26 02:13:09,682][123091] Updated weights for policy 0, policy_version 330086 (0.0010) [2023-12-26 02:13:09,744][123091] Updated weights for policy 0, policy_version 330096 (0.0010) [2023-12-26 02:13:10,111][123090] Updated weights for policy 1, policy_version 328263 (0.0009) [2023-12-26 02:13:10,176][123090] Updated weights for policy 1, policy_version 328273 (0.0010) [2023-12-26 02:13:10,245][123090] Updated weights for policy 1, policy_version 328283 (0.0009) [2023-12-26 02:13:10,611][123091] Updated weights for policy 0, policy_version 330106 (0.0009) [2023-12-26 02:13:10,677][123091] Updated weights for policy 0, policy_version 330116 (0.0010) [2023-12-26 02:13:10,739][123091] Updated weights for policy 0, policy_version 330126 (0.0006) [2023-12-26 02:13:11,044][123090] Updated weights for policy 1, policy_version 328295 (0.0008) [2023-12-26 02:13:11,124][123090] Updated weights for policy 1, policy_version 328305 (0.0006) [2023-12-26 02:13:11,208][123090] Updated weights for policy 1, policy_version 328315 (0.0008) [2023-12-26 02:13:11,539][123091] Updated weights for policy 0, policy_version 330136 (0.0008) [2023-12-26 02:13:11,598][123091] Updated weights for policy 0, policy_version 330146 (0.0008) [2023-12-26 02:13:11,673][123091] Updated weights for policy 0, policy_version 330156 (0.0008) [2023-12-26 02:13:12,044][123090] Updated weights for policy 1, policy_version 328325 (0.0009) [2023-12-26 02:13:12,097][123090] Updated weights for policy 1, policy_version 328335 (0.0011) [2023-12-26 02:13:12,161][123090] Updated weights for policy 1, policy_version 328345 (0.0010) [2023-12-26 02:13:12,464][123091] Updated weights for policy 0, policy_version 330166 (0.0009) [2023-12-26 02:13:12,512][123091] Updated weights for policy 0, policy_version 330176 (0.0009) [2023-12-26 02:13:12,578][123091] Updated weights for policy 0, policy_version 330186 (0.0009) [2023-12-26 02:13:12,980][123090] Updated weights for policy 1, policy_version 328355 (0.0010) [2023-12-26 02:13:13,047][123090] Updated weights for policy 1, policy_version 328365 (0.0011) [2023-12-26 02:13:13,118][123090] Updated weights for policy 1, policy_version 328375 (0.0009) [2023-12-26 02:13:13,402][123091] Updated weights for policy 0, policy_version 330196 (0.0006) [2023-12-26 02:13:13,471][123091] Updated weights for policy 0, policy_version 330206 (0.0005) [2023-12-26 02:13:13,539][123091] Updated weights for policy 0, policy_version 330216 (0.0005) [2023-12-26 02:13:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 168607744. Throughput: 0: 8728.6, 1: 8673.9. Samples: 168601620. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:13,785][121949] Avg episode reward: [(0, '6188.652'), (1, '5235.065')] [2023-12-26 02:13:13,825][123090] Updated weights for policy 1, policy_version 328385 (0.0007) [2023-12-26 02:13:13,880][123090] Updated weights for policy 1, policy_version 328395 (0.0006) [2023-12-26 02:13:13,931][123090] Updated weights for policy 1, policy_version 328405 (0.0006) [2023-12-26 02:13:13,989][123090] Updated weights for policy 1, policy_version 328415 (0.0005) [2023-12-26 02:13:14,174][123091] Updated weights for policy 0, policy_version 330226 (0.0005) [2023-12-26 02:13:14,233][123091] Updated weights for policy 0, policy_version 330236 (0.0006) [2023-12-26 02:13:14,287][123091] Updated weights for policy 0, policy_version 330246 (0.0005) [2023-12-26 02:13:14,335][123091] Updated weights for policy 0, policy_version 330256 (0.0005) [2023-12-26 02:13:14,672][123090] Updated weights for policy 1, policy_version 328425 (0.0008) [2023-12-26 02:13:14,720][123090] Updated weights for policy 1, policy_version 328435 (0.0009) [2023-12-26 02:13:14,774][123090] Updated weights for policy 1, policy_version 328445 (0.0008) [2023-12-26 02:13:15,092][123091] Updated weights for policy 0, policy_version 330266 (0.0011) [2023-12-26 02:13:15,148][123091] Updated weights for policy 0, policy_version 330276 (0.0011) [2023-12-26 02:13:15,209][123091] Updated weights for policy 0, policy_version 330286 (0.0011) [2023-12-26 02:13:15,677][123090] Updated weights for policy 1, policy_version 328455 (0.0009) [2023-12-26 02:13:15,737][123090] Updated weights for policy 1, policy_version 328465 (0.0009) [2023-12-26 02:13:15,801][123090] Updated weights for policy 1, policy_version 328475 (0.0008) [2023-12-26 02:13:16,064][123091] Updated weights for policy 0, policy_version 330296 (0.0010) [2023-12-26 02:13:16,130][123091] Updated weights for policy 0, policy_version 330306 (0.0011) [2023-12-26 02:13:16,192][123091] Updated weights for policy 0, policy_version 330316 (0.0010) [2023-12-26 02:13:16,623][123090] Updated weights for policy 1, policy_version 328485 (0.0008) [2023-12-26 02:13:16,679][123090] Updated weights for policy 1, policy_version 328495 (0.0010) [2023-12-26 02:13:16,743][123090] Updated weights for policy 1, policy_version 328505 (0.0008) [2023-12-26 02:13:16,951][123091] Updated weights for policy 0, policy_version 330326 (0.0005) [2023-12-26 02:13:17,013][123091] Updated weights for policy 0, policy_version 330336 (0.0005) [2023-12-26 02:13:17,079][123091] Updated weights for policy 0, policy_version 330346 (0.0005) [2023-12-26 02:13:17,491][123090] Updated weights for policy 1, policy_version 328515 (0.0006) [2023-12-26 02:13:17,548][123090] Updated weights for policy 1, policy_version 328525 (0.0005) [2023-12-26 02:13:17,596][123090] Updated weights for policy 1, policy_version 328535 (0.0005) [2023-12-26 02:13:17,652][123091] Updated weights for policy 0, policy_version 330356 (0.0006) [2023-12-26 02:13:17,711][123091] Updated weights for policy 0, policy_version 330366 (0.0010) [2023-12-26 02:13:17,774][123091] Updated weights for policy 0, policy_version 330376 (0.0010) [2023-12-26 02:13:18,263][123090] Updated weights for policy 1, policy_version 328545 (0.0005) [2023-12-26 02:13:18,331][123090] Updated weights for policy 1, policy_version 328555 (0.0006) [2023-12-26 02:13:18,392][123090] Updated weights for policy 1, policy_version 328565 (0.0008) [2023-12-26 02:13:18,447][123090] Updated weights for policy 1, policy_version 328575 (0.0008) [2023-12-26 02:13:18,596][123091] Updated weights for policy 0, policy_version 330386 (0.0010) [2023-12-26 02:13:18,662][123091] Updated weights for policy 0, policy_version 330396 (0.0010) [2023-12-26 02:13:18,725][123091] Updated weights for policy 0, policy_version 330406 (0.0011) [2023-12-26 02:13:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 168706048. Throughput: 0: 8780.7, 1: 8752.4. Samples: 168713440. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:18,784][123091] Updated weights for policy 0, policy_version 330416 (0.0011) [2023-12-26 02:13:18,785][121949] Avg episode reward: [(0, '6193.250'), (1, '5506.022')] [2023-12-26 02:13:19,128][123090] Updated weights for policy 1, policy_version 328585 (0.0010) [2023-12-26 02:13:19,197][123090] Updated weights for policy 1, policy_version 328595 (0.0010) [2023-12-26 02:13:19,266][123090] Updated weights for policy 1, policy_version 328605 (0.0011) [2023-12-26 02:13:19,560][123091] Updated weights for policy 0, policy_version 330426 (0.0006) [2023-12-26 02:13:19,615][123091] Updated weights for policy 0, policy_version 330436 (0.0006) [2023-12-26 02:13:19,679][123091] Updated weights for policy 0, policy_version 330446 (0.0006) [2023-12-26 02:13:20,000][123090] Updated weights for policy 1, policy_version 328615 (0.0009) [2023-12-26 02:13:20,055][123090] Updated weights for policy 1, policy_version 328625 (0.0009) [2023-12-26 02:13:20,134][123090] Updated weights for policy 1, policy_version 328635 (0.0006) [2023-12-26 02:13:20,439][123091] Updated weights for policy 0, policy_version 330456 (0.0008) [2023-12-26 02:13:20,501][123091] Updated weights for policy 0, policy_version 330466 (0.0005) [2023-12-26 02:13:20,566][123091] Updated weights for policy 0, policy_version 330476 (0.0008) [2023-12-26 02:13:20,966][123090] Updated weights for policy 1, policy_version 328645 (0.0010) [2023-12-26 02:13:21,036][123090] Updated weights for policy 1, policy_version 328655 (0.0011) [2023-12-26 02:13:21,106][123090] Updated weights for policy 1, policy_version 328665 (0.0010) [2023-12-26 02:13:21,357][123091] Updated weights for policy 0, policy_version 330486 (0.0010) [2023-12-26 02:13:21,425][123091] Updated weights for policy 0, policy_version 330496 (0.0009) [2023-12-26 02:13:21,480][123091] Updated weights for policy 0, policy_version 330506 (0.0009) [2023-12-26 02:13:21,965][123090] Updated weights for policy 1, policy_version 328675 (0.0009) [2023-12-26 02:13:22,025][123090] Updated weights for policy 1, policy_version 328685 (0.0010) [2023-12-26 02:13:22,088][123090] Updated weights for policy 1, policy_version 328695 (0.0010) [2023-12-26 02:13:22,351][123091] Updated weights for policy 0, policy_version 330516 (0.0009) [2023-12-26 02:13:22,420][123091] Updated weights for policy 0, policy_version 330526 (0.0009) [2023-12-26 02:13:22,489][123091] Updated weights for policy 0, policy_version 330536 (0.0009) [2023-12-26 02:13:22,913][123090] Updated weights for policy 1, policy_version 328705 (0.0011) [2023-12-26 02:13:22,978][123090] Updated weights for policy 1, policy_version 328715 (0.0010) [2023-12-26 02:13:23,043][123090] Updated weights for policy 1, policy_version 328725 (0.0008) [2023-12-26 02:13:23,118][123090] Updated weights for policy 1, policy_version 328735 (0.0005) [2023-12-26 02:13:23,289][123091] Updated weights for policy 0, policy_version 330546 (0.0009) [2023-12-26 02:13:23,363][123091] Updated weights for policy 0, policy_version 330556 (0.0005) [2023-12-26 02:13:23,435][123091] Updated weights for policy 0, policy_version 330566 (0.0006) [2023-12-26 02:13:23,494][123091] Updated weights for policy 0, policy_version 330576 (0.0005) [2023-12-26 02:13:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 168787968. Throughput: 0: 8812.2, 1: 8738.0. Samples: 168766252. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:23,786][121949] Avg episode reward: [(0, '6135.494'), (1, '5646.429')] [2023-12-26 02:13:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000330576_84631552.pth... [2023-12-26 02:13:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000329520_84361216.pth [2023-12-26 02:13:23,816][123090] Updated weights for policy 1, policy_version 328745 (0.0005) [2023-12-26 02:13:23,882][123090] Updated weights for policy 1, policy_version 328755 (0.0009) [2023-12-26 02:13:23,953][123090] Updated weights for policy 1, policy_version 328765 (0.0007) [2023-12-26 02:13:23,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000328768_84164608.pth... [2023-12-26 02:13:23,969][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000327712_83894272.pth [2023-12-26 02:13:24,208][123091] Updated weights for policy 0, policy_version 330586 (0.0010) [2023-12-26 02:13:24,274][123091] Updated weights for policy 0, policy_version 330596 (0.0011) [2023-12-26 02:13:24,340][123091] Updated weights for policy 0, policy_version 330606 (0.0011) [2023-12-26 02:13:24,654][123090] Updated weights for policy 1, policy_version 328775 (0.0010) [2023-12-26 02:13:24,708][123090] Updated weights for policy 1, policy_version 328785 (0.0010) [2023-12-26 02:13:24,759][123090] Updated weights for policy 1, policy_version 328795 (0.0010) [2023-12-26 02:13:25,193][123091] Updated weights for policy 0, policy_version 330616 (0.0009) [2023-12-26 02:13:25,264][123091] Updated weights for policy 0, policy_version 330626 (0.0009) [2023-12-26 02:13:25,335][123091] Updated weights for policy 0, policy_version 330636 (0.0009) [2023-12-26 02:13:25,557][123090] Updated weights for policy 1, policy_version 328805 (0.0009) [2023-12-26 02:13:25,620][123090] Updated weights for policy 1, policy_version 328815 (0.0006) [2023-12-26 02:13:25,669][123090] Updated weights for policy 1, policy_version 328825 (0.0005) [2023-12-26 02:13:26,118][123091] Updated weights for policy 0, policy_version 330646 (0.0009) [2023-12-26 02:13:26,162][123091] Updated weights for policy 0, policy_version 330656 (0.0010) [2023-12-26 02:13:26,217][123091] Updated weights for policy 0, policy_version 330666 (0.0010) [2023-12-26 02:13:26,315][123090] Updated weights for policy 1, policy_version 328835 (0.0005) [2023-12-26 02:13:26,370][123090] Updated weights for policy 1, policy_version 328845 (0.0005) [2023-12-26 02:13:26,426][123090] Updated weights for policy 1, policy_version 328855 (0.0006) [2023-12-26 02:13:27,110][123091] Updated weights for policy 0, policy_version 330676 (0.0010) [2023-12-26 02:13:27,165][123090] Updated weights for policy 1, policy_version 328865 (0.0008) [2023-12-26 02:13:27,167][123091] Updated weights for policy 0, policy_version 330686 (0.0009) [2023-12-26 02:13:27,220][123091] Updated weights for policy 0, policy_version 330696 (0.0009) [2023-12-26 02:13:27,222][123090] Updated weights for policy 1, policy_version 328875 (0.0008) [2023-12-26 02:13:27,275][123090] Updated weights for policy 1, policy_version 328885 (0.0009) [2023-12-26 02:13:27,336][123090] Updated weights for policy 1, policy_version 328895 (0.0009) [2023-12-26 02:13:27,956][123091] Updated weights for policy 0, policy_version 330706 (0.0007) [2023-12-26 02:13:28,010][123091] Updated weights for policy 0, policy_version 330716 (0.0005) [2023-12-26 02:13:28,057][123091] Updated weights for policy 0, policy_version 330726 (0.0005) [2023-12-26 02:13:28,115][123091] Updated weights for policy 0, policy_version 330736 (0.0005) [2023-12-26 02:13:28,146][123090] Updated weights for policy 1, policy_version 328905 (0.0006) [2023-12-26 02:13:28,216][123090] Updated weights for policy 1, policy_version 328915 (0.0005) [2023-12-26 02:13:28,272][123090] Updated weights for policy 1, policy_version 328925 (0.0005) [2023-12-26 02:13:28,755][123091] Updated weights for policy 0, policy_version 330746 (0.0005) [2023-12-26 02:13:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 168878080. Throughput: 0: 8862.6, 1: 8867.2. Samples: 168873872. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:28,785][121949] Avg episode reward: [(0, '6044.540'), (1, '5511.527')] [2023-12-26 02:13:28,833][123091] Updated weights for policy 0, policy_version 330756 (0.0005) [2023-12-26 02:13:28,901][123091] Updated weights for policy 0, policy_version 330766 (0.0007) [2023-12-26 02:13:28,921][123090] Updated weights for policy 1, policy_version 328935 (0.0006) [2023-12-26 02:13:28,988][123090] Updated weights for policy 1, policy_version 328945 (0.0007) [2023-12-26 02:13:29,049][123090] Updated weights for policy 1, policy_version 328955 (0.0009) [2023-12-26 02:13:29,699][123091] Updated weights for policy 0, policy_version 330776 (0.0009) [2023-12-26 02:13:29,745][123090] Updated weights for policy 1, policy_version 328965 (0.0007) [2023-12-26 02:13:29,749][123091] Updated weights for policy 0, policy_version 330787 (0.0009) [2023-12-26 02:13:29,799][123091] Updated weights for policy 0, policy_version 330798 (0.0009) [2023-12-26 02:13:29,809][123090] Updated weights for policy 1, policy_version 328975 (0.0007) [2023-12-26 02:13:29,876][123090] Updated weights for policy 1, policy_version 328985 (0.0010) [2023-12-26 02:13:30,602][123090] Updated weights for policy 1, policy_version 328995 (0.0009) [2023-12-26 02:13:30,648][123090] Updated weights for policy 1, policy_version 329005 (0.0008) [2023-12-26 02:13:30,687][123091] Updated weights for policy 0, policy_version 330808 (0.0007) [2023-12-26 02:13:30,698][123090] Updated weights for policy 1, policy_version 329015 (0.0009) [2023-12-26 02:13:30,739][123091] Updated weights for policy 0, policy_version 330818 (0.0009) [2023-12-26 02:13:30,796][123091] Updated weights for policy 0, policy_version 330828 (0.0009) [2023-12-26 02:13:31,562][123090] Updated weights for policy 1, policy_version 329025 (0.0007) [2023-12-26 02:13:31,585][123091] Updated weights for policy 0, policy_version 330838 (0.0007) [2023-12-26 02:13:31,627][123090] Updated weights for policy 1, policy_version 329035 (0.0010) [2023-12-26 02:13:31,661][123091] Updated weights for policy 0, policy_version 330848 (0.0007) [2023-12-26 02:13:31,696][123090] Updated weights for policy 1, policy_version 329045 (0.0008) [2023-12-26 02:13:31,721][123091] Updated weights for policy 0, policy_version 330858 (0.0007) [2023-12-26 02:13:31,762][123090] Updated weights for policy 1, policy_version 329055 (0.0009) [2023-12-26 02:13:32,472][123091] Updated weights for policy 0, policy_version 330868 (0.0006) [2023-12-26 02:13:32,523][123091] Updated weights for policy 0, policy_version 330878 (0.0005) [2023-12-26 02:13:32,552][123090] Updated weights for policy 1, policy_version 329065 (0.0011) [2023-12-26 02:13:32,589][123091] Updated weights for policy 0, policy_version 330888 (0.0008) [2023-12-26 02:13:32,615][123090] Updated weights for policy 1, policy_version 329075 (0.0010) [2023-12-26 02:13:32,662][123090] Updated weights for policy 1, policy_version 329085 (0.0010) [2023-12-26 02:13:33,223][123091] Updated weights for policy 0, policy_version 330898 (0.0008) [2023-12-26 02:13:33,282][123091] Updated weights for policy 0, policy_version 330908 (0.0005) [2023-12-26 02:13:33,320][123090] Updated weights for policy 1, policy_version 329095 (0.0010) [2023-12-26 02:13:33,331][123091] Updated weights for policy 0, policy_version 330918 (0.0007) [2023-12-26 02:13:33,369][123090] Updated weights for policy 1, policy_version 329105 (0.0006) [2023-12-26 02:13:33,380][123091] Updated weights for policy 0, policy_version 330928 (0.0009) [2023-12-26 02:13:33,417][123090] Updated weights for policy 1, policy_version 329115 (0.0008) [2023-12-26 02:13:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 168976384. Throughput: 0: 8977.7, 1: 8951.0. Samples: 168985824. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:33,786][121949] Avg episode reward: [(0, '6140.956'), (1, '5552.650')] [2023-12-26 02:13:34,065][123091] Updated weights for policy 0, policy_version 330938 (0.0005) [2023-12-26 02:13:34,120][123091] Updated weights for policy 0, policy_version 330948 (0.0006) [2023-12-26 02:13:34,131][123090] Updated weights for policy 1, policy_version 329125 (0.0009) [2023-12-26 02:13:34,176][123091] Updated weights for policy 0, policy_version 330958 (0.0008) [2023-12-26 02:13:34,196][123090] Updated weights for policy 1, policy_version 329135 (0.0009) [2023-12-26 02:13:34,258][123090] Updated weights for policy 1, policy_version 329145 (0.0009) [2023-12-26 02:13:34,971][123091] Updated weights for policy 0, policy_version 330968 (0.0008) [2023-12-26 02:13:34,982][123090] Updated weights for policy 1, policy_version 329155 (0.0007) [2023-12-26 02:13:35,031][123091] Updated weights for policy 0, policy_version 330978 (0.0008) [2023-12-26 02:13:35,046][123090] Updated weights for policy 1, policy_version 329165 (0.0007) [2023-12-26 02:13:35,078][123091] Updated weights for policy 0, policy_version 330988 (0.0007) [2023-12-26 02:13:35,123][123090] Updated weights for policy 1, policy_version 329175 (0.0005) [2023-12-26 02:13:35,731][123090] Updated weights for policy 1, policy_version 329185 (0.0005) [2023-12-26 02:13:35,746][123091] Updated weights for policy 0, policy_version 330998 (0.0007) [2023-12-26 02:13:35,783][123090] Updated weights for policy 1, policy_version 329195 (0.0007) [2023-12-26 02:13:35,806][123091] Updated weights for policy 0, policy_version 331008 (0.0008) [2023-12-26 02:13:35,846][123090] Updated weights for policy 1, policy_version 329205 (0.0008) [2023-12-26 02:13:35,859][123091] Updated weights for policy 0, policy_version 331018 (0.0008) [2023-12-26 02:13:35,898][123090] Updated weights for policy 1, policy_version 329215 (0.0008) [2023-12-26 02:13:36,666][123091] Updated weights for policy 0, policy_version 331028 (0.0009) [2023-12-26 02:13:36,731][123091] Updated weights for policy 0, policy_version 331038 (0.0005) [2023-12-26 02:13:36,759][123090] Updated weights for policy 1, policy_version 329225 (0.0008) [2023-12-26 02:13:36,797][123091] Updated weights for policy 0, policy_version 331048 (0.0007) [2023-12-26 02:13:36,822][123090] Updated weights for policy 1, policy_version 329235 (0.0005) [2023-12-26 02:13:36,895][123090] Updated weights for policy 1, policy_version 329245 (0.0005) [2023-12-26 02:13:37,604][123091] Updated weights for policy 0, policy_version 331058 (0.0008) [2023-12-26 02:13:37,665][123091] Updated weights for policy 0, policy_version 331068 (0.0010) [2023-12-26 02:13:37,684][123090] Updated weights for policy 1, policy_version 329255 (0.0008) [2023-12-26 02:13:37,722][123091] Updated weights for policy 0, policy_version 331078 (0.0009) [2023-12-26 02:13:37,750][123090] Updated weights for policy 1, policy_version 329265 (0.0008) [2023-12-26 02:13:37,781][123091] Updated weights for policy 0, policy_version 331088 (0.0007) [2023-12-26 02:13:37,817][123090] Updated weights for policy 1, policy_version 329275 (0.0009) [2023-12-26 02:13:38,602][123091] Updated weights for policy 0, policy_version 331098 (0.0011) [2023-12-26 02:13:38,646][123090] Updated weights for policy 1, policy_version 329285 (0.0010) [2023-12-26 02:13:38,662][123091] Updated weights for policy 0, policy_version 331108 (0.0011) [2023-12-26 02:13:38,711][123090] Updated weights for policy 1, policy_version 329295 (0.0007) [2023-12-26 02:13:38,724][123091] Updated weights for policy 0, policy_version 331118 (0.0011) [2023-12-26 02:13:38,769][123090] Updated weights for policy 1, policy_version 329305 (0.0009) [2023-12-26 02:13:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 169066496. Throughput: 0: 9047.1, 1: 9048.9. Samples: 169043228. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:38,785][121949] Avg episode reward: [(0, '6224.793'), (1, '5730.404')] [2023-12-26 02:13:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000331120_84770816.pth... [2023-12-26 02:13:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000330064_84500480.pth [2023-12-26 02:13:38,802][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000329312_84303872.pth... [2023-12-26 02:13:38,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000328224_84025344.pth [2023-12-26 02:13:39,582][123091] Updated weights for policy 0, policy_version 331128 (0.0009) [2023-12-26 02:13:39,596][123090] Updated weights for policy 1, policy_version 329315 (0.0008) [2023-12-26 02:13:39,635][123091] Updated weights for policy 0, policy_version 331139 (0.0010) [2023-12-26 02:13:39,663][123090] Updated weights for policy 1, policy_version 329325 (0.0007) [2023-12-26 02:13:39,708][123091] Updated weights for policy 0, policy_version 331149 (0.0009) [2023-12-26 02:13:39,736][123090] Updated weights for policy 1, policy_version 329335 (0.0006) [2023-12-26 02:13:40,507][123090] Updated weights for policy 1, policy_version 329345 (0.0006) [2023-12-26 02:13:40,556][123091] Updated weights for policy 0, policy_version 331159 (0.0009) [2023-12-26 02:13:40,569][123090] Updated weights for policy 1, policy_version 329355 (0.0006) [2023-12-26 02:13:40,615][123091] Updated weights for policy 0, policy_version 331169 (0.0010) [2023-12-26 02:13:40,636][123090] Updated weights for policy 1, policy_version 329365 (0.0009) [2023-12-26 02:13:40,666][123091] Updated weights for policy 0, policy_version 331179 (0.0007) [2023-12-26 02:13:40,700][123090] Updated weights for policy 1, policy_version 329375 (0.0011) [2023-12-26 02:13:41,453][123091] Updated weights for policy 0, policy_version 331189 (0.0007) [2023-12-26 02:13:41,523][123091] Updated weights for policy 0, policy_version 331199 (0.0006) [2023-12-26 02:13:41,551][123090] Updated weights for policy 1, policy_version 329385 (0.0011) [2023-12-26 02:13:41,591][123091] Updated weights for policy 0, policy_version 331209 (0.0006) [2023-12-26 02:13:41,616][123090] Updated weights for policy 1, policy_version 329395 (0.0011) [2023-12-26 02:13:41,684][123090] Updated weights for policy 1, policy_version 329405 (0.0010) [2023-12-26 02:13:42,331][123091] Updated weights for policy 0, policy_version 331219 (0.0008) [2023-12-26 02:13:42,402][123091] Updated weights for policy 0, policy_version 331229 (0.0011) [2023-12-26 02:13:42,465][123091] Updated weights for policy 0, policy_version 331239 (0.0007) [2023-12-26 02:13:42,551][123090] Updated weights for policy 1, policy_version 329415 (0.0008) [2023-12-26 02:13:42,619][123090] Updated weights for policy 1, policy_version 329425 (0.0006) [2023-12-26 02:13:42,680][123090] Updated weights for policy 1, policy_version 329435 (0.0008) [2023-12-26 02:13:43,176][123091] Updated weights for policy 0, policy_version 331249 (0.0008) [2023-12-26 02:13:43,242][123091] Updated weights for policy 0, policy_version 331259 (0.0008) [2023-12-26 02:13:43,311][123091] Updated weights for policy 0, policy_version 331269 (0.0008) [2023-12-26 02:13:43,344][123090] Updated weights for policy 1, policy_version 329445 (0.0010) [2023-12-26 02:13:43,367][123091] Updated weights for policy 0, policy_version 331279 (0.0006) [2023-12-26 02:13:43,405][123090] Updated weights for policy 1, policy_version 329455 (0.0009) [2023-12-26 02:13:43,463][123090] Updated weights for policy 1, policy_version 329465 (0.0009) [2023-12-26 02:13:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 169156608. Throughput: 0: 8966.3, 1: 9023.6. Samples: 169146016. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:43,785][121949] Avg episode reward: [(0, '6201.214'), (1, '5668.082')] [2023-12-26 02:13:44,063][123091] Updated weights for policy 0, policy_version 331289 (0.0009) [2023-12-26 02:13:44,119][123091] Updated weights for policy 0, policy_version 331299 (0.0009) [2023-12-26 02:13:44,168][123091] Updated weights for policy 0, policy_version 331309 (0.0009) [2023-12-26 02:13:44,324][123090] Updated weights for policy 1, policy_version 329475 (0.0008) [2023-12-26 02:13:44,394][123090] Updated weights for policy 1, policy_version 329485 (0.0005) [2023-12-26 02:13:44,455][123090] Updated weights for policy 1, policy_version 329495 (0.0006) [2023-12-26 02:13:44,896][123091] Updated weights for policy 0, policy_version 331320 (0.0007) [2023-12-26 02:13:44,962][123091] Updated weights for policy 0, policy_version 331330 (0.0006) [2023-12-26 02:13:45,036][123091] Updated weights for policy 0, policy_version 331340 (0.0007) [2023-12-26 02:13:45,192][123090] Updated weights for policy 1, policy_version 329505 (0.0005) [2023-12-26 02:13:45,261][123090] Updated weights for policy 1, policy_version 329515 (0.0009) [2023-12-26 02:13:45,322][123090] Updated weights for policy 1, policy_version 329525 (0.0009) [2023-12-26 02:13:45,374][123090] Updated weights for policy 1, policy_version 329535 (0.0008) [2023-12-26 02:13:45,764][123091] Updated weights for policy 0, policy_version 331350 (0.0010) [2023-12-26 02:13:45,820][123091] Updated weights for policy 0, policy_version 331360 (0.0010) [2023-12-26 02:13:45,873][123091] Updated weights for policy 0, policy_version 331370 (0.0006) [2023-12-26 02:13:46,256][123090] Updated weights for policy 1, policy_version 329545 (0.0006) [2023-12-26 02:13:46,310][123090] Updated weights for policy 1, policy_version 329555 (0.0005) [2023-12-26 02:13:46,366][123090] Updated weights for policy 1, policy_version 329565 (0.0005) [2023-12-26 02:13:46,527][123091] Updated weights for policy 0, policy_version 331380 (0.0005) [2023-12-26 02:13:46,583][123091] Updated weights for policy 0, policy_version 331390 (0.0005) [2023-12-26 02:13:46,635][123091] Updated weights for policy 0, policy_version 331400 (0.0005) [2023-12-26 02:13:47,114][123090] Updated weights for policy 1, policy_version 329575 (0.0009) [2023-12-26 02:13:47,173][123090] Updated weights for policy 1, policy_version 329585 (0.0009) [2023-12-26 02:13:47,226][123090] Updated weights for policy 1, policy_version 329595 (0.0009) [2023-12-26 02:13:47,409][123091] Updated weights for policy 0, policy_version 331410 (0.0007) [2023-12-26 02:13:47,483][123091] Updated weights for policy 0, policy_version 331420 (0.0008) [2023-12-26 02:13:47,541][123091] Updated weights for policy 0, policy_version 331431 (0.0010) [2023-12-26 02:13:48,017][123090] Updated weights for policy 1, policy_version 329605 (0.0009) [2023-12-26 02:13:48,083][123090] Updated weights for policy 1, policy_version 329615 (0.0007) [2023-12-26 02:13:48,132][123090] Updated weights for policy 1, policy_version 329625 (0.0005) [2023-12-26 02:13:48,386][123091] Updated weights for policy 0, policy_version 331441 (0.0011) [2023-12-26 02:13:48,445][123091] Updated weights for policy 0, policy_version 331451 (0.0009) [2023-12-26 02:13:48,509][123091] Updated weights for policy 0, policy_version 331462 (0.0009) [2023-12-26 02:13:48,570][123091] Updated weights for policy 0, policy_version 331472 (0.0009) [2023-12-26 02:13:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 169246720. Throughput: 0: 8992.2, 1: 9045.1. Samples: 169257828. Policy #0 lag: (min: 9.0, avg: 36.5, max: 41.0) [2023-12-26 02:13:48,784][121949] Avg episode reward: [(0, '6146.461'), (1, '5695.447')] [2023-12-26 02:13:48,922][123090] Updated weights for policy 1, policy_version 329635 (0.0005) [2023-12-26 02:13:48,993][123090] Updated weights for policy 1, policy_version 329645 (0.0005) [2023-12-26 02:13:49,062][123090] Updated weights for policy 1, policy_version 329655 (0.0007) [2023-12-26 02:13:49,430][123091] Updated weights for policy 0, policy_version 331482 (0.0008) [2023-12-26 02:13:49,484][123091] Updated weights for policy 0, policy_version 331492 (0.0010) [2023-12-26 02:13:49,541][123091] Updated weights for policy 0, policy_version 331502 (0.0009) [2023-12-26 02:13:49,802][123090] Updated weights for policy 1, policy_version 329665 (0.0009) [2023-12-26 02:13:49,877][123090] Updated weights for policy 1, policy_version 329675 (0.0009) [2023-12-26 02:13:49,953][123090] Updated weights for policy 1, policy_version 329685 (0.0010) [2023-12-26 02:13:50,019][123090] Updated weights for policy 1, policy_version 329695 (0.0010) [2023-12-26 02:13:50,395][123091] Updated weights for policy 0, policy_version 331512 (0.0010) [2023-12-26 02:13:50,455][123091] Updated weights for policy 0, policy_version 331522 (0.0009) [2023-12-26 02:13:50,521][123091] Updated weights for policy 0, policy_version 331532 (0.0009) [2023-12-26 02:13:50,835][123090] Updated weights for policy 1, policy_version 329705 (0.0009) [2023-12-26 02:13:50,898][123090] Updated weights for policy 1, policy_version 329715 (0.0009) [2023-12-26 02:13:50,961][123090] Updated weights for policy 1, policy_version 329725 (0.0010) [2023-12-26 02:13:51,377][123091] Updated weights for policy 0, policy_version 331542 (0.0009) [2023-12-26 02:13:51,451][123091] Updated weights for policy 0, policy_version 331552 (0.0006) [2023-12-26 02:13:51,517][123091] Updated weights for policy 0, policy_version 331562 (0.0008) [2023-12-26 02:13:51,846][123090] Updated weights for policy 1, policy_version 329735 (0.0009) [2023-12-26 02:13:51,916][123090] Updated weights for policy 1, policy_version 329745 (0.0009) [2023-12-26 02:13:51,961][123090] Updated weights for policy 1, policy_version 329755 (0.0007) [2023-12-26 02:13:52,354][123091] Updated weights for policy 0, policy_version 331572 (0.0009) [2023-12-26 02:13:52,423][123091] Updated weights for policy 0, policy_version 331582 (0.0008) [2023-12-26 02:13:52,483][123091] Updated weights for policy 0, policy_version 331592 (0.0009) [2023-12-26 02:13:52,677][123090] Updated weights for policy 1, policy_version 329765 (0.0005) [2023-12-26 02:13:52,747][123090] Updated weights for policy 1, policy_version 329775 (0.0005) [2023-12-26 02:13:52,818][123090] Updated weights for policy 1, policy_version 329785 (0.0006) [2023-12-26 02:13:53,343][123091] Updated weights for policy 0, policy_version 331602 (0.0011) [2023-12-26 02:13:53,405][123091] Updated weights for policy 0, policy_version 331612 (0.0011) [2023-12-26 02:13:53,467][123091] Updated weights for policy 0, policy_version 331622 (0.0011) [2023-12-26 02:13:53,525][123091] Updated weights for policy 0, policy_version 331632 (0.0010) [2023-12-26 02:13:53,533][123090] Updated weights for policy 1, policy_version 329795 (0.0009) [2023-12-26 02:13:53,594][123090] Updated weights for policy 1, policy_version 329805 (0.0009) [2023-12-26 02:13:53,651][123090] Updated weights for policy 1, policy_version 329815 (0.0008) [2023-12-26 02:13:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 169336832. Throughput: 0: 8950.7, 1: 9012.4. Samples: 169308400. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:13:53,785][121949] Avg episode reward: [(0, '6119.611'), (1, '5672.368')] [2023-12-26 02:13:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000331632_84901888.pth... [2023-12-26 02:13:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000329824_84434944.pth... [2023-12-26 02:13:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000328768_84164608.pth [2023-12-26 02:13:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000329824_84434944.pth [2023-12-26 02:13:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000330576_84631552.pth [2023-12-26 02:13:53,800][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000331632_84901888.pth [2023-12-26 02:13:54,338][123090] Updated weights for policy 1, policy_version 329825 (0.0008) [2023-12-26 02:13:54,349][123091] Updated weights for policy 0, policy_version 331642 (0.0011) [2023-12-26 02:13:54,403][123090] Updated weights for policy 1, policy_version 329835 (0.0005) [2023-12-26 02:13:54,418][123091] Updated weights for policy 0, policy_version 331652 (0.0011) [2023-12-26 02:13:54,470][123091] Updated weights for policy 0, policy_version 331662 (0.0010) [2023-12-26 02:13:54,474][123090] Updated weights for policy 1, policy_version 329845 (0.0008) [2023-12-26 02:13:54,544][123090] Updated weights for policy 1, policy_version 329855 (0.0005) [2023-12-26 02:13:55,148][123090] Updated weights for policy 1, policy_version 329865 (0.0005) [2023-12-26 02:13:55,205][123090] Updated weights for policy 1, policy_version 329875 (0.0005) [2023-12-26 02:13:55,259][123091] Updated weights for policy 0, policy_version 331672 (0.0007) [2023-12-26 02:13:55,271][123090] Updated weights for policy 1, policy_version 329885 (0.0006) [2023-12-26 02:13:55,325][123091] Updated weights for policy 0, policy_version 331682 (0.0006) [2023-12-26 02:13:55,401][123091] Updated weights for policy 0, policy_version 331692 (0.0005) [2023-12-26 02:13:55,964][123091] Updated weights for policy 0, policy_version 331702 (0.0007) [2023-12-26 02:13:56,012][123090] Updated weights for policy 1, policy_version 329895 (0.0006) [2023-12-26 02:13:56,032][123091] Updated weights for policy 0, policy_version 331712 (0.0006) [2023-12-26 02:13:56,068][123090] Updated weights for policy 1, policy_version 329905 (0.0010) [2023-12-26 02:13:56,088][123091] Updated weights for policy 0, policy_version 331722 (0.0007) [2023-12-26 02:13:56,124][123090] Updated weights for policy 1, policy_version 329915 (0.0009) [2023-12-26 02:13:56,855][123091] Updated weights for policy 0, policy_version 331732 (0.0007) [2023-12-26 02:13:56,916][123091] Updated weights for policy 0, policy_version 331742 (0.0006) [2023-12-26 02:13:56,936][123090] Updated weights for policy 1, policy_version 329925 (0.0010) [2023-12-26 02:13:56,970][123091] Updated weights for policy 0, policy_version 331752 (0.0005) [2023-12-26 02:13:56,990][123090] Updated weights for policy 1, policy_version 329935 (0.0010) [2023-12-26 02:13:57,045][123090] Updated weights for policy 1, policy_version 329945 (0.0010) [2023-12-26 02:13:57,732][123091] Updated weights for policy 0, policy_version 331762 (0.0006) [2023-12-26 02:13:57,763][123090] Updated weights for policy 1, policy_version 329955 (0.0010) [2023-12-26 02:13:57,792][123091] Updated weights for policy 0, policy_version 331772 (0.0009) [2023-12-26 02:13:57,815][123090] Updated weights for policy 1, policy_version 329965 (0.0010) [2023-12-26 02:13:57,852][123091] Updated weights for policy 0, policy_version 331782 (0.0006) [2023-12-26 02:13:57,863][123090] Updated weights for policy 1, policy_version 329975 (0.0010) [2023-12-26 02:13:57,911][123091] Updated weights for policy 0, policy_version 331792 (0.0006) [2023-12-26 02:13:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 169418752. Throughput: 0: 9040.5, 1: 9130.8. Samples: 169419324. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:13:58,785][121949] Avg episode reward: [(0, '6116.094'), (1, '5599.346')] [2023-12-26 02:13:58,798][123090] Updated weights for policy 1, policy_version 329985 (0.0010) [2023-12-26 02:13:58,842][123091] Updated weights for policy 0, policy_version 331802 (0.0006) [2023-12-26 02:13:58,865][123090] Updated weights for policy 1, policy_version 329995 (0.0008) [2023-12-26 02:13:58,913][123091] Updated weights for policy 0, policy_version 331812 (0.0006) [2023-12-26 02:13:58,936][123090] Updated weights for policy 1, policy_version 330005 (0.0009) [2023-12-26 02:13:58,979][123091] Updated weights for policy 0, policy_version 331822 (0.0007) [2023-12-26 02:13:59,001][123090] Updated weights for policy 1, policy_version 330015 (0.0008) [2023-12-26 02:13:59,749][123091] Updated weights for policy 0, policy_version 331832 (0.0010) [2023-12-26 02:13:59,804][123091] Updated weights for policy 0, policy_version 331842 (0.0010) [2023-12-26 02:13:59,808][123090] Updated weights for policy 1, policy_version 330025 (0.0010) [2023-12-26 02:13:59,872][123090] Updated weights for policy 1, policy_version 330035 (0.0009) [2023-12-26 02:13:59,890][123091] Updated weights for policy 0, policy_version 331852 (0.0008) [2023-12-26 02:13:59,932][123090] Updated weights for policy 1, policy_version 330045 (0.0010) [2023-12-26 02:14:00,625][123091] Updated weights for policy 0, policy_version 331862 (0.0006) [2023-12-26 02:14:00,676][123091] Updated weights for policy 0, policy_version 331872 (0.0005) [2023-12-26 02:14:00,689][123090] Updated weights for policy 1, policy_version 330055 (0.0008) [2023-12-26 02:14:00,734][123091] Updated weights for policy 0, policy_version 331882 (0.0005) [2023-12-26 02:14:00,746][123090] Updated weights for policy 1, policy_version 330065 (0.0009) [2023-12-26 02:14:00,798][123090] Updated weights for policy 1, policy_version 330075 (0.0010) [2023-12-26 02:14:01,513][123091] Updated weights for policy 0, policy_version 331892 (0.0007) [2023-12-26 02:14:01,567][123091] Updated weights for policy 0, policy_version 331904 (0.0010) [2023-12-26 02:14:01,615][123091] Updated weights for policy 0, policy_version 331914 (0.0009) [2023-12-26 02:14:01,631][123090] Updated weights for policy 1, policy_version 330085 (0.0009) [2023-12-26 02:14:01,693][123090] Updated weights for policy 1, policy_version 330095 (0.0009) [2023-12-26 02:14:01,768][123090] Updated weights for policy 1, policy_version 330105 (0.0010) [2023-12-26 02:14:02,416][123091] Updated weights for policy 0, policy_version 331924 (0.0007) [2023-12-26 02:14:02,481][123091] Updated weights for policy 0, policy_version 331934 (0.0008) [2023-12-26 02:14:02,541][123091] Updated weights for policy 0, policy_version 331944 (0.0008) [2023-12-26 02:14:02,572][123090] Updated weights for policy 1, policy_version 330115 (0.0010) [2023-12-26 02:14:02,626][123090] Updated weights for policy 1, policy_version 330125 (0.0008) [2023-12-26 02:14:02,677][123090] Updated weights for policy 1, policy_version 330135 (0.0009) [2023-12-26 02:14:03,266][123091] Updated weights for policy 0, policy_version 331954 (0.0008) [2023-12-26 02:14:03,331][123091] Updated weights for policy 0, policy_version 331964 (0.0008) [2023-12-26 02:14:03,393][123091] Updated weights for policy 0, policy_version 331974 (0.0007) [2023-12-26 02:14:03,449][123091] Updated weights for policy 0, policy_version 331984 (0.0006) [2023-12-26 02:14:03,589][123090] Updated weights for policy 1, policy_version 330145 (0.0009) [2023-12-26 02:14:03,647][123090] Updated weights for policy 1, policy_version 330155 (0.0009) [2023-12-26 02:14:03,703][123090] Updated weights for policy 1, policy_version 330165 (0.0009) [2023-12-26 02:14:03,759][123090] Updated weights for policy 1, policy_version 330175 (0.0010) [2023-12-26 02:14:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 169517056. Throughput: 0: 9002.0, 1: 9024.6. Samples: 169524640. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:03,784][121949] Avg episode reward: [(0, '6159.216'), (1, '5640.304')] [2023-12-26 02:14:04,040][123091] Updated weights for policy 0, policy_version 331994 (0.0005) [2023-12-26 02:14:04,087][123091] Updated weights for policy 0, policy_version 332004 (0.0005) [2023-12-26 02:14:04,149][123091] Updated weights for policy 0, policy_version 332014 (0.0005) [2023-12-26 02:14:04,639][123090] Updated weights for policy 1, policy_version 330185 (0.0008) [2023-12-26 02:14:04,703][123090] Updated weights for policy 1, policy_version 330195 (0.0009) [2023-12-26 02:14:04,760][123090] Updated weights for policy 1, policy_version 330205 (0.0009) [2023-12-26 02:14:04,858][123091] Updated weights for policy 0, policy_version 332024 (0.0009) [2023-12-26 02:14:04,910][123091] Updated weights for policy 0, policy_version 332034 (0.0009) [2023-12-26 02:14:04,965][123091] Updated weights for policy 0, policy_version 332044 (0.0008) [2023-12-26 02:14:05,634][123090] Updated weights for policy 1, policy_version 330215 (0.0010) [2023-12-26 02:14:05,654][123091] Updated weights for policy 0, policy_version 332054 (0.0007) [2023-12-26 02:14:05,689][123090] Updated weights for policy 1, policy_version 330225 (0.0009) [2023-12-26 02:14:05,703][123091] Updated weights for policy 0, policy_version 332064 (0.0008) [2023-12-26 02:14:05,759][123090] Updated weights for policy 1, policy_version 330235 (0.0009) [2023-12-26 02:14:05,767][123091] Updated weights for policy 0, policy_version 332074 (0.0007) [2023-12-26 02:14:06,512][123091] Updated weights for policy 0, policy_version 332084 (0.0008) [2023-12-26 02:14:06,567][123091] Updated weights for policy 0, policy_version 332094 (0.0011) [2023-12-26 02:14:06,624][123091] Updated weights for policy 0, policy_version 332104 (0.0011) [2023-12-26 02:14:06,657][123090] Updated weights for policy 1, policy_version 330245 (0.0007) [2023-12-26 02:14:06,716][123090] Updated weights for policy 1, policy_version 330255 (0.0005) [2023-12-26 02:14:06,787][123090] Updated weights for policy 1, policy_version 330265 (0.0006) [2023-12-26 02:14:07,384][123091] Updated weights for policy 0, policy_version 332114 (0.0011) [2023-12-26 02:14:07,439][123091] Updated weights for policy 0, policy_version 332124 (0.0010) [2023-12-26 02:14:07,492][123091] Updated weights for policy 0, policy_version 332134 (0.0009) [2023-12-26 02:14:07,544][123090] Updated weights for policy 1, policy_version 330275 (0.0007) [2023-12-26 02:14:07,546][123091] Updated weights for policy 0, policy_version 332144 (0.0009) [2023-12-26 02:14:07,602][123090] Updated weights for policy 1, policy_version 330285 (0.0010) [2023-12-26 02:14:07,656][123090] Updated weights for policy 1, policy_version 330295 (0.0010) [2023-12-26 02:14:08,226][123091] Updated weights for policy 0, policy_version 332154 (0.0009) [2023-12-26 02:14:08,295][123091] Updated weights for policy 0, policy_version 332164 (0.0010) [2023-12-26 02:14:08,361][123091] Updated weights for policy 0, policy_version 332174 (0.0010) [2023-12-26 02:14:08,537][123090] Updated weights for policy 1, policy_version 330305 (0.0009) [2023-12-26 02:14:08,594][123090] Updated weights for policy 1, policy_version 330315 (0.0009) [2023-12-26 02:14:08,647][123090] Updated weights for policy 1, policy_version 330325 (0.0009) [2023-12-26 02:14:08,703][123090] Updated weights for policy 1, policy_version 330335 (0.0009) [2023-12-26 02:14:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 169607168. Throughput: 0: 9083.4, 1: 8972.7. Samples: 169578772. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:08,785][121949] Avg episode reward: [(0, '6071.009'), (1, '5676.371')] [2023-12-26 02:14:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000332176_85041152.pth... [2023-12-26 02:14:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000330336_84566016.pth... [2023-12-26 02:14:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000331120_84770816.pth [2023-12-26 02:14:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000329312_84303872.pth [2023-12-26 02:14:09,159][123091] Updated weights for policy 0, policy_version 332184 (0.0009) [2023-12-26 02:14:09,220][123091] Updated weights for policy 0, policy_version 332194 (0.0009) [2023-12-26 02:14:09,283][123091] Updated weights for policy 0, policy_version 332204 (0.0009) [2023-12-26 02:14:09,584][123090] Updated weights for policy 1, policy_version 330345 (0.0009) [2023-12-26 02:14:09,651][123090] Updated weights for policy 1, policy_version 330355 (0.0010) [2023-12-26 02:14:09,723][123090] Updated weights for policy 1, policy_version 330365 (0.0010) [2023-12-26 02:14:10,122][123091] Updated weights for policy 0, policy_version 332214 (0.0009) [2023-12-26 02:14:10,185][123091] Updated weights for policy 0, policy_version 332224 (0.0009) [2023-12-26 02:14:10,253][123091] Updated weights for policy 0, policy_version 332234 (0.0010) [2023-12-26 02:14:10,525][123090] Updated weights for policy 1, policy_version 330375 (0.0007) [2023-12-26 02:14:10,586][123090] Updated weights for policy 1, policy_version 330385 (0.0009) [2023-12-26 02:14:10,639][123090] Updated weights for policy 1, policy_version 330395 (0.0009) [2023-12-26 02:14:11,107][123091] Updated weights for policy 0, policy_version 332244 (0.0009) [2023-12-26 02:14:11,170][123091] Updated weights for policy 0, policy_version 332254 (0.0009) [2023-12-26 02:14:11,235][123091] Updated weights for policy 0, policy_version 332264 (0.0009) [2023-12-26 02:14:11,527][123090] Updated weights for policy 1, policy_version 330405 (0.0010) [2023-12-26 02:14:11,615][123090] Updated weights for policy 1, policy_version 330415 (0.0011) [2023-12-26 02:14:11,688][123090] Updated weights for policy 1, policy_version 330425 (0.0009) [2023-12-26 02:14:12,119][123091] Updated weights for policy 0, policy_version 332274 (0.0009) [2023-12-26 02:14:12,174][123091] Updated weights for policy 0, policy_version 332284 (0.0010) [2023-12-26 02:14:12,232][123091] Updated weights for policy 0, policy_version 332294 (0.0009) [2023-12-26 02:14:12,304][123091] Updated weights for policy 0, policy_version 332304 (0.0009) [2023-12-26 02:14:12,368][123090] Updated weights for policy 1, policy_version 330435 (0.0010) [2023-12-26 02:14:12,439][123090] Updated weights for policy 1, policy_version 330445 (0.0010) [2023-12-26 02:14:12,505][123090] Updated weights for policy 1, policy_version 330455 (0.0010) [2023-12-26 02:14:13,073][123091] Updated weights for policy 0, policy_version 332314 (0.0010) [2023-12-26 02:14:13,131][123091] Updated weights for policy 0, policy_version 332325 (0.0010) [2023-12-26 02:14:13,203][123091] Updated weights for policy 0, policy_version 332335 (0.0009) [2023-12-26 02:14:13,334][123090] Updated weights for policy 1, policy_version 330465 (0.0009) [2023-12-26 02:14:13,387][123090] Updated weights for policy 1, policy_version 330475 (0.0005) [2023-12-26 02:14:13,452][123090] Updated weights for policy 1, policy_version 330485 (0.0005) [2023-12-26 02:14:13,522][123090] Updated weights for policy 1, policy_version 330495 (0.0011) [2023-12-26 02:14:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 169689088. Throughput: 0: 9089.6, 1: 8869.4. Samples: 169682028. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:13,785][121949] Avg episode reward: [(0, '6026.022'), (1, '5761.584')] [2023-12-26 02:14:14,006][123091] Updated weights for policy 0, policy_version 332345 (0.0010) [2023-12-26 02:14:14,063][123091] Updated weights for policy 0, policy_version 332355 (0.0009) [2023-12-26 02:14:14,132][123091] Updated weights for policy 0, policy_version 332365 (0.0010) [2023-12-26 02:14:14,273][123090] Updated weights for policy 1, policy_version 330505 (0.0006) [2023-12-26 02:14:14,333][123090] Updated weights for policy 1, policy_version 330515 (0.0005) [2023-12-26 02:14:14,400][123090] Updated weights for policy 1, policy_version 330525 (0.0005) [2023-12-26 02:14:14,871][123091] Updated weights for policy 0, policy_version 332375 (0.0006) [2023-12-26 02:14:14,943][123091] Updated weights for policy 0, policy_version 332385 (0.0010) [2023-12-26 02:14:15,013][123091] Updated weights for policy 0, policy_version 332395 (0.0008) [2023-12-26 02:14:15,108][123090] Updated weights for policy 1, policy_version 330535 (0.0010) [2023-12-26 02:14:15,191][123090] Updated weights for policy 1, policy_version 330545 (0.0011) [2023-12-26 02:14:15,258][123090] Updated weights for policy 1, policy_version 330555 (0.0011) [2023-12-26 02:14:15,758][123091] Updated weights for policy 0, policy_version 332405 (0.0007) [2023-12-26 02:14:15,826][123091] Updated weights for policy 0, policy_version 332415 (0.0007) [2023-12-26 02:14:15,897][123091] Updated weights for policy 0, policy_version 332425 (0.0006) [2023-12-26 02:14:16,043][123090] Updated weights for policy 1, policy_version 330565 (0.0010) [2023-12-26 02:14:16,108][123090] Updated weights for policy 1, policy_version 330575 (0.0010) [2023-12-26 02:14:16,174][123090] Updated weights for policy 1, policy_version 330585 (0.0010) [2023-12-26 02:14:16,630][123091] Updated weights for policy 0, policy_version 332435 (0.0009) [2023-12-26 02:14:16,676][123091] Updated weights for policy 0, policy_version 332445 (0.0005) [2023-12-26 02:14:16,725][123091] Updated weights for policy 0, policy_version 332455 (0.0005) [2023-12-26 02:14:16,933][123090] Updated weights for policy 1, policy_version 330595 (0.0010) [2023-12-26 02:14:17,003][123090] Updated weights for policy 1, policy_version 330605 (0.0009) [2023-12-26 02:14:17,064][123090] Updated weights for policy 1, policy_version 330615 (0.0009) [2023-12-26 02:14:17,512][123091] Updated weights for policy 0, policy_version 332465 (0.0006) [2023-12-26 02:14:17,564][123091] Updated weights for policy 0, policy_version 332475 (0.0011) [2023-12-26 02:14:17,628][123091] Updated weights for policy 0, policy_version 332485 (0.0009) [2023-12-26 02:14:17,686][123091] Updated weights for policy 0, policy_version 332495 (0.0006) [2023-12-26 02:14:17,802][123090] Updated weights for policy 1, policy_version 330625 (0.0009) [2023-12-26 02:14:17,861][123090] Updated weights for policy 1, policy_version 330635 (0.0005) [2023-12-26 02:14:17,916][123090] Updated weights for policy 1, policy_version 330645 (0.0005) [2023-12-26 02:14:17,968][123090] Updated weights for policy 1, policy_version 330655 (0.0005) [2023-12-26 02:14:18,502][123091] Updated weights for policy 0, policy_version 332505 (0.0010) [2023-12-26 02:14:18,557][123091] Updated weights for policy 0, policy_version 332515 (0.0010) [2023-12-26 02:14:18,617][123091] Updated weights for policy 0, policy_version 332525 (0.0010) [2023-12-26 02:14:18,745][123090] Updated weights for policy 1, policy_version 330665 (0.0009) [2023-12-26 02:14:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 169779200. Throughput: 0: 9068.9, 1: 8859.9. Samples: 169792612. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:18,785][121949] Avg episode reward: [(0, '6031.982'), (1, '5820.568')] [2023-12-26 02:14:18,811][123090] Updated weights for policy 1, policy_version 330675 (0.0009) [2023-12-26 02:14:18,876][123090] Updated weights for policy 1, policy_version 330685 (0.0009) [2023-12-26 02:14:19,459][123091] Updated weights for policy 0, policy_version 332535 (0.0011) [2023-12-26 02:14:19,530][123091] Updated weights for policy 0, policy_version 332545 (0.0011) [2023-12-26 02:14:19,585][123091] Updated weights for policy 0, policy_version 332555 (0.0011) [2023-12-26 02:14:19,720][123090] Updated weights for policy 1, policy_version 330695 (0.0009) [2023-12-26 02:14:19,786][123090] Updated weights for policy 1, policy_version 330705 (0.0009) [2023-12-26 02:14:19,852][123090] Updated weights for policy 1, policy_version 330715 (0.0009) [2023-12-26 02:14:20,408][123091] Updated weights for policy 0, policy_version 332565 (0.0011) [2023-12-26 02:14:20,456][123091] Updated weights for policy 0, policy_version 332575 (0.0010) [2023-12-26 02:14:20,515][123091] Updated weights for policy 0, policy_version 332585 (0.0011) [2023-12-26 02:14:20,703][123090] Updated weights for policy 1, policy_version 330725 (0.0008) [2023-12-26 02:14:20,774][123090] Updated weights for policy 1, policy_version 330735 (0.0007) [2023-12-26 02:14:20,843][123090] Updated weights for policy 1, policy_version 330745 (0.0010) [2023-12-26 02:14:21,385][123091] Updated weights for policy 0, policy_version 332595 (0.0011) [2023-12-26 02:14:21,441][123091] Updated weights for policy 0, policy_version 332605 (0.0009) [2023-12-26 02:14:21,502][123091] Updated weights for policy 0, policy_version 332615 (0.0009) [2023-12-26 02:14:21,682][123090] Updated weights for policy 1, policy_version 330755 (0.0010) [2023-12-26 02:14:21,755][123090] Updated weights for policy 1, policy_version 330765 (0.0009) [2023-12-26 02:14:21,811][123090] Updated weights for policy 1, policy_version 330775 (0.0010) [2023-12-26 02:14:22,280][123091] Updated weights for policy 0, policy_version 332625 (0.0009) [2023-12-26 02:14:22,338][123091] Updated weights for policy 0, policy_version 332635 (0.0009) [2023-12-26 02:14:22,406][123091] Updated weights for policy 0, policy_version 332645 (0.0009) [2023-12-26 02:14:22,473][123091] Updated weights for policy 0, policy_version 332655 (0.0010) [2023-12-26 02:14:22,630][123090] Updated weights for policy 1, policy_version 330785 (0.0010) [2023-12-26 02:14:22,698][123090] Updated weights for policy 1, policy_version 330795 (0.0006) [2023-12-26 02:14:22,764][123090] Updated weights for policy 1, policy_version 330805 (0.0006) [2023-12-26 02:14:22,824][123090] Updated weights for policy 1, policy_version 330815 (0.0010) [2023-12-26 02:14:23,418][123091] Updated weights for policy 0, policy_version 332665 (0.0010) [2023-12-26 02:14:23,485][123091] Updated weights for policy 0, policy_version 332675 (0.0009) [2023-12-26 02:14:23,505][123090] Updated weights for policy 1, policy_version 330825 (0.0006) [2023-12-26 02:14:23,539][123091] Updated weights for policy 0, policy_version 332685 (0.0008) [2023-12-26 02:14:23,572][123090] Updated weights for policy 1, policy_version 330835 (0.0005) [2023-12-26 02:14:23,628][123090] Updated weights for policy 1, policy_version 330845 (0.0005) [2023-12-26 02:14:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 169869312. Throughput: 0: 8993.5, 1: 8763.5. Samples: 169842296. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:23,785][121949] Avg episode reward: [(0, '6106.119'), (1, '5564.493')] [2023-12-26 02:14:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000332688_85172224.pth... [2023-12-26 02:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000330848_84697088.pth... [2023-12-26 02:14:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000331632_84901888.pth [2023-12-26 02:14:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000329824_84434944.pth [2023-12-26 02:14:24,343][123090] Updated weights for policy 1, policy_version 330855 (0.0005) [2023-12-26 02:14:24,409][123090] Updated weights for policy 1, policy_version 330865 (0.0006) [2023-12-26 02:14:24,418][123091] Updated weights for policy 0, policy_version 332695 (0.0008) [2023-12-26 02:14:24,468][123091] Updated weights for policy 0, policy_version 332705 (0.0007) [2023-12-26 02:14:24,477][123090] Updated weights for policy 1, policy_version 330875 (0.0006) [2023-12-26 02:14:24,525][123091] Updated weights for policy 0, policy_version 332715 (0.0006) [2023-12-26 02:14:25,203][123090] Updated weights for policy 1, policy_version 330885 (0.0005) [2023-12-26 02:14:25,251][123090] Updated weights for policy 1, policy_version 330895 (0.0005) [2023-12-26 02:14:25,299][123090] Updated weights for policy 1, policy_version 330905 (0.0005) [2023-12-26 02:14:25,332][123091] Updated weights for policy 0, policy_version 332725 (0.0007) [2023-12-26 02:14:25,384][123091] Updated weights for policy 0, policy_version 332735 (0.0009) [2023-12-26 02:14:25,449][123091] Updated weights for policy 0, policy_version 332745 (0.0009) [2023-12-26 02:14:25,978][123090] Updated weights for policy 1, policy_version 330915 (0.0006) [2023-12-26 02:14:26,026][123090] Updated weights for policy 1, policy_version 330925 (0.0005) [2023-12-26 02:14:26,091][123090] Updated weights for policy 1, policy_version 330935 (0.0005) [2023-12-26 02:14:26,333][123091] Updated weights for policy 0, policy_version 332755 (0.0010) [2023-12-26 02:14:26,385][123091] Updated weights for policy 0, policy_version 332765 (0.0009) [2023-12-26 02:14:26,444][123091] Updated weights for policy 0, policy_version 332775 (0.0009) [2023-12-26 02:14:26,798][123090] Updated weights for policy 1, policy_version 330945 (0.0006) [2023-12-26 02:14:26,864][123090] Updated weights for policy 1, policy_version 330955 (0.0009) [2023-12-26 02:14:26,923][123090] Updated weights for policy 1, policy_version 330965 (0.0009) [2023-12-26 02:14:26,986][123090] Updated weights for policy 1, policy_version 330975 (0.0009) [2023-12-26 02:14:27,298][123091] Updated weights for policy 0, policy_version 332785 (0.0010) [2023-12-26 02:14:27,352][123091] Updated weights for policy 0, policy_version 332795 (0.0009) [2023-12-26 02:14:27,400][123091] Updated weights for policy 0, policy_version 332805 (0.0009) [2023-12-26 02:14:27,451][123091] Updated weights for policy 0, policy_version 332815 (0.0008) [2023-12-26 02:14:27,712][123090] Updated weights for policy 1, policy_version 330985 (0.0006) [2023-12-26 02:14:27,764][123090] Updated weights for policy 1, policy_version 330995 (0.0005) [2023-12-26 02:14:27,826][123090] Updated weights for policy 1, policy_version 331005 (0.0005) [2023-12-26 02:14:28,408][123091] Updated weights for policy 0, policy_version 332825 (0.0009) [2023-12-26 02:14:28,413][123090] Updated weights for policy 1, policy_version 331015 (0.0005) [2023-12-26 02:14:28,475][123090] Updated weights for policy 1, policy_version 331025 (0.0005) [2023-12-26 02:14:28,477][123091] Updated weights for policy 0, policy_version 332835 (0.0009) [2023-12-26 02:14:28,535][123091] Updated weights for policy 0, policy_version 332845 (0.0009) [2023-12-26 02:14:28,544][123090] Updated weights for policy 1, policy_version 331035 (0.0005) [2023-12-26 02:14:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 169959424. Throughput: 0: 8939.8, 1: 8899.1. Samples: 169948768. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:28,785][121949] Avg episode reward: [(0, '6205.576'), (1, '5139.544')] [2023-12-26 02:14:29,204][123090] Updated weights for policy 1, policy_version 331045 (0.0007) [2023-12-26 02:14:29,274][123090] Updated weights for policy 1, policy_version 331056 (0.0008) [2023-12-26 02:14:29,342][123090] Updated weights for policy 1, policy_version 331066 (0.0008) [2023-12-26 02:14:29,447][123091] Updated weights for policy 0, policy_version 332855 (0.0010) [2023-12-26 02:14:29,510][123091] Updated weights for policy 0, policy_version 332865 (0.0011) [2023-12-26 02:14:29,573][123091] Updated weights for policy 0, policy_version 332875 (0.0010) [2023-12-26 02:14:30,150][123090] Updated weights for policy 1, policy_version 331076 (0.0009) [2023-12-26 02:14:30,203][123090] Updated weights for policy 1, policy_version 331086 (0.0009) [2023-12-26 02:14:30,258][123090] Updated weights for policy 1, policy_version 331096 (0.0009) [2023-12-26 02:14:30,393][123091] Updated weights for policy 0, policy_version 332885 (0.0011) [2023-12-26 02:14:30,448][123091] Updated weights for policy 0, policy_version 332895 (0.0010) [2023-12-26 02:14:30,504][123091] Updated weights for policy 0, policy_version 332905 (0.0010) [2023-12-26 02:14:31,126][123090] Updated weights for policy 1, policy_version 331106 (0.0009) [2023-12-26 02:14:31,192][123090] Updated weights for policy 1, policy_version 331116 (0.0008) [2023-12-26 02:14:31,255][123090] Updated weights for policy 1, policy_version 331126 (0.0009) [2023-12-26 02:14:31,315][123090] Updated weights for policy 1, policy_version 331136 (0.0009) [2023-12-26 02:14:31,327][123091] Updated weights for policy 0, policy_version 332915 (0.0009) [2023-12-26 02:14:31,391][123091] Updated weights for policy 0, policy_version 332925 (0.0008) [2023-12-26 02:14:31,450][123091] Updated weights for policy 0, policy_version 332935 (0.0008) [2023-12-26 02:14:32,152][123091] Updated weights for policy 0, policy_version 332945 (0.0008) [2023-12-26 02:14:32,172][123090] Updated weights for policy 1, policy_version 331146 (0.0008) [2023-12-26 02:14:32,215][123091] Updated weights for policy 0, policy_version 332955 (0.0011) [2023-12-26 02:14:32,235][123090] Updated weights for policy 1, policy_version 331156 (0.0006) [2023-12-26 02:14:32,278][123091] Updated weights for policy 0, policy_version 332965 (0.0011) [2023-12-26 02:14:32,301][123090] Updated weights for policy 1, policy_version 331166 (0.0010) [2023-12-26 02:14:32,344][123091] Updated weights for policy 0, policy_version 332975 (0.0007) [2023-12-26 02:14:33,082][123091] Updated weights for policy 0, policy_version 332985 (0.0005) [2023-12-26 02:14:33,141][123091] Updated weights for policy 0, policy_version 332995 (0.0009) [2023-12-26 02:14:33,164][123090] Updated weights for policy 1, policy_version 331176 (0.0007) [2023-12-26 02:14:33,195][123091] Updated weights for policy 0, policy_version 333005 (0.0010) [2023-12-26 02:14:33,219][123090] Updated weights for policy 1, policy_version 331186 (0.0008) [2023-12-26 02:14:33,283][123090] Updated weights for policy 1, policy_version 331196 (0.0009) [2023-12-26 02:14:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 170041344. Throughput: 0: 8849.6, 1: 8869.0. Samples: 170055168. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:33,785][121949] Avg episode reward: [(0, '6310.344'), (1, '5179.180')] [2023-12-26 02:14:33,787][123091] Updated weights for policy 0, policy_version 333015 (0.0007) [2023-12-26 02:14:33,858][123091] Updated weights for policy 0, policy_version 333025 (0.0010) [2023-12-26 02:14:33,929][123091] Updated weights for policy 0, policy_version 333035 (0.0011) [2023-12-26 02:14:34,167][123090] Updated weights for policy 1, policy_version 331206 (0.0009) [2023-12-26 02:14:34,243][123090] Updated weights for policy 1, policy_version 331216 (0.0010) [2023-12-26 02:14:34,317][123090] Updated weights for policy 1, policy_version 331226 (0.0010) [2023-12-26 02:14:34,617][123091] Updated weights for policy 0, policy_version 333045 (0.0010) [2023-12-26 02:14:34,674][123091] Updated weights for policy 0, policy_version 333055 (0.0009) [2023-12-26 02:14:34,735][123091] Updated weights for policy 0, policy_version 333065 (0.0010) [2023-12-26 02:14:35,149][123090] Updated weights for policy 1, policy_version 331236 (0.0009) [2023-12-26 02:14:35,215][123090] Updated weights for policy 1, policy_version 331246 (0.0010) [2023-12-26 02:14:35,288][123090] Updated weights for policy 1, policy_version 331256 (0.0010) [2023-12-26 02:14:35,482][123091] Updated weights for policy 0, policy_version 333075 (0.0009) [2023-12-26 02:14:35,533][123091] Updated weights for policy 0, policy_version 333085 (0.0005) [2023-12-26 02:14:35,589][123091] Updated weights for policy 0, policy_version 333095 (0.0007) [2023-12-26 02:14:36,152][123090] Updated weights for policy 1, policy_version 331266 (0.0009) [2023-12-26 02:14:36,209][123090] Updated weights for policy 1, policy_version 331276 (0.0006) [2023-12-26 02:14:36,261][123091] Updated weights for policy 0, policy_version 333105 (0.0010) [2023-12-26 02:14:36,273][123090] Updated weights for policy 1, policy_version 331286 (0.0006) [2023-12-26 02:14:36,325][123091] Updated weights for policy 0, policy_version 333115 (0.0011) [2023-12-26 02:14:36,336][123090] Updated weights for policy 1, policy_version 331296 (0.0006) [2023-12-26 02:14:36,376][123091] Updated weights for policy 0, policy_version 333125 (0.0010) [2023-12-26 02:14:36,443][123091] Updated weights for policy 0, policy_version 333135 (0.0011) [2023-12-26 02:14:37,109][123090] Updated weights for policy 1, policy_version 331306 (0.0009) [2023-12-26 02:14:37,166][123090] Updated weights for policy 1, policy_version 331316 (0.0009) [2023-12-26 02:14:37,218][123090] Updated weights for policy 1, policy_version 331326 (0.0009) [2023-12-26 02:14:37,276][123091] Updated weights for policy 0, policy_version 333145 (0.0011) [2023-12-26 02:14:37,340][123091] Updated weights for policy 0, policy_version 333155 (0.0011) [2023-12-26 02:14:37,403][123091] Updated weights for policy 0, policy_version 333165 (0.0011) [2023-12-26 02:14:38,116][123090] Updated weights for policy 1, policy_version 331336 (0.0006) [2023-12-26 02:14:38,122][123091] Updated weights for policy 0, policy_version 333175 (0.0008) [2023-12-26 02:14:38,180][123091] Updated weights for policy 0, policy_version 333185 (0.0006) [2023-12-26 02:14:38,188][123090] Updated weights for policy 1, policy_version 331346 (0.0005) [2023-12-26 02:14:38,242][123091] Updated weights for policy 0, policy_version 333195 (0.0007) [2023-12-26 02:14:38,264][123090] Updated weights for policy 1, policy_version 331356 (0.0005) [2023-12-26 02:14:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 170131456. Throughput: 0: 8920.3, 1: 8859.4. Samples: 170108484. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:38,785][121949] Avg episode reward: [(0, '6318.852'), (1, '5191.396')] [2023-12-26 02:14:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000333200_85303296.pth... [2023-12-26 02:14:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000331360_84828160.pth... [2023-12-26 02:14:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000332176_85041152.pth [2023-12-26 02:14:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000330336_84566016.pth [2023-12-26 02:14:38,990][123091] Updated weights for policy 0, policy_version 333205 (0.0009) [2023-12-26 02:14:38,992][123090] Updated weights for policy 1, policy_version 331366 (0.0006) [2023-12-26 02:14:39,041][123091] Updated weights for policy 0, policy_version 333215 (0.0010) [2023-12-26 02:14:39,056][123090] Updated weights for policy 1, policy_version 331376 (0.0006) [2023-12-26 02:14:39,088][123091] Updated weights for policy 0, policy_version 333225 (0.0010) [2023-12-26 02:14:39,113][123090] Updated weights for policy 1, policy_version 331386 (0.0007) [2023-12-26 02:14:39,991][123091] Updated weights for policy 0, policy_version 333235 (0.0010) [2023-12-26 02:14:40,012][123090] Updated weights for policy 1, policy_version 331396 (0.0007) [2023-12-26 02:14:40,054][123091] Updated weights for policy 0, policy_version 333245 (0.0009) [2023-12-26 02:14:40,083][123090] Updated weights for policy 1, policy_version 331406 (0.0008) [2023-12-26 02:14:40,119][123091] Updated weights for policy 0, policy_version 333255 (0.0009) [2023-12-26 02:14:40,149][123090] Updated weights for policy 1, policy_version 331416 (0.0010) [2023-12-26 02:14:40,913][123091] Updated weights for policy 0, policy_version 333265 (0.0007) [2023-12-26 02:14:40,984][123091] Updated weights for policy 0, policy_version 333275 (0.0005) [2023-12-26 02:14:41,005][123090] Updated weights for policy 1, policy_version 331426 (0.0010) [2023-12-26 02:14:41,058][123091] Updated weights for policy 0, policy_version 333285 (0.0007) [2023-12-26 02:14:41,077][123090] Updated weights for policy 1, policy_version 331436 (0.0009) [2023-12-26 02:14:41,117][123091] Updated weights for policy 0, policy_version 333295 (0.0005) [2023-12-26 02:14:41,145][123090] Updated weights for policy 1, policy_version 331446 (0.0010) [2023-12-26 02:14:41,213][123090] Updated weights for policy 1, policy_version 331456 (0.0009) [2023-12-26 02:14:41,893][123091] Updated weights for policy 0, policy_version 333305 (0.0009) [2023-12-26 02:14:41,960][123091] Updated weights for policy 0, policy_version 333315 (0.0007) [2023-12-26 02:14:42,023][123091] Updated weights for policy 0, policy_version 333325 (0.0011) [2023-12-26 02:14:42,066][123090] Updated weights for policy 1, policy_version 331466 (0.0009) [2023-12-26 02:14:42,122][123090] Updated weights for policy 1, policy_version 331476 (0.0010) [2023-12-26 02:14:42,174][123090] Updated weights for policy 1, policy_version 331486 (0.0010) [2023-12-26 02:14:42,832][123091] Updated weights for policy 0, policy_version 333335 (0.0011) [2023-12-26 02:14:42,872][123090] Updated weights for policy 1, policy_version 331496 (0.0007) [2023-12-26 02:14:42,892][123091] Updated weights for policy 0, policy_version 333345 (0.0011) [2023-12-26 02:14:42,934][123090] Updated weights for policy 1, policy_version 331506 (0.0006) [2023-12-26 02:14:42,957][123091] Updated weights for policy 0, policy_version 333355 (0.0011) [2023-12-26 02:14:42,996][123090] Updated weights for policy 1, policy_version 331516 (0.0007) [2023-12-26 02:14:43,740][123090] Updated weights for policy 1, policy_version 331526 (0.0010) [2023-12-26 02:14:43,750][123091] Updated weights for policy 0, policy_version 333365 (0.0011) [2023-12-26 02:14:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 170213376. Throughput: 0: 8899.0, 1: 8718.7. Samples: 170212116. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:43,784][121949] Avg episode reward: [(0, '6280.261'), (1, '4931.476')] [2023-12-26 02:14:43,799][123090] Updated weights for policy 1, policy_version 331536 (0.0005) [2023-12-26 02:14:43,817][123091] Updated weights for policy 0, policy_version 333375 (0.0011) [2023-12-26 02:14:43,857][123090] Updated weights for policy 1, policy_version 331546 (0.0005) [2023-12-26 02:14:43,886][123091] Updated weights for policy 0, policy_version 333385 (0.0008) [2023-12-26 02:14:44,532][123090] Updated weights for policy 1, policy_version 331556 (0.0007) [2023-12-26 02:14:44,562][123091] Updated weights for policy 0, policy_version 333395 (0.0005) [2023-12-26 02:14:44,600][123090] Updated weights for policy 1, policy_version 331566 (0.0011) [2023-12-26 02:14:44,615][123091] Updated weights for policy 0, policy_version 333405 (0.0006) [2023-12-26 02:14:44,663][123090] Updated weights for policy 1, policy_version 331576 (0.0011) [2023-12-26 02:14:44,687][123091] Updated weights for policy 0, policy_version 333415 (0.0007) [2023-12-26 02:14:45,446][123091] Updated weights for policy 0, policy_version 333425 (0.0011) [2023-12-26 02:14:45,506][123091] Updated weights for policy 0, policy_version 333435 (0.0011) [2023-12-26 02:14:45,506][123090] Updated weights for policy 1, policy_version 331586 (0.0011) [2023-12-26 02:14:45,565][123091] Updated weights for policy 0, policy_version 333445 (0.0011) [2023-12-26 02:14:45,569][123090] Updated weights for policy 1, policy_version 331596 (0.0010) [2023-12-26 02:14:45,627][123091] Updated weights for policy 0, policy_version 333455 (0.0010) [2023-12-26 02:14:45,638][123090] Updated weights for policy 1, policy_version 331606 (0.0011) [2023-12-26 02:14:45,708][123090] Updated weights for policy 1, policy_version 331616 (0.0010) [2023-12-26 02:14:46,460][123091] Updated weights for policy 0, policy_version 333465 (0.0006) [2023-12-26 02:14:46,497][123090] Updated weights for policy 1, policy_version 331626 (0.0007) [2023-12-26 02:14:46,522][123091] Updated weights for policy 0, policy_version 333475 (0.0005) [2023-12-26 02:14:46,550][123090] Updated weights for policy 1, policy_version 331636 (0.0008) [2023-12-26 02:14:46,582][123091] Updated weights for policy 0, policy_version 333485 (0.0005) [2023-12-26 02:14:46,599][123090] Updated weights for policy 1, policy_version 331646 (0.0009) [2023-12-26 02:14:47,199][123091] Updated weights for policy 0, policy_version 333495 (0.0006) [2023-12-26 02:14:47,263][123091] Updated weights for policy 0, policy_version 333505 (0.0008) [2023-12-26 02:14:47,325][123091] Updated weights for policy 0, policy_version 333515 (0.0008) [2023-12-26 02:14:47,433][123090] Updated weights for policy 1, policy_version 331656 (0.0008) [2023-12-26 02:14:47,497][123090] Updated weights for policy 1, policy_version 331666 (0.0006) [2023-12-26 02:14:47,563][123090] Updated weights for policy 1, policy_version 331676 (0.0010) [2023-12-26 02:14:48,126][123091] Updated weights for policy 0, policy_version 333525 (0.0009) [2023-12-26 02:14:48,174][123091] Updated weights for policy 0, policy_version 333535 (0.0010) [2023-12-26 02:14:48,222][123091] Updated weights for policy 0, policy_version 333545 (0.0010) [2023-12-26 02:14:48,344][123090] Updated weights for policy 1, policy_version 331686 (0.0009) [2023-12-26 02:14:48,404][123090] Updated weights for policy 1, policy_version 331696 (0.0009) [2023-12-26 02:14:48,457][123090] Updated weights for policy 1, policy_version 331706 (0.0008) [2023-12-26 02:14:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 170311680. Throughput: 0: 8912.3, 1: 8793.5. Samples: 170321404. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:48,785][121949] Avg episode reward: [(0, '6214.565'), (1, '4960.194')] [2023-12-26 02:14:48,986][123091] Updated weights for policy 0, policy_version 333555 (0.0009) [2023-12-26 02:14:49,034][123091] Updated weights for policy 0, policy_version 333565 (0.0005) [2023-12-26 02:14:49,084][123091] Updated weights for policy 0, policy_version 333575 (0.0006) [2023-12-26 02:14:49,298][123090] Updated weights for policy 1, policy_version 331716 (0.0007) [2023-12-26 02:14:49,372][123090] Updated weights for policy 1, policy_version 331726 (0.0010) [2023-12-26 02:14:49,448][123090] Updated weights for policy 1, policy_version 331736 (0.0009) [2023-12-26 02:14:49,918][123091] Updated weights for policy 0, policy_version 333585 (0.0005) [2023-12-26 02:14:49,983][123091] Updated weights for policy 0, policy_version 333595 (0.0009) [2023-12-26 02:14:50,035][123091] Updated weights for policy 0, policy_version 333605 (0.0010) [2023-12-26 02:14:50,098][123091] Updated weights for policy 0, policy_version 333615 (0.0010) [2023-12-26 02:14:50,187][123090] Updated weights for policy 1, policy_version 331746 (0.0008) [2023-12-26 02:14:50,254][123090] Updated weights for policy 1, policy_version 331756 (0.0005) [2023-12-26 02:14:50,325][123090] Updated weights for policy 1, policy_version 331766 (0.0006) [2023-12-26 02:14:50,405][123090] Updated weights for policy 1, policy_version 331776 (0.0009) [2023-12-26 02:14:50,920][123091] Updated weights for policy 0, policy_version 333625 (0.0011) [2023-12-26 02:14:50,980][123091] Updated weights for policy 0, policy_version 333635 (0.0011) [2023-12-26 02:14:51,043][123091] Updated weights for policy 0, policy_version 333645 (0.0016) [2023-12-26 02:14:51,167][123090] Updated weights for policy 1, policy_version 331786 (0.0007) [2023-12-26 02:14:51,230][123090] Updated weights for policy 1, policy_version 331796 (0.0006) [2023-12-26 02:14:51,302][123090] Updated weights for policy 1, policy_version 331806 (0.0007) [2023-12-26 02:14:51,862][123091] Updated weights for policy 0, policy_version 333655 (0.0010) [2023-12-26 02:14:51,929][123091] Updated weights for policy 0, policy_version 333665 (0.0006) [2023-12-26 02:14:51,993][123091] Updated weights for policy 0, policy_version 333675 (0.0005) [2023-12-26 02:14:52,077][123090] Updated weights for policy 1, policy_version 331816 (0.0006) [2023-12-26 02:14:52,137][123090] Updated weights for policy 1, policy_version 331826 (0.0005) [2023-12-26 02:14:52,212][123090] Updated weights for policy 1, policy_version 331836 (0.0005) [2023-12-26 02:14:52,656][123091] Updated weights for policy 0, policy_version 333685 (0.0006) [2023-12-26 02:14:52,726][123091] Updated weights for policy 0, policy_version 333695 (0.0008) [2023-12-26 02:14:52,785][123091] Updated weights for policy 0, policy_version 333705 (0.0010) [2023-12-26 02:14:52,960][123090] Updated weights for policy 1, policy_version 331846 (0.0007) [2023-12-26 02:14:53,012][123090] Updated weights for policy 1, policy_version 331856 (0.0008) [2023-12-26 02:14:53,065][123090] Updated weights for policy 1, policy_version 331866 (0.0009) [2023-12-26 02:14:53,588][123091] Updated weights for policy 0, policy_version 333715 (0.0011) [2023-12-26 02:14:53,637][123091] Updated weights for policy 0, policy_version 333725 (0.0009) [2023-12-26 02:14:53,698][123091] Updated weights for policy 0, policy_version 333735 (0.0009) [2023-12-26 02:14:53,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 170401792. Throughput: 0: 8853.9, 1: 8833.3. Samples: 170374700. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:53,785][121949] Avg episode reward: [(0, '6008.553'), (1, '5165.743')] [2023-12-26 02:14:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000333744_85442560.pth... [2023-12-26 02:14:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000331872_84959232.pth... [2023-12-26 02:14:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000332688_85172224.pth [2023-12-26 02:14:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000330848_84697088.pth [2023-12-26 02:14:53,905][123090] Updated weights for policy 1, policy_version 331876 (0.0009) [2023-12-26 02:14:53,967][123090] Updated weights for policy 1, policy_version 331886 (0.0010) [2023-12-26 02:14:54,025][123090] Updated weights for policy 1, policy_version 331896 (0.0010) [2023-12-26 02:14:54,405][123091] Updated weights for policy 0, policy_version 333745 (0.0009) [2023-12-26 02:14:54,455][123091] Updated weights for policy 0, policy_version 333755 (0.0009) [2023-12-26 02:14:54,514][123091] Updated weights for policy 0, policy_version 333766 (0.0011) [2023-12-26 02:14:54,571][123091] Updated weights for policy 0, policy_version 333776 (0.0007) [2023-12-26 02:14:54,784][123090] Updated weights for policy 1, policy_version 331906 (0.0010) [2023-12-26 02:14:54,843][123090] Updated weights for policy 1, policy_version 331916 (0.0009) [2023-12-26 02:14:54,914][123090] Updated weights for policy 1, policy_version 331926 (0.0006) [2023-12-26 02:14:54,980][123090] Updated weights for policy 1, policy_version 331936 (0.0009) [2023-12-26 02:14:55,327][123091] Updated weights for policy 0, policy_version 333786 (0.0009) [2023-12-26 02:14:55,376][123091] Updated weights for policy 0, policy_version 333796 (0.0009) [2023-12-26 02:14:55,431][123091] Updated weights for policy 0, policy_version 333806 (0.0009) [2023-12-26 02:14:55,768][123090] Updated weights for policy 1, policy_version 331946 (0.0011) [2023-12-26 02:14:55,835][123090] Updated weights for policy 1, policy_version 331956 (0.0011) [2023-12-26 02:14:55,898][123090] Updated weights for policy 1, policy_version 331966 (0.0011) [2023-12-26 02:14:56,275][123091] Updated weights for policy 0, policy_version 333816 (0.0009) [2023-12-26 02:14:56,326][123091] Updated weights for policy 0, policy_version 333826 (0.0009) [2023-12-26 02:14:56,387][123091] Updated weights for policy 0, policy_version 333836 (0.0010) [2023-12-26 02:14:56,564][123090] Updated weights for policy 1, policy_version 331976 (0.0006) [2023-12-26 02:14:56,625][123090] Updated weights for policy 1, policy_version 331986 (0.0007) [2023-12-26 02:14:56,673][123090] Updated weights for policy 1, policy_version 331996 (0.0007) [2023-12-26 02:14:57,333][123091] Updated weights for policy 0, policy_version 333846 (0.0009) [2023-12-26 02:14:57,351][123090] Updated weights for policy 1, policy_version 332006 (0.0008) [2023-12-26 02:14:57,393][123091] Updated weights for policy 0, policy_version 333856 (0.0005) [2023-12-26 02:14:57,400][123090] Updated weights for policy 1, policy_version 332016 (0.0009) [2023-12-26 02:14:57,448][123090] Updated weights for policy 1, policy_version 332026 (0.0009) [2023-12-26 02:14:57,455][123091] Updated weights for policy 0, policy_version 333866 (0.0005) [2023-12-26 02:14:58,269][123090] Updated weights for policy 1, policy_version 332036 (0.0008) [2023-12-26 02:14:58,280][123091] Updated weights for policy 0, policy_version 333876 (0.0007) [2023-12-26 02:14:58,336][123090] Updated weights for policy 1, policy_version 332046 (0.0008) [2023-12-26 02:14:58,344][123091] Updated weights for policy 0, policy_version 333886 (0.0009) [2023-12-26 02:14:58,406][123090] Updated weights for policy 1, policy_version 332056 (0.0009) [2023-12-26 02:14:58,408][123091] Updated weights for policy 0, policy_version 333896 (0.0007) [2023-12-26 02:14:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 170491904. Throughput: 0: 8890.5, 1: 8934.1. Samples: 170484136. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:14:58,785][121949] Avg episode reward: [(0, '5962.520'), (1, '5368.361')] [2023-12-26 02:14:59,282][123091] Updated weights for policy 0, policy_version 333906 (0.0008) [2023-12-26 02:14:59,305][123090] Updated weights for policy 1, policy_version 332066 (0.0009) [2023-12-26 02:14:59,339][123091] Updated weights for policy 0, policy_version 333916 (0.0006) [2023-12-26 02:14:59,371][123090] Updated weights for policy 1, policy_version 332077 (0.0009) [2023-12-26 02:14:59,402][123091] Updated weights for policy 0, policy_version 333926 (0.0008) [2023-12-26 02:14:59,437][123090] Updated weights for policy 1, policy_version 332087 (0.0005) [2023-12-26 02:14:59,462][123091] Updated weights for policy 0, policy_version 333936 (0.0008) [2023-12-26 02:15:00,093][123090] Updated weights for policy 1, policy_version 332097 (0.0006) [2023-12-26 02:15:00,153][123090] Updated weights for policy 1, policy_version 332107 (0.0011) [2023-12-26 02:15:00,217][123090] Updated weights for policy 1, policy_version 332118 (0.0009) [2023-12-26 02:15:00,273][123090] Updated weights for policy 1, policy_version 332128 (0.0009) [2023-12-26 02:15:00,363][123091] Updated weights for policy 0, policy_version 333946 (0.0010) [2023-12-26 02:15:00,423][123091] Updated weights for policy 0, policy_version 333956 (0.0010) [2023-12-26 02:15:00,489][123091] Updated weights for policy 0, policy_version 333966 (0.0010) [2023-12-26 02:15:01,170][123090] Updated weights for policy 1, policy_version 332138 (0.0010) [2023-12-26 02:15:01,176][123091] Updated weights for policy 0, policy_version 333977 (0.0011) [2023-12-26 02:15:01,234][123090] Updated weights for policy 1, policy_version 332148 (0.0010) [2023-12-26 02:15:01,241][123091] Updated weights for policy 0, policy_version 333987 (0.0011) [2023-12-26 02:15:01,302][123090] Updated weights for policy 1, policy_version 332158 (0.0008) [2023-12-26 02:15:01,309][123091] Updated weights for policy 0, policy_version 333997 (0.0010) [2023-12-26 02:15:02,107][123090] Updated weights for policy 1, policy_version 332168 (0.0006) [2023-12-26 02:15:02,110][123091] Updated weights for policy 0, policy_version 334007 (0.0011) [2023-12-26 02:15:02,176][123090] Updated weights for policy 1, policy_version 332178 (0.0006) [2023-12-26 02:15:02,178][123091] Updated weights for policy 0, policy_version 334017 (0.0011) [2023-12-26 02:15:02,239][123090] Updated weights for policy 1, policy_version 332188 (0.0005) [2023-12-26 02:15:02,241][123091] Updated weights for policy 0, policy_version 334027 (0.0011) [2023-12-26 02:15:02,940][123090] Updated weights for policy 1, policy_version 332198 (0.0008) [2023-12-26 02:15:02,954][123091] Updated weights for policy 0, policy_version 334037 (0.0008) [2023-12-26 02:15:02,999][123090] Updated weights for policy 1, policy_version 332208 (0.0009) [2023-12-26 02:15:03,023][123091] Updated weights for policy 0, policy_version 334047 (0.0007) [2023-12-26 02:15:03,056][123090] Updated weights for policy 1, policy_version 332218 (0.0006) [2023-12-26 02:15:03,079][123091] Updated weights for policy 0, policy_version 334057 (0.0009) [2023-12-26 02:15:03,744][123090] Updated weights for policy 1, policy_version 332228 (0.0007) [2023-12-26 02:15:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 170573824. Throughput: 0: 8853.1, 1: 8900.9. Samples: 170591540. Policy #0 lag: (min: 30.0, avg: 37.5, max: 62.0) [2023-12-26 02:15:03,784][121949] Avg episode reward: [(0, '5964.619'), (1, '5595.351')] [2023-12-26 02:15:03,808][123090] Updated weights for policy 1, policy_version 332238 (0.0010) [2023-12-26 02:15:03,837][123091] Updated weights for policy 0, policy_version 334067 (0.0006) [2023-12-26 02:15:03,884][123090] Updated weights for policy 1, policy_version 332248 (0.0009) [2023-12-26 02:15:03,900][123091] Updated weights for policy 0, policy_version 334077 (0.0008) [2023-12-26 02:15:03,968][123091] Updated weights for policy 0, policy_version 334087 (0.0009) [2023-12-26 02:15:04,725][123091] Updated weights for policy 0, policy_version 334097 (0.0008) [2023-12-26 02:15:04,760][123090] Updated weights for policy 1, policy_version 332258 (0.0007) [2023-12-26 02:15:04,789][123091] Updated weights for policy 0, policy_version 334107 (0.0005) [2023-12-26 02:15:04,807][123090] Updated weights for policy 1, policy_version 332268 (0.0009) [2023-12-26 02:15:04,838][123091] Updated weights for policy 0, policy_version 334117 (0.0007) [2023-12-26 02:15:04,870][123090] Updated weights for policy 1, policy_version 332278 (0.0008) [2023-12-26 02:15:04,898][123091] Updated weights for policy 0, policy_version 334127 (0.0011) [2023-12-26 02:15:04,937][123090] Updated weights for policy 1, policy_version 332288 (0.0006) [2023-12-26 02:15:05,542][123091] Updated weights for policy 0, policy_version 334137 (0.0006) [2023-12-26 02:15:05,599][123091] Updated weights for policy 0, policy_version 334147 (0.0005) [2023-12-26 02:15:05,655][123091] Updated weights for policy 0, policy_version 334157 (0.0005) [2023-12-26 02:15:05,717][123090] Updated weights for policy 1, policy_version 332298 (0.0005) [2023-12-26 02:15:05,785][123090] Updated weights for policy 1, policy_version 332308 (0.0005) [2023-12-26 02:15:05,849][123090] Updated weights for policy 1, policy_version 332318 (0.0005) [2023-12-26 02:15:06,248][123091] Updated weights for policy 0, policy_version 334167 (0.0010) [2023-12-26 02:15:06,315][123091] Updated weights for policy 0, policy_version 334177 (0.0011) [2023-12-26 02:15:06,378][123091] Updated weights for policy 0, policy_version 334187 (0.0011) [2023-12-26 02:15:06,560][123090] Updated weights for policy 1, policy_version 332328 (0.0008) [2023-12-26 02:15:06,623][123090] Updated weights for policy 1, policy_version 332338 (0.0010) [2023-12-26 02:15:06,677][123090] Updated weights for policy 1, policy_version 332348 (0.0010) [2023-12-26 02:15:07,071][123091] Updated weights for policy 0, policy_version 334197 (0.0008) [2023-12-26 02:15:07,144][123091] Updated weights for policy 0, policy_version 334207 (0.0005) [2023-12-26 02:15:07,209][123091] Updated weights for policy 0, policy_version 334217 (0.0005) [2023-12-26 02:15:07,628][123090] Updated weights for policy 1, policy_version 332358 (0.0010) [2023-12-26 02:15:07,687][123090] Updated weights for policy 1, policy_version 332368 (0.0010) [2023-12-26 02:15:07,745][123090] Updated weights for policy 1, policy_version 332378 (0.0010) [2023-12-26 02:15:07,893][123091] Updated weights for policy 0, policy_version 334227 (0.0008) [2023-12-26 02:15:07,945][123091] Updated weights for policy 0, policy_version 334237 (0.0007) [2023-12-26 02:15:07,990][123091] Updated weights for policy 0, policy_version 334247 (0.0005) [2023-12-26 02:15:08,669][123090] Updated weights for policy 1, policy_version 332388 (0.0009) [2023-12-26 02:15:08,738][123090] Updated weights for policy 1, policy_version 332398 (0.0010) [2023-12-26 02:15:08,739][123091] Updated weights for policy 0, policy_version 334257 (0.0006) [2023-12-26 02:15:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 170663936. Throughput: 0: 8934.4, 1: 8940.6. Samples: 170646672. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:08,785][121949] Avg episode reward: [(0, '6089.998'), (1, '5483.821')] [2023-12-26 02:15:08,802][123090] Updated weights for policy 1, policy_version 332408 (0.0009) [2023-12-26 02:15:08,802][123091] Updated weights for policy 0, policy_version 334267 (0.0010) [2023-12-26 02:15:08,850][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000332416_85098496.pth... [2023-12-26 02:15:08,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000331360_84828160.pth [2023-12-26 02:15:08,865][123091] Updated weights for policy 0, policy_version 334277 (0.0006) [2023-12-26 02:15:08,922][123091] Updated weights for policy 0, policy_version 334287 (0.0005) [2023-12-26 02:15:08,925][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000334288_85581824.pth... [2023-12-26 02:15:08,928][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000333200_85303296.pth [2023-12-26 02:15:09,631][123091] Updated weights for policy 0, policy_version 334297 (0.0006) [2023-12-26 02:15:09,649][123090] Updated weights for policy 1, policy_version 332418 (0.0009) [2023-12-26 02:15:09,687][123091] Updated weights for policy 0, policy_version 334307 (0.0007) [2023-12-26 02:15:09,722][123090] Updated weights for policy 1, policy_version 332428 (0.0008) [2023-12-26 02:15:09,740][123091] Updated weights for policy 0, policy_version 334317 (0.0008) [2023-12-26 02:15:09,788][123090] Updated weights for policy 1, policy_version 332438 (0.0007) [2023-12-26 02:15:09,857][123090] Updated weights for policy 1, policy_version 332448 (0.0007) [2023-12-26 02:15:10,594][123091] Updated weights for policy 0, policy_version 334327 (0.0009) [2023-12-26 02:15:10,632][123090] Updated weights for policy 1, policy_version 332458 (0.0005) [2023-12-26 02:15:10,663][123091] Updated weights for policy 0, policy_version 334337 (0.0009) [2023-12-26 02:15:10,686][123090] Updated weights for policy 1, policy_version 332468 (0.0005) [2023-12-26 02:15:10,732][123091] Updated weights for policy 0, policy_version 334347 (0.0008) [2023-12-26 02:15:10,736][123090] Updated weights for policy 1, policy_version 332478 (0.0005) [2023-12-26 02:15:11,500][123090] Updated weights for policy 1, policy_version 332488 (0.0007) [2023-12-26 02:15:11,562][123091] Updated weights for policy 0, policy_version 334357 (0.0009) [2023-12-26 02:15:11,576][123090] Updated weights for policy 1, policy_version 332498 (0.0006) [2023-12-26 02:15:11,618][123091] Updated weights for policy 0, policy_version 334367 (0.0008) [2023-12-26 02:15:11,646][123090] Updated weights for policy 1, policy_version 332508 (0.0008) [2023-12-26 02:15:11,682][123091] Updated weights for policy 0, policy_version 334377 (0.0008) [2023-12-26 02:15:12,424][123090] Updated weights for policy 1, policy_version 332518 (0.0012) [2023-12-26 02:15:12,486][123090] Updated weights for policy 1, policy_version 332528 (0.0008) [2023-12-26 02:15:12,521][123091] Updated weights for policy 0, policy_version 334387 (0.0009) [2023-12-26 02:15:12,560][123090] Updated weights for policy 1, policy_version 332538 (0.0008) [2023-12-26 02:15:12,580][123091] Updated weights for policy 0, policy_version 334397 (0.0008) [2023-12-26 02:15:12,639][123091] Updated weights for policy 0, policy_version 334407 (0.0007) [2023-12-26 02:15:13,279][123090] Updated weights for policy 1, policy_version 332548 (0.0008) [2023-12-26 02:15:13,330][123091] Updated weights for policy 0, policy_version 334417 (0.0006) [2023-12-26 02:15:13,337][123090] Updated weights for policy 1, policy_version 332558 (0.0010) [2023-12-26 02:15:13,378][123091] Updated weights for policy 0, policy_version 334427 (0.0006) [2023-12-26 02:15:13,397][123090] Updated weights for policy 1, policy_version 332568 (0.0010) [2023-12-26 02:15:13,438][123091] Updated weights for policy 0, policy_version 334437 (0.0006) [2023-12-26 02:15:13,489][123091] Updated weights for policy 0, policy_version 334447 (0.0009) [2023-12-26 02:15:13,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 170762240. Throughput: 0: 9060.6, 1: 8783.6. Samples: 170751756. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:13,785][121949] Avg episode reward: [(0, '6074.311'), (1, '5576.502')] [2023-12-26 02:15:14,215][123090] Updated weights for policy 1, policy_version 332578 (0.0010) [2023-12-26 02:15:14,286][123090] Updated weights for policy 1, policy_version 332588 (0.0008) [2023-12-26 02:15:14,339][123090] Updated weights for policy 1, policy_version 332598 (0.0009) [2023-12-26 02:15:14,347][123091] Updated weights for policy 0, policy_version 334457 (0.0008) [2023-12-26 02:15:14,401][123090] Updated weights for policy 1, policy_version 332608 (0.0008) [2023-12-26 02:15:14,409][123091] Updated weights for policy 0, policy_version 334467 (0.0008) [2023-12-26 02:15:14,476][123091] Updated weights for policy 0, policy_version 334477 (0.0009) [2023-12-26 02:15:15,128][123090] Updated weights for policy 1, policy_version 332618 (0.0009) [2023-12-26 02:15:15,193][123090] Updated weights for policy 1, policy_version 332628 (0.0011) [2023-12-26 02:15:15,261][123090] Updated weights for policy 1, policy_version 332638 (0.0010) [2023-12-26 02:15:15,351][123091] Updated weights for policy 0, policy_version 334487 (0.0009) [2023-12-26 02:15:15,424][123091] Updated weights for policy 0, policy_version 334497 (0.0009) [2023-12-26 02:15:15,492][123091] Updated weights for policy 0, policy_version 334507 (0.0009) [2023-12-26 02:15:16,023][123090] Updated weights for policy 1, policy_version 332648 (0.0010) [2023-12-26 02:15:16,092][123090] Updated weights for policy 1, policy_version 332658 (0.0010) [2023-12-26 02:15:16,155][123090] Updated weights for policy 1, policy_version 332668 (0.0011) [2023-12-26 02:15:16,314][123091] Updated weights for policy 0, policy_version 334517 (0.0009) [2023-12-26 02:15:16,383][123091] Updated weights for policy 0, policy_version 334527 (0.0009) [2023-12-26 02:15:16,452][123091] Updated weights for policy 0, policy_version 334537 (0.0010) [2023-12-26 02:15:16,846][123090] Updated weights for policy 1, policy_version 332678 (0.0007) [2023-12-26 02:15:16,913][123090] Updated weights for policy 1, policy_version 332688 (0.0005) [2023-12-26 02:15:16,983][123090] Updated weights for policy 1, policy_version 332698 (0.0006) [2023-12-26 02:15:17,293][123091] Updated weights for policy 0, policy_version 334547 (0.0009) [2023-12-26 02:15:17,345][123091] Updated weights for policy 0, policy_version 334557 (0.0009) [2023-12-26 02:15:17,398][123091] Updated weights for policy 0, policy_version 334567 (0.0009) [2023-12-26 02:15:17,748][123090] Updated weights for policy 1, policy_version 332708 (0.0010) [2023-12-26 02:15:17,821][123090] Updated weights for policy 1, policy_version 332718 (0.0009) [2023-12-26 02:15:17,890][123090] Updated weights for policy 1, policy_version 332728 (0.0008) [2023-12-26 02:15:18,248][123091] Updated weights for policy 0, policy_version 334577 (0.0010) [2023-12-26 02:15:18,321][123091] Updated weights for policy 0, policy_version 334587 (0.0008) [2023-12-26 02:15:18,387][123091] Updated weights for policy 0, policy_version 334597 (0.0010) [2023-12-26 02:15:18,452][123091] Updated weights for policy 0, policy_version 334607 (0.0010) [2023-12-26 02:15:18,586][123090] Updated weights for policy 1, policy_version 332738 (0.0005) [2023-12-26 02:15:18,645][123090] Updated weights for policy 1, policy_version 332748 (0.0006) [2023-12-26 02:15:18,701][123090] Updated weights for policy 1, policy_version 332758 (0.0005) [2023-12-26 02:15:18,752][123090] Updated weights for policy 1, policy_version 332768 (0.0008) [2023-12-26 02:15:18,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 170852352. Throughput: 0: 9015.7, 1: 8844.1. Samples: 170858860. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:18,785][121949] Avg episode reward: [(0, '5908.438'), (1, '5377.272')] [2023-12-26 02:15:19,303][123091] Updated weights for policy 0, policy_version 334617 (0.0009) [2023-12-26 02:15:19,375][123091] Updated weights for policy 0, policy_version 334627 (0.0010) [2023-12-26 02:15:19,435][123091] Updated weights for policy 0, policy_version 334637 (0.0009) [2023-12-26 02:15:19,530][123090] Updated weights for policy 1, policy_version 332778 (0.0009) [2023-12-26 02:15:19,581][123090] Updated weights for policy 1, policy_version 332788 (0.0008) [2023-12-26 02:15:19,635][123090] Updated weights for policy 1, policy_version 332798 (0.0008) [2023-12-26 02:15:20,270][123091] Updated weights for policy 0, policy_version 334647 (0.0009) [2023-12-26 02:15:20,326][123091] Updated weights for policy 0, policy_version 334657 (0.0010) [2023-12-26 02:15:20,388][123091] Updated weights for policy 0, policy_version 334667 (0.0010) [2023-12-26 02:15:20,480][123090] Updated weights for policy 1, policy_version 332808 (0.0009) [2023-12-26 02:15:20,550][123090] Updated weights for policy 1, policy_version 332818 (0.0009) [2023-12-26 02:15:20,620][123090] Updated weights for policy 1, policy_version 332828 (0.0009) [2023-12-26 02:15:21,290][123091] Updated weights for policy 0, policy_version 334677 (0.0009) [2023-12-26 02:15:21,356][123091] Updated weights for policy 0, policy_version 334687 (0.0008) [2023-12-26 02:15:21,423][123091] Updated weights for policy 0, policy_version 334697 (0.0010) [2023-12-26 02:15:21,455][123090] Updated weights for policy 1, policy_version 332838 (0.0009) [2023-12-26 02:15:21,514][123090] Updated weights for policy 1, policy_version 332848 (0.0008) [2023-12-26 02:15:21,582][123090] Updated weights for policy 1, policy_version 332858 (0.0008) [2023-12-26 02:15:22,280][123091] Updated weights for policy 0, policy_version 334707 (0.0007) [2023-12-26 02:15:22,345][123091] Updated weights for policy 0, policy_version 334717 (0.0010) [2023-12-26 02:15:22,413][123090] Updated weights for policy 1, policy_version 332868 (0.0009) [2023-12-26 02:15:22,424][123091] Updated weights for policy 0, policy_version 334727 (0.0008) [2023-12-26 02:15:22,477][123090] Updated weights for policy 1, policy_version 332878 (0.0010) [2023-12-26 02:15:22,537][123090] Updated weights for policy 1, policy_version 332888 (0.0011) [2023-12-26 02:15:23,255][123091] Updated weights for policy 0, policy_version 334737 (0.0007) [2023-12-26 02:15:23,308][123091] Updated weights for policy 0, policy_version 334747 (0.0009) [2023-12-26 02:15:23,354][123090] Updated weights for policy 1, policy_version 332898 (0.0010) [2023-12-26 02:15:23,356][123091] Updated weights for policy 0, policy_version 334757 (0.0008) [2023-12-26 02:15:23,404][123090] Updated weights for policy 1, policy_version 332908 (0.0010) [2023-12-26 02:15:23,407][123091] Updated weights for policy 0, policy_version 334767 (0.0005) [2023-12-26 02:15:23,455][123090] Updated weights for policy 1, policy_version 332918 (0.0010) [2023-12-26 02:15:23,505][123090] Updated weights for policy 1, policy_version 332928 (0.0010) [2023-12-26 02:15:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 170934272. Throughput: 0: 8926.4, 1: 8865.2. Samples: 170909104. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:23,784][121949] Avg episode reward: [(0, '5900.428'), (1, '5474.284')] [2023-12-26 02:15:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000332928_85229568.pth... [2023-12-26 02:15:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000334768_85704704.pth... [2023-12-26 02:15:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000331872_84959232.pth [2023-12-26 02:15:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000333744_85442560.pth [2023-12-26 02:15:24,276][123091] Updated weights for policy 0, policy_version 334777 (0.0006) [2023-12-26 02:15:24,333][123090] Updated weights for policy 1, policy_version 332938 (0.0005) [2023-12-26 02:15:24,340][123091] Updated weights for policy 0, policy_version 334787 (0.0005) [2023-12-26 02:15:24,386][123090] Updated weights for policy 1, policy_version 332948 (0.0005) [2023-12-26 02:15:24,402][123091] Updated weights for policy 0, policy_version 334797 (0.0005) [2023-12-26 02:15:24,443][123090] Updated weights for policy 1, policy_version 332958 (0.0005) [2023-12-26 02:15:25,104][123091] Updated weights for policy 0, policy_version 334807 (0.0005) [2023-12-26 02:15:25,154][123091] Updated weights for policy 0, policy_version 334817 (0.0005) [2023-12-26 02:15:25,188][123090] Updated weights for policy 1, policy_version 332968 (0.0009) [2023-12-26 02:15:25,216][123091] Updated weights for policy 0, policy_version 334827 (0.0010) [2023-12-26 02:15:25,249][123090] Updated weights for policy 1, policy_version 332978 (0.0010) [2023-12-26 02:15:25,303][123090] Updated weights for policy 1, policy_version 332988 (0.0010) [2023-12-26 02:15:25,976][123091] Updated weights for policy 0, policy_version 334837 (0.0010) [2023-12-26 02:15:26,024][123090] Updated weights for policy 1, policy_version 332998 (0.0010) [2023-12-26 02:15:26,039][123091] Updated weights for policy 0, policy_version 334847 (0.0010) [2023-12-26 02:15:26,083][123090] Updated weights for policy 1, policy_version 333008 (0.0010) [2023-12-26 02:15:26,091][123091] Updated weights for policy 0, policy_version 334857 (0.0010) [2023-12-26 02:15:26,146][123090] Updated weights for policy 1, policy_version 333018 (0.0010) [2023-12-26 02:15:26,830][123091] Updated weights for policy 0, policy_version 334867 (0.0009) [2023-12-26 02:15:26,888][123091] Updated weights for policy 0, policy_version 334877 (0.0006) [2023-12-26 02:15:26,951][123091] Updated weights for policy 0, policy_version 334887 (0.0008) [2023-12-26 02:15:26,956][123090] Updated weights for policy 1, policy_version 333028 (0.0010) [2023-12-26 02:15:27,018][123090] Updated weights for policy 1, policy_version 333038 (0.0010) [2023-12-26 02:15:27,086][123090] Updated weights for policy 1, policy_version 333048 (0.0010) [2023-12-26 02:15:27,677][123091] Updated weights for policy 0, policy_version 334897 (0.0010) [2023-12-26 02:15:27,733][123091] Updated weights for policy 0, policy_version 334907 (0.0010) [2023-12-26 02:15:27,790][123091] Updated weights for policy 0, policy_version 334917 (0.0009) [2023-12-26 02:15:27,810][123090] Updated weights for policy 1, policy_version 333058 (0.0010) [2023-12-26 02:15:27,843][123091] Updated weights for policy 0, policy_version 334927 (0.0008) [2023-12-26 02:15:27,870][123090] Updated weights for policy 1, policy_version 333068 (0.0010) [2023-12-26 02:15:27,933][123090] Updated weights for policy 1, policy_version 333078 (0.0010) [2023-12-26 02:15:27,989][123090] Updated weights for policy 1, policy_version 333088 (0.0010) [2023-12-26 02:15:28,679][123091] Updated weights for policy 0, policy_version 334937 (0.0009) [2023-12-26 02:15:28,739][123091] Updated weights for policy 0, policy_version 334947 (0.0009) [2023-12-26 02:15:28,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 171016192. Throughput: 0: 8958.2, 1: 8953.0. Samples: 171018120. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:28,785][121949] Avg episode reward: [(0, '6003.589'), (1, '5522.454')] [2023-12-26 02:15:28,801][123090] Updated weights for policy 1, policy_version 333098 (0.0010) [2023-12-26 02:15:28,803][123091] Updated weights for policy 0, policy_version 334957 (0.0006) [2023-12-26 02:15:28,856][123090] Updated weights for policy 1, policy_version 333108 (0.0010) [2023-12-26 02:15:28,910][123090] Updated weights for policy 1, policy_version 333118 (0.0010) [2023-12-26 02:15:29,627][123091] Updated weights for policy 0, policy_version 334967 (0.0008) [2023-12-26 02:15:29,674][123091] Updated weights for policy 0, policy_version 334977 (0.0008) [2023-12-26 02:15:29,734][123091] Updated weights for policy 0, policy_version 334987 (0.0008) [2023-12-26 02:15:29,751][123090] Updated weights for policy 1, policy_version 333128 (0.0010) [2023-12-26 02:15:29,825][123090] Updated weights for policy 1, policy_version 333138 (0.0010) [2023-12-26 02:15:29,898][123090] Updated weights for policy 1, policy_version 333148 (0.0011) [2023-12-26 02:15:30,471][123091] Updated weights for policy 0, policy_version 334997 (0.0008) [2023-12-26 02:15:30,521][123091] Updated weights for policy 0, policy_version 335007 (0.0005) [2023-12-26 02:15:30,566][123091] Updated weights for policy 0, policy_version 335017 (0.0005) [2023-12-26 02:15:30,688][123090] Updated weights for policy 1, policy_version 333158 (0.0010) [2023-12-26 02:15:30,747][123090] Updated weights for policy 1, policy_version 333168 (0.0010) [2023-12-26 02:15:30,809][123090] Updated weights for policy 1, policy_version 333178 (0.0010) [2023-12-26 02:15:31,357][123091] Updated weights for policy 0, policy_version 335027 (0.0006) [2023-12-26 02:15:31,421][123091] Updated weights for policy 0, policy_version 335037 (0.0010) [2023-12-26 02:15:31,482][123091] Updated weights for policy 0, policy_version 335047 (0.0008) [2023-12-26 02:15:31,631][123090] Updated weights for policy 1, policy_version 333188 (0.0010) [2023-12-26 02:15:31,698][123090] Updated weights for policy 1, policy_version 333198 (0.0011) [2023-12-26 02:15:31,767][123090] Updated weights for policy 1, policy_version 333208 (0.0011) [2023-12-26 02:15:32,268][123091] Updated weights for policy 0, policy_version 335057 (0.0008) [2023-12-26 02:15:32,317][123091] Updated weights for policy 0, policy_version 335067 (0.0009) [2023-12-26 02:15:32,373][123091] Updated weights for policy 0, policy_version 335077 (0.0009) [2023-12-26 02:15:32,433][123091] Updated weights for policy 0, policy_version 335087 (0.0010) [2023-12-26 02:15:32,548][123090] Updated weights for policy 1, policy_version 333218 (0.0010) [2023-12-26 02:15:32,610][123090] Updated weights for policy 1, policy_version 333228 (0.0008) [2023-12-26 02:15:32,678][123090] Updated weights for policy 1, policy_version 333238 (0.0011) [2023-12-26 02:15:32,737][123090] Updated weights for policy 1, policy_version 333248 (0.0010) [2023-12-26 02:15:33,326][123091] Updated weights for policy 0, policy_version 335097 (0.0006) [2023-12-26 02:15:33,392][123091] Updated weights for policy 0, policy_version 335107 (0.0006) [2023-12-26 02:15:33,459][123090] Updated weights for policy 1, policy_version 333258 (0.0007) [2023-12-26 02:15:33,468][123091] Updated weights for policy 0, policy_version 335117 (0.0006) [2023-12-26 02:15:33,515][123090] Updated weights for policy 1, policy_version 333268 (0.0010) [2023-12-26 02:15:33,572][123090] Updated weights for policy 1, policy_version 333278 (0.0008) [2023-12-26 02:15:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 171114496. Throughput: 0: 8916.5, 1: 8918.0. Samples: 171123952. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:33,785][121949] Avg episode reward: [(0, '6076.059'), (1, '5030.639')] [2023-12-26 02:15:34,074][123091] Updated weights for policy 0, policy_version 335127 (0.0006) [2023-12-26 02:15:34,126][123091] Updated weights for policy 0, policy_version 335137 (0.0006) [2023-12-26 02:15:34,188][123091] Updated weights for policy 0, policy_version 335147 (0.0007) [2023-12-26 02:15:34,246][123090] Updated weights for policy 1, policy_version 333288 (0.0007) [2023-12-26 02:15:34,298][123090] Updated weights for policy 1, policy_version 333298 (0.0008) [2023-12-26 02:15:34,356][123090] Updated weights for policy 1, policy_version 333308 (0.0008) [2023-12-26 02:15:34,887][123091] Updated weights for policy 0, policy_version 335157 (0.0007) [2023-12-26 02:15:34,954][123091] Updated weights for policy 0, policy_version 335167 (0.0006) [2023-12-26 02:15:35,001][123091] Updated weights for policy 0, policy_version 335177 (0.0005) [2023-12-26 02:15:35,119][123090] Updated weights for policy 1, policy_version 333318 (0.0006) [2023-12-26 02:15:35,178][123090] Updated weights for policy 1, policy_version 333328 (0.0005) [2023-12-26 02:15:35,228][123090] Updated weights for policy 1, policy_version 333338 (0.0009) [2023-12-26 02:15:35,772][123091] Updated weights for policy 0, policy_version 335187 (0.0007) [2023-12-26 02:15:35,826][123091] Updated weights for policy 0, policy_version 335197 (0.0010) [2023-12-26 02:15:35,887][123091] Updated weights for policy 0, policy_version 335207 (0.0011) [2023-12-26 02:15:36,035][123090] Updated weights for policy 1, policy_version 333348 (0.0009) [2023-12-26 02:15:36,087][123090] Updated weights for policy 1, policy_version 333358 (0.0009) [2023-12-26 02:15:36,154][123090] Updated weights for policy 1, policy_version 333368 (0.0008) [2023-12-26 02:15:36,717][123091] Updated weights for policy 0, policy_version 335217 (0.0010) [2023-12-26 02:15:36,780][123091] Updated weights for policy 0, policy_version 335227 (0.0011) [2023-12-26 02:15:36,851][123091] Updated weights for policy 0, policy_version 335237 (0.0011) [2023-12-26 02:15:36,918][123091] Updated weights for policy 0, policy_version 335247 (0.0011) [2023-12-26 02:15:37,009][123090] Updated weights for policy 1, policy_version 333378 (0.0009) [2023-12-26 02:15:37,070][123090] Updated weights for policy 1, policy_version 333388 (0.0008) [2023-12-26 02:15:37,130][123090] Updated weights for policy 1, policy_version 333398 (0.0009) [2023-12-26 02:15:37,178][123090] Updated weights for policy 1, policy_version 333408 (0.0009) [2023-12-26 02:15:37,737][123091] Updated weights for policy 0, policy_version 335257 (0.0011) [2023-12-26 02:15:37,784][123091] Updated weights for policy 0, policy_version 335267 (0.0010) [2023-12-26 02:15:37,835][123091] Updated weights for policy 0, policy_version 335277 (0.0010) [2023-12-26 02:15:38,005][123090] Updated weights for policy 1, policy_version 333418 (0.0008) [2023-12-26 02:15:38,069][123090] Updated weights for policy 1, policy_version 333428 (0.0009) [2023-12-26 02:15:38,121][123090] Updated weights for policy 1, policy_version 333438 (0.0009) [2023-12-26 02:15:38,696][123091] Updated weights for policy 0, policy_version 335287 (0.0011) [2023-12-26 02:15:38,760][123091] Updated weights for policy 0, policy_version 335297 (0.0011) [2023-12-26 02:15:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 171196416. Throughput: 0: 8944.6, 1: 8954.5. Samples: 171180160. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:38,785][121949] Avg episode reward: [(0, '6232.759'), (1, '5093.514')] [2023-12-26 02:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000333440_85360640.pth... [2023-12-26 02:15:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000332416_85098496.pth [2023-12-26 02:15:38,828][123091] Updated weights for policy 0, policy_version 335307 (0.0011) [2023-12-26 02:15:38,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000335312_85843968.pth... [2023-12-26 02:15:38,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000334288_85581824.pth [2023-12-26 02:15:38,981][123090] Updated weights for policy 1, policy_version 333448 (0.0009) [2023-12-26 02:15:39,029][123090] Updated weights for policy 1, policy_version 333458 (0.0009) [2023-12-26 02:15:39,081][123090] Updated weights for policy 1, policy_version 333468 (0.0008) [2023-12-26 02:15:39,678][123091] Updated weights for policy 0, policy_version 335317 (0.0011) [2023-12-26 02:15:39,735][123091] Updated weights for policy 0, policy_version 335327 (0.0011) [2023-12-26 02:15:39,783][123091] Updated weights for policy 0, policy_version 335337 (0.0011) [2023-12-26 02:15:39,969][123090] Updated weights for policy 1, policy_version 333478 (0.0009) [2023-12-26 02:15:40,019][123090] Updated weights for policy 1, policy_version 333488 (0.0009) [2023-12-26 02:15:40,073][123090] Updated weights for policy 1, policy_version 333498 (0.0009) [2023-12-26 02:15:40,637][123091] Updated weights for policy 0, policy_version 335347 (0.0011) [2023-12-26 02:15:40,691][123091] Updated weights for policy 0, policy_version 335357 (0.0010) [2023-12-26 02:15:40,754][123091] Updated weights for policy 0, policy_version 335367 (0.0011) [2023-12-26 02:15:40,928][123090] Updated weights for policy 1, policy_version 333508 (0.0009) [2023-12-26 02:15:40,992][123090] Updated weights for policy 1, policy_version 333518 (0.0009) [2023-12-26 02:15:41,053][123090] Updated weights for policy 1, policy_version 333528 (0.0009) [2023-12-26 02:15:41,581][123091] Updated weights for policy 0, policy_version 335377 (0.0010) [2023-12-26 02:15:41,657][123091] Updated weights for policy 0, policy_version 335387 (0.0011) [2023-12-26 02:15:41,730][123091] Updated weights for policy 0, policy_version 335397 (0.0011) [2023-12-26 02:15:41,800][123091] Updated weights for policy 0, policy_version 335407 (0.0010) [2023-12-26 02:15:41,907][123090] Updated weights for policy 1, policy_version 333538 (0.0009) [2023-12-26 02:15:41,964][123090] Updated weights for policy 1, policy_version 333548 (0.0009) [2023-12-26 02:15:42,014][123090] Updated weights for policy 1, policy_version 333558 (0.0009) [2023-12-26 02:15:42,076][123090] Updated weights for policy 1, policy_version 333568 (0.0009) [2023-12-26 02:15:42,656][123091] Updated weights for policy 0, policy_version 335417 (0.0011) [2023-12-26 02:15:42,716][123091] Updated weights for policy 0, policy_version 335427 (0.0011) [2023-12-26 02:15:42,764][123091] Updated weights for policy 0, policy_version 335437 (0.0011) [2023-12-26 02:15:42,930][123090] Updated weights for policy 1, policy_version 333578 (0.0009) [2023-12-26 02:15:42,985][123090] Updated weights for policy 1, policy_version 333588 (0.0009) [2023-12-26 02:15:43,041][123090] Updated weights for policy 1, policy_version 333598 (0.0008) [2023-12-26 02:15:43,564][123091] Updated weights for policy 0, policy_version 335447 (0.0008) [2023-12-26 02:15:43,618][123091] Updated weights for policy 0, policy_version 335457 (0.0006) [2023-12-26 02:15:43,678][123091] Updated weights for policy 0, policy_version 335467 (0.0006) [2023-12-26 02:15:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 171286528. Throughput: 0: 8869.1, 1: 8820.3. Samples: 171280160. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:43,785][121949] Avg episode reward: [(0, '6147.283'), (1, '5459.298')] [2023-12-26 02:15:43,937][123090] Updated weights for policy 1, policy_version 333608 (0.0009) [2023-12-26 02:15:43,993][123090] Updated weights for policy 1, policy_version 333618 (0.0009) [2023-12-26 02:15:44,041][123090] Updated weights for policy 1, policy_version 333628 (0.0009) [2023-12-26 02:15:44,469][123091] Updated weights for policy 0, policy_version 335477 (0.0009) [2023-12-26 02:15:44,532][123091] Updated weights for policy 0, policy_version 335487 (0.0011) [2023-12-26 02:15:44,595][123091] Updated weights for policy 0, policy_version 335497 (0.0011) [2023-12-26 02:15:44,898][123090] Updated weights for policy 1, policy_version 333638 (0.0009) [2023-12-26 02:15:44,951][123090] Updated weights for policy 1, policy_version 333648 (0.0009) [2023-12-26 02:15:45,003][123090] Updated weights for policy 1, policy_version 333658 (0.0009) [2023-12-26 02:15:45,420][123091] Updated weights for policy 0, policy_version 335507 (0.0011) [2023-12-26 02:15:45,481][123091] Updated weights for policy 0, policy_version 335517 (0.0009) [2023-12-26 02:15:45,536][123091] Updated weights for policy 0, policy_version 335527 (0.0009) [2023-12-26 02:15:45,847][123090] Updated weights for policy 1, policy_version 333668 (0.0009) [2023-12-26 02:15:45,916][123090] Updated weights for policy 1, policy_version 333678 (0.0009) [2023-12-26 02:15:45,972][123090] Updated weights for policy 1, policy_version 333688 (0.0009) [2023-12-26 02:15:46,363][123091] Updated weights for policy 0, policy_version 335537 (0.0009) [2023-12-26 02:15:46,427][123091] Updated weights for policy 0, policy_version 335547 (0.0009) [2023-12-26 02:15:46,481][123091] Updated weights for policy 0, policy_version 335557 (0.0009) [2023-12-26 02:15:46,535][123091] Updated weights for policy 0, policy_version 335567 (0.0010) [2023-12-26 02:15:46,787][123090] Updated weights for policy 1, policy_version 333698 (0.0010) [2023-12-26 02:15:46,844][123090] Updated weights for policy 1, policy_version 333708 (0.0011) [2023-12-26 02:15:46,897][123090] Updated weights for policy 1, policy_version 333718 (0.0009) [2023-12-26 02:15:46,960][123090] Updated weights for policy 1, policy_version 333728 (0.0005) [2023-12-26 02:15:47,325][123091] Updated weights for policy 0, policy_version 335577 (0.0005) [2023-12-26 02:15:47,379][123091] Updated weights for policy 0, policy_version 335587 (0.0005) [2023-12-26 02:15:47,440][123091] Updated weights for policy 0, policy_version 335597 (0.0005) [2023-12-26 02:15:47,727][123090] Updated weights for policy 1, policy_version 333738 (0.0008) [2023-12-26 02:15:47,783][123090] Updated weights for policy 1, policy_version 333748 (0.0005) [2023-12-26 02:15:47,852][123090] Updated weights for policy 1, policy_version 333758 (0.0005) [2023-12-26 02:15:48,220][123091] Updated weights for policy 0, policy_version 335607 (0.0008) [2023-12-26 02:15:48,283][123091] Updated weights for policy 0, policy_version 335617 (0.0009) [2023-12-26 02:15:48,358][123091] Updated weights for policy 0, policy_version 335627 (0.0007) [2023-12-26 02:15:48,559][123090] Updated weights for policy 1, policy_version 333768 (0.0010) [2023-12-26 02:15:48,614][123090] Updated weights for policy 1, policy_version 333778 (0.0011) [2023-12-26 02:15:48,676][123090] Updated weights for policy 1, policy_version 333788 (0.0011) [2023-12-26 02:15:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 171376640. Throughput: 0: 8856.8, 1: 8785.9. Samples: 171385464. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:48,785][121949] Avg episode reward: [(0, '6146.678'), (1, '5649.089')] [2023-12-26 02:15:49,130][123091] Updated weights for policy 0, policy_version 335637 (0.0007) [2023-12-26 02:15:49,203][123091] Updated weights for policy 0, policy_version 335647 (0.0008) [2023-12-26 02:15:49,278][123091] Updated weights for policy 0, policy_version 335657 (0.0009) [2023-12-26 02:15:49,499][123090] Updated weights for policy 1, policy_version 333798 (0.0010) [2023-12-26 02:15:49,546][123090] Updated weights for policy 1, policy_version 333808 (0.0007) [2023-12-26 02:15:49,597][123090] Updated weights for policy 1, policy_version 333818 (0.0005) [2023-12-26 02:15:50,133][123091] Updated weights for policy 0, policy_version 335667 (0.0009) [2023-12-26 02:15:50,192][123091] Updated weights for policy 0, policy_version 335677 (0.0009) [2023-12-26 02:15:50,218][123090] Updated weights for policy 1, policy_version 333828 (0.0007) [2023-12-26 02:15:50,246][123091] Updated weights for policy 0, policy_version 335687 (0.0007) [2023-12-26 02:15:50,284][123090] Updated weights for policy 1, policy_version 333838 (0.0011) [2023-12-26 02:15:50,340][123090] Updated weights for policy 1, policy_version 333848 (0.0010) [2023-12-26 02:15:51,085][123091] Updated weights for policy 0, policy_version 335697 (0.0009) [2023-12-26 02:15:51,152][123091] Updated weights for policy 0, policy_version 335707 (0.0009) [2023-12-26 02:15:51,183][123090] Updated weights for policy 1, policy_version 333858 (0.0010) [2023-12-26 02:15:51,215][123091] Updated weights for policy 0, policy_version 335717 (0.0009) [2023-12-26 02:15:51,252][123090] Updated weights for policy 1, policy_version 333868 (0.0010) [2023-12-26 02:15:51,286][123091] Updated weights for policy 0, policy_version 335727 (0.0007) [2023-12-26 02:15:51,320][123090] Updated weights for policy 1, policy_version 333878 (0.0010) [2023-12-26 02:15:51,393][123090] Updated weights for policy 1, policy_version 333888 (0.0011) [2023-12-26 02:15:52,000][123091] Updated weights for policy 0, policy_version 335737 (0.0006) [2023-12-26 02:15:52,062][123091] Updated weights for policy 0, policy_version 335747 (0.0005) [2023-12-26 02:15:52,128][123091] Updated weights for policy 0, policy_version 335757 (0.0005) [2023-12-26 02:15:52,167][123090] Updated weights for policy 1, policy_version 333898 (0.0010) [2023-12-26 02:15:52,225][123090] Updated weights for policy 1, policy_version 333908 (0.0010) [2023-12-26 02:15:52,309][123090] Updated weights for policy 1, policy_version 333918 (0.0010) [2023-12-26 02:15:52,852][123091] Updated weights for policy 0, policy_version 335768 (0.0008) [2023-12-26 02:15:52,914][123091] Updated weights for policy 0, policy_version 335778 (0.0009) [2023-12-26 02:15:52,977][123091] Updated weights for policy 0, policy_version 335788 (0.0006) [2023-12-26 02:15:53,146][123090] Updated weights for policy 1, policy_version 333928 (0.0008) [2023-12-26 02:15:53,194][123090] Updated weights for policy 1, policy_version 333938 (0.0005) [2023-12-26 02:15:53,256][123090] Updated weights for policy 1, policy_version 333948 (0.0007) [2023-12-26 02:15:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 171458560. Throughput: 0: 8788.7, 1: 8790.2. Samples: 171437724. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:53,785][121949] Avg episode reward: [(0, '6091.208'), (1, '5519.229')] [2023-12-26 02:15:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000333952_85491712.pth... [2023-12-26 02:15:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000332928_85229568.pth [2023-12-26 02:15:53,810][123091] Updated weights for policy 0, policy_version 335798 (0.0006) [2023-12-26 02:15:53,872][123091] Updated weights for policy 0, policy_version 335808 (0.0005) [2023-12-26 02:15:53,936][123091] Updated weights for policy 0, policy_version 335818 (0.0005) [2023-12-26 02:15:53,973][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000335824_85975040.pth... [2023-12-26 02:15:53,978][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000334768_85704704.pth [2023-12-26 02:15:54,050][123090] Updated weights for policy 1, policy_version 333958 (0.0008) [2023-12-26 02:15:54,102][123090] Updated weights for policy 1, policy_version 333968 (0.0006) [2023-12-26 02:15:54,152][123090] Updated weights for policy 1, policy_version 333978 (0.0005) [2023-12-26 02:15:54,574][123091] Updated weights for policy 0, policy_version 335828 (0.0005) [2023-12-26 02:15:54,623][123091] Updated weights for policy 0, policy_version 335838 (0.0005) [2023-12-26 02:15:54,669][123091] Updated weights for policy 0, policy_version 335848 (0.0005) [2023-12-26 02:15:54,855][123090] Updated weights for policy 1, policy_version 333988 (0.0007) [2023-12-26 02:15:54,916][123090] Updated weights for policy 1, policy_version 333998 (0.0009) [2023-12-26 02:15:54,988][123090] Updated weights for policy 1, policy_version 334008 (0.0009) [2023-12-26 02:15:55,469][123091] Updated weights for policy 0, policy_version 335858 (0.0005) [2023-12-26 02:15:55,544][123091] Updated weights for policy 0, policy_version 335868 (0.0005) [2023-12-26 02:15:55,613][123091] Updated weights for policy 0, policy_version 335878 (0.0008) [2023-12-26 02:15:55,678][123091] Updated weights for policy 0, policy_version 335888 (0.0008) [2023-12-26 02:15:55,757][123090] Updated weights for policy 1, policy_version 334018 (0.0010) [2023-12-26 02:15:55,819][123090] Updated weights for policy 1, policy_version 334028 (0.0009) [2023-12-26 02:15:55,871][123090] Updated weights for policy 1, policy_version 334038 (0.0008) [2023-12-26 02:15:55,920][123090] Updated weights for policy 1, policy_version 334048 (0.0009) [2023-12-26 02:15:56,424][123091] Updated weights for policy 0, policy_version 335898 (0.0011) [2023-12-26 02:15:56,480][123091] Updated weights for policy 0, policy_version 335908 (0.0010) [2023-12-26 02:15:56,528][123091] Updated weights for policy 0, policy_version 335918 (0.0010) [2023-12-26 02:15:56,707][123090] Updated weights for policy 1, policy_version 334058 (0.0009) [2023-12-26 02:15:56,759][123090] Updated weights for policy 1, policy_version 334068 (0.0008) [2023-12-26 02:15:56,821][123090] Updated weights for policy 1, policy_version 334078 (0.0008) [2023-12-26 02:15:57,296][123091] Updated weights for policy 0, policy_version 335928 (0.0009) [2023-12-26 02:15:57,361][123091] Updated weights for policy 0, policy_version 335938 (0.0011) [2023-12-26 02:15:57,424][123091] Updated weights for policy 0, policy_version 335948 (0.0010) [2023-12-26 02:15:57,693][123090] Updated weights for policy 1, policy_version 334088 (0.0009) [2023-12-26 02:15:57,746][123090] Updated weights for policy 1, policy_version 334098 (0.0009) [2023-12-26 02:15:57,798][123090] Updated weights for policy 1, policy_version 334108 (0.0009) [2023-12-26 02:15:58,221][123091] Updated weights for policy 0, policy_version 335958 (0.0010) [2023-12-26 02:15:58,281][123091] Updated weights for policy 0, policy_version 335968 (0.0009) [2023-12-26 02:15:58,353][123091] Updated weights for policy 0, policy_version 335978 (0.0008) [2023-12-26 02:15:58,678][123090] Updated weights for policy 1, policy_version 334118 (0.0008) [2023-12-26 02:15:58,767][123090] Updated weights for policy 1, policy_version 334128 (0.0009) [2023-12-26 02:15:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 171548672. Throughput: 0: 8783.9, 1: 8883.7. Samples: 171546800. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:15:58,785][121949] Avg episode reward: [(0, '6103.701'), (1, '5659.881')] [2023-12-26 02:15:58,843][123090] Updated weights for policy 1, policy_version 334138 (0.0008) [2023-12-26 02:15:59,416][123091] Updated weights for policy 0, policy_version 335988 (0.0009) [2023-12-26 02:15:59,470][123091] Updated weights for policy 0, policy_version 335998 (0.0009) [2023-12-26 02:15:59,534][123091] Updated weights for policy 0, policy_version 336009 (0.0010) [2023-12-26 02:15:59,766][123090] Updated weights for policy 1, policy_version 334148 (0.0008) [2023-12-26 02:15:59,835][123090] Updated weights for policy 1, policy_version 334158 (0.0009) [2023-12-26 02:15:59,908][123090] Updated weights for policy 1, policy_version 334168 (0.0007) [2023-12-26 02:16:00,346][123091] Updated weights for policy 0, policy_version 336019 (0.0009) [2023-12-26 02:16:00,418][123091] Updated weights for policy 0, policy_version 336029 (0.0010) [2023-12-26 02:16:00,483][123091] Updated weights for policy 0, policy_version 336039 (0.0009) [2023-12-26 02:16:00,621][123090] Updated weights for policy 1, policy_version 334178 (0.0008) [2023-12-26 02:16:00,693][123090] Updated weights for policy 1, policy_version 334188 (0.0010) [2023-12-26 02:16:00,757][123090] Updated weights for policy 1, policy_version 334198 (0.0010) [2023-12-26 02:16:00,818][123090] Updated weights for policy 1, policy_version 334208 (0.0009) [2023-12-26 02:16:01,351][123091] Updated weights for policy 0, policy_version 336049 (0.0010) [2023-12-26 02:16:01,419][123091] Updated weights for policy 0, policy_version 336059 (0.0009) [2023-12-26 02:16:01,475][123091] Updated weights for policy 0, policy_version 336069 (0.0010) [2023-12-26 02:16:01,538][123091] Updated weights for policy 0, policy_version 336079 (0.0009) [2023-12-26 02:16:01,680][123090] Updated weights for policy 1, policy_version 334218 (0.0009) [2023-12-26 02:16:01,753][123090] Updated weights for policy 1, policy_version 334228 (0.0009) [2023-12-26 02:16:01,816][123090] Updated weights for policy 1, policy_version 334238 (0.0010) [2023-12-26 02:16:02,384][123091] Updated weights for policy 0, policy_version 336089 (0.0010) [2023-12-26 02:16:02,446][123091] Updated weights for policy 0, policy_version 336099 (0.0009) [2023-12-26 02:16:02,515][123091] Updated weights for policy 0, policy_version 336109 (0.0010) [2023-12-26 02:16:02,625][123090] Updated weights for policy 1, policy_version 334248 (0.0010) [2023-12-26 02:16:02,680][123090] Updated weights for policy 1, policy_version 334258 (0.0009) [2023-12-26 02:16:02,743][123090] Updated weights for policy 1, policy_version 334268 (0.0009) [2023-12-26 02:16:03,303][123091] Updated weights for policy 0, policy_version 336119 (0.0010) [2023-12-26 02:16:03,359][123091] Updated weights for policy 0, policy_version 336129 (0.0011) [2023-12-26 02:16:03,424][123091] Updated weights for policy 0, policy_version 336139 (0.0011) [2023-12-26 02:16:03,592][123090] Updated weights for policy 1, policy_version 334278 (0.0007) [2023-12-26 02:16:03,655][123090] Updated weights for policy 1, policy_version 334288 (0.0006) [2023-12-26 02:16:03,707][123090] Updated weights for policy 1, policy_version 334298 (0.0005) [2023-12-26 02:16:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 171638784. Throughput: 0: 8740.5, 1: 8740.5. Samples: 171645500. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:16:03,784][121949] Avg episode reward: [(0, '6157.167'), (1, '5651.006')] [2023-12-26 02:16:04,221][123091] Updated weights for policy 0, policy_version 336149 (0.0011) [2023-12-26 02:16:04,281][123091] Updated weights for policy 0, policy_version 336159 (0.0011) [2023-12-26 02:16:04,349][123091] Updated weights for policy 0, policy_version 336169 (0.0011) [2023-12-26 02:16:04,556][123090] Updated weights for policy 1, policy_version 334308 (0.0008) [2023-12-26 02:16:04,611][123090] Updated weights for policy 1, policy_version 334318 (0.0009) [2023-12-26 02:16:04,676][123090] Updated weights for policy 1, policy_version 334328 (0.0009) [2023-12-26 02:16:05,170][123091] Updated weights for policy 0, policy_version 336179 (0.0009) [2023-12-26 02:16:05,228][123091] Updated weights for policy 0, policy_version 336189 (0.0007) [2023-12-26 02:16:05,295][123091] Updated weights for policy 0, policy_version 336199 (0.0006) [2023-12-26 02:16:05,430][123090] Updated weights for policy 1, policy_version 334338 (0.0008) [2023-12-26 02:16:05,508][123090] Updated weights for policy 1, policy_version 334348 (0.0006) [2023-12-26 02:16:05,580][123090] Updated weights for policy 1, policy_version 334358 (0.0007) [2023-12-26 02:16:05,646][123090] Updated weights for policy 1, policy_version 334368 (0.0006) [2023-12-26 02:16:06,010][123091] Updated weights for policy 0, policy_version 336209 (0.0006) [2023-12-26 02:16:06,070][123091] Updated weights for policy 0, policy_version 336219 (0.0005) [2023-12-26 02:16:06,149][123091] Updated weights for policy 0, policy_version 336229 (0.0009) [2023-12-26 02:16:06,218][123091] Updated weights for policy 0, policy_version 336239 (0.0009) [2023-12-26 02:16:06,450][123090] Updated weights for policy 1, policy_version 334378 (0.0010) [2023-12-26 02:16:06,517][123090] Updated weights for policy 1, policy_version 334388 (0.0009) [2023-12-26 02:16:06,585][123090] Updated weights for policy 1, policy_version 334398 (0.0009) [2023-12-26 02:16:06,936][123091] Updated weights for policy 0, policy_version 336249 (0.0009) [2023-12-26 02:16:06,983][123091] Updated weights for policy 0, policy_version 336259 (0.0010) [2023-12-26 02:16:07,035][123091] Updated weights for policy 0, policy_version 336269 (0.0010) [2023-12-26 02:16:07,458][123090] Updated weights for policy 1, policy_version 334408 (0.0007) [2023-12-26 02:16:07,526][123090] Updated weights for policy 1, policy_version 334418 (0.0005) [2023-12-26 02:16:07,597][123090] Updated weights for policy 1, policy_version 334428 (0.0005) [2023-12-26 02:16:07,878][123091] Updated weights for policy 0, policy_version 336279 (0.0010) [2023-12-26 02:16:07,929][123091] Updated weights for policy 0, policy_version 336289 (0.0010) [2023-12-26 02:16:07,973][123091] Updated weights for policy 0, policy_version 336299 (0.0010) [2023-12-26 02:16:08,333][123090] Updated weights for policy 1, policy_version 334438 (0.0007) [2023-12-26 02:16:08,399][123090] Updated weights for policy 1, policy_version 334448 (0.0007) [2023-12-26 02:16:08,455][123090] Updated weights for policy 1, policy_version 334458 (0.0006) [2023-12-26 02:16:08,753][123091] Updated weights for policy 0, policy_version 336309 (0.0009) [2023-12-26 02:16:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 171720704. Throughput: 0: 8801.6, 1: 8737.7. Samples: 171698372. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:16:08,784][121949] Avg episode reward: [(0, '6168.159'), (1, '5616.643')] [2023-12-26 02:16:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000334464_85622784.pth... [2023-12-26 02:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000333440_85360640.pth [2023-12-26 02:16:08,815][123091] Updated weights for policy 0, policy_version 336319 (0.0007) [2023-12-26 02:16:08,875][123091] Updated weights for policy 0, policy_version 336330 (0.0010) [2023-12-26 02:16:08,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000336336_86106112.pth... [2023-12-26 02:16:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000335312_85843968.pth [2023-12-26 02:16:09,312][123090] Updated weights for policy 1, policy_version 334468 (0.0009) [2023-12-26 02:16:09,383][123090] Updated weights for policy 1, policy_version 334478 (0.0009) [2023-12-26 02:16:09,457][123090] Updated weights for policy 1, policy_version 334488 (0.0009) [2023-12-26 02:16:09,647][123091] Updated weights for policy 0, policy_version 336340 (0.0008) [2023-12-26 02:16:09,710][123091] Updated weights for policy 0, policy_version 336350 (0.0008) [2023-12-26 02:16:09,781][123091] Updated weights for policy 0, policy_version 336360 (0.0008) [2023-12-26 02:16:10,343][123090] Updated weights for policy 1, policy_version 334498 (0.0010) [2023-12-26 02:16:10,401][123090] Updated weights for policy 1, policy_version 334508 (0.0009) [2023-12-26 02:16:10,462][123090] Updated weights for policy 1, policy_version 334518 (0.0009) [2023-12-26 02:16:10,531][123090] Updated weights for policy 1, policy_version 334528 (0.0009) [2023-12-26 02:16:10,578][123091] Updated weights for policy 0, policy_version 336370 (0.0009) [2023-12-26 02:16:10,629][123091] Updated weights for policy 0, policy_version 336380 (0.0009) [2023-12-26 02:16:10,682][123091] Updated weights for policy 0, policy_version 336390 (0.0005) [2023-12-26 02:16:10,730][123091] Updated weights for policy 0, policy_version 336400 (0.0005) [2023-12-26 02:16:11,447][123090] Updated weights for policy 1, policy_version 334538 (0.0010) [2023-12-26 02:16:11,490][123091] Updated weights for policy 0, policy_version 336410 (0.0009) [2023-12-26 02:16:11,508][123090] Updated weights for policy 1, policy_version 334548 (0.0008) [2023-12-26 02:16:11,549][123091] Updated weights for policy 0, policy_version 336420 (0.0006) [2023-12-26 02:16:11,570][123090] Updated weights for policy 1, policy_version 334558 (0.0010) [2023-12-26 02:16:11,611][123091] Updated weights for policy 0, policy_version 336430 (0.0007) [2023-12-26 02:16:12,400][123090] Updated weights for policy 1, policy_version 334568 (0.0010) [2023-12-26 02:16:12,447][123091] Updated weights for policy 0, policy_version 336440 (0.0010) [2023-12-26 02:16:12,464][123090] Updated weights for policy 1, policy_version 334578 (0.0011) [2023-12-26 02:16:12,506][123091] Updated weights for policy 0, policy_version 336450 (0.0011) [2023-12-26 02:16:12,528][123090] Updated weights for policy 1, policy_version 334588 (0.0011) [2023-12-26 02:16:12,574][123091] Updated weights for policy 0, policy_version 336460 (0.0011) [2023-12-26 02:16:13,306][123090] Updated weights for policy 1, policy_version 334598 (0.0007) [2023-12-26 02:16:13,352][123090] Updated weights for policy 1, policy_version 334608 (0.0005) [2023-12-26 02:16:13,411][123091] Updated weights for policy 0, policy_version 336470 (0.0011) [2023-12-26 02:16:13,421][123090] Updated weights for policy 1, policy_version 334618 (0.0005) [2023-12-26 02:16:13,474][123091] Updated weights for policy 0, policy_version 336480 (0.0011) [2023-12-26 02:16:13,540][123091] Updated weights for policy 0, policy_version 336490 (0.0011) [2023-12-26 02:16:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 171810816. Throughput: 0: 8785.1, 1: 8624.4. Samples: 171801552. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:16:13,785][121949] Avg episode reward: [(0, '6137.280'), (1, '5693.223')] [2023-12-26 02:16:14,130][123090] Updated weights for policy 1, policy_version 334628 (0.0007) [2023-12-26 02:16:14,188][123090] Updated weights for policy 1, policy_version 334638 (0.0005) [2023-12-26 02:16:14,245][123090] Updated weights for policy 1, policy_version 334648 (0.0005) [2023-12-26 02:16:14,350][123091] Updated weights for policy 0, policy_version 336500 (0.0011) [2023-12-26 02:16:14,413][123091] Updated weights for policy 0, policy_version 336510 (0.0010) [2023-12-26 02:16:14,477][123091] Updated weights for policy 0, policy_version 336520 (0.0005) [2023-12-26 02:16:15,043][123090] Updated weights for policy 1, policy_version 334658 (0.0008) [2023-12-26 02:16:15,101][123090] Updated weights for policy 1, policy_version 334668 (0.0009) [2023-12-26 02:16:15,163][123091] Updated weights for policy 0, policy_version 336530 (0.0006) [2023-12-26 02:16:15,164][123090] Updated weights for policy 1, policy_version 334678 (0.0009) [2023-12-26 02:16:15,228][123091] Updated weights for policy 0, policy_version 336540 (0.0008) [2023-12-26 02:16:15,235][123090] Updated weights for policy 1, policy_version 334688 (0.0007) [2023-12-26 02:16:15,293][123091] Updated weights for policy 0, policy_version 336550 (0.0011) [2023-12-26 02:16:15,357][123091] Updated weights for policy 0, policy_version 336560 (0.0011) [2023-12-26 02:16:16,106][123091] Updated weights for policy 0, policy_version 336570 (0.0011) [2023-12-26 02:16:16,126][123090] Updated weights for policy 1, policy_version 334698 (0.0005) [2023-12-26 02:16:16,168][123091] Updated weights for policy 0, policy_version 336580 (0.0011) [2023-12-26 02:16:16,188][123090] Updated weights for policy 1, policy_version 334708 (0.0005) [2023-12-26 02:16:16,228][123091] Updated weights for policy 0, policy_version 336590 (0.0010) [2023-12-26 02:16:16,254][123090] Updated weights for policy 1, policy_version 334718 (0.0005) [2023-12-26 02:16:16,900][123090] Updated weights for policy 1, policy_version 334728 (0.0006) [2023-12-26 02:16:16,923][123091] Updated weights for policy 0, policy_version 336600 (0.0007) [2023-12-26 02:16:16,963][123090] Updated weights for policy 1, policy_version 334738 (0.0005) [2023-12-26 02:16:16,983][123091] Updated weights for policy 0, policy_version 336610 (0.0005) [2023-12-26 02:16:17,015][123090] Updated weights for policy 1, policy_version 334748 (0.0006) [2023-12-26 02:16:17,048][123091] Updated weights for policy 0, policy_version 336620 (0.0006) [2023-12-26 02:16:17,694][123091] Updated weights for policy 0, policy_version 336630 (0.0006) [2023-12-26 02:16:17,696][123090] Updated weights for policy 1, policy_version 334758 (0.0008) [2023-12-26 02:16:17,755][123091] Updated weights for policy 0, policy_version 336640 (0.0006) [2023-12-26 02:16:17,756][123090] Updated weights for policy 1, policy_version 334768 (0.0009) [2023-12-26 02:16:17,817][123090] Updated weights for policy 1, policy_version 334778 (0.0005) [2023-12-26 02:16:17,823][123091] Updated weights for policy 0, policy_version 336650 (0.0005) [2023-12-26 02:16:18,533][123090] Updated weights for policy 1, policy_version 334788 (0.0005) [2023-12-26 02:16:18,595][123090] Updated weights for policy 1, policy_version 334798 (0.0010) [2023-12-26 02:16:18,639][123091] Updated weights for policy 0, policy_version 336660 (0.0009) [2023-12-26 02:16:18,653][123090] Updated weights for policy 1, policy_version 334808 (0.0009) [2023-12-26 02:16:18,710][123091] Updated weights for policy 0, policy_version 336670 (0.0009) [2023-12-26 02:16:18,779][123091] Updated weights for policy 0, policy_version 336680 (0.0009) [2023-12-26 02:16:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 171900928. Throughput: 0: 8841.2, 1: 8702.1. Samples: 171913400. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 02:16:18,785][121949] Avg episode reward: [(0, '6153.744'), (1, '5455.480')] [2023-12-26 02:16:19,441][123090] Updated weights for policy 1, policy_version 334818 (0.0007) [2023-12-26 02:16:19,507][123090] Updated weights for policy 1, policy_version 334828 (0.0007) [2023-12-26 02:16:19,569][123090] Updated weights for policy 1, policy_version 334838 (0.0006) [2023-12-26 02:16:19,628][123090] Updated weights for policy 1, policy_version 334848 (0.0006) [2023-12-26 02:16:19,675][123091] Updated weights for policy 0, policy_version 336690 (0.0009) [2023-12-26 02:16:19,725][123091] Updated weights for policy 0, policy_version 336700 (0.0007) [2023-12-26 02:16:19,787][123091] Updated weights for policy 0, policy_version 336710 (0.0009) [2023-12-26 02:16:19,841][123091] Updated weights for policy 0, policy_version 336720 (0.0009) [2023-12-26 02:16:20,419][123090] Updated weights for policy 1, policy_version 334858 (0.0010) [2023-12-26 02:16:20,493][123090] Updated weights for policy 1, policy_version 334868 (0.0005) [2023-12-26 02:16:20,552][123090] Updated weights for policy 1, policy_version 334878 (0.0006) [2023-12-26 02:16:20,672][123091] Updated weights for policy 0, policy_version 336730 (0.0006) [2023-12-26 02:16:20,743][123091] Updated weights for policy 0, policy_version 336740 (0.0006) [2023-12-26 02:16:20,820][123091] Updated weights for policy 0, policy_version 336750 (0.0006) [2023-12-26 02:16:21,315][123090] Updated weights for policy 1, policy_version 334888 (0.0009) [2023-12-26 02:16:21,382][123090] Updated weights for policy 1, policy_version 334898 (0.0010) [2023-12-26 02:16:21,447][123090] Updated weights for policy 1, policy_version 334908 (0.0009) [2023-12-26 02:16:21,536][123091] Updated weights for policy 0, policy_version 336760 (0.0008) [2023-12-26 02:16:21,603][123091] Updated weights for policy 0, policy_version 336770 (0.0010) [2023-12-26 02:16:21,669][123091] Updated weights for policy 0, policy_version 336780 (0.0009) [2023-12-26 02:16:22,342][123090] Updated weights for policy 1, policy_version 334918 (0.0009) [2023-12-26 02:16:22,417][123090] Updated weights for policy 1, policy_version 334928 (0.0008) [2023-12-26 02:16:22,459][123091] Updated weights for policy 0, policy_version 336790 (0.0008) [2023-12-26 02:16:22,479][123090] Updated weights for policy 1, policy_version 334938 (0.0007) [2023-12-26 02:16:22,525][123091] Updated weights for policy 0, policy_version 336800 (0.0007) [2023-12-26 02:16:22,585][123091] Updated weights for policy 0, policy_version 336810 (0.0010) [2023-12-26 02:16:23,249][123090] Updated weights for policy 1, policy_version 334948 (0.0009) [2023-12-26 02:16:23,313][123090] Updated weights for policy 1, policy_version 334958 (0.0006) [2023-12-26 02:16:23,381][123090] Updated weights for policy 1, policy_version 334968 (0.0005) [2023-12-26 02:16:23,420][123091] Updated weights for policy 0, policy_version 336820 (0.0009) [2023-12-26 02:16:23,481][123091] Updated weights for policy 0, policy_version 336830 (0.0009) [2023-12-26 02:16:23,539][123091] Updated weights for policy 0, policy_version 336840 (0.0009) [2023-12-26 02:16:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 171991040. Throughput: 0: 8770.1, 1: 8672.7. Samples: 171965084. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:23,785][121949] Avg episode reward: [(0, '6200.089'), (1, '5321.964')] [2023-12-26 02:16:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000334976_85753856.pth... [2023-12-26 02:16:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000336848_86237184.pth... [2023-12-26 02:16:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000333952_85491712.pth [2023-12-26 02:16:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000335824_85975040.pth [2023-12-26 02:16:24,136][123090] Updated weights for policy 1, policy_version 334978 (0.0008) [2023-12-26 02:16:24,192][123090] Updated weights for policy 1, policy_version 334988 (0.0009) [2023-12-26 02:16:24,251][123090] Updated weights for policy 1, policy_version 334998 (0.0009) [2023-12-26 02:16:24,311][123090] Updated weights for policy 1, policy_version 335008 (0.0009) [2023-12-26 02:16:24,354][123091] Updated weights for policy 0, policy_version 336850 (0.0009) [2023-12-26 02:16:24,414][123091] Updated weights for policy 0, policy_version 336861 (0.0009) [2023-12-26 02:16:24,466][123091] Updated weights for policy 0, policy_version 336871 (0.0010) [2023-12-26 02:16:25,079][123090] Updated weights for policy 1, policy_version 335018 (0.0009) [2023-12-26 02:16:25,136][123090] Updated weights for policy 1, policy_version 335028 (0.0005) [2023-12-26 02:16:25,213][123090] Updated weights for policy 1, policy_version 335038 (0.0005) [2023-12-26 02:16:25,349][123091] Updated weights for policy 0, policy_version 336881 (0.0010) [2023-12-26 02:16:25,398][123091] Updated weights for policy 0, policy_version 336891 (0.0009) [2023-12-26 02:16:25,445][123091] Updated weights for policy 0, policy_version 336901 (0.0008) [2023-12-26 02:16:25,493][123091] Updated weights for policy 0, policy_version 336911 (0.0009) [2023-12-26 02:16:25,982][123090] Updated weights for policy 1, policy_version 335048 (0.0009) [2023-12-26 02:16:26,032][123090] Updated weights for policy 1, policy_version 335058 (0.0010) [2023-12-26 02:16:26,091][123090] Updated weights for policy 1, policy_version 335068 (0.0010) [2023-12-26 02:16:26,352][123091] Updated weights for policy 0, policy_version 336921 (0.0009) [2023-12-26 02:16:26,408][123091] Updated weights for policy 0, policy_version 336931 (0.0009) [2023-12-26 02:16:26,456][123091] Updated weights for policy 0, policy_version 336941 (0.0009) [2023-12-26 02:16:26,914][123090] Updated weights for policy 1, policy_version 335078 (0.0010) [2023-12-26 02:16:26,975][123090] Updated weights for policy 1, policy_version 335088 (0.0010) [2023-12-26 02:16:27,033][123090] Updated weights for policy 1, policy_version 335098 (0.0010) [2023-12-26 02:16:27,167][123091] Updated weights for policy 0, policy_version 336951 (0.0009) [2023-12-26 02:16:27,221][123091] Updated weights for policy 0, policy_version 336961 (0.0009) [2023-12-26 02:16:27,269][123091] Updated weights for policy 0, policy_version 336971 (0.0009) [2023-12-26 02:16:27,809][123090] Updated weights for policy 1, policy_version 335108 (0.0008) [2023-12-26 02:16:27,862][123090] Updated weights for policy 1, policy_version 335118 (0.0006) [2023-12-26 02:16:27,911][123090] Updated weights for policy 1, policy_version 335128 (0.0008) [2023-12-26 02:16:28,160][123091] Updated weights for policy 0, policy_version 336981 (0.0010) [2023-12-26 02:16:28,217][123091] Updated weights for policy 0, policy_version 336991 (0.0014) [2023-12-26 02:16:28,270][123091] Updated weights for policy 0, policy_version 337001 (0.0009) [2023-12-26 02:16:28,546][123090] Updated weights for policy 1, policy_version 335138 (0.0006) [2023-12-26 02:16:28,607][123090] Updated weights for policy 1, policy_version 335148 (0.0006) [2023-12-26 02:16:28,664][123090] Updated weights for policy 1, policy_version 335158 (0.0008) [2023-12-26 02:16:28,730][123090] Updated weights for policy 1, policy_version 335168 (0.0005) [2023-12-26 02:16:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 172081152. Throughput: 0: 8810.9, 1: 8750.1. Samples: 172070404. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:28,785][121949] Avg episode reward: [(0, '6185.820'), (1, '5397.870')] [2023-12-26 02:16:29,161][123091] Updated weights for policy 0, policy_version 337011 (0.0008) [2023-12-26 02:16:29,229][123091] Updated weights for policy 0, policy_version 337021 (0.0008) [2023-12-26 02:16:29,286][123091] Updated weights for policy 0, policy_version 337031 (0.0009) [2023-12-26 02:16:29,420][123090] Updated weights for policy 1, policy_version 335178 (0.0010) [2023-12-26 02:16:29,483][123090] Updated weights for policy 1, policy_version 335188 (0.0010) [2023-12-26 02:16:29,547][123090] Updated weights for policy 1, policy_version 335198 (0.0010) [2023-12-26 02:16:30,098][123091] Updated weights for policy 0, policy_version 337041 (0.0009) [2023-12-26 02:16:30,173][123091] Updated weights for policy 0, policy_version 337051 (0.0006) [2023-12-26 02:16:30,217][123090] Updated weights for policy 1, policy_version 335208 (0.0007) [2023-12-26 02:16:30,239][123091] Updated weights for policy 0, policy_version 337061 (0.0009) [2023-12-26 02:16:30,269][123090] Updated weights for policy 1, policy_version 335219 (0.0009) [2023-12-26 02:16:30,300][123091] Updated weights for policy 0, policy_version 337071 (0.0006) [2023-12-26 02:16:30,323][123090] Updated weights for policy 1, policy_version 335230 (0.0009) [2023-12-26 02:16:31,068][123091] Updated weights for policy 0, policy_version 337081 (0.0010) [2023-12-26 02:16:31,136][123091] Updated weights for policy 0, policy_version 337091 (0.0009) [2023-12-26 02:16:31,139][123090] Updated weights for policy 1, policy_version 335240 (0.0009) [2023-12-26 02:16:31,187][123091] Updated weights for policy 0, policy_version 337101 (0.0007) [2023-12-26 02:16:31,197][123090] Updated weights for policy 1, policy_version 335250 (0.0006) [2023-12-26 02:16:31,263][123090] Updated weights for policy 1, policy_version 335260 (0.0006) [2023-12-26 02:16:31,945][123091] Updated weights for policy 0, policy_version 337111 (0.0005) [2023-12-26 02:16:31,953][123090] Updated weights for policy 1, policy_version 335270 (0.0008) [2023-12-26 02:16:32,009][123091] Updated weights for policy 0, policy_version 337121 (0.0005) [2023-12-26 02:16:32,021][123090] Updated weights for policy 1, policy_version 335280 (0.0008) [2023-12-26 02:16:32,071][123091] Updated weights for policy 0, policy_version 337131 (0.0007) [2023-12-26 02:16:32,082][123090] Updated weights for policy 1, policy_version 335290 (0.0006) [2023-12-26 02:16:32,811][123090] Updated weights for policy 1, policy_version 335300 (0.0007) [2023-12-26 02:16:32,875][123090] Updated weights for policy 1, policy_version 335310 (0.0009) [2023-12-26 02:16:32,882][123091] Updated weights for policy 0, policy_version 337141 (0.0009) [2023-12-26 02:16:32,927][123090] Updated weights for policy 1, policy_version 335320 (0.0007) [2023-12-26 02:16:32,929][123091] Updated weights for policy 0, policy_version 337151 (0.0006) [2023-12-26 02:16:32,978][123091] Updated weights for policy 0, policy_version 337161 (0.0009) [2023-12-26 02:16:33,764][123090] Updated weights for policy 1, policy_version 335330 (0.0007) [2023-12-26 02:16:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 172163072. Throughput: 0: 8778.1, 1: 8847.4. Samples: 172178608. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:33,785][121949] Avg episode reward: [(0, '6104.280'), (1, '5416.237')] [2023-12-26 02:16:33,834][123090] Updated weights for policy 1, policy_version 335340 (0.0008) [2023-12-26 02:16:33,849][123091] Updated weights for policy 0, policy_version 337171 (0.0009) [2023-12-26 02:16:33,895][123090] Updated weights for policy 1, policy_version 335350 (0.0008) [2023-12-26 02:16:33,915][123091] Updated weights for policy 0, policy_version 337181 (0.0008) [2023-12-26 02:16:33,949][123090] Updated weights for policy 1, policy_version 335360 (0.0009) [2023-12-26 02:16:33,979][123091] Updated weights for policy 0, policy_version 337191 (0.0009) [2023-12-26 02:16:34,782][123090] Updated weights for policy 1, policy_version 335370 (0.0009) [2023-12-26 02:16:34,787][123091] Updated weights for policy 0, policy_version 337201 (0.0009) [2023-12-26 02:16:34,846][123090] Updated weights for policy 1, policy_version 335380 (0.0008) [2023-12-26 02:16:34,856][123091] Updated weights for policy 0, policy_version 337211 (0.0009) [2023-12-26 02:16:34,906][123090] Updated weights for policy 1, policy_version 335390 (0.0008) [2023-12-26 02:16:34,917][123091] Updated weights for policy 0, policy_version 337221 (0.0006) [2023-12-26 02:16:34,970][123091] Updated weights for policy 0, policy_version 337231 (0.0009) [2023-12-26 02:16:35,736][123090] Updated weights for policy 1, policy_version 335400 (0.0009) [2023-12-26 02:16:35,779][123091] Updated weights for policy 0, policy_version 337241 (0.0008) [2023-12-26 02:16:35,796][123090] Updated weights for policy 1, policy_version 335410 (0.0009) [2023-12-26 02:16:35,827][123091] Updated weights for policy 0, policy_version 337251 (0.0009) [2023-12-26 02:16:35,851][123090] Updated weights for policy 1, policy_version 335420 (0.0008) [2023-12-26 02:16:35,880][123091] Updated weights for policy 0, policy_version 337262 (0.0008) [2023-12-26 02:16:36,694][123090] Updated weights for policy 1, policy_version 335430 (0.0007) [2023-12-26 02:16:36,763][123090] Updated weights for policy 1, policy_version 335440 (0.0007) [2023-12-26 02:16:36,779][123091] Updated weights for policy 0, policy_version 337272 (0.0008) [2023-12-26 02:16:36,837][123090] Updated weights for policy 1, policy_version 335450 (0.0008) [2023-12-26 02:16:36,854][123091] Updated weights for policy 0, policy_version 337282 (0.0006) [2023-12-26 02:16:36,917][123091] Updated weights for policy 0, policy_version 337292 (0.0007) [2023-12-26 02:16:37,646][123090] Updated weights for policy 1, policy_version 335460 (0.0009) [2023-12-26 02:16:37,691][123091] Updated weights for policy 0, policy_version 337302 (0.0008) [2023-12-26 02:16:37,703][123090] Updated weights for policy 1, policy_version 335470 (0.0008) [2023-12-26 02:16:37,751][123091] Updated weights for policy 0, policy_version 337312 (0.0008) [2023-12-26 02:16:37,765][123090] Updated weights for policy 1, policy_version 335480 (0.0009) [2023-12-26 02:16:37,815][123091] Updated weights for policy 0, policy_version 337322 (0.0009) [2023-12-26 02:16:38,538][123090] Updated weights for policy 1, policy_version 335490 (0.0009) [2023-12-26 02:16:38,557][123091] Updated weights for policy 0, policy_version 337332 (0.0009) [2023-12-26 02:16:38,607][123090] Updated weights for policy 1, policy_version 335500 (0.0009) [2023-12-26 02:16:38,624][123091] Updated weights for policy 0, policy_version 337342 (0.0007) [2023-12-26 02:16:38,674][123090] Updated weights for policy 1, policy_version 335510 (0.0009) [2023-12-26 02:16:38,690][123091] Updated weights for policy 0, policy_version 337352 (0.0007) [2023-12-26 02:16:38,737][123090] Updated weights for policy 1, policy_version 335520 (0.0008) [2023-12-26 02:16:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 172261376. Throughput: 0: 8777.0, 1: 8823.5. Samples: 172229744. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:38,785][121949] Avg episode reward: [(0, '6115.934'), (1, '5651.247')] [2023-12-26 02:16:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000335520_85893120.pth... [2023-12-26 02:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000337360_86368256.pth... [2023-12-26 02:16:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000334464_85622784.pth [2023-12-26 02:16:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000336336_86106112.pth [2023-12-26 02:16:39,306][123091] Updated weights for policy 0, policy_version 337362 (0.0007) [2023-12-26 02:16:39,381][123091] Updated weights for policy 0, policy_version 337372 (0.0008) [2023-12-26 02:16:39,453][123091] Updated weights for policy 0, policy_version 337382 (0.0010) [2023-12-26 02:16:39,520][123091] Updated weights for policy 0, policy_version 337392 (0.0009) [2023-12-26 02:16:39,627][123090] Updated weights for policy 1, policy_version 335530 (0.0009) [2023-12-26 02:16:39,692][123090] Updated weights for policy 1, policy_version 335540 (0.0010) [2023-12-26 02:16:39,759][123090] Updated weights for policy 1, policy_version 335550 (0.0010) [2023-12-26 02:16:40,328][123091] Updated weights for policy 0, policy_version 337402 (0.0007) [2023-12-26 02:16:40,402][123091] Updated weights for policy 0, policy_version 337412 (0.0007) [2023-12-26 02:16:40,467][123091] Updated weights for policy 0, policy_version 337422 (0.0009) [2023-12-26 02:16:40,639][123090] Updated weights for policy 1, policy_version 335560 (0.0010) [2023-12-26 02:16:40,692][123090] Updated weights for policy 1, policy_version 335570 (0.0006) [2023-12-26 02:16:40,757][123090] Updated weights for policy 1, policy_version 335580 (0.0006) [2023-12-26 02:16:41,312][123091] Updated weights for policy 0, policy_version 337432 (0.0010) [2023-12-26 02:16:41,382][123091] Updated weights for policy 0, policy_version 337442 (0.0009) [2023-12-26 02:16:41,451][123091] Updated weights for policy 0, policy_version 337452 (0.0011) [2023-12-26 02:16:41,510][123090] Updated weights for policy 1, policy_version 335590 (0.0006) [2023-12-26 02:16:41,581][123090] Updated weights for policy 1, policy_version 335600 (0.0008) [2023-12-26 02:16:41,650][123090] Updated weights for policy 1, policy_version 335610 (0.0008) [2023-12-26 02:16:42,278][123091] Updated weights for policy 0, policy_version 337462 (0.0010) [2023-12-26 02:16:42,328][123091] Updated weights for policy 0, policy_version 337472 (0.0010) [2023-12-26 02:16:42,392][123091] Updated weights for policy 0, policy_version 337482 (0.0007) [2023-12-26 02:16:42,514][123090] Updated weights for policy 1, policy_version 335620 (0.0010) [2023-12-26 02:16:42,570][123090] Updated weights for policy 1, policy_version 335630 (0.0010) [2023-12-26 02:16:42,627][123090] Updated weights for policy 1, policy_version 335640 (0.0009) [2023-12-26 02:16:43,159][123091] Updated weights for policy 0, policy_version 337492 (0.0008) [2023-12-26 02:16:43,211][123091] Updated weights for policy 0, policy_version 337502 (0.0007) [2023-12-26 02:16:43,266][123091] Updated weights for policy 0, policy_version 337512 (0.0010) [2023-12-26 02:16:43,468][123090] Updated weights for policy 1, policy_version 335650 (0.0010) [2023-12-26 02:16:43,527][123090] Updated weights for policy 1, policy_version 335661 (0.0011) [2023-12-26 02:16:43,582][123090] Updated weights for policy 1, policy_version 335672 (0.0011) [2023-12-26 02:16:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 172343296. Throughput: 0: 8735.2, 1: 8751.5. Samples: 172333704. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:43,785][121949] Avg episode reward: [(0, '6218.513'), (1, '5821.536')] [2023-12-26 02:16:43,994][123091] Updated weights for policy 0, policy_version 337522 (0.0010) [2023-12-26 02:16:44,046][123091] Updated weights for policy 0, policy_version 337532 (0.0010) [2023-12-26 02:16:44,093][123091] Updated weights for policy 0, policy_version 337542 (0.0010) [2023-12-26 02:16:44,152][123091] Updated weights for policy 0, policy_version 337552 (0.0010) [2023-12-26 02:16:44,483][123090] Updated weights for policy 1, policy_version 335682 (0.0010) [2023-12-26 02:16:44,546][123090] Updated weights for policy 1, policy_version 335692 (0.0010) [2023-12-26 02:16:44,607][123090] Updated weights for policy 1, policy_version 335702 (0.0009) [2023-12-26 02:16:44,667][123090] Updated weights for policy 1, policy_version 335712 (0.0008) [2023-12-26 02:16:45,003][123091] Updated weights for policy 0, policy_version 337562 (0.0011) [2023-12-26 02:16:45,063][123091] Updated weights for policy 0, policy_version 337572 (0.0011) [2023-12-26 02:16:45,130][123091] Updated weights for policy 0, policy_version 337582 (0.0011) [2023-12-26 02:16:45,479][123090] Updated weights for policy 1, policy_version 335722 (0.0005) [2023-12-26 02:16:45,529][123090] Updated weights for policy 1, policy_version 335732 (0.0005) [2023-12-26 02:16:45,581][123090] Updated weights for policy 1, policy_version 335742 (0.0007) [2023-12-26 02:16:45,876][123091] Updated weights for policy 0, policy_version 337592 (0.0006) [2023-12-26 02:16:45,944][123091] Updated weights for policy 0, policy_version 337602 (0.0007) [2023-12-26 02:16:45,995][123091] Updated weights for policy 0, policy_version 337612 (0.0010) [2023-12-26 02:16:46,439][123090] Updated weights for policy 1, policy_version 335752 (0.0009) [2023-12-26 02:16:46,493][123090] Updated weights for policy 1, policy_version 335762 (0.0007) [2023-12-26 02:16:46,544][123090] Updated weights for policy 1, policy_version 335772 (0.0008) [2023-12-26 02:16:46,795][123091] Updated weights for policy 0, policy_version 337622 (0.0008) [2023-12-26 02:16:46,849][123091] Updated weights for policy 0, policy_version 337632 (0.0005) [2023-12-26 02:16:46,918][123091] Updated weights for policy 0, policy_version 337642 (0.0005) [2023-12-26 02:16:47,410][123090] Updated weights for policy 1, policy_version 335782 (0.0010) [2023-12-26 02:16:47,468][123090] Updated weights for policy 1, policy_version 335792 (0.0009) [2023-12-26 02:16:47,515][123090] Updated weights for policy 1, policy_version 335802 (0.0008) [2023-12-26 02:16:47,675][123091] Updated weights for policy 0, policy_version 337652 (0.0005) [2023-12-26 02:16:47,742][123091] Updated weights for policy 0, policy_version 337662 (0.0009) [2023-12-26 02:16:47,798][123091] Updated weights for policy 0, policy_version 337672 (0.0011) [2023-12-26 02:16:48,415][123090] Updated weights for policy 1, policy_version 335812 (0.0009) [2023-12-26 02:16:48,472][123090] Updated weights for policy 1, policy_version 335822 (0.0010) [2023-12-26 02:16:48,532][123090] Updated weights for policy 1, policy_version 335832 (0.0010) [2023-12-26 02:16:48,555][123091] Updated weights for policy 0, policy_version 337682 (0.0010) [2023-12-26 02:16:48,623][123091] Updated weights for policy 0, policy_version 337692 (0.0007) [2023-12-26 02:16:48,698][123091] Updated weights for policy 0, policy_version 337702 (0.0009) [2023-12-26 02:16:48,767][123091] Updated weights for policy 0, policy_version 337712 (0.0009) [2023-12-26 02:16:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 172433408. Throughput: 0: 8884.8, 1: 8764.4. Samples: 172439716. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:48,784][121949] Avg episode reward: [(0, '6320.440'), (1, '5792.155')] [2023-12-26 02:16:49,308][123090] Updated weights for policy 1, policy_version 335842 (0.0010) [2023-12-26 02:16:49,379][123090] Updated weights for policy 1, policy_version 335852 (0.0008) [2023-12-26 02:16:49,444][123090] Updated weights for policy 1, policy_version 335862 (0.0008) [2023-12-26 02:16:49,504][123090] Updated weights for policy 1, policy_version 335872 (0.0007) [2023-12-26 02:16:49,509][123091] Updated weights for policy 0, policy_version 337722 (0.0008) [2023-12-26 02:16:49,564][123091] Updated weights for policy 0, policy_version 337732 (0.0010) [2023-12-26 02:16:49,633][123091] Updated weights for policy 0, policy_version 337742 (0.0010) [2023-12-26 02:16:50,317][123090] Updated weights for policy 1, policy_version 335882 (0.0009) [2023-12-26 02:16:50,382][123090] Updated weights for policy 1, policy_version 335892 (0.0009) [2023-12-26 02:16:50,435][123091] Updated weights for policy 0, policy_version 337752 (0.0010) [2023-12-26 02:16:50,437][123090] Updated weights for policy 1, policy_version 335902 (0.0009) [2023-12-26 02:16:50,490][123091] Updated weights for policy 0, policy_version 337762 (0.0010) [2023-12-26 02:16:50,552][123091] Updated weights for policy 0, policy_version 337772 (0.0010) [2023-12-26 02:16:51,283][123090] Updated weights for policy 1, policy_version 335912 (0.0009) [2023-12-26 02:16:51,344][123090] Updated weights for policy 1, policy_version 335922 (0.0009) [2023-12-26 02:16:51,409][123090] Updated weights for policy 1, policy_version 335932 (0.0008) [2023-12-26 02:16:51,430][123091] Updated weights for policy 0, policy_version 337782 (0.0010) [2023-12-26 02:16:51,500][123091] Updated weights for policy 0, policy_version 337792 (0.0011) [2023-12-26 02:16:51,567][123091] Updated weights for policy 0, policy_version 337802 (0.0010) [2023-12-26 02:16:52,245][123090] Updated weights for policy 1, policy_version 335942 (0.0009) [2023-12-26 02:16:52,318][123090] Updated weights for policy 1, policy_version 335952 (0.0009) [2023-12-26 02:16:52,377][123090] Updated weights for policy 1, policy_version 335962 (0.0009) [2023-12-26 02:16:52,396][123091] Updated weights for policy 0, policy_version 337812 (0.0010) [2023-12-26 02:16:52,470][123091] Updated weights for policy 0, policy_version 337822 (0.0011) [2023-12-26 02:16:52,544][123091] Updated weights for policy 0, policy_version 337832 (0.0011) [2023-12-26 02:16:53,091][123090] Updated weights for policy 1, policy_version 335972 (0.0007) [2023-12-26 02:16:53,141][123090] Updated weights for policy 1, policy_version 335982 (0.0007) [2023-12-26 02:16:53,196][123090] Updated weights for policy 1, policy_version 335992 (0.0005) [2023-12-26 02:16:53,348][123091] Updated weights for policy 0, policy_version 337842 (0.0011) [2023-12-26 02:16:53,414][123091] Updated weights for policy 0, policy_version 337852 (0.0009) [2023-12-26 02:16:53,468][123091] Updated weights for policy 0, policy_version 337862 (0.0005) [2023-12-26 02:16:53,533][123091] Updated weights for policy 0, policy_version 337872 (0.0005) [2023-12-26 02:16:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 172515328. Throughput: 0: 8845.1, 1: 8770.6. Samples: 172491084. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:53,786][121949] Avg episode reward: [(0, '6264.663'), (1, '5818.143')] [2023-12-26 02:16:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000337872_86499328.pth... [2023-12-26 02:16:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000336000_86016000.pth... [2023-12-26 02:16:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000336848_86237184.pth [2023-12-26 02:16:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000334976_85753856.pth [2023-12-26 02:16:53,972][123090] Updated weights for policy 1, policy_version 336002 (0.0005) [2023-12-26 02:16:54,028][123090] Updated weights for policy 1, policy_version 336012 (0.0007) [2023-12-26 02:16:54,084][123090] Updated weights for policy 1, policy_version 336022 (0.0008) [2023-12-26 02:16:54,134][123090] Updated weights for policy 1, policy_version 336032 (0.0009) [2023-12-26 02:16:54,197][123091] Updated weights for policy 0, policy_version 337882 (0.0009) [2023-12-26 02:16:54,253][123091] Updated weights for policy 0, policy_version 337892 (0.0007) [2023-12-26 02:16:54,324][123091] Updated weights for policy 0, policy_version 337902 (0.0009) [2023-12-26 02:16:54,970][123090] Updated weights for policy 1, policy_version 336042 (0.0006) [2023-12-26 02:16:55,027][123090] Updated weights for policy 1, policy_version 336052 (0.0006) [2023-12-26 02:16:55,081][123090] Updated weights for policy 1, policy_version 336062 (0.0006) [2023-12-26 02:16:55,082][123091] Updated weights for policy 0, policy_version 337912 (0.0006) [2023-12-26 02:16:55,144][123091] Updated weights for policy 0, policy_version 337922 (0.0008) [2023-12-26 02:16:55,207][123091] Updated weights for policy 0, policy_version 337932 (0.0008) [2023-12-26 02:16:55,775][123090] Updated weights for policy 1, policy_version 336072 (0.0006) [2023-12-26 02:16:55,824][123090] Updated weights for policy 1, policy_version 336082 (0.0005) [2023-12-26 02:16:55,882][123090] Updated weights for policy 1, policy_version 336092 (0.0007) [2023-12-26 02:16:55,893][123091] Updated weights for policy 0, policy_version 337942 (0.0006) [2023-12-26 02:16:55,963][123091] Updated weights for policy 0, policy_version 337952 (0.0005) [2023-12-26 02:16:56,019][123091] Updated weights for policy 0, policy_version 337962 (0.0010) [2023-12-26 02:16:56,666][123090] Updated weights for policy 1, policy_version 336102 (0.0008) [2023-12-26 02:16:56,725][123090] Updated weights for policy 1, policy_version 336112 (0.0008) [2023-12-26 02:16:56,759][123091] Updated weights for policy 0, policy_version 337972 (0.0010) [2023-12-26 02:16:56,792][123090] Updated weights for policy 1, policy_version 336122 (0.0008) [2023-12-26 02:16:56,817][123091] Updated weights for policy 0, policy_version 337982 (0.0010) [2023-12-26 02:16:56,876][123091] Updated weights for policy 0, policy_version 337992 (0.0010) [2023-12-26 02:16:57,507][123090] Updated weights for policy 1, policy_version 336132 (0.0007) [2023-12-26 02:16:57,559][123090] Updated weights for policy 1, policy_version 336142 (0.0009) [2023-12-26 02:16:57,605][123091] Updated weights for policy 0, policy_version 338002 (0.0010) [2023-12-26 02:16:57,620][123090] Updated weights for policy 1, policy_version 336152 (0.0008) [2023-12-26 02:16:57,663][123091] Updated weights for policy 0, policy_version 338012 (0.0010) [2023-12-26 02:16:57,720][123091] Updated weights for policy 0, policy_version 338022 (0.0010) [2023-12-26 02:16:57,781][123091] Updated weights for policy 0, policy_version 338032 (0.0010) [2023-12-26 02:16:58,472][123090] Updated weights for policy 1, policy_version 336162 (0.0007) [2023-12-26 02:16:58,542][123090] Updated weights for policy 1, policy_version 336172 (0.0010) [2023-12-26 02:16:58,609][123090] Updated weights for policy 1, policy_version 336182 (0.0009) [2023-12-26 02:16:58,633][123091] Updated weights for policy 0, policy_version 338042 (0.0008) [2023-12-26 02:16:58,686][123090] Updated weights for policy 1, policy_version 336192 (0.0008) [2023-12-26 02:16:58,697][123091] Updated weights for policy 0, policy_version 338052 (0.0007) [2023-12-26 02:16:58,766][123091] Updated weights for policy 0, policy_version 338062 (0.0009) [2023-12-26 02:16:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 172613632. Throughput: 0: 8893.5, 1: 8895.3. Samples: 172602048. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:16:58,785][121949] Avg episode reward: [(0, '6213.501'), (1, '5633.405')] [2023-12-26 02:16:59,454][123090] Updated weights for policy 1, policy_version 336202 (0.0006) [2023-12-26 02:16:59,465][123091] Updated weights for policy 0, policy_version 338072 (0.0007) [2023-12-26 02:16:59,516][123090] Updated weights for policy 1, policy_version 336212 (0.0009) [2023-12-26 02:16:59,520][123091] Updated weights for policy 0, policy_version 338082 (0.0007) [2023-12-26 02:16:59,571][123091] Updated weights for policy 0, policy_version 338092 (0.0009) [2023-12-26 02:16:59,579][123090] Updated weights for policy 1, policy_version 336222 (0.0007) [2023-12-26 02:17:00,402][123090] Updated weights for policy 1, policy_version 336232 (0.0009) [2023-12-26 02:17:00,426][123091] Updated weights for policy 0, policy_version 338102 (0.0008) [2023-12-26 02:17:00,463][123090] Updated weights for policy 1, policy_version 336242 (0.0010) [2023-12-26 02:17:00,483][123091] Updated weights for policy 0, policy_version 338112 (0.0006) [2023-12-26 02:17:00,517][123090] Updated weights for policy 1, policy_version 336252 (0.0010) [2023-12-26 02:17:00,536][123091] Updated weights for policy 0, policy_version 338122 (0.0005) [2023-12-26 02:17:01,240][123091] Updated weights for policy 0, policy_version 338132 (0.0007) [2023-12-26 02:17:01,307][123091] Updated weights for policy 0, policy_version 338142 (0.0008) [2023-12-26 02:17:01,376][123091] Updated weights for policy 0, policy_version 338152 (0.0009) [2023-12-26 02:17:01,380][123090] Updated weights for policy 1, policy_version 336262 (0.0008) [2023-12-26 02:17:01,440][123090] Updated weights for policy 1, policy_version 336272 (0.0007) [2023-12-26 02:17:01,497][123090] Updated weights for policy 1, policy_version 336282 (0.0009) [2023-12-26 02:17:02,122][123091] Updated weights for policy 0, policy_version 338162 (0.0009) [2023-12-26 02:17:02,180][123091] Updated weights for policy 0, policy_version 338172 (0.0010) [2023-12-26 02:17:02,235][123091] Updated weights for policy 0, policy_version 338182 (0.0010) [2023-12-26 02:17:02,292][123091] Updated weights for policy 0, policy_version 338192 (0.0011) [2023-12-26 02:17:02,344][123090] Updated weights for policy 1, policy_version 336292 (0.0007) [2023-12-26 02:17:02,404][123090] Updated weights for policy 1, policy_version 336302 (0.0009) [2023-12-26 02:17:02,453][123090] Updated weights for policy 1, policy_version 336312 (0.0009) [2023-12-26 02:17:03,007][123091] Updated weights for policy 0, policy_version 338202 (0.0006) [2023-12-26 02:17:03,073][123091] Updated weights for policy 0, policy_version 338212 (0.0005) [2023-12-26 02:17:03,145][123091] Updated weights for policy 0, policy_version 338222 (0.0006) [2023-12-26 02:17:03,288][123090] Updated weights for policy 1, policy_version 336322 (0.0008) [2023-12-26 02:17:03,349][123090] Updated weights for policy 1, policy_version 336332 (0.0005) [2023-12-26 02:17:03,414][123090] Updated weights for policy 1, policy_version 336342 (0.0006) [2023-12-26 02:17:03,482][123090] Updated weights for policy 1, policy_version 336352 (0.0005) [2023-12-26 02:17:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 172695552. Throughput: 0: 8887.8, 1: 8791.4. Samples: 172708968. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:03,785][121949] Avg episode reward: [(0, '6182.944'), (1, '5592.741')] [2023-12-26 02:17:03,790][123091] Updated weights for policy 0, policy_version 338232 (0.0006) [2023-12-26 02:17:03,856][123091] Updated weights for policy 0, policy_version 338242 (0.0009) [2023-12-26 02:17:03,912][123091] Updated weights for policy 0, policy_version 338252 (0.0008) [2023-12-26 02:17:04,098][123090] Updated weights for policy 1, policy_version 336362 (0.0006) [2023-12-26 02:17:04,165][123090] Updated weights for policy 1, policy_version 336372 (0.0007) [2023-12-26 02:17:04,232][123090] Updated weights for policy 1, policy_version 336382 (0.0008) [2023-12-26 02:17:04,684][123091] Updated weights for policy 0, policy_version 338262 (0.0007) [2023-12-26 02:17:04,740][123091] Updated weights for policy 0, policy_version 338272 (0.0005) [2023-12-26 02:17:04,804][123091] Updated weights for policy 0, policy_version 338282 (0.0005) [2023-12-26 02:17:05,102][123090] Updated weights for policy 1, policy_version 336392 (0.0008) [2023-12-26 02:17:05,169][123090] Updated weights for policy 1, policy_version 336402 (0.0008) [2023-12-26 02:17:05,227][123090] Updated weights for policy 1, policy_version 336412 (0.0009) [2023-12-26 02:17:05,417][123091] Updated weights for policy 0, policy_version 338292 (0.0008) [2023-12-26 02:17:05,469][123091] Updated weights for policy 0, policy_version 338302 (0.0009) [2023-12-26 02:17:05,523][123091] Updated weights for policy 0, policy_version 338312 (0.0005) [2023-12-26 02:17:06,082][123090] Updated weights for policy 1, policy_version 336422 (0.0009) [2023-12-26 02:17:06,142][123090] Updated weights for policy 1, policy_version 336432 (0.0009) [2023-12-26 02:17:06,204][123090] Updated weights for policy 1, policy_version 336442 (0.0009) [2023-12-26 02:17:06,242][123091] Updated weights for policy 0, policy_version 338322 (0.0005) [2023-12-26 02:17:06,313][123091] Updated weights for policy 0, policy_version 338332 (0.0011) [2023-12-26 02:17:06,376][123091] Updated weights for policy 0, policy_version 338342 (0.0011) [2023-12-26 02:17:06,441][123091] Updated weights for policy 0, policy_version 338352 (0.0011) [2023-12-26 02:17:07,082][123090] Updated weights for policy 1, policy_version 336452 (0.0008) [2023-12-26 02:17:07,102][123091] Updated weights for policy 0, policy_version 338362 (0.0009) [2023-12-26 02:17:07,143][123090] Updated weights for policy 1, policy_version 336462 (0.0008) [2023-12-26 02:17:07,149][123091] Updated weights for policy 0, policy_version 338372 (0.0010) [2023-12-26 02:17:07,205][123091] Updated weights for policy 0, policy_version 338382 (0.0009) [2023-12-26 02:17:07,207][123090] Updated weights for policy 1, policy_version 336472 (0.0007) [2023-12-26 02:17:07,984][123090] Updated weights for policy 1, policy_version 336482 (0.0009) [2023-12-26 02:17:08,043][123090] Updated weights for policy 1, policy_version 336492 (0.0010) [2023-12-26 02:17:08,107][123091] Updated weights for policy 0, policy_version 338392 (0.0010) [2023-12-26 02:17:08,109][123090] Updated weights for policy 1, policy_version 336502 (0.0007) [2023-12-26 02:17:08,169][123090] Updated weights for policy 1, policy_version 336512 (0.0007) [2023-12-26 02:17:08,171][123091] Updated weights for policy 0, policy_version 338402 (0.0011) [2023-12-26 02:17:08,229][123091] Updated weights for policy 0, policy_version 338412 (0.0010) [2023-12-26 02:17:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 172785664. Throughput: 0: 8959.4, 1: 8768.2. Samples: 172762824. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:08,785][121949] Avg episode reward: [(0, '6149.166'), (1, '5640.339')] [2023-12-26 02:17:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000336512_86147072.pth... [2023-12-26 02:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000338416_86638592.pth... [2023-12-26 02:17:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000335520_85893120.pth [2023-12-26 02:17:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000337360_86368256.pth [2023-12-26 02:17:08,945][123091] Updated weights for policy 0, policy_version 338422 (0.0007) [2023-12-26 02:17:09,013][123091] Updated weights for policy 0, policy_version 338432 (0.0006) [2023-12-26 02:17:09,077][123091] Updated weights for policy 0, policy_version 338442 (0.0007) [2023-12-26 02:17:09,091][123090] Updated weights for policy 1, policy_version 336522 (0.0007) [2023-12-26 02:17:09,166][123090] Updated weights for policy 1, policy_version 336532 (0.0008) [2023-12-26 02:17:09,237][123090] Updated weights for policy 1, policy_version 336542 (0.0007) [2023-12-26 02:17:09,858][123091] Updated weights for policy 0, policy_version 338452 (0.0008) [2023-12-26 02:17:09,926][123091] Updated weights for policy 0, policy_version 338462 (0.0008) [2023-12-26 02:17:09,993][123091] Updated weights for policy 0, policy_version 338472 (0.0008) [2023-12-26 02:17:10,078][123090] Updated weights for policy 1, policy_version 336552 (0.0006) [2023-12-26 02:17:10,130][123090] Updated weights for policy 1, policy_version 336562 (0.0006) [2023-12-26 02:17:10,190][123090] Updated weights for policy 1, policy_version 336572 (0.0006) [2023-12-26 02:17:10,771][123091] Updated weights for policy 0, policy_version 338482 (0.0008) [2023-12-26 02:17:10,819][123091] Updated weights for policy 0, policy_version 338492 (0.0005) [2023-12-26 02:17:10,876][123091] Updated weights for policy 0, policy_version 338502 (0.0006) [2023-12-26 02:17:11,003][123090] Updated weights for policy 1, policy_version 336582 (0.0009) [2023-12-26 02:17:11,074][123090] Updated weights for policy 1, policy_version 336592 (0.0009) [2023-12-26 02:17:11,147][123090] Updated weights for policy 1, policy_version 336602 (0.0008) [2023-12-26 02:17:11,757][123091] Updated weights for policy 0, policy_version 338513 (0.0009) [2023-12-26 02:17:11,829][123091] Updated weights for policy 0, policy_version 338523 (0.0010) [2023-12-26 02:17:11,883][123091] Updated weights for policy 0, policy_version 338533 (0.0009) [2023-12-26 02:17:11,939][123091] Updated weights for policy 0, policy_version 338543 (0.0007) [2023-12-26 02:17:11,982][123090] Updated weights for policy 1, policy_version 336612 (0.0009) [2023-12-26 02:17:12,045][123090] Updated weights for policy 1, policy_version 336622 (0.0010) [2023-12-26 02:17:12,102][123090] Updated weights for policy 1, policy_version 336632 (0.0010) [2023-12-26 02:17:12,726][123091] Updated weights for policy 0, policy_version 338553 (0.0009) [2023-12-26 02:17:12,788][123091] Updated weights for policy 0, policy_version 338563 (0.0010) [2023-12-26 02:17:12,839][123091] Updated weights for policy 0, policy_version 338573 (0.0008) [2023-12-26 02:17:12,942][123090] Updated weights for policy 1, policy_version 336642 (0.0009) [2023-12-26 02:17:13,015][123090] Updated weights for policy 1, policy_version 336652 (0.0005) [2023-12-26 02:17:13,071][123090] Updated weights for policy 1, policy_version 336662 (0.0006) [2023-12-26 02:17:13,119][123090] Updated weights for policy 1, policy_version 336672 (0.0005) [2023-12-26 02:17:13,717][123091] Updated weights for policy 0, policy_version 338583 (0.0007) [2023-12-26 02:17:13,766][123091] Updated weights for policy 0, policy_version 338593 (0.0005) [2023-12-26 02:17:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 172867584. Throughput: 0: 9006.5, 1: 8708.1. Samples: 172867560. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:13,784][121949] Avg episode reward: [(0, '6110.577'), (1, '5684.486')] [2023-12-26 02:17:13,804][123090] Updated weights for policy 1, policy_version 336682 (0.0006) [2023-12-26 02:17:13,818][123091] Updated weights for policy 0, policy_version 338603 (0.0005) [2023-12-26 02:17:13,866][123090] Updated weights for policy 1, policy_version 336692 (0.0009) [2023-12-26 02:17:13,928][123090] Updated weights for policy 1, policy_version 336702 (0.0010) [2023-12-26 02:17:14,509][123091] Updated weights for policy 0, policy_version 338613 (0.0006) [2023-12-26 02:17:14,562][123091] Updated weights for policy 0, policy_version 338623 (0.0005) [2023-12-26 02:17:14,611][123091] Updated weights for policy 0, policy_version 338633 (0.0005) [2023-12-26 02:17:14,705][123090] Updated weights for policy 1, policy_version 336712 (0.0011) [2023-12-26 02:17:14,768][123090] Updated weights for policy 1, policy_version 336722 (0.0011) [2023-12-26 02:17:14,834][123090] Updated weights for policy 1, policy_version 336732 (0.0010) [2023-12-26 02:17:15,340][123091] Updated weights for policy 0, policy_version 338643 (0.0005) [2023-12-26 02:17:15,401][123091] Updated weights for policy 0, policy_version 338653 (0.0006) [2023-12-26 02:17:15,462][123091] Updated weights for policy 0, policy_version 338663 (0.0007) [2023-12-26 02:17:15,738][123090] Updated weights for policy 1, policy_version 336742 (0.0008) [2023-12-26 02:17:15,794][123090] Updated weights for policy 1, policy_version 336752 (0.0010) [2023-12-26 02:17:15,848][123090] Updated weights for policy 1, policy_version 336762 (0.0009) [2023-12-26 02:17:16,168][123091] Updated weights for policy 0, policy_version 338673 (0.0006) [2023-12-26 02:17:16,221][123091] Updated weights for policy 0, policy_version 338683 (0.0005) [2023-12-26 02:17:16,270][123091] Updated weights for policy 0, policy_version 338693 (0.0005) [2023-12-26 02:17:16,323][123091] Updated weights for policy 0, policy_version 338703 (0.0005) [2023-12-26 02:17:16,772][123090] Updated weights for policy 1, policy_version 336772 (0.0010) [2023-12-26 02:17:16,828][123090] Updated weights for policy 1, policy_version 336782 (0.0009) [2023-12-26 02:17:16,887][123090] Updated weights for policy 1, policy_version 336792 (0.0010) [2023-12-26 02:17:17,036][123091] Updated weights for policy 0, policy_version 338713 (0.0009) [2023-12-26 02:17:17,100][123091] Updated weights for policy 0, policy_version 338723 (0.0009) [2023-12-26 02:17:17,159][123091] Updated weights for policy 0, policy_version 338733 (0.0008) [2023-12-26 02:17:17,552][123090] Updated weights for policy 1, policy_version 336802 (0.0010) [2023-12-26 02:17:17,619][123090] Updated weights for policy 1, policy_version 336812 (0.0009) [2023-12-26 02:17:17,670][123090] Updated weights for policy 1, policy_version 336822 (0.0008) [2023-12-26 02:17:17,727][123090] Updated weights for policy 1, policy_version 336832 (0.0010) [2023-12-26 02:17:18,029][123091] Updated weights for policy 0, policy_version 338743 (0.0009) [2023-12-26 02:17:18,094][123091] Updated weights for policy 0, policy_version 338753 (0.0008) [2023-12-26 02:17:18,156][123091] Updated weights for policy 0, policy_version 338763 (0.0010) [2023-12-26 02:17:18,580][123090] Updated weights for policy 1, policy_version 336842 (0.0009) [2023-12-26 02:17:18,640][123090] Updated weights for policy 1, policy_version 336852 (0.0010) [2023-12-26 02:17:18,704][123090] Updated weights for policy 1, policy_version 336862 (0.0010) [2023-12-26 02:17:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 172965888. Throughput: 0: 9091.8, 1: 8620.9. Samples: 172975680. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:18,785][121949] Avg episode reward: [(0, '6044.039'), (1, '5638.239')] [2023-12-26 02:17:18,996][123091] Updated weights for policy 0, policy_version 338773 (0.0010) [2023-12-26 02:17:19,060][123091] Updated weights for policy 0, policy_version 338783 (0.0009) [2023-12-26 02:17:19,129][123091] Updated weights for policy 0, policy_version 338793 (0.0009) [2023-12-26 02:17:19,560][123090] Updated weights for policy 1, policy_version 336872 (0.0010) [2023-12-26 02:17:19,618][123090] Updated weights for policy 1, policy_version 336883 (0.0009) [2023-12-26 02:17:19,670][123090] Updated weights for policy 1, policy_version 336893 (0.0009) [2023-12-26 02:17:19,982][123091] Updated weights for policy 0, policy_version 338803 (0.0010) [2023-12-26 02:17:20,041][123091] Updated weights for policy 0, policy_version 338813 (0.0010) [2023-12-26 02:17:20,103][123091] Updated weights for policy 0, policy_version 338823 (0.0009) [2023-12-26 02:17:20,530][123090] Updated weights for policy 1, policy_version 336903 (0.0008) [2023-12-26 02:17:20,594][123090] Updated weights for policy 1, policy_version 336913 (0.0009) [2023-12-26 02:17:20,653][123090] Updated weights for policy 1, policy_version 336923 (0.0010) [2023-12-26 02:17:20,977][123091] Updated weights for policy 0, policy_version 338833 (0.0009) [2023-12-26 02:17:21,039][123091] Updated weights for policy 0, policy_version 338843 (0.0009) [2023-12-26 02:17:21,108][123091] Updated weights for policy 0, policy_version 338853 (0.0009) [2023-12-26 02:17:21,174][123091] Updated weights for policy 0, policy_version 338863 (0.0010) [2023-12-26 02:17:21,534][123090] Updated weights for policy 1, policy_version 336933 (0.0009) [2023-12-26 02:17:21,594][123090] Updated weights for policy 1, policy_version 336943 (0.0010) [2023-12-26 02:17:21,660][123090] Updated weights for policy 1, policy_version 336953 (0.0010) [2023-12-26 02:17:22,018][123091] Updated weights for policy 0, policy_version 338873 (0.0006) [2023-12-26 02:17:22,091][123091] Updated weights for policy 0, policy_version 338883 (0.0006) [2023-12-26 02:17:22,156][123091] Updated weights for policy 0, policy_version 338893 (0.0006) [2023-12-26 02:17:22,515][123090] Updated weights for policy 1, policy_version 336963 (0.0009) [2023-12-26 02:17:22,580][123090] Updated weights for policy 1, policy_version 336973 (0.0007) [2023-12-26 02:17:22,647][123090] Updated weights for policy 1, policy_version 336983 (0.0007) [2023-12-26 02:17:22,944][123091] Updated weights for policy 0, policy_version 338903 (0.0005) [2023-12-26 02:17:23,000][123091] Updated weights for policy 0, policy_version 338913 (0.0008) [2023-12-26 02:17:23,056][123091] Updated weights for policy 0, policy_version 338923 (0.0008) [2023-12-26 02:17:23,367][123090] Updated weights for policy 1, policy_version 336993 (0.0006) [2023-12-26 02:17:23,432][123090] Updated weights for policy 1, policy_version 337003 (0.0010) [2023-12-26 02:17:23,487][123090] Updated weights for policy 1, policy_version 337013 (0.0010) [2023-12-26 02:17:23,534][123090] Updated weights for policy 1, policy_version 337023 (0.0010) [2023-12-26 02:17:23,746][123091] Updated weights for policy 0, policy_version 338933 (0.0007) [2023-12-26 02:17:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 173047808. Throughput: 0: 9080.1, 1: 8600.4. Samples: 173025364. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:23,785][121949] Avg episode reward: [(0, '5942.806'), (1, '5493.112')] [2023-12-26 02:17:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000337024_86278144.pth... [2023-12-26 02:17:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000336000_86016000.pth [2023-12-26 02:17:23,817][123091] Updated weights for policy 0, policy_version 338943 (0.0009) [2023-12-26 02:17:23,874][123091] Updated weights for policy 0, policy_version 338953 (0.0011) [2023-12-26 02:17:23,923][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000338960_86777856.pth... [2023-12-26 02:17:23,926][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000337872_86499328.pth [2023-12-26 02:17:24,313][123090] Updated weights for policy 1, policy_version 337033 (0.0006) [2023-12-26 02:17:24,390][123090] Updated weights for policy 1, policy_version 337043 (0.0007) [2023-12-26 02:17:24,448][123090] Updated weights for policy 1, policy_version 337053 (0.0010) [2023-12-26 02:17:24,574][123091] Updated weights for policy 0, policy_version 338963 (0.0009) [2023-12-26 02:17:24,637][123091] Updated weights for policy 0, policy_version 338973 (0.0005) [2023-12-26 02:17:24,705][123091] Updated weights for policy 0, policy_version 338983 (0.0008) [2023-12-26 02:17:25,113][123090] Updated weights for policy 1, policy_version 337063 (0.0007) [2023-12-26 02:17:25,161][123090] Updated weights for policy 1, policy_version 337073 (0.0005) [2023-12-26 02:17:25,224][123090] Updated weights for policy 1, policy_version 337083 (0.0005) [2023-12-26 02:17:25,463][123091] Updated weights for policy 0, policy_version 338993 (0.0011) [2023-12-26 02:17:25,518][123091] Updated weights for policy 0, policy_version 339003 (0.0010) [2023-12-26 02:17:25,570][123091] Updated weights for policy 0, policy_version 339013 (0.0010) [2023-12-26 02:17:25,622][123091] Updated weights for policy 0, policy_version 339023 (0.0010) [2023-12-26 02:17:25,844][123090] Updated weights for policy 1, policy_version 337093 (0.0005) [2023-12-26 02:17:25,900][123090] Updated weights for policy 1, policy_version 337103 (0.0005) [2023-12-26 02:17:25,962][123090] Updated weights for policy 1, policy_version 337113 (0.0010) [2023-12-26 02:17:26,526][123091] Updated weights for policy 0, policy_version 339033 (0.0010) [2023-12-26 02:17:26,580][123091] Updated weights for policy 0, policy_version 339043 (0.0010) [2023-12-26 02:17:26,632][123091] Updated weights for policy 0, policy_version 339053 (0.0009) [2023-12-26 02:17:26,637][123090] Updated weights for policy 1, policy_version 337123 (0.0010) [2023-12-26 02:17:26,691][123090] Updated weights for policy 1, policy_version 337133 (0.0005) [2023-12-26 02:17:26,751][123090] Updated weights for policy 1, policy_version 337143 (0.0005) [2023-12-26 02:17:27,398][123090] Updated weights for policy 1, policy_version 337153 (0.0005) [2023-12-26 02:17:27,452][123090] Updated weights for policy 1, policy_version 337163 (0.0005) [2023-12-26 02:17:27,492][123091] Updated weights for policy 0, policy_version 339063 (0.0006) [2023-12-26 02:17:27,503][123090] Updated weights for policy 1, policy_version 337173 (0.0006) [2023-12-26 02:17:27,546][123090] Updated weights for policy 1, policy_version 337183 (0.0006) [2023-12-26 02:17:27,555][123091] Updated weights for policy 0, policy_version 339073 (0.0006) [2023-12-26 02:17:27,611][123091] Updated weights for policy 0, policy_version 339083 (0.0007) [2023-12-26 02:17:28,366][123090] Updated weights for policy 1, policy_version 337193 (0.0009) [2023-12-26 02:17:28,383][123091] Updated weights for policy 0, policy_version 339093 (0.0008) [2023-12-26 02:17:28,420][123090] Updated weights for policy 1, policy_version 337203 (0.0009) [2023-12-26 02:17:28,436][123091] Updated weights for policy 0, policy_version 339103 (0.0008) [2023-12-26 02:17:28,473][123090] Updated weights for policy 1, policy_version 337213 (0.0009) [2023-12-26 02:17:28,491][123091] Updated weights for policy 0, policy_version 339113 (0.0007) [2023-12-26 02:17:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 173146112. Throughput: 0: 9089.6, 1: 8779.4. Samples: 173137808. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:28,785][121949] Avg episode reward: [(0, '6002.446'), (1, '5504.045')] [2023-12-26 02:17:29,306][123091] Updated weights for policy 0, policy_version 339123 (0.0010) [2023-12-26 02:17:29,343][123090] Updated weights for policy 1, policy_version 337223 (0.0010) [2023-12-26 02:17:29,367][123091] Updated weights for policy 0, policy_version 339133 (0.0009) [2023-12-26 02:17:29,411][123090] Updated weights for policy 1, policy_version 337233 (0.0009) [2023-12-26 02:17:29,416][123091] Updated weights for policy 0, policy_version 339143 (0.0006) [2023-12-26 02:17:29,472][123090] Updated weights for policy 1, policy_version 337243 (0.0007) [2023-12-26 02:17:30,220][123091] Updated weights for policy 0, policy_version 339153 (0.0007) [2023-12-26 02:17:30,223][123090] Updated weights for policy 1, policy_version 337253 (0.0007) [2023-12-26 02:17:30,268][123091] Updated weights for policy 0, policy_version 339163 (0.0008) [2023-12-26 02:17:30,278][123090] Updated weights for policy 1, policy_version 337263 (0.0008) [2023-12-26 02:17:30,322][123091] Updated weights for policy 0, policy_version 339173 (0.0008) [2023-12-26 02:17:30,340][123090] Updated weights for policy 1, policy_version 337273 (0.0009) [2023-12-26 02:17:30,380][123091] Updated weights for policy 0, policy_version 339183 (0.0010) [2023-12-26 02:17:31,051][123090] Updated weights for policy 1, policy_version 337283 (0.0008) [2023-12-26 02:17:31,114][123090] Updated weights for policy 1, policy_version 337293 (0.0008) [2023-12-26 02:17:31,188][123090] Updated weights for policy 1, policy_version 337303 (0.0008) [2023-12-26 02:17:31,258][123091] Updated weights for policy 0, policy_version 339193 (0.0008) [2023-12-26 02:17:31,320][123091] Updated weights for policy 0, policy_version 339203 (0.0006) [2023-12-26 02:17:31,391][123091] Updated weights for policy 0, policy_version 339213 (0.0009) [2023-12-26 02:17:31,968][123090] Updated weights for policy 1, policy_version 337313 (0.0009) [2023-12-26 02:17:32,031][123090] Updated weights for policy 1, policy_version 337323 (0.0009) [2023-12-26 02:17:32,092][123090] Updated weights for policy 1, policy_version 337333 (0.0009) [2023-12-26 02:17:32,162][123090] Updated weights for policy 1, policy_version 337343 (0.0009) [2023-12-26 02:17:32,200][123091] Updated weights for policy 0, policy_version 339223 (0.0009) [2023-12-26 02:17:32,254][123091] Updated weights for policy 0, policy_version 339233 (0.0010) [2023-12-26 02:17:32,323][123091] Updated weights for policy 0, policy_version 339243 (0.0009) [2023-12-26 02:17:32,945][123090] Updated weights for policy 1, policy_version 337353 (0.0009) [2023-12-26 02:17:33,015][123090] Updated weights for policy 1, policy_version 337363 (0.0010) [2023-12-26 02:17:33,040][123091] Updated weights for policy 0, policy_version 339253 (0.0008) [2023-12-26 02:17:33,081][123090] Updated weights for policy 1, policy_version 337373 (0.0009) [2023-12-26 02:17:33,090][123091] Updated weights for policy 0, policy_version 339263 (0.0009) [2023-12-26 02:17:33,135][123091] Updated weights for policy 0, policy_version 339273 (0.0007) [2023-12-26 02:17:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 173228032. Throughput: 0: 9037.1, 1: 8847.4. Samples: 173244524. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 02:17:33,785][121949] Avg episode reward: [(0, '6147.546'), (1, '5723.582')] [2023-12-26 02:17:33,884][123090] Updated weights for policy 1, policy_version 337383 (0.0009) [2023-12-26 02:17:33,934][123091] Updated weights for policy 0, policy_version 339283 (0.0008) [2023-12-26 02:17:33,937][123090] Updated weights for policy 1, policy_version 337393 (0.0009) [2023-12-26 02:17:33,987][123091] Updated weights for policy 0, policy_version 339293 (0.0009) [2023-12-26 02:17:33,997][123090] Updated weights for policy 1, policy_version 337403 (0.0007) [2023-12-26 02:17:34,039][123091] Updated weights for policy 0, policy_version 339303 (0.0009) [2023-12-26 02:17:34,828][123091] Updated weights for policy 0, policy_version 339313 (0.0010) [2023-12-26 02:17:34,850][123090] Updated weights for policy 1, policy_version 337413 (0.0008) [2023-12-26 02:17:34,888][123091] Updated weights for policy 0, policy_version 339323 (0.0005) [2023-12-26 02:17:34,905][123090] Updated weights for policy 1, policy_version 337423 (0.0008) [2023-12-26 02:17:34,961][123090] Updated weights for policy 1, policy_version 337433 (0.0008) [2023-12-26 02:17:34,962][123091] Updated weights for policy 0, policy_version 339333 (0.0005) [2023-12-26 02:17:35,030][123091] Updated weights for policy 0, policy_version 339343 (0.0006) [2023-12-26 02:17:35,672][123091] Updated weights for policy 0, policy_version 339353 (0.0005) [2023-12-26 02:17:35,728][123091] Updated weights for policy 0, policy_version 339363 (0.0005) [2023-12-26 02:17:35,793][123091] Updated weights for policy 0, policy_version 339373 (0.0005) [2023-12-26 02:17:35,875][123090] Updated weights for policy 1, policy_version 337443 (0.0009) [2023-12-26 02:17:35,939][123090] Updated weights for policy 1, policy_version 337453 (0.0009) [2023-12-26 02:17:36,009][123090] Updated weights for policy 1, policy_version 337463 (0.0009) [2023-12-26 02:17:36,512][123091] Updated weights for policy 0, policy_version 339383 (0.0008) [2023-12-26 02:17:36,587][123091] Updated weights for policy 0, policy_version 339393 (0.0005) [2023-12-26 02:17:36,650][123091] Updated weights for policy 0, policy_version 339403 (0.0011) [2023-12-26 02:17:36,878][123090] Updated weights for policy 1, policy_version 337473 (0.0010) [2023-12-26 02:17:36,951][123090] Updated weights for policy 1, policy_version 337483 (0.0009) [2023-12-26 02:17:37,026][123090] Updated weights for policy 1, policy_version 337493 (0.0010) [2023-12-26 02:17:37,088][123090] Updated weights for policy 1, policy_version 337503 (0.0009) [2023-12-26 02:17:37,346][123091] Updated weights for policy 0, policy_version 339413 (0.0008) [2023-12-26 02:17:37,400][123091] Updated weights for policy 0, policy_version 339423 (0.0005) [2023-12-26 02:17:37,453][123091] Updated weights for policy 0, policy_version 339433 (0.0005) [2023-12-26 02:17:37,885][123090] Updated weights for policy 1, policy_version 337513 (0.0006) [2023-12-26 02:17:37,944][123090] Updated weights for policy 1, policy_version 337523 (0.0005) [2023-12-26 02:17:38,021][123090] Updated weights for policy 1, policy_version 337533 (0.0011) [2023-12-26 02:17:38,103][123091] Updated weights for policy 0, policy_version 339443 (0.0005) [2023-12-26 02:17:38,175][123091] Updated weights for policy 0, policy_version 339453 (0.0005) [2023-12-26 02:17:38,237][123091] Updated weights for policy 0, policy_version 339463 (0.0005) [2023-12-26 02:17:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 173318144. Throughput: 0: 9099.7, 1: 8814.3. Samples: 173297212. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:17:38,785][121949] Avg episode reward: [(0, '6239.428'), (1, '5736.172')] [2023-12-26 02:17:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000339472_86908928.pth... [2023-12-26 02:17:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000337536_86409216.pth... [2023-12-26 02:17:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000338416_86638592.pth [2023-12-26 02:17:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000336512_86147072.pth [2023-12-26 02:17:38,873][123090] Updated weights for policy 1, policy_version 337543 (0.0009) [2023-12-26 02:17:38,934][123090] Updated weights for policy 1, policy_version 337553 (0.0009) [2023-12-26 02:17:38,992][123090] Updated weights for policy 1, policy_version 337563 (0.0009) [2023-12-26 02:17:38,999][123091] Updated weights for policy 0, policy_version 339473 (0.0006) [2023-12-26 02:17:39,047][123091] Updated weights for policy 0, policy_version 339483 (0.0010) [2023-12-26 02:17:39,105][123091] Updated weights for policy 0, policy_version 339493 (0.0010) [2023-12-26 02:17:39,163][123091] Updated weights for policy 0, policy_version 339503 (0.0010) [2023-12-26 02:17:39,871][123090] Updated weights for policy 1, policy_version 337573 (0.0009) [2023-12-26 02:17:39,940][123090] Updated weights for policy 1, policy_version 337583 (0.0010) [2023-12-26 02:17:40,006][123090] Updated weights for policy 1, policy_version 337593 (0.0009) [2023-12-26 02:17:40,049][123091] Updated weights for policy 0, policy_version 339513 (0.0008) [2023-12-26 02:17:40,103][123091] Updated weights for policy 0, policy_version 339523 (0.0010) [2023-12-26 02:17:40,179][123091] Updated weights for policy 0, policy_version 339533 (0.0009) [2023-12-26 02:17:40,808][123090] Updated weights for policy 1, policy_version 337603 (0.0009) [2023-12-26 02:17:40,877][123090] Updated weights for policy 1, policy_version 337613 (0.0009) [2023-12-26 02:17:40,908][123091] Updated weights for policy 0, policy_version 339543 (0.0008) [2023-12-26 02:17:40,942][123090] Updated weights for policy 1, policy_version 337623 (0.0007) [2023-12-26 02:17:40,972][123091] Updated weights for policy 0, policy_version 339554 (0.0010) [2023-12-26 02:17:41,039][123091] Updated weights for policy 0, policy_version 339564 (0.0008) [2023-12-26 02:17:41,717][123090] Updated weights for policy 1, policy_version 337633 (0.0007) [2023-12-26 02:17:41,788][123090] Updated weights for policy 1, policy_version 337643 (0.0009) [2023-12-26 02:17:41,847][123090] Updated weights for policy 1, policy_version 337653 (0.0009) [2023-12-26 02:17:41,867][123091] Updated weights for policy 0, policy_version 339574 (0.0010) [2023-12-26 02:17:41,896][123090] Updated weights for policy 1, policy_version 337663 (0.0007) [2023-12-26 02:17:41,922][123091] Updated weights for policy 0, policy_version 339584 (0.0008) [2023-12-26 02:17:41,992][123091] Updated weights for policy 0, policy_version 339594 (0.0010) [2023-12-26 02:17:42,752][123091] Updated weights for policy 0, policy_version 339604 (0.0008) [2023-12-26 02:17:42,785][123090] Updated weights for policy 1, policy_version 337673 (0.0006) [2023-12-26 02:17:42,812][123091] Updated weights for policy 0, policy_version 339614 (0.0006) [2023-12-26 02:17:42,858][123090] Updated weights for policy 1, policy_version 337683 (0.0005) [2023-12-26 02:17:42,869][123091] Updated weights for policy 0, policy_version 339624 (0.0007) [2023-12-26 02:17:42,917][123090] Updated weights for policy 1, policy_version 337693 (0.0005) [2023-12-26 02:17:43,678][123090] Updated weights for policy 1, policy_version 337703 (0.0008) [2023-12-26 02:17:43,695][123091] Updated weights for policy 0, policy_version 339634 (0.0009) [2023-12-26 02:17:43,725][123090] Updated weights for policy 1, policy_version 337713 (0.0008) [2023-12-26 02:17:43,747][123091] Updated weights for policy 0, policy_version 339644 (0.0008) [2023-12-26 02:17:43,773][123090] Updated weights for policy 1, policy_version 337723 (0.0008) [2023-12-26 02:17:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 173400064. Throughput: 0: 9062.1, 1: 8710.6. Samples: 173401816. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:17:43,784][121949] Avg episode reward: [(0, '6279.337'), (1, '5600.891')] [2023-12-26 02:17:43,792][123091] Updated weights for policy 0, policy_version 339654 (0.0008) [2023-12-26 02:17:44,500][123090] Updated weights for policy 1, policy_version 337733 (0.0006) [2023-12-26 02:17:44,559][123090] Updated weights for policy 1, policy_version 337743 (0.0005) [2023-12-26 02:17:44,624][123090] Updated weights for policy 1, policy_version 337753 (0.0005) [2023-12-26 02:17:44,724][123091] Updated weights for policy 0, policy_version 339665 (0.0010) [2023-12-26 02:17:44,786][123091] Updated weights for policy 0, policy_version 339675 (0.0009) [2023-12-26 02:17:44,852][123091] Updated weights for policy 0, policy_version 339685 (0.0009) [2023-12-26 02:17:44,900][123091] Updated weights for policy 0, policy_version 339695 (0.0009) [2023-12-26 02:17:45,392][123090] Updated weights for policy 1, policy_version 337763 (0.0008) [2023-12-26 02:17:45,449][123090] Updated weights for policy 1, policy_version 337773 (0.0011) [2023-12-26 02:17:45,509][123090] Updated weights for policy 1, policy_version 337783 (0.0010) [2023-12-26 02:17:45,767][123091] Updated weights for policy 0, policy_version 339705 (0.0010) [2023-12-26 02:17:45,829][123091] Updated weights for policy 0, policy_version 339715 (0.0010) [2023-12-26 02:17:45,902][123091] Updated weights for policy 0, policy_version 339725 (0.0010) [2023-12-26 02:17:46,203][123090] Updated weights for policy 1, policy_version 337793 (0.0011) [2023-12-26 02:17:46,267][123090] Updated weights for policy 1, policy_version 337803 (0.0010) [2023-12-26 02:17:46,330][123090] Updated weights for policy 1, policy_version 337813 (0.0011) [2023-12-26 02:17:46,393][123090] Updated weights for policy 1, policy_version 337823 (0.0011) [2023-12-26 02:17:46,746][123091] Updated weights for policy 0, policy_version 339735 (0.0010) [2023-12-26 02:17:46,804][123091] Updated weights for policy 0, policy_version 339745 (0.0009) [2023-12-26 02:17:46,872][123091] Updated weights for policy 0, policy_version 339755 (0.0009) [2023-12-26 02:17:47,132][123090] Updated weights for policy 1, policy_version 337833 (0.0008) [2023-12-26 02:17:47,199][123090] Updated weights for policy 1, policy_version 337843 (0.0007) [2023-12-26 02:17:47,263][123090] Updated weights for policy 1, policy_version 337853 (0.0008) [2023-12-26 02:17:47,719][123091] Updated weights for policy 0, policy_version 339765 (0.0009) [2023-12-26 02:17:47,771][123091] Updated weights for policy 0, policy_version 339775 (0.0009) [2023-12-26 02:17:47,824][123091] Updated weights for policy 0, policy_version 339785 (0.0009) [2023-12-26 02:17:48,029][123090] Updated weights for policy 1, policy_version 337863 (0.0008) [2023-12-26 02:17:48,076][123090] Updated weights for policy 1, policy_version 337873 (0.0005) [2023-12-26 02:17:48,125][123090] Updated weights for policy 1, policy_version 337883 (0.0007) [2023-12-26 02:17:48,679][123091] Updated weights for policy 0, policy_version 339795 (0.0008) [2023-12-26 02:17:48,753][123091] Updated weights for policy 0, policy_version 339805 (0.0005) [2023-12-26 02:17:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 173490176. Throughput: 0: 8938.0, 1: 8795.5. Samples: 173506972. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:17:48,785][121949] Avg episode reward: [(0, '6258.318'), (1, '5618.265')] [2023-12-26 02:17:48,826][123091] Updated weights for policy 0, policy_version 339815 (0.0006) [2023-12-26 02:17:48,859][123090] Updated weights for policy 1, policy_version 337893 (0.0010) [2023-12-26 02:17:48,926][123090] Updated weights for policy 1, policy_version 337903 (0.0008) [2023-12-26 02:17:49,005][123090] Updated weights for policy 1, policy_version 337913 (0.0008) [2023-12-26 02:17:49,533][123091] Updated weights for policy 0, policy_version 339825 (0.0007) [2023-12-26 02:17:49,584][123091] Updated weights for policy 0, policy_version 339835 (0.0008) [2023-12-26 02:17:49,639][123091] Updated weights for policy 0, policy_version 339845 (0.0008) [2023-12-26 02:17:49,686][123091] Updated weights for policy 0, policy_version 339855 (0.0008) [2023-12-26 02:17:49,775][123090] Updated weights for policy 1, policy_version 337923 (0.0010) [2023-12-26 02:17:49,830][123090] Updated weights for policy 1, policy_version 337933 (0.0013) [2023-12-26 02:17:49,909][123090] Updated weights for policy 1, policy_version 337943 (0.0009) [2023-12-26 02:17:50,580][123091] Updated weights for policy 0, policy_version 339865 (0.0009) [2023-12-26 02:17:50,649][123091] Updated weights for policy 0, policy_version 339875 (0.0007) [2023-12-26 02:17:50,680][123090] Updated weights for policy 1, policy_version 337953 (0.0009) [2023-12-26 02:17:50,714][123091] Updated weights for policy 0, policy_version 339885 (0.0009) [2023-12-26 02:17:50,735][123090] Updated weights for policy 1, policy_version 337963 (0.0007) [2023-12-26 02:17:50,786][123090] Updated weights for policy 1, policy_version 337973 (0.0009) [2023-12-26 02:17:50,841][123090] Updated weights for policy 1, policy_version 337983 (0.0009) [2023-12-26 02:17:51,571][123091] Updated weights for policy 0, policy_version 339895 (0.0009) [2023-12-26 02:17:51,637][123091] Updated weights for policy 0, policy_version 339905 (0.0008) [2023-12-26 02:17:51,665][123090] Updated weights for policy 1, policy_version 337993 (0.0009) [2023-12-26 02:17:51,699][123091] Updated weights for policy 0, policy_version 339915 (0.0008) [2023-12-26 02:17:51,736][123090] Updated weights for policy 1, policy_version 338003 (0.0008) [2023-12-26 02:17:51,805][123090] Updated weights for policy 1, policy_version 338013 (0.0007) [2023-12-26 02:17:52,539][123091] Updated weights for policy 0, policy_version 339925 (0.0010) [2023-12-26 02:17:52,595][123091] Updated weights for policy 0, policy_version 339935 (0.0010) [2023-12-26 02:17:52,618][123090] Updated weights for policy 1, policy_version 338023 (0.0009) [2023-12-26 02:17:52,656][123091] Updated weights for policy 0, policy_version 339945 (0.0008) [2023-12-26 02:17:52,684][123090] Updated weights for policy 1, policy_version 338033 (0.0007) [2023-12-26 02:17:52,746][123090] Updated weights for policy 1, policy_version 338043 (0.0010) [2023-12-26 02:17:53,485][123091] Updated weights for policy 0, policy_version 339955 (0.0009) [2023-12-26 02:17:53,541][123091] Updated weights for policy 0, policy_version 339965 (0.0009) [2023-12-26 02:17:53,568][123090] Updated weights for policy 1, policy_version 338053 (0.0010) [2023-12-26 02:17:53,601][123091] Updated weights for policy 0, policy_version 339975 (0.0005) [2023-12-26 02:17:53,624][123090] Updated weights for policy 1, policy_version 338063 (0.0010) [2023-12-26 02:17:53,678][123090] Updated weights for policy 1, policy_version 338073 (0.0010) [2023-12-26 02:17:53,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 173588480. Throughput: 0: 8874.8, 1: 8827.0. Samples: 173559404. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:17:53,785][121949] Avg episode reward: [(0, '6369.493'), (1, '5806.929')] [2023-12-26 02:17:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000338080_86548480.pth... [2023-12-26 02:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000339984_87040000.pth... [2023-12-26 02:17:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000337024_86278144.pth [2023-12-26 02:17:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000338960_86777856.pth [2023-12-26 02:17:54,445][123091] Updated weights for policy 0, policy_version 339985 (0.0006) [2023-12-26 02:17:54,496][123091] Updated weights for policy 0, policy_version 339995 (0.0009) [2023-12-26 02:17:54,509][123090] Updated weights for policy 1, policy_version 338083 (0.0010) [2023-12-26 02:17:54,560][123091] Updated weights for policy 0, policy_version 340005 (0.0010) [2023-12-26 02:17:54,568][123090] Updated weights for policy 1, policy_version 338093 (0.0010) [2023-12-26 02:17:54,627][123090] Updated weights for policy 1, policy_version 338103 (0.0010) [2023-12-26 02:17:54,631][123091] Updated weights for policy 0, policy_version 340015 (0.0007) [2023-12-26 02:17:55,319][123090] Updated weights for policy 1, policy_version 338113 (0.0007) [2023-12-26 02:17:55,336][123091] Updated weights for policy 0, policy_version 340025 (0.0005) [2023-12-26 02:17:55,386][123091] Updated weights for policy 0, policy_version 340035 (0.0005) [2023-12-26 02:17:55,391][123090] Updated weights for policy 1, policy_version 338123 (0.0005) [2023-12-26 02:17:55,435][123091] Updated weights for policy 0, policy_version 340045 (0.0005) [2023-12-26 02:17:55,460][123090] Updated weights for policy 1, policy_version 338133 (0.0006) [2023-12-26 02:17:55,527][123090] Updated weights for policy 1, policy_version 338143 (0.0006) [2023-12-26 02:17:56,138][123091] Updated weights for policy 0, policy_version 340055 (0.0006) [2023-12-26 02:17:56,198][123090] Updated weights for policy 1, policy_version 338153 (0.0007) [2023-12-26 02:17:56,211][123091] Updated weights for policy 0, policy_version 340065 (0.0006) [2023-12-26 02:17:56,270][123090] Updated weights for policy 1, policy_version 338163 (0.0005) [2023-12-26 02:17:56,275][123091] Updated weights for policy 0, policy_version 340075 (0.0009) [2023-12-26 02:17:56,320][123090] Updated weights for policy 1, policy_version 338173 (0.0010) [2023-12-26 02:17:56,987][123091] Updated weights for policy 0, policy_version 340085 (0.0006) [2023-12-26 02:17:57,044][123091] Updated weights for policy 0, policy_version 340095 (0.0009) [2023-12-26 02:17:57,093][123091] Updated weights for policy 0, policy_version 340105 (0.0008) [2023-12-26 02:17:57,102][123090] Updated weights for policy 1, policy_version 338183 (0.0010) [2023-12-26 02:17:57,156][123090] Updated weights for policy 1, policy_version 338193 (0.0010) [2023-12-26 02:17:57,205][123090] Updated weights for policy 1, policy_version 338203 (0.0010) [2023-12-26 02:17:57,816][123091] Updated weights for policy 0, policy_version 340115 (0.0010) [2023-12-26 02:17:57,864][123091] Updated weights for policy 0, policy_version 340125 (0.0005) [2023-12-26 02:17:57,910][123091] Updated weights for policy 0, policy_version 340135 (0.0005) [2023-12-26 02:17:58,032][123090] Updated weights for policy 1, policy_version 338213 (0.0010) [2023-12-26 02:17:58,101][123090] Updated weights for policy 1, policy_version 338223 (0.0011) [2023-12-26 02:17:58,182][123090] Updated weights for policy 1, policy_version 338233 (0.0011) [2023-12-26 02:17:58,593][123091] Updated weights for policy 0, policy_version 340145 (0.0005) [2023-12-26 02:17:58,650][123091] Updated weights for policy 0, policy_version 340155 (0.0008) [2023-12-26 02:17:58,719][123091] Updated weights for policy 0, policy_version 340165 (0.0010) [2023-12-26 02:17:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 173670400. Throughput: 0: 8887.8, 1: 8914.4. Samples: 173668660. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:17:58,785][121949] Avg episode reward: [(0, '6512.895'), (1, '5820.686')] [2023-12-26 02:17:58,790][123091] Updated weights for policy 0, policy_version 340175 (0.0010) [2023-12-26 02:17:58,795][123007] Saving new best policy, reward=6512.895! [2023-12-26 02:17:59,103][123090] Updated weights for policy 1, policy_version 338243 (0.0010) [2023-12-26 02:17:59,161][123090] Updated weights for policy 1, policy_version 338253 (0.0010) [2023-12-26 02:17:59,224][123090] Updated weights for policy 1, policy_version 338263 (0.0010) [2023-12-26 02:17:59,702][123091] Updated weights for policy 0, policy_version 340185 (0.0006) [2023-12-26 02:17:59,771][123091] Updated weights for policy 0, policy_version 340195 (0.0008) [2023-12-26 02:17:59,834][123091] Updated weights for policy 0, policy_version 340205 (0.0011) [2023-12-26 02:18:00,029][123090] Updated weights for policy 1, policy_version 338273 (0.0010) [2023-12-26 02:18:00,086][123090] Updated weights for policy 1, policy_version 338283 (0.0008) [2023-12-26 02:18:00,134][123090] Updated weights for policy 1, policy_version 338293 (0.0009) [2023-12-26 02:18:00,195][123090] Updated weights for policy 1, policy_version 338303 (0.0005) [2023-12-26 02:18:00,607][123091] Updated weights for policy 0, policy_version 340215 (0.0006) [2023-12-26 02:18:00,659][123091] Updated weights for policy 0, policy_version 340225 (0.0005) [2023-12-26 02:18:00,707][123091] Updated weights for policy 0, policy_version 340235 (0.0005) [2023-12-26 02:18:00,976][123090] Updated weights for policy 1, policy_version 338313 (0.0010) [2023-12-26 02:18:01,041][123090] Updated weights for policy 1, policy_version 338323 (0.0013) [2023-12-26 02:18:01,108][123090] Updated weights for policy 1, policy_version 338333 (0.0010) [2023-12-26 02:18:01,462][123091] Updated weights for policy 0, policy_version 340245 (0.0009) [2023-12-26 02:18:01,510][123091] Updated weights for policy 0, policy_version 340255 (0.0009) [2023-12-26 02:18:01,563][123091] Updated weights for policy 0, policy_version 340265 (0.0008) [2023-12-26 02:18:01,970][123090] Updated weights for policy 1, policy_version 338343 (0.0009) [2023-12-26 02:18:02,037][123090] Updated weights for policy 1, policy_version 338353 (0.0009) [2023-12-26 02:18:02,102][123090] Updated weights for policy 1, policy_version 338363 (0.0009) [2023-12-26 02:18:02,449][123091] Updated weights for policy 0, policy_version 340275 (0.0009) [2023-12-26 02:18:02,508][123091] Updated weights for policy 0, policy_version 340285 (0.0011) [2023-12-26 02:18:02,577][123091] Updated weights for policy 0, policy_version 340295 (0.0007) [2023-12-26 02:18:02,773][123090] Updated weights for policy 1, policy_version 338373 (0.0007) [2023-12-26 02:18:02,829][123090] Updated weights for policy 1, policy_version 338383 (0.0005) [2023-12-26 02:18:02,888][123090] Updated weights for policy 1, policy_version 338393 (0.0005) [2023-12-26 02:18:03,331][123091] Updated weights for policy 0, policy_version 340305 (0.0006) [2023-12-26 02:18:03,386][123091] Updated weights for policy 0, policy_version 340315 (0.0009) [2023-12-26 02:18:03,438][123091] Updated weights for policy 0, policy_version 340325 (0.0007) [2023-12-26 02:18:03,490][123091] Updated weights for policy 0, policy_version 340335 (0.0005) [2023-12-26 02:18:03,607][123090] Updated weights for policy 1, policy_version 338403 (0.0008) [2023-12-26 02:18:03,658][123090] Updated weights for policy 1, policy_version 338413 (0.0010) [2023-12-26 02:18:03,705][123090] Updated weights for policy 1, policy_version 338423 (0.0010) [2023-12-26 02:18:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 173768704. Throughput: 0: 8849.1, 1: 8905.5. Samples: 173774636. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:03,784][121949] Avg episode reward: [(0, '6377.630'), (1, '5684.595')] [2023-12-26 02:18:04,238][123091] Updated weights for policy 0, policy_version 340345 (0.0010) [2023-12-26 02:18:04,293][123091] Updated weights for policy 0, policy_version 340355 (0.0010) [2023-12-26 02:18:04,360][123091] Updated weights for policy 0, policy_version 340365 (0.0011) [2023-12-26 02:18:04,499][123090] Updated weights for policy 1, policy_version 338433 (0.0010) [2023-12-26 02:18:04,556][123090] Updated weights for policy 1, policy_version 338443 (0.0005) [2023-12-26 02:18:04,617][123090] Updated weights for policy 1, policy_version 338453 (0.0009) [2023-12-26 02:18:04,684][123090] Updated weights for policy 1, policy_version 338463 (0.0010) [2023-12-26 02:18:05,117][123091] Updated weights for policy 0, policy_version 340375 (0.0010) [2023-12-26 02:18:05,179][123091] Updated weights for policy 0, policy_version 340385 (0.0011) [2023-12-26 02:18:05,233][123091] Updated weights for policy 0, policy_version 340395 (0.0010) [2023-12-26 02:18:05,462][123090] Updated weights for policy 1, policy_version 338473 (0.0010) [2023-12-26 02:18:05,524][123090] Updated weights for policy 1, policy_version 338483 (0.0010) [2023-12-26 02:18:05,593][123090] Updated weights for policy 1, policy_version 338493 (0.0009) [2023-12-26 02:18:06,054][123091] Updated weights for policy 0, policy_version 340405 (0.0010) [2023-12-26 02:18:06,117][123091] Updated weights for policy 0, policy_version 340415 (0.0006) [2023-12-26 02:18:06,180][123091] Updated weights for policy 0, policy_version 340425 (0.0008) [2023-12-26 02:18:06,342][123090] Updated weights for policy 1, policy_version 338503 (0.0010) [2023-12-26 02:18:06,410][123090] Updated weights for policy 1, policy_version 338513 (0.0010) [2023-12-26 02:18:06,480][123090] Updated weights for policy 1, policy_version 338523 (0.0009) [2023-12-26 02:18:06,997][123091] Updated weights for policy 0, policy_version 340435 (0.0006) [2023-12-26 02:18:07,063][123091] Updated weights for policy 0, policy_version 340445 (0.0006) [2023-12-26 02:18:07,126][123091] Updated weights for policy 0, policy_version 340455 (0.0009) [2023-12-26 02:18:07,268][123090] Updated weights for policy 1, policy_version 338533 (0.0008) [2023-12-26 02:18:07,337][123090] Updated weights for policy 1, policy_version 338543 (0.0005) [2023-12-26 02:18:07,401][123090] Updated weights for policy 1, policy_version 338553 (0.0005) [2023-12-26 02:18:07,924][123091] Updated weights for policy 0, policy_version 340465 (0.0008) [2023-12-26 02:18:07,979][123091] Updated weights for policy 0, policy_version 340475 (0.0005) [2023-12-26 02:18:08,047][123091] Updated weights for policy 0, policy_version 340485 (0.0005) [2023-12-26 02:18:08,126][123091] Updated weights for policy 0, policy_version 340495 (0.0005) [2023-12-26 02:18:08,155][123090] Updated weights for policy 1, policy_version 338563 (0.0006) [2023-12-26 02:18:08,207][123090] Updated weights for policy 1, policy_version 338573 (0.0006) [2023-12-26 02:18:08,253][123090] Updated weights for policy 1, policy_version 338583 (0.0005) [2023-12-26 02:18:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 173850624. Throughput: 0: 8892.9, 1: 8957.1. Samples: 173828620. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:08,785][121949] Avg episode reward: [(0, '6223.101'), (1, '5763.763')] [2023-12-26 02:18:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000340496_87171072.pth... [2023-12-26 02:18:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000338592_86679552.pth... [2023-12-26 02:18:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000339472_86908928.pth [2023-12-26 02:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000337536_86409216.pth [2023-12-26 02:18:08,873][123091] Updated weights for policy 0, policy_version 340505 (0.0009) [2023-12-26 02:18:08,930][123091] Updated weights for policy 0, policy_version 340515 (0.0009) [2023-12-26 02:18:08,952][123090] Updated weights for policy 1, policy_version 338593 (0.0006) [2023-12-26 02:18:08,990][123091] Updated weights for policy 0, policy_version 340525 (0.0007) [2023-12-26 02:18:09,006][123090] Updated weights for policy 1, policy_version 338603 (0.0007) [2023-12-26 02:18:09,064][123090] Updated weights for policy 1, policy_version 338613 (0.0007) [2023-12-26 02:18:09,132][123090] Updated weights for policy 1, policy_version 338623 (0.0009) [2023-12-26 02:18:09,895][123091] Updated weights for policy 0, policy_version 340535 (0.0008) [2023-12-26 02:18:09,928][123090] Updated weights for policy 1, policy_version 338633 (0.0007) [2023-12-26 02:18:09,966][123091] Updated weights for policy 0, policy_version 340545 (0.0009) [2023-12-26 02:18:09,994][123090] Updated weights for policy 1, policy_version 338643 (0.0011) [2023-12-26 02:18:10,027][123091] Updated weights for policy 0, policy_version 340555 (0.0007) [2023-12-26 02:18:10,043][123090] Updated weights for policy 1, policy_version 338653 (0.0008) [2023-12-26 02:18:10,832][123090] Updated weights for policy 1, policy_version 338663 (0.0006) [2023-12-26 02:18:10,881][123091] Updated weights for policy 0, policy_version 340565 (0.0008) [2023-12-26 02:18:10,896][123090] Updated weights for policy 1, policy_version 338673 (0.0006) [2023-12-26 02:18:10,948][123091] Updated weights for policy 0, policy_version 340575 (0.0009) [2023-12-26 02:18:10,954][123090] Updated weights for policy 1, policy_version 338683 (0.0006) [2023-12-26 02:18:11,011][123091] Updated weights for policy 0, policy_version 340585 (0.0008) [2023-12-26 02:18:11,808][123090] Updated weights for policy 1, policy_version 338693 (0.0009) [2023-12-26 02:18:11,874][123090] Updated weights for policy 1, policy_version 338703 (0.0009) [2023-12-26 02:18:11,919][123091] Updated weights for policy 0, policy_version 340595 (0.0010) [2023-12-26 02:18:11,944][123090] Updated weights for policy 1, policy_version 338713 (0.0009) [2023-12-26 02:18:11,988][123091] Updated weights for policy 0, policy_version 340605 (0.0011) [2023-12-26 02:18:12,061][123091] Updated weights for policy 0, policy_version 340615 (0.0011) [2023-12-26 02:18:12,799][123090] Updated weights for policy 1, policy_version 338723 (0.0009) [2023-12-26 02:18:12,852][123090] Updated weights for policy 1, policy_version 338733 (0.0009) [2023-12-26 02:18:12,861][123091] Updated weights for policy 0, policy_version 340625 (0.0011) [2023-12-26 02:18:12,907][123090] Updated weights for policy 1, policy_version 338743 (0.0007) [2023-12-26 02:18:12,910][123091] Updated weights for policy 0, policy_version 340635 (0.0009) [2023-12-26 02:18:12,955][123091] Updated weights for policy 0, policy_version 340645 (0.0006) [2023-12-26 02:18:13,009][123091] Updated weights for policy 0, policy_version 340655 (0.0008) [2023-12-26 02:18:13,778][123090] Updated weights for policy 1, policy_version 338753 (0.0009) [2023-12-26 02:18:13,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 173932544. Throughput: 0: 8815.5, 1: 8841.8. Samples: 173932384. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:13,785][121949] Avg episode reward: [(0, '6323.036'), (1, '5798.734')] [2023-12-26 02:18:13,789][123091] Updated weights for policy 0, policy_version 340665 (0.0008) [2023-12-26 02:18:13,827][123090] Updated weights for policy 1, policy_version 338763 (0.0009) [2023-12-26 02:18:13,838][123091] Updated weights for policy 0, policy_version 340675 (0.0007) [2023-12-26 02:18:13,879][123090] Updated weights for policy 1, policy_version 338773 (0.0009) [2023-12-26 02:18:13,886][123091] Updated weights for policy 0, policy_version 340685 (0.0006) [2023-12-26 02:18:13,928][123090] Updated weights for policy 1, policy_version 338783 (0.0006) [2023-12-26 02:18:14,607][123090] Updated weights for policy 1, policy_version 338793 (0.0006) [2023-12-26 02:18:14,684][123090] Updated weights for policy 1, policy_version 338803 (0.0005) [2023-12-26 02:18:14,728][123091] Updated weights for policy 0, policy_version 340695 (0.0006) [2023-12-26 02:18:14,749][123090] Updated weights for policy 1, policy_version 338813 (0.0008) [2023-12-26 02:18:14,794][123091] Updated weights for policy 0, policy_version 340705 (0.0007) [2023-12-26 02:18:14,848][123091] Updated weights for policy 0, policy_version 340715 (0.0010) [2023-12-26 02:18:15,570][123090] Updated weights for policy 1, policy_version 338823 (0.0008) [2023-12-26 02:18:15,601][123091] Updated weights for policy 0, policy_version 340725 (0.0010) [2023-12-26 02:18:15,627][123090] Updated weights for policy 1, policy_version 338833 (0.0009) [2023-12-26 02:18:15,653][123091] Updated weights for policy 0, policy_version 340735 (0.0008) [2023-12-26 02:18:15,678][123090] Updated weights for policy 1, policy_version 338843 (0.0008) [2023-12-26 02:18:15,697][123091] Updated weights for policy 0, policy_version 340745 (0.0010) [2023-12-26 02:18:16,467][123090] Updated weights for policy 1, policy_version 338853 (0.0006) [2023-12-26 02:18:16,491][123091] Updated weights for policy 0, policy_version 340755 (0.0010) [2023-12-26 02:18:16,517][123090] Updated weights for policy 1, policy_version 338863 (0.0007) [2023-12-26 02:18:16,558][123091] Updated weights for policy 0, policy_version 340765 (0.0005) [2023-12-26 02:18:16,561][123090] Updated weights for policy 1, policy_version 338873 (0.0005) [2023-12-26 02:18:16,621][123091] Updated weights for policy 0, policy_version 340775 (0.0007) [2023-12-26 02:18:17,333][123090] Updated weights for policy 1, policy_version 338883 (0.0005) [2023-12-26 02:18:17,351][123091] Updated weights for policy 0, policy_version 340785 (0.0010) [2023-12-26 02:18:17,403][123090] Updated weights for policy 1, policy_version 338893 (0.0007) [2023-12-26 02:18:17,418][123091] Updated weights for policy 0, policy_version 340795 (0.0007) [2023-12-26 02:18:17,468][123090] Updated weights for policy 1, policy_version 338903 (0.0008) [2023-12-26 02:18:17,478][123091] Updated weights for policy 0, policy_version 340805 (0.0005) [2023-12-26 02:18:17,548][123091] Updated weights for policy 0, policy_version 340815 (0.0008) [2023-12-26 02:18:18,138][123090] Updated weights for policy 1, policy_version 338913 (0.0007) [2023-12-26 02:18:18,199][123090] Updated weights for policy 1, policy_version 338923 (0.0005) [2023-12-26 02:18:18,261][123090] Updated weights for policy 1, policy_version 338933 (0.0007) [2023-12-26 02:18:18,270][123091] Updated weights for policy 0, policy_version 340825 (0.0006) [2023-12-26 02:18:18,316][123090] Updated weights for policy 1, policy_version 338943 (0.0010) [2023-12-26 02:18:18,324][123091] Updated weights for policy 0, policy_version 340835 (0.0010) [2023-12-26 02:18:18,393][123091] Updated weights for policy 0, policy_version 340845 (0.0011) [2023-12-26 02:18:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 174030848. Throughput: 0: 8852.2, 1: 8873.4. Samples: 174042176. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:18,784][121949] Avg episode reward: [(0, '6250.899'), (1, '5771.138')] [2023-12-26 02:18:19,090][123090] Updated weights for policy 1, policy_version 338953 (0.0006) [2023-12-26 02:18:19,162][123090] Updated weights for policy 1, policy_version 338963 (0.0006) [2023-12-26 02:18:19,230][123090] Updated weights for policy 1, policy_version 338973 (0.0007) [2023-12-26 02:18:19,248][123091] Updated weights for policy 0, policy_version 340855 (0.0009) [2023-12-26 02:18:19,322][123091] Updated weights for policy 0, policy_version 340865 (0.0009) [2023-12-26 02:18:19,385][123091] Updated weights for policy 0, policy_version 340875 (0.0010) [2023-12-26 02:18:19,925][123090] Updated weights for policy 1, policy_version 338983 (0.0010) [2023-12-26 02:18:20,021][123090] Updated weights for policy 1, policy_version 338993 (0.0008) [2023-12-26 02:18:20,087][123090] Updated weights for policy 1, policy_version 339003 (0.0005) [2023-12-26 02:18:20,245][123091] Updated weights for policy 0, policy_version 340885 (0.0010) [2023-12-26 02:18:20,296][123091] Updated weights for policy 0, policy_version 340895 (0.0007) [2023-12-26 02:18:20,355][123091] Updated weights for policy 0, policy_version 340905 (0.0008) [2023-12-26 02:18:20,834][123090] Updated weights for policy 1, policy_version 339013 (0.0007) [2023-12-26 02:18:20,892][123090] Updated weights for policy 1, policy_version 339023 (0.0009) [2023-12-26 02:18:20,952][123090] Updated weights for policy 1, policy_version 339033 (0.0009) [2023-12-26 02:18:21,239][123091] Updated weights for policy 0, policy_version 340915 (0.0009) [2023-12-26 02:18:21,304][123091] Updated weights for policy 0, policy_version 340925 (0.0010) [2023-12-26 02:18:21,375][123091] Updated weights for policy 0, policy_version 340935 (0.0009) [2023-12-26 02:18:21,770][123090] Updated weights for policy 1, policy_version 339043 (0.0010) [2023-12-26 02:18:21,822][123090] Updated weights for policy 1, policy_version 339053 (0.0008) [2023-12-26 02:18:21,878][123090] Updated weights for policy 1, policy_version 339063 (0.0008) [2023-12-26 02:18:22,274][123091] Updated weights for policy 0, policy_version 340945 (0.0009) [2023-12-26 02:18:22,334][123091] Updated weights for policy 0, policy_version 340955 (0.0010) [2023-12-26 02:18:22,406][123091] Updated weights for policy 0, policy_version 340965 (0.0010) [2023-12-26 02:18:22,470][123091] Updated weights for policy 0, policy_version 340975 (0.0010) [2023-12-26 02:18:22,727][123090] Updated weights for policy 1, policy_version 339073 (0.0009) [2023-12-26 02:18:22,797][123090] Updated weights for policy 1, policy_version 339083 (0.0010) [2023-12-26 02:18:22,864][123090] Updated weights for policy 1, policy_version 339093 (0.0009) [2023-12-26 02:18:22,934][123090] Updated weights for policy 1, policy_version 339103 (0.0009) [2023-12-26 02:18:23,344][123091] Updated weights for policy 0, policy_version 340985 (0.0010) [2023-12-26 02:18:23,395][123091] Updated weights for policy 0, policy_version 340995 (0.0008) [2023-12-26 02:18:23,451][123091] Updated weights for policy 0, policy_version 341005 (0.0009) [2023-12-26 02:18:23,671][123090] Updated weights for policy 1, policy_version 339113 (0.0006) [2023-12-26 02:18:23,726][123090] Updated weights for policy 1, policy_version 339123 (0.0005) [2023-12-26 02:18:23,785][121949] Fps is (10 sec: 18021.6, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 174112768. Throughput: 0: 8760.3, 1: 8942.7. Samples: 174093852. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:23,786][121949] Avg episode reward: [(0, '6233.359'), (1, '5774.165')] [2023-12-26 02:18:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000341008_87302144.pth... [2023-12-26 02:18:23,796][123090] Updated weights for policy 1, policy_version 339133 (0.0005) [2023-12-26 02:18:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000339984_87040000.pth [2023-12-26 02:18:23,817][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000339136_86818816.pth... [2023-12-26 02:18:23,822][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000338080_86548480.pth [2023-12-26 02:18:24,335][123091] Updated weights for policy 0, policy_version 341015 (0.0010) [2023-12-26 02:18:24,382][123091] Updated weights for policy 0, policy_version 341025 (0.0009) [2023-12-26 02:18:24,440][123091] Updated weights for policy 0, policy_version 341035 (0.0009) [2023-12-26 02:18:24,513][123090] Updated weights for policy 1, policy_version 339143 (0.0008) [2023-12-26 02:18:24,575][123090] Updated weights for policy 1, policy_version 339153 (0.0009) [2023-12-26 02:18:24,641][123090] Updated weights for policy 1, policy_version 339163 (0.0009) [2023-12-26 02:18:25,242][123091] Updated weights for policy 0, policy_version 341045 (0.0009) [2023-12-26 02:18:25,303][123091] Updated weights for policy 0, policy_version 341055 (0.0006) [2023-12-26 02:18:25,354][123091] Updated weights for policy 0, policy_version 341065 (0.0005) [2023-12-26 02:18:25,533][123090] Updated weights for policy 1, policy_version 339173 (0.0009) [2023-12-26 02:18:25,599][123090] Updated weights for policy 1, policy_version 339183 (0.0010) [2023-12-26 02:18:25,662][123090] Updated weights for policy 1, policy_version 339193 (0.0010) [2023-12-26 02:18:26,015][123091] Updated weights for policy 0, policy_version 341075 (0.0007) [2023-12-26 02:18:26,059][123091] Updated weights for policy 0, policy_version 341085 (0.0010) [2023-12-26 02:18:26,107][123091] Updated weights for policy 0, policy_version 341095 (0.0010) [2023-12-26 02:18:26,534][123090] Updated weights for policy 1, policy_version 339203 (0.0009) [2023-12-26 02:18:26,582][123090] Updated weights for policy 1, policy_version 339213 (0.0008) [2023-12-26 02:18:26,630][123090] Updated weights for policy 1, policy_version 339224 (0.0009) [2023-12-26 02:18:26,965][123091] Updated weights for policy 0, policy_version 341105 (0.0010) [2023-12-26 02:18:27,016][123091] Updated weights for policy 0, policy_version 341115 (0.0011) [2023-12-26 02:18:27,075][123091] Updated weights for policy 0, policy_version 341125 (0.0011) [2023-12-26 02:18:27,124][123091] Updated weights for policy 0, policy_version 341135 (0.0011) [2023-12-26 02:18:27,495][123090] Updated weights for policy 1, policy_version 339234 (0.0009) [2023-12-26 02:18:27,565][123090] Updated weights for policy 1, policy_version 339244 (0.0009) [2023-12-26 02:18:27,624][123090] Updated weights for policy 1, policy_version 339254 (0.0008) [2023-12-26 02:18:27,672][123090] Updated weights for policy 1, policy_version 339264 (0.0008) [2023-12-26 02:18:27,960][123091] Updated weights for policy 0, policy_version 341145 (0.0010) [2023-12-26 02:18:28,007][123091] Updated weights for policy 0, policy_version 341155 (0.0010) [2023-12-26 02:18:28,055][123091] Updated weights for policy 0, policy_version 341165 (0.0010) [2023-12-26 02:18:28,484][123090] Updated weights for policy 1, policy_version 339274 (0.0009) [2023-12-26 02:18:28,545][123090] Updated weights for policy 1, policy_version 339284 (0.0009) [2023-12-26 02:18:28,610][123090] Updated weights for policy 1, policy_version 339294 (0.0007) [2023-12-26 02:18:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 174202880. Throughput: 0: 8716.7, 1: 8960.8. Samples: 174197308. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:28,785][121949] Avg episode reward: [(0, '6299.416'), (1, '5781.027')] [2023-12-26 02:18:28,906][123091] Updated weights for policy 0, policy_version 341175 (0.0010) [2023-12-26 02:18:28,957][123091] Updated weights for policy 0, policy_version 341185 (0.0010) [2023-12-26 02:18:29,004][123091] Updated weights for policy 0, policy_version 341195 (0.0009) [2023-12-26 02:18:29,345][123090] Updated weights for policy 1, policy_version 339304 (0.0007) [2023-12-26 02:18:29,415][123090] Updated weights for policy 1, policy_version 339314 (0.0007) [2023-12-26 02:18:29,481][123090] Updated weights for policy 1, policy_version 339324 (0.0005) [2023-12-26 02:18:29,813][123091] Updated weights for policy 0, policy_version 341205 (0.0007) [2023-12-26 02:18:29,876][123091] Updated weights for policy 0, policy_version 341215 (0.0006) [2023-12-26 02:18:29,943][123091] Updated weights for policy 0, policy_version 341225 (0.0007) [2023-12-26 02:18:30,208][123090] Updated weights for policy 1, policy_version 339334 (0.0007) [2023-12-26 02:18:30,257][123090] Updated weights for policy 1, policy_version 339344 (0.0009) [2023-12-26 02:18:30,322][123090] Updated weights for policy 1, policy_version 339354 (0.0009) [2023-12-26 02:18:30,673][123091] Updated weights for policy 0, policy_version 341235 (0.0007) [2023-12-26 02:18:30,723][123091] Updated weights for policy 0, policy_version 341245 (0.0010) [2023-12-26 02:18:30,774][123091] Updated weights for policy 0, policy_version 341255 (0.0010) [2023-12-26 02:18:31,207][123090] Updated weights for policy 1, policy_version 339364 (0.0009) [2023-12-26 02:18:31,280][123090] Updated weights for policy 1, policy_version 339374 (0.0009) [2023-12-26 02:18:31,353][123090] Updated weights for policy 1, policy_version 339384 (0.0010) [2023-12-26 02:18:31,480][123091] Updated weights for policy 0, policy_version 341265 (0.0010) [2023-12-26 02:18:31,552][123091] Updated weights for policy 0, policy_version 341275 (0.0011) [2023-12-26 02:18:31,615][123091] Updated weights for policy 0, policy_version 341285 (0.0011) [2023-12-26 02:18:31,672][123091] Updated weights for policy 0, policy_version 341295 (0.0008) [2023-12-26 02:18:32,229][123090] Updated weights for policy 1, policy_version 339394 (0.0009) [2023-12-26 02:18:32,300][123090] Updated weights for policy 1, policy_version 339404 (0.0009) [2023-12-26 02:18:32,311][123091] Updated weights for policy 0, policy_version 341305 (0.0010) [2023-12-26 02:18:32,371][123090] Updated weights for policy 1, policy_version 339414 (0.0007) [2023-12-26 02:18:32,372][123091] Updated weights for policy 0, policy_version 341315 (0.0009) [2023-12-26 02:18:32,431][123090] Updated weights for policy 1, policy_version 339424 (0.0007) [2023-12-26 02:18:32,431][123091] Updated weights for policy 0, policy_version 341325 (0.0008) [2023-12-26 02:18:33,202][123091] Updated weights for policy 0, policy_version 341335 (0.0007) [2023-12-26 02:18:33,253][123091] Updated weights for policy 0, policy_version 341345 (0.0008) [2023-12-26 02:18:33,300][123090] Updated weights for policy 1, policy_version 339434 (0.0009) [2023-12-26 02:18:33,306][123091] Updated weights for policy 0, policy_version 341355 (0.0005) [2023-12-26 02:18:33,356][123090] Updated weights for policy 1, policy_version 339444 (0.0009) [2023-12-26 02:18:33,417][123090] Updated weights for policy 1, policy_version 339454 (0.0009) [2023-12-26 02:18:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 174292992. Throughput: 0: 8860.0, 1: 8862.6. Samples: 174304492. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:33,785][121949] Avg episode reward: [(0, '6279.970'), (1, '5783.826')] [2023-12-26 02:18:33,965][123091] Updated weights for policy 0, policy_version 341365 (0.0006) [2023-12-26 02:18:34,026][123091] Updated weights for policy 0, policy_version 341375 (0.0006) [2023-12-26 02:18:34,075][123091] Updated weights for policy 0, policy_version 341385 (0.0005) [2023-12-26 02:18:34,313][123090] Updated weights for policy 1, policy_version 339464 (0.0008) [2023-12-26 02:18:34,370][123090] Updated weights for policy 1, policy_version 339474 (0.0009) [2023-12-26 02:18:34,426][123090] Updated weights for policy 1, policy_version 339484 (0.0010) [2023-12-26 02:18:34,811][123091] Updated weights for policy 0, policy_version 341395 (0.0010) [2023-12-26 02:18:34,881][123091] Updated weights for policy 0, policy_version 341405 (0.0011) [2023-12-26 02:18:34,953][123091] Updated weights for policy 0, policy_version 341415 (0.0011) [2023-12-26 02:18:35,324][123090] Updated weights for policy 1, policy_version 339494 (0.0009) [2023-12-26 02:18:35,383][123090] Updated weights for policy 1, policy_version 339504 (0.0009) [2023-12-26 02:18:35,444][123090] Updated weights for policy 1, policy_version 339514 (0.0009) [2023-12-26 02:18:35,746][123091] Updated weights for policy 0, policy_version 341425 (0.0011) [2023-12-26 02:18:35,816][123091] Updated weights for policy 0, policy_version 341435 (0.0011) [2023-12-26 02:18:35,859][123091] Updated weights for policy 0, policy_version 341445 (0.0010) [2023-12-26 02:18:35,925][123091] Updated weights for policy 0, policy_version 341455 (0.0011) [2023-12-26 02:18:36,279][123090] Updated weights for policy 1, policy_version 339524 (0.0008) [2023-12-26 02:18:36,332][123090] Updated weights for policy 1, policy_version 339534 (0.0009) [2023-12-26 02:18:36,380][123090] Updated weights for policy 1, policy_version 339544 (0.0008) [2023-12-26 02:18:36,744][123091] Updated weights for policy 0, policy_version 341465 (0.0011) [2023-12-26 02:18:36,790][123091] Updated weights for policy 0, policy_version 341475 (0.0009) [2023-12-26 02:18:36,845][123091] Updated weights for policy 0, policy_version 341485 (0.0010) [2023-12-26 02:18:37,251][123090] Updated weights for policy 1, policy_version 339554 (0.0009) [2023-12-26 02:18:37,315][123090] Updated weights for policy 1, policy_version 339564 (0.0008) [2023-12-26 02:18:37,379][123090] Updated weights for policy 1, policy_version 339574 (0.0009) [2023-12-26 02:18:37,444][123090] Updated weights for policy 1, policy_version 339584 (0.0009) [2023-12-26 02:18:37,668][123091] Updated weights for policy 0, policy_version 341495 (0.0011) [2023-12-26 02:18:37,721][123091] Updated weights for policy 0, policy_version 341505 (0.0011) [2023-12-26 02:18:37,781][123091] Updated weights for policy 0, policy_version 341515 (0.0011) [2023-12-26 02:18:38,298][123090] Updated weights for policy 1, policy_version 339594 (0.0009) [2023-12-26 02:18:38,369][123090] Updated weights for policy 1, policy_version 339604 (0.0012) [2023-12-26 02:18:38,433][123090] Updated weights for policy 1, policy_version 339614 (0.0009) [2023-12-26 02:18:38,586][123091] Updated weights for policy 0, policy_version 341525 (0.0011) [2023-12-26 02:18:38,634][123091] Updated weights for policy 0, policy_version 341535 (0.0010) [2023-12-26 02:18:38,681][123091] Updated weights for policy 0, policy_version 341545 (0.0010) [2023-12-26 02:18:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 174383104. Throughput: 0: 8902.5, 1: 8817.0. Samples: 174356788. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:38,785][121949] Avg episode reward: [(0, '6279.775'), (1, '5745.691')] [2023-12-26 02:18:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000341552_87441408.pth... [2023-12-26 02:18:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000339616_86941696.pth... [2023-12-26 02:18:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000340496_87171072.pth [2023-12-26 02:18:38,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000338592_86679552.pth [2023-12-26 02:18:39,288][123090] Updated weights for policy 1, policy_version 339624 (0.0008) [2023-12-26 02:18:39,353][123090] Updated weights for policy 1, policy_version 339634 (0.0009) [2023-12-26 02:18:39,433][123090] Updated weights for policy 1, policy_version 339644 (0.0009) [2023-12-26 02:18:39,550][123091] Updated weights for policy 0, policy_version 341555 (0.0010) [2023-12-26 02:18:39,621][123091] Updated weights for policy 0, policy_version 341565 (0.0009) [2023-12-26 02:18:39,678][123091] Updated weights for policy 0, policy_version 341575 (0.0010) [2023-12-26 02:18:40,224][123090] Updated weights for policy 1, policy_version 339654 (0.0009) [2023-12-26 02:18:40,289][123090] Updated weights for policy 1, policy_version 339664 (0.0011) [2023-12-26 02:18:40,357][123090] Updated weights for policy 1, policy_version 339674 (0.0011) [2023-12-26 02:18:40,530][123091] Updated weights for policy 0, policy_version 341585 (0.0009) [2023-12-26 02:18:40,601][123091] Updated weights for policy 0, policy_version 341595 (0.0008) [2023-12-26 02:18:40,654][123091] Updated weights for policy 0, policy_version 341605 (0.0007) [2023-12-26 02:18:40,721][123091] Updated weights for policy 0, policy_version 341615 (0.0008) [2023-12-26 02:18:41,189][123090] Updated weights for policy 1, policy_version 339684 (0.0010) [2023-12-26 02:18:41,255][123090] Updated weights for policy 1, policy_version 339694 (0.0010) [2023-12-26 02:18:41,319][123090] Updated weights for policy 1, policy_version 339704 (0.0009) [2023-12-26 02:18:41,525][123091] Updated weights for policy 0, policy_version 341625 (0.0010) [2023-12-26 02:18:41,584][123091] Updated weights for policy 0, policy_version 341635 (0.0010) [2023-12-26 02:18:41,656][123091] Updated weights for policy 0, policy_version 341645 (0.0009) [2023-12-26 02:18:42,060][123090] Updated weights for policy 1, policy_version 339714 (0.0010) [2023-12-26 02:18:42,120][123090] Updated weights for policy 1, policy_version 339724 (0.0009) [2023-12-26 02:18:42,181][123090] Updated weights for policy 1, policy_version 339734 (0.0010) [2023-12-26 02:18:42,248][123090] Updated weights for policy 1, policy_version 339744 (0.0008) [2023-12-26 02:18:42,482][123091] Updated weights for policy 0, policy_version 341655 (0.0008) [2023-12-26 02:18:42,537][123091] Updated weights for policy 0, policy_version 341665 (0.0008) [2023-12-26 02:18:42,592][123091] Updated weights for policy 0, policy_version 341675 (0.0008) [2023-12-26 02:18:43,029][123090] Updated weights for policy 1, policy_version 339754 (0.0010) [2023-12-26 02:18:43,082][123090] Updated weights for policy 1, policy_version 339764 (0.0009) [2023-12-26 02:18:43,146][123090] Updated weights for policy 1, policy_version 339774 (0.0010) [2023-12-26 02:18:43,353][123091] Updated weights for policy 0, policy_version 341685 (0.0009) [2023-12-26 02:18:43,413][123091] Updated weights for policy 0, policy_version 341695 (0.0009) [2023-12-26 02:18:43,468][123091] Updated weights for policy 0, policy_version 341705 (0.0010) [2023-12-26 02:18:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 174465024. Throughput: 0: 8812.4, 1: 8750.8. Samples: 174459004. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:43,785][121949] Avg episode reward: [(0, '6240.405'), (1, '5664.179')] [2023-12-26 02:18:43,925][123090] Updated weights for policy 1, policy_version 339784 (0.0010) [2023-12-26 02:18:43,979][123090] Updated weights for policy 1, policy_version 339794 (0.0010) [2023-12-26 02:18:44,031][123090] Updated weights for policy 1, policy_version 339804 (0.0010) [2023-12-26 02:18:44,248][123091] Updated weights for policy 0, policy_version 341716 (0.0009) [2023-12-26 02:18:44,302][123091] Updated weights for policy 0, policy_version 341726 (0.0010) [2023-12-26 02:18:44,363][123091] Updated weights for policy 0, policy_version 341736 (0.0010) [2023-12-26 02:18:44,901][123090] Updated weights for policy 1, policy_version 339814 (0.0010) [2023-12-26 02:18:44,970][123090] Updated weights for policy 1, policy_version 339824 (0.0009) [2023-12-26 02:18:45,048][123090] Updated weights for policy 1, policy_version 339834 (0.0006) [2023-12-26 02:18:45,156][123091] Updated weights for policy 0, policy_version 341746 (0.0008) [2023-12-26 02:18:45,226][123091] Updated weights for policy 0, policy_version 341756 (0.0006) [2023-12-26 02:18:45,290][123091] Updated weights for policy 0, policy_version 341766 (0.0006) [2023-12-26 02:18:45,364][123091] Updated weights for policy 0, policy_version 341776 (0.0006) [2023-12-26 02:18:45,844][123090] Updated weights for policy 1, policy_version 339844 (0.0008) [2023-12-26 02:18:45,897][123090] Updated weights for policy 1, policy_version 339854 (0.0010) [2023-12-26 02:18:45,956][123090] Updated weights for policy 1, policy_version 339864 (0.0008) [2023-12-26 02:18:46,008][123091] Updated weights for policy 0, policy_version 341786 (0.0006) [2023-12-26 02:18:46,066][123091] Updated weights for policy 0, policy_version 341796 (0.0005) [2023-12-26 02:18:46,126][123091] Updated weights for policy 0, policy_version 341806 (0.0006) [2023-12-26 02:18:46,725][123091] Updated weights for policy 0, policy_version 341816 (0.0005) [2023-12-26 02:18:46,795][123091] Updated weights for policy 0, policy_version 341826 (0.0005) [2023-12-26 02:18:46,849][123091] Updated weights for policy 0, policy_version 341836 (0.0005) [2023-12-26 02:18:46,884][123090] Updated weights for policy 1, policy_version 339874 (0.0009) [2023-12-26 02:18:46,944][123090] Updated weights for policy 1, policy_version 339884 (0.0009) [2023-12-26 02:18:47,012][123090] Updated weights for policy 1, policy_version 339894 (0.0009) [2023-12-26 02:18:47,072][123090] Updated weights for policy 1, policy_version 339904 (0.0009) [2023-12-26 02:18:47,605][123091] Updated weights for policy 0, policy_version 341846 (0.0006) [2023-12-26 02:18:47,676][123091] Updated weights for policy 0, policy_version 341856 (0.0005) [2023-12-26 02:18:47,743][123091] Updated weights for policy 0, policy_version 341866 (0.0006) [2023-12-26 02:18:47,936][123090] Updated weights for policy 1, policy_version 339914 (0.0009) [2023-12-26 02:18:48,004][123090] Updated weights for policy 1, policy_version 339924 (0.0010) [2023-12-26 02:18:48,060][123090] Updated weights for policy 1, policy_version 339934 (0.0009) [2023-12-26 02:18:48,512][123091] Updated weights for policy 0, policy_version 341876 (0.0009) [2023-12-26 02:18:48,577][123091] Updated weights for policy 0, policy_version 341886 (0.0008) [2023-12-26 02:18:48,641][123091] Updated weights for policy 0, policy_version 341896 (0.0009) [2023-12-26 02:18:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 174555136. Throughput: 0: 8899.1, 1: 8689.9. Samples: 174566144. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:48,785][121949] Avg episode reward: [(0, '6249.170'), (1, '5558.882')] [2023-12-26 02:18:48,923][123090] Updated weights for policy 1, policy_version 339944 (0.0010) [2023-12-26 02:18:48,978][123090] Updated weights for policy 1, policy_version 339954 (0.0010) [2023-12-26 02:18:49,033][123090] Updated weights for policy 1, policy_version 339964 (0.0010) [2023-12-26 02:18:49,397][123091] Updated weights for policy 0, policy_version 341906 (0.0009) [2023-12-26 02:18:49,455][123091] Updated weights for policy 0, policy_version 341916 (0.0008) [2023-12-26 02:18:49,524][123091] Updated weights for policy 0, policy_version 341926 (0.0008) [2023-12-26 02:18:49,584][123091] Updated weights for policy 0, policy_version 341936 (0.0008) [2023-12-26 02:18:49,957][123090] Updated weights for policy 1, policy_version 339974 (0.0009) [2023-12-26 02:18:50,006][123090] Updated weights for policy 1, policy_version 339984 (0.0008) [2023-12-26 02:18:50,058][123090] Updated weights for policy 1, policy_version 339994 (0.0008) [2023-12-26 02:18:50,336][123091] Updated weights for policy 0, policy_version 341946 (0.0006) [2023-12-26 02:18:50,404][123091] Updated weights for policy 0, policy_version 341956 (0.0009) [2023-12-26 02:18:50,467][123091] Updated weights for policy 0, policy_version 341966 (0.0011) [2023-12-26 02:18:50,878][123090] Updated weights for policy 1, policy_version 340004 (0.0009) [2023-12-26 02:18:50,944][123090] Updated weights for policy 1, policy_version 340014 (0.0009) [2023-12-26 02:18:51,021][123090] Updated weights for policy 1, policy_version 340024 (0.0009) [2023-12-26 02:18:51,288][123091] Updated weights for policy 0, policy_version 341976 (0.0011) [2023-12-26 02:18:51,353][123091] Updated weights for policy 0, policy_version 341986 (0.0009) [2023-12-26 02:18:51,424][123091] Updated weights for policy 0, policy_version 341996 (0.0007) [2023-12-26 02:18:51,882][123090] Updated weights for policy 1, policy_version 340034 (0.0008) [2023-12-26 02:18:51,941][123090] Updated weights for policy 1, policy_version 340044 (0.0010) [2023-12-26 02:18:51,999][123090] Updated weights for policy 1, policy_version 340055 (0.0010) [2023-12-26 02:18:52,219][123091] Updated weights for policy 0, policy_version 342006 (0.0008) [2023-12-26 02:18:52,285][123091] Updated weights for policy 0, policy_version 342016 (0.0010) [2023-12-26 02:18:52,349][123091] Updated weights for policy 0, policy_version 342026 (0.0010) [2023-12-26 02:18:52,836][123090] Updated weights for policy 1, policy_version 340065 (0.0009) [2023-12-26 02:18:52,896][123090] Updated weights for policy 1, policy_version 340075 (0.0006) [2023-12-26 02:18:52,963][123090] Updated weights for policy 1, policy_version 340085 (0.0005) [2023-12-26 02:18:53,014][123090] Updated weights for policy 1, policy_version 340095 (0.0005) [2023-12-26 02:18:53,202][123091] Updated weights for policy 0, policy_version 342036 (0.0010) [2023-12-26 02:18:53,250][123091] Updated weights for policy 0, policy_version 342046 (0.0010) [2023-12-26 02:18:53,308][123091] Updated weights for policy 0, policy_version 342056 (0.0009) [2023-12-26 02:18:53,764][123090] Updated weights for policy 1, policy_version 340105 (0.0007) [2023-12-26 02:18:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 174637056. Throughput: 0: 8892.5, 1: 8641.1. Samples: 174617628. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 02:18:53,785][121949] Avg episode reward: [(0, '6318.331'), (1, '5499.256')] [2023-12-26 02:18:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000342064_87572480.pth... [2023-12-26 02:18:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000341008_87302144.pth [2023-12-26 02:18:53,819][123090] Updated weights for policy 1, policy_version 340115 (0.0007) [2023-12-26 02:18:53,884][123090] Updated weights for policy 1, policy_version 340125 (0.0009) [2023-12-26 02:18:53,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000340128_87072768.pth... [2023-12-26 02:18:53,906][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000339136_86818816.pth [2023-12-26 02:18:54,138][123091] Updated weights for policy 0, policy_version 342066 (0.0010) [2023-12-26 02:18:54,197][123091] Updated weights for policy 0, policy_version 342076 (0.0009) [2023-12-26 02:18:54,249][123091] Updated weights for policy 0, policy_version 342086 (0.0009) [2023-12-26 02:18:54,306][123091] Updated weights for policy 0, policy_version 342096 (0.0009) [2023-12-26 02:18:54,693][123090] Updated weights for policy 1, policy_version 340135 (0.0010) [2023-12-26 02:18:54,756][123090] Updated weights for policy 1, policy_version 340145 (0.0011) [2023-12-26 02:18:54,812][123090] Updated weights for policy 1, policy_version 340155 (0.0010) [2023-12-26 02:18:55,069][123091] Updated weights for policy 0, policy_version 342106 (0.0005) [2023-12-26 02:18:55,132][123091] Updated weights for policy 0, policy_version 342116 (0.0006) [2023-12-26 02:18:55,186][123091] Updated weights for policy 0, policy_version 342126 (0.0009) [2023-12-26 02:18:55,647][123090] Updated weights for policy 1, policy_version 340165 (0.0010) [2023-12-26 02:18:55,694][123090] Updated weights for policy 1, policy_version 340175 (0.0010) [2023-12-26 02:18:55,742][123090] Updated weights for policy 1, policy_version 340185 (0.0010) [2023-12-26 02:18:55,936][123091] Updated weights for policy 0, policy_version 342136 (0.0010) [2023-12-26 02:18:55,994][123091] Updated weights for policy 0, policy_version 342147 (0.0010) [2023-12-26 02:18:56,042][123091] Updated weights for policy 0, policy_version 342157 (0.0009) [2023-12-26 02:18:56,544][123090] Updated weights for policy 1, policy_version 340195 (0.0010) [2023-12-26 02:18:56,602][123090] Updated weights for policy 1, policy_version 340205 (0.0010) [2023-12-26 02:18:56,660][123090] Updated weights for policy 1, policy_version 340215 (0.0010) [2023-12-26 02:18:56,888][123091] Updated weights for policy 0, policy_version 342167 (0.0006) [2023-12-26 02:18:56,958][123091] Updated weights for policy 0, policy_version 342177 (0.0005) [2023-12-26 02:18:57,027][123091] Updated weights for policy 0, policy_version 342187 (0.0005) [2023-12-26 02:18:57,486][123090] Updated weights for policy 1, policy_version 340225 (0.0010) [2023-12-26 02:18:57,549][123090] Updated weights for policy 1, policy_version 340235 (0.0010) [2023-12-26 02:18:57,605][123091] Updated weights for policy 0, policy_version 342197 (0.0006) [2023-12-26 02:18:57,611][123090] Updated weights for policy 1, policy_version 340245 (0.0010) [2023-12-26 02:18:57,652][123091] Updated weights for policy 0, policy_version 342207 (0.0005) [2023-12-26 02:18:57,687][123090] Updated weights for policy 1, policy_version 340255 (0.0010) [2023-12-26 02:18:57,722][123091] Updated weights for policy 0, policy_version 342217 (0.0005) [2023-12-26 02:18:58,548][123091] Updated weights for policy 0, policy_version 342227 (0.0006) [2023-12-26 02:18:58,549][123090] Updated weights for policy 1, policy_version 340265 (0.0008) [2023-12-26 02:18:58,615][123090] Updated weights for policy 1, policy_version 340275 (0.0007) [2023-12-26 02:18:58,622][123091] Updated weights for policy 0, policy_version 342237 (0.0008) [2023-12-26 02:18:58,683][123090] Updated weights for policy 1, policy_version 340285 (0.0007) [2023-12-26 02:18:58,693][123091] Updated weights for policy 0, policy_version 342247 (0.0008) [2023-12-26 02:18:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 174735360. Throughput: 0: 8986.3, 1: 8609.4. Samples: 174724192. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:18:58,785][121949] Avg episode reward: [(0, '6352.867'), (1, '5572.782')] [2023-12-26 02:18:59,513][123091] Updated weights for policy 0, policy_version 342257 (0.0008) [2023-12-26 02:18:59,520][123090] Updated weights for policy 1, policy_version 340295 (0.0008) [2023-12-26 02:18:59,569][123091] Updated weights for policy 0, policy_version 342267 (0.0010) [2023-12-26 02:18:59,582][123090] Updated weights for policy 1, policy_version 340305 (0.0006) [2023-12-26 02:18:59,624][123091] Updated weights for policy 0, policy_version 342277 (0.0010) [2023-12-26 02:18:59,639][123090] Updated weights for policy 1, policy_version 340315 (0.0006) [2023-12-26 02:18:59,683][123091] Updated weights for policy 0, policy_version 342287 (0.0011) [2023-12-26 02:19:00,420][123090] Updated weights for policy 1, policy_version 340325 (0.0008) [2023-12-26 02:19:00,473][123090] Updated weights for policy 1, policy_version 340335 (0.0009) [2023-12-26 02:19:00,506][123091] Updated weights for policy 0, policy_version 342297 (0.0008) [2023-12-26 02:19:00,528][123090] Updated weights for policy 1, policy_version 340345 (0.0008) [2023-12-26 02:19:00,557][123091] Updated weights for policy 0, policy_version 342307 (0.0006) [2023-12-26 02:19:00,604][123091] Updated weights for policy 0, policy_version 342317 (0.0009) [2023-12-26 02:19:01,295][123090] Updated weights for policy 1, policy_version 340355 (0.0010) [2023-12-26 02:19:01,357][123090] Updated weights for policy 1, policy_version 340365 (0.0008) [2023-12-26 02:19:01,423][123090] Updated weights for policy 1, policy_version 340375 (0.0008) [2023-12-26 02:19:01,454][123091] Updated weights for policy 0, policy_version 342327 (0.0009) [2023-12-26 02:19:01,513][123091] Updated weights for policy 0, policy_version 342337 (0.0008) [2023-12-26 02:19:01,575][123091] Updated weights for policy 0, policy_version 342347 (0.0009) [2023-12-26 02:19:02,204][123090] Updated weights for policy 1, policy_version 340385 (0.0008) [2023-12-26 02:19:02,273][123090] Updated weights for policy 1, policy_version 340395 (0.0009) [2023-12-26 02:19:02,328][123090] Updated weights for policy 1, policy_version 340405 (0.0011) [2023-12-26 02:19:02,396][123090] Updated weights for policy 1, policy_version 340415 (0.0011) [2023-12-26 02:19:02,430][123091] Updated weights for policy 0, policy_version 342357 (0.0009) [2023-12-26 02:19:02,478][123091] Updated weights for policy 0, policy_version 342367 (0.0009) [2023-12-26 02:19:02,530][123091] Updated weights for policy 0, policy_version 342377 (0.0008) [2023-12-26 02:19:03,204][123090] Updated weights for policy 1, policy_version 340425 (0.0010) [2023-12-26 02:19:03,251][123091] Updated weights for policy 0, policy_version 342387 (0.0008) [2023-12-26 02:19:03,269][123090] Updated weights for policy 1, policy_version 340435 (0.0010) [2023-12-26 02:19:03,310][123091] Updated weights for policy 0, policy_version 342397 (0.0007) [2023-12-26 02:19:03,328][123090] Updated weights for policy 1, policy_version 340445 (0.0010) [2023-12-26 02:19:03,365][123091] Updated weights for policy 0, policy_version 342407 (0.0007) [2023-12-26 02:19:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 174817280. Throughput: 0: 8945.5, 1: 8539.2. Samples: 174828988. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:03,784][121949] Avg episode reward: [(0, '6343.754'), (1, '5362.131')] [2023-12-26 02:19:04,093][123091] Updated weights for policy 0, policy_version 342417 (0.0006) [2023-12-26 02:19:04,150][123090] Updated weights for policy 1, policy_version 340455 (0.0010) [2023-12-26 02:19:04,162][123091] Updated weights for policy 0, policy_version 342427 (0.0008) [2023-12-26 02:19:04,220][123090] Updated weights for policy 1, policy_version 340465 (0.0011) [2023-12-26 02:19:04,227][123091] Updated weights for policy 0, policy_version 342437 (0.0009) [2023-12-26 02:19:04,284][123091] Updated weights for policy 0, policy_version 342447 (0.0009) [2023-12-26 02:19:04,287][123090] Updated weights for policy 1, policy_version 340475 (0.0009) [2023-12-26 02:19:05,119][123090] Updated weights for policy 1, policy_version 340485 (0.0011) [2023-12-26 02:19:05,153][123091] Updated weights for policy 0, policy_version 342457 (0.0007) [2023-12-26 02:19:05,179][123090] Updated weights for policy 1, policy_version 340495 (0.0010) [2023-12-26 02:19:05,216][123091] Updated weights for policy 0, policy_version 342467 (0.0008) [2023-12-26 02:19:05,230][123090] Updated weights for policy 1, policy_version 340505 (0.0010) [2023-12-26 02:19:05,272][123091] Updated weights for policy 0, policy_version 342477 (0.0006) [2023-12-26 02:19:06,055][123090] Updated weights for policy 1, policy_version 340515 (0.0010) [2023-12-26 02:19:06,067][123091] Updated weights for policy 0, policy_version 342487 (0.0007) [2023-12-26 02:19:06,120][123090] Updated weights for policy 1, policy_version 340525 (0.0010) [2023-12-26 02:19:06,121][123091] Updated weights for policy 0, policy_version 342497 (0.0007) [2023-12-26 02:19:06,181][123091] Updated weights for policy 0, policy_version 342507 (0.0009) [2023-12-26 02:19:06,187][123090] Updated weights for policy 1, policy_version 340535 (0.0010) [2023-12-26 02:19:06,989][123091] Updated weights for policy 0, policy_version 342517 (0.0006) [2023-12-26 02:19:07,007][123090] Updated weights for policy 1, policy_version 340545 (0.0010) [2023-12-26 02:19:07,042][123091] Updated weights for policy 0, policy_version 342527 (0.0005) [2023-12-26 02:19:07,062][123090] Updated weights for policy 1, policy_version 340555 (0.0010) [2023-12-26 02:19:07,095][123091] Updated weights for policy 0, policy_version 342537 (0.0006) [2023-12-26 02:19:07,121][123090] Updated weights for policy 1, policy_version 340565 (0.0010) [2023-12-26 02:19:07,187][123090] Updated weights for policy 1, policy_version 340575 (0.0010) [2023-12-26 02:19:07,901][123091] Updated weights for policy 0, policy_version 342547 (0.0009) [2023-12-26 02:19:07,950][123091] Updated weights for policy 0, policy_version 342558 (0.0009) [2023-12-26 02:19:07,997][123091] Updated weights for policy 0, policy_version 342568 (0.0006) [2023-12-26 02:19:08,002][123090] Updated weights for policy 1, policy_version 340585 (0.0010) [2023-12-26 02:19:08,061][123090] Updated weights for policy 1, policy_version 340595 (0.0010) [2023-12-26 02:19:08,120][123090] Updated weights for policy 1, policy_version 340605 (0.0010) [2023-12-26 02:19:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.4, 300 sec: 17661.4). Total num frames: 174899200. Throughput: 0: 8985.4, 1: 8492.7. Samples: 174880360. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:08,785][121949] Avg episode reward: [(0, '6332.658'), (1, '5240.150')] [2023-12-26 02:19:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000342576_87703552.pth... [2023-12-26 02:19:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000340608_87195648.pth... [2023-12-26 02:19:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000341552_87441408.pth [2023-12-26 02:19:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000339616_86941696.pth [2023-12-26 02:19:08,888][123090] Updated weights for policy 1, policy_version 340615 (0.0010) [2023-12-26 02:19:08,903][123091] Updated weights for policy 0, policy_version 342578 (0.0007) [2023-12-26 02:19:08,952][123090] Updated weights for policy 1, policy_version 340625 (0.0010) [2023-12-26 02:19:08,968][123091] Updated weights for policy 0, policy_version 342588 (0.0006) [2023-12-26 02:19:09,001][123090] Updated weights for policy 1, policy_version 340635 (0.0010) [2023-12-26 02:19:09,030][123091] Updated weights for policy 0, policy_version 342598 (0.0007) [2023-12-26 02:19:09,093][123091] Updated weights for policy 0, policy_version 342608 (0.0010) [2023-12-26 02:19:09,762][123090] Updated weights for policy 1, policy_version 340645 (0.0009) [2023-12-26 02:19:09,824][123090] Updated weights for policy 1, policy_version 340655 (0.0009) [2023-12-26 02:19:09,891][123090] Updated weights for policy 1, policy_version 340665 (0.0008) [2023-12-26 02:19:10,013][123091] Updated weights for policy 0, policy_version 342618 (0.0010) [2023-12-26 02:19:10,088][123091] Updated weights for policy 0, policy_version 342628 (0.0009) [2023-12-26 02:19:10,168][123091] Updated weights for policy 0, policy_version 342638 (0.0010) [2023-12-26 02:19:10,658][123090] Updated weights for policy 1, policy_version 340675 (0.0008) [2023-12-26 02:19:10,707][123090] Updated weights for policy 1, policy_version 340685 (0.0009) [2023-12-26 02:19:10,763][123090] Updated weights for policy 1, policy_version 340695 (0.0010) [2023-12-26 02:19:11,009][123091] Updated weights for policy 0, policy_version 342648 (0.0010) [2023-12-26 02:19:11,077][123091] Updated weights for policy 0, policy_version 342658 (0.0011) [2023-12-26 02:19:11,149][123091] Updated weights for policy 0, policy_version 342668 (0.0009) [2023-12-26 02:19:11,661][123090] Updated weights for policy 1, policy_version 340705 (0.0009) [2023-12-26 02:19:11,735][123090] Updated weights for policy 1, policy_version 340715 (0.0008) [2023-12-26 02:19:11,812][123090] Updated weights for policy 1, policy_version 340725 (0.0007) [2023-12-26 02:19:11,856][123091] Updated weights for policy 0, policy_version 342678 (0.0007) [2023-12-26 02:19:11,884][123090] Updated weights for policy 1, policy_version 340735 (0.0006) [2023-12-26 02:19:11,928][123091] Updated weights for policy 0, policy_version 342688 (0.0006) [2023-12-26 02:19:11,999][123091] Updated weights for policy 0, policy_version 342698 (0.0008) [2023-12-26 02:19:12,686][123090] Updated weights for policy 1, policy_version 340745 (0.0010) [2023-12-26 02:19:12,742][123090] Updated weights for policy 1, policy_version 340755 (0.0008) [2023-12-26 02:19:12,760][123091] Updated weights for policy 0, policy_version 342708 (0.0009) [2023-12-26 02:19:12,793][123090] Updated weights for policy 1, policy_version 340765 (0.0007) [2023-12-26 02:19:12,823][123091] Updated weights for policy 0, policy_version 342718 (0.0011) [2023-12-26 02:19:12,885][123091] Updated weights for policy 0, policy_version 342728 (0.0010) [2023-12-26 02:19:13,545][123090] Updated weights for policy 1, policy_version 340775 (0.0007) [2023-12-26 02:19:13,592][123090] Updated weights for policy 1, policy_version 340785 (0.0005) [2023-12-26 02:19:13,646][123090] Updated weights for policy 1, policy_version 340795 (0.0007) [2023-12-26 02:19:13,657][123091] Updated weights for policy 0, policy_version 342738 (0.0010) [2023-12-26 02:19:13,710][123091] Updated weights for policy 0, policy_version 342748 (0.0005) [2023-12-26 02:19:13,769][123091] Updated weights for policy 0, policy_version 342758 (0.0006) [2023-12-26 02:19:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 174989312. Throughput: 0: 8954.5, 1: 8526.2. Samples: 174983936. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:13,785][121949] Avg episode reward: [(0, '6330.092'), (1, '5279.850')] [2023-12-26 02:19:13,815][123091] Updated weights for policy 0, policy_version 342768 (0.0008) [2023-12-26 02:19:14,353][123090] Updated weights for policy 1, policy_version 340805 (0.0007) [2023-12-26 02:19:14,425][123090] Updated weights for policy 1, policy_version 340815 (0.0007) [2023-12-26 02:19:14,495][123090] Updated weights for policy 1, policy_version 340825 (0.0008) [2023-12-26 02:19:14,638][123091] Updated weights for policy 0, policy_version 342778 (0.0005) [2023-12-26 02:19:14,707][123091] Updated weights for policy 0, policy_version 342788 (0.0007) [2023-12-26 02:19:14,769][123091] Updated weights for policy 0, policy_version 342798 (0.0009) [2023-12-26 02:19:15,260][123090] Updated weights for policy 1, policy_version 340835 (0.0009) [2023-12-26 02:19:15,309][123090] Updated weights for policy 1, policy_version 340845 (0.0009) [2023-12-26 02:19:15,359][123090] Updated weights for policy 1, policy_version 340855 (0.0009) [2023-12-26 02:19:15,607][123091] Updated weights for policy 0, policy_version 342808 (0.0009) [2023-12-26 02:19:15,667][123091] Updated weights for policy 0, policy_version 342818 (0.0009) [2023-12-26 02:19:15,734][123091] Updated weights for policy 0, policy_version 342828 (0.0009) [2023-12-26 02:19:16,201][123090] Updated weights for policy 1, policy_version 340865 (0.0009) [2023-12-26 02:19:16,257][123090] Updated weights for policy 1, policy_version 340875 (0.0009) [2023-12-26 02:19:16,321][123090] Updated weights for policy 1, policy_version 340885 (0.0009) [2023-12-26 02:19:16,382][123090] Updated weights for policy 1, policy_version 340895 (0.0008) [2023-12-26 02:19:16,525][123091] Updated weights for policy 0, policy_version 342838 (0.0009) [2023-12-26 02:19:16,577][123091] Updated weights for policy 0, policy_version 342848 (0.0009) [2023-12-26 02:19:16,634][123091] Updated weights for policy 0, policy_version 342858 (0.0009) [2023-12-26 02:19:17,199][123090] Updated weights for policy 1, policy_version 340905 (0.0010) [2023-12-26 02:19:17,250][123090] Updated weights for policy 1, policy_version 340915 (0.0009) [2023-12-26 02:19:17,302][123090] Updated weights for policy 1, policy_version 340925 (0.0009) [2023-12-26 02:19:17,450][123091] Updated weights for policy 0, policy_version 342868 (0.0009) [2023-12-26 02:19:17,517][123091] Updated weights for policy 0, policy_version 342878 (0.0009) [2023-12-26 02:19:17,569][123091] Updated weights for policy 0, policy_version 342888 (0.0009) [2023-12-26 02:19:18,133][123090] Updated weights for policy 1, policy_version 340936 (0.0009) [2023-12-26 02:19:18,185][123090] Updated weights for policy 1, policy_version 340946 (0.0009) [2023-12-26 02:19:18,236][123090] Updated weights for policy 1, policy_version 340956 (0.0009) [2023-12-26 02:19:18,393][123091] Updated weights for policy 0, policy_version 342898 (0.0009) [2023-12-26 02:19:18,459][123091] Updated weights for policy 0, policy_version 342908 (0.0009) [2023-12-26 02:19:18,520][123091] Updated weights for policy 0, policy_version 342918 (0.0009) [2023-12-26 02:19:18,581][123091] Updated weights for policy 0, policy_version 342928 (0.0009) [2023-12-26 02:19:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 175079424. Throughput: 0: 8845.1, 1: 8570.9. Samples: 175088212. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:18,785][121949] Avg episode reward: [(0, '6366.408'), (1, '5359.023')] [2023-12-26 02:19:19,116][123090] Updated weights for policy 1, policy_version 340966 (0.0010) [2023-12-26 02:19:19,174][123090] Updated weights for policy 1, policy_version 340976 (0.0010) [2023-12-26 02:19:19,245][123090] Updated weights for policy 1, policy_version 340986 (0.0010) [2023-12-26 02:19:19,432][123091] Updated weights for policy 0, policy_version 342938 (0.0008) [2023-12-26 02:19:19,508][123091] Updated weights for policy 0, policy_version 342948 (0.0009) [2023-12-26 02:19:19,575][123091] Updated weights for policy 0, policy_version 342958 (0.0009) [2023-12-26 02:19:20,079][123090] Updated weights for policy 1, policy_version 340996 (0.0010) [2023-12-26 02:19:20,151][123090] Updated weights for policy 1, policy_version 341006 (0.0008) [2023-12-26 02:19:20,218][123090] Updated weights for policy 1, policy_version 341016 (0.0009) [2023-12-26 02:19:20,391][123091] Updated weights for policy 0, policy_version 342968 (0.0009) [2023-12-26 02:19:20,460][123091] Updated weights for policy 0, policy_version 342978 (0.0009) [2023-12-26 02:19:20,527][123091] Updated weights for policy 0, policy_version 342988 (0.0010) [2023-12-26 02:19:21,045][123090] Updated weights for policy 1, policy_version 341026 (0.0009) [2023-12-26 02:19:21,113][123090] Updated weights for policy 1, policy_version 341036 (0.0009) [2023-12-26 02:19:21,178][123090] Updated weights for policy 1, policy_version 341046 (0.0011) [2023-12-26 02:19:21,245][123090] Updated weights for policy 1, policy_version 341056 (0.0010) [2023-12-26 02:19:21,412][123091] Updated weights for policy 0, policy_version 342998 (0.0009) [2023-12-26 02:19:21,474][123091] Updated weights for policy 0, policy_version 343008 (0.0009) [2023-12-26 02:19:21,539][123091] Updated weights for policy 0, policy_version 343018 (0.0009) [2023-12-26 02:19:22,145][123090] Updated weights for policy 1, policy_version 341066 (0.0009) [2023-12-26 02:19:22,206][123090] Updated weights for policy 1, policy_version 341076 (0.0010) [2023-12-26 02:19:22,264][123090] Updated weights for policy 1, policy_version 341086 (0.0010) [2023-12-26 02:19:22,378][123091] Updated weights for policy 0, policy_version 343028 (0.0010) [2023-12-26 02:19:22,451][123091] Updated weights for policy 0, policy_version 343038 (0.0011) [2023-12-26 02:19:22,527][123091] Updated weights for policy 0, policy_version 343048 (0.0011) [2023-12-26 02:19:22,991][123090] Updated weights for policy 1, policy_version 341096 (0.0008) [2023-12-26 02:19:23,044][123090] Updated weights for policy 1, policy_version 341106 (0.0009) [2023-12-26 02:19:23,103][123090] Updated weights for policy 1, policy_version 341116 (0.0008) [2023-12-26 02:19:23,334][123091] Updated weights for policy 0, policy_version 343058 (0.0011) [2023-12-26 02:19:23,396][123091] Updated weights for policy 0, policy_version 343068 (0.0010) [2023-12-26 02:19:23,461][123091] Updated weights for policy 0, policy_version 343078 (0.0010) [2023-12-26 02:19:23,516][123091] Updated weights for policy 0, policy_version 343088 (0.0010) [2023-12-26 02:19:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17633.6). Total num frames: 175161344. Throughput: 0: 8775.9, 1: 8578.6. Samples: 175137736. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:23,785][121949] Avg episode reward: [(0, '6181.015'), (1, '5495.719')] [2023-12-26 02:19:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000343088_87834624.pth... [2023-12-26 02:19:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000341120_87326720.pth... [2023-12-26 02:19:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000342064_87572480.pth [2023-12-26 02:19:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000340128_87072768.pth [2023-12-26 02:19:23,974][123090] Updated weights for policy 1, policy_version 341126 (0.0010) [2023-12-26 02:19:24,033][123090] Updated weights for policy 1, policy_version 341136 (0.0010) [2023-12-26 02:19:24,097][123090] Updated weights for policy 1, policy_version 341146 (0.0010) [2023-12-26 02:19:24,211][123091] Updated weights for policy 0, policy_version 343098 (0.0006) [2023-12-26 02:19:24,277][123091] Updated weights for policy 0, policy_version 343108 (0.0005) [2023-12-26 02:19:24,343][123091] Updated weights for policy 0, policy_version 343118 (0.0006) [2023-12-26 02:19:24,997][123090] Updated weights for policy 1, policy_version 341156 (0.0010) [2023-12-26 02:19:25,049][123090] Updated weights for policy 1, policy_version 341166 (0.0009) [2023-12-26 02:19:25,098][123091] Updated weights for policy 0, policy_version 343128 (0.0010) [2023-12-26 02:19:25,111][123090] Updated weights for policy 1, policy_version 341176 (0.0009) [2023-12-26 02:19:25,164][123091] Updated weights for policy 0, policy_version 343138 (0.0009) [2023-12-26 02:19:25,228][123091] Updated weights for policy 0, policy_version 343148 (0.0009) [2023-12-26 02:19:25,994][123091] Updated weights for policy 0, policy_version 343158 (0.0010) [2023-12-26 02:19:26,003][123090] Updated weights for policy 1, policy_version 341186 (0.0009) [2023-12-26 02:19:26,053][123091] Updated weights for policy 0, policy_version 343168 (0.0010) [2023-12-26 02:19:26,065][123090] Updated weights for policy 1, policy_version 341196 (0.0008) [2023-12-26 02:19:26,109][123091] Updated weights for policy 0, policy_version 343178 (0.0009) [2023-12-26 02:19:26,112][123090] Updated weights for policy 1, policy_version 341206 (0.0008) [2023-12-26 02:19:26,812][123091] Updated weights for policy 0, policy_version 343188 (0.0005) [2023-12-26 02:19:26,869][123091] Updated weights for policy 0, policy_version 343198 (0.0005) [2023-12-26 02:19:26,920][123091] Updated weights for policy 0, policy_version 343208 (0.0005) [2023-12-26 02:19:27,038][123090] Updated weights for policy 1, policy_version 341217 (0.0009) [2023-12-26 02:19:27,090][123090] Updated weights for policy 1, policy_version 341227 (0.0008) [2023-12-26 02:19:27,141][123090] Updated weights for policy 1, policy_version 341237 (0.0008) [2023-12-26 02:19:27,194][123090] Updated weights for policy 1, policy_version 341248 (0.0009) [2023-12-26 02:19:27,596][123091] Updated weights for policy 0, policy_version 343218 (0.0006) [2023-12-26 02:19:27,647][123091] Updated weights for policy 0, policy_version 343229 (0.0010) [2023-12-26 02:19:27,693][123091] Updated weights for policy 0, policy_version 343240 (0.0010) [2023-12-26 02:19:28,053][123090] Updated weights for policy 1, policy_version 341258 (0.0009) [2023-12-26 02:19:28,113][123090] Updated weights for policy 1, policy_version 341268 (0.0010) [2023-12-26 02:19:28,165][123090] Updated weights for policy 1, policy_version 341278 (0.0009) [2023-12-26 02:19:28,498][123091] Updated weights for policy 0, policy_version 343250 (0.0008) [2023-12-26 02:19:28,551][123091] Updated weights for policy 0, policy_version 343260 (0.0009) [2023-12-26 02:19:28,603][123091] Updated weights for policy 0, policy_version 343270 (0.0009) [2023-12-26 02:19:28,664][123091] Updated weights for policy 0, policy_version 343280 (0.0008) [2023-12-26 02:19:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 175251456. Throughput: 0: 8894.7, 1: 8532.3. Samples: 175243224. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:28,785][121949] Avg episode reward: [(0, '6175.491'), (1, '5490.983')] [2023-12-26 02:19:29,048][123090] Updated weights for policy 1, policy_version 341288 (0.0009) [2023-12-26 02:19:29,109][123090] Updated weights for policy 1, policy_version 341298 (0.0008) [2023-12-26 02:19:29,158][123090] Updated weights for policy 1, policy_version 341308 (0.0009) [2023-12-26 02:19:29,450][123091] Updated weights for policy 0, policy_version 343290 (0.0009) [2023-12-26 02:19:29,509][123091] Updated weights for policy 0, policy_version 343300 (0.0010) [2023-12-26 02:19:29,582][123091] Updated weights for policy 0, policy_version 343310 (0.0011) [2023-12-26 02:19:30,056][123090] Updated weights for policy 1, policy_version 341318 (0.0008) [2023-12-26 02:19:30,122][123090] Updated weights for policy 1, policy_version 341328 (0.0008) [2023-12-26 02:19:30,184][123090] Updated weights for policy 1, policy_version 341338 (0.0006) [2023-12-26 02:19:30,406][123091] Updated weights for policy 0, policy_version 343320 (0.0006) [2023-12-26 02:19:30,472][123091] Updated weights for policy 0, policy_version 343330 (0.0005) [2023-12-26 02:19:30,538][123091] Updated weights for policy 0, policy_version 343340 (0.0005) [2023-12-26 02:19:30,926][123090] Updated weights for policy 1, policy_version 341348 (0.0007) [2023-12-26 02:19:30,979][123090] Updated weights for policy 1, policy_version 341358 (0.0009) [2023-12-26 02:19:31,045][123090] Updated weights for policy 1, policy_version 341368 (0.0010) [2023-12-26 02:19:31,182][123091] Updated weights for policy 0, policy_version 343350 (0.0006) [2023-12-26 02:19:31,256][123091] Updated weights for policy 0, policy_version 343360 (0.0006) [2023-12-26 02:19:31,312][123091] Updated weights for policy 0, policy_version 343370 (0.0006) [2023-12-26 02:19:31,891][123090] Updated weights for policy 1, policy_version 341378 (0.0007) [2023-12-26 02:19:31,941][123090] Updated weights for policy 1, policy_version 341388 (0.0009) [2023-12-26 02:19:31,991][123090] Updated weights for policy 1, policy_version 341398 (0.0008) [2023-12-26 02:19:32,042][123091] Updated weights for policy 0, policy_version 343380 (0.0008) [2023-12-26 02:19:32,046][123090] Updated weights for policy 1, policy_version 341408 (0.0007) [2023-12-26 02:19:32,100][123091] Updated weights for policy 0, policy_version 343390 (0.0009) [2023-12-26 02:19:32,150][123091] Updated weights for policy 0, policy_version 343400 (0.0009) [2023-12-26 02:19:32,848][123091] Updated weights for policy 0, policy_version 343410 (0.0010) [2023-12-26 02:19:32,899][123091] Updated weights for policy 0, policy_version 343420 (0.0008) [2023-12-26 02:19:32,944][123090] Updated weights for policy 1, policy_version 341418 (0.0008) [2023-12-26 02:19:32,954][123091] Updated weights for policy 0, policy_version 343430 (0.0008) [2023-12-26 02:19:33,004][123090] Updated weights for policy 1, policy_version 341428 (0.0008) [2023-12-26 02:19:33,017][123091] Updated weights for policy 0, policy_version 343440 (0.0006) [2023-12-26 02:19:33,067][123090] Updated weights for policy 1, policy_version 341438 (0.0009) [2023-12-26 02:19:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 175333376. Throughput: 0: 8852.0, 1: 8559.4. Samples: 175349656. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:33,785][121949] Avg episode reward: [(0, '6319.949'), (1, '5536.611')] [2023-12-26 02:19:33,841][123091] Updated weights for policy 0, policy_version 343450 (0.0008) [2023-12-26 02:19:33,848][123090] Updated weights for policy 1, policy_version 341448 (0.0009) [2023-12-26 02:19:33,894][123090] Updated weights for policy 1, policy_version 341458 (0.0009) [2023-12-26 02:19:33,907][123091] Updated weights for policy 0, policy_version 343460 (0.0007) [2023-12-26 02:19:33,946][123090] Updated weights for policy 1, policy_version 341468 (0.0010) [2023-12-26 02:19:33,968][123091] Updated weights for policy 0, policy_version 343470 (0.0007) [2023-12-26 02:19:34,733][123091] Updated weights for policy 0, policy_version 343480 (0.0011) [2023-12-26 02:19:34,789][123091] Updated weights for policy 0, policy_version 343490 (0.0011) [2023-12-26 02:19:34,849][123091] Updated weights for policy 0, policy_version 343500 (0.0011) [2023-12-26 02:19:34,860][123090] Updated weights for policy 1, policy_version 341478 (0.0008) [2023-12-26 02:19:34,927][123090] Updated weights for policy 1, policy_version 341488 (0.0009) [2023-12-26 02:19:34,976][123090] Updated weights for policy 1, policy_version 341498 (0.0009) [2023-12-26 02:19:35,678][123091] Updated weights for policy 0, policy_version 343510 (0.0008) [2023-12-26 02:19:35,744][123091] Updated weights for policy 0, policy_version 343520 (0.0005) [2023-12-26 02:19:35,791][123091] Updated weights for policy 0, policy_version 343530 (0.0006) [2023-12-26 02:19:35,831][123090] Updated weights for policy 1, policy_version 341508 (0.0010) [2023-12-26 02:19:35,908][123090] Updated weights for policy 1, policy_version 341518 (0.0010) [2023-12-26 02:19:35,979][123090] Updated weights for policy 1, policy_version 341528 (0.0008) [2023-12-26 02:19:36,478][123091] Updated weights for policy 0, policy_version 343540 (0.0007) [2023-12-26 02:19:36,527][123091] Updated weights for policy 0, policy_version 343550 (0.0011) [2023-12-26 02:19:36,590][123091] Updated weights for policy 0, policy_version 343560 (0.0011) [2023-12-26 02:19:36,724][123090] Updated weights for policy 1, policy_version 341538 (0.0007) [2023-12-26 02:19:36,772][123090] Updated weights for policy 1, policy_version 341548 (0.0010) [2023-12-26 02:19:36,820][123090] Updated weights for policy 1, policy_version 341558 (0.0010) [2023-12-26 02:19:36,867][123090] Updated weights for policy 1, policy_version 341568 (0.0010) [2023-12-26 02:19:37,439][123091] Updated weights for policy 0, policy_version 343570 (0.0011) [2023-12-26 02:19:37,487][123091] Updated weights for policy 0, policy_version 343580 (0.0010) [2023-12-26 02:19:37,539][123091] Updated weights for policy 0, policy_version 343590 (0.0011) [2023-12-26 02:19:37,591][123090] Updated weights for policy 1, policy_version 341578 (0.0005) [2023-12-26 02:19:37,595][123091] Updated weights for policy 0, policy_version 343600 (0.0011) [2023-12-26 02:19:37,641][123090] Updated weights for policy 1, policy_version 341588 (0.0005) [2023-12-26 02:19:37,690][123090] Updated weights for policy 1, policy_version 341598 (0.0005) [2023-12-26 02:19:38,377][123090] Updated weights for policy 1, policy_version 341608 (0.0007) [2023-12-26 02:19:38,442][123090] Updated weights for policy 1, policy_version 341618 (0.0008) [2023-12-26 02:19:38,446][123091] Updated weights for policy 0, policy_version 343610 (0.0011) [2023-12-26 02:19:38,499][123090] Updated weights for policy 1, policy_version 341628 (0.0010) [2023-12-26 02:19:38,513][123091] Updated weights for policy 0, policy_version 343620 (0.0011) [2023-12-26 02:19:38,584][123091] Updated weights for policy 0, policy_version 343630 (0.0011) [2023-12-26 02:19:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 175431680. Throughput: 0: 8853.4, 1: 8578.3. Samples: 175402048. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:38,785][121949] Avg episode reward: [(0, '6349.111'), (1, '5565.574')] [2023-12-26 02:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000343632_87973888.pth... [2023-12-26 02:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000341632_87457792.pth... [2023-12-26 02:19:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000340608_87195648.pth [2023-12-26 02:19:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000342576_87703552.pth [2023-12-26 02:19:39,258][123090] Updated weights for policy 1, policy_version 341638 (0.0006) [2023-12-26 02:19:39,331][123090] Updated weights for policy 1, policy_version 341648 (0.0007) [2023-12-26 02:19:39,398][123090] Updated weights for policy 1, policy_version 341658 (0.0008) [2023-12-26 02:19:39,411][123091] Updated weights for policy 0, policy_version 343640 (0.0011) [2023-12-26 02:19:39,475][123091] Updated weights for policy 0, policy_version 343650 (0.0011) [2023-12-26 02:19:39,547][123091] Updated weights for policy 0, policy_version 343660 (0.0011) [2023-12-26 02:19:40,180][123090] Updated weights for policy 1, policy_version 341668 (0.0011) [2023-12-26 02:19:40,245][123090] Updated weights for policy 1, policy_version 341678 (0.0010) [2023-12-26 02:19:40,308][123090] Updated weights for policy 1, policy_version 341688 (0.0010) [2023-12-26 02:19:40,385][123091] Updated weights for policy 0, policy_version 343670 (0.0011) [2023-12-26 02:19:40,452][123091] Updated weights for policy 0, policy_version 343680 (0.0011) [2023-12-26 02:19:40,513][123091] Updated weights for policy 0, policy_version 343690 (0.0011) [2023-12-26 02:19:41,136][123090] Updated weights for policy 1, policy_version 341698 (0.0011) [2023-12-26 02:19:41,201][123090] Updated weights for policy 1, policy_version 341708 (0.0010) [2023-12-26 02:19:41,234][123091] Updated weights for policy 0, policy_version 343700 (0.0011) [2023-12-26 02:19:41,265][123090] Updated weights for policy 1, policy_version 341718 (0.0011) [2023-12-26 02:19:41,295][123091] Updated weights for policy 0, policy_version 343710 (0.0010) [2023-12-26 02:19:41,326][123090] Updated weights for policy 1, policy_version 341728 (0.0010) [2023-12-26 02:19:41,354][123091] Updated weights for policy 0, policy_version 343720 (0.0008) [2023-12-26 02:19:42,142][123090] Updated weights for policy 1, policy_version 341738 (0.0008) [2023-12-26 02:19:42,201][123090] Updated weights for policy 1, policy_version 341748 (0.0005) [2023-12-26 02:19:42,213][123091] Updated weights for policy 0, policy_version 343730 (0.0010) [2023-12-26 02:19:42,265][123090] Updated weights for policy 1, policy_version 341758 (0.0007) [2023-12-26 02:19:42,278][123091] Updated weights for policy 0, policy_version 343740 (0.0011) [2023-12-26 02:19:42,341][123091] Updated weights for policy 0, policy_version 343750 (0.0011) [2023-12-26 02:19:42,407][123091] Updated weights for policy 0, policy_version 343760 (0.0011) [2023-12-26 02:19:43,010][123090] Updated weights for policy 1, policy_version 341768 (0.0010) [2023-12-26 02:19:43,061][123090] Updated weights for policy 1, policy_version 341778 (0.0010) [2023-12-26 02:19:43,113][123090] Updated weights for policy 1, policy_version 341788 (0.0010) [2023-12-26 02:19:43,128][123091] Updated weights for policy 0, policy_version 343770 (0.0011) [2023-12-26 02:19:43,179][123091] Updated weights for policy 0, policy_version 343780 (0.0010) [2023-12-26 02:19:43,234][123091] Updated weights for policy 0, policy_version 343790 (0.0011) [2023-12-26 02:19:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 175513600. Throughput: 0: 8796.0, 1: 8637.6. Samples: 175508704. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:43,785][121949] Avg episode reward: [(0, '6184.354'), (1, '5778.930')] [2023-12-26 02:19:43,958][123090] Updated weights for policy 1, policy_version 341798 (0.0010) [2023-12-26 02:19:43,985][123091] Updated weights for policy 0, policy_version 343800 (0.0006) [2023-12-26 02:19:44,004][123090] Updated weights for policy 1, policy_version 341808 (0.0006) [2023-12-26 02:19:44,042][123091] Updated weights for policy 0, policy_version 343810 (0.0007) [2023-12-26 02:19:44,063][123090] Updated weights for policy 1, policy_version 341818 (0.0007) [2023-12-26 02:19:44,096][123091] Updated weights for policy 0, policy_version 343820 (0.0010) [2023-12-26 02:19:44,832][123090] Updated weights for policy 1, policy_version 341828 (0.0010) [2023-12-26 02:19:44,902][123090] Updated weights for policy 1, policy_version 341838 (0.0010) [2023-12-26 02:19:44,904][123091] Updated weights for policy 0, policy_version 343830 (0.0007) [2023-12-26 02:19:44,966][123090] Updated weights for policy 1, policy_version 341848 (0.0009) [2023-12-26 02:19:44,966][123091] Updated weights for policy 0, policy_version 343840 (0.0007) [2023-12-26 02:19:45,027][123091] Updated weights for policy 0, policy_version 343850 (0.0011) [2023-12-26 02:19:45,774][123091] Updated weights for policy 0, policy_version 343860 (0.0011) [2023-12-26 02:19:45,811][123090] Updated weights for policy 1, policy_version 341858 (0.0009) [2023-12-26 02:19:45,834][123091] Updated weights for policy 0, policy_version 343870 (0.0007) [2023-12-26 02:19:45,860][123090] Updated weights for policy 1, policy_version 341868 (0.0010) [2023-12-26 02:19:45,897][123091] Updated weights for policy 0, policy_version 343880 (0.0005) [2023-12-26 02:19:45,909][123090] Updated weights for policy 1, policy_version 341878 (0.0010) [2023-12-26 02:19:45,954][123090] Updated weights for policy 1, policy_version 341888 (0.0010) [2023-12-26 02:19:46,597][123091] Updated weights for policy 0, policy_version 343890 (0.0007) [2023-12-26 02:19:46,662][123091] Updated weights for policy 0, policy_version 343900 (0.0011) [2023-12-26 02:19:46,681][123090] Updated weights for policy 1, policy_version 341898 (0.0007) [2023-12-26 02:19:46,730][123091] Updated weights for policy 0, policy_version 343910 (0.0011) [2023-12-26 02:19:46,744][123090] Updated weights for policy 1, policy_version 341908 (0.0007) [2023-12-26 02:19:46,795][123091] Updated weights for policy 0, policy_version 343920 (0.0010) [2023-12-26 02:19:46,804][123090] Updated weights for policy 1, policy_version 341918 (0.0009) [2023-12-26 02:19:47,535][123091] Updated weights for policy 0, policy_version 343930 (0.0009) [2023-12-26 02:19:47,583][123091] Updated weights for policy 0, policy_version 343940 (0.0008) [2023-12-26 02:19:47,623][123090] Updated weights for policy 1, policy_version 341928 (0.0011) [2023-12-26 02:19:47,647][123091] Updated weights for policy 0, policy_version 343950 (0.0007) [2023-12-26 02:19:47,670][123090] Updated weights for policy 1, policy_version 341938 (0.0010) [2023-12-26 02:19:47,722][123090] Updated weights for policy 1, policy_version 341948 (0.0010) [2023-12-26 02:19:48,406][123091] Updated weights for policy 0, policy_version 343960 (0.0006) [2023-12-26 02:19:48,466][123091] Updated weights for policy 0, policy_version 343970 (0.0008) [2023-12-26 02:19:48,530][123091] Updated weights for policy 0, policy_version 343980 (0.0007) [2023-12-26 02:19:48,552][123090] Updated weights for policy 1, policy_version 341958 (0.0010) [2023-12-26 02:19:48,623][123090] Updated weights for policy 1, policy_version 341968 (0.0009) [2023-12-26 02:19:48,691][123090] Updated weights for policy 1, policy_version 341978 (0.0011) [2023-12-26 02:19:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 175611904. Throughput: 0: 8882.2, 1: 8669.5. Samples: 175618816. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:48,785][121949] Avg episode reward: [(0, '6245.834'), (1, '5513.343')] [2023-12-26 02:19:49,297][123091] Updated weights for policy 0, policy_version 343990 (0.0008) [2023-12-26 02:19:49,371][123091] Updated weights for policy 0, policy_version 344000 (0.0009) [2023-12-26 02:19:49,434][123091] Updated weights for policy 0, policy_version 344010 (0.0011) [2023-12-26 02:19:49,485][123090] Updated weights for policy 1, policy_version 341988 (0.0010) [2023-12-26 02:19:49,550][123090] Updated weights for policy 1, policy_version 341998 (0.0010) [2023-12-26 02:19:49,624][123090] Updated weights for policy 1, policy_version 342008 (0.0011) [2023-12-26 02:19:50,166][123091] Updated weights for policy 0, policy_version 344020 (0.0011) [2023-12-26 02:19:50,218][123091] Updated weights for policy 0, policy_version 344030 (0.0011) [2023-12-26 02:19:50,274][123091] Updated weights for policy 0, policy_version 344040 (0.0011) [2023-12-26 02:19:50,406][123090] Updated weights for policy 1, policy_version 342018 (0.0010) [2023-12-26 02:19:50,462][123090] Updated weights for policy 1, policy_version 342028 (0.0009) [2023-12-26 02:19:50,523][123090] Updated weights for policy 1, policy_version 342038 (0.0009) [2023-12-26 02:19:50,597][123090] Updated weights for policy 1, policy_version 342048 (0.0009) [2023-12-26 02:19:51,094][123091] Updated weights for policy 0, policy_version 344050 (0.0010) [2023-12-26 02:19:51,160][123091] Updated weights for policy 0, policy_version 344060 (0.0008) [2023-12-26 02:19:51,219][123091] Updated weights for policy 0, policy_version 344070 (0.0010) [2023-12-26 02:19:51,286][123091] Updated weights for policy 0, policy_version 344080 (0.0011) [2023-12-26 02:19:51,489][123090] Updated weights for policy 1, policy_version 342058 (0.0009) [2023-12-26 02:19:51,549][123090] Updated weights for policy 1, policy_version 342068 (0.0009) [2023-12-26 02:19:51,615][123090] Updated weights for policy 1, policy_version 342078 (0.0009) [2023-12-26 02:19:52,038][123091] Updated weights for policy 0, policy_version 344090 (0.0007) [2023-12-26 02:19:52,105][123091] Updated weights for policy 0, policy_version 344100 (0.0011) [2023-12-26 02:19:52,172][123091] Updated weights for policy 0, policy_version 344110 (0.0011) [2023-12-26 02:19:52,500][123090] Updated weights for policy 1, policy_version 342088 (0.0009) [2023-12-26 02:19:52,568][123090] Updated weights for policy 1, policy_version 342098 (0.0010) [2023-12-26 02:19:52,633][123090] Updated weights for policy 1, policy_version 342108 (0.0010) [2023-12-26 02:19:52,877][123091] Updated weights for policy 0, policy_version 344120 (0.0006) [2023-12-26 02:19:52,924][123091] Updated weights for policy 0, policy_version 344130 (0.0005) [2023-12-26 02:19:52,965][123091] Updated weights for policy 0, policy_version 344140 (0.0005) [2023-12-26 02:19:53,498][123090] Updated weights for policy 1, policy_version 342118 (0.0009) [2023-12-26 02:19:53,554][123090] Updated weights for policy 1, policy_version 342128 (0.0008) [2023-12-26 02:19:53,614][123090] Updated weights for policy 1, policy_version 342138 (0.0009) [2023-12-26 02:19:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 175693824. Throughput: 0: 8896.4, 1: 8665.2. Samples: 175670632. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:53,785][123091] Updated weights for policy 0, policy_version 344150 (0.0006) [2023-12-26 02:19:53,785][121949] Avg episode reward: [(0, '6372.031'), (1, '5439.396')] [2023-12-26 02:19:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000342144_87588864.pth... [2023-12-26 02:19:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000341120_87326720.pth [2023-12-26 02:19:53,843][123091] Updated weights for policy 0, policy_version 344160 (0.0005) [2023-12-26 02:19:53,898][123091] Updated weights for policy 0, policy_version 344170 (0.0005) [2023-12-26 02:19:53,937][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000344176_88113152.pth... [2023-12-26 02:19:53,942][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000343088_87834624.pth [2023-12-26 02:19:54,438][123090] Updated weights for policy 1, policy_version 342148 (0.0009) [2023-12-26 02:19:54,501][123090] Updated weights for policy 1, policy_version 342158 (0.0010) [2023-12-26 02:19:54,532][123091] Updated weights for policy 0, policy_version 344180 (0.0005) [2023-12-26 02:19:54,567][123090] Updated weights for policy 1, policy_version 342168 (0.0009) [2023-12-26 02:19:54,598][123091] Updated weights for policy 0, policy_version 344190 (0.0005) [2023-12-26 02:19:54,665][123091] Updated weights for policy 0, policy_version 344200 (0.0005) [2023-12-26 02:19:55,225][123090] Updated weights for policy 1, policy_version 342178 (0.0008) [2023-12-26 02:19:55,283][123091] Updated weights for policy 0, policy_version 344210 (0.0006) [2023-12-26 02:19:55,290][123090] Updated weights for policy 1, policy_version 342188 (0.0009) [2023-12-26 02:19:55,339][123091] Updated weights for policy 0, policy_version 344220 (0.0005) [2023-12-26 02:19:55,357][123090] Updated weights for policy 1, policy_version 342198 (0.0008) [2023-12-26 02:19:55,393][123091] Updated weights for policy 0, policy_version 344230 (0.0006) [2023-12-26 02:19:55,429][123090] Updated weights for policy 1, policy_version 342208 (0.0008) [2023-12-26 02:19:55,440][123091] Updated weights for policy 0, policy_version 344240 (0.0010) [2023-12-26 02:19:56,070][123090] Updated weights for policy 1, policy_version 342218 (0.0007) [2023-12-26 02:19:56,126][123090] Updated weights for policy 1, policy_version 342228 (0.0005) [2023-12-26 02:19:56,190][123090] Updated weights for policy 1, policy_version 342238 (0.0005) [2023-12-26 02:19:56,247][123091] Updated weights for policy 0, policy_version 344250 (0.0010) [2023-12-26 02:19:56,301][123091] Updated weights for policy 0, policy_version 344260 (0.0010) [2023-12-26 02:19:56,348][123091] Updated weights for policy 0, policy_version 344270 (0.0010) [2023-12-26 02:19:56,890][123090] Updated weights for policy 1, policy_version 342248 (0.0006) [2023-12-26 02:19:56,944][123090] Updated weights for policy 1, policy_version 342258 (0.0005) [2023-12-26 02:19:56,999][123090] Updated weights for policy 1, policy_version 342268 (0.0005) [2023-12-26 02:19:57,151][123091] Updated weights for policy 0, policy_version 344280 (0.0008) [2023-12-26 02:19:57,198][123091] Updated weights for policy 0, policy_version 344290 (0.0010) [2023-12-26 02:19:57,242][123091] Updated weights for policy 0, policy_version 344300 (0.0006) [2023-12-26 02:19:57,725][123090] Updated weights for policy 1, policy_version 342278 (0.0008) [2023-12-26 02:19:57,784][123090] Updated weights for policy 1, policy_version 342288 (0.0010) [2023-12-26 02:19:57,837][123090] Updated weights for policy 1, policy_version 342298 (0.0010) [2023-12-26 02:19:58,004][123091] Updated weights for policy 0, policy_version 344310 (0.0007) [2023-12-26 02:19:58,069][123091] Updated weights for policy 0, policy_version 344320 (0.0008) [2023-12-26 02:19:58,135][123091] Updated weights for policy 0, policy_version 344330 (0.0008) [2023-12-26 02:19:58,742][123090] Updated weights for policy 1, policy_version 342308 (0.0007) [2023-12-26 02:19:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 175783936. Throughput: 0: 9023.8, 1: 8726.1. Samples: 175782676. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:19:58,784][121949] Avg episode reward: [(0, '6269.905'), (1, '5676.097')] [2023-12-26 02:19:58,812][123090] Updated weights for policy 1, policy_version 342318 (0.0009) [2023-12-26 02:19:58,859][123091] Updated weights for policy 0, policy_version 344340 (0.0007) [2023-12-26 02:19:58,870][123090] Updated weights for policy 1, policy_version 342328 (0.0010) [2023-12-26 02:19:58,914][123091] Updated weights for policy 0, policy_version 344350 (0.0006) [2023-12-26 02:19:58,968][123091] Updated weights for policy 0, policy_version 344360 (0.0005) [2023-12-26 02:19:59,668][123091] Updated weights for policy 0, policy_version 344370 (0.0006) [2023-12-26 02:19:59,739][123091] Updated weights for policy 0, policy_version 344380 (0.0008) [2023-12-26 02:19:59,791][123091] Updated weights for policy 0, policy_version 344390 (0.0006) [2023-12-26 02:19:59,804][123090] Updated weights for policy 1, policy_version 342338 (0.0008) [2023-12-26 02:19:59,847][123091] Updated weights for policy 0, policy_version 344400 (0.0007) [2023-12-26 02:19:59,865][123090] Updated weights for policy 1, policy_version 342348 (0.0008) [2023-12-26 02:19:59,930][123090] Updated weights for policy 1, policy_version 342358 (0.0008) [2023-12-26 02:19:59,990][123090] Updated weights for policy 1, policy_version 342368 (0.0008) [2023-12-26 02:20:00,570][123091] Updated weights for policy 0, policy_version 344410 (0.0005) [2023-12-26 02:20:00,644][123091] Updated weights for policy 0, policy_version 344420 (0.0005) [2023-12-26 02:20:00,700][123091] Updated weights for policy 0, policy_version 344430 (0.0005) [2023-12-26 02:20:00,718][123090] Updated weights for policy 1, policy_version 342378 (0.0006) [2023-12-26 02:20:00,787][123090] Updated weights for policy 1, policy_version 342388 (0.0007) [2023-12-26 02:20:00,842][123090] Updated weights for policy 1, policy_version 342398 (0.0005) [2023-12-26 02:20:01,407][123091] Updated weights for policy 0, policy_version 344440 (0.0009) [2023-12-26 02:20:01,473][123091] Updated weights for policy 0, policy_version 344450 (0.0010) [2023-12-26 02:20:01,539][123091] Updated weights for policy 0, policy_version 344460 (0.0011) [2023-12-26 02:20:01,599][123090] Updated weights for policy 1, policy_version 342408 (0.0009) [2023-12-26 02:20:01,666][123090] Updated weights for policy 1, policy_version 342418 (0.0008) [2023-12-26 02:20:01,740][123090] Updated weights for policy 1, policy_version 342428 (0.0008) [2023-12-26 02:20:02,341][123091] Updated weights for policy 0, policy_version 344470 (0.0010) [2023-12-26 02:20:02,406][123091] Updated weights for policy 0, policy_version 344480 (0.0011) [2023-12-26 02:20:02,434][123090] Updated weights for policy 1, policy_version 342438 (0.0010) [2023-12-26 02:20:02,459][123091] Updated weights for policy 0, policy_version 344490 (0.0010) [2023-12-26 02:20:02,498][123090] Updated weights for policy 1, policy_version 342448 (0.0011) [2023-12-26 02:20:02,562][123090] Updated weights for policy 1, policy_version 342458 (0.0011) [2023-12-26 02:20:03,250][123091] Updated weights for policy 0, policy_version 344500 (0.0008) [2023-12-26 02:20:03,299][123091] Updated weights for policy 0, policy_version 344510 (0.0005) [2023-12-26 02:20:03,319][123090] Updated weights for policy 1, policy_version 342468 (0.0006) [2023-12-26 02:20:03,354][123091] Updated weights for policy 0, policy_version 344520 (0.0005) [2023-12-26 02:20:03,371][123090] Updated weights for policy 1, policy_version 342478 (0.0005) [2023-12-26 02:20:03,424][123090] Updated weights for policy 1, policy_version 342488 (0.0005) [2023-12-26 02:20:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 175882240. Throughput: 0: 9170.0, 1: 8719.3. Samples: 175893228. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:20:03,785][121949] Avg episode reward: [(0, '6148.971'), (1, '5671.752')] [2023-12-26 02:20:04,065][123091] Updated weights for policy 0, policy_version 344530 (0.0006) [2023-12-26 02:20:04,121][123091] Updated weights for policy 0, policy_version 344540 (0.0011) [2023-12-26 02:20:04,177][123091] Updated weights for policy 0, policy_version 344550 (0.0010) [2023-12-26 02:20:04,200][123090] Updated weights for policy 1, policy_version 342498 (0.0005) [2023-12-26 02:20:04,232][123091] Updated weights for policy 0, policy_version 344560 (0.0010) [2023-12-26 02:20:04,259][123090] Updated weights for policy 1, policy_version 342508 (0.0007) [2023-12-26 02:20:04,326][123090] Updated weights for policy 1, policy_version 342518 (0.0008) [2023-12-26 02:20:04,394][123090] Updated weights for policy 1, policy_version 342528 (0.0009) [2023-12-26 02:20:05,069][123091] Updated weights for policy 0, policy_version 344570 (0.0008) [2023-12-26 02:20:05,136][123091] Updated weights for policy 0, policy_version 344580 (0.0011) [2023-12-26 02:20:05,226][123091] Updated weights for policy 0, policy_version 344590 (0.0011) [2023-12-26 02:20:05,229][123090] Updated weights for policy 1, policy_version 342538 (0.0008) [2023-12-26 02:20:05,294][123090] Updated weights for policy 1, policy_version 342548 (0.0009) [2023-12-26 02:20:05,350][123090] Updated weights for policy 1, policy_version 342558 (0.0009) [2023-12-26 02:20:06,003][123091] Updated weights for policy 0, policy_version 344600 (0.0010) [2023-12-26 02:20:06,054][123091] Updated weights for policy 0, policy_version 344610 (0.0010) [2023-12-26 02:20:06,102][123091] Updated weights for policy 0, policy_version 344620 (0.0009) [2023-12-26 02:20:06,154][123090] Updated weights for policy 1, policy_version 342568 (0.0009) [2023-12-26 02:20:06,211][123090] Updated weights for policy 1, policy_version 342578 (0.0011) [2023-12-26 02:20:06,279][123090] Updated weights for policy 1, policy_version 342588 (0.0011) [2023-12-26 02:20:06,931][123091] Updated weights for policy 0, policy_version 344630 (0.0007) [2023-12-26 02:20:06,989][123091] Updated weights for policy 0, policy_version 344640 (0.0005) [2023-12-26 02:20:07,048][123091] Updated weights for policy 0, policy_version 344650 (0.0005) [2023-12-26 02:20:07,090][123090] Updated weights for policy 1, policy_version 342598 (0.0010) [2023-12-26 02:20:07,161][123090] Updated weights for policy 1, policy_version 342608 (0.0010) [2023-12-26 02:20:07,231][123090] Updated weights for policy 1, policy_version 342618 (0.0011) [2023-12-26 02:20:07,643][123091] Updated weights for policy 0, policy_version 344660 (0.0006) [2023-12-26 02:20:07,705][123091] Updated weights for policy 0, policy_version 344670 (0.0006) [2023-12-26 02:20:07,773][123091] Updated weights for policy 0, policy_version 344680 (0.0006) [2023-12-26 02:20:08,013][123090] Updated weights for policy 1, policy_version 342628 (0.0010) [2023-12-26 02:20:08,073][123090] Updated weights for policy 1, policy_version 342638 (0.0007) [2023-12-26 02:20:08,147][123090] Updated weights for policy 1, policy_version 342648 (0.0005) [2023-12-26 02:20:08,526][123091] Updated weights for policy 0, policy_version 344690 (0.0006) [2023-12-26 02:20:08,582][123091] Updated weights for policy 0, policy_version 344700 (0.0008) [2023-12-26 02:20:08,649][123091] Updated weights for policy 0, policy_version 344710 (0.0011) [2023-12-26 02:20:08,717][123091] Updated weights for policy 0, policy_version 344720 (0.0007) [2023-12-26 02:20:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 175972352. Throughput: 0: 9204.3, 1: 8737.3. Samples: 175945108. Policy #0 lag: (min: 31.0, avg: 43.8, max: 63.0) [2023-12-26 02:20:08,785][121949] Avg episode reward: [(0, '6243.986'), (1, '5727.922')] [2023-12-26 02:20:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000344720_88252416.pth... [2023-12-26 02:20:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000342656_87719936.pth... [2023-12-26 02:20:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000343632_87973888.pth [2023-12-26 02:20:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000341632_87457792.pth [2023-12-26 02:20:08,952][123090] Updated weights for policy 1, policy_version 342658 (0.0006) [2023-12-26 02:20:09,020][123090] Updated weights for policy 1, policy_version 342668 (0.0009) [2023-12-26 02:20:09,073][123090] Updated weights for policy 1, policy_version 342678 (0.0008) [2023-12-26 02:20:09,138][123090] Updated weights for policy 1, policy_version 342688 (0.0009) [2023-12-26 02:20:09,571][123091] Updated weights for policy 0, policy_version 344730 (0.0010) [2023-12-26 02:20:09,645][123091] Updated weights for policy 0, policy_version 344740 (0.0011) [2023-12-26 02:20:09,716][123091] Updated weights for policy 0, policy_version 344750 (0.0011) [2023-12-26 02:20:10,074][123090] Updated weights for policy 1, policy_version 342698 (0.0008) [2023-12-26 02:20:10,144][123090] Updated weights for policy 1, policy_version 342708 (0.0008) [2023-12-26 02:20:10,215][123090] Updated weights for policy 1, policy_version 342718 (0.0009) [2023-12-26 02:20:10,530][123091] Updated weights for policy 0, policy_version 344760 (0.0010) [2023-12-26 02:20:10,578][123091] Updated weights for policy 0, policy_version 344770 (0.0011) [2023-12-26 02:20:10,626][123091] Updated weights for policy 0, policy_version 344780 (0.0011) [2023-12-26 02:20:11,070][123090] Updated weights for policy 1, policy_version 342728 (0.0010) [2023-12-26 02:20:11,154][123090] Updated weights for policy 1, policy_version 342738 (0.0011) [2023-12-26 02:20:11,232][123090] Updated weights for policy 1, policy_version 342748 (0.0011) [2023-12-26 02:20:11,558][123091] Updated weights for policy 0, policy_version 344790 (0.0010) [2023-12-26 02:20:11,631][123091] Updated weights for policy 0, policy_version 344800 (0.0009) [2023-12-26 02:20:11,707][123091] Updated weights for policy 0, policy_version 344810 (0.0009) [2023-12-26 02:20:12,151][123090] Updated weights for policy 1, policy_version 342758 (0.0009) [2023-12-26 02:20:12,222][123090] Updated weights for policy 1, policy_version 342768 (0.0009) [2023-12-26 02:20:12,299][123090] Updated weights for policy 1, policy_version 342778 (0.0010) [2023-12-26 02:20:12,624][123091] Updated weights for policy 0, policy_version 344820 (0.0009) [2023-12-26 02:20:12,700][123091] Updated weights for policy 0, policy_version 344830 (0.0009) [2023-12-26 02:20:12,770][123091] Updated weights for policy 0, policy_version 344840 (0.0008) [2023-12-26 02:20:13,280][123090] Updated weights for policy 1, policy_version 342788 (0.0009) [2023-12-26 02:20:13,357][123090] Updated weights for policy 1, policy_version 342798 (0.0010) [2023-12-26 02:20:13,434][123090] Updated weights for policy 1, policy_version 342808 (0.0010) [2023-12-26 02:20:13,631][123091] Updated weights for policy 0, policy_version 344850 (0.0008) [2023-12-26 02:20:13,702][123091] Updated weights for policy 0, policy_version 344860 (0.0008) [2023-12-26 02:20:13,772][123091] Updated weights for policy 0, policy_version 344870 (0.0008) [2023-12-26 02:20:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 176046080. Throughput: 0: 9102.5, 1: 8719.9. Samples: 176045232. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:13,785][121949] Avg episode reward: [(0, '6246.296'), (1, '5625.668')] [2023-12-26 02:20:13,848][123091] Updated weights for policy 0, policy_version 344880 (0.0006) [2023-12-26 02:20:14,265][123090] Updated weights for policy 1, policy_version 342818 (0.0008) [2023-12-26 02:20:14,332][123090] Updated weights for policy 1, policy_version 342828 (0.0007) [2023-12-26 02:20:14,401][123090] Updated weights for policy 1, policy_version 342838 (0.0009) [2023-12-26 02:20:14,472][123090] Updated weights for policy 1, policy_version 342848 (0.0009) [2023-12-26 02:20:14,561][123091] Updated weights for policy 0, policy_version 344890 (0.0009) [2023-12-26 02:20:14,609][123091] Updated weights for policy 0, policy_version 344900 (0.0009) [2023-12-26 02:20:14,671][123091] Updated weights for policy 0, policy_version 344910 (0.0010) [2023-12-26 02:20:15,265][123090] Updated weights for policy 1, policy_version 342858 (0.0010) [2023-12-26 02:20:15,336][123090] Updated weights for policy 1, policy_version 342868 (0.0010) [2023-12-26 02:20:15,412][123090] Updated weights for policy 1, policy_version 342878 (0.0009) [2023-12-26 02:20:15,540][123091] Updated weights for policy 0, policy_version 344920 (0.0009) [2023-12-26 02:20:15,608][123091] Updated weights for policy 0, policy_version 344930 (0.0010) [2023-12-26 02:20:15,672][123091] Updated weights for policy 0, policy_version 344940 (0.0010) [2023-12-26 02:20:16,225][123090] Updated weights for policy 1, policy_version 342888 (0.0009) [2023-12-26 02:20:16,292][123090] Updated weights for policy 1, policy_version 342898 (0.0009) [2023-12-26 02:20:16,354][123090] Updated weights for policy 1, policy_version 342908 (0.0009) [2023-12-26 02:20:16,497][123091] Updated weights for policy 0, policy_version 344950 (0.0007) [2023-12-26 02:20:16,552][123091] Updated weights for policy 0, policy_version 344960 (0.0007) [2023-12-26 02:20:16,607][123091] Updated weights for policy 0, policy_version 344970 (0.0009) [2023-12-26 02:20:17,221][123090] Updated weights for policy 1, policy_version 342918 (0.0008) [2023-12-26 02:20:17,289][123090] Updated weights for policy 1, policy_version 342928 (0.0005) [2023-12-26 02:20:17,365][123090] Updated weights for policy 1, policy_version 342938 (0.0007) [2023-12-26 02:20:17,423][123091] Updated weights for policy 0, policy_version 344980 (0.0008) [2023-12-26 02:20:17,483][123091] Updated weights for policy 0, policy_version 344990 (0.0008) [2023-12-26 02:20:17,539][123091] Updated weights for policy 0, policy_version 345000 (0.0007) [2023-12-26 02:20:18,194][123090] Updated weights for policy 1, policy_version 342948 (0.0011) [2023-12-26 02:20:18,248][123090] Updated weights for policy 1, policy_version 342958 (0.0011) [2023-12-26 02:20:18,301][123090] Updated weights for policy 1, policy_version 342968 (0.0009) [2023-12-26 02:20:18,409][123091] Updated weights for policy 0, policy_version 345010 (0.0009) [2023-12-26 02:20:18,480][123091] Updated weights for policy 0, policy_version 345020 (0.0009) [2023-12-26 02:20:18,555][123091] Updated weights for policy 0, policy_version 345030 (0.0009) [2023-12-26 02:20:18,628][123091] Updated weights for policy 0, policy_version 345040 (0.0010) [2023-12-26 02:20:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 176136192. Throughput: 0: 8991.7, 1: 8690.1. Samples: 176145336. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:18,785][121949] Avg episode reward: [(0, '6253.434'), (1, '5599.748')] [2023-12-26 02:20:19,138][123090] Updated weights for policy 1, policy_version 342978 (0.0009) [2023-12-26 02:20:19,191][123090] Updated weights for policy 1, policy_version 342988 (0.0010) [2023-12-26 02:20:19,255][123090] Updated weights for policy 1, policy_version 342998 (0.0009) [2023-12-26 02:20:19,328][123090] Updated weights for policy 1, policy_version 343008 (0.0009) [2023-12-26 02:20:19,442][123091] Updated weights for policy 0, policy_version 345050 (0.0010) [2023-12-26 02:20:19,518][123091] Updated weights for policy 0, policy_version 345060 (0.0009) [2023-12-26 02:20:19,578][123091] Updated weights for policy 0, policy_version 345070 (0.0010) [2023-12-26 02:20:20,268][123090] Updated weights for policy 1, policy_version 343018 (0.0011) [2023-12-26 02:20:20,340][123090] Updated weights for policy 1, policy_version 343028 (0.0010) [2023-12-26 02:20:20,414][123090] Updated weights for policy 1, policy_version 343038 (0.0009) [2023-12-26 02:20:20,442][123091] Updated weights for policy 0, policy_version 345080 (0.0009) [2023-12-26 02:20:20,509][123091] Updated weights for policy 0, policy_version 345090 (0.0010) [2023-12-26 02:20:20,579][123091] Updated weights for policy 0, policy_version 345100 (0.0010) [2023-12-26 02:20:21,291][123090] Updated weights for policy 1, policy_version 343048 (0.0008) [2023-12-26 02:20:21,363][123090] Updated weights for policy 1, policy_version 343058 (0.0008) [2023-12-26 02:20:21,453][123090] Updated weights for policy 1, policy_version 343068 (0.0009) [2023-12-26 02:20:21,528][123091] Updated weights for policy 0, policy_version 345110 (0.0008) [2023-12-26 02:20:21,605][123091] Updated weights for policy 0, policy_version 345120 (0.0009) [2023-12-26 02:20:21,687][123091] Updated weights for policy 0, policy_version 345130 (0.0009) [2023-12-26 02:20:22,347][123090] Updated weights for policy 1, policy_version 343078 (0.0009) [2023-12-26 02:20:22,419][123090] Updated weights for policy 1, policy_version 343088 (0.0008) [2023-12-26 02:20:22,490][123090] Updated weights for policy 1, policy_version 343098 (0.0008) [2023-12-26 02:20:22,620][123091] Updated weights for policy 0, policy_version 345140 (0.0009) [2023-12-26 02:20:22,686][123091] Updated weights for policy 0, policy_version 345150 (0.0010) [2023-12-26 02:20:22,756][123091] Updated weights for policy 0, policy_version 345160 (0.0010) [2023-12-26 02:20:23,277][123090] Updated weights for policy 1, policy_version 343108 (0.0009) [2023-12-26 02:20:23,354][123090] Updated weights for policy 1, policy_version 343118 (0.0010) [2023-12-26 02:20:23,424][123090] Updated weights for policy 1, policy_version 343128 (0.0010) [2023-12-26 02:20:23,623][123091] Updated weights for policy 0, policy_version 345170 (0.0009) [2023-12-26 02:20:23,695][123091] Updated weights for policy 0, policy_version 345180 (0.0009) [2023-12-26 02:20:23,766][123091] Updated weights for policy 0, policy_version 345190 (0.0008) [2023-12-26 02:20:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 176209920. Throughput: 0: 8931.9, 1: 8643.0. Samples: 176192920. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:23,785][121949] Avg episode reward: [(0, '6205.388'), (1, '5797.854')] [2023-12-26 02:20:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000343136_87842816.pth... [2023-12-26 02:20:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000342144_87588864.pth [2023-12-26 02:20:23,839][123091] Updated weights for policy 0, policy_version 345200 (0.0009) [2023-12-26 02:20:23,839][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000345200_88375296.pth... [2023-12-26 02:20:23,844][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000344176_88113152.pth [2023-12-26 02:20:24,322][123090] Updated weights for policy 1, policy_version 343138 (0.0007) [2023-12-26 02:20:24,379][123090] Updated weights for policy 1, policy_version 343148 (0.0009) [2023-12-26 02:20:24,436][123090] Updated weights for policy 1, policy_version 343158 (0.0009) [2023-12-26 02:20:24,502][123090] Updated weights for policy 1, policy_version 343168 (0.0010) [2023-12-26 02:20:24,600][123091] Updated weights for policy 0, policy_version 345210 (0.0009) [2023-12-26 02:20:24,667][123091] Updated weights for policy 0, policy_version 345220 (0.0008) [2023-12-26 02:20:24,738][123091] Updated weights for policy 0, policy_version 345230 (0.0009) [2023-12-26 02:20:25,407][123090] Updated weights for policy 1, policy_version 343178 (0.0010) [2023-12-26 02:20:25,475][123090] Updated weights for policy 1, policy_version 343188 (0.0010) [2023-12-26 02:20:25,537][123090] Updated weights for policy 1, policy_version 343198 (0.0009) [2023-12-26 02:20:25,558][123091] Updated weights for policy 0, policy_version 345240 (0.0010) [2023-12-26 02:20:25,625][123091] Updated weights for policy 0, policy_version 345250 (0.0010) [2023-12-26 02:20:25,695][123091] Updated weights for policy 0, policy_version 345260 (0.0010) [2023-12-26 02:20:26,373][123090] Updated weights for policy 1, policy_version 343208 (0.0008) [2023-12-26 02:20:26,440][123090] Updated weights for policy 1, policy_version 343218 (0.0010) [2023-12-26 02:20:26,504][123090] Updated weights for policy 1, policy_version 343228 (0.0010) [2023-12-26 02:20:26,558][123091] Updated weights for policy 0, policy_version 345270 (0.0009) [2023-12-26 02:20:26,620][123091] Updated weights for policy 0, policy_version 345280 (0.0009) [2023-12-26 02:20:26,686][123091] Updated weights for policy 0, policy_version 345290 (0.0009) [2023-12-26 02:20:27,389][123090] Updated weights for policy 1, policy_version 343238 (0.0011) [2023-12-26 02:20:27,460][123090] Updated weights for policy 1, policy_version 343248 (0.0011) [2023-12-26 02:20:27,518][123090] Updated weights for policy 1, policy_version 343258 (0.0011) [2023-12-26 02:20:27,563][123091] Updated weights for policy 0, policy_version 345300 (0.0010) [2023-12-26 02:20:27,637][123091] Updated weights for policy 0, policy_version 345310 (0.0009) [2023-12-26 02:20:27,703][123091] Updated weights for policy 0, policy_version 345320 (0.0009) [2023-12-26 02:20:28,408][123090] Updated weights for policy 1, policy_version 343268 (0.0011) [2023-12-26 02:20:28,482][123090] Updated weights for policy 1, policy_version 343278 (0.0010) [2023-12-26 02:20:28,561][123090] Updated weights for policy 1, policy_version 343288 (0.0009) [2023-12-26 02:20:28,645][123091] Updated weights for policy 0, policy_version 345330 (0.0009) [2023-12-26 02:20:28,725][123091] Updated weights for policy 0, policy_version 345340 (0.0009) [2023-12-26 02:20:28,784][121949] Fps is (10 sec: 15564.7, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 176291840. Throughput: 0: 8870.0, 1: 8501.9. Samples: 176290440. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:28,785][121949] Avg episode reward: [(0, '6269.647'), (1, '5882.678')] [2023-12-26 02:20:28,801][123091] Updated weights for policy 0, policy_version 345350 (0.0010) [2023-12-26 02:20:28,875][123091] Updated weights for policy 0, policy_version 345360 (0.0009) [2023-12-26 02:20:29,528][123090] Updated weights for policy 1, policy_version 343298 (0.0009) [2023-12-26 02:20:29,602][123090] Updated weights for policy 1, policy_version 343308 (0.0007) [2023-12-26 02:20:29,670][123090] Updated weights for policy 1, policy_version 343318 (0.0009) [2023-12-26 02:20:29,731][123090] Updated weights for policy 1, policy_version 343328 (0.0010) [2023-12-26 02:20:29,784][123091] Updated weights for policy 0, policy_version 345370 (0.0009) [2023-12-26 02:20:29,842][123091] Updated weights for policy 0, policy_version 345380 (0.0009) [2023-12-26 02:20:29,909][123091] Updated weights for policy 0, policy_version 345390 (0.0008) [2023-12-26 02:20:30,607][123090] Updated weights for policy 1, policy_version 343338 (0.0010) [2023-12-26 02:20:30,669][123090] Updated weights for policy 1, policy_version 343348 (0.0009) [2023-12-26 02:20:30,721][123090] Updated weights for policy 1, policy_version 343358 (0.0009) [2023-12-26 02:20:30,783][123091] Updated weights for policy 0, policy_version 345400 (0.0010) [2023-12-26 02:20:30,847][123091] Updated weights for policy 0, policy_version 345410 (0.0010) [2023-12-26 02:20:30,905][123091] Updated weights for policy 0, policy_version 345420 (0.0009) [2023-12-26 02:20:31,638][123090] Updated weights for policy 1, policy_version 343368 (0.0008) [2023-12-26 02:20:31,720][123090] Updated weights for policy 1, policy_version 343378 (0.0008) [2023-12-26 02:20:31,795][123090] Updated weights for policy 1, policy_version 343388 (0.0008) [2023-12-26 02:20:31,859][123091] Updated weights for policy 0, policy_version 345430 (0.0010) [2023-12-26 02:20:31,923][123091] Updated weights for policy 0, policy_version 345440 (0.0010) [2023-12-26 02:20:32,003][123091] Updated weights for policy 0, policy_version 345450 (0.0010) [2023-12-26 02:20:32,652][123090] Updated weights for policy 1, policy_version 343398 (0.0008) [2023-12-26 02:20:32,724][123090] Updated weights for policy 1, policy_version 343408 (0.0007) [2023-12-26 02:20:32,780][123090] Updated weights for policy 1, policy_version 343418 (0.0006) [2023-12-26 02:20:32,881][123091] Updated weights for policy 0, policy_version 345460 (0.0008) [2023-12-26 02:20:32,957][123091] Updated weights for policy 0, policy_version 345470 (0.0007) [2023-12-26 02:20:33,008][123091] Updated weights for policy 0, policy_version 345480 (0.0005) [2023-12-26 02:20:33,553][123090] Updated weights for policy 1, policy_version 343428 (0.0007) [2023-12-26 02:20:33,616][123090] Updated weights for policy 1, policy_version 343438 (0.0008) [2023-12-26 02:20:33,688][123090] Updated weights for policy 1, policy_version 343448 (0.0011) [2023-12-26 02:20:33,711][123091] Updated weights for policy 0, policy_version 345490 (0.0007) [2023-12-26 02:20:33,774][123091] Updated weights for policy 0, policy_version 345500 (0.0007) [2023-12-26 02:20:33,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 176373760. Throughput: 0: 8643.3, 1: 8378.3. Samples: 176384788. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:33,785][121949] Avg episode reward: [(0, '6414.863'), (1, '5964.202')] [2023-12-26 02:20:33,786][123008] Saving new best policy, reward=5964.202! [2023-12-26 02:20:33,852][123091] Updated weights for policy 0, policy_version 345510 (0.0010) [2023-12-26 02:20:33,917][123091] Updated weights for policy 0, policy_version 345520 (0.0011) [2023-12-26 02:20:34,481][123090] Updated weights for policy 1, policy_version 343458 (0.0007) [2023-12-26 02:20:34,553][123090] Updated weights for policy 1, policy_version 343468 (0.0008) [2023-12-26 02:20:34,629][123090] Updated weights for policy 1, policy_version 343478 (0.0006) [2023-12-26 02:20:34,695][123090] Updated weights for policy 1, policy_version 343488 (0.0008) [2023-12-26 02:20:34,839][123091] Updated weights for policy 0, policy_version 345530 (0.0007) [2023-12-26 02:20:34,912][123091] Updated weights for policy 0, policy_version 345540 (0.0007) [2023-12-26 02:20:34,983][123091] Updated weights for policy 0, policy_version 345550 (0.0006) [2023-12-26 02:20:35,529][123090] Updated weights for policy 1, policy_version 343498 (0.0010) [2023-12-26 02:20:35,605][123090] Updated weights for policy 1, policy_version 343508 (0.0011) [2023-12-26 02:20:35,675][123090] Updated weights for policy 1, policy_version 343518 (0.0009) [2023-12-26 02:20:35,838][123091] Updated weights for policy 0, policy_version 345560 (0.0010) [2023-12-26 02:20:35,912][123091] Updated weights for policy 0, policy_version 345570 (0.0011) [2023-12-26 02:20:35,991][123091] Updated weights for policy 0, policy_version 345580 (0.0010) [2023-12-26 02:20:36,554][123090] Updated weights for policy 1, policy_version 343528 (0.0008) [2023-12-26 02:20:36,628][123090] Updated weights for policy 1, policy_version 343538 (0.0009) [2023-12-26 02:20:36,698][123090] Updated weights for policy 1, policy_version 343548 (0.0008) [2023-12-26 02:20:36,902][123091] Updated weights for policy 0, policy_version 345590 (0.0010) [2023-12-26 02:20:36,958][123091] Updated weights for policy 0, policy_version 345600 (0.0009) [2023-12-26 02:20:37,030][123091] Updated weights for policy 0, policy_version 345610 (0.0008) [2023-12-26 02:20:37,445][123090] Updated weights for policy 1, policy_version 343558 (0.0010) [2023-12-26 02:20:37,517][123090] Updated weights for policy 1, policy_version 343568 (0.0011) [2023-12-26 02:20:37,589][123090] Updated weights for policy 1, policy_version 343578 (0.0010) [2023-12-26 02:20:37,954][123091] Updated weights for policy 0, policy_version 345620 (0.0009) [2023-12-26 02:20:38,017][123091] Updated weights for policy 0, policy_version 345630 (0.0010) [2023-12-26 02:20:38,078][123091] Updated weights for policy 0, policy_version 345640 (0.0010) [2023-12-26 02:20:38,427][123090] Updated weights for policy 1, policy_version 343588 (0.0010) [2023-12-26 02:20:38,495][123090] Updated weights for policy 1, policy_version 343598 (0.0010) [2023-12-26 02:20:38,550][123090] Updated weights for policy 1, policy_version 343608 (0.0010) [2023-12-26 02:20:38,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17066.7, 300 sec: 17522.6). Total num frames: 176455680. Throughput: 0: 8579.7, 1: 8361.3. Samples: 176432980. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:38,785][121949] Avg episode reward: [(0, '6426.666'), (1, '5850.295')] [2023-12-26 02:20:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000345648_88489984.pth... [2023-12-26 02:20:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000343616_87965696.pth... [2023-12-26 02:20:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000344720_88252416.pth [2023-12-26 02:20:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000342656_87719936.pth [2023-12-26 02:20:38,958][123091] Updated weights for policy 0, policy_version 345650 (0.0007) [2023-12-26 02:20:39,023][123091] Updated weights for policy 0, policy_version 345660 (0.0010) [2023-12-26 02:20:39,088][123091] Updated weights for policy 0, policy_version 345670 (0.0010) [2023-12-26 02:20:39,155][123091] Updated weights for policy 0, policy_version 345680 (0.0010) [2023-12-26 02:20:39,358][123090] Updated weights for policy 1, policy_version 343618 (0.0009) [2023-12-26 02:20:39,438][123090] Updated weights for policy 1, policy_version 343628 (0.0008) [2023-12-26 02:20:39,510][123090] Updated weights for policy 1, policy_version 343638 (0.0010) [2023-12-26 02:20:40,159][123091] Updated weights for policy 0, policy_version 345690 (0.0008) [2023-12-26 02:20:40,231][123091] Updated weights for policy 0, policy_version 345700 (0.0008) [2023-12-26 02:20:40,317][123091] Updated weights for policy 0, policy_version 345710 (0.0008) [2023-12-26 02:20:40,411][123090] Updated weights for policy 1, policy_version 343649 (0.0009) [2023-12-26 02:20:40,491][123090] Updated weights for policy 1, policy_version 343659 (0.0007) [2023-12-26 02:20:40,566][123090] Updated weights for policy 1, policy_version 343669 (0.0008) [2023-12-26 02:20:40,640][123090] Updated weights for policy 1, policy_version 343679 (0.0008) [2023-12-26 02:20:41,114][123091] Updated weights for policy 0, policy_version 345720 (0.0008) [2023-12-26 02:20:41,191][123091] Updated weights for policy 0, policy_version 345730 (0.0009) [2023-12-26 02:20:41,266][123091] Updated weights for policy 0, policy_version 345740 (0.0009) [2023-12-26 02:20:41,464][123090] Updated weights for policy 1, policy_version 343689 (0.0008) [2023-12-26 02:20:41,536][123090] Updated weights for policy 1, policy_version 343699 (0.0011) [2023-12-26 02:20:41,601][123090] Updated weights for policy 1, policy_version 343709 (0.0010) [2023-12-26 02:20:42,190][123091] Updated weights for policy 0, policy_version 345750 (0.0009) [2023-12-26 02:20:42,260][123091] Updated weights for policy 0, policy_version 345760 (0.0010) [2023-12-26 02:20:42,332][123091] Updated weights for policy 0, policy_version 345770 (0.0008) [2023-12-26 02:20:42,523][123090] Updated weights for policy 1, policy_version 343719 (0.0007) [2023-12-26 02:20:42,599][123090] Updated weights for policy 1, policy_version 343729 (0.0008) [2023-12-26 02:20:42,674][123090] Updated weights for policy 1, policy_version 343739 (0.0011) [2023-12-26 02:20:43,202][123091] Updated weights for policy 0, policy_version 345780 (0.0010) [2023-12-26 02:20:43,271][123091] Updated weights for policy 0, policy_version 345790 (0.0010) [2023-12-26 02:20:43,341][123091] Updated weights for policy 0, policy_version 345800 (0.0011) [2023-12-26 02:20:43,480][123090] Updated weights for policy 1, policy_version 343749 (0.0008) [2023-12-26 02:20:43,548][123090] Updated weights for policy 1, policy_version 343759 (0.0006) [2023-12-26 02:20:43,620][123090] Updated weights for policy 1, policy_version 343769 (0.0007) [2023-12-26 02:20:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17494.8). Total num frames: 176537600. Throughput: 0: 8365.8, 1: 8226.8. Samples: 176529344. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:43,785][121949] Avg episode reward: [(0, '6449.317'), (1, '5815.994')] [2023-12-26 02:20:44,151][123091] Updated weights for policy 0, policy_version 345810 (0.0010) [2023-12-26 02:20:44,209][123091] Updated weights for policy 0, policy_version 345820 (0.0010) [2023-12-26 02:20:44,274][123091] Updated weights for policy 0, policy_version 345830 (0.0010) [2023-12-26 02:20:44,331][123091] Updated weights for policy 0, policy_version 345840 (0.0009) [2023-12-26 02:20:44,409][123090] Updated weights for policy 1, policy_version 343779 (0.0010) [2023-12-26 02:20:44,478][123090] Updated weights for policy 1, policy_version 343789 (0.0010) [2023-12-26 02:20:44,545][123090] Updated weights for policy 1, policy_version 343799 (0.0009) [2023-12-26 02:20:45,251][123091] Updated weights for policy 0, policy_version 345850 (0.0009) [2023-12-26 02:20:45,322][123091] Updated weights for policy 0, policy_version 345860 (0.0009) [2023-12-26 02:20:45,387][123091] Updated weights for policy 0, policy_version 345870 (0.0008) [2023-12-26 02:20:45,460][123090] Updated weights for policy 1, policy_version 343809 (0.0009) [2023-12-26 02:20:45,529][123090] Updated weights for policy 1, policy_version 343819 (0.0010) [2023-12-26 02:20:45,593][123090] Updated weights for policy 1, policy_version 343829 (0.0010) [2023-12-26 02:20:45,661][123090] Updated weights for policy 1, policy_version 343839 (0.0010) [2023-12-26 02:20:46,147][123091] Updated weights for policy 0, policy_version 345880 (0.0009) [2023-12-26 02:20:46,204][123091] Updated weights for policy 0, policy_version 345890 (0.0009) [2023-12-26 02:20:46,266][123091] Updated weights for policy 0, policy_version 345900 (0.0006) [2023-12-26 02:20:46,441][123090] Updated weights for policy 1, policy_version 343849 (0.0007) [2023-12-26 02:20:46,510][123090] Updated weights for policy 1, policy_version 343859 (0.0006) [2023-12-26 02:20:46,577][123090] Updated weights for policy 1, policy_version 343869 (0.0006) [2023-12-26 02:20:47,094][123091] Updated weights for policy 0, policy_version 345910 (0.0008) [2023-12-26 02:20:47,150][123091] Updated weights for policy 0, policy_version 345920 (0.0010) [2023-12-26 02:20:47,226][123091] Updated weights for policy 0, policy_version 345930 (0.0006) [2023-12-26 02:20:47,241][123090] Updated weights for policy 1, policy_version 343879 (0.0008) [2023-12-26 02:20:47,306][123090] Updated weights for policy 1, policy_version 343889 (0.0011) [2023-12-26 02:20:47,371][123090] Updated weights for policy 1, policy_version 343899 (0.0010) [2023-12-26 02:20:47,995][123091] Updated weights for policy 0, policy_version 345940 (0.0008) [2023-12-26 02:20:48,057][123091] Updated weights for policy 0, policy_version 345950 (0.0010) [2023-12-26 02:20:48,121][123091] Updated weights for policy 0, policy_version 345960 (0.0008) [2023-12-26 02:20:48,206][123090] Updated weights for policy 1, policy_version 343909 (0.0009) [2023-12-26 02:20:48,265][123090] Updated weights for policy 1, policy_version 343919 (0.0009) [2023-12-26 02:20:48,328][123090] Updated weights for policy 1, policy_version 343929 (0.0009) [2023-12-26 02:20:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 17494.8). Total num frames: 176619520. Throughput: 0: 8196.6, 1: 8201.2. Samples: 176631132. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:48,785][121949] Avg episode reward: [(0, '6413.291'), (1, '5847.214')] [2023-12-26 02:20:49,003][123091] Updated weights for policy 0, policy_version 345970 (0.0009) [2023-12-26 02:20:49,069][123091] Updated weights for policy 0, policy_version 345980 (0.0008) [2023-12-26 02:20:49,144][123091] Updated weights for policy 0, policy_version 345990 (0.0009) [2023-12-26 02:20:49,196][123090] Updated weights for policy 1, policy_version 343939 (0.0009) [2023-12-26 02:20:49,217][123091] Updated weights for policy 0, policy_version 346000 (0.0008) [2023-12-26 02:20:49,281][123090] Updated weights for policy 1, policy_version 343949 (0.0009) [2023-12-26 02:20:49,354][123090] Updated weights for policy 1, policy_version 343959 (0.0010) [2023-12-26 02:20:50,199][123091] Updated weights for policy 0, policy_version 346010 (0.0010) [2023-12-26 02:20:50,266][123091] Updated weights for policy 0, policy_version 346020 (0.0010) [2023-12-26 02:20:50,338][123091] Updated weights for policy 0, policy_version 346030 (0.0010) [2023-12-26 02:20:50,350][123090] Updated weights for policy 1, policy_version 343970 (0.0010) [2023-12-26 02:20:50,424][123090] Updated weights for policy 1, policy_version 343980 (0.0010) [2023-12-26 02:20:50,497][123090] Updated weights for policy 1, policy_version 343990 (0.0010) [2023-12-26 02:20:50,576][123090] Updated weights for policy 1, policy_version 344000 (0.0010) [2023-12-26 02:20:51,426][123091] Updated weights for policy 0, policy_version 346040 (0.0008) [2023-12-26 02:20:51,492][123091] Updated weights for policy 0, policy_version 346050 (0.0010) [2023-12-26 02:20:51,547][123090] Updated weights for policy 1, policy_version 344010 (0.0010) [2023-12-26 02:20:51,559][123091] Updated weights for policy 0, policy_version 346060 (0.0006) [2023-12-26 02:20:51,613][123090] Updated weights for policy 1, policy_version 344020 (0.0011) [2023-12-26 02:20:51,680][123090] Updated weights for policy 1, policy_version 344030 (0.0009) [2023-12-26 02:20:52,451][123091] Updated weights for policy 0, policy_version 346070 (0.0008) [2023-12-26 02:20:52,517][123091] Updated weights for policy 0, policy_version 346080 (0.0010) [2023-12-26 02:20:52,559][123090] Updated weights for policy 1, policy_version 344040 (0.0008) [2023-12-26 02:20:52,578][123091] Updated weights for policy 0, policy_version 346090 (0.0011) [2023-12-26 02:20:52,629][123090] Updated weights for policy 1, policy_version 344050 (0.0006) [2023-12-26 02:20:52,699][123090] Updated weights for policy 1, policy_version 344060 (0.0009) [2023-12-26 02:20:53,396][123091] Updated weights for policy 0, policy_version 346100 (0.0011) [2023-12-26 02:20:53,462][123091] Updated weights for policy 0, policy_version 346110 (0.0010) [2023-12-26 02:20:53,527][123091] Updated weights for policy 0, policy_version 346120 (0.0010) [2023-12-26 02:20:53,533][123090] Updated weights for policy 1, policy_version 344070 (0.0008) [2023-12-26 02:20:53,598][123090] Updated weights for policy 1, policy_version 344080 (0.0007) [2023-12-26 02:20:53,646][123090] Updated weights for policy 1, policy_version 344090 (0.0008) [2023-12-26 02:20:53,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 17467.0). Total num frames: 176701440. Throughput: 0: 8095.6, 1: 8113.8. Samples: 176674528. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:53,785][121949] Avg episode reward: [(0, '6437.213'), (1, '5903.168')] [2023-12-26 02:20:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000346128_88612864.pth... [2023-12-26 02:20:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000344096_88088576.pth... [2023-12-26 02:20:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000343136_87842816.pth [2023-12-26 02:20:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000345200_88375296.pth [2023-12-26 02:20:54,346][123091] Updated weights for policy 0, policy_version 346130 (0.0010) [2023-12-26 02:20:54,405][123091] Updated weights for policy 0, policy_version 346140 (0.0010) [2023-12-26 02:20:54,470][123091] Updated weights for policy 0, policy_version 346150 (0.0010) [2023-12-26 02:20:54,478][123090] Updated weights for policy 1, policy_version 344100 (0.0008) [2023-12-26 02:20:54,532][123091] Updated weights for policy 0, policy_version 346160 (0.0010) [2023-12-26 02:20:54,535][123090] Updated weights for policy 1, policy_version 344110 (0.0009) [2023-12-26 02:20:54,588][123090] Updated weights for policy 1, policy_version 344120 (0.0009) [2023-12-26 02:20:55,354][123091] Updated weights for policy 0, policy_version 346170 (0.0010) [2023-12-26 02:20:55,405][123091] Updated weights for policy 0, policy_version 346180 (0.0010) [2023-12-26 02:20:55,436][123090] Updated weights for policy 1, policy_version 344130 (0.0009) [2023-12-26 02:20:55,467][123091] Updated weights for policy 0, policy_version 346190 (0.0010) [2023-12-26 02:20:55,493][123090] Updated weights for policy 1, policy_version 344140 (0.0008) [2023-12-26 02:20:55,548][123090] Updated weights for policy 1, policy_version 344150 (0.0009) [2023-12-26 02:20:55,600][123090] Updated weights for policy 1, policy_version 344160 (0.0009) [2023-12-26 02:20:56,266][123091] Updated weights for policy 0, policy_version 346200 (0.0010) [2023-12-26 02:20:56,314][123091] Updated weights for policy 0, policy_version 346210 (0.0009) [2023-12-26 02:20:56,363][123091] Updated weights for policy 0, policy_version 346220 (0.0009) [2023-12-26 02:20:56,443][123090] Updated weights for policy 1, policy_version 344170 (0.0009) [2023-12-26 02:20:56,505][123090] Updated weights for policy 1, policy_version 344180 (0.0006) [2023-12-26 02:20:56,565][123090] Updated weights for policy 1, policy_version 344190 (0.0005) [2023-12-26 02:20:57,268][123091] Updated weights for policy 0, policy_version 346230 (0.0009) [2023-12-26 02:20:57,269][123090] Updated weights for policy 1, policy_version 344200 (0.0006) [2023-12-26 02:20:57,324][123090] Updated weights for policy 1, policy_version 344210 (0.0006) [2023-12-26 02:20:57,328][123091] Updated weights for policy 0, policy_version 346240 (0.0009) [2023-12-26 02:20:57,379][123090] Updated weights for policy 1, policy_version 344220 (0.0007) [2023-12-26 02:20:57,390][123091] Updated weights for policy 0, policy_version 346250 (0.0008) [2023-12-26 02:20:58,112][123090] Updated weights for policy 1, policy_version 344230 (0.0006) [2023-12-26 02:20:58,187][123090] Updated weights for policy 1, policy_version 344240 (0.0009) [2023-12-26 02:20:58,252][123091] Updated weights for policy 0, policy_version 346260 (0.0008) [2023-12-26 02:20:58,255][123090] Updated weights for policy 1, policy_version 344250 (0.0010) [2023-12-26 02:20:58,321][123091] Updated weights for policy 0, policy_version 346270 (0.0007) [2023-12-26 02:20:58,400][123091] Updated weights for policy 0, policy_version 346280 (0.0010) [2023-12-26 02:20:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 17439.2). Total num frames: 176783360. Throughput: 0: 8064.6, 1: 8189.3. Samples: 176776656. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:20:58,784][121949] Avg episode reward: [(0, '6413.359'), (1, '5865.669')] [2023-12-26 02:20:59,015][123090] Updated weights for policy 1, policy_version 344260 (0.0008) [2023-12-26 02:20:59,082][123090] Updated weights for policy 1, policy_version 344270 (0.0009) [2023-12-26 02:20:59,128][123090] Updated weights for policy 1, policy_version 344280 (0.0008) [2023-12-26 02:20:59,298][123091] Updated weights for policy 0, policy_version 346290 (0.0009) [2023-12-26 02:20:59,367][123091] Updated weights for policy 0, policy_version 346300 (0.0009) [2023-12-26 02:20:59,428][123091] Updated weights for policy 0, policy_version 346310 (0.0009) [2023-12-26 02:20:59,487][123091] Updated weights for policy 0, policy_version 346320 (0.0009) [2023-12-26 02:20:59,933][123090] Updated weights for policy 1, policy_version 344290 (0.0006) [2023-12-26 02:20:59,999][123090] Updated weights for policy 1, policy_version 344300 (0.0010) [2023-12-26 02:21:00,070][123090] Updated weights for policy 1, policy_version 344310 (0.0010) [2023-12-26 02:21:00,136][123090] Updated weights for policy 1, policy_version 344320 (0.0010) [2023-12-26 02:21:00,322][123091] Updated weights for policy 0, policy_version 346330 (0.0009) [2023-12-26 02:21:00,381][123091] Updated weights for policy 0, policy_version 346340 (0.0009) [2023-12-26 02:21:00,444][123091] Updated weights for policy 0, policy_version 346350 (0.0009) [2023-12-26 02:21:00,914][123090] Updated weights for policy 1, policy_version 344330 (0.0010) [2023-12-26 02:21:00,973][123090] Updated weights for policy 1, policy_version 344340 (0.0006) [2023-12-26 02:21:01,027][123090] Updated weights for policy 1, policy_version 344350 (0.0006) [2023-12-26 02:21:01,287][123091] Updated weights for policy 0, policy_version 346360 (0.0010) [2023-12-26 02:21:01,348][123091] Updated weights for policy 0, policy_version 346370 (0.0010) [2023-12-26 02:21:01,420][123091] Updated weights for policy 0, policy_version 346380 (0.0010) [2023-12-26 02:21:01,800][123090] Updated weights for policy 1, policy_version 344360 (0.0008) [2023-12-26 02:21:01,867][123090] Updated weights for policy 1, policy_version 344370 (0.0009) [2023-12-26 02:21:01,933][123090] Updated weights for policy 1, policy_version 344380 (0.0008) [2023-12-26 02:21:02,178][123091] Updated weights for policy 0, policy_version 346390 (0.0007) [2023-12-26 02:21:02,231][123091] Updated weights for policy 0, policy_version 346400 (0.0005) [2023-12-26 02:21:02,287][123091] Updated weights for policy 0, policy_version 346410 (0.0007) [2023-12-26 02:21:02,699][123090] Updated weights for policy 1, policy_version 344390 (0.0008) [2023-12-26 02:21:02,757][123090] Updated weights for policy 1, policy_version 344400 (0.0009) [2023-12-26 02:21:02,807][123090] Updated weights for policy 1, policy_version 344410 (0.0008) [2023-12-26 02:21:03,024][123091] Updated weights for policy 0, policy_version 346420 (0.0007) [2023-12-26 02:21:03,089][123091] Updated weights for policy 0, policy_version 346430 (0.0007) [2023-12-26 02:21:03,150][123091] Updated weights for policy 0, policy_version 346440 (0.0008) [2023-12-26 02:21:03,711][123090] Updated weights for policy 1, policy_version 344420 (0.0009) [2023-12-26 02:21:03,767][123090] Updated weights for policy 1, policy_version 344430 (0.0008) [2023-12-26 02:21:03,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16384.0, 300 sec: 17439.2). Total num frames: 176865280. Throughput: 0: 8107.5, 1: 8273.2. Samples: 176882468. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:03,785][121949] Avg episode reward: [(0, '6379.142'), (1, '5843.567')] [2023-12-26 02:21:03,831][123090] Updated weights for policy 1, policy_version 344440 (0.0008) [2023-12-26 02:21:03,837][123091] Updated weights for policy 0, policy_version 346450 (0.0009) [2023-12-26 02:21:03,897][123091] Updated weights for policy 0, policy_version 346460 (0.0011) [2023-12-26 02:21:03,950][123091] Updated weights for policy 0, policy_version 346470 (0.0011) [2023-12-26 02:21:03,998][123091] Updated weights for policy 0, policy_version 346480 (0.0011) [2023-12-26 02:21:04,688][123090] Updated weights for policy 1, policy_version 344450 (0.0008) [2023-12-26 02:21:04,751][123090] Updated weights for policy 1, policy_version 344460 (0.0009) [2023-12-26 02:21:04,810][123090] Updated weights for policy 1, policy_version 344470 (0.0009) [2023-12-26 02:21:04,860][123091] Updated weights for policy 0, policy_version 346490 (0.0011) [2023-12-26 02:21:04,867][123090] Updated weights for policy 1, policy_version 344480 (0.0006) [2023-12-26 02:21:04,918][123091] Updated weights for policy 0, policy_version 346500 (0.0011) [2023-12-26 02:21:04,976][123091] Updated weights for policy 0, policy_version 346510 (0.0010) [2023-12-26 02:21:05,683][123090] Updated weights for policy 1, policy_version 344490 (0.0009) [2023-12-26 02:21:05,742][123090] Updated weights for policy 1, policy_version 344500 (0.0009) [2023-12-26 02:21:05,808][123090] Updated weights for policy 1, policy_version 344510 (0.0008) [2023-12-26 02:21:05,831][123091] Updated weights for policy 0, policy_version 346520 (0.0011) [2023-12-26 02:21:05,893][123091] Updated weights for policy 0, policy_version 346530 (0.0011) [2023-12-26 02:21:05,960][123091] Updated weights for policy 0, policy_version 346540 (0.0011) [2023-12-26 02:21:06,685][123091] Updated weights for policy 0, policy_version 346550 (0.0009) [2023-12-26 02:21:06,705][123090] Updated weights for policy 1, policy_version 344520 (0.0007) [2023-12-26 02:21:06,752][123091] Updated weights for policy 0, policy_version 346560 (0.0009) [2023-12-26 02:21:06,766][123090] Updated weights for policy 1, policy_version 344530 (0.0008) [2023-12-26 02:21:06,818][123091] Updated weights for policy 0, policy_version 346570 (0.0008) [2023-12-26 02:21:06,828][123090] Updated weights for policy 1, policy_version 344540 (0.0008) [2023-12-26 02:21:07,645][123091] Updated weights for policy 0, policy_version 346580 (0.0010) [2023-12-26 02:21:07,694][123091] Updated weights for policy 0, policy_version 346591 (0.0009) [2023-12-26 02:21:07,697][123090] Updated weights for policy 1, policy_version 344550 (0.0007) [2023-12-26 02:21:07,755][123091] Updated weights for policy 0, policy_version 346601 (0.0007) [2023-12-26 02:21:07,765][123090] Updated weights for policy 1, policy_version 344560 (0.0006) [2023-12-26 02:21:07,826][123090] Updated weights for policy 1, policy_version 344570 (0.0008) [2023-12-26 02:21:08,406][123091] Updated weights for policy 0, policy_version 346611 (0.0006) [2023-12-26 02:21:08,425][123090] Updated weights for policy 1, policy_version 344580 (0.0007) [2023-12-26 02:21:08,472][123091] Updated weights for policy 0, policy_version 346621 (0.0008) [2023-12-26 02:21:08,481][123090] Updated weights for policy 1, policy_version 344590 (0.0011) [2023-12-26 02:21:08,521][123091] Updated weights for policy 0, policy_version 346631 (0.0008) [2023-12-26 02:21:08,541][123090] Updated weights for policy 1, policy_version 344600 (0.0011) [2023-12-26 02:21:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 16520.5, 300 sec: 17467.0). Total num frames: 176963584. Throughput: 0: 8153.0, 1: 8298.2. Samples: 176933228. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:08,785][121949] Avg episode reward: [(0, '6415.275'), (1, '5812.981')] [2023-12-26 02:21:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000346640_88743936.pth... [2023-12-26 02:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000344608_88219648.pth... [2023-12-26 02:21:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000343616_87965696.pth [2023-12-26 02:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000345648_88489984.pth [2023-12-26 02:21:09,360][123091] Updated weights for policy 0, policy_version 346641 (0.0008) [2023-12-26 02:21:09,415][123090] Updated weights for policy 1, policy_version 344610 (0.0010) [2023-12-26 02:21:09,429][123091] Updated weights for policy 0, policy_version 346651 (0.0009) [2023-12-26 02:21:09,483][123090] Updated weights for policy 1, policy_version 344620 (0.0011) [2023-12-26 02:21:09,492][123091] Updated weights for policy 0, policy_version 346661 (0.0010) [2023-12-26 02:21:09,548][123090] Updated weights for policy 1, policy_version 344630 (0.0011) [2023-12-26 02:21:09,548][123091] Updated weights for policy 0, policy_version 346671 (0.0009) [2023-12-26 02:21:09,612][123090] Updated weights for policy 1, policy_version 344640 (0.0011) [2023-12-26 02:21:10,382][123091] Updated weights for policy 0, policy_version 346681 (0.0011) [2023-12-26 02:21:10,386][123090] Updated weights for policy 1, policy_version 344650 (0.0007) [2023-12-26 02:21:10,441][123090] Updated weights for policy 1, policy_version 344660 (0.0008) [2023-12-26 02:21:10,444][123091] Updated weights for policy 0, policy_version 346691 (0.0011) [2023-12-26 02:21:10,492][123090] Updated weights for policy 1, policy_version 344670 (0.0007) [2023-12-26 02:21:10,508][123091] Updated weights for policy 0, policy_version 346701 (0.0011) [2023-12-26 02:21:11,253][123090] Updated weights for policy 1, policy_version 344680 (0.0010) [2023-12-26 02:21:11,304][123091] Updated weights for policy 0, policy_version 346711 (0.0011) [2023-12-26 02:21:11,316][123090] Updated weights for policy 1, policy_version 344690 (0.0011) [2023-12-26 02:21:11,368][123091] Updated weights for policy 0, policy_version 346721 (0.0009) [2023-12-26 02:21:11,394][123090] Updated weights for policy 1, policy_version 344700 (0.0010) [2023-12-26 02:21:11,443][123091] Updated weights for policy 0, policy_version 346731 (0.0009) [2023-12-26 02:21:12,215][123090] Updated weights for policy 1, policy_version 344710 (0.0010) [2023-12-26 02:21:12,278][123090] Updated weights for policy 1, policy_version 344720 (0.0010) [2023-12-26 02:21:12,315][123091] Updated weights for policy 0, policy_version 346741 (0.0008) [2023-12-26 02:21:12,348][123090] Updated weights for policy 1, policy_version 344730 (0.0010) [2023-12-26 02:21:12,381][123091] Updated weights for policy 0, policy_version 346751 (0.0008) [2023-12-26 02:21:12,442][123091] Updated weights for policy 0, policy_version 346761 (0.0007) [2023-12-26 02:21:13,170][123091] Updated weights for policy 0, policy_version 346771 (0.0006) [2023-12-26 02:21:13,203][123090] Updated weights for policy 1, policy_version 344740 (0.0009) [2023-12-26 02:21:13,232][123091] Updated weights for policy 0, policy_version 346781 (0.0005) [2023-12-26 02:21:13,272][123090] Updated weights for policy 1, policy_version 344750 (0.0010) [2023-12-26 02:21:13,291][123091] Updated weights for policy 0, policy_version 346791 (0.0006) [2023-12-26 02:21:13,333][123090] Updated weights for policy 1, policy_version 344760 (0.0008) [2023-12-26 02:21:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 16657.1, 300 sec: 17439.2). Total num frames: 177045504. Throughput: 0: 8228.8, 1: 8400.6. Samples: 177038764. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:13,785][121949] Avg episode reward: [(0, '6296.881'), (1, '5637.371')] [2023-12-26 02:21:14,079][123091] Updated weights for policy 0, policy_version 346801 (0.0006) [2023-12-26 02:21:14,123][123090] Updated weights for policy 1, policy_version 344770 (0.0009) [2023-12-26 02:21:14,129][123091] Updated weights for policy 0, policy_version 346811 (0.0009) [2023-12-26 02:21:14,185][123090] Updated weights for policy 1, policy_version 344780 (0.0007) [2023-12-26 02:21:14,188][123091] Updated weights for policy 0, policy_version 346821 (0.0010) [2023-12-26 02:21:14,241][123090] Updated weights for policy 1, policy_version 344790 (0.0006) [2023-12-26 02:21:14,255][123091] Updated weights for policy 0, policy_version 346831 (0.0006) [2023-12-26 02:21:14,315][123090] Updated weights for policy 1, policy_version 344800 (0.0005) [2023-12-26 02:21:14,890][123090] Updated weights for policy 1, policy_version 344810 (0.0006) [2023-12-26 02:21:14,949][123090] Updated weights for policy 1, policy_version 344820 (0.0006) [2023-12-26 02:21:15,008][123091] Updated weights for policy 0, policy_version 346841 (0.0010) [2023-12-26 02:21:15,019][123090] Updated weights for policy 1, policy_version 344830 (0.0007) [2023-12-26 02:21:15,064][123091] Updated weights for policy 0, policy_version 346851 (0.0006) [2023-12-26 02:21:15,135][123091] Updated weights for policy 0, policy_version 346861 (0.0010) [2023-12-26 02:21:15,808][123090] Updated weights for policy 1, policy_version 344840 (0.0010) [2023-12-26 02:21:15,860][123090] Updated weights for policy 1, policy_version 344850 (0.0009) [2023-12-26 02:21:15,868][123091] Updated weights for policy 0, policy_version 346871 (0.0007) [2023-12-26 02:21:15,910][123090] Updated weights for policy 1, policy_version 344860 (0.0010) [2023-12-26 02:21:15,917][123091] Updated weights for policy 0, policy_version 346881 (0.0005) [2023-12-26 02:21:15,964][123091] Updated weights for policy 0, policy_version 346891 (0.0005) [2023-12-26 02:21:16,636][123091] Updated weights for policy 0, policy_version 346901 (0.0005) [2023-12-26 02:21:16,683][123091] Updated weights for policy 0, policy_version 346911 (0.0005) [2023-12-26 02:21:16,752][123091] Updated weights for policy 0, policy_version 346921 (0.0006) [2023-12-26 02:21:16,799][123090] Updated weights for policy 1, policy_version 344871 (0.0010) [2023-12-26 02:21:16,852][123090] Updated weights for policy 1, policy_version 344881 (0.0008) [2023-12-26 02:21:16,908][123090] Updated weights for policy 1, policy_version 344891 (0.0009) [2023-12-26 02:21:17,497][123091] Updated weights for policy 0, policy_version 346931 (0.0008) [2023-12-26 02:21:17,548][123091] Updated weights for policy 0, policy_version 346941 (0.0005) [2023-12-26 02:21:17,601][123091] Updated weights for policy 0, policy_version 346951 (0.0005) [2023-12-26 02:21:17,812][123090] Updated weights for policy 1, policy_version 344901 (0.0009) [2023-12-26 02:21:17,872][123090] Updated weights for policy 1, policy_version 344911 (0.0008) [2023-12-26 02:21:17,931][123090] Updated weights for policy 1, policy_version 344921 (0.0009) [2023-12-26 02:21:18,311][123091] Updated weights for policy 0, policy_version 346961 (0.0005) [2023-12-26 02:21:18,373][123091] Updated weights for policy 0, policy_version 346971 (0.0008) [2023-12-26 02:21:18,438][123091] Updated weights for policy 0, policy_version 346981 (0.0008) [2023-12-26 02:21:18,496][123091] Updated weights for policy 0, policy_version 346991 (0.0010) [2023-12-26 02:21:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 17439.2). Total num frames: 177135616. Throughput: 0: 8471.8, 1: 8494.0. Samples: 177148248. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:18,785][121949] Avg episode reward: [(0, '6192.396'), (1, '5598.413')] [2023-12-26 02:21:18,809][123090] Updated weights for policy 1, policy_version 344931 (0.0009) [2023-12-26 02:21:18,868][123090] Updated weights for policy 1, policy_version 344941 (0.0010) [2023-12-26 02:21:18,924][123090] Updated weights for policy 1, policy_version 344951 (0.0008) [2023-12-26 02:21:19,200][123091] Updated weights for policy 0, policy_version 347001 (0.0009) [2023-12-26 02:21:19,269][123091] Updated weights for policy 0, policy_version 347011 (0.0011) [2023-12-26 02:21:19,338][123091] Updated weights for policy 0, policy_version 347021 (0.0011) [2023-12-26 02:21:19,773][123090] Updated weights for policy 1, policy_version 344961 (0.0006) [2023-12-26 02:21:19,838][123090] Updated weights for policy 1, policy_version 344971 (0.0009) [2023-12-26 02:21:19,911][123090] Updated weights for policy 1, policy_version 344981 (0.0010) [2023-12-26 02:21:19,967][123090] Updated weights for policy 1, policy_version 344991 (0.0009) [2023-12-26 02:21:20,205][123091] Updated weights for policy 0, policy_version 347031 (0.0010) [2023-12-26 02:21:20,260][123091] Updated weights for policy 0, policy_version 347041 (0.0006) [2023-12-26 02:21:20,315][123091] Updated weights for policy 0, policy_version 347051 (0.0006) [2023-12-26 02:21:20,865][123090] Updated weights for policy 1, policy_version 345001 (0.0009) [2023-12-26 02:21:20,936][123090] Updated weights for policy 1, policy_version 345011 (0.0010) [2023-12-26 02:21:20,998][123090] Updated weights for policy 1, policy_version 345021 (0.0009) [2023-12-26 02:21:21,056][123091] Updated weights for policy 0, policy_version 347061 (0.0008) [2023-12-26 02:21:21,117][123091] Updated weights for policy 0, policy_version 347071 (0.0011) [2023-12-26 02:21:21,188][123091] Updated weights for policy 0, policy_version 347081 (0.0011) [2023-12-26 02:21:21,901][123090] Updated weights for policy 1, policy_version 345031 (0.0009) [2023-12-26 02:21:21,966][123090] Updated weights for policy 1, policy_version 345041 (0.0009) [2023-12-26 02:21:22,036][123090] Updated weights for policy 1, policy_version 345051 (0.0009) [2023-12-26 02:21:22,052][123091] Updated weights for policy 0, policy_version 347091 (0.0011) [2023-12-26 02:21:22,121][123091] Updated weights for policy 0, policy_version 347101 (0.0011) [2023-12-26 02:21:22,186][123091] Updated weights for policy 0, policy_version 347111 (0.0011) [2023-12-26 02:21:22,883][123090] Updated weights for policy 1, policy_version 345061 (0.0009) [2023-12-26 02:21:22,942][123090] Updated weights for policy 1, policy_version 345071 (0.0009) [2023-12-26 02:21:23,007][123090] Updated weights for policy 1, policy_version 345081 (0.0009) [2023-12-26 02:21:23,011][123091] Updated weights for policy 0, policy_version 347121 (0.0011) [2023-12-26 02:21:23,066][123091] Updated weights for policy 0, policy_version 347131 (0.0011) [2023-12-26 02:21:23,129][123091] Updated weights for policy 0, policy_version 347141 (0.0011) [2023-12-26 02:21:23,181][123091] Updated weights for policy 0, policy_version 347151 (0.0010) [2023-12-26 02:21:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 16793.5, 300 sec: 17411.5). Total num frames: 177217536. Throughput: 0: 8531.1, 1: 8503.7. Samples: 177199548. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:23,785][121949] Avg episode reward: [(0, '6273.882'), (1, '5832.719')] [2023-12-26 02:21:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000347152_88875008.pth... [2023-12-26 02:21:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000346128_88612864.pth [2023-12-26 02:21:23,824][123090] Updated weights for policy 1, policy_version 345091 (0.0007) [2023-12-26 02:21:23,880][123090] Updated weights for policy 1, policy_version 345101 (0.0009) [2023-12-26 02:21:23,939][123090] Updated weights for policy 1, policy_version 345111 (0.0009) [2023-12-26 02:21:23,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000345120_88350720.pth... [2023-12-26 02:21:23,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000344096_88088576.pth [2023-12-26 02:21:24,017][123091] Updated weights for policy 0, policy_version 347161 (0.0011) [2023-12-26 02:21:24,061][123091] Updated weights for policy 0, policy_version 347171 (0.0010) [2023-12-26 02:21:24,106][123091] Updated weights for policy 0, policy_version 347181 (0.0010) [2023-12-26 02:21:24,780][123090] Updated weights for policy 1, policy_version 345121 (0.0009) [2023-12-26 02:21:24,834][123090] Updated weights for policy 1, policy_version 345131 (0.0010) [2023-12-26 02:21:24,886][123090] Updated weights for policy 1, policy_version 345141 (0.0010) [2023-12-26 02:21:24,946][123090] Updated weights for policy 1, policy_version 345151 (0.0011) [2023-12-26 02:21:24,972][123091] Updated weights for policy 0, policy_version 347191 (0.0010) [2023-12-26 02:21:25,035][123091] Updated weights for policy 0, policy_version 347201 (0.0008) [2023-12-26 02:21:25,108][123091] Updated weights for policy 0, policy_version 347211 (0.0006) [2023-12-26 02:21:25,610][123090] Updated weights for policy 1, policy_version 345161 (0.0006) [2023-12-26 02:21:25,664][123090] Updated weights for policy 1, policy_version 345171 (0.0005) [2023-12-26 02:21:25,712][123090] Updated weights for policy 1, policy_version 345181 (0.0005) [2023-12-26 02:21:25,905][123091] Updated weights for policy 0, policy_version 347221 (0.0010) [2023-12-26 02:21:25,967][123091] Updated weights for policy 0, policy_version 347231 (0.0010) [2023-12-26 02:21:26,027][123091] Updated weights for policy 0, policy_version 347241 (0.0010) [2023-12-26 02:21:26,345][123090] Updated weights for policy 1, policy_version 345191 (0.0006) [2023-12-26 02:21:26,404][123090] Updated weights for policy 1, policy_version 345201 (0.0006) [2023-12-26 02:21:26,459][123090] Updated weights for policy 1, policy_version 345211 (0.0006) [2023-12-26 02:21:26,824][123091] Updated weights for policy 0, policy_version 347251 (0.0009) [2023-12-26 02:21:26,883][123091] Updated weights for policy 0, policy_version 347261 (0.0006) [2023-12-26 02:21:26,934][123091] Updated weights for policy 0, policy_version 347271 (0.0006) [2023-12-26 02:21:27,160][123090] Updated weights for policy 1, policy_version 345221 (0.0007) [2023-12-26 02:21:27,209][123090] Updated weights for policy 1, policy_version 345231 (0.0005) [2023-12-26 02:21:27,262][123090] Updated weights for policy 1, policy_version 345241 (0.0005) [2023-12-26 02:21:27,713][123091] Updated weights for policy 0, policy_version 347281 (0.0007) [2023-12-26 02:21:27,770][123091] Updated weights for policy 0, policy_version 347291 (0.0005) [2023-12-26 02:21:27,828][123091] Updated weights for policy 0, policy_version 347301 (0.0005) [2023-12-26 02:21:27,883][123091] Updated weights for policy 0, policy_version 347311 (0.0005) [2023-12-26 02:21:27,985][123090] Updated weights for policy 1, policy_version 345251 (0.0007) [2023-12-26 02:21:28,036][123090] Updated weights for policy 1, policy_version 345261 (0.0005) [2023-12-26 02:21:28,085][123090] Updated weights for policy 1, policy_version 345271 (0.0005) [2023-12-26 02:21:28,595][123091] Updated weights for policy 0, policy_version 347321 (0.0006) [2023-12-26 02:21:28,651][123091] Updated weights for policy 0, policy_version 347331 (0.0005) [2023-12-26 02:21:28,712][123091] Updated weights for policy 0, policy_version 347341 (0.0006) [2023-12-26 02:21:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17066.6, 300 sec: 17467.0). Total num frames: 177315840. Throughput: 0: 8633.8, 1: 8628.3. Samples: 177306144. Policy #0 lag: (min: 7.0, avg: 9.6, max: 39.0) [2023-12-26 02:21:28,785][121949] Avg episode reward: [(0, '6249.348'), (1, '5720.614')] [2023-12-26 02:21:28,855][123090] Updated weights for policy 1, policy_version 345281 (0.0005) [2023-12-26 02:21:28,929][123090] Updated weights for policy 1, policy_version 345291 (0.0006) [2023-12-26 02:21:28,980][123090] Updated weights for policy 1, policy_version 345301 (0.0006) [2023-12-26 02:21:29,033][123090] Updated weights for policy 1, policy_version 345311 (0.0008) [2023-12-26 02:21:29,454][123091] Updated weights for policy 0, policy_version 347351 (0.0008) [2023-12-26 02:21:29,515][123091] Updated weights for policy 0, policy_version 347361 (0.0010) [2023-12-26 02:21:29,572][123091] Updated weights for policy 0, policy_version 347371 (0.0009) [2023-12-26 02:21:29,863][123090] Updated weights for policy 1, policy_version 345321 (0.0007) [2023-12-26 02:21:29,930][123090] Updated weights for policy 1, policy_version 345331 (0.0008) [2023-12-26 02:21:29,981][123090] Updated weights for policy 1, policy_version 345341 (0.0010) [2023-12-26 02:21:30,318][123091] Updated weights for policy 0, policy_version 347381 (0.0007) [2023-12-26 02:21:30,378][123091] Updated weights for policy 0, policy_version 347391 (0.0005) [2023-12-26 02:21:30,438][123091] Updated weights for policy 0, policy_version 347401 (0.0005) [2023-12-26 02:21:30,780][123090] Updated weights for policy 1, policy_version 345351 (0.0011) [2023-12-26 02:21:30,838][123090] Updated weights for policy 1, policy_version 345362 (0.0009) [2023-12-26 02:21:30,898][123090] Updated weights for policy 1, policy_version 345372 (0.0009) [2023-12-26 02:21:31,082][123091] Updated weights for policy 0, policy_version 347411 (0.0005) [2023-12-26 02:21:31,145][123091] Updated weights for policy 0, policy_version 347421 (0.0006) [2023-12-26 02:21:31,209][123091] Updated weights for policy 0, policy_version 347431 (0.0006) [2023-12-26 02:21:31,777][123090] Updated weights for policy 1, policy_version 345382 (0.0009) [2023-12-26 02:21:31,830][123090] Updated weights for policy 1, policy_version 345392 (0.0009) [2023-12-26 02:21:31,886][123090] Updated weights for policy 1, policy_version 345402 (0.0009) [2023-12-26 02:21:32,002][123091] Updated weights for policy 0, policy_version 347441 (0.0007) [2023-12-26 02:21:32,062][123091] Updated weights for policy 0, policy_version 347451 (0.0009) [2023-12-26 02:21:32,117][123091] Updated weights for policy 0, policy_version 347461 (0.0009) [2023-12-26 02:21:32,182][123091] Updated weights for policy 0, policy_version 347471 (0.0009) [2023-12-26 02:21:32,739][123090] Updated weights for policy 1, policy_version 345412 (0.0009) [2023-12-26 02:21:32,798][123090] Updated weights for policy 1, policy_version 345422 (0.0010) [2023-12-26 02:21:32,858][123090] Updated weights for policy 1, policy_version 345432 (0.0006) [2023-12-26 02:21:33,011][123091] Updated weights for policy 0, policy_version 347481 (0.0009) [2023-12-26 02:21:33,062][123091] Updated weights for policy 0, policy_version 347491 (0.0009) [2023-12-26 02:21:33,116][123091] Updated weights for policy 0, policy_version 347501 (0.0008) [2023-12-26 02:21:33,647][123090] Updated weights for policy 1, policy_version 345442 (0.0006) [2023-12-26 02:21:33,693][123090] Updated weights for policy 1, policy_version 345452 (0.0010) [2023-12-26 02:21:33,740][123090] Updated weights for policy 1, policy_version 345462 (0.0010) [2023-12-26 02:21:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17066.7, 300 sec: 17411.5). Total num frames: 177397760. Throughput: 0: 8745.8, 1: 8664.3. Samples: 177414584. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:33,785][121949] Avg episode reward: [(0, '6234.890'), (1, '5711.510')] [2023-12-26 02:21:33,805][123090] Updated weights for policy 1, policy_version 345472 (0.0010) [2023-12-26 02:21:33,972][123091] Updated weights for policy 0, policy_version 347512 (0.0009) [2023-12-26 02:21:34,029][123091] Updated weights for policy 0, policy_version 347522 (0.0009) [2023-12-26 02:21:34,077][123091] Updated weights for policy 0, policy_version 347533 (0.0009) [2023-12-26 02:21:34,663][123090] Updated weights for policy 1, policy_version 345482 (0.0010) [2023-12-26 02:21:34,731][123090] Updated weights for policy 1, policy_version 345492 (0.0010) [2023-12-26 02:21:34,786][123090] Updated weights for policy 1, policy_version 345502 (0.0010) [2023-12-26 02:21:34,927][123091] Updated weights for policy 0, policy_version 347543 (0.0009) [2023-12-26 02:21:34,975][123091] Updated weights for policy 0, policy_version 347553 (0.0007) [2023-12-26 02:21:35,032][123091] Updated weights for policy 0, policy_version 347563 (0.0007) [2023-12-26 02:21:35,614][123090] Updated weights for policy 1, policy_version 345512 (0.0010) [2023-12-26 02:21:35,685][123090] Updated weights for policy 1, policy_version 345522 (0.0010) [2023-12-26 02:21:35,743][123090] Updated weights for policy 1, policy_version 345532 (0.0010) [2023-12-26 02:21:35,754][123091] Updated weights for policy 0, policy_version 347573 (0.0007) [2023-12-26 02:21:35,819][123091] Updated weights for policy 0, policy_version 347583 (0.0006) [2023-12-26 02:21:35,865][123091] Updated weights for policy 0, policy_version 347593 (0.0006) [2023-12-26 02:21:36,554][123091] Updated weights for policy 0, policy_version 347603 (0.0005) [2023-12-26 02:21:36,573][123090] Updated weights for policy 1, policy_version 345542 (0.0008) [2023-12-26 02:21:36,623][123091] Updated weights for policy 0, policy_version 347613 (0.0007) [2023-12-26 02:21:36,635][123090] Updated weights for policy 1, policy_version 345552 (0.0008) [2023-12-26 02:21:36,688][123091] Updated weights for policy 0, policy_version 347623 (0.0010) [2023-12-26 02:21:36,691][123090] Updated weights for policy 1, policy_version 345562 (0.0006) [2023-12-26 02:21:37,361][123091] Updated weights for policy 0, policy_version 347633 (0.0010) [2023-12-26 02:21:37,424][123091] Updated weights for policy 0, policy_version 347643 (0.0011) [2023-12-26 02:21:37,491][123091] Updated weights for policy 0, policy_version 347653 (0.0011) [2023-12-26 02:21:37,561][123091] Updated weights for policy 0, policy_version 347663 (0.0011) [2023-12-26 02:21:37,576][123090] Updated weights for policy 1, policy_version 345572 (0.0007) [2023-12-26 02:21:37,633][123090] Updated weights for policy 1, policy_version 345582 (0.0009) [2023-12-26 02:21:37,699][123090] Updated weights for policy 1, policy_version 345592 (0.0008) [2023-12-26 02:21:38,290][123091] Updated weights for policy 0, policy_version 347673 (0.0006) [2023-12-26 02:21:38,357][123091] Updated weights for policy 0, policy_version 347683 (0.0007) [2023-12-26 02:21:38,421][123091] Updated weights for policy 0, policy_version 347693 (0.0008) [2023-12-26 02:21:38,482][123090] Updated weights for policy 1, policy_version 345602 (0.0008) [2023-12-26 02:21:38,547][123090] Updated weights for policy 1, policy_version 345612 (0.0005) [2023-12-26 02:21:38,594][123090] Updated weights for policy 1, policy_version 345622 (0.0005) [2023-12-26 02:21:38,647][123090] Updated weights for policy 1, policy_version 345632 (0.0005) [2023-12-26 02:21:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 177496064. Throughput: 0: 8901.1, 1: 8744.4. Samples: 177468572. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:38,785][121949] Avg episode reward: [(0, '6275.228'), (1, '5703.305')] [2023-12-26 02:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000347696_89014272.pth... [2023-12-26 02:21:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000345632_88481792.pth... [2023-12-26 02:21:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000344608_88219648.pth [2023-12-26 02:21:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000346640_88743936.pth [2023-12-26 02:21:39,204][123091] Updated weights for policy 0, policy_version 347703 (0.0011) [2023-12-26 02:21:39,268][123091] Updated weights for policy 0, policy_version 347713 (0.0011) [2023-12-26 02:21:39,335][123091] Updated weights for policy 0, policy_version 347723 (0.0010) [2023-12-26 02:21:39,397][123090] Updated weights for policy 1, policy_version 345642 (0.0007) [2023-12-26 02:21:39,453][123090] Updated weights for policy 1, policy_version 345652 (0.0009) [2023-12-26 02:21:39,510][123090] Updated weights for policy 1, policy_version 345662 (0.0010) [2023-12-26 02:21:40,178][123091] Updated weights for policy 0, policy_version 347733 (0.0010) [2023-12-26 02:21:40,245][123091] Updated weights for policy 0, policy_version 347743 (0.0009) [2023-12-26 02:21:40,309][123091] Updated weights for policy 0, policy_version 347753 (0.0010) [2023-12-26 02:21:40,325][123090] Updated weights for policy 1, policy_version 345672 (0.0006) [2023-12-26 02:21:40,376][123090] Updated weights for policy 1, policy_version 345682 (0.0007) [2023-12-26 02:21:40,434][123090] Updated weights for policy 1, policy_version 345692 (0.0010) [2023-12-26 02:21:41,043][123091] Updated weights for policy 0, policy_version 347763 (0.0009) [2023-12-26 02:21:41,109][123091] Updated weights for policy 0, policy_version 347773 (0.0007) [2023-12-26 02:21:41,177][123091] Updated weights for policy 0, policy_version 347783 (0.0008) [2023-12-26 02:21:41,312][123090] Updated weights for policy 1, policy_version 345702 (0.0010) [2023-12-26 02:21:41,381][123090] Updated weights for policy 1, policy_version 345712 (0.0010) [2023-12-26 02:21:41,443][123090] Updated weights for policy 1, policy_version 345722 (0.0009) [2023-12-26 02:21:41,990][123091] Updated weights for policy 0, policy_version 347793 (0.0006) [2023-12-26 02:21:42,053][123091] Updated weights for policy 0, policy_version 347803 (0.0009) [2023-12-26 02:21:42,126][123091] Updated weights for policy 0, policy_version 347813 (0.0011) [2023-12-26 02:21:42,195][123091] Updated weights for policy 0, policy_version 347823 (0.0009) [2023-12-26 02:21:42,327][123090] Updated weights for policy 1, policy_version 345732 (0.0010) [2023-12-26 02:21:42,398][123090] Updated weights for policy 1, policy_version 345742 (0.0009) [2023-12-26 02:21:42,465][123090] Updated weights for policy 1, policy_version 345752 (0.0008) [2023-12-26 02:21:42,897][123091] Updated weights for policy 0, policy_version 347833 (0.0007) [2023-12-26 02:21:42,950][123091] Updated weights for policy 0, policy_version 347843 (0.0008) [2023-12-26 02:21:43,006][123091] Updated weights for policy 0, policy_version 347853 (0.0005) [2023-12-26 02:21:43,340][123090] Updated weights for policy 1, policy_version 345762 (0.0008) [2023-12-26 02:21:43,408][123090] Updated weights for policy 1, policy_version 345772 (0.0009) [2023-12-26 02:21:43,473][123090] Updated weights for policy 1, policy_version 345782 (0.0009) [2023-12-26 02:21:43,522][123090] Updated weights for policy 1, policy_version 345792 (0.0009) [2023-12-26 02:21:43,722][123091] Updated weights for policy 0, policy_version 347863 (0.0005) [2023-12-26 02:21:43,771][123091] Updated weights for policy 0, policy_version 347873 (0.0005) [2023-12-26 02:21:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 177577984. Throughput: 0: 8975.2, 1: 8718.3. Samples: 177572868. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:43,785][121949] Avg episode reward: [(0, '6309.872'), (1, '5682.269')] [2023-12-26 02:21:43,826][123091] Updated weights for policy 0, policy_version 347883 (0.0005) [2023-12-26 02:21:44,397][123090] Updated weights for policy 1, policy_version 345802 (0.0010) [2023-12-26 02:21:44,459][123090] Updated weights for policy 1, policy_version 345812 (0.0010) [2023-12-26 02:21:44,512][123090] Updated weights for policy 1, policy_version 345822 (0.0009) [2023-12-26 02:21:44,576][123091] Updated weights for policy 0, policy_version 347893 (0.0007) [2023-12-26 02:21:44,632][123091] Updated weights for policy 0, policy_version 347903 (0.0010) [2023-12-26 02:21:44,691][123091] Updated weights for policy 0, policy_version 347913 (0.0009) [2023-12-26 02:21:45,333][123090] Updated weights for policy 1, policy_version 345832 (0.0006) [2023-12-26 02:21:45,379][123090] Updated weights for policy 1, policy_version 345842 (0.0005) [2023-12-26 02:21:45,434][123090] Updated weights for policy 1, policy_version 345852 (0.0005) [2023-12-26 02:21:45,551][123091] Updated weights for policy 0, policy_version 347923 (0.0010) [2023-12-26 02:21:45,625][123091] Updated weights for policy 0, policy_version 347933 (0.0011) [2023-12-26 02:21:45,688][123091] Updated weights for policy 0, policy_version 347943 (0.0010) [2023-12-26 02:21:46,108][123090] Updated weights for policy 1, policy_version 345862 (0.0008) [2023-12-26 02:21:46,175][123090] Updated weights for policy 1, policy_version 345872 (0.0008) [2023-12-26 02:21:46,249][123090] Updated weights for policy 1, policy_version 345882 (0.0006) [2023-12-26 02:21:46,443][123091] Updated weights for policy 0, policy_version 347953 (0.0007) [2023-12-26 02:21:46,494][123091] Updated weights for policy 0, policy_version 347963 (0.0010) [2023-12-26 02:21:46,541][123091] Updated weights for policy 0, policy_version 347973 (0.0010) [2023-12-26 02:21:46,592][123091] Updated weights for policy 0, policy_version 347983 (0.0010) [2023-12-26 02:21:47,000][123090] Updated weights for policy 1, policy_version 345892 (0.0005) [2023-12-26 02:21:47,067][123090] Updated weights for policy 1, policy_version 345902 (0.0005) [2023-12-26 02:21:47,133][123090] Updated weights for policy 1, policy_version 345912 (0.0006) [2023-12-26 02:21:47,433][123091] Updated weights for policy 0, policy_version 347993 (0.0010) [2023-12-26 02:21:47,477][123091] Updated weights for policy 0, policy_version 348003 (0.0005) [2023-12-26 02:21:47,523][123091] Updated weights for policy 0, policy_version 348013 (0.0005) [2023-12-26 02:21:47,694][123090] Updated weights for policy 1, policy_version 345922 (0.0005) [2023-12-26 02:21:47,748][123090] Updated weights for policy 1, policy_version 345932 (0.0005) [2023-12-26 02:21:47,804][123090] Updated weights for policy 1, policy_version 345942 (0.0005) [2023-12-26 02:21:47,866][123090] Updated weights for policy 1, policy_version 345952 (0.0005) [2023-12-26 02:21:48,314][123091] Updated weights for policy 0, policy_version 348023 (0.0009) [2023-12-26 02:21:48,385][123091] Updated weights for policy 0, policy_version 348033 (0.0011) [2023-12-26 02:21:48,449][123091] Updated weights for policy 0, policy_version 348043 (0.0011) [2023-12-26 02:21:48,520][123090] Updated weights for policy 1, policy_version 345962 (0.0009) [2023-12-26 02:21:48,569][123090] Updated weights for policy 1, policy_version 345972 (0.0009) [2023-12-26 02:21:48,630][123090] Updated weights for policy 1, policy_version 345982 (0.0010) [2023-12-26 02:21:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 177676288. Throughput: 0: 9028.2, 1: 8763.8. Samples: 177683108. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:48,785][121949] Avg episode reward: [(0, '6347.089'), (1, '5803.151')] [2023-12-26 02:21:49,281][123091] Updated weights for policy 0, policy_version 348053 (0.0009) [2023-12-26 02:21:49,347][123091] Updated weights for policy 0, policy_version 348063 (0.0007) [2023-12-26 02:21:49,412][123091] Updated weights for policy 0, policy_version 348073 (0.0007) [2023-12-26 02:21:49,472][123090] Updated weights for policy 1, policy_version 345992 (0.0008) [2023-12-26 02:21:49,526][123090] Updated weights for policy 1, policy_version 346002 (0.0010) [2023-12-26 02:21:49,581][123090] Updated weights for policy 1, policy_version 346012 (0.0010) [2023-12-26 02:21:50,144][123091] Updated weights for policy 0, policy_version 348083 (0.0008) [2023-12-26 02:21:50,201][123091] Updated weights for policy 0, policy_version 348093 (0.0010) [2023-12-26 02:21:50,271][123091] Updated weights for policy 0, policy_version 348103 (0.0011) [2023-12-26 02:21:50,357][123090] Updated weights for policy 1, policy_version 346022 (0.0009) [2023-12-26 02:21:50,426][123090] Updated weights for policy 1, policy_version 346032 (0.0009) [2023-12-26 02:21:50,481][123090] Updated weights for policy 1, policy_version 346042 (0.0009) [2023-12-26 02:21:51,083][123091] Updated weights for policy 0, policy_version 348113 (0.0009) [2023-12-26 02:21:51,149][123091] Updated weights for policy 0, policy_version 348123 (0.0010) [2023-12-26 02:21:51,219][123091] Updated weights for policy 0, policy_version 348133 (0.0009) [2023-12-26 02:21:51,285][123091] Updated weights for policy 0, policy_version 348143 (0.0008) [2023-12-26 02:21:51,403][123090] Updated weights for policy 1, policy_version 346052 (0.0008) [2023-12-26 02:21:51,476][123090] Updated weights for policy 1, policy_version 346062 (0.0008) [2023-12-26 02:21:51,546][123090] Updated weights for policy 1, policy_version 346072 (0.0008) [2023-12-26 02:21:52,054][123091] Updated weights for policy 0, policy_version 348153 (0.0010) [2023-12-26 02:21:52,116][123091] Updated weights for policy 0, policy_version 348163 (0.0010) [2023-12-26 02:21:52,183][123091] Updated weights for policy 0, policy_version 348173 (0.0007) [2023-12-26 02:21:52,344][123090] Updated weights for policy 1, policy_version 346082 (0.0009) [2023-12-26 02:21:52,417][123090] Updated weights for policy 1, policy_version 346092 (0.0010) [2023-12-26 02:21:52,480][123090] Updated weights for policy 1, policy_version 346102 (0.0010) [2023-12-26 02:21:52,540][123090] Updated weights for policy 1, policy_version 346112 (0.0011) [2023-12-26 02:21:52,862][123091] Updated weights for policy 0, policy_version 348183 (0.0006) [2023-12-26 02:21:52,913][123091] Updated weights for policy 0, policy_version 348193 (0.0005) [2023-12-26 02:21:52,980][123091] Updated weights for policy 0, policy_version 348203 (0.0006) [2023-12-26 02:21:53,345][123090] Updated weights for policy 1, policy_version 346122 (0.0011) [2023-12-26 02:21:53,396][123090] Updated weights for policy 1, policy_version 346132 (0.0010) [2023-12-26 02:21:53,451][123090] Updated weights for policy 1, policy_version 346142 (0.0010) [2023-12-26 02:21:53,694][123091] Updated weights for policy 0, policy_version 348213 (0.0008) [2023-12-26 02:21:53,747][123091] Updated weights for policy 0, policy_version 348223 (0.0011) [2023-12-26 02:21:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 177758208. Throughput: 0: 9043.3, 1: 8787.1. Samples: 177735596. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:53,785][121949] Avg episode reward: [(0, '6392.031'), (1, '5776.218')] [2023-12-26 02:21:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000346144_88612864.pth... [2023-12-26 02:21:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000345120_88350720.pth [2023-12-26 02:21:53,809][123091] Updated weights for policy 0, policy_version 348233 (0.0009) [2023-12-26 02:21:53,855][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000348240_89153536.pth... [2023-12-26 02:21:53,859][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000347152_88875008.pth [2023-12-26 02:21:54,246][123090] Updated weights for policy 1, policy_version 346152 (0.0006) [2023-12-26 02:21:54,296][123090] Updated weights for policy 1, policy_version 346162 (0.0006) [2023-12-26 02:21:54,356][123090] Updated weights for policy 1, policy_version 346172 (0.0009) [2023-12-26 02:21:54,554][123091] Updated weights for policy 0, policy_version 348243 (0.0006) [2023-12-26 02:21:54,624][123091] Updated weights for policy 0, policy_version 348253 (0.0007) [2023-12-26 02:21:54,687][123091] Updated weights for policy 0, policy_version 348263 (0.0010) [2023-12-26 02:21:55,124][123090] Updated weights for policy 1, policy_version 346182 (0.0011) [2023-12-26 02:21:55,179][123090] Updated weights for policy 1, policy_version 346192 (0.0010) [2023-12-26 02:21:55,231][123090] Updated weights for policy 1, policy_version 346202 (0.0010) [2023-12-26 02:21:55,449][123091] Updated weights for policy 0, policy_version 348273 (0.0007) [2023-12-26 02:21:55,512][123091] Updated weights for policy 0, policy_version 348283 (0.0011) [2023-12-26 02:21:55,584][123091] Updated weights for policy 0, policy_version 348293 (0.0010) [2023-12-26 02:21:55,650][123091] Updated weights for policy 0, policy_version 348303 (0.0010) [2023-12-26 02:21:56,045][123090] Updated weights for policy 1, policy_version 346212 (0.0008) [2023-12-26 02:21:56,114][123090] Updated weights for policy 1, policy_version 346222 (0.0005) [2023-12-26 02:21:56,180][123090] Updated weights for policy 1, policy_version 346232 (0.0005) [2023-12-26 02:21:56,448][123091] Updated weights for policy 0, policy_version 348313 (0.0011) [2023-12-26 02:21:56,502][123091] Updated weights for policy 0, policy_version 348323 (0.0010) [2023-12-26 02:21:56,553][123091] Updated weights for policy 0, policy_version 348333 (0.0010) [2023-12-26 02:21:56,824][123090] Updated weights for policy 1, policy_version 346242 (0.0007) [2023-12-26 02:21:56,889][123090] Updated weights for policy 1, policy_version 346252 (0.0005) [2023-12-26 02:21:56,952][123090] Updated weights for policy 1, policy_version 346262 (0.0009) [2023-12-26 02:21:57,003][123090] Updated weights for policy 1, policy_version 346272 (0.0010) [2023-12-26 02:21:57,316][123091] Updated weights for policy 0, policy_version 348343 (0.0010) [2023-12-26 02:21:57,378][123091] Updated weights for policy 0, policy_version 348353 (0.0008) [2023-12-26 02:21:57,431][123091] Updated weights for policy 0, policy_version 348363 (0.0005) [2023-12-26 02:21:57,702][123090] Updated weights for policy 1, policy_version 346282 (0.0010) [2023-12-26 02:21:57,753][123090] Updated weights for policy 1, policy_version 346292 (0.0010) [2023-12-26 02:21:57,807][123090] Updated weights for policy 1, policy_version 346302 (0.0010) [2023-12-26 02:21:58,173][123091] Updated weights for policy 0, policy_version 348373 (0.0008) [2023-12-26 02:21:58,231][123091] Updated weights for policy 0, policy_version 348383 (0.0010) [2023-12-26 02:21:58,294][123091] Updated weights for policy 0, policy_version 348393 (0.0010) [2023-12-26 02:21:58,651][123090] Updated weights for policy 1, policy_version 346312 (0.0008) [2023-12-26 02:21:58,727][123090] Updated weights for policy 1, policy_version 346322 (0.0007) [2023-12-26 02:21:58,786][121949] Fps is (10 sec: 17199.3, 60 sec: 17748.6, 300 sec: 17466.9). Total num frames: 177848320. Throughput: 0: 9123.0, 1: 8837.3. Samples: 177847020. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:21:58,787][121949] Avg episode reward: [(0, '6440.779'), (1, '5674.771')] [2023-12-26 02:21:58,807][123090] Updated weights for policy 1, policy_version 346332 (0.0008) [2023-12-26 02:21:59,233][123091] Updated weights for policy 0, policy_version 348403 (0.0010) [2023-12-26 02:21:59,303][123091] Updated weights for policy 0, policy_version 348413 (0.0009) [2023-12-26 02:21:59,370][123091] Updated weights for policy 0, policy_version 348423 (0.0010) [2023-12-26 02:21:59,573][123090] Updated weights for policy 1, policy_version 346342 (0.0006) [2023-12-26 02:21:59,623][123090] Updated weights for policy 1, policy_version 346352 (0.0005) [2023-12-26 02:21:59,685][123090] Updated weights for policy 1, policy_version 346362 (0.0005) [2023-12-26 02:22:00,089][123091] Updated weights for policy 0, policy_version 348433 (0.0007) [2023-12-26 02:22:00,144][123091] Updated weights for policy 0, policy_version 348443 (0.0005) [2023-12-26 02:22:00,201][123091] Updated weights for policy 0, policy_version 348453 (0.0005) [2023-12-26 02:22:00,265][123091] Updated weights for policy 0, policy_version 348463 (0.0005) [2023-12-26 02:22:00,397][123090] Updated weights for policy 1, policy_version 346372 (0.0005) [2023-12-26 02:22:00,468][123090] Updated weights for policy 1, policy_version 346382 (0.0006) [2023-12-26 02:22:00,531][123090] Updated weights for policy 1, policy_version 346392 (0.0009) [2023-12-26 02:22:00,907][123091] Updated weights for policy 0, policy_version 348473 (0.0005) [2023-12-26 02:22:00,974][123091] Updated weights for policy 0, policy_version 348483 (0.0005) [2023-12-26 02:22:01,036][123091] Updated weights for policy 0, policy_version 348493 (0.0006) [2023-12-26 02:22:01,285][123090] Updated weights for policy 1, policy_version 346402 (0.0009) [2023-12-26 02:22:01,341][123090] Updated weights for policy 1, policy_version 346412 (0.0009) [2023-12-26 02:22:01,415][123090] Updated weights for policy 1, policy_version 346422 (0.0009) [2023-12-26 02:22:01,477][123090] Updated weights for policy 1, policy_version 346432 (0.0008) [2023-12-26 02:22:01,703][123091] Updated weights for policy 0, policy_version 348503 (0.0006) [2023-12-26 02:22:01,775][123091] Updated weights for policy 0, policy_version 348513 (0.0008) [2023-12-26 02:22:01,829][123091] Updated weights for policy 0, policy_version 348523 (0.0008) [2023-12-26 02:22:02,349][123090] Updated weights for policy 1, policy_version 346442 (0.0008) [2023-12-26 02:22:02,419][123090] Updated weights for policy 1, policy_version 346452 (0.0008) [2023-12-26 02:22:02,491][123090] Updated weights for policy 1, policy_version 346462 (0.0008) [2023-12-26 02:22:02,569][123091] Updated weights for policy 0, policy_version 348533 (0.0007) [2023-12-26 02:22:02,623][123091] Updated weights for policy 0, policy_version 348543 (0.0006) [2023-12-26 02:22:02,690][123091] Updated weights for policy 0, policy_version 348553 (0.0005) [2023-12-26 02:22:03,247][123090] Updated weights for policy 1, policy_version 346472 (0.0010) [2023-12-26 02:22:03,308][123090] Updated weights for policy 1, policy_version 346482 (0.0010) [2023-12-26 02:22:03,366][123090] Updated weights for policy 1, policy_version 346492 (0.0010) [2023-12-26 02:22:03,379][123091] Updated weights for policy 0, policy_version 348563 (0.0005) [2023-12-26 02:22:03,438][123091] Updated weights for policy 0, policy_version 348573 (0.0005) [2023-12-26 02:22:03,492][123091] Updated weights for policy 0, policy_version 348583 (0.0005) [2023-12-26 02:22:03,784][121949] Fps is (10 sec: 18841.0, 60 sec: 18022.3, 300 sec: 17494.8). Total num frames: 177946624. Throughput: 0: 9087.7, 1: 8865.2. Samples: 177956136. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:03,785][121949] Avg episode reward: [(0, '6469.451'), (1, '5677.036')] [2023-12-26 02:22:04,186][123090] Updated weights for policy 1, policy_version 346502 (0.0010) [2023-12-26 02:22:04,226][123091] Updated weights for policy 0, policy_version 348593 (0.0009) [2023-12-26 02:22:04,254][123090] Updated weights for policy 1, policy_version 346512 (0.0010) [2023-12-26 02:22:04,283][123091] Updated weights for policy 0, policy_version 348603 (0.0008) [2023-12-26 02:22:04,321][123090] Updated weights for policy 1, policy_version 346522 (0.0011) [2023-12-26 02:22:04,342][123091] Updated weights for policy 0, policy_version 348613 (0.0008) [2023-12-26 02:22:04,409][123091] Updated weights for policy 0, policy_version 348623 (0.0010) [2023-12-26 02:22:05,027][123090] Updated weights for policy 1, policy_version 346532 (0.0008) [2023-12-26 02:22:05,082][123090] Updated weights for policy 1, policy_version 346542 (0.0005) [2023-12-26 02:22:05,116][123091] Updated weights for policy 0, policy_version 348633 (0.0009) [2023-12-26 02:22:05,138][123090] Updated weights for policy 1, policy_version 346552 (0.0005) [2023-12-26 02:22:05,182][123091] Updated weights for policy 0, policy_version 348643 (0.0008) [2023-12-26 02:22:05,244][123091] Updated weights for policy 0, policy_version 348653 (0.0008) [2023-12-26 02:22:05,807][123090] Updated weights for policy 1, policy_version 346562 (0.0005) [2023-12-26 02:22:05,867][123090] Updated weights for policy 1, policy_version 346572 (0.0005) [2023-12-26 02:22:05,924][123090] Updated weights for policy 1, policy_version 346582 (0.0007) [2023-12-26 02:22:05,939][123091] Updated weights for policy 0, policy_version 348663 (0.0006) [2023-12-26 02:22:05,978][123090] Updated weights for policy 1, policy_version 346592 (0.0007) [2023-12-26 02:22:06,007][123091] Updated weights for policy 0, policy_version 348673 (0.0005) [2023-12-26 02:22:06,070][123091] Updated weights for policy 0, policy_version 348683 (0.0005) [2023-12-26 02:22:06,771][123090] Updated weights for policy 1, policy_version 346602 (0.0010) [2023-12-26 02:22:06,816][123091] Updated weights for policy 0, policy_version 348693 (0.0006) [2023-12-26 02:22:06,830][123090] Updated weights for policy 1, policy_version 346612 (0.0010) [2023-12-26 02:22:06,868][123091] Updated weights for policy 0, policy_version 348703 (0.0009) [2023-12-26 02:22:06,893][123090] Updated weights for policy 1, policy_version 346622 (0.0010) [2023-12-26 02:22:06,930][123091] Updated weights for policy 0, policy_version 348713 (0.0006) [2023-12-26 02:22:07,702][123091] Updated weights for policy 0, policy_version 348723 (0.0007) [2023-12-26 02:22:07,714][123090] Updated weights for policy 1, policy_version 346632 (0.0008) [2023-12-26 02:22:07,770][123091] Updated weights for policy 0, policy_version 348733 (0.0010) [2023-12-26 02:22:07,790][123090] Updated weights for policy 1, policy_version 346642 (0.0005) [2023-12-26 02:22:07,846][123091] Updated weights for policy 0, policy_version 348743 (0.0008) [2023-12-26 02:22:07,863][123090] Updated weights for policy 1, policy_version 346652 (0.0005) [2023-12-26 02:22:08,429][123090] Updated weights for policy 1, policy_version 346662 (0.0008) [2023-12-26 02:22:08,493][123090] Updated weights for policy 1, policy_version 346672 (0.0009) [2023-12-26 02:22:08,552][123090] Updated weights for policy 1, policy_version 346682 (0.0010) [2023-12-26 02:22:08,676][123091] Updated weights for policy 0, policy_version 348753 (0.0008) [2023-12-26 02:22:08,752][123091] Updated weights for policy 0, policy_version 348763 (0.0007) [2023-12-26 02:22:08,784][121949] Fps is (10 sec: 18846.0, 60 sec: 17885.9, 300 sec: 17522.5). Total num frames: 178036736. Throughput: 0: 9149.0, 1: 8961.1. Samples: 178014496. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:08,785][121949] Avg episode reward: [(0, '6465.545'), (1, '5817.699')] [2023-12-26 02:22:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000346688_88752128.pth... [2023-12-26 02:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000345632_88481792.pth [2023-12-26 02:22:08,825][123091] Updated weights for policy 0, policy_version 348773 (0.0009) [2023-12-26 02:22:08,889][123091] Updated weights for policy 0, policy_version 348783 (0.0010) [2023-12-26 02:22:08,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000348784_89292800.pth... [2023-12-26 02:22:08,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000347696_89014272.pth [2023-12-26 02:22:09,223][123090] Updated weights for policy 1, policy_version 346692 (0.0009) [2023-12-26 02:22:09,287][123090] Updated weights for policy 1, policy_version 346702 (0.0009) [2023-12-26 02:22:09,354][123090] Updated weights for policy 1, policy_version 346712 (0.0008) [2023-12-26 02:22:09,711][123091] Updated weights for policy 0, policy_version 348793 (0.0010) [2023-12-26 02:22:09,768][123091] Updated weights for policy 0, policy_version 348803 (0.0010) [2023-12-26 02:22:09,835][123091] Updated weights for policy 0, policy_version 348813 (0.0009) [2023-12-26 02:22:10,217][123090] Updated weights for policy 1, policy_version 346722 (0.0007) [2023-12-26 02:22:10,283][123090] Updated weights for policy 1, policy_version 346732 (0.0010) [2023-12-26 02:22:10,345][123090] Updated weights for policy 1, policy_version 346742 (0.0009) [2023-12-26 02:22:10,403][123090] Updated weights for policy 1, policy_version 346752 (0.0010) [2023-12-26 02:22:10,726][123091] Updated weights for policy 0, policy_version 348824 (0.0010) [2023-12-26 02:22:10,789][123091] Updated weights for policy 0, policy_version 348834 (0.0007) [2023-12-26 02:22:10,856][123091] Updated weights for policy 0, policy_version 348844 (0.0010) [2023-12-26 02:22:11,079][123090] Updated weights for policy 1, policy_version 346762 (0.0007) [2023-12-26 02:22:11,153][123090] Updated weights for policy 1, policy_version 346772 (0.0009) [2023-12-26 02:22:11,208][123090] Updated weights for policy 1, policy_version 346782 (0.0010) [2023-12-26 02:22:11,630][123091] Updated weights for policy 0, policy_version 348854 (0.0009) [2023-12-26 02:22:11,711][123091] Updated weights for policy 0, policy_version 348864 (0.0008) [2023-12-26 02:22:11,783][123091] Updated weights for policy 0, policy_version 348874 (0.0008) [2023-12-26 02:22:11,986][123090] Updated weights for policy 1, policy_version 346792 (0.0005) [2023-12-26 02:22:12,060][123090] Updated weights for policy 1, policy_version 346802 (0.0005) [2023-12-26 02:22:12,131][123090] Updated weights for policy 1, policy_version 346812 (0.0007) [2023-12-26 02:22:12,624][123091] Updated weights for policy 0, policy_version 348884 (0.0007) [2023-12-26 02:22:12,682][123091] Updated weights for policy 0, policy_version 348894 (0.0006) [2023-12-26 02:22:12,746][123091] Updated weights for policy 0, policy_version 348904 (0.0006) [2023-12-26 02:22:12,854][123090] Updated weights for policy 1, policy_version 346822 (0.0008) [2023-12-26 02:22:12,907][123090] Updated weights for policy 1, policy_version 346832 (0.0010) [2023-12-26 02:22:12,956][123090] Updated weights for policy 1, policy_version 346842 (0.0009) [2023-12-26 02:22:13,531][123091] Updated weights for policy 0, policy_version 348914 (0.0008) [2023-12-26 02:22:13,592][123091] Updated weights for policy 0, policy_version 348924 (0.0010) [2023-12-26 02:22:13,661][123091] Updated weights for policy 0, policy_version 348934 (0.0010) [2023-12-26 02:22:13,730][123091] Updated weights for policy 0, policy_version 348944 (0.0009) [2023-12-26 02:22:13,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18022.4, 300 sec: 17494.8). Total num frames: 178126848. Throughput: 0: 9133.0, 1: 8976.6. Samples: 178121072. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:13,785][121949] Avg episode reward: [(0, '6465.101'), (1, '5828.420')] [2023-12-26 02:22:13,795][123090] Updated weights for policy 1, policy_version 346852 (0.0009) [2023-12-26 02:22:13,843][123090] Updated weights for policy 1, policy_version 346862 (0.0009) [2023-12-26 02:22:13,895][123090] Updated weights for policy 1, policy_version 346872 (0.0009) [2023-12-26 02:22:14,550][123091] Updated weights for policy 0, policy_version 348954 (0.0010) [2023-12-26 02:22:14,599][123091] Updated weights for policy 0, policy_version 348964 (0.0009) [2023-12-26 02:22:14,649][123091] Updated weights for policy 0, policy_version 348974 (0.0009) [2023-12-26 02:22:14,735][123090] Updated weights for policy 1, policy_version 346882 (0.0009) [2023-12-26 02:22:14,805][123090] Updated weights for policy 1, policy_version 346892 (0.0009) [2023-12-26 02:22:14,876][123090] Updated weights for policy 1, policy_version 346902 (0.0010) [2023-12-26 02:22:14,943][123090] Updated weights for policy 1, policy_version 346912 (0.0010) [2023-12-26 02:22:15,500][123091] Updated weights for policy 0, policy_version 348984 (0.0006) [2023-12-26 02:22:15,567][123091] Updated weights for policy 0, policy_version 348994 (0.0009) [2023-12-26 02:22:15,634][123091] Updated weights for policy 0, policy_version 349004 (0.0009) [2023-12-26 02:22:15,793][123090] Updated weights for policy 1, policy_version 346922 (0.0009) [2023-12-26 02:22:15,849][123090] Updated weights for policy 1, policy_version 346932 (0.0008) [2023-12-26 02:22:15,912][123090] Updated weights for policy 1, policy_version 346942 (0.0008) [2023-12-26 02:22:16,437][123091] Updated weights for policy 0, policy_version 349014 (0.0009) [2023-12-26 02:22:16,491][123091] Updated weights for policy 0, policy_version 349024 (0.0010) [2023-12-26 02:22:16,544][123091] Updated weights for policy 0, policy_version 349034 (0.0009) [2023-12-26 02:22:16,701][123090] Updated weights for policy 1, policy_version 346952 (0.0009) [2023-12-26 02:22:16,749][123090] Updated weights for policy 1, policy_version 346962 (0.0009) [2023-12-26 02:22:16,804][123090] Updated weights for policy 1, policy_version 346973 (0.0009) [2023-12-26 02:22:17,350][123091] Updated weights for policy 0, policy_version 349044 (0.0010) [2023-12-26 02:22:17,401][123091] Updated weights for policy 0, policy_version 349054 (0.0010) [2023-12-26 02:22:17,452][123091] Updated weights for policy 0, policy_version 349064 (0.0010) [2023-12-26 02:22:17,511][123090] Updated weights for policy 1, policy_version 346983 (0.0006) [2023-12-26 02:22:17,565][123090] Updated weights for policy 1, policy_version 346993 (0.0005) [2023-12-26 02:22:17,616][123090] Updated weights for policy 1, policy_version 347003 (0.0005) [2023-12-26 02:22:18,291][123091] Updated weights for policy 0, policy_version 349074 (0.0010) [2023-12-26 02:22:18,357][123091] Updated weights for policy 0, policy_version 349084 (0.0011) [2023-12-26 02:22:18,424][123091] Updated weights for policy 0, policy_version 349094 (0.0011) [2023-12-26 02:22:18,425][123090] Updated weights for policy 1, policy_version 347013 (0.0008) [2023-12-26 02:22:18,486][123090] Updated weights for policy 1, policy_version 347023 (0.0006) [2023-12-26 02:22:18,487][123091] Updated weights for policy 0, policy_version 349104 (0.0011) [2023-12-26 02:22:18,538][123090] Updated weights for policy 1, policy_version 347033 (0.0009) [2023-12-26 02:22:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17522.6). Total num frames: 178216960. Throughput: 0: 9067.3, 1: 8964.3. Samples: 178226004. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:18,785][121949] Avg episode reward: [(0, '6376.208'), (1, '5748.152')] [2023-12-26 02:22:19,320][123091] Updated weights for policy 0, policy_version 349114 (0.0011) [2023-12-26 02:22:19,382][123090] Updated weights for policy 1, policy_version 347043 (0.0009) [2023-12-26 02:22:19,389][123091] Updated weights for policy 0, policy_version 349124 (0.0011) [2023-12-26 02:22:19,443][123090] Updated weights for policy 1, policy_version 347053 (0.0006) [2023-12-26 02:22:19,453][123091] Updated weights for policy 0, policy_version 349134 (0.0010) [2023-12-26 02:22:19,520][123090] Updated weights for policy 1, policy_version 347063 (0.0007) [2023-12-26 02:22:20,228][123091] Updated weights for policy 0, policy_version 349144 (0.0010) [2023-12-26 02:22:20,301][123091] Updated weights for policy 0, policy_version 349154 (0.0009) [2023-12-26 02:22:20,311][123090] Updated weights for policy 1, policy_version 347073 (0.0007) [2023-12-26 02:22:20,373][123091] Updated weights for policy 0, policy_version 349164 (0.0006) [2023-12-26 02:22:20,383][123090] Updated weights for policy 1, policy_version 347083 (0.0007) [2023-12-26 02:22:20,443][123090] Updated weights for policy 1, policy_version 347093 (0.0009) [2023-12-26 02:22:20,503][123090] Updated weights for policy 1, policy_version 347103 (0.0009) [2023-12-26 02:22:21,153][123091] Updated weights for policy 0, policy_version 349174 (0.0008) [2023-12-26 02:22:21,225][123091] Updated weights for policy 0, policy_version 349184 (0.0006) [2023-12-26 02:22:21,297][123091] Updated weights for policy 0, policy_version 349194 (0.0008) [2023-12-26 02:22:21,344][123090] Updated weights for policy 1, policy_version 347113 (0.0007) [2023-12-26 02:22:21,423][123090] Updated weights for policy 1, policy_version 347123 (0.0007) [2023-12-26 02:22:21,494][123090] Updated weights for policy 1, policy_version 347133 (0.0006) [2023-12-26 02:22:22,006][123091] Updated weights for policy 0, policy_version 349204 (0.0007) [2023-12-26 02:22:22,068][123091] Updated weights for policy 0, policy_version 349214 (0.0010) [2023-12-26 02:22:22,137][123091] Updated weights for policy 0, policy_version 349224 (0.0010) [2023-12-26 02:22:22,209][123090] Updated weights for policy 1, policy_version 347143 (0.0009) [2023-12-26 02:22:22,275][123090] Updated weights for policy 1, policy_version 347153 (0.0010) [2023-12-26 02:22:22,336][123090] Updated weights for policy 1, policy_version 347163 (0.0010) [2023-12-26 02:22:22,969][123091] Updated weights for policy 0, policy_version 349234 (0.0010) [2023-12-26 02:22:23,026][123091] Updated weights for policy 0, policy_version 349244 (0.0009) [2023-12-26 02:22:23,084][123091] Updated weights for policy 0, policy_version 349254 (0.0006) [2023-12-26 02:22:23,154][123091] Updated weights for policy 0, policy_version 349264 (0.0008) [2023-12-26 02:22:23,198][123090] Updated weights for policy 1, policy_version 347173 (0.0010) [2023-12-26 02:22:23,256][123090] Updated weights for policy 1, policy_version 347183 (0.0009) [2023-12-26 02:22:23,320][123090] Updated weights for policy 1, policy_version 347193 (0.0010) [2023-12-26 02:22:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.5, 300 sec: 17467.0). Total num frames: 178298880. Throughput: 0: 9016.3, 1: 8970.4. Samples: 178277972. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:23,784][121949] Avg episode reward: [(0, '6360.531'), (1, '5656.659')] [2023-12-26 02:22:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000349264_89415680.pth... [2023-12-26 02:22:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000347200_88883200.pth... [2023-12-26 02:22:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000346144_88612864.pth [2023-12-26 02:22:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000348240_89153536.pth [2023-12-26 02:22:23,922][123091] Updated weights for policy 0, policy_version 349274 (0.0009) [2023-12-26 02:22:23,974][123091] Updated weights for policy 0, policy_version 349284 (0.0009) [2023-12-26 02:22:24,022][123091] Updated weights for policy 0, policy_version 349294 (0.0009) [2023-12-26 02:22:24,134][123090] Updated weights for policy 1, policy_version 347203 (0.0010) [2023-12-26 02:22:24,197][123090] Updated weights for policy 1, policy_version 347213 (0.0010) [2023-12-26 02:22:24,247][123090] Updated weights for policy 1, policy_version 347223 (0.0010) [2023-12-26 02:22:24,874][123091] Updated weights for policy 0, policy_version 349304 (0.0009) [2023-12-26 02:22:24,925][123091] Updated weights for policy 0, policy_version 349314 (0.0010) [2023-12-26 02:22:24,995][123091] Updated weights for policy 0, policy_version 349324 (0.0006) [2023-12-26 02:22:25,065][123090] Updated weights for policy 1, policy_version 347233 (0.0009) [2023-12-26 02:22:25,131][123090] Updated weights for policy 1, policy_version 347243 (0.0009) [2023-12-26 02:22:25,189][123090] Updated weights for policy 1, policy_version 347253 (0.0009) [2023-12-26 02:22:25,238][123090] Updated weights for policy 1, policy_version 347263 (0.0008) [2023-12-26 02:22:25,827][123091] Updated weights for policy 0, policy_version 349334 (0.0011) [2023-12-26 02:22:25,901][123091] Updated weights for policy 0, policy_version 349344 (0.0009) [2023-12-26 02:22:25,978][123091] Updated weights for policy 0, policy_version 349354 (0.0005) [2023-12-26 02:22:26,041][123090] Updated weights for policy 1, policy_version 347273 (0.0006) [2023-12-26 02:22:26,099][123090] Updated weights for policy 1, policy_version 347283 (0.0005) [2023-12-26 02:22:26,158][123090] Updated weights for policy 1, policy_version 347293 (0.0005) [2023-12-26 02:22:26,706][123091] Updated weights for policy 0, policy_version 349364 (0.0005) [2023-12-26 02:22:26,775][123091] Updated weights for policy 0, policy_version 349374 (0.0006) [2023-12-26 02:22:26,842][123091] Updated weights for policy 0, policy_version 349384 (0.0007) [2023-12-26 02:22:26,924][123090] Updated weights for policy 1, policy_version 347303 (0.0009) [2023-12-26 02:22:26,990][123090] Updated weights for policy 1, policy_version 347313 (0.0010) [2023-12-26 02:22:27,037][123090] Updated weights for policy 1, policy_version 347323 (0.0010) [2023-12-26 02:22:27,528][123091] Updated weights for policy 0, policy_version 349394 (0.0007) [2023-12-26 02:22:27,574][123091] Updated weights for policy 0, policy_version 349404 (0.0010) [2023-12-26 02:22:27,621][123091] Updated weights for policy 0, policy_version 349414 (0.0010) [2023-12-26 02:22:27,672][123091] Updated weights for policy 0, policy_version 349424 (0.0008) [2023-12-26 02:22:27,737][123090] Updated weights for policy 1, policy_version 347333 (0.0008) [2023-12-26 02:22:27,789][123090] Updated weights for policy 1, policy_version 347343 (0.0005) [2023-12-26 02:22:27,853][123090] Updated weights for policy 1, policy_version 347353 (0.0005) [2023-12-26 02:22:28,389][123091] Updated weights for policy 0, policy_version 349434 (0.0011) [2023-12-26 02:22:28,455][123091] Updated weights for policy 0, policy_version 349444 (0.0011) [2023-12-26 02:22:28,519][123091] Updated weights for policy 0, policy_version 349454 (0.0010) [2023-12-26 02:22:28,621][123090] Updated weights for policy 1, policy_version 347363 (0.0007) [2023-12-26 02:22:28,681][123090] Updated weights for policy 1, policy_version 347373 (0.0009) [2023-12-26 02:22:28,740][123090] Updated weights for policy 1, policy_version 347383 (0.0006) [2023-12-26 02:22:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17494.8). Total num frames: 178388992. Throughput: 0: 8996.4, 1: 9027.0. Samples: 178383916. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:28,785][121949] Avg episode reward: [(0, '6407.245'), (1, '5738.101')] [2023-12-26 02:22:29,357][123091] Updated weights for policy 0, policy_version 349464 (0.0010) [2023-12-26 02:22:29,416][123091] Updated weights for policy 0, policy_version 349474 (0.0010) [2023-12-26 02:22:29,454][123090] Updated weights for policy 1, policy_version 347393 (0.0008) [2023-12-26 02:22:29,468][123091] Updated weights for policy 0, policy_version 349484 (0.0010) [2023-12-26 02:22:29,514][123090] Updated weights for policy 1, policy_version 347403 (0.0006) [2023-12-26 02:22:29,566][123090] Updated weights for policy 1, policy_version 347413 (0.0009) [2023-12-26 02:22:29,626][123090] Updated weights for policy 1, policy_version 347423 (0.0010) [2023-12-26 02:22:30,278][123091] Updated weights for policy 0, policy_version 349494 (0.0009) [2023-12-26 02:22:30,348][123091] Updated weights for policy 0, policy_version 349504 (0.0007) [2023-12-26 02:22:30,412][123091] Updated weights for policy 0, policy_version 349514 (0.0010) [2023-12-26 02:22:30,485][123090] Updated weights for policy 1, policy_version 347433 (0.0008) [2023-12-26 02:22:30,545][123090] Updated weights for policy 1, policy_version 347443 (0.0009) [2023-12-26 02:22:30,597][123090] Updated weights for policy 1, policy_version 347453 (0.0008) [2023-12-26 02:22:31,146][123091] Updated weights for policy 0, policy_version 349524 (0.0010) [2023-12-26 02:22:31,215][123091] Updated weights for policy 0, policy_version 349534 (0.0010) [2023-12-26 02:22:31,279][123091] Updated weights for policy 0, policy_version 349544 (0.0010) [2023-12-26 02:22:31,402][123090] Updated weights for policy 1, policy_version 347463 (0.0010) [2023-12-26 02:22:31,468][123090] Updated weights for policy 1, policy_version 347473 (0.0006) [2023-12-26 02:22:31,535][123090] Updated weights for policy 1, policy_version 347483 (0.0007) [2023-12-26 02:22:31,979][123091] Updated weights for policy 0, policy_version 349554 (0.0009) [2023-12-26 02:22:32,034][123091] Updated weights for policy 0, policy_version 349564 (0.0007) [2023-12-26 02:22:32,094][123091] Updated weights for policy 0, policy_version 349574 (0.0010) [2023-12-26 02:22:32,159][123091] Updated weights for policy 0, policy_version 349584 (0.0010) [2023-12-26 02:22:32,225][123090] Updated weights for policy 1, policy_version 347493 (0.0006) [2023-12-26 02:22:32,293][123090] Updated weights for policy 1, policy_version 347503 (0.0005) [2023-12-26 02:22:32,364][123090] Updated weights for policy 1, policy_version 347513 (0.0007) [2023-12-26 02:22:32,975][123091] Updated weights for policy 0, policy_version 349594 (0.0010) [2023-12-26 02:22:33,033][123091] Updated weights for policy 0, policy_version 349604 (0.0010) [2023-12-26 02:22:33,084][123091] Updated weights for policy 0, policy_version 349614 (0.0010) [2023-12-26 02:22:33,102][123090] Updated weights for policy 1, policy_version 347523 (0.0009) [2023-12-26 02:22:33,162][123090] Updated weights for policy 1, policy_version 347533 (0.0008) [2023-12-26 02:22:33,220][123090] Updated weights for policy 1, policy_version 347543 (0.0008) [2023-12-26 02:22:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17494.8). Total num frames: 178479104. Throughput: 0: 8990.4, 1: 9003.2. Samples: 178492820. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:33,785][121949] Avg episode reward: [(0, '6432.790'), (1, '5762.454')] [2023-12-26 02:22:33,939][123091] Updated weights for policy 0, policy_version 349624 (0.0010) [2023-12-26 02:22:33,984][123090] Updated weights for policy 1, policy_version 347553 (0.0008) [2023-12-26 02:22:33,988][123091] Updated weights for policy 0, policy_version 349635 (0.0010) [2023-12-26 02:22:34,032][123091] Updated weights for policy 0, policy_version 349645 (0.0009) [2023-12-26 02:22:34,043][123090] Updated weights for policy 1, policy_version 347564 (0.0008) [2023-12-26 02:22:34,089][123090] Updated weights for policy 1, policy_version 347574 (0.0008) [2023-12-26 02:22:34,153][123090] Updated weights for policy 1, policy_version 347584 (0.0008) [2023-12-26 02:22:34,796][123091] Updated weights for policy 0, policy_version 349655 (0.0006) [2023-12-26 02:22:34,854][123091] Updated weights for policy 0, policy_version 349665 (0.0005) [2023-12-26 02:22:34,908][123091] Updated weights for policy 0, policy_version 349675 (0.0006) [2023-12-26 02:22:35,068][123090] Updated weights for policy 1, policy_version 347594 (0.0008) [2023-12-26 02:22:35,136][123090] Updated weights for policy 1, policy_version 347604 (0.0009) [2023-12-26 02:22:35,198][123090] Updated weights for policy 1, policy_version 347614 (0.0009) [2023-12-26 02:22:35,614][123091] Updated weights for policy 0, policy_version 349685 (0.0005) [2023-12-26 02:22:35,662][123091] Updated weights for policy 0, policy_version 349695 (0.0005) [2023-12-26 02:22:35,706][123091] Updated weights for policy 0, policy_version 349705 (0.0005) [2023-12-26 02:22:36,088][123090] Updated weights for policy 1, policy_version 347624 (0.0009) [2023-12-26 02:22:36,167][123090] Updated weights for policy 1, policy_version 347634 (0.0008) [2023-12-26 02:22:36,239][123090] Updated weights for policy 1, policy_version 347644 (0.0010) [2023-12-26 02:22:36,417][123091] Updated weights for policy 0, policy_version 349715 (0.0006) [2023-12-26 02:22:36,492][123091] Updated weights for policy 0, policy_version 349725 (0.0009) [2023-12-26 02:22:36,550][123091] Updated weights for policy 0, policy_version 349735 (0.0009) [2023-12-26 02:22:37,054][123090] Updated weights for policy 1, policy_version 347654 (0.0009) [2023-12-26 02:22:37,121][123090] Updated weights for policy 1, policy_version 347664 (0.0010) [2023-12-26 02:22:37,192][123090] Updated weights for policy 1, policy_version 347674 (0.0008) [2023-12-26 02:22:37,367][123091] Updated weights for policy 0, policy_version 349745 (0.0008) [2023-12-26 02:22:37,425][123091] Updated weights for policy 0, policy_version 349755 (0.0005) [2023-12-26 02:22:37,493][123091] Updated weights for policy 0, policy_version 349765 (0.0005) [2023-12-26 02:22:37,548][123091] Updated weights for policy 0, policy_version 349775 (0.0005) [2023-12-26 02:22:37,868][123090] Updated weights for policy 1, policy_version 347684 (0.0005) [2023-12-26 02:22:37,915][123090] Updated weights for policy 1, policy_version 347694 (0.0005) [2023-12-26 02:22:37,970][123090] Updated weights for policy 1, policy_version 347704 (0.0005) [2023-12-26 02:22:38,267][123091] Updated weights for policy 0, policy_version 349785 (0.0005) [2023-12-26 02:22:38,328][123091] Updated weights for policy 0, policy_version 349795 (0.0006) [2023-12-26 02:22:38,396][123091] Updated weights for policy 0, policy_version 349805 (0.0008) [2023-12-26 02:22:38,670][123090] Updated weights for policy 1, policy_version 347714 (0.0006) [2023-12-26 02:22:38,734][123090] Updated weights for policy 1, policy_version 347724 (0.0010) [2023-12-26 02:22:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17522.5). Total num frames: 178569216. Throughput: 0: 9032.5, 1: 8989.4. Samples: 178546584. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:38,785][121949] Avg episode reward: [(0, '6396.588'), (1, '5703.168')] [2023-12-26 02:22:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000349808_89554944.pth... [2023-12-26 02:22:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000348784_89292800.pth [2023-12-26 02:22:38,807][123090] Updated weights for policy 1, policy_version 347734 (0.0011) [2023-12-26 02:22:38,874][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000347744_89022464.pth... [2023-12-26 02:22:38,876][123090] Updated weights for policy 1, policy_version 347744 (0.0012) [2023-12-26 02:22:38,878][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000346688_88752128.pth [2023-12-26 02:22:39,198][123091] Updated weights for policy 0, policy_version 349815 (0.0009) [2023-12-26 02:22:39,266][123091] Updated weights for policy 0, policy_version 349825 (0.0009) [2023-12-26 02:22:39,328][123091] Updated weights for policy 0, policy_version 349835 (0.0010) [2023-12-26 02:22:39,685][123090] Updated weights for policy 1, policy_version 347754 (0.0009) [2023-12-26 02:22:39,739][123090] Updated weights for policy 1, policy_version 347764 (0.0009) [2023-12-26 02:22:39,800][123090] Updated weights for policy 1, policy_version 347774 (0.0009) [2023-12-26 02:22:40,150][123091] Updated weights for policy 0, policy_version 349845 (0.0010) [2023-12-26 02:22:40,206][123091] Updated weights for policy 0, policy_version 349855 (0.0011) [2023-12-26 02:22:40,265][123091] Updated weights for policy 0, policy_version 349865 (0.0010) [2023-12-26 02:22:40,608][123090] Updated weights for policy 1, policy_version 347784 (0.0010) [2023-12-26 02:22:40,664][123090] Updated weights for policy 1, policy_version 347794 (0.0011) [2023-12-26 02:22:40,716][123090] Updated weights for policy 1, policy_version 347804 (0.0011) [2023-12-26 02:22:41,049][123091] Updated weights for policy 0, policy_version 349875 (0.0007) [2023-12-26 02:22:41,117][123091] Updated weights for policy 0, policy_version 349885 (0.0011) [2023-12-26 02:22:41,185][123091] Updated weights for policy 0, policy_version 349895 (0.0011) [2023-12-26 02:22:41,607][123090] Updated weights for policy 1, policy_version 347814 (0.0011) [2023-12-26 02:22:41,674][123090] Updated weights for policy 1, policy_version 347824 (0.0011) [2023-12-26 02:22:41,747][123090] Updated weights for policy 1, policy_version 347834 (0.0010) [2023-12-26 02:22:42,035][123091] Updated weights for policy 0, policy_version 349905 (0.0011) [2023-12-26 02:22:42,104][123091] Updated weights for policy 0, policy_version 349915 (0.0008) [2023-12-26 02:22:42,177][123091] Updated weights for policy 0, policy_version 349925 (0.0006) [2023-12-26 02:22:42,246][123091] Updated weights for policy 0, policy_version 349935 (0.0008) [2023-12-26 02:22:42,537][123090] Updated weights for policy 1, policy_version 347844 (0.0008) [2023-12-26 02:22:42,609][123090] Updated weights for policy 1, policy_version 347854 (0.0010) [2023-12-26 02:22:42,666][123090] Updated weights for policy 1, policy_version 347864 (0.0010) [2023-12-26 02:22:42,898][123091] Updated weights for policy 0, policy_version 349945 (0.0011) [2023-12-26 02:22:42,956][123091] Updated weights for policy 0, policy_version 349955 (0.0010) [2023-12-26 02:22:43,025][123091] Updated weights for policy 0, policy_version 349965 (0.0010) [2023-12-26 02:22:43,435][123090] Updated weights for policy 1, policy_version 347874 (0.0008) [2023-12-26 02:22:43,500][123090] Updated weights for policy 1, policy_version 347884 (0.0006) [2023-12-26 02:22:43,560][123090] Updated weights for policy 1, policy_version 347894 (0.0010) [2023-12-26 02:22:43,613][123090] Updated weights for policy 1, policy_version 347904 (0.0010) [2023-12-26 02:22:43,762][123091] Updated weights for policy 0, policy_version 349975 (0.0007) [2023-12-26 02:22:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17522.5). Total num frames: 178659328. Throughput: 0: 8978.0, 1: 8947.9. Samples: 178653644. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 02:22:43,785][121949] Avg episode reward: [(0, '6372.925'), (1, '5869.250')] [2023-12-26 02:22:43,828][123091] Updated weights for policy 0, policy_version 349985 (0.0005) [2023-12-26 02:22:43,905][123091] Updated weights for policy 0, policy_version 349995 (0.0010) [2023-12-26 02:22:44,326][123090] Updated weights for policy 1, policy_version 347914 (0.0007) [2023-12-26 02:22:44,390][123090] Updated weights for policy 1, policy_version 347924 (0.0010) [2023-12-26 02:22:44,445][123090] Updated weights for policy 1, policy_version 347934 (0.0010) [2023-12-26 02:22:44,667][123091] Updated weights for policy 0, policy_version 350005 (0.0010) [2023-12-26 02:22:44,722][123091] Updated weights for policy 0, policy_version 350015 (0.0006) [2023-12-26 02:22:44,781][123091] Updated weights for policy 0, policy_version 350025 (0.0008) [2023-12-26 02:22:45,299][123090] Updated weights for policy 1, policy_version 347944 (0.0007) [2023-12-26 02:22:45,368][123090] Updated weights for policy 1, policy_version 347954 (0.0008) [2023-12-26 02:22:45,428][123090] Updated weights for policy 1, policy_version 347964 (0.0008) [2023-12-26 02:22:45,550][123091] Updated weights for policy 0, policy_version 350035 (0.0011) [2023-12-26 02:22:45,603][123091] Updated weights for policy 0, policy_version 350045 (0.0010) [2023-12-26 02:22:45,654][123091] Updated weights for policy 0, policy_version 350055 (0.0010) [2023-12-26 02:22:46,177][123090] Updated weights for policy 1, policy_version 347974 (0.0007) [2023-12-26 02:22:46,246][123090] Updated weights for policy 1, policy_version 347984 (0.0006) [2023-12-26 02:22:46,301][123090] Updated weights for policy 1, policy_version 347994 (0.0005) [2023-12-26 02:22:46,407][123091] Updated weights for policy 0, policy_version 350065 (0.0010) [2023-12-26 02:22:46,469][123091] Updated weights for policy 0, policy_version 350075 (0.0006) [2023-12-26 02:22:46,528][123091] Updated weights for policy 0, policy_version 350085 (0.0006) [2023-12-26 02:22:46,603][123091] Updated weights for policy 0, policy_version 350095 (0.0006) [2023-12-26 02:22:46,963][123090] Updated weights for policy 1, policy_version 348004 (0.0006) [2023-12-26 02:22:47,019][123090] Updated weights for policy 1, policy_version 348014 (0.0008) [2023-12-26 02:22:47,080][123090] Updated weights for policy 1, policy_version 348024 (0.0010) [2023-12-26 02:22:47,301][123091] Updated weights for policy 0, policy_version 350105 (0.0005) [2023-12-26 02:22:47,355][123091] Updated weights for policy 0, policy_version 350115 (0.0005) [2023-12-26 02:22:47,402][123091] Updated weights for policy 0, policy_version 350125 (0.0005) [2023-12-26 02:22:47,992][123090] Updated weights for policy 1, policy_version 348034 (0.0010) [2023-12-26 02:22:48,057][123090] Updated weights for policy 1, policy_version 348044 (0.0009) [2023-12-26 02:22:48,074][123091] Updated weights for policy 0, policy_version 350135 (0.0005) [2023-12-26 02:22:48,119][123090] Updated weights for policy 1, policy_version 348054 (0.0010) [2023-12-26 02:22:48,129][123091] Updated weights for policy 0, policy_version 350145 (0.0009) [2023-12-26 02:22:48,183][123090] Updated weights for policy 1, policy_version 348064 (0.0006) [2023-12-26 02:22:48,187][123091] Updated weights for policy 0, policy_version 350155 (0.0010) [2023-12-26 02:22:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17494.8). Total num frames: 178749440. Throughput: 0: 9010.8, 1: 8969.2. Samples: 178765232. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:22:48,785][121949] Avg episode reward: [(0, '6372.049'), (1, '5927.282')] [2023-12-26 02:22:48,808][123091] Updated weights for policy 0, policy_version 350165 (0.0008) [2023-12-26 02:22:48,869][123091] Updated weights for policy 0, policy_version 350175 (0.0007) [2023-12-26 02:22:48,933][123091] Updated weights for policy 0, policy_version 350185 (0.0005) [2023-12-26 02:22:49,015][123090] Updated weights for policy 1, policy_version 348074 (0.0005) [2023-12-26 02:22:49,072][123090] Updated weights for policy 1, policy_version 348084 (0.0006) [2023-12-26 02:22:49,136][123090] Updated weights for policy 1, policy_version 348094 (0.0007) [2023-12-26 02:22:49,687][123091] Updated weights for policy 0, policy_version 350195 (0.0006) [2023-12-26 02:22:49,751][123091] Updated weights for policy 0, policy_version 350205 (0.0005) [2023-12-26 02:22:49,825][123091] Updated weights for policy 0, policy_version 350215 (0.0006) [2023-12-26 02:22:49,950][123090] Updated weights for policy 1, policy_version 348104 (0.0009) [2023-12-26 02:22:50,009][123090] Updated weights for policy 1, policy_version 348114 (0.0010) [2023-12-26 02:22:50,063][123090] Updated weights for policy 1, policy_version 348124 (0.0010) [2023-12-26 02:22:50,516][123091] Updated weights for policy 0, policy_version 350225 (0.0007) [2023-12-26 02:22:50,579][123091] Updated weights for policy 0, policy_version 350235 (0.0007) [2023-12-26 02:22:50,644][123091] Updated weights for policy 0, policy_version 350245 (0.0006) [2023-12-26 02:22:50,718][123091] Updated weights for policy 0, policy_version 350255 (0.0010) [2023-12-26 02:22:50,918][123090] Updated weights for policy 1, policy_version 348134 (0.0008) [2023-12-26 02:22:50,973][123090] Updated weights for policy 1, policy_version 348144 (0.0006) [2023-12-26 02:22:51,026][123090] Updated weights for policy 1, policy_version 348154 (0.0006) [2023-12-26 02:22:51,460][123091] Updated weights for policy 0, policy_version 350265 (0.0006) [2023-12-26 02:22:51,533][123091] Updated weights for policy 0, policy_version 350275 (0.0009) [2023-12-26 02:22:51,590][123091] Updated weights for policy 0, policy_version 350285 (0.0009) [2023-12-26 02:22:51,802][123090] Updated weights for policy 1, policy_version 348164 (0.0008) [2023-12-26 02:22:51,862][123090] Updated weights for policy 1, policy_version 348174 (0.0008) [2023-12-26 02:22:51,927][123090] Updated weights for policy 1, policy_version 348184 (0.0008) [2023-12-26 02:22:52,449][123091] Updated weights for policy 0, policy_version 350295 (0.0010) [2023-12-26 02:22:52,510][123091] Updated weights for policy 0, policy_version 350305 (0.0010) [2023-12-26 02:22:52,573][123091] Updated weights for policy 0, policy_version 350315 (0.0010) [2023-12-26 02:22:52,742][123090] Updated weights for policy 1, policy_version 348194 (0.0010) [2023-12-26 02:22:52,792][123090] Updated weights for policy 1, policy_version 348204 (0.0009) [2023-12-26 02:22:52,844][123090] Updated weights for policy 1, policy_version 348214 (0.0009) [2023-12-26 02:22:53,440][123091] Updated weights for policy 0, policy_version 350325 (0.0009) [2023-12-26 02:22:53,495][123091] Updated weights for policy 0, policy_version 350335 (0.0009) [2023-12-26 02:22:53,561][123091] Updated weights for policy 0, policy_version 350345 (0.0009) [2023-12-26 02:22:53,589][123090] Updated weights for policy 1, policy_version 348225 (0.0010) [2023-12-26 02:22:53,655][123090] Updated weights for policy 1, policy_version 348235 (0.0005) [2023-12-26 02:22:53,715][123090] Updated weights for policy 1, policy_version 348245 (0.0008) [2023-12-26 02:22:53,761][123090] Updated weights for policy 1, policy_version 348255 (0.0008) [2023-12-26 02:22:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17550.3). Total num frames: 178847744. Throughput: 0: 8998.8, 1: 8891.3. Samples: 178819552. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:22:53,785][121949] Avg episode reward: [(0, '6378.956'), (1, '5954.053')] [2023-12-26 02:22:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000350352_89694208.pth... [2023-12-26 02:22:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000348256_89153536.pth... [2023-12-26 02:22:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000349264_89415680.pth [2023-12-26 02:22:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000347200_88883200.pth [2023-12-26 02:22:54,393][123091] Updated weights for policy 0, policy_version 350356 (0.0010) [2023-12-26 02:22:54,447][123091] Updated weights for policy 0, policy_version 350366 (0.0009) [2023-12-26 02:22:54,516][123091] Updated weights for policy 0, policy_version 350376 (0.0009) [2023-12-26 02:22:54,571][123090] Updated weights for policy 1, policy_version 348265 (0.0008) [2023-12-26 02:22:54,624][123090] Updated weights for policy 1, policy_version 348275 (0.0005) [2023-12-26 02:22:54,683][123090] Updated weights for policy 1, policy_version 348286 (0.0009) [2023-12-26 02:22:55,306][123091] Updated weights for policy 0, policy_version 350386 (0.0009) [2023-12-26 02:22:55,348][123090] Updated weights for policy 1, policy_version 348296 (0.0009) [2023-12-26 02:22:55,372][123091] Updated weights for policy 0, policy_version 350396 (0.0011) [2023-12-26 02:22:55,393][123090] Updated weights for policy 1, policy_version 348306 (0.0008) [2023-12-26 02:22:55,438][123091] Updated weights for policy 0, policy_version 350406 (0.0011) [2023-12-26 02:22:55,446][123090] Updated weights for policy 1, policy_version 348316 (0.0008) [2023-12-26 02:22:55,502][123091] Updated weights for policy 0, policy_version 350416 (0.0010) [2023-12-26 02:22:56,300][123091] Updated weights for policy 0, policy_version 350426 (0.0011) [2023-12-26 02:22:56,312][123090] Updated weights for policy 1, policy_version 348326 (0.0007) [2023-12-26 02:22:56,369][123091] Updated weights for policy 0, policy_version 350436 (0.0009) [2023-12-26 02:22:56,375][123090] Updated weights for policy 1, policy_version 348336 (0.0008) [2023-12-26 02:22:56,432][123091] Updated weights for policy 0, policy_version 350446 (0.0007) [2023-12-26 02:22:56,438][123090] Updated weights for policy 1, policy_version 348346 (0.0010) [2023-12-26 02:22:57,112][123091] Updated weights for policy 0, policy_version 350456 (0.0009) [2023-12-26 02:22:57,171][123091] Updated weights for policy 0, policy_version 350466 (0.0010) [2023-12-26 02:22:57,231][123091] Updated weights for policy 0, policy_version 350476 (0.0011) [2023-12-26 02:22:57,329][123090] Updated weights for policy 1, policy_version 348356 (0.0010) [2023-12-26 02:22:57,382][123090] Updated weights for policy 1, policy_version 348366 (0.0009) [2023-12-26 02:22:57,430][123090] Updated weights for policy 1, policy_version 348376 (0.0009) [2023-12-26 02:22:58,017][123091] Updated weights for policy 0, policy_version 350486 (0.0008) [2023-12-26 02:22:58,080][123091] Updated weights for policy 0, policy_version 350496 (0.0009) [2023-12-26 02:22:58,138][123091] Updated weights for policy 0, policy_version 350506 (0.0009) [2023-12-26 02:22:58,301][123090] Updated weights for policy 1, policy_version 348386 (0.0009) [2023-12-26 02:22:58,377][123090] Updated weights for policy 1, policy_version 348396 (0.0008) [2023-12-26 02:22:58,451][123090] Updated weights for policy 1, policy_version 348406 (0.0007) [2023-12-26 02:22:58,522][123090] Updated weights for policy 1, policy_version 348416 (0.0008) [2023-12-26 02:22:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18023.1, 300 sec: 17494.8). Total num frames: 178929664. Throughput: 0: 9032.5, 1: 8836.5. Samples: 178925176. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:22:58,784][121949] Avg episode reward: [(0, '6365.773'), (1, '5929.693')] [2023-12-26 02:22:59,101][123091] Updated weights for policy 0, policy_version 350516 (0.0008) [2023-12-26 02:22:59,162][123091] Updated weights for policy 0, policy_version 350526 (0.0007) [2023-12-26 02:22:59,230][123091] Updated weights for policy 0, policy_version 350536 (0.0008) [2023-12-26 02:22:59,385][123090] Updated weights for policy 1, policy_version 348426 (0.0009) [2023-12-26 02:22:59,451][123090] Updated weights for policy 1, policy_version 348436 (0.0009) [2023-12-26 02:22:59,525][123090] Updated weights for policy 1, policy_version 348446 (0.0010) [2023-12-26 02:22:59,920][123091] Updated weights for policy 0, policy_version 350546 (0.0011) [2023-12-26 02:22:59,989][123091] Updated weights for policy 0, policy_version 350556 (0.0011) [2023-12-26 02:23:00,051][123091] Updated weights for policy 0, policy_version 350566 (0.0006) [2023-12-26 02:23:00,100][123091] Updated weights for policy 0, policy_version 350576 (0.0005) [2023-12-26 02:23:00,311][123090] Updated weights for policy 1, policy_version 348456 (0.0011) [2023-12-26 02:23:00,376][123090] Updated weights for policy 1, policy_version 348466 (0.0010) [2023-12-26 02:23:00,432][123090] Updated weights for policy 1, policy_version 348476 (0.0006) [2023-12-26 02:23:00,813][123091] Updated weights for policy 0, policy_version 350586 (0.0010) [2023-12-26 02:23:00,859][123091] Updated weights for policy 0, policy_version 350596 (0.0010) [2023-12-26 02:23:00,910][123091] Updated weights for policy 0, policy_version 350606 (0.0010) [2023-12-26 02:23:01,173][123090] Updated weights for policy 1, policy_version 348486 (0.0007) [2023-12-26 02:23:01,236][123090] Updated weights for policy 1, policy_version 348496 (0.0009) [2023-12-26 02:23:01,304][123090] Updated weights for policy 1, policy_version 348506 (0.0008) [2023-12-26 02:23:01,703][123091] Updated weights for policy 0, policy_version 350616 (0.0010) [2023-12-26 02:23:01,772][123091] Updated weights for policy 0, policy_version 350626 (0.0011) [2023-12-26 02:23:01,834][123091] Updated weights for policy 0, policy_version 350636 (0.0011) [2023-12-26 02:23:02,021][123090] Updated weights for policy 1, policy_version 348516 (0.0008) [2023-12-26 02:23:02,076][123090] Updated weights for policy 1, policy_version 348526 (0.0008) [2023-12-26 02:23:02,129][123090] Updated weights for policy 1, policy_version 348536 (0.0008) [2023-12-26 02:23:02,612][123091] Updated weights for policy 0, policy_version 350646 (0.0011) [2023-12-26 02:23:02,672][123091] Updated weights for policy 0, policy_version 350656 (0.0010) [2023-12-26 02:23:02,731][123091] Updated weights for policy 0, policy_version 350666 (0.0011) [2023-12-26 02:23:02,966][123090] Updated weights for policy 1, policy_version 348546 (0.0007) [2023-12-26 02:23:03,026][123090] Updated weights for policy 1, policy_version 348556 (0.0005) [2023-12-26 02:23:03,092][123090] Updated weights for policy 1, policy_version 348566 (0.0005) [2023-12-26 02:23:03,159][123090] Updated weights for policy 1, policy_version 348576 (0.0005) [2023-12-26 02:23:03,554][123091] Updated weights for policy 0, policy_version 350676 (0.0010) [2023-12-26 02:23:03,605][123091] Updated weights for policy 0, policy_version 350686 (0.0010) [2023-12-26 02:23:03,655][123091] Updated weights for policy 0, policy_version 350696 (0.0008) [2023-12-26 02:23:03,764][123090] Updated weights for policy 1, policy_version 348586 (0.0005) [2023-12-26 02:23:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17886.0, 300 sec: 17522.6). Total num frames: 179019776. Throughput: 0: 9049.2, 1: 8858.5. Samples: 179031848. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:03,785][121949] Avg episode reward: [(0, '6232.886'), (1, '5938.441')] [2023-12-26 02:23:03,824][123090] Updated weights for policy 1, policy_version 348596 (0.0005) [2023-12-26 02:23:03,895][123090] Updated weights for policy 1, policy_version 348606 (0.0008) [2023-12-26 02:23:04,479][123091] Updated weights for policy 0, policy_version 350706 (0.0006) [2023-12-26 02:23:04,545][123091] Updated weights for policy 0, policy_version 350716 (0.0011) [2023-12-26 02:23:04,592][123090] Updated weights for policy 1, policy_version 348616 (0.0006) [2023-12-26 02:23:04,607][123091] Updated weights for policy 0, policy_version 350726 (0.0010) [2023-12-26 02:23:04,641][123090] Updated weights for policy 1, policy_version 348626 (0.0006) [2023-12-26 02:23:04,669][123091] Updated weights for policy 0, policy_version 350736 (0.0010) [2023-12-26 02:23:04,694][123090] Updated weights for policy 1, policy_version 348636 (0.0007) [2023-12-26 02:23:05,404][123090] Updated weights for policy 1, policy_version 348646 (0.0007) [2023-12-26 02:23:05,421][123091] Updated weights for policy 0, policy_version 350746 (0.0008) [2023-12-26 02:23:05,475][123090] Updated weights for policy 1, policy_version 348656 (0.0008) [2023-12-26 02:23:05,486][123091] Updated weights for policy 0, policy_version 350756 (0.0006) [2023-12-26 02:23:05,541][123091] Updated weights for policy 0, policy_version 350766 (0.0005) [2023-12-26 02:23:05,543][123090] Updated weights for policy 1, policy_version 348667 (0.0009) [2023-12-26 02:23:06,163][123091] Updated weights for policy 0, policy_version 350776 (0.0006) [2023-12-26 02:23:06,216][123091] Updated weights for policy 0, policy_version 350786 (0.0007) [2023-12-26 02:23:06,280][123091] Updated weights for policy 0, policy_version 350796 (0.0010) [2023-12-26 02:23:06,340][123090] Updated weights for policy 1, policy_version 348677 (0.0006) [2023-12-26 02:23:06,400][123090] Updated weights for policy 1, policy_version 348687 (0.0009) [2023-12-26 02:23:06,471][123090] Updated weights for policy 1, policy_version 348697 (0.0006) [2023-12-26 02:23:06,945][123091] Updated weights for policy 0, policy_version 350806 (0.0008) [2023-12-26 02:23:07,005][123091] Updated weights for policy 0, policy_version 350816 (0.0008) [2023-12-26 02:23:07,066][123091] Updated weights for policy 0, policy_version 350826 (0.0010) [2023-12-26 02:23:07,169][123090] Updated weights for policy 1, policy_version 348707 (0.0007) [2023-12-26 02:23:07,229][123090] Updated weights for policy 1, policy_version 348717 (0.0008) [2023-12-26 02:23:07,294][123090] Updated weights for policy 1, policy_version 348727 (0.0007) [2023-12-26 02:23:07,894][123091] Updated weights for policy 0, policy_version 350836 (0.0011) [2023-12-26 02:23:07,948][123091] Updated weights for policy 0, policy_version 350846 (0.0010) [2023-12-26 02:23:08,007][123091] Updated weights for policy 0, policy_version 350856 (0.0010) [2023-12-26 02:23:08,085][123090] Updated weights for policy 1, policy_version 348737 (0.0006) [2023-12-26 02:23:08,148][123090] Updated weights for policy 1, policy_version 348747 (0.0006) [2023-12-26 02:23:08,213][123090] Updated weights for policy 1, policy_version 348757 (0.0005) [2023-12-26 02:23:08,285][123090] Updated weights for policy 1, policy_version 348767 (0.0007) [2023-12-26 02:23:08,739][123091] Updated weights for policy 0, policy_version 350866 (0.0009) [2023-12-26 02:23:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17550.3). Total num frames: 179109888. Throughput: 0: 9092.9, 1: 8917.0. Samples: 179088420. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:08,785][121949] Avg episode reward: [(0, '6094.033'), (1, '5953.753')] [2023-12-26 02:23:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000348768_89284608.pth... [2023-12-26 02:23:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000347744_89022464.pth [2023-12-26 02:23:08,797][123091] Updated weights for policy 0, policy_version 350876 (0.0006) [2023-12-26 02:23:08,857][123091] Updated weights for policy 0, policy_version 350886 (0.0008) [2023-12-26 02:23:08,909][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000350896_89833472.pth... [2023-12-26 02:23:08,911][123091] Updated weights for policy 0, policy_version 350896 (0.0009) [2023-12-26 02:23:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000349808_89554944.pth [2023-12-26 02:23:08,953][123090] Updated weights for policy 1, policy_version 348777 (0.0009) [2023-12-26 02:23:09,006][123090] Updated weights for policy 1, policy_version 348787 (0.0005) [2023-12-26 02:23:09,056][123090] Updated weights for policy 1, policy_version 348797 (0.0005) [2023-12-26 02:23:09,710][123091] Updated weights for policy 0, policy_version 350906 (0.0009) [2023-12-26 02:23:09,773][123091] Updated weights for policy 0, policy_version 350916 (0.0009) [2023-12-26 02:23:09,846][123091] Updated weights for policy 0, policy_version 350926 (0.0010) [2023-12-26 02:23:09,925][123090] Updated weights for policy 1, policy_version 348807 (0.0006) [2023-12-26 02:23:10,005][123090] Updated weights for policy 1, policy_version 348817 (0.0006) [2023-12-26 02:23:10,068][123090] Updated weights for policy 1, policy_version 348827 (0.0006) [2023-12-26 02:23:10,653][123091] Updated weights for policy 0, policy_version 350936 (0.0009) [2023-12-26 02:23:10,709][123091] Updated weights for policy 0, policy_version 350946 (0.0008) [2023-12-26 02:23:10,776][123091] Updated weights for policy 0, policy_version 350956 (0.0009) [2023-12-26 02:23:10,838][123090] Updated weights for policy 1, policy_version 348837 (0.0008) [2023-12-26 02:23:10,901][123090] Updated weights for policy 1, policy_version 348847 (0.0010) [2023-12-26 02:23:10,952][123090] Updated weights for policy 1, policy_version 348857 (0.0010) [2023-12-26 02:23:11,650][123091] Updated weights for policy 0, policy_version 350966 (0.0009) [2023-12-26 02:23:11,715][123091] Updated weights for policy 0, policy_version 350976 (0.0009) [2023-12-26 02:23:11,785][123091] Updated weights for policy 0, policy_version 350986 (0.0009) [2023-12-26 02:23:11,803][123090] Updated weights for policy 1, policy_version 348867 (0.0010) [2023-12-26 02:23:11,858][123090] Updated weights for policy 1, policy_version 348877 (0.0010) [2023-12-26 02:23:11,926][123090] Updated weights for policy 1, policy_version 348887 (0.0010) [2023-12-26 02:23:12,610][123091] Updated weights for policy 0, policy_version 350996 (0.0006) [2023-12-26 02:23:12,676][123091] Updated weights for policy 0, policy_version 351006 (0.0005) [2023-12-26 02:23:12,742][123091] Updated weights for policy 0, policy_version 351016 (0.0006) [2023-12-26 02:23:12,763][123090] Updated weights for policy 1, policy_version 348897 (0.0009) [2023-12-26 02:23:12,822][123090] Updated weights for policy 1, policy_version 348907 (0.0011) [2023-12-26 02:23:12,884][123090] Updated weights for policy 1, policy_version 348917 (0.0010) [2023-12-26 02:23:12,957][123090] Updated weights for policy 1, policy_version 348927 (0.0009) [2023-12-26 02:23:13,516][123091] Updated weights for policy 0, policy_version 351026 (0.0007) [2023-12-26 02:23:13,568][123091] Updated weights for policy 0, policy_version 351036 (0.0010) [2023-12-26 02:23:13,634][123091] Updated weights for policy 0, policy_version 351046 (0.0010) [2023-12-26 02:23:13,695][123091] Updated weights for policy 0, policy_version 351056 (0.0006) [2023-12-26 02:23:13,737][123090] Updated weights for policy 1, policy_version 348937 (0.0009) [2023-12-26 02:23:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17522.6). Total num frames: 179200000. Throughput: 0: 9091.5, 1: 8911.1. Samples: 179194032. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:13,784][121949] Avg episode reward: [(0, '6259.197'), (1, '5890.790')] [2023-12-26 02:23:13,797][123090] Updated weights for policy 1, policy_version 348947 (0.0010) [2023-12-26 02:23:13,855][123090] Updated weights for policy 1, policy_version 348957 (0.0010) [2023-12-26 02:23:14,354][123091] Updated weights for policy 0, policy_version 351066 (0.0005) [2023-12-26 02:23:14,408][123091] Updated weights for policy 0, policy_version 351076 (0.0007) [2023-12-26 02:23:14,468][123091] Updated weights for policy 0, policy_version 351086 (0.0006) [2023-12-26 02:23:14,600][123090] Updated weights for policy 1, policy_version 348967 (0.0010) [2023-12-26 02:23:14,657][123090] Updated weights for policy 1, policy_version 348977 (0.0010) [2023-12-26 02:23:14,721][123090] Updated weights for policy 1, policy_version 348987 (0.0009) [2023-12-26 02:23:15,238][123091] Updated weights for policy 0, policy_version 351096 (0.0009) [2023-12-26 02:23:15,312][123091] Updated weights for policy 0, policy_version 351106 (0.0010) [2023-12-26 02:23:15,374][123091] Updated weights for policy 0, policy_version 351117 (0.0009) [2023-12-26 02:23:15,605][123090] Updated weights for policy 1, policy_version 348997 (0.0009) [2023-12-26 02:23:15,664][123090] Updated weights for policy 1, policy_version 349007 (0.0010) [2023-12-26 02:23:15,723][123090] Updated weights for policy 1, policy_version 349017 (0.0009) [2023-12-26 02:23:16,082][123091] Updated weights for policy 0, policy_version 351127 (0.0006) [2023-12-26 02:23:16,138][123091] Updated weights for policy 0, policy_version 351137 (0.0005) [2023-12-26 02:23:16,203][123091] Updated weights for policy 0, policy_version 351147 (0.0005) [2023-12-26 02:23:16,574][123090] Updated weights for policy 1, policy_version 349027 (0.0008) [2023-12-26 02:23:16,646][123090] Updated weights for policy 1, policy_version 349037 (0.0006) [2023-12-26 02:23:16,718][123090] Updated weights for policy 1, policy_version 349047 (0.0005) [2023-12-26 02:23:16,899][123091] Updated weights for policy 0, policy_version 351157 (0.0005) [2023-12-26 02:23:16,957][123091] Updated weights for policy 0, policy_version 351167 (0.0006) [2023-12-26 02:23:17,017][123091] Updated weights for policy 0, policy_version 351177 (0.0010) [2023-12-26 02:23:17,378][123090] Updated weights for policy 1, policy_version 349057 (0.0006) [2023-12-26 02:23:17,434][123090] Updated weights for policy 1, policy_version 349067 (0.0008) [2023-12-26 02:23:17,480][123090] Updated weights for policy 1, policy_version 349077 (0.0009) [2023-12-26 02:23:17,540][123090] Updated weights for policy 1, policy_version 349087 (0.0009) [2023-12-26 02:23:17,830][123091] Updated weights for policy 0, policy_version 351187 (0.0010) [2023-12-26 02:23:17,886][123091] Updated weights for policy 0, policy_version 351197 (0.0009) [2023-12-26 02:23:17,939][123091] Updated weights for policy 0, policy_version 351207 (0.0009) [2023-12-26 02:23:18,393][123090] Updated weights for policy 1, policy_version 349097 (0.0009) [2023-12-26 02:23:18,449][123090] Updated weights for policy 1, policy_version 349107 (0.0008) [2023-12-26 02:23:18,514][123090] Updated weights for policy 1, policy_version 349117 (0.0009) [2023-12-26 02:23:18,770][123091] Updated weights for policy 0, policy_version 351217 (0.0009) [2023-12-26 02:23:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17550.3). Total num frames: 179290112. Throughput: 0: 9124.9, 1: 8869.4. Samples: 179302564. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:18,785][121949] Avg episode reward: [(0, '6394.453'), (1, '5868.442')] [2023-12-26 02:23:18,830][123091] Updated weights for policy 0, policy_version 351227 (0.0005) [2023-12-26 02:23:18,888][123091] Updated weights for policy 0, policy_version 351237 (0.0006) [2023-12-26 02:23:18,954][123091] Updated weights for policy 0, policy_version 351247 (0.0010) [2023-12-26 02:23:19,241][123090] Updated weights for policy 1, policy_version 349127 (0.0007) [2023-12-26 02:23:19,307][123090] Updated weights for policy 1, policy_version 349137 (0.0006) [2023-12-26 02:23:19,377][123090] Updated weights for policy 1, policy_version 349147 (0.0007) [2023-12-26 02:23:19,764][123091] Updated weights for policy 0, policy_version 351257 (0.0010) [2023-12-26 02:23:19,833][123091] Updated weights for policy 0, policy_version 351267 (0.0010) [2023-12-26 02:23:19,903][123091] Updated weights for policy 0, policy_version 351277 (0.0010) [2023-12-26 02:23:20,169][123090] Updated weights for policy 1, policy_version 349157 (0.0008) [2023-12-26 02:23:20,221][123090] Updated weights for policy 1, policy_version 349167 (0.0010) [2023-12-26 02:23:20,275][123090] Updated weights for policy 1, policy_version 349177 (0.0010) [2023-12-26 02:23:20,779][123091] Updated weights for policy 0, policy_version 351287 (0.0010) [2023-12-26 02:23:20,844][123091] Updated weights for policy 0, policy_version 351297 (0.0010) [2023-12-26 02:23:20,908][123091] Updated weights for policy 0, policy_version 351307 (0.0010) [2023-12-26 02:23:21,152][123090] Updated weights for policy 1, policy_version 349187 (0.0010) [2023-12-26 02:23:21,218][123090] Updated weights for policy 1, policy_version 349197 (0.0010) [2023-12-26 02:23:21,287][123090] Updated weights for policy 1, policy_version 349207 (0.0009) [2023-12-26 02:23:21,752][123091] Updated weights for policy 0, policy_version 351317 (0.0010) [2023-12-26 02:23:21,806][123091] Updated weights for policy 0, policy_version 351327 (0.0010) [2023-12-26 02:23:21,869][123091] Updated weights for policy 0, policy_version 351337 (0.0009) [2023-12-26 02:23:22,135][123090] Updated weights for policy 1, policy_version 349217 (0.0010) [2023-12-26 02:23:22,205][123090] Updated weights for policy 1, policy_version 349227 (0.0009) [2023-12-26 02:23:22,273][123090] Updated weights for policy 1, policy_version 349237 (0.0009) [2023-12-26 02:23:22,340][123090] Updated weights for policy 1, policy_version 349247 (0.0010) [2023-12-26 02:23:22,702][123091] Updated weights for policy 0, policy_version 351347 (0.0009) [2023-12-26 02:23:22,766][123091] Updated weights for policy 0, policy_version 351357 (0.0011) [2023-12-26 02:23:22,828][123091] Updated weights for policy 0, policy_version 351367 (0.0011) [2023-12-26 02:23:23,191][123090] Updated weights for policy 1, policy_version 349257 (0.0010) [2023-12-26 02:23:23,249][123090] Updated weights for policy 1, policy_version 349267 (0.0009) [2023-12-26 02:23:23,304][123090] Updated weights for policy 1, policy_version 349277 (0.0009) [2023-12-26 02:23:23,530][123091] Updated weights for policy 0, policy_version 351377 (0.0006) [2023-12-26 02:23:23,588][123091] Updated weights for policy 0, policy_version 351387 (0.0006) [2023-12-26 02:23:23,648][123091] Updated weights for policy 0, policy_version 351397 (0.0007) [2023-12-26 02:23:23,719][123091] Updated weights for policy 0, policy_version 351407 (0.0009) [2023-12-26 02:23:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17550.3). Total num frames: 179380224. Throughput: 0: 9042.2, 1: 8892.2. Samples: 179353636. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:23,785][121949] Avg episode reward: [(0, '6371.605'), (1, '5915.569')] [2023-12-26 02:23:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000351408_89964544.pth... [2023-12-26 02:23:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000349280_89415680.pth... [2023-12-26 02:23:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000350352_89694208.pth [2023-12-26 02:23:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000348256_89153536.pth [2023-12-26 02:23:24,174][123090] Updated weights for policy 1, policy_version 349287 (0.0007) [2023-12-26 02:23:24,243][123090] Updated weights for policy 1, policy_version 349297 (0.0006) [2023-12-26 02:23:24,305][123090] Updated weights for policy 1, policy_version 349307 (0.0006) [2023-12-26 02:23:24,567][123091] Updated weights for policy 0, policy_version 351417 (0.0010) [2023-12-26 02:23:24,629][123091] Updated weights for policy 0, policy_version 351427 (0.0009) [2023-12-26 02:23:24,690][123091] Updated weights for policy 0, policy_version 351437 (0.0011) [2023-12-26 02:23:25,060][123090] Updated weights for policy 1, policy_version 349317 (0.0009) [2023-12-26 02:23:25,109][123090] Updated weights for policy 1, policy_version 349327 (0.0009) [2023-12-26 02:23:25,158][123090] Updated weights for policy 1, policy_version 349337 (0.0009) [2023-12-26 02:23:25,518][123091] Updated weights for policy 0, policy_version 351447 (0.0010) [2023-12-26 02:23:25,580][123091] Updated weights for policy 0, policy_version 351457 (0.0009) [2023-12-26 02:23:25,642][123091] Updated weights for policy 0, policy_version 351467 (0.0009) [2023-12-26 02:23:25,968][123090] Updated weights for policy 1, policy_version 349347 (0.0009) [2023-12-26 02:23:26,028][123090] Updated weights for policy 1, policy_version 349357 (0.0009) [2023-12-26 02:23:26,086][123090] Updated weights for policy 1, policy_version 349367 (0.0007) [2023-12-26 02:23:26,384][123091] Updated weights for policy 0, policy_version 351477 (0.0008) [2023-12-26 02:23:26,447][123091] Updated weights for policy 0, policy_version 351488 (0.0009) [2023-12-26 02:23:26,518][123091] Updated weights for policy 0, policy_version 351499 (0.0010) [2023-12-26 02:23:26,925][123090] Updated weights for policy 1, policy_version 349377 (0.0008) [2023-12-26 02:23:26,973][123090] Updated weights for policy 1, policy_version 349387 (0.0009) [2023-12-26 02:23:27,027][123090] Updated weights for policy 1, policy_version 349397 (0.0009) [2023-12-26 02:23:27,080][123090] Updated weights for policy 1, policy_version 349407 (0.0009) [2023-12-26 02:23:27,252][123091] Updated weights for policy 0, policy_version 351509 (0.0008) [2023-12-26 02:23:27,302][123091] Updated weights for policy 0, policy_version 351519 (0.0006) [2023-12-26 02:23:27,361][123091] Updated weights for policy 0, policy_version 351529 (0.0006) [2023-12-26 02:23:28,017][123090] Updated weights for policy 1, policy_version 349417 (0.0009) [2023-12-26 02:23:28,059][123091] Updated weights for policy 0, policy_version 351539 (0.0007) [2023-12-26 02:23:28,077][123090] Updated weights for policy 1, policy_version 349427 (0.0005) [2023-12-26 02:23:28,127][123091] Updated weights for policy 0, policy_version 351549 (0.0009) [2023-12-26 02:23:28,134][123090] Updated weights for policy 1, policy_version 349437 (0.0005) [2023-12-26 02:23:28,193][123091] Updated weights for policy 0, policy_version 351559 (0.0006) [2023-12-26 02:23:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17522.6). Total num frames: 179462144. Throughput: 0: 9048.7, 1: 8833.4. Samples: 179458340. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:28,785][121949] Avg episode reward: [(0, '6332.471'), (1, '5878.434')] [2023-12-26 02:23:28,855][123090] Updated weights for policy 1, policy_version 349447 (0.0007) [2023-12-26 02:23:28,919][123091] Updated weights for policy 0, policy_version 351569 (0.0006) [2023-12-26 02:23:28,925][123090] Updated weights for policy 1, policy_version 349457 (0.0006) [2023-12-26 02:23:28,983][123091] Updated weights for policy 0, policy_version 351579 (0.0011) [2023-12-26 02:23:28,992][123090] Updated weights for policy 1, policy_version 349467 (0.0009) [2023-12-26 02:23:29,038][123091] Updated weights for policy 0, policy_version 351589 (0.0010) [2023-12-26 02:23:29,081][123091] Updated weights for policy 0, policy_version 351599 (0.0010) [2023-12-26 02:23:29,730][123090] Updated weights for policy 1, policy_version 349477 (0.0008) [2023-12-26 02:23:29,790][123090] Updated weights for policy 1, policy_version 349487 (0.0005) [2023-12-26 02:23:29,861][123090] Updated weights for policy 1, policy_version 349497 (0.0008) [2023-12-26 02:23:29,914][123091] Updated weights for policy 0, policy_version 351609 (0.0010) [2023-12-26 02:23:29,982][123091] Updated weights for policy 0, policy_version 351619 (0.0008) [2023-12-26 02:23:30,050][123091] Updated weights for policy 0, policy_version 351629 (0.0008) [2023-12-26 02:23:30,533][123090] Updated weights for policy 1, policy_version 349507 (0.0006) [2023-12-26 02:23:30,583][123090] Updated weights for policy 1, policy_version 349517 (0.0005) [2023-12-26 02:23:30,643][123090] Updated weights for policy 1, policy_version 349527 (0.0010) [2023-12-26 02:23:30,719][123091] Updated weights for policy 0, policy_version 351639 (0.0006) [2023-12-26 02:23:30,770][123091] Updated weights for policy 0, policy_version 351649 (0.0005) [2023-12-26 02:23:30,831][123091] Updated weights for policy 0, policy_version 351659 (0.0007) [2023-12-26 02:23:31,429][123090] Updated weights for policy 1, policy_version 349537 (0.0010) [2023-12-26 02:23:31,477][123090] Updated weights for policy 1, policy_version 349547 (0.0010) [2023-12-26 02:23:31,528][123090] Updated weights for policy 1, policy_version 349557 (0.0010) [2023-12-26 02:23:31,572][123090] Updated weights for policy 1, policy_version 349567 (0.0010) [2023-12-26 02:23:31,669][123091] Updated weights for policy 0, policy_version 351669 (0.0008) [2023-12-26 02:23:31,729][123091] Updated weights for policy 0, policy_version 351679 (0.0008) [2023-12-26 02:23:31,798][123091] Updated weights for policy 0, policy_version 351689 (0.0006) [2023-12-26 02:23:32,433][123090] Updated weights for policy 1, policy_version 349577 (0.0009) [2023-12-26 02:23:32,487][123090] Updated weights for policy 1, policy_version 349587 (0.0008) [2023-12-26 02:23:32,542][123090] Updated weights for policy 1, policy_version 349597 (0.0006) [2023-12-26 02:23:32,591][123091] Updated weights for policy 0, policy_version 351699 (0.0008) [2023-12-26 02:23:32,659][123091] Updated weights for policy 0, policy_version 351709 (0.0009) [2023-12-26 02:23:32,726][123091] Updated weights for policy 0, policy_version 351719 (0.0009) [2023-12-26 02:23:33,309][123090] Updated weights for policy 1, policy_version 349607 (0.0009) [2023-12-26 02:23:33,371][123090] Updated weights for policy 1, policy_version 349617 (0.0010) [2023-12-26 02:23:33,427][123090] Updated weights for policy 1, policy_version 349627 (0.0009) [2023-12-26 02:23:33,534][123091] Updated weights for policy 0, policy_version 351729 (0.0010) [2023-12-26 02:23:33,604][123091] Updated weights for policy 0, policy_version 351739 (0.0009) [2023-12-26 02:23:33,661][123091] Updated weights for policy 0, policy_version 351749 (0.0010) [2023-12-26 02:23:33,710][123091] Updated weights for policy 0, policy_version 351759 (0.0009) [2023-12-26 02:23:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17550.3). Total num frames: 179560448. Throughput: 0: 8974.9, 1: 8859.2. Samples: 179567768. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:33,785][121949] Avg episode reward: [(0, '6310.012'), (1, '5872.331')] [2023-12-26 02:23:34,243][123090] Updated weights for policy 1, policy_version 349637 (0.0009) [2023-12-26 02:23:34,297][123090] Updated weights for policy 1, policy_version 349647 (0.0010) [2023-12-26 02:23:34,351][123090] Updated weights for policy 1, policy_version 349657 (0.0009) [2023-12-26 02:23:34,545][123091] Updated weights for policy 0, policy_version 351769 (0.0009) [2023-12-26 02:23:34,609][123091] Updated weights for policy 0, policy_version 351779 (0.0009) [2023-12-26 02:23:34,673][123091] Updated weights for policy 0, policy_version 351789 (0.0009) [2023-12-26 02:23:35,219][123090] Updated weights for policy 1, policy_version 349667 (0.0010) [2023-12-26 02:23:35,267][123090] Updated weights for policy 1, policy_version 349677 (0.0009) [2023-12-26 02:23:35,325][123090] Updated weights for policy 1, policy_version 349687 (0.0010) [2023-12-26 02:23:35,434][123091] Updated weights for policy 0, policy_version 351799 (0.0010) [2023-12-26 02:23:35,497][123091] Updated weights for policy 0, policy_version 351809 (0.0009) [2023-12-26 02:23:35,560][123091] Updated weights for policy 0, policy_version 351819 (0.0009) [2023-12-26 02:23:36,175][123090] Updated weights for policy 1, policy_version 349697 (0.0007) [2023-12-26 02:23:36,244][123090] Updated weights for policy 1, policy_version 349707 (0.0008) [2023-12-26 02:23:36,316][123090] Updated weights for policy 1, policy_version 349717 (0.0008) [2023-12-26 02:23:36,361][123091] Updated weights for policy 0, policy_version 351829 (0.0007) [2023-12-26 02:23:36,385][123090] Updated weights for policy 1, policy_version 349727 (0.0009) [2023-12-26 02:23:36,435][123091] Updated weights for policy 0, policy_version 351839 (0.0006) [2023-12-26 02:23:36,495][123091] Updated weights for policy 0, policy_version 351849 (0.0006) [2023-12-26 02:23:37,048][123090] Updated weights for policy 1, policy_version 349737 (0.0007) [2023-12-26 02:23:37,111][123090] Updated weights for policy 1, policy_version 349747 (0.0009) [2023-12-26 02:23:37,191][123090] Updated weights for policy 1, policy_version 349757 (0.0006) [2023-12-26 02:23:37,228][123091] Updated weights for policy 0, policy_version 351859 (0.0006) [2023-12-26 02:23:37,300][123091] Updated weights for policy 0, policy_version 351869 (0.0006) [2023-12-26 02:23:37,372][123091] Updated weights for policy 0, policy_version 351879 (0.0009) [2023-12-26 02:23:37,866][123090] Updated weights for policy 1, policy_version 349767 (0.0009) [2023-12-26 02:23:37,940][123090] Updated weights for policy 1, policy_version 349777 (0.0010) [2023-12-26 02:23:38,008][123090] Updated weights for policy 1, policy_version 349787 (0.0010) [2023-12-26 02:23:38,082][123091] Updated weights for policy 0, policy_version 351889 (0.0010) [2023-12-26 02:23:38,151][123091] Updated weights for policy 0, policy_version 351899 (0.0009) [2023-12-26 02:23:38,218][123091] Updated weights for policy 0, policy_version 351909 (0.0010) [2023-12-26 02:23:38,285][123091] Updated weights for policy 0, policy_version 351919 (0.0010) [2023-12-26 02:23:38,755][123090] Updated weights for policy 1, policy_version 349797 (0.0010) [2023-12-26 02:23:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17550.3). Total num frames: 179642368. Throughput: 0: 8926.5, 1: 8864.9. Samples: 179620164. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:38,785][121949] Avg episode reward: [(0, '6251.654'), (1, '5824.289')] [2023-12-26 02:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000351920_90095616.pth... [2023-12-26 02:23:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000350896_89833472.pth [2023-12-26 02:23:38,811][123090] Updated weights for policy 1, policy_version 349807 (0.0010) [2023-12-26 02:23:38,875][123090] Updated weights for policy 1, policy_version 349817 (0.0010) [2023-12-26 02:23:38,915][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000349824_89554944.pth... [2023-12-26 02:23:38,920][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000348768_89284608.pth [2023-12-26 02:23:39,105][123091] Updated weights for policy 0, policy_version 351929 (0.0011) [2023-12-26 02:23:39,164][123091] Updated weights for policy 0, policy_version 351939 (0.0011) [2023-12-26 02:23:39,229][123091] Updated weights for policy 0, policy_version 351949 (0.0010) [2023-12-26 02:23:39,752][123090] Updated weights for policy 1, policy_version 349827 (0.0009) [2023-12-26 02:23:39,830][123090] Updated weights for policy 1, policy_version 349837 (0.0007) [2023-12-26 02:23:39,905][123090] Updated weights for policy 1, policy_version 349847 (0.0009) [2023-12-26 02:23:40,070][123091] Updated weights for policy 0, policy_version 351959 (0.0010) [2023-12-26 02:23:40,136][123091] Updated weights for policy 0, policy_version 351969 (0.0009) [2023-12-26 02:23:40,202][123091] Updated weights for policy 0, policy_version 351979 (0.0009) [2023-12-26 02:23:40,733][123090] Updated weights for policy 1, policy_version 349857 (0.0009) [2023-12-26 02:23:40,782][123090] Updated weights for policy 1, policy_version 349867 (0.0009) [2023-12-26 02:23:40,830][123090] Updated weights for policy 1, policy_version 349877 (0.0009) [2023-12-26 02:23:40,877][123090] Updated weights for policy 1, policy_version 349887 (0.0009) [2023-12-26 02:23:41,057][123091] Updated weights for policy 0, policy_version 351989 (0.0008) [2023-12-26 02:23:41,115][123091] Updated weights for policy 0, policy_version 352000 (0.0010) [2023-12-26 02:23:41,181][123091] Updated weights for policy 0, policy_version 352010 (0.0010) [2023-12-26 02:23:41,788][123090] Updated weights for policy 1, policy_version 349897 (0.0011) [2023-12-26 02:23:41,854][123090] Updated weights for policy 1, policy_version 349907 (0.0011) [2023-12-26 02:23:41,918][123090] Updated weights for policy 1, policy_version 349917 (0.0010) [2023-12-26 02:23:42,095][123091] Updated weights for policy 0, policy_version 352020 (0.0008) [2023-12-26 02:23:42,171][123091] Updated weights for policy 0, policy_version 352030 (0.0006) [2023-12-26 02:23:42,249][123091] Updated weights for policy 0, policy_version 352040 (0.0006) [2023-12-26 02:23:42,702][123090] Updated weights for policy 1, policy_version 349927 (0.0009) [2023-12-26 02:23:42,758][123090] Updated weights for policy 1, policy_version 349937 (0.0010) [2023-12-26 02:23:42,817][123090] Updated weights for policy 1, policy_version 349947 (0.0010) [2023-12-26 02:23:42,941][123091] Updated weights for policy 0, policy_version 352050 (0.0010) [2023-12-26 02:23:42,996][123091] Updated weights for policy 0, policy_version 352060 (0.0010) [2023-12-26 02:23:43,068][123091] Updated weights for policy 0, policy_version 352070 (0.0008) [2023-12-26 02:23:43,141][123091] Updated weights for policy 0, policy_version 352080 (0.0005) [2023-12-26 02:23:43,575][123090] Updated weights for policy 1, policy_version 349957 (0.0008) [2023-12-26 02:23:43,628][123090] Updated weights for policy 1, policy_version 349967 (0.0005) [2023-12-26 02:23:43,678][123090] Updated weights for policy 1, policy_version 349977 (0.0005) [2023-12-26 02:23:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17550.3). Total num frames: 179732480. Throughput: 0: 8917.1, 1: 8850.5. Samples: 179724720. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:43,785][121949] Avg episode reward: [(0, '6219.623'), (1, '5897.420')] [2023-12-26 02:23:43,892][123091] Updated weights for policy 0, policy_version 352091 (0.0011) [2023-12-26 02:23:43,948][123091] Updated weights for policy 0, policy_version 352102 (0.0010) [2023-12-26 02:23:44,000][123091] Updated weights for policy 0, policy_version 352112 (0.0006) [2023-12-26 02:23:44,351][123090] Updated weights for policy 1, policy_version 349987 (0.0006) [2023-12-26 02:23:44,425][123090] Updated weights for policy 1, policy_version 349997 (0.0008) [2023-12-26 02:23:44,488][123090] Updated weights for policy 1, policy_version 350007 (0.0008) [2023-12-26 02:23:44,701][123091] Updated weights for policy 0, policy_version 352122 (0.0006) [2023-12-26 02:23:44,762][123091] Updated weights for policy 0, policy_version 352132 (0.0006) [2023-12-26 02:23:44,834][123091] Updated weights for policy 0, policy_version 352142 (0.0008) [2023-12-26 02:23:45,274][123090] Updated weights for policy 1, policy_version 350017 (0.0007) [2023-12-26 02:23:45,345][123090] Updated weights for policy 1, policy_version 350027 (0.0010) [2023-12-26 02:23:45,407][123090] Updated weights for policy 1, policy_version 350037 (0.0010) [2023-12-26 02:23:45,462][123090] Updated weights for policy 1, policy_version 350047 (0.0010) [2023-12-26 02:23:45,605][123091] Updated weights for policy 0, policy_version 352152 (0.0010) [2023-12-26 02:23:45,656][123091] Updated weights for policy 0, policy_version 352162 (0.0009) [2023-12-26 02:23:45,708][123091] Updated weights for policy 0, policy_version 352172 (0.0011) [2023-12-26 02:23:46,246][123090] Updated weights for policy 1, policy_version 350057 (0.0010) [2023-12-26 02:23:46,297][123090] Updated weights for policy 1, policy_version 350067 (0.0010) [2023-12-26 02:23:46,352][123090] Updated weights for policy 1, policy_version 350077 (0.0010) [2023-12-26 02:23:46,549][123091] Updated weights for policy 0, policy_version 352182 (0.0011) [2023-12-26 02:23:46,615][123091] Updated weights for policy 0, policy_version 352192 (0.0011) [2023-12-26 02:23:46,677][123091] Updated weights for policy 0, policy_version 352202 (0.0010) [2023-12-26 02:23:47,196][123090] Updated weights for policy 1, policy_version 350087 (0.0010) [2023-12-26 02:23:47,239][123090] Updated weights for policy 1, policy_version 350097 (0.0010) [2023-12-26 02:23:47,300][123090] Updated weights for policy 1, policy_version 350107 (0.0010) [2023-12-26 02:23:47,494][123091] Updated weights for policy 0, policy_version 352212 (0.0011) [2023-12-26 02:23:47,542][123091] Updated weights for policy 0, policy_version 352222 (0.0010) [2023-12-26 02:23:47,590][123091] Updated weights for policy 0, policy_version 352232 (0.0010) [2023-12-26 02:23:47,989][123090] Updated weights for policy 1, policy_version 350117 (0.0008) [2023-12-26 02:23:48,046][123090] Updated weights for policy 1, policy_version 350127 (0.0005) [2023-12-26 02:23:48,114][123090] Updated weights for policy 1, policy_version 350137 (0.0008) [2023-12-26 02:23:48,434][123091] Updated weights for policy 0, policy_version 352242 (0.0011) [2023-12-26 02:23:48,486][123091] Updated weights for policy 0, policy_version 352252 (0.0011) [2023-12-26 02:23:48,546][123091] Updated weights for policy 0, policy_version 352262 (0.0011) [2023-12-26 02:23:48,603][123091] Updated weights for policy 0, policy_version 352272 (0.0011) [2023-12-26 02:23:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17578.1). Total num frames: 179822592. Throughput: 0: 8920.2, 1: 8898.0. Samples: 179833668. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:48,785][121949] Avg episode reward: [(0, '6204.552'), (1, '5749.492')] [2023-12-26 02:23:48,849][123090] Updated weights for policy 1, policy_version 350147 (0.0008) [2023-12-26 02:23:48,916][123090] Updated weights for policy 1, policy_version 350157 (0.0008) [2023-12-26 02:23:48,978][123090] Updated weights for policy 1, policy_version 350167 (0.0007) [2023-12-26 02:23:49,410][123091] Updated weights for policy 0, policy_version 352282 (0.0011) [2023-12-26 02:23:49,455][123091] Updated weights for policy 0, policy_version 352292 (0.0010) [2023-12-26 02:23:49,506][123091] Updated weights for policy 0, policy_version 352302 (0.0010) [2023-12-26 02:23:49,796][123090] Updated weights for policy 1, policy_version 350177 (0.0006) [2023-12-26 02:23:49,863][123090] Updated weights for policy 1, policy_version 350187 (0.0009) [2023-12-26 02:23:49,934][123090] Updated weights for policy 1, policy_version 350197 (0.0007) [2023-12-26 02:23:50,009][123090] Updated weights for policy 1, policy_version 350207 (0.0008) [2023-12-26 02:23:50,363][123091] Updated weights for policy 0, policy_version 352312 (0.0010) [2023-12-26 02:23:50,421][123091] Updated weights for policy 0, policy_version 352322 (0.0009) [2023-12-26 02:23:50,487][123091] Updated weights for policy 0, policy_version 352332 (0.0010) [2023-12-26 02:23:50,781][123090] Updated weights for policy 1, policy_version 350217 (0.0009) [2023-12-26 02:23:50,848][123090] Updated weights for policy 1, policy_version 350227 (0.0009) [2023-12-26 02:23:50,913][123090] Updated weights for policy 1, policy_version 350237 (0.0008) [2023-12-26 02:23:51,353][123091] Updated weights for policy 0, policy_version 352342 (0.0008) [2023-12-26 02:23:51,428][123091] Updated weights for policy 0, policy_version 352352 (0.0007) [2023-12-26 02:23:51,480][123091] Updated weights for policy 0, policy_version 352362 (0.0009) [2023-12-26 02:23:51,696][123090] Updated weights for policy 1, policy_version 350247 (0.0009) [2023-12-26 02:23:51,771][123090] Updated weights for policy 1, policy_version 350257 (0.0009) [2023-12-26 02:23:51,840][123090] Updated weights for policy 1, policy_version 350267 (0.0008) [2023-12-26 02:23:52,326][123091] Updated weights for policy 0, policy_version 352372 (0.0010) [2023-12-26 02:23:52,392][123091] Updated weights for policy 0, policy_version 352382 (0.0010) [2023-12-26 02:23:52,463][123091] Updated weights for policy 0, policy_version 352392 (0.0011) [2023-12-26 02:23:52,680][123090] Updated weights for policy 1, policy_version 350277 (0.0009) [2023-12-26 02:23:52,732][123090] Updated weights for policy 1, policy_version 350287 (0.0008) [2023-12-26 02:23:52,785][123090] Updated weights for policy 1, policy_version 350297 (0.0009) [2023-12-26 02:23:53,283][123091] Updated weights for policy 0, policy_version 352402 (0.0011) [2023-12-26 02:23:53,330][123091] Updated weights for policy 0, policy_version 352412 (0.0010) [2023-12-26 02:23:53,381][123091] Updated weights for policy 0, policy_version 352422 (0.0010) [2023-12-26 02:23:53,440][123091] Updated weights for policy 0, policy_version 352432 (0.0011) [2023-12-26 02:23:53,636][123090] Updated weights for policy 1, policy_version 350307 (0.0009) [2023-12-26 02:23:53,700][123090] Updated weights for policy 1, policy_version 350317 (0.0009) [2023-12-26 02:23:53,762][123090] Updated weights for policy 1, policy_version 350327 (0.0009) [2023-12-26 02:23:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 179904512. Throughput: 0: 8852.2, 1: 8849.6. Samples: 179885000. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:53,785][121949] Avg episode reward: [(0, '6120.888'), (1, '5521.033')] [2023-12-26 02:23:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000352432_90226688.pth... [2023-12-26 02:23:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000351408_89964544.pth [2023-12-26 02:23:53,814][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000350336_89686016.pth... [2023-12-26 02:23:53,819][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000349280_89415680.pth [2023-12-26 02:23:54,271][123091] Updated weights for policy 0, policy_version 352442 (0.0011) [2023-12-26 02:23:54,341][123091] Updated weights for policy 0, policy_version 352452 (0.0011) [2023-12-26 02:23:54,403][123091] Updated weights for policy 0, policy_version 352462 (0.0011) [2023-12-26 02:23:54,558][123090] Updated weights for policy 1, policy_version 350337 (0.0009) [2023-12-26 02:23:54,616][123090] Updated weights for policy 1, policy_version 350347 (0.0009) [2023-12-26 02:23:54,668][123090] Updated weights for policy 1, policy_version 350357 (0.0008) [2023-12-26 02:23:54,716][123090] Updated weights for policy 1, policy_version 350367 (0.0009) [2023-12-26 02:23:55,217][123091] Updated weights for policy 0, policy_version 352472 (0.0011) [2023-12-26 02:23:55,277][123091] Updated weights for policy 0, policy_version 352482 (0.0011) [2023-12-26 02:23:55,336][123091] Updated weights for policy 0, policy_version 352492 (0.0011) [2023-12-26 02:23:55,565][123090] Updated weights for policy 1, policy_version 350377 (0.0009) [2023-12-26 02:23:55,624][123090] Updated weights for policy 1, policy_version 350387 (0.0008) [2023-12-26 02:23:55,671][123090] Updated weights for policy 1, policy_version 350397 (0.0009) [2023-12-26 02:23:56,121][123091] Updated weights for policy 0, policy_version 352502 (0.0007) [2023-12-26 02:23:56,176][123091] Updated weights for policy 0, policy_version 352512 (0.0009) [2023-12-26 02:23:56,235][123091] Updated weights for policy 0, policy_version 352522 (0.0011) [2023-12-26 02:23:56,559][123090] Updated weights for policy 1, policy_version 350407 (0.0008) [2023-12-26 02:23:56,617][123090] Updated weights for policy 1, policy_version 350417 (0.0008) [2023-12-26 02:23:56,679][123090] Updated weights for policy 1, policy_version 350427 (0.0009) [2023-12-26 02:23:57,040][123091] Updated weights for policy 0, policy_version 352532 (0.0010) [2023-12-26 02:23:57,104][123091] Updated weights for policy 0, policy_version 352542 (0.0010) [2023-12-26 02:23:57,162][123091] Updated weights for policy 0, policy_version 352552 (0.0010) [2023-12-26 02:23:57,482][123090] Updated weights for policy 1, policy_version 350437 (0.0007) [2023-12-26 02:23:57,549][123090] Updated weights for policy 1, policy_version 350447 (0.0007) [2023-12-26 02:23:57,601][123090] Updated weights for policy 1, policy_version 350457 (0.0008) [2023-12-26 02:23:57,988][123091] Updated weights for policy 0, policy_version 352562 (0.0010) [2023-12-26 02:23:58,061][123091] Updated weights for policy 0, policy_version 352572 (0.0010) [2023-12-26 02:23:58,129][123091] Updated weights for policy 0, policy_version 352582 (0.0011) [2023-12-26 02:23:58,200][123091] Updated weights for policy 0, policy_version 352592 (0.0010) [2023-12-26 02:23:58,381][123090] Updated weights for policy 1, policy_version 350467 (0.0008) [2023-12-26 02:23:58,449][123090] Updated weights for policy 1, policy_version 350477 (0.0007) [2023-12-26 02:23:58,522][123090] Updated weights for policy 1, policy_version 350487 (0.0008) [2023-12-26 02:23:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 179994624. Throughput: 0: 8841.8, 1: 8801.0. Samples: 179987964. Policy #0 lag: (min: 23.0, avg: 24.4, max: 55.0) [2023-12-26 02:23:58,785][121949] Avg episode reward: [(0, '6164.598'), (1, '5445.854')] [2023-12-26 02:23:59,130][123091] Updated weights for policy 0, policy_version 352602 (0.0009) [2023-12-26 02:23:59,198][123091] Updated weights for policy 0, policy_version 352612 (0.0009) [2023-12-26 02:23:59,274][123091] Updated weights for policy 0, policy_version 352622 (0.0008) [2023-12-26 02:23:59,455][123090] Updated weights for policy 1, policy_version 350497 (0.0009) [2023-12-26 02:23:59,525][123090] Updated weights for policy 1, policy_version 350507 (0.0010) [2023-12-26 02:23:59,595][123090] Updated weights for policy 1, policy_version 350517 (0.0009) [2023-12-26 02:23:59,664][123090] Updated weights for policy 1, policy_version 350527 (0.0010) [2023-12-26 02:24:00,044][123091] Updated weights for policy 0, policy_version 352632 (0.0005) [2023-12-26 02:24:00,093][123091] Updated weights for policy 0, policy_version 352642 (0.0006) [2023-12-26 02:24:00,156][123091] Updated weights for policy 0, policy_version 352652 (0.0009) [2023-12-26 02:24:00,521][123090] Updated weights for policy 1, policy_version 350537 (0.0009) [2023-12-26 02:24:00,576][123090] Updated weights for policy 1, policy_version 350547 (0.0010) [2023-12-26 02:24:00,648][123090] Updated weights for policy 1, policy_version 350557 (0.0008) [2023-12-26 02:24:00,958][123091] Updated weights for policy 0, policy_version 352662 (0.0009) [2023-12-26 02:24:01,022][123091] Updated weights for policy 0, policy_version 352672 (0.0010) [2023-12-26 02:24:01,081][123091] Updated weights for policy 0, policy_version 352682 (0.0010) [2023-12-26 02:24:01,477][123090] Updated weights for policy 1, policy_version 350567 (0.0009) [2023-12-26 02:24:01,525][123090] Updated weights for policy 1, policy_version 350577 (0.0008) [2023-12-26 02:24:01,572][123090] Updated weights for policy 1, policy_version 350587 (0.0008) [2023-12-26 02:24:01,913][123091] Updated weights for policy 0, policy_version 352692 (0.0010) [2023-12-26 02:24:01,980][123091] Updated weights for policy 0, policy_version 352702 (0.0011) [2023-12-26 02:24:02,042][123091] Updated weights for policy 0, policy_version 352712 (0.0010) [2023-12-26 02:24:02,384][123090] Updated weights for policy 1, policy_version 350597 (0.0008) [2023-12-26 02:24:02,452][123090] Updated weights for policy 1, policy_version 350607 (0.0009) [2023-12-26 02:24:02,508][123090] Updated weights for policy 1, policy_version 350617 (0.0009) [2023-12-26 02:24:02,826][123091] Updated weights for policy 0, policy_version 352722 (0.0006) [2023-12-26 02:24:02,897][123091] Updated weights for policy 0, policy_version 352732 (0.0005) [2023-12-26 02:24:02,959][123091] Updated weights for policy 0, policy_version 352742 (0.0006) [2023-12-26 02:24:03,015][123091] Updated weights for policy 0, policy_version 352752 (0.0005) [2023-12-26 02:24:03,349][123090] Updated weights for policy 1, policy_version 350627 (0.0010) [2023-12-26 02:24:03,412][123090] Updated weights for policy 1, policy_version 350637 (0.0007) [2023-12-26 02:24:03,468][123090] Updated weights for policy 1, policy_version 350647 (0.0005) [2023-12-26 02:24:03,665][123091] Updated weights for policy 0, policy_version 352762 (0.0005) [2023-12-26 02:24:03,714][123091] Updated weights for policy 0, policy_version 352772 (0.0005) [2023-12-26 02:24:03,758][123091] Updated weights for policy 0, policy_version 352782 (0.0005) [2023-12-26 02:24:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 180084736. Throughput: 0: 8766.1, 1: 8755.9. Samples: 180091052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:03,784][121949] Avg episode reward: [(0, '6129.894'), (1, '5507.687')] [2023-12-26 02:24:04,142][123090] Updated weights for policy 1, policy_version 350657 (0.0005) [2023-12-26 02:24:04,212][123090] Updated weights for policy 1, policy_version 350667 (0.0006) [2023-12-26 02:24:04,285][123090] Updated weights for policy 1, policy_version 350677 (0.0006) [2023-12-26 02:24:04,347][123090] Updated weights for policy 1, policy_version 350687 (0.0007) [2023-12-26 02:24:04,528][123091] Updated weights for policy 0, policy_version 352792 (0.0010) [2023-12-26 02:24:04,584][123091] Updated weights for policy 0, policy_version 352802 (0.0011) [2023-12-26 02:24:04,640][123091] Updated weights for policy 0, policy_version 352812 (0.0011) [2023-12-26 02:24:05,097][123090] Updated weights for policy 1, policy_version 350697 (0.0008) [2023-12-26 02:24:05,152][123090] Updated weights for policy 1, policy_version 350707 (0.0009) [2023-12-26 02:24:05,199][123090] Updated weights for policy 1, policy_version 350717 (0.0008) [2023-12-26 02:24:05,407][123091] Updated weights for policy 0, policy_version 352822 (0.0007) [2023-12-26 02:24:05,464][123091] Updated weights for policy 0, policy_version 352832 (0.0009) [2023-12-26 02:24:05,522][123091] Updated weights for policy 0, policy_version 352842 (0.0010) [2023-12-26 02:24:05,941][123090] Updated weights for policy 1, policy_version 350727 (0.0008) [2023-12-26 02:24:06,004][123090] Updated weights for policy 1, policy_version 350737 (0.0009) [2023-12-26 02:24:06,053][123090] Updated weights for policy 1, policy_version 350747 (0.0009) [2023-12-26 02:24:06,338][123091] Updated weights for policy 0, policy_version 352852 (0.0011) [2023-12-26 02:24:06,403][123091] Updated weights for policy 0, policy_version 352862 (0.0011) [2023-12-26 02:24:06,475][123091] Updated weights for policy 0, policy_version 352872 (0.0011) [2023-12-26 02:24:06,887][123090] Updated weights for policy 1, policy_version 350757 (0.0009) [2023-12-26 02:24:06,954][123090] Updated weights for policy 1, policy_version 350767 (0.0009) [2023-12-26 02:24:07,013][123090] Updated weights for policy 1, policy_version 350777 (0.0009) [2023-12-26 02:24:07,300][123091] Updated weights for policy 0, policy_version 352882 (0.0011) [2023-12-26 02:24:07,367][123091] Updated weights for policy 0, policy_version 352892 (0.0011) [2023-12-26 02:24:07,423][123091] Updated weights for policy 0, policy_version 352902 (0.0011) [2023-12-26 02:24:07,490][123091] Updated weights for policy 0, policy_version 352912 (0.0011) [2023-12-26 02:24:07,846][123090] Updated weights for policy 1, policy_version 350787 (0.0008) [2023-12-26 02:24:07,895][123090] Updated weights for policy 1, policy_version 350797 (0.0009) [2023-12-26 02:24:07,954][123090] Updated weights for policy 1, policy_version 350807 (0.0010) [2023-12-26 02:24:08,304][123091] Updated weights for policy 0, policy_version 352922 (0.0010) [2023-12-26 02:24:08,363][123091] Updated weights for policy 0, policy_version 352932 (0.0009) [2023-12-26 02:24:08,429][123091] Updated weights for policy 0, policy_version 352942 (0.0006) [2023-12-26 02:24:08,738][123090] Updated weights for policy 1, policy_version 350817 (0.0010) [2023-12-26 02:24:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 180166656. Throughput: 0: 8804.9, 1: 8814.0. Samples: 180146484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:08,785][121949] Avg episode reward: [(0, '6072.723'), (1, '5560.121')] [2023-12-26 02:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000352944_90357760.pth... [2023-12-26 02:24:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000351920_90095616.pth [2023-12-26 02:24:08,801][123090] Updated weights for policy 1, policy_version 350827 (0.0011) [2023-12-26 02:24:08,864][123090] Updated weights for policy 1, policy_version 350837 (0.0010) [2023-12-26 02:24:08,924][123090] Updated weights for policy 1, policy_version 350847 (0.0011) [2023-12-26 02:24:08,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000350848_89817088.pth... [2023-12-26 02:24:08,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000349824_89554944.pth [2023-12-26 02:24:09,142][123091] Updated weights for policy 0, policy_version 352952 (0.0006) [2023-12-26 02:24:09,195][123091] Updated weights for policy 0, policy_version 352962 (0.0005) [2023-12-26 02:24:09,261][123091] Updated weights for policy 0, policy_version 352972 (0.0009) [2023-12-26 02:24:09,745][123090] Updated weights for policy 1, policy_version 350857 (0.0010) [2023-12-26 02:24:09,805][123090] Updated weights for policy 1, policy_version 350867 (0.0010) [2023-12-26 02:24:09,878][123090] Updated weights for policy 1, policy_version 350877 (0.0010) [2023-12-26 02:24:10,097][123091] Updated weights for policy 0, policy_version 352982 (0.0006) [2023-12-26 02:24:10,155][123091] Updated weights for policy 0, policy_version 352992 (0.0006) [2023-12-26 02:24:10,215][123091] Updated weights for policy 0, policy_version 353002 (0.0006) [2023-12-26 02:24:10,659][123090] Updated weights for policy 1, policy_version 350887 (0.0009) [2023-12-26 02:24:10,736][123090] Updated weights for policy 1, policy_version 350897 (0.0008) [2023-12-26 02:24:10,812][123090] Updated weights for policy 1, policy_version 350907 (0.0008) [2023-12-26 02:24:10,992][123091] Updated weights for policy 0, policy_version 353012 (0.0008) [2023-12-26 02:24:11,063][123091] Updated weights for policy 0, policy_version 353022 (0.0008) [2023-12-26 02:24:11,141][123091] Updated weights for policy 0, policy_version 353032 (0.0007) [2023-12-26 02:24:11,588][123090] Updated weights for policy 1, policy_version 350917 (0.0008) [2023-12-26 02:24:11,657][123090] Updated weights for policy 1, policy_version 350927 (0.0009) [2023-12-26 02:24:11,730][123090] Updated weights for policy 1, policy_version 350937 (0.0010) [2023-12-26 02:24:11,948][123091] Updated weights for policy 0, policy_version 353042 (0.0010) [2023-12-26 02:24:12,007][123091] Updated weights for policy 0, policy_version 353052 (0.0007) [2023-12-26 02:24:12,062][123091] Updated weights for policy 0, policy_version 353062 (0.0005) [2023-12-26 02:24:12,107][123091] Updated weights for policy 0, policy_version 353072 (0.0005) [2023-12-26 02:24:12,591][123090] Updated weights for policy 1, policy_version 350947 (0.0009) [2023-12-26 02:24:12,654][123090] Updated weights for policy 1, policy_version 350957 (0.0010) [2023-12-26 02:24:12,711][123090] Updated weights for policy 1, policy_version 350967 (0.0009) [2023-12-26 02:24:12,927][123091] Updated weights for policy 0, policy_version 353082 (0.0010) [2023-12-26 02:24:12,988][123091] Updated weights for policy 0, policy_version 353092 (0.0009) [2023-12-26 02:24:13,048][123091] Updated weights for policy 0, policy_version 353102 (0.0009) [2023-12-26 02:24:13,581][123090] Updated weights for policy 1, policy_version 350977 (0.0009) [2023-12-26 02:24:13,634][123090] Updated weights for policy 1, policy_version 350987 (0.0009) [2023-12-26 02:24:13,697][123090] Updated weights for policy 1, policy_version 350997 (0.0009) [2023-12-26 02:24:13,759][123090] Updated weights for policy 1, policy_version 351007 (0.0006) [2023-12-26 02:24:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 180256768. Throughput: 0: 8782.6, 1: 8824.1. Samples: 180250640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:13,785][121949] Avg episode reward: [(0, '6113.439'), (1, '5639.389')] [2023-12-26 02:24:13,793][123091] Updated weights for policy 0, policy_version 353112 (0.0009) [2023-12-26 02:24:13,846][123091] Updated weights for policy 0, policy_version 353122 (0.0009) [2023-12-26 02:24:13,904][123091] Updated weights for policy 0, policy_version 353132 (0.0010) [2023-12-26 02:24:14,448][123090] Updated weights for policy 1, policy_version 351017 (0.0010) [2023-12-26 02:24:14,514][123090] Updated weights for policy 1, policy_version 351027 (0.0010) [2023-12-26 02:24:14,565][123090] Updated weights for policy 1, policy_version 351037 (0.0006) [2023-12-26 02:24:14,816][123091] Updated weights for policy 0, policy_version 353142 (0.0009) [2023-12-26 02:24:14,886][123091] Updated weights for policy 0, policy_version 353152 (0.0008) [2023-12-26 02:24:14,962][123091] Updated weights for policy 0, policy_version 353162 (0.0008) [2023-12-26 02:24:15,384][123090] Updated weights for policy 1, policy_version 351047 (0.0005) [2023-12-26 02:24:15,446][123090] Updated weights for policy 1, policy_version 351057 (0.0005) [2023-12-26 02:24:15,511][123090] Updated weights for policy 1, policy_version 351067 (0.0005) [2023-12-26 02:24:15,645][123091] Updated weights for policy 0, policy_version 353172 (0.0009) [2023-12-26 02:24:15,712][123091] Updated weights for policy 0, policy_version 353182 (0.0011) [2023-12-26 02:24:15,760][123091] Updated weights for policy 0, policy_version 353192 (0.0011) [2023-12-26 02:24:16,177][123090] Updated weights for policy 1, policy_version 351077 (0.0007) [2023-12-26 02:24:16,233][123090] Updated weights for policy 1, policy_version 351087 (0.0005) [2023-12-26 02:24:16,282][123090] Updated weights for policy 1, policy_version 351097 (0.0005) [2023-12-26 02:24:16,591][123091] Updated weights for policy 0, policy_version 353202 (0.0011) [2023-12-26 02:24:16,639][123091] Updated weights for policy 0, policy_version 353212 (0.0010) [2023-12-26 02:24:16,691][123091] Updated weights for policy 0, policy_version 353222 (0.0005) [2023-12-26 02:24:16,742][123091] Updated weights for policy 0, policy_version 353232 (0.0005) [2023-12-26 02:24:17,070][123090] Updated weights for policy 1, policy_version 351107 (0.0007) [2023-12-26 02:24:17,123][123090] Updated weights for policy 1, policy_version 351117 (0.0010) [2023-12-26 02:24:17,177][123090] Updated weights for policy 1, policy_version 351128 (0.0010) [2023-12-26 02:24:17,423][123091] Updated weights for policy 0, policy_version 353242 (0.0005) [2023-12-26 02:24:17,470][123091] Updated weights for policy 0, policy_version 353252 (0.0005) [2023-12-26 02:24:17,519][123091] Updated weights for policy 0, policy_version 353262 (0.0005) [2023-12-26 02:24:18,149][123090] Updated weights for policy 1, policy_version 351139 (0.0010) [2023-12-26 02:24:18,167][123091] Updated weights for policy 0, policy_version 353272 (0.0005) [2023-12-26 02:24:18,213][123090] Updated weights for policy 1, policy_version 351149 (0.0010) [2023-12-26 02:24:18,216][123091] Updated weights for policy 0, policy_version 353282 (0.0005) [2023-12-26 02:24:18,264][123091] Updated weights for policy 0, policy_version 353292 (0.0005) [2023-12-26 02:24:18,273][123090] Updated weights for policy 1, policy_version 351159 (0.0010) [2023-12-26 02:24:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 180346880. Throughput: 0: 8837.1, 1: 8765.1. Samples: 180359864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:18,785][121949] Avg episode reward: [(0, '6077.083'), (1, '5600.255')] [2023-12-26 02:24:19,066][123091] Updated weights for policy 0, policy_version 353302 (0.0008) [2023-12-26 02:24:19,079][123090] Updated weights for policy 1, policy_version 351169 (0.0010) [2023-12-26 02:24:19,114][123091] Updated weights for policy 0, policy_version 353312 (0.0010) [2023-12-26 02:24:19,131][123090] Updated weights for policy 1, policy_version 351179 (0.0010) [2023-12-26 02:24:19,165][123091] Updated weights for policy 0, policy_version 353322 (0.0010) [2023-12-26 02:24:19,189][123090] Updated weights for policy 1, policy_version 351189 (0.0010) [2023-12-26 02:24:19,255][123090] Updated weights for policy 1, policy_version 351199 (0.0011) [2023-12-26 02:24:20,031][123091] Updated weights for policy 0, policy_version 353332 (0.0011) [2023-12-26 02:24:20,088][123091] Updated weights for policy 0, policy_version 353342 (0.0011) [2023-12-26 02:24:20,090][123090] Updated weights for policy 1, policy_version 351209 (0.0011) [2023-12-26 02:24:20,145][123091] Updated weights for policy 0, policy_version 353352 (0.0011) [2023-12-26 02:24:20,154][123090] Updated weights for policy 1, policy_version 351219 (0.0011) [2023-12-26 02:24:20,218][123090] Updated weights for policy 1, policy_version 351229 (0.0011) [2023-12-26 02:24:20,849][123091] Updated weights for policy 0, policy_version 353362 (0.0011) [2023-12-26 02:24:20,913][123091] Updated weights for policy 0, policy_version 353372 (0.0010) [2023-12-26 02:24:20,962][123091] Updated weights for policy 0, policy_version 353382 (0.0009) [2023-12-26 02:24:21,018][123091] Updated weights for policy 0, policy_version 353392 (0.0010) [2023-12-26 02:24:21,115][123090] Updated weights for policy 1, policy_version 351239 (0.0009) [2023-12-26 02:24:21,183][123090] Updated weights for policy 1, policy_version 351249 (0.0009) [2023-12-26 02:24:21,253][123090] Updated weights for policy 1, policy_version 351259 (0.0008) [2023-12-26 02:24:21,889][123091] Updated weights for policy 0, policy_version 353402 (0.0010) [2023-12-26 02:24:21,948][123091] Updated weights for policy 0, policy_version 353412 (0.0010) [2023-12-26 02:24:22,014][123091] Updated weights for policy 0, policy_version 353422 (0.0009) [2023-12-26 02:24:22,079][123090] Updated weights for policy 1, policy_version 351269 (0.0009) [2023-12-26 02:24:22,134][123090] Updated weights for policy 1, policy_version 351279 (0.0009) [2023-12-26 02:24:22,195][123090] Updated weights for policy 1, policy_version 351289 (0.0009) [2023-12-26 02:24:22,730][123091] Updated weights for policy 0, policy_version 353432 (0.0009) [2023-12-26 02:24:22,780][123091] Updated weights for policy 0, policy_version 353442 (0.0009) [2023-12-26 02:24:22,833][123091] Updated weights for policy 0, policy_version 353452 (0.0009) [2023-12-26 02:24:23,082][123090] Updated weights for policy 1, policy_version 351299 (0.0010) [2023-12-26 02:24:23,150][123090] Updated weights for policy 1, policy_version 351309 (0.0011) [2023-12-26 02:24:23,216][123090] Updated weights for policy 1, policy_version 351319 (0.0010) [2023-12-26 02:24:23,620][123091] Updated weights for policy 0, policy_version 353462 (0.0007) [2023-12-26 02:24:23,675][123091] Updated weights for policy 0, policy_version 353472 (0.0005) [2023-12-26 02:24:23,726][123091] Updated weights for policy 0, policy_version 353482 (0.0006) [2023-12-26 02:24:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 180436992. Throughput: 0: 8834.8, 1: 8732.7. Samples: 180410704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:23,785][121949] Avg episode reward: [(0, '6192.794'), (1, '5317.444')] [2023-12-26 02:24:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000353488_90497024.pth... [2023-12-26 02:24:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000351328_89939968.pth... [2023-12-26 02:24:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000352432_90226688.pth [2023-12-26 02:24:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000350336_89686016.pth [2023-12-26 02:24:23,903][123090] Updated weights for policy 1, policy_version 351329 (0.0010) [2023-12-26 02:24:23,958][123090] Updated weights for policy 1, policy_version 351339 (0.0006) [2023-12-26 02:24:24,008][123090] Updated weights for policy 1, policy_version 351349 (0.0006) [2023-12-26 02:24:24,057][123090] Updated weights for policy 1, policy_version 351359 (0.0006) [2023-12-26 02:24:24,521][123091] Updated weights for policy 0, policy_version 353492 (0.0010) [2023-12-26 02:24:24,586][123091] Updated weights for policy 0, policy_version 353502 (0.0009) [2023-12-26 02:24:24,651][123091] Updated weights for policy 0, policy_version 353512 (0.0009) [2023-12-26 02:24:24,731][123090] Updated weights for policy 1, policy_version 351369 (0.0010) [2023-12-26 02:24:24,778][123090] Updated weights for policy 1, policy_version 351379 (0.0010) [2023-12-26 02:24:24,833][123090] Updated weights for policy 1, policy_version 351389 (0.0010) [2023-12-26 02:24:25,482][123091] Updated weights for policy 0, policy_version 353522 (0.0009) [2023-12-26 02:24:25,520][123090] Updated weights for policy 1, policy_version 351399 (0.0005) [2023-12-26 02:24:25,549][123091] Updated weights for policy 0, policy_version 353532 (0.0005) [2023-12-26 02:24:25,574][123090] Updated weights for policy 1, policy_version 351409 (0.0005) [2023-12-26 02:24:25,603][123091] Updated weights for policy 0, policy_version 353542 (0.0006) [2023-12-26 02:24:25,626][123090] Updated weights for policy 1, policy_version 351419 (0.0010) [2023-12-26 02:24:25,657][123091] Updated weights for policy 0, policy_version 353552 (0.0005) [2023-12-26 02:24:26,297][123090] Updated weights for policy 1, policy_version 351429 (0.0008) [2023-12-26 02:24:26,353][123090] Updated weights for policy 1, policy_version 351439 (0.0005) [2023-12-26 02:24:26,410][123090] Updated weights for policy 1, policy_version 351449 (0.0007) [2023-12-26 02:24:26,431][123091] Updated weights for policy 0, policy_version 353562 (0.0007) [2023-12-26 02:24:26,486][123091] Updated weights for policy 0, policy_version 353572 (0.0009) [2023-12-26 02:24:26,539][123091] Updated weights for policy 0, policy_version 353582 (0.0010) [2023-12-26 02:24:27,099][123090] Updated weights for policy 1, policy_version 351459 (0.0007) [2023-12-26 02:24:27,160][123090] Updated weights for policy 1, policy_version 351469 (0.0009) [2023-12-26 02:24:27,213][123090] Updated weights for policy 1, policy_version 351479 (0.0009) [2023-12-26 02:24:27,427][123091] Updated weights for policy 0, policy_version 353592 (0.0009) [2023-12-26 02:24:27,475][123091] Updated weights for policy 0, policy_version 353603 (0.0009) [2023-12-26 02:24:27,526][123091] Updated weights for policy 0, policy_version 353613 (0.0009) [2023-12-26 02:24:28,021][123090] Updated weights for policy 1, policy_version 351489 (0.0009) [2023-12-26 02:24:28,068][123090] Updated weights for policy 1, policy_version 351499 (0.0009) [2023-12-26 02:24:28,122][123090] Updated weights for policy 1, policy_version 351509 (0.0008) [2023-12-26 02:24:28,173][123090] Updated weights for policy 1, policy_version 351519 (0.0008) [2023-12-26 02:24:28,417][123091] Updated weights for policy 0, policy_version 353623 (0.0010) [2023-12-26 02:24:28,482][123091] Updated weights for policy 0, policy_version 353633 (0.0010) [2023-12-26 02:24:28,541][123091] Updated weights for policy 0, policy_version 353644 (0.0010) [2023-12-26 02:24:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 180527104. Throughput: 0: 8843.7, 1: 8841.6. Samples: 180520556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:28,784][121949] Avg episode reward: [(0, '6318.995'), (1, '5340.224')] [2023-12-26 02:24:28,941][123090] Updated weights for policy 1, policy_version 351529 (0.0010) [2023-12-26 02:24:28,996][123090] Updated weights for policy 1, policy_version 351539 (0.0009) [2023-12-26 02:24:29,067][123090] Updated weights for policy 1, policy_version 351549 (0.0009) [2023-12-26 02:24:29,408][123091] Updated weights for policy 0, policy_version 353655 (0.0009) [2023-12-26 02:24:29,468][123091] Updated weights for policy 0, policy_version 353665 (0.0010) [2023-12-26 02:24:29,533][123091] Updated weights for policy 0, policy_version 353675 (0.0010) [2023-12-26 02:24:29,853][123090] Updated weights for policy 1, policy_version 351559 (0.0010) [2023-12-26 02:24:29,922][123090] Updated weights for policy 1, policy_version 351569 (0.0009) [2023-12-26 02:24:29,992][123090] Updated weights for policy 1, policy_version 351579 (0.0010) [2023-12-26 02:24:30,420][123091] Updated weights for policy 0, policy_version 353685 (0.0010) [2023-12-26 02:24:30,481][123091] Updated weights for policy 0, policy_version 353695 (0.0010) [2023-12-26 02:24:30,547][123091] Updated weights for policy 0, policy_version 353705 (0.0010) [2023-12-26 02:24:30,796][123090] Updated weights for policy 1, policy_version 351589 (0.0008) [2023-12-26 02:24:30,844][123090] Updated weights for policy 1, policy_version 351599 (0.0006) [2023-12-26 02:24:30,901][123090] Updated weights for policy 1, policy_version 351609 (0.0009) [2023-12-26 02:24:31,460][123091] Updated weights for policy 0, policy_version 353715 (0.0010) [2023-12-26 02:24:31,528][123091] Updated weights for policy 0, policy_version 353725 (0.0005) [2023-12-26 02:24:31,592][123091] Updated weights for policy 0, policy_version 353735 (0.0006) [2023-12-26 02:24:31,669][123090] Updated weights for policy 1, policy_version 351619 (0.0009) [2023-12-26 02:24:31,748][123090] Updated weights for policy 1, policy_version 351629 (0.0008) [2023-12-26 02:24:31,804][123090] Updated weights for policy 1, policy_version 351639 (0.0006) [2023-12-26 02:24:32,424][123091] Updated weights for policy 0, policy_version 353745 (0.0008) [2023-12-26 02:24:32,479][123091] Updated weights for policy 0, policy_version 353755 (0.0010) [2023-12-26 02:24:32,548][123091] Updated weights for policy 0, policy_version 353765 (0.0009) [2023-12-26 02:24:32,600][123091] Updated weights for policy 0, policy_version 353775 (0.0009) [2023-12-26 02:24:32,607][123090] Updated weights for policy 1, policy_version 351649 (0.0008) [2023-12-26 02:24:32,676][123090] Updated weights for policy 1, policy_version 351659 (0.0010) [2023-12-26 02:24:32,745][123090] Updated weights for policy 1, policy_version 351669 (0.0009) [2023-12-26 02:24:32,808][123090] Updated weights for policy 1, policy_version 351679 (0.0010) [2023-12-26 02:24:33,473][123090] Updated weights for policy 1, policy_version 351689 (0.0008) [2023-12-26 02:24:33,484][123091] Updated weights for policy 0, policy_version 353785 (0.0008) [2023-12-26 02:24:33,534][123090] Updated weights for policy 1, policy_version 351699 (0.0008) [2023-12-26 02:24:33,537][123091] Updated weights for policy 0, policy_version 353795 (0.0008) [2023-12-26 02:24:33,583][123091] Updated weights for policy 0, policy_version 353805 (0.0008) [2023-12-26 02:24:33,596][123090] Updated weights for policy 1, policy_version 351709 (0.0007) [2023-12-26 02:24:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 180617216. Throughput: 0: 8748.0, 1: 8813.9. Samples: 180623960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:33,786][121949] Avg episode reward: [(0, '6305.404'), (1, '5558.413')] [2023-12-26 02:24:34,357][123090] Updated weights for policy 1, policy_version 351719 (0.0009) [2023-12-26 02:24:34,416][123090] Updated weights for policy 1, policy_version 351729 (0.0010) [2023-12-26 02:24:34,453][123091] Updated weights for policy 0, policy_version 353815 (0.0010) [2023-12-26 02:24:34,478][123090] Updated weights for policy 1, policy_version 351739 (0.0007) [2023-12-26 02:24:34,513][123091] Updated weights for policy 0, policy_version 353825 (0.0008) [2023-12-26 02:24:34,584][123091] Updated weights for policy 0, policy_version 353835 (0.0009) [2023-12-26 02:24:35,314][123090] Updated weights for policy 1, policy_version 351749 (0.0009) [2023-12-26 02:24:35,364][123090] Updated weights for policy 1, policy_version 351759 (0.0009) [2023-12-26 02:24:35,407][123091] Updated weights for policy 0, policy_version 353845 (0.0007) [2023-12-26 02:24:35,414][123090] Updated weights for policy 1, policy_version 351769 (0.0009) [2023-12-26 02:24:35,457][123091] Updated weights for policy 0, policy_version 353855 (0.0008) [2023-12-26 02:24:35,509][123091] Updated weights for policy 0, policy_version 353865 (0.0009) [2023-12-26 02:24:36,264][123090] Updated weights for policy 1, policy_version 351779 (0.0008) [2023-12-26 02:24:36,326][123090] Updated weights for policy 1, policy_version 351789 (0.0009) [2023-12-26 02:24:36,373][123091] Updated weights for policy 0, policy_version 353875 (0.0009) [2023-12-26 02:24:36,389][123090] Updated weights for policy 1, policy_version 351799 (0.0008) [2023-12-26 02:24:36,436][123091] Updated weights for policy 0, policy_version 353885 (0.0009) [2023-12-26 02:24:36,505][123091] Updated weights for policy 0, policy_version 353895 (0.0009) [2023-12-26 02:24:37,230][123090] Updated weights for policy 1, policy_version 351809 (0.0009) [2023-12-26 02:24:37,296][123090] Updated weights for policy 1, policy_version 351819 (0.0009) [2023-12-26 02:24:37,352][123091] Updated weights for policy 0, policy_version 353905 (0.0009) [2023-12-26 02:24:37,363][123090] Updated weights for policy 1, policy_version 351829 (0.0009) [2023-12-26 02:24:37,422][123091] Updated weights for policy 0, policy_version 353915 (0.0010) [2023-12-26 02:24:37,424][123090] Updated weights for policy 1, policy_version 351839 (0.0009) [2023-12-26 02:24:37,490][123091] Updated weights for policy 0, policy_version 353925 (0.0006) [2023-12-26 02:24:37,561][123091] Updated weights for policy 0, policy_version 353935 (0.0006) [2023-12-26 02:24:38,253][123090] Updated weights for policy 1, policy_version 351849 (0.0010) [2023-12-26 02:24:38,323][123090] Updated weights for policy 1, policy_version 351859 (0.0010) [2023-12-26 02:24:38,365][123091] Updated weights for policy 0, policy_version 353945 (0.0008) [2023-12-26 02:24:38,390][123090] Updated weights for policy 1, policy_version 351869 (0.0008) [2023-12-26 02:24:38,420][123091] Updated weights for policy 0, policy_version 353955 (0.0009) [2023-12-26 02:24:38,485][123091] Updated weights for policy 0, policy_version 353965 (0.0009) [2023-12-26 02:24:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 180699136. Throughput: 0: 8749.7, 1: 8805.6. Samples: 180674992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:38,785][121949] Avg episode reward: [(0, '6330.476'), (1, '5816.030')] [2023-12-26 02:24:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000353968_90619904.pth... [2023-12-26 02:24:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000351872_90079232.pth... [2023-12-26 02:24:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000352944_90357760.pth [2023-12-26 02:24:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000350848_89817088.pth [2023-12-26 02:24:39,267][123090] Updated weights for policy 1, policy_version 351879 (0.0008) [2023-12-26 02:24:39,272][123091] Updated weights for policy 0, policy_version 353975 (0.0010) [2023-12-26 02:24:39,335][123090] Updated weights for policy 1, policy_version 351889 (0.0008) [2023-12-26 02:24:39,346][123091] Updated weights for policy 0, policy_version 353985 (0.0009) [2023-12-26 02:24:39,405][123090] Updated weights for policy 1, policy_version 351899 (0.0007) [2023-12-26 02:24:39,415][123091] Updated weights for policy 0, policy_version 353995 (0.0009) [2023-12-26 02:24:40,219][123091] Updated weights for policy 0, policy_version 354005 (0.0008) [2023-12-26 02:24:40,274][123090] Updated weights for policy 1, policy_version 351909 (0.0007) [2023-12-26 02:24:40,282][123091] Updated weights for policy 0, policy_version 354015 (0.0006) [2023-12-26 02:24:40,330][123090] Updated weights for policy 1, policy_version 351919 (0.0008) [2023-12-26 02:24:40,334][123091] Updated weights for policy 0, policy_version 354025 (0.0006) [2023-12-26 02:24:40,391][123090] Updated weights for policy 1, policy_version 351929 (0.0009) [2023-12-26 02:24:41,130][123091] Updated weights for policy 0, policy_version 354035 (0.0008) [2023-12-26 02:24:41,200][123091] Updated weights for policy 0, policy_version 354045 (0.0010) [2023-12-26 02:24:41,266][123090] Updated weights for policy 1, policy_version 351939 (0.0008) [2023-12-26 02:24:41,274][123091] Updated weights for policy 0, policy_version 354055 (0.0009) [2023-12-26 02:24:41,338][123090] Updated weights for policy 1, policy_version 351949 (0.0009) [2023-12-26 02:24:41,423][123090] Updated weights for policy 1, policy_version 351959 (0.0009) [2023-12-26 02:24:42,104][123091] Updated weights for policy 0, policy_version 354065 (0.0007) [2023-12-26 02:24:42,174][123091] Updated weights for policy 0, policy_version 354075 (0.0009) [2023-12-26 02:24:42,233][123091] Updated weights for policy 0, policy_version 354085 (0.0010) [2023-12-26 02:24:42,303][123090] Updated weights for policy 1, policy_version 351969 (0.0009) [2023-12-26 02:24:42,305][123091] Updated weights for policy 0, policy_version 354095 (0.0009) [2023-12-26 02:24:42,375][123090] Updated weights for policy 1, policy_version 351979 (0.0008) [2023-12-26 02:24:42,448][123090] Updated weights for policy 1, policy_version 351989 (0.0010) [2023-12-26 02:24:42,514][123090] Updated weights for policy 1, policy_version 351999 (0.0009) [2023-12-26 02:24:43,126][123091] Updated weights for policy 0, policy_version 354105 (0.0009) [2023-12-26 02:24:43,187][123091] Updated weights for policy 0, policy_version 354115 (0.0010) [2023-12-26 02:24:43,253][123091] Updated weights for policy 0, policy_version 354125 (0.0009) [2023-12-26 02:24:43,338][123090] Updated weights for policy 1, policy_version 352009 (0.0010) [2023-12-26 02:24:43,407][123090] Updated weights for policy 1, policy_version 352019 (0.0009) [2023-12-26 02:24:43,475][123090] Updated weights for policy 1, policy_version 352029 (0.0009) [2023-12-26 02:24:43,784][121949] Fps is (10 sec: 16384.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 180781056. Throughput: 0: 8740.2, 1: 8762.9. Samples: 180775600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:43,784][121949] Avg episode reward: [(0, '6304.797'), (1, '5760.402')] [2023-12-26 02:24:44,073][123091] Updated weights for policy 0, policy_version 354135 (0.0010) [2023-12-26 02:24:44,120][123091] Updated weights for policy 0, policy_version 354145 (0.0009) [2023-12-26 02:24:44,175][123091] Updated weights for policy 0, policy_version 354155 (0.0009) [2023-12-26 02:24:44,278][123090] Updated weights for policy 1, policy_version 352039 (0.0009) [2023-12-26 02:24:44,343][123090] Updated weights for policy 1, policy_version 352049 (0.0009) [2023-12-26 02:24:44,403][123090] Updated weights for policy 1, policy_version 352059 (0.0010) [2023-12-26 02:24:45,019][123091] Updated weights for policy 0, policy_version 354165 (0.0009) [2023-12-26 02:24:45,083][123091] Updated weights for policy 0, policy_version 354175 (0.0009) [2023-12-26 02:24:45,139][123091] Updated weights for policy 0, policy_version 354185 (0.0010) [2023-12-26 02:24:45,255][123090] Updated weights for policy 1, policy_version 352069 (0.0009) [2023-12-26 02:24:45,325][123090] Updated weights for policy 1, policy_version 352079 (0.0009) [2023-12-26 02:24:45,382][123090] Updated weights for policy 1, policy_version 352089 (0.0009) [2023-12-26 02:24:45,974][123091] Updated weights for policy 0, policy_version 354195 (0.0009) [2023-12-26 02:24:46,034][123091] Updated weights for policy 0, policy_version 354205 (0.0008) [2023-12-26 02:24:46,083][123091] Updated weights for policy 0, policy_version 354215 (0.0009) [2023-12-26 02:24:46,226][123090] Updated weights for policy 1, policy_version 352099 (0.0009) [2023-12-26 02:24:46,298][123090] Updated weights for policy 1, policy_version 352109 (0.0010) [2023-12-26 02:24:46,372][123090] Updated weights for policy 1, policy_version 352119 (0.0009) [2023-12-26 02:24:46,829][123091] Updated weights for policy 0, policy_version 354225 (0.0010) [2023-12-26 02:24:46,883][123091] Updated weights for policy 0, policy_version 354235 (0.0010) [2023-12-26 02:24:46,930][123091] Updated weights for policy 0, policy_version 354245 (0.0009) [2023-12-26 02:24:46,985][123091] Updated weights for policy 0, policy_version 354255 (0.0010) [2023-12-26 02:24:47,205][123090] Updated weights for policy 1, policy_version 352129 (0.0008) [2023-12-26 02:24:47,262][123090] Updated weights for policy 1, policy_version 352139 (0.0009) [2023-12-26 02:24:47,328][123090] Updated weights for policy 1, policy_version 352149 (0.0009) [2023-12-26 02:24:47,397][123090] Updated weights for policy 1, policy_version 352159 (0.0009) [2023-12-26 02:24:47,827][123091] Updated weights for policy 0, policy_version 354265 (0.0010) [2023-12-26 02:24:47,884][123091] Updated weights for policy 0, policy_version 354275 (0.0010) [2023-12-26 02:24:47,943][123091] Updated weights for policy 0, policy_version 354285 (0.0009) [2023-12-26 02:24:48,192][123090] Updated weights for policy 1, policy_version 352169 (0.0009) [2023-12-26 02:24:48,249][123090] Updated weights for policy 1, policy_version 352179 (0.0010) [2023-12-26 02:24:48,313][123090] Updated weights for policy 1, policy_version 352189 (0.0009) [2023-12-26 02:24:48,765][123091] Updated weights for policy 0, policy_version 354295 (0.0008) [2023-12-26 02:24:48,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17339.8, 300 sec: 17522.5). Total num frames: 180862976. Throughput: 0: 8728.9, 1: 8766.6. Samples: 180878348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:48,785][121949] Avg episode reward: [(0, '6137.439'), (1, '5702.661')] [2023-12-26 02:24:48,840][123091] Updated weights for policy 0, policy_version 354305 (0.0006) [2023-12-26 02:24:48,901][123091] Updated weights for policy 0, policy_version 354315 (0.0006) [2023-12-26 02:24:49,174][123090] Updated weights for policy 1, policy_version 352199 (0.0007) [2023-12-26 02:24:49,273][123090] Updated weights for policy 1, policy_version 352209 (0.0008) [2023-12-26 02:24:49,337][123090] Updated weights for policy 1, policy_version 352219 (0.0009) [2023-12-26 02:24:49,586][123091] Updated weights for policy 0, policy_version 354326 (0.0007) [2023-12-26 02:24:49,644][123091] Updated weights for policy 0, policy_version 354336 (0.0005) [2023-12-26 02:24:49,702][123091] Updated weights for policy 0, policy_version 354346 (0.0005) [2023-12-26 02:24:50,156][123090] Updated weights for policy 1, policy_version 352229 (0.0010) [2023-12-26 02:24:50,211][123090] Updated weights for policy 1, policy_version 352239 (0.0009) [2023-12-26 02:24:50,277][123090] Updated weights for policy 1, policy_version 352249 (0.0008) [2023-12-26 02:24:50,445][123091] Updated weights for policy 0, policy_version 354356 (0.0007) [2023-12-26 02:24:50,508][123091] Updated weights for policy 0, policy_version 354366 (0.0009) [2023-12-26 02:24:50,565][123091] Updated weights for policy 0, policy_version 354376 (0.0007) [2023-12-26 02:24:51,147][123090] Updated weights for policy 1, policy_version 352259 (0.0009) [2023-12-26 02:24:51,217][123090] Updated weights for policy 1, policy_version 352269 (0.0010) [2023-12-26 02:24:51,288][123090] Updated weights for policy 1, policy_version 352279 (0.0009) [2023-12-26 02:24:51,374][123091] Updated weights for policy 0, policy_version 354386 (0.0010) [2023-12-26 02:24:51,447][123091] Updated weights for policy 0, policy_version 354396 (0.0010) [2023-12-26 02:24:51,509][123091] Updated weights for policy 0, policy_version 354406 (0.0010) [2023-12-26 02:24:51,565][123091] Updated weights for policy 0, policy_version 354416 (0.0008) [2023-12-26 02:24:52,191][123090] Updated weights for policy 1, policy_version 352289 (0.0009) [2023-12-26 02:24:52,238][123090] Updated weights for policy 1, policy_version 352299 (0.0009) [2023-12-26 02:24:52,301][123090] Updated weights for policy 1, policy_version 352309 (0.0009) [2023-12-26 02:24:52,331][123091] Updated weights for policy 0, policy_version 354426 (0.0007) [2023-12-26 02:24:52,372][123090] Updated weights for policy 1, policy_version 352319 (0.0010) [2023-12-26 02:24:52,398][123091] Updated weights for policy 0, policy_version 354436 (0.0011) [2023-12-26 02:24:52,449][123091] Updated weights for policy 0, policy_version 354446 (0.0010) [2023-12-26 02:24:53,209][123090] Updated weights for policy 1, policy_version 352329 (0.0009) [2023-12-26 02:24:53,258][123090] Updated weights for policy 1, policy_version 352339 (0.0009) [2023-12-26 02:24:53,291][123091] Updated weights for policy 0, policy_version 354456 (0.0008) [2023-12-26 02:24:53,307][123090] Updated weights for policy 1, policy_version 352349 (0.0007) [2023-12-26 02:24:53,348][123091] Updated weights for policy 0, policy_version 354466 (0.0008) [2023-12-26 02:24:53,411][123091] Updated weights for policy 0, policy_version 354476 (0.0009) [2023-12-26 02:24:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 180953088. Throughput: 0: 8738.4, 1: 8676.4. Samples: 180930148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:53,785][121949] Avg episode reward: [(0, '6031.201'), (1, '5668.201')] [2023-12-26 02:24:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000354480_90750976.pth... [2023-12-26 02:24:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000352352_90202112.pth... [2023-12-26 02:24:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000353488_90497024.pth [2023-12-26 02:24:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000351328_89939968.pth [2023-12-26 02:24:54,111][123091] Updated weights for policy 0, policy_version 354486 (0.0008) [2023-12-26 02:24:54,166][123091] Updated weights for policy 0, policy_version 354496 (0.0009) [2023-12-26 02:24:54,197][123090] Updated weights for policy 1, policy_version 352359 (0.0009) [2023-12-26 02:24:54,222][123091] Updated weights for policy 0, policy_version 354506 (0.0007) [2023-12-26 02:24:54,251][123090] Updated weights for policy 1, policy_version 352369 (0.0008) [2023-12-26 02:24:54,303][123090] Updated weights for policy 1, policy_version 352379 (0.0009) [2023-12-26 02:24:55,058][123091] Updated weights for policy 0, policy_version 354516 (0.0008) [2023-12-26 02:24:55,122][123091] Updated weights for policy 0, policy_version 354526 (0.0009) [2023-12-26 02:24:55,147][123090] Updated weights for policy 1, policy_version 352389 (0.0008) [2023-12-26 02:24:55,176][123091] Updated weights for policy 0, policy_version 354536 (0.0007) [2023-12-26 02:24:55,205][123090] Updated weights for policy 1, policy_version 352399 (0.0009) [2023-12-26 02:24:55,259][123090] Updated weights for policy 1, policy_version 352409 (0.0009) [2023-12-26 02:24:55,924][123091] Updated weights for policy 0, policy_version 354546 (0.0008) [2023-12-26 02:24:55,973][123091] Updated weights for policy 0, policy_version 354556 (0.0009) [2023-12-26 02:24:56,028][123091] Updated weights for policy 0, policy_version 354566 (0.0010) [2023-12-26 02:24:56,086][123091] Updated weights for policy 0, policy_version 354576 (0.0009) [2023-12-26 02:24:56,107][123090] Updated weights for policy 1, policy_version 352419 (0.0010) [2023-12-26 02:24:56,166][123090] Updated weights for policy 1, policy_version 352429 (0.0009) [2023-12-26 02:24:56,230][123090] Updated weights for policy 1, policy_version 352439 (0.0009) [2023-12-26 02:24:56,835][123091] Updated weights for policy 0, policy_version 354586 (0.0006) [2023-12-26 02:24:56,895][123091] Updated weights for policy 0, policy_version 354596 (0.0008) [2023-12-26 02:24:56,947][123091] Updated weights for policy 0, policy_version 354606 (0.0009) [2023-12-26 02:24:57,117][123090] Updated weights for policy 1, policy_version 352449 (0.0010) [2023-12-26 02:24:57,184][123090] Updated weights for policy 1, policy_version 352459 (0.0009) [2023-12-26 02:24:57,254][123090] Updated weights for policy 1, policy_version 352469 (0.0009) [2023-12-26 02:24:57,314][123090] Updated weights for policy 1, policy_version 352479 (0.0010) [2023-12-26 02:24:57,712][123091] Updated weights for policy 0, policy_version 354616 (0.0009) [2023-12-26 02:24:57,762][123091] Updated weights for policy 0, policy_version 354626 (0.0010) [2023-12-26 02:24:57,818][123091] Updated weights for policy 0, policy_version 354636 (0.0006) [2023-12-26 02:24:58,134][123090] Updated weights for policy 1, policy_version 352489 (0.0006) [2023-12-26 02:24:58,208][123090] Updated weights for policy 1, policy_version 352499 (0.0006) [2023-12-26 02:24:58,270][123090] Updated weights for policy 1, policy_version 352509 (0.0009) [2023-12-26 02:24:58,706][123091] Updated weights for policy 0, policy_version 354646 (0.0011) [2023-12-26 02:24:58,766][123091] Updated weights for policy 0, policy_version 354656 (0.0006) [2023-12-26 02:24:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 181035008. Throughput: 0: 8770.0, 1: 8632.8. Samples: 181033768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:24:58,785][121949] Avg episode reward: [(0, '6161.470'), (1, '5713.426')] [2023-12-26 02:24:58,837][123091] Updated weights for policy 0, policy_version 354666 (0.0008) [2023-12-26 02:24:59,090][123090] Updated weights for policy 1, policy_version 352519 (0.0009) [2023-12-26 02:24:59,161][123090] Updated weights for policy 1, policy_version 352529 (0.0009) [2023-12-26 02:24:59,230][123090] Updated weights for policy 1, policy_version 352539 (0.0009) [2023-12-26 02:24:59,655][123091] Updated weights for policy 0, policy_version 354676 (0.0008) [2023-12-26 02:24:59,718][123091] Updated weights for policy 0, policy_version 354686 (0.0009) [2023-12-26 02:24:59,770][123091] Updated weights for policy 0, policy_version 354696 (0.0010) [2023-12-26 02:24:59,978][123090] Updated weights for policy 1, policy_version 352549 (0.0010) [2023-12-26 02:25:00,036][123090] Updated weights for policy 1, policy_version 352559 (0.0009) [2023-12-26 02:25:00,101][123090] Updated weights for policy 1, policy_version 352569 (0.0009) [2023-12-26 02:25:00,531][123091] Updated weights for policy 0, policy_version 354706 (0.0009) [2023-12-26 02:25:00,596][123091] Updated weights for policy 0, policy_version 354716 (0.0005) [2023-12-26 02:25:00,644][123091] Updated weights for policy 0, policy_version 354726 (0.0006) [2023-12-26 02:25:00,706][123091] Updated weights for policy 0, policy_version 354736 (0.0005) [2023-12-26 02:25:01,000][123090] Updated weights for policy 1, policy_version 352579 (0.0010) [2023-12-26 02:25:01,070][123090] Updated weights for policy 1, policy_version 352589 (0.0009) [2023-12-26 02:25:01,134][123090] Updated weights for policy 1, policy_version 352599 (0.0010) [2023-12-26 02:25:01,355][123091] Updated weights for policy 0, policy_version 354746 (0.0008) [2023-12-26 02:25:01,424][123091] Updated weights for policy 0, policy_version 354756 (0.0009) [2023-12-26 02:25:01,483][123091] Updated weights for policy 0, policy_version 354766 (0.0011) [2023-12-26 02:25:02,011][123090] Updated weights for policy 1, policy_version 352609 (0.0010) [2023-12-26 02:25:02,066][123090] Updated weights for policy 1, policy_version 352619 (0.0009) [2023-12-26 02:25:02,127][123090] Updated weights for policy 1, policy_version 352629 (0.0009) [2023-12-26 02:25:02,190][123090] Updated weights for policy 1, policy_version 352639 (0.0010) [2023-12-26 02:25:02,289][123091] Updated weights for policy 0, policy_version 354776 (0.0009) [2023-12-26 02:25:02,358][123091] Updated weights for policy 0, policy_version 354786 (0.0009) [2023-12-26 02:25:02,421][123091] Updated weights for policy 0, policy_version 354796 (0.0009) [2023-12-26 02:25:02,907][123090] Updated weights for policy 1, policy_version 352649 (0.0007) [2023-12-26 02:25:02,956][123090] Updated weights for policy 1, policy_version 352659 (0.0005) [2023-12-26 02:25:03,007][123090] Updated weights for policy 1, policy_version 352669 (0.0005) [2023-12-26 02:25:03,252][123091] Updated weights for policy 0, policy_version 354806 (0.0007) [2023-12-26 02:25:03,302][123091] Updated weights for policy 0, policy_version 354816 (0.0005) [2023-12-26 02:25:03,346][123091] Updated weights for policy 0, policy_version 354826 (0.0005) [2023-12-26 02:25:03,681][123090] Updated weights for policy 1, policy_version 352679 (0.0005) [2023-12-26 02:25:03,728][123090] Updated weights for policy 1, policy_version 352689 (0.0005) [2023-12-26 02:25:03,778][123090] Updated weights for policy 1, policy_version 352699 (0.0005) [2023-12-26 02:25:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 181125120. Throughput: 0: 8707.4, 1: 8645.7. Samples: 181140752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:25:03,785][121949] Avg episode reward: [(0, '6243.474'), (1, '5720.768')] [2023-12-26 02:25:04,089][123091] Updated weights for policy 0, policy_version 354836 (0.0007) [2023-12-26 02:25:04,150][123091] Updated weights for policy 0, policy_version 354846 (0.0009) [2023-12-26 02:25:04,216][123091] Updated weights for policy 0, policy_version 354856 (0.0009) [2023-12-26 02:25:04,640][123090] Updated weights for policy 1, policy_version 352709 (0.0008) [2023-12-26 02:25:04,695][123090] Updated weights for policy 1, policy_version 352719 (0.0010) [2023-12-26 02:25:04,750][123090] Updated weights for policy 1, policy_version 352729 (0.0010) [2023-12-26 02:25:05,012][123091] Updated weights for policy 0, policy_version 354866 (0.0010) [2023-12-26 02:25:05,074][123091] Updated weights for policy 0, policy_version 354876 (0.0009) [2023-12-26 02:25:05,133][123091] Updated weights for policy 0, policy_version 354886 (0.0009) [2023-12-26 02:25:05,194][123091] Updated weights for policy 0, policy_version 354896 (0.0009) [2023-12-26 02:25:05,501][123090] Updated weights for policy 1, policy_version 352739 (0.0008) [2023-12-26 02:25:05,547][123090] Updated weights for policy 1, policy_version 352749 (0.0005) [2023-12-26 02:25:05,594][123090] Updated weights for policy 1, policy_version 352759 (0.0005) [2023-12-26 02:25:06,058][123091] Updated weights for policy 0, policy_version 354906 (0.0009) [2023-12-26 02:25:06,114][123091] Updated weights for policy 0, policy_version 354916 (0.0009) [2023-12-26 02:25:06,171][123091] Updated weights for policy 0, policy_version 354926 (0.0009) [2023-12-26 02:25:06,341][123090] Updated weights for policy 1, policy_version 352769 (0.0009) [2023-12-26 02:25:06,400][123090] Updated weights for policy 1, policy_version 352779 (0.0007) [2023-12-26 02:25:06,464][123090] Updated weights for policy 1, policy_version 352789 (0.0005) [2023-12-26 02:25:06,522][123090] Updated weights for policy 1, policy_version 352799 (0.0009) [2023-12-26 02:25:07,033][123091] Updated weights for policy 0, policy_version 354936 (0.0010) [2023-12-26 02:25:07,110][123091] Updated weights for policy 0, policy_version 354946 (0.0010) [2023-12-26 02:25:07,176][123091] Updated weights for policy 0, policy_version 354956 (0.0008) [2023-12-26 02:25:07,198][123090] Updated weights for policy 1, policy_version 352809 (0.0006) [2023-12-26 02:25:07,260][123090] Updated weights for policy 1, policy_version 352819 (0.0007) [2023-12-26 02:25:07,333][123090] Updated weights for policy 1, policy_version 352829 (0.0005) [2023-12-26 02:25:07,801][123091] Updated weights for policy 0, policy_version 354966 (0.0008) [2023-12-26 02:25:07,872][123091] Updated weights for policy 0, policy_version 354976 (0.0009) [2023-12-26 02:25:07,926][123091] Updated weights for policy 0, policy_version 354986 (0.0009) [2023-12-26 02:25:08,043][123090] Updated weights for policy 1, policy_version 352839 (0.0008) [2023-12-26 02:25:08,098][123090] Updated weights for policy 1, policy_version 352849 (0.0008) [2023-12-26 02:25:08,162][123090] Updated weights for policy 1, policy_version 352859 (0.0010) [2023-12-26 02:25:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 181215232. Throughput: 0: 8683.9, 1: 8714.1. Samples: 181193612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:25:08,785][121949] Avg episode reward: [(0, '6251.033'), (1, '5856.584')] [2023-12-26 02:25:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000352864_90333184.pth... [2023-12-26 02:25:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000351872_90079232.pth [2023-12-26 02:25:08,808][123091] Updated weights for policy 0, policy_version 354996 (0.0009) [2023-12-26 02:25:08,864][123091] Updated weights for policy 0, policy_version 355006 (0.0009) [2023-12-26 02:25:08,889][123090] Updated weights for policy 1, policy_version 352869 (0.0010) [2023-12-26 02:25:08,914][123091] Updated weights for policy 0, policy_version 355016 (0.0008) [2023-12-26 02:25:08,945][123090] Updated weights for policy 1, policy_version 352879 (0.0005) [2023-12-26 02:25:08,954][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000355024_90890240.pth... [2023-12-26 02:25:08,959][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000353968_90619904.pth [2023-12-26 02:25:09,004][123090] Updated weights for policy 1, policy_version 352889 (0.0006) [2023-12-26 02:25:09,759][123091] Updated weights for policy 0, policy_version 355026 (0.0007) [2023-12-26 02:25:09,811][123090] Updated weights for policy 1, policy_version 352899 (0.0010) [2023-12-26 02:25:09,817][123091] Updated weights for policy 0, policy_version 355036 (0.0008) [2023-12-26 02:25:09,882][123091] Updated weights for policy 0, policy_version 355046 (0.0006) [2023-12-26 02:25:09,884][123090] Updated weights for policy 1, policy_version 352910 (0.0008) [2023-12-26 02:25:09,952][123091] Updated weights for policy 0, policy_version 355056 (0.0008) [2023-12-26 02:25:09,953][123090] Updated weights for policy 1, policy_version 352920 (0.0008) [2023-12-26 02:25:10,719][123090] Updated weights for policy 1, policy_version 352930 (0.0009) [2023-12-26 02:25:10,768][123091] Updated weights for policy 0, policy_version 355066 (0.0009) [2023-12-26 02:25:10,776][123090] Updated weights for policy 1, policy_version 352940 (0.0006) [2023-12-26 02:25:10,821][123091] Updated weights for policy 0, policy_version 355076 (0.0008) [2023-12-26 02:25:10,835][123090] Updated weights for policy 1, policy_version 352950 (0.0005) [2023-12-26 02:25:10,873][123091] Updated weights for policy 0, policy_version 355086 (0.0008) [2023-12-26 02:25:10,887][123090] Updated weights for policy 1, policy_version 352960 (0.0005) [2023-12-26 02:25:11,652][123090] Updated weights for policy 1, policy_version 352970 (0.0009) [2023-12-26 02:25:11,729][123090] Updated weights for policy 1, policy_version 352980 (0.0009) [2023-12-26 02:25:11,775][123091] Updated weights for policy 0, policy_version 355096 (0.0009) [2023-12-26 02:25:11,793][123090] Updated weights for policy 1, policy_version 352990 (0.0006) [2023-12-26 02:25:11,835][123091] Updated weights for policy 0, policy_version 355106 (0.0009) [2023-12-26 02:25:11,900][123091] Updated weights for policy 0, policy_version 355116 (0.0010) [2023-12-26 02:25:12,443][123090] Updated weights for policy 1, policy_version 353000 (0.0011) [2023-12-26 02:25:12,507][123090] Updated weights for policy 1, policy_version 353010 (0.0010) [2023-12-26 02:25:12,575][123090] Updated weights for policy 1, policy_version 353020 (0.0011) [2023-12-26 02:25:12,719][123091] Updated weights for policy 0, policy_version 355126 (0.0009) [2023-12-26 02:25:12,784][123091] Updated weights for policy 0, policy_version 355136 (0.0010) [2023-12-26 02:25:12,846][123091] Updated weights for policy 0, policy_version 355146 (0.0009) [2023-12-26 02:25:13,311][123090] Updated weights for policy 1, policy_version 353030 (0.0008) [2023-12-26 02:25:13,360][123090] Updated weights for policy 1, policy_version 353040 (0.0005) [2023-12-26 02:25:13,412][123090] Updated weights for policy 1, policy_version 353050 (0.0008) [2023-12-26 02:25:13,670][123091] Updated weights for policy 0, policy_version 355156 (0.0009) [2023-12-26 02:25:13,720][123091] Updated weights for policy 0, policy_version 355166 (0.0009) [2023-12-26 02:25:13,772][123091] Updated weights for policy 0, policy_version 355177 (0.0010) [2023-12-26 02:25:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 181305344. Throughput: 0: 8661.9, 1: 8677.0. Samples: 181300808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:25:13,785][121949] Avg episode reward: [(0, '6207.216'), (1, '5851.067')] [2023-12-26 02:25:14,145][123090] Updated weights for policy 1, policy_version 353060 (0.0007) [2023-12-26 02:25:14,192][123090] Updated weights for policy 1, policy_version 353070 (0.0007) [2023-12-26 02:25:14,264][123090] Updated weights for policy 1, policy_version 353080 (0.0008) [2023-12-26 02:25:14,665][123091] Updated weights for policy 0, policy_version 355187 (0.0010) [2023-12-26 02:25:14,723][123091] Updated weights for policy 0, policy_version 355197 (0.0010) [2023-12-26 02:25:14,788][123091] Updated weights for policy 0, policy_version 355207 (0.0009) [2023-12-26 02:25:15,081][123090] Updated weights for policy 1, policy_version 353090 (0.0009) [2023-12-26 02:25:15,150][123090] Updated weights for policy 1, policy_version 353100 (0.0009) [2023-12-26 02:25:15,226][123090] Updated weights for policy 1, policy_version 353110 (0.0006) [2023-12-26 02:25:15,294][123090] Updated weights for policy 1, policy_version 353120 (0.0007) [2023-12-26 02:25:15,644][123091] Updated weights for policy 0, policy_version 355217 (0.0010) [2023-12-26 02:25:15,713][123091] Updated weights for policy 0, policy_version 355227 (0.0009) [2023-12-26 02:25:15,769][123091] Updated weights for policy 0, policy_version 355238 (0.0009) [2023-12-26 02:25:15,821][123091] Updated weights for policy 0, policy_version 355248 (0.0009) [2023-12-26 02:25:16,058][123090] Updated weights for policy 1, policy_version 353130 (0.0009) [2023-12-26 02:25:16,125][123090] Updated weights for policy 1, policy_version 353140 (0.0009) [2023-12-26 02:25:16,180][123090] Updated weights for policy 1, policy_version 353150 (0.0009) [2023-12-26 02:25:16,652][123091] Updated weights for policy 0, policy_version 355258 (0.0009) [2023-12-26 02:25:16,700][123091] Updated weights for policy 0, policy_version 355268 (0.0009) [2023-12-26 02:25:16,748][123091] Updated weights for policy 0, policy_version 355278 (0.0009) [2023-12-26 02:25:17,035][123090] Updated weights for policy 1, policy_version 353160 (0.0010) [2023-12-26 02:25:17,097][123090] Updated weights for policy 1, policy_version 353171 (0.0010) [2023-12-26 02:25:17,153][123090] Updated weights for policy 1, policy_version 353181 (0.0009) [2023-12-26 02:25:17,602][123091] Updated weights for policy 0, policy_version 355288 (0.0009) [2023-12-26 02:25:17,665][123091] Updated weights for policy 0, policy_version 355298 (0.0009) [2023-12-26 02:25:17,724][123091] Updated weights for policy 0, policy_version 355308 (0.0009) [2023-12-26 02:25:17,972][123090] Updated weights for policy 1, policy_version 353191 (0.0010) [2023-12-26 02:25:18,038][123090] Updated weights for policy 1, policy_version 353201 (0.0010) [2023-12-26 02:25:18,112][123090] Updated weights for policy 1, policy_version 353211 (0.0011) [2023-12-26 02:25:18,454][123091] Updated weights for policy 0, policy_version 355318 (0.0008) [2023-12-26 02:25:18,502][123091] Updated weights for policy 0, policy_version 355328 (0.0009) [2023-12-26 02:25:18,563][123091] Updated weights for policy 0, policy_version 355338 (0.0009) [2023-12-26 02:25:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 181395456. Throughput: 0: 8718.7, 1: 8676.9. Samples: 181406760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:25:18,785][121949] Avg episode reward: [(0, '6179.978'), (1, '5605.638')] [2023-12-26 02:25:18,939][123090] Updated weights for policy 1, policy_version 353221 (0.0010) [2023-12-26 02:25:18,987][123090] Updated weights for policy 1, policy_version 353231 (0.0010) [2023-12-26 02:25:19,043][123090] Updated weights for policy 1, policy_version 353241 (0.0008) [2023-12-26 02:25:19,390][123091] Updated weights for policy 0, policy_version 355348 (0.0009) [2023-12-26 02:25:19,450][123091] Updated weights for policy 0, policy_version 355358 (0.0009) [2023-12-26 02:25:19,524][123091] Updated weights for policy 0, policy_version 355368 (0.0008) [2023-12-26 02:25:19,782][123090] Updated weights for policy 1, policy_version 353251 (0.0005) [2023-12-26 02:25:19,857][123090] Updated weights for policy 1, policy_version 353261 (0.0007) [2023-12-26 02:25:19,933][123090] Updated weights for policy 1, policy_version 353271 (0.0006) [2023-12-26 02:25:20,343][123091] Updated weights for policy 0, policy_version 355378 (0.0010) [2023-12-26 02:25:20,399][123091] Updated weights for policy 0, policy_version 355388 (0.0011) [2023-12-26 02:25:20,456][123091] Updated weights for policy 0, policy_version 355398 (0.0008) [2023-12-26 02:25:20,517][123091] Updated weights for policy 0, policy_version 355408 (0.0007) [2023-12-26 02:25:20,660][123090] Updated weights for policy 1, policy_version 353281 (0.0010) [2023-12-26 02:25:20,727][123090] Updated weights for policy 1, policy_version 353291 (0.0011) [2023-12-26 02:25:20,779][123090] Updated weights for policy 1, policy_version 353301 (0.0010) [2023-12-26 02:25:20,840][123090] Updated weights for policy 1, policy_version 353311 (0.0011) [2023-12-26 02:25:21,376][123091] Updated weights for policy 0, policy_version 355418 (0.0009) [2023-12-26 02:25:21,433][123091] Updated weights for policy 0, policy_version 355428 (0.0009) [2023-12-26 02:25:21,504][123091] Updated weights for policy 0, policy_version 355438 (0.0009) [2023-12-26 02:25:21,696][123090] Updated weights for policy 1, policy_version 353321 (0.0011) [2023-12-26 02:25:21,771][123090] Updated weights for policy 1, policy_version 353331 (0.0011) [2023-12-26 02:25:21,835][123090] Updated weights for policy 1, policy_version 353341 (0.0010) [2023-12-26 02:25:22,333][123091] Updated weights for policy 0, policy_version 355448 (0.0009) [2023-12-26 02:25:22,418][123091] Updated weights for policy 0, policy_version 355458 (0.0009) [2023-12-26 02:25:22,489][123091] Updated weights for policy 0, policy_version 355468 (0.0010) [2023-12-26 02:25:22,616][123090] Updated weights for policy 1, policy_version 353351 (0.0008) [2023-12-26 02:25:22,690][123090] Updated weights for policy 1, policy_version 353361 (0.0008) [2023-12-26 02:25:22,754][123090] Updated weights for policy 1, policy_version 353371 (0.0007) [2023-12-26 02:25:23,371][123090] Updated weights for policy 1, policy_version 353381 (0.0005) [2023-12-26 02:25:23,386][123091] Updated weights for policy 0, policy_version 355478 (0.0010) [2023-12-26 02:25:23,440][123090] Updated weights for policy 1, policy_version 353391 (0.0006) [2023-12-26 02:25:23,440][123091] Updated weights for policy 0, policy_version 355488 (0.0009) [2023-12-26 02:25:23,512][123091] Updated weights for policy 0, policy_version 355498 (0.0008) [2023-12-26 02:25:23,517][123090] Updated weights for policy 1, policy_version 353401 (0.0005) [2023-12-26 02:25:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 181485568. Throughput: 0: 8721.7, 1: 8688.0. Samples: 181458428. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:23,785][121949] Avg episode reward: [(0, '6204.336'), (1, '5668.310')] [2023-12-26 02:25:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000355504_91013120.pth... [2023-12-26 02:25:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000353408_90472448.pth... [2023-12-26 02:25:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000354480_90750976.pth [2023-12-26 02:25:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000352352_90202112.pth [2023-12-26 02:25:24,126][123090] Updated weights for policy 1, policy_version 353411 (0.0005) [2023-12-26 02:25:24,175][123090] Updated weights for policy 1, policy_version 353421 (0.0005) [2023-12-26 02:25:24,232][123090] Updated weights for policy 1, policy_version 353431 (0.0005) [2023-12-26 02:25:24,385][123091] Updated weights for policy 0, policy_version 355508 (0.0010) [2023-12-26 02:25:24,440][123091] Updated weights for policy 0, policy_version 355519 (0.0010) [2023-12-26 02:25:24,494][123091] Updated weights for policy 0, policy_version 355529 (0.0010) [2023-12-26 02:25:24,923][123090] Updated weights for policy 1, policy_version 353441 (0.0005) [2023-12-26 02:25:24,984][123090] Updated weights for policy 1, policy_version 353451 (0.0005) [2023-12-26 02:25:25,039][123090] Updated weights for policy 1, policy_version 353461 (0.0005) [2023-12-26 02:25:25,098][123090] Updated weights for policy 1, policy_version 353471 (0.0005) [2023-12-26 02:25:25,456][123091] Updated weights for policy 0, policy_version 355539 (0.0009) [2023-12-26 02:25:25,515][123091] Updated weights for policy 0, policy_version 355549 (0.0009) [2023-12-26 02:25:25,568][123091] Updated weights for policy 0, policy_version 355559 (0.0009) [2023-12-26 02:25:25,794][123090] Updated weights for policy 1, policy_version 353481 (0.0005) [2023-12-26 02:25:25,871][123090] Updated weights for policy 1, policy_version 353491 (0.0005) [2023-12-26 02:25:25,943][123090] Updated weights for policy 1, policy_version 353501 (0.0006) [2023-12-26 02:25:26,404][123091] Updated weights for policy 0, policy_version 355569 (0.0006) [2023-12-26 02:25:26,470][123091] Updated weights for policy 0, policy_version 355579 (0.0009) [2023-12-26 02:25:26,507][123090] Updated weights for policy 1, policy_version 353511 (0.0007) [2023-12-26 02:25:26,533][123091] Updated weights for policy 0, policy_version 355589 (0.0008) [2023-12-26 02:25:26,567][123090] Updated weights for policy 1, policy_version 353521 (0.0007) [2023-12-26 02:25:26,601][123091] Updated weights for policy 0, policy_version 355599 (0.0007) [2023-12-26 02:25:26,635][123090] Updated weights for policy 1, policy_version 353531 (0.0005) [2023-12-26 02:25:27,295][123091] Updated weights for policy 0, policy_version 355609 (0.0007) [2023-12-26 02:25:27,306][123090] Updated weights for policy 1, policy_version 353541 (0.0005) [2023-12-26 02:25:27,362][123091] Updated weights for policy 0, policy_version 355619 (0.0008) [2023-12-26 02:25:27,374][123090] Updated weights for policy 1, policy_version 353551 (0.0005) [2023-12-26 02:25:27,423][123091] Updated weights for policy 0, policy_version 355629 (0.0009) [2023-12-26 02:25:27,436][123090] Updated weights for policy 1, policy_version 353561 (0.0008) [2023-12-26 02:25:28,074][123091] Updated weights for policy 0, policy_version 355639 (0.0010) [2023-12-26 02:25:28,134][123091] Updated weights for policy 0, policy_version 355649 (0.0009) [2023-12-26 02:25:28,162][123090] Updated weights for policy 1, policy_version 353571 (0.0006) [2023-12-26 02:25:28,196][123091] Updated weights for policy 0, policy_version 355659 (0.0008) [2023-12-26 02:25:28,211][123090] Updated weights for policy 1, policy_version 353581 (0.0005) [2023-12-26 02:25:28,271][123090] Updated weights for policy 1, policy_version 353591 (0.0007) [2023-12-26 02:25:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 181575680. Throughput: 0: 8698.3, 1: 8933.5. Samples: 181569032. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:28,785][121949] Avg episode reward: [(0, '6192.690'), (1, '5952.281')] [2023-12-26 02:25:29,005][123090] Updated weights for policy 1, policy_version 353601 (0.0006) [2023-12-26 02:25:29,063][123090] Updated weights for policy 1, policy_version 353611 (0.0005) [2023-12-26 02:25:29,086][123091] Updated weights for policy 0, policy_version 355669 (0.0008) [2023-12-26 02:25:29,126][123090] Updated weights for policy 1, policy_version 353621 (0.0005) [2023-12-26 02:25:29,146][123091] Updated weights for policy 0, policy_version 355679 (0.0008) [2023-12-26 02:25:29,179][123090] Updated weights for policy 1, policy_version 353631 (0.0005) [2023-12-26 02:25:29,203][123091] Updated weights for policy 0, policy_version 355689 (0.0008) [2023-12-26 02:25:29,898][123090] Updated weights for policy 1, policy_version 353641 (0.0007) [2023-12-26 02:25:29,972][123090] Updated weights for policy 1, policy_version 353651 (0.0008) [2023-12-26 02:25:30,039][123090] Updated weights for policy 1, policy_version 353661 (0.0009) [2023-12-26 02:25:30,130][123091] Updated weights for policy 0, policy_version 355699 (0.0009) [2023-12-26 02:25:30,192][123091] Updated weights for policy 0, policy_version 355709 (0.0009) [2023-12-26 02:25:30,259][123091] Updated weights for policy 0, policy_version 355719 (0.0009) [2023-12-26 02:25:30,827][123090] Updated weights for policy 1, policy_version 353671 (0.0006) [2023-12-26 02:25:30,885][123090] Updated weights for policy 1, policy_version 353681 (0.0005) [2023-12-26 02:25:30,938][123090] Updated weights for policy 1, policy_version 353691 (0.0006) [2023-12-26 02:25:31,099][123091] Updated weights for policy 0, policy_version 355729 (0.0010) [2023-12-26 02:25:31,173][123091] Updated weights for policy 0, policy_version 355739 (0.0010) [2023-12-26 02:25:31,230][123091] Updated weights for policy 0, policy_version 355749 (0.0009) [2023-12-26 02:25:31,298][123091] Updated weights for policy 0, policy_version 355759 (0.0006) [2023-12-26 02:25:31,716][123090] Updated weights for policy 1, policy_version 353701 (0.0008) [2023-12-26 02:25:31,796][123090] Updated weights for policy 1, policy_version 353711 (0.0008) [2023-12-26 02:25:31,860][123090] Updated weights for policy 1, policy_version 353721 (0.0008) [2023-12-26 02:25:32,088][123091] Updated weights for policy 0, policy_version 355769 (0.0006) [2023-12-26 02:25:32,137][123091] Updated weights for policy 0, policy_version 355779 (0.0005) [2023-12-26 02:25:32,191][123091] Updated weights for policy 0, policy_version 355789 (0.0005) [2023-12-26 02:25:32,688][123090] Updated weights for policy 1, policy_version 353731 (0.0009) [2023-12-26 02:25:32,762][123090] Updated weights for policy 1, policy_version 353741 (0.0009) [2023-12-26 02:25:32,818][123090] Updated weights for policy 1, policy_version 353751 (0.0009) [2023-12-26 02:25:32,895][123091] Updated weights for policy 0, policy_version 355799 (0.0008) [2023-12-26 02:25:32,982][123091] Updated weights for policy 0, policy_version 355809 (0.0008) [2023-12-26 02:25:33,038][123091] Updated weights for policy 0, policy_version 355819 (0.0009) [2023-12-26 02:25:33,541][123090] Updated weights for policy 1, policy_version 353761 (0.0009) [2023-12-26 02:25:33,598][123090] Updated weights for policy 1, policy_version 353772 (0.0010) [2023-12-26 02:25:33,646][123090] Updated weights for policy 1, policy_version 353782 (0.0005) [2023-12-26 02:25:33,716][123090] Updated weights for policy 1, policy_version 353792 (0.0005) [2023-12-26 02:25:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 181665792. Throughput: 0: 8701.1, 1: 9036.5. Samples: 181676544. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:33,785][121949] Avg episode reward: [(0, '6010.425'), (1, '5982.453')] [2023-12-26 02:25:33,786][123008] Saving new best policy, reward=5982.453! [2023-12-26 02:25:33,878][123091] Updated weights for policy 0, policy_version 355829 (0.0007) [2023-12-26 02:25:33,950][123091] Updated weights for policy 0, policy_version 355839 (0.0005) [2023-12-26 02:25:34,009][123091] Updated weights for policy 0, policy_version 355849 (0.0005) [2023-12-26 02:25:34,448][123090] Updated weights for policy 1, policy_version 353802 (0.0009) [2023-12-26 02:25:34,518][123090] Updated weights for policy 1, policy_version 353812 (0.0009) [2023-12-26 02:25:34,590][123090] Updated weights for policy 1, policy_version 353822 (0.0006) [2023-12-26 02:25:34,731][123091] Updated weights for policy 0, policy_version 355859 (0.0007) [2023-12-26 02:25:34,799][123091] Updated weights for policy 0, policy_version 355869 (0.0011) [2023-12-26 02:25:34,850][123091] Updated weights for policy 0, policy_version 355879 (0.0010) [2023-12-26 02:25:35,245][123090] Updated weights for policy 1, policy_version 353832 (0.0008) [2023-12-26 02:25:35,297][123090] Updated weights for policy 1, policy_version 353842 (0.0009) [2023-12-26 02:25:35,350][123090] Updated weights for policy 1, policy_version 353852 (0.0009) [2023-12-26 02:25:35,610][123091] Updated weights for policy 0, policy_version 355889 (0.0010) [2023-12-26 02:25:35,680][123091] Updated weights for policy 0, policy_version 355899 (0.0010) [2023-12-26 02:25:35,740][123091] Updated weights for policy 0, policy_version 355909 (0.0010) [2023-12-26 02:25:35,806][123091] Updated weights for policy 0, policy_version 355919 (0.0010) [2023-12-26 02:25:36,256][123090] Updated weights for policy 1, policy_version 353862 (0.0008) [2023-12-26 02:25:36,321][123090] Updated weights for policy 1, policy_version 353872 (0.0009) [2023-12-26 02:25:36,390][123090] Updated weights for policy 1, policy_version 353882 (0.0009) [2023-12-26 02:25:36,599][123091] Updated weights for policy 0, policy_version 355929 (0.0011) [2023-12-26 02:25:36,664][123091] Updated weights for policy 0, policy_version 355939 (0.0011) [2023-12-26 02:25:36,730][123091] Updated weights for policy 0, policy_version 355949 (0.0011) [2023-12-26 02:25:37,155][123090] Updated weights for policy 1, policy_version 353892 (0.0009) [2023-12-26 02:25:37,216][123090] Updated weights for policy 1, policy_version 353902 (0.0009) [2023-12-26 02:25:37,265][123090] Updated weights for policy 1, policy_version 353912 (0.0009) [2023-12-26 02:25:37,549][123091] Updated weights for policy 0, policy_version 355959 (0.0007) [2023-12-26 02:25:37,594][123091] Updated weights for policy 0, policy_version 355969 (0.0005) [2023-12-26 02:25:37,643][123091] Updated weights for policy 0, policy_version 355979 (0.0006) [2023-12-26 02:25:38,166][123090] Updated weights for policy 1, policy_version 353922 (0.0009) [2023-12-26 02:25:38,234][123090] Updated weights for policy 1, policy_version 353932 (0.0009) [2023-12-26 02:25:38,297][123090] Updated weights for policy 1, policy_version 353942 (0.0009) [2023-12-26 02:25:38,370][123090] Updated weights for policy 1, policy_version 353952 (0.0009) [2023-12-26 02:25:38,433][123091] Updated weights for policy 0, policy_version 355989 (0.0007) [2023-12-26 02:25:38,495][123091] Updated weights for policy 0, policy_version 355999 (0.0009) [2023-12-26 02:25:38,552][123091] Updated weights for policy 0, policy_version 356009 (0.0007) [2023-12-26 02:25:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 181755904. Throughput: 0: 8700.4, 1: 9082.6. Samples: 181730384. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:38,785][121949] Avg episode reward: [(0, '6004.036'), (1, '5867.877')] [2023-12-26 02:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000356016_91144192.pth... [2023-12-26 02:25:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000353952_90611712.pth... [2023-12-26 02:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000355024_90890240.pth [2023-12-26 02:25:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000352864_90333184.pth [2023-12-26 02:25:39,191][123090] Updated weights for policy 1, policy_version 353962 (0.0010) [2023-12-26 02:25:39,253][123091] Updated weights for policy 0, policy_version 356019 (0.0006) [2023-12-26 02:25:39,259][123090] Updated weights for policy 1, policy_version 353972 (0.0010) [2023-12-26 02:25:39,316][123091] Updated weights for policy 0, policy_version 356029 (0.0008) [2023-12-26 02:25:39,318][123090] Updated weights for policy 1, policy_version 353982 (0.0008) [2023-12-26 02:25:39,388][123091] Updated weights for policy 0, policy_version 356039 (0.0009) [2023-12-26 02:25:40,134][123090] Updated weights for policy 1, policy_version 353992 (0.0009) [2023-12-26 02:25:40,198][123090] Updated weights for policy 1, policy_version 354002 (0.0006) [2023-12-26 02:25:40,198][123091] Updated weights for policy 0, policy_version 356049 (0.0009) [2023-12-26 02:25:40,261][123090] Updated weights for policy 1, policy_version 354012 (0.0007) [2023-12-26 02:25:40,264][123091] Updated weights for policy 0, policy_version 356059 (0.0009) [2023-12-26 02:25:40,332][123091] Updated weights for policy 0, policy_version 356069 (0.0009) [2023-12-26 02:25:40,405][123091] Updated weights for policy 0, policy_version 356079 (0.0006) [2023-12-26 02:25:40,996][123090] Updated weights for policy 1, policy_version 354022 (0.0006) [2023-12-26 02:25:41,069][123090] Updated weights for policy 1, policy_version 354032 (0.0009) [2023-12-26 02:25:41,145][123090] Updated weights for policy 1, policy_version 354042 (0.0009) [2023-12-26 02:25:41,226][123091] Updated weights for policy 0, policy_version 356089 (0.0008) [2023-12-26 02:25:41,301][123091] Updated weights for policy 0, policy_version 356099 (0.0009) [2023-12-26 02:25:41,366][123091] Updated weights for policy 0, policy_version 356109 (0.0009) [2023-12-26 02:25:41,968][123090] Updated weights for policy 1, policy_version 354052 (0.0009) [2023-12-26 02:25:42,026][123090] Updated weights for policy 1, policy_version 354062 (0.0005) [2023-12-26 02:25:42,092][123090] Updated weights for policy 1, policy_version 354072 (0.0005) [2023-12-26 02:25:42,252][123091] Updated weights for policy 0, policy_version 356119 (0.0010) [2023-12-26 02:25:42,325][123091] Updated weights for policy 0, policy_version 356129 (0.0009) [2023-12-26 02:25:42,393][123091] Updated weights for policy 0, policy_version 356139 (0.0009) [2023-12-26 02:25:42,817][123090] Updated weights for policy 1, policy_version 354082 (0.0007) [2023-12-26 02:25:42,873][123090] Updated weights for policy 1, policy_version 354092 (0.0010) [2023-12-26 02:25:42,925][123090] Updated weights for policy 1, policy_version 354102 (0.0010) [2023-12-26 02:25:42,985][123090] Updated weights for policy 1, policy_version 354112 (0.0010) [2023-12-26 02:25:43,129][123091] Updated weights for policy 0, policy_version 356149 (0.0009) [2023-12-26 02:25:43,194][123091] Updated weights for policy 0, policy_version 356159 (0.0010) [2023-12-26 02:25:43,254][123091] Updated weights for policy 0, policy_version 356169 (0.0011) [2023-12-26 02:25:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 181837824. Throughput: 0: 8644.8, 1: 9151.0. Samples: 181834580. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:43,785][121949] Avg episode reward: [(0, '6260.804'), (1, '5889.752')] [2023-12-26 02:25:43,799][123090] Updated weights for policy 1, policy_version 354122 (0.0005) [2023-12-26 02:25:43,854][123090] Updated weights for policy 1, policy_version 354132 (0.0005) [2023-12-26 02:25:43,904][123090] Updated weights for policy 1, policy_version 354142 (0.0005) [2023-12-26 02:25:43,967][123091] Updated weights for policy 0, policy_version 356179 (0.0008) [2023-12-26 02:25:44,015][123091] Updated weights for policy 0, policy_version 356189 (0.0005) [2023-12-26 02:25:44,062][123091] Updated weights for policy 0, policy_version 356199 (0.0005) [2023-12-26 02:25:44,575][123090] Updated weights for policy 1, policy_version 354152 (0.0006) [2023-12-26 02:25:44,644][123090] Updated weights for policy 1, policy_version 354162 (0.0010) [2023-12-26 02:25:44,691][123090] Updated weights for policy 1, policy_version 354172 (0.0010) [2023-12-26 02:25:44,783][123091] Updated weights for policy 0, policy_version 356209 (0.0006) [2023-12-26 02:25:44,844][123091] Updated weights for policy 0, policy_version 356219 (0.0009) [2023-12-26 02:25:44,908][123091] Updated weights for policy 0, policy_version 356229 (0.0009) [2023-12-26 02:25:44,970][123091] Updated weights for policy 0, policy_version 356239 (0.0009) [2023-12-26 02:25:45,462][123090] Updated weights for policy 1, policy_version 354182 (0.0007) [2023-12-26 02:25:45,518][123090] Updated weights for policy 1, policy_version 354192 (0.0009) [2023-12-26 02:25:45,574][123090] Updated weights for policy 1, policy_version 354202 (0.0010) [2023-12-26 02:25:45,844][123091] Updated weights for policy 0, policy_version 356249 (0.0009) [2023-12-26 02:25:45,892][123091] Updated weights for policy 0, policy_version 356259 (0.0008) [2023-12-26 02:25:45,949][123091] Updated weights for policy 0, policy_version 356269 (0.0007) [2023-12-26 02:25:46,358][123090] Updated weights for policy 1, policy_version 354212 (0.0008) [2023-12-26 02:25:46,411][123090] Updated weights for policy 1, policy_version 354222 (0.0005) [2023-12-26 02:25:46,464][123090] Updated weights for policy 1, policy_version 354232 (0.0009) [2023-12-26 02:25:46,670][123091] Updated weights for policy 0, policy_version 356279 (0.0008) [2023-12-26 02:25:46,717][123091] Updated weights for policy 0, policy_version 356289 (0.0008) [2023-12-26 02:25:46,765][123091] Updated weights for policy 0, policy_version 356299 (0.0009) [2023-12-26 02:25:47,298][123090] Updated weights for policy 1, policy_version 354242 (0.0010) [2023-12-26 02:25:47,364][123090] Updated weights for policy 1, policy_version 354252 (0.0010) [2023-12-26 02:25:47,433][123090] Updated weights for policy 1, policy_version 354262 (0.0010) [2023-12-26 02:25:47,499][123090] Updated weights for policy 1, policy_version 354272 (0.0010) [2023-12-26 02:25:47,543][123091] Updated weights for policy 0, policy_version 356309 (0.0009) [2023-12-26 02:25:47,596][123091] Updated weights for policy 0, policy_version 356319 (0.0009) [2023-12-26 02:25:47,651][123091] Updated weights for policy 0, policy_version 356329 (0.0009) [2023-12-26 02:25:48,298][123090] Updated weights for policy 1, policy_version 354282 (0.0010) [2023-12-26 02:25:48,373][123090] Updated weights for policy 1, policy_version 354292 (0.0010) [2023-12-26 02:25:48,446][123090] Updated weights for policy 1, policy_version 354302 (0.0011) [2023-12-26 02:25:48,497][123091] Updated weights for policy 0, policy_version 356339 (0.0008) [2023-12-26 02:25:48,559][123091] Updated weights for policy 0, policy_version 356349 (0.0008) [2023-12-26 02:25:48,630][123091] Updated weights for policy 0, policy_version 356359 (0.0008) [2023-12-26 02:25:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 181936128. Throughput: 0: 8678.9, 1: 9185.1. Samples: 181944636. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:48,785][121949] Avg episode reward: [(0, '6312.443'), (1, '5969.766')] [2023-12-26 02:25:49,158][123090] Updated weights for policy 1, policy_version 354312 (0.0008) [2023-12-26 02:25:49,216][123090] Updated weights for policy 1, policy_version 354322 (0.0010) [2023-12-26 02:25:49,283][123090] Updated weights for policy 1, policy_version 354332 (0.0011) [2023-12-26 02:25:49,321][123091] Updated weights for policy 0, policy_version 356369 (0.0007) [2023-12-26 02:25:49,389][123091] Updated weights for policy 0, policy_version 356379 (0.0009) [2023-12-26 02:25:49,454][123091] Updated weights for policy 0, policy_version 356389 (0.0009) [2023-12-26 02:25:49,517][123091] Updated weights for policy 0, policy_version 356399 (0.0010) [2023-12-26 02:25:50,080][123090] Updated weights for policy 1, policy_version 354342 (0.0007) [2023-12-26 02:25:50,128][123090] Updated weights for policy 1, policy_version 354352 (0.0009) [2023-12-26 02:25:50,174][123090] Updated weights for policy 1, policy_version 354362 (0.0007) [2023-12-26 02:25:50,383][123091] Updated weights for policy 0, policy_version 356409 (0.0009) [2023-12-26 02:25:50,447][123091] Updated weights for policy 0, policy_version 356419 (0.0009) [2023-12-26 02:25:50,505][123091] Updated weights for policy 0, policy_version 356429 (0.0009) [2023-12-26 02:25:50,973][123090] Updated weights for policy 1, policy_version 354372 (0.0007) [2023-12-26 02:25:51,037][123090] Updated weights for policy 1, policy_version 354382 (0.0010) [2023-12-26 02:25:51,110][123090] Updated weights for policy 1, policy_version 354392 (0.0010) [2023-12-26 02:25:51,361][123091] Updated weights for policy 0, policy_version 356439 (0.0009) [2023-12-26 02:25:51,422][123091] Updated weights for policy 0, policy_version 356449 (0.0010) [2023-12-26 02:25:51,474][123091] Updated weights for policy 0, policy_version 356459 (0.0009) [2023-12-26 02:25:51,909][123090] Updated weights for policy 1, policy_version 354402 (0.0011) [2023-12-26 02:25:51,975][123090] Updated weights for policy 1, policy_version 354412 (0.0011) [2023-12-26 02:25:52,045][123090] Updated weights for policy 1, policy_version 354422 (0.0007) [2023-12-26 02:25:52,115][123090] Updated weights for policy 1, policy_version 354432 (0.0010) [2023-12-26 02:25:52,341][123091] Updated weights for policy 0, policy_version 356469 (0.0009) [2023-12-26 02:25:52,415][123091] Updated weights for policy 0, policy_version 356479 (0.0009) [2023-12-26 02:25:52,469][123091] Updated weights for policy 0, policy_version 356489 (0.0009) [2023-12-26 02:25:52,879][123090] Updated weights for policy 1, policy_version 354442 (0.0005) [2023-12-26 02:25:52,935][123090] Updated weights for policy 1, policy_version 354452 (0.0005) [2023-12-26 02:25:52,997][123090] Updated weights for policy 1, policy_version 354462 (0.0005) [2023-12-26 02:25:53,369][123091] Updated weights for policy 0, policy_version 356499 (0.0009) [2023-12-26 02:25:53,428][123091] Updated weights for policy 0, policy_version 356509 (0.0010) [2023-12-26 02:25:53,494][123091] Updated weights for policy 0, policy_version 356519 (0.0010) [2023-12-26 02:25:53,623][123090] Updated weights for policy 1, policy_version 354472 (0.0008) [2023-12-26 02:25:53,683][123090] Updated weights for policy 1, policy_version 354482 (0.0009) [2023-12-26 02:25:53,755][123090] Updated weights for policy 1, policy_version 354492 (0.0009) [2023-12-26 02:25:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 182026240. Throughput: 0: 8701.4, 1: 9167.9. Samples: 181997732. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:53,785][121949] Avg episode reward: [(0, '6055.369'), (1, '5873.871')] [2023-12-26 02:25:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000356528_91275264.pth... [2023-12-26 02:25:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000354496_90750976.pth... [2023-12-26 02:25:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000355504_91013120.pth [2023-12-26 02:25:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000353408_90472448.pth [2023-12-26 02:25:54,339][123091] Updated weights for policy 0, policy_version 356529 (0.0010) [2023-12-26 02:25:54,406][123091] Updated weights for policy 0, policy_version 356539 (0.0008) [2023-12-26 02:25:54,473][123091] Updated weights for policy 0, policy_version 356549 (0.0010) [2023-12-26 02:25:54,531][123091] Updated weights for policy 0, policy_version 356559 (0.0009) [2023-12-26 02:25:54,588][123090] Updated weights for policy 1, policy_version 354502 (0.0010) [2023-12-26 02:25:54,654][123090] Updated weights for policy 1, policy_version 354512 (0.0008) [2023-12-26 02:25:54,724][123090] Updated weights for policy 1, policy_version 354522 (0.0010) [2023-12-26 02:25:55,287][123091] Updated weights for policy 0, policy_version 356569 (0.0010) [2023-12-26 02:25:55,352][123091] Updated weights for policy 0, policy_version 356579 (0.0010) [2023-12-26 02:25:55,408][123091] Updated weights for policy 0, policy_version 356589 (0.0007) [2023-12-26 02:25:55,510][123090] Updated weights for policy 1, policy_version 354532 (0.0011) [2023-12-26 02:25:55,561][123090] Updated weights for policy 1, policy_version 354542 (0.0010) [2023-12-26 02:25:55,605][123090] Updated weights for policy 1, policy_version 354552 (0.0010) [2023-12-26 02:25:56,202][123091] Updated weights for policy 0, policy_version 356599 (0.0009) [2023-12-26 02:25:56,260][123091] Updated weights for policy 0, policy_version 356609 (0.0010) [2023-12-26 02:25:56,306][123090] Updated weights for policy 1, policy_version 354562 (0.0009) [2023-12-26 02:25:56,313][123091] Updated weights for policy 0, policy_version 356619 (0.0010) [2023-12-26 02:25:56,368][123090] Updated weights for policy 1, policy_version 354572 (0.0005) [2023-12-26 02:25:56,421][123090] Updated weights for policy 1, policy_version 354582 (0.0005) [2023-12-26 02:25:56,482][123090] Updated weights for policy 1, policy_version 354592 (0.0010) [2023-12-26 02:25:57,170][123090] Updated weights for policy 1, policy_version 354602 (0.0006) [2023-12-26 02:25:57,245][123090] Updated weights for policy 1, policy_version 354612 (0.0005) [2023-12-26 02:25:57,246][123091] Updated weights for policy 0, policy_version 356629 (0.0009) [2023-12-26 02:25:57,294][123091] Updated weights for policy 0, policy_version 356639 (0.0009) [2023-12-26 02:25:57,312][123090] Updated weights for policy 1, policy_version 354622 (0.0005) [2023-12-26 02:25:57,345][123091] Updated weights for policy 0, policy_version 356649 (0.0007) [2023-12-26 02:25:57,904][123091] Updated weights for policy 0, policy_version 356659 (0.0006) [2023-12-26 02:25:57,964][123091] Updated weights for policy 0, policy_version 356669 (0.0007) [2023-12-26 02:25:57,992][123090] Updated weights for policy 1, policy_version 354632 (0.0009) [2023-12-26 02:25:58,030][123091] Updated weights for policy 0, policy_version 356679 (0.0008) [2023-12-26 02:25:58,058][123090] Updated weights for policy 1, policy_version 354642 (0.0008) [2023-12-26 02:25:58,124][123090] Updated weights for policy 1, policy_version 354652 (0.0008) [2023-12-26 02:25:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 182108160. Throughput: 0: 8691.5, 1: 9196.5. Samples: 182105768. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:25:58,785][121949] Avg episode reward: [(0, '5976.449'), (1, '5902.029')] [2023-12-26 02:25:58,981][123091] Updated weights for policy 0, policy_version 356689 (0.0008) [2023-12-26 02:25:58,990][123090] Updated weights for policy 1, policy_version 354662 (0.0008) [2023-12-26 02:25:59,043][123091] Updated weights for policy 0, policy_version 356699 (0.0009) [2023-12-26 02:25:59,060][123090] Updated weights for policy 1, policy_version 354672 (0.0008) [2023-12-26 02:25:59,097][123091] Updated weights for policy 0, policy_version 356709 (0.0008) [2023-12-26 02:25:59,121][123090] Updated weights for policy 1, policy_version 354682 (0.0008) [2023-12-26 02:25:59,162][123091] Updated weights for policy 0, policy_version 356719 (0.0007) [2023-12-26 02:25:59,899][123090] Updated weights for policy 1, policy_version 354692 (0.0006) [2023-12-26 02:25:59,934][123091] Updated weights for policy 0, policy_version 356729 (0.0009) [2023-12-26 02:25:59,972][123090] Updated weights for policy 1, policy_version 354702 (0.0008) [2023-12-26 02:26:00,003][123091] Updated weights for policy 0, policy_version 356739 (0.0007) [2023-12-26 02:26:00,036][123090] Updated weights for policy 1, policy_version 354712 (0.0007) [2023-12-26 02:26:00,065][123091] Updated weights for policy 0, policy_version 356749 (0.0008) [2023-12-26 02:26:00,795][123091] Updated weights for policy 0, policy_version 356759 (0.0008) [2023-12-26 02:26:00,850][123091] Updated weights for policy 0, policy_version 356769 (0.0010) [2023-12-26 02:26:00,863][123090] Updated weights for policy 1, policy_version 354722 (0.0008) [2023-12-26 02:26:00,901][123091] Updated weights for policy 0, policy_version 356779 (0.0008) [2023-12-26 02:26:00,920][123090] Updated weights for policy 1, policy_version 354732 (0.0008) [2023-12-26 02:26:00,974][123090] Updated weights for policy 1, policy_version 354742 (0.0009) [2023-12-26 02:26:01,029][123090] Updated weights for policy 1, policy_version 354752 (0.0009) [2023-12-26 02:26:01,784][123091] Updated weights for policy 0, policy_version 356789 (0.0009) [2023-12-26 02:26:01,842][123091] Updated weights for policy 0, policy_version 356799 (0.0009) [2023-12-26 02:26:01,871][123090] Updated weights for policy 1, policy_version 354762 (0.0008) [2023-12-26 02:26:01,900][123091] Updated weights for policy 0, policy_version 356809 (0.0008) [2023-12-26 02:26:01,931][123090] Updated weights for policy 1, policy_version 354772 (0.0010) [2023-12-26 02:26:01,998][123090] Updated weights for policy 1, policy_version 354782 (0.0010) [2023-12-26 02:26:02,687][123091] Updated weights for policy 0, policy_version 356819 (0.0008) [2023-12-26 02:26:02,739][123091] Updated weights for policy 0, policy_version 356829 (0.0009) [2023-12-26 02:26:02,799][123091] Updated weights for policy 0, policy_version 356839 (0.0011) [2023-12-26 02:26:02,859][123090] Updated weights for policy 1, policy_version 354792 (0.0009) [2023-12-26 02:26:02,911][123090] Updated weights for policy 1, policy_version 354802 (0.0009) [2023-12-26 02:26:02,972][123090] Updated weights for policy 1, policy_version 354812 (0.0009) [2023-12-26 02:26:03,642][123091] Updated weights for policy 0, policy_version 356849 (0.0010) [2023-12-26 02:26:03,694][123091] Updated weights for policy 0, policy_version 356859 (0.0010) [2023-12-26 02:26:03,741][123091] Updated weights for policy 0, policy_version 356869 (0.0010) [2023-12-26 02:26:03,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 182190080. Throughput: 0: 8707.8, 1: 9117.2. Samples: 182208884. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:03,785][121949] Avg episode reward: [(0, '5965.658'), (1, '5989.498')] [2023-12-26 02:26:03,796][123091] Updated weights for policy 0, policy_version 356879 (0.0011) [2023-12-26 02:26:03,813][123090] Updated weights for policy 1, policy_version 354822 (0.0008) [2023-12-26 02:26:03,877][123090] Updated weights for policy 1, policy_version 354832 (0.0009) [2023-12-26 02:26:03,950][123090] Updated weights for policy 1, policy_version 354842 (0.0009) [2023-12-26 02:26:03,989][123008] Saving new best policy, reward=5989.498! [2023-12-26 02:26:04,669][123091] Updated weights for policy 0, policy_version 356889 (0.0011) [2023-12-26 02:26:04,724][123091] Updated weights for policy 0, policy_version 356899 (0.0011) [2023-12-26 02:26:04,784][123091] Updated weights for policy 0, policy_version 356909 (0.0011) [2023-12-26 02:26:04,805][123090] Updated weights for policy 1, policy_version 354852 (0.0010) [2023-12-26 02:26:04,875][123090] Updated weights for policy 1, policy_version 354862 (0.0009) [2023-12-26 02:26:04,935][123090] Updated weights for policy 1, policy_version 354872 (0.0009) [2023-12-26 02:26:05,606][123091] Updated weights for policy 0, policy_version 356919 (0.0010) [2023-12-26 02:26:05,656][123091] Updated weights for policy 0, policy_version 356929 (0.0010) [2023-12-26 02:26:05,714][123091] Updated weights for policy 0, policy_version 356939 (0.0010) [2023-12-26 02:26:05,770][123090] Updated weights for policy 1, policy_version 354882 (0.0009) [2023-12-26 02:26:05,839][123090] Updated weights for policy 1, policy_version 354892 (0.0009) [2023-12-26 02:26:05,895][123090] Updated weights for policy 1, policy_version 354902 (0.0009) [2023-12-26 02:26:05,951][123090] Updated weights for policy 1, policy_version 354912 (0.0008) [2023-12-26 02:26:06,581][123091] Updated weights for policy 0, policy_version 356949 (0.0011) [2023-12-26 02:26:06,641][123091] Updated weights for policy 0, policy_version 356959 (0.0010) [2023-12-26 02:26:06,693][123091] Updated weights for policy 0, policy_version 356969 (0.0010) [2023-12-26 02:26:06,808][123090] Updated weights for policy 1, policy_version 354922 (0.0009) [2023-12-26 02:26:06,857][123090] Updated weights for policy 1, policy_version 354932 (0.0009) [2023-12-26 02:26:06,914][123090] Updated weights for policy 1, policy_version 354942 (0.0008) [2023-12-26 02:26:07,526][123091] Updated weights for policy 0, policy_version 356979 (0.0011) [2023-12-26 02:26:07,577][123091] Updated weights for policy 0, policy_version 356989 (0.0010) [2023-12-26 02:26:07,624][123091] Updated weights for policy 0, policy_version 356999 (0.0010) [2023-12-26 02:26:07,801][123090] Updated weights for policy 1, policy_version 354952 (0.0010) [2023-12-26 02:26:07,869][123090] Updated weights for policy 1, policy_version 354962 (0.0009) [2023-12-26 02:26:07,935][123090] Updated weights for policy 1, policy_version 354972 (0.0010) [2023-12-26 02:26:08,468][123091] Updated weights for policy 0, policy_version 357009 (0.0010) [2023-12-26 02:26:08,532][123091] Updated weights for policy 0, policy_version 357019 (0.0009) [2023-12-26 02:26:08,596][123091] Updated weights for policy 0, policy_version 357029 (0.0006) [2023-12-26 02:26:08,659][123091] Updated weights for policy 0, policy_version 357039 (0.0006) [2023-12-26 02:26:08,773][123090] Updated weights for policy 1, policy_version 354982 (0.0010) [2023-12-26 02:26:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 182280192. Throughput: 0: 8713.1, 1: 9078.9. Samples: 182259064. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:08,785][121949] Avg episode reward: [(0, '6029.657'), (1, '5999.579')] [2023-12-26 02:26:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000357040_91406336.pth... [2023-12-26 02:26:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000356016_91144192.pth [2023-12-26 02:26:08,840][123090] Updated weights for policy 1, policy_version 354992 (0.0010) [2023-12-26 02:26:08,893][123090] Updated weights for policy 1, policy_version 355002 (0.0009) [2023-12-26 02:26:08,935][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000355008_90882048.pth... [2023-12-26 02:26:08,940][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000353952_90611712.pth [2023-12-26 02:26:08,941][123008] Saving new best policy, reward=5999.579! [2023-12-26 02:26:09,484][123091] Updated weights for policy 0, policy_version 357049 (0.0008) [2023-12-26 02:26:09,558][123091] Updated weights for policy 0, policy_version 357059 (0.0010) [2023-12-26 02:26:09,625][123091] Updated weights for policy 0, policy_version 357069 (0.0008) [2023-12-26 02:26:09,793][123090] Updated weights for policy 1, policy_version 355012 (0.0009) [2023-12-26 02:26:09,865][123090] Updated weights for policy 1, policy_version 355022 (0.0009) [2023-12-26 02:26:09,926][123090] Updated weights for policy 1, policy_version 355032 (0.0010) [2023-12-26 02:26:10,426][123091] Updated weights for policy 0, policy_version 357079 (0.0008) [2023-12-26 02:26:10,491][123091] Updated weights for policy 0, policy_version 357089 (0.0009) [2023-12-26 02:26:10,558][123091] Updated weights for policy 0, policy_version 357099 (0.0009) [2023-12-26 02:26:10,757][123090] Updated weights for policy 1, policy_version 355042 (0.0009) [2023-12-26 02:26:10,805][123090] Updated weights for policy 1, policy_version 355052 (0.0009) [2023-12-26 02:26:10,865][123090] Updated weights for policy 1, policy_version 355062 (0.0009) [2023-12-26 02:26:10,925][123090] Updated weights for policy 1, policy_version 355072 (0.0010) [2023-12-26 02:26:11,385][123091] Updated weights for policy 0, policy_version 357109 (0.0010) [2023-12-26 02:26:11,463][123091] Updated weights for policy 0, policy_version 357119 (0.0009) [2023-12-26 02:26:11,527][123091] Updated weights for policy 0, policy_version 357129 (0.0009) [2023-12-26 02:26:11,772][123090] Updated weights for policy 1, policy_version 355082 (0.0009) [2023-12-26 02:26:11,825][123090] Updated weights for policy 1, policy_version 355092 (0.0009) [2023-12-26 02:26:11,880][123090] Updated weights for policy 1, policy_version 355103 (0.0009) [2023-12-26 02:26:12,374][123091] Updated weights for policy 0, policy_version 357139 (0.0010) [2023-12-26 02:26:12,447][123091] Updated weights for policy 0, policy_version 357149 (0.0007) [2023-12-26 02:26:12,502][123091] Updated weights for policy 0, policy_version 357159 (0.0005) [2023-12-26 02:26:12,760][123090] Updated weights for policy 1, policy_version 355113 (0.0008) [2023-12-26 02:26:12,818][123090] Updated weights for policy 1, policy_version 355123 (0.0010) [2023-12-26 02:26:12,885][123090] Updated weights for policy 1, policy_version 355133 (0.0010) [2023-12-26 02:26:13,192][123091] Updated weights for policy 0, policy_version 357169 (0.0005) [2023-12-26 02:26:13,244][123091] Updated weights for policy 0, policy_version 357179 (0.0005) [2023-12-26 02:26:13,305][123091] Updated weights for policy 0, policy_version 357189 (0.0005) [2023-12-26 02:26:13,368][123091] Updated weights for policy 0, policy_version 357199 (0.0006) [2023-12-26 02:26:13,594][123090] Updated weights for policy 1, policy_version 355143 (0.0007) [2023-12-26 02:26:13,655][123090] Updated weights for policy 1, policy_version 355153 (0.0005) [2023-12-26 02:26:13,714][123090] Updated weights for policy 1, policy_version 355163 (0.0007) [2023-12-26 02:26:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 182370304. Throughput: 0: 8730.9, 1: 8845.4. Samples: 182359964. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:13,784][121949] Avg episode reward: [(0, '6053.470'), (1, '5987.703')] [2023-12-26 02:26:14,154][123091] Updated weights for policy 0, policy_version 357209 (0.0009) [2023-12-26 02:26:14,217][123091] Updated weights for policy 0, policy_version 357219 (0.0009) [2023-12-26 02:26:14,283][123091] Updated weights for policy 0, policy_version 357229 (0.0008) [2023-12-26 02:26:14,431][123090] Updated weights for policy 1, policy_version 355173 (0.0007) [2023-12-26 02:26:14,503][123090] Updated weights for policy 1, policy_version 355183 (0.0006) [2023-12-26 02:26:14,548][123090] Updated weights for policy 1, policy_version 355193 (0.0006) [2023-12-26 02:26:15,096][123091] Updated weights for policy 0, policy_version 357239 (0.0009) [2023-12-26 02:26:15,155][123091] Updated weights for policy 0, policy_version 357249 (0.0010) [2023-12-26 02:26:15,219][123091] Updated weights for policy 0, policy_version 357259 (0.0010) [2023-12-26 02:26:15,253][123090] Updated weights for policy 1, policy_version 355203 (0.0005) [2023-12-26 02:26:15,312][123090] Updated weights for policy 1, policy_version 355213 (0.0006) [2023-12-26 02:26:15,370][123090] Updated weights for policy 1, policy_version 355223 (0.0006) [2023-12-26 02:26:16,005][123090] Updated weights for policy 1, policy_version 355233 (0.0006) [2023-12-26 02:26:16,060][123090] Updated weights for policy 1, policy_version 355243 (0.0005) [2023-12-26 02:26:16,101][123091] Updated weights for policy 0, policy_version 357269 (0.0010) [2023-12-26 02:26:16,114][123090] Updated weights for policy 1, policy_version 355253 (0.0005) [2023-12-26 02:26:16,165][123091] Updated weights for policy 0, policy_version 357279 (0.0011) [2023-12-26 02:26:16,169][123090] Updated weights for policy 1, policy_version 355263 (0.0007) [2023-12-26 02:26:16,227][123091] Updated weights for policy 0, policy_version 357289 (0.0010) [2023-12-26 02:26:16,918][123090] Updated weights for policy 1, policy_version 355273 (0.0006) [2023-12-26 02:26:16,973][123090] Updated weights for policy 1, policy_version 355283 (0.0005) [2023-12-26 02:26:17,013][123091] Updated weights for policy 0, policy_version 357299 (0.0009) [2023-12-26 02:26:17,036][123090] Updated weights for policy 1, policy_version 355293 (0.0005) [2023-12-26 02:26:17,065][123091] Updated weights for policy 0, policy_version 357309 (0.0007) [2023-12-26 02:26:17,121][123091] Updated weights for policy 0, policy_version 357319 (0.0005) [2023-12-26 02:26:17,732][123090] Updated weights for policy 1, policy_version 355303 (0.0005) [2023-12-26 02:26:17,789][123090] Updated weights for policy 1, policy_version 355313 (0.0006) [2023-12-26 02:26:17,796][123091] Updated weights for policy 0, policy_version 357329 (0.0005) [2023-12-26 02:26:17,857][123091] Updated weights for policy 0, policy_version 357339 (0.0005) [2023-12-26 02:26:17,859][123090] Updated weights for policy 1, policy_version 355323 (0.0007) [2023-12-26 02:26:17,925][123091] Updated weights for policy 0, policy_version 357349 (0.0005) [2023-12-26 02:26:17,991][123091] Updated weights for policy 0, policy_version 357359 (0.0005) [2023-12-26 02:26:18,557][123090] Updated weights for policy 1, policy_version 355333 (0.0007) [2023-12-26 02:26:18,605][123090] Updated weights for policy 1, policy_version 355343 (0.0005) [2023-12-26 02:26:18,667][123090] Updated weights for policy 1, policy_version 355353 (0.0005) [2023-12-26 02:26:18,757][123091] Updated weights for policy 0, policy_version 357369 (0.0010) [2023-12-26 02:26:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 182460416. Throughput: 0: 8777.7, 1: 8940.6. Samples: 182473868. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:18,784][121949] Avg episode reward: [(0, '6094.211'), (1, '5973.760')] [2023-12-26 02:26:18,815][123091] Updated weights for policy 0, policy_version 357379 (0.0006) [2023-12-26 02:26:18,880][123091] Updated weights for policy 0, policy_version 357389 (0.0006) [2023-12-26 02:26:19,399][123090] Updated weights for policy 1, policy_version 355363 (0.0007) [2023-12-26 02:26:19,455][123090] Updated weights for policy 1, policy_version 355373 (0.0010) [2023-12-26 02:26:19,528][123090] Updated weights for policy 1, policy_version 355383 (0.0011) [2023-12-26 02:26:19,626][123091] Updated weights for policy 0, policy_version 357399 (0.0008) [2023-12-26 02:26:19,691][123091] Updated weights for policy 0, policy_version 357409 (0.0009) [2023-12-26 02:26:19,755][123091] Updated weights for policy 0, policy_version 357419 (0.0009) [2023-12-26 02:26:20,323][123090] Updated weights for policy 1, policy_version 355393 (0.0010) [2023-12-26 02:26:20,403][123090] Updated weights for policy 1, policy_version 355403 (0.0010) [2023-12-26 02:26:20,414][123091] Updated weights for policy 0, policy_version 357429 (0.0006) [2023-12-26 02:26:20,471][123090] Updated weights for policy 1, policy_version 355413 (0.0007) [2023-12-26 02:26:20,481][123091] Updated weights for policy 0, policy_version 357439 (0.0008) [2023-12-26 02:26:20,543][123090] Updated weights for policy 1, policy_version 355423 (0.0008) [2023-12-26 02:26:20,556][123091] Updated weights for policy 0, policy_version 357449 (0.0007) [2023-12-26 02:26:21,332][123090] Updated weights for policy 1, policy_version 355433 (0.0008) [2023-12-26 02:26:21,381][123091] Updated weights for policy 0, policy_version 357459 (0.0009) [2023-12-26 02:26:21,406][123090] Updated weights for policy 1, policy_version 355443 (0.0009) [2023-12-26 02:26:21,450][123091] Updated weights for policy 0, policy_version 357469 (0.0008) [2023-12-26 02:26:21,481][123090] Updated weights for policy 1, policy_version 355453 (0.0009) [2023-12-26 02:26:21,525][123091] Updated weights for policy 0, policy_version 357479 (0.0006) [2023-12-26 02:26:22,321][123090] Updated weights for policy 1, policy_version 355463 (0.0010) [2023-12-26 02:26:22,368][123091] Updated weights for policy 0, policy_version 357489 (0.0009) [2023-12-26 02:26:22,387][123090] Updated weights for policy 1, policy_version 355473 (0.0010) [2023-12-26 02:26:22,431][123091] Updated weights for policy 0, policy_version 357499 (0.0008) [2023-12-26 02:26:22,445][123090] Updated weights for policy 1, policy_version 355483 (0.0009) [2023-12-26 02:26:22,479][123091] Updated weights for policy 0, policy_version 357509 (0.0009) [2023-12-26 02:26:22,529][123091] Updated weights for policy 0, policy_version 357519 (0.0010) [2023-12-26 02:26:23,271][123090] Updated weights for policy 1, policy_version 355493 (0.0009) [2023-12-26 02:26:23,320][123090] Updated weights for policy 1, policy_version 355503 (0.0009) [2023-12-26 02:26:23,371][123090] Updated weights for policy 1, policy_version 355513 (0.0007) [2023-12-26 02:26:23,377][123091] Updated weights for policy 0, policy_version 357529 (0.0010) [2023-12-26 02:26:23,460][123091] Updated weights for policy 0, policy_version 357539 (0.0010) [2023-12-26 02:26:23,520][123091] Updated weights for policy 0, policy_version 357549 (0.0009) [2023-12-26 02:26:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 182550528. Throughput: 0: 8773.7, 1: 8929.5. Samples: 182527028. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:23,785][121949] Avg episode reward: [(0, '6053.132'), (1, '6014.933')] [2023-12-26 02:26:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000357552_91537408.pth... [2023-12-26 02:26:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000355520_91013120.pth... [2023-12-26 02:26:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000356528_91275264.pth [2023-12-26 02:26:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000354496_90750976.pth [2023-12-26 02:26:23,799][123008] Saving new best policy, reward=6014.933! [2023-12-26 02:26:24,242][123090] Updated weights for policy 1, policy_version 355523 (0.0008) [2023-12-26 02:26:24,296][123090] Updated weights for policy 1, policy_version 355533 (0.0009) [2023-12-26 02:26:24,326][123091] Updated weights for policy 0, policy_version 357559 (0.0010) [2023-12-26 02:26:24,359][123090] Updated weights for policy 1, policy_version 355543 (0.0006) [2023-12-26 02:26:24,380][123091] Updated weights for policy 0, policy_version 357569 (0.0009) [2023-12-26 02:26:24,434][123091] Updated weights for policy 0, policy_version 357579 (0.0009) [2023-12-26 02:26:25,199][123090] Updated weights for policy 1, policy_version 355553 (0.0008) [2023-12-26 02:26:25,252][123090] Updated weights for policy 1, policy_version 355563 (0.0009) [2023-12-26 02:26:25,265][123091] Updated weights for policy 0, policy_version 357589 (0.0008) [2023-12-26 02:26:25,312][123090] Updated weights for policy 1, policy_version 355573 (0.0008) [2023-12-26 02:26:25,317][123091] Updated weights for policy 0, policy_version 357599 (0.0009) [2023-12-26 02:26:25,366][123090] Updated weights for policy 1, policy_version 355583 (0.0009) [2023-12-26 02:26:25,368][123091] Updated weights for policy 0, policy_version 357609 (0.0008) [2023-12-26 02:26:26,125][123090] Updated weights for policy 1, policy_version 355593 (0.0009) [2023-12-26 02:26:26,137][123091] Updated weights for policy 0, policy_version 357619 (0.0008) [2023-12-26 02:26:26,190][123090] Updated weights for policy 1, policy_version 355603 (0.0009) [2023-12-26 02:26:26,195][123091] Updated weights for policy 0, policy_version 357629 (0.0006) [2023-12-26 02:26:26,254][123091] Updated weights for policy 0, policy_version 357639 (0.0008) [2023-12-26 02:26:26,255][123090] Updated weights for policy 1, policy_version 355613 (0.0010) [2023-12-26 02:26:27,024][123090] Updated weights for policy 1, policy_version 355623 (0.0009) [2023-12-26 02:26:27,042][123091] Updated weights for policy 0, policy_version 357649 (0.0008) [2023-12-26 02:26:27,071][123090] Updated weights for policy 1, policy_version 355633 (0.0007) [2023-12-26 02:26:27,091][123091] Updated weights for policy 0, policy_version 357659 (0.0009) [2023-12-26 02:26:27,116][123090] Updated weights for policy 1, policy_version 355643 (0.0007) [2023-12-26 02:26:27,139][123091] Updated weights for policy 0, policy_version 357669 (0.0008) [2023-12-26 02:26:27,186][123091] Updated weights for policy 0, policy_version 357679 (0.0009) [2023-12-26 02:26:27,840][123090] Updated weights for policy 1, policy_version 355653 (0.0006) [2023-12-26 02:26:27,894][123090] Updated weights for policy 1, policy_version 355663 (0.0005) [2023-12-26 02:26:27,928][123091] Updated weights for policy 0, policy_version 357689 (0.0009) [2023-12-26 02:26:27,943][123090] Updated weights for policy 1, policy_version 355673 (0.0005) [2023-12-26 02:26:27,977][123091] Updated weights for policy 0, policy_version 357700 (0.0009) [2023-12-26 02:26:28,029][123091] Updated weights for policy 0, policy_version 357710 (0.0010) [2023-12-26 02:26:28,560][123090] Updated weights for policy 1, policy_version 355683 (0.0006) [2023-12-26 02:26:28,622][123090] Updated weights for policy 1, policy_version 355693 (0.0009) [2023-12-26 02:26:28,684][123090] Updated weights for policy 1, policy_version 355703 (0.0010) [2023-12-26 02:26:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 182640640. Throughput: 0: 8785.7, 1: 8916.9. Samples: 182631196. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:28,785][121949] Avg episode reward: [(0, '5802.076'), (1, '6020.287')] [2023-12-26 02:26:28,786][123008] Saving new best policy, reward=6020.287! [2023-12-26 02:26:28,902][123091] Updated weights for policy 0, policy_version 357720 (0.0010) [2023-12-26 02:26:28,951][123091] Updated weights for policy 0, policy_version 357730 (0.0009) [2023-12-26 02:26:29,005][123091] Updated weights for policy 0, policy_version 357740 (0.0007) [2023-12-26 02:26:29,496][123090] Updated weights for policy 1, policy_version 355713 (0.0009) [2023-12-26 02:26:29,555][123090] Updated weights for policy 1, policy_version 355723 (0.0010) [2023-12-26 02:26:29,620][123090] Updated weights for policy 1, policy_version 355733 (0.0009) [2023-12-26 02:26:29,669][123090] Updated weights for policy 1, policy_version 355743 (0.0009) [2023-12-26 02:26:29,861][123091] Updated weights for policy 0, policy_version 357750 (0.0008) [2023-12-26 02:26:29,927][123091] Updated weights for policy 0, policy_version 357760 (0.0009) [2023-12-26 02:26:29,991][123091] Updated weights for policy 0, policy_version 357770 (0.0006) [2023-12-26 02:26:30,520][123090] Updated weights for policy 1, policy_version 355753 (0.0010) [2023-12-26 02:26:30,577][123090] Updated weights for policy 1, policy_version 355764 (0.0011) [2023-12-26 02:26:30,630][123090] Updated weights for policy 1, policy_version 355774 (0.0005) [2023-12-26 02:26:30,810][123091] Updated weights for policy 0, policy_version 357780 (0.0010) [2023-12-26 02:26:30,861][123091] Updated weights for policy 0, policy_version 357791 (0.0009) [2023-12-26 02:26:30,908][123091] Updated weights for policy 0, policy_version 357801 (0.0008) [2023-12-26 02:26:31,463][123090] Updated weights for policy 1, policy_version 355784 (0.0009) [2023-12-26 02:26:31,533][123090] Updated weights for policy 1, policy_version 355794 (0.0010) [2023-12-26 02:26:31,590][123090] Updated weights for policy 1, policy_version 355804 (0.0007) [2023-12-26 02:26:31,768][123091] Updated weights for policy 0, policy_version 357811 (0.0007) [2023-12-26 02:26:31,836][123091] Updated weights for policy 0, policy_version 357821 (0.0006) [2023-12-26 02:26:31,905][123091] Updated weights for policy 0, policy_version 357831 (0.0009) [2023-12-26 02:26:32,389][123090] Updated weights for policy 1, policy_version 355814 (0.0007) [2023-12-26 02:26:32,459][123090] Updated weights for policy 1, policy_version 355824 (0.0006) [2023-12-26 02:26:32,529][123090] Updated weights for policy 1, policy_version 355834 (0.0006) [2023-12-26 02:26:32,634][123091] Updated weights for policy 0, policy_version 357841 (0.0008) [2023-12-26 02:26:32,682][123091] Updated weights for policy 0, policy_version 357851 (0.0005) [2023-12-26 02:26:32,750][123091] Updated weights for policy 0, policy_version 357861 (0.0005) [2023-12-26 02:26:32,811][123091] Updated weights for policy 0, policy_version 357871 (0.0005) [2023-12-26 02:26:33,278][123090] Updated weights for policy 1, policy_version 355844 (0.0005) [2023-12-26 02:26:33,326][123090] Updated weights for policy 1, policy_version 355854 (0.0005) [2023-12-26 02:26:33,376][123090] Updated weights for policy 1, policy_version 355864 (0.0006) [2023-12-26 02:26:33,583][123091] Updated weights for policy 0, policy_version 357881 (0.0006) [2023-12-26 02:26:33,646][123091] Updated weights for policy 0, policy_version 357891 (0.0005) [2023-12-26 02:26:33,711][123091] Updated weights for policy 0, policy_version 357901 (0.0005) [2023-12-26 02:26:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 182730752. Throughput: 0: 8736.6, 1: 8899.3. Samples: 182738248. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:33,784][121949] Avg episode reward: [(0, '5831.747'), (1, '5957.206')] [2023-12-26 02:26:34,244][123090] Updated weights for policy 1, policy_version 355874 (0.0008) [2023-12-26 02:26:34,305][123090] Updated weights for policy 1, policy_version 355884 (0.0010) [2023-12-26 02:26:34,343][123091] Updated weights for policy 0, policy_version 357911 (0.0008) [2023-12-26 02:26:34,362][123090] Updated weights for policy 1, policy_version 355894 (0.0008) [2023-12-26 02:26:34,415][123091] Updated weights for policy 0, policy_version 357921 (0.0009) [2023-12-26 02:26:34,418][123090] Updated weights for policy 1, policy_version 355904 (0.0007) [2023-12-26 02:26:34,463][123091] Updated weights for policy 0, policy_version 357931 (0.0008) [2023-12-26 02:26:35,231][123090] Updated weights for policy 1, policy_version 355914 (0.0010) [2023-12-26 02:26:35,284][123090] Updated weights for policy 1, policy_version 355924 (0.0009) [2023-12-26 02:26:35,315][123091] Updated weights for policy 0, policy_version 357941 (0.0010) [2023-12-26 02:26:35,335][123090] Updated weights for policy 1, policy_version 355934 (0.0009) [2023-12-26 02:26:35,363][123091] Updated weights for policy 0, policy_version 357951 (0.0010) [2023-12-26 02:26:35,414][123091] Updated weights for policy 0, policy_version 357961 (0.0010) [2023-12-26 02:26:36,181][123090] Updated weights for policy 1, policy_version 355944 (0.0010) [2023-12-26 02:26:36,248][123090] Updated weights for policy 1, policy_version 355954 (0.0009) [2023-12-26 02:26:36,264][123091] Updated weights for policy 0, policy_version 357971 (0.0009) [2023-12-26 02:26:36,312][123090] Updated weights for policy 1, policy_version 355964 (0.0007) [2023-12-26 02:26:36,327][123091] Updated weights for policy 0, policy_version 357981 (0.0009) [2023-12-26 02:26:36,381][123091] Updated weights for policy 0, policy_version 357991 (0.0010) [2023-12-26 02:26:37,068][123090] Updated weights for policy 1, policy_version 355974 (0.0009) [2023-12-26 02:26:37,117][123090] Updated weights for policy 1, policy_version 355984 (0.0009) [2023-12-26 02:26:37,145][123091] Updated weights for policy 0, policy_version 358001 (0.0009) [2023-12-26 02:26:37,173][123090] Updated weights for policy 1, policy_version 355994 (0.0009) [2023-12-26 02:26:37,212][123091] Updated weights for policy 0, policy_version 358011 (0.0006) [2023-12-26 02:26:37,271][123091] Updated weights for policy 0, policy_version 358021 (0.0007) [2023-12-26 02:26:37,344][123091] Updated weights for policy 0, policy_version 358031 (0.0009) [2023-12-26 02:26:37,942][123090] Updated weights for policy 1, policy_version 356004 (0.0009) [2023-12-26 02:26:38,000][123090] Updated weights for policy 1, policy_version 356014 (0.0010) [2023-12-26 02:26:38,063][123090] Updated weights for policy 1, policy_version 356024 (0.0009) [2023-12-26 02:26:38,163][123091] Updated weights for policy 0, policy_version 358041 (0.0009) [2023-12-26 02:26:38,224][123091] Updated weights for policy 0, policy_version 358051 (0.0008) [2023-12-26 02:26:38,284][123091] Updated weights for policy 0, policy_version 358061 (0.0010) [2023-12-26 02:26:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 182812672. Throughput: 0: 8751.8, 1: 8870.5. Samples: 182790732. Policy #0 lag: (min: 27.0, avg: 31.4, max: 59.0) [2023-12-26 02:26:38,785][121949] Avg episode reward: [(0, '5812.863'), (1, '5931.318')] [2023-12-26 02:26:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000358064_91668480.pth... [2023-12-26 02:26:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000356032_91144192.pth... [2023-12-26 02:26:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000357040_91406336.pth [2023-12-26 02:26:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000355008_90882048.pth [2023-12-26 02:26:38,880][123090] Updated weights for policy 1, policy_version 356034 (0.0009) [2023-12-26 02:26:38,941][123090] Updated weights for policy 1, policy_version 356044 (0.0006) [2023-12-26 02:26:39,005][123090] Updated weights for policy 1, policy_version 356054 (0.0006) [2023-12-26 02:26:39,065][123091] Updated weights for policy 0, policy_version 358071 (0.0007) [2023-12-26 02:26:39,076][123090] Updated weights for policy 1, policy_version 356064 (0.0006) [2023-12-26 02:26:39,125][123091] Updated weights for policy 0, policy_version 358081 (0.0005) [2023-12-26 02:26:39,184][123091] Updated weights for policy 0, policy_version 358091 (0.0005) [2023-12-26 02:26:39,817][123090] Updated weights for policy 1, policy_version 356074 (0.0007) [2023-12-26 02:26:39,889][123090] Updated weights for policy 1, policy_version 356084 (0.0008) [2023-12-26 02:26:39,960][123090] Updated weights for policy 1, policy_version 356094 (0.0010) [2023-12-26 02:26:39,979][123091] Updated weights for policy 0, policy_version 358101 (0.0007) [2023-12-26 02:26:40,045][123091] Updated weights for policy 0, policy_version 358111 (0.0009) [2023-12-26 02:26:40,110][123091] Updated weights for policy 0, policy_version 358121 (0.0010) [2023-12-26 02:26:40,745][123090] Updated weights for policy 1, policy_version 356104 (0.0009) [2023-12-26 02:26:40,812][123090] Updated weights for policy 1, policy_version 356114 (0.0010) [2023-12-26 02:26:40,878][123090] Updated weights for policy 1, policy_version 356124 (0.0010) [2023-12-26 02:26:40,908][123091] Updated weights for policy 0, policy_version 358131 (0.0008) [2023-12-26 02:26:40,977][123091] Updated weights for policy 0, policy_version 358141 (0.0009) [2023-12-26 02:26:41,038][123091] Updated weights for policy 0, policy_version 358152 (0.0009) [2023-12-26 02:26:41,704][123090] Updated weights for policy 1, policy_version 356134 (0.0009) [2023-12-26 02:26:41,775][123090] Updated weights for policy 1, policy_version 356144 (0.0009) [2023-12-26 02:26:41,846][123090] Updated weights for policy 1, policy_version 356154 (0.0006) [2023-12-26 02:26:41,860][123091] Updated weights for policy 0, policy_version 358162 (0.0010) [2023-12-26 02:26:41,922][123091] Updated weights for policy 0, policy_version 358172 (0.0007) [2023-12-26 02:26:41,980][123091] Updated weights for policy 0, policy_version 358182 (0.0005) [2023-12-26 02:26:42,052][123091] Updated weights for policy 0, policy_version 358192 (0.0006) [2023-12-26 02:26:42,700][123090] Updated weights for policy 1, policy_version 356164 (0.0010) [2023-12-26 02:26:42,752][123090] Updated weights for policy 1, policy_version 356174 (0.0010) [2023-12-26 02:26:42,804][123090] Updated weights for policy 1, policy_version 356184 (0.0010) [2023-12-26 02:26:42,808][123091] Updated weights for policy 0, policy_version 358202 (0.0011) [2023-12-26 02:26:42,871][123091] Updated weights for policy 0, policy_version 358212 (0.0009) [2023-12-26 02:26:42,941][123091] Updated weights for policy 0, policy_version 358222 (0.0005) [2023-12-26 02:26:43,569][123090] Updated weights for policy 1, policy_version 356194 (0.0009) [2023-12-26 02:26:43,629][123090] Updated weights for policy 1, policy_version 356204 (0.0005) [2023-12-26 02:26:43,672][123091] Updated weights for policy 0, policy_version 358232 (0.0009) [2023-12-26 02:26:43,677][123090] Updated weights for policy 1, policy_version 356214 (0.0009) [2023-12-26 02:26:43,723][123091] Updated weights for policy 0, policy_version 358242 (0.0010) [2023-12-26 02:26:43,736][123090] Updated weights for policy 1, policy_version 356224 (0.0010) [2023-12-26 02:26:43,770][123091] Updated weights for policy 0, policy_version 358252 (0.0010) [2023-12-26 02:26:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 182902784. Throughput: 0: 8791.1, 1: 8763.5. Samples: 182895728. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:26:43,785][121949] Avg episode reward: [(0, '5824.038'), (1, '6006.552')] [2023-12-26 02:26:44,512][123091] Updated weights for policy 0, policy_version 358262 (0.0010) [2023-12-26 02:26:44,554][123090] Updated weights for policy 1, policy_version 356234 (0.0010) [2023-12-26 02:26:44,572][123091] Updated weights for policy 0, policy_version 358272 (0.0011) [2023-12-26 02:26:44,614][123090] Updated weights for policy 1, policy_version 356244 (0.0010) [2023-12-26 02:26:44,620][123091] Updated weights for policy 0, policy_version 358282 (0.0010) [2023-12-26 02:26:44,670][123090] Updated weights for policy 1, policy_version 356254 (0.0010) [2023-12-26 02:26:45,418][123091] Updated weights for policy 0, policy_version 358292 (0.0011) [2023-12-26 02:26:45,480][123091] Updated weights for policy 0, policy_version 358302 (0.0010) [2023-12-26 02:26:45,544][123091] Updated weights for policy 0, policy_version 358312 (0.0011) [2023-12-26 02:26:45,548][123090] Updated weights for policy 1, policy_version 356264 (0.0010) [2023-12-26 02:26:45,613][123090] Updated weights for policy 1, policy_version 356274 (0.0010) [2023-12-26 02:26:45,676][123090] Updated weights for policy 1, policy_version 356284 (0.0010) [2023-12-26 02:26:46,348][123091] Updated weights for policy 0, policy_version 358322 (0.0010) [2023-12-26 02:26:46,411][123091] Updated weights for policy 0, policy_version 358332 (0.0010) [2023-12-26 02:26:46,414][123090] Updated weights for policy 1, policy_version 356294 (0.0007) [2023-12-26 02:26:46,471][123090] Updated weights for policy 1, policy_version 356304 (0.0005) [2023-12-26 02:26:46,477][123091] Updated weights for policy 0, policy_version 358342 (0.0010) [2023-12-26 02:26:46,523][123090] Updated weights for policy 1, policy_version 356314 (0.0008) [2023-12-26 02:26:46,536][123091] Updated weights for policy 0, policy_version 358352 (0.0010) [2023-12-26 02:26:47,194][123090] Updated weights for policy 1, policy_version 356324 (0.0008) [2023-12-26 02:26:47,259][123091] Updated weights for policy 0, policy_version 358362 (0.0008) [2023-12-26 02:26:47,266][123090] Updated weights for policy 1, policy_version 356334 (0.0005) [2023-12-26 02:26:47,307][123091] Updated weights for policy 0, policy_version 358372 (0.0009) [2023-12-26 02:26:47,333][123090] Updated weights for policy 1, policy_version 356344 (0.0005) [2023-12-26 02:26:47,356][123091] Updated weights for policy 0, policy_version 358382 (0.0006) [2023-12-26 02:26:47,975][123090] Updated weights for policy 1, policy_version 356354 (0.0006) [2023-12-26 02:26:48,045][123090] Updated weights for policy 1, policy_version 356364 (0.0010) [2023-12-26 02:26:48,112][123090] Updated weights for policy 1, policy_version 356374 (0.0010) [2023-12-26 02:26:48,156][123091] Updated weights for policy 0, policy_version 358392 (0.0008) [2023-12-26 02:26:48,174][123090] Updated weights for policy 1, policy_version 356384 (0.0010) [2023-12-26 02:26:48,221][123091] Updated weights for policy 0, policy_version 358402 (0.0007) [2023-12-26 02:26:48,283][123091] Updated weights for policy 0, policy_version 358412 (0.0011) [2023-12-26 02:26:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 182992896. Throughput: 0: 8846.4, 1: 8871.2. Samples: 183006176. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:26:48,784][121949] Avg episode reward: [(0, '5690.804'), (1, '6022.957')] [2023-12-26 02:26:48,785][123008] Saving new best policy, reward=6022.957! [2023-12-26 02:26:48,961][123090] Updated weights for policy 1, policy_version 356394 (0.0005) [2023-12-26 02:26:49,029][123090] Updated weights for policy 1, policy_version 356404 (0.0006) [2023-12-26 02:26:49,089][123091] Updated weights for policy 0, policy_version 358422 (0.0010) [2023-12-26 02:26:49,100][123090] Updated weights for policy 1, policy_version 356414 (0.0005) [2023-12-26 02:26:49,144][123091] Updated weights for policy 0, policy_version 358432 (0.0011) [2023-12-26 02:26:49,200][123091] Updated weights for policy 0, policy_version 358442 (0.0010) [2023-12-26 02:26:49,831][123090] Updated weights for policy 1, policy_version 356424 (0.0008) [2023-12-26 02:26:49,890][123090] Updated weights for policy 1, policy_version 356434 (0.0010) [2023-12-26 02:26:49,955][123090] Updated weights for policy 1, policy_version 356444 (0.0010) [2023-12-26 02:26:50,046][123091] Updated weights for policy 0, policy_version 358452 (0.0010) [2023-12-26 02:26:50,109][123091] Updated weights for policy 0, policy_version 358462 (0.0008) [2023-12-26 02:26:50,169][123091] Updated weights for policy 0, policy_version 358472 (0.0008) [2023-12-26 02:26:50,775][123090] Updated weights for policy 1, policy_version 356454 (0.0011) [2023-12-26 02:26:50,835][123090] Updated weights for policy 1, policy_version 356464 (0.0010) [2023-12-26 02:26:50,886][123090] Updated weights for policy 1, policy_version 356474 (0.0010) [2023-12-26 02:26:50,943][123091] Updated weights for policy 0, policy_version 358482 (0.0009) [2023-12-26 02:26:50,995][123091] Updated weights for policy 0, policy_version 358492 (0.0011) [2023-12-26 02:26:51,055][123091] Updated weights for policy 0, policy_version 358502 (0.0010) [2023-12-26 02:26:51,119][123091] Updated weights for policy 0, policy_version 358512 (0.0007) [2023-12-26 02:26:51,696][123090] Updated weights for policy 1, policy_version 356484 (0.0011) [2023-12-26 02:26:51,765][123090] Updated weights for policy 1, policy_version 356494 (0.0008) [2023-12-26 02:26:51,827][123090] Updated weights for policy 1, policy_version 356504 (0.0008) [2023-12-26 02:26:51,922][123091] Updated weights for policy 0, policy_version 358522 (0.0006) [2023-12-26 02:26:51,972][123091] Updated weights for policy 0, policy_version 358532 (0.0005) [2023-12-26 02:26:52,030][123091] Updated weights for policy 0, policy_version 358542 (0.0006) [2023-12-26 02:26:52,689][123090] Updated weights for policy 1, policy_version 356514 (0.0008) [2023-12-26 02:26:52,751][123090] Updated weights for policy 1, policy_version 356524 (0.0009) [2023-12-26 02:26:52,770][123091] Updated weights for policy 0, policy_version 358552 (0.0006) [2023-12-26 02:26:52,810][123090] Updated weights for policy 1, policy_version 356534 (0.0009) [2023-12-26 02:26:52,825][123091] Updated weights for policy 0, policy_version 358562 (0.0006) [2023-12-26 02:26:52,862][123090] Updated weights for policy 1, policy_version 356544 (0.0008) [2023-12-26 02:26:52,894][123091] Updated weights for policy 0, policy_version 358572 (0.0006) [2023-12-26 02:26:53,653][123091] Updated weights for policy 0, policy_version 358582 (0.0005) [2023-12-26 02:26:53,678][123090] Updated weights for policy 1, policy_version 356554 (0.0005) [2023-12-26 02:26:53,724][123091] Updated weights for policy 0, policy_version 358592 (0.0005) [2023-12-26 02:26:53,742][123090] Updated weights for policy 1, policy_version 356564 (0.0006) [2023-12-26 02:26:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17717.1). Total num frames: 183074816. Throughput: 0: 8854.6, 1: 8927.6. Samples: 183059264. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:26:53,785][121949] Avg episode reward: [(0, '5691.324'), (1, '5941.462')] [2023-12-26 02:26:53,794][123091] Updated weights for policy 0, policy_version 358602 (0.0008) [2023-12-26 02:26:53,812][123090] Updated weights for policy 1, policy_version 356574 (0.0007) [2023-12-26 02:26:53,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000356576_91283456.pth... [2023-12-26 02:26:53,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000355520_91013120.pth [2023-12-26 02:26:53,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000358608_91807744.pth... [2023-12-26 02:26:53,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000357552_91537408.pth [2023-12-26 02:26:54,472][123091] Updated weights for policy 0, policy_version 358612 (0.0006) [2023-12-26 02:26:54,528][123091] Updated weights for policy 0, policy_version 358622 (0.0005) [2023-12-26 02:26:54,567][123090] Updated weights for policy 1, policy_version 356584 (0.0009) [2023-12-26 02:26:54,590][123091] Updated weights for policy 0, policy_version 358632 (0.0008) [2023-12-26 02:26:54,623][123090] Updated weights for policy 1, policy_version 356594 (0.0010) [2023-12-26 02:26:54,685][123090] Updated weights for policy 1, policy_version 356604 (0.0010) [2023-12-26 02:26:55,429][123091] Updated weights for policy 0, policy_version 358642 (0.0007) [2023-12-26 02:26:55,464][123090] Updated weights for policy 1, policy_version 356614 (0.0011) [2023-12-26 02:26:55,493][123091] Updated weights for policy 0, policy_version 358652 (0.0007) [2023-12-26 02:26:55,516][123090] Updated weights for policy 1, policy_version 356624 (0.0010) [2023-12-26 02:26:55,553][123091] Updated weights for policy 0, policy_version 358662 (0.0006) [2023-12-26 02:26:55,574][123090] Updated weights for policy 1, policy_version 356634 (0.0010) [2023-12-26 02:26:55,615][123091] Updated weights for policy 0, policy_version 358672 (0.0006) [2023-12-26 02:26:56,407][123090] Updated weights for policy 1, policy_version 356644 (0.0008) [2023-12-26 02:26:56,420][123091] Updated weights for policy 0, policy_version 358682 (0.0010) [2023-12-26 02:26:56,464][123090] Updated weights for policy 1, policy_version 356654 (0.0005) [2023-12-26 02:26:56,472][123091] Updated weights for policy 0, policy_version 358692 (0.0011) [2023-12-26 02:26:56,522][123090] Updated weights for policy 1, policy_version 356664 (0.0005) [2023-12-26 02:26:56,526][123091] Updated weights for policy 0, policy_version 358702 (0.0010) [2023-12-26 02:26:57,081][123090] Updated weights for policy 1, policy_version 356674 (0.0005) [2023-12-26 02:26:57,143][123090] Updated weights for policy 1, policy_version 356684 (0.0006) [2023-12-26 02:26:57,188][123090] Updated weights for policy 1, policy_version 356694 (0.0005) [2023-12-26 02:26:57,239][123090] Updated weights for policy 1, policy_version 356704 (0.0005) [2023-12-26 02:26:57,420][123091] Updated weights for policy 0, policy_version 358712 (0.0009) [2023-12-26 02:26:57,483][123091] Updated weights for policy 0, policy_version 358722 (0.0009) [2023-12-26 02:26:57,542][123091] Updated weights for policy 0, policy_version 358732 (0.0009) [2023-12-26 02:26:57,887][123090] Updated weights for policy 1, policy_version 356714 (0.0005) [2023-12-26 02:26:57,932][123090] Updated weights for policy 1, policy_version 356724 (0.0005) [2023-12-26 02:26:57,982][123090] Updated weights for policy 1, policy_version 356734 (0.0005) [2023-12-26 02:26:58,414][123091] Updated weights for policy 0, policy_version 358742 (0.0010) [2023-12-26 02:26:58,478][123091] Updated weights for policy 0, policy_version 358752 (0.0010) [2023-12-26 02:26:58,542][123091] Updated weights for policy 0, policy_version 358762 (0.0011) [2023-12-26 02:26:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 183173120. Throughput: 0: 8895.6, 1: 9040.4. Samples: 183167084. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:26:58,784][121949] Avg episode reward: [(0, '5785.827'), (1, '5940.274')] [2023-12-26 02:26:58,813][123090] Updated weights for policy 1, policy_version 356744 (0.0006) [2023-12-26 02:26:58,886][123090] Updated weights for policy 1, policy_version 356754 (0.0006) [2023-12-26 02:26:58,961][123090] Updated weights for policy 1, policy_version 356764 (0.0006) [2023-12-26 02:26:59,416][123091] Updated weights for policy 0, policy_version 358772 (0.0008) [2023-12-26 02:26:59,479][123091] Updated weights for policy 0, policy_version 358782 (0.0005) [2023-12-26 02:26:59,542][123091] Updated weights for policy 0, policy_version 358792 (0.0005) [2023-12-26 02:26:59,739][123090] Updated weights for policy 1, policy_version 356774 (0.0008) [2023-12-26 02:26:59,811][123090] Updated weights for policy 1, policy_version 356784 (0.0009) [2023-12-26 02:26:59,880][123090] Updated weights for policy 1, policy_version 356794 (0.0009) [2023-12-26 02:27:00,291][123091] Updated weights for policy 0, policy_version 358802 (0.0007) [2023-12-26 02:27:00,350][123091] Updated weights for policy 0, policy_version 358812 (0.0009) [2023-12-26 02:27:00,408][123091] Updated weights for policy 0, policy_version 358822 (0.0009) [2023-12-26 02:27:00,471][123091] Updated weights for policy 0, policy_version 358832 (0.0009) [2023-12-26 02:27:00,677][123090] Updated weights for policy 1, policy_version 356804 (0.0007) [2023-12-26 02:27:00,728][123090] Updated weights for policy 1, policy_version 356814 (0.0008) [2023-12-26 02:27:00,786][123090] Updated weights for policy 1, policy_version 356824 (0.0006) [2023-12-26 02:27:01,263][123091] Updated weights for policy 0, policy_version 358842 (0.0011) [2023-12-26 02:27:01,316][123091] Updated weights for policy 0, policy_version 358852 (0.0010) [2023-12-26 02:27:01,377][123091] Updated weights for policy 0, policy_version 358862 (0.0009) [2023-12-26 02:27:01,573][123090] Updated weights for policy 1, policy_version 356834 (0.0007) [2023-12-26 02:27:01,645][123090] Updated weights for policy 1, policy_version 356844 (0.0008) [2023-12-26 02:27:01,714][123090] Updated weights for policy 1, policy_version 356854 (0.0009) [2023-12-26 02:27:01,779][123090] Updated weights for policy 1, policy_version 356864 (0.0009) [2023-12-26 02:27:02,174][123091] Updated weights for policy 0, policy_version 358872 (0.0006) [2023-12-26 02:27:02,228][123091] Updated weights for policy 0, policy_version 358882 (0.0005) [2023-12-26 02:27:02,284][123091] Updated weights for policy 0, policy_version 358892 (0.0006) [2023-12-26 02:27:02,682][123090] Updated weights for policy 1, policy_version 356874 (0.0005) [2023-12-26 02:27:02,743][123090] Updated weights for policy 1, policy_version 356884 (0.0007) [2023-12-26 02:27:02,816][123090] Updated weights for policy 1, policy_version 356894 (0.0007) [2023-12-26 02:27:03,010][123091] Updated weights for policy 0, policy_version 358902 (0.0009) [2023-12-26 02:27:03,058][123091] Updated weights for policy 0, policy_version 358912 (0.0010) [2023-12-26 02:27:03,107][123091] Updated weights for policy 0, policy_version 358922 (0.0009) [2023-12-26 02:27:03,538][123090] Updated weights for policy 1, policy_version 356904 (0.0008) [2023-12-26 02:27:03,599][123090] Updated weights for policy 1, policy_version 356914 (0.0008) [2023-12-26 02:27:03,663][123090] Updated weights for policy 1, policy_version 356924 (0.0009) [2023-12-26 02:27:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 183263232. Throughput: 0: 8876.4, 1: 8888.4. Samples: 183273280. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:03,785][121949] Avg episode reward: [(0, '5762.612'), (1, '5998.088')] [2023-12-26 02:27:03,876][123091] Updated weights for policy 0, policy_version 358932 (0.0009) [2023-12-26 02:27:03,945][123091] Updated weights for policy 0, policy_version 358942 (0.0006) [2023-12-26 02:27:04,027][123091] Updated weights for policy 0, policy_version 358952 (0.0006) [2023-12-26 02:27:04,529][123090] Updated weights for policy 1, policy_version 356934 (0.0008) [2023-12-26 02:27:04,588][123090] Updated weights for policy 1, policy_version 356944 (0.0009) [2023-12-26 02:27:04,647][123090] Updated weights for policy 1, policy_version 356954 (0.0009) [2023-12-26 02:27:04,734][123091] Updated weights for policy 0, policy_version 358962 (0.0008) [2023-12-26 02:27:04,793][123091] Updated weights for policy 0, policy_version 358972 (0.0006) [2023-12-26 02:27:04,844][123091] Updated weights for policy 0, policy_version 358982 (0.0005) [2023-12-26 02:27:04,894][123091] Updated weights for policy 0, policy_version 358992 (0.0005) [2023-12-26 02:27:05,536][123090] Updated weights for policy 1, policy_version 356964 (0.0009) [2023-12-26 02:27:05,577][123091] Updated weights for policy 0, policy_version 359002 (0.0007) [2023-12-26 02:27:05,591][123090] Updated weights for policy 1, policy_version 356974 (0.0010) [2023-12-26 02:27:05,625][123091] Updated weights for policy 0, policy_version 359012 (0.0009) [2023-12-26 02:27:05,636][123090] Updated weights for policy 1, policy_version 356984 (0.0007) [2023-12-26 02:27:05,677][123091] Updated weights for policy 0, policy_version 359022 (0.0007) [2023-12-26 02:27:06,487][123090] Updated weights for policy 1, policy_version 356994 (0.0009) [2023-12-26 02:27:06,508][123091] Updated weights for policy 0, policy_version 359032 (0.0008) [2023-12-26 02:27:06,550][123090] Updated weights for policy 1, policy_version 357004 (0.0009) [2023-12-26 02:27:06,561][123091] Updated weights for policy 0, policy_version 359042 (0.0007) [2023-12-26 02:27:06,614][123090] Updated weights for policy 1, policy_version 357014 (0.0008) [2023-12-26 02:27:06,616][123091] Updated weights for policy 0, policy_version 359052 (0.0007) [2023-12-26 02:27:06,671][123090] Updated weights for policy 1, policy_version 357024 (0.0009) [2023-12-26 02:27:07,414][123091] Updated weights for policy 0, policy_version 359062 (0.0009) [2023-12-26 02:27:07,479][123091] Updated weights for policy 0, policy_version 359072 (0.0009) [2023-12-26 02:27:07,518][123090] Updated weights for policy 1, policy_version 357034 (0.0009) [2023-12-26 02:27:07,529][123091] Updated weights for policy 0, policy_version 359082 (0.0008) [2023-12-26 02:27:07,579][123090] Updated weights for policy 1, policy_version 357044 (0.0008) [2023-12-26 02:27:07,642][123090] Updated weights for policy 1, policy_version 357054 (0.0009) [2023-12-26 02:27:08,381][123091] Updated weights for policy 0, policy_version 359092 (0.0009) [2023-12-26 02:27:08,411][123090] Updated weights for policy 1, policy_version 357064 (0.0007) [2023-12-26 02:27:08,434][123091] Updated weights for policy 0, policy_version 359102 (0.0011) [2023-12-26 02:27:08,467][123090] Updated weights for policy 1, policy_version 357074 (0.0007) [2023-12-26 02:27:08,493][123091] Updated weights for policy 0, policy_version 359112 (0.0010) [2023-12-26 02:27:08,526][123090] Updated weights for policy 1, policy_version 357084 (0.0006) [2023-12-26 02:27:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 183353344. Throughput: 0: 8913.7, 1: 8856.3. Samples: 183326676. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:08,785][121949] Avg episode reward: [(0, '5856.794'), (1, '6024.991')] [2023-12-26 02:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000357088_91414528.pth... [2023-12-26 02:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000359120_91938816.pth... [2023-12-26 02:27:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000356032_91144192.pth [2023-12-26 02:27:08,795][123008] Saving new best policy, reward=6024.991! [2023-12-26 02:27:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000358064_91668480.pth [2023-12-26 02:27:09,341][123091] Updated weights for policy 0, policy_version 359122 (0.0011) [2023-12-26 02:27:09,420][123090] Updated weights for policy 1, policy_version 357094 (0.0010) [2023-12-26 02:27:09,438][123091] Updated weights for policy 0, policy_version 359132 (0.0011) [2023-12-26 02:27:09,491][123090] Updated weights for policy 1, policy_version 357104 (0.0007) [2023-12-26 02:27:09,505][123091] Updated weights for policy 0, policy_version 359142 (0.0009) [2023-12-26 02:27:09,555][123090] Updated weights for policy 1, policy_version 357114 (0.0006) [2023-12-26 02:27:09,565][123091] Updated weights for policy 0, policy_version 359152 (0.0011) [2023-12-26 02:27:10,406][123090] Updated weights for policy 1, policy_version 357124 (0.0009) [2023-12-26 02:27:10,430][123091] Updated weights for policy 0, policy_version 359162 (0.0010) [2023-12-26 02:27:10,471][123090] Updated weights for policy 1, policy_version 357134 (0.0006) [2023-12-26 02:27:10,478][123091] Updated weights for policy 0, policy_version 359172 (0.0010) [2023-12-26 02:27:10,525][123091] Updated weights for policy 0, policy_version 359182 (0.0010) [2023-12-26 02:27:10,532][123090] Updated weights for policy 1, policy_version 357144 (0.0006) [2023-12-26 02:27:11,387][123091] Updated weights for policy 0, policy_version 359192 (0.0010) [2023-12-26 02:27:11,388][123090] Updated weights for policy 1, policy_version 357154 (0.0009) [2023-12-26 02:27:11,455][123090] Updated weights for policy 1, policy_version 357164 (0.0009) [2023-12-26 02:27:11,455][123091] Updated weights for policy 0, policy_version 359202 (0.0009) [2023-12-26 02:27:11,521][123091] Updated weights for policy 0, policy_version 359212 (0.0009) [2023-12-26 02:27:11,521][123090] Updated weights for policy 1, policy_version 357174 (0.0009) [2023-12-26 02:27:11,587][123090] Updated weights for policy 1, policy_version 357184 (0.0009) [2023-12-26 02:27:12,374][123091] Updated weights for policy 0, policy_version 359222 (0.0010) [2023-12-26 02:27:12,444][123091] Updated weights for policy 0, policy_version 359232 (0.0011) [2023-12-26 02:27:12,464][123090] Updated weights for policy 1, policy_version 357194 (0.0007) [2023-12-26 02:27:12,499][123091] Updated weights for policy 0, policy_version 359242 (0.0010) [2023-12-26 02:27:12,520][123090] Updated weights for policy 1, policy_version 357204 (0.0008) [2023-12-26 02:27:12,580][123090] Updated weights for policy 1, policy_version 357214 (0.0009) [2023-12-26 02:27:13,316][123091] Updated weights for policy 0, policy_version 359252 (0.0011) [2023-12-26 02:27:13,371][123091] Updated weights for policy 0, policy_version 359262 (0.0010) [2023-12-26 02:27:13,420][123090] Updated weights for policy 1, policy_version 357224 (0.0007) [2023-12-26 02:27:13,429][123091] Updated weights for policy 0, policy_version 359272 (0.0010) [2023-12-26 02:27:13,467][123090] Updated weights for policy 1, policy_version 357234 (0.0008) [2023-12-26 02:27:13,514][123090] Updated weights for policy 1, policy_version 357244 (0.0008) [2023-12-26 02:27:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 183435264. Throughput: 0: 8876.1, 1: 8799.4. Samples: 183426592. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:13,785][121949] Avg episode reward: [(0, '5946.554'), (1, '5939.705')] [2023-12-26 02:27:14,266][123091] Updated weights for policy 0, policy_version 359282 (0.0010) [2023-12-26 02:27:14,328][123091] Updated weights for policy 0, policy_version 359292 (0.0011) [2023-12-26 02:27:14,353][123090] Updated weights for policy 1, policy_version 357254 (0.0009) [2023-12-26 02:27:14,391][123091] Updated weights for policy 0, policy_version 359302 (0.0010) [2023-12-26 02:27:14,419][123090] Updated weights for policy 1, policy_version 357264 (0.0008) [2023-12-26 02:27:14,450][123091] Updated weights for policy 0, policy_version 359312 (0.0010) [2023-12-26 02:27:14,481][123090] Updated weights for policy 1, policy_version 357274 (0.0008) [2023-12-26 02:27:15,240][123091] Updated weights for policy 0, policy_version 359322 (0.0011) [2023-12-26 02:27:15,299][123091] Updated weights for policy 0, policy_version 359332 (0.0011) [2023-12-26 02:27:15,306][123090] Updated weights for policy 1, policy_version 357284 (0.0007) [2023-12-26 02:27:15,366][123091] Updated weights for policy 0, policy_version 359343 (0.0008) [2023-12-26 02:27:15,371][123090] Updated weights for policy 1, policy_version 357294 (0.0009) [2023-12-26 02:27:15,443][123090] Updated weights for policy 1, policy_version 357304 (0.0009) [2023-12-26 02:27:16,039][123091] Updated weights for policy 0, policy_version 359353 (0.0010) [2023-12-26 02:27:16,094][123091] Updated weights for policy 0, policy_version 359363 (0.0009) [2023-12-26 02:27:16,146][123091] Updated weights for policy 0, policy_version 359373 (0.0009) [2023-12-26 02:27:16,292][123090] Updated weights for policy 1, policy_version 357314 (0.0008) [2023-12-26 02:27:16,354][123090] Updated weights for policy 1, policy_version 357324 (0.0010) [2023-12-26 02:27:16,425][123090] Updated weights for policy 1, policy_version 357334 (0.0010) [2023-12-26 02:27:16,483][123090] Updated weights for policy 1, policy_version 357344 (0.0009) [2023-12-26 02:27:16,906][123091] Updated weights for policy 0, policy_version 359383 (0.0009) [2023-12-26 02:27:16,965][123091] Updated weights for policy 0, policy_version 359393 (0.0009) [2023-12-26 02:27:17,022][123091] Updated weights for policy 0, policy_version 359403 (0.0006) [2023-12-26 02:27:17,319][123090] Updated weights for policy 1, policy_version 357354 (0.0009) [2023-12-26 02:27:17,373][123090] Updated weights for policy 1, policy_version 357365 (0.0010) [2023-12-26 02:27:17,432][123090] Updated weights for policy 1, policy_version 357375 (0.0010) [2023-12-26 02:27:17,620][123091] Updated weights for policy 0, policy_version 359413 (0.0007) [2023-12-26 02:27:17,681][123091] Updated weights for policy 0, policy_version 359423 (0.0009) [2023-12-26 02:27:17,735][123091] Updated weights for policy 0, policy_version 359433 (0.0009) [2023-12-26 02:27:18,306][123090] Updated weights for policy 1, policy_version 357385 (0.0010) [2023-12-26 02:27:18,373][123090] Updated weights for policy 1, policy_version 357395 (0.0008) [2023-12-26 02:27:18,447][123090] Updated weights for policy 1, policy_version 357405 (0.0009) [2023-12-26 02:27:18,484][123091] Updated weights for policy 0, policy_version 359443 (0.0008) [2023-12-26 02:27:18,552][123091] Updated weights for policy 0, policy_version 359453 (0.0007) [2023-12-26 02:27:18,623][123091] Updated weights for policy 0, policy_version 359463 (0.0010) [2023-12-26 02:27:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 183525376. Throughput: 0: 8914.3, 1: 8720.0. Samples: 183531792. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:18,784][121949] Avg episode reward: [(0, '5822.330'), (1, '5704.064')] [2023-12-26 02:27:19,303][123090] Updated weights for policy 1, policy_version 357415 (0.0007) [2023-12-26 02:27:19,365][123090] Updated weights for policy 1, policy_version 357425 (0.0008) [2023-12-26 02:27:19,380][123091] Updated weights for policy 0, policy_version 359473 (0.0008) [2023-12-26 02:27:19,434][123090] Updated weights for policy 1, policy_version 357435 (0.0008) [2023-12-26 02:27:19,443][123091] Updated weights for policy 0, policy_version 359483 (0.0011) [2023-12-26 02:27:19,507][123091] Updated weights for policy 0, policy_version 359493 (0.0011) [2023-12-26 02:27:19,574][123091] Updated weights for policy 0, policy_version 359503 (0.0011) [2023-12-26 02:27:20,291][123090] Updated weights for policy 1, policy_version 357445 (0.0009) [2023-12-26 02:27:20,342][123090] Updated weights for policy 1, policy_version 357455 (0.0008) [2023-12-26 02:27:20,345][123091] Updated weights for policy 0, policy_version 359513 (0.0008) [2023-12-26 02:27:20,403][123090] Updated weights for policy 1, policy_version 357465 (0.0009) [2023-12-26 02:27:20,408][123091] Updated weights for policy 0, policy_version 359523 (0.0009) [2023-12-26 02:27:20,472][123091] Updated weights for policy 0, policy_version 359533 (0.0009) [2023-12-26 02:27:21,266][123090] Updated weights for policy 1, policy_version 357475 (0.0010) [2023-12-26 02:27:21,335][123090] Updated weights for policy 1, policy_version 357485 (0.0009) [2023-12-26 02:27:21,337][123091] Updated weights for policy 0, policy_version 359543 (0.0007) [2023-12-26 02:27:21,406][123090] Updated weights for policy 1, policy_version 357495 (0.0008) [2023-12-26 02:27:21,408][123091] Updated weights for policy 0, policy_version 359553 (0.0009) [2023-12-26 02:27:21,474][123091] Updated weights for policy 0, policy_version 359563 (0.0007) [2023-12-26 02:27:22,306][123091] Updated weights for policy 0, policy_version 359573 (0.0010) [2023-12-26 02:27:22,320][123090] Updated weights for policy 1, policy_version 357505 (0.0010) [2023-12-26 02:27:22,362][123091] Updated weights for policy 0, policy_version 359583 (0.0009) [2023-12-26 02:27:22,389][123090] Updated weights for policy 1, policy_version 357515 (0.0010) [2023-12-26 02:27:22,431][123091] Updated weights for policy 0, policy_version 359593 (0.0008) [2023-12-26 02:27:22,458][123090] Updated weights for policy 1, policy_version 357525 (0.0010) [2023-12-26 02:27:22,518][123090] Updated weights for policy 1, policy_version 357535 (0.0011) [2023-12-26 02:27:23,271][123091] Updated weights for policy 0, policy_version 359603 (0.0008) [2023-12-26 02:27:23,328][123090] Updated weights for policy 1, policy_version 357545 (0.0010) [2023-12-26 02:27:23,329][123091] Updated weights for policy 0, policy_version 359613 (0.0007) [2023-12-26 02:27:23,384][123090] Updated weights for policy 1, policy_version 357555 (0.0006) [2023-12-26 02:27:23,390][123091] Updated weights for policy 0, policy_version 359623 (0.0009) [2023-12-26 02:27:23,447][123090] Updated weights for policy 1, policy_version 357565 (0.0007) [2023-12-26 02:27:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 183607296. Throughput: 0: 8896.5, 1: 8694.1. Samples: 183582308. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:23,784][121949] Avg episode reward: [(0, '5651.314'), (1, '5628.886')] [2023-12-26 02:27:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000357568_91537408.pth... [2023-12-26 02:27:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000359632_92069888.pth... [2023-12-26 02:27:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000356576_91283456.pth [2023-12-26 02:27:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000358608_91807744.pth [2023-12-26 02:27:24,226][123091] Updated weights for policy 0, policy_version 359633 (0.0008) [2023-12-26 02:27:24,236][123090] Updated weights for policy 1, policy_version 357575 (0.0007) [2023-12-26 02:27:24,285][123091] Updated weights for policy 0, policy_version 359643 (0.0011) [2023-12-26 02:27:24,292][123090] Updated weights for policy 1, policy_version 357585 (0.0006) [2023-12-26 02:27:24,349][123091] Updated weights for policy 0, policy_version 359653 (0.0006) [2023-12-26 02:27:24,359][123090] Updated weights for policy 1, policy_version 357595 (0.0009) [2023-12-26 02:27:24,413][123091] Updated weights for policy 0, policy_version 359663 (0.0006) [2023-12-26 02:27:25,089][123090] Updated weights for policy 1, policy_version 357605 (0.0007) [2023-12-26 02:27:25,106][123091] Updated weights for policy 0, policy_version 359673 (0.0005) [2023-12-26 02:27:25,141][123090] Updated weights for policy 1, policy_version 357615 (0.0010) [2023-12-26 02:27:25,153][123091] Updated weights for policy 0, policy_version 359683 (0.0005) [2023-12-26 02:27:25,193][123090] Updated weights for policy 1, policy_version 357625 (0.0010) [2023-12-26 02:27:25,204][123091] Updated weights for policy 0, policy_version 359693 (0.0005) [2023-12-26 02:27:25,933][123091] Updated weights for policy 0, policy_version 359703 (0.0009) [2023-12-26 02:27:25,988][123090] Updated weights for policy 1, policy_version 357635 (0.0009) [2023-12-26 02:27:25,992][123091] Updated weights for policy 0, policy_version 359713 (0.0010) [2023-12-26 02:27:26,046][123090] Updated weights for policy 1, policy_version 357645 (0.0006) [2023-12-26 02:27:26,059][123091] Updated weights for policy 0, policy_version 359723 (0.0011) [2023-12-26 02:27:26,107][123090] Updated weights for policy 1, policy_version 357655 (0.0009) [2023-12-26 02:27:26,847][123090] Updated weights for policy 1, policy_version 357665 (0.0010) [2023-12-26 02:27:26,877][123091] Updated weights for policy 0, policy_version 359733 (0.0011) [2023-12-26 02:27:26,906][123090] Updated weights for policy 1, policy_version 357675 (0.0008) [2023-12-26 02:27:26,929][123091] Updated weights for policy 0, policy_version 359743 (0.0010) [2023-12-26 02:27:26,962][123090] Updated weights for policy 1, policy_version 357685 (0.0006) [2023-12-26 02:27:26,988][123091] Updated weights for policy 0, policy_version 359753 (0.0011) [2023-12-26 02:27:27,033][123090] Updated weights for policy 1, policy_version 357695 (0.0005) [2023-12-26 02:27:27,727][123090] Updated weights for policy 1, policy_version 357705 (0.0005) [2023-12-26 02:27:27,738][123091] Updated weights for policy 0, policy_version 359763 (0.0009) [2023-12-26 02:27:27,785][123090] Updated weights for policy 1, policy_version 357715 (0.0006) [2023-12-26 02:27:27,787][123091] Updated weights for policy 0, policy_version 359773 (0.0006) [2023-12-26 02:27:27,834][123091] Updated weights for policy 0, policy_version 359783 (0.0007) [2023-12-26 02:27:27,843][123090] Updated weights for policy 1, policy_version 357725 (0.0010) [2023-12-26 02:27:28,553][123091] Updated weights for policy 0, policy_version 359793 (0.0006) [2023-12-26 02:27:28,563][123090] Updated weights for policy 1, policy_version 357735 (0.0010) [2023-12-26 02:27:28,617][123091] Updated weights for policy 0, policy_version 359803 (0.0011) [2023-12-26 02:27:28,617][123090] Updated weights for policy 1, policy_version 357745 (0.0005) [2023-12-26 02:27:28,680][123091] Updated weights for policy 0, policy_version 359813 (0.0009) [2023-12-26 02:27:28,681][123090] Updated weights for policy 1, policy_version 357755 (0.0008) [2023-12-26 02:27:28,741][123091] Updated weights for policy 0, policy_version 359823 (0.0007) [2023-12-26 02:27:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 183705600. Throughput: 0: 8922.7, 1: 8748.7. Samples: 183690940. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:28,785][121949] Avg episode reward: [(0, '5707.852'), (1, '5712.890')] [2023-12-26 02:27:29,532][123090] Updated weights for policy 1, policy_version 357765 (0.0010) [2023-12-26 02:27:29,558][123091] Updated weights for policy 0, policy_version 359833 (0.0007) [2023-12-26 02:27:29,591][123090] Updated weights for policy 1, policy_version 357775 (0.0010) [2023-12-26 02:27:29,620][123091] Updated weights for policy 0, policy_version 359843 (0.0008) [2023-12-26 02:27:29,650][123090] Updated weights for policy 1, policy_version 357785 (0.0010) [2023-12-26 02:27:29,679][123091] Updated weights for policy 0, policy_version 359853 (0.0008) [2023-12-26 02:27:30,478][123090] Updated weights for policy 1, policy_version 357795 (0.0010) [2023-12-26 02:27:30,507][123091] Updated weights for policy 0, policy_version 359863 (0.0006) [2023-12-26 02:27:30,526][123090] Updated weights for policy 1, policy_version 357805 (0.0010) [2023-12-26 02:27:30,555][123091] Updated weights for policy 0, policy_version 359873 (0.0005) [2023-12-26 02:27:30,574][123090] Updated weights for policy 1, policy_version 357815 (0.0010) [2023-12-26 02:27:30,611][123091] Updated weights for policy 0, policy_version 359883 (0.0008) [2023-12-26 02:27:31,414][123090] Updated weights for policy 1, policy_version 357825 (0.0010) [2023-12-26 02:27:31,482][123091] Updated weights for policy 0, policy_version 359893 (0.0007) [2023-12-26 02:27:31,483][123090] Updated weights for policy 1, policy_version 357835 (0.0010) [2023-12-26 02:27:31,546][123090] Updated weights for policy 1, policy_version 357845 (0.0009) [2023-12-26 02:27:31,546][123091] Updated weights for policy 0, policy_version 359903 (0.0007) [2023-12-26 02:27:31,612][123091] Updated weights for policy 0, policy_version 359913 (0.0009) [2023-12-26 02:27:31,613][123090] Updated weights for policy 1, policy_version 357855 (0.0009) [2023-12-26 02:27:32,293][123091] Updated weights for policy 0, policy_version 359923 (0.0008) [2023-12-26 02:27:32,363][123091] Updated weights for policy 0, policy_version 359933 (0.0011) [2023-12-26 02:27:32,430][123091] Updated weights for policy 0, policy_version 359943 (0.0011) [2023-12-26 02:27:32,431][123090] Updated weights for policy 1, policy_version 357865 (0.0006) [2023-12-26 02:27:32,484][123090] Updated weights for policy 1, policy_version 357875 (0.0006) [2023-12-26 02:27:32,557][123090] Updated weights for policy 1, policy_version 357885 (0.0005) [2023-12-26 02:27:33,215][123090] Updated weights for policy 1, policy_version 357895 (0.0005) [2023-12-26 02:27:33,259][123091] Updated weights for policy 0, policy_version 359953 (0.0011) [2023-12-26 02:27:33,267][123090] Updated weights for policy 1, policy_version 357905 (0.0006) [2023-12-26 02:27:33,313][123091] Updated weights for policy 0, policy_version 359963 (0.0010) [2023-12-26 02:27:33,315][123090] Updated weights for policy 1, policy_version 357915 (0.0007) [2023-12-26 02:27:33,368][123091] Updated weights for policy 0, policy_version 359973 (0.0011) [2023-12-26 02:27:33,429][123091] Updated weights for policy 0, policy_version 359983 (0.0010) [2023-12-26 02:27:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 183787520. Throughput: 0: 8895.7, 1: 8735.8. Samples: 183799596. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:33,785][121949] Avg episode reward: [(0, '5767.822'), (1, '5718.710')] [2023-12-26 02:27:34,112][123090] Updated weights for policy 1, policy_version 357925 (0.0007) [2023-12-26 02:27:34,147][123091] Updated weights for policy 0, policy_version 359993 (0.0011) [2023-12-26 02:27:34,175][123090] Updated weights for policy 1, policy_version 357935 (0.0007) [2023-12-26 02:27:34,207][123091] Updated weights for policy 0, policy_version 360003 (0.0011) [2023-12-26 02:27:34,245][123090] Updated weights for policy 1, policy_version 357945 (0.0006) [2023-12-26 02:27:34,267][123091] Updated weights for policy 0, policy_version 360013 (0.0011) [2023-12-26 02:27:35,057][123090] Updated weights for policy 1, policy_version 357955 (0.0007) [2023-12-26 02:27:35,094][123091] Updated weights for policy 0, policy_version 360023 (0.0011) [2023-12-26 02:27:35,111][123090] Updated weights for policy 1, policy_version 357965 (0.0007) [2023-12-26 02:27:35,157][123091] Updated weights for policy 0, policy_version 360033 (0.0011) [2023-12-26 02:27:35,157][123090] Updated weights for policy 1, policy_version 357975 (0.0009) [2023-12-26 02:27:35,220][123091] Updated weights for policy 0, policy_version 360043 (0.0011) [2023-12-26 02:27:36,014][123090] Updated weights for policy 1, policy_version 357985 (0.0008) [2023-12-26 02:27:36,032][123091] Updated weights for policy 0, policy_version 360053 (0.0010) [2023-12-26 02:27:36,065][123090] Updated weights for policy 1, policy_version 357995 (0.0007) [2023-12-26 02:27:36,079][123091] Updated weights for policy 0, policy_version 360063 (0.0010) [2023-12-26 02:27:36,124][123090] Updated weights for policy 1, policy_version 358005 (0.0007) [2023-12-26 02:27:36,142][123091] Updated weights for policy 0, policy_version 360073 (0.0010) [2023-12-26 02:27:36,178][123090] Updated weights for policy 1, policy_version 358015 (0.0009) [2023-12-26 02:27:36,881][123091] Updated weights for policy 0, policy_version 360083 (0.0009) [2023-12-26 02:27:36,942][123091] Updated weights for policy 0, policy_version 360093 (0.0009) [2023-12-26 02:27:36,996][123091] Updated weights for policy 0, policy_version 360103 (0.0010) [2023-12-26 02:27:37,060][123090] Updated weights for policy 1, policy_version 358025 (0.0007) [2023-12-26 02:27:37,118][123090] Updated weights for policy 1, policy_version 358035 (0.0009) [2023-12-26 02:27:37,187][123090] Updated weights for policy 1, policy_version 358045 (0.0009) [2023-12-26 02:27:37,791][123091] Updated weights for policy 0, policy_version 360113 (0.0010) [2023-12-26 02:27:37,857][123091] Updated weights for policy 0, policy_version 360123 (0.0008) [2023-12-26 02:27:37,923][123091] Updated weights for policy 0, policy_version 360133 (0.0008) [2023-12-26 02:27:37,986][123091] Updated weights for policy 0, policy_version 360143 (0.0011) [2023-12-26 02:27:38,048][123090] Updated weights for policy 1, policy_version 358055 (0.0006) [2023-12-26 02:27:38,112][123090] Updated weights for policy 1, policy_version 358065 (0.0006) [2023-12-26 02:27:38,172][123090] Updated weights for policy 1, policy_version 358075 (0.0005) [2023-12-26 02:27:38,726][123091] Updated weights for policy 0, policy_version 360153 (0.0011) [2023-12-26 02:27:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 183869440. Throughput: 0: 8912.9, 1: 8681.2. Samples: 183850996. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:38,785][121949] Avg episode reward: [(0, '5609.353'), (1, '5651.111')] [2023-12-26 02:27:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000358080_91668480.pth... [2023-12-26 02:27:38,794][123091] Updated weights for policy 0, policy_version 360163 (0.0006) [2023-12-26 02:27:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000357088_91414528.pth [2023-12-26 02:27:38,855][123091] Updated weights for policy 0, policy_version 360173 (0.0005) [2023-12-26 02:27:38,875][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000360176_92209152.pth... [2023-12-26 02:27:38,880][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000359120_91938816.pth [2023-12-26 02:27:38,944][123090] Updated weights for policy 1, policy_version 358085 (0.0007) [2023-12-26 02:27:39,019][123090] Updated weights for policy 1, policy_version 358095 (0.0008) [2023-12-26 02:27:39,088][123090] Updated weights for policy 1, policy_version 358105 (0.0008) [2023-12-26 02:27:39,679][123091] Updated weights for policy 0, policy_version 360183 (0.0009) [2023-12-26 02:27:39,735][123091] Updated weights for policy 0, policy_version 360193 (0.0011) [2023-12-26 02:27:39,796][123091] Updated weights for policy 0, policy_version 360203 (0.0011) [2023-12-26 02:27:39,876][123090] Updated weights for policy 1, policy_version 358115 (0.0007) [2023-12-26 02:27:39,953][123090] Updated weights for policy 1, policy_version 358125 (0.0008) [2023-12-26 02:27:40,017][123090] Updated weights for policy 1, policy_version 358135 (0.0010) [2023-12-26 02:27:40,572][123091] Updated weights for policy 0, policy_version 360213 (0.0008) [2023-12-26 02:27:40,631][123091] Updated weights for policy 0, policy_version 360223 (0.0006) [2023-12-26 02:27:40,679][123091] Updated weights for policy 0, policy_version 360233 (0.0010) [2023-12-26 02:27:40,854][123090] Updated weights for policy 1, policy_version 358145 (0.0009) [2023-12-26 02:27:40,916][123090] Updated weights for policy 1, policy_version 358155 (0.0005) [2023-12-26 02:27:40,976][123090] Updated weights for policy 1, policy_version 358165 (0.0005) [2023-12-26 02:27:41,054][123090] Updated weights for policy 1, policy_version 358175 (0.0007) [2023-12-26 02:27:41,459][123091] Updated weights for policy 0, policy_version 360243 (0.0007) [2023-12-26 02:27:41,523][123091] Updated weights for policy 0, policy_version 360253 (0.0006) [2023-12-26 02:27:41,586][123091] Updated weights for policy 0, policy_version 360263 (0.0006) [2023-12-26 02:27:41,882][123090] Updated weights for policy 1, policy_version 358185 (0.0009) [2023-12-26 02:27:41,941][123090] Updated weights for policy 1, policy_version 358195 (0.0010) [2023-12-26 02:27:42,007][123090] Updated weights for policy 1, policy_version 358205 (0.0008) [2023-12-26 02:27:42,229][123091] Updated weights for policy 0, policy_version 360273 (0.0010) [2023-12-26 02:27:42,293][123091] Updated weights for policy 0, policy_version 360283 (0.0011) [2023-12-26 02:27:42,369][123091] Updated weights for policy 0, policy_version 360293 (0.0011) [2023-12-26 02:27:42,433][123091] Updated weights for policy 0, policy_version 360303 (0.0009) [2023-12-26 02:27:42,854][123090] Updated weights for policy 1, policy_version 358215 (0.0008) [2023-12-26 02:27:42,913][123090] Updated weights for policy 1, policy_version 358225 (0.0009) [2023-12-26 02:27:42,970][123090] Updated weights for policy 1, policy_version 358235 (0.0009) [2023-12-26 02:27:43,246][123091] Updated weights for policy 0, policy_version 360313 (0.0010) [2023-12-26 02:27:43,304][123091] Updated weights for policy 0, policy_version 360323 (0.0010) [2023-12-26 02:27:43,361][123091] Updated weights for policy 0, policy_version 360333 (0.0010) [2023-12-26 02:27:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 183959552. Throughput: 0: 8949.6, 1: 8582.6. Samples: 183956032. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:43,784][121949] Avg episode reward: [(0, '5718.500'), (1, '5574.301')] [2023-12-26 02:27:43,806][123090] Updated weights for policy 1, policy_version 358245 (0.0009) [2023-12-26 02:27:43,865][123090] Updated weights for policy 1, policy_version 358255 (0.0009) [2023-12-26 02:27:43,930][123090] Updated weights for policy 1, policy_version 358265 (0.0009) [2023-12-26 02:27:44,205][123091] Updated weights for policy 0, policy_version 360343 (0.0009) [2023-12-26 02:27:44,254][123091] Updated weights for policy 0, policy_version 360353 (0.0009) [2023-12-26 02:27:44,312][123091] Updated weights for policy 0, policy_version 360364 (0.0010) [2023-12-26 02:27:44,730][123090] Updated weights for policy 1, policy_version 358275 (0.0008) [2023-12-26 02:27:44,791][123090] Updated weights for policy 1, policy_version 358285 (0.0007) [2023-12-26 02:27:44,848][123090] Updated weights for policy 1, policy_version 358295 (0.0008) [2023-12-26 02:27:45,153][123091] Updated weights for policy 0, policy_version 360374 (0.0010) [2023-12-26 02:27:45,216][123091] Updated weights for policy 0, policy_version 360384 (0.0010) [2023-12-26 02:27:45,280][123091] Updated weights for policy 0, policy_version 360394 (0.0009) [2023-12-26 02:27:45,637][123090] Updated weights for policy 1, policy_version 358305 (0.0009) [2023-12-26 02:27:45,691][123090] Updated weights for policy 1, policy_version 358315 (0.0008) [2023-12-26 02:27:45,740][123090] Updated weights for policy 1, policy_version 358325 (0.0009) [2023-12-26 02:27:45,786][123090] Updated weights for policy 1, policy_version 358335 (0.0005) [2023-12-26 02:27:46,160][123091] Updated weights for policy 0, policy_version 360404 (0.0010) [2023-12-26 02:27:46,221][123091] Updated weights for policy 0, policy_version 360414 (0.0008) [2023-12-26 02:27:46,271][123091] Updated weights for policy 0, policy_version 360424 (0.0005) [2023-12-26 02:27:46,591][123090] Updated weights for policy 1, policy_version 358345 (0.0009) [2023-12-26 02:27:46,644][123090] Updated weights for policy 1, policy_version 358355 (0.0009) [2023-12-26 02:27:46,694][123090] Updated weights for policy 1, policy_version 358365 (0.0009) [2023-12-26 02:27:47,007][123091] Updated weights for policy 0, policy_version 360434 (0.0005) [2023-12-26 02:27:47,078][123091] Updated weights for policy 0, policy_version 360444 (0.0005) [2023-12-26 02:27:47,140][123091] Updated weights for policy 0, policy_version 360454 (0.0005) [2023-12-26 02:27:47,191][123091] Updated weights for policy 0, policy_version 360464 (0.0005) [2023-12-26 02:27:47,502][123090] Updated weights for policy 1, policy_version 358375 (0.0006) [2023-12-26 02:27:47,574][123090] Updated weights for policy 1, policy_version 358385 (0.0005) [2023-12-26 02:27:47,640][123090] Updated weights for policy 1, policy_version 358395 (0.0005) [2023-12-26 02:27:47,893][123091] Updated weights for policy 0, policy_version 360474 (0.0005) [2023-12-26 02:27:47,949][123091] Updated weights for policy 0, policy_version 360484 (0.0005) [2023-12-26 02:27:48,006][123091] Updated weights for policy 0, policy_version 360494 (0.0006) [2023-12-26 02:27:48,180][123090] Updated weights for policy 1, policy_version 358405 (0.0005) [2023-12-26 02:27:48,244][123090] Updated weights for policy 1, policy_version 358415 (0.0005) [2023-12-26 02:27:48,302][123090] Updated weights for policy 1, policy_version 358425 (0.0005) [2023-12-26 02:27:48,699][123091] Updated weights for policy 0, policy_version 360504 (0.0007) [2023-12-26 02:27:48,771][123091] Updated weights for policy 0, policy_version 360514 (0.0005) [2023-12-26 02:27:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 184049664. Throughput: 0: 8958.6, 1: 8639.5. Samples: 184065200. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:48,785][121949] Avg episode reward: [(0, '5805.953'), (1, '5369.259')] [2023-12-26 02:27:48,840][123091] Updated weights for policy 0, policy_version 360524 (0.0005) [2023-12-26 02:27:49,052][123090] Updated weights for policy 1, policy_version 358435 (0.0008) [2023-12-26 02:27:49,118][123090] Updated weights for policy 1, policy_version 358445 (0.0009) [2023-12-26 02:27:49,175][123090] Updated weights for policy 1, policy_version 358455 (0.0010) [2023-12-26 02:27:49,569][123091] Updated weights for policy 0, policy_version 360534 (0.0009) [2023-12-26 02:27:49,629][123091] Updated weights for policy 0, policy_version 360544 (0.0011) [2023-12-26 02:27:49,676][123091] Updated weights for policy 0, policy_version 360554 (0.0010) [2023-12-26 02:27:49,955][123090] Updated weights for policy 1, policy_version 358465 (0.0009) [2023-12-26 02:27:50,020][123090] Updated weights for policy 1, policy_version 358475 (0.0008) [2023-12-26 02:27:50,082][123090] Updated weights for policy 1, policy_version 358485 (0.0008) [2023-12-26 02:27:50,147][123090] Updated weights for policy 1, policy_version 358495 (0.0008) [2023-12-26 02:27:50,488][123091] Updated weights for policy 0, policy_version 360564 (0.0008) [2023-12-26 02:27:50,554][123091] Updated weights for policy 0, policy_version 360574 (0.0011) [2023-12-26 02:27:50,624][123091] Updated weights for policy 0, policy_version 360584 (0.0010) [2023-12-26 02:27:50,929][123090] Updated weights for policy 1, policy_version 358505 (0.0009) [2023-12-26 02:27:50,984][123090] Updated weights for policy 1, policy_version 358515 (0.0009) [2023-12-26 02:27:51,053][123090] Updated weights for policy 1, policy_version 358525 (0.0009) [2023-12-26 02:27:51,361][123091] Updated weights for policy 0, policy_version 360594 (0.0008) [2023-12-26 02:27:51,425][123091] Updated weights for policy 0, policy_version 360604 (0.0009) [2023-12-26 02:27:51,496][123091] Updated weights for policy 0, policy_version 360614 (0.0009) [2023-12-26 02:27:51,564][123091] Updated weights for policy 0, policy_version 360624 (0.0009) [2023-12-26 02:27:51,890][123090] Updated weights for policy 1, policy_version 358535 (0.0010) [2023-12-26 02:27:51,953][123090] Updated weights for policy 1, policy_version 358545 (0.0009) [2023-12-26 02:27:52,024][123090] Updated weights for policy 1, policy_version 358555 (0.0010) [2023-12-26 02:27:52,429][123091] Updated weights for policy 0, policy_version 360634 (0.0009) [2023-12-26 02:27:52,496][123091] Updated weights for policy 0, policy_version 360644 (0.0009) [2023-12-26 02:27:52,563][123091] Updated weights for policy 0, policy_version 360654 (0.0009) [2023-12-26 02:27:52,818][123090] Updated weights for policy 1, policy_version 358565 (0.0008) [2023-12-26 02:27:52,874][123090] Updated weights for policy 1, policy_version 358575 (0.0005) [2023-12-26 02:27:52,932][123090] Updated weights for policy 1, policy_version 358585 (0.0007) [2023-12-26 02:27:53,396][123091] Updated weights for policy 0, policy_version 360664 (0.0010) [2023-12-26 02:27:53,454][123091] Updated weights for policy 0, policy_version 360674 (0.0010) [2023-12-26 02:27:53,521][123091] Updated weights for policy 0, policy_version 360684 (0.0011) [2023-12-26 02:27:53,739][123090] Updated weights for policy 1, policy_version 358595 (0.0009) [2023-12-26 02:27:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 184139776. Throughput: 0: 8916.5, 1: 8672.5. Samples: 184118184. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 02:27:53,785][121949] Avg episode reward: [(0, '5578.058'), (1, '5346.294')] [2023-12-26 02:27:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000360688_92340224.pth... [2023-12-26 02:27:53,794][123090] Updated weights for policy 1, policy_version 358605 (0.0009) [2023-12-26 02:27:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000359632_92069888.pth [2023-12-26 02:27:53,842][123090] Updated weights for policy 1, policy_version 358615 (0.0009) [2023-12-26 02:27:53,890][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000358624_91807744.pth... [2023-12-26 02:27:53,893][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000357568_91537408.pth [2023-12-26 02:27:54,360][123091] Updated weights for policy 0, policy_version 360694 (0.0010) [2023-12-26 02:27:54,425][123091] Updated weights for policy 0, policy_version 360704 (0.0009) [2023-12-26 02:27:54,495][123091] Updated weights for policy 0, policy_version 360714 (0.0010) [2023-12-26 02:27:54,688][123090] Updated weights for policy 1, policy_version 358625 (0.0009) [2023-12-26 02:27:54,753][123090] Updated weights for policy 1, policy_version 358635 (0.0010) [2023-12-26 02:27:54,816][123090] Updated weights for policy 1, policy_version 358645 (0.0010) [2023-12-26 02:27:54,876][123090] Updated weights for policy 1, policy_version 358655 (0.0010) [2023-12-26 02:27:55,329][123091] Updated weights for policy 0, policy_version 360724 (0.0010) [2023-12-26 02:27:55,374][123091] Updated weights for policy 0, policy_version 360734 (0.0009) [2023-12-26 02:27:55,426][123091] Updated weights for policy 0, policy_version 360744 (0.0008) [2023-12-26 02:27:55,739][123090] Updated weights for policy 1, policy_version 358665 (0.0009) [2023-12-26 02:27:55,788][123090] Updated weights for policy 1, policy_version 358675 (0.0009) [2023-12-26 02:27:55,851][123090] Updated weights for policy 1, policy_version 358685 (0.0009) [2023-12-26 02:27:56,198][123091] Updated weights for policy 0, policy_version 360754 (0.0007) [2023-12-26 02:27:56,249][123091] Updated weights for policy 0, policy_version 360765 (0.0010) [2023-12-26 02:27:56,307][123091] Updated weights for policy 0, policy_version 360775 (0.0009) [2023-12-26 02:27:56,685][123090] Updated weights for policy 1, policy_version 358695 (0.0010) [2023-12-26 02:27:56,745][123090] Updated weights for policy 1, policy_version 358705 (0.0009) [2023-12-26 02:27:56,819][123090] Updated weights for policy 1, policy_version 358715 (0.0006) [2023-12-26 02:27:57,091][123091] Updated weights for policy 0, policy_version 360785 (0.0009) [2023-12-26 02:27:57,149][123091] Updated weights for policy 0, policy_version 360795 (0.0010) [2023-12-26 02:27:57,204][123091] Updated weights for policy 0, policy_version 360805 (0.0010) [2023-12-26 02:27:57,258][123091] Updated weights for policy 0, policy_version 360815 (0.0010) [2023-12-26 02:27:57,544][123090] Updated weights for policy 1, policy_version 358725 (0.0007) [2023-12-26 02:27:57,594][123090] Updated weights for policy 1, policy_version 358735 (0.0009) [2023-12-26 02:27:57,640][123090] Updated weights for policy 1, policy_version 358746 (0.0008) [2023-12-26 02:27:58,113][123091] Updated weights for policy 0, policy_version 360825 (0.0011) [2023-12-26 02:27:58,177][123091] Updated weights for policy 0, policy_version 360835 (0.0011) [2023-12-26 02:27:58,245][123091] Updated weights for policy 0, policy_version 360845 (0.0011) [2023-12-26 02:27:58,527][123090] Updated weights for policy 1, policy_version 358756 (0.0009) [2023-12-26 02:27:58,592][123090] Updated weights for policy 1, policy_version 358766 (0.0009) [2023-12-26 02:27:58,660][123090] Updated weights for policy 1, policy_version 358776 (0.0009) [2023-12-26 02:27:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 184229888. Throughput: 0: 8947.2, 1: 8729.1. Samples: 184222024. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:27:58,785][121949] Avg episode reward: [(0, '5534.674'), (1, '5441.813')] [2023-12-26 02:27:59,120][123091] Updated weights for policy 0, policy_version 360855 (0.0009) [2023-12-26 02:27:59,187][123091] Updated weights for policy 0, policy_version 360865 (0.0011) [2023-12-26 02:27:59,260][123091] Updated weights for policy 0, policy_version 360875 (0.0010) [2023-12-26 02:27:59,519][123090] Updated weights for policy 1, policy_version 358786 (0.0009) [2023-12-26 02:27:59,578][123090] Updated weights for policy 1, policy_version 358796 (0.0010) [2023-12-26 02:27:59,631][123090] Updated weights for policy 1, policy_version 358806 (0.0010) [2023-12-26 02:27:59,682][123090] Updated weights for policy 1, policy_version 358816 (0.0010) [2023-12-26 02:28:00,026][123091] Updated weights for policy 0, policy_version 360885 (0.0011) [2023-12-26 02:28:00,085][123091] Updated weights for policy 0, policy_version 360895 (0.0010) [2023-12-26 02:28:00,136][123091] Updated weights for policy 0, policy_version 360905 (0.0010) [2023-12-26 02:28:00,441][123090] Updated weights for policy 1, policy_version 358826 (0.0005) [2023-12-26 02:28:00,503][123090] Updated weights for policy 1, policy_version 358836 (0.0005) [2023-12-26 02:28:00,562][123090] Updated weights for policy 1, policy_version 358846 (0.0005) [2023-12-26 02:28:00,871][123091] Updated weights for policy 0, policy_version 360915 (0.0011) [2023-12-26 02:28:00,918][123091] Updated weights for policy 0, policy_version 360925 (0.0010) [2023-12-26 02:28:00,973][123091] Updated weights for policy 0, policy_version 360935 (0.0010) [2023-12-26 02:28:01,206][123090] Updated weights for policy 1, policy_version 358856 (0.0008) [2023-12-26 02:28:01,257][123090] Updated weights for policy 1, policy_version 358866 (0.0008) [2023-12-26 02:28:01,316][123090] Updated weights for policy 1, policy_version 358877 (0.0009) [2023-12-26 02:28:01,755][123091] Updated weights for policy 0, policy_version 360945 (0.0007) [2023-12-26 02:28:01,823][123091] Updated weights for policy 0, policy_version 360955 (0.0009) [2023-12-26 02:28:01,892][123091] Updated weights for policy 0, policy_version 360965 (0.0010) [2023-12-26 02:28:01,963][123091] Updated weights for policy 0, policy_version 360975 (0.0010) [2023-12-26 02:28:02,268][123090] Updated weights for policy 1, policy_version 358887 (0.0010) [2023-12-26 02:28:02,337][123090] Updated weights for policy 1, policy_version 358897 (0.0009) [2023-12-26 02:28:02,404][123090] Updated weights for policy 1, policy_version 358907 (0.0009) [2023-12-26 02:28:02,647][123091] Updated weights for policy 0, policy_version 360985 (0.0007) [2023-12-26 02:28:02,713][123091] Updated weights for policy 0, policy_version 360995 (0.0005) [2023-12-26 02:28:02,780][123091] Updated weights for policy 0, policy_version 361005 (0.0007) [2023-12-26 02:28:03,191][123090] Updated weights for policy 1, policy_version 358917 (0.0007) [2023-12-26 02:28:03,253][123090] Updated weights for policy 1, policy_version 358927 (0.0009) [2023-12-26 02:28:03,311][123090] Updated weights for policy 1, policy_version 358937 (0.0009) [2023-12-26 02:28:03,453][123091] Updated weights for policy 0, policy_version 361015 (0.0008) [2023-12-26 02:28:03,507][123091] Updated weights for policy 0, policy_version 361026 (0.0010) [2023-12-26 02:28:03,562][123091] Updated weights for policy 0, policy_version 361037 (0.0008) [2023-12-26 02:28:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 184320000. Throughput: 0: 8941.6, 1: 8783.7. Samples: 184329432. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:03,785][121949] Avg episode reward: [(0, '5620.369'), (1, '5614.602')] [2023-12-26 02:28:04,043][123090] Updated weights for policy 1, policy_version 358947 (0.0007) [2023-12-26 02:28:04,110][123090] Updated weights for policy 1, policy_version 358957 (0.0008) [2023-12-26 02:28:04,184][123090] Updated weights for policy 1, policy_version 358967 (0.0009) [2023-12-26 02:28:04,294][123091] Updated weights for policy 0, policy_version 361047 (0.0008) [2023-12-26 02:28:04,354][123091] Updated weights for policy 0, policy_version 361057 (0.0009) [2023-12-26 02:28:04,412][123091] Updated weights for policy 0, policy_version 361067 (0.0010) [2023-12-26 02:28:04,920][123090] Updated weights for policy 1, policy_version 358977 (0.0008) [2023-12-26 02:28:04,990][123090] Updated weights for policy 1, policy_version 358987 (0.0008) [2023-12-26 02:28:05,062][123090] Updated weights for policy 1, policy_version 358997 (0.0006) [2023-12-26 02:28:05,129][123090] Updated weights for policy 1, policy_version 359007 (0.0006) [2023-12-26 02:28:05,153][123091] Updated weights for policy 0, policy_version 361077 (0.0007) [2023-12-26 02:28:05,226][123091] Updated weights for policy 0, policy_version 361087 (0.0007) [2023-12-26 02:28:05,282][123091] Updated weights for policy 0, policy_version 361097 (0.0010) [2023-12-26 02:28:05,913][123090] Updated weights for policy 1, policy_version 359017 (0.0006) [2023-12-26 02:28:05,987][123090] Updated weights for policy 1, policy_version 359027 (0.0007) [2023-12-26 02:28:06,017][123091] Updated weights for policy 0, policy_version 361107 (0.0010) [2023-12-26 02:28:06,051][123090] Updated weights for policy 1, policy_version 359037 (0.0007) [2023-12-26 02:28:06,069][123091] Updated weights for policy 0, policy_version 361117 (0.0011) [2023-12-26 02:28:06,131][123091] Updated weights for policy 0, policy_version 361127 (0.0010) [2023-12-26 02:28:06,861][123090] Updated weights for policy 1, policy_version 359047 (0.0006) [2023-12-26 02:28:06,866][123091] Updated weights for policy 0, policy_version 361137 (0.0011) [2023-12-26 02:28:06,925][123091] Updated weights for policy 0, policy_version 361147 (0.0010) [2023-12-26 02:28:06,928][123090] Updated weights for policy 1, policy_version 359057 (0.0007) [2023-12-26 02:28:06,978][123091] Updated weights for policy 0, policy_version 361157 (0.0011) [2023-12-26 02:28:06,989][123090] Updated weights for policy 1, policy_version 359067 (0.0006) [2023-12-26 02:28:07,026][123091] Updated weights for policy 0, policy_version 361167 (0.0011) [2023-12-26 02:28:07,785][123090] Updated weights for policy 1, policy_version 359077 (0.0005) [2023-12-26 02:28:07,843][123090] Updated weights for policy 1, policy_version 359087 (0.0007) [2023-12-26 02:28:07,887][123091] Updated weights for policy 0, policy_version 361177 (0.0011) [2023-12-26 02:28:07,895][123090] Updated weights for policy 1, policy_version 359097 (0.0007) [2023-12-26 02:28:07,940][123091] Updated weights for policy 0, policy_version 361187 (0.0011) [2023-12-26 02:28:07,988][123091] Updated weights for policy 0, policy_version 361197 (0.0010) [2023-12-26 02:28:08,711][123090] Updated weights for policy 1, policy_version 359107 (0.0009) [2023-12-26 02:28:08,776][123090] Updated weights for policy 1, policy_version 359117 (0.0005) [2023-12-26 02:28:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 184401920. Throughput: 0: 8987.8, 1: 8840.4. Samples: 184384580. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:08,785][121949] Avg episode reward: [(0, '5505.327'), (1, '5581.026')] [2023-12-26 02:28:08,825][123091] Updated weights for policy 0, policy_version 361207 (0.0011) [2023-12-26 02:28:08,846][123090] Updated weights for policy 1, policy_version 359127 (0.0005) [2023-12-26 02:28:08,881][123091] Updated weights for policy 0, policy_version 361217 (0.0011) [2023-12-26 02:28:08,908][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000359136_91938816.pth... [2023-12-26 02:28:08,913][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000358080_91668480.pth [2023-12-26 02:28:08,937][123091] Updated weights for policy 0, policy_version 361227 (0.0011) [2023-12-26 02:28:08,961][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000361232_92479488.pth... [2023-12-26 02:28:08,964][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000360176_92209152.pth [2023-12-26 02:28:09,668][123090] Updated weights for policy 1, policy_version 359137 (0.0006) [2023-12-26 02:28:09,733][123090] Updated weights for policy 1, policy_version 359147 (0.0009) [2023-12-26 02:28:09,794][123090] Updated weights for policy 1, policy_version 359157 (0.0008) [2023-12-26 02:28:09,825][123091] Updated weights for policy 0, policy_version 361237 (0.0011) [2023-12-26 02:28:09,857][123090] Updated weights for policy 1, policy_version 359167 (0.0007) [2023-12-26 02:28:09,893][123091] Updated weights for policy 0, policy_version 361247 (0.0011) [2023-12-26 02:28:09,963][123091] Updated weights for policy 0, policy_version 361257 (0.0011) [2023-12-26 02:28:10,628][123090] Updated weights for policy 1, policy_version 359177 (0.0005) [2023-12-26 02:28:10,676][123091] Updated weights for policy 0, policy_version 361267 (0.0009) [2023-12-26 02:28:10,684][123090] Updated weights for policy 1, policy_version 359187 (0.0007) [2023-12-26 02:28:10,742][123090] Updated weights for policy 1, policy_version 359197 (0.0009) [2023-12-26 02:28:10,743][123091] Updated weights for policy 0, policy_version 361277 (0.0005) [2023-12-26 02:28:10,809][123091] Updated weights for policy 0, policy_version 361287 (0.0005) [2023-12-26 02:28:11,538][123090] Updated weights for policy 1, policy_version 359207 (0.0009) [2023-12-26 02:28:11,580][123091] Updated weights for policy 0, policy_version 361297 (0.0005) [2023-12-26 02:28:11,595][123090] Updated weights for policy 1, policy_version 359217 (0.0010) [2023-12-26 02:28:11,651][123091] Updated weights for policy 0, policy_version 361307 (0.0008) [2023-12-26 02:28:11,663][123090] Updated weights for policy 1, policy_version 359227 (0.0009) [2023-12-26 02:28:11,720][123091] Updated weights for policy 0, policy_version 361317 (0.0008) [2023-12-26 02:28:11,781][123091] Updated weights for policy 0, policy_version 361327 (0.0007) [2023-12-26 02:28:12,536][123090] Updated weights for policy 1, policy_version 359237 (0.0008) [2023-12-26 02:28:12,593][123091] Updated weights for policy 0, policy_version 361337 (0.0007) [2023-12-26 02:28:12,595][123090] Updated weights for policy 1, policy_version 359247 (0.0007) [2023-12-26 02:28:12,653][123091] Updated weights for policy 0, policy_version 361347 (0.0009) [2023-12-26 02:28:12,661][123090] Updated weights for policy 1, policy_version 359257 (0.0006) [2023-12-26 02:28:12,713][123091] Updated weights for policy 0, policy_version 361357 (0.0010) [2023-12-26 02:28:13,369][123090] Updated weights for policy 1, policy_version 359267 (0.0008) [2023-12-26 02:28:13,422][123090] Updated weights for policy 1, policy_version 359277 (0.0005) [2023-12-26 02:28:13,471][123090] Updated weights for policy 1, policy_version 359287 (0.0005) [2023-12-26 02:28:13,633][123091] Updated weights for policy 0, policy_version 361367 (0.0010) [2023-12-26 02:28:13,701][123091] Updated weights for policy 0, policy_version 361377 (0.0008) [2023-12-26 02:28:13,773][123091] Updated weights for policy 0, policy_version 361387 (0.0005) [2023-12-26 02:28:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 184492032. Throughput: 0: 8967.4, 1: 8783.4. Samples: 184489724. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:13,785][121949] Avg episode reward: [(0, '5459.103'), (1, '5521.541')] [2023-12-26 02:28:14,201][123090] Updated weights for policy 1, policy_version 359297 (0.0006) [2023-12-26 02:28:14,249][123090] Updated weights for policy 1, policy_version 359307 (0.0009) [2023-12-26 02:28:14,300][123090] Updated weights for policy 1, policy_version 359317 (0.0005) [2023-12-26 02:28:14,356][123090] Updated weights for policy 1, policy_version 359327 (0.0006) [2023-12-26 02:28:14,510][123091] Updated weights for policy 0, policy_version 361397 (0.0008) [2023-12-26 02:28:14,562][123091] Updated weights for policy 0, policy_version 361407 (0.0009) [2023-12-26 02:28:14,614][123091] Updated weights for policy 0, policy_version 361417 (0.0009) [2023-12-26 02:28:15,148][123090] Updated weights for policy 1, policy_version 359337 (0.0009) [2023-12-26 02:28:15,217][123090] Updated weights for policy 1, policy_version 359347 (0.0010) [2023-12-26 02:28:15,283][123090] Updated weights for policy 1, policy_version 359357 (0.0009) [2023-12-26 02:28:15,473][123091] Updated weights for policy 0, policy_version 361427 (0.0008) [2023-12-26 02:28:15,521][123091] Updated weights for policy 0, policy_version 361437 (0.0009) [2023-12-26 02:28:15,570][123091] Updated weights for policy 0, policy_version 361447 (0.0009) [2023-12-26 02:28:16,064][123090] Updated weights for policy 1, policy_version 359367 (0.0009) [2023-12-26 02:28:16,121][123090] Updated weights for policy 1, policy_version 359377 (0.0009) [2023-12-26 02:28:16,189][123090] Updated weights for policy 1, policy_version 359387 (0.0009) [2023-12-26 02:28:16,438][123091] Updated weights for policy 0, policy_version 361458 (0.0013) [2023-12-26 02:28:16,493][123091] Updated weights for policy 0, policy_version 361468 (0.0009) [2023-12-26 02:28:16,558][123091] Updated weights for policy 0, policy_version 361478 (0.0009) [2023-12-26 02:28:16,623][123091] Updated weights for policy 0, policy_version 361488 (0.0010) [2023-12-26 02:28:16,929][123090] Updated weights for policy 1, policy_version 359397 (0.0005) [2023-12-26 02:28:17,001][123090] Updated weights for policy 1, policy_version 359407 (0.0007) [2023-12-26 02:28:17,060][123090] Updated weights for policy 1, policy_version 359417 (0.0010) [2023-12-26 02:28:17,480][123091] Updated weights for policy 0, policy_version 361498 (0.0005) [2023-12-26 02:28:17,543][123091] Updated weights for policy 0, policy_version 361508 (0.0005) [2023-12-26 02:28:17,597][123091] Updated weights for policy 0, policy_version 361518 (0.0005) [2023-12-26 02:28:17,800][123090] Updated weights for policy 1, policy_version 359427 (0.0010) [2023-12-26 02:28:17,865][123090] Updated weights for policy 1, policy_version 359437 (0.0010) [2023-12-26 02:28:17,917][123090] Updated weights for policy 1, policy_version 359447 (0.0010) [2023-12-26 02:28:18,311][123091] Updated weights for policy 0, policy_version 361528 (0.0009) [2023-12-26 02:28:18,387][123091] Updated weights for policy 0, policy_version 361538 (0.0008) [2023-12-26 02:28:18,458][123091] Updated weights for policy 0, policy_version 361548 (0.0006) [2023-12-26 02:28:18,602][123090] Updated weights for policy 1, policy_version 359457 (0.0005) [2023-12-26 02:28:18,665][123090] Updated weights for policy 1, policy_version 359467 (0.0009) [2023-12-26 02:28:18,720][123090] Updated weights for policy 1, policy_version 359477 (0.0009) [2023-12-26 02:28:18,776][123090] Updated weights for policy 1, policy_version 359487 (0.0009) [2023-12-26 02:28:18,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 184590336. Throughput: 0: 8920.3, 1: 8808.6. Samples: 184597392. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:18,784][121949] Avg episode reward: [(0, '5699.299'), (1, '5693.925')] [2023-12-26 02:28:19,196][123091] Updated weights for policy 0, policy_version 361558 (0.0005) [2023-12-26 02:28:19,259][123091] Updated weights for policy 0, policy_version 361568 (0.0008) [2023-12-26 02:28:19,324][123091] Updated weights for policy 0, policy_version 361578 (0.0008) [2023-12-26 02:28:19,654][123090] Updated weights for policy 1, policy_version 359497 (0.0010) [2023-12-26 02:28:19,715][123090] Updated weights for policy 1, policy_version 359507 (0.0010) [2023-12-26 02:28:19,782][123090] Updated weights for policy 1, policy_version 359517 (0.0011) [2023-12-26 02:28:20,099][123091] Updated weights for policy 0, policy_version 361588 (0.0009) [2023-12-26 02:28:20,158][123091] Updated weights for policy 0, policy_version 361598 (0.0011) [2023-12-26 02:28:20,234][123091] Updated weights for policy 0, policy_version 361608 (0.0011) [2023-12-26 02:28:20,651][123090] Updated weights for policy 1, policy_version 359527 (0.0011) [2023-12-26 02:28:20,719][123090] Updated weights for policy 1, policy_version 359537 (0.0011) [2023-12-26 02:28:20,786][123090] Updated weights for policy 1, policy_version 359547 (0.0011) [2023-12-26 02:28:21,024][123091] Updated weights for policy 0, policy_version 361618 (0.0011) [2023-12-26 02:28:21,094][123091] Updated weights for policy 0, policy_version 361628 (0.0009) [2023-12-26 02:28:21,168][123091] Updated weights for policy 0, policy_version 361638 (0.0009) [2023-12-26 02:28:21,234][123091] Updated weights for policy 0, policy_version 361648 (0.0009) [2023-12-26 02:28:21,621][123090] Updated weights for policy 1, policy_version 359557 (0.0011) [2023-12-26 02:28:21,681][123090] Updated weights for policy 1, policy_version 359567 (0.0011) [2023-12-26 02:28:21,753][123090] Updated weights for policy 1, policy_version 359577 (0.0008) [2023-12-26 02:28:22,048][123091] Updated weights for policy 0, policy_version 361658 (0.0008) [2023-12-26 02:28:22,101][123091] Updated weights for policy 0, policy_version 361668 (0.0011) [2023-12-26 02:28:22,157][123091] Updated weights for policy 0, policy_version 361678 (0.0011) [2023-12-26 02:28:22,562][123090] Updated weights for policy 1, policy_version 359587 (0.0006) [2023-12-26 02:28:22,625][123090] Updated weights for policy 1, policy_version 359597 (0.0010) [2023-12-26 02:28:22,685][123090] Updated weights for policy 1, policy_version 359607 (0.0011) [2023-12-26 02:28:22,985][123091] Updated weights for policy 0, policy_version 361688 (0.0011) [2023-12-26 02:28:23,041][123091] Updated weights for policy 0, policy_version 361698 (0.0011) [2023-12-26 02:28:23,096][123091] Updated weights for policy 0, policy_version 361708 (0.0010) [2023-12-26 02:28:23,463][123090] Updated weights for policy 1, policy_version 359617 (0.0010) [2023-12-26 02:28:23,519][123090] Updated weights for policy 1, policy_version 359627 (0.0005) [2023-12-26 02:28:23,572][123090] Updated weights for policy 1, policy_version 359637 (0.0005) [2023-12-26 02:28:23,627][123090] Updated weights for policy 1, policy_version 359647 (0.0005) [2023-12-26 02:28:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 184672256. Throughput: 0: 8920.6, 1: 8813.8. Samples: 184649044. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:23,785][121949] Avg episode reward: [(0, '5787.790'), (1, '5723.936')] [2023-12-26 02:28:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000361712_92602368.pth... [2023-12-26 02:28:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000359648_92069888.pth... [2023-12-26 02:28:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000360688_92340224.pth [2023-12-26 02:28:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000358624_91807744.pth [2023-12-26 02:28:23,929][123091] Updated weights for policy 0, policy_version 361718 (0.0009) [2023-12-26 02:28:23,977][123091] Updated weights for policy 0, policy_version 361728 (0.0010) [2023-12-26 02:28:24,046][123091] Updated weights for policy 0, policy_version 361738 (0.0011) [2023-12-26 02:28:24,430][123090] Updated weights for policy 1, policy_version 359657 (0.0009) [2023-12-26 02:28:24,488][123090] Updated weights for policy 1, policy_version 359667 (0.0008) [2023-12-26 02:28:24,556][123090] Updated weights for policy 1, policy_version 359677 (0.0008) [2023-12-26 02:28:24,860][123091] Updated weights for policy 0, policy_version 361748 (0.0011) [2023-12-26 02:28:24,930][123091] Updated weights for policy 0, policy_version 361758 (0.0011) [2023-12-26 02:28:24,993][123091] Updated weights for policy 0, policy_version 361768 (0.0011) [2023-12-26 02:28:25,220][123090] Updated weights for policy 1, policy_version 359687 (0.0006) [2023-12-26 02:28:25,291][123090] Updated weights for policy 1, policy_version 359697 (0.0005) [2023-12-26 02:28:25,356][123090] Updated weights for policy 1, policy_version 359707 (0.0006) [2023-12-26 02:28:25,796][123091] Updated weights for policy 0, policy_version 361778 (0.0011) [2023-12-26 02:28:25,843][123091] Updated weights for policy 0, policy_version 361788 (0.0010) [2023-12-26 02:28:25,930][123091] Updated weights for policy 0, policy_version 361798 (0.0010) [2023-12-26 02:28:25,983][123091] Updated weights for policy 0, policy_version 361808 (0.0010) [2023-12-26 02:28:26,106][123090] Updated weights for policy 1, policy_version 359717 (0.0006) [2023-12-26 02:28:26,152][123090] Updated weights for policy 1, policy_version 359727 (0.0005) [2023-12-26 02:28:26,202][123090] Updated weights for policy 1, policy_version 359737 (0.0005) [2023-12-26 02:28:26,794][123091] Updated weights for policy 0, policy_version 361818 (0.0010) [2023-12-26 02:28:26,852][123091] Updated weights for policy 0, policy_version 361828 (0.0010) [2023-12-26 02:28:26,906][123091] Updated weights for policy 0, policy_version 361838 (0.0010) [2023-12-26 02:28:26,968][123090] Updated weights for policy 1, policy_version 359747 (0.0006) [2023-12-26 02:28:27,027][123090] Updated weights for policy 1, policy_version 359757 (0.0009) [2023-12-26 02:28:27,088][123090] Updated weights for policy 1, policy_version 359767 (0.0009) [2023-12-26 02:28:27,713][123091] Updated weights for policy 0, policy_version 361848 (0.0011) [2023-12-26 02:28:27,764][123091] Updated weights for policy 0, policy_version 361858 (0.0010) [2023-12-26 02:28:27,818][123091] Updated weights for policy 0, policy_version 361868 (0.0010) [2023-12-26 02:28:27,921][123090] Updated weights for policy 1, policy_version 359777 (0.0009) [2023-12-26 02:28:28,013][123090] Updated weights for policy 1, policy_version 359787 (0.0008) [2023-12-26 02:28:28,077][123090] Updated weights for policy 1, policy_version 359797 (0.0008) [2023-12-26 02:28:28,135][123090] Updated weights for policy 1, policy_version 359807 (0.0009) [2023-12-26 02:28:28,646][123091] Updated weights for policy 0, policy_version 361878 (0.0011) [2023-12-26 02:28:28,705][123091] Updated weights for policy 0, policy_version 361888 (0.0011) [2023-12-26 02:28:28,759][123091] Updated weights for policy 0, policy_version 361898 (0.0010) [2023-12-26 02:28:28,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 184754176. Throughput: 0: 8855.7, 1: 8898.1. Samples: 184754956. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:28,785][121949] Avg episode reward: [(0, '5782.250'), (1, '5842.919')] [2023-12-26 02:28:28,930][123090] Updated weights for policy 1, policy_version 359817 (0.0009) [2023-12-26 02:28:28,982][123090] Updated weights for policy 1, policy_version 359827 (0.0008) [2023-12-26 02:28:29,038][123090] Updated weights for policy 1, policy_version 359837 (0.0009) [2023-12-26 02:28:29,551][123091] Updated weights for policy 0, policy_version 361908 (0.0009) [2023-12-26 02:28:29,595][123091] Updated weights for policy 0, policy_version 361918 (0.0008) [2023-12-26 02:28:29,642][123091] Updated weights for policy 0, policy_version 361928 (0.0008) [2023-12-26 02:28:29,946][123090] Updated weights for policy 1, policy_version 359847 (0.0009) [2023-12-26 02:28:30,004][123090] Updated weights for policy 1, policy_version 359857 (0.0010) [2023-12-26 02:28:30,061][123090] Updated weights for policy 1, policy_version 359867 (0.0009) [2023-12-26 02:28:30,298][123091] Updated weights for policy 0, policy_version 361938 (0.0007) [2023-12-26 02:28:30,363][123091] Updated weights for policy 0, policy_version 361948 (0.0006) [2023-12-26 02:28:30,432][123091] Updated weights for policy 0, policy_version 361958 (0.0005) [2023-12-26 02:28:30,504][123091] Updated weights for policy 0, policy_version 361968 (0.0005) [2023-12-26 02:28:31,006][123090] Updated weights for policy 1, policy_version 359877 (0.0010) [2023-12-26 02:28:31,071][123090] Updated weights for policy 1, policy_version 359887 (0.0010) [2023-12-26 02:28:31,127][123090] Updated weights for policy 1, policy_version 359897 (0.0007) [2023-12-26 02:28:31,160][123091] Updated weights for policy 0, policy_version 361978 (0.0007) [2023-12-26 02:28:31,223][123091] Updated weights for policy 0, policy_version 361988 (0.0009) [2023-12-26 02:28:31,292][123091] Updated weights for policy 0, policy_version 361998 (0.0010) [2023-12-26 02:28:31,981][123090] Updated weights for policy 1, policy_version 359907 (0.0008) [2023-12-26 02:28:32,037][123090] Updated weights for policy 1, policy_version 359917 (0.0007) [2023-12-26 02:28:32,099][123091] Updated weights for policy 0, policy_version 362008 (0.0008) [2023-12-26 02:28:32,099][123090] Updated weights for policy 1, policy_version 359927 (0.0006) [2023-12-26 02:28:32,146][123091] Updated weights for policy 0, policy_version 362018 (0.0008) [2023-12-26 02:28:32,197][123091] Updated weights for policy 0, policy_version 362029 (0.0010) [2023-12-26 02:28:32,742][123090] Updated weights for policy 1, policy_version 359937 (0.0006) [2023-12-26 02:28:32,805][123090] Updated weights for policy 1, policy_version 359947 (0.0005) [2023-12-26 02:28:32,874][123090] Updated weights for policy 1, policy_version 359957 (0.0008) [2023-12-26 02:28:32,932][123090] Updated weights for policy 1, policy_version 359967 (0.0008) [2023-12-26 02:28:33,087][123091] Updated weights for policy 0, policy_version 362039 (0.0010) [2023-12-26 02:28:33,143][123091] Updated weights for policy 0, policy_version 362049 (0.0009) [2023-12-26 02:28:33,189][123091] Updated weights for policy 0, policy_version 362059 (0.0007) [2023-12-26 02:28:33,683][123090] Updated weights for policy 1, policy_version 359977 (0.0006) [2023-12-26 02:28:33,742][123090] Updated weights for policy 1, policy_version 359987 (0.0005) [2023-12-26 02:28:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 184844288. Throughput: 0: 8874.4, 1: 8801.6. Samples: 184860612. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:33,785][121949] Avg episode reward: [(0, '5998.644'), (1, '5954.496')] [2023-12-26 02:28:33,799][123090] Updated weights for policy 1, policy_version 359997 (0.0009) [2023-12-26 02:28:34,009][123091] Updated weights for policy 0, policy_version 362069 (0.0008) [2023-12-26 02:28:34,068][123091] Updated weights for policy 0, policy_version 362079 (0.0009) [2023-12-26 02:28:34,117][123091] Updated weights for policy 0, policy_version 362089 (0.0009) [2023-12-26 02:28:34,589][123090] Updated weights for policy 1, policy_version 360007 (0.0009) [2023-12-26 02:28:34,658][123090] Updated weights for policy 1, policy_version 360017 (0.0009) [2023-12-26 02:28:34,714][123090] Updated weights for policy 1, policy_version 360027 (0.0008) [2023-12-26 02:28:34,888][123091] Updated weights for policy 0, policy_version 362099 (0.0009) [2023-12-26 02:28:34,943][123091] Updated weights for policy 0, policy_version 362109 (0.0010) [2023-12-26 02:28:35,000][123091] Updated weights for policy 0, policy_version 362119 (0.0010) [2023-12-26 02:28:35,583][123090] Updated weights for policy 1, policy_version 360037 (0.0009) [2023-12-26 02:28:35,636][123090] Updated weights for policy 1, policy_version 360047 (0.0010) [2023-12-26 02:28:35,690][123090] Updated weights for policy 1, policy_version 360057 (0.0010) [2023-12-26 02:28:35,774][123091] Updated weights for policy 0, policy_version 362129 (0.0009) [2023-12-26 02:28:35,833][123091] Updated weights for policy 0, policy_version 362139 (0.0005) [2023-12-26 02:28:35,900][123091] Updated weights for policy 0, policy_version 362149 (0.0011) [2023-12-26 02:28:35,957][123091] Updated weights for policy 0, policy_version 362159 (0.0011) [2023-12-26 02:28:36,603][123090] Updated weights for policy 1, policy_version 360067 (0.0009) [2023-12-26 02:28:36,658][123090] Updated weights for policy 1, policy_version 360077 (0.0009) [2023-12-26 02:28:36,720][123090] Updated weights for policy 1, policy_version 360087 (0.0010) [2023-12-26 02:28:36,727][123091] Updated weights for policy 0, policy_version 362169 (0.0011) [2023-12-26 02:28:36,788][123091] Updated weights for policy 0, policy_version 362179 (0.0011) [2023-12-26 02:28:36,844][123091] Updated weights for policy 0, policy_version 362189 (0.0011) [2023-12-26 02:28:37,524][123090] Updated weights for policy 1, policy_version 360097 (0.0009) [2023-12-26 02:28:37,592][123090] Updated weights for policy 1, policy_version 360107 (0.0009) [2023-12-26 02:28:37,653][123090] Updated weights for policy 1, policy_version 360117 (0.0008) [2023-12-26 02:28:37,679][123091] Updated weights for policy 0, policy_version 362199 (0.0011) [2023-12-26 02:28:37,706][123090] Updated weights for policy 1, policy_version 360127 (0.0009) [2023-12-26 02:28:37,742][123091] Updated weights for policy 0, policy_version 362209 (0.0011) [2023-12-26 02:28:37,804][123091] Updated weights for policy 0, policy_version 362219 (0.0010) [2023-12-26 02:28:38,558][123090] Updated weights for policy 1, policy_version 360137 (0.0009) [2023-12-26 02:28:38,603][123091] Updated weights for policy 0, policy_version 362229 (0.0011) [2023-12-26 02:28:38,625][123090] Updated weights for policy 1, policy_version 360147 (0.0010) [2023-12-26 02:28:38,662][123091] Updated weights for policy 0, policy_version 362239 (0.0011) [2023-12-26 02:28:38,683][123090] Updated weights for policy 1, policy_version 360157 (0.0008) [2023-12-26 02:28:38,730][123091] Updated weights for policy 0, policy_version 362249 (0.0011) [2023-12-26 02:28:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 184942592. Throughput: 0: 8889.4, 1: 8772.7. Samples: 184912980. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:38,785][121949] Avg episode reward: [(0, '6056.443'), (1, '5840.475')] [2023-12-26 02:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000362256_92741632.pth... [2023-12-26 02:28:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000360160_92200960.pth... [2023-12-26 02:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000361232_92479488.pth [2023-12-26 02:28:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000359136_91938816.pth [2023-12-26 02:28:39,476][123090] Updated weights for policy 1, policy_version 360167 (0.0007) [2023-12-26 02:28:39,551][123090] Updated weights for policy 1, policy_version 360177 (0.0006) [2023-12-26 02:28:39,561][123091] Updated weights for policy 0, policy_version 362259 (0.0010) [2023-12-26 02:28:39,620][123091] Updated weights for policy 0, policy_version 362269 (0.0009) [2023-12-26 02:28:39,628][123090] Updated weights for policy 1, policy_version 360187 (0.0006) [2023-12-26 02:28:39,691][123091] Updated weights for policy 0, policy_version 362279 (0.0008) [2023-12-26 02:28:40,436][123091] Updated weights for policy 0, policy_version 362289 (0.0008) [2023-12-26 02:28:40,462][123090] Updated weights for policy 1, policy_version 360197 (0.0007) [2023-12-26 02:28:40,492][123091] Updated weights for policy 0, policy_version 362299 (0.0007) [2023-12-26 02:28:40,512][123090] Updated weights for policy 1, policy_version 360207 (0.0009) [2023-12-26 02:28:40,548][123091] Updated weights for policy 0, policy_version 362309 (0.0008) [2023-12-26 02:28:40,561][123090] Updated weights for policy 1, policy_version 360217 (0.0007) [2023-12-26 02:28:40,603][123091] Updated weights for policy 0, policy_version 362319 (0.0006) [2023-12-26 02:28:41,330][123091] Updated weights for policy 0, policy_version 362329 (0.0010) [2023-12-26 02:28:41,405][123091] Updated weights for policy 0, policy_version 362339 (0.0010) [2023-12-26 02:28:41,478][123091] Updated weights for policy 0, policy_version 362349 (0.0007) [2023-12-26 02:28:41,527][123090] Updated weights for policy 1, policy_version 360227 (0.0009) [2023-12-26 02:28:41,585][123090] Updated weights for policy 1, policy_version 360237 (0.0009) [2023-12-26 02:28:41,649][123090] Updated weights for policy 1, policy_version 360247 (0.0010) [2023-12-26 02:28:42,212][123091] Updated weights for policy 0, policy_version 362359 (0.0008) [2023-12-26 02:28:42,283][123091] Updated weights for policy 0, policy_version 362369 (0.0009) [2023-12-26 02:28:42,353][123091] Updated weights for policy 0, policy_version 362379 (0.0007) [2023-12-26 02:28:42,553][123090] Updated weights for policy 1, policy_version 360257 (0.0009) [2023-12-26 02:28:42,617][123090] Updated weights for policy 1, policy_version 360267 (0.0006) [2023-12-26 02:28:42,688][123090] Updated weights for policy 1, policy_version 360277 (0.0005) [2023-12-26 02:28:42,764][123090] Updated weights for policy 1, policy_version 360287 (0.0005) [2023-12-26 02:28:43,204][123091] Updated weights for policy 0, policy_version 362389 (0.0008) [2023-12-26 02:28:43,256][123091] Updated weights for policy 0, policy_version 362399 (0.0009) [2023-12-26 02:28:43,303][123091] Updated weights for policy 0, policy_version 362409 (0.0008) [2023-12-26 02:28:43,395][123090] Updated weights for policy 1, policy_version 360297 (0.0005) [2023-12-26 02:28:43,449][123090] Updated weights for policy 1, policy_version 360307 (0.0005) [2023-12-26 02:28:43,501][123090] Updated weights for policy 1, policy_version 360317 (0.0005) [2023-12-26 02:28:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 185024512. Throughput: 0: 8919.7, 1: 8722.4. Samples: 185015920. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:43,785][121949] Avg episode reward: [(0, '5967.600'), (1, '5824.540')] [2023-12-26 02:28:44,038][123091] Updated weights for policy 0, policy_version 362419 (0.0009) [2023-12-26 02:28:44,105][123091] Updated weights for policy 0, policy_version 362429 (0.0005) [2023-12-26 02:28:44,175][123091] Updated weights for policy 0, policy_version 362439 (0.0005) [2023-12-26 02:28:44,240][123090] Updated weights for policy 1, policy_version 360327 (0.0007) [2023-12-26 02:28:44,309][123090] Updated weights for policy 1, policy_version 360337 (0.0009) [2023-12-26 02:28:44,373][123090] Updated weights for policy 1, policy_version 360347 (0.0010) [2023-12-26 02:28:44,818][123091] Updated weights for policy 0, policy_version 362449 (0.0007) [2023-12-26 02:28:44,882][123091] Updated weights for policy 0, policy_version 362459 (0.0006) [2023-12-26 02:28:44,954][123091] Updated weights for policy 0, policy_version 362469 (0.0006) [2023-12-26 02:28:45,018][123091] Updated weights for policy 0, policy_version 362479 (0.0011) [2023-12-26 02:28:45,282][123090] Updated weights for policy 1, policy_version 360357 (0.0010) [2023-12-26 02:28:45,337][123090] Updated weights for policy 1, policy_version 360367 (0.0010) [2023-12-26 02:28:45,404][123090] Updated weights for policy 1, policy_version 360377 (0.0011) [2023-12-26 02:28:45,790][123091] Updated weights for policy 0, policy_version 362489 (0.0011) [2023-12-26 02:28:45,852][123091] Updated weights for policy 0, policy_version 362499 (0.0010) [2023-12-26 02:28:45,904][123091] Updated weights for policy 0, policy_version 362509 (0.0010) [2023-12-26 02:28:46,164][123090] Updated weights for policy 1, policy_version 360387 (0.0011) [2023-12-26 02:28:46,219][123090] Updated weights for policy 1, policy_version 360397 (0.0010) [2023-12-26 02:28:46,277][123090] Updated weights for policy 1, policy_version 360407 (0.0010) [2023-12-26 02:28:46,732][123091] Updated weights for policy 0, policy_version 362519 (0.0011) [2023-12-26 02:28:46,784][123091] Updated weights for policy 0, policy_version 362529 (0.0010) [2023-12-26 02:28:46,835][123091] Updated weights for policy 0, policy_version 362539 (0.0010) [2023-12-26 02:28:47,116][123090] Updated weights for policy 1, policy_version 360417 (0.0010) [2023-12-26 02:28:47,170][123090] Updated weights for policy 1, policy_version 360427 (0.0005) [2023-12-26 02:28:47,219][123090] Updated weights for policy 1, policy_version 360437 (0.0005) [2023-12-26 02:28:47,279][123090] Updated weights for policy 1, policy_version 360447 (0.0006) [2023-12-26 02:28:47,510][123091] Updated weights for policy 0, policy_version 362549 (0.0008) [2023-12-26 02:28:47,561][123091] Updated weights for policy 0, policy_version 362559 (0.0010) [2023-12-26 02:28:47,627][123091] Updated weights for policy 0, policy_version 362569 (0.0010) [2023-12-26 02:28:47,975][123090] Updated weights for policy 1, policy_version 360457 (0.0006) [2023-12-26 02:28:48,030][123090] Updated weights for policy 1, policy_version 360467 (0.0005) [2023-12-26 02:28:48,086][123090] Updated weights for policy 1, policy_version 360477 (0.0005) [2023-12-26 02:28:48,307][123091] Updated weights for policy 0, policy_version 362579 (0.0009) [2023-12-26 02:28:48,377][123091] Updated weights for policy 0, policy_version 362589 (0.0008) [2023-12-26 02:28:48,442][123091] Updated weights for policy 0, policy_version 362599 (0.0008) [2023-12-26 02:28:48,775][123090] Updated weights for policy 1, policy_version 360487 (0.0006) [2023-12-26 02:28:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 185114624. Throughput: 0: 8935.8, 1: 8795.8. Samples: 185127348. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:48,785][121949] Avg episode reward: [(0, '5657.252'), (1, '5905.558')] [2023-12-26 02:28:48,852][123090] Updated weights for policy 1, policy_version 360497 (0.0007) [2023-12-26 02:28:48,916][123090] Updated weights for policy 1, policy_version 360507 (0.0008) [2023-12-26 02:28:49,152][123091] Updated weights for policy 0, policy_version 362609 (0.0008) [2023-12-26 02:28:49,230][123091] Updated weights for policy 0, policy_version 362619 (0.0006) [2023-12-26 02:28:49,303][123091] Updated weights for policy 0, policy_version 362629 (0.0009) [2023-12-26 02:28:49,381][123091] Updated weights for policy 0, policy_version 362639 (0.0011) [2023-12-26 02:28:49,639][123090] Updated weights for policy 1, policy_version 360517 (0.0009) [2023-12-26 02:28:49,691][123090] Updated weights for policy 1, policy_version 360527 (0.0010) [2023-12-26 02:28:49,750][123090] Updated weights for policy 1, policy_version 360537 (0.0010) [2023-12-26 02:28:50,144][123091] Updated weights for policy 0, policy_version 362649 (0.0010) [2023-12-26 02:28:50,202][123091] Updated weights for policy 0, policy_version 362659 (0.0010) [2023-12-26 02:28:50,260][123091] Updated weights for policy 0, policy_version 362669 (0.0010) [2023-12-26 02:28:50,500][123090] Updated weights for policy 1, policy_version 360547 (0.0009) [2023-12-26 02:28:50,555][123090] Updated weights for policy 1, policy_version 360557 (0.0005) [2023-12-26 02:28:50,629][123090] Updated weights for policy 1, policy_version 360567 (0.0008) [2023-12-26 02:28:51,144][123091] Updated weights for policy 0, policy_version 362680 (0.0009) [2023-12-26 02:28:51,202][123091] Updated weights for policy 0, policy_version 362690 (0.0010) [2023-12-26 02:28:51,265][123091] Updated weights for policy 0, policy_version 362700 (0.0009) [2023-12-26 02:28:51,362][123090] Updated weights for policy 1, policy_version 360577 (0.0011) [2023-12-26 02:28:51,425][123090] Updated weights for policy 1, policy_version 360587 (0.0007) [2023-12-26 02:28:51,478][123090] Updated weights for policy 1, policy_version 360597 (0.0007) [2023-12-26 02:28:51,526][123090] Updated weights for policy 1, policy_version 360607 (0.0005) [2023-12-26 02:28:52,165][123091] Updated weights for policy 0, policy_version 362710 (0.0010) [2023-12-26 02:28:52,218][123091] Updated weights for policy 0, policy_version 362720 (0.0009) [2023-12-26 02:28:52,273][123091] Updated weights for policy 0, policy_version 362730 (0.0009) [2023-12-26 02:28:52,312][123090] Updated weights for policy 1, policy_version 360617 (0.0008) [2023-12-26 02:28:52,381][123090] Updated weights for policy 1, policy_version 360627 (0.0010) [2023-12-26 02:28:52,430][123090] Updated weights for policy 1, policy_version 360637 (0.0005) [2023-12-26 02:28:53,139][123091] Updated weights for policy 0, policy_version 362740 (0.0009) [2023-12-26 02:28:53,189][123091] Updated weights for policy 0, policy_version 362750 (0.0010) [2023-12-26 02:28:53,229][123090] Updated weights for policy 1, policy_version 360647 (0.0007) [2023-12-26 02:28:53,240][123091] Updated weights for policy 0, policy_version 362760 (0.0009) [2023-12-26 02:28:53,288][123090] Updated weights for policy 1, policy_version 360657 (0.0008) [2023-12-26 02:28:53,352][123090] Updated weights for policy 1, policy_version 360667 (0.0010) [2023-12-26 02:28:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 185204736. Throughput: 0: 8881.1, 1: 8813.3. Samples: 185180828. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:53,785][121949] Avg episode reward: [(0, '5780.299'), (1, '5896.511')] [2023-12-26 02:28:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000362768_92872704.pth... [2023-12-26 02:28:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000360672_92332032.pth... [2023-12-26 02:28:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000361712_92602368.pth [2023-12-26 02:28:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000359648_92069888.pth [2023-12-26 02:28:53,982][123091] Updated weights for policy 0, policy_version 362770 (0.0008) [2023-12-26 02:28:54,058][123091] Updated weights for policy 0, policy_version 362780 (0.0005) [2023-12-26 02:28:54,130][123091] Updated weights for policy 0, policy_version 362790 (0.0007) [2023-12-26 02:28:54,193][123091] Updated weights for policy 0, policy_version 362800 (0.0010) [2023-12-26 02:28:54,226][123090] Updated weights for policy 1, policy_version 360677 (0.0008) [2023-12-26 02:28:54,281][123090] Updated weights for policy 1, policy_version 360687 (0.0009) [2023-12-26 02:28:54,334][123090] Updated weights for policy 1, policy_version 360698 (0.0010) [2023-12-26 02:28:54,891][123091] Updated weights for policy 0, policy_version 362810 (0.0010) [2023-12-26 02:28:54,955][123091] Updated weights for policy 0, policy_version 362820 (0.0007) [2023-12-26 02:28:55,018][123091] Updated weights for policy 0, policy_version 362830 (0.0006) [2023-12-26 02:28:55,263][123090] Updated weights for policy 1, policy_version 360709 (0.0010) [2023-12-26 02:28:55,335][123090] Updated weights for policy 1, policy_version 360719 (0.0009) [2023-12-26 02:28:55,405][123090] Updated weights for policy 1, policy_version 360729 (0.0008) [2023-12-26 02:28:55,731][123091] Updated weights for policy 0, policy_version 362840 (0.0008) [2023-12-26 02:28:55,783][123091] Updated weights for policy 0, policy_version 362850 (0.0009) [2023-12-26 02:28:55,835][123091] Updated weights for policy 0, policy_version 362860 (0.0009) [2023-12-26 02:28:56,200][123090] Updated weights for policy 1, policy_version 360739 (0.0009) [2023-12-26 02:28:56,260][123090] Updated weights for policy 1, policy_version 360749 (0.0010) [2023-12-26 02:28:56,319][123090] Updated weights for policy 1, policy_version 360759 (0.0010) [2023-12-26 02:28:56,550][123091] Updated weights for policy 0, policy_version 362870 (0.0007) [2023-12-26 02:28:56,605][123091] Updated weights for policy 0, policy_version 362880 (0.0006) [2023-12-26 02:28:56,686][123091] Updated weights for policy 0, policy_version 362890 (0.0005) [2023-12-26 02:28:57,086][123090] Updated weights for policy 1, policy_version 360770 (0.0009) [2023-12-26 02:28:57,149][123090] Updated weights for policy 1, policy_version 360780 (0.0010) [2023-12-26 02:28:57,221][123090] Updated weights for policy 1, policy_version 360790 (0.0008) [2023-12-26 02:28:57,289][123090] Updated weights for policy 1, policy_version 360800 (0.0010) [2023-12-26 02:28:57,326][123091] Updated weights for policy 0, policy_version 362900 (0.0007) [2023-12-26 02:28:57,385][123091] Updated weights for policy 0, policy_version 362910 (0.0006) [2023-12-26 02:28:57,462][123091] Updated weights for policy 0, policy_version 362920 (0.0011) [2023-12-26 02:28:57,895][123090] Updated weights for policy 1, policy_version 360810 (0.0006) [2023-12-26 02:28:57,950][123090] Updated weights for policy 1, policy_version 360820 (0.0005) [2023-12-26 02:28:58,011][123090] Updated weights for policy 1, policy_version 360830 (0.0007) [2023-12-26 02:28:58,210][123091] Updated weights for policy 0, policy_version 362930 (0.0008) [2023-12-26 02:28:58,269][123091] Updated weights for policy 0, policy_version 362940 (0.0011) [2023-12-26 02:28:58,328][123091] Updated weights for policy 0, policy_version 362950 (0.0011) [2023-12-26 02:28:58,395][123091] Updated weights for policy 0, policy_version 362960 (0.0009) [2023-12-26 02:28:58,769][123090] Updated weights for policy 1, policy_version 360840 (0.0008) [2023-12-26 02:28:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 185294848. Throughput: 0: 8953.8, 1: 8815.0. Samples: 185289320. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:28:58,785][121949] Avg episode reward: [(0, '6057.749'), (1, '6027.481')] [2023-12-26 02:28:58,831][123090] Updated weights for policy 1, policy_version 360850 (0.0008) [2023-12-26 02:28:58,886][123090] Updated weights for policy 1, policy_version 360860 (0.0010) [2023-12-26 02:28:58,903][123008] Saving new best policy, reward=6027.481! [2023-12-26 02:28:59,195][123091] Updated weights for policy 0, policy_version 362970 (0.0006) [2023-12-26 02:28:59,259][123091] Updated weights for policy 0, policy_version 362980 (0.0008) [2023-12-26 02:28:59,322][123091] Updated weights for policy 0, policy_version 362990 (0.0006) [2023-12-26 02:28:59,636][123090] Updated weights for policy 1, policy_version 360870 (0.0007) [2023-12-26 02:28:59,690][123090] Updated weights for policy 1, policy_version 360880 (0.0005) [2023-12-26 02:28:59,746][123090] Updated weights for policy 1, policy_version 360890 (0.0006) [2023-12-26 02:29:00,034][123091] Updated weights for policy 0, policy_version 363000 (0.0010) [2023-12-26 02:29:00,090][123091] Updated weights for policy 0, policy_version 363010 (0.0009) [2023-12-26 02:29:00,143][123091] Updated weights for policy 0, policy_version 363020 (0.0010) [2023-12-26 02:29:00,462][123090] Updated weights for policy 1, policy_version 360900 (0.0006) [2023-12-26 02:29:00,510][123090] Updated weights for policy 1, policy_version 360910 (0.0008) [2023-12-26 02:29:00,565][123090] Updated weights for policy 1, policy_version 360920 (0.0010) [2023-12-26 02:29:01,000][123091] Updated weights for policy 0, policy_version 363030 (0.0008) [2023-12-26 02:29:01,067][123091] Updated weights for policy 0, policy_version 363040 (0.0007) [2023-12-26 02:29:01,133][123091] Updated weights for policy 0, policy_version 363050 (0.0009) [2023-12-26 02:29:01,368][123090] Updated weights for policy 1, policy_version 360930 (0.0010) [2023-12-26 02:29:01,438][123090] Updated weights for policy 1, policy_version 360940 (0.0009) [2023-12-26 02:29:01,490][123090] Updated weights for policy 1, policy_version 360950 (0.0010) [2023-12-26 02:29:01,552][123090] Updated weights for policy 1, policy_version 360960 (0.0010) [2023-12-26 02:29:01,844][123091] Updated weights for policy 0, policy_version 363060 (0.0006) [2023-12-26 02:29:01,893][123091] Updated weights for policy 0, policy_version 363070 (0.0009) [2023-12-26 02:29:01,943][123091] Updated weights for policy 0, policy_version 363080 (0.0008) [2023-12-26 02:29:02,395][123090] Updated weights for policy 1, policy_version 360970 (0.0008) [2023-12-26 02:29:02,451][123090] Updated weights for policy 1, policy_version 360980 (0.0008) [2023-12-26 02:29:02,506][123090] Updated weights for policy 1, policy_version 360990 (0.0008) [2023-12-26 02:29:02,650][123091] Updated weights for policy 0, policy_version 363090 (0.0005) [2023-12-26 02:29:02,700][123091] Updated weights for policy 0, policy_version 363100 (0.0006) [2023-12-26 02:29:02,753][123091] Updated weights for policy 0, policy_version 363110 (0.0005) [2023-12-26 02:29:02,810][123091] Updated weights for policy 0, policy_version 363120 (0.0007) [2023-12-26 02:29:03,314][123090] Updated weights for policy 1, policy_version 361000 (0.0010) [2023-12-26 02:29:03,374][123090] Updated weights for policy 1, policy_version 361010 (0.0007) [2023-12-26 02:29:03,445][123090] Updated weights for policy 1, policy_version 361020 (0.0006) [2023-12-26 02:29:03,501][123091] Updated weights for policy 0, policy_version 363130 (0.0006) [2023-12-26 02:29:03,556][123091] Updated weights for policy 0, policy_version 363140 (0.0006) [2023-12-26 02:29:03,602][123091] Updated weights for policy 0, policy_version 363150 (0.0005) [2023-12-26 02:29:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 185393152. Throughput: 0: 9065.7, 1: 8800.3. Samples: 185401360. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:29:03,784][121949] Avg episode reward: [(0, '6003.019'), (1, '6070.160')] [2023-12-26 02:29:03,785][123008] Saving new best policy, reward=6070.160! [2023-12-26 02:29:04,110][123090] Updated weights for policy 1, policy_version 361030 (0.0009) [2023-12-26 02:29:04,173][123090] Updated weights for policy 1, policy_version 361040 (0.0010) [2023-12-26 02:29:04,229][123090] Updated weights for policy 1, policy_version 361050 (0.0010) [2023-12-26 02:29:04,325][123091] Updated weights for policy 0, policy_version 363160 (0.0005) [2023-12-26 02:29:04,395][123091] Updated weights for policy 0, policy_version 363170 (0.0008) [2023-12-26 02:29:04,444][123091] Updated weights for policy 0, policy_version 363180 (0.0009) [2023-12-26 02:29:05,030][123090] Updated weights for policy 1, policy_version 361060 (0.0008) [2023-12-26 02:29:05,084][123090] Updated weights for policy 1, policy_version 361070 (0.0010) [2023-12-26 02:29:05,136][123090] Updated weights for policy 1, policy_version 361080 (0.0010) [2023-12-26 02:29:05,242][123091] Updated weights for policy 0, policy_version 363190 (0.0010) [2023-12-26 02:29:05,297][123091] Updated weights for policy 0, policy_version 363200 (0.0010) [2023-12-26 02:29:05,352][123091] Updated weights for policy 0, policy_version 363210 (0.0011) [2023-12-26 02:29:05,939][123090] Updated weights for policy 1, policy_version 361090 (0.0010) [2023-12-26 02:29:06,001][123090] Updated weights for policy 1, policy_version 361100 (0.0010) [2023-12-26 02:29:06,071][123090] Updated weights for policy 1, policy_version 361110 (0.0010) [2023-12-26 02:29:06,141][123090] Updated weights for policy 1, policy_version 361120 (0.0011) [2023-12-26 02:29:06,177][123091] Updated weights for policy 0, policy_version 363220 (0.0010) [2023-12-26 02:29:06,247][123091] Updated weights for policy 0, policy_version 363230 (0.0011) [2023-12-26 02:29:06,305][123091] Updated weights for policy 0, policy_version 363240 (0.0011) [2023-12-26 02:29:06,936][123090] Updated weights for policy 1, policy_version 361130 (0.0011) [2023-12-26 02:29:06,985][123090] Updated weights for policy 1, policy_version 361140 (0.0010) [2023-12-26 02:29:07,006][123091] Updated weights for policy 0, policy_version 363250 (0.0010) [2023-12-26 02:29:07,041][123090] Updated weights for policy 1, policy_version 361150 (0.0010) [2023-12-26 02:29:07,056][123091] Updated weights for policy 0, policy_version 363260 (0.0005) [2023-12-26 02:29:07,100][123091] Updated weights for policy 0, policy_version 363270 (0.0005) [2023-12-26 02:29:07,158][123091] Updated weights for policy 0, policy_version 363280 (0.0008) [2023-12-26 02:29:07,833][123090] Updated weights for policy 1, policy_version 361160 (0.0010) [2023-12-26 02:29:07,893][123090] Updated weights for policy 1, policy_version 361170 (0.0010) [2023-12-26 02:29:07,942][123091] Updated weights for policy 0, policy_version 363290 (0.0005) [2023-12-26 02:29:07,956][123090] Updated weights for policy 1, policy_version 361180 (0.0010) [2023-12-26 02:29:07,995][123091] Updated weights for policy 0, policy_version 363300 (0.0005) [2023-12-26 02:29:08,053][123091] Updated weights for policy 0, policy_version 363310 (0.0005) [2023-12-26 02:29:08,691][123091] Updated weights for policy 0, policy_version 363320 (0.0006) [2023-12-26 02:29:08,750][123091] Updated weights for policy 0, policy_version 363330 (0.0006) [2023-12-26 02:29:08,774][123090] Updated weights for policy 1, policy_version 361190 (0.0010) [2023-12-26 02:29:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 185475072. Throughput: 0: 9078.2, 1: 8852.8. Samples: 185455940. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:29:08,785][121949] Avg episode reward: [(0, '5911.837'), (1, '6091.294')] [2023-12-26 02:29:08,818][123091] Updated weights for policy 0, policy_version 363340 (0.0006) [2023-12-26 02:29:08,827][123090] Updated weights for policy 1, policy_version 361200 (0.0009) [2023-12-26 02:29:08,844][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000363344_93020160.pth... [2023-12-26 02:29:08,849][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000362256_92741632.pth [2023-12-26 02:29:08,894][123090] Updated weights for policy 1, policy_version 361210 (0.0011) [2023-12-26 02:29:08,934][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000361216_92471296.pth... [2023-12-26 02:29:08,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000360160_92200960.pth [2023-12-26 02:29:08,939][123008] Saving new best policy, reward=6091.294! [2023-12-26 02:29:09,565][123091] Updated weights for policy 0, policy_version 363350 (0.0009) [2023-12-26 02:29:09,614][123091] Updated weights for policy 0, policy_version 363360 (0.0011) [2023-12-26 02:29:09,674][123091] Updated weights for policy 0, policy_version 363370 (0.0011) [2023-12-26 02:29:09,714][123090] Updated weights for policy 1, policy_version 361220 (0.0009) [2023-12-26 02:29:09,784][123090] Updated weights for policy 1, policy_version 361230 (0.0009) [2023-12-26 02:29:09,851][123090] Updated weights for policy 1, policy_version 361240 (0.0009) [2023-12-26 02:29:10,486][123091] Updated weights for policy 0, policy_version 363380 (0.0009) [2023-12-26 02:29:10,554][123091] Updated weights for policy 0, policy_version 363390 (0.0006) [2023-12-26 02:29:10,611][123091] Updated weights for policy 0, policy_version 363400 (0.0005) [2023-12-26 02:29:10,689][123090] Updated weights for policy 1, policy_version 361250 (0.0008) [2023-12-26 02:29:10,740][123090] Updated weights for policy 1, policy_version 361260 (0.0009) [2023-12-26 02:29:10,789][123090] Updated weights for policy 1, policy_version 361270 (0.0009) [2023-12-26 02:29:10,850][123090] Updated weights for policy 1, policy_version 361280 (0.0009) [2023-12-26 02:29:11,416][123091] Updated weights for policy 0, policy_version 363410 (0.0008) [2023-12-26 02:29:11,473][123091] Updated weights for policy 0, policy_version 363420 (0.0010) [2023-12-26 02:29:11,529][123091] Updated weights for policy 0, policy_version 363430 (0.0010) [2023-12-26 02:29:11,584][123091] Updated weights for policy 0, policy_version 363440 (0.0009) [2023-12-26 02:29:11,714][123090] Updated weights for policy 1, policy_version 361290 (0.0010) [2023-12-26 02:29:11,775][123090] Updated weights for policy 1, policy_version 361300 (0.0010) [2023-12-26 02:29:11,827][123090] Updated weights for policy 1, policy_version 361310 (0.0006) [2023-12-26 02:29:12,468][123091] Updated weights for policy 0, policy_version 363450 (0.0009) [2023-12-26 02:29:12,540][123091] Updated weights for policy 0, policy_version 363460 (0.0006) [2023-12-26 02:29:12,597][123091] Updated weights for policy 0, policy_version 363470 (0.0009) [2023-12-26 02:29:12,643][123090] Updated weights for policy 1, policy_version 361320 (0.0006) [2023-12-26 02:29:12,719][123090] Updated weights for policy 1, policy_version 361330 (0.0008) [2023-12-26 02:29:12,781][123090] Updated weights for policy 1, policy_version 361340 (0.0010) [2023-12-26 02:29:13,294][123091] Updated weights for policy 0, policy_version 363480 (0.0010) [2023-12-26 02:29:13,353][123091] Updated weights for policy 0, policy_version 363490 (0.0010) [2023-12-26 02:29:13,410][123091] Updated weights for policy 0, policy_version 363500 (0.0010) [2023-12-26 02:29:13,476][123090] Updated weights for policy 1, policy_version 361350 (0.0005) [2023-12-26 02:29:13,549][123090] Updated weights for policy 1, policy_version 361360 (0.0005) [2023-12-26 02:29:13,622][123090] Updated weights for policy 1, policy_version 361370 (0.0005) [2023-12-26 02:29:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 185573376. Throughput: 0: 9154.4, 1: 8806.2. Samples: 185563184. Policy #0 lag: (min: 27.0, avg: 33.1, max: 59.0) [2023-12-26 02:29:13,785][121949] Avg episode reward: [(0, '5936.578'), (1, '6064.314')] [2023-12-26 02:29:14,282][123091] Updated weights for policy 0, policy_version 363511 (0.0009) [2023-12-26 02:29:14,321][123090] Updated weights for policy 1, policy_version 361380 (0.0005) [2023-12-26 02:29:14,339][123091] Updated weights for policy 0, policy_version 363521 (0.0009) [2023-12-26 02:29:14,379][123090] Updated weights for policy 1, policy_version 361390 (0.0005) [2023-12-26 02:29:14,396][123091] Updated weights for policy 0, policy_version 363531 (0.0009) [2023-12-26 02:29:14,433][123090] Updated weights for policy 1, policy_version 361400 (0.0005) [2023-12-26 02:29:15,162][123090] Updated weights for policy 1, policy_version 361410 (0.0005) [2023-12-26 02:29:15,240][123090] Updated weights for policy 1, policy_version 361420 (0.0006) [2023-12-26 02:29:15,299][123091] Updated weights for policy 0, policy_version 363541 (0.0009) [2023-12-26 02:29:15,300][123090] Updated weights for policy 1, policy_version 361430 (0.0008) [2023-12-26 02:29:15,358][123090] Updated weights for policy 1, policy_version 361440 (0.0008) [2023-12-26 02:29:15,363][123091] Updated weights for policy 0, policy_version 363551 (0.0009) [2023-12-26 02:29:15,421][123091] Updated weights for policy 0, policy_version 363561 (0.0010) [2023-12-26 02:29:16,118][123090] Updated weights for policy 1, policy_version 361450 (0.0009) [2023-12-26 02:29:16,183][123090] Updated weights for policy 1, policy_version 361460 (0.0010) [2023-12-26 02:29:16,239][123090] Updated weights for policy 1, policy_version 361470 (0.0010) [2023-12-26 02:29:16,259][123091] Updated weights for policy 0, policy_version 363571 (0.0008) [2023-12-26 02:29:16,316][123091] Updated weights for policy 0, policy_version 363581 (0.0005) [2023-12-26 02:29:16,367][123091] Updated weights for policy 0, policy_version 363591 (0.0005) [2023-12-26 02:29:17,074][123090] Updated weights for policy 1, policy_version 361480 (0.0006) [2023-12-26 02:29:17,102][123091] Updated weights for policy 0, policy_version 363601 (0.0005) [2023-12-26 02:29:17,142][123090] Updated weights for policy 1, policy_version 361490 (0.0006) [2023-12-26 02:29:17,159][123091] Updated weights for policy 0, policy_version 363611 (0.0006) [2023-12-26 02:29:17,194][123090] Updated weights for policy 1, policy_version 361500 (0.0007) [2023-12-26 02:29:17,215][123091] Updated weights for policy 0, policy_version 363621 (0.0006) [2023-12-26 02:29:17,268][123091] Updated weights for policy 0, policy_version 363631 (0.0005) [2023-12-26 02:29:17,960][123090] Updated weights for policy 1, policy_version 361510 (0.0010) [2023-12-26 02:29:17,989][123091] Updated weights for policy 0, policy_version 363641 (0.0007) [2023-12-26 02:29:18,020][123090] Updated weights for policy 1, policy_version 361520 (0.0011) [2023-12-26 02:29:18,053][123091] Updated weights for policy 0, policy_version 363651 (0.0006) [2023-12-26 02:29:18,072][123090] Updated weights for policy 1, policy_version 361530 (0.0010) [2023-12-26 02:29:18,113][123091] Updated weights for policy 0, policy_version 363661 (0.0006) [2023-12-26 02:29:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 185655296. Throughput: 0: 9106.9, 1: 8912.8. Samples: 185671504. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:18,785][121949] Avg episode reward: [(0, '5919.967'), (1, '6052.614')] [2023-12-26 02:29:18,819][123090] Updated weights for policy 1, policy_version 361540 (0.0009) [2023-12-26 02:29:18,885][123090] Updated weights for policy 1, policy_version 361550 (0.0005) [2023-12-26 02:29:18,951][123090] Updated weights for policy 1, policy_version 361560 (0.0006) [2023-12-26 02:29:18,953][123091] Updated weights for policy 0, policy_version 363671 (0.0010) [2023-12-26 02:29:19,016][123091] Updated weights for policy 0, policy_version 363681 (0.0008) [2023-12-26 02:29:19,064][123091] Updated weights for policy 0, policy_version 363691 (0.0009) [2023-12-26 02:29:19,770][123090] Updated weights for policy 1, policy_version 361570 (0.0007) [2023-12-26 02:29:19,789][123091] Updated weights for policy 0, policy_version 363701 (0.0007) [2023-12-26 02:29:19,843][123090] Updated weights for policy 1, policy_version 361580 (0.0007) [2023-12-26 02:29:19,865][123091] Updated weights for policy 0, policy_version 363711 (0.0008) [2023-12-26 02:29:19,905][123090] Updated weights for policy 1, policy_version 361590 (0.0008) [2023-12-26 02:29:19,939][123091] Updated weights for policy 0, policy_version 363721 (0.0006) [2023-12-26 02:29:19,971][123090] Updated weights for policy 1, policy_version 361600 (0.0009) [2023-12-26 02:29:20,727][123090] Updated weights for policy 1, policy_version 361610 (0.0006) [2023-12-26 02:29:20,790][123091] Updated weights for policy 0, policy_version 363731 (0.0006) [2023-12-26 02:29:20,792][123090] Updated weights for policy 1, policy_version 361620 (0.0009) [2023-12-26 02:29:20,847][123090] Updated weights for policy 1, policy_version 361630 (0.0007) [2023-12-26 02:29:20,853][123091] Updated weights for policy 0, policy_version 363741 (0.0008) [2023-12-26 02:29:20,919][123091] Updated weights for policy 0, policy_version 363751 (0.0009) [2023-12-26 02:29:21,625][123090] Updated weights for policy 1, policy_version 361640 (0.0010) [2023-12-26 02:29:21,700][123090] Updated weights for policy 1, policy_version 361650 (0.0011) [2023-12-26 02:29:21,770][123090] Updated weights for policy 1, policy_version 361660 (0.0011) [2023-12-26 02:29:21,802][123091] Updated weights for policy 0, policy_version 363761 (0.0009) [2023-12-26 02:29:21,866][123091] Updated weights for policy 0, policy_version 363771 (0.0009) [2023-12-26 02:29:21,921][123091] Updated weights for policy 0, policy_version 363781 (0.0009) [2023-12-26 02:29:21,976][123091] Updated weights for policy 0, policy_version 363791 (0.0010) [2023-12-26 02:29:22,549][123090] Updated weights for policy 1, policy_version 361670 (0.0008) [2023-12-26 02:29:22,604][123090] Updated weights for policy 1, policy_version 361680 (0.0010) [2023-12-26 02:29:22,668][123090] Updated weights for policy 1, policy_version 361690 (0.0010) [2023-12-26 02:29:22,861][123091] Updated weights for policy 0, policy_version 363801 (0.0009) [2023-12-26 02:29:22,922][123091] Updated weights for policy 0, policy_version 363811 (0.0009) [2023-12-26 02:29:22,975][123091] Updated weights for policy 0, policy_version 363821 (0.0009) [2023-12-26 02:29:23,460][123090] Updated weights for policy 1, policy_version 361700 (0.0009) [2023-12-26 02:29:23,522][123090] Updated weights for policy 1, policy_version 361710 (0.0010) [2023-12-26 02:29:23,575][123090] Updated weights for policy 1, policy_version 361720 (0.0010) [2023-12-26 02:29:23,738][123091] Updated weights for policy 0, policy_version 363831 (0.0006) [2023-12-26 02:29:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 185745408. Throughput: 0: 9068.1, 1: 8957.9. Samples: 185724148. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:23,785][123091] Updated weights for policy 0, policy_version 363841 (0.0005) [2023-12-26 02:29:23,785][121949] Avg episode reward: [(0, '5919.654'), (1, '6076.691')] [2023-12-26 02:29:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000361728_92602368.pth... [2023-12-26 02:29:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000360672_92332032.pth [2023-12-26 02:29:23,851][123091] Updated weights for policy 0, policy_version 363851 (0.0006) [2023-12-26 02:29:23,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000363856_93151232.pth... [2023-12-26 02:29:23,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000362768_92872704.pth [2023-12-26 02:29:24,314][123090] Updated weights for policy 1, policy_version 361730 (0.0009) [2023-12-26 02:29:24,370][123090] Updated weights for policy 1, policy_version 361740 (0.0005) [2023-12-26 02:29:24,430][123090] Updated weights for policy 1, policy_version 361750 (0.0006) [2023-12-26 02:29:24,481][123090] Updated weights for policy 1, policy_version 361760 (0.0008) [2023-12-26 02:29:24,677][123091] Updated weights for policy 0, policy_version 363861 (0.0008) [2023-12-26 02:29:24,731][123091] Updated weights for policy 0, policy_version 363872 (0.0011) [2023-12-26 02:29:24,783][123091] Updated weights for policy 0, policy_version 363883 (0.0010) [2023-12-26 02:29:25,223][123090] Updated weights for policy 1, policy_version 361770 (0.0009) [2023-12-26 02:29:25,286][123090] Updated weights for policy 1, policy_version 361780 (0.0010) [2023-12-26 02:29:25,352][123090] Updated weights for policy 1, policy_version 361790 (0.0010) [2023-12-26 02:29:25,537][123091] Updated weights for policy 0, policy_version 363894 (0.0009) [2023-12-26 02:29:25,600][123091] Updated weights for policy 0, policy_version 363904 (0.0009) [2023-12-26 02:29:25,660][123091] Updated weights for policy 0, policy_version 363914 (0.0009) [2023-12-26 02:29:26,133][123090] Updated weights for policy 1, policy_version 361800 (0.0006) [2023-12-26 02:29:26,186][123090] Updated weights for policy 1, policy_version 361810 (0.0005) [2023-12-26 02:29:26,239][123090] Updated weights for policy 1, policy_version 361820 (0.0005) [2023-12-26 02:29:26,537][123091] Updated weights for policy 0, policy_version 363924 (0.0009) [2023-12-26 02:29:26,599][123091] Updated weights for policy 0, policy_version 363934 (0.0009) [2023-12-26 02:29:26,651][123091] Updated weights for policy 0, policy_version 363944 (0.0009) [2023-12-26 02:29:26,826][123090] Updated weights for policy 1, policy_version 361830 (0.0005) [2023-12-26 02:29:26,877][123090] Updated weights for policy 1, policy_version 361840 (0.0005) [2023-12-26 02:29:26,923][123090] Updated weights for policy 1, policy_version 361850 (0.0005) [2023-12-26 02:29:27,499][123090] Updated weights for policy 1, policy_version 361860 (0.0005) [2023-12-26 02:29:27,548][123090] Updated weights for policy 1, policy_version 361870 (0.0005) [2023-12-26 02:29:27,587][123091] Updated weights for policy 0, policy_version 363955 (0.0009) [2023-12-26 02:29:27,599][123090] Updated weights for policy 1, policy_version 361880 (0.0009) [2023-12-26 02:29:27,649][123091] Updated weights for policy 0, policy_version 363965 (0.0009) [2023-12-26 02:29:27,713][123091] Updated weights for policy 0, policy_version 363975 (0.0010) [2023-12-26 02:29:28,308][123090] Updated weights for policy 1, policy_version 361890 (0.0009) [2023-12-26 02:29:28,378][123090] Updated weights for policy 1, policy_version 361900 (0.0008) [2023-12-26 02:29:28,441][123091] Updated weights for policy 0, policy_version 363985 (0.0009) [2023-12-26 02:29:28,443][123090] Updated weights for policy 1, policy_version 361910 (0.0008) [2023-12-26 02:29:28,497][123091] Updated weights for policy 0, policy_version 363995 (0.0008) [2023-12-26 02:29:28,510][123090] Updated weights for policy 1, policy_version 361920 (0.0007) [2023-12-26 02:29:28,547][123091] Updated weights for policy 0, policy_version 364005 (0.0009) [2023-12-26 02:29:28,600][123091] Updated weights for policy 0, policy_version 364015 (0.0009) [2023-12-26 02:29:28,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18159.0, 300 sec: 17717.0). Total num frames: 185843712. Throughput: 0: 9021.7, 1: 9121.0. Samples: 185832340. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:28,785][121949] Avg episode reward: [(0, '6074.820'), (1, '6032.041')] [2023-12-26 02:29:29,267][123090] Updated weights for policy 1, policy_version 361930 (0.0009) [2023-12-26 02:29:29,319][123090] Updated weights for policy 1, policy_version 361940 (0.0010) [2023-12-26 02:29:29,388][123090] Updated weights for policy 1, policy_version 361950 (0.0010) [2023-12-26 02:29:29,479][123091] Updated weights for policy 0, policy_version 364025 (0.0009) [2023-12-26 02:29:29,551][123091] Updated weights for policy 0, policy_version 364035 (0.0006) [2023-12-26 02:29:29,628][123091] Updated weights for policy 0, policy_version 364045 (0.0006) [2023-12-26 02:29:30,269][123091] Updated weights for policy 0, policy_version 364055 (0.0005) [2023-12-26 02:29:30,323][123091] Updated weights for policy 0, policy_version 364065 (0.0006) [2023-12-26 02:29:30,330][123090] Updated weights for policy 1, policy_version 361960 (0.0010) [2023-12-26 02:29:30,380][123091] Updated weights for policy 0, policy_version 364075 (0.0007) [2023-12-26 02:29:30,400][123090] Updated weights for policy 1, policy_version 361970 (0.0009) [2023-12-26 02:29:30,447][123090] Updated weights for policy 1, policy_version 361980 (0.0009) [2023-12-26 02:29:31,103][123091] Updated weights for policy 0, policy_version 364085 (0.0007) [2023-12-26 02:29:31,169][123091] Updated weights for policy 0, policy_version 364095 (0.0008) [2023-12-26 02:29:31,219][123091] Updated weights for policy 0, policy_version 364105 (0.0008) [2023-12-26 02:29:31,331][123090] Updated weights for policy 1, policy_version 361990 (0.0009) [2023-12-26 02:29:31,397][123090] Updated weights for policy 1, policy_version 362000 (0.0008) [2023-12-26 02:29:31,454][123090] Updated weights for policy 1, policy_version 362010 (0.0005) [2023-12-26 02:29:31,958][123091] Updated weights for policy 0, policy_version 364115 (0.0007) [2023-12-26 02:29:32,031][123091] Updated weights for policy 0, policy_version 364125 (0.0006) [2023-12-26 02:29:32,097][123091] Updated weights for policy 0, policy_version 364135 (0.0005) [2023-12-26 02:29:32,302][123090] Updated weights for policy 1, policy_version 362020 (0.0008) [2023-12-26 02:29:32,375][123090] Updated weights for policy 1, policy_version 362030 (0.0007) [2023-12-26 02:29:32,430][123090] Updated weights for policy 1, policy_version 362040 (0.0007) [2023-12-26 02:29:32,784][123091] Updated weights for policy 0, policy_version 364145 (0.0006) [2023-12-26 02:29:32,840][123091] Updated weights for policy 0, policy_version 364155 (0.0010) [2023-12-26 02:29:32,899][123091] Updated weights for policy 0, policy_version 364165 (0.0010) [2023-12-26 02:29:32,954][123091] Updated weights for policy 0, policy_version 364175 (0.0009) [2023-12-26 02:29:33,144][123090] Updated weights for policy 1, policy_version 362050 (0.0009) [2023-12-26 02:29:33,193][123090] Updated weights for policy 1, policy_version 362060 (0.0005) [2023-12-26 02:29:33,237][123090] Updated weights for policy 1, policy_version 362070 (0.0005) [2023-12-26 02:29:33,286][123090] Updated weights for policy 1, policy_version 362080 (0.0005) [2023-12-26 02:29:33,703][123091] Updated weights for policy 0, policy_version 364185 (0.0005) [2023-12-26 02:29:33,755][123091] Updated weights for policy 0, policy_version 364195 (0.0005) [2023-12-26 02:29:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 185925632. Throughput: 0: 9045.1, 1: 9073.6. Samples: 185942692. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:33,785][121949] Avg episode reward: [(0, '6092.895'), (1, '6028.438')] [2023-12-26 02:29:33,817][123091] Updated weights for policy 0, policy_version 364205 (0.0007) [2023-12-26 02:29:34,013][123090] Updated weights for policy 1, policy_version 362090 (0.0009) [2023-12-26 02:29:34,074][123090] Updated weights for policy 1, policy_version 362100 (0.0010) [2023-12-26 02:29:34,129][123090] Updated weights for policy 1, policy_version 362110 (0.0009) [2023-12-26 02:29:34,496][123091] Updated weights for policy 0, policy_version 364215 (0.0009) [2023-12-26 02:29:34,564][123091] Updated weights for policy 0, policy_version 364225 (0.0009) [2023-12-26 02:29:34,634][123091] Updated weights for policy 0, policy_version 364235 (0.0009) [2023-12-26 02:29:34,959][123090] Updated weights for policy 1, policy_version 362120 (0.0006) [2023-12-26 02:29:35,025][123090] Updated weights for policy 1, policy_version 362130 (0.0006) [2023-12-26 02:29:35,089][123090] Updated weights for policy 1, policy_version 362140 (0.0005) [2023-12-26 02:29:35,388][123091] Updated weights for policy 0, policy_version 364245 (0.0009) [2023-12-26 02:29:35,437][123091] Updated weights for policy 0, policy_version 364256 (0.0008) [2023-12-26 02:29:35,483][123091] Updated weights for policy 0, policy_version 364266 (0.0005) [2023-12-26 02:29:35,723][123090] Updated weights for policy 1, policy_version 362150 (0.0005) [2023-12-26 02:29:35,777][123090] Updated weights for policy 1, policy_version 362160 (0.0005) [2023-12-26 02:29:35,831][123090] Updated weights for policy 1, policy_version 362170 (0.0009) [2023-12-26 02:29:36,274][123091] Updated weights for policy 0, policy_version 364276 (0.0006) [2023-12-26 02:29:36,343][123091] Updated weights for policy 0, policy_version 364286 (0.0009) [2023-12-26 02:29:36,408][123091] Updated weights for policy 0, policy_version 364296 (0.0011) [2023-12-26 02:29:36,624][123090] Updated weights for policy 1, policy_version 362180 (0.0009) [2023-12-26 02:29:36,690][123090] Updated weights for policy 1, policy_version 362190 (0.0009) [2023-12-26 02:29:36,751][123090] Updated weights for policy 1, policy_version 362200 (0.0009) [2023-12-26 02:29:37,218][123091] Updated weights for policy 0, policy_version 364306 (0.0011) [2023-12-26 02:29:37,284][123091] Updated weights for policy 0, policy_version 364316 (0.0011) [2023-12-26 02:29:37,346][123091] Updated weights for policy 0, policy_version 364326 (0.0007) [2023-12-26 02:29:37,415][123091] Updated weights for policy 0, policy_version 364336 (0.0005) [2023-12-26 02:29:37,616][123090] Updated weights for policy 1, policy_version 362210 (0.0009) [2023-12-26 02:29:37,685][123090] Updated weights for policy 1, policy_version 362220 (0.0006) [2023-12-26 02:29:37,747][123090] Updated weights for policy 1, policy_version 362230 (0.0006) [2023-12-26 02:29:37,803][123090] Updated weights for policy 1, policy_version 362240 (0.0009) [2023-12-26 02:29:38,153][123091] Updated weights for policy 0, policy_version 364346 (0.0010) [2023-12-26 02:29:38,203][123091] Updated weights for policy 0, policy_version 364356 (0.0009) [2023-12-26 02:29:38,268][123091] Updated weights for policy 0, policy_version 364366 (0.0010) [2023-12-26 02:29:38,631][123090] Updated weights for policy 1, policy_version 362250 (0.0009) [2023-12-26 02:29:38,689][123090] Updated weights for policy 1, policy_version 362260 (0.0008) [2023-12-26 02:29:38,745][123090] Updated weights for policy 1, policy_version 362270 (0.0007) [2023-12-26 02:29:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 186023936. Throughput: 0: 9097.8, 1: 9074.2. Samples: 185998568. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:38,784][121949] Avg episode reward: [(0, '5952.201'), (1, '6060.981')] [2023-12-26 02:29:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000364368_93282304.pth... [2023-12-26 02:29:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000362272_92741632.pth... [2023-12-26 02:29:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000361216_92471296.pth [2023-12-26 02:29:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000363344_93020160.pth [2023-12-26 02:29:39,115][123091] Updated weights for policy 0, policy_version 364376 (0.0006) [2023-12-26 02:29:39,188][123091] Updated weights for policy 0, policy_version 364386 (0.0006) [2023-12-26 02:29:39,256][123091] Updated weights for policy 0, policy_version 364396 (0.0007) [2023-12-26 02:29:39,604][123090] Updated weights for policy 1, policy_version 362280 (0.0009) [2023-12-26 02:29:39,673][123090] Updated weights for policy 1, policy_version 362290 (0.0009) [2023-12-26 02:29:39,743][123090] Updated weights for policy 1, policy_version 362300 (0.0009) [2023-12-26 02:29:40,023][123091] Updated weights for policy 0, policy_version 364406 (0.0008) [2023-12-26 02:29:40,080][123091] Updated weights for policy 0, policy_version 364416 (0.0006) [2023-12-26 02:29:40,144][123091] Updated weights for policy 0, policy_version 364426 (0.0006) [2023-12-26 02:29:40,649][123090] Updated weights for policy 1, policy_version 362310 (0.0009) [2023-12-26 02:29:40,708][123090] Updated weights for policy 1, policy_version 362320 (0.0009) [2023-12-26 02:29:40,769][123090] Updated weights for policy 1, policy_version 362330 (0.0009) [2023-12-26 02:29:40,876][123091] Updated weights for policy 0, policy_version 364436 (0.0006) [2023-12-26 02:29:40,949][123091] Updated weights for policy 0, policy_version 364446 (0.0005) [2023-12-26 02:29:41,027][123091] Updated weights for policy 0, policy_version 364456 (0.0007) [2023-12-26 02:29:41,580][123090] Updated weights for policy 1, policy_version 362340 (0.0008) [2023-12-26 02:29:41,658][123090] Updated weights for policy 1, policy_version 362350 (0.0010) [2023-12-26 02:29:41,736][123090] Updated weights for policy 1, policy_version 362361 (0.0011) [2023-12-26 02:29:41,857][123091] Updated weights for policy 0, policy_version 364466 (0.0010) [2023-12-26 02:29:41,917][123091] Updated weights for policy 0, policy_version 364476 (0.0010) [2023-12-26 02:29:41,989][123091] Updated weights for policy 0, policy_version 364486 (0.0010) [2023-12-26 02:29:42,056][123091] Updated weights for policy 0, policy_version 364496 (0.0009) [2023-12-26 02:29:42,623][123090] Updated weights for policy 1, policy_version 362371 (0.0010) [2023-12-26 02:29:42,694][123090] Updated weights for policy 1, policy_version 362381 (0.0009) [2023-12-26 02:29:42,744][123090] Updated weights for policy 1, policy_version 362391 (0.0009) [2023-12-26 02:29:42,801][123091] Updated weights for policy 0, policy_version 364506 (0.0005) [2023-12-26 02:29:42,862][123091] Updated weights for policy 0, policy_version 364516 (0.0007) [2023-12-26 02:29:42,926][123091] Updated weights for policy 0, policy_version 364526 (0.0008) [2023-12-26 02:29:43,580][123090] Updated weights for policy 1, policy_version 362401 (0.0008) [2023-12-26 02:29:43,634][123090] Updated weights for policy 1, policy_version 362411 (0.0005) [2023-12-26 02:29:43,692][123090] Updated weights for policy 1, policy_version 362421 (0.0006) [2023-12-26 02:29:43,716][123091] Updated weights for policy 0, policy_version 364536 (0.0011) [2023-12-26 02:29:43,744][123090] Updated weights for policy 1, policy_version 362431 (0.0006) [2023-12-26 02:29:43,776][123091] Updated weights for policy 0, policy_version 364546 (0.0011) [2023-12-26 02:29:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 186105856. Throughput: 0: 9023.7, 1: 9006.1. Samples: 186100664. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:43,785][121949] Avg episode reward: [(0, '5997.398'), (1, '6063.607')] [2023-12-26 02:29:43,845][123091] Updated weights for policy 0, policy_version 364556 (0.0011) [2023-12-26 02:29:44,364][123090] Updated weights for policy 1, policy_version 362441 (0.0010) [2023-12-26 02:29:44,423][123090] Updated weights for policy 1, policy_version 362451 (0.0010) [2023-12-26 02:29:44,471][123090] Updated weights for policy 1, policy_version 362461 (0.0010) [2023-12-26 02:29:44,658][123091] Updated weights for policy 0, policy_version 364566 (0.0011) [2023-12-26 02:29:44,711][123091] Updated weights for policy 0, policy_version 364576 (0.0008) [2023-12-26 02:29:44,764][123091] Updated weights for policy 0, policy_version 364586 (0.0006) [2023-12-26 02:29:45,254][123090] Updated weights for policy 1, policy_version 362471 (0.0007) [2023-12-26 02:29:45,321][123090] Updated weights for policy 1, policy_version 362481 (0.0006) [2023-12-26 02:29:45,369][123090] Updated weights for policy 1, policy_version 362491 (0.0008) [2023-12-26 02:29:45,590][123091] Updated weights for policy 0, policy_version 364596 (0.0009) [2023-12-26 02:29:45,638][123091] Updated weights for policy 0, policy_version 364606 (0.0010) [2023-12-26 02:29:45,689][123091] Updated weights for policy 0, policy_version 364616 (0.0010) [2023-12-26 02:29:46,060][123090] Updated weights for policy 1, policy_version 362501 (0.0009) [2023-12-26 02:29:46,127][123090] Updated weights for policy 1, policy_version 362511 (0.0009) [2023-12-26 02:29:46,179][123090] Updated weights for policy 1, policy_version 362521 (0.0008) [2023-12-26 02:29:46,538][123091] Updated weights for policy 0, policy_version 364626 (0.0010) [2023-12-26 02:29:46,593][123091] Updated weights for policy 0, policy_version 364636 (0.0010) [2023-12-26 02:29:46,647][123091] Updated weights for policy 0, policy_version 364646 (0.0010) [2023-12-26 02:29:46,706][123091] Updated weights for policy 0, policy_version 364656 (0.0010) [2023-12-26 02:29:46,952][123090] Updated weights for policy 1, policy_version 362531 (0.0007) [2023-12-26 02:29:47,011][123090] Updated weights for policy 1, policy_version 362541 (0.0005) [2023-12-26 02:29:47,076][123090] Updated weights for policy 1, policy_version 362551 (0.0005) [2023-12-26 02:29:47,511][123091] Updated weights for policy 0, policy_version 364666 (0.0006) [2023-12-26 02:29:47,569][123091] Updated weights for policy 0, policy_version 364676 (0.0006) [2023-12-26 02:29:47,619][123091] Updated weights for policy 0, policy_version 364686 (0.0005) [2023-12-26 02:29:47,846][123090] Updated weights for policy 1, policy_version 362561 (0.0006) [2023-12-26 02:29:47,910][123090] Updated weights for policy 1, policy_version 362571 (0.0011) [2023-12-26 02:29:47,986][123090] Updated weights for policy 1, policy_version 362581 (0.0011) [2023-12-26 02:29:48,054][123090] Updated weights for policy 1, policy_version 362591 (0.0010) [2023-12-26 02:29:48,358][123091] Updated weights for policy 0, policy_version 364696 (0.0009) [2023-12-26 02:29:48,414][123091] Updated weights for policy 0, policy_version 364706 (0.0010) [2023-12-26 02:29:48,475][123091] Updated weights for policy 0, policy_version 364716 (0.0009) [2023-12-26 02:29:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 186195968. Throughput: 0: 8942.5, 1: 8984.6. Samples: 186208080. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:48,784][121949] Avg episode reward: [(0, '5990.524'), (1, '6072.286')] [2023-12-26 02:29:48,898][123090] Updated weights for policy 1, policy_version 362601 (0.0006) [2023-12-26 02:29:48,961][123090] Updated weights for policy 1, policy_version 362611 (0.0005) [2023-12-26 02:29:49,019][123090] Updated weights for policy 1, policy_version 362621 (0.0005) [2023-12-26 02:29:49,304][123091] Updated weights for policy 0, policy_version 364726 (0.0007) [2023-12-26 02:29:49,388][123091] Updated weights for policy 0, policy_version 364736 (0.0009) [2023-12-26 02:29:49,454][123091] Updated weights for policy 0, policy_version 364746 (0.0010) [2023-12-26 02:29:49,743][123090] Updated weights for policy 1, policy_version 362631 (0.0008) [2023-12-26 02:29:49,803][123090] Updated weights for policy 1, policy_version 362641 (0.0008) [2023-12-26 02:29:49,875][123090] Updated weights for policy 1, policy_version 362651 (0.0007) [2023-12-26 02:29:50,238][123091] Updated weights for policy 0, policy_version 364756 (0.0009) [2023-12-26 02:29:50,285][123091] Updated weights for policy 0, policy_version 364766 (0.0009) [2023-12-26 02:29:50,341][123091] Updated weights for policy 0, policy_version 364777 (0.0010) [2023-12-26 02:29:50,620][123090] Updated weights for policy 1, policy_version 362661 (0.0007) [2023-12-26 02:29:50,692][123090] Updated weights for policy 1, policy_version 362671 (0.0009) [2023-12-26 02:29:50,759][123090] Updated weights for policy 1, policy_version 362681 (0.0007) [2023-12-26 02:29:51,303][123091] Updated weights for policy 0, policy_version 364787 (0.0010) [2023-12-26 02:29:51,371][123091] Updated weights for policy 0, policy_version 364797 (0.0009) [2023-12-26 02:29:51,440][123091] Updated weights for policy 0, policy_version 364807 (0.0010) [2023-12-26 02:29:51,492][123090] Updated weights for policy 1, policy_version 362691 (0.0006) [2023-12-26 02:29:51,557][123090] Updated weights for policy 1, policy_version 362701 (0.0007) [2023-12-26 02:29:51,609][123090] Updated weights for policy 1, policy_version 362711 (0.0006) [2023-12-26 02:29:52,328][123091] Updated weights for policy 0, policy_version 364817 (0.0010) [2023-12-26 02:29:52,355][123090] Updated weights for policy 1, policy_version 362721 (0.0006) [2023-12-26 02:29:52,395][123091] Updated weights for policy 0, policy_version 364827 (0.0009) [2023-12-26 02:29:52,419][123090] Updated weights for policy 1, policy_version 362731 (0.0007) [2023-12-26 02:29:52,444][123091] Updated weights for policy 0, policy_version 364837 (0.0008) [2023-12-26 02:29:52,483][123090] Updated weights for policy 1, policy_version 362741 (0.0008) [2023-12-26 02:29:52,494][123091] Updated weights for policy 0, policy_version 364847 (0.0007) [2023-12-26 02:29:52,543][123090] Updated weights for policy 1, policy_version 362752 (0.0009) [2023-12-26 02:29:53,377][123090] Updated weights for policy 1, policy_version 362762 (0.0009) [2023-12-26 02:29:53,391][123091] Updated weights for policy 0, policy_version 364857 (0.0006) [2023-12-26 02:29:53,428][123090] Updated weights for policy 1, policy_version 362772 (0.0008) [2023-12-26 02:29:53,443][123091] Updated weights for policy 0, policy_version 364867 (0.0007) [2023-12-26 02:29:53,484][123090] Updated weights for policy 1, policy_version 362782 (0.0008) [2023-12-26 02:29:53,491][123091] Updated weights for policy 0, policy_version 364877 (0.0007) [2023-12-26 02:29:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 186286080. Throughput: 0: 8892.6, 1: 8987.8. Samples: 186260560. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:53,785][121949] Avg episode reward: [(0, '6053.145'), (1, '6020.966')] [2023-12-26 02:29:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000364880_93413376.pth... [2023-12-26 02:29:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000362784_92872704.pth... [2023-12-26 02:29:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000363856_93151232.pth [2023-12-26 02:29:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000361728_92602368.pth [2023-12-26 02:29:54,236][123091] Updated weights for policy 0, policy_version 364887 (0.0010) [2023-12-26 02:29:54,257][123090] Updated weights for policy 1, policy_version 362792 (0.0007) [2023-12-26 02:29:54,294][123091] Updated weights for policy 0, policy_version 364897 (0.0008) [2023-12-26 02:29:54,321][123090] Updated weights for policy 1, policy_version 362802 (0.0008) [2023-12-26 02:29:54,356][123091] Updated weights for policy 0, policy_version 364907 (0.0007) [2023-12-26 02:29:54,377][123090] Updated weights for policy 1, policy_version 362812 (0.0008) [2023-12-26 02:29:55,130][123090] Updated weights for policy 1, policy_version 362822 (0.0005) [2023-12-26 02:29:55,152][123091] Updated weights for policy 0, policy_version 364917 (0.0009) [2023-12-26 02:29:55,181][123090] Updated weights for policy 1, policy_version 362832 (0.0005) [2023-12-26 02:29:55,213][123091] Updated weights for policy 0, policy_version 364927 (0.0009) [2023-12-26 02:29:55,235][123090] Updated weights for policy 1, policy_version 362842 (0.0005) [2023-12-26 02:29:55,271][123091] Updated weights for policy 0, policy_version 364937 (0.0006) [2023-12-26 02:29:55,976][123091] Updated weights for policy 0, policy_version 364947 (0.0009) [2023-12-26 02:29:56,035][123091] Updated weights for policy 0, policy_version 364957 (0.0011) [2023-12-26 02:29:56,037][123090] Updated weights for policy 1, policy_version 362852 (0.0007) [2023-12-26 02:29:56,096][123090] Updated weights for policy 1, policy_version 362862 (0.0010) [2023-12-26 02:29:56,097][123091] Updated weights for policy 0, policy_version 364967 (0.0010) [2023-12-26 02:29:56,162][123090] Updated weights for policy 1, policy_version 362872 (0.0010) [2023-12-26 02:29:56,792][123091] Updated weights for policy 0, policy_version 364977 (0.0010) [2023-12-26 02:29:56,839][123091] Updated weights for policy 0, policy_version 364987 (0.0010) [2023-12-26 02:29:56,852][123090] Updated weights for policy 1, policy_version 362882 (0.0009) [2023-12-26 02:29:56,890][123091] Updated weights for policy 0, policy_version 364997 (0.0010) [2023-12-26 02:29:56,904][123090] Updated weights for policy 1, policy_version 362892 (0.0005) [2023-12-26 02:29:56,941][123091] Updated weights for policy 0, policy_version 365007 (0.0010) [2023-12-26 02:29:56,963][123090] Updated weights for policy 1, policy_version 362902 (0.0006) [2023-12-26 02:29:57,011][123090] Updated weights for policy 1, policy_version 362912 (0.0009) [2023-12-26 02:29:57,748][123091] Updated weights for policy 0, policy_version 365017 (0.0008) [2023-12-26 02:29:57,752][123090] Updated weights for policy 1, policy_version 362922 (0.0005) [2023-12-26 02:29:57,806][123091] Updated weights for policy 0, policy_version 365027 (0.0005) [2023-12-26 02:29:57,813][123090] Updated weights for policy 1, policy_version 362932 (0.0005) [2023-12-26 02:29:57,863][123090] Updated weights for policy 1, policy_version 362942 (0.0005) [2023-12-26 02:29:57,864][123091] Updated weights for policy 0, policy_version 365037 (0.0005) [2023-12-26 02:29:58,575][123090] Updated weights for policy 1, policy_version 362952 (0.0008) [2023-12-26 02:29:58,620][123091] Updated weights for policy 0, policy_version 365047 (0.0007) [2023-12-26 02:29:58,649][123090] Updated weights for policy 1, policy_version 362962 (0.0009) [2023-12-26 02:29:58,685][123091] Updated weights for policy 0, policy_version 365057 (0.0009) [2023-12-26 02:29:58,725][123090] Updated weights for policy 1, policy_version 362972 (0.0007) [2023-12-26 02:29:58,756][123091] Updated weights for policy 0, policy_version 365067 (0.0009) [2023-12-26 02:29:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 186376192. Throughput: 0: 8876.7, 1: 9069.5. Samples: 186370760. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:29:58,784][121949] Avg episode reward: [(0, '6132.049'), (1, '5986.786')] [2023-12-26 02:29:59,598][123090] Updated weights for policy 1, policy_version 362982 (0.0009) [2023-12-26 02:29:59,632][123091] Updated weights for policy 0, policy_version 365077 (0.0008) [2023-12-26 02:29:59,647][123090] Updated weights for policy 1, policy_version 362992 (0.0010) [2023-12-26 02:29:59,684][123091] Updated weights for policy 0, policy_version 365087 (0.0005) [2023-12-26 02:29:59,703][123090] Updated weights for policy 1, policy_version 363002 (0.0010) [2023-12-26 02:29:59,737][123091] Updated weights for policy 0, policy_version 365097 (0.0010) [2023-12-26 02:30:00,518][123090] Updated weights for policy 1, policy_version 363012 (0.0010) [2023-12-26 02:30:00,570][123091] Updated weights for policy 0, policy_version 365107 (0.0008) [2023-12-26 02:30:00,573][123090] Updated weights for policy 1, policy_version 363022 (0.0010) [2023-12-26 02:30:00,628][123091] Updated weights for policy 0, policy_version 365117 (0.0005) [2023-12-26 02:30:00,634][123090] Updated weights for policy 1, policy_version 363032 (0.0011) [2023-12-26 02:30:00,680][123091] Updated weights for policy 0, policy_version 365127 (0.0007) [2023-12-26 02:30:01,431][123090] Updated weights for policy 1, policy_version 363042 (0.0010) [2023-12-26 02:30:01,459][123091] Updated weights for policy 0, policy_version 365137 (0.0008) [2023-12-26 02:30:01,481][123090] Updated weights for policy 1, policy_version 363052 (0.0009) [2023-12-26 02:30:01,520][123091] Updated weights for policy 0, policy_version 365147 (0.0006) [2023-12-26 02:30:01,536][123090] Updated weights for policy 1, policy_version 363062 (0.0006) [2023-12-26 02:30:01,577][123091] Updated weights for policy 0, policy_version 365157 (0.0006) [2023-12-26 02:30:01,588][123090] Updated weights for policy 1, policy_version 363072 (0.0005) [2023-12-26 02:30:01,643][123091] Updated weights for policy 0, policy_version 365167 (0.0006) [2023-12-26 02:30:02,393][123091] Updated weights for policy 0, policy_version 365177 (0.0010) [2023-12-26 02:30:02,462][123091] Updated weights for policy 0, policy_version 365187 (0.0008) [2023-12-26 02:30:02,470][123090] Updated weights for policy 1, policy_version 363082 (0.0009) [2023-12-26 02:30:02,514][123091] Updated weights for policy 0, policy_version 365197 (0.0008) [2023-12-26 02:30:02,530][123090] Updated weights for policy 1, policy_version 363092 (0.0006) [2023-12-26 02:30:02,602][123090] Updated weights for policy 1, policy_version 363102 (0.0008) [2023-12-26 02:30:03,281][123091] Updated weights for policy 0, policy_version 365207 (0.0006) [2023-12-26 02:30:03,301][123090] Updated weights for policy 1, policy_version 363112 (0.0010) [2023-12-26 02:30:03,325][123091] Updated weights for policy 0, policy_version 365217 (0.0005) [2023-12-26 02:30:03,347][123090] Updated weights for policy 1, policy_version 363122 (0.0007) [2023-12-26 02:30:03,371][123091] Updated weights for policy 0, policy_version 365227 (0.0005) [2023-12-26 02:30:03,411][123090] Updated weights for policy 1, policy_version 363132 (0.0005) [2023-12-26 02:30:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 186466304. Throughput: 0: 8896.0, 1: 9017.2. Samples: 186477600. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:03,785][121949] Avg episode reward: [(0, '6110.445'), (1, '6016.417')] [2023-12-26 02:30:04,101][123090] Updated weights for policy 1, policy_version 363142 (0.0010) [2023-12-26 02:30:04,129][123091] Updated weights for policy 0, policy_version 365237 (0.0007) [2023-12-26 02:30:04,160][123090] Updated weights for policy 1, policy_version 363152 (0.0010) [2023-12-26 02:30:04,181][123091] Updated weights for policy 0, policy_version 365247 (0.0008) [2023-12-26 02:30:04,220][123090] Updated weights for policy 1, policy_version 363162 (0.0010) [2023-12-26 02:30:04,226][123091] Updated weights for policy 0, policy_version 365257 (0.0008) [2023-12-26 02:30:05,003][123091] Updated weights for policy 0, policy_version 365267 (0.0007) [2023-12-26 02:30:05,055][123090] Updated weights for policy 1, policy_version 363172 (0.0010) [2023-12-26 02:30:05,061][123091] Updated weights for policy 0, policy_version 365277 (0.0006) [2023-12-26 02:30:05,109][123091] Updated weights for policy 0, policy_version 365287 (0.0005) [2023-12-26 02:30:05,111][123090] Updated weights for policy 1, policy_version 363182 (0.0010) [2023-12-26 02:30:05,159][123090] Updated weights for policy 1, policy_version 363192 (0.0010) [2023-12-26 02:30:05,750][123091] Updated weights for policy 0, policy_version 365297 (0.0006) [2023-12-26 02:30:05,802][123091] Updated weights for policy 0, policy_version 365307 (0.0006) [2023-12-26 02:30:05,859][123091] Updated weights for policy 0, policy_version 365317 (0.0006) [2023-12-26 02:30:05,919][123091] Updated weights for policy 0, policy_version 365327 (0.0007) [2023-12-26 02:30:05,952][123090] Updated weights for policy 1, policy_version 363202 (0.0010) [2023-12-26 02:30:06,017][123090] Updated weights for policy 1, policy_version 363212 (0.0010) [2023-12-26 02:30:06,071][123090] Updated weights for policy 1, policy_version 363222 (0.0010) [2023-12-26 02:30:06,135][123090] Updated weights for policy 1, policy_version 363232 (0.0008) [2023-12-26 02:30:06,724][123091] Updated weights for policy 0, policy_version 365337 (0.0010) [2023-12-26 02:30:06,782][123091] Updated weights for policy 0, policy_version 365347 (0.0011) [2023-12-26 02:30:06,843][123091] Updated weights for policy 0, policy_version 365357 (0.0011) [2023-12-26 02:30:06,957][123090] Updated weights for policy 1, policy_version 363242 (0.0009) [2023-12-26 02:30:07,014][123090] Updated weights for policy 1, policy_version 363252 (0.0008) [2023-12-26 02:30:07,081][123090] Updated weights for policy 1, policy_version 363262 (0.0009) [2023-12-26 02:30:07,658][123091] Updated weights for policy 0, policy_version 365367 (0.0007) [2023-12-26 02:30:07,732][123091] Updated weights for policy 0, policy_version 365377 (0.0005) [2023-12-26 02:30:07,795][123091] Updated weights for policy 0, policy_version 365387 (0.0005) [2023-12-26 02:30:07,871][123090] Updated weights for policy 1, policy_version 363272 (0.0010) [2023-12-26 02:30:07,942][123090] Updated weights for policy 1, policy_version 363282 (0.0010) [2023-12-26 02:30:08,004][123090] Updated weights for policy 1, policy_version 363292 (0.0008) [2023-12-26 02:30:08,501][123091] Updated weights for policy 0, policy_version 365397 (0.0008) [2023-12-26 02:30:08,561][123091] Updated weights for policy 0, policy_version 365407 (0.0010) [2023-12-26 02:30:08,619][123091] Updated weights for policy 0, policy_version 365417 (0.0009) [2023-12-26 02:30:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 186556416. Throughput: 0: 8958.5, 1: 9014.8. Samples: 186532948. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:08,785][121949] Avg episode reward: [(0, '5979.919'), (1, '5946.351')] [2023-12-26 02:30:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000365424_93552640.pth... [2023-12-26 02:30:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000363296_93003776.pth... [2023-12-26 02:30:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000362272_92741632.pth [2023-12-26 02:30:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000364368_93282304.pth [2023-12-26 02:30:08,856][123090] Updated weights for policy 1, policy_version 363302 (0.0010) [2023-12-26 02:30:08,914][123090] Updated weights for policy 1, policy_version 363312 (0.0010) [2023-12-26 02:30:08,975][123090] Updated weights for policy 1, policy_version 363323 (0.0010) [2023-12-26 02:30:09,464][123091] Updated weights for policy 0, policy_version 365427 (0.0009) [2023-12-26 02:30:09,533][123091] Updated weights for policy 0, policy_version 365437 (0.0010) [2023-12-26 02:30:09,594][123091] Updated weights for policy 0, policy_version 365447 (0.0007) [2023-12-26 02:30:09,758][123090] Updated weights for policy 1, policy_version 363333 (0.0009) [2023-12-26 02:30:09,821][123090] Updated weights for policy 1, policy_version 363343 (0.0009) [2023-12-26 02:30:09,891][123090] Updated weights for policy 1, policy_version 363353 (0.0008) [2023-12-26 02:30:10,415][123091] Updated weights for policy 0, policy_version 365457 (0.0010) [2023-12-26 02:30:10,487][123091] Updated weights for policy 0, policy_version 365467 (0.0009) [2023-12-26 02:30:10,555][123091] Updated weights for policy 0, policy_version 365477 (0.0010) [2023-12-26 02:30:10,608][123091] Updated weights for policy 0, policy_version 365487 (0.0010) [2023-12-26 02:30:10,689][123090] Updated weights for policy 1, policy_version 363363 (0.0008) [2023-12-26 02:30:10,749][123090] Updated weights for policy 1, policy_version 363373 (0.0005) [2023-12-26 02:30:10,805][123090] Updated weights for policy 1, policy_version 363383 (0.0009) [2023-12-26 02:30:11,495][123091] Updated weights for policy 0, policy_version 365497 (0.0006) [2023-12-26 02:30:11,556][123091] Updated weights for policy 0, policy_version 365507 (0.0006) [2023-12-26 02:30:11,621][123091] Updated weights for policy 0, policy_version 365517 (0.0006) [2023-12-26 02:30:11,693][123090] Updated weights for policy 1, policy_version 363393 (0.0009) [2023-12-26 02:30:11,768][123090] Updated weights for policy 1, policy_version 363403 (0.0008) [2023-12-26 02:30:11,849][123090] Updated weights for policy 1, policy_version 363413 (0.0005) [2023-12-26 02:30:11,923][123090] Updated weights for policy 1, policy_version 363423 (0.0006) [2023-12-26 02:30:12,240][123091] Updated weights for policy 0, policy_version 365527 (0.0006) [2023-12-26 02:30:12,297][123091] Updated weights for policy 0, policy_version 365537 (0.0006) [2023-12-26 02:30:12,359][123091] Updated weights for policy 0, policy_version 365547 (0.0008) [2023-12-26 02:30:12,733][123090] Updated weights for policy 1, policy_version 363433 (0.0009) [2023-12-26 02:30:12,808][123090] Updated weights for policy 1, policy_version 363443 (0.0010) [2023-12-26 02:30:12,870][123090] Updated weights for policy 1, policy_version 363453 (0.0009) [2023-12-26 02:30:13,062][123091] Updated weights for policy 0, policy_version 365557 (0.0010) [2023-12-26 02:30:13,113][123091] Updated weights for policy 0, policy_version 365567 (0.0009) [2023-12-26 02:30:13,164][123091] Updated weights for policy 0, policy_version 365577 (0.0009) [2023-12-26 02:30:13,714][123090] Updated weights for policy 1, policy_version 363463 (0.0009) [2023-12-26 02:30:13,775][123090] Updated weights for policy 1, policy_version 363473 (0.0008) [2023-12-26 02:30:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 186638336. Throughput: 0: 9000.2, 1: 8884.9. Samples: 186637168. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:13,784][121949] Avg episode reward: [(0, '6076.434'), (1, '5948.246')] [2023-12-26 02:30:13,845][123090] Updated weights for policy 1, policy_version 363483 (0.0006) [2023-12-26 02:30:13,955][123091] Updated weights for policy 0, policy_version 365587 (0.0008) [2023-12-26 02:30:14,005][123091] Updated weights for policy 0, policy_version 365597 (0.0006) [2023-12-26 02:30:14,066][123091] Updated weights for policy 0, policy_version 365607 (0.0005) [2023-12-26 02:30:14,498][123090] Updated weights for policy 1, policy_version 363493 (0.0006) [2023-12-26 02:30:14,553][123090] Updated weights for policy 1, policy_version 363503 (0.0005) [2023-12-26 02:30:14,613][123090] Updated weights for policy 1, policy_version 363513 (0.0005) [2023-12-26 02:30:14,703][123091] Updated weights for policy 0, policy_version 365617 (0.0006) [2023-12-26 02:30:14,756][123091] Updated weights for policy 0, policy_version 365627 (0.0009) [2023-12-26 02:30:14,814][123091] Updated weights for policy 0, policy_version 365637 (0.0010) [2023-12-26 02:30:14,869][123091] Updated weights for policy 0, policy_version 365647 (0.0009) [2023-12-26 02:30:15,409][123090] Updated weights for policy 1, policy_version 363523 (0.0006) [2023-12-26 02:30:15,486][123090] Updated weights for policy 1, policy_version 363533 (0.0008) [2023-12-26 02:30:15,555][123090] Updated weights for policy 1, policy_version 363543 (0.0008) [2023-12-26 02:30:15,663][123091] Updated weights for policy 0, policy_version 365657 (0.0010) [2023-12-26 02:30:15,721][123091] Updated weights for policy 0, policy_version 365667 (0.0010) [2023-12-26 02:30:15,780][123091] Updated weights for policy 0, policy_version 365677 (0.0010) [2023-12-26 02:30:16,128][123090] Updated weights for policy 1, policy_version 363553 (0.0006) [2023-12-26 02:30:16,202][123090] Updated weights for policy 1, policy_version 363563 (0.0005) [2023-12-26 02:30:16,263][123090] Updated weights for policy 1, policy_version 363573 (0.0008) [2023-12-26 02:30:16,325][123090] Updated weights for policy 1, policy_version 363583 (0.0010) [2023-12-26 02:30:16,567][123091] Updated weights for policy 0, policy_version 365688 (0.0010) [2023-12-26 02:30:16,618][123091] Updated weights for policy 0, policy_version 365698 (0.0006) [2023-12-26 02:30:16,667][123091] Updated weights for policy 0, policy_version 365708 (0.0005) [2023-12-26 02:30:17,126][123090] Updated weights for policy 1, policy_version 363593 (0.0010) [2023-12-26 02:30:17,178][123090] Updated weights for policy 1, policy_version 363603 (0.0010) [2023-12-26 02:30:17,236][123090] Updated weights for policy 1, policy_version 363613 (0.0010) [2023-12-26 02:30:17,437][123091] Updated weights for policy 0, policy_version 365718 (0.0010) [2023-12-26 02:30:17,499][123091] Updated weights for policy 0, policy_version 365728 (0.0010) [2023-12-26 02:30:17,550][123091] Updated weights for policy 0, policy_version 365738 (0.0010) [2023-12-26 02:30:18,066][123090] Updated weights for policy 1, policy_version 363623 (0.0009) [2023-12-26 02:30:18,130][123090] Updated weights for policy 1, policy_version 363633 (0.0010) [2023-12-26 02:30:18,189][123090] Updated weights for policy 1, policy_version 363643 (0.0010) [2023-12-26 02:30:18,353][123091] Updated weights for policy 0, policy_version 365748 (0.0009) [2023-12-26 02:30:18,421][123091] Updated weights for policy 0, policy_version 365758 (0.0006) [2023-12-26 02:30:18,488][123091] Updated weights for policy 0, policy_version 365768 (0.0006) [2023-12-26 02:30:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 186736640. Throughput: 0: 8984.5, 1: 8903.9. Samples: 186747664. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:18,785][121949] Avg episode reward: [(0, '6206.886'), (1, '5960.133')] [2023-12-26 02:30:19,031][123090] Updated weights for policy 1, policy_version 363653 (0.0010) [2023-12-26 02:30:19,090][123090] Updated weights for policy 1, policy_version 363663 (0.0010) [2023-12-26 02:30:19,155][123090] Updated weights for policy 1, policy_version 363673 (0.0011) [2023-12-26 02:30:19,184][123091] Updated weights for policy 0, policy_version 365778 (0.0006) [2023-12-26 02:30:19,247][123091] Updated weights for policy 0, policy_version 365788 (0.0009) [2023-12-26 02:30:19,316][123091] Updated weights for policy 0, policy_version 365798 (0.0009) [2023-12-26 02:30:19,395][123091] Updated weights for policy 0, policy_version 365808 (0.0009) [2023-12-26 02:30:20,017][123090] Updated weights for policy 1, policy_version 363683 (0.0009) [2023-12-26 02:30:20,074][123090] Updated weights for policy 1, policy_version 363693 (0.0005) [2023-12-26 02:30:20,125][123090] Updated weights for policy 1, policy_version 363703 (0.0005) [2023-12-26 02:30:20,293][123091] Updated weights for policy 0, policy_version 365818 (0.0010) [2023-12-26 02:30:20,351][123091] Updated weights for policy 0, policy_version 365828 (0.0009) [2023-12-26 02:30:20,418][123091] Updated weights for policy 0, policy_version 365838 (0.0009) [2023-12-26 02:30:20,841][123090] Updated weights for policy 1, policy_version 363713 (0.0006) [2023-12-26 02:30:20,911][123090] Updated weights for policy 1, policy_version 363723 (0.0006) [2023-12-26 02:30:20,979][123090] Updated weights for policy 1, policy_version 363733 (0.0005) [2023-12-26 02:30:21,053][123090] Updated weights for policy 1, policy_version 363743 (0.0009) [2023-12-26 02:30:21,341][123091] Updated weights for policy 0, policy_version 365848 (0.0010) [2023-12-26 02:30:21,414][123091] Updated weights for policy 0, policy_version 365858 (0.0007) [2023-12-26 02:30:21,473][123091] Updated weights for policy 0, policy_version 365868 (0.0005) [2023-12-26 02:30:21,853][123090] Updated weights for policy 1, policy_version 363753 (0.0010) [2023-12-26 02:30:21,926][123090] Updated weights for policy 1, policy_version 363763 (0.0011) [2023-12-26 02:30:21,990][123090] Updated weights for policy 1, policy_version 363773 (0.0010) [2023-12-26 02:30:22,329][123091] Updated weights for policy 0, policy_version 365878 (0.0008) [2023-12-26 02:30:22,404][123091] Updated weights for policy 0, policy_version 365888 (0.0009) [2023-12-26 02:30:22,474][123091] Updated weights for policy 0, policy_version 365898 (0.0008) [2023-12-26 02:30:22,795][123090] Updated weights for policy 1, policy_version 363783 (0.0007) [2023-12-26 02:30:22,859][123090] Updated weights for policy 1, policy_version 363793 (0.0009) [2023-12-26 02:30:22,915][123090] Updated weights for policy 1, policy_version 363803 (0.0010) [2023-12-26 02:30:23,243][123091] Updated weights for policy 0, policy_version 365908 (0.0009) [2023-12-26 02:30:23,293][123091] Updated weights for policy 0, policy_version 365918 (0.0008) [2023-12-26 02:30:23,346][123091] Updated weights for policy 0, policy_version 365928 (0.0009) [2023-12-26 02:30:23,733][123090] Updated weights for policy 1, policy_version 363813 (0.0010) [2023-12-26 02:30:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 186818560. Throughput: 0: 8910.0, 1: 8878.7. Samples: 186799064. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:23,785][121949] Avg episode reward: [(0, '6245.072'), (1, '6037.997')] [2023-12-26 02:30:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000365936_93683712.pth... [2023-12-26 02:30:23,795][123090] Updated weights for policy 1, policy_version 363823 (0.0010) [2023-12-26 02:30:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000364880_93413376.pth [2023-12-26 02:30:23,857][123090] Updated weights for policy 1, policy_version 363833 (0.0010) [2023-12-26 02:30:23,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000363840_93143040.pth... [2023-12-26 02:30:23,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000362784_92872704.pth [2023-12-26 02:30:24,210][123091] Updated weights for policy 0, policy_version 365938 (0.0007) [2023-12-26 02:30:24,262][123091] Updated weights for policy 0, policy_version 365948 (0.0005) [2023-12-26 02:30:24,316][123091] Updated weights for policy 0, policy_version 365958 (0.0006) [2023-12-26 02:30:24,365][123091] Updated weights for policy 0, policy_version 365968 (0.0009) [2023-12-26 02:30:24,689][123090] Updated weights for policy 1, policy_version 363843 (0.0010) [2023-12-26 02:30:24,751][123090] Updated weights for policy 1, policy_version 363853 (0.0010) [2023-12-26 02:30:24,816][123090] Updated weights for policy 1, policy_version 363863 (0.0010) [2023-12-26 02:30:25,144][123091] Updated weights for policy 0, policy_version 365978 (0.0009) [2023-12-26 02:30:25,209][123091] Updated weights for policy 0, policy_version 365988 (0.0005) [2023-12-26 02:30:25,258][123091] Updated weights for policy 0, policy_version 365998 (0.0005) [2023-12-26 02:30:25,632][123090] Updated weights for policy 1, policy_version 363873 (0.0010) [2023-12-26 02:30:25,695][123090] Updated weights for policy 1, policy_version 363883 (0.0010) [2023-12-26 02:30:25,768][123090] Updated weights for policy 1, policy_version 363893 (0.0010) [2023-12-26 02:30:25,838][123090] Updated weights for policy 1, policy_version 363903 (0.0010) [2023-12-26 02:30:26,077][123091] Updated weights for policy 0, policy_version 366008 (0.0009) [2023-12-26 02:30:26,147][123091] Updated weights for policy 0, policy_version 366018 (0.0011) [2023-12-26 02:30:26,223][123091] Updated weights for policy 0, policy_version 366028 (0.0006) [2023-12-26 02:30:26,516][123090] Updated weights for policy 1, policy_version 363913 (0.0010) [2023-12-26 02:30:26,567][123090] Updated weights for policy 1, policy_version 363923 (0.0010) [2023-12-26 02:30:26,625][123090] Updated weights for policy 1, policy_version 363933 (0.0010) [2023-12-26 02:30:26,900][123091] Updated weights for policy 0, policy_version 366038 (0.0007) [2023-12-26 02:30:26,963][123091] Updated weights for policy 0, policy_version 366048 (0.0008) [2023-12-26 02:30:27,028][123091] Updated weights for policy 0, policy_version 366058 (0.0008) [2023-12-26 02:30:27,434][123090] Updated weights for policy 1, policy_version 363943 (0.0010) [2023-12-26 02:30:27,489][123090] Updated weights for policy 1, policy_version 363953 (0.0010) [2023-12-26 02:30:27,536][123090] Updated weights for policy 1, policy_version 363963 (0.0010) [2023-12-26 02:30:27,774][123091] Updated weights for policy 0, policy_version 366068 (0.0009) [2023-12-26 02:30:27,828][123091] Updated weights for policy 0, policy_version 366078 (0.0008) [2023-12-26 02:30:27,879][123091] Updated weights for policy 0, policy_version 366088 (0.0008) [2023-12-26 02:30:28,370][123090] Updated weights for policy 1, policy_version 363973 (0.0009) [2023-12-26 02:30:28,429][123090] Updated weights for policy 1, policy_version 363983 (0.0007) [2023-12-26 02:30:28,503][123090] Updated weights for policy 1, policy_version 363993 (0.0011) [2023-12-26 02:30:28,698][123091] Updated weights for policy 0, policy_version 366098 (0.0009) [2023-12-26 02:30:28,762][123091] Updated weights for policy 0, policy_version 366108 (0.0009) [2023-12-26 02:30:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 186908672. Throughput: 0: 8922.4, 1: 8946.0. Samples: 186904744. Policy #0 lag: (min: 3.0, avg: 5.9, max: 35.0) [2023-12-26 02:30:28,785][121949] Avg episode reward: [(0, '6293.979'), (1, '6054.556')] [2023-12-26 02:30:28,820][123091] Updated weights for policy 0, policy_version 366118 (0.0009) [2023-12-26 02:30:28,877][123091] Updated weights for policy 0, policy_version 366128 (0.0010) [2023-12-26 02:30:29,190][123090] Updated weights for policy 1, policy_version 364003 (0.0010) [2023-12-26 02:30:29,266][123090] Updated weights for policy 1, policy_version 364013 (0.0010) [2023-12-26 02:30:29,337][123090] Updated weights for policy 1, policy_version 364023 (0.0010) [2023-12-26 02:30:29,729][123091] Updated weights for policy 0, policy_version 366138 (0.0009) [2023-12-26 02:30:29,785][123091] Updated weights for policy 0, policy_version 366148 (0.0009) [2023-12-26 02:30:29,841][123091] Updated weights for policy 0, policy_version 366158 (0.0009) [2023-12-26 02:30:30,169][123090] Updated weights for policy 1, policy_version 364033 (0.0010) [2023-12-26 02:30:30,231][123090] Updated weights for policy 1, policy_version 364043 (0.0009) [2023-12-26 02:30:30,288][123090] Updated weights for policy 1, policy_version 364053 (0.0009) [2023-12-26 02:30:30,351][123090] Updated weights for policy 1, policy_version 364063 (0.0009) [2023-12-26 02:30:30,710][123091] Updated weights for policy 0, policy_version 366168 (0.0009) [2023-12-26 02:30:30,768][123091] Updated weights for policy 0, policy_version 366178 (0.0007) [2023-12-26 02:30:30,823][123091] Updated weights for policy 0, policy_version 366188 (0.0006) [2023-12-26 02:30:31,181][123090] Updated weights for policy 1, policy_version 364073 (0.0008) [2023-12-26 02:30:31,256][123090] Updated weights for policy 1, policy_version 364083 (0.0007) [2023-12-26 02:30:31,317][123090] Updated weights for policy 1, policy_version 364093 (0.0008) [2023-12-26 02:30:31,637][123091] Updated weights for policy 0, policy_version 366198 (0.0009) [2023-12-26 02:30:31,694][123091] Updated weights for policy 0, policy_version 366208 (0.0009) [2023-12-26 02:30:31,762][123091] Updated weights for policy 0, policy_version 366218 (0.0009) [2023-12-26 02:30:32,021][123090] Updated weights for policy 1, policy_version 364103 (0.0008) [2023-12-26 02:30:32,069][123090] Updated weights for policy 1, policy_version 364113 (0.0008) [2023-12-26 02:30:32,128][123090] Updated weights for policy 1, policy_version 364123 (0.0010) [2023-12-26 02:30:32,564][123091] Updated weights for policy 0, policy_version 366228 (0.0008) [2023-12-26 02:30:32,622][123091] Updated weights for policy 0, policy_version 366238 (0.0005) [2023-12-26 02:30:32,678][123091] Updated weights for policy 0, policy_version 366248 (0.0005) [2023-12-26 02:30:33,025][123090] Updated weights for policy 1, policy_version 364134 (0.0009) [2023-12-26 02:30:33,074][123090] Updated weights for policy 1, policy_version 364144 (0.0009) [2023-12-26 02:30:33,134][123090] Updated weights for policy 1, policy_version 364154 (0.0009) [2023-12-26 02:30:33,432][123091] Updated weights for policy 0, policy_version 366258 (0.0006) [2023-12-26 02:30:33,485][123091] Updated weights for policy 0, policy_version 366268 (0.0010) [2023-12-26 02:30:33,533][123091] Updated weights for policy 0, policy_version 366278 (0.0010) [2023-12-26 02:30:33,584][123091] Updated weights for policy 0, policy_version 366288 (0.0010) [2023-12-26 02:30:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 186998784. Throughput: 0: 8904.2, 1: 8920.0. Samples: 187010172. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:33,785][121949] Avg episode reward: [(0, '6315.803'), (1, '6046.163')] [2023-12-26 02:30:33,943][123090] Updated weights for policy 1, policy_version 364164 (0.0009) [2023-12-26 02:30:34,001][123090] Updated weights for policy 1, policy_version 364174 (0.0010) [2023-12-26 02:30:34,053][123090] Updated weights for policy 1, policy_version 364184 (0.0009) [2023-12-26 02:30:34,382][123091] Updated weights for policy 0, policy_version 366298 (0.0006) [2023-12-26 02:30:34,446][123091] Updated weights for policy 0, policy_version 366308 (0.0011) [2023-12-26 02:30:34,506][123091] Updated weights for policy 0, policy_version 366318 (0.0011) [2023-12-26 02:30:34,936][123090] Updated weights for policy 1, policy_version 364194 (0.0009) [2023-12-26 02:30:35,006][123090] Updated weights for policy 1, policy_version 364204 (0.0009) [2023-12-26 02:30:35,068][123090] Updated weights for policy 1, policy_version 364214 (0.0010) [2023-12-26 02:30:35,127][123090] Updated weights for policy 1, policy_version 364224 (0.0010) [2023-12-26 02:30:35,233][123091] Updated weights for policy 0, policy_version 366328 (0.0008) [2023-12-26 02:30:35,287][123091] Updated weights for policy 0, policy_version 366338 (0.0010) [2023-12-26 02:30:35,331][123091] Updated weights for policy 0, policy_version 366348 (0.0010) [2023-12-26 02:30:35,962][123090] Updated weights for policy 1, policy_version 364234 (0.0009) [2023-12-26 02:30:36,015][123090] Updated weights for policy 1, policy_version 364244 (0.0010) [2023-12-26 02:30:36,076][123090] Updated weights for policy 1, policy_version 364254 (0.0009) [2023-12-26 02:30:36,139][123091] Updated weights for policy 0, policy_version 366358 (0.0008) [2023-12-26 02:30:36,197][123091] Updated weights for policy 0, policy_version 366368 (0.0009) [2023-12-26 02:30:36,246][123091] Updated weights for policy 0, policy_version 366378 (0.0009) [2023-12-26 02:30:36,875][123090] Updated weights for policy 1, policy_version 364264 (0.0006) [2023-12-26 02:30:36,941][123090] Updated weights for policy 1, policy_version 364274 (0.0005) [2023-12-26 02:30:37,012][123090] Updated weights for policy 1, policy_version 364284 (0.0005) [2023-12-26 02:30:37,157][123091] Updated weights for policy 0, policy_version 366388 (0.0008) [2023-12-26 02:30:37,210][123091] Updated weights for policy 0, policy_version 366398 (0.0005) [2023-12-26 02:30:37,282][123091] Updated weights for policy 0, policy_version 366408 (0.0006) [2023-12-26 02:30:37,798][123090] Updated weights for policy 1, policy_version 364294 (0.0010) [2023-12-26 02:30:37,870][123090] Updated weights for policy 1, policy_version 364304 (0.0009) [2023-12-26 02:30:37,940][123090] Updated weights for policy 1, policy_version 364314 (0.0010) [2023-12-26 02:30:38,089][123091] Updated weights for policy 0, policy_version 366418 (0.0008) [2023-12-26 02:30:38,137][123091] Updated weights for policy 0, policy_version 366428 (0.0009) [2023-12-26 02:30:38,196][123091] Updated weights for policy 0, policy_version 366438 (0.0008) [2023-12-26 02:30:38,250][123091] Updated weights for policy 0, policy_version 366448 (0.0009) [2023-12-26 02:30:38,700][123090] Updated weights for policy 1, policy_version 364324 (0.0010) [2023-12-26 02:30:38,762][123090] Updated weights for policy 1, policy_version 364334 (0.0009) [2023-12-26 02:30:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 187080704. Throughput: 0: 8950.6, 1: 8863.6. Samples: 187062200. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:38,784][121949] Avg episode reward: [(0, '6079.461'), (1, '5975.786')] [2023-12-26 02:30:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000366448_93814784.pth... [2023-12-26 02:30:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000365424_93552640.pth [2023-12-26 02:30:38,826][123090] Updated weights for policy 1, policy_version 364344 (0.0009) [2023-12-26 02:30:38,875][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000364352_93274112.pth... [2023-12-26 02:30:38,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000363296_93003776.pth [2023-12-26 02:30:39,056][123091] Updated weights for policy 0, policy_version 366458 (0.0010) [2023-12-26 02:30:39,106][123091] Updated weights for policy 0, policy_version 366468 (0.0009) [2023-12-26 02:30:39,165][123091] Updated weights for policy 0, policy_version 366478 (0.0008) [2023-12-26 02:30:39,685][123090] Updated weights for policy 1, policy_version 364354 (0.0009) [2023-12-26 02:30:39,754][123090] Updated weights for policy 1, policy_version 364364 (0.0006) [2023-12-26 02:30:39,828][123090] Updated weights for policy 1, policy_version 364374 (0.0007) [2023-12-26 02:30:40,090][123091] Updated weights for policy 0, policy_version 366488 (0.0009) [2023-12-26 02:30:40,166][123091] Updated weights for policy 0, policy_version 366498 (0.0006) [2023-12-26 02:30:40,242][123091] Updated weights for policy 0, policy_version 366508 (0.0009) [2023-12-26 02:30:40,587][123090] Updated weights for policy 1, policy_version 364385 (0.0010) [2023-12-26 02:30:40,661][123090] Updated weights for policy 1, policy_version 364395 (0.0008) [2023-12-26 02:30:40,731][123090] Updated weights for policy 1, policy_version 364405 (0.0009) [2023-12-26 02:30:40,784][123090] Updated weights for policy 1, policy_version 364415 (0.0009) [2023-12-26 02:30:40,999][123091] Updated weights for policy 0, policy_version 366518 (0.0008) [2023-12-26 02:30:41,070][123091] Updated weights for policy 0, policy_version 366528 (0.0010) [2023-12-26 02:30:41,143][123091] Updated weights for policy 0, policy_version 366538 (0.0009) [2023-12-26 02:30:41,606][123090] Updated weights for policy 1, policy_version 364425 (0.0009) [2023-12-26 02:30:41,666][123090] Updated weights for policy 1, policy_version 364435 (0.0007) [2023-12-26 02:30:41,733][123090] Updated weights for policy 1, policy_version 364445 (0.0008) [2023-12-26 02:30:41,990][123091] Updated weights for policy 0, policy_version 366548 (0.0008) [2023-12-26 02:30:42,054][123091] Updated weights for policy 0, policy_version 366558 (0.0006) [2023-12-26 02:30:42,115][123091] Updated weights for policy 0, policy_version 366568 (0.0010) [2023-12-26 02:30:42,525][123090] Updated weights for policy 1, policy_version 364455 (0.0007) [2023-12-26 02:30:42,594][123090] Updated weights for policy 1, policy_version 364465 (0.0005) [2023-12-26 02:30:42,670][123090] Updated weights for policy 1, policy_version 364475 (0.0006) [2023-12-26 02:30:42,903][123091] Updated weights for policy 0, policy_version 366578 (0.0009) [2023-12-26 02:30:42,975][123091] Updated weights for policy 0, policy_version 366588 (0.0009) [2023-12-26 02:30:43,048][123091] Updated weights for policy 0, policy_version 366598 (0.0009) [2023-12-26 02:30:43,117][123091] Updated weights for policy 0, policy_version 366608 (0.0009) [2023-12-26 02:30:43,359][123090] Updated weights for policy 1, policy_version 364485 (0.0006) [2023-12-26 02:30:43,419][123090] Updated weights for policy 1, policy_version 364495 (0.0006) [2023-12-26 02:30:43,482][123090] Updated weights for policy 1, policy_version 364505 (0.0009) [2023-12-26 02:30:43,774][123091] Updated weights for policy 0, policy_version 366618 (0.0011) [2023-12-26 02:30:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 187170816. Throughput: 0: 8871.2, 1: 8799.3. Samples: 187165932. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:43,785][121949] Avg episode reward: [(0, '6121.801'), (1, '5961.259')] [2023-12-26 02:30:43,845][123091] Updated weights for policy 0, policy_version 366628 (0.0011) [2023-12-26 02:30:43,916][123091] Updated weights for policy 0, policy_version 366638 (0.0011) [2023-12-26 02:30:44,294][123090] Updated weights for policy 1, policy_version 364515 (0.0010) [2023-12-26 02:30:44,345][123090] Updated weights for policy 1, policy_version 364525 (0.0010) [2023-12-26 02:30:44,396][123090] Updated weights for policy 1, policy_version 364535 (0.0010) [2023-12-26 02:30:44,611][123091] Updated weights for policy 0, policy_version 366648 (0.0011) [2023-12-26 02:30:44,655][123091] Updated weights for policy 0, policy_version 366658 (0.0010) [2023-12-26 02:30:44,710][123091] Updated weights for policy 0, policy_version 366668 (0.0011) [2023-12-26 02:30:45,226][123090] Updated weights for policy 1, policy_version 364545 (0.0010) [2023-12-26 02:30:45,298][123090] Updated weights for policy 1, policy_version 364555 (0.0009) [2023-12-26 02:30:45,362][123090] Updated weights for policy 1, policy_version 364565 (0.0007) [2023-12-26 02:30:45,428][123090] Updated weights for policy 1, policy_version 364575 (0.0008) [2023-12-26 02:30:45,538][123091] Updated weights for policy 0, policy_version 366678 (0.0007) [2023-12-26 02:30:45,597][123091] Updated weights for policy 0, policy_version 366688 (0.0006) [2023-12-26 02:30:45,666][123091] Updated weights for policy 0, policy_version 366698 (0.0005) [2023-12-26 02:30:46,172][123090] Updated weights for policy 1, policy_version 364585 (0.0008) [2023-12-26 02:30:46,234][123090] Updated weights for policy 1, policy_version 364595 (0.0006) [2023-12-26 02:30:46,283][123091] Updated weights for policy 0, policy_version 366708 (0.0005) [2023-12-26 02:30:46,298][123090] Updated weights for policy 1, policy_version 364605 (0.0007) [2023-12-26 02:30:46,327][123091] Updated weights for policy 0, policy_version 366718 (0.0005) [2023-12-26 02:30:46,396][123091] Updated weights for policy 0, policy_version 366728 (0.0005) [2023-12-26 02:30:47,048][123090] Updated weights for policy 1, policy_version 364615 (0.0008) [2023-12-26 02:30:47,063][123091] Updated weights for policy 0, policy_version 366738 (0.0006) [2023-12-26 02:30:47,101][123090] Updated weights for policy 1, policy_version 364625 (0.0005) [2023-12-26 02:30:47,122][123091] Updated weights for policy 0, policy_version 366748 (0.0010) [2023-12-26 02:30:47,152][123090] Updated weights for policy 1, policy_version 364635 (0.0009) [2023-12-26 02:30:47,179][123091] Updated weights for policy 0, policy_version 366758 (0.0008) [2023-12-26 02:30:47,247][123091] Updated weights for policy 0, policy_version 366768 (0.0005) [2023-12-26 02:30:47,944][123090] Updated weights for policy 1, policy_version 364645 (0.0010) [2023-12-26 02:30:47,974][123091] Updated weights for policy 0, policy_version 366778 (0.0010) [2023-12-26 02:30:48,003][123090] Updated weights for policy 1, policy_version 364655 (0.0010) [2023-12-26 02:30:48,040][123091] Updated weights for policy 0, policy_version 366788 (0.0010) [2023-12-26 02:30:48,063][123090] Updated weights for policy 1, policy_version 364665 (0.0010) [2023-12-26 02:30:48,103][123091] Updated weights for policy 0, policy_version 366798 (0.0011) [2023-12-26 02:30:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 187260928. Throughput: 0: 8948.8, 1: 8801.5. Samples: 187276360. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:48,785][121949] Avg episode reward: [(0, '6167.351'), (1, '5889.319')] [2023-12-26 02:30:48,865][123090] Updated weights for policy 1, policy_version 364675 (0.0009) [2023-12-26 02:30:48,934][123090] Updated weights for policy 1, policy_version 364685 (0.0008) [2023-12-26 02:30:48,942][123091] Updated weights for policy 0, policy_version 366808 (0.0008) [2023-12-26 02:30:48,995][123090] Updated weights for policy 1, policy_version 364695 (0.0010) [2023-12-26 02:30:48,998][123091] Updated weights for policy 0, policy_version 366818 (0.0008) [2023-12-26 02:30:49,051][123091] Updated weights for policy 0, policy_version 366828 (0.0006) [2023-12-26 02:30:49,814][123090] Updated weights for policy 1, policy_version 364705 (0.0011) [2023-12-26 02:30:49,889][123090] Updated weights for policy 1, policy_version 364715 (0.0008) [2023-12-26 02:30:49,921][123091] Updated weights for policy 0, policy_version 366838 (0.0010) [2023-12-26 02:30:49,958][123090] Updated weights for policy 1, policy_version 364725 (0.0007) [2023-12-26 02:30:49,989][123091] Updated weights for policy 0, policy_version 366848 (0.0010) [2023-12-26 02:30:50,022][123090] Updated weights for policy 1, policy_version 364735 (0.0006) [2023-12-26 02:30:50,058][123091] Updated weights for policy 0, policy_version 366858 (0.0011) [2023-12-26 02:30:50,831][123090] Updated weights for policy 1, policy_version 364745 (0.0009) [2023-12-26 02:30:50,888][123091] Updated weights for policy 0, policy_version 366868 (0.0011) [2023-12-26 02:30:50,895][123090] Updated weights for policy 1, policy_version 364755 (0.0008) [2023-12-26 02:30:50,952][123091] Updated weights for policy 0, policy_version 366878 (0.0011) [2023-12-26 02:30:50,959][123090] Updated weights for policy 1, policy_version 364765 (0.0006) [2023-12-26 02:30:51,016][123091] Updated weights for policy 0, policy_version 366888 (0.0011) [2023-12-26 02:30:51,748][123090] Updated weights for policy 1, policy_version 364775 (0.0008) [2023-12-26 02:30:51,818][123090] Updated weights for policy 1, policy_version 364785 (0.0011) [2023-12-26 02:30:51,849][123091] Updated weights for policy 0, policy_version 366898 (0.0011) [2023-12-26 02:30:51,882][123090] Updated weights for policy 1, policy_version 364795 (0.0007) [2023-12-26 02:30:51,914][123091] Updated weights for policy 0, policy_version 366908 (0.0009) [2023-12-26 02:30:51,977][123091] Updated weights for policy 0, policy_version 366918 (0.0008) [2023-12-26 02:30:52,042][123091] Updated weights for policy 0, policy_version 366928 (0.0010) [2023-12-26 02:30:52,683][123090] Updated weights for policy 1, policy_version 364805 (0.0009) [2023-12-26 02:30:52,742][123090] Updated weights for policy 1, policy_version 364815 (0.0010) [2023-12-26 02:30:52,810][123090] Updated weights for policy 1, policy_version 364825 (0.0011) [2023-12-26 02:30:52,843][123091] Updated weights for policy 0, policy_version 366938 (0.0008) [2023-12-26 02:30:52,916][123091] Updated weights for policy 0, policy_version 366948 (0.0006) [2023-12-26 02:30:52,984][123091] Updated weights for policy 0, policy_version 366958 (0.0008) [2023-12-26 02:30:53,624][123090] Updated weights for policy 1, policy_version 364835 (0.0010) [2023-12-26 02:30:53,640][123091] Updated weights for policy 0, policy_version 366968 (0.0007) [2023-12-26 02:30:53,688][123090] Updated weights for policy 1, policy_version 364845 (0.0011) [2023-12-26 02:30:53,690][123091] Updated weights for policy 0, policy_version 366978 (0.0008) [2023-12-26 02:30:53,739][123091] Updated weights for policy 0, policy_version 366988 (0.0008) [2023-12-26 02:30:53,756][123090] Updated weights for policy 1, policy_version 364855 (0.0010) [2023-12-26 02:30:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 187351040. Throughput: 0: 8865.7, 1: 8790.9. Samples: 187327492. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:53,785][121949] Avg episode reward: [(0, '6058.661'), (1, '5837.436')] [2023-12-26 02:30:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000366992_93954048.pth... [2023-12-26 02:30:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000365936_93683712.pth [2023-12-26 02:30:53,813][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000364864_93405184.pth... [2023-12-26 02:30:53,819][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000363840_93143040.pth [2023-12-26 02:30:54,531][123091] Updated weights for policy 0, policy_version 366998 (0.0010) [2023-12-26 02:30:54,567][123090] Updated weights for policy 1, policy_version 364865 (0.0010) [2023-12-26 02:30:54,595][123091] Updated weights for policy 0, policy_version 367008 (0.0011) [2023-12-26 02:30:54,626][123090] Updated weights for policy 1, policy_version 364875 (0.0010) [2023-12-26 02:30:54,660][123091] Updated weights for policy 0, policy_version 367018 (0.0011) [2023-12-26 02:30:54,678][123090] Updated weights for policy 1, policy_version 364885 (0.0010) [2023-12-26 02:30:54,739][123090] Updated weights for policy 1, policy_version 364895 (0.0010) [2023-12-26 02:30:55,375][123091] Updated weights for policy 0, policy_version 367028 (0.0009) [2023-12-26 02:30:55,432][123091] Updated weights for policy 0, policy_version 367038 (0.0005) [2023-12-26 02:30:55,481][123091] Updated weights for policy 0, policy_version 367048 (0.0005) [2023-12-26 02:30:55,541][123090] Updated weights for policy 1, policy_version 364905 (0.0010) [2023-12-26 02:30:55,600][123090] Updated weights for policy 1, policy_version 364915 (0.0010) [2023-12-26 02:30:55,666][123090] Updated weights for policy 1, policy_version 364925 (0.0010) [2023-12-26 02:30:56,189][123091] Updated weights for policy 0, policy_version 367058 (0.0005) [2023-12-26 02:30:56,263][123091] Updated weights for policy 0, policy_version 367068 (0.0006) [2023-12-26 02:30:56,328][123091] Updated weights for policy 0, policy_version 367078 (0.0006) [2023-12-26 02:30:56,404][123091] Updated weights for policy 0, policy_version 367088 (0.0009) [2023-12-26 02:30:56,451][123090] Updated weights for policy 1, policy_version 364935 (0.0009) [2023-12-26 02:30:56,518][123090] Updated weights for policy 1, policy_version 364945 (0.0005) [2023-12-26 02:30:56,587][123090] Updated weights for policy 1, policy_version 364955 (0.0006) [2023-12-26 02:30:57,134][123091] Updated weights for policy 0, policy_version 367098 (0.0010) [2023-12-26 02:30:57,193][123091] Updated weights for policy 0, policy_version 367108 (0.0010) [2023-12-26 02:30:57,240][123091] Updated weights for policy 0, policy_version 367118 (0.0010) [2023-12-26 02:30:57,378][123090] Updated weights for policy 1, policy_version 364965 (0.0008) [2023-12-26 02:30:57,441][123090] Updated weights for policy 1, policy_version 364975 (0.0010) [2023-12-26 02:30:57,503][123090] Updated weights for policy 1, policy_version 364985 (0.0008) [2023-12-26 02:30:58,088][123091] Updated weights for policy 0, policy_version 367128 (0.0010) [2023-12-26 02:30:58,152][123091] Updated weights for policy 0, policy_version 367138 (0.0011) [2023-12-26 02:30:58,226][123091] Updated weights for policy 0, policy_version 367148 (0.0010) [2023-12-26 02:30:58,309][123090] Updated weights for policy 1, policy_version 364995 (0.0007) [2023-12-26 02:30:58,409][123090] Updated weights for policy 1, policy_version 365005 (0.0010) [2023-12-26 02:30:58,477][123090] Updated weights for policy 1, policy_version 365015 (0.0008) [2023-12-26 02:30:58,785][121949] Fps is (10 sec: 18020.7, 60 sec: 17749.1, 300 sec: 17800.2). Total num frames: 187441152. Throughput: 0: 8916.6, 1: 8806.3. Samples: 187434716. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:30:58,786][121949] Avg episode reward: [(0, '6130.659'), (1, '5725.047')] [2023-12-26 02:30:59,210][123091] Updated weights for policy 0, policy_version 367158 (0.0009) [2023-12-26 02:30:59,283][123091] Updated weights for policy 0, policy_version 367168 (0.0010) [2023-12-26 02:30:59,359][123091] Updated weights for policy 0, policy_version 367178 (0.0010) [2023-12-26 02:30:59,386][123090] Updated weights for policy 1, policy_version 365025 (0.0007) [2023-12-26 02:30:59,462][123090] Updated weights for policy 1, policy_version 365035 (0.0008) [2023-12-26 02:30:59,532][123090] Updated weights for policy 1, policy_version 365045 (0.0009) [2023-12-26 02:30:59,581][123090] Updated weights for policy 1, policy_version 365055 (0.0009) [2023-12-26 02:31:00,208][123091] Updated weights for policy 0, policy_version 367188 (0.0007) [2023-12-26 02:31:00,280][123091] Updated weights for policy 0, policy_version 367198 (0.0006) [2023-12-26 02:31:00,355][123091] Updated weights for policy 0, policy_version 367208 (0.0006) [2023-12-26 02:31:00,408][123090] Updated weights for policy 1, policy_version 365065 (0.0006) [2023-12-26 02:31:00,484][123090] Updated weights for policy 1, policy_version 365075 (0.0006) [2023-12-26 02:31:00,561][123090] Updated weights for policy 1, policy_version 365085 (0.0010) [2023-12-26 02:31:01,062][123091] Updated weights for policy 0, policy_version 367218 (0.0006) [2023-12-26 02:31:01,121][123091] Updated weights for policy 0, policy_version 367228 (0.0008) [2023-12-26 02:31:01,191][123091] Updated weights for policy 0, policy_version 367238 (0.0008) [2023-12-26 02:31:01,252][123091] Updated weights for policy 0, policy_version 367248 (0.0008) [2023-12-26 02:31:01,334][123090] Updated weights for policy 1, policy_version 365095 (0.0007) [2023-12-26 02:31:01,408][123090] Updated weights for policy 1, policy_version 365105 (0.0008) [2023-12-26 02:31:01,485][123090] Updated weights for policy 1, policy_version 365115 (0.0010) [2023-12-26 02:31:02,101][123091] Updated weights for policy 0, policy_version 367258 (0.0010) [2023-12-26 02:31:02,162][123091] Updated weights for policy 0, policy_version 367268 (0.0007) [2023-12-26 02:31:02,200][123090] Updated weights for policy 1, policy_version 365125 (0.0011) [2023-12-26 02:31:02,219][123091] Updated weights for policy 0, policy_version 367278 (0.0005) [2023-12-26 02:31:02,266][123090] Updated weights for policy 1, policy_version 365135 (0.0010) [2023-12-26 02:31:02,325][123090] Updated weights for policy 1, policy_version 365145 (0.0010) [2023-12-26 02:31:02,951][123091] Updated weights for policy 0, policy_version 367288 (0.0007) [2023-12-26 02:31:03,020][123091] Updated weights for policy 0, policy_version 367298 (0.0007) [2023-12-26 02:31:03,091][123091] Updated weights for policy 0, policy_version 367308 (0.0006) [2023-12-26 02:31:03,169][123090] Updated weights for policy 1, policy_version 365155 (0.0010) [2023-12-26 02:31:03,222][123090] Updated weights for policy 1, policy_version 365165 (0.0011) [2023-12-26 02:31:03,276][123090] Updated weights for policy 1, policy_version 365175 (0.0011) [2023-12-26 02:31:03,675][123091] Updated weights for policy 0, policy_version 367318 (0.0006) [2023-12-26 02:31:03,727][123091] Updated weights for policy 0, policy_version 367328 (0.0006) [2023-12-26 02:31:03,784][123091] Updated weights for policy 0, policy_version 367338 (0.0006) [2023-12-26 02:31:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 187523072. Throughput: 0: 8842.9, 1: 8723.2. Samples: 187538140. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:03,785][121949] Avg episode reward: [(0, '6169.911'), (1, '5668.705')] [2023-12-26 02:31:04,154][123090] Updated weights for policy 1, policy_version 365185 (0.0011) [2023-12-26 02:31:04,223][123090] Updated weights for policy 1, policy_version 365195 (0.0011) [2023-12-26 02:31:04,279][123090] Updated weights for policy 1, policy_version 365205 (0.0010) [2023-12-26 02:31:04,336][123090] Updated weights for policy 1, policy_version 365215 (0.0011) [2023-12-26 02:31:04,633][123091] Updated weights for policy 0, policy_version 367348 (0.0007) [2023-12-26 02:31:04,701][123091] Updated weights for policy 0, policy_version 367358 (0.0010) [2023-12-26 02:31:04,765][123091] Updated weights for policy 0, policy_version 367368 (0.0011) [2023-12-26 02:31:05,189][123090] Updated weights for policy 1, policy_version 365225 (0.0011) [2023-12-26 02:31:05,256][123090] Updated weights for policy 1, policy_version 365235 (0.0011) [2023-12-26 02:31:05,311][123090] Updated weights for policy 1, policy_version 365245 (0.0010) [2023-12-26 02:31:05,551][123091] Updated weights for policy 0, policy_version 367378 (0.0010) [2023-12-26 02:31:05,600][123091] Updated weights for policy 0, policy_version 367388 (0.0005) [2023-12-26 02:31:05,674][123091] Updated weights for policy 0, policy_version 367398 (0.0005) [2023-12-26 02:31:05,734][123091] Updated weights for policy 0, policy_version 367408 (0.0005) [2023-12-26 02:31:06,119][123090] Updated weights for policy 1, policy_version 365255 (0.0011) [2023-12-26 02:31:06,186][123090] Updated weights for policy 1, policy_version 365265 (0.0011) [2023-12-26 02:31:06,259][123090] Updated weights for policy 1, policy_version 365275 (0.0010) [2023-12-26 02:31:06,460][123091] Updated weights for policy 0, policy_version 367418 (0.0011) [2023-12-26 02:31:06,532][123091] Updated weights for policy 0, policy_version 367428 (0.0011) [2023-12-26 02:31:06,588][123091] Updated weights for policy 0, policy_version 367438 (0.0011) [2023-12-26 02:31:07,101][123090] Updated weights for policy 1, policy_version 365285 (0.0009) [2023-12-26 02:31:07,157][123090] Updated weights for policy 1, policy_version 365295 (0.0010) [2023-12-26 02:31:07,213][123090] Updated weights for policy 1, policy_version 365305 (0.0010) [2023-12-26 02:31:07,266][123091] Updated weights for policy 0, policy_version 367448 (0.0007) [2023-12-26 02:31:07,341][123091] Updated weights for policy 0, policy_version 367458 (0.0005) [2023-12-26 02:31:07,408][123091] Updated weights for policy 0, policy_version 367468 (0.0005) [2023-12-26 02:31:07,891][123090] Updated weights for policy 1, policy_version 365315 (0.0010) [2023-12-26 02:31:07,946][123090] Updated weights for policy 1, policy_version 365325 (0.0010) [2023-12-26 02:31:07,999][123090] Updated weights for policy 1, policy_version 365335 (0.0010) [2023-12-26 02:31:08,107][123091] Updated weights for policy 0, policy_version 367478 (0.0009) [2023-12-26 02:31:08,175][123091] Updated weights for policy 0, policy_version 367488 (0.0010) [2023-12-26 02:31:08,239][123091] Updated weights for policy 0, policy_version 367498 (0.0006) [2023-12-26 02:31:08,769][123090] Updated weights for policy 1, policy_version 365345 (0.0010) [2023-12-26 02:31:08,784][121949] Fps is (10 sec: 17204.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 187613184. Throughput: 0: 8899.4, 1: 8690.8. Samples: 187590620. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:08,785][121949] Avg episode reward: [(0, '6249.961'), (1, '5650.002')] [2023-12-26 02:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000367504_94085120.pth... [2023-12-26 02:31:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000366448_93814784.pth [2023-12-26 02:31:08,836][123090] Updated weights for policy 1, policy_version 365355 (0.0009) [2023-12-26 02:31:08,887][123090] Updated weights for policy 1, policy_version 365365 (0.0010) [2023-12-26 02:31:08,946][123090] Updated weights for policy 1, policy_version 365375 (0.0011) [2023-12-26 02:31:08,952][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000365376_93536256.pth... [2023-12-26 02:31:08,957][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000364352_93274112.pth [2023-12-26 02:31:09,017][123091] Updated weights for policy 0, policy_version 367508 (0.0007) [2023-12-26 02:31:09,075][123091] Updated weights for policy 0, policy_version 367518 (0.0006) [2023-12-26 02:31:09,129][123091] Updated weights for policy 0, policy_version 367528 (0.0006) [2023-12-26 02:31:09,822][123090] Updated weights for policy 1, policy_version 365385 (0.0009) [2023-12-26 02:31:09,891][123090] Updated weights for policy 1, policy_version 365395 (0.0009) [2023-12-26 02:31:09,961][123090] Updated weights for policy 1, policy_version 365405 (0.0009) [2023-12-26 02:31:09,981][123091] Updated weights for policy 0, policy_version 367538 (0.0006) [2023-12-26 02:31:10,054][123091] Updated weights for policy 0, policy_version 367548 (0.0007) [2023-12-26 02:31:10,115][123091] Updated weights for policy 0, policy_version 367558 (0.0007) [2023-12-26 02:31:10,171][123091] Updated weights for policy 0, policy_version 367568 (0.0007) [2023-12-26 02:31:10,780][123090] Updated weights for policy 1, policy_version 365415 (0.0009) [2023-12-26 02:31:10,840][123090] Updated weights for policy 1, policy_version 365425 (0.0009) [2023-12-26 02:31:10,888][123091] Updated weights for policy 0, policy_version 367578 (0.0007) [2023-12-26 02:31:10,900][123090] Updated weights for policy 1, policy_version 365435 (0.0008) [2023-12-26 02:31:10,947][123091] Updated weights for policy 0, policy_version 367588 (0.0005) [2023-12-26 02:31:11,017][123091] Updated weights for policy 0, policy_version 367598 (0.0007) [2023-12-26 02:31:11,778][123090] Updated weights for policy 1, policy_version 365445 (0.0008) [2023-12-26 02:31:11,846][123090] Updated weights for policy 1, policy_version 365455 (0.0009) [2023-12-26 02:31:11,890][123091] Updated weights for policy 0, policy_version 367608 (0.0008) [2023-12-26 02:31:11,913][123090] Updated weights for policy 1, policy_version 365465 (0.0009) [2023-12-26 02:31:11,960][123091] Updated weights for policy 0, policy_version 367618 (0.0007) [2023-12-26 02:31:12,028][123091] Updated weights for policy 0, policy_version 367628 (0.0010) [2023-12-26 02:31:12,655][123090] Updated weights for policy 1, policy_version 365475 (0.0009) [2023-12-26 02:31:12,717][123090] Updated weights for policy 1, policy_version 365485 (0.0005) [2023-12-26 02:31:12,776][123090] Updated weights for policy 1, policy_version 365495 (0.0005) [2023-12-26 02:31:12,904][123091] Updated weights for policy 0, policy_version 367638 (0.0009) [2023-12-26 02:31:12,961][123091] Updated weights for policy 0, policy_version 367648 (0.0009) [2023-12-26 02:31:13,034][123091] Updated weights for policy 0, policy_version 367658 (0.0009) [2023-12-26 02:31:13,468][123090] Updated weights for policy 1, policy_version 365505 (0.0007) [2023-12-26 02:31:13,531][123090] Updated weights for policy 1, policy_version 365515 (0.0011) [2023-12-26 02:31:13,586][123090] Updated weights for policy 1, policy_version 365525 (0.0008) [2023-12-26 02:31:13,636][123090] Updated weights for policy 1, policy_version 365535 (0.0005) [2023-12-26 02:31:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 187703296. Throughput: 0: 8909.0, 1: 8701.6. Samples: 187697220. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:13,785][121949] Avg episode reward: [(0, '6177.731'), (1, '5709.078')] [2023-12-26 02:31:13,923][123091] Updated weights for policy 0, policy_version 367668 (0.0010) [2023-12-26 02:31:13,976][123091] Updated weights for policy 0, policy_version 367678 (0.0009) [2023-12-26 02:31:14,037][123091] Updated weights for policy 0, policy_version 367688 (0.0010) [2023-12-26 02:31:14,406][123090] Updated weights for policy 1, policy_version 365545 (0.0009) [2023-12-26 02:31:14,461][123090] Updated weights for policy 1, policy_version 365555 (0.0007) [2023-12-26 02:31:14,530][123090] Updated weights for policy 1, policy_version 365565 (0.0008) [2023-12-26 02:31:14,914][123091] Updated weights for policy 0, policy_version 367698 (0.0010) [2023-12-26 02:31:14,970][123091] Updated weights for policy 0, policy_version 367708 (0.0009) [2023-12-26 02:31:15,031][123091] Updated weights for policy 0, policy_version 367718 (0.0010) [2023-12-26 02:31:15,085][123091] Updated weights for policy 0, policy_version 367728 (0.0010) [2023-12-26 02:31:15,366][123090] Updated weights for policy 1, policy_version 365575 (0.0009) [2023-12-26 02:31:15,435][123090] Updated weights for policy 1, policy_version 365585 (0.0006) [2023-12-26 02:31:15,506][123090] Updated weights for policy 1, policy_version 365595 (0.0008) [2023-12-26 02:31:15,998][123091] Updated weights for policy 0, policy_version 367738 (0.0009) [2023-12-26 02:31:16,050][123091] Updated weights for policy 0, policy_version 367748 (0.0009) [2023-12-26 02:31:16,102][123091] Updated weights for policy 0, policy_version 367758 (0.0009) [2023-12-26 02:31:16,206][123090] Updated weights for policy 1, policy_version 365605 (0.0008) [2023-12-26 02:31:16,276][123090] Updated weights for policy 1, policy_version 365615 (0.0010) [2023-12-26 02:31:16,338][123090] Updated weights for policy 1, policy_version 365625 (0.0010) [2023-12-26 02:31:17,001][123091] Updated weights for policy 0, policy_version 367768 (0.0009) [2023-12-26 02:31:17,015][123090] Updated weights for policy 1, policy_version 365635 (0.0010) [2023-12-26 02:31:17,063][123091] Updated weights for policy 0, policy_version 367778 (0.0008) [2023-12-26 02:31:17,080][123090] Updated weights for policy 1, policy_version 365645 (0.0008) [2023-12-26 02:31:17,139][123091] Updated weights for policy 0, policy_version 367788 (0.0009) [2023-12-26 02:31:17,151][123090] Updated weights for policy 1, policy_version 365655 (0.0008) [2023-12-26 02:31:17,844][123090] Updated weights for policy 1, policy_version 365665 (0.0009) [2023-12-26 02:31:17,904][123090] Updated weights for policy 1, policy_version 365675 (0.0009) [2023-12-26 02:31:17,958][123091] Updated weights for policy 0, policy_version 367798 (0.0009) [2023-12-26 02:31:17,970][123090] Updated weights for policy 1, policy_version 365685 (0.0006) [2023-12-26 02:31:18,018][123091] Updated weights for policy 0, policy_version 367808 (0.0008) [2023-12-26 02:31:18,040][123090] Updated weights for policy 1, policy_version 365695 (0.0005) [2023-12-26 02:31:18,084][123091] Updated weights for policy 0, policy_version 367818 (0.0008) [2023-12-26 02:31:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 187785216. Throughput: 0: 8839.6, 1: 8762.9. Samples: 187802280. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:18,785][121949] Avg episode reward: [(0, '6087.943'), (1, '5760.021')] [2023-12-26 02:31:18,817][123090] Updated weights for policy 1, policy_version 365705 (0.0006) [2023-12-26 02:31:18,865][123090] Updated weights for policy 1, policy_version 365715 (0.0005) [2023-12-26 02:31:18,912][123090] Updated weights for policy 1, policy_version 365725 (0.0005) [2023-12-26 02:31:18,947][123091] Updated weights for policy 0, policy_version 367828 (0.0010) [2023-12-26 02:31:19,004][123091] Updated weights for policy 0, policy_version 367838 (0.0010) [2023-12-26 02:31:19,059][123091] Updated weights for policy 0, policy_version 367849 (0.0010) [2023-12-26 02:31:19,636][123090] Updated weights for policy 1, policy_version 365735 (0.0008) [2023-12-26 02:31:19,697][123090] Updated weights for policy 1, policy_version 365745 (0.0008) [2023-12-26 02:31:19,765][123090] Updated weights for policy 1, policy_version 365755 (0.0010) [2023-12-26 02:31:19,967][123091] Updated weights for policy 0, policy_version 367859 (0.0010) [2023-12-26 02:31:20,026][123091] Updated weights for policy 0, policy_version 367869 (0.0009) [2023-12-26 02:31:20,097][123091] Updated weights for policy 0, policy_version 367879 (0.0006) [2023-12-26 02:31:20,633][123090] Updated weights for policy 1, policy_version 365765 (0.0010) [2023-12-26 02:31:20,725][123090] Updated weights for policy 1, policy_version 365775 (0.0009) [2023-12-26 02:31:20,787][123090] Updated weights for policy 1, policy_version 365785 (0.0010) [2023-12-26 02:31:20,927][123091] Updated weights for policy 0, policy_version 367889 (0.0007) [2023-12-26 02:31:20,993][123091] Updated weights for policy 0, policy_version 367899 (0.0009) [2023-12-26 02:31:21,073][123091] Updated weights for policy 0, policy_version 367909 (0.0009) [2023-12-26 02:31:21,145][123091] Updated weights for policy 0, policy_version 367919 (0.0008) [2023-12-26 02:31:21,541][123090] Updated weights for policy 1, policy_version 365795 (0.0010) [2023-12-26 02:31:21,617][123090] Updated weights for policy 1, policy_version 365805 (0.0009) [2023-12-26 02:31:21,692][123090] Updated weights for policy 1, policy_version 365815 (0.0007) [2023-12-26 02:31:21,985][123091] Updated weights for policy 0, policy_version 367929 (0.0006) [2023-12-26 02:31:22,062][123091] Updated weights for policy 0, policy_version 367939 (0.0006) [2023-12-26 02:31:22,139][123091] Updated weights for policy 0, policy_version 367949 (0.0010) [2023-12-26 02:31:22,458][123090] Updated weights for policy 1, policy_version 365825 (0.0007) [2023-12-26 02:31:22,523][123090] Updated weights for policy 1, policy_version 365835 (0.0009) [2023-12-26 02:31:22,592][123090] Updated weights for policy 1, policy_version 365845 (0.0009) [2023-12-26 02:31:22,649][123090] Updated weights for policy 1, policy_version 365855 (0.0009) [2023-12-26 02:31:22,948][123091] Updated weights for policy 0, policy_version 367959 (0.0008) [2023-12-26 02:31:22,999][123091] Updated weights for policy 0, policy_version 367969 (0.0009) [2023-12-26 02:31:23,059][123091] Updated weights for policy 0, policy_version 367979 (0.0009) [2023-12-26 02:31:23,456][123090] Updated weights for policy 1, policy_version 365865 (0.0009) [2023-12-26 02:31:23,519][123090] Updated weights for policy 1, policy_version 365875 (0.0006) [2023-12-26 02:31:23,569][123090] Updated weights for policy 1, policy_version 365885 (0.0005) [2023-12-26 02:31:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 187875328. Throughput: 0: 8782.3, 1: 8798.5. Samples: 187853344. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:23,785][121949] Avg episode reward: [(0, '6056.449'), (1, '5785.015')] [2023-12-26 02:31:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000367984_94208000.pth... [2023-12-26 02:31:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000365888_93667328.pth... [2023-12-26 02:31:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000366992_93954048.pth [2023-12-26 02:31:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000364864_93405184.pth [2023-12-26 02:31:23,958][123091] Updated weights for policy 0, policy_version 367989 (0.0010) [2023-12-26 02:31:24,015][123091] Updated weights for policy 0, policy_version 367999 (0.0008) [2023-12-26 02:31:24,070][123091] Updated weights for policy 0, policy_version 368009 (0.0005) [2023-12-26 02:31:24,169][123090] Updated weights for policy 1, policy_version 365895 (0.0005) [2023-12-26 02:31:24,250][123090] Updated weights for policy 1, policy_version 365905 (0.0005) [2023-12-26 02:31:24,320][123090] Updated weights for policy 1, policy_version 365915 (0.0005) [2023-12-26 02:31:24,859][123091] Updated weights for policy 0, policy_version 368019 (0.0007) [2023-12-26 02:31:24,928][123091] Updated weights for policy 0, policy_version 368029 (0.0010) [2023-12-26 02:31:24,937][123090] Updated weights for policy 1, policy_version 365925 (0.0006) [2023-12-26 02:31:24,994][123090] Updated weights for policy 1, policy_version 365935 (0.0005) [2023-12-26 02:31:24,999][123091] Updated weights for policy 0, policy_version 368039 (0.0011) [2023-12-26 02:31:25,056][123090] Updated weights for policy 1, policy_version 365945 (0.0006) [2023-12-26 02:31:25,782][123090] Updated weights for policy 1, policy_version 365955 (0.0006) [2023-12-26 02:31:25,794][123091] Updated weights for policy 0, policy_version 368049 (0.0011) [2023-12-26 02:31:25,847][123090] Updated weights for policy 1, policy_version 365965 (0.0007) [2023-12-26 02:31:25,856][123091] Updated weights for policy 0, policy_version 368059 (0.0010) [2023-12-26 02:31:25,913][123090] Updated weights for policy 1, policy_version 365975 (0.0005) [2023-12-26 02:31:25,914][123091] Updated weights for policy 0, policy_version 368069 (0.0010) [2023-12-26 02:31:25,975][123091] Updated weights for policy 0, policy_version 368079 (0.0008) [2023-12-26 02:31:26,701][123090] Updated weights for policy 1, policy_version 365985 (0.0009) [2023-12-26 02:31:26,744][123091] Updated weights for policy 0, policy_version 368089 (0.0011) [2023-12-26 02:31:26,760][123090] Updated weights for policy 1, policy_version 365995 (0.0007) [2023-12-26 02:31:26,807][123091] Updated weights for policy 0, policy_version 368099 (0.0011) [2023-12-26 02:31:26,827][123090] Updated weights for policy 1, policy_version 366005 (0.0009) [2023-12-26 02:31:26,869][123091] Updated weights for policy 0, policy_version 368109 (0.0010) [2023-12-26 02:31:26,880][123090] Updated weights for policy 1, policy_version 366015 (0.0008) [2023-12-26 02:31:27,585][123090] Updated weights for policy 1, policy_version 366025 (0.0005) [2023-12-26 02:31:27,649][123090] Updated weights for policy 1, policy_version 366035 (0.0005) [2023-12-26 02:31:27,695][123091] Updated weights for policy 0, policy_version 368119 (0.0011) [2023-12-26 02:31:27,703][123090] Updated weights for policy 1, policy_version 366045 (0.0005) [2023-12-26 02:31:27,750][123091] Updated weights for policy 0, policy_version 368129 (0.0006) [2023-12-26 02:31:27,812][123091] Updated weights for policy 0, policy_version 368139 (0.0005) [2023-12-26 02:31:28,411][123090] Updated weights for policy 1, policy_version 366055 (0.0006) [2023-12-26 02:31:28,480][123090] Updated weights for policy 1, policy_version 366065 (0.0005) [2023-12-26 02:31:28,547][123090] Updated weights for policy 1, policy_version 366075 (0.0007) [2023-12-26 02:31:28,562][123091] Updated weights for policy 0, policy_version 368149 (0.0008) [2023-12-26 02:31:28,625][123091] Updated weights for policy 0, policy_version 368159 (0.0010) [2023-12-26 02:31:28,684][123091] Updated weights for policy 0, policy_version 368169 (0.0010) [2023-12-26 02:31:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 187973632. Throughput: 0: 8788.8, 1: 8892.9. Samples: 187961608. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:28,784][121949] Avg episode reward: [(0, '6042.091'), (1, '5625.659')] [2023-12-26 02:31:29,265][123090] Updated weights for policy 1, policy_version 366085 (0.0006) [2023-12-26 02:31:29,329][123090] Updated weights for policy 1, policy_version 366095 (0.0006) [2023-12-26 02:31:29,396][123090] Updated weights for policy 1, policy_version 366105 (0.0010) [2023-12-26 02:31:29,495][123091] Updated weights for policy 0, policy_version 368179 (0.0009) [2023-12-26 02:31:29,562][123091] Updated weights for policy 0, policy_version 368189 (0.0005) [2023-12-26 02:31:29,632][123091] Updated weights for policy 0, policy_version 368199 (0.0005) [2023-12-26 02:31:30,166][123090] Updated weights for policy 1, policy_version 366115 (0.0008) [2023-12-26 02:31:30,222][123090] Updated weights for policy 1, policy_version 366125 (0.0010) [2023-12-26 02:31:30,288][123090] Updated weights for policy 1, policy_version 366135 (0.0010) [2023-12-26 02:31:30,402][123091] Updated weights for policy 0, policy_version 368209 (0.0008) [2023-12-26 02:31:30,476][123091] Updated weights for policy 0, policy_version 368219 (0.0006) [2023-12-26 02:31:30,547][123091] Updated weights for policy 0, policy_version 368229 (0.0006) [2023-12-26 02:31:30,613][123091] Updated weights for policy 0, policy_version 368239 (0.0006) [2023-12-26 02:31:31,107][123090] Updated weights for policy 1, policy_version 366145 (0.0011) [2023-12-26 02:31:31,178][123090] Updated weights for policy 1, policy_version 366155 (0.0011) [2023-12-26 02:31:31,237][123090] Updated weights for policy 1, policy_version 366165 (0.0010) [2023-12-26 02:31:31,264][123091] Updated weights for policy 0, policy_version 368249 (0.0008) [2023-12-26 02:31:31,304][123090] Updated weights for policy 1, policy_version 366175 (0.0008) [2023-12-26 02:31:31,327][123091] Updated weights for policy 0, policy_version 368259 (0.0009) [2023-12-26 02:31:31,399][123091] Updated weights for policy 0, policy_version 368269 (0.0009) [2023-12-26 02:31:32,054][123090] Updated weights for policy 1, policy_version 366185 (0.0010) [2023-12-26 02:31:32,124][123090] Updated weights for policy 1, policy_version 366195 (0.0010) [2023-12-26 02:31:32,191][123090] Updated weights for policy 1, policy_version 366205 (0.0010) [2023-12-26 02:31:32,215][123091] Updated weights for policy 0, policy_version 368279 (0.0007) [2023-12-26 02:31:32,286][123091] Updated weights for policy 0, policy_version 368289 (0.0008) [2023-12-26 02:31:32,350][123091] Updated weights for policy 0, policy_version 368299 (0.0008) [2023-12-26 02:31:32,977][123090] Updated weights for policy 1, policy_version 366215 (0.0007) [2023-12-26 02:31:33,040][123090] Updated weights for policy 1, policy_version 366225 (0.0005) [2023-12-26 02:31:33,100][123090] Updated weights for policy 1, policy_version 366235 (0.0005) [2023-12-26 02:31:33,183][123091] Updated weights for policy 0, policy_version 368309 (0.0009) [2023-12-26 02:31:33,236][123091] Updated weights for policy 0, policy_version 368319 (0.0010) [2023-12-26 02:31:33,291][123091] Updated weights for policy 0, policy_version 368330 (0.0007) [2023-12-26 02:31:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 188055552. Throughput: 0: 8699.4, 1: 8924.5. Samples: 188069436. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:33,784][121949] Avg episode reward: [(0, '6201.172'), (1, '5306.815')] [2023-12-26 02:31:33,851][123090] Updated weights for policy 1, policy_version 366245 (0.0008) [2023-12-26 02:31:33,913][123090] Updated weights for policy 1, policy_version 366255 (0.0010) [2023-12-26 02:31:33,964][123090] Updated weights for policy 1, policy_version 366265 (0.0010) [2023-12-26 02:31:33,992][123091] Updated weights for policy 0, policy_version 368340 (0.0008) [2023-12-26 02:31:34,043][123091] Updated weights for policy 0, policy_version 368350 (0.0005) [2023-12-26 02:31:34,090][123091] Updated weights for policy 0, policy_version 368360 (0.0005) [2023-12-26 02:31:34,679][123090] Updated weights for policy 1, policy_version 366275 (0.0009) [2023-12-26 02:31:34,736][123090] Updated weights for policy 1, policy_version 366285 (0.0006) [2023-12-26 02:31:34,812][123090] Updated weights for policy 1, policy_version 366295 (0.0005) [2023-12-26 02:31:34,865][123091] Updated weights for policy 0, policy_version 368370 (0.0008) [2023-12-26 02:31:34,932][123091] Updated weights for policy 0, policy_version 368380 (0.0008) [2023-12-26 02:31:34,993][123091] Updated weights for policy 0, policy_version 368390 (0.0009) [2023-12-26 02:31:35,048][123091] Updated weights for policy 0, policy_version 368400 (0.0010) [2023-12-26 02:31:35,499][123090] Updated weights for policy 1, policy_version 366305 (0.0008) [2023-12-26 02:31:35,576][123090] Updated weights for policy 1, policy_version 366315 (0.0005) [2023-12-26 02:31:35,650][123090] Updated weights for policy 1, policy_version 366325 (0.0005) [2023-12-26 02:31:35,712][123090] Updated weights for policy 1, policy_version 366335 (0.0005) [2023-12-26 02:31:35,978][123091] Updated weights for policy 0, policy_version 368410 (0.0010) [2023-12-26 02:31:36,035][123091] Updated weights for policy 0, policy_version 368420 (0.0007) [2023-12-26 02:31:36,108][123091] Updated weights for policy 0, policy_version 368430 (0.0007) [2023-12-26 02:31:36,396][123090] Updated weights for policy 1, policy_version 366345 (0.0010) [2023-12-26 02:31:36,449][123090] Updated weights for policy 1, policy_version 366355 (0.0011) [2023-12-26 02:31:36,501][123090] Updated weights for policy 1, policy_version 366365 (0.0010) [2023-12-26 02:31:36,974][123091] Updated weights for policy 0, policy_version 368440 (0.0010) [2023-12-26 02:31:37,037][123091] Updated weights for policy 0, policy_version 368450 (0.0010) [2023-12-26 02:31:37,097][123091] Updated weights for policy 0, policy_version 368460 (0.0010) [2023-12-26 02:31:37,212][123090] Updated weights for policy 1, policy_version 366375 (0.0007) [2023-12-26 02:31:37,274][123090] Updated weights for policy 1, policy_version 366385 (0.0005) [2023-12-26 02:31:37,341][123090] Updated weights for policy 1, policy_version 366395 (0.0009) [2023-12-26 02:31:38,036][123091] Updated weights for policy 0, policy_version 368470 (0.0009) [2023-12-26 02:31:38,038][123090] Updated weights for policy 1, policy_version 366405 (0.0006) [2023-12-26 02:31:38,093][123091] Updated weights for policy 0, policy_version 368480 (0.0009) [2023-12-26 02:31:38,113][123090] Updated weights for policy 1, policy_version 366415 (0.0006) [2023-12-26 02:31:38,156][123091] Updated weights for policy 0, policy_version 368490 (0.0008) [2023-12-26 02:31:38,181][123090] Updated weights for policy 1, policy_version 366425 (0.0005) [2023-12-26 02:31:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 188145664. Throughput: 0: 8732.4, 1: 8977.5. Samples: 188124440. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:38,784][121949] Avg episode reward: [(0, '6168.352'), (1, '5442.967')] [2023-12-26 02:31:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000366432_93806592.pth... [2023-12-26 02:31:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000368496_94339072.pth... [2023-12-26 02:31:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000367504_94085120.pth [2023-12-26 02:31:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000365376_93536256.pth [2023-12-26 02:31:38,933][123090] Updated weights for policy 1, policy_version 366435 (0.0007) [2023-12-26 02:31:38,995][123090] Updated weights for policy 1, policy_version 366445 (0.0011) [2023-12-26 02:31:39,026][123091] Updated weights for policy 0, policy_version 368500 (0.0009) [2023-12-26 02:31:39,056][123090] Updated weights for policy 1, policy_version 366455 (0.0011) [2023-12-26 02:31:39,084][123091] Updated weights for policy 0, policy_version 368510 (0.0008) [2023-12-26 02:31:39,141][123091] Updated weights for policy 0, policy_version 368520 (0.0008) [2023-12-26 02:31:39,827][123090] Updated weights for policy 1, policy_version 366465 (0.0010) [2023-12-26 02:31:39,897][123090] Updated weights for policy 1, policy_version 366475 (0.0007) [2023-12-26 02:31:39,970][123090] Updated weights for policy 1, policy_version 366485 (0.0008) [2023-12-26 02:31:40,018][123091] Updated weights for policy 0, policy_version 368530 (0.0008) [2023-12-26 02:31:40,034][123090] Updated weights for policy 1, policy_version 366495 (0.0008) [2023-12-26 02:31:40,082][123091] Updated weights for policy 0, policy_version 368540 (0.0009) [2023-12-26 02:31:40,153][123091] Updated weights for policy 0, policy_version 368550 (0.0009) [2023-12-26 02:31:40,216][123091] Updated weights for policy 0, policy_version 368560 (0.0009) [2023-12-26 02:31:40,811][123090] Updated weights for policy 1, policy_version 366505 (0.0007) [2023-12-26 02:31:40,882][123090] Updated weights for policy 1, policy_version 366515 (0.0008) [2023-12-26 02:31:40,944][123090] Updated weights for policy 1, policy_version 366525 (0.0006) [2023-12-26 02:31:41,080][123091] Updated weights for policy 0, policy_version 368570 (0.0009) [2023-12-26 02:31:41,135][123091] Updated weights for policy 0, policy_version 368580 (0.0010) [2023-12-26 02:31:41,202][123091] Updated weights for policy 0, policy_version 368590 (0.0009) [2023-12-26 02:31:41,758][123090] Updated weights for policy 1, policy_version 366535 (0.0008) [2023-12-26 02:31:41,822][123090] Updated weights for policy 1, policy_version 366545 (0.0009) [2023-12-26 02:31:41,887][123090] Updated weights for policy 1, policy_version 366555 (0.0009) [2023-12-26 02:31:42,106][123091] Updated weights for policy 0, policy_version 368600 (0.0009) [2023-12-26 02:31:42,161][123091] Updated weights for policy 0, policy_version 368610 (0.0010) [2023-12-26 02:31:42,232][123091] Updated weights for policy 0, policy_version 368620 (0.0009) [2023-12-26 02:31:42,716][123090] Updated weights for policy 1, policy_version 366565 (0.0010) [2023-12-26 02:31:42,781][123090] Updated weights for policy 1, policy_version 366575 (0.0009) [2023-12-26 02:31:42,849][123090] Updated weights for policy 1, policy_version 366585 (0.0009) [2023-12-26 02:31:43,081][123091] Updated weights for policy 0, policy_version 368630 (0.0010) [2023-12-26 02:31:43,145][123091] Updated weights for policy 0, policy_version 368640 (0.0009) [2023-12-26 02:31:43,206][123091] Updated weights for policy 0, policy_version 368650 (0.0009) [2023-12-26 02:31:43,649][123090] Updated weights for policy 1, policy_version 366595 (0.0010) [2023-12-26 02:31:43,699][123090] Updated weights for policy 1, policy_version 366605 (0.0006) [2023-12-26 02:31:43,756][123090] Updated weights for policy 1, policy_version 366616 (0.0008) [2023-12-26 02:31:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 188227584. Throughput: 0: 8564.0, 1: 9039.5. Samples: 188226856. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:43,785][121949] Avg episode reward: [(0, '6027.533'), (1, '5474.357')] [2023-12-26 02:31:44,037][123091] Updated weights for policy 0, policy_version 368660 (0.0010) [2023-12-26 02:31:44,086][123091] Updated weights for policy 0, policy_version 368671 (0.0010) [2023-12-26 02:31:44,133][123091] Updated weights for policy 0, policy_version 368681 (0.0009) [2023-12-26 02:31:44,599][123090] Updated weights for policy 1, policy_version 366626 (0.0008) [2023-12-26 02:31:44,669][123090] Updated weights for policy 1, policy_version 366636 (0.0009) [2023-12-26 02:31:44,729][123090] Updated weights for policy 1, policy_version 366646 (0.0009) [2023-12-26 02:31:44,986][123091] Updated weights for policy 0, policy_version 368691 (0.0009) [2023-12-26 02:31:45,053][123091] Updated weights for policy 0, policy_version 368701 (0.0009) [2023-12-26 02:31:45,121][123091] Updated weights for policy 0, policy_version 368711 (0.0010) [2023-12-26 02:31:45,504][123090] Updated weights for policy 1, policy_version 366657 (0.0009) [2023-12-26 02:31:45,556][123090] Updated weights for policy 1, policy_version 366667 (0.0009) [2023-12-26 02:31:45,606][123090] Updated weights for policy 1, policy_version 366677 (0.0007) [2023-12-26 02:31:45,660][123090] Updated weights for policy 1, policy_version 366687 (0.0005) [2023-12-26 02:31:45,997][123091] Updated weights for policy 0, policy_version 368721 (0.0010) [2023-12-26 02:31:46,060][123091] Updated weights for policy 0, policy_version 368731 (0.0010) [2023-12-26 02:31:46,122][123091] Updated weights for policy 0, policy_version 368741 (0.0010) [2023-12-26 02:31:46,184][123091] Updated weights for policy 0, policy_version 368751 (0.0010) [2023-12-26 02:31:46,450][123090] Updated weights for policy 1, policy_version 366697 (0.0010) [2023-12-26 02:31:46,501][123090] Updated weights for policy 1, policy_version 366707 (0.0008) [2023-12-26 02:31:46,549][123090] Updated weights for policy 1, policy_version 366717 (0.0009) [2023-12-26 02:31:47,054][123091] Updated weights for policy 0, policy_version 368761 (0.0009) [2023-12-26 02:31:47,108][123091] Updated weights for policy 0, policy_version 368771 (0.0010) [2023-12-26 02:31:47,169][123091] Updated weights for policy 0, policy_version 368781 (0.0010) [2023-12-26 02:31:47,276][123090] Updated weights for policy 1, policy_version 366727 (0.0009) [2023-12-26 02:31:47,323][123090] Updated weights for policy 1, policy_version 366737 (0.0009) [2023-12-26 02:31:47,375][123090] Updated weights for policy 1, policy_version 366747 (0.0009) [2023-12-26 02:31:47,913][123091] Updated weights for policy 0, policy_version 368791 (0.0006) [2023-12-26 02:31:47,970][123091] Updated weights for policy 0, policy_version 368801 (0.0005) [2023-12-26 02:31:48,035][123091] Updated weights for policy 0, policy_version 368811 (0.0009) [2023-12-26 02:31:48,247][123090] Updated weights for policy 1, policy_version 366757 (0.0007) [2023-12-26 02:31:48,298][123090] Updated weights for policy 1, policy_version 366767 (0.0005) [2023-12-26 02:31:48,366][123090] Updated weights for policy 1, policy_version 366777 (0.0007) [2023-12-26 02:31:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 188317696. Throughput: 0: 8544.4, 1: 9087.1. Samples: 188331560. Policy #0 lag: (min: 23.0, avg: 35.6, max: 55.0) [2023-12-26 02:31:48,785][121949] Avg episode reward: [(0, '6007.962'), (1, '5406.975')] [2023-12-26 02:31:48,789][123091] Updated weights for policy 0, policy_version 368821 (0.0009) [2023-12-26 02:31:48,840][123091] Updated weights for policy 0, policy_version 368831 (0.0008) [2023-12-26 02:31:48,895][123091] Updated weights for policy 0, policy_version 368841 (0.0008) [2023-12-26 02:31:49,218][123090] Updated weights for policy 1, policy_version 366787 (0.0010) [2023-12-26 02:31:49,284][123090] Updated weights for policy 1, policy_version 366797 (0.0009) [2023-12-26 02:31:49,351][123090] Updated weights for policy 1, policy_version 366807 (0.0010) [2023-12-26 02:31:49,631][123091] Updated weights for policy 0, policy_version 368851 (0.0007) [2023-12-26 02:31:49,702][123091] Updated weights for policy 0, policy_version 368861 (0.0006) [2023-12-26 02:31:49,775][123091] Updated weights for policy 0, policy_version 368871 (0.0006) [2023-12-26 02:31:50,248][123090] Updated weights for policy 1, policy_version 366817 (0.0011) [2023-12-26 02:31:50,306][123090] Updated weights for policy 1, policy_version 366827 (0.0009) [2023-12-26 02:31:50,362][123090] Updated weights for policy 1, policy_version 366837 (0.0009) [2023-12-26 02:31:50,423][123090] Updated weights for policy 1, policy_version 366847 (0.0009) [2023-12-26 02:31:50,581][123091] Updated weights for policy 0, policy_version 368881 (0.0007) [2023-12-26 02:31:50,639][123091] Updated weights for policy 0, policy_version 368891 (0.0010) [2023-12-26 02:31:50,704][123091] Updated weights for policy 0, policy_version 368901 (0.0009) [2023-12-26 02:31:50,771][123091] Updated weights for policy 0, policy_version 368911 (0.0011) [2023-12-26 02:31:51,295][123090] Updated weights for policy 1, policy_version 366857 (0.0009) [2023-12-26 02:31:51,365][123090] Updated weights for policy 1, policy_version 366867 (0.0010) [2023-12-26 02:31:51,441][123090] Updated weights for policy 1, policy_version 366877 (0.0009) [2023-12-26 02:31:51,603][123091] Updated weights for policy 0, policy_version 368921 (0.0010) [2023-12-26 02:31:51,674][123091] Updated weights for policy 0, policy_version 368931 (0.0009) [2023-12-26 02:31:51,746][123091] Updated weights for policy 0, policy_version 368941 (0.0007) [2023-12-26 02:31:52,311][123090] Updated weights for policy 1, policy_version 366887 (0.0009) [2023-12-26 02:31:52,383][123090] Updated weights for policy 1, policy_version 366897 (0.0009) [2023-12-26 02:31:52,454][123090] Updated weights for policy 1, policy_version 366907 (0.0010) [2023-12-26 02:31:52,528][123091] Updated weights for policy 0, policy_version 368951 (0.0006) [2023-12-26 02:31:52,584][123091] Updated weights for policy 0, policy_version 368961 (0.0005) [2023-12-26 02:31:52,638][123091] Updated weights for policy 0, policy_version 368971 (0.0005) [2023-12-26 02:31:53,283][123091] Updated weights for policy 0, policy_version 368981 (0.0007) [2023-12-26 02:31:53,342][123091] Updated weights for policy 0, policy_version 368991 (0.0008) [2023-12-26 02:31:53,353][123090] Updated weights for policy 1, policy_version 366917 (0.0009) [2023-12-26 02:31:53,410][123091] Updated weights for policy 0, policy_version 369001 (0.0006) [2023-12-26 02:31:53,419][123090] Updated weights for policy 1, policy_version 366927 (0.0008) [2023-12-26 02:31:53,484][123090] Updated weights for policy 1, policy_version 366937 (0.0009) [2023-12-26 02:31:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 188407808. Throughput: 0: 8533.3, 1: 9061.0. Samples: 188382364. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:31:53,785][121949] Avg episode reward: [(0, '6024.371'), (1, '5606.794')] [2023-12-26 02:31:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000369008_94470144.pth... [2023-12-26 02:31:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000366944_93937664.pth... [2023-12-26 02:31:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000365888_93667328.pth [2023-12-26 02:31:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000367984_94208000.pth [2023-12-26 02:31:53,996][123091] Updated weights for policy 0, policy_version 369011 (0.0005) [2023-12-26 02:31:54,063][123091] Updated weights for policy 0, policy_version 369021 (0.0005) [2023-12-26 02:31:54,125][123091] Updated weights for policy 0, policy_version 369031 (0.0006) [2023-12-26 02:31:54,402][123090] Updated weights for policy 1, policy_version 366947 (0.0009) [2023-12-26 02:31:54,471][123090] Updated weights for policy 1, policy_version 366957 (0.0010) [2023-12-26 02:31:54,531][123090] Updated weights for policy 1, policy_version 366967 (0.0010) [2023-12-26 02:31:54,889][123091] Updated weights for policy 0, policy_version 369041 (0.0006) [2023-12-26 02:31:54,956][123091] Updated weights for policy 0, policy_version 369051 (0.0010) [2023-12-26 02:31:55,020][123091] Updated weights for policy 0, policy_version 369061 (0.0010) [2023-12-26 02:31:55,086][123091] Updated weights for policy 0, policy_version 369071 (0.0010) [2023-12-26 02:31:55,351][123090] Updated weights for policy 1, policy_version 366977 (0.0010) [2023-12-26 02:31:55,417][123090] Updated weights for policy 1, policy_version 366987 (0.0009) [2023-12-26 02:31:55,479][123090] Updated weights for policy 1, policy_version 366997 (0.0007) [2023-12-26 02:31:55,538][123090] Updated weights for policy 1, policy_version 367007 (0.0005) [2023-12-26 02:31:55,872][123091] Updated weights for policy 0, policy_version 369081 (0.0006) [2023-12-26 02:31:55,919][123091] Updated weights for policy 0, policy_version 369091 (0.0005) [2023-12-26 02:31:55,963][123091] Updated weights for policy 0, policy_version 369101 (0.0005) [2023-12-26 02:31:56,205][123090] Updated weights for policy 1, policy_version 367017 (0.0005) [2023-12-26 02:31:56,264][123090] Updated weights for policy 1, policy_version 367027 (0.0005) [2023-12-26 02:31:56,319][123090] Updated weights for policy 1, policy_version 367037 (0.0005) [2023-12-26 02:31:56,649][123091] Updated weights for policy 0, policy_version 369111 (0.0005) [2023-12-26 02:31:56,721][123091] Updated weights for policy 0, policy_version 369121 (0.0007) [2023-12-26 02:31:56,791][123091] Updated weights for policy 0, policy_version 369131 (0.0011) [2023-12-26 02:31:57,152][123090] Updated weights for policy 1, policy_version 367047 (0.0008) [2023-12-26 02:31:57,208][123090] Updated weights for policy 1, policy_version 367057 (0.0009) [2023-12-26 02:31:57,257][123090] Updated weights for policy 1, policy_version 367067 (0.0009) [2023-12-26 02:31:57,586][123091] Updated weights for policy 0, policy_version 369141 (0.0010) [2023-12-26 02:31:57,648][123091] Updated weights for policy 0, policy_version 369151 (0.0010) [2023-12-26 02:31:57,706][123091] Updated weights for policy 0, policy_version 369161 (0.0010) [2023-12-26 02:31:58,103][123090] Updated weights for policy 1, policy_version 367077 (0.0007) [2023-12-26 02:31:58,170][123090] Updated weights for policy 1, policy_version 367087 (0.0009) [2023-12-26 02:31:58,227][123090] Updated weights for policy 1, policy_version 367097 (0.0007) [2023-12-26 02:31:58,552][123091] Updated weights for policy 0, policy_version 369171 (0.0011) [2023-12-26 02:31:58,618][123091] Updated weights for policy 0, policy_version 369181 (0.0011) [2023-12-26 02:31:58,688][123091] Updated weights for policy 0, policy_version 369191 (0.0011) [2023-12-26 02:31:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17613.0, 300 sec: 17744.7). Total num frames: 188497920. Throughput: 0: 8599.4, 1: 9010.8. Samples: 188489676. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:31:58,785][121949] Avg episode reward: [(0, '6050.709'), (1, '5703.961')] [2023-12-26 02:31:59,068][123090] Updated weights for policy 1, policy_version 367107 (0.0005) [2023-12-26 02:31:59,139][123090] Updated weights for policy 1, policy_version 367117 (0.0006) [2023-12-26 02:31:59,209][123090] Updated weights for policy 1, policy_version 367127 (0.0006) [2023-12-26 02:31:59,520][123091] Updated weights for policy 0, policy_version 369201 (0.0011) [2023-12-26 02:31:59,582][123091] Updated weights for policy 0, policy_version 369211 (0.0011) [2023-12-26 02:31:59,648][123091] Updated weights for policy 0, policy_version 369221 (0.0010) [2023-12-26 02:31:59,711][123091] Updated weights for policy 0, policy_version 369231 (0.0011) [2023-12-26 02:31:59,912][123090] Updated weights for policy 1, policy_version 367137 (0.0007) [2023-12-26 02:31:59,977][123090] Updated weights for policy 1, policy_version 367147 (0.0006) [2023-12-26 02:32:00,034][123090] Updated weights for policy 1, policy_version 367157 (0.0007) [2023-12-26 02:32:00,095][123090] Updated weights for policy 1, policy_version 367167 (0.0008) [2023-12-26 02:32:00,541][123091] Updated weights for policy 0, policy_version 369241 (0.0011) [2023-12-26 02:32:00,604][123091] Updated weights for policy 0, policy_version 369251 (0.0010) [2023-12-26 02:32:00,670][123091] Updated weights for policy 0, policy_version 369261 (0.0011) [2023-12-26 02:32:00,767][123090] Updated weights for policy 1, policy_version 367177 (0.0008) [2023-12-26 02:32:00,815][123090] Updated weights for policy 1, policy_version 367187 (0.0009) [2023-12-26 02:32:00,863][123090] Updated weights for policy 1, policy_version 367197 (0.0008) [2023-12-26 02:32:01,506][123091] Updated weights for policy 0, policy_version 369271 (0.0007) [2023-12-26 02:32:01,566][123091] Updated weights for policy 0, policy_version 369281 (0.0005) [2023-12-26 02:32:01,639][123091] Updated weights for policy 0, policy_version 369291 (0.0007) [2023-12-26 02:32:01,770][123090] Updated weights for policy 1, policy_version 367207 (0.0010) [2023-12-26 02:32:01,827][123090] Updated weights for policy 1, policy_version 367217 (0.0009) [2023-12-26 02:32:01,897][123090] Updated weights for policy 1, policy_version 367227 (0.0010) [2023-12-26 02:32:02,231][123091] Updated weights for policy 0, policy_version 369301 (0.0007) [2023-12-26 02:32:02,296][123091] Updated weights for policy 0, policy_version 369311 (0.0006) [2023-12-26 02:32:02,360][123091] Updated weights for policy 0, policy_version 369321 (0.0007) [2023-12-26 02:32:02,810][123090] Updated weights for policy 1, policy_version 367237 (0.0010) [2023-12-26 02:32:02,885][123090] Updated weights for policy 1, policy_version 367247 (0.0010) [2023-12-26 02:32:02,947][123090] Updated weights for policy 1, policy_version 367257 (0.0009) [2023-12-26 02:32:03,081][123091] Updated weights for policy 0, policy_version 369331 (0.0009) [2023-12-26 02:32:03,141][123091] Updated weights for policy 0, policy_version 369341 (0.0009) [2023-12-26 02:32:03,194][123091] Updated weights for policy 0, policy_version 369351 (0.0009) [2023-12-26 02:32:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 188579840. Throughput: 0: 8689.8, 1: 8917.1. Samples: 188594592. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:03,785][121949] Avg episode reward: [(0, '6187.576'), (1, '5523.261')] [2023-12-26 02:32:03,794][123090] Updated weights for policy 1, policy_version 367267 (0.0010) [2023-12-26 02:32:03,859][123090] Updated weights for policy 1, policy_version 367277 (0.0010) [2023-12-26 02:32:03,925][123090] Updated weights for policy 1, policy_version 367287 (0.0009) [2023-12-26 02:32:04,031][123091] Updated weights for policy 0, policy_version 369361 (0.0010) [2023-12-26 02:32:04,093][123091] Updated weights for policy 0, policy_version 369371 (0.0009) [2023-12-26 02:32:04,156][123091] Updated weights for policy 0, policy_version 369381 (0.0009) [2023-12-26 02:32:04,211][123091] Updated weights for policy 0, policy_version 369391 (0.0009) [2023-12-26 02:32:04,746][123090] Updated weights for policy 1, policy_version 367297 (0.0009) [2023-12-26 02:32:04,815][123090] Updated weights for policy 1, policy_version 367307 (0.0010) [2023-12-26 02:32:04,882][123090] Updated weights for policy 1, policy_version 367317 (0.0009) [2023-12-26 02:32:04,930][123090] Updated weights for policy 1, policy_version 367327 (0.0009) [2023-12-26 02:32:04,992][123091] Updated weights for policy 0, policy_version 369401 (0.0008) [2023-12-26 02:32:05,052][123091] Updated weights for policy 0, policy_version 369411 (0.0005) [2023-12-26 02:32:05,101][123091] Updated weights for policy 0, policy_version 369421 (0.0008) [2023-12-26 02:32:05,793][123091] Updated weights for policy 0, policy_version 369431 (0.0007) [2023-12-26 02:32:05,797][123090] Updated weights for policy 1, policy_version 367337 (0.0008) [2023-12-26 02:32:05,851][123090] Updated weights for policy 1, policy_version 367348 (0.0009) [2023-12-26 02:32:05,854][123091] Updated weights for policy 0, policy_version 369441 (0.0005) [2023-12-26 02:32:05,905][123090] Updated weights for policy 1, policy_version 367358 (0.0009) [2023-12-26 02:32:05,923][123091] Updated weights for policy 0, policy_version 369451 (0.0006) [2023-12-26 02:32:06,632][123091] Updated weights for policy 0, policy_version 369461 (0.0010) [2023-12-26 02:32:06,685][123091] Updated weights for policy 0, policy_version 369471 (0.0011) [2023-12-26 02:32:06,743][123091] Updated weights for policy 0, policy_version 369481 (0.0007) [2023-12-26 02:32:06,832][123090] Updated weights for policy 1, policy_version 367368 (0.0008) [2023-12-26 02:32:06,901][123090] Updated weights for policy 1, policy_version 367378 (0.0009) [2023-12-26 02:32:06,961][123090] Updated weights for policy 1, policy_version 367388 (0.0009) [2023-12-26 02:32:07,499][123091] Updated weights for policy 0, policy_version 369491 (0.0007) [2023-12-26 02:32:07,548][123091] Updated weights for policy 0, policy_version 369501 (0.0006) [2023-12-26 02:32:07,598][123091] Updated weights for policy 0, policy_version 369511 (0.0005) [2023-12-26 02:32:07,689][123090] Updated weights for policy 1, policy_version 367398 (0.0007) [2023-12-26 02:32:07,753][123090] Updated weights for policy 1, policy_version 367408 (0.0005) [2023-12-26 02:32:07,814][123090] Updated weights for policy 1, policy_version 367418 (0.0009) [2023-12-26 02:32:08,290][123091] Updated weights for policy 0, policy_version 369521 (0.0006) [2023-12-26 02:32:08,353][123091] Updated weights for policy 0, policy_version 369531 (0.0007) [2023-12-26 02:32:08,412][123091] Updated weights for policy 0, policy_version 369541 (0.0008) [2023-12-26 02:32:08,477][123091] Updated weights for policy 0, policy_version 369551 (0.0006) [2023-12-26 02:32:08,684][123090] Updated weights for policy 1, policy_version 367428 (0.0009) [2023-12-26 02:32:08,739][123090] Updated weights for policy 1, policy_version 367439 (0.0010) [2023-12-26 02:32:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 188669952. Throughput: 0: 8777.7, 1: 8874.9. Samples: 188647712. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:08,786][121949] Avg episode reward: [(0, '6258.956'), (1, '5466.428')] [2023-12-26 02:32:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000369552_94609408.pth... [2023-12-26 02:32:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000368496_94339072.pth [2023-12-26 02:32:08,807][123090] Updated weights for policy 1, policy_version 367449 (0.0010) [2023-12-26 02:32:08,842][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000367456_94068736.pth... [2023-12-26 02:32:08,847][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000366432_93806592.pth [2023-12-26 02:32:09,269][123091] Updated weights for policy 0, policy_version 369561 (0.0009) [2023-12-26 02:32:09,343][123091] Updated weights for policy 0, policy_version 369571 (0.0008) [2023-12-26 02:32:09,416][123091] Updated weights for policy 0, policy_version 369581 (0.0009) [2023-12-26 02:32:09,620][123090] Updated weights for policy 1, policy_version 367459 (0.0009) [2023-12-26 02:32:09,692][123090] Updated weights for policy 1, policy_version 367469 (0.0009) [2023-12-26 02:32:09,758][123090] Updated weights for policy 1, policy_version 367479 (0.0010) [2023-12-26 02:32:10,260][123091] Updated weights for policy 0, policy_version 369591 (0.0009) [2023-12-26 02:32:10,313][123091] Updated weights for policy 0, policy_version 369601 (0.0010) [2023-12-26 02:32:10,383][123091] Updated weights for policy 0, policy_version 369611 (0.0009) [2023-12-26 02:32:10,599][123090] Updated weights for policy 1, policy_version 367489 (0.0009) [2023-12-26 02:32:10,662][123090] Updated weights for policy 1, policy_version 367500 (0.0010) [2023-12-26 02:32:10,725][123090] Updated weights for policy 1, policy_version 367510 (0.0009) [2023-12-26 02:32:10,792][123090] Updated weights for policy 1, policy_version 367520 (0.0010) [2023-12-26 02:32:11,191][123091] Updated weights for policy 0, policy_version 369621 (0.0009) [2023-12-26 02:32:11,254][123091] Updated weights for policy 0, policy_version 369631 (0.0008) [2023-12-26 02:32:11,320][123091] Updated weights for policy 0, policy_version 369641 (0.0009) [2023-12-26 02:32:11,673][123090] Updated weights for policy 1, policy_version 367530 (0.0011) [2023-12-26 02:32:11,733][123090] Updated weights for policy 1, policy_version 367540 (0.0011) [2023-12-26 02:32:11,782][123090] Updated weights for policy 1, policy_version 367550 (0.0009) [2023-12-26 02:32:12,177][123091] Updated weights for policy 0, policy_version 369651 (0.0009) [2023-12-26 02:32:12,241][123091] Updated weights for policy 0, policy_version 369661 (0.0008) [2023-12-26 02:32:12,301][123091] Updated weights for policy 0, policy_version 369671 (0.0010) [2023-12-26 02:32:12,626][123090] Updated weights for policy 1, policy_version 367560 (0.0010) [2023-12-26 02:32:12,677][123090] Updated weights for policy 1, policy_version 367570 (0.0010) [2023-12-26 02:32:12,732][123090] Updated weights for policy 1, policy_version 367580 (0.0009) [2023-12-26 02:32:13,129][123091] Updated weights for policy 0, policy_version 369681 (0.0009) [2023-12-26 02:32:13,183][123091] Updated weights for policy 0, policy_version 369691 (0.0005) [2023-12-26 02:32:13,236][123091] Updated weights for policy 0, policy_version 369701 (0.0005) [2023-12-26 02:32:13,283][123091] Updated weights for policy 0, policy_version 369711 (0.0005) [2023-12-26 02:32:13,652][123090] Updated weights for policy 1, policy_version 367590 (0.0009) [2023-12-26 02:32:13,724][123090] Updated weights for policy 1, policy_version 367600 (0.0009) [2023-12-26 02:32:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 188751872. Throughput: 0: 8808.3, 1: 8742.9. Samples: 188751416. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:13,785][121949] Avg episode reward: [(0, '6238.075'), (1, '5491.801')] [2023-12-26 02:32:13,793][123090] Updated weights for policy 1, policy_version 367610 (0.0010) [2023-12-26 02:32:13,952][123091] Updated weights for policy 0, policy_version 369721 (0.0005) [2023-12-26 02:32:13,997][123091] Updated weights for policy 0, policy_version 369731 (0.0006) [2023-12-26 02:32:14,055][123091] Updated weights for policy 0, policy_version 369741 (0.0005) [2023-12-26 02:32:14,700][123090] Updated weights for policy 1, policy_version 367620 (0.0009) [2023-12-26 02:32:14,705][123091] Updated weights for policy 0, policy_version 369751 (0.0005) [2023-12-26 02:32:14,752][123090] Updated weights for policy 1, policy_version 367630 (0.0009) [2023-12-26 02:32:14,763][123091] Updated weights for policy 0, policy_version 369761 (0.0006) [2023-12-26 02:32:14,819][123090] Updated weights for policy 1, policy_version 367640 (0.0009) [2023-12-26 02:32:14,834][123091] Updated weights for policy 0, policy_version 369771 (0.0009) [2023-12-26 02:32:15,498][123091] Updated weights for policy 0, policy_version 369781 (0.0010) [2023-12-26 02:32:15,562][123091] Updated weights for policy 0, policy_version 369791 (0.0010) [2023-12-26 02:32:15,626][123091] Updated weights for policy 0, policy_version 369801 (0.0011) [2023-12-26 02:32:15,701][123090] Updated weights for policy 1, policy_version 367650 (0.0007) [2023-12-26 02:32:15,766][123090] Updated weights for policy 1, policy_version 367660 (0.0008) [2023-12-26 02:32:15,838][123090] Updated weights for policy 1, policy_version 367670 (0.0007) [2023-12-26 02:32:15,894][123090] Updated weights for policy 1, policy_version 367680 (0.0005) [2023-12-26 02:32:16,454][123091] Updated weights for policy 0, policy_version 369811 (0.0011) [2023-12-26 02:32:16,505][123091] Updated weights for policy 0, policy_version 369821 (0.0010) [2023-12-26 02:32:16,556][123091] Updated weights for policy 0, policy_version 369831 (0.0010) [2023-12-26 02:32:16,633][123090] Updated weights for policy 1, policy_version 367690 (0.0008) [2023-12-26 02:32:16,689][123090] Updated weights for policy 1, policy_version 367700 (0.0008) [2023-12-26 02:32:16,748][123090] Updated weights for policy 1, policy_version 367710 (0.0009) [2023-12-26 02:32:17,362][123091] Updated weights for policy 0, policy_version 369841 (0.0010) [2023-12-26 02:32:17,427][123091] Updated weights for policy 0, policy_version 369851 (0.0008) [2023-12-26 02:32:17,486][123091] Updated weights for policy 0, policy_version 369861 (0.0010) [2023-12-26 02:32:17,537][123091] Updated weights for policy 0, policy_version 369871 (0.0010) [2023-12-26 02:32:17,597][123090] Updated weights for policy 1, policy_version 367720 (0.0009) [2023-12-26 02:32:17,658][123090] Updated weights for policy 1, policy_version 367730 (0.0008) [2023-12-26 02:32:17,717][123090] Updated weights for policy 1, policy_version 367740 (0.0008) [2023-12-26 02:32:18,244][123091] Updated weights for policy 0, policy_version 369881 (0.0006) [2023-12-26 02:32:18,299][123091] Updated weights for policy 0, policy_version 369891 (0.0006) [2023-12-26 02:32:18,370][123091] Updated weights for policy 0, policy_version 369901 (0.0006) [2023-12-26 02:32:18,653][123090] Updated weights for policy 1, policy_version 367750 (0.0009) [2023-12-26 02:32:18,725][123090] Updated weights for policy 1, policy_version 367760 (0.0010) [2023-12-26 02:32:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 188841984. Throughput: 0: 8919.6, 1: 8610.6. Samples: 188858300. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:18,785][121949] Avg episode reward: [(0, '6318.650'), (1, '5492.696')] [2023-12-26 02:32:18,790][123090] Updated weights for policy 1, policy_version 367770 (0.0010) [2023-12-26 02:32:19,125][123091] Updated weights for policy 0, policy_version 369911 (0.0009) [2023-12-26 02:32:19,191][123091] Updated weights for policy 0, policy_version 369921 (0.0005) [2023-12-26 02:32:19,262][123091] Updated weights for policy 0, policy_version 369931 (0.0007) [2023-12-26 02:32:19,629][123090] Updated weights for policy 1, policy_version 367780 (0.0010) [2023-12-26 02:32:19,692][123090] Updated weights for policy 1, policy_version 367790 (0.0009) [2023-12-26 02:32:19,754][123090] Updated weights for policy 1, policy_version 367800 (0.0010) [2023-12-26 02:32:20,013][123091] Updated weights for policy 0, policy_version 369941 (0.0008) [2023-12-26 02:32:20,065][123091] Updated weights for policy 0, policy_version 369951 (0.0010) [2023-12-26 02:32:20,122][123091] Updated weights for policy 0, policy_version 369961 (0.0009) [2023-12-26 02:32:20,613][123090] Updated weights for policy 1, policy_version 367810 (0.0009) [2023-12-26 02:32:20,675][123090] Updated weights for policy 1, policy_version 367820 (0.0006) [2023-12-26 02:32:20,741][123090] Updated weights for policy 1, policy_version 367830 (0.0010) [2023-12-26 02:32:20,804][123090] Updated weights for policy 1, policy_version 367840 (0.0010) [2023-12-26 02:32:21,005][123091] Updated weights for policy 0, policy_version 369971 (0.0009) [2023-12-26 02:32:21,077][123091] Updated weights for policy 0, policy_version 369981 (0.0011) [2023-12-26 02:32:21,130][123091] Updated weights for policy 0, policy_version 369991 (0.0009) [2023-12-26 02:32:21,675][123090] Updated weights for policy 1, policy_version 367850 (0.0010) [2023-12-26 02:32:21,748][123090] Updated weights for policy 1, policy_version 367860 (0.0009) [2023-12-26 02:32:21,819][123090] Updated weights for policy 1, policy_version 367870 (0.0009) [2023-12-26 02:32:21,980][123091] Updated weights for policy 0, policy_version 370001 (0.0010) [2023-12-26 02:32:22,043][123091] Updated weights for policy 0, policy_version 370011 (0.0010) [2023-12-26 02:32:22,103][123091] Updated weights for policy 0, policy_version 370021 (0.0010) [2023-12-26 02:32:22,157][123091] Updated weights for policy 0, policy_version 370031 (0.0010) [2023-12-26 02:32:22,654][123090] Updated weights for policy 1, policy_version 367880 (0.0010) [2023-12-26 02:32:22,705][123090] Updated weights for policy 1, policy_version 367890 (0.0009) [2023-12-26 02:32:22,760][123090] Updated weights for policy 1, policy_version 367900 (0.0009) [2023-12-26 02:32:22,995][123091] Updated weights for policy 0, policy_version 370041 (0.0006) [2023-12-26 02:32:23,051][123091] Updated weights for policy 0, policy_version 370051 (0.0006) [2023-12-26 02:32:23,104][123091] Updated weights for policy 0, policy_version 370061 (0.0006) [2023-12-26 02:32:23,639][123090] Updated weights for policy 1, policy_version 367910 (0.0010) [2023-12-26 02:32:23,692][123090] Updated weights for policy 1, policy_version 367920 (0.0009) [2023-12-26 02:32:23,748][123090] Updated weights for policy 1, policy_version 367930 (0.0009) [2023-12-26 02:32:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 188932096. Throughput: 0: 8909.7, 1: 8517.9. Samples: 188908680. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:23,784][121949] Avg episode reward: [(0, '6339.688'), (1, '5530.979')] [2023-12-26 02:32:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000370064_94740480.pth... [2023-12-26 02:32:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000367936_94191616.pth... [2023-12-26 02:32:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000366944_93937664.pth [2023-12-26 02:32:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000369008_94470144.pth [2023-12-26 02:32:23,872][123091] Updated weights for policy 0, policy_version 370071 (0.0008) [2023-12-26 02:32:23,929][123091] Updated weights for policy 0, policy_version 370081 (0.0008) [2023-12-26 02:32:24,004][123091] Updated weights for policy 0, policy_version 370091 (0.0009) [2023-12-26 02:32:24,598][123090] Updated weights for policy 1, policy_version 367940 (0.0010) [2023-12-26 02:32:24,652][123090] Updated weights for policy 1, policy_version 367951 (0.0010) [2023-12-26 02:32:24,701][123090] Updated weights for policy 1, policy_version 367961 (0.0008) [2023-12-26 02:32:24,810][123091] Updated weights for policy 0, policy_version 370101 (0.0007) [2023-12-26 02:32:24,875][123091] Updated weights for policy 0, policy_version 370111 (0.0009) [2023-12-26 02:32:24,927][123091] Updated weights for policy 0, policy_version 370121 (0.0010) [2023-12-26 02:32:25,616][123090] Updated weights for policy 1, policy_version 367971 (0.0010) [2023-12-26 02:32:25,626][123091] Updated weights for policy 0, policy_version 370131 (0.0009) [2023-12-26 02:32:25,672][123090] Updated weights for policy 1, policy_version 367981 (0.0008) [2023-12-26 02:32:25,680][123091] Updated weights for policy 0, policy_version 370141 (0.0005) [2023-12-26 02:32:25,746][123091] Updated weights for policy 0, policy_version 370151 (0.0005) [2023-12-26 02:32:25,746][123090] Updated weights for policy 1, policy_version 367991 (0.0008) [2023-12-26 02:32:26,421][123091] Updated weights for policy 0, policy_version 370161 (0.0005) [2023-12-26 02:32:26,470][123091] Updated weights for policy 0, policy_version 370171 (0.0006) [2023-12-26 02:32:26,524][123091] Updated weights for policy 0, policy_version 370181 (0.0007) [2023-12-26 02:32:26,576][123091] Updated weights for policy 0, policy_version 370191 (0.0009) [2023-12-26 02:32:26,654][123090] Updated weights for policy 1, policy_version 368001 (0.0009) [2023-12-26 02:32:26,722][123090] Updated weights for policy 1, policy_version 368011 (0.0009) [2023-12-26 02:32:26,787][123090] Updated weights for policy 1, policy_version 368021 (0.0009) [2023-12-26 02:32:26,842][123090] Updated weights for policy 1, policy_version 368031 (0.0009) [2023-12-26 02:32:27,298][123091] Updated weights for policy 0, policy_version 370201 (0.0006) [2023-12-26 02:32:27,366][123091] Updated weights for policy 0, policy_version 370211 (0.0006) [2023-12-26 02:32:27,420][123091] Updated weights for policy 0, policy_version 370221 (0.0005) [2023-12-26 02:32:27,744][123090] Updated weights for policy 1, policy_version 368041 (0.0009) [2023-12-26 02:32:27,806][123090] Updated weights for policy 1, policy_version 368051 (0.0008) [2023-12-26 02:32:27,865][123090] Updated weights for policy 1, policy_version 368061 (0.0009) [2023-12-26 02:32:28,026][123091] Updated weights for policy 0, policy_version 370231 (0.0008) [2023-12-26 02:32:28,087][123091] Updated weights for policy 0, policy_version 370241 (0.0010) [2023-12-26 02:32:28,148][123091] Updated weights for policy 0, policy_version 370251 (0.0010) [2023-12-26 02:32:28,690][123090] Updated weights for policy 1, policy_version 368071 (0.0009) [2023-12-26 02:32:28,751][123090] Updated weights for policy 1, policy_version 368081 (0.0008) [2023-12-26 02:32:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 189014016. Throughput: 0: 9104.2, 1: 8378.9. Samples: 189013596. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:28,784][121949] Avg episode reward: [(0, '6260.114'), (1, '5759.511')] [2023-12-26 02:32:28,814][123090] Updated weights for policy 1, policy_version 368091 (0.0010) [2023-12-26 02:32:28,926][123091] Updated weights for policy 0, policy_version 370261 (0.0008) [2023-12-26 02:32:28,992][123091] Updated weights for policy 0, policy_version 370271 (0.0006) [2023-12-26 02:32:29,056][123091] Updated weights for policy 0, policy_version 370281 (0.0005) [2023-12-26 02:32:29,578][123090] Updated weights for policy 1, policy_version 368101 (0.0008) [2023-12-26 02:32:29,626][123090] Updated weights for policy 1, policy_version 368111 (0.0005) [2023-12-26 02:32:29,674][123090] Updated weights for policy 1, policy_version 368121 (0.0005) [2023-12-26 02:32:29,811][123091] Updated weights for policy 0, policy_version 370291 (0.0009) [2023-12-26 02:32:29,881][123091] Updated weights for policy 0, policy_version 370301 (0.0011) [2023-12-26 02:32:29,940][123091] Updated weights for policy 0, policy_version 370311 (0.0011) [2023-12-26 02:32:30,468][123090] Updated weights for policy 1, policy_version 368131 (0.0009) [2023-12-26 02:32:30,531][123090] Updated weights for policy 1, policy_version 368141 (0.0008) [2023-12-26 02:32:30,578][123090] Updated weights for policy 1, policy_version 368151 (0.0008) [2023-12-26 02:32:30,764][123091] Updated weights for policy 0, policy_version 370321 (0.0010) [2023-12-26 02:32:30,811][123091] Updated weights for policy 0, policy_version 370331 (0.0010) [2023-12-26 02:32:30,854][123091] Updated weights for policy 0, policy_version 370341 (0.0010) [2023-12-26 02:32:30,896][123091] Updated weights for policy 0, policy_version 370351 (0.0010) [2023-12-26 02:32:31,448][123090] Updated weights for policy 1, policy_version 368161 (0.0008) [2023-12-26 02:32:31,512][123090] Updated weights for policy 1, policy_version 368171 (0.0009) [2023-12-26 02:32:31,562][123090] Updated weights for policy 1, policy_version 368181 (0.0008) [2023-12-26 02:32:31,625][123090] Updated weights for policy 1, policy_version 368191 (0.0008) [2023-12-26 02:32:31,746][123091] Updated weights for policy 0, policy_version 370361 (0.0008) [2023-12-26 02:32:31,808][123091] Updated weights for policy 0, policy_version 370371 (0.0008) [2023-12-26 02:32:31,872][123091] Updated weights for policy 0, policy_version 370381 (0.0008) [2023-12-26 02:32:32,476][123090] Updated weights for policy 1, policy_version 368201 (0.0006) [2023-12-26 02:32:32,538][123090] Updated weights for policy 1, policy_version 368211 (0.0005) [2023-12-26 02:32:32,602][123090] Updated weights for policy 1, policy_version 368221 (0.0006) [2023-12-26 02:32:32,662][123091] Updated weights for policy 0, policy_version 370391 (0.0008) [2023-12-26 02:32:32,733][123091] Updated weights for policy 0, policy_version 370401 (0.0005) [2023-12-26 02:32:32,800][123091] Updated weights for policy 0, policy_version 370411 (0.0006) [2023-12-26 02:32:33,331][123090] Updated weights for policy 1, policy_version 368231 (0.0008) [2023-12-26 02:32:33,377][123090] Updated weights for policy 1, policy_version 368241 (0.0008) [2023-12-26 02:32:33,424][123090] Updated weights for policy 1, policy_version 368251 (0.0008) [2023-12-26 02:32:33,542][123091] Updated weights for policy 0, policy_version 370421 (0.0010) [2023-12-26 02:32:33,585][123091] Updated weights for policy 0, policy_version 370431 (0.0010) [2023-12-26 02:32:33,630][123091] Updated weights for policy 0, policy_version 370441 (0.0010) [2023-12-26 02:32:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 189112320. Throughput: 0: 9143.2, 1: 8350.4. Samples: 189118772. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:33,785][121949] Avg episode reward: [(0, '6136.225'), (1, '5727.431')] [2023-12-26 02:32:34,321][123091] Updated weights for policy 0, policy_version 370451 (0.0009) [2023-12-26 02:32:34,347][123090] Updated weights for policy 1, policy_version 368261 (0.0008) [2023-12-26 02:32:34,383][123091] Updated weights for policy 0, policy_version 370461 (0.0007) [2023-12-26 02:32:34,409][123090] Updated weights for policy 1, policy_version 368271 (0.0007) [2023-12-26 02:32:34,438][123091] Updated weights for policy 0, policy_version 370471 (0.0009) [2023-12-26 02:32:34,472][123090] Updated weights for policy 1, policy_version 368281 (0.0008) [2023-12-26 02:32:35,258][123091] Updated weights for policy 0, policy_version 370481 (0.0010) [2023-12-26 02:32:35,272][123090] Updated weights for policy 1, policy_version 368291 (0.0009) [2023-12-26 02:32:35,308][123091] Updated weights for policy 0, policy_version 370491 (0.0009) [2023-12-26 02:32:35,333][123090] Updated weights for policy 1, policy_version 368301 (0.0006) [2023-12-26 02:32:35,364][123091] Updated weights for policy 0, policy_version 370501 (0.0008) [2023-12-26 02:32:35,383][123090] Updated weights for policy 1, policy_version 368311 (0.0005) [2023-12-26 02:32:35,422][123091] Updated weights for policy 0, policy_version 370511 (0.0009) [2023-12-26 02:32:36,083][123090] Updated weights for policy 1, policy_version 368321 (0.0006) [2023-12-26 02:32:36,144][123090] Updated weights for policy 1, policy_version 368331 (0.0008) [2023-12-26 02:32:36,203][123090] Updated weights for policy 1, policy_version 368341 (0.0010) [2023-12-26 02:32:36,244][123091] Updated weights for policy 0, policy_version 370521 (0.0008) [2023-12-26 02:32:36,265][123090] Updated weights for policy 1, policy_version 368351 (0.0008) [2023-12-26 02:32:36,310][123091] Updated weights for policy 0, policy_version 370531 (0.0009) [2023-12-26 02:32:36,367][123091] Updated weights for policy 0, policy_version 370541 (0.0009) [2023-12-26 02:32:37,142][123090] Updated weights for policy 1, policy_version 368361 (0.0010) [2023-12-26 02:32:37,189][123091] Updated weights for policy 0, policy_version 370551 (0.0008) [2023-12-26 02:32:37,206][123090] Updated weights for policy 1, policy_version 368371 (0.0009) [2023-12-26 02:32:37,248][123091] Updated weights for policy 0, policy_version 370561 (0.0007) [2023-12-26 02:32:37,269][123090] Updated weights for policy 1, policy_version 368381 (0.0009) [2023-12-26 02:32:37,318][123091] Updated weights for policy 0, policy_version 370571 (0.0010) [2023-12-26 02:32:38,094][123090] Updated weights for policy 1, policy_version 368391 (0.0007) [2023-12-26 02:32:38,119][123091] Updated weights for policy 0, policy_version 370581 (0.0011) [2023-12-26 02:32:38,152][123090] Updated weights for policy 1, policy_version 368401 (0.0008) [2023-12-26 02:32:38,171][123091] Updated weights for policy 0, policy_version 370591 (0.0010) [2023-12-26 02:32:38,214][123090] Updated weights for policy 1, policy_version 368411 (0.0007) [2023-12-26 02:32:38,221][123091] Updated weights for policy 0, policy_version 370601 (0.0009) [2023-12-26 02:32:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 189194240. Throughput: 0: 9146.7, 1: 8414.6. Samples: 189172620. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:38,785][121949] Avg episode reward: [(0, '6233.401'), (1, '5705.462')] [2023-12-26 02:32:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000370608_94879744.pth... [2023-12-26 02:32:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000368416_94314496.pth... [2023-12-26 02:32:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000369552_94609408.pth [2023-12-26 02:32:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000367456_94068736.pth [2023-12-26 02:32:39,087][123090] Updated weights for policy 1, policy_version 368421 (0.0009) [2023-12-26 02:32:39,095][123091] Updated weights for policy 0, policy_version 370611 (0.0009) [2023-12-26 02:32:39,156][123091] Updated weights for policy 0, policy_version 370621 (0.0005) [2023-12-26 02:32:39,158][123090] Updated weights for policy 1, policy_version 368431 (0.0011) [2023-12-26 02:32:39,225][123090] Updated weights for policy 1, policy_version 368441 (0.0011) [2023-12-26 02:32:39,228][123091] Updated weights for policy 0, policy_version 370631 (0.0007) [2023-12-26 02:32:39,994][123091] Updated weights for policy 0, policy_version 370641 (0.0007) [2023-12-26 02:32:40,051][123090] Updated weights for policy 1, policy_version 368451 (0.0010) [2023-12-26 02:32:40,055][123091] Updated weights for policy 0, policy_version 370651 (0.0008) [2023-12-26 02:32:40,117][123091] Updated weights for policy 0, policy_version 370661 (0.0008) [2023-12-26 02:32:40,118][123090] Updated weights for policy 1, policy_version 368461 (0.0010) [2023-12-26 02:32:40,182][123091] Updated weights for policy 0, policy_version 370671 (0.0008) [2023-12-26 02:32:40,183][123090] Updated weights for policy 1, policy_version 368471 (0.0011) [2023-12-26 02:32:41,012][123090] Updated weights for policy 1, policy_version 368481 (0.0011) [2023-12-26 02:32:41,015][123091] Updated weights for policy 0, policy_version 370681 (0.0009) [2023-12-26 02:32:41,085][123090] Updated weights for policy 1, policy_version 368491 (0.0011) [2023-12-26 02:32:41,096][123091] Updated weights for policy 0, policy_version 370691 (0.0008) [2023-12-26 02:32:41,159][123090] Updated weights for policy 1, policy_version 368501 (0.0009) [2023-12-26 02:32:41,167][123091] Updated weights for policy 0, policy_version 370701 (0.0008) [2023-12-26 02:32:41,222][123090] Updated weights for policy 1, policy_version 368511 (0.0008) [2023-12-26 02:32:42,002][123091] Updated weights for policy 0, policy_version 370711 (0.0008) [2023-12-26 02:32:42,048][123090] Updated weights for policy 1, policy_version 368521 (0.0010) [2023-12-26 02:32:42,072][123091] Updated weights for policy 0, policy_version 370721 (0.0006) [2023-12-26 02:32:42,118][123090] Updated weights for policy 1, policy_version 368531 (0.0011) [2023-12-26 02:32:42,133][123091] Updated weights for policy 0, policy_version 370731 (0.0006) [2023-12-26 02:32:42,190][123090] Updated weights for policy 1, policy_version 368541 (0.0011) [2023-12-26 02:32:42,917][123090] Updated weights for policy 1, policy_version 368551 (0.0008) [2023-12-26 02:32:42,990][123090] Updated weights for policy 1, policy_version 368561 (0.0007) [2023-12-26 02:32:43,041][123091] Updated weights for policy 0, policy_version 370741 (0.0006) [2023-12-26 02:32:43,055][123090] Updated weights for policy 1, policy_version 368571 (0.0010) [2023-12-26 02:32:43,101][123091] Updated weights for policy 0, policy_version 370751 (0.0008) [2023-12-26 02:32:43,168][123091] Updated weights for policy 0, policy_version 370761 (0.0010) [2023-12-26 02:32:43,728][123090] Updated weights for policy 1, policy_version 368581 (0.0006) [2023-12-26 02:32:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 189276160. Throughput: 0: 9017.9, 1: 8410.1. Samples: 189273932. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:43,784][121949] Avg episode reward: [(0, '6274.984'), (1, '5774.533')] [2023-12-26 02:32:43,796][123090] Updated weights for policy 1, policy_version 368591 (0.0005) [2023-12-26 02:32:43,859][123090] Updated weights for policy 1, policy_version 368601 (0.0007) [2023-12-26 02:32:43,948][123091] Updated weights for policy 0, policy_version 370771 (0.0010) [2023-12-26 02:32:44,000][123091] Updated weights for policy 0, policy_version 370781 (0.0009) [2023-12-26 02:32:44,059][123091] Updated weights for policy 0, policy_version 370791 (0.0008) [2023-12-26 02:32:44,646][123090] Updated weights for policy 1, policy_version 368611 (0.0009) [2023-12-26 02:32:44,713][123090] Updated weights for policy 1, policy_version 368621 (0.0005) [2023-12-26 02:32:44,802][123090] Updated weights for policy 1, policy_version 368631 (0.0008) [2023-12-26 02:32:44,864][123091] Updated weights for policy 0, policy_version 370801 (0.0008) [2023-12-26 02:32:44,933][123091] Updated weights for policy 0, policy_version 370811 (0.0009) [2023-12-26 02:32:44,987][123091] Updated weights for policy 0, policy_version 370821 (0.0006) [2023-12-26 02:32:45,043][123091] Updated weights for policy 0, policy_version 370831 (0.0009) [2023-12-26 02:32:45,553][123090] Updated weights for policy 1, policy_version 368641 (0.0011) [2023-12-26 02:32:45,615][123090] Updated weights for policy 1, policy_version 368651 (0.0009) [2023-12-26 02:32:45,682][123090] Updated weights for policy 1, policy_version 368661 (0.0009) [2023-12-26 02:32:45,740][123090] Updated weights for policy 1, policy_version 368671 (0.0010) [2023-12-26 02:32:45,854][123091] Updated weights for policy 0, policy_version 370841 (0.0010) [2023-12-26 02:32:45,912][123091] Updated weights for policy 0, policy_version 370851 (0.0009) [2023-12-26 02:32:45,968][123091] Updated weights for policy 0, policy_version 370861 (0.0008) [2023-12-26 02:32:46,510][123090] Updated weights for policy 1, policy_version 368681 (0.0009) [2023-12-26 02:32:46,565][123090] Updated weights for policy 1, policy_version 368691 (0.0005) [2023-12-26 02:32:46,620][123090] Updated weights for policy 1, policy_version 368701 (0.0006) [2023-12-26 02:32:46,628][123091] Updated weights for policy 0, policy_version 370871 (0.0008) [2023-12-26 02:32:46,694][123091] Updated weights for policy 0, policy_version 370881 (0.0010) [2023-12-26 02:32:46,753][123091] Updated weights for policy 0, policy_version 370891 (0.0009) [2023-12-26 02:32:47,448][123090] Updated weights for policy 1, policy_version 368711 (0.0008) [2023-12-26 02:32:47,500][123090] Updated weights for policy 1, policy_version 368721 (0.0009) [2023-12-26 02:32:47,526][123091] Updated weights for policy 0, policy_version 370901 (0.0009) [2023-12-26 02:32:47,555][123090] Updated weights for policy 1, policy_version 368731 (0.0007) [2023-12-26 02:32:47,582][123091] Updated weights for policy 0, policy_version 370911 (0.0010) [2023-12-26 02:32:47,654][123091] Updated weights for policy 0, policy_version 370921 (0.0005) [2023-12-26 02:32:48,348][123091] Updated weights for policy 0, policy_version 370931 (0.0007) [2023-12-26 02:32:48,415][123091] Updated weights for policy 0, policy_version 370941 (0.0009) [2023-12-26 02:32:48,471][123090] Updated weights for policy 1, policy_version 368741 (0.0006) [2023-12-26 02:32:48,474][123091] Updated weights for policy 0, policy_version 370951 (0.0009) [2023-12-26 02:32:48,536][123090] Updated weights for policy 1, policy_version 368751 (0.0010) [2023-12-26 02:32:48,607][123090] Updated weights for policy 1, policy_version 368761 (0.0009) [2023-12-26 02:32:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 189374464. Throughput: 0: 9075.8, 1: 8439.2. Samples: 189382768. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:48,785][121949] Avg episode reward: [(0, '6286.416'), (1, '5815.442')] [2023-12-26 02:32:49,265][123091] Updated weights for policy 0, policy_version 370961 (0.0007) [2023-12-26 02:32:49,330][123091] Updated weights for policy 0, policy_version 370971 (0.0009) [2023-12-26 02:32:49,388][123091] Updated weights for policy 0, policy_version 370981 (0.0008) [2023-12-26 02:32:49,440][123090] Updated weights for policy 1, policy_version 368771 (0.0009) [2023-12-26 02:32:49,457][123091] Updated weights for policy 0, policy_version 370991 (0.0006) [2023-12-26 02:32:49,507][123090] Updated weights for policy 1, policy_version 368781 (0.0010) [2023-12-26 02:32:49,573][123090] Updated weights for policy 1, policy_version 368791 (0.0010) [2023-12-26 02:32:50,134][123091] Updated weights for policy 0, policy_version 371001 (0.0006) [2023-12-26 02:32:50,197][123091] Updated weights for policy 0, policy_version 371011 (0.0007) [2023-12-26 02:32:50,254][123091] Updated weights for policy 0, policy_version 371021 (0.0009) [2023-12-26 02:32:50,362][123090] Updated weights for policy 1, policy_version 368801 (0.0010) [2023-12-26 02:32:50,430][123090] Updated weights for policy 1, policy_version 368811 (0.0010) [2023-12-26 02:32:50,492][123090] Updated weights for policy 1, policy_version 368821 (0.0005) [2023-12-26 02:32:50,553][123090] Updated weights for policy 1, policy_version 368831 (0.0005) [2023-12-26 02:32:51,062][123091] Updated weights for policy 0, policy_version 371031 (0.0010) [2023-12-26 02:32:51,133][123091] Updated weights for policy 0, policy_version 371041 (0.0010) [2023-12-26 02:32:51,197][123091] Updated weights for policy 0, policy_version 371051 (0.0011) [2023-12-26 02:32:51,364][123090] Updated weights for policy 1, policy_version 368841 (0.0008) [2023-12-26 02:32:51,432][123090] Updated weights for policy 1, policy_version 368851 (0.0008) [2023-12-26 02:32:51,497][123090] Updated weights for policy 1, policy_version 368861 (0.0009) [2023-12-26 02:32:51,981][123091] Updated weights for policy 0, policy_version 371061 (0.0008) [2023-12-26 02:32:52,053][123091] Updated weights for policy 0, policy_version 371071 (0.0008) [2023-12-26 02:32:52,120][123091] Updated weights for policy 0, policy_version 371081 (0.0010) [2023-12-26 02:32:52,370][123090] Updated weights for policy 1, policy_version 368871 (0.0007) [2023-12-26 02:32:52,442][123090] Updated weights for policy 1, policy_version 368881 (0.0006) [2023-12-26 02:32:52,516][123090] Updated weights for policy 1, policy_version 368891 (0.0009) [2023-12-26 02:32:52,925][123091] Updated weights for policy 0, policy_version 371091 (0.0009) [2023-12-26 02:32:52,993][123091] Updated weights for policy 0, policy_version 371101 (0.0009) [2023-12-26 02:32:53,051][123091] Updated weights for policy 0, policy_version 371111 (0.0009) [2023-12-26 02:32:53,276][123090] Updated weights for policy 1, policy_version 368901 (0.0010) [2023-12-26 02:32:53,338][123090] Updated weights for policy 1, policy_version 368911 (0.0010) [2023-12-26 02:32:53,389][123090] Updated weights for policy 1, policy_version 368921 (0.0010) [2023-12-26 02:32:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 189456384. Throughput: 0: 9034.7, 1: 8460.2. Samples: 189434980. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:53,785][121949] Avg episode reward: [(0, '6189.078'), (1, '5819.612')] [2023-12-26 02:32:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000371120_95010816.pth... [2023-12-26 02:32:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000368928_94445568.pth... [2023-12-26 02:32:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000367936_94191616.pth [2023-12-26 02:32:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000370064_94740480.pth [2023-12-26 02:32:53,849][123091] Updated weights for policy 0, policy_version 371121 (0.0010) [2023-12-26 02:32:53,911][123091] Updated weights for policy 0, policy_version 371131 (0.0006) [2023-12-26 02:32:53,961][123091] Updated weights for policy 0, policy_version 371141 (0.0005) [2023-12-26 02:32:54,014][123091] Updated weights for policy 0, policy_version 371151 (0.0005) [2023-12-26 02:32:54,173][123090] Updated weights for policy 1, policy_version 368931 (0.0010) [2023-12-26 02:32:54,222][123090] Updated weights for policy 1, policy_version 368941 (0.0011) [2023-12-26 02:32:54,271][123090] Updated weights for policy 1, policy_version 368951 (0.0010) [2023-12-26 02:32:54,768][123091] Updated weights for policy 0, policy_version 371161 (0.0005) [2023-12-26 02:32:54,824][123091] Updated weights for policy 0, policy_version 371171 (0.0009) [2023-12-26 02:32:54,882][123091] Updated weights for policy 0, policy_version 371181 (0.0010) [2023-12-26 02:32:55,035][123090] Updated weights for policy 1, policy_version 368961 (0.0010) [2023-12-26 02:32:55,087][123090] Updated weights for policy 1, policy_version 368971 (0.0005) [2023-12-26 02:32:55,141][123090] Updated weights for policy 1, policy_version 368981 (0.0005) [2023-12-26 02:32:55,189][123090] Updated weights for policy 1, policy_version 368991 (0.0005) [2023-12-26 02:32:55,566][123091] Updated weights for policy 0, policy_version 371191 (0.0010) [2023-12-26 02:32:55,628][123091] Updated weights for policy 0, policy_version 371201 (0.0010) [2023-12-26 02:32:55,698][123091] Updated weights for policy 0, policy_version 371211 (0.0010) [2023-12-26 02:32:55,896][123090] Updated weights for policy 1, policy_version 369001 (0.0010) [2023-12-26 02:32:55,955][123090] Updated weights for policy 1, policy_version 369011 (0.0010) [2023-12-26 02:32:56,017][123090] Updated weights for policy 1, policy_version 369021 (0.0010) [2023-12-26 02:32:56,508][123091] Updated weights for policy 0, policy_version 371221 (0.0011) [2023-12-26 02:32:56,573][123091] Updated weights for policy 0, policy_version 371231 (0.0010) [2023-12-26 02:32:56,633][123091] Updated weights for policy 0, policy_version 371241 (0.0010) [2023-12-26 02:32:56,833][123090] Updated weights for policy 1, policy_version 369031 (0.0011) [2023-12-26 02:32:56,895][123090] Updated weights for policy 1, policy_version 369041 (0.0010) [2023-12-26 02:32:56,961][123090] Updated weights for policy 1, policy_version 369051 (0.0010) [2023-12-26 02:32:57,411][123091] Updated weights for policy 0, policy_version 371251 (0.0009) [2023-12-26 02:32:57,475][123091] Updated weights for policy 0, policy_version 371261 (0.0007) [2023-12-26 02:32:57,537][123091] Updated weights for policy 0, policy_version 371271 (0.0010) [2023-12-26 02:32:57,738][123090] Updated weights for policy 1, policy_version 369061 (0.0008) [2023-12-26 02:32:57,797][123090] Updated weights for policy 1, policy_version 369071 (0.0005) [2023-12-26 02:32:57,866][123090] Updated weights for policy 1, policy_version 369081 (0.0005) [2023-12-26 02:32:58,407][123091] Updated weights for policy 0, policy_version 371281 (0.0011) [2023-12-26 02:32:58,483][123091] Updated weights for policy 0, policy_version 371291 (0.0009) [2023-12-26 02:32:58,548][123091] Updated weights for policy 0, policy_version 371301 (0.0006) [2023-12-26 02:32:58,606][123091] Updated weights for policy 0, policy_version 371311 (0.0009) [2023-12-26 02:32:58,640][123090] Updated weights for policy 1, policy_version 369091 (0.0006) [2023-12-26 02:32:58,704][123090] Updated weights for policy 1, policy_version 369101 (0.0008) [2023-12-26 02:32:58,772][123090] Updated weights for policy 1, policy_version 369111 (0.0008) [2023-12-26 02:32:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 189546496. Throughput: 0: 9062.6, 1: 8518.7. Samples: 189542572. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:32:58,785][121949] Avg episode reward: [(0, '6253.956'), (1, '5787.165')] [2023-12-26 02:32:59,427][123091] Updated weights for policy 0, policy_version 371321 (0.0010) [2023-12-26 02:32:59,483][123091] Updated weights for policy 0, policy_version 371331 (0.0010) [2023-12-26 02:32:59,545][123091] Updated weights for policy 0, policy_version 371341 (0.0010) [2023-12-26 02:32:59,586][123090] Updated weights for policy 1, policy_version 369121 (0.0010) [2023-12-26 02:32:59,648][123090] Updated weights for policy 1, policy_version 369131 (0.0010) [2023-12-26 02:32:59,712][123090] Updated weights for policy 1, policy_version 369141 (0.0006) [2023-12-26 02:32:59,781][123090] Updated weights for policy 1, policy_version 369151 (0.0006) [2023-12-26 02:33:00,315][123091] Updated weights for policy 0, policy_version 371351 (0.0007) [2023-12-26 02:33:00,382][123091] Updated weights for policy 0, policy_version 371361 (0.0006) [2023-12-26 02:33:00,449][123091] Updated weights for policy 0, policy_version 371371 (0.0005) [2023-12-26 02:33:00,486][123090] Updated weights for policy 1, policy_version 369161 (0.0010) [2023-12-26 02:33:00,549][123090] Updated weights for policy 1, policy_version 369171 (0.0010) [2023-12-26 02:33:00,613][123090] Updated weights for policy 1, policy_version 369181 (0.0006) [2023-12-26 02:33:01,097][123091] Updated weights for policy 0, policy_version 371381 (0.0006) [2023-12-26 02:33:01,166][123091] Updated weights for policy 0, policy_version 371391 (0.0011) [2023-12-26 02:33:01,225][123091] Updated weights for policy 0, policy_version 371401 (0.0010) [2023-12-26 02:33:01,295][123090] Updated weights for policy 1, policy_version 369191 (0.0008) [2023-12-26 02:33:01,359][123090] Updated weights for policy 1, policy_version 369201 (0.0008) [2023-12-26 02:33:01,419][123090] Updated weights for policy 1, policy_version 369211 (0.0008) [2023-12-26 02:33:01,984][123091] Updated weights for policy 0, policy_version 371411 (0.0010) [2023-12-26 02:33:02,041][123091] Updated weights for policy 0, policy_version 371421 (0.0009) [2023-12-26 02:33:02,099][123091] Updated weights for policy 0, policy_version 371431 (0.0009) [2023-12-26 02:33:02,229][123090] Updated weights for policy 1, policy_version 369221 (0.0008) [2023-12-26 02:33:02,288][123090] Updated weights for policy 1, policy_version 369231 (0.0009) [2023-12-26 02:33:02,343][123090] Updated weights for policy 1, policy_version 369241 (0.0010) [2023-12-26 02:33:02,922][123091] Updated weights for policy 0, policy_version 371441 (0.0009) [2023-12-26 02:33:02,978][123091] Updated weights for policy 0, policy_version 371451 (0.0005) [2023-12-26 02:33:03,055][123091] Updated weights for policy 0, policy_version 371461 (0.0005) [2023-12-26 02:33:03,119][123090] Updated weights for policy 1, policy_version 369251 (0.0007) [2023-12-26 02:33:03,126][123091] Updated weights for policy 0, policy_version 371471 (0.0005) [2023-12-26 02:33:03,166][123090] Updated weights for policy 1, policy_version 369261 (0.0005) [2023-12-26 02:33:03,226][123090] Updated weights for policy 1, policy_version 369271 (0.0005) [2023-12-26 02:33:03,659][123091] Updated weights for policy 0, policy_version 371481 (0.0005) [2023-12-26 02:33:03,709][123091] Updated weights for policy 0, policy_version 371491 (0.0005) [2023-12-26 02:33:03,760][123091] Updated weights for policy 0, policy_version 371501 (0.0005) [2023-12-26 02:33:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 189644800. Throughput: 0: 9022.3, 1: 8667.0. Samples: 189654320. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:33:03,785][121949] Avg episode reward: [(0, '6274.039'), (1, '5800.742')] [2023-12-26 02:33:03,890][123090] Updated weights for policy 1, policy_version 369281 (0.0005) [2023-12-26 02:33:03,952][123090] Updated weights for policy 1, policy_version 369291 (0.0008) [2023-12-26 02:33:04,009][123090] Updated weights for policy 1, policy_version 369301 (0.0010) [2023-12-26 02:33:04,062][123090] Updated weights for policy 1, policy_version 369311 (0.0006) [2023-12-26 02:33:04,461][123091] Updated weights for policy 0, policy_version 371511 (0.0006) [2023-12-26 02:33:04,515][123091] Updated weights for policy 0, policy_version 371521 (0.0006) [2023-12-26 02:33:04,563][123091] Updated weights for policy 0, policy_version 371531 (0.0006) [2023-12-26 02:33:04,809][123090] Updated weights for policy 1, policy_version 369321 (0.0006) [2023-12-26 02:33:04,872][123090] Updated weights for policy 1, policy_version 369331 (0.0005) [2023-12-26 02:33:04,921][123090] Updated weights for policy 1, policy_version 369341 (0.0005) [2023-12-26 02:33:05,308][123091] Updated weights for policy 0, policy_version 371541 (0.0008) [2023-12-26 02:33:05,370][123091] Updated weights for policy 0, policy_version 371551 (0.0010) [2023-12-26 02:33:05,447][123091] Updated weights for policy 0, policy_version 371561 (0.0009) [2023-12-26 02:33:05,562][123090] Updated weights for policy 1, policy_version 369351 (0.0006) [2023-12-26 02:33:05,624][123090] Updated weights for policy 1, policy_version 369361 (0.0008) [2023-12-26 02:33:05,685][123090] Updated weights for policy 1, policy_version 369371 (0.0005) [2023-12-26 02:33:06,330][123091] Updated weights for policy 0, policy_version 371571 (0.0010) [2023-12-26 02:33:06,359][123090] Updated weights for policy 1, policy_version 369381 (0.0007) [2023-12-26 02:33:06,396][123091] Updated weights for policy 0, policy_version 371581 (0.0008) [2023-12-26 02:33:06,425][123090] Updated weights for policy 1, policy_version 369391 (0.0007) [2023-12-26 02:33:06,457][123091] Updated weights for policy 0, policy_version 371591 (0.0009) [2023-12-26 02:33:06,486][123090] Updated weights for policy 1, policy_version 369401 (0.0007) [2023-12-26 02:33:07,277][123090] Updated weights for policy 1, policy_version 369411 (0.0007) [2023-12-26 02:33:07,316][123091] Updated weights for policy 0, policy_version 371601 (0.0008) [2023-12-26 02:33:07,352][123090] Updated weights for policy 1, policy_version 369421 (0.0006) [2023-12-26 02:33:07,389][123091] Updated weights for policy 0, policy_version 371611 (0.0009) [2023-12-26 02:33:07,427][123090] Updated weights for policy 1, policy_version 369431 (0.0005) [2023-12-26 02:33:07,463][123091] Updated weights for policy 0, policy_version 371621 (0.0009) [2023-12-26 02:33:07,526][123091] Updated weights for policy 0, policy_version 371631 (0.0009) [2023-12-26 02:33:08,034][123090] Updated weights for policy 1, policy_version 369441 (0.0005) [2023-12-26 02:33:08,100][123090] Updated weights for policy 1, policy_version 369451 (0.0007) [2023-12-26 02:33:08,153][123090] Updated weights for policy 1, policy_version 369461 (0.0006) [2023-12-26 02:33:08,231][123090] Updated weights for policy 1, policy_version 369471 (0.0007) [2023-12-26 02:33:08,389][123091] Updated weights for policy 0, policy_version 371641 (0.0009) [2023-12-26 02:33:08,452][123091] Updated weights for policy 0, policy_version 371651 (0.0009) [2023-12-26 02:33:08,516][123091] Updated weights for policy 0, policy_version 371661 (0.0009) [2023-12-26 02:33:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 189734912. Throughput: 0: 9051.5, 1: 8772.9. Samples: 189710776. Policy #0 lag: (min: 22.0, avg: 45.3, max: 48.0) [2023-12-26 02:33:08,785][121949] Avg episode reward: [(0, '6282.265'), (1, '5725.983')] [2023-12-26 02:33:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000371664_95150080.pth... [2023-12-26 02:33:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000369472_94584832.pth... [2023-12-26 02:33:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000370608_94879744.pth [2023-12-26 02:33:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000368416_94314496.pth [2023-12-26 02:33:08,983][123090] Updated weights for policy 1, policy_version 369482 (0.0011) [2023-12-26 02:33:09,049][123090] Updated weights for policy 1, policy_version 369492 (0.0009) [2023-12-26 02:33:09,106][123090] Updated weights for policy 1, policy_version 369502 (0.0008) [2023-12-26 02:33:09,373][123091] Updated weights for policy 0, policy_version 371671 (0.0009) [2023-12-26 02:33:09,437][123091] Updated weights for policy 0, policy_version 371681 (0.0009) [2023-12-26 02:33:09,497][123091] Updated weights for policy 0, policy_version 371691 (0.0009) [2023-12-26 02:33:10,010][123090] Updated weights for policy 1, policy_version 369512 (0.0009) [2023-12-26 02:33:10,076][123090] Updated weights for policy 1, policy_version 369522 (0.0009) [2023-12-26 02:33:10,138][123090] Updated weights for policy 1, policy_version 369532 (0.0006) [2023-12-26 02:33:10,359][123091] Updated weights for policy 0, policy_version 371701 (0.0008) [2023-12-26 02:33:10,422][123091] Updated weights for policy 0, policy_version 371711 (0.0005) [2023-12-26 02:33:10,481][123091] Updated weights for policy 0, policy_version 371721 (0.0006) [2023-12-26 02:33:10,864][123090] Updated weights for policy 1, policy_version 369542 (0.0006) [2023-12-26 02:33:10,915][123090] Updated weights for policy 1, policy_version 369552 (0.0007) [2023-12-26 02:33:10,986][123090] Updated weights for policy 1, policy_version 369562 (0.0005) [2023-12-26 02:33:11,137][123091] Updated weights for policy 0, policy_version 371731 (0.0006) [2023-12-26 02:33:11,203][123091] Updated weights for policy 0, policy_version 371741 (0.0010) [2023-12-26 02:33:11,279][123091] Updated weights for policy 0, policy_version 371751 (0.0011) [2023-12-26 02:33:11,762][123090] Updated weights for policy 1, policy_version 369572 (0.0007) [2023-12-26 02:33:11,826][123090] Updated weights for policy 1, policy_version 369582 (0.0008) [2023-12-26 02:33:11,898][123090] Updated weights for policy 1, policy_version 369592 (0.0008) [2023-12-26 02:33:12,139][123091] Updated weights for policy 0, policy_version 371761 (0.0011) [2023-12-26 02:33:12,211][123091] Updated weights for policy 0, policy_version 371771 (0.0010) [2023-12-26 02:33:12,272][123091] Updated weights for policy 0, policy_version 371781 (0.0009) [2023-12-26 02:33:12,334][123091] Updated weights for policy 0, policy_version 371791 (0.0009) [2023-12-26 02:33:12,684][123090] Updated weights for policy 1, policy_version 369602 (0.0008) [2023-12-26 02:33:12,750][123090] Updated weights for policy 1, policy_version 369612 (0.0009) [2023-12-26 02:33:12,822][123090] Updated weights for policy 1, policy_version 369622 (0.0007) [2023-12-26 02:33:12,894][123090] Updated weights for policy 1, policy_version 369632 (0.0008) [2023-12-26 02:33:13,078][123091] Updated weights for policy 0, policy_version 371801 (0.0008) [2023-12-26 02:33:13,144][123091] Updated weights for policy 0, policy_version 371811 (0.0010) [2023-12-26 02:33:13,204][123091] Updated weights for policy 0, policy_version 371821 (0.0009) [2023-12-26 02:33:13,510][123090] Updated weights for policy 1, policy_version 369642 (0.0010) [2023-12-26 02:33:13,566][123090] Updated weights for policy 1, policy_version 369652 (0.0010) [2023-12-26 02:33:13,622][123090] Updated weights for policy 1, policy_version 369662 (0.0010) [2023-12-26 02:33:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 189825024. Throughput: 0: 8924.1, 1: 8909.8. Samples: 189816120. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:13,785][121949] Avg episode reward: [(0, '6321.091'), (1, '5651.987')] [2023-12-26 02:33:14,061][123091] Updated weights for policy 0, policy_version 371831 (0.0010) [2023-12-26 02:33:14,115][123091] Updated weights for policy 0, policy_version 371841 (0.0009) [2023-12-26 02:33:14,171][123091] Updated weights for policy 0, policy_version 371851 (0.0009) [2023-12-26 02:33:14,413][123090] Updated weights for policy 1, policy_version 369672 (0.0006) [2023-12-26 02:33:14,465][123090] Updated weights for policy 1, policy_version 369682 (0.0005) [2023-12-26 02:33:14,514][123090] Updated weights for policy 1, policy_version 369692 (0.0006) [2023-12-26 02:33:15,060][123091] Updated weights for policy 0, policy_version 371861 (0.0009) [2023-12-26 02:33:15,120][123091] Updated weights for policy 0, policy_version 371871 (0.0010) [2023-12-26 02:33:15,184][123091] Updated weights for policy 0, policy_version 371881 (0.0009) [2023-12-26 02:33:15,302][123090] Updated weights for policy 1, policy_version 369702 (0.0008) [2023-12-26 02:33:15,368][123090] Updated weights for policy 1, policy_version 369712 (0.0009) [2023-12-26 02:33:15,435][123090] Updated weights for policy 1, policy_version 369722 (0.0005) [2023-12-26 02:33:16,051][123091] Updated weights for policy 0, policy_version 371891 (0.0009) [2023-12-26 02:33:16,112][123091] Updated weights for policy 0, policy_version 371901 (0.0010) [2023-12-26 02:33:16,147][123090] Updated weights for policy 1, policy_version 369732 (0.0006) [2023-12-26 02:33:16,162][123091] Updated weights for policy 0, policy_version 371911 (0.0009) [2023-12-26 02:33:16,201][123090] Updated weights for policy 1, policy_version 369742 (0.0008) [2023-12-26 02:33:16,266][123090] Updated weights for policy 1, policy_version 369752 (0.0009) [2023-12-26 02:33:16,993][123091] Updated weights for policy 0, policy_version 371921 (0.0009) [2023-12-26 02:33:17,045][123091] Updated weights for policy 0, policy_version 371931 (0.0009) [2023-12-26 02:33:17,103][123091] Updated weights for policy 0, policy_version 371941 (0.0010) [2023-12-26 02:33:17,108][123090] Updated weights for policy 1, policy_version 369762 (0.0009) [2023-12-26 02:33:17,159][123091] Updated weights for policy 0, policy_version 371951 (0.0008) [2023-12-26 02:33:17,169][123090] Updated weights for policy 1, policy_version 369772 (0.0009) [2023-12-26 02:33:17,222][123090] Updated weights for policy 1, policy_version 369782 (0.0009) [2023-12-26 02:33:17,270][123090] Updated weights for policy 1, policy_version 369792 (0.0009) [2023-12-26 02:33:17,965][123091] Updated weights for policy 0, policy_version 371961 (0.0009) [2023-12-26 02:33:18,014][123091] Updated weights for policy 0, policy_version 371971 (0.0009) [2023-12-26 02:33:18,063][123091] Updated weights for policy 0, policy_version 371981 (0.0010) [2023-12-26 02:33:18,128][123090] Updated weights for policy 1, policy_version 369802 (0.0009) [2023-12-26 02:33:18,185][123090] Updated weights for policy 1, policy_version 369812 (0.0009) [2023-12-26 02:33:18,235][123090] Updated weights for policy 1, policy_version 369822 (0.0009) [2023-12-26 02:33:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 189906944. Throughput: 0: 8866.9, 1: 8952.5. Samples: 189920648. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:18,785][121949] Avg episode reward: [(0, '6305.060'), (1, '5768.731')] [2023-12-26 02:33:18,969][123091] Updated weights for policy 0, policy_version 371991 (0.0009) [2023-12-26 02:33:19,027][123091] Updated weights for policy 0, policy_version 372001 (0.0010) [2023-12-26 02:33:19,075][123090] Updated weights for policy 1, policy_version 369832 (0.0009) [2023-12-26 02:33:19,085][123091] Updated weights for policy 0, policy_version 372011 (0.0008) [2023-12-26 02:33:19,136][123090] Updated weights for policy 1, policy_version 369842 (0.0008) [2023-12-26 02:33:19,202][123090] Updated weights for policy 1, policy_version 369852 (0.0009) [2023-12-26 02:33:19,949][123091] Updated weights for policy 0, policy_version 372021 (0.0010) [2023-12-26 02:33:20,020][123091] Updated weights for policy 0, policy_version 372031 (0.0010) [2023-12-26 02:33:20,037][123090] Updated weights for policy 1, policy_version 369862 (0.0008) [2023-12-26 02:33:20,084][123091] Updated weights for policy 0, policy_version 372041 (0.0010) [2023-12-26 02:33:20,098][123090] Updated weights for policy 1, policy_version 369872 (0.0007) [2023-12-26 02:33:20,151][123090] Updated weights for policy 1, policy_version 369882 (0.0005) [2023-12-26 02:33:20,927][123090] Updated weights for policy 1, policy_version 369892 (0.0008) [2023-12-26 02:33:20,976][123091] Updated weights for policy 0, policy_version 372051 (0.0009) [2023-12-26 02:33:20,982][123090] Updated weights for policy 1, policy_version 369902 (0.0008) [2023-12-26 02:33:21,043][123091] Updated weights for policy 0, policy_version 372061 (0.0010) [2023-12-26 02:33:21,046][123090] Updated weights for policy 1, policy_version 369912 (0.0008) [2023-12-26 02:33:21,111][123091] Updated weights for policy 0, policy_version 372071 (0.0008) [2023-12-26 02:33:21,899][123090] Updated weights for policy 1, policy_version 369922 (0.0009) [2023-12-26 02:33:21,934][123091] Updated weights for policy 0, policy_version 372081 (0.0009) [2023-12-26 02:33:21,964][123090] Updated weights for policy 1, policy_version 369932 (0.0009) [2023-12-26 02:33:21,986][123091] Updated weights for policy 0, policy_version 372091 (0.0008) [2023-12-26 02:33:22,029][123090] Updated weights for policy 1, policy_version 369942 (0.0008) [2023-12-26 02:33:22,039][123091] Updated weights for policy 0, policy_version 372101 (0.0009) [2023-12-26 02:33:22,100][123090] Updated weights for policy 1, policy_version 369952 (0.0007) [2023-12-26 02:33:22,107][123091] Updated weights for policy 0, policy_version 372111 (0.0010) [2023-12-26 02:33:22,842][123090] Updated weights for policy 1, policy_version 369962 (0.0005) [2023-12-26 02:33:22,913][123090] Updated weights for policy 1, policy_version 369972 (0.0008) [2023-12-26 02:33:22,992][123090] Updated weights for policy 1, policy_version 369982 (0.0008) [2023-12-26 02:33:23,018][123091] Updated weights for policy 0, policy_version 372121 (0.0009) [2023-12-26 02:33:23,081][123091] Updated weights for policy 0, policy_version 372131 (0.0010) [2023-12-26 02:33:23,151][123091] Updated weights for policy 0, policy_version 372141 (0.0008) [2023-12-26 02:33:23,740][123090] Updated weights for policy 1, policy_version 369992 (0.0010) [2023-12-26 02:33:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 189988864. Throughput: 0: 8810.8, 1: 8927.4. Samples: 189970844. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:23,785][121949] Avg episode reward: [(0, '6255.241'), (1, '5717.457')] [2023-12-26 02:33:23,791][123090] Updated weights for policy 1, policy_version 370002 (0.0010) [2023-12-26 02:33:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000372144_95272960.pth... [2023-12-26 02:33:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000371120_95010816.pth [2023-12-26 02:33:23,842][123090] Updated weights for policy 1, policy_version 370012 (0.0010) [2023-12-26 02:33:23,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000370016_94724096.pth... [2023-12-26 02:33:23,862][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000368928_94445568.pth [2023-12-26 02:33:23,977][123091] Updated weights for policy 0, policy_version 372151 (0.0008) [2023-12-26 02:33:24,035][123091] Updated weights for policy 0, policy_version 372161 (0.0009) [2023-12-26 02:33:24,087][123091] Updated weights for policy 0, policy_version 372171 (0.0009) [2023-12-26 02:33:24,639][123090] Updated weights for policy 1, policy_version 370022 (0.0010) [2023-12-26 02:33:24,702][123090] Updated weights for policy 1, policy_version 370032 (0.0010) [2023-12-26 02:33:24,761][123090] Updated weights for policy 1, policy_version 370042 (0.0010) [2023-12-26 02:33:24,981][123091] Updated weights for policy 0, policy_version 372181 (0.0009) [2023-12-26 02:33:25,048][123091] Updated weights for policy 0, policy_version 372191 (0.0009) [2023-12-26 02:33:25,123][123091] Updated weights for policy 0, policy_version 372201 (0.0009) [2023-12-26 02:33:25,562][123090] Updated weights for policy 1, policy_version 370052 (0.0008) [2023-12-26 02:33:25,631][123090] Updated weights for policy 1, policy_version 370062 (0.0005) [2023-12-26 02:33:25,692][123090] Updated weights for policy 1, policy_version 370072 (0.0005) [2023-12-26 02:33:25,995][123091] Updated weights for policy 0, policy_version 372211 (0.0010) [2023-12-26 02:33:26,057][123091] Updated weights for policy 0, policy_version 372221 (0.0010) [2023-12-26 02:33:26,133][123091] Updated weights for policy 0, policy_version 372231 (0.0010) [2023-12-26 02:33:26,357][123090] Updated weights for policy 1, policy_version 370082 (0.0005) [2023-12-26 02:33:26,419][123090] Updated weights for policy 1, policy_version 370092 (0.0005) [2023-12-26 02:33:26,480][123090] Updated weights for policy 1, policy_version 370102 (0.0005) [2023-12-26 02:33:26,539][123090] Updated weights for policy 1, policy_version 370112 (0.0005) [2023-12-26 02:33:27,007][123091] Updated weights for policy 0, policy_version 372241 (0.0009) [2023-12-26 02:33:27,077][123091] Updated weights for policy 0, policy_version 372251 (0.0005) [2023-12-26 02:33:27,153][123091] Updated weights for policy 0, policy_version 372261 (0.0005) [2023-12-26 02:33:27,222][123091] Updated weights for policy 0, policy_version 372271 (0.0006) [2023-12-26 02:33:27,264][123090] Updated weights for policy 1, policy_version 370122 (0.0013) [2023-12-26 02:33:27,331][123090] Updated weights for policy 1, policy_version 370132 (0.0008) [2023-12-26 02:33:27,396][123090] Updated weights for policy 1, policy_version 370142 (0.0008) [2023-12-26 02:33:27,937][123091] Updated weights for policy 0, policy_version 372281 (0.0007) [2023-12-26 02:33:28,024][123091] Updated weights for policy 0, policy_version 372291 (0.0006) [2023-12-26 02:33:28,086][123091] Updated weights for policy 0, policy_version 372301 (0.0008) [2023-12-26 02:33:28,191][123090] Updated weights for policy 1, policy_version 370152 (0.0006) [2023-12-26 02:33:28,247][123090] Updated weights for policy 1, policy_version 370162 (0.0005) [2023-12-26 02:33:28,300][123090] Updated weights for policy 1, policy_version 370172 (0.0005) [2023-12-26 02:33:28,736][123091] Updated weights for policy 0, policy_version 372311 (0.0007) [2023-12-26 02:33:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 190078976. Throughput: 0: 8778.5, 1: 9057.5. Samples: 190076552. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:28,784][121949] Avg episode reward: [(0, '6206.233'), (1, '5748.600')] [2023-12-26 02:33:28,805][123091] Updated weights for policy 0, policy_version 372321 (0.0006) [2023-12-26 02:33:28,867][123091] Updated weights for policy 0, policy_version 372331 (0.0008) [2023-12-26 02:33:29,171][123090] Updated weights for policy 1, policy_version 370183 (0.0010) [2023-12-26 02:33:29,241][123090] Updated weights for policy 1, policy_version 370193 (0.0009) [2023-12-26 02:33:29,298][123090] Updated weights for policy 1, policy_version 370203 (0.0010) [2023-12-26 02:33:29,583][123091] Updated weights for policy 0, policy_version 372341 (0.0006) [2023-12-26 02:33:29,649][123091] Updated weights for policy 0, policy_version 372351 (0.0010) [2023-12-26 02:33:29,712][123091] Updated weights for policy 0, policy_version 372361 (0.0009) [2023-12-26 02:33:30,188][123090] Updated weights for policy 1, policy_version 370213 (0.0010) [2023-12-26 02:33:30,247][123090] Updated weights for policy 1, policy_version 370223 (0.0009) [2023-12-26 02:33:30,309][123090] Updated weights for policy 1, policy_version 370233 (0.0010) [2023-12-26 02:33:30,472][123091] Updated weights for policy 0, policy_version 372371 (0.0009) [2023-12-26 02:33:30,532][123091] Updated weights for policy 0, policy_version 372381 (0.0010) [2023-12-26 02:33:30,585][123091] Updated weights for policy 0, policy_version 372391 (0.0009) [2023-12-26 02:33:31,156][123090] Updated weights for policy 1, policy_version 370243 (0.0009) [2023-12-26 02:33:31,232][123090] Updated weights for policy 1, policy_version 370253 (0.0005) [2023-12-26 02:33:31,301][123090] Updated weights for policy 1, policy_version 370263 (0.0006) [2023-12-26 02:33:31,346][123091] Updated weights for policy 0, policy_version 372402 (0.0010) [2023-12-26 02:33:31,417][123091] Updated weights for policy 0, policy_version 372412 (0.0009) [2023-12-26 02:33:31,474][123091] Updated weights for policy 0, policy_version 372422 (0.0008) [2023-12-26 02:33:31,544][123091] Updated weights for policy 0, policy_version 372432 (0.0009) [2023-12-26 02:33:32,038][123090] Updated weights for policy 1, policy_version 370273 (0.0008) [2023-12-26 02:33:32,109][123090] Updated weights for policy 1, policy_version 370283 (0.0009) [2023-12-26 02:33:32,170][123090] Updated weights for policy 1, policy_version 370293 (0.0009) [2023-12-26 02:33:32,225][123090] Updated weights for policy 1, policy_version 370303 (0.0009) [2023-12-26 02:33:32,290][123091] Updated weights for policy 0, policy_version 372442 (0.0007) [2023-12-26 02:33:32,354][123091] Updated weights for policy 0, policy_version 372452 (0.0006) [2023-12-26 02:33:32,417][123091] Updated weights for policy 0, policy_version 372462 (0.0008) [2023-12-26 02:33:33,075][123090] Updated weights for policy 1, policy_version 370313 (0.0010) [2023-12-26 02:33:33,125][123090] Updated weights for policy 1, policy_version 370323 (0.0009) [2023-12-26 02:33:33,175][123090] Updated weights for policy 1, policy_version 370333 (0.0009) [2023-12-26 02:33:33,197][123091] Updated weights for policy 0, policy_version 372472 (0.0009) [2023-12-26 02:33:33,246][123091] Updated weights for policy 0, policy_version 372482 (0.0008) [2023-12-26 02:33:33,305][123091] Updated weights for policy 0, policy_version 372492 (0.0010) [2023-12-26 02:33:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 190169088. Throughput: 0: 8781.4, 1: 8984.9. Samples: 190182256. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:33,785][121949] Avg episode reward: [(0, '6275.696'), (1, '5824.598')] [2023-12-26 02:33:33,926][123091] Updated weights for policy 0, policy_version 372502 (0.0009) [2023-12-26 02:33:33,989][123091] Updated weights for policy 0, policy_version 372512 (0.0010) [2023-12-26 02:33:34,044][123091] Updated weights for policy 0, policy_version 372522 (0.0009) [2023-12-26 02:33:34,055][123090] Updated weights for policy 1, policy_version 370343 (0.0010) [2023-12-26 02:33:34,131][123090] Updated weights for policy 1, policy_version 370353 (0.0009) [2023-12-26 02:33:34,208][123090] Updated weights for policy 1, policy_version 370363 (0.0010) [2023-12-26 02:33:34,810][123091] Updated weights for policy 0, policy_version 372532 (0.0008) [2023-12-26 02:33:34,880][123091] Updated weights for policy 0, policy_version 372542 (0.0008) [2023-12-26 02:33:34,942][123091] Updated weights for policy 0, policy_version 372552 (0.0009) [2023-12-26 02:33:35,063][123090] Updated weights for policy 1, policy_version 370373 (0.0010) [2023-12-26 02:33:35,132][123090] Updated weights for policy 1, policy_version 370383 (0.0009) [2023-12-26 02:33:35,193][123090] Updated weights for policy 1, policy_version 370393 (0.0009) [2023-12-26 02:33:35,637][123091] Updated weights for policy 0, policy_version 372562 (0.0009) [2023-12-26 02:33:35,690][123091] Updated weights for policy 0, policy_version 372572 (0.0008) [2023-12-26 02:33:35,754][123091] Updated weights for policy 0, policy_version 372582 (0.0006) [2023-12-26 02:33:35,810][123091] Updated weights for policy 0, policy_version 372592 (0.0006) [2023-12-26 02:33:36,083][123090] Updated weights for policy 1, policy_version 370403 (0.0010) [2023-12-26 02:33:36,146][123090] Updated weights for policy 1, policy_version 370413 (0.0009) [2023-12-26 02:33:36,209][123090] Updated weights for policy 1, policy_version 370423 (0.0010) [2023-12-26 02:33:36,482][123091] Updated weights for policy 0, policy_version 372602 (0.0009) [2023-12-26 02:33:36,543][123091] Updated weights for policy 0, policy_version 372612 (0.0007) [2023-12-26 02:33:36,598][123091] Updated weights for policy 0, policy_version 372622 (0.0009) [2023-12-26 02:33:37,094][123090] Updated weights for policy 1, policy_version 370433 (0.0010) [2023-12-26 02:33:37,154][123090] Updated weights for policy 1, policy_version 370443 (0.0010) [2023-12-26 02:33:37,204][123090] Updated weights for policy 1, policy_version 370453 (0.0010) [2023-12-26 02:33:37,395][123091] Updated weights for policy 0, policy_version 372632 (0.0006) [2023-12-26 02:33:37,453][123091] Updated weights for policy 0, policy_version 372642 (0.0007) [2023-12-26 02:33:37,513][123091] Updated weights for policy 0, policy_version 372652 (0.0010) [2023-12-26 02:33:38,078][123090] Updated weights for policy 1, policy_version 370465 (0.0010) [2023-12-26 02:33:38,133][123090] Updated weights for policy 1, policy_version 370475 (0.0006) [2023-12-26 02:33:38,181][123090] Updated weights for policy 1, policy_version 370485 (0.0006) [2023-12-26 02:33:38,234][123090] Updated weights for policy 1, policy_version 370495 (0.0010) [2023-12-26 02:33:38,278][123091] Updated weights for policy 0, policy_version 372662 (0.0006) [2023-12-26 02:33:38,339][123091] Updated weights for policy 0, policy_version 372672 (0.0007) [2023-12-26 02:33:38,407][123091] Updated weights for policy 0, policy_version 372682 (0.0008) [2023-12-26 02:33:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 190259200. Throughput: 0: 8844.0, 1: 8944.6. Samples: 190235468. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:38,785][121949] Avg episode reward: [(0, '6360.351'), (1, '5743.572')] [2023-12-26 02:33:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000372688_95412224.pth... [2023-12-26 02:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000370496_94846976.pth... [2023-12-26 02:33:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000371664_95150080.pth [2023-12-26 02:33:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000369472_94584832.pth [2023-12-26 02:33:39,088][123090] Updated weights for policy 1, policy_version 370505 (0.0010) [2023-12-26 02:33:39,151][123090] Updated weights for policy 1, policy_version 370515 (0.0010) [2023-12-26 02:33:39,196][123091] Updated weights for policy 0, policy_version 372692 (0.0009) [2023-12-26 02:33:39,214][123090] Updated weights for policy 1, policy_version 370525 (0.0010) [2023-12-26 02:33:39,268][123091] Updated weights for policy 0, policy_version 372702 (0.0011) [2023-12-26 02:33:39,334][123091] Updated weights for policy 0, policy_version 372712 (0.0011) [2023-12-26 02:33:40,046][123090] Updated weights for policy 1, policy_version 370535 (0.0011) [2023-12-26 02:33:40,114][123090] Updated weights for policy 1, policy_version 370545 (0.0011) [2023-12-26 02:33:40,178][123091] Updated weights for policy 0, policy_version 372722 (0.0009) [2023-12-26 02:33:40,183][123090] Updated weights for policy 1, policy_version 370555 (0.0011) [2023-12-26 02:33:40,243][123091] Updated weights for policy 0, policy_version 372732 (0.0007) [2023-12-26 02:33:40,311][123091] Updated weights for policy 0, policy_version 372742 (0.0009) [2023-12-26 02:33:40,382][123091] Updated weights for policy 0, policy_version 372752 (0.0008) [2023-12-26 02:33:40,934][123090] Updated weights for policy 1, policy_version 370565 (0.0008) [2023-12-26 02:33:41,010][123090] Updated weights for policy 1, policy_version 370575 (0.0007) [2023-12-26 02:33:41,081][123090] Updated weights for policy 1, policy_version 370585 (0.0009) [2023-12-26 02:33:41,248][123091] Updated weights for policy 0, policy_version 372762 (0.0009) [2023-12-26 02:33:41,304][123091] Updated weights for policy 0, policy_version 372772 (0.0009) [2023-12-26 02:33:41,373][123091] Updated weights for policy 0, policy_version 372782 (0.0009) [2023-12-26 02:33:41,883][123090] Updated weights for policy 1, policy_version 370595 (0.0008) [2023-12-26 02:33:41,946][123090] Updated weights for policy 1, policy_version 370605 (0.0006) [2023-12-26 02:33:42,016][123090] Updated weights for policy 1, policy_version 370615 (0.0006) [2023-12-26 02:33:42,258][123091] Updated weights for policy 0, policy_version 372792 (0.0007) [2023-12-26 02:33:42,324][123091] Updated weights for policy 0, policy_version 372802 (0.0008) [2023-12-26 02:33:42,396][123091] Updated weights for policy 0, policy_version 372812 (0.0010) [2023-12-26 02:33:42,830][123090] Updated weights for policy 1, policy_version 370625 (0.0009) [2023-12-26 02:33:42,894][123090] Updated weights for policy 1, policy_version 370635 (0.0009) [2023-12-26 02:33:42,957][123090] Updated weights for policy 1, policy_version 370645 (0.0009) [2023-12-26 02:33:43,028][123090] Updated weights for policy 1, policy_version 370655 (0.0009) [2023-12-26 02:33:43,230][123091] Updated weights for policy 0, policy_version 372822 (0.0006) [2023-12-26 02:33:43,294][123091] Updated weights for policy 0, policy_version 372832 (0.0006) [2023-12-26 02:33:43,353][123091] Updated weights for policy 0, policy_version 372842 (0.0009) [2023-12-26 02:33:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 190341120. Throughput: 0: 8779.5, 1: 8919.1. Samples: 190339012. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:43,785][121949] Avg episode reward: [(0, '6449.658'), (1, '5761.531')] [2023-12-26 02:33:43,804][123090] Updated weights for policy 1, policy_version 370665 (0.0010) [2023-12-26 02:33:43,855][123090] Updated weights for policy 1, policy_version 370675 (0.0010) [2023-12-26 02:33:43,906][123090] Updated weights for policy 1, policy_version 370685 (0.0010) [2023-12-26 02:33:44,047][123091] Updated weights for policy 0, policy_version 372852 (0.0008) [2023-12-26 02:33:44,106][123091] Updated weights for policy 0, policy_version 372862 (0.0006) [2023-12-26 02:33:44,160][123091] Updated weights for policy 0, policy_version 372872 (0.0010) [2023-12-26 02:33:44,637][123090] Updated weights for policy 1, policy_version 370695 (0.0009) [2023-12-26 02:33:44,688][123090] Updated weights for policy 1, policy_version 370705 (0.0005) [2023-12-26 02:33:44,738][123090] Updated weights for policy 1, policy_version 370715 (0.0005) [2023-12-26 02:33:44,933][123091] Updated weights for policy 0, policy_version 372882 (0.0010) [2023-12-26 02:33:45,000][123091] Updated weights for policy 0, policy_version 372892 (0.0010) [2023-12-26 02:33:45,067][123091] Updated weights for policy 0, policy_version 372902 (0.0009) [2023-12-26 02:33:45,137][123091] Updated weights for policy 0, policy_version 372912 (0.0009) [2023-12-26 02:33:45,365][123090] Updated weights for policy 1, policy_version 370725 (0.0006) [2023-12-26 02:33:45,423][123090] Updated weights for policy 1, policy_version 370735 (0.0005) [2023-12-26 02:33:45,492][123090] Updated weights for policy 1, policy_version 370745 (0.0006) [2023-12-26 02:33:46,013][123091] Updated weights for policy 0, policy_version 372922 (0.0005) [2023-12-26 02:33:46,065][123091] Updated weights for policy 0, policy_version 372932 (0.0005) [2023-12-26 02:33:46,122][123091] Updated weights for policy 0, policy_version 372942 (0.0005) [2023-12-26 02:33:46,141][123090] Updated weights for policy 1, policy_version 370755 (0.0007) [2023-12-26 02:33:46,195][123090] Updated weights for policy 1, policy_version 370765 (0.0009) [2023-12-26 02:33:46,253][123090] Updated weights for policy 1, policy_version 370775 (0.0005) [2023-12-26 02:33:46,770][123091] Updated weights for policy 0, policy_version 372952 (0.0010) [2023-12-26 02:33:46,826][123091] Updated weights for policy 0, policy_version 372962 (0.0010) [2023-12-26 02:33:46,882][123091] Updated weights for policy 0, policy_version 372972 (0.0010) [2023-12-26 02:33:46,981][123090] Updated weights for policy 1, policy_version 370785 (0.0006) [2023-12-26 02:33:47,040][123090] Updated weights for policy 1, policy_version 370795 (0.0010) [2023-12-26 02:33:47,091][123090] Updated weights for policy 1, policy_version 370805 (0.0010) [2023-12-26 02:33:47,142][123090] Updated weights for policy 1, policy_version 370815 (0.0010) [2023-12-26 02:33:47,737][123091] Updated weights for policy 0, policy_version 372982 (0.0010) [2023-12-26 02:33:47,786][123091] Updated weights for policy 0, policy_version 372992 (0.0008) [2023-12-26 02:33:47,845][123091] Updated weights for policy 0, policy_version 373002 (0.0010) [2023-12-26 02:33:47,950][123090] Updated weights for policy 1, policy_version 370825 (0.0007) [2023-12-26 02:33:48,014][123090] Updated weights for policy 1, policy_version 370835 (0.0007) [2023-12-26 02:33:48,080][123090] Updated weights for policy 1, policy_version 370845 (0.0006) [2023-12-26 02:33:48,676][123091] Updated weights for policy 0, policy_version 373012 (0.0010) [2023-12-26 02:33:48,739][123091] Updated weights for policy 0, policy_version 373022 (0.0011) [2023-12-26 02:33:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 190431232. Throughput: 0: 8728.3, 1: 8939.4. Samples: 190449364. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:48,785][121949] Avg episode reward: [(0, '6467.263'), (1, '5852.551')] [2023-12-26 02:33:48,800][123091] Updated weights for policy 0, policy_version 373032 (0.0009) [2023-12-26 02:33:48,858][123090] Updated weights for policy 1, policy_version 370855 (0.0010) [2023-12-26 02:33:48,914][123090] Updated weights for policy 1, policy_version 370865 (0.0010) [2023-12-26 02:33:48,965][123090] Updated weights for policy 1, policy_version 370875 (0.0010) [2023-12-26 02:33:49,616][123091] Updated weights for policy 0, policy_version 373042 (0.0010) [2023-12-26 02:33:49,669][123091] Updated weights for policy 0, policy_version 373052 (0.0005) [2023-12-26 02:33:49,719][123091] Updated weights for policy 0, policy_version 373062 (0.0006) [2023-12-26 02:33:49,731][123090] Updated weights for policy 1, policy_version 370885 (0.0010) [2023-12-26 02:33:49,774][123091] Updated weights for policy 0, policy_version 373072 (0.0008) [2023-12-26 02:33:49,790][123090] Updated weights for policy 1, policy_version 370895 (0.0010) [2023-12-26 02:33:49,857][123090] Updated weights for policy 1, policy_version 370905 (0.0010) [2023-12-26 02:33:50,576][123091] Updated weights for policy 0, policy_version 373082 (0.0011) [2023-12-26 02:33:50,648][123091] Updated weights for policy 0, policy_version 373092 (0.0011) [2023-12-26 02:33:50,712][123090] Updated weights for policy 1, policy_version 370915 (0.0009) [2023-12-26 02:33:50,712][123091] Updated weights for policy 0, policy_version 373102 (0.0011) [2023-12-26 02:33:50,778][123090] Updated weights for policy 1, policy_version 370925 (0.0008) [2023-12-26 02:33:50,851][123090] Updated weights for policy 1, policy_version 370935 (0.0007) [2023-12-26 02:33:51,536][123091] Updated weights for policy 0, policy_version 373112 (0.0009) [2023-12-26 02:33:51,596][123091] Updated weights for policy 0, policy_version 373122 (0.0009) [2023-12-26 02:33:51,663][123091] Updated weights for policy 0, policy_version 373132 (0.0010) [2023-12-26 02:33:51,687][123090] Updated weights for policy 1, policy_version 370945 (0.0007) [2023-12-26 02:33:51,758][123090] Updated weights for policy 1, policy_version 370955 (0.0010) [2023-12-26 02:33:51,822][123090] Updated weights for policy 1, policy_version 370965 (0.0008) [2023-12-26 02:33:51,883][123090] Updated weights for policy 1, policy_version 370975 (0.0010) [2023-12-26 02:33:52,558][123091] Updated weights for policy 0, policy_version 373142 (0.0009) [2023-12-26 02:33:52,621][123091] Updated weights for policy 0, policy_version 373152 (0.0008) [2023-12-26 02:33:52,637][123090] Updated weights for policy 1, policy_version 370985 (0.0008) [2023-12-26 02:33:52,686][123091] Updated weights for policy 0, policy_version 373162 (0.0008) [2023-12-26 02:33:52,689][123090] Updated weights for policy 1, policy_version 370995 (0.0009) [2023-12-26 02:33:52,747][123090] Updated weights for policy 1, policy_version 371005 (0.0006) [2023-12-26 02:33:53,526][123091] Updated weights for policy 0, policy_version 373172 (0.0009) [2023-12-26 02:33:53,577][123090] Updated weights for policy 1, policy_version 371015 (0.0010) [2023-12-26 02:33:53,587][123091] Updated weights for policy 0, policy_version 373182 (0.0007) [2023-12-26 02:33:53,634][123091] Updated weights for policy 0, policy_version 373192 (0.0009) [2023-12-26 02:33:53,647][123090] Updated weights for policy 1, policy_version 371025 (0.0007) [2023-12-26 02:33:53,701][123090] Updated weights for policy 1, policy_version 371035 (0.0006) [2023-12-26 02:33:53,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 190529536. Throughput: 0: 8704.7, 1: 8864.5. Samples: 190501392. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:53,785][121949] Avg episode reward: [(0, '6368.433'), (1, '5841.676')] [2023-12-26 02:33:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000371040_94986240.pth... [2023-12-26 02:33:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000373200_95543296.pth... [2023-12-26 02:33:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000370016_94724096.pth [2023-12-26 02:33:53,799][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000371040_94986240.pth [2023-12-26 02:33:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000372144_95272960.pth [2023-12-26 02:33:53,801][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000373200_95543296.pth [2023-12-26 02:33:54,373][123090] Updated weights for policy 1, policy_version 371045 (0.0009) [2023-12-26 02:33:54,431][123090] Updated weights for policy 1, policy_version 371056 (0.0009) [2023-12-26 02:33:54,449][123091] Updated weights for policy 0, policy_version 373202 (0.0008) [2023-12-26 02:33:54,482][123090] Updated weights for policy 1, policy_version 371066 (0.0010) [2023-12-26 02:33:54,502][123091] Updated weights for policy 0, policy_version 373212 (0.0007) [2023-12-26 02:33:54,548][123091] Updated weights for policy 0, policy_version 373222 (0.0008) [2023-12-26 02:33:54,597][123091] Updated weights for policy 0, policy_version 373232 (0.0009) [2023-12-26 02:33:55,277][123090] Updated weights for policy 1, policy_version 371076 (0.0007) [2023-12-26 02:33:55,325][123090] Updated weights for policy 1, policy_version 371086 (0.0005) [2023-12-26 02:33:55,371][123091] Updated weights for policy 0, policy_version 373242 (0.0005) [2023-12-26 02:33:55,372][123090] Updated weights for policy 1, policy_version 371096 (0.0005) [2023-12-26 02:33:55,421][123091] Updated weights for policy 0, policy_version 373252 (0.0005) [2023-12-26 02:33:55,481][123091] Updated weights for policy 0, policy_version 373262 (0.0005) [2023-12-26 02:33:56,057][123090] Updated weights for policy 1, policy_version 371106 (0.0006) [2023-12-26 02:33:56,128][123090] Updated weights for policy 1, policy_version 371116 (0.0010) [2023-12-26 02:33:56,199][123090] Updated weights for policy 1, policy_version 371126 (0.0009) [2023-12-26 02:33:56,263][123090] Updated weights for policy 1, policy_version 371136 (0.0009) [2023-12-26 02:33:56,283][123091] Updated weights for policy 0, policy_version 373272 (0.0009) [2023-12-26 02:33:56,336][123091] Updated weights for policy 0, policy_version 373282 (0.0009) [2023-12-26 02:33:56,388][123091] Updated weights for policy 0, policy_version 373293 (0.0009) [2023-12-26 02:33:57,037][123090] Updated weights for policy 1, policy_version 371146 (0.0009) [2023-12-26 02:33:57,088][123090] Updated weights for policy 1, policy_version 371156 (0.0009) [2023-12-26 02:33:57,143][123090] Updated weights for policy 1, policy_version 371166 (0.0009) [2023-12-26 02:33:57,254][123091] Updated weights for policy 0, policy_version 373303 (0.0009) [2023-12-26 02:33:57,319][123091] Updated weights for policy 0, policy_version 373313 (0.0009) [2023-12-26 02:33:57,382][123091] Updated weights for policy 0, policy_version 373323 (0.0010) [2023-12-26 02:33:57,917][123090] Updated weights for policy 1, policy_version 371176 (0.0009) [2023-12-26 02:33:57,970][123090] Updated weights for policy 1, policy_version 371186 (0.0009) [2023-12-26 02:33:58,041][123090] Updated weights for policy 1, policy_version 371196 (0.0009) [2023-12-26 02:33:58,224][123091] Updated weights for policy 0, policy_version 373333 (0.0009) [2023-12-26 02:33:58,287][123091] Updated weights for policy 0, policy_version 373343 (0.0010) [2023-12-26 02:33:58,356][123091] Updated weights for policy 0, policy_version 373353 (0.0009) [2023-12-26 02:33:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 190611456. Throughput: 0: 8715.9, 1: 8880.7. Samples: 190607968. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:33:58,785][121949] Avg episode reward: [(0, '6237.789'), (1, '5852.306')] [2023-12-26 02:33:58,997][123090] Updated weights for policy 1, policy_version 371206 (0.0009) [2023-12-26 02:33:59,064][123090] Updated weights for policy 1, policy_version 371216 (0.0010) [2023-12-26 02:33:59,127][123090] Updated weights for policy 1, policy_version 371226 (0.0010) [2023-12-26 02:33:59,205][123091] Updated weights for policy 0, policy_version 373363 (0.0007) [2023-12-26 02:33:59,296][123091] Updated weights for policy 0, policy_version 373373 (0.0009) [2023-12-26 02:33:59,356][123091] Updated weights for policy 0, policy_version 373383 (0.0009) [2023-12-26 02:33:59,865][123090] Updated weights for policy 1, policy_version 371236 (0.0010) [2023-12-26 02:33:59,929][123090] Updated weights for policy 1, policy_version 371246 (0.0010) [2023-12-26 02:33:59,980][123090] Updated weights for policy 1, policy_version 371256 (0.0010) [2023-12-26 02:34:00,141][123091] Updated weights for policy 0, policy_version 373393 (0.0009) [2023-12-26 02:34:00,207][123091] Updated weights for policy 0, policy_version 373403 (0.0009) [2023-12-26 02:34:00,265][123091] Updated weights for policy 0, policy_version 373413 (0.0009) [2023-12-26 02:34:00,329][123091] Updated weights for policy 0, policy_version 373423 (0.0010) [2023-12-26 02:34:00,760][123090] Updated weights for policy 1, policy_version 371266 (0.0010) [2023-12-26 02:34:00,822][123090] Updated weights for policy 1, policy_version 371276 (0.0008) [2023-12-26 02:34:00,888][123090] Updated weights for policy 1, policy_version 371286 (0.0005) [2023-12-26 02:34:00,942][123090] Updated weights for policy 1, policy_version 371296 (0.0005) [2023-12-26 02:34:01,223][123091] Updated weights for policy 0, policy_version 373433 (0.0010) [2023-12-26 02:34:01,286][123091] Updated weights for policy 0, policy_version 373443 (0.0010) [2023-12-26 02:34:01,337][123091] Updated weights for policy 0, policy_version 373453 (0.0006) [2023-12-26 02:34:01,697][123090] Updated weights for policy 1, policy_version 371306 (0.0007) [2023-12-26 02:34:01,766][123090] Updated weights for policy 1, policy_version 371316 (0.0008) [2023-12-26 02:34:01,819][123090] Updated weights for policy 1, policy_version 371326 (0.0010) [2023-12-26 02:34:02,158][123091] Updated weights for policy 0, policy_version 373463 (0.0008) [2023-12-26 02:34:02,231][123091] Updated weights for policy 0, policy_version 373473 (0.0007) [2023-12-26 02:34:02,297][123091] Updated weights for policy 0, policy_version 373483 (0.0008) [2023-12-26 02:34:02,612][123090] Updated weights for policy 1, policy_version 371336 (0.0009) [2023-12-26 02:34:02,674][123090] Updated weights for policy 1, policy_version 371346 (0.0010) [2023-12-26 02:34:02,722][123090] Updated weights for policy 1, policy_version 371356 (0.0010) [2023-12-26 02:34:03,070][123091] Updated weights for policy 0, policy_version 373493 (0.0009) [2023-12-26 02:34:03,121][123091] Updated weights for policy 0, policy_version 373503 (0.0010) [2023-12-26 02:34:03,167][123091] Updated weights for policy 0, policy_version 373513 (0.0010) [2023-12-26 02:34:03,553][123090] Updated weights for policy 1, policy_version 371366 (0.0010) [2023-12-26 02:34:03,600][123090] Updated weights for policy 1, policy_version 371376 (0.0010) [2023-12-26 02:34:03,648][123090] Updated weights for policy 1, policy_version 371386 (0.0010) [2023-12-26 02:34:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 190701568. Throughput: 0: 8733.3, 1: 8852.5. Samples: 190712012. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:03,785][121949] Avg episode reward: [(0, '6232.570'), (1, '5888.155')] [2023-12-26 02:34:03,837][123091] Updated weights for policy 0, policy_version 373523 (0.0010) [2023-12-26 02:34:03,888][123091] Updated weights for policy 0, policy_version 373533 (0.0009) [2023-12-26 02:34:03,941][123091] Updated weights for policy 0, policy_version 373543 (0.0009) [2023-12-26 02:34:04,505][123090] Updated weights for policy 1, policy_version 371396 (0.0010) [2023-12-26 02:34:04,572][123090] Updated weights for policy 1, policy_version 371406 (0.0011) [2023-12-26 02:34:04,632][123090] Updated weights for policy 1, policy_version 371416 (0.0010) [2023-12-26 02:34:04,779][123091] Updated weights for policy 0, policy_version 373553 (0.0009) [2023-12-26 02:34:04,842][123091] Updated weights for policy 0, policy_version 373563 (0.0008) [2023-12-26 02:34:04,902][123091] Updated weights for policy 0, policy_version 373573 (0.0009) [2023-12-26 02:34:04,950][123091] Updated weights for policy 0, policy_version 373583 (0.0009) [2023-12-26 02:34:05,460][123090] Updated weights for policy 1, policy_version 371426 (0.0010) [2023-12-26 02:34:05,508][123090] Updated weights for policy 1, policy_version 371436 (0.0010) [2023-12-26 02:34:05,559][123090] Updated weights for policy 1, policy_version 371446 (0.0010) [2023-12-26 02:34:05,611][123090] Updated weights for policy 1, policy_version 371456 (0.0010) [2023-12-26 02:34:05,709][123091] Updated weights for policy 0, policy_version 373593 (0.0006) [2023-12-26 02:34:05,782][123091] Updated weights for policy 0, policy_version 373603 (0.0005) [2023-12-26 02:34:05,853][123091] Updated weights for policy 0, policy_version 373613 (0.0005) [2023-12-26 02:34:06,451][123090] Updated weights for policy 1, policy_version 371466 (0.0006) [2023-12-26 02:34:06,517][123090] Updated weights for policy 1, policy_version 371476 (0.0005) [2023-12-26 02:34:06,532][123091] Updated weights for policy 0, policy_version 373623 (0.0009) [2023-12-26 02:34:06,592][123090] Updated weights for policy 1, policy_version 371486 (0.0007) [2023-12-26 02:34:06,596][123091] Updated weights for policy 0, policy_version 373633 (0.0011) [2023-12-26 02:34:06,653][123091] Updated weights for policy 0, policy_version 373643 (0.0011) [2023-12-26 02:34:07,270][123090] Updated weights for policy 1, policy_version 371496 (0.0007) [2023-12-26 02:34:07,320][123090] Updated weights for policy 1, policy_version 371506 (0.0005) [2023-12-26 02:34:07,371][123090] Updated weights for policy 1, policy_version 371516 (0.0005) [2023-12-26 02:34:07,409][123091] Updated weights for policy 0, policy_version 373653 (0.0008) [2023-12-26 02:34:07,482][123091] Updated weights for policy 0, policy_version 373663 (0.0005) [2023-12-26 02:34:07,549][123091] Updated weights for policy 0, policy_version 373673 (0.0005) [2023-12-26 02:34:08,043][123090] Updated weights for policy 1, policy_version 371526 (0.0005) [2023-12-26 02:34:08,095][123090] Updated weights for policy 1, policy_version 371536 (0.0005) [2023-12-26 02:34:08,156][123090] Updated weights for policy 1, policy_version 371546 (0.0008) [2023-12-26 02:34:08,208][123091] Updated weights for policy 0, policy_version 373683 (0.0007) [2023-12-26 02:34:08,255][123091] Updated weights for policy 0, policy_version 373693 (0.0010) [2023-12-26 02:34:08,302][123091] Updated weights for policy 0, policy_version 373703 (0.0010) [2023-12-26 02:34:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 190791680. Throughput: 0: 8812.4, 1: 8853.8. Samples: 190765820. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:08,785][121949] Avg episode reward: [(0, '6135.399'), (1, '5924.124')] [2023-12-26 02:34:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000373712_95674368.pth... [2023-12-26 02:34:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000371552_95117312.pth... [2023-12-26 02:34:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000372688_95412224.pth [2023-12-26 02:34:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000370496_94846976.pth [2023-12-26 02:34:08,966][123090] Updated weights for policy 1, policy_version 371556 (0.0010) [2023-12-26 02:34:09,032][123090] Updated weights for policy 1, policy_version 371566 (0.0011) [2023-12-26 02:34:09,067][123091] Updated weights for policy 0, policy_version 373713 (0.0010) [2023-12-26 02:34:09,104][123090] Updated weights for policy 1, policy_version 371576 (0.0011) [2023-12-26 02:34:09,140][123091] Updated weights for policy 0, policy_version 373723 (0.0006) [2023-12-26 02:34:09,199][123091] Updated weights for policy 0, policy_version 373733 (0.0011) [2023-12-26 02:34:09,257][123091] Updated weights for policy 0, policy_version 373743 (0.0010) [2023-12-26 02:34:09,907][123090] Updated weights for policy 1, policy_version 371586 (0.0011) [2023-12-26 02:34:09,976][123090] Updated weights for policy 1, policy_version 371596 (0.0012) [2023-12-26 02:34:10,043][123090] Updated weights for policy 1, policy_version 371606 (0.0009) [2023-12-26 02:34:10,118][123090] Updated weights for policy 1, policy_version 371616 (0.0009) [2023-12-26 02:34:10,121][123091] Updated weights for policy 0, policy_version 373753 (0.0007) [2023-12-26 02:34:10,178][123091] Updated weights for policy 0, policy_version 373763 (0.0009) [2023-12-26 02:34:10,269][123091] Updated weights for policy 0, policy_version 373773 (0.0009) [2023-12-26 02:34:10,884][123090] Updated weights for policy 1, policy_version 371626 (0.0009) [2023-12-26 02:34:10,936][123090] Updated weights for policy 1, policy_version 371636 (0.0010) [2023-12-26 02:34:10,996][123090] Updated weights for policy 1, policy_version 371646 (0.0007) [2023-12-26 02:34:11,084][123091] Updated weights for policy 0, policy_version 373783 (0.0010) [2023-12-26 02:34:11,145][123091] Updated weights for policy 0, policy_version 373793 (0.0011) [2023-12-26 02:34:11,208][123091] Updated weights for policy 0, policy_version 373803 (0.0011) [2023-12-26 02:34:11,861][123090] Updated weights for policy 1, policy_version 371656 (0.0008) [2023-12-26 02:34:11,928][123090] Updated weights for policy 1, policy_version 371666 (0.0009) [2023-12-26 02:34:11,998][123090] Updated weights for policy 1, policy_version 371676 (0.0009) [2023-12-26 02:34:12,085][123091] Updated weights for policy 0, policy_version 373813 (0.0011) [2023-12-26 02:34:12,145][123091] Updated weights for policy 0, policy_version 373823 (0.0011) [2023-12-26 02:34:12,211][123091] Updated weights for policy 0, policy_version 373833 (0.0011) [2023-12-26 02:34:12,855][123090] Updated weights for policy 1, policy_version 371686 (0.0009) [2023-12-26 02:34:12,920][123090] Updated weights for policy 1, policy_version 371696 (0.0010) [2023-12-26 02:34:12,979][123090] Updated weights for policy 1, policy_version 371706 (0.0010) [2023-12-26 02:34:12,999][123091] Updated weights for policy 0, policy_version 373843 (0.0010) [2023-12-26 02:34:13,069][123091] Updated weights for policy 0, policy_version 373853 (0.0009) [2023-12-26 02:34:13,137][123091] Updated weights for policy 0, policy_version 373863 (0.0006) [2023-12-26 02:34:13,691][123090] Updated weights for policy 1, policy_version 371716 (0.0007) [2023-12-26 02:34:13,729][123091] Updated weights for policy 0, policy_version 373873 (0.0005) [2023-12-26 02:34:13,746][123090] Updated weights for policy 1, policy_version 371726 (0.0005) [2023-12-26 02:34:13,781][123091] Updated weights for policy 0, policy_version 373883 (0.0006) [2023-12-26 02:34:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 190873600. Throughput: 0: 8890.5, 1: 8804.4. Samples: 190872820. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:13,785][121949] Avg episode reward: [(0, '6095.568'), (1, '5901.608')] [2023-12-26 02:34:13,813][123090] Updated weights for policy 1, policy_version 371736 (0.0006) [2023-12-26 02:34:13,837][123091] Updated weights for policy 0, policy_version 373893 (0.0006) [2023-12-26 02:34:13,905][123091] Updated weights for policy 0, policy_version 373903 (0.0007) [2023-12-26 02:34:14,457][123090] Updated weights for policy 1, policy_version 371746 (0.0006) [2023-12-26 02:34:14,545][123090] Updated weights for policy 1, policy_version 371756 (0.0006) [2023-12-26 02:34:14,612][123090] Updated weights for policy 1, policy_version 371766 (0.0006) [2023-12-26 02:34:14,659][123091] Updated weights for policy 0, policy_version 373913 (0.0009) [2023-12-26 02:34:14,674][123090] Updated weights for policy 1, policy_version 371776 (0.0008) [2023-12-26 02:34:14,720][123091] Updated weights for policy 0, policy_version 373923 (0.0010) [2023-12-26 02:34:14,784][123091] Updated weights for policy 0, policy_version 373934 (0.0010) [2023-12-26 02:34:15,343][123090] Updated weights for policy 1, policy_version 371786 (0.0010) [2023-12-26 02:34:15,401][123090] Updated weights for policy 1, policy_version 371796 (0.0009) [2023-12-26 02:34:15,458][123090] Updated weights for policy 1, policy_version 371806 (0.0007) [2023-12-26 02:34:15,706][123091] Updated weights for policy 0, policy_version 373944 (0.0010) [2023-12-26 02:34:15,766][123091] Updated weights for policy 0, policy_version 373954 (0.0009) [2023-12-26 02:34:15,818][123091] Updated weights for policy 0, policy_version 373964 (0.0010) [2023-12-26 02:34:16,252][123090] Updated weights for policy 1, policy_version 371816 (0.0009) [2023-12-26 02:34:16,310][123090] Updated weights for policy 1, policy_version 371826 (0.0010) [2023-12-26 02:34:16,363][123090] Updated weights for policy 1, policy_version 371837 (0.0010) [2023-12-26 02:34:16,592][123091] Updated weights for policy 0, policy_version 373974 (0.0009) [2023-12-26 02:34:16,641][123091] Updated weights for policy 0, policy_version 373985 (0.0009) [2023-12-26 02:34:16,689][123091] Updated weights for policy 0, policy_version 373995 (0.0009) [2023-12-26 02:34:17,166][123090] Updated weights for policy 1, policy_version 371847 (0.0007) [2023-12-26 02:34:17,216][123090] Updated weights for policy 1, policy_version 371857 (0.0009) [2023-12-26 02:34:17,270][123090] Updated weights for policy 1, policy_version 371867 (0.0007) [2023-12-26 02:34:17,596][123091] Updated weights for policy 0, policy_version 374005 (0.0010) [2023-12-26 02:34:17,649][123091] Updated weights for policy 0, policy_version 374017 (0.0010) [2023-12-26 02:34:17,698][123091] Updated weights for policy 0, policy_version 374027 (0.0009) [2023-12-26 02:34:18,076][123090] Updated weights for policy 1, policy_version 371877 (0.0006) [2023-12-26 02:34:18,133][123090] Updated weights for policy 1, policy_version 371888 (0.0010) [2023-12-26 02:34:18,181][123090] Updated weights for policy 1, policy_version 371898 (0.0008) [2023-12-26 02:34:18,544][123091] Updated weights for policy 0, policy_version 374037 (0.0008) [2023-12-26 02:34:18,621][123091] Updated weights for policy 0, policy_version 374047 (0.0010) [2023-12-26 02:34:18,698][123091] Updated weights for policy 0, policy_version 374057 (0.0009) [2023-12-26 02:34:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 190971904. Throughput: 0: 8823.7, 1: 8949.5. Samples: 190982048. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:18,785][121949] Avg episode reward: [(0, '6371.216'), (1, '5858.428')] [2023-12-26 02:34:18,848][123090] Updated weights for policy 1, policy_version 371908 (0.0007) [2023-12-26 02:34:18,919][123090] Updated weights for policy 1, policy_version 371918 (0.0005) [2023-12-26 02:34:18,991][123090] Updated weights for policy 1, policy_version 371928 (0.0005) [2023-12-26 02:34:19,580][123091] Updated weights for policy 0, policy_version 374067 (0.0010) [2023-12-26 02:34:19,646][123091] Updated weights for policy 0, policy_version 374077 (0.0010) [2023-12-26 02:34:19,696][123091] Updated weights for policy 0, policy_version 374087 (0.0009) [2023-12-26 02:34:19,735][123090] Updated weights for policy 1, policy_version 371938 (0.0007) [2023-12-26 02:34:19,808][123090] Updated weights for policy 1, policy_version 371948 (0.0007) [2023-12-26 02:34:19,874][123090] Updated weights for policy 1, policy_version 371958 (0.0009) [2023-12-26 02:34:19,927][123090] Updated weights for policy 1, policy_version 371968 (0.0009) [2023-12-26 02:34:20,568][123091] Updated weights for policy 0, policy_version 374097 (0.0010) [2023-12-26 02:34:20,642][123091] Updated weights for policy 0, policy_version 374107 (0.0008) [2023-12-26 02:34:20,706][123091] Updated weights for policy 0, policy_version 374117 (0.0008) [2023-12-26 02:34:20,764][123091] Updated weights for policy 0, policy_version 374127 (0.0006) [2023-12-26 02:34:20,798][123090] Updated weights for policy 1, policy_version 371978 (0.0009) [2023-12-26 02:34:20,867][123090] Updated weights for policy 1, policy_version 371988 (0.0010) [2023-12-26 02:34:20,929][123090] Updated weights for policy 1, policy_version 371998 (0.0009) [2023-12-26 02:34:21,563][123091] Updated weights for policy 0, policy_version 374137 (0.0008) [2023-12-26 02:34:21,621][123091] Updated weights for policy 0, policy_version 374147 (0.0008) [2023-12-26 02:34:21,681][123091] Updated weights for policy 0, policy_version 374157 (0.0008) [2023-12-26 02:34:21,788][123090] Updated weights for policy 1, policy_version 372008 (0.0009) [2023-12-26 02:34:21,838][123090] Updated weights for policy 1, policy_version 372018 (0.0008) [2023-12-26 02:34:21,888][123090] Updated weights for policy 1, policy_version 372028 (0.0009) [2023-12-26 02:34:22,513][123091] Updated weights for policy 0, policy_version 374167 (0.0010) [2023-12-26 02:34:22,562][123091] Updated weights for policy 0, policy_version 374177 (0.0011) [2023-12-26 02:34:22,618][123091] Updated weights for policy 0, policy_version 374187 (0.0011) [2023-12-26 02:34:22,770][123090] Updated weights for policy 1, policy_version 372038 (0.0010) [2023-12-26 02:34:22,823][123090] Updated weights for policy 1, policy_version 372048 (0.0009) [2023-12-26 02:34:22,877][123090] Updated weights for policy 1, policy_version 372058 (0.0009) [2023-12-26 02:34:23,327][123091] Updated weights for policy 0, policy_version 374197 (0.0010) [2023-12-26 02:34:23,375][123091] Updated weights for policy 0, policy_version 374207 (0.0009) [2023-12-26 02:34:23,425][123091] Updated weights for policy 0, policy_version 374217 (0.0007) [2023-12-26 02:34:23,751][123090] Updated weights for policy 1, policy_version 372068 (0.0009) [2023-12-26 02:34:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 191053824. Throughput: 0: 8721.5, 1: 9002.1. Samples: 191033032. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:23,785][121949] Avg episode reward: [(0, '6310.904'), (1, '5874.970')] [2023-12-26 02:34:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000374224_95805440.pth... [2023-12-26 02:34:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000373200_95543296.pth [2023-12-26 02:34:23,806][123090] Updated weights for policy 1, policy_version 372078 (0.0009) [2023-12-26 02:34:23,864][123090] Updated weights for policy 1, policy_version 372088 (0.0007) [2023-12-26 02:34:23,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000372096_95256576.pth... [2023-12-26 02:34:23,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000371040_94986240.pth [2023-12-26 02:34:24,200][123091] Updated weights for policy 0, policy_version 374227 (0.0009) [2023-12-26 02:34:24,252][123091] Updated weights for policy 0, policy_version 374237 (0.0011) [2023-12-26 02:34:24,307][123091] Updated weights for policy 0, policy_version 374247 (0.0011) [2023-12-26 02:34:24,661][123090] Updated weights for policy 1, policy_version 372098 (0.0006) [2023-12-26 02:34:24,716][123090] Updated weights for policy 1, policy_version 372108 (0.0008) [2023-12-26 02:34:24,768][123090] Updated weights for policy 1, policy_version 372118 (0.0005) [2023-12-26 02:34:24,834][123090] Updated weights for policy 1, policy_version 372128 (0.0005) [2023-12-26 02:34:25,116][123091] Updated weights for policy 0, policy_version 374257 (0.0010) [2023-12-26 02:34:25,185][123091] Updated weights for policy 0, policy_version 374267 (0.0010) [2023-12-26 02:34:25,257][123091] Updated weights for policy 0, policy_version 374277 (0.0011) [2023-12-26 02:34:25,321][123091] Updated weights for policy 0, policy_version 374287 (0.0011) [2023-12-26 02:34:25,618][123090] Updated weights for policy 1, policy_version 372138 (0.0010) [2023-12-26 02:34:25,666][123090] Updated weights for policy 1, policy_version 372148 (0.0010) [2023-12-26 02:34:25,718][123090] Updated weights for policy 1, policy_version 372159 (0.0009) [2023-12-26 02:34:26,080][123091] Updated weights for policy 0, policy_version 374297 (0.0006) [2023-12-26 02:34:26,129][123091] Updated weights for policy 0, policy_version 374307 (0.0005) [2023-12-26 02:34:26,178][123091] Updated weights for policy 0, policy_version 374317 (0.0005) [2023-12-26 02:34:26,590][123090] Updated weights for policy 1, policy_version 372169 (0.0011) [2023-12-26 02:34:26,653][123090] Updated weights for policy 1, policy_version 372179 (0.0010) [2023-12-26 02:34:26,709][123090] Updated weights for policy 1, policy_version 372189 (0.0010) [2023-12-26 02:34:27,014][123091] Updated weights for policy 0, policy_version 374327 (0.0010) [2023-12-26 02:34:27,065][123091] Updated weights for policy 0, policy_version 374337 (0.0010) [2023-12-26 02:34:27,115][123091] Updated weights for policy 0, policy_version 374347 (0.0010) [2023-12-26 02:34:27,499][123090] Updated weights for policy 1, policy_version 372199 (0.0007) [2023-12-26 02:34:27,564][123090] Updated weights for policy 1, policy_version 372209 (0.0008) [2023-12-26 02:34:27,623][123090] Updated weights for policy 1, policy_version 372219 (0.0010) [2023-12-26 02:34:27,957][123091] Updated weights for policy 0, policy_version 374357 (0.0010) [2023-12-26 02:34:28,015][123091] Updated weights for policy 0, policy_version 374367 (0.0011) [2023-12-26 02:34:28,084][123091] Updated weights for policy 0, policy_version 374377 (0.0010) [2023-12-26 02:34:28,420][123090] Updated weights for policy 1, policy_version 372229 (0.0010) [2023-12-26 02:34:28,475][123090] Updated weights for policy 1, policy_version 372239 (0.0010) [2023-12-26 02:34:28,538][123090] Updated weights for policy 1, policy_version 372249 (0.0010) [2023-12-26 02:34:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 191143936. Throughput: 0: 8779.4, 1: 8984.7. Samples: 191138392. Policy #0 lag: (min: 2.0, avg: 18.0, max: 34.0) [2023-12-26 02:34:28,785][121949] Avg episode reward: [(0, '6200.310'), (1, '5892.073')] [2023-12-26 02:34:28,872][123091] Updated weights for policy 0, policy_version 374387 (0.0007) [2023-12-26 02:34:28,935][123091] Updated weights for policy 0, policy_version 374397 (0.0011) [2023-12-26 02:34:28,996][123091] Updated weights for policy 0, policy_version 374407 (0.0010) [2023-12-26 02:34:29,374][123090] Updated weights for policy 1, policy_version 372259 (0.0011) [2023-12-26 02:34:29,441][123090] Updated weights for policy 1, policy_version 372269 (0.0011) [2023-12-26 02:34:29,500][123090] Updated weights for policy 1, policy_version 372279 (0.0010) [2023-12-26 02:34:29,721][123091] Updated weights for policy 0, policy_version 374417 (0.0010) [2023-12-26 02:34:29,778][123091] Updated weights for policy 0, policy_version 374427 (0.0006) [2023-12-26 02:34:29,829][123091] Updated weights for policy 0, policy_version 374437 (0.0010) [2023-12-26 02:34:29,891][123091] Updated weights for policy 0, policy_version 374447 (0.0011) [2023-12-26 02:34:30,340][123090] Updated weights for policy 1, policy_version 372289 (0.0010) [2023-12-26 02:34:30,402][123090] Updated weights for policy 1, policy_version 372299 (0.0010) [2023-12-26 02:34:30,461][123090] Updated weights for policy 1, policy_version 372309 (0.0010) [2023-12-26 02:34:30,517][123090] Updated weights for policy 1, policy_version 372319 (0.0010) [2023-12-26 02:34:30,736][123091] Updated weights for policy 0, policy_version 374457 (0.0010) [2023-12-26 02:34:30,786][123091] Updated weights for policy 0, policy_version 374467 (0.0009) [2023-12-26 02:34:30,838][123091] Updated weights for policy 0, policy_version 374477 (0.0005) [2023-12-26 02:34:31,329][123090] Updated weights for policy 1, policy_version 372329 (0.0010) [2023-12-26 02:34:31,401][123090] Updated weights for policy 1, policy_version 372339 (0.0009) [2023-12-26 02:34:31,455][123090] Updated weights for policy 1, policy_version 372349 (0.0010) [2023-12-26 02:34:31,608][123091] Updated weights for policy 0, policy_version 374487 (0.0007) [2023-12-26 02:34:31,675][123091] Updated weights for policy 0, policy_version 374497 (0.0008) [2023-12-26 02:34:31,745][123091] Updated weights for policy 0, policy_version 374507 (0.0006) [2023-12-26 02:34:32,359][123090] Updated weights for policy 1, policy_version 372359 (0.0009) [2023-12-26 02:34:32,425][123090] Updated weights for policy 1, policy_version 372369 (0.0008) [2023-12-26 02:34:32,426][123091] Updated weights for policy 0, policy_version 374517 (0.0008) [2023-12-26 02:34:32,484][123090] Updated weights for policy 1, policy_version 372379 (0.0007) [2023-12-26 02:34:32,489][123091] Updated weights for policy 0, policy_version 374527 (0.0010) [2023-12-26 02:34:32,552][123091] Updated weights for policy 0, policy_version 374537 (0.0010) [2023-12-26 02:34:33,280][123091] Updated weights for policy 0, policy_version 374547 (0.0010) [2023-12-26 02:34:33,336][123090] Updated weights for policy 1, policy_version 372389 (0.0007) [2023-12-26 02:34:33,337][123091] Updated weights for policy 0, policy_version 374557 (0.0009) [2023-12-26 02:34:33,385][123091] Updated weights for policy 0, policy_version 374567 (0.0007) [2023-12-26 02:34:33,397][123090] Updated weights for policy 1, policy_version 372399 (0.0007) [2023-12-26 02:34:33,463][123090] Updated weights for policy 1, policy_version 372409 (0.0005) [2023-12-26 02:34:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 191234048. Throughput: 0: 8799.8, 1: 8869.0. Samples: 191244460. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:33,785][121949] Avg episode reward: [(0, '6170.709'), (1, '5890.462')] [2023-12-26 02:34:34,055][123090] Updated weights for policy 1, policy_version 372419 (0.0007) [2023-12-26 02:34:34,108][123090] Updated weights for policy 1, policy_version 372429 (0.0009) [2023-12-26 02:34:34,167][123090] Updated weights for policy 1, policy_version 372439 (0.0009) [2023-12-26 02:34:34,251][123091] Updated weights for policy 0, policy_version 374577 (0.0009) [2023-12-26 02:34:34,298][123091] Updated weights for policy 0, policy_version 374587 (0.0008) [2023-12-26 02:34:34,354][123091] Updated weights for policy 0, policy_version 374597 (0.0008) [2023-12-26 02:34:34,410][123091] Updated weights for policy 0, policy_version 374607 (0.0008) [2023-12-26 02:34:35,078][123090] Updated weights for policy 1, policy_version 372449 (0.0009) [2023-12-26 02:34:35,133][123090] Updated weights for policy 1, policy_version 372459 (0.0009) [2023-12-26 02:34:35,189][123090] Updated weights for policy 1, policy_version 372469 (0.0009) [2023-12-26 02:34:35,234][123091] Updated weights for policy 0, policy_version 374617 (0.0008) [2023-12-26 02:34:35,255][123090] Updated weights for policy 1, policy_version 372479 (0.0007) [2023-12-26 02:34:35,289][123091] Updated weights for policy 0, policy_version 374627 (0.0008) [2023-12-26 02:34:35,356][123091] Updated weights for policy 0, policy_version 374637 (0.0009) [2023-12-26 02:34:36,113][123091] Updated weights for policy 0, policy_version 374647 (0.0008) [2023-12-26 02:34:36,121][123090] Updated weights for policy 1, policy_version 372489 (0.0008) [2023-12-26 02:34:36,175][123091] Updated weights for policy 0, policy_version 374657 (0.0011) [2023-12-26 02:34:36,178][123090] Updated weights for policy 1, policy_version 372499 (0.0008) [2023-12-26 02:34:36,236][123090] Updated weights for policy 1, policy_version 372509 (0.0009) [2023-12-26 02:34:36,238][123091] Updated weights for policy 0, policy_version 374667 (0.0010) [2023-12-26 02:34:37,059][123091] Updated weights for policy 0, policy_version 374677 (0.0011) [2023-12-26 02:34:37,117][123090] Updated weights for policy 1, policy_version 372519 (0.0008) [2023-12-26 02:34:37,123][123091] Updated weights for policy 0, policy_version 374687 (0.0011) [2023-12-26 02:34:37,173][123090] Updated weights for policy 1, policy_version 372529 (0.0007) [2023-12-26 02:34:37,181][123091] Updated weights for policy 0, policy_version 374697 (0.0010) [2023-12-26 02:34:37,226][123090] Updated weights for policy 1, policy_version 372539 (0.0007) [2023-12-26 02:34:38,030][123091] Updated weights for policy 0, policy_version 374707 (0.0011) [2023-12-26 02:34:38,053][123090] Updated weights for policy 1, policy_version 372549 (0.0007) [2023-12-26 02:34:38,089][123091] Updated weights for policy 0, policy_version 374717 (0.0011) [2023-12-26 02:34:38,114][123090] Updated weights for policy 1, policy_version 372559 (0.0007) [2023-12-26 02:34:38,149][123091] Updated weights for policy 0, policy_version 374727 (0.0011) [2023-12-26 02:34:38,162][123090] Updated weights for policy 1, policy_version 372569 (0.0008) [2023-12-26 02:34:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 191315968. Throughput: 0: 8805.6, 1: 8857.7. Samples: 191296240. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:38,785][121949] Avg episode reward: [(0, '6288.991'), (1, '5918.907')] [2023-12-26 02:34:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000374736_95936512.pth... [2023-12-26 02:34:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000372576_95379456.pth... [2023-12-26 02:34:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000373712_95674368.pth [2023-12-26 02:34:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000371552_95117312.pth [2023-12-26 02:34:38,908][123091] Updated weights for policy 0, policy_version 374737 (0.0010) [2023-12-26 02:34:38,937][123090] Updated weights for policy 1, policy_version 372579 (0.0007) [2023-12-26 02:34:38,969][123091] Updated weights for policy 0, policy_version 374747 (0.0009) [2023-12-26 02:34:39,007][123090] Updated weights for policy 1, policy_version 372589 (0.0008) [2023-12-26 02:34:39,025][123091] Updated weights for policy 0, policy_version 374757 (0.0008) [2023-12-26 02:34:39,076][123090] Updated weights for policy 1, policy_version 372599 (0.0008) [2023-12-26 02:34:39,078][123091] Updated weights for policy 0, policy_version 374767 (0.0009) [2023-12-26 02:34:39,849][123090] Updated weights for policy 1, policy_version 372609 (0.0006) [2023-12-26 02:34:39,916][123090] Updated weights for policy 1, policy_version 372619 (0.0008) [2023-12-26 02:34:39,958][123091] Updated weights for policy 0, policy_version 374777 (0.0008) [2023-12-26 02:34:39,983][123090] Updated weights for policy 1, policy_version 372629 (0.0008) [2023-12-26 02:34:40,026][123091] Updated weights for policy 0, policy_version 374787 (0.0008) [2023-12-26 02:34:40,047][123090] Updated weights for policy 1, policy_version 372639 (0.0008) [2023-12-26 02:34:40,087][123091] Updated weights for policy 0, policy_version 374797 (0.0009) [2023-12-26 02:34:40,797][123090] Updated weights for policy 1, policy_version 372649 (0.0006) [2023-12-26 02:34:40,852][123090] Updated weights for policy 1, policy_version 372659 (0.0006) [2023-12-26 02:34:40,918][123090] Updated weights for policy 1, policy_version 372669 (0.0010) [2023-12-26 02:34:40,966][123091] Updated weights for policy 0, policy_version 374808 (0.0009) [2023-12-26 02:34:41,026][123091] Updated weights for policy 0, policy_version 374818 (0.0009) [2023-12-26 02:34:41,089][123091] Updated weights for policy 0, policy_version 374828 (0.0010) [2023-12-26 02:34:41,751][123090] Updated weights for policy 1, policy_version 372679 (0.0009) [2023-12-26 02:34:41,817][123090] Updated weights for policy 1, policy_version 372689 (0.0009) [2023-12-26 02:34:41,877][123090] Updated weights for policy 1, policy_version 372699 (0.0009) [2023-12-26 02:34:42,010][123091] Updated weights for policy 0, policy_version 374838 (0.0009) [2023-12-26 02:34:42,084][123091] Updated weights for policy 0, policy_version 374848 (0.0011) [2023-12-26 02:34:42,151][123091] Updated weights for policy 0, policy_version 374858 (0.0011) [2023-12-26 02:34:42,719][123090] Updated weights for policy 1, policy_version 372709 (0.0009) [2023-12-26 02:34:42,768][123090] Updated weights for policy 1, policy_version 372719 (0.0009) [2023-12-26 02:34:42,821][123090] Updated weights for policy 1, policy_version 372729 (0.0009) [2023-12-26 02:34:43,001][123091] Updated weights for policy 0, policy_version 374868 (0.0010) [2023-12-26 02:34:43,052][123091] Updated weights for policy 0, policy_version 374878 (0.0010) [2023-12-26 02:34:43,115][123091] Updated weights for policy 0, policy_version 374888 (0.0011) [2023-12-26 02:34:43,689][123090] Updated weights for policy 1, policy_version 372739 (0.0009) [2023-12-26 02:34:43,752][123090] Updated weights for policy 1, policy_version 372749 (0.0009) [2023-12-26 02:34:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 191397888. Throughput: 0: 8777.9, 1: 8792.8. Samples: 191398652. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:43,785][121949] Avg episode reward: [(0, '6333.363'), (1, '5919.464')] [2023-12-26 02:34:43,816][123090] Updated weights for policy 1, policy_version 372759 (0.0008) [2023-12-26 02:34:43,937][123091] Updated weights for policy 0, policy_version 374898 (0.0011) [2023-12-26 02:34:44,004][123091] Updated weights for policy 0, policy_version 374908 (0.0010) [2023-12-26 02:34:44,059][123091] Updated weights for policy 0, policy_version 374918 (0.0011) [2023-12-26 02:34:44,120][123091] Updated weights for policy 0, policy_version 374928 (0.0010) [2023-12-26 02:34:44,627][123090] Updated weights for policy 1, policy_version 372769 (0.0009) [2023-12-26 02:34:44,683][123090] Updated weights for policy 1, policy_version 372779 (0.0009) [2023-12-26 02:34:44,737][123090] Updated weights for policy 1, policy_version 372789 (0.0007) [2023-12-26 02:34:44,782][123091] Updated weights for policy 0, policy_version 374938 (0.0007) [2023-12-26 02:34:44,802][123090] Updated weights for policy 1, policy_version 372799 (0.0009) [2023-12-26 02:34:44,852][123091] Updated weights for policy 0, policy_version 374948 (0.0007) [2023-12-26 02:34:44,915][123091] Updated weights for policy 0, policy_version 374958 (0.0009) [2023-12-26 02:34:45,557][123091] Updated weights for policy 0, policy_version 374969 (0.0006) [2023-12-26 02:34:45,624][123091] Updated weights for policy 0, policy_version 374979 (0.0006) [2023-12-26 02:34:45,683][123091] Updated weights for policy 0, policy_version 374989 (0.0009) [2023-12-26 02:34:45,699][123090] Updated weights for policy 1, policy_version 372809 (0.0009) [2023-12-26 02:34:45,772][123090] Updated weights for policy 1, policy_version 372819 (0.0009) [2023-12-26 02:34:45,832][123090] Updated weights for policy 1, policy_version 372829 (0.0010) [2023-12-26 02:34:46,470][123091] Updated weights for policy 0, policy_version 374999 (0.0009) [2023-12-26 02:34:46,534][123091] Updated weights for policy 0, policy_version 375009 (0.0009) [2023-12-26 02:34:46,590][123091] Updated weights for policy 0, policy_version 375019 (0.0009) [2023-12-26 02:34:46,653][123090] Updated weights for policy 1, policy_version 372839 (0.0008) [2023-12-26 02:34:46,714][123090] Updated weights for policy 1, policy_version 372849 (0.0009) [2023-12-26 02:34:46,767][123090] Updated weights for policy 1, policy_version 372859 (0.0006) [2023-12-26 02:34:47,335][123091] Updated weights for policy 0, policy_version 375029 (0.0007) [2023-12-26 02:34:47,387][123091] Updated weights for policy 0, policy_version 375039 (0.0005) [2023-12-26 02:34:47,461][123091] Updated weights for policy 0, policy_version 375049 (0.0005) [2023-12-26 02:34:47,645][123090] Updated weights for policy 1, policy_version 372869 (0.0008) [2023-12-26 02:34:47,702][123090] Updated weights for policy 1, policy_version 372879 (0.0009) [2023-12-26 02:34:47,756][123090] Updated weights for policy 1, policy_version 372889 (0.0009) [2023-12-26 02:34:48,114][123091] Updated weights for policy 0, policy_version 375059 (0.0005) [2023-12-26 02:34:48,165][123091] Updated weights for policy 0, policy_version 375069 (0.0006) [2023-12-26 02:34:48,222][123091] Updated weights for policy 0, policy_version 375079 (0.0006) [2023-12-26 02:34:48,647][123090] Updated weights for policy 1, policy_version 372899 (0.0009) [2023-12-26 02:34:48,704][123090] Updated weights for policy 1, policy_version 372909 (0.0009) [2023-12-26 02:34:48,761][123090] Updated weights for policy 1, policy_version 372919 (0.0009) [2023-12-26 02:34:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 191488000. Throughput: 0: 8880.4, 1: 8730.5. Samples: 191504500. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:48,785][121949] Avg episode reward: [(0, '6345.036'), (1, '5964.766')] [2023-12-26 02:34:49,056][123091] Updated weights for policy 0, policy_version 375089 (0.0010) [2023-12-26 02:34:49,111][123091] Updated weights for policy 0, policy_version 375099 (0.0010) [2023-12-26 02:34:49,158][123091] Updated weights for policy 0, policy_version 375109 (0.0010) [2023-12-26 02:34:49,206][123091] Updated weights for policy 0, policy_version 375119 (0.0010) [2023-12-26 02:34:49,612][123090] Updated weights for policy 1, policy_version 372929 (0.0009) [2023-12-26 02:34:49,662][123090] Updated weights for policy 1, policy_version 372939 (0.0009) [2023-12-26 02:34:49,727][123090] Updated weights for policy 1, policy_version 372949 (0.0010) [2023-12-26 02:34:49,790][123090] Updated weights for policy 1, policy_version 372959 (0.0008) [2023-12-26 02:34:50,054][123091] Updated weights for policy 0, policy_version 375129 (0.0010) [2023-12-26 02:34:50,118][123091] Updated weights for policy 0, policy_version 375139 (0.0011) [2023-12-26 02:34:50,181][123091] Updated weights for policy 0, policy_version 375149 (0.0011) [2023-12-26 02:34:50,622][123090] Updated weights for policy 1, policy_version 372969 (0.0009) [2023-12-26 02:34:50,687][123090] Updated weights for policy 1, policy_version 372979 (0.0010) [2023-12-26 02:34:50,748][123090] Updated weights for policy 1, policy_version 372989 (0.0010) [2023-12-26 02:34:50,975][123091] Updated weights for policy 0, policy_version 375159 (0.0010) [2023-12-26 02:34:51,044][123091] Updated weights for policy 0, policy_version 375169 (0.0008) [2023-12-26 02:34:51,106][123091] Updated weights for policy 0, policy_version 375179 (0.0006) [2023-12-26 02:34:51,561][123090] Updated weights for policy 1, policy_version 372999 (0.0010) [2023-12-26 02:34:51,629][123090] Updated weights for policy 1, policy_version 373009 (0.0009) [2023-12-26 02:34:51,704][123090] Updated weights for policy 1, policy_version 373019 (0.0009) [2023-12-26 02:34:51,876][123091] Updated weights for policy 0, policy_version 375189 (0.0007) [2023-12-26 02:34:51,927][123091] Updated weights for policy 0, policy_version 375199 (0.0007) [2023-12-26 02:34:51,988][123091] Updated weights for policy 0, policy_version 375209 (0.0006) [2023-12-26 02:34:52,553][123090] Updated weights for policy 1, policy_version 373029 (0.0010) [2023-12-26 02:34:52,626][123090] Updated weights for policy 1, policy_version 373039 (0.0009) [2023-12-26 02:34:52,693][123090] Updated weights for policy 1, policy_version 373049 (0.0009) [2023-12-26 02:34:52,734][123091] Updated weights for policy 0, policy_version 375219 (0.0006) [2023-12-26 02:34:52,803][123091] Updated weights for policy 0, policy_version 375229 (0.0006) [2023-12-26 02:34:52,858][123091] Updated weights for policy 0, policy_version 375239 (0.0006) [2023-12-26 02:34:53,514][123091] Updated weights for policy 0, policy_version 375249 (0.0005) [2023-12-26 02:34:53,578][123091] Updated weights for policy 0, policy_version 375259 (0.0009) [2023-12-26 02:34:53,597][123090] Updated weights for policy 1, policy_version 373059 (0.0008) [2023-12-26 02:34:53,640][123091] Updated weights for policy 0, policy_version 375269 (0.0011) [2023-12-26 02:34:53,657][123090] Updated weights for policy 1, policy_version 373069 (0.0009) [2023-12-26 02:34:53,699][123091] Updated weights for policy 0, policy_version 375279 (0.0011) [2023-12-26 02:34:53,722][123090] Updated weights for policy 1, policy_version 373079 (0.0009) [2023-12-26 02:34:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 191586304. Throughput: 0: 8831.5, 1: 8717.1. Samples: 191555504. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:53,785][121949] Avg episode reward: [(0, '6214.442'), (1, '6008.498')] [2023-12-26 02:34:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000375280_96075776.pth... [2023-12-26 02:34:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000373088_95510528.pth... [2023-12-26 02:34:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000374224_95805440.pth [2023-12-26 02:34:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000372096_95256576.pth [2023-12-26 02:34:54,415][123091] Updated weights for policy 0, policy_version 375289 (0.0006) [2023-12-26 02:34:54,481][123091] Updated weights for policy 0, policy_version 375299 (0.0007) [2023-12-26 02:34:54,548][123091] Updated weights for policy 0, policy_version 375309 (0.0005) [2023-12-26 02:34:54,582][123090] Updated weights for policy 1, policy_version 373089 (0.0009) [2023-12-26 02:34:54,642][123090] Updated weights for policy 1, policy_version 373099 (0.0011) [2023-12-26 02:34:54,700][123090] Updated weights for policy 1, policy_version 373110 (0.0010) [2023-12-26 02:34:54,759][123090] Updated weights for policy 1, policy_version 373120 (0.0010) [2023-12-26 02:34:55,190][123091] Updated weights for policy 0, policy_version 375319 (0.0005) [2023-12-26 02:34:55,261][123091] Updated weights for policy 0, policy_version 375329 (0.0006) [2023-12-26 02:34:55,329][123091] Updated weights for policy 0, policy_version 375339 (0.0005) [2023-12-26 02:34:55,723][123090] Updated weights for policy 1, policy_version 373131 (0.0010) [2023-12-26 02:34:55,777][123090] Updated weights for policy 1, policy_version 373141 (0.0010) [2023-12-26 02:34:55,831][123090] Updated weights for policy 1, policy_version 373152 (0.0010) [2023-12-26 02:34:55,940][123091] Updated weights for policy 0, policy_version 375349 (0.0005) [2023-12-26 02:34:55,987][123091] Updated weights for policy 0, policy_version 375359 (0.0005) [2023-12-26 02:34:56,035][123091] Updated weights for policy 0, policy_version 375369 (0.0005) [2023-12-26 02:34:56,628][123091] Updated weights for policy 0, policy_version 375379 (0.0005) [2023-12-26 02:34:56,682][123091] Updated weights for policy 0, policy_version 375389 (0.0005) [2023-12-26 02:34:56,720][123090] Updated weights for policy 1, policy_version 373162 (0.0007) [2023-12-26 02:34:56,743][123091] Updated weights for policy 0, policy_version 375399 (0.0005) [2023-12-26 02:34:56,771][123090] Updated weights for policy 1, policy_version 373172 (0.0010) [2023-12-26 02:34:56,826][123090] Updated weights for policy 1, policy_version 373182 (0.0010) [2023-12-26 02:34:57,367][123091] Updated weights for policy 0, policy_version 375409 (0.0006) [2023-12-26 02:34:57,433][123091] Updated weights for policy 0, policy_version 375419 (0.0010) [2023-12-26 02:34:57,485][123091] Updated weights for policy 0, policy_version 375429 (0.0009) [2023-12-26 02:34:57,532][123090] Updated weights for policy 1, policy_version 373192 (0.0007) [2023-12-26 02:34:57,538][123091] Updated weights for policy 0, policy_version 375439 (0.0008) [2023-12-26 02:34:57,577][123090] Updated weights for policy 1, policy_version 373202 (0.0006) [2023-12-26 02:34:57,627][123090] Updated weights for policy 1, policy_version 373213 (0.0008) [2023-12-26 02:34:58,413][123091] Updated weights for policy 0, policy_version 375449 (0.0008) [2023-12-26 02:34:58,457][123090] Updated weights for policy 1, policy_version 373223 (0.0008) [2023-12-26 02:34:58,491][123091] Updated weights for policy 0, policy_version 375459 (0.0008) [2023-12-26 02:34:58,530][123090] Updated weights for policy 1, policy_version 373233 (0.0007) [2023-12-26 02:34:58,557][123091] Updated weights for policy 0, policy_version 375469 (0.0008) [2023-12-26 02:34:58,596][123090] Updated weights for policy 1, policy_version 373243 (0.0008) [2023-12-26 02:34:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 191676416. Throughput: 0: 9015.3, 1: 8624.5. Samples: 191666612. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:34:58,785][121949] Avg episode reward: [(0, '6223.209'), (1, '5995.413')] [2023-12-26 02:34:59,421][123091] Updated weights for policy 0, policy_version 375479 (0.0006) [2023-12-26 02:34:59,477][123090] Updated weights for policy 1, policy_version 373253 (0.0007) [2023-12-26 02:34:59,486][123091] Updated weights for policy 0, policy_version 375489 (0.0005) [2023-12-26 02:34:59,536][123090] Updated weights for policy 1, policy_version 373263 (0.0006) [2023-12-26 02:34:59,552][123091] Updated weights for policy 0, policy_version 375499 (0.0006) [2023-12-26 02:34:59,599][123090] Updated weights for policy 1, policy_version 373273 (0.0008) [2023-12-26 02:35:00,244][123091] Updated weights for policy 0, policy_version 375509 (0.0007) [2023-12-26 02:35:00,301][123091] Updated weights for policy 0, policy_version 375519 (0.0009) [2023-12-26 02:35:00,344][123090] Updated weights for policy 1, policy_version 373283 (0.0007) [2023-12-26 02:35:00,360][123091] Updated weights for policy 0, policy_version 375529 (0.0008) [2023-12-26 02:35:00,405][123090] Updated weights for policy 1, policy_version 373293 (0.0008) [2023-12-26 02:35:00,455][123090] Updated weights for policy 1, policy_version 373303 (0.0008) [2023-12-26 02:35:01,103][123091] Updated weights for policy 0, policy_version 375539 (0.0008) [2023-12-26 02:35:01,173][123091] Updated weights for policy 0, policy_version 375549 (0.0009) [2023-12-26 02:35:01,236][123091] Updated weights for policy 0, policy_version 375559 (0.0006) [2023-12-26 02:35:01,297][123090] Updated weights for policy 1, policy_version 373313 (0.0008) [2023-12-26 02:35:01,372][123090] Updated weights for policy 1, policy_version 373323 (0.0006) [2023-12-26 02:35:01,434][123090] Updated weights for policy 1, policy_version 373333 (0.0007) [2023-12-26 02:35:01,489][123090] Updated weights for policy 1, policy_version 373343 (0.0008) [2023-12-26 02:35:02,029][123091] Updated weights for policy 0, policy_version 375569 (0.0008) [2023-12-26 02:35:02,081][123091] Updated weights for policy 0, policy_version 375579 (0.0009) [2023-12-26 02:35:02,134][123091] Updated weights for policy 0, policy_version 375589 (0.0010) [2023-12-26 02:35:02,187][123091] Updated weights for policy 0, policy_version 375599 (0.0009) [2023-12-26 02:35:02,232][123090] Updated weights for policy 1, policy_version 373353 (0.0006) [2023-12-26 02:35:02,306][123090] Updated weights for policy 1, policy_version 373363 (0.0009) [2023-12-26 02:35:02,377][123090] Updated weights for policy 1, policy_version 373373 (0.0010) [2023-12-26 02:35:02,946][123091] Updated weights for policy 0, policy_version 375609 (0.0006) [2023-12-26 02:35:02,996][123091] Updated weights for policy 0, policy_version 375619 (0.0005) [2023-12-26 02:35:03,042][123091] Updated weights for policy 0, policy_version 375629 (0.0005) [2023-12-26 02:35:03,107][123090] Updated weights for policy 1, policy_version 373383 (0.0008) [2023-12-26 02:35:03,162][123090] Updated weights for policy 1, policy_version 373393 (0.0009) [2023-12-26 02:35:03,209][123090] Updated weights for policy 1, policy_version 373403 (0.0005) [2023-12-26 02:35:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 191758336. Throughput: 0: 9040.0, 1: 8555.6. Samples: 191773848. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:03,784][121949] Avg episode reward: [(0, '6254.406'), (1, '5927.275')] [2023-12-26 02:35:03,786][123091] Updated weights for policy 0, policy_version 375639 (0.0009) [2023-12-26 02:35:03,853][123091] Updated weights for policy 0, policy_version 375649 (0.0010) [2023-12-26 02:35:03,920][123090] Updated weights for policy 1, policy_version 373413 (0.0006) [2023-12-26 02:35:03,920][123091] Updated weights for policy 0, policy_version 375659 (0.0011) [2023-12-26 02:35:03,999][123090] Updated weights for policy 1, policy_version 373423 (0.0007) [2023-12-26 02:35:04,065][123090] Updated weights for policy 1, policy_version 373433 (0.0006) [2023-12-26 02:35:04,726][123091] Updated weights for policy 0, policy_version 375669 (0.0009) [2023-12-26 02:35:04,771][123090] Updated weights for policy 1, policy_version 373443 (0.0006) [2023-12-26 02:35:04,774][123091] Updated weights for policy 0, policy_version 375679 (0.0010) [2023-12-26 02:35:04,837][123091] Updated weights for policy 0, policy_version 375689 (0.0010) [2023-12-26 02:35:04,838][123090] Updated weights for policy 1, policy_version 373453 (0.0008) [2023-12-26 02:35:04,887][123090] Updated weights for policy 1, policy_version 373463 (0.0007) [2023-12-26 02:35:05,565][123091] Updated weights for policy 0, policy_version 375699 (0.0009) [2023-12-26 02:35:05,585][123090] Updated weights for policy 1, policy_version 373473 (0.0009) [2023-12-26 02:35:05,638][123090] Updated weights for policy 1, policy_version 373483 (0.0005) [2023-12-26 02:35:05,641][123091] Updated weights for policy 0, policy_version 375709 (0.0005) [2023-12-26 02:35:05,687][123090] Updated weights for policy 1, policy_version 373493 (0.0005) [2023-12-26 02:35:05,717][123091] Updated weights for policy 0, policy_version 375719 (0.0005) [2023-12-26 02:35:05,737][123090] Updated weights for policy 1, policy_version 373503 (0.0005) [2023-12-26 02:35:06,463][123091] Updated weights for policy 0, policy_version 375729 (0.0006) [2023-12-26 02:35:06,509][123090] Updated weights for policy 1, policy_version 373513 (0.0010) [2023-12-26 02:35:06,527][123091] Updated weights for policy 0, policy_version 375739 (0.0011) [2023-12-26 02:35:06,574][123090] Updated weights for policy 1, policy_version 373523 (0.0010) [2023-12-26 02:35:06,591][123091] Updated weights for policy 0, policy_version 375749 (0.0011) [2023-12-26 02:35:06,631][123090] Updated weights for policy 1, policy_version 373533 (0.0010) [2023-12-26 02:35:06,655][123091] Updated weights for policy 0, policy_version 375759 (0.0011) [2023-12-26 02:35:07,477][123090] Updated weights for policy 1, policy_version 373543 (0.0008) [2023-12-26 02:35:07,486][123091] Updated weights for policy 0, policy_version 375769 (0.0011) [2023-12-26 02:35:07,547][123090] Updated weights for policy 1, policy_version 373553 (0.0007) [2023-12-26 02:35:07,553][123091] Updated weights for policy 0, policy_version 375779 (0.0011) [2023-12-26 02:35:07,605][123090] Updated weights for policy 1, policy_version 373563 (0.0007) [2023-12-26 02:35:07,620][123091] Updated weights for policy 0, policy_version 375789 (0.0011) [2023-12-26 02:35:08,396][123090] Updated weights for policy 1, policy_version 373573 (0.0008) [2023-12-26 02:35:08,430][123091] Updated weights for policy 0, policy_version 375799 (0.0011) [2023-12-26 02:35:08,455][123090] Updated weights for policy 1, policy_version 373583 (0.0010) [2023-12-26 02:35:08,494][123091] Updated weights for policy 0, policy_version 375809 (0.0011) [2023-12-26 02:35:08,515][123090] Updated weights for policy 1, policy_version 373593 (0.0010) [2023-12-26 02:35:08,550][123091] Updated weights for policy 0, policy_version 375819 (0.0010) [2023-12-26 02:35:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 191856640. Throughput: 0: 9108.8, 1: 8608.4. Samples: 191830304. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:08,785][121949] Avg episode reward: [(0, '6298.090'), (1, '5916.064')] [2023-12-26 02:35:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000373600_95641600.pth... [2023-12-26 02:35:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000375824_96215040.pth... [2023-12-26 02:35:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000372576_95379456.pth [2023-12-26 02:35:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000374736_95936512.pth [2023-12-26 02:35:09,356][123090] Updated weights for policy 1, policy_version 373603 (0.0010) [2023-12-26 02:35:09,379][123091] Updated weights for policy 0, policy_version 375829 (0.0010) [2023-12-26 02:35:09,413][123090] Updated weights for policy 1, policy_version 373613 (0.0010) [2023-12-26 02:35:09,448][123091] Updated weights for policy 0, policy_version 375839 (0.0011) [2023-12-26 02:35:09,478][123090] Updated weights for policy 1, policy_version 373623 (0.0011) [2023-12-26 02:35:09,508][123091] Updated weights for policy 0, policy_version 375849 (0.0011) [2023-12-26 02:35:10,290][123090] Updated weights for policy 1, policy_version 373633 (0.0010) [2023-12-26 02:35:10,357][123091] Updated weights for policy 0, policy_version 375859 (0.0010) [2023-12-26 02:35:10,364][123090] Updated weights for policy 1, policy_version 373643 (0.0009) [2023-12-26 02:35:10,421][123091] Updated weights for policy 0, policy_version 375869 (0.0006) [2023-12-26 02:35:10,429][123090] Updated weights for policy 1, policy_version 373653 (0.0011) [2023-12-26 02:35:10,480][123091] Updated weights for policy 0, policy_version 375879 (0.0006) [2023-12-26 02:35:10,493][123090] Updated weights for policy 1, policy_version 373663 (0.0011) [2023-12-26 02:35:11,174][123091] Updated weights for policy 0, policy_version 375889 (0.0006) [2023-12-26 02:35:11,234][123091] Updated weights for policy 0, policy_version 375899 (0.0008) [2023-12-26 02:35:11,252][123090] Updated weights for policy 1, policy_version 373673 (0.0008) [2023-12-26 02:35:11,305][123091] Updated weights for policy 0, policy_version 375909 (0.0008) [2023-12-26 02:35:11,315][123090] Updated weights for policy 1, policy_version 373683 (0.0007) [2023-12-26 02:35:11,375][123091] Updated weights for policy 0, policy_version 375919 (0.0008) [2023-12-26 02:35:11,377][123090] Updated weights for policy 1, policy_version 373693 (0.0010) [2023-12-26 02:35:12,136][123091] Updated weights for policy 0, policy_version 375929 (0.0008) [2023-12-26 02:35:12,195][123091] Updated weights for policy 0, policy_version 375939 (0.0008) [2023-12-26 02:35:12,227][123090] Updated weights for policy 1, policy_version 373703 (0.0014) [2023-12-26 02:35:12,257][123091] Updated weights for policy 0, policy_version 375949 (0.0008) [2023-12-26 02:35:12,290][123090] Updated weights for policy 1, policy_version 373713 (0.0010) [2023-12-26 02:35:12,363][123090] Updated weights for policy 1, policy_version 373723 (0.0011) [2023-12-26 02:35:13,069][123091] Updated weights for policy 0, policy_version 375959 (0.0008) [2023-12-26 02:35:13,118][123091] Updated weights for policy 0, policy_version 375969 (0.0009) [2023-12-26 02:35:13,184][123091] Updated weights for policy 0, policy_version 375979 (0.0010) [2023-12-26 02:35:13,196][123090] Updated weights for policy 1, policy_version 373733 (0.0011) [2023-12-26 02:35:13,245][123090] Updated weights for policy 1, policy_version 373743 (0.0010) [2023-12-26 02:35:13,293][123090] Updated weights for policy 1, policy_version 373753 (0.0010) [2023-12-26 02:35:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 191938560. Throughput: 0: 9073.1, 1: 8605.6. Samples: 191933932. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:13,785][121949] Avg episode reward: [(0, '6468.199'), (1, '6017.995')] [2023-12-26 02:35:14,044][123091] Updated weights for policy 0, policy_version 375989 (0.0009) [2023-12-26 02:35:14,107][123091] Updated weights for policy 0, policy_version 375999 (0.0009) [2023-12-26 02:35:14,157][123090] Updated weights for policy 1, policy_version 373763 (0.0010) [2023-12-26 02:35:14,168][123091] Updated weights for policy 0, policy_version 376009 (0.0007) [2023-12-26 02:35:14,209][123090] Updated weights for policy 1, policy_version 373773 (0.0010) [2023-12-26 02:35:14,256][123090] Updated weights for policy 1, policy_version 373783 (0.0010) [2023-12-26 02:35:14,952][123091] Updated weights for policy 0, policy_version 376019 (0.0007) [2023-12-26 02:35:15,016][123091] Updated weights for policy 0, policy_version 376029 (0.0009) [2023-12-26 02:35:15,083][123091] Updated weights for policy 0, policy_version 376039 (0.0009) [2023-12-26 02:35:15,084][123090] Updated weights for policy 1, policy_version 373793 (0.0010) [2023-12-26 02:35:15,148][123090] Updated weights for policy 1, policy_version 373803 (0.0008) [2023-12-26 02:35:15,222][123090] Updated weights for policy 1, policy_version 373813 (0.0008) [2023-12-26 02:35:15,292][123090] Updated weights for policy 1, policy_version 373823 (0.0007) [2023-12-26 02:35:15,924][123091] Updated weights for policy 0, policy_version 376049 (0.0006) [2023-12-26 02:35:15,992][123091] Updated weights for policy 0, policy_version 376059 (0.0006) [2023-12-26 02:35:16,050][123091] Updated weights for policy 0, policy_version 376069 (0.0005) [2023-12-26 02:35:16,066][123090] Updated weights for policy 1, policy_version 373833 (0.0007) [2023-12-26 02:35:16,119][123091] Updated weights for policy 0, policy_version 376079 (0.0006) [2023-12-26 02:35:16,124][123090] Updated weights for policy 1, policy_version 373843 (0.0005) [2023-12-26 02:35:16,181][123090] Updated weights for policy 1, policy_version 373853 (0.0005) [2023-12-26 02:35:16,800][123090] Updated weights for policy 1, policy_version 373863 (0.0005) [2023-12-26 02:35:16,817][123091] Updated weights for policy 0, policy_version 376089 (0.0010) [2023-12-26 02:35:16,852][123090] Updated weights for policy 1, policy_version 373873 (0.0005) [2023-12-26 02:35:16,890][123091] Updated weights for policy 0, policy_version 376099 (0.0009) [2023-12-26 02:35:16,905][123090] Updated weights for policy 1, policy_version 373883 (0.0006) [2023-12-26 02:35:16,960][123091] Updated weights for policy 0, policy_version 376109 (0.0005) [2023-12-26 02:35:17,562][123091] Updated weights for policy 0, policy_version 376119 (0.0007) [2023-12-26 02:35:17,620][123091] Updated weights for policy 0, policy_version 376129 (0.0006) [2023-12-26 02:35:17,629][123090] Updated weights for policy 1, policy_version 373893 (0.0007) [2023-12-26 02:35:17,677][123091] Updated weights for policy 0, policy_version 376139 (0.0005) [2023-12-26 02:35:17,680][123090] Updated weights for policy 1, policy_version 373903 (0.0010) [2023-12-26 02:35:17,743][123090] Updated weights for policy 1, policy_version 373913 (0.0010) [2023-12-26 02:35:18,416][123091] Updated weights for policy 0, policy_version 376149 (0.0009) [2023-12-26 02:35:18,484][123091] Updated weights for policy 0, policy_version 376159 (0.0011) [2023-12-26 02:35:18,544][123091] Updated weights for policy 0, policy_version 376169 (0.0011) [2023-12-26 02:35:18,565][123090] Updated weights for policy 1, policy_version 373923 (0.0010) [2023-12-26 02:35:18,626][123090] Updated weights for policy 1, policy_version 373933 (0.0009) [2023-12-26 02:35:18,687][123090] Updated weights for policy 1, policy_version 373943 (0.0007) [2023-12-26 02:35:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 192036864. Throughput: 0: 9073.2, 1: 8670.0. Samples: 192042900. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:18,785][121949] Avg episode reward: [(0, '6478.056'), (1, '6023.850')] [2023-12-26 02:35:19,382][123091] Updated weights for policy 0, policy_version 376179 (0.0011) [2023-12-26 02:35:19,403][123090] Updated weights for policy 1, policy_version 373953 (0.0005) [2023-12-26 02:35:19,446][123091] Updated weights for policy 0, policy_version 376189 (0.0011) [2023-12-26 02:35:19,459][123090] Updated weights for policy 1, policy_version 373963 (0.0009) [2023-12-26 02:35:19,511][123091] Updated weights for policy 0, policy_version 376199 (0.0011) [2023-12-26 02:35:19,526][123090] Updated weights for policy 1, policy_version 373973 (0.0008) [2023-12-26 02:35:19,588][123090] Updated weights for policy 1, policy_version 373983 (0.0005) [2023-12-26 02:35:20,321][123091] Updated weights for policy 0, policy_version 376209 (0.0010) [2023-12-26 02:35:20,377][123091] Updated weights for policy 0, policy_version 376219 (0.0011) [2023-12-26 02:35:20,384][123090] Updated weights for policy 1, policy_version 373993 (0.0010) [2023-12-26 02:35:20,433][123091] Updated weights for policy 0, policy_version 376229 (0.0011) [2023-12-26 02:35:20,448][123090] Updated weights for policy 1, policy_version 374003 (0.0011) [2023-12-26 02:35:20,491][123091] Updated weights for policy 0, policy_version 376239 (0.0011) [2023-12-26 02:35:20,513][123090] Updated weights for policy 1, policy_version 374013 (0.0011) [2023-12-26 02:35:21,379][123090] Updated weights for policy 1, policy_version 374023 (0.0010) [2023-12-26 02:35:21,384][123091] Updated weights for policy 0, policy_version 376249 (0.0011) [2023-12-26 02:35:21,445][123090] Updated weights for policy 1, policy_version 374033 (0.0008) [2023-12-26 02:35:21,450][123091] Updated weights for policy 0, policy_version 376260 (0.0009) [2023-12-26 02:35:21,507][123091] Updated weights for policy 0, policy_version 376270 (0.0008) [2023-12-26 02:35:21,507][123090] Updated weights for policy 1, policy_version 374043 (0.0006) [2023-12-26 02:35:22,202][123090] Updated weights for policy 1, policy_version 374053 (0.0005) [2023-12-26 02:35:22,274][123090] Updated weights for policy 1, policy_version 374063 (0.0007) [2023-12-26 02:35:22,329][123090] Updated weights for policy 1, policy_version 374073 (0.0007) [2023-12-26 02:35:22,376][123091] Updated weights for policy 0, policy_version 376280 (0.0009) [2023-12-26 02:35:22,430][123091] Updated weights for policy 0, policy_version 376290 (0.0008) [2023-12-26 02:35:22,484][123091] Updated weights for policy 0, policy_version 376300 (0.0009) [2023-12-26 02:35:23,178][123090] Updated weights for policy 1, policy_version 374083 (0.0009) [2023-12-26 02:35:23,245][123090] Updated weights for policy 1, policy_version 374093 (0.0011) [2023-12-26 02:35:23,308][123090] Updated weights for policy 1, policy_version 374103 (0.0011) [2023-12-26 02:35:23,351][123091] Updated weights for policy 0, policy_version 376310 (0.0008) [2023-12-26 02:35:23,399][123091] Updated weights for policy 0, policy_version 376320 (0.0009) [2023-12-26 02:35:23,452][123091] Updated weights for policy 0, policy_version 376330 (0.0009) [2023-12-26 02:35:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 192118784. Throughput: 0: 9042.9, 1: 8692.0. Samples: 192094312. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:23,785][121949] Avg episode reward: [(0, '6512.375'), (1, '5942.924')] [2023-12-26 02:35:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000376336_96346112.pth... [2023-12-26 02:35:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000374112_95772672.pth... [2023-12-26 02:35:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000373088_95510528.pth [2023-12-26 02:35:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000375280_96075776.pth [2023-12-26 02:35:24,129][123090] Updated weights for policy 1, policy_version 374113 (0.0010) [2023-12-26 02:35:24,181][123090] Updated weights for policy 1, policy_version 374123 (0.0010) [2023-12-26 02:35:24,243][123090] Updated weights for policy 1, policy_version 374133 (0.0010) [2023-12-26 02:35:24,306][123090] Updated weights for policy 1, policy_version 374143 (0.0010) [2023-12-26 02:35:24,315][123091] Updated weights for policy 0, policy_version 376340 (0.0009) [2023-12-26 02:35:24,367][123091] Updated weights for policy 0, policy_version 376350 (0.0008) [2023-12-26 02:35:24,415][123091] Updated weights for policy 0, policy_version 376360 (0.0009) [2023-12-26 02:35:25,131][123090] Updated weights for policy 1, policy_version 374153 (0.0010) [2023-12-26 02:35:25,179][123090] Updated weights for policy 1, policy_version 374163 (0.0010) [2023-12-26 02:35:25,234][123090] Updated weights for policy 1, policy_version 374173 (0.0010) [2023-12-26 02:35:25,250][123091] Updated weights for policy 0, policy_version 376370 (0.0008) [2023-12-26 02:35:25,298][123091] Updated weights for policy 0, policy_version 376380 (0.0009) [2023-12-26 02:35:25,355][123091] Updated weights for policy 0, policy_version 376390 (0.0009) [2023-12-26 02:35:25,420][123091] Updated weights for policy 0, policy_version 376400 (0.0008) [2023-12-26 02:35:26,068][123090] Updated weights for policy 1, policy_version 374183 (0.0010) [2023-12-26 02:35:26,119][123090] Updated weights for policy 1, policy_version 374193 (0.0010) [2023-12-26 02:35:26,160][123091] Updated weights for policy 0, policy_version 376410 (0.0011) [2023-12-26 02:35:26,174][123090] Updated weights for policy 1, policy_version 374203 (0.0010) [2023-12-26 02:35:26,219][123091] Updated weights for policy 0, policy_version 376420 (0.0010) [2023-12-26 02:35:26,278][123091] Updated weights for policy 0, policy_version 376430 (0.0011) [2023-12-26 02:35:26,953][123090] Updated weights for policy 1, policy_version 374213 (0.0008) [2023-12-26 02:35:26,977][123091] Updated weights for policy 0, policy_version 376440 (0.0008) [2023-12-26 02:35:27,003][123090] Updated weights for policy 1, policy_version 374223 (0.0005) [2023-12-26 02:35:27,032][123091] Updated weights for policy 0, policy_version 376450 (0.0006) [2023-12-26 02:35:27,052][123090] Updated weights for policy 1, policy_version 374233 (0.0005) [2023-12-26 02:35:27,092][123091] Updated weights for policy 0, policy_version 376460 (0.0006) [2023-12-26 02:35:27,691][123091] Updated weights for policy 0, policy_version 376470 (0.0005) [2023-12-26 02:35:27,757][123091] Updated weights for policy 0, policy_version 376480 (0.0006) [2023-12-26 02:35:27,811][123090] Updated weights for policy 1, policy_version 374243 (0.0007) [2023-12-26 02:35:27,820][123091] Updated weights for policy 0, policy_version 376490 (0.0008) [2023-12-26 02:35:27,864][123090] Updated weights for policy 1, policy_version 374253 (0.0010) [2023-12-26 02:35:27,919][123090] Updated weights for policy 1, policy_version 374263 (0.0009) [2023-12-26 02:35:28,630][123091] Updated weights for policy 0, policy_version 376500 (0.0008) [2023-12-26 02:35:28,663][123090] Updated weights for policy 1, policy_version 374273 (0.0009) [2023-12-26 02:35:28,690][123091] Updated weights for policy 0, policy_version 376510 (0.0010) [2023-12-26 02:35:28,733][123090] Updated weights for policy 1, policy_version 374283 (0.0005) [2023-12-26 02:35:28,750][123091] Updated weights for policy 0, policy_version 376520 (0.0009) [2023-12-26 02:35:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 192200704. Throughput: 0: 9151.0, 1: 8713.8. Samples: 192202564. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:28,784][121949] Avg episode reward: [(0, '6535.714'), (1, '5998.072')] [2023-12-26 02:35:28,789][123007] Saving new best policy, reward=6535.714! [2023-12-26 02:35:28,805][123090] Updated weights for policy 1, policy_version 374293 (0.0005) [2023-12-26 02:35:28,866][123090] Updated weights for policy 1, policy_version 374303 (0.0008) [2023-12-26 02:35:29,519][123090] Updated weights for policy 1, policy_version 374313 (0.0011) [2023-12-26 02:35:29,581][123090] Updated weights for policy 1, policy_version 374323 (0.0010) [2023-12-26 02:35:29,637][123091] Updated weights for policy 0, policy_version 376530 (0.0008) [2023-12-26 02:35:29,646][123090] Updated weights for policy 1, policy_version 374333 (0.0007) [2023-12-26 02:35:29,697][123091] Updated weights for policy 0, policy_version 376540 (0.0009) [2023-12-26 02:35:29,760][123091] Updated weights for policy 0, policy_version 376550 (0.0010) [2023-12-26 02:35:29,814][123091] Updated weights for policy 0, policy_version 376560 (0.0010) [2023-12-26 02:35:30,409][123090] Updated weights for policy 1, policy_version 374343 (0.0009) [2023-12-26 02:35:30,456][123090] Updated weights for policy 1, policy_version 374353 (0.0010) [2023-12-26 02:35:30,503][123090] Updated weights for policy 1, policy_version 374363 (0.0010) [2023-12-26 02:35:30,667][123091] Updated weights for policy 0, policy_version 376570 (0.0005) [2023-12-26 02:35:30,733][123091] Updated weights for policy 0, policy_version 376580 (0.0005) [2023-12-26 02:35:30,779][123091] Updated weights for policy 0, policy_version 376590 (0.0005) [2023-12-26 02:35:31,273][123090] Updated weights for policy 1, policy_version 374373 (0.0009) [2023-12-26 02:35:31,323][123090] Updated weights for policy 1, policy_version 374383 (0.0005) [2023-12-26 02:35:31,379][123090] Updated weights for policy 1, policy_version 374393 (0.0006) [2023-12-26 02:35:31,464][123091] Updated weights for policy 0, policy_version 376600 (0.0008) [2023-12-26 02:35:31,519][123091] Updated weights for policy 0, policy_version 376610 (0.0008) [2023-12-26 02:35:31,577][123091] Updated weights for policy 0, policy_version 376620 (0.0009) [2023-12-26 02:35:32,165][123090] Updated weights for policy 1, policy_version 374403 (0.0012) [2023-12-26 02:35:32,216][123090] Updated weights for policy 1, policy_version 374413 (0.0010) [2023-12-26 02:35:32,273][123090] Updated weights for policy 1, policy_version 374423 (0.0011) [2023-12-26 02:35:32,428][123091] Updated weights for policy 0, policy_version 376630 (0.0009) [2023-12-26 02:35:32,480][123091] Updated weights for policy 0, policy_version 376640 (0.0009) [2023-12-26 02:35:32,531][123091] Updated weights for policy 0, policy_version 376650 (0.0009) [2023-12-26 02:35:33,109][123090] Updated weights for policy 1, policy_version 374433 (0.0010) [2023-12-26 02:35:33,163][123090] Updated weights for policy 1, policy_version 374443 (0.0010) [2023-12-26 02:35:33,232][123090] Updated weights for policy 1, policy_version 374453 (0.0010) [2023-12-26 02:35:33,294][123090] Updated weights for policy 1, policy_version 374463 (0.0010) [2023-12-26 02:35:33,368][123091] Updated weights for policy 0, policy_version 376660 (0.0010) [2023-12-26 02:35:33,415][123091] Updated weights for policy 0, policy_version 376670 (0.0009) [2023-12-26 02:35:33,462][123091] Updated weights for policy 0, policy_version 376680 (0.0009) [2023-12-26 02:35:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 192299008. Throughput: 0: 9045.4, 1: 8826.3. Samples: 192308728. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:33,785][121949] Avg episode reward: [(0, '6542.793'), (1, '5997.284')] [2023-12-26 02:35:33,786][123007] Saving new best policy, reward=6542.793! [2023-12-26 02:35:34,111][123090] Updated weights for policy 1, policy_version 374473 (0.0010) [2023-12-26 02:35:34,179][123090] Updated weights for policy 1, policy_version 374483 (0.0010) [2023-12-26 02:35:34,239][123091] Updated weights for policy 0, policy_version 376690 (0.0008) [2023-12-26 02:35:34,248][123090] Updated weights for policy 1, policy_version 374493 (0.0013) [2023-12-26 02:35:34,303][123091] Updated weights for policy 0, policy_version 376700 (0.0008) [2023-12-26 02:35:34,372][123091] Updated weights for policy 0, policy_version 376710 (0.0008) [2023-12-26 02:35:34,439][123091] Updated weights for policy 0, policy_version 376720 (0.0008) [2023-12-26 02:35:34,989][123090] Updated weights for policy 1, policy_version 374503 (0.0007) [2023-12-26 02:35:35,041][123090] Updated weights for policy 1, policy_version 374513 (0.0006) [2023-12-26 02:35:35,095][123090] Updated weights for policy 1, policy_version 374523 (0.0008) [2023-12-26 02:35:35,223][123091] Updated weights for policy 0, policy_version 376730 (0.0006) [2023-12-26 02:35:35,281][123091] Updated weights for policy 0, policy_version 376740 (0.0008) [2023-12-26 02:35:35,340][123091] Updated weights for policy 0, policy_version 376750 (0.0010) [2023-12-26 02:35:35,785][123090] Updated weights for policy 1, policy_version 374533 (0.0005) [2023-12-26 02:35:35,837][123090] Updated weights for policy 1, policy_version 374543 (0.0009) [2023-12-26 02:35:35,902][123090] Updated weights for policy 1, policy_version 374553 (0.0007) [2023-12-26 02:35:36,134][123091] Updated weights for policy 0, policy_version 376760 (0.0010) [2023-12-26 02:35:36,201][123091] Updated weights for policy 0, policy_version 376770 (0.0010) [2023-12-26 02:35:36,272][123091] Updated weights for policy 0, policy_version 376780 (0.0011) [2023-12-26 02:35:36,710][123090] Updated weights for policy 1, policy_version 374563 (0.0007) [2023-12-26 02:35:36,782][123090] Updated weights for policy 1, policy_version 374573 (0.0011) [2023-12-26 02:35:36,846][123090] Updated weights for policy 1, policy_version 374583 (0.0005) [2023-12-26 02:35:36,971][123091] Updated weights for policy 0, policy_version 376790 (0.0008) [2023-12-26 02:35:37,030][123091] Updated weights for policy 0, policy_version 376800 (0.0005) [2023-12-26 02:35:37,102][123091] Updated weights for policy 0, policy_version 376810 (0.0006) [2023-12-26 02:35:37,599][123090] Updated weights for policy 1, policy_version 374593 (0.0005) [2023-12-26 02:35:37,666][123090] Updated weights for policy 1, policy_version 374603 (0.0005) [2023-12-26 02:35:37,736][123090] Updated weights for policy 1, policy_version 374613 (0.0009) [2023-12-26 02:35:37,786][123090] Updated weights for policy 1, policy_version 374623 (0.0006) [2023-12-26 02:35:37,790][123091] Updated weights for policy 0, policy_version 376820 (0.0006) [2023-12-26 02:35:37,858][123091] Updated weights for policy 0, policy_version 376830 (0.0006) [2023-12-26 02:35:37,912][123091] Updated weights for policy 0, policy_version 376840 (0.0007) [2023-12-26 02:35:38,445][123090] Updated weights for policy 1, policy_version 374633 (0.0005) [2023-12-26 02:35:38,515][123090] Updated weights for policy 1, policy_version 374643 (0.0005) [2023-12-26 02:35:38,568][123091] Updated weights for policy 0, policy_version 376850 (0.0007) [2023-12-26 02:35:38,571][123090] Updated weights for policy 1, policy_version 374653 (0.0007) [2023-12-26 02:35:38,634][123091] Updated weights for policy 0, policy_version 376860 (0.0011) [2023-12-26 02:35:38,698][123091] Updated weights for policy 0, policy_version 376870 (0.0011) [2023-12-26 02:35:38,767][123091] Updated weights for policy 0, policy_version 376880 (0.0011) [2023-12-26 02:35:38,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 192397312. Throughput: 0: 9088.9, 1: 8896.0. Samples: 192364824. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:38,785][121949] Avg episode reward: [(0, '6546.381'), (1, '6066.648')] [2023-12-26 02:35:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000376880_96485376.pth... [2023-12-26 02:35:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000374656_95911936.pth... [2023-12-26 02:35:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000375824_96215040.pth [2023-12-26 02:35:38,797][123007] Saving new best policy, reward=6546.381! [2023-12-26 02:35:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000373600_95641600.pth [2023-12-26 02:35:39,335][123090] Updated weights for policy 1, policy_version 374663 (0.0008) [2023-12-26 02:35:39,407][123090] Updated weights for policy 1, policy_version 374673 (0.0009) [2023-12-26 02:35:39,473][123090] Updated weights for policy 1, policy_version 374683 (0.0009) [2023-12-26 02:35:39,603][123091] Updated weights for policy 0, policy_version 376890 (0.0011) [2023-12-26 02:35:39,659][123091] Updated weights for policy 0, policy_version 376900 (0.0011) [2023-12-26 02:35:39,719][123091] Updated weights for policy 0, policy_version 376910 (0.0010) [2023-12-26 02:35:40,289][123090] Updated weights for policy 1, policy_version 374693 (0.0009) [2023-12-26 02:35:40,358][123090] Updated weights for policy 1, policy_version 374703 (0.0009) [2023-12-26 02:35:40,419][123090] Updated weights for policy 1, policy_version 374713 (0.0009) [2023-12-26 02:35:40,537][123091] Updated weights for policy 0, policy_version 376920 (0.0011) [2023-12-26 02:35:40,600][123091] Updated weights for policy 0, policy_version 376930 (0.0011) [2023-12-26 02:35:40,667][123091] Updated weights for policy 0, policy_version 376940 (0.0011) [2023-12-26 02:35:41,257][123090] Updated weights for policy 1, policy_version 374723 (0.0009) [2023-12-26 02:35:41,318][123090] Updated weights for policy 1, policy_version 374733 (0.0008) [2023-12-26 02:35:41,389][123090] Updated weights for policy 1, policy_version 374743 (0.0009) [2023-12-26 02:35:41,493][123091] Updated weights for policy 0, policy_version 376950 (0.0010) [2023-12-26 02:35:41,553][123091] Updated weights for policy 0, policy_version 376960 (0.0010) [2023-12-26 02:35:41,625][123091] Updated weights for policy 0, policy_version 376970 (0.0010) [2023-12-26 02:35:42,289][123090] Updated weights for policy 1, policy_version 374753 (0.0010) [2023-12-26 02:35:42,359][123090] Updated weights for policy 1, policy_version 374763 (0.0008) [2023-12-26 02:35:42,422][123090] Updated weights for policy 1, policy_version 374773 (0.0008) [2023-12-26 02:35:42,473][123091] Updated weights for policy 0, policy_version 376980 (0.0009) [2023-12-26 02:35:42,491][123090] Updated weights for policy 1, policy_version 374783 (0.0009) [2023-12-26 02:35:42,533][123091] Updated weights for policy 0, policy_version 376990 (0.0011) [2023-12-26 02:35:42,601][123091] Updated weights for policy 0, policy_version 377000 (0.0011) [2023-12-26 02:35:43,291][123090] Updated weights for policy 1, policy_version 374793 (0.0008) [2023-12-26 02:35:43,335][123090] Updated weights for policy 1, policy_version 374803 (0.0010) [2023-12-26 02:35:43,382][123090] Updated weights for policy 1, policy_version 374813 (0.0010) [2023-12-26 02:35:43,417][123091] Updated weights for policy 0, policy_version 377010 (0.0010) [2023-12-26 02:35:43,474][123091] Updated weights for policy 0, policy_version 377021 (0.0010) [2023-12-26 02:35:43,529][123091] Updated weights for policy 0, policy_version 377031 (0.0010) [2023-12-26 02:35:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 192479232. Throughput: 0: 8919.4, 1: 8952.3. Samples: 192470836. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 02:35:43,785][121949] Avg episode reward: [(0, '6578.391'), (1, '6094.739')] [2023-12-26 02:35:43,786][123007] Saving new best policy, reward=6578.391! [2023-12-26 02:35:43,786][123008] Saving new best policy, reward=6094.739! [2023-12-26 02:35:44,105][123090] Updated weights for policy 1, policy_version 374823 (0.0006) [2023-12-26 02:35:44,163][123090] Updated weights for policy 1, policy_version 374833 (0.0005) [2023-12-26 02:35:44,223][123090] Updated weights for policy 1, policy_version 374843 (0.0008) [2023-12-26 02:35:44,390][123091] Updated weights for policy 0, policy_version 377041 (0.0009) [2023-12-26 02:35:44,449][123091] Updated weights for policy 0, policy_version 377051 (0.0009) [2023-12-26 02:35:44,509][123091] Updated weights for policy 0, policy_version 377061 (0.0009) [2023-12-26 02:35:44,566][123091] Updated weights for policy 0, policy_version 377071 (0.0009) [2023-12-26 02:35:45,033][123090] Updated weights for policy 1, policy_version 374853 (0.0010) [2023-12-26 02:35:45,102][123090] Updated weights for policy 1, policy_version 374863 (0.0009) [2023-12-26 02:35:45,185][123090] Updated weights for policy 1, policy_version 374873 (0.0010) [2023-12-26 02:35:45,402][123091] Updated weights for policy 0, policy_version 377081 (0.0009) [2023-12-26 02:35:45,464][123091] Updated weights for policy 0, policy_version 377091 (0.0009) [2023-12-26 02:35:45,527][123091] Updated weights for policy 0, policy_version 377101 (0.0009) [2023-12-26 02:35:46,048][123090] Updated weights for policy 1, policy_version 374883 (0.0008) [2023-12-26 02:35:46,094][123090] Updated weights for policy 1, policy_version 374893 (0.0005) [2023-12-26 02:35:46,144][123090] Updated weights for policy 1, policy_version 374903 (0.0005) [2023-12-26 02:35:46,233][123091] Updated weights for policy 0, policy_version 377111 (0.0007) [2023-12-26 02:35:46,300][123091] Updated weights for policy 0, policy_version 377121 (0.0005) [2023-12-26 02:35:46,368][123091] Updated weights for policy 0, policy_version 377131 (0.0005) [2023-12-26 02:35:46,807][123090] Updated weights for policy 1, policy_version 374913 (0.0005) [2023-12-26 02:35:46,862][123090] Updated weights for policy 1, policy_version 374923 (0.0005) [2023-12-26 02:35:46,917][123090] Updated weights for policy 1, policy_version 374933 (0.0005) [2023-12-26 02:35:46,972][123090] Updated weights for policy 1, policy_version 374943 (0.0005) [2023-12-26 02:35:47,124][123091] Updated weights for policy 0, policy_version 377141 (0.0007) [2023-12-26 02:35:47,177][123091] Updated weights for policy 0, policy_version 377151 (0.0009) [2023-12-26 02:35:47,226][123091] Updated weights for policy 0, policy_version 377161 (0.0009) [2023-12-26 02:35:47,637][123090] Updated weights for policy 1, policy_version 374953 (0.0005) [2023-12-26 02:35:47,707][123090] Updated weights for policy 1, policy_version 374963 (0.0008) [2023-12-26 02:35:47,767][123090] Updated weights for policy 1, policy_version 374973 (0.0006) [2023-12-26 02:35:48,120][123091] Updated weights for policy 0, policy_version 377171 (0.0009) [2023-12-26 02:35:48,193][123091] Updated weights for policy 0, policy_version 377181 (0.0010) [2023-12-26 02:35:48,268][123091] Updated weights for policy 0, policy_version 377191 (0.0008) [2023-12-26 02:35:48,479][123090] Updated weights for policy 1, policy_version 374983 (0.0005) [2023-12-26 02:35:48,548][123090] Updated weights for policy 1, policy_version 374993 (0.0007) [2023-12-26 02:35:48,604][123090] Updated weights for policy 1, policy_version 375003 (0.0010) [2023-12-26 02:35:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 192569344. Throughput: 0: 8884.3, 1: 9008.7. Samples: 192579032. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:35:48,785][121949] Avg episode reward: [(0, '6540.365'), (1, '6038.114')] [2023-12-26 02:35:49,078][123091] Updated weights for policy 0, policy_version 377201 (0.0009) [2023-12-26 02:35:49,141][123091] Updated weights for policy 0, policy_version 377211 (0.0009) [2023-12-26 02:35:49,206][123091] Updated weights for policy 0, policy_version 377221 (0.0009) [2023-12-26 02:35:49,276][123091] Updated weights for policy 0, policy_version 377231 (0.0010) [2023-12-26 02:35:49,371][123090] Updated weights for policy 1, policy_version 375013 (0.0009) [2023-12-26 02:35:49,433][123090] Updated weights for policy 1, policy_version 375023 (0.0009) [2023-12-26 02:35:49,486][123090] Updated weights for policy 1, policy_version 375033 (0.0009) [2023-12-26 02:35:50,119][123091] Updated weights for policy 0, policy_version 377241 (0.0011) [2023-12-26 02:35:50,175][123091] Updated weights for policy 0, policy_version 377251 (0.0011) [2023-12-26 02:35:50,227][123091] Updated weights for policy 0, policy_version 377261 (0.0011) [2023-12-26 02:35:50,356][123090] Updated weights for policy 1, policy_version 375043 (0.0009) [2023-12-26 02:35:50,428][123090] Updated weights for policy 1, policy_version 375053 (0.0011) [2023-12-26 02:35:50,484][123090] Updated weights for policy 1, policy_version 375063 (0.0010) [2023-12-26 02:35:50,980][123091] Updated weights for policy 0, policy_version 377271 (0.0010) [2023-12-26 02:35:51,048][123091] Updated weights for policy 0, policy_version 377281 (0.0007) [2023-12-26 02:35:51,119][123091] Updated weights for policy 0, policy_version 377291 (0.0009) [2023-12-26 02:35:51,324][123090] Updated weights for policy 1, policy_version 375073 (0.0010) [2023-12-26 02:35:51,398][123090] Updated weights for policy 1, policy_version 375083 (0.0009) [2023-12-26 02:35:51,469][123090] Updated weights for policy 1, policy_version 375093 (0.0006) [2023-12-26 02:35:51,546][123090] Updated weights for policy 1, policy_version 375103 (0.0005) [2023-12-26 02:35:51,991][123091] Updated weights for policy 0, policy_version 377301 (0.0009) [2023-12-26 02:35:52,056][123091] Updated weights for policy 0, policy_version 377311 (0.0010) [2023-12-26 02:35:52,114][123091] Updated weights for policy 0, policy_version 377321 (0.0010) [2023-12-26 02:35:52,254][123090] Updated weights for policy 1, policy_version 375113 (0.0010) [2023-12-26 02:35:52,309][123090] Updated weights for policy 1, policy_version 375123 (0.0008) [2023-12-26 02:35:52,373][123090] Updated weights for policy 1, policy_version 375133 (0.0008) [2023-12-26 02:35:53,001][123091] Updated weights for policy 0, policy_version 377331 (0.0010) [2023-12-26 02:35:53,053][123091] Updated weights for policy 0, policy_version 377341 (0.0009) [2023-12-26 02:35:53,113][123091] Updated weights for policy 0, policy_version 377351 (0.0009) [2023-12-26 02:35:53,155][123090] Updated weights for policy 1, policy_version 375143 (0.0011) [2023-12-26 02:35:53,210][123090] Updated weights for policy 1, policy_version 375153 (0.0010) [2023-12-26 02:35:53,264][123090] Updated weights for policy 1, policy_version 375163 (0.0010) [2023-12-26 02:35:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.5). Total num frames: 192651264. Throughput: 0: 8841.1, 1: 8926.5. Samples: 192629844. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:35:53,785][121949] Avg episode reward: [(0, '6510.169'), (1, '6032.763')] [2023-12-26 02:35:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000377360_96608256.pth... [2023-12-26 02:35:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000375168_96043008.pth... [2023-12-26 02:35:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000376336_96346112.pth [2023-12-26 02:35:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000374112_95772672.pth [2023-12-26 02:35:53,968][123091] Updated weights for policy 0, policy_version 377361 (0.0008) [2023-12-26 02:35:54,034][123091] Updated weights for policy 0, policy_version 377371 (0.0007) [2023-12-26 02:35:54,081][123090] Updated weights for policy 1, policy_version 375173 (0.0009) [2023-12-26 02:35:54,084][123091] Updated weights for policy 0, policy_version 377381 (0.0008) [2023-12-26 02:35:54,139][123091] Updated weights for policy 0, policy_version 377391 (0.0009) [2023-12-26 02:35:54,145][123090] Updated weights for policy 1, policy_version 375183 (0.0009) [2023-12-26 02:35:54,204][123090] Updated weights for policy 1, policy_version 375193 (0.0010) [2023-12-26 02:35:54,926][123090] Updated weights for policy 1, policy_version 375203 (0.0010) [2023-12-26 02:35:54,994][123090] Updated weights for policy 1, policy_version 375213 (0.0011) [2023-12-26 02:35:55,001][123091] Updated weights for policy 0, policy_version 377401 (0.0005) [2023-12-26 02:35:55,058][123090] Updated weights for policy 1, policy_version 375223 (0.0010) [2023-12-26 02:35:55,066][123091] Updated weights for policy 0, policy_version 377411 (0.0006) [2023-12-26 02:35:55,129][123091] Updated weights for policy 0, policy_version 377421 (0.0007) [2023-12-26 02:35:55,834][123090] Updated weights for policy 1, policy_version 375233 (0.0010) [2023-12-26 02:35:55,900][123090] Updated weights for policy 1, policy_version 375243 (0.0010) [2023-12-26 02:35:55,948][123091] Updated weights for policy 0, policy_version 377431 (0.0008) [2023-12-26 02:35:55,959][123090] Updated weights for policy 1, policy_version 375253 (0.0010) [2023-12-26 02:35:55,999][123091] Updated weights for policy 0, policy_version 377441 (0.0007) [2023-12-26 02:35:56,021][123090] Updated weights for policy 1, policy_version 375263 (0.0010) [2023-12-26 02:35:56,064][123091] Updated weights for policy 0, policy_version 377451 (0.0008) [2023-12-26 02:35:56,816][123090] Updated weights for policy 1, policy_version 375273 (0.0010) [2023-12-26 02:35:56,869][123090] Updated weights for policy 1, policy_version 375283 (0.0009) [2023-12-26 02:35:56,893][123091] Updated weights for policy 0, policy_version 377461 (0.0009) [2023-12-26 02:35:56,927][123090] Updated weights for policy 1, policy_version 375293 (0.0006) [2023-12-26 02:35:56,946][123091] Updated weights for policy 0, policy_version 377471 (0.0009) [2023-12-26 02:35:56,995][123091] Updated weights for policy 0, policy_version 377481 (0.0009) [2023-12-26 02:35:57,747][123090] Updated weights for policy 1, policy_version 375303 (0.0008) [2023-12-26 02:35:57,808][123090] Updated weights for policy 1, policy_version 375313 (0.0008) [2023-12-26 02:35:57,832][123091] Updated weights for policy 0, policy_version 377491 (0.0009) [2023-12-26 02:35:57,868][123090] Updated weights for policy 1, policy_version 375323 (0.0006) [2023-12-26 02:35:57,897][123091] Updated weights for policy 0, policy_version 377501 (0.0008) [2023-12-26 02:35:57,946][123091] Updated weights for policy 0, policy_version 377511 (0.0009) [2023-12-26 02:35:58,709][123090] Updated weights for policy 1, policy_version 375333 (0.0008) [2023-12-26 02:35:58,774][123090] Updated weights for policy 1, policy_version 375343 (0.0010) [2023-12-26 02:35:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 192733184. Throughput: 0: 8793.3, 1: 8987.6. Samples: 192734068. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:35:58,784][121949] Avg episode reward: [(0, '6427.088'), (1, '6080.794')] [2023-12-26 02:35:58,789][123091] Updated weights for policy 0, policy_version 377521 (0.0008) [2023-12-26 02:35:58,841][123090] Updated weights for policy 1, policy_version 375353 (0.0008) [2023-12-26 02:35:58,856][123091] Updated weights for policy 0, policy_version 377531 (0.0006) [2023-12-26 02:35:58,912][123091] Updated weights for policy 0, policy_version 377541 (0.0005) [2023-12-26 02:35:58,969][123091] Updated weights for policy 0, policy_version 377551 (0.0005) [2023-12-26 02:35:59,634][123091] Updated weights for policy 0, policy_version 377561 (0.0006) [2023-12-26 02:35:59,696][123091] Updated weights for policy 0, policy_version 377571 (0.0006) [2023-12-26 02:35:59,755][123091] Updated weights for policy 0, policy_version 377581 (0.0006) [2023-12-26 02:35:59,775][123090] Updated weights for policy 1, policy_version 375363 (0.0008) [2023-12-26 02:35:59,849][123090] Updated weights for policy 1, policy_version 375373 (0.0007) [2023-12-26 02:35:59,909][123090] Updated weights for policy 1, policy_version 375383 (0.0006) [2023-12-26 02:36:00,540][123091] Updated weights for policy 0, policy_version 377591 (0.0009) [2023-12-26 02:36:00,593][123091] Updated weights for policy 0, policy_version 377601 (0.0009) [2023-12-26 02:36:00,642][123090] Updated weights for policy 1, policy_version 375393 (0.0007) [2023-12-26 02:36:00,650][123091] Updated weights for policy 0, policy_version 377611 (0.0010) [2023-12-26 02:36:00,707][123090] Updated weights for policy 1, policy_version 375403 (0.0008) [2023-12-26 02:36:00,772][123090] Updated weights for policy 1, policy_version 375413 (0.0009) [2023-12-26 02:36:00,833][123090] Updated weights for policy 1, policy_version 375423 (0.0009) [2023-12-26 02:36:01,511][123091] Updated weights for policy 0, policy_version 377621 (0.0010) [2023-12-26 02:36:01,562][123091] Updated weights for policy 0, policy_version 377631 (0.0008) [2023-12-26 02:36:01,616][123091] Updated weights for policy 0, policy_version 377641 (0.0006) [2023-12-26 02:36:01,693][123090] Updated weights for policy 1, policy_version 375433 (0.0007) [2023-12-26 02:36:01,766][123090] Updated weights for policy 1, policy_version 375443 (0.0010) [2023-12-26 02:36:01,831][123090] Updated weights for policy 1, policy_version 375453 (0.0010) [2023-12-26 02:36:02,364][123091] Updated weights for policy 0, policy_version 377651 (0.0008) [2023-12-26 02:36:02,434][123091] Updated weights for policy 0, policy_version 377661 (0.0011) [2023-12-26 02:36:02,507][123091] Updated weights for policy 0, policy_version 377671 (0.0011) [2023-12-26 02:36:02,570][123090] Updated weights for policy 1, policy_version 375463 (0.0010) [2023-12-26 02:36:02,621][123090] Updated weights for policy 1, policy_version 375473 (0.0008) [2023-12-26 02:36:02,684][123090] Updated weights for policy 1, policy_version 375483 (0.0010) [2023-12-26 02:36:03,239][123091] Updated weights for policy 0, policy_version 377681 (0.0010) [2023-12-26 02:36:03,290][123091] Updated weights for policy 0, policy_version 377691 (0.0005) [2023-12-26 02:36:03,337][123091] Updated weights for policy 0, policy_version 377701 (0.0006) [2023-12-26 02:36:03,385][123091] Updated weights for policy 0, policy_version 377711 (0.0005) [2023-12-26 02:36:03,459][123090] Updated weights for policy 1, policy_version 375493 (0.0008) [2023-12-26 02:36:03,508][123090] Updated weights for policy 1, policy_version 375503 (0.0005) [2023-12-26 02:36:03,559][123090] Updated weights for policy 1, policy_version 375513 (0.0005) [2023-12-26 02:36:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 192831488. Throughput: 0: 8793.2, 1: 8934.5. Samples: 192840648. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:03,785][121949] Avg episode reward: [(0, '6341.988'), (1, '6073.038')] [2023-12-26 02:36:04,018][123091] Updated weights for policy 0, policy_version 377721 (0.0010) [2023-12-26 02:36:04,081][123091] Updated weights for policy 0, policy_version 377731 (0.0011) [2023-12-26 02:36:04,148][123091] Updated weights for policy 0, policy_version 377741 (0.0011) [2023-12-26 02:36:04,239][123090] Updated weights for policy 1, policy_version 375523 (0.0005) [2023-12-26 02:36:04,311][123090] Updated weights for policy 1, policy_version 375533 (0.0008) [2023-12-26 02:36:04,379][123090] Updated weights for policy 1, policy_version 375543 (0.0008) [2023-12-26 02:36:04,968][123091] Updated weights for policy 0, policy_version 377751 (0.0007) [2023-12-26 02:36:05,037][123091] Updated weights for policy 0, policy_version 377761 (0.0006) [2023-12-26 02:36:05,100][123091] Updated weights for policy 0, policy_version 377771 (0.0007) [2023-12-26 02:36:05,171][123090] Updated weights for policy 1, policy_version 375553 (0.0011) [2023-12-26 02:36:05,218][123090] Updated weights for policy 1, policy_version 375563 (0.0010) [2023-12-26 02:36:05,266][123090] Updated weights for policy 1, policy_version 375573 (0.0010) [2023-12-26 02:36:05,310][123090] Updated weights for policy 1, policy_version 375583 (0.0010) [2023-12-26 02:36:05,855][123091] Updated weights for policy 0, policy_version 377781 (0.0010) [2023-12-26 02:36:05,919][123091] Updated weights for policy 0, policy_version 377791 (0.0011) [2023-12-26 02:36:05,986][123091] Updated weights for policy 0, policy_version 377801 (0.0011) [2023-12-26 02:36:06,118][123090] Updated weights for policy 1, policy_version 375593 (0.0007) [2023-12-26 02:36:06,184][123090] Updated weights for policy 1, policy_version 375603 (0.0007) [2023-12-26 02:36:06,258][123090] Updated weights for policy 1, policy_version 375613 (0.0006) [2023-12-26 02:36:06,704][123091] Updated weights for policy 0, policy_version 377811 (0.0009) [2023-12-26 02:36:06,776][123091] Updated weights for policy 0, policy_version 377821 (0.0008) [2023-12-26 02:36:06,852][123091] Updated weights for policy 0, policy_version 377831 (0.0007) [2023-12-26 02:36:06,972][123090] Updated weights for policy 1, policy_version 375623 (0.0007) [2023-12-26 02:36:07,041][123090] Updated weights for policy 1, policy_version 375633 (0.0008) [2023-12-26 02:36:07,110][123090] Updated weights for policy 1, policy_version 375643 (0.0007) [2023-12-26 02:36:07,638][123091] Updated weights for policy 0, policy_version 377841 (0.0007) [2023-12-26 02:36:07,685][123091] Updated weights for policy 0, policy_version 377851 (0.0010) [2023-12-26 02:36:07,744][123091] Updated weights for policy 0, policy_version 377861 (0.0008) [2023-12-26 02:36:07,807][123091] Updated weights for policy 0, policy_version 377871 (0.0010) [2023-12-26 02:36:07,840][123090] Updated weights for policy 1, policy_version 375653 (0.0007) [2023-12-26 02:36:07,911][123090] Updated weights for policy 1, policy_version 375663 (0.0009) [2023-12-26 02:36:07,973][123090] Updated weights for policy 1, policy_version 375673 (0.0009) [2023-12-26 02:36:08,594][123091] Updated weights for policy 0, policy_version 377881 (0.0007) [2023-12-26 02:36:08,654][123091] Updated weights for policy 0, policy_version 377891 (0.0005) [2023-12-26 02:36:08,713][123091] Updated weights for policy 0, policy_version 377901 (0.0009) [2023-12-26 02:36:08,762][123090] Updated weights for policy 1, policy_version 375683 (0.0007) [2023-12-26 02:36:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 192921600. Throughput: 0: 8854.3, 1: 8970.2. Samples: 192896416. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:08,784][121949] Avg episode reward: [(0, '6326.875'), (1, '6060.041')] [2023-12-26 02:36:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000377904_96747520.pth... [2023-12-26 02:36:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000376880_96485376.pth [2023-12-26 02:36:08,838][123090] Updated weights for policy 1, policy_version 375693 (0.0008) [2023-12-26 02:36:08,896][123090] Updated weights for policy 1, policy_version 375703 (0.0009) [2023-12-26 02:36:08,941][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000375712_96182272.pth... [2023-12-26 02:36:08,944][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000374656_95911936.pth [2023-12-26 02:36:09,550][123091] Updated weights for policy 0, policy_version 377911 (0.0010) [2023-12-26 02:36:09,616][123091] Updated weights for policy 0, policy_version 377921 (0.0010) [2023-12-26 02:36:09,675][123090] Updated weights for policy 1, policy_version 375713 (0.0009) [2023-12-26 02:36:09,685][123091] Updated weights for policy 0, policy_version 377931 (0.0008) [2023-12-26 02:36:09,739][123090] Updated weights for policy 1, policy_version 375723 (0.0008) [2023-12-26 02:36:09,807][123090] Updated weights for policy 1, policy_version 375733 (0.0010) [2023-12-26 02:36:09,882][123090] Updated weights for policy 1, policy_version 375743 (0.0008) [2023-12-26 02:36:10,476][123091] Updated weights for policy 0, policy_version 377941 (0.0009) [2023-12-26 02:36:10,539][123091] Updated weights for policy 0, policy_version 377951 (0.0008) [2023-12-26 02:36:10,563][123090] Updated weights for policy 1, policy_version 375753 (0.0008) [2023-12-26 02:36:10,596][123091] Updated weights for policy 0, policy_version 377961 (0.0009) [2023-12-26 02:36:10,621][123090] Updated weights for policy 1, policy_version 375763 (0.0008) [2023-12-26 02:36:10,684][123090] Updated weights for policy 1, policy_version 375773 (0.0010) [2023-12-26 02:36:11,459][123091] Updated weights for policy 0, policy_version 377971 (0.0009) [2023-12-26 02:36:11,511][123090] Updated weights for policy 1, policy_version 375783 (0.0009) [2023-12-26 02:36:11,524][123091] Updated weights for policy 0, policy_version 377981 (0.0009) [2023-12-26 02:36:11,575][123090] Updated weights for policy 1, policy_version 375793 (0.0010) [2023-12-26 02:36:11,587][123091] Updated weights for policy 0, policy_version 377991 (0.0009) [2023-12-26 02:36:11,648][123090] Updated weights for policy 1, policy_version 375803 (0.0009) [2023-12-26 02:36:12,436][123091] Updated weights for policy 0, policy_version 378001 (0.0010) [2023-12-26 02:36:12,499][123091] Updated weights for policy 0, policy_version 378011 (0.0010) [2023-12-26 02:36:12,516][123090] Updated weights for policy 1, policy_version 375813 (0.0007) [2023-12-26 02:36:12,556][123091] Updated weights for policy 0, policy_version 378021 (0.0006) [2023-12-26 02:36:12,580][123090] Updated weights for policy 1, policy_version 375823 (0.0008) [2023-12-26 02:36:12,620][123091] Updated weights for policy 0, policy_version 378031 (0.0005) [2023-12-26 02:36:12,637][123090] Updated weights for policy 1, policy_version 375833 (0.0009) [2023-12-26 02:36:13,373][123091] Updated weights for policy 0, policy_version 378041 (0.0008) [2023-12-26 02:36:13,426][123091] Updated weights for policy 0, policy_version 378051 (0.0009) [2023-12-26 02:36:13,475][123090] Updated weights for policy 1, policy_version 375843 (0.0009) [2023-12-26 02:36:13,477][123091] Updated weights for policy 0, policy_version 378061 (0.0009) [2023-12-26 02:36:13,526][123090] Updated weights for policy 1, policy_version 375853 (0.0008) [2023-12-26 02:36:13,574][123090] Updated weights for policy 1, policy_version 375863 (0.0009) [2023-12-26 02:36:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 193011712. Throughput: 0: 8775.0, 1: 8970.5. Samples: 193001116. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:13,785][121949] Avg episode reward: [(0, '6319.913'), (1, '6047.612')] [2023-12-26 02:36:14,329][123091] Updated weights for policy 0, policy_version 378071 (0.0009) [2023-12-26 02:36:14,395][123091] Updated weights for policy 0, policy_version 378081 (0.0009) [2023-12-26 02:36:14,435][123090] Updated weights for policy 1, policy_version 375873 (0.0009) [2023-12-26 02:36:14,457][123091] Updated weights for policy 0, policy_version 378091 (0.0010) [2023-12-26 02:36:14,495][123090] Updated weights for policy 1, policy_version 375883 (0.0009) [2023-12-26 02:36:14,551][123090] Updated weights for policy 1, policy_version 375893 (0.0009) [2023-12-26 02:36:14,609][123090] Updated weights for policy 1, policy_version 375903 (0.0010) [2023-12-26 02:36:15,297][123091] Updated weights for policy 0, policy_version 378101 (0.0010) [2023-12-26 02:36:15,361][123091] Updated weights for policy 0, policy_version 378111 (0.0010) [2023-12-26 02:36:15,423][123091] Updated weights for policy 0, policy_version 378121 (0.0011) [2023-12-26 02:36:15,460][123090] Updated weights for policy 1, policy_version 375913 (0.0008) [2023-12-26 02:36:15,511][123090] Updated weights for policy 1, policy_version 375923 (0.0009) [2023-12-26 02:36:15,571][123090] Updated weights for policy 1, policy_version 375933 (0.0009) [2023-12-26 02:36:16,236][123091] Updated weights for policy 0, policy_version 378131 (0.0010) [2023-12-26 02:36:16,298][123091] Updated weights for policy 0, policy_version 378141 (0.0008) [2023-12-26 02:36:16,364][123091] Updated weights for policy 0, policy_version 378151 (0.0005) [2023-12-26 02:36:16,443][123090] Updated weights for policy 1, policy_version 375943 (0.0009) [2023-12-26 02:36:16,498][123090] Updated weights for policy 1, policy_version 375953 (0.0010) [2023-12-26 02:36:16,569][123090] Updated weights for policy 1, policy_version 375963 (0.0010) [2023-12-26 02:36:16,975][123091] Updated weights for policy 0, policy_version 378161 (0.0005) [2023-12-26 02:36:17,042][123091] Updated weights for policy 0, policy_version 378171 (0.0005) [2023-12-26 02:36:17,101][123091] Updated weights for policy 0, policy_version 378181 (0.0005) [2023-12-26 02:36:17,158][123091] Updated weights for policy 0, policy_version 378191 (0.0008) [2023-12-26 02:36:17,427][123090] Updated weights for policy 1, policy_version 375973 (0.0008) [2023-12-26 02:36:17,504][123090] Updated weights for policy 1, policy_version 375983 (0.0005) [2023-12-26 02:36:17,580][123090] Updated weights for policy 1, policy_version 375993 (0.0005) [2023-12-26 02:36:17,990][123091] Updated weights for policy 0, policy_version 378201 (0.0009) [2023-12-26 02:36:18,044][123091] Updated weights for policy 0, policy_version 378211 (0.0009) [2023-12-26 02:36:18,102][123091] Updated weights for policy 0, policy_version 378221 (0.0010) [2023-12-26 02:36:18,129][123090] Updated weights for policy 1, policy_version 376003 (0.0005) [2023-12-26 02:36:18,184][123090] Updated weights for policy 1, policy_version 376013 (0.0005) [2023-12-26 02:36:18,238][123090] Updated weights for policy 1, policy_version 376023 (0.0005) [2023-12-26 02:36:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 193093632. Throughput: 0: 8799.8, 1: 8929.3. Samples: 193106540. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:18,785][121949] Avg episode reward: [(0, '6358.830'), (1, '6052.799')] [2023-12-26 02:36:18,965][123091] Updated weights for policy 0, policy_version 378231 (0.0009) [2023-12-26 02:36:19,013][123091] Updated weights for policy 0, policy_version 378241 (0.0009) [2023-12-26 02:36:19,066][123091] Updated weights for policy 0, policy_version 378251 (0.0009) [2023-12-26 02:36:19,067][123090] Updated weights for policy 1, policy_version 376033 (0.0005) [2023-12-26 02:36:19,126][123090] Updated weights for policy 1, policy_version 376043 (0.0005) [2023-12-26 02:36:19,190][123090] Updated weights for policy 1, policy_version 376053 (0.0005) [2023-12-26 02:36:19,255][123090] Updated weights for policy 1, policy_version 376063 (0.0007) [2023-12-26 02:36:19,941][123091] Updated weights for policy 0, policy_version 378261 (0.0009) [2023-12-26 02:36:19,986][123090] Updated weights for policy 1, policy_version 376073 (0.0009) [2023-12-26 02:36:20,006][123091] Updated weights for policy 0, policy_version 378271 (0.0006) [2023-12-26 02:36:20,045][123090] Updated weights for policy 1, policy_version 376083 (0.0009) [2023-12-26 02:36:20,068][123091] Updated weights for policy 0, policy_version 378281 (0.0006) [2023-12-26 02:36:20,107][123090] Updated weights for policy 1, policy_version 376093 (0.0009) [2023-12-26 02:36:20,902][123091] Updated weights for policy 0, policy_version 378291 (0.0007) [2023-12-26 02:36:20,961][123091] Updated weights for policy 0, policy_version 378301 (0.0008) [2023-12-26 02:36:20,967][123090] Updated weights for policy 1, policy_version 376103 (0.0010) [2023-12-26 02:36:21,021][123091] Updated weights for policy 0, policy_version 378311 (0.0007) [2023-12-26 02:36:21,033][123090] Updated weights for policy 1, policy_version 376113 (0.0009) [2023-12-26 02:36:21,097][123090] Updated weights for policy 1, policy_version 376123 (0.0010) [2023-12-26 02:36:21,916][123091] Updated weights for policy 0, policy_version 378321 (0.0009) [2023-12-26 02:36:21,978][123091] Updated weights for policy 0, policy_version 378331 (0.0009) [2023-12-26 02:36:21,985][123090] Updated weights for policy 1, policy_version 376133 (0.0008) [2023-12-26 02:36:22,044][123091] Updated weights for policy 0, policy_version 378341 (0.0009) [2023-12-26 02:36:22,051][123090] Updated weights for policy 1, policy_version 376143 (0.0007) [2023-12-26 02:36:22,111][123091] Updated weights for policy 0, policy_version 378351 (0.0009) [2023-12-26 02:36:22,116][123090] Updated weights for policy 1, policy_version 376153 (0.0008) [2023-12-26 02:36:22,745][123090] Updated weights for policy 1, policy_version 376163 (0.0005) [2023-12-26 02:36:22,799][123090] Updated weights for policy 1, policy_version 376173 (0.0005) [2023-12-26 02:36:22,858][123090] Updated weights for policy 1, policy_version 376183 (0.0007) [2023-12-26 02:36:23,002][123091] Updated weights for policy 0, policy_version 378361 (0.0010) [2023-12-26 02:36:23,054][123091] Updated weights for policy 0, policy_version 378371 (0.0010) [2023-12-26 02:36:23,113][123091] Updated weights for policy 0, policy_version 378381 (0.0010) [2023-12-26 02:36:23,682][123090] Updated weights for policy 1, policy_version 376193 (0.0009) [2023-12-26 02:36:23,731][123090] Updated weights for policy 1, policy_version 376203 (0.0009) [2023-12-26 02:36:23,782][123090] Updated weights for policy 1, policy_version 376213 (0.0008) [2023-12-26 02:36:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 193175552. Throughput: 0: 8740.4, 1: 8868.2. Samples: 193157212. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:23,785][121949] Avg episode reward: [(0, '6436.926'), (1, '5977.992')] [2023-12-26 02:36:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000378384_96870400.pth... [2023-12-26 02:36:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000377360_96608256.pth [2023-12-26 02:36:23,839][123090] Updated weights for policy 1, policy_version 376223 (0.0009) [2023-12-26 02:36:23,841][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000376224_96313344.pth... [2023-12-26 02:36:23,844][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000375168_96043008.pth [2023-12-26 02:36:23,945][123091] Updated weights for policy 0, policy_version 378391 (0.0008) [2023-12-26 02:36:24,005][123091] Updated weights for policy 0, policy_version 378401 (0.0005) [2023-12-26 02:36:24,067][123091] Updated weights for policy 0, policy_version 378411 (0.0006) [2023-12-26 02:36:24,740][123090] Updated weights for policy 1, policy_version 376233 (0.0008) [2023-12-26 02:36:24,801][123090] Updated weights for policy 1, policy_version 376243 (0.0008) [2023-12-26 02:36:24,802][123091] Updated weights for policy 0, policy_version 378421 (0.0007) [2023-12-26 02:36:24,853][123091] Updated weights for policy 0, policy_version 378431 (0.0007) [2023-12-26 02:36:24,865][123090] Updated weights for policy 1, policy_version 376253 (0.0007) [2023-12-26 02:36:24,904][123091] Updated weights for policy 0, policy_version 378441 (0.0010) [2023-12-26 02:36:25,689][123090] Updated weights for policy 1, policy_version 376263 (0.0009) [2023-12-26 02:36:25,707][123091] Updated weights for policy 0, policy_version 378451 (0.0008) [2023-12-26 02:36:25,741][123090] Updated weights for policy 1, policy_version 376273 (0.0008) [2023-12-26 02:36:25,773][123091] Updated weights for policy 0, policy_version 378461 (0.0006) [2023-12-26 02:36:25,789][123090] Updated weights for policy 1, policy_version 376283 (0.0009) [2023-12-26 02:36:25,835][123091] Updated weights for policy 0, policy_version 378471 (0.0007) [2023-12-26 02:36:26,453][123091] Updated weights for policy 0, policy_version 378481 (0.0008) [2023-12-26 02:36:26,502][123091] Updated weights for policy 0, policy_version 378491 (0.0007) [2023-12-26 02:36:26,552][123091] Updated weights for policy 0, policy_version 378501 (0.0009) [2023-12-26 02:36:26,603][123091] Updated weights for policy 0, policy_version 378512 (0.0010) [2023-12-26 02:36:26,700][123090] Updated weights for policy 1, policy_version 376293 (0.0009) [2023-12-26 02:36:26,757][123090] Updated weights for policy 1, policy_version 376303 (0.0009) [2023-12-26 02:36:26,822][123090] Updated weights for policy 1, policy_version 376313 (0.0009) [2023-12-26 02:36:27,390][123091] Updated weights for policy 0, policy_version 378522 (0.0009) [2023-12-26 02:36:27,439][123091] Updated weights for policy 0, policy_version 378533 (0.0010) [2023-12-26 02:36:27,497][123091] Updated weights for policy 0, policy_version 378544 (0.0009) [2023-12-26 02:36:27,627][123090] Updated weights for policy 1, policy_version 376323 (0.0009) [2023-12-26 02:36:27,684][123090] Updated weights for policy 1, policy_version 376333 (0.0010) [2023-12-26 02:36:27,735][123090] Updated weights for policy 1, policy_version 376343 (0.0010) [2023-12-26 02:36:28,377][123091] Updated weights for policy 0, policy_version 378554 (0.0009) [2023-12-26 02:36:28,439][123091] Updated weights for policy 0, policy_version 378564 (0.0008) [2023-12-26 02:36:28,507][123091] Updated weights for policy 0, policy_version 378574 (0.0008) [2023-12-26 02:36:28,650][123090] Updated weights for policy 1, policy_version 376354 (0.0010) [2023-12-26 02:36:28,703][123090] Updated weights for policy 1, policy_version 376364 (0.0009) [2023-12-26 02:36:28,757][123090] Updated weights for policy 1, policy_version 376374 (0.0009) [2023-12-26 02:36:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 193265664. Throughput: 0: 8745.0, 1: 8848.6. Samples: 193262548. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:28,784][121949] Avg episode reward: [(0, '6467.781'), (1, '6003.610')] [2023-12-26 02:36:28,825][123090] Updated weights for policy 1, policy_version 376384 (0.0009) [2023-12-26 02:36:29,239][123091] Updated weights for policy 0, policy_version 378584 (0.0009) [2023-12-26 02:36:29,299][123091] Updated weights for policy 0, policy_version 378594 (0.0011) [2023-12-26 02:36:29,365][123091] Updated weights for policy 0, policy_version 378604 (0.0009) [2023-12-26 02:36:29,732][123090] Updated weights for policy 1, policy_version 376394 (0.0011) [2023-12-26 02:36:29,795][123090] Updated weights for policy 1, policy_version 376404 (0.0011) [2023-12-26 02:36:29,862][123090] Updated weights for policy 1, policy_version 376414 (0.0009) [2023-12-26 02:36:30,205][123091] Updated weights for policy 0, policy_version 378614 (0.0011) [2023-12-26 02:36:30,272][123091] Updated weights for policy 0, policy_version 378624 (0.0011) [2023-12-26 02:36:30,336][123091] Updated weights for policy 0, policy_version 378634 (0.0011) [2023-12-26 02:36:30,670][123090] Updated weights for policy 1, policy_version 376424 (0.0009) [2023-12-26 02:36:30,729][123090] Updated weights for policy 1, policy_version 376434 (0.0008) [2023-12-26 02:36:30,788][123090] Updated weights for policy 1, policy_version 376444 (0.0009) [2023-12-26 02:36:31,136][123091] Updated weights for policy 0, policy_version 378644 (0.0011) [2023-12-26 02:36:31,201][123091] Updated weights for policy 0, policy_version 378654 (0.0011) [2023-12-26 02:36:31,269][123091] Updated weights for policy 0, policy_version 378664 (0.0011) [2023-12-26 02:36:31,542][123090] Updated weights for policy 1, policy_version 376454 (0.0007) [2023-12-26 02:36:31,617][123090] Updated weights for policy 1, policy_version 376464 (0.0007) [2023-12-26 02:36:31,689][123090] Updated weights for policy 1, policy_version 376474 (0.0007) [2023-12-26 02:36:32,108][123091] Updated weights for policy 0, policy_version 378674 (0.0011) [2023-12-26 02:36:32,171][123091] Updated weights for policy 0, policy_version 378684 (0.0009) [2023-12-26 02:36:32,245][123091] Updated weights for policy 0, policy_version 378694 (0.0005) [2023-12-26 02:36:32,310][123091] Updated weights for policy 0, policy_version 378704 (0.0009) [2023-12-26 02:36:32,407][123090] Updated weights for policy 1, policy_version 376484 (0.0009) [2023-12-26 02:36:32,465][123090] Updated weights for policy 1, policy_version 376494 (0.0009) [2023-12-26 02:36:32,526][123090] Updated weights for policy 1, policy_version 376504 (0.0009) [2023-12-26 02:36:33,175][123091] Updated weights for policy 0, policy_version 378714 (0.0006) [2023-12-26 02:36:33,240][123091] Updated weights for policy 0, policy_version 378724 (0.0005) [2023-12-26 02:36:33,297][123090] Updated weights for policy 1, policy_version 376514 (0.0008) [2023-12-26 02:36:33,304][123091] Updated weights for policy 0, policy_version 378734 (0.0006) [2023-12-26 02:36:33,347][123090] Updated weights for policy 1, policy_version 376524 (0.0010) [2023-12-26 02:36:33,398][123090] Updated weights for policy 1, policy_version 376534 (0.0010) [2023-12-26 02:36:33,444][123090] Updated weights for policy 1, policy_version 376544 (0.0009) [2023-12-26 02:36:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 193355776. Throughput: 0: 8755.6, 1: 8790.2. Samples: 193368596. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:33,784][121949] Avg episode reward: [(0, '6391.155'), (1, '6040.234')] [2023-12-26 02:36:33,910][123091] Updated weights for policy 0, policy_version 378744 (0.0005) [2023-12-26 02:36:33,967][123091] Updated weights for policy 0, policy_version 378754 (0.0005) [2023-12-26 02:36:34,025][123091] Updated weights for policy 0, policy_version 378764 (0.0005) [2023-12-26 02:36:34,128][123090] Updated weights for policy 1, policy_version 376554 (0.0005) [2023-12-26 02:36:34,191][123090] Updated weights for policy 1, policy_version 376564 (0.0009) [2023-12-26 02:36:34,257][123090] Updated weights for policy 1, policy_version 376574 (0.0008) [2023-12-26 02:36:34,694][123091] Updated weights for policy 0, policy_version 378774 (0.0005) [2023-12-26 02:36:34,750][123091] Updated weights for policy 0, policy_version 378784 (0.0005) [2023-12-26 02:36:34,817][123091] Updated weights for policy 0, policy_version 378794 (0.0005) [2023-12-26 02:36:35,063][123090] Updated weights for policy 1, policy_version 376584 (0.0010) [2023-12-26 02:36:35,119][123090] Updated weights for policy 1, policy_version 376594 (0.0010) [2023-12-26 02:36:35,167][123090] Updated weights for policy 1, policy_version 376604 (0.0010) [2023-12-26 02:36:35,470][123091] Updated weights for policy 0, policy_version 378804 (0.0006) [2023-12-26 02:36:35,528][123091] Updated weights for policy 0, policy_version 378814 (0.0005) [2023-12-26 02:36:35,580][123091] Updated weights for policy 0, policy_version 378824 (0.0005) [2023-12-26 02:36:36,008][123090] Updated weights for policy 1, policy_version 376614 (0.0009) [2023-12-26 02:36:36,068][123090] Updated weights for policy 1, policy_version 376624 (0.0009) [2023-12-26 02:36:36,127][123090] Updated weights for policy 1, policy_version 376634 (0.0009) [2023-12-26 02:36:36,280][123091] Updated weights for policy 0, policy_version 378834 (0.0006) [2023-12-26 02:36:36,336][123091] Updated weights for policy 0, policy_version 378844 (0.0010) [2023-12-26 02:36:36,401][123091] Updated weights for policy 0, policy_version 378854 (0.0006) [2023-12-26 02:36:36,462][123091] Updated weights for policy 0, policy_version 378864 (0.0005) [2023-12-26 02:36:37,031][123090] Updated weights for policy 1, policy_version 376644 (0.0008) [2023-12-26 02:36:37,085][123090] Updated weights for policy 1, policy_version 376654 (0.0005) [2023-12-26 02:36:37,146][123090] Updated weights for policy 1, policy_version 376664 (0.0006) [2023-12-26 02:36:37,155][123091] Updated weights for policy 0, policy_version 378874 (0.0005) [2023-12-26 02:36:37,208][123091] Updated weights for policy 0, policy_version 378884 (0.0005) [2023-12-26 02:36:37,265][123091] Updated weights for policy 0, policy_version 378894 (0.0007) [2023-12-26 02:36:37,776][123090] Updated weights for policy 1, policy_version 376674 (0.0008) [2023-12-26 02:36:37,838][123090] Updated weights for policy 1, policy_version 376684 (0.0006) [2023-12-26 02:36:37,902][123090] Updated weights for policy 1, policy_version 376694 (0.0006) [2023-12-26 02:36:37,960][123090] Updated weights for policy 1, policy_version 376704 (0.0008) [2023-12-26 02:36:38,035][123091] Updated weights for policy 0, policy_version 378904 (0.0008) [2023-12-26 02:36:38,092][123091] Updated weights for policy 0, policy_version 378914 (0.0009) [2023-12-26 02:36:38,145][123091] Updated weights for policy 0, policy_version 378924 (0.0009) [2023-12-26 02:36:38,780][123090] Updated weights for policy 1, policy_version 376714 (0.0011) [2023-12-26 02:36:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 193445888. Throughput: 0: 8861.1, 1: 8827.2. Samples: 193425816. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:38,785][121949] Avg episode reward: [(0, '6339.649'), (1, '6028.078')] [2023-12-26 02:36:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000378928_97009664.pth... [2023-12-26 02:36:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000377904_96747520.pth [2023-12-26 02:36:38,839][123090] Updated weights for policy 1, policy_version 376724 (0.0010) [2023-12-26 02:36:38,903][123090] Updated weights for policy 1, policy_version 376734 (0.0011) [2023-12-26 02:36:38,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000376736_96444416.pth... [2023-12-26 02:36:38,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000375712_96182272.pth [2023-12-26 02:36:39,004][123091] Updated weights for policy 0, policy_version 378934 (0.0009) [2023-12-26 02:36:39,061][123091] Updated weights for policy 0, policy_version 378944 (0.0009) [2023-12-26 02:36:39,130][123091] Updated weights for policy 0, policy_version 378954 (0.0009) [2023-12-26 02:36:39,742][123090] Updated weights for policy 1, policy_version 376744 (0.0007) [2023-12-26 02:36:39,824][123090] Updated weights for policy 1, policy_version 376754 (0.0011) [2023-12-26 02:36:39,883][123090] Updated weights for policy 1, policy_version 376764 (0.0010) [2023-12-26 02:36:39,951][123091] Updated weights for policy 0, policy_version 378964 (0.0009) [2023-12-26 02:36:40,009][123091] Updated weights for policy 0, policy_version 378974 (0.0006) [2023-12-26 02:36:40,081][123091] Updated weights for policy 0, policy_version 378984 (0.0007) [2023-12-26 02:36:40,675][123090] Updated weights for policy 1, policy_version 376774 (0.0010) [2023-12-26 02:36:40,730][123090] Updated weights for policy 1, policy_version 376784 (0.0010) [2023-12-26 02:36:40,781][123090] Updated weights for policy 1, policy_version 376794 (0.0005) [2023-12-26 02:36:40,826][123091] Updated weights for policy 0, policy_version 378994 (0.0008) [2023-12-26 02:36:40,884][123091] Updated weights for policy 0, policy_version 379004 (0.0005) [2023-12-26 02:36:40,948][123091] Updated weights for policy 0, policy_version 379014 (0.0005) [2023-12-26 02:36:41,005][123091] Updated weights for policy 0, policy_version 379024 (0.0005) [2023-12-26 02:36:41,594][123090] Updated weights for policy 1, policy_version 376804 (0.0005) [2023-12-26 02:36:41,666][123090] Updated weights for policy 1, policy_version 376814 (0.0009) [2023-12-26 02:36:41,732][123090] Updated weights for policy 1, policy_version 376824 (0.0009) [2023-12-26 02:36:41,788][123091] Updated weights for policy 0, policy_version 379034 (0.0010) [2023-12-26 02:36:41,855][123091] Updated weights for policy 0, policy_version 379044 (0.0010) [2023-12-26 02:36:41,921][123091] Updated weights for policy 0, policy_version 379054 (0.0010) [2023-12-26 02:36:42,512][123090] Updated weights for policy 1, policy_version 376834 (0.0006) [2023-12-26 02:36:42,578][123090] Updated weights for policy 1, policy_version 376844 (0.0009) [2023-12-26 02:36:42,646][123090] Updated weights for policy 1, policy_version 376854 (0.0006) [2023-12-26 02:36:42,712][123090] Updated weights for policy 1, policy_version 376864 (0.0005) [2023-12-26 02:36:42,783][123091] Updated weights for policy 0, policy_version 379064 (0.0010) [2023-12-26 02:36:42,837][123091] Updated weights for policy 0, policy_version 379074 (0.0010) [2023-12-26 02:36:42,895][123091] Updated weights for policy 0, policy_version 379084 (0.0009) [2023-12-26 02:36:43,419][123090] Updated weights for policy 1, policy_version 376874 (0.0005) [2023-12-26 02:36:43,471][123090] Updated weights for policy 1, policy_version 376884 (0.0006) [2023-12-26 02:36:43,529][123090] Updated weights for policy 1, policy_version 376894 (0.0010) [2023-12-26 02:36:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 193536000. Throughput: 0: 8918.7, 1: 8787.3. Samples: 193530840. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:43,785][121949] Avg episode reward: [(0, '6412.750'), (1, '6063.489')] [2023-12-26 02:36:43,840][123091] Updated weights for policy 0, policy_version 379094 (0.0010) [2023-12-26 02:36:43,915][123091] Updated weights for policy 0, policy_version 379104 (0.0010) [2023-12-26 02:36:43,975][123091] Updated weights for policy 0, policy_version 379114 (0.0009) [2023-12-26 02:36:44,252][123090] Updated weights for policy 1, policy_version 376904 (0.0009) [2023-12-26 02:36:44,301][123090] Updated weights for policy 1, policy_version 376914 (0.0009) [2023-12-26 02:36:44,350][123090] Updated weights for policy 1, policy_version 376924 (0.0008) [2023-12-26 02:36:44,779][123091] Updated weights for policy 0, policy_version 379124 (0.0009) [2023-12-26 02:36:44,833][123091] Updated weights for policy 0, policy_version 379134 (0.0006) [2023-12-26 02:36:44,888][123091] Updated weights for policy 0, policy_version 379144 (0.0009) [2023-12-26 02:36:45,212][123090] Updated weights for policy 1, policy_version 376934 (0.0010) [2023-12-26 02:36:45,271][123090] Updated weights for policy 1, policy_version 376944 (0.0010) [2023-12-26 02:36:45,331][123090] Updated weights for policy 1, policy_version 376954 (0.0010) [2023-12-26 02:36:45,680][123091] Updated weights for policy 0, policy_version 379154 (0.0009) [2023-12-26 02:36:45,751][123091] Updated weights for policy 0, policy_version 379164 (0.0010) [2023-12-26 02:36:45,823][123091] Updated weights for policy 0, policy_version 379174 (0.0010) [2023-12-26 02:36:45,885][123091] Updated weights for policy 0, policy_version 379184 (0.0010) [2023-12-26 02:36:46,051][123090] Updated weights for policy 1, policy_version 376964 (0.0010) [2023-12-26 02:36:46,103][123090] Updated weights for policy 1, policy_version 376974 (0.0010) [2023-12-26 02:36:46,150][123090] Updated weights for policy 1, policy_version 376984 (0.0010) [2023-12-26 02:36:46,753][123091] Updated weights for policy 0, policy_version 379194 (0.0010) [2023-12-26 02:36:46,823][123091] Updated weights for policy 0, policy_version 379204 (0.0010) [2023-12-26 02:36:46,889][123091] Updated weights for policy 0, policy_version 379214 (0.0006) [2023-12-26 02:36:46,930][123090] Updated weights for policy 1, policy_version 376994 (0.0009) [2023-12-26 02:36:46,996][123090] Updated weights for policy 1, policy_version 377004 (0.0006) [2023-12-26 02:36:47,074][123090] Updated weights for policy 1, policy_version 377014 (0.0006) [2023-12-26 02:36:47,155][123090] Updated weights for policy 1, policy_version 377024 (0.0005) [2023-12-26 02:36:47,605][123091] Updated weights for policy 0, policy_version 379224 (0.0006) [2023-12-26 02:36:47,669][123091] Updated weights for policy 0, policy_version 379234 (0.0006) [2023-12-26 02:36:47,738][123091] Updated weights for policy 0, policy_version 379244 (0.0006) [2023-12-26 02:36:47,816][123090] Updated weights for policy 1, policy_version 377034 (0.0005) [2023-12-26 02:36:47,870][123090] Updated weights for policy 1, policy_version 377044 (0.0005) [2023-12-26 02:36:47,922][123090] Updated weights for policy 1, policy_version 377054 (0.0005) [2023-12-26 02:36:48,382][123091] Updated weights for policy 0, policy_version 379254 (0.0008) [2023-12-26 02:36:48,444][123091] Updated weights for policy 0, policy_version 379264 (0.0011) [2023-12-26 02:36:48,506][123091] Updated weights for policy 0, policy_version 379274 (0.0010) [2023-12-26 02:36:48,582][123090] Updated weights for policy 1, policy_version 377064 (0.0008) [2023-12-26 02:36:48,652][123090] Updated weights for policy 1, policy_version 377074 (0.0008) [2023-12-26 02:36:48,707][123090] Updated weights for policy 1, policy_version 377084 (0.0008) [2023-12-26 02:36:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 193634304. Throughput: 0: 8864.1, 1: 8910.0. Samples: 193640480. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:48,785][121949] Avg episode reward: [(0, '6475.116'), (1, '6067.482')] [2023-12-26 02:36:49,365][123091] Updated weights for policy 0, policy_version 379284 (0.0010) [2023-12-26 02:36:49,431][123091] Updated weights for policy 0, policy_version 379294 (0.0009) [2023-12-26 02:36:49,442][123090] Updated weights for policy 1, policy_version 377094 (0.0009) [2023-12-26 02:36:49,480][123091] Updated weights for policy 0, policy_version 379304 (0.0007) [2023-12-26 02:36:49,501][123090] Updated weights for policy 1, policy_version 377104 (0.0010) [2023-12-26 02:36:49,560][123090] Updated weights for policy 1, policy_version 377114 (0.0010) [2023-12-26 02:36:50,339][123091] Updated weights for policy 0, policy_version 379314 (0.0009) [2023-12-26 02:36:50,394][123090] Updated weights for policy 1, policy_version 377124 (0.0011) [2023-12-26 02:36:50,399][123091] Updated weights for policy 0, policy_version 379324 (0.0010) [2023-12-26 02:36:50,454][123090] Updated weights for policy 1, policy_version 377134 (0.0011) [2023-12-26 02:36:50,457][123091] Updated weights for policy 0, policy_version 379334 (0.0008) [2023-12-26 02:36:50,507][123091] Updated weights for policy 0, policy_version 379344 (0.0008) [2023-12-26 02:36:50,517][123090] Updated weights for policy 1, policy_version 377144 (0.0011) [2023-12-26 02:36:51,352][123090] Updated weights for policy 1, policy_version 377154 (0.0011) [2023-12-26 02:36:51,391][123091] Updated weights for policy 0, policy_version 379354 (0.0009) [2023-12-26 02:36:51,414][123090] Updated weights for policy 1, policy_version 377164 (0.0010) [2023-12-26 02:36:51,452][123091] Updated weights for policy 0, policy_version 379364 (0.0008) [2023-12-26 02:36:51,478][123090] Updated weights for policy 1, policy_version 377174 (0.0011) [2023-12-26 02:36:51,512][123091] Updated weights for policy 0, policy_version 379374 (0.0008) [2023-12-26 02:36:51,535][123090] Updated weights for policy 1, policy_version 377184 (0.0010) [2023-12-26 02:36:52,371][123090] Updated weights for policy 1, policy_version 377194 (0.0010) [2023-12-26 02:36:52,418][123091] Updated weights for policy 0, policy_version 379384 (0.0007) [2023-12-26 02:36:52,439][123090] Updated weights for policy 1, policy_version 377204 (0.0008) [2023-12-26 02:36:52,486][123091] Updated weights for policy 0, policy_version 379394 (0.0005) [2023-12-26 02:36:52,507][123090] Updated weights for policy 1, policy_version 377214 (0.0005) [2023-12-26 02:36:52,548][123091] Updated weights for policy 0, policy_version 379404 (0.0005) [2023-12-26 02:36:53,169][123091] Updated weights for policy 0, policy_version 379414 (0.0006) [2023-12-26 02:36:53,183][123090] Updated weights for policy 1, policy_version 377224 (0.0008) [2023-12-26 02:36:53,224][123091] Updated weights for policy 0, policy_version 379424 (0.0006) [2023-12-26 02:36:53,236][123090] Updated weights for policy 1, policy_version 377234 (0.0009) [2023-12-26 02:36:53,284][123091] Updated weights for policy 0, policy_version 379434 (0.0005) [2023-12-26 02:36:53,286][123090] Updated weights for policy 1, policy_version 377244 (0.0009) [2023-12-26 02:36:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 193716224. Throughput: 0: 8806.5, 1: 8858.8. Samples: 193691360. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:53,785][121949] Avg episode reward: [(0, '6524.815'), (1, '6058.873')] [2023-12-26 02:36:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000379440_97140736.pth... [2023-12-26 02:36:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000377248_96575488.pth... [2023-12-26 02:36:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000378384_96870400.pth [2023-12-26 02:36:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000376224_96313344.pth [2023-12-26 02:36:54,021][123091] Updated weights for policy 0, policy_version 379444 (0.0007) [2023-12-26 02:36:54,085][123091] Updated weights for policy 0, policy_version 379454 (0.0009) [2023-12-26 02:36:54,085][123090] Updated weights for policy 1, policy_version 377254 (0.0007) [2023-12-26 02:36:54,135][123090] Updated weights for policy 1, policy_version 377264 (0.0007) [2023-12-26 02:36:54,155][123091] Updated weights for policy 0, policy_version 379464 (0.0009) [2023-12-26 02:36:54,183][123090] Updated weights for policy 1, policy_version 377274 (0.0007) [2023-12-26 02:36:54,966][123091] Updated weights for policy 0, policy_version 379474 (0.0007) [2023-12-26 02:36:55,004][123090] Updated weights for policy 1, policy_version 377284 (0.0008) [2023-12-26 02:36:55,027][123091] Updated weights for policy 0, policy_version 379484 (0.0008) [2023-12-26 02:36:55,064][123090] Updated weights for policy 1, policy_version 377294 (0.0006) [2023-12-26 02:36:55,082][123091] Updated weights for policy 0, policy_version 379494 (0.0010) [2023-12-26 02:36:55,127][123090] Updated weights for policy 1, policy_version 377304 (0.0006) [2023-12-26 02:36:55,138][123091] Updated weights for policy 0, policy_version 379504 (0.0011) [2023-12-26 02:36:55,846][123091] Updated weights for policy 0, policy_version 379514 (0.0006) [2023-12-26 02:36:55,898][123090] Updated weights for policy 1, policy_version 377314 (0.0007) [2023-12-26 02:36:55,903][123091] Updated weights for policy 0, policy_version 379524 (0.0005) [2023-12-26 02:36:55,961][123090] Updated weights for policy 1, policy_version 377324 (0.0006) [2023-12-26 02:36:55,966][123091] Updated weights for policy 0, policy_version 379534 (0.0009) [2023-12-26 02:36:56,024][123090] Updated weights for policy 1, policy_version 377334 (0.0010) [2023-12-26 02:36:56,083][123090] Updated weights for policy 1, policy_version 377344 (0.0009) [2023-12-26 02:36:56,595][123091] Updated weights for policy 0, policy_version 379544 (0.0006) [2023-12-26 02:36:56,670][123091] Updated weights for policy 0, policy_version 379554 (0.0005) [2023-12-26 02:36:56,746][123091] Updated weights for policy 0, policy_version 379564 (0.0005) [2023-12-26 02:36:56,790][123090] Updated weights for policy 1, policy_version 377354 (0.0005) [2023-12-26 02:36:56,867][123090] Updated weights for policy 1, policy_version 377364 (0.0005) [2023-12-26 02:36:56,915][123090] Updated weights for policy 1, policy_version 377374 (0.0005) [2023-12-26 02:36:57,384][123091] Updated weights for policy 0, policy_version 379574 (0.0008) [2023-12-26 02:36:57,434][123091] Updated weights for policy 0, policy_version 379584 (0.0010) [2023-12-26 02:36:57,484][123091] Updated weights for policy 0, policy_version 379594 (0.0010) [2023-12-26 02:36:57,504][123090] Updated weights for policy 1, policy_version 377384 (0.0007) [2023-12-26 02:36:57,563][123090] Updated weights for policy 1, policy_version 377394 (0.0008) [2023-12-26 02:36:57,626][123090] Updated weights for policy 1, policy_version 377404 (0.0009) [2023-12-26 02:36:58,200][123091] Updated weights for policy 0, policy_version 379604 (0.0009) [2023-12-26 02:36:58,267][123091] Updated weights for policy 0, policy_version 379614 (0.0007) [2023-12-26 02:36:58,336][123091] Updated weights for policy 0, policy_version 379624 (0.0008) [2023-12-26 02:36:58,522][123090] Updated weights for policy 1, policy_version 377414 (0.0010) [2023-12-26 02:36:58,582][123090] Updated weights for policy 1, policy_version 377424 (0.0011) [2023-12-26 02:36:58,661][123090] Updated weights for policy 1, policy_version 377434 (0.0009) [2023-12-26 02:36:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 193814528. Throughput: 0: 8945.5, 1: 8913.9. Samples: 193804788. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:36:58,785][121949] Avg episode reward: [(0, '6450.525'), (1, '6108.581')] [2023-12-26 02:36:58,786][123008] Saving new best policy, reward=6108.581! [2023-12-26 02:36:59,090][123091] Updated weights for policy 0, policy_version 379634 (0.0008) [2023-12-26 02:36:59,145][123091] Updated weights for policy 0, policy_version 379644 (0.0010) [2023-12-26 02:36:59,207][123091] Updated weights for policy 0, policy_version 379654 (0.0011) [2023-12-26 02:36:59,279][123091] Updated weights for policy 0, policy_version 379664 (0.0006) [2023-12-26 02:36:59,475][123090] Updated weights for policy 1, policy_version 377444 (0.0008) [2023-12-26 02:36:59,525][123090] Updated weights for policy 1, policy_version 377454 (0.0006) [2023-12-26 02:36:59,573][123090] Updated weights for policy 1, policy_version 377464 (0.0005) [2023-12-26 02:36:59,980][123091] Updated weights for policy 0, policy_version 379674 (0.0008) [2023-12-26 02:37:00,049][123091] Updated weights for policy 0, policy_version 379684 (0.0008) [2023-12-26 02:37:00,121][123091] Updated weights for policy 0, policy_version 379694 (0.0008) [2023-12-26 02:37:00,356][123090] Updated weights for policy 1, policy_version 377474 (0.0006) [2023-12-26 02:37:00,423][123090] Updated weights for policy 1, policy_version 377484 (0.0011) [2023-12-26 02:37:00,482][123090] Updated weights for policy 1, policy_version 377494 (0.0010) [2023-12-26 02:37:00,543][123090] Updated weights for policy 1, policy_version 377504 (0.0010) [2023-12-26 02:37:00,852][123091] Updated weights for policy 0, policy_version 379704 (0.0006) [2023-12-26 02:37:00,912][123091] Updated weights for policy 0, policy_version 379714 (0.0006) [2023-12-26 02:37:00,969][123091] Updated weights for policy 0, policy_version 379724 (0.0005) [2023-12-26 02:37:01,326][123090] Updated weights for policy 1, policy_version 377514 (0.0009) [2023-12-26 02:37:01,396][123090] Updated weights for policy 1, policy_version 377524 (0.0006) [2023-12-26 02:37:01,447][123090] Updated weights for policy 1, policy_version 377534 (0.0005) [2023-12-26 02:37:01,729][123091] Updated weights for policy 0, policy_version 379734 (0.0009) [2023-12-26 02:37:01,777][123091] Updated weights for policy 0, policy_version 379744 (0.0010) [2023-12-26 02:37:01,847][123091] Updated weights for policy 0, policy_version 379754 (0.0010) [2023-12-26 02:37:02,248][123090] Updated weights for policy 1, policy_version 377544 (0.0009) [2023-12-26 02:37:02,318][123090] Updated weights for policy 1, policy_version 377554 (0.0011) [2023-12-26 02:37:02,393][123090] Updated weights for policy 1, policy_version 377564 (0.0010) [2023-12-26 02:37:02,612][123091] Updated weights for policy 0, policy_version 379764 (0.0011) [2023-12-26 02:37:02,678][123091] Updated weights for policy 0, policy_version 379774 (0.0011) [2023-12-26 02:37:02,740][123091] Updated weights for policy 0, policy_version 379784 (0.0009) [2023-12-26 02:37:03,187][123090] Updated weights for policy 1, policy_version 377574 (0.0010) [2023-12-26 02:37:03,241][123090] Updated weights for policy 1, policy_version 377584 (0.0010) [2023-12-26 02:37:03,303][123090] Updated weights for policy 1, policy_version 377594 (0.0010) [2023-12-26 02:37:03,529][123091] Updated weights for policy 0, policy_version 379794 (0.0008) [2023-12-26 02:37:03,578][123091] Updated weights for policy 0, policy_version 379804 (0.0005) [2023-12-26 02:37:03,623][123091] Updated weights for policy 0, policy_version 379814 (0.0005) [2023-12-26 02:37:03,690][123091] Updated weights for policy 0, policy_version 379824 (0.0005) [2023-12-26 02:37:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 193904640. Throughput: 0: 9030.1, 1: 8895.0. Samples: 193913168. Policy #0 lag: (min: 31.0, avg: 31.9, max: 59.0) [2023-12-26 02:37:03,785][121949] Avg episode reward: [(0, '6349.768'), (1, '6082.479')] [2023-12-26 02:37:04,060][123090] Updated weights for policy 1, policy_version 377604 (0.0008) [2023-12-26 02:37:04,125][123090] Updated weights for policy 1, policy_version 377614 (0.0011) [2023-12-26 02:37:04,178][123090] Updated weights for policy 1, policy_version 377624 (0.0010) [2023-12-26 02:37:04,445][123091] Updated weights for policy 0, policy_version 379834 (0.0011) [2023-12-26 02:37:04,513][123091] Updated weights for policy 0, policy_version 379844 (0.0006) [2023-12-26 02:37:04,586][123091] Updated weights for policy 0, policy_version 379854 (0.0009) [2023-12-26 02:37:05,021][123090] Updated weights for policy 1, policy_version 377634 (0.0010) [2023-12-26 02:37:05,076][123090] Updated weights for policy 1, policy_version 377644 (0.0005) [2023-12-26 02:37:05,128][123090] Updated weights for policy 1, policy_version 377654 (0.0005) [2023-12-26 02:37:05,193][123090] Updated weights for policy 1, policy_version 377664 (0.0005) [2023-12-26 02:37:05,403][123091] Updated weights for policy 0, policy_version 379864 (0.0006) [2023-12-26 02:37:05,456][123091] Updated weights for policy 0, policy_version 379874 (0.0005) [2023-12-26 02:37:05,502][123091] Updated weights for policy 0, policy_version 379884 (0.0005) [2023-12-26 02:37:05,848][123090] Updated weights for policy 1, policy_version 377674 (0.0005) [2023-12-26 02:37:05,907][123090] Updated weights for policy 1, policy_version 377684 (0.0009) [2023-12-26 02:37:05,959][123090] Updated weights for policy 1, policy_version 377694 (0.0010) [2023-12-26 02:37:06,142][123091] Updated weights for policy 0, policy_version 379894 (0.0009) [2023-12-26 02:37:06,197][123091] Updated weights for policy 0, policy_version 379904 (0.0010) [2023-12-26 02:37:06,256][123091] Updated weights for policy 0, policy_version 379914 (0.0010) [2023-12-26 02:37:06,736][123090] Updated weights for policy 1, policy_version 377704 (0.0009) [2023-12-26 02:37:06,794][123090] Updated weights for policy 1, policy_version 377714 (0.0007) [2023-12-26 02:37:06,842][123090] Updated weights for policy 1, policy_version 377724 (0.0005) [2023-12-26 02:37:06,949][123091] Updated weights for policy 0, policy_version 379924 (0.0008) [2023-12-26 02:37:07,022][123091] Updated weights for policy 0, policy_version 379934 (0.0011) [2023-12-26 02:37:07,092][123091] Updated weights for policy 0, policy_version 379944 (0.0011) [2023-12-26 02:37:07,628][123090] Updated weights for policy 1, policy_version 377734 (0.0008) [2023-12-26 02:37:07,676][123090] Updated weights for policy 1, policy_version 377744 (0.0010) [2023-12-26 02:37:07,735][123090] Updated weights for policy 1, policy_version 377754 (0.0010) [2023-12-26 02:37:07,870][123091] Updated weights for policy 0, policy_version 379954 (0.0011) [2023-12-26 02:37:07,932][123091] Updated weights for policy 0, policy_version 379964 (0.0011) [2023-12-26 02:37:07,987][123091] Updated weights for policy 0, policy_version 379974 (0.0010) [2023-12-26 02:37:08,038][123091] Updated weights for policy 0, policy_version 379984 (0.0010) [2023-12-26 02:37:08,486][123090] Updated weights for policy 1, policy_version 377764 (0.0009) [2023-12-26 02:37:08,549][123090] Updated weights for policy 1, policy_version 377774 (0.0005) [2023-12-26 02:37:08,613][123090] Updated weights for policy 1, policy_version 377784 (0.0005) [2023-12-26 02:37:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 193994752. Throughput: 0: 9108.0, 1: 8956.0. Samples: 193970100. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:08,786][121949] Avg episode reward: [(0, '6439.489'), (1, '6069.052')] [2023-12-26 02:37:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000379984_97280000.pth... [2023-12-26 02:37:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000377792_96714752.pth... [2023-12-26 02:37:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000378928_97009664.pth [2023-12-26 02:37:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000376736_96444416.pth [2023-12-26 02:37:08,884][123091] Updated weights for policy 0, policy_version 379994 (0.0010) [2023-12-26 02:37:08,958][123091] Updated weights for policy 0, policy_version 380004 (0.0008) [2023-12-26 02:37:09,016][123091] Updated weights for policy 0, policy_version 380014 (0.0009) [2023-12-26 02:37:09,344][123090] Updated weights for policy 1, policy_version 377794 (0.0006) [2023-12-26 02:37:09,417][123090] Updated weights for policy 1, policy_version 377804 (0.0008) [2023-12-26 02:37:09,480][123090] Updated weights for policy 1, policy_version 377814 (0.0010) [2023-12-26 02:37:09,542][123090] Updated weights for policy 1, policy_version 377824 (0.0008) [2023-12-26 02:37:09,855][123091] Updated weights for policy 0, policy_version 380024 (0.0008) [2023-12-26 02:37:09,915][123091] Updated weights for policy 0, policy_version 380034 (0.0008) [2023-12-26 02:37:09,977][123091] Updated weights for policy 0, policy_version 380044 (0.0008) [2023-12-26 02:37:10,397][123090] Updated weights for policy 1, policy_version 377834 (0.0009) [2023-12-26 02:37:10,457][123090] Updated weights for policy 1, policy_version 377844 (0.0009) [2023-12-26 02:37:10,523][123090] Updated weights for policy 1, policy_version 377854 (0.0009) [2023-12-26 02:37:10,736][123091] Updated weights for policy 0, policy_version 380054 (0.0009) [2023-12-26 02:37:10,804][123091] Updated weights for policy 0, policy_version 380064 (0.0006) [2023-12-26 02:37:10,861][123091] Updated weights for policy 0, policy_version 380074 (0.0005) [2023-12-26 02:37:11,392][123090] Updated weights for policy 1, policy_version 377864 (0.0009) [2023-12-26 02:37:11,458][123090] Updated weights for policy 1, policy_version 377874 (0.0006) [2023-12-26 02:37:11,520][123090] Updated weights for policy 1, policy_version 377884 (0.0005) [2023-12-26 02:37:11,734][123091] Updated weights for policy 0, policy_version 380084 (0.0006) [2023-12-26 02:37:11,806][123091] Updated weights for policy 0, policy_version 380094 (0.0007) [2023-12-26 02:37:11,881][123091] Updated weights for policy 0, policy_version 380104 (0.0008) [2023-12-26 02:37:12,169][123090] Updated weights for policy 1, policy_version 377894 (0.0007) [2023-12-26 02:37:12,232][123090] Updated weights for policy 1, policy_version 377904 (0.0006) [2023-12-26 02:37:12,300][123090] Updated weights for policy 1, policy_version 377914 (0.0007) [2023-12-26 02:37:12,748][123091] Updated weights for policy 0, policy_version 380114 (0.0009) [2023-12-26 02:37:12,811][123091] Updated weights for policy 0, policy_version 380124 (0.0010) [2023-12-26 02:37:12,877][123091] Updated weights for policy 0, policy_version 380134 (0.0007) [2023-12-26 02:37:12,935][123091] Updated weights for policy 0, policy_version 380144 (0.0009) [2023-12-26 02:37:13,047][123090] Updated weights for policy 1, policy_version 377924 (0.0008) [2023-12-26 02:37:13,125][123090] Updated weights for policy 1, policy_version 377934 (0.0006) [2023-12-26 02:37:13,205][123090] Updated weights for policy 1, policy_version 377944 (0.0006) [2023-12-26 02:37:13,749][123091] Updated weights for policy 0, policy_version 380154 (0.0009) [2023-12-26 02:37:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 194076672. Throughput: 0: 9047.9, 1: 9014.0. Samples: 194075336. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:13,784][121949] Avg episode reward: [(0, '6523.381'), (1, '6015.186')] [2023-12-26 02:37:13,796][123091] Updated weights for policy 0, policy_version 380165 (0.0007) [2023-12-26 02:37:13,851][123091] Updated weights for policy 0, policy_version 380175 (0.0005) [2023-12-26 02:37:13,947][123090] Updated weights for policy 1, policy_version 377954 (0.0009) [2023-12-26 02:37:14,009][123090] Updated weights for policy 1, policy_version 377964 (0.0008) [2023-12-26 02:37:14,069][123090] Updated weights for policy 1, policy_version 377974 (0.0008) [2023-12-26 02:37:14,128][123090] Updated weights for policy 1, policy_version 377984 (0.0008) [2023-12-26 02:37:14,566][123091] Updated weights for policy 0, policy_version 380185 (0.0010) [2023-12-26 02:37:14,634][123091] Updated weights for policy 0, policy_version 380195 (0.0010) [2023-12-26 02:37:14,705][123091] Updated weights for policy 0, policy_version 380205 (0.0011) [2023-12-26 02:37:14,992][123090] Updated weights for policy 1, policy_version 377994 (0.0009) [2023-12-26 02:37:15,056][123090] Updated weights for policy 1, policy_version 378004 (0.0008) [2023-12-26 02:37:15,116][123090] Updated weights for policy 1, policy_version 378014 (0.0009) [2023-12-26 02:37:15,512][123091] Updated weights for policy 0, policy_version 380215 (0.0008) [2023-12-26 02:37:15,565][123091] Updated weights for policy 0, policy_version 380225 (0.0005) [2023-12-26 02:37:15,619][123091] Updated weights for policy 0, policy_version 380235 (0.0006) [2023-12-26 02:37:15,983][123090] Updated weights for policy 1, policy_version 378024 (0.0009) [2023-12-26 02:37:16,049][123090] Updated weights for policy 1, policy_version 378034 (0.0009) [2023-12-26 02:37:16,101][123090] Updated weights for policy 1, policy_version 378044 (0.0005) [2023-12-26 02:37:16,256][123091] Updated weights for policy 0, policy_version 380245 (0.0008) [2023-12-26 02:37:16,307][123091] Updated weights for policy 0, policy_version 380255 (0.0009) [2023-12-26 02:37:16,357][123091] Updated weights for policy 0, policy_version 380265 (0.0005) [2023-12-26 02:37:16,949][123090] Updated weights for policy 1, policy_version 378054 (0.0007) [2023-12-26 02:37:17,001][123090] Updated weights for policy 1, policy_version 378065 (0.0009) [2023-12-26 02:37:17,016][123091] Updated weights for policy 0, policy_version 380275 (0.0005) [2023-12-26 02:37:17,055][123090] Updated weights for policy 1, policy_version 378075 (0.0010) [2023-12-26 02:37:17,070][123091] Updated weights for policy 0, policy_version 380285 (0.0005) [2023-12-26 02:37:17,120][123091] Updated weights for policy 0, policy_version 380295 (0.0006) [2023-12-26 02:37:17,858][123091] Updated weights for policy 0, policy_version 380305 (0.0008) [2023-12-26 02:37:17,909][123091] Updated weights for policy 0, policy_version 380315 (0.0005) [2023-12-26 02:37:17,960][123091] Updated weights for policy 0, policy_version 380325 (0.0005) [2023-12-26 02:37:17,978][123090] Updated weights for policy 1, policy_version 378085 (0.0008) [2023-12-26 02:37:18,013][123091] Updated weights for policy 0, policy_version 380335 (0.0005) [2023-12-26 02:37:18,035][123090] Updated weights for policy 1, policy_version 378095 (0.0009) [2023-12-26 02:37:18,087][123090] Updated weights for policy 1, policy_version 378105 (0.0009) [2023-12-26 02:37:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 194166784. Throughput: 0: 9134.7, 1: 8945.9. Samples: 194182228. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:18,785][121949] Avg episode reward: [(0, '6369.752'), (1, '5957.163')] [2023-12-26 02:37:18,860][123091] Updated weights for policy 0, policy_version 380345 (0.0007) [2023-12-26 02:37:18,923][123091] Updated weights for policy 0, policy_version 380355 (0.0005) [2023-12-26 02:37:18,954][123090] Updated weights for policy 1, policy_version 378115 (0.0008) [2023-12-26 02:37:18,992][123091] Updated weights for policy 0, policy_version 380365 (0.0006) [2023-12-26 02:37:19,025][123090] Updated weights for policy 1, policy_version 378125 (0.0006) [2023-12-26 02:37:19,072][123090] Updated weights for policy 1, policy_version 378135 (0.0005) [2023-12-26 02:37:19,713][123091] Updated weights for policy 0, policy_version 380375 (0.0007) [2023-12-26 02:37:19,787][123091] Updated weights for policy 0, policy_version 380385 (0.0008) [2023-12-26 02:37:19,851][123091] Updated weights for policy 0, policy_version 380395 (0.0010) [2023-12-26 02:37:19,936][123090] Updated weights for policy 1, policy_version 378145 (0.0006) [2023-12-26 02:37:20,011][123090] Updated weights for policy 1, policy_version 378155 (0.0009) [2023-12-26 02:37:20,080][123090] Updated weights for policy 1, policy_version 378165 (0.0010) [2023-12-26 02:37:20,147][123090] Updated weights for policy 1, policy_version 378175 (0.0010) [2023-12-26 02:37:20,608][123091] Updated weights for policy 0, policy_version 380405 (0.0008) [2023-12-26 02:37:20,677][123091] Updated weights for policy 0, policy_version 380415 (0.0006) [2023-12-26 02:37:20,751][123091] Updated weights for policy 0, policy_version 380425 (0.0008) [2023-12-26 02:37:21,012][123090] Updated weights for policy 1, policy_version 378185 (0.0009) [2023-12-26 02:37:21,092][123090] Updated weights for policy 1, policy_version 378195 (0.0008) [2023-12-26 02:37:21,168][123090] Updated weights for policy 1, policy_version 378205 (0.0008) [2023-12-26 02:37:21,566][123091] Updated weights for policy 0, policy_version 380435 (0.0010) [2023-12-26 02:37:21,629][123091] Updated weights for policy 0, policy_version 380445 (0.0009) [2023-12-26 02:37:21,689][123091] Updated weights for policy 0, policy_version 380455 (0.0010) [2023-12-26 02:37:21,966][123090] Updated weights for policy 1, policy_version 378215 (0.0010) [2023-12-26 02:37:22,037][123090] Updated weights for policy 1, policy_version 378225 (0.0009) [2023-12-26 02:37:22,102][123090] Updated weights for policy 1, policy_version 378235 (0.0009) [2023-12-26 02:37:22,514][123091] Updated weights for policy 0, policy_version 380465 (0.0010) [2023-12-26 02:37:22,573][123091] Updated weights for policy 0, policy_version 380475 (0.0011) [2023-12-26 02:37:22,633][123091] Updated weights for policy 0, policy_version 380485 (0.0011) [2023-12-26 02:37:22,700][123091] Updated weights for policy 0, policy_version 380495 (0.0011) [2023-12-26 02:37:22,938][123090] Updated weights for policy 1, policy_version 378245 (0.0008) [2023-12-26 02:37:23,010][123090] Updated weights for policy 1, policy_version 378255 (0.0009) [2023-12-26 02:37:23,080][123090] Updated weights for policy 1, policy_version 378265 (0.0009) [2023-12-26 02:37:23,537][123091] Updated weights for policy 0, policy_version 380505 (0.0008) [2023-12-26 02:37:23,604][123091] Updated weights for policy 0, policy_version 380515 (0.0008) [2023-12-26 02:37:23,667][123091] Updated weights for policy 0, policy_version 380525 (0.0009) [2023-12-26 02:37:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 194256896. Throughput: 0: 9044.3, 1: 8914.5. Samples: 194233964. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:23,785][121949] Avg episode reward: [(0, '6336.467'), (1, '6017.172')] [2023-12-26 02:37:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000380528_97419264.pth... [2023-12-26 02:37:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000378272_96837632.pth... [2023-12-26 02:37:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000379440_97140736.pth [2023-12-26 02:37:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000377248_96575488.pth [2023-12-26 02:37:23,851][123090] Updated weights for policy 1, policy_version 378275 (0.0009) [2023-12-26 02:37:23,916][123090] Updated weights for policy 1, policy_version 378285 (0.0009) [2023-12-26 02:37:23,973][123090] Updated weights for policy 1, policy_version 378295 (0.0009) [2023-12-26 02:37:24,413][123091] Updated weights for policy 0, policy_version 380535 (0.0009) [2023-12-26 02:37:24,478][123091] Updated weights for policy 0, policy_version 380545 (0.0006) [2023-12-26 02:37:24,544][123091] Updated weights for policy 0, policy_version 380555 (0.0011) [2023-12-26 02:37:24,769][123090] Updated weights for policy 1, policy_version 378305 (0.0009) [2023-12-26 02:37:24,829][123090] Updated weights for policy 1, policy_version 378315 (0.0005) [2023-12-26 02:37:24,891][123090] Updated weights for policy 1, policy_version 378325 (0.0005) [2023-12-26 02:37:24,947][123090] Updated weights for policy 1, policy_version 378335 (0.0005) [2023-12-26 02:37:25,246][123091] Updated weights for policy 0, policy_version 380565 (0.0011) [2023-12-26 02:37:25,310][123091] Updated weights for policy 0, policy_version 380575 (0.0007) [2023-12-26 02:37:25,379][123091] Updated weights for policy 0, policy_version 380585 (0.0006) [2023-12-26 02:37:25,694][123090] Updated weights for policy 1, policy_version 378345 (0.0009) [2023-12-26 02:37:25,747][123090] Updated weights for policy 1, policy_version 378355 (0.0010) [2023-12-26 02:37:25,802][123090] Updated weights for policy 1, policy_version 378365 (0.0010) [2023-12-26 02:37:25,974][123091] Updated weights for policy 0, policy_version 380595 (0.0006) [2023-12-26 02:37:26,048][123091] Updated weights for policy 0, policy_version 380605 (0.0009) [2023-12-26 02:37:26,112][123091] Updated weights for policy 0, policy_version 380615 (0.0007) [2023-12-26 02:37:26,585][123090] Updated weights for policy 1, policy_version 378375 (0.0007) [2023-12-26 02:37:26,633][123090] Updated weights for policy 1, policy_version 378385 (0.0005) [2023-12-26 02:37:26,688][123090] Updated weights for policy 1, policy_version 378395 (0.0009) [2023-12-26 02:37:26,782][123091] Updated weights for policy 0, policy_version 380625 (0.0005) [2023-12-26 02:37:26,851][123091] Updated weights for policy 0, policy_version 380635 (0.0005) [2023-12-26 02:37:26,920][123091] Updated weights for policy 0, policy_version 380645 (0.0005) [2023-12-26 02:37:26,987][123091] Updated weights for policy 0, policy_version 380655 (0.0005) [2023-12-26 02:37:27,580][123090] Updated weights for policy 1, policy_version 378405 (0.0009) [2023-12-26 02:37:27,598][123091] Updated weights for policy 0, policy_version 380665 (0.0005) [2023-12-26 02:37:27,634][123090] Updated weights for policy 1, policy_version 378415 (0.0006) [2023-12-26 02:37:27,656][123091] Updated weights for policy 0, policy_version 380675 (0.0007) [2023-12-26 02:37:27,684][123090] Updated weights for policy 1, policy_version 378425 (0.0006) [2023-12-26 02:37:27,710][123091] Updated weights for policy 0, policy_version 380685 (0.0008) [2023-12-26 02:37:28,341][123090] Updated weights for policy 1, policy_version 378435 (0.0007) [2023-12-26 02:37:28,406][123090] Updated weights for policy 1, policy_version 378445 (0.0007) [2023-12-26 02:37:28,414][123091] Updated weights for policy 0, policy_version 380695 (0.0007) [2023-12-26 02:37:28,465][123090] Updated weights for policy 1, policy_version 378455 (0.0008) [2023-12-26 02:37:28,480][123091] Updated weights for policy 0, policy_version 380705 (0.0008) [2023-12-26 02:37:28,541][123091] Updated weights for policy 0, policy_version 380715 (0.0009) [2023-12-26 02:37:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 194355200. Throughput: 0: 9151.7, 1: 8910.8. Samples: 194343656. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:28,785][121949] Avg episode reward: [(0, '6327.308'), (1, '6060.647')] [2023-12-26 02:37:29,207][123090] Updated weights for policy 1, policy_version 378465 (0.0007) [2023-12-26 02:37:29,272][123090] Updated weights for policy 1, policy_version 378475 (0.0009) [2023-12-26 02:37:29,322][123090] Updated weights for policy 1, policy_version 378485 (0.0009) [2023-12-26 02:37:29,336][123091] Updated weights for policy 0, policy_version 380725 (0.0009) [2023-12-26 02:37:29,391][123090] Updated weights for policy 1, policy_version 378495 (0.0008) [2023-12-26 02:37:29,405][123091] Updated weights for policy 0, policy_version 380735 (0.0009) [2023-12-26 02:37:29,472][123091] Updated weights for policy 0, policy_version 380745 (0.0010) [2023-12-26 02:37:30,197][123090] Updated weights for policy 1, policy_version 378505 (0.0008) [2023-12-26 02:37:30,248][123090] Updated weights for policy 1, policy_version 378515 (0.0005) [2023-12-26 02:37:30,288][123091] Updated weights for policy 0, policy_version 380755 (0.0011) [2023-12-26 02:37:30,308][123090] Updated weights for policy 1, policy_version 378525 (0.0005) [2023-12-26 02:37:30,350][123091] Updated weights for policy 0, policy_version 380765 (0.0011) [2023-12-26 02:37:30,409][123091] Updated weights for policy 0, policy_version 380775 (0.0011) [2023-12-26 02:37:31,120][123090] Updated weights for policy 1, policy_version 378535 (0.0009) [2023-12-26 02:37:31,183][123090] Updated weights for policy 1, policy_version 378545 (0.0010) [2023-12-26 02:37:31,200][123091] Updated weights for policy 0, policy_version 380785 (0.0010) [2023-12-26 02:37:31,241][123090] Updated weights for policy 1, policy_version 378555 (0.0009) [2023-12-26 02:37:31,258][123091] Updated weights for policy 0, policy_version 380795 (0.0006) [2023-12-26 02:37:31,316][123091] Updated weights for policy 0, policy_version 380805 (0.0005) [2023-12-26 02:37:31,385][123091] Updated weights for policy 0, policy_version 380815 (0.0007) [2023-12-26 02:37:32,109][123091] Updated weights for policy 0, policy_version 380825 (0.0005) [2023-12-26 02:37:32,160][123090] Updated weights for policy 1, policy_version 378565 (0.0008) [2023-12-26 02:37:32,171][123091] Updated weights for policy 0, policy_version 380835 (0.0006) [2023-12-26 02:37:32,214][123090] Updated weights for policy 1, policy_version 378575 (0.0008) [2023-12-26 02:37:32,227][123091] Updated weights for policy 0, policy_version 380845 (0.0005) [2023-12-26 02:37:32,270][123090] Updated weights for policy 1, policy_version 378585 (0.0009) [2023-12-26 02:37:33,004][123091] Updated weights for policy 0, policy_version 380855 (0.0008) [2023-12-26 02:37:33,054][123091] Updated weights for policy 0, policy_version 380865 (0.0009) [2023-12-26 02:37:33,104][123091] Updated weights for policy 0, policy_version 380875 (0.0010) [2023-12-26 02:37:33,110][123090] Updated weights for policy 1, policy_version 378596 (0.0008) [2023-12-26 02:37:33,161][123090] Updated weights for policy 1, policy_version 378606 (0.0010) [2023-12-26 02:37:33,217][123090] Updated weights for policy 1, policy_version 378616 (0.0009) [2023-12-26 02:37:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 194437120. Throughput: 0: 9209.7, 1: 8807.6. Samples: 194451256. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:33,785][121949] Avg episode reward: [(0, '6173.169'), (1, '6078.093')] [2023-12-26 02:37:33,790][123091] Updated weights for policy 0, policy_version 380885 (0.0006) [2023-12-26 02:37:33,845][123091] Updated weights for policy 0, policy_version 380895 (0.0006) [2023-12-26 02:37:33,889][123091] Updated weights for policy 0, policy_version 380905 (0.0005) [2023-12-26 02:37:34,107][123090] Updated weights for policy 1, policy_version 378626 (0.0009) [2023-12-26 02:37:34,175][123090] Updated weights for policy 1, policy_version 378636 (0.0009) [2023-12-26 02:37:34,231][123090] Updated weights for policy 1, policy_version 378646 (0.0009) [2023-12-26 02:37:34,289][123090] Updated weights for policy 1, policy_version 378656 (0.0010) [2023-12-26 02:37:34,535][123091] Updated weights for policy 0, policy_version 380915 (0.0005) [2023-12-26 02:37:34,589][123091] Updated weights for policy 0, policy_version 380925 (0.0006) [2023-12-26 02:37:34,645][123091] Updated weights for policy 0, policy_version 380935 (0.0006) [2023-12-26 02:37:35,203][123090] Updated weights for policy 1, policy_version 378666 (0.0009) [2023-12-26 02:37:35,263][123090] Updated weights for policy 1, policy_version 378676 (0.0009) [2023-12-26 02:37:35,315][123090] Updated weights for policy 1, policy_version 378686 (0.0009) [2023-12-26 02:37:35,347][123091] Updated weights for policy 0, policy_version 380945 (0.0006) [2023-12-26 02:37:35,398][123091] Updated weights for policy 0, policy_version 380955 (0.0005) [2023-12-26 02:37:35,452][123091] Updated weights for policy 0, policy_version 380965 (0.0005) [2023-12-26 02:37:35,505][123091] Updated weights for policy 0, policy_version 380975 (0.0005) [2023-12-26 02:37:36,226][123090] Updated weights for policy 1, policy_version 378696 (0.0008) [2023-12-26 02:37:36,241][123091] Updated weights for policy 0, policy_version 380985 (0.0007) [2023-12-26 02:37:36,292][123090] Updated weights for policy 1, policy_version 378706 (0.0008) [2023-12-26 02:37:36,303][123091] Updated weights for policy 0, policy_version 380995 (0.0007) [2023-12-26 02:37:36,344][123090] Updated weights for policy 1, policy_version 378716 (0.0008) [2023-12-26 02:37:36,356][123091] Updated weights for policy 0, policy_version 381005 (0.0005) [2023-12-26 02:37:37,102][123091] Updated weights for policy 0, policy_version 381015 (0.0007) [2023-12-26 02:37:37,162][123091] Updated weights for policy 0, policy_version 381025 (0.0009) [2023-12-26 02:37:37,173][123090] Updated weights for policy 1, policy_version 378726 (0.0008) [2023-12-26 02:37:37,227][123091] Updated weights for policy 0, policy_version 381035 (0.0007) [2023-12-26 02:37:37,233][123090] Updated weights for policy 1, policy_version 378736 (0.0011) [2023-12-26 02:37:37,292][123090] Updated weights for policy 1, policy_version 378746 (0.0010) [2023-12-26 02:37:37,963][123091] Updated weights for policy 0, policy_version 381045 (0.0008) [2023-12-26 02:37:38,011][123091] Updated weights for policy 0, policy_version 381055 (0.0006) [2023-12-26 02:37:38,058][123091] Updated weights for policy 0, policy_version 381065 (0.0007) [2023-12-26 02:37:38,096][123090] Updated weights for policy 1, policy_version 378756 (0.0010) [2023-12-26 02:37:38,148][123090] Updated weights for policy 1, policy_version 378766 (0.0010) [2023-12-26 02:37:38,204][123090] Updated weights for policy 1, policy_version 378776 (0.0010) [2023-12-26 02:37:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 194527232. Throughput: 0: 9320.7, 1: 8767.6. Samples: 194505332. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:38,785][121949] Avg episode reward: [(0, '6050.643'), (1, '6059.753')] [2023-12-26 02:37:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000381072_97558528.pth... [2023-12-26 02:37:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000378784_96968704.pth... [2023-12-26 02:37:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000377792_96714752.pth [2023-12-26 02:37:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000379984_97280000.pth [2023-12-26 02:37:38,843][123091] Updated weights for policy 0, policy_version 381075 (0.0007) [2023-12-26 02:37:38,910][123091] Updated weights for policy 0, policy_version 381085 (0.0006) [2023-12-26 02:37:38,958][123090] Updated weights for policy 1, policy_version 378786 (0.0010) [2023-12-26 02:37:38,973][123091] Updated weights for policy 0, policy_version 381095 (0.0007) [2023-12-26 02:37:39,018][123090] Updated weights for policy 1, policy_version 378796 (0.0011) [2023-12-26 02:37:39,080][123090] Updated weights for policy 1, policy_version 378806 (0.0010) [2023-12-26 02:37:39,145][123090] Updated weights for policy 1, policy_version 378816 (0.0011) [2023-12-26 02:37:39,754][123091] Updated weights for policy 0, policy_version 381105 (0.0008) [2023-12-26 02:37:39,819][123091] Updated weights for policy 0, policy_version 381115 (0.0007) [2023-12-26 02:37:39,888][123091] Updated weights for policy 0, policy_version 381125 (0.0011) [2023-12-26 02:37:39,958][123091] Updated weights for policy 0, policy_version 381135 (0.0011) [2023-12-26 02:37:40,019][123090] Updated weights for policy 1, policy_version 378826 (0.0007) [2023-12-26 02:37:40,068][123090] Updated weights for policy 1, policy_version 378836 (0.0011) [2023-12-26 02:37:40,121][123090] Updated weights for policy 1, policy_version 378846 (0.0011) [2023-12-26 02:37:40,783][123091] Updated weights for policy 0, policy_version 381145 (0.0010) [2023-12-26 02:37:40,834][123091] Updated weights for policy 0, policy_version 381155 (0.0010) [2023-12-26 02:37:40,837][123090] Updated weights for policy 1, policy_version 378856 (0.0007) [2023-12-26 02:37:40,885][123091] Updated weights for policy 0, policy_version 381165 (0.0010) [2023-12-26 02:37:40,901][123090] Updated weights for policy 1, policy_version 378866 (0.0008) [2023-12-26 02:37:40,961][123090] Updated weights for policy 1, policy_version 378876 (0.0009) [2023-12-26 02:37:41,772][123091] Updated weights for policy 0, policy_version 381175 (0.0009) [2023-12-26 02:37:41,827][123090] Updated weights for policy 1, policy_version 378886 (0.0009) [2023-12-26 02:37:41,836][123091] Updated weights for policy 0, policy_version 381185 (0.0008) [2023-12-26 02:37:41,886][123090] Updated weights for policy 1, policy_version 378896 (0.0008) [2023-12-26 02:37:41,902][123091] Updated weights for policy 0, policy_version 381195 (0.0008) [2023-12-26 02:37:41,950][123090] Updated weights for policy 1, policy_version 378906 (0.0009) [2023-12-26 02:37:42,675][123091] Updated weights for policy 0, policy_version 381205 (0.0007) [2023-12-26 02:37:42,730][123091] Updated weights for policy 0, policy_version 381215 (0.0006) [2023-12-26 02:37:42,770][123090] Updated weights for policy 1, policy_version 378916 (0.0009) [2023-12-26 02:37:42,781][123091] Updated weights for policy 0, policy_version 381225 (0.0008) [2023-12-26 02:37:42,840][123090] Updated weights for policy 1, policy_version 378926 (0.0009) [2023-12-26 02:37:42,905][123090] Updated weights for policy 1, policy_version 378936 (0.0009) [2023-12-26 02:37:43,583][123091] Updated weights for policy 0, policy_version 381235 (0.0006) [2023-12-26 02:37:43,634][123091] Updated weights for policy 0, policy_version 381245 (0.0009) [2023-12-26 02:37:43,688][123091] Updated weights for policy 0, policy_version 381255 (0.0010) [2023-12-26 02:37:43,750][123090] Updated weights for policy 1, policy_version 378946 (0.0009) [2023-12-26 02:37:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 194617344. Throughput: 0: 9225.6, 1: 8692.3. Samples: 194611092. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:43,784][121949] Avg episode reward: [(0, '6164.799'), (1, '5990.384')] [2023-12-26 02:37:43,814][123090] Updated weights for policy 1, policy_version 378956 (0.0010) [2023-12-26 02:37:43,875][123090] Updated weights for policy 1, policy_version 378966 (0.0009) [2023-12-26 02:37:43,939][123090] Updated weights for policy 1, policy_version 378976 (0.0009) [2023-12-26 02:37:44,552][123091] Updated weights for policy 0, policy_version 381265 (0.0010) [2023-12-26 02:37:44,619][123091] Updated weights for policy 0, policy_version 381275 (0.0010) [2023-12-26 02:37:44,679][123091] Updated weights for policy 0, policy_version 381285 (0.0009) [2023-12-26 02:37:44,725][123090] Updated weights for policy 1, policy_version 378986 (0.0008) [2023-12-26 02:37:44,743][123091] Updated weights for policy 0, policy_version 381295 (0.0010) [2023-12-26 02:37:44,795][123090] Updated weights for policy 1, policy_version 378996 (0.0008) [2023-12-26 02:37:44,855][123090] Updated weights for policy 1, policy_version 379006 (0.0009) [2023-12-26 02:37:45,605][123091] Updated weights for policy 0, policy_version 381305 (0.0009) [2023-12-26 02:37:45,661][123091] Updated weights for policy 0, policy_version 381315 (0.0009) [2023-12-26 02:37:45,690][123090] Updated weights for policy 1, policy_version 379016 (0.0007) [2023-12-26 02:37:45,718][123091] Updated weights for policy 0, policy_version 381325 (0.0010) [2023-12-26 02:37:45,749][123090] Updated weights for policy 1, policy_version 379026 (0.0008) [2023-12-26 02:37:45,809][123090] Updated weights for policy 1, policy_version 379036 (0.0008) [2023-12-26 02:37:46,489][123091] Updated weights for policy 0, policy_version 381335 (0.0010) [2023-12-26 02:37:46,536][123091] Updated weights for policy 0, policy_version 381345 (0.0009) [2023-12-26 02:37:46,592][123091] Updated weights for policy 0, policy_version 381355 (0.0009) [2023-12-26 02:37:46,651][123090] Updated weights for policy 1, policy_version 379046 (0.0006) [2023-12-26 02:37:46,713][123090] Updated weights for policy 1, policy_version 379056 (0.0008) [2023-12-26 02:37:46,763][123090] Updated weights for policy 1, policy_version 379066 (0.0009) [2023-12-26 02:37:47,335][123091] Updated weights for policy 0, policy_version 381365 (0.0007) [2023-12-26 02:37:47,398][123091] Updated weights for policy 0, policy_version 381375 (0.0011) [2023-12-26 02:37:47,453][123091] Updated weights for policy 0, policy_version 381385 (0.0010) [2023-12-26 02:37:47,585][123090] Updated weights for policy 1, policy_version 379076 (0.0008) [2023-12-26 02:37:47,635][123090] Updated weights for policy 1, policy_version 379086 (0.0008) [2023-12-26 02:37:47,686][123090] Updated weights for policy 1, policy_version 379096 (0.0008) [2023-12-26 02:37:48,216][123091] Updated weights for policy 0, policy_version 381395 (0.0010) [2023-12-26 02:37:48,278][123091] Updated weights for policy 0, policy_version 381405 (0.0011) [2023-12-26 02:37:48,349][123091] Updated weights for policy 0, policy_version 381415 (0.0011) [2023-12-26 02:37:48,463][123090] Updated weights for policy 1, policy_version 379106 (0.0008) [2023-12-26 02:37:48,520][123090] Updated weights for policy 1, policy_version 379116 (0.0005) [2023-12-26 02:37:48,582][123090] Updated weights for policy 1, policy_version 379126 (0.0005) [2023-12-26 02:37:48,638][123090] Updated weights for policy 1, policy_version 379136 (0.0006) [2023-12-26 02:37:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 194707456. Throughput: 0: 9156.8, 1: 8698.9. Samples: 194716676. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:48,785][121949] Avg episode reward: [(0, '5999.208'), (1, '6007.250')] [2023-12-26 02:37:49,182][123091] Updated weights for policy 0, policy_version 381425 (0.0011) [2023-12-26 02:37:49,253][123091] Updated weights for policy 0, policy_version 381435 (0.0013) [2023-12-26 02:37:49,320][123091] Updated weights for policy 0, policy_version 381445 (0.0011) [2023-12-26 02:37:49,393][123091] Updated weights for policy 0, policy_version 381455 (0.0008) [2023-12-26 02:37:49,452][123090] Updated weights for policy 1, policy_version 379146 (0.0010) [2023-12-26 02:37:49,507][123090] Updated weights for policy 1, policy_version 379156 (0.0010) [2023-12-26 02:37:49,567][123090] Updated weights for policy 1, policy_version 379166 (0.0010) [2023-12-26 02:37:50,163][123091] Updated weights for policy 0, policy_version 381465 (0.0010) [2023-12-26 02:37:50,230][123091] Updated weights for policy 0, policy_version 381475 (0.0011) [2023-12-26 02:37:50,293][123091] Updated weights for policy 0, policy_version 381485 (0.0011) [2023-12-26 02:37:50,484][123090] Updated weights for policy 1, policy_version 379176 (0.0009) [2023-12-26 02:37:50,549][123090] Updated weights for policy 1, policy_version 379186 (0.0009) [2023-12-26 02:37:50,615][123090] Updated weights for policy 1, policy_version 379196 (0.0009) [2023-12-26 02:37:51,120][123091] Updated weights for policy 0, policy_version 381495 (0.0011) [2023-12-26 02:37:51,196][123091] Updated weights for policy 0, policy_version 381505 (0.0009) [2023-12-26 02:37:51,270][123091] Updated weights for policy 0, policy_version 381515 (0.0010) [2023-12-26 02:37:51,420][123090] Updated weights for policy 1, policy_version 379206 (0.0010) [2023-12-26 02:37:51,493][123090] Updated weights for policy 1, policy_version 379216 (0.0010) [2023-12-26 02:37:51,557][123090] Updated weights for policy 1, policy_version 379226 (0.0010) [2023-12-26 02:37:52,075][123091] Updated weights for policy 0, policy_version 381525 (0.0009) [2023-12-26 02:37:52,135][123091] Updated weights for policy 0, policy_version 381535 (0.0009) [2023-12-26 02:37:52,191][123091] Updated weights for policy 0, policy_version 381545 (0.0009) [2023-12-26 02:37:52,408][123090] Updated weights for policy 1, policy_version 379236 (0.0010) [2023-12-26 02:37:52,467][123090] Updated weights for policy 1, policy_version 379246 (0.0010) [2023-12-26 02:37:52,541][123090] Updated weights for policy 1, policy_version 379256 (0.0009) [2023-12-26 02:37:53,039][123091] Updated weights for policy 0, policy_version 381555 (0.0009) [2023-12-26 02:37:53,093][123091] Updated weights for policy 0, policy_version 381566 (0.0010) [2023-12-26 02:37:53,146][123091] Updated weights for policy 0, policy_version 381576 (0.0010) [2023-12-26 02:37:53,351][123090] Updated weights for policy 1, policy_version 379266 (0.0009) [2023-12-26 02:37:53,402][123090] Updated weights for policy 1, policy_version 379276 (0.0009) [2023-12-26 02:37:53,459][123090] Updated weights for policy 1, policy_version 379286 (0.0008) [2023-12-26 02:37:53,517][123090] Updated weights for policy 1, policy_version 379296 (0.0008) [2023-12-26 02:37:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 194789376. Throughput: 0: 9091.7, 1: 8614.5. Samples: 194766876. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:53,785][121949] Avg episode reward: [(0, '5957.911'), (1, '6042.740')] [2023-12-26 02:37:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000381584_97689600.pth... [2023-12-26 02:37:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000379296_97099776.pth... [2023-12-26 02:37:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000380528_97419264.pth [2023-12-26 02:37:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000378272_96837632.pth [2023-12-26 02:37:54,031][123091] Updated weights for policy 0, policy_version 381587 (0.0010) [2023-12-26 02:37:54,094][123091] Updated weights for policy 0, policy_version 381597 (0.0009) [2023-12-26 02:37:54,156][123091] Updated weights for policy 0, policy_version 381607 (0.0009) [2023-12-26 02:37:54,330][123090] Updated weights for policy 1, policy_version 379306 (0.0009) [2023-12-26 02:37:54,390][123090] Updated weights for policy 1, policy_version 379316 (0.0007) [2023-12-26 02:37:54,462][123090] Updated weights for policy 1, policy_version 379326 (0.0006) [2023-12-26 02:37:55,030][123091] Updated weights for policy 0, policy_version 381617 (0.0010) [2023-12-26 02:37:55,086][123091] Updated weights for policy 0, policy_version 381627 (0.0009) [2023-12-26 02:37:55,133][123091] Updated weights for policy 0, policy_version 381637 (0.0009) [2023-12-26 02:37:55,138][123090] Updated weights for policy 1, policy_version 379336 (0.0007) [2023-12-26 02:37:55,188][123090] Updated weights for policy 1, policy_version 379346 (0.0008) [2023-12-26 02:37:55,189][123091] Updated weights for policy 0, policy_version 381647 (0.0008) [2023-12-26 02:37:55,239][123090] Updated weights for policy 1, policy_version 379356 (0.0009) [2023-12-26 02:37:55,964][123090] Updated weights for policy 1, policy_version 379366 (0.0009) [2023-12-26 02:37:56,012][123090] Updated weights for policy 1, policy_version 379376 (0.0005) [2023-12-26 02:37:56,074][123091] Updated weights for policy 0, policy_version 381657 (0.0009) [2023-12-26 02:37:56,075][123090] Updated weights for policy 1, policy_version 379386 (0.0005) [2023-12-26 02:37:56,140][123091] Updated weights for policy 0, policy_version 381667 (0.0010) [2023-12-26 02:37:56,198][123091] Updated weights for policy 0, policy_version 381677 (0.0010) [2023-12-26 02:37:56,771][123090] Updated weights for policy 1, policy_version 379396 (0.0005) [2023-12-26 02:37:56,840][123090] Updated weights for policy 1, policy_version 379406 (0.0008) [2023-12-26 02:37:56,911][123090] Updated weights for policy 1, policy_version 379416 (0.0009) [2023-12-26 02:37:57,067][123091] Updated weights for policy 0, policy_version 381687 (0.0007) [2023-12-26 02:37:57,126][123091] Updated weights for policy 0, policy_version 381697 (0.0005) [2023-12-26 02:37:57,192][123091] Updated weights for policy 0, policy_version 381707 (0.0006) [2023-12-26 02:37:57,652][123090] Updated weights for policy 1, policy_version 379426 (0.0008) [2023-12-26 02:37:57,706][123090] Updated weights for policy 1, policy_version 379436 (0.0005) [2023-12-26 02:37:57,760][123090] Updated weights for policy 1, policy_version 379446 (0.0005) [2023-12-26 02:37:57,814][123090] Updated weights for policy 1, policy_version 379456 (0.0005) [2023-12-26 02:37:57,950][123091] Updated weights for policy 0, policy_version 381717 (0.0008) [2023-12-26 02:37:58,022][123091] Updated weights for policy 0, policy_version 381728 (0.0010) [2023-12-26 02:37:58,097][123091] Updated weights for policy 0, policy_version 381738 (0.0010) [2023-12-26 02:37:58,504][123090] Updated weights for policy 1, policy_version 379467 (0.0011) [2023-12-26 02:37:58,570][123090] Updated weights for policy 1, policy_version 379477 (0.0008) [2023-12-26 02:37:58,646][123090] Updated weights for policy 1, policy_version 379487 (0.0009) [2023-12-26 02:37:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 194879488. Throughput: 0: 9086.3, 1: 8655.7. Samples: 194873728. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:37:58,785][121949] Avg episode reward: [(0, '5992.985'), (1, '6011.344')] [2023-12-26 02:37:58,981][123091] Updated weights for policy 0, policy_version 381748 (0.0010) [2023-12-26 02:37:59,045][123091] Updated weights for policy 0, policy_version 381758 (0.0009) [2023-12-26 02:37:59,108][123091] Updated weights for policy 0, policy_version 381768 (0.0010) [2023-12-26 02:37:59,501][123090] Updated weights for policy 1, policy_version 379497 (0.0008) [2023-12-26 02:37:59,574][123090] Updated weights for policy 1, policy_version 379507 (0.0010) [2023-12-26 02:37:59,643][123090] Updated weights for policy 1, policy_version 379517 (0.0009) [2023-12-26 02:38:00,011][123091] Updated weights for policy 0, policy_version 381778 (0.0010) [2023-12-26 02:38:00,072][123091] Updated weights for policy 0, policy_version 381788 (0.0009) [2023-12-26 02:38:00,134][123091] Updated weights for policy 0, policy_version 381798 (0.0009) [2023-12-26 02:38:00,204][123091] Updated weights for policy 0, policy_version 381808 (0.0010) [2023-12-26 02:38:00,364][123090] Updated weights for policy 1, policy_version 379527 (0.0006) [2023-12-26 02:38:00,433][123090] Updated weights for policy 1, policy_version 379537 (0.0005) [2023-12-26 02:38:00,493][123090] Updated weights for policy 1, policy_version 379547 (0.0005) [2023-12-26 02:38:00,972][123091] Updated weights for policy 0, policy_version 381818 (0.0005) [2023-12-26 02:38:01,034][123091] Updated weights for policy 0, policy_version 381828 (0.0006) [2023-12-26 02:38:01,096][123091] Updated weights for policy 0, policy_version 381838 (0.0007) [2023-12-26 02:38:01,151][123090] Updated weights for policy 1, policy_version 379557 (0.0008) [2023-12-26 02:38:01,207][123090] Updated weights for policy 1, policy_version 379567 (0.0010) [2023-12-26 02:38:01,266][123090] Updated weights for policy 1, policy_version 379577 (0.0010) [2023-12-26 02:38:01,838][123091] Updated weights for policy 0, policy_version 381848 (0.0005) [2023-12-26 02:38:01,901][123091] Updated weights for policy 0, policy_version 381858 (0.0005) [2023-12-26 02:38:01,950][123091] Updated weights for policy 0, policy_version 381868 (0.0005) [2023-12-26 02:38:02,173][123090] Updated weights for policy 1, policy_version 379587 (0.0009) [2023-12-26 02:38:02,223][123090] Updated weights for policy 1, policy_version 379597 (0.0009) [2023-12-26 02:38:02,285][123090] Updated weights for policy 1, policy_version 379607 (0.0010) [2023-12-26 02:38:02,665][123091] Updated weights for policy 0, policy_version 381878 (0.0008) [2023-12-26 02:38:02,720][123091] Updated weights for policy 0, policy_version 381888 (0.0011) [2023-12-26 02:38:02,771][123091] Updated weights for policy 0, policy_version 381898 (0.0010) [2023-12-26 02:38:03,139][123090] Updated weights for policy 1, policy_version 379617 (0.0009) [2023-12-26 02:38:03,189][123090] Updated weights for policy 1, policy_version 379627 (0.0010) [2023-12-26 02:38:03,245][123090] Updated weights for policy 1, policy_version 379637 (0.0009) [2023-12-26 02:38:03,287][123090] Updated weights for policy 1, policy_version 379647 (0.0006) [2023-12-26 02:38:03,567][123091] Updated weights for policy 0, policy_version 381908 (0.0010) [2023-12-26 02:38:03,626][123091] Updated weights for policy 0, policy_version 381918 (0.0008) [2023-12-26 02:38:03,687][123091] Updated weights for policy 0, policy_version 381929 (0.0010) [2023-12-26 02:38:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 194969600. Throughput: 0: 8974.0, 1: 8724.4. Samples: 194978652. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:38:03,785][121949] Avg episode reward: [(0, '5935.439'), (1, '5897.272')] [2023-12-26 02:38:04,091][123090] Updated weights for policy 1, policy_version 379657 (0.0009) [2023-12-26 02:38:04,155][123090] Updated weights for policy 1, policy_version 379667 (0.0009) [2023-12-26 02:38:04,214][123090] Updated weights for policy 1, policy_version 379677 (0.0009) [2023-12-26 02:38:04,482][123091] Updated weights for policy 0, policy_version 381939 (0.0008) [2023-12-26 02:38:04,545][123091] Updated weights for policy 0, policy_version 381949 (0.0006) [2023-12-26 02:38:04,611][123091] Updated weights for policy 0, policy_version 381959 (0.0006) [2023-12-26 02:38:04,979][123090] Updated weights for policy 1, policy_version 379687 (0.0007) [2023-12-26 02:38:05,040][123090] Updated weights for policy 1, policy_version 379697 (0.0005) [2023-12-26 02:38:05,095][123090] Updated weights for policy 1, policy_version 379707 (0.0005) [2023-12-26 02:38:05,275][123091] Updated weights for policy 0, policy_version 381969 (0.0007) [2023-12-26 02:38:05,360][123091] Updated weights for policy 0, policy_version 381979 (0.0006) [2023-12-26 02:38:05,426][123091] Updated weights for policy 0, policy_version 381989 (0.0011) [2023-12-26 02:38:05,488][123091] Updated weights for policy 0, policy_version 381999 (0.0010) [2023-12-26 02:38:05,807][123090] Updated weights for policy 1, policy_version 379717 (0.0006) [2023-12-26 02:38:05,855][123090] Updated weights for policy 1, policy_version 379727 (0.0005) [2023-12-26 02:38:05,904][123090] Updated weights for policy 1, policy_version 379737 (0.0006) [2023-12-26 02:38:06,256][123091] Updated weights for policy 0, policy_version 382009 (0.0010) [2023-12-26 02:38:06,320][123091] Updated weights for policy 0, policy_version 382019 (0.0009) [2023-12-26 02:38:06,383][123091] Updated weights for policy 0, policy_version 382029 (0.0010) [2023-12-26 02:38:06,703][123090] Updated weights for policy 1, policy_version 379747 (0.0007) [2023-12-26 02:38:06,756][123090] Updated weights for policy 1, policy_version 379757 (0.0010) [2023-12-26 02:38:06,808][123090] Updated weights for policy 1, policy_version 379767 (0.0009) [2023-12-26 02:38:07,106][123091] Updated weights for policy 0, policy_version 382039 (0.0006) [2023-12-26 02:38:07,153][123091] Updated weights for policy 0, policy_version 382049 (0.0005) [2023-12-26 02:38:07,212][123091] Updated weights for policy 0, policy_version 382059 (0.0007) [2023-12-26 02:38:07,712][123090] Updated weights for policy 1, policy_version 379777 (0.0010) [2023-12-26 02:38:07,766][123090] Updated weights for policy 1, policy_version 379787 (0.0009) [2023-12-26 02:38:07,833][123090] Updated weights for policy 1, policy_version 379797 (0.0007) [2023-12-26 02:38:07,895][123090] Updated weights for policy 1, policy_version 379807 (0.0010) [2023-12-26 02:38:07,989][123091] Updated weights for policy 0, policy_version 382069 (0.0010) [2023-12-26 02:38:08,054][123091] Updated weights for policy 0, policy_version 382079 (0.0009) [2023-12-26 02:38:08,122][123091] Updated weights for policy 0, policy_version 382089 (0.0009) [2023-12-26 02:38:08,740][123090] Updated weights for policy 1, policy_version 379817 (0.0005) [2023-12-26 02:38:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 195051520. Throughput: 0: 8989.7, 1: 8787.8. Samples: 195033948. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:38:08,785][121949] Avg episode reward: [(0, '5844.498'), (1, '5829.667')] [2023-12-26 02:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000382096_97820672.pth... [2023-12-26 02:38:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000381072_97558528.pth [2023-12-26 02:38:08,806][123090] Updated weights for policy 1, policy_version 379827 (0.0006) [2023-12-26 02:38:08,873][123090] Updated weights for policy 1, policy_version 379837 (0.0005) [2023-12-26 02:38:08,890][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000379840_97239040.pth... [2023-12-26 02:38:08,894][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000378784_96968704.pth [2023-12-26 02:38:08,919][123091] Updated weights for policy 0, policy_version 382099 (0.0009) [2023-12-26 02:38:08,981][123091] Updated weights for policy 0, policy_version 382109 (0.0011) [2023-12-26 02:38:09,032][123091] Updated weights for policy 0, policy_version 382119 (0.0010) [2023-12-26 02:38:09,592][123090] Updated weights for policy 1, policy_version 379847 (0.0006) [2023-12-26 02:38:09,646][123090] Updated weights for policy 1, policy_version 379857 (0.0007) [2023-12-26 02:38:09,708][123090] Updated weights for policy 1, policy_version 379867 (0.0006) [2023-12-26 02:38:09,839][123091] Updated weights for policy 0, policy_version 382129 (0.0010) [2023-12-26 02:38:09,910][123091] Updated weights for policy 0, policy_version 382139 (0.0009) [2023-12-26 02:38:09,981][123091] Updated weights for policy 0, policy_version 382149 (0.0006) [2023-12-26 02:38:10,056][123091] Updated weights for policy 0, policy_version 382159 (0.0006) [2023-12-26 02:38:10,434][123090] Updated weights for policy 1, policy_version 379877 (0.0008) [2023-12-26 02:38:10,491][123090] Updated weights for policy 1, policy_version 379887 (0.0009) [2023-12-26 02:38:10,557][123090] Updated weights for policy 1, policy_version 379897 (0.0009) [2023-12-26 02:38:10,760][123091] Updated weights for policy 0, policy_version 382169 (0.0005) [2023-12-26 02:38:10,815][123091] Updated weights for policy 0, policy_version 382179 (0.0007) [2023-12-26 02:38:10,866][123091] Updated weights for policy 0, policy_version 382189 (0.0010) [2023-12-26 02:38:11,423][123090] Updated weights for policy 1, policy_version 379907 (0.0009) [2023-12-26 02:38:11,490][123090] Updated weights for policy 1, policy_version 379917 (0.0009) [2023-12-26 02:38:11,558][123090] Updated weights for policy 1, policy_version 379927 (0.0009) [2023-12-26 02:38:11,667][123091] Updated weights for policy 0, policy_version 382199 (0.0009) [2023-12-26 02:38:11,738][123091] Updated weights for policy 0, policy_version 382209 (0.0008) [2023-12-26 02:38:11,812][123091] Updated weights for policy 0, policy_version 382219 (0.0008) [2023-12-26 02:38:12,515][123090] Updated weights for policy 1, policy_version 379937 (0.0010) [2023-12-26 02:38:12,534][123091] Updated weights for policy 0, policy_version 382229 (0.0009) [2023-12-26 02:38:12,579][123090] Updated weights for policy 1, policy_version 379947 (0.0006) [2023-12-26 02:38:12,597][123091] Updated weights for policy 0, policy_version 382239 (0.0010) [2023-12-26 02:38:12,649][123090] Updated weights for policy 1, policy_version 379957 (0.0007) [2023-12-26 02:38:12,659][123091] Updated weights for policy 0, policy_version 382249 (0.0010) [2023-12-26 02:38:12,711][123090] Updated weights for policy 1, policy_version 379967 (0.0009) [2023-12-26 02:38:13,413][123091] Updated weights for policy 0, policy_version 382259 (0.0011) [2023-12-26 02:38:13,466][123091] Updated weights for policy 0, policy_version 382269 (0.0006) [2023-12-26 02:38:13,517][123091] Updated weights for policy 0, policy_version 382279 (0.0005) [2023-12-26 02:38:13,597][123090] Updated weights for policy 1, policy_version 379977 (0.0009) [2023-12-26 02:38:13,664][123090] Updated weights for policy 1, policy_version 379987 (0.0010) [2023-12-26 02:38:13,728][123090] Updated weights for policy 1, policy_version 379997 (0.0010) [2023-12-26 02:38:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 195149824. Throughput: 0: 8921.4, 1: 8751.8. Samples: 195138944. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:38:13,785][121949] Avg episode reward: [(0, '5948.650'), (1, '5772.860')] [2023-12-26 02:38:14,254][123091] Updated weights for policy 0, policy_version 382289 (0.0005) [2023-12-26 02:38:14,308][123091] Updated weights for policy 0, policy_version 382299 (0.0005) [2023-12-26 02:38:14,353][123091] Updated weights for policy 0, policy_version 382309 (0.0005) [2023-12-26 02:38:14,414][123091] Updated weights for policy 0, policy_version 382319 (0.0005) [2023-12-26 02:38:14,608][123090] Updated weights for policy 1, policy_version 380007 (0.0007) [2023-12-26 02:38:14,674][123090] Updated weights for policy 1, policy_version 380017 (0.0007) [2023-12-26 02:38:14,736][123090] Updated weights for policy 1, policy_version 380027 (0.0009) [2023-12-26 02:38:15,086][123091] Updated weights for policy 0, policy_version 382329 (0.0009) [2023-12-26 02:38:15,149][123091] Updated weights for policy 0, policy_version 382339 (0.0005) [2023-12-26 02:38:15,224][123091] Updated weights for policy 0, policy_version 382349 (0.0006) [2023-12-26 02:38:15,607][123090] Updated weights for policy 1, policy_version 380037 (0.0009) [2023-12-26 02:38:15,668][123090] Updated weights for policy 1, policy_version 380047 (0.0009) [2023-12-26 02:38:15,731][123090] Updated weights for policy 1, policy_version 380057 (0.0008) [2023-12-26 02:38:16,005][123091] Updated weights for policy 0, policy_version 382359 (0.0011) [2023-12-26 02:38:16,068][123091] Updated weights for policy 0, policy_version 382369 (0.0011) [2023-12-26 02:38:16,131][123091] Updated weights for policy 0, policy_version 382379 (0.0011) [2023-12-26 02:38:16,543][123090] Updated weights for policy 1, policy_version 380067 (0.0009) [2023-12-26 02:38:16,607][123090] Updated weights for policy 1, policy_version 380077 (0.0009) [2023-12-26 02:38:16,655][123090] Updated weights for policy 1, policy_version 380087 (0.0008) [2023-12-26 02:38:16,949][123091] Updated weights for policy 0, policy_version 382389 (0.0010) [2023-12-26 02:38:17,014][123091] Updated weights for policy 0, policy_version 382399 (0.0011) [2023-12-26 02:38:17,069][123091] Updated weights for policy 0, policy_version 382409 (0.0010) [2023-12-26 02:38:17,497][123090] Updated weights for policy 1, policy_version 380097 (0.0008) [2023-12-26 02:38:17,556][123090] Updated weights for policy 1, policy_version 380107 (0.0009) [2023-12-26 02:38:17,617][123090] Updated weights for policy 1, policy_version 380117 (0.0009) [2023-12-26 02:38:17,681][123090] Updated weights for policy 1, policy_version 380127 (0.0009) [2023-12-26 02:38:17,892][123091] Updated weights for policy 0, policy_version 382419 (0.0010) [2023-12-26 02:38:17,950][123091] Updated weights for policy 0, policy_version 382429 (0.0010) [2023-12-26 02:38:18,005][123091] Updated weights for policy 0, policy_version 382439 (0.0010) [2023-12-26 02:38:18,524][123090] Updated weights for policy 1, policy_version 380137 (0.0010) [2023-12-26 02:38:18,577][123090] Updated weights for policy 1, policy_version 380147 (0.0010) [2023-12-26 02:38:18,638][123090] Updated weights for policy 1, policy_version 380157 (0.0008) [2023-12-26 02:38:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 195231744. Throughput: 0: 8918.1, 1: 8674.1. Samples: 195242908. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:38:18,785][121949] Avg episode reward: [(0, '6181.734'), (1, '5724.600')] [2023-12-26 02:38:18,815][123091] Updated weights for policy 0, policy_version 382449 (0.0011) [2023-12-26 02:38:18,878][123091] Updated weights for policy 0, policy_version 382459 (0.0011) [2023-12-26 02:38:18,945][123091] Updated weights for policy 0, policy_version 382469 (0.0011) [2023-12-26 02:38:19,015][123091] Updated weights for policy 0, policy_version 382479 (0.0011) [2023-12-26 02:38:19,522][123090] Updated weights for policy 1, policy_version 380167 (0.0009) [2023-12-26 02:38:19,575][123090] Updated weights for policy 1, policy_version 380177 (0.0010) [2023-12-26 02:38:19,642][123090] Updated weights for policy 1, policy_version 380187 (0.0009) [2023-12-26 02:38:19,814][123091] Updated weights for policy 0, policy_version 382489 (0.0008) [2023-12-26 02:38:19,879][123091] Updated weights for policy 0, policy_version 382499 (0.0010) [2023-12-26 02:38:19,939][123091] Updated weights for policy 0, policy_version 382509 (0.0010) [2023-12-26 02:38:20,522][123090] Updated weights for policy 1, policy_version 380197 (0.0010) [2023-12-26 02:38:20,591][123090] Updated weights for policy 1, policy_version 380207 (0.0010) [2023-12-26 02:38:20,659][123090] Updated weights for policy 1, policy_version 380217 (0.0009) [2023-12-26 02:38:20,782][123091] Updated weights for policy 0, policy_version 382519 (0.0009) [2023-12-26 02:38:20,846][123091] Updated weights for policy 0, policy_version 382529 (0.0008) [2023-12-26 02:38:20,905][123091] Updated weights for policy 0, policy_version 382539 (0.0008) [2023-12-26 02:38:21,558][123090] Updated weights for policy 1, policy_version 380227 (0.0010) [2023-12-26 02:38:21,627][123090] Updated weights for policy 1, policy_version 380237 (0.0007) [2023-12-26 02:38:21,698][123090] Updated weights for policy 1, policy_version 380247 (0.0006) [2023-12-26 02:38:21,711][123091] Updated weights for policy 0, policy_version 382549 (0.0008) [2023-12-26 02:38:21,777][123091] Updated weights for policy 0, policy_version 382559 (0.0007) [2023-12-26 02:38:21,843][123091] Updated weights for policy 0, policy_version 382569 (0.0006) [2023-12-26 02:38:22,458][123090] Updated weights for policy 1, policy_version 380257 (0.0007) [2023-12-26 02:38:22,515][123090] Updated weights for policy 1, policy_version 380267 (0.0006) [2023-12-26 02:38:22,573][123090] Updated weights for policy 1, policy_version 380277 (0.0008) [2023-12-26 02:38:22,629][123090] Updated weights for policy 1, policy_version 380287 (0.0010) [2023-12-26 02:38:22,659][123091] Updated weights for policy 0, policy_version 382579 (0.0007) [2023-12-26 02:38:22,722][123091] Updated weights for policy 0, policy_version 382589 (0.0009) [2023-12-26 02:38:22,790][123091] Updated weights for policy 0, policy_version 382599 (0.0009) [2023-12-26 02:38:23,366][123090] Updated weights for policy 1, policy_version 380297 (0.0006) [2023-12-26 02:38:23,414][123090] Updated weights for policy 1, policy_version 380307 (0.0005) [2023-12-26 02:38:23,470][123090] Updated weights for policy 1, policy_version 380317 (0.0006) [2023-12-26 02:38:23,649][123091] Updated weights for policy 0, policy_version 382609 (0.0009) [2023-12-26 02:38:23,708][123091] Updated weights for policy 0, policy_version 382619 (0.0008) [2023-12-26 02:38:23,774][123091] Updated weights for policy 0, policy_version 382629 (0.0009) [2023-12-26 02:38:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 195313664. Throughput: 0: 8826.9, 1: 8679.5. Samples: 195293116. Policy #0 lag: (min: 31.0, avg: 43.9, max: 63.0) [2023-12-26 02:38:23,785][121949] Avg episode reward: [(0, '6102.658'), (1, '5925.413')] [2023-12-26 02:38:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000380320_97361920.pth... [2023-12-26 02:38:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000379296_97099776.pth [2023-12-26 02:38:23,839][123091] Updated weights for policy 0, policy_version 382639 (0.0009) [2023-12-26 02:38:23,843][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000382640_97959936.pth... [2023-12-26 02:38:23,847][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000381584_97689600.pth [2023-12-26 02:38:24,166][123090] Updated weights for policy 1, policy_version 380327 (0.0007) [2023-12-26 02:38:24,217][123090] Updated weights for policy 1, policy_version 380337 (0.0006) [2023-12-26 02:38:24,271][123090] Updated weights for policy 1, policy_version 380347 (0.0005) [2023-12-26 02:38:24,690][123091] Updated weights for policy 0, policy_version 382649 (0.0010) [2023-12-26 02:38:24,739][123091] Updated weights for policy 0, policy_version 382659 (0.0009) [2023-12-26 02:38:24,787][123091] Updated weights for policy 0, policy_version 382669 (0.0009) [2023-12-26 02:38:25,016][123090] Updated weights for policy 1, policy_version 380357 (0.0007) [2023-12-26 02:38:25,084][123090] Updated weights for policy 1, policy_version 380367 (0.0008) [2023-12-26 02:38:25,149][123090] Updated weights for policy 1, policy_version 380377 (0.0009) [2023-12-26 02:38:25,637][123091] Updated weights for policy 0, policy_version 382680 (0.0010) [2023-12-26 02:38:25,708][123091] Updated weights for policy 0, policy_version 382690 (0.0009) [2023-12-26 02:38:25,765][123091] Updated weights for policy 0, policy_version 382700 (0.0010) [2023-12-26 02:38:25,976][123090] Updated weights for policy 1, policy_version 380387 (0.0010) [2023-12-26 02:38:26,040][123090] Updated weights for policy 1, policy_version 380397 (0.0010) [2023-12-26 02:38:26,096][123090] Updated weights for policy 1, policy_version 380407 (0.0009) [2023-12-26 02:38:26,471][123091] Updated weights for policy 0, policy_version 382710 (0.0008) [2023-12-26 02:38:26,520][123091] Updated weights for policy 0, policy_version 382720 (0.0009) [2023-12-26 02:38:26,580][123091] Updated weights for policy 0, policy_version 382730 (0.0009) [2023-12-26 02:38:26,932][123090] Updated weights for policy 1, policy_version 380417 (0.0009) [2023-12-26 02:38:26,992][123090] Updated weights for policy 1, policy_version 380427 (0.0005) [2023-12-26 02:38:27,060][123090] Updated weights for policy 1, policy_version 380437 (0.0008) [2023-12-26 02:38:27,122][123090] Updated weights for policy 1, policy_version 380447 (0.0009) [2023-12-26 02:38:27,436][123091] Updated weights for policy 0, policy_version 382740 (0.0010) [2023-12-26 02:38:27,490][123091] Updated weights for policy 0, policy_version 382750 (0.0008) [2023-12-26 02:38:27,545][123091] Updated weights for policy 0, policy_version 382760 (0.0009) [2023-12-26 02:38:27,928][123090] Updated weights for policy 1, policy_version 380457 (0.0009) [2023-12-26 02:38:27,981][123090] Updated weights for policy 1, policy_version 380467 (0.0010) [2023-12-26 02:38:28,031][123090] Updated weights for policy 1, policy_version 380478 (0.0010) [2023-12-26 02:38:28,253][123091] Updated weights for policy 0, policy_version 382770 (0.0008) [2023-12-26 02:38:28,324][123091] Updated weights for policy 0, policy_version 382780 (0.0006) [2023-12-26 02:38:28,396][123091] Updated weights for policy 0, policy_version 382790 (0.0007) [2023-12-26 02:38:28,467][123091] Updated weights for policy 0, policy_version 382800 (0.0005) [2023-12-26 02:38:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 195403776. Throughput: 0: 8778.6, 1: 8721.2. Samples: 195398588. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:28,785][121949] Avg episode reward: [(0, '5879.797'), (1, '5895.842')] [2023-12-26 02:38:28,946][123090] Updated weights for policy 1, policy_version 380488 (0.0010) [2023-12-26 02:38:29,006][123090] Updated weights for policy 1, policy_version 380498 (0.0010) [2023-12-26 02:38:29,059][123090] Updated weights for policy 1, policy_version 380508 (0.0009) [2023-12-26 02:38:29,226][123091] Updated weights for policy 0, policy_version 382810 (0.0009) [2023-12-26 02:38:29,292][123091] Updated weights for policy 0, policy_version 382820 (0.0009) [2023-12-26 02:38:29,359][123091] Updated weights for policy 0, policy_version 382830 (0.0009) [2023-12-26 02:38:29,908][123090] Updated weights for policy 1, policy_version 380518 (0.0010) [2023-12-26 02:38:29,979][123090] Updated weights for policy 1, policy_version 380528 (0.0009) [2023-12-26 02:38:30,051][123090] Updated weights for policy 1, policy_version 380538 (0.0008) [2023-12-26 02:38:30,136][123091] Updated weights for policy 0, policy_version 382840 (0.0010) [2023-12-26 02:38:30,193][123091] Updated weights for policy 0, policy_version 382850 (0.0009) [2023-12-26 02:38:30,248][123091] Updated weights for policy 0, policy_version 382860 (0.0009) [2023-12-26 02:38:30,885][123090] Updated weights for policy 1, policy_version 380548 (0.0009) [2023-12-26 02:38:30,953][123090] Updated weights for policy 1, policy_version 380558 (0.0009) [2023-12-26 02:38:31,031][123090] Updated weights for policy 1, policy_version 380568 (0.0009) [2023-12-26 02:38:31,068][123091] Updated weights for policy 0, policy_version 382870 (0.0009) [2023-12-26 02:38:31,132][123091] Updated weights for policy 0, policy_version 382880 (0.0010) [2023-12-26 02:38:31,201][123091] Updated weights for policy 0, policy_version 382890 (0.0009) [2023-12-26 02:38:31,853][123090] Updated weights for policy 1, policy_version 380578 (0.0008) [2023-12-26 02:38:31,913][123090] Updated weights for policy 1, policy_version 380588 (0.0009) [2023-12-26 02:38:31,968][123090] Updated weights for policy 1, policy_version 380598 (0.0009) [2023-12-26 02:38:32,024][123090] Updated weights for policy 1, policy_version 380608 (0.0009) [2023-12-26 02:38:32,057][123091] Updated weights for policy 0, policy_version 382900 (0.0010) [2023-12-26 02:38:32,107][123091] Updated weights for policy 0, policy_version 382910 (0.0009) [2023-12-26 02:38:32,166][123091] Updated weights for policy 0, policy_version 382920 (0.0009) [2023-12-26 02:38:32,799][123090] Updated weights for policy 1, policy_version 380618 (0.0010) [2023-12-26 02:38:32,861][123090] Updated weights for policy 1, policy_version 380628 (0.0010) [2023-12-26 02:38:32,920][123090] Updated weights for policy 1, policy_version 380638 (0.0010) [2023-12-26 02:38:32,926][123091] Updated weights for policy 0, policy_version 382930 (0.0008) [2023-12-26 02:38:32,990][123091] Updated weights for policy 0, policy_version 382940 (0.0005) [2023-12-26 02:38:33,056][123091] Updated weights for policy 0, policy_version 382950 (0.0005) [2023-12-26 02:38:33,125][123091] Updated weights for policy 0, policy_version 382960 (0.0007) [2023-12-26 02:38:33,765][123091] Updated weights for policy 0, policy_version 382970 (0.0005) [2023-12-26 02:38:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 195485696. Throughput: 0: 8818.7, 1: 8679.2. Samples: 195504080. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:33,785][121949] Avg episode reward: [(0, '5974.077'), (1, '5877.593')] [2023-12-26 02:38:33,814][123091] Updated weights for policy 0, policy_version 382980 (0.0007) [2023-12-26 02:38:33,822][123090] Updated weights for policy 1, policy_version 380648 (0.0008) [2023-12-26 02:38:33,871][123091] Updated weights for policy 0, policy_version 382990 (0.0006) [2023-12-26 02:38:33,881][123090] Updated weights for policy 1, policy_version 380658 (0.0008) [2023-12-26 02:38:33,940][123090] Updated weights for policy 1, policy_version 380668 (0.0008) [2023-12-26 02:38:34,619][123091] Updated weights for policy 0, policy_version 383000 (0.0009) [2023-12-26 02:38:34,684][123091] Updated weights for policy 0, policy_version 383010 (0.0009) [2023-12-26 02:38:34,737][123091] Updated weights for policy 0, policy_version 383020 (0.0009) [2023-12-26 02:38:34,809][123090] Updated weights for policy 1, policy_version 380678 (0.0010) [2023-12-26 02:38:34,876][123090] Updated weights for policy 1, policy_version 380688 (0.0011) [2023-12-26 02:38:34,935][123090] Updated weights for policy 1, policy_version 380698 (0.0011) [2023-12-26 02:38:35,599][123091] Updated weights for policy 0, policy_version 383030 (0.0009) [2023-12-26 02:38:35,646][123090] Updated weights for policy 1, policy_version 380708 (0.0008) [2023-12-26 02:38:35,654][123091] Updated weights for policy 0, policy_version 383040 (0.0009) [2023-12-26 02:38:35,700][123091] Updated weights for policy 0, policy_version 383050 (0.0008) [2023-12-26 02:38:35,706][123090] Updated weights for policy 1, policy_version 380718 (0.0009) [2023-12-26 02:38:35,753][123090] Updated weights for policy 1, policy_version 380728 (0.0010) [2023-12-26 02:38:36,511][123090] Updated weights for policy 1, policy_version 380738 (0.0011) [2023-12-26 02:38:36,524][123091] Updated weights for policy 0, policy_version 383060 (0.0008) [2023-12-26 02:38:36,575][123090] Updated weights for policy 1, policy_version 380748 (0.0011) [2023-12-26 02:38:36,591][123091] Updated weights for policy 0, policy_version 383070 (0.0006) [2023-12-26 02:38:36,638][123090] Updated weights for policy 1, policy_version 380758 (0.0010) [2023-12-26 02:38:36,658][123091] Updated weights for policy 0, policy_version 383080 (0.0008) [2023-12-26 02:38:36,705][123090] Updated weights for policy 1, policy_version 380768 (0.0010) [2023-12-26 02:38:37,400][123091] Updated weights for policy 0, policy_version 383090 (0.0009) [2023-12-26 02:38:37,470][123091] Updated weights for policy 0, policy_version 383100 (0.0006) [2023-12-26 02:38:37,485][123090] Updated weights for policy 1, policy_version 380778 (0.0006) [2023-12-26 02:38:37,528][123091] Updated weights for policy 0, policy_version 383110 (0.0006) [2023-12-26 02:38:37,555][123090] Updated weights for policy 1, policy_version 380788 (0.0011) [2023-12-26 02:38:37,576][123091] Updated weights for policy 0, policy_version 383120 (0.0008) [2023-12-26 02:38:37,625][123090] Updated weights for policy 1, policy_version 380798 (0.0011) [2023-12-26 02:38:38,327][123091] Updated weights for policy 0, policy_version 383130 (0.0008) [2023-12-26 02:38:38,390][123091] Updated weights for policy 0, policy_version 383140 (0.0008) [2023-12-26 02:38:38,415][123090] Updated weights for policy 1, policy_version 380808 (0.0011) [2023-12-26 02:38:38,460][123091] Updated weights for policy 0, policy_version 383150 (0.0008) [2023-12-26 02:38:38,488][123090] Updated weights for policy 1, policy_version 380818 (0.0005) [2023-12-26 02:38:38,559][123090] Updated weights for policy 1, policy_version 380828 (0.0005) [2023-12-26 02:38:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 195584000. Throughput: 0: 8835.8, 1: 8716.9. Samples: 195556748. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:38,785][121949] Avg episode reward: [(0, '6115.741'), (1, '5809.014')] [2023-12-26 02:38:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000383152_98091008.pth... [2023-12-26 02:38:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000380832_97492992.pth... [2023-12-26 02:38:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000382096_97820672.pth [2023-12-26 02:38:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000379840_97239040.pth [2023-12-26 02:38:39,263][123091] Updated weights for policy 0, policy_version 383160 (0.0009) [2023-12-26 02:38:39,276][123090] Updated weights for policy 1, policy_version 380838 (0.0008) [2023-12-26 02:38:39,330][123091] Updated weights for policy 0, policy_version 383170 (0.0007) [2023-12-26 02:38:39,346][123090] Updated weights for policy 1, policy_version 380848 (0.0010) [2023-12-26 02:38:39,395][123091] Updated weights for policy 0, policy_version 383180 (0.0009) [2023-12-26 02:38:39,415][123090] Updated weights for policy 1, policy_version 380858 (0.0009) [2023-12-26 02:38:40,240][123091] Updated weights for policy 0, policy_version 383190 (0.0008) [2023-12-26 02:38:40,278][123090] Updated weights for policy 1, policy_version 380868 (0.0008) [2023-12-26 02:38:40,305][123091] Updated weights for policy 0, policy_version 383200 (0.0009) [2023-12-26 02:38:40,337][123090] Updated weights for policy 1, policy_version 380878 (0.0008) [2023-12-26 02:38:40,364][123091] Updated weights for policy 0, policy_version 383210 (0.0008) [2023-12-26 02:38:40,398][123090] Updated weights for policy 1, policy_version 380888 (0.0008) [2023-12-26 02:38:41,206][123091] Updated weights for policy 0, policy_version 383220 (0.0009) [2023-12-26 02:38:41,250][123090] Updated weights for policy 1, policy_version 380899 (0.0009) [2023-12-26 02:38:41,268][123091] Updated weights for policy 0, policy_version 383230 (0.0009) [2023-12-26 02:38:41,315][123090] Updated weights for policy 1, policy_version 380909 (0.0007) [2023-12-26 02:38:41,337][123091] Updated weights for policy 0, policy_version 383240 (0.0009) [2023-12-26 02:38:41,382][123090] Updated weights for policy 1, policy_version 380919 (0.0008) [2023-12-26 02:38:42,167][123091] Updated weights for policy 0, policy_version 383250 (0.0009) [2023-12-26 02:38:42,207][123090] Updated weights for policy 1, policy_version 380929 (0.0009) [2023-12-26 02:38:42,222][123091] Updated weights for policy 0, policy_version 383260 (0.0010) [2023-12-26 02:38:42,266][123090] Updated weights for policy 1, policy_version 380939 (0.0007) [2023-12-26 02:38:42,285][123091] Updated weights for policy 0, policy_version 383270 (0.0011) [2023-12-26 02:38:42,326][123090] Updated weights for policy 1, policy_version 380949 (0.0008) [2023-12-26 02:38:42,352][123091] Updated weights for policy 0, policy_version 383280 (0.0010) [2023-12-26 02:38:42,399][123090] Updated weights for policy 1, policy_version 380959 (0.0009) [2023-12-26 02:38:43,095][123091] Updated weights for policy 0, policy_version 383290 (0.0010) [2023-12-26 02:38:43,160][123091] Updated weights for policy 0, policy_version 383300 (0.0009) [2023-12-26 02:38:43,226][123091] Updated weights for policy 0, policy_version 383310 (0.0008) [2023-12-26 02:38:43,284][123090] Updated weights for policy 1, policy_version 380969 (0.0008) [2023-12-26 02:38:43,332][123090] Updated weights for policy 1, policy_version 380979 (0.0009) [2023-12-26 02:38:43,381][123090] Updated weights for policy 1, policy_version 380989 (0.0010) [2023-12-26 02:38:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 195665920. Throughput: 0: 8856.7, 1: 8628.7. Samples: 195660572. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:43,785][121949] Avg episode reward: [(0, '6190.480'), (1, '5762.018')] [2023-12-26 02:38:44,044][123091] Updated weights for policy 0, policy_version 383320 (0.0010) [2023-12-26 02:38:44,096][123091] Updated weights for policy 0, policy_version 383330 (0.0009) [2023-12-26 02:38:44,153][123091] Updated weights for policy 0, policy_version 383340 (0.0010) [2023-12-26 02:38:44,203][123090] Updated weights for policy 1, policy_version 380999 (0.0008) [2023-12-26 02:38:44,260][123090] Updated weights for policy 1, policy_version 381009 (0.0009) [2023-12-26 02:38:44,319][123090] Updated weights for policy 1, policy_version 381019 (0.0008) [2023-12-26 02:38:44,972][123091] Updated weights for policy 0, policy_version 383350 (0.0009) [2023-12-26 02:38:45,054][123091] Updated weights for policy 0, policy_version 383360 (0.0009) [2023-12-26 02:38:45,125][123091] Updated weights for policy 0, policy_version 383370 (0.0009) [2023-12-26 02:38:45,173][123090] Updated weights for policy 1, policy_version 381029 (0.0009) [2023-12-26 02:38:45,238][123090] Updated weights for policy 1, policy_version 381039 (0.0008) [2023-12-26 02:38:45,309][123090] Updated weights for policy 1, policy_version 381049 (0.0008) [2023-12-26 02:38:45,989][123091] Updated weights for policy 0, policy_version 383380 (0.0010) [2023-12-26 02:38:46,047][123091] Updated weights for policy 0, policy_version 383390 (0.0009) [2023-12-26 02:38:46,104][123090] Updated weights for policy 1, policy_version 381059 (0.0008) [2023-12-26 02:38:46,111][123091] Updated weights for policy 0, policy_version 383400 (0.0008) [2023-12-26 02:38:46,165][123090] Updated weights for policy 1, policy_version 381069 (0.0007) [2023-12-26 02:38:46,230][123090] Updated weights for policy 1, policy_version 381079 (0.0009) [2023-12-26 02:38:46,893][123091] Updated weights for policy 0, policy_version 383410 (0.0008) [2023-12-26 02:38:46,957][123091] Updated weights for policy 0, policy_version 383420 (0.0005) [2023-12-26 02:38:47,011][123091] Updated weights for policy 0, policy_version 383430 (0.0005) [2023-12-26 02:38:47,056][123091] Updated weights for policy 0, policy_version 383440 (0.0005) [2023-12-26 02:38:47,079][123090] Updated weights for policy 1, policy_version 381089 (0.0009) [2023-12-26 02:38:47,134][123090] Updated weights for policy 1, policy_version 381099 (0.0009) [2023-12-26 02:38:47,186][123090] Updated weights for policy 1, policy_version 381109 (0.0009) [2023-12-26 02:38:47,247][123090] Updated weights for policy 1, policy_version 381119 (0.0009) [2023-12-26 02:38:47,792][123091] Updated weights for policy 0, policy_version 383450 (0.0009) [2023-12-26 02:38:47,845][123091] Updated weights for policy 0, policy_version 383460 (0.0009) [2023-12-26 02:38:47,894][123091] Updated weights for policy 0, policy_version 383470 (0.0010) [2023-12-26 02:38:48,116][123090] Updated weights for policy 1, policy_version 381129 (0.0010) [2023-12-26 02:38:48,168][123090] Updated weights for policy 1, policy_version 381139 (0.0009) [2023-12-26 02:38:48,217][123090] Updated weights for policy 1, policy_version 381149 (0.0008) [2023-12-26 02:38:48,779][123091] Updated weights for policy 0, policy_version 383480 (0.0010) [2023-12-26 02:38:48,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 195747840. Throughput: 0: 8873.5, 1: 8587.3. Samples: 195764388. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:48,785][121949] Avg episode reward: [(0, '6049.440'), (1, '5668.185')] [2023-12-26 02:38:48,832][123091] Updated weights for policy 0, policy_version 383490 (0.0009) [2023-12-26 02:38:48,887][123091] Updated weights for policy 0, policy_version 383500 (0.0010) [2023-12-26 02:38:49,002][123090] Updated weights for policy 1, policy_version 381159 (0.0009) [2023-12-26 02:38:49,054][123090] Updated weights for policy 1, policy_version 381169 (0.0009) [2023-12-26 02:38:49,115][123090] Updated weights for policy 1, policy_version 381179 (0.0009) [2023-12-26 02:38:49,726][123091] Updated weights for policy 0, policy_version 383510 (0.0007) [2023-12-26 02:38:49,789][123091] Updated weights for policy 0, policy_version 383520 (0.0009) [2023-12-26 02:38:49,860][123091] Updated weights for policy 0, policy_version 383530 (0.0009) [2023-12-26 02:38:49,965][123090] Updated weights for policy 1, policy_version 381189 (0.0009) [2023-12-26 02:38:50,036][123090] Updated weights for policy 1, policy_version 381199 (0.0009) [2023-12-26 02:38:50,104][123090] Updated weights for policy 1, policy_version 381209 (0.0006) [2023-12-26 02:38:50,716][123091] Updated weights for policy 0, policy_version 383540 (0.0008) [2023-12-26 02:38:50,786][123091] Updated weights for policy 0, policy_version 383550 (0.0009) [2023-12-26 02:38:50,848][123091] Updated weights for policy 0, policy_version 383560 (0.0009) [2023-12-26 02:38:50,858][123090] Updated weights for policy 1, policy_version 381219 (0.0009) [2023-12-26 02:38:50,923][123090] Updated weights for policy 1, policy_version 381229 (0.0008) [2023-12-26 02:38:50,990][123090] Updated weights for policy 1, policy_version 381239 (0.0010) [2023-12-26 02:38:51,736][123091] Updated weights for policy 0, policy_version 383570 (0.0008) [2023-12-26 02:38:51,808][123091] Updated weights for policy 0, policy_version 383580 (0.0010) [2023-12-26 02:38:51,810][123090] Updated weights for policy 1, policy_version 381249 (0.0009) [2023-12-26 02:38:51,868][123091] Updated weights for policy 0, policy_version 383590 (0.0007) [2023-12-26 02:38:51,869][123090] Updated weights for policy 1, policy_version 381259 (0.0008) [2023-12-26 02:38:51,928][123090] Updated weights for policy 1, policy_version 381269 (0.0008) [2023-12-26 02:38:51,928][123091] Updated weights for policy 0, policy_version 383600 (0.0008) [2023-12-26 02:38:51,976][123090] Updated weights for policy 1, policy_version 381279 (0.0008) [2023-12-26 02:38:52,778][123091] Updated weights for policy 0, policy_version 383610 (0.0010) [2023-12-26 02:38:52,789][123090] Updated weights for policy 1, policy_version 381289 (0.0008) [2023-12-26 02:38:52,840][123091] Updated weights for policy 0, policy_version 383620 (0.0008) [2023-12-26 02:38:52,846][123090] Updated weights for policy 1, policy_version 381299 (0.0009) [2023-12-26 02:38:52,901][123091] Updated weights for policy 0, policy_version 383630 (0.0008) [2023-12-26 02:38:52,917][123090] Updated weights for policy 1, policy_version 381309 (0.0007) [2023-12-26 02:38:53,558][123090] Updated weights for policy 1, policy_version 381319 (0.0006) [2023-12-26 02:38:53,607][123090] Updated weights for policy 1, policy_version 381329 (0.0005) [2023-12-26 02:38:53,660][123091] Updated weights for policy 0, policy_version 383640 (0.0007) [2023-12-26 02:38:53,660][123090] Updated weights for policy 1, policy_version 381339 (0.0006) [2023-12-26 02:38:53,715][123091] Updated weights for policy 0, policy_version 383650 (0.0005) [2023-12-26 02:38:53,765][123091] Updated weights for policy 0, policy_version 383660 (0.0008) [2023-12-26 02:38:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 195846144. Throughput: 0: 8824.6, 1: 8539.0. Samples: 195815312. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:53,785][121949] Avg episode reward: [(0, '6036.857'), (1, '5681.365')] [2023-12-26 02:38:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000381344_97624064.pth... [2023-12-26 02:38:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000383664_98222080.pth... [2023-12-26 02:38:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000380320_97361920.pth [2023-12-26 02:38:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000382640_97959936.pth [2023-12-26 02:38:54,405][123090] Updated weights for policy 1, policy_version 381349 (0.0008) [2023-12-26 02:38:54,457][123090] Updated weights for policy 1, policy_version 381359 (0.0010) [2023-12-26 02:38:54,505][123090] Updated weights for policy 1, policy_version 381369 (0.0010) [2023-12-26 02:38:54,567][123091] Updated weights for policy 0, policy_version 383670 (0.0009) [2023-12-26 02:38:54,620][123091] Updated weights for policy 0, policy_version 383680 (0.0009) [2023-12-26 02:38:54,683][123091] Updated weights for policy 0, policy_version 383690 (0.0008) [2023-12-26 02:38:55,364][123090] Updated weights for policy 1, policy_version 381379 (0.0010) [2023-12-26 02:38:55,420][123090] Updated weights for policy 1, policy_version 381389 (0.0010) [2023-12-26 02:38:55,472][123090] Updated weights for policy 1, policy_version 381399 (0.0010) [2023-12-26 02:38:55,526][123091] Updated weights for policy 0, policy_version 383700 (0.0008) [2023-12-26 02:38:55,577][123091] Updated weights for policy 0, policy_version 383710 (0.0009) [2023-12-26 02:38:55,636][123091] Updated weights for policy 0, policy_version 383720 (0.0009) [2023-12-26 02:38:56,300][123090] Updated weights for policy 1, policy_version 381409 (0.0010) [2023-12-26 02:38:56,356][123090] Updated weights for policy 1, policy_version 381419 (0.0009) [2023-12-26 02:38:56,419][123090] Updated weights for policy 1, policy_version 381429 (0.0011) [2023-12-26 02:38:56,458][123091] Updated weights for policy 0, policy_version 383730 (0.0009) [2023-12-26 02:38:56,484][123090] Updated weights for policy 1, policy_version 381439 (0.0011) [2023-12-26 02:38:56,512][123091] Updated weights for policy 0, policy_version 383740 (0.0006) [2023-12-26 02:38:56,557][123091] Updated weights for policy 0, policy_version 383750 (0.0005) [2023-12-26 02:38:56,615][123091] Updated weights for policy 0, policy_version 383760 (0.0008) [2023-12-26 02:38:57,238][123090] Updated weights for policy 1, policy_version 381449 (0.0006) [2023-12-26 02:38:57,290][123090] Updated weights for policy 1, policy_version 381459 (0.0005) [2023-12-26 02:38:57,352][123090] Updated weights for policy 1, policy_version 381469 (0.0006) [2023-12-26 02:38:57,374][123091] Updated weights for policy 0, policy_version 383770 (0.0006) [2023-12-26 02:38:57,429][123091] Updated weights for policy 0, policy_version 383780 (0.0005) [2023-12-26 02:38:57,484][123091] Updated weights for policy 0, policy_version 383790 (0.0005) [2023-12-26 02:38:58,082][123090] Updated weights for policy 1, policy_version 381479 (0.0009) [2023-12-26 02:38:58,142][123090] Updated weights for policy 1, policy_version 381489 (0.0010) [2023-12-26 02:38:58,164][123091] Updated weights for policy 0, policy_version 383800 (0.0007) [2023-12-26 02:38:58,204][123090] Updated weights for policy 1, policy_version 381499 (0.0009) [2023-12-26 02:38:58,218][123091] Updated weights for policy 0, policy_version 383810 (0.0010) [2023-12-26 02:38:58,272][123091] Updated weights for policy 0, policy_version 383820 (0.0010) [2023-12-26 02:38:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 195928064. Throughput: 0: 8789.0, 1: 8632.3. Samples: 195922900. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:38:58,785][121949] Avg episode reward: [(0, '6218.529'), (1, '5753.705')] [2023-12-26 02:38:59,050][123090] Updated weights for policy 1, policy_version 381509 (0.0008) [2023-12-26 02:38:59,116][123090] Updated weights for policy 1, policy_version 381519 (0.0010) [2023-12-26 02:38:59,156][123091] Updated weights for policy 0, policy_version 383830 (0.0010) [2023-12-26 02:38:59,181][123090] Updated weights for policy 1, policy_version 381529 (0.0010) [2023-12-26 02:38:59,214][123091] Updated weights for policy 0, policy_version 383840 (0.0008) [2023-12-26 02:38:59,275][123091] Updated weights for policy 0, policy_version 383850 (0.0008) [2023-12-26 02:39:00,005][123090] Updated weights for policy 1, policy_version 381539 (0.0010) [2023-12-26 02:39:00,071][123090] Updated weights for policy 1, policy_version 381549 (0.0011) [2023-12-26 02:39:00,145][123090] Updated weights for policy 1, policy_version 381559 (0.0011) [2023-12-26 02:39:00,149][123091] Updated weights for policy 0, policy_version 383860 (0.0008) [2023-12-26 02:39:00,213][123091] Updated weights for policy 0, policy_version 383870 (0.0006) [2023-12-26 02:39:00,276][123091] Updated weights for policy 0, policy_version 383880 (0.0005) [2023-12-26 02:39:00,916][123091] Updated weights for policy 0, policy_version 383890 (0.0006) [2023-12-26 02:39:00,955][123090] Updated weights for policy 1, policy_version 381569 (0.0011) [2023-12-26 02:39:00,974][123091] Updated weights for policy 0, policy_version 383900 (0.0010) [2023-12-26 02:39:01,002][123090] Updated weights for policy 1, policy_version 381579 (0.0010) [2023-12-26 02:39:01,026][123091] Updated weights for policy 0, policy_version 383910 (0.0006) [2023-12-26 02:39:01,064][123090] Updated weights for policy 1, policy_version 381589 (0.0010) [2023-12-26 02:39:01,092][123091] Updated weights for policy 0, policy_version 383920 (0.0007) [2023-12-26 02:39:01,133][123090] Updated weights for policy 1, policy_version 381599 (0.0010) [2023-12-26 02:39:01,944][123090] Updated weights for policy 1, policy_version 381609 (0.0011) [2023-12-26 02:39:01,947][123091] Updated weights for policy 0, policy_version 383930 (0.0007) [2023-12-26 02:39:02,003][123090] Updated weights for policy 1, policy_version 381619 (0.0010) [2023-12-26 02:39:02,006][123091] Updated weights for policy 0, policy_version 383940 (0.0008) [2023-12-26 02:39:02,066][123090] Updated weights for policy 1, policy_version 381629 (0.0010) [2023-12-26 02:39:02,069][123091] Updated weights for policy 0, policy_version 383950 (0.0007) [2023-12-26 02:39:02,881][123090] Updated weights for policy 1, policy_version 381639 (0.0010) [2023-12-26 02:39:02,904][123091] Updated weights for policy 0, policy_version 383960 (0.0007) [2023-12-26 02:39:02,932][123090] Updated weights for policy 1, policy_version 381649 (0.0010) [2023-12-26 02:39:02,964][123091] Updated weights for policy 0, policy_version 383970 (0.0006) [2023-12-26 02:39:02,987][123090] Updated weights for policy 1, policy_version 381659 (0.0010) [2023-12-26 02:39:03,019][123091] Updated weights for policy 0, policy_version 383980 (0.0006) [2023-12-26 02:39:03,775][123091] Updated weights for policy 0, policy_version 383990 (0.0009) [2023-12-26 02:39:03,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 196009984. Throughput: 0: 8750.1, 1: 8689.3. Samples: 196027676. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:03,785][121949] Avg episode reward: [(0, '6277.132'), (1, '5828.723')] [2023-12-26 02:39:03,812][123090] Updated weights for policy 1, policy_version 381669 (0.0010) [2023-12-26 02:39:03,832][123091] Updated weights for policy 0, policy_version 384000 (0.0006) [2023-12-26 02:39:03,864][123090] Updated weights for policy 1, policy_version 381679 (0.0010) [2023-12-26 02:39:03,892][123091] Updated weights for policy 0, policy_version 384010 (0.0007) [2023-12-26 02:39:03,927][123090] Updated weights for policy 1, policy_version 381689 (0.0010) [2023-12-26 02:39:04,652][123090] Updated weights for policy 1, policy_version 381699 (0.0009) [2023-12-26 02:39:04,723][123090] Updated weights for policy 1, policy_version 381709 (0.0005) [2023-12-26 02:39:04,793][123090] Updated weights for policy 1, policy_version 381719 (0.0009) [2023-12-26 02:39:04,815][123091] Updated weights for policy 0, policy_version 384020 (0.0006) [2023-12-26 02:39:04,867][123091] Updated weights for policy 0, policy_version 384030 (0.0006) [2023-12-26 02:39:04,919][123091] Updated weights for policy 0, policy_version 384040 (0.0005) [2023-12-26 02:39:05,502][123091] Updated weights for policy 0, policy_version 384050 (0.0005) [2023-12-26 02:39:05,533][123090] Updated weights for policy 1, policy_version 381729 (0.0010) [2023-12-26 02:39:05,556][123091] Updated weights for policy 0, policy_version 384060 (0.0005) [2023-12-26 02:39:05,581][123090] Updated weights for policy 1, policy_version 381739 (0.0005) [2023-12-26 02:39:05,612][123091] Updated weights for policy 0, policy_version 384070 (0.0006) [2023-12-26 02:39:05,632][123090] Updated weights for policy 1, policy_version 381749 (0.0005) [2023-12-26 02:39:05,666][123091] Updated weights for policy 0, policy_version 384080 (0.0009) [2023-12-26 02:39:05,693][123090] Updated weights for policy 1, policy_version 381759 (0.0005) [2023-12-26 02:39:06,338][123090] Updated weights for policy 1, policy_version 381769 (0.0008) [2023-12-26 02:39:06,408][123090] Updated weights for policy 1, policy_version 381779 (0.0008) [2023-12-26 02:39:06,464][123090] Updated weights for policy 1, policy_version 381789 (0.0008) [2023-12-26 02:39:06,466][123091] Updated weights for policy 0, policy_version 384090 (0.0006) [2023-12-26 02:39:06,527][123091] Updated weights for policy 0, policy_version 384100 (0.0005) [2023-12-26 02:39:06,589][123091] Updated weights for policy 0, policy_version 384110 (0.0006) [2023-12-26 02:39:07,263][123090] Updated weights for policy 1, policy_version 381799 (0.0010) [2023-12-26 02:39:07,323][123090] Updated weights for policy 1, policy_version 381809 (0.0011) [2023-12-26 02:39:07,378][123091] Updated weights for policy 0, policy_version 384120 (0.0007) [2023-12-26 02:39:07,379][123090] Updated weights for policy 1, policy_version 381819 (0.0011) [2023-12-26 02:39:07,444][123091] Updated weights for policy 0, policy_version 384130 (0.0008) [2023-12-26 02:39:07,504][123091] Updated weights for policy 0, policy_version 384140 (0.0009) [2023-12-26 02:39:08,053][123090] Updated weights for policy 1, policy_version 381829 (0.0010) [2023-12-26 02:39:08,111][123090] Updated weights for policy 1, policy_version 381839 (0.0008) [2023-12-26 02:39:08,170][123090] Updated weights for policy 1, policy_version 381849 (0.0009) [2023-12-26 02:39:08,354][123091] Updated weights for policy 0, policy_version 384150 (0.0010) [2023-12-26 02:39:08,414][123091] Updated weights for policy 0, policy_version 384160 (0.0010) [2023-12-26 02:39:08,469][123091] Updated weights for policy 0, policy_version 384170 (0.0009) [2023-12-26 02:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 196108288. Throughput: 0: 8783.8, 1: 8786.9. Samples: 196083800. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:08,785][121949] Avg episode reward: [(0, '6240.689'), (1, '5890.893')] [2023-12-26 02:39:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000384176_98353152.pth... [2023-12-26 02:39:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000381856_97755136.pth... [2023-12-26 02:39:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000383152_98091008.pth [2023-12-26 02:39:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000380832_97492992.pth [2023-12-26 02:39:08,962][123090] Updated weights for policy 1, policy_version 381859 (0.0009) [2023-12-26 02:39:09,017][123090] Updated weights for policy 1, policy_version 381869 (0.0009) [2023-12-26 02:39:09,076][123090] Updated weights for policy 1, policy_version 381879 (0.0009) [2023-12-26 02:39:09,296][123091] Updated weights for policy 0, policy_version 384180 (0.0010) [2023-12-26 02:39:09,365][123091] Updated weights for policy 0, policy_version 384190 (0.0010) [2023-12-26 02:39:09,431][123091] Updated weights for policy 0, policy_version 384200 (0.0010) [2023-12-26 02:39:09,931][123090] Updated weights for policy 1, policy_version 381889 (0.0009) [2023-12-26 02:39:09,990][123090] Updated weights for policy 1, policy_version 381899 (0.0010) [2023-12-26 02:39:10,046][123090] Updated weights for policy 1, policy_version 381909 (0.0010) [2023-12-26 02:39:10,101][123090] Updated weights for policy 1, policy_version 381919 (0.0009) [2023-12-26 02:39:10,269][123091] Updated weights for policy 0, policy_version 384210 (0.0010) [2023-12-26 02:39:10,333][123091] Updated weights for policy 0, policy_version 384220 (0.0008) [2023-12-26 02:39:10,385][123091] Updated weights for policy 0, policy_version 384230 (0.0010) [2023-12-26 02:39:10,435][123091] Updated weights for policy 0, policy_version 384240 (0.0009) [2023-12-26 02:39:10,942][123090] Updated weights for policy 1, policy_version 381929 (0.0006) [2023-12-26 02:39:11,000][123090] Updated weights for policy 1, policy_version 381939 (0.0005) [2023-12-26 02:39:11,067][123090] Updated weights for policy 1, policy_version 381949 (0.0009) [2023-12-26 02:39:11,237][123091] Updated weights for policy 0, policy_version 384250 (0.0010) [2023-12-26 02:39:11,297][123091] Updated weights for policy 0, policy_version 384260 (0.0010) [2023-12-26 02:39:11,350][123091] Updated weights for policy 0, policy_version 384270 (0.0010) [2023-12-26 02:39:11,883][123090] Updated weights for policy 1, policy_version 381959 (0.0009) [2023-12-26 02:39:11,947][123090] Updated weights for policy 1, policy_version 381969 (0.0007) [2023-12-26 02:39:12,008][123090] Updated weights for policy 1, policy_version 381979 (0.0006) [2023-12-26 02:39:12,251][123091] Updated weights for policy 0, policy_version 384280 (0.0011) [2023-12-26 02:39:12,314][123091] Updated weights for policy 0, policy_version 384290 (0.0011) [2023-12-26 02:39:12,383][123091] Updated weights for policy 0, policy_version 384300 (0.0011) [2023-12-26 02:39:12,704][123090] Updated weights for policy 1, policy_version 381989 (0.0008) [2023-12-26 02:39:12,772][123090] Updated weights for policy 1, policy_version 381999 (0.0011) [2023-12-26 02:39:12,839][123090] Updated weights for policy 1, policy_version 382009 (0.0011) [2023-12-26 02:39:13,111][123091] Updated weights for policy 0, policy_version 384310 (0.0008) [2023-12-26 02:39:13,168][123091] Updated weights for policy 0, policy_version 384320 (0.0008) [2023-12-26 02:39:13,226][123091] Updated weights for policy 0, policy_version 384330 (0.0010) [2023-12-26 02:39:13,637][123090] Updated weights for policy 1, policy_version 382019 (0.0010) [2023-12-26 02:39:13,697][123090] Updated weights for policy 1, policy_version 382029 (0.0009) [2023-12-26 02:39:13,753][123090] Updated weights for policy 1, policy_version 382039 (0.0008) [2023-12-26 02:39:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 196190208. Throughput: 0: 8774.6, 1: 8767.1. Samples: 196187964. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:13,785][121949] Avg episode reward: [(0, '6307.857'), (1, '5907.768')] [2023-12-26 02:39:13,975][123091] Updated weights for policy 0, policy_version 384340 (0.0011) [2023-12-26 02:39:14,030][123091] Updated weights for policy 0, policy_version 384350 (0.0007) [2023-12-26 02:39:14,104][123091] Updated weights for policy 0, policy_version 384360 (0.0007) [2023-12-26 02:39:14,583][123090] Updated weights for policy 1, policy_version 382049 (0.0006) [2023-12-26 02:39:14,640][123090] Updated weights for policy 1, policy_version 382059 (0.0010) [2023-12-26 02:39:14,689][123090] Updated weights for policy 1, policy_version 382069 (0.0007) [2023-12-26 02:39:14,747][123090] Updated weights for policy 1, policy_version 382079 (0.0006) [2023-12-26 02:39:14,766][123091] Updated weights for policy 0, policy_version 384370 (0.0006) [2023-12-26 02:39:14,839][123091] Updated weights for policy 0, policy_version 384380 (0.0007) [2023-12-26 02:39:14,912][123091] Updated weights for policy 0, policy_version 384390 (0.0005) [2023-12-26 02:39:14,983][123091] Updated weights for policy 0, policy_version 384400 (0.0009) [2023-12-26 02:39:15,545][123090] Updated weights for policy 1, policy_version 382089 (0.0009) [2023-12-26 02:39:15,607][123090] Updated weights for policy 1, policy_version 382099 (0.0009) [2023-12-26 02:39:15,671][123090] Updated weights for policy 1, policy_version 382109 (0.0009) [2023-12-26 02:39:15,725][123091] Updated weights for policy 0, policy_version 384410 (0.0010) [2023-12-26 02:39:15,793][123091] Updated weights for policy 0, policy_version 384420 (0.0011) [2023-12-26 02:39:15,864][123091] Updated weights for policy 0, policy_version 384430 (0.0011) [2023-12-26 02:39:16,502][123090] Updated weights for policy 1, policy_version 382119 (0.0007) [2023-12-26 02:39:16,558][123090] Updated weights for policy 1, policy_version 382129 (0.0008) [2023-12-26 02:39:16,621][123090] Updated weights for policy 1, policy_version 382139 (0.0009) [2023-12-26 02:39:16,685][123091] Updated weights for policy 0, policy_version 384440 (0.0009) [2023-12-26 02:39:16,752][123091] Updated weights for policy 0, policy_version 384450 (0.0011) [2023-12-26 02:39:16,823][123091] Updated weights for policy 0, policy_version 384460 (0.0011) [2023-12-26 02:39:17,471][123090] Updated weights for policy 1, policy_version 382149 (0.0007) [2023-12-26 02:39:17,508][123091] Updated weights for policy 0, policy_version 384470 (0.0010) [2023-12-26 02:39:17,537][123090] Updated weights for policy 1, policy_version 382159 (0.0005) [2023-12-26 02:39:17,560][123091] Updated weights for policy 0, policy_version 384480 (0.0010) [2023-12-26 02:39:17,597][123090] Updated weights for policy 1, policy_version 382169 (0.0008) [2023-12-26 02:39:17,611][123091] Updated weights for policy 0, policy_version 384490 (0.0010) [2023-12-26 02:39:18,319][123090] Updated weights for policy 1, policy_version 382179 (0.0006) [2023-12-26 02:39:18,385][123090] Updated weights for policy 1, policy_version 382189 (0.0007) [2023-12-26 02:39:18,451][123091] Updated weights for policy 0, policy_version 384500 (0.0010) [2023-12-26 02:39:18,454][123090] Updated weights for policy 1, policy_version 382199 (0.0006) [2023-12-26 02:39:18,514][123091] Updated weights for policy 0, policy_version 384510 (0.0010) [2023-12-26 02:39:18,577][123091] Updated weights for policy 0, policy_version 384520 (0.0010) [2023-12-26 02:39:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 196288512. Throughput: 0: 8778.4, 1: 8821.0. Samples: 196296052. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:18,785][121949] Avg episode reward: [(0, '6445.755'), (1, '5958.333')] [2023-12-26 02:39:19,160][123090] Updated weights for policy 1, policy_version 382209 (0.0007) [2023-12-26 02:39:19,214][123090] Updated weights for policy 1, policy_version 382219 (0.0006) [2023-12-26 02:39:19,277][123090] Updated weights for policy 1, policy_version 382229 (0.0009) [2023-12-26 02:39:19,338][123090] Updated weights for policy 1, policy_version 382239 (0.0009) [2023-12-26 02:39:19,424][123091] Updated weights for policy 0, policy_version 384530 (0.0009) [2023-12-26 02:39:19,487][123091] Updated weights for policy 0, policy_version 384540 (0.0006) [2023-12-26 02:39:19,547][123091] Updated weights for policy 0, policy_version 384550 (0.0010) [2023-12-26 02:39:19,604][123091] Updated weights for policy 0, policy_version 384560 (0.0011) [2023-12-26 02:39:20,140][123090] Updated weights for policy 1, policy_version 382249 (0.0007) [2023-12-26 02:39:20,208][123090] Updated weights for policy 1, policy_version 382259 (0.0006) [2023-12-26 02:39:20,277][123090] Updated weights for policy 1, policy_version 382269 (0.0009) [2023-12-26 02:39:20,430][123091] Updated weights for policy 0, policy_version 384570 (0.0011) [2023-12-26 02:39:20,493][123091] Updated weights for policy 0, policy_version 384580 (0.0011) [2023-12-26 02:39:20,562][123091] Updated weights for policy 0, policy_version 384590 (0.0010) [2023-12-26 02:39:21,080][123090] Updated weights for policy 1, policy_version 382279 (0.0009) [2023-12-26 02:39:21,152][123090] Updated weights for policy 1, policy_version 382289 (0.0009) [2023-12-26 02:39:21,213][123090] Updated weights for policy 1, policy_version 382299 (0.0009) [2023-12-26 02:39:21,424][123091] Updated weights for policy 0, policy_version 384600 (0.0011) [2023-12-26 02:39:21,480][123091] Updated weights for policy 0, policy_version 384610 (0.0010) [2023-12-26 02:39:21,541][123091] Updated weights for policy 0, policy_version 384620 (0.0011) [2023-12-26 02:39:22,013][123090] Updated weights for policy 1, policy_version 382309 (0.0008) [2023-12-26 02:39:22,080][123090] Updated weights for policy 1, policy_version 382319 (0.0008) [2023-12-26 02:39:22,150][123090] Updated weights for policy 1, policy_version 382329 (0.0008) [2023-12-26 02:39:22,414][123091] Updated weights for policy 0, policy_version 384630 (0.0008) [2023-12-26 02:39:22,485][123091] Updated weights for policy 0, policy_version 384640 (0.0009) [2023-12-26 02:39:22,550][123091] Updated weights for policy 0, policy_version 384650 (0.0011) [2023-12-26 02:39:23,060][123090] Updated weights for policy 1, policy_version 382339 (0.0008) [2023-12-26 02:39:23,111][123090] Updated weights for policy 1, policy_version 382349 (0.0009) [2023-12-26 02:39:23,166][123090] Updated weights for policy 1, policy_version 382359 (0.0009) [2023-12-26 02:39:23,331][123091] Updated weights for policy 0, policy_version 384660 (0.0009) [2023-12-26 02:39:23,395][123091] Updated weights for policy 0, policy_version 384670 (0.0009) [2023-12-26 02:39:23,460][123091] Updated weights for policy 0, policy_version 384680 (0.0010) [2023-12-26 02:39:23,785][121949] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 196370432. Throughput: 0: 8751.4, 1: 8834.4. Samples: 196348112. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:23,786][121949] Avg episode reward: [(0, '6458.694'), (1, '5966.516')] [2023-12-26 02:39:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000384688_98484224.pth... [2023-12-26 02:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000382368_97886208.pth... [2023-12-26 02:39:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000381344_97624064.pth [2023-12-26 02:39:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000383664_98222080.pth [2023-12-26 02:39:23,968][123090] Updated weights for policy 1, policy_version 382369 (0.0009) [2023-12-26 02:39:24,024][123090] Updated weights for policy 1, policy_version 382379 (0.0005) [2023-12-26 02:39:24,079][123090] Updated weights for policy 1, policy_version 382389 (0.0005) [2023-12-26 02:39:24,134][123090] Updated weights for policy 1, policy_version 382399 (0.0005) [2023-12-26 02:39:24,350][123091] Updated weights for policy 0, policy_version 384690 (0.0009) [2023-12-26 02:39:24,411][123091] Updated weights for policy 0, policy_version 384700 (0.0009) [2023-12-26 02:39:24,459][123091] Updated weights for policy 0, policy_version 384710 (0.0008) [2023-12-26 02:39:24,508][123091] Updated weights for policy 0, policy_version 384720 (0.0009) [2023-12-26 02:39:24,893][123090] Updated weights for policy 1, policy_version 382409 (0.0009) [2023-12-26 02:39:24,958][123090] Updated weights for policy 1, policy_version 382419 (0.0010) [2023-12-26 02:39:25,019][123090] Updated weights for policy 1, policy_version 382429 (0.0007) [2023-12-26 02:39:25,315][123091] Updated weights for policy 0, policy_version 384730 (0.0006) [2023-12-26 02:39:25,369][123091] Updated weights for policy 0, policy_version 384741 (0.0011) [2023-12-26 02:39:25,421][123091] Updated weights for policy 0, policy_version 384752 (0.0009) [2023-12-26 02:39:25,735][123090] Updated weights for policy 1, policy_version 382439 (0.0008) [2023-12-26 02:39:25,792][123090] Updated weights for policy 1, policy_version 382449 (0.0009) [2023-12-26 02:39:25,851][123090] Updated weights for policy 1, policy_version 382459 (0.0008) [2023-12-26 02:39:26,189][123091] Updated weights for policy 0, policy_version 384762 (0.0010) [2023-12-26 02:39:26,250][123091] Updated weights for policy 0, policy_version 384772 (0.0010) [2023-12-26 02:39:26,307][123091] Updated weights for policy 0, policy_version 384783 (0.0008) [2023-12-26 02:39:26,614][123090] Updated weights for policy 1, policy_version 382469 (0.0007) [2023-12-26 02:39:26,671][123090] Updated weights for policy 1, policy_version 382479 (0.0005) [2023-12-26 02:39:26,733][123090] Updated weights for policy 1, policy_version 382489 (0.0005) [2023-12-26 02:39:27,159][123091] Updated weights for policy 0, policy_version 384793 (0.0006) [2023-12-26 02:39:27,208][123091] Updated weights for policy 0, policy_version 384803 (0.0005) [2023-12-26 02:39:27,254][123091] Updated weights for policy 0, policy_version 384813 (0.0005) [2023-12-26 02:39:27,295][123090] Updated weights for policy 1, policy_version 382499 (0.0005) [2023-12-26 02:39:27,361][123090] Updated weights for policy 1, policy_version 382509 (0.0008) [2023-12-26 02:39:27,416][123090] Updated weights for policy 1, policy_version 382519 (0.0008) [2023-12-26 02:39:28,064][123091] Updated weights for policy 0, policy_version 384823 (0.0008) [2023-12-26 02:39:28,118][123091] Updated weights for policy 0, policy_version 384833 (0.0009) [2023-12-26 02:39:28,166][123091] Updated weights for policy 0, policy_version 384844 (0.0009) [2023-12-26 02:39:28,212][123090] Updated weights for policy 1, policy_version 382529 (0.0009) [2023-12-26 02:39:28,276][123090] Updated weights for policy 1, policy_version 382539 (0.0009) [2023-12-26 02:39:28,334][123090] Updated weights for policy 1, policy_version 382549 (0.0009) [2023-12-26 02:39:28,405][123090] Updated weights for policy 1, policy_version 382559 (0.0006) [2023-12-26 02:39:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 196460544. Throughput: 0: 8751.2, 1: 8893.6. Samples: 196454588. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:28,784][121949] Avg episode reward: [(0, '6454.341'), (1, '6000.975')] [2023-12-26 02:39:29,072][123091] Updated weights for policy 0, policy_version 384854 (0.0010) [2023-12-26 02:39:29,124][123091] Updated weights for policy 0, policy_version 384865 (0.0009) [2023-12-26 02:39:29,149][123090] Updated weights for policy 1, policy_version 382569 (0.0005) [2023-12-26 02:39:29,180][123091] Updated weights for policy 0, policy_version 384876 (0.0010) [2023-12-26 02:39:29,218][123090] Updated weights for policy 1, policy_version 382579 (0.0006) [2023-12-26 02:39:29,286][123090] Updated weights for policy 1, policy_version 382589 (0.0007) [2023-12-26 02:39:30,008][123090] Updated weights for policy 1, policy_version 382599 (0.0006) [2023-12-26 02:39:30,021][123091] Updated weights for policy 0, policy_version 384886 (0.0008) [2023-12-26 02:39:30,071][123090] Updated weights for policy 1, policy_version 382609 (0.0005) [2023-12-26 02:39:30,089][123091] Updated weights for policy 0, policy_version 384896 (0.0009) [2023-12-26 02:39:30,136][123090] Updated weights for policy 1, policy_version 382619 (0.0005) [2023-12-26 02:39:30,149][123091] Updated weights for policy 0, policy_version 384906 (0.0008) [2023-12-26 02:39:30,732][123090] Updated weights for policy 1, policy_version 382629 (0.0007) [2023-12-26 02:39:30,797][123090] Updated weights for policy 1, policy_version 382639 (0.0008) [2023-12-26 02:39:30,860][123090] Updated weights for policy 1, policy_version 382649 (0.0008) [2023-12-26 02:39:31,027][123091] Updated weights for policy 0, policy_version 384916 (0.0008) [2023-12-26 02:39:31,088][123091] Updated weights for policy 0, policy_version 384926 (0.0009) [2023-12-26 02:39:31,155][123091] Updated weights for policy 0, policy_version 384936 (0.0009) [2023-12-26 02:39:31,586][123090] Updated weights for policy 1, policy_version 382659 (0.0008) [2023-12-26 02:39:31,654][123090] Updated weights for policy 1, policy_version 382669 (0.0008) [2023-12-26 02:39:31,719][123090] Updated weights for policy 1, policy_version 382679 (0.0008) [2023-12-26 02:39:32,090][123091] Updated weights for policy 0, policy_version 384946 (0.0009) [2023-12-26 02:39:32,149][123091] Updated weights for policy 0, policy_version 384956 (0.0010) [2023-12-26 02:39:32,206][123091] Updated weights for policy 0, policy_version 384966 (0.0010) [2023-12-26 02:39:32,261][123091] Updated weights for policy 0, policy_version 384976 (0.0009) [2023-12-26 02:39:32,456][123090] Updated weights for policy 1, policy_version 382689 (0.0008) [2023-12-26 02:39:32,517][123090] Updated weights for policy 1, policy_version 382699 (0.0007) [2023-12-26 02:39:32,583][123090] Updated weights for policy 1, policy_version 382709 (0.0009) [2023-12-26 02:39:32,650][123090] Updated weights for policy 1, policy_version 382719 (0.0009) [2023-12-26 02:39:33,155][123091] Updated weights for policy 0, policy_version 384986 (0.0010) [2023-12-26 02:39:33,218][123091] Updated weights for policy 0, policy_version 384996 (0.0010) [2023-12-26 02:39:33,272][123091] Updated weights for policy 0, policy_version 385006 (0.0010) [2023-12-26 02:39:33,381][123090] Updated weights for policy 1, policy_version 382729 (0.0006) [2023-12-26 02:39:33,439][123090] Updated weights for policy 1, policy_version 382739 (0.0005) [2023-12-26 02:39:33,485][123090] Updated weights for policy 1, policy_version 382749 (0.0005) [2023-12-26 02:39:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 196550656. Throughput: 0: 8671.5, 1: 9030.6. Samples: 196560984. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:33,785][121949] Avg episode reward: [(0, '6277.888'), (1, '5975.095')] [2023-12-26 02:39:34,170][123090] Updated weights for policy 1, policy_version 382759 (0.0007) [2023-12-26 02:39:34,200][123091] Updated weights for policy 0, policy_version 385016 (0.0009) [2023-12-26 02:39:34,227][123090] Updated weights for policy 1, policy_version 382769 (0.0008) [2023-12-26 02:39:34,265][123091] Updated weights for policy 0, policy_version 385026 (0.0008) [2023-12-26 02:39:34,282][123090] Updated weights for policy 1, policy_version 382779 (0.0007) [2023-12-26 02:39:34,316][123091] Updated weights for policy 0, policy_version 385036 (0.0007) [2023-12-26 02:39:35,106][123090] Updated weights for policy 1, policy_version 382789 (0.0009) [2023-12-26 02:39:35,169][123090] Updated weights for policy 1, policy_version 382799 (0.0010) [2023-12-26 02:39:35,172][123091] Updated weights for policy 0, policy_version 385046 (0.0007) [2023-12-26 02:39:35,235][123090] Updated weights for policy 1, policy_version 382809 (0.0007) [2023-12-26 02:39:35,236][123091] Updated weights for policy 0, policy_version 385056 (0.0009) [2023-12-26 02:39:35,291][123091] Updated weights for policy 0, policy_version 385066 (0.0010) [2023-12-26 02:39:35,966][123090] Updated weights for policy 1, policy_version 382819 (0.0007) [2023-12-26 02:39:36,028][123090] Updated weights for policy 1, policy_version 382829 (0.0010) [2023-12-26 02:39:36,078][123090] Updated weights for policy 1, policy_version 382839 (0.0010) [2023-12-26 02:39:36,164][123091] Updated weights for policy 0, policy_version 385076 (0.0009) [2023-12-26 02:39:36,228][123091] Updated weights for policy 0, policy_version 385086 (0.0006) [2023-12-26 02:39:36,286][123091] Updated weights for policy 0, policy_version 385096 (0.0006) [2023-12-26 02:39:36,868][123090] Updated weights for policy 1, policy_version 382849 (0.0009) [2023-12-26 02:39:36,942][123090] Updated weights for policy 1, policy_version 382859 (0.0008) [2023-12-26 02:39:37,015][123090] Updated weights for policy 1, policy_version 382869 (0.0007) [2023-12-26 02:39:37,072][123091] Updated weights for policy 0, policy_version 385106 (0.0007) [2023-12-26 02:39:37,082][123090] Updated weights for policy 1, policy_version 382879 (0.0011) [2023-12-26 02:39:37,132][123091] Updated weights for policy 0, policy_version 385116 (0.0008) [2023-12-26 02:39:37,181][123091] Updated weights for policy 0, policy_version 385126 (0.0009) [2023-12-26 02:39:37,234][123091] Updated weights for policy 0, policy_version 385136 (0.0009) [2023-12-26 02:39:37,849][123090] Updated weights for policy 1, policy_version 382889 (0.0011) [2023-12-26 02:39:37,909][123090] Updated weights for policy 1, policy_version 382899 (0.0011) [2023-12-26 02:39:37,968][123090] Updated weights for policy 1, policy_version 382909 (0.0007) [2023-12-26 02:39:38,109][123091] Updated weights for policy 0, policy_version 385146 (0.0010) [2023-12-26 02:39:38,160][123091] Updated weights for policy 0, policy_version 385156 (0.0009) [2023-12-26 02:39:38,228][123091] Updated weights for policy 0, policy_version 385166 (0.0010) [2023-12-26 02:39:38,693][123090] Updated weights for policy 1, policy_version 382919 (0.0008) [2023-12-26 02:39:38,766][123090] Updated weights for policy 1, policy_version 382929 (0.0006) [2023-12-26 02:39:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 196632576. Throughput: 0: 8662.3, 1: 9089.4. Samples: 196614140. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:38,785][121949] Avg episode reward: [(0, '6250.886'), (1, '5881.404')] [2023-12-26 02:39:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000385168_98607104.pth... [2023-12-26 02:39:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000384176_98353152.pth [2023-12-26 02:39:38,839][123090] Updated weights for policy 1, policy_version 382939 (0.0007) [2023-12-26 02:39:38,874][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000382944_98033664.pth... [2023-12-26 02:39:38,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000381856_97755136.pth [2023-12-26 02:39:39,136][123091] Updated weights for policy 0, policy_version 385176 (0.0006) [2023-12-26 02:39:39,182][123091] Updated weights for policy 0, policy_version 385186 (0.0005) [2023-12-26 02:39:39,239][123091] Updated weights for policy 0, policy_version 385196 (0.0007) [2023-12-26 02:39:39,599][123090] Updated weights for policy 1, policy_version 382949 (0.0007) [2023-12-26 02:39:39,654][123090] Updated weights for policy 1, policy_version 382959 (0.0006) [2023-12-26 02:39:39,719][123090] Updated weights for policy 1, policy_version 382969 (0.0006) [2023-12-26 02:39:40,051][123091] Updated weights for policy 0, policy_version 385206 (0.0007) [2023-12-26 02:39:40,100][123091] Updated weights for policy 0, policy_version 385216 (0.0005) [2023-12-26 02:39:40,147][123091] Updated weights for policy 0, policy_version 385226 (0.0008) [2023-12-26 02:39:40,528][123090] Updated weights for policy 1, policy_version 382979 (0.0009) [2023-12-26 02:39:40,580][123090] Updated weights for policy 1, policy_version 382989 (0.0010) [2023-12-26 02:39:40,624][123090] Updated weights for policy 1, policy_version 382999 (0.0010) [2023-12-26 02:39:40,859][123091] Updated weights for policy 0, policy_version 385236 (0.0007) [2023-12-26 02:39:40,910][123091] Updated weights for policy 0, policy_version 385246 (0.0009) [2023-12-26 02:39:40,958][123091] Updated weights for policy 0, policy_version 385256 (0.0009) [2023-12-26 02:39:41,484][123090] Updated weights for policy 1, policy_version 383009 (0.0010) [2023-12-26 02:39:41,552][123090] Updated weights for policy 1, policy_version 383019 (0.0008) [2023-12-26 02:39:41,618][123090] Updated weights for policy 1, policy_version 383029 (0.0008) [2023-12-26 02:39:41,686][123090] Updated weights for policy 1, policy_version 383039 (0.0008) [2023-12-26 02:39:41,766][123091] Updated weights for policy 0, policy_version 385266 (0.0009) [2023-12-26 02:39:41,839][123091] Updated weights for policy 0, policy_version 385276 (0.0010) [2023-12-26 02:39:41,891][123091] Updated weights for policy 0, policy_version 385286 (0.0010) [2023-12-26 02:39:41,948][123091] Updated weights for policy 0, policy_version 385296 (0.0011) [2023-12-26 02:39:42,484][123090] Updated weights for policy 1, policy_version 383049 (0.0008) [2023-12-26 02:39:42,534][123090] Updated weights for policy 1, policy_version 383059 (0.0006) [2023-12-26 02:39:42,582][123090] Updated weights for policy 1, policy_version 383069 (0.0005) [2023-12-26 02:39:42,809][123091] Updated weights for policy 0, policy_version 385306 (0.0009) [2023-12-26 02:39:42,868][123091] Updated weights for policy 0, policy_version 385316 (0.0010) [2023-12-26 02:39:42,930][123091] Updated weights for policy 0, policy_version 385326 (0.0007) [2023-12-26 02:39:43,441][123090] Updated weights for policy 1, policy_version 383079 (0.0010) [2023-12-26 02:39:43,497][123090] Updated weights for policy 1, policy_version 383089 (0.0010) [2023-12-26 02:39:43,549][123090] Updated weights for policy 1, policy_version 383099 (0.0010) [2023-12-26 02:39:43,680][123091] Updated weights for policy 0, policy_version 385336 (0.0009) [2023-12-26 02:39:43,738][123091] Updated weights for policy 0, policy_version 385346 (0.0006) [2023-12-26 02:39:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 196722688. Throughput: 0: 8648.3, 1: 9049.2. Samples: 196719284. Policy #0 lag: (min: 30.0, avg: 43.3, max: 62.0) [2023-12-26 02:39:43,785][121949] Avg episode reward: [(0, '6320.744'), (1, '5875.975')] [2023-12-26 02:39:43,789][123091] Updated weights for policy 0, policy_version 385356 (0.0005) [2023-12-26 02:39:44,406][123090] Updated weights for policy 1, policy_version 383109 (0.0010) [2023-12-26 02:39:44,466][123090] Updated weights for policy 1, policy_version 383119 (0.0009) [2023-12-26 02:39:44,530][123090] Updated weights for policy 1, policy_version 383129 (0.0009) [2023-12-26 02:39:44,584][123091] Updated weights for policy 0, policy_version 385366 (0.0006) [2023-12-26 02:39:44,646][123091] Updated weights for policy 0, policy_version 385376 (0.0009) [2023-12-26 02:39:44,698][123091] Updated weights for policy 0, policy_version 385386 (0.0009) [2023-12-26 02:39:45,380][123090] Updated weights for policy 1, policy_version 383139 (0.0010) [2023-12-26 02:39:45,447][123090] Updated weights for policy 1, policy_version 383149 (0.0011) [2023-12-26 02:39:45,478][123091] Updated weights for policy 0, policy_version 385396 (0.0008) [2023-12-26 02:39:45,511][123090] Updated weights for policy 1, policy_version 383159 (0.0010) [2023-12-26 02:39:45,538][123091] Updated weights for policy 0, policy_version 385406 (0.0006) [2023-12-26 02:39:45,604][123091] Updated weights for policy 0, policy_version 385416 (0.0008) [2023-12-26 02:39:46,322][123090] Updated weights for policy 1, policy_version 383169 (0.0011) [2023-12-26 02:39:46,377][123090] Updated weights for policy 1, policy_version 383179 (0.0010) [2023-12-26 02:39:46,425][123090] Updated weights for policy 1, policy_version 383189 (0.0010) [2023-12-26 02:39:46,436][123091] Updated weights for policy 0, policy_version 385426 (0.0008) [2023-12-26 02:39:46,473][123090] Updated weights for policy 1, policy_version 383199 (0.0010) [2023-12-26 02:39:46,486][123091] Updated weights for policy 0, policy_version 385436 (0.0008) [2023-12-26 02:39:46,543][123091] Updated weights for policy 0, policy_version 385446 (0.0009) [2023-12-26 02:39:46,595][123091] Updated weights for policy 0, policy_version 385456 (0.0009) [2023-12-26 02:39:47,238][123090] Updated weights for policy 1, policy_version 383209 (0.0009) [2023-12-26 02:39:47,298][123090] Updated weights for policy 1, policy_version 383219 (0.0009) [2023-12-26 02:39:47,364][123090] Updated weights for policy 1, policy_version 383229 (0.0010) [2023-12-26 02:39:47,462][123091] Updated weights for policy 0, policy_version 385466 (0.0009) [2023-12-26 02:39:47,517][123091] Updated weights for policy 0, policy_version 385476 (0.0008) [2023-12-26 02:39:47,576][123091] Updated weights for policy 0, policy_version 385486 (0.0010) [2023-12-26 02:39:48,173][123090] Updated weights for policy 1, policy_version 383239 (0.0006) [2023-12-26 02:39:48,237][123090] Updated weights for policy 1, policy_version 383249 (0.0006) [2023-12-26 02:39:48,295][123090] Updated weights for policy 1, policy_version 383259 (0.0005) [2023-12-26 02:39:48,441][123091] Updated weights for policy 0, policy_version 385496 (0.0010) [2023-12-26 02:39:48,500][123091] Updated weights for policy 0, policy_version 385506 (0.0009) [2023-12-26 02:39:48,564][123091] Updated weights for policy 0, policy_version 385516 (0.0009) [2023-12-26 02:39:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 196812800. Throughput: 0: 8639.9, 1: 9046.3. Samples: 196823556. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:39:48,785][121949] Avg episode reward: [(0, '6127.381'), (1, '5971.384')] [2023-12-26 02:39:49,124][123090] Updated weights for policy 1, policy_version 383269 (0.0010) [2023-12-26 02:39:49,192][123090] Updated weights for policy 1, policy_version 383279 (0.0010) [2023-12-26 02:39:49,256][123090] Updated weights for policy 1, policy_version 383289 (0.0009) [2023-12-26 02:39:49,339][123091] Updated weights for policy 0, policy_version 385526 (0.0007) [2023-12-26 02:39:49,405][123091] Updated weights for policy 0, policy_version 385536 (0.0010) [2023-12-26 02:39:49,459][123091] Updated weights for policy 0, policy_version 385546 (0.0013) [2023-12-26 02:39:50,087][123090] Updated weights for policy 1, policy_version 383299 (0.0008) [2023-12-26 02:39:50,147][123090] Updated weights for policy 1, policy_version 383309 (0.0009) [2023-12-26 02:39:50,211][123090] Updated weights for policy 1, policy_version 383319 (0.0009) [2023-12-26 02:39:50,298][123091] Updated weights for policy 0, policy_version 385556 (0.0009) [2023-12-26 02:39:50,356][123091] Updated weights for policy 0, policy_version 385566 (0.0006) [2023-12-26 02:39:50,409][123091] Updated weights for policy 0, policy_version 385576 (0.0006) [2023-12-26 02:39:50,971][123090] Updated weights for policy 1, policy_version 383329 (0.0009) [2023-12-26 02:39:51,022][123090] Updated weights for policy 1, policy_version 383339 (0.0007) [2023-12-26 02:39:51,091][123090] Updated weights for policy 1, policy_version 383349 (0.0009) [2023-12-26 02:39:51,157][123090] Updated weights for policy 1, policy_version 383359 (0.0009) [2023-12-26 02:39:51,205][123091] Updated weights for policy 0, policy_version 385586 (0.0006) [2023-12-26 02:39:51,269][123091] Updated weights for policy 0, policy_version 385596 (0.0009) [2023-12-26 02:39:51,328][123091] Updated weights for policy 0, policy_version 385606 (0.0009) [2023-12-26 02:39:51,399][123091] Updated weights for policy 0, policy_version 385616 (0.0009) [2023-12-26 02:39:51,942][123090] Updated weights for policy 1, policy_version 383369 (0.0006) [2023-12-26 02:39:52,012][123090] Updated weights for policy 1, policy_version 383379 (0.0009) [2023-12-26 02:39:52,075][123090] Updated weights for policy 1, policy_version 383389 (0.0010) [2023-12-26 02:39:52,175][123091] Updated weights for policy 0, policy_version 385626 (0.0008) [2023-12-26 02:39:52,239][123091] Updated weights for policy 0, policy_version 385636 (0.0011) [2023-12-26 02:39:52,304][123091] Updated weights for policy 0, policy_version 385646 (0.0011) [2023-12-26 02:39:52,846][123090] Updated weights for policy 1, policy_version 383399 (0.0009) [2023-12-26 02:39:52,900][123090] Updated weights for policy 1, policy_version 383410 (0.0009) [2023-12-26 02:39:52,960][123090] Updated weights for policy 1, policy_version 383420 (0.0009) [2023-12-26 02:39:53,040][123091] Updated weights for policy 0, policy_version 385656 (0.0007) [2023-12-26 02:39:53,097][123091] Updated weights for policy 0, policy_version 385666 (0.0006) [2023-12-26 02:39:53,156][123091] Updated weights for policy 0, policy_version 385676 (0.0005) [2023-12-26 02:39:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 196894720. Throughput: 0: 8613.4, 1: 8996.9. Samples: 196876264. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:39:53,785][121949] Avg episode reward: [(0, '5969.364'), (1, '5994.227')] [2023-12-26 02:39:53,785][123091] Updated weights for policy 0, policy_version 385686 (0.0006) [2023-12-26 02:39:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000383424_98156544.pth... [2023-12-26 02:39:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000382368_97886208.pth [2023-12-26 02:39:53,850][123091] Updated weights for policy 0, policy_version 385696 (0.0011) [2023-12-26 02:39:53,898][123090] Updated weights for policy 1, policy_version 383430 (0.0007) [2023-12-26 02:39:53,918][123091] Updated weights for policy 0, policy_version 385706 (0.0011) [2023-12-26 02:39:53,957][123090] Updated weights for policy 1, policy_version 383440 (0.0007) [2023-12-26 02:39:53,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000385712_98746368.pth... [2023-12-26 02:39:53,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000384688_98484224.pth [2023-12-26 02:39:54,031][123090] Updated weights for policy 1, policy_version 383450 (0.0008) [2023-12-26 02:39:54,638][123091] Updated weights for policy 0, policy_version 385716 (0.0011) [2023-12-26 02:39:54,681][123091] Updated weights for policy 0, policy_version 385726 (0.0010) [2023-12-26 02:39:54,736][123091] Updated weights for policy 0, policy_version 385736 (0.0010) [2023-12-26 02:39:54,752][123090] Updated weights for policy 1, policy_version 383460 (0.0009) [2023-12-26 02:39:54,818][123090] Updated weights for policy 1, policy_version 383470 (0.0007) [2023-12-26 02:39:54,885][123090] Updated weights for policy 1, policy_version 383480 (0.0009) [2023-12-26 02:39:55,479][123091] Updated weights for policy 0, policy_version 385746 (0.0009) [2023-12-26 02:39:55,552][123091] Updated weights for policy 0, policy_version 385756 (0.0010) [2023-12-26 02:39:55,620][123091] Updated weights for policy 0, policy_version 385766 (0.0010) [2023-12-26 02:39:55,686][123091] Updated weights for policy 0, policy_version 385776 (0.0010) [2023-12-26 02:39:55,709][123090] Updated weights for policy 1, policy_version 383490 (0.0009) [2023-12-26 02:39:55,765][123090] Updated weights for policy 1, policy_version 383500 (0.0005) [2023-12-26 02:39:55,819][123090] Updated weights for policy 1, policy_version 383510 (0.0005) [2023-12-26 02:39:55,881][123090] Updated weights for policy 1, policy_version 383520 (0.0005) [2023-12-26 02:39:56,452][123090] Updated weights for policy 1, policy_version 383530 (0.0007) [2023-12-26 02:39:56,478][123091] Updated weights for policy 0, policy_version 385786 (0.0011) [2023-12-26 02:39:56,503][123090] Updated weights for policy 1, policy_version 383540 (0.0007) [2023-12-26 02:39:56,541][123091] Updated weights for policy 0, policy_version 385796 (0.0010) [2023-12-26 02:39:56,551][123090] Updated weights for policy 1, policy_version 383550 (0.0007) [2023-12-26 02:39:56,608][123091] Updated weights for policy 0, policy_version 385806 (0.0011) [2023-12-26 02:39:57,344][123090] Updated weights for policy 1, policy_version 383560 (0.0008) [2023-12-26 02:39:57,386][123091] Updated weights for policy 0, policy_version 385816 (0.0010) [2023-12-26 02:39:57,392][123090] Updated weights for policy 1, policy_version 383570 (0.0006) [2023-12-26 02:39:57,443][123091] Updated weights for policy 0, policy_version 385826 (0.0010) [2023-12-26 02:39:57,445][123090] Updated weights for policy 1, policy_version 383580 (0.0008) [2023-12-26 02:39:57,490][123091] Updated weights for policy 0, policy_version 385836 (0.0010) [2023-12-26 02:39:58,303][123090] Updated weights for policy 1, policy_version 383590 (0.0008) [2023-12-26 02:39:58,305][123091] Updated weights for policy 0, policy_version 385846 (0.0008) [2023-12-26 02:39:58,371][123090] Updated weights for policy 1, policy_version 383600 (0.0008) [2023-12-26 02:39:58,382][123091] Updated weights for policy 0, policy_version 385856 (0.0012) [2023-12-26 02:39:58,442][123090] Updated weights for policy 1, policy_version 383610 (0.0008) [2023-12-26 02:39:58,456][123091] Updated weights for policy 0, policy_version 385866 (0.0009) [2023-12-26 02:39:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 196993024. Throughput: 0: 8725.2, 1: 9006.9. Samples: 196985904. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:39:58,784][121949] Avg episode reward: [(0, '6064.250'), (1, '5948.577')] [2023-12-26 02:39:59,294][123090] Updated weights for policy 1, policy_version 383620 (0.0009) [2023-12-26 02:39:59,355][123090] Updated weights for policy 1, policy_version 383630 (0.0008) [2023-12-26 02:39:59,386][123091] Updated weights for policy 0, policy_version 385876 (0.0009) [2023-12-26 02:39:59,424][123090] Updated weights for policy 1, policy_version 383640 (0.0008) [2023-12-26 02:39:59,442][123091] Updated weights for policy 0, policy_version 385886 (0.0006) [2023-12-26 02:39:59,498][123091] Updated weights for policy 0, policy_version 385896 (0.0006) [2023-12-26 02:40:00,253][123091] Updated weights for policy 0, policy_version 385906 (0.0010) [2023-12-26 02:40:00,297][123090] Updated weights for policy 1, policy_version 383650 (0.0009) [2023-12-26 02:40:00,315][123091] Updated weights for policy 0, policy_version 385916 (0.0011) [2023-12-26 02:40:00,345][123090] Updated weights for policy 1, policy_version 383660 (0.0008) [2023-12-26 02:40:00,383][123091] Updated weights for policy 0, policy_version 385926 (0.0010) [2023-12-26 02:40:00,398][123090] Updated weights for policy 1, policy_version 383670 (0.0007) [2023-12-26 02:40:00,445][123091] Updated weights for policy 0, policy_version 385936 (0.0011) [2023-12-26 02:40:00,447][123090] Updated weights for policy 1, policy_version 383680 (0.0008) [2023-12-26 02:40:01,188][123091] Updated weights for policy 0, policy_version 385946 (0.0006) [2023-12-26 02:40:01,259][123091] Updated weights for policy 0, policy_version 385956 (0.0005) [2023-12-26 02:40:01,330][123091] Updated weights for policy 0, policy_version 385966 (0.0006) [2023-12-26 02:40:01,355][123090] Updated weights for policy 1, policy_version 383690 (0.0009) [2023-12-26 02:40:01,416][123090] Updated weights for policy 1, policy_version 383700 (0.0009) [2023-12-26 02:40:01,470][123090] Updated weights for policy 1, policy_version 383710 (0.0010) [2023-12-26 02:40:02,051][123091] Updated weights for policy 0, policy_version 385976 (0.0010) [2023-12-26 02:40:02,094][123091] Updated weights for policy 0, policy_version 385986 (0.0010) [2023-12-26 02:40:02,141][123091] Updated weights for policy 0, policy_version 385996 (0.0010) [2023-12-26 02:40:02,384][123090] Updated weights for policy 1, policy_version 383720 (0.0009) [2023-12-26 02:40:02,451][123090] Updated weights for policy 1, policy_version 383730 (0.0008) [2023-12-26 02:40:02,502][123090] Updated weights for policy 1, policy_version 383740 (0.0009) [2023-12-26 02:40:02,899][123091] Updated weights for policy 0, policy_version 386006 (0.0008) [2023-12-26 02:40:02,955][123091] Updated weights for policy 0, policy_version 386016 (0.0006) [2023-12-26 02:40:03,001][123091] Updated weights for policy 0, policy_version 386026 (0.0005) [2023-12-26 02:40:03,360][123090] Updated weights for policy 1, policy_version 383750 (0.0009) [2023-12-26 02:40:03,425][123090] Updated weights for policy 1, policy_version 383760 (0.0010) [2023-12-26 02:40:03,488][123090] Updated weights for policy 1, policy_version 383770 (0.0010) [2023-12-26 02:40:03,667][123091] Updated weights for policy 0, policy_version 386036 (0.0007) [2023-12-26 02:40:03,729][123091] Updated weights for policy 0, policy_version 386046 (0.0010) [2023-12-26 02:40:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 197074944. Throughput: 0: 8714.7, 1: 8909.9. Samples: 197089156. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:03,784][121949] Avg episode reward: [(0, '6185.465'), (1, '5963.098')] [2023-12-26 02:40:03,790][123091] Updated weights for policy 0, policy_version 386056 (0.0010) [2023-12-26 02:40:04,397][123090] Updated weights for policy 1, policy_version 383780 (0.0009) [2023-12-26 02:40:04,464][123090] Updated weights for policy 1, policy_version 383790 (0.0008) [2023-12-26 02:40:04,520][123090] Updated weights for policy 1, policy_version 383800 (0.0009) [2023-12-26 02:40:04,528][123091] Updated weights for policy 0, policy_version 386066 (0.0010) [2023-12-26 02:40:04,586][123091] Updated weights for policy 0, policy_version 386076 (0.0010) [2023-12-26 02:40:04,653][123091] Updated weights for policy 0, policy_version 386086 (0.0011) [2023-12-26 02:40:04,704][123091] Updated weights for policy 0, policy_version 386096 (0.0010) [2023-12-26 02:40:05,330][123091] Updated weights for policy 0, policy_version 386106 (0.0008) [2023-12-26 02:40:05,396][123091] Updated weights for policy 0, policy_version 386117 (0.0008) [2023-12-26 02:40:05,408][123090] Updated weights for policy 1, policy_version 383810 (0.0007) [2023-12-26 02:40:05,462][123091] Updated weights for policy 0, policy_version 386127 (0.0006) [2023-12-26 02:40:05,468][123090] Updated weights for policy 1, policy_version 383820 (0.0009) [2023-12-26 02:40:05,538][123090] Updated weights for policy 1, policy_version 383830 (0.0009) [2023-12-26 02:40:05,598][123090] Updated weights for policy 1, policy_version 383840 (0.0009) [2023-12-26 02:40:06,176][123091] Updated weights for policy 0, policy_version 386137 (0.0007) [2023-12-26 02:40:06,242][123091] Updated weights for policy 0, policy_version 386147 (0.0010) [2023-12-26 02:40:06,306][123091] Updated weights for policy 0, policy_version 386157 (0.0008) [2023-12-26 02:40:06,466][123090] Updated weights for policy 1, policy_version 383850 (0.0009) [2023-12-26 02:40:06,530][123090] Updated weights for policy 1, policy_version 383860 (0.0009) [2023-12-26 02:40:06,600][123090] Updated weights for policy 1, policy_version 383870 (0.0009) [2023-12-26 02:40:07,082][123091] Updated weights for policy 0, policy_version 386167 (0.0009) [2023-12-26 02:40:07,139][123091] Updated weights for policy 0, policy_version 386177 (0.0009) [2023-12-26 02:40:07,199][123091] Updated weights for policy 0, policy_version 386187 (0.0008) [2023-12-26 02:40:07,476][123090] Updated weights for policy 1, policy_version 383880 (0.0010) [2023-12-26 02:40:07,544][123090] Updated weights for policy 1, policy_version 383890 (0.0009) [2023-12-26 02:40:07,605][123090] Updated weights for policy 1, policy_version 383900 (0.0009) [2023-12-26 02:40:08,019][123091] Updated weights for policy 0, policy_version 386197 (0.0009) [2023-12-26 02:40:08,072][123091] Updated weights for policy 0, policy_version 386207 (0.0009) [2023-12-26 02:40:08,128][123091] Updated weights for policy 0, policy_version 386217 (0.0009) [2023-12-26 02:40:08,416][123090] Updated weights for policy 1, policy_version 383910 (0.0011) [2023-12-26 02:40:08,476][123090] Updated weights for policy 1, policy_version 383920 (0.0011) [2023-12-26 02:40:08,528][123090] Updated weights for policy 1, policy_version 383930 (0.0010) [2023-12-26 02:40:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 197165056. Throughput: 0: 8805.8, 1: 8844.2. Samples: 197142352. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:08,785][121949] Avg episode reward: [(0, '6277.984'), (1, '6000.599')] [2023-12-26 02:40:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000386224_98877440.pth... [2023-12-26 02:40:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000383936_98287616.pth... [2023-12-26 02:40:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000385168_98607104.pth [2023-12-26 02:40:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000382944_98033664.pth [2023-12-26 02:40:08,984][123091] Updated weights for policy 0, policy_version 386227 (0.0009) [2023-12-26 02:40:09,041][123091] Updated weights for policy 0, policy_version 386237 (0.0010) [2023-12-26 02:40:09,100][123091] Updated weights for policy 0, policy_version 386247 (0.0009) [2023-12-26 02:40:09,297][123090] Updated weights for policy 1, policy_version 383940 (0.0010) [2023-12-26 02:40:09,377][123090] Updated weights for policy 1, policy_version 383950 (0.0008) [2023-12-26 02:40:09,453][123090] Updated weights for policy 1, policy_version 383960 (0.0008) [2023-12-26 02:40:10,004][123091] Updated weights for policy 0, policy_version 386257 (0.0010) [2023-12-26 02:40:10,068][123091] Updated weights for policy 0, policy_version 386267 (0.0008) [2023-12-26 02:40:10,135][123091] Updated weights for policy 0, policy_version 386277 (0.0008) [2023-12-26 02:40:10,209][123091] Updated weights for policy 0, policy_version 386287 (0.0005) [2023-12-26 02:40:10,253][123090] Updated weights for policy 1, policy_version 383970 (0.0009) [2023-12-26 02:40:10,308][123090] Updated weights for policy 1, policy_version 383980 (0.0010) [2023-12-26 02:40:10,363][123090] Updated weights for policy 1, policy_version 383990 (0.0009) [2023-12-26 02:40:10,423][123090] Updated weights for policy 1, policy_version 384000 (0.0010) [2023-12-26 02:40:10,992][123091] Updated weights for policy 0, policy_version 386297 (0.0010) [2023-12-26 02:40:11,055][123091] Updated weights for policy 0, policy_version 386307 (0.0010) [2023-12-26 02:40:11,113][123091] Updated weights for policy 0, policy_version 386317 (0.0009) [2023-12-26 02:40:11,294][123090] Updated weights for policy 1, policy_version 384010 (0.0010) [2023-12-26 02:40:11,362][123090] Updated weights for policy 1, policy_version 384020 (0.0010) [2023-12-26 02:40:11,435][123090] Updated weights for policy 1, policy_version 384030 (0.0010) [2023-12-26 02:40:12,005][123091] Updated weights for policy 0, policy_version 386327 (0.0009) [2023-12-26 02:40:12,060][123091] Updated weights for policy 0, policy_version 386337 (0.0005) [2023-12-26 02:40:12,123][123091] Updated weights for policy 0, policy_version 386347 (0.0009) [2023-12-26 02:40:12,300][123090] Updated weights for policy 1, policy_version 384040 (0.0008) [2023-12-26 02:40:12,365][123090] Updated weights for policy 1, policy_version 384050 (0.0007) [2023-12-26 02:40:12,434][123090] Updated weights for policy 1, policy_version 384060 (0.0006) [2023-12-26 02:40:12,992][123091] Updated weights for policy 0, policy_version 386358 (0.0010) [2023-12-26 02:40:13,049][123091] Updated weights for policy 0, policy_version 386368 (0.0010) [2023-12-26 02:40:13,099][123091] Updated weights for policy 0, policy_version 386378 (0.0009) [2023-12-26 02:40:13,193][123090] Updated weights for policy 1, policy_version 384070 (0.0008) [2023-12-26 02:40:13,250][123090] Updated weights for policy 1, policy_version 384080 (0.0010) [2023-12-26 02:40:13,309][123090] Updated weights for policy 1, policy_version 384090 (0.0009) [2023-12-26 02:40:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 197246976. Throughput: 0: 8773.1, 1: 8775.6. Samples: 197244284. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:13,785][121949] Avg episode reward: [(0, '6191.406'), (1, '5984.219')] [2023-12-26 02:40:13,928][123091] Updated weights for policy 0, policy_version 386388 (0.0009) [2023-12-26 02:40:13,977][123091] Updated weights for policy 0, policy_version 386398 (0.0009) [2023-12-26 02:40:14,029][123091] Updated weights for policy 0, policy_version 386408 (0.0010) [2023-12-26 02:40:14,134][123090] Updated weights for policy 1, policy_version 384100 (0.0010) [2023-12-26 02:40:14,198][123090] Updated weights for policy 1, policy_version 384110 (0.0009) [2023-12-26 02:40:14,272][123090] Updated weights for policy 1, policy_version 384120 (0.0009) [2023-12-26 02:40:14,855][123091] Updated weights for policy 0, policy_version 386418 (0.0009) [2023-12-26 02:40:14,927][123091] Updated weights for policy 0, policy_version 386428 (0.0006) [2023-12-26 02:40:14,996][123091] Updated weights for policy 0, policy_version 386438 (0.0006) [2023-12-26 02:40:15,060][123091] Updated weights for policy 0, policy_version 386448 (0.0008) [2023-12-26 02:40:15,188][123090] Updated weights for policy 1, policy_version 384130 (0.0009) [2023-12-26 02:40:15,252][123090] Updated weights for policy 1, policy_version 384140 (0.0010) [2023-12-26 02:40:15,327][123090] Updated weights for policy 1, policy_version 384150 (0.0009) [2023-12-26 02:40:15,392][123090] Updated weights for policy 1, policy_version 384160 (0.0009) [2023-12-26 02:40:15,578][123091] Updated weights for policy 0, policy_version 386458 (0.0011) [2023-12-26 02:40:15,635][123091] Updated weights for policy 0, policy_version 386468 (0.0011) [2023-12-26 02:40:15,694][123091] Updated weights for policy 0, policy_version 386478 (0.0010) [2023-12-26 02:40:16,270][123090] Updated weights for policy 1, policy_version 384170 (0.0009) [2023-12-26 02:40:16,319][123090] Updated weights for policy 1, policy_version 384180 (0.0009) [2023-12-26 02:40:16,376][123090] Updated weights for policy 1, policy_version 384190 (0.0009) [2023-12-26 02:40:16,461][123091] Updated weights for policy 0, policy_version 386488 (0.0010) [2023-12-26 02:40:16,519][123091] Updated weights for policy 0, policy_version 386498 (0.0010) [2023-12-26 02:40:16,587][123091] Updated weights for policy 0, policy_version 386508 (0.0010) [2023-12-26 02:40:17,258][123090] Updated weights for policy 1, policy_version 384200 (0.0009) [2023-12-26 02:40:17,309][123090] Updated weights for policy 1, policy_version 384210 (0.0009) [2023-12-26 02:40:17,338][123091] Updated weights for policy 0, policy_version 386518 (0.0008) [2023-12-26 02:40:17,362][123090] Updated weights for policy 1, policy_version 384220 (0.0009) [2023-12-26 02:40:17,404][123091] Updated weights for policy 0, policy_version 386528 (0.0005) [2023-12-26 02:40:17,474][123091] Updated weights for policy 0, policy_version 386538 (0.0007) [2023-12-26 02:40:18,102][123091] Updated weights for policy 0, policy_version 386548 (0.0010) [2023-12-26 02:40:18,159][123091] Updated weights for policy 0, policy_version 386558 (0.0010) [2023-12-26 02:40:18,225][123091] Updated weights for policy 0, policy_version 386568 (0.0010) [2023-12-26 02:40:18,276][123090] Updated weights for policy 1, policy_version 384230 (0.0008) [2023-12-26 02:40:18,331][123090] Updated weights for policy 1, policy_version 384240 (0.0008) [2023-12-26 02:40:18,401][123090] Updated weights for policy 1, policy_version 384250 (0.0009) [2023-12-26 02:40:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 197337088. Throughput: 0: 8934.1, 1: 8577.0. Samples: 197348980. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:18,785][121949] Avg episode reward: [(0, '6226.370'), (1, '5923.776')] [2023-12-26 02:40:18,960][123091] Updated weights for policy 0, policy_version 386578 (0.0010) [2023-12-26 02:40:19,034][123091] Updated weights for policy 0, policy_version 386588 (0.0009) [2023-12-26 02:40:19,088][123091] Updated weights for policy 0, policy_version 386598 (0.0009) [2023-12-26 02:40:19,156][123091] Updated weights for policy 0, policy_version 386608 (0.0008) [2023-12-26 02:40:19,161][123090] Updated weights for policy 1, policy_version 384260 (0.0009) [2023-12-26 02:40:19,233][123090] Updated weights for policy 1, policy_version 384270 (0.0009) [2023-12-26 02:40:19,303][123090] Updated weights for policy 1, policy_version 384280 (0.0009) [2023-12-26 02:40:20,046][123091] Updated weights for policy 0, policy_version 386618 (0.0010) [2023-12-26 02:40:20,114][123091] Updated weights for policy 0, policy_version 386628 (0.0010) [2023-12-26 02:40:20,154][123090] Updated weights for policy 1, policy_version 384290 (0.0009) [2023-12-26 02:40:20,180][123091] Updated weights for policy 0, policy_version 386638 (0.0009) [2023-12-26 02:40:20,217][123090] Updated weights for policy 1, policy_version 384300 (0.0010) [2023-12-26 02:40:20,284][123090] Updated weights for policy 1, policy_version 384310 (0.0010) [2023-12-26 02:40:20,355][123090] Updated weights for policy 1, policy_version 384320 (0.0009) [2023-12-26 02:40:20,981][123091] Updated weights for policy 0, policy_version 386648 (0.0009) [2023-12-26 02:40:21,056][123091] Updated weights for policy 0, policy_version 386658 (0.0009) [2023-12-26 02:40:21,130][123091] Updated weights for policy 0, policy_version 386668 (0.0009) [2023-12-26 02:40:21,201][123090] Updated weights for policy 1, policy_version 384330 (0.0008) [2023-12-26 02:40:21,274][123090] Updated weights for policy 1, policy_version 384340 (0.0008) [2023-12-26 02:40:21,344][123090] Updated weights for policy 1, policy_version 384350 (0.0008) [2023-12-26 02:40:21,998][123091] Updated weights for policy 0, policy_version 386678 (0.0010) [2023-12-26 02:40:22,064][123091] Updated weights for policy 0, policy_version 386688 (0.0009) [2023-12-26 02:40:22,125][123091] Updated weights for policy 0, policy_version 386698 (0.0009) [2023-12-26 02:40:22,131][123090] Updated weights for policy 1, policy_version 384360 (0.0009) [2023-12-26 02:40:22,192][123090] Updated weights for policy 1, policy_version 384370 (0.0008) [2023-12-26 02:40:22,258][123090] Updated weights for policy 1, policy_version 384380 (0.0009) [2023-12-26 02:40:22,933][123091] Updated weights for policy 0, policy_version 386708 (0.0008) [2023-12-26 02:40:23,004][123091] Updated weights for policy 0, policy_version 386718 (0.0010) [2023-12-26 02:40:23,077][123091] Updated weights for policy 0, policy_version 386728 (0.0007) [2023-12-26 02:40:23,113][123090] Updated weights for policy 1, policy_version 384390 (0.0008) [2023-12-26 02:40:23,175][123090] Updated weights for policy 1, policy_version 384400 (0.0008) [2023-12-26 02:40:23,258][123090] Updated weights for policy 1, policy_version 384410 (0.0005) [2023-12-26 02:40:23,740][123091] Updated weights for policy 0, policy_version 386738 (0.0006) [2023-12-26 02:40:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 197419008. Throughput: 0: 8936.3, 1: 8512.6. Samples: 197399344. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:23,785][121949] Avg episode reward: [(0, '6279.242'), (1, '5925.263')] [2023-12-26 02:40:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000384416_98410496.pth... [2023-12-26 02:40:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000383424_98156544.pth [2023-12-26 02:40:23,795][123091] Updated weights for policy 0, policy_version 386748 (0.0007) [2023-12-26 02:40:23,852][123091] Updated weights for policy 0, policy_version 386758 (0.0005) [2023-12-26 02:40:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000386768_99016704.pth... [2023-12-26 02:40:23,904][123091] Updated weights for policy 0, policy_version 386768 (0.0005) [2023-12-26 02:40:23,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000385712_98746368.pth [2023-12-26 02:40:24,041][123090] Updated weights for policy 1, policy_version 384420 (0.0006) [2023-12-26 02:40:24,102][123090] Updated weights for policy 1, policy_version 384430 (0.0009) [2023-12-26 02:40:24,161][123090] Updated weights for policy 1, policy_version 384440 (0.0008) [2023-12-26 02:40:24,742][123091] Updated weights for policy 0, policy_version 386778 (0.0010) [2023-12-26 02:40:24,806][123091] Updated weights for policy 0, policy_version 386788 (0.0009) [2023-12-26 02:40:24,872][123091] Updated weights for policy 0, policy_version 386798 (0.0006) [2023-12-26 02:40:25,020][123090] Updated weights for policy 1, policy_version 384450 (0.0010) [2023-12-26 02:40:25,075][123090] Updated weights for policy 1, policy_version 384460 (0.0009) [2023-12-26 02:40:25,133][123090] Updated weights for policy 1, policy_version 384470 (0.0008) [2023-12-26 02:40:25,195][123090] Updated weights for policy 1, policy_version 384480 (0.0005) [2023-12-26 02:40:25,512][123091] Updated weights for policy 0, policy_version 386808 (0.0005) [2023-12-26 02:40:25,565][123091] Updated weights for policy 0, policy_version 386818 (0.0005) [2023-12-26 02:40:25,627][123091] Updated weights for policy 0, policy_version 386828 (0.0005) [2023-12-26 02:40:25,872][123090] Updated weights for policy 1, policy_version 384490 (0.0005) [2023-12-26 02:40:25,934][123090] Updated weights for policy 1, policy_version 384500 (0.0005) [2023-12-26 02:40:25,985][123090] Updated weights for policy 1, policy_version 384510 (0.0005) [2023-12-26 02:40:26,237][123091] Updated weights for policy 0, policy_version 386838 (0.0005) [2023-12-26 02:40:26,282][123091] Updated weights for policy 0, policy_version 386848 (0.0005) [2023-12-26 02:40:26,341][123091] Updated weights for policy 0, policy_version 386858 (0.0005) [2023-12-26 02:40:26,592][123090] Updated weights for policy 1, policy_version 384520 (0.0005) [2023-12-26 02:40:26,650][123090] Updated weights for policy 1, policy_version 384530 (0.0008) [2023-12-26 02:40:26,702][123090] Updated weights for policy 1, policy_version 384540 (0.0010) [2023-12-26 02:40:27,039][123091] Updated weights for policy 0, policy_version 386868 (0.0007) [2023-12-26 02:40:27,099][123091] Updated weights for policy 0, policy_version 386878 (0.0008) [2023-12-26 02:40:27,159][123091] Updated weights for policy 0, policy_version 386888 (0.0005) [2023-12-26 02:40:27,438][123090] Updated weights for policy 1, policy_version 384550 (0.0008) [2023-12-26 02:40:27,486][123090] Updated weights for policy 1, policy_version 384560 (0.0005) [2023-12-26 02:40:27,531][123090] Updated weights for policy 1, policy_version 384570 (0.0005) [2023-12-26 02:40:27,826][123091] Updated weights for policy 0, policy_version 386898 (0.0005) [2023-12-26 02:40:27,893][123091] Updated weights for policy 0, policy_version 386908 (0.0005) [2023-12-26 02:40:27,962][123091] Updated weights for policy 0, policy_version 386918 (0.0008) [2023-12-26 02:40:28,032][123091] Updated weights for policy 0, policy_version 386928 (0.0006) [2023-12-26 02:40:28,204][123090] Updated weights for policy 1, policy_version 384580 (0.0005) [2023-12-26 02:40:28,257][123090] Updated weights for policy 1, policy_version 384590 (0.0005) [2023-12-26 02:40:28,318][123090] Updated weights for policy 1, policy_version 384600 (0.0005) [2023-12-26 02:40:28,724][123091] Updated weights for policy 0, policy_version 386938 (0.0010) [2023-12-26 02:40:28,779][123091] Updated weights for policy 0, policy_version 386948 (0.0010) [2023-12-26 02:40:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 197517312. Throughput: 0: 9072.3, 1: 8563.5. Samples: 197512900. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:28,786][121949] Avg episode reward: [(0, '6196.666'), (1, '5924.798')] [2023-12-26 02:40:28,838][123091] Updated weights for policy 0, policy_version 386958 (0.0010) [2023-12-26 02:40:28,962][123090] Updated weights for policy 1, policy_version 384610 (0.0007) [2023-12-26 02:40:29,018][123090] Updated weights for policy 1, policy_version 384620 (0.0006) [2023-12-26 02:40:29,078][123090] Updated weights for policy 1, policy_version 384630 (0.0009) [2023-12-26 02:40:29,138][123090] Updated weights for policy 1, policy_version 384640 (0.0009) [2023-12-26 02:40:29,704][123091] Updated weights for policy 0, policy_version 386968 (0.0009) [2023-12-26 02:40:29,752][123091] Updated weights for policy 0, policy_version 386978 (0.0009) [2023-12-26 02:40:29,801][123091] Updated weights for policy 0, policy_version 386988 (0.0009) [2023-12-26 02:40:29,971][123090] Updated weights for policy 1, policy_version 384650 (0.0011) [2023-12-26 02:40:30,039][123090] Updated weights for policy 1, policy_version 384660 (0.0010) [2023-12-26 02:40:30,091][123090] Updated weights for policy 1, policy_version 384670 (0.0010) [2023-12-26 02:40:30,674][123091] Updated weights for policy 0, policy_version 386998 (0.0009) [2023-12-26 02:40:30,725][123091] Updated weights for policy 0, policy_version 387008 (0.0009) [2023-12-26 02:40:30,784][123091] Updated weights for policy 0, policy_version 387018 (0.0009) [2023-12-26 02:40:30,926][123090] Updated weights for policy 1, policy_version 384680 (0.0010) [2023-12-26 02:40:30,981][123090] Updated weights for policy 1, policy_version 384690 (0.0010) [2023-12-26 02:40:31,053][123090] Updated weights for policy 1, policy_version 384700 (0.0011) [2023-12-26 02:40:31,651][123091] Updated weights for policy 0, policy_version 387028 (0.0009) [2023-12-26 02:40:31,718][123091] Updated weights for policy 0, policy_version 387038 (0.0009) [2023-12-26 02:40:31,774][123091] Updated weights for policy 0, policy_version 387048 (0.0009) [2023-12-26 02:40:31,877][123090] Updated weights for policy 1, policy_version 384710 (0.0010) [2023-12-26 02:40:31,933][123090] Updated weights for policy 1, policy_version 384720 (0.0010) [2023-12-26 02:40:31,984][123090] Updated weights for policy 1, policy_version 384730 (0.0010) [2023-12-26 02:40:32,634][123091] Updated weights for policy 0, policy_version 387058 (0.0009) [2023-12-26 02:40:32,684][123091] Updated weights for policy 0, policy_version 387069 (0.0009) [2023-12-26 02:40:32,738][123091] Updated weights for policy 0, policy_version 387080 (0.0010) [2023-12-26 02:40:32,792][123090] Updated weights for policy 1, policy_version 384740 (0.0008) [2023-12-26 02:40:32,864][123090] Updated weights for policy 1, policy_version 384750 (0.0006) [2023-12-26 02:40:32,931][123090] Updated weights for policy 1, policy_version 384760 (0.0010) [2023-12-26 02:40:33,598][123091] Updated weights for policy 0, policy_version 387090 (0.0008) [2023-12-26 02:40:33,664][123091] Updated weights for policy 0, policy_version 387100 (0.0010) [2023-12-26 02:40:33,721][123090] Updated weights for policy 1, policy_version 384770 (0.0009) [2023-12-26 02:40:33,736][123091] Updated weights for policy 0, policy_version 387110 (0.0010) [2023-12-26 02:40:33,780][123090] Updated weights for policy 1, policy_version 384780 (0.0005) [2023-12-26 02:40:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 197599232. Throughput: 0: 9048.1, 1: 8611.9. Samples: 197618260. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:33,785][121949] Avg episode reward: [(0, '6174.581'), (1, '5839.891')] [2023-12-26 02:40:33,798][123091] Updated weights for policy 0, policy_version 387120 (0.0009) [2023-12-26 02:40:33,841][123090] Updated weights for policy 1, policy_version 384790 (0.0005) [2023-12-26 02:40:33,901][123090] Updated weights for policy 1, policy_version 384800 (0.0005) [2023-12-26 02:40:34,596][123090] Updated weights for policy 1, policy_version 384810 (0.0011) [2023-12-26 02:40:34,657][123090] Updated weights for policy 1, policy_version 384820 (0.0011) [2023-12-26 02:40:34,676][123091] Updated weights for policy 0, policy_version 387130 (0.0007) [2023-12-26 02:40:34,717][123090] Updated weights for policy 1, policy_version 384830 (0.0011) [2023-12-26 02:40:34,742][123091] Updated weights for policy 0, policy_version 387140 (0.0006) [2023-12-26 02:40:34,803][123091] Updated weights for policy 0, policy_version 387150 (0.0009) [2023-12-26 02:40:35,457][123090] Updated weights for policy 1, policy_version 384840 (0.0009) [2023-12-26 02:40:35,519][123090] Updated weights for policy 1, policy_version 384850 (0.0010) [2023-12-26 02:40:35,587][123090] Updated weights for policy 1, policy_version 384860 (0.0010) [2023-12-26 02:40:35,634][123091] Updated weights for policy 0, policy_version 387160 (0.0009) [2023-12-26 02:40:35,682][123091] Updated weights for policy 0, policy_version 387170 (0.0009) [2023-12-26 02:40:35,738][123091] Updated weights for policy 0, policy_version 387180 (0.0008) [2023-12-26 02:40:36,432][123090] Updated weights for policy 1, policy_version 384870 (0.0011) [2023-12-26 02:40:36,504][123090] Updated weights for policy 1, policy_version 384880 (0.0011) [2023-12-26 02:40:36,568][123090] Updated weights for policy 1, policy_version 384890 (0.0011) [2023-12-26 02:40:36,632][123091] Updated weights for policy 0, policy_version 387190 (0.0010) [2023-12-26 02:40:36,691][123091] Updated weights for policy 0, policy_version 387200 (0.0009) [2023-12-26 02:40:36,747][123091] Updated weights for policy 0, policy_version 387210 (0.0010) [2023-12-26 02:40:37,290][123090] Updated weights for policy 1, policy_version 384900 (0.0009) [2023-12-26 02:40:37,344][123090] Updated weights for policy 1, policy_version 384910 (0.0005) [2023-12-26 02:40:37,413][123090] Updated weights for policy 1, policy_version 384920 (0.0005) [2023-12-26 02:40:37,672][123091] Updated weights for policy 0, policy_version 387220 (0.0009) [2023-12-26 02:40:37,738][123091] Updated weights for policy 0, policy_version 387230 (0.0009) [2023-12-26 02:40:37,799][123091] Updated weights for policy 0, policy_version 387240 (0.0009) [2023-12-26 02:40:38,116][123090] Updated weights for policy 1, policy_version 384930 (0.0006) [2023-12-26 02:40:38,167][123090] Updated weights for policy 1, policy_version 384940 (0.0010) [2023-12-26 02:40:38,218][123090] Updated weights for policy 1, policy_version 384950 (0.0010) [2023-12-26 02:40:38,277][123090] Updated weights for policy 1, policy_version 384960 (0.0010) [2023-12-26 02:40:38,614][123091] Updated weights for policy 0, policy_version 387250 (0.0008) [2023-12-26 02:40:38,677][123091] Updated weights for policy 0, policy_version 387260 (0.0007) [2023-12-26 02:40:38,727][123091] Updated weights for policy 0, policy_version 387270 (0.0009) [2023-12-26 02:40:38,783][123091] Updated weights for policy 0, policy_version 387280 (0.0009) [2023-12-26 02:40:38,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 197697536. Throughput: 0: 9013.2, 1: 8624.9. Samples: 197669980. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:38,784][121949] Avg episode reward: [(0, '6219.683'), (1, '5889.266')] [2023-12-26 02:40:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000387280_99147776.pth... [2023-12-26 02:40:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000384960_98549760.pth... [2023-12-26 02:40:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000386224_98877440.pth [2023-12-26 02:40:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000383936_98287616.pth [2023-12-26 02:40:39,093][123090] Updated weights for policy 1, policy_version 384970 (0.0009) [2023-12-26 02:40:39,141][123090] Updated weights for policy 1, policy_version 384980 (0.0007) [2023-12-26 02:40:39,206][123090] Updated weights for policy 1, policy_version 384990 (0.0005) [2023-12-26 02:40:39,649][123091] Updated weights for policy 0, policy_version 387290 (0.0010) [2023-12-26 02:40:39,717][123091] Updated weights for policy 0, policy_version 387300 (0.0010) [2023-12-26 02:40:39,770][123091] Updated weights for policy 0, policy_version 387310 (0.0009) [2023-12-26 02:40:40,092][123090] Updated weights for policy 1, policy_version 385000 (0.0010) [2023-12-26 02:40:40,148][123090] Updated weights for policy 1, policy_version 385010 (0.0009) [2023-12-26 02:40:40,205][123090] Updated weights for policy 1, policy_version 385020 (0.0008) [2023-12-26 02:40:40,633][123091] Updated weights for policy 0, policy_version 387320 (0.0010) [2023-12-26 02:40:40,686][123091] Updated weights for policy 0, policy_version 387330 (0.0010) [2023-12-26 02:40:40,740][123091] Updated weights for policy 0, policy_version 387341 (0.0010) [2023-12-26 02:40:40,927][123090] Updated weights for policy 1, policy_version 385030 (0.0010) [2023-12-26 02:40:40,991][123090] Updated weights for policy 1, policy_version 385040 (0.0009) [2023-12-26 02:40:41,064][123090] Updated weights for policy 1, policy_version 385050 (0.0008) [2023-12-26 02:40:41,678][123091] Updated weights for policy 0, policy_version 387351 (0.0009) [2023-12-26 02:40:41,750][123091] Updated weights for policy 0, policy_version 387361 (0.0010) [2023-12-26 02:40:41,819][123091] Updated weights for policy 0, policy_version 387371 (0.0009) [2023-12-26 02:40:41,883][123090] Updated weights for policy 1, policy_version 385060 (0.0010) [2023-12-26 02:40:41,943][123090] Updated weights for policy 1, policy_version 385070 (0.0007) [2023-12-26 02:40:42,019][123090] Updated weights for policy 1, policy_version 385080 (0.0006) [2023-12-26 02:40:42,652][123091] Updated weights for policy 0, policy_version 387381 (0.0010) [2023-12-26 02:40:42,704][123091] Updated weights for policy 0, policy_version 387391 (0.0009) [2023-12-26 02:40:42,725][123090] Updated weights for policy 1, policy_version 385090 (0.0006) [2023-12-26 02:40:42,769][123091] Updated weights for policy 0, policy_version 387401 (0.0008) [2023-12-26 02:40:42,784][123090] Updated weights for policy 1, policy_version 385100 (0.0005) [2023-12-26 02:40:42,842][123090] Updated weights for policy 1, policy_version 385110 (0.0006) [2023-12-26 02:40:42,896][123090] Updated weights for policy 1, policy_version 385120 (0.0009) [2023-12-26 02:40:43,647][123091] Updated weights for policy 0, policy_version 387411 (0.0008) [2023-12-26 02:40:43,677][123090] Updated weights for policy 1, policy_version 385130 (0.0008) [2023-12-26 02:40:43,705][123091] Updated weights for policy 0, policy_version 387421 (0.0007) [2023-12-26 02:40:43,736][123090] Updated weights for policy 1, policy_version 385140 (0.0010) [2023-12-26 02:40:43,764][123091] Updated weights for policy 0, policy_version 387431 (0.0006) [2023-12-26 02:40:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 197771264. Throughput: 0: 8870.6, 1: 8637.7. Samples: 197773776. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:43,785][121949] Avg episode reward: [(0, '6259.203'), (1, '5882.260')] [2023-12-26 02:40:43,796][123090] Updated weights for policy 1, policy_version 385150 (0.0010) [2023-12-26 02:40:44,538][123090] Updated weights for policy 1, policy_version 385160 (0.0006) [2023-12-26 02:40:44,589][123090] Updated weights for policy 1, policy_version 385170 (0.0005) [2023-12-26 02:40:44,638][123091] Updated weights for policy 0, policy_version 387441 (0.0006) [2023-12-26 02:40:44,656][123090] Updated weights for policy 1, policy_version 385180 (0.0005) [2023-12-26 02:40:44,704][123091] Updated weights for policy 0, policy_version 387451 (0.0009) [2023-12-26 02:40:44,766][123091] Updated weights for policy 0, policy_version 387461 (0.0010) [2023-12-26 02:40:44,834][123091] Updated weights for policy 0, policy_version 387471 (0.0006) [2023-12-26 02:40:45,313][123090] Updated weights for policy 1, policy_version 385190 (0.0009) [2023-12-26 02:40:45,387][123090] Updated weights for policy 1, policy_version 385200 (0.0009) [2023-12-26 02:40:45,461][123090] Updated weights for policy 1, policy_version 385210 (0.0006) [2023-12-26 02:40:45,613][123091] Updated weights for policy 0, policy_version 387481 (0.0008) [2023-12-26 02:40:45,660][123091] Updated weights for policy 0, policy_version 387491 (0.0009) [2023-12-26 02:40:45,708][123091] Updated weights for policy 0, policy_version 387501 (0.0009) [2023-12-26 02:40:46,211][123090] Updated weights for policy 1, policy_version 385220 (0.0008) [2023-12-26 02:40:46,278][123090] Updated weights for policy 1, policy_version 385230 (0.0010) [2023-12-26 02:40:46,350][123090] Updated weights for policy 1, policy_version 385240 (0.0011) [2023-12-26 02:40:46,578][123091] Updated weights for policy 0, policy_version 387511 (0.0009) [2023-12-26 02:40:46,642][123091] Updated weights for policy 0, policy_version 387521 (0.0010) [2023-12-26 02:40:46,703][123091] Updated weights for policy 0, policy_version 387531 (0.0009) [2023-12-26 02:40:47,078][123090] Updated weights for policy 1, policy_version 385250 (0.0010) [2023-12-26 02:40:47,136][123090] Updated weights for policy 1, policy_version 385260 (0.0005) [2023-12-26 02:40:47,199][123090] Updated weights for policy 1, policy_version 385270 (0.0006) [2023-12-26 02:40:47,258][123090] Updated weights for policy 1, policy_version 385280 (0.0009) [2023-12-26 02:40:47,616][123091] Updated weights for policy 0, policy_version 387541 (0.0010) [2023-12-26 02:40:47,674][123091] Updated weights for policy 0, policy_version 387551 (0.0010) [2023-12-26 02:40:47,726][123091] Updated weights for policy 0, policy_version 387561 (0.0010) [2023-12-26 02:40:47,924][123090] Updated weights for policy 1, policy_version 385290 (0.0008) [2023-12-26 02:40:47,970][123090] Updated weights for policy 1, policy_version 385300 (0.0007) [2023-12-26 02:40:48,032][123090] Updated weights for policy 1, policy_version 385310 (0.0010) [2023-12-26 02:40:48,583][123091] Updated weights for policy 0, policy_version 387571 (0.0010) [2023-12-26 02:40:48,646][123091] Updated weights for policy 0, policy_version 387581 (0.0010) [2023-12-26 02:40:48,705][123091] Updated weights for policy 0, policy_version 387591 (0.0009) [2023-12-26 02:40:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 197869568. Throughput: 0: 8752.9, 1: 8819.0. Samples: 197879892. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:48,785][121949] Avg episode reward: [(0, '6236.490'), (1, '5715.389')] [2023-12-26 02:40:48,866][123090] Updated weights for policy 1, policy_version 385320 (0.0007) [2023-12-26 02:40:48,923][123090] Updated weights for policy 1, policy_version 385330 (0.0006) [2023-12-26 02:40:48,974][123090] Updated weights for policy 1, policy_version 385340 (0.0005) [2023-12-26 02:40:49,592][123091] Updated weights for policy 0, policy_version 387601 (0.0009) [2023-12-26 02:40:49,648][123091] Updated weights for policy 0, policy_version 387611 (0.0009) [2023-12-26 02:40:49,691][123090] Updated weights for policy 1, policy_version 385350 (0.0006) [2023-12-26 02:40:49,709][123091] Updated weights for policy 0, policy_version 387621 (0.0007) [2023-12-26 02:40:49,743][123090] Updated weights for policy 1, policy_version 385360 (0.0009) [2023-12-26 02:40:49,768][123091] Updated weights for policy 0, policy_version 387631 (0.0006) [2023-12-26 02:40:49,795][123090] Updated weights for policy 1, policy_version 385370 (0.0009) [2023-12-26 02:40:50,583][123090] Updated weights for policy 1, policy_version 385380 (0.0009) [2023-12-26 02:40:50,647][123090] Updated weights for policy 1, policy_version 385390 (0.0008) [2023-12-26 02:40:50,676][123091] Updated weights for policy 0, policy_version 387641 (0.0010) [2023-12-26 02:40:50,702][123090] Updated weights for policy 1, policy_version 385400 (0.0007) [2023-12-26 02:40:50,743][123091] Updated weights for policy 0, policy_version 387651 (0.0011) [2023-12-26 02:40:50,791][123091] Updated weights for policy 0, policy_version 387661 (0.0010) [2023-12-26 02:40:51,521][123090] Updated weights for policy 1, policy_version 385410 (0.0008) [2023-12-26 02:40:51,574][123090] Updated weights for policy 1, policy_version 385421 (0.0009) [2023-12-26 02:40:51,636][123090] Updated weights for policy 1, policy_version 385431 (0.0009) [2023-12-26 02:40:51,646][123091] Updated weights for policy 0, policy_version 387671 (0.0009) [2023-12-26 02:40:51,708][123091] Updated weights for policy 0, policy_version 387681 (0.0007) [2023-12-26 02:40:51,783][123091] Updated weights for policy 0, policy_version 387691 (0.0009) [2023-12-26 02:40:52,489][123090] Updated weights for policy 1, policy_version 385441 (0.0008) [2023-12-26 02:40:52,563][123090] Updated weights for policy 1, policy_version 385451 (0.0006) [2023-12-26 02:40:52,620][123090] Updated weights for policy 1, policy_version 385461 (0.0005) [2023-12-26 02:40:52,626][123091] Updated weights for policy 0, policy_version 387701 (0.0009) [2023-12-26 02:40:52,677][123090] Updated weights for policy 1, policy_version 385471 (0.0005) [2023-12-26 02:40:52,695][123091] Updated weights for policy 0, policy_version 387711 (0.0009) [2023-12-26 02:40:52,755][123091] Updated weights for policy 0, policy_version 387721 (0.0009) [2023-12-26 02:40:53,380][123090] Updated weights for policy 1, policy_version 385481 (0.0009) [2023-12-26 02:40:53,429][123090] Updated weights for policy 1, policy_version 385491 (0.0010) [2023-12-26 02:40:53,481][123090] Updated weights for policy 1, policy_version 385501 (0.0009) [2023-12-26 02:40:53,604][123091] Updated weights for policy 0, policy_version 387731 (0.0010) [2023-12-26 02:40:53,662][123091] Updated weights for policy 0, policy_version 387741 (0.0009) [2023-12-26 02:40:53,712][123091] Updated weights for policy 0, policy_version 387751 (0.0009) [2023-12-26 02:40:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 197959680. Throughput: 0: 8644.9, 1: 8899.2. Samples: 197931840. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:53,785][121949] Avg episode reward: [(0, '6310.839'), (1, '5600.228')] [2023-12-26 02:40:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000387760_99270656.pth... [2023-12-26 02:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000385504_98689024.pth... [2023-12-26 02:40:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000384416_98410496.pth [2023-12-26 02:40:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000386768_99016704.pth [2023-12-26 02:40:54,347][123090] Updated weights for policy 1, policy_version 385511 (0.0009) [2023-12-26 02:40:54,411][123090] Updated weights for policy 1, policy_version 385521 (0.0009) [2023-12-26 02:40:54,463][123090] Updated weights for policy 1, policy_version 385531 (0.0010) [2023-12-26 02:40:54,490][123091] Updated weights for policy 0, policy_version 387761 (0.0009) [2023-12-26 02:40:54,553][123091] Updated weights for policy 0, policy_version 387771 (0.0010) [2023-12-26 02:40:54,604][123091] Updated weights for policy 0, policy_version 387781 (0.0009) [2023-12-26 02:40:54,653][123091] Updated weights for policy 0, policy_version 387792 (0.0009) [2023-12-26 02:40:55,280][123090] Updated weights for policy 1, policy_version 385541 (0.0009) [2023-12-26 02:40:55,325][123090] Updated weights for policy 1, policy_version 385551 (0.0005) [2023-12-26 02:40:55,370][123090] Updated weights for policy 1, policy_version 385561 (0.0005) [2023-12-26 02:40:55,490][123091] Updated weights for policy 0, policy_version 387802 (0.0010) [2023-12-26 02:40:55,539][123091] Updated weights for policy 0, policy_version 387812 (0.0009) [2023-12-26 02:40:55,588][123091] Updated weights for policy 0, policy_version 387822 (0.0009) [2023-12-26 02:40:56,182][123090] Updated weights for policy 1, policy_version 385571 (0.0007) [2023-12-26 02:40:56,238][123090] Updated weights for policy 1, policy_version 385581 (0.0009) [2023-12-26 02:40:56,303][123090] Updated weights for policy 1, policy_version 385591 (0.0010) [2023-12-26 02:40:56,461][123091] Updated weights for policy 0, policy_version 387832 (0.0009) [2023-12-26 02:40:56,522][123091] Updated weights for policy 0, policy_version 387842 (0.0010) [2023-12-26 02:40:56,586][123091] Updated weights for policy 0, policy_version 387852 (0.0010) [2023-12-26 02:40:57,109][123090] Updated weights for policy 1, policy_version 385601 (0.0010) [2023-12-26 02:40:57,163][123090] Updated weights for policy 1, policy_version 385611 (0.0009) [2023-12-26 02:40:57,218][123090] Updated weights for policy 1, policy_version 385621 (0.0010) [2023-12-26 02:40:57,266][123090] Updated weights for policy 1, policy_version 385631 (0.0009) [2023-12-26 02:40:57,394][123091] Updated weights for policy 0, policy_version 387862 (0.0009) [2023-12-26 02:40:57,458][123091] Updated weights for policy 0, policy_version 387872 (0.0009) [2023-12-26 02:40:57,522][123091] Updated weights for policy 0, policy_version 387882 (0.0009) [2023-12-26 02:40:58,020][123090] Updated weights for policy 1, policy_version 385641 (0.0007) [2023-12-26 02:40:58,085][123090] Updated weights for policy 1, policy_version 385651 (0.0007) [2023-12-26 02:40:58,149][123090] Updated weights for policy 1, policy_version 385661 (0.0006) [2023-12-26 02:40:58,379][123091] Updated weights for policy 0, policy_version 387892 (0.0009) [2023-12-26 02:40:58,439][123091] Updated weights for policy 0, policy_version 387902 (0.0009) [2023-12-26 02:40:58,513][123091] Updated weights for policy 0, policy_version 387912 (0.0010) [2023-12-26 02:40:58,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 198041600. Throughput: 0: 8654.5, 1: 8926.9. Samples: 198035448. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:40:58,785][121949] Avg episode reward: [(0, '6298.554'), (1, '5631.936')] [2023-12-26 02:40:59,019][123090] Updated weights for policy 1, policy_version 385671 (0.0008) [2023-12-26 02:40:59,081][123090] Updated weights for policy 1, policy_version 385681 (0.0010) [2023-12-26 02:40:59,135][123090] Updated weights for policy 1, policy_version 385691 (0.0009) [2023-12-26 02:40:59,361][123091] Updated weights for policy 0, policy_version 387922 (0.0009) [2023-12-26 02:40:59,423][123091] Updated weights for policy 0, policy_version 387932 (0.0006) [2023-12-26 02:40:59,486][123091] Updated weights for policy 0, policy_version 387942 (0.0011) [2023-12-26 02:40:59,556][123091] Updated weights for policy 0, policy_version 387952 (0.0010) [2023-12-26 02:40:59,929][123090] Updated weights for policy 1, policy_version 385701 (0.0008) [2023-12-26 02:40:59,992][123090] Updated weights for policy 1, policy_version 385711 (0.0007) [2023-12-26 02:41:00,058][123090] Updated weights for policy 1, policy_version 385721 (0.0006) [2023-12-26 02:41:00,258][123091] Updated weights for policy 0, policy_version 387962 (0.0006) [2023-12-26 02:41:00,308][123091] Updated weights for policy 0, policy_version 387972 (0.0010) [2023-12-26 02:41:00,367][123091] Updated weights for policy 0, policy_version 387982 (0.0010) [2023-12-26 02:41:00,802][123090] Updated weights for policy 1, policy_version 385731 (0.0008) [2023-12-26 02:41:00,867][123090] Updated weights for policy 1, policy_version 385741 (0.0005) [2023-12-26 02:41:00,925][123090] Updated weights for policy 1, policy_version 385751 (0.0006) [2023-12-26 02:41:01,075][123091] Updated weights for policy 0, policy_version 387992 (0.0008) [2023-12-26 02:41:01,137][123091] Updated weights for policy 0, policy_version 388002 (0.0007) [2023-12-26 02:41:01,202][123091] Updated weights for policy 0, policy_version 388012 (0.0009) [2023-12-26 02:41:01,753][123090] Updated weights for policy 1, policy_version 385761 (0.0009) [2023-12-26 02:41:01,812][123090] Updated weights for policy 1, policy_version 385771 (0.0009) [2023-12-26 02:41:01,874][123090] Updated weights for policy 1, policy_version 385781 (0.0010) [2023-12-26 02:41:01,926][123090] Updated weights for policy 1, policy_version 385792 (0.0010) [2023-12-26 02:41:01,952][123091] Updated weights for policy 0, policy_version 388022 (0.0008) [2023-12-26 02:41:02,001][123091] Updated weights for policy 0, policy_version 388032 (0.0008) [2023-12-26 02:41:02,056][123091] Updated weights for policy 0, policy_version 388042 (0.0009) [2023-12-26 02:41:02,782][123090] Updated weights for policy 1, policy_version 385802 (0.0010) [2023-12-26 02:41:02,834][123090] Updated weights for policy 1, policy_version 385812 (0.0010) [2023-12-26 02:41:02,868][123091] Updated weights for policy 0, policy_version 388052 (0.0009) [2023-12-26 02:41:02,886][123090] Updated weights for policy 1, policy_version 385822 (0.0010) [2023-12-26 02:41:02,925][123091] Updated weights for policy 0, policy_version 388062 (0.0006) [2023-12-26 02:41:02,983][123091] Updated weights for policy 0, policy_version 388072 (0.0006) [2023-12-26 02:41:03,650][123090] Updated weights for policy 1, policy_version 385832 (0.0006) [2023-12-26 02:41:03,654][123091] Updated weights for policy 0, policy_version 388082 (0.0006) [2023-12-26 02:41:03,699][123090] Updated weights for policy 1, policy_version 385842 (0.0005) [2023-12-26 02:41:03,711][123091] Updated weights for policy 0, policy_version 388092 (0.0005) [2023-12-26 02:41:03,758][123090] Updated weights for policy 1, policy_version 385852 (0.0005) [2023-12-26 02:41:03,764][123091] Updated weights for policy 0, policy_version 388102 (0.0005) [2023-12-26 02:41:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 198131712. Throughput: 0: 8641.0, 1: 9029.0. Samples: 198144128. Policy #0 lag: (min: 29.0, avg: 35.7, max: 61.0) [2023-12-26 02:41:03,785][121949] Avg episode reward: [(0, '5922.604'), (1, '5852.524')] [2023-12-26 02:41:03,814][123091] Updated weights for policy 0, policy_version 388112 (0.0005) [2023-12-26 02:41:04,530][123091] Updated weights for policy 0, policy_version 388122 (0.0011) [2023-12-26 02:41:04,589][123090] Updated weights for policy 1, policy_version 385862 (0.0006) [2023-12-26 02:41:04,595][123091] Updated weights for policy 0, policy_version 388132 (0.0011) [2023-12-26 02:41:04,642][123090] Updated weights for policy 1, policy_version 385872 (0.0008) [2023-12-26 02:41:04,647][123091] Updated weights for policy 0, policy_version 388142 (0.0011) [2023-12-26 02:41:04,698][123090] Updated weights for policy 1, policy_version 385882 (0.0007) [2023-12-26 02:41:05,473][123091] Updated weights for policy 0, policy_version 388152 (0.0011) [2023-12-26 02:41:05,491][123090] Updated weights for policy 1, policy_version 385892 (0.0008) [2023-12-26 02:41:05,536][123091] Updated weights for policy 0, policy_version 388162 (0.0011) [2023-12-26 02:41:05,544][123090] Updated weights for policy 1, policy_version 385902 (0.0006) [2023-12-26 02:41:05,593][123090] Updated weights for policy 1, policy_version 385912 (0.0010) [2023-12-26 02:41:05,596][123091] Updated weights for policy 0, policy_version 388172 (0.0011) [2023-12-26 02:41:06,437][123091] Updated weights for policy 0, policy_version 388182 (0.0011) [2023-12-26 02:41:06,474][123090] Updated weights for policy 1, policy_version 385922 (0.0007) [2023-12-26 02:41:06,508][123091] Updated weights for policy 0, policy_version 388192 (0.0011) [2023-12-26 02:41:06,541][123090] Updated weights for policy 1, policy_version 385932 (0.0008) [2023-12-26 02:41:06,572][123091] Updated weights for policy 0, policy_version 388202 (0.0011) [2023-12-26 02:41:06,605][123090] Updated weights for policy 1, policy_version 385942 (0.0009) [2023-12-26 02:41:06,668][123090] Updated weights for policy 1, policy_version 385952 (0.0009) [2023-12-26 02:41:07,327][123091] Updated weights for policy 0, policy_version 388212 (0.0011) [2023-12-26 02:41:07,379][123091] Updated weights for policy 0, policy_version 388222 (0.0010) [2023-12-26 02:41:07,423][123091] Updated weights for policy 0, policy_version 388232 (0.0010) [2023-12-26 02:41:07,523][123090] Updated weights for policy 1, policy_version 385962 (0.0006) [2023-12-26 02:41:07,579][123090] Updated weights for policy 1, policy_version 385972 (0.0006) [2023-12-26 02:41:07,646][123090] Updated weights for policy 1, policy_version 385982 (0.0006) [2023-12-26 02:41:08,187][123091] Updated weights for policy 0, policy_version 388242 (0.0008) [2023-12-26 02:41:08,256][123091] Updated weights for policy 0, policy_version 388252 (0.0009) [2023-12-26 02:41:08,310][123091] Updated weights for policy 0, policy_version 388262 (0.0009) [2023-12-26 02:41:08,377][123091] Updated weights for policy 0, policy_version 388272 (0.0007) [2023-12-26 02:41:08,385][123090] Updated weights for policy 1, policy_version 385992 (0.0010) [2023-12-26 02:41:08,456][123090] Updated weights for policy 1, policy_version 386002 (0.0011) [2023-12-26 02:41:08,512][123090] Updated weights for policy 1, policy_version 386012 (0.0010) [2023-12-26 02:41:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 198221824. Throughput: 0: 8681.4, 1: 9031.7. Samples: 198196436. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:08,785][121949] Avg episode reward: [(0, '5941.890'), (1, '5939.826')] [2023-12-26 02:41:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000388272_99401728.pth... [2023-12-26 02:41:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000386016_98820096.pth... [2023-12-26 02:41:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000387280_99147776.pth [2023-12-26 02:41:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000384960_98549760.pth [2023-12-26 02:41:09,100][123091] Updated weights for policy 0, policy_version 388282 (0.0007) [2023-12-26 02:41:09,160][123091] Updated weights for policy 0, policy_version 388292 (0.0006) [2023-12-26 02:41:09,227][123091] Updated weights for policy 0, policy_version 388302 (0.0006) [2023-12-26 02:41:09,308][123090] Updated weights for policy 1, policy_version 386022 (0.0010) [2023-12-26 02:41:09,377][123090] Updated weights for policy 1, policy_version 386032 (0.0010) [2023-12-26 02:41:09,440][123090] Updated weights for policy 1, policy_version 386042 (0.0011) [2023-12-26 02:41:09,918][123091] Updated weights for policy 0, policy_version 388312 (0.0010) [2023-12-26 02:41:09,983][123091] Updated weights for policy 0, policy_version 388322 (0.0010) [2023-12-26 02:41:10,040][123091] Updated weights for policy 0, policy_version 388332 (0.0010) [2023-12-26 02:41:10,192][123090] Updated weights for policy 1, policy_version 386052 (0.0009) [2023-12-26 02:41:10,263][123090] Updated weights for policy 1, policy_version 386062 (0.0007) [2023-12-26 02:41:10,328][123090] Updated weights for policy 1, policy_version 386072 (0.0009) [2023-12-26 02:41:10,757][123091] Updated weights for policy 0, policy_version 388342 (0.0010) [2023-12-26 02:41:10,810][123091] Updated weights for policy 0, policy_version 388352 (0.0011) [2023-12-26 02:41:10,869][123091] Updated weights for policy 0, policy_version 388362 (0.0011) [2023-12-26 02:41:10,956][123090] Updated weights for policy 1, policy_version 386082 (0.0008) [2023-12-26 02:41:11,021][123090] Updated weights for policy 1, policy_version 386092 (0.0006) [2023-12-26 02:41:11,091][123090] Updated weights for policy 1, policy_version 386102 (0.0010) [2023-12-26 02:41:11,160][123090] Updated weights for policy 1, policy_version 386112 (0.0009) [2023-12-26 02:41:11,737][123091] Updated weights for policy 0, policy_version 388372 (0.0010) [2023-12-26 02:41:11,799][123091] Updated weights for policy 0, policy_version 388382 (0.0008) [2023-12-26 02:41:11,865][123091] Updated weights for policy 0, policy_version 388392 (0.0006) [2023-12-26 02:41:11,930][123090] Updated weights for policy 1, policy_version 386122 (0.0006) [2023-12-26 02:41:12,003][123090] Updated weights for policy 1, policy_version 386132 (0.0007) [2023-12-26 02:41:12,065][123090] Updated weights for policy 1, policy_version 386142 (0.0009) [2023-12-26 02:41:12,737][123091] Updated weights for policy 0, policy_version 388402 (0.0008) [2023-12-26 02:41:12,802][123091] Updated weights for policy 0, policy_version 388412 (0.0011) [2023-12-26 02:41:12,838][123090] Updated weights for policy 1, policy_version 386152 (0.0007) [2023-12-26 02:41:12,855][123091] Updated weights for policy 0, policy_version 388422 (0.0011) [2023-12-26 02:41:12,898][123090] Updated weights for policy 1, policy_version 386162 (0.0006) [2023-12-26 02:41:12,919][123091] Updated weights for policy 0, policy_version 388432 (0.0011) [2023-12-26 02:41:12,959][123090] Updated weights for policy 1, policy_version 386172 (0.0007) [2023-12-26 02:41:13,644][123090] Updated weights for policy 1, policy_version 386182 (0.0006) [2023-12-26 02:41:13,707][123090] Updated weights for policy 1, policy_version 386192 (0.0005) [2023-12-26 02:41:13,754][123091] Updated weights for policy 0, policy_version 388442 (0.0011) [2023-12-26 02:41:13,777][123090] Updated weights for policy 1, policy_version 386202 (0.0005) [2023-12-26 02:41:13,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 198303744. Throughput: 0: 8583.6, 1: 8997.6. Samples: 198304056. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:13,786][121949] Avg episode reward: [(0, '6006.736'), (1, '5902.888')] [2023-12-26 02:41:13,809][123091] Updated weights for policy 0, policy_version 388452 (0.0010) [2023-12-26 02:41:13,859][123091] Updated weights for policy 0, policy_version 388462 (0.0010) [2023-12-26 02:41:14,535][123090] Updated weights for policy 1, policy_version 386212 (0.0007) [2023-12-26 02:41:14,598][123090] Updated weights for policy 1, policy_version 386222 (0.0007) [2023-12-26 02:41:14,659][123090] Updated weights for policy 1, policy_version 386232 (0.0005) [2023-12-26 02:41:14,684][123091] Updated weights for policy 0, policy_version 388472 (0.0008) [2023-12-26 02:41:14,733][123091] Updated weights for policy 0, policy_version 388483 (0.0009) [2023-12-26 02:41:14,796][123091] Updated weights for policy 0, policy_version 388494 (0.0009) [2023-12-26 02:41:15,461][123090] Updated weights for policy 1, policy_version 386242 (0.0006) [2023-12-26 02:41:15,527][123090] Updated weights for policy 1, policy_version 386252 (0.0011) [2023-12-26 02:41:15,590][123090] Updated weights for policy 1, policy_version 386262 (0.0011) [2023-12-26 02:41:15,646][123090] Updated weights for policy 1, policy_version 386272 (0.0010) [2023-12-26 02:41:15,666][123091] Updated weights for policy 0, policy_version 388504 (0.0008) [2023-12-26 02:41:15,713][123091] Updated weights for policy 0, policy_version 388514 (0.0009) [2023-12-26 02:41:15,781][123091] Updated weights for policy 0, policy_version 388524 (0.0009) [2023-12-26 02:41:16,468][123090] Updated weights for policy 1, policy_version 386282 (0.0011) [2023-12-26 02:41:16,532][123090] Updated weights for policy 1, policy_version 386292 (0.0011) [2023-12-26 02:41:16,599][123090] Updated weights for policy 1, policy_version 386302 (0.0010) [2023-12-26 02:41:16,629][123091] Updated weights for policy 0, policy_version 388534 (0.0008) [2023-12-26 02:41:16,678][123091] Updated weights for policy 0, policy_version 388544 (0.0009) [2023-12-26 02:41:16,735][123091] Updated weights for policy 0, policy_version 388555 (0.0009) [2023-12-26 02:41:17,417][123090] Updated weights for policy 1, policy_version 386312 (0.0010) [2023-12-26 02:41:17,465][123090] Updated weights for policy 1, policy_version 386322 (0.0010) [2023-12-26 02:41:17,520][123090] Updated weights for policy 1, policy_version 386332 (0.0010) [2023-12-26 02:41:17,558][123091] Updated weights for policy 0, policy_version 388565 (0.0008) [2023-12-26 02:41:17,613][123091] Updated weights for policy 0, policy_version 388575 (0.0008) [2023-12-26 02:41:17,674][123091] Updated weights for policy 0, policy_version 388585 (0.0008) [2023-12-26 02:41:18,315][123090] Updated weights for policy 1, policy_version 386342 (0.0010) [2023-12-26 02:41:18,382][123090] Updated weights for policy 1, policy_version 386352 (0.0009) [2023-12-26 02:41:18,396][123091] Updated weights for policy 0, policy_version 388595 (0.0009) [2023-12-26 02:41:18,442][123090] Updated weights for policy 1, policy_version 386362 (0.0007) [2023-12-26 02:41:18,448][123091] Updated weights for policy 0, policy_version 388605 (0.0008) [2023-12-26 02:41:18,496][123091] Updated weights for policy 0, policy_version 388615 (0.0008) [2023-12-26 02:41:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 198402048. Throughput: 0: 8595.3, 1: 8993.9. Samples: 198409772. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:18,785][121949] Avg episode reward: [(0, '5822.084'), (1, '5805.062')] [2023-12-26 02:41:19,112][123090] Updated weights for policy 1, policy_version 386372 (0.0007) [2023-12-26 02:41:19,185][123090] Updated weights for policy 1, policy_version 386382 (0.0009) [2023-12-26 02:41:19,229][123091] Updated weights for policy 0, policy_version 388625 (0.0008) [2023-12-26 02:41:19,250][123090] Updated weights for policy 1, policy_version 386392 (0.0010) [2023-12-26 02:41:19,298][123091] Updated weights for policy 0, policy_version 388635 (0.0008) [2023-12-26 02:41:19,365][123091] Updated weights for policy 0, policy_version 388645 (0.0008) [2023-12-26 02:41:19,430][123091] Updated weights for policy 0, policy_version 388655 (0.0008) [2023-12-26 02:41:20,074][123090] Updated weights for policy 1, policy_version 386402 (0.0009) [2023-12-26 02:41:20,144][123090] Updated weights for policy 1, policy_version 386412 (0.0010) [2023-12-26 02:41:20,201][123090] Updated weights for policy 1, policy_version 386422 (0.0011) [2023-12-26 02:41:20,208][123091] Updated weights for policy 0, policy_version 388665 (0.0007) [2023-12-26 02:41:20,257][123090] Updated weights for policy 1, policy_version 386432 (0.0011) [2023-12-26 02:41:20,272][123091] Updated weights for policy 0, policy_version 388675 (0.0006) [2023-12-26 02:41:20,329][123091] Updated weights for policy 0, policy_version 388685 (0.0009) [2023-12-26 02:41:21,087][123090] Updated weights for policy 1, policy_version 386442 (0.0008) [2023-12-26 02:41:21,155][123090] Updated weights for policy 1, policy_version 386452 (0.0010) [2023-12-26 02:41:21,221][123090] Updated weights for policy 1, policy_version 386462 (0.0006) [2023-12-26 02:41:21,222][123091] Updated weights for policy 0, policy_version 388695 (0.0010) [2023-12-26 02:41:21,284][123091] Updated weights for policy 0, policy_version 388705 (0.0010) [2023-12-26 02:41:21,352][123091] Updated weights for policy 0, policy_version 388715 (0.0010) [2023-12-26 02:41:22,053][123090] Updated weights for policy 1, policy_version 386472 (0.0007) [2023-12-26 02:41:22,118][123090] Updated weights for policy 1, policy_version 386482 (0.0005) [2023-12-26 02:41:22,187][123090] Updated weights for policy 1, policy_version 386492 (0.0005) [2023-12-26 02:41:22,234][123091] Updated weights for policy 0, policy_version 388725 (0.0009) [2023-12-26 02:41:22,290][123091] Updated weights for policy 0, policy_version 388735 (0.0009) [2023-12-26 02:41:22,354][123091] Updated weights for policy 0, policy_version 388745 (0.0009) [2023-12-26 02:41:22,889][123090] Updated weights for policy 1, policy_version 386502 (0.0007) [2023-12-26 02:41:22,953][123090] Updated weights for policy 1, policy_version 386512 (0.0005) [2023-12-26 02:41:23,006][123090] Updated weights for policy 1, policy_version 386522 (0.0006) [2023-12-26 02:41:23,283][123091] Updated weights for policy 0, policy_version 388755 (0.0009) [2023-12-26 02:41:23,335][123091] Updated weights for policy 0, policy_version 388765 (0.0009) [2023-12-26 02:41:23,393][123091] Updated weights for policy 0, policy_version 388775 (0.0009) [2023-12-26 02:41:23,769][123090] Updated weights for policy 1, policy_version 386532 (0.0008) [2023-12-26 02:41:23,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 198483968. Throughput: 0: 8624.2, 1: 8990.6. Samples: 198462652. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:23,785][121949] Avg episode reward: [(0, '6049.939'), (1, '5677.842')] [2023-12-26 02:41:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000388784_99532800.pth... [2023-12-26 02:41:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000387760_99270656.pth [2023-12-26 02:41:23,839][123090] Updated weights for policy 1, policy_version 386542 (0.0010) [2023-12-26 02:41:23,906][123090] Updated weights for policy 1, policy_version 386552 (0.0009) [2023-12-26 02:41:23,956][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000386560_98959360.pth... [2023-12-26 02:41:23,959][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000385504_98689024.pth [2023-12-26 02:41:24,245][123091] Updated weights for policy 0, policy_version 388785 (0.0009) [2023-12-26 02:41:24,300][123091] Updated weights for policy 0, policy_version 388795 (0.0010) [2023-12-26 02:41:24,353][123091] Updated weights for policy 0, policy_version 388805 (0.0009) [2023-12-26 02:41:24,421][123091] Updated weights for policy 0, policy_version 388815 (0.0010) [2023-12-26 02:41:24,632][123090] Updated weights for policy 1, policy_version 386562 (0.0008) [2023-12-26 02:41:24,698][123090] Updated weights for policy 1, policy_version 386572 (0.0005) [2023-12-26 02:41:24,761][123090] Updated weights for policy 1, policy_version 386582 (0.0006) [2023-12-26 02:41:24,832][123090] Updated weights for policy 1, policy_version 386592 (0.0005) [2023-12-26 02:41:25,318][123091] Updated weights for policy 0, policy_version 388825 (0.0010) [2023-12-26 02:41:25,366][123091] Updated weights for policy 0, policy_version 388836 (0.0009) [2023-12-26 02:41:25,425][123091] Updated weights for policy 0, policy_version 388846 (0.0009) [2023-12-26 02:41:25,459][123090] Updated weights for policy 1, policy_version 386602 (0.0009) [2023-12-26 02:41:25,510][123090] Updated weights for policy 1, policy_version 386612 (0.0009) [2023-12-26 02:41:25,569][123090] Updated weights for policy 1, policy_version 386622 (0.0009) [2023-12-26 02:41:26,291][123091] Updated weights for policy 0, policy_version 388856 (0.0010) [2023-12-26 02:41:26,344][123091] Updated weights for policy 0, policy_version 388866 (0.0009) [2023-12-26 02:41:26,361][123090] Updated weights for policy 1, policy_version 386632 (0.0006) [2023-12-26 02:41:26,401][123091] Updated weights for policy 0, policy_version 388876 (0.0009) [2023-12-26 02:41:26,421][123090] Updated weights for policy 1, policy_version 386642 (0.0006) [2023-12-26 02:41:26,479][123090] Updated weights for policy 1, policy_version 386652 (0.0007) [2023-12-26 02:41:27,200][123090] Updated weights for policy 1, policy_version 386662 (0.0007) [2023-12-26 02:41:27,264][123090] Updated weights for policy 1, policy_version 386672 (0.0007) [2023-12-26 02:41:27,298][123091] Updated weights for policy 0, policy_version 388886 (0.0007) [2023-12-26 02:41:27,318][123090] Updated weights for policy 1, policy_version 386682 (0.0007) [2023-12-26 02:41:27,357][123091] Updated weights for policy 0, policy_version 388896 (0.0008) [2023-12-26 02:41:27,417][123091] Updated weights for policy 0, policy_version 388906 (0.0009) [2023-12-26 02:41:28,029][123090] Updated weights for policy 1, policy_version 386692 (0.0007) [2023-12-26 02:41:28,085][123090] Updated weights for policy 1, policy_version 386703 (0.0009) [2023-12-26 02:41:28,135][123090] Updated weights for policy 1, policy_version 386713 (0.0009) [2023-12-26 02:41:28,144][123091] Updated weights for policy 0, policy_version 388916 (0.0007) [2023-12-26 02:41:28,223][123091] Updated weights for policy 0, policy_version 388926 (0.0005) [2023-12-26 02:41:28,302][123091] Updated weights for policy 0, policy_version 388936 (0.0005) [2023-12-26 02:41:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 198574080. Throughput: 0: 8603.7, 1: 9043.9. Samples: 198567920. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:28,784][121949] Avg episode reward: [(0, '6079.022'), (1, '5677.228')] [2023-12-26 02:41:28,950][123090] Updated weights for policy 1, policy_version 386723 (0.0009) [2023-12-26 02:41:28,952][123091] Updated weights for policy 0, policy_version 388946 (0.0006) [2023-12-26 02:41:29,012][123090] Updated weights for policy 1, policy_version 386733 (0.0008) [2023-12-26 02:41:29,014][123091] Updated weights for policy 0, policy_version 388956 (0.0005) [2023-12-26 02:41:29,068][123091] Updated weights for policy 0, policy_version 388966 (0.0006) [2023-12-26 02:41:29,075][123090] Updated weights for policy 1, policy_version 386743 (0.0008) [2023-12-26 02:41:29,125][123091] Updated weights for policy 0, policy_version 388976 (0.0005) [2023-12-26 02:41:29,801][123090] Updated weights for policy 1, policy_version 386753 (0.0009) [2023-12-26 02:41:29,866][123090] Updated weights for policy 1, policy_version 386763 (0.0010) [2023-12-26 02:41:29,904][123091] Updated weights for policy 0, policy_version 388986 (0.0007) [2023-12-26 02:41:29,929][123090] Updated weights for policy 1, policy_version 386773 (0.0009) [2023-12-26 02:41:29,972][123091] Updated weights for policy 0, policy_version 388996 (0.0008) [2023-12-26 02:41:29,992][123090] Updated weights for policy 1, policy_version 386783 (0.0006) [2023-12-26 02:41:30,024][123091] Updated weights for policy 0, policy_version 389006 (0.0009) [2023-12-26 02:41:30,730][123090] Updated weights for policy 1, policy_version 386793 (0.0010) [2023-12-26 02:41:30,792][123090] Updated weights for policy 1, policy_version 386803 (0.0010) [2023-12-26 02:41:30,854][123090] Updated weights for policy 1, policy_version 386813 (0.0010) [2023-12-26 02:41:30,897][123091] Updated weights for policy 0, policy_version 389016 (0.0009) [2023-12-26 02:41:30,946][123091] Updated weights for policy 0, policy_version 389026 (0.0009) [2023-12-26 02:41:31,007][123091] Updated weights for policy 0, policy_version 389036 (0.0009) [2023-12-26 02:41:31,693][123090] Updated weights for policy 1, policy_version 386823 (0.0008) [2023-12-26 02:41:31,756][123090] Updated weights for policy 1, policy_version 386833 (0.0006) [2023-12-26 02:41:31,820][123090] Updated weights for policy 1, policy_version 386843 (0.0007) [2023-12-26 02:41:31,885][123091] Updated weights for policy 0, policy_version 389046 (0.0009) [2023-12-26 02:41:31,943][123091] Updated weights for policy 0, policy_version 389056 (0.0009) [2023-12-26 02:41:32,012][123091] Updated weights for policy 0, policy_version 389066 (0.0010) [2023-12-26 02:41:32,534][123090] Updated weights for policy 1, policy_version 386853 (0.0006) [2023-12-26 02:41:32,597][123090] Updated weights for policy 1, policy_version 386863 (0.0005) [2023-12-26 02:41:32,654][123090] Updated weights for policy 1, policy_version 386873 (0.0005) [2023-12-26 02:41:32,798][123091] Updated weights for policy 0, policy_version 389076 (0.0010) [2023-12-26 02:41:32,851][123091] Updated weights for policy 0, policy_version 389086 (0.0009) [2023-12-26 02:41:32,901][123091] Updated weights for policy 0, policy_version 389096 (0.0009) [2023-12-26 02:41:33,305][123090] Updated weights for policy 1, policy_version 386883 (0.0005) [2023-12-26 02:41:33,358][123090] Updated weights for policy 1, policy_version 386893 (0.0005) [2023-12-26 02:41:33,427][123090] Updated weights for policy 1, policy_version 386903 (0.0005) [2023-12-26 02:41:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 198664192. Throughput: 0: 8676.4, 1: 9050.8. Samples: 198677620. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:33,785][121949] Avg episode reward: [(0, '6006.728'), (1, '5728.902')] [2023-12-26 02:41:33,827][123091] Updated weights for policy 0, policy_version 389107 (0.0010) [2023-12-26 02:41:33,882][123091] Updated weights for policy 0, policy_version 389117 (0.0009) [2023-12-26 02:41:33,937][123091] Updated weights for policy 0, policy_version 389127 (0.0008) [2023-12-26 02:41:34,038][123090] Updated weights for policy 1, policy_version 386913 (0.0005) [2023-12-26 02:41:34,097][123090] Updated weights for policy 1, policy_version 386923 (0.0006) [2023-12-26 02:41:34,163][123090] Updated weights for policy 1, policy_version 386933 (0.0007) [2023-12-26 02:41:34,225][123090] Updated weights for policy 1, policy_version 386943 (0.0008) [2023-12-26 02:41:34,810][123091] Updated weights for policy 0, policy_version 389137 (0.0009) [2023-12-26 02:41:34,864][123091] Updated weights for policy 0, policy_version 389147 (0.0009) [2023-12-26 02:41:34,885][123090] Updated weights for policy 1, policy_version 386953 (0.0007) [2023-12-26 02:41:34,923][123091] Updated weights for policy 0, policy_version 389157 (0.0008) [2023-12-26 02:41:34,951][123090] Updated weights for policy 1, policy_version 386963 (0.0007) [2023-12-26 02:41:34,979][123091] Updated weights for policy 0, policy_version 389167 (0.0009) [2023-12-26 02:41:35,015][123090] Updated weights for policy 1, policy_version 386973 (0.0008) [2023-12-26 02:41:35,692][123090] Updated weights for policy 1, policy_version 386983 (0.0007) [2023-12-26 02:41:35,740][123090] Updated weights for policy 1, policy_version 386993 (0.0008) [2023-12-26 02:41:35,791][123090] Updated weights for policy 1, policy_version 387003 (0.0009) [2023-12-26 02:41:35,852][123091] Updated weights for policy 0, policy_version 389177 (0.0008) [2023-12-26 02:41:35,908][123091] Updated weights for policy 0, policy_version 389187 (0.0009) [2023-12-26 02:41:35,968][123091] Updated weights for policy 0, policy_version 389197 (0.0010) [2023-12-26 02:41:36,677][123090] Updated weights for policy 1, policy_version 387013 (0.0009) [2023-12-26 02:41:36,741][123090] Updated weights for policy 1, policy_version 387023 (0.0010) [2023-12-26 02:41:36,774][123091] Updated weights for policy 0, policy_version 389207 (0.0008) [2023-12-26 02:41:36,806][123090] Updated weights for policy 1, policy_version 387033 (0.0008) [2023-12-26 02:41:36,836][123091] Updated weights for policy 0, policy_version 389217 (0.0008) [2023-12-26 02:41:36,902][123091] Updated weights for policy 0, policy_version 389227 (0.0008) [2023-12-26 02:41:37,574][123090] Updated weights for policy 1, policy_version 387043 (0.0009) [2023-12-26 02:41:37,636][123090] Updated weights for policy 1, policy_version 387053 (0.0009) [2023-12-26 02:41:37,693][123090] Updated weights for policy 1, policy_version 387063 (0.0009) [2023-12-26 02:41:37,767][123091] Updated weights for policy 0, policy_version 389237 (0.0010) [2023-12-26 02:41:37,824][123091] Updated weights for policy 0, policy_version 389247 (0.0009) [2023-12-26 02:41:37,886][123091] Updated weights for policy 0, policy_version 389257 (0.0006) [2023-12-26 02:41:38,507][123090] Updated weights for policy 1, policy_version 387073 (0.0009) [2023-12-26 02:41:38,563][123090] Updated weights for policy 1, policy_version 387083 (0.0010) [2023-12-26 02:41:38,600][123091] Updated weights for policy 0, policy_version 389267 (0.0006) [2023-12-26 02:41:38,629][123090] Updated weights for policy 1, policy_version 387093 (0.0009) [2023-12-26 02:41:38,665][123091] Updated weights for policy 0, policy_version 389277 (0.0008) [2023-12-26 02:41:38,694][123090] Updated weights for policy 1, policy_version 387103 (0.0007) [2023-12-26 02:41:38,718][123091] Updated weights for policy 0, policy_version 389287 (0.0010) [2023-12-26 02:41:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 198762496. Throughput: 0: 8686.4, 1: 9061.5. Samples: 198730496. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:38,785][121949] Avg episode reward: [(0, '5781.750'), (1, '5844.191')] [2023-12-26 02:41:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000387104_99098624.pth... [2023-12-26 02:41:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000389296_99663872.pth... [2023-12-26 02:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000386016_98820096.pth [2023-12-26 02:41:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000388272_99401728.pth [2023-12-26 02:41:39,520][123091] Updated weights for policy 0, policy_version 389297 (0.0009) [2023-12-26 02:41:39,546][123090] Updated weights for policy 1, policy_version 387113 (0.0008) [2023-12-26 02:41:39,580][123091] Updated weights for policy 0, policy_version 389307 (0.0008) [2023-12-26 02:41:39,617][123090] Updated weights for policy 1, policy_version 387123 (0.0008) [2023-12-26 02:41:39,640][123091] Updated weights for policy 0, policy_version 389317 (0.0009) [2023-12-26 02:41:39,679][123090] Updated weights for policy 1, policy_version 387133 (0.0008) [2023-12-26 02:41:39,706][123091] Updated weights for policy 0, policy_version 389327 (0.0009) [2023-12-26 02:41:40,420][123090] Updated weights for policy 1, policy_version 387143 (0.0009) [2023-12-26 02:41:40,489][123090] Updated weights for policy 1, policy_version 387153 (0.0007) [2023-12-26 02:41:40,544][123091] Updated weights for policy 0, policy_version 389337 (0.0008) [2023-12-26 02:41:40,555][123090] Updated weights for policy 1, policy_version 387163 (0.0005) [2023-12-26 02:41:40,597][123091] Updated weights for policy 0, policy_version 389347 (0.0005) [2023-12-26 02:41:40,657][123091] Updated weights for policy 0, policy_version 389357 (0.0005) [2023-12-26 02:41:41,376][123090] Updated weights for policy 1, policy_version 387173 (0.0011) [2023-12-26 02:41:41,443][123090] Updated weights for policy 1, policy_version 387183 (0.0009) [2023-12-26 02:41:41,486][123091] Updated weights for policy 0, policy_version 389367 (0.0006) [2023-12-26 02:41:41,506][123090] Updated weights for policy 1, policy_version 387193 (0.0008) [2023-12-26 02:41:41,551][123091] Updated weights for policy 0, policy_version 389377 (0.0009) [2023-12-26 02:41:41,621][123091] Updated weights for policy 0, policy_version 389387 (0.0010) [2023-12-26 02:41:42,260][123090] Updated weights for policy 1, policy_version 387203 (0.0007) [2023-12-26 02:41:42,329][123090] Updated weights for policy 1, policy_version 387213 (0.0011) [2023-12-26 02:41:42,404][123090] Updated weights for policy 1, policy_version 387223 (0.0010) [2023-12-26 02:41:42,426][123091] Updated weights for policy 0, policy_version 389397 (0.0009) [2023-12-26 02:41:42,480][123091] Updated weights for policy 0, policy_version 389407 (0.0009) [2023-12-26 02:41:42,545][123091] Updated weights for policy 0, policy_version 389417 (0.0009) [2023-12-26 02:41:43,134][123090] Updated weights for policy 1, policy_version 387233 (0.0009) [2023-12-26 02:41:43,199][123090] Updated weights for policy 1, policy_version 387243 (0.0005) [2023-12-26 02:41:43,272][123090] Updated weights for policy 1, policy_version 387253 (0.0005) [2023-12-26 02:41:43,352][123090] Updated weights for policy 1, policy_version 387263 (0.0005) [2023-12-26 02:41:43,403][123091] Updated weights for policy 0, policy_version 389427 (0.0008) [2023-12-26 02:41:43,471][123091] Updated weights for policy 0, policy_version 389437 (0.0005) [2023-12-26 02:41:43,538][123091] Updated weights for policy 0, policy_version 389447 (0.0005) [2023-12-26 02:41:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 198844416. Throughput: 0: 8705.1, 1: 9060.5. Samples: 198834896. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:43,785][121949] Avg episode reward: [(0, '5843.713'), (1, '5776.313')] [2023-12-26 02:41:43,948][123090] Updated weights for policy 1, policy_version 387273 (0.0006) [2023-12-26 02:41:44,003][123090] Updated weights for policy 1, policy_version 387283 (0.0005) [2023-12-26 02:41:44,049][123090] Updated weights for policy 1, policy_version 387293 (0.0010) [2023-12-26 02:41:44,203][123091] Updated weights for policy 0, policy_version 389457 (0.0006) [2023-12-26 02:41:44,269][123091] Updated weights for policy 0, policy_version 389467 (0.0009) [2023-12-26 02:41:44,333][123091] Updated weights for policy 0, policy_version 389477 (0.0009) [2023-12-26 02:41:44,390][123091] Updated weights for policy 0, policy_version 389487 (0.0010) [2023-12-26 02:41:44,830][123090] Updated weights for policy 1, policy_version 387303 (0.0008) [2023-12-26 02:41:44,909][123090] Updated weights for policy 1, policy_version 387313 (0.0006) [2023-12-26 02:41:44,977][123090] Updated weights for policy 1, policy_version 387323 (0.0006) [2023-12-26 02:41:45,156][123091] Updated weights for policy 0, policy_version 389497 (0.0007) [2023-12-26 02:41:45,220][123091] Updated weights for policy 0, policy_version 389507 (0.0006) [2023-12-26 02:41:45,289][123091] Updated weights for policy 0, policy_version 389517 (0.0007) [2023-12-26 02:41:45,674][123090] Updated weights for policy 1, policy_version 387333 (0.0005) [2023-12-26 02:41:45,733][123090] Updated weights for policy 1, policy_version 387343 (0.0005) [2023-12-26 02:41:45,791][123090] Updated weights for policy 1, policy_version 387353 (0.0005) [2023-12-26 02:41:45,954][123091] Updated weights for policy 0, policy_version 389527 (0.0006) [2023-12-26 02:41:46,023][123091] Updated weights for policy 0, policy_version 389537 (0.0006) [2023-12-26 02:41:46,075][123091] Updated weights for policy 0, policy_version 389547 (0.0005) [2023-12-26 02:41:46,437][123090] Updated weights for policy 1, policy_version 387363 (0.0006) [2023-12-26 02:41:46,512][123090] Updated weights for policy 1, policy_version 387373 (0.0005) [2023-12-26 02:41:46,592][123090] Updated weights for policy 1, policy_version 387383 (0.0005) [2023-12-26 02:41:46,752][123091] Updated weights for policy 0, policy_version 389557 (0.0008) [2023-12-26 02:41:46,819][123091] Updated weights for policy 0, policy_version 389567 (0.0011) [2023-12-26 02:41:46,882][123091] Updated weights for policy 0, policy_version 389577 (0.0011) [2023-12-26 02:41:47,316][123090] Updated weights for policy 1, policy_version 387393 (0.0008) [2023-12-26 02:41:47,363][123090] Updated weights for policy 1, policy_version 387403 (0.0010) [2023-12-26 02:41:47,415][123090] Updated weights for policy 1, policy_version 387413 (0.0010) [2023-12-26 02:41:47,462][123090] Updated weights for policy 1, policy_version 387423 (0.0010) [2023-12-26 02:41:47,698][123091] Updated weights for policy 0, policy_version 389587 (0.0011) [2023-12-26 02:41:47,757][123091] Updated weights for policy 0, policy_version 389597 (0.0010) [2023-12-26 02:41:47,823][123091] Updated weights for policy 0, policy_version 389607 (0.0011) [2023-12-26 02:41:48,248][123090] Updated weights for policy 1, policy_version 387433 (0.0006) [2023-12-26 02:41:48,307][123090] Updated weights for policy 1, policy_version 387443 (0.0007) [2023-12-26 02:41:48,375][123090] Updated weights for policy 1, policy_version 387453 (0.0011) [2023-12-26 02:41:48,605][123091] Updated weights for policy 0, policy_version 389617 (0.0011) [2023-12-26 02:41:48,653][123091] Updated weights for policy 0, policy_version 389627 (0.0011) [2023-12-26 02:41:48,704][123091] Updated weights for policy 0, policy_version 389637 (0.0007) [2023-12-26 02:41:48,755][123091] Updated weights for policy 0, policy_version 389647 (0.0011) [2023-12-26 02:41:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 198942720. Throughput: 0: 8741.9, 1: 9181.0. Samples: 198950656. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:48,784][121949] Avg episode reward: [(0, '6031.705'), (1, '5639.099')] [2023-12-26 02:41:49,087][123090] Updated weights for policy 1, policy_version 387463 (0.0006) [2023-12-26 02:41:49,150][123090] Updated weights for policy 1, policy_version 387473 (0.0005) [2023-12-26 02:41:49,219][123090] Updated weights for policy 1, policy_version 387483 (0.0006) [2023-12-26 02:41:49,493][123091] Updated weights for policy 0, policy_version 389657 (0.0010) [2023-12-26 02:41:49,555][123091] Updated weights for policy 0, policy_version 389667 (0.0011) [2023-12-26 02:41:49,618][123091] Updated weights for policy 0, policy_version 389677 (0.0010) [2023-12-26 02:41:49,941][123090] Updated weights for policy 1, policy_version 387493 (0.0008) [2023-12-26 02:41:50,007][123090] Updated weights for policy 1, policy_version 387503 (0.0008) [2023-12-26 02:41:50,064][123090] Updated weights for policy 1, policy_version 387513 (0.0010) [2023-12-26 02:41:50,441][123091] Updated weights for policy 0, policy_version 389687 (0.0010) [2023-12-26 02:41:50,506][123091] Updated weights for policy 0, policy_version 389697 (0.0008) [2023-12-26 02:41:50,574][123091] Updated weights for policy 0, policy_version 389707 (0.0009) [2023-12-26 02:41:50,948][123090] Updated weights for policy 1, policy_version 387523 (0.0010) [2023-12-26 02:41:51,010][123090] Updated weights for policy 1, policy_version 387533 (0.0009) [2023-12-26 02:41:51,073][123090] Updated weights for policy 1, policy_version 387543 (0.0010) [2023-12-26 02:41:51,380][123091] Updated weights for policy 0, policy_version 389717 (0.0010) [2023-12-26 02:41:51,439][123091] Updated weights for policy 0, policy_version 389727 (0.0010) [2023-12-26 02:41:51,504][123091] Updated weights for policy 0, policy_version 389737 (0.0011) [2023-12-26 02:41:51,936][123090] Updated weights for policy 1, policy_version 387553 (0.0010) [2023-12-26 02:41:52,001][123090] Updated weights for policy 1, policy_version 387563 (0.0009) [2023-12-26 02:41:52,055][123090] Updated weights for policy 1, policy_version 387573 (0.0009) [2023-12-26 02:41:52,116][123090] Updated weights for policy 1, policy_version 387583 (0.0009) [2023-12-26 02:41:52,335][123091] Updated weights for policy 0, policy_version 389747 (0.0011) [2023-12-26 02:41:52,412][123091] Updated weights for policy 0, policy_version 389757 (0.0011) [2023-12-26 02:41:52,479][123091] Updated weights for policy 0, policy_version 389767 (0.0011) [2023-12-26 02:41:52,978][123090] Updated weights for policy 1, policy_version 387593 (0.0009) [2023-12-26 02:41:53,041][123090] Updated weights for policy 1, policy_version 387603 (0.0009) [2023-12-26 02:41:53,107][123090] Updated weights for policy 1, policy_version 387613 (0.0009) [2023-12-26 02:41:53,293][123091] Updated weights for policy 0, policy_version 389777 (0.0011) [2023-12-26 02:41:53,340][123091] Updated weights for policy 0, policy_version 389787 (0.0010) [2023-12-26 02:41:53,392][123091] Updated weights for policy 0, policy_version 389797 (0.0010) [2023-12-26 02:41:53,446][123091] Updated weights for policy 0, policy_version 389807 (0.0011) [2023-12-26 02:41:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 199024640. Throughput: 0: 8730.8, 1: 9185.1. Samples: 199002656. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:53,785][121949] Avg episode reward: [(0, '6056.036'), (1, '5673.946')] [2023-12-26 02:41:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000389808_99794944.pth... [2023-12-26 02:41:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000387616_99229696.pth... [2023-12-26 02:41:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000388784_99532800.pth [2023-12-26 02:41:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000386560_98959360.pth [2023-12-26 02:41:53,948][123090] Updated weights for policy 1, policy_version 387623 (0.0009) [2023-12-26 02:41:54,011][123090] Updated weights for policy 1, policy_version 387633 (0.0009) [2023-12-26 02:41:54,072][123090] Updated weights for policy 1, policy_version 387643 (0.0009) [2023-12-26 02:41:54,298][123091] Updated weights for policy 0, policy_version 389817 (0.0009) [2023-12-26 02:41:54,351][123091] Updated weights for policy 0, policy_version 389827 (0.0009) [2023-12-26 02:41:54,403][123091] Updated weights for policy 0, policy_version 389837 (0.0009) [2023-12-26 02:41:54,937][123090] Updated weights for policy 1, policy_version 387653 (0.0009) [2023-12-26 02:41:55,005][123090] Updated weights for policy 1, policy_version 387663 (0.0010) [2023-12-26 02:41:55,075][123090] Updated weights for policy 1, policy_version 387673 (0.0010) [2023-12-26 02:41:55,229][123091] Updated weights for policy 0, policy_version 389847 (0.0010) [2023-12-26 02:41:55,292][123091] Updated weights for policy 0, policy_version 389857 (0.0009) [2023-12-26 02:41:55,362][123091] Updated weights for policy 0, policy_version 389867 (0.0005) [2023-12-26 02:41:55,985][123090] Updated weights for policy 1, policy_version 387683 (0.0010) [2023-12-26 02:41:55,990][123091] Updated weights for policy 0, policy_version 389877 (0.0010) [2023-12-26 02:41:56,041][123091] Updated weights for policy 0, policy_version 389887 (0.0009) [2023-12-26 02:41:56,051][123090] Updated weights for policy 1, policy_version 387693 (0.0006) [2023-12-26 02:41:56,103][123091] Updated weights for policy 0, policy_version 389898 (0.0008) [2023-12-26 02:41:56,118][123090] Updated weights for policy 1, policy_version 387703 (0.0007) [2023-12-26 02:41:56,855][123091] Updated weights for policy 0, policy_version 389908 (0.0007) [2023-12-26 02:41:56,925][123091] Updated weights for policy 0, policy_version 389918 (0.0006) [2023-12-26 02:41:56,976][123090] Updated weights for policy 1, policy_version 387713 (0.0007) [2023-12-26 02:41:56,989][123091] Updated weights for policy 0, policy_version 389928 (0.0006) [2023-12-26 02:41:57,039][123090] Updated weights for policy 1, policy_version 387723 (0.0007) [2023-12-26 02:41:57,091][123090] Updated weights for policy 1, policy_version 387733 (0.0009) [2023-12-26 02:41:57,140][123090] Updated weights for policy 1, policy_version 387743 (0.0008) [2023-12-26 02:41:57,684][123091] Updated weights for policy 0, policy_version 389938 (0.0009) [2023-12-26 02:41:57,748][123091] Updated weights for policy 0, policy_version 389948 (0.0005) [2023-12-26 02:41:57,803][123091] Updated weights for policy 0, policy_version 389958 (0.0005) [2023-12-26 02:41:57,859][123091] Updated weights for policy 0, policy_version 389968 (0.0005) [2023-12-26 02:41:58,036][123090] Updated weights for policy 1, policy_version 387753 (0.0009) [2023-12-26 02:41:58,105][123090] Updated weights for policy 1, policy_version 387763 (0.0006) [2023-12-26 02:41:58,177][123090] Updated weights for policy 1, policy_version 387773 (0.0008) [2023-12-26 02:41:58,583][123091] Updated weights for policy 0, policy_version 389978 (0.0011) [2023-12-26 02:41:58,651][123091] Updated weights for policy 0, policy_version 389988 (0.0010) [2023-12-26 02:41:58,719][123091] Updated weights for policy 0, policy_version 389998 (0.0010) [2023-12-26 02:41:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 199114752. Throughput: 0: 8742.1, 1: 9079.7. Samples: 199106032. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:41:58,785][121949] Avg episode reward: [(0, '6217.597'), (1, '5768.268')] [2023-12-26 02:41:59,000][123090] Updated weights for policy 1, policy_version 387783 (0.0009) [2023-12-26 02:41:59,055][123090] Updated weights for policy 1, policy_version 387793 (0.0009) [2023-12-26 02:41:59,115][123090] Updated weights for policy 1, policy_version 387803 (0.0008) [2023-12-26 02:41:59,553][123091] Updated weights for policy 0, policy_version 390008 (0.0006) [2023-12-26 02:41:59,604][123091] Updated weights for policy 0, policy_version 390018 (0.0005) [2023-12-26 02:41:59,653][123091] Updated weights for policy 0, policy_version 390028 (0.0005) [2023-12-26 02:42:00,005][123090] Updated weights for policy 1, policy_version 387813 (0.0009) [2023-12-26 02:42:00,077][123090] Updated weights for policy 1, policy_version 387823 (0.0005) [2023-12-26 02:42:00,147][123090] Updated weights for policy 1, policy_version 387833 (0.0009) [2023-12-26 02:42:00,407][123091] Updated weights for policy 0, policy_version 390038 (0.0008) [2023-12-26 02:42:00,460][123091] Updated weights for policy 0, policy_version 390048 (0.0009) [2023-12-26 02:42:00,517][123091] Updated weights for policy 0, policy_version 390058 (0.0009) [2023-12-26 02:42:00,947][123090] Updated weights for policy 1, policy_version 387843 (0.0009) [2023-12-26 02:42:01,001][123090] Updated weights for policy 1, policy_version 387853 (0.0009) [2023-12-26 02:42:01,062][123090] Updated weights for policy 1, policy_version 387863 (0.0009) [2023-12-26 02:42:01,367][123091] Updated weights for policy 0, policy_version 390068 (0.0010) [2023-12-26 02:42:01,437][123091] Updated weights for policy 0, policy_version 390078 (0.0009) [2023-12-26 02:42:01,491][123091] Updated weights for policy 0, policy_version 390088 (0.0007) [2023-12-26 02:42:01,938][123090] Updated weights for policy 1, policy_version 387873 (0.0009) [2023-12-26 02:42:01,993][123090] Updated weights for policy 1, policy_version 387883 (0.0008) [2023-12-26 02:42:02,052][123090] Updated weights for policy 1, policy_version 387893 (0.0010) [2023-12-26 02:42:02,112][123090] Updated weights for policy 1, policy_version 387903 (0.0009) [2023-12-26 02:42:02,274][123091] Updated weights for policy 0, policy_version 390098 (0.0010) [2023-12-26 02:42:02,337][123091] Updated weights for policy 0, policy_version 390108 (0.0008) [2023-12-26 02:42:02,403][123091] Updated weights for policy 0, policy_version 390118 (0.0008) [2023-12-26 02:42:02,465][123091] Updated weights for policy 0, policy_version 390128 (0.0008) [2023-12-26 02:42:02,976][123090] Updated weights for policy 1, policy_version 387914 (0.0009) [2023-12-26 02:42:03,035][123090] Updated weights for policy 1, policy_version 387924 (0.0008) [2023-12-26 02:42:03,096][123090] Updated weights for policy 1, policy_version 387934 (0.0009) [2023-12-26 02:42:03,234][123091] Updated weights for policy 0, policy_version 390138 (0.0009) [2023-12-26 02:42:03,285][123091] Updated weights for policy 0, policy_version 390148 (0.0009) [2023-12-26 02:42:03,334][123091] Updated weights for policy 0, policy_version 390158 (0.0009) [2023-12-26 02:42:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 199196672. Throughput: 0: 8763.9, 1: 9001.6. Samples: 199209220. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:42:03,785][121949] Avg episode reward: [(0, '6130.463'), (1, '5865.639')] [2023-12-26 02:42:03,897][123090] Updated weights for policy 1, policy_version 387944 (0.0009) [2023-12-26 02:42:03,959][123090] Updated weights for policy 1, policy_version 387954 (0.0009) [2023-12-26 02:42:04,032][123090] Updated weights for policy 1, policy_version 387964 (0.0009) [2023-12-26 02:42:04,217][123091] Updated weights for policy 0, policy_version 390168 (0.0009) [2023-12-26 02:42:04,294][123091] Updated weights for policy 0, policy_version 390178 (0.0009) [2023-12-26 02:42:04,356][123091] Updated weights for policy 0, policy_version 390188 (0.0010) [2023-12-26 02:42:04,788][123090] Updated weights for policy 1, policy_version 387974 (0.0007) [2023-12-26 02:42:04,839][123090] Updated weights for policy 1, policy_version 387984 (0.0005) [2023-12-26 02:42:04,894][123090] Updated weights for policy 1, policy_version 387994 (0.0005) [2023-12-26 02:42:05,162][123091] Updated weights for policy 0, policy_version 390198 (0.0007) [2023-12-26 02:42:05,209][123091] Updated weights for policy 0, policy_version 390208 (0.0005) [2023-12-26 02:42:05,257][123091] Updated weights for policy 0, policy_version 390218 (0.0005) [2023-12-26 02:42:05,567][123090] Updated weights for policy 1, policy_version 388004 (0.0006) [2023-12-26 02:42:05,633][123090] Updated weights for policy 1, policy_version 388014 (0.0006) [2023-12-26 02:42:05,696][123090] Updated weights for policy 1, policy_version 388024 (0.0005) [2023-12-26 02:42:06,027][123091] Updated weights for policy 0, policy_version 390228 (0.0005) [2023-12-26 02:42:06,080][123091] Updated weights for policy 0, policy_version 390238 (0.0006) [2023-12-26 02:42:06,149][123091] Updated weights for policy 0, policy_version 390248 (0.0008) [2023-12-26 02:42:06,369][123090] Updated weights for policy 1, policy_version 388034 (0.0006) [2023-12-26 02:42:06,424][123090] Updated weights for policy 1, policy_version 388044 (0.0008) [2023-12-26 02:42:06,485][123090] Updated weights for policy 1, policy_version 388054 (0.0009) [2023-12-26 02:42:06,555][123090] Updated weights for policy 1, policy_version 388064 (0.0009) [2023-12-26 02:42:06,981][123091] Updated weights for policy 0, policy_version 390258 (0.0010) [2023-12-26 02:42:07,045][123091] Updated weights for policy 0, policy_version 390268 (0.0011) [2023-12-26 02:42:07,109][123091] Updated weights for policy 0, policy_version 390278 (0.0011) [2023-12-26 02:42:07,172][123091] Updated weights for policy 0, policy_version 390288 (0.0011) [2023-12-26 02:42:07,411][123090] Updated weights for policy 1, policy_version 388074 (0.0008) [2023-12-26 02:42:07,475][123090] Updated weights for policy 1, policy_version 388084 (0.0009) [2023-12-26 02:42:07,535][123090] Updated weights for policy 1, policy_version 388094 (0.0009) [2023-12-26 02:42:08,003][123091] Updated weights for policy 0, policy_version 390298 (0.0011) [2023-12-26 02:42:08,070][123091] Updated weights for policy 0, policy_version 390308 (0.0011) [2023-12-26 02:42:08,139][123091] Updated weights for policy 0, policy_version 390318 (0.0011) [2023-12-26 02:42:08,374][123090] Updated weights for policy 1, policy_version 388104 (0.0009) [2023-12-26 02:42:08,435][123090] Updated weights for policy 1, policy_version 388114 (0.0009) [2023-12-26 02:42:08,504][123090] Updated weights for policy 1, policy_version 388124 (0.0006) [2023-12-26 02:42:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 199286784. Throughput: 0: 8770.6, 1: 9051.2. Samples: 199264632. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:42:08,785][121949] Avg episode reward: [(0, '5865.837'), (1, '5835.209')] [2023-12-26 02:42:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000388128_99360768.pth... [2023-12-26 02:42:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000390320_99926016.pth... [2023-12-26 02:42:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000387104_99098624.pth [2023-12-26 02:42:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000389296_99663872.pth [2023-12-26 02:42:08,939][123091] Updated weights for policy 0, policy_version 390328 (0.0011) [2023-12-26 02:42:09,001][123091] Updated weights for policy 0, policy_version 390338 (0.0011) [2023-12-26 02:42:09,063][123091] Updated weights for policy 0, policy_version 390348 (0.0011) [2023-12-26 02:42:09,286][123090] Updated weights for policy 1, policy_version 388134 (0.0007) [2023-12-26 02:42:09,354][123090] Updated weights for policy 1, policy_version 388144 (0.0008) [2023-12-26 02:42:09,428][123090] Updated weights for policy 1, policy_version 388154 (0.0010) [2023-12-26 02:42:09,897][123091] Updated weights for policy 0, policy_version 390358 (0.0010) [2023-12-26 02:42:09,956][123091] Updated weights for policy 0, policy_version 390368 (0.0010) [2023-12-26 02:42:10,009][123091] Updated weights for policy 0, policy_version 390378 (0.0010) [2023-12-26 02:42:10,222][123090] Updated weights for policy 1, policy_version 388164 (0.0008) [2023-12-26 02:42:10,271][123090] Updated weights for policy 1, policy_version 388174 (0.0009) [2023-12-26 02:42:10,320][123090] Updated weights for policy 1, policy_version 388184 (0.0009) [2023-12-26 02:42:10,892][123091] Updated weights for policy 0, policy_version 390388 (0.0011) [2023-12-26 02:42:10,958][123091] Updated weights for policy 0, policy_version 390398 (0.0011) [2023-12-26 02:42:11,025][123091] Updated weights for policy 0, policy_version 390408 (0.0010) [2023-12-26 02:42:11,265][123090] Updated weights for policy 1, policy_version 388194 (0.0009) [2023-12-26 02:42:11,335][123090] Updated weights for policy 1, policy_version 388204 (0.0009) [2023-12-26 02:42:11,410][123090] Updated weights for policy 1, policy_version 388214 (0.0009) [2023-12-26 02:42:11,475][123090] Updated weights for policy 1, policy_version 388224 (0.0009) [2023-12-26 02:42:11,872][123091] Updated weights for policy 0, policy_version 390418 (0.0011) [2023-12-26 02:42:11,928][123091] Updated weights for policy 0, policy_version 390428 (0.0011) [2023-12-26 02:42:11,988][123091] Updated weights for policy 0, policy_version 390438 (0.0011) [2023-12-26 02:42:12,041][123091] Updated weights for policy 0, policy_version 390448 (0.0011) [2023-12-26 02:42:12,307][123090] Updated weights for policy 1, policy_version 388234 (0.0009) [2023-12-26 02:42:12,372][123090] Updated weights for policy 1, policy_version 388244 (0.0009) [2023-12-26 02:42:12,425][123090] Updated weights for policy 1, policy_version 388254 (0.0009) [2023-12-26 02:42:12,878][123091] Updated weights for policy 0, policy_version 390458 (0.0010) [2023-12-26 02:42:12,940][123091] Updated weights for policy 0, policy_version 390468 (0.0010) [2023-12-26 02:42:12,987][123091] Updated weights for policy 0, policy_version 390478 (0.0010) [2023-12-26 02:42:13,260][123090] Updated weights for policy 1, policy_version 388264 (0.0008) [2023-12-26 02:42:13,312][123090] Updated weights for policy 1, policy_version 388274 (0.0009) [2023-12-26 02:42:13,368][123090] Updated weights for policy 1, policy_version 388284 (0.0008) [2023-12-26 02:42:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 199368704. Throughput: 0: 8813.6, 1: 8908.7. Samples: 199365428. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:42:13,785][121949] Avg episode reward: [(0, '5848.248'), (1, '5645.726')] [2023-12-26 02:42:13,823][123091] Updated weights for policy 0, policy_version 390488 (0.0011) [2023-12-26 02:42:13,883][123091] Updated weights for policy 0, policy_version 390498 (0.0011) [2023-12-26 02:42:13,949][123091] Updated weights for policy 0, policy_version 390508 (0.0010) [2023-12-26 02:42:14,226][123090] Updated weights for policy 1, policy_version 388294 (0.0009) [2023-12-26 02:42:14,278][123090] Updated weights for policy 1, policy_version 388304 (0.0008) [2023-12-26 02:42:14,329][123090] Updated weights for policy 1, policy_version 388314 (0.0008) [2023-12-26 02:42:14,768][123091] Updated weights for policy 0, policy_version 390518 (0.0010) [2023-12-26 02:42:14,826][123091] Updated weights for policy 0, policy_version 390528 (0.0011) [2023-12-26 02:42:14,877][123091] Updated weights for policy 0, policy_version 390538 (0.0010) [2023-12-26 02:42:15,173][123090] Updated weights for policy 1, policy_version 388324 (0.0009) [2023-12-26 02:42:15,229][123090] Updated weights for policy 1, policy_version 388334 (0.0009) [2023-12-26 02:42:15,286][123090] Updated weights for policy 1, policy_version 388344 (0.0009) [2023-12-26 02:42:15,699][123091] Updated weights for policy 0, policy_version 390548 (0.0008) [2023-12-26 02:42:15,761][123091] Updated weights for policy 0, policy_version 390558 (0.0005) [2023-12-26 02:42:15,826][123091] Updated weights for policy 0, policy_version 390568 (0.0007) [2023-12-26 02:42:16,131][123090] Updated weights for policy 1, policy_version 388354 (0.0009) [2023-12-26 02:42:16,198][123090] Updated weights for policy 1, policy_version 388364 (0.0010) [2023-12-26 02:42:16,261][123090] Updated weights for policy 1, policy_version 388374 (0.0009) [2023-12-26 02:42:16,324][123090] Updated weights for policy 1, policy_version 388384 (0.0010) [2023-12-26 02:42:16,594][123091] Updated weights for policy 0, policy_version 390578 (0.0008) [2023-12-26 02:42:16,659][123091] Updated weights for policy 0, policy_version 390588 (0.0005) [2023-12-26 02:42:16,707][123091] Updated weights for policy 0, policy_version 390598 (0.0005) [2023-12-26 02:42:16,759][123091] Updated weights for policy 0, policy_version 390608 (0.0005) [2023-12-26 02:42:17,199][123090] Updated weights for policy 1, policy_version 388394 (0.0009) [2023-12-26 02:42:17,261][123090] Updated weights for policy 1, policy_version 388404 (0.0009) [2023-12-26 02:42:17,312][123090] Updated weights for policy 1, policy_version 388414 (0.0008) [2023-12-26 02:42:17,469][123091] Updated weights for policy 0, policy_version 390618 (0.0010) [2023-12-26 02:42:17,532][123091] Updated weights for policy 0, policy_version 390628 (0.0007) [2023-12-26 02:42:17,598][123091] Updated weights for policy 0, policy_version 390638 (0.0006) [2023-12-26 02:42:18,191][123090] Updated weights for policy 1, policy_version 388424 (0.0009) [2023-12-26 02:42:18,254][123090] Updated weights for policy 1, policy_version 388434 (0.0010) [2023-12-26 02:42:18,310][123090] Updated weights for policy 1, policy_version 388444 (0.0009) [2023-12-26 02:42:18,383][123091] Updated weights for policy 0, policy_version 390648 (0.0008) [2023-12-26 02:42:18,441][123091] Updated weights for policy 0, policy_version 390658 (0.0009) [2023-12-26 02:42:18,496][123091] Updated weights for policy 0, policy_version 390668 (0.0010) [2023-12-26 02:42:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 199458816. Throughput: 0: 8826.9, 1: 8756.8. Samples: 199468884. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:42:18,784][121949] Avg episode reward: [(0, '5997.594'), (1, '5593.263')] [2023-12-26 02:42:19,138][123090] Updated weights for policy 1, policy_version 388454 (0.0009) [2023-12-26 02:42:19,193][123090] Updated weights for policy 1, policy_version 388464 (0.0009) [2023-12-26 02:42:19,267][123090] Updated weights for policy 1, policy_version 388474 (0.0010) [2023-12-26 02:42:19,365][123091] Updated weights for policy 0, policy_version 390678 (0.0009) [2023-12-26 02:42:19,425][123091] Updated weights for policy 0, policy_version 390688 (0.0010) [2023-12-26 02:42:19,491][123091] Updated weights for policy 0, policy_version 390698 (0.0010) [2023-12-26 02:42:20,086][123090] Updated weights for policy 1, policy_version 388484 (0.0009) [2023-12-26 02:42:20,146][123090] Updated weights for policy 1, policy_version 388494 (0.0009) [2023-12-26 02:42:20,210][123090] Updated weights for policy 1, policy_version 388504 (0.0009) [2023-12-26 02:42:20,347][123091] Updated weights for policy 0, policy_version 390708 (0.0010) [2023-12-26 02:42:20,409][123091] Updated weights for policy 0, policy_version 390718 (0.0009) [2023-12-26 02:42:20,469][123091] Updated weights for policy 0, policy_version 390728 (0.0009) [2023-12-26 02:42:21,073][123090] Updated weights for policy 1, policy_version 388514 (0.0010) [2023-12-26 02:42:21,146][123090] Updated weights for policy 1, policy_version 388524 (0.0011) [2023-12-26 02:42:21,216][123090] Updated weights for policy 1, policy_version 388534 (0.0008) [2023-12-26 02:42:21,272][123090] Updated weights for policy 1, policy_version 388544 (0.0010) [2023-12-26 02:42:21,340][123091] Updated weights for policy 0, policy_version 390738 (0.0009) [2023-12-26 02:42:21,413][123091] Updated weights for policy 0, policy_version 390748 (0.0009) [2023-12-26 02:42:21,478][123091] Updated weights for policy 0, policy_version 390758 (0.0009) [2023-12-26 02:42:21,543][123091] Updated weights for policy 0, policy_version 390768 (0.0010) [2023-12-26 02:42:22,151][123090] Updated weights for policy 1, policy_version 388554 (0.0008) [2023-12-26 02:42:22,226][123090] Updated weights for policy 1, policy_version 388564 (0.0009) [2023-12-26 02:42:22,293][123090] Updated weights for policy 1, policy_version 388574 (0.0007) [2023-12-26 02:42:22,401][123091] Updated weights for policy 0, policy_version 390778 (0.0010) [2023-12-26 02:42:22,452][123091] Updated weights for policy 0, policy_version 390788 (0.0010) [2023-12-26 02:42:22,504][123091] Updated weights for policy 0, policy_version 390798 (0.0009) [2023-12-26 02:42:23,016][123090] Updated weights for policy 1, policy_version 388584 (0.0007) [2023-12-26 02:42:23,086][123090] Updated weights for policy 1, policy_version 388594 (0.0007) [2023-12-26 02:42:23,151][123090] Updated weights for policy 1, policy_version 388604 (0.0005) [2023-12-26 02:42:23,405][123091] Updated weights for policy 0, policy_version 390808 (0.0009) [2023-12-26 02:42:23,472][123091] Updated weights for policy 0, policy_version 390818 (0.0010) [2023-12-26 02:42:23,525][123091] Updated weights for policy 0, policy_version 390828 (0.0010) [2023-12-26 02:42:23,731][123090] Updated weights for policy 1, policy_version 388614 (0.0005) [2023-12-26 02:42:23,775][123090] Updated weights for policy 1, policy_version 388624 (0.0005) [2023-12-26 02:42:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199540736. Throughput: 0: 8818.1, 1: 8693.8. Samples: 199518536. Policy #0 lag: (min: 9.0, avg: 34.0, max: 41.0) [2023-12-26 02:42:23,785][121949] Avg episode reward: [(0, '5992.233'), (1, '5533.641')] [2023-12-26 02:42:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000390832_100057088.pth... [2023-12-26 02:42:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000389808_99794944.pth [2023-12-26 02:42:23,823][123090] Updated weights for policy 1, policy_version 388634 (0.0005) [2023-12-26 02:42:23,849][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000388640_99491840.pth... [2023-12-26 02:42:23,852][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000387616_99229696.pth [2023-12-26 02:42:24,433][123091] Updated weights for policy 0, policy_version 390838 (0.0009) [2023-12-26 02:42:24,458][123090] Updated weights for policy 1, policy_version 388644 (0.0005) [2023-12-26 02:42:24,495][123091] Updated weights for policy 0, policy_version 390848 (0.0009) [2023-12-26 02:42:24,518][123090] Updated weights for policy 1, policy_version 388654 (0.0005) [2023-12-26 02:42:24,558][123091] Updated weights for policy 0, policy_version 390858 (0.0008) [2023-12-26 02:42:24,581][123090] Updated weights for policy 1, policy_version 388664 (0.0008) [2023-12-26 02:42:25,231][123090] Updated weights for policy 1, policy_version 388674 (0.0009) [2023-12-26 02:42:25,286][123091] Updated weights for policy 0, policy_version 390868 (0.0007) [2023-12-26 02:42:25,293][123090] Updated weights for policy 1, policy_version 388684 (0.0007) [2023-12-26 02:42:25,338][123091] Updated weights for policy 0, policy_version 390878 (0.0007) [2023-12-26 02:42:25,353][123090] Updated weights for policy 1, policy_version 388694 (0.0010) [2023-12-26 02:42:25,393][123091] Updated weights for policy 0, policy_version 390888 (0.0008) [2023-12-26 02:42:25,423][123090] Updated weights for policy 1, policy_version 388704 (0.0008) [2023-12-26 02:42:26,211][123090] Updated weights for policy 1, policy_version 388714 (0.0010) [2023-12-26 02:42:26,227][123091] Updated weights for policy 0, policy_version 390898 (0.0008) [2023-12-26 02:42:26,267][123090] Updated weights for policy 1, policy_version 388724 (0.0009) [2023-12-26 02:42:26,284][123091] Updated weights for policy 0, policy_version 390908 (0.0006) [2023-12-26 02:42:26,331][123090] Updated weights for policy 1, policy_version 388734 (0.0009) [2023-12-26 02:42:26,348][123091] Updated weights for policy 0, policy_version 390918 (0.0007) [2023-12-26 02:42:26,406][123091] Updated weights for policy 0, policy_version 390928 (0.0009) [2023-12-26 02:42:27,138][123090] Updated weights for policy 1, policy_version 388744 (0.0006) [2023-12-26 02:42:27,186][123091] Updated weights for policy 0, policy_version 390938 (0.0011) [2023-12-26 02:42:27,206][123090] Updated weights for policy 1, policy_version 388754 (0.0006) [2023-12-26 02:42:27,244][123091] Updated weights for policy 0, policy_version 390948 (0.0009) [2023-12-26 02:42:27,255][123090] Updated weights for policy 1, policy_version 388764 (0.0008) [2023-12-26 02:42:27,310][123091] Updated weights for policy 0, policy_version 390958 (0.0010) [2023-12-26 02:42:27,992][123090] Updated weights for policy 1, policy_version 388774 (0.0007) [2023-12-26 02:42:28,034][123091] Updated weights for policy 0, policy_version 390968 (0.0007) [2023-12-26 02:42:28,056][123090] Updated weights for policy 1, policy_version 388784 (0.0005) [2023-12-26 02:42:28,096][123091] Updated weights for policy 0, policy_version 390978 (0.0006) [2023-12-26 02:42:28,112][123090] Updated weights for policy 1, policy_version 388794 (0.0006) [2023-12-26 02:42:28,161][123091] Updated weights for policy 0, policy_version 390988 (0.0006) [2023-12-26 02:42:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 199630848. Throughput: 0: 8817.9, 1: 8776.4. Samples: 199626640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:28,785][121949] Avg episode reward: [(0, '5910.605'), (1, '5504.728')] [2023-12-26 02:42:28,853][123090] Updated weights for policy 1, policy_version 388804 (0.0005) [2023-12-26 02:42:28,910][123090] Updated weights for policy 1, policy_version 388814 (0.0005) [2023-12-26 02:42:28,915][123091] Updated weights for policy 0, policy_version 390998 (0.0005) [2023-12-26 02:42:28,964][123090] Updated weights for policy 1, policy_version 388824 (0.0007) [2023-12-26 02:42:28,987][123091] Updated weights for policy 0, policy_version 391008 (0.0007) [2023-12-26 02:42:29,064][123091] Updated weights for policy 0, policy_version 391018 (0.0010) [2023-12-26 02:42:29,723][123090] Updated weights for policy 1, policy_version 388834 (0.0006) [2023-12-26 02:42:29,768][123091] Updated weights for policy 0, policy_version 391028 (0.0009) [2023-12-26 02:42:29,781][123090] Updated weights for policy 1, policy_version 388844 (0.0006) [2023-12-26 02:42:29,827][123091] Updated weights for policy 0, policy_version 391038 (0.0008) [2023-12-26 02:42:29,843][123090] Updated weights for policy 1, policy_version 388854 (0.0008) [2023-12-26 02:42:29,892][123091] Updated weights for policy 0, policy_version 391048 (0.0010) [2023-12-26 02:42:29,910][123090] Updated weights for policy 1, policy_version 388864 (0.0008) [2023-12-26 02:42:30,636][123090] Updated weights for policy 1, policy_version 388874 (0.0005) [2023-12-26 02:42:30,694][123090] Updated weights for policy 1, policy_version 388884 (0.0008) [2023-12-26 02:42:30,704][123091] Updated weights for policy 0, policy_version 391058 (0.0010) [2023-12-26 02:42:30,745][123090] Updated weights for policy 1, policy_version 388894 (0.0007) [2023-12-26 02:42:30,751][123091] Updated weights for policy 0, policy_version 391068 (0.0010) [2023-12-26 02:42:30,800][123091] Updated weights for policy 0, policy_version 391078 (0.0010) [2023-12-26 02:42:30,858][123091] Updated weights for policy 0, policy_version 391088 (0.0010) [2023-12-26 02:42:31,515][123090] Updated weights for policy 1, policy_version 388904 (0.0008) [2023-12-26 02:42:31,581][123090] Updated weights for policy 1, policy_version 388914 (0.0009) [2023-12-26 02:42:31,650][123090] Updated weights for policy 1, policy_version 388924 (0.0008) [2023-12-26 02:42:31,677][123091] Updated weights for policy 0, policy_version 391098 (0.0007) [2023-12-26 02:42:31,735][123091] Updated weights for policy 0, policy_version 391108 (0.0009) [2023-12-26 02:42:31,799][123091] Updated weights for policy 0, policy_version 391118 (0.0009) [2023-12-26 02:42:32,502][123090] Updated weights for policy 1, policy_version 388934 (0.0009) [2023-12-26 02:42:32,560][123090] Updated weights for policy 1, policy_version 388944 (0.0009) [2023-12-26 02:42:32,607][123091] Updated weights for policy 0, policy_version 391128 (0.0008) [2023-12-26 02:42:32,614][123090] Updated weights for policy 1, policy_version 388954 (0.0009) [2023-12-26 02:42:32,671][123091] Updated weights for policy 0, policy_version 391138 (0.0009) [2023-12-26 02:42:32,733][123091] Updated weights for policy 0, policy_version 391148 (0.0009) [2023-12-26 02:42:33,449][123090] Updated weights for policy 1, policy_version 388964 (0.0010) [2023-12-26 02:42:33,496][123090] Updated weights for policy 1, policy_version 388974 (0.0009) [2023-12-26 02:42:33,540][123091] Updated weights for policy 0, policy_version 391158 (0.0008) [2023-12-26 02:42:33,547][123090] Updated weights for policy 1, policy_version 388984 (0.0008) [2023-12-26 02:42:33,604][123091] Updated weights for policy 0, policy_version 391168 (0.0007) [2023-12-26 02:42:33,652][123091] Updated weights for policy 0, policy_version 391178 (0.0010) [2023-12-26 02:42:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 199729152. Throughput: 0: 8745.8, 1: 8673.1. Samples: 199734512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:33,785][121949] Avg episode reward: [(0, '5860.449'), (1, '5720.671')] [2023-12-26 02:42:34,243][123090] Updated weights for policy 1, policy_version 388994 (0.0009) [2023-12-26 02:42:34,310][123090] Updated weights for policy 1, policy_version 389004 (0.0008) [2023-12-26 02:42:34,374][123090] Updated weights for policy 1, policy_version 389014 (0.0008) [2023-12-26 02:42:34,436][123090] Updated weights for policy 1, policy_version 389024 (0.0008) [2023-12-26 02:42:34,465][123091] Updated weights for policy 0, policy_version 391188 (0.0010) [2023-12-26 02:42:34,524][123091] Updated weights for policy 0, policy_version 391198 (0.0010) [2023-12-26 02:42:34,589][123091] Updated weights for policy 0, policy_version 391208 (0.0010) [2023-12-26 02:42:35,205][123090] Updated weights for policy 1, policy_version 389034 (0.0005) [2023-12-26 02:42:35,262][123090] Updated weights for policy 1, policy_version 389044 (0.0008) [2023-12-26 02:42:35,324][123090] Updated weights for policy 1, policy_version 389054 (0.0009) [2023-12-26 02:42:35,426][123091] Updated weights for policy 0, policy_version 391218 (0.0009) [2023-12-26 02:42:35,480][123091] Updated weights for policy 0, policy_version 391228 (0.0009) [2023-12-26 02:42:35,543][123091] Updated weights for policy 0, policy_version 391238 (0.0009) [2023-12-26 02:42:35,601][123091] Updated weights for policy 0, policy_version 391248 (0.0010) [2023-12-26 02:42:36,123][123090] Updated weights for policy 1, policy_version 389064 (0.0010) [2023-12-26 02:42:36,185][123090] Updated weights for policy 1, policy_version 389074 (0.0010) [2023-12-26 02:42:36,249][123090] Updated weights for policy 1, policy_version 389084 (0.0010) [2023-12-26 02:42:36,420][123091] Updated weights for policy 0, policy_version 391258 (0.0006) [2023-12-26 02:42:36,485][123091] Updated weights for policy 0, policy_version 391268 (0.0005) [2023-12-26 02:42:36,539][123091] Updated weights for policy 0, policy_version 391278 (0.0005) [2023-12-26 02:42:37,123][123090] Updated weights for policy 1, policy_version 389094 (0.0009) [2023-12-26 02:42:37,181][123090] Updated weights for policy 1, policy_version 389104 (0.0010) [2023-12-26 02:42:37,234][123091] Updated weights for policy 0, policy_version 391288 (0.0007) [2023-12-26 02:42:37,246][123090] Updated weights for policy 1, policy_version 389114 (0.0007) [2023-12-26 02:42:37,284][123091] Updated weights for policy 0, policy_version 391298 (0.0007) [2023-12-26 02:42:37,344][123091] Updated weights for policy 0, policy_version 391308 (0.0005) [2023-12-26 02:42:38,108][123090] Updated weights for policy 1, policy_version 389124 (0.0008) [2023-12-26 02:42:38,156][123091] Updated weights for policy 0, policy_version 391318 (0.0007) [2023-12-26 02:42:38,170][123090] Updated weights for policy 1, policy_version 389134 (0.0007) [2023-12-26 02:42:38,218][123091] Updated weights for policy 0, policy_version 391328 (0.0010) [2023-12-26 02:42:38,233][123090] Updated weights for policy 1, policy_version 389144 (0.0006) [2023-12-26 02:42:38,269][123091] Updated weights for policy 0, policy_version 391338 (0.0010) [2023-12-26 02:42:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 199811072. Throughput: 0: 8749.0, 1: 8707.2. Samples: 199788184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:38,785][121949] Avg episode reward: [(0, '6029.058'), (1, '5694.286')] [2023-12-26 02:42:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000389152_99622912.pth... [2023-12-26 02:42:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000391344_100188160.pth... [2023-12-26 02:42:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000388128_99360768.pth [2023-12-26 02:42:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000390320_99926016.pth [2023-12-26 02:42:39,049][123091] Updated weights for policy 0, policy_version 391348 (0.0011) [2023-12-26 02:42:39,078][123090] Updated weights for policy 1, policy_version 389154 (0.0006) [2023-12-26 02:42:39,121][123091] Updated weights for policy 0, policy_version 391358 (0.0007) [2023-12-26 02:42:39,139][123090] Updated weights for policy 1, policy_version 389164 (0.0010) [2023-12-26 02:42:39,180][123091] Updated weights for policy 0, policy_version 391368 (0.0007) [2023-12-26 02:42:39,199][123090] Updated weights for policy 1, policy_version 389174 (0.0008) [2023-12-26 02:42:39,272][123090] Updated weights for policy 1, policy_version 389184 (0.0009) [2023-12-26 02:42:39,990][123091] Updated weights for policy 0, policy_version 391378 (0.0009) [2023-12-26 02:42:40,056][123091] Updated weights for policy 0, policy_version 391388 (0.0010) [2023-12-26 02:42:40,124][123091] Updated weights for policy 0, policy_version 391398 (0.0010) [2023-12-26 02:42:40,161][123090] Updated weights for policy 1, policy_version 389194 (0.0006) [2023-12-26 02:42:40,188][123091] Updated weights for policy 0, policy_version 391408 (0.0011) [2023-12-26 02:42:40,224][123090] Updated weights for policy 1, policy_version 389204 (0.0008) [2023-12-26 02:42:40,283][123090] Updated weights for policy 1, policy_version 389214 (0.0009) [2023-12-26 02:42:40,938][123091] Updated weights for policy 0, policy_version 391418 (0.0009) [2023-12-26 02:42:40,997][123091] Updated weights for policy 0, policy_version 391428 (0.0010) [2023-12-26 02:42:41,061][123091] Updated weights for policy 0, policy_version 391438 (0.0009) [2023-12-26 02:42:41,175][123090] Updated weights for policy 1, policy_version 389224 (0.0009) [2023-12-26 02:42:41,236][123090] Updated weights for policy 1, policy_version 389234 (0.0009) [2023-12-26 02:42:41,304][123090] Updated weights for policy 1, policy_version 389244 (0.0010) [2023-12-26 02:42:42,021][123091] Updated weights for policy 0, policy_version 391448 (0.0010) [2023-12-26 02:42:42,081][123091] Updated weights for policy 0, policy_version 391458 (0.0008) [2023-12-26 02:42:42,083][123090] Updated weights for policy 1, policy_version 389254 (0.0008) [2023-12-26 02:42:42,135][123091] Updated weights for policy 0, policy_version 391468 (0.0008) [2023-12-26 02:42:42,140][123090] Updated weights for policy 1, policy_version 389264 (0.0007) [2023-12-26 02:42:42,208][123090] Updated weights for policy 1, policy_version 389274 (0.0006) [2023-12-26 02:42:42,982][123090] Updated weights for policy 1, policy_version 389284 (0.0006) [2023-12-26 02:42:42,988][123091] Updated weights for policy 0, policy_version 391478 (0.0010) [2023-12-26 02:42:43,046][123091] Updated weights for policy 0, policy_version 391488 (0.0009) [2023-12-26 02:42:43,048][123090] Updated weights for policy 1, policy_version 389294 (0.0007) [2023-12-26 02:42:43,109][123091] Updated weights for policy 0, policy_version 391498 (0.0010) [2023-12-26 02:42:43,109][123090] Updated weights for policy 1, policy_version 389304 (0.0009) [2023-12-26 02:42:43,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 199892992. Throughput: 0: 8711.0, 1: 8730.7. Samples: 199890908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:43,784][121949] Avg episode reward: [(0, '6186.719'), (1, '5565.259')] [2023-12-26 02:42:43,928][123091] Updated weights for policy 0, policy_version 391508 (0.0009) [2023-12-26 02:42:43,934][123090] Updated weights for policy 1, policy_version 389314 (0.0007) [2023-12-26 02:42:43,994][123091] Updated weights for policy 0, policy_version 391518 (0.0008) [2023-12-26 02:42:44,000][123090] Updated weights for policy 1, policy_version 389324 (0.0010) [2023-12-26 02:42:44,054][123091] Updated weights for policy 0, policy_version 391528 (0.0008) [2023-12-26 02:42:44,063][123090] Updated weights for policy 1, policy_version 389334 (0.0010) [2023-12-26 02:42:44,128][123090] Updated weights for policy 1, policy_version 389344 (0.0010) [2023-12-26 02:42:44,783][123091] Updated weights for policy 0, policy_version 391538 (0.0008) [2023-12-26 02:42:44,853][123091] Updated weights for policy 0, policy_version 391548 (0.0009) [2023-12-26 02:42:44,925][123091] Updated weights for policy 0, policy_version 391558 (0.0010) [2023-12-26 02:42:44,969][123090] Updated weights for policy 1, policy_version 389354 (0.0006) [2023-12-26 02:42:44,984][123091] Updated weights for policy 0, policy_version 391568 (0.0009) [2023-12-26 02:42:45,041][123090] Updated weights for policy 1, policy_version 389364 (0.0006) [2023-12-26 02:42:45,115][123090] Updated weights for policy 1, policy_version 389374 (0.0006) [2023-12-26 02:42:45,741][123090] Updated weights for policy 1, policy_version 389384 (0.0008) [2023-12-26 02:42:45,797][123090] Updated weights for policy 1, policy_version 389394 (0.0005) [2023-12-26 02:42:45,836][123091] Updated weights for policy 0, policy_version 391578 (0.0006) [2023-12-26 02:42:45,867][123090] Updated weights for policy 1, policy_version 389404 (0.0008) [2023-12-26 02:42:45,895][123091] Updated weights for policy 0, policy_version 391588 (0.0006) [2023-12-26 02:42:45,975][123091] Updated weights for policy 0, policy_version 391598 (0.0006) [2023-12-26 02:42:46,578][123090] Updated weights for policy 1, policy_version 389414 (0.0007) [2023-12-26 02:42:46,623][123090] Updated weights for policy 1, policy_version 389424 (0.0005) [2023-12-26 02:42:46,674][123090] Updated weights for policy 1, policy_version 389434 (0.0008) [2023-12-26 02:42:46,803][123091] Updated weights for policy 0, policy_version 391608 (0.0009) [2023-12-26 02:42:46,868][123091] Updated weights for policy 0, policy_version 391618 (0.0010) [2023-12-26 02:42:46,925][123091] Updated weights for policy 0, policy_version 391628 (0.0008) [2023-12-26 02:42:47,406][123090] Updated weights for policy 1, policy_version 389444 (0.0008) [2023-12-26 02:42:47,487][123090] Updated weights for policy 1, policy_version 389454 (0.0010) [2023-12-26 02:42:47,562][123090] Updated weights for policy 1, policy_version 389464 (0.0011) [2023-12-26 02:42:47,661][123091] Updated weights for policy 0, policy_version 391638 (0.0006) [2023-12-26 02:42:47,724][123091] Updated weights for policy 0, policy_version 391648 (0.0011) [2023-12-26 02:42:47,779][123091] Updated weights for policy 0, policy_version 391658 (0.0011) [2023-12-26 02:42:48,338][123090] Updated weights for policy 1, policy_version 389474 (0.0011) [2023-12-26 02:42:48,406][123090] Updated weights for policy 1, policy_version 389484 (0.0011) [2023-12-26 02:42:48,466][123090] Updated weights for policy 1, policy_version 389494 (0.0010) [2023-12-26 02:42:48,517][123091] Updated weights for policy 0, policy_version 391668 (0.0011) [2023-12-26 02:42:48,534][123090] Updated weights for policy 1, policy_version 389504 (0.0011) [2023-12-26 02:42:48,583][123091] Updated weights for policy 0, policy_version 391678 (0.0011) [2023-12-26 02:42:48,643][123091] Updated weights for policy 0, policy_version 391688 (0.0011) [2023-12-26 02:42:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 199991296. Throughput: 0: 8707.1, 1: 8832.6. Samples: 199998508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:48,785][121949] Avg episode reward: [(0, '6221.691'), (1, '5518.363')] [2023-12-26 02:42:49,311][123090] Updated weights for policy 1, policy_version 389514 (0.0005) [2023-12-26 02:42:49,369][123090] Updated weights for policy 1, policy_version 389524 (0.0010) [2023-12-26 02:42:49,396][123091] Updated weights for policy 0, policy_version 391698 (0.0010) [2023-12-26 02:42:49,432][123090] Updated weights for policy 1, policy_version 389534 (0.0009) [2023-12-26 02:42:49,452][123091] Updated weights for policy 0, policy_version 391708 (0.0009) [2023-12-26 02:42:49,515][123091] Updated weights for policy 0, policy_version 391718 (0.0009) [2023-12-26 02:42:49,608][123091] Updated weights for policy 0, policy_version 391728 (0.0010) [2023-12-26 02:42:50,157][123090] Updated weights for policy 1, policy_version 389544 (0.0006) [2023-12-26 02:42:50,223][123090] Updated weights for policy 1, policy_version 389554 (0.0007) [2023-12-26 02:42:50,280][123090] Updated weights for policy 1, policy_version 389564 (0.0009) [2023-12-26 02:42:50,435][123091] Updated weights for policy 0, policy_version 391738 (0.0011) [2023-12-26 02:42:50,504][123091] Updated weights for policy 0, policy_version 391748 (0.0010) [2023-12-26 02:42:50,575][123091] Updated weights for policy 0, policy_version 391758 (0.0010) [2023-12-26 02:42:51,115][123090] Updated weights for policy 1, policy_version 389574 (0.0009) [2023-12-26 02:42:51,180][123090] Updated weights for policy 1, policy_version 389584 (0.0008) [2023-12-26 02:42:51,251][123090] Updated weights for policy 1, policy_version 389594 (0.0008) [2023-12-26 02:42:51,321][123091] Updated weights for policy 0, policy_version 391768 (0.0009) [2023-12-26 02:42:51,388][123091] Updated weights for policy 0, policy_version 391778 (0.0009) [2023-12-26 02:42:51,445][123091] Updated weights for policy 0, policy_version 391788 (0.0010) [2023-12-26 02:42:52,005][123090] Updated weights for policy 1, policy_version 389604 (0.0007) [2023-12-26 02:42:52,073][123090] Updated weights for policy 1, policy_version 389614 (0.0006) [2023-12-26 02:42:52,143][123090] Updated weights for policy 1, policy_version 389624 (0.0006) [2023-12-26 02:42:52,338][123091] Updated weights for policy 0, policy_version 391798 (0.0007) [2023-12-26 02:42:52,410][123091] Updated weights for policy 0, policy_version 391808 (0.0007) [2023-12-26 02:42:52,481][123091] Updated weights for policy 0, policy_version 391818 (0.0006) [2023-12-26 02:42:52,918][123090] Updated weights for policy 1, policy_version 389634 (0.0007) [2023-12-26 02:42:52,973][123090] Updated weights for policy 1, policy_version 389644 (0.0009) [2023-12-26 02:42:53,027][123090] Updated weights for policy 1, policy_version 389654 (0.0010) [2023-12-26 02:42:53,081][123090] Updated weights for policy 1, policy_version 389664 (0.0009) [2023-12-26 02:42:53,141][123091] Updated weights for policy 0, policy_version 391828 (0.0007) [2023-12-26 02:42:53,207][123091] Updated weights for policy 0, policy_version 391838 (0.0010) [2023-12-26 02:42:53,265][123091] Updated weights for policy 0, policy_version 391849 (0.0010) [2023-12-26 02:42:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 200073216. Throughput: 0: 8695.8, 1: 8782.7. Samples: 200051164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:53,785][121949] Avg episode reward: [(0, '6289.536'), (1, '5320.737')] [2023-12-26 02:42:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000389664_99753984.pth... [2023-12-26 02:42:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000391856_100319232.pth... [2023-12-26 02:42:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000388640_99491840.pth [2023-12-26 02:42:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000390832_100057088.pth [2023-12-26 02:42:53,956][123090] Updated weights for policy 1, policy_version 389674 (0.0010) [2023-12-26 02:42:54,019][123090] Updated weights for policy 1, policy_version 389684 (0.0010) [2023-12-26 02:42:54,074][123090] Updated weights for policy 1, policy_version 389694 (0.0010) [2023-12-26 02:42:54,100][123091] Updated weights for policy 0, policy_version 391859 (0.0010) [2023-12-26 02:42:54,160][123091] Updated weights for policy 0, policy_version 391869 (0.0011) [2023-12-26 02:42:54,215][123091] Updated weights for policy 0, policy_version 391879 (0.0010) [2023-12-26 02:42:54,879][123090] Updated weights for policy 1, policy_version 389704 (0.0009) [2023-12-26 02:42:54,944][123090] Updated weights for policy 1, policy_version 389714 (0.0008) [2023-12-26 02:42:54,997][123090] Updated weights for policy 1, policy_version 389724 (0.0008) [2023-12-26 02:42:55,029][123091] Updated weights for policy 0, policy_version 391889 (0.0010) [2023-12-26 02:42:55,087][123091] Updated weights for policy 0, policy_version 391899 (0.0011) [2023-12-26 02:42:55,131][123091] Updated weights for policy 0, policy_version 391909 (0.0010) [2023-12-26 02:42:55,193][123091] Updated weights for policy 0, policy_version 391919 (0.0008) [2023-12-26 02:42:55,743][123091] Updated weights for policy 0, policy_version 391929 (0.0007) [2023-12-26 02:42:55,800][123091] Updated weights for policy 0, policy_version 391939 (0.0010) [2023-12-26 02:42:55,848][123090] Updated weights for policy 1, policy_version 389734 (0.0007) [2023-12-26 02:42:55,858][123091] Updated weights for policy 0, policy_version 391949 (0.0010) [2023-12-26 02:42:55,893][123090] Updated weights for policy 1, policy_version 389744 (0.0007) [2023-12-26 02:42:55,941][123090] Updated weights for policy 1, policy_version 389754 (0.0009) [2023-12-26 02:42:56,649][123091] Updated weights for policy 0, policy_version 391959 (0.0010) [2023-12-26 02:42:56,723][123091] Updated weights for policy 0, policy_version 391969 (0.0011) [2023-12-26 02:42:56,798][123091] Updated weights for policy 0, policy_version 391979 (0.0011) [2023-12-26 02:42:56,822][123090] Updated weights for policy 1, policy_version 389764 (0.0007) [2023-12-26 02:42:56,870][123090] Updated weights for policy 1, policy_version 389774 (0.0009) [2023-12-26 02:42:56,918][123090] Updated weights for policy 1, policy_version 389784 (0.0009) [2023-12-26 02:42:57,575][123091] Updated weights for policy 0, policy_version 391989 (0.0011) [2023-12-26 02:42:57,626][123091] Updated weights for policy 0, policy_version 391999 (0.0010) [2023-12-26 02:42:57,677][123091] Updated weights for policy 0, policy_version 392009 (0.0010) [2023-12-26 02:42:57,749][123090] Updated weights for policy 1, policy_version 389794 (0.0009) [2023-12-26 02:42:57,816][123090] Updated weights for policy 1, policy_version 389804 (0.0009) [2023-12-26 02:42:57,871][123090] Updated weights for policy 1, policy_version 389814 (0.0009) [2023-12-26 02:42:57,934][123090] Updated weights for policy 1, policy_version 389824 (0.0009) [2023-12-26 02:42:58,598][123091] Updated weights for policy 0, policy_version 392019 (0.0010) [2023-12-26 02:42:58,676][123091] Updated weights for policy 0, policy_version 392029 (0.0009) [2023-12-26 02:42:58,742][123091] Updated weights for policy 0, policy_version 392039 (0.0009) [2023-12-26 02:42:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 200155136. Throughput: 0: 8794.3, 1: 8807.0. Samples: 200157484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:42:58,785][121949] Avg episode reward: [(0, '6289.457'), (1, '5192.560')] [2023-12-26 02:42:58,824][123090] Updated weights for policy 1, policy_version 389834 (0.0009) [2023-12-26 02:42:58,896][123090] Updated weights for policy 1, policy_version 389844 (0.0008) [2023-12-26 02:42:58,967][123090] Updated weights for policy 1, policy_version 389854 (0.0008) [2023-12-26 02:42:59,650][123091] Updated weights for policy 0, policy_version 392049 (0.0009) [2023-12-26 02:42:59,710][123091] Updated weights for policy 0, policy_version 392059 (0.0009) [2023-12-26 02:42:59,763][123091] Updated weights for policy 0, policy_version 392069 (0.0007) [2023-12-26 02:42:59,773][123090] Updated weights for policy 1, policy_version 389864 (0.0009) [2023-12-26 02:42:59,813][123091] Updated weights for policy 0, policy_version 392079 (0.0006) [2023-12-26 02:42:59,857][123090] Updated weights for policy 1, policy_version 389874 (0.0010) [2023-12-26 02:42:59,918][123090] Updated weights for policy 1, policy_version 389884 (0.0009) [2023-12-26 02:43:00,606][123091] Updated weights for policy 0, policy_version 392089 (0.0006) [2023-12-26 02:43:00,651][123091] Updated weights for policy 0, policy_version 392099 (0.0005) [2023-12-26 02:43:00,707][123091] Updated weights for policy 0, policy_version 392109 (0.0010) [2023-12-26 02:43:00,734][123090] Updated weights for policy 1, policy_version 389894 (0.0007) [2023-12-26 02:43:00,784][123090] Updated weights for policy 1, policy_version 389904 (0.0005) [2023-12-26 02:43:00,833][123090] Updated weights for policy 1, policy_version 389914 (0.0005) [2023-12-26 02:43:01,502][123091] Updated weights for policy 0, policy_version 392119 (0.0009) [2023-12-26 02:43:01,559][123091] Updated weights for policy 0, policy_version 392129 (0.0006) [2023-12-26 02:43:01,605][123090] Updated weights for policy 1, policy_version 389924 (0.0007) [2023-12-26 02:43:01,611][123091] Updated weights for policy 0, policy_version 392139 (0.0008) [2023-12-26 02:43:01,677][123090] Updated weights for policy 1, policy_version 389934 (0.0008) [2023-12-26 02:43:01,742][123090] Updated weights for policy 1, policy_version 389944 (0.0009) [2023-12-26 02:43:02,441][123091] Updated weights for policy 0, policy_version 392149 (0.0009) [2023-12-26 02:43:02,509][123091] Updated weights for policy 0, policy_version 392159 (0.0009) [2023-12-26 02:43:02,530][123090] Updated weights for policy 1, policy_version 389954 (0.0008) [2023-12-26 02:43:02,576][123091] Updated weights for policy 0, policy_version 392169 (0.0011) [2023-12-26 02:43:02,586][123090] Updated weights for policy 1, policy_version 389964 (0.0006) [2023-12-26 02:43:02,646][123090] Updated weights for policy 1, policy_version 389974 (0.0006) [2023-12-26 02:43:02,708][123090] Updated weights for policy 1, policy_version 389984 (0.0005) [2023-12-26 02:43:03,389][123091] Updated weights for policy 0, policy_version 392179 (0.0009) [2023-12-26 02:43:03,442][123090] Updated weights for policy 1, policy_version 389994 (0.0006) [2023-12-26 02:43:03,448][123091] Updated weights for policy 0, policy_version 392189 (0.0005) [2023-12-26 02:43:03,504][123090] Updated weights for policy 1, policy_version 390004 (0.0007) [2023-12-26 02:43:03,510][123091] Updated weights for policy 0, policy_version 392199 (0.0006) [2023-12-26 02:43:03,566][123090] Updated weights for policy 1, policy_version 390014 (0.0010) [2023-12-26 02:43:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 200253440. Throughput: 0: 8757.4, 1: 8860.2. Samples: 200261680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:03,785][121949] Avg episode reward: [(0, '6226.440'), (1, '4980.715')] [2023-12-26 02:43:04,128][123091] Updated weights for policy 0, policy_version 392209 (0.0005) [2023-12-26 02:43:04,202][123091] Updated weights for policy 0, policy_version 392219 (0.0006) [2023-12-26 02:43:04,250][123090] Updated weights for policy 1, policy_version 390024 (0.0007) [2023-12-26 02:43:04,273][123091] Updated weights for policy 0, policy_version 392229 (0.0006) [2023-12-26 02:43:04,318][123090] Updated weights for policy 1, policy_version 390034 (0.0006) [2023-12-26 02:43:04,346][123091] Updated weights for policy 0, policy_version 392239 (0.0006) [2023-12-26 02:43:04,387][123090] Updated weights for policy 1, policy_version 390044 (0.0006) [2023-12-26 02:43:04,928][123091] Updated weights for policy 0, policy_version 392249 (0.0005) [2023-12-26 02:43:04,982][123091] Updated weights for policy 0, policy_version 392259 (0.0005) [2023-12-26 02:43:05,042][123091] Updated weights for policy 0, policy_version 392269 (0.0005) [2023-12-26 02:43:05,106][123090] Updated weights for policy 1, policy_version 390054 (0.0010) [2023-12-26 02:43:05,163][123090] Updated weights for policy 1, policy_version 390064 (0.0009) [2023-12-26 02:43:05,225][123090] Updated weights for policy 1, policy_version 390075 (0.0010) [2023-12-26 02:43:05,701][123091] Updated weights for policy 0, policy_version 392279 (0.0005) [2023-12-26 02:43:05,759][123091] Updated weights for policy 0, policy_version 392289 (0.0008) [2023-12-26 02:43:05,810][123091] Updated weights for policy 0, policy_version 392299 (0.0010) [2023-12-26 02:43:06,143][123090] Updated weights for policy 1, policy_version 390085 (0.0009) [2023-12-26 02:43:06,212][123090] Updated weights for policy 1, policy_version 390095 (0.0006) [2023-12-26 02:43:06,278][123090] Updated weights for policy 1, policy_version 390105 (0.0006) [2023-12-26 02:43:06,609][123091] Updated weights for policy 0, policy_version 392309 (0.0009) [2023-12-26 02:43:06,675][123091] Updated weights for policy 0, policy_version 392319 (0.0006) [2023-12-26 02:43:06,738][123091] Updated weights for policy 0, policy_version 392329 (0.0006) [2023-12-26 02:43:07,005][123090] Updated weights for policy 1, policy_version 390115 (0.0006) [2023-12-26 02:43:07,057][123090] Updated weights for policy 1, policy_version 390125 (0.0009) [2023-12-26 02:43:07,113][123090] Updated weights for policy 1, policy_version 390135 (0.0009) [2023-12-26 02:43:07,486][123091] Updated weights for policy 0, policy_version 392339 (0.0009) [2023-12-26 02:43:07,544][123091] Updated weights for policy 0, policy_version 392349 (0.0011) [2023-12-26 02:43:07,603][123091] Updated weights for policy 0, policy_version 392359 (0.0011) [2023-12-26 02:43:07,926][123090] Updated weights for policy 1, policy_version 390145 (0.0010) [2023-12-26 02:43:07,986][123090] Updated weights for policy 1, policy_version 390155 (0.0010) [2023-12-26 02:43:08,042][123090] Updated weights for policy 1, policy_version 390165 (0.0010) [2023-12-26 02:43:08,102][123090] Updated weights for policy 1, policy_version 390175 (0.0010) [2023-12-26 02:43:08,307][123091] Updated weights for policy 0, policy_version 392369 (0.0011) [2023-12-26 02:43:08,381][123091] Updated weights for policy 0, policy_version 392379 (0.0011) [2023-12-26 02:43:08,444][123091] Updated weights for policy 0, policy_version 392389 (0.0011) [2023-12-26 02:43:08,503][123091] Updated weights for policy 0, policy_version 392399 (0.0011) [2023-12-26 02:43:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 200343552. Throughput: 0: 8886.0, 1: 8894.3. Samples: 200318644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:08,785][121949] Avg episode reward: [(0, '6116.928'), (1, '4825.972')] [2023-12-26 02:43:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000392400_100458496.pth... [2023-12-26 02:43:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000390176_99885056.pth... [2023-12-26 02:43:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000391344_100188160.pth [2023-12-26 02:43:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000389152_99622912.pth [2023-12-26 02:43:08,954][123090] Updated weights for policy 1, policy_version 390185 (0.0010) [2023-12-26 02:43:09,009][123090] Updated weights for policy 1, policy_version 390195 (0.0010) [2023-12-26 02:43:09,060][123090] Updated weights for policy 1, policy_version 390205 (0.0010) [2023-12-26 02:43:09,290][123091] Updated weights for policy 0, policy_version 392409 (0.0007) [2023-12-26 02:43:09,354][123091] Updated weights for policy 0, policy_version 392419 (0.0010) [2023-12-26 02:43:09,419][123091] Updated weights for policy 0, policy_version 392429 (0.0011) [2023-12-26 02:43:09,944][123090] Updated weights for policy 1, policy_version 390215 (0.0009) [2023-12-26 02:43:10,008][123090] Updated weights for policy 1, policy_version 390225 (0.0010) [2023-12-26 02:43:10,076][123090] Updated weights for policy 1, policy_version 390235 (0.0010) [2023-12-26 02:43:10,228][123091] Updated weights for policy 0, policy_version 392439 (0.0009) [2023-12-26 02:43:10,291][123091] Updated weights for policy 0, policy_version 392449 (0.0011) [2023-12-26 02:43:10,351][123091] Updated weights for policy 0, policy_version 392459 (0.0011) [2023-12-26 02:43:10,886][123090] Updated weights for policy 1, policy_version 390245 (0.0011) [2023-12-26 02:43:10,943][123090] Updated weights for policy 1, policy_version 390255 (0.0007) [2023-12-26 02:43:10,989][123090] Updated weights for policy 1, policy_version 390265 (0.0005) [2023-12-26 02:43:11,061][123091] Updated weights for policy 0, policy_version 392469 (0.0009) [2023-12-26 02:43:11,133][123091] Updated weights for policy 0, policy_version 392479 (0.0011) [2023-12-26 02:43:11,200][123091] Updated weights for policy 0, policy_version 392489 (0.0011) [2023-12-26 02:43:11,843][123090] Updated weights for policy 1, policy_version 390275 (0.0007) [2023-12-26 02:43:11,901][123090] Updated weights for policy 1, policy_version 390285 (0.0006) [2023-12-26 02:43:11,963][123090] Updated weights for policy 1, policy_version 390295 (0.0009) [2023-12-26 02:43:12,060][123091] Updated weights for policy 0, policy_version 392499 (0.0011) [2023-12-26 02:43:12,119][123091] Updated weights for policy 0, policy_version 392509 (0.0006) [2023-12-26 02:43:12,180][123091] Updated weights for policy 0, policy_version 392519 (0.0005) [2023-12-26 02:43:12,822][123090] Updated weights for policy 1, policy_version 390305 (0.0009) [2023-12-26 02:43:12,882][123091] Updated weights for policy 0, policy_version 392529 (0.0007) [2023-12-26 02:43:12,887][123090] Updated weights for policy 1, policy_version 390315 (0.0005) [2023-12-26 02:43:12,949][123090] Updated weights for policy 1, policy_version 390325 (0.0005) [2023-12-26 02:43:12,958][123091] Updated weights for policy 0, policy_version 392539 (0.0007) [2023-12-26 02:43:13,011][123091] Updated weights for policy 0, policy_version 392549 (0.0008) [2023-12-26 02:43:13,018][123090] Updated weights for policy 1, policy_version 390335 (0.0007) [2023-12-26 02:43:13,062][123091] Updated weights for policy 0, policy_version 392559 (0.0009) [2023-12-26 02:43:13,681][123090] Updated weights for policy 1, policy_version 390345 (0.0005) [2023-12-26 02:43:13,746][123090] Updated weights for policy 1, policy_version 390355 (0.0005) [2023-12-26 02:43:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 200425472. Throughput: 0: 8940.2, 1: 8778.5. Samples: 200423980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:13,785][121949] Avg episode reward: [(0, '6038.695'), (1, '4947.906')] [2023-12-26 02:43:13,789][123091] Updated weights for policy 0, policy_version 392569 (0.0006) [2023-12-26 02:43:13,823][123090] Updated weights for policy 1, policy_version 390365 (0.0007) [2023-12-26 02:43:13,855][123091] Updated weights for policy 0, policy_version 392579 (0.0007) [2023-12-26 02:43:13,917][123091] Updated weights for policy 0, policy_version 392589 (0.0010) [2023-12-26 02:43:14,447][123090] Updated weights for policy 1, policy_version 390375 (0.0006) [2023-12-26 02:43:14,507][123090] Updated weights for policy 1, policy_version 390385 (0.0006) [2023-12-26 02:43:14,573][123090] Updated weights for policy 1, policy_version 390395 (0.0009) [2023-12-26 02:43:14,700][123091] Updated weights for policy 0, policy_version 392599 (0.0011) [2023-12-26 02:43:14,748][123091] Updated weights for policy 0, policy_version 392609 (0.0010) [2023-12-26 02:43:14,804][123091] Updated weights for policy 0, policy_version 392619 (0.0011) [2023-12-26 02:43:15,401][123090] Updated weights for policy 1, policy_version 390405 (0.0007) [2023-12-26 02:43:15,462][123090] Updated weights for policy 1, policy_version 390415 (0.0006) [2023-12-26 02:43:15,526][123090] Updated weights for policy 1, policy_version 390425 (0.0005) [2023-12-26 02:43:15,622][123091] Updated weights for policy 0, policy_version 392629 (0.0011) [2023-12-26 02:43:15,680][123091] Updated weights for policy 0, policy_version 392639 (0.0010) [2023-12-26 02:43:15,736][123091] Updated weights for policy 0, policy_version 392649 (0.0009) [2023-12-26 02:43:16,279][123090] Updated weights for policy 1, policy_version 390435 (0.0007) [2023-12-26 02:43:16,337][123090] Updated weights for policy 1, policy_version 390445 (0.0009) [2023-12-26 02:43:16,406][123090] Updated weights for policy 1, policy_version 390455 (0.0009) [2023-12-26 02:43:16,553][123091] Updated weights for policy 0, policy_version 392659 (0.0008) [2023-12-26 02:43:16,599][123091] Updated weights for policy 0, policy_version 392669 (0.0005) [2023-12-26 02:43:16,655][123091] Updated weights for policy 0, policy_version 392679 (0.0007) [2023-12-26 02:43:17,304][123090] Updated weights for policy 1, policy_version 390465 (0.0009) [2023-12-26 02:43:17,314][123091] Updated weights for policy 0, policy_version 392689 (0.0006) [2023-12-26 02:43:17,368][123091] Updated weights for policy 0, policy_version 392699 (0.0005) [2023-12-26 02:43:17,371][123090] Updated weights for policy 1, policy_version 390475 (0.0010) [2023-12-26 02:43:17,417][123091] Updated weights for policy 0, policy_version 392709 (0.0005) [2023-12-26 02:43:17,436][123090] Updated weights for policy 1, policy_version 390485 (0.0009) [2023-12-26 02:43:17,464][123091] Updated weights for policy 0, policy_version 392719 (0.0007) [2023-12-26 02:43:17,490][123090] Updated weights for policy 1, policy_version 390495 (0.0009) [2023-12-26 02:43:18,279][123091] Updated weights for policy 0, policy_version 392729 (0.0006) [2023-12-26 02:43:18,290][123090] Updated weights for policy 1, policy_version 390505 (0.0006) [2023-12-26 02:43:18,348][123091] Updated weights for policy 0, policy_version 392739 (0.0007) [2023-12-26 02:43:18,366][123090] Updated weights for policy 1, policy_version 390515 (0.0007) [2023-12-26 02:43:18,408][123091] Updated weights for policy 0, policy_version 392749 (0.0007) [2023-12-26 02:43:18,425][123090] Updated weights for policy 1, policy_version 390525 (0.0008) [2023-12-26 02:43:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 200523776. Throughput: 0: 8978.3, 1: 8783.1. Samples: 200533776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:18,785][121949] Avg episode reward: [(0, '5958.805'), (1, '5080.892')] [2023-12-26 02:43:19,110][123091] Updated weights for policy 0, policy_version 392759 (0.0007) [2023-12-26 02:43:19,166][123091] Updated weights for policy 0, policy_version 392769 (0.0009) [2023-12-26 02:43:19,218][123091] Updated weights for policy 0, policy_version 392779 (0.0008) [2023-12-26 02:43:19,232][123090] Updated weights for policy 1, policy_version 390535 (0.0010) [2023-12-26 02:43:19,299][123090] Updated weights for policy 1, policy_version 390545 (0.0011) [2023-12-26 02:43:19,361][123090] Updated weights for policy 1, policy_version 390555 (0.0011) [2023-12-26 02:43:20,027][123091] Updated weights for policy 0, policy_version 392789 (0.0009) [2023-12-26 02:43:20,093][123091] Updated weights for policy 0, policy_version 392799 (0.0009) [2023-12-26 02:43:20,150][123091] Updated weights for policy 0, policy_version 392809 (0.0009) [2023-12-26 02:43:20,197][123090] Updated weights for policy 1, policy_version 390565 (0.0007) [2023-12-26 02:43:20,259][123090] Updated weights for policy 1, policy_version 390575 (0.0009) [2023-12-26 02:43:20,325][123090] Updated weights for policy 1, policy_version 390585 (0.0009) [2023-12-26 02:43:20,943][123091] Updated weights for policy 0, policy_version 392819 (0.0008) [2023-12-26 02:43:21,021][123091] Updated weights for policy 0, policy_version 392829 (0.0006) [2023-12-26 02:43:21,091][123091] Updated weights for policy 0, policy_version 392839 (0.0007) [2023-12-26 02:43:21,192][123090] Updated weights for policy 1, policy_version 390595 (0.0009) [2023-12-26 02:43:21,261][123090] Updated weights for policy 1, policy_version 390605 (0.0009) [2023-12-26 02:43:21,330][123090] Updated weights for policy 1, policy_version 390615 (0.0009) [2023-12-26 02:43:21,816][123091] Updated weights for policy 0, policy_version 392849 (0.0010) [2023-12-26 02:43:21,872][123091] Updated weights for policy 0, policy_version 392859 (0.0010) [2023-12-26 02:43:21,933][123091] Updated weights for policy 0, policy_version 392869 (0.0010) [2023-12-26 02:43:22,004][123091] Updated weights for policy 0, policy_version 392879 (0.0010) [2023-12-26 02:43:22,224][123090] Updated weights for policy 1, policy_version 390625 (0.0009) [2023-12-26 02:43:22,299][123090] Updated weights for policy 1, policy_version 390635 (0.0010) [2023-12-26 02:43:22,370][123090] Updated weights for policy 1, policy_version 390645 (0.0010) [2023-12-26 02:43:22,437][123090] Updated weights for policy 1, policy_version 390655 (0.0009) [2023-12-26 02:43:22,832][123091] Updated weights for policy 0, policy_version 392889 (0.0009) [2023-12-26 02:43:22,891][123091] Updated weights for policy 0, policy_version 392899 (0.0005) [2023-12-26 02:43:22,960][123091] Updated weights for policy 0, policy_version 392909 (0.0006) [2023-12-26 02:43:23,329][123090] Updated weights for policy 1, policy_version 390665 (0.0011) [2023-12-26 02:43:23,389][123090] Updated weights for policy 1, policy_version 390675 (0.0010) [2023-12-26 02:43:23,456][123090] Updated weights for policy 1, policy_version 390685 (0.0011) [2023-12-26 02:43:23,649][123091] Updated weights for policy 0, policy_version 392919 (0.0005) [2023-12-26 02:43:23,722][123091] Updated weights for policy 0, policy_version 392929 (0.0005) [2023-12-26 02:43:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 200605696. Throughput: 0: 9002.7, 1: 8717.1. Samples: 200585580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:23,785][121949] Avg episode reward: [(0, '6060.858'), (1, '5089.980')] [2023-12-26 02:43:23,788][123091] Updated weights for policy 0, policy_version 392939 (0.0005) [2023-12-26 02:43:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000390688_100016128.pth... [2023-12-26 02:43:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000389664_99753984.pth [2023-12-26 02:43:23,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000392944_100597760.pth... [2023-12-26 02:43:23,832][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000391856_100319232.pth [2023-12-26 02:43:24,274][123090] Updated weights for policy 1, policy_version 390695 (0.0007) [2023-12-26 02:43:24,344][123090] Updated weights for policy 1, policy_version 390705 (0.0008) [2023-12-26 02:43:24,395][123090] Updated weights for policy 1, policy_version 390715 (0.0010) [2023-12-26 02:43:24,406][123091] Updated weights for policy 0, policy_version 392949 (0.0006) [2023-12-26 02:43:24,471][123091] Updated weights for policy 0, policy_version 392959 (0.0008) [2023-12-26 02:43:24,542][123091] Updated weights for policy 0, policy_version 392969 (0.0008) [2023-12-26 02:43:25,039][123090] Updated weights for policy 1, policy_version 390725 (0.0007) [2023-12-26 02:43:25,101][123090] Updated weights for policy 1, policy_version 390735 (0.0005) [2023-12-26 02:43:25,160][123091] Updated weights for policy 0, policy_version 392979 (0.0008) [2023-12-26 02:43:25,162][123090] Updated weights for policy 1, policy_version 390745 (0.0005) [2023-12-26 02:43:25,211][123091] Updated weights for policy 0, policy_version 392989 (0.0010) [2023-12-26 02:43:25,270][123091] Updated weights for policy 0, policy_version 392999 (0.0009) [2023-12-26 02:43:25,828][123090] Updated weights for policy 1, policy_version 390755 (0.0005) [2023-12-26 02:43:25,886][123090] Updated weights for policy 1, policy_version 390765 (0.0005) [2023-12-26 02:43:25,935][123090] Updated weights for policy 1, policy_version 390775 (0.0010) [2023-12-26 02:43:26,021][123091] Updated weights for policy 0, policy_version 393009 (0.0006) [2023-12-26 02:43:26,076][123091] Updated weights for policy 0, policy_version 393019 (0.0011) [2023-12-26 02:43:26,130][123091] Updated weights for policy 0, policy_version 393029 (0.0010) [2023-12-26 02:43:26,180][123091] Updated weights for policy 0, policy_version 393039 (0.0010) [2023-12-26 02:43:26,702][123090] Updated weights for policy 1, policy_version 390785 (0.0007) [2023-12-26 02:43:26,798][123090] Updated weights for policy 1, policy_version 390795 (0.0011) [2023-12-26 02:43:26,866][123090] Updated weights for policy 1, policy_version 390805 (0.0008) [2023-12-26 02:43:26,900][123091] Updated weights for policy 0, policy_version 393049 (0.0007) [2023-12-26 02:43:26,918][123090] Updated weights for policy 1, policy_version 390815 (0.0005) [2023-12-26 02:43:26,958][123091] Updated weights for policy 0, policy_version 393059 (0.0005) [2023-12-26 02:43:27,004][123091] Updated weights for policy 0, policy_version 393069 (0.0005) [2023-12-26 02:43:27,685][123091] Updated weights for policy 0, policy_version 393079 (0.0008) [2023-12-26 02:43:27,725][123090] Updated weights for policy 1, policy_version 390825 (0.0008) [2023-12-26 02:43:27,736][123091] Updated weights for policy 0, policy_version 393089 (0.0008) [2023-12-26 02:43:27,781][123090] Updated weights for policy 1, policy_version 390835 (0.0008) [2023-12-26 02:43:27,788][123091] Updated weights for policy 0, policy_version 393099 (0.0008) [2023-12-26 02:43:27,845][123090] Updated weights for policy 1, policy_version 390845 (0.0009) [2023-12-26 02:43:28,551][123091] Updated weights for policy 0, policy_version 393109 (0.0008) [2023-12-26 02:43:28,607][123091] Updated weights for policy 0, policy_version 393119 (0.0009) [2023-12-26 02:43:28,655][123090] Updated weights for policy 1, policy_version 390855 (0.0010) [2023-12-26 02:43:28,662][123091] Updated weights for policy 0, policy_version 393129 (0.0006) [2023-12-26 02:43:28,714][123090] Updated weights for policy 1, policy_version 390865 (0.0010) [2023-12-26 02:43:28,784][123090] Updated weights for policy 1, policy_version 390875 (0.0010) [2023-12-26 02:43:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 200704000. Throughput: 0: 9150.7, 1: 8810.0. Samples: 200699144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:28,785][121949] Avg episode reward: [(0, '6142.239'), (1, '5291.655')] [2023-12-26 02:43:29,509][123091] Updated weights for policy 0, policy_version 393139 (0.0009) [2023-12-26 02:43:29,572][123091] Updated weights for policy 0, policy_version 393149 (0.0009) [2023-12-26 02:43:29,627][123090] Updated weights for policy 1, policy_version 390885 (0.0009) [2023-12-26 02:43:29,637][123091] Updated weights for policy 0, policy_version 393159 (0.0009) [2023-12-26 02:43:29,690][123090] Updated weights for policy 1, policy_version 390895 (0.0009) [2023-12-26 02:43:29,754][123090] Updated weights for policy 1, policy_version 390905 (0.0009) [2023-12-26 02:43:30,533][123091] Updated weights for policy 0, policy_version 393169 (0.0007) [2023-12-26 02:43:30,554][123090] Updated weights for policy 1, policy_version 390915 (0.0005) [2023-12-26 02:43:30,590][123091] Updated weights for policy 0, policy_version 393179 (0.0008) [2023-12-26 02:43:30,619][123090] Updated weights for policy 1, policy_version 390925 (0.0005) [2023-12-26 02:43:30,645][123091] Updated weights for policy 0, policy_version 393189 (0.0010) [2023-12-26 02:43:30,686][123090] Updated weights for policy 1, policy_version 390935 (0.0005) [2023-12-26 02:43:30,698][123091] Updated weights for policy 0, policy_version 393199 (0.0009) [2023-12-26 02:43:31,425][123090] Updated weights for policy 1, policy_version 390945 (0.0006) [2023-12-26 02:43:31,488][123090] Updated weights for policy 1, policy_version 390955 (0.0010) [2023-12-26 02:43:31,554][123090] Updated weights for policy 1, policy_version 390965 (0.0010) [2023-12-26 02:43:31,603][123091] Updated weights for policy 0, policy_version 393209 (0.0006) [2023-12-26 02:43:31,617][123090] Updated weights for policy 1, policy_version 390975 (0.0011) [2023-12-26 02:43:31,670][123091] Updated weights for policy 0, policy_version 393219 (0.0009) [2023-12-26 02:43:31,734][123091] Updated weights for policy 0, policy_version 393229 (0.0008) [2023-12-26 02:43:32,396][123090] Updated weights for policy 1, policy_version 390985 (0.0007) [2023-12-26 02:43:32,439][123091] Updated weights for policy 0, policy_version 393239 (0.0009) [2023-12-26 02:43:32,461][123090] Updated weights for policy 1, policy_version 390995 (0.0006) [2023-12-26 02:43:32,504][123091] Updated weights for policy 0, policy_version 393249 (0.0009) [2023-12-26 02:43:32,529][123090] Updated weights for policy 1, policy_version 391005 (0.0005) [2023-12-26 02:43:32,578][123091] Updated weights for policy 0, policy_version 393259 (0.0009) [2023-12-26 02:43:33,265][123090] Updated weights for policy 1, policy_version 391015 (0.0009) [2023-12-26 02:43:33,307][123091] Updated weights for policy 0, policy_version 393269 (0.0008) [2023-12-26 02:43:33,320][123090] Updated weights for policy 1, policy_version 391025 (0.0010) [2023-12-26 02:43:33,372][123090] Updated weights for policy 1, policy_version 391035 (0.0010) [2023-12-26 02:43:33,382][123091] Updated weights for policy 0, policy_version 393279 (0.0005) [2023-12-26 02:43:33,453][123091] Updated weights for policy 0, policy_version 393289 (0.0005) [2023-12-26 02:43:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 200794112. Throughput: 0: 9165.4, 1: 8767.8. Samples: 200805504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:33,784][121949] Avg episode reward: [(0, '6088.794'), (1, '5440.178')] [2023-12-26 02:43:34,025][123091] Updated weights for policy 0, policy_version 393299 (0.0007) [2023-12-26 02:43:34,082][123091] Updated weights for policy 0, policy_version 393309 (0.0010) [2023-12-26 02:43:34,147][123091] Updated weights for policy 0, policy_version 393319 (0.0008) [2023-12-26 02:43:34,175][123090] Updated weights for policy 1, policy_version 391045 (0.0010) [2023-12-26 02:43:34,235][123090] Updated weights for policy 1, policy_version 391055 (0.0010) [2023-12-26 02:43:34,303][123090] Updated weights for policy 1, policy_version 391065 (0.0011) [2023-12-26 02:43:34,981][123091] Updated weights for policy 0, policy_version 393329 (0.0007) [2023-12-26 02:43:35,037][123091] Updated weights for policy 0, policy_version 393339 (0.0009) [2023-12-26 02:43:35,089][123091] Updated weights for policy 0, policy_version 393349 (0.0009) [2023-12-26 02:43:35,136][123090] Updated weights for policy 1, policy_version 391075 (0.0011) [2023-12-26 02:43:35,140][123091] Updated weights for policy 0, policy_version 393359 (0.0006) [2023-12-26 02:43:35,197][123090] Updated weights for policy 1, policy_version 391085 (0.0010) [2023-12-26 02:43:35,263][123090] Updated weights for policy 1, policy_version 391095 (0.0010) [2023-12-26 02:43:35,837][123091] Updated weights for policy 0, policy_version 393369 (0.0005) [2023-12-26 02:43:35,885][123091] Updated weights for policy 0, policy_version 393379 (0.0005) [2023-12-26 02:43:35,939][123091] Updated weights for policy 0, policy_version 393389 (0.0005) [2023-12-26 02:43:36,086][123090] Updated weights for policy 1, policy_version 391105 (0.0010) [2023-12-26 02:43:36,152][123090] Updated weights for policy 1, policy_version 391115 (0.0009) [2023-12-26 02:43:36,212][123090] Updated weights for policy 1, policy_version 391125 (0.0010) [2023-12-26 02:43:36,278][123090] Updated weights for policy 1, policy_version 391135 (0.0011) [2023-12-26 02:43:36,720][123091] Updated weights for policy 0, policy_version 393399 (0.0009) [2023-12-26 02:43:36,776][123091] Updated weights for policy 0, policy_version 393409 (0.0010) [2023-12-26 02:43:36,823][123091] Updated weights for policy 0, policy_version 393419 (0.0005) [2023-12-26 02:43:37,108][123090] Updated weights for policy 1, policy_version 391145 (0.0011) [2023-12-26 02:43:37,171][123090] Updated weights for policy 1, policy_version 391155 (0.0011) [2023-12-26 02:43:37,230][123090] Updated weights for policy 1, policy_version 391165 (0.0010) [2023-12-26 02:43:37,536][123091] Updated weights for policy 0, policy_version 393429 (0.0008) [2023-12-26 02:43:37,598][123091] Updated weights for policy 0, policy_version 393439 (0.0011) [2023-12-26 02:43:37,669][123091] Updated weights for policy 0, policy_version 393449 (0.0011) [2023-12-26 02:43:38,040][123090] Updated weights for policy 1, policy_version 391175 (0.0007) [2023-12-26 02:43:38,101][123090] Updated weights for policy 1, policy_version 391185 (0.0005) [2023-12-26 02:43:38,151][123090] Updated weights for policy 1, policy_version 391195 (0.0005) [2023-12-26 02:43:38,466][123091] Updated weights for policy 0, policy_version 393459 (0.0008) [2023-12-26 02:43:38,538][123091] Updated weights for policy 0, policy_version 393469 (0.0010) [2023-12-26 02:43:38,600][123091] Updated weights for policy 0, policy_version 393479 (0.0011) [2023-12-26 02:43:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 200884224. Throughput: 0: 9206.8, 1: 8747.2. Samples: 200859096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:38,784][121949] Avg episode reward: [(0, '6246.623'), (1, '5560.161')] [2023-12-26 02:43:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000393488_100737024.pth... [2023-12-26 02:43:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000392400_100458496.pth [2023-12-26 02:43:38,832][123090] Updated weights for policy 1, policy_version 391205 (0.0007) [2023-12-26 02:43:38,885][123090] Updated weights for policy 1, policy_version 391215 (0.0009) [2023-12-26 02:43:38,938][123090] Updated weights for policy 1, policy_version 391225 (0.0009) [2023-12-26 02:43:38,975][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000391232_100155392.pth... [2023-12-26 02:43:38,980][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000390176_99885056.pth [2023-12-26 02:43:39,365][123091] Updated weights for policy 0, policy_version 393489 (0.0010) [2023-12-26 02:43:39,438][123091] Updated weights for policy 0, policy_version 393499 (0.0008) [2023-12-26 02:43:39,498][123091] Updated weights for policy 0, policy_version 393509 (0.0006) [2023-12-26 02:43:39,564][123091] Updated weights for policy 0, policy_version 393519 (0.0006) [2023-12-26 02:43:39,797][123090] Updated weights for policy 1, policy_version 391235 (0.0009) [2023-12-26 02:43:39,870][123090] Updated weights for policy 1, policy_version 391245 (0.0010) [2023-12-26 02:43:39,940][123090] Updated weights for policy 1, policy_version 391255 (0.0010) [2023-12-26 02:43:40,324][123091] Updated weights for policy 0, policy_version 393529 (0.0006) [2023-12-26 02:43:40,397][123091] Updated weights for policy 0, policy_version 393539 (0.0007) [2023-12-26 02:43:40,468][123091] Updated weights for policy 0, policy_version 393549 (0.0008) [2023-12-26 02:43:40,632][123090] Updated weights for policy 1, policy_version 391265 (0.0006) [2023-12-26 02:43:40,705][123090] Updated weights for policy 1, policy_version 391275 (0.0006) [2023-12-26 02:43:40,765][123090] Updated weights for policy 1, policy_version 391285 (0.0009) [2023-12-26 02:43:40,829][123090] Updated weights for policy 1, policy_version 391295 (0.0009) [2023-12-26 02:43:41,271][123091] Updated weights for policy 0, policy_version 393559 (0.0010) [2023-12-26 02:43:41,338][123091] Updated weights for policy 0, policy_version 393569 (0.0009) [2023-12-26 02:43:41,410][123091] Updated weights for policy 0, policy_version 393579 (0.0008) [2023-12-26 02:43:41,643][123090] Updated weights for policy 1, policy_version 391305 (0.0008) [2023-12-26 02:43:41,717][123090] Updated weights for policy 1, policy_version 391315 (0.0008) [2023-12-26 02:43:41,792][123090] Updated weights for policy 1, policy_version 391325 (0.0009) [2023-12-26 02:43:42,185][123091] Updated weights for policy 0, policy_version 393589 (0.0008) [2023-12-26 02:43:42,251][123091] Updated weights for policy 0, policy_version 393599 (0.0009) [2023-12-26 02:43:42,317][123091] Updated weights for policy 0, policy_version 393609 (0.0009) [2023-12-26 02:43:42,600][123090] Updated weights for policy 1, policy_version 391335 (0.0007) [2023-12-26 02:43:42,667][123090] Updated weights for policy 1, policy_version 391345 (0.0008) [2023-12-26 02:43:42,722][123090] Updated weights for policy 1, policy_version 391355 (0.0009) [2023-12-26 02:43:43,100][123091] Updated weights for policy 0, policy_version 393619 (0.0008) [2023-12-26 02:43:43,167][123091] Updated weights for policy 0, policy_version 393629 (0.0008) [2023-12-26 02:43:43,231][123091] Updated weights for policy 0, policy_version 393639 (0.0009) [2023-12-26 02:43:43,532][123090] Updated weights for policy 1, policy_version 391365 (0.0007) [2023-12-26 02:43:43,583][123090] Updated weights for policy 1, policy_version 391375 (0.0007) [2023-12-26 02:43:43,631][123090] Updated weights for policy 1, policy_version 391385 (0.0007) [2023-12-26 02:43:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 200974336. Throughput: 0: 9174.8, 1: 8777.9. Samples: 200965360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:43:43,785][121949] Avg episode reward: [(0, '6226.282'), (1, '5666.047')] [2023-12-26 02:43:44,018][123091] Updated weights for policy 0, policy_version 393649 (0.0008) [2023-12-26 02:43:44,071][123091] Updated weights for policy 0, policy_version 393659 (0.0005) [2023-12-26 02:43:44,126][123091] Updated weights for policy 0, policy_version 393669 (0.0005) [2023-12-26 02:43:44,177][123091] Updated weights for policy 0, policy_version 393679 (0.0005) [2023-12-26 02:43:44,443][123090] Updated weights for policy 1, policy_version 391395 (0.0006) [2023-12-26 02:43:44,501][123090] Updated weights for policy 1, policy_version 391405 (0.0009) [2023-12-26 02:43:44,560][123090] Updated weights for policy 1, policy_version 391415 (0.0008) [2023-12-26 02:43:44,902][123091] Updated weights for policy 0, policy_version 393689 (0.0008) [2023-12-26 02:43:44,961][123091] Updated weights for policy 0, policy_version 393699 (0.0008) [2023-12-26 02:43:45,013][123091] Updated weights for policy 0, policy_version 393709 (0.0008) [2023-12-26 02:43:45,406][123090] Updated weights for policy 1, policy_version 391425 (0.0010) [2023-12-26 02:43:45,469][123090] Updated weights for policy 1, policy_version 391435 (0.0010) [2023-12-26 02:43:45,528][123090] Updated weights for policy 1, policy_version 391445 (0.0010) [2023-12-26 02:43:45,590][123090] Updated weights for policy 1, policy_version 391455 (0.0010) [2023-12-26 02:43:45,845][123091] Updated weights for policy 0, policy_version 393719 (0.0010) [2023-12-26 02:43:45,892][123091] Updated weights for policy 0, policy_version 393729 (0.0010) [2023-12-26 02:43:45,940][123091] Updated weights for policy 0, policy_version 393739 (0.0010) [2023-12-26 02:43:46,333][123090] Updated weights for policy 1, policy_version 391465 (0.0006) [2023-12-26 02:43:46,389][123090] Updated weights for policy 1, policy_version 391475 (0.0005) [2023-12-26 02:43:46,441][123090] Updated weights for policy 1, policy_version 391485 (0.0005) [2023-12-26 02:43:46,659][123091] Updated weights for policy 0, policy_version 393749 (0.0008) [2023-12-26 02:43:46,720][123091] Updated weights for policy 0, policy_version 393759 (0.0005) [2023-12-26 02:43:46,772][123091] Updated weights for policy 0, policy_version 393769 (0.0006) [2023-12-26 02:43:47,125][123090] Updated weights for policy 1, policy_version 391495 (0.0009) [2023-12-26 02:43:47,188][123090] Updated weights for policy 1, policy_version 391505 (0.0007) [2023-12-26 02:43:47,264][123090] Updated weights for policy 1, policy_version 391515 (0.0010) [2023-12-26 02:43:47,441][123091] Updated weights for policy 0, policy_version 393779 (0.0005) [2023-12-26 02:43:47,516][123091] Updated weights for policy 0, policy_version 393789 (0.0007) [2023-12-26 02:43:47,577][123091] Updated weights for policy 0, policy_version 393799 (0.0008) [2023-12-26 02:43:47,940][123090] Updated weights for policy 1, policy_version 391525 (0.0008) [2023-12-26 02:43:48,009][123090] Updated weights for policy 1, policy_version 391535 (0.0011) [2023-12-26 02:43:48,081][123090] Updated weights for policy 1, policy_version 391545 (0.0011) [2023-12-26 02:43:48,270][123091] Updated weights for policy 0, policy_version 393809 (0.0008) [2023-12-26 02:43:48,341][123091] Updated weights for policy 0, policy_version 393819 (0.0006) [2023-12-26 02:43:48,407][123091] Updated weights for policy 0, policy_version 393829 (0.0008) [2023-12-26 02:43:48,473][123091] Updated weights for policy 0, policy_version 393839 (0.0008) [2023-12-26 02:43:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 201064448. Throughput: 0: 9305.2, 1: 8819.4. Samples: 201077284. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:43:48,785][121949] Avg episode reward: [(0, '6163.536'), (1, '5713.272')] [2023-12-26 02:43:48,894][123090] Updated weights for policy 1, policy_version 391555 (0.0011) [2023-12-26 02:43:48,949][123090] Updated weights for policy 1, policy_version 391565 (0.0010) [2023-12-26 02:43:48,999][123090] Updated weights for policy 1, policy_version 391575 (0.0010) [2023-12-26 02:43:49,037][123091] Updated weights for policy 0, policy_version 393849 (0.0006) [2023-12-26 02:43:49,100][123091] Updated weights for policy 0, policy_version 393859 (0.0009) [2023-12-26 02:43:49,164][123091] Updated weights for policy 0, policy_version 393869 (0.0009) [2023-12-26 02:43:49,856][123090] Updated weights for policy 1, policy_version 391585 (0.0013) [2023-12-26 02:43:49,912][123090] Updated weights for policy 1, policy_version 391595 (0.0009) [2023-12-26 02:43:49,924][123091] Updated weights for policy 0, policy_version 393879 (0.0008) [2023-12-26 02:43:49,970][123090] Updated weights for policy 1, policy_version 391605 (0.0008) [2023-12-26 02:43:49,977][123091] Updated weights for policy 0, policy_version 393889 (0.0010) [2023-12-26 02:43:50,027][123090] Updated weights for policy 1, policy_version 391615 (0.0008) [2023-12-26 02:43:50,038][123091] Updated weights for policy 0, policy_version 393899 (0.0007) [2023-12-26 02:43:50,798][123090] Updated weights for policy 1, policy_version 391625 (0.0009) [2023-12-26 02:43:50,847][123090] Updated weights for policy 1, policy_version 391635 (0.0009) [2023-12-26 02:43:50,901][123090] Updated weights for policy 1, policy_version 391645 (0.0009) [2023-12-26 02:43:50,955][123091] Updated weights for policy 0, policy_version 393909 (0.0007) [2023-12-26 02:43:51,018][123091] Updated weights for policy 0, policy_version 393919 (0.0007) [2023-12-26 02:43:51,086][123091] Updated weights for policy 0, policy_version 393929 (0.0008) [2023-12-26 02:43:51,808][123090] Updated weights for policy 1, policy_version 391655 (0.0009) [2023-12-26 02:43:51,880][123090] Updated weights for policy 1, policy_version 391665 (0.0009) [2023-12-26 02:43:51,921][123091] Updated weights for policy 0, policy_version 393939 (0.0008) [2023-12-26 02:43:51,947][123090] Updated weights for policy 1, policy_version 391675 (0.0009) [2023-12-26 02:43:51,980][123091] Updated weights for policy 0, policy_version 393949 (0.0008) [2023-12-26 02:43:52,042][123091] Updated weights for policy 0, policy_version 393959 (0.0009) [2023-12-26 02:43:52,780][123091] Updated weights for policy 0, policy_version 393969 (0.0009) [2023-12-26 02:43:52,794][123090] Updated weights for policy 1, policy_version 391685 (0.0009) [2023-12-26 02:43:52,840][123091] Updated weights for policy 0, policy_version 393979 (0.0006) [2023-12-26 02:43:52,858][123090] Updated weights for policy 1, policy_version 391695 (0.0011) [2023-12-26 02:43:52,899][123091] Updated weights for policy 0, policy_version 393989 (0.0007) [2023-12-26 02:43:52,926][123090] Updated weights for policy 1, policy_version 391705 (0.0009) [2023-12-26 02:43:52,962][123091] Updated weights for policy 0, policy_version 393999 (0.0010) [2023-12-26 02:43:53,749][123090] Updated weights for policy 1, policy_version 391715 (0.0009) [2023-12-26 02:43:53,754][123091] Updated weights for policy 0, policy_version 394009 (0.0006) [2023-12-26 02:43:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 201146368. Throughput: 0: 9228.0, 1: 8796.6. Samples: 201129748. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:43:53,785][121949] Avg episode reward: [(0, '6135.611'), (1, '5730.634')] [2023-12-26 02:43:53,811][123091] Updated weights for policy 0, policy_version 394019 (0.0006) [2023-12-26 02:43:53,816][123090] Updated weights for policy 1, policy_version 391725 (0.0010) [2023-12-26 02:43:53,865][123091] Updated weights for policy 0, policy_version 394029 (0.0006) [2023-12-26 02:43:53,878][123090] Updated weights for policy 1, policy_version 391735 (0.0010) [2023-12-26 02:43:53,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000394032_100876288.pth... [2023-12-26 02:43:53,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000392944_100597760.pth [2023-12-26 02:43:53,927][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000391744_100286464.pth... [2023-12-26 02:43:53,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000390688_100016128.pth [2023-12-26 02:43:54,539][123091] Updated weights for policy 0, policy_version 394039 (0.0009) [2023-12-26 02:43:54,593][123091] Updated weights for policy 0, policy_version 394049 (0.0010) [2023-12-26 02:43:54,656][123091] Updated weights for policy 0, policy_version 394059 (0.0007) [2023-12-26 02:43:54,696][123090] Updated weights for policy 1, policy_version 391745 (0.0010) [2023-12-26 02:43:54,744][123090] Updated weights for policy 1, policy_version 391755 (0.0008) [2023-12-26 02:43:54,803][123090] Updated weights for policy 1, policy_version 391765 (0.0005) [2023-12-26 02:43:54,855][123090] Updated weights for policy 1, policy_version 391775 (0.0005) [2023-12-26 02:43:55,360][123091] Updated weights for policy 0, policy_version 394069 (0.0005) [2023-12-26 02:43:55,413][123091] Updated weights for policy 0, policy_version 394079 (0.0005) [2023-12-26 02:43:55,465][123091] Updated weights for policy 0, policy_version 394089 (0.0005) [2023-12-26 02:43:55,567][123090] Updated weights for policy 1, policy_version 391785 (0.0005) [2023-12-26 02:43:55,623][123090] Updated weights for policy 1, policy_version 391795 (0.0005) [2023-12-26 02:43:55,678][123090] Updated weights for policy 1, policy_version 391805 (0.0005) [2023-12-26 02:43:56,109][123091] Updated weights for policy 0, policy_version 394099 (0.0006) [2023-12-26 02:43:56,166][123091] Updated weights for policy 0, policy_version 394109 (0.0005) [2023-12-26 02:43:56,214][123091] Updated weights for policy 0, policy_version 394119 (0.0005) [2023-12-26 02:43:56,335][123090] Updated weights for policy 1, policy_version 391815 (0.0005) [2023-12-26 02:43:56,389][123090] Updated weights for policy 1, policy_version 391825 (0.0005) [2023-12-26 02:43:56,440][123090] Updated weights for policy 1, policy_version 391835 (0.0005) [2023-12-26 02:43:56,848][123091] Updated weights for policy 0, policy_version 394129 (0.0005) [2023-12-26 02:43:56,896][123091] Updated weights for policy 0, policy_version 394139 (0.0005) [2023-12-26 02:43:56,954][123091] Updated weights for policy 0, policy_version 394149 (0.0005) [2023-12-26 02:43:57,015][123091] Updated weights for policy 0, policy_version 394159 (0.0005) [2023-12-26 02:43:57,256][123090] Updated weights for policy 1, policy_version 391845 (0.0008) [2023-12-26 02:43:57,300][123090] Updated weights for policy 1, policy_version 391855 (0.0010) [2023-12-26 02:43:57,356][123090] Updated weights for policy 1, policy_version 391865 (0.0009) [2023-12-26 02:43:57,666][123091] Updated weights for policy 0, policy_version 394169 (0.0005) [2023-12-26 02:43:57,721][123091] Updated weights for policy 0, policy_version 394179 (0.0005) [2023-12-26 02:43:57,770][123091] Updated weights for policy 0, policy_version 394189 (0.0005) [2023-12-26 02:43:58,169][123090] Updated weights for policy 1, policy_version 391875 (0.0010) [2023-12-26 02:43:58,231][123090] Updated weights for policy 1, policy_version 391885 (0.0007) [2023-12-26 02:43:58,290][123090] Updated weights for policy 1, policy_version 391895 (0.0008) [2023-12-26 02:43:58,582][123091] Updated weights for policy 0, policy_version 394199 (0.0006) [2023-12-26 02:43:58,657][123091] Updated weights for policy 0, policy_version 394209 (0.0007) [2023-12-26 02:43:58,730][123091] Updated weights for policy 0, policy_version 394219 (0.0007) [2023-12-26 02:43:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18295.5, 300 sec: 17772.5). Total num frames: 201252864. Throughput: 0: 9330.0, 1: 8859.0. Samples: 201242484. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:43:58,785][121949] Avg episode reward: [(0, '6179.136'), (1, '5685.328')] [2023-12-26 02:43:59,286][123090] Updated weights for policy 1, policy_version 391905 (0.0012) [2023-12-26 02:43:59,345][123090] Updated weights for policy 1, policy_version 391915 (0.0007) [2023-12-26 02:43:59,407][123090] Updated weights for policy 1, policy_version 391925 (0.0009) [2023-12-26 02:43:59,460][123090] Updated weights for policy 1, policy_version 391935 (0.0009) [2023-12-26 02:43:59,517][123091] Updated weights for policy 0, policy_version 394229 (0.0007) [2023-12-26 02:43:59,568][123091] Updated weights for policy 0, policy_version 394239 (0.0009) [2023-12-26 02:43:59,616][123091] Updated weights for policy 0, policy_version 394249 (0.0010) [2023-12-26 02:44:00,265][123090] Updated weights for policy 1, policy_version 391945 (0.0006) [2023-12-26 02:44:00,338][123090] Updated weights for policy 1, policy_version 391955 (0.0005) [2023-12-26 02:44:00,409][123090] Updated weights for policy 1, policy_version 391965 (0.0009) [2023-12-26 02:44:00,424][123091] Updated weights for policy 0, policy_version 394259 (0.0009) [2023-12-26 02:44:00,476][123091] Updated weights for policy 0, policy_version 394269 (0.0006) [2023-12-26 02:44:00,535][123091] Updated weights for policy 0, policy_version 394279 (0.0005) [2023-12-26 02:44:01,190][123090] Updated weights for policy 1, policy_version 391975 (0.0010) [2023-12-26 02:44:01,258][123090] Updated weights for policy 1, policy_version 391985 (0.0009) [2023-12-26 02:44:01,322][123090] Updated weights for policy 1, policy_version 391995 (0.0009) [2023-12-26 02:44:01,334][123091] Updated weights for policy 0, policy_version 394289 (0.0006) [2023-12-26 02:44:01,398][123091] Updated weights for policy 0, policy_version 394299 (0.0011) [2023-12-26 02:44:01,457][123091] Updated weights for policy 0, policy_version 394309 (0.0010) [2023-12-26 02:44:01,519][123091] Updated weights for policy 0, policy_version 394319 (0.0011) [2023-12-26 02:44:02,169][123090] Updated weights for policy 1, policy_version 392005 (0.0009) [2023-12-26 02:44:02,223][123090] Updated weights for policy 1, policy_version 392015 (0.0009) [2023-12-26 02:44:02,277][123090] Updated weights for policy 1, policy_version 392025 (0.0009) [2023-12-26 02:44:02,385][123091] Updated weights for policy 0, policy_version 394329 (0.0010) [2023-12-26 02:44:02,443][123091] Updated weights for policy 0, policy_version 394339 (0.0010) [2023-12-26 02:44:02,506][123091] Updated weights for policy 0, policy_version 394349 (0.0011) [2023-12-26 02:44:03,151][123090] Updated weights for policy 1, policy_version 392035 (0.0009) [2023-12-26 02:44:03,216][123090] Updated weights for policy 1, policy_version 392045 (0.0009) [2023-12-26 02:44:03,275][123090] Updated weights for policy 1, policy_version 392055 (0.0008) [2023-12-26 02:44:03,321][123091] Updated weights for policy 0, policy_version 394359 (0.0010) [2023-12-26 02:44:03,367][123091] Updated weights for policy 0, policy_version 394369 (0.0010) [2023-12-26 02:44:03,422][123091] Updated weights for policy 0, policy_version 394379 (0.0005) [2023-12-26 02:44:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 201334784. Throughput: 0: 9261.8, 1: 8753.6. Samples: 201344468. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:03,785][121949] Avg episode reward: [(0, '6147.101'), (1, '5627.971')] [2023-12-26 02:44:04,044][123090] Updated weights for policy 1, policy_version 392065 (0.0007) [2023-12-26 02:44:04,102][123090] Updated weights for policy 1, policy_version 392075 (0.0007) [2023-12-26 02:44:04,161][123090] Updated weights for policy 1, policy_version 392085 (0.0006) [2023-12-26 02:44:04,212][123091] Updated weights for policy 0, policy_version 394389 (0.0008) [2023-12-26 02:44:04,227][123090] Updated weights for policy 1, policy_version 392095 (0.0006) [2023-12-26 02:44:04,275][123091] Updated weights for policy 0, policy_version 394399 (0.0011) [2023-12-26 02:44:04,341][123091] Updated weights for policy 0, policy_version 394409 (0.0011) [2023-12-26 02:44:04,846][123090] Updated weights for policy 1, policy_version 392105 (0.0010) [2023-12-26 02:44:04,920][123090] Updated weights for policy 1, policy_version 392115 (0.0007) [2023-12-26 02:44:04,993][123090] Updated weights for policy 1, policy_version 392125 (0.0005) [2023-12-26 02:44:05,133][123091] Updated weights for policy 0, policy_version 394419 (0.0009) [2023-12-26 02:44:05,189][123091] Updated weights for policy 0, policy_version 394429 (0.0005) [2023-12-26 02:44:05,237][123091] Updated weights for policy 0, policy_version 394439 (0.0005) [2023-12-26 02:44:05,611][123090] Updated weights for policy 1, policy_version 392135 (0.0005) [2023-12-26 02:44:05,661][123090] Updated weights for policy 1, policy_version 392145 (0.0005) [2023-12-26 02:44:05,707][123090] Updated weights for policy 1, policy_version 392155 (0.0005) [2023-12-26 02:44:06,041][123091] Updated weights for policy 0, policy_version 394449 (0.0007) [2023-12-26 02:44:06,105][123091] Updated weights for policy 0, policy_version 394459 (0.0010) [2023-12-26 02:44:06,176][123091] Updated weights for policy 0, policy_version 394469 (0.0006) [2023-12-26 02:44:06,240][123091] Updated weights for policy 0, policy_version 394479 (0.0006) [2023-12-26 02:44:06,430][123090] Updated weights for policy 1, policy_version 392165 (0.0005) [2023-12-26 02:44:06,497][123090] Updated weights for policy 1, policy_version 392175 (0.0005) [2023-12-26 02:44:06,571][123090] Updated weights for policy 1, policy_version 392185 (0.0006) [2023-12-26 02:44:07,033][123091] Updated weights for policy 0, policy_version 394489 (0.0010) [2023-12-26 02:44:07,096][123091] Updated weights for policy 0, policy_version 394499 (0.0010) [2023-12-26 02:44:07,159][123091] Updated weights for policy 0, policy_version 394509 (0.0011) [2023-12-26 02:44:07,287][123090] Updated weights for policy 1, policy_version 392195 (0.0007) [2023-12-26 02:44:07,343][123090] Updated weights for policy 1, policy_version 392205 (0.0007) [2023-12-26 02:44:07,393][123090] Updated weights for policy 1, policy_version 392215 (0.0005) [2023-12-26 02:44:07,975][123091] Updated weights for policy 0, policy_version 394519 (0.0010) [2023-12-26 02:44:08,022][123091] Updated weights for policy 0, policy_version 394529 (0.0010) [2023-12-26 02:44:08,066][123091] Updated weights for policy 0, policy_version 394539 (0.0010) [2023-12-26 02:44:08,148][123090] Updated weights for policy 1, policy_version 392225 (0.0005) [2023-12-26 02:44:08,201][123090] Updated weights for policy 1, policy_version 392235 (0.0005) [2023-12-26 02:44:08,255][123090] Updated weights for policy 1, policy_version 392245 (0.0005) [2023-12-26 02:44:08,303][123090] Updated weights for policy 1, policy_version 392255 (0.0005) [2023-12-26 02:44:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 201424896. Throughput: 0: 9248.6, 1: 8881.3. Samples: 201401428. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:08,785][121949] Avg episode reward: [(0, '6061.266'), (1, '5715.149')] [2023-12-26 02:44:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000394544_101007360.pth... [2023-12-26 02:44:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000392256_100417536.pth... [2023-12-26 02:44:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000393488_100737024.pth [2023-12-26 02:44:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000391232_100155392.pth [2023-12-26 02:44:08,915][123091] Updated weights for policy 0, policy_version 394549 (0.0010) [2023-12-26 02:44:08,982][123091] Updated weights for policy 0, policy_version 394559 (0.0011) [2023-12-26 02:44:09,053][123091] Updated weights for policy 0, policy_version 394569 (0.0011) [2023-12-26 02:44:09,054][123090] Updated weights for policy 1, policy_version 392265 (0.0006) [2023-12-26 02:44:09,125][123090] Updated weights for policy 1, policy_version 392275 (0.0005) [2023-12-26 02:44:09,193][123090] Updated weights for policy 1, policy_version 392285 (0.0006) [2023-12-26 02:44:09,826][123091] Updated weights for policy 0, policy_version 394579 (0.0010) [2023-12-26 02:44:09,891][123091] Updated weights for policy 0, policy_version 394589 (0.0009) [2023-12-26 02:44:09,921][123090] Updated weights for policy 1, policy_version 392295 (0.0008) [2023-12-26 02:44:09,963][123091] Updated weights for policy 0, policy_version 394599 (0.0009) [2023-12-26 02:44:09,991][123090] Updated weights for policy 1, policy_version 392305 (0.0011) [2023-12-26 02:44:10,059][123090] Updated weights for policy 1, policy_version 392315 (0.0010) [2023-12-26 02:44:10,685][123091] Updated weights for policy 0, policy_version 394609 (0.0007) [2023-12-26 02:44:10,743][123091] Updated weights for policy 0, policy_version 394619 (0.0010) [2023-12-26 02:44:10,793][123091] Updated weights for policy 0, policy_version 394630 (0.0010) [2023-12-26 02:44:10,838][123091] Updated weights for policy 0, policy_version 394640 (0.0007) [2023-12-26 02:44:10,843][123090] Updated weights for policy 1, policy_version 392325 (0.0008) [2023-12-26 02:44:10,905][123090] Updated weights for policy 1, policy_version 392335 (0.0005) [2023-12-26 02:44:10,958][123090] Updated weights for policy 1, policy_version 392345 (0.0005) [2023-12-26 02:44:11,700][123090] Updated weights for policy 1, policy_version 392355 (0.0006) [2023-12-26 02:44:11,716][123091] Updated weights for policy 0, policy_version 394650 (0.0009) [2023-12-26 02:44:11,758][123090] Updated weights for policy 1, policy_version 392365 (0.0008) [2023-12-26 02:44:11,783][123091] Updated weights for policy 0, policy_version 394660 (0.0006) [2023-12-26 02:44:11,818][123090] Updated weights for policy 1, policy_version 392375 (0.0008) [2023-12-26 02:44:11,856][123091] Updated weights for policy 0, policy_version 394670 (0.0008) [2023-12-26 02:44:12,619][123091] Updated weights for policy 0, policy_version 394680 (0.0010) [2023-12-26 02:44:12,684][123091] Updated weights for policy 0, policy_version 394690 (0.0009) [2023-12-26 02:44:12,717][123090] Updated weights for policy 1, policy_version 392385 (0.0008) [2023-12-26 02:44:12,746][123091] Updated weights for policy 0, policy_version 394700 (0.0008) [2023-12-26 02:44:12,775][123090] Updated weights for policy 1, policy_version 392395 (0.0007) [2023-12-26 02:44:12,840][123090] Updated weights for policy 1, policy_version 392405 (0.0009) [2023-12-26 02:44:12,900][123090] Updated weights for policy 1, policy_version 392415 (0.0009) [2023-12-26 02:44:13,553][123091] Updated weights for policy 0, policy_version 394710 (0.0008) [2023-12-26 02:44:13,615][123091] Updated weights for policy 0, policy_version 394720 (0.0005) [2023-12-26 02:44:13,668][123091] Updated weights for policy 0, policy_version 394730 (0.0005) [2023-12-26 02:44:13,759][123090] Updated weights for policy 1, policy_version 392425 (0.0009) [2023-12-26 02:44:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 201515008. Throughput: 0: 9100.8, 1: 8907.2. Samples: 201509504. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:13,785][121949] Avg episode reward: [(0, '6046.623'), (1, '5878.305')] [2023-12-26 02:44:13,826][123090] Updated weights for policy 1, policy_version 392435 (0.0009) [2023-12-26 02:44:13,888][123090] Updated weights for policy 1, policy_version 392445 (0.0010) [2023-12-26 02:44:14,380][123091] Updated weights for policy 0, policy_version 394740 (0.0006) [2023-12-26 02:44:14,439][123091] Updated weights for policy 0, policy_version 394750 (0.0010) [2023-12-26 02:44:14,507][123091] Updated weights for policy 0, policy_version 394760 (0.0010) [2023-12-26 02:44:14,768][123090] Updated weights for policy 1, policy_version 392455 (0.0009) [2023-12-26 02:44:14,836][123090] Updated weights for policy 1, policy_version 392465 (0.0009) [2023-12-26 02:44:14,891][123090] Updated weights for policy 1, policy_version 392475 (0.0009) [2023-12-26 02:44:15,261][123091] Updated weights for policy 0, policy_version 394770 (0.0010) [2023-12-26 02:44:15,329][123091] Updated weights for policy 0, policy_version 394780 (0.0010) [2023-12-26 02:44:15,391][123091] Updated weights for policy 0, policy_version 394790 (0.0010) [2023-12-26 02:44:15,449][123091] Updated weights for policy 0, policy_version 394800 (0.0009) [2023-12-26 02:44:15,747][123090] Updated weights for policy 1, policy_version 392485 (0.0010) [2023-12-26 02:44:15,804][123090] Updated weights for policy 1, policy_version 392495 (0.0009) [2023-12-26 02:44:15,858][123090] Updated weights for policy 1, policy_version 392505 (0.0009) [2023-12-26 02:44:16,257][123091] Updated weights for policy 0, policy_version 394810 (0.0010) [2023-12-26 02:44:16,315][123091] Updated weights for policy 0, policy_version 394820 (0.0010) [2023-12-26 02:44:16,377][123091] Updated weights for policy 0, policy_version 394830 (0.0010) [2023-12-26 02:44:16,692][123090] Updated weights for policy 1, policy_version 392515 (0.0010) [2023-12-26 02:44:16,749][123090] Updated weights for policy 1, policy_version 392526 (0.0008) [2023-12-26 02:44:16,799][123090] Updated weights for policy 1, policy_version 392536 (0.0008) [2023-12-26 02:44:17,260][123091] Updated weights for policy 0, policy_version 394841 (0.0010) [2023-12-26 02:44:17,314][123091] Updated weights for policy 0, policy_version 394852 (0.0010) [2023-12-26 02:44:17,375][123091] Updated weights for policy 0, policy_version 394862 (0.0010) [2023-12-26 02:44:17,482][123090] Updated weights for policy 1, policy_version 392546 (0.0006) [2023-12-26 02:44:17,536][123090] Updated weights for policy 1, policy_version 392556 (0.0009) [2023-12-26 02:44:17,586][123090] Updated weights for policy 1, policy_version 392566 (0.0009) [2023-12-26 02:44:17,634][123090] Updated weights for policy 1, policy_version 392576 (0.0009) [2023-12-26 02:44:18,225][123091] Updated weights for policy 0, policy_version 394872 (0.0007) [2023-12-26 02:44:18,287][123091] Updated weights for policy 0, policy_version 394882 (0.0006) [2023-12-26 02:44:18,357][123091] Updated weights for policy 0, policy_version 394892 (0.0007) [2023-12-26 02:44:18,546][123090] Updated weights for policy 1, policy_version 392586 (0.0010) [2023-12-26 02:44:18,604][123090] Updated weights for policy 1, policy_version 392596 (0.0010) [2023-12-26 02:44:18,662][123090] Updated weights for policy 1, policy_version 392606 (0.0010) [2023-12-26 02:44:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 201605120. Throughput: 0: 9099.2, 1: 8864.0. Samples: 201613848. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:18,785][121949] Avg episode reward: [(0, '6084.529'), (1, '5752.353')] [2023-12-26 02:44:19,085][123091] Updated weights for policy 0, policy_version 394902 (0.0008) [2023-12-26 02:44:19,150][123091] Updated weights for policy 0, policy_version 394912 (0.0009) [2023-12-26 02:44:19,211][123091] Updated weights for policy 0, policy_version 394922 (0.0009) [2023-12-26 02:44:19,495][123090] Updated weights for policy 1, policy_version 392616 (0.0008) [2023-12-26 02:44:19,561][123090] Updated weights for policy 1, policy_version 392626 (0.0008) [2023-12-26 02:44:19,621][123090] Updated weights for policy 1, policy_version 392636 (0.0008) [2023-12-26 02:44:20,092][123091] Updated weights for policy 0, policy_version 394932 (0.0010) [2023-12-26 02:44:20,157][123091] Updated weights for policy 0, policy_version 394942 (0.0010) [2023-12-26 02:44:20,220][123091] Updated weights for policy 0, policy_version 394952 (0.0010) [2023-12-26 02:44:20,381][123090] Updated weights for policy 1, policy_version 392646 (0.0007) [2023-12-26 02:44:20,439][123090] Updated weights for policy 1, policy_version 392656 (0.0009) [2023-12-26 02:44:20,503][123090] Updated weights for policy 1, policy_version 392666 (0.0009) [2023-12-26 02:44:21,099][123091] Updated weights for policy 0, policy_version 394962 (0.0010) [2023-12-26 02:44:21,163][123091] Updated weights for policy 0, policy_version 394972 (0.0009) [2023-12-26 02:44:21,222][123091] Updated weights for policy 0, policy_version 394982 (0.0009) [2023-12-26 02:44:21,291][123090] Updated weights for policy 1, policy_version 392676 (0.0009) [2023-12-26 02:44:21,293][123091] Updated weights for policy 0, policy_version 394992 (0.0008) [2023-12-26 02:44:21,374][123090] Updated weights for policy 1, policy_version 392686 (0.0008) [2023-12-26 02:44:21,448][123090] Updated weights for policy 1, policy_version 392696 (0.0007) [2023-12-26 02:44:22,171][123091] Updated weights for policy 0, policy_version 395002 (0.0009) [2023-12-26 02:44:22,230][123091] Updated weights for policy 0, policy_version 395012 (0.0010) [2023-12-26 02:44:22,233][123090] Updated weights for policy 1, policy_version 392706 (0.0006) [2023-12-26 02:44:22,297][123091] Updated weights for policy 0, policy_version 395022 (0.0008) [2023-12-26 02:44:22,301][123090] Updated weights for policy 1, policy_version 392716 (0.0008) [2023-12-26 02:44:22,363][123090] Updated weights for policy 1, policy_version 392726 (0.0009) [2023-12-26 02:44:22,431][123090] Updated weights for policy 1, policy_version 392736 (0.0010) [2023-12-26 02:44:23,121][123091] Updated weights for policy 0, policy_version 395032 (0.0009) [2023-12-26 02:44:23,187][123091] Updated weights for policy 0, policy_version 395042 (0.0009) [2023-12-26 02:44:23,234][123090] Updated weights for policy 1, policy_version 392746 (0.0010) [2023-12-26 02:44:23,239][123091] Updated weights for policy 0, policy_version 395052 (0.0009) [2023-12-26 02:44:23,294][123090] Updated weights for policy 1, policy_version 392756 (0.0008) [2023-12-26 02:44:23,357][123090] Updated weights for policy 1, policy_version 392766 (0.0008) [2023-12-26 02:44:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 201687040. Throughput: 0: 9018.7, 1: 8882.9. Samples: 201664672. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:23,785][121949] Avg episode reward: [(0, '6213.909'), (1, '5554.142')] [2023-12-26 02:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000395056_101138432.pth... [2023-12-26 02:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000392768_100548608.pth... [2023-12-26 02:44:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000394032_100876288.pth [2023-12-26 02:44:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000391744_100286464.pth [2023-12-26 02:44:24,045][123091] Updated weights for policy 0, policy_version 395062 (0.0009) [2023-12-26 02:44:24,100][123091] Updated weights for policy 0, policy_version 395072 (0.0009) [2023-12-26 02:44:24,167][123091] Updated weights for policy 0, policy_version 395082 (0.0008) [2023-12-26 02:44:24,199][123090] Updated weights for policy 1, policy_version 392776 (0.0009) [2023-12-26 02:44:24,259][123090] Updated weights for policy 1, policy_version 392786 (0.0009) [2023-12-26 02:44:24,321][123090] Updated weights for policy 1, policy_version 392796 (0.0009) [2023-12-26 02:44:24,909][123091] Updated weights for policy 0, policy_version 395092 (0.0009) [2023-12-26 02:44:24,972][123091] Updated weights for policy 0, policy_version 395102 (0.0009) [2023-12-26 02:44:25,028][123091] Updated weights for policy 0, policy_version 395112 (0.0009) [2023-12-26 02:44:25,155][123090] Updated weights for policy 1, policy_version 392806 (0.0008) [2023-12-26 02:44:25,206][123090] Updated weights for policy 1, policy_version 392816 (0.0009) [2023-12-26 02:44:25,261][123090] Updated weights for policy 1, policy_version 392826 (0.0009) [2023-12-26 02:44:25,892][123091] Updated weights for policy 0, policy_version 395122 (0.0009) [2023-12-26 02:44:25,927][123090] Updated weights for policy 1, policy_version 392836 (0.0008) [2023-12-26 02:44:25,945][123091] Updated weights for policy 0, policy_version 395132 (0.0010) [2023-12-26 02:44:25,976][123090] Updated weights for policy 1, policy_version 392846 (0.0009) [2023-12-26 02:44:25,998][123091] Updated weights for policy 0, policy_version 395142 (0.0008) [2023-12-26 02:44:26,036][123090] Updated weights for policy 1, policy_version 392856 (0.0009) [2023-12-26 02:44:26,056][123091] Updated weights for policy 0, policy_version 395152 (0.0008) [2023-12-26 02:44:26,813][123090] Updated weights for policy 1, policy_version 392866 (0.0005) [2023-12-26 02:44:26,872][123090] Updated weights for policy 1, policy_version 392876 (0.0005) [2023-12-26 02:44:26,924][123091] Updated weights for policy 0, policy_version 395162 (0.0008) [2023-12-26 02:44:26,943][123090] Updated weights for policy 1, policy_version 392886 (0.0005) [2023-12-26 02:44:26,986][123091] Updated weights for policy 0, policy_version 395172 (0.0010) [2023-12-26 02:44:27,013][123090] Updated weights for policy 1, policy_version 392896 (0.0005) [2023-12-26 02:44:27,060][123091] Updated weights for policy 0, policy_version 395182 (0.0009) [2023-12-26 02:44:27,629][123090] Updated weights for policy 1, policy_version 392906 (0.0010) [2023-12-26 02:44:27,677][123090] Updated weights for policy 1, policy_version 392916 (0.0010) [2023-12-26 02:44:27,732][123090] Updated weights for policy 1, policy_version 392926 (0.0010) [2023-12-26 02:44:27,903][123091] Updated weights for policy 0, policy_version 395192 (0.0010) [2023-12-26 02:44:27,960][123091] Updated weights for policy 0, policy_version 395202 (0.0009) [2023-12-26 02:44:28,013][123091] Updated weights for policy 0, policy_version 395212 (0.0010) [2023-12-26 02:44:28,476][123090] Updated weights for policy 1, policy_version 392936 (0.0011) [2023-12-26 02:44:28,536][123090] Updated weights for policy 1, policy_version 392946 (0.0011) [2023-12-26 02:44:28,603][123090] Updated weights for policy 1, policy_version 392956 (0.0010) [2023-12-26 02:44:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 201777152. Throughput: 0: 8982.6, 1: 8919.5. Samples: 201770952. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:28,784][121949] Avg episode reward: [(0, '6235.741'), (1, '5671.978')] [2023-12-26 02:44:28,865][123091] Updated weights for policy 0, policy_version 395222 (0.0009) [2023-12-26 02:44:28,927][123091] Updated weights for policy 0, policy_version 395232 (0.0009) [2023-12-26 02:44:28,986][123091] Updated weights for policy 0, policy_version 395242 (0.0009) [2023-12-26 02:44:29,404][123090] Updated weights for policy 1, policy_version 392966 (0.0009) [2023-12-26 02:44:29,460][123090] Updated weights for policy 1, policy_version 392976 (0.0008) [2023-12-26 02:44:29,516][123090] Updated weights for policy 1, policy_version 392986 (0.0008) [2023-12-26 02:44:29,860][123091] Updated weights for policy 0, policy_version 395252 (0.0009) [2023-12-26 02:44:29,926][123091] Updated weights for policy 0, policy_version 395262 (0.0010) [2023-12-26 02:44:29,996][123091] Updated weights for policy 0, policy_version 395272 (0.0006) [2023-12-26 02:44:30,324][123090] Updated weights for policy 1, policy_version 392996 (0.0009) [2023-12-26 02:44:30,382][123090] Updated weights for policy 1, policy_version 393006 (0.0010) [2023-12-26 02:44:30,447][123090] Updated weights for policy 1, policy_version 393016 (0.0010) [2023-12-26 02:44:30,725][123091] Updated weights for policy 0, policy_version 395282 (0.0006) [2023-12-26 02:44:30,782][123091] Updated weights for policy 0, policy_version 395292 (0.0009) [2023-12-26 02:44:30,839][123091] Updated weights for policy 0, policy_version 395302 (0.0005) [2023-12-26 02:44:30,898][123091] Updated weights for policy 0, policy_version 395312 (0.0005) [2023-12-26 02:44:31,315][123090] Updated weights for policy 1, policy_version 393026 (0.0009) [2023-12-26 02:44:31,387][123090] Updated weights for policy 1, policy_version 393036 (0.0009) [2023-12-26 02:44:31,444][123090] Updated weights for policy 1, policy_version 393046 (0.0009) [2023-12-26 02:44:31,513][123090] Updated weights for policy 1, policy_version 393056 (0.0009) [2023-12-26 02:44:31,690][123091] Updated weights for policy 0, policy_version 395322 (0.0009) [2023-12-26 02:44:31,760][123091] Updated weights for policy 0, policy_version 395332 (0.0009) [2023-12-26 02:44:31,824][123091] Updated weights for policy 0, policy_version 395342 (0.0009) [2023-12-26 02:44:32,302][123090] Updated weights for policy 1, policy_version 393066 (0.0009) [2023-12-26 02:44:32,367][123090] Updated weights for policy 1, policy_version 393076 (0.0008) [2023-12-26 02:44:32,428][123090] Updated weights for policy 1, policy_version 393086 (0.0010) [2023-12-26 02:44:32,616][123091] Updated weights for policy 0, policy_version 395352 (0.0009) [2023-12-26 02:44:32,671][123091] Updated weights for policy 0, policy_version 395362 (0.0009) [2023-12-26 02:44:32,721][123091] Updated weights for policy 0, policy_version 395372 (0.0008) [2023-12-26 02:44:33,292][123090] Updated weights for policy 1, policy_version 393096 (0.0009) [2023-12-26 02:44:33,347][123090] Updated weights for policy 1, policy_version 393106 (0.0010) [2023-12-26 02:44:33,417][123090] Updated weights for policy 1, policy_version 393116 (0.0010) [2023-12-26 02:44:33,601][123091] Updated weights for policy 0, policy_version 395382 (0.0010) [2023-12-26 02:44:33,660][123091] Updated weights for policy 0, policy_version 395393 (0.0010) [2023-12-26 02:44:33,724][123091] Updated weights for policy 0, policy_version 395403 (0.0009) [2023-12-26 02:44:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 201867264. Throughput: 0: 8860.1, 1: 8851.4. Samples: 201874300. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:33,785][121949] Avg episode reward: [(0, '6138.867'), (1, '5716.316')] [2023-12-26 02:44:34,211][123090] Updated weights for policy 1, policy_version 393126 (0.0009) [2023-12-26 02:44:34,265][123090] Updated weights for policy 1, policy_version 393136 (0.0010) [2023-12-26 02:44:34,323][123090] Updated weights for policy 1, policy_version 393146 (0.0010) [2023-12-26 02:44:34,586][123091] Updated weights for policy 0, policy_version 395413 (0.0010) [2023-12-26 02:44:34,650][123091] Updated weights for policy 0, policy_version 395423 (0.0010) [2023-12-26 02:44:34,713][123091] Updated weights for policy 0, policy_version 395433 (0.0010) [2023-12-26 02:44:35,174][123090] Updated weights for policy 1, policy_version 393156 (0.0010) [2023-12-26 02:44:35,225][123090] Updated weights for policy 1, policy_version 393166 (0.0009) [2023-12-26 02:44:35,280][123090] Updated weights for policy 1, policy_version 393176 (0.0009) [2023-12-26 02:44:35,536][123091] Updated weights for policy 0, policy_version 395443 (0.0010) [2023-12-26 02:44:35,606][123091] Updated weights for policy 0, policy_version 395453 (0.0010) [2023-12-26 02:44:35,660][123091] Updated weights for policy 0, policy_version 395463 (0.0010) [2023-12-26 02:44:36,106][123090] Updated weights for policy 1, policy_version 393186 (0.0009) [2023-12-26 02:44:36,175][123090] Updated weights for policy 1, policy_version 393196 (0.0008) [2023-12-26 02:44:36,238][123090] Updated weights for policy 1, policy_version 393206 (0.0009) [2023-12-26 02:44:36,302][123090] Updated weights for policy 1, policy_version 393216 (0.0009) [2023-12-26 02:44:36,505][123091] Updated weights for policy 0, policy_version 395473 (0.0010) [2023-12-26 02:44:36,569][123091] Updated weights for policy 0, policy_version 395483 (0.0008) [2023-12-26 02:44:36,641][123091] Updated weights for policy 0, policy_version 395494 (0.0010) [2023-12-26 02:44:36,706][123091] Updated weights for policy 0, policy_version 395504 (0.0009) [2023-12-26 02:44:37,132][123090] Updated weights for policy 1, policy_version 393226 (0.0009) [2023-12-26 02:44:37,180][123090] Updated weights for policy 1, policy_version 393236 (0.0008) [2023-12-26 02:44:37,234][123090] Updated weights for policy 1, policy_version 393246 (0.0009) [2023-12-26 02:44:37,528][123091] Updated weights for policy 0, policy_version 395514 (0.0010) [2023-12-26 02:44:37,591][123091] Updated weights for policy 0, policy_version 395524 (0.0009) [2023-12-26 02:44:37,658][123091] Updated weights for policy 0, policy_version 395534 (0.0010) [2023-12-26 02:44:38,088][123090] Updated weights for policy 1, policy_version 393256 (0.0010) [2023-12-26 02:44:38,141][123090] Updated weights for policy 1, policy_version 393266 (0.0009) [2023-12-26 02:44:38,188][123090] Updated weights for policy 1, policy_version 393276 (0.0008) [2023-12-26 02:44:38,491][123091] Updated weights for policy 0, policy_version 395544 (0.0010) [2023-12-26 02:44:38,553][123091] Updated weights for policy 0, policy_version 395554 (0.0009) [2023-12-26 02:44:38,617][123091] Updated weights for policy 0, policy_version 395564 (0.0009) [2023-12-26 02:44:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 201949184. Throughput: 0: 8828.7, 1: 8850.6. Samples: 201925316. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:38,785][121949] Avg episode reward: [(0, '6133.022'), (1, '5437.910')] [2023-12-26 02:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000395568_101269504.pth... [2023-12-26 02:44:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000393280_100679680.pth... [2023-12-26 02:44:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000394544_101007360.pth [2023-12-26 02:44:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000392256_100417536.pth [2023-12-26 02:44:39,070][123090] Updated weights for policy 1, policy_version 393286 (0.0009) [2023-12-26 02:44:39,131][123090] Updated weights for policy 1, policy_version 393296 (0.0008) [2023-12-26 02:44:39,184][123090] Updated weights for policy 1, policy_version 393306 (0.0009) [2023-12-26 02:44:39,471][123091] Updated weights for policy 0, policy_version 395574 (0.0009) [2023-12-26 02:44:39,539][123091] Updated weights for policy 0, policy_version 395584 (0.0010) [2023-12-26 02:44:39,604][123091] Updated weights for policy 0, policy_version 395594 (0.0009) [2023-12-26 02:44:40,041][123090] Updated weights for policy 1, policy_version 393316 (0.0010) [2023-12-26 02:44:40,096][123090] Updated weights for policy 1, policy_version 393326 (0.0007) [2023-12-26 02:44:40,147][123090] Updated weights for policy 1, policy_version 393336 (0.0005) [2023-12-26 02:44:40,467][123091] Updated weights for policy 0, policy_version 395604 (0.0009) [2023-12-26 02:44:40,529][123091] Updated weights for policy 0, policy_version 395614 (0.0010) [2023-12-26 02:44:40,587][123091] Updated weights for policy 0, policy_version 395624 (0.0010) [2023-12-26 02:44:40,951][123090] Updated weights for policy 1, policy_version 393346 (0.0008) [2023-12-26 02:44:41,009][123090] Updated weights for policy 1, policy_version 393356 (0.0009) [2023-12-26 02:44:41,084][123090] Updated weights for policy 1, policy_version 393367 (0.0010) [2023-12-26 02:44:41,406][123091] Updated weights for policy 0, policy_version 395634 (0.0009) [2023-12-26 02:44:41,470][123091] Updated weights for policy 0, policy_version 395644 (0.0009) [2023-12-26 02:44:41,534][123091] Updated weights for policy 0, policy_version 395654 (0.0010) [2023-12-26 02:44:41,598][123091] Updated weights for policy 0, policy_version 395664 (0.0009) [2023-12-26 02:44:42,015][123090] Updated weights for policy 1, policy_version 393377 (0.0008) [2023-12-26 02:44:42,064][123090] Updated weights for policy 1, policy_version 393387 (0.0009) [2023-12-26 02:44:42,123][123090] Updated weights for policy 1, policy_version 393397 (0.0009) [2023-12-26 02:44:42,171][123090] Updated weights for policy 1, policy_version 393407 (0.0008) [2023-12-26 02:44:42,417][123091] Updated weights for policy 0, policy_version 395674 (0.0008) [2023-12-26 02:44:42,486][123091] Updated weights for policy 0, policy_version 395684 (0.0006) [2023-12-26 02:44:42,554][123091] Updated weights for policy 0, policy_version 395694 (0.0008) [2023-12-26 02:44:43,101][123090] Updated weights for policy 1, policy_version 393417 (0.0010) [2023-12-26 02:44:43,166][123090] Updated weights for policy 1, policy_version 393427 (0.0009) [2023-12-26 02:44:43,197][123091] Updated weights for policy 0, policy_version 395704 (0.0006) [2023-12-26 02:44:43,221][123090] Updated weights for policy 1, policy_version 393437 (0.0009) [2023-12-26 02:44:43,259][123091] Updated weights for policy 0, policy_version 395714 (0.0006) [2023-12-26 02:44:43,325][123091] Updated weights for policy 0, policy_version 395724 (0.0007) [2023-12-26 02:44:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 202031104. Throughput: 0: 8644.2, 1: 8766.6. Samples: 202025968. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:43,784][121949] Avg episode reward: [(0, '6213.822'), (1, '5453.455')] [2023-12-26 02:44:44,045][123091] Updated weights for policy 0, policy_version 395734 (0.0005) [2023-12-26 02:44:44,062][123090] Updated weights for policy 1, policy_version 393447 (0.0008) [2023-12-26 02:44:44,102][123091] Updated weights for policy 0, policy_version 395744 (0.0006) [2023-12-26 02:44:44,120][123090] Updated weights for policy 1, policy_version 393457 (0.0009) [2023-12-26 02:44:44,159][123091] Updated weights for policy 0, policy_version 395754 (0.0005) [2023-12-26 02:44:44,183][123090] Updated weights for policy 1, policy_version 393467 (0.0009) [2023-12-26 02:44:44,930][123091] Updated weights for policy 0, policy_version 395764 (0.0006) [2023-12-26 02:44:45,008][123091] Updated weights for policy 0, policy_version 395774 (0.0006) [2023-12-26 02:44:45,026][123090] Updated weights for policy 1, policy_version 393477 (0.0007) [2023-12-26 02:44:45,073][123091] Updated weights for policy 0, policy_version 395784 (0.0008) [2023-12-26 02:44:45,093][123090] Updated weights for policy 1, policy_version 393487 (0.0005) [2023-12-26 02:44:45,168][123090] Updated weights for policy 1, policy_version 393497 (0.0006) [2023-12-26 02:44:45,725][123091] Updated weights for policy 0, policy_version 395794 (0.0006) [2023-12-26 02:44:45,774][123091] Updated weights for policy 0, policy_version 395804 (0.0005) [2023-12-26 02:44:45,842][123091] Updated weights for policy 0, policy_version 395814 (0.0005) [2023-12-26 02:44:45,888][123090] Updated weights for policy 1, policy_version 393507 (0.0006) [2023-12-26 02:44:45,908][123091] Updated weights for policy 0, policy_version 395824 (0.0007) [2023-12-26 02:44:45,937][123090] Updated weights for policy 1, policy_version 393517 (0.0007) [2023-12-26 02:44:45,993][123090] Updated weights for policy 1, policy_version 393527 (0.0005) [2023-12-26 02:44:46,544][123091] Updated weights for policy 0, policy_version 395834 (0.0005) [2023-12-26 02:44:46,609][123091] Updated weights for policy 0, policy_version 395844 (0.0006) [2023-12-26 02:44:46,665][123091] Updated weights for policy 0, policy_version 395854 (0.0005) [2023-12-26 02:44:46,853][123090] Updated weights for policy 1, policy_version 393537 (0.0005) [2023-12-26 02:44:46,929][123090] Updated weights for policy 1, policy_version 393547 (0.0009) [2023-12-26 02:44:47,005][123090] Updated weights for policy 1, policy_version 393557 (0.0009) [2023-12-26 02:44:47,054][123090] Updated weights for policy 1, policy_version 393567 (0.0009) [2023-12-26 02:44:47,399][123091] Updated weights for policy 0, policy_version 395864 (0.0009) [2023-12-26 02:44:47,452][123091] Updated weights for policy 0, policy_version 395874 (0.0010) [2023-12-26 02:44:47,505][123091] Updated weights for policy 0, policy_version 395884 (0.0010) [2023-12-26 02:44:47,750][123090] Updated weights for policy 1, policy_version 393577 (0.0006) [2023-12-26 02:44:47,823][123090] Updated weights for policy 1, policy_version 393587 (0.0008) [2023-12-26 02:44:47,886][123090] Updated weights for policy 1, policy_version 393597 (0.0009) [2023-12-26 02:44:48,405][123091] Updated weights for policy 0, policy_version 395894 (0.0008) [2023-12-26 02:44:48,463][123091] Updated weights for policy 0, policy_version 395904 (0.0007) [2023-12-26 02:44:48,511][123091] Updated weights for policy 0, policy_version 395914 (0.0005) [2023-12-26 02:44:48,644][123090] Updated weights for policy 1, policy_version 393607 (0.0008) [2023-12-26 02:44:48,715][123090] Updated weights for policy 1, policy_version 393617 (0.0008) [2023-12-26 02:44:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 202121216. Throughput: 0: 8755.0, 1: 8827.3. Samples: 202135668. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:48,784][121949] Avg episode reward: [(0, '6337.386'), (1, '5543.033')] [2023-12-26 02:44:48,786][123090] Updated weights for policy 1, policy_version 393627 (0.0008) [2023-12-26 02:44:49,310][123091] Updated weights for policy 0, policy_version 395924 (0.0007) [2023-12-26 02:44:49,380][123091] Updated weights for policy 0, policy_version 395934 (0.0010) [2023-12-26 02:44:49,450][123091] Updated weights for policy 0, policy_version 395944 (0.0010) [2023-12-26 02:44:49,614][123090] Updated weights for policy 1, policy_version 393637 (0.0009) [2023-12-26 02:44:49,673][123090] Updated weights for policy 1, policy_version 393647 (0.0010) [2023-12-26 02:44:49,744][123090] Updated weights for policy 1, policy_version 393657 (0.0010) [2023-12-26 02:44:50,315][123091] Updated weights for policy 0, policy_version 395954 (0.0010) [2023-12-26 02:44:50,373][123091] Updated weights for policy 0, policy_version 395964 (0.0010) [2023-12-26 02:44:50,428][123091] Updated weights for policy 0, policy_version 395975 (0.0009) [2023-12-26 02:44:50,544][123090] Updated weights for policy 1, policy_version 393667 (0.0010) [2023-12-26 02:44:50,610][123090] Updated weights for policy 1, policy_version 393677 (0.0010) [2023-12-26 02:44:50,677][123090] Updated weights for policy 1, policy_version 393687 (0.0011) [2023-12-26 02:44:51,314][123091] Updated weights for policy 0, policy_version 395985 (0.0009) [2023-12-26 02:44:51,378][123091] Updated weights for policy 0, policy_version 395995 (0.0010) [2023-12-26 02:44:51,447][123091] Updated weights for policy 0, policy_version 396005 (0.0008) [2023-12-26 02:44:51,495][123090] Updated weights for policy 1, policy_version 393697 (0.0011) [2023-12-26 02:44:51,503][123091] Updated weights for policy 0, policy_version 396015 (0.0005) [2023-12-26 02:44:51,559][123090] Updated weights for policy 1, policy_version 393707 (0.0011) [2023-12-26 02:44:51,623][123090] Updated weights for policy 1, policy_version 393717 (0.0010) [2023-12-26 02:44:51,689][123090] Updated weights for policy 1, policy_version 393727 (0.0010) [2023-12-26 02:44:52,333][123091] Updated weights for policy 0, policy_version 396025 (0.0008) [2023-12-26 02:44:52,403][123091] Updated weights for policy 0, policy_version 396035 (0.0009) [2023-12-26 02:44:52,475][123091] Updated weights for policy 0, policy_version 396045 (0.0009) [2023-12-26 02:44:52,532][123090] Updated weights for policy 1, policy_version 393737 (0.0010) [2023-12-26 02:44:52,599][123090] Updated weights for policy 1, policy_version 393747 (0.0010) [2023-12-26 02:44:52,667][123090] Updated weights for policy 1, policy_version 393757 (0.0009) [2023-12-26 02:44:53,274][123091] Updated weights for policy 0, policy_version 396055 (0.0006) [2023-12-26 02:44:53,333][123091] Updated weights for policy 0, policy_version 396065 (0.0005) [2023-12-26 02:44:53,399][123091] Updated weights for policy 0, policy_version 396075 (0.0005) [2023-12-26 02:44:53,456][123090] Updated weights for policy 1, policy_version 393767 (0.0011) [2023-12-26 02:44:53,515][123090] Updated weights for policy 1, policy_version 393777 (0.0010) [2023-12-26 02:44:53,582][123090] Updated weights for policy 1, policy_version 393787 (0.0010) [2023-12-26 02:44:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 202211328. Throughput: 0: 8716.1, 1: 8727.4. Samples: 202186380. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:53,784][121949] Avg episode reward: [(0, '6256.944'), (1, '5632.373')] [2023-12-26 02:44:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000396080_101400576.pth... [2023-12-26 02:44:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000393792_100810752.pth... [2023-12-26 02:44:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000395056_101138432.pth [2023-12-26 02:44:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000392768_100548608.pth [2023-12-26 02:44:54,086][123091] Updated weights for policy 0, policy_version 396085 (0.0007) [2023-12-26 02:44:54,145][123091] Updated weights for policy 0, policy_version 396095 (0.0007) [2023-12-26 02:44:54,206][123091] Updated weights for policy 0, policy_version 396105 (0.0011) [2023-12-26 02:44:54,315][123090] Updated weights for policy 1, policy_version 393797 (0.0008) [2023-12-26 02:44:54,379][123090] Updated weights for policy 1, policy_version 393807 (0.0006) [2023-12-26 02:44:54,447][123090] Updated weights for policy 1, policy_version 393817 (0.0005) [2023-12-26 02:44:55,045][123091] Updated weights for policy 0, policy_version 396116 (0.0010) [2023-12-26 02:44:55,105][123091] Updated weights for policy 0, policy_version 396126 (0.0010) [2023-12-26 02:44:55,110][123090] Updated weights for policy 1, policy_version 393827 (0.0006) [2023-12-26 02:44:55,167][123090] Updated weights for policy 1, policy_version 393837 (0.0006) [2023-12-26 02:44:55,167][123091] Updated weights for policy 0, policy_version 396136 (0.0008) [2023-12-26 02:44:55,227][123090] Updated weights for policy 1, policy_version 393847 (0.0005) [2023-12-26 02:44:55,944][123090] Updated weights for policy 1, policy_version 393857 (0.0005) [2023-12-26 02:44:56,006][123090] Updated weights for policy 1, policy_version 393867 (0.0009) [2023-12-26 02:44:56,020][123091] Updated weights for policy 0, policy_version 396146 (0.0008) [2023-12-26 02:44:56,054][123090] Updated weights for policy 1, policy_version 393877 (0.0010) [2023-12-26 02:44:56,072][123091] Updated weights for policy 0, policy_version 396156 (0.0011) [2023-12-26 02:44:56,106][123090] Updated weights for policy 1, policy_version 393887 (0.0010) [2023-12-26 02:44:56,116][123091] Updated weights for policy 0, policy_version 396166 (0.0010) [2023-12-26 02:44:56,166][123091] Updated weights for policy 0, policy_version 396176 (0.0010) [2023-12-26 02:44:56,923][123090] Updated weights for policy 1, policy_version 393897 (0.0010) [2023-12-26 02:44:56,974][123090] Updated weights for policy 1, policy_version 393907 (0.0010) [2023-12-26 02:44:57,011][123091] Updated weights for policy 0, policy_version 396186 (0.0005) [2023-12-26 02:44:57,025][123090] Updated weights for policy 1, policy_version 393917 (0.0010) [2023-12-26 02:44:57,059][123091] Updated weights for policy 0, policy_version 396196 (0.0006) [2023-12-26 02:44:57,107][123091] Updated weights for policy 0, policy_version 396206 (0.0009) [2023-12-26 02:44:57,876][123090] Updated weights for policy 1, policy_version 393927 (0.0009) [2023-12-26 02:44:57,935][123091] Updated weights for policy 0, policy_version 396216 (0.0006) [2023-12-26 02:44:57,944][123090] Updated weights for policy 1, policy_version 393937 (0.0008) [2023-12-26 02:44:58,003][123091] Updated weights for policy 0, policy_version 396226 (0.0006) [2023-12-26 02:44:58,007][123090] Updated weights for policy 1, policy_version 393947 (0.0007) [2023-12-26 02:44:58,067][123091] Updated weights for policy 0, policy_version 396236 (0.0008) [2023-12-26 02:44:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 202293248. Throughput: 0: 8703.6, 1: 8709.2. Samples: 202293080. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:44:58,785][121949] Avg episode reward: [(0, '6227.910'), (1, '5560.291')] [2023-12-26 02:44:58,878][123090] Updated weights for policy 1, policy_version 393957 (0.0008) [2023-12-26 02:44:58,897][123091] Updated weights for policy 0, policy_version 396246 (0.0012) [2023-12-26 02:44:58,941][123090] Updated weights for policy 1, policy_version 393967 (0.0008) [2023-12-26 02:44:58,964][123091] Updated weights for policy 0, policy_version 396256 (0.0011) [2023-12-26 02:44:59,004][123090] Updated weights for policy 1, policy_version 393977 (0.0008) [2023-12-26 02:44:59,028][123091] Updated weights for policy 0, policy_version 396266 (0.0011) [2023-12-26 02:44:59,754][123090] Updated weights for policy 1, policy_version 393987 (0.0009) [2023-12-26 02:44:59,806][123090] Updated weights for policy 1, policy_version 393997 (0.0010) [2023-12-26 02:44:59,867][123091] Updated weights for policy 0, policy_version 396276 (0.0011) [2023-12-26 02:44:59,874][123090] Updated weights for policy 1, policy_version 394007 (0.0010) [2023-12-26 02:44:59,919][123091] Updated weights for policy 0, policy_version 396286 (0.0011) [2023-12-26 02:44:59,990][123091] Updated weights for policy 0, policy_version 396296 (0.0010) [2023-12-26 02:45:00,709][123090] Updated weights for policy 1, policy_version 394017 (0.0010) [2023-12-26 02:45:00,752][123091] Updated weights for policy 0, policy_version 396306 (0.0010) [2023-12-26 02:45:00,765][123090] Updated weights for policy 1, policy_version 394027 (0.0005) [2023-12-26 02:45:00,813][123091] Updated weights for policy 0, policy_version 396316 (0.0009) [2023-12-26 02:45:00,825][123090] Updated weights for policy 1, policy_version 394037 (0.0005) [2023-12-26 02:45:00,878][123090] Updated weights for policy 1, policy_version 394047 (0.0005) [2023-12-26 02:45:00,881][123091] Updated weights for policy 0, policy_version 396326 (0.0010) [2023-12-26 02:45:00,941][123091] Updated weights for policy 0, policy_version 396336 (0.0005) [2023-12-26 02:45:01,605][123090] Updated weights for policy 1, policy_version 394057 (0.0008) [2023-12-26 02:45:01,649][123091] Updated weights for policy 0, policy_version 396346 (0.0008) [2023-12-26 02:45:01,676][123090] Updated weights for policy 1, policy_version 394067 (0.0010) [2023-12-26 02:45:01,714][123091] Updated weights for policy 0, policy_version 396356 (0.0006) [2023-12-26 02:45:01,741][123090] Updated weights for policy 1, policy_version 394077 (0.0008) [2023-12-26 02:45:01,780][123091] Updated weights for policy 0, policy_version 396366 (0.0011) [2023-12-26 02:45:02,425][123090] Updated weights for policy 1, policy_version 394087 (0.0008) [2023-12-26 02:45:02,485][123090] Updated weights for policy 1, policy_version 394097 (0.0009) [2023-12-26 02:45:02,535][123091] Updated weights for policy 0, policy_version 396376 (0.0011) [2023-12-26 02:45:02,561][123090] Updated weights for policy 1, policy_version 394107 (0.0007) [2023-12-26 02:45:02,598][123091] Updated weights for policy 0, policy_version 396386 (0.0011) [2023-12-26 02:45:02,645][123091] Updated weights for policy 0, policy_version 396396 (0.0010) [2023-12-26 02:45:03,355][123091] Updated weights for policy 0, policy_version 396406 (0.0011) [2023-12-26 02:45:03,419][123091] Updated weights for policy 0, policy_version 396416 (0.0010) [2023-12-26 02:45:03,428][123090] Updated weights for policy 1, policy_version 394117 (0.0007) [2023-12-26 02:45:03,486][123091] Updated weights for policy 0, policy_version 396426 (0.0010) [2023-12-26 02:45:03,497][123090] Updated weights for policy 1, policy_version 394127 (0.0007) [2023-12-26 02:45:03,559][123090] Updated weights for policy 1, policy_version 394137 (0.0006) [2023-12-26 02:45:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 202391552. Throughput: 0: 8720.4, 1: 8758.2. Samples: 202400388. Policy #0 lag: (min: 31.0, avg: 41.3, max: 63.0) [2023-12-26 02:45:03,785][121949] Avg episode reward: [(0, '6120.629'), (1, '5437.692')] [2023-12-26 02:45:04,241][123091] Updated weights for policy 0, policy_version 396436 (0.0009) [2023-12-26 02:45:04,292][123090] Updated weights for policy 1, policy_version 394147 (0.0009) [2023-12-26 02:45:04,308][123091] Updated weights for policy 0, policy_version 396446 (0.0006) [2023-12-26 02:45:04,361][123090] Updated weights for policy 1, policy_version 394157 (0.0008) [2023-12-26 02:45:04,372][123091] Updated weights for policy 0, policy_version 396456 (0.0007) [2023-12-26 02:45:04,427][123090] Updated weights for policy 1, policy_version 394167 (0.0007) [2023-12-26 02:45:05,068][123090] Updated weights for policy 1, policy_version 394177 (0.0008) [2023-12-26 02:45:05,142][123090] Updated weights for policy 1, policy_version 394187 (0.0006) [2023-12-26 02:45:05,179][123091] Updated weights for policy 0, policy_version 396466 (0.0010) [2023-12-26 02:45:05,212][123090] Updated weights for policy 1, policy_version 394197 (0.0006) [2023-12-26 02:45:05,235][123091] Updated weights for policy 0, policy_version 396476 (0.0010) [2023-12-26 02:45:05,267][123090] Updated weights for policy 1, policy_version 394207 (0.0005) [2023-12-26 02:45:05,286][123091] Updated weights for policy 0, policy_version 396486 (0.0010) [2023-12-26 02:45:05,338][123091] Updated weights for policy 0, policy_version 396496 (0.0010) [2023-12-26 02:45:06,003][123090] Updated weights for policy 1, policy_version 394217 (0.0006) [2023-12-26 02:45:06,069][123090] Updated weights for policy 1, policy_version 394227 (0.0007) [2023-12-26 02:45:06,133][123090] Updated weights for policy 1, policy_version 394237 (0.0009) [2023-12-26 02:45:06,177][123091] Updated weights for policy 0, policy_version 396506 (0.0010) [2023-12-26 02:45:06,236][123091] Updated weights for policy 0, policy_version 396516 (0.0006) [2023-12-26 02:45:06,307][123091] Updated weights for policy 0, policy_version 396526 (0.0005) [2023-12-26 02:45:06,936][123091] Updated weights for policy 0, policy_version 396536 (0.0005) [2023-12-26 02:45:06,995][123091] Updated weights for policy 0, policy_version 396546 (0.0005) [2023-12-26 02:45:07,028][123090] Updated weights for policy 1, policy_version 394247 (0.0008) [2023-12-26 02:45:07,050][123091] Updated weights for policy 0, policy_version 396556 (0.0009) [2023-12-26 02:45:07,096][123090] Updated weights for policy 1, policy_version 394257 (0.0007) [2023-12-26 02:45:07,150][123090] Updated weights for policy 1, policy_version 394267 (0.0009) [2023-12-26 02:45:07,761][123091] Updated weights for policy 0, policy_version 396566 (0.0008) [2023-12-26 02:45:07,820][123091] Updated weights for policy 0, policy_version 396576 (0.0005) [2023-12-26 02:45:07,875][123091] Updated weights for policy 0, policy_version 396586 (0.0007) [2023-12-26 02:45:08,039][123090] Updated weights for policy 1, policy_version 394277 (0.0009) [2023-12-26 02:45:08,101][123090] Updated weights for policy 1, policy_version 394287 (0.0009) [2023-12-26 02:45:08,171][123090] Updated weights for policy 1, policy_version 394297 (0.0009) [2023-12-26 02:45:08,670][123091] Updated weights for policy 0, policy_version 396596 (0.0009) [2023-12-26 02:45:08,731][123091] Updated weights for policy 0, policy_version 396606 (0.0009) [2023-12-26 02:45:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 202473472. Throughput: 0: 8782.6, 1: 8776.8. Samples: 202454840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:08,785][121949] Avg episode reward: [(0, '6127.397'), (1, '5510.123')] [2023-12-26 02:45:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000394304_100941824.pth... [2023-12-26 02:45:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000393280_100679680.pth [2023-12-26 02:45:08,803][123091] Updated weights for policy 0, policy_version 396616 (0.0009) [2023-12-26 02:45:08,856][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000396624_101539840.pth... [2023-12-26 02:45:08,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000395568_101269504.pth [2023-12-26 02:45:08,984][123090] Updated weights for policy 1, policy_version 394307 (0.0010) [2023-12-26 02:45:09,054][123090] Updated weights for policy 1, policy_version 394317 (0.0009) [2023-12-26 02:45:09,120][123090] Updated weights for policy 1, policy_version 394327 (0.0009) [2023-12-26 02:45:09,639][123091] Updated weights for policy 0, policy_version 396626 (0.0009) [2023-12-26 02:45:09,701][123091] Updated weights for policy 0, policy_version 396636 (0.0010) [2023-12-26 02:45:09,767][123091] Updated weights for policy 0, policy_version 396646 (0.0009) [2023-12-26 02:45:09,833][123091] Updated weights for policy 0, policy_version 396656 (0.0010) [2023-12-26 02:45:09,924][123090] Updated weights for policy 1, policy_version 394337 (0.0009) [2023-12-26 02:45:09,990][123090] Updated weights for policy 1, policy_version 394347 (0.0008) [2023-12-26 02:45:10,060][123090] Updated weights for policy 1, policy_version 394357 (0.0008) [2023-12-26 02:45:10,126][123090] Updated weights for policy 1, policy_version 394367 (0.0008) [2023-12-26 02:45:10,676][123091] Updated weights for policy 0, policy_version 396666 (0.0011) [2023-12-26 02:45:10,744][123091] Updated weights for policy 0, policy_version 396676 (0.0011) [2023-12-26 02:45:10,804][123091] Updated weights for policy 0, policy_version 396686 (0.0011) [2023-12-26 02:45:10,847][123090] Updated weights for policy 1, policy_version 394377 (0.0010) [2023-12-26 02:45:10,906][123090] Updated weights for policy 1, policy_version 394387 (0.0011) [2023-12-26 02:45:10,957][123090] Updated weights for policy 1, policy_version 394397 (0.0006) [2023-12-26 02:45:11,655][123091] Updated weights for policy 0, policy_version 396696 (0.0010) [2023-12-26 02:45:11,721][123091] Updated weights for policy 0, policy_version 396706 (0.0010) [2023-12-26 02:45:11,792][123091] Updated weights for policy 0, policy_version 396716 (0.0008) [2023-12-26 02:45:11,862][123090] Updated weights for policy 1, policy_version 394407 (0.0007) [2023-12-26 02:45:11,931][123090] Updated weights for policy 1, policy_version 394417 (0.0009) [2023-12-26 02:45:11,997][123090] Updated weights for policy 1, policy_version 394427 (0.0009) [2023-12-26 02:45:12,572][123091] Updated weights for policy 0, policy_version 396726 (0.0011) [2023-12-26 02:45:12,639][123091] Updated weights for policy 0, policy_version 396736 (0.0007) [2023-12-26 02:45:12,696][123091] Updated weights for policy 0, policy_version 396746 (0.0005) [2023-12-26 02:45:12,780][123090] Updated weights for policy 1, policy_version 394437 (0.0009) [2023-12-26 02:45:12,849][123090] Updated weights for policy 1, policy_version 394447 (0.0007) [2023-12-26 02:45:12,914][123090] Updated weights for policy 1, policy_version 394457 (0.0006) [2023-12-26 02:45:13,373][123091] Updated weights for policy 0, policy_version 396756 (0.0005) [2023-12-26 02:45:13,442][123091] Updated weights for policy 0, policy_version 396766 (0.0005) [2023-12-26 02:45:13,504][123091] Updated weights for policy 0, policy_version 396776 (0.0005) [2023-12-26 02:45:13,555][123090] Updated weights for policy 1, policy_version 394467 (0.0006) [2023-12-26 02:45:13,619][123090] Updated weights for policy 1, policy_version 394477 (0.0008) [2023-12-26 02:45:13,697][123090] Updated weights for policy 1, policy_version 394487 (0.0007) [2023-12-26 02:45:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 202571776. Throughput: 0: 8801.5, 1: 8699.8. Samples: 202558512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:13,785][121949] Avg episode reward: [(0, '6084.031'), (1, '5562.748')] [2023-12-26 02:45:14,201][123091] Updated weights for policy 0, policy_version 396786 (0.0006) [2023-12-26 02:45:14,260][123091] Updated weights for policy 0, policy_version 396796 (0.0011) [2023-12-26 02:45:14,320][123091] Updated weights for policy 0, policy_version 396806 (0.0011) [2023-12-26 02:45:14,385][123090] Updated weights for policy 1, policy_version 394497 (0.0006) [2023-12-26 02:45:14,386][123091] Updated weights for policy 0, policy_version 396816 (0.0011) [2023-12-26 02:45:14,441][123090] Updated weights for policy 1, policy_version 394507 (0.0009) [2023-12-26 02:45:14,507][123090] Updated weights for policy 1, policy_version 394517 (0.0009) [2023-12-26 02:45:14,577][123090] Updated weights for policy 1, policy_version 394527 (0.0009) [2023-12-26 02:45:15,198][123091] Updated weights for policy 0, policy_version 396826 (0.0006) [2023-12-26 02:45:15,265][123091] Updated weights for policy 0, policy_version 396836 (0.0006) [2023-12-26 02:45:15,332][123091] Updated weights for policy 0, policy_version 396846 (0.0011) [2023-12-26 02:45:15,366][123090] Updated weights for policy 1, policy_version 394537 (0.0007) [2023-12-26 02:45:15,425][123090] Updated weights for policy 1, policy_version 394547 (0.0009) [2023-12-26 02:45:15,496][123090] Updated weights for policy 1, policy_version 394557 (0.0011) [2023-12-26 02:45:16,090][123091] Updated weights for policy 0, policy_version 396856 (0.0011) [2023-12-26 02:45:16,141][123091] Updated weights for policy 0, policy_version 396866 (0.0010) [2023-12-26 02:45:16,193][123091] Updated weights for policy 0, policy_version 396876 (0.0010) [2023-12-26 02:45:16,306][123090] Updated weights for policy 1, policy_version 394567 (0.0010) [2023-12-26 02:45:16,353][123090] Updated weights for policy 1, policy_version 394577 (0.0010) [2023-12-26 02:45:16,407][123090] Updated weights for policy 1, policy_version 394587 (0.0010) [2023-12-26 02:45:16,922][123091] Updated weights for policy 0, policy_version 396886 (0.0007) [2023-12-26 02:45:16,978][123091] Updated weights for policy 0, policy_version 396896 (0.0005) [2023-12-26 02:45:17,030][123091] Updated weights for policy 0, policy_version 396906 (0.0005) [2023-12-26 02:45:17,137][123090] Updated weights for policy 1, policy_version 394597 (0.0005) [2023-12-26 02:45:17,196][123090] Updated weights for policy 1, policy_version 394607 (0.0005) [2023-12-26 02:45:17,244][123090] Updated weights for policy 1, policy_version 394617 (0.0005) [2023-12-26 02:45:17,700][123091] Updated weights for policy 0, policy_version 396916 (0.0005) [2023-12-26 02:45:17,753][123091] Updated weights for policy 0, policy_version 396926 (0.0005) [2023-12-26 02:45:17,815][123091] Updated weights for policy 0, policy_version 396936 (0.0005) [2023-12-26 02:45:17,878][123090] Updated weights for policy 1, policy_version 394627 (0.0007) [2023-12-26 02:45:17,930][123090] Updated weights for policy 1, policy_version 394637 (0.0010) [2023-12-26 02:45:17,982][123090] Updated weights for policy 1, policy_version 394647 (0.0010) [2023-12-26 02:45:18,410][123091] Updated weights for policy 0, policy_version 396946 (0.0006) [2023-12-26 02:45:18,475][123091] Updated weights for policy 0, policy_version 396956 (0.0009) [2023-12-26 02:45:18,524][123091] Updated weights for policy 0, policy_version 396966 (0.0009) [2023-12-26 02:45:18,581][123091] Updated weights for policy 0, policy_version 396976 (0.0009) [2023-12-26 02:45:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 202661888. Throughput: 0: 8913.3, 1: 8840.4. Samples: 202673216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:18,785][121949] Avg episode reward: [(0, '5984.609'), (1, '5446.118')] [2023-12-26 02:45:18,801][123090] Updated weights for policy 1, policy_version 394657 (0.0010) [2023-12-26 02:45:18,855][123090] Updated weights for policy 1, policy_version 394667 (0.0010) [2023-12-26 02:45:18,925][123090] Updated weights for policy 1, policy_version 394677 (0.0009) [2023-12-26 02:45:18,993][123090] Updated weights for policy 1, policy_version 394687 (0.0010) [2023-12-26 02:45:19,311][123091] Updated weights for policy 0, policy_version 396986 (0.0009) [2023-12-26 02:45:19,385][123091] Updated weights for policy 0, policy_version 396996 (0.0008) [2023-12-26 02:45:19,447][123091] Updated weights for policy 0, policy_version 397006 (0.0009) [2023-12-26 02:45:19,896][123090] Updated weights for policy 1, policy_version 394697 (0.0009) [2023-12-26 02:45:19,964][123090] Updated weights for policy 1, policy_version 394707 (0.0010) [2023-12-26 02:45:20,034][123090] Updated weights for policy 1, policy_version 394717 (0.0010) [2023-12-26 02:45:20,279][123091] Updated weights for policy 0, policy_version 397016 (0.0009) [2023-12-26 02:45:20,346][123091] Updated weights for policy 0, policy_version 397026 (0.0008) [2023-12-26 02:45:20,413][123091] Updated weights for policy 0, policy_version 397036 (0.0008) [2023-12-26 02:45:20,934][123090] Updated weights for policy 1, policy_version 394727 (0.0009) [2023-12-26 02:45:20,999][123090] Updated weights for policy 1, policy_version 394737 (0.0010) [2023-12-26 02:45:21,069][123090] Updated weights for policy 1, policy_version 394747 (0.0010) [2023-12-26 02:45:21,158][123091] Updated weights for policy 0, policy_version 397046 (0.0009) [2023-12-26 02:45:21,233][123091] Updated weights for policy 0, policy_version 397056 (0.0007) [2023-12-26 02:45:21,306][123091] Updated weights for policy 0, policy_version 397066 (0.0009) [2023-12-26 02:45:21,927][123090] Updated weights for policy 1, policy_version 394757 (0.0010) [2023-12-26 02:45:21,990][123090] Updated weights for policy 1, policy_version 394767 (0.0009) [2023-12-26 02:45:22,052][123090] Updated weights for policy 1, policy_version 394777 (0.0009) [2023-12-26 02:45:22,128][123091] Updated weights for policy 0, policy_version 397076 (0.0009) [2023-12-26 02:45:22,194][123091] Updated weights for policy 0, policy_version 397086 (0.0010) [2023-12-26 02:45:22,254][123091] Updated weights for policy 0, policy_version 397096 (0.0010) [2023-12-26 02:45:22,892][123090] Updated weights for policy 1, policy_version 394787 (0.0010) [2023-12-26 02:45:22,946][123090] Updated weights for policy 1, policy_version 394797 (0.0009) [2023-12-26 02:45:23,003][123090] Updated weights for policy 1, policy_version 394807 (0.0009) [2023-12-26 02:45:23,120][123091] Updated weights for policy 0, policy_version 397106 (0.0009) [2023-12-26 02:45:23,168][123091] Updated weights for policy 0, policy_version 397116 (0.0007) [2023-12-26 02:45:23,235][123091] Updated weights for policy 0, policy_version 397126 (0.0006) [2023-12-26 02:45:23,296][123091] Updated weights for policy 0, policy_version 397136 (0.0005) [2023-12-26 02:45:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17717.0). Total num frames: 202743808. Throughput: 0: 8947.2, 1: 8793.2. Samples: 202723632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:23,785][121949] Avg episode reward: [(0, '6128.439'), (1, '5458.207')] [2023-12-26 02:45:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000397136_101670912.pth... [2023-12-26 02:45:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000394816_101072896.pth... [2023-12-26 02:45:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000396080_101400576.pth [2023-12-26 02:45:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000393792_100810752.pth [2023-12-26 02:45:23,924][123090] Updated weights for policy 1, policy_version 394817 (0.0009) [2023-12-26 02:45:23,966][123091] Updated weights for policy 0, policy_version 397146 (0.0006) [2023-12-26 02:45:23,980][123090] Updated weights for policy 1, policy_version 394827 (0.0009) [2023-12-26 02:45:24,020][123091] Updated weights for policy 0, policy_version 397156 (0.0006) [2023-12-26 02:45:24,027][123090] Updated weights for policy 1, policy_version 394837 (0.0008) [2023-12-26 02:45:24,069][123091] Updated weights for policy 0, policy_version 397166 (0.0009) [2023-12-26 02:45:24,090][123090] Updated weights for policy 1, policy_version 394847 (0.0007) [2023-12-26 02:45:24,845][123091] Updated weights for policy 0, policy_version 397176 (0.0008) [2023-12-26 02:45:24,850][123090] Updated weights for policy 1, policy_version 394857 (0.0006) [2023-12-26 02:45:24,908][123091] Updated weights for policy 0, policy_version 397186 (0.0008) [2023-12-26 02:45:24,914][123090] Updated weights for policy 1, policy_version 394867 (0.0008) [2023-12-26 02:45:24,969][123091] Updated weights for policy 0, policy_version 397196 (0.0006) [2023-12-26 02:45:24,979][123090] Updated weights for policy 1, policy_version 394877 (0.0006) [2023-12-26 02:45:25,663][123090] Updated weights for policy 1, policy_version 394887 (0.0008) [2023-12-26 02:45:25,719][123090] Updated weights for policy 1, policy_version 394897 (0.0009) [2023-12-26 02:45:25,735][123091] Updated weights for policy 0, policy_version 397206 (0.0007) [2023-12-26 02:45:25,776][123090] Updated weights for policy 1, policy_version 394907 (0.0008) [2023-12-26 02:45:25,795][123091] Updated weights for policy 0, policy_version 397216 (0.0008) [2023-12-26 02:45:25,855][123091] Updated weights for policy 0, policy_version 397226 (0.0010) [2023-12-26 02:45:26,567][123090] Updated weights for policy 1, policy_version 394917 (0.0009) [2023-12-26 02:45:26,630][123090] Updated weights for policy 1, policy_version 394927 (0.0008) [2023-12-26 02:45:26,685][123090] Updated weights for policy 1, policy_version 394937 (0.0006) [2023-12-26 02:45:26,706][123091] Updated weights for policy 0, policy_version 397236 (0.0009) [2023-12-26 02:45:26,766][123091] Updated weights for policy 0, policy_version 397246 (0.0010) [2023-12-26 02:45:26,822][123091] Updated weights for policy 0, policy_version 397256 (0.0009) [2023-12-26 02:45:27,433][123090] Updated weights for policy 1, policy_version 394947 (0.0007) [2023-12-26 02:45:27,512][123090] Updated weights for policy 1, policy_version 394957 (0.0010) [2023-12-26 02:45:27,550][123091] Updated weights for policy 0, policy_version 397266 (0.0008) [2023-12-26 02:45:27,581][123090] Updated weights for policy 1, policy_version 394967 (0.0010) [2023-12-26 02:45:27,601][123091] Updated weights for policy 0, policy_version 397276 (0.0005) [2023-12-26 02:45:27,646][123091] Updated weights for policy 0, policy_version 397286 (0.0005) [2023-12-26 02:45:27,697][123091] Updated weights for policy 0, policy_version 397296 (0.0007) [2023-12-26 02:45:28,322][123090] Updated weights for policy 1, policy_version 394977 (0.0010) [2023-12-26 02:45:28,386][123091] Updated weights for policy 0, policy_version 397306 (0.0008) [2023-12-26 02:45:28,387][123090] Updated weights for policy 1, policy_version 394987 (0.0007) [2023-12-26 02:45:28,444][123091] Updated weights for policy 0, policy_version 397316 (0.0008) [2023-12-26 02:45:28,445][123090] Updated weights for policy 1, policy_version 394997 (0.0007) [2023-12-26 02:45:28,500][123090] Updated weights for policy 1, policy_version 395007 (0.0008) [2023-12-26 02:45:28,503][123091] Updated weights for policy 0, policy_version 397326 (0.0007) [2023-12-26 02:45:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 202842112. Throughput: 0: 9038.0, 1: 8851.1. Samples: 202830976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:28,784][121949] Avg episode reward: [(0, '6051.881'), (1, '5496.904')] [2023-12-26 02:45:29,165][123090] Updated weights for policy 1, policy_version 395017 (0.0005) [2023-12-26 02:45:29,223][123090] Updated weights for policy 1, policy_version 395027 (0.0006) [2023-12-26 02:45:29,296][123090] Updated weights for policy 1, policy_version 395037 (0.0007) [2023-12-26 02:45:29,387][123091] Updated weights for policy 0, policy_version 397336 (0.0010) [2023-12-26 02:45:29,441][123091] Updated weights for policy 0, policy_version 397346 (0.0008) [2023-12-26 02:45:29,509][123091] Updated weights for policy 0, policy_version 397356 (0.0009) [2023-12-26 02:45:30,084][123090] Updated weights for policy 1, policy_version 395047 (0.0006) [2023-12-26 02:45:30,143][123090] Updated weights for policy 1, policy_version 395057 (0.0005) [2023-12-26 02:45:30,214][123090] Updated weights for policy 1, policy_version 395067 (0.0007) [2023-12-26 02:45:30,390][123091] Updated weights for policy 0, policy_version 397366 (0.0009) [2023-12-26 02:45:30,448][123091] Updated weights for policy 0, policy_version 397376 (0.0009) [2023-12-26 02:45:30,512][123091] Updated weights for policy 0, policy_version 397386 (0.0009) [2023-12-26 02:45:30,819][123090] Updated weights for policy 1, policy_version 395077 (0.0005) [2023-12-26 02:45:30,879][123090] Updated weights for policy 1, policy_version 395087 (0.0005) [2023-12-26 02:45:30,942][123090] Updated weights for policy 1, policy_version 395097 (0.0005) [2023-12-26 02:45:31,401][123091] Updated weights for policy 0, policy_version 397396 (0.0008) [2023-12-26 02:45:31,459][123091] Updated weights for policy 0, policy_version 397406 (0.0009) [2023-12-26 02:45:31,526][123091] Updated weights for policy 0, policy_version 397416 (0.0009) [2023-12-26 02:45:31,636][123090] Updated weights for policy 1, policy_version 395107 (0.0006) [2023-12-26 02:45:31,701][123090] Updated weights for policy 1, policy_version 395117 (0.0007) [2023-12-26 02:45:31,770][123090] Updated weights for policy 1, policy_version 395127 (0.0008) [2023-12-26 02:45:32,433][123091] Updated weights for policy 0, policy_version 397426 (0.0008) [2023-12-26 02:45:32,461][123090] Updated weights for policy 1, policy_version 395137 (0.0007) [2023-12-26 02:45:32,494][123091] Updated weights for policy 0, policy_version 397436 (0.0009) [2023-12-26 02:45:32,520][123090] Updated weights for policy 1, policy_version 395147 (0.0011) [2023-12-26 02:45:32,551][123091] Updated weights for policy 0, policy_version 397446 (0.0010) [2023-12-26 02:45:32,583][123090] Updated weights for policy 1, policy_version 395157 (0.0011) [2023-12-26 02:45:32,604][123091] Updated weights for policy 0, policy_version 397456 (0.0006) [2023-12-26 02:45:32,650][123090] Updated weights for policy 1, policy_version 395167 (0.0010) [2023-12-26 02:45:33,352][123090] Updated weights for policy 1, policy_version 395177 (0.0006) [2023-12-26 02:45:33,384][123091] Updated weights for policy 0, policy_version 397466 (0.0009) [2023-12-26 02:45:33,410][123090] Updated weights for policy 1, policy_version 395187 (0.0005) [2023-12-26 02:45:33,432][123091] Updated weights for policy 0, policy_version 397477 (0.0009) [2023-12-26 02:45:33,460][123090] Updated weights for policy 1, policy_version 395197 (0.0005) [2023-12-26 02:45:33,481][123091] Updated weights for policy 0, policy_version 397487 (0.0009) [2023-12-26 02:45:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 202932224. Throughput: 0: 8875.3, 1: 9006.0. Samples: 202940332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:33,785][121949] Avg episode reward: [(0, '6122.178'), (1, '5343.683')] [2023-12-26 02:45:34,183][123090] Updated weights for policy 1, policy_version 395207 (0.0009) [2023-12-26 02:45:34,251][123090] Updated weights for policy 1, policy_version 395217 (0.0011) [2023-12-26 02:45:34,320][123090] Updated weights for policy 1, policy_version 395227 (0.0010) [2023-12-26 02:45:34,459][123091] Updated weights for policy 0, policy_version 397497 (0.0006) [2023-12-26 02:45:34,519][123091] Updated weights for policy 0, policy_version 397507 (0.0005) [2023-12-26 02:45:34,582][123091] Updated weights for policy 0, policy_version 397517 (0.0006) [2023-12-26 02:45:35,136][123090] Updated weights for policy 1, policy_version 395237 (0.0010) [2023-12-26 02:45:35,183][123090] Updated weights for policy 1, policy_version 395247 (0.0010) [2023-12-26 02:45:35,230][123090] Updated weights for policy 1, policy_version 395257 (0.0010) [2023-12-26 02:45:35,317][123091] Updated weights for policy 0, policy_version 397527 (0.0008) [2023-12-26 02:45:35,379][123091] Updated weights for policy 0, policy_version 397537 (0.0011) [2023-12-26 02:45:35,441][123091] Updated weights for policy 0, policy_version 397547 (0.0011) [2023-12-26 02:45:36,090][123090] Updated weights for policy 1, policy_version 395267 (0.0010) [2023-12-26 02:45:36,122][123091] Updated weights for policy 0, policy_version 397557 (0.0010) [2023-12-26 02:45:36,171][123090] Updated weights for policy 1, policy_version 395277 (0.0007) [2023-12-26 02:45:36,174][123091] Updated weights for policy 0, policy_version 397567 (0.0007) [2023-12-26 02:45:36,233][123091] Updated weights for policy 0, policy_version 397577 (0.0008) [2023-12-26 02:45:36,242][123090] Updated weights for policy 1, policy_version 395287 (0.0010) [2023-12-26 02:45:36,982][123090] Updated weights for policy 1, policy_version 395297 (0.0011) [2023-12-26 02:45:37,033][123091] Updated weights for policy 0, policy_version 397587 (0.0009) [2023-12-26 02:45:37,048][123090] Updated weights for policy 1, policy_version 395307 (0.0011) [2023-12-26 02:45:37,097][123091] Updated weights for policy 0, policy_version 397597 (0.0008) [2023-12-26 02:45:37,111][123090] Updated weights for policy 1, policy_version 395317 (0.0009) [2023-12-26 02:45:37,158][123091] Updated weights for policy 0, policy_version 397607 (0.0008) [2023-12-26 02:45:37,172][123090] Updated weights for policy 1, policy_version 395327 (0.0011) [2023-12-26 02:45:37,883][123091] Updated weights for policy 0, policy_version 397617 (0.0008) [2023-12-26 02:45:37,934][123091] Updated weights for policy 0, policy_version 397627 (0.0005) [2023-12-26 02:45:37,991][123091] Updated weights for policy 0, policy_version 397637 (0.0006) [2023-12-26 02:45:37,999][123090] Updated weights for policy 1, policy_version 395337 (0.0010) [2023-12-26 02:45:38,050][123091] Updated weights for policy 0, policy_version 397647 (0.0005) [2023-12-26 02:45:38,056][123090] Updated weights for policy 1, policy_version 395347 (0.0011) [2023-12-26 02:45:38,123][123090] Updated weights for policy 1, policy_version 395357 (0.0010) [2023-12-26 02:45:38,658][123091] Updated weights for policy 0, policy_version 397657 (0.0005) [2023-12-26 02:45:38,705][123091] Updated weights for policy 0, policy_version 397667 (0.0006) [2023-12-26 02:45:38,758][123091] Updated weights for policy 0, policy_version 397677 (0.0007) [2023-12-26 02:45:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 203022336. Throughput: 0: 8930.6, 1: 9021.1. Samples: 202994212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:38,785][121949] Avg episode reward: [(0, '6188.479'), (1, '5320.669')] [2023-12-26 02:45:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000397680_101810176.pth... [2023-12-26 02:45:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000395360_101212160.pth... [2023-12-26 02:45:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000396624_101539840.pth [2023-12-26 02:45:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000394304_100941824.pth [2023-12-26 02:45:38,955][123090] Updated weights for policy 1, policy_version 395367 (0.0010) [2023-12-26 02:45:39,022][123090] Updated weights for policy 1, policy_version 395377 (0.0011) [2023-12-26 02:45:39,088][123090] Updated weights for policy 1, policy_version 395387 (0.0010) [2023-12-26 02:45:39,489][123091] Updated weights for policy 0, policy_version 397687 (0.0008) [2023-12-26 02:45:39,550][123091] Updated weights for policy 0, policy_version 397697 (0.0009) [2023-12-26 02:45:39,618][123091] Updated weights for policy 0, policy_version 397707 (0.0009) [2023-12-26 02:45:39,882][123090] Updated weights for policy 1, policy_version 395397 (0.0008) [2023-12-26 02:45:39,950][123090] Updated weights for policy 1, policy_version 395407 (0.0007) [2023-12-26 02:45:40,006][123090] Updated weights for policy 1, policy_version 395417 (0.0006) [2023-12-26 02:45:40,496][123091] Updated weights for policy 0, policy_version 397717 (0.0010) [2023-12-26 02:45:40,558][123091] Updated weights for policy 0, policy_version 397727 (0.0010) [2023-12-26 02:45:40,623][123091] Updated weights for policy 0, policy_version 397737 (0.0010) [2023-12-26 02:45:40,743][123090] Updated weights for policy 1, policy_version 395427 (0.0005) [2023-12-26 02:45:40,805][123090] Updated weights for policy 1, policy_version 395437 (0.0005) [2023-12-26 02:45:40,862][123090] Updated weights for policy 1, policy_version 395447 (0.0005) [2023-12-26 02:45:41,530][123091] Updated weights for policy 0, policy_version 397747 (0.0011) [2023-12-26 02:45:41,594][123091] Updated weights for policy 0, policy_version 397757 (0.0009) [2023-12-26 02:45:41,610][123090] Updated weights for policy 1, policy_version 395457 (0.0006) [2023-12-26 02:45:41,660][123091] Updated weights for policy 0, policy_version 397767 (0.0008) [2023-12-26 02:45:41,677][123090] Updated weights for policy 1, policy_version 395467 (0.0008) [2023-12-26 02:45:41,755][123090] Updated weights for policy 1, policy_version 395477 (0.0008) [2023-12-26 02:45:41,817][123090] Updated weights for policy 1, policy_version 395487 (0.0008) [2023-12-26 02:45:42,524][123091] Updated weights for policy 0, policy_version 397777 (0.0009) [2023-12-26 02:45:42,590][123091] Updated weights for policy 0, policy_version 397787 (0.0009) [2023-12-26 02:45:42,598][123090] Updated weights for policy 1, policy_version 395497 (0.0009) [2023-12-26 02:45:42,657][123091] Updated weights for policy 0, policy_version 397797 (0.0008) [2023-12-26 02:45:42,660][123090] Updated weights for policy 1, policy_version 395507 (0.0009) [2023-12-26 02:45:42,716][123090] Updated weights for policy 1, policy_version 395517 (0.0009) [2023-12-26 02:45:42,724][123091] Updated weights for policy 0, policy_version 397807 (0.0008) [2023-12-26 02:45:43,347][123090] Updated weights for policy 1, policy_version 395527 (0.0009) [2023-12-26 02:45:43,395][123090] Updated weights for policy 1, policy_version 395537 (0.0010) [2023-12-26 02:45:43,442][123090] Updated weights for policy 1, policy_version 395547 (0.0010) [2023-12-26 02:45:43,555][123091] Updated weights for policy 0, policy_version 397817 (0.0009) [2023-12-26 02:45:43,625][123091] Updated weights for policy 0, policy_version 397827 (0.0009) [2023-12-26 02:45:43,690][123091] Updated weights for policy 0, policy_version 397837 (0.0009) [2023-12-26 02:45:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 203112448. Throughput: 0: 8967.8, 1: 9003.0. Samples: 203101768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:43,784][121949] Avg episode reward: [(0, '6242.340'), (1, '5637.314')] [2023-12-26 02:45:44,245][123090] Updated weights for policy 1, policy_version 395557 (0.0010) [2023-12-26 02:45:44,309][123090] Updated weights for policy 1, policy_version 395567 (0.0009) [2023-12-26 02:45:44,374][123090] Updated weights for policy 1, policy_version 395577 (0.0009) [2023-12-26 02:45:44,501][123091] Updated weights for policy 0, policy_version 397847 (0.0009) [2023-12-26 02:45:44,558][123091] Updated weights for policy 0, policy_version 397857 (0.0009) [2023-12-26 02:45:44,614][123091] Updated weights for policy 0, policy_version 397867 (0.0009) [2023-12-26 02:45:45,201][123090] Updated weights for policy 1, policy_version 395587 (0.0010) [2023-12-26 02:45:45,269][123090] Updated weights for policy 1, policy_version 395597 (0.0011) [2023-12-26 02:45:45,336][123090] Updated weights for policy 1, policy_version 395607 (0.0011) [2023-12-26 02:45:45,478][123091] Updated weights for policy 0, policy_version 397877 (0.0010) [2023-12-26 02:45:45,540][123091] Updated weights for policy 0, policy_version 397887 (0.0009) [2023-12-26 02:45:45,606][123091] Updated weights for policy 0, policy_version 397897 (0.0010) [2023-12-26 02:45:46,112][123090] Updated weights for policy 1, policy_version 395617 (0.0010) [2023-12-26 02:45:46,177][123090] Updated weights for policy 1, policy_version 395627 (0.0008) [2023-12-26 02:45:46,257][123090] Updated weights for policy 1, policy_version 395637 (0.0005) [2023-12-26 02:45:46,309][123090] Updated weights for policy 1, policy_version 395647 (0.0009) [2023-12-26 02:45:46,434][123091] Updated weights for policy 0, policy_version 397907 (0.0009) [2023-12-26 02:45:46,486][123091] Updated weights for policy 0, policy_version 397917 (0.0009) [2023-12-26 02:45:46,535][123091] Updated weights for policy 0, policy_version 397927 (0.0010) [2023-12-26 02:45:47,005][123090] Updated weights for policy 1, policy_version 395657 (0.0008) [2023-12-26 02:45:47,053][123090] Updated weights for policy 1, policy_version 395667 (0.0005) [2023-12-26 02:45:47,098][123090] Updated weights for policy 1, policy_version 395677 (0.0005) [2023-12-26 02:45:47,439][123091] Updated weights for policy 0, policy_version 397937 (0.0008) [2023-12-26 02:45:47,496][123091] Updated weights for policy 0, policy_version 397947 (0.0009) [2023-12-26 02:45:47,555][123091] Updated weights for policy 0, policy_version 397957 (0.0009) [2023-12-26 02:45:47,616][123091] Updated weights for policy 0, policy_version 397967 (0.0010) [2023-12-26 02:45:47,844][123090] Updated weights for policy 1, policy_version 395687 (0.0008) [2023-12-26 02:45:47,901][123090] Updated weights for policy 1, policy_version 395697 (0.0009) [2023-12-26 02:45:47,961][123090] Updated weights for policy 1, policy_version 395707 (0.0009) [2023-12-26 02:45:48,455][123091] Updated weights for policy 0, policy_version 397977 (0.0009) [2023-12-26 02:45:48,515][123091] Updated weights for policy 0, policy_version 397987 (0.0009) [2023-12-26 02:45:48,575][123091] Updated weights for policy 0, policy_version 397997 (0.0009) [2023-12-26 02:45:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 203194368. Throughput: 0: 8876.6, 1: 9025.8. Samples: 203206000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:48,786][121949] Avg episode reward: [(0, '6221.681'), (1, '5373.610')] [2023-12-26 02:45:48,800][123090] Updated weights for policy 1, policy_version 395717 (0.0009) [2023-12-26 02:45:48,873][123090] Updated weights for policy 1, policy_version 395727 (0.0007) [2023-12-26 02:45:48,945][123090] Updated weights for policy 1, policy_version 395737 (0.0006) [2023-12-26 02:45:49,454][123091] Updated weights for policy 0, policy_version 398007 (0.0009) [2023-12-26 02:45:49,510][123091] Updated weights for policy 0, policy_version 398017 (0.0010) [2023-12-26 02:45:49,559][123091] Updated weights for policy 0, policy_version 398027 (0.0009) [2023-12-26 02:45:49,740][123090] Updated weights for policy 1, policy_version 395747 (0.0006) [2023-12-26 02:45:49,809][123090] Updated weights for policy 1, policy_version 395757 (0.0005) [2023-12-26 02:45:49,877][123090] Updated weights for policy 1, policy_version 395767 (0.0009) [2023-12-26 02:45:50,446][123091] Updated weights for policy 0, policy_version 398037 (0.0010) [2023-12-26 02:45:50,499][123091] Updated weights for policy 0, policy_version 398047 (0.0009) [2023-12-26 02:45:50,560][123091] Updated weights for policy 0, policy_version 398057 (0.0010) [2023-12-26 02:45:50,644][123090] Updated weights for policy 1, policy_version 395777 (0.0009) [2023-12-26 02:45:50,709][123090] Updated weights for policy 1, policy_version 395787 (0.0008) [2023-12-26 02:45:50,770][123090] Updated weights for policy 1, policy_version 395797 (0.0010) [2023-12-26 02:45:50,835][123090] Updated weights for policy 1, policy_version 395807 (0.0010) [2023-12-26 02:45:51,416][123091] Updated weights for policy 0, policy_version 398067 (0.0010) [2023-12-26 02:45:51,474][123091] Updated weights for policy 0, policy_version 398077 (0.0010) [2023-12-26 02:45:51,533][123091] Updated weights for policy 0, policy_version 398088 (0.0010) [2023-12-26 02:45:51,661][123090] Updated weights for policy 1, policy_version 395817 (0.0009) [2023-12-26 02:45:51,718][123090] Updated weights for policy 1, policy_version 395827 (0.0010) [2023-12-26 02:45:51,789][123090] Updated weights for policy 1, policy_version 395837 (0.0005) [2023-12-26 02:45:52,340][123091] Updated weights for policy 0, policy_version 398098 (0.0010) [2023-12-26 02:45:52,407][123091] Updated weights for policy 0, policy_version 398108 (0.0010) [2023-12-26 02:45:52,481][123091] Updated weights for policy 0, policy_version 398118 (0.0009) [2023-12-26 02:45:52,549][123091] Updated weights for policy 0, policy_version 398128 (0.0009) [2023-12-26 02:45:52,593][123090] Updated weights for policy 1, policy_version 395847 (0.0007) [2023-12-26 02:45:52,657][123090] Updated weights for policy 1, policy_version 395857 (0.0005) [2023-12-26 02:45:52,726][123090] Updated weights for policy 1, policy_version 395867 (0.0010) [2023-12-26 02:45:53,425][123091] Updated weights for policy 0, policy_version 398138 (0.0008) [2023-12-26 02:45:53,429][123090] Updated weights for policy 1, policy_version 395877 (0.0009) [2023-12-26 02:45:53,488][123091] Updated weights for policy 0, policy_version 398148 (0.0008) [2023-12-26 02:45:53,489][123090] Updated weights for policy 1, policy_version 395887 (0.0008) [2023-12-26 02:45:53,539][123091] Updated weights for policy 0, policy_version 398158 (0.0006) [2023-12-26 02:45:53,551][123090] Updated weights for policy 1, policy_version 395897 (0.0010) [2023-12-26 02:45:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 203284480. Throughput: 0: 8824.5, 1: 8997.7. Samples: 203256840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:53,784][121949] Avg episode reward: [(0, '6253.632'), (1, '5272.346')] [2023-12-26 02:45:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000398160_101933056.pth... [2023-12-26 02:45:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000395904_101351424.pth... [2023-12-26 02:45:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000397136_101670912.pth [2023-12-26 02:45:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000394816_101072896.pth [2023-12-26 02:45:54,318][123091] Updated weights for policy 0, policy_version 398168 (0.0009) [2023-12-26 02:45:54,377][123091] Updated weights for policy 0, policy_version 398178 (0.0010) [2023-12-26 02:45:54,397][123090] Updated weights for policy 1, policy_version 395907 (0.0009) [2023-12-26 02:45:54,438][123091] Updated weights for policy 0, policy_version 398188 (0.0006) [2023-12-26 02:45:54,463][123090] Updated weights for policy 1, policy_version 395917 (0.0009) [2023-12-26 02:45:54,518][123090] Updated weights for policy 1, policy_version 395927 (0.0009) [2023-12-26 02:45:55,212][123091] Updated weights for policy 0, policy_version 398198 (0.0007) [2023-12-26 02:45:55,267][123091] Updated weights for policy 0, policy_version 398208 (0.0005) [2023-12-26 02:45:55,323][123091] Updated weights for policy 0, policy_version 398218 (0.0005) [2023-12-26 02:45:55,387][123090] Updated weights for policy 1, policy_version 395937 (0.0010) [2023-12-26 02:45:55,439][123090] Updated weights for policy 1, policy_version 395947 (0.0009) [2023-12-26 02:45:55,491][123090] Updated weights for policy 1, policy_version 395957 (0.0009) [2023-12-26 02:45:55,544][123090] Updated weights for policy 1, policy_version 395967 (0.0009) [2023-12-26 02:45:55,911][123091] Updated weights for policy 0, policy_version 398228 (0.0007) [2023-12-26 02:45:55,963][123091] Updated weights for policy 0, policy_version 398238 (0.0009) [2023-12-26 02:45:56,015][123091] Updated weights for policy 0, policy_version 398248 (0.0010) [2023-12-26 02:45:56,419][123090] Updated weights for policy 1, policy_version 395977 (0.0009) [2023-12-26 02:45:56,473][123090] Updated weights for policy 1, policy_version 395987 (0.0009) [2023-12-26 02:45:56,528][123090] Updated weights for policy 1, policy_version 395997 (0.0010) [2023-12-26 02:45:56,808][123091] Updated weights for policy 0, policy_version 398258 (0.0009) [2023-12-26 02:45:56,870][123091] Updated weights for policy 0, policy_version 398268 (0.0006) [2023-12-26 02:45:56,937][123091] Updated weights for policy 0, policy_version 398278 (0.0009) [2023-12-26 02:45:56,996][123091] Updated weights for policy 0, policy_version 398288 (0.0010) [2023-12-26 02:45:57,423][123090] Updated weights for policy 1, policy_version 396007 (0.0009) [2023-12-26 02:45:57,485][123090] Updated weights for policy 1, policy_version 396017 (0.0009) [2023-12-26 02:45:57,546][123090] Updated weights for policy 1, policy_version 396027 (0.0009) [2023-12-26 02:45:57,758][123091] Updated weights for policy 0, policy_version 398298 (0.0009) [2023-12-26 02:45:57,817][123091] Updated weights for policy 0, policy_version 398308 (0.0010) [2023-12-26 02:45:57,873][123091] Updated weights for policy 0, policy_version 398318 (0.0007) [2023-12-26 02:45:58,403][123090] Updated weights for policy 1, policy_version 396037 (0.0009) [2023-12-26 02:45:58,476][123090] Updated weights for policy 1, policy_version 396047 (0.0010) [2023-12-26 02:45:58,553][123090] Updated weights for policy 1, policy_version 396057 (0.0010) [2023-12-26 02:45:58,668][123091] Updated weights for policy 0, policy_version 398328 (0.0007) [2023-12-26 02:45:58,759][123091] Updated weights for policy 0, policy_version 398338 (0.0009) [2023-12-26 02:45:58,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 203366400. Throughput: 0: 8876.4, 1: 8991.9. Samples: 203362580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:45:58,785][121949] Avg episode reward: [(0, '6251.448'), (1, '5428.665')] [2023-12-26 02:45:58,835][123091] Updated weights for policy 0, policy_version 398348 (0.0008) [2023-12-26 02:45:59,516][123090] Updated weights for policy 1, policy_version 396067 (0.0009) [2023-12-26 02:45:59,574][123091] Updated weights for policy 0, policy_version 398358 (0.0007) [2023-12-26 02:45:59,585][123090] Updated weights for policy 1, policy_version 396077 (0.0011) [2023-12-26 02:45:59,639][123091] Updated weights for policy 0, policy_version 398368 (0.0006) [2023-12-26 02:45:59,651][123090] Updated weights for policy 1, policy_version 396087 (0.0010) [2023-12-26 02:45:59,703][123091] Updated weights for policy 0, policy_version 398378 (0.0007) [2023-12-26 02:46:00,399][123090] Updated weights for policy 1, policy_version 396097 (0.0007) [2023-12-26 02:46:00,466][123090] Updated weights for policy 1, policy_version 396107 (0.0007) [2023-12-26 02:46:00,522][123091] Updated weights for policy 0, policy_version 398388 (0.0008) [2023-12-26 02:46:00,534][123090] Updated weights for policy 1, policy_version 396117 (0.0008) [2023-12-26 02:46:00,578][123091] Updated weights for policy 0, policy_version 398398 (0.0007) [2023-12-26 02:46:00,599][123090] Updated weights for policy 1, policy_version 396127 (0.0007) [2023-12-26 02:46:00,631][123091] Updated weights for policy 0, policy_version 398408 (0.0008) [2023-12-26 02:46:01,412][123090] Updated weights for policy 1, policy_version 396137 (0.0009) [2023-12-26 02:46:01,477][123090] Updated weights for policy 1, policy_version 396147 (0.0008) [2023-12-26 02:46:01,508][123091] Updated weights for policy 0, policy_version 398418 (0.0010) [2023-12-26 02:46:01,539][123090] Updated weights for policy 1, policy_version 396157 (0.0009) [2023-12-26 02:46:01,569][123091] Updated weights for policy 0, policy_version 398428 (0.0009) [2023-12-26 02:46:01,634][123091] Updated weights for policy 0, policy_version 398438 (0.0008) [2023-12-26 02:46:01,696][123091] Updated weights for policy 0, policy_version 398448 (0.0009) [2023-12-26 02:46:02,416][123090] Updated weights for policy 1, policy_version 396167 (0.0009) [2023-12-26 02:46:02,481][123090] Updated weights for policy 1, policy_version 396177 (0.0010) [2023-12-26 02:46:02,529][123091] Updated weights for policy 0, policy_version 398458 (0.0007) [2023-12-26 02:46:02,549][123090] Updated weights for policy 1, policy_version 396187 (0.0010) [2023-12-26 02:46:02,594][123091] Updated weights for policy 0, policy_version 398468 (0.0009) [2023-12-26 02:46:02,663][123091] Updated weights for policy 0, policy_version 398478 (0.0009) [2023-12-26 02:46:03,405][123090] Updated weights for policy 1, policy_version 396197 (0.0008) [2023-12-26 02:46:03,476][123090] Updated weights for policy 1, policy_version 396207 (0.0009) [2023-12-26 02:46:03,489][123091] Updated weights for policy 0, policy_version 398488 (0.0007) [2023-12-26 02:46:03,540][123090] Updated weights for policy 1, policy_version 396217 (0.0008) [2023-12-26 02:46:03,547][123091] Updated weights for policy 0, policy_version 398498 (0.0009) [2023-12-26 02:46:03,611][123091] Updated weights for policy 0, policy_version 398508 (0.0009) [2023-12-26 02:46:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 203456512. Throughput: 0: 8736.6, 1: 8810.6. Samples: 203462840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:46:03,784][121949] Avg episode reward: [(0, '6081.367'), (1, '5523.378')] [2023-12-26 02:46:04,427][123090] Updated weights for policy 1, policy_version 396227 (0.0009) [2023-12-26 02:46:04,491][123090] Updated weights for policy 1, policy_version 396237 (0.0009) [2023-12-26 02:46:04,495][123091] Updated weights for policy 0, policy_version 398518 (0.0009) [2023-12-26 02:46:04,554][123090] Updated weights for policy 1, policy_version 396247 (0.0010) [2023-12-26 02:46:04,556][123091] Updated weights for policy 0, policy_version 398528 (0.0006) [2023-12-26 02:46:04,618][123091] Updated weights for policy 0, policy_version 398538 (0.0008) [2023-12-26 02:46:05,380][123091] Updated weights for policy 0, policy_version 398548 (0.0010) [2023-12-26 02:46:05,419][123090] Updated weights for policy 1, policy_version 396257 (0.0009) [2023-12-26 02:46:05,432][123091] Updated weights for policy 0, policy_version 398558 (0.0009) [2023-12-26 02:46:05,475][123090] Updated weights for policy 1, policy_version 396267 (0.0008) [2023-12-26 02:46:05,483][123091] Updated weights for policy 0, policy_version 398568 (0.0008) [2023-12-26 02:46:05,521][123090] Updated weights for policy 1, policy_version 396277 (0.0008) [2023-12-26 02:46:05,570][123090] Updated weights for policy 1, policy_version 396287 (0.0009) [2023-12-26 02:46:06,230][123091] Updated weights for policy 0, policy_version 398578 (0.0007) [2023-12-26 02:46:06,296][123091] Updated weights for policy 0, policy_version 398588 (0.0008) [2023-12-26 02:46:06,352][123091] Updated weights for policy 0, policy_version 398598 (0.0009) [2023-12-26 02:46:06,410][123091] Updated weights for policy 0, policy_version 398608 (0.0009) [2023-12-26 02:46:06,513][123090] Updated weights for policy 1, policy_version 396297 (0.0010) [2023-12-26 02:46:06,576][123090] Updated weights for policy 1, policy_version 396307 (0.0009) [2023-12-26 02:46:06,646][123090] Updated weights for policy 1, policy_version 396317 (0.0010) [2023-12-26 02:46:07,198][123091] Updated weights for policy 0, policy_version 398618 (0.0008) [2023-12-26 02:46:07,262][123091] Updated weights for policy 0, policy_version 398628 (0.0010) [2023-12-26 02:46:07,328][123091] Updated weights for policy 0, policy_version 398638 (0.0010) [2023-12-26 02:46:07,521][123090] Updated weights for policy 1, policy_version 396327 (0.0010) [2023-12-26 02:46:07,573][123090] Updated weights for policy 1, policy_version 396337 (0.0009) [2023-12-26 02:46:07,622][123090] Updated weights for policy 1, policy_version 396347 (0.0009) [2023-12-26 02:46:08,110][123091] Updated weights for policy 0, policy_version 398648 (0.0009) [2023-12-26 02:46:08,180][123091] Updated weights for policy 0, policy_version 398658 (0.0010) [2023-12-26 02:46:08,242][123091] Updated weights for policy 0, policy_version 398668 (0.0009) [2023-12-26 02:46:08,515][123090] Updated weights for policy 1, policy_version 396357 (0.0009) [2023-12-26 02:46:08,576][123090] Updated weights for policy 1, policy_version 396367 (0.0010) [2023-12-26 02:46:08,641][123090] Updated weights for policy 1, policy_version 396377 (0.0009) [2023-12-26 02:46:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 203538432. Throughput: 0: 8733.9, 1: 8826.9. Samples: 203513872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:46:08,785][121949] Avg episode reward: [(0, '6070.572'), (1, '5465.748')] [2023-12-26 02:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000398672_102064128.pth... [2023-12-26 02:46:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000396384_101474304.pth... [2023-12-26 02:46:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000397680_101810176.pth [2023-12-26 02:46:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000395360_101212160.pth [2023-12-26 02:46:09,033][123091] Updated weights for policy 0, policy_version 398678 (0.0007) [2023-12-26 02:46:09,085][123091] Updated weights for policy 0, policy_version 398688 (0.0005) [2023-12-26 02:46:09,152][123091] Updated weights for policy 0, policy_version 398698 (0.0010) [2023-12-26 02:46:09,515][123090] Updated weights for policy 1, policy_version 396387 (0.0009) [2023-12-26 02:46:09,583][123090] Updated weights for policy 1, policy_version 396397 (0.0009) [2023-12-26 02:46:09,640][123090] Updated weights for policy 1, policy_version 396407 (0.0008) [2023-12-26 02:46:10,018][123091] Updated weights for policy 0, policy_version 398708 (0.0009) [2023-12-26 02:46:10,078][123091] Updated weights for policy 0, policy_version 398718 (0.0010) [2023-12-26 02:46:10,141][123091] Updated weights for policy 0, policy_version 398728 (0.0009) [2023-12-26 02:46:10,474][123090] Updated weights for policy 1, policy_version 396417 (0.0008) [2023-12-26 02:46:10,530][123090] Updated weights for policy 1, policy_version 396427 (0.0010) [2023-12-26 02:46:10,584][123090] Updated weights for policy 1, policy_version 396437 (0.0009) [2023-12-26 02:46:10,643][123090] Updated weights for policy 1, policy_version 396447 (0.0010) [2023-12-26 02:46:10,922][123091] Updated weights for policy 0, policy_version 398738 (0.0009) [2023-12-26 02:46:10,983][123091] Updated weights for policy 0, policy_version 398748 (0.0006) [2023-12-26 02:46:11,051][123091] Updated weights for policy 0, policy_version 398758 (0.0009) [2023-12-26 02:46:11,113][123091] Updated weights for policy 0, policy_version 398768 (0.0009) [2023-12-26 02:46:11,543][123090] Updated weights for policy 1, policy_version 396457 (0.0009) [2023-12-26 02:46:11,605][123090] Updated weights for policy 1, policy_version 396467 (0.0009) [2023-12-26 02:46:11,679][123090] Updated weights for policy 1, policy_version 396477 (0.0009) [2023-12-26 02:46:12,014][123091] Updated weights for policy 0, policy_version 398778 (0.0011) [2023-12-26 02:46:12,077][123091] Updated weights for policy 0, policy_version 398788 (0.0011) [2023-12-26 02:46:12,141][123091] Updated weights for policy 0, policy_version 398798 (0.0011) [2023-12-26 02:46:12,548][123090] Updated weights for policy 1, policy_version 396487 (0.0009) [2023-12-26 02:46:12,607][123090] Updated weights for policy 1, policy_version 396497 (0.0009) [2023-12-26 02:46:12,671][123090] Updated weights for policy 1, policy_version 396507 (0.0009) [2023-12-26 02:46:12,973][123091] Updated weights for policy 0, policy_version 398808 (0.0011) [2023-12-26 02:46:13,040][123091] Updated weights for policy 0, policy_version 398818 (0.0011) [2023-12-26 02:46:13,110][123091] Updated weights for policy 0, policy_version 398828 (0.0011) [2023-12-26 02:46:13,514][123090] Updated weights for policy 1, policy_version 396517 (0.0009) [2023-12-26 02:46:13,574][123090] Updated weights for policy 1, policy_version 396527 (0.0009) [2023-12-26 02:46:13,642][123090] Updated weights for policy 1, policy_version 396537 (0.0009) [2023-12-26 02:46:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 203620352. Throughput: 0: 8674.4, 1: 8740.2. Samples: 203614632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:46:13,784][121949] Avg episode reward: [(0, '6239.409'), (1, '5499.919')] [2023-12-26 02:46:13,931][123091] Updated weights for policy 0, policy_version 398838 (0.0011) [2023-12-26 02:46:13,996][123091] Updated weights for policy 0, policy_version 398848 (0.0010) [2023-12-26 02:46:14,052][123091] Updated weights for policy 0, policy_version 398858 (0.0011) [2023-12-26 02:46:14,479][123090] Updated weights for policy 1, policy_version 396547 (0.0009) [2023-12-26 02:46:14,542][123090] Updated weights for policy 1, policy_version 396557 (0.0009) [2023-12-26 02:46:14,598][123090] Updated weights for policy 1, policy_version 396567 (0.0009) [2023-12-26 02:46:14,829][123091] Updated weights for policy 0, policy_version 398868 (0.0011) [2023-12-26 02:46:14,889][123091] Updated weights for policy 0, policy_version 398878 (0.0010) [2023-12-26 02:46:14,947][123091] Updated weights for policy 0, policy_version 398888 (0.0008) [2023-12-26 02:46:15,522][123090] Updated weights for policy 1, policy_version 396577 (0.0010) [2023-12-26 02:46:15,575][123090] Updated weights for policy 1, policy_version 396587 (0.0010) [2023-12-26 02:46:15,630][123090] Updated weights for policy 1, policy_version 396597 (0.0009) [2023-12-26 02:46:15,655][123091] Updated weights for policy 0, policy_version 398898 (0.0007) [2023-12-26 02:46:15,693][123090] Updated weights for policy 1, policy_version 396607 (0.0008) [2023-12-26 02:46:15,725][123091] Updated weights for policy 0, policy_version 398908 (0.0011) [2023-12-26 02:46:15,807][123091] Updated weights for policy 0, policy_version 398918 (0.0010) [2023-12-26 02:46:15,865][123091] Updated weights for policy 0, policy_version 398928 (0.0005) [2023-12-26 02:46:16,491][123091] Updated weights for policy 0, policy_version 398938 (0.0011) [2023-12-26 02:46:16,528][123090] Updated weights for policy 1, policy_version 396617 (0.0007) [2023-12-26 02:46:16,550][123091] Updated weights for policy 0, policy_version 398948 (0.0011) [2023-12-26 02:46:16,584][123090] Updated weights for policy 1, policy_version 396627 (0.0009) [2023-12-26 02:46:16,613][123091] Updated weights for policy 0, policy_version 398958 (0.0010) [2023-12-26 02:46:16,643][123090] Updated weights for policy 1, policy_version 396637 (0.0008) [2023-12-26 02:46:17,437][123091] Updated weights for policy 0, policy_version 398968 (0.0011) [2023-12-26 02:46:17,470][123090] Updated weights for policy 1, policy_version 396647 (0.0007) [2023-12-26 02:46:17,496][123091] Updated weights for policy 0, policy_version 398978 (0.0010) [2023-12-26 02:46:17,521][123090] Updated weights for policy 1, policy_version 396657 (0.0008) [2023-12-26 02:46:17,554][123091] Updated weights for policy 0, policy_version 398988 (0.0010) [2023-12-26 02:46:17,565][123090] Updated weights for policy 1, policy_version 396667 (0.0007) [2023-12-26 02:46:18,353][123090] Updated weights for policy 1, policy_version 396677 (0.0008) [2023-12-26 02:46:18,371][123091] Updated weights for policy 0, policy_version 398998 (0.0011) [2023-12-26 02:46:18,414][123090] Updated weights for policy 1, policy_version 396687 (0.0007) [2023-12-26 02:46:18,432][123091] Updated weights for policy 0, policy_version 399008 (0.0011) [2023-12-26 02:46:18,466][123090] Updated weights for policy 1, policy_version 396697 (0.0007) [2023-12-26 02:46:18,488][123091] Updated weights for policy 0, policy_version 399018 (0.0010) [2023-12-26 02:46:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 203710464. Throughput: 0: 8756.6, 1: 8538.0. Samples: 203718588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:46:18,785][121949] Avg episode reward: [(0, '6288.726'), (1, '5622.051')] [2023-12-26 02:46:19,298][123091] Updated weights for policy 0, policy_version 399028 (0.0009) [2023-12-26 02:46:19,341][123090] Updated weights for policy 1, policy_version 396707 (0.0009) [2023-12-26 02:46:19,364][123091] Updated weights for policy 0, policy_version 399038 (0.0010) [2023-12-26 02:46:19,403][123090] Updated weights for policy 1, policy_version 396717 (0.0008) [2023-12-26 02:46:19,428][123091] Updated weights for policy 0, policy_version 399048 (0.0010) [2023-12-26 02:46:19,470][123090] Updated weights for policy 1, policy_version 396727 (0.0007) [2023-12-26 02:46:20,203][123091] Updated weights for policy 0, policy_version 399058 (0.0008) [2023-12-26 02:46:20,260][123091] Updated weights for policy 0, policy_version 399068 (0.0006) [2023-12-26 02:46:20,316][123091] Updated weights for policy 0, policy_version 399078 (0.0010) [2023-12-26 02:46:20,383][123091] Updated weights for policy 0, policy_version 399088 (0.0011) [2023-12-26 02:46:20,392][123090] Updated weights for policy 1, policy_version 396737 (0.0009) [2023-12-26 02:46:20,452][123090] Updated weights for policy 1, policy_version 396747 (0.0009) [2023-12-26 02:46:20,517][123090] Updated weights for policy 1, policy_version 396757 (0.0009) [2023-12-26 02:46:20,579][123090] Updated weights for policy 1, policy_version 396767 (0.0008) [2023-12-26 02:46:21,180][123091] Updated weights for policy 0, policy_version 399098 (0.0010) [2023-12-26 02:46:21,247][123091] Updated weights for policy 0, policy_version 399108 (0.0009) [2023-12-26 02:46:21,311][123091] Updated weights for policy 0, policy_version 399118 (0.0007) [2023-12-26 02:46:21,488][123090] Updated weights for policy 1, policy_version 396777 (0.0006) [2023-12-26 02:46:21,556][123090] Updated weights for policy 1, policy_version 396787 (0.0005) [2023-12-26 02:46:21,635][123090] Updated weights for policy 1, policy_version 396797 (0.0007) [2023-12-26 02:46:22,101][123091] Updated weights for policy 0, policy_version 399128 (0.0010) [2023-12-26 02:46:22,161][123091] Updated weights for policy 0, policy_version 399138 (0.0009) [2023-12-26 02:46:22,218][123091] Updated weights for policy 0, policy_version 399148 (0.0009) [2023-12-26 02:46:22,455][123090] Updated weights for policy 1, policy_version 396807 (0.0009) [2023-12-26 02:46:22,528][123090] Updated weights for policy 1, policy_version 396817 (0.0008) [2023-12-26 02:46:22,602][123090] Updated weights for policy 1, policy_version 396827 (0.0009) [2023-12-26 02:46:23,035][123091] Updated weights for policy 0, policy_version 399158 (0.0009) [2023-12-26 02:46:23,093][123091] Updated weights for policy 0, policy_version 399168 (0.0010) [2023-12-26 02:46:23,150][123091] Updated weights for policy 0, policy_version 399178 (0.0009) [2023-12-26 02:46:23,430][123090] Updated weights for policy 1, policy_version 396837 (0.0009) [2023-12-26 02:46:23,481][123090] Updated weights for policy 1, policy_version 396847 (0.0009) [2023-12-26 02:46:23,546][123090] Updated weights for policy 1, policy_version 396857 (0.0010) [2023-12-26 02:46:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 203792384. Throughput: 0: 8735.6, 1: 8486.9. Samples: 203769228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 02:46:23,786][121949] Avg episode reward: [(0, '6074.729'), (1, '5691.433')] [2023-12-26 02:46:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000399184_102195200.pth... [2023-12-26 02:46:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000396864_101597184.pth... [2023-12-26 02:46:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000395904_101351424.pth [2023-12-26 02:46:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000398160_101933056.pth [2023-12-26 02:46:23,953][123091] Updated weights for policy 0, policy_version 399188 (0.0008) [2023-12-26 02:46:24,024][123091] Updated weights for policy 0, policy_version 399198 (0.0005) [2023-12-26 02:46:24,094][123091] Updated weights for policy 0, policy_version 399208 (0.0005) [2023-12-26 02:46:24,432][123090] Updated weights for policy 1, policy_version 396867 (0.0010) [2023-12-26 02:46:24,493][123090] Updated weights for policy 1, policy_version 396877 (0.0010) [2023-12-26 02:46:24,548][123090] Updated weights for policy 1, policy_version 396887 (0.0009) [2023-12-26 02:46:24,703][123091] Updated weights for policy 0, policy_version 399218 (0.0006) [2023-12-26 02:46:24,766][123091] Updated weights for policy 0, policy_version 399228 (0.0007) [2023-12-26 02:46:24,831][123091] Updated weights for policy 0, policy_version 399238 (0.0005) [2023-12-26 02:46:24,895][123091] Updated weights for policy 0, policy_version 399248 (0.0005) [2023-12-26 02:46:25,479][123091] Updated weights for policy 0, policy_version 399258 (0.0005) [2023-12-26 02:46:25,497][123090] Updated weights for policy 1, policy_version 396898 (0.0010) [2023-12-26 02:46:25,527][123091] Updated weights for policy 0, policy_version 399268 (0.0005) [2023-12-26 02:46:25,562][123090] Updated weights for policy 1, policy_version 396908 (0.0008) [2023-12-26 02:46:25,580][123091] Updated weights for policy 0, policy_version 399278 (0.0005) [2023-12-26 02:46:25,627][123090] Updated weights for policy 1, policy_version 396918 (0.0008) [2023-12-26 02:46:25,690][123090] Updated weights for policy 1, policy_version 396928 (0.0008) [2023-12-26 02:46:26,224][123091] Updated weights for policy 0, policy_version 399288 (0.0005) [2023-12-26 02:46:26,263][123090] Updated weights for policy 1, policy_version 396938 (0.0005) [2023-12-26 02:46:26,300][123091] Updated weights for policy 0, policy_version 399298 (0.0005) [2023-12-26 02:46:26,325][123090] Updated weights for policy 1, policy_version 396948 (0.0006) [2023-12-26 02:46:26,374][123091] Updated weights for policy 0, policy_version 399308 (0.0005) [2023-12-26 02:46:26,387][123090] Updated weights for policy 1, policy_version 396958 (0.0007) [2023-12-26 02:46:26,950][123091] Updated weights for policy 0, policy_version 399318 (0.0005) [2023-12-26 02:46:26,994][123091] Updated weights for policy 0, policy_version 399328 (0.0005) [2023-12-26 02:46:27,047][123091] Updated weights for policy 0, policy_version 399338 (0.0005) [2023-12-26 02:46:27,087][123090] Updated weights for policy 1, policy_version 396968 (0.0006) [2023-12-26 02:46:27,147][123090] Updated weights for policy 1, policy_version 396978 (0.0005) [2023-12-26 02:46:27,213][123090] Updated weights for policy 1, policy_version 396988 (0.0005) [2023-12-26 02:46:27,759][123091] Updated weights for policy 0, policy_version 399348 (0.0005) [2023-12-26 02:46:27,839][123091] Updated weights for policy 0, policy_version 399358 (0.0006) [2023-12-26 02:46:27,843][123090] Updated weights for policy 1, policy_version 396998 (0.0005) [2023-12-26 02:46:27,892][123090] Updated weights for policy 1, policy_version 397008 (0.0005) [2023-12-26 02:46:27,900][123091] Updated weights for policy 0, policy_version 399368 (0.0006) [2023-12-26 02:46:27,958][123090] Updated weights for policy 1, policy_version 397018 (0.0005) [2023-12-26 02:46:28,564][123091] Updated weights for policy 0, policy_version 399378 (0.0007) [2023-12-26 02:46:28,629][123091] Updated weights for policy 0, policy_version 399388 (0.0010) [2023-12-26 02:46:28,684][123091] Updated weights for policy 0, policy_version 399398 (0.0010) [2023-12-26 02:46:28,746][123091] Updated weights for policy 0, policy_version 399408 (0.0010) [2023-12-26 02:46:28,758][123090] Updated weights for policy 1, policy_version 397028 (0.0007) [2023-12-26 02:46:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 203890688. Throughput: 0: 8868.8, 1: 8476.2. Samples: 203882292. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:28,785][121949] Avg episode reward: [(0, '6018.859'), (1, '5666.944')] [2023-12-26 02:46:28,809][123090] Updated weights for policy 1, policy_version 397038 (0.0010) [2023-12-26 02:46:28,871][123090] Updated weights for policy 1, policy_version 397048 (0.0010) [2023-12-26 02:46:29,566][123091] Updated weights for policy 0, policy_version 399418 (0.0011) [2023-12-26 02:46:29,613][123091] Updated weights for policy 0, policy_version 399428 (0.0010) [2023-12-26 02:46:29,671][123091] Updated weights for policy 0, policy_version 399438 (0.0011) [2023-12-26 02:46:29,694][123090] Updated weights for policy 1, policy_version 397058 (0.0009) [2023-12-26 02:46:29,746][123090] Updated weights for policy 1, policy_version 397068 (0.0009) [2023-12-26 02:46:29,799][123090] Updated weights for policy 1, policy_version 397078 (0.0009) [2023-12-26 02:46:29,865][123090] Updated weights for policy 1, policy_version 397088 (0.0009) [2023-12-26 02:46:30,449][123091] Updated weights for policy 0, policy_version 399448 (0.0007) [2023-12-26 02:46:30,494][123091] Updated weights for policy 0, policy_version 399458 (0.0005) [2023-12-26 02:46:30,544][123091] Updated weights for policy 0, policy_version 399468 (0.0005) [2023-12-26 02:46:30,634][123090] Updated weights for policy 1, policy_version 397098 (0.0009) [2023-12-26 02:46:30,686][123090] Updated weights for policy 1, policy_version 397108 (0.0009) [2023-12-26 02:46:30,738][123090] Updated weights for policy 1, policy_version 397119 (0.0009) [2023-12-26 02:46:31,265][123091] Updated weights for policy 0, policy_version 399478 (0.0006) [2023-12-26 02:46:31,339][123091] Updated weights for policy 0, policy_version 399488 (0.0005) [2023-12-26 02:46:31,410][123091] Updated weights for policy 0, policy_version 399498 (0.0008) [2023-12-26 02:46:31,563][123090] Updated weights for policy 1, policy_version 397129 (0.0009) [2023-12-26 02:46:31,630][123090] Updated weights for policy 1, policy_version 397139 (0.0009) [2023-12-26 02:46:31,708][123090] Updated weights for policy 1, policy_version 397149 (0.0009) [2023-12-26 02:46:32,122][123091] Updated weights for policy 0, policy_version 399508 (0.0008) [2023-12-26 02:46:32,177][123091] Updated weights for policy 0, policy_version 399518 (0.0005) [2023-12-26 02:46:32,235][123091] Updated weights for policy 0, policy_version 399528 (0.0006) [2023-12-26 02:46:32,372][123090] Updated weights for policy 1, policy_version 397159 (0.0009) [2023-12-26 02:46:32,425][123090] Updated weights for policy 1, policy_version 397169 (0.0008) [2023-12-26 02:46:32,492][123090] Updated weights for policy 1, policy_version 397179 (0.0009) [2023-12-26 02:46:33,049][123091] Updated weights for policy 0, policy_version 399538 (0.0011) [2023-12-26 02:46:33,097][123091] Updated weights for policy 0, policy_version 399548 (0.0010) [2023-12-26 02:46:33,149][123091] Updated weights for policy 0, policy_version 399558 (0.0010) [2023-12-26 02:46:33,203][123091] Updated weights for policy 0, policy_version 399568 (0.0010) [2023-12-26 02:46:33,262][123090] Updated weights for policy 1, policy_version 397189 (0.0007) [2023-12-26 02:46:33,311][123090] Updated weights for policy 1, policy_version 397199 (0.0007) [2023-12-26 02:46:33,367][123090] Updated weights for policy 1, policy_version 397209 (0.0009) [2023-12-26 02:46:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 203980800. Throughput: 0: 8991.7, 1: 8483.6. Samples: 203992384. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:33,785][121949] Avg episode reward: [(0, '6136.862'), (1, '5398.095')] [2023-12-26 02:46:33,956][123091] Updated weights for policy 0, policy_version 399578 (0.0008) [2023-12-26 02:46:34,003][123091] Updated weights for policy 0, policy_version 399588 (0.0010) [2023-12-26 02:46:34,049][123091] Updated weights for policy 0, policy_version 399598 (0.0010) [2023-12-26 02:46:34,228][123090] Updated weights for policy 1, policy_version 397219 (0.0007) [2023-12-26 02:46:34,298][123090] Updated weights for policy 1, policy_version 397229 (0.0009) [2023-12-26 02:46:34,367][123090] Updated weights for policy 1, policy_version 397239 (0.0008) [2023-12-26 02:46:34,903][123091] Updated weights for policy 0, policy_version 399608 (0.0007) [2023-12-26 02:46:34,964][123091] Updated weights for policy 0, policy_version 399618 (0.0005) [2023-12-26 02:46:35,029][123091] Updated weights for policy 0, policy_version 399628 (0.0006) [2023-12-26 02:46:35,100][123090] Updated weights for policy 1, policy_version 397249 (0.0009) [2023-12-26 02:46:35,174][123090] Updated weights for policy 1, policy_version 397259 (0.0005) [2023-12-26 02:46:35,246][123090] Updated weights for policy 1, policy_version 397269 (0.0006) [2023-12-26 02:46:35,299][123090] Updated weights for policy 1, policy_version 397279 (0.0006) [2023-12-26 02:46:35,667][123091] Updated weights for policy 0, policy_version 399638 (0.0005) [2023-12-26 02:46:35,722][123091] Updated weights for policy 0, policy_version 399648 (0.0008) [2023-12-26 02:46:35,783][123091] Updated weights for policy 0, policy_version 399658 (0.0005) [2023-12-26 02:46:35,988][123090] Updated weights for policy 1, policy_version 397289 (0.0008) [2023-12-26 02:46:36,050][123090] Updated weights for policy 1, policy_version 397299 (0.0010) [2023-12-26 02:46:36,108][123090] Updated weights for policy 1, policy_version 397309 (0.0010) [2023-12-26 02:46:36,451][123091] Updated weights for policy 0, policy_version 399668 (0.0006) [2023-12-26 02:46:36,507][123091] Updated weights for policy 0, policy_version 399678 (0.0009) [2023-12-26 02:46:36,569][123091] Updated weights for policy 0, policy_version 399688 (0.0009) [2023-12-26 02:46:37,023][123090] Updated weights for policy 1, policy_version 397319 (0.0010) [2023-12-26 02:46:37,086][123090] Updated weights for policy 1, policy_version 397329 (0.0010) [2023-12-26 02:46:37,153][123090] Updated weights for policy 1, policy_version 397339 (0.0009) [2023-12-26 02:46:37,336][123091] Updated weights for policy 0, policy_version 399698 (0.0008) [2023-12-26 02:46:37,397][123091] Updated weights for policy 0, policy_version 399708 (0.0005) [2023-12-26 02:46:37,443][123091] Updated weights for policy 0, policy_version 399718 (0.0005) [2023-12-26 02:46:37,492][123091] Updated weights for policy 0, policy_version 399728 (0.0005) [2023-12-26 02:46:38,003][123090] Updated weights for policy 1, policy_version 397349 (0.0005) [2023-12-26 02:46:38,059][123090] Updated weights for policy 1, policy_version 397359 (0.0005) [2023-12-26 02:46:38,114][123091] Updated weights for policy 0, policy_version 399738 (0.0006) [2023-12-26 02:46:38,124][123090] Updated weights for policy 1, policy_version 397369 (0.0005) [2023-12-26 02:46:38,173][123091] Updated weights for policy 0, policy_version 399748 (0.0005) [2023-12-26 02:46:38,226][123091] Updated weights for policy 0, policy_version 399758 (0.0005) [2023-12-26 02:46:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 204070912. Throughput: 0: 9096.7, 1: 8492.6. Samples: 204048360. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:38,785][121949] Avg episode reward: [(0, '6201.272'), (1, '5115.806')] [2023-12-26 02:46:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000399760_102342656.pth... [2023-12-26 02:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000398672_102064128.pth [2023-12-26 02:46:38,813][123090] Updated weights for policy 1, policy_version 397379 (0.0006) [2023-12-26 02:46:38,863][123090] Updated weights for policy 1, policy_version 397389 (0.0008) [2023-12-26 02:46:38,896][123091] Updated weights for policy 0, policy_version 399768 (0.0006) [2023-12-26 02:46:38,919][123090] Updated weights for policy 1, policy_version 397399 (0.0007) [2023-12-26 02:46:38,955][123091] Updated weights for policy 0, policy_version 399778 (0.0008) [2023-12-26 02:46:38,972][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000397408_101736448.pth... [2023-12-26 02:46:38,977][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000396384_101474304.pth [2023-12-26 02:46:39,021][123091] Updated weights for policy 0, policy_version 399788 (0.0008) [2023-12-26 02:46:39,794][123090] Updated weights for policy 1, policy_version 397409 (0.0007) [2023-12-26 02:46:39,797][123091] Updated weights for policy 0, policy_version 399798 (0.0009) [2023-12-26 02:46:39,870][123090] Updated weights for policy 1, policy_version 397419 (0.0008) [2023-12-26 02:46:39,873][123091] Updated weights for policy 0, policy_version 399808 (0.0008) [2023-12-26 02:46:39,939][123090] Updated weights for policy 1, policy_version 397429 (0.0008) [2023-12-26 02:46:39,945][123091] Updated weights for policy 0, policy_version 399818 (0.0009) [2023-12-26 02:46:40,004][123090] Updated weights for policy 1, policy_version 397439 (0.0009) [2023-12-26 02:46:40,731][123091] Updated weights for policy 0, policy_version 399828 (0.0007) [2023-12-26 02:46:40,790][123091] Updated weights for policy 0, policy_version 399838 (0.0007) [2023-12-26 02:46:40,812][123090] Updated weights for policy 1, policy_version 397449 (0.0009) [2023-12-26 02:46:40,858][123091] Updated weights for policy 0, policy_version 399848 (0.0008) [2023-12-26 02:46:40,881][123090] Updated weights for policy 1, policy_version 397459 (0.0008) [2023-12-26 02:46:40,949][123090] Updated weights for policy 1, policy_version 397469 (0.0009) [2023-12-26 02:46:41,669][123091] Updated weights for policy 0, policy_version 399858 (0.0008) [2023-12-26 02:46:41,740][123091] Updated weights for policy 0, policy_version 399868 (0.0010) [2023-12-26 02:46:41,804][123091] Updated weights for policy 0, policy_version 399878 (0.0009) [2023-12-26 02:46:41,812][123090] Updated weights for policy 1, policy_version 397479 (0.0006) [2023-12-26 02:46:41,863][123091] Updated weights for policy 0, policy_version 399888 (0.0010) [2023-12-26 02:46:41,868][123090] Updated weights for policy 1, policy_version 397489 (0.0005) [2023-12-26 02:46:41,931][123090] Updated weights for policy 1, policy_version 397499 (0.0005) [2023-12-26 02:46:42,659][123090] Updated weights for policy 1, policy_version 397509 (0.0008) [2023-12-26 02:46:42,701][123091] Updated weights for policy 0, policy_version 399898 (0.0009) [2023-12-26 02:46:42,724][123090] Updated weights for policy 1, policy_version 397519 (0.0008) [2023-12-26 02:46:42,755][123091] Updated weights for policy 0, policy_version 399908 (0.0008) [2023-12-26 02:46:42,788][123090] Updated weights for policy 1, policy_version 397529 (0.0009) [2023-12-26 02:46:42,809][123091] Updated weights for policy 0, policy_version 399918 (0.0008) [2023-12-26 02:46:43,571][123091] Updated weights for policy 0, policy_version 399928 (0.0009) [2023-12-26 02:46:43,587][123090] Updated weights for policy 1, policy_version 397539 (0.0010) [2023-12-26 02:46:43,623][123091] Updated weights for policy 0, policy_version 399938 (0.0009) [2023-12-26 02:46:43,652][123090] Updated weights for policy 1, policy_version 397549 (0.0008) [2023-12-26 02:46:43,675][123091] Updated weights for policy 0, policy_version 399948 (0.0008) [2023-12-26 02:46:43,708][123090] Updated weights for policy 1, policy_version 397559 (0.0007) [2023-12-26 02:46:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 204169216. Throughput: 0: 9113.2, 1: 8513.6. Samples: 204155792. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:43,785][121949] Avg episode reward: [(0, '6140.892'), (1, '5319.200')] [2023-12-26 02:46:44,481][123090] Updated weights for policy 1, policy_version 397569 (0.0010) [2023-12-26 02:46:44,534][123091] Updated weights for policy 0, policy_version 399958 (0.0010) [2023-12-26 02:46:44,545][123090] Updated weights for policy 1, policy_version 397579 (0.0007) [2023-12-26 02:46:44,595][123090] Updated weights for policy 1, policy_version 397589 (0.0009) [2023-12-26 02:46:44,600][123091] Updated weights for policy 0, policy_version 399968 (0.0009) [2023-12-26 02:46:44,650][123091] Updated weights for policy 0, policy_version 399978 (0.0008) [2023-12-26 02:46:44,653][123090] Updated weights for policy 1, policy_version 397599 (0.0008) [2023-12-26 02:46:45,453][123091] Updated weights for policy 0, policy_version 399988 (0.0008) [2023-12-26 02:46:45,517][123091] Updated weights for policy 0, policy_version 399998 (0.0005) [2023-12-26 02:46:45,531][123090] Updated weights for policy 1, policy_version 397609 (0.0009) [2023-12-26 02:46:45,585][123091] Updated weights for policy 0, policy_version 400008 (0.0005) [2023-12-26 02:46:45,596][123090] Updated weights for policy 1, policy_version 397619 (0.0009) [2023-12-26 02:46:45,662][123090] Updated weights for policy 1, policy_version 397629 (0.0009) [2023-12-26 02:46:46,367][123091] Updated weights for policy 0, policy_version 400018 (0.0009) [2023-12-26 02:46:46,416][123091] Updated weights for policy 0, policy_version 400028 (0.0009) [2023-12-26 02:46:46,465][123091] Updated weights for policy 0, policy_version 400038 (0.0007) [2023-12-26 02:46:46,474][123090] Updated weights for policy 1, policy_version 397639 (0.0010) [2023-12-26 02:46:46,516][123091] Updated weights for policy 0, policy_version 400048 (0.0006) [2023-12-26 02:46:46,536][123090] Updated weights for policy 1, policy_version 397649 (0.0010) [2023-12-26 02:46:46,594][123090] Updated weights for policy 1, policy_version 397659 (0.0009) [2023-12-26 02:46:47,368][123091] Updated weights for policy 0, policy_version 400058 (0.0010) [2023-12-26 02:46:47,417][123090] Updated weights for policy 1, policy_version 397670 (0.0009) [2023-12-26 02:46:47,432][123091] Updated weights for policy 0, policy_version 400068 (0.0009) [2023-12-26 02:46:47,474][123090] Updated weights for policy 1, policy_version 397680 (0.0006) [2023-12-26 02:46:47,489][123091] Updated weights for policy 0, policy_version 400078 (0.0010) [2023-12-26 02:46:47,530][123090] Updated weights for policy 1, policy_version 397690 (0.0009) [2023-12-26 02:46:48,340][123091] Updated weights for policy 0, policy_version 400088 (0.0009) [2023-12-26 02:46:48,367][123090] Updated weights for policy 1, policy_version 397700 (0.0009) [2023-12-26 02:46:48,402][123091] Updated weights for policy 0, policy_version 400098 (0.0007) [2023-12-26 02:46:48,435][123090] Updated weights for policy 1, policy_version 397710 (0.0009) [2023-12-26 02:46:48,462][123091] Updated weights for policy 0, policy_version 400108 (0.0006) [2023-12-26 02:46:48,501][123090] Updated weights for policy 1, policy_version 397720 (0.0009) [2023-12-26 02:46:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 204251136. Throughput: 0: 9158.6, 1: 8553.1. Samples: 204259872. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:48,785][121949] Avg episode reward: [(0, '6187.281'), (1, '5560.583')] [2023-12-26 02:46:49,247][123091] Updated weights for policy 0, policy_version 400118 (0.0009) [2023-12-26 02:46:49,307][123091] Updated weights for policy 0, policy_version 400128 (0.0009) [2023-12-26 02:46:49,345][123090] Updated weights for policy 1, policy_version 397730 (0.0008) [2023-12-26 02:46:49,373][123091] Updated weights for policy 0, policy_version 400138 (0.0008) [2023-12-26 02:46:49,412][123090] Updated weights for policy 1, policy_version 397740 (0.0008) [2023-12-26 02:46:49,484][123090] Updated weights for policy 1, policy_version 397750 (0.0009) [2023-12-26 02:46:50,166][123091] Updated weights for policy 0, policy_version 400148 (0.0010) [2023-12-26 02:46:50,226][123091] Updated weights for policy 0, policy_version 400158 (0.0010) [2023-12-26 02:46:50,285][123091] Updated weights for policy 0, policy_version 400168 (0.0010) [2023-12-26 02:46:50,345][123090] Updated weights for policy 1, policy_version 397762 (0.0010) [2023-12-26 02:46:50,411][123090] Updated weights for policy 1, policy_version 397772 (0.0010) [2023-12-26 02:46:50,474][123090] Updated weights for policy 1, policy_version 397782 (0.0010) [2023-12-26 02:46:50,526][123090] Updated weights for policy 1, policy_version 397792 (0.0009) [2023-12-26 02:46:51,156][123091] Updated weights for policy 0, policy_version 400179 (0.0010) [2023-12-26 02:46:51,227][123091] Updated weights for policy 0, policy_version 400189 (0.0010) [2023-12-26 02:46:51,292][123091] Updated weights for policy 0, policy_version 400199 (0.0010) [2023-12-26 02:46:51,376][123090] Updated weights for policy 1, policy_version 397802 (0.0009) [2023-12-26 02:46:51,439][123090] Updated weights for policy 1, policy_version 397812 (0.0010) [2023-12-26 02:46:51,502][123090] Updated weights for policy 1, policy_version 397822 (0.0009) [2023-12-26 02:46:52,078][123091] Updated weights for policy 0, policy_version 400209 (0.0008) [2023-12-26 02:46:52,134][123091] Updated weights for policy 0, policy_version 400219 (0.0005) [2023-12-26 02:46:52,190][123091] Updated weights for policy 0, policy_version 400229 (0.0005) [2023-12-26 02:46:52,245][123091] Updated weights for policy 0, policy_version 400239 (0.0005) [2023-12-26 02:46:52,421][123090] Updated weights for policy 1, policy_version 397832 (0.0009) [2023-12-26 02:46:52,487][123090] Updated weights for policy 1, policy_version 397842 (0.0009) [2023-12-26 02:46:52,545][123090] Updated weights for policy 1, policy_version 397852 (0.0009) [2023-12-26 02:46:52,985][123091] Updated weights for policy 0, policy_version 400249 (0.0010) [2023-12-26 02:46:53,037][123091] Updated weights for policy 0, policy_version 400259 (0.0011) [2023-12-26 02:46:53,089][123091] Updated weights for policy 0, policy_version 400269 (0.0011) [2023-12-26 02:46:53,403][123090] Updated weights for policy 1, policy_version 397862 (0.0009) [2023-12-26 02:46:53,468][123090] Updated weights for policy 1, policy_version 397872 (0.0008) [2023-12-26 02:46:53,530][123090] Updated weights for policy 1, policy_version 397882 (0.0009) [2023-12-26 02:46:53,785][121949] Fps is (10 sec: 16383.5, 60 sec: 17476.1, 300 sec: 17689.1). Total num frames: 204333056. Throughput: 0: 9140.0, 1: 8561.0. Samples: 204310424. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:53,786][121949] Avg episode reward: [(0, '6045.221'), (1, '5523.609')] [2023-12-26 02:46:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000397888_101859328.pth... [2023-12-26 02:46:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000400272_102473728.pth... [2023-12-26 02:46:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000399184_102195200.pth [2023-12-26 02:46:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000396864_101597184.pth [2023-12-26 02:46:53,938][123091] Updated weights for policy 0, policy_version 400279 (0.0009) [2023-12-26 02:46:53,984][123091] Updated weights for policy 0, policy_version 400289 (0.0006) [2023-12-26 02:46:54,032][123091] Updated weights for policy 0, policy_version 400299 (0.0005) [2023-12-26 02:46:54,428][123090] Updated weights for policy 1, policy_version 397892 (0.0010) [2023-12-26 02:46:54,484][123090] Updated weights for policy 1, policy_version 397902 (0.0009) [2023-12-26 02:46:54,537][123090] Updated weights for policy 1, policy_version 397912 (0.0009) [2023-12-26 02:46:54,743][123091] Updated weights for policy 0, policy_version 400309 (0.0008) [2023-12-26 02:46:54,795][123091] Updated weights for policy 0, policy_version 400319 (0.0009) [2023-12-26 02:46:54,859][123091] Updated weights for policy 0, policy_version 400329 (0.0009) [2023-12-26 02:46:55,366][123090] Updated weights for policy 1, policy_version 397922 (0.0009) [2023-12-26 02:46:55,430][123090] Updated weights for policy 1, policy_version 397932 (0.0009) [2023-12-26 02:46:55,497][123090] Updated weights for policy 1, policy_version 397942 (0.0010) [2023-12-26 02:46:55,560][123090] Updated weights for policy 1, policy_version 397952 (0.0008) [2023-12-26 02:46:55,723][123091] Updated weights for policy 0, policy_version 400339 (0.0010) [2023-12-26 02:46:55,791][123091] Updated weights for policy 0, policy_version 400349 (0.0009) [2023-12-26 02:46:55,858][123091] Updated weights for policy 0, policy_version 400359 (0.0009) [2023-12-26 02:46:56,423][123090] Updated weights for policy 1, policy_version 397962 (0.0009) [2023-12-26 02:46:56,478][123090] Updated weights for policy 1, policy_version 397972 (0.0010) [2023-12-26 02:46:56,531][123091] Updated weights for policy 0, policy_version 400369 (0.0009) [2023-12-26 02:46:56,542][123090] Updated weights for policy 1, policy_version 397982 (0.0009) [2023-12-26 02:46:56,582][123091] Updated weights for policy 0, policy_version 400379 (0.0009) [2023-12-26 02:46:56,632][123091] Updated weights for policy 0, policy_version 400389 (0.0009) [2023-12-26 02:46:56,687][123091] Updated weights for policy 0, policy_version 400399 (0.0009) [2023-12-26 02:46:57,384][123090] Updated weights for policy 1, policy_version 397992 (0.0006) [2023-12-26 02:46:57,454][123090] Updated weights for policy 1, policy_version 398002 (0.0005) [2023-12-26 02:46:57,506][123090] Updated weights for policy 1, policy_version 398012 (0.0005) [2023-12-26 02:46:57,509][123091] Updated weights for policy 0, policy_version 400409 (0.0005) [2023-12-26 02:46:57,559][123091] Updated weights for policy 0, policy_version 400419 (0.0005) [2023-12-26 02:46:57,610][123091] Updated weights for policy 0, policy_version 400429 (0.0005) [2023-12-26 02:46:58,181][123090] Updated weights for policy 1, policy_version 398022 (0.0005) [2023-12-26 02:46:58,248][123090] Updated weights for policy 1, policy_version 398032 (0.0005) [2023-12-26 02:46:58,317][123090] Updated weights for policy 1, policy_version 398042 (0.0006) [2023-12-26 02:46:58,376][123091] Updated weights for policy 0, policy_version 400439 (0.0009) [2023-12-26 02:46:58,447][123091] Updated weights for policy 0, policy_version 400449 (0.0008) [2023-12-26 02:46:58,513][123091] Updated weights for policy 0, policy_version 400459 (0.0008) [2023-12-26 02:46:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 204423168. Throughput: 0: 9199.2, 1: 8583.5. Samples: 204414856. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:46:58,785][121949] Avg episode reward: [(0, '6001.170'), (1, '5348.640')] [2023-12-26 02:46:59,138][123090] Updated weights for policy 1, policy_version 398052 (0.0008) [2023-12-26 02:46:59,195][123090] Updated weights for policy 1, policy_version 398062 (0.0010) [2023-12-26 02:46:59,258][123090] Updated weights for policy 1, policy_version 398072 (0.0009) [2023-12-26 02:46:59,260][123091] Updated weights for policy 0, policy_version 400469 (0.0008) [2023-12-26 02:46:59,311][123091] Updated weights for policy 0, policy_version 400479 (0.0007) [2023-12-26 02:46:59,382][123091] Updated weights for policy 0, policy_version 400489 (0.0011) [2023-12-26 02:47:00,005][123090] Updated weights for policy 1, policy_version 398082 (0.0008) [2023-12-26 02:47:00,076][123090] Updated weights for policy 1, policy_version 398092 (0.0005) [2023-12-26 02:47:00,117][123091] Updated weights for policy 0, policy_version 400499 (0.0011) [2023-12-26 02:47:00,134][123090] Updated weights for policy 1, policy_version 398102 (0.0005) [2023-12-26 02:47:00,180][123091] Updated weights for policy 0, policy_version 400509 (0.0009) [2023-12-26 02:47:00,187][123090] Updated weights for policy 1, policy_version 398112 (0.0008) [2023-12-26 02:47:00,250][123091] Updated weights for policy 0, policy_version 400519 (0.0007) [2023-12-26 02:47:00,859][123090] Updated weights for policy 1, policy_version 398122 (0.0005) [2023-12-26 02:47:00,915][123090] Updated weights for policy 1, policy_version 398132 (0.0007) [2023-12-26 02:47:00,945][123091] Updated weights for policy 0, policy_version 400529 (0.0008) [2023-12-26 02:47:00,976][123090] Updated weights for policy 1, policy_version 398142 (0.0008) [2023-12-26 02:47:01,003][123091] Updated weights for policy 0, policy_version 400539 (0.0005) [2023-12-26 02:47:01,066][123091] Updated weights for policy 0, policy_version 400549 (0.0008) [2023-12-26 02:47:01,125][123091] Updated weights for policy 0, policy_version 400559 (0.0008) [2023-12-26 02:47:01,834][123090] Updated weights for policy 1, policy_version 398152 (0.0008) [2023-12-26 02:47:01,859][123091] Updated weights for policy 0, policy_version 400569 (0.0006) [2023-12-26 02:47:01,901][123090] Updated weights for policy 1, policy_version 398162 (0.0010) [2023-12-26 02:47:01,927][123091] Updated weights for policy 0, policy_version 400579 (0.0007) [2023-12-26 02:47:01,963][123090] Updated weights for policy 1, policy_version 398172 (0.0006) [2023-12-26 02:47:01,977][123091] Updated weights for policy 0, policy_version 400589 (0.0008) [2023-12-26 02:47:02,641][123091] Updated weights for policy 0, policy_version 400599 (0.0008) [2023-12-26 02:47:02,695][123091] Updated weights for policy 0, policy_version 400609 (0.0008) [2023-12-26 02:47:02,751][123091] Updated weights for policy 0, policy_version 400619 (0.0009) [2023-12-26 02:47:02,767][123090] Updated weights for policy 1, policy_version 398182 (0.0007) [2023-12-26 02:47:02,817][123090] Updated weights for policy 1, policy_version 398192 (0.0009) [2023-12-26 02:47:02,866][123090] Updated weights for policy 1, policy_version 398202 (0.0009) [2023-12-26 02:47:03,578][123091] Updated weights for policy 0, policy_version 400629 (0.0009) [2023-12-26 02:47:03,631][123091] Updated weights for policy 0, policy_version 400640 (0.0009) [2023-12-26 02:47:03,696][123091] Updated weights for policy 0, policy_version 400650 (0.0009) [2023-12-26 02:47:03,717][123090] Updated weights for policy 1, policy_version 398212 (0.0009) [2023-12-26 02:47:03,780][123090] Updated weights for policy 1, policy_version 398222 (0.0008) [2023-12-26 02:47:03,784][121949] Fps is (10 sec: 18023.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 204513280. Throughput: 0: 9250.6, 1: 8665.0. Samples: 204524788. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:03,784][121949] Avg episode reward: [(0, '6074.276'), (1, '5306.003')] [2023-12-26 02:47:03,849][123090] Updated weights for policy 1, policy_version 398232 (0.0009) [2023-12-26 02:47:04,559][123091] Updated weights for policy 0, policy_version 400660 (0.0009) [2023-12-26 02:47:04,589][123090] Updated weights for policy 1, policy_version 398242 (0.0007) [2023-12-26 02:47:04,622][123091] Updated weights for policy 0, policy_version 400670 (0.0009) [2023-12-26 02:47:04,648][123090] Updated weights for policy 1, policy_version 398252 (0.0008) [2023-12-26 02:47:04,680][123091] Updated weights for policy 0, policy_version 400680 (0.0008) [2023-12-26 02:47:04,707][123090] Updated weights for policy 1, policy_version 398262 (0.0007) [2023-12-26 02:47:04,771][123090] Updated weights for policy 1, policy_version 398272 (0.0005) [2023-12-26 02:47:05,521][123091] Updated weights for policy 0, policy_version 400690 (0.0006) [2023-12-26 02:47:05,531][123090] Updated weights for policy 1, policy_version 398282 (0.0005) [2023-12-26 02:47:05,585][123091] Updated weights for policy 0, policy_version 400700 (0.0007) [2023-12-26 02:47:05,591][123090] Updated weights for policy 1, policy_version 398292 (0.0009) [2023-12-26 02:47:05,643][123090] Updated weights for policy 1, policy_version 398302 (0.0010) [2023-12-26 02:47:05,654][123091] Updated weights for policy 0, policy_version 400710 (0.0006) [2023-12-26 02:47:05,721][123091] Updated weights for policy 0, policy_version 400720 (0.0007) [2023-12-26 02:47:06,456][123090] Updated weights for policy 1, policy_version 398312 (0.0009) [2023-12-26 02:47:06,507][123091] Updated weights for policy 0, policy_version 400730 (0.0011) [2023-12-26 02:47:06,519][123090] Updated weights for policy 1, policy_version 398322 (0.0009) [2023-12-26 02:47:06,567][123091] Updated weights for policy 0, policy_version 400740 (0.0011) [2023-12-26 02:47:06,587][123090] Updated weights for policy 1, policy_version 398332 (0.0006) [2023-12-26 02:47:06,623][123091] Updated weights for policy 0, policy_version 400750 (0.0011) [2023-12-26 02:47:07,412][123090] Updated weights for policy 1, policy_version 398342 (0.0008) [2023-12-26 02:47:07,468][123091] Updated weights for policy 0, policy_version 400760 (0.0011) [2023-12-26 02:47:07,472][123090] Updated weights for policy 1, policy_version 398352 (0.0010) [2023-12-26 02:47:07,529][123091] Updated weights for policy 0, policy_version 400770 (0.0011) [2023-12-26 02:47:07,535][123090] Updated weights for policy 1, policy_version 398362 (0.0007) [2023-12-26 02:47:07,591][123091] Updated weights for policy 0, policy_version 400780 (0.0011) [2023-12-26 02:47:08,370][123090] Updated weights for policy 1, policy_version 398372 (0.0008) [2023-12-26 02:47:08,404][123091] Updated weights for policy 0, policy_version 400790 (0.0009) [2023-12-26 02:47:08,430][123090] Updated weights for policy 1, policy_version 398382 (0.0008) [2023-12-26 02:47:08,463][123091] Updated weights for policy 0, policy_version 400800 (0.0008) [2023-12-26 02:47:08,495][123090] Updated weights for policy 1, policy_version 398392 (0.0009) [2023-12-26 02:47:08,524][123091] Updated weights for policy 0, policy_version 400810 (0.0008) [2023-12-26 02:47:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 204603392. Throughput: 0: 9223.6, 1: 8730.4. Samples: 204577156. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:08,785][121949] Avg episode reward: [(0, '6225.420'), (1, '5352.174')] [2023-12-26 02:47:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000398400_101990400.pth... [2023-12-26 02:47:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000400816_102612992.pth... [2023-12-26 02:47:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000397408_101736448.pth [2023-12-26 02:47:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000399760_102342656.pth [2023-12-26 02:47:09,305][123090] Updated weights for policy 1, policy_version 398402 (0.0008) [2023-12-26 02:47:09,375][123091] Updated weights for policy 0, policy_version 400820 (0.0008) [2023-12-26 02:47:09,381][123090] Updated weights for policy 1, policy_version 398412 (0.0010) [2023-12-26 02:47:09,442][123091] Updated weights for policy 0, policy_version 400830 (0.0007) [2023-12-26 02:47:09,457][123090] Updated weights for policy 1, policy_version 398422 (0.0009) [2023-12-26 02:47:09,505][123091] Updated weights for policy 0, policy_version 400840 (0.0009) [2023-12-26 02:47:09,521][123090] Updated weights for policy 1, policy_version 398432 (0.0007) [2023-12-26 02:47:10,326][123091] Updated weights for policy 0, policy_version 400850 (0.0009) [2023-12-26 02:47:10,349][123090] Updated weights for policy 1, policy_version 398442 (0.0005) [2023-12-26 02:47:10,386][123091] Updated weights for policy 0, policy_version 400860 (0.0009) [2023-12-26 02:47:10,425][123090] Updated weights for policy 1, policy_version 398452 (0.0008) [2023-12-26 02:47:10,437][123091] Updated weights for policy 0, policy_version 400870 (0.0009) [2023-12-26 02:47:10,494][123091] Updated weights for policy 0, policy_version 400880 (0.0007) [2023-12-26 02:47:10,496][123090] Updated weights for policy 1, policy_version 398462 (0.0006) [2023-12-26 02:47:11,249][123090] Updated weights for policy 1, policy_version 398472 (0.0007) [2023-12-26 02:47:11,268][123091] Updated weights for policy 0, policy_version 400890 (0.0008) [2023-12-26 02:47:11,316][123090] Updated weights for policy 1, policy_version 398482 (0.0010) [2023-12-26 02:47:11,332][123091] Updated weights for policy 0, policy_version 400900 (0.0008) [2023-12-26 02:47:11,397][123090] Updated weights for policy 1, policy_version 398492 (0.0008) [2023-12-26 02:47:11,402][123091] Updated weights for policy 0, policy_version 400910 (0.0008) [2023-12-26 02:47:12,223][123090] Updated weights for policy 1, policy_version 398502 (0.0009) [2023-12-26 02:47:12,239][123091] Updated weights for policy 0, policy_version 400920 (0.0009) [2023-12-26 02:47:12,297][123090] Updated weights for policy 1, policy_version 398512 (0.0008) [2023-12-26 02:47:12,305][123091] Updated weights for policy 0, policy_version 400930 (0.0014) [2023-12-26 02:47:12,367][123090] Updated weights for policy 1, policy_version 398522 (0.0008) [2023-12-26 02:47:12,380][123091] Updated weights for policy 0, policy_version 400940 (0.0009) [2023-12-26 02:47:13,137][123090] Updated weights for policy 1, policy_version 398532 (0.0007) [2023-12-26 02:47:13,195][123090] Updated weights for policy 1, policy_version 398542 (0.0006) [2023-12-26 02:47:13,207][123091] Updated weights for policy 0, policy_version 400950 (0.0013) [2023-12-26 02:47:13,256][123090] Updated weights for policy 1, policy_version 398552 (0.0006) [2023-12-26 02:47:13,270][123091] Updated weights for policy 0, policy_version 400960 (0.0010) [2023-12-26 02:47:13,333][123091] Updated weights for policy 0, policy_version 400970 (0.0010) [2023-12-26 02:47:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 204685312. Throughput: 0: 9038.0, 1: 8680.1. Samples: 204679604. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:13,785][121949] Avg episode reward: [(0, '6272.764'), (1, '5628.435')] [2023-12-26 02:47:13,919][123090] Updated weights for policy 1, policy_version 398562 (0.0006) [2023-12-26 02:47:13,967][123090] Updated weights for policy 1, policy_version 398572 (0.0005) [2023-12-26 02:47:14,019][123090] Updated weights for policy 1, policy_version 398582 (0.0005) [2023-12-26 02:47:14,073][123090] Updated weights for policy 1, policy_version 398592 (0.0005) [2023-12-26 02:47:14,082][123091] Updated weights for policy 0, policy_version 400980 (0.0008) [2023-12-26 02:47:14,140][123091] Updated weights for policy 0, policy_version 400990 (0.0005) [2023-12-26 02:47:14,202][123091] Updated weights for policy 0, policy_version 401000 (0.0005) [2023-12-26 02:47:14,764][123090] Updated weights for policy 1, policy_version 398602 (0.0006) [2023-12-26 02:47:14,837][123090] Updated weights for policy 1, policy_version 398612 (0.0006) [2023-12-26 02:47:14,854][123091] Updated weights for policy 0, policy_version 401010 (0.0006) [2023-12-26 02:47:14,908][123090] Updated weights for policy 1, policy_version 398622 (0.0010) [2023-12-26 02:47:14,921][123091] Updated weights for policy 0, policy_version 401020 (0.0006) [2023-12-26 02:47:14,994][123091] Updated weights for policy 0, policy_version 401030 (0.0005) [2023-12-26 02:47:15,066][123091] Updated weights for policy 0, policy_version 401040 (0.0006) [2023-12-26 02:47:15,669][123090] Updated weights for policy 1, policy_version 398632 (0.0006) [2023-12-26 02:47:15,722][123091] Updated weights for policy 0, policy_version 401050 (0.0005) [2023-12-26 02:47:15,726][123090] Updated weights for policy 1, policy_version 398642 (0.0005) [2023-12-26 02:47:15,774][123091] Updated weights for policy 0, policy_version 401060 (0.0005) [2023-12-26 02:47:15,779][123090] Updated weights for policy 1, policy_version 398652 (0.0010) [2023-12-26 02:47:15,825][123091] Updated weights for policy 0, policy_version 401070 (0.0005) [2023-12-26 02:47:16,424][123090] Updated weights for policy 1, policy_version 398662 (0.0010) [2023-12-26 02:47:16,491][123090] Updated weights for policy 1, policy_version 398672 (0.0010) [2023-12-26 02:47:16,511][123091] Updated weights for policy 0, policy_version 401080 (0.0006) [2023-12-26 02:47:16,550][123090] Updated weights for policy 1, policy_version 398682 (0.0010) [2023-12-26 02:47:16,562][123091] Updated weights for policy 0, policy_version 401090 (0.0007) [2023-12-26 02:47:16,613][123091] Updated weights for policy 0, policy_version 401100 (0.0006) [2023-12-26 02:47:17,249][123090] Updated weights for policy 1, policy_version 398692 (0.0010) [2023-12-26 02:47:17,293][123090] Updated weights for policy 1, policy_version 398702 (0.0010) [2023-12-26 02:47:17,348][123090] Updated weights for policy 1, policy_version 398712 (0.0010) [2023-12-26 02:47:17,410][123091] Updated weights for policy 0, policy_version 401110 (0.0010) [2023-12-26 02:47:17,460][123091] Updated weights for policy 0, policy_version 401120 (0.0010) [2023-12-26 02:47:17,507][123091] Updated weights for policy 0, policy_version 401130 (0.0010) [2023-12-26 02:47:18,208][123091] Updated weights for policy 0, policy_version 401140 (0.0008) [2023-12-26 02:47:18,210][123090] Updated weights for policy 1, policy_version 398722 (0.0011) [2023-12-26 02:47:18,263][123091] Updated weights for policy 0, policy_version 401150 (0.0005) [2023-12-26 02:47:18,270][123090] Updated weights for policy 1, policy_version 398732 (0.0010) [2023-12-26 02:47:18,312][123091] Updated weights for policy 0, policy_version 401160 (0.0005) [2023-12-26 02:47:18,323][123090] Updated weights for policy 1, policy_version 398742 (0.0011) [2023-12-26 02:47:18,383][123090] Updated weights for policy 1, policy_version 398752 (0.0011) [2023-12-26 02:47:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 204783616. Throughput: 0: 9095.9, 1: 8732.4. Samples: 204794652. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:18,785][121949] Avg episode reward: [(0, '6162.665'), (1, '5746.938')] [2023-12-26 02:47:19,031][123091] Updated weights for policy 0, policy_version 401170 (0.0008) [2023-12-26 02:47:19,092][123091] Updated weights for policy 0, policy_version 401180 (0.0005) [2023-12-26 02:47:19,157][123091] Updated weights for policy 0, policy_version 401190 (0.0005) [2023-12-26 02:47:19,219][123091] Updated weights for policy 0, policy_version 401200 (0.0006) [2023-12-26 02:47:19,281][123090] Updated weights for policy 1, policy_version 398762 (0.0011) [2023-12-26 02:47:19,356][123090] Updated weights for policy 1, policy_version 398772 (0.0013) [2023-12-26 02:47:19,404][123090] Updated weights for policy 1, policy_version 398782 (0.0011) [2023-12-26 02:47:19,921][123091] Updated weights for policy 0, policy_version 401210 (0.0010) [2023-12-26 02:47:19,995][123091] Updated weights for policy 0, policy_version 401220 (0.0011) [2023-12-26 02:47:20,064][123091] Updated weights for policy 0, policy_version 401230 (0.0009) [2023-12-26 02:47:20,195][123090] Updated weights for policy 1, policy_version 398792 (0.0006) [2023-12-26 02:47:20,256][123090] Updated weights for policy 1, policy_version 398802 (0.0006) [2023-12-26 02:47:20,319][123090] Updated weights for policy 1, policy_version 398812 (0.0011) [2023-12-26 02:47:20,866][123091] Updated weights for policy 0, policy_version 401240 (0.0011) [2023-12-26 02:47:20,930][123091] Updated weights for policy 0, policy_version 401250 (0.0011) [2023-12-26 02:47:21,002][123091] Updated weights for policy 0, policy_version 401260 (0.0008) [2023-12-26 02:47:21,128][123090] Updated weights for policy 1, policy_version 398822 (0.0011) [2023-12-26 02:47:21,193][123090] Updated weights for policy 1, policy_version 398832 (0.0011) [2023-12-26 02:47:21,269][123090] Updated weights for policy 1, policy_version 398842 (0.0011) [2023-12-26 02:47:21,876][123091] Updated weights for policy 0, policy_version 401270 (0.0010) [2023-12-26 02:47:21,925][123091] Updated weights for policy 0, policy_version 401280 (0.0011) [2023-12-26 02:47:21,977][123091] Updated weights for policy 0, policy_version 401290 (0.0011) [2023-12-26 02:47:22,060][123090] Updated weights for policy 1, policy_version 398852 (0.0010) [2023-12-26 02:47:22,129][123090] Updated weights for policy 1, policy_version 398862 (0.0007) [2023-12-26 02:47:22,199][123090] Updated weights for policy 1, policy_version 398872 (0.0008) [2023-12-26 02:47:22,805][123091] Updated weights for policy 0, policy_version 401300 (0.0010) [2023-12-26 02:47:22,876][123091] Updated weights for policy 0, policy_version 401310 (0.0009) [2023-12-26 02:47:22,946][123091] Updated weights for policy 0, policy_version 401320 (0.0009) [2023-12-26 02:47:22,964][123090] Updated weights for policy 1, policy_version 398882 (0.0009) [2023-12-26 02:47:23,032][123090] Updated weights for policy 1, policy_version 398892 (0.0011) [2023-12-26 02:47:23,104][123090] Updated weights for policy 1, policy_version 398902 (0.0011) [2023-12-26 02:47:23,175][123090] Updated weights for policy 1, policy_version 398912 (0.0011) [2023-12-26 02:47:23,716][123091] Updated weights for policy 0, policy_version 401330 (0.0008) [2023-12-26 02:47:23,779][123091] Updated weights for policy 0, policy_version 401340 (0.0005) [2023-12-26 02:47:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 204865536. Throughput: 0: 9042.9, 1: 8711.3. Samples: 204847304. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:23,785][121949] Avg episode reward: [(0, '6178.131'), (1, '5657.955')] [2023-12-26 02:47:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000398912_102121472.pth... [2023-12-26 02:47:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000397888_101859328.pth [2023-12-26 02:47:23,825][123091] Updated weights for policy 0, policy_version 401350 (0.0005) [2023-12-26 02:47:23,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000401360_102752256.pth... [2023-12-26 02:47:23,879][123091] Updated weights for policy 0, policy_version 401360 (0.0005) [2023-12-26 02:47:23,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000400272_102473728.pth [2023-12-26 02:47:23,901][123090] Updated weights for policy 1, policy_version 398922 (0.0010) [2023-12-26 02:47:23,959][123090] Updated weights for policy 1, policy_version 398932 (0.0009) [2023-12-26 02:47:24,008][123090] Updated weights for policy 1, policy_version 398942 (0.0005) [2023-12-26 02:47:24,533][123091] Updated weights for policy 0, policy_version 401370 (0.0008) [2023-12-26 02:47:24,595][123091] Updated weights for policy 0, policy_version 401380 (0.0007) [2023-12-26 02:47:24,657][123091] Updated weights for policy 0, policy_version 401390 (0.0007) [2023-12-26 02:47:24,760][123090] Updated weights for policy 1, policy_version 398952 (0.0009) [2023-12-26 02:47:24,807][123090] Updated weights for policy 1, policy_version 398962 (0.0010) [2023-12-26 02:47:24,858][123090] Updated weights for policy 1, policy_version 398972 (0.0010) [2023-12-26 02:47:25,360][123091] Updated weights for policy 0, policy_version 401400 (0.0009) [2023-12-26 02:47:25,407][123091] Updated weights for policy 0, policy_version 401410 (0.0010) [2023-12-26 02:47:25,458][123091] Updated weights for policy 0, policy_version 401420 (0.0010) [2023-12-26 02:47:25,613][123090] Updated weights for policy 1, policy_version 398982 (0.0007) [2023-12-26 02:47:25,668][123090] Updated weights for policy 1, policy_version 398992 (0.0005) [2023-12-26 02:47:25,724][123090] Updated weights for policy 1, policy_version 399002 (0.0007) [2023-12-26 02:47:26,300][123091] Updated weights for policy 0, policy_version 401430 (0.0007) [2023-12-26 02:47:26,375][123091] Updated weights for policy 0, policy_version 401440 (0.0005) [2023-12-26 02:47:26,434][123091] Updated weights for policy 0, policy_version 401450 (0.0005) [2023-12-26 02:47:26,556][123090] Updated weights for policy 1, policy_version 399012 (0.0009) [2023-12-26 02:47:26,606][123090] Updated weights for policy 1, policy_version 399022 (0.0009) [2023-12-26 02:47:26,676][123090] Updated weights for policy 1, policy_version 399032 (0.0005) [2023-12-26 02:47:27,114][123091] Updated weights for policy 0, policy_version 401460 (0.0008) [2023-12-26 02:47:27,172][123091] Updated weights for policy 0, policy_version 401470 (0.0010) [2023-12-26 02:47:27,230][123091] Updated weights for policy 0, policy_version 401480 (0.0010) [2023-12-26 02:47:27,315][123090] Updated weights for policy 1, policy_version 399042 (0.0005) [2023-12-26 02:47:27,379][123090] Updated weights for policy 1, policy_version 399052 (0.0009) [2023-12-26 02:47:27,440][123090] Updated weights for policy 1, policy_version 399062 (0.0010) [2023-12-26 02:47:27,512][123090] Updated weights for policy 1, policy_version 399072 (0.0010) [2023-12-26 02:47:27,937][123091] Updated weights for policy 0, policy_version 401490 (0.0010) [2023-12-26 02:47:27,991][123091] Updated weights for policy 0, policy_version 401500 (0.0010) [2023-12-26 02:47:28,045][123091] Updated weights for policy 0, policy_version 401510 (0.0006) [2023-12-26 02:47:28,097][123091] Updated weights for policy 0, policy_version 401520 (0.0005) [2023-12-26 02:47:28,206][123090] Updated weights for policy 1, policy_version 399082 (0.0009) [2023-12-26 02:47:28,257][123090] Updated weights for policy 1, policy_version 399092 (0.0010) [2023-12-26 02:47:28,316][123090] Updated weights for policy 1, policy_version 399102 (0.0010) [2023-12-26 02:47:28,778][123091] Updated weights for policy 0, policy_version 401530 (0.0010) [2023-12-26 02:47:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 204963840. Throughput: 0: 9052.4, 1: 8804.4. Samples: 204959344. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:28,785][121949] Avg episode reward: [(0, '6281.394'), (1, '5587.146')] [2023-12-26 02:47:28,840][123091] Updated weights for policy 0, policy_version 401540 (0.0010) [2023-12-26 02:47:28,906][123091] Updated weights for policy 0, policy_version 401550 (0.0011) [2023-12-26 02:47:29,145][123090] Updated weights for policy 1, policy_version 399112 (0.0006) [2023-12-26 02:47:29,210][123090] Updated weights for policy 1, policy_version 399122 (0.0005) [2023-12-26 02:47:29,281][123090] Updated weights for policy 1, policy_version 399132 (0.0007) [2023-12-26 02:47:29,648][123091] Updated weights for policy 0, policy_version 401560 (0.0010) [2023-12-26 02:47:29,707][123091] Updated weights for policy 0, policy_version 401570 (0.0011) [2023-12-26 02:47:29,766][123091] Updated weights for policy 0, policy_version 401580 (0.0011) [2023-12-26 02:47:29,967][123090] Updated weights for policy 1, policy_version 399142 (0.0007) [2023-12-26 02:47:30,020][123090] Updated weights for policy 1, policy_version 399152 (0.0009) [2023-12-26 02:47:30,080][123090] Updated weights for policy 1, policy_version 399162 (0.0009) [2023-12-26 02:47:30,583][123091] Updated weights for policy 0, policy_version 401590 (0.0007) [2023-12-26 02:47:30,646][123091] Updated weights for policy 0, policy_version 401600 (0.0005) [2023-12-26 02:47:30,697][123091] Updated weights for policy 0, policy_version 401610 (0.0006) [2023-12-26 02:47:30,810][123090] Updated weights for policy 1, policy_version 399172 (0.0007) [2023-12-26 02:47:30,879][123090] Updated weights for policy 1, policy_version 399182 (0.0005) [2023-12-26 02:47:30,947][123090] Updated weights for policy 1, policy_version 399192 (0.0005) [2023-12-26 02:47:31,434][123091] Updated weights for policy 0, policy_version 401620 (0.0007) [2023-12-26 02:47:31,502][123091] Updated weights for policy 0, policy_version 401630 (0.0008) [2023-12-26 02:47:31,552][123091] Updated weights for policy 0, policy_version 401640 (0.0008) [2023-12-26 02:47:31,616][123090] Updated weights for policy 1, policy_version 399202 (0.0006) [2023-12-26 02:47:31,676][123090] Updated weights for policy 1, policy_version 399212 (0.0007) [2023-12-26 02:47:31,736][123090] Updated weights for policy 1, policy_version 399222 (0.0007) [2023-12-26 02:47:31,795][123090] Updated weights for policy 1, policy_version 399232 (0.0008) [2023-12-26 02:47:32,370][123091] Updated weights for policy 0, policy_version 401650 (0.0008) [2023-12-26 02:47:32,440][123091] Updated weights for policy 0, policy_version 401660 (0.0011) [2023-12-26 02:47:32,503][123091] Updated weights for policy 0, policy_version 401670 (0.0007) [2023-12-26 02:47:32,524][123090] Updated weights for policy 1, policy_version 399242 (0.0011) [2023-12-26 02:47:32,569][123091] Updated weights for policy 0, policy_version 401680 (0.0006) [2023-12-26 02:47:32,587][123090] Updated weights for policy 1, policy_version 399252 (0.0010) [2023-12-26 02:47:32,646][123090] Updated weights for policy 1, policy_version 399262 (0.0010) [2023-12-26 02:47:33,243][123091] Updated weights for policy 0, policy_version 401690 (0.0005) [2023-12-26 02:47:33,301][123091] Updated weights for policy 0, policy_version 401700 (0.0006) [2023-12-26 02:47:33,310][123090] Updated weights for policy 1, policy_version 399272 (0.0009) [2023-12-26 02:47:33,358][123091] Updated weights for policy 0, policy_version 401710 (0.0005) [2023-12-26 02:47:33,373][123090] Updated weights for policy 1, policy_version 399282 (0.0010) [2023-12-26 02:47:33,440][123090] Updated weights for policy 1, policy_version 399292 (0.0010) [2023-12-26 02:47:33,784][121949] Fps is (10 sec: 19660.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 205062144. Throughput: 0: 9144.1, 1: 8946.2. Samples: 205073936. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:33,785][121949] Avg episode reward: [(0, '6399.168'), (1, '5751.261')] [2023-12-26 02:47:34,084][123091] Updated weights for policy 0, policy_version 401720 (0.0008) [2023-12-26 02:47:34,095][123090] Updated weights for policy 1, policy_version 399302 (0.0007) [2023-12-26 02:47:34,144][123091] Updated weights for policy 0, policy_version 401730 (0.0009) [2023-12-26 02:47:34,160][123090] Updated weights for policy 1, policy_version 399312 (0.0007) [2023-12-26 02:47:34,220][123091] Updated weights for policy 0, policy_version 401740 (0.0008) [2023-12-26 02:47:34,237][123090] Updated weights for policy 1, policy_version 399322 (0.0011) [2023-12-26 02:47:35,000][123090] Updated weights for policy 1, policy_version 399332 (0.0010) [2023-12-26 02:47:35,048][123091] Updated weights for policy 0, policy_version 401750 (0.0009) [2023-12-26 02:47:35,056][123090] Updated weights for policy 1, policy_version 399342 (0.0008) [2023-12-26 02:47:35,113][123090] Updated weights for policy 1, policy_version 399352 (0.0009) [2023-12-26 02:47:35,119][123091] Updated weights for policy 0, policy_version 401760 (0.0007) [2023-12-26 02:47:35,182][123091] Updated weights for policy 0, policy_version 401770 (0.0008) [2023-12-26 02:47:35,802][123091] Updated weights for policy 0, policy_version 401780 (0.0008) [2023-12-26 02:47:35,849][123090] Updated weights for policy 1, policy_version 399362 (0.0008) [2023-12-26 02:47:35,852][123091] Updated weights for policy 0, policy_version 401790 (0.0009) [2023-12-26 02:47:35,903][123091] Updated weights for policy 0, policy_version 401800 (0.0008) [2023-12-26 02:47:35,908][123090] Updated weights for policy 1, policy_version 399372 (0.0008) [2023-12-26 02:47:35,975][123090] Updated weights for policy 1, policy_version 399382 (0.0009) [2023-12-26 02:47:36,038][123090] Updated weights for policy 1, policy_version 399392 (0.0008) [2023-12-26 02:47:36,708][123091] Updated weights for policy 0, policy_version 401810 (0.0009) [2023-12-26 02:47:36,762][123091] Updated weights for policy 0, policy_version 401820 (0.0008) [2023-12-26 02:47:36,835][123091] Updated weights for policy 0, policy_version 401830 (0.0007) [2023-12-26 02:47:36,867][123090] Updated weights for policy 1, policy_version 399402 (0.0010) [2023-12-26 02:47:36,897][123091] Updated weights for policy 0, policy_version 401840 (0.0008) [2023-12-26 02:47:36,927][123090] Updated weights for policy 1, policy_version 399412 (0.0009) [2023-12-26 02:47:36,990][123090] Updated weights for policy 1, policy_version 399422 (0.0010) [2023-12-26 02:47:37,683][123091] Updated weights for policy 0, policy_version 401850 (0.0010) [2023-12-26 02:47:37,735][123091] Updated weights for policy 0, policy_version 401860 (0.0009) [2023-12-26 02:47:37,795][123091] Updated weights for policy 0, policy_version 401870 (0.0010) [2023-12-26 02:47:37,808][123090] Updated weights for policy 1, policy_version 399432 (0.0010) [2023-12-26 02:47:37,858][123090] Updated weights for policy 1, policy_version 399442 (0.0009) [2023-12-26 02:47:37,919][123090] Updated weights for policy 1, policy_version 399452 (0.0009) [2023-12-26 02:47:38,601][123091] Updated weights for policy 0, policy_version 401880 (0.0010) [2023-12-26 02:47:38,665][123091] Updated weights for policy 0, policy_version 401890 (0.0009) [2023-12-26 02:47:38,737][123091] Updated weights for policy 0, policy_version 401900 (0.0010) [2023-12-26 02:47:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 205152256. Throughput: 0: 9172.3, 1: 9009.6. Samples: 205128600. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:38,785][121949] Avg episode reward: [(0, '6291.451'), (1, '5681.031')] [2023-12-26 02:47:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000401904_102891520.pth... [2023-12-26 02:47:38,791][123090] Updated weights for policy 1, policy_version 399462 (0.0009) [2023-12-26 02:47:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000400816_102612992.pth [2023-12-26 02:47:38,850][123090] Updated weights for policy 1, policy_version 399472 (0.0009) [2023-12-26 02:47:38,901][123090] Updated weights for policy 1, policy_version 399482 (0.0009) [2023-12-26 02:47:38,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000399488_102268928.pth... [2023-12-26 02:47:38,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000398400_101990400.pth [2023-12-26 02:47:39,590][123091] Updated weights for policy 0, policy_version 401910 (0.0009) [2023-12-26 02:47:39,649][123091] Updated weights for policy 0, policy_version 401921 (0.0010) [2023-12-26 02:47:39,691][123090] Updated weights for policy 1, policy_version 399493 (0.0008) [2023-12-26 02:47:39,709][123091] Updated weights for policy 0, policy_version 401931 (0.0008) [2023-12-26 02:47:39,765][123090] Updated weights for policy 1, policy_version 399503 (0.0005) [2023-12-26 02:47:39,838][123090] Updated weights for policy 1, policy_version 399513 (0.0007) [2023-12-26 02:47:40,573][123091] Updated weights for policy 0, policy_version 401941 (0.0007) [2023-12-26 02:47:40,627][123090] Updated weights for policy 1, policy_version 399523 (0.0006) [2023-12-26 02:47:40,639][123091] Updated weights for policy 0, policy_version 401951 (0.0008) [2023-12-26 02:47:40,680][123090] Updated weights for policy 1, policy_version 399533 (0.0005) [2023-12-26 02:47:40,693][123091] Updated weights for policy 0, policy_version 401961 (0.0008) [2023-12-26 02:47:40,748][123090] Updated weights for policy 1, policy_version 399543 (0.0005) [2023-12-26 02:47:41,451][123090] Updated weights for policy 1, policy_version 399553 (0.0006) [2023-12-26 02:47:41,516][123090] Updated weights for policy 1, policy_version 399563 (0.0009) [2023-12-26 02:47:41,558][123091] Updated weights for policy 0, policy_version 401971 (0.0009) [2023-12-26 02:47:41,590][123090] Updated weights for policy 1, policy_version 399573 (0.0010) [2023-12-26 02:47:41,625][123091] Updated weights for policy 0, policy_version 401981 (0.0007) [2023-12-26 02:47:41,660][123090] Updated weights for policy 1, policy_version 399583 (0.0009) [2023-12-26 02:47:41,693][123091] Updated weights for policy 0, policy_version 401991 (0.0010) [2023-12-26 02:47:42,479][123090] Updated weights for policy 1, policy_version 399593 (0.0009) [2023-12-26 02:47:42,519][123091] Updated weights for policy 0, policy_version 402001 (0.0012) [2023-12-26 02:47:42,535][123090] Updated weights for policy 1, policy_version 399603 (0.0008) [2023-12-26 02:47:42,584][123091] Updated weights for policy 0, policy_version 402011 (0.0008) [2023-12-26 02:47:42,597][123090] Updated weights for policy 1, policy_version 399613 (0.0008) [2023-12-26 02:47:42,648][123091] Updated weights for policy 0, policy_version 402021 (0.0010) [2023-12-26 02:47:42,722][123091] Updated weights for policy 0, policy_version 402031 (0.0011) [2023-12-26 02:47:43,331][123091] Updated weights for policy 0, policy_version 402041 (0.0006) [2023-12-26 02:47:43,391][123091] Updated weights for policy 0, policy_version 402051 (0.0006) [2023-12-26 02:47:43,450][123091] Updated weights for policy 0, policy_version 402061 (0.0005) [2023-12-26 02:47:43,511][123090] Updated weights for policy 1, policy_version 399623 (0.0009) [2023-12-26 02:47:43,591][123090] Updated weights for policy 1, policy_version 399633 (0.0010) [2023-12-26 02:47:43,644][123090] Updated weights for policy 1, policy_version 399643 (0.0010) [2023-12-26 02:47:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 205242368. Throughput: 0: 9094.2, 1: 9068.4. Samples: 205232172. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:43,785][121949] Avg episode reward: [(0, '6260.457'), (1, '5510.046')] [2023-12-26 02:47:43,961][123091] Updated weights for policy 0, policy_version 402071 (0.0005) [2023-12-26 02:47:44,025][123091] Updated weights for policy 0, policy_version 402081 (0.0008) [2023-12-26 02:47:44,080][123091] Updated weights for policy 0, policy_version 402091 (0.0010) [2023-12-26 02:47:44,549][123090] Updated weights for policy 1, policy_version 399653 (0.0010) [2023-12-26 02:47:44,604][123090] Updated weights for policy 1, policy_version 399663 (0.0010) [2023-12-26 02:47:44,663][123090] Updated weights for policy 1, policy_version 399673 (0.0010) [2023-12-26 02:47:44,808][123091] Updated weights for policy 0, policy_version 402101 (0.0010) [2023-12-26 02:47:44,867][123091] Updated weights for policy 0, policy_version 402111 (0.0009) [2023-12-26 02:47:44,927][123091] Updated weights for policy 0, policy_version 402121 (0.0010) [2023-12-26 02:47:45,520][123090] Updated weights for policy 1, policy_version 399683 (0.0010) [2023-12-26 02:47:45,579][123090] Updated weights for policy 1, policy_version 399693 (0.0009) [2023-12-26 02:47:45,637][123090] Updated weights for policy 1, policy_version 399703 (0.0009) [2023-12-26 02:47:45,792][123091] Updated weights for policy 0, policy_version 402131 (0.0010) [2023-12-26 02:47:45,846][123091] Updated weights for policy 0, policy_version 402141 (0.0009) [2023-12-26 02:47:45,895][123091] Updated weights for policy 0, policy_version 402151 (0.0009) [2023-12-26 02:47:46,478][123090] Updated weights for policy 1, policy_version 399713 (0.0009) [2023-12-26 02:47:46,542][123090] Updated weights for policy 1, policy_version 399723 (0.0009) [2023-12-26 02:47:46,611][123090] Updated weights for policy 1, policy_version 399733 (0.0009) [2023-12-26 02:47:46,677][123090] Updated weights for policy 1, policy_version 399743 (0.0009) [2023-12-26 02:47:46,738][123091] Updated weights for policy 0, policy_version 402161 (0.0009) [2023-12-26 02:47:46,809][123091] Updated weights for policy 0, policy_version 402171 (0.0010) [2023-12-26 02:47:46,857][123091] Updated weights for policy 0, policy_version 402181 (0.0009) [2023-12-26 02:47:46,908][123091] Updated weights for policy 0, policy_version 402192 (0.0010) [2023-12-26 02:47:47,495][123090] Updated weights for policy 1, policy_version 399753 (0.0010) [2023-12-26 02:47:47,568][123090] Updated weights for policy 1, policy_version 399763 (0.0009) [2023-12-26 02:47:47,641][123090] Updated weights for policy 1, policy_version 399773 (0.0006) [2023-12-26 02:47:47,760][123091] Updated weights for policy 0, policy_version 402202 (0.0006) [2023-12-26 02:47:47,826][123091] Updated weights for policy 0, policy_version 402212 (0.0005) [2023-12-26 02:47:47,897][123091] Updated weights for policy 0, policy_version 402222 (0.0005) [2023-12-26 02:47:48,416][123090] Updated weights for policy 1, policy_version 399783 (0.0010) [2023-12-26 02:47:48,490][123090] Updated weights for policy 1, policy_version 399793 (0.0010) [2023-12-26 02:47:48,558][123090] Updated weights for policy 1, policy_version 399803 (0.0010) [2023-12-26 02:47:48,643][123091] Updated weights for policy 0, policy_version 402232 (0.0009) [2023-12-26 02:47:48,708][123091] Updated weights for policy 0, policy_version 402242 (0.0010) [2023-12-26 02:47:48,770][123091] Updated weights for policy 0, policy_version 402252 (0.0010) [2023-12-26 02:47:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 205324288. Throughput: 0: 9077.8, 1: 8970.3. Samples: 205336952. Policy #0 lag: (min: 3.0, avg: 11.3, max: 35.0) [2023-12-26 02:47:48,785][121949] Avg episode reward: [(0, '6365.480'), (1, '5384.545')] [2023-12-26 02:47:49,389][123090] Updated weights for policy 1, policy_version 399813 (0.0010) [2023-12-26 02:47:49,445][123090] Updated weights for policy 1, policy_version 399823 (0.0010) [2023-12-26 02:47:49,496][123090] Updated weights for policy 1, policy_version 399833 (0.0009) [2023-12-26 02:47:49,618][123091] Updated weights for policy 0, policy_version 402262 (0.0009) [2023-12-26 02:47:49,683][123091] Updated weights for policy 0, policy_version 402272 (0.0009) [2023-12-26 02:47:49,754][123091] Updated weights for policy 0, policy_version 402282 (0.0010) [2023-12-26 02:47:50,416][123090] Updated weights for policy 1, policy_version 399843 (0.0009) [2023-12-26 02:47:50,486][123090] Updated weights for policy 1, policy_version 399853 (0.0009) [2023-12-26 02:47:50,526][123091] Updated weights for policy 0, policy_version 402292 (0.0008) [2023-12-26 02:47:50,550][123090] Updated weights for policy 1, policy_version 399863 (0.0010) [2023-12-26 02:47:50,583][123091] Updated weights for policy 0, policy_version 402302 (0.0007) [2023-12-26 02:47:50,651][123091] Updated weights for policy 0, policy_version 402312 (0.0010) [2023-12-26 02:47:51,362][123090] Updated weights for policy 1, policy_version 399873 (0.0009) [2023-12-26 02:47:51,441][123090] Updated weights for policy 1, policy_version 399883 (0.0007) [2023-12-26 02:47:51,483][123091] Updated weights for policy 0, policy_version 402322 (0.0008) [2023-12-26 02:47:51,513][123090] Updated weights for policy 1, policy_version 399893 (0.0008) [2023-12-26 02:47:51,554][123091] Updated weights for policy 0, policy_version 402332 (0.0006) [2023-12-26 02:47:51,585][123090] Updated weights for policy 1, policy_version 399903 (0.0008) [2023-12-26 02:47:51,612][123091] Updated weights for policy 0, policy_version 402342 (0.0006) [2023-12-26 02:47:51,679][123091] Updated weights for policy 0, policy_version 402352 (0.0008) [2023-12-26 02:47:52,433][123090] Updated weights for policy 1, policy_version 399913 (0.0009) [2023-12-26 02:47:52,499][123090] Updated weights for policy 1, policy_version 399923 (0.0009) [2023-12-26 02:47:52,520][123091] Updated weights for policy 0, policy_version 402362 (0.0007) [2023-12-26 02:47:52,567][123090] Updated weights for policy 1, policy_version 399933 (0.0005) [2023-12-26 02:47:52,582][123091] Updated weights for policy 0, policy_version 402372 (0.0006) [2023-12-26 02:47:52,649][123091] Updated weights for policy 0, policy_version 402382 (0.0006) [2023-12-26 02:47:53,338][123090] Updated weights for policy 1, policy_version 399943 (0.0008) [2023-12-26 02:47:53,392][123091] Updated weights for policy 0, policy_version 402392 (0.0006) [2023-12-26 02:47:53,403][123090] Updated weights for policy 1, policy_version 399953 (0.0009) [2023-12-26 02:47:53,439][123091] Updated weights for policy 0, policy_version 402402 (0.0006) [2023-12-26 02:47:53,463][123090] Updated weights for policy 1, policy_version 399963 (0.0009) [2023-12-26 02:47:53,497][123091] Updated weights for policy 0, policy_version 402412 (0.0007) [2023-12-26 02:47:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.6, 300 sec: 17828.0). Total num frames: 205414400. Throughput: 0: 9082.1, 1: 8924.4. Samples: 205387444. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:47:53,785][121949] Avg episode reward: [(0, '6402.197'), (1, '5427.928')] [2023-12-26 02:47:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000402416_103022592.pth... [2023-12-26 02:47:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000399968_102391808.pth... [2023-12-26 02:47:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000398912_102121472.pth [2023-12-26 02:47:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000401360_102752256.pth [2023-12-26 02:47:54,150][123090] Updated weights for policy 1, policy_version 399973 (0.0007) [2023-12-26 02:47:54,215][123090] Updated weights for policy 1, policy_version 399983 (0.0005) [2023-12-26 02:47:54,290][123090] Updated weights for policy 1, policy_version 399993 (0.0005) [2023-12-26 02:47:54,301][123091] Updated weights for policy 0, policy_version 402422 (0.0006) [2023-12-26 02:47:54,352][123091] Updated weights for policy 0, policy_version 402432 (0.0005) [2023-12-26 02:47:54,411][123091] Updated weights for policy 0, policy_version 402442 (0.0005) [2023-12-26 02:47:54,944][123090] Updated weights for policy 1, policy_version 400003 (0.0006) [2023-12-26 02:47:55,006][123090] Updated weights for policy 1, policy_version 400013 (0.0006) [2023-12-26 02:47:55,071][123090] Updated weights for policy 1, policy_version 400024 (0.0006) [2023-12-26 02:47:55,202][123091] Updated weights for policy 0, policy_version 402452 (0.0007) [2023-12-26 02:47:55,246][123091] Updated weights for policy 0, policy_version 402462 (0.0010) [2023-12-26 02:47:55,301][123091] Updated weights for policy 0, policy_version 402472 (0.0010) [2023-12-26 02:47:55,799][123090] Updated weights for policy 1, policy_version 400034 (0.0006) [2023-12-26 02:47:55,853][123090] Updated weights for policy 1, policy_version 400044 (0.0005) [2023-12-26 02:47:55,908][123090] Updated weights for policy 1, policy_version 400054 (0.0005) [2023-12-26 02:47:55,962][123090] Updated weights for policy 1, policy_version 400064 (0.0005) [2023-12-26 02:47:56,132][123091] Updated weights for policy 0, policy_version 402482 (0.0011) [2023-12-26 02:47:56,194][123091] Updated weights for policy 0, policy_version 402492 (0.0010) [2023-12-26 02:47:56,256][123091] Updated weights for policy 0, policy_version 402502 (0.0010) [2023-12-26 02:47:56,318][123091] Updated weights for policy 0, policy_version 402512 (0.0011) [2023-12-26 02:47:56,579][123090] Updated weights for policy 1, policy_version 400074 (0.0005) [2023-12-26 02:47:56,660][123090] Updated weights for policy 1, policy_version 400084 (0.0005) [2023-12-26 02:47:56,736][123090] Updated weights for policy 1, policy_version 400094 (0.0005) [2023-12-26 02:47:57,073][123091] Updated weights for policy 0, policy_version 402522 (0.0005) [2023-12-26 02:47:57,117][123091] Updated weights for policy 0, policy_version 402532 (0.0005) [2023-12-26 02:47:57,174][123091] Updated weights for policy 0, policy_version 402542 (0.0009) [2023-12-26 02:47:57,308][123090] Updated weights for policy 1, policy_version 400104 (0.0005) [2023-12-26 02:47:57,375][123090] Updated weights for policy 1, policy_version 400114 (0.0006) [2023-12-26 02:47:57,447][123090] Updated weights for policy 1, policy_version 400124 (0.0005) [2023-12-26 02:47:57,875][123091] Updated weights for policy 0, policy_version 402552 (0.0006) [2023-12-26 02:47:57,924][123091] Updated weights for policy 0, policy_version 402562 (0.0005) [2023-12-26 02:47:57,980][123091] Updated weights for policy 0, policy_version 402572 (0.0006) [2023-12-26 02:47:58,067][123090] Updated weights for policy 1, policy_version 400134 (0.0008) [2023-12-26 02:47:58,129][123090] Updated weights for policy 1, policy_version 400144 (0.0010) [2023-12-26 02:47:58,196][123090] Updated weights for policy 1, policy_version 400154 (0.0010) [2023-12-26 02:47:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 205504512. Throughput: 0: 9139.5, 1: 9097.6. Samples: 205500272. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:47:58,785][121949] Avg episode reward: [(0, '6411.894'), (1, '5563.398')] [2023-12-26 02:47:58,862][123091] Updated weights for policy 0, policy_version 402582 (0.0009) [2023-12-26 02:47:58,927][123091] Updated weights for policy 0, policy_version 402592 (0.0009) [2023-12-26 02:47:58,988][123091] Updated weights for policy 0, policy_version 402602 (0.0009) [2023-12-26 02:47:59,152][123090] Updated weights for policy 1, policy_version 400164 (0.0010) [2023-12-26 02:47:59,229][123090] Updated weights for policy 1, policy_version 400174 (0.0010) [2023-12-26 02:47:59,295][123090] Updated weights for policy 1, policy_version 400184 (0.0007) [2023-12-26 02:47:59,911][123091] Updated weights for policy 0, policy_version 402612 (0.0009) [2023-12-26 02:47:59,980][123091] Updated weights for policy 0, policy_version 402622 (0.0008) [2023-12-26 02:48:00,041][123091] Updated weights for policy 0, policy_version 402632 (0.0009) [2023-12-26 02:48:00,068][123090] Updated weights for policy 1, policy_version 400194 (0.0009) [2023-12-26 02:48:00,134][123090] Updated weights for policy 1, policy_version 400204 (0.0010) [2023-12-26 02:48:00,204][123090] Updated weights for policy 1, policy_version 400214 (0.0010) [2023-12-26 02:48:00,272][123090] Updated weights for policy 1, policy_version 400224 (0.0009) [2023-12-26 02:48:00,886][123091] Updated weights for policy 0, policy_version 402642 (0.0009) [2023-12-26 02:48:00,938][123091] Updated weights for policy 0, policy_version 402652 (0.0009) [2023-12-26 02:48:00,995][123091] Updated weights for policy 0, policy_version 402662 (0.0007) [2023-12-26 02:48:01,018][123090] Updated weights for policy 1, policy_version 400234 (0.0010) [2023-12-26 02:48:01,070][123091] Updated weights for policy 0, policy_version 402672 (0.0008) [2023-12-26 02:48:01,076][123090] Updated weights for policy 1, policy_version 400244 (0.0010) [2023-12-26 02:48:01,143][123090] Updated weights for policy 1, policy_version 400254 (0.0010) [2023-12-26 02:48:01,866][123091] Updated weights for policy 0, policy_version 402682 (0.0007) [2023-12-26 02:48:01,922][123091] Updated weights for policy 0, policy_version 402692 (0.0009) [2023-12-26 02:48:01,968][123090] Updated weights for policy 1, policy_version 400264 (0.0009) [2023-12-26 02:48:01,988][123091] Updated weights for policy 0, policy_version 402702 (0.0008) [2023-12-26 02:48:02,031][123090] Updated weights for policy 1, policy_version 400274 (0.0006) [2023-12-26 02:48:02,087][123090] Updated weights for policy 1, policy_version 400284 (0.0008) [2023-12-26 02:48:02,715][123091] Updated weights for policy 0, policy_version 402712 (0.0006) [2023-12-26 02:48:02,770][123091] Updated weights for policy 0, policy_version 402722 (0.0007) [2023-12-26 02:48:02,817][123091] Updated weights for policy 0, policy_version 402732 (0.0008) [2023-12-26 02:48:02,832][123090] Updated weights for policy 1, policy_version 400294 (0.0008) [2023-12-26 02:48:02,880][123090] Updated weights for policy 1, policy_version 400304 (0.0010) [2023-12-26 02:48:02,934][123090] Updated weights for policy 1, policy_version 400314 (0.0010) [2023-12-26 02:48:03,642][123091] Updated weights for policy 0, policy_version 402742 (0.0005) [2023-12-26 02:48:03,646][123090] Updated weights for policy 1, policy_version 400324 (0.0008) [2023-12-26 02:48:03,699][123090] Updated weights for policy 1, policy_version 400334 (0.0010) [2023-12-26 02:48:03,712][123091] Updated weights for policy 0, policy_version 402752 (0.0006) [2023-12-26 02:48:03,763][123090] Updated weights for policy 1, policy_version 400344 (0.0007) [2023-12-26 02:48:03,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 205586432. Throughput: 0: 9022.2, 1: 9037.4. Samples: 205607336. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:03,785][121949] Avg episode reward: [(0, '6328.042'), (1, '5640.127')] [2023-12-26 02:48:03,793][123091] Updated weights for policy 0, policy_version 402762 (0.0005) [2023-12-26 02:48:04,344][123091] Updated weights for policy 0, policy_version 402772 (0.0007) [2023-12-26 02:48:04,403][123091] Updated weights for policy 0, policy_version 402782 (0.0010) [2023-12-26 02:48:04,448][123090] Updated weights for policy 1, policy_version 400354 (0.0006) [2023-12-26 02:48:04,461][123091] Updated weights for policy 0, policy_version 402792 (0.0009) [2023-12-26 02:48:04,516][123090] Updated weights for policy 1, policy_version 400364 (0.0008) [2023-12-26 02:48:04,582][123090] Updated weights for policy 1, policy_version 400374 (0.0009) [2023-12-26 02:48:04,645][123090] Updated weights for policy 1, policy_version 400384 (0.0010) [2023-12-26 02:48:05,256][123091] Updated weights for policy 0, policy_version 402802 (0.0006) [2023-12-26 02:48:05,320][123091] Updated weights for policy 0, policy_version 402812 (0.0008) [2023-12-26 02:48:05,388][123091] Updated weights for policy 0, policy_version 402822 (0.0008) [2023-12-26 02:48:05,420][123090] Updated weights for policy 1, policy_version 400394 (0.0006) [2023-12-26 02:48:05,462][123091] Updated weights for policy 0, policy_version 402832 (0.0008) [2023-12-26 02:48:05,484][123090] Updated weights for policy 1, policy_version 400404 (0.0006) [2023-12-26 02:48:05,546][123090] Updated weights for policy 1, policy_version 400414 (0.0007) [2023-12-26 02:48:06,300][123091] Updated weights for policy 0, policy_version 402842 (0.0009) [2023-12-26 02:48:06,312][123090] Updated weights for policy 1, policy_version 400424 (0.0008) [2023-12-26 02:48:06,357][123091] Updated weights for policy 0, policy_version 402852 (0.0007) [2023-12-26 02:48:06,380][123090] Updated weights for policy 1, policy_version 400434 (0.0009) [2023-12-26 02:48:06,420][123091] Updated weights for policy 0, policy_version 402862 (0.0008) [2023-12-26 02:48:06,442][123090] Updated weights for policy 1, policy_version 400444 (0.0009) [2023-12-26 02:48:07,217][123090] Updated weights for policy 1, policy_version 400454 (0.0007) [2023-12-26 02:48:07,254][123091] Updated weights for policy 0, policy_version 402872 (0.0010) [2023-12-26 02:48:07,281][123090] Updated weights for policy 1, policy_version 400464 (0.0010) [2023-12-26 02:48:07,319][123091] Updated weights for policy 0, policy_version 402882 (0.0005) [2023-12-26 02:48:07,331][123090] Updated weights for policy 1, policy_version 400474 (0.0009) [2023-12-26 02:48:07,391][123091] Updated weights for policy 0, policy_version 402892 (0.0009) [2023-12-26 02:48:08,126][123090] Updated weights for policy 1, policy_version 400484 (0.0005) [2023-12-26 02:48:08,178][123091] Updated weights for policy 0, policy_version 402902 (0.0010) [2023-12-26 02:48:08,196][123090] Updated weights for policy 1, policy_version 400494 (0.0005) [2023-12-26 02:48:08,240][123091] Updated weights for policy 0, policy_version 402912 (0.0011) [2023-12-26 02:48:08,258][123090] Updated weights for policy 1, policy_version 400504 (0.0009) [2023-12-26 02:48:08,295][123091] Updated weights for policy 0, policy_version 402922 (0.0010) [2023-12-26 02:48:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 205684736. Throughput: 0: 9015.0, 1: 9079.3. Samples: 205661544. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:08,785][121949] Avg episode reward: [(0, '6298.311'), (1, '5555.480')] [2023-12-26 02:48:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000402928_103153664.pth... [2023-12-26 02:48:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000400512_102531072.pth... [2023-12-26 02:48:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000401904_102891520.pth [2023-12-26 02:48:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000399488_102268928.pth [2023-12-26 02:48:08,940][123090] Updated weights for policy 1, policy_version 400514 (0.0009) [2023-12-26 02:48:08,997][123090] Updated weights for policy 1, policy_version 400524 (0.0006) [2023-12-26 02:48:09,065][123090] Updated weights for policy 1, policy_version 400534 (0.0008) [2023-12-26 02:48:09,131][123090] Updated weights for policy 1, policy_version 400544 (0.0010) [2023-12-26 02:48:09,132][123091] Updated weights for policy 0, policy_version 402932 (0.0011) [2023-12-26 02:48:09,194][123091] Updated weights for policy 0, policy_version 402942 (0.0010) [2023-12-26 02:48:09,269][123091] Updated weights for policy 0, policy_version 402952 (0.0009) [2023-12-26 02:48:09,977][123090] Updated weights for policy 1, policy_version 400554 (0.0009) [2023-12-26 02:48:10,042][123090] Updated weights for policy 1, policy_version 400564 (0.0010) [2023-12-26 02:48:10,093][123091] Updated weights for policy 0, policy_version 402962 (0.0010) [2023-12-26 02:48:10,095][123090] Updated weights for policy 1, policy_version 400574 (0.0009) [2023-12-26 02:48:10,163][123091] Updated weights for policy 0, policy_version 402972 (0.0006) [2023-12-26 02:48:10,233][123091] Updated weights for policy 0, policy_version 402982 (0.0008) [2023-12-26 02:48:10,296][123091] Updated weights for policy 0, policy_version 402992 (0.0009) [2023-12-26 02:48:10,970][123091] Updated weights for policy 0, policy_version 403002 (0.0006) [2023-12-26 02:48:10,991][123090] Updated weights for policy 1, policy_version 400584 (0.0008) [2023-12-26 02:48:11,042][123091] Updated weights for policy 0, policy_version 403012 (0.0007) [2023-12-26 02:48:11,055][123090] Updated weights for policy 1, policy_version 400594 (0.0010) [2023-12-26 02:48:11,107][123091] Updated weights for policy 0, policy_version 403022 (0.0009) [2023-12-26 02:48:11,115][123090] Updated weights for policy 1, policy_version 400604 (0.0009) [2023-12-26 02:48:11,971][123091] Updated weights for policy 0, policy_version 403032 (0.0011) [2023-12-26 02:48:12,033][123090] Updated weights for policy 1, policy_version 400614 (0.0010) [2023-12-26 02:48:12,040][123091] Updated weights for policy 0, policy_version 403042 (0.0011) [2023-12-26 02:48:12,094][123090] Updated weights for policy 1, policy_version 400624 (0.0006) [2023-12-26 02:48:12,104][123091] Updated weights for policy 0, policy_version 403052 (0.0011) [2023-12-26 02:48:12,152][123090] Updated weights for policy 1, policy_version 400634 (0.0007) [2023-12-26 02:48:12,940][123091] Updated weights for policy 0, policy_version 403062 (0.0011) [2023-12-26 02:48:12,978][123090] Updated weights for policy 1, policy_version 400644 (0.0007) [2023-12-26 02:48:13,000][123091] Updated weights for policy 0, policy_version 403072 (0.0011) [2023-12-26 02:48:13,031][123090] Updated weights for policy 1, policy_version 400654 (0.0005) [2023-12-26 02:48:13,071][123091] Updated weights for policy 0, policy_version 403082 (0.0011) [2023-12-26 02:48:13,087][123090] Updated weights for policy 1, policy_version 400664 (0.0005) [2023-12-26 02:48:13,716][123090] Updated weights for policy 1, policy_version 400674 (0.0006) [2023-12-26 02:48:13,771][123090] Updated weights for policy 1, policy_version 400684 (0.0010) [2023-12-26 02:48:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 205766656. Throughput: 0: 8925.2, 1: 8962.9. Samples: 205764312. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:13,785][121949] Avg episode reward: [(0, '6306.065'), (1, '5639.020')] [2023-12-26 02:48:13,820][123090] Updated weights for policy 1, policy_version 400694 (0.0009) [2023-12-26 02:48:13,875][123090] Updated weights for policy 1, policy_version 400704 (0.0005) [2023-12-26 02:48:13,877][123091] Updated weights for policy 0, policy_version 403092 (0.0011) [2023-12-26 02:48:13,932][123091] Updated weights for policy 0, policy_version 403102 (0.0010) [2023-12-26 02:48:13,983][123091] Updated weights for policy 0, policy_version 403112 (0.0010) [2023-12-26 02:48:14,623][123090] Updated weights for policy 1, policy_version 400714 (0.0006) [2023-12-26 02:48:14,679][123090] Updated weights for policy 1, policy_version 400724 (0.0006) [2023-12-26 02:48:14,746][123090] Updated weights for policy 1, policy_version 400734 (0.0006) [2023-12-26 02:48:14,818][123091] Updated weights for policy 0, policy_version 403122 (0.0011) [2023-12-26 02:48:14,881][123091] Updated weights for policy 0, policy_version 403132 (0.0011) [2023-12-26 02:48:14,945][123091] Updated weights for policy 0, policy_version 403142 (0.0011) [2023-12-26 02:48:15,007][123091] Updated weights for policy 0, policy_version 403152 (0.0009) [2023-12-26 02:48:15,424][123090] Updated weights for policy 1, policy_version 400744 (0.0009) [2023-12-26 02:48:15,478][123090] Updated weights for policy 1, policy_version 400754 (0.0009) [2023-12-26 02:48:15,547][123090] Updated weights for policy 1, policy_version 400764 (0.0006) [2023-12-26 02:48:15,783][123091] Updated weights for policy 0, policy_version 403162 (0.0011) [2023-12-26 02:48:15,835][123091] Updated weights for policy 0, policy_version 403172 (0.0011) [2023-12-26 02:48:15,888][123091] Updated weights for policy 0, policy_version 403182 (0.0011) [2023-12-26 02:48:16,246][123090] Updated weights for policy 1, policy_version 400774 (0.0009) [2023-12-26 02:48:16,301][123090] Updated weights for policy 1, policy_version 400784 (0.0010) [2023-12-26 02:48:16,367][123090] Updated weights for policy 1, policy_version 400794 (0.0010) [2023-12-26 02:48:16,665][123091] Updated weights for policy 0, policy_version 403192 (0.0008) [2023-12-26 02:48:16,713][123091] Updated weights for policy 0, policy_version 403202 (0.0007) [2023-12-26 02:48:16,762][123091] Updated weights for policy 0, policy_version 403212 (0.0009) [2023-12-26 02:48:17,198][123090] Updated weights for policy 1, policy_version 400804 (0.0010) [2023-12-26 02:48:17,264][123090] Updated weights for policy 1, policy_version 400814 (0.0009) [2023-12-26 02:48:17,333][123090] Updated weights for policy 1, policy_version 400824 (0.0010) [2023-12-26 02:48:17,559][123091] Updated weights for policy 0, policy_version 403222 (0.0009) [2023-12-26 02:48:17,612][123091] Updated weights for policy 0, policy_version 403233 (0.0010) [2023-12-26 02:48:17,666][123091] Updated weights for policy 0, policy_version 403243 (0.0010) [2023-12-26 02:48:18,031][123090] Updated weights for policy 1, policy_version 400834 (0.0009) [2023-12-26 02:48:18,097][123090] Updated weights for policy 1, policy_version 400844 (0.0009) [2023-12-26 02:48:18,149][123090] Updated weights for policy 1, policy_version 400854 (0.0010) [2023-12-26 02:48:18,200][123090] Updated weights for policy 1, policy_version 400864 (0.0005) [2023-12-26 02:48:18,550][123091] Updated weights for policy 0, policy_version 403253 (0.0009) [2023-12-26 02:48:18,611][123091] Updated weights for policy 0, policy_version 403263 (0.0009) [2023-12-26 02:48:18,675][123091] Updated weights for policy 0, policy_version 403273 (0.0009) [2023-12-26 02:48:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 205864960. Throughput: 0: 8825.8, 1: 8951.8. Samples: 205873924. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:18,785][121949] Avg episode reward: [(0, '6414.306'), (1, '5608.750')] [2023-12-26 02:48:19,035][123090] Updated weights for policy 1, policy_version 400874 (0.0009) [2023-12-26 02:48:19,094][123090] Updated weights for policy 1, policy_version 400884 (0.0010) [2023-12-26 02:48:19,152][123090] Updated weights for policy 1, policy_version 400894 (0.0010) [2023-12-26 02:48:19,510][123091] Updated weights for policy 0, policy_version 403283 (0.0010) [2023-12-26 02:48:19,574][123091] Updated weights for policy 0, policy_version 403293 (0.0010) [2023-12-26 02:48:19,638][123091] Updated weights for policy 0, policy_version 403303 (0.0010) [2023-12-26 02:48:20,047][123090] Updated weights for policy 1, policy_version 400904 (0.0010) [2023-12-26 02:48:20,107][123090] Updated weights for policy 1, policy_version 400914 (0.0010) [2023-12-26 02:48:20,174][123090] Updated weights for policy 1, policy_version 400924 (0.0010) [2023-12-26 02:48:20,386][123091] Updated weights for policy 0, policy_version 403313 (0.0010) [2023-12-26 02:48:20,453][123091] Updated weights for policy 0, policy_version 403323 (0.0010) [2023-12-26 02:48:20,516][123091] Updated weights for policy 0, policy_version 403333 (0.0010) [2023-12-26 02:48:20,576][123091] Updated weights for policy 0, policy_version 403343 (0.0010) [2023-12-26 02:48:21,047][123090] Updated weights for policy 1, policy_version 400934 (0.0009) [2023-12-26 02:48:21,114][123090] Updated weights for policy 1, policy_version 400944 (0.0009) [2023-12-26 02:48:21,185][123090] Updated weights for policy 1, policy_version 400954 (0.0009) [2023-12-26 02:48:21,467][123091] Updated weights for policy 0, policy_version 403353 (0.0008) [2023-12-26 02:48:21,540][123091] Updated weights for policy 0, policy_version 403363 (0.0006) [2023-12-26 02:48:21,615][123091] Updated weights for policy 0, policy_version 403373 (0.0007) [2023-12-26 02:48:22,083][123090] Updated weights for policy 1, policy_version 400964 (0.0009) [2023-12-26 02:48:22,142][123090] Updated weights for policy 1, policy_version 400974 (0.0009) [2023-12-26 02:48:22,192][123090] Updated weights for policy 1, policy_version 400984 (0.0009) [2023-12-26 02:48:22,448][123091] Updated weights for policy 0, policy_version 403383 (0.0009) [2023-12-26 02:48:22,511][123091] Updated weights for policy 0, policy_version 403393 (0.0009) [2023-12-26 02:48:22,570][123091] Updated weights for policy 0, policy_version 403403 (0.0010) [2023-12-26 02:48:23,019][123090] Updated weights for policy 1, policy_version 400994 (0.0008) [2023-12-26 02:48:23,091][123090] Updated weights for policy 1, policy_version 401004 (0.0008) [2023-12-26 02:48:23,155][123090] Updated weights for policy 1, policy_version 401014 (0.0008) [2023-12-26 02:48:23,219][123090] Updated weights for policy 1, policy_version 401024 (0.0009) [2023-12-26 02:48:23,463][123091] Updated weights for policy 0, policy_version 403413 (0.0010) [2023-12-26 02:48:23,528][123091] Updated weights for policy 0, policy_version 403423 (0.0009) [2023-12-26 02:48:23,586][123091] Updated weights for policy 0, policy_version 403433 (0.0010) [2023-12-26 02:48:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 205946880. Throughput: 0: 8777.7, 1: 8876.6. Samples: 205923044. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:23,784][121949] Avg episode reward: [(0, '6453.944'), (1, '5609.342')] [2023-12-26 02:48:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000403440_103284736.pth... [2023-12-26 02:48:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000401024_102662144.pth... [2023-12-26 02:48:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000402416_103022592.pth [2023-12-26 02:48:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000399968_102391808.pth [2023-12-26 02:48:23,976][123090] Updated weights for policy 1, policy_version 401034 (0.0009) [2023-12-26 02:48:24,038][123090] Updated weights for policy 1, policy_version 401045 (0.0010) [2023-12-26 02:48:24,110][123090] Updated weights for policy 1, policy_version 401055 (0.0009) [2023-12-26 02:48:24,342][123091] Updated weights for policy 0, policy_version 403443 (0.0008) [2023-12-26 02:48:24,390][123091] Updated weights for policy 0, policy_version 403453 (0.0006) [2023-12-26 02:48:24,440][123091] Updated weights for policy 0, policy_version 403463 (0.0005) [2023-12-26 02:48:24,982][123090] Updated weights for policy 1, policy_version 401065 (0.0009) [2023-12-26 02:48:25,047][123090] Updated weights for policy 1, policy_version 401075 (0.0008) [2023-12-26 02:48:25,109][123090] Updated weights for policy 1, policy_version 401085 (0.0008) [2023-12-26 02:48:25,110][123091] Updated weights for policy 0, policy_version 403473 (0.0005) [2023-12-26 02:48:25,158][123091] Updated weights for policy 0, policy_version 403483 (0.0005) [2023-12-26 02:48:25,208][123091] Updated weights for policy 0, policy_version 403493 (0.0005) [2023-12-26 02:48:25,256][123091] Updated weights for policy 0, policy_version 403503 (0.0005) [2023-12-26 02:48:25,862][123090] Updated weights for policy 1, policy_version 401095 (0.0009) [2023-12-26 02:48:25,929][123090] Updated weights for policy 1, policy_version 401105 (0.0009) [2023-12-26 02:48:25,994][123090] Updated weights for policy 1, policy_version 401115 (0.0009) [2023-12-26 02:48:26,005][123091] Updated weights for policy 0, policy_version 403513 (0.0005) [2023-12-26 02:48:26,070][123091] Updated weights for policy 0, policy_version 403523 (0.0007) [2023-12-26 02:48:26,141][123091] Updated weights for policy 0, policy_version 403533 (0.0006) [2023-12-26 02:48:26,804][123090] Updated weights for policy 1, policy_version 401125 (0.0009) [2023-12-26 02:48:26,865][123090] Updated weights for policy 1, policy_version 401135 (0.0009) [2023-12-26 02:48:26,900][123091] Updated weights for policy 0, policy_version 403543 (0.0007) [2023-12-26 02:48:26,912][123090] Updated weights for policy 1, policy_version 401145 (0.0009) [2023-12-26 02:48:26,952][123091] Updated weights for policy 0, policy_version 403553 (0.0009) [2023-12-26 02:48:27,013][123091] Updated weights for policy 0, policy_version 403563 (0.0009) [2023-12-26 02:48:27,771][123090] Updated weights for policy 1, policy_version 401155 (0.0008) [2023-12-26 02:48:27,775][123091] Updated weights for policy 0, policy_version 403573 (0.0007) [2023-12-26 02:48:27,825][123090] Updated weights for policy 1, policy_version 401165 (0.0009) [2023-12-26 02:48:27,828][123091] Updated weights for policy 0, policy_version 403583 (0.0006) [2023-12-26 02:48:27,876][123090] Updated weights for policy 1, policy_version 401175 (0.0007) [2023-12-26 02:48:27,885][123091] Updated weights for policy 0, policy_version 403593 (0.0009) [2023-12-26 02:48:28,614][123091] Updated weights for policy 0, policy_version 403603 (0.0009) [2023-12-26 02:48:28,662][123091] Updated weights for policy 0, policy_version 403613 (0.0009) [2023-12-26 02:48:28,729][123091] Updated weights for policy 0, policy_version 403623 (0.0009) [2023-12-26 02:48:28,745][123090] Updated weights for policy 1, policy_version 401185 (0.0008) [2023-12-26 02:48:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 206036992. Throughput: 0: 8856.6, 1: 8857.7. Samples: 206029316. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:28,785][121949] Avg episode reward: [(0, '6417.011'), (1, '5570.557')] [2023-12-26 02:48:28,801][123090] Updated weights for policy 1, policy_version 401195 (0.0006) [2023-12-26 02:48:28,849][123090] Updated weights for policy 1, policy_version 401205 (0.0007) [2023-12-26 02:48:28,905][123090] Updated weights for policy 1, policy_version 401215 (0.0009) [2023-12-26 02:48:29,577][123091] Updated weights for policy 0, policy_version 403633 (0.0009) [2023-12-26 02:48:29,646][123091] Updated weights for policy 0, policy_version 403643 (0.0010) [2023-12-26 02:48:29,703][123091] Updated weights for policy 0, policy_version 403653 (0.0007) [2023-12-26 02:48:29,711][123090] Updated weights for policy 1, policy_version 401225 (0.0010) [2023-12-26 02:48:29,757][123091] Updated weights for policy 0, policy_version 403663 (0.0008) [2023-12-26 02:48:29,759][123090] Updated weights for policy 1, policy_version 401236 (0.0009) [2023-12-26 02:48:29,809][123090] Updated weights for policy 1, policy_version 401246 (0.0009) [2023-12-26 02:48:30,570][123091] Updated weights for policy 0, policy_version 403673 (0.0010) [2023-12-26 02:48:30,629][123091] Updated weights for policy 0, policy_version 403683 (0.0009) [2023-12-26 02:48:30,649][123090] Updated weights for policy 1, policy_version 401256 (0.0006) [2023-12-26 02:48:30,679][123091] Updated weights for policy 0, policy_version 403693 (0.0008) [2023-12-26 02:48:30,709][123090] Updated weights for policy 1, policy_version 401266 (0.0007) [2023-12-26 02:48:30,773][123090] Updated weights for policy 1, policy_version 401276 (0.0008) [2023-12-26 02:48:31,552][123091] Updated weights for policy 0, policy_version 403703 (0.0006) [2023-12-26 02:48:31,563][123090] Updated weights for policy 1, policy_version 401286 (0.0006) [2023-12-26 02:48:31,625][123091] Updated weights for policy 0, policy_version 403713 (0.0007) [2023-12-26 02:48:31,627][123090] Updated weights for policy 1, policy_version 401296 (0.0007) [2023-12-26 02:48:31,689][123091] Updated weights for policy 0, policy_version 403723 (0.0006) [2023-12-26 02:48:31,693][123090] Updated weights for policy 1, policy_version 401306 (0.0007) [2023-12-26 02:48:32,396][123091] Updated weights for policy 0, policy_version 403733 (0.0008) [2023-12-26 02:48:32,460][123091] Updated weights for policy 0, policy_version 403743 (0.0009) [2023-12-26 02:48:32,517][123091] Updated weights for policy 0, policy_version 403753 (0.0006) [2023-12-26 02:48:32,527][123090] Updated weights for policy 1, policy_version 401316 (0.0008) [2023-12-26 02:48:32,588][123090] Updated weights for policy 1, policy_version 401326 (0.0009) [2023-12-26 02:48:32,645][123090] Updated weights for policy 1, policy_version 401336 (0.0010) [2023-12-26 02:48:33,256][123091] Updated weights for policy 0, policy_version 403763 (0.0007) [2023-12-26 02:48:33,304][123091] Updated weights for policy 0, policy_version 403773 (0.0009) [2023-12-26 02:48:33,351][123091] Updated weights for policy 0, policy_version 403783 (0.0008) [2023-12-26 02:48:33,486][123090] Updated weights for policy 1, policy_version 401346 (0.0009) [2023-12-26 02:48:33,542][123090] Updated weights for policy 1, policy_version 401356 (0.0009) [2023-12-26 02:48:33,596][123090] Updated weights for policy 1, policy_version 401366 (0.0009) [2023-12-26 02:48:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 206127104. Throughput: 0: 8816.8, 1: 8902.3. Samples: 206134312. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:33,785][121949] Avg episode reward: [(0, '6389.351'), (1, '5626.920')] [2023-12-26 02:48:34,054][123091] Updated weights for policy 0, policy_version 403793 (0.0008) [2023-12-26 02:48:34,105][123091] Updated weights for policy 0, policy_version 403803 (0.0010) [2023-12-26 02:48:34,167][123091] Updated weights for policy 0, policy_version 403813 (0.0010) [2023-12-26 02:48:34,223][123091] Updated weights for policy 0, policy_version 403823 (0.0011) [2023-12-26 02:48:34,465][123090] Updated weights for policy 1, policy_version 401377 (0.0009) [2023-12-26 02:48:34,523][123090] Updated weights for policy 1, policy_version 401387 (0.0005) [2023-12-26 02:48:34,582][123090] Updated weights for policy 1, policy_version 401397 (0.0006) [2023-12-26 02:48:34,642][123090] Updated weights for policy 1, policy_version 401407 (0.0007) [2023-12-26 02:48:35,078][123091] Updated weights for policy 0, policy_version 403833 (0.0010) [2023-12-26 02:48:35,130][123091] Updated weights for policy 0, policy_version 403843 (0.0007) [2023-12-26 02:48:35,177][123091] Updated weights for policy 0, policy_version 403853 (0.0005) [2023-12-26 02:48:35,368][123090] Updated weights for policy 1, policy_version 401417 (0.0005) [2023-12-26 02:48:35,428][123090] Updated weights for policy 1, policy_version 401427 (0.0006) [2023-12-26 02:48:35,490][123090] Updated weights for policy 1, policy_version 401437 (0.0008) [2023-12-26 02:48:35,952][123091] Updated weights for policy 0, policy_version 403863 (0.0005) [2023-12-26 02:48:36,005][123091] Updated weights for policy 0, policy_version 403873 (0.0005) [2023-12-26 02:48:36,052][123091] Updated weights for policy 0, policy_version 403883 (0.0005) [2023-12-26 02:48:36,194][123090] Updated weights for policy 1, policy_version 401447 (0.0009) [2023-12-26 02:48:36,251][123090] Updated weights for policy 1, policy_version 401457 (0.0010) [2023-12-26 02:48:36,304][123090] Updated weights for policy 1, policy_version 401467 (0.0009) [2023-12-26 02:48:36,817][123091] Updated weights for policy 0, policy_version 403893 (0.0007) [2023-12-26 02:48:36,886][123091] Updated weights for policy 0, policy_version 403903 (0.0006) [2023-12-26 02:48:36,952][123091] Updated weights for policy 0, policy_version 403913 (0.0006) [2023-12-26 02:48:37,223][123090] Updated weights for policy 1, policy_version 401477 (0.0009) [2023-12-26 02:48:37,276][123090] Updated weights for policy 1, policy_version 401487 (0.0010) [2023-12-26 02:48:37,334][123090] Updated weights for policy 1, policy_version 401498 (0.0010) [2023-12-26 02:48:37,630][123091] Updated weights for policy 0, policy_version 403923 (0.0006) [2023-12-26 02:48:37,698][123091] Updated weights for policy 0, policy_version 403933 (0.0008) [2023-12-26 02:48:37,772][123091] Updated weights for policy 0, policy_version 403943 (0.0006) [2023-12-26 02:48:38,237][123090] Updated weights for policy 1, policy_version 401508 (0.0010) [2023-12-26 02:48:38,296][123090] Updated weights for policy 1, policy_version 401518 (0.0010) [2023-12-26 02:48:38,359][123090] Updated weights for policy 1, policy_version 401528 (0.0009) [2023-12-26 02:48:38,522][123091] Updated weights for policy 0, policy_version 403953 (0.0007) [2023-12-26 02:48:38,573][123091] Updated weights for policy 0, policy_version 403963 (0.0010) [2023-12-26 02:48:38,624][123091] Updated weights for policy 0, policy_version 403973 (0.0010) [2023-12-26 02:48:38,679][123091] Updated weights for policy 0, policy_version 403983 (0.0010) [2023-12-26 02:48:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 206217216. Throughput: 0: 8866.6, 1: 8942.8. Samples: 206188868. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:38,785][121949] Avg episode reward: [(0, '6413.022'), (1, '5495.656')] [2023-12-26 02:48:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000401536_102793216.pth... [2023-12-26 02:48:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000403984_103424000.pth... [2023-12-26 02:48:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000400512_102531072.pth [2023-12-26 02:48:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000402928_103153664.pth [2023-12-26 02:48:39,208][123090] Updated weights for policy 1, policy_version 401538 (0.0009) [2023-12-26 02:48:39,276][123090] Updated weights for policy 1, policy_version 401548 (0.0011) [2023-12-26 02:48:39,347][123090] Updated weights for policy 1, policy_version 401558 (0.0011) [2023-12-26 02:48:39,422][123090] Updated weights for policy 1, policy_version 401568 (0.0010) [2023-12-26 02:48:39,533][123091] Updated weights for policy 0, policy_version 403993 (0.0006) [2023-12-26 02:48:39,590][123091] Updated weights for policy 0, policy_version 404003 (0.0009) [2023-12-26 02:48:39,645][123091] Updated weights for policy 0, policy_version 404013 (0.0010) [2023-12-26 02:48:40,278][123090] Updated weights for policy 1, policy_version 401578 (0.0009) [2023-12-26 02:48:40,350][123090] Updated weights for policy 1, policy_version 401588 (0.0010) [2023-12-26 02:48:40,422][123090] Updated weights for policy 1, policy_version 401598 (0.0009) [2023-12-26 02:48:40,467][123091] Updated weights for policy 0, policy_version 404023 (0.0009) [2023-12-26 02:48:40,529][123091] Updated weights for policy 0, policy_version 404033 (0.0009) [2023-12-26 02:48:40,582][123091] Updated weights for policy 0, policy_version 404043 (0.0009) [2023-12-26 02:48:41,186][123090] Updated weights for policy 1, policy_version 401608 (0.0008) [2023-12-26 02:48:41,258][123090] Updated weights for policy 1, policy_version 401618 (0.0006) [2023-12-26 02:48:41,334][123090] Updated weights for policy 1, policy_version 401628 (0.0007) [2023-12-26 02:48:41,471][123091] Updated weights for policy 0, policy_version 404053 (0.0009) [2023-12-26 02:48:41,539][123091] Updated weights for policy 0, policy_version 404063 (0.0009) [2023-12-26 02:48:41,611][123091] Updated weights for policy 0, policy_version 404073 (0.0009) [2023-12-26 02:48:42,120][123090] Updated weights for policy 1, policy_version 401638 (0.0007) [2023-12-26 02:48:42,194][123090] Updated weights for policy 1, policy_version 401648 (0.0008) [2023-12-26 02:48:42,263][123090] Updated weights for policy 1, policy_version 401658 (0.0008) [2023-12-26 02:48:42,468][123091] Updated weights for policy 0, policy_version 404083 (0.0008) [2023-12-26 02:48:42,542][123091] Updated weights for policy 0, policy_version 404093 (0.0010) [2023-12-26 02:48:42,611][123091] Updated weights for policy 0, policy_version 404103 (0.0010) [2023-12-26 02:48:43,019][123090] Updated weights for policy 1, policy_version 401668 (0.0009) [2023-12-26 02:48:43,069][123090] Updated weights for policy 1, policy_version 401678 (0.0008) [2023-12-26 02:48:43,119][123090] Updated weights for policy 1, policy_version 401688 (0.0009) [2023-12-26 02:48:43,476][123091] Updated weights for policy 0, policy_version 404113 (0.0010) [2023-12-26 02:48:43,537][123091] Updated weights for policy 0, policy_version 404123 (0.0009) [2023-12-26 02:48:43,589][123091] Updated weights for policy 0, policy_version 404133 (0.0009) [2023-12-26 02:48:43,644][123091] Updated weights for policy 0, policy_version 404143 (0.0009) [2023-12-26 02:48:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 206299136. Throughput: 0: 8822.0, 1: 8769.2. Samples: 206291880. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:43,785][121949] Avg episode reward: [(0, '6412.153'), (1, '5305.662')] [2023-12-26 02:48:43,826][123090] Updated weights for policy 1, policy_version 401698 (0.0005) [2023-12-26 02:48:43,884][123090] Updated weights for policy 1, policy_version 401708 (0.0005) [2023-12-26 02:48:43,944][123090] Updated weights for policy 1, policy_version 401718 (0.0005) [2023-12-26 02:48:43,996][123090] Updated weights for policy 1, policy_version 401728 (0.0006) [2023-12-26 02:48:44,541][123091] Updated weights for policy 0, policy_version 404153 (0.0010) [2023-12-26 02:48:44,588][123091] Updated weights for policy 0, policy_version 404163 (0.0009) [2023-12-26 02:48:44,646][123091] Updated weights for policy 0, policy_version 404173 (0.0009) [2023-12-26 02:48:44,703][123090] Updated weights for policy 1, policy_version 401738 (0.0009) [2023-12-26 02:48:44,752][123090] Updated weights for policy 1, policy_version 401748 (0.0009) [2023-12-26 02:48:44,820][123090] Updated weights for policy 1, policy_version 401758 (0.0010) [2023-12-26 02:48:45,520][123091] Updated weights for policy 0, policy_version 404183 (0.0009) [2023-12-26 02:48:45,588][123091] Updated weights for policy 0, policy_version 404193 (0.0010) [2023-12-26 02:48:45,650][123091] Updated weights for policy 0, policy_version 404203 (0.0008) [2023-12-26 02:48:45,671][123090] Updated weights for policy 1, policy_version 401768 (0.0009) [2023-12-26 02:48:45,728][123090] Updated weights for policy 1, policy_version 401778 (0.0009) [2023-12-26 02:48:45,784][123090] Updated weights for policy 1, policy_version 401788 (0.0009) [2023-12-26 02:48:46,496][123091] Updated weights for policy 0, policy_version 404213 (0.0009) [2023-12-26 02:48:46,551][123091] Updated weights for policy 0, policy_version 404223 (0.0009) [2023-12-26 02:48:46,558][123090] Updated weights for policy 1, policy_version 401798 (0.0010) [2023-12-26 02:48:46,609][123091] Updated weights for policy 0, policy_version 404233 (0.0009) [2023-12-26 02:48:46,619][123090] Updated weights for policy 1, policy_version 401808 (0.0010) [2023-12-26 02:48:46,679][123090] Updated weights for policy 1, policy_version 401818 (0.0009) [2023-12-26 02:48:47,460][123091] Updated weights for policy 0, policy_version 404243 (0.0009) [2023-12-26 02:48:47,469][123090] Updated weights for policy 1, policy_version 401828 (0.0008) [2023-12-26 02:48:47,520][123091] Updated weights for policy 0, policy_version 404253 (0.0008) [2023-12-26 02:48:47,523][123090] Updated weights for policy 1, policy_version 401838 (0.0008) [2023-12-26 02:48:47,577][123090] Updated weights for policy 1, policy_version 401848 (0.0008) [2023-12-26 02:48:47,579][123091] Updated weights for policy 0, policy_version 404263 (0.0008) [2023-12-26 02:48:48,329][123091] Updated weights for policy 0, policy_version 404273 (0.0010) [2023-12-26 02:48:48,389][123091] Updated weights for policy 0, policy_version 404284 (0.0010) [2023-12-26 02:48:48,419][123090] Updated weights for policy 1, policy_version 401858 (0.0006) [2023-12-26 02:48:48,444][123091] Updated weights for policy 0, policy_version 404294 (0.0009) [2023-12-26 02:48:48,474][123090] Updated weights for policy 1, policy_version 401868 (0.0009) [2023-12-26 02:48:48,502][123091] Updated weights for policy 0, policy_version 404304 (0.0009) [2023-12-26 02:48:48,541][123090] Updated weights for policy 1, policy_version 401878 (0.0009) [2023-12-26 02:48:48,602][123090] Updated weights for policy 1, policy_version 401888 (0.0009) [2023-12-26 02:48:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 206389248. Throughput: 0: 8761.7, 1: 8772.9. Samples: 206396384. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:48,785][121949] Avg episode reward: [(0, '6456.806'), (1, '5311.170')] [2023-12-26 02:48:49,401][123090] Updated weights for policy 1, policy_version 401898 (0.0010) [2023-12-26 02:48:49,412][123091] Updated weights for policy 0, policy_version 404314 (0.0008) [2023-12-26 02:48:49,462][123091] Updated weights for policy 0, policy_version 404324 (0.0008) [2023-12-26 02:48:49,464][123090] Updated weights for policy 1, policy_version 401908 (0.0008) [2023-12-26 02:48:49,523][123091] Updated weights for policy 0, policy_version 404334 (0.0009) [2023-12-26 02:48:49,526][123090] Updated weights for policy 1, policy_version 401918 (0.0007) [2023-12-26 02:48:50,343][123091] Updated weights for policy 0, policy_version 404344 (0.0009) [2023-12-26 02:48:50,386][123090] Updated weights for policy 1, policy_version 401928 (0.0009) [2023-12-26 02:48:50,398][123091] Updated weights for policy 0, policy_version 404354 (0.0007) [2023-12-26 02:48:50,452][123090] Updated weights for policy 1, policy_version 401938 (0.0008) [2023-12-26 02:48:50,459][123091] Updated weights for policy 0, policy_version 404364 (0.0008) [2023-12-26 02:48:50,512][123090] Updated weights for policy 1, policy_version 401948 (0.0008) [2023-12-26 02:48:51,256][123091] Updated weights for policy 0, policy_version 404374 (0.0007) [2023-12-26 02:48:51,323][123091] Updated weights for policy 0, policy_version 404384 (0.0006) [2023-12-26 02:48:51,374][123090] Updated weights for policy 1, policy_version 401958 (0.0010) [2023-12-26 02:48:51,396][123091] Updated weights for policy 0, policy_version 404394 (0.0008) [2023-12-26 02:48:51,440][123090] Updated weights for policy 1, policy_version 401968 (0.0008) [2023-12-26 02:48:51,509][123090] Updated weights for policy 1, policy_version 401978 (0.0009) [2023-12-26 02:48:52,094][123091] Updated weights for policy 0, policy_version 404404 (0.0008) [2023-12-26 02:48:52,155][123091] Updated weights for policy 0, policy_version 404414 (0.0005) [2023-12-26 02:48:52,211][123091] Updated weights for policy 0, policy_version 404424 (0.0005) [2023-12-26 02:48:52,396][123090] Updated weights for policy 1, policy_version 401988 (0.0010) [2023-12-26 02:48:52,455][123090] Updated weights for policy 1, policy_version 401998 (0.0010) [2023-12-26 02:48:52,523][123090] Updated weights for policy 1, policy_version 402008 (0.0010) [2023-12-26 02:48:52,980][123091] Updated weights for policy 0, policy_version 404434 (0.0007) [2023-12-26 02:48:53,042][123091] Updated weights for policy 0, policy_version 404444 (0.0009) [2023-12-26 02:48:53,102][123091] Updated weights for policy 0, policy_version 404454 (0.0009) [2023-12-26 02:48:53,369][123090] Updated weights for policy 1, policy_version 402018 (0.0010) [2023-12-26 02:48:53,426][123090] Updated weights for policy 1, policy_version 402028 (0.0009) [2023-12-26 02:48:53,499][123090] Updated weights for policy 1, policy_version 402038 (0.0010) [2023-12-26 02:48:53,561][123090] Updated weights for policy 1, policy_version 402048 (0.0009) [2023-12-26 02:48:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 206471168. Throughput: 0: 8744.6, 1: 8712.8. Samples: 206447132. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:53,785][121949] Avg episode reward: [(0, '6455.648'), (1, '5400.653')] [2023-12-26 02:48:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000404464_103546880.pth... [2023-12-26 02:48:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000402048_102924288.pth... [2023-12-26 02:48:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000401024_102662144.pth [2023-12-26 02:48:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000403440_103284736.pth [2023-12-26 02:48:53,858][123091] Updated weights for policy 0, policy_version 404465 (0.0010) [2023-12-26 02:48:53,927][123091] Updated weights for policy 0, policy_version 404475 (0.0007) [2023-12-26 02:48:53,992][123091] Updated weights for policy 0, policy_version 404485 (0.0009) [2023-12-26 02:48:54,048][123091] Updated weights for policy 0, policy_version 404495 (0.0009) [2023-12-26 02:48:54,503][123090] Updated weights for policy 1, policy_version 402058 (0.0010) [2023-12-26 02:48:54,578][123090] Updated weights for policy 1, policy_version 402068 (0.0010) [2023-12-26 02:48:54,646][123090] Updated weights for policy 1, policy_version 402079 (0.0010) [2023-12-26 02:48:54,699][123091] Updated weights for policy 0, policy_version 404505 (0.0007) [2023-12-26 02:48:54,763][123091] Updated weights for policy 0, policy_version 404515 (0.0005) [2023-12-26 02:48:54,822][123091] Updated weights for policy 0, policy_version 404525 (0.0005) [2023-12-26 02:48:55,509][123091] Updated weights for policy 0, policy_version 404535 (0.0006) [2023-12-26 02:48:55,510][123090] Updated weights for policy 1, policy_version 402089 (0.0010) [2023-12-26 02:48:55,554][123091] Updated weights for policy 0, policy_version 404545 (0.0009) [2023-12-26 02:48:55,574][123090] Updated weights for policy 1, policy_version 402099 (0.0008) [2023-12-26 02:48:55,599][123091] Updated weights for policy 0, policy_version 404555 (0.0008) [2023-12-26 02:48:55,626][123090] Updated weights for policy 1, policy_version 402109 (0.0008) [2023-12-26 02:48:56,349][123091] Updated weights for policy 0, policy_version 404565 (0.0007) [2023-12-26 02:48:56,403][123091] Updated weights for policy 0, policy_version 404575 (0.0010) [2023-12-26 02:48:56,450][123091] Updated weights for policy 0, policy_version 404585 (0.0010) [2023-12-26 02:48:56,525][123090] Updated weights for policy 1, policy_version 402119 (0.0009) [2023-12-26 02:48:56,579][123090] Updated weights for policy 1, policy_version 402131 (0.0010) [2023-12-26 02:48:56,637][123090] Updated weights for policy 1, policy_version 402141 (0.0009) [2023-12-26 02:48:57,142][123091] Updated weights for policy 0, policy_version 404595 (0.0009) [2023-12-26 02:48:57,201][123091] Updated weights for policy 0, policy_version 404605 (0.0005) [2023-12-26 02:48:57,261][123091] Updated weights for policy 0, policy_version 404615 (0.0005) [2023-12-26 02:48:57,591][123090] Updated weights for policy 1, policy_version 402151 (0.0010) [2023-12-26 02:48:57,646][123090] Updated weights for policy 1, policy_version 402162 (0.0010) [2023-12-26 02:48:57,705][123090] Updated weights for policy 1, policy_version 402172 (0.0009) [2023-12-26 02:48:57,898][123091] Updated weights for policy 0, policy_version 404625 (0.0005) [2023-12-26 02:48:57,958][123091] Updated weights for policy 0, policy_version 404635 (0.0005) [2023-12-26 02:48:58,030][123091] Updated weights for policy 0, policy_version 404645 (0.0010) [2023-12-26 02:48:58,102][123091] Updated weights for policy 0, policy_version 404655 (0.0007) [2023-12-26 02:48:58,599][123090] Updated weights for policy 1, policy_version 402182 (0.0009) [2023-12-26 02:48:58,675][123090] Updated weights for policy 1, policy_version 402192 (0.0008) [2023-12-26 02:48:58,741][123090] Updated weights for policy 1, policy_version 402202 (0.0009) [2023-12-26 02:48:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 206553088. Throughput: 0: 8918.4, 1: 8646.4. Samples: 206554728. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:48:58,784][121949] Avg episode reward: [(0, '6432.420'), (1, '5636.119')] [2023-12-26 02:48:58,953][123091] Updated weights for policy 0, policy_version 404665 (0.0009) [2023-12-26 02:48:59,018][123091] Updated weights for policy 0, policy_version 404675 (0.0009) [2023-12-26 02:48:59,088][123091] Updated weights for policy 0, policy_version 404685 (0.0009) [2023-12-26 02:48:59,654][123090] Updated weights for policy 1, policy_version 402212 (0.0008) [2023-12-26 02:48:59,725][123090] Updated weights for policy 1, policy_version 402222 (0.0006) [2023-12-26 02:48:59,778][123090] Updated weights for policy 1, policy_version 402232 (0.0006) [2023-12-26 02:48:59,919][123091] Updated weights for policy 0, policy_version 404695 (0.0007) [2023-12-26 02:48:59,990][123091] Updated weights for policy 0, policy_version 404705 (0.0008) [2023-12-26 02:49:00,055][123091] Updated weights for policy 0, policy_version 404715 (0.0009) [2023-12-26 02:49:00,552][123090] Updated weights for policy 1, policy_version 402242 (0.0007) [2023-12-26 02:49:00,611][123090] Updated weights for policy 1, policy_version 402252 (0.0010) [2023-12-26 02:49:00,669][123090] Updated weights for policy 1, policy_version 402263 (0.0007) [2023-12-26 02:49:00,811][123091] Updated weights for policy 0, policy_version 404725 (0.0007) [2023-12-26 02:49:00,882][123091] Updated weights for policy 0, policy_version 404735 (0.0005) [2023-12-26 02:49:00,950][123091] Updated weights for policy 0, policy_version 404745 (0.0005) [2023-12-26 02:49:01,473][123090] Updated weights for policy 1, policy_version 402273 (0.0006) [2023-12-26 02:49:01,539][123090] Updated weights for policy 1, policy_version 402283 (0.0009) [2023-12-26 02:49:01,602][123090] Updated weights for policy 1, policy_version 402293 (0.0010) [2023-12-26 02:49:01,664][123091] Updated weights for policy 0, policy_version 404755 (0.0007) [2023-12-26 02:49:01,671][123090] Updated weights for policy 1, policy_version 402303 (0.0009) [2023-12-26 02:49:01,728][123091] Updated weights for policy 0, policy_version 404765 (0.0010) [2023-12-26 02:49:01,790][123091] Updated weights for policy 0, policy_version 404775 (0.0009) [2023-12-26 02:49:02,523][123090] Updated weights for policy 1, policy_version 402313 (0.0009) [2023-12-26 02:49:02,530][123091] Updated weights for policy 0, policy_version 404785 (0.0009) [2023-12-26 02:49:02,592][123090] Updated weights for policy 1, policy_version 402323 (0.0008) [2023-12-26 02:49:02,595][123091] Updated weights for policy 0, policy_version 404795 (0.0009) [2023-12-26 02:49:02,639][123090] Updated weights for policy 1, policy_version 402333 (0.0007) [2023-12-26 02:49:02,651][123091] Updated weights for policy 0, policy_version 404805 (0.0008) [2023-12-26 02:49:02,720][123091] Updated weights for policy 0, policy_version 404815 (0.0010) [2023-12-26 02:49:03,243][123090] Updated weights for policy 1, policy_version 402343 (0.0005) [2023-12-26 02:49:03,298][123090] Updated weights for policy 1, policy_version 402353 (0.0007) [2023-12-26 02:49:03,360][123090] Updated weights for policy 1, policy_version 402363 (0.0010) [2023-12-26 02:49:03,460][123091] Updated weights for policy 0, policy_version 404825 (0.0006) [2023-12-26 02:49:03,515][123091] Updated weights for policy 0, policy_version 404835 (0.0005) [2023-12-26 02:49:03,566][123091] Updated weights for policy 0, policy_version 404845 (0.0007) [2023-12-26 02:49:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 206651392. Throughput: 0: 8957.9, 1: 8520.6. Samples: 206660460. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:49:03,785][121949] Avg episode reward: [(0, '6370.464'), (1, '5755.659')] [2023-12-26 02:49:04,070][123090] Updated weights for policy 1, policy_version 402373 (0.0010) [2023-12-26 02:49:04,139][123090] Updated weights for policy 1, policy_version 402383 (0.0008) [2023-12-26 02:49:04,209][123090] Updated weights for policy 1, policy_version 402393 (0.0008) [2023-12-26 02:49:04,247][123091] Updated weights for policy 0, policy_version 404855 (0.0009) [2023-12-26 02:49:04,300][123091] Updated weights for policy 0, policy_version 404865 (0.0008) [2023-12-26 02:49:04,356][123091] Updated weights for policy 0, policy_version 404875 (0.0007) [2023-12-26 02:49:05,037][123091] Updated weights for policy 0, policy_version 404885 (0.0006) [2023-12-26 02:49:05,103][123091] Updated weights for policy 0, policy_version 404895 (0.0005) [2023-12-26 02:49:05,103][123090] Updated weights for policy 1, policy_version 402403 (0.0008) [2023-12-26 02:49:05,153][123091] Updated weights for policy 0, policy_version 404905 (0.0006) [2023-12-26 02:49:05,155][123090] Updated weights for policy 1, policy_version 402413 (0.0008) [2023-12-26 02:49:05,212][123090] Updated weights for policy 1, policy_version 402423 (0.0008) [2023-12-26 02:49:05,863][123091] Updated weights for policy 0, policy_version 404915 (0.0009) [2023-12-26 02:49:05,928][123091] Updated weights for policy 0, policy_version 404925 (0.0009) [2023-12-26 02:49:05,989][123091] Updated weights for policy 0, policy_version 404935 (0.0009) [2023-12-26 02:49:06,079][123090] Updated weights for policy 1, policy_version 402433 (0.0010) [2023-12-26 02:49:06,147][123090] Updated weights for policy 1, policy_version 402443 (0.0009) [2023-12-26 02:49:06,210][123090] Updated weights for policy 1, policy_version 402453 (0.0008) [2023-12-26 02:49:06,285][123090] Updated weights for policy 1, policy_version 402463 (0.0011) [2023-12-26 02:49:06,843][123091] Updated weights for policy 0, policy_version 404945 (0.0009) [2023-12-26 02:49:06,902][123091] Updated weights for policy 0, policy_version 404955 (0.0009) [2023-12-26 02:49:06,966][123091] Updated weights for policy 0, policy_version 404965 (0.0009) [2023-12-26 02:49:07,023][123090] Updated weights for policy 1, policy_version 402473 (0.0006) [2023-12-26 02:49:07,025][123091] Updated weights for policy 0, policy_version 404975 (0.0009) [2023-12-26 02:49:07,086][123090] Updated weights for policy 1, policy_version 402483 (0.0009) [2023-12-26 02:49:07,142][123090] Updated weights for policy 1, policy_version 402493 (0.0009) [2023-12-26 02:49:07,858][123091] Updated weights for policy 0, policy_version 404985 (0.0011) [2023-12-26 02:49:07,925][123091] Updated weights for policy 0, policy_version 404995 (0.0011) [2023-12-26 02:49:07,961][123090] Updated weights for policy 1, policy_version 402503 (0.0006) [2023-12-26 02:49:07,984][123091] Updated weights for policy 0, policy_version 405005 (0.0011) [2023-12-26 02:49:08,007][123090] Updated weights for policy 1, policy_version 402513 (0.0009) [2023-12-26 02:49:08,055][123090] Updated weights for policy 1, policy_version 402523 (0.0009) [2023-12-26 02:49:08,772][123091] Updated weights for policy 0, policy_version 405015 (0.0009) [2023-12-26 02:49:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 206733312. Throughput: 0: 9045.4, 1: 8559.6. Samples: 206715272. Policy #0 lag: (min: 24.0, avg: 41.4, max: 56.0) [2023-12-26 02:49:08,785][121949] Avg episode reward: [(0, '6406.435'), (1, '5793.106')] [2023-12-26 02:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000402528_103047168.pth... [2023-12-26 02:49:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000401536_102793216.pth [2023-12-26 02:49:08,836][123091] Updated weights for policy 0, policy_version 405025 (0.0010) [2023-12-26 02:49:08,889][123091] Updated weights for policy 0, policy_version 405035 (0.0009) [2023-12-26 02:49:08,916][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000405040_103694336.pth... [2023-12-26 02:49:08,919][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000403984_103424000.pth [2023-12-26 02:49:08,939][123090] Updated weights for policy 1, policy_version 402533 (0.0009) [2023-12-26 02:49:08,990][123090] Updated weights for policy 1, policy_version 402543 (0.0009) [2023-12-26 02:49:09,058][123090] Updated weights for policy 1, policy_version 402553 (0.0010) [2023-12-26 02:49:09,713][123091] Updated weights for policy 0, policy_version 405045 (0.0010) [2023-12-26 02:49:09,777][123091] Updated weights for policy 0, policy_version 405055 (0.0011) [2023-12-26 02:49:09,857][123091] Updated weights for policy 0, policy_version 405065 (0.0011) [2023-12-26 02:49:09,927][123090] Updated weights for policy 1, policy_version 402563 (0.0010) [2023-12-26 02:49:09,988][123090] Updated weights for policy 1, policy_version 402573 (0.0009) [2023-12-26 02:49:10,050][123090] Updated weights for policy 1, policy_version 402583 (0.0009) [2023-12-26 02:49:10,645][123091] Updated weights for policy 0, policy_version 405075 (0.0009) [2023-12-26 02:49:10,699][123091] Updated weights for policy 0, policy_version 405085 (0.0005) [2023-12-26 02:49:10,773][123091] Updated weights for policy 0, policy_version 405095 (0.0005) [2023-12-26 02:49:10,960][123090] Updated weights for policy 1, policy_version 402593 (0.0009) [2023-12-26 02:49:11,017][123090] Updated weights for policy 1, policy_version 402603 (0.0009) [2023-12-26 02:49:11,106][123090] Updated weights for policy 1, policy_version 402613 (0.0009) [2023-12-26 02:49:11,181][123090] Updated weights for policy 1, policy_version 402623 (0.0009) [2023-12-26 02:49:11,555][123091] Updated weights for policy 0, policy_version 405105 (0.0006) [2023-12-26 02:49:11,622][123091] Updated weights for policy 0, policy_version 405115 (0.0010) [2023-12-26 02:49:11,683][123091] Updated weights for policy 0, policy_version 405125 (0.0009) [2023-12-26 02:49:11,751][123091] Updated weights for policy 0, policy_version 405135 (0.0010) [2023-12-26 02:49:11,965][123090] Updated weights for policy 1, policy_version 402633 (0.0006) [2023-12-26 02:49:12,017][123090] Updated weights for policy 1, policy_version 402643 (0.0005) [2023-12-26 02:49:12,076][123090] Updated weights for policy 1, policy_version 402653 (0.0008) [2023-12-26 02:49:12,650][123091] Updated weights for policy 0, policy_version 405145 (0.0009) [2023-12-26 02:49:12,715][123091] Updated weights for policy 0, policy_version 405155 (0.0009) [2023-12-26 02:49:12,775][123091] Updated weights for policy 0, policy_version 405165 (0.0009) [2023-12-26 02:49:12,894][123090] Updated weights for policy 1, policy_version 402663 (0.0007) [2023-12-26 02:49:12,962][123090] Updated weights for policy 1, policy_version 402673 (0.0010) [2023-12-26 02:49:13,026][123090] Updated weights for policy 1, policy_version 402683 (0.0011) [2023-12-26 02:49:13,632][123091] Updated weights for policy 0, policy_version 405175 (0.0009) [2023-12-26 02:49:13,687][123091] Updated weights for policy 0, policy_version 405186 (0.0010) [2023-12-26 02:49:13,741][123091] Updated weights for policy 0, policy_version 405196 (0.0010) [2023-12-26 02:49:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 206823424. Throughput: 0: 8966.1, 1: 8534.5. Samples: 206816844. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:13,785][121949] Avg episode reward: [(0, '6411.016'), (1, '5788.467')] [2023-12-26 02:49:13,794][123090] Updated weights for policy 1, policy_version 402693 (0.0008) [2023-12-26 02:49:13,869][123090] Updated weights for policy 1, policy_version 402703 (0.0005) [2023-12-26 02:49:13,947][123090] Updated weights for policy 1, policy_version 402713 (0.0009) [2023-12-26 02:49:14,627][123091] Updated weights for policy 0, policy_version 405206 (0.0009) [2023-12-26 02:49:14,676][123091] Updated weights for policy 0, policy_version 405216 (0.0009) [2023-12-26 02:49:14,696][123090] Updated weights for policy 1, policy_version 402723 (0.0011) [2023-12-26 02:49:14,732][123091] Updated weights for policy 0, policy_version 405226 (0.0006) [2023-12-26 02:49:14,763][123090] Updated weights for policy 1, policy_version 402733 (0.0009) [2023-12-26 02:49:14,835][123090] Updated weights for policy 1, policy_version 402743 (0.0011) [2023-12-26 02:49:15,619][123091] Updated weights for policy 0, policy_version 405236 (0.0009) [2023-12-26 02:49:15,642][123090] Updated weights for policy 1, policy_version 402753 (0.0011) [2023-12-26 02:49:15,677][123091] Updated weights for policy 0, policy_version 405246 (0.0009) [2023-12-26 02:49:15,700][123090] Updated weights for policy 1, policy_version 402763 (0.0010) [2023-12-26 02:49:15,739][123091] Updated weights for policy 0, policy_version 405256 (0.0005) [2023-12-26 02:49:15,766][123090] Updated weights for policy 1, policy_version 402773 (0.0010) [2023-12-26 02:49:15,825][123090] Updated weights for policy 1, policy_version 402783 (0.0010) [2023-12-26 02:49:16,435][123091] Updated weights for policy 0, policy_version 405266 (0.0006) [2023-12-26 02:49:16,498][123091] Updated weights for policy 0, policy_version 405276 (0.0005) [2023-12-26 02:49:16,540][123090] Updated weights for policy 1, policy_version 402793 (0.0006) [2023-12-26 02:49:16,546][123091] Updated weights for policy 0, policy_version 405286 (0.0005) [2023-12-26 02:49:16,593][123090] Updated weights for policy 1, policy_version 402803 (0.0005) [2023-12-26 02:49:16,601][123091] Updated weights for policy 0, policy_version 405296 (0.0005) [2023-12-26 02:49:16,668][123090] Updated weights for policy 1, policy_version 402813 (0.0006) [2023-12-26 02:49:17,253][123091] Updated weights for policy 0, policy_version 405306 (0.0008) [2023-12-26 02:49:17,322][123091] Updated weights for policy 0, policy_version 405316 (0.0006) [2023-12-26 02:49:17,392][123091] Updated weights for policy 0, policy_version 405326 (0.0008) [2023-12-26 02:49:17,422][123090] Updated weights for policy 1, policy_version 402823 (0.0009) [2023-12-26 02:49:17,474][123090] Updated weights for policy 1, policy_version 402833 (0.0010) [2023-12-26 02:49:17,519][123090] Updated weights for policy 1, policy_version 402843 (0.0010) [2023-12-26 02:49:18,079][123091] Updated weights for policy 0, policy_version 405336 (0.0006) [2023-12-26 02:49:18,133][123091] Updated weights for policy 0, policy_version 405346 (0.0005) [2023-12-26 02:49:18,193][123091] Updated weights for policy 0, policy_version 405356 (0.0005) [2023-12-26 02:49:18,297][123090] Updated weights for policy 1, policy_version 402853 (0.0009) [2023-12-26 02:49:18,368][123090] Updated weights for policy 1, policy_version 402863 (0.0009) [2023-12-26 02:49:18,421][123090] Updated weights for policy 1, policy_version 402873 (0.0010) [2023-12-26 02:49:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 206913536. Throughput: 0: 8983.2, 1: 8593.3. Samples: 206925256. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:18,785][121949] Avg episode reward: [(0, '6376.395'), (1, '5685.508')] [2023-12-26 02:49:19,000][123091] Updated weights for policy 0, policy_version 405366 (0.0009) [2023-12-26 02:49:19,064][123091] Updated weights for policy 0, policy_version 405376 (0.0010) [2023-12-26 02:49:19,112][123091] Updated weights for policy 0, policy_version 405386 (0.0009) [2023-12-26 02:49:19,248][123090] Updated weights for policy 1, policy_version 402883 (0.0011) [2023-12-26 02:49:19,307][123090] Updated weights for policy 1, policy_version 402893 (0.0010) [2023-12-26 02:49:19,371][123090] Updated weights for policy 1, policy_version 402903 (0.0011) [2023-12-26 02:49:19,982][123091] Updated weights for policy 0, policy_version 405396 (0.0009) [2023-12-26 02:49:20,043][123091] Updated weights for policy 0, policy_version 405406 (0.0009) [2023-12-26 02:49:20,096][123091] Updated weights for policy 0, policy_version 405416 (0.0009) [2023-12-26 02:49:20,206][123090] Updated weights for policy 1, policy_version 402913 (0.0010) [2023-12-26 02:49:20,266][123090] Updated weights for policy 1, policy_version 402923 (0.0010) [2023-12-26 02:49:20,330][123090] Updated weights for policy 1, policy_version 402933 (0.0011) [2023-12-26 02:49:20,386][123090] Updated weights for policy 1, policy_version 402943 (0.0011) [2023-12-26 02:49:20,984][123091] Updated weights for policy 0, policy_version 405426 (0.0009) [2023-12-26 02:49:21,050][123091] Updated weights for policy 0, policy_version 405436 (0.0010) [2023-12-26 02:49:21,117][123091] Updated weights for policy 0, policy_version 405446 (0.0009) [2023-12-26 02:49:21,187][123091] Updated weights for policy 0, policy_version 405456 (0.0009) [2023-12-26 02:49:21,204][123090] Updated weights for policy 1, policy_version 402953 (0.0008) [2023-12-26 02:49:21,263][123090] Updated weights for policy 1, policy_version 402963 (0.0009) [2023-12-26 02:49:21,331][123090] Updated weights for policy 1, policy_version 402973 (0.0007) [2023-12-26 02:49:21,998][123091] Updated weights for policy 0, policy_version 405466 (0.0006) [2023-12-26 02:49:22,058][123091] Updated weights for policy 0, policy_version 405476 (0.0006) [2023-12-26 02:49:22,116][123091] Updated weights for policy 0, policy_version 405486 (0.0008) [2023-12-26 02:49:22,173][123090] Updated weights for policy 1, policy_version 402983 (0.0009) [2023-12-26 02:49:22,238][123090] Updated weights for policy 1, policy_version 402993 (0.0009) [2023-12-26 02:49:22,307][123090] Updated weights for policy 1, policy_version 403003 (0.0008) [2023-12-26 02:49:22,914][123091] Updated weights for policy 0, policy_version 405496 (0.0011) [2023-12-26 02:49:22,977][123091] Updated weights for policy 0, policy_version 405506 (0.0011) [2023-12-26 02:49:23,041][123091] Updated weights for policy 0, policy_version 405516 (0.0008) [2023-12-26 02:49:23,153][123090] Updated weights for policy 1, policy_version 403013 (0.0009) [2023-12-26 02:49:23,212][123090] Updated weights for policy 1, policy_version 403023 (0.0010) [2023-12-26 02:49:23,266][123090] Updated weights for policy 1, policy_version 403033 (0.0010) [2023-12-26 02:49:23,709][123091] Updated weights for policy 0, policy_version 405526 (0.0007) [2023-12-26 02:49:23,753][123091] Updated weights for policy 0, policy_version 405536 (0.0010) [2023-12-26 02:49:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 206995456. Throughput: 0: 8918.8, 1: 8565.1. Samples: 206975648. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:23,785][121949] Avg episode reward: [(0, '6317.904'), (1, '5632.639')] [2023-12-26 02:49:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000403040_103178240.pth... [2023-12-26 02:49:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000402048_102924288.pth [2023-12-26 02:49:23,804][123091] Updated weights for policy 0, policy_version 405546 (0.0011) [2023-12-26 02:49:23,842][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000405552_103825408.pth... [2023-12-26 02:49:23,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000404464_103546880.pth [2023-12-26 02:49:24,033][123090] Updated weights for policy 1, policy_version 403043 (0.0009) [2023-12-26 02:49:24,082][123090] Updated weights for policy 1, policy_version 403053 (0.0005) [2023-12-26 02:49:24,139][123090] Updated weights for policy 1, policy_version 403063 (0.0005) [2023-12-26 02:49:24,617][123091] Updated weights for policy 0, policy_version 405556 (0.0010) [2023-12-26 02:49:24,671][123091] Updated weights for policy 0, policy_version 405566 (0.0009) [2023-12-26 02:49:24,733][123091] Updated weights for policy 0, policy_version 405576 (0.0007) [2023-12-26 02:49:24,928][123090] Updated weights for policy 1, policy_version 403073 (0.0006) [2023-12-26 02:49:24,978][123090] Updated weights for policy 1, policy_version 403083 (0.0008) [2023-12-26 02:49:25,032][123090] Updated weights for policy 1, policy_version 403093 (0.0005) [2023-12-26 02:49:25,084][123090] Updated weights for policy 1, policy_version 403103 (0.0005) [2023-12-26 02:49:25,549][123091] Updated weights for policy 0, policy_version 405586 (0.0006) [2023-12-26 02:49:25,600][123091] Updated weights for policy 0, policy_version 405596 (0.0010) [2023-12-26 02:49:25,656][123091] Updated weights for policy 0, policy_version 405606 (0.0007) [2023-12-26 02:49:25,711][123091] Updated weights for policy 0, policy_version 405616 (0.0008) [2023-12-26 02:49:25,860][123090] Updated weights for policy 1, policy_version 403113 (0.0009) [2023-12-26 02:49:25,912][123090] Updated weights for policy 1, policy_version 403123 (0.0009) [2023-12-26 02:49:25,962][123090] Updated weights for policy 1, policy_version 403133 (0.0009) [2023-12-26 02:49:26,520][123091] Updated weights for policy 0, policy_version 405626 (0.0005) [2023-12-26 02:49:26,590][123091] Updated weights for policy 0, policy_version 405636 (0.0005) [2023-12-26 02:49:26,648][123091] Updated weights for policy 0, policy_version 405646 (0.0005) [2023-12-26 02:49:26,827][123090] Updated weights for policy 1, policy_version 403143 (0.0010) [2023-12-26 02:49:26,880][123090] Updated weights for policy 1, policy_version 403153 (0.0010) [2023-12-26 02:49:26,934][123090] Updated weights for policy 1, policy_version 403165 (0.0010) [2023-12-26 02:49:27,154][123091] Updated weights for policy 0, policy_version 405656 (0.0006) [2023-12-26 02:49:27,215][123091] Updated weights for policy 0, policy_version 405666 (0.0005) [2023-12-26 02:49:27,274][123091] Updated weights for policy 0, policy_version 405676 (0.0005) [2023-12-26 02:49:27,712][123090] Updated weights for policy 1, policy_version 403176 (0.0006) [2023-12-26 02:49:27,756][123090] Updated weights for policy 1, policy_version 403186 (0.0005) [2023-12-26 02:49:27,804][123090] Updated weights for policy 1, policy_version 403196 (0.0005) [2023-12-26 02:49:27,983][123091] Updated weights for policy 0, policy_version 405686 (0.0005) [2023-12-26 02:49:28,058][123091] Updated weights for policy 0, policy_version 405696 (0.0005) [2023-12-26 02:49:28,124][123091] Updated weights for policy 0, policy_version 405706 (0.0006) [2023-12-26 02:49:28,510][123090] Updated weights for policy 1, policy_version 403206 (0.0008) [2023-12-26 02:49:28,570][123090] Updated weights for policy 1, policy_version 403216 (0.0008) [2023-12-26 02:49:28,635][123090] Updated weights for policy 1, policy_version 403226 (0.0009) [2023-12-26 02:49:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 207093760. Throughput: 0: 8999.8, 1: 8620.1. Samples: 207084776. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:28,785][121949] Avg episode reward: [(0, '6290.101'), (1, '5561.331')] [2023-12-26 02:49:28,887][123091] Updated weights for policy 0, policy_version 405716 (0.0006) [2023-12-26 02:49:28,958][123091] Updated weights for policy 0, policy_version 405726 (0.0010) [2023-12-26 02:49:29,021][123091] Updated weights for policy 0, policy_version 405736 (0.0011) [2023-12-26 02:49:29,358][123090] Updated weights for policy 1, policy_version 403236 (0.0009) [2023-12-26 02:49:29,423][123090] Updated weights for policy 1, policy_version 403246 (0.0008) [2023-12-26 02:49:29,478][123090] Updated weights for policy 1, policy_version 403256 (0.0009) [2023-12-26 02:49:29,775][123091] Updated weights for policy 0, policy_version 405746 (0.0010) [2023-12-26 02:49:29,839][123091] Updated weights for policy 0, policy_version 405756 (0.0010) [2023-12-26 02:49:29,893][123091] Updated weights for policy 0, policy_version 405766 (0.0010) [2023-12-26 02:49:29,952][123091] Updated weights for policy 0, policy_version 405776 (0.0009) [2023-12-26 02:49:30,368][123090] Updated weights for policy 1, policy_version 403266 (0.0009) [2023-12-26 02:49:30,421][123090] Updated weights for policy 1, policy_version 403276 (0.0008) [2023-12-26 02:49:30,467][123090] Updated weights for policy 1, policy_version 403286 (0.0005) [2023-12-26 02:49:30,515][123090] Updated weights for policy 1, policy_version 403296 (0.0005) [2023-12-26 02:49:30,662][123091] Updated weights for policy 0, policy_version 405786 (0.0006) [2023-12-26 02:49:30,706][123091] Updated weights for policy 0, policy_version 405796 (0.0005) [2023-12-26 02:49:30,768][123091] Updated weights for policy 0, policy_version 405806 (0.0007) [2023-12-26 02:49:31,302][123090] Updated weights for policy 1, policy_version 403306 (0.0007) [2023-12-26 02:49:31,377][123090] Updated weights for policy 1, policy_version 403316 (0.0007) [2023-12-26 02:49:31,433][123090] Updated weights for policy 1, policy_version 403326 (0.0006) [2023-12-26 02:49:31,573][123091] Updated weights for policy 0, policy_version 405816 (0.0009) [2023-12-26 02:49:31,642][123091] Updated weights for policy 0, policy_version 405826 (0.0009) [2023-12-26 02:49:31,707][123091] Updated weights for policy 0, policy_version 405836 (0.0010) [2023-12-26 02:49:32,200][123090] Updated weights for policy 1, policy_version 403336 (0.0008) [2023-12-26 02:49:32,248][123090] Updated weights for policy 1, policy_version 403346 (0.0008) [2023-12-26 02:49:32,322][123090] Updated weights for policy 1, policy_version 403356 (0.0007) [2023-12-26 02:49:32,564][123091] Updated weights for policy 0, policy_version 405846 (0.0010) [2023-12-26 02:49:32,626][123091] Updated weights for policy 0, policy_version 405856 (0.0011) [2023-12-26 02:49:32,685][123091] Updated weights for policy 0, policy_version 405866 (0.0010) [2023-12-26 02:49:33,135][123090] Updated weights for policy 1, policy_version 403366 (0.0010) [2023-12-26 02:49:33,188][123090] Updated weights for policy 1, policy_version 403376 (0.0008) [2023-12-26 02:49:33,253][123090] Updated weights for policy 1, policy_version 403386 (0.0009) [2023-12-26 02:49:33,466][123091] Updated weights for policy 0, policy_version 405876 (0.0009) [2023-12-26 02:49:33,520][123091] Updated weights for policy 0, policy_version 405886 (0.0009) [2023-12-26 02:49:33,567][123091] Updated weights for policy 0, policy_version 405896 (0.0009) [2023-12-26 02:49:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 207183872. Throughput: 0: 9090.3, 1: 8627.2. Samples: 207193680. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:33,786][121949] Avg episode reward: [(0, '6282.472'), (1, '5847.800')] [2023-12-26 02:49:34,012][123090] Updated weights for policy 1, policy_version 403396 (0.0008) [2023-12-26 02:49:34,075][123090] Updated weights for policy 1, policy_version 403406 (0.0005) [2023-12-26 02:49:34,152][123090] Updated weights for policy 1, policy_version 403416 (0.0007) [2023-12-26 02:49:34,423][123091] Updated weights for policy 0, policy_version 405906 (0.0009) [2023-12-26 02:49:34,486][123091] Updated weights for policy 0, policy_version 405916 (0.0011) [2023-12-26 02:49:34,539][123091] Updated weights for policy 0, policy_version 405926 (0.0011) [2023-12-26 02:49:34,595][123091] Updated weights for policy 0, policy_version 405936 (0.0010) [2023-12-26 02:49:34,936][123090] Updated weights for policy 1, policy_version 403426 (0.0010) [2023-12-26 02:49:34,995][123090] Updated weights for policy 1, policy_version 403436 (0.0010) [2023-12-26 02:49:35,056][123090] Updated weights for policy 1, policy_version 403446 (0.0010) [2023-12-26 02:49:35,122][123090] Updated weights for policy 1, policy_version 403456 (0.0010) [2023-12-26 02:49:35,443][123091] Updated weights for policy 0, policy_version 405946 (0.0005) [2023-12-26 02:49:35,502][123091] Updated weights for policy 0, policy_version 405956 (0.0005) [2023-12-26 02:49:35,561][123091] Updated weights for policy 0, policy_version 405966 (0.0005) [2023-12-26 02:49:35,767][123090] Updated weights for policy 1, policy_version 403466 (0.0005) [2023-12-26 02:49:35,829][123090] Updated weights for policy 1, policy_version 403476 (0.0005) [2023-12-26 02:49:35,898][123090] Updated weights for policy 1, policy_version 403486 (0.0005) [2023-12-26 02:49:36,293][123091] Updated weights for policy 0, policy_version 405976 (0.0010) [2023-12-26 02:49:36,357][123091] Updated weights for policy 0, policy_version 405986 (0.0011) [2023-12-26 02:49:36,423][123091] Updated weights for policy 0, policy_version 405996 (0.0011) [2023-12-26 02:49:36,564][123090] Updated weights for policy 1, policy_version 403496 (0.0009) [2023-12-26 02:49:36,616][123090] Updated weights for policy 1, policy_version 403506 (0.0010) [2023-12-26 02:49:36,670][123090] Updated weights for policy 1, policy_version 403516 (0.0010) [2023-12-26 02:49:37,175][123091] Updated weights for policy 0, policy_version 406006 (0.0008) [2023-12-26 02:49:37,236][123091] Updated weights for policy 0, policy_version 406016 (0.0006) [2023-12-26 02:49:37,317][123091] Updated weights for policy 0, policy_version 406026 (0.0006) [2023-12-26 02:49:37,422][123090] Updated weights for policy 1, policy_version 403526 (0.0010) [2023-12-26 02:49:37,480][123090] Updated weights for policy 1, policy_version 403536 (0.0010) [2023-12-26 02:49:37,543][123090] Updated weights for policy 1, policy_version 403546 (0.0010) [2023-12-26 02:49:38,103][123091] Updated weights for policy 0, policy_version 406036 (0.0007) [2023-12-26 02:49:38,158][123091] Updated weights for policy 0, policy_version 406046 (0.0009) [2023-12-26 02:49:38,219][123091] Updated weights for policy 0, policy_version 406056 (0.0009) [2023-12-26 02:49:38,311][123090] Updated weights for policy 1, policy_version 403556 (0.0010) [2023-12-26 02:49:38,375][123090] Updated weights for policy 1, policy_version 403566 (0.0011) [2023-12-26 02:49:38,431][123090] Updated weights for policy 1, policy_version 403576 (0.0010) [2023-12-26 02:49:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 207273984. Throughput: 0: 9106.2, 1: 8723.0. Samples: 207249448. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:38,785][121949] Avg episode reward: [(0, '6286.392'), (1, '5859.154')] [2023-12-26 02:49:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000406064_103956480.pth... [2023-12-26 02:49:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000403584_103317504.pth... [2023-12-26 02:49:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000405040_103694336.pth [2023-12-26 02:49:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000402528_103047168.pth [2023-12-26 02:49:39,086][123091] Updated weights for policy 0, policy_version 406066 (0.0010) [2023-12-26 02:49:39,151][123091] Updated weights for policy 0, policy_version 406076 (0.0010) [2023-12-26 02:49:39,215][123091] Updated weights for policy 0, policy_version 406086 (0.0011) [2023-12-26 02:49:39,242][123090] Updated weights for policy 1, policy_version 403586 (0.0010) [2023-12-26 02:49:39,278][123091] Updated weights for policy 0, policy_version 406096 (0.0011) [2023-12-26 02:49:39,305][123090] Updated weights for policy 1, policy_version 403596 (0.0009) [2023-12-26 02:49:39,375][123090] Updated weights for policy 1, policy_version 403606 (0.0009) [2023-12-26 02:49:39,447][123090] Updated weights for policy 1, policy_version 403616 (0.0008) [2023-12-26 02:49:40,115][123091] Updated weights for policy 0, policy_version 406106 (0.0010) [2023-12-26 02:49:40,163][123091] Updated weights for policy 0, policy_version 406116 (0.0009) [2023-12-26 02:49:40,233][123091] Updated weights for policy 0, policy_version 406126 (0.0010) [2023-12-26 02:49:40,245][123090] Updated weights for policy 1, policy_version 403626 (0.0008) [2023-12-26 02:49:40,310][123090] Updated weights for policy 1, policy_version 403636 (0.0010) [2023-12-26 02:49:40,379][123090] Updated weights for policy 1, policy_version 403646 (0.0010) [2023-12-26 02:49:41,109][123091] Updated weights for policy 0, policy_version 406136 (0.0010) [2023-12-26 02:49:41,180][123091] Updated weights for policy 0, policy_version 406146 (0.0010) [2023-12-26 02:49:41,210][123090] Updated weights for policy 1, policy_version 403656 (0.0007) [2023-12-26 02:49:41,244][123091] Updated weights for policy 0, policy_version 406157 (0.0009) [2023-12-26 02:49:41,283][123090] Updated weights for policy 1, policy_version 403666 (0.0006) [2023-12-26 02:49:41,350][123090] Updated weights for policy 1, policy_version 403676 (0.0007) [2023-12-26 02:49:42,122][123090] Updated weights for policy 1, policy_version 403686 (0.0008) [2023-12-26 02:49:42,137][123091] Updated weights for policy 0, policy_version 406167 (0.0009) [2023-12-26 02:49:42,178][123090] Updated weights for policy 1, policy_version 403696 (0.0006) [2023-12-26 02:49:42,192][123091] Updated weights for policy 0, policy_version 406177 (0.0010) [2023-12-26 02:49:42,233][123090] Updated weights for policy 1, policy_version 403706 (0.0006) [2023-12-26 02:49:42,247][123091] Updated weights for policy 0, policy_version 406187 (0.0010) [2023-12-26 02:49:43,082][123090] Updated weights for policy 1, policy_version 403716 (0.0007) [2023-12-26 02:49:43,087][123091] Updated weights for policy 0, policy_version 406197 (0.0010) [2023-12-26 02:49:43,145][123091] Updated weights for policy 0, policy_version 406207 (0.0010) [2023-12-26 02:49:43,152][123090] Updated weights for policy 1, policy_version 403726 (0.0005) [2023-12-26 02:49:43,193][123091] Updated weights for policy 0, policy_version 406217 (0.0010) [2023-12-26 02:49:43,204][123090] Updated weights for policy 1, policy_version 403736 (0.0005) [2023-12-26 02:49:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 207355904. Throughput: 0: 8897.2, 1: 8837.7. Samples: 207352804. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:43,785][121949] Avg episode reward: [(0, '6158.975'), (1, '5903.433')] [2023-12-26 02:49:43,996][123091] Updated weights for policy 0, policy_version 406227 (0.0010) [2023-12-26 02:49:44,030][123090] Updated weights for policy 1, policy_version 403746 (0.0007) [2023-12-26 02:49:44,058][123091] Updated weights for policy 0, policy_version 406237 (0.0007) [2023-12-26 02:49:44,089][123090] Updated weights for policy 1, policy_version 403756 (0.0010) [2023-12-26 02:49:44,114][123091] Updated weights for policy 0, policy_version 406247 (0.0006) [2023-12-26 02:49:44,156][123090] Updated weights for policy 1, policy_version 403766 (0.0010) [2023-12-26 02:49:44,211][123090] Updated weights for policy 1, policy_version 403776 (0.0010) [2023-12-26 02:49:44,859][123091] Updated weights for policy 0, policy_version 406257 (0.0008) [2023-12-26 02:49:44,926][123091] Updated weights for policy 0, policy_version 406267 (0.0006) [2023-12-26 02:49:45,000][123091] Updated weights for policy 0, policy_version 406277 (0.0009) [2023-12-26 02:49:45,033][123090] Updated weights for policy 1, policy_version 403786 (0.0009) [2023-12-26 02:49:45,056][123091] Updated weights for policy 0, policy_version 406287 (0.0010) [2023-12-26 02:49:45,100][123090] Updated weights for policy 1, policy_version 403796 (0.0007) [2023-12-26 02:49:45,157][123090] Updated weights for policy 1, policy_version 403806 (0.0009) [2023-12-26 02:49:45,842][123091] Updated weights for policy 0, policy_version 406297 (0.0010) [2023-12-26 02:49:45,897][123091] Updated weights for policy 0, policy_version 406307 (0.0010) [2023-12-26 02:49:45,948][123091] Updated weights for policy 0, policy_version 406317 (0.0010) [2023-12-26 02:49:45,972][123090] Updated weights for policy 1, policy_version 403816 (0.0008) [2023-12-26 02:49:46,038][123090] Updated weights for policy 1, policy_version 403826 (0.0009) [2023-12-26 02:49:46,098][123090] Updated weights for policy 1, policy_version 403836 (0.0008) [2023-12-26 02:49:46,783][123091] Updated weights for policy 0, policy_version 406327 (0.0010) [2023-12-26 02:49:46,830][123091] Updated weights for policy 0, policy_version 406337 (0.0010) [2023-12-26 02:49:46,888][123091] Updated weights for policy 0, policy_version 406347 (0.0010) [2023-12-26 02:49:46,931][123090] Updated weights for policy 1, policy_version 403846 (0.0010) [2023-12-26 02:49:46,996][123090] Updated weights for policy 1, policy_version 403856 (0.0010) [2023-12-26 02:49:47,065][123090] Updated weights for policy 1, policy_version 403866 (0.0010) [2023-12-26 02:49:47,725][123091] Updated weights for policy 0, policy_version 406357 (0.0010) [2023-12-26 02:49:47,748][123090] Updated weights for policy 1, policy_version 403876 (0.0008) [2023-12-26 02:49:47,776][123091] Updated weights for policy 0, policy_version 406367 (0.0010) [2023-12-26 02:49:47,821][123090] Updated weights for policy 1, policy_version 403886 (0.0007) [2023-12-26 02:49:47,827][123091] Updated weights for policy 0, policy_version 406377 (0.0010) [2023-12-26 02:49:47,887][123090] Updated weights for policy 1, policy_version 403896 (0.0008) [2023-12-26 02:49:48,584][123091] Updated weights for policy 0, policy_version 406387 (0.0010) [2023-12-26 02:49:48,617][123090] Updated weights for policy 1, policy_version 403906 (0.0008) [2023-12-26 02:49:48,648][123091] Updated weights for policy 0, policy_version 406397 (0.0011) [2023-12-26 02:49:48,675][123090] Updated weights for policy 1, policy_version 403916 (0.0009) [2023-12-26 02:49:48,706][123091] Updated weights for policy 0, policy_version 406407 (0.0008) [2023-12-26 02:49:48,740][123090] Updated weights for policy 1, policy_version 403926 (0.0009) [2023-12-26 02:49:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 207446016. Throughput: 0: 8876.2, 1: 8874.1. Samples: 207459220. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:48,784][121949] Avg episode reward: [(0, '6168.497'), (1, '5967.139')] [2023-12-26 02:49:48,805][123090] Updated weights for policy 1, policy_version 403936 (0.0009) [2023-12-26 02:49:49,422][123091] Updated weights for policy 0, policy_version 406417 (0.0007) [2023-12-26 02:49:49,485][123091] Updated weights for policy 0, policy_version 406427 (0.0007) [2023-12-26 02:49:49,538][123091] Updated weights for policy 0, policy_version 406437 (0.0006) [2023-12-26 02:49:49,542][123090] Updated weights for policy 1, policy_version 403946 (0.0010) [2023-12-26 02:49:49,594][123091] Updated weights for policy 0, policy_version 406447 (0.0006) [2023-12-26 02:49:49,611][123090] Updated weights for policy 1, policy_version 403956 (0.0009) [2023-12-26 02:49:49,675][123090] Updated weights for policy 1, policy_version 403966 (0.0008) [2023-12-26 02:49:50,376][123091] Updated weights for policy 0, policy_version 406457 (0.0011) [2023-12-26 02:49:50,438][123091] Updated weights for policy 0, policy_version 406467 (0.0009) [2023-12-26 02:49:50,503][123091] Updated weights for policy 0, policy_version 406477 (0.0010) [2023-12-26 02:49:50,506][123090] Updated weights for policy 1, policy_version 403976 (0.0007) [2023-12-26 02:49:50,556][123090] Updated weights for policy 1, policy_version 403986 (0.0008) [2023-12-26 02:49:50,633][123090] Updated weights for policy 1, policy_version 403996 (0.0009) [2023-12-26 02:49:51,311][123091] Updated weights for policy 0, policy_version 406487 (0.0010) [2023-12-26 02:49:51,384][123091] Updated weights for policy 0, policy_version 406497 (0.0009) [2023-12-26 02:49:51,451][123091] Updated weights for policy 0, policy_version 406507 (0.0005) [2023-12-26 02:49:51,455][123090] Updated weights for policy 1, policy_version 404006 (0.0009) [2023-12-26 02:49:51,532][123090] Updated weights for policy 1, policy_version 404016 (0.0009) [2023-12-26 02:49:51,612][123090] Updated weights for policy 1, policy_version 404026 (0.0009) [2023-12-26 02:49:52,189][123091] Updated weights for policy 0, policy_version 406517 (0.0007) [2023-12-26 02:49:52,256][123091] Updated weights for policy 0, policy_version 406527 (0.0009) [2023-12-26 02:49:52,316][123091] Updated weights for policy 0, policy_version 406537 (0.0009) [2023-12-26 02:49:52,455][123090] Updated weights for policy 1, policy_version 404036 (0.0008) [2023-12-26 02:49:52,521][123090] Updated weights for policy 1, policy_version 404046 (0.0008) [2023-12-26 02:49:52,575][123090] Updated weights for policy 1, policy_version 404056 (0.0009) [2023-12-26 02:49:53,095][123091] Updated weights for policy 0, policy_version 406547 (0.0010) [2023-12-26 02:49:53,147][123091] Updated weights for policy 0, policy_version 406557 (0.0009) [2023-12-26 02:49:53,195][123091] Updated weights for policy 0, policy_version 406567 (0.0008) [2023-12-26 02:49:53,400][123090] Updated weights for policy 1, policy_version 404066 (0.0010) [2023-12-26 02:49:53,465][123090] Updated weights for policy 1, policy_version 404076 (0.0007) [2023-12-26 02:49:53,522][123090] Updated weights for policy 1, policy_version 404086 (0.0009) [2023-12-26 02:49:53,569][123090] Updated weights for policy 1, policy_version 404096 (0.0009) [2023-12-26 02:49:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 207536128. Throughput: 0: 8833.4, 1: 8864.2. Samples: 207511664. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:53,785][121949] Avg episode reward: [(0, '6165.412'), (1, '5951.605')] [2023-12-26 02:49:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000406576_104087552.pth... [2023-12-26 02:49:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000404096_103448576.pth... [2023-12-26 02:49:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000405552_103825408.pth [2023-12-26 02:49:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000403040_103178240.pth [2023-12-26 02:49:54,001][123091] Updated weights for policy 0, policy_version 406577 (0.0009) [2023-12-26 02:49:54,058][123091] Updated weights for policy 0, policy_version 406587 (0.0006) [2023-12-26 02:49:54,112][123091] Updated weights for policy 0, policy_version 406597 (0.0006) [2023-12-26 02:49:54,172][123091] Updated weights for policy 0, policy_version 406607 (0.0006) [2023-12-26 02:49:54,497][123090] Updated weights for policy 1, policy_version 404106 (0.0009) [2023-12-26 02:49:54,550][123090] Updated weights for policy 1, policy_version 404116 (0.0009) [2023-12-26 02:49:54,603][123090] Updated weights for policy 1, policy_version 404126 (0.0009) [2023-12-26 02:49:54,957][123091] Updated weights for policy 0, policy_version 406617 (0.0009) [2023-12-26 02:49:55,022][123091] Updated weights for policy 0, policy_version 406627 (0.0008) [2023-12-26 02:49:55,088][123091] Updated weights for policy 0, policy_version 406637 (0.0005) [2023-12-26 02:49:55,379][123090] Updated weights for policy 1, policy_version 404136 (0.0006) [2023-12-26 02:49:55,441][123090] Updated weights for policy 1, policy_version 404146 (0.0005) [2023-12-26 02:49:55,501][123090] Updated weights for policy 1, policy_version 404156 (0.0005) [2023-12-26 02:49:55,619][123091] Updated weights for policy 0, policy_version 406647 (0.0005) [2023-12-26 02:49:55,684][123091] Updated weights for policy 0, policy_version 406657 (0.0005) [2023-12-26 02:49:55,761][123091] Updated weights for policy 0, policy_version 406667 (0.0005) [2023-12-26 02:49:56,261][123090] Updated weights for policy 1, policy_version 404166 (0.0007) [2023-12-26 02:49:56,309][123090] Updated weights for policy 1, policy_version 404176 (0.0008) [2023-12-26 02:49:56,357][123090] Updated weights for policy 1, policy_version 404186 (0.0009) [2023-12-26 02:49:56,465][123091] Updated weights for policy 0, policy_version 406677 (0.0006) [2023-12-26 02:49:56,512][123091] Updated weights for policy 0, policy_version 406687 (0.0010) [2023-12-26 02:49:56,563][123091] Updated weights for policy 0, policy_version 406697 (0.0010) [2023-12-26 02:49:57,260][123090] Updated weights for policy 1, policy_version 404196 (0.0009) [2023-12-26 02:49:57,298][123091] Updated weights for policy 0, policy_version 406707 (0.0009) [2023-12-26 02:49:57,314][123090] Updated weights for policy 1, policy_version 404206 (0.0009) [2023-12-26 02:49:57,355][123091] Updated weights for policy 0, policy_version 406717 (0.0008) [2023-12-26 02:49:57,375][123090] Updated weights for policy 1, policy_version 404216 (0.0007) [2023-12-26 02:49:57,412][123091] Updated weights for policy 0, policy_version 406727 (0.0010) [2023-12-26 02:49:58,156][123091] Updated weights for policy 0, policy_version 406737 (0.0010) [2023-12-26 02:49:58,206][123090] Updated weights for policy 1, policy_version 404226 (0.0010) [2023-12-26 02:49:58,218][123091] Updated weights for policy 0, policy_version 406747 (0.0009) [2023-12-26 02:49:58,268][123090] Updated weights for policy 1, policy_version 404236 (0.0009) [2023-12-26 02:49:58,274][123091] Updated weights for policy 0, policy_version 406757 (0.0010) [2023-12-26 02:49:58,336][123090] Updated weights for policy 1, policy_version 404246 (0.0009) [2023-12-26 02:49:58,346][123091] Updated weights for policy 0, policy_version 406767 (0.0008) [2023-12-26 02:49:58,395][123090] Updated weights for policy 1, policy_version 404256 (0.0010) [2023-12-26 02:49:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 207626240. Throughput: 0: 8982.3, 1: 8860.9. Samples: 207619788. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:49:58,785][121949] Avg episode reward: [(0, '6177.975'), (1, '5792.895')] [2023-12-26 02:49:59,232][123091] Updated weights for policy 0, policy_version 406777 (0.0011) [2023-12-26 02:49:59,268][123090] Updated weights for policy 1, policy_version 404266 (0.0009) [2023-12-26 02:49:59,303][123091] Updated weights for policy 0, policy_version 406787 (0.0011) [2023-12-26 02:49:59,328][123090] Updated weights for policy 1, policy_version 404276 (0.0007) [2023-12-26 02:49:59,363][123091] Updated weights for policy 0, policy_version 406797 (0.0011) [2023-12-26 02:49:59,385][123090] Updated weights for policy 1, policy_version 404286 (0.0009) [2023-12-26 02:50:00,169][123091] Updated weights for policy 0, policy_version 406807 (0.0011) [2023-12-26 02:50:00,196][123090] Updated weights for policy 1, policy_version 404296 (0.0010) [2023-12-26 02:50:00,224][123091] Updated weights for policy 0, policy_version 406817 (0.0010) [2023-12-26 02:50:00,240][123090] Updated weights for policy 1, policy_version 404306 (0.0006) [2023-12-26 02:50:00,279][123091] Updated weights for policy 0, policy_version 406827 (0.0010) [2023-12-26 02:50:00,295][123090] Updated weights for policy 1, policy_version 404316 (0.0006) [2023-12-26 02:50:01,070][123090] Updated weights for policy 1, policy_version 404326 (0.0009) [2023-12-26 02:50:01,097][123091] Updated weights for policy 0, policy_version 406837 (0.0009) [2023-12-26 02:50:01,135][123090] Updated weights for policy 1, policy_version 404336 (0.0010) [2023-12-26 02:50:01,170][123091] Updated weights for policy 0, policy_version 406847 (0.0008) [2023-12-26 02:50:01,208][123090] Updated weights for policy 1, policy_version 404346 (0.0007) [2023-12-26 02:50:01,232][123091] Updated weights for policy 0, policy_version 406857 (0.0008) [2023-12-26 02:50:01,991][123090] Updated weights for policy 1, policy_version 404356 (0.0007) [2023-12-26 02:50:02,022][123091] Updated weights for policy 0, policy_version 406867 (0.0009) [2023-12-26 02:50:02,061][123090] Updated weights for policy 1, policy_version 404366 (0.0008) [2023-12-26 02:50:02,080][123091] Updated weights for policy 0, policy_version 406877 (0.0010) [2023-12-26 02:50:02,121][123090] Updated weights for policy 1, policy_version 404376 (0.0006) [2023-12-26 02:50:02,135][123091] Updated weights for policy 0, policy_version 406887 (0.0010) [2023-12-26 02:50:02,835][123090] Updated weights for policy 1, policy_version 404386 (0.0008) [2023-12-26 02:50:02,890][123091] Updated weights for policy 0, policy_version 406897 (0.0007) [2023-12-26 02:50:02,894][123090] Updated weights for policy 1, policy_version 404396 (0.0007) [2023-12-26 02:50:02,942][123091] Updated weights for policy 0, policy_version 406907 (0.0009) [2023-12-26 02:50:02,953][123090] Updated weights for policy 1, policy_version 404406 (0.0005) [2023-12-26 02:50:03,012][123091] Updated weights for policy 0, policy_version 406917 (0.0010) [2023-12-26 02:50:03,020][123090] Updated weights for policy 1, policy_version 404416 (0.0006) [2023-12-26 02:50:03,075][123091] Updated weights for policy 0, policy_version 406927 (0.0009) [2023-12-26 02:50:03,773][123090] Updated weights for policy 1, policy_version 404426 (0.0010) [2023-12-26 02:50:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 207708160. Throughput: 0: 8932.9, 1: 8842.1. Samples: 207725128. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:03,785][121949] Avg episode reward: [(0, '6178.275'), (1, '5699.412')] [2023-12-26 02:50:03,825][123090] Updated weights for policy 1, policy_version 404436 (0.0009) [2023-12-26 02:50:03,882][123090] Updated weights for policy 1, policy_version 404446 (0.0009) [2023-12-26 02:50:03,898][123091] Updated weights for policy 0, policy_version 406937 (0.0009) [2023-12-26 02:50:03,969][123091] Updated weights for policy 0, policy_version 406947 (0.0010) [2023-12-26 02:50:04,042][123091] Updated weights for policy 0, policy_version 406957 (0.0009) [2023-12-26 02:50:04,700][123090] Updated weights for policy 1, policy_version 404456 (0.0010) [2023-12-26 02:50:04,760][123090] Updated weights for policy 1, policy_version 404467 (0.0010) [2023-12-26 02:50:04,790][123091] Updated weights for policy 0, policy_version 406967 (0.0008) [2023-12-26 02:50:04,816][123090] Updated weights for policy 1, policy_version 404477 (0.0009) [2023-12-26 02:50:04,839][123091] Updated weights for policy 0, policy_version 406977 (0.0010) [2023-12-26 02:50:04,899][123091] Updated weights for policy 0, policy_version 406987 (0.0008) [2023-12-26 02:50:05,605][123090] Updated weights for policy 1, policy_version 404487 (0.0008) [2023-12-26 02:50:05,665][123090] Updated weights for policy 1, policy_version 404497 (0.0009) [2023-12-26 02:50:05,725][123090] Updated weights for policy 1, policy_version 404508 (0.0009) [2023-12-26 02:50:05,732][123091] Updated weights for policy 0, policy_version 406997 (0.0008) [2023-12-26 02:50:05,781][123091] Updated weights for policy 0, policy_version 407007 (0.0008) [2023-12-26 02:50:05,831][123091] Updated weights for policy 0, policy_version 407017 (0.0009) [2023-12-26 02:50:06,539][123090] Updated weights for policy 1, policy_version 404518 (0.0009) [2023-12-26 02:50:06,594][123090] Updated weights for policy 1, policy_version 404528 (0.0006) [2023-12-26 02:50:06,662][123090] Updated weights for policy 1, policy_version 404538 (0.0007) [2023-12-26 02:50:06,685][123091] Updated weights for policy 0, policy_version 407027 (0.0008) [2023-12-26 02:50:06,743][123091] Updated weights for policy 0, policy_version 407037 (0.0010) [2023-12-26 02:50:06,802][123091] Updated weights for policy 0, policy_version 407047 (0.0010) [2023-12-26 02:50:07,361][123090] Updated weights for policy 1, policy_version 404548 (0.0007) [2023-12-26 02:50:07,423][123090] Updated weights for policy 1, policy_version 404558 (0.0008) [2023-12-26 02:50:07,485][123090] Updated weights for policy 1, policy_version 404568 (0.0010) [2023-12-26 02:50:07,669][123091] Updated weights for policy 0, policy_version 407057 (0.0009) [2023-12-26 02:50:07,725][123091] Updated weights for policy 0, policy_version 407067 (0.0005) [2023-12-26 02:50:07,784][123091] Updated weights for policy 0, policy_version 407077 (0.0005) [2023-12-26 02:50:07,839][123091] Updated weights for policy 0, policy_version 407087 (0.0005) [2023-12-26 02:50:08,258][123090] Updated weights for policy 1, policy_version 404578 (0.0007) [2023-12-26 02:50:08,317][123090] Updated weights for policy 1, policy_version 404588 (0.0009) [2023-12-26 02:50:08,392][123090] Updated weights for policy 1, policy_version 404598 (0.0009) [2023-12-26 02:50:08,449][123090] Updated weights for policy 1, policy_version 404608 (0.0009) [2023-12-26 02:50:08,469][123091] Updated weights for policy 0, policy_version 407097 (0.0008) [2023-12-26 02:50:08,543][123091] Updated weights for policy 0, policy_version 407107 (0.0010) [2023-12-26 02:50:08,613][123091] Updated weights for policy 0, policy_version 407117 (0.0010) [2023-12-26 02:50:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 207806464. Throughput: 0: 8963.5, 1: 8861.6. Samples: 207777776. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:08,785][121949] Avg episode reward: [(0, '6181.188'), (1, '5756.862')] [2023-12-26 02:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000404608_103579648.pth... [2023-12-26 02:50:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000407120_104226816.pth... [2023-12-26 02:50:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000403584_103317504.pth [2023-12-26 02:50:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000406064_103956480.pth [2023-12-26 02:50:09,346][123090] Updated weights for policy 1, policy_version 404618 (0.0010) [2023-12-26 02:50:09,370][123091] Updated weights for policy 0, policy_version 407127 (0.0009) [2023-12-26 02:50:09,416][123090] Updated weights for policy 1, policy_version 404628 (0.0008) [2023-12-26 02:50:09,439][123091] Updated weights for policy 0, policy_version 407137 (0.0008) [2023-12-26 02:50:09,478][123090] Updated weights for policy 1, policy_version 404638 (0.0006) [2023-12-26 02:50:09,506][123091] Updated weights for policy 0, policy_version 407147 (0.0008) [2023-12-26 02:50:10,339][123091] Updated weights for policy 0, policy_version 407157 (0.0008) [2023-12-26 02:50:10,376][123090] Updated weights for policy 1, policy_version 404648 (0.0009) [2023-12-26 02:50:10,405][123091] Updated weights for policy 0, policy_version 407167 (0.0007) [2023-12-26 02:50:10,440][123090] Updated weights for policy 1, policy_version 404658 (0.0007) [2023-12-26 02:50:10,470][123091] Updated weights for policy 0, policy_version 407177 (0.0010) [2023-12-26 02:50:10,504][123090] Updated weights for policy 1, policy_version 404668 (0.0007) [2023-12-26 02:50:11,304][123091] Updated weights for policy 0, policy_version 407187 (0.0010) [2023-12-26 02:50:11,344][123090] Updated weights for policy 1, policy_version 404678 (0.0007) [2023-12-26 02:50:11,363][123091] Updated weights for policy 0, policy_version 407197 (0.0008) [2023-12-26 02:50:11,411][123090] Updated weights for policy 1, policy_version 404688 (0.0009) [2023-12-26 02:50:11,428][123091] Updated weights for policy 0, policy_version 407207 (0.0009) [2023-12-26 02:50:11,472][123090] Updated weights for policy 1, policy_version 404698 (0.0009) [2023-12-26 02:50:12,315][123091] Updated weights for policy 0, policy_version 407217 (0.0007) [2023-12-26 02:50:12,363][123090] Updated weights for policy 1, policy_version 404708 (0.0010) [2023-12-26 02:50:12,380][123091] Updated weights for policy 0, policy_version 407227 (0.0008) [2023-12-26 02:50:12,425][123090] Updated weights for policy 1, policy_version 404718 (0.0007) [2023-12-26 02:50:12,452][123091] Updated weights for policy 0, policy_version 407237 (0.0008) [2023-12-26 02:50:12,488][123090] Updated weights for policy 1, policy_version 404728 (0.0006) [2023-12-26 02:50:12,526][123091] Updated weights for policy 0, policy_version 407247 (0.0010) [2023-12-26 02:50:13,294][123091] Updated weights for policy 0, policy_version 407257 (0.0007) [2023-12-26 02:50:13,309][123090] Updated weights for policy 1, policy_version 404738 (0.0007) [2023-12-26 02:50:13,350][123091] Updated weights for policy 0, policy_version 407267 (0.0005) [2023-12-26 02:50:13,366][123090] Updated weights for policy 1, policy_version 404748 (0.0008) [2023-12-26 02:50:13,419][123091] Updated weights for policy 0, policy_version 407277 (0.0005) [2023-12-26 02:50:13,429][123090] Updated weights for policy 1, policy_version 404758 (0.0008) [2023-12-26 02:50:13,500][123090] Updated weights for policy 1, policy_version 404768 (0.0010) [2023-12-26 02:50:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 207888384. Throughput: 0: 8874.7, 1: 8801.9. Samples: 207880220. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:13,785][121949] Avg episode reward: [(0, '6065.308'), (1, '5755.595')] [2023-12-26 02:50:14,128][123091] Updated weights for policy 0, policy_version 407287 (0.0008) [2023-12-26 02:50:14,176][123091] Updated weights for policy 0, policy_version 407297 (0.0009) [2023-12-26 02:50:14,232][123091] Updated weights for policy 0, policy_version 407307 (0.0009) [2023-12-26 02:50:14,354][123090] Updated weights for policy 1, policy_version 404778 (0.0005) [2023-12-26 02:50:14,414][123090] Updated weights for policy 1, policy_version 404788 (0.0005) [2023-12-26 02:50:14,477][123090] Updated weights for policy 1, policy_version 404798 (0.0005) [2023-12-26 02:50:15,126][123091] Updated weights for policy 0, policy_version 407317 (0.0010) [2023-12-26 02:50:15,192][123091] Updated weights for policy 0, policy_version 407327 (0.0007) [2023-12-26 02:50:15,268][123090] Updated weights for policy 1, policy_version 404808 (0.0009) [2023-12-26 02:50:15,270][123091] Updated weights for policy 0, policy_version 407337 (0.0006) [2023-12-26 02:50:15,337][123090] Updated weights for policy 1, policy_version 404818 (0.0008) [2023-12-26 02:50:15,396][123090] Updated weights for policy 1, policy_version 404828 (0.0008) [2023-12-26 02:50:15,986][123091] Updated weights for policy 0, policy_version 407347 (0.0009) [2023-12-26 02:50:16,044][123091] Updated weights for policy 0, policy_version 407357 (0.0005) [2023-12-26 02:50:16,089][123091] Updated weights for policy 0, policy_version 407367 (0.0005) [2023-12-26 02:50:16,291][123090] Updated weights for policy 1, policy_version 404838 (0.0009) [2023-12-26 02:50:16,350][123090] Updated weights for policy 1, policy_version 404848 (0.0010) [2023-12-26 02:50:16,403][123090] Updated weights for policy 1, policy_version 404859 (0.0010) [2023-12-26 02:50:16,635][123091] Updated weights for policy 0, policy_version 407377 (0.0005) [2023-12-26 02:50:16,702][123091] Updated weights for policy 0, policy_version 407387 (0.0006) [2023-12-26 02:50:16,774][123091] Updated weights for policy 0, policy_version 407397 (0.0005) [2023-12-26 02:50:16,837][123091] Updated weights for policy 0, policy_version 407407 (0.0005) [2023-12-26 02:50:17,254][123090] Updated weights for policy 1, policy_version 404869 (0.0010) [2023-12-26 02:50:17,318][123090] Updated weights for policy 1, policy_version 404879 (0.0010) [2023-12-26 02:50:17,376][123090] Updated weights for policy 1, policy_version 404889 (0.0010) [2023-12-26 02:50:17,559][123091] Updated weights for policy 0, policy_version 407417 (0.0008) [2023-12-26 02:50:17,607][123091] Updated weights for policy 0, policy_version 407427 (0.0009) [2023-12-26 02:50:17,655][123091] Updated weights for policy 0, policy_version 407437 (0.0009) [2023-12-26 02:50:18,200][123090] Updated weights for policy 1, policy_version 404899 (0.0009) [2023-12-26 02:50:18,256][123090] Updated weights for policy 1, policy_version 404909 (0.0005) [2023-12-26 02:50:18,327][123090] Updated weights for policy 1, policy_version 404919 (0.0006) [2023-12-26 02:50:18,491][123091] Updated weights for policy 0, policy_version 407447 (0.0006) [2023-12-26 02:50:18,556][123091] Updated weights for policy 0, policy_version 407457 (0.0006) [2023-12-26 02:50:18,622][123091] Updated weights for policy 0, policy_version 407467 (0.0005) [2023-12-26 02:50:18,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 207978496. Throughput: 0: 8918.1, 1: 8719.8. Samples: 207987388. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:18,786][121949] Avg episode reward: [(0, '6037.584'), (1, '5625.188')] [2023-12-26 02:50:19,017][123090] Updated weights for policy 1, policy_version 404929 (0.0008) [2023-12-26 02:50:19,069][123090] Updated weights for policy 1, policy_version 404939 (0.0009) [2023-12-26 02:50:19,121][123090] Updated weights for policy 1, policy_version 404949 (0.0009) [2023-12-26 02:50:19,184][123090] Updated weights for policy 1, policy_version 404959 (0.0009) [2023-12-26 02:50:19,369][123091] Updated weights for policy 0, policy_version 407477 (0.0008) [2023-12-26 02:50:19,427][123091] Updated weights for policy 0, policy_version 407487 (0.0010) [2023-12-26 02:50:19,487][123091] Updated weights for policy 0, policy_version 407497 (0.0009) [2023-12-26 02:50:20,067][123090] Updated weights for policy 1, policy_version 404969 (0.0008) [2023-12-26 02:50:20,133][123090] Updated weights for policy 1, policy_version 404979 (0.0008) [2023-12-26 02:50:20,196][123090] Updated weights for policy 1, policy_version 404989 (0.0008) [2023-12-26 02:50:20,378][123091] Updated weights for policy 0, policy_version 407507 (0.0009) [2023-12-26 02:50:20,430][123091] Updated weights for policy 0, policy_version 407517 (0.0010) [2023-12-26 02:50:20,479][123091] Updated weights for policy 0, policy_version 407527 (0.0010) [2023-12-26 02:50:21,000][123090] Updated weights for policy 1, policy_version 404999 (0.0009) [2023-12-26 02:50:21,070][123090] Updated weights for policy 1, policy_version 405009 (0.0008) [2023-12-26 02:50:21,136][123090] Updated weights for policy 1, policy_version 405019 (0.0009) [2023-12-26 02:50:21,360][123091] Updated weights for policy 0, policy_version 407537 (0.0010) [2023-12-26 02:50:21,428][123091] Updated weights for policy 0, policy_version 407547 (0.0008) [2023-12-26 02:50:21,497][123091] Updated weights for policy 0, policy_version 407557 (0.0005) [2023-12-26 02:50:21,571][123091] Updated weights for policy 0, policy_version 407567 (0.0008) [2023-12-26 02:50:22,049][123090] Updated weights for policy 1, policy_version 405029 (0.0009) [2023-12-26 02:50:22,113][123090] Updated weights for policy 1, policy_version 405039 (0.0009) [2023-12-26 02:50:22,178][123090] Updated weights for policy 1, policy_version 405049 (0.0009) [2023-12-26 02:50:22,436][123091] Updated weights for policy 0, policy_version 407577 (0.0008) [2023-12-26 02:50:22,502][123091] Updated weights for policy 0, policy_version 407587 (0.0008) [2023-12-26 02:50:22,569][123091] Updated weights for policy 0, policy_version 407597 (0.0008) [2023-12-26 02:50:23,079][123090] Updated weights for policy 1, policy_version 405059 (0.0009) [2023-12-26 02:50:23,140][123090] Updated weights for policy 1, policy_version 405069 (0.0009) [2023-12-26 02:50:23,204][123090] Updated weights for policy 1, policy_version 405079 (0.0009) [2023-12-26 02:50:23,280][123091] Updated weights for policy 0, policy_version 407607 (0.0006) [2023-12-26 02:50:23,330][123091] Updated weights for policy 0, policy_version 407617 (0.0005) [2023-12-26 02:50:23,377][123091] Updated weights for policy 0, policy_version 407627 (0.0005) [2023-12-26 02:50:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 208060416. Throughput: 0: 8883.5, 1: 8634.8. Samples: 208037772. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:23,785][121949] Avg episode reward: [(0, '6095.408'), (1, '5651.965')] [2023-12-26 02:50:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000407632_104357888.pth... [2023-12-26 02:50:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000405088_103702528.pth... [2023-12-26 02:50:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000404096_103448576.pth [2023-12-26 02:50:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000406576_104087552.pth [2023-12-26 02:50:24,102][123091] Updated weights for policy 0, policy_version 407637 (0.0008) [2023-12-26 02:50:24,116][123090] Updated weights for policy 1, policy_version 405089 (0.0009) [2023-12-26 02:50:24,169][123091] Updated weights for policy 0, policy_version 407647 (0.0011) [2023-12-26 02:50:24,176][123090] Updated weights for policy 1, policy_version 405099 (0.0006) [2023-12-26 02:50:24,232][123091] Updated weights for policy 0, policy_version 407657 (0.0011) [2023-12-26 02:50:24,233][123090] Updated weights for policy 1, policy_version 405109 (0.0010) [2023-12-26 02:50:24,283][123090] Updated weights for policy 1, policy_version 405119 (0.0007) [2023-12-26 02:50:24,988][123091] Updated weights for policy 0, policy_version 407667 (0.0009) [2023-12-26 02:50:25,045][123091] Updated weights for policy 0, policy_version 407677 (0.0006) [2023-12-26 02:50:25,048][123090] Updated weights for policy 1, policy_version 405129 (0.0006) [2023-12-26 02:50:25,094][123091] Updated weights for policy 0, policy_version 407687 (0.0005) [2023-12-26 02:50:25,110][123090] Updated weights for policy 1, policy_version 405139 (0.0005) [2023-12-26 02:50:25,162][123090] Updated weights for policy 1, policy_version 405149 (0.0005) [2023-12-26 02:50:25,775][123091] Updated weights for policy 0, policy_version 407697 (0.0005) [2023-12-26 02:50:25,838][123091] Updated weights for policy 0, policy_version 407707 (0.0007) [2023-12-26 02:50:25,897][123091] Updated weights for policy 0, policy_version 407717 (0.0011) [2023-12-26 02:50:25,909][123090] Updated weights for policy 1, policy_version 405159 (0.0007) [2023-12-26 02:50:25,962][123091] Updated weights for policy 0, policy_version 407727 (0.0008) [2023-12-26 02:50:25,965][123090] Updated weights for policy 1, policy_version 405169 (0.0009) [2023-12-26 02:50:26,023][123090] Updated weights for policy 1, policy_version 405179 (0.0008) [2023-12-26 02:50:26,675][123091] Updated weights for policy 0, policy_version 407737 (0.0006) [2023-12-26 02:50:26,728][123091] Updated weights for policy 0, policy_version 407747 (0.0005) [2023-12-26 02:50:26,778][123090] Updated weights for policy 1, policy_version 405189 (0.0007) [2023-12-26 02:50:26,780][123091] Updated weights for policy 0, policy_version 407757 (0.0005) [2023-12-26 02:50:26,830][123090] Updated weights for policy 1, policy_version 405199 (0.0010) [2023-12-26 02:50:26,878][123090] Updated weights for policy 1, policy_version 405209 (0.0010) [2023-12-26 02:50:27,553][123091] Updated weights for policy 0, policy_version 407767 (0.0010) [2023-12-26 02:50:27,608][123091] Updated weights for policy 0, policy_version 407777 (0.0010) [2023-12-26 02:50:27,612][123090] Updated weights for policy 1, policy_version 405219 (0.0008) [2023-12-26 02:50:27,659][123091] Updated weights for policy 0, policy_version 407787 (0.0010) [2023-12-26 02:50:27,666][123090] Updated weights for policy 1, policy_version 405229 (0.0005) [2023-12-26 02:50:27,716][123090] Updated weights for policy 1, policy_version 405239 (0.0006) [2023-12-26 02:50:28,474][123090] Updated weights for policy 1, policy_version 405249 (0.0010) [2023-12-26 02:50:28,514][123091] Updated weights for policy 0, policy_version 407797 (0.0010) [2023-12-26 02:50:28,537][123090] Updated weights for policy 1, policy_version 405259 (0.0010) [2023-12-26 02:50:28,577][123091] Updated weights for policy 0, policy_version 407807 (0.0010) [2023-12-26 02:50:28,600][123090] Updated weights for policy 1, policy_version 405269 (0.0010) [2023-12-26 02:50:28,640][123091] Updated weights for policy 0, policy_version 407817 (0.0011) [2023-12-26 02:50:28,663][123090] Updated weights for policy 1, policy_version 405279 (0.0010) [2023-12-26 02:50:28,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 208158720. Throughput: 0: 9021.8, 1: 8624.8. Samples: 208146900. Policy #0 lag: (min: 31.0, avg: 31.1, max: 41.0) [2023-12-26 02:50:28,785][121949] Avg episode reward: [(0, '6238.056'), (1, '5731.690')] [2023-12-26 02:50:29,422][123090] Updated weights for policy 1, policy_version 405289 (0.0006) [2023-12-26 02:50:29,449][123091] Updated weights for policy 0, policy_version 407827 (0.0010) [2023-12-26 02:50:29,491][123090] Updated weights for policy 1, policy_version 405299 (0.0005) [2023-12-26 02:50:29,510][123091] Updated weights for policy 0, policy_version 407837 (0.0009) [2023-12-26 02:50:29,566][123090] Updated weights for policy 1, policy_version 405309 (0.0007) [2023-12-26 02:50:29,572][123091] Updated weights for policy 0, policy_version 407847 (0.0008) [2023-12-26 02:50:30,229][123090] Updated weights for policy 1, policy_version 405319 (0.0007) [2023-12-26 02:50:30,295][123090] Updated weights for policy 1, policy_version 405329 (0.0005) [2023-12-26 02:50:30,365][123090] Updated weights for policy 1, policy_version 405339 (0.0006) [2023-12-26 02:50:30,422][123091] Updated weights for policy 0, policy_version 407857 (0.0009) [2023-12-26 02:50:30,475][123091] Updated weights for policy 0, policy_version 407867 (0.0010) [2023-12-26 02:50:30,529][123091] Updated weights for policy 0, policy_version 407877 (0.0010) [2023-12-26 02:50:30,585][123091] Updated weights for policy 0, policy_version 407888 (0.0011) [2023-12-26 02:50:30,983][123090] Updated weights for policy 1, policy_version 405349 (0.0007) [2023-12-26 02:50:31,054][123090] Updated weights for policy 1, policy_version 405359 (0.0008) [2023-12-26 02:50:31,124][123090] Updated weights for policy 1, policy_version 405369 (0.0007) [2023-12-26 02:50:31,573][123091] Updated weights for policy 0, policy_version 407898 (0.0009) [2023-12-26 02:50:31,636][123091] Updated weights for policy 0, policy_version 407908 (0.0010) [2023-12-26 02:50:31,702][123091] Updated weights for policy 0, policy_version 407918 (0.0010) [2023-12-26 02:50:31,860][123090] Updated weights for policy 1, policy_version 405379 (0.0011) [2023-12-26 02:50:31,929][123090] Updated weights for policy 1, policy_version 405389 (0.0010) [2023-12-26 02:50:31,996][123090] Updated weights for policy 1, policy_version 405399 (0.0010) [2023-12-26 02:50:32,572][123091] Updated weights for policy 0, policy_version 407928 (0.0010) [2023-12-26 02:50:32,643][123091] Updated weights for policy 0, policy_version 407938 (0.0009) [2023-12-26 02:50:32,699][123091] Updated weights for policy 0, policy_version 407948 (0.0010) [2023-12-26 02:50:32,742][123090] Updated weights for policy 1, policy_version 405409 (0.0010) [2023-12-26 02:50:32,802][123090] Updated weights for policy 1, policy_version 405419 (0.0005) [2023-12-26 02:50:32,852][123090] Updated weights for policy 1, policy_version 405429 (0.0005) [2023-12-26 02:50:32,902][123090] Updated weights for policy 1, policy_version 405439 (0.0005) [2023-12-26 02:50:33,553][123090] Updated weights for policy 1, policy_version 405449 (0.0005) [2023-12-26 02:50:33,606][123090] Updated weights for policy 1, policy_version 405459 (0.0005) [2023-12-26 02:50:33,610][123091] Updated weights for policy 0, policy_version 407958 (0.0008) [2023-12-26 02:50:33,659][123090] Updated weights for policy 1, policy_version 405469 (0.0005) [2023-12-26 02:50:33,662][123091] Updated weights for policy 0, policy_version 407968 (0.0009) [2023-12-26 02:50:33,729][123091] Updated weights for policy 0, policy_version 407978 (0.0009) [2023-12-26 02:50:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 208248832. Throughput: 0: 8924.5, 1: 8742.8. Samples: 208254252. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:33,785][121949] Avg episode reward: [(0, '6212.163'), (1, '5613.211')] [2023-12-26 02:50:34,341][123090] Updated weights for policy 1, policy_version 405479 (0.0005) [2023-12-26 02:50:34,397][123090] Updated weights for policy 1, policy_version 405489 (0.0006) [2023-12-26 02:50:34,462][123090] Updated weights for policy 1, policy_version 405499 (0.0008) [2023-12-26 02:50:34,549][123091] Updated weights for policy 0, policy_version 407988 (0.0010) [2023-12-26 02:50:34,606][123091] Updated weights for policy 0, policy_version 407998 (0.0008) [2023-12-26 02:50:34,655][123091] Updated weights for policy 0, policy_version 408008 (0.0008) [2023-12-26 02:50:35,278][123091] Updated weights for policy 0, policy_version 408018 (0.0007) [2023-12-26 02:50:35,295][123090] Updated weights for policy 1, policy_version 405509 (0.0009) [2023-12-26 02:50:35,325][123091] Updated weights for policy 0, policy_version 408028 (0.0010) [2023-12-26 02:50:35,353][123090] Updated weights for policy 1, policy_version 405519 (0.0006) [2023-12-26 02:50:35,368][123091] Updated weights for policy 0, policy_version 408038 (0.0010) [2023-12-26 02:50:35,401][123090] Updated weights for policy 1, policy_version 405529 (0.0006) [2023-12-26 02:50:35,416][123091] Updated weights for policy 0, policy_version 408048 (0.0010) [2023-12-26 02:50:36,156][123090] Updated weights for policy 1, policy_version 405539 (0.0007) [2023-12-26 02:50:36,221][123090] Updated weights for policy 1, policy_version 405549 (0.0005) [2023-12-26 02:50:36,272][123091] Updated weights for policy 0, policy_version 408058 (0.0008) [2023-12-26 02:50:36,288][123090] Updated weights for policy 1, policy_version 405559 (0.0008) [2023-12-26 02:50:36,338][123091] Updated weights for policy 0, policy_version 408068 (0.0010) [2023-12-26 02:50:36,394][123091] Updated weights for policy 0, policy_version 408078 (0.0011) [2023-12-26 02:50:36,996][123090] Updated weights for policy 1, policy_version 405569 (0.0006) [2023-12-26 02:50:37,075][123090] Updated weights for policy 1, policy_version 405579 (0.0007) [2023-12-26 02:50:37,142][123090] Updated weights for policy 1, policy_version 405589 (0.0007) [2023-12-26 02:50:37,202][123091] Updated weights for policy 0, policy_version 408088 (0.0009) [2023-12-26 02:50:37,204][123090] Updated weights for policy 1, policy_version 405599 (0.0005) [2023-12-26 02:50:37,272][123091] Updated weights for policy 0, policy_version 408098 (0.0008) [2023-12-26 02:50:37,346][123091] Updated weights for policy 0, policy_version 408108 (0.0007) [2023-12-26 02:50:37,872][123090] Updated weights for policy 1, policy_version 405609 (0.0005) [2023-12-26 02:50:37,928][123090] Updated weights for policy 1, policy_version 405619 (0.0006) [2023-12-26 02:50:37,981][123090] Updated weights for policy 1, policy_version 405629 (0.0005) [2023-12-26 02:50:38,012][123091] Updated weights for policy 0, policy_version 408118 (0.0009) [2023-12-26 02:50:38,074][123091] Updated weights for policy 0, policy_version 408128 (0.0006) [2023-12-26 02:50:38,132][123091] Updated weights for policy 0, policy_version 408138 (0.0005) [2023-12-26 02:50:38,669][123090] Updated weights for policy 1, policy_version 405639 (0.0009) [2023-12-26 02:50:38,729][123090] Updated weights for policy 1, policy_version 405649 (0.0009) [2023-12-26 02:50:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 208330752. Throughput: 0: 8924.3, 1: 8793.5. Samples: 208308964. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:38,785][121949] Avg episode reward: [(0, '6127.985'), (1, '5431.181')] [2023-12-26 02:50:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000408144_104488960.pth... [2023-12-26 02:50:38,791][123090] Updated weights for policy 1, policy_version 405659 (0.0009) [2023-12-26 02:50:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000407120_104226816.pth [2023-12-26 02:50:38,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000405664_103849984.pth... [2023-12-26 02:50:38,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000404608_103579648.pth [2023-12-26 02:50:38,840][123091] Updated weights for policy 0, policy_version 408148 (0.0007) [2023-12-26 02:50:38,895][123091] Updated weights for policy 0, policy_version 408158 (0.0009) [2023-12-26 02:50:38,949][123091] Updated weights for policy 0, policy_version 408168 (0.0009) [2023-12-26 02:50:39,702][123090] Updated weights for policy 1, policy_version 405669 (0.0010) [2023-12-26 02:50:39,745][123091] Updated weights for policy 0, policy_version 408178 (0.0009) [2023-12-26 02:50:39,769][123090] Updated weights for policy 1, policy_version 405679 (0.0010) [2023-12-26 02:50:39,807][123091] Updated weights for policy 0, policy_version 408188 (0.0007) [2023-12-26 02:50:39,834][123090] Updated weights for policy 1, policy_version 405689 (0.0009) [2023-12-26 02:50:39,877][123091] Updated weights for policy 0, policy_version 408198 (0.0007) [2023-12-26 02:50:39,950][123091] Updated weights for policy 0, policy_version 408208 (0.0007) [2023-12-26 02:50:40,721][123090] Updated weights for policy 1, policy_version 405699 (0.0010) [2023-12-26 02:50:40,725][123091] Updated weights for policy 0, policy_version 408218 (0.0006) [2023-12-26 02:50:40,779][123091] Updated weights for policy 0, policy_version 408228 (0.0006) [2023-12-26 02:50:40,783][123090] Updated weights for policy 1, policy_version 405709 (0.0009) [2023-12-26 02:50:40,834][123090] Updated weights for policy 1, policy_version 405719 (0.0008) [2023-12-26 02:50:40,835][123091] Updated weights for policy 0, policy_version 408238 (0.0007) [2023-12-26 02:50:41,597][123091] Updated weights for policy 0, policy_version 408248 (0.0008) [2023-12-26 02:50:41,670][123091] Updated weights for policy 0, policy_version 408258 (0.0008) [2023-12-26 02:50:41,743][123091] Updated weights for policy 0, policy_version 408268 (0.0008) [2023-12-26 02:50:41,770][123090] Updated weights for policy 1, policy_version 405729 (0.0009) [2023-12-26 02:50:41,826][123090] Updated weights for policy 1, policy_version 405739 (0.0007) [2023-12-26 02:50:41,891][123090] Updated weights for policy 1, policy_version 405749 (0.0010) [2023-12-26 02:50:41,948][123090] Updated weights for policy 1, policy_version 405759 (0.0009) [2023-12-26 02:50:42,472][123091] Updated weights for policy 0, policy_version 408278 (0.0008) [2023-12-26 02:50:42,537][123091] Updated weights for policy 0, policy_version 408288 (0.0008) [2023-12-26 02:50:42,599][123091] Updated weights for policy 0, policy_version 408298 (0.0008) [2023-12-26 02:50:42,842][123090] Updated weights for policy 1, policy_version 405769 (0.0009) [2023-12-26 02:50:42,910][123090] Updated weights for policy 1, policy_version 405779 (0.0006) [2023-12-26 02:50:42,967][123090] Updated weights for policy 1, policy_version 405789 (0.0005) [2023-12-26 02:50:43,311][123091] Updated weights for policy 0, policy_version 408308 (0.0007) [2023-12-26 02:50:43,360][123091] Updated weights for policy 0, policy_version 408318 (0.0005) [2023-12-26 02:50:43,429][123091] Updated weights for policy 0, policy_version 408328 (0.0009) [2023-12-26 02:50:43,637][123090] Updated weights for policy 1, policy_version 405799 (0.0008) [2023-12-26 02:50:43,703][123090] Updated weights for policy 1, policy_version 405809 (0.0009) [2023-12-26 02:50:43,752][123090] Updated weights for policy 1, policy_version 405819 (0.0009) [2023-12-26 02:50:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 208429056. Throughput: 0: 8864.9, 1: 8819.0. Samples: 208415564. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:43,785][121949] Avg episode reward: [(0, '6112.294'), (1, '5459.909')] [2023-12-26 02:50:44,223][123091] Updated weights for policy 0, policy_version 408338 (0.0010) [2023-12-26 02:50:44,272][123091] Updated weights for policy 0, policy_version 408348 (0.0009) [2023-12-26 02:50:44,320][123091] Updated weights for policy 0, policy_version 408358 (0.0005) [2023-12-26 02:50:44,365][123091] Updated weights for policy 0, policy_version 408368 (0.0005) [2023-12-26 02:50:44,631][123090] Updated weights for policy 1, policy_version 405829 (0.0009) [2023-12-26 02:50:44,680][123090] Updated weights for policy 1, policy_version 405839 (0.0010) [2023-12-26 02:50:44,727][123090] Updated weights for policy 1, policy_version 405849 (0.0010) [2023-12-26 02:50:45,085][123091] Updated weights for policy 0, policy_version 408378 (0.0010) [2023-12-26 02:50:45,145][123091] Updated weights for policy 0, policy_version 408388 (0.0011) [2023-12-26 02:50:45,219][123091] Updated weights for policy 0, policy_version 408398 (0.0011) [2023-12-26 02:50:45,493][123090] Updated weights for policy 1, policy_version 405859 (0.0009) [2023-12-26 02:50:45,565][123090] Updated weights for policy 1, policy_version 405869 (0.0005) [2023-12-26 02:50:45,638][123090] Updated weights for policy 1, policy_version 405879 (0.0005) [2023-12-26 02:50:45,981][123091] Updated weights for policy 0, policy_version 408408 (0.0006) [2023-12-26 02:50:46,037][123091] Updated weights for policy 0, policy_version 408418 (0.0005) [2023-12-26 02:50:46,099][123091] Updated weights for policy 0, policy_version 408428 (0.0006) [2023-12-26 02:50:46,257][123090] Updated weights for policy 1, policy_version 405889 (0.0007) [2023-12-26 02:50:46,315][123090] Updated weights for policy 1, policy_version 405899 (0.0008) [2023-12-26 02:50:46,369][123090] Updated weights for policy 1, policy_version 405909 (0.0006) [2023-12-26 02:50:46,427][123090] Updated weights for policy 1, policy_version 405919 (0.0005) [2023-12-26 02:50:46,832][123091] Updated weights for policy 0, policy_version 408438 (0.0006) [2023-12-26 02:50:46,879][123091] Updated weights for policy 0, policy_version 408448 (0.0005) [2023-12-26 02:50:46,940][123091] Updated weights for policy 0, policy_version 408458 (0.0005) [2023-12-26 02:50:47,288][123090] Updated weights for policy 1, policy_version 405929 (0.0007) [2023-12-26 02:50:47,334][123090] Updated weights for policy 1, policy_version 405939 (0.0005) [2023-12-26 02:50:47,389][123090] Updated weights for policy 1, policy_version 405949 (0.0005) [2023-12-26 02:50:47,620][123091] Updated weights for policy 0, policy_version 408468 (0.0005) [2023-12-26 02:50:47,673][123091] Updated weights for policy 0, policy_version 408478 (0.0005) [2023-12-26 02:50:47,730][123091] Updated weights for policy 0, policy_version 408488 (0.0005) [2023-12-26 02:50:48,090][123090] Updated weights for policy 1, policy_version 405959 (0.0006) [2023-12-26 02:50:48,159][123090] Updated weights for policy 1, policy_version 405969 (0.0005) [2023-12-26 02:50:48,219][123090] Updated weights for policy 1, policy_version 405979 (0.0005) [2023-12-26 02:50:48,456][123091] Updated weights for policy 0, policy_version 408498 (0.0006) [2023-12-26 02:50:48,518][123091] Updated weights for policy 0, policy_version 408508 (0.0008) [2023-12-26 02:50:48,580][123091] Updated weights for policy 0, policy_version 408518 (0.0008) [2023-12-26 02:50:48,633][123091] Updated weights for policy 0, policy_version 408528 (0.0009) [2023-12-26 02:50:48,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 208519168. Throughput: 0: 8987.7, 1: 8874.7. Samples: 208528932. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:48,785][121949] Avg episode reward: [(0, '6010.794'), (1, '5612.087')] [2023-12-26 02:50:48,919][123090] Updated weights for policy 1, policy_version 405989 (0.0008) [2023-12-26 02:50:48,973][123090] Updated weights for policy 1, policy_version 405999 (0.0009) [2023-12-26 02:50:49,035][123090] Updated weights for policy 1, policy_version 406009 (0.0009) [2023-12-26 02:50:49,480][123091] Updated weights for policy 0, policy_version 408538 (0.0009) [2023-12-26 02:50:49,546][123091] Updated weights for policy 0, policy_version 408548 (0.0009) [2023-12-26 02:50:49,611][123091] Updated weights for policy 0, policy_version 408558 (0.0008) [2023-12-26 02:50:49,859][123090] Updated weights for policy 1, policy_version 406019 (0.0006) [2023-12-26 02:50:49,929][123090] Updated weights for policy 1, policy_version 406029 (0.0010) [2023-12-26 02:50:50,011][123090] Updated weights for policy 1, policy_version 406039 (0.0009) [2023-12-26 02:50:50,442][123091] Updated weights for policy 0, policy_version 408568 (0.0009) [2023-12-26 02:50:50,510][123091] Updated weights for policy 0, policy_version 408578 (0.0010) [2023-12-26 02:50:50,571][123091] Updated weights for policy 0, policy_version 408588 (0.0009) [2023-12-26 02:50:50,837][123090] Updated weights for policy 1, policy_version 406049 (0.0010) [2023-12-26 02:50:50,902][123090] Updated weights for policy 1, policy_version 406059 (0.0010) [2023-12-26 02:50:50,970][123090] Updated weights for policy 1, policy_version 406069 (0.0010) [2023-12-26 02:50:51,036][123090] Updated weights for policy 1, policy_version 406079 (0.0010) [2023-12-26 02:50:51,415][123091] Updated weights for policy 0, policy_version 408598 (0.0009) [2023-12-26 02:50:51,483][123091] Updated weights for policy 0, policy_version 408608 (0.0006) [2023-12-26 02:50:51,546][123091] Updated weights for policy 0, policy_version 408618 (0.0006) [2023-12-26 02:50:51,873][123090] Updated weights for policy 1, policy_version 406089 (0.0006) [2023-12-26 02:50:51,949][123090] Updated weights for policy 1, policy_version 406099 (0.0006) [2023-12-26 02:50:52,010][123090] Updated weights for policy 1, policy_version 406109 (0.0009) [2023-12-26 02:50:52,266][123091] Updated weights for policy 0, policy_version 408628 (0.0007) [2023-12-26 02:50:52,321][123091] Updated weights for policy 0, policy_version 408638 (0.0006) [2023-12-26 02:50:52,384][123091] Updated weights for policy 0, policy_version 408648 (0.0007) [2023-12-26 02:50:52,850][123090] Updated weights for policy 1, policy_version 406119 (0.0010) [2023-12-26 02:50:52,912][123090] Updated weights for policy 1, policy_version 406129 (0.0009) [2023-12-26 02:50:52,972][123090] Updated weights for policy 1, policy_version 406139 (0.0009) [2023-12-26 02:50:53,150][123091] Updated weights for policy 0, policy_version 408658 (0.0008) [2023-12-26 02:50:53,199][123091] Updated weights for policy 0, policy_version 408668 (0.0009) [2023-12-26 02:50:53,250][123091] Updated weights for policy 0, policy_version 408679 (0.0010) [2023-12-26 02:50:53,773][123090] Updated weights for policy 1, policy_version 406149 (0.0009) [2023-12-26 02:50:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 208601088. Throughput: 0: 8963.4, 1: 8856.3. Samples: 208579668. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:53,785][121949] Avg episode reward: [(0, '6040.986'), (1, '5689.457')] [2023-12-26 02:50:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000408688_104628224.pth... [2023-12-26 02:50:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000407632_104357888.pth [2023-12-26 02:50:53,830][123090] Updated weights for policy 1, policy_version 406159 (0.0010) [2023-12-26 02:50:53,885][123090] Updated weights for policy 1, policy_version 406169 (0.0010) [2023-12-26 02:50:53,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000406176_103981056.pth... [2023-12-26 02:50:53,933][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000405088_103702528.pth [2023-12-26 02:50:54,111][123091] Updated weights for policy 0, policy_version 408689 (0.0010) [2023-12-26 02:50:54,168][123091] Updated weights for policy 0, policy_version 408699 (0.0010) [2023-12-26 02:50:54,222][123091] Updated weights for policy 0, policy_version 408709 (0.0010) [2023-12-26 02:50:54,283][123091] Updated weights for policy 0, policy_version 408719 (0.0009) [2023-12-26 02:50:54,760][123090] Updated weights for policy 1, policy_version 406179 (0.0009) [2023-12-26 02:50:54,811][123090] Updated weights for policy 1, policy_version 406189 (0.0008) [2023-12-26 02:50:54,863][123090] Updated weights for policy 1, policy_version 406199 (0.0005) [2023-12-26 02:50:55,073][123091] Updated weights for policy 0, policy_version 408729 (0.0007) [2023-12-26 02:50:55,121][123091] Updated weights for policy 0, policy_version 408739 (0.0006) [2023-12-26 02:50:55,184][123091] Updated weights for policy 0, policy_version 408749 (0.0007) [2023-12-26 02:50:55,742][123090] Updated weights for policy 1, policy_version 406210 (0.0009) [2023-12-26 02:50:55,798][123090] Updated weights for policy 1, policy_version 406220 (0.0008) [2023-12-26 02:50:55,850][123090] Updated weights for policy 1, policy_version 406230 (0.0009) [2023-12-26 02:50:55,904][123090] Updated weights for policy 1, policy_version 406240 (0.0008) [2023-12-26 02:50:55,926][123091] Updated weights for policy 0, policy_version 408759 (0.0009) [2023-12-26 02:50:55,978][123091] Updated weights for policy 0, policy_version 408769 (0.0010) [2023-12-26 02:50:56,036][123091] Updated weights for policy 0, policy_version 408779 (0.0010) [2023-12-26 02:50:56,704][123090] Updated weights for policy 1, policy_version 406250 (0.0009) [2023-12-26 02:50:56,761][123090] Updated weights for policy 1, policy_version 406260 (0.0009) [2023-12-26 02:50:56,816][123090] Updated weights for policy 1, policy_version 406270 (0.0009) [2023-12-26 02:50:56,854][123091] Updated weights for policy 0, policy_version 408789 (0.0010) [2023-12-26 02:50:56,906][123091] Updated weights for policy 0, policy_version 408799 (0.0009) [2023-12-26 02:50:56,959][123091] Updated weights for policy 0, policy_version 408809 (0.0009) [2023-12-26 02:50:57,643][123090] Updated weights for policy 1, policy_version 406280 (0.0010) [2023-12-26 02:50:57,690][123090] Updated weights for policy 1, policy_version 406290 (0.0010) [2023-12-26 02:50:57,737][123090] Updated weights for policy 1, policy_version 406300 (0.0010) [2023-12-26 02:50:57,745][123091] Updated weights for policy 0, policy_version 408819 (0.0008) [2023-12-26 02:50:57,794][123091] Updated weights for policy 0, policy_version 408829 (0.0009) [2023-12-26 02:50:57,854][123091] Updated weights for policy 0, policy_version 408839 (0.0009) [2023-12-26 02:50:58,513][123090] Updated weights for policy 1, policy_version 406310 (0.0009) [2023-12-26 02:50:58,573][123090] Updated weights for policy 1, policy_version 406320 (0.0008) [2023-12-26 02:50:58,646][123090] Updated weights for policy 1, policy_version 406330 (0.0007) [2023-12-26 02:50:58,673][123091] Updated weights for policy 0, policy_version 408849 (0.0010) [2023-12-26 02:50:58,739][123091] Updated weights for policy 0, policy_version 408859 (0.0008) [2023-12-26 02:50:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 208691200. Throughput: 0: 9024.1, 1: 8871.0. Samples: 208685500. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:50:58,785][121949] Avg episode reward: [(0, '6156.760'), (1, '5604.357')] [2023-12-26 02:50:58,808][123091] Updated weights for policy 0, policy_version 408869 (0.0008) [2023-12-26 02:50:58,867][123091] Updated weights for policy 0, policy_version 408879 (0.0008) [2023-12-26 02:50:59,381][123090] Updated weights for policy 1, policy_version 406340 (0.0007) [2023-12-26 02:50:59,446][123090] Updated weights for policy 1, policy_version 406350 (0.0006) [2023-12-26 02:50:59,519][123090] Updated weights for policy 1, policy_version 406360 (0.0006) [2023-12-26 02:50:59,636][123091] Updated weights for policy 0, policy_version 408889 (0.0008) [2023-12-26 02:50:59,697][123091] Updated weights for policy 0, policy_version 408899 (0.0009) [2023-12-26 02:50:59,760][123091] Updated weights for policy 0, policy_version 408909 (0.0009) [2023-12-26 02:51:00,253][123090] Updated weights for policy 1, policy_version 406370 (0.0008) [2023-12-26 02:51:00,317][123090] Updated weights for policy 1, policy_version 406380 (0.0006) [2023-12-26 02:51:00,376][123090] Updated weights for policy 1, policy_version 406390 (0.0006) [2023-12-26 02:51:00,427][123090] Updated weights for policy 1, policy_version 406400 (0.0007) [2023-12-26 02:51:00,561][123091] Updated weights for policy 0, policy_version 408919 (0.0009) [2023-12-26 02:51:00,622][123091] Updated weights for policy 0, policy_version 408929 (0.0010) [2023-12-26 02:51:00,677][123091] Updated weights for policy 0, policy_version 408940 (0.0010) [2023-12-26 02:51:01,054][123090] Updated weights for policy 1, policy_version 406410 (0.0007) [2023-12-26 02:51:01,107][123090] Updated weights for policy 1, policy_version 406420 (0.0006) [2023-12-26 02:51:01,184][123090] Updated weights for policy 1, policy_version 406430 (0.0010) [2023-12-26 02:51:01,597][123091] Updated weights for policy 0, policy_version 408950 (0.0010) [2023-12-26 02:51:01,662][123091] Updated weights for policy 0, policy_version 408960 (0.0010) [2023-12-26 02:51:01,728][123091] Updated weights for policy 0, policy_version 408970 (0.0010) [2023-12-26 02:51:01,937][123090] Updated weights for policy 1, policy_version 406440 (0.0009) [2023-12-26 02:51:01,996][123090] Updated weights for policy 1, policy_version 406450 (0.0008) [2023-12-26 02:51:02,053][123090] Updated weights for policy 1, policy_version 406460 (0.0007) [2023-12-26 02:51:02,552][123091] Updated weights for policy 0, policy_version 408980 (0.0011) [2023-12-26 02:51:02,609][123091] Updated weights for policy 0, policy_version 408990 (0.0010) [2023-12-26 02:51:02,674][123091] Updated weights for policy 0, policy_version 409000 (0.0010) [2023-12-26 02:51:02,841][123090] Updated weights for policy 1, policy_version 406470 (0.0008) [2023-12-26 02:51:02,889][123090] Updated weights for policy 1, policy_version 406480 (0.0008) [2023-12-26 02:51:02,942][123090] Updated weights for policy 1, policy_version 406490 (0.0009) [2023-12-26 02:51:03,479][123091] Updated weights for policy 0, policy_version 409010 (0.0011) [2023-12-26 02:51:03,540][123091] Updated weights for policy 0, policy_version 409020 (0.0010) [2023-12-26 02:51:03,599][123091] Updated weights for policy 0, policy_version 409030 (0.0008) [2023-12-26 02:51:03,653][123091] Updated weights for policy 0, policy_version 409040 (0.0010) [2023-12-26 02:51:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 208781312. Throughput: 0: 8924.5, 1: 8970.7. Samples: 208792664. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:03,784][121949] Avg episode reward: [(0, '6164.141'), (1, '5495.105')] [2023-12-26 02:51:03,796][123090] Updated weights for policy 1, policy_version 406500 (0.0009) [2023-12-26 02:51:03,852][123090] Updated weights for policy 1, policy_version 406510 (0.0008) [2023-12-26 02:51:03,917][123090] Updated weights for policy 1, policy_version 406520 (0.0009) [2023-12-26 02:51:04,476][123091] Updated weights for policy 0, policy_version 409050 (0.0011) [2023-12-26 02:51:04,540][123091] Updated weights for policy 0, policy_version 409060 (0.0011) [2023-12-26 02:51:04,594][123091] Updated weights for policy 0, policy_version 409070 (0.0006) [2023-12-26 02:51:04,784][123090] Updated weights for policy 1, policy_version 406530 (0.0009) [2023-12-26 02:51:04,841][123090] Updated weights for policy 1, policy_version 406540 (0.0009) [2023-12-26 02:51:04,917][123090] Updated weights for policy 1, policy_version 406550 (0.0006) [2023-12-26 02:51:04,982][123090] Updated weights for policy 1, policy_version 406560 (0.0009) [2023-12-26 02:51:05,244][123091] Updated weights for policy 0, policy_version 409080 (0.0005) [2023-12-26 02:51:05,308][123091] Updated weights for policy 0, policy_version 409090 (0.0005) [2023-12-26 02:51:05,376][123091] Updated weights for policy 0, policy_version 409100 (0.0010) [2023-12-26 02:51:05,717][123090] Updated weights for policy 1, policy_version 406570 (0.0005) [2023-12-26 02:51:05,775][123090] Updated weights for policy 1, policy_version 406580 (0.0005) [2023-12-26 02:51:05,847][123090] Updated weights for policy 1, policy_version 406590 (0.0005) [2023-12-26 02:51:06,084][123091] Updated weights for policy 0, policy_version 409110 (0.0007) [2023-12-26 02:51:06,143][123091] Updated weights for policy 0, policy_version 409120 (0.0008) [2023-12-26 02:51:06,211][123091] Updated weights for policy 0, policy_version 409130 (0.0007) [2023-12-26 02:51:06,600][123090] Updated weights for policy 1, policy_version 406600 (0.0009) [2023-12-26 02:51:06,666][123090] Updated weights for policy 1, policy_version 406610 (0.0009) [2023-12-26 02:51:06,736][123090] Updated weights for policy 1, policy_version 406620 (0.0009) [2023-12-26 02:51:06,954][123091] Updated weights for policy 0, policy_version 409140 (0.0008) [2023-12-26 02:51:07,026][123091] Updated weights for policy 0, policy_version 409150 (0.0010) [2023-12-26 02:51:07,093][123091] Updated weights for policy 0, policy_version 409160 (0.0010) [2023-12-26 02:51:07,549][123090] Updated weights for policy 1, policy_version 406630 (0.0010) [2023-12-26 02:51:07,619][123090] Updated weights for policy 1, policy_version 406640 (0.0009) [2023-12-26 02:51:07,688][123090] Updated weights for policy 1, policy_version 406650 (0.0009) [2023-12-26 02:51:07,851][123091] Updated weights for policy 0, policy_version 409170 (0.0008) [2023-12-26 02:51:07,922][123091] Updated weights for policy 0, policy_version 409180 (0.0005) [2023-12-26 02:51:07,994][123091] Updated weights for policy 0, policy_version 409190 (0.0005) [2023-12-26 02:51:08,063][123091] Updated weights for policy 0, policy_version 409200 (0.0007) [2023-12-26 02:51:08,570][123090] Updated weights for policy 1, policy_version 406660 (0.0009) [2023-12-26 02:51:08,618][123090] Updated weights for policy 1, policy_version 406670 (0.0009) [2023-12-26 02:51:08,666][123090] Updated weights for policy 1, policy_version 406680 (0.0009) [2023-12-26 02:51:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 208871424. Throughput: 0: 9001.5, 1: 8998.8. Samples: 208847780. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:08,785][121949] Avg episode reward: [(0, '6063.529'), (1, '5615.604')] [2023-12-26 02:51:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000406688_104112128.pth... [2023-12-26 02:51:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000405664_103849984.pth [2023-12-26 02:51:08,802][123091] Updated weights for policy 0, policy_version 409210 (0.0010) [2023-12-26 02:51:08,860][123091] Updated weights for policy 0, policy_version 409221 (0.0011) [2023-12-26 02:51:08,919][123091] Updated weights for policy 0, policy_version 409231 (0.0009) [2023-12-26 02:51:08,925][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000409232_104767488.pth... [2023-12-26 02:51:08,930][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000408144_104488960.pth [2023-12-26 02:51:09,503][123090] Updated weights for policy 1, policy_version 406690 (0.0008) [2023-12-26 02:51:09,562][123090] Updated weights for policy 1, policy_version 406700 (0.0009) [2023-12-26 02:51:09,617][123090] Updated weights for policy 1, policy_version 406710 (0.0010) [2023-12-26 02:51:09,669][123090] Updated weights for policy 1, policy_version 406720 (0.0009) [2023-12-26 02:51:09,823][123091] Updated weights for policy 0, policy_version 409241 (0.0009) [2023-12-26 02:51:09,896][123091] Updated weights for policy 0, policy_version 409251 (0.0010) [2023-12-26 02:51:09,971][123091] Updated weights for policy 0, policy_version 409261 (0.0009) [2023-12-26 02:51:10,546][123090] Updated weights for policy 1, policy_version 406730 (0.0008) [2023-12-26 02:51:10,620][123090] Updated weights for policy 1, policy_version 406740 (0.0009) [2023-12-26 02:51:10,688][123090] Updated weights for policy 1, policy_version 406750 (0.0009) [2023-12-26 02:51:10,782][123091] Updated weights for policy 0, policy_version 409272 (0.0009) [2023-12-26 02:51:10,840][123091] Updated weights for policy 0, policy_version 409283 (0.0010) [2023-12-26 02:51:10,892][123091] Updated weights for policy 0, policy_version 409293 (0.0009) [2023-12-26 02:51:11,465][123090] Updated weights for policy 1, policy_version 406760 (0.0009) [2023-12-26 02:51:11,524][123090] Updated weights for policy 1, policy_version 406770 (0.0009) [2023-12-26 02:51:11,590][123090] Updated weights for policy 1, policy_version 406780 (0.0010) [2023-12-26 02:51:11,842][123091] Updated weights for policy 0, policy_version 409303 (0.0010) [2023-12-26 02:51:11,905][123091] Updated weights for policy 0, policy_version 409313 (0.0009) [2023-12-26 02:51:11,966][123091] Updated weights for policy 0, policy_version 409323 (0.0010) [2023-12-26 02:51:12,477][123090] Updated weights for policy 1, policy_version 406790 (0.0009) [2023-12-26 02:51:12,539][123090] Updated weights for policy 1, policy_version 406800 (0.0009) [2023-12-26 02:51:12,601][123090] Updated weights for policy 1, policy_version 406810 (0.0009) [2023-12-26 02:51:12,780][123091] Updated weights for policy 0, policy_version 409333 (0.0009) [2023-12-26 02:51:12,844][123091] Updated weights for policy 0, policy_version 409343 (0.0010) [2023-12-26 02:51:12,914][123091] Updated weights for policy 0, policy_version 409353 (0.0009) [2023-12-26 02:51:13,406][123090] Updated weights for policy 1, policy_version 406820 (0.0010) [2023-12-26 02:51:13,467][123090] Updated weights for policy 1, policy_version 406830 (0.0006) [2023-12-26 02:51:13,538][123090] Updated weights for policy 1, policy_version 406840 (0.0005) [2023-12-26 02:51:13,759][123091] Updated weights for policy 0, policy_version 409363 (0.0009) [2023-12-26 02:51:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 208953344. Throughput: 0: 8879.8, 1: 8945.3. Samples: 208949032. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:13,785][121949] Avg episode reward: [(0, '6228.226'), (1, '5795.716')] [2023-12-26 02:51:13,811][123091] Updated weights for policy 0, policy_version 409373 (0.0009) [2023-12-26 02:51:13,866][123091] Updated weights for policy 0, policy_version 409383 (0.0009) [2023-12-26 02:51:14,221][123090] Updated weights for policy 1, policy_version 406850 (0.0005) [2023-12-26 02:51:14,277][123090] Updated weights for policy 1, policy_version 406860 (0.0005) [2023-12-26 02:51:14,326][123090] Updated weights for policy 1, policy_version 406870 (0.0005) [2023-12-26 02:51:14,386][123090] Updated weights for policy 1, policy_version 406880 (0.0009) [2023-12-26 02:51:14,741][123091] Updated weights for policy 0, policy_version 409393 (0.0010) [2023-12-26 02:51:14,806][123091] Updated weights for policy 0, policy_version 409403 (0.0009) [2023-12-26 02:51:14,875][123091] Updated weights for policy 0, policy_version 409413 (0.0010) [2023-12-26 02:51:14,938][123091] Updated weights for policy 0, policy_version 409423 (0.0010) [2023-12-26 02:51:15,149][123090] Updated weights for policy 1, policy_version 406890 (0.0010) [2023-12-26 02:51:15,202][123090] Updated weights for policy 1, policy_version 406900 (0.0010) [2023-12-26 02:51:15,260][123090] Updated weights for policy 1, policy_version 406911 (0.0009) [2023-12-26 02:51:15,707][123091] Updated weights for policy 0, policy_version 409433 (0.0011) [2023-12-26 02:51:15,764][123091] Updated weights for policy 0, policy_version 409444 (0.0010) [2023-12-26 02:51:15,828][123091] Updated weights for policy 0, policy_version 409454 (0.0010) [2023-12-26 02:51:16,068][123090] Updated weights for policy 1, policy_version 406921 (0.0006) [2023-12-26 02:51:16,139][123090] Updated weights for policy 1, policy_version 406931 (0.0005) [2023-12-26 02:51:16,198][123090] Updated weights for policy 1, policy_version 406941 (0.0006) [2023-12-26 02:51:16,732][123091] Updated weights for policy 0, policy_version 409464 (0.0009) [2023-12-26 02:51:16,794][123091] Updated weights for policy 0, policy_version 409474 (0.0009) [2023-12-26 02:51:16,857][123091] Updated weights for policy 0, policy_version 409484 (0.0009) [2023-12-26 02:51:16,890][123090] Updated weights for policy 1, policy_version 406951 (0.0009) [2023-12-26 02:51:16,954][123090] Updated weights for policy 1, policy_version 406961 (0.0011) [2023-12-26 02:51:17,025][123090] Updated weights for policy 1, policy_version 406971 (0.0011) [2023-12-26 02:51:17,692][123091] Updated weights for policy 0, policy_version 409494 (0.0009) [2023-12-26 02:51:17,747][123091] Updated weights for policy 0, policy_version 409504 (0.0011) [2023-12-26 02:51:17,814][123091] Updated weights for policy 0, policy_version 409514 (0.0011) [2023-12-26 02:51:17,860][123090] Updated weights for policy 1, policy_version 406981 (0.0011) [2023-12-26 02:51:17,922][123090] Updated weights for policy 1, policy_version 406991 (0.0010) [2023-12-26 02:51:17,995][123090] Updated weights for policy 1, policy_version 407001 (0.0011) [2023-12-26 02:51:18,565][123091] Updated weights for policy 0, policy_version 409524 (0.0009) [2023-12-26 02:51:18,619][123091] Updated weights for policy 0, policy_version 409534 (0.0005) [2023-12-26 02:51:18,676][123091] Updated weights for policy 0, policy_version 409544 (0.0007) [2023-12-26 02:51:18,738][123090] Updated weights for policy 1, policy_version 407011 (0.0009) [2023-12-26 02:51:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.5, 300 sec: 17800.3). Total num frames: 209043456. Throughput: 0: 8927.7, 1: 8882.7. Samples: 209055716. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:18,784][121949] Avg episode reward: [(0, '6257.666'), (1, '5761.371')] [2023-12-26 02:51:18,812][123090] Updated weights for policy 1, policy_version 407021 (0.0010) [2023-12-26 02:51:18,886][123090] Updated weights for policy 1, policy_version 407031 (0.0010) [2023-12-26 02:51:19,476][123091] Updated weights for policy 0, policy_version 409554 (0.0007) [2023-12-26 02:51:19,541][123091] Updated weights for policy 0, policy_version 409564 (0.0007) [2023-12-26 02:51:19,604][123091] Updated weights for policy 0, policy_version 409574 (0.0006) [2023-12-26 02:51:19,662][123091] Updated weights for policy 0, policy_version 409584 (0.0007) [2023-12-26 02:51:19,695][123090] Updated weights for policy 1, policy_version 407041 (0.0010) [2023-12-26 02:51:19,763][123090] Updated weights for policy 1, policy_version 407051 (0.0011) [2023-12-26 02:51:19,834][123090] Updated weights for policy 1, policy_version 407061 (0.0011) [2023-12-26 02:51:19,894][123090] Updated weights for policy 1, policy_version 407071 (0.0010) [2023-12-26 02:51:20,444][123091] Updated weights for policy 0, policy_version 409594 (0.0006) [2023-12-26 02:51:20,512][123091] Updated weights for policy 0, policy_version 409604 (0.0011) [2023-12-26 02:51:20,592][123091] Updated weights for policy 0, policy_version 409614 (0.0010) [2023-12-26 02:51:20,736][123090] Updated weights for policy 1, policy_version 407081 (0.0008) [2023-12-26 02:51:20,803][123090] Updated weights for policy 1, policy_version 407091 (0.0008) [2023-12-26 02:51:20,867][123090] Updated weights for policy 1, policy_version 407101 (0.0008) [2023-12-26 02:51:21,411][123091] Updated weights for policy 0, policy_version 409624 (0.0008) [2023-12-26 02:51:21,465][123091] Updated weights for policy 0, policy_version 409634 (0.0005) [2023-12-26 02:51:21,519][123091] Updated weights for policy 0, policy_version 409644 (0.0006) [2023-12-26 02:51:21,725][123090] Updated weights for policy 1, policy_version 407111 (0.0010) [2023-12-26 02:51:21,795][123090] Updated weights for policy 1, policy_version 407121 (0.0010) [2023-12-26 02:51:21,863][123090] Updated weights for policy 1, policy_version 407131 (0.0011) [2023-12-26 02:51:22,327][123091] Updated weights for policy 0, policy_version 409654 (0.0006) [2023-12-26 02:51:22,404][123091] Updated weights for policy 0, policy_version 409664 (0.0007) [2023-12-26 02:51:22,475][123091] Updated weights for policy 0, policy_version 409674 (0.0008) [2023-12-26 02:51:22,739][123090] Updated weights for policy 1, policy_version 407141 (0.0010) [2023-12-26 02:51:22,795][123090] Updated weights for policy 1, policy_version 407151 (0.0010) [2023-12-26 02:51:22,855][123090] Updated weights for policy 1, policy_version 407161 (0.0011) [2023-12-26 02:51:23,250][123091] Updated weights for policy 0, policy_version 409684 (0.0010) [2023-12-26 02:51:23,346][123091] Updated weights for policy 0, policy_version 409694 (0.0011) [2023-12-26 02:51:23,402][123091] Updated weights for policy 0, policy_version 409704 (0.0011) [2023-12-26 02:51:23,687][123090] Updated weights for policy 1, policy_version 407171 (0.0009) [2023-12-26 02:51:23,740][123090] Updated weights for policy 1, policy_version 407181 (0.0005) [2023-12-26 02:51:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 209125376. Throughput: 0: 8911.7, 1: 8827.1. Samples: 209107208. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:23,785][121949] Avg episode reward: [(0, '6252.747'), (1, '5543.016')] [2023-12-26 02:51:23,788][123090] Updated weights for policy 1, policy_version 407191 (0.0005) [2023-12-26 02:51:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000409712_104890368.pth... [2023-12-26 02:51:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000408688_104628224.pth [2023-12-26 02:51:23,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000407200_104243200.pth... [2023-12-26 02:51:23,836][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000406176_103981056.pth [2023-12-26 02:51:24,167][123091] Updated weights for policy 0, policy_version 409714 (0.0009) [2023-12-26 02:51:24,219][123091] Updated weights for policy 0, policy_version 409724 (0.0010) [2023-12-26 02:51:24,275][123091] Updated weights for policy 0, policy_version 409734 (0.0010) [2023-12-26 02:51:24,327][123091] Updated weights for policy 0, policy_version 409744 (0.0009) [2023-12-26 02:51:24,551][123090] Updated weights for policy 1, policy_version 407201 (0.0006) [2023-12-26 02:51:24,621][123090] Updated weights for policy 1, policy_version 407211 (0.0010) [2023-12-26 02:51:24,686][123090] Updated weights for policy 1, policy_version 407221 (0.0009) [2023-12-26 02:51:24,750][123090] Updated weights for policy 1, policy_version 407231 (0.0005) [2023-12-26 02:51:25,198][123091] Updated weights for policy 0, policy_version 409754 (0.0010) [2023-12-26 02:51:25,252][123091] Updated weights for policy 0, policy_version 409766 (0.0010) [2023-12-26 02:51:25,314][123091] Updated weights for policy 0, policy_version 409776 (0.0010) [2023-12-26 02:51:25,410][123090] Updated weights for policy 1, policy_version 407241 (0.0008) [2023-12-26 02:51:25,459][123090] Updated weights for policy 1, policy_version 407251 (0.0009) [2023-12-26 02:51:25,512][123090] Updated weights for policy 1, policy_version 407261 (0.0009) [2023-12-26 02:51:26,126][123091] Updated weights for policy 0, policy_version 409786 (0.0006) [2023-12-26 02:51:26,189][123091] Updated weights for policy 0, policy_version 409796 (0.0005) [2023-12-26 02:51:26,248][123091] Updated weights for policy 0, policy_version 409806 (0.0006) [2023-12-26 02:51:26,300][123090] Updated weights for policy 1, policy_version 407271 (0.0006) [2023-12-26 02:51:26,350][123090] Updated weights for policy 1, policy_version 407281 (0.0005) [2023-12-26 02:51:26,418][123090] Updated weights for policy 1, policy_version 407291 (0.0008) [2023-12-26 02:51:26,797][123091] Updated weights for policy 0, policy_version 409816 (0.0005) [2023-12-26 02:51:26,857][123091] Updated weights for policy 0, policy_version 409826 (0.0005) [2023-12-26 02:51:26,919][123091] Updated weights for policy 0, policy_version 409836 (0.0005) [2023-12-26 02:51:27,289][123090] Updated weights for policy 1, policy_version 407301 (0.0009) [2023-12-26 02:51:27,344][123090] Updated weights for policy 1, policy_version 407311 (0.0009) [2023-12-26 02:51:27,403][123090] Updated weights for policy 1, policy_version 407321 (0.0009) [2023-12-26 02:51:27,503][123091] Updated weights for policy 0, policy_version 409846 (0.0005) [2023-12-26 02:51:27,561][123091] Updated weights for policy 0, policy_version 409856 (0.0005) [2023-12-26 02:51:27,609][123091] Updated weights for policy 0, policy_version 409866 (0.0005) [2023-12-26 02:51:28,292][123090] Updated weights for policy 1, policy_version 407331 (0.0009) [2023-12-26 02:51:28,339][123091] Updated weights for policy 0, policy_version 409876 (0.0007) [2023-12-26 02:51:28,355][123090] Updated weights for policy 1, policy_version 407341 (0.0009) [2023-12-26 02:51:28,401][123091] Updated weights for policy 0, policy_version 409886 (0.0011) [2023-12-26 02:51:28,411][123090] Updated weights for policy 1, policy_version 407351 (0.0010) [2023-12-26 02:51:28,455][123091] Updated weights for policy 0, policy_version 409896 (0.0011) [2023-12-26 02:51:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 209223680. Throughput: 0: 8916.7, 1: 8845.2. Samples: 209214852. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:28,785][121949] Avg episode reward: [(0, '6173.689'), (1, '5609.957')] [2023-12-26 02:51:29,131][123091] Updated weights for policy 0, policy_version 409906 (0.0010) [2023-12-26 02:51:29,197][123091] Updated weights for policy 0, policy_version 409916 (0.0005) [2023-12-26 02:51:29,263][123091] Updated weights for policy 0, policy_version 409926 (0.0008) [2023-12-26 02:51:29,327][123091] Updated weights for policy 0, policy_version 409936 (0.0006) [2023-12-26 02:51:29,327][123090] Updated weights for policy 1, policy_version 407361 (0.0006) [2023-12-26 02:51:29,396][123090] Updated weights for policy 1, policy_version 407371 (0.0009) [2023-12-26 02:51:29,446][123090] Updated weights for policy 1, policy_version 407381 (0.0008) [2023-12-26 02:51:29,504][123090] Updated weights for policy 1, policy_version 407391 (0.0009) [2023-12-26 02:51:30,122][123091] Updated weights for policy 0, policy_version 409946 (0.0011) [2023-12-26 02:51:30,181][123091] Updated weights for policy 0, policy_version 409956 (0.0010) [2023-12-26 02:51:30,236][123091] Updated weights for policy 0, policy_version 409966 (0.0010) [2023-12-26 02:51:30,341][123090] Updated weights for policy 1, policy_version 407401 (0.0009) [2023-12-26 02:51:30,401][123090] Updated weights for policy 1, policy_version 407411 (0.0008) [2023-12-26 02:51:30,452][123090] Updated weights for policy 1, policy_version 407421 (0.0008) [2023-12-26 02:51:31,057][123091] Updated weights for policy 0, policy_version 409976 (0.0011) [2023-12-26 02:51:31,120][123091] Updated weights for policy 0, policy_version 409986 (0.0010) [2023-12-26 02:51:31,189][123091] Updated weights for policy 0, policy_version 409996 (0.0009) [2023-12-26 02:51:31,316][123090] Updated weights for policy 1, policy_version 407431 (0.0009) [2023-12-26 02:51:31,385][123090] Updated weights for policy 1, policy_version 407441 (0.0009) [2023-12-26 02:51:31,452][123090] Updated weights for policy 1, policy_version 407451 (0.0009) [2023-12-26 02:51:31,929][123091] Updated weights for policy 0, policy_version 410006 (0.0007) [2023-12-26 02:51:31,982][123091] Updated weights for policy 0, policy_version 410016 (0.0005) [2023-12-26 02:51:32,032][123091] Updated weights for policy 0, policy_version 410026 (0.0005) [2023-12-26 02:51:32,322][123090] Updated weights for policy 1, policy_version 407461 (0.0008) [2023-12-26 02:51:32,398][123090] Updated weights for policy 1, policy_version 407471 (0.0010) [2023-12-26 02:51:32,456][123090] Updated weights for policy 1, policy_version 407481 (0.0010) [2023-12-26 02:51:32,718][123091] Updated weights for policy 0, policy_version 410036 (0.0005) [2023-12-26 02:51:32,780][123091] Updated weights for policy 0, policy_version 410046 (0.0010) [2023-12-26 02:51:32,831][123091] Updated weights for policy 0, policy_version 410056 (0.0010) [2023-12-26 02:51:33,212][123090] Updated weights for policy 1, policy_version 407491 (0.0009) [2023-12-26 02:51:33,267][123090] Updated weights for policy 1, policy_version 407501 (0.0005) [2023-12-26 02:51:33,333][123090] Updated weights for policy 1, policy_version 407511 (0.0005) [2023-12-26 02:51:33,512][123091] Updated weights for policy 0, policy_version 410066 (0.0009) [2023-12-26 02:51:33,567][123091] Updated weights for policy 0, policy_version 410076 (0.0005) [2023-12-26 02:51:33,617][123091] Updated weights for policy 0, policy_version 410086 (0.0005) [2023-12-26 02:51:33,667][123091] Updated weights for policy 0, policy_version 410096 (0.0005) [2023-12-26 02:51:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 209313792. Throughput: 0: 8923.3, 1: 8737.8. Samples: 209323680. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:33,785][121949] Avg episode reward: [(0, '6198.317'), (1, '5694.128')] [2023-12-26 02:51:34,111][123090] Updated weights for policy 1, policy_version 407521 (0.0006) [2023-12-26 02:51:34,170][123090] Updated weights for policy 1, policy_version 407531 (0.0009) [2023-12-26 02:51:34,240][123090] Updated weights for policy 1, policy_version 407541 (0.0008) [2023-12-26 02:51:34,303][123090] Updated weights for policy 1, policy_version 407551 (0.0007) [2023-12-26 02:51:34,334][123091] Updated weights for policy 0, policy_version 410106 (0.0011) [2023-12-26 02:51:34,400][123091] Updated weights for policy 0, policy_version 410116 (0.0008) [2023-12-26 02:51:34,466][123091] Updated weights for policy 0, policy_version 410126 (0.0010) [2023-12-26 02:51:35,132][123090] Updated weights for policy 1, policy_version 407561 (0.0005) [2023-12-26 02:51:35,187][123091] Updated weights for policy 0, policy_version 410136 (0.0006) [2023-12-26 02:51:35,210][123090] Updated weights for policy 1, policy_version 407571 (0.0005) [2023-12-26 02:51:35,248][123091] Updated weights for policy 0, policy_version 410146 (0.0007) [2023-12-26 02:51:35,266][123090] Updated weights for policy 1, policy_version 407581 (0.0008) [2023-12-26 02:51:35,307][123091] Updated weights for policy 0, policy_version 410156 (0.0006) [2023-12-26 02:51:35,798][123091] Updated weights for policy 0, policy_version 410166 (0.0005) [2023-12-26 02:51:35,845][123091] Updated weights for policy 0, policy_version 410176 (0.0005) [2023-12-26 02:51:35,897][123091] Updated weights for policy 0, policy_version 410186 (0.0009) [2023-12-26 02:51:36,042][123090] Updated weights for policy 1, policy_version 407591 (0.0008) [2023-12-26 02:51:36,116][123090] Updated weights for policy 1, policy_version 407601 (0.0007) [2023-12-26 02:51:36,183][123090] Updated weights for policy 1, policy_version 407611 (0.0006) [2023-12-26 02:51:36,755][123091] Updated weights for policy 0, policy_version 410196 (0.0009) [2023-12-26 02:51:36,823][123091] Updated weights for policy 0, policy_version 410206 (0.0009) [2023-12-26 02:51:36,891][123091] Updated weights for policy 0, policy_version 410216 (0.0006) [2023-12-26 02:51:36,954][123090] Updated weights for policy 1, policy_version 407621 (0.0007) [2023-12-26 02:51:37,027][123090] Updated weights for policy 1, policy_version 407631 (0.0009) [2023-12-26 02:51:37,093][123090] Updated weights for policy 1, policy_version 407641 (0.0006) [2023-12-26 02:51:37,697][123091] Updated weights for policy 0, policy_version 410226 (0.0007) [2023-12-26 02:51:37,747][123091] Updated weights for policy 0, policy_version 410236 (0.0010) [2023-12-26 02:51:37,803][123091] Updated weights for policy 0, policy_version 410246 (0.0010) [2023-12-26 02:51:37,862][123091] Updated weights for policy 0, policy_version 410256 (0.0010) [2023-12-26 02:51:37,869][123090] Updated weights for policy 1, policy_version 407651 (0.0009) [2023-12-26 02:51:37,918][123090] Updated weights for policy 1, policy_version 407661 (0.0005) [2023-12-26 02:51:37,971][123090] Updated weights for policy 1, policy_version 407671 (0.0005) [2023-12-26 02:51:38,676][123090] Updated weights for policy 1, policy_version 407681 (0.0005) [2023-12-26 02:51:38,683][123091] Updated weights for policy 0, policy_version 410266 (0.0010) [2023-12-26 02:51:38,743][123090] Updated weights for policy 1, policy_version 407691 (0.0010) [2023-12-26 02:51:38,746][123091] Updated weights for policy 0, policy_version 410276 (0.0009) [2023-12-26 02:51:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 209395712. Throughput: 0: 9024.7, 1: 8744.2. Samples: 209379268. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:38,785][121949] Avg episode reward: [(0, '6128.344'), (1, '5789.886')] [2023-12-26 02:51:38,804][123090] Updated weights for policy 1, policy_version 407701 (0.0009) [2023-12-26 02:51:38,813][123091] Updated weights for policy 0, policy_version 410286 (0.0009) [2023-12-26 02:51:38,824][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000410288_105037824.pth... [2023-12-26 02:51:38,828][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000409232_104767488.pth [2023-12-26 02:51:38,876][123090] Updated weights for policy 1, policy_version 407711 (0.0010) [2023-12-26 02:51:38,879][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000407712_104374272.pth... [2023-12-26 02:51:38,883][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000406688_104112128.pth [2023-12-26 02:51:39,684][123091] Updated weights for policy 0, policy_version 410296 (0.0008) [2023-12-26 02:51:39,687][123090] Updated weights for policy 1, policy_version 407721 (0.0008) [2023-12-26 02:51:39,742][123091] Updated weights for policy 0, policy_version 410306 (0.0008) [2023-12-26 02:51:39,744][123090] Updated weights for policy 1, policy_version 407731 (0.0007) [2023-12-26 02:51:39,803][123091] Updated weights for policy 0, policy_version 410316 (0.0009) [2023-12-26 02:51:39,805][123090] Updated weights for policy 1, policy_version 407741 (0.0007) [2023-12-26 02:51:40,619][123090] Updated weights for policy 1, policy_version 407751 (0.0009) [2023-12-26 02:51:40,638][123091] Updated weights for policy 0, policy_version 410326 (0.0006) [2023-12-26 02:51:40,669][123090] Updated weights for policy 1, policy_version 407761 (0.0008) [2023-12-26 02:51:40,703][123091] Updated weights for policy 0, policy_version 410336 (0.0006) [2023-12-26 02:51:40,732][123090] Updated weights for policy 1, policy_version 407771 (0.0009) [2023-12-26 02:51:40,762][123091] Updated weights for policy 0, policy_version 410346 (0.0006) [2023-12-26 02:51:41,520][123091] Updated weights for policy 0, policy_version 410356 (0.0007) [2023-12-26 02:51:41,582][123090] Updated weights for policy 1, policy_version 407781 (0.0009) [2023-12-26 02:51:41,589][123091] Updated weights for policy 0, policy_version 410366 (0.0008) [2023-12-26 02:51:41,655][123090] Updated weights for policy 1, policy_version 407791 (0.0008) [2023-12-26 02:51:41,664][123091] Updated weights for policy 0, policy_version 410376 (0.0009) [2023-12-26 02:51:41,730][123090] Updated weights for policy 1, policy_version 407801 (0.0010) [2023-12-26 02:51:42,517][123091] Updated weights for policy 0, policy_version 410386 (0.0008) [2023-12-26 02:51:42,549][123090] Updated weights for policy 1, policy_version 407811 (0.0010) [2023-12-26 02:51:42,569][123091] Updated weights for policy 0, policy_version 410396 (0.0008) [2023-12-26 02:51:42,616][123090] Updated weights for policy 1, policy_version 407821 (0.0007) [2023-12-26 02:51:42,626][123091] Updated weights for policy 0, policy_version 410406 (0.0007) [2023-12-26 02:51:42,679][123091] Updated weights for policy 0, policy_version 410416 (0.0005) [2023-12-26 02:51:42,686][123090] Updated weights for policy 1, policy_version 407831 (0.0008) [2023-12-26 02:51:43,427][123091] Updated weights for policy 0, policy_version 410426 (0.0010) [2023-12-26 02:51:43,476][123091] Updated weights for policy 0, policy_version 410436 (0.0009) [2023-12-26 02:51:43,532][123091] Updated weights for policy 0, policy_version 410446 (0.0009) [2023-12-26 02:51:43,554][123090] Updated weights for policy 1, policy_version 407841 (0.0009) [2023-12-26 02:51:43,621][123090] Updated weights for policy 1, policy_version 407851 (0.0009) [2023-12-26 02:51:43,676][123090] Updated weights for policy 1, policy_version 407861 (0.0007) [2023-12-26 02:51:43,722][123090] Updated weights for policy 1, policy_version 407871 (0.0005) [2023-12-26 02:51:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 209494016. Throughput: 0: 8957.3, 1: 8768.0. Samples: 209483136. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:43,785][121949] Avg episode reward: [(0, '6088.280'), (1, '5634.801')] [2023-12-26 02:51:44,382][123091] Updated weights for policy 0, policy_version 410456 (0.0010) [2023-12-26 02:51:44,439][123091] Updated weights for policy 0, policy_version 410466 (0.0008) [2023-12-26 02:51:44,502][123091] Updated weights for policy 0, policy_version 410476 (0.0006) [2023-12-26 02:51:44,538][123090] Updated weights for policy 1, policy_version 407881 (0.0008) [2023-12-26 02:51:44,596][123090] Updated weights for policy 1, policy_version 407891 (0.0009) [2023-12-26 02:51:44,657][123090] Updated weights for policy 1, policy_version 407901 (0.0009) [2023-12-26 02:51:45,324][123091] Updated weights for policy 0, policy_version 410486 (0.0009) [2023-12-26 02:51:45,389][123091] Updated weights for policy 0, policy_version 410496 (0.0010) [2023-12-26 02:51:45,452][123091] Updated weights for policy 0, policy_version 410506 (0.0009) [2023-12-26 02:51:45,499][123090] Updated weights for policy 1, policy_version 407911 (0.0009) [2023-12-26 02:51:45,570][123090] Updated weights for policy 1, policy_version 407921 (0.0009) [2023-12-26 02:51:45,631][123090] Updated weights for policy 1, policy_version 407931 (0.0010) [2023-12-26 02:51:46,251][123091] Updated weights for policy 0, policy_version 410516 (0.0006) [2023-12-26 02:51:46,304][123091] Updated weights for policy 0, policy_version 410526 (0.0005) [2023-12-26 02:51:46,362][123091] Updated weights for policy 0, policy_version 410536 (0.0005) [2023-12-26 02:51:46,482][123090] Updated weights for policy 1, policy_version 407941 (0.0009) [2023-12-26 02:51:46,537][123090] Updated weights for policy 1, policy_version 407952 (0.0010) [2023-12-26 02:51:46,592][123090] Updated weights for policy 1, policy_version 407964 (0.0010) [2023-12-26 02:51:47,039][123091] Updated weights for policy 0, policy_version 410546 (0.0005) [2023-12-26 02:51:47,088][123091] Updated weights for policy 0, policy_version 410556 (0.0006) [2023-12-26 02:51:47,136][123091] Updated weights for policy 0, policy_version 410566 (0.0006) [2023-12-26 02:51:47,186][123091] Updated weights for policy 0, policy_version 410576 (0.0005) [2023-12-26 02:51:47,376][123090] Updated weights for policy 1, policy_version 407974 (0.0007) [2023-12-26 02:51:47,434][123090] Updated weights for policy 1, policy_version 407984 (0.0006) [2023-12-26 02:51:47,496][123090] Updated weights for policy 1, policy_version 407994 (0.0006) [2023-12-26 02:51:47,952][123091] Updated weights for policy 0, policy_version 410586 (0.0005) [2023-12-26 02:51:48,002][123091] Updated weights for policy 0, policy_version 410596 (0.0005) [2023-12-26 02:51:48,066][123091] Updated weights for policy 0, policy_version 410606 (0.0009) [2023-12-26 02:51:48,206][123090] Updated weights for policy 1, policy_version 408004 (0.0007) [2023-12-26 02:51:48,254][123090] Updated weights for policy 1, policy_version 408014 (0.0010) [2023-12-26 02:51:48,302][123090] Updated weights for policy 1, policy_version 408024 (0.0010) [2023-12-26 02:51:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 209575936. Throughput: 0: 9029.5, 1: 8697.8. Samples: 209590396. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 02:51:48,785][121949] Avg episode reward: [(0, '6232.664'), (1, '5733.250')] [2023-12-26 02:51:48,894][123091] Updated weights for policy 0, policy_version 410616 (0.0009) [2023-12-26 02:51:48,958][123091] Updated weights for policy 0, policy_version 410626 (0.0009) [2023-12-26 02:51:49,025][123091] Updated weights for policy 0, policy_version 410636 (0.0010) [2023-12-26 02:51:49,114][123090] Updated weights for policy 1, policy_version 408034 (0.0009) [2023-12-26 02:51:49,171][123090] Updated weights for policy 1, policy_version 408044 (0.0008) [2023-12-26 02:51:49,233][123090] Updated weights for policy 1, policy_version 408054 (0.0008) [2023-12-26 02:51:49,308][123090] Updated weights for policy 1, policy_version 408064 (0.0008) [2023-12-26 02:51:49,871][123091] Updated weights for policy 0, policy_version 410646 (0.0010) [2023-12-26 02:51:49,935][123091] Updated weights for policy 0, policy_version 410656 (0.0009) [2023-12-26 02:51:49,997][123091] Updated weights for policy 0, policy_version 410666 (0.0006) [2023-12-26 02:51:50,080][123090] Updated weights for policy 1, policy_version 408074 (0.0009) [2023-12-26 02:51:50,132][123090] Updated weights for policy 1, policy_version 408084 (0.0010) [2023-12-26 02:51:50,195][123090] Updated weights for policy 1, policy_version 408094 (0.0009) [2023-12-26 02:51:50,784][123091] Updated weights for policy 0, policy_version 410676 (0.0008) [2023-12-26 02:51:50,848][123091] Updated weights for policy 0, policy_version 410686 (0.0011) [2023-12-26 02:51:50,915][123091] Updated weights for policy 0, policy_version 410696 (0.0011) [2023-12-26 02:51:51,067][123090] Updated weights for policy 1, policy_version 408104 (0.0009) [2023-12-26 02:51:51,136][123090] Updated weights for policy 1, policy_version 408114 (0.0009) [2023-12-26 02:51:51,200][123090] Updated weights for policy 1, policy_version 408124 (0.0009) [2023-12-26 02:51:51,758][123091] Updated weights for policy 0, policy_version 410706 (0.0011) [2023-12-26 02:51:51,818][123091] Updated weights for policy 0, policy_version 410716 (0.0011) [2023-12-26 02:51:51,877][123091] Updated weights for policy 0, policy_version 410726 (0.0011) [2023-12-26 02:51:51,934][123091] Updated weights for policy 0, policy_version 410736 (0.0010) [2023-12-26 02:51:52,042][123090] Updated weights for policy 1, policy_version 408134 (0.0009) [2023-12-26 02:51:52,100][123090] Updated weights for policy 1, policy_version 408144 (0.0010) [2023-12-26 02:51:52,161][123090] Updated weights for policy 1, policy_version 408154 (0.0009) [2023-12-26 02:51:52,776][123091] Updated weights for policy 0, policy_version 410746 (0.0010) [2023-12-26 02:51:52,844][123091] Updated weights for policy 0, policy_version 410756 (0.0009) [2023-12-26 02:51:52,904][123091] Updated weights for policy 0, policy_version 410766 (0.0009) [2023-12-26 02:51:53,013][123090] Updated weights for policy 1, policy_version 408164 (0.0010) [2023-12-26 02:51:53,066][123090] Updated weights for policy 1, policy_version 408174 (0.0010) [2023-12-26 02:51:53,129][123090] Updated weights for policy 1, policy_version 408184 (0.0009) [2023-12-26 02:51:53,728][123091] Updated weights for policy 0, policy_version 410776 (0.0009) [2023-12-26 02:51:53,784][123091] Updated weights for policy 0, policy_version 410786 (0.0009) [2023-12-26 02:51:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 209657856. Throughput: 0: 8970.5, 1: 8663.5. Samples: 209641308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:51:53,785][121949] Avg episode reward: [(0, '6286.478'), (1, '5941.001')] [2023-12-26 02:51:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000408192_104497152.pth... [2023-12-26 02:51:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000407200_104243200.pth [2023-12-26 02:51:53,837][123091] Updated weights for policy 0, policy_version 410796 (0.0009) [2023-12-26 02:51:53,853][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000410800_105168896.pth... [2023-12-26 02:51:53,858][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000409712_104890368.pth [2023-12-26 02:51:53,966][123090] Updated weights for policy 1, policy_version 408194 (0.0009) [2023-12-26 02:51:54,031][123090] Updated weights for policy 1, policy_version 408204 (0.0008) [2023-12-26 02:51:54,094][123090] Updated weights for policy 1, policy_version 408214 (0.0009) [2023-12-26 02:51:54,148][123090] Updated weights for policy 1, policy_version 408224 (0.0008) [2023-12-26 02:51:54,583][123091] Updated weights for policy 0, policy_version 410806 (0.0007) [2023-12-26 02:51:54,652][123091] Updated weights for policy 0, policy_version 410816 (0.0005) [2023-12-26 02:51:54,723][123091] Updated weights for policy 0, policy_version 410826 (0.0005) [2023-12-26 02:51:55,057][123090] Updated weights for policy 1, policy_version 408234 (0.0009) [2023-12-26 02:51:55,115][123090] Updated weights for policy 1, policy_version 408244 (0.0010) [2023-12-26 02:51:55,176][123090] Updated weights for policy 1, policy_version 408254 (0.0008) [2023-12-26 02:51:55,422][123091] Updated weights for policy 0, policy_version 410836 (0.0007) [2023-12-26 02:51:55,480][123091] Updated weights for policy 0, policy_version 410846 (0.0010) [2023-12-26 02:51:55,528][123091] Updated weights for policy 0, policy_version 410856 (0.0009) [2023-12-26 02:51:56,011][123090] Updated weights for policy 1, policy_version 408264 (0.0010) [2023-12-26 02:51:56,065][123090] Updated weights for policy 1, policy_version 408274 (0.0009) [2023-12-26 02:51:56,121][123090] Updated weights for policy 1, policy_version 408284 (0.0009) [2023-12-26 02:51:56,370][123091] Updated weights for policy 0, policy_version 410866 (0.0009) [2023-12-26 02:51:56,423][123091] Updated weights for policy 0, policy_version 410876 (0.0009) [2023-12-26 02:51:56,472][123091] Updated weights for policy 0, policy_version 410886 (0.0009) [2023-12-26 02:51:56,522][123091] Updated weights for policy 0, policy_version 410896 (0.0009) [2023-12-26 02:51:56,934][123090] Updated weights for policy 1, policy_version 408294 (0.0010) [2023-12-26 02:51:56,979][123090] Updated weights for policy 1, policy_version 408304 (0.0008) [2023-12-26 02:51:57,026][123090] Updated weights for policy 1, policy_version 408314 (0.0008) [2023-12-26 02:51:57,294][123091] Updated weights for policy 0, policy_version 410906 (0.0005) [2023-12-26 02:51:57,362][123091] Updated weights for policy 0, policy_version 410916 (0.0010) [2023-12-26 02:51:57,415][123091] Updated weights for policy 0, policy_version 410926 (0.0009) [2023-12-26 02:51:57,860][123090] Updated weights for policy 1, policy_version 408324 (0.0009) [2023-12-26 02:51:57,914][123090] Updated weights for policy 1, policy_version 408334 (0.0009) [2023-12-26 02:51:57,969][123090] Updated weights for policy 1, policy_version 408344 (0.0009) [2023-12-26 02:51:58,225][123091] Updated weights for policy 0, policy_version 410936 (0.0010) [2023-12-26 02:51:58,291][123091] Updated weights for policy 0, policy_version 410946 (0.0009) [2023-12-26 02:51:58,368][123091] Updated weights for policy 0, policy_version 410956 (0.0009) [2023-12-26 02:51:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 209747968. Throughput: 0: 9008.1, 1: 8677.9. Samples: 209744904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:51:58,785][121949] Avg episode reward: [(0, '6236.942'), (1, '5982.716')] [2023-12-26 02:51:58,831][123090] Updated weights for policy 1, policy_version 408354 (0.0008) [2023-12-26 02:51:58,898][123090] Updated weights for policy 1, policy_version 408364 (0.0005) [2023-12-26 02:51:58,979][123090] Updated weights for policy 1, policy_version 408374 (0.0009) [2023-12-26 02:51:59,047][123090] Updated weights for policy 1, policy_version 408384 (0.0010) [2023-12-26 02:51:59,296][123091] Updated weights for policy 0, policy_version 410966 (0.0009) [2023-12-26 02:51:59,363][123091] Updated weights for policy 0, policy_version 410976 (0.0009) [2023-12-26 02:51:59,429][123091] Updated weights for policy 0, policy_version 410986 (0.0009) [2023-12-26 02:51:59,759][123090] Updated weights for policy 1, policy_version 408394 (0.0005) [2023-12-26 02:51:59,829][123090] Updated weights for policy 1, policy_version 408404 (0.0006) [2023-12-26 02:51:59,902][123090] Updated weights for policy 1, policy_version 408414 (0.0008) [2023-12-26 02:52:00,170][123091] Updated weights for policy 0, policy_version 410996 (0.0007) [2023-12-26 02:52:00,233][123091] Updated weights for policy 0, policy_version 411006 (0.0010) [2023-12-26 02:52:00,292][123091] Updated weights for policy 0, policy_version 411016 (0.0009) [2023-12-26 02:52:00,641][123090] Updated weights for policy 1, policy_version 408424 (0.0008) [2023-12-26 02:52:00,699][123090] Updated weights for policy 1, policy_version 408434 (0.0010) [2023-12-26 02:52:00,754][123090] Updated weights for policy 1, policy_version 408444 (0.0008) [2023-12-26 02:52:01,136][123091] Updated weights for policy 0, policy_version 411026 (0.0009) [2023-12-26 02:52:01,196][123091] Updated weights for policy 0, policy_version 411036 (0.0009) [2023-12-26 02:52:01,258][123091] Updated weights for policy 0, policy_version 411046 (0.0009) [2023-12-26 02:52:01,309][123091] Updated weights for policy 0, policy_version 411056 (0.0009) [2023-12-26 02:52:01,542][123090] Updated weights for policy 1, policy_version 408454 (0.0007) [2023-12-26 02:52:01,602][123090] Updated weights for policy 1, policy_version 408464 (0.0007) [2023-12-26 02:52:01,678][123090] Updated weights for policy 1, policy_version 408475 (0.0009) [2023-12-26 02:52:02,074][123091] Updated weights for policy 0, policy_version 411066 (0.0005) [2023-12-26 02:52:02,142][123091] Updated weights for policy 0, policy_version 411076 (0.0006) [2023-12-26 02:52:02,204][123091] Updated weights for policy 0, policy_version 411086 (0.0005) [2023-12-26 02:52:02,382][123090] Updated weights for policy 1, policy_version 408485 (0.0009) [2023-12-26 02:52:02,434][123090] Updated weights for policy 1, policy_version 408495 (0.0009) [2023-12-26 02:52:02,490][123090] Updated weights for policy 1, policy_version 408505 (0.0009) [2023-12-26 02:52:02,908][123091] Updated weights for policy 0, policy_version 411096 (0.0010) [2023-12-26 02:52:02,962][123091] Updated weights for policy 0, policy_version 411106 (0.0009) [2023-12-26 02:52:03,017][123091] Updated weights for policy 0, policy_version 411116 (0.0010) [2023-12-26 02:52:03,343][123090] Updated weights for policy 1, policy_version 408515 (0.0009) [2023-12-26 02:52:03,405][123090] Updated weights for policy 1, policy_version 408525 (0.0010) [2023-12-26 02:52:03,466][123090] Updated weights for policy 1, policy_version 408535 (0.0010) [2023-12-26 02:52:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 209838080. Throughput: 0: 9051.9, 1: 8613.1. Samples: 209850640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:03,784][121949] Avg episode reward: [(0, '6156.147'), (1, '5914.654')] [2023-12-26 02:52:03,796][123091] Updated weights for policy 0, policy_version 411126 (0.0010) [2023-12-26 02:52:03,876][123091] Updated weights for policy 0, policy_version 411136 (0.0009) [2023-12-26 02:52:03,936][123091] Updated weights for policy 0, policy_version 411146 (0.0009) [2023-12-26 02:52:04,327][123090] Updated weights for policy 1, policy_version 408545 (0.0009) [2023-12-26 02:52:04,394][123090] Updated weights for policy 1, policy_version 408555 (0.0009) [2023-12-26 02:52:04,458][123090] Updated weights for policy 1, policy_version 408565 (0.0009) [2023-12-26 02:52:04,523][123090] Updated weights for policy 1, policy_version 408575 (0.0009) [2023-12-26 02:52:04,763][123091] Updated weights for policy 0, policy_version 411156 (0.0010) [2023-12-26 02:52:04,821][123091] Updated weights for policy 0, policy_version 411166 (0.0010) [2023-12-26 02:52:04,868][123091] Updated weights for policy 0, policy_version 411176 (0.0010) [2023-12-26 02:52:05,324][123090] Updated weights for policy 1, policy_version 408585 (0.0009) [2023-12-26 02:52:05,384][123090] Updated weights for policy 1, policy_version 408595 (0.0010) [2023-12-26 02:52:05,441][123090] Updated weights for policy 1, policy_version 408605 (0.0009) [2023-12-26 02:52:05,542][123091] Updated weights for policy 0, policy_version 411186 (0.0010) [2023-12-26 02:52:05,610][123091] Updated weights for policy 0, policy_version 411196 (0.0006) [2023-12-26 02:52:05,668][123091] Updated weights for policy 0, policy_version 411206 (0.0006) [2023-12-26 02:52:05,716][123091] Updated weights for policy 0, policy_version 411216 (0.0007) [2023-12-26 02:52:06,151][123090] Updated weights for policy 1, policy_version 408615 (0.0010) [2023-12-26 02:52:06,214][123090] Updated weights for policy 1, policy_version 408625 (0.0011) [2023-12-26 02:52:06,282][123090] Updated weights for policy 1, policy_version 408635 (0.0011) [2023-12-26 02:52:06,456][123091] Updated weights for policy 0, policy_version 411226 (0.0011) [2023-12-26 02:52:06,516][123091] Updated weights for policy 0, policy_version 411236 (0.0011) [2023-12-26 02:52:06,590][123091] Updated weights for policy 0, policy_version 411246 (0.0011) [2023-12-26 02:52:07,028][123090] Updated weights for policy 1, policy_version 408645 (0.0008) [2023-12-26 02:52:07,084][123090] Updated weights for policy 1, policy_version 408655 (0.0006) [2023-12-26 02:52:07,134][123090] Updated weights for policy 1, policy_version 408665 (0.0005) [2023-12-26 02:52:07,416][123091] Updated weights for policy 0, policy_version 411256 (0.0011) [2023-12-26 02:52:07,472][123091] Updated weights for policy 0, policy_version 411266 (0.0011) [2023-12-26 02:52:07,524][123091] Updated weights for policy 0, policy_version 411276 (0.0011) [2023-12-26 02:52:07,895][123090] Updated weights for policy 1, policy_version 408675 (0.0009) [2023-12-26 02:52:07,946][123090] Updated weights for policy 1, policy_version 408685 (0.0008) [2023-12-26 02:52:07,995][123090] Updated weights for policy 1, policy_version 408695 (0.0009) [2023-12-26 02:52:08,364][123091] Updated weights for policy 0, policy_version 411286 (0.0010) [2023-12-26 02:52:08,425][123091] Updated weights for policy 0, policy_version 411296 (0.0010) [2023-12-26 02:52:08,486][123091] Updated weights for policy 0, policy_version 411306 (0.0010) [2023-12-26 02:52:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 209928192. Throughput: 0: 9074.5, 1: 8653.0. Samples: 209904944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:08,785][121949] Avg episode reward: [(0, '6091.021'), (1, '5788.414')] [2023-12-26 02:52:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000411312_105299968.pth... [2023-12-26 02:52:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000408704_104628224.pth... [2023-12-26 02:52:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000410288_105037824.pth [2023-12-26 02:52:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000407712_104374272.pth [2023-12-26 02:52:08,881][123090] Updated weights for policy 1, policy_version 408705 (0.0009) [2023-12-26 02:52:08,930][123090] Updated weights for policy 1, policy_version 408715 (0.0009) [2023-12-26 02:52:08,984][123090] Updated weights for policy 1, policy_version 408725 (0.0010) [2023-12-26 02:52:09,039][123090] Updated weights for policy 1, policy_version 408736 (0.0010) [2023-12-26 02:52:09,273][123091] Updated weights for policy 0, policy_version 411316 (0.0010) [2023-12-26 02:52:09,336][123091] Updated weights for policy 0, policy_version 411326 (0.0007) [2023-12-26 02:52:09,408][123091] Updated weights for policy 0, policy_version 411336 (0.0008) [2023-12-26 02:52:09,919][123090] Updated weights for policy 1, policy_version 408746 (0.0010) [2023-12-26 02:52:09,985][123090] Updated weights for policy 1, policy_version 408756 (0.0011) [2023-12-26 02:52:10,053][123090] Updated weights for policy 1, policy_version 408766 (0.0010) [2023-12-26 02:52:10,221][123091] Updated weights for policy 0, policy_version 411346 (0.0008) [2023-12-26 02:52:10,284][123091] Updated weights for policy 0, policy_version 411356 (0.0006) [2023-12-26 02:52:10,338][123091] Updated weights for policy 0, policy_version 411366 (0.0006) [2023-12-26 02:52:10,396][123091] Updated weights for policy 0, policy_version 411376 (0.0009) [2023-12-26 02:52:10,870][123090] Updated weights for policy 1, policy_version 408776 (0.0006) [2023-12-26 02:52:10,930][123090] Updated weights for policy 1, policy_version 408786 (0.0007) [2023-12-26 02:52:10,994][123090] Updated weights for policy 1, policy_version 408796 (0.0009) [2023-12-26 02:52:11,219][123091] Updated weights for policy 0, policy_version 411386 (0.0010) [2023-12-26 02:52:11,291][123091] Updated weights for policy 0, policy_version 411396 (0.0006) [2023-12-26 02:52:11,363][123091] Updated weights for policy 0, policy_version 411406 (0.0006) [2023-12-26 02:52:11,880][123090] Updated weights for policy 1, policy_version 408806 (0.0009) [2023-12-26 02:52:11,947][123090] Updated weights for policy 1, policy_version 408816 (0.0010) [2023-12-26 02:52:12,014][123090] Updated weights for policy 1, policy_version 408826 (0.0009) [2023-12-26 02:52:12,092][123091] Updated weights for policy 0, policy_version 411416 (0.0006) [2023-12-26 02:52:12,158][123091] Updated weights for policy 0, policy_version 411426 (0.0008) [2023-12-26 02:52:12,220][123091] Updated weights for policy 0, policy_version 411436 (0.0010) [2023-12-26 02:52:12,882][123090] Updated weights for policy 1, policy_version 408836 (0.0008) [2023-12-26 02:52:12,948][123090] Updated weights for policy 1, policy_version 408846 (0.0005) [2023-12-26 02:52:13,003][123090] Updated weights for policy 1, policy_version 408856 (0.0005) [2023-12-26 02:52:13,038][123091] Updated weights for policy 0, policy_version 411446 (0.0009) [2023-12-26 02:52:13,090][123091] Updated weights for policy 0, policy_version 411456 (0.0009) [2023-12-26 02:52:13,146][123091] Updated weights for policy 0, policy_version 411467 (0.0008) [2023-12-26 02:52:13,633][123090] Updated weights for policy 1, policy_version 408866 (0.0006) [2023-12-26 02:52:13,694][123090] Updated weights for policy 1, policy_version 408876 (0.0011) [2023-12-26 02:52:13,757][123090] Updated weights for policy 1, policy_version 408886 (0.0010) [2023-12-26 02:52:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 210010112. Throughput: 0: 9005.6, 1: 8622.4. Samples: 210008104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:13,784][121949] Avg episode reward: [(0, '6233.063'), (1, '5756.471')] [2023-12-26 02:52:13,824][123090] Updated weights for policy 1, policy_version 408896 (0.0011) [2023-12-26 02:52:14,042][123091] Updated weights for policy 0, policy_version 411477 (0.0009) [2023-12-26 02:52:14,090][123091] Updated weights for policy 0, policy_version 411487 (0.0009) [2023-12-26 02:52:14,142][123091] Updated weights for policy 0, policy_version 411497 (0.0009) [2023-12-26 02:52:14,666][123090] Updated weights for policy 1, policy_version 408906 (0.0010) [2023-12-26 02:52:14,722][123090] Updated weights for policy 1, policy_version 408916 (0.0010) [2023-12-26 02:52:14,791][123090] Updated weights for policy 1, policy_version 408926 (0.0009) [2023-12-26 02:52:14,914][123091] Updated weights for policy 0, policy_version 411507 (0.0008) [2023-12-26 02:52:14,977][123091] Updated weights for policy 0, policy_version 411517 (0.0005) [2023-12-26 02:52:15,042][123091] Updated weights for policy 0, policy_version 411527 (0.0009) [2023-12-26 02:52:15,597][123090] Updated weights for policy 1, policy_version 408936 (0.0010) [2023-12-26 02:52:15,658][123090] Updated weights for policy 1, policy_version 408946 (0.0011) [2023-12-26 02:52:15,715][123090] Updated weights for policy 1, policy_version 408956 (0.0011) [2023-12-26 02:52:15,857][123091] Updated weights for policy 0, policy_version 411537 (0.0009) [2023-12-26 02:52:15,904][123091] Updated weights for policy 0, policy_version 411547 (0.0007) [2023-12-26 02:52:15,956][123091] Updated weights for policy 0, policy_version 411557 (0.0005) [2023-12-26 02:52:16,015][123091] Updated weights for policy 0, policy_version 411567 (0.0005) [2023-12-26 02:52:16,532][123090] Updated weights for policy 1, policy_version 408966 (0.0008) [2023-12-26 02:52:16,585][123090] Updated weights for policy 1, policy_version 408976 (0.0005) [2023-12-26 02:52:16,632][123090] Updated weights for policy 1, policy_version 408986 (0.0005) [2023-12-26 02:52:16,711][123091] Updated weights for policy 0, policy_version 411577 (0.0006) [2023-12-26 02:52:16,775][123091] Updated weights for policy 0, policy_version 411587 (0.0007) [2023-12-26 02:52:16,829][123091] Updated weights for policy 0, policy_version 411597 (0.0010) [2023-12-26 02:52:17,308][123090] Updated weights for policy 1, policy_version 408996 (0.0005) [2023-12-26 02:52:17,374][123090] Updated weights for policy 1, policy_version 409006 (0.0006) [2023-12-26 02:52:17,432][123090] Updated weights for policy 1, policy_version 409016 (0.0005) [2023-12-26 02:52:17,515][123091] Updated weights for policy 0, policy_version 411608 (0.0006) [2023-12-26 02:52:17,573][123091] Updated weights for policy 0, policy_version 411618 (0.0005) [2023-12-26 02:52:17,638][123091] Updated weights for policy 0, policy_version 411628 (0.0009) [2023-12-26 02:52:18,079][123090] Updated weights for policy 1, policy_version 409026 (0.0005) [2023-12-26 02:52:18,145][123090] Updated weights for policy 1, policy_version 409036 (0.0005) [2023-12-26 02:52:18,203][123090] Updated weights for policy 1, policy_version 409046 (0.0005) [2023-12-26 02:52:18,257][123090] Updated weights for policy 1, policy_version 409056 (0.0007) [2023-12-26 02:52:18,348][123091] Updated weights for policy 0, policy_version 411638 (0.0009) [2023-12-26 02:52:18,409][123091] Updated weights for policy 0, policy_version 411648 (0.0008) [2023-12-26 02:52:18,462][123091] Updated weights for policy 0, policy_version 411658 (0.0009) [2023-12-26 02:52:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 210108416. Throughput: 0: 8949.2, 1: 8740.7. Samples: 210119724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:18,785][121949] Avg episode reward: [(0, '6302.616'), (1, '5984.916')] [2023-12-26 02:52:18,952][123090] Updated weights for policy 1, policy_version 409066 (0.0009) [2023-12-26 02:52:19,004][123090] Updated weights for policy 1, policy_version 409076 (0.0009) [2023-12-26 02:52:19,060][123090] Updated weights for policy 1, policy_version 409086 (0.0009) [2023-12-26 02:52:19,292][123091] Updated weights for policy 0, policy_version 411668 (0.0010) [2023-12-26 02:52:19,353][123091] Updated weights for policy 0, policy_version 411678 (0.0010) [2023-12-26 02:52:19,423][123091] Updated weights for policy 0, policy_version 411688 (0.0009) [2023-12-26 02:52:20,035][123090] Updated weights for policy 1, policy_version 409096 (0.0010) [2023-12-26 02:52:20,103][123090] Updated weights for policy 1, policy_version 409106 (0.0010) [2023-12-26 02:52:20,166][123090] Updated weights for policy 1, policy_version 409116 (0.0009) [2023-12-26 02:52:20,243][123091] Updated weights for policy 0, policy_version 411698 (0.0008) [2023-12-26 02:52:20,313][123091] Updated weights for policy 0, policy_version 411708 (0.0005) [2023-12-26 02:52:20,376][123091] Updated weights for policy 0, policy_version 411718 (0.0006) [2023-12-26 02:52:20,431][123091] Updated weights for policy 0, policy_version 411728 (0.0009) [2023-12-26 02:52:21,033][123090] Updated weights for policy 1, policy_version 409126 (0.0010) [2023-12-26 02:52:21,098][123090] Updated weights for policy 1, policy_version 409136 (0.0011) [2023-12-26 02:52:21,161][123090] Updated weights for policy 1, policy_version 409146 (0.0010) [2023-12-26 02:52:21,264][123091] Updated weights for policy 0, policy_version 411738 (0.0008) [2023-12-26 02:52:21,337][123091] Updated weights for policy 0, policy_version 411748 (0.0009) [2023-12-26 02:52:21,403][123091] Updated weights for policy 0, policy_version 411758 (0.0009) [2023-12-26 02:52:22,021][123090] Updated weights for policy 1, policy_version 409156 (0.0011) [2023-12-26 02:52:22,092][123090] Updated weights for policy 1, policy_version 409166 (0.0009) [2023-12-26 02:52:22,149][123090] Updated weights for policy 1, policy_version 409176 (0.0009) [2023-12-26 02:52:22,239][123091] Updated weights for policy 0, policy_version 411768 (0.0010) [2023-12-26 02:52:22,292][123091] Updated weights for policy 0, policy_version 411778 (0.0009) [2023-12-26 02:52:22,341][123091] Updated weights for policy 0, policy_version 411788 (0.0008) [2023-12-26 02:52:22,997][123090] Updated weights for policy 1, policy_version 409186 (0.0010) [2023-12-26 02:52:23,052][123090] Updated weights for policy 1, policy_version 409197 (0.0010) [2023-12-26 02:52:23,106][123090] Updated weights for policy 1, policy_version 409207 (0.0009) [2023-12-26 02:52:23,132][123091] Updated weights for policy 0, policy_version 411798 (0.0008) [2023-12-26 02:52:23,190][123091] Updated weights for policy 0, policy_version 411808 (0.0008) [2023-12-26 02:52:23,256][123091] Updated weights for policy 0, policy_version 411818 (0.0010) [2023-12-26 02:52:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 210190336. Throughput: 0: 8853.4, 1: 8710.9. Samples: 210169664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:23,784][121949] Avg episode reward: [(0, '6283.755'), (1, '6017.858')] [2023-12-26 02:52:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000411824_105431040.pth... [2023-12-26 02:52:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000409216_104759296.pth... [2023-12-26 02:52:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000410800_105168896.pth [2023-12-26 02:52:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000408192_104497152.pth [2023-12-26 02:52:23,998][123090] Updated weights for policy 1, policy_version 409217 (0.0007) [2023-12-26 02:52:24,013][123091] Updated weights for policy 0, policy_version 411828 (0.0009) [2023-12-26 02:52:24,059][123090] Updated weights for policy 1, policy_version 409227 (0.0008) [2023-12-26 02:52:24,066][123091] Updated weights for policy 0, policy_version 411838 (0.0008) [2023-12-26 02:52:24,119][123090] Updated weights for policy 1, policy_version 409237 (0.0006) [2023-12-26 02:52:24,128][123091] Updated weights for policy 0, policy_version 411848 (0.0008) [2023-12-26 02:52:24,188][123090] Updated weights for policy 1, policy_version 409247 (0.0008) [2023-12-26 02:52:24,870][123091] Updated weights for policy 0, policy_version 411858 (0.0007) [2023-12-26 02:52:24,910][123090] Updated weights for policy 1, policy_version 409257 (0.0007) [2023-12-26 02:52:24,932][123091] Updated weights for policy 0, policy_version 411868 (0.0007) [2023-12-26 02:52:24,970][123090] Updated weights for policy 1, policy_version 409267 (0.0007) [2023-12-26 02:52:24,998][123091] Updated weights for policy 0, policy_version 411878 (0.0009) [2023-12-26 02:52:25,028][123090] Updated weights for policy 1, policy_version 409277 (0.0007) [2023-12-26 02:52:25,059][123091] Updated weights for policy 0, policy_version 411888 (0.0010) [2023-12-26 02:52:25,642][123090] Updated weights for policy 1, policy_version 409287 (0.0006) [2023-12-26 02:52:25,704][123090] Updated weights for policy 1, policy_version 409297 (0.0005) [2023-12-26 02:52:25,757][123090] Updated weights for policy 1, policy_version 409307 (0.0005) [2023-12-26 02:52:25,809][123091] Updated weights for policy 0, policy_version 411898 (0.0010) [2023-12-26 02:52:25,864][123091] Updated weights for policy 0, policy_version 411908 (0.0010) [2023-12-26 02:52:25,934][123091] Updated weights for policy 0, policy_version 411918 (0.0011) [2023-12-26 02:52:26,434][123090] Updated weights for policy 1, policy_version 409317 (0.0008) [2023-12-26 02:52:26,497][123090] Updated weights for policy 1, policy_version 409327 (0.0010) [2023-12-26 02:52:26,560][123090] Updated weights for policy 1, policy_version 409337 (0.0011) [2023-12-26 02:52:26,645][123091] Updated weights for policy 0, policy_version 411928 (0.0009) [2023-12-26 02:52:26,696][123091] Updated weights for policy 0, policy_version 411938 (0.0010) [2023-12-26 02:52:26,743][123091] Updated weights for policy 0, policy_version 411948 (0.0010) [2023-12-26 02:52:27,338][123090] Updated weights for policy 1, policy_version 409347 (0.0009) [2023-12-26 02:52:27,401][123090] Updated weights for policy 1, policy_version 409357 (0.0005) [2023-12-26 02:52:27,456][123090] Updated weights for policy 1, policy_version 409367 (0.0005) [2023-12-26 02:52:27,479][123091] Updated weights for policy 0, policy_version 411958 (0.0011) [2023-12-26 02:52:27,530][123091] Updated weights for policy 0, policy_version 411968 (0.0010) [2023-12-26 02:52:27,577][123091] Updated weights for policy 0, policy_version 411978 (0.0010) [2023-12-26 02:52:28,133][123090] Updated weights for policy 1, policy_version 409377 (0.0005) [2023-12-26 02:52:28,180][123090] Updated weights for policy 1, policy_version 409387 (0.0005) [2023-12-26 02:52:28,224][123090] Updated weights for policy 1, policy_version 409397 (0.0005) [2023-12-26 02:52:28,279][123090] Updated weights for policy 1, policy_version 409407 (0.0005) [2023-12-26 02:52:28,452][123091] Updated weights for policy 0, policy_version 411988 (0.0010) [2023-12-26 02:52:28,503][123091] Updated weights for policy 0, policy_version 411998 (0.0010) [2023-12-26 02:52:28,565][123091] Updated weights for policy 0, policy_version 412008 (0.0010) [2023-12-26 02:52:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 210288640. Throughput: 0: 8944.8, 1: 8772.7. Samples: 210280428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:28,785][121949] Avg episode reward: [(0, '6149.533'), (1, '6046.928')] [2023-12-26 02:52:29,054][123090] Updated weights for policy 1, policy_version 409417 (0.0010) [2023-12-26 02:52:29,102][123090] Updated weights for policy 1, policy_version 409427 (0.0010) [2023-12-26 02:52:29,156][123090] Updated weights for policy 1, policy_version 409437 (0.0010) [2023-12-26 02:52:29,391][123091] Updated weights for policy 0, policy_version 412018 (0.0010) [2023-12-26 02:52:29,451][123091] Updated weights for policy 0, policy_version 412028 (0.0009) [2023-12-26 02:52:29,504][123091] Updated weights for policy 0, policy_version 412038 (0.0009) [2023-12-26 02:52:29,552][123091] Updated weights for policy 0, policy_version 412048 (0.0009) [2023-12-26 02:52:30,043][123090] Updated weights for policy 1, policy_version 409447 (0.0010) [2023-12-26 02:52:30,110][123090] Updated weights for policy 1, policy_version 409457 (0.0005) [2023-12-26 02:52:30,173][123090] Updated weights for policy 1, policy_version 409467 (0.0008) [2023-12-26 02:52:30,382][123091] Updated weights for policy 0, policy_version 412058 (0.0009) [2023-12-26 02:52:30,429][123091] Updated weights for policy 0, policy_version 412068 (0.0009) [2023-12-26 02:52:30,477][123091] Updated weights for policy 0, policy_version 412078 (0.0009) [2023-12-26 02:52:30,964][123090] Updated weights for policy 1, policy_version 409477 (0.0010) [2023-12-26 02:52:31,016][123090] Updated weights for policy 1, policy_version 409487 (0.0010) [2023-12-26 02:52:31,079][123090] Updated weights for policy 1, policy_version 409497 (0.0011) [2023-12-26 02:52:31,320][123091] Updated weights for policy 0, policy_version 412088 (0.0009) [2023-12-26 02:52:31,382][123091] Updated weights for policy 0, policy_version 412098 (0.0008) [2023-12-26 02:52:31,441][123091] Updated weights for policy 0, policy_version 412108 (0.0009) [2023-12-26 02:52:31,921][123090] Updated weights for policy 1, policy_version 409507 (0.0011) [2023-12-26 02:52:31,981][123090] Updated weights for policy 1, policy_version 409517 (0.0010) [2023-12-26 02:52:32,029][123090] Updated weights for policy 1, policy_version 409527 (0.0010) [2023-12-26 02:52:32,260][123091] Updated weights for policy 0, policy_version 412118 (0.0009) [2023-12-26 02:52:32,327][123091] Updated weights for policy 0, policy_version 412128 (0.0008) [2023-12-26 02:52:32,392][123091] Updated weights for policy 0, policy_version 412138 (0.0010) [2023-12-26 02:52:32,772][123090] Updated weights for policy 1, policy_version 409537 (0.0010) [2023-12-26 02:52:32,832][123090] Updated weights for policy 1, policy_version 409547 (0.0006) [2023-12-26 02:52:32,891][123090] Updated weights for policy 1, policy_version 409557 (0.0005) [2023-12-26 02:52:32,950][123090] Updated weights for policy 1, policy_version 409567 (0.0006) [2023-12-26 02:52:33,303][123091] Updated weights for policy 0, policy_version 412148 (0.0008) [2023-12-26 02:52:33,362][123091] Updated weights for policy 0, policy_version 412158 (0.0005) [2023-12-26 02:52:33,406][123091] Updated weights for policy 0, policy_version 412168 (0.0005) [2023-12-26 02:52:33,531][123090] Updated weights for policy 1, policy_version 409577 (0.0005) [2023-12-26 02:52:33,587][123090] Updated weights for policy 1, policy_version 409587 (0.0005) [2023-12-26 02:52:33,635][123090] Updated weights for policy 1, policy_version 409597 (0.0005) [2023-12-26 02:52:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 210378752. Throughput: 0: 8856.8, 1: 8851.7. Samples: 210387280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:33,785][121949] Avg episode reward: [(0, '6132.746'), (1, '5994.822')] [2023-12-26 02:52:34,052][123091] Updated weights for policy 0, policy_version 412178 (0.0006) [2023-12-26 02:52:34,102][123091] Updated weights for policy 0, policy_version 412188 (0.0008) [2023-12-26 02:52:34,160][123091] Updated weights for policy 0, policy_version 412198 (0.0010) [2023-12-26 02:52:34,223][123090] Updated weights for policy 1, policy_version 409607 (0.0008) [2023-12-26 02:52:34,223][123091] Updated weights for policy 0, policy_version 412208 (0.0009) [2023-12-26 02:52:34,280][123090] Updated weights for policy 1, policy_version 409617 (0.0009) [2023-12-26 02:52:34,341][123090] Updated weights for policy 1, policy_version 409627 (0.0009) [2023-12-26 02:52:35,076][123091] Updated weights for policy 0, policy_version 412218 (0.0010) [2023-12-26 02:52:35,136][123091] Updated weights for policy 0, policy_version 412228 (0.0008) [2023-12-26 02:52:35,193][123091] Updated weights for policy 0, policy_version 412238 (0.0009) [2023-12-26 02:52:35,220][123090] Updated weights for policy 1, policy_version 409637 (0.0009) [2023-12-26 02:52:35,277][123090] Updated weights for policy 1, policy_version 409647 (0.0009) [2023-12-26 02:52:35,342][123090] Updated weights for policy 1, policy_version 409657 (0.0009) [2023-12-26 02:52:35,975][123091] Updated weights for policy 0, policy_version 412248 (0.0006) [2023-12-26 02:52:36,033][123091] Updated weights for policy 0, policy_version 412258 (0.0005) [2023-12-26 02:52:36,081][123091] Updated weights for policy 0, policy_version 412268 (0.0006) [2023-12-26 02:52:36,215][123090] Updated weights for policy 1, policy_version 409667 (0.0009) [2023-12-26 02:52:36,268][123090] Updated weights for policy 1, policy_version 409677 (0.0009) [2023-12-26 02:52:36,327][123090] Updated weights for policy 1, policy_version 409687 (0.0010) [2023-12-26 02:52:36,726][123091] Updated weights for policy 0, policy_version 412278 (0.0006) [2023-12-26 02:52:36,794][123091] Updated weights for policy 0, policy_version 412288 (0.0006) [2023-12-26 02:52:36,849][123091] Updated weights for policy 0, policy_version 412298 (0.0006) [2023-12-26 02:52:37,265][123090] Updated weights for policy 1, policy_version 409697 (0.0010) [2023-12-26 02:52:37,328][123090] Updated weights for policy 1, policy_version 409707 (0.0010) [2023-12-26 02:52:37,399][123090] Updated weights for policy 1, policy_version 409717 (0.0009) [2023-12-26 02:52:37,465][123090] Updated weights for policy 1, policy_version 409727 (0.0010) [2023-12-26 02:52:37,650][123091] Updated weights for policy 0, policy_version 412308 (0.0008) [2023-12-26 02:52:37,711][123091] Updated weights for policy 0, policy_version 412318 (0.0009) [2023-12-26 02:52:37,775][123091] Updated weights for policy 0, policy_version 412328 (0.0011) [2023-12-26 02:52:38,316][123090] Updated weights for policy 1, policy_version 409737 (0.0009) [2023-12-26 02:52:38,386][123090] Updated weights for policy 1, policy_version 409747 (0.0008) [2023-12-26 02:52:38,447][123090] Updated weights for policy 1, policy_version 409757 (0.0009) [2023-12-26 02:52:38,602][123091] Updated weights for policy 0, policy_version 412338 (0.0011) [2023-12-26 02:52:38,665][123091] Updated weights for policy 0, policy_version 412348 (0.0011) [2023-12-26 02:52:38,723][123091] Updated weights for policy 0, policy_version 412358 (0.0011) [2023-12-26 02:52:38,782][123091] Updated weights for policy 0, policy_version 412368 (0.0011) [2023-12-26 02:52:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 210468864. Throughput: 0: 8905.5, 1: 8863.9. Samples: 210440932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:38,785][121949] Avg episode reward: [(0, '6043.008'), (1, '6033.843')] [2023-12-26 02:52:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000412368_105570304.pth... [2023-12-26 02:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000409760_104898560.pth... [2023-12-26 02:52:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000408704_104628224.pth [2023-12-26 02:52:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000411312_105299968.pth [2023-12-26 02:52:39,311][123090] Updated weights for policy 1, policy_version 409767 (0.0009) [2023-12-26 02:52:39,380][123090] Updated weights for policy 1, policy_version 409777 (0.0009) [2023-12-26 02:52:39,446][123090] Updated weights for policy 1, policy_version 409787 (0.0010) [2023-12-26 02:52:39,624][123091] Updated weights for policy 0, policy_version 412378 (0.0008) [2023-12-26 02:52:39,673][123091] Updated weights for policy 0, policy_version 412388 (0.0009) [2023-12-26 02:52:39,730][123091] Updated weights for policy 0, policy_version 412398 (0.0009) [2023-12-26 02:52:40,246][123090] Updated weights for policy 1, policy_version 409797 (0.0007) [2023-12-26 02:52:40,324][123090] Updated weights for policy 1, policy_version 409807 (0.0005) [2023-12-26 02:52:40,403][123090] Updated weights for policy 1, policy_version 409817 (0.0006) [2023-12-26 02:52:40,472][123091] Updated weights for policy 0, policy_version 412408 (0.0008) [2023-12-26 02:52:40,543][123091] Updated weights for policy 0, policy_version 412418 (0.0008) [2023-12-26 02:52:40,608][123091] Updated weights for policy 0, policy_version 412428 (0.0009) [2023-12-26 02:52:41,187][123090] Updated weights for policy 1, policy_version 409827 (0.0010) [2023-12-26 02:52:41,255][123090] Updated weights for policy 1, policy_version 409837 (0.0011) [2023-12-26 02:52:41,324][123090] Updated weights for policy 1, policy_version 409847 (0.0011) [2023-12-26 02:52:41,446][123091] Updated weights for policy 0, policy_version 412438 (0.0009) [2023-12-26 02:52:41,506][123091] Updated weights for policy 0, policy_version 412448 (0.0008) [2023-12-26 02:52:41,564][123091] Updated weights for policy 0, policy_version 412458 (0.0009) [2023-12-26 02:52:42,126][123090] Updated weights for policy 1, policy_version 409857 (0.0010) [2023-12-26 02:52:42,187][123090] Updated weights for policy 1, policy_version 409867 (0.0005) [2023-12-26 02:52:42,243][123090] Updated weights for policy 1, policy_version 409877 (0.0005) [2023-12-26 02:52:42,315][123090] Updated weights for policy 1, policy_version 409887 (0.0007) [2023-12-26 02:52:42,414][123091] Updated weights for policy 0, policy_version 412468 (0.0009) [2023-12-26 02:52:42,472][123091] Updated weights for policy 0, policy_version 412478 (0.0009) [2023-12-26 02:52:42,524][123091] Updated weights for policy 0, policy_version 412488 (0.0009) [2023-12-26 02:52:42,986][123090] Updated weights for policy 1, policy_version 409897 (0.0010) [2023-12-26 02:52:43,045][123090] Updated weights for policy 1, policy_version 409907 (0.0008) [2023-12-26 02:52:43,118][123090] Updated weights for policy 1, policy_version 409917 (0.0007) [2023-12-26 02:52:43,307][123091] Updated weights for policy 0, policy_version 412498 (0.0008) [2023-12-26 02:52:43,376][123091] Updated weights for policy 0, policy_version 412508 (0.0005) [2023-12-26 02:52:43,450][123091] Updated weights for policy 0, policy_version 412518 (0.0005) [2023-12-26 02:52:43,524][123091] Updated weights for policy 0, policy_version 412528 (0.0009) [2023-12-26 02:52:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 210550784. Throughput: 0: 8868.1, 1: 8883.0. Samples: 210543700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:43,784][121949] Avg episode reward: [(0, '6046.735'), (1, '5995.949')] [2023-12-26 02:52:43,870][123090] Updated weights for policy 1, policy_version 409927 (0.0007) [2023-12-26 02:52:43,933][123090] Updated weights for policy 1, policy_version 409937 (0.0006) [2023-12-26 02:52:44,004][123090] Updated weights for policy 1, policy_version 409947 (0.0005) [2023-12-26 02:52:44,320][123091] Updated weights for policy 0, policy_version 412538 (0.0009) [2023-12-26 02:52:44,379][123091] Updated weights for policy 0, policy_version 412548 (0.0009) [2023-12-26 02:52:44,433][123091] Updated weights for policy 0, policy_version 412558 (0.0008) [2023-12-26 02:52:44,738][123090] Updated weights for policy 1, policy_version 409957 (0.0007) [2023-12-26 02:52:44,799][123090] Updated weights for policy 1, policy_version 409967 (0.0009) [2023-12-26 02:52:44,868][123090] Updated weights for policy 1, policy_version 409978 (0.0009) [2023-12-26 02:52:45,267][123091] Updated weights for policy 0, policy_version 412568 (0.0010) [2023-12-26 02:52:45,332][123091] Updated weights for policy 0, policy_version 412578 (0.0010) [2023-12-26 02:52:45,401][123091] Updated weights for policy 0, policy_version 412588 (0.0010) [2023-12-26 02:52:45,759][123090] Updated weights for policy 1, policy_version 409988 (0.0010) [2023-12-26 02:52:45,808][123090] Updated weights for policy 1, policy_version 409998 (0.0009) [2023-12-26 02:52:45,861][123090] Updated weights for policy 1, policy_version 410008 (0.0009) [2023-12-26 02:52:46,281][123091] Updated weights for policy 0, policy_version 412598 (0.0010) [2023-12-26 02:52:46,335][123091] Updated weights for policy 0, policy_version 412608 (0.0006) [2023-12-26 02:52:46,388][123091] Updated weights for policy 0, policy_version 412618 (0.0006) [2023-12-26 02:52:46,705][123090] Updated weights for policy 1, policy_version 410018 (0.0010) [2023-12-26 02:52:46,771][123090] Updated weights for policy 1, policy_version 410028 (0.0010) [2023-12-26 02:52:46,833][123090] Updated weights for policy 1, policy_version 410038 (0.0009) [2023-12-26 02:52:46,894][123090] Updated weights for policy 1, policy_version 410048 (0.0009) [2023-12-26 02:52:47,217][123091] Updated weights for policy 0, policy_version 412628 (0.0009) [2023-12-26 02:52:47,275][123091] Updated weights for policy 0, policy_version 412638 (0.0009) [2023-12-26 02:52:47,331][123091] Updated weights for policy 0, policy_version 412650 (0.0010) [2023-12-26 02:52:47,726][123090] Updated weights for policy 1, policy_version 410058 (0.0010) [2023-12-26 02:52:47,788][123090] Updated weights for policy 1, policy_version 410068 (0.0010) [2023-12-26 02:52:47,840][123090] Updated weights for policy 1, policy_version 410078 (0.0009) [2023-12-26 02:52:48,148][123091] Updated weights for policy 0, policy_version 412660 (0.0009) [2023-12-26 02:52:48,204][123091] Updated weights for policy 0, policy_version 412670 (0.0010) [2023-12-26 02:52:48,259][123091] Updated weights for policy 0, policy_version 412680 (0.0009) [2023-12-26 02:52:48,662][123090] Updated weights for policy 1, policy_version 410088 (0.0007) [2023-12-26 02:52:48,726][123090] Updated weights for policy 1, policy_version 410098 (0.0007) [2023-12-26 02:52:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 210632704. Throughput: 0: 8834.4, 1: 8881.8. Samples: 210647868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:48,785][121949] Avg episode reward: [(0, '6134.433'), (1, '5966.973')] [2023-12-26 02:52:48,790][123090] Updated weights for policy 1, policy_version 410108 (0.0006) [2023-12-26 02:52:49,110][123091] Updated weights for policy 0, policy_version 412690 (0.0009) [2023-12-26 02:52:49,165][123091] Updated weights for policy 0, policy_version 412700 (0.0008) [2023-12-26 02:52:49,226][123091] Updated weights for policy 0, policy_version 412710 (0.0007) [2023-12-26 02:52:49,298][123091] Updated weights for policy 0, policy_version 412720 (0.0010) [2023-12-26 02:52:49,581][123090] Updated weights for policy 1, policy_version 410118 (0.0010) [2023-12-26 02:52:49,655][123090] Updated weights for policy 1, policy_version 410128 (0.0006) [2023-12-26 02:52:49,726][123090] Updated weights for policy 1, policy_version 410138 (0.0005) [2023-12-26 02:52:50,141][123091] Updated weights for policy 0, policy_version 412730 (0.0006) [2023-12-26 02:52:50,202][123091] Updated weights for policy 0, policy_version 412740 (0.0006) [2023-12-26 02:52:50,259][123091] Updated weights for policy 0, policy_version 412750 (0.0006) [2023-12-26 02:52:50,478][123090] Updated weights for policy 1, policy_version 410148 (0.0006) [2023-12-26 02:52:50,544][123090] Updated weights for policy 1, policy_version 410158 (0.0009) [2023-12-26 02:52:50,615][123090] Updated weights for policy 1, policy_version 410168 (0.0009) [2023-12-26 02:52:51,005][123091] Updated weights for policy 0, policy_version 412760 (0.0009) [2023-12-26 02:52:51,077][123091] Updated weights for policy 0, policy_version 412770 (0.0010) [2023-12-26 02:52:51,154][123091] Updated weights for policy 0, policy_version 412780 (0.0008) [2023-12-26 02:52:51,331][123090] Updated weights for policy 1, policy_version 410178 (0.0010) [2023-12-26 02:52:51,404][123090] Updated weights for policy 1, policy_version 410188 (0.0008) [2023-12-26 02:52:51,470][123090] Updated weights for policy 1, policy_version 410198 (0.0009) [2023-12-26 02:52:51,530][123090] Updated weights for policy 1, policy_version 410208 (0.0008) [2023-12-26 02:52:51,950][123091] Updated weights for policy 0, policy_version 412790 (0.0008) [2023-12-26 02:52:51,999][123091] Updated weights for policy 0, policy_version 412800 (0.0005) [2023-12-26 02:52:52,067][123091] Updated weights for policy 0, policy_version 412810 (0.0010) [2023-12-26 02:52:52,388][123090] Updated weights for policy 1, policy_version 410218 (0.0009) [2023-12-26 02:52:52,452][123090] Updated weights for policy 1, policy_version 410228 (0.0009) [2023-12-26 02:52:52,502][123090] Updated weights for policy 1, policy_version 410238 (0.0008) [2023-12-26 02:52:52,878][123091] Updated weights for policy 0, policy_version 412820 (0.0011) [2023-12-26 02:52:52,941][123091] Updated weights for policy 0, policy_version 412830 (0.0010) [2023-12-26 02:52:53,008][123091] Updated weights for policy 0, policy_version 412840 (0.0011) [2023-12-26 02:52:53,289][123090] Updated weights for policy 1, policy_version 410248 (0.0006) [2023-12-26 02:52:53,350][123090] Updated weights for policy 1, policy_version 410258 (0.0008) [2023-12-26 02:52:53,418][123090] Updated weights for policy 1, policy_version 410268 (0.0006) [2023-12-26 02:52:53,762][123091] Updated weights for policy 0, policy_version 412850 (0.0010) [2023-12-26 02:52:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 210722816. Throughput: 0: 8809.5, 1: 8867.4. Samples: 210700404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:53,785][121949] Avg episode reward: [(0, '5973.509'), (1, '5982.321')] [2023-12-26 02:52:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000410272_105029632.pth... [2023-12-26 02:52:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000409216_104759296.pth [2023-12-26 02:52:53,829][123091] Updated weights for policy 0, policy_version 412860 (0.0005) [2023-12-26 02:52:53,903][123091] Updated weights for policy 0, policy_version 412870 (0.0005) [2023-12-26 02:52:53,971][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000412880_105701376.pth... [2023-12-26 02:52:53,972][123091] Updated weights for policy 0, policy_version 412880 (0.0005) [2023-12-26 02:52:53,977][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000411824_105431040.pth [2023-12-26 02:52:54,123][123090] Updated weights for policy 1, policy_version 410278 (0.0005) [2023-12-26 02:52:54,191][123090] Updated weights for policy 1, policy_version 410288 (0.0006) [2023-12-26 02:52:54,255][123090] Updated weights for policy 1, policy_version 410298 (0.0005) [2023-12-26 02:52:54,688][123091] Updated weights for policy 0, policy_version 412890 (0.0010) [2023-12-26 02:52:54,736][123091] Updated weights for policy 0, policy_version 412900 (0.0010) [2023-12-26 02:52:54,787][123091] Updated weights for policy 0, policy_version 412910 (0.0010) [2023-12-26 02:52:54,909][123090] Updated weights for policy 1, policy_version 410308 (0.0005) [2023-12-26 02:52:54,976][123090] Updated weights for policy 1, policy_version 410318 (0.0006) [2023-12-26 02:52:55,048][123090] Updated weights for policy 1, policy_version 410328 (0.0006) [2023-12-26 02:52:55,538][123091] Updated weights for policy 0, policy_version 412920 (0.0007) [2023-12-26 02:52:55,599][123091] Updated weights for policy 0, policy_version 412930 (0.0005) [2023-12-26 02:52:55,647][123091] Updated weights for policy 0, policy_version 412940 (0.0006) [2023-12-26 02:52:55,659][123090] Updated weights for policy 1, policy_version 410338 (0.0006) [2023-12-26 02:52:55,719][123090] Updated weights for policy 1, policy_version 410348 (0.0006) [2023-12-26 02:52:55,778][123090] Updated weights for policy 1, policy_version 410358 (0.0009) [2023-12-26 02:52:55,841][123090] Updated weights for policy 1, policy_version 410368 (0.0010) [2023-12-26 02:52:56,440][123091] Updated weights for policy 0, policy_version 412950 (0.0009) [2023-12-26 02:52:56,454][123090] Updated weights for policy 1, policy_version 410378 (0.0005) [2023-12-26 02:52:56,492][123091] Updated weights for policy 0, policy_version 412960 (0.0011) [2023-12-26 02:52:56,506][123090] Updated weights for policy 1, policy_version 410388 (0.0005) [2023-12-26 02:52:56,536][123091] Updated weights for policy 0, policy_version 412970 (0.0010) [2023-12-26 02:52:56,558][123090] Updated weights for policy 1, policy_version 410398 (0.0005) [2023-12-26 02:52:57,251][123090] Updated weights for policy 1, policy_version 410408 (0.0005) [2023-12-26 02:52:57,300][123090] Updated weights for policy 1, policy_version 410418 (0.0005) [2023-12-26 02:52:57,352][123090] Updated weights for policy 1, policy_version 410428 (0.0005) [2023-12-26 02:52:57,365][123091] Updated weights for policy 0, policy_version 412980 (0.0010) [2023-12-26 02:52:57,415][123091] Updated weights for policy 0, policy_version 412990 (0.0007) [2023-12-26 02:52:57,473][123091] Updated weights for policy 0, policy_version 413000 (0.0007) [2023-12-26 02:52:58,015][123090] Updated weights for policy 1, policy_version 410438 (0.0007) [2023-12-26 02:52:58,081][123090] Updated weights for policy 1, policy_version 410448 (0.0007) [2023-12-26 02:52:58,145][123090] Updated weights for policy 1, policy_version 410458 (0.0010) [2023-12-26 02:52:58,236][123091] Updated weights for policy 0, policy_version 413010 (0.0007) [2023-12-26 02:52:58,305][123091] Updated weights for policy 0, policy_version 413020 (0.0009) [2023-12-26 02:52:58,379][123091] Updated weights for policy 0, policy_version 413030 (0.0009) [2023-12-26 02:52:58,448][123091] Updated weights for policy 0, policy_version 413040 (0.0008) [2023-12-26 02:52:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 210821120. Throughput: 0: 8860.0, 1: 9062.7. Samples: 210814628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:52:58,785][121949] Avg episode reward: [(0, '6050.343'), (1, '5872.281')] [2023-12-26 02:52:59,045][123090] Updated weights for policy 1, policy_version 410468 (0.0011) [2023-12-26 02:52:59,115][123090] Updated weights for policy 1, policy_version 410478 (0.0007) [2023-12-26 02:52:59,193][123090] Updated weights for policy 1, policy_version 410488 (0.0010) [2023-12-26 02:52:59,418][123091] Updated weights for policy 0, policy_version 413050 (0.0009) [2023-12-26 02:52:59,487][123091] Updated weights for policy 0, policy_version 413060 (0.0009) [2023-12-26 02:52:59,539][123091] Updated weights for policy 0, policy_version 413070 (0.0009) [2023-12-26 02:53:00,050][123090] Updated weights for policy 1, policy_version 410498 (0.0010) [2023-12-26 02:53:00,115][123090] Updated weights for policy 1, policy_version 410508 (0.0006) [2023-12-26 02:53:00,186][123090] Updated weights for policy 1, policy_version 410518 (0.0005) [2023-12-26 02:53:00,252][123090] Updated weights for policy 1, policy_version 410528 (0.0006) [2023-12-26 02:53:00,354][123091] Updated weights for policy 0, policy_version 413080 (0.0009) [2023-12-26 02:53:00,414][123091] Updated weights for policy 0, policy_version 413091 (0.0010) [2023-12-26 02:53:00,461][123091] Updated weights for policy 0, policy_version 413101 (0.0008) [2023-12-26 02:53:01,009][123090] Updated weights for policy 1, policy_version 410538 (0.0009) [2023-12-26 02:53:01,074][123090] Updated weights for policy 1, policy_version 410548 (0.0009) [2023-12-26 02:53:01,142][123090] Updated weights for policy 1, policy_version 410558 (0.0009) [2023-12-26 02:53:01,180][123091] Updated weights for policy 0, policy_version 413111 (0.0009) [2023-12-26 02:53:01,245][123091] Updated weights for policy 0, policy_version 413121 (0.0010) [2023-12-26 02:53:01,308][123091] Updated weights for policy 0, policy_version 413131 (0.0010) [2023-12-26 02:53:01,955][123090] Updated weights for policy 1, policy_version 410568 (0.0009) [2023-12-26 02:53:02,025][123090] Updated weights for policy 1, policy_version 410578 (0.0008) [2023-12-26 02:53:02,084][123090] Updated weights for policy 1, policy_version 410588 (0.0008) [2023-12-26 02:53:02,094][123091] Updated weights for policy 0, policy_version 413141 (0.0010) [2023-12-26 02:53:02,149][123091] Updated weights for policy 0, policy_version 413151 (0.0009) [2023-12-26 02:53:02,204][123091] Updated weights for policy 0, policy_version 413161 (0.0008) [2023-12-26 02:53:02,912][123090] Updated weights for policy 1, policy_version 410598 (0.0008) [2023-12-26 02:53:02,948][123091] Updated weights for policy 0, policy_version 413171 (0.0010) [2023-12-26 02:53:02,968][123090] Updated weights for policy 1, policy_version 410608 (0.0007) [2023-12-26 02:53:03,009][123091] Updated weights for policy 0, policy_version 413181 (0.0010) [2023-12-26 02:53:03,030][123090] Updated weights for policy 1, policy_version 410618 (0.0009) [2023-12-26 02:53:03,074][123091] Updated weights for policy 0, policy_version 413191 (0.0011) [2023-12-26 02:53:03,783][123091] Updated weights for policy 0, policy_version 413201 (0.0010) [2023-12-26 02:53:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 210903040. Throughput: 0: 8832.9, 1: 8936.3. Samples: 210919344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:53:03,785][121949] Avg episode reward: [(0, '6153.492'), (1, '5832.021')] [2023-12-26 02:53:03,854][123091] Updated weights for policy 0, policy_version 413211 (0.0007) [2023-12-26 02:53:03,910][123090] Updated weights for policy 1, policy_version 410628 (0.0007) [2023-12-26 02:53:03,916][123091] Updated weights for policy 0, policy_version 413221 (0.0011) [2023-12-26 02:53:03,970][123090] Updated weights for policy 1, policy_version 410638 (0.0006) [2023-12-26 02:53:03,975][123091] Updated weights for policy 0, policy_version 413231 (0.0011) [2023-12-26 02:53:04,033][123090] Updated weights for policy 1, policy_version 410648 (0.0008) [2023-12-26 02:53:04,773][123090] Updated weights for policy 1, policy_version 410658 (0.0006) [2023-12-26 02:53:04,787][123091] Updated weights for policy 0, policy_version 413241 (0.0011) [2023-12-26 02:53:04,821][123090] Updated weights for policy 1, policy_version 410668 (0.0005) [2023-12-26 02:53:04,854][123091] Updated weights for policy 0, policy_version 413251 (0.0011) [2023-12-26 02:53:04,882][123090] Updated weights for policy 1, policy_version 410678 (0.0006) [2023-12-26 02:53:04,901][123091] Updated weights for policy 0, policy_version 413261 (0.0010) [2023-12-26 02:53:04,936][123090] Updated weights for policy 1, policy_version 410688 (0.0006) [2023-12-26 02:53:05,670][123091] Updated weights for policy 0, policy_version 413271 (0.0010) [2023-12-26 02:53:05,728][123091] Updated weights for policy 0, policy_version 413281 (0.0010) [2023-12-26 02:53:05,750][123090] Updated weights for policy 1, policy_version 410698 (0.0011) [2023-12-26 02:53:05,791][123091] Updated weights for policy 0, policy_version 413291 (0.0011) [2023-12-26 02:53:05,811][123090] Updated weights for policy 1, policy_version 410708 (0.0008) [2023-12-26 02:53:05,870][123090] Updated weights for policy 1, policy_version 410718 (0.0005) [2023-12-26 02:53:06,614][123091] Updated weights for policy 0, policy_version 413301 (0.0009) [2023-12-26 02:53:06,633][123090] Updated weights for policy 1, policy_version 410728 (0.0010) [2023-12-26 02:53:06,679][123091] Updated weights for policy 0, policy_version 413311 (0.0009) [2023-12-26 02:53:06,698][123090] Updated weights for policy 1, policy_version 410738 (0.0011) [2023-12-26 02:53:06,742][123091] Updated weights for policy 0, policy_version 413321 (0.0011) [2023-12-26 02:53:06,761][123090] Updated weights for policy 1, policy_version 410748 (0.0010) [2023-12-26 02:53:07,543][123091] Updated weights for policy 0, policy_version 413331 (0.0011) [2023-12-26 02:53:07,554][123090] Updated weights for policy 1, policy_version 410758 (0.0011) [2023-12-26 02:53:07,603][123091] Updated weights for policy 0, policy_version 413341 (0.0011) [2023-12-26 02:53:07,617][123090] Updated weights for policy 1, policy_version 410768 (0.0011) [2023-12-26 02:53:07,665][123091] Updated weights for policy 0, policy_version 413351 (0.0010) [2023-12-26 02:53:07,687][123090] Updated weights for policy 1, policy_version 410778 (0.0008) [2023-12-26 02:53:08,390][123090] Updated weights for policy 1, policy_version 410788 (0.0007) [2023-12-26 02:53:08,453][123090] Updated weights for policy 1, policy_version 410798 (0.0007) [2023-12-26 02:53:08,495][123091] Updated weights for policy 0, policy_version 413361 (0.0010) [2023-12-26 02:53:08,508][123090] Updated weights for policy 1, policy_version 410808 (0.0005) [2023-12-26 02:53:08,548][123091] Updated weights for policy 0, policy_version 413371 (0.0011) [2023-12-26 02:53:08,599][123091] Updated weights for policy 0, policy_version 413381 (0.0010) [2023-12-26 02:53:08,651][123091] Updated weights for policy 0, policy_version 413391 (0.0010) [2023-12-26 02:53:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 211001344. Throughput: 0: 8866.3, 1: 8992.3. Samples: 210973300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:53:08,785][121949] Avg episode reward: [(0, '6071.800'), (1, '5838.790')] [2023-12-26 02:53:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000413392_105832448.pth... [2023-12-26 02:53:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000410816_105168896.pth... [2023-12-26 02:53:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000412368_105570304.pth [2023-12-26 02:53:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000409760_104898560.pth [2023-12-26 02:53:09,306][123090] Updated weights for policy 1, policy_version 410818 (0.0007) [2023-12-26 02:53:09,374][123090] Updated weights for policy 1, policy_version 410828 (0.0010) [2023-12-26 02:53:09,442][123090] Updated weights for policy 1, policy_version 410838 (0.0009) [2023-12-26 02:53:09,449][123091] Updated weights for policy 0, policy_version 413401 (0.0008) [2023-12-26 02:53:09,498][123090] Updated weights for policy 1, policy_version 410848 (0.0008) [2023-12-26 02:53:09,500][123091] Updated weights for policy 0, policy_version 413411 (0.0009) [2023-12-26 02:53:09,555][123091] Updated weights for policy 0, policy_version 413421 (0.0009) [2023-12-26 02:53:10,334][123090] Updated weights for policy 1, policy_version 410858 (0.0009) [2023-12-26 02:53:10,396][123090] Updated weights for policy 1, policy_version 410868 (0.0009) [2023-12-26 02:53:10,451][123091] Updated weights for policy 0, policy_version 413431 (0.0009) [2023-12-26 02:53:10,458][123090] Updated weights for policy 1, policy_version 410878 (0.0008) [2023-12-26 02:53:10,508][123091] Updated weights for policy 0, policy_version 413441 (0.0010) [2023-12-26 02:53:10,567][123091] Updated weights for policy 0, policy_version 413451 (0.0010) [2023-12-26 02:53:11,266][123090] Updated weights for policy 1, policy_version 410888 (0.0008) [2023-12-26 02:53:11,333][123090] Updated weights for policy 1, policy_version 410898 (0.0008) [2023-12-26 02:53:11,410][123090] Updated weights for policy 1, policy_version 410908 (0.0008) [2023-12-26 02:53:11,500][123091] Updated weights for policy 0, policy_version 413461 (0.0009) [2023-12-26 02:53:11,560][123091] Updated weights for policy 0, policy_version 413471 (0.0009) [2023-12-26 02:53:11,624][123091] Updated weights for policy 0, policy_version 413481 (0.0010) [2023-12-26 02:53:12,270][123090] Updated weights for policy 1, policy_version 410918 (0.0009) [2023-12-26 02:53:12,338][123090] Updated weights for policy 1, policy_version 410928 (0.0009) [2023-12-26 02:53:12,412][123090] Updated weights for policy 1, policy_version 410938 (0.0009) [2023-12-26 02:53:12,471][123091] Updated weights for policy 0, policy_version 413491 (0.0009) [2023-12-26 02:53:12,533][123091] Updated weights for policy 0, policy_version 413501 (0.0008) [2023-12-26 02:53:12,588][123091] Updated weights for policy 0, policy_version 413511 (0.0008) [2023-12-26 02:53:13,173][123090] Updated weights for policy 1, policy_version 410948 (0.0008) [2023-12-26 02:53:13,236][123090] Updated weights for policy 1, policy_version 410958 (0.0010) [2023-12-26 02:53:13,293][123090] Updated weights for policy 1, policy_version 410968 (0.0009) [2023-12-26 02:53:13,345][123091] Updated weights for policy 0, policy_version 413521 (0.0007) [2023-12-26 02:53:13,402][123091] Updated weights for policy 0, policy_version 413531 (0.0009) [2023-12-26 02:53:13,450][123091] Updated weights for policy 0, policy_version 413541 (0.0009) [2023-12-26 02:53:13,504][123091] Updated weights for policy 0, policy_version 413551 (0.0009) [2023-12-26 02:53:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 211083264. Throughput: 0: 8750.4, 1: 8930.0. Samples: 211076044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 02:53:13,785][121949] Avg episode reward: [(0, '5964.539'), (1, '5888.271')] [2023-12-26 02:53:14,060][123090] Updated weights for policy 1, policy_version 410978 (0.0009) [2023-12-26 02:53:14,131][123090] Updated weights for policy 1, policy_version 410988 (0.0009) [2023-12-26 02:53:14,203][123090] Updated weights for policy 1, policy_version 410998 (0.0010) [2023-12-26 02:53:14,287][123090] Updated weights for policy 1, policy_version 411008 (0.0009) [2023-12-26 02:53:14,298][123091] Updated weights for policy 0, policy_version 413561 (0.0006) [2023-12-26 02:53:14,369][123091] Updated weights for policy 0, policy_version 413571 (0.0006) [2023-12-26 02:53:14,429][123091] Updated weights for policy 0, policy_version 413581 (0.0006) [2023-12-26 02:53:15,121][123090] Updated weights for policy 1, policy_version 411018 (0.0009) [2023-12-26 02:53:15,153][123091] Updated weights for policy 0, policy_version 413591 (0.0007) [2023-12-26 02:53:15,176][123090] Updated weights for policy 1, policy_version 411028 (0.0008) [2023-12-26 02:53:15,217][123091] Updated weights for policy 0, policy_version 413601 (0.0008) [2023-12-26 02:53:15,237][123090] Updated weights for policy 1, policy_version 411038 (0.0008) [2023-12-26 02:53:15,279][123091] Updated weights for policy 0, policy_version 413611 (0.0008) [2023-12-26 02:53:16,009][123091] Updated weights for policy 0, policy_version 413621 (0.0008) [2023-12-26 02:53:16,066][123091] Updated weights for policy 0, policy_version 413631 (0.0007) [2023-12-26 02:53:16,075][123090] Updated weights for policy 1, policy_version 411048 (0.0008) [2023-12-26 02:53:16,131][123091] Updated weights for policy 0, policy_version 413641 (0.0008) [2023-12-26 02:53:16,142][123090] Updated weights for policy 1, policy_version 411058 (0.0007) [2023-12-26 02:53:16,209][123090] Updated weights for policy 1, policy_version 411068 (0.0008) [2023-12-26 02:53:16,830][123091] Updated weights for policy 0, policy_version 413651 (0.0007) [2023-12-26 02:53:16,878][123091] Updated weights for policy 0, policy_version 413661 (0.0005) [2023-12-26 02:53:16,925][123091] Updated weights for policy 0, policy_version 413671 (0.0005) [2023-12-26 02:53:16,976][123090] Updated weights for policy 1, policy_version 411078 (0.0007) [2023-12-26 02:53:17,041][123090] Updated weights for policy 1, policy_version 411088 (0.0006) [2023-12-26 02:53:17,103][123090] Updated weights for policy 1, policy_version 411098 (0.0006) [2023-12-26 02:53:17,589][123091] Updated weights for policy 0, policy_version 413681 (0.0005) [2023-12-26 02:53:17,640][123091] Updated weights for policy 0, policy_version 413691 (0.0005) [2023-12-26 02:53:17,706][123091] Updated weights for policy 0, policy_version 413701 (0.0006) [2023-12-26 02:53:17,752][123090] Updated weights for policy 1, policy_version 411108 (0.0007) [2023-12-26 02:53:17,774][123091] Updated weights for policy 0, policy_version 413711 (0.0006) [2023-12-26 02:53:17,813][123090] Updated weights for policy 1, policy_version 411118 (0.0008) [2023-12-26 02:53:17,870][123090] Updated weights for policy 1, policy_version 411128 (0.0009) [2023-12-26 02:53:18,500][123091] Updated weights for policy 0, policy_version 413721 (0.0006) [2023-12-26 02:53:18,558][123091] Updated weights for policy 0, policy_version 413731 (0.0006) [2023-12-26 02:53:18,619][123090] Updated weights for policy 1, policy_version 411138 (0.0008) [2023-12-26 02:53:18,626][123091] Updated weights for policy 0, policy_version 413741 (0.0005) [2023-12-26 02:53:18,690][123090] Updated weights for policy 1, policy_version 411148 (0.0006) [2023-12-26 02:53:18,757][123090] Updated weights for policy 1, policy_version 411158 (0.0005) [2023-12-26 02:53:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 211173376. Throughput: 0: 8898.1, 1: 8900.5. Samples: 211188212. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:18,785][121949] Avg episode reward: [(0, '5950.212'), (1, '6022.672')] [2023-12-26 02:53:18,826][123090] Updated weights for policy 1, policy_version 411168 (0.0006) [2023-12-26 02:53:19,391][123091] Updated weights for policy 0, policy_version 413751 (0.0007) [2023-12-26 02:53:19,403][123090] Updated weights for policy 1, policy_version 411178 (0.0008) [2023-12-26 02:53:19,457][123091] Updated weights for policy 0, policy_version 413761 (0.0006) [2023-12-26 02:53:19,464][123090] Updated weights for policy 1, policy_version 411188 (0.0006) [2023-12-26 02:53:19,527][123091] Updated weights for policy 0, policy_version 413771 (0.0008) [2023-12-26 02:53:19,537][123090] Updated weights for policy 1, policy_version 411198 (0.0008) [2023-12-26 02:53:20,346][123090] Updated weights for policy 1, policy_version 411208 (0.0008) [2023-12-26 02:53:20,360][123091] Updated weights for policy 0, policy_version 413781 (0.0009) [2023-12-26 02:53:20,409][123090] Updated weights for policy 1, policy_version 411218 (0.0009) [2023-12-26 02:53:20,431][123091] Updated weights for policy 0, policy_version 413791 (0.0010) [2023-12-26 02:53:20,470][123090] Updated weights for policy 1, policy_version 411228 (0.0007) [2023-12-26 02:53:20,491][123091] Updated weights for policy 0, policy_version 413801 (0.0009) [2023-12-26 02:53:21,304][123090] Updated weights for policy 1, policy_version 411238 (0.0009) [2023-12-26 02:53:21,319][123091] Updated weights for policy 0, policy_version 413811 (0.0009) [2023-12-26 02:53:21,376][123090] Updated weights for policy 1, policy_version 411248 (0.0007) [2023-12-26 02:53:21,398][123091] Updated weights for policy 0, policy_version 413821 (0.0011) [2023-12-26 02:53:21,444][123090] Updated weights for policy 1, policy_version 411258 (0.0008) [2023-12-26 02:53:21,458][123091] Updated weights for policy 0, policy_version 413831 (0.0011) [2023-12-26 02:53:22,265][123091] Updated weights for policy 0, policy_version 413841 (0.0011) [2023-12-26 02:53:22,283][123090] Updated weights for policy 1, policy_version 411268 (0.0008) [2023-12-26 02:53:22,327][123091] Updated weights for policy 0, policy_version 413851 (0.0009) [2023-12-26 02:53:22,347][123090] Updated weights for policy 1, policy_version 411278 (0.0009) [2023-12-26 02:53:22,397][123091] Updated weights for policy 0, policy_version 413861 (0.0008) [2023-12-26 02:53:22,416][123090] Updated weights for policy 1, policy_version 411288 (0.0009) [2023-12-26 02:53:22,457][123091] Updated weights for policy 0, policy_version 413871 (0.0008) [2023-12-26 02:53:23,245][123090] Updated weights for policy 1, policy_version 411298 (0.0006) [2023-12-26 02:53:23,301][123090] Updated weights for policy 1, policy_version 411308 (0.0006) [2023-12-26 02:53:23,303][123091] Updated weights for policy 0, policy_version 413881 (0.0008) [2023-12-26 02:53:23,361][123091] Updated weights for policy 0, policy_version 413891 (0.0007) [2023-12-26 02:53:23,366][123090] Updated weights for policy 1, policy_version 411318 (0.0010) [2023-12-26 02:53:23,417][123091] Updated weights for policy 0, policy_version 413901 (0.0006) [2023-12-26 02:53:23,427][123090] Updated weights for policy 1, policy_version 411328 (0.0011) [2023-12-26 02:53:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 211263488. Throughput: 0: 8849.2, 1: 8912.5. Samples: 211240212. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:23,785][121949] Avg episode reward: [(0, '6008.861'), (1, '5948.423')] [2023-12-26 02:53:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000413904_105963520.pth... [2023-12-26 02:53:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000411328_105299968.pth... [2023-12-26 02:53:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000412880_105701376.pth [2023-12-26 02:53:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000410272_105029632.pth [2023-12-26 02:53:24,154][123090] Updated weights for policy 1, policy_version 411338 (0.0005) [2023-12-26 02:53:24,181][123091] Updated weights for policy 0, policy_version 413911 (0.0009) [2023-12-26 02:53:24,224][123090] Updated weights for policy 1, policy_version 411348 (0.0005) [2023-12-26 02:53:24,243][123091] Updated weights for policy 0, policy_version 413921 (0.0008) [2023-12-26 02:53:24,291][123091] Updated weights for policy 0, policy_version 413931 (0.0006) [2023-12-26 02:53:24,293][123090] Updated weights for policy 1, policy_version 411358 (0.0006) [2023-12-26 02:53:24,987][123090] Updated weights for policy 1, policy_version 411368 (0.0010) [2023-12-26 02:53:25,037][123090] Updated weights for policy 1, policy_version 411378 (0.0007) [2023-12-26 02:53:25,105][123090] Updated weights for policy 1, policy_version 411388 (0.0005) [2023-12-26 02:53:25,155][123091] Updated weights for policy 0, policy_version 413941 (0.0008) [2023-12-26 02:53:25,209][123091] Updated weights for policy 0, policy_version 413951 (0.0010) [2023-12-26 02:53:25,260][123091] Updated weights for policy 0, policy_version 413961 (0.0009) [2023-12-26 02:53:25,868][123090] Updated weights for policy 1, policy_version 411398 (0.0008) [2023-12-26 02:53:25,935][123090] Updated weights for policy 1, policy_version 411408 (0.0009) [2023-12-26 02:53:25,988][123090] Updated weights for policy 1, policy_version 411418 (0.0009) [2023-12-26 02:53:26,051][123091] Updated weights for policy 0, policy_version 413971 (0.0008) [2023-12-26 02:53:26,102][123091] Updated weights for policy 0, policy_version 413981 (0.0005) [2023-12-26 02:53:26,159][123091] Updated weights for policy 0, policy_version 413991 (0.0007) [2023-12-26 02:53:26,871][123090] Updated weights for policy 1, policy_version 411428 (0.0009) [2023-12-26 02:53:26,914][123091] Updated weights for policy 0, policy_version 414001 (0.0006) [2023-12-26 02:53:26,932][123090] Updated weights for policy 1, policy_version 411438 (0.0006) [2023-12-26 02:53:26,967][123091] Updated weights for policy 0, policy_version 414011 (0.0009) [2023-12-26 02:53:26,987][123090] Updated weights for policy 1, policy_version 411448 (0.0006) [2023-12-26 02:53:27,012][123091] Updated weights for policy 0, policy_version 414021 (0.0008) [2023-12-26 02:53:27,059][123091] Updated weights for policy 0, policy_version 414031 (0.0009) [2023-12-26 02:53:27,631][123090] Updated weights for policy 1, policy_version 411458 (0.0008) [2023-12-26 02:53:27,693][123090] Updated weights for policy 1, policy_version 411468 (0.0009) [2023-12-26 02:53:27,758][123090] Updated weights for policy 1, policy_version 411478 (0.0005) [2023-12-26 02:53:27,819][123090] Updated weights for policy 1, policy_version 411488 (0.0008) [2023-12-26 02:53:27,973][123091] Updated weights for policy 0, policy_version 414041 (0.0010) [2023-12-26 02:53:28,023][123091] Updated weights for policy 0, policy_version 414052 (0.0010) [2023-12-26 02:53:28,074][123091] Updated weights for policy 0, policy_version 414062 (0.0009) [2023-12-26 02:53:28,535][123090] Updated weights for policy 1, policy_version 411498 (0.0006) [2023-12-26 02:53:28,606][123090] Updated weights for policy 1, policy_version 411508 (0.0005) [2023-12-26 02:53:28,663][123090] Updated weights for policy 1, policy_version 411518 (0.0005) [2023-12-26 02:53:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 211353600. Throughput: 0: 8867.6, 1: 8988.2. Samples: 211347212. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:28,785][121949] Avg episode reward: [(0, '5998.593'), (1, '5851.295')] [2023-12-26 02:53:28,999][123091] Updated weights for policy 0, policy_version 414072 (0.0009) [2023-12-26 02:53:29,051][123091] Updated weights for policy 0, policy_version 414082 (0.0009) [2023-12-26 02:53:29,100][123091] Updated weights for policy 0, policy_version 414092 (0.0008) [2023-12-26 02:53:29,383][123090] Updated weights for policy 1, policy_version 411528 (0.0007) [2023-12-26 02:53:29,434][123090] Updated weights for policy 1, policy_version 411538 (0.0008) [2023-12-26 02:53:29,493][123090] Updated weights for policy 1, policy_version 411548 (0.0008) [2023-12-26 02:53:30,004][123091] Updated weights for policy 0, policy_version 414102 (0.0008) [2023-12-26 02:53:30,065][123091] Updated weights for policy 0, policy_version 414112 (0.0009) [2023-12-26 02:53:30,125][123091] Updated weights for policy 0, policy_version 414122 (0.0009) [2023-12-26 02:53:30,320][123090] Updated weights for policy 1, policy_version 411558 (0.0009) [2023-12-26 02:53:30,390][123090] Updated weights for policy 1, policy_version 411568 (0.0010) [2023-12-26 02:53:30,461][123090] Updated weights for policy 1, policy_version 411578 (0.0010) [2023-12-26 02:53:30,703][123091] Updated weights for policy 0, policy_version 414132 (0.0009) [2023-12-26 02:53:30,750][123091] Updated weights for policy 0, policy_version 414142 (0.0009) [2023-12-26 02:53:30,799][123091] Updated weights for policy 0, policy_version 414152 (0.0007) [2023-12-26 02:53:31,294][123090] Updated weights for policy 1, policy_version 411588 (0.0011) [2023-12-26 02:53:31,356][123090] Updated weights for policy 1, policy_version 411598 (0.0010) [2023-12-26 02:53:31,422][123090] Updated weights for policy 1, policy_version 411608 (0.0011) [2023-12-26 02:53:31,639][123091] Updated weights for policy 0, policy_version 414162 (0.0006) [2023-12-26 02:53:31,701][123091] Updated weights for policy 0, policy_version 414172 (0.0008) [2023-12-26 02:53:31,772][123091] Updated weights for policy 0, policy_version 414182 (0.0010) [2023-12-26 02:53:31,832][123091] Updated weights for policy 0, policy_version 414192 (0.0010) [2023-12-26 02:53:32,212][123090] Updated weights for policy 1, policy_version 411618 (0.0010) [2023-12-26 02:53:32,268][123090] Updated weights for policy 1, policy_version 411628 (0.0009) [2023-12-26 02:53:32,337][123090] Updated weights for policy 1, policy_version 411638 (0.0010) [2023-12-26 02:53:32,410][123090] Updated weights for policy 1, policy_version 411648 (0.0010) [2023-12-26 02:53:32,602][123091] Updated weights for policy 0, policy_version 414202 (0.0009) [2023-12-26 02:53:32,656][123091] Updated weights for policy 0, policy_version 414212 (0.0009) [2023-12-26 02:53:32,712][123091] Updated weights for policy 0, policy_version 414222 (0.0009) [2023-12-26 02:53:33,234][123090] Updated weights for policy 1, policy_version 411658 (0.0007) [2023-12-26 02:53:33,283][123090] Updated weights for policy 1, policy_version 411668 (0.0005) [2023-12-26 02:53:33,342][123090] Updated weights for policy 1, policy_version 411678 (0.0005) [2023-12-26 02:53:33,592][123091] Updated weights for policy 0, policy_version 414232 (0.0010) [2023-12-26 02:53:33,669][123091] Updated weights for policy 0, policy_version 414242 (0.0009) [2023-12-26 02:53:33,742][123091] Updated weights for policy 0, policy_version 414252 (0.0010) [2023-12-26 02:53:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 211443712. Throughput: 0: 8861.2, 1: 9011.0. Samples: 211452120. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:33,786][121949] Avg episode reward: [(0, '6125.865'), (1, '5862.686')] [2023-12-26 02:53:34,012][123090] Updated weights for policy 1, policy_version 411688 (0.0008) [2023-12-26 02:53:34,074][123090] Updated weights for policy 1, policy_version 411698 (0.0005) [2023-12-26 02:53:34,132][123090] Updated weights for policy 1, policy_version 411708 (0.0006) [2023-12-26 02:53:34,596][123091] Updated weights for policy 0, policy_version 414262 (0.0010) [2023-12-26 02:53:34,658][123091] Updated weights for policy 0, policy_version 414272 (0.0010) [2023-12-26 02:53:34,725][123091] Updated weights for policy 0, policy_version 414282 (0.0010) [2023-12-26 02:53:34,912][123090] Updated weights for policy 1, policy_version 411718 (0.0010) [2023-12-26 02:53:34,969][123090] Updated weights for policy 1, policy_version 411728 (0.0010) [2023-12-26 02:53:35,024][123090] Updated weights for policy 1, policy_version 411738 (0.0010) [2023-12-26 02:53:35,564][123091] Updated weights for policy 0, policy_version 414292 (0.0010) [2023-12-26 02:53:35,617][123091] Updated weights for policy 0, policy_version 414302 (0.0010) [2023-12-26 02:53:35,679][123091] Updated weights for policy 0, policy_version 414312 (0.0010) [2023-12-26 02:53:35,718][123090] Updated weights for policy 1, policy_version 411748 (0.0008) [2023-12-26 02:53:35,790][123090] Updated weights for policy 1, policy_version 411758 (0.0005) [2023-12-26 02:53:35,848][123090] Updated weights for policy 1, policy_version 411768 (0.0006) [2023-12-26 02:53:36,547][123091] Updated weights for policy 0, policy_version 414322 (0.0008) [2023-12-26 02:53:36,623][123091] Updated weights for policy 0, policy_version 414332 (0.0007) [2023-12-26 02:53:36,624][123090] Updated weights for policy 1, policy_version 411778 (0.0009) [2023-12-26 02:53:36,682][123090] Updated weights for policy 1, policy_version 411788 (0.0007) [2023-12-26 02:53:36,697][123091] Updated weights for policy 0, policy_version 414342 (0.0006) [2023-12-26 02:53:36,749][123090] Updated weights for policy 1, policy_version 411798 (0.0006) [2023-12-26 02:53:36,764][123091] Updated weights for policy 0, policy_version 414352 (0.0007) [2023-12-26 02:53:36,820][123090] Updated weights for policy 1, policy_version 411808 (0.0007) [2023-12-26 02:53:37,474][123091] Updated weights for policy 0, policy_version 414362 (0.0009) [2023-12-26 02:53:37,477][123090] Updated weights for policy 1, policy_version 411818 (0.0007) [2023-12-26 02:53:37,532][123091] Updated weights for policy 0, policy_version 414372 (0.0008) [2023-12-26 02:53:37,535][123090] Updated weights for policy 1, policy_version 411828 (0.0007) [2023-12-26 02:53:37,586][123091] Updated weights for policy 0, policy_version 414382 (0.0008) [2023-12-26 02:53:37,588][123090] Updated weights for policy 1, policy_version 411838 (0.0007) [2023-12-26 02:53:38,441][123090] Updated weights for policy 1, policy_version 411848 (0.0009) [2023-12-26 02:53:38,444][123091] Updated weights for policy 0, policy_version 414392 (0.0008) [2023-12-26 02:53:38,494][123090] Updated weights for policy 1, policy_version 411858 (0.0009) [2023-12-26 02:53:38,496][123091] Updated weights for policy 0, policy_version 414402 (0.0008) [2023-12-26 02:53:38,551][123091] Updated weights for policy 0, policy_version 414412 (0.0008) [2023-12-26 02:53:38,554][123090] Updated weights for policy 1, policy_version 411868 (0.0006) [2023-12-26 02:53:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 211533824. Throughput: 0: 8835.8, 1: 9046.8. Samples: 211505120. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:38,785][121949] Avg episode reward: [(0, '6145.777'), (1, '5909.281')] [2023-12-26 02:53:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000414416_106094592.pth... [2023-12-26 02:53:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000411872_105439232.pth... [2023-12-26 02:53:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000413392_105832448.pth [2023-12-26 02:53:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000410816_105168896.pth [2023-12-26 02:53:39,317][123091] Updated weights for policy 0, policy_version 414422 (0.0006) [2023-12-26 02:53:39,386][123091] Updated weights for policy 0, policy_version 414432 (0.0009) [2023-12-26 02:53:39,444][123090] Updated weights for policy 1, policy_version 411878 (0.0010) [2023-12-26 02:53:39,457][123091] Updated weights for policy 0, policy_version 414442 (0.0010) [2023-12-26 02:53:39,505][123090] Updated weights for policy 1, policy_version 411888 (0.0008) [2023-12-26 02:53:39,566][123090] Updated weights for policy 1, policy_version 411898 (0.0010) [2023-12-26 02:53:40,280][123091] Updated weights for policy 0, policy_version 414452 (0.0011) [2023-12-26 02:53:40,347][123091] Updated weights for policy 0, policy_version 414462 (0.0011) [2023-12-26 02:53:40,350][123090] Updated weights for policy 1, policy_version 411908 (0.0007) [2023-12-26 02:53:40,411][123091] Updated weights for policy 0, policy_version 414472 (0.0010) [2023-12-26 02:53:40,414][123090] Updated weights for policy 1, policy_version 411918 (0.0006) [2023-12-26 02:53:40,468][123090] Updated weights for policy 1, policy_version 411928 (0.0007) [2023-12-26 02:53:41,108][123091] Updated weights for policy 0, policy_version 414482 (0.0011) [2023-12-26 02:53:41,175][123091] Updated weights for policy 0, policy_version 414492 (0.0011) [2023-12-26 02:53:41,230][123091] Updated weights for policy 0, policy_version 414502 (0.0011) [2023-12-26 02:53:41,298][123091] Updated weights for policy 0, policy_version 414512 (0.0011) [2023-12-26 02:53:41,360][123090] Updated weights for policy 1, policy_version 411938 (0.0009) [2023-12-26 02:53:41,435][123090] Updated weights for policy 1, policy_version 411948 (0.0011) [2023-12-26 02:53:41,509][123090] Updated weights for policy 1, policy_version 411958 (0.0009) [2023-12-26 02:53:41,568][123090] Updated weights for policy 1, policy_version 411968 (0.0009) [2023-12-26 02:53:42,110][123091] Updated weights for policy 0, policy_version 414522 (0.0008) [2023-12-26 02:53:42,174][123091] Updated weights for policy 0, policy_version 414532 (0.0006) [2023-12-26 02:53:42,228][123091] Updated weights for policy 0, policy_version 414542 (0.0006) [2023-12-26 02:53:42,469][123090] Updated weights for policy 1, policy_version 411978 (0.0009) [2023-12-26 02:53:42,536][123090] Updated weights for policy 1, policy_version 411988 (0.0010) [2023-12-26 02:53:42,599][123090] Updated weights for policy 1, policy_version 411998 (0.0009) [2023-12-26 02:53:43,076][123091] Updated weights for policy 0, policy_version 414552 (0.0009) [2023-12-26 02:53:43,140][123091] Updated weights for policy 0, policy_version 414562 (0.0009) [2023-12-26 02:53:43,194][123091] Updated weights for policy 0, policy_version 414572 (0.0009) [2023-12-26 02:53:43,304][123090] Updated weights for policy 1, policy_version 412008 (0.0009) [2023-12-26 02:53:43,360][123090] Updated weights for policy 1, policy_version 412018 (0.0009) [2023-12-26 02:53:43,409][123090] Updated weights for policy 1, policy_version 412028 (0.0009) [2023-12-26 02:53:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 211615744. Throughput: 0: 8812.0, 1: 8842.4. Samples: 211609076. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:43,785][121949] Avg episode reward: [(0, '6063.955'), (1, '5942.172')] [2023-12-26 02:53:43,986][123091] Updated weights for policy 0, policy_version 414582 (0.0009) [2023-12-26 02:53:44,039][123091] Updated weights for policy 0, policy_version 414592 (0.0009) [2023-12-26 02:53:44,087][123091] Updated weights for policy 0, policy_version 414602 (0.0009) [2023-12-26 02:53:44,253][123090] Updated weights for policy 1, policy_version 412038 (0.0008) [2023-12-26 02:53:44,316][123090] Updated weights for policy 1, policy_version 412048 (0.0009) [2023-12-26 02:53:44,376][123090] Updated weights for policy 1, policy_version 412058 (0.0009) [2023-12-26 02:53:44,867][123091] Updated weights for policy 0, policy_version 414612 (0.0008) [2023-12-26 02:53:44,935][123091] Updated weights for policy 0, policy_version 414622 (0.0009) [2023-12-26 02:53:45,010][123091] Updated weights for policy 0, policy_version 414632 (0.0006) [2023-12-26 02:53:45,226][123090] Updated weights for policy 1, policy_version 412068 (0.0010) [2023-12-26 02:53:45,287][123090] Updated weights for policy 1, policy_version 412078 (0.0010) [2023-12-26 02:53:45,352][123090] Updated weights for policy 1, policy_version 412088 (0.0010) [2023-12-26 02:53:45,645][123091] Updated weights for policy 0, policy_version 414642 (0.0007) [2023-12-26 02:53:45,715][123091] Updated weights for policy 0, policy_version 414652 (0.0010) [2023-12-26 02:53:45,774][123091] Updated weights for policy 0, policy_version 414662 (0.0009) [2023-12-26 02:53:45,823][123091] Updated weights for policy 0, policy_version 414672 (0.0009) [2023-12-26 02:53:46,202][123090] Updated weights for policy 1, policy_version 412098 (0.0009) [2023-12-26 02:53:46,259][123090] Updated weights for policy 1, policy_version 412108 (0.0009) [2023-12-26 02:53:46,306][123090] Updated weights for policy 1, policy_version 412118 (0.0009) [2023-12-26 02:53:46,361][123090] Updated weights for policy 1, policy_version 412128 (0.0009) [2023-12-26 02:53:46,636][123091] Updated weights for policy 0, policy_version 414682 (0.0009) [2023-12-26 02:53:46,701][123091] Updated weights for policy 0, policy_version 414692 (0.0009) [2023-12-26 02:53:46,764][123091] Updated weights for policy 0, policy_version 414702 (0.0005) [2023-12-26 02:53:47,246][123090] Updated weights for policy 1, policy_version 412138 (0.0009) [2023-12-26 02:53:47,309][123090] Updated weights for policy 1, policy_version 412148 (0.0008) [2023-12-26 02:53:47,365][123090] Updated weights for policy 1, policy_version 412158 (0.0008) [2023-12-26 02:53:47,508][123091] Updated weights for policy 0, policy_version 414712 (0.0009) [2023-12-26 02:53:47,559][123091] Updated weights for policy 0, policy_version 414722 (0.0006) [2023-12-26 02:53:47,608][123091] Updated weights for policy 0, policy_version 414732 (0.0005) [2023-12-26 02:53:48,215][123090] Updated weights for policy 1, policy_version 412168 (0.0009) [2023-12-26 02:53:48,268][123090] Updated weights for policy 1, policy_version 412179 (0.0010) [2023-12-26 02:53:48,316][123090] Updated weights for policy 1, policy_version 412189 (0.0009) [2023-12-26 02:53:48,395][123091] Updated weights for policy 0, policy_version 414742 (0.0008) [2023-12-26 02:53:48,454][123091] Updated weights for policy 0, policy_version 414752 (0.0009) [2023-12-26 02:53:48,503][123091] Updated weights for policy 0, policy_version 414762 (0.0009) [2023-12-26 02:53:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 211705856. Throughput: 0: 8804.4, 1: 8847.4. Samples: 211713672. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:48,785][121949] Avg episode reward: [(0, '5967.374'), (1, '5992.383')] [2023-12-26 02:53:49,206][123090] Updated weights for policy 1, policy_version 412199 (0.0010) [2023-12-26 02:53:49,261][123090] Updated weights for policy 1, policy_version 412209 (0.0009) [2023-12-26 02:53:49,323][123090] Updated weights for policy 1, policy_version 412219 (0.0009) [2023-12-26 02:53:49,370][123091] Updated weights for policy 0, policy_version 414772 (0.0009) [2023-12-26 02:53:49,433][123091] Updated weights for policy 0, policy_version 414782 (0.0009) [2023-12-26 02:53:49,483][123091] Updated weights for policy 0, policy_version 414792 (0.0009) [2023-12-26 02:53:50,225][123091] Updated weights for policy 0, policy_version 414802 (0.0009) [2023-12-26 02:53:50,239][123090] Updated weights for policy 1, policy_version 412229 (0.0008) [2023-12-26 02:53:50,286][123091] Updated weights for policy 0, policy_version 414812 (0.0008) [2023-12-26 02:53:50,304][123090] Updated weights for policy 1, policy_version 412239 (0.0009) [2023-12-26 02:53:50,338][123091] Updated weights for policy 0, policy_version 414822 (0.0008) [2023-12-26 02:53:50,367][123090] Updated weights for policy 1, policy_version 412249 (0.0008) [2023-12-26 02:53:50,405][123091] Updated weights for policy 0, policy_version 414832 (0.0007) [2023-12-26 02:53:51,210][123090] Updated weights for policy 1, policy_version 412259 (0.0008) [2023-12-26 02:53:51,252][123091] Updated weights for policy 0, policy_version 414842 (0.0010) [2023-12-26 02:53:51,277][123090] Updated weights for policy 1, policy_version 412269 (0.0008) [2023-12-26 02:53:51,316][123091] Updated weights for policy 0, policy_version 414852 (0.0009) [2023-12-26 02:53:51,348][123090] Updated weights for policy 1, policy_version 412279 (0.0007) [2023-12-26 02:53:51,381][123091] Updated weights for policy 0, policy_version 414862 (0.0009) [2023-12-26 02:53:52,111][123090] Updated weights for policy 1, policy_version 412289 (0.0008) [2023-12-26 02:53:52,153][123091] Updated weights for policy 0, policy_version 414872 (0.0010) [2023-12-26 02:53:52,175][123090] Updated weights for policy 1, policy_version 412299 (0.0006) [2023-12-26 02:53:52,216][123091] Updated weights for policy 0, policy_version 414882 (0.0011) [2023-12-26 02:53:52,240][123090] Updated weights for policy 1, policy_version 412309 (0.0005) [2023-12-26 02:53:52,282][123091] Updated weights for policy 0, policy_version 414892 (0.0013) [2023-12-26 02:53:52,304][123090] Updated weights for policy 1, policy_version 412319 (0.0010) [2023-12-26 02:53:53,012][123091] Updated weights for policy 0, policy_version 414902 (0.0009) [2023-12-26 02:53:53,079][123091] Updated weights for policy 0, policy_version 414912 (0.0009) [2023-12-26 02:53:53,143][123090] Updated weights for policy 1, policy_version 412329 (0.0010) [2023-12-26 02:53:53,150][123091] Updated weights for policy 0, policy_version 414922 (0.0008) [2023-12-26 02:53:53,212][123090] Updated weights for policy 1, policy_version 412339 (0.0006) [2023-12-26 02:53:53,280][123090] Updated weights for policy 1, policy_version 412349 (0.0009) [2023-12-26 02:53:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 211787776. Throughput: 0: 8786.1, 1: 8796.2. Samples: 211764512. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:53,786][121949] Avg episode reward: [(0, '6001.643'), (1, '6023.126')] [2023-12-26 02:53:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000412352_105562112.pth... [2023-12-26 02:53:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000411328_105299968.pth [2023-12-26 02:53:53,800][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000412352_105562112.pth [2023-12-26 02:53:53,814][123091] Updated weights for policy 0, policy_version 414932 (0.0007) [2023-12-26 02:53:53,869][123091] Updated weights for policy 0, policy_version 414942 (0.0005) [2023-12-26 02:53:53,929][123091] Updated weights for policy 0, policy_version 414952 (0.0008) [2023-12-26 02:53:53,978][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000414960_106233856.pth... [2023-12-26 02:53:53,983][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000413904_105963520.pth [2023-12-26 02:53:53,984][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000414960_106233856.pth [2023-12-26 02:53:54,084][123090] Updated weights for policy 1, policy_version 412359 (0.0011) [2023-12-26 02:53:54,147][123090] Updated weights for policy 1, policy_version 412369 (0.0011) [2023-12-26 02:53:54,216][123090] Updated weights for policy 1, policy_version 412379 (0.0006) [2023-12-26 02:53:54,699][123091] Updated weights for policy 0, policy_version 414962 (0.0011) [2023-12-26 02:53:54,762][123091] Updated weights for policy 0, policy_version 414972 (0.0010) [2023-12-26 02:53:54,805][123091] Updated weights for policy 0, policy_version 414982 (0.0010) [2023-12-26 02:53:54,853][123091] Updated weights for policy 0, policy_version 414992 (0.0010) [2023-12-26 02:53:54,897][123090] Updated weights for policy 1, policy_version 412389 (0.0006) [2023-12-26 02:53:54,961][123090] Updated weights for policy 1, policy_version 412399 (0.0010) [2023-12-26 02:53:55,022][123090] Updated weights for policy 1, policy_version 412409 (0.0010) [2023-12-26 02:53:55,705][123091] Updated weights for policy 0, policy_version 415002 (0.0010) [2023-12-26 02:53:55,768][123091] Updated weights for policy 0, policy_version 415012 (0.0010) [2023-12-26 02:53:55,794][123090] Updated weights for policy 1, policy_version 412419 (0.0011) [2023-12-26 02:53:55,830][123091] Updated weights for policy 0, policy_version 415022 (0.0010) [2023-12-26 02:53:55,856][123090] Updated weights for policy 1, policy_version 412429 (0.0010) [2023-12-26 02:53:55,918][123090] Updated weights for policy 1, policy_version 412439 (0.0010) [2023-12-26 02:53:56,533][123091] Updated weights for policy 0, policy_version 415032 (0.0006) [2023-12-26 02:53:56,580][123091] Updated weights for policy 0, policy_version 415042 (0.0010) [2023-12-26 02:53:56,624][123090] Updated weights for policy 1, policy_version 412449 (0.0007) [2023-12-26 02:53:56,627][123091] Updated weights for policy 0, policy_version 415052 (0.0010) [2023-12-26 02:53:56,679][123090] Updated weights for policy 1, policy_version 412459 (0.0005) [2023-12-26 02:53:56,741][123090] Updated weights for policy 1, policy_version 412469 (0.0005) [2023-12-26 02:53:56,801][123090] Updated weights for policy 1, policy_version 412479 (0.0005) [2023-12-26 02:53:57,372][123091] Updated weights for policy 0, policy_version 415062 (0.0007) [2023-12-26 02:53:57,440][123091] Updated weights for policy 0, policy_version 415072 (0.0006) [2023-12-26 02:53:57,484][123090] Updated weights for policy 1, policy_version 412489 (0.0006) [2023-12-26 02:53:57,510][123091] Updated weights for policy 0, policy_version 415082 (0.0006) [2023-12-26 02:53:57,543][123090] Updated weights for policy 1, policy_version 412499 (0.0005) [2023-12-26 02:53:57,599][123090] Updated weights for policy 1, policy_version 412509 (0.0005) [2023-12-26 02:53:58,157][123091] Updated weights for policy 0, policy_version 415092 (0.0007) [2023-12-26 02:53:58,223][123091] Updated weights for policy 0, policy_version 415102 (0.0010) [2023-12-26 02:53:58,290][123091] Updated weights for policy 0, policy_version 415112 (0.0010) [2023-12-26 02:53:58,334][123090] Updated weights for policy 1, policy_version 412519 (0.0007) [2023-12-26 02:53:58,402][123090] Updated weights for policy 1, policy_version 412529 (0.0010) [2023-12-26 02:53:58,472][123090] Updated weights for policy 1, policy_version 412539 (0.0009) [2023-12-26 02:53:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 211886080. Throughput: 0: 8924.7, 1: 8882.7. Samples: 211877376. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:53:58,785][121949] Avg episode reward: [(0, '6154.089'), (1, '5945.998')] [2023-12-26 02:53:59,084][123091] Updated weights for policy 0, policy_version 415122 (0.0009) [2023-12-26 02:53:59,130][123091] Updated weights for policy 0, policy_version 415132 (0.0010) [2023-12-26 02:53:59,189][123091] Updated weights for policy 0, policy_version 415142 (0.0007) [2023-12-26 02:53:59,267][123091] Updated weights for policy 0, policy_version 415152 (0.0007) [2023-12-26 02:53:59,343][123090] Updated weights for policy 1, policy_version 412549 (0.0010) [2023-12-26 02:53:59,407][123090] Updated weights for policy 1, policy_version 412559 (0.0009) [2023-12-26 02:53:59,460][123090] Updated weights for policy 1, policy_version 412569 (0.0009) [2023-12-26 02:54:00,060][123091] Updated weights for policy 0, policy_version 415162 (0.0006) [2023-12-26 02:54:00,136][123091] Updated weights for policy 0, policy_version 415172 (0.0006) [2023-12-26 02:54:00,204][123091] Updated weights for policy 0, policy_version 415182 (0.0009) [2023-12-26 02:54:00,371][123090] Updated weights for policy 1, policy_version 412579 (0.0010) [2023-12-26 02:54:00,440][123090] Updated weights for policy 1, policy_version 412589 (0.0010) [2023-12-26 02:54:00,502][123090] Updated weights for policy 1, policy_version 412599 (0.0010) [2023-12-26 02:54:00,918][123091] Updated weights for policy 0, policy_version 415192 (0.0006) [2023-12-26 02:54:00,965][123091] Updated weights for policy 0, policy_version 415202 (0.0005) [2023-12-26 02:54:01,028][123091] Updated weights for policy 0, policy_version 415212 (0.0007) [2023-12-26 02:54:01,331][123090] Updated weights for policy 1, policy_version 412609 (0.0009) [2023-12-26 02:54:01,400][123090] Updated weights for policy 1, policy_version 412619 (0.0008) [2023-12-26 02:54:01,458][123090] Updated weights for policy 1, policy_version 412629 (0.0008) [2023-12-26 02:54:01,527][123090] Updated weights for policy 1, policy_version 412639 (0.0008) [2023-12-26 02:54:01,727][123091] Updated weights for policy 0, policy_version 415222 (0.0009) [2023-12-26 02:54:01,786][123091] Updated weights for policy 0, policy_version 415232 (0.0008) [2023-12-26 02:54:01,843][123091] Updated weights for policy 0, policy_version 415242 (0.0005) [2023-12-26 02:54:02,378][123090] Updated weights for policy 1, policy_version 412649 (0.0008) [2023-12-26 02:54:02,453][123090] Updated weights for policy 1, policy_version 412659 (0.0008) [2023-12-26 02:54:02,520][123090] Updated weights for policy 1, policy_version 412669 (0.0009) [2023-12-26 02:54:02,599][123091] Updated weights for policy 0, policy_version 415252 (0.0005) [2023-12-26 02:54:02,666][123091] Updated weights for policy 0, policy_version 415262 (0.0006) [2023-12-26 02:54:02,737][123091] Updated weights for policy 0, policy_version 415272 (0.0007) [2023-12-26 02:54:03,341][123090] Updated weights for policy 1, policy_version 412679 (0.0010) [2023-12-26 02:54:03,397][123090] Updated weights for policy 1, policy_version 412689 (0.0009) [2023-12-26 02:54:03,458][123090] Updated weights for policy 1, policy_version 412699 (0.0010) [2023-12-26 02:54:03,502][123091] Updated weights for policy 0, policy_version 415282 (0.0010) [2023-12-26 02:54:03,552][123091] Updated weights for policy 0, policy_version 415292 (0.0010) [2023-12-26 02:54:03,610][123091] Updated weights for policy 0, policy_version 415302 (0.0010) [2023-12-26 02:54:03,657][123091] Updated weights for policy 0, policy_version 415312 (0.0010) [2023-12-26 02:54:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 211976192. Throughput: 0: 8891.0, 1: 8788.7. Samples: 211983800. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:03,785][121949] Avg episode reward: [(0, '6148.484'), (1, '5936.715')] [2023-12-26 02:54:04,260][123090] Updated weights for policy 1, policy_version 412709 (0.0011) [2023-12-26 02:54:04,327][123090] Updated weights for policy 1, policy_version 412719 (0.0011) [2023-12-26 02:54:04,395][123090] Updated weights for policy 1, policy_version 412729 (0.0010) [2023-12-26 02:54:04,537][123091] Updated weights for policy 0, policy_version 415322 (0.0009) [2023-12-26 02:54:04,606][123091] Updated weights for policy 0, policy_version 415332 (0.0008) [2023-12-26 02:54:04,669][123091] Updated weights for policy 0, policy_version 415342 (0.0008) [2023-12-26 02:54:05,215][123090] Updated weights for policy 1, policy_version 412739 (0.0011) [2023-12-26 02:54:05,278][123090] Updated weights for policy 1, policy_version 412749 (0.0010) [2023-12-26 02:54:05,333][123090] Updated weights for policy 1, policy_version 412759 (0.0010) [2023-12-26 02:54:05,362][123091] Updated weights for policy 0, policy_version 415352 (0.0010) [2023-12-26 02:54:05,425][123091] Updated weights for policy 0, policy_version 415362 (0.0007) [2023-12-26 02:54:05,495][123091] Updated weights for policy 0, policy_version 415372 (0.0008) [2023-12-26 02:54:06,158][123090] Updated weights for policy 1, policy_version 412769 (0.0011) [2023-12-26 02:54:06,214][123090] Updated weights for policy 1, policy_version 412779 (0.0011) [2023-12-26 02:54:06,248][123091] Updated weights for policy 0, policy_version 415382 (0.0010) [2023-12-26 02:54:06,279][123090] Updated weights for policy 1, policy_version 412789 (0.0010) [2023-12-26 02:54:06,309][123091] Updated weights for policy 0, policy_version 415392 (0.0006) [2023-12-26 02:54:06,343][123090] Updated weights for policy 1, policy_version 412799 (0.0011) [2023-12-26 02:54:06,363][123091] Updated weights for policy 0, policy_version 415402 (0.0005) [2023-12-26 02:54:07,032][123091] Updated weights for policy 0, policy_version 415412 (0.0008) [2023-12-26 02:54:07,094][123091] Updated weights for policy 0, policy_version 415422 (0.0010) [2023-12-26 02:54:07,155][123091] Updated weights for policy 0, policy_version 415432 (0.0009) [2023-12-26 02:54:07,210][123090] Updated weights for policy 1, policy_version 412809 (0.0011) [2023-12-26 02:54:07,273][123090] Updated weights for policy 1, policy_version 412819 (0.0011) [2023-12-26 02:54:07,329][123090] Updated weights for policy 1, policy_version 412829 (0.0010) [2023-12-26 02:54:07,829][123091] Updated weights for policy 0, policy_version 415442 (0.0005) [2023-12-26 02:54:07,891][123091] Updated weights for policy 0, policy_version 415452 (0.0005) [2023-12-26 02:54:07,956][123091] Updated weights for policy 0, policy_version 415462 (0.0005) [2023-12-26 02:54:08,021][123091] Updated weights for policy 0, policy_version 415472 (0.0006) [2023-12-26 02:54:08,144][123090] Updated weights for policy 1, policy_version 412839 (0.0010) [2023-12-26 02:54:08,196][123090] Updated weights for policy 1, policy_version 412849 (0.0010) [2023-12-26 02:54:08,259][123090] Updated weights for policy 1, policy_version 412859 (0.0010) [2023-12-26 02:54:08,718][123091] Updated weights for policy 0, policy_version 415482 (0.0011) [2023-12-26 02:54:08,784][123091] Updated weights for policy 0, policy_version 415492 (0.0011) [2023-12-26 02:54:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 212058112. Throughput: 0: 8937.1, 1: 8775.4. Samples: 212037276. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:08,785][121949] Avg episode reward: [(0, '6145.295'), (1, '5993.944')] [2023-12-26 02:54:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000412864_105693184.pth... [2023-12-26 02:54:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000411872_105439232.pth [2023-12-26 02:54:08,839][123091] Updated weights for policy 0, policy_version 415502 (0.0011) [2023-12-26 02:54:08,846][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000415504_106373120.pth... [2023-12-26 02:54:08,849][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000414416_106094592.pth [2023-12-26 02:54:09,089][123090] Updated weights for policy 1, policy_version 412869 (0.0009) [2023-12-26 02:54:09,155][123090] Updated weights for policy 1, policy_version 412879 (0.0010) [2023-12-26 02:54:09,206][123090] Updated weights for policy 1, policy_version 412889 (0.0010) [2023-12-26 02:54:09,658][123091] Updated weights for policy 0, policy_version 415512 (0.0009) [2023-12-26 02:54:09,709][123091] Updated weights for policy 0, policy_version 415522 (0.0008) [2023-12-26 02:54:09,764][123091] Updated weights for policy 0, policy_version 415532 (0.0005) [2023-12-26 02:54:10,040][123090] Updated weights for policy 1, policy_version 412899 (0.0007) [2023-12-26 02:54:10,118][123090] Updated weights for policy 1, policy_version 412909 (0.0006) [2023-12-26 02:54:10,178][123090] Updated weights for policy 1, policy_version 412919 (0.0008) [2023-12-26 02:54:10,555][123091] Updated weights for policy 0, policy_version 415542 (0.0005) [2023-12-26 02:54:10,627][123091] Updated weights for policy 0, policy_version 415552 (0.0006) [2023-12-26 02:54:10,675][123091] Updated weights for policy 0, policy_version 415562 (0.0005) [2023-12-26 02:54:10,865][123090] Updated weights for policy 1, policy_version 412929 (0.0008) [2023-12-26 02:54:10,923][123090] Updated weights for policy 1, policy_version 412939 (0.0005) [2023-12-26 02:54:10,985][123090] Updated weights for policy 1, policy_version 412949 (0.0007) [2023-12-26 02:54:11,059][123090] Updated weights for policy 1, policy_version 412959 (0.0008) [2023-12-26 02:54:11,412][123091] Updated weights for policy 0, policy_version 415572 (0.0007) [2023-12-26 02:54:11,475][123091] Updated weights for policy 0, policy_version 415582 (0.0006) [2023-12-26 02:54:11,532][123091] Updated weights for policy 0, policy_version 415592 (0.0005) [2023-12-26 02:54:11,825][123090] Updated weights for policy 1, policy_version 412969 (0.0008) [2023-12-26 02:54:11,888][123090] Updated weights for policy 1, policy_version 412979 (0.0008) [2023-12-26 02:54:11,944][123090] Updated weights for policy 1, policy_version 412989 (0.0008) [2023-12-26 02:54:12,309][123091] Updated weights for policy 0, policy_version 415602 (0.0007) [2023-12-26 02:54:12,374][123091] Updated weights for policy 0, policy_version 415612 (0.0009) [2023-12-26 02:54:12,438][123091] Updated weights for policy 0, policy_version 415622 (0.0011) [2023-12-26 02:54:12,490][123091] Updated weights for policy 0, policy_version 415632 (0.0010) [2023-12-26 02:54:12,737][123090] Updated weights for policy 1, policy_version 412999 (0.0009) [2023-12-26 02:54:12,790][123090] Updated weights for policy 1, policy_version 413009 (0.0006) [2023-12-26 02:54:12,842][123090] Updated weights for policy 1, policy_version 413019 (0.0009) [2023-12-26 02:54:13,290][123091] Updated weights for policy 0, policy_version 415642 (0.0006) [2023-12-26 02:54:13,369][123091] Updated weights for policy 0, policy_version 415652 (0.0007) [2023-12-26 02:54:13,434][123091] Updated weights for policy 0, policy_version 415662 (0.0010) [2023-12-26 02:54:13,545][123090] Updated weights for policy 1, policy_version 413029 (0.0007) [2023-12-26 02:54:13,599][123090] Updated weights for policy 1, policy_version 413039 (0.0006) [2023-12-26 02:54:13,656][123090] Updated weights for policy 1, policy_version 413049 (0.0006) [2023-12-26 02:54:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 212156416. Throughput: 0: 9024.3, 1: 8726.9. Samples: 212146020. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:13,785][121949] Avg episode reward: [(0, '5961.182'), (1, '6009.693')] [2023-12-26 02:54:14,221][123091] Updated weights for policy 0, policy_version 415672 (0.0010) [2023-12-26 02:54:14,320][123091] Updated weights for policy 0, policy_version 415682 (0.0010) [2023-12-26 02:54:14,331][123090] Updated weights for policy 1, policy_version 413059 (0.0007) [2023-12-26 02:54:14,386][123091] Updated weights for policy 0, policy_version 415692 (0.0009) [2023-12-26 02:54:14,393][123090] Updated weights for policy 1, policy_version 413069 (0.0005) [2023-12-26 02:54:14,453][123090] Updated weights for policy 1, policy_version 413079 (0.0005) [2023-12-26 02:54:15,167][123090] Updated weights for policy 1, policy_version 413089 (0.0007) [2023-12-26 02:54:15,234][123090] Updated weights for policy 1, policy_version 413099 (0.0009) [2023-12-26 02:54:15,235][123091] Updated weights for policy 0, policy_version 415702 (0.0007) [2023-12-26 02:54:15,299][123090] Updated weights for policy 1, policy_version 413109 (0.0007) [2023-12-26 02:54:15,301][123091] Updated weights for policy 0, policy_version 415712 (0.0009) [2023-12-26 02:54:15,366][123090] Updated weights for policy 1, policy_version 413119 (0.0007) [2023-12-26 02:54:15,368][123091] Updated weights for policy 0, policy_version 415722 (0.0009) [2023-12-26 02:54:16,099][123090] Updated weights for policy 1, policy_version 413129 (0.0005) [2023-12-26 02:54:16,166][123090] Updated weights for policy 1, policy_version 413139 (0.0005) [2023-12-26 02:54:16,180][123091] Updated weights for policy 0, policy_version 415732 (0.0008) [2023-12-26 02:54:16,220][123090] Updated weights for policy 1, policy_version 413149 (0.0005) [2023-12-26 02:54:16,244][123091] Updated weights for policy 0, policy_version 415742 (0.0006) [2023-12-26 02:54:16,307][123091] Updated weights for policy 0, policy_version 415752 (0.0009) [2023-12-26 02:54:16,957][123090] Updated weights for policy 1, policy_version 413159 (0.0008) [2023-12-26 02:54:17,012][123090] Updated weights for policy 1, policy_version 413169 (0.0009) [2023-12-26 02:54:17,069][123090] Updated weights for policy 1, policy_version 413179 (0.0009) [2023-12-26 02:54:17,120][123091] Updated weights for policy 0, policy_version 415762 (0.0010) [2023-12-26 02:54:17,189][123091] Updated weights for policy 0, policy_version 415772 (0.0010) [2023-12-26 02:54:17,240][123091] Updated weights for policy 0, policy_version 415782 (0.0010) [2023-12-26 02:54:17,287][123091] Updated weights for policy 0, policy_version 415792 (0.0010) [2023-12-26 02:54:17,917][123090] Updated weights for policy 1, policy_version 413189 (0.0008) [2023-12-26 02:54:17,981][123090] Updated weights for policy 1, policy_version 413199 (0.0009) [2023-12-26 02:54:18,038][123090] Updated weights for policy 1, policy_version 413209 (0.0009) [2023-12-26 02:54:18,103][123091] Updated weights for policy 0, policy_version 415802 (0.0011) [2023-12-26 02:54:18,169][123091] Updated weights for policy 0, policy_version 415812 (0.0010) [2023-12-26 02:54:18,223][123091] Updated weights for policy 0, policy_version 415822 (0.0010) [2023-12-26 02:54:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 212238336. Throughput: 0: 9033.5, 1: 8774.7. Samples: 212253484. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:18,784][121949] Avg episode reward: [(0, '5812.170'), (1, '5922.312')] [2023-12-26 02:54:18,932][123090] Updated weights for policy 1, policy_version 413219 (0.0006) [2023-12-26 02:54:18,938][123091] Updated weights for policy 0, policy_version 415832 (0.0010) [2023-12-26 02:54:18,996][123090] Updated weights for policy 1, policy_version 413229 (0.0006) [2023-12-26 02:54:19,003][123091] Updated weights for policy 0, policy_version 415842 (0.0009) [2023-12-26 02:54:19,052][123090] Updated weights for policy 1, policy_version 413239 (0.0008) [2023-12-26 02:54:19,064][123091] Updated weights for policy 0, policy_version 415852 (0.0008) [2023-12-26 02:54:19,865][123090] Updated weights for policy 1, policy_version 413249 (0.0009) [2023-12-26 02:54:19,906][123091] Updated weights for policy 0, policy_version 415862 (0.0009) [2023-12-26 02:54:19,926][123090] Updated weights for policy 1, policy_version 413259 (0.0007) [2023-12-26 02:54:19,975][123091] Updated weights for policy 0, policy_version 415872 (0.0007) [2023-12-26 02:54:19,995][123090] Updated weights for policy 1, policy_version 413269 (0.0007) [2023-12-26 02:54:20,042][123091] Updated weights for policy 0, policy_version 415882 (0.0008) [2023-12-26 02:54:20,064][123090] Updated weights for policy 1, policy_version 413279 (0.0007) [2023-12-26 02:54:20,836][123090] Updated weights for policy 1, policy_version 413289 (0.0009) [2023-12-26 02:54:20,898][123090] Updated weights for policy 1, policy_version 413299 (0.0010) [2023-12-26 02:54:20,915][123091] Updated weights for policy 0, policy_version 415892 (0.0010) [2023-12-26 02:54:20,966][123090] Updated weights for policy 1, policy_version 413309 (0.0008) [2023-12-26 02:54:20,977][123091] Updated weights for policy 0, policy_version 415902 (0.0007) [2023-12-26 02:54:21,046][123091] Updated weights for policy 0, policy_version 415912 (0.0009) [2023-12-26 02:54:21,782][123090] Updated weights for policy 1, policy_version 413319 (0.0009) [2023-12-26 02:54:21,853][123090] Updated weights for policy 1, policy_version 413329 (0.0011) [2023-12-26 02:54:21,872][123091] Updated weights for policy 0, policy_version 415922 (0.0009) [2023-12-26 02:54:21,913][123090] Updated weights for policy 1, policy_version 413339 (0.0011) [2023-12-26 02:54:21,934][123091] Updated weights for policy 0, policy_version 415932 (0.0006) [2023-12-26 02:54:21,999][123091] Updated weights for policy 0, policy_version 415942 (0.0009) [2023-12-26 02:54:22,068][123091] Updated weights for policy 0, policy_version 415952 (0.0009) [2023-12-26 02:54:22,757][123090] Updated weights for policy 1, policy_version 413349 (0.0011) [2023-12-26 02:54:22,819][123090] Updated weights for policy 1, policy_version 413359 (0.0010) [2023-12-26 02:54:22,880][123090] Updated weights for policy 1, policy_version 413369 (0.0008) [2023-12-26 02:54:22,897][123091] Updated weights for policy 0, policy_version 415962 (0.0007) [2023-12-26 02:54:22,963][123091] Updated weights for policy 0, policy_version 415972 (0.0010) [2023-12-26 02:54:23,020][123091] Updated weights for policy 0, policy_version 415982 (0.0010) [2023-12-26 02:54:23,600][123090] Updated weights for policy 1, policy_version 413379 (0.0006) [2023-12-26 02:54:23,651][123090] Updated weights for policy 1, policy_version 413389 (0.0005) [2023-12-26 02:54:23,700][123090] Updated weights for policy 1, policy_version 413399 (0.0005) [2023-12-26 02:54:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 212328448. Throughput: 0: 9041.4, 1: 8726.0. Samples: 212304648. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:23,784][121949] Avg episode reward: [(0, '5888.810'), (1, '5902.801')] [2023-12-26 02:54:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000415984_106496000.pth... [2023-12-26 02:54:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000413408_105832448.pth... [2023-12-26 02:54:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000412352_105562112.pth [2023-12-26 02:54:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000414960_106233856.pth [2023-12-26 02:54:23,948][123091] Updated weights for policy 0, policy_version 415992 (0.0010) [2023-12-26 02:54:24,009][123091] Updated weights for policy 0, policy_version 416002 (0.0009) [2023-12-26 02:54:24,073][123091] Updated weights for policy 0, policy_version 416012 (0.0009) [2023-12-26 02:54:24,490][123090] Updated weights for policy 1, policy_version 413409 (0.0006) [2023-12-26 02:54:24,552][123090] Updated weights for policy 1, policy_version 413419 (0.0010) [2023-12-26 02:54:24,618][123090] Updated weights for policy 1, policy_version 413429 (0.0010) [2023-12-26 02:54:24,670][123090] Updated weights for policy 1, policy_version 413439 (0.0010) [2023-12-26 02:54:24,880][123091] Updated weights for policy 0, policy_version 416022 (0.0009) [2023-12-26 02:54:24,929][123091] Updated weights for policy 0, policy_version 416032 (0.0009) [2023-12-26 02:54:24,988][123091] Updated weights for policy 0, policy_version 416042 (0.0006) [2023-12-26 02:54:25,488][123090] Updated weights for policy 1, policy_version 413449 (0.0010) [2023-12-26 02:54:25,535][123090] Updated weights for policy 1, policy_version 413459 (0.0010) [2023-12-26 02:54:25,583][123090] Updated weights for policy 1, policy_version 413469 (0.0010) [2023-12-26 02:54:25,736][123091] Updated weights for policy 0, policy_version 416052 (0.0007) [2023-12-26 02:54:25,794][123091] Updated weights for policy 0, policy_version 416062 (0.0009) [2023-12-26 02:54:25,847][123091] Updated weights for policy 0, policy_version 416072 (0.0009) [2023-12-26 02:54:26,464][123090] Updated weights for policy 1, policy_version 413479 (0.0010) [2023-12-26 02:54:26,545][123090] Updated weights for policy 1, policy_version 413489 (0.0011) [2023-12-26 02:54:26,562][123091] Updated weights for policy 0, policy_version 416082 (0.0009) [2023-12-26 02:54:26,615][123090] Updated weights for policy 1, policy_version 413499 (0.0011) [2023-12-26 02:54:26,633][123091] Updated weights for policy 0, policy_version 416092 (0.0006) [2023-12-26 02:54:26,691][123091] Updated weights for policy 0, policy_version 416102 (0.0006) [2023-12-26 02:54:26,759][123091] Updated weights for policy 0, policy_version 416112 (0.0007) [2023-12-26 02:54:27,267][123090] Updated weights for policy 1, policy_version 413509 (0.0009) [2023-12-26 02:54:27,326][123090] Updated weights for policy 1, policy_version 413519 (0.0005) [2023-12-26 02:54:27,379][123090] Updated weights for policy 1, policy_version 413529 (0.0007) [2023-12-26 02:54:27,386][123091] Updated weights for policy 0, policy_version 416122 (0.0005) [2023-12-26 02:54:27,439][123091] Updated weights for policy 0, policy_version 416132 (0.0005) [2023-12-26 02:54:27,487][123091] Updated weights for policy 0, policy_version 416142 (0.0005) [2023-12-26 02:54:28,116][123090] Updated weights for policy 1, policy_version 413539 (0.0006) [2023-12-26 02:54:28,160][123091] Updated weights for policy 0, policy_version 416152 (0.0005) [2023-12-26 02:54:28,165][123090] Updated weights for policy 1, policy_version 413549 (0.0009) [2023-12-26 02:54:28,215][123091] Updated weights for policy 0, policy_version 416162 (0.0005) [2023-12-26 02:54:28,221][123090] Updated weights for policy 1, policy_version 413559 (0.0007) [2023-12-26 02:54:28,265][123091] Updated weights for policy 0, policy_version 416172 (0.0005) [2023-12-26 02:54:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 212418560. Throughput: 0: 9047.9, 1: 8809.7. Samples: 212412668. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:28,785][121949] Avg episode reward: [(0, '6006.460'), (1, '5909.825')] [2023-12-26 02:54:29,067][123091] Updated weights for policy 0, policy_version 416182 (0.0005) [2023-12-26 02:54:29,089][123090] Updated weights for policy 1, policy_version 413569 (0.0008) [2023-12-26 02:54:29,131][123091] Updated weights for policy 0, policy_version 416192 (0.0007) [2023-12-26 02:54:29,141][123090] Updated weights for policy 1, policy_version 413579 (0.0009) [2023-12-26 02:54:29,180][123091] Updated weights for policy 0, policy_version 416202 (0.0008) [2023-12-26 02:54:29,193][123090] Updated weights for policy 1, policy_version 413589 (0.0008) [2023-12-26 02:54:29,256][123090] Updated weights for policy 1, policy_version 413599 (0.0009) [2023-12-26 02:54:29,807][123091] Updated weights for policy 0, policy_version 416212 (0.0006) [2023-12-26 02:54:29,880][123091] Updated weights for policy 0, policy_version 416222 (0.0008) [2023-12-26 02:54:29,952][123091] Updated weights for policy 0, policy_version 416232 (0.0010) [2023-12-26 02:54:30,155][123090] Updated weights for policy 1, policy_version 413609 (0.0009) [2023-12-26 02:54:30,212][123090] Updated weights for policy 1, policy_version 413619 (0.0008) [2023-12-26 02:54:30,270][123090] Updated weights for policy 1, policy_version 413629 (0.0008) [2023-12-26 02:54:30,746][123091] Updated weights for policy 0, policy_version 416242 (0.0011) [2023-12-26 02:54:30,808][123091] Updated weights for policy 0, policy_version 416252 (0.0011) [2023-12-26 02:54:30,871][123091] Updated weights for policy 0, policy_version 416262 (0.0005) [2023-12-26 02:54:30,930][123091] Updated weights for policy 0, policy_version 416272 (0.0005) [2023-12-26 02:54:31,066][123090] Updated weights for policy 1, policy_version 413639 (0.0009) [2023-12-26 02:54:31,128][123090] Updated weights for policy 1, policy_version 413649 (0.0009) [2023-12-26 02:54:31,193][123090] Updated weights for policy 1, policy_version 413659 (0.0009) [2023-12-26 02:54:31,741][123091] Updated weights for policy 0, policy_version 416282 (0.0009) [2023-12-26 02:54:31,800][123091] Updated weights for policy 0, policy_version 416292 (0.0011) [2023-12-26 02:54:31,866][123091] Updated weights for policy 0, policy_version 416302 (0.0011) [2023-12-26 02:54:31,933][123090] Updated weights for policy 1, policy_version 413669 (0.0009) [2023-12-26 02:54:31,990][123090] Updated weights for policy 1, policy_version 413679 (0.0009) [2023-12-26 02:54:32,047][123090] Updated weights for policy 1, policy_version 413689 (0.0008) [2023-12-26 02:54:32,596][123091] Updated weights for policy 0, policy_version 416312 (0.0006) [2023-12-26 02:54:32,651][123091] Updated weights for policy 0, policy_version 416322 (0.0006) [2023-12-26 02:54:32,713][123091] Updated weights for policy 0, policy_version 416332 (0.0011) [2023-12-26 02:54:32,899][123090] Updated weights for policy 1, policy_version 413699 (0.0010) [2023-12-26 02:54:32,966][123090] Updated weights for policy 1, policy_version 413709 (0.0010) [2023-12-26 02:54:33,028][123090] Updated weights for policy 1, policy_version 413719 (0.0010) [2023-12-26 02:54:33,452][123091] Updated weights for policy 0, policy_version 416342 (0.0011) [2023-12-26 02:54:33,510][123091] Updated weights for policy 0, policy_version 416352 (0.0009) [2023-12-26 02:54:33,578][123091] Updated weights for policy 0, policy_version 416362 (0.0005) [2023-12-26 02:54:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 212508672. Throughput: 0: 9111.8, 1: 8823.2. Samples: 212520748. Policy #0 lag: (min: 31.0, avg: 40.6, max: 63.0) [2023-12-26 02:54:33,784][121949] Avg episode reward: [(0, '5976.257'), (1, '5832.292')] [2023-12-26 02:54:33,809][123090] Updated weights for policy 1, policy_version 413729 (0.0009) [2023-12-26 02:54:33,867][123090] Updated weights for policy 1, policy_version 413739 (0.0006) [2023-12-26 02:54:33,940][123090] Updated weights for policy 1, policy_version 413749 (0.0005) [2023-12-26 02:54:34,001][123090] Updated weights for policy 1, policy_version 413759 (0.0009) [2023-12-26 02:54:34,349][123091] Updated weights for policy 0, policy_version 416372 (0.0005) [2023-12-26 02:54:34,418][123091] Updated weights for policy 0, policy_version 416382 (0.0006) [2023-12-26 02:54:34,487][123091] Updated weights for policy 0, policy_version 416392 (0.0010) [2023-12-26 02:54:34,784][123090] Updated weights for policy 1, policy_version 413769 (0.0006) [2023-12-26 02:54:34,853][123090] Updated weights for policy 1, policy_version 413779 (0.0005) [2023-12-26 02:54:34,908][123090] Updated weights for policy 1, policy_version 413789 (0.0006) [2023-12-26 02:54:35,278][123091] Updated weights for policy 0, policy_version 416402 (0.0011) [2023-12-26 02:54:35,329][123091] Updated weights for policy 0, policy_version 416412 (0.0010) [2023-12-26 02:54:35,380][123091] Updated weights for policy 0, policy_version 416422 (0.0010) [2023-12-26 02:54:35,433][123091] Updated weights for policy 0, policy_version 416432 (0.0010) [2023-12-26 02:54:35,662][123090] Updated weights for policy 1, policy_version 413799 (0.0009) [2023-12-26 02:54:35,725][123090] Updated weights for policy 1, policy_version 413809 (0.0010) [2023-12-26 02:54:35,779][123090] Updated weights for policy 1, policy_version 413819 (0.0010) [2023-12-26 02:54:36,299][123091] Updated weights for policy 0, policy_version 416442 (0.0009) [2023-12-26 02:54:36,375][123091] Updated weights for policy 0, policy_version 416452 (0.0009) [2023-12-26 02:54:36,440][123091] Updated weights for policy 0, policy_version 416462 (0.0009) [2023-12-26 02:54:36,573][123090] Updated weights for policy 1, policy_version 413829 (0.0010) [2023-12-26 02:54:36,629][123090] Updated weights for policy 1, policy_version 413839 (0.0010) [2023-12-26 02:54:36,681][123090] Updated weights for policy 1, policy_version 413849 (0.0010) [2023-12-26 02:54:37,222][123091] Updated weights for policy 0, policy_version 416472 (0.0009) [2023-12-26 02:54:37,286][123091] Updated weights for policy 0, policy_version 416482 (0.0008) [2023-12-26 02:54:37,349][123091] Updated weights for policy 0, policy_version 416492 (0.0009) [2023-12-26 02:54:37,522][123090] Updated weights for policy 1, policy_version 413859 (0.0011) [2023-12-26 02:54:37,588][123090] Updated weights for policy 1, policy_version 413869 (0.0010) [2023-12-26 02:54:37,650][123090] Updated weights for policy 1, policy_version 413879 (0.0010) [2023-12-26 02:54:38,028][123091] Updated weights for policy 0, policy_version 416502 (0.0009) [2023-12-26 02:54:38,102][123091] Updated weights for policy 0, policy_version 416512 (0.0006) [2023-12-26 02:54:38,174][123091] Updated weights for policy 0, policy_version 416522 (0.0006) [2023-12-26 02:54:38,468][123090] Updated weights for policy 1, policy_version 413889 (0.0011) [2023-12-26 02:54:38,536][123090] Updated weights for policy 1, policy_version 413899 (0.0009) [2023-12-26 02:54:38,614][123090] Updated weights for policy 1, policy_version 413909 (0.0011) [2023-12-26 02:54:38,666][123090] Updated weights for policy 1, policy_version 413919 (0.0010) [2023-12-26 02:54:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 212598784. Throughput: 0: 9105.7, 1: 8874.8. Samples: 212573632. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:54:38,785][121949] Avg episode reward: [(0, '5839.929'), (1, '5816.107')] [2023-12-26 02:54:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000416528_106635264.pth... [2023-12-26 02:54:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000413920_105963520.pth... [2023-12-26 02:54:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000412864_105693184.pth [2023-12-26 02:54:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000415504_106373120.pth [2023-12-26 02:54:38,928][123091] Updated weights for policy 0, policy_version 416532 (0.0008) [2023-12-26 02:54:38,992][123091] Updated weights for policy 0, policy_version 416542 (0.0009) [2023-12-26 02:54:39,050][123091] Updated weights for policy 0, policy_version 416552 (0.0010) [2023-12-26 02:54:39,323][123090] Updated weights for policy 1, policy_version 413929 (0.0010) [2023-12-26 02:54:39,388][123090] Updated weights for policy 1, policy_version 413939 (0.0009) [2023-12-26 02:54:39,458][123090] Updated weights for policy 1, policy_version 413949 (0.0010) [2023-12-26 02:54:39,816][123091] Updated weights for policy 0, policy_version 416562 (0.0007) [2023-12-26 02:54:39,890][123091] Updated weights for policy 0, policy_version 416572 (0.0009) [2023-12-26 02:54:39,962][123091] Updated weights for policy 0, policy_version 416582 (0.0011) [2023-12-26 02:54:40,030][123091] Updated weights for policy 0, policy_version 416592 (0.0011) [2023-12-26 02:54:40,317][123090] Updated weights for policy 1, policy_version 413959 (0.0010) [2023-12-26 02:54:40,385][123090] Updated weights for policy 1, policy_version 413969 (0.0010) [2023-12-26 02:54:40,454][123090] Updated weights for policy 1, policy_version 413979 (0.0010) [2023-12-26 02:54:40,800][123091] Updated weights for policy 0, policy_version 416602 (0.0010) [2023-12-26 02:54:40,863][123091] Updated weights for policy 0, policy_version 416612 (0.0011) [2023-12-26 02:54:40,917][123091] Updated weights for policy 0, policy_version 416622 (0.0007) [2023-12-26 02:54:41,390][123090] Updated weights for policy 1, policy_version 413989 (0.0009) [2023-12-26 02:54:41,446][123090] Updated weights for policy 1, policy_version 413999 (0.0010) [2023-12-26 02:54:41,520][123090] Updated weights for policy 1, policy_version 414009 (0.0009) [2023-12-26 02:54:41,743][123091] Updated weights for policy 0, policy_version 416632 (0.0008) [2023-12-26 02:54:41,811][123091] Updated weights for policy 0, policy_version 416642 (0.0009) [2023-12-26 02:54:41,869][123091] Updated weights for policy 0, policy_version 416652 (0.0008) [2023-12-26 02:54:42,407][123090] Updated weights for policy 1, policy_version 414019 (0.0009) [2023-12-26 02:54:42,480][123090] Updated weights for policy 1, policy_version 414029 (0.0006) [2023-12-26 02:54:42,548][123090] Updated weights for policy 1, policy_version 414039 (0.0006) [2023-12-26 02:54:42,692][123091] Updated weights for policy 0, policy_version 416662 (0.0009) [2023-12-26 02:54:42,757][123091] Updated weights for policy 0, policy_version 416672 (0.0009) [2023-12-26 02:54:42,817][123091] Updated weights for policy 0, policy_version 416682 (0.0009) [2023-12-26 02:54:43,343][123090] Updated weights for policy 1, policy_version 414049 (0.0006) [2023-12-26 02:54:43,409][123090] Updated weights for policy 1, policy_version 414059 (0.0010) [2023-12-26 02:54:43,472][123090] Updated weights for policy 1, policy_version 414069 (0.0010) [2023-12-26 02:54:43,522][123090] Updated weights for policy 1, policy_version 414079 (0.0010) [2023-12-26 02:54:43,607][123091] Updated weights for policy 0, policy_version 416692 (0.0008) [2023-12-26 02:54:43,664][123091] Updated weights for policy 0, policy_version 416702 (0.0010) [2023-12-26 02:54:43,726][123091] Updated weights for policy 0, policy_version 416712 (0.0010) [2023-12-26 02:54:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 212688896. Throughput: 0: 9050.1, 1: 8735.1. Samples: 212677712. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:54:43,785][121949] Avg episode reward: [(0, '5807.280'), (1, '5878.264')] [2023-12-26 02:54:44,332][123090] Updated weights for policy 1, policy_version 414089 (0.0009) [2023-12-26 02:54:44,393][123090] Updated weights for policy 1, policy_version 414099 (0.0009) [2023-12-26 02:54:44,456][123090] Updated weights for policy 1, policy_version 414109 (0.0009) [2023-12-26 02:54:44,513][123091] Updated weights for policy 0, policy_version 416722 (0.0011) [2023-12-26 02:54:44,578][123091] Updated weights for policy 0, policy_version 416732 (0.0010) [2023-12-26 02:54:44,649][123091] Updated weights for policy 0, policy_version 416742 (0.0010) [2023-12-26 02:54:44,706][123091] Updated weights for policy 0, policy_version 416752 (0.0009) [2023-12-26 02:54:45,301][123090] Updated weights for policy 1, policy_version 414119 (0.0008) [2023-12-26 02:54:45,356][123090] Updated weights for policy 1, policy_version 414129 (0.0005) [2023-12-26 02:54:45,404][123090] Updated weights for policy 1, policy_version 414139 (0.0005) [2023-12-26 02:54:45,563][123091] Updated weights for policy 0, policy_version 416762 (0.0009) [2023-12-26 02:54:45,621][123091] Updated weights for policy 0, policy_version 416772 (0.0009) [2023-12-26 02:54:45,676][123091] Updated weights for policy 0, policy_version 416782 (0.0010) [2023-12-26 02:54:46,208][123090] Updated weights for policy 1, policy_version 414149 (0.0009) [2023-12-26 02:54:46,265][123090] Updated weights for policy 1, policy_version 414159 (0.0009) [2023-12-26 02:54:46,330][123090] Updated weights for policy 1, policy_version 414169 (0.0009) [2023-12-26 02:54:46,509][123091] Updated weights for policy 0, policy_version 416792 (0.0009) [2023-12-26 02:54:46,571][123091] Updated weights for policy 0, policy_version 416802 (0.0010) [2023-12-26 02:54:46,641][123091] Updated weights for policy 0, policy_version 416812 (0.0010) [2023-12-26 02:54:47,083][123090] Updated weights for policy 1, policy_version 414179 (0.0010) [2023-12-26 02:54:47,150][123090] Updated weights for policy 1, policy_version 414189 (0.0008) [2023-12-26 02:54:47,221][123090] Updated weights for policy 1, policy_version 414199 (0.0009) [2023-12-26 02:54:47,529][123091] Updated weights for policy 0, policy_version 416822 (0.0010) [2023-12-26 02:54:47,584][123091] Updated weights for policy 0, policy_version 416832 (0.0010) [2023-12-26 02:54:47,647][123091] Updated weights for policy 0, policy_version 416842 (0.0009) [2023-12-26 02:54:48,063][123090] Updated weights for policy 1, policy_version 414209 (0.0010) [2023-12-26 02:54:48,131][123090] Updated weights for policy 1, policy_version 414219 (0.0009) [2023-12-26 02:54:48,191][123090] Updated weights for policy 1, policy_version 414229 (0.0009) [2023-12-26 02:54:48,255][123090] Updated weights for policy 1, policy_version 414239 (0.0009) [2023-12-26 02:54:48,433][123091] Updated weights for policy 0, policy_version 416852 (0.0009) [2023-12-26 02:54:48,497][123091] Updated weights for policy 0, policy_version 416862 (0.0009) [2023-12-26 02:54:48,558][123091] Updated weights for policy 0, policy_version 416872 (0.0009) [2023-12-26 02:54:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 212770816. Throughput: 0: 8938.3, 1: 8772.5. Samples: 212780784. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:54:48,785][121949] Avg episode reward: [(0, '5874.082'), (1, '5942.532')] [2023-12-26 02:54:49,045][123090] Updated weights for policy 1, policy_version 414249 (0.0009) [2023-12-26 02:54:49,108][123090] Updated weights for policy 1, policy_version 414259 (0.0008) [2023-12-26 02:54:49,163][123090] Updated weights for policy 1, policy_version 414269 (0.0009) [2023-12-26 02:54:49,414][123091] Updated weights for policy 0, policy_version 416882 (0.0010) [2023-12-26 02:54:49,474][123091] Updated weights for policy 0, policy_version 416892 (0.0009) [2023-12-26 02:54:49,533][123091] Updated weights for policy 0, policy_version 416902 (0.0010) [2023-12-26 02:54:49,583][123091] Updated weights for policy 0, policy_version 416912 (0.0008) [2023-12-26 02:54:50,060][123090] Updated weights for policy 1, policy_version 414279 (0.0009) [2023-12-26 02:54:50,124][123090] Updated weights for policy 1, policy_version 414289 (0.0009) [2023-12-26 02:54:50,189][123090] Updated weights for policy 1, policy_version 414299 (0.0009) [2023-12-26 02:54:50,407][123091] Updated weights for policy 0, policy_version 416922 (0.0010) [2023-12-26 02:54:50,455][123091] Updated weights for policy 0, policy_version 416932 (0.0009) [2023-12-26 02:54:50,503][123091] Updated weights for policy 0, policy_version 416942 (0.0005) [2023-12-26 02:54:51,032][123090] Updated weights for policy 1, policy_version 414309 (0.0009) [2023-12-26 02:54:51,100][123090] Updated weights for policy 1, policy_version 414319 (0.0010) [2023-12-26 02:54:51,162][123090] Updated weights for policy 1, policy_version 414329 (0.0009) [2023-12-26 02:54:51,363][123091] Updated weights for policy 0, policy_version 416952 (0.0009) [2023-12-26 02:54:51,434][123091] Updated weights for policy 0, policy_version 416962 (0.0010) [2023-12-26 02:54:51,487][123091] Updated weights for policy 0, policy_version 416972 (0.0009) [2023-12-26 02:54:52,022][123090] Updated weights for policy 1, policy_version 414339 (0.0008) [2023-12-26 02:54:52,085][123090] Updated weights for policy 1, policy_version 414349 (0.0009) [2023-12-26 02:54:52,140][123090] Updated weights for policy 1, policy_version 414359 (0.0010) [2023-12-26 02:54:52,300][123091] Updated weights for policy 0, policy_version 416982 (0.0009) [2023-12-26 02:54:52,357][123091] Updated weights for policy 0, policy_version 416992 (0.0009) [2023-12-26 02:54:52,415][123091] Updated weights for policy 0, policy_version 417002 (0.0006) [2023-12-26 02:54:53,052][123090] Updated weights for policy 1, policy_version 414369 (0.0010) [2023-12-26 02:54:53,080][123091] Updated weights for policy 0, policy_version 417012 (0.0006) [2023-12-26 02:54:53,109][123090] Updated weights for policy 1, policy_version 414379 (0.0009) [2023-12-26 02:54:53,141][123091] Updated weights for policy 0, policy_version 417022 (0.0007) [2023-12-26 02:54:53,169][123090] Updated weights for policy 1, policy_version 414389 (0.0009) [2023-12-26 02:54:53,197][123091] Updated weights for policy 0, policy_version 417032 (0.0007) [2023-12-26 02:54:53,227][123090] Updated weights for policy 1, policy_version 414399 (0.0010) [2023-12-26 02:54:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 212852736. Throughput: 0: 8885.3, 1: 8760.4. Samples: 212831328. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:54:53,785][121949] Avg episode reward: [(0, '5910.879'), (1, '5925.475')] [2023-12-26 02:54:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000414400_106086400.pth... [2023-12-26 02:54:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000417040_106766336.pth... [2023-12-26 02:54:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000415984_106496000.pth [2023-12-26 02:54:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000413408_105832448.pth [2023-12-26 02:54:53,938][123091] Updated weights for policy 0, policy_version 417042 (0.0005) [2023-12-26 02:54:54,008][123091] Updated weights for policy 0, policy_version 417052 (0.0005) [2023-12-26 02:54:54,071][123091] Updated weights for policy 0, policy_version 417062 (0.0006) [2023-12-26 02:54:54,121][123090] Updated weights for policy 1, policy_version 414409 (0.0007) [2023-12-26 02:54:54,126][123091] Updated weights for policy 0, policy_version 417072 (0.0009) [2023-12-26 02:54:54,189][123090] Updated weights for policy 1, policy_version 414419 (0.0010) [2023-12-26 02:54:54,261][123090] Updated weights for policy 1, policy_version 414429 (0.0010) [2023-12-26 02:54:54,853][123091] Updated weights for policy 0, policy_version 417082 (0.0010) [2023-12-26 02:54:54,909][123091] Updated weights for policy 0, policy_version 417092 (0.0009) [2023-12-26 02:54:54,977][123091] Updated weights for policy 0, policy_version 417103 (0.0009) [2023-12-26 02:54:55,078][123090] Updated weights for policy 1, policy_version 414439 (0.0008) [2023-12-26 02:54:55,136][123090] Updated weights for policy 1, policy_version 414449 (0.0009) [2023-12-26 02:54:55,189][123090] Updated weights for policy 1, policy_version 414460 (0.0010) [2023-12-26 02:54:55,654][123091] Updated weights for policy 0, policy_version 417113 (0.0006) [2023-12-26 02:54:55,698][123091] Updated weights for policy 0, policy_version 417123 (0.0005) [2023-12-26 02:54:55,759][123091] Updated weights for policy 0, policy_version 417133 (0.0005) [2023-12-26 02:54:56,101][123090] Updated weights for policy 1, policy_version 414471 (0.0010) [2023-12-26 02:54:56,167][123090] Updated weights for policy 1, policy_version 414481 (0.0010) [2023-12-26 02:54:56,239][123090] Updated weights for policy 1, policy_version 414491 (0.0010) [2023-12-26 02:54:56,399][123091] Updated weights for policy 0, policy_version 417143 (0.0005) [2023-12-26 02:54:56,456][123091] Updated weights for policy 0, policy_version 417153 (0.0005) [2023-12-26 02:54:56,519][123091] Updated weights for policy 0, policy_version 417163 (0.0005) [2023-12-26 02:54:57,135][123090] Updated weights for policy 1, policy_version 414501 (0.0008) [2023-12-26 02:54:57,191][123090] Updated weights for policy 1, policy_version 414511 (0.0008) [2023-12-26 02:54:57,197][123091] Updated weights for policy 0, policy_version 417173 (0.0008) [2023-12-26 02:54:57,240][123091] Updated weights for policy 0, policy_version 417183 (0.0010) [2023-12-26 02:54:57,251][123090] Updated weights for policy 1, policy_version 414521 (0.0007) [2023-12-26 02:54:57,290][123091] Updated weights for policy 0, policy_version 417193 (0.0010) [2023-12-26 02:54:57,996][123090] Updated weights for policy 1, policy_version 414531 (0.0006) [2023-12-26 02:54:58,059][123090] Updated weights for policy 1, policy_version 414541 (0.0009) [2023-12-26 02:54:58,089][123091] Updated weights for policy 0, policy_version 417203 (0.0009) [2023-12-26 02:54:58,113][123090] Updated weights for policy 1, policy_version 414551 (0.0009) [2023-12-26 02:54:58,148][123091] Updated weights for policy 0, policy_version 417213 (0.0007) [2023-12-26 02:54:58,216][123091] Updated weights for policy 0, policy_version 417223 (0.0008) [2023-12-26 02:54:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 212942848. Throughput: 0: 8947.9, 1: 8677.9. Samples: 212939180. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:54:58,785][121949] Avg episode reward: [(0, '6121.156'), (1, '5918.748')] [2023-12-26 02:54:59,020][123090] Updated weights for policy 1, policy_version 414561 (0.0009) [2023-12-26 02:54:59,032][123091] Updated weights for policy 0, policy_version 417233 (0.0008) [2023-12-26 02:54:59,067][123090] Updated weights for policy 1, policy_version 414571 (0.0008) [2023-12-26 02:54:59,081][123091] Updated weights for policy 0, policy_version 417243 (0.0006) [2023-12-26 02:54:59,118][123090] Updated weights for policy 1, policy_version 414581 (0.0009) [2023-12-26 02:54:59,136][123091] Updated weights for policy 0, policy_version 417253 (0.0005) [2023-12-26 02:54:59,177][123090] Updated weights for policy 1, policy_version 414591 (0.0009) [2023-12-26 02:54:59,182][123091] Updated weights for policy 0, policy_version 417263 (0.0005) [2023-12-26 02:54:59,962][123091] Updated weights for policy 0, policy_version 417273 (0.0010) [2023-12-26 02:55:00,020][123091] Updated weights for policy 0, policy_version 417283 (0.0008) [2023-12-26 02:55:00,056][123090] Updated weights for policy 1, policy_version 414601 (0.0010) [2023-12-26 02:55:00,075][123091] Updated weights for policy 0, policy_version 417293 (0.0008) [2023-12-26 02:55:00,105][123090] Updated weights for policy 1, policy_version 414611 (0.0008) [2023-12-26 02:55:00,159][123090] Updated weights for policy 1, policy_version 414621 (0.0009) [2023-12-26 02:55:00,887][123091] Updated weights for policy 0, policy_version 417303 (0.0009) [2023-12-26 02:55:00,941][123091] Updated weights for policy 0, policy_version 417313 (0.0008) [2023-12-26 02:55:00,992][123091] Updated weights for policy 0, policy_version 417323 (0.0009) [2023-12-26 02:55:01,004][123090] Updated weights for policy 1, policy_version 414631 (0.0008) [2023-12-26 02:55:01,073][123090] Updated weights for policy 1, policy_version 414641 (0.0006) [2023-12-26 02:55:01,140][123090] Updated weights for policy 1, policy_version 414651 (0.0008) [2023-12-26 02:55:01,818][123091] Updated weights for policy 0, policy_version 417333 (0.0008) [2023-12-26 02:55:01,869][123091] Updated weights for policy 0, policy_version 417343 (0.0008) [2023-12-26 02:55:01,919][123091] Updated weights for policy 0, policy_version 417353 (0.0008) [2023-12-26 02:55:02,027][123090] Updated weights for policy 1, policy_version 414661 (0.0009) [2023-12-26 02:55:02,092][123090] Updated weights for policy 1, policy_version 414671 (0.0009) [2023-12-26 02:55:02,149][123090] Updated weights for policy 1, policy_version 414681 (0.0010) [2023-12-26 02:55:02,629][123091] Updated weights for policy 0, policy_version 417363 (0.0007) [2023-12-26 02:55:02,692][123091] Updated weights for policy 0, policy_version 417373 (0.0005) [2023-12-26 02:55:02,751][123091] Updated weights for policy 0, policy_version 417383 (0.0011) [2023-12-26 02:55:03,030][123090] Updated weights for policy 1, policy_version 414691 (0.0009) [2023-12-26 02:55:03,094][123090] Updated weights for policy 1, policy_version 414702 (0.0011) [2023-12-26 02:55:03,147][123090] Updated weights for policy 1, policy_version 414713 (0.0010) [2023-12-26 02:55:03,469][123091] Updated weights for policy 0, policy_version 417393 (0.0010) [2023-12-26 02:55:03,533][123091] Updated weights for policy 0, policy_version 417403 (0.0005) [2023-12-26 02:55:03,582][123091] Updated weights for policy 0, policy_version 417413 (0.0007) [2023-12-26 02:55:03,625][123091] Updated weights for policy 0, policy_version 417423 (0.0008) [2023-12-26 02:55:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 213032960. Throughput: 0: 9017.6, 1: 8538.8. Samples: 213043528. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:03,785][121949] Avg episode reward: [(0, '6042.013'), (1, '5950.876')] [2023-12-26 02:55:04,074][123090] Updated weights for policy 1, policy_version 414723 (0.0009) [2023-12-26 02:55:04,143][123090] Updated weights for policy 1, policy_version 414733 (0.0010) [2023-12-26 02:55:04,215][123090] Updated weights for policy 1, policy_version 414743 (0.0009) [2023-12-26 02:55:04,342][123091] Updated weights for policy 0, policy_version 417433 (0.0008) [2023-12-26 02:55:04,412][123091] Updated weights for policy 0, policy_version 417443 (0.0008) [2023-12-26 02:55:04,480][123091] Updated weights for policy 0, policy_version 417453 (0.0006) [2023-12-26 02:55:05,082][123091] Updated weights for policy 0, policy_version 417463 (0.0005) [2023-12-26 02:55:05,095][123090] Updated weights for policy 1, policy_version 414753 (0.0009) [2023-12-26 02:55:05,147][123091] Updated weights for policy 0, policy_version 417473 (0.0006) [2023-12-26 02:55:05,151][123090] Updated weights for policy 1, policy_version 414763 (0.0008) [2023-12-26 02:55:05,212][123091] Updated weights for policy 0, policy_version 417483 (0.0005) [2023-12-26 02:55:05,213][123090] Updated weights for policy 1, policy_version 414773 (0.0007) [2023-12-26 02:55:05,262][123090] Updated weights for policy 1, policy_version 414783 (0.0005) [2023-12-26 02:55:05,942][123091] Updated weights for policy 0, policy_version 417493 (0.0008) [2023-12-26 02:55:05,998][123090] Updated weights for policy 1, policy_version 414793 (0.0010) [2023-12-26 02:55:06,005][123091] Updated weights for policy 0, policy_version 417503 (0.0006) [2023-12-26 02:55:06,047][123090] Updated weights for policy 1, policy_version 414803 (0.0010) [2023-12-26 02:55:06,073][123091] Updated weights for policy 0, policy_version 417513 (0.0005) [2023-12-26 02:55:06,102][123090] Updated weights for policy 1, policy_version 414813 (0.0009) [2023-12-26 02:55:06,818][123091] Updated weights for policy 0, policy_version 417523 (0.0007) [2023-12-26 02:55:06,869][123091] Updated weights for policy 0, policy_version 417533 (0.0009) [2023-12-26 02:55:06,916][123091] Updated weights for policy 0, policy_version 417543 (0.0008) [2023-12-26 02:55:06,962][123090] Updated weights for policy 1, policy_version 414823 (0.0011) [2023-12-26 02:55:07,025][123090] Updated weights for policy 1, policy_version 414833 (0.0010) [2023-12-26 02:55:07,087][123090] Updated weights for policy 1, policy_version 414843 (0.0010) [2023-12-26 02:55:07,743][123091] Updated weights for policy 0, policy_version 417553 (0.0007) [2023-12-26 02:55:07,797][123091] Updated weights for policy 0, policy_version 417563 (0.0005) [2023-12-26 02:55:07,851][123091] Updated weights for policy 0, policy_version 417573 (0.0005) [2023-12-26 02:55:07,909][123090] Updated weights for policy 1, policy_version 414853 (0.0010) [2023-12-26 02:55:07,922][123091] Updated weights for policy 0, policy_version 417583 (0.0006) [2023-12-26 02:55:07,958][123090] Updated weights for policy 1, policy_version 414863 (0.0009) [2023-12-26 02:55:08,013][123090] Updated weights for policy 1, policy_version 414873 (0.0009) [2023-12-26 02:55:08,585][123091] Updated weights for policy 0, policy_version 417593 (0.0006) [2023-12-26 02:55:08,646][123091] Updated weights for policy 0, policy_version 417603 (0.0006) [2023-12-26 02:55:08,711][123091] Updated weights for policy 0, policy_version 417613 (0.0006) [2023-12-26 02:55:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 213123072. Throughput: 0: 9112.5, 1: 8530.9. Samples: 213098604. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:08,785][121949] Avg episode reward: [(0, '5874.497'), (1, '5920.369')] [2023-12-26 02:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000417616_106913792.pth... [2023-12-26 02:55:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000416528_106635264.pth [2023-12-26 02:55:08,819][123090] Updated weights for policy 1, policy_version 414883 (0.0008) [2023-12-26 02:55:08,886][123090] Updated weights for policy 1, policy_version 414893 (0.0009) [2023-12-26 02:55:08,944][123090] Updated weights for policy 1, policy_version 414903 (0.0009) [2023-12-26 02:55:08,993][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000414912_106217472.pth... [2023-12-26 02:55:08,998][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000413920_105963520.pth [2023-12-26 02:55:09,452][123091] Updated weights for policy 0, policy_version 417623 (0.0008) [2023-12-26 02:55:09,519][123091] Updated weights for policy 0, policy_version 417633 (0.0009) [2023-12-26 02:55:09,581][123091] Updated weights for policy 0, policy_version 417643 (0.0009) [2023-12-26 02:55:09,825][123090] Updated weights for policy 1, policy_version 414913 (0.0009) [2023-12-26 02:55:09,890][123090] Updated weights for policy 1, policy_version 414923 (0.0009) [2023-12-26 02:55:09,958][123090] Updated weights for policy 1, policy_version 414933 (0.0007) [2023-12-26 02:55:10,015][123090] Updated weights for policy 1, policy_version 414943 (0.0009) [2023-12-26 02:55:10,368][123091] Updated weights for policy 0, policy_version 417653 (0.0007) [2023-12-26 02:55:10,420][123091] Updated weights for policy 0, policy_version 417663 (0.0009) [2023-12-26 02:55:10,484][123091] Updated weights for policy 0, policy_version 417673 (0.0008) [2023-12-26 02:55:10,873][123090] Updated weights for policy 1, policy_version 414953 (0.0009) [2023-12-26 02:55:10,928][123090] Updated weights for policy 1, policy_version 414964 (0.0010) [2023-12-26 02:55:10,987][123090] Updated weights for policy 1, policy_version 414974 (0.0010) [2023-12-26 02:55:11,231][123091] Updated weights for policy 0, policy_version 417683 (0.0010) [2023-12-26 02:55:11,290][123091] Updated weights for policy 0, policy_version 417693 (0.0009) [2023-12-26 02:55:11,344][123091] Updated weights for policy 0, policy_version 417703 (0.0009) [2023-12-26 02:55:11,891][123090] Updated weights for policy 1, policy_version 414984 (0.0008) [2023-12-26 02:55:11,946][123090] Updated weights for policy 1, policy_version 414994 (0.0007) [2023-12-26 02:55:11,997][123090] Updated weights for policy 1, policy_version 415004 (0.0005) [2023-12-26 02:55:12,258][123091] Updated weights for policy 0, policy_version 417713 (0.0009) [2023-12-26 02:55:12,331][123091] Updated weights for policy 0, policy_version 417723 (0.0009) [2023-12-26 02:55:12,400][123091] Updated weights for policy 0, policy_version 417733 (0.0009) [2023-12-26 02:55:12,454][123091] Updated weights for policy 0, policy_version 417743 (0.0009) [2023-12-26 02:55:12,735][123090] Updated weights for policy 1, policy_version 415014 (0.0007) [2023-12-26 02:55:12,793][123090] Updated weights for policy 1, policy_version 415024 (0.0006) [2023-12-26 02:55:12,846][123090] Updated weights for policy 1, policy_version 415034 (0.0006) [2023-12-26 02:55:13,264][123091] Updated weights for policy 0, policy_version 417753 (0.0010) [2023-12-26 02:55:13,320][123091] Updated weights for policy 0, policy_version 417763 (0.0006) [2023-12-26 02:55:13,370][123091] Updated weights for policy 0, policy_version 417773 (0.0007) [2023-12-26 02:55:13,556][123090] Updated weights for policy 1, policy_version 415044 (0.0007) [2023-12-26 02:55:13,615][123090] Updated weights for policy 1, policy_version 415054 (0.0008) [2023-12-26 02:55:13,684][123090] Updated weights for policy 1, policy_version 415064 (0.0007) [2023-12-26 02:55:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 213213184. Throughput: 0: 9106.5, 1: 8447.7. Samples: 213202604. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:13,784][121949] Avg episode reward: [(0, '5905.641'), (1, '5897.799')] [2023-12-26 02:55:14,188][123091] Updated weights for policy 0, policy_version 417783 (0.0011) [2023-12-26 02:55:14,254][123091] Updated weights for policy 0, policy_version 417793 (0.0011) [2023-12-26 02:55:14,300][123090] Updated weights for policy 1, policy_version 415074 (0.0006) [2023-12-26 02:55:14,313][123091] Updated weights for policy 0, policy_version 417803 (0.0011) [2023-12-26 02:55:14,365][123090] Updated weights for policy 1, policy_version 415084 (0.0009) [2023-12-26 02:55:14,413][123090] Updated weights for policy 1, policy_version 415094 (0.0010) [2023-12-26 02:55:14,461][123090] Updated weights for policy 1, policy_version 415104 (0.0010) [2023-12-26 02:55:15,135][123091] Updated weights for policy 0, policy_version 417813 (0.0009) [2023-12-26 02:55:15,201][123091] Updated weights for policy 0, policy_version 417823 (0.0009) [2023-12-26 02:55:15,268][123091] Updated weights for policy 0, policy_version 417833 (0.0008) [2023-12-26 02:55:15,311][123090] Updated weights for policy 1, policy_version 415114 (0.0011) [2023-12-26 02:55:15,382][123090] Updated weights for policy 1, policy_version 415124 (0.0011) [2023-12-26 02:55:15,459][123090] Updated weights for policy 1, policy_version 415134 (0.0011) [2023-12-26 02:55:16,013][123091] Updated weights for policy 0, policy_version 417843 (0.0007) [2023-12-26 02:55:16,087][123091] Updated weights for policy 0, policy_version 417853 (0.0006) [2023-12-26 02:55:16,150][123091] Updated weights for policy 0, policy_version 417863 (0.0010) [2023-12-26 02:55:16,258][123090] Updated weights for policy 1, policy_version 415144 (0.0010) [2023-12-26 02:55:16,320][123090] Updated weights for policy 1, policy_version 415154 (0.0010) [2023-12-26 02:55:16,371][123090] Updated weights for policy 1, policy_version 415164 (0.0010) [2023-12-26 02:55:16,882][123091] Updated weights for policy 0, policy_version 417873 (0.0010) [2023-12-26 02:55:16,944][123091] Updated weights for policy 0, policy_version 417883 (0.0005) [2023-12-26 02:55:16,993][123091] Updated weights for policy 0, policy_version 417893 (0.0005) [2023-12-26 02:55:17,043][123091] Updated weights for policy 0, policy_version 417903 (0.0005) [2023-12-26 02:55:17,186][123090] Updated weights for policy 1, policy_version 415174 (0.0010) [2023-12-26 02:55:17,237][123090] Updated weights for policy 1, policy_version 415184 (0.0010) [2023-12-26 02:55:17,295][123090] Updated weights for policy 1, policy_version 415194 (0.0010) [2023-12-26 02:55:17,709][123091] Updated weights for policy 0, policy_version 417913 (0.0010) [2023-12-26 02:55:17,756][123091] Updated weights for policy 0, policy_version 417923 (0.0010) [2023-12-26 02:55:17,804][123091] Updated weights for policy 0, policy_version 417933 (0.0011) [2023-12-26 02:55:18,132][123090] Updated weights for policy 1, policy_version 415204 (0.0010) [2023-12-26 02:55:18,185][123090] Updated weights for policy 1, policy_version 415214 (0.0009) [2023-12-26 02:55:18,252][123090] Updated weights for policy 1, policy_version 415224 (0.0009) [2023-12-26 02:55:18,621][123091] Updated weights for policy 0, policy_version 417943 (0.0009) [2023-12-26 02:55:18,686][123091] Updated weights for policy 0, policy_version 417953 (0.0010) [2023-12-26 02:55:18,748][123091] Updated weights for policy 0, policy_version 417963 (0.0010) [2023-12-26 02:55:18,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 213303296. Throughput: 0: 9074.4, 1: 8501.9. Samples: 213311688. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:18,785][121949] Avg episode reward: [(0, '5957.388'), (1, '5993.484')] [2023-12-26 02:55:19,108][123090] Updated weights for policy 1, policy_version 415234 (0.0009) [2023-12-26 02:55:19,171][123090] Updated weights for policy 1, policy_version 415244 (0.0010) [2023-12-26 02:55:19,237][123090] Updated weights for policy 1, policy_version 415254 (0.0010) [2023-12-26 02:55:19,301][123090] Updated weights for policy 1, policy_version 415264 (0.0009) [2023-12-26 02:55:19,579][123091] Updated weights for policy 0, policy_version 417973 (0.0008) [2023-12-26 02:55:19,637][123091] Updated weights for policy 0, policy_version 417983 (0.0009) [2023-12-26 02:55:19,695][123091] Updated weights for policy 0, policy_version 417993 (0.0007) [2023-12-26 02:55:20,124][123090] Updated weights for policy 1, policy_version 415274 (0.0009) [2023-12-26 02:55:20,177][123090] Updated weights for policy 1, policy_version 415284 (0.0010) [2023-12-26 02:55:20,241][123090] Updated weights for policy 1, policy_version 415294 (0.0009) [2023-12-26 02:55:20,483][123091] Updated weights for policy 0, policy_version 418003 (0.0009) [2023-12-26 02:55:20,540][123091] Updated weights for policy 0, policy_version 418013 (0.0010) [2023-12-26 02:55:20,616][123091] Updated weights for policy 0, policy_version 418023 (0.0009) [2023-12-26 02:55:21,084][123090] Updated weights for policy 1, policy_version 415304 (0.0009) [2023-12-26 02:55:21,155][123090] Updated weights for policy 1, policy_version 415314 (0.0009) [2023-12-26 02:55:21,226][123090] Updated weights for policy 1, policy_version 415324 (0.0007) [2023-12-26 02:55:21,495][123091] Updated weights for policy 0, policy_version 418033 (0.0010) [2023-12-26 02:55:21,558][123091] Updated weights for policy 0, policy_version 418043 (0.0009) [2023-12-26 02:55:21,620][123091] Updated weights for policy 0, policy_version 418053 (0.0009) [2023-12-26 02:55:21,678][123091] Updated weights for policy 0, policy_version 418063 (0.0010) [2023-12-26 02:55:22,010][123090] Updated weights for policy 1, policy_version 415334 (0.0009) [2023-12-26 02:55:22,077][123090] Updated weights for policy 1, policy_version 415344 (0.0010) [2023-12-26 02:55:22,140][123090] Updated weights for policy 1, policy_version 415354 (0.0010) [2023-12-26 02:55:22,541][123091] Updated weights for policy 0, policy_version 418073 (0.0009) [2023-12-26 02:55:22,608][123091] Updated weights for policy 0, policy_version 418083 (0.0009) [2023-12-26 02:55:22,674][123091] Updated weights for policy 0, policy_version 418093 (0.0009) [2023-12-26 02:55:22,958][123090] Updated weights for policy 1, policy_version 415364 (0.0011) [2023-12-26 02:55:23,021][123090] Updated weights for policy 1, policy_version 415374 (0.0010) [2023-12-26 02:55:23,084][123090] Updated weights for policy 1, policy_version 415384 (0.0010) [2023-12-26 02:55:23,508][123091] Updated weights for policy 0, policy_version 418103 (0.0009) [2023-12-26 02:55:23,556][123091] Updated weights for policy 0, policy_version 418113 (0.0008) [2023-12-26 02:55:23,606][123091] Updated weights for policy 0, policy_version 418123 (0.0009) [2023-12-26 02:55:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 213385216. Throughput: 0: 9058.2, 1: 8461.9. Samples: 213362040. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:23,785][121949] Avg episode reward: [(0, '5954.909'), (1, '6029.662')] [2023-12-26 02:55:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000418128_107044864.pth... [2023-12-26 02:55:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000415392_106340352.pth... [2023-12-26 02:55:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000414400_106086400.pth [2023-12-26 02:55:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000417040_106766336.pth [2023-12-26 02:55:23,898][123090] Updated weights for policy 1, policy_version 415394 (0.0009) [2023-12-26 02:55:23,975][123090] Updated weights for policy 1, policy_version 415404 (0.0006) [2023-12-26 02:55:24,035][123090] Updated weights for policy 1, policy_version 415414 (0.0008) [2023-12-26 02:55:24,103][123090] Updated weights for policy 1, policy_version 415424 (0.0008) [2023-12-26 02:55:24,550][123091] Updated weights for policy 0, policy_version 418133 (0.0010) [2023-12-26 02:55:24,615][123091] Updated weights for policy 0, policy_version 418143 (0.0010) [2023-12-26 02:55:24,676][123091] Updated weights for policy 0, policy_version 418153 (0.0010) [2023-12-26 02:55:24,736][123090] Updated weights for policy 1, policy_version 415434 (0.0006) [2023-12-26 02:55:24,799][123090] Updated weights for policy 1, policy_version 415444 (0.0005) [2023-12-26 02:55:24,857][123090] Updated weights for policy 1, policy_version 415454 (0.0005) [2023-12-26 02:55:25,539][123091] Updated weights for policy 0, policy_version 418163 (0.0009) [2023-12-26 02:55:25,589][123091] Updated weights for policy 0, policy_version 418173 (0.0010) [2023-12-26 02:55:25,620][123090] Updated weights for policy 1, policy_version 415464 (0.0007) [2023-12-26 02:55:25,636][123091] Updated weights for policy 0, policy_version 418183 (0.0009) [2023-12-26 02:55:25,677][123090] Updated weights for policy 1, policy_version 415474 (0.0008) [2023-12-26 02:55:25,726][123090] Updated weights for policy 1, policy_version 415484 (0.0009) [2023-12-26 02:55:26,488][123091] Updated weights for policy 0, policy_version 418193 (0.0008) [2023-12-26 02:55:26,555][123091] Updated weights for policy 0, policy_version 418203 (0.0008) [2023-12-26 02:55:26,567][123090] Updated weights for policy 1, policy_version 415494 (0.0009) [2023-12-26 02:55:26,605][123091] Updated weights for policy 0, policy_version 418213 (0.0006) [2023-12-26 02:55:26,637][123090] Updated weights for policy 1, policy_version 415504 (0.0009) [2023-12-26 02:55:26,661][123091] Updated weights for policy 0, policy_version 418223 (0.0005) [2023-12-26 02:55:26,710][123090] Updated weights for policy 1, policy_version 415514 (0.0009) [2023-12-26 02:55:27,467][123091] Updated weights for policy 0, policy_version 418233 (0.0010) [2023-12-26 02:55:27,498][123090] Updated weights for policy 1, policy_version 415524 (0.0008) [2023-12-26 02:55:27,516][123091] Updated weights for policy 0, policy_version 418243 (0.0009) [2023-12-26 02:55:27,550][123090] Updated weights for policy 1, policy_version 415534 (0.0005) [2023-12-26 02:55:27,566][123091] Updated weights for policy 0, policy_version 418254 (0.0008) [2023-12-26 02:55:27,614][123090] Updated weights for policy 1, policy_version 415544 (0.0005) [2023-12-26 02:55:28,385][123091] Updated weights for policy 0, policy_version 418264 (0.0010) [2023-12-26 02:55:28,408][123090] Updated weights for policy 1, policy_version 415554 (0.0005) [2023-12-26 02:55:28,436][123091] Updated weights for policy 0, policy_version 418274 (0.0007) [2023-12-26 02:55:28,470][123090] Updated weights for policy 1, policy_version 415564 (0.0010) [2023-12-26 02:55:28,503][123091] Updated weights for policy 0, policy_version 418284 (0.0006) [2023-12-26 02:55:28,533][123090] Updated weights for policy 1, policy_version 415574 (0.0010) [2023-12-26 02:55:28,597][123090] Updated weights for policy 1, policy_version 415584 (0.0009) [2023-12-26 02:55:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 213475328. Throughput: 0: 8961.7, 1: 8539.1. Samples: 213465248. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:28,785][121949] Avg episode reward: [(0, '6054.862'), (1, '6007.253')] [2023-12-26 02:55:29,064][123091] Updated weights for policy 0, policy_version 418294 (0.0008) [2023-12-26 02:55:29,129][123091] Updated weights for policy 0, policy_version 418304 (0.0009) [2023-12-26 02:55:29,192][123091] Updated weights for policy 0, policy_version 418314 (0.0009) [2023-12-26 02:55:29,431][123090] Updated weights for policy 1, policy_version 415594 (0.0006) [2023-12-26 02:55:29,496][123090] Updated weights for policy 1, policy_version 415604 (0.0005) [2023-12-26 02:55:29,558][123090] Updated weights for policy 1, policy_version 415614 (0.0007) [2023-12-26 02:55:30,049][123091] Updated weights for policy 0, policy_version 418324 (0.0009) [2023-12-26 02:55:30,105][123091] Updated weights for policy 0, policy_version 418334 (0.0010) [2023-12-26 02:55:30,167][123091] Updated weights for policy 0, policy_version 418344 (0.0010) [2023-12-26 02:55:30,373][123090] Updated weights for policy 1, policy_version 415624 (0.0009) [2023-12-26 02:55:30,439][123090] Updated weights for policy 1, policy_version 415634 (0.0010) [2023-12-26 02:55:30,492][123090] Updated weights for policy 1, policy_version 415644 (0.0005) [2023-12-26 02:55:30,931][123091] Updated weights for policy 0, policy_version 418354 (0.0009) [2023-12-26 02:55:31,006][123091] Updated weights for policy 0, policy_version 418364 (0.0005) [2023-12-26 02:55:31,073][123091] Updated weights for policy 0, policy_version 418374 (0.0011) [2023-12-26 02:55:31,133][123091] Updated weights for policy 0, policy_version 418384 (0.0010) [2023-12-26 02:55:31,209][123090] Updated weights for policy 1, policy_version 415654 (0.0008) [2023-12-26 02:55:31,266][123090] Updated weights for policy 1, policy_version 415664 (0.0010) [2023-12-26 02:55:31,333][123090] Updated weights for policy 1, policy_version 415674 (0.0010) [2023-12-26 02:55:31,864][123091] Updated weights for policy 0, policy_version 418394 (0.0011) [2023-12-26 02:55:31,920][123091] Updated weights for policy 0, policy_version 418404 (0.0011) [2023-12-26 02:55:31,985][123091] Updated weights for policy 0, policy_version 418414 (0.0010) [2023-12-26 02:55:32,114][123090] Updated weights for policy 1, policy_version 415684 (0.0007) [2023-12-26 02:55:32,184][123090] Updated weights for policy 1, policy_version 415694 (0.0006) [2023-12-26 02:55:32,251][123090] Updated weights for policy 1, policy_version 415704 (0.0011) [2023-12-26 02:55:32,732][123091] Updated weights for policy 0, policy_version 418424 (0.0010) [2023-12-26 02:55:32,802][123091] Updated weights for policy 0, policy_version 418434 (0.0010) [2023-12-26 02:55:32,871][123091] Updated weights for policy 0, policy_version 418444 (0.0010) [2023-12-26 02:55:32,969][123090] Updated weights for policy 1, policy_version 415714 (0.0011) [2023-12-26 02:55:33,016][123090] Updated weights for policy 1, policy_version 415724 (0.0008) [2023-12-26 02:55:33,063][123090] Updated weights for policy 1, policy_version 415734 (0.0005) [2023-12-26 02:55:33,116][123090] Updated weights for policy 1, policy_version 415744 (0.0005) [2023-12-26 02:55:33,602][123091] Updated weights for policy 0, policy_version 418454 (0.0007) [2023-12-26 02:55:33,656][123091] Updated weights for policy 0, policy_version 418464 (0.0005) [2023-12-26 02:55:33,711][123091] Updated weights for policy 0, policy_version 418474 (0.0005) [2023-12-26 02:55:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 213565440. Throughput: 0: 9051.1, 1: 8618.8. Samples: 213575928. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:33,785][121949] Avg episode reward: [(0, '6046.433'), (1, '6016.120')] [2023-12-26 02:55:33,839][123090] Updated weights for policy 1, policy_version 415754 (0.0005) [2023-12-26 02:55:33,893][123090] Updated weights for policy 1, policy_version 415764 (0.0005) [2023-12-26 02:55:33,957][123090] Updated weights for policy 1, policy_version 415774 (0.0005) [2023-12-26 02:55:34,448][123091] Updated weights for policy 0, policy_version 418484 (0.0007) [2023-12-26 02:55:34,513][123091] Updated weights for policy 0, policy_version 418494 (0.0009) [2023-12-26 02:55:34,578][123091] Updated weights for policy 0, policy_version 418504 (0.0009) [2023-12-26 02:55:34,695][123090] Updated weights for policy 1, policy_version 415784 (0.0008) [2023-12-26 02:55:34,754][123090] Updated weights for policy 1, policy_version 415794 (0.0008) [2023-12-26 02:55:34,816][123090] Updated weights for policy 1, policy_version 415804 (0.0008) [2023-12-26 02:55:35,429][123090] Updated weights for policy 1, policy_version 415814 (0.0006) [2023-12-26 02:55:35,444][123091] Updated weights for policy 0, policy_version 418514 (0.0006) [2023-12-26 02:55:35,481][123090] Updated weights for policy 1, policy_version 415824 (0.0005) [2023-12-26 02:55:35,494][123091] Updated weights for policy 0, policy_version 418524 (0.0009) [2023-12-26 02:55:35,537][123090] Updated weights for policy 1, policy_version 415834 (0.0005) [2023-12-26 02:55:35,547][123091] Updated weights for policy 0, policy_version 418534 (0.0009) [2023-12-26 02:55:36,165][123090] Updated weights for policy 1, policy_version 415844 (0.0006) [2023-12-26 02:55:36,224][123090] Updated weights for policy 1, policy_version 415854 (0.0008) [2023-12-26 02:55:36,291][123090] Updated weights for policy 1, policy_version 415864 (0.0008) [2023-12-26 02:55:36,327][123091] Updated weights for policy 0, policy_version 418545 (0.0010) [2023-12-26 02:55:36,395][123091] Updated weights for policy 0, policy_version 418555 (0.0008) [2023-12-26 02:55:36,459][123091] Updated weights for policy 0, policy_version 418565 (0.0010) [2023-12-26 02:55:36,521][123091] Updated weights for policy 0, policy_version 418575 (0.0009) [2023-12-26 02:55:37,091][123090] Updated weights for policy 1, policy_version 415874 (0.0008) [2023-12-26 02:55:37,153][123090] Updated weights for policy 1, policy_version 415884 (0.0005) [2023-12-26 02:55:37,213][123090] Updated weights for policy 1, policy_version 415894 (0.0005) [2023-12-26 02:55:37,262][123090] Updated weights for policy 1, policy_version 415904 (0.0005) [2023-12-26 02:55:37,409][123091] Updated weights for policy 0, policy_version 418585 (0.0010) [2023-12-26 02:55:37,486][123091] Updated weights for policy 0, policy_version 418595 (0.0008) [2023-12-26 02:55:37,554][123091] Updated weights for policy 0, policy_version 418605 (0.0009) [2023-12-26 02:55:38,038][123090] Updated weights for policy 1, policy_version 415914 (0.0009) [2023-12-26 02:55:38,100][123090] Updated weights for policy 1, policy_version 415924 (0.0010) [2023-12-26 02:55:38,161][123090] Updated weights for policy 1, policy_version 415934 (0.0008) [2023-12-26 02:55:38,244][123091] Updated weights for policy 0, policy_version 418615 (0.0006) [2023-12-26 02:55:38,288][123091] Updated weights for policy 0, policy_version 418625 (0.0005) [2023-12-26 02:55:38,355][123091] Updated weights for policy 0, policy_version 418635 (0.0009) [2023-12-26 02:55:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 213655552. Throughput: 0: 9079.1, 1: 8713.3. Samples: 213631988. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:38,785][121949] Avg episode reward: [(0, '6046.879'), (1, '5905.928')] [2023-12-26 02:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000418640_107175936.pth... [2023-12-26 02:55:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000415936_106479616.pth... [2023-12-26 02:55:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000414912_106217472.pth [2023-12-26 02:55:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000417616_106913792.pth [2023-12-26 02:55:38,945][123090] Updated weights for policy 1, policy_version 415944 (0.0009) [2023-12-26 02:55:39,005][123090] Updated weights for policy 1, policy_version 415954 (0.0011) [2023-12-26 02:55:39,072][123090] Updated weights for policy 1, policy_version 415964 (0.0011) [2023-12-26 02:55:39,161][123091] Updated weights for policy 0, policy_version 418645 (0.0010) [2023-12-26 02:55:39,223][123091] Updated weights for policy 0, policy_version 418655 (0.0008) [2023-12-26 02:55:39,294][123091] Updated weights for policy 0, policy_version 418665 (0.0007) [2023-12-26 02:55:39,912][123090] Updated weights for policy 1, policy_version 415974 (0.0010) [2023-12-26 02:55:39,980][123090] Updated weights for policy 1, policy_version 415984 (0.0008) [2023-12-26 02:55:40,037][123090] Updated weights for policy 1, policy_version 415994 (0.0009) [2023-12-26 02:55:40,125][123091] Updated weights for policy 0, policy_version 418675 (0.0008) [2023-12-26 02:55:40,188][123091] Updated weights for policy 0, policy_version 418685 (0.0010) [2023-12-26 02:55:40,245][123091] Updated weights for policy 0, policy_version 418695 (0.0009) [2023-12-26 02:55:40,872][123090] Updated weights for policy 1, policy_version 416004 (0.0009) [2023-12-26 02:55:40,926][123090] Updated weights for policy 1, policy_version 416014 (0.0009) [2023-12-26 02:55:40,983][123090] Updated weights for policy 1, policy_version 416024 (0.0010) [2023-12-26 02:55:41,099][123091] Updated weights for policy 0, policy_version 418705 (0.0009) [2023-12-26 02:55:41,170][123091] Updated weights for policy 0, policy_version 418715 (0.0010) [2023-12-26 02:55:41,220][123091] Updated weights for policy 0, policy_version 418725 (0.0009) [2023-12-26 02:55:41,276][123091] Updated weights for policy 0, policy_version 418735 (0.0009) [2023-12-26 02:55:41,830][123090] Updated weights for policy 1, policy_version 416034 (0.0010) [2023-12-26 02:55:41,896][123090] Updated weights for policy 1, policy_version 416044 (0.0010) [2023-12-26 02:55:41,961][123090] Updated weights for policy 1, policy_version 416054 (0.0009) [2023-12-26 02:55:42,027][123090] Updated weights for policy 1, policy_version 416064 (0.0008) [2023-12-26 02:55:42,177][123091] Updated weights for policy 0, policy_version 418745 (0.0010) [2023-12-26 02:55:42,236][123091] Updated weights for policy 0, policy_version 418755 (0.0009) [2023-12-26 02:55:42,305][123091] Updated weights for policy 0, policy_version 418765 (0.0008) [2023-12-26 02:55:42,866][123090] Updated weights for policy 1, policy_version 416074 (0.0010) [2023-12-26 02:55:42,918][123090] Updated weights for policy 1, policy_version 416085 (0.0010) [2023-12-26 02:55:42,973][123090] Updated weights for policy 1, policy_version 416095 (0.0009) [2023-12-26 02:55:43,096][123091] Updated weights for policy 0, policy_version 418775 (0.0009) [2023-12-26 02:55:43,148][123091] Updated weights for policy 0, policy_version 418785 (0.0009) [2023-12-26 02:55:43,200][123091] Updated weights for policy 0, policy_version 418795 (0.0009) [2023-12-26 02:55:43,734][123090] Updated weights for policy 1, policy_version 416105 (0.0007) [2023-12-26 02:55:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 213737472. Throughput: 0: 8912.6, 1: 8786.3. Samples: 213735632. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:43,785][121949] Avg episode reward: [(0, '6035.596'), (1, '5931.617')] [2023-12-26 02:55:43,796][123090] Updated weights for policy 1, policy_version 416115 (0.0010) [2023-12-26 02:55:43,854][123090] Updated weights for policy 1, policy_version 416125 (0.0006) [2023-12-26 02:55:44,135][123091] Updated weights for policy 0, policy_version 418805 (0.0010) [2023-12-26 02:55:44,183][123091] Updated weights for policy 0, policy_version 418815 (0.0010) [2023-12-26 02:55:44,235][123091] Updated weights for policy 0, policy_version 418825 (0.0010) [2023-12-26 02:55:44,537][123090] Updated weights for policy 1, policy_version 416135 (0.0009) [2023-12-26 02:55:44,604][123090] Updated weights for policy 1, policy_version 416145 (0.0010) [2023-12-26 02:55:44,659][123090] Updated weights for policy 1, policy_version 416155 (0.0010) [2023-12-26 02:55:45,009][123091] Updated weights for policy 0, policy_version 418835 (0.0011) [2023-12-26 02:55:45,085][123091] Updated weights for policy 0, policy_version 418845 (0.0007) [2023-12-26 02:55:45,155][123091] Updated weights for policy 0, policy_version 418855 (0.0006) [2023-12-26 02:55:45,464][123090] Updated weights for policy 1, policy_version 416165 (0.0010) [2023-12-26 02:55:45,524][123090] Updated weights for policy 1, policy_version 416175 (0.0010) [2023-12-26 02:55:45,586][123090] Updated weights for policy 1, policy_version 416185 (0.0011) [2023-12-26 02:55:45,773][123091] Updated weights for policy 0, policy_version 418865 (0.0006) [2023-12-26 02:55:45,829][123091] Updated weights for policy 0, policy_version 418875 (0.0005) [2023-12-26 02:55:45,891][123091] Updated weights for policy 0, policy_version 418885 (0.0011) [2023-12-26 02:55:45,949][123091] Updated weights for policy 0, policy_version 418895 (0.0010) [2023-12-26 02:55:46,271][123090] Updated weights for policy 1, policy_version 416195 (0.0009) [2023-12-26 02:55:46,327][123090] Updated weights for policy 1, policy_version 416205 (0.0005) [2023-12-26 02:55:46,388][123090] Updated weights for policy 1, policy_version 416215 (0.0005) [2023-12-26 02:55:46,675][123091] Updated weights for policy 0, policy_version 418905 (0.0007) [2023-12-26 02:55:46,732][123091] Updated weights for policy 0, policy_version 418915 (0.0007) [2023-12-26 02:55:46,787][123091] Updated weights for policy 0, policy_version 418925 (0.0005) [2023-12-26 02:55:47,140][123090] Updated weights for policy 1, policy_version 416225 (0.0010) [2023-12-26 02:55:47,195][123090] Updated weights for policy 1, policy_version 416235 (0.0006) [2023-12-26 02:55:47,249][123090] Updated weights for policy 1, policy_version 416245 (0.0005) [2023-12-26 02:55:47,299][123090] Updated weights for policy 1, policy_version 416255 (0.0005) [2023-12-26 02:55:47,461][123091] Updated weights for policy 0, policy_version 418935 (0.0005) [2023-12-26 02:55:47,517][123091] Updated weights for policy 0, policy_version 418945 (0.0005) [2023-12-26 02:55:47,573][123091] Updated weights for policy 0, policy_version 418955 (0.0005) [2023-12-26 02:55:47,951][123090] Updated weights for policy 1, policy_version 416265 (0.0005) [2023-12-26 02:55:47,996][123090] Updated weights for policy 1, policy_version 416275 (0.0005) [2023-12-26 02:55:48,050][123090] Updated weights for policy 1, policy_version 416285 (0.0005) [2023-12-26 02:55:48,299][123091] Updated weights for policy 0, policy_version 418965 (0.0008) [2023-12-26 02:55:48,363][123091] Updated weights for policy 0, policy_version 418975 (0.0008) [2023-12-26 02:55:48,427][123091] Updated weights for policy 0, policy_version 418985 (0.0010) [2023-12-26 02:55:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 213835776. Throughput: 0: 8937.5, 1: 8952.2. Samples: 213848560. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:48,785][121949] Avg episode reward: [(0, '5943.328'), (1, '5975.989')] [2023-12-26 02:55:48,849][123090] Updated weights for policy 1, policy_version 416295 (0.0008) [2023-12-26 02:55:48,918][123090] Updated weights for policy 1, policy_version 416305 (0.0009) [2023-12-26 02:55:48,982][123090] Updated weights for policy 1, policy_version 416315 (0.0009) [2023-12-26 02:55:49,273][123091] Updated weights for policy 0, policy_version 418995 (0.0011) [2023-12-26 02:55:49,333][123091] Updated weights for policy 0, policy_version 419005 (0.0010) [2023-12-26 02:55:49,395][123091] Updated weights for policy 0, policy_version 419015 (0.0012) [2023-12-26 02:55:49,852][123090] Updated weights for policy 1, policy_version 416325 (0.0009) [2023-12-26 02:55:49,914][123090] Updated weights for policy 1, policy_version 416335 (0.0009) [2023-12-26 02:55:49,986][123090] Updated weights for policy 1, policy_version 416345 (0.0010) [2023-12-26 02:55:50,152][123091] Updated weights for policy 0, policy_version 419025 (0.0010) [2023-12-26 02:55:50,204][123091] Updated weights for policy 0, policy_version 419035 (0.0010) [2023-12-26 02:55:50,272][123091] Updated weights for policy 0, policy_version 419045 (0.0011) [2023-12-26 02:55:50,340][123091] Updated weights for policy 0, policy_version 419055 (0.0010) [2023-12-26 02:55:50,886][123090] Updated weights for policy 1, policy_version 416355 (0.0008) [2023-12-26 02:55:50,955][123090] Updated weights for policy 1, policy_version 416365 (0.0006) [2023-12-26 02:55:51,026][123090] Updated weights for policy 1, policy_version 416375 (0.0006) [2023-12-26 02:55:51,111][123091] Updated weights for policy 0, policy_version 419065 (0.0010) [2023-12-26 02:55:51,179][123091] Updated weights for policy 0, policy_version 419075 (0.0011) [2023-12-26 02:55:51,238][123091] Updated weights for policy 0, policy_version 419085 (0.0010) [2023-12-26 02:55:51,756][123090] Updated weights for policy 1, policy_version 416385 (0.0008) [2023-12-26 02:55:51,829][123090] Updated weights for policy 1, policy_version 416395 (0.0006) [2023-12-26 02:55:51,890][123090] Updated weights for policy 1, policy_version 416405 (0.0008) [2023-12-26 02:55:51,954][123090] Updated weights for policy 1, policy_version 416415 (0.0009) [2023-12-26 02:55:52,056][123091] Updated weights for policy 0, policy_version 419095 (0.0010) [2023-12-26 02:55:52,126][123091] Updated weights for policy 0, policy_version 419105 (0.0010) [2023-12-26 02:55:52,185][123091] Updated weights for policy 0, policy_version 419115 (0.0010) [2023-12-26 02:55:52,713][123090] Updated weights for policy 1, policy_version 416425 (0.0005) [2023-12-26 02:55:52,789][123090] Updated weights for policy 1, policy_version 416435 (0.0006) [2023-12-26 02:55:52,863][123090] Updated weights for policy 1, policy_version 416445 (0.0005) [2023-12-26 02:55:52,998][123091] Updated weights for policy 0, policy_version 419125 (0.0011) [2023-12-26 02:55:53,065][123091] Updated weights for policy 0, policy_version 419135 (0.0010) [2023-12-26 02:55:53,130][123091] Updated weights for policy 0, policy_version 419145 (0.0010) [2023-12-26 02:55:53,568][123090] Updated weights for policy 1, policy_version 416455 (0.0006) [2023-12-26 02:55:53,626][123090] Updated weights for policy 1, policy_version 416465 (0.0005) [2023-12-26 02:55:53,684][123090] Updated weights for policy 1, policy_version 416475 (0.0005) [2023-12-26 02:55:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 213925888. Throughput: 0: 8878.8, 1: 8941.8. Samples: 213900532. Policy #0 lag: (min: 15.0, avg: 23.0, max: 47.0) [2023-12-26 02:55:53,785][121949] Avg episode reward: [(0, '5907.756'), (1, '5930.129')] [2023-12-26 02:55:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000416480_106618880.pth... [2023-12-26 02:55:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000419152_107307008.pth... [2023-12-26 02:55:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000418128_107044864.pth [2023-12-26 02:55:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000415392_106340352.pth [2023-12-26 02:55:53,939][123091] Updated weights for policy 0, policy_version 419155 (0.0010) [2023-12-26 02:55:54,005][123091] Updated weights for policy 0, policy_version 419165 (0.0010) [2023-12-26 02:55:54,072][123091] Updated weights for policy 0, policy_version 419175 (0.0011) [2023-12-26 02:55:54,388][123090] Updated weights for policy 1, policy_version 416485 (0.0008) [2023-12-26 02:55:54,450][123090] Updated weights for policy 1, policy_version 416495 (0.0010) [2023-12-26 02:55:54,520][123090] Updated weights for policy 1, policy_version 416505 (0.0007) [2023-12-26 02:55:54,865][123091] Updated weights for policy 0, policy_version 419185 (0.0007) [2023-12-26 02:55:54,937][123091] Updated weights for policy 0, policy_version 419195 (0.0010) [2023-12-26 02:55:54,997][123091] Updated weights for policy 0, policy_version 419205 (0.0010) [2023-12-26 02:55:55,056][123091] Updated weights for policy 0, policy_version 419215 (0.0010) [2023-12-26 02:55:55,340][123090] Updated weights for policy 1, policy_version 416515 (0.0009) [2023-12-26 02:55:55,404][123090] Updated weights for policy 1, policy_version 416525 (0.0008) [2023-12-26 02:55:55,453][123090] Updated weights for policy 1, policy_version 416535 (0.0009) [2023-12-26 02:55:55,833][123091] Updated weights for policy 0, policy_version 419225 (0.0006) [2023-12-26 02:55:55,890][123091] Updated weights for policy 0, policy_version 419235 (0.0005) [2023-12-26 02:55:55,946][123091] Updated weights for policy 0, policy_version 419245 (0.0010) [2023-12-26 02:55:56,299][123090] Updated weights for policy 1, policy_version 416545 (0.0008) [2023-12-26 02:55:56,371][123090] Updated weights for policy 1, policy_version 416555 (0.0005) [2023-12-26 02:55:56,436][123090] Updated weights for policy 1, policy_version 416565 (0.0005) [2023-12-26 02:55:56,515][123090] Updated weights for policy 1, policy_version 416575 (0.0005) [2023-12-26 02:55:56,638][123091] Updated weights for policy 0, policy_version 419255 (0.0007) [2023-12-26 02:55:56,710][123091] Updated weights for policy 0, policy_version 419265 (0.0006) [2023-12-26 02:55:56,786][123091] Updated weights for policy 0, policy_version 419275 (0.0010) [2023-12-26 02:55:57,183][123090] Updated weights for policy 1, policy_version 416585 (0.0009) [2023-12-26 02:55:57,238][123090] Updated weights for policy 1, policy_version 416596 (0.0010) [2023-12-26 02:55:57,303][123090] Updated weights for policy 1, policy_version 416606 (0.0010) [2023-12-26 02:55:57,511][123091] Updated weights for policy 0, policy_version 419285 (0.0008) [2023-12-26 02:55:57,588][123091] Updated weights for policy 0, policy_version 419295 (0.0005) [2023-12-26 02:55:57,657][123091] Updated weights for policy 0, policy_version 419305 (0.0005) [2023-12-26 02:55:58,209][123090] Updated weights for policy 1, policy_version 416616 (0.0008) [2023-12-26 02:55:58,291][123090] Updated weights for policy 1, policy_version 416626 (0.0007) [2023-12-26 02:55:58,363][123090] Updated weights for policy 1, policy_version 416636 (0.0008) [2023-12-26 02:55:58,370][123091] Updated weights for policy 0, policy_version 419315 (0.0006) [2023-12-26 02:55:58,434][123091] Updated weights for policy 0, policy_version 419325 (0.0005) [2023-12-26 02:55:58,500][123091] Updated weights for policy 0, policy_version 419335 (0.0008) [2023-12-26 02:55:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 214016000. Throughput: 0: 8890.2, 1: 9033.9. Samples: 214009192. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:55:58,785][121949] Avg episode reward: [(0, '5990.261'), (1, '5866.905')] [2023-12-26 02:55:59,258][123090] Updated weights for policy 1, policy_version 416646 (0.0009) [2023-12-26 02:55:59,273][123091] Updated weights for policy 0, policy_version 419345 (0.0008) [2023-12-26 02:55:59,318][123090] Updated weights for policy 1, policy_version 416656 (0.0009) [2023-12-26 02:55:59,340][123091] Updated weights for policy 0, policy_version 419355 (0.0009) [2023-12-26 02:55:59,390][123090] Updated weights for policy 1, policy_version 416666 (0.0008) [2023-12-26 02:55:59,411][123091] Updated weights for policy 0, policy_version 419365 (0.0011) [2023-12-26 02:55:59,477][123091] Updated weights for policy 0, policy_version 419375 (0.0010) [2023-12-26 02:56:00,167][123091] Updated weights for policy 0, policy_version 419385 (0.0009) [2023-12-26 02:56:00,223][123091] Updated weights for policy 0, policy_version 419395 (0.0010) [2023-12-26 02:56:00,252][123090] Updated weights for policy 1, policy_version 416676 (0.0008) [2023-12-26 02:56:00,275][123091] Updated weights for policy 0, policy_version 419405 (0.0010) [2023-12-26 02:56:00,320][123090] Updated weights for policy 1, policy_version 416686 (0.0008) [2023-12-26 02:56:00,381][123090] Updated weights for policy 1, policy_version 416696 (0.0007) [2023-12-26 02:56:00,907][123091] Updated weights for policy 0, policy_version 419415 (0.0010) [2023-12-26 02:56:00,955][123091] Updated weights for policy 0, policy_version 419425 (0.0010) [2023-12-26 02:56:01,009][123091] Updated weights for policy 0, policy_version 419435 (0.0010) [2023-12-26 02:56:01,065][123090] Updated weights for policy 1, policy_version 416706 (0.0006) [2023-12-26 02:56:01,133][123090] Updated weights for policy 1, policy_version 416716 (0.0010) [2023-12-26 02:56:01,198][123090] Updated weights for policy 1, policy_version 416726 (0.0009) [2023-12-26 02:56:01,256][123090] Updated weights for policy 1, policy_version 416736 (0.0012) [2023-12-26 02:56:01,843][123091] Updated weights for policy 0, policy_version 419445 (0.0008) [2023-12-26 02:56:01,890][123091] Updated weights for policy 0, policy_version 419455 (0.0008) [2023-12-26 02:56:01,949][123091] Updated weights for policy 0, policy_version 419465 (0.0008) [2023-12-26 02:56:01,980][123090] Updated weights for policy 1, policy_version 416746 (0.0008) [2023-12-26 02:56:02,034][123090] Updated weights for policy 1, policy_version 416756 (0.0009) [2023-12-26 02:56:02,085][123090] Updated weights for policy 1, policy_version 416766 (0.0008) [2023-12-26 02:56:02,713][123091] Updated weights for policy 0, policy_version 419475 (0.0009) [2023-12-26 02:56:02,767][123091] Updated weights for policy 0, policy_version 419485 (0.0009) [2023-12-26 02:56:02,824][123091] Updated weights for policy 0, policy_version 419495 (0.0009) [2023-12-26 02:56:02,936][123090] Updated weights for policy 1, policy_version 416776 (0.0006) [2023-12-26 02:56:03,001][123090] Updated weights for policy 1, policy_version 416786 (0.0005) [2023-12-26 02:56:03,060][123090] Updated weights for policy 1, policy_version 416796 (0.0005) [2023-12-26 02:56:03,687][123090] Updated weights for policy 1, policy_version 416806 (0.0005) [2023-12-26 02:56:03,723][123091] Updated weights for policy 0, policy_version 419505 (0.0009) [2023-12-26 02:56:03,758][123090] Updated weights for policy 1, policy_version 416816 (0.0006) [2023-12-26 02:56:03,773][123091] Updated weights for policy 0, policy_version 419515 (0.0006) [2023-12-26 02:56:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 214097920. Throughput: 0: 8885.2, 1: 9003.5. Samples: 214116676. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:03,784][121949] Avg episode reward: [(0, '5870.364'), (1, '5860.585')] [2023-12-26 02:56:03,823][123090] Updated weights for policy 1, policy_version 416826 (0.0005) [2023-12-26 02:56:03,834][123091] Updated weights for policy 0, policy_version 419525 (0.0007) [2023-12-26 02:56:03,904][123091] Updated weights for policy 0, policy_version 419535 (0.0009) [2023-12-26 02:56:04,620][123090] Updated weights for policy 1, policy_version 416836 (0.0009) [2023-12-26 02:56:04,681][123090] Updated weights for policy 1, policy_version 416846 (0.0008) [2023-12-26 02:56:04,692][123091] Updated weights for policy 0, policy_version 419545 (0.0008) [2023-12-26 02:56:04,748][123090] Updated weights for policy 1, policy_version 416856 (0.0008) [2023-12-26 02:56:04,749][123091] Updated weights for policy 0, policy_version 419555 (0.0005) [2023-12-26 02:56:04,799][123091] Updated weights for policy 0, policy_version 419565 (0.0009) [2023-12-26 02:56:05,524][123091] Updated weights for policy 0, policy_version 419575 (0.0005) [2023-12-26 02:56:05,593][123091] Updated weights for policy 0, policy_version 419585 (0.0005) [2023-12-26 02:56:05,626][123090] Updated weights for policy 1, policy_version 416866 (0.0007) [2023-12-26 02:56:05,643][123091] Updated weights for policy 0, policy_version 419595 (0.0006) [2023-12-26 02:56:05,683][123090] Updated weights for policy 1, policy_version 416876 (0.0010) [2023-12-26 02:56:05,743][123090] Updated weights for policy 1, policy_version 416886 (0.0009) [2023-12-26 02:56:05,800][123090] Updated weights for policy 1, policy_version 416896 (0.0008) [2023-12-26 02:56:06,362][123091] Updated weights for policy 0, policy_version 419605 (0.0008) [2023-12-26 02:56:06,425][123091] Updated weights for policy 0, policy_version 419615 (0.0009) [2023-12-26 02:56:06,479][123091] Updated weights for policy 0, policy_version 419625 (0.0009) [2023-12-26 02:56:06,643][123090] Updated weights for policy 1, policy_version 416906 (0.0010) [2023-12-26 02:56:06,710][123090] Updated weights for policy 1, policy_version 416916 (0.0010) [2023-12-26 02:56:06,777][123090] Updated weights for policy 1, policy_version 416926 (0.0010) [2023-12-26 02:56:07,351][123091] Updated weights for policy 0, policy_version 419635 (0.0010) [2023-12-26 02:56:07,401][123091] Updated weights for policy 0, policy_version 419645 (0.0009) [2023-12-26 02:56:07,467][123091] Updated weights for policy 0, policy_version 419655 (0.0009) [2023-12-26 02:56:07,537][123090] Updated weights for policy 1, policy_version 416936 (0.0007) [2023-12-26 02:56:07,597][123090] Updated weights for policy 1, policy_version 416946 (0.0009) [2023-12-26 02:56:07,655][123090] Updated weights for policy 1, policy_version 416956 (0.0009) [2023-12-26 02:56:08,265][123091] Updated weights for policy 0, policy_version 419665 (0.0010) [2023-12-26 02:56:08,342][123091] Updated weights for policy 0, policy_version 419675 (0.0009) [2023-12-26 02:56:08,403][123091] Updated weights for policy 0, policy_version 419685 (0.0010) [2023-12-26 02:56:08,469][123091] Updated weights for policy 0, policy_version 419695 (0.0009) [2023-12-26 02:56:08,476][123090] Updated weights for policy 1, policy_version 416966 (0.0008) [2023-12-26 02:56:08,537][123090] Updated weights for policy 1, policy_version 416976 (0.0006) [2023-12-26 02:56:08,595][123090] Updated weights for policy 1, policy_version 416986 (0.0005) [2023-12-26 02:56:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 214196224. Throughput: 0: 8938.5, 1: 9003.1. Samples: 214169408. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:08,785][121949] Avg episode reward: [(0, '5850.292'), (1, '5876.629')] [2023-12-26 02:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000419696_107446272.pth... [2023-12-26 02:56:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000416992_106749952.pth... [2023-12-26 02:56:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000418640_107175936.pth [2023-12-26 02:56:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000415936_106479616.pth [2023-12-26 02:56:09,335][123091] Updated weights for policy 0, policy_version 419705 (0.0009) [2023-12-26 02:56:09,398][123090] Updated weights for policy 1, policy_version 416996 (0.0009) [2023-12-26 02:56:09,414][123091] Updated weights for policy 0, policy_version 419715 (0.0008) [2023-12-26 02:56:09,466][123090] Updated weights for policy 1, policy_version 417006 (0.0010) [2023-12-26 02:56:09,488][123091] Updated weights for policy 0, policy_version 419725 (0.0010) [2023-12-26 02:56:09,528][123090] Updated weights for policy 1, policy_version 417016 (0.0008) [2023-12-26 02:56:10,378][123091] Updated weights for policy 0, policy_version 419735 (0.0009) [2023-12-26 02:56:10,380][123090] Updated weights for policy 1, policy_version 417026 (0.0009) [2023-12-26 02:56:10,440][123091] Updated weights for policy 0, policy_version 419745 (0.0008) [2023-12-26 02:56:10,442][123090] Updated weights for policy 1, policy_version 417036 (0.0008) [2023-12-26 02:56:10,506][123090] Updated weights for policy 1, policy_version 417046 (0.0008) [2023-12-26 02:56:10,508][123091] Updated weights for policy 0, policy_version 419755 (0.0010) [2023-12-26 02:56:10,558][123090] Updated weights for policy 1, policy_version 417056 (0.0009) [2023-12-26 02:56:11,350][123091] Updated weights for policy 0, policy_version 419765 (0.0009) [2023-12-26 02:56:11,420][123090] Updated weights for policy 1, policy_version 417066 (0.0008) [2023-12-26 02:56:11,425][123091] Updated weights for policy 0, policy_version 419775 (0.0009) [2023-12-26 02:56:11,481][123091] Updated weights for policy 0, policy_version 419785 (0.0009) [2023-12-26 02:56:11,492][123090] Updated weights for policy 1, policy_version 417076 (0.0009) [2023-12-26 02:56:11,554][123090] Updated weights for policy 1, policy_version 417086 (0.0009) [2023-12-26 02:56:12,367][123091] Updated weights for policy 0, policy_version 419795 (0.0010) [2023-12-26 02:56:12,410][123090] Updated weights for policy 1, policy_version 417097 (0.0008) [2023-12-26 02:56:12,430][123091] Updated weights for policy 0, policy_version 419805 (0.0006) [2023-12-26 02:56:12,475][123090] Updated weights for policy 1, policy_version 417107 (0.0008) [2023-12-26 02:56:12,498][123091] Updated weights for policy 0, policy_version 419815 (0.0008) [2023-12-26 02:56:12,532][123090] Updated weights for policy 1, policy_version 417117 (0.0008) [2023-12-26 02:56:13,299][123090] Updated weights for policy 1, policy_version 417127 (0.0009) [2023-12-26 02:56:13,312][123091] Updated weights for policy 0, policy_version 419825 (0.0008) [2023-12-26 02:56:13,350][123090] Updated weights for policy 1, policy_version 417137 (0.0008) [2023-12-26 02:56:13,373][123091] Updated weights for policy 0, policy_version 419835 (0.0009) [2023-12-26 02:56:13,400][123090] Updated weights for policy 1, policy_version 417147 (0.0009) [2023-12-26 02:56:13,434][123091] Updated weights for policy 0, policy_version 419845 (0.0008) [2023-12-26 02:56:13,497][123091] Updated weights for policy 0, policy_version 419855 (0.0006) [2023-12-26 02:56:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 214278144. Throughput: 0: 8941.4, 1: 8942.0. Samples: 214270000. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:13,785][121949] Avg episode reward: [(0, '6001.489'), (1, '5839.192')] [2023-12-26 02:56:14,181][123091] Updated weights for policy 0, policy_version 419865 (0.0006) [2023-12-26 02:56:14,230][123091] Updated weights for policy 0, policy_version 419875 (0.0005) [2023-12-26 02:56:14,233][123090] Updated weights for policy 1, policy_version 417157 (0.0008) [2023-12-26 02:56:14,283][123091] Updated weights for policy 0, policy_version 419885 (0.0005) [2023-12-26 02:56:14,302][123090] Updated weights for policy 1, policy_version 417167 (0.0006) [2023-12-26 02:56:14,368][123090] Updated weights for policy 1, policy_version 417177 (0.0006) [2023-12-26 02:56:15,012][123091] Updated weights for policy 0, policy_version 419895 (0.0007) [2023-12-26 02:56:15,030][123090] Updated weights for policy 1, policy_version 417187 (0.0007) [2023-12-26 02:56:15,082][123091] Updated weights for policy 0, policy_version 419905 (0.0006) [2023-12-26 02:56:15,100][123090] Updated weights for policy 1, policy_version 417197 (0.0006) [2023-12-26 02:56:15,151][123091] Updated weights for policy 0, policy_version 419915 (0.0007) [2023-12-26 02:56:15,172][123090] Updated weights for policy 1, policy_version 417207 (0.0008) [2023-12-26 02:56:15,821][123091] Updated weights for policy 0, policy_version 419925 (0.0008) [2023-12-26 02:56:15,873][123091] Updated weights for policy 0, policy_version 419935 (0.0009) [2023-12-26 02:56:15,937][123091] Updated weights for policy 0, policy_version 419945 (0.0008) [2023-12-26 02:56:15,979][123090] Updated weights for policy 1, policy_version 417217 (0.0009) [2023-12-26 02:56:16,054][123090] Updated weights for policy 1, policy_version 417227 (0.0009) [2023-12-26 02:56:16,127][123090] Updated weights for policy 1, policy_version 417237 (0.0010) [2023-12-26 02:56:16,205][123090] Updated weights for policy 1, policy_version 417247 (0.0009) [2023-12-26 02:56:16,671][123091] Updated weights for policy 0, policy_version 419955 (0.0006) [2023-12-26 02:56:16,729][123091] Updated weights for policy 0, policy_version 419965 (0.0009) [2023-12-26 02:56:16,796][123091] Updated weights for policy 0, policy_version 419975 (0.0009) [2023-12-26 02:56:17,065][123090] Updated weights for policy 1, policy_version 417257 (0.0009) [2023-12-26 02:56:17,129][123090] Updated weights for policy 1, policy_version 417267 (0.0009) [2023-12-26 02:56:17,197][123090] Updated weights for policy 1, policy_version 417277 (0.0010) [2023-12-26 02:56:17,602][123091] Updated weights for policy 0, policy_version 419985 (0.0008) [2023-12-26 02:56:17,671][123091] Updated weights for policy 0, policy_version 419995 (0.0005) [2023-12-26 02:56:17,733][123091] Updated weights for policy 0, policy_version 420005 (0.0010) [2023-12-26 02:56:17,780][123091] Updated weights for policy 0, policy_version 420015 (0.0010) [2023-12-26 02:56:18,016][123090] Updated weights for policy 1, policy_version 417287 (0.0009) [2023-12-26 02:56:18,087][123090] Updated weights for policy 1, policy_version 417297 (0.0009) [2023-12-26 02:56:18,151][123090] Updated weights for policy 1, policy_version 417307 (0.0009) [2023-12-26 02:56:18,538][123091] Updated weights for policy 0, policy_version 420026 (0.0010) [2023-12-26 02:56:18,592][123091] Updated weights for policy 0, policy_version 420036 (0.0009) [2023-12-26 02:56:18,644][123091] Updated weights for policy 0, policy_version 420046 (0.0009) [2023-12-26 02:56:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 214368256. Throughput: 0: 8960.2, 1: 8875.7. Samples: 214378544. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:18,785][121949] Avg episode reward: [(0, '5863.364'), (1, '5867.024')] [2023-12-26 02:56:18,971][123090] Updated weights for policy 1, policy_version 417317 (0.0009) [2023-12-26 02:56:19,033][123090] Updated weights for policy 1, policy_version 417327 (0.0009) [2023-12-26 02:56:19,082][123090] Updated weights for policy 1, policy_version 417337 (0.0009) [2023-12-26 02:56:19,531][123091] Updated weights for policy 0, policy_version 420056 (0.0010) [2023-12-26 02:56:19,601][123091] Updated weights for policy 0, policy_version 420066 (0.0011) [2023-12-26 02:56:19,673][123091] Updated weights for policy 0, policy_version 420076 (0.0011) [2023-12-26 02:56:19,963][123090] Updated weights for policy 1, policy_version 417347 (0.0007) [2023-12-26 02:56:20,026][123090] Updated weights for policy 1, policy_version 417357 (0.0008) [2023-12-26 02:56:20,089][123090] Updated weights for policy 1, policy_version 417367 (0.0009) [2023-12-26 02:56:20,519][123091] Updated weights for policy 0, policy_version 420086 (0.0010) [2023-12-26 02:56:20,583][123091] Updated weights for policy 0, policy_version 420096 (0.0010) [2023-12-26 02:56:20,656][123091] Updated weights for policy 0, policy_version 420106 (0.0010) [2023-12-26 02:56:20,885][123090] Updated weights for policy 1, policy_version 417377 (0.0009) [2023-12-26 02:56:20,946][123090] Updated weights for policy 1, policy_version 417388 (0.0008) [2023-12-26 02:56:21,000][123090] Updated weights for policy 1, policy_version 417398 (0.0009) [2023-12-26 02:56:21,071][123090] Updated weights for policy 1, policy_version 417408 (0.0008) [2023-12-26 02:56:21,543][123091] Updated weights for policy 0, policy_version 420116 (0.0009) [2023-12-26 02:56:21,610][123091] Updated weights for policy 0, policy_version 420126 (0.0009) [2023-12-26 02:56:21,680][123091] Updated weights for policy 0, policy_version 420136 (0.0009) [2023-12-26 02:56:21,940][123090] Updated weights for policy 1, policy_version 417418 (0.0010) [2023-12-26 02:56:22,000][123090] Updated weights for policy 1, policy_version 417428 (0.0009) [2023-12-26 02:56:22,064][123090] Updated weights for policy 1, policy_version 417438 (0.0008) [2023-12-26 02:56:22,519][123091] Updated weights for policy 0, policy_version 420146 (0.0009) [2023-12-26 02:56:22,574][123091] Updated weights for policy 0, policy_version 420156 (0.0009) [2023-12-26 02:56:22,634][123091] Updated weights for policy 0, policy_version 420166 (0.0009) [2023-12-26 02:56:22,700][123091] Updated weights for policy 0, policy_version 420176 (0.0011) [2023-12-26 02:56:22,906][123090] Updated weights for policy 1, policy_version 417448 (0.0010) [2023-12-26 02:56:22,979][123090] Updated weights for policy 1, policy_version 417458 (0.0010) [2023-12-26 02:56:23,050][123090] Updated weights for policy 1, policy_version 417468 (0.0010) [2023-12-26 02:56:23,470][123091] Updated weights for policy 0, policy_version 420186 (0.0005) [2023-12-26 02:56:23,529][123091] Updated weights for policy 0, policy_version 420196 (0.0005) [2023-12-26 02:56:23,588][123091] Updated weights for policy 0, policy_version 420206 (0.0005) [2023-12-26 02:56:23,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 214450176. Throughput: 0: 8913.7, 1: 8781.0. Samples: 214428256. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:23,785][121949] Avg episode reward: [(0, '5926.320'), (1, '5849.180')] [2023-12-26 02:56:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000420208_107577344.pth... [2023-12-26 02:56:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000419152_107307008.pth [2023-12-26 02:56:23,806][123090] Updated weights for policy 1, policy_version 417478 (0.0010) [2023-12-26 02:56:23,879][123090] Updated weights for policy 1, policy_version 417488 (0.0011) [2023-12-26 02:56:23,944][123090] Updated weights for policy 1, policy_version 417498 (0.0010) [2023-12-26 02:56:23,979][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000417504_106881024.pth... [2023-12-26 02:56:23,984][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000416480_106618880.pth [2023-12-26 02:56:24,254][123091] Updated weights for policy 0, policy_version 420216 (0.0008) [2023-12-26 02:56:24,321][123091] Updated weights for policy 0, policy_version 420227 (0.0010) [2023-12-26 02:56:24,380][123091] Updated weights for policy 0, policy_version 420237 (0.0009) [2023-12-26 02:56:24,710][123090] Updated weights for policy 1, policy_version 417508 (0.0010) [2023-12-26 02:56:24,781][123090] Updated weights for policy 1, policy_version 417518 (0.0007) [2023-12-26 02:56:24,853][123090] Updated weights for policy 1, policy_version 417528 (0.0010) [2023-12-26 02:56:25,222][123091] Updated weights for policy 0, policy_version 420247 (0.0007) [2023-12-26 02:56:25,299][123091] Updated weights for policy 0, policy_version 420257 (0.0006) [2023-12-26 02:56:25,370][123091] Updated weights for policy 0, policy_version 420267 (0.0005) [2023-12-26 02:56:25,588][123090] Updated weights for policy 1, policy_version 417538 (0.0009) [2023-12-26 02:56:25,659][123090] Updated weights for policy 1, policy_version 417548 (0.0005) [2023-12-26 02:56:25,727][123090] Updated weights for policy 1, policy_version 417558 (0.0007) [2023-12-26 02:56:25,776][123090] Updated weights for policy 1, policy_version 417568 (0.0009) [2023-12-26 02:56:26,012][123091] Updated weights for policy 0, policy_version 420277 (0.0007) [2023-12-26 02:56:26,071][123091] Updated weights for policy 0, policy_version 420287 (0.0009) [2023-12-26 02:56:26,133][123091] Updated weights for policy 0, policy_version 420297 (0.0009) [2023-12-26 02:56:26,539][123090] Updated weights for policy 1, policy_version 417578 (0.0010) [2023-12-26 02:56:26,594][123090] Updated weights for policy 1, policy_version 417589 (0.0010) [2023-12-26 02:56:26,649][123090] Updated weights for policy 1, policy_version 417600 (0.0010) [2023-12-26 02:56:26,840][123091] Updated weights for policy 0, policy_version 420307 (0.0008) [2023-12-26 02:56:26,886][123091] Updated weights for policy 0, policy_version 420317 (0.0005) [2023-12-26 02:56:26,930][123091] Updated weights for policy 0, policy_version 420327 (0.0005) [2023-12-26 02:56:27,557][123090] Updated weights for policy 1, policy_version 417610 (0.0010) [2023-12-26 02:56:27,624][123090] Updated weights for policy 1, policy_version 417620 (0.0010) [2023-12-26 02:56:27,690][123091] Updated weights for policy 0, policy_version 420337 (0.0006) [2023-12-26 02:56:27,697][123090] Updated weights for policy 1, policy_version 417630 (0.0010) [2023-12-26 02:56:27,749][123091] Updated weights for policy 0, policy_version 420347 (0.0010) [2023-12-26 02:56:27,802][123091] Updated weights for policy 0, policy_version 420357 (0.0010) [2023-12-26 02:56:27,856][123091] Updated weights for policy 0, policy_version 420367 (0.0010) [2023-12-26 02:56:28,484][123090] Updated weights for policy 1, policy_version 417640 (0.0011) [2023-12-26 02:56:28,544][123090] Updated weights for policy 1, policy_version 417650 (0.0011) [2023-12-26 02:56:28,596][123090] Updated weights for policy 1, policy_version 417660 (0.0010) [2023-12-26 02:56:28,666][123091] Updated weights for policy 0, policy_version 420377 (0.0011) [2023-12-26 02:56:28,733][123091] Updated weights for policy 0, policy_version 420387 (0.0011) [2023-12-26 02:56:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 214540288. Throughput: 0: 9014.9, 1: 8784.8. Samples: 214536620. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:28,785][121949] Avg episode reward: [(0, '6183.056'), (1, '5777.410')] [2023-12-26 02:56:28,789][123091] Updated weights for policy 0, policy_version 420397 (0.0011) [2023-12-26 02:56:29,426][123090] Updated weights for policy 1, policy_version 417670 (0.0008) [2023-12-26 02:56:29,485][123090] Updated weights for policy 1, policy_version 417680 (0.0005) [2023-12-26 02:56:29,533][123090] Updated weights for policy 1, policy_version 417690 (0.0005) [2023-12-26 02:56:29,573][123091] Updated weights for policy 0, policy_version 420407 (0.0009) [2023-12-26 02:56:29,631][123091] Updated weights for policy 0, policy_version 420417 (0.0009) [2023-12-26 02:56:29,688][123091] Updated weights for policy 0, policy_version 420427 (0.0009) [2023-12-26 02:56:30,276][123090] Updated weights for policy 1, policy_version 417700 (0.0005) [2023-12-26 02:56:30,333][123090] Updated weights for policy 1, policy_version 417710 (0.0005) [2023-12-26 02:56:30,397][123090] Updated weights for policy 1, policy_version 417720 (0.0005) [2023-12-26 02:56:30,599][123091] Updated weights for policy 0, policy_version 420437 (0.0008) [2023-12-26 02:56:30,657][123091] Updated weights for policy 0, policy_version 420447 (0.0007) [2023-12-26 02:56:30,713][123091] Updated weights for policy 0, policy_version 420457 (0.0005) [2023-12-26 02:56:31,141][123090] Updated weights for policy 1, policy_version 417730 (0.0006) [2023-12-26 02:56:31,207][123090] Updated weights for policy 1, policy_version 417740 (0.0010) [2023-12-26 02:56:31,274][123090] Updated weights for policy 1, policy_version 417750 (0.0010) [2023-12-26 02:56:31,347][123090] Updated weights for policy 1, policy_version 417760 (0.0009) [2023-12-26 02:56:31,493][123091] Updated weights for policy 0, policy_version 420467 (0.0005) [2023-12-26 02:56:31,545][123091] Updated weights for policy 0, policy_version 420477 (0.0005) [2023-12-26 02:56:31,616][123091] Updated weights for policy 0, policy_version 420487 (0.0006) [2023-12-26 02:56:32,132][123090] Updated weights for policy 1, policy_version 417770 (0.0008) [2023-12-26 02:56:32,181][123090] Updated weights for policy 1, policy_version 417780 (0.0009) [2023-12-26 02:56:32,233][123090] Updated weights for policy 1, policy_version 417790 (0.0008) [2023-12-26 02:56:32,293][123091] Updated weights for policy 0, policy_version 420497 (0.0008) [2023-12-26 02:56:32,353][123091] Updated weights for policy 0, policy_version 420507 (0.0011) [2023-12-26 02:56:32,408][123091] Updated weights for policy 0, policy_version 420517 (0.0008) [2023-12-26 02:56:32,466][123091] Updated weights for policy 0, policy_version 420527 (0.0005) [2023-12-26 02:56:32,983][123090] Updated weights for policy 1, policy_version 417800 (0.0006) [2023-12-26 02:56:33,039][123090] Updated weights for policy 1, policy_version 417810 (0.0006) [2023-12-26 02:56:33,102][123090] Updated weights for policy 1, policy_version 417820 (0.0005) [2023-12-26 02:56:33,148][123091] Updated weights for policy 0, policy_version 420537 (0.0005) [2023-12-26 02:56:33,193][123091] Updated weights for policy 0, policy_version 420547 (0.0005) [2023-12-26 02:56:33,239][123091] Updated weights for policy 0, policy_version 420557 (0.0005) [2023-12-26 02:56:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 214630400. Throughput: 0: 8991.0, 1: 8742.0. Samples: 214646548. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:33,785][121949] Avg episode reward: [(0, '6150.260'), (1, '5732.990')] [2023-12-26 02:56:33,791][123090] Updated weights for policy 1, policy_version 417830 (0.0008) [2023-12-26 02:56:33,843][123090] Updated weights for policy 1, policy_version 417840 (0.0010) [2023-12-26 02:56:33,895][123090] Updated weights for policy 1, policy_version 417850 (0.0010) [2023-12-26 02:56:33,909][123091] Updated weights for policy 0, policy_version 420567 (0.0005) [2023-12-26 02:56:33,971][123091] Updated weights for policy 0, policy_version 420577 (0.0006) [2023-12-26 02:56:34,046][123091] Updated weights for policy 0, policy_version 420587 (0.0005) [2023-12-26 02:56:34,735][123091] Updated weights for policy 0, policy_version 420597 (0.0007) [2023-12-26 02:56:34,760][123090] Updated weights for policy 1, policy_version 417860 (0.0008) [2023-12-26 02:56:34,809][123091] Updated weights for policy 0, policy_version 420607 (0.0005) [2023-12-26 02:56:34,827][123090] Updated weights for policy 1, policy_version 417870 (0.0009) [2023-12-26 02:56:34,871][123091] Updated weights for policy 0, policy_version 420617 (0.0005) [2023-12-26 02:56:34,887][123090] Updated weights for policy 1, policy_version 417880 (0.0010) [2023-12-26 02:56:35,565][123091] Updated weights for policy 0, policy_version 420627 (0.0006) [2023-12-26 02:56:35,617][123091] Updated weights for policy 0, policy_version 420637 (0.0009) [2023-12-26 02:56:35,665][123091] Updated weights for policy 0, policy_version 420647 (0.0009) [2023-12-26 02:56:35,692][123090] Updated weights for policy 1, policy_version 417890 (0.0009) [2023-12-26 02:56:35,743][123090] Updated weights for policy 1, policy_version 417900 (0.0005) [2023-12-26 02:56:35,800][123090] Updated weights for policy 1, policy_version 417910 (0.0005) [2023-12-26 02:56:35,856][123090] Updated weights for policy 1, policy_version 417920 (0.0005) [2023-12-26 02:56:36,529][123091] Updated weights for policy 0, policy_version 420657 (0.0009) [2023-12-26 02:56:36,589][123090] Updated weights for policy 1, policy_version 417930 (0.0009) [2023-12-26 02:56:36,592][123091] Updated weights for policy 0, policy_version 420667 (0.0005) [2023-12-26 02:56:36,648][123091] Updated weights for policy 0, policy_version 420677 (0.0005) [2023-12-26 02:56:36,652][123090] Updated weights for policy 1, policy_version 417940 (0.0008) [2023-12-26 02:56:36,693][123091] Updated weights for policy 0, policy_version 420687 (0.0005) [2023-12-26 02:56:36,702][123090] Updated weights for policy 1, policy_version 417950 (0.0010) [2023-12-26 02:56:37,343][123091] Updated weights for policy 0, policy_version 420697 (0.0007) [2023-12-26 02:56:37,401][123091] Updated weights for policy 0, policy_version 420707 (0.0010) [2023-12-26 02:56:37,462][123091] Updated weights for policy 0, policy_version 420717 (0.0009) [2023-12-26 02:56:37,565][123090] Updated weights for policy 1, policy_version 417960 (0.0006) [2023-12-26 02:56:37,622][123090] Updated weights for policy 1, policy_version 417970 (0.0005) [2023-12-26 02:56:37,669][123090] Updated weights for policy 1, policy_version 417980 (0.0006) [2023-12-26 02:56:38,376][123090] Updated weights for policy 1, policy_version 417990 (0.0006) [2023-12-26 02:56:38,420][123091] Updated weights for policy 0, policy_version 420727 (0.0009) [2023-12-26 02:56:38,436][123090] Updated weights for policy 1, policy_version 418000 (0.0011) [2023-12-26 02:56:38,470][123091] Updated weights for policy 0, policy_version 420737 (0.0007) [2023-12-26 02:56:38,493][123090] Updated weights for policy 1, policy_version 418010 (0.0010) [2023-12-26 02:56:38,518][123091] Updated weights for policy 0, policy_version 420747 (0.0006) [2023-12-26 02:56:38,784][121949] Fps is (10 sec: 18840.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 214728704. Throughput: 0: 9019.6, 1: 8772.7. Samples: 214701196. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:38,786][121949] Avg episode reward: [(0, '5985.184'), (1, '5771.792')] [2023-12-26 02:56:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000420752_107716608.pth... [2023-12-26 02:56:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000418016_107012096.pth... [2023-12-26 02:56:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000416992_106749952.pth [2023-12-26 02:56:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000419696_107446272.pth [2023-12-26 02:56:39,254][123090] Updated weights for policy 1, policy_version 418020 (0.0010) [2023-12-26 02:56:39,312][123090] Updated weights for policy 1, policy_version 418030 (0.0005) [2023-12-26 02:56:39,389][123090] Updated weights for policy 1, policy_version 418040 (0.0008) [2023-12-26 02:56:39,428][123091] Updated weights for policy 0, policy_version 420757 (0.0009) [2023-12-26 02:56:39,484][123091] Updated weights for policy 0, policy_version 420767 (0.0008) [2023-12-26 02:56:39,533][123091] Updated weights for policy 0, policy_version 420777 (0.0009) [2023-12-26 02:56:40,199][123090] Updated weights for policy 1, policy_version 418050 (0.0010) [2023-12-26 02:56:40,260][123090] Updated weights for policy 1, policy_version 418060 (0.0006) [2023-12-26 02:56:40,332][123090] Updated weights for policy 1, policy_version 418070 (0.0006) [2023-12-26 02:56:40,401][123090] Updated weights for policy 1, policy_version 418080 (0.0006) [2023-12-26 02:56:40,458][123091] Updated weights for policy 0, policy_version 420787 (0.0009) [2023-12-26 02:56:40,519][123091] Updated weights for policy 0, policy_version 420797 (0.0009) [2023-12-26 02:56:40,584][123091] Updated weights for policy 0, policy_version 420807 (0.0009) [2023-12-26 02:56:41,194][123090] Updated weights for policy 1, policy_version 418090 (0.0011) [2023-12-26 02:56:41,254][123090] Updated weights for policy 1, policy_version 418100 (0.0010) [2023-12-26 02:56:41,322][123090] Updated weights for policy 1, policy_version 418110 (0.0011) [2023-12-26 02:56:41,444][123091] Updated weights for policy 0, policy_version 420817 (0.0009) [2023-12-26 02:56:41,498][123091] Updated weights for policy 0, policy_version 420827 (0.0009) [2023-12-26 02:56:41,552][123091] Updated weights for policy 0, policy_version 420837 (0.0010) [2023-12-26 02:56:41,607][123091] Updated weights for policy 0, policy_version 420847 (0.0009) [2023-12-26 02:56:42,119][123090] Updated weights for policy 1, policy_version 418120 (0.0009) [2023-12-26 02:56:42,176][123090] Updated weights for policy 1, policy_version 418130 (0.0009) [2023-12-26 02:56:42,232][123090] Updated weights for policy 1, policy_version 418140 (0.0010) [2023-12-26 02:56:42,460][123091] Updated weights for policy 0, policy_version 420857 (0.0011) [2023-12-26 02:56:42,527][123091] Updated weights for policy 0, policy_version 420867 (0.0011) [2023-12-26 02:56:42,585][123091] Updated weights for policy 0, policy_version 420877 (0.0009) [2023-12-26 02:56:43,062][123090] Updated weights for policy 1, policy_version 418150 (0.0010) [2023-12-26 02:56:43,110][123090] Updated weights for policy 1, policy_version 418160 (0.0009) [2023-12-26 02:56:43,172][123090] Updated weights for policy 1, policy_version 418170 (0.0010) [2023-12-26 02:56:43,361][123091] Updated weights for policy 0, policy_version 420887 (0.0007) [2023-12-26 02:56:43,430][123091] Updated weights for policy 0, policy_version 420897 (0.0006) [2023-12-26 02:56:43,476][123091] Updated weights for policy 0, policy_version 420907 (0.0005) [2023-12-26 02:56:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 214810624. Throughput: 0: 8926.9, 1: 8744.3. Samples: 214804396. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:43,785][121949] Avg episode reward: [(0, '5943.904'), (1, '5699.499')] [2023-12-26 02:56:44,042][123090] Updated weights for policy 1, policy_version 418180 (0.0010) [2023-12-26 02:56:44,113][123090] Updated weights for policy 1, policy_version 418190 (0.0009) [2023-12-26 02:56:44,177][123091] Updated weights for policy 0, policy_version 420917 (0.0006) [2023-12-26 02:56:44,186][123090] Updated weights for policy 1, policy_version 418200 (0.0009) [2023-12-26 02:56:44,236][123091] Updated weights for policy 0, policy_version 420927 (0.0006) [2023-12-26 02:56:44,296][123091] Updated weights for policy 0, policy_version 420937 (0.0010) [2023-12-26 02:56:45,006][123090] Updated weights for policy 1, policy_version 418210 (0.0008) [2023-12-26 02:56:45,075][123090] Updated weights for policy 1, policy_version 418220 (0.0009) [2023-12-26 02:56:45,100][123091] Updated weights for policy 0, policy_version 420947 (0.0010) [2023-12-26 02:56:45,138][123090] Updated weights for policy 1, policy_version 418230 (0.0008) [2023-12-26 02:56:45,167][123091] Updated weights for policy 0, policy_version 420957 (0.0008) [2023-12-26 02:56:45,200][123090] Updated weights for policy 1, policy_version 418240 (0.0010) [2023-12-26 02:56:45,235][123091] Updated weights for policy 0, policy_version 420967 (0.0005) [2023-12-26 02:56:45,887][123091] Updated weights for policy 0, policy_version 420977 (0.0007) [2023-12-26 02:56:45,945][123091] Updated weights for policy 0, policy_version 420987 (0.0007) [2023-12-26 02:56:45,952][123090] Updated weights for policy 1, policy_version 418250 (0.0008) [2023-12-26 02:56:45,994][123091] Updated weights for policy 0, policy_version 420997 (0.0010) [2023-12-26 02:56:46,017][123090] Updated weights for policy 1, policy_version 418260 (0.0008) [2023-12-26 02:56:46,054][123091] Updated weights for policy 0, policy_version 421007 (0.0007) [2023-12-26 02:56:46,073][123090] Updated weights for policy 1, policy_version 418270 (0.0010) [2023-12-26 02:56:46,816][123090] Updated weights for policy 1, policy_version 418280 (0.0007) [2023-12-26 02:56:46,874][123090] Updated weights for policy 1, policy_version 418290 (0.0006) [2023-12-26 02:56:46,903][123091] Updated weights for policy 0, policy_version 421017 (0.0009) [2023-12-26 02:56:46,933][123090] Updated weights for policy 1, policy_version 418300 (0.0006) [2023-12-26 02:56:46,960][123091] Updated weights for policy 0, policy_version 421027 (0.0009) [2023-12-26 02:56:47,014][123091] Updated weights for policy 0, policy_version 421037 (0.0010) [2023-12-26 02:56:47,591][123090] Updated weights for policy 1, policy_version 418310 (0.0007) [2023-12-26 02:56:47,642][123090] Updated weights for policy 1, policy_version 418320 (0.0009) [2023-12-26 02:56:47,690][123090] Updated weights for policy 1, policy_version 418330 (0.0008) [2023-12-26 02:56:47,857][123091] Updated weights for policy 0, policy_version 421047 (0.0010) [2023-12-26 02:56:47,919][123091] Updated weights for policy 0, policy_version 421057 (0.0010) [2023-12-26 02:56:47,985][123091] Updated weights for policy 0, policy_version 421067 (0.0010) [2023-12-26 02:56:48,561][123090] Updated weights for policy 1, policy_version 418340 (0.0009) [2023-12-26 02:56:48,617][123090] Updated weights for policy 1, policy_version 418350 (0.0009) [2023-12-26 02:56:48,684][123090] Updated weights for policy 1, policy_version 418360 (0.0009) [2023-12-26 02:56:48,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 214900736. Throughput: 0: 8913.2, 1: 8758.7. Samples: 214911908. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:48,784][121949] Avg episode reward: [(0, '6033.299'), (1, '5685.434')] [2023-12-26 02:56:48,789][123091] Updated weights for policy 0, policy_version 421077 (0.0009) [2023-12-26 02:56:48,863][123091] Updated weights for policy 0, policy_version 421087 (0.0006) [2023-12-26 02:56:48,939][123091] Updated weights for policy 0, policy_version 421097 (0.0008) [2023-12-26 02:56:49,576][123090] Updated weights for policy 1, policy_version 418370 (0.0009) [2023-12-26 02:56:49,633][123090] Updated weights for policy 1, policy_version 418380 (0.0009) [2023-12-26 02:56:49,662][123091] Updated weights for policy 0, policy_version 421107 (0.0008) [2023-12-26 02:56:49,687][123090] Updated weights for policy 1, policy_version 418390 (0.0008) [2023-12-26 02:56:49,719][123091] Updated weights for policy 0, policy_version 421117 (0.0008) [2023-12-26 02:56:49,748][123090] Updated weights for policy 1, policy_version 418400 (0.0007) [2023-12-26 02:56:49,779][123091] Updated weights for policy 0, policy_version 421127 (0.0009) [2023-12-26 02:56:50,608][123090] Updated weights for policy 1, policy_version 418410 (0.0009) [2023-12-26 02:56:50,624][123091] Updated weights for policy 0, policy_version 421137 (0.0009) [2023-12-26 02:56:50,666][123090] Updated weights for policy 1, policy_version 418420 (0.0008) [2023-12-26 02:56:50,681][123091] Updated weights for policy 0, policy_version 421147 (0.0009) [2023-12-26 02:56:50,733][123090] Updated weights for policy 1, policy_version 418430 (0.0007) [2023-12-26 02:56:50,739][123091] Updated weights for policy 0, policy_version 421157 (0.0009) [2023-12-26 02:56:50,804][123091] Updated weights for policy 0, policy_version 421167 (0.0009) [2023-12-26 02:56:51,572][123090] Updated weights for policy 1, policy_version 418440 (0.0009) [2023-12-26 02:56:51,629][123090] Updated weights for policy 1, policy_version 418450 (0.0010) [2023-12-26 02:56:51,671][123091] Updated weights for policy 0, policy_version 421177 (0.0011) [2023-12-26 02:56:51,695][123090] Updated weights for policy 1, policy_version 418460 (0.0008) [2023-12-26 02:56:51,736][123091] Updated weights for policy 0, policy_version 421187 (0.0010) [2023-12-26 02:56:51,796][123091] Updated weights for policy 0, policy_version 421197 (0.0011) [2023-12-26 02:56:52,546][123090] Updated weights for policy 1, policy_version 418470 (0.0010) [2023-12-26 02:56:52,620][123090] Updated weights for policy 1, policy_version 418480 (0.0011) [2023-12-26 02:56:52,624][123091] Updated weights for policy 0, policy_version 421207 (0.0009) [2023-12-26 02:56:52,680][123090] Updated weights for policy 1, policy_version 418490 (0.0010) [2023-12-26 02:56:52,687][123091] Updated weights for policy 0, policy_version 421217 (0.0008) [2023-12-26 02:56:52,746][123091] Updated weights for policy 0, policy_version 421227 (0.0008) [2023-12-26 02:56:53,454][123090] Updated weights for policy 1, policy_version 418500 (0.0008) [2023-12-26 02:56:53,501][123090] Updated weights for policy 1, policy_version 418510 (0.0005) [2023-12-26 02:56:53,552][123090] Updated weights for policy 1, policy_version 418520 (0.0008) [2023-12-26 02:56:53,554][123091] Updated weights for policy 0, policy_version 421237 (0.0006) [2023-12-26 02:56:53,618][123091] Updated weights for policy 0, policy_version 421247 (0.0006) [2023-12-26 02:56:53,692][123091] Updated weights for policy 0, policy_version 421257 (0.0009) [2023-12-26 02:56:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 214990848. Throughput: 0: 8877.8, 1: 8745.1. Samples: 214962444. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:53,785][121949] Avg episode reward: [(0, '6125.069'), (1, '5705.718')] [2023-12-26 02:56:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000421264_107847680.pth... [2023-12-26 02:56:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000418528_107143168.pth... [2023-12-26 02:56:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000420208_107577344.pth [2023-12-26 02:56:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000417504_106881024.pth [2023-12-26 02:56:54,325][123090] Updated weights for policy 1, policy_version 418530 (0.0010) [2023-12-26 02:56:54,380][123090] Updated weights for policy 1, policy_version 418541 (0.0009) [2023-12-26 02:56:54,428][123090] Updated weights for policy 1, policy_version 418551 (0.0009) [2023-12-26 02:56:54,520][123091] Updated weights for policy 0, policy_version 421267 (0.0009) [2023-12-26 02:56:54,579][123091] Updated weights for policy 0, policy_version 421277 (0.0009) [2023-12-26 02:56:54,641][123091] Updated weights for policy 0, policy_version 421287 (0.0008) [2023-12-26 02:56:55,245][123090] Updated weights for policy 1, policy_version 418561 (0.0008) [2023-12-26 02:56:55,298][123090] Updated weights for policy 1, policy_version 418571 (0.0008) [2023-12-26 02:56:55,364][123090] Updated weights for policy 1, policy_version 418581 (0.0009) [2023-12-26 02:56:55,431][123090] Updated weights for policy 1, policy_version 418591 (0.0006) [2023-12-26 02:56:55,509][123091] Updated weights for policy 0, policy_version 421297 (0.0006) [2023-12-26 02:56:55,574][123091] Updated weights for policy 0, policy_version 421307 (0.0009) [2023-12-26 02:56:55,636][123091] Updated weights for policy 0, policy_version 421317 (0.0008) [2023-12-26 02:56:55,703][123091] Updated weights for policy 0, policy_version 421327 (0.0009) [2023-12-26 02:56:56,221][123090] Updated weights for policy 1, policy_version 418601 (0.0009) [2023-12-26 02:56:56,279][123090] Updated weights for policy 1, policy_version 418611 (0.0006) [2023-12-26 02:56:56,331][123090] Updated weights for policy 1, policy_version 418621 (0.0005) [2023-12-26 02:56:56,537][123091] Updated weights for policy 0, policy_version 421337 (0.0007) [2023-12-26 02:56:56,618][123091] Updated weights for policy 0, policy_version 421347 (0.0011) [2023-12-26 02:56:56,698][123091] Updated weights for policy 0, policy_version 421357 (0.0011) [2023-12-26 02:56:57,001][123090] Updated weights for policy 1, policy_version 418631 (0.0008) [2023-12-26 02:56:57,059][123090] Updated weights for policy 1, policy_version 418641 (0.0010) [2023-12-26 02:56:57,116][123090] Updated weights for policy 1, policy_version 418651 (0.0010) [2023-12-26 02:56:57,340][123091] Updated weights for policy 0, policy_version 421367 (0.0009) [2023-12-26 02:56:57,394][123091] Updated weights for policy 0, policy_version 421377 (0.0010) [2023-12-26 02:56:57,447][123091] Updated weights for policy 0, policy_version 421387 (0.0010) [2023-12-26 02:56:57,996][123090] Updated weights for policy 1, policy_version 418662 (0.0010) [2023-12-26 02:56:58,059][123090] Updated weights for policy 1, policy_version 418672 (0.0009) [2023-12-26 02:56:58,115][123090] Updated weights for policy 1, policy_version 418682 (0.0008) [2023-12-26 02:56:58,241][123091] Updated weights for policy 0, policy_version 421397 (0.0010) [2023-12-26 02:56:58,305][123091] Updated weights for policy 0, policy_version 421407 (0.0010) [2023-12-26 02:56:58,368][123091] Updated weights for policy 0, policy_version 421417 (0.0010) [2023-12-26 02:56:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 215072768. Throughput: 0: 8924.5, 1: 8811.9. Samples: 215068140. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:56:58,785][121949] Avg episode reward: [(0, '6024.257'), (1, '5707.828')] [2023-12-26 02:56:58,989][123090] Updated weights for policy 1, policy_version 418692 (0.0008) [2023-12-26 02:56:59,055][123090] Updated weights for policy 1, policy_version 418702 (0.0009) [2023-12-26 02:56:59,121][123090] Updated weights for policy 1, policy_version 418712 (0.0009) [2023-12-26 02:56:59,248][123091] Updated weights for policy 0, policy_version 421427 (0.0008) [2023-12-26 02:56:59,303][123091] Updated weights for policy 0, policy_version 421437 (0.0009) [2023-12-26 02:56:59,377][123091] Updated weights for policy 0, policy_version 421447 (0.0014) [2023-12-26 02:56:59,971][123090] Updated weights for policy 1, policy_version 418722 (0.0009) [2023-12-26 02:57:00,033][123090] Updated weights for policy 1, policy_version 418732 (0.0009) [2023-12-26 02:57:00,090][123090] Updated weights for policy 1, policy_version 418742 (0.0009) [2023-12-26 02:57:00,139][123090] Updated weights for policy 1, policy_version 418752 (0.0009) [2023-12-26 02:57:00,237][123091] Updated weights for policy 0, policy_version 421457 (0.0011) [2023-12-26 02:57:00,305][123091] Updated weights for policy 0, policy_version 421467 (0.0009) [2023-12-26 02:57:00,377][123091] Updated weights for policy 0, policy_version 421477 (0.0006) [2023-12-26 02:57:00,451][123091] Updated weights for policy 0, policy_version 421487 (0.0006) [2023-12-26 02:57:00,877][123090] Updated weights for policy 1, policy_version 418762 (0.0005) [2023-12-26 02:57:00,942][123090] Updated weights for policy 1, policy_version 418772 (0.0005) [2023-12-26 02:57:00,996][123090] Updated weights for policy 1, policy_version 418782 (0.0005) [2023-12-26 02:57:01,121][123091] Updated weights for policy 0, policy_version 421497 (0.0008) [2023-12-26 02:57:01,195][123091] Updated weights for policy 0, policy_version 421507 (0.0009) [2023-12-26 02:57:01,264][123091] Updated weights for policy 0, policy_version 421517 (0.0009) [2023-12-26 02:57:01,751][123090] Updated weights for policy 1, policy_version 418792 (0.0009) [2023-12-26 02:57:01,804][123090] Updated weights for policy 1, policy_version 418802 (0.0010) [2023-12-26 02:57:01,871][123090] Updated weights for policy 1, policy_version 418812 (0.0010) [2023-12-26 02:57:02,014][123091] Updated weights for policy 0, policy_version 421527 (0.0007) [2023-12-26 02:57:02,066][123091] Updated weights for policy 0, policy_version 421537 (0.0010) [2023-12-26 02:57:02,110][123091] Updated weights for policy 0, policy_version 421547 (0.0010) [2023-12-26 02:57:02,693][123090] Updated weights for policy 1, policy_version 418822 (0.0007) [2023-12-26 02:57:02,747][123090] Updated weights for policy 1, policy_version 418832 (0.0009) [2023-12-26 02:57:02,796][123090] Updated weights for policy 1, policy_version 418843 (0.0009) [2023-12-26 02:57:02,960][123091] Updated weights for policy 0, policy_version 421557 (0.0010) [2023-12-26 02:57:03,026][123091] Updated weights for policy 0, policy_version 421567 (0.0009) [2023-12-26 02:57:03,091][123091] Updated weights for policy 0, policy_version 421577 (0.0008) [2023-12-26 02:57:03,537][123090] Updated weights for policy 1, policy_version 418853 (0.0006) [2023-12-26 02:57:03,612][123090] Updated weights for policy 1, policy_version 418863 (0.0005) [2023-12-26 02:57:03,684][123090] Updated weights for policy 1, policy_version 418873 (0.0006) [2023-12-26 02:57:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 215162880. Throughput: 0: 8834.2, 1: 8843.4. Samples: 215174040. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:57:03,785][121949] Avg episode reward: [(0, '6119.913'), (1, '5693.942')] [2023-12-26 02:57:03,919][123091] Updated weights for policy 0, policy_version 421587 (0.0009) [2023-12-26 02:57:03,981][123091] Updated weights for policy 0, policy_version 421597 (0.0008) [2023-12-26 02:57:04,050][123091] Updated weights for policy 0, policy_version 421607 (0.0008) [2023-12-26 02:57:04,367][123090] Updated weights for policy 1, policy_version 418883 (0.0007) [2023-12-26 02:57:04,433][123090] Updated weights for policy 1, policy_version 418893 (0.0009) [2023-12-26 02:57:04,506][123090] Updated weights for policy 1, policy_version 418903 (0.0009) [2023-12-26 02:57:04,817][123091] Updated weights for policy 0, policy_version 421617 (0.0008) [2023-12-26 02:57:04,876][123091] Updated weights for policy 0, policy_version 421627 (0.0009) [2023-12-26 02:57:04,932][123091] Updated weights for policy 0, policy_version 421637 (0.0010) [2023-12-26 02:57:04,979][123091] Updated weights for policy 0, policy_version 421647 (0.0010) [2023-12-26 02:57:05,365][123090] Updated weights for policy 1, policy_version 418913 (0.0010) [2023-12-26 02:57:05,430][123090] Updated weights for policy 1, policy_version 418923 (0.0010) [2023-12-26 02:57:05,488][123090] Updated weights for policy 1, policy_version 418933 (0.0010) [2023-12-26 02:57:05,542][123090] Updated weights for policy 1, policy_version 418943 (0.0011) [2023-12-26 02:57:05,705][123091] Updated weights for policy 0, policy_version 421657 (0.0010) [2023-12-26 02:57:05,803][123091] Updated weights for policy 0, policy_version 421667 (0.0009) [2023-12-26 02:57:05,867][123091] Updated weights for policy 0, policy_version 421677 (0.0010) [2023-12-26 02:57:06,344][123090] Updated weights for policy 1, policy_version 418953 (0.0006) [2023-12-26 02:57:06,419][123090] Updated weights for policy 1, policy_version 418963 (0.0005) [2023-12-26 02:57:06,483][123090] Updated weights for policy 1, policy_version 418973 (0.0006) [2023-12-26 02:57:06,675][123091] Updated weights for policy 0, policy_version 421687 (0.0010) [2023-12-26 02:57:06,746][123091] Updated weights for policy 0, policy_version 421697 (0.0010) [2023-12-26 02:57:06,811][123091] Updated weights for policy 0, policy_version 421707 (0.0010) [2023-12-26 02:57:07,146][123090] Updated weights for policy 1, policy_version 418983 (0.0005) [2023-12-26 02:57:07,216][123090] Updated weights for policy 1, policy_version 418993 (0.0008) [2023-12-26 02:57:07,269][123090] Updated weights for policy 1, policy_version 419003 (0.0007) [2023-12-26 02:57:07,639][123091] Updated weights for policy 0, policy_version 421717 (0.0007) [2023-12-26 02:57:07,693][123091] Updated weights for policy 0, policy_version 421727 (0.0007) [2023-12-26 02:57:07,750][123091] Updated weights for policy 0, policy_version 421737 (0.0009) [2023-12-26 02:57:07,945][123090] Updated weights for policy 1, policy_version 419013 (0.0007) [2023-12-26 02:57:07,998][123090] Updated weights for policy 1, policy_version 419023 (0.0009) [2023-12-26 02:57:08,059][123090] Updated weights for policy 1, policy_version 419033 (0.0009) [2023-12-26 02:57:08,575][123091] Updated weights for policy 0, policy_version 421747 (0.0010) [2023-12-26 02:57:08,628][123091] Updated weights for policy 0, policy_version 421757 (0.0009) [2023-12-26 02:57:08,687][123091] Updated weights for policy 0, policy_version 421767 (0.0006) [2023-12-26 02:57:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 215252992. Throughput: 0: 8899.9, 1: 8879.0. Samples: 215228300. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:57:08,785][121949] Avg episode reward: [(0, '6068.766'), (1, '5853.004')] [2023-12-26 02:57:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000421776_107978752.pth... [2023-12-26 02:57:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000419040_107274240.pth... [2023-12-26 02:57:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000420752_107716608.pth [2023-12-26 02:57:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000418016_107012096.pth [2023-12-26 02:57:08,832][123090] Updated weights for policy 1, policy_version 419043 (0.0009) [2023-12-26 02:57:08,901][123090] Updated weights for policy 1, policy_version 419053 (0.0010) [2023-12-26 02:57:08,969][123090] Updated weights for policy 1, policy_version 419063 (0.0010) [2023-12-26 02:57:09,303][123091] Updated weights for policy 0, policy_version 421777 (0.0006) [2023-12-26 02:57:09,370][123091] Updated weights for policy 0, policy_version 421787 (0.0008) [2023-12-26 02:57:09,437][123091] Updated weights for policy 0, policy_version 421797 (0.0016) [2023-12-26 02:57:09,506][123091] Updated weights for policy 0, policy_version 421807 (0.0011) [2023-12-26 02:57:09,872][123090] Updated weights for policy 1, policy_version 419073 (0.0010) [2023-12-26 02:57:09,940][123090] Updated weights for policy 1, policy_version 419083 (0.0008) [2023-12-26 02:57:10,007][123090] Updated weights for policy 1, policy_version 419093 (0.0009) [2023-12-26 02:57:10,074][123090] Updated weights for policy 1, policy_version 419103 (0.0008) [2023-12-26 02:57:10,324][123091] Updated weights for policy 0, policy_version 421817 (0.0010) [2023-12-26 02:57:10,383][123091] Updated weights for policy 0, policy_version 421827 (0.0011) [2023-12-26 02:57:10,442][123091] Updated weights for policy 0, policy_version 421837 (0.0011) [2023-12-26 02:57:10,864][123090] Updated weights for policy 1, policy_version 419113 (0.0009) [2023-12-26 02:57:10,934][123090] Updated weights for policy 1, policy_version 419123 (0.0009) [2023-12-26 02:57:10,999][123090] Updated weights for policy 1, policy_version 419133 (0.0009) [2023-12-26 02:57:11,302][123091] Updated weights for policy 0, policy_version 421847 (0.0011) [2023-12-26 02:57:11,374][123091] Updated weights for policy 0, policy_version 421857 (0.0011) [2023-12-26 02:57:11,447][123091] Updated weights for policy 0, policy_version 421867 (0.0010) [2023-12-26 02:57:11,877][123090] Updated weights for policy 1, policy_version 419143 (0.0008) [2023-12-26 02:57:11,950][123090] Updated weights for policy 1, policy_version 419153 (0.0006) [2023-12-26 02:57:12,027][123090] Updated weights for policy 1, policy_version 419163 (0.0006) [2023-12-26 02:57:12,295][123091] Updated weights for policy 0, policy_version 421877 (0.0008) [2023-12-26 02:57:12,372][123091] Updated weights for policy 0, policy_version 421889 (0.0007) [2023-12-26 02:57:12,434][123091] Updated weights for policy 0, policy_version 421899 (0.0006) [2023-12-26 02:57:12,703][123090] Updated weights for policy 1, policy_version 419173 (0.0007) [2023-12-26 02:57:12,758][123090] Updated weights for policy 1, policy_version 419183 (0.0008) [2023-12-26 02:57:12,825][123090] Updated weights for policy 1, policy_version 419193 (0.0009) [2023-12-26 02:57:13,177][123091] Updated weights for policy 0, policy_version 421909 (0.0005) [2023-12-26 02:57:13,222][123091] Updated weights for policy 0, policy_version 421919 (0.0005) [2023-12-26 02:57:13,287][123091] Updated weights for policy 0, policy_version 421929 (0.0007) [2023-12-26 02:57:13,609][123090] Updated weights for policy 1, policy_version 419203 (0.0008) [2023-12-26 02:57:13,668][123090] Updated weights for policy 1, policy_version 419213 (0.0005) [2023-12-26 02:57:13,728][123090] Updated weights for policy 1, policy_version 419223 (0.0005) [2023-12-26 02:57:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 215343104. Throughput: 0: 8806.5, 1: 8879.2. Samples: 215332476. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:57:13,785][121949] Avg episode reward: [(0, '6039.833'), (1, '5935.615')] [2023-12-26 02:57:14,043][123091] Updated weights for policy 0, policy_version 421939 (0.0007) [2023-12-26 02:57:14,091][123091] Updated weights for policy 0, policy_version 421949 (0.0005) [2023-12-26 02:57:14,143][123091] Updated weights for policy 0, policy_version 421959 (0.0005) [2023-12-26 02:57:14,454][123090] Updated weights for policy 1, policy_version 419233 (0.0005) [2023-12-26 02:57:14,513][123090] Updated weights for policy 1, policy_version 419243 (0.0005) [2023-12-26 02:57:14,566][123090] Updated weights for policy 1, policy_version 419253 (0.0005) [2023-12-26 02:57:14,622][123090] Updated weights for policy 1, policy_version 419263 (0.0005) [2023-12-26 02:57:14,914][123091] Updated weights for policy 0, policy_version 421969 (0.0006) [2023-12-26 02:57:14,970][123091] Updated weights for policy 0, policy_version 421979 (0.0009) [2023-12-26 02:57:15,026][123091] Updated weights for policy 0, policy_version 421989 (0.0009) [2023-12-26 02:57:15,086][123091] Updated weights for policy 0, policy_version 421999 (0.0009) [2023-12-26 02:57:15,384][123090] Updated weights for policy 1, policy_version 419273 (0.0010) [2023-12-26 02:57:15,440][123090] Updated weights for policy 1, policy_version 419283 (0.0010) [2023-12-26 02:57:15,488][123090] Updated weights for policy 1, policy_version 419293 (0.0010) [2023-12-26 02:57:15,966][123091] Updated weights for policy 0, policy_version 422009 (0.0008) [2023-12-26 02:57:16,014][123091] Updated weights for policy 0, policy_version 422019 (0.0009) [2023-12-26 02:57:16,067][123091] Updated weights for policy 0, policy_version 422030 (0.0010) [2023-12-26 02:57:16,255][123090] Updated weights for policy 1, policy_version 419303 (0.0007) [2023-12-26 02:57:16,324][123090] Updated weights for policy 1, policy_version 419313 (0.0007) [2023-12-26 02:57:16,379][123090] Updated weights for policy 1, policy_version 419323 (0.0009) [2023-12-26 02:57:16,924][123091] Updated weights for policy 0, policy_version 422040 (0.0010) [2023-12-26 02:57:16,983][123091] Updated weights for policy 0, policy_version 422050 (0.0011) [2023-12-26 02:57:17,031][123091] Updated weights for policy 0, policy_version 422060 (0.0010) [2023-12-26 02:57:17,110][123090] Updated weights for policy 1, policy_version 419333 (0.0007) [2023-12-26 02:57:17,159][123090] Updated weights for policy 1, policy_version 419343 (0.0006) [2023-12-26 02:57:17,227][123090] Updated weights for policy 1, policy_version 419353 (0.0008) [2023-12-26 02:57:17,732][123091] Updated weights for policy 0, policy_version 422070 (0.0008) [2023-12-26 02:57:17,788][123091] Updated weights for policy 0, policy_version 422080 (0.0008) [2023-12-26 02:57:17,844][123091] Updated weights for policy 0, policy_version 422090 (0.0005) [2023-12-26 02:57:18,020][123090] Updated weights for policy 1, policy_version 419363 (0.0009) [2023-12-26 02:57:18,081][123090] Updated weights for policy 1, policy_version 419373 (0.0009) [2023-12-26 02:57:18,146][123090] Updated weights for policy 1, policy_version 419383 (0.0007) [2023-12-26 02:57:18,564][123091] Updated weights for policy 0, policy_version 422100 (0.0005) [2023-12-26 02:57:18,632][123091] Updated weights for policy 0, policy_version 422110 (0.0005) [2023-12-26 02:57:18,687][123091] Updated weights for policy 0, policy_version 422120 (0.0005) [2023-12-26 02:57:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 215433216. Throughput: 0: 8809.4, 1: 8893.3. Samples: 215443164. Policy #0 lag: (min: 31.0, avg: 36.8, max: 63.0) [2023-12-26 02:57:18,785][121949] Avg episode reward: [(0, '6067.364'), (1, '5873.558')] [2023-12-26 02:57:18,901][123090] Updated weights for policy 1, policy_version 419393 (0.0006) [2023-12-26 02:57:18,959][123090] Updated weights for policy 1, policy_version 419403 (0.0006) [2023-12-26 02:57:19,018][123090] Updated weights for policy 1, policy_version 419413 (0.0005) [2023-12-26 02:57:19,082][123090] Updated weights for policy 1, policy_version 419423 (0.0005) [2023-12-26 02:57:19,526][123091] Updated weights for policy 0, policy_version 422130 (0.0009) [2023-12-26 02:57:19,587][123091] Updated weights for policy 0, policy_version 422140 (0.0009) [2023-12-26 02:57:19,658][123091] Updated weights for policy 0, policy_version 422150 (0.0009) [2023-12-26 02:57:19,720][123091] Updated weights for policy 0, policy_version 422160 (0.0010) [2023-12-26 02:57:19,863][123090] Updated weights for policy 1, policy_version 419433 (0.0009) [2023-12-26 02:57:19,932][123090] Updated weights for policy 1, policy_version 419443 (0.0010) [2023-12-26 02:57:19,997][123090] Updated weights for policy 1, policy_version 419453 (0.0010) [2023-12-26 02:57:20,592][123091] Updated weights for policy 0, policy_version 422170 (0.0009) [2023-12-26 02:57:20,658][123091] Updated weights for policy 0, policy_version 422180 (0.0009) [2023-12-26 02:57:20,719][123091] Updated weights for policy 0, policy_version 422190 (0.0009) [2023-12-26 02:57:20,829][123090] Updated weights for policy 1, policy_version 419463 (0.0009) [2023-12-26 02:57:20,900][123090] Updated weights for policy 1, policy_version 419473 (0.0010) [2023-12-26 02:57:20,971][123090] Updated weights for policy 1, policy_version 419483 (0.0009) [2023-12-26 02:57:21,631][123091] Updated weights for policy 0, policy_version 422200 (0.0009) [2023-12-26 02:57:21,700][123091] Updated weights for policy 0, policy_version 422210 (0.0010) [2023-12-26 02:57:21,775][123091] Updated weights for policy 0, policy_version 422220 (0.0009) [2023-12-26 02:57:21,804][123090] Updated weights for policy 1, policy_version 419493 (0.0009) [2023-12-26 02:57:21,870][123090] Updated weights for policy 1, policy_version 419503 (0.0008) [2023-12-26 02:57:21,940][123090] Updated weights for policy 1, policy_version 419513 (0.0008) [2023-12-26 02:57:22,634][123091] Updated weights for policy 0, policy_version 422230 (0.0010) [2023-12-26 02:57:22,702][123091] Updated weights for policy 0, policy_version 422240 (0.0011) [2023-12-26 02:57:22,733][123090] Updated weights for policy 1, policy_version 419523 (0.0008) [2023-12-26 02:57:22,768][123091] Updated weights for policy 0, policy_version 422250 (0.0008) [2023-12-26 02:57:22,799][123090] Updated weights for policy 1, policy_version 419533 (0.0008) [2023-12-26 02:57:22,862][123090] Updated weights for policy 1, policy_version 419543 (0.0009) [2023-12-26 02:57:23,573][123091] Updated weights for policy 0, policy_version 422260 (0.0009) [2023-12-26 02:57:23,647][123091] Updated weights for policy 0, policy_version 422270 (0.0010) [2023-12-26 02:57:23,665][123090] Updated weights for policy 1, policy_version 419553 (0.0010) [2023-12-26 02:57:23,717][123091] Updated weights for policy 0, policy_version 422280 (0.0010) [2023-12-26 02:57:23,722][123090] Updated weights for policy 1, policy_version 419563 (0.0005) [2023-12-26 02:57:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.5, 300 sec: 17717.0). Total num frames: 215515136. Throughput: 0: 8719.5, 1: 8888.4. Samples: 215493540. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:23,784][121949] Avg episode reward: [(0, '6100.438'), (1, '5879.821')] [2023-12-26 02:57:23,787][123090] Updated weights for policy 1, policy_version 419573 (0.0008) [2023-12-26 02:57:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000422288_108109824.pth... [2023-12-26 02:57:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000421264_107847680.pth [2023-12-26 02:57:23,852][123090] Updated weights for policy 1, policy_version 419583 (0.0010) [2023-12-26 02:57:23,857][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000419584_107413504.pth... [2023-12-26 02:57:23,860][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000418528_107143168.pth [2023-12-26 02:57:24,535][123091] Updated weights for policy 0, policy_version 422290 (0.0008) [2023-12-26 02:57:24,598][123091] Updated weights for policy 0, policy_version 422300 (0.0009) [2023-12-26 02:57:24,618][123090] Updated weights for policy 1, policy_version 419593 (0.0008) [2023-12-26 02:57:24,673][123091] Updated weights for policy 0, policy_version 422310 (0.0009) [2023-12-26 02:57:24,678][123090] Updated weights for policy 1, policy_version 419603 (0.0005) [2023-12-26 02:57:24,736][123091] Updated weights for policy 0, policy_version 422320 (0.0008) [2023-12-26 02:57:24,739][123090] Updated weights for policy 1, policy_version 419613 (0.0008) [2023-12-26 02:57:25,536][123091] Updated weights for policy 0, policy_version 422330 (0.0010) [2023-12-26 02:57:25,577][123090] Updated weights for policy 1, policy_version 419623 (0.0010) [2023-12-26 02:57:25,595][123091] Updated weights for policy 0, policy_version 422340 (0.0008) [2023-12-26 02:57:25,626][123090] Updated weights for policy 1, policy_version 419633 (0.0007) [2023-12-26 02:57:25,650][123091] Updated weights for policy 0, policy_version 422350 (0.0008) [2023-12-26 02:57:25,683][123090] Updated weights for policy 1, policy_version 419643 (0.0008) [2023-12-26 02:57:26,494][123091] Updated weights for policy 0, policy_version 422360 (0.0009) [2023-12-26 02:57:26,505][123090] Updated weights for policy 1, policy_version 419653 (0.0008) [2023-12-26 02:57:26,551][123091] Updated weights for policy 0, policy_version 422370 (0.0008) [2023-12-26 02:57:26,554][123090] Updated weights for policy 1, policy_version 419663 (0.0008) [2023-12-26 02:57:26,601][123090] Updated weights for policy 1, policy_version 419673 (0.0009) [2023-12-26 02:57:26,602][123091] Updated weights for policy 0, policy_version 422380 (0.0008) [2023-12-26 02:57:27,446][123091] Updated weights for policy 0, policy_version 422390 (0.0007) [2023-12-26 02:57:27,496][123091] Updated weights for policy 0, policy_version 422400 (0.0006) [2023-12-26 02:57:27,506][123090] Updated weights for policy 1, policy_version 419683 (0.0008) [2023-12-26 02:57:27,539][123091] Updated weights for policy 0, policy_version 422410 (0.0005) [2023-12-26 02:57:27,566][123090] Updated weights for policy 1, policy_version 419693 (0.0009) [2023-12-26 02:57:27,631][123090] Updated weights for policy 1, policy_version 419703 (0.0006) [2023-12-26 02:57:28,236][123091] Updated weights for policy 0, policy_version 422420 (0.0006) [2023-12-26 02:57:28,275][123090] Updated weights for policy 1, policy_version 419713 (0.0005) [2023-12-26 02:57:28,287][123091] Updated weights for policy 0, policy_version 422430 (0.0006) [2023-12-26 02:57:28,331][123090] Updated weights for policy 1, policy_version 419723 (0.0006) [2023-12-26 02:57:28,350][123091] Updated weights for policy 0, policy_version 422440 (0.0007) [2023-12-26 02:57:28,393][123090] Updated weights for policy 1, policy_version 419733 (0.0008) [2023-12-26 02:57:28,451][123090] Updated weights for policy 1, policy_version 419743 (0.0008) [2023-12-26 02:57:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 215605248. Throughput: 0: 8753.9, 1: 8843.5. Samples: 215596276. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:28,785][121949] Avg episode reward: [(0, '6160.500'), (1, '5888.982')] [2023-12-26 02:57:29,078][123091] Updated weights for policy 0, policy_version 422450 (0.0008) [2023-12-26 02:57:29,132][123091] Updated weights for policy 0, policy_version 422460 (0.0005) [2023-12-26 02:57:29,183][123091] Updated weights for policy 0, policy_version 422470 (0.0005) [2023-12-26 02:57:29,246][123091] Updated weights for policy 0, policy_version 422480 (0.0007) [2023-12-26 02:57:29,282][123090] Updated weights for policy 1, policy_version 419753 (0.0009) [2023-12-26 02:57:29,344][123090] Updated weights for policy 1, policy_version 419763 (0.0010) [2023-12-26 02:57:29,410][123090] Updated weights for policy 1, policy_version 419773 (0.0013) [2023-12-26 02:57:30,000][123091] Updated weights for policy 0, policy_version 422490 (0.0010) [2023-12-26 02:57:30,064][123091] Updated weights for policy 0, policy_version 422500 (0.0006) [2023-12-26 02:57:30,126][123091] Updated weights for policy 0, policy_version 422510 (0.0005) [2023-12-26 02:57:30,181][123090] Updated weights for policy 1, policy_version 419783 (0.0009) [2023-12-26 02:57:30,244][123090] Updated weights for policy 1, policy_version 419793 (0.0008) [2023-12-26 02:57:30,299][123090] Updated weights for policy 1, policy_version 419803 (0.0008) [2023-12-26 02:57:30,824][123091] Updated weights for policy 0, policy_version 422520 (0.0009) [2023-12-26 02:57:30,879][123091] Updated weights for policy 0, policy_version 422530 (0.0010) [2023-12-26 02:57:30,934][123091] Updated weights for policy 0, policy_version 422540 (0.0010) [2023-12-26 02:57:30,993][123090] Updated weights for policy 1, policy_version 419813 (0.0005) [2023-12-26 02:57:31,063][123090] Updated weights for policy 1, policy_version 419823 (0.0007) [2023-12-26 02:57:31,131][123090] Updated weights for policy 1, policy_version 419833 (0.0008) [2023-12-26 02:57:31,821][123091] Updated weights for policy 0, policy_version 422550 (0.0009) [2023-12-26 02:57:31,873][123090] Updated weights for policy 1, policy_version 419843 (0.0009) [2023-12-26 02:57:31,887][123091] Updated weights for policy 0, policy_version 422560 (0.0008) [2023-12-26 02:57:31,938][123090] Updated weights for policy 1, policy_version 419853 (0.0008) [2023-12-26 02:57:31,949][123091] Updated weights for policy 0, policy_version 422570 (0.0006) [2023-12-26 02:57:31,986][123090] Updated weights for policy 1, policy_version 419863 (0.0010) [2023-12-26 02:57:32,677][123091] Updated weights for policy 0, policy_version 422580 (0.0007) [2023-12-26 02:57:32,743][123091] Updated weights for policy 0, policy_version 422590 (0.0006) [2023-12-26 02:57:32,800][123090] Updated weights for policy 1, policy_version 419873 (0.0010) [2023-12-26 02:57:32,811][123091] Updated weights for policy 0, policy_version 422600 (0.0007) [2023-12-26 02:57:32,862][123090] Updated weights for policy 1, policy_version 419883 (0.0008) [2023-12-26 02:57:32,930][123090] Updated weights for policy 1, policy_version 419893 (0.0005) [2023-12-26 02:57:33,005][123090] Updated weights for policy 1, policy_version 419903 (0.0005) [2023-12-26 02:57:33,430][123091] Updated weights for policy 0, policy_version 422610 (0.0006) [2023-12-26 02:57:33,483][123091] Updated weights for policy 0, policy_version 422620 (0.0006) [2023-12-26 02:57:33,528][123091] Updated weights for policy 0, policy_version 422630 (0.0006) [2023-12-26 02:57:33,575][123091] Updated weights for policy 0, policy_version 422640 (0.0005) [2023-12-26 02:57:33,757][123090] Updated weights for policy 1, policy_version 419913 (0.0010) [2023-12-26 02:57:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 215695360. Throughput: 0: 8805.2, 1: 8890.6. Samples: 215708220. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:33,785][121949] Avg episode reward: [(0, '6048.122'), (1, '5884.276')] [2023-12-26 02:57:33,815][123090] Updated weights for policy 1, policy_version 419923 (0.0010) [2023-12-26 02:57:33,876][123090] Updated weights for policy 1, policy_version 419933 (0.0010) [2023-12-26 02:57:34,291][123091] Updated weights for policy 0, policy_version 422650 (0.0011) [2023-12-26 02:57:34,348][123091] Updated weights for policy 0, policy_version 422660 (0.0010) [2023-12-26 02:57:34,407][123091] Updated weights for policy 0, policy_version 422670 (0.0007) [2023-12-26 02:57:34,669][123090] Updated weights for policy 1, policy_version 419943 (0.0007) [2023-12-26 02:57:34,738][123090] Updated weights for policy 1, policy_version 419953 (0.0010) [2023-12-26 02:57:34,797][123090] Updated weights for policy 1, policy_version 419963 (0.0010) [2023-12-26 02:57:35,187][123091] Updated weights for policy 0, policy_version 422680 (0.0010) [2023-12-26 02:57:35,249][123091] Updated weights for policy 0, policy_version 422690 (0.0008) [2023-12-26 02:57:35,311][123091] Updated weights for policy 0, policy_version 422700 (0.0005) [2023-12-26 02:57:35,574][123090] Updated weights for policy 1, policy_version 419973 (0.0010) [2023-12-26 02:57:35,637][123090] Updated weights for policy 1, policy_version 419983 (0.0010) [2023-12-26 02:57:35,708][123090] Updated weights for policy 1, policy_version 419993 (0.0010) [2023-12-26 02:57:35,970][123091] Updated weights for policy 0, policy_version 422710 (0.0009) [2023-12-26 02:57:36,032][123091] Updated weights for policy 0, policy_version 422720 (0.0011) [2023-12-26 02:57:36,093][123091] Updated weights for policy 0, policy_version 422730 (0.0011) [2023-12-26 02:57:36,517][123090] Updated weights for policy 1, policy_version 420003 (0.0010) [2023-12-26 02:57:36,581][123090] Updated weights for policy 1, policy_version 420013 (0.0006) [2023-12-26 02:57:36,655][123090] Updated weights for policy 1, policy_version 420023 (0.0006) [2023-12-26 02:57:36,932][123091] Updated weights for policy 0, policy_version 422740 (0.0010) [2023-12-26 02:57:36,992][123091] Updated weights for policy 0, policy_version 422750 (0.0011) [2023-12-26 02:57:37,063][123091] Updated weights for policy 0, policy_version 422760 (0.0011) [2023-12-26 02:57:37,324][123090] Updated weights for policy 1, policy_version 420033 (0.0006) [2023-12-26 02:57:37,374][123090] Updated weights for policy 1, policy_version 420043 (0.0006) [2023-12-26 02:57:37,436][123090] Updated weights for policy 1, policy_version 420053 (0.0007) [2023-12-26 02:57:37,499][123090] Updated weights for policy 1, policy_version 420063 (0.0006) [2023-12-26 02:57:37,890][123091] Updated weights for policy 0, policy_version 422770 (0.0011) [2023-12-26 02:57:37,946][123091] Updated weights for policy 0, policy_version 422780 (0.0007) [2023-12-26 02:57:38,027][123091] Updated weights for policy 0, policy_version 422790 (0.0005) [2023-12-26 02:57:38,099][123091] Updated weights for policy 0, policy_version 422800 (0.0006) [2023-12-26 02:57:38,152][123090] Updated weights for policy 1, policy_version 420073 (0.0005) [2023-12-26 02:57:38,202][123090] Updated weights for policy 1, policy_version 420083 (0.0006) [2023-12-26 02:57:38,254][123090] Updated weights for policy 1, policy_version 420093 (0.0010) [2023-12-26 02:57:38,769][123091] Updated weights for policy 0, policy_version 422810 (0.0010) [2023-12-26 02:57:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 215785472. Throughput: 0: 8849.4, 1: 8928.3. Samples: 215762436. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:38,785][121949] Avg episode reward: [(0, '6128.439'), (1, '5803.819')] [2023-12-26 02:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000420096_107544576.pth... [2023-12-26 02:57:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000419040_107274240.pth [2023-12-26 02:57:38,821][123091] Updated weights for policy 0, policy_version 422820 (0.0010) [2023-12-26 02:57:38,884][123091] Updated weights for policy 0, policy_version 422830 (0.0011) [2023-12-26 02:57:38,895][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000422832_108249088.pth... [2023-12-26 02:57:38,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000421776_107978752.pth [2023-12-26 02:57:39,073][123090] Updated weights for policy 1, policy_version 420103 (0.0009) [2023-12-26 02:57:39,133][123090] Updated weights for policy 1, policy_version 420113 (0.0009) [2023-12-26 02:57:39,196][123090] Updated weights for policy 1, policy_version 420123 (0.0009) [2023-12-26 02:57:39,750][123091] Updated weights for policy 0, policy_version 422840 (0.0011) [2023-12-26 02:57:39,805][123091] Updated weights for policy 0, policy_version 422850 (0.0011) [2023-12-26 02:57:39,872][123091] Updated weights for policy 0, policy_version 422860 (0.0011) [2023-12-26 02:57:40,100][123090] Updated weights for policy 1, policy_version 420133 (0.0009) [2023-12-26 02:57:40,171][123090] Updated weights for policy 1, policy_version 420143 (0.0009) [2023-12-26 02:57:40,232][123090] Updated weights for policy 1, policy_version 420153 (0.0009) [2023-12-26 02:57:40,743][123091] Updated weights for policy 0, policy_version 422870 (0.0011) [2023-12-26 02:57:40,798][123091] Updated weights for policy 0, policy_version 422880 (0.0010) [2023-12-26 02:57:40,857][123091] Updated weights for policy 0, policy_version 422890 (0.0011) [2023-12-26 02:57:41,074][123090] Updated weights for policy 1, policy_version 420163 (0.0009) [2023-12-26 02:57:41,131][123090] Updated weights for policy 1, policy_version 420173 (0.0009) [2023-12-26 02:57:41,195][123090] Updated weights for policy 1, policy_version 420183 (0.0009) [2023-12-26 02:57:41,752][123091] Updated weights for policy 0, policy_version 422900 (0.0011) [2023-12-26 02:57:41,823][123091] Updated weights for policy 0, policy_version 422910 (0.0011) [2023-12-26 02:57:41,887][123091] Updated weights for policy 0, policy_version 422920 (0.0011) [2023-12-26 02:57:42,074][123090] Updated weights for policy 1, policy_version 420193 (0.0009) [2023-12-26 02:57:42,123][123090] Updated weights for policy 1, policy_version 420203 (0.0008) [2023-12-26 02:57:42,172][123090] Updated weights for policy 1, policy_version 420213 (0.0009) [2023-12-26 02:57:42,220][123090] Updated weights for policy 1, policy_version 420223 (0.0008) [2023-12-26 02:57:42,748][123091] Updated weights for policy 0, policy_version 422930 (0.0010) [2023-12-26 02:57:42,818][123091] Updated weights for policy 0, policy_version 422940 (0.0008) [2023-12-26 02:57:42,889][123091] Updated weights for policy 0, policy_version 422950 (0.0007) [2023-12-26 02:57:42,955][123091] Updated weights for policy 0, policy_version 422960 (0.0010) [2023-12-26 02:57:43,097][123090] Updated weights for policy 1, policy_version 420233 (0.0009) [2023-12-26 02:57:43,149][123090] Updated weights for policy 1, policy_version 420243 (0.0010) [2023-12-26 02:57:43,203][123090] Updated weights for policy 1, policy_version 420253 (0.0010) [2023-12-26 02:57:43,712][123091] Updated weights for policy 0, policy_version 422970 (0.0005) [2023-12-26 02:57:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 215867392. Throughput: 0: 8836.5, 1: 8894.1. Samples: 215866020. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:43,785][121949] Avg episode reward: [(0, '6195.371'), (1, '5836.732')] [2023-12-26 02:57:43,786][123091] Updated weights for policy 0, policy_version 422980 (0.0005) [2023-12-26 02:57:43,862][123091] Updated weights for policy 0, policy_version 422990 (0.0005) [2023-12-26 02:57:44,129][123090] Updated weights for policy 1, policy_version 420263 (0.0009) [2023-12-26 02:57:44,187][123090] Updated weights for policy 1, policy_version 420273 (0.0008) [2023-12-26 02:57:44,237][123090] Updated weights for policy 1, policy_version 420283 (0.0009) [2023-12-26 02:57:44,476][123091] Updated weights for policy 0, policy_version 423000 (0.0008) [2023-12-26 02:57:44,534][123091] Updated weights for policy 0, policy_version 423010 (0.0010) [2023-12-26 02:57:44,598][123091] Updated weights for policy 0, policy_version 423020 (0.0009) [2023-12-26 02:57:45,002][123090] Updated weights for policy 1, policy_version 420293 (0.0009) [2023-12-26 02:57:45,071][123090] Updated weights for policy 1, policy_version 420303 (0.0009) [2023-12-26 02:57:45,134][123090] Updated weights for policy 1, policy_version 420313 (0.0009) [2023-12-26 02:57:45,411][123091] Updated weights for policy 0, policy_version 423030 (0.0010) [2023-12-26 02:57:45,473][123091] Updated weights for policy 0, policy_version 423040 (0.0010) [2023-12-26 02:57:45,537][123091] Updated weights for policy 0, policy_version 423050 (0.0009) [2023-12-26 02:57:45,958][123090] Updated weights for policy 1, policy_version 420323 (0.0009) [2023-12-26 02:57:46,018][123090] Updated weights for policy 1, policy_version 420333 (0.0009) [2023-12-26 02:57:46,070][123090] Updated weights for policy 1, policy_version 420343 (0.0008) [2023-12-26 02:57:46,375][123091] Updated weights for policy 0, policy_version 423060 (0.0010) [2023-12-26 02:57:46,441][123091] Updated weights for policy 0, policy_version 423070 (0.0009) [2023-12-26 02:57:46,515][123091] Updated weights for policy 0, policy_version 423080 (0.0009) [2023-12-26 02:57:46,914][123090] Updated weights for policy 1, policy_version 420353 (0.0007) [2023-12-26 02:57:46,963][123090] Updated weights for policy 1, policy_version 420363 (0.0009) [2023-12-26 02:57:47,012][123090] Updated weights for policy 1, policy_version 420373 (0.0009) [2023-12-26 02:57:47,074][123090] Updated weights for policy 1, policy_version 420383 (0.0009) [2023-12-26 02:57:47,353][123091] Updated weights for policy 0, policy_version 423090 (0.0010) [2023-12-26 02:57:47,407][123091] Updated weights for policy 0, policy_version 423100 (0.0007) [2023-12-26 02:57:47,477][123091] Updated weights for policy 0, policy_version 423110 (0.0005) [2023-12-26 02:57:47,548][123091] Updated weights for policy 0, policy_version 423120 (0.0005) [2023-12-26 02:57:47,973][123090] Updated weights for policy 1, policy_version 420393 (0.0009) [2023-12-26 02:57:48,025][123090] Updated weights for policy 1, policy_version 420403 (0.0010) [2023-12-26 02:57:48,081][123090] Updated weights for policy 1, policy_version 420413 (0.0009) [2023-12-26 02:57:48,094][123091] Updated weights for policy 0, policy_version 423130 (0.0005) [2023-12-26 02:57:48,157][123091] Updated weights for policy 0, policy_version 423140 (0.0008) [2023-12-26 02:57:48,215][123091] Updated weights for policy 0, policy_version 423150 (0.0010) [2023-12-26 02:57:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 215957504. Throughput: 0: 8900.9, 1: 8811.8. Samples: 215971108. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:48,785][121949] Avg episode reward: [(0, '6153.684'), (1, '5845.505')] [2023-12-26 02:57:48,976][123090] Updated weights for policy 1, policy_version 420423 (0.0007) [2023-12-26 02:57:49,027][123091] Updated weights for policy 0, policy_version 423160 (0.0011) [2023-12-26 02:57:49,035][123090] Updated weights for policy 1, policy_version 420433 (0.0005) [2023-12-26 02:57:49,087][123091] Updated weights for policy 0, policy_version 423170 (0.0011) [2023-12-26 02:57:49,098][123090] Updated weights for policy 1, policy_version 420443 (0.0005) [2023-12-26 02:57:49,142][123091] Updated weights for policy 0, policy_version 423180 (0.0009) [2023-12-26 02:57:49,938][123091] Updated weights for policy 0, policy_version 423190 (0.0009) [2023-12-26 02:57:49,954][123090] Updated weights for policy 1, policy_version 420453 (0.0008) [2023-12-26 02:57:49,992][123091] Updated weights for policy 0, policy_version 423200 (0.0009) [2023-12-26 02:57:50,023][123090] Updated weights for policy 1, policy_version 420463 (0.0008) [2023-12-26 02:57:50,048][123091] Updated weights for policy 0, policy_version 423210 (0.0008) [2023-12-26 02:57:50,087][123090] Updated weights for policy 1, policy_version 420473 (0.0008) [2023-12-26 02:57:50,764][123091] Updated weights for policy 0, policy_version 423220 (0.0007) [2023-12-26 02:57:50,831][123091] Updated weights for policy 0, policy_version 423230 (0.0006) [2023-12-26 02:57:50,904][123091] Updated weights for policy 0, policy_version 423240 (0.0006) [2023-12-26 02:57:50,952][123090] Updated weights for policy 1, policy_version 420483 (0.0009) [2023-12-26 02:57:51,013][123090] Updated weights for policy 1, policy_version 420493 (0.0006) [2023-12-26 02:57:51,086][123090] Updated weights for policy 1, policy_version 420503 (0.0010) [2023-12-26 02:57:51,755][123091] Updated weights for policy 0, policy_version 423250 (0.0009) [2023-12-26 02:57:51,822][123091] Updated weights for policy 0, policy_version 423260 (0.0008) [2023-12-26 02:57:51,892][123091] Updated weights for policy 0, policy_version 423270 (0.0007) [2023-12-26 02:57:51,939][123090] Updated weights for policy 1, policy_version 420513 (0.0009) [2023-12-26 02:57:51,956][123091] Updated weights for policy 0, policy_version 423280 (0.0007) [2023-12-26 02:57:52,000][123090] Updated weights for policy 1, policy_version 420523 (0.0009) [2023-12-26 02:57:52,058][123090] Updated weights for policy 1, policy_version 420533 (0.0010) [2023-12-26 02:57:52,123][123090] Updated weights for policy 1, policy_version 420543 (0.0009) [2023-12-26 02:57:52,783][123091] Updated weights for policy 0, policy_version 423290 (0.0009) [2023-12-26 02:57:52,836][123091] Updated weights for policy 0, policy_version 423300 (0.0009) [2023-12-26 02:57:52,888][123091] Updated weights for policy 0, policy_version 423310 (0.0010) [2023-12-26 02:57:52,966][123090] Updated weights for policy 1, policy_version 420553 (0.0009) [2023-12-26 02:57:53,033][123090] Updated weights for policy 1, policy_version 420563 (0.0009) [2023-12-26 02:57:53,101][123090] Updated weights for policy 1, policy_version 420573 (0.0010) [2023-12-26 02:57:53,632][123091] Updated weights for policy 0, policy_version 423320 (0.0006) [2023-12-26 02:57:53,685][123091] Updated weights for policy 0, policy_version 423330 (0.0005) [2023-12-26 02:57:53,744][123091] Updated weights for policy 0, policy_version 423340 (0.0005) [2023-12-26 02:57:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 216047616. Throughput: 0: 8881.1, 1: 8782.7. Samples: 216023176. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:53,785][121949] Avg episode reward: [(0, '6164.197'), (1, '5819.090')] [2023-12-26 02:57:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000423344_108380160.pth... [2023-12-26 02:57:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000420576_107667456.pth... [2023-12-26 02:57:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000422288_108109824.pth [2023-12-26 02:57:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000419584_107413504.pth [2023-12-26 02:57:54,003][123090] Updated weights for policy 1, policy_version 420583 (0.0009) [2023-12-26 02:57:54,059][123090] Updated weights for policy 1, policy_version 420593 (0.0008) [2023-12-26 02:57:54,115][123090] Updated weights for policy 1, policy_version 420603 (0.0005) [2023-12-26 02:57:54,376][123091] Updated weights for policy 0, policy_version 423350 (0.0008) [2023-12-26 02:57:54,434][123091] Updated weights for policy 0, policy_version 423360 (0.0009) [2023-12-26 02:57:54,498][123091] Updated weights for policy 0, policy_version 423370 (0.0009) [2023-12-26 02:57:54,906][123090] Updated weights for policy 1, policy_version 420613 (0.0008) [2023-12-26 02:57:54,963][123090] Updated weights for policy 1, policy_version 420623 (0.0009) [2023-12-26 02:57:55,024][123090] Updated weights for policy 1, policy_version 420633 (0.0008) [2023-12-26 02:57:55,268][123091] Updated weights for policy 0, policy_version 423380 (0.0010) [2023-12-26 02:57:55,336][123091] Updated weights for policy 0, policy_version 423390 (0.0009) [2023-12-26 02:57:55,398][123091] Updated weights for policy 0, policy_version 423400 (0.0009) [2023-12-26 02:57:55,776][123090] Updated weights for policy 1, policy_version 420643 (0.0006) [2023-12-26 02:57:55,835][123090] Updated weights for policy 1, policy_version 420653 (0.0006) [2023-12-26 02:57:55,900][123090] Updated weights for policy 1, policy_version 420663 (0.0008) [2023-12-26 02:57:56,269][123091] Updated weights for policy 0, policy_version 423410 (0.0010) [2023-12-26 02:57:56,336][123091] Updated weights for policy 0, policy_version 423420 (0.0010) [2023-12-26 02:57:56,394][123091] Updated weights for policy 0, policy_version 423430 (0.0010) [2023-12-26 02:57:56,449][123091] Updated weights for policy 0, policy_version 423440 (0.0009) [2023-12-26 02:57:56,541][123090] Updated weights for policy 1, policy_version 420673 (0.0006) [2023-12-26 02:57:56,596][123090] Updated weights for policy 1, policy_version 420683 (0.0009) [2023-12-26 02:57:56,657][123090] Updated weights for policy 1, policy_version 420693 (0.0009) [2023-12-26 02:57:56,723][123090] Updated weights for policy 1, policy_version 420703 (0.0009) [2023-12-26 02:57:57,285][123091] Updated weights for policy 0, policy_version 423450 (0.0009) [2023-12-26 02:57:57,343][123091] Updated weights for policy 0, policy_version 423460 (0.0008) [2023-12-26 02:57:57,400][123091] Updated weights for policy 0, policy_version 423470 (0.0009) [2023-12-26 02:57:57,501][123090] Updated weights for policy 1, policy_version 420713 (0.0009) [2023-12-26 02:57:57,553][123090] Updated weights for policy 1, policy_version 420723 (0.0010) [2023-12-26 02:57:57,615][123090] Updated weights for policy 1, policy_version 420733 (0.0008) [2023-12-26 02:57:58,217][123091] Updated weights for policy 0, policy_version 423480 (0.0009) [2023-12-26 02:57:58,285][123091] Updated weights for policy 0, policy_version 423490 (0.0009) [2023-12-26 02:57:58,350][123091] Updated weights for policy 0, policy_version 423500 (0.0009) [2023-12-26 02:57:58,505][123090] Updated weights for policy 1, policy_version 420743 (0.0009) [2023-12-26 02:57:58,580][123090] Updated weights for policy 1, policy_version 420753 (0.0008) [2023-12-26 02:57:58,646][123090] Updated weights for policy 1, policy_version 420763 (0.0009) [2023-12-26 02:57:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 216137728. Throughput: 0: 8922.8, 1: 8785.4. Samples: 216129348. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:57:58,785][121949] Avg episode reward: [(0, '6193.761'), (1, '5862.996')] [2023-12-26 02:57:59,293][123091] Updated weights for policy 0, policy_version 423510 (0.0006) [2023-12-26 02:57:59,379][123091] Updated weights for policy 0, policy_version 423520 (0.0009) [2023-12-26 02:57:59,423][123090] Updated weights for policy 1, policy_version 420773 (0.0008) [2023-12-26 02:57:59,436][123091] Updated weights for policy 0, policy_version 423530 (0.0010) [2023-12-26 02:57:59,482][123090] Updated weights for policy 1, policy_version 420783 (0.0007) [2023-12-26 02:57:59,545][123090] Updated weights for policy 1, policy_version 420793 (0.0008) [2023-12-26 02:58:00,183][123090] Updated weights for policy 1, policy_version 420803 (0.0007) [2023-12-26 02:58:00,250][123091] Updated weights for policy 0, policy_version 423540 (0.0008) [2023-12-26 02:58:00,252][123090] Updated weights for policy 1, policy_version 420813 (0.0008) [2023-12-26 02:58:00,311][123091] Updated weights for policy 0, policy_version 423550 (0.0008) [2023-12-26 02:58:00,313][123090] Updated weights for policy 1, policy_version 420823 (0.0008) [2023-12-26 02:58:00,366][123091] Updated weights for policy 0, policy_version 423560 (0.0007) [2023-12-26 02:58:01,076][123090] Updated weights for policy 1, policy_version 420833 (0.0007) [2023-12-26 02:58:01,148][123090] Updated weights for policy 1, policy_version 420843 (0.0007) [2023-12-26 02:58:01,206][123090] Updated weights for policy 1, policy_version 420853 (0.0006) [2023-12-26 02:58:01,225][123091] Updated weights for policy 0, policy_version 423570 (0.0009) [2023-12-26 02:58:01,281][123090] Updated weights for policy 1, policy_version 420863 (0.0008) [2023-12-26 02:58:01,288][123091] Updated weights for policy 0, policy_version 423580 (0.0007) [2023-12-26 02:58:01,366][123091] Updated weights for policy 0, policy_version 423590 (0.0009) [2023-12-26 02:58:01,438][123091] Updated weights for policy 0, policy_version 423600 (0.0006) [2023-12-26 02:58:02,001][123090] Updated weights for policy 1, policy_version 420873 (0.0006) [2023-12-26 02:58:02,061][123090] Updated weights for policy 1, policy_version 420883 (0.0005) [2023-12-26 02:58:02,109][123090] Updated weights for policy 1, policy_version 420893 (0.0005) [2023-12-26 02:58:02,267][123091] Updated weights for policy 0, policy_version 423610 (0.0008) [2023-12-26 02:58:02,343][123091] Updated weights for policy 0, policy_version 423620 (0.0010) [2023-12-26 02:58:02,409][123091] Updated weights for policy 0, policy_version 423630 (0.0009) [2023-12-26 02:58:02,838][123090] Updated weights for policy 1, policy_version 420903 (0.0008) [2023-12-26 02:58:02,899][123090] Updated weights for policy 1, policy_version 420913 (0.0010) [2023-12-26 02:58:02,960][123090] Updated weights for policy 1, policy_version 420923 (0.0010) [2023-12-26 02:58:03,112][123091] Updated weights for policy 0, policy_version 423640 (0.0006) [2023-12-26 02:58:03,166][123091] Updated weights for policy 0, policy_version 423650 (0.0007) [2023-12-26 02:58:03,218][123091] Updated weights for policy 0, policy_version 423660 (0.0005) [2023-12-26 02:58:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 216219648. Throughput: 0: 8846.8, 1: 8741.9. Samples: 216234660. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:03,785][121949] Avg episode reward: [(0, '6159.563'), (1, '5740.172')] [2023-12-26 02:58:03,894][123091] Updated weights for policy 0, policy_version 423670 (0.0007) [2023-12-26 02:58:03,905][123090] Updated weights for policy 1, policy_version 420933 (0.0008) [2023-12-26 02:58:03,965][123091] Updated weights for policy 0, policy_version 423680 (0.0006) [2023-12-26 02:58:03,968][123090] Updated weights for policy 1, policy_version 420943 (0.0008) [2023-12-26 02:58:04,032][123091] Updated weights for policy 0, policy_version 423690 (0.0009) [2023-12-26 02:58:04,034][123090] Updated weights for policy 1, policy_version 420953 (0.0008) [2023-12-26 02:58:04,814][123091] Updated weights for policy 0, policy_version 423700 (0.0011) [2023-12-26 02:58:04,883][123091] Updated weights for policy 0, policy_version 423710 (0.0006) [2023-12-26 02:58:04,897][123090] Updated weights for policy 1, policy_version 420963 (0.0008) [2023-12-26 02:58:04,942][123091] Updated weights for policy 0, policy_version 423720 (0.0005) [2023-12-26 02:58:04,953][123090] Updated weights for policy 1, policy_version 420973 (0.0009) [2023-12-26 02:58:05,028][123090] Updated weights for policy 1, policy_version 420983 (0.0010) [2023-12-26 02:58:05,596][123091] Updated weights for policy 0, policy_version 423730 (0.0007) [2023-12-26 02:58:05,653][123091] Updated weights for policy 0, policy_version 423740 (0.0010) [2023-12-26 02:58:05,700][123091] Updated weights for policy 0, policy_version 423750 (0.0010) [2023-12-26 02:58:05,747][123091] Updated weights for policy 0, policy_version 423760 (0.0010) [2023-12-26 02:58:05,868][123090] Updated weights for policy 1, policy_version 420993 (0.0009) [2023-12-26 02:58:05,940][123090] Updated weights for policy 1, policy_version 421003 (0.0009) [2023-12-26 02:58:06,010][123090] Updated weights for policy 1, policy_version 421013 (0.0009) [2023-12-26 02:58:06,072][123090] Updated weights for policy 1, policy_version 421023 (0.0009) [2023-12-26 02:58:06,609][123091] Updated weights for policy 0, policy_version 423770 (0.0011) [2023-12-26 02:58:06,673][123091] Updated weights for policy 0, policy_version 423780 (0.0011) [2023-12-26 02:58:06,733][123091] Updated weights for policy 0, policy_version 423790 (0.0011) [2023-12-26 02:58:06,941][123090] Updated weights for policy 1, policy_version 421033 (0.0009) [2023-12-26 02:58:07,013][123090] Updated weights for policy 1, policy_version 421043 (0.0009) [2023-12-26 02:58:07,078][123090] Updated weights for policy 1, policy_version 421053 (0.0009) [2023-12-26 02:58:07,545][123091] Updated weights for policy 0, policy_version 423800 (0.0010) [2023-12-26 02:58:07,600][123091] Updated weights for policy 0, policy_version 423810 (0.0010) [2023-12-26 02:58:07,648][123091] Updated weights for policy 0, policy_version 423820 (0.0010) [2023-12-26 02:58:07,910][123090] Updated weights for policy 1, policy_version 421063 (0.0007) [2023-12-26 02:58:07,964][123090] Updated weights for policy 1, policy_version 421073 (0.0009) [2023-12-26 02:58:08,029][123090] Updated weights for policy 1, policy_version 421083 (0.0009) [2023-12-26 02:58:08,494][123091] Updated weights for policy 0, policy_version 423830 (0.0011) [2023-12-26 02:58:08,560][123091] Updated weights for policy 0, policy_version 423840 (0.0011) [2023-12-26 02:58:08,626][123091] Updated weights for policy 0, policy_version 423850 (0.0011) [2023-12-26 02:58:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 216309760. Throughput: 0: 8917.9, 1: 8705.6. Samples: 216286600. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:08,785][121949] Avg episode reward: [(0, '6124.635'), (1, '5499.777')] [2023-12-26 02:58:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000423856_108511232.pth... [2023-12-26 02:58:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000422832_108249088.pth [2023-12-26 02:58:08,833][123090] Updated weights for policy 1, policy_version 421093 (0.0009) [2023-12-26 02:58:08,888][123090] Updated weights for policy 1, policy_version 421103 (0.0010) [2023-12-26 02:58:08,943][123090] Updated weights for policy 1, policy_version 421113 (0.0010) [2023-12-26 02:58:08,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000421120_107806720.pth... [2023-12-26 02:58:08,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000420096_107544576.pth [2023-12-26 02:58:09,322][123091] Updated weights for policy 0, policy_version 423860 (0.0007) [2023-12-26 02:58:09,398][123091] Updated weights for policy 0, policy_version 423870 (0.0009) [2023-12-26 02:58:09,461][123091] Updated weights for policy 0, policy_version 423880 (0.0013) [2023-12-26 02:58:09,881][123090] Updated weights for policy 1, policy_version 421123 (0.0009) [2023-12-26 02:58:09,951][123090] Updated weights for policy 1, policy_version 421133 (0.0008) [2023-12-26 02:58:10,014][123090] Updated weights for policy 1, policy_version 421143 (0.0008) [2023-12-26 02:58:10,297][123091] Updated weights for policy 0, policy_version 423890 (0.0011) [2023-12-26 02:58:10,368][123091] Updated weights for policy 0, policy_version 423900 (0.0011) [2023-12-26 02:58:10,438][123091] Updated weights for policy 0, policy_version 423910 (0.0011) [2023-12-26 02:58:10,510][123091] Updated weights for policy 0, policy_version 423920 (0.0009) [2023-12-26 02:58:10,837][123090] Updated weights for policy 1, policy_version 421153 (0.0008) [2023-12-26 02:58:10,909][123090] Updated weights for policy 1, policy_version 421163 (0.0005) [2023-12-26 02:58:10,975][123090] Updated weights for policy 1, policy_version 421173 (0.0005) [2023-12-26 02:58:11,049][123090] Updated weights for policy 1, policy_version 421183 (0.0007) [2023-12-26 02:58:11,308][123091] Updated weights for policy 0, policy_version 423930 (0.0007) [2023-12-26 02:58:11,378][123091] Updated weights for policy 0, policy_version 423940 (0.0009) [2023-12-26 02:58:11,452][123091] Updated weights for policy 0, policy_version 423950 (0.0008) [2023-12-26 02:58:11,835][123090] Updated weights for policy 1, policy_version 421193 (0.0009) [2023-12-26 02:58:11,890][123090] Updated weights for policy 1, policy_version 421203 (0.0009) [2023-12-26 02:58:11,949][123090] Updated weights for policy 1, policy_version 421213 (0.0009) [2023-12-26 02:58:12,221][123091] Updated weights for policy 0, policy_version 423960 (0.0008) [2023-12-26 02:58:12,294][123091] Updated weights for policy 0, policy_version 423970 (0.0009) [2023-12-26 02:58:12,353][123091] Updated weights for policy 0, policy_version 423980 (0.0010) [2023-12-26 02:58:12,765][123090] Updated weights for policy 1, policy_version 421223 (0.0010) [2023-12-26 02:58:12,821][123090] Updated weights for policy 1, policy_version 421233 (0.0009) [2023-12-26 02:58:12,873][123090] Updated weights for policy 1, policy_version 421243 (0.0009) [2023-12-26 02:58:13,083][123091] Updated weights for policy 0, policy_version 423990 (0.0008) [2023-12-26 02:58:13,140][123091] Updated weights for policy 0, policy_version 424000 (0.0009) [2023-12-26 02:58:13,192][123091] Updated weights for policy 0, policy_version 424010 (0.0009) [2023-12-26 02:58:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 216391680. Throughput: 0: 8940.0, 1: 8686.4. Samples: 216389464. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:13,785][121949] Avg episode reward: [(0, '6177.567'), (1, '5561.907')] [2023-12-26 02:58:13,790][123090] Updated weights for policy 1, policy_version 421253 (0.0009) [2023-12-26 02:58:13,853][123090] Updated weights for policy 1, policy_version 421263 (0.0010) [2023-12-26 02:58:13,900][123090] Updated weights for policy 1, policy_version 421273 (0.0010) [2023-12-26 02:58:13,938][123091] Updated weights for policy 0, policy_version 424020 (0.0008) [2023-12-26 02:58:14,000][123091] Updated weights for policy 0, policy_version 424030 (0.0009) [2023-12-26 02:58:14,060][123091] Updated weights for policy 0, policy_version 424040 (0.0009) [2023-12-26 02:58:14,747][123090] Updated weights for policy 1, policy_version 421283 (0.0010) [2023-12-26 02:58:14,817][123090] Updated weights for policy 1, policy_version 421293 (0.0010) [2023-12-26 02:58:14,879][123090] Updated weights for policy 1, policy_version 421303 (0.0009) [2023-12-26 02:58:14,907][123091] Updated weights for policy 0, policy_version 424050 (0.0009) [2023-12-26 02:58:14,968][123091] Updated weights for policy 0, policy_version 424060 (0.0009) [2023-12-26 02:58:15,022][123091] Updated weights for policy 0, policy_version 424070 (0.0009) [2023-12-26 02:58:15,076][123091] Updated weights for policy 0, policy_version 424080 (0.0009) [2023-12-26 02:58:15,756][123090] Updated weights for policy 1, policy_version 421313 (0.0009) [2023-12-26 02:58:15,805][123090] Updated weights for policy 1, policy_version 421323 (0.0005) [2023-12-26 02:58:15,875][123090] Updated weights for policy 1, policy_version 421333 (0.0005) [2023-12-26 02:58:15,938][123090] Updated weights for policy 1, policy_version 421343 (0.0005) [2023-12-26 02:58:15,965][123091] Updated weights for policy 0, policy_version 424090 (0.0010) [2023-12-26 02:58:16,022][123091] Updated weights for policy 0, policy_version 424100 (0.0010) [2023-12-26 02:58:16,080][123091] Updated weights for policy 0, policy_version 424111 (0.0010) [2023-12-26 02:58:16,604][123090] Updated weights for policy 1, policy_version 421353 (0.0005) [2023-12-26 02:58:16,681][123090] Updated weights for policy 1, policy_version 421363 (0.0005) [2023-12-26 02:58:16,749][123090] Updated weights for policy 1, policy_version 421373 (0.0008) [2023-12-26 02:58:17,012][123091] Updated weights for policy 0, policy_version 424121 (0.0009) [2023-12-26 02:58:17,061][123091] Updated weights for policy 0, policy_version 424131 (0.0009) [2023-12-26 02:58:17,113][123091] Updated weights for policy 0, policy_version 424141 (0.0008) [2023-12-26 02:58:17,485][123090] Updated weights for policy 1, policy_version 421383 (0.0009) [2023-12-26 02:58:17,551][123090] Updated weights for policy 1, policy_version 421393 (0.0011) [2023-12-26 02:58:17,599][123090] Updated weights for policy 1, policy_version 421403 (0.0010) [2023-12-26 02:58:17,886][123091] Updated weights for policy 0, policy_version 424151 (0.0006) [2023-12-26 02:58:17,948][123091] Updated weights for policy 0, policy_version 424161 (0.0010) [2023-12-26 02:58:18,007][123091] Updated weights for policy 0, policy_version 424172 (0.0010) [2023-12-26 02:58:18,428][123090] Updated weights for policy 1, policy_version 421413 (0.0010) [2023-12-26 02:58:18,482][123090] Updated weights for policy 1, policy_version 421423 (0.0009) [2023-12-26 02:58:18,541][123090] Updated weights for policy 1, policy_version 421433 (0.0009) [2023-12-26 02:58:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 216481792. Throughput: 0: 8849.1, 1: 8610.0. Samples: 216493876. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:18,785][121949] Avg episode reward: [(0, '6156.098'), (1, '5771.910')] [2023-12-26 02:58:18,803][123091] Updated weights for policy 0, policy_version 424182 (0.0010) [2023-12-26 02:58:18,859][123091] Updated weights for policy 0, policy_version 424192 (0.0010) [2023-12-26 02:58:18,917][123091] Updated weights for policy 0, policy_version 424202 (0.0010) [2023-12-26 02:58:19,431][123090] Updated weights for policy 1, policy_version 421443 (0.0009) [2023-12-26 02:58:19,502][123090] Updated weights for policy 1, policy_version 421453 (0.0010) [2023-12-26 02:58:19,559][123090] Updated weights for policy 1, policy_version 421463 (0.0006) [2023-12-26 02:58:19,698][123091] Updated weights for policy 0, policy_version 424212 (0.0009) [2023-12-26 02:58:19,755][123091] Updated weights for policy 0, policy_version 424222 (0.0009) [2023-12-26 02:58:19,826][123091] Updated weights for policy 0, policy_version 424232 (0.0006) [2023-12-26 02:58:20,280][123090] Updated weights for policy 1, policy_version 421473 (0.0006) [2023-12-26 02:58:20,350][123090] Updated weights for policy 1, policy_version 421483 (0.0006) [2023-12-26 02:58:20,414][123090] Updated weights for policy 1, policy_version 421493 (0.0006) [2023-12-26 02:58:20,478][123090] Updated weights for policy 1, policy_version 421503 (0.0006) [2023-12-26 02:58:20,656][123091] Updated weights for policy 0, policy_version 424242 (0.0009) [2023-12-26 02:58:20,727][123091] Updated weights for policy 0, policy_version 424252 (0.0006) [2023-12-26 02:58:20,794][123091] Updated weights for policy 0, policy_version 424262 (0.0009) [2023-12-26 02:58:20,859][123091] Updated weights for policy 0, policy_version 424272 (0.0011) [2023-12-26 02:58:21,188][123090] Updated weights for policy 1, policy_version 421513 (0.0007) [2023-12-26 02:58:21,257][123090] Updated weights for policy 1, policy_version 421523 (0.0007) [2023-12-26 02:58:21,316][123090] Updated weights for policy 1, policy_version 421533 (0.0010) [2023-12-26 02:58:21,633][123091] Updated weights for policy 0, policy_version 424282 (0.0007) [2023-12-26 02:58:21,705][123091] Updated weights for policy 0, policy_version 424292 (0.0007) [2023-12-26 02:58:21,776][123091] Updated weights for policy 0, policy_version 424302 (0.0011) [2023-12-26 02:58:22,155][123090] Updated weights for policy 1, policy_version 421543 (0.0010) [2023-12-26 02:58:22,216][123090] Updated weights for policy 1, policy_version 421553 (0.0009) [2023-12-26 02:58:22,286][123090] Updated weights for policy 1, policy_version 421563 (0.0009) [2023-12-26 02:58:22,568][123091] Updated weights for policy 0, policy_version 424312 (0.0011) [2023-12-26 02:58:22,632][123091] Updated weights for policy 0, policy_version 424322 (0.0010) [2023-12-26 02:58:22,689][123091] Updated weights for policy 0, policy_version 424332 (0.0011) [2023-12-26 02:58:23,116][123090] Updated weights for policy 1, policy_version 421573 (0.0009) [2023-12-26 02:58:23,174][123090] Updated weights for policy 1, policy_version 421583 (0.0007) [2023-12-26 02:58:23,226][123090] Updated weights for policy 1, policy_version 421593 (0.0009) [2023-12-26 02:58:23,524][123091] Updated weights for policy 0, policy_version 424342 (0.0011) [2023-12-26 02:58:23,583][123091] Updated weights for policy 0, policy_version 424352 (0.0011) [2023-12-26 02:58:23,638][123091] Updated weights for policy 0, policy_version 424362 (0.0010) [2023-12-26 02:58:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 216571904. Throughput: 0: 8818.5, 1: 8621.9. Samples: 216547260. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:23,785][121949] Avg episode reward: [(0, '6145.501'), (1, '5564.419')] [2023-12-26 02:58:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000424368_108642304.pth... [2023-12-26 02:58:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000421600_107929600.pth... [2023-12-26 02:58:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000420576_107667456.pth [2023-12-26 02:58:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000423344_108380160.pth [2023-12-26 02:58:24,091][123090] Updated weights for policy 1, policy_version 421603 (0.0009) [2023-12-26 02:58:24,145][123090] Updated weights for policy 1, policy_version 421613 (0.0009) [2023-12-26 02:58:24,195][123090] Updated weights for policy 1, policy_version 421623 (0.0009) [2023-12-26 02:58:24,456][123091] Updated weights for policy 0, policy_version 424372 (0.0010) [2023-12-26 02:58:24,514][123091] Updated weights for policy 0, policy_version 424382 (0.0010) [2023-12-26 02:58:24,563][123091] Updated weights for policy 0, policy_version 424392 (0.0009) [2023-12-26 02:58:25,054][123090] Updated weights for policy 1, policy_version 421633 (0.0010) [2023-12-26 02:58:25,119][123090] Updated weights for policy 1, policy_version 421643 (0.0005) [2023-12-26 02:58:25,179][123090] Updated weights for policy 1, policy_version 421653 (0.0005) [2023-12-26 02:58:25,231][123090] Updated weights for policy 1, policy_version 421663 (0.0005) [2023-12-26 02:58:25,391][123091] Updated weights for policy 0, policy_version 424402 (0.0009) [2023-12-26 02:58:25,457][123091] Updated weights for policy 0, policy_version 424412 (0.0008) [2023-12-26 02:58:25,509][123091] Updated weights for policy 0, policy_version 424422 (0.0006) [2023-12-26 02:58:25,573][123091] Updated weights for policy 0, policy_version 424432 (0.0007) [2023-12-26 02:58:26,031][123090] Updated weights for policy 1, policy_version 421673 (0.0009) [2023-12-26 02:58:26,089][123090] Updated weights for policy 1, policy_version 421683 (0.0010) [2023-12-26 02:58:26,143][123090] Updated weights for policy 1, policy_version 421693 (0.0010) [2023-12-26 02:58:26,283][123091] Updated weights for policy 0, policy_version 424442 (0.0008) [2023-12-26 02:58:26,345][123091] Updated weights for policy 0, policy_version 424452 (0.0006) [2023-12-26 02:58:26,391][123091] Updated weights for policy 0, policy_version 424462 (0.0006) [2023-12-26 02:58:26,891][123090] Updated weights for policy 1, policy_version 421703 (0.0009) [2023-12-26 02:58:26,946][123090] Updated weights for policy 1, policy_version 421713 (0.0008) [2023-12-26 02:58:27,003][123090] Updated weights for policy 1, policy_version 421723 (0.0010) [2023-12-26 02:58:27,105][123091] Updated weights for policy 0, policy_version 424472 (0.0005) [2023-12-26 02:58:27,157][123091] Updated weights for policy 0, policy_version 424482 (0.0005) [2023-12-26 02:58:27,206][123091] Updated weights for policy 0, policy_version 424492 (0.0005) [2023-12-26 02:58:27,729][123090] Updated weights for policy 1, policy_version 421733 (0.0008) [2023-12-26 02:58:27,806][123090] Updated weights for policy 1, policy_version 421743 (0.0005) [2023-12-26 02:58:27,853][123090] Updated weights for policy 1, policy_version 421753 (0.0005) [2023-12-26 02:58:27,899][123091] Updated weights for policy 0, policy_version 424502 (0.0005) [2023-12-26 02:58:27,957][123091] Updated weights for policy 0, policy_version 424512 (0.0005) [2023-12-26 02:58:28,017][123091] Updated weights for policy 0, policy_version 424522 (0.0006) [2023-12-26 02:58:28,527][123090] Updated weights for policy 1, policy_version 421763 (0.0007) [2023-12-26 02:58:28,596][123090] Updated weights for policy 1, policy_version 421773 (0.0009) [2023-12-26 02:58:28,661][123090] Updated weights for policy 1, policy_version 421783 (0.0009) [2023-12-26 02:58:28,712][123091] Updated weights for policy 0, policy_version 424532 (0.0005) [2023-12-26 02:58:28,777][123091] Updated weights for policy 0, policy_version 424542 (0.0005) [2023-12-26 02:58:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 216662016. Throughput: 0: 8885.0, 1: 8623.0. Samples: 216653884. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:28,785][121949] Avg episode reward: [(0, '6117.851'), (1, '5420.303')] [2023-12-26 02:58:28,845][123091] Updated weights for policy 0, policy_version 424552 (0.0008) [2023-12-26 02:58:29,381][123090] Updated weights for policy 1, policy_version 421793 (0.0007) [2023-12-26 02:58:29,443][123090] Updated weights for policy 1, policy_version 421803 (0.0007) [2023-12-26 02:58:29,508][123090] Updated weights for policy 1, policy_version 421813 (0.0006) [2023-12-26 02:58:29,583][123090] Updated weights for policy 1, policy_version 421823 (0.0005) [2023-12-26 02:58:29,618][123091] Updated weights for policy 0, policy_version 424562 (0.0010) [2023-12-26 02:58:29,674][123091] Updated weights for policy 0, policy_version 424572 (0.0008) [2023-12-26 02:58:29,729][123091] Updated weights for policy 0, policy_version 424582 (0.0010) [2023-12-26 02:58:29,781][123091] Updated weights for policy 0, policy_version 424592 (0.0010) [2023-12-26 02:58:30,259][123090] Updated weights for policy 1, policy_version 421833 (0.0005) [2023-12-26 02:58:30,323][123090] Updated weights for policy 1, policy_version 421843 (0.0007) [2023-12-26 02:58:30,382][123090] Updated weights for policy 1, policy_version 421853 (0.0010) [2023-12-26 02:58:30,491][123091] Updated weights for policy 0, policy_version 424602 (0.0005) [2023-12-26 02:58:30,547][123091] Updated weights for policy 0, policy_version 424612 (0.0009) [2023-12-26 02:58:30,609][123091] Updated weights for policy 0, policy_version 424622 (0.0009) [2023-12-26 02:58:31,137][123090] Updated weights for policy 1, policy_version 421863 (0.0011) [2023-12-26 02:58:31,188][123090] Updated weights for policy 1, policy_version 421873 (0.0010) [2023-12-26 02:58:31,236][123090] Updated weights for policy 1, policy_version 421883 (0.0010) [2023-12-26 02:58:31,425][123091] Updated weights for policy 0, policy_version 424632 (0.0010) [2023-12-26 02:58:31,495][123091] Updated weights for policy 0, policy_version 424642 (0.0010) [2023-12-26 02:58:31,559][123091] Updated weights for policy 0, policy_version 424652 (0.0010) [2023-12-26 02:58:32,027][123090] Updated weights for policy 1, policy_version 421893 (0.0008) [2023-12-26 02:58:32,098][123090] Updated weights for policy 1, policy_version 421903 (0.0010) [2023-12-26 02:58:32,159][123090] Updated weights for policy 1, policy_version 421913 (0.0010) [2023-12-26 02:58:32,362][123091] Updated weights for policy 0, policy_version 424662 (0.0010) [2023-12-26 02:58:32,431][123091] Updated weights for policy 0, policy_version 424672 (0.0010) [2023-12-26 02:58:32,486][123091] Updated weights for policy 0, policy_version 424682 (0.0008) [2023-12-26 02:58:32,855][123090] Updated weights for policy 1, policy_version 421923 (0.0009) [2023-12-26 02:58:32,912][123090] Updated weights for policy 1, policy_version 421933 (0.0005) [2023-12-26 02:58:32,975][123090] Updated weights for policy 1, policy_version 421943 (0.0006) [2023-12-26 02:58:33,236][123091] Updated weights for policy 0, policy_version 424692 (0.0007) [2023-12-26 02:58:33,289][123091] Updated weights for policy 0, policy_version 424702 (0.0010) [2023-12-26 02:58:33,342][123091] Updated weights for policy 0, policy_version 424712 (0.0010) [2023-12-26 02:58:33,619][123090] Updated weights for policy 1, policy_version 421953 (0.0006) [2023-12-26 02:58:33,676][123090] Updated weights for policy 1, policy_version 421963 (0.0006) [2023-12-26 02:58:33,730][123090] Updated weights for policy 1, policy_version 421973 (0.0005) [2023-12-26 02:58:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 216752128. Throughput: 0: 8874.7, 1: 8810.4. Samples: 216766936. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:33,785][121949] Avg episode reward: [(0, '6087.004'), (1, '5501.811')] [2023-12-26 02:58:33,787][123090] Updated weights for policy 1, policy_version 421983 (0.0005) [2023-12-26 02:58:34,270][123091] Updated weights for policy 0, policy_version 424722 (0.0010) [2023-12-26 02:58:34,327][123091] Updated weights for policy 0, policy_version 424732 (0.0010) [2023-12-26 02:58:34,397][123091] Updated weights for policy 0, policy_version 424742 (0.0009) [2023-12-26 02:58:34,398][123090] Updated weights for policy 1, policy_version 421993 (0.0007) [2023-12-26 02:58:34,456][123090] Updated weights for policy 1, policy_version 422003 (0.0008) [2023-12-26 02:58:34,459][123091] Updated weights for policy 0, policy_version 424752 (0.0009) [2023-12-26 02:58:34,516][123090] Updated weights for policy 1, policy_version 422013 (0.0010) [2023-12-26 02:58:35,297][123090] Updated weights for policy 1, policy_version 422023 (0.0008) [2023-12-26 02:58:35,314][123091] Updated weights for policy 0, policy_version 424762 (0.0009) [2023-12-26 02:58:35,345][123090] Updated weights for policy 1, policy_version 422033 (0.0005) [2023-12-26 02:58:35,383][123091] Updated weights for policy 0, policy_version 424772 (0.0005) [2023-12-26 02:58:35,395][123090] Updated weights for policy 1, policy_version 422043 (0.0005) [2023-12-26 02:58:35,455][123091] Updated weights for policy 0, policy_version 424782 (0.0006) [2023-12-26 02:58:35,976][123090] Updated weights for policy 1, policy_version 422053 (0.0005) [2023-12-26 02:58:36,040][123090] Updated weights for policy 1, policy_version 422063 (0.0005) [2023-12-26 02:58:36,106][123090] Updated weights for policy 1, policy_version 422073 (0.0006) [2023-12-26 02:58:36,184][123091] Updated weights for policy 0, policy_version 424792 (0.0006) [2023-12-26 02:58:36,245][123091] Updated weights for policy 0, policy_version 424802 (0.0006) [2023-12-26 02:58:36,318][123091] Updated weights for policy 0, policy_version 424812 (0.0007) [2023-12-26 02:58:36,830][123090] Updated weights for policy 1, policy_version 422083 (0.0008) [2023-12-26 02:58:36,880][123090] Updated weights for policy 1, policy_version 422093 (0.0009) [2023-12-26 02:58:36,933][123090] Updated weights for policy 1, policy_version 422103 (0.0009) [2023-12-26 02:58:37,115][123091] Updated weights for policy 0, policy_version 424822 (0.0008) [2023-12-26 02:58:37,173][123091] Updated weights for policy 0, policy_version 424832 (0.0009) [2023-12-26 02:58:37,238][123091] Updated weights for policy 0, policy_version 424842 (0.0010) [2023-12-26 02:58:37,723][123090] Updated weights for policy 1, policy_version 422113 (0.0009) [2023-12-26 02:58:37,773][123090] Updated weights for policy 1, policy_version 422123 (0.0005) [2023-12-26 02:58:37,841][123090] Updated weights for policy 1, policy_version 422133 (0.0005) [2023-12-26 02:58:37,900][123090] Updated weights for policy 1, policy_version 422143 (0.0005) [2023-12-26 02:58:37,973][123091] Updated weights for policy 0, policy_version 424852 (0.0008) [2023-12-26 02:58:38,043][123091] Updated weights for policy 0, policy_version 424862 (0.0011) [2023-12-26 02:58:38,118][123091] Updated weights for policy 0, policy_version 424872 (0.0007) [2023-12-26 02:58:38,548][123090] Updated weights for policy 1, policy_version 422153 (0.0007) [2023-12-26 02:58:38,619][123090] Updated weights for policy 1, policy_version 422163 (0.0009) [2023-12-26 02:58:38,671][123090] Updated weights for policy 1, policy_version 422173 (0.0010) [2023-12-26 02:58:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 216850432. Throughput: 0: 8855.7, 1: 8913.6. Samples: 216822788. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 02:58:38,785][121949] Avg episode reward: [(0, '6126.581'), (1, '5585.822')] [2023-12-26 02:58:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000424880_108773376.pth... [2023-12-26 02:58:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000422176_108077056.pth... [2023-12-26 02:58:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000423856_108511232.pth [2023-12-26 02:58:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000421120_107806720.pth [2023-12-26 02:58:39,007][123091] Updated weights for policy 0, policy_version 424882 (0.0010) [2023-12-26 02:58:39,064][123091] Updated weights for policy 0, policy_version 424893 (0.0010) [2023-12-26 02:58:39,121][123091] Updated weights for policy 0, policy_version 424903 (0.0007) [2023-12-26 02:58:39,362][123090] Updated weights for policy 1, policy_version 422183 (0.0008) [2023-12-26 02:58:39,436][123090] Updated weights for policy 1, policy_version 422193 (0.0009) [2023-12-26 02:58:39,494][123090] Updated weights for policy 1, policy_version 422203 (0.0009) [2023-12-26 02:58:39,897][123091] Updated weights for policy 0, policy_version 424913 (0.0006) [2023-12-26 02:58:39,973][123091] Updated weights for policy 0, policy_version 424923 (0.0009) [2023-12-26 02:58:40,035][123091] Updated weights for policy 0, policy_version 424933 (0.0009) [2023-12-26 02:58:40,101][123091] Updated weights for policy 0, policy_version 424943 (0.0009) [2023-12-26 02:58:40,317][123090] Updated weights for policy 1, policy_version 422213 (0.0009) [2023-12-26 02:58:40,381][123090] Updated weights for policy 1, policy_version 422223 (0.0010) [2023-12-26 02:58:40,444][123090] Updated weights for policy 1, policy_version 422233 (0.0009) [2023-12-26 02:58:40,942][123091] Updated weights for policy 0, policy_version 424953 (0.0010) [2023-12-26 02:58:41,000][123091] Updated weights for policy 0, policy_version 424963 (0.0010) [2023-12-26 02:58:41,072][123091] Updated weights for policy 0, policy_version 424973 (0.0009) [2023-12-26 02:58:41,270][123090] Updated weights for policy 1, policy_version 422243 (0.0009) [2023-12-26 02:58:41,344][123090] Updated weights for policy 1, policy_version 422253 (0.0009) [2023-12-26 02:58:41,418][123090] Updated weights for policy 1, policy_version 422263 (0.0009) [2023-12-26 02:58:41,918][123091] Updated weights for policy 0, policy_version 424983 (0.0010) [2023-12-26 02:58:41,966][123091] Updated weights for policy 0, policy_version 424993 (0.0009) [2023-12-26 02:58:42,022][123091] Updated weights for policy 0, policy_version 425003 (0.0006) [2023-12-26 02:58:42,309][123090] Updated weights for policy 1, policy_version 422273 (0.0009) [2023-12-26 02:58:42,390][123090] Updated weights for policy 1, policy_version 422283 (0.0010) [2023-12-26 02:58:42,452][123090] Updated weights for policy 1, policy_version 422293 (0.0010) [2023-12-26 02:58:42,524][123090] Updated weights for policy 1, policy_version 422303 (0.0009) [2023-12-26 02:58:42,759][123091] Updated weights for policy 0, policy_version 425013 (0.0008) [2023-12-26 02:58:42,839][123091] Updated weights for policy 0, policy_version 425024 (0.0010) [2023-12-26 02:58:42,899][123091] Updated weights for policy 0, policy_version 425034 (0.0010) [2023-12-26 02:58:43,357][123090] Updated weights for policy 1, policy_version 422313 (0.0009) [2023-12-26 02:58:43,412][123090] Updated weights for policy 1, policy_version 422323 (0.0009) [2023-12-26 02:58:43,479][123090] Updated weights for policy 1, policy_version 422333 (0.0009) [2023-12-26 02:58:43,705][123091] Updated weights for policy 0, policy_version 425044 (0.0009) [2023-12-26 02:58:43,763][123091] Updated weights for policy 0, policy_version 425054 (0.0010) [2023-12-26 02:58:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 216932352. Throughput: 0: 8819.7, 1: 8928.8. Samples: 216928032. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:58:43,784][121949] Avg episode reward: [(0, '6152.249'), (1, '5404.217')] [2023-12-26 02:58:43,817][123091] Updated weights for policy 0, policy_version 425064 (0.0009) [2023-12-26 02:58:44,319][123090] Updated weights for policy 1, policy_version 422343 (0.0009) [2023-12-26 02:58:44,368][123090] Updated weights for policy 1, policy_version 422354 (0.0010) [2023-12-26 02:58:44,424][123090] Updated weights for policy 1, policy_version 422364 (0.0009) [2023-12-26 02:58:44,563][123091] Updated weights for policy 0, policy_version 425074 (0.0009) [2023-12-26 02:58:44,611][123091] Updated weights for policy 0, policy_version 425084 (0.0009) [2023-12-26 02:58:44,665][123091] Updated weights for policy 0, policy_version 425094 (0.0009) [2023-12-26 02:58:44,717][123091] Updated weights for policy 0, policy_version 425104 (0.0009) [2023-12-26 02:58:45,317][123090] Updated weights for policy 1, policy_version 422374 (0.0010) [2023-12-26 02:58:45,382][123090] Updated weights for policy 1, policy_version 422384 (0.0010) [2023-12-26 02:58:45,448][123090] Updated weights for policy 1, policy_version 422394 (0.0010) [2023-12-26 02:58:45,569][123091] Updated weights for policy 0, policy_version 425114 (0.0010) [2023-12-26 02:58:45,630][123091] Updated weights for policy 0, policy_version 425124 (0.0009) [2023-12-26 02:58:45,690][123091] Updated weights for policy 0, policy_version 425134 (0.0010) [2023-12-26 02:58:46,273][123090] Updated weights for policy 1, policy_version 422404 (0.0009) [2023-12-26 02:58:46,320][123090] Updated weights for policy 1, policy_version 422414 (0.0008) [2023-12-26 02:58:46,376][123090] Updated weights for policy 1, policy_version 422424 (0.0010) [2023-12-26 02:58:46,541][123091] Updated weights for policy 0, policy_version 425144 (0.0009) [2023-12-26 02:58:46,601][123091] Updated weights for policy 0, policy_version 425154 (0.0010) [2023-12-26 02:58:46,661][123091] Updated weights for policy 0, policy_version 425164 (0.0009) [2023-12-26 02:58:47,234][123090] Updated weights for policy 1, policy_version 422434 (0.0009) [2023-12-26 02:58:47,305][123090] Updated weights for policy 1, policy_version 422444 (0.0007) [2023-12-26 02:58:47,376][123090] Updated weights for policy 1, policy_version 422454 (0.0009) [2023-12-26 02:58:47,446][123090] Updated weights for policy 1, policy_version 422464 (0.0010) [2023-12-26 02:58:47,484][123091] Updated weights for policy 0, policy_version 425174 (0.0010) [2023-12-26 02:58:47,542][123091] Updated weights for policy 0, policy_version 425184 (0.0009) [2023-12-26 02:58:47,605][123091] Updated weights for policy 0, policy_version 425194 (0.0010) [2023-12-26 02:58:48,235][123090] Updated weights for policy 1, policy_version 422474 (0.0010) [2023-12-26 02:58:48,296][123090] Updated weights for policy 1, policy_version 422484 (0.0005) [2023-12-26 02:58:48,361][123090] Updated weights for policy 1, policy_version 422494 (0.0007) [2023-12-26 02:58:48,452][123091] Updated weights for policy 0, policy_version 425204 (0.0009) [2023-12-26 02:58:48,507][123091] Updated weights for policy 0, policy_version 425214 (0.0009) [2023-12-26 02:58:48,567][123091] Updated weights for policy 0, policy_version 425224 (0.0009) [2023-12-26 02:58:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 217022464. Throughput: 0: 8815.6, 1: 8870.0. Samples: 217030508. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:58:48,785][121949] Avg episode reward: [(0, '6141.859'), (1, '5548.616')] [2023-12-26 02:58:49,097][123090] Updated weights for policy 1, policy_version 422504 (0.0006) [2023-12-26 02:58:49,149][123090] Updated weights for policy 1, policy_version 422514 (0.0006) [2023-12-26 02:58:49,195][123090] Updated weights for policy 1, policy_version 422524 (0.0005) [2023-12-26 02:58:49,485][123091] Updated weights for policy 0, policy_version 425234 (0.0009) [2023-12-26 02:58:49,560][123091] Updated weights for policy 0, policy_version 425244 (0.0005) [2023-12-26 02:58:49,630][123091] Updated weights for policy 0, policy_version 425254 (0.0007) [2023-12-26 02:58:49,699][123091] Updated weights for policy 0, policy_version 425264 (0.0008) [2023-12-26 02:58:49,990][123090] Updated weights for policy 1, policy_version 422534 (0.0006) [2023-12-26 02:58:50,049][123090] Updated weights for policy 1, policy_version 422544 (0.0006) [2023-12-26 02:58:50,115][123090] Updated weights for policy 1, policy_version 422554 (0.0006) [2023-12-26 02:58:50,486][123091] Updated weights for policy 0, policy_version 425274 (0.0011) [2023-12-26 02:58:50,548][123091] Updated weights for policy 0, policy_version 425284 (0.0011) [2023-12-26 02:58:50,629][123091] Updated weights for policy 0, policy_version 425294 (0.0007) [2023-12-26 02:58:50,813][123090] Updated weights for policy 1, policy_version 422564 (0.0010) [2023-12-26 02:58:50,877][123090] Updated weights for policy 1, policy_version 422574 (0.0011) [2023-12-26 02:58:50,945][123090] Updated weights for policy 1, policy_version 422584 (0.0011) [2023-12-26 02:58:51,311][123091] Updated weights for policy 0, policy_version 425304 (0.0009) [2023-12-26 02:58:51,387][123091] Updated weights for policy 0, policy_version 425315 (0.0013) [2023-12-26 02:58:51,441][123091] Updated weights for policy 0, policy_version 425325 (0.0011) [2023-12-26 02:58:51,760][123090] Updated weights for policy 1, policy_version 422594 (0.0010) [2023-12-26 02:58:51,814][123090] Updated weights for policy 1, policy_version 422604 (0.0009) [2023-12-26 02:58:51,867][123090] Updated weights for policy 1, policy_version 422614 (0.0009) [2023-12-26 02:58:51,919][123090] Updated weights for policy 1, policy_version 422624 (0.0009) [2023-12-26 02:58:52,280][123091] Updated weights for policy 0, policy_version 425335 (0.0010) [2023-12-26 02:58:52,329][123091] Updated weights for policy 0, policy_version 425345 (0.0009) [2023-12-26 02:58:52,404][123091] Updated weights for policy 0, policy_version 425356 (0.0009) [2023-12-26 02:58:52,784][123090] Updated weights for policy 1, policy_version 422634 (0.0009) [2023-12-26 02:58:52,840][123090] Updated weights for policy 1, policy_version 422644 (0.0009) [2023-12-26 02:58:52,891][123090] Updated weights for policy 1, policy_version 422654 (0.0009) [2023-12-26 02:58:53,220][123091] Updated weights for policy 0, policy_version 425366 (0.0009) [2023-12-26 02:58:53,270][123091] Updated weights for policy 0, policy_version 425376 (0.0009) [2023-12-26 02:58:53,319][123091] Updated weights for policy 0, policy_version 425386 (0.0009) [2023-12-26 02:58:53,745][123090] Updated weights for policy 1, policy_version 422664 (0.0009) [2023-12-26 02:58:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 217104384. Throughput: 0: 8781.1, 1: 8950.4. Samples: 217084516. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:58:53,785][121949] Avg episode reward: [(0, '6226.938'), (1, '5566.663')] [2023-12-26 02:58:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000425392_108904448.pth... [2023-12-26 02:58:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000424368_108642304.pth [2023-12-26 02:58:53,819][123090] Updated weights for policy 1, policy_version 422674 (0.0010) [2023-12-26 02:58:53,891][123090] Updated weights for policy 1, policy_version 422684 (0.0009) [2023-12-26 02:58:53,915][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000422688_108208128.pth... [2023-12-26 02:58:53,920][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000421600_107929600.pth [2023-12-26 02:58:54,171][123091] Updated weights for policy 0, policy_version 425396 (0.0008) [2023-12-26 02:58:54,233][123091] Updated weights for policy 0, policy_version 425406 (0.0009) [2023-12-26 02:58:54,296][123091] Updated weights for policy 0, policy_version 425416 (0.0011) [2023-12-26 02:58:54,655][123090] Updated weights for policy 1, policy_version 422694 (0.0008) [2023-12-26 02:58:54,715][123090] Updated weights for policy 1, policy_version 422704 (0.0007) [2023-12-26 02:58:54,779][123090] Updated weights for policy 1, policy_version 422714 (0.0010) [2023-12-26 02:58:55,126][123091] Updated weights for policy 0, policy_version 425426 (0.0009) [2023-12-26 02:58:55,198][123091] Updated weights for policy 0, policy_version 425436 (0.0006) [2023-12-26 02:58:55,267][123091] Updated weights for policy 0, policy_version 425446 (0.0008) [2023-12-26 02:58:55,347][123091] Updated weights for policy 0, policy_version 425456 (0.0005) [2023-12-26 02:58:55,546][123090] Updated weights for policy 1, policy_version 422724 (0.0009) [2023-12-26 02:58:55,596][123090] Updated weights for policy 1, policy_version 422734 (0.0005) [2023-12-26 02:58:55,643][123090] Updated weights for policy 1, policy_version 422744 (0.0005) [2023-12-26 02:58:56,002][123091] Updated weights for policy 0, policy_version 425466 (0.0008) [2023-12-26 02:58:56,067][123091] Updated weights for policy 0, policy_version 425476 (0.0010) [2023-12-26 02:58:56,115][123091] Updated weights for policy 0, policy_version 425486 (0.0009) [2023-12-26 02:58:56,350][123090] Updated weights for policy 1, policy_version 422754 (0.0005) [2023-12-26 02:58:56,408][123090] Updated weights for policy 1, policy_version 422764 (0.0005) [2023-12-26 02:58:56,470][123090] Updated weights for policy 1, policy_version 422774 (0.0005) [2023-12-26 02:58:56,528][123090] Updated weights for policy 1, policy_version 422784 (0.0010) [2023-12-26 02:58:56,911][123091] Updated weights for policy 0, policy_version 425496 (0.0010) [2023-12-26 02:58:56,968][123091] Updated weights for policy 0, policy_version 425506 (0.0010) [2023-12-26 02:58:57,036][123091] Updated weights for policy 0, policy_version 425516 (0.0010) [2023-12-26 02:58:57,192][123090] Updated weights for policy 1, policy_version 422794 (0.0010) [2023-12-26 02:58:57,254][123090] Updated weights for policy 1, policy_version 422804 (0.0010) [2023-12-26 02:58:57,324][123090] Updated weights for policy 1, policy_version 422814 (0.0008) [2023-12-26 02:58:57,738][123091] Updated weights for policy 0, policy_version 425526 (0.0008) [2023-12-26 02:58:57,804][123091] Updated weights for policy 0, policy_version 425536 (0.0008) [2023-12-26 02:58:57,875][123091] Updated weights for policy 0, policy_version 425546 (0.0009) [2023-12-26 02:58:58,030][123090] Updated weights for policy 1, policy_version 422824 (0.0008) [2023-12-26 02:58:58,096][123090] Updated weights for policy 1, policy_version 422834 (0.0009) [2023-12-26 02:58:58,162][123090] Updated weights for policy 1, policy_version 422844 (0.0009) [2023-12-26 02:58:58,710][123091] Updated weights for policy 0, policy_version 425556 (0.0009) [2023-12-26 02:58:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 217194496. Throughput: 0: 8815.1, 1: 9037.3. Samples: 217192820. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:58:58,785][121949] Avg episode reward: [(0, '6138.624'), (1, '5463.122')] [2023-12-26 02:58:58,787][123091] Updated weights for policy 0, policy_version 425566 (0.0009) [2023-12-26 02:58:58,857][123091] Updated weights for policy 0, policy_version 425576 (0.0009) [2023-12-26 02:58:59,016][123090] Updated weights for policy 1, policy_version 422854 (0.0009) [2023-12-26 02:58:59,083][123090] Updated weights for policy 1, policy_version 422864 (0.0009) [2023-12-26 02:58:59,146][123090] Updated weights for policy 1, policy_version 422874 (0.0008) [2023-12-26 02:58:59,688][123091] Updated weights for policy 0, policy_version 425586 (0.0011) [2023-12-26 02:58:59,751][123091] Updated weights for policy 0, policy_version 425596 (0.0011) [2023-12-26 02:58:59,814][123091] Updated weights for policy 0, policy_version 425606 (0.0011) [2023-12-26 02:58:59,881][123091] Updated weights for policy 0, policy_version 425616 (0.0009) [2023-12-26 02:58:59,919][123090] Updated weights for policy 1, policy_version 422884 (0.0009) [2023-12-26 02:58:59,985][123090] Updated weights for policy 1, policy_version 422894 (0.0009) [2023-12-26 02:59:00,039][123090] Updated weights for policy 1, policy_version 422904 (0.0010) [2023-12-26 02:59:00,722][123091] Updated weights for policy 0, policy_version 425626 (0.0010) [2023-12-26 02:59:00,785][123091] Updated weights for policy 0, policy_version 425636 (0.0009) [2023-12-26 02:59:00,850][123091] Updated weights for policy 0, policy_version 425646 (0.0009) [2023-12-26 02:59:00,862][123090] Updated weights for policy 1, policy_version 422914 (0.0009) [2023-12-26 02:59:00,922][123090] Updated weights for policy 1, policy_version 422924 (0.0009) [2023-12-26 02:59:00,980][123090] Updated weights for policy 1, policy_version 422934 (0.0008) [2023-12-26 02:59:01,041][123090] Updated weights for policy 1, policy_version 422944 (0.0008) [2023-12-26 02:59:01,633][123091] Updated weights for policy 0, policy_version 425656 (0.0007) [2023-12-26 02:59:01,696][123091] Updated weights for policy 0, policy_version 425666 (0.0007) [2023-12-26 02:59:01,762][123091] Updated weights for policy 0, policy_version 425676 (0.0009) [2023-12-26 02:59:01,890][123090] Updated weights for policy 1, policy_version 422954 (0.0010) [2023-12-26 02:59:01,951][123090] Updated weights for policy 1, policy_version 422964 (0.0009) [2023-12-26 02:59:01,998][123090] Updated weights for policy 1, policy_version 422974 (0.0008) [2023-12-26 02:59:02,467][123091] Updated weights for policy 0, policy_version 425686 (0.0009) [2023-12-26 02:59:02,534][123091] Updated weights for policy 0, policy_version 425696 (0.0009) [2023-12-26 02:59:02,587][123091] Updated weights for policy 0, policy_version 425706 (0.0009) [2023-12-26 02:59:02,843][123090] Updated weights for policy 1, policy_version 422984 (0.0006) [2023-12-26 02:59:02,904][123090] Updated weights for policy 1, policy_version 422994 (0.0005) [2023-12-26 02:59:02,966][123090] Updated weights for policy 1, policy_version 423004 (0.0005) [2023-12-26 02:59:03,425][123091] Updated weights for policy 0, policy_version 425716 (0.0007) [2023-12-26 02:59:03,490][123091] Updated weights for policy 0, policy_version 425726 (0.0006) [2023-12-26 02:59:03,564][123091] Updated weights for policy 0, policy_version 425736 (0.0005) [2023-12-26 02:59:03,624][123090] Updated weights for policy 1, policy_version 423014 (0.0006) [2023-12-26 02:59:03,677][123090] Updated weights for policy 1, policy_version 423024 (0.0008) [2023-12-26 02:59:03,744][123090] Updated weights for policy 1, policy_version 423034 (0.0009) [2023-12-26 02:59:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 217292800. Throughput: 0: 8804.3, 1: 9070.4. Samples: 217298240. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:03,785][121949] Avg episode reward: [(0, '6110.837'), (1, '5434.853')] [2023-12-26 02:59:04,346][123091] Updated weights for policy 0, policy_version 425746 (0.0010) [2023-12-26 02:59:04,402][123091] Updated weights for policy 0, policy_version 425756 (0.0011) [2023-12-26 02:59:04,458][123091] Updated weights for policy 0, policy_version 425766 (0.0010) [2023-12-26 02:59:04,505][123091] Updated weights for policy 0, policy_version 425776 (0.0010) [2023-12-26 02:59:04,575][123090] Updated weights for policy 1, policy_version 423044 (0.0009) [2023-12-26 02:59:04,627][123090] Updated weights for policy 1, policy_version 423054 (0.0009) [2023-12-26 02:59:04,674][123090] Updated weights for policy 1, policy_version 423064 (0.0009) [2023-12-26 02:59:05,331][123091] Updated weights for policy 0, policy_version 425786 (0.0008) [2023-12-26 02:59:05,379][123091] Updated weights for policy 0, policy_version 425796 (0.0010) [2023-12-26 02:59:05,430][123091] Updated weights for policy 0, policy_version 425806 (0.0010) [2023-12-26 02:59:05,517][123090] Updated weights for policy 1, policy_version 423074 (0.0008) [2023-12-26 02:59:05,567][123090] Updated weights for policy 1, policy_version 423084 (0.0009) [2023-12-26 02:59:05,617][123090] Updated weights for policy 1, policy_version 423095 (0.0009) [2023-12-26 02:59:06,163][123091] Updated weights for policy 0, policy_version 425816 (0.0010) [2023-12-26 02:59:06,220][123091] Updated weights for policy 0, policy_version 425826 (0.0008) [2023-12-26 02:59:06,282][123091] Updated weights for policy 0, policy_version 425836 (0.0009) [2023-12-26 02:59:06,374][123090] Updated weights for policy 1, policy_version 423105 (0.0006) [2023-12-26 02:59:06,438][123090] Updated weights for policy 1, policy_version 423115 (0.0010) [2023-12-26 02:59:06,488][123090] Updated weights for policy 1, policy_version 423125 (0.0006) [2023-12-26 02:59:06,537][123090] Updated weights for policy 1, policy_version 423135 (0.0005) [2023-12-26 02:59:07,063][123091] Updated weights for policy 0, policy_version 425846 (0.0010) [2023-12-26 02:59:07,126][123091] Updated weights for policy 0, policy_version 425856 (0.0011) [2023-12-26 02:59:07,192][123091] Updated weights for policy 0, policy_version 425866 (0.0011) [2023-12-26 02:59:07,306][123090] Updated weights for policy 1, policy_version 423145 (0.0009) [2023-12-26 02:59:07,361][123090] Updated weights for policy 1, policy_version 423155 (0.0011) [2023-12-26 02:59:07,412][123090] Updated weights for policy 1, policy_version 423165 (0.0008) [2023-12-26 02:59:07,870][123091] Updated weights for policy 0, policy_version 425876 (0.0008) [2023-12-26 02:59:07,930][123091] Updated weights for policy 0, policy_version 425886 (0.0005) [2023-12-26 02:59:07,984][123091] Updated weights for policy 0, policy_version 425896 (0.0005) [2023-12-26 02:59:08,232][123090] Updated weights for policy 1, policy_version 423175 (0.0008) [2023-12-26 02:59:08,293][123090] Updated weights for policy 1, policy_version 423185 (0.0009) [2023-12-26 02:59:08,348][123090] Updated weights for policy 1, policy_version 423195 (0.0009) [2023-12-26 02:59:08,684][123091] Updated weights for policy 0, policy_version 425906 (0.0006) [2023-12-26 02:59:08,736][123091] Updated weights for policy 0, policy_version 425916 (0.0009) [2023-12-26 02:59:08,784][123091] Updated weights for policy 0, policy_version 425926 (0.0010) [2023-12-26 02:59:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 217374720. Throughput: 0: 8819.7, 1: 9074.4. Samples: 217352492. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:08,785][121949] Avg episode reward: [(0, '6102.666'), (1, '5321.127')] [2023-12-26 02:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000423200_108339200.pth... [2023-12-26 02:59:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000422176_108077056.pth [2023-12-26 02:59:08,836][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000425936_109043712.pth... [2023-12-26 02:59:08,839][123091] Updated weights for policy 0, policy_version 425936 (0.0010) [2023-12-26 02:59:08,839][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000424880_108773376.pth [2023-12-26 02:59:09,134][123090] Updated weights for policy 1, policy_version 423205 (0.0008) [2023-12-26 02:59:09,196][123090] Updated weights for policy 1, policy_version 423215 (0.0009) [2023-12-26 02:59:09,259][123090] Updated weights for policy 1, policy_version 423225 (0.0009) [2023-12-26 02:59:09,725][123091] Updated weights for policy 0, policy_version 425946 (0.0011) [2023-12-26 02:59:09,780][123091] Updated weights for policy 0, policy_version 425956 (0.0011) [2023-12-26 02:59:09,850][123091] Updated weights for policy 0, policy_version 425966 (0.0013) [2023-12-26 02:59:10,124][123090] Updated weights for policy 1, policy_version 423235 (0.0009) [2023-12-26 02:59:10,187][123090] Updated weights for policy 1, policy_version 423245 (0.0009) [2023-12-26 02:59:10,246][123090] Updated weights for policy 1, policy_version 423255 (0.0010) [2023-12-26 02:59:10,614][123091] Updated weights for policy 0, policy_version 425976 (0.0006) [2023-12-26 02:59:10,686][123091] Updated weights for policy 0, policy_version 425986 (0.0005) [2023-12-26 02:59:10,749][123091] Updated weights for policy 0, policy_version 425996 (0.0005) [2023-12-26 02:59:11,056][123090] Updated weights for policy 1, policy_version 423265 (0.0009) [2023-12-26 02:59:11,132][123090] Updated weights for policy 1, policy_version 423275 (0.0008) [2023-12-26 02:59:11,192][123090] Updated weights for policy 1, policy_version 423285 (0.0009) [2023-12-26 02:59:11,252][123090] Updated weights for policy 1, policy_version 423295 (0.0009) [2023-12-26 02:59:11,485][123091] Updated weights for policy 0, policy_version 426006 (0.0007) [2023-12-26 02:59:11,548][123091] Updated weights for policy 0, policy_version 426016 (0.0009) [2023-12-26 02:59:11,621][123091] Updated weights for policy 0, policy_version 426026 (0.0009) [2023-12-26 02:59:12,100][123090] Updated weights for policy 1, policy_version 423305 (0.0010) [2023-12-26 02:59:12,152][123090] Updated weights for policy 1, policy_version 423315 (0.0010) [2023-12-26 02:59:12,204][123090] Updated weights for policy 1, policy_version 423325 (0.0010) [2023-12-26 02:59:12,462][123091] Updated weights for policy 0, policy_version 426036 (0.0009) [2023-12-26 02:59:12,526][123091] Updated weights for policy 0, policy_version 426046 (0.0009) [2023-12-26 02:59:12,588][123091] Updated weights for policy 0, policy_version 426056 (0.0008) [2023-12-26 02:59:13,037][123090] Updated weights for policy 1, policy_version 423335 (0.0010) [2023-12-26 02:59:13,096][123090] Updated weights for policy 1, policy_version 423345 (0.0010) [2023-12-26 02:59:13,159][123090] Updated weights for policy 1, policy_version 423355 (0.0010) [2023-12-26 02:59:13,434][123091] Updated weights for policy 0, policy_version 426066 (0.0009) [2023-12-26 02:59:13,493][123091] Updated weights for policy 0, policy_version 426076 (0.0009) [2023-12-26 02:59:13,560][123091] Updated weights for policy 0, policy_version 426086 (0.0009) [2023-12-26 02:59:13,632][123091] Updated weights for policy 0, policy_version 426096 (0.0009) [2023-12-26 02:59:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 217464832. Throughput: 0: 8827.8, 1: 9054.8. Samples: 217458600. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:13,785][121949] Avg episode reward: [(0, '6110.129'), (1, '5394.606')] [2023-12-26 02:59:13,840][123090] Updated weights for policy 1, policy_version 423365 (0.0008) [2023-12-26 02:59:13,908][123090] Updated weights for policy 1, policy_version 423375 (0.0005) [2023-12-26 02:59:13,982][123090] Updated weights for policy 1, policy_version 423385 (0.0005) [2023-12-26 02:59:14,480][123091] Updated weights for policy 0, policy_version 426106 (0.0010) [2023-12-26 02:59:14,550][123091] Updated weights for policy 0, policy_version 426116 (0.0009) [2023-12-26 02:59:14,615][123091] Updated weights for policy 0, policy_version 426126 (0.0009) [2023-12-26 02:59:14,695][123090] Updated weights for policy 1, policy_version 423395 (0.0007) [2023-12-26 02:59:14,764][123090] Updated weights for policy 1, policy_version 423405 (0.0006) [2023-12-26 02:59:14,831][123090] Updated weights for policy 1, policy_version 423415 (0.0007) [2023-12-26 02:59:15,389][123090] Updated weights for policy 1, policy_version 423425 (0.0005) [2023-12-26 02:59:15,457][123090] Updated weights for policy 1, policy_version 423435 (0.0009) [2023-12-26 02:59:15,516][123091] Updated weights for policy 0, policy_version 426136 (0.0008) [2023-12-26 02:59:15,522][123090] Updated weights for policy 1, policy_version 423445 (0.0011) [2023-12-26 02:59:15,584][123091] Updated weights for policy 0, policy_version 426146 (0.0006) [2023-12-26 02:59:15,590][123090] Updated weights for policy 1, policy_version 423455 (0.0011) [2023-12-26 02:59:15,639][123091] Updated weights for policy 0, policy_version 426156 (0.0008) [2023-12-26 02:59:16,286][123090] Updated weights for policy 1, policy_version 423465 (0.0006) [2023-12-26 02:59:16,331][123090] Updated weights for policy 1, policy_version 423475 (0.0005) [2023-12-26 02:59:16,383][123090] Updated weights for policy 1, policy_version 423485 (0.0005) [2023-12-26 02:59:16,495][123091] Updated weights for policy 0, policy_version 426166 (0.0010) [2023-12-26 02:59:16,549][123091] Updated weights for policy 0, policy_version 426176 (0.0010) [2023-12-26 02:59:16,602][123091] Updated weights for policy 0, policy_version 426186 (0.0009) [2023-12-26 02:59:17,078][123090] Updated weights for policy 1, policy_version 423495 (0.0005) [2023-12-26 02:59:17,133][123090] Updated weights for policy 1, policy_version 423505 (0.0005) [2023-12-26 02:59:17,192][123090] Updated weights for policy 1, policy_version 423515 (0.0005) [2023-12-26 02:59:17,548][123091] Updated weights for policy 0, policy_version 426196 (0.0010) [2023-12-26 02:59:17,611][123091] Updated weights for policy 0, policy_version 426206 (0.0010) [2023-12-26 02:59:17,665][123091] Updated weights for policy 0, policy_version 426217 (0.0010) [2023-12-26 02:59:17,820][123090] Updated weights for policy 1, policy_version 423525 (0.0006) [2023-12-26 02:59:17,883][123090] Updated weights for policy 1, policy_version 423535 (0.0008) [2023-12-26 02:59:17,946][123090] Updated weights for policy 1, policy_version 423545 (0.0010) [2023-12-26 02:59:18,546][123091] Updated weights for policy 0, policy_version 426227 (0.0010) [2023-12-26 02:59:18,611][123091] Updated weights for policy 0, policy_version 426237 (0.0009) [2023-12-26 02:59:18,678][123091] Updated weights for policy 0, policy_version 426247 (0.0009) [2023-12-26 02:59:18,700][123090] Updated weights for policy 1, policy_version 423555 (0.0009) [2023-12-26 02:59:18,759][123090] Updated weights for policy 1, policy_version 423565 (0.0010) [2023-12-26 02:59:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 217554944. Throughput: 0: 8694.3, 1: 9078.0. Samples: 217566692. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:18,784][121949] Avg episode reward: [(0, '6139.978'), (1, '5602.640')] [2023-12-26 02:59:18,831][123090] Updated weights for policy 1, policy_version 423575 (0.0010) [2023-12-26 02:59:19,538][123091] Updated weights for policy 0, policy_version 426257 (0.0008) [2023-12-26 02:59:19,599][123091] Updated weights for policy 0, policy_version 426267 (0.0009) [2023-12-26 02:59:19,608][123090] Updated weights for policy 1, policy_version 423585 (0.0010) [2023-12-26 02:59:19,663][123091] Updated weights for policy 0, policy_version 426277 (0.0007) [2023-12-26 02:59:19,670][123090] Updated weights for policy 1, policy_version 423595 (0.0010) [2023-12-26 02:59:19,726][123091] Updated weights for policy 0, policy_version 426287 (0.0008) [2023-12-26 02:59:19,727][123090] Updated weights for policy 1, policy_version 423605 (0.0008) [2023-12-26 02:59:19,794][123090] Updated weights for policy 1, policy_version 423615 (0.0010) [2023-12-26 02:59:20,562][123091] Updated weights for policy 0, policy_version 426297 (0.0008) [2023-12-26 02:59:20,591][123090] Updated weights for policy 1, policy_version 423625 (0.0008) [2023-12-26 02:59:20,632][123091] Updated weights for policy 0, policy_version 426307 (0.0009) [2023-12-26 02:59:20,648][123090] Updated weights for policy 1, policy_version 423635 (0.0008) [2023-12-26 02:59:20,694][123091] Updated weights for policy 0, policy_version 426317 (0.0007) [2023-12-26 02:59:20,709][123090] Updated weights for policy 1, policy_version 423645 (0.0008) [2023-12-26 02:59:21,494][123091] Updated weights for policy 0, policy_version 426327 (0.0009) [2023-12-26 02:59:21,560][123091] Updated weights for policy 0, policy_version 426337 (0.0009) [2023-12-26 02:59:21,624][123091] Updated weights for policy 0, policy_version 426347 (0.0009) [2023-12-26 02:59:21,642][123090] Updated weights for policy 1, policy_version 423655 (0.0009) [2023-12-26 02:59:21,714][123090] Updated weights for policy 1, policy_version 423665 (0.0010) [2023-12-26 02:59:21,777][123090] Updated weights for policy 1, policy_version 423675 (0.0009) [2023-12-26 02:59:22,404][123091] Updated weights for policy 0, policy_version 426357 (0.0008) [2023-12-26 02:59:22,456][123091] Updated weights for policy 0, policy_version 426367 (0.0006) [2023-12-26 02:59:22,526][123091] Updated weights for policy 0, policy_version 426377 (0.0006) [2023-12-26 02:59:22,682][123090] Updated weights for policy 1, policy_version 423685 (0.0008) [2023-12-26 02:59:22,737][123090] Updated weights for policy 1, policy_version 423695 (0.0008) [2023-12-26 02:59:22,795][123090] Updated weights for policy 1, policy_version 423705 (0.0007) [2023-12-26 02:59:23,301][123091] Updated weights for policy 0, policy_version 426387 (0.0008) [2023-12-26 02:59:23,359][123091] Updated weights for policy 0, policy_version 426397 (0.0005) [2023-12-26 02:59:23,405][123091] Updated weights for policy 0, policy_version 426407 (0.0008) [2023-12-26 02:59:23,683][123090] Updated weights for policy 1, policy_version 423715 (0.0009) [2023-12-26 02:59:23,741][123090] Updated weights for policy 1, policy_version 423725 (0.0007) [2023-12-26 02:59:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 217636864. Throughput: 0: 8671.0, 1: 8989.9. Samples: 217617528. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:23,785][121949] Avg episode reward: [(0, '6188.631'), (1, '5657.533')] [2023-12-26 02:59:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000426416_109166592.pth... [2023-12-26 02:59:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000425392_108904448.pth [2023-12-26 02:59:23,798][123090] Updated weights for policy 1, policy_version 423735 (0.0005) [2023-12-26 02:59:23,850][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000423744_108478464.pth... [2023-12-26 02:59:23,853][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000422688_108208128.pth [2023-12-26 02:59:24,089][123091] Updated weights for policy 0, policy_version 426417 (0.0006) [2023-12-26 02:59:24,147][123091] Updated weights for policy 0, policy_version 426427 (0.0005) [2023-12-26 02:59:24,198][123091] Updated weights for policy 0, policy_version 426437 (0.0005) [2023-12-26 02:59:24,251][123091] Updated weights for policy 0, policy_version 426447 (0.0009) [2023-12-26 02:59:24,477][123090] Updated weights for policy 1, policy_version 423745 (0.0006) [2023-12-26 02:59:24,546][123090] Updated weights for policy 1, policy_version 423755 (0.0007) [2023-12-26 02:59:24,617][123090] Updated weights for policy 1, policy_version 423765 (0.0007) [2023-12-26 02:59:24,678][123090] Updated weights for policy 1, policy_version 423775 (0.0007) [2023-12-26 02:59:25,084][123091] Updated weights for policy 0, policy_version 426457 (0.0011) [2023-12-26 02:59:25,158][123091] Updated weights for policy 0, policy_version 426467 (0.0010) [2023-12-26 02:59:25,216][123091] Updated weights for policy 0, policy_version 426477 (0.0010) [2023-12-26 02:59:25,300][123090] Updated weights for policy 1, policy_version 423785 (0.0010) [2023-12-26 02:59:25,352][123090] Updated weights for policy 1, policy_version 423795 (0.0010) [2023-12-26 02:59:25,396][123090] Updated weights for policy 1, policy_version 423805 (0.0010) [2023-12-26 02:59:26,032][123091] Updated weights for policy 0, policy_version 426487 (0.0011) [2023-12-26 02:59:26,091][123091] Updated weights for policy 0, policy_version 426497 (0.0011) [2023-12-26 02:59:26,150][123091] Updated weights for policy 0, policy_version 426507 (0.0011) [2023-12-26 02:59:26,195][123090] Updated weights for policy 1, policy_version 423815 (0.0009) [2023-12-26 02:59:26,250][123090] Updated weights for policy 1, policy_version 423825 (0.0008) [2023-12-26 02:59:26,302][123090] Updated weights for policy 1, policy_version 423835 (0.0008) [2023-12-26 02:59:26,985][123091] Updated weights for policy 0, policy_version 426517 (0.0011) [2023-12-26 02:59:27,042][123091] Updated weights for policy 0, policy_version 426527 (0.0010) [2023-12-26 02:59:27,090][123090] Updated weights for policy 1, policy_version 423845 (0.0007) [2023-12-26 02:59:27,101][123091] Updated weights for policy 0, policy_version 426537 (0.0010) [2023-12-26 02:59:27,149][123090] Updated weights for policy 1, policy_version 423855 (0.0006) [2023-12-26 02:59:27,198][123090] Updated weights for policy 1, policy_version 423865 (0.0005) [2023-12-26 02:59:27,816][123091] Updated weights for policy 0, policy_version 426547 (0.0011) [2023-12-26 02:59:27,871][123091] Updated weights for policy 0, policy_version 426557 (0.0011) [2023-12-26 02:59:27,916][123090] Updated weights for policy 1, policy_version 423875 (0.0006) [2023-12-26 02:59:27,919][123091] Updated weights for policy 0, policy_version 426567 (0.0010) [2023-12-26 02:59:27,985][123090] Updated weights for policy 1, policy_version 423885 (0.0008) [2023-12-26 02:59:28,052][123090] Updated weights for policy 1, policy_version 423895 (0.0009) [2023-12-26 02:59:28,635][123091] Updated weights for policy 0, policy_version 426577 (0.0010) [2023-12-26 02:59:28,700][123091] Updated weights for policy 0, policy_version 426587 (0.0006) [2023-12-26 02:59:28,726][123090] Updated weights for policy 1, policy_version 423905 (0.0009) [2023-12-26 02:59:28,755][123091] Updated weights for policy 0, policy_version 426597 (0.0007) [2023-12-26 02:59:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 217726976. Throughput: 0: 8726.1, 1: 9021.8. Samples: 217726688. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:28,785][121949] Avg episode reward: [(0, '6178.179'), (1, '5506.169')] [2023-12-26 02:59:28,799][123090] Updated weights for policy 1, policy_version 423915 (0.0007) [2023-12-26 02:59:28,818][123091] Updated weights for policy 0, policy_version 426607 (0.0007) [2023-12-26 02:59:28,863][123090] Updated weights for policy 1, policy_version 423925 (0.0010) [2023-12-26 02:59:28,919][123090] Updated weights for policy 1, policy_version 423935 (0.0009) [2023-12-26 02:59:29,546][123091] Updated weights for policy 0, policy_version 426617 (0.0009) [2023-12-26 02:59:29,614][123091] Updated weights for policy 0, policy_version 426627 (0.0009) [2023-12-26 02:59:29,667][123091] Updated weights for policy 0, policy_version 426637 (0.0008) [2023-12-26 02:59:29,674][123090] Updated weights for policy 1, policy_version 423945 (0.0006) [2023-12-26 02:59:29,729][123090] Updated weights for policy 1, policy_version 423955 (0.0005) [2023-12-26 02:59:29,790][123090] Updated weights for policy 1, policy_version 423965 (0.0005) [2023-12-26 02:59:30,403][123091] Updated weights for policy 0, policy_version 426647 (0.0007) [2023-12-26 02:59:30,456][123091] Updated weights for policy 0, policy_version 426657 (0.0009) [2023-12-26 02:59:30,512][123091] Updated weights for policy 0, policy_version 426667 (0.0009) [2023-12-26 02:59:30,588][123090] Updated weights for policy 1, policy_version 423975 (0.0009) [2023-12-26 02:59:30,651][123090] Updated weights for policy 1, policy_version 423985 (0.0010) [2023-12-26 02:59:30,705][123090] Updated weights for policy 1, policy_version 423995 (0.0010) [2023-12-26 02:59:31,357][123091] Updated weights for policy 0, policy_version 426677 (0.0010) [2023-12-26 02:59:31,423][123091] Updated weights for policy 0, policy_version 426687 (0.0010) [2023-12-26 02:59:31,457][123090] Updated weights for policy 1, policy_version 424005 (0.0010) [2023-12-26 02:59:31,472][123091] Updated weights for policy 0, policy_version 426697 (0.0010) [2023-12-26 02:59:31,516][123090] Updated weights for policy 1, policy_version 424015 (0.0010) [2023-12-26 02:59:31,563][123090] Updated weights for policy 1, policy_version 424025 (0.0010) [2023-12-26 02:59:32,215][123090] Updated weights for policy 1, policy_version 424035 (0.0005) [2023-12-26 02:59:32,263][123091] Updated weights for policy 0, policy_version 426707 (0.0010) [2023-12-26 02:59:32,272][123090] Updated weights for policy 1, policy_version 424045 (0.0008) [2023-12-26 02:59:32,320][123090] Updated weights for policy 1, policy_version 424055 (0.0010) [2023-12-26 02:59:32,324][123091] Updated weights for policy 0, policy_version 426717 (0.0006) [2023-12-26 02:59:32,396][123091] Updated weights for policy 0, policy_version 426727 (0.0010) [2023-12-26 02:59:33,111][123091] Updated weights for policy 0, policy_version 426737 (0.0010) [2023-12-26 02:59:33,115][123090] Updated weights for policy 1, policy_version 424065 (0.0010) [2023-12-26 02:59:33,165][123091] Updated weights for policy 0, policy_version 426747 (0.0007) [2023-12-26 02:59:33,181][123090] Updated weights for policy 1, policy_version 424075 (0.0009) [2023-12-26 02:59:33,221][123091] Updated weights for policy 0, policy_version 426757 (0.0007) [2023-12-26 02:59:33,244][123090] Updated weights for policy 1, policy_version 424085 (0.0007) [2023-12-26 02:59:33,269][123091] Updated weights for policy 0, policy_version 426767 (0.0007) [2023-12-26 02:59:33,306][123090] Updated weights for policy 1, policy_version 424095 (0.0005) [2023-12-26 02:59:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 217825280. Throughput: 0: 8822.9, 1: 9137.2. Samples: 217838716. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:33,785][121949] Avg episode reward: [(0, '6099.875'), (1, '5586.658')] [2023-12-26 02:59:33,958][123091] Updated weights for policy 0, policy_version 426777 (0.0006) [2023-12-26 02:59:33,989][123090] Updated weights for policy 1, policy_version 424105 (0.0007) [2023-12-26 02:59:34,013][123091] Updated weights for policy 0, policy_version 426787 (0.0006) [2023-12-26 02:59:34,058][123090] Updated weights for policy 1, policy_version 424115 (0.0005) [2023-12-26 02:59:34,067][123091] Updated weights for policy 0, policy_version 426797 (0.0006) [2023-12-26 02:59:34,115][123090] Updated weights for policy 1, policy_version 424125 (0.0005) [2023-12-26 02:59:34,869][123091] Updated weights for policy 0, policy_version 426807 (0.0008) [2023-12-26 02:59:34,910][123090] Updated weights for policy 1, policy_version 424135 (0.0009) [2023-12-26 02:59:34,934][123091] Updated weights for policy 0, policy_version 426817 (0.0007) [2023-12-26 02:59:34,973][123090] Updated weights for policy 1, policy_version 424145 (0.0010) [2023-12-26 02:59:34,993][123091] Updated weights for policy 0, policy_version 426827 (0.0006) [2023-12-26 02:59:35,029][123090] Updated weights for policy 1, policy_version 424155 (0.0010) [2023-12-26 02:59:35,795][123091] Updated weights for policy 0, policy_version 426837 (0.0010) [2023-12-26 02:59:35,849][123090] Updated weights for policy 1, policy_version 424165 (0.0010) [2023-12-26 02:59:35,857][123091] Updated weights for policy 0, policy_version 426847 (0.0008) [2023-12-26 02:59:35,912][123090] Updated weights for policy 1, policy_version 424175 (0.0010) [2023-12-26 02:59:35,916][123091] Updated weights for policy 0, policy_version 426857 (0.0010) [2023-12-26 02:59:35,970][123090] Updated weights for policy 1, policy_version 424185 (0.0010) [2023-12-26 02:59:36,759][123091] Updated weights for policy 0, policy_version 426867 (0.0008) [2023-12-26 02:59:36,811][123090] Updated weights for policy 1, policy_version 424195 (0.0009) [2023-12-26 02:59:36,828][123091] Updated weights for policy 0, policy_version 426877 (0.0011) [2023-12-26 02:59:36,885][123090] Updated weights for policy 1, policy_version 424205 (0.0006) [2023-12-26 02:59:36,889][123091] Updated weights for policy 0, policy_version 426887 (0.0010) [2023-12-26 02:59:36,950][123090] Updated weights for policy 1, policy_version 424215 (0.0005) [2023-12-26 02:59:37,537][123091] Updated weights for policy 0, policy_version 426897 (0.0006) [2023-12-26 02:59:37,597][123091] Updated weights for policy 0, policy_version 426907 (0.0011) [2023-12-26 02:59:37,654][123091] Updated weights for policy 0, policy_version 426917 (0.0011) [2023-12-26 02:59:37,671][123090] Updated weights for policy 1, policy_version 424225 (0.0006) [2023-12-26 02:59:37,715][123091] Updated weights for policy 0, policy_version 426927 (0.0011) [2023-12-26 02:59:37,737][123090] Updated weights for policy 1, policy_version 424235 (0.0007) [2023-12-26 02:59:37,790][123090] Updated weights for policy 1, policy_version 424245 (0.0008) [2023-12-26 02:59:37,856][123090] Updated weights for policy 1, policy_version 424255 (0.0009) [2023-12-26 02:59:38,500][123091] Updated weights for policy 0, policy_version 426937 (0.0011) [2023-12-26 02:59:38,547][123091] Updated weights for policy 0, policy_version 426947 (0.0010) [2023-12-26 02:59:38,595][123091] Updated weights for policy 0, policy_version 426957 (0.0010) [2023-12-26 02:59:38,704][123090] Updated weights for policy 1, policy_version 424265 (0.0009) [2023-12-26 02:59:38,772][123090] Updated weights for policy 1, policy_version 424275 (0.0008) [2023-12-26 02:59:38,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 217915392. Throughput: 0: 8839.3, 1: 9095.6. Samples: 217891588. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:38,785][121949] Avg episode reward: [(0, '6193.507'), (1, '5766.706')] [2023-12-26 02:59:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000426960_109305856.pth... [2023-12-26 02:59:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000425936_109043712.pth [2023-12-26 02:59:38,840][123090] Updated weights for policy 1, policy_version 424285 (0.0009) [2023-12-26 02:59:38,857][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000424288_108617728.pth... [2023-12-26 02:59:38,862][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000423200_108339200.pth [2023-12-26 02:59:39,460][123091] Updated weights for policy 0, policy_version 426967 (0.0011) [2023-12-26 02:59:39,530][123091] Updated weights for policy 0, policy_version 426977 (0.0011) [2023-12-26 02:59:39,603][123091] Updated weights for policy 0, policy_version 426987 (0.0011) [2023-12-26 02:59:39,703][123090] Updated weights for policy 1, policy_version 424295 (0.0007) [2023-12-26 02:59:39,773][123090] Updated weights for policy 1, policy_version 424305 (0.0009) [2023-12-26 02:59:39,842][123090] Updated weights for policy 1, policy_version 424315 (0.0009) [2023-12-26 02:59:40,353][123091] Updated weights for policy 0, policy_version 426997 (0.0008) [2023-12-26 02:59:40,404][123091] Updated weights for policy 0, policy_version 427007 (0.0008) [2023-12-26 02:59:40,455][123091] Updated weights for policy 0, policy_version 427017 (0.0008) [2023-12-26 02:59:40,691][123090] Updated weights for policy 1, policy_version 424325 (0.0009) [2023-12-26 02:59:40,748][123090] Updated weights for policy 1, policy_version 424335 (0.0009) [2023-12-26 02:59:40,803][123090] Updated weights for policy 1, policy_version 424345 (0.0009) [2023-12-26 02:59:41,219][123091] Updated weights for policy 0, policy_version 427027 (0.0007) [2023-12-26 02:59:41,291][123091] Updated weights for policy 0, policy_version 427037 (0.0008) [2023-12-26 02:59:41,355][123091] Updated weights for policy 0, policy_version 427047 (0.0008) [2023-12-26 02:59:41,673][123090] Updated weights for policy 1, policy_version 424355 (0.0009) [2023-12-26 02:59:41,755][123090] Updated weights for policy 1, policy_version 424365 (0.0010) [2023-12-26 02:59:41,819][123090] Updated weights for policy 1, policy_version 424375 (0.0009) [2023-12-26 02:59:42,143][123091] Updated weights for policy 0, policy_version 427057 (0.0009) [2023-12-26 02:59:42,209][123091] Updated weights for policy 0, policy_version 427067 (0.0008) [2023-12-26 02:59:42,276][123091] Updated weights for policy 0, policy_version 427077 (0.0011) [2023-12-26 02:59:42,340][123091] Updated weights for policy 0, policy_version 427087 (0.0008) [2023-12-26 02:59:42,726][123090] Updated weights for policy 1, policy_version 424385 (0.0009) [2023-12-26 02:59:42,790][123090] Updated weights for policy 1, policy_version 424395 (0.0009) [2023-12-26 02:59:42,851][123090] Updated weights for policy 1, policy_version 424405 (0.0009) [2023-12-26 02:59:42,917][123090] Updated weights for policy 1, policy_version 424415 (0.0009) [2023-12-26 02:59:43,042][123091] Updated weights for policy 0, policy_version 427097 (0.0006) [2023-12-26 02:59:43,090][123091] Updated weights for policy 0, policy_version 427107 (0.0006) [2023-12-26 02:59:43,148][123091] Updated weights for policy 0, policy_version 427117 (0.0006) [2023-12-26 02:59:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 217997312. Throughput: 0: 8861.9, 1: 8991.7. Samples: 217996228. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:43,785][121949] Avg episode reward: [(0, '6248.424'), (1, '5543.378')] [2023-12-26 02:59:43,801][123090] Updated weights for policy 1, policy_version 424425 (0.0006) [2023-12-26 02:59:43,834][123091] Updated weights for policy 0, policy_version 427127 (0.0007) [2023-12-26 02:59:43,871][123090] Updated weights for policy 1, policy_version 424435 (0.0005) [2023-12-26 02:59:43,882][123091] Updated weights for policy 0, policy_version 427137 (0.0009) [2023-12-26 02:59:43,931][123091] Updated weights for policy 0, policy_version 427148 (0.0009) [2023-12-26 02:59:43,936][123090] Updated weights for policy 1, policy_version 424445 (0.0005) [2023-12-26 02:59:44,608][123090] Updated weights for policy 1, policy_version 424455 (0.0008) [2023-12-26 02:59:44,666][123090] Updated weights for policy 1, policy_version 424465 (0.0009) [2023-12-26 02:59:44,718][123090] Updated weights for policy 1, policy_version 424475 (0.0008) [2023-12-26 02:59:44,799][123091] Updated weights for policy 0, policy_version 427158 (0.0009) [2023-12-26 02:59:44,859][123091] Updated weights for policy 0, policy_version 427168 (0.0009) [2023-12-26 02:59:44,922][123091] Updated weights for policy 0, policy_version 427178 (0.0010) [2023-12-26 02:59:45,578][123090] Updated weights for policy 1, policy_version 424485 (0.0010) [2023-12-26 02:59:45,646][123090] Updated weights for policy 1, policy_version 424495 (0.0009) [2023-12-26 02:59:45,712][123090] Updated weights for policy 1, policy_version 424505 (0.0010) [2023-12-26 02:59:45,767][123091] Updated weights for policy 0, policy_version 427188 (0.0009) [2023-12-26 02:59:45,821][123091] Updated weights for policy 0, policy_version 427198 (0.0007) [2023-12-26 02:59:45,877][123091] Updated weights for policy 0, policy_version 427208 (0.0009) [2023-12-26 02:59:46,537][123090] Updated weights for policy 1, policy_version 424515 (0.0010) [2023-12-26 02:59:46,587][123090] Updated weights for policy 1, policy_version 424525 (0.0009) [2023-12-26 02:59:46,643][123090] Updated weights for policy 1, policy_version 424535 (0.0009) [2023-12-26 02:59:46,698][123091] Updated weights for policy 0, policy_version 427218 (0.0008) [2023-12-26 02:59:46,746][123091] Updated weights for policy 0, policy_version 427228 (0.0009) [2023-12-26 02:59:46,804][123091] Updated weights for policy 0, policy_version 427239 (0.0010) [2023-12-26 02:59:47,512][123090] Updated weights for policy 1, policy_version 424545 (0.0009) [2023-12-26 02:59:47,571][123090] Updated weights for policy 1, policy_version 424555 (0.0009) [2023-12-26 02:59:47,587][123091] Updated weights for policy 0, policy_version 427249 (0.0010) [2023-12-26 02:59:47,623][123090] Updated weights for policy 1, policy_version 424565 (0.0009) [2023-12-26 02:59:47,637][123091] Updated weights for policy 0, policy_version 427259 (0.0006) [2023-12-26 02:59:47,673][123090] Updated weights for policy 1, policy_version 424575 (0.0008) [2023-12-26 02:59:47,698][123091] Updated weights for policy 0, policy_version 427269 (0.0009) [2023-12-26 02:59:47,757][123091] Updated weights for policy 0, policy_version 427279 (0.0007) [2023-12-26 02:59:48,530][123090] Updated weights for policy 1, policy_version 424585 (0.0009) [2023-12-26 02:59:48,573][123091] Updated weights for policy 0, policy_version 427289 (0.0007) [2023-12-26 02:59:48,591][123090] Updated weights for policy 1, policy_version 424595 (0.0008) [2023-12-26 02:59:48,635][123091] Updated weights for policy 0, policy_version 427299 (0.0009) [2023-12-26 02:59:48,655][123090] Updated weights for policy 1, policy_version 424605 (0.0009) [2023-12-26 02:59:48,700][123091] Updated weights for policy 0, policy_version 427309 (0.0009) [2023-12-26 02:59:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 218095616. Throughput: 0: 8898.1, 1: 8935.6. Samples: 218100756. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:48,785][121949] Avg episode reward: [(0, '6243.391'), (1, '5560.514')] [2023-12-26 02:59:49,532][123090] Updated weights for policy 1, policy_version 424615 (0.0009) [2023-12-26 02:59:49,536][123091] Updated weights for policy 0, policy_version 427319 (0.0007) [2023-12-26 02:59:49,598][123090] Updated weights for policy 1, policy_version 424625 (0.0008) [2023-12-26 02:59:49,599][123091] Updated weights for policy 0, policy_version 427329 (0.0007) [2023-12-26 02:59:49,666][123090] Updated weights for policy 1, policy_version 424635 (0.0007) [2023-12-26 02:59:49,668][123091] Updated weights for policy 0, policy_version 427339 (0.0008) [2023-12-26 02:59:50,462][123091] Updated weights for policy 0, policy_version 427349 (0.0009) [2023-12-26 02:59:50,481][123090] Updated weights for policy 1, policy_version 424645 (0.0008) [2023-12-26 02:59:50,515][123091] Updated weights for policy 0, policy_version 427359 (0.0007) [2023-12-26 02:59:50,541][123090] Updated weights for policy 1, policy_version 424655 (0.0010) [2023-12-26 02:59:50,575][123091] Updated weights for policy 0, policy_version 427369 (0.0009) [2023-12-26 02:59:50,609][123090] Updated weights for policy 1, policy_version 424665 (0.0008) [2023-12-26 02:59:51,391][123091] Updated weights for policy 0, policy_version 427379 (0.0011) [2023-12-26 02:59:51,449][123091] Updated weights for policy 0, policy_version 427389 (0.0006) [2023-12-26 02:59:51,497][123090] Updated weights for policy 1, policy_version 424675 (0.0008) [2023-12-26 02:59:51,504][123091] Updated weights for policy 0, policy_version 427399 (0.0007) [2023-12-26 02:59:51,560][123090] Updated weights for policy 1, policy_version 424685 (0.0009) [2023-12-26 02:59:51,631][123090] Updated weights for policy 1, policy_version 424695 (0.0009) [2023-12-26 02:59:52,323][123091] Updated weights for policy 0, policy_version 427409 (0.0009) [2023-12-26 02:59:52,390][123091] Updated weights for policy 0, policy_version 427419 (0.0011) [2023-12-26 02:59:52,440][123090] Updated weights for policy 1, policy_version 424705 (0.0009) [2023-12-26 02:59:52,453][123091] Updated weights for policy 0, policy_version 427429 (0.0010) [2023-12-26 02:59:52,506][123090] Updated weights for policy 1, policy_version 424715 (0.0009) [2023-12-26 02:59:52,519][123091] Updated weights for policy 0, policy_version 427439 (0.0011) [2023-12-26 02:59:52,568][123090] Updated weights for policy 1, policy_version 424725 (0.0009) [2023-12-26 02:59:52,636][123090] Updated weights for policy 1, policy_version 424735 (0.0009) [2023-12-26 02:59:53,352][123091] Updated weights for policy 0, policy_version 427449 (0.0009) [2023-12-26 02:59:53,400][123091] Updated weights for policy 0, policy_version 427459 (0.0009) [2023-12-26 02:59:53,451][123091] Updated weights for policy 0, policy_version 427469 (0.0007) [2023-12-26 02:59:53,456][123090] Updated weights for policy 1, policy_version 424745 (0.0009) [2023-12-26 02:59:53,518][123090] Updated weights for policy 1, policy_version 424755 (0.0009) [2023-12-26 02:59:53,582][123090] Updated weights for policy 1, policy_version 424765 (0.0009) [2023-12-26 02:59:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 218177536. Throughput: 0: 8868.3, 1: 8879.3. Samples: 218151136. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:53,785][121949] Avg episode reward: [(0, '6112.179'), (1, '5584.049')] [2023-12-26 02:59:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000427472_109436928.pth... [2023-12-26 02:59:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000424768_108740608.pth... [2023-12-26 02:59:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000426416_109166592.pth [2023-12-26 02:59:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000423744_108478464.pth [2023-12-26 02:59:54,204][123091] Updated weights for policy 0, policy_version 427479 (0.0006) [2023-12-26 02:59:54,264][123091] Updated weights for policy 0, policy_version 427489 (0.0006) [2023-12-26 02:59:54,332][123091] Updated weights for policy 0, policy_version 427499 (0.0006) [2023-12-26 02:59:54,387][123090] Updated weights for policy 1, policy_version 424775 (0.0007) [2023-12-26 02:59:54,452][123090] Updated weights for policy 1, policy_version 424785 (0.0009) [2023-12-26 02:59:54,517][123090] Updated weights for policy 1, policy_version 424795 (0.0009) [2023-12-26 02:59:55,060][123091] Updated weights for policy 0, policy_version 427509 (0.0008) [2023-12-26 02:59:55,124][123091] Updated weights for policy 0, policy_version 427519 (0.0006) [2023-12-26 02:59:55,185][123091] Updated weights for policy 0, policy_version 427529 (0.0006) [2023-12-26 02:59:55,334][123090] Updated weights for policy 1, policy_version 424805 (0.0009) [2023-12-26 02:59:55,402][123090] Updated weights for policy 1, policy_version 424815 (0.0009) [2023-12-26 02:59:55,469][123090] Updated weights for policy 1, policy_version 424825 (0.0008) [2023-12-26 02:59:55,864][123091] Updated weights for policy 0, policy_version 427539 (0.0007) [2023-12-26 02:59:55,918][123091] Updated weights for policy 0, policy_version 427549 (0.0010) [2023-12-26 02:59:55,963][123091] Updated weights for policy 0, policy_version 427559 (0.0005) [2023-12-26 02:59:56,329][123090] Updated weights for policy 1, policy_version 424835 (0.0010) [2023-12-26 02:59:56,381][123090] Updated weights for policy 1, policy_version 424845 (0.0009) [2023-12-26 02:59:56,446][123090] Updated weights for policy 1, policy_version 424855 (0.0008) [2023-12-26 02:59:56,697][123091] Updated weights for policy 0, policy_version 427569 (0.0005) [2023-12-26 02:59:56,768][123091] Updated weights for policy 0, policy_version 427579 (0.0007) [2023-12-26 02:59:56,832][123091] Updated weights for policy 0, policy_version 427589 (0.0008) [2023-12-26 02:59:56,897][123091] Updated weights for policy 0, policy_version 427599 (0.0008) [2023-12-26 02:59:57,325][123090] Updated weights for policy 1, policy_version 424865 (0.0009) [2023-12-26 02:59:57,399][123090] Updated weights for policy 1, policy_version 424875 (0.0006) [2023-12-26 02:59:57,468][123090] Updated weights for policy 1, policy_version 424885 (0.0008) [2023-12-26 02:59:57,521][123090] Updated weights for policy 1, policy_version 424895 (0.0009) [2023-12-26 02:59:57,581][123091] Updated weights for policy 0, policy_version 427609 (0.0006) [2023-12-26 02:59:57,642][123091] Updated weights for policy 0, policy_version 427619 (0.0005) [2023-12-26 02:59:57,697][123091] Updated weights for policy 0, policy_version 427629 (0.0005) [2023-12-26 02:59:58,298][123090] Updated weights for policy 1, policy_version 424905 (0.0008) [2023-12-26 02:59:58,375][123090] Updated weights for policy 1, policy_version 424915 (0.0007) [2023-12-26 02:59:58,440][123090] Updated weights for policy 1, policy_version 424925 (0.0007) [2023-12-26 02:59:58,501][123091] Updated weights for policy 0, policy_version 427639 (0.0009) [2023-12-26 02:59:58,572][123091] Updated weights for policy 0, policy_version 427649 (0.0007) [2023-12-26 02:59:58,640][123091] Updated weights for policy 0, policy_version 427659 (0.0008) [2023-12-26 02:59:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 218267648. Throughput: 0: 8884.5, 1: 8859.5. Samples: 218257076. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 02:59:58,785][121949] Avg episode reward: [(0, '6162.156'), (1, '5521.015')] [2023-12-26 02:59:59,361][123090] Updated weights for policy 1, policy_version 424935 (0.0008) [2023-12-26 02:59:59,420][123090] Updated weights for policy 1, policy_version 424945 (0.0009) [2023-12-26 02:59:59,426][123091] Updated weights for policy 0, policy_version 427669 (0.0008) [2023-12-26 02:59:59,472][123090] Updated weights for policy 1, policy_version 424955 (0.0007) [2023-12-26 02:59:59,478][123091] Updated weights for policy 0, policy_version 427679 (0.0009) [2023-12-26 02:59:59,530][123091] Updated weights for policy 0, policy_version 427689 (0.0009) [2023-12-26 03:00:00,315][123091] Updated weights for policy 0, policy_version 427699 (0.0008) [2023-12-26 03:00:00,332][123090] Updated weights for policy 1, policy_version 424965 (0.0008) [2023-12-26 03:00:00,381][123091] Updated weights for policy 0, policy_version 427709 (0.0009) [2023-12-26 03:00:00,400][123090] Updated weights for policy 1, policy_version 424975 (0.0007) [2023-12-26 03:00:00,446][123091] Updated weights for policy 0, policy_version 427719 (0.0006) [2023-12-26 03:00:00,452][123090] Updated weights for policy 1, policy_version 424985 (0.0009) [2023-12-26 03:00:01,293][123091] Updated weights for policy 0, policy_version 427729 (0.0009) [2023-12-26 03:00:01,319][123090] Updated weights for policy 1, policy_version 424995 (0.0005) [2023-12-26 03:00:01,355][123091] Updated weights for policy 0, policy_version 427739 (0.0009) [2023-12-26 03:00:01,393][123090] Updated weights for policy 1, policy_version 425005 (0.0008) [2023-12-26 03:00:01,430][123091] Updated weights for policy 0, policy_version 427749 (0.0009) [2023-12-26 03:00:01,464][123090] Updated weights for policy 1, policy_version 425015 (0.0010) [2023-12-26 03:00:01,492][123091] Updated weights for policy 0, policy_version 427759 (0.0011) [2023-12-26 03:00:02,236][123090] Updated weights for policy 1, policy_version 425025 (0.0008) [2023-12-26 03:00:02,266][123091] Updated weights for policy 0, policy_version 427769 (0.0007) [2023-12-26 03:00:02,303][123090] Updated weights for policy 1, policy_version 425035 (0.0006) [2023-12-26 03:00:02,331][123091] Updated weights for policy 0, policy_version 427779 (0.0006) [2023-12-26 03:00:02,365][123090] Updated weights for policy 1, policy_version 425045 (0.0006) [2023-12-26 03:00:02,402][123091] Updated weights for policy 0, policy_version 427789 (0.0008) [2023-12-26 03:00:02,422][123090] Updated weights for policy 1, policy_version 425055 (0.0006) [2023-12-26 03:00:03,088][123091] Updated weights for policy 0, policy_version 427799 (0.0009) [2023-12-26 03:00:03,141][123091] Updated weights for policy 0, policy_version 427809 (0.0009) [2023-12-26 03:00:03,198][123091] Updated weights for policy 0, policy_version 427819 (0.0010) [2023-12-26 03:00:03,240][123090] Updated weights for policy 1, policy_version 425065 (0.0008) [2023-12-26 03:00:03,290][123090] Updated weights for policy 1, policy_version 425075 (0.0008) [2023-12-26 03:00:03,338][123090] Updated weights for policy 1, policy_version 425085 (0.0008) [2023-12-26 03:00:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 218349568. Throughput: 0: 8986.8, 1: 8648.7. Samples: 218360296. Policy #0 lag: (min: 5.0, avg: 8.1, max: 37.0) [2023-12-26 03:00:03,786][121949] Avg episode reward: [(0, '6160.389'), (1, '5412.131')] [2023-12-26 03:00:04,050][123091] Updated weights for policy 0, policy_version 427829 (0.0009) [2023-12-26 03:00:04,113][123091] Updated weights for policy 0, policy_version 427839 (0.0011) [2023-12-26 03:00:04,129][123090] Updated weights for policy 1, policy_version 425095 (0.0008) [2023-12-26 03:00:04,179][123091] Updated weights for policy 0, policy_version 427849 (0.0009) [2023-12-26 03:00:04,195][123090] Updated weights for policy 1, policy_version 425105 (0.0006) [2023-12-26 03:00:04,263][123090] Updated weights for policy 1, policy_version 425115 (0.0010) [2023-12-26 03:00:04,997][123090] Updated weights for policy 1, policy_version 425125 (0.0009) [2023-12-26 03:00:05,041][123091] Updated weights for policy 0, policy_version 427859 (0.0008) [2023-12-26 03:00:05,063][123090] Updated weights for policy 1, policy_version 425135 (0.0009) [2023-12-26 03:00:05,101][123091] Updated weights for policy 0, policy_version 427869 (0.0007) [2023-12-26 03:00:05,118][123090] Updated weights for policy 1, policy_version 425145 (0.0007) [2023-12-26 03:00:05,170][123091] Updated weights for policy 0, policy_version 427879 (0.0008) [2023-12-26 03:00:05,939][123091] Updated weights for policy 0, policy_version 427889 (0.0009) [2023-12-26 03:00:05,948][123090] Updated weights for policy 1, policy_version 425155 (0.0009) [2023-12-26 03:00:06,003][123090] Updated weights for policy 1, policy_version 425165 (0.0009) [2023-12-26 03:00:06,006][123091] Updated weights for policy 0, policy_version 427899 (0.0006) [2023-12-26 03:00:06,056][123090] Updated weights for policy 1, policy_version 425175 (0.0008) [2023-12-26 03:00:06,072][123091] Updated weights for policy 0, policy_version 427909 (0.0008) [2023-12-26 03:00:06,135][123091] Updated weights for policy 0, policy_version 427919 (0.0008) [2023-12-26 03:00:06,854][123091] Updated weights for policy 0, policy_version 427929 (0.0006) [2023-12-26 03:00:06,903][123091] Updated weights for policy 0, policy_version 427939 (0.0005) [2023-12-26 03:00:06,970][123091] Updated weights for policy 0, policy_version 427949 (0.0005) [2023-12-26 03:00:06,972][123090] Updated weights for policy 1, policy_version 425185 (0.0007) [2023-12-26 03:00:07,044][123090] Updated weights for policy 1, policy_version 425195 (0.0005) [2023-12-26 03:00:07,112][123090] Updated weights for policy 1, policy_version 425205 (0.0005) [2023-12-26 03:00:07,176][123090] Updated weights for policy 1, policy_version 425215 (0.0005) [2023-12-26 03:00:07,691][123091] Updated weights for policy 0, policy_version 427959 (0.0008) [2023-12-26 03:00:07,750][123091] Updated weights for policy 0, policy_version 427969 (0.0009) [2023-12-26 03:00:07,782][123090] Updated weights for policy 1, policy_version 425225 (0.0008) [2023-12-26 03:00:07,810][123091] Updated weights for policy 0, policy_version 427979 (0.0008) [2023-12-26 03:00:07,840][123090] Updated weights for policy 1, policy_version 425235 (0.0006) [2023-12-26 03:00:07,895][123090] Updated weights for policy 1, policy_version 425245 (0.0005) [2023-12-26 03:00:08,446][123090] Updated weights for policy 1, policy_version 425255 (0.0007) [2023-12-26 03:00:08,494][123090] Updated weights for policy 1, policy_version 425265 (0.0008) [2023-12-26 03:00:08,541][123090] Updated weights for policy 1, policy_version 425275 (0.0008) [2023-12-26 03:00:08,573][123091] Updated weights for policy 0, policy_version 427989 (0.0009) [2023-12-26 03:00:08,635][123091] Updated weights for policy 0, policy_version 427999 (0.0011) [2023-12-26 03:00:08,703][123091] Updated weights for policy 0, policy_version 428009 (0.0011) [2023-12-26 03:00:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 218447872. Throughput: 0: 9019.0, 1: 8654.2. Samples: 218412816. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:08,785][121949] Avg episode reward: [(0, '6162.925'), (1, '5359.450')] [2023-12-26 03:00:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000428016_109576192.pth... [2023-12-26 03:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000425280_108871680.pth... [2023-12-26 03:00:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000424288_108617728.pth [2023-12-26 03:00:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000426960_109305856.pth [2023-12-26 03:00:09,428][123090] Updated weights for policy 1, policy_version 425285 (0.0008) [2023-12-26 03:00:09,485][123090] Updated weights for policy 1, policy_version 425295 (0.0009) [2023-12-26 03:00:09,536][123091] Updated weights for policy 0, policy_version 428019 (0.0010) [2023-12-26 03:00:09,545][123090] Updated weights for policy 1, policy_version 425305 (0.0009) [2023-12-26 03:00:09,596][123091] Updated weights for policy 0, policy_version 428029 (0.0011) [2023-12-26 03:00:09,660][123091] Updated weights for policy 0, policy_version 428039 (0.0011) [2023-12-26 03:00:10,411][123090] Updated weights for policy 1, policy_version 425315 (0.0008) [2023-12-26 03:00:10,477][123090] Updated weights for policy 1, policy_version 425325 (0.0009) [2023-12-26 03:00:10,510][123091] Updated weights for policy 0, policy_version 428049 (0.0011) [2023-12-26 03:00:10,534][123090] Updated weights for policy 1, policy_version 425335 (0.0010) [2023-12-26 03:00:10,562][123091] Updated weights for policy 0, policy_version 428059 (0.0010) [2023-12-26 03:00:10,614][123091] Updated weights for policy 0, policy_version 428069 (0.0010) [2023-12-26 03:00:10,680][123091] Updated weights for policy 0, policy_version 428079 (0.0011) [2023-12-26 03:00:11,376][123090] Updated weights for policy 1, policy_version 425345 (0.0006) [2023-12-26 03:00:11,438][123090] Updated weights for policy 1, policy_version 425355 (0.0008) [2023-12-26 03:00:11,500][123090] Updated weights for policy 1, policy_version 425365 (0.0009) [2023-12-26 03:00:11,564][123090] Updated weights for policy 1, policy_version 425375 (0.0008) [2023-12-26 03:00:11,582][123091] Updated weights for policy 0, policy_version 428089 (0.0010) [2023-12-26 03:00:11,651][123091] Updated weights for policy 0, policy_version 428099 (0.0010) [2023-12-26 03:00:11,706][123091] Updated weights for policy 0, policy_version 428109 (0.0010) [2023-12-26 03:00:12,446][123090] Updated weights for policy 1, policy_version 425385 (0.0009) [2023-12-26 03:00:12,476][123091] Updated weights for policy 0, policy_version 428119 (0.0009) [2023-12-26 03:00:12,492][123090] Updated weights for policy 1, policy_version 425395 (0.0007) [2023-12-26 03:00:12,521][123091] Updated weights for policy 0, policy_version 428129 (0.0007) [2023-12-26 03:00:12,549][123090] Updated weights for policy 1, policy_version 425405 (0.0009) [2023-12-26 03:00:12,573][123091] Updated weights for policy 0, policy_version 428139 (0.0006) [2023-12-26 03:00:13,300][123090] Updated weights for policy 1, policy_version 425415 (0.0007) [2023-12-26 03:00:13,363][123090] Updated weights for policy 1, policy_version 425425 (0.0010) [2023-12-26 03:00:13,425][123090] Updated weights for policy 1, policy_version 425435 (0.0010) [2023-12-26 03:00:13,462][123091] Updated weights for policy 0, policy_version 428149 (0.0010) [2023-12-26 03:00:13,516][123091] Updated weights for policy 0, policy_version 428159 (0.0010) [2023-12-26 03:00:13,563][123091] Updated weights for policy 0, policy_version 428169 (0.0010) [2023-12-26 03:00:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 218529792. Throughput: 0: 8984.7, 1: 8618.8. Samples: 218518848. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:13,785][121949] Avg episode reward: [(0, '6235.715'), (1, '5082.364')] [2023-12-26 03:00:14,116][123090] Updated weights for policy 1, policy_version 425445 (0.0006) [2023-12-26 03:00:14,168][123090] Updated weights for policy 1, policy_version 425455 (0.0005) [2023-12-26 03:00:14,224][123090] Updated weights for policy 1, policy_version 425465 (0.0005) [2023-12-26 03:00:14,283][123091] Updated weights for policy 0, policy_version 428179 (0.0009) [2023-12-26 03:00:14,334][123091] Updated weights for policy 0, policy_version 428189 (0.0006) [2023-12-26 03:00:14,381][123091] Updated weights for policy 0, policy_version 428199 (0.0005) [2023-12-26 03:00:14,933][123090] Updated weights for policy 1, policy_version 425475 (0.0005) [2023-12-26 03:00:14,995][123090] Updated weights for policy 1, policy_version 425485 (0.0005) [2023-12-26 03:00:15,064][123090] Updated weights for policy 1, policy_version 425495 (0.0006) [2023-12-26 03:00:15,187][123091] Updated weights for policy 0, policy_version 428209 (0.0009) [2023-12-26 03:00:15,254][123091] Updated weights for policy 0, policy_version 428219 (0.0011) [2023-12-26 03:00:15,319][123091] Updated weights for policy 0, policy_version 428229 (0.0011) [2023-12-26 03:00:15,383][123091] Updated weights for policy 0, policy_version 428239 (0.0011) [2023-12-26 03:00:15,772][123090] Updated weights for policy 1, policy_version 425505 (0.0009) [2023-12-26 03:00:15,830][123090] Updated weights for policy 1, policy_version 425515 (0.0005) [2023-12-26 03:00:15,884][123090] Updated weights for policy 1, policy_version 425525 (0.0006) [2023-12-26 03:00:15,933][123090] Updated weights for policy 1, policy_version 425535 (0.0005) [2023-12-26 03:00:16,216][123091] Updated weights for policy 0, policy_version 428249 (0.0008) [2023-12-26 03:00:16,271][123091] Updated weights for policy 0, policy_version 428259 (0.0010) [2023-12-26 03:00:16,322][123091] Updated weights for policy 0, policy_version 428269 (0.0010) [2023-12-26 03:00:16,612][123090] Updated weights for policy 1, policy_version 425545 (0.0005) [2023-12-26 03:00:16,672][123090] Updated weights for policy 1, policy_version 425555 (0.0005) [2023-12-26 03:00:16,723][123090] Updated weights for policy 1, policy_version 425565 (0.0005) [2023-12-26 03:00:17,020][123091] Updated weights for policy 0, policy_version 428279 (0.0010) [2023-12-26 03:00:17,068][123091] Updated weights for policy 0, policy_version 428289 (0.0010) [2023-12-26 03:00:17,118][123091] Updated weights for policy 0, policy_version 428299 (0.0010) [2023-12-26 03:00:17,322][123090] Updated weights for policy 1, policy_version 425575 (0.0005) [2023-12-26 03:00:17,389][123090] Updated weights for policy 1, policy_version 425585 (0.0006) [2023-12-26 03:00:17,455][123090] Updated weights for policy 1, policy_version 425595 (0.0006) [2023-12-26 03:00:17,971][123091] Updated weights for policy 0, policy_version 428309 (0.0010) [2023-12-26 03:00:18,033][123091] Updated weights for policy 0, policy_version 428319 (0.0010) [2023-12-26 03:00:18,084][123091] Updated weights for policy 0, policy_version 428329 (0.0010) [2023-12-26 03:00:18,086][123090] Updated weights for policy 1, policy_version 425605 (0.0008) [2023-12-26 03:00:18,144][123090] Updated weights for policy 1, policy_version 425615 (0.0010) [2023-12-26 03:00:18,207][123090] Updated weights for policy 1, policy_version 425625 (0.0008) [2023-12-26 03:00:18,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 218619904. Throughput: 0: 8929.9, 1: 8745.7. Samples: 218634120. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:18,786][121949] Avg episode reward: [(0, '6077.751'), (1, '5227.809')] [2023-12-26 03:00:18,902][123090] Updated weights for policy 1, policy_version 425635 (0.0007) [2023-12-26 03:00:18,910][123091] Updated weights for policy 0, policy_version 428339 (0.0009) [2023-12-26 03:00:18,958][123090] Updated weights for policy 1, policy_version 425645 (0.0011) [2023-12-26 03:00:18,972][123091] Updated weights for policy 0, policy_version 428349 (0.0006) [2023-12-26 03:00:19,012][123090] Updated weights for policy 1, policy_version 425655 (0.0008) [2023-12-26 03:00:19,025][123091] Updated weights for policy 0, policy_version 428359 (0.0011) [2023-12-26 03:00:19,842][123090] Updated weights for policy 1, policy_version 425665 (0.0006) [2023-12-26 03:00:19,863][123091] Updated weights for policy 0, policy_version 428369 (0.0011) [2023-12-26 03:00:19,909][123090] Updated weights for policy 1, policy_version 425675 (0.0011) [2023-12-26 03:00:19,931][123091] Updated weights for policy 0, policy_version 428379 (0.0011) [2023-12-26 03:00:19,982][123090] Updated weights for policy 1, policy_version 425685 (0.0015) [2023-12-26 03:00:19,999][123091] Updated weights for policy 0, policy_version 428389 (0.0007) [2023-12-26 03:00:20,052][123090] Updated weights for policy 1, policy_version 425695 (0.0010) [2023-12-26 03:00:20,069][123091] Updated weights for policy 0, policy_version 428399 (0.0011) [2023-12-26 03:00:20,854][123090] Updated weights for policy 1, policy_version 425705 (0.0010) [2023-12-26 03:00:20,876][123091] Updated weights for policy 0, policy_version 428409 (0.0011) [2023-12-26 03:00:20,932][123090] Updated weights for policy 1, policy_version 425715 (0.0011) [2023-12-26 03:00:20,944][123091] Updated weights for policy 0, policy_version 428419 (0.0007) [2023-12-26 03:00:21,006][123090] Updated weights for policy 1, policy_version 425725 (0.0011) [2023-12-26 03:00:21,008][123091] Updated weights for policy 0, policy_version 428429 (0.0007) [2023-12-26 03:00:21,846][123090] Updated weights for policy 1, policy_version 425735 (0.0008) [2023-12-26 03:00:21,864][123091] Updated weights for policy 0, policy_version 428439 (0.0009) [2023-12-26 03:00:21,903][123090] Updated weights for policy 1, policy_version 425745 (0.0008) [2023-12-26 03:00:21,924][123091] Updated weights for policy 0, policy_version 428449 (0.0009) [2023-12-26 03:00:21,967][123090] Updated weights for policy 1, policy_version 425755 (0.0008) [2023-12-26 03:00:21,989][123091] Updated weights for policy 0, policy_version 428459 (0.0009) [2023-12-26 03:00:22,740][123091] Updated weights for policy 0, policy_version 428469 (0.0008) [2023-12-26 03:00:22,804][123091] Updated weights for policy 0, policy_version 428479 (0.0009) [2023-12-26 03:00:22,859][123090] Updated weights for policy 1, policy_version 425765 (0.0007) [2023-12-26 03:00:22,862][123091] Updated weights for policy 0, policy_version 428489 (0.0009) [2023-12-26 03:00:22,917][123090] Updated weights for policy 1, policy_version 425775 (0.0007) [2023-12-26 03:00:22,980][123090] Updated weights for policy 1, policy_version 425785 (0.0005) [2023-12-26 03:00:23,744][123090] Updated weights for policy 1, policy_version 425795 (0.0007) [2023-12-26 03:00:23,754][123091] Updated weights for policy 0, policy_version 428499 (0.0007) [2023-12-26 03:00:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 218701824. Throughput: 0: 8901.0, 1: 8732.0. Samples: 218685068. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:23,785][121949] Avg episode reward: [(0, '6003.151'), (1, '4838.022')] [2023-12-26 03:00:23,803][123090] Updated weights for policy 1, policy_version 425805 (0.0006) [2023-12-26 03:00:23,812][123091] Updated weights for policy 0, policy_version 428509 (0.0010) [2023-12-26 03:00:23,862][123091] Updated weights for policy 0, policy_version 428519 (0.0009) [2023-12-26 03:00:23,862][123090] Updated weights for policy 1, policy_version 425815 (0.0005) [2023-12-26 03:00:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000428528_109707264.pth... [2023-12-26 03:00:23,907][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000427472_109436928.pth [2023-12-26 03:00:23,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000425824_109010944.pth... [2023-12-26 03:00:23,915][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000424768_108740608.pth [2023-12-26 03:00:24,562][123090] Updated weights for policy 1, policy_version 425825 (0.0009) [2023-12-26 03:00:24,609][123090] Updated weights for policy 1, policy_version 425835 (0.0005) [2023-12-26 03:00:24,670][123090] Updated weights for policy 1, policy_version 425845 (0.0010) [2023-12-26 03:00:24,737][123090] Updated weights for policy 1, policy_version 425855 (0.0010) [2023-12-26 03:00:24,750][123091] Updated weights for policy 0, policy_version 428529 (0.0007) [2023-12-26 03:00:24,802][123091] Updated weights for policy 0, policy_version 428539 (0.0008) [2023-12-26 03:00:24,851][123091] Updated weights for policy 0, policy_version 428549 (0.0009) [2023-12-26 03:00:24,900][123091] Updated weights for policy 0, policy_version 428559 (0.0009) [2023-12-26 03:00:25,566][123090] Updated weights for policy 1, policy_version 425865 (0.0010) [2023-12-26 03:00:25,625][123090] Updated weights for policy 1, policy_version 425875 (0.0010) [2023-12-26 03:00:25,686][123090] Updated weights for policy 1, policy_version 425885 (0.0008) [2023-12-26 03:00:25,755][123091] Updated weights for policy 0, policy_version 428569 (0.0008) [2023-12-26 03:00:25,807][123091] Updated weights for policy 0, policy_version 428579 (0.0009) [2023-12-26 03:00:25,862][123091] Updated weights for policy 0, policy_version 428589 (0.0009) [2023-12-26 03:00:26,444][123090] Updated weights for policy 1, policy_version 425895 (0.0007) [2023-12-26 03:00:26,510][123090] Updated weights for policy 1, policy_version 425905 (0.0009) [2023-12-26 03:00:26,564][123090] Updated weights for policy 1, policy_version 425915 (0.0010) [2023-12-26 03:00:26,708][123091] Updated weights for policy 0, policy_version 428599 (0.0007) [2023-12-26 03:00:26,773][123091] Updated weights for policy 0, policy_version 428609 (0.0009) [2023-12-26 03:00:26,837][123091] Updated weights for policy 0, policy_version 428619 (0.0010) [2023-12-26 03:00:27,245][123090] Updated weights for policy 1, policy_version 425925 (0.0008) [2023-12-26 03:00:27,296][123090] Updated weights for policy 1, policy_version 425935 (0.0009) [2023-12-26 03:00:27,351][123090] Updated weights for policy 1, policy_version 425945 (0.0007) [2023-12-26 03:00:27,675][123091] Updated weights for policy 0, policy_version 428629 (0.0010) [2023-12-26 03:00:27,731][123091] Updated weights for policy 0, policy_version 428641 (0.0011) [2023-12-26 03:00:27,777][123091] Updated weights for policy 0, policy_version 428652 (0.0007) [2023-12-26 03:00:27,983][123090] Updated weights for policy 1, policy_version 425955 (0.0007) [2023-12-26 03:00:28,042][123090] Updated weights for policy 1, policy_version 425965 (0.0005) [2023-12-26 03:00:28,107][123090] Updated weights for policy 1, policy_version 425975 (0.0005) [2023-12-26 03:00:28,545][123091] Updated weights for policy 0, policy_version 428662 (0.0007) [2023-12-26 03:00:28,593][123091] Updated weights for policy 0, policy_version 428672 (0.0008) [2023-12-26 03:00:28,648][123091] Updated weights for policy 0, policy_version 428682 (0.0009) [2023-12-26 03:00:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 218800128. Throughput: 0: 8821.7, 1: 8846.5. Samples: 218791296. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:28,785][121949] Avg episode reward: [(0, '6017.659'), (1, '4730.939')] [2023-12-26 03:00:28,858][123090] Updated weights for policy 1, policy_version 425985 (0.0006) [2023-12-26 03:00:28,910][123090] Updated weights for policy 1, policy_version 425995 (0.0010) [2023-12-26 03:00:28,957][123090] Updated weights for policy 1, policy_version 426005 (0.0010) [2023-12-26 03:00:29,031][123090] Updated weights for policy 1, policy_version 426015 (0.0011) [2023-12-26 03:00:29,378][123091] Updated weights for policy 0, policy_version 428692 (0.0009) [2023-12-26 03:00:29,446][123091] Updated weights for policy 0, policy_version 428702 (0.0008) [2023-12-26 03:00:29,515][123091] Updated weights for policy 0, policy_version 428712 (0.0005) [2023-12-26 03:00:29,837][123090] Updated weights for policy 1, policy_version 426025 (0.0007) [2023-12-26 03:00:29,907][123090] Updated weights for policy 1, policy_version 426035 (0.0007) [2023-12-26 03:00:29,970][123090] Updated weights for policy 1, policy_version 426045 (0.0011) [2023-12-26 03:00:30,202][123091] Updated weights for policy 0, policy_version 428722 (0.0006) [2023-12-26 03:00:30,272][123091] Updated weights for policy 0, policy_version 428732 (0.0005) [2023-12-26 03:00:30,340][123091] Updated weights for policy 0, policy_version 428742 (0.0007) [2023-12-26 03:00:30,405][123091] Updated weights for policy 0, policy_version 428752 (0.0009) [2023-12-26 03:00:30,764][123090] Updated weights for policy 1, policy_version 426055 (0.0008) [2023-12-26 03:00:30,831][123090] Updated weights for policy 1, policy_version 426065 (0.0008) [2023-12-26 03:00:30,885][123090] Updated weights for policy 1, policy_version 426075 (0.0005) [2023-12-26 03:00:31,156][123091] Updated weights for policy 0, policy_version 428762 (0.0008) [2023-12-26 03:00:31,225][123091] Updated weights for policy 0, policy_version 428772 (0.0009) [2023-12-26 03:00:31,291][123091] Updated weights for policy 0, policy_version 428782 (0.0010) [2023-12-26 03:00:31,648][123090] Updated weights for policy 1, policy_version 426085 (0.0007) [2023-12-26 03:00:31,703][123090] Updated weights for policy 1, policy_version 426095 (0.0006) [2023-12-26 03:00:31,776][123090] Updated weights for policy 1, policy_version 426105 (0.0009) [2023-12-26 03:00:32,146][123091] Updated weights for policy 0, policy_version 428792 (0.0009) [2023-12-26 03:00:32,202][123091] Updated weights for policy 0, policy_version 428803 (0.0010) [2023-12-26 03:00:32,254][123091] Updated weights for policy 0, policy_version 428813 (0.0010) [2023-12-26 03:00:32,433][123090] Updated weights for policy 1, policy_version 426115 (0.0009) [2023-12-26 03:00:32,481][123090] Updated weights for policy 1, policy_version 426125 (0.0009) [2023-12-26 03:00:32,550][123090] Updated weights for policy 1, policy_version 426135 (0.0007) [2023-12-26 03:00:33,099][123091] Updated weights for policy 0, policy_version 428823 (0.0011) [2023-12-26 03:00:33,157][123091] Updated weights for policy 0, policy_version 428833 (0.0010) [2023-12-26 03:00:33,223][123091] Updated weights for policy 0, policy_version 428843 (0.0010) [2023-12-26 03:00:33,355][123090] Updated weights for policy 1, policy_version 426145 (0.0008) [2023-12-26 03:00:33,402][123090] Updated weights for policy 1, policy_version 426155 (0.0005) [2023-12-26 03:00:33,452][123090] Updated weights for policy 1, policy_version 426165 (0.0008) [2023-12-26 03:00:33,500][123090] Updated weights for policy 1, policy_version 426175 (0.0010) [2023-12-26 03:00:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 218890240. Throughput: 0: 8848.1, 1: 8947.6. Samples: 218901560. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:33,785][121949] Avg episode reward: [(0, '6064.064'), (1, '5071.696')] [2023-12-26 03:00:33,921][123091] Updated weights for policy 0, policy_version 428853 (0.0008) [2023-12-26 03:00:33,976][123091] Updated weights for policy 0, policy_version 428863 (0.0006) [2023-12-26 03:00:34,054][123091] Updated weights for policy 0, policy_version 428873 (0.0005) [2023-12-26 03:00:34,272][123090] Updated weights for policy 1, policy_version 426185 (0.0006) [2023-12-26 03:00:34,332][123090] Updated weights for policy 1, policy_version 426195 (0.0005) [2023-12-26 03:00:34,402][123090] Updated weights for policy 1, policy_version 426205 (0.0007) [2023-12-26 03:00:34,794][123091] Updated weights for policy 0, policy_version 428883 (0.0006) [2023-12-26 03:00:34,843][123091] Updated weights for policy 0, policy_version 428893 (0.0009) [2023-12-26 03:00:34,895][123091] Updated weights for policy 0, policy_version 428903 (0.0009) [2023-12-26 03:00:35,202][123090] Updated weights for policy 1, policy_version 426215 (0.0010) [2023-12-26 03:00:35,269][123090] Updated weights for policy 1, policy_version 426225 (0.0010) [2023-12-26 03:00:35,328][123090] Updated weights for policy 1, policy_version 426235 (0.0009) [2023-12-26 03:00:35,725][123091] Updated weights for policy 0, policy_version 428913 (0.0008) [2023-12-26 03:00:35,776][123091] Updated weights for policy 0, policy_version 428923 (0.0006) [2023-12-26 03:00:35,836][123091] Updated weights for policy 0, policy_version 428933 (0.0011) [2023-12-26 03:00:35,904][123091] Updated weights for policy 0, policy_version 428943 (0.0011) [2023-12-26 03:00:35,974][123090] Updated weights for policy 1, policy_version 426245 (0.0006) [2023-12-26 03:00:36,029][123090] Updated weights for policy 1, policy_version 426255 (0.0005) [2023-12-26 03:00:36,080][123090] Updated weights for policy 1, policy_version 426265 (0.0006) [2023-12-26 03:00:36,755][123091] Updated weights for policy 0, policy_version 428953 (0.0009) [2023-12-26 03:00:36,797][123090] Updated weights for policy 1, policy_version 426275 (0.0008) [2023-12-26 03:00:36,818][123091] Updated weights for policy 0, policy_version 428963 (0.0008) [2023-12-26 03:00:36,865][123090] Updated weights for policy 1, policy_version 426285 (0.0010) [2023-12-26 03:00:36,882][123091] Updated weights for policy 0, policy_version 428973 (0.0008) [2023-12-26 03:00:36,929][123090] Updated weights for policy 1, policy_version 426295 (0.0010) [2023-12-26 03:00:37,583][123091] Updated weights for policy 0, policy_version 428983 (0.0005) [2023-12-26 03:00:37,653][123091] Updated weights for policy 0, policy_version 428993 (0.0007) [2023-12-26 03:00:37,661][123090] Updated weights for policy 1, policy_version 426305 (0.0009) [2023-12-26 03:00:37,701][123091] Updated weights for policy 0, policy_version 429003 (0.0009) [2023-12-26 03:00:37,732][123090] Updated weights for policy 1, policy_version 426315 (0.0008) [2023-12-26 03:00:37,799][123090] Updated weights for policy 1, policy_version 426325 (0.0009) [2023-12-26 03:00:37,859][123090] Updated weights for policy 1, policy_version 426335 (0.0009) [2023-12-26 03:00:38,472][123091] Updated weights for policy 0, policy_version 429013 (0.0010) [2023-12-26 03:00:38,535][123091] Updated weights for policy 0, policy_version 429023 (0.0009) [2023-12-26 03:00:38,551][123090] Updated weights for policy 1, policy_version 426345 (0.0007) [2023-12-26 03:00:38,596][123091] Updated weights for policy 0, policy_version 429033 (0.0008) [2023-12-26 03:00:38,607][123090] Updated weights for policy 1, policy_version 426355 (0.0007) [2023-12-26 03:00:38,663][123090] Updated weights for policy 1, policy_version 426365 (0.0009) [2023-12-26 03:00:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 218988544. Throughput: 0: 8877.1, 1: 9045.1. Samples: 218957632. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:38,785][121949] Avg episode reward: [(0, '6094.306'), (1, '5089.012')] [2023-12-26 03:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000429040_109838336.pth... [2023-12-26 03:00:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000426368_109150208.pth... [2023-12-26 03:00:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000428016_109576192.pth [2023-12-26 03:00:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000425280_108871680.pth [2023-12-26 03:00:39,456][123091] Updated weights for policy 0, policy_version 429043 (0.0007) [2023-12-26 03:00:39,461][123090] Updated weights for policy 1, policy_version 426375 (0.0009) [2023-12-26 03:00:39,510][123090] Updated weights for policy 1, policy_version 426385 (0.0009) [2023-12-26 03:00:39,519][123091] Updated weights for policy 0, policy_version 429053 (0.0008) [2023-12-26 03:00:39,572][123090] Updated weights for policy 1, policy_version 426395 (0.0009) [2023-12-26 03:00:39,582][123091] Updated weights for policy 0, policy_version 429063 (0.0008) [2023-12-26 03:00:40,349][123091] Updated weights for policy 0, policy_version 429073 (0.0008) [2023-12-26 03:00:40,415][123091] Updated weights for policy 0, policy_version 429083 (0.0011) [2023-12-26 03:00:40,457][123090] Updated weights for policy 1, policy_version 426405 (0.0009) [2023-12-26 03:00:40,479][123091] Updated weights for policy 0, policy_version 429093 (0.0011) [2023-12-26 03:00:40,524][123090] Updated weights for policy 1, policy_version 426415 (0.0009) [2023-12-26 03:00:40,541][123091] Updated weights for policy 0, policy_version 429103 (0.0010) [2023-12-26 03:00:40,588][123090] Updated weights for policy 1, policy_version 426425 (0.0008) [2023-12-26 03:00:41,349][123091] Updated weights for policy 0, policy_version 429113 (0.0009) [2023-12-26 03:00:41,413][123091] Updated weights for policy 0, policy_version 429123 (0.0007) [2023-12-26 03:00:41,440][123090] Updated weights for policy 1, policy_version 426435 (0.0010) [2023-12-26 03:00:41,475][123091] Updated weights for policy 0, policy_version 429133 (0.0006) [2023-12-26 03:00:41,506][123090] Updated weights for policy 1, policy_version 426445 (0.0011) [2023-12-26 03:00:41,566][123090] Updated weights for policy 1, policy_version 426455 (0.0011) [2023-12-26 03:00:42,278][123091] Updated weights for policy 0, policy_version 429143 (0.0007) [2023-12-26 03:00:42,343][123091] Updated weights for policy 0, policy_version 429153 (0.0008) [2023-12-26 03:00:42,418][123091] Updated weights for policy 0, policy_version 429163 (0.0008) [2023-12-26 03:00:42,420][123090] Updated weights for policy 1, policy_version 426465 (0.0011) [2023-12-26 03:00:42,486][123090] Updated weights for policy 1, policy_version 426475 (0.0009) [2023-12-26 03:00:42,543][123090] Updated weights for policy 1, policy_version 426485 (0.0009) [2023-12-26 03:00:42,597][123090] Updated weights for policy 1, policy_version 426495 (0.0010) [2023-12-26 03:00:43,135][123091] Updated weights for policy 0, policy_version 429173 (0.0009) [2023-12-26 03:00:43,189][123091] Updated weights for policy 0, policy_version 429183 (0.0009) [2023-12-26 03:00:43,249][123091] Updated weights for policy 0, policy_version 429193 (0.0009) [2023-12-26 03:00:43,442][123090] Updated weights for policy 1, policy_version 426505 (0.0009) [2023-12-26 03:00:43,495][123090] Updated weights for policy 1, policy_version 426515 (0.0009) [2023-12-26 03:00:43,548][123090] Updated weights for policy 1, policy_version 426525 (0.0009) [2023-12-26 03:00:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 219070464. Throughput: 0: 8818.2, 1: 9089.1. Samples: 219062908. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:43,785][121949] Avg episode reward: [(0, '5998.478'), (1, '4858.402')] [2023-12-26 03:00:44,003][123091] Updated weights for policy 0, policy_version 429203 (0.0008) [2023-12-26 03:00:44,070][123091] Updated weights for policy 0, policy_version 429213 (0.0010) [2023-12-26 03:00:44,138][123091] Updated weights for policy 0, policy_version 429223 (0.0009) [2023-12-26 03:00:44,350][123090] Updated weights for policy 1, policy_version 426535 (0.0009) [2023-12-26 03:00:44,411][123090] Updated weights for policy 1, policy_version 426545 (0.0010) [2023-12-26 03:00:44,476][123090] Updated weights for policy 1, policy_version 426555 (0.0010) [2023-12-26 03:00:44,804][123091] Updated weights for policy 0, policy_version 429233 (0.0006) [2023-12-26 03:00:44,859][123091] Updated weights for policy 0, policy_version 429243 (0.0010) [2023-12-26 03:00:44,913][123091] Updated weights for policy 0, policy_version 429254 (0.0010) [2023-12-26 03:00:44,966][123091] Updated weights for policy 0, policy_version 429264 (0.0010) [2023-12-26 03:00:45,281][123090] Updated weights for policy 1, policy_version 426565 (0.0010) [2023-12-26 03:00:45,351][123090] Updated weights for policy 1, policy_version 426575 (0.0009) [2023-12-26 03:00:45,412][123090] Updated weights for policy 1, policy_version 426585 (0.0009) [2023-12-26 03:00:45,860][123091] Updated weights for policy 0, policy_version 429274 (0.0005) [2023-12-26 03:00:45,920][123091] Updated weights for policy 0, policy_version 429284 (0.0005) [2023-12-26 03:00:45,980][123091] Updated weights for policy 0, policy_version 429294 (0.0006) [2023-12-26 03:00:46,270][123090] Updated weights for policy 1, policy_version 426595 (0.0009) [2023-12-26 03:00:46,323][123090] Updated weights for policy 1, policy_version 426605 (0.0009) [2023-12-26 03:00:46,383][123090] Updated weights for policy 1, policy_version 426615 (0.0010) [2023-12-26 03:00:46,721][123091] Updated weights for policy 0, policy_version 429304 (0.0009) [2023-12-26 03:00:46,783][123091] Updated weights for policy 0, policy_version 429314 (0.0011) [2023-12-26 03:00:46,854][123091] Updated weights for policy 0, policy_version 429324 (0.0010) [2023-12-26 03:00:47,267][123090] Updated weights for policy 1, policy_version 426625 (0.0010) [2023-12-26 03:00:47,343][123090] Updated weights for policy 1, policy_version 426635 (0.0009) [2023-12-26 03:00:47,416][123090] Updated weights for policy 1, policy_version 426645 (0.0009) [2023-12-26 03:00:47,481][123090] Updated weights for policy 1, policy_version 426655 (0.0009) [2023-12-26 03:00:47,507][123091] Updated weights for policy 0, policy_version 429334 (0.0006) [2023-12-26 03:00:47,567][123091] Updated weights for policy 0, policy_version 429344 (0.0006) [2023-12-26 03:00:47,627][123091] Updated weights for policy 0, policy_version 429354 (0.0009) [2023-12-26 03:00:48,199][123090] Updated weights for policy 1, policy_version 426665 (0.0006) [2023-12-26 03:00:48,250][123090] Updated weights for policy 1, policy_version 426675 (0.0005) [2023-12-26 03:00:48,299][123090] Updated weights for policy 1, policy_version 426685 (0.0010) [2023-12-26 03:00:48,318][123091] Updated weights for policy 0, policy_version 429364 (0.0007) [2023-12-26 03:00:48,390][123091] Updated weights for policy 0, policy_version 429374 (0.0007) [2023-12-26 03:00:48,459][123091] Updated weights for policy 0, policy_version 429384 (0.0008) [2023-12-26 03:00:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 219160576. Throughput: 0: 8905.9, 1: 9130.2. Samples: 219171916. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:48,785][121949] Avg episode reward: [(0, '6033.920'), (1, '4957.872')] [2023-12-26 03:00:49,019][123090] Updated weights for policy 1, policy_version 426695 (0.0007) [2023-12-26 03:00:49,077][123090] Updated weights for policy 1, policy_version 426705 (0.0006) [2023-12-26 03:00:49,136][123090] Updated weights for policy 1, policy_version 426715 (0.0005) [2023-12-26 03:00:49,165][123091] Updated weights for policy 0, policy_version 429394 (0.0009) [2023-12-26 03:00:49,226][123091] Updated weights for policy 0, policy_version 429404 (0.0006) [2023-12-26 03:00:49,291][123091] Updated weights for policy 0, policy_version 429414 (0.0008) [2023-12-26 03:00:49,363][123091] Updated weights for policy 0, policy_version 429424 (0.0008) [2023-12-26 03:00:49,882][123090] Updated weights for policy 1, policy_version 426725 (0.0008) [2023-12-26 03:00:49,939][123090] Updated weights for policy 1, policy_version 426735 (0.0010) [2023-12-26 03:00:50,001][123090] Updated weights for policy 1, policy_version 426745 (0.0011) [2023-12-26 03:00:50,074][123091] Updated weights for policy 0, policy_version 429434 (0.0010) [2023-12-26 03:00:50,129][123091] Updated weights for policy 0, policy_version 429444 (0.0008) [2023-12-26 03:00:50,191][123091] Updated weights for policy 0, policy_version 429454 (0.0010) [2023-12-26 03:00:50,863][123090] Updated weights for policy 1, policy_version 426755 (0.0009) [2023-12-26 03:00:50,916][123090] Updated weights for policy 1, policy_version 426766 (0.0009) [2023-12-26 03:00:50,973][123090] Updated weights for policy 1, policy_version 426776 (0.0009) [2023-12-26 03:00:51,032][123091] Updated weights for policy 0, policy_version 429464 (0.0009) [2023-12-26 03:00:51,094][123091] Updated weights for policy 0, policy_version 429474 (0.0010) [2023-12-26 03:00:51,162][123091] Updated weights for policy 0, policy_version 429484 (0.0010) [2023-12-26 03:00:51,854][123090] Updated weights for policy 1, policy_version 426786 (0.0008) [2023-12-26 03:00:51,915][123090] Updated weights for policy 1, policy_version 426796 (0.0009) [2023-12-26 03:00:51,975][123090] Updated weights for policy 1, policy_version 426806 (0.0008) [2023-12-26 03:00:52,037][123090] Updated weights for policy 1, policy_version 426816 (0.0009) [2023-12-26 03:00:52,080][123091] Updated weights for policy 0, policy_version 429494 (0.0010) [2023-12-26 03:00:52,139][123091] Updated weights for policy 0, policy_version 429504 (0.0009) [2023-12-26 03:00:52,206][123091] Updated weights for policy 0, policy_version 429514 (0.0009) [2023-12-26 03:00:52,887][123090] Updated weights for policy 1, policy_version 426826 (0.0009) [2023-12-26 03:00:52,944][123090] Updated weights for policy 1, policy_version 426836 (0.0009) [2023-12-26 03:00:52,996][123090] Updated weights for policy 1, policy_version 426846 (0.0009) [2023-12-26 03:00:53,025][123091] Updated weights for policy 0, policy_version 429524 (0.0008) [2023-12-26 03:00:53,080][123091] Updated weights for policy 0, policy_version 429534 (0.0007) [2023-12-26 03:00:53,138][123091] Updated weights for policy 0, policy_version 429544 (0.0011) [2023-12-26 03:00:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 219242496. Throughput: 0: 8916.9, 1: 9136.2. Samples: 219225204. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:53,785][121949] Avg episode reward: [(0, '6073.242'), (1, '5115.787')] [2023-12-26 03:00:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000429552_109969408.pth... [2023-12-26 03:00:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000426848_109273088.pth... [2023-12-26 03:00:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000428528_109707264.pth [2023-12-26 03:00:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000425824_109010944.pth [2023-12-26 03:00:53,853][123090] Updated weights for policy 1, policy_version 426856 (0.0009) [2023-12-26 03:00:53,902][123090] Updated weights for policy 1, policy_version 426866 (0.0009) [2023-12-26 03:00:53,917][123091] Updated weights for policy 0, policy_version 429554 (0.0011) [2023-12-26 03:00:53,951][123090] Updated weights for policy 1, policy_version 426876 (0.0007) [2023-12-26 03:00:53,979][123091] Updated weights for policy 0, policy_version 429564 (0.0010) [2023-12-26 03:00:54,041][123091] Updated weights for policy 0, policy_version 429574 (0.0010) [2023-12-26 03:00:54,103][123091] Updated weights for policy 0, policy_version 429584 (0.0011) [2023-12-26 03:00:54,789][123090] Updated weights for policy 1, policy_version 426886 (0.0006) [2023-12-26 03:00:54,838][123090] Updated weights for policy 1, policy_version 426896 (0.0009) [2023-12-26 03:00:54,885][123090] Updated weights for policy 1, policy_version 426906 (0.0009) [2023-12-26 03:00:54,905][123091] Updated weights for policy 0, policy_version 429594 (0.0010) [2023-12-26 03:00:54,977][123091] Updated weights for policy 0, policy_version 429604 (0.0007) [2023-12-26 03:00:55,038][123091] Updated weights for policy 0, policy_version 429614 (0.0006) [2023-12-26 03:00:55,652][123091] Updated weights for policy 0, policy_version 429624 (0.0006) [2023-12-26 03:00:55,709][123091] Updated weights for policy 0, policy_version 429634 (0.0006) [2023-12-26 03:00:55,774][123091] Updated weights for policy 0, policy_version 429644 (0.0006) [2023-12-26 03:00:55,799][123090] Updated weights for policy 1, policy_version 426916 (0.0008) [2023-12-26 03:00:55,853][123090] Updated weights for policy 1, policy_version 426926 (0.0010) [2023-12-26 03:00:55,915][123090] Updated weights for policy 1, policy_version 426936 (0.0010) [2023-12-26 03:00:56,471][123091] Updated weights for policy 0, policy_version 429654 (0.0006) [2023-12-26 03:00:56,543][123091] Updated weights for policy 0, policy_version 429664 (0.0006) [2023-12-26 03:00:56,616][123091] Updated weights for policy 0, policy_version 429674 (0.0007) [2023-12-26 03:00:56,846][123090] Updated weights for policy 1, policy_version 426946 (0.0010) [2023-12-26 03:00:56,908][123090] Updated weights for policy 1, policy_version 426956 (0.0009) [2023-12-26 03:00:56,976][123090] Updated weights for policy 1, policy_version 426966 (0.0010) [2023-12-26 03:00:57,035][123090] Updated weights for policy 1, policy_version 426976 (0.0010) [2023-12-26 03:00:57,398][123091] Updated weights for policy 0, policy_version 429684 (0.0010) [2023-12-26 03:00:57,472][123091] Updated weights for policy 0, policy_version 429694 (0.0008) [2023-12-26 03:00:57,537][123091] Updated weights for policy 0, policy_version 429704 (0.0008) [2023-12-26 03:00:57,844][123090] Updated weights for policy 1, policy_version 426986 (0.0005) [2023-12-26 03:00:57,907][123090] Updated weights for policy 1, policy_version 426996 (0.0005) [2023-12-26 03:00:57,981][123090] Updated weights for policy 1, policy_version 427006 (0.0006) [2023-12-26 03:00:58,304][123091] Updated weights for policy 0, policy_version 429714 (0.0008) [2023-12-26 03:00:58,377][123091] Updated weights for policy 0, policy_version 429724 (0.0008) [2023-12-26 03:00:58,444][123091] Updated weights for policy 0, policy_version 429734 (0.0007) [2023-12-26 03:00:58,514][123091] Updated weights for policy 0, policy_version 429744 (0.0011) [2023-12-26 03:00:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 219332608. Throughput: 0: 8940.7, 1: 9036.8. Samples: 219327832. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:00:58,785][121949] Avg episode reward: [(0, '6036.459'), (1, '5166.597')] [2023-12-26 03:00:58,940][123090] Updated weights for policy 1, policy_version 427016 (0.0009) [2023-12-26 03:00:59,012][123090] Updated weights for policy 1, policy_version 427026 (0.0010) [2023-12-26 03:00:59,077][123090] Updated weights for policy 1, policy_version 427036 (0.0009) [2023-12-26 03:00:59,417][123091] Updated weights for policy 0, policy_version 429754 (0.0008) [2023-12-26 03:00:59,480][123091] Updated weights for policy 0, policy_version 429764 (0.0011) [2023-12-26 03:00:59,547][123091] Updated weights for policy 0, policy_version 429774 (0.0011) [2023-12-26 03:00:59,872][123090] Updated weights for policy 1, policy_version 427046 (0.0008) [2023-12-26 03:00:59,945][123090] Updated weights for policy 1, policy_version 427056 (0.0008) [2023-12-26 03:01:00,005][123090] Updated weights for policy 1, policy_version 427066 (0.0011) [2023-12-26 03:01:00,318][123091] Updated weights for policy 0, policy_version 429784 (0.0007) [2023-12-26 03:01:00,382][123091] Updated weights for policy 0, policy_version 429794 (0.0005) [2023-12-26 03:01:00,439][123091] Updated weights for policy 0, policy_version 429804 (0.0010) [2023-12-26 03:01:00,806][123090] Updated weights for policy 1, policy_version 427076 (0.0009) [2023-12-26 03:01:00,856][123090] Updated weights for policy 1, policy_version 427086 (0.0005) [2023-12-26 03:01:00,909][123090] Updated weights for policy 1, policy_version 427096 (0.0007) [2023-12-26 03:01:01,089][123091] Updated weights for policy 0, policy_version 429814 (0.0009) [2023-12-26 03:01:01,159][123091] Updated weights for policy 0, policy_version 429824 (0.0008) [2023-12-26 03:01:01,226][123091] Updated weights for policy 0, policy_version 429834 (0.0008) [2023-12-26 03:01:01,792][123090] Updated weights for policy 1, policy_version 427106 (0.0009) [2023-12-26 03:01:01,858][123090] Updated weights for policy 1, policy_version 427116 (0.0009) [2023-12-26 03:01:01,919][123090] Updated weights for policy 1, policy_version 427126 (0.0009) [2023-12-26 03:01:01,981][123090] Updated weights for policy 1, policy_version 427136 (0.0008) [2023-12-26 03:01:02,068][123091] Updated weights for policy 0, policy_version 429844 (0.0009) [2023-12-26 03:01:02,128][123091] Updated weights for policy 0, policy_version 429854 (0.0011) [2023-12-26 03:01:02,178][123091] Updated weights for policy 0, policy_version 429864 (0.0008) [2023-12-26 03:01:02,843][123090] Updated weights for policy 1, policy_version 427146 (0.0010) [2023-12-26 03:01:02,907][123090] Updated weights for policy 1, policy_version 427156 (0.0011) [2023-12-26 03:01:02,966][123090] Updated weights for policy 1, policy_version 427166 (0.0010) [2023-12-26 03:01:02,969][123091] Updated weights for policy 0, policy_version 429874 (0.0005) [2023-12-26 03:01:03,030][123091] Updated weights for policy 0, policy_version 429884 (0.0007) [2023-12-26 03:01:03,082][123091] Updated weights for policy 0, policy_version 429894 (0.0009) [2023-12-26 03:01:03,147][123091] Updated weights for policy 0, policy_version 429904 (0.0008) [2023-12-26 03:01:03,777][123090] Updated weights for policy 1, policy_version 427176 (0.0007) [2023-12-26 03:01:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 219414528. Throughput: 0: 8910.0, 1: 8779.1. Samples: 219430128. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:01:03,785][121949] Avg episode reward: [(0, '6021.324'), (1, '5272.686')] [2023-12-26 03:01:03,828][123090] Updated weights for policy 1, policy_version 427186 (0.0006) [2023-12-26 03:01:03,908][123090] Updated weights for policy 1, policy_version 427196 (0.0007) [2023-12-26 03:01:04,003][123091] Updated weights for policy 0, policy_version 429914 (0.0008) [2023-12-26 03:01:04,067][123091] Updated weights for policy 0, policy_version 429924 (0.0009) [2023-12-26 03:01:04,133][123091] Updated weights for policy 0, policy_version 429934 (0.0009) [2023-12-26 03:01:04,722][123090] Updated weights for policy 1, policy_version 427206 (0.0010) [2023-12-26 03:01:04,791][123090] Updated weights for policy 1, policy_version 427216 (0.0011) [2023-12-26 03:01:04,854][123090] Updated weights for policy 1, policy_version 427226 (0.0011) [2023-12-26 03:01:04,945][123091] Updated weights for policy 0, policy_version 429944 (0.0009) [2023-12-26 03:01:04,998][123091] Updated weights for policy 0, policy_version 429954 (0.0009) [2023-12-26 03:01:05,054][123091] Updated weights for policy 0, policy_version 429964 (0.0009) [2023-12-26 03:01:05,681][123090] Updated weights for policy 1, policy_version 427236 (0.0011) [2023-12-26 03:01:05,752][123090] Updated weights for policy 1, policy_version 427246 (0.0011) [2023-12-26 03:01:05,823][123090] Updated weights for policy 1, policy_version 427256 (0.0011) [2023-12-26 03:01:05,898][123091] Updated weights for policy 0, policy_version 429974 (0.0007) [2023-12-26 03:01:05,953][123091] Updated weights for policy 0, policy_version 429984 (0.0006) [2023-12-26 03:01:06,013][123091] Updated weights for policy 0, policy_version 429994 (0.0011) [2023-12-26 03:01:06,620][123090] Updated weights for policy 1, policy_version 427266 (0.0011) [2023-12-26 03:01:06,692][123090] Updated weights for policy 1, policy_version 427276 (0.0011) [2023-12-26 03:01:06,761][123090] Updated weights for policy 1, policy_version 427286 (0.0006) [2023-12-26 03:01:06,830][123090] Updated weights for policy 1, policy_version 427296 (0.0006) [2023-12-26 03:01:06,862][123091] Updated weights for policy 0, policy_version 430004 (0.0010) [2023-12-26 03:01:06,923][123091] Updated weights for policy 0, policy_version 430014 (0.0009) [2023-12-26 03:01:07,007][123091] Updated weights for policy 0, policy_version 430024 (0.0010) [2023-12-26 03:01:07,564][123090] Updated weights for policy 1, policy_version 427306 (0.0010) [2023-12-26 03:01:07,611][123090] Updated weights for policy 1, policy_version 427316 (0.0010) [2023-12-26 03:01:07,672][123090] Updated weights for policy 1, policy_version 427326 (0.0010) [2023-12-26 03:01:07,850][123091] Updated weights for policy 0, policy_version 430034 (0.0009) [2023-12-26 03:01:07,911][123091] Updated weights for policy 0, policy_version 430044 (0.0006) [2023-12-26 03:01:07,970][123091] Updated weights for policy 0, policy_version 430054 (0.0006) [2023-12-26 03:01:08,033][123091] Updated weights for policy 0, policy_version 430064 (0.0010) [2023-12-26 03:01:08,445][123090] Updated weights for policy 1, policy_version 427336 (0.0010) [2023-12-26 03:01:08,496][123090] Updated weights for policy 1, policy_version 427346 (0.0010) [2023-12-26 03:01:08,559][123090] Updated weights for policy 1, policy_version 427356 (0.0010) [2023-12-26 03:01:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 219504640. Throughput: 0: 8919.0, 1: 8777.3. Samples: 219481404. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:01:08,785][121949] Avg episode reward: [(0, '6106.696'), (1, '5132.021')] [2023-12-26 03:01:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000427360_109404160.pth... [2023-12-26 03:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000426368_109150208.pth [2023-12-26 03:01:08,846][123091] Updated weights for policy 0, policy_version 430074 (0.0011) [2023-12-26 03:01:08,913][123091] Updated weights for policy 0, policy_version 430084 (0.0011) [2023-12-26 03:01:08,971][123091] Updated weights for policy 0, policy_version 430094 (0.0010) [2023-12-26 03:01:08,979][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000430096_110108672.pth... [2023-12-26 03:01:08,982][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000429040_109838336.pth [2023-12-26 03:01:09,410][123090] Updated weights for policy 1, policy_version 427366 (0.0010) [2023-12-26 03:01:09,476][123090] Updated weights for policy 1, policy_version 427376 (0.0009) [2023-12-26 03:01:09,543][123090] Updated weights for policy 1, policy_version 427386 (0.0005) [2023-12-26 03:01:09,792][123091] Updated weights for policy 0, policy_version 430104 (0.0010) [2023-12-26 03:01:09,858][123091] Updated weights for policy 0, policy_version 430114 (0.0009) [2023-12-26 03:01:09,928][123091] Updated weights for policy 0, policy_version 430124 (0.0010) [2023-12-26 03:01:10,283][123090] Updated weights for policy 1, policy_version 427396 (0.0006) [2023-12-26 03:01:10,338][123090] Updated weights for policy 1, policy_version 427406 (0.0006) [2023-12-26 03:01:10,405][123090] Updated weights for policy 1, policy_version 427416 (0.0007) [2023-12-26 03:01:10,718][123091] Updated weights for policy 0, policy_version 430134 (0.0008) [2023-12-26 03:01:10,773][123091] Updated weights for policy 0, policy_version 430144 (0.0005) [2023-12-26 03:01:10,826][123091] Updated weights for policy 0, policy_version 430154 (0.0005) [2023-12-26 03:01:11,149][123090] Updated weights for policy 1, policy_version 427426 (0.0008) [2023-12-26 03:01:11,210][123090] Updated weights for policy 1, policy_version 427436 (0.0010) [2023-12-26 03:01:11,279][123090] Updated weights for policy 1, policy_version 427446 (0.0009) [2023-12-26 03:01:11,349][123090] Updated weights for policy 1, policy_version 427456 (0.0009) [2023-12-26 03:01:11,661][123091] Updated weights for policy 0, policy_version 430164 (0.0007) [2023-12-26 03:01:11,719][123091] Updated weights for policy 0, policy_version 430174 (0.0009) [2023-12-26 03:01:11,796][123091] Updated weights for policy 0, policy_version 430184 (0.0009) [2023-12-26 03:01:12,202][123090] Updated weights for policy 1, policy_version 427466 (0.0009) [2023-12-26 03:01:12,276][123090] Updated weights for policy 1, policy_version 427476 (0.0010) [2023-12-26 03:01:12,341][123090] Updated weights for policy 1, policy_version 427486 (0.0010) [2023-12-26 03:01:12,587][123091] Updated weights for policy 0, policy_version 430194 (0.0009) [2023-12-26 03:01:12,650][123091] Updated weights for policy 0, policy_version 430204 (0.0009) [2023-12-26 03:01:12,722][123091] Updated weights for policy 0, policy_version 430214 (0.0010) [2023-12-26 03:01:12,804][123091] Updated weights for policy 0, policy_version 430224 (0.0010) [2023-12-26 03:01:13,125][123090] Updated weights for policy 1, policy_version 427496 (0.0010) [2023-12-26 03:01:13,185][123090] Updated weights for policy 1, policy_version 427506 (0.0010) [2023-12-26 03:01:13,253][123090] Updated weights for policy 1, policy_version 427516 (0.0009) [2023-12-26 03:01:13,607][123091] Updated weights for policy 0, policy_version 430234 (0.0010) [2023-12-26 03:01:13,660][123091] Updated weights for policy 0, policy_version 430244 (0.0009) [2023-12-26 03:01:13,716][123091] Updated weights for policy 0, policy_version 430254 (0.0009) [2023-12-26 03:01:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 219594752. Throughput: 0: 8925.8, 1: 8725.5. Samples: 219585608. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:01:13,785][121949] Avg episode reward: [(0, '6007.990'), (1, '4770.473')] [2023-12-26 03:01:14,080][123090] Updated weights for policy 1, policy_version 427526 (0.0007) [2023-12-26 03:01:14,155][123090] Updated weights for policy 1, policy_version 427536 (0.0008) [2023-12-26 03:01:14,219][123090] Updated weights for policy 1, policy_version 427546 (0.0010) [2023-12-26 03:01:14,546][123091] Updated weights for policy 0, policy_version 430264 (0.0010) [2023-12-26 03:01:14,612][123091] Updated weights for policy 0, policy_version 430274 (0.0009) [2023-12-26 03:01:14,679][123091] Updated weights for policy 0, policy_version 430284 (0.0009) [2023-12-26 03:01:15,010][123090] Updated weights for policy 1, policy_version 427556 (0.0010) [2023-12-26 03:01:15,062][123090] Updated weights for policy 1, policy_version 427566 (0.0009) [2023-12-26 03:01:15,128][123090] Updated weights for policy 1, policy_version 427576 (0.0007) [2023-12-26 03:01:15,519][123091] Updated weights for policy 0, policy_version 430294 (0.0007) [2023-12-26 03:01:15,593][123091] Updated weights for policy 0, policy_version 430304 (0.0005) [2023-12-26 03:01:15,647][123091] Updated weights for policy 0, policy_version 430314 (0.0005) [2023-12-26 03:01:15,850][123090] Updated weights for policy 1, policy_version 427586 (0.0008) [2023-12-26 03:01:15,920][123090] Updated weights for policy 1, policy_version 427596 (0.0009) [2023-12-26 03:01:15,979][123090] Updated weights for policy 1, policy_version 427606 (0.0010) [2023-12-26 03:01:16,042][123090] Updated weights for policy 1, policy_version 427616 (0.0010) [2023-12-26 03:01:16,365][123091] Updated weights for policy 0, policy_version 430324 (0.0007) [2023-12-26 03:01:16,427][123091] Updated weights for policy 0, policy_version 430334 (0.0010) [2023-12-26 03:01:16,494][123091] Updated weights for policy 0, policy_version 430344 (0.0009) [2023-12-26 03:01:16,816][123090] Updated weights for policy 1, policy_version 427626 (0.0010) [2023-12-26 03:01:16,867][123090] Updated weights for policy 1, policy_version 427636 (0.0010) [2023-12-26 03:01:16,926][123090] Updated weights for policy 1, policy_version 427646 (0.0009) [2023-12-26 03:01:17,316][123091] Updated weights for policy 0, policy_version 430354 (0.0009) [2023-12-26 03:01:17,375][123091] Updated weights for policy 0, policy_version 430364 (0.0008) [2023-12-26 03:01:17,438][123091] Updated weights for policy 0, policy_version 430374 (0.0008) [2023-12-26 03:01:17,489][123091] Updated weights for policy 0, policy_version 430384 (0.0009) [2023-12-26 03:01:17,791][123090] Updated weights for policy 1, policy_version 427656 (0.0010) [2023-12-26 03:01:17,867][123090] Updated weights for policy 1, policy_version 427666 (0.0005) [2023-12-26 03:01:17,939][123090] Updated weights for policy 1, policy_version 427676 (0.0008) [2023-12-26 03:01:18,324][123091] Updated weights for policy 0, policy_version 430394 (0.0010) [2023-12-26 03:01:18,395][123091] Updated weights for policy 0, policy_version 430404 (0.0009) [2023-12-26 03:01:18,457][123091] Updated weights for policy 0, policy_version 430414 (0.0010) [2023-12-26 03:01:18,618][123090] Updated weights for policy 1, policy_version 427686 (0.0008) [2023-12-26 03:01:18,680][123090] Updated weights for policy 1, policy_version 427696 (0.0006) [2023-12-26 03:01:18,752][123090] Updated weights for policy 1, policy_version 427706 (0.0006) [2023-12-26 03:01:18,788][121949] Fps is (10 sec: 18016.0, 60 sec: 17748.3, 300 sec: 17744.5). Total num frames: 219684864. Throughput: 0: 8845.6, 1: 8694.0. Samples: 219690904. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:01:18,789][121949] Avg episode reward: [(0, '5985.790'), (1, '4738.959')] [2023-12-26 03:01:19,313][123091] Updated weights for policy 0, policy_version 430424 (0.0007) [2023-12-26 03:01:19,388][123091] Updated weights for policy 0, policy_version 430434 (0.0006) [2023-12-26 03:01:19,454][123091] Updated weights for policy 0, policy_version 430444 (0.0007) [2023-12-26 03:01:19,462][123090] Updated weights for policy 1, policy_version 427716 (0.0006) [2023-12-26 03:01:19,533][123090] Updated weights for policy 1, policy_version 427726 (0.0011) [2023-12-26 03:01:19,600][123090] Updated weights for policy 1, policy_version 427736 (0.0010) [2023-12-26 03:01:20,351][123090] Updated weights for policy 1, policy_version 427746 (0.0010) [2023-12-26 03:01:20,362][123091] Updated weights for policy 0, policy_version 430454 (0.0008) [2023-12-26 03:01:20,412][123090] Updated weights for policy 1, policy_version 427756 (0.0006) [2023-12-26 03:01:20,416][123091] Updated weights for policy 0, policy_version 430464 (0.0008) [2023-12-26 03:01:20,478][123090] Updated weights for policy 1, policy_version 427766 (0.0006) [2023-12-26 03:01:20,487][123091] Updated weights for policy 0, policy_version 430474 (0.0008) [2023-12-26 03:01:20,538][123090] Updated weights for policy 1, policy_version 427776 (0.0005) [2023-12-26 03:01:21,228][123090] Updated weights for policy 1, policy_version 427786 (0.0006) [2023-12-26 03:01:21,302][123090] Updated weights for policy 1, policy_version 427796 (0.0008) [2023-12-26 03:01:21,374][123090] Updated weights for policy 1, policy_version 427806 (0.0007) [2023-12-26 03:01:21,426][123091] Updated weights for policy 0, policy_version 430484 (0.0008) [2023-12-26 03:01:21,482][123091] Updated weights for policy 0, policy_version 430494 (0.0009) [2023-12-26 03:01:21,552][123091] Updated weights for policy 0, policy_version 430504 (0.0009) [2023-12-26 03:01:22,115][123090] Updated weights for policy 1, policy_version 427816 (0.0009) [2023-12-26 03:01:22,167][123090] Updated weights for policy 1, policy_version 427826 (0.0008) [2023-12-26 03:01:22,221][123090] Updated weights for policy 1, policy_version 427836 (0.0009) [2023-12-26 03:01:22,412][123091] Updated weights for policy 0, policy_version 430514 (0.0009) [2023-12-26 03:01:22,472][123091] Updated weights for policy 0, policy_version 430524 (0.0009) [2023-12-26 03:01:22,526][123091] Updated weights for policy 0, policy_version 430534 (0.0010) [2023-12-26 03:01:22,590][123091] Updated weights for policy 0, policy_version 430544 (0.0010) [2023-12-26 03:01:23,084][123090] Updated weights for policy 1, policy_version 427846 (0.0009) [2023-12-26 03:01:23,139][123090] Updated weights for policy 1, policy_version 427856 (0.0009) [2023-12-26 03:01:23,195][123090] Updated weights for policy 1, policy_version 427866 (0.0009) [2023-12-26 03:01:23,441][123091] Updated weights for policy 0, policy_version 430554 (0.0010) [2023-12-26 03:01:23,506][123091] Updated weights for policy 0, policy_version 430564 (0.0009) [2023-12-26 03:01:23,574][123091] Updated weights for policy 0, policy_version 430574 (0.0010) [2023-12-26 03:01:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 219766784. Throughput: 0: 8782.9, 1: 8685.4. Samples: 219743708. Policy #0 lag: (min: 31.0, avg: 33.6, max: 63.0) [2023-12-26 03:01:23,786][121949] Avg episode reward: [(0, '5942.853'), (1, '4932.883')] [2023-12-26 03:01:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000430576_110231552.pth... [2023-12-26 03:01:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000427872_109535232.pth... [2023-12-26 03:01:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000426848_109273088.pth [2023-12-26 03:01:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000429552_109969408.pth [2023-12-26 03:01:24,070][123090] Updated weights for policy 1, policy_version 427876 (0.0009) [2023-12-26 03:01:24,130][123090] Updated weights for policy 1, policy_version 427886 (0.0010) [2023-12-26 03:01:24,182][123090] Updated weights for policy 1, policy_version 427896 (0.0007) [2023-12-26 03:01:24,411][123091] Updated weights for policy 0, policy_version 430584 (0.0011) [2023-12-26 03:01:24,468][123091] Updated weights for policy 0, policy_version 430594 (0.0011) [2023-12-26 03:01:24,531][123091] Updated weights for policy 0, policy_version 430604 (0.0009) [2023-12-26 03:01:25,078][123090] Updated weights for policy 1, policy_version 427906 (0.0009) [2023-12-26 03:01:25,132][123090] Updated weights for policy 1, policy_version 427918 (0.0011) [2023-12-26 03:01:25,177][123090] Updated weights for policy 1, policy_version 427928 (0.0007) [2023-12-26 03:01:25,187][123091] Updated weights for policy 0, policy_version 430614 (0.0005) [2023-12-26 03:01:25,250][123091] Updated weights for policy 0, policy_version 430624 (0.0009) [2023-12-26 03:01:25,320][123091] Updated weights for policy 0, policy_version 430634 (0.0008) [2023-12-26 03:01:26,004][123090] Updated weights for policy 1, policy_version 427938 (0.0006) [2023-12-26 03:01:26,063][123091] Updated weights for policy 0, policy_version 430644 (0.0010) [2023-12-26 03:01:26,067][123090] Updated weights for policy 1, policy_version 427948 (0.0010) [2023-12-26 03:01:26,111][123091] Updated weights for policy 0, policy_version 430654 (0.0010) [2023-12-26 03:01:26,127][123090] Updated weights for policy 1, policy_version 427958 (0.0010) [2023-12-26 03:01:26,165][123091] Updated weights for policy 0, policy_version 430664 (0.0008) [2023-12-26 03:01:26,182][123090] Updated weights for policy 1, policy_version 427968 (0.0010) [2023-12-26 03:01:26,824][123091] Updated weights for policy 0, policy_version 430674 (0.0005) [2023-12-26 03:01:26,885][123091] Updated weights for policy 0, policy_version 430684 (0.0005) [2023-12-26 03:01:26,942][123091] Updated weights for policy 0, policy_version 430694 (0.0005) [2023-12-26 03:01:26,951][123090] Updated weights for policy 1, policy_version 427978 (0.0006) [2023-12-26 03:01:26,986][123091] Updated weights for policy 0, policy_version 430704 (0.0005) [2023-12-26 03:01:27,001][123090] Updated weights for policy 1, policy_version 427988 (0.0009) [2023-12-26 03:01:27,060][123090] Updated weights for policy 1, policy_version 427999 (0.0010) [2023-12-26 03:01:27,725][123091] Updated weights for policy 0, policy_version 430714 (0.0011) [2023-12-26 03:01:27,793][123091] Updated weights for policy 0, policy_version 430724 (0.0011) [2023-12-26 03:01:27,856][123091] Updated weights for policy 0, policy_version 430734 (0.0011) [2023-12-26 03:01:27,943][123090] Updated weights for policy 1, policy_version 428009 (0.0010) [2023-12-26 03:01:27,998][123090] Updated weights for policy 1, policy_version 428020 (0.0010) [2023-12-26 03:01:28,050][123090] Updated weights for policy 1, policy_version 428030 (0.0010) [2023-12-26 03:01:28,554][123091] Updated weights for policy 0, policy_version 430744 (0.0006) [2023-12-26 03:01:28,602][123091] Updated weights for policy 0, policy_version 430754 (0.0006) [2023-12-26 03:01:28,652][123091] Updated weights for policy 0, policy_version 430764 (0.0006) [2023-12-26 03:01:28,784][121949] Fps is (10 sec: 17209.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 219856896. Throughput: 0: 8847.3, 1: 8645.9. Samples: 219850100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:28,785][121949] Avg episode reward: [(0, '5842.460'), (1, '4797.093')] [2023-12-26 03:01:28,920][123090] Updated weights for policy 1, policy_version 428040 (0.0009) [2023-12-26 03:01:28,982][123090] Updated weights for policy 1, policy_version 428050 (0.0009) [2023-12-26 03:01:29,045][123090] Updated weights for policy 1, policy_version 428060 (0.0009) [2023-12-26 03:01:29,462][123091] Updated weights for policy 0, policy_version 430774 (0.0008) [2023-12-26 03:01:29,521][123091] Updated weights for policy 0, policy_version 430785 (0.0008) [2023-12-26 03:01:29,577][123091] Updated weights for policy 0, policy_version 430795 (0.0009) [2023-12-26 03:01:29,866][123090] Updated weights for policy 1, policy_version 428070 (0.0009) [2023-12-26 03:01:29,934][123090] Updated weights for policy 1, policy_version 428080 (0.0009) [2023-12-26 03:01:29,992][123090] Updated weights for policy 1, policy_version 428090 (0.0010) [2023-12-26 03:01:30,404][123091] Updated weights for policy 0, policy_version 430805 (0.0009) [2023-12-26 03:01:30,465][123091] Updated weights for policy 0, policy_version 430815 (0.0010) [2023-12-26 03:01:30,518][123091] Updated weights for policy 0, policy_version 430826 (0.0009) [2023-12-26 03:01:30,771][123090] Updated weights for policy 1, policy_version 428101 (0.0008) [2023-12-26 03:01:30,826][123090] Updated weights for policy 1, policy_version 428111 (0.0006) [2023-12-26 03:01:30,874][123090] Updated weights for policy 1, policy_version 428121 (0.0008) [2023-12-26 03:01:31,417][123091] Updated weights for policy 0, policy_version 430836 (0.0009) [2023-12-26 03:01:31,482][123091] Updated weights for policy 0, policy_version 430846 (0.0006) [2023-12-26 03:01:31,551][123091] Updated weights for policy 0, policy_version 430856 (0.0006) [2023-12-26 03:01:31,621][123090] Updated weights for policy 1, policy_version 428131 (0.0008) [2023-12-26 03:01:31,687][123090] Updated weights for policy 1, policy_version 428141 (0.0010) [2023-12-26 03:01:31,759][123090] Updated weights for policy 1, policy_version 428151 (0.0009) [2023-12-26 03:01:32,358][123091] Updated weights for policy 0, policy_version 430866 (0.0007) [2023-12-26 03:01:32,419][123091] Updated weights for policy 0, policy_version 430876 (0.0010) [2023-12-26 03:01:32,486][123091] Updated weights for policy 0, policy_version 430886 (0.0009) [2023-12-26 03:01:32,495][123090] Updated weights for policy 1, policy_version 428161 (0.0006) [2023-12-26 03:01:32,548][123091] Updated weights for policy 0, policy_version 430896 (0.0009) [2023-12-26 03:01:32,559][123090] Updated weights for policy 1, policy_version 428171 (0.0007) [2023-12-26 03:01:32,623][123090] Updated weights for policy 1, policy_version 428181 (0.0008) [2023-12-26 03:01:32,680][123090] Updated weights for policy 1, policy_version 428191 (0.0006) [2023-12-26 03:01:33,297][123091] Updated weights for policy 0, policy_version 430906 (0.0005) [2023-12-26 03:01:33,333][123090] Updated weights for policy 1, policy_version 428201 (0.0005) [2023-12-26 03:01:33,344][123091] Updated weights for policy 0, policy_version 430916 (0.0008) [2023-12-26 03:01:33,393][123091] Updated weights for policy 0, policy_version 430926 (0.0009) [2023-12-26 03:01:33,398][123090] Updated weights for policy 1, policy_version 428211 (0.0005) [2023-12-26 03:01:33,454][123090] Updated weights for policy 1, policy_version 428221 (0.0005) [2023-12-26 03:01:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 219947008. Throughput: 0: 8765.6, 1: 8718.7. Samples: 219958708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:33,784][121949] Avg episode reward: [(0, '5725.025'), (1, '4827.078')] [2023-12-26 03:01:34,069][123091] Updated weights for policy 0, policy_version 430936 (0.0009) [2023-12-26 03:01:34,121][123090] Updated weights for policy 1, policy_version 428231 (0.0007) [2023-12-26 03:01:34,128][123091] Updated weights for policy 0, policy_version 430946 (0.0008) [2023-12-26 03:01:34,185][123090] Updated weights for policy 1, policy_version 428241 (0.0008) [2023-12-26 03:01:34,201][123091] Updated weights for policy 0, policy_version 430956 (0.0010) [2023-12-26 03:01:34,254][123090] Updated weights for policy 1, policy_version 428251 (0.0008) [2023-12-26 03:01:35,061][123090] Updated weights for policy 1, policy_version 428261 (0.0008) [2023-12-26 03:01:35,063][123091] Updated weights for policy 0, policy_version 430966 (0.0008) [2023-12-26 03:01:35,112][123091] Updated weights for policy 0, policy_version 430976 (0.0009) [2023-12-26 03:01:35,123][123090] Updated weights for policy 1, policy_version 428271 (0.0008) [2023-12-26 03:01:35,164][123091] Updated weights for policy 0, policy_version 430986 (0.0007) [2023-12-26 03:01:35,189][123090] Updated weights for policy 1, policy_version 428281 (0.0007) [2023-12-26 03:01:36,001][123090] Updated weights for policy 1, policy_version 428291 (0.0010) [2023-12-26 03:01:36,006][123091] Updated weights for policy 0, policy_version 430996 (0.0009) [2023-12-26 03:01:36,064][123090] Updated weights for policy 1, policy_version 428301 (0.0008) [2023-12-26 03:01:36,097][123091] Updated weights for policy 0, policy_version 431006 (0.0008) [2023-12-26 03:01:36,135][123090] Updated weights for policy 1, policy_version 428311 (0.0009) [2023-12-26 03:01:36,161][123091] Updated weights for policy 0, policy_version 431016 (0.0010) [2023-12-26 03:01:36,931][123090] Updated weights for policy 1, policy_version 428321 (0.0008) [2023-12-26 03:01:36,974][123091] Updated weights for policy 0, policy_version 431026 (0.0009) [2023-12-26 03:01:36,994][123090] Updated weights for policy 1, policy_version 428331 (0.0010) [2023-12-26 03:01:37,031][123091] Updated weights for policy 0, policy_version 431036 (0.0006) [2023-12-26 03:01:37,054][123090] Updated weights for policy 1, policy_version 428341 (0.0010) [2023-12-26 03:01:37,087][123091] Updated weights for policy 0, policy_version 431046 (0.0006) [2023-12-26 03:01:37,117][123090] Updated weights for policy 1, policy_version 428351 (0.0010) [2023-12-26 03:01:37,155][123091] Updated weights for policy 0, policy_version 431056 (0.0007) [2023-12-26 03:01:37,900][123090] Updated weights for policy 1, policy_version 428361 (0.0010) [2023-12-26 03:01:37,959][123090] Updated weights for policy 1, policy_version 428371 (0.0010) [2023-12-26 03:01:38,015][123090] Updated weights for policy 1, policy_version 428381 (0.0010) [2023-12-26 03:01:38,021][123091] Updated weights for policy 0, policy_version 431066 (0.0006) [2023-12-26 03:01:38,071][123091] Updated weights for policy 0, policy_version 431076 (0.0008) [2023-12-26 03:01:38,119][123091] Updated weights for policy 0, policy_version 431086 (0.0009) [2023-12-26 03:01:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 220028928. Throughput: 0: 8739.0, 1: 8725.5. Samples: 220011108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:38,784][121949] Avg episode reward: [(0, '5834.525'), (1, '5072.686')] [2023-12-26 03:01:38,787][123090] Updated weights for policy 1, policy_version 428391 (0.0010) [2023-12-26 03:01:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000431088_110362624.pth... [2023-12-26 03:01:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000430096_110108672.pth [2023-12-26 03:01:38,851][123090] Updated weights for policy 1, policy_version 428401 (0.0011) [2023-12-26 03:01:38,914][123090] Updated weights for policy 1, policy_version 428411 (0.0010) [2023-12-26 03:01:38,939][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000428416_109674496.pth... [2023-12-26 03:01:38,944][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000427360_109404160.pth [2023-12-26 03:01:38,983][123091] Updated weights for policy 0, policy_version 431096 (0.0009) [2023-12-26 03:01:39,043][123091] Updated weights for policy 0, policy_version 431106 (0.0009) [2023-12-26 03:01:39,102][123091] Updated weights for policy 0, policy_version 431116 (0.0009) [2023-12-26 03:01:39,705][123090] Updated weights for policy 1, policy_version 428421 (0.0008) [2023-12-26 03:01:39,781][123090] Updated weights for policy 1, policy_version 428431 (0.0006) [2023-12-26 03:01:39,854][123090] Updated weights for policy 1, policy_version 428441 (0.0007) [2023-12-26 03:01:39,931][123091] Updated weights for policy 0, policy_version 431126 (0.0010) [2023-12-26 03:01:39,992][123091] Updated weights for policy 0, policy_version 431136 (0.0010) [2023-12-26 03:01:40,062][123091] Updated weights for policy 0, policy_version 431146 (0.0009) [2023-12-26 03:01:40,611][123090] Updated weights for policy 1, policy_version 428451 (0.0007) [2023-12-26 03:01:40,681][123090] Updated weights for policy 1, policy_version 428461 (0.0009) [2023-12-26 03:01:40,752][123090] Updated weights for policy 1, policy_version 428471 (0.0010) [2023-12-26 03:01:40,827][123091] Updated weights for policy 0, policy_version 431156 (0.0008) [2023-12-26 03:01:40,891][123091] Updated weights for policy 0, policy_version 431166 (0.0008) [2023-12-26 03:01:40,943][123091] Updated weights for policy 0, policy_version 431176 (0.0010) [2023-12-26 03:01:41,593][123090] Updated weights for policy 1, policy_version 428481 (0.0009) [2023-12-26 03:01:41,666][123090] Updated weights for policy 1, policy_version 428491 (0.0009) [2023-12-26 03:01:41,733][123090] Updated weights for policy 1, policy_version 428501 (0.0010) [2023-12-26 03:01:41,803][123091] Updated weights for policy 0, policy_version 431186 (0.0009) [2023-12-26 03:01:41,813][123090] Updated weights for policy 1, policy_version 428511 (0.0009) [2023-12-26 03:01:41,867][123091] Updated weights for policy 0, policy_version 431196 (0.0009) [2023-12-26 03:01:41,932][123091] Updated weights for policy 0, policy_version 431206 (0.0009) [2023-12-26 03:01:41,994][123091] Updated weights for policy 0, policy_version 431216 (0.0010) [2023-12-26 03:01:42,641][123090] Updated weights for policy 1, policy_version 428521 (0.0010) [2023-12-26 03:01:42,705][123090] Updated weights for policy 1, policy_version 428531 (0.0008) [2023-12-26 03:01:42,779][123090] Updated weights for policy 1, policy_version 428541 (0.0007) [2023-12-26 03:01:42,856][123091] Updated weights for policy 0, policy_version 431226 (0.0009) [2023-12-26 03:01:42,923][123091] Updated weights for policy 0, policy_version 431236 (0.0009) [2023-12-26 03:01:42,990][123091] Updated weights for policy 0, policy_version 431246 (0.0009) [2023-12-26 03:01:43,504][123090] Updated weights for policy 1, policy_version 428551 (0.0006) [2023-12-26 03:01:43,559][123090] Updated weights for policy 1, policy_version 428561 (0.0007) [2023-12-26 03:01:43,608][123090] Updated weights for policy 1, policy_version 428571 (0.0009) [2023-12-26 03:01:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 220119040. Throughput: 0: 8671.8, 1: 8794.9. Samples: 220113832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:43,784][121949] Avg episode reward: [(0, '5877.059'), (1, '4907.107')] [2023-12-26 03:01:43,836][123091] Updated weights for policy 0, policy_version 431256 (0.0009) [2023-12-26 03:01:43,897][123091] Updated weights for policy 0, policy_version 431266 (0.0008) [2023-12-26 03:01:43,958][123091] Updated weights for policy 0, policy_version 431276 (0.0010) [2023-12-26 03:01:44,435][123090] Updated weights for policy 1, policy_version 428581 (0.0009) [2023-12-26 03:01:44,493][123090] Updated weights for policy 1, policy_version 428591 (0.0009) [2023-12-26 03:01:44,555][123090] Updated weights for policy 1, policy_version 428601 (0.0009) [2023-12-26 03:01:44,775][123091] Updated weights for policy 0, policy_version 431286 (0.0010) [2023-12-26 03:01:44,845][123091] Updated weights for policy 0, policy_version 431296 (0.0009) [2023-12-26 03:01:44,911][123091] Updated weights for policy 0, policy_version 431306 (0.0010) [2023-12-26 03:01:45,386][123090] Updated weights for policy 1, policy_version 428611 (0.0010) [2023-12-26 03:01:45,446][123090] Updated weights for policy 1, policy_version 428621 (0.0009) [2023-12-26 03:01:45,505][123090] Updated weights for policy 1, policy_version 428631 (0.0010) [2023-12-26 03:01:45,753][123091] Updated weights for policy 0, policy_version 431316 (0.0010) [2023-12-26 03:01:45,816][123091] Updated weights for policy 0, policy_version 431326 (0.0009) [2023-12-26 03:01:45,883][123091] Updated weights for policy 0, policy_version 431336 (0.0009) [2023-12-26 03:01:46,324][123090] Updated weights for policy 1, policy_version 428641 (0.0009) [2023-12-26 03:01:46,386][123090] Updated weights for policy 1, policy_version 428651 (0.0009) [2023-12-26 03:01:46,433][123090] Updated weights for policy 1, policy_version 428661 (0.0009) [2023-12-26 03:01:46,494][123090] Updated weights for policy 1, policy_version 428671 (0.0008) [2023-12-26 03:01:46,710][123091] Updated weights for policy 0, policy_version 431346 (0.0009) [2023-12-26 03:01:46,776][123091] Updated weights for policy 0, policy_version 431356 (0.0010) [2023-12-26 03:01:46,838][123091] Updated weights for policy 0, policy_version 431366 (0.0009) [2023-12-26 03:01:46,900][123091] Updated weights for policy 0, policy_version 431376 (0.0009) [2023-12-26 03:01:47,312][123090] Updated weights for policy 1, policy_version 428681 (0.0009) [2023-12-26 03:01:47,364][123090] Updated weights for policy 1, policy_version 428691 (0.0009) [2023-12-26 03:01:47,419][123090] Updated weights for policy 1, policy_version 428701 (0.0009) [2023-12-26 03:01:47,705][123091] Updated weights for policy 0, policy_version 431386 (0.0009) [2023-12-26 03:01:47,760][123091] Updated weights for policy 0, policy_version 431396 (0.0009) [2023-12-26 03:01:47,820][123091] Updated weights for policy 0, policy_version 431406 (0.0009) [2023-12-26 03:01:48,287][123090] Updated weights for policy 1, policy_version 428711 (0.0009) [2023-12-26 03:01:48,356][123090] Updated weights for policy 1, policy_version 428721 (0.0009) [2023-12-26 03:01:48,416][123090] Updated weights for policy 1, policy_version 428731 (0.0010) [2023-12-26 03:01:48,610][123091] Updated weights for policy 0, policy_version 431416 (0.0009) [2023-12-26 03:01:48,666][123091] Updated weights for policy 0, policy_version 431426 (0.0008) [2023-12-26 03:01:48,723][123091] Updated weights for policy 0, policy_version 431436 (0.0010) [2023-12-26 03:01:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 220209152. Throughput: 0: 8658.7, 1: 8824.5. Samples: 220216872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:48,785][121949] Avg episode reward: [(0, '5909.796'), (1, '4900.923')] [2023-12-26 03:01:49,311][123090] Updated weights for policy 1, policy_version 428741 (0.0009) [2023-12-26 03:01:49,378][123091] Updated weights for policy 0, policy_version 431446 (0.0009) [2023-12-26 03:01:49,383][123090] Updated weights for policy 1, policy_version 428751 (0.0009) [2023-12-26 03:01:49,443][123090] Updated weights for policy 1, policy_version 428761 (0.0007) [2023-12-26 03:01:49,449][123091] Updated weights for policy 0, policy_version 431456 (0.0011) [2023-12-26 03:01:49,511][123091] Updated weights for policy 0, policy_version 431466 (0.0011) [2023-12-26 03:01:50,257][123090] Updated weights for policy 1, policy_version 428771 (0.0006) [2023-12-26 03:01:50,311][123090] Updated weights for policy 1, policy_version 428781 (0.0005) [2023-12-26 03:01:50,373][123090] Updated weights for policy 1, policy_version 428791 (0.0006) [2023-12-26 03:01:50,383][123091] Updated weights for policy 0, policy_version 431476 (0.0010) [2023-12-26 03:01:50,447][123091] Updated weights for policy 0, policy_version 431486 (0.0009) [2023-12-26 03:01:50,513][123091] Updated weights for policy 0, policy_version 431496 (0.0008) [2023-12-26 03:01:51,018][123090] Updated weights for policy 1, policy_version 428801 (0.0006) [2023-12-26 03:01:51,089][123090] Updated weights for policy 1, policy_version 428811 (0.0008) [2023-12-26 03:01:51,159][123090] Updated weights for policy 1, policy_version 428821 (0.0008) [2023-12-26 03:01:51,226][123090] Updated weights for policy 1, policy_version 428831 (0.0008) [2023-12-26 03:01:51,318][123091] Updated weights for policy 0, policy_version 431506 (0.0006) [2023-12-26 03:01:51,385][123091] Updated weights for policy 0, policy_version 431516 (0.0007) [2023-12-26 03:01:51,461][123091] Updated weights for policy 0, policy_version 431526 (0.0011) [2023-12-26 03:01:51,532][123091] Updated weights for policy 0, policy_version 431536 (0.0006) [2023-12-26 03:01:51,984][123090] Updated weights for policy 1, policy_version 428841 (0.0010) [2023-12-26 03:01:52,047][123090] Updated weights for policy 1, policy_version 428851 (0.0009) [2023-12-26 03:01:52,119][123090] Updated weights for policy 1, policy_version 428861 (0.0006) [2023-12-26 03:01:52,208][123091] Updated weights for policy 0, policy_version 431546 (0.0006) [2023-12-26 03:01:52,264][123091] Updated weights for policy 0, policy_version 431556 (0.0008) [2023-12-26 03:01:52,331][123091] Updated weights for policy 0, policy_version 431566 (0.0011) [2023-12-26 03:01:52,909][123090] Updated weights for policy 1, policy_version 428871 (0.0008) [2023-12-26 03:01:52,960][123090] Updated weights for policy 1, policy_version 428881 (0.0009) [2023-12-26 03:01:53,009][123090] Updated weights for policy 1, policy_version 428891 (0.0009) [2023-12-26 03:01:53,053][123091] Updated weights for policy 0, policy_version 431576 (0.0007) [2023-12-26 03:01:53,111][123091] Updated weights for policy 0, policy_version 431586 (0.0010) [2023-12-26 03:01:53,172][123091] Updated weights for policy 0, policy_version 431596 (0.0010) [2023-12-26 03:01:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 220291072. Throughput: 0: 8670.7, 1: 8861.9. Samples: 220270368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:53,785][121949] Avg episode reward: [(0, '5975.685'), (1, '5307.890')] [2023-12-26 03:01:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000431600_110493696.pth... [2023-12-26 03:01:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000428896_109797376.pth... [2023-12-26 03:01:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000430576_110231552.pth [2023-12-26 03:01:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000427872_109535232.pth [2023-12-26 03:01:53,834][123090] Updated weights for policy 1, policy_version 428901 (0.0009) [2023-12-26 03:01:53,887][123090] Updated weights for policy 1, policy_version 428911 (0.0005) [2023-12-26 03:01:53,951][123090] Updated weights for policy 1, policy_version 428921 (0.0008) [2023-12-26 03:01:53,979][123091] Updated weights for policy 0, policy_version 431606 (0.0007) [2023-12-26 03:01:54,042][123091] Updated weights for policy 0, policy_version 431616 (0.0005) [2023-12-26 03:01:54,099][123091] Updated weights for policy 0, policy_version 431626 (0.0005) [2023-12-26 03:01:54,639][123090] Updated weights for policy 1, policy_version 428931 (0.0008) [2023-12-26 03:01:54,696][123090] Updated weights for policy 1, policy_version 428941 (0.0005) [2023-12-26 03:01:54,761][123090] Updated weights for policy 1, policy_version 428951 (0.0008) [2023-12-26 03:01:54,796][123091] Updated weights for policy 0, policy_version 431636 (0.0005) [2023-12-26 03:01:54,842][123091] Updated weights for policy 0, policy_version 431646 (0.0005) [2023-12-26 03:01:54,905][123091] Updated weights for policy 0, policy_version 431657 (0.0008) [2023-12-26 03:01:55,554][123090] Updated weights for policy 1, policy_version 428961 (0.0006) [2023-12-26 03:01:55,605][123090] Updated weights for policy 1, policy_version 428971 (0.0009) [2023-12-26 03:01:55,656][123090] Updated weights for policy 1, policy_version 428981 (0.0009) [2023-12-26 03:01:55,657][123091] Updated weights for policy 0, policy_version 431667 (0.0007) [2023-12-26 03:01:55,702][123091] Updated weights for policy 0, policy_version 431677 (0.0007) [2023-12-26 03:01:55,704][123090] Updated weights for policy 1, policy_version 428991 (0.0007) [2023-12-26 03:01:55,755][123091] Updated weights for policy 0, policy_version 431687 (0.0008) [2023-12-26 03:01:56,567][123090] Updated weights for policy 1, policy_version 429001 (0.0009) [2023-12-26 03:01:56,590][123091] Updated weights for policy 0, policy_version 431697 (0.0009) [2023-12-26 03:01:56,615][123090] Updated weights for policy 1, policy_version 429011 (0.0008) [2023-12-26 03:01:56,638][123091] Updated weights for policy 0, policy_version 431707 (0.0008) [2023-12-26 03:01:56,660][123090] Updated weights for policy 1, policy_version 429021 (0.0010) [2023-12-26 03:01:56,691][123091] Updated weights for policy 0, policy_version 431717 (0.0009) [2023-12-26 03:01:56,753][123091] Updated weights for policy 0, policy_version 431727 (0.0006) [2023-12-26 03:01:57,537][123090] Updated weights for policy 1, policy_version 429031 (0.0009) [2023-12-26 03:01:57,557][123091] Updated weights for policy 0, policy_version 431737 (0.0008) [2023-12-26 03:01:57,594][123090] Updated weights for policy 1, policy_version 429041 (0.0007) [2023-12-26 03:01:57,614][123091] Updated weights for policy 0, policy_version 431747 (0.0008) [2023-12-26 03:01:57,655][123090] Updated weights for policy 1, policy_version 429051 (0.0008) [2023-12-26 03:01:57,676][123091] Updated weights for policy 0, policy_version 431757 (0.0007) [2023-12-26 03:01:58,556][123090] Updated weights for policy 1, policy_version 429061 (0.0011) [2023-12-26 03:01:58,582][123091] Updated weights for policy 0, policy_version 431767 (0.0009) [2023-12-26 03:01:58,626][123090] Updated weights for policy 1, policy_version 429071 (0.0011) [2023-12-26 03:01:58,650][123091] Updated weights for policy 0, policy_version 431777 (0.0008) [2023-12-26 03:01:58,700][123090] Updated weights for policy 1, policy_version 429081 (0.0010) [2023-12-26 03:01:58,724][123091] Updated weights for policy 0, policy_version 431787 (0.0007) [2023-12-26 03:01:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 220389376. Throughput: 0: 8749.5, 1: 8851.7. Samples: 220377656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:01:58,784][121949] Avg episode reward: [(0, '5957.999'), (1, '5349.166')] [2023-12-26 03:01:59,496][123090] Updated weights for policy 1, policy_version 429091 (0.0009) [2023-12-26 03:01:59,558][123090] Updated weights for policy 1, policy_version 429101 (0.0010) [2023-12-26 03:01:59,565][123091] Updated weights for policy 0, policy_version 431797 (0.0007) [2023-12-26 03:01:59,614][123090] Updated weights for policy 1, policy_version 429111 (0.0010) [2023-12-26 03:01:59,629][123091] Updated weights for policy 0, policy_version 431807 (0.0006) [2023-12-26 03:01:59,693][123091] Updated weights for policy 0, policy_version 431817 (0.0007) [2023-12-26 03:02:00,479][123091] Updated weights for policy 0, policy_version 431827 (0.0008) [2023-12-26 03:02:00,479][123090] Updated weights for policy 1, policy_version 429121 (0.0010) [2023-12-26 03:02:00,539][123091] Updated weights for policy 0, policy_version 431837 (0.0008) [2023-12-26 03:02:00,548][123090] Updated weights for policy 1, policy_version 429131 (0.0006) [2023-12-26 03:02:00,592][123091] Updated weights for policy 0, policy_version 431847 (0.0008) [2023-12-26 03:02:00,611][123090] Updated weights for policy 1, policy_version 429141 (0.0010) [2023-12-26 03:02:00,663][123090] Updated weights for policy 1, policy_version 429151 (0.0010) [2023-12-26 03:02:01,418][123090] Updated weights for policy 1, policy_version 429161 (0.0010) [2023-12-26 03:02:01,466][123090] Updated weights for policy 1, policy_version 429171 (0.0010) [2023-12-26 03:02:01,489][123091] Updated weights for policy 0, policy_version 431857 (0.0007) [2023-12-26 03:02:01,522][123090] Updated weights for policy 1, policy_version 429181 (0.0010) [2023-12-26 03:02:01,537][123091] Updated weights for policy 0, policy_version 431867 (0.0006) [2023-12-26 03:02:01,592][123091] Updated weights for policy 0, policy_version 431877 (0.0008) [2023-12-26 03:02:01,657][123091] Updated weights for policy 0, policy_version 431887 (0.0009) [2023-12-26 03:02:02,343][123090] Updated weights for policy 1, policy_version 429191 (0.0010) [2023-12-26 03:02:02,412][123090] Updated weights for policy 1, policy_version 429201 (0.0008) [2023-12-26 03:02:02,461][123090] Updated weights for policy 1, policy_version 429211 (0.0008) [2023-12-26 03:02:02,514][123091] Updated weights for policy 0, policy_version 431897 (0.0009) [2023-12-26 03:02:02,575][123091] Updated weights for policy 0, policy_version 431907 (0.0009) [2023-12-26 03:02:02,640][123091] Updated weights for policy 0, policy_version 431917 (0.0010) [2023-12-26 03:02:03,299][123090] Updated weights for policy 1, policy_version 429221 (0.0006) [2023-12-26 03:02:03,345][123090] Updated weights for policy 1, policy_version 429231 (0.0005) [2023-12-26 03:02:03,397][123090] Updated weights for policy 1, policy_version 429241 (0.0008) [2023-12-26 03:02:03,479][123091] Updated weights for policy 0, policy_version 431927 (0.0009) [2023-12-26 03:02:03,540][123091] Updated weights for policy 0, policy_version 431937 (0.0010) [2023-12-26 03:02:03,604][123091] Updated weights for policy 0, policy_version 431947 (0.0009) [2023-12-26 03:02:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 220471296. Throughput: 0: 8710.5, 1: 8810.5. Samples: 220479284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:03,785][121949] Avg episode reward: [(0, '5818.006'), (1, '5240.643')] [2023-12-26 03:02:04,224][123090] Updated weights for policy 1, policy_version 429251 (0.0010) [2023-12-26 03:02:04,293][123090] Updated weights for policy 1, policy_version 429261 (0.0009) [2023-12-26 03:02:04,361][123090] Updated weights for policy 1, policy_version 429271 (0.0009) [2023-12-26 03:02:04,448][123091] Updated weights for policy 0, policy_version 431957 (0.0009) [2023-12-26 03:02:04,518][123091] Updated weights for policy 0, policy_version 431967 (0.0009) [2023-12-26 03:02:04,581][123091] Updated weights for policy 0, policy_version 431977 (0.0010) [2023-12-26 03:02:05,091][123090] Updated weights for policy 1, policy_version 429281 (0.0010) [2023-12-26 03:02:05,157][123090] Updated weights for policy 1, policy_version 429291 (0.0009) [2023-12-26 03:02:05,221][123090] Updated weights for policy 1, policy_version 429301 (0.0006) [2023-12-26 03:02:05,279][123090] Updated weights for policy 1, policy_version 429311 (0.0005) [2023-12-26 03:02:05,489][123091] Updated weights for policy 0, policy_version 431987 (0.0010) [2023-12-26 03:02:05,540][123091] Updated weights for policy 0, policy_version 431997 (0.0009) [2023-12-26 03:02:05,594][123091] Updated weights for policy 0, policy_version 432007 (0.0011) [2023-12-26 03:02:06,007][123090] Updated weights for policy 1, policy_version 429321 (0.0009) [2023-12-26 03:02:06,059][123090] Updated weights for policy 1, policy_version 429331 (0.0007) [2023-12-26 03:02:06,121][123090] Updated weights for policy 1, policy_version 429341 (0.0008) [2023-12-26 03:02:06,479][123091] Updated weights for policy 0, policy_version 432018 (0.0010) [2023-12-26 03:02:06,554][123091] Updated weights for policy 0, policy_version 432028 (0.0011) [2023-12-26 03:02:06,614][123091] Updated weights for policy 0, policy_version 432038 (0.0011) [2023-12-26 03:02:06,663][123091] Updated weights for policy 0, policy_version 432048 (0.0011) [2023-12-26 03:02:06,896][123090] Updated weights for policy 1, policy_version 429351 (0.0008) [2023-12-26 03:02:06,967][123090] Updated weights for policy 1, policy_version 429361 (0.0008) [2023-12-26 03:02:07,022][123090] Updated weights for policy 1, policy_version 429371 (0.0010) [2023-12-26 03:02:07,489][123091] Updated weights for policy 0, policy_version 432058 (0.0011) [2023-12-26 03:02:07,541][123091] Updated weights for policy 0, policy_version 432068 (0.0010) [2023-12-26 03:02:07,586][123091] Updated weights for policy 0, policy_version 432078 (0.0010) [2023-12-26 03:02:07,726][123090] Updated weights for policy 1, policy_version 429381 (0.0008) [2023-12-26 03:02:07,788][123090] Updated weights for policy 1, policy_version 429391 (0.0005) [2023-12-26 03:02:07,852][123090] Updated weights for policy 1, policy_version 429401 (0.0005) [2023-12-26 03:02:08,448][123091] Updated weights for policy 0, policy_version 432088 (0.0011) [2023-12-26 03:02:08,513][123091] Updated weights for policy 0, policy_version 432098 (0.0010) [2023-12-26 03:02:08,572][123091] Updated weights for policy 0, policy_version 432108 (0.0005) [2023-12-26 03:02:08,574][123090] Updated weights for policy 1, policy_version 429411 (0.0006) [2023-12-26 03:02:08,629][123090] Updated weights for policy 1, policy_version 429421 (0.0006) [2023-12-26 03:02:08,685][123090] Updated weights for policy 1, policy_version 429431 (0.0010) [2023-12-26 03:02:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 220561408. Throughput: 0: 8713.7, 1: 8800.3. Samples: 220531836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:08,785][121949] Avg episode reward: [(0, '5753.054'), (1, '5276.710')] [2023-12-26 03:02:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000432112_110624768.pth... [2023-12-26 03:02:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000429440_109936640.pth... [2023-12-26 03:02:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000431088_110362624.pth [2023-12-26 03:02:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000428416_109674496.pth [2023-12-26 03:02:09,262][123091] Updated weights for policy 0, policy_version 432118 (0.0007) [2023-12-26 03:02:09,327][123091] Updated weights for policy 0, policy_version 432128 (0.0008) [2023-12-26 03:02:09,404][123091] Updated weights for policy 0, policy_version 432138 (0.0011) [2023-12-26 03:02:09,539][123090] Updated weights for policy 1, policy_version 429441 (0.0010) [2023-12-26 03:02:09,595][123090] Updated weights for policy 1, policy_version 429451 (0.0010) [2023-12-26 03:02:09,651][123090] Updated weights for policy 1, policy_version 429461 (0.0010) [2023-12-26 03:02:09,715][123090] Updated weights for policy 1, policy_version 429471 (0.0010) [2023-12-26 03:02:10,259][123091] Updated weights for policy 0, policy_version 432148 (0.0011) [2023-12-26 03:02:10,326][123091] Updated weights for policy 0, policy_version 432158 (0.0010) [2023-12-26 03:02:10,383][123091] Updated weights for policy 0, policy_version 432168 (0.0010) [2023-12-26 03:02:10,556][123090] Updated weights for policy 1, policy_version 429481 (0.0007) [2023-12-26 03:02:10,626][123090] Updated weights for policy 1, policy_version 429491 (0.0009) [2023-12-26 03:02:10,699][123090] Updated weights for policy 1, policy_version 429501 (0.0009) [2023-12-26 03:02:11,208][123091] Updated weights for policy 0, policy_version 432178 (0.0009) [2023-12-26 03:02:11,270][123091] Updated weights for policy 0, policy_version 432188 (0.0008) [2023-12-26 03:02:11,340][123091] Updated weights for policy 0, policy_version 432198 (0.0011) [2023-12-26 03:02:11,408][123091] Updated weights for policy 0, policy_version 432208 (0.0010) [2023-12-26 03:02:11,487][123090] Updated weights for policy 1, policy_version 429511 (0.0007) [2023-12-26 03:02:11,561][123090] Updated weights for policy 1, policy_version 429521 (0.0008) [2023-12-26 03:02:11,632][123090] Updated weights for policy 1, policy_version 429531 (0.0008) [2023-12-26 03:02:12,215][123091] Updated weights for policy 0, policy_version 432218 (0.0010) [2023-12-26 03:02:12,266][123091] Updated weights for policy 0, policy_version 432228 (0.0010) [2023-12-26 03:02:12,332][123091] Updated weights for policy 0, policy_version 432238 (0.0009) [2023-12-26 03:02:12,439][123090] Updated weights for policy 1, policy_version 429541 (0.0008) [2023-12-26 03:02:12,490][123090] Updated weights for policy 1, policy_version 429551 (0.0009) [2023-12-26 03:02:12,545][123090] Updated weights for policy 1, policy_version 429561 (0.0010) [2023-12-26 03:02:13,078][123091] Updated weights for policy 0, policy_version 432248 (0.0006) [2023-12-26 03:02:13,156][123091] Updated weights for policy 0, policy_version 432258 (0.0005) [2023-12-26 03:02:13,228][123091] Updated weights for policy 0, policy_version 432268 (0.0005) [2023-12-26 03:02:13,399][123090] Updated weights for policy 1, policy_version 429571 (0.0009) [2023-12-26 03:02:13,460][123090] Updated weights for policy 1, policy_version 429581 (0.0006) [2023-12-26 03:02:13,526][123090] Updated weights for policy 1, policy_version 429591 (0.0006) [2023-12-26 03:02:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 220643328. Throughput: 0: 8627.6, 1: 8843.1. Samples: 220636284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:13,785][121949] Avg episode reward: [(0, '5855.639'), (1, '5353.815')] [2023-12-26 03:02:13,854][123091] Updated weights for policy 0, policy_version 432278 (0.0008) [2023-12-26 03:02:13,903][123091] Updated weights for policy 0, policy_version 432288 (0.0006) [2023-12-26 03:02:13,953][123091] Updated weights for policy 0, policy_version 432298 (0.0005) [2023-12-26 03:02:14,276][123090] Updated weights for policy 1, policy_version 429601 (0.0006) [2023-12-26 03:02:14,338][123090] Updated weights for policy 1, policy_version 429611 (0.0005) [2023-12-26 03:02:14,398][123090] Updated weights for policy 1, policy_version 429621 (0.0005) [2023-12-26 03:02:14,457][123090] Updated weights for policy 1, policy_version 429631 (0.0006) [2023-12-26 03:02:14,793][123091] Updated weights for policy 0, policy_version 432308 (0.0007) [2023-12-26 03:02:14,856][123091] Updated weights for policy 0, policy_version 432318 (0.0010) [2023-12-26 03:02:14,912][123091] Updated weights for policy 0, policy_version 432328 (0.0010) [2023-12-26 03:02:15,092][123090] Updated weights for policy 1, policy_version 429641 (0.0005) [2023-12-26 03:02:15,159][123090] Updated weights for policy 1, policy_version 429651 (0.0006) [2023-12-26 03:02:15,228][123090] Updated weights for policy 1, policy_version 429661 (0.0005) [2023-12-26 03:02:15,818][123091] Updated weights for policy 0, policy_version 432338 (0.0008) [2023-12-26 03:02:15,867][123091] Updated weights for policy 0, policy_version 432348 (0.0008) [2023-12-26 03:02:15,885][123090] Updated weights for policy 1, policy_version 429671 (0.0009) [2023-12-26 03:02:15,911][123091] Updated weights for policy 0, policy_version 432358 (0.0010) [2023-12-26 03:02:15,937][123090] Updated weights for policy 1, policy_version 429681 (0.0010) [2023-12-26 03:02:15,960][123091] Updated weights for policy 0, policy_version 432368 (0.0009) [2023-12-26 03:02:15,997][123090] Updated weights for policy 1, policy_version 429691 (0.0010) [2023-12-26 03:02:16,666][123091] Updated weights for policy 0, policy_version 432378 (0.0005) [2023-12-26 03:02:16,674][123090] Updated weights for policy 1, policy_version 429701 (0.0005) [2023-12-26 03:02:16,720][123091] Updated weights for policy 0, policy_version 432388 (0.0005) [2023-12-26 03:02:16,739][123090] Updated weights for policy 1, policy_version 429711 (0.0010) [2023-12-26 03:02:16,769][123091] Updated weights for policy 0, policy_version 432398 (0.0005) [2023-12-26 03:02:16,803][123090] Updated weights for policy 1, policy_version 429721 (0.0006) [2023-12-26 03:02:17,449][123091] Updated weights for policy 0, policy_version 432408 (0.0005) [2023-12-26 03:02:17,467][123090] Updated weights for policy 1, policy_version 429731 (0.0009) [2023-12-26 03:02:17,503][123091] Updated weights for policy 0, policy_version 432418 (0.0005) [2023-12-26 03:02:17,519][123090] Updated weights for policy 1, policy_version 429741 (0.0005) [2023-12-26 03:02:17,562][123091] Updated weights for policy 0, policy_version 432428 (0.0005) [2023-12-26 03:02:17,574][123090] Updated weights for policy 1, policy_version 429751 (0.0005) [2023-12-26 03:02:18,211][123091] Updated weights for policy 0, policy_version 432438 (0.0008) [2023-12-26 03:02:18,243][123090] Updated weights for policy 1, policy_version 429761 (0.0005) [2023-12-26 03:02:18,276][123091] Updated weights for policy 0, policy_version 432448 (0.0010) [2023-12-26 03:02:18,313][123090] Updated weights for policy 1, policy_version 429771 (0.0006) [2023-12-26 03:02:18,338][123091] Updated weights for policy 0, policy_version 432458 (0.0011) [2023-12-26 03:02:18,377][123090] Updated weights for policy 1, policy_version 429781 (0.0008) [2023-12-26 03:02:18,433][123090] Updated weights for policy 1, policy_version 429791 (0.0010) [2023-12-26 03:02:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17613.9, 300 sec: 17716.9). Total num frames: 220741632. Throughput: 0: 8712.1, 1: 8906.2. Samples: 220751532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:18,784][121949] Avg episode reward: [(0, '5865.687'), (1, '5367.649')] [2023-12-26 03:02:19,182][123091] Updated weights for policy 0, policy_version 432468 (0.0010) [2023-12-26 03:02:19,216][123090] Updated weights for policy 1, policy_version 429801 (0.0007) [2023-12-26 03:02:19,255][123091] Updated weights for policy 0, policy_version 432478 (0.0010) [2023-12-26 03:02:19,284][123090] Updated weights for policy 1, policy_version 429811 (0.0010) [2023-12-26 03:02:19,321][123091] Updated weights for policy 0, policy_version 432488 (0.0011) [2023-12-26 03:02:19,355][123090] Updated weights for policy 1, policy_version 429821 (0.0009) [2023-12-26 03:02:20,156][123091] Updated weights for policy 0, policy_version 432498 (0.0013) [2023-12-26 03:02:20,179][123090] Updated weights for policy 1, policy_version 429831 (0.0009) [2023-12-26 03:02:20,220][123091] Updated weights for policy 0, policy_version 432508 (0.0011) [2023-12-26 03:02:20,240][123090] Updated weights for policy 1, policy_version 429841 (0.0006) [2023-12-26 03:02:20,280][123091] Updated weights for policy 0, policy_version 432518 (0.0010) [2023-12-26 03:02:20,300][123090] Updated weights for policy 1, policy_version 429851 (0.0006) [2023-12-26 03:02:20,340][123091] Updated weights for policy 0, policy_version 432528 (0.0009) [2023-12-26 03:02:21,154][123090] Updated weights for policy 1, policy_version 429861 (0.0009) [2023-12-26 03:02:21,186][123091] Updated weights for policy 0, policy_version 432538 (0.0011) [2023-12-26 03:02:21,211][123090] Updated weights for policy 1, policy_version 429871 (0.0006) [2023-12-26 03:02:21,243][123091] Updated weights for policy 0, policy_version 432548 (0.0011) [2023-12-26 03:02:21,285][123090] Updated weights for policy 1, policy_version 429881 (0.0006) [2023-12-26 03:02:21,316][123091] Updated weights for policy 0, policy_version 432558 (0.0009) [2023-12-26 03:02:22,144][123090] Updated weights for policy 1, policy_version 429891 (0.0008) [2023-12-26 03:02:22,200][123091] Updated weights for policy 0, policy_version 432568 (0.0009) [2023-12-26 03:02:22,204][123090] Updated weights for policy 1, policy_version 429901 (0.0009) [2023-12-26 03:02:22,262][123091] Updated weights for policy 0, policy_version 432578 (0.0009) [2023-12-26 03:02:22,266][123090] Updated weights for policy 1, policy_version 429911 (0.0009) [2023-12-26 03:02:22,328][123091] Updated weights for policy 0, policy_version 432588 (0.0009) [2023-12-26 03:02:23,100][123090] Updated weights for policy 1, policy_version 429921 (0.0009) [2023-12-26 03:02:23,148][123090] Updated weights for policy 1, policy_version 429931 (0.0010) [2023-12-26 03:02:23,162][123091] Updated weights for policy 0, policy_version 432598 (0.0007) [2023-12-26 03:02:23,195][123090] Updated weights for policy 1, policy_version 429941 (0.0010) [2023-12-26 03:02:23,223][123091] Updated weights for policy 0, policy_version 432608 (0.0005) [2023-12-26 03:02:23,251][123090] Updated weights for policy 1, policy_version 429951 (0.0010) [2023-12-26 03:02:23,278][123091] Updated weights for policy 0, policy_version 432618 (0.0005) [2023-12-26 03:02:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 220823552. Throughput: 0: 8701.2, 1: 8873.6. Samples: 220801976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:23,785][121949] Avg episode reward: [(0, '5781.114'), (1, '5318.375')] [2023-12-26 03:02:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000432624_110755840.pth... [2023-12-26 03:02:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000429952_110067712.pth... [2023-12-26 03:02:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000431600_110493696.pth [2023-12-26 03:02:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000428896_109797376.pth [2023-12-26 03:02:23,849][123091] Updated weights for policy 0, policy_version 432628 (0.0005) [2023-12-26 03:02:23,904][123091] Updated weights for policy 0, policy_version 432638 (0.0005) [2023-12-26 03:02:23,957][123091] Updated weights for policy 0, policy_version 432648 (0.0005) [2023-12-26 03:02:24,093][123090] Updated weights for policy 1, policy_version 429961 (0.0010) [2023-12-26 03:02:24,152][123090] Updated weights for policy 1, policy_version 429971 (0.0010) [2023-12-26 03:02:24,204][123090] Updated weights for policy 1, policy_version 429981 (0.0010) [2023-12-26 03:02:24,613][123091] Updated weights for policy 0, policy_version 432658 (0.0005) [2023-12-26 03:02:24,660][123091] Updated weights for policy 0, policy_version 432668 (0.0005) [2023-12-26 03:02:24,717][123091] Updated weights for policy 0, policy_version 432678 (0.0005) [2023-12-26 03:02:24,771][123091] Updated weights for policy 0, policy_version 432688 (0.0005) [2023-12-26 03:02:25,030][123090] Updated weights for policy 1, policy_version 429991 (0.0007) [2023-12-26 03:02:25,087][123090] Updated weights for policy 1, policy_version 430001 (0.0006) [2023-12-26 03:02:25,142][123090] Updated weights for policy 1, policy_version 430011 (0.0006) [2023-12-26 03:02:25,392][123091] Updated weights for policy 0, policy_version 432698 (0.0005) [2023-12-26 03:02:25,451][123091] Updated weights for policy 0, policy_version 432708 (0.0005) [2023-12-26 03:02:25,517][123091] Updated weights for policy 0, policy_version 432718 (0.0005) [2023-12-26 03:02:25,884][123090] Updated weights for policy 1, policy_version 430021 (0.0008) [2023-12-26 03:02:25,940][123090] Updated weights for policy 1, policy_version 430032 (0.0010) [2023-12-26 03:02:25,999][123090] Updated weights for policy 1, policy_version 430043 (0.0010) [2023-12-26 03:02:26,197][123091] Updated weights for policy 0, policy_version 432728 (0.0009) [2023-12-26 03:02:26,244][123091] Updated weights for policy 0, policy_version 432738 (0.0010) [2023-12-26 03:02:26,296][123091] Updated weights for policy 0, policy_version 432748 (0.0010) [2023-12-26 03:02:26,833][123090] Updated weights for policy 1, policy_version 430053 (0.0010) [2023-12-26 03:02:26,888][123090] Updated weights for policy 1, policy_version 430063 (0.0010) [2023-12-26 03:02:26,943][123090] Updated weights for policy 1, policy_version 430073 (0.0010) [2023-12-26 03:02:27,110][123091] Updated weights for policy 0, policy_version 432758 (0.0009) [2023-12-26 03:02:27,168][123091] Updated weights for policy 0, policy_version 432768 (0.0010) [2023-12-26 03:02:27,223][123091] Updated weights for policy 0, policy_version 432778 (0.0010) [2023-12-26 03:02:27,755][123090] Updated weights for policy 1, policy_version 430083 (0.0010) [2023-12-26 03:02:27,825][123090] Updated weights for policy 1, policy_version 430093 (0.0008) [2023-12-26 03:02:27,893][123090] Updated weights for policy 1, policy_version 430103 (0.0008) [2023-12-26 03:02:27,942][123091] Updated weights for policy 0, policy_version 432788 (0.0007) [2023-12-26 03:02:28,004][123091] Updated weights for policy 0, policy_version 432798 (0.0005) [2023-12-26 03:02:28,058][123091] Updated weights for policy 0, policy_version 432808 (0.0005) [2023-12-26 03:02:28,731][123090] Updated weights for policy 1, policy_version 430113 (0.0008) [2023-12-26 03:02:28,779][123091] Updated weights for policy 0, policy_version 432818 (0.0006) [2023-12-26 03:02:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 220913664. Throughput: 0: 8877.9, 1: 8877.9. Samples: 220912840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:28,784][121949] Avg episode reward: [(0, '5892.935'), (1, '5367.208')] [2023-12-26 03:02:28,786][123090] Updated weights for policy 1, policy_version 430123 (0.0008) [2023-12-26 03:02:28,833][123091] Updated weights for policy 0, policy_version 432828 (0.0008) [2023-12-26 03:02:28,835][123090] Updated weights for policy 1, policy_version 430133 (0.0009) [2023-12-26 03:02:28,888][123090] Updated weights for policy 1, policy_version 430143 (0.0008) [2023-12-26 03:02:28,889][123091] Updated weights for policy 0, policy_version 432838 (0.0008) [2023-12-26 03:02:28,935][123091] Updated weights for policy 0, policy_version 432848 (0.0008) [2023-12-26 03:02:29,733][123091] Updated weights for policy 0, policy_version 432858 (0.0011) [2023-12-26 03:02:29,752][123090] Updated weights for policy 1, policy_version 430153 (0.0010) [2023-12-26 03:02:29,799][123091] Updated weights for policy 0, policy_version 432868 (0.0010) [2023-12-26 03:02:29,808][123090] Updated weights for policy 1, policy_version 430163 (0.0011) [2023-12-26 03:02:29,875][123091] Updated weights for policy 0, policy_version 432878 (0.0011) [2023-12-26 03:02:29,877][123090] Updated weights for policy 1, policy_version 430173 (0.0009) [2023-12-26 03:02:30,624][123091] Updated weights for policy 0, policy_version 432888 (0.0010) [2023-12-26 03:02:30,672][123090] Updated weights for policy 1, policy_version 430183 (0.0011) [2023-12-26 03:02:30,672][123091] Updated weights for policy 0, policy_version 432898 (0.0010) [2023-12-26 03:02:30,716][123091] Updated weights for policy 0, policy_version 432908 (0.0010) [2023-12-26 03:02:30,719][123090] Updated weights for policy 1, policy_version 430193 (0.0010) [2023-12-26 03:02:30,762][123090] Updated weights for policy 1, policy_version 430203 (0.0010) [2023-12-26 03:02:31,504][123091] Updated weights for policy 0, policy_version 432918 (0.0010) [2023-12-26 03:02:31,561][123091] Updated weights for policy 0, policy_version 432928 (0.0008) [2023-12-26 03:02:31,571][123090] Updated weights for policy 1, policy_version 430213 (0.0010) [2023-12-26 03:02:31,615][123091] Updated weights for policy 0, policy_version 432938 (0.0007) [2023-12-26 03:02:31,635][123090] Updated weights for policy 1, policy_version 430223 (0.0011) [2023-12-26 03:02:31,711][123090] Updated weights for policy 1, policy_version 430233 (0.0011) [2023-12-26 03:02:32,327][123091] Updated weights for policy 0, policy_version 432948 (0.0007) [2023-12-26 03:02:32,400][123091] Updated weights for policy 0, policy_version 432958 (0.0008) [2023-12-26 03:02:32,469][123091] Updated weights for policy 0, policy_version 432968 (0.0006) [2023-12-26 03:02:32,577][123090] Updated weights for policy 1, policy_version 430243 (0.0010) [2023-12-26 03:02:32,641][123090] Updated weights for policy 1, policy_version 430253 (0.0009) [2023-12-26 03:02:32,711][123090] Updated weights for policy 1, policy_version 430263 (0.0007) [2023-12-26 03:02:33,203][123091] Updated weights for policy 0, policy_version 432978 (0.0007) [2023-12-26 03:02:33,254][123091] Updated weights for policy 0, policy_version 432988 (0.0009) [2023-12-26 03:02:33,303][123091] Updated weights for policy 0, policy_version 432998 (0.0009) [2023-12-26 03:02:33,348][123091] Updated weights for policy 0, policy_version 433008 (0.0008) [2023-12-26 03:02:33,459][123090] Updated weights for policy 1, policy_version 430273 (0.0006) [2023-12-26 03:02:33,517][123090] Updated weights for policy 1, policy_version 430283 (0.0010) [2023-12-26 03:02:33,570][123090] Updated weights for policy 1, policy_version 430293 (0.0010) [2023-12-26 03:02:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 221011968. Throughput: 0: 8974.0, 1: 8887.9. Samples: 221020656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:33,785][121949] Avg episode reward: [(0, '6045.003'), (1, '5434.237')] [2023-12-26 03:02:34,188][123091] Updated weights for policy 0, policy_version 433018 (0.0008) [2023-12-26 03:02:34,253][123091] Updated weights for policy 0, policy_version 433028 (0.0007) [2023-12-26 03:02:34,322][123091] Updated weights for policy 0, policy_version 433038 (0.0009) [2023-12-26 03:02:34,422][123090] Updated weights for policy 1, policy_version 430305 (0.0010) [2023-12-26 03:02:34,483][123090] Updated weights for policy 1, policy_version 430315 (0.0009) [2023-12-26 03:02:34,547][123090] Updated weights for policy 1, policy_version 430325 (0.0009) [2023-12-26 03:02:34,616][123090] Updated weights for policy 1, policy_version 430335 (0.0010) [2023-12-26 03:02:35,161][123091] Updated weights for policy 0, policy_version 433048 (0.0010) [2023-12-26 03:02:35,220][123091] Updated weights for policy 0, policy_version 433059 (0.0010) [2023-12-26 03:02:35,276][123091] Updated weights for policy 0, policy_version 433071 (0.0011) [2023-12-26 03:02:35,366][123090] Updated weights for policy 1, policy_version 430345 (0.0008) [2023-12-26 03:02:35,428][123090] Updated weights for policy 1, policy_version 430355 (0.0008) [2023-12-26 03:02:35,491][123090] Updated weights for policy 1, policy_version 430365 (0.0009) [2023-12-26 03:02:36,101][123090] Updated weights for policy 1, policy_version 430375 (0.0007) [2023-12-26 03:02:36,176][123090] Updated weights for policy 1, policy_version 430385 (0.0008) [2023-12-26 03:02:36,195][123091] Updated weights for policy 0, policy_version 433081 (0.0007) [2023-12-26 03:02:36,239][123090] Updated weights for policy 1, policy_version 430395 (0.0008) [2023-12-26 03:02:36,250][123091] Updated weights for policy 0, policy_version 433091 (0.0008) [2023-12-26 03:02:36,308][123091] Updated weights for policy 0, policy_version 433101 (0.0009) [2023-12-26 03:02:36,944][123090] Updated weights for policy 1, policy_version 430405 (0.0009) [2023-12-26 03:02:37,012][123090] Updated weights for policy 1, policy_version 430415 (0.0010) [2023-12-26 03:02:37,073][123090] Updated weights for policy 1, policy_version 430425 (0.0010) [2023-12-26 03:02:37,172][123091] Updated weights for policy 0, policy_version 433111 (0.0010) [2023-12-26 03:02:37,227][123091] Updated weights for policy 0, policy_version 433121 (0.0009) [2023-12-26 03:02:37,290][123091] Updated weights for policy 0, policy_version 433131 (0.0010) [2023-12-26 03:02:37,888][123090] Updated weights for policy 1, policy_version 430435 (0.0008) [2023-12-26 03:02:37,951][123090] Updated weights for policy 1, policy_version 430445 (0.0007) [2023-12-26 03:02:38,016][123090] Updated weights for policy 1, policy_version 430455 (0.0005) [2023-12-26 03:02:38,152][123091] Updated weights for policy 0, policy_version 433141 (0.0010) [2023-12-26 03:02:38,215][123091] Updated weights for policy 0, policy_version 433151 (0.0009) [2023-12-26 03:02:38,282][123091] Updated weights for policy 0, policy_version 433161 (0.0008) [2023-12-26 03:02:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 221093888. Throughput: 0: 8941.1, 1: 8911.6. Samples: 221073736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:38,785][121949] Avg episode reward: [(0, '6022.129'), (1, '5585.886')] [2023-12-26 03:02:38,788][123090] Updated weights for policy 1, policy_version 430465 (0.0006) [2023-12-26 03:02:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000433168_110895104.pth... [2023-12-26 03:02:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000432112_110624768.pth [2023-12-26 03:02:38,839][123090] Updated weights for policy 1, policy_version 430475 (0.0009) [2023-12-26 03:02:38,892][123090] Updated weights for policy 1, policy_version 430485 (0.0009) [2023-12-26 03:02:38,955][123090] Updated weights for policy 1, policy_version 430495 (0.0009) [2023-12-26 03:02:38,960][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000430496_110206976.pth... [2023-12-26 03:02:38,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000429440_109936640.pth [2023-12-26 03:02:39,113][123091] Updated weights for policy 0, policy_version 433171 (0.0009) [2023-12-26 03:02:39,172][123091] Updated weights for policy 0, policy_version 433181 (0.0009) [2023-12-26 03:02:39,234][123091] Updated weights for policy 0, policy_version 433191 (0.0008) [2023-12-26 03:02:39,857][123090] Updated weights for policy 1, policy_version 430505 (0.0008) [2023-12-26 03:02:39,926][123090] Updated weights for policy 1, policy_version 430515 (0.0008) [2023-12-26 03:02:39,988][123090] Updated weights for policy 1, policy_version 430525 (0.0009) [2023-12-26 03:02:40,022][123091] Updated weights for policy 0, policy_version 433201 (0.0007) [2023-12-26 03:02:40,093][123091] Updated weights for policy 0, policy_version 433211 (0.0008) [2023-12-26 03:02:40,159][123091] Updated weights for policy 0, policy_version 433221 (0.0008) [2023-12-26 03:02:40,221][123091] Updated weights for policy 0, policy_version 433231 (0.0008) [2023-12-26 03:02:40,691][123090] Updated weights for policy 1, policy_version 430535 (0.0010) [2023-12-26 03:02:40,747][123090] Updated weights for policy 1, policy_version 430545 (0.0010) [2023-12-26 03:02:40,810][123090] Updated weights for policy 1, policy_version 430555 (0.0010) [2023-12-26 03:02:40,946][123091] Updated weights for policy 0, policy_version 433241 (0.0009) [2023-12-26 03:02:40,998][123091] Updated weights for policy 0, policy_version 433251 (0.0009) [2023-12-26 03:02:41,062][123091] Updated weights for policy 0, policy_version 433261 (0.0009) [2023-12-26 03:02:41,673][123090] Updated weights for policy 1, policy_version 430565 (0.0010) [2023-12-26 03:02:41,747][123090] Updated weights for policy 1, policy_version 430575 (0.0010) [2023-12-26 03:02:41,823][123090] Updated weights for policy 1, policy_version 430585 (0.0010) [2023-12-26 03:02:41,893][123091] Updated weights for policy 0, policy_version 433271 (0.0008) [2023-12-26 03:02:41,956][123091] Updated weights for policy 0, policy_version 433281 (0.0009) [2023-12-26 03:02:42,023][123091] Updated weights for policy 0, policy_version 433291 (0.0006) [2023-12-26 03:02:42,689][123090] Updated weights for policy 1, policy_version 430595 (0.0010) [2023-12-26 03:02:42,759][123090] Updated weights for policy 1, policy_version 430605 (0.0009) [2023-12-26 03:02:42,809][123090] Updated weights for policy 1, policy_version 430615 (0.0009) [2023-12-26 03:02:42,834][123091] Updated weights for policy 0, policy_version 433301 (0.0008) [2023-12-26 03:02:42,901][123091] Updated weights for policy 0, policy_version 433311 (0.0010) [2023-12-26 03:02:42,957][123091] Updated weights for policy 0, policy_version 433321 (0.0009) [2023-12-26 03:02:43,620][123090] Updated weights for policy 1, policy_version 430625 (0.0008) [2023-12-26 03:02:43,679][123090] Updated weights for policy 1, policy_version 430635 (0.0010) [2023-12-26 03:02:43,736][123090] Updated weights for policy 1, policy_version 430645 (0.0009) [2023-12-26 03:02:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 221175808. Throughput: 0: 8864.0, 1: 8888.2. Samples: 221176504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:43,785][121949] Avg episode reward: [(0, '5974.636'), (1, '5602.486')] [2023-12-26 03:02:43,802][123090] Updated weights for policy 1, policy_version 430655 (0.0009) [2023-12-26 03:02:43,804][123091] Updated weights for policy 0, policy_version 433331 (0.0008) [2023-12-26 03:02:43,859][123091] Updated weights for policy 0, policy_version 433341 (0.0009) [2023-12-26 03:02:43,923][123091] Updated weights for policy 0, policy_version 433352 (0.0010) [2023-12-26 03:02:44,504][123090] Updated weights for policy 1, policy_version 430665 (0.0010) [2023-12-26 03:02:44,574][123090] Updated weights for policy 1, policy_version 430675 (0.0010) [2023-12-26 03:02:44,648][123090] Updated weights for policy 1, policy_version 430685 (0.0009) [2023-12-26 03:02:44,876][123091] Updated weights for policy 0, policy_version 433363 (0.0011) [2023-12-26 03:02:44,941][123091] Updated weights for policy 0, policy_version 433373 (0.0010) [2023-12-26 03:02:45,009][123091] Updated weights for policy 0, policy_version 433383 (0.0010) [2023-12-26 03:02:45,387][123090] Updated weights for policy 1, policy_version 430695 (0.0009) [2023-12-26 03:02:45,440][123090] Updated weights for policy 1, policy_version 430705 (0.0006) [2023-12-26 03:02:45,500][123090] Updated weights for policy 1, policy_version 430715 (0.0006) [2023-12-26 03:02:45,861][123091] Updated weights for policy 0, policy_version 433393 (0.0010) [2023-12-26 03:02:45,928][123091] Updated weights for policy 0, policy_version 433403 (0.0009) [2023-12-26 03:02:45,984][123091] Updated weights for policy 0, policy_version 433413 (0.0009) [2023-12-26 03:02:46,036][123091] Updated weights for policy 0, policy_version 433423 (0.0009) [2023-12-26 03:02:46,303][123090] Updated weights for policy 1, policy_version 430725 (0.0010) [2023-12-26 03:02:46,372][123090] Updated weights for policy 1, policy_version 430735 (0.0010) [2023-12-26 03:02:46,441][123090] Updated weights for policy 1, policy_version 430745 (0.0010) [2023-12-26 03:02:46,876][123091] Updated weights for policy 0, policy_version 433433 (0.0009) [2023-12-26 03:02:46,943][123091] Updated weights for policy 0, policy_version 433443 (0.0009) [2023-12-26 03:02:47,003][123091] Updated weights for policy 0, policy_version 433453 (0.0009) [2023-12-26 03:02:47,233][123090] Updated weights for policy 1, policy_version 430755 (0.0010) [2023-12-26 03:02:47,295][123090] Updated weights for policy 1, policy_version 430765 (0.0010) [2023-12-26 03:02:47,360][123090] Updated weights for policy 1, policy_version 430775 (0.0010) [2023-12-26 03:02:47,837][123091] Updated weights for policy 0, policy_version 433463 (0.0008) [2023-12-26 03:02:47,893][123091] Updated weights for policy 0, policy_version 433473 (0.0010) [2023-12-26 03:02:47,960][123091] Updated weights for policy 0, policy_version 433483 (0.0009) [2023-12-26 03:02:48,153][123090] Updated weights for policy 1, policy_version 430785 (0.0010) [2023-12-26 03:02:48,204][123090] Updated weights for policy 1, policy_version 430795 (0.0010) [2023-12-26 03:02:48,248][123090] Updated weights for policy 1, policy_version 430805 (0.0010) [2023-12-26 03:02:48,292][123090] Updated weights for policy 1, policy_version 430815 (0.0010) [2023-12-26 03:02:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 221265920. Throughput: 0: 8868.2, 1: 8925.2. Samples: 221279984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:02:48,785][121949] Avg episode reward: [(0, '5885.626'), (1, '5555.175')] [2023-12-26 03:02:48,806][123091] Updated weights for policy 0, policy_version 433493 (0.0010) [2023-12-26 03:02:48,869][123091] Updated weights for policy 0, policy_version 433503 (0.0010) [2023-12-26 03:02:48,925][123091] Updated weights for policy 0, policy_version 433513 (0.0010) [2023-12-26 03:02:49,161][123090] Updated weights for policy 1, policy_version 430825 (0.0009) [2023-12-26 03:02:49,214][123090] Updated weights for policy 1, policy_version 430835 (0.0009) [2023-12-26 03:02:49,280][123090] Updated weights for policy 1, policy_version 430846 (0.0010) [2023-12-26 03:02:49,771][123091] Updated weights for policy 0, policy_version 433523 (0.0009) [2023-12-26 03:02:49,842][123091] Updated weights for policy 0, policy_version 433533 (0.0010) [2023-12-26 03:02:49,894][123091] Updated weights for policy 0, policy_version 433543 (0.0010) [2023-12-26 03:02:50,142][123090] Updated weights for policy 1, policy_version 430856 (0.0009) [2023-12-26 03:02:50,194][123090] Updated weights for policy 1, policy_version 430866 (0.0008) [2023-12-26 03:02:50,250][123090] Updated weights for policy 1, policy_version 430876 (0.0009) [2023-12-26 03:02:50,724][123091] Updated weights for policy 0, policy_version 433553 (0.0008) [2023-12-26 03:02:50,784][123091] Updated weights for policy 0, policy_version 433563 (0.0009) [2023-12-26 03:02:50,849][123091] Updated weights for policy 0, policy_version 433573 (0.0009) [2023-12-26 03:02:50,907][123091] Updated weights for policy 0, policy_version 433583 (0.0009) [2023-12-26 03:02:51,110][123090] Updated weights for policy 1, policy_version 430886 (0.0010) [2023-12-26 03:02:51,182][123090] Updated weights for policy 1, policy_version 430896 (0.0010) [2023-12-26 03:02:51,250][123090] Updated weights for policy 1, policy_version 430906 (0.0011) [2023-12-26 03:02:51,751][123091] Updated weights for policy 0, policy_version 433593 (0.0010) [2023-12-26 03:02:51,810][123091] Updated weights for policy 0, policy_version 433603 (0.0010) [2023-12-26 03:02:51,873][123091] Updated weights for policy 0, policy_version 433613 (0.0010) [2023-12-26 03:02:52,072][123090] Updated weights for policy 1, policy_version 430916 (0.0011) [2023-12-26 03:02:52,123][123090] Updated weights for policy 1, policy_version 430926 (0.0010) [2023-12-26 03:02:52,179][123090] Updated weights for policy 1, policy_version 430936 (0.0010) [2023-12-26 03:02:52,671][123091] Updated weights for policy 0, policy_version 433623 (0.0011) [2023-12-26 03:02:52,731][123091] Updated weights for policy 0, policy_version 433633 (0.0011) [2023-12-26 03:02:52,790][123091] Updated weights for policy 0, policy_version 433643 (0.0010) [2023-12-26 03:02:53,018][123090] Updated weights for policy 1, policy_version 430946 (0.0010) [2023-12-26 03:02:53,075][123090] Updated weights for policy 1, policy_version 430956 (0.0010) [2023-12-26 03:02:53,141][123090] Updated weights for policy 1, policy_version 430966 (0.0010) [2023-12-26 03:02:53,200][123090] Updated weights for policy 1, policy_version 430976 (0.0010) [2023-12-26 03:02:53,616][123091] Updated weights for policy 0, policy_version 433653 (0.0008) [2023-12-26 03:02:53,680][123091] Updated weights for policy 0, policy_version 433663 (0.0005) [2023-12-26 03:02:53,735][123091] Updated weights for policy 0, policy_version 433673 (0.0005) [2023-12-26 03:02:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 221356032. Throughput: 0: 8884.3, 1: 8860.9. Samples: 221330376. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:02:53,785][121949] Avg episode reward: [(0, '6019.494'), (1, '5593.131')] [2023-12-26 03:02:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000433680_111026176.pth... [2023-12-26 03:02:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000430976_110329856.pth... [2023-12-26 03:02:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000432624_110755840.pth [2023-12-26 03:02:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000429952_110067712.pth [2023-12-26 03:02:53,935][123090] Updated weights for policy 1, policy_version 430986 (0.0010) [2023-12-26 03:02:53,996][123090] Updated weights for policy 1, policy_version 430996 (0.0010) [2023-12-26 03:02:54,053][123090] Updated weights for policy 1, policy_version 431006 (0.0010) [2023-12-26 03:02:54,393][123091] Updated weights for policy 0, policy_version 433683 (0.0005) [2023-12-26 03:02:54,443][123091] Updated weights for policy 0, policy_version 433693 (0.0005) [2023-12-26 03:02:54,489][123091] Updated weights for policy 0, policy_version 433703 (0.0005) [2023-12-26 03:02:54,830][123090] Updated weights for policy 1, policy_version 431016 (0.0006) [2023-12-26 03:02:54,880][123090] Updated weights for policy 1, policy_version 431026 (0.0006) [2023-12-26 03:02:54,945][123090] Updated weights for policy 1, policy_version 431036 (0.0008) [2023-12-26 03:02:55,111][123091] Updated weights for policy 0, policy_version 433713 (0.0005) [2023-12-26 03:02:55,165][123091] Updated weights for policy 0, policy_version 433723 (0.0005) [2023-12-26 03:02:55,212][123091] Updated weights for policy 0, policy_version 433733 (0.0010) [2023-12-26 03:02:55,266][123091] Updated weights for policy 0, policy_version 433743 (0.0010) [2023-12-26 03:02:55,713][123090] Updated weights for policy 1, policy_version 431046 (0.0007) [2023-12-26 03:02:55,774][123090] Updated weights for policy 1, policy_version 431056 (0.0005) [2023-12-26 03:02:55,838][123090] Updated weights for policy 1, policy_version 431066 (0.0007) [2023-12-26 03:02:56,077][123091] Updated weights for policy 0, policy_version 433753 (0.0010) [2023-12-26 03:02:56,128][123091] Updated weights for policy 0, policy_version 433763 (0.0010) [2023-12-26 03:02:56,182][123091] Updated weights for policy 0, policy_version 433773 (0.0010) [2023-12-26 03:02:56,527][123090] Updated weights for policy 1, policy_version 431076 (0.0008) [2023-12-26 03:02:56,575][123090] Updated weights for policy 1, policy_version 431086 (0.0009) [2023-12-26 03:02:56,631][123090] Updated weights for policy 1, policy_version 431096 (0.0008) [2023-12-26 03:02:57,031][123091] Updated weights for policy 0, policy_version 433783 (0.0010) [2023-12-26 03:02:57,074][123091] Updated weights for policy 0, policy_version 433793 (0.0010) [2023-12-26 03:02:57,122][123091] Updated weights for policy 0, policy_version 433803 (0.0010) [2023-12-26 03:02:57,416][123090] Updated weights for policy 1, policy_version 431106 (0.0008) [2023-12-26 03:02:57,473][123090] Updated weights for policy 1, policy_version 431116 (0.0005) [2023-12-26 03:02:57,519][123090] Updated weights for policy 1, policy_version 431126 (0.0005) [2023-12-26 03:02:57,584][123090] Updated weights for policy 1, policy_version 431136 (0.0005) [2023-12-26 03:02:57,962][123091] Updated weights for policy 0, policy_version 433813 (0.0010) [2023-12-26 03:02:58,041][123091] Updated weights for policy 0, policy_version 433823 (0.0010) [2023-12-26 03:02:58,112][123091] Updated weights for policy 0, policy_version 433833 (0.0010) [2023-12-26 03:02:58,326][123090] Updated weights for policy 1, policy_version 431146 (0.0008) [2023-12-26 03:02:58,397][123090] Updated weights for policy 1, policy_version 431156 (0.0008) [2023-12-26 03:02:58,478][123090] Updated weights for policy 1, policy_version 431166 (0.0012) [2023-12-26 03:02:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 221446144. Throughput: 0: 8957.7, 1: 8915.7. Samples: 221440584. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:02:58,785][121949] Avg episode reward: [(0, '6093.608'), (1, '5510.869')] [2023-12-26 03:02:59,068][123091] Updated weights for policy 0, policy_version 433843 (0.0009) [2023-12-26 03:02:59,116][123091] Updated weights for policy 0, policy_version 433853 (0.0009) [2023-12-26 03:02:59,172][123091] Updated weights for policy 0, policy_version 433863 (0.0008) [2023-12-26 03:02:59,377][123090] Updated weights for policy 1, policy_version 431176 (0.0010) [2023-12-26 03:02:59,446][123090] Updated weights for policy 1, policy_version 431186 (0.0011) [2023-12-26 03:02:59,514][123090] Updated weights for policy 1, policy_version 431196 (0.0011) [2023-12-26 03:03:00,033][123091] Updated weights for policy 0, policy_version 433873 (0.0009) [2023-12-26 03:03:00,090][123091] Updated weights for policy 0, policy_version 433883 (0.0009) [2023-12-26 03:03:00,151][123091] Updated weights for policy 0, policy_version 433893 (0.0010) [2023-12-26 03:03:00,219][123091] Updated weights for policy 0, policy_version 433903 (0.0010) [2023-12-26 03:03:00,321][123090] Updated weights for policy 1, policy_version 431206 (0.0010) [2023-12-26 03:03:00,387][123090] Updated weights for policy 1, policy_version 431216 (0.0009) [2023-12-26 03:03:00,446][123090] Updated weights for policy 1, policy_version 431226 (0.0010) [2023-12-26 03:03:00,986][123091] Updated weights for policy 0, policy_version 433913 (0.0006) [2023-12-26 03:03:01,037][123091] Updated weights for policy 0, policy_version 433923 (0.0006) [2023-12-26 03:03:01,099][123091] Updated weights for policy 0, policy_version 433933 (0.0006) [2023-12-26 03:03:01,211][123090] Updated weights for policy 1, policy_version 431236 (0.0009) [2023-12-26 03:03:01,276][123090] Updated weights for policy 1, policy_version 431246 (0.0007) [2023-12-26 03:03:01,346][123090] Updated weights for policy 1, policy_version 431256 (0.0006) [2023-12-26 03:03:01,888][123091] Updated weights for policy 0, policy_version 433943 (0.0009) [2023-12-26 03:03:01,955][123091] Updated weights for policy 0, policy_version 433953 (0.0011) [2023-12-26 03:03:02,021][123091] Updated weights for policy 0, policy_version 433963 (0.0010) [2023-12-26 03:03:02,134][123090] Updated weights for policy 1, policy_version 431266 (0.0008) [2023-12-26 03:03:02,191][123090] Updated weights for policy 1, policy_version 431276 (0.0009) [2023-12-26 03:03:02,239][123090] Updated weights for policy 1, policy_version 431286 (0.0009) [2023-12-26 03:03:02,307][123090] Updated weights for policy 1, policy_version 431296 (0.0008) [2023-12-26 03:03:02,837][123091] Updated weights for policy 0, policy_version 433973 (0.0011) [2023-12-26 03:03:02,885][123091] Updated weights for policy 0, policy_version 433983 (0.0010) [2023-12-26 03:03:02,949][123091] Updated weights for policy 0, policy_version 433993 (0.0008) [2023-12-26 03:03:03,036][123090] Updated weights for policy 1, policy_version 431306 (0.0005) [2023-12-26 03:03:03,091][123090] Updated weights for policy 1, policy_version 431316 (0.0006) [2023-12-26 03:03:03,163][123090] Updated weights for policy 1, policy_version 431326 (0.0005) [2023-12-26 03:03:03,765][123091] Updated weights for policy 0, policy_version 434003 (0.0009) [2023-12-26 03:03:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 221528064. Throughput: 0: 8820.9, 1: 8815.6. Samples: 221545176. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:03,784][121949] Avg episode reward: [(0, '6084.239'), (1, '5542.290')] [2023-12-26 03:03:03,821][123091] Updated weights for policy 0, policy_version 434013 (0.0011) [2023-12-26 03:03:03,870][123090] Updated weights for policy 1, policy_version 431336 (0.0006) [2023-12-26 03:03:03,889][123091] Updated weights for policy 0, policy_version 434023 (0.0011) [2023-12-26 03:03:03,932][123090] Updated weights for policy 1, policy_version 431346 (0.0007) [2023-12-26 03:03:04,001][123090] Updated weights for policy 1, policy_version 431356 (0.0009) [2023-12-26 03:03:04,679][123090] Updated weights for policy 1, policy_version 431366 (0.0006) [2023-12-26 03:03:04,689][123091] Updated weights for policy 0, policy_version 434033 (0.0011) [2023-12-26 03:03:04,733][123090] Updated weights for policy 1, policy_version 431376 (0.0005) [2023-12-26 03:03:04,741][123091] Updated weights for policy 0, policy_version 434043 (0.0010) [2023-12-26 03:03:04,782][123090] Updated weights for policy 1, policy_version 431386 (0.0005) [2023-12-26 03:03:04,789][123091] Updated weights for policy 0, policy_version 434053 (0.0010) [2023-12-26 03:03:04,833][123091] Updated weights for policy 0, policy_version 434063 (0.0010) [2023-12-26 03:03:05,486][123090] Updated weights for policy 1, policy_version 431396 (0.0007) [2023-12-26 03:03:05,552][123090] Updated weights for policy 1, policy_version 431406 (0.0009) [2023-12-26 03:03:05,613][123090] Updated weights for policy 1, policy_version 431416 (0.0008) [2023-12-26 03:03:05,640][123091] Updated weights for policy 0, policy_version 434073 (0.0010) [2023-12-26 03:03:05,695][123091] Updated weights for policy 0, policy_version 434083 (0.0010) [2023-12-26 03:03:05,742][123091] Updated weights for policy 0, policy_version 434093 (0.0010) [2023-12-26 03:03:06,383][123090] Updated weights for policy 1, policy_version 431426 (0.0006) [2023-12-26 03:03:06,454][123090] Updated weights for policy 1, policy_version 431436 (0.0008) [2023-12-26 03:03:06,519][123090] Updated weights for policy 1, policy_version 431446 (0.0009) [2023-12-26 03:03:06,586][123090] Updated weights for policy 1, policy_version 431456 (0.0009) [2023-12-26 03:03:06,595][123091] Updated weights for policy 0, policy_version 434103 (0.0011) [2023-12-26 03:03:06,652][123091] Updated weights for policy 0, policy_version 434113 (0.0011) [2023-12-26 03:03:06,722][123091] Updated weights for policy 0, policy_version 434123 (0.0011) [2023-12-26 03:03:07,401][123090] Updated weights for policy 1, policy_version 431466 (0.0010) [2023-12-26 03:03:07,456][123090] Updated weights for policy 1, policy_version 431476 (0.0010) [2023-12-26 03:03:07,500][123091] Updated weights for policy 0, policy_version 434133 (0.0011) [2023-12-26 03:03:07,519][123090] Updated weights for policy 1, policy_version 431486 (0.0006) [2023-12-26 03:03:07,558][123091] Updated weights for policy 0, policy_version 434143 (0.0010) [2023-12-26 03:03:07,628][123091] Updated weights for policy 0, policy_version 434153 (0.0011) [2023-12-26 03:03:08,267][123090] Updated weights for policy 1, policy_version 431496 (0.0006) [2023-12-26 03:03:08,318][123090] Updated weights for policy 1, policy_version 431506 (0.0005) [2023-12-26 03:03:08,385][123090] Updated weights for policy 1, policy_version 431516 (0.0007) [2023-12-26 03:03:08,424][123091] Updated weights for policy 0, policy_version 434163 (0.0011) [2023-12-26 03:03:08,487][123091] Updated weights for policy 0, policy_version 434173 (0.0010) [2023-12-26 03:03:08,551][123091] Updated weights for policy 0, policy_version 434183 (0.0011) [2023-12-26 03:03:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 221626368. Throughput: 0: 8847.6, 1: 8877.5. Samples: 221599608. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:08,785][121949] Avg episode reward: [(0, '6171.400'), (1, '5587.669')] [2023-12-26 03:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000431520_110469120.pth... [2023-12-26 03:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000434192_111157248.pth... [2023-12-26 03:03:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000430496_110206976.pth [2023-12-26 03:03:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000433168_110895104.pth [2023-12-26 03:03:09,136][123090] Updated weights for policy 1, policy_version 431526 (0.0006) [2023-12-26 03:03:09,210][123090] Updated weights for policy 1, policy_version 431536 (0.0010) [2023-12-26 03:03:09,277][123090] Updated weights for policy 1, policy_version 431546 (0.0010) [2023-12-26 03:03:09,392][123091] Updated weights for policy 0, policy_version 434193 (0.0010) [2023-12-26 03:03:09,459][123091] Updated weights for policy 0, policy_version 434203 (0.0008) [2023-12-26 03:03:09,508][123091] Updated weights for policy 0, policy_version 434213 (0.0009) [2023-12-26 03:03:09,566][123091] Updated weights for policy 0, policy_version 434223 (0.0009) [2023-12-26 03:03:10,107][123090] Updated weights for policy 1, policy_version 431556 (0.0007) [2023-12-26 03:03:10,158][123090] Updated weights for policy 1, policy_version 431566 (0.0006) [2023-12-26 03:03:10,218][123090] Updated weights for policy 1, policy_version 431576 (0.0005) [2023-12-26 03:03:10,460][123091] Updated weights for policy 0, policy_version 434233 (0.0009) [2023-12-26 03:03:10,526][123091] Updated weights for policy 0, policy_version 434243 (0.0009) [2023-12-26 03:03:10,579][123091] Updated weights for policy 0, policy_version 434253 (0.0009) [2023-12-26 03:03:10,923][123090] Updated weights for policy 1, policy_version 431586 (0.0006) [2023-12-26 03:03:10,979][123090] Updated weights for policy 1, policy_version 431596 (0.0006) [2023-12-26 03:03:11,045][123090] Updated weights for policy 1, policy_version 431606 (0.0008) [2023-12-26 03:03:11,114][123090] Updated weights for policy 1, policy_version 431616 (0.0008) [2023-12-26 03:03:11,505][123091] Updated weights for policy 0, policy_version 434263 (0.0008) [2023-12-26 03:03:11,577][123091] Updated weights for policy 0, policy_version 434273 (0.0007) [2023-12-26 03:03:11,651][123091] Updated weights for policy 0, policy_version 434283 (0.0009) [2023-12-26 03:03:11,803][123090] Updated weights for policy 1, policy_version 431626 (0.0009) [2023-12-26 03:03:11,864][123090] Updated weights for policy 1, policy_version 431636 (0.0009) [2023-12-26 03:03:11,929][123090] Updated weights for policy 1, policy_version 431646 (0.0009) [2023-12-26 03:03:12,410][123091] Updated weights for policy 0, policy_version 434293 (0.0008) [2023-12-26 03:03:12,473][123091] Updated weights for policy 0, policy_version 434303 (0.0008) [2023-12-26 03:03:12,536][123091] Updated weights for policy 0, policy_version 434313 (0.0008) [2023-12-26 03:03:12,810][123090] Updated weights for policy 1, policy_version 431656 (0.0009) [2023-12-26 03:03:12,873][123090] Updated weights for policy 1, policy_version 431666 (0.0009) [2023-12-26 03:03:12,934][123090] Updated weights for policy 1, policy_version 431676 (0.0009) [2023-12-26 03:03:13,319][123091] Updated weights for policy 0, policy_version 434323 (0.0009) [2023-12-26 03:03:13,379][123091] Updated weights for policy 0, policy_version 434333 (0.0009) [2023-12-26 03:03:13,441][123091] Updated weights for policy 0, policy_version 434343 (0.0009) [2023-12-26 03:03:13,774][123090] Updated weights for policy 1, policy_version 431686 (0.0009) [2023-12-26 03:03:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 221708288. Throughput: 0: 8655.2, 1: 8921.5. Samples: 221703792. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:13,785][121949] Avg episode reward: [(0, '6129.965'), (1, '5618.911')] [2023-12-26 03:03:13,827][123090] Updated weights for policy 1, policy_version 431696 (0.0009) [2023-12-26 03:03:13,879][123090] Updated weights for policy 1, policy_version 431706 (0.0009) [2023-12-26 03:03:14,254][123091] Updated weights for policy 0, policy_version 434353 (0.0009) [2023-12-26 03:03:14,323][123091] Updated weights for policy 0, policy_version 434363 (0.0012) [2023-12-26 03:03:14,387][123091] Updated weights for policy 0, policy_version 434373 (0.0011) [2023-12-26 03:03:14,447][123091] Updated weights for policy 0, policy_version 434383 (0.0010) [2023-12-26 03:03:14,755][123090] Updated weights for policy 1, policy_version 431717 (0.0008) [2023-12-26 03:03:14,827][123090] Updated weights for policy 1, policy_version 431727 (0.0008) [2023-12-26 03:03:14,890][123090] Updated weights for policy 1, policy_version 431737 (0.0007) [2023-12-26 03:03:15,272][123091] Updated weights for policy 0, policy_version 434393 (0.0011) [2023-12-26 03:03:15,336][123091] Updated weights for policy 0, policy_version 434403 (0.0011) [2023-12-26 03:03:15,403][123091] Updated weights for policy 0, policy_version 434413 (0.0011) [2023-12-26 03:03:15,694][123090] Updated weights for policy 1, policy_version 431747 (0.0006) [2023-12-26 03:03:15,743][123090] Updated weights for policy 1, policy_version 431757 (0.0009) [2023-12-26 03:03:15,805][123090] Updated weights for policy 1, policy_version 431767 (0.0008) [2023-12-26 03:03:16,169][123091] Updated weights for policy 0, policy_version 434423 (0.0010) [2023-12-26 03:03:16,233][123091] Updated weights for policy 0, policy_version 434433 (0.0009) [2023-12-26 03:03:16,297][123091] Updated weights for policy 0, policy_version 434443 (0.0007) [2023-12-26 03:03:16,703][123090] Updated weights for policy 1, policy_version 431777 (0.0008) [2023-12-26 03:03:16,770][123090] Updated weights for policy 1, policy_version 431787 (0.0010) [2023-12-26 03:03:16,832][123090] Updated weights for policy 1, policy_version 431797 (0.0010) [2023-12-26 03:03:16,900][123090] Updated weights for policy 1, policy_version 431807 (0.0009) [2023-12-26 03:03:16,908][123091] Updated weights for policy 0, policy_version 434453 (0.0006) [2023-12-26 03:03:16,975][123091] Updated weights for policy 0, policy_version 434463 (0.0005) [2023-12-26 03:03:17,043][123091] Updated weights for policy 0, policy_version 434473 (0.0006) [2023-12-26 03:03:17,615][123090] Updated weights for policy 1, policy_version 431817 (0.0006) [2023-12-26 03:03:17,625][123091] Updated weights for policy 0, policy_version 434483 (0.0006) [2023-12-26 03:03:17,664][123090] Updated weights for policy 1, policy_version 431827 (0.0005) [2023-12-26 03:03:17,673][123091] Updated weights for policy 0, policy_version 434493 (0.0005) [2023-12-26 03:03:17,718][123090] Updated weights for policy 1, policy_version 431837 (0.0006) [2023-12-26 03:03:17,728][123091] Updated weights for policy 0, policy_version 434503 (0.0005) [2023-12-26 03:03:18,479][123091] Updated weights for policy 0, policy_version 434513 (0.0009) [2023-12-26 03:03:18,541][123091] Updated weights for policy 0, policy_version 434523 (0.0007) [2023-12-26 03:03:18,557][123090] Updated weights for policy 1, policy_version 431847 (0.0009) [2023-12-26 03:03:18,607][123091] Updated weights for policy 0, policy_version 434533 (0.0009) [2023-12-26 03:03:18,623][123090] Updated weights for policy 1, policy_version 431857 (0.0007) [2023-12-26 03:03:18,670][123091] Updated weights for policy 0, policy_version 434543 (0.0011) [2023-12-26 03:03:18,687][123090] Updated weights for policy 1, policy_version 431867 (0.0007) [2023-12-26 03:03:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 221806592. Throughput: 0: 8688.4, 1: 8906.8. Samples: 221812436. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:18,785][121949] Avg episode reward: [(0, '6074.205'), (1, '5609.049')] [2023-12-26 03:03:19,418][123091] Updated weights for policy 0, policy_version 434553 (0.0007) [2023-12-26 03:03:19,496][123091] Updated weights for policy 0, policy_version 434563 (0.0007) [2023-12-26 03:03:19,559][123090] Updated weights for policy 1, policy_version 431877 (0.0009) [2023-12-26 03:03:19,569][123091] Updated weights for policy 0, policy_version 434573 (0.0007) [2023-12-26 03:03:19,631][123090] Updated weights for policy 1, policy_version 431887 (0.0009) [2023-12-26 03:03:19,693][123090] Updated weights for policy 1, policy_version 431897 (0.0009) [2023-12-26 03:03:20,321][123091] Updated weights for policy 0, policy_version 434583 (0.0009) [2023-12-26 03:03:20,387][123091] Updated weights for policy 0, policy_version 434593 (0.0006) [2023-12-26 03:03:20,438][123091] Updated weights for policy 0, policy_version 434603 (0.0005) [2023-12-26 03:03:20,564][123090] Updated weights for policy 1, policy_version 431907 (0.0009) [2023-12-26 03:03:20,635][123090] Updated weights for policy 1, policy_version 431917 (0.0009) [2023-12-26 03:03:20,693][123090] Updated weights for policy 1, policy_version 431927 (0.0009) [2023-12-26 03:03:21,215][123091] Updated weights for policy 0, policy_version 434613 (0.0008) [2023-12-26 03:03:21,286][123091] Updated weights for policy 0, policy_version 434623 (0.0010) [2023-12-26 03:03:21,358][123091] Updated weights for policy 0, policy_version 434633 (0.0010) [2023-12-26 03:03:21,562][123090] Updated weights for policy 1, policy_version 431937 (0.0009) [2023-12-26 03:03:21,635][123090] Updated weights for policy 1, policy_version 431947 (0.0009) [2023-12-26 03:03:21,707][123090] Updated weights for policy 1, policy_version 431957 (0.0009) [2023-12-26 03:03:21,777][123090] Updated weights for policy 1, policy_version 431967 (0.0007) [2023-12-26 03:03:22,215][123091] Updated weights for policy 0, policy_version 434643 (0.0009) [2023-12-26 03:03:22,275][123091] Updated weights for policy 0, policy_version 434653 (0.0007) [2023-12-26 03:03:22,348][123091] Updated weights for policy 0, policy_version 434663 (0.0008) [2023-12-26 03:03:22,555][123090] Updated weights for policy 1, policy_version 431977 (0.0009) [2023-12-26 03:03:22,621][123090] Updated weights for policy 1, policy_version 431987 (0.0009) [2023-12-26 03:03:22,687][123090] Updated weights for policy 1, policy_version 431997 (0.0009) [2023-12-26 03:03:23,183][123091] Updated weights for policy 0, policy_version 434673 (0.0010) [2023-12-26 03:03:23,257][123091] Updated weights for policy 0, policy_version 434683 (0.0005) [2023-12-26 03:03:23,317][123091] Updated weights for policy 0, policy_version 434693 (0.0007) [2023-12-26 03:03:23,369][123091] Updated weights for policy 0, policy_version 434703 (0.0007) [2023-12-26 03:03:23,515][123090] Updated weights for policy 1, policy_version 432007 (0.0007) [2023-12-26 03:03:23,575][123090] Updated weights for policy 1, policy_version 432017 (0.0007) [2023-12-26 03:03:23,628][123090] Updated weights for policy 1, policy_version 432028 (0.0010) [2023-12-26 03:03:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 221888512. Throughput: 0: 8720.4, 1: 8820.0. Samples: 221863056. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:23,785][121949] Avg episode reward: [(0, '6062.154'), (1, '5510.110')] [2023-12-26 03:03:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000432032_110600192.pth... [2023-12-26 03:03:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000434704_111288320.pth... [2023-12-26 03:03:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000430976_110329856.pth [2023-12-26 03:03:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000433680_111026176.pth [2023-12-26 03:03:24,038][123091] Updated weights for policy 0, policy_version 434713 (0.0010) [2023-12-26 03:03:24,100][123091] Updated weights for policy 0, policy_version 434723 (0.0010) [2023-12-26 03:03:24,154][123091] Updated weights for policy 0, policy_version 434733 (0.0010) [2023-12-26 03:03:24,419][123090] Updated weights for policy 1, policy_version 432038 (0.0007) [2023-12-26 03:03:24,489][123090] Updated weights for policy 1, policy_version 432048 (0.0006) [2023-12-26 03:03:24,552][123090] Updated weights for policy 1, policy_version 432058 (0.0005) [2023-12-26 03:03:24,911][123091] Updated weights for policy 0, policy_version 434743 (0.0007) [2023-12-26 03:03:24,971][123091] Updated weights for policy 0, policy_version 434753 (0.0007) [2023-12-26 03:03:25,034][123091] Updated weights for policy 0, policy_version 434763 (0.0010) [2023-12-26 03:03:25,214][123090] Updated weights for policy 1, policy_version 432068 (0.0006) [2023-12-26 03:03:25,269][123090] Updated weights for policy 1, policy_version 432078 (0.0005) [2023-12-26 03:03:25,336][123090] Updated weights for policy 1, policy_version 432088 (0.0005) [2023-12-26 03:03:25,768][123091] Updated weights for policy 0, policy_version 434773 (0.0008) [2023-12-26 03:03:25,822][123091] Updated weights for policy 0, policy_version 434783 (0.0007) [2023-12-26 03:03:25,870][123091] Updated weights for policy 0, policy_version 434793 (0.0009) [2023-12-26 03:03:26,115][123090] Updated weights for policy 1, policy_version 432098 (0.0006) [2023-12-26 03:03:26,172][123090] Updated weights for policy 1, policy_version 432108 (0.0010) [2023-12-26 03:03:26,224][123090] Updated weights for policy 1, policy_version 432118 (0.0009) [2023-12-26 03:03:26,277][123090] Updated weights for policy 1, policy_version 432128 (0.0009) [2023-12-26 03:03:26,520][123091] Updated weights for policy 0, policy_version 434803 (0.0008) [2023-12-26 03:03:26,575][123091] Updated weights for policy 0, policy_version 434813 (0.0005) [2023-12-26 03:03:26,626][123091] Updated weights for policy 0, policy_version 434823 (0.0005) [2023-12-26 03:03:27,153][123090] Updated weights for policy 1, policy_version 432138 (0.0007) [2023-12-26 03:03:27,200][123090] Updated weights for policy 1, policy_version 432148 (0.0010) [2023-12-26 03:03:27,244][123090] Updated weights for policy 1, policy_version 432158 (0.0010) [2023-12-26 03:03:27,331][123091] Updated weights for policy 0, policy_version 434833 (0.0006) [2023-12-26 03:03:27,384][123091] Updated weights for policy 0, policy_version 434843 (0.0008) [2023-12-26 03:03:27,432][123091] Updated weights for policy 0, policy_version 434853 (0.0009) [2023-12-26 03:03:27,482][123091] Updated weights for policy 0, policy_version 434863 (0.0009) [2023-12-26 03:03:28,041][123090] Updated weights for policy 1, policy_version 432168 (0.0007) [2023-12-26 03:03:28,112][123090] Updated weights for policy 1, policy_version 432178 (0.0005) [2023-12-26 03:03:28,182][123090] Updated weights for policy 1, policy_version 432188 (0.0006) [2023-12-26 03:03:28,281][123091] Updated weights for policy 0, policy_version 434873 (0.0008) [2023-12-26 03:03:28,349][123091] Updated weights for policy 0, policy_version 434883 (0.0011) [2023-12-26 03:03:28,415][123091] Updated weights for policy 0, policy_version 434893 (0.0006) [2023-12-26 03:03:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 221978624. Throughput: 0: 8832.7, 1: 8872.0. Samples: 221973216. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:28,784][121949] Avg episode reward: [(0, '6009.259'), (1, '5526.889')] [2023-12-26 03:03:28,894][123090] Updated weights for policy 1, policy_version 432198 (0.0008) [2023-12-26 03:03:28,942][123090] Updated weights for policy 1, policy_version 432208 (0.0008) [2023-12-26 03:03:28,990][123090] Updated weights for policy 1, policy_version 432218 (0.0005) [2023-12-26 03:03:29,133][123091] Updated weights for policy 0, policy_version 434903 (0.0005) [2023-12-26 03:03:29,196][123091] Updated weights for policy 0, policy_version 434913 (0.0005) [2023-12-26 03:03:29,257][123091] Updated weights for policy 0, policy_version 434923 (0.0007) [2023-12-26 03:03:29,774][123090] Updated weights for policy 1, policy_version 432228 (0.0005) [2023-12-26 03:03:29,831][123090] Updated weights for policy 1, policy_version 432238 (0.0007) [2023-12-26 03:03:29,900][123090] Updated weights for policy 1, policy_version 432248 (0.0009) [2023-12-26 03:03:29,970][123091] Updated weights for policy 0, policy_version 434933 (0.0007) [2023-12-26 03:03:30,022][123091] Updated weights for policy 0, policy_version 434943 (0.0010) [2023-12-26 03:03:30,072][123091] Updated weights for policy 0, policy_version 434953 (0.0009) [2023-12-26 03:03:30,706][123090] Updated weights for policy 1, policy_version 432258 (0.0008) [2023-12-26 03:03:30,763][123090] Updated weights for policy 1, policy_version 432268 (0.0009) [2023-12-26 03:03:30,823][123090] Updated weights for policy 1, policy_version 432278 (0.0009) [2023-12-26 03:03:30,893][123090] Updated weights for policy 1, policy_version 432288 (0.0010) [2023-12-26 03:03:30,916][123091] Updated weights for policy 0, policy_version 434963 (0.0008) [2023-12-26 03:03:30,992][123091] Updated weights for policy 0, policy_version 434973 (0.0005) [2023-12-26 03:03:31,063][123091] Updated weights for policy 0, policy_version 434983 (0.0009) [2023-12-26 03:03:31,707][123090] Updated weights for policy 1, policy_version 432298 (0.0007) [2023-12-26 03:03:31,770][123090] Updated weights for policy 1, policy_version 432308 (0.0007) [2023-12-26 03:03:31,838][123090] Updated weights for policy 1, policy_version 432318 (0.0006) [2023-12-26 03:03:31,886][123091] Updated weights for policy 0, policy_version 434993 (0.0009) [2023-12-26 03:03:31,933][123091] Updated weights for policy 0, policy_version 435003 (0.0008) [2023-12-26 03:03:31,993][123091] Updated weights for policy 0, policy_version 435013 (0.0010) [2023-12-26 03:03:32,046][123091] Updated weights for policy 0, policy_version 435023 (0.0007) [2023-12-26 03:03:32,649][123090] Updated weights for policy 1, policy_version 432328 (0.0009) [2023-12-26 03:03:32,710][123090] Updated weights for policy 1, policy_version 432338 (0.0009) [2023-12-26 03:03:32,773][123090] Updated weights for policy 1, policy_version 432348 (0.0009) [2023-12-26 03:03:32,781][123091] Updated weights for policy 0, policy_version 435033 (0.0007) [2023-12-26 03:03:32,842][123091] Updated weights for policy 0, policy_version 435043 (0.0011) [2023-12-26 03:03:32,901][123091] Updated weights for policy 0, policy_version 435053 (0.0009) [2023-12-26 03:03:33,603][123090] Updated weights for policy 1, policy_version 432358 (0.0010) [2023-12-26 03:03:33,652][123090] Updated weights for policy 1, policy_version 432368 (0.0009) [2023-12-26 03:03:33,701][123090] Updated weights for policy 1, policy_version 432378 (0.0009) [2023-12-26 03:03:33,738][123091] Updated weights for policy 0, policy_version 435063 (0.0009) [2023-12-26 03:03:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 222068736. Throughput: 0: 8923.7, 1: 8844.3. Samples: 222079544. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:33,785][121949] Avg episode reward: [(0, '6078.371'), (1, '5669.402')] [2023-12-26 03:03:33,799][123091] Updated weights for policy 0, policy_version 435073 (0.0008) [2023-12-26 03:03:33,875][123091] Updated weights for policy 0, policy_version 435083 (0.0006) [2023-12-26 03:03:34,535][123091] Updated weights for policy 0, policy_version 435093 (0.0008) [2023-12-26 03:03:34,596][123091] Updated weights for policy 0, policy_version 435103 (0.0007) [2023-12-26 03:03:34,615][123090] Updated weights for policy 1, policy_version 432388 (0.0009) [2023-12-26 03:03:34,659][123091] Updated weights for policy 0, policy_version 435113 (0.0009) [2023-12-26 03:03:34,681][123090] Updated weights for policy 1, policy_version 432398 (0.0009) [2023-12-26 03:03:34,746][123090] Updated weights for policy 1, policy_version 432408 (0.0007) [2023-12-26 03:03:35,416][123091] Updated weights for policy 0, policy_version 435123 (0.0008) [2023-12-26 03:03:35,470][123091] Updated weights for policy 0, policy_version 435133 (0.0005) [2023-12-26 03:03:35,532][123091] Updated weights for policy 0, policy_version 435143 (0.0006) [2023-12-26 03:03:35,617][123090] Updated weights for policy 1, policy_version 432418 (0.0009) [2023-12-26 03:03:35,678][123090] Updated weights for policy 1, policy_version 432428 (0.0009) [2023-12-26 03:03:35,731][123090] Updated weights for policy 1, policy_version 432438 (0.0009) [2023-12-26 03:03:35,801][123090] Updated weights for policy 1, policy_version 432448 (0.0009) [2023-12-26 03:03:36,221][123091] Updated weights for policy 0, policy_version 435153 (0.0010) [2023-12-26 03:03:36,276][123091] Updated weights for policy 0, policy_version 435163 (0.0005) [2023-12-26 03:03:36,329][123091] Updated weights for policy 0, policy_version 435173 (0.0007) [2023-12-26 03:03:36,392][123091] Updated weights for policy 0, policy_version 435183 (0.0011) [2023-12-26 03:03:36,644][123090] Updated weights for policy 1, policy_version 432458 (0.0009) [2023-12-26 03:03:36,704][123090] Updated weights for policy 1, policy_version 432468 (0.0009) [2023-12-26 03:03:36,765][123090] Updated weights for policy 1, policy_version 432478 (0.0009) [2023-12-26 03:03:37,198][123091] Updated weights for policy 0, policy_version 435193 (0.0011) [2023-12-26 03:03:37,249][123091] Updated weights for policy 0, policy_version 435203 (0.0010) [2023-12-26 03:03:37,301][123091] Updated weights for policy 0, policy_version 435213 (0.0010) [2023-12-26 03:03:37,582][123090] Updated weights for policy 1, policy_version 432488 (0.0009) [2023-12-26 03:03:37,638][123090] Updated weights for policy 1, policy_version 432498 (0.0010) [2023-12-26 03:03:37,701][123090] Updated weights for policy 1, policy_version 432508 (0.0009) [2023-12-26 03:03:38,116][123091] Updated weights for policy 0, policy_version 435223 (0.0010) [2023-12-26 03:03:38,165][123091] Updated weights for policy 0, policy_version 435233 (0.0010) [2023-12-26 03:03:38,222][123091] Updated weights for policy 0, policy_version 435243 (0.0005) [2023-12-26 03:03:38,591][123090] Updated weights for policy 1, policy_version 432518 (0.0007) [2023-12-26 03:03:38,655][123090] Updated weights for policy 1, policy_version 432528 (0.0005) [2023-12-26 03:03:38,724][123090] Updated weights for policy 1, policy_version 432538 (0.0005) [2023-12-26 03:03:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 222158848. Throughput: 0: 9014.2, 1: 8832.9. Samples: 222133488. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:38,785][121949] Avg episode reward: [(0, '6213.053'), (1, '5565.071')] [2023-12-26 03:03:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000435248_111427584.pth... [2023-12-26 03:03:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000432544_110731264.pth... [2023-12-26 03:03:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000431520_110469120.pth [2023-12-26 03:03:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000434192_111157248.pth [2023-12-26 03:03:39,015][123091] Updated weights for policy 0, policy_version 435253 (0.0008) [2023-12-26 03:03:39,074][123091] Updated weights for policy 0, policy_version 435263 (0.0011) [2023-12-26 03:03:39,134][123091] Updated weights for policy 0, policy_version 435273 (0.0006) [2023-12-26 03:03:39,389][123090] Updated weights for policy 1, policy_version 432548 (0.0007) [2023-12-26 03:03:39,458][123090] Updated weights for policy 1, policy_version 432558 (0.0010) [2023-12-26 03:03:39,518][123090] Updated weights for policy 1, policy_version 432568 (0.0011) [2023-12-26 03:03:39,883][123091] Updated weights for policy 0, policy_version 435283 (0.0007) [2023-12-26 03:03:39,950][123091] Updated weights for policy 0, policy_version 435293 (0.0009) [2023-12-26 03:03:40,010][123091] Updated weights for policy 0, policy_version 435303 (0.0011) [2023-12-26 03:03:40,285][123090] Updated weights for policy 1, policy_version 432578 (0.0010) [2023-12-26 03:03:40,343][123090] Updated weights for policy 1, policy_version 432588 (0.0005) [2023-12-26 03:03:40,393][123090] Updated weights for policy 1, policy_version 432598 (0.0005) [2023-12-26 03:03:40,451][123090] Updated weights for policy 1, policy_version 432608 (0.0006) [2023-12-26 03:03:40,835][123091] Updated weights for policy 0, policy_version 435313 (0.0011) [2023-12-26 03:03:40,902][123091] Updated weights for policy 0, policy_version 435323 (0.0011) [2023-12-26 03:03:40,969][123091] Updated weights for policy 0, policy_version 435333 (0.0011) [2023-12-26 03:03:41,025][123091] Updated weights for policy 0, policy_version 435343 (0.0010) [2023-12-26 03:03:41,217][123090] Updated weights for policy 1, policy_version 432618 (0.0011) [2023-12-26 03:03:41,282][123090] Updated weights for policy 1, policy_version 432628 (0.0011) [2023-12-26 03:03:41,360][123090] Updated weights for policy 1, policy_version 432638 (0.0011) [2023-12-26 03:03:41,799][123091] Updated weights for policy 0, policy_version 435353 (0.0008) [2023-12-26 03:03:41,860][123091] Updated weights for policy 0, policy_version 435363 (0.0008) [2023-12-26 03:03:41,921][123091] Updated weights for policy 0, policy_version 435373 (0.0005) [2023-12-26 03:03:42,242][123090] Updated weights for policy 1, policy_version 432648 (0.0011) [2023-12-26 03:03:42,300][123090] Updated weights for policy 1, policy_version 432658 (0.0010) [2023-12-26 03:03:42,369][123090] Updated weights for policy 1, policy_version 432668 (0.0009) [2023-12-26 03:03:42,710][123091] Updated weights for policy 0, policy_version 435383 (0.0009) [2023-12-26 03:03:42,768][123091] Updated weights for policy 0, policy_version 435393 (0.0010) [2023-12-26 03:03:42,835][123091] Updated weights for policy 0, policy_version 435403 (0.0009) [2023-12-26 03:03:43,115][123090] Updated weights for policy 1, policy_version 432678 (0.0008) [2023-12-26 03:03:43,185][123090] Updated weights for policy 1, policy_version 432688 (0.0008) [2023-12-26 03:03:43,242][123090] Updated weights for policy 1, policy_version 432698 (0.0009) [2023-12-26 03:03:43,609][123091] Updated weights for policy 0, policy_version 435413 (0.0009) [2023-12-26 03:03:43,675][123091] Updated weights for policy 0, policy_version 435423 (0.0009) [2023-12-26 03:03:43,744][123091] Updated weights for policy 0, policy_version 435433 (0.0010) [2023-12-26 03:03:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 222240768. Throughput: 0: 8982.5, 1: 8766.1. Samples: 222239272. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:43,785][121949] Avg episode reward: [(0, '6207.205'), (1, '5481.240')] [2023-12-26 03:03:44,057][123090] Updated weights for policy 1, policy_version 432708 (0.0009) [2023-12-26 03:03:44,123][123090] Updated weights for policy 1, policy_version 432718 (0.0005) [2023-12-26 03:03:44,192][123090] Updated weights for policy 1, policy_version 432728 (0.0005) [2023-12-26 03:03:44,574][123091] Updated weights for policy 0, policy_version 435443 (0.0010) [2023-12-26 03:03:44,644][123091] Updated weights for policy 0, policy_version 435453 (0.0008) [2023-12-26 03:03:44,713][123091] Updated weights for policy 0, policy_version 435463 (0.0010) [2023-12-26 03:03:44,905][123090] Updated weights for policy 1, policy_version 432738 (0.0009) [2023-12-26 03:03:44,982][123090] Updated weights for policy 1, policy_version 432748 (0.0006) [2023-12-26 03:03:45,054][123090] Updated weights for policy 1, policy_version 432758 (0.0006) [2023-12-26 03:03:45,124][123090] Updated weights for policy 1, policy_version 432768 (0.0009) [2023-12-26 03:03:45,561][123091] Updated weights for policy 0, policy_version 435473 (0.0008) [2023-12-26 03:03:45,615][123091] Updated weights for policy 0, policy_version 435483 (0.0009) [2023-12-26 03:03:45,677][123091] Updated weights for policy 0, policy_version 435493 (0.0009) [2023-12-26 03:03:45,740][123091] Updated weights for policy 0, policy_version 435503 (0.0010) [2023-12-26 03:03:45,862][123090] Updated weights for policy 1, policy_version 432778 (0.0008) [2023-12-26 03:03:45,930][123090] Updated weights for policy 1, policy_version 432788 (0.0009) [2023-12-26 03:03:45,995][123090] Updated weights for policy 1, policy_version 432798 (0.0010) [2023-12-26 03:03:46,582][123091] Updated weights for policy 0, policy_version 435513 (0.0010) [2023-12-26 03:03:46,634][123091] Updated weights for policy 0, policy_version 435523 (0.0009) [2023-12-26 03:03:46,681][123091] Updated weights for policy 0, policy_version 435533 (0.0008) [2023-12-26 03:03:46,812][123090] Updated weights for policy 1, policy_version 432808 (0.0009) [2023-12-26 03:03:46,876][123090] Updated weights for policy 1, policy_version 432818 (0.0009) [2023-12-26 03:03:46,935][123090] Updated weights for policy 1, policy_version 432828 (0.0009) [2023-12-26 03:03:47,537][123091] Updated weights for policy 0, policy_version 435543 (0.0009) [2023-12-26 03:03:47,592][123091] Updated weights for policy 0, policy_version 435553 (0.0010) [2023-12-26 03:03:47,640][123091] Updated weights for policy 0, policy_version 435563 (0.0009) [2023-12-26 03:03:47,691][123090] Updated weights for policy 1, policy_version 432838 (0.0007) [2023-12-26 03:03:47,763][123090] Updated weights for policy 1, policy_version 432848 (0.0006) [2023-12-26 03:03:47,829][123090] Updated weights for policy 1, policy_version 432858 (0.0010) [2023-12-26 03:03:48,374][123091] Updated weights for policy 0, policy_version 435573 (0.0008) [2023-12-26 03:03:48,436][123091] Updated weights for policy 0, policy_version 435583 (0.0006) [2023-12-26 03:03:48,491][123091] Updated weights for policy 0, policy_version 435593 (0.0007) [2023-12-26 03:03:48,566][123090] Updated weights for policy 1, policy_version 432868 (0.0010) [2023-12-26 03:03:48,630][123090] Updated weights for policy 1, policy_version 432878 (0.0008) [2023-12-26 03:03:48,690][123090] Updated weights for policy 1, policy_version 432888 (0.0008) [2023-12-26 03:03:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 222339072. Throughput: 0: 8998.6, 1: 8779.6. Samples: 222345192. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:48,784][121949] Avg episode reward: [(0, '6130.827'), (1, '5503.810')] [2023-12-26 03:03:49,268][123091] Updated weights for policy 0, policy_version 435603 (0.0008) [2023-12-26 03:03:49,328][123091] Updated weights for policy 0, policy_version 435613 (0.0010) [2023-12-26 03:03:49,399][123091] Updated weights for policy 0, policy_version 435623 (0.0009) [2023-12-26 03:03:49,510][123090] Updated weights for policy 1, policy_version 432898 (0.0006) [2023-12-26 03:03:49,572][123090] Updated weights for policy 1, policy_version 432908 (0.0009) [2023-12-26 03:03:49,633][123090] Updated weights for policy 1, policy_version 432918 (0.0009) [2023-12-26 03:03:49,697][123090] Updated weights for policy 1, policy_version 432928 (0.0009) [2023-12-26 03:03:50,236][123091] Updated weights for policy 0, policy_version 435633 (0.0009) [2023-12-26 03:03:50,297][123091] Updated weights for policy 0, policy_version 435643 (0.0010) [2023-12-26 03:03:50,349][123091] Updated weights for policy 0, policy_version 435653 (0.0009) [2023-12-26 03:03:50,409][123091] Updated weights for policy 0, policy_version 435663 (0.0010) [2023-12-26 03:03:50,551][123090] Updated weights for policy 1, policy_version 432938 (0.0009) [2023-12-26 03:03:50,619][123090] Updated weights for policy 1, policy_version 432948 (0.0009) [2023-12-26 03:03:50,691][123090] Updated weights for policy 1, policy_version 432958 (0.0009) [2023-12-26 03:03:51,283][123091] Updated weights for policy 0, policy_version 435673 (0.0009) [2023-12-26 03:03:51,350][123091] Updated weights for policy 0, policy_version 435683 (0.0010) [2023-12-26 03:03:51,417][123091] Updated weights for policy 0, policy_version 435693 (0.0007) [2023-12-26 03:03:51,556][123090] Updated weights for policy 1, policy_version 432968 (0.0010) [2023-12-26 03:03:51,620][123090] Updated weights for policy 1, policy_version 432978 (0.0010) [2023-12-26 03:03:51,701][123090] Updated weights for policy 1, policy_version 432988 (0.0008) [2023-12-26 03:03:52,199][123091] Updated weights for policy 0, policy_version 435703 (0.0009) [2023-12-26 03:03:52,270][123091] Updated weights for policy 0, policy_version 435713 (0.0009) [2023-12-26 03:03:52,332][123091] Updated weights for policy 0, policy_version 435723 (0.0009) [2023-12-26 03:03:52,423][123090] Updated weights for policy 1, policy_version 432998 (0.0010) [2023-12-26 03:03:52,482][123090] Updated weights for policy 1, policy_version 433008 (0.0010) [2023-12-26 03:03:52,542][123090] Updated weights for policy 1, policy_version 433018 (0.0010) [2023-12-26 03:03:53,197][123091] Updated weights for policy 0, policy_version 435733 (0.0010) [2023-12-26 03:03:53,256][123091] Updated weights for policy 0, policy_version 435743 (0.0009) [2023-12-26 03:03:53,308][123091] Updated weights for policy 0, policy_version 435753 (0.0010) [2023-12-26 03:03:53,339][123090] Updated weights for policy 1, policy_version 433028 (0.0010) [2023-12-26 03:03:53,394][123090] Updated weights for policy 1, policy_version 433038 (0.0008) [2023-12-26 03:03:53,449][123090] Updated weights for policy 1, policy_version 433048 (0.0010) [2023-12-26 03:03:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 222420992. Throughput: 0: 8994.6, 1: 8710.6. Samples: 222396348. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:53,785][121949] Avg episode reward: [(0, '6163.006'), (1, '5731.125')] [2023-12-26 03:03:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000435760_111558656.pth... [2023-12-26 03:03:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000433056_110862336.pth... [2023-12-26 03:03:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000434704_111288320.pth [2023-12-26 03:03:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000432032_110600192.pth [2023-12-26 03:03:54,141][123091] Updated weights for policy 0, policy_version 435763 (0.0008) [2023-12-26 03:03:54,200][123091] Updated weights for policy 0, policy_version 435773 (0.0009) [2023-12-26 03:03:54,259][123091] Updated weights for policy 0, policy_version 435783 (0.0009) [2023-12-26 03:03:54,287][123090] Updated weights for policy 1, policy_version 433058 (0.0010) [2023-12-26 03:03:54,352][123090] Updated weights for policy 1, policy_version 433068 (0.0006) [2023-12-26 03:03:54,412][123090] Updated weights for policy 1, policy_version 433078 (0.0006) [2023-12-26 03:03:54,477][123090] Updated weights for policy 1, policy_version 433088 (0.0006) [2023-12-26 03:03:55,121][123091] Updated weights for policy 0, policy_version 435793 (0.0009) [2023-12-26 03:03:55,170][123091] Updated weights for policy 0, policy_version 435803 (0.0006) [2023-12-26 03:03:55,172][123090] Updated weights for policy 1, policy_version 433098 (0.0010) [2023-12-26 03:03:55,221][123091] Updated weights for policy 0, policy_version 435813 (0.0005) [2023-12-26 03:03:55,223][123090] Updated weights for policy 1, policy_version 433108 (0.0010) [2023-12-26 03:03:55,272][123091] Updated weights for policy 0, policy_version 435823 (0.0006) [2023-12-26 03:03:55,278][123090] Updated weights for policy 1, policy_version 433118 (0.0010) [2023-12-26 03:03:56,070][123090] Updated weights for policy 1, policy_version 433128 (0.0009) [2023-12-26 03:03:56,125][123090] Updated weights for policy 1, policy_version 433138 (0.0005) [2023-12-26 03:03:56,149][123091] Updated weights for policy 0, policy_version 435833 (0.0009) [2023-12-26 03:03:56,181][123090] Updated weights for policy 1, policy_version 433148 (0.0005) [2023-12-26 03:03:56,200][123091] Updated weights for policy 0, policy_version 435843 (0.0009) [2023-12-26 03:03:56,254][123091] Updated weights for policy 0, policy_version 435853 (0.0009) [2023-12-26 03:03:56,951][123090] Updated weights for policy 1, policy_version 433158 (0.0009) [2023-12-26 03:03:57,003][123090] Updated weights for policy 1, policy_version 433168 (0.0008) [2023-12-26 03:03:57,058][123090] Updated weights for policy 1, policy_version 433178 (0.0009) [2023-12-26 03:03:57,094][123091] Updated weights for policy 0, policy_version 435863 (0.0007) [2023-12-26 03:03:57,147][123091] Updated weights for policy 0, policy_version 435873 (0.0010) [2023-12-26 03:03:57,202][123091] Updated weights for policy 0, policy_version 435884 (0.0009) [2023-12-26 03:03:57,791][123090] Updated weights for policy 1, policy_version 433188 (0.0009) [2023-12-26 03:03:57,853][123090] Updated weights for policy 1, policy_version 433198 (0.0009) [2023-12-26 03:03:57,899][123090] Updated weights for policy 1, policy_version 433208 (0.0009) [2023-12-26 03:03:58,088][123091] Updated weights for policy 0, policy_version 435894 (0.0009) [2023-12-26 03:03:58,149][123091] Updated weights for policy 0, policy_version 435904 (0.0010) [2023-12-26 03:03:58,208][123091] Updated weights for policy 0, policy_version 435914 (0.0009) [2023-12-26 03:03:58,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 222502912. Throughput: 0: 8987.8, 1: 8732.0. Samples: 222501184. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:03:58,785][121949] Avg episode reward: [(0, '6172.683'), (1, '5714.613')] [2023-12-26 03:03:58,797][123090] Updated weights for policy 1, policy_version 433218 (0.0008) [2023-12-26 03:03:58,869][123090] Updated weights for policy 1, policy_version 433228 (0.0009) [2023-12-26 03:03:58,947][123090] Updated weights for policy 1, policy_version 433238 (0.0009) [2023-12-26 03:03:59,014][123090] Updated weights for policy 1, policy_version 433248 (0.0009) [2023-12-26 03:03:59,156][123091] Updated weights for policy 0, policy_version 435924 (0.0009) [2023-12-26 03:03:59,224][123091] Updated weights for policy 0, policy_version 435934 (0.0009) [2023-12-26 03:03:59,294][123091] Updated weights for policy 0, policy_version 435944 (0.0010) [2023-12-26 03:03:59,810][123090] Updated weights for policy 1, policy_version 433258 (0.0009) [2023-12-26 03:03:59,877][123090] Updated weights for policy 1, policy_version 433268 (0.0010) [2023-12-26 03:03:59,936][123090] Updated weights for policy 1, policy_version 433278 (0.0007) [2023-12-26 03:04:00,079][123091] Updated weights for policy 0, policy_version 435954 (0.0009) [2023-12-26 03:04:00,147][123091] Updated weights for policy 0, policy_version 435964 (0.0010) [2023-12-26 03:04:00,213][123091] Updated weights for policy 0, policy_version 435974 (0.0010) [2023-12-26 03:04:00,272][123091] Updated weights for policy 0, policy_version 435984 (0.0010) [2023-12-26 03:04:00,718][123090] Updated weights for policy 1, policy_version 433288 (0.0009) [2023-12-26 03:04:00,765][123090] Updated weights for policy 1, policy_version 433298 (0.0008) [2023-12-26 03:04:00,817][123090] Updated weights for policy 1, policy_version 433308 (0.0009) [2023-12-26 03:04:01,091][123091] Updated weights for policy 0, policy_version 435994 (0.0010) [2023-12-26 03:04:01,159][123091] Updated weights for policy 0, policy_version 436004 (0.0010) [2023-12-26 03:04:01,213][123091] Updated weights for policy 0, policy_version 436014 (0.0009) [2023-12-26 03:04:01,730][123090] Updated weights for policy 1, policy_version 433318 (0.0009) [2023-12-26 03:04:01,789][123090] Updated weights for policy 1, policy_version 433328 (0.0010) [2023-12-26 03:04:01,840][123090] Updated weights for policy 1, policy_version 433338 (0.0010) [2023-12-26 03:04:02,124][123091] Updated weights for policy 0, policy_version 436024 (0.0009) [2023-12-26 03:04:02,196][123091] Updated weights for policy 0, policy_version 436034 (0.0010) [2023-12-26 03:04:02,263][123091] Updated weights for policy 0, policy_version 436044 (0.0010) [2023-12-26 03:04:02,731][123090] Updated weights for policy 1, policy_version 433348 (0.0009) [2023-12-26 03:04:02,790][123090] Updated weights for policy 1, policy_version 433358 (0.0010) [2023-12-26 03:04:02,860][123090] Updated weights for policy 1, policy_version 433368 (0.0011) [2023-12-26 03:04:03,098][123091] Updated weights for policy 0, policy_version 436054 (0.0010) [2023-12-26 03:04:03,156][123091] Updated weights for policy 0, policy_version 436064 (0.0010) [2023-12-26 03:04:03,209][123091] Updated weights for policy 0, policy_version 436074 (0.0009) [2023-12-26 03:04:03,571][123090] Updated weights for policy 1, policy_version 433378 (0.0009) [2023-12-26 03:04:03,629][123090] Updated weights for policy 1, policy_version 433388 (0.0009) [2023-12-26 03:04:03,677][123090] Updated weights for policy 1, policy_version 433398 (0.0009) [2023-12-26 03:04:03,726][123090] Updated weights for policy 1, policy_version 433408 (0.0010) [2023-12-26 03:04:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 222593024. Throughput: 0: 8809.9, 1: 8730.7. Samples: 222601768. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:04:03,785][121949] Avg episode reward: [(0, '6158.396'), (1, '5574.381')] [2023-12-26 03:04:04,070][123091] Updated weights for policy 0, policy_version 436084 (0.0009) [2023-12-26 03:04:04,131][123091] Updated weights for policy 0, policy_version 436094 (0.0009) [2023-12-26 03:04:04,196][123091] Updated weights for policy 0, policy_version 436104 (0.0009) [2023-12-26 03:04:04,571][123090] Updated weights for policy 1, policy_version 433418 (0.0009) [2023-12-26 03:04:04,627][123090] Updated weights for policy 1, policy_version 433428 (0.0009) [2023-12-26 03:04:04,675][123090] Updated weights for policy 1, policy_version 433438 (0.0009) [2023-12-26 03:04:05,014][123091] Updated weights for policy 0, policy_version 436114 (0.0009) [2023-12-26 03:04:05,085][123091] Updated weights for policy 0, policy_version 436124 (0.0005) [2023-12-26 03:04:05,160][123091] Updated weights for policy 0, policy_version 436134 (0.0005) [2023-12-26 03:04:05,226][123091] Updated weights for policy 0, policy_version 436144 (0.0007) [2023-12-26 03:04:05,539][123090] Updated weights for policy 1, policy_version 433448 (0.0009) [2023-12-26 03:04:05,588][123090] Updated weights for policy 1, policy_version 433458 (0.0009) [2023-12-26 03:04:05,641][123090] Updated weights for policy 1, policy_version 433468 (0.0009) [2023-12-26 03:04:05,910][123091] Updated weights for policy 0, policy_version 436154 (0.0005) [2023-12-26 03:04:05,978][123091] Updated weights for policy 0, policy_version 436164 (0.0005) [2023-12-26 03:04:06,026][123091] Updated weights for policy 0, policy_version 436174 (0.0005) [2023-12-26 03:04:06,417][123090] Updated weights for policy 1, policy_version 433478 (0.0009) [2023-12-26 03:04:06,485][123090] Updated weights for policy 1, policy_version 433488 (0.0010) [2023-12-26 03:04:06,558][123090] Updated weights for policy 1, policy_version 433498 (0.0009) [2023-12-26 03:04:06,748][123091] Updated weights for policy 0, policy_version 436184 (0.0009) [2023-12-26 03:04:06,808][123091] Updated weights for policy 0, policy_version 436194 (0.0009) [2023-12-26 03:04:06,871][123091] Updated weights for policy 0, policy_version 436204 (0.0010) [2023-12-26 03:04:07,357][123090] Updated weights for policy 1, policy_version 433508 (0.0010) [2023-12-26 03:04:07,420][123090] Updated weights for policy 1, policy_version 433518 (0.0008) [2023-12-26 03:04:07,484][123090] Updated weights for policy 1, policy_version 433528 (0.0010) [2023-12-26 03:04:07,755][123091] Updated weights for policy 0, policy_version 436214 (0.0009) [2023-12-26 03:04:07,815][123091] Updated weights for policy 0, policy_version 436224 (0.0009) [2023-12-26 03:04:07,885][123091] Updated weights for policy 0, policy_version 436234 (0.0009) [2023-12-26 03:04:08,291][123090] Updated weights for policy 1, policy_version 433538 (0.0010) [2023-12-26 03:04:08,360][123090] Updated weights for policy 1, policy_version 433548 (0.0009) [2023-12-26 03:04:08,427][123090] Updated weights for policy 1, policy_version 433558 (0.0010) [2023-12-26 03:04:08,490][123090] Updated weights for policy 1, policy_version 433568 (0.0009) [2023-12-26 03:04:08,722][123091] Updated weights for policy 0, policy_version 436244 (0.0010) [2023-12-26 03:04:08,776][123091] Updated weights for policy 0, policy_version 436254 (0.0009) [2023-12-26 03:04:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 222674944. Throughput: 0: 8831.9, 1: 8763.1. Samples: 222654832. Policy #0 lag: (min: 31.0, avg: 32.9, max: 63.0) [2023-12-26 03:04:08,785][121949] Avg episode reward: [(0, '6065.703'), (1, '5510.788')] [2023-12-26 03:04:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000433568_110993408.pth... [2023-12-26 03:04:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000432544_110731264.pth [2023-12-26 03:04:08,833][123091] Updated weights for policy 0, policy_version 436264 (0.0009) [2023-12-26 03:04:08,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000436272_111689728.pth... [2023-12-26 03:04:08,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000435248_111427584.pth [2023-12-26 03:04:09,325][123090] Updated weights for policy 1, policy_version 433578 (0.0010) [2023-12-26 03:04:09,400][123090] Updated weights for policy 1, policy_version 433588 (0.0010) [2023-12-26 03:04:09,474][123090] Updated weights for policy 1, policy_version 433598 (0.0010) [2023-12-26 03:04:09,707][123091] Updated weights for policy 0, policy_version 436274 (0.0008) [2023-12-26 03:04:09,769][123091] Updated weights for policy 0, policy_version 436284 (0.0009) [2023-12-26 03:04:09,834][123091] Updated weights for policy 0, policy_version 436294 (0.0006) [2023-12-26 03:04:09,902][123091] Updated weights for policy 0, policy_version 436304 (0.0010) [2023-12-26 03:04:10,282][123090] Updated weights for policy 1, policy_version 433608 (0.0006) [2023-12-26 03:04:10,360][123090] Updated weights for policy 1, policy_version 433618 (0.0009) [2023-12-26 03:04:10,438][123090] Updated weights for policy 1, policy_version 433628 (0.0010) [2023-12-26 03:04:10,740][123091] Updated weights for policy 0, policy_version 436314 (0.0010) [2023-12-26 03:04:10,793][123091] Updated weights for policy 0, policy_version 436324 (0.0009) [2023-12-26 03:04:10,850][123091] Updated weights for policy 0, policy_version 436334 (0.0009) [2023-12-26 03:04:11,217][123090] Updated weights for policy 1, policy_version 433638 (0.0007) [2023-12-26 03:04:11,282][123090] Updated weights for policy 1, policy_version 433648 (0.0008) [2023-12-26 03:04:11,339][123090] Updated weights for policy 1, policy_version 433658 (0.0008) [2023-12-26 03:04:11,724][123091] Updated weights for policy 0, policy_version 436344 (0.0010) [2023-12-26 03:04:11,797][123091] Updated weights for policy 0, policy_version 436354 (0.0009) [2023-12-26 03:04:11,861][123091] Updated weights for policy 0, policy_version 436364 (0.0009) [2023-12-26 03:04:12,164][123090] Updated weights for policy 1, policy_version 433668 (0.0009) [2023-12-26 03:04:12,216][123090] Updated weights for policy 1, policy_version 433678 (0.0009) [2023-12-26 03:04:12,280][123090] Updated weights for policy 1, policy_version 433688 (0.0010) [2023-12-26 03:04:12,685][123091] Updated weights for policy 0, policy_version 436374 (0.0010) [2023-12-26 03:04:12,747][123091] Updated weights for policy 0, policy_version 436384 (0.0009) [2023-12-26 03:04:12,810][123091] Updated weights for policy 0, policy_version 436394 (0.0009) [2023-12-26 03:04:13,137][123090] Updated weights for policy 1, policy_version 433698 (0.0009) [2023-12-26 03:04:13,194][123090] Updated weights for policy 1, policy_version 433708 (0.0009) [2023-12-26 03:04:13,246][123090] Updated weights for policy 1, policy_version 433718 (0.0009) [2023-12-26 03:04:13,301][123090] Updated weights for policy 1, policy_version 433728 (0.0009) [2023-12-26 03:04:13,511][123091] Updated weights for policy 0, policy_version 436404 (0.0007) [2023-12-26 03:04:13,562][123091] Updated weights for policy 0, policy_version 436414 (0.0005) [2023-12-26 03:04:13,616][123091] Updated weights for policy 0, policy_version 436424 (0.0005) [2023-12-26 03:04:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 222765056. Throughput: 0: 8674.3, 1: 8722.2. Samples: 222756060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:13,785][121949] Avg episode reward: [(0, '6111.194'), (1, '5320.860')] [2023-12-26 03:04:14,207][123090] Updated weights for policy 1, policy_version 433738 (0.0010) [2023-12-26 03:04:14,263][123090] Updated weights for policy 1, policy_version 433748 (0.0009) [2023-12-26 03:04:14,304][123091] Updated weights for policy 0, policy_version 436434 (0.0006) [2023-12-26 03:04:14,312][123090] Updated weights for policy 1, policy_version 433758 (0.0009) [2023-12-26 03:04:14,364][123091] Updated weights for policy 0, policy_version 436444 (0.0009) [2023-12-26 03:04:14,426][123091] Updated weights for policy 0, policy_version 436454 (0.0008) [2023-12-26 03:04:14,487][123091] Updated weights for policy 0, policy_version 436464 (0.0009) [2023-12-26 03:04:15,204][123090] Updated weights for policy 1, policy_version 433768 (0.0009) [2023-12-26 03:04:15,273][123090] Updated weights for policy 1, policy_version 433778 (0.0010) [2023-12-26 03:04:15,317][123091] Updated weights for policy 0, policy_version 436474 (0.0005) [2023-12-26 03:04:15,349][123090] Updated weights for policy 1, policy_version 433788 (0.0010) [2023-12-26 03:04:15,373][123091] Updated weights for policy 0, policy_version 436484 (0.0005) [2023-12-26 03:04:15,421][123091] Updated weights for policy 0, policy_version 436494 (0.0005) [2023-12-26 03:04:16,074][123091] Updated weights for policy 0, policy_version 436504 (0.0009) [2023-12-26 03:04:16,122][123091] Updated weights for policy 0, policy_version 436514 (0.0010) [2023-12-26 03:04:16,131][123090] Updated weights for policy 1, policy_version 433798 (0.0006) [2023-12-26 03:04:16,185][123091] Updated weights for policy 0, policy_version 436524 (0.0010) [2023-12-26 03:04:16,201][123090] Updated weights for policy 1, policy_version 433808 (0.0005) [2023-12-26 03:04:16,263][123090] Updated weights for policy 1, policy_version 433818 (0.0006) [2023-12-26 03:04:16,936][123091] Updated weights for policy 0, policy_version 436534 (0.0009) [2023-12-26 03:04:16,994][123091] Updated weights for policy 0, policy_version 436544 (0.0006) [2023-12-26 03:04:17,046][123090] Updated weights for policy 1, policy_version 433828 (0.0011) [2023-12-26 03:04:17,059][123091] Updated weights for policy 0, policy_version 436554 (0.0007) [2023-12-26 03:04:17,095][123090] Updated weights for policy 1, policy_version 433838 (0.0010) [2023-12-26 03:04:17,147][123090] Updated weights for policy 1, policy_version 433848 (0.0010) [2023-12-26 03:04:17,715][123091] Updated weights for policy 0, policy_version 436564 (0.0007) [2023-12-26 03:04:17,768][123091] Updated weights for policy 0, policy_version 436574 (0.0009) [2023-12-26 03:04:17,818][123091] Updated weights for policy 0, policy_version 436584 (0.0009) [2023-12-26 03:04:18,013][123090] Updated weights for policy 1, policy_version 433858 (0.0010) [2023-12-26 03:04:18,075][123090] Updated weights for policy 1, policy_version 433868 (0.0010) [2023-12-26 03:04:18,130][123090] Updated weights for policy 1, policy_version 433878 (0.0010) [2023-12-26 03:04:18,199][123090] Updated weights for policy 1, policy_version 433888 (0.0010) [2023-12-26 03:04:18,645][123091] Updated weights for policy 0, policy_version 436595 (0.0009) [2023-12-26 03:04:18,718][123091] Updated weights for policy 0, policy_version 436605 (0.0009) [2023-12-26 03:04:18,775][123091] Updated weights for policy 0, policy_version 436615 (0.0009) [2023-12-26 03:04:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 222846976. Throughput: 0: 8757.4, 1: 8684.6. Samples: 222864428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:18,785][121949] Avg episode reward: [(0, '6177.444'), (1, '5117.237')] [2023-12-26 03:04:19,001][123090] Updated weights for policy 1, policy_version 433898 (0.0005) [2023-12-26 03:04:19,057][123090] Updated weights for policy 1, policy_version 433908 (0.0009) [2023-12-26 03:04:19,117][123090] Updated weights for policy 1, policy_version 433918 (0.0010) [2023-12-26 03:04:19,655][123091] Updated weights for policy 0, policy_version 436625 (0.0007) [2023-12-26 03:04:19,712][123091] Updated weights for policy 0, policy_version 436635 (0.0010) [2023-12-26 03:04:19,769][123091] Updated weights for policy 0, policy_version 436645 (0.0009) [2023-12-26 03:04:19,830][123091] Updated weights for policy 0, policy_version 436655 (0.0009) [2023-12-26 03:04:19,888][123090] Updated weights for policy 1, policy_version 433928 (0.0010) [2023-12-26 03:04:19,956][123090] Updated weights for policy 1, policy_version 433938 (0.0011) [2023-12-26 03:04:20,009][123090] Updated weights for policy 1, policy_version 433948 (0.0010) [2023-12-26 03:04:20,758][123090] Updated weights for policy 1, policy_version 433958 (0.0010) [2023-12-26 03:04:20,770][123091] Updated weights for policy 0, policy_version 436665 (0.0009) [2023-12-26 03:04:20,814][123090] Updated weights for policy 1, policy_version 433968 (0.0010) [2023-12-26 03:04:20,839][123091] Updated weights for policy 0, policy_version 436675 (0.0006) [2023-12-26 03:04:20,879][123090] Updated weights for policy 1, policy_version 433978 (0.0011) [2023-12-26 03:04:20,910][123091] Updated weights for policy 0, policy_version 436685 (0.0006) [2023-12-26 03:04:21,592][123091] Updated weights for policy 0, policy_version 436695 (0.0008) [2023-12-26 03:04:21,662][123091] Updated weights for policy 0, policy_version 436705 (0.0009) [2023-12-26 03:04:21,692][123090] Updated weights for policy 1, policy_version 433988 (0.0010) [2023-12-26 03:04:21,735][123091] Updated weights for policy 0, policy_version 436715 (0.0009) [2023-12-26 03:04:21,763][123090] Updated weights for policy 1, policy_version 433998 (0.0009) [2023-12-26 03:04:21,820][123090] Updated weights for policy 1, policy_version 434008 (0.0010) [2023-12-26 03:04:22,519][123091] Updated weights for policy 0, policy_version 436725 (0.0009) [2023-12-26 03:04:22,584][123091] Updated weights for policy 0, policy_version 436735 (0.0011) [2023-12-26 03:04:22,628][123090] Updated weights for policy 1, policy_version 434018 (0.0007) [2023-12-26 03:04:22,647][123091] Updated weights for policy 0, policy_version 436745 (0.0011) [2023-12-26 03:04:22,683][123090] Updated weights for policy 1, policy_version 434028 (0.0006) [2023-12-26 03:04:22,743][123090] Updated weights for policy 1, policy_version 434038 (0.0007) [2023-12-26 03:04:22,796][123090] Updated weights for policy 1, policy_version 434048 (0.0005) [2023-12-26 03:04:23,470][123091] Updated weights for policy 0, policy_version 436755 (0.0011) [2023-12-26 03:04:23,525][123091] Updated weights for policy 0, policy_version 436765 (0.0010) [2023-12-26 03:04:23,579][123091] Updated weights for policy 0, policy_version 436775 (0.0010) [2023-12-26 03:04:23,643][123090] Updated weights for policy 1, policy_version 434058 (0.0007) [2023-12-26 03:04:23,691][123090] Updated weights for policy 1, policy_version 434068 (0.0009) [2023-12-26 03:04:23,740][123090] Updated weights for policy 1, policy_version 434078 (0.0007) [2023-12-26 03:04:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 222945280. Throughput: 0: 8667.4, 1: 8741.3. Samples: 222916876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:23,785][121949] Avg episode reward: [(0, '6058.274'), (1, '5374.881')] [2023-12-26 03:04:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000434080_111124480.pth... [2023-12-26 03:04:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000436784_111820800.pth... [2023-12-26 03:04:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000433056_110862336.pth [2023-12-26 03:04:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000435760_111558656.pth [2023-12-26 03:04:24,377][123091] Updated weights for policy 0, policy_version 436785 (0.0010) [2023-12-26 03:04:24,433][123091] Updated weights for policy 0, policy_version 436795 (0.0011) [2023-12-26 03:04:24,484][123091] Updated weights for policy 0, policy_version 436805 (0.0011) [2023-12-26 03:04:24,543][123091] Updated weights for policy 0, policy_version 436815 (0.0011) [2023-12-26 03:04:24,563][123090] Updated weights for policy 1, policy_version 434088 (0.0007) [2023-12-26 03:04:24,631][123090] Updated weights for policy 1, policy_version 434098 (0.0009) [2023-12-26 03:04:24,698][123090] Updated weights for policy 1, policy_version 434108 (0.0009) [2023-12-26 03:04:25,386][123091] Updated weights for policy 0, policy_version 436825 (0.0010) [2023-12-26 03:04:25,449][123091] Updated weights for policy 0, policy_version 436835 (0.0010) [2023-12-26 03:04:25,465][123090] Updated weights for policy 1, policy_version 434118 (0.0007) [2023-12-26 03:04:25,503][123091] Updated weights for policy 0, policy_version 436845 (0.0010) [2023-12-26 03:04:25,510][123090] Updated weights for policy 1, policy_version 434128 (0.0008) [2023-12-26 03:04:25,557][123090] Updated weights for policy 1, policy_version 434138 (0.0008) [2023-12-26 03:04:26,322][123091] Updated weights for policy 0, policy_version 436855 (0.0010) [2023-12-26 03:04:26,395][123091] Updated weights for policy 0, policy_version 436865 (0.0010) [2023-12-26 03:04:26,412][123090] Updated weights for policy 1, policy_version 434148 (0.0008) [2023-12-26 03:04:26,461][123091] Updated weights for policy 0, policy_version 436875 (0.0008) [2023-12-26 03:04:26,475][123090] Updated weights for policy 1, policy_version 434158 (0.0005) [2023-12-26 03:04:26,532][123090] Updated weights for policy 1, policy_version 434168 (0.0008) [2023-12-26 03:04:27,253][123091] Updated weights for policy 0, policy_version 436885 (0.0007) [2023-12-26 03:04:27,323][123091] Updated weights for policy 0, policy_version 436895 (0.0006) [2023-12-26 03:04:27,323][123090] Updated weights for policy 1, policy_version 434178 (0.0009) [2023-12-26 03:04:27,372][123090] Updated weights for policy 1, policy_version 434188 (0.0007) [2023-12-26 03:04:27,382][123091] Updated weights for policy 0, policy_version 436905 (0.0008) [2023-12-26 03:04:27,444][123090] Updated weights for policy 1, policy_version 434198 (0.0005) [2023-12-26 03:04:27,508][123090] Updated weights for policy 1, policy_version 434208 (0.0005) [2023-12-26 03:04:28,022][123091] Updated weights for policy 0, policy_version 436915 (0.0006) [2023-12-26 03:04:28,080][123091] Updated weights for policy 0, policy_version 436925 (0.0005) [2023-12-26 03:04:28,137][123090] Updated weights for policy 1, policy_version 434218 (0.0007) [2023-12-26 03:04:28,147][123091] Updated weights for policy 0, policy_version 436935 (0.0006) [2023-12-26 03:04:28,190][123090] Updated weights for policy 1, policy_version 434228 (0.0009) [2023-12-26 03:04:28,243][123090] Updated weights for policy 1, policy_version 434238 (0.0009) [2023-12-26 03:04:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 223027200. Throughput: 0: 8644.7, 1: 8740.9. Samples: 223021624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:28,784][121949] Avg episode reward: [(0, '5837.659'), (1, '5373.915')] [2023-12-26 03:04:28,874][123091] Updated weights for policy 0, policy_version 436945 (0.0006) [2023-12-26 03:04:28,935][123091] Updated weights for policy 0, policy_version 436955 (0.0009) [2023-12-26 03:04:28,995][123091] Updated weights for policy 0, policy_version 436965 (0.0009) [2023-12-26 03:04:29,038][123090] Updated weights for policy 1, policy_version 434248 (0.0010) [2023-12-26 03:04:29,049][123091] Updated weights for policy 0, policy_version 436975 (0.0007) [2023-12-26 03:04:29,095][123090] Updated weights for policy 1, policy_version 434258 (0.0009) [2023-12-26 03:04:29,144][123090] Updated weights for policy 1, policy_version 434268 (0.0008) [2023-12-26 03:04:29,859][123091] Updated weights for policy 0, policy_version 436985 (0.0008) [2023-12-26 03:04:29,954][123091] Updated weights for policy 0, policy_version 436995 (0.0010) [2023-12-26 03:04:29,993][123090] Updated weights for policy 1, policy_version 434278 (0.0009) [2023-12-26 03:04:30,015][123091] Updated weights for policy 0, policy_version 437005 (0.0008) [2023-12-26 03:04:30,053][123090] Updated weights for policy 1, policy_version 434288 (0.0006) [2023-12-26 03:04:30,109][123090] Updated weights for policy 1, policy_version 434298 (0.0005) [2023-12-26 03:04:30,753][123091] Updated weights for policy 0, policy_version 437015 (0.0009) [2023-12-26 03:04:30,807][123091] Updated weights for policy 0, policy_version 437025 (0.0009) [2023-12-26 03:04:30,874][123091] Updated weights for policy 0, policy_version 437035 (0.0009) [2023-12-26 03:04:30,919][123090] Updated weights for policy 1, policy_version 434308 (0.0005) [2023-12-26 03:04:30,967][123090] Updated weights for policy 1, policy_version 434318 (0.0005) [2023-12-26 03:04:31,014][123090] Updated weights for policy 1, policy_version 434328 (0.0005) [2023-12-26 03:04:31,719][123091] Updated weights for policy 0, policy_version 437045 (0.0009) [2023-12-26 03:04:31,749][123090] Updated weights for policy 1, policy_version 434338 (0.0007) [2023-12-26 03:04:31,784][123091] Updated weights for policy 0, policy_version 437055 (0.0009) [2023-12-26 03:04:31,813][123090] Updated weights for policy 1, policy_version 434348 (0.0005) [2023-12-26 03:04:31,841][123091] Updated weights for policy 0, policy_version 437065 (0.0009) [2023-12-26 03:04:31,878][123090] Updated weights for policy 1, policy_version 434358 (0.0005) [2023-12-26 03:04:31,946][123090] Updated weights for policy 1, policy_version 434368 (0.0005) [2023-12-26 03:04:32,644][123091] Updated weights for policy 0, policy_version 437075 (0.0009) [2023-12-26 03:04:32,702][123091] Updated weights for policy 0, policy_version 437085 (0.0010) [2023-12-26 03:04:32,747][123090] Updated weights for policy 1, policy_version 434378 (0.0007) [2023-12-26 03:04:32,753][123091] Updated weights for policy 0, policy_version 437095 (0.0010) [2023-12-26 03:04:32,812][123090] Updated weights for policy 1, policy_version 434388 (0.0008) [2023-12-26 03:04:32,881][123090] Updated weights for policy 1, policy_version 434398 (0.0010) [2023-12-26 03:04:33,607][123091] Updated weights for policy 0, policy_version 437105 (0.0010) [2023-12-26 03:04:33,660][123091] Updated weights for policy 0, policy_version 437115 (0.0007) [2023-12-26 03:04:33,665][123090] Updated weights for policy 1, policy_version 434408 (0.0010) [2023-12-26 03:04:33,716][123091] Updated weights for policy 0, policy_version 437125 (0.0007) [2023-12-26 03:04:33,717][123090] Updated weights for policy 1, policy_version 434418 (0.0011) [2023-12-26 03:04:33,774][123091] Updated weights for policy 0, policy_version 437135 (0.0007) [2023-12-26 03:04:33,780][123090] Updated weights for policy 1, policy_version 434428 (0.0010) [2023-12-26 03:04:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 223117312. Throughput: 0: 8680.5, 1: 8760.4. Samples: 223130036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:33,784][121949] Avg episode reward: [(0, '5816.503'), (1, '5091.047')] [2023-12-26 03:04:34,563][123091] Updated weights for policy 0, policy_version 437145 (0.0007) [2023-12-26 03:04:34,587][123090] Updated weights for policy 1, policy_version 434438 (0.0009) [2023-12-26 03:04:34,629][123091] Updated weights for policy 0, policy_version 437155 (0.0009) [2023-12-26 03:04:34,646][123090] Updated weights for policy 1, policy_version 434448 (0.0009) [2023-12-26 03:04:34,690][123091] Updated weights for policy 0, policy_version 437165 (0.0009) [2023-12-26 03:04:34,709][123090] Updated weights for policy 1, policy_version 434458 (0.0010) [2023-12-26 03:04:35,468][123090] Updated weights for policy 1, policy_version 434468 (0.0008) [2023-12-26 03:04:35,494][123091] Updated weights for policy 0, policy_version 437175 (0.0008) [2023-12-26 03:04:35,525][123090] Updated weights for policy 1, policy_version 434478 (0.0005) [2023-12-26 03:04:35,564][123091] Updated weights for policy 0, policy_version 437185 (0.0005) [2023-12-26 03:04:35,596][123090] Updated weights for policy 1, policy_version 434488 (0.0005) [2023-12-26 03:04:35,626][123091] Updated weights for policy 0, policy_version 437195 (0.0005) [2023-12-26 03:04:36,242][123090] Updated weights for policy 1, policy_version 434498 (0.0006) [2023-12-26 03:04:36,301][123090] Updated weights for policy 1, policy_version 434508 (0.0008) [2023-12-26 03:04:36,322][123091] Updated weights for policy 0, policy_version 437205 (0.0005) [2023-12-26 03:04:36,362][123090] Updated weights for policy 1, policy_version 434518 (0.0010) [2023-12-26 03:04:36,382][123091] Updated weights for policy 0, policy_version 437215 (0.0006) [2023-12-26 03:04:36,414][123090] Updated weights for policy 1, policy_version 434528 (0.0010) [2023-12-26 03:04:36,443][123091] Updated weights for policy 0, policy_version 437225 (0.0006) [2023-12-26 03:04:37,234][123090] Updated weights for policy 1, policy_version 434538 (0.0009) [2023-12-26 03:04:37,278][123091] Updated weights for policy 0, policy_version 437235 (0.0008) [2023-12-26 03:04:37,300][123090] Updated weights for policy 1, policy_version 434548 (0.0005) [2023-12-26 03:04:37,326][123091] Updated weights for policy 0, policy_version 437245 (0.0009) [2023-12-26 03:04:37,358][123090] Updated weights for policy 1, policy_version 434558 (0.0005) [2023-12-26 03:04:37,375][123091] Updated weights for policy 0, policy_version 437255 (0.0009) [2023-12-26 03:04:37,995][123090] Updated weights for policy 1, policy_version 434568 (0.0006) [2023-12-26 03:04:38,051][123090] Updated weights for policy 1, policy_version 434578 (0.0010) [2023-12-26 03:04:38,102][123090] Updated weights for policy 1, policy_version 434588 (0.0009) [2023-12-26 03:04:38,310][123091] Updated weights for policy 0, policy_version 437265 (0.0010) [2023-12-26 03:04:38,382][123091] Updated weights for policy 0, policy_version 437275 (0.0010) [2023-12-26 03:04:38,450][123091] Updated weights for policy 0, policy_version 437285 (0.0008) [2023-12-26 03:04:38,508][123091] Updated weights for policy 0, policy_version 437295 (0.0010) [2023-12-26 03:04:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 223207424. Throughput: 0: 8701.4, 1: 8805.0. Samples: 223184136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:38,785][121949] Avg episode reward: [(0, '6083.874'), (1, '5322.634')] [2023-12-26 03:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000437296_111951872.pth... [2023-12-26 03:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000434592_111255552.pth... [2023-12-26 03:04:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000436272_111689728.pth [2023-12-26 03:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000433568_110993408.pth [2023-12-26 03:04:38,903][123090] Updated weights for policy 1, policy_version 434598 (0.0009) [2023-12-26 03:04:38,963][123090] Updated weights for policy 1, policy_version 434608 (0.0009) [2023-12-26 03:04:39,020][123090] Updated weights for policy 1, policy_version 434618 (0.0009) [2023-12-26 03:04:39,356][123091] Updated weights for policy 0, policy_version 437305 (0.0009) [2023-12-26 03:04:39,432][123091] Updated weights for policy 0, policy_version 437315 (0.0008) [2023-12-26 03:04:39,501][123091] Updated weights for policy 0, policy_version 437325 (0.0010) [2023-12-26 03:04:39,885][123090] Updated weights for policy 1, policy_version 434628 (0.0008) [2023-12-26 03:04:39,950][123090] Updated weights for policy 1, policy_version 434638 (0.0009) [2023-12-26 03:04:40,032][123090] Updated weights for policy 1, policy_version 434648 (0.0008) [2023-12-26 03:04:40,377][123091] Updated weights for policy 0, policy_version 437335 (0.0010) [2023-12-26 03:04:40,428][123091] Updated weights for policy 0, policy_version 437345 (0.0009) [2023-12-26 03:04:40,486][123091] Updated weights for policy 0, policy_version 437355 (0.0010) [2023-12-26 03:04:40,840][123090] Updated weights for policy 1, policy_version 434658 (0.0009) [2023-12-26 03:04:40,910][123090] Updated weights for policy 1, policy_version 434668 (0.0006) [2023-12-26 03:04:40,980][123090] Updated weights for policy 1, policy_version 434678 (0.0005) [2023-12-26 03:04:41,053][123090] Updated weights for policy 1, policy_version 434688 (0.0007) [2023-12-26 03:04:41,332][123091] Updated weights for policy 0, policy_version 437365 (0.0008) [2023-12-26 03:04:41,410][123091] Updated weights for policy 0, policy_version 437375 (0.0008) [2023-12-26 03:04:41,480][123091] Updated weights for policy 0, policy_version 437385 (0.0006) [2023-12-26 03:04:41,810][123090] Updated weights for policy 1, policy_version 434698 (0.0009) [2023-12-26 03:04:41,873][123090] Updated weights for policy 1, policy_version 434708 (0.0010) [2023-12-26 03:04:41,943][123090] Updated weights for policy 1, policy_version 434718 (0.0009) [2023-12-26 03:04:42,251][123091] Updated weights for policy 0, policy_version 437395 (0.0007) [2023-12-26 03:04:42,314][123091] Updated weights for policy 0, policy_version 437405 (0.0011) [2023-12-26 03:04:42,378][123091] Updated weights for policy 0, policy_version 437415 (0.0010) [2023-12-26 03:04:42,768][123090] Updated weights for policy 1, policy_version 434728 (0.0006) [2023-12-26 03:04:42,841][123090] Updated weights for policy 1, policy_version 434738 (0.0009) [2023-12-26 03:04:42,906][123090] Updated weights for policy 1, policy_version 434748 (0.0009) [2023-12-26 03:04:43,145][123091] Updated weights for policy 0, policy_version 437425 (0.0008) [2023-12-26 03:04:43,209][123091] Updated weights for policy 0, policy_version 437435 (0.0009) [2023-12-26 03:04:43,266][123091] Updated weights for policy 0, policy_version 437445 (0.0009) [2023-12-26 03:04:43,326][123091] Updated weights for policy 0, policy_version 437455 (0.0010) [2023-12-26 03:04:43,702][123090] Updated weights for policy 1, policy_version 434758 (0.0010) [2023-12-26 03:04:43,758][123090] Updated weights for policy 1, policy_version 434768 (0.0009) [2023-12-26 03:04:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 223289344. Throughput: 0: 8701.8, 1: 8770.8. Samples: 223287452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:43,785][121949] Avg episode reward: [(0, '6110.428'), (1, '5474.240')] [2023-12-26 03:04:43,815][123090] Updated weights for policy 1, policy_version 434778 (0.0010) [2023-12-26 03:04:44,117][123091] Updated weights for policy 0, policy_version 437465 (0.0012) [2023-12-26 03:04:44,184][123091] Updated weights for policy 0, policy_version 437475 (0.0011) [2023-12-26 03:04:44,256][123091] Updated weights for policy 0, policy_version 437485 (0.0010) [2023-12-26 03:04:44,624][123090] Updated weights for policy 1, policy_version 434788 (0.0009) [2023-12-26 03:04:44,673][123090] Updated weights for policy 1, policy_version 434798 (0.0009) [2023-12-26 03:04:44,733][123090] Updated weights for policy 1, policy_version 434808 (0.0009) [2023-12-26 03:04:45,076][123091] Updated weights for policy 0, policy_version 437495 (0.0011) [2023-12-26 03:04:45,128][123091] Updated weights for policy 0, policy_version 437505 (0.0011) [2023-12-26 03:04:45,176][123091] Updated weights for policy 0, policy_version 437515 (0.0010) [2023-12-26 03:04:45,578][123090] Updated weights for policy 1, policy_version 434818 (0.0009) [2023-12-26 03:04:45,641][123090] Updated weights for policy 1, policy_version 434828 (0.0009) [2023-12-26 03:04:45,703][123090] Updated weights for policy 1, policy_version 434838 (0.0009) [2023-12-26 03:04:45,767][123090] Updated weights for policy 1, policy_version 434848 (0.0009) [2023-12-26 03:04:46,032][123091] Updated weights for policy 0, policy_version 437525 (0.0010) [2023-12-26 03:04:46,101][123091] Updated weights for policy 0, policy_version 437535 (0.0010) [2023-12-26 03:04:46,156][123091] Updated weights for policy 0, policy_version 437545 (0.0010) [2023-12-26 03:04:46,598][123090] Updated weights for policy 1, policy_version 434858 (0.0009) [2023-12-26 03:04:46,655][123090] Updated weights for policy 1, policy_version 434868 (0.0009) [2023-12-26 03:04:46,715][123090] Updated weights for policy 1, policy_version 434878 (0.0009) [2023-12-26 03:04:46,913][123091] Updated weights for policy 0, policy_version 437555 (0.0010) [2023-12-26 03:04:46,970][123091] Updated weights for policy 0, policy_version 437565 (0.0010) [2023-12-26 03:04:47,024][123091] Updated weights for policy 0, policy_version 437575 (0.0010) [2023-12-26 03:04:47,495][123090] Updated weights for policy 1, policy_version 434888 (0.0009) [2023-12-26 03:04:47,554][123090] Updated weights for policy 1, policy_version 434899 (0.0010) [2023-12-26 03:04:47,607][123090] Updated weights for policy 1, policy_version 434909 (0.0009) [2023-12-26 03:04:47,760][123091] Updated weights for policy 0, policy_version 437585 (0.0010) [2023-12-26 03:04:47,814][123091] Updated weights for policy 0, policy_version 437595 (0.0010) [2023-12-26 03:04:47,867][123091] Updated weights for policy 0, policy_version 437605 (0.0009) [2023-12-26 03:04:47,917][123091] Updated weights for policy 0, policy_version 437615 (0.0005) [2023-12-26 03:04:48,471][123090] Updated weights for policy 1, policy_version 434919 (0.0010) [2023-12-26 03:04:48,535][123090] Updated weights for policy 1, policy_version 434929 (0.0009) [2023-12-26 03:04:48,601][123090] Updated weights for policy 1, policy_version 434939 (0.0008) [2023-12-26 03:04:48,744][123091] Updated weights for policy 0, policy_version 437625 (0.0009) [2023-12-26 03:04:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 223379456. Throughput: 0: 8798.5, 1: 8765.5. Samples: 223392148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:48,785][121949] Avg episode reward: [(0, '6044.223'), (1, '5651.310')] [2023-12-26 03:04:48,800][123091] Updated weights for policy 0, policy_version 437635 (0.0010) [2023-12-26 03:04:48,860][123091] Updated weights for policy 0, policy_version 437645 (0.0010) [2023-12-26 03:04:49,452][123090] Updated weights for policy 1, policy_version 434949 (0.0010) [2023-12-26 03:04:49,522][123090] Updated weights for policy 1, policy_version 434959 (0.0009) [2023-12-26 03:04:49,592][123090] Updated weights for policy 1, policy_version 434969 (0.0009) [2023-12-26 03:04:49,734][123091] Updated weights for policy 0, policy_version 437655 (0.0009) [2023-12-26 03:04:49,795][123091] Updated weights for policy 0, policy_version 437665 (0.0009) [2023-12-26 03:04:49,858][123091] Updated weights for policy 0, policy_version 437675 (0.0010) [2023-12-26 03:04:50,435][123090] Updated weights for policy 1, policy_version 434979 (0.0010) [2023-12-26 03:04:50,494][123090] Updated weights for policy 1, policy_version 434989 (0.0009) [2023-12-26 03:04:50,554][123090] Updated weights for policy 1, policy_version 434999 (0.0009) [2023-12-26 03:04:50,649][123091] Updated weights for policy 0, policy_version 437685 (0.0009) [2023-12-26 03:04:50,716][123091] Updated weights for policy 0, policy_version 437695 (0.0009) [2023-12-26 03:04:50,788][123091] Updated weights for policy 0, policy_version 437705 (0.0006) [2023-12-26 03:04:51,463][123090] Updated weights for policy 1, policy_version 435009 (0.0009) [2023-12-26 03:04:51,495][123091] Updated weights for policy 0, policy_version 437715 (0.0007) [2023-12-26 03:04:51,528][123090] Updated weights for policy 1, policy_version 435019 (0.0008) [2023-12-26 03:04:51,547][123091] Updated weights for policy 0, policy_version 437725 (0.0008) [2023-12-26 03:04:51,593][123090] Updated weights for policy 1, policy_version 435029 (0.0006) [2023-12-26 03:04:51,595][123091] Updated weights for policy 0, policy_version 437735 (0.0008) [2023-12-26 03:04:51,663][123090] Updated weights for policy 1, policy_version 435039 (0.0007) [2023-12-26 03:04:52,449][123091] Updated weights for policy 0, policy_version 437745 (0.0008) [2023-12-26 03:04:52,498][123091] Updated weights for policy 0, policy_version 437755 (0.0009) [2023-12-26 03:04:52,522][123090] Updated weights for policy 1, policy_version 435049 (0.0008) [2023-12-26 03:04:52,549][123091] Updated weights for policy 0, policy_version 437765 (0.0009) [2023-12-26 03:04:52,590][123090] Updated weights for policy 1, policy_version 435059 (0.0007) [2023-12-26 03:04:52,600][123091] Updated weights for policy 0, policy_version 437775 (0.0009) [2023-12-26 03:04:52,652][123090] Updated weights for policy 1, policy_version 435069 (0.0009) [2023-12-26 03:04:53,310][123090] Updated weights for policy 1, policy_version 435079 (0.0006) [2023-12-26 03:04:53,379][123090] Updated weights for policy 1, policy_version 435089 (0.0009) [2023-12-26 03:04:53,428][123090] Updated weights for policy 1, policy_version 435099 (0.0006) [2023-12-26 03:04:53,499][123091] Updated weights for policy 0, policy_version 437785 (0.0010) [2023-12-26 03:04:53,551][123091] Updated weights for policy 0, policy_version 437795 (0.0009) [2023-12-26 03:04:53,607][123091] Updated weights for policy 0, policy_version 437805 (0.0009) [2023-12-26 03:04:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 223469568. Throughput: 0: 8782.7, 1: 8737.1. Samples: 223443228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:53,785][121949] Avg episode reward: [(0, '6029.643'), (1, '5582.910')] [2023-12-26 03:04:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000437808_112082944.pth... [2023-12-26 03:04:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000435104_111386624.pth... [2023-12-26 03:04:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000434080_111124480.pth [2023-12-26 03:04:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000436784_111820800.pth [2023-12-26 03:04:54,233][123090] Updated weights for policy 1, policy_version 435109 (0.0009) [2023-12-26 03:04:54,301][123090] Updated weights for policy 1, policy_version 435119 (0.0009) [2023-12-26 03:04:54,332][123091] Updated weights for policy 0, policy_version 437815 (0.0007) [2023-12-26 03:04:54,370][123090] Updated weights for policy 1, policy_version 435129 (0.0009) [2023-12-26 03:04:54,391][123091] Updated weights for policy 0, policy_version 437825 (0.0007) [2023-12-26 03:04:54,442][123091] Updated weights for policy 0, policy_version 437835 (0.0010) [2023-12-26 03:04:55,150][123091] Updated weights for policy 0, policy_version 437845 (0.0010) [2023-12-26 03:04:55,209][123091] Updated weights for policy 0, policy_version 437856 (0.0010) [2023-12-26 03:04:55,234][123090] Updated weights for policy 1, policy_version 435139 (0.0009) [2023-12-26 03:04:55,266][123091] Updated weights for policy 0, policy_version 437866 (0.0007) [2023-12-26 03:04:55,299][123090] Updated weights for policy 1, policy_version 435149 (0.0009) [2023-12-26 03:04:55,354][123090] Updated weights for policy 1, policy_version 435159 (0.0009) [2023-12-26 03:04:56,106][123091] Updated weights for policy 0, policy_version 437876 (0.0009) [2023-12-26 03:04:56,154][123091] Updated weights for policy 0, policy_version 437886 (0.0009) [2023-12-26 03:04:56,170][123090] Updated weights for policy 1, policy_version 435169 (0.0009) [2023-12-26 03:04:56,221][123091] Updated weights for policy 0, policy_version 437896 (0.0008) [2023-12-26 03:04:56,227][123090] Updated weights for policy 1, policy_version 435179 (0.0009) [2023-12-26 03:04:56,292][123090] Updated weights for policy 1, policy_version 435189 (0.0009) [2023-12-26 03:04:56,360][123090] Updated weights for policy 1, policy_version 435199 (0.0009) [2023-12-26 03:04:57,029][123091] Updated weights for policy 0, policy_version 437906 (0.0008) [2023-12-26 03:04:57,088][123091] Updated weights for policy 0, policy_version 437916 (0.0009) [2023-12-26 03:04:57,140][123091] Updated weights for policy 0, policy_version 437926 (0.0009) [2023-12-26 03:04:57,171][123090] Updated weights for policy 1, policy_version 435209 (0.0008) [2023-12-26 03:04:57,195][123091] Updated weights for policy 0, policy_version 437936 (0.0007) [2023-12-26 03:04:57,235][123090] Updated weights for policy 1, policy_version 435219 (0.0009) [2023-12-26 03:04:57,305][123090] Updated weights for policy 1, policy_version 435229 (0.0008) [2023-12-26 03:04:58,007][123090] Updated weights for policy 1, policy_version 435239 (0.0007) [2023-12-26 03:04:58,071][123091] Updated weights for policy 0, policy_version 437946 (0.0008) [2023-12-26 03:04:58,073][123090] Updated weights for policy 1, policy_version 435249 (0.0008) [2023-12-26 03:04:58,131][123090] Updated weights for policy 1, policy_version 435259 (0.0008) [2023-12-26 03:04:58,132][123091] Updated weights for policy 0, policy_version 437956 (0.0008) [2023-12-26 03:04:58,186][123091] Updated weights for policy 0, policy_version 437966 (0.0009) [2023-12-26 03:04:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 223551488. Throughput: 0: 8865.5, 1: 8749.7. Samples: 223548744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:04:58,785][121949] Avg episode reward: [(0, '6101.271'), (1, '5565.064')] [2023-12-26 03:04:58,941][123090] Updated weights for policy 1, policy_version 435269 (0.0008) [2023-12-26 03:04:58,988][123090] Updated weights for policy 1, policy_version 435279 (0.0009) [2023-12-26 03:04:59,045][123090] Updated weights for policy 1, policy_version 435289 (0.0008) [2023-12-26 03:04:59,047][123091] Updated weights for policy 0, policy_version 437976 (0.0008) [2023-12-26 03:04:59,095][123091] Updated weights for policy 0, policy_version 437986 (0.0008) [2023-12-26 03:04:59,158][123091] Updated weights for policy 0, policy_version 437996 (0.0010) [2023-12-26 03:04:59,897][123091] Updated weights for policy 0, policy_version 438006 (0.0007) [2023-12-26 03:04:59,956][123090] Updated weights for policy 1, policy_version 435299 (0.0009) [2023-12-26 03:04:59,963][123091] Updated weights for policy 0, policy_version 438016 (0.0008) [2023-12-26 03:05:00,021][123090] Updated weights for policy 1, policy_version 435309 (0.0008) [2023-12-26 03:05:00,028][123091] Updated weights for policy 0, policy_version 438026 (0.0007) [2023-12-26 03:05:00,088][123090] Updated weights for policy 1, policy_version 435319 (0.0009) [2023-12-26 03:05:00,833][123091] Updated weights for policy 0, policy_version 438036 (0.0009) [2023-12-26 03:05:00,898][123091] Updated weights for policy 0, policy_version 438046 (0.0010) [2023-12-26 03:05:00,911][123090] Updated weights for policy 1, policy_version 435329 (0.0009) [2023-12-26 03:05:00,960][123091] Updated weights for policy 0, policy_version 438056 (0.0010) [2023-12-26 03:05:00,963][123090] Updated weights for policy 1, policy_version 435339 (0.0007) [2023-12-26 03:05:01,026][123090] Updated weights for policy 1, policy_version 435349 (0.0007) [2023-12-26 03:05:01,087][123090] Updated weights for policy 1, policy_version 435359 (0.0008) [2023-12-26 03:05:01,774][123091] Updated weights for policy 0, policy_version 438066 (0.0011) [2023-12-26 03:05:01,826][123091] Updated weights for policy 0, policy_version 438076 (0.0010) [2023-12-26 03:05:01,878][123091] Updated weights for policy 0, policy_version 438086 (0.0011) [2023-12-26 03:05:01,934][123091] Updated weights for policy 0, policy_version 438096 (0.0010) [2023-12-26 03:05:01,954][123090] Updated weights for policy 1, policy_version 435369 (0.0007) [2023-12-26 03:05:02,007][123090] Updated weights for policy 1, policy_version 435379 (0.0009) [2023-12-26 03:05:02,062][123090] Updated weights for policy 1, policy_version 435389 (0.0009) [2023-12-26 03:05:02,780][123091] Updated weights for policy 0, policy_version 438106 (0.0009) [2023-12-26 03:05:02,839][123091] Updated weights for policy 0, policy_version 438116 (0.0010) [2023-12-26 03:05:02,894][123090] Updated weights for policy 1, policy_version 435399 (0.0007) [2023-12-26 03:05:02,898][123091] Updated weights for policy 0, policy_version 438126 (0.0010) [2023-12-26 03:05:02,948][123090] Updated weights for policy 1, policy_version 435409 (0.0009) [2023-12-26 03:05:03,005][123090] Updated weights for policy 1, policy_version 435419 (0.0008) [2023-12-26 03:05:03,735][123090] Updated weights for policy 1, policy_version 435429 (0.0009) [2023-12-26 03:05:03,737][123091] Updated weights for policy 0, policy_version 438136 (0.0009) [2023-12-26 03:05:03,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 223633408. Throughput: 0: 8727.1, 1: 8748.5. Samples: 223650836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:03,786][121949] Avg episode reward: [(0, '6196.018'), (1, '5679.826')] [2023-12-26 03:05:03,794][123090] Updated weights for policy 1, policy_version 435439 (0.0008) [2023-12-26 03:05:03,798][123091] Updated weights for policy 0, policy_version 438146 (0.0006) [2023-12-26 03:05:03,859][123091] Updated weights for policy 0, policy_version 438156 (0.0007) [2023-12-26 03:05:03,871][123090] Updated weights for policy 1, policy_version 435449 (0.0008) [2023-12-26 03:05:04,647][123091] Updated weights for policy 0, policy_version 438166 (0.0008) [2023-12-26 03:05:04,712][123091] Updated weights for policy 0, policy_version 438176 (0.0010) [2023-12-26 03:05:04,745][123090] Updated weights for policy 1, policy_version 435459 (0.0009) [2023-12-26 03:05:04,768][123091] Updated weights for policy 0, policy_version 438186 (0.0006) [2023-12-26 03:05:04,804][123090] Updated weights for policy 1, policy_version 435469 (0.0009) [2023-12-26 03:05:04,875][123090] Updated weights for policy 1, policy_version 435479 (0.0010) [2023-12-26 03:05:05,586][123091] Updated weights for policy 0, policy_version 438196 (0.0007) [2023-12-26 03:05:05,639][123091] Updated weights for policy 0, policy_version 438206 (0.0009) [2023-12-26 03:05:05,675][123090] Updated weights for policy 1, policy_version 435489 (0.0009) [2023-12-26 03:05:05,703][123091] Updated weights for policy 0, policy_version 438216 (0.0008) [2023-12-26 03:05:05,728][123090] Updated weights for policy 1, policy_version 435499 (0.0008) [2023-12-26 03:05:05,783][123090] Updated weights for policy 1, policy_version 435509 (0.0009) [2023-12-26 03:05:05,833][123090] Updated weights for policy 1, policy_version 435519 (0.0009) [2023-12-26 03:05:06,503][123091] Updated weights for policy 0, policy_version 438226 (0.0009) [2023-12-26 03:05:06,559][123091] Updated weights for policy 0, policy_version 438236 (0.0011) [2023-12-26 03:05:06,618][123091] Updated weights for policy 0, policy_version 438246 (0.0009) [2023-12-26 03:05:06,688][123091] Updated weights for policy 0, policy_version 438256 (0.0008) [2023-12-26 03:05:06,773][123090] Updated weights for policy 1, policy_version 435529 (0.0010) [2023-12-26 03:05:06,843][123090] Updated weights for policy 1, policy_version 435539 (0.0009) [2023-12-26 03:05:06,911][123090] Updated weights for policy 1, policy_version 435549 (0.0010) [2023-12-26 03:05:07,428][123091] Updated weights for policy 0, policy_version 438266 (0.0009) [2023-12-26 03:05:07,485][123091] Updated weights for policy 0, policy_version 438276 (0.0009) [2023-12-26 03:05:07,545][123091] Updated weights for policy 0, policy_version 438286 (0.0009) [2023-12-26 03:05:07,721][123090] Updated weights for policy 1, policy_version 435559 (0.0009) [2023-12-26 03:05:07,783][123090] Updated weights for policy 1, policy_version 435569 (0.0007) [2023-12-26 03:05:07,838][123090] Updated weights for policy 1, policy_version 435579 (0.0010) [2023-12-26 03:05:08,264][123091] Updated weights for policy 0, policy_version 438296 (0.0010) [2023-12-26 03:05:08,323][123091] Updated weights for policy 0, policy_version 438306 (0.0009) [2023-12-26 03:05:08,390][123091] Updated weights for policy 0, policy_version 438316 (0.0010) [2023-12-26 03:05:08,717][123090] Updated weights for policy 1, policy_version 435589 (0.0010) [2023-12-26 03:05:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 223723520. Throughput: 0: 8750.7, 1: 8705.2. Samples: 223702392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:08,785][121949] Avg episode reward: [(0, '6116.708'), (1, '5631.794')] [2023-12-26 03:05:08,787][123090] Updated weights for policy 1, policy_version 435599 (0.0009) [2023-12-26 03:05:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000438320_112214016.pth... [2023-12-26 03:05:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000437296_111951872.pth [2023-12-26 03:05:08,849][123090] Updated weights for policy 1, policy_version 435609 (0.0009) [2023-12-26 03:05:08,895][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000435616_111517696.pth... [2023-12-26 03:05:08,898][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000434592_111255552.pth [2023-12-26 03:05:09,163][123091] Updated weights for policy 0, policy_version 438326 (0.0006) [2023-12-26 03:05:09,235][123091] Updated weights for policy 0, policy_version 438336 (0.0007) [2023-12-26 03:05:09,301][123091] Updated weights for policy 0, policy_version 438346 (0.0008) [2023-12-26 03:05:09,780][123090] Updated weights for policy 1, policy_version 435619 (0.0010) [2023-12-26 03:05:09,849][123090] Updated weights for policy 1, policy_version 435630 (0.0009) [2023-12-26 03:05:09,924][123090] Updated weights for policy 1, policy_version 435640 (0.0006) [2023-12-26 03:05:10,053][123091] Updated weights for policy 0, policy_version 438356 (0.0007) [2023-12-26 03:05:10,103][123091] Updated weights for policy 0, policy_version 438366 (0.0006) [2023-12-26 03:05:10,175][123091] Updated weights for policy 0, policy_version 438376 (0.0006) [2023-12-26 03:05:10,638][123090] Updated weights for policy 1, policy_version 435650 (0.0006) [2023-12-26 03:05:10,691][123090] Updated weights for policy 1, policy_version 435660 (0.0006) [2023-12-26 03:05:10,761][123090] Updated weights for policy 1, policy_version 435670 (0.0008) [2023-12-26 03:05:10,828][123090] Updated weights for policy 1, policy_version 435680 (0.0006) [2023-12-26 03:05:10,913][123091] Updated weights for policy 0, policy_version 438386 (0.0006) [2023-12-26 03:05:10,977][123091] Updated weights for policy 0, policy_version 438396 (0.0006) [2023-12-26 03:05:11,051][123091] Updated weights for policy 0, policy_version 438406 (0.0009) [2023-12-26 03:05:11,123][123091] Updated weights for policy 0, policy_version 438416 (0.0010) [2023-12-26 03:05:11,621][123090] Updated weights for policy 1, policy_version 435690 (0.0009) [2023-12-26 03:05:11,686][123090] Updated weights for policy 1, policy_version 435700 (0.0008) [2023-12-26 03:05:11,755][123090] Updated weights for policy 1, policy_version 435710 (0.0009) [2023-12-26 03:05:11,973][123091] Updated weights for policy 0, policy_version 438426 (0.0011) [2023-12-26 03:05:12,036][123091] Updated weights for policy 0, policy_version 438436 (0.0011) [2023-12-26 03:05:12,099][123091] Updated weights for policy 0, policy_version 438446 (0.0011) [2023-12-26 03:05:12,586][123090] Updated weights for policy 1, policy_version 435720 (0.0009) [2023-12-26 03:05:12,639][123090] Updated weights for policy 1, policy_version 435730 (0.0009) [2023-12-26 03:05:12,688][123090] Updated weights for policy 1, policy_version 435740 (0.0009) [2023-12-26 03:05:12,928][123091] Updated weights for policy 0, policy_version 438456 (0.0011) [2023-12-26 03:05:12,980][123091] Updated weights for policy 0, policy_version 438466 (0.0008) [2023-12-26 03:05:13,037][123091] Updated weights for policy 0, policy_version 438476 (0.0005) [2023-12-26 03:05:13,602][123090] Updated weights for policy 1, policy_version 435750 (0.0009) [2023-12-26 03:05:13,650][123090] Updated weights for policy 1, policy_version 435760 (0.0009) [2023-12-26 03:05:13,698][123090] Updated weights for policy 1, policy_version 435770 (0.0009) [2023-12-26 03:05:13,710][123091] Updated weights for policy 0, policy_version 438486 (0.0007) [2023-12-26 03:05:13,769][123091] Updated weights for policy 0, policy_version 438496 (0.0008) [2023-12-26 03:05:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 223813632. Throughput: 0: 8784.7, 1: 8667.6. Samples: 223806980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:13,785][121949] Avg episode reward: [(0, '5979.579'), (1, '5674.576')] [2023-12-26 03:05:13,835][123091] Updated weights for policy 0, policy_version 438506 (0.0009) [2023-12-26 03:05:14,564][123090] Updated weights for policy 1, policy_version 435780 (0.0010) [2023-12-26 03:05:14,622][123090] Updated weights for policy 1, policy_version 435790 (0.0009) [2023-12-26 03:05:14,671][123090] Updated weights for policy 1, policy_version 435800 (0.0009) [2023-12-26 03:05:14,683][123091] Updated weights for policy 0, policy_version 438516 (0.0009) [2023-12-26 03:05:14,748][123091] Updated weights for policy 0, policy_version 438526 (0.0009) [2023-12-26 03:05:14,813][123091] Updated weights for policy 0, policy_version 438536 (0.0009) [2023-12-26 03:05:15,544][123090] Updated weights for policy 1, policy_version 435810 (0.0007) [2023-12-26 03:05:15,607][123090] Updated weights for policy 1, policy_version 435820 (0.0009) [2023-12-26 03:05:15,636][123091] Updated weights for policy 0, policy_version 438546 (0.0009) [2023-12-26 03:05:15,673][123090] Updated weights for policy 1, policy_version 435830 (0.0009) [2023-12-26 03:05:15,684][123091] Updated weights for policy 0, policy_version 438556 (0.0008) [2023-12-26 03:05:15,731][123091] Updated weights for policy 0, policy_version 438566 (0.0009) [2023-12-26 03:05:15,731][123090] Updated weights for policy 1, policy_version 435840 (0.0008) [2023-12-26 03:05:15,784][123091] Updated weights for policy 0, policy_version 438576 (0.0010) [2023-12-26 03:05:16,553][123090] Updated weights for policy 1, policy_version 435850 (0.0009) [2023-12-26 03:05:16,603][123090] Updated weights for policy 1, policy_version 435860 (0.0009) [2023-12-26 03:05:16,632][123091] Updated weights for policy 0, policy_version 438586 (0.0007) [2023-12-26 03:05:16,666][123090] Updated weights for policy 1, policy_version 435870 (0.0008) [2023-12-26 03:05:16,690][123091] Updated weights for policy 0, policy_version 438596 (0.0008) [2023-12-26 03:05:16,749][123091] Updated weights for policy 0, policy_version 438606 (0.0010) [2023-12-26 03:05:17,500][123090] Updated weights for policy 1, policy_version 435880 (0.0010) [2023-12-26 03:05:17,548][123090] Updated weights for policy 1, policy_version 435890 (0.0010) [2023-12-26 03:05:17,575][123091] Updated weights for policy 0, policy_version 438616 (0.0009) [2023-12-26 03:05:17,604][123090] Updated weights for policy 1, policy_version 435900 (0.0007) [2023-12-26 03:05:17,627][123091] Updated weights for policy 0, policy_version 438626 (0.0009) [2023-12-26 03:05:17,674][123091] Updated weights for policy 0, policy_version 438636 (0.0009) [2023-12-26 03:05:18,398][123090] Updated weights for policy 1, policy_version 435910 (0.0009) [2023-12-26 03:05:18,464][123090] Updated weights for policy 1, policy_version 435920 (0.0008) [2023-12-26 03:05:18,530][123090] Updated weights for policy 1, policy_version 435930 (0.0008) [2023-12-26 03:05:18,539][123091] Updated weights for policy 0, policy_version 438647 (0.0009) [2023-12-26 03:05:18,595][123091] Updated weights for policy 0, policy_version 438657 (0.0008) [2023-12-26 03:05:18,654][123091] Updated weights for policy 0, policy_version 438667 (0.0009) [2023-12-26 03:05:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 223903744. Throughput: 0: 8767.6, 1: 8571.1. Samples: 223910280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:18,785][121949] Avg episode reward: [(0, '5953.281'), (1, '5566.594')] [2023-12-26 03:05:19,322][123091] Updated weights for policy 0, policy_version 438677 (0.0008) [2023-12-26 03:05:19,351][123090] Updated weights for policy 1, policy_version 435940 (0.0007) [2023-12-26 03:05:19,391][123091] Updated weights for policy 0, policy_version 438687 (0.0009) [2023-12-26 03:05:19,423][123090] Updated weights for policy 1, policy_version 435950 (0.0008) [2023-12-26 03:05:19,454][123091] Updated weights for policy 0, policy_version 438697 (0.0011) [2023-12-26 03:05:19,495][123090] Updated weights for policy 1, policy_version 435960 (0.0008) [2023-12-26 03:05:20,259][123090] Updated weights for policy 1, policy_version 435970 (0.0007) [2023-12-26 03:05:20,279][123091] Updated weights for policy 0, policy_version 438707 (0.0010) [2023-12-26 03:05:20,324][123090] Updated weights for policy 1, policy_version 435980 (0.0005) [2023-12-26 03:05:20,338][123091] Updated weights for policy 0, policy_version 438717 (0.0010) [2023-12-26 03:05:20,384][123090] Updated weights for policy 1, policy_version 435990 (0.0007) [2023-12-26 03:05:20,397][123091] Updated weights for policy 0, policy_version 438727 (0.0011) [2023-12-26 03:05:20,449][123090] Updated weights for policy 1, policy_version 436000 (0.0006) [2023-12-26 03:05:21,259][123091] Updated weights for policy 0, policy_version 438737 (0.0010) [2023-12-26 03:05:21,269][123090] Updated weights for policy 1, policy_version 436010 (0.0009) [2023-12-26 03:05:21,331][123091] Updated weights for policy 0, policy_version 438747 (0.0011) [2023-12-26 03:05:21,333][123090] Updated weights for policy 1, policy_version 436020 (0.0008) [2023-12-26 03:05:21,399][123091] Updated weights for policy 0, policy_version 438757 (0.0010) [2023-12-26 03:05:21,401][123090] Updated weights for policy 1, policy_version 436030 (0.0009) [2023-12-26 03:05:21,451][123091] Updated weights for policy 0, policy_version 438767 (0.0006) [2023-12-26 03:05:22,254][123091] Updated weights for policy 0, policy_version 438777 (0.0009) [2023-12-26 03:05:22,309][123090] Updated weights for policy 1, policy_version 436040 (0.0007) [2023-12-26 03:05:22,323][123091] Updated weights for policy 0, policy_version 438787 (0.0006) [2023-12-26 03:05:22,380][123090] Updated weights for policy 1, policy_version 436050 (0.0008) [2023-12-26 03:05:22,396][123091] Updated weights for policy 0, policy_version 438797 (0.0007) [2023-12-26 03:05:22,446][123090] Updated weights for policy 1, policy_version 436060 (0.0009) [2023-12-26 03:05:23,098][123090] Updated weights for policy 1, policy_version 436070 (0.0007) [2023-12-26 03:05:23,104][123091] Updated weights for policy 0, policy_version 438807 (0.0006) [2023-12-26 03:05:23,160][123091] Updated weights for policy 0, policy_version 438817 (0.0005) [2023-12-26 03:05:23,162][123090] Updated weights for policy 1, policy_version 436080 (0.0009) [2023-12-26 03:05:23,211][123090] Updated weights for policy 1, policy_version 436090 (0.0009) [2023-12-26 03:05:23,223][123091] Updated weights for policy 0, policy_version 438827 (0.0006) [2023-12-26 03:05:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 223985664. Throughput: 0: 8749.1, 1: 8534.4. Samples: 223961892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:23,785][121949] Avg episode reward: [(0, '6066.725'), (1, '5587.480')] [2023-12-26 03:05:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000436096_111640576.pth... [2023-12-26 03:05:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000438832_112345088.pth... [2023-12-26 03:05:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000435104_111386624.pth [2023-12-26 03:05:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000437808_112082944.pth [2023-12-26 03:05:23,880][123091] Updated weights for policy 0, policy_version 438837 (0.0006) [2023-12-26 03:05:23,933][123091] Updated weights for policy 0, policy_version 438847 (0.0005) [2023-12-26 03:05:23,999][123091] Updated weights for policy 0, policy_version 438857 (0.0005) [2023-12-26 03:05:24,067][123090] Updated weights for policy 1, policy_version 436100 (0.0008) [2023-12-26 03:05:24,127][123090] Updated weights for policy 1, policy_version 436111 (0.0011) [2023-12-26 03:05:24,180][123090] Updated weights for policy 1, policy_version 436121 (0.0009) [2023-12-26 03:05:24,649][123091] Updated weights for policy 0, policy_version 438867 (0.0005) [2023-12-26 03:05:24,705][123091] Updated weights for policy 0, policy_version 438877 (0.0005) [2023-12-26 03:05:24,777][123091] Updated weights for policy 0, policy_version 438887 (0.0005) [2023-12-26 03:05:25,132][123090] Updated weights for policy 1, policy_version 436131 (0.0010) [2023-12-26 03:05:25,191][123090] Updated weights for policy 1, policy_version 436141 (0.0010) [2023-12-26 03:05:25,245][123090] Updated weights for policy 1, policy_version 436151 (0.0010) [2023-12-26 03:05:25,381][123091] Updated weights for policy 0, policy_version 438897 (0.0005) [2023-12-26 03:05:25,445][123091] Updated weights for policy 0, policy_version 438907 (0.0005) [2023-12-26 03:05:25,501][123091] Updated weights for policy 0, policy_version 438917 (0.0006) [2023-12-26 03:05:25,559][123091] Updated weights for policy 0, policy_version 438927 (0.0005) [2023-12-26 03:05:26,195][123090] Updated weights for policy 1, policy_version 436161 (0.0010) [2023-12-26 03:05:26,200][123091] Updated weights for policy 0, policy_version 438937 (0.0005) [2023-12-26 03:05:26,256][123091] Updated weights for policy 0, policy_version 438947 (0.0005) [2023-12-26 03:05:26,258][123090] Updated weights for policy 1, policy_version 436171 (0.0008) [2023-12-26 03:05:26,312][123091] Updated weights for policy 0, policy_version 438957 (0.0005) [2023-12-26 03:05:26,320][123090] Updated weights for policy 1, policy_version 436181 (0.0008) [2023-12-26 03:05:26,374][123090] Updated weights for policy 1, policy_version 436191 (0.0009) [2023-12-26 03:05:26,964][123091] Updated weights for policy 0, policy_version 438967 (0.0005) [2023-12-26 03:05:27,008][123091] Updated weights for policy 0, policy_version 438977 (0.0005) [2023-12-26 03:05:27,054][123091] Updated weights for policy 0, policy_version 438987 (0.0005) [2023-12-26 03:05:27,321][123090] Updated weights for policy 1, policy_version 436201 (0.0009) [2023-12-26 03:05:27,386][123090] Updated weights for policy 1, policy_version 436211 (0.0005) [2023-12-26 03:05:27,438][123090] Updated weights for policy 1, policy_version 436221 (0.0005) [2023-12-26 03:05:27,731][123091] Updated weights for policy 0, policy_version 438997 (0.0005) [2023-12-26 03:05:27,781][123091] Updated weights for policy 0, policy_version 439007 (0.0005) [2023-12-26 03:05:27,828][123091] Updated weights for policy 0, policy_version 439017 (0.0006) [2023-12-26 03:05:28,029][123090] Updated weights for policy 1, policy_version 436231 (0.0007) [2023-12-26 03:05:28,110][123090] Updated weights for policy 1, policy_version 436241 (0.0009) [2023-12-26 03:05:28,178][123090] Updated weights for policy 1, policy_version 436251 (0.0009) [2023-12-26 03:05:28,537][123091] Updated weights for policy 0, policy_version 439027 (0.0005) [2023-12-26 03:05:28,586][123091] Updated weights for policy 0, policy_version 439037 (0.0008) [2023-12-26 03:05:28,648][123091] Updated weights for policy 0, policy_version 439047 (0.0010) [2023-12-26 03:05:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 224083968. Throughput: 0: 9035.3, 1: 8452.7. Samples: 224074412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:28,785][121949] Avg episode reward: [(0, '6125.914'), (1, '5634.825')] [2023-12-26 03:05:29,016][123090] Updated weights for policy 1, policy_version 436261 (0.0010) [2023-12-26 03:05:29,076][123090] Updated weights for policy 1, policy_version 436271 (0.0009) [2023-12-26 03:05:29,133][123090] Updated weights for policy 1, policy_version 436281 (0.0010) [2023-12-26 03:05:29,326][123091] Updated weights for policy 0, policy_version 439057 (0.0010) [2023-12-26 03:05:29,398][123091] Updated weights for policy 0, policy_version 439067 (0.0008) [2023-12-26 03:05:29,462][123091] Updated weights for policy 0, policy_version 439077 (0.0009) [2023-12-26 03:05:29,523][123091] Updated weights for policy 0, policy_version 439087 (0.0009) [2023-12-26 03:05:30,002][123090] Updated weights for policy 1, policy_version 436291 (0.0010) [2023-12-26 03:05:30,074][123090] Updated weights for policy 1, policy_version 436301 (0.0009) [2023-12-26 03:05:30,137][123090] Updated weights for policy 1, policy_version 436311 (0.0008) [2023-12-26 03:05:30,289][123091] Updated weights for policy 0, policy_version 439097 (0.0010) [2023-12-26 03:05:30,349][123091] Updated weights for policy 0, policy_version 439107 (0.0009) [2023-12-26 03:05:30,420][123091] Updated weights for policy 0, policy_version 439117 (0.0006) [2023-12-26 03:05:30,878][123090] Updated weights for policy 1, policy_version 436321 (0.0007) [2023-12-26 03:05:30,928][123090] Updated weights for policy 1, policy_version 436331 (0.0005) [2023-12-26 03:05:30,974][123090] Updated weights for policy 1, policy_version 436341 (0.0005) [2023-12-26 03:05:31,023][123090] Updated weights for policy 1, policy_version 436351 (0.0005) [2023-12-26 03:05:31,192][123091] Updated weights for policy 0, policy_version 439127 (0.0008) [2023-12-26 03:05:31,248][123091] Updated weights for policy 0, policy_version 439137 (0.0009) [2023-12-26 03:05:31,301][123091] Updated weights for policy 0, policy_version 439147 (0.0008) [2023-12-26 03:05:31,830][123090] Updated weights for policy 1, policy_version 436361 (0.0006) [2023-12-26 03:05:31,904][123090] Updated weights for policy 1, policy_version 436371 (0.0006) [2023-12-26 03:05:31,974][123090] Updated weights for policy 1, policy_version 436381 (0.0008) [2023-12-26 03:05:32,180][123091] Updated weights for policy 0, policy_version 439157 (0.0010) [2023-12-26 03:05:32,236][123091] Updated weights for policy 0, policy_version 439167 (0.0010) [2023-12-26 03:05:32,289][123091] Updated weights for policy 0, policy_version 439177 (0.0010) [2023-12-26 03:05:32,717][123090] Updated weights for policy 1, policy_version 436391 (0.0007) [2023-12-26 03:05:32,779][123090] Updated weights for policy 1, policy_version 436401 (0.0008) [2023-12-26 03:05:32,842][123090] Updated weights for policy 1, policy_version 436411 (0.0009) [2023-12-26 03:05:33,130][123091] Updated weights for policy 0, policy_version 439187 (0.0010) [2023-12-26 03:05:33,190][123091] Updated weights for policy 0, policy_version 439197 (0.0010) [2023-12-26 03:05:33,248][123091] Updated weights for policy 0, policy_version 439207 (0.0010) [2023-12-26 03:05:33,639][123090] Updated weights for policy 1, policy_version 436421 (0.0008) [2023-12-26 03:05:33,690][123090] Updated weights for policy 1, policy_version 436431 (0.0008) [2023-12-26 03:05:33,741][123090] Updated weights for policy 1, policy_version 436441 (0.0008) [2023-12-26 03:05:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 224174080. Throughput: 0: 9053.3, 1: 8507.7. Samples: 224182392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:05:33,784][121949] Avg episode reward: [(0, '6175.681'), (1, '5665.493')] [2023-12-26 03:05:34,002][123091] Updated weights for policy 0, policy_version 439217 (0.0010) [2023-12-26 03:05:34,053][123091] Updated weights for policy 0, policy_version 439227 (0.0005) [2023-12-26 03:05:34,110][123091] Updated weights for policy 0, policy_version 439237 (0.0005) [2023-12-26 03:05:34,179][123091] Updated weights for policy 0, policy_version 439247 (0.0008) [2023-12-26 03:05:34,622][123090] Updated weights for policy 1, policy_version 436451 (0.0009) [2023-12-26 03:05:34,686][123090] Updated weights for policy 1, policy_version 436461 (0.0009) [2023-12-26 03:05:34,744][123090] Updated weights for policy 1, policy_version 436471 (0.0008) [2023-12-26 03:05:34,923][123091] Updated weights for policy 0, policy_version 439257 (0.0006) [2023-12-26 03:05:34,999][123091] Updated weights for policy 0, policy_version 439267 (0.0006) [2023-12-26 03:05:35,061][123091] Updated weights for policy 0, policy_version 439277 (0.0008) [2023-12-26 03:05:35,557][123090] Updated weights for policy 1, policy_version 436481 (0.0008) [2023-12-26 03:05:35,609][123090] Updated weights for policy 1, policy_version 436491 (0.0009) [2023-12-26 03:05:35,672][123090] Updated weights for policy 1, policy_version 436501 (0.0010) [2023-12-26 03:05:35,730][123090] Updated weights for policy 1, policy_version 436511 (0.0009) [2023-12-26 03:05:35,738][123091] Updated weights for policy 0, policy_version 439287 (0.0007) [2023-12-26 03:05:35,800][123091] Updated weights for policy 0, policy_version 439297 (0.0010) [2023-12-26 03:05:35,849][123091] Updated weights for policy 0, policy_version 439307 (0.0009) [2023-12-26 03:05:36,600][123090] Updated weights for policy 1, policy_version 436521 (0.0009) [2023-12-26 03:05:36,665][123090] Updated weights for policy 1, policy_version 436531 (0.0011) [2023-12-26 03:05:36,719][123091] Updated weights for policy 0, policy_version 439317 (0.0008) [2023-12-26 03:05:36,730][123090] Updated weights for policy 1, policy_version 436541 (0.0011) [2023-12-26 03:05:36,773][123091] Updated weights for policy 0, policy_version 439327 (0.0007) [2023-12-26 03:05:36,833][123091] Updated weights for policy 0, policy_version 439337 (0.0009) [2023-12-26 03:05:37,571][123090] Updated weights for policy 1, policy_version 436551 (0.0009) [2023-12-26 03:05:37,625][123090] Updated weights for policy 1, policy_version 436561 (0.0006) [2023-12-26 03:05:37,685][123090] Updated weights for policy 1, policy_version 436571 (0.0011) [2023-12-26 03:05:37,691][123091] Updated weights for policy 0, policy_version 439347 (0.0009) [2023-12-26 03:05:37,743][123091] Updated weights for policy 0, policy_version 439357 (0.0007) [2023-12-26 03:05:37,803][123091] Updated weights for policy 0, policy_version 439367 (0.0009) [2023-12-26 03:05:38,469][123090] Updated weights for policy 1, policy_version 436581 (0.0011) [2023-12-26 03:05:38,529][123090] Updated weights for policy 1, policy_version 436591 (0.0011) [2023-12-26 03:05:38,596][123090] Updated weights for policy 1, policy_version 436601 (0.0010) [2023-12-26 03:05:38,679][123091] Updated weights for policy 0, policy_version 439377 (0.0009) [2023-12-26 03:05:38,738][123091] Updated weights for policy 0, policy_version 439387 (0.0008) [2023-12-26 03:05:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 224256000. Throughput: 0: 9060.9, 1: 8523.0. Samples: 224234500. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:05:38,785][121949] Avg episode reward: [(0, '6149.898'), (1, '5607.402')] [2023-12-26 03:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000436608_111771648.pth... [2023-12-26 03:05:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000435616_111517696.pth [2023-12-26 03:05:38,797][123091] Updated weights for policy 0, policy_version 439397 (0.0008) [2023-12-26 03:05:38,856][123091] Updated weights for policy 0, policy_version 439407 (0.0009) [2023-12-26 03:05:38,863][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000439408_112492544.pth... [2023-12-26 03:05:38,868][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000438320_112214016.pth [2023-12-26 03:05:39,403][123090] Updated weights for policy 1, policy_version 436611 (0.0011) [2023-12-26 03:05:39,472][123090] Updated weights for policy 1, policy_version 436621 (0.0011) [2023-12-26 03:05:39,540][123090] Updated weights for policy 1, policy_version 436631 (0.0010) [2023-12-26 03:05:39,713][123091] Updated weights for policy 0, policy_version 439417 (0.0009) [2023-12-26 03:05:39,778][123091] Updated weights for policy 0, policy_version 439427 (0.0009) [2023-12-26 03:05:39,833][123091] Updated weights for policy 0, policy_version 439437 (0.0009) [2023-12-26 03:05:40,386][123090] Updated weights for policy 1, policy_version 436641 (0.0011) [2023-12-26 03:05:40,452][123090] Updated weights for policy 1, policy_version 436651 (0.0009) [2023-12-26 03:05:40,514][123090] Updated weights for policy 1, policy_version 436661 (0.0009) [2023-12-26 03:05:40,581][123090] Updated weights for policy 1, policy_version 436671 (0.0010) [2023-12-26 03:05:40,747][123091] Updated weights for policy 0, policy_version 439447 (0.0010) [2023-12-26 03:05:40,821][123091] Updated weights for policy 0, policy_version 439457 (0.0009) [2023-12-26 03:05:40,892][123091] Updated weights for policy 0, policy_version 439467 (0.0010) [2023-12-26 03:05:41,349][123090] Updated weights for policy 1, policy_version 436681 (0.0009) [2023-12-26 03:05:41,418][123090] Updated weights for policy 1, policy_version 436691 (0.0009) [2023-12-26 03:05:41,485][123090] Updated weights for policy 1, policy_version 436701 (0.0009) [2023-12-26 03:05:41,762][123091] Updated weights for policy 0, policy_version 439477 (0.0009) [2023-12-26 03:05:41,834][123091] Updated weights for policy 0, policy_version 439487 (0.0008) [2023-12-26 03:05:41,891][123091] Updated weights for policy 0, policy_version 439497 (0.0006) [2023-12-26 03:05:42,393][123090] Updated weights for policy 1, policy_version 436711 (0.0010) [2023-12-26 03:05:42,461][123090] Updated weights for policy 1, policy_version 436721 (0.0010) [2023-12-26 03:05:42,523][123090] Updated weights for policy 1, policy_version 436731 (0.0010) [2023-12-26 03:05:42,703][123091] Updated weights for policy 0, policy_version 439507 (0.0009) [2023-12-26 03:05:42,770][123091] Updated weights for policy 0, policy_version 439517 (0.0008) [2023-12-26 03:05:42,837][123091] Updated weights for policy 0, policy_version 439527 (0.0010) [2023-12-26 03:05:43,352][123090] Updated weights for policy 1, policy_version 436741 (0.0009) [2023-12-26 03:05:43,423][123090] Updated weights for policy 1, policy_version 436751 (0.0009) [2023-12-26 03:05:43,475][123090] Updated weights for policy 1, policy_version 436761 (0.0009) [2023-12-26 03:05:43,662][123091] Updated weights for policy 0, policy_version 439537 (0.0009) [2023-12-26 03:05:43,724][123091] Updated weights for policy 0, policy_version 439547 (0.0009) [2023-12-26 03:05:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 224337920. Throughput: 0: 8981.6, 1: 8489.3. Samples: 224334932. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:05:43,784][121949] Avg episode reward: [(0, '5939.208'), (1, '5706.104')] [2023-12-26 03:05:43,786][123091] Updated weights for policy 0, policy_version 439557 (0.0009) [2023-12-26 03:05:43,844][123091] Updated weights for policy 0, policy_version 439567 (0.0009) [2023-12-26 03:05:44,301][123090] Updated weights for policy 1, policy_version 436771 (0.0009) [2023-12-26 03:05:44,371][123090] Updated weights for policy 1, policy_version 436781 (0.0009) [2023-12-26 03:05:44,431][123090] Updated weights for policy 1, policy_version 436791 (0.0010) [2023-12-26 03:05:44,665][123091] Updated weights for policy 0, policy_version 439577 (0.0010) [2023-12-26 03:05:44,727][123091] Updated weights for policy 0, policy_version 439587 (0.0009) [2023-12-26 03:05:44,797][123091] Updated weights for policy 0, policy_version 439597 (0.0009) [2023-12-26 03:05:45,298][123090] Updated weights for policy 1, policy_version 436801 (0.0010) [2023-12-26 03:05:45,354][123090] Updated weights for policy 1, policy_version 436811 (0.0010) [2023-12-26 03:05:45,408][123090] Updated weights for policy 1, policy_version 436821 (0.0010) [2023-12-26 03:05:45,460][123090] Updated weights for policy 1, policy_version 436831 (0.0008) [2023-12-26 03:05:45,523][123091] Updated weights for policy 0, policy_version 439607 (0.0008) [2023-12-26 03:05:45,574][123091] Updated weights for policy 0, policy_version 439617 (0.0010) [2023-12-26 03:05:45,625][123091] Updated weights for policy 0, policy_version 439628 (0.0010) [2023-12-26 03:05:46,244][123090] Updated weights for policy 1, policy_version 436841 (0.0006) [2023-12-26 03:05:46,291][123090] Updated weights for policy 1, policy_version 436851 (0.0005) [2023-12-26 03:05:46,358][123090] Updated weights for policy 1, policy_version 436861 (0.0005) [2023-12-26 03:05:46,428][123091] Updated weights for policy 0, policy_version 439638 (0.0009) [2023-12-26 03:05:46,480][123091] Updated weights for policy 0, policy_version 439648 (0.0009) [2023-12-26 03:05:46,534][123091] Updated weights for policy 0, policy_version 439658 (0.0009) [2023-12-26 03:05:47,100][123090] Updated weights for policy 1, policy_version 436871 (0.0008) [2023-12-26 03:05:47,151][123090] Updated weights for policy 1, policy_version 436881 (0.0007) [2023-12-26 03:05:47,206][123090] Updated weights for policy 1, policy_version 436891 (0.0005) [2023-12-26 03:05:47,434][123091] Updated weights for policy 0, policy_version 439668 (0.0009) [2023-12-26 03:05:47,497][123091] Updated weights for policy 0, policy_version 439678 (0.0009) [2023-12-26 03:05:47,565][123091] Updated weights for policy 0, policy_version 439688 (0.0010) [2023-12-26 03:05:47,975][123090] Updated weights for policy 1, policy_version 436901 (0.0005) [2023-12-26 03:05:48,023][123090] Updated weights for policy 1, policy_version 436911 (0.0005) [2023-12-26 03:05:48,081][123090] Updated weights for policy 1, policy_version 436921 (0.0007) [2023-12-26 03:05:48,427][123091] Updated weights for policy 0, policy_version 439698 (0.0009) [2023-12-26 03:05:48,493][123091] Updated weights for policy 0, policy_version 439708 (0.0009) [2023-12-26 03:05:48,560][123091] Updated weights for policy 0, policy_version 439718 (0.0010) [2023-12-26 03:05:48,627][123091] Updated weights for policy 0, policy_version 439728 (0.0010) [2023-12-26 03:05:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 224428032. Throughput: 0: 8970.1, 1: 8566.5. Samples: 224439976. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:05:48,785][121949] Avg episode reward: [(0, '5967.145'), (1, '5561.142')] [2023-12-26 03:05:48,805][123090] Updated weights for policy 1, policy_version 436931 (0.0010) [2023-12-26 03:05:48,854][123090] Updated weights for policy 1, policy_version 436941 (0.0009) [2023-12-26 03:05:48,914][123090] Updated weights for policy 1, policy_version 436951 (0.0009) [2023-12-26 03:05:49,453][123091] Updated weights for policy 0, policy_version 439738 (0.0009) [2023-12-26 03:05:49,505][123091] Updated weights for policy 0, policy_version 439748 (0.0005) [2023-12-26 03:05:49,557][123091] Updated weights for policy 0, policy_version 439758 (0.0006) [2023-12-26 03:05:49,721][123090] Updated weights for policy 1, policy_version 436961 (0.0006) [2023-12-26 03:05:49,785][123090] Updated weights for policy 1, policy_version 436971 (0.0011) [2023-12-26 03:05:49,848][123090] Updated weights for policy 1, policy_version 436981 (0.0011) [2023-12-26 03:05:49,913][123090] Updated weights for policy 1, policy_version 436991 (0.0011) [2023-12-26 03:05:50,346][123091] Updated weights for policy 0, policy_version 439768 (0.0011) [2023-12-26 03:05:50,402][123091] Updated weights for policy 0, policy_version 439778 (0.0011) [2023-12-26 03:05:50,466][123091] Updated weights for policy 0, policy_version 439788 (0.0011) [2023-12-26 03:05:50,735][123090] Updated weights for policy 1, policy_version 437001 (0.0007) [2023-12-26 03:05:50,791][123090] Updated weights for policy 1, policy_version 437011 (0.0006) [2023-12-26 03:05:50,855][123090] Updated weights for policy 1, policy_version 437021 (0.0006) [2023-12-26 03:05:51,213][123091] Updated weights for policy 0, policy_version 439798 (0.0011) [2023-12-26 03:05:51,284][123091] Updated weights for policy 0, policy_version 439808 (0.0011) [2023-12-26 03:05:51,351][123091] Updated weights for policy 0, policy_version 439818 (0.0011) [2023-12-26 03:05:51,631][123090] Updated weights for policy 1, policy_version 437031 (0.0008) [2023-12-26 03:05:51,699][123090] Updated weights for policy 1, policy_version 437041 (0.0006) [2023-12-26 03:05:51,773][123090] Updated weights for policy 1, policy_version 437051 (0.0008) [2023-12-26 03:05:52,137][123091] Updated weights for policy 0, policy_version 439828 (0.0008) [2023-12-26 03:05:52,185][123091] Updated weights for policy 0, policy_version 439838 (0.0005) [2023-12-26 03:05:52,232][123091] Updated weights for policy 0, policy_version 439848 (0.0005) [2023-12-26 03:05:52,642][123090] Updated weights for policy 1, policy_version 437061 (0.0010) [2023-12-26 03:05:52,699][123090] Updated weights for policy 1, policy_version 437071 (0.0009) [2023-12-26 03:05:52,751][123090] Updated weights for policy 1, policy_version 437081 (0.0008) [2023-12-26 03:05:53,054][123091] Updated weights for policy 0, policy_version 439858 (0.0010) [2023-12-26 03:05:53,097][123091] Updated weights for policy 0, policy_version 439868 (0.0010) [2023-12-26 03:05:53,144][123091] Updated weights for policy 0, policy_version 439878 (0.0010) [2023-12-26 03:05:53,191][123091] Updated weights for policy 0, policy_version 439888 (0.0010) [2023-12-26 03:05:53,614][123090] Updated weights for policy 1, policy_version 437091 (0.0009) [2023-12-26 03:05:53,665][123090] Updated weights for policy 1, policy_version 437101 (0.0008) [2023-12-26 03:05:53,722][123090] Updated weights for policy 1, policy_version 437111 (0.0008) [2023-12-26 03:05:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 224518144. Throughput: 0: 8967.3, 1: 8587.5. Samples: 224492356. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:05:53,785][121949] Avg episode reward: [(0, '6025.922'), (1, '5469.341')] [2023-12-26 03:05:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000439888_112615424.pth... [2023-12-26 03:05:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000437120_111902720.pth... [2023-12-26 03:05:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000438832_112345088.pth [2023-12-26 03:05:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000436096_111640576.pth [2023-12-26 03:05:54,031][123091] Updated weights for policy 0, policy_version 439898 (0.0011) [2023-12-26 03:05:54,078][123091] Updated weights for policy 0, policy_version 439908 (0.0010) [2023-12-26 03:05:54,136][123091] Updated weights for policy 0, policy_version 439918 (0.0010) [2023-12-26 03:05:54,488][123090] Updated weights for policy 1, policy_version 437121 (0.0008) [2023-12-26 03:05:54,541][123090] Updated weights for policy 1, policy_version 437131 (0.0005) [2023-12-26 03:05:54,612][123090] Updated weights for policy 1, policy_version 437141 (0.0007) [2023-12-26 03:05:54,667][123090] Updated weights for policy 1, policy_version 437151 (0.0006) [2023-12-26 03:05:54,968][123091] Updated weights for policy 0, policy_version 439928 (0.0011) [2023-12-26 03:05:55,038][123091] Updated weights for policy 0, policy_version 439938 (0.0011) [2023-12-26 03:05:55,104][123091] Updated weights for policy 0, policy_version 439948 (0.0008) [2023-12-26 03:05:55,414][123090] Updated weights for policy 1, policy_version 437161 (0.0010) [2023-12-26 03:05:55,476][123090] Updated weights for policy 1, policy_version 437171 (0.0010) [2023-12-26 03:05:55,537][123090] Updated weights for policy 1, policy_version 437181 (0.0010) [2023-12-26 03:05:55,910][123091] Updated weights for policy 0, policy_version 439958 (0.0010) [2023-12-26 03:05:55,983][123091] Updated weights for policy 0, policy_version 439968 (0.0011) [2023-12-26 03:05:56,049][123091] Updated weights for policy 0, policy_version 439978 (0.0010) [2023-12-26 03:05:56,289][123090] Updated weights for policy 1, policy_version 437191 (0.0010) [2023-12-26 03:05:56,339][123090] Updated weights for policy 1, policy_version 437201 (0.0007) [2023-12-26 03:05:56,391][123090] Updated weights for policy 1, policy_version 437211 (0.0005) [2023-12-26 03:05:56,823][123091] Updated weights for policy 0, policy_version 439988 (0.0010) [2023-12-26 03:05:56,887][123091] Updated weights for policy 0, policy_version 439998 (0.0010) [2023-12-26 03:05:56,948][123091] Updated weights for policy 0, policy_version 440008 (0.0010) [2023-12-26 03:05:57,109][123090] Updated weights for policy 1, policy_version 437221 (0.0005) [2023-12-26 03:05:57,180][123090] Updated weights for policy 1, policy_version 437231 (0.0005) [2023-12-26 03:05:57,254][123090] Updated weights for policy 1, policy_version 437241 (0.0007) [2023-12-26 03:05:57,747][123091] Updated weights for policy 0, policy_version 440018 (0.0010) [2023-12-26 03:05:57,791][123091] Updated weights for policy 0, policy_version 440028 (0.0010) [2023-12-26 03:05:57,838][123091] Updated weights for policy 0, policy_version 440038 (0.0010) [2023-12-26 03:05:57,881][123091] Updated weights for policy 0, policy_version 440048 (0.0010) [2023-12-26 03:05:57,929][123090] Updated weights for policy 1, policy_version 437251 (0.0008) [2023-12-26 03:05:58,009][123090] Updated weights for policy 1, policy_version 437261 (0.0006) [2023-12-26 03:05:58,081][123090] Updated weights for policy 1, policy_version 437271 (0.0008) [2023-12-26 03:05:58,783][123091] Updated weights for policy 0, policy_version 440058 (0.0008) [2023-12-26 03:05:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 224600064. Throughput: 0: 8948.0, 1: 8680.5. Samples: 224600260. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:05:58,784][121949] Avg episode reward: [(0, '6091.225'), (1, '5466.444')] [2023-12-26 03:05:58,852][123091] Updated weights for policy 0, policy_version 440068 (0.0008) [2023-12-26 03:05:58,890][123090] Updated weights for policy 1, policy_version 437281 (0.0007) [2023-12-26 03:05:58,916][123091] Updated weights for policy 0, policy_version 440078 (0.0010) [2023-12-26 03:05:58,954][123090] Updated weights for policy 1, policy_version 437291 (0.0009) [2023-12-26 03:05:59,014][123090] Updated weights for policy 1, policy_version 437301 (0.0009) [2023-12-26 03:05:59,077][123090] Updated weights for policy 1, policy_version 437311 (0.0009) [2023-12-26 03:05:59,711][123091] Updated weights for policy 0, policy_version 440088 (0.0010) [2023-12-26 03:05:59,773][123091] Updated weights for policy 0, policy_version 440098 (0.0011) [2023-12-26 03:05:59,828][123091] Updated weights for policy 0, policy_version 440108 (0.0008) [2023-12-26 03:05:59,931][123090] Updated weights for policy 1, policy_version 437321 (0.0008) [2023-12-26 03:05:59,994][123090] Updated weights for policy 1, policy_version 437331 (0.0009) [2023-12-26 03:06:00,066][123090] Updated weights for policy 1, policy_version 437341 (0.0009) [2023-12-26 03:06:00,495][123091] Updated weights for policy 0, policy_version 440118 (0.0011) [2023-12-26 03:06:00,560][123091] Updated weights for policy 0, policy_version 440128 (0.0010) [2023-12-26 03:06:00,631][123091] Updated weights for policy 0, policy_version 440138 (0.0010) [2023-12-26 03:06:00,845][123090] Updated weights for policy 1, policy_version 437351 (0.0009) [2023-12-26 03:06:00,909][123090] Updated weights for policy 1, policy_version 437361 (0.0006) [2023-12-26 03:06:00,983][123090] Updated weights for policy 1, policy_version 437371 (0.0005) [2023-12-26 03:06:01,433][123091] Updated weights for policy 0, policy_version 440148 (0.0009) [2023-12-26 03:06:01,495][123091] Updated weights for policy 0, policy_version 440158 (0.0008) [2023-12-26 03:06:01,556][123091] Updated weights for policy 0, policy_version 440168 (0.0008) [2023-12-26 03:06:01,663][123090] Updated weights for policy 1, policy_version 437381 (0.0006) [2023-12-26 03:06:01,738][123090] Updated weights for policy 1, policy_version 437391 (0.0008) [2023-12-26 03:06:01,805][123090] Updated weights for policy 1, policy_version 437401 (0.0011) [2023-12-26 03:06:02,377][123091] Updated weights for policy 0, policy_version 440178 (0.0010) [2023-12-26 03:06:02,436][123091] Updated weights for policy 0, policy_version 440188 (0.0006) [2023-12-26 03:06:02,504][123091] Updated weights for policy 0, policy_version 440198 (0.0008) [2023-12-26 03:06:02,557][123091] Updated weights for policy 0, policy_version 440208 (0.0009) [2023-12-26 03:06:02,616][123090] Updated weights for policy 1, policy_version 437411 (0.0010) [2023-12-26 03:06:02,678][123090] Updated weights for policy 1, policy_version 437421 (0.0010) [2023-12-26 03:06:02,748][123090] Updated weights for policy 1, policy_version 437431 (0.0010) [2023-12-26 03:06:03,302][123091] Updated weights for policy 0, policy_version 440218 (0.0006) [2023-12-26 03:06:03,367][123091] Updated weights for policy 0, policy_version 440228 (0.0007) [2023-12-26 03:06:03,424][123091] Updated weights for policy 0, policy_version 440238 (0.0009) [2023-12-26 03:06:03,532][123090] Updated weights for policy 1, policy_version 437441 (0.0010) [2023-12-26 03:06:03,592][123090] Updated weights for policy 1, policy_version 437451 (0.0005) [2023-12-26 03:06:03,649][123090] Updated weights for policy 1, policy_version 437461 (0.0008) [2023-12-26 03:06:03,706][123090] Updated weights for policy 1, policy_version 437471 (0.0009) [2023-12-26 03:06:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 224698368. Throughput: 0: 8962.2, 1: 8733.0. Samples: 224706564. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:03,785][121949] Avg episode reward: [(0, '6093.377'), (1, '5451.475')] [2023-12-26 03:06:04,262][123091] Updated weights for policy 0, policy_version 440248 (0.0009) [2023-12-26 03:06:04,319][123091] Updated weights for policy 0, policy_version 440258 (0.0009) [2023-12-26 03:06:04,379][123091] Updated weights for policy 0, policy_version 440268 (0.0009) [2023-12-26 03:06:04,508][123090] Updated weights for policy 1, policy_version 437481 (0.0010) [2023-12-26 03:06:04,561][123090] Updated weights for policy 1, policy_version 437491 (0.0010) [2023-12-26 03:06:04,617][123090] Updated weights for policy 1, policy_version 437501 (0.0009) [2023-12-26 03:06:05,250][123091] Updated weights for policy 0, policy_version 440278 (0.0010) [2023-12-26 03:06:05,306][123091] Updated weights for policy 0, policy_version 440288 (0.0009) [2023-12-26 03:06:05,373][123091] Updated weights for policy 0, policy_version 440298 (0.0010) [2023-12-26 03:06:05,417][123090] Updated weights for policy 1, policy_version 437511 (0.0009) [2023-12-26 03:06:05,471][123090] Updated weights for policy 1, policy_version 437521 (0.0009) [2023-12-26 03:06:05,540][123090] Updated weights for policy 1, policy_version 437531 (0.0010) [2023-12-26 03:06:06,244][123091] Updated weights for policy 0, policy_version 440308 (0.0008) [2023-12-26 03:06:06,297][123090] Updated weights for policy 1, policy_version 437541 (0.0008) [2023-12-26 03:06:06,310][123091] Updated weights for policy 0, policy_version 440318 (0.0009) [2023-12-26 03:06:06,363][123090] Updated weights for policy 1, policy_version 437551 (0.0010) [2023-12-26 03:06:06,378][123091] Updated weights for policy 0, policy_version 440328 (0.0009) [2023-12-26 03:06:06,429][123090] Updated weights for policy 1, policy_version 437561 (0.0008) [2023-12-26 03:06:07,201][123091] Updated weights for policy 0, policy_version 440338 (0.0009) [2023-12-26 03:06:07,231][123090] Updated weights for policy 1, policy_version 437571 (0.0009) [2023-12-26 03:06:07,258][123091] Updated weights for policy 0, policy_version 440348 (0.0008) [2023-12-26 03:06:07,278][123090] Updated weights for policy 1, policy_version 437581 (0.0009) [2023-12-26 03:06:07,315][123091] Updated weights for policy 0, policy_version 440358 (0.0007) [2023-12-26 03:06:07,339][123090] Updated weights for policy 1, policy_version 437591 (0.0009) [2023-12-26 03:06:07,376][123091] Updated weights for policy 0, policy_version 440368 (0.0009) [2023-12-26 03:06:08,179][123090] Updated weights for policy 1, policy_version 437601 (0.0008) [2023-12-26 03:06:08,215][123091] Updated weights for policy 0, policy_version 440378 (0.0008) [2023-12-26 03:06:08,225][123090] Updated weights for policy 1, policy_version 437611 (0.0010) [2023-12-26 03:06:08,271][123090] Updated weights for policy 1, policy_version 437621 (0.0007) [2023-12-26 03:06:08,277][123091] Updated weights for policy 0, policy_version 440388 (0.0008) [2023-12-26 03:06:08,325][123090] Updated weights for policy 1, policy_version 437631 (0.0008) [2023-12-26 03:06:08,343][123091] Updated weights for policy 0, policy_version 440398 (0.0008) [2023-12-26 03:06:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 224780288. Throughput: 0: 8931.8, 1: 8751.6. Samples: 224757644. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:08,784][121949] Avg episode reward: [(0, '5951.408'), (1, '5416.536')] [2023-12-26 03:06:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000440400_112746496.pth... [2023-12-26 03:06:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000437632_112033792.pth... [2023-12-26 03:06:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000436608_111771648.pth [2023-12-26 03:06:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000439408_112492544.pth [2023-12-26 03:06:09,138][123090] Updated weights for policy 1, policy_version 437641 (0.0009) [2023-12-26 03:06:09,197][123090] Updated weights for policy 1, policy_version 437651 (0.0009) [2023-12-26 03:06:09,217][123091] Updated weights for policy 0, policy_version 440408 (0.0009) [2023-12-26 03:06:09,256][123090] Updated weights for policy 1, policy_version 437661 (0.0009) [2023-12-26 03:06:09,281][123091] Updated weights for policy 0, policy_version 440418 (0.0009) [2023-12-26 03:06:09,342][123091] Updated weights for policy 0, policy_version 440428 (0.0009) [2023-12-26 03:06:10,179][123090] Updated weights for policy 1, policy_version 437671 (0.0009) [2023-12-26 03:06:10,199][123091] Updated weights for policy 0, policy_version 440438 (0.0010) [2023-12-26 03:06:10,239][123090] Updated weights for policy 1, policy_version 437681 (0.0008) [2023-12-26 03:06:10,250][123091] Updated weights for policy 0, policy_version 440448 (0.0008) [2023-12-26 03:06:10,300][123091] Updated weights for policy 0, policy_version 440458 (0.0008) [2023-12-26 03:06:10,302][123090] Updated weights for policy 1, policy_version 437691 (0.0009) [2023-12-26 03:06:11,005][123091] Updated weights for policy 0, policy_version 440468 (0.0006) [2023-12-26 03:06:11,083][123091] Updated weights for policy 0, policy_version 440478 (0.0009) [2023-12-26 03:06:11,156][123091] Updated weights for policy 0, policy_version 440488 (0.0009) [2023-12-26 03:06:11,199][123090] Updated weights for policy 1, policy_version 437701 (0.0008) [2023-12-26 03:06:11,258][123090] Updated weights for policy 1, policy_version 437711 (0.0008) [2023-12-26 03:06:11,313][123090] Updated weights for policy 1, policy_version 437721 (0.0008) [2023-12-26 03:06:11,992][123091] Updated weights for policy 0, policy_version 440498 (0.0007) [2023-12-26 03:06:12,049][123091] Updated weights for policy 0, policy_version 440508 (0.0010) [2023-12-26 03:06:12,109][123091] Updated weights for policy 0, policy_version 440518 (0.0006) [2023-12-26 03:06:12,110][123090] Updated weights for policy 1, policy_version 437731 (0.0007) [2023-12-26 03:06:12,169][123091] Updated weights for policy 0, policy_version 440528 (0.0006) [2023-12-26 03:06:12,180][123090] Updated weights for policy 1, policy_version 437741 (0.0007) [2023-12-26 03:06:12,242][123090] Updated weights for policy 1, policy_version 437751 (0.0009) [2023-12-26 03:06:12,875][123091] Updated weights for policy 0, policy_version 440538 (0.0010) [2023-12-26 03:06:12,932][123091] Updated weights for policy 0, policy_version 440548 (0.0010) [2023-12-26 03:06:12,996][123091] Updated weights for policy 0, policy_version 440558 (0.0011) [2023-12-26 03:06:13,105][123090] Updated weights for policy 1, policy_version 437761 (0.0010) [2023-12-26 03:06:13,170][123090] Updated weights for policy 1, policy_version 437771 (0.0009) [2023-12-26 03:06:13,227][123090] Updated weights for policy 1, policy_version 437781 (0.0009) [2023-12-26 03:06:13,281][123090] Updated weights for policy 1, policy_version 437791 (0.0009) [2023-12-26 03:06:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17550.5). Total num frames: 224862208. Throughput: 0: 8690.9, 1: 8776.5. Samples: 224860448. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:13,785][121949] Avg episode reward: [(0, '5937.541'), (1, '5495.257')] [2023-12-26 03:06:13,816][123091] Updated weights for policy 0, policy_version 440568 (0.0011) [2023-12-26 03:06:13,882][123091] Updated weights for policy 0, policy_version 440578 (0.0011) [2023-12-26 03:06:13,942][123091] Updated weights for policy 0, policy_version 440588 (0.0011) [2023-12-26 03:06:14,139][123090] Updated weights for policy 1, policy_version 437801 (0.0010) [2023-12-26 03:06:14,197][123090] Updated weights for policy 1, policy_version 437811 (0.0010) [2023-12-26 03:06:14,244][123090] Updated weights for policy 1, policy_version 437821 (0.0009) [2023-12-26 03:06:14,656][123091] Updated weights for policy 0, policy_version 440598 (0.0008) [2023-12-26 03:06:14,709][123091] Updated weights for policy 0, policy_version 440608 (0.0009) [2023-12-26 03:06:14,768][123091] Updated weights for policy 0, policy_version 440618 (0.0010) [2023-12-26 03:06:15,182][123090] Updated weights for policy 1, policy_version 437831 (0.0009) [2023-12-26 03:06:15,233][123090] Updated weights for policy 1, policy_version 437841 (0.0009) [2023-12-26 03:06:15,284][123090] Updated weights for policy 1, policy_version 437851 (0.0006) [2023-12-26 03:06:15,586][123091] Updated weights for policy 0, policy_version 440628 (0.0010) [2023-12-26 03:06:15,639][123091] Updated weights for policy 0, policy_version 440638 (0.0010) [2023-12-26 03:06:15,694][123091] Updated weights for policy 0, policy_version 440648 (0.0010) [2023-12-26 03:06:15,968][123090] Updated weights for policy 1, policy_version 437861 (0.0008) [2023-12-26 03:06:16,018][123090] Updated weights for policy 1, policy_version 437871 (0.0009) [2023-12-26 03:06:16,079][123090] Updated weights for policy 1, policy_version 437881 (0.0007) [2023-12-26 03:06:16,501][123091] Updated weights for policy 0, policy_version 440658 (0.0009) [2023-12-26 03:06:16,561][123091] Updated weights for policy 0, policy_version 440668 (0.0005) [2023-12-26 03:06:16,606][123091] Updated weights for policy 0, policy_version 440678 (0.0005) [2023-12-26 03:06:16,656][123091] Updated weights for policy 0, policy_version 440688 (0.0005) [2023-12-26 03:06:16,926][123090] Updated weights for policy 1, policy_version 437891 (0.0007) [2023-12-26 03:06:16,989][123090] Updated weights for policy 1, policy_version 437901 (0.0010) [2023-12-26 03:06:17,044][123090] Updated weights for policy 1, policy_version 437911 (0.0009) [2023-12-26 03:06:17,265][123091] Updated weights for policy 0, policy_version 440698 (0.0009) [2023-12-26 03:06:17,329][123091] Updated weights for policy 0, policy_version 440708 (0.0005) [2023-12-26 03:06:17,401][123091] Updated weights for policy 0, policy_version 440718 (0.0005) [2023-12-26 03:06:17,964][123090] Updated weights for policy 1, policy_version 437921 (0.0009) [2023-12-26 03:06:18,030][123090] Updated weights for policy 1, policy_version 437931 (0.0009) [2023-12-26 03:06:18,063][123091] Updated weights for policy 0, policy_version 440728 (0.0008) [2023-12-26 03:06:18,090][123090] Updated weights for policy 1, policy_version 437941 (0.0009) [2023-12-26 03:06:18,128][123091] Updated weights for policy 0, policy_version 440738 (0.0008) [2023-12-26 03:06:18,158][123090] Updated weights for policy 1, policy_version 437951 (0.0008) [2023-12-26 03:06:18,192][123091] Updated weights for policy 0, policy_version 440748 (0.0008) [2023-12-26 03:06:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 224952320. Throughput: 0: 8743.3, 1: 8692.6. Samples: 224967008. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:18,785][121949] Avg episode reward: [(0, '6033.896'), (1, '5437.136')] [2023-12-26 03:06:18,955][123090] Updated weights for policy 1, policy_version 437961 (0.0009) [2023-12-26 03:06:19,011][123091] Updated weights for policy 0, policy_version 440758 (0.0008) [2023-12-26 03:06:19,017][123090] Updated weights for policy 1, policy_version 437971 (0.0010) [2023-12-26 03:06:19,072][123091] Updated weights for policy 0, policy_version 440768 (0.0009) [2023-12-26 03:06:19,081][123090] Updated weights for policy 1, policy_version 437981 (0.0009) [2023-12-26 03:06:19,135][123091] Updated weights for policy 0, policy_version 440778 (0.0008) [2023-12-26 03:06:19,959][123090] Updated weights for policy 1, policy_version 437991 (0.0010) [2023-12-26 03:06:19,974][123091] Updated weights for policy 0, policy_version 440788 (0.0010) [2023-12-26 03:06:20,021][123090] Updated weights for policy 1, policy_version 438001 (0.0008) [2023-12-26 03:06:20,028][123091] Updated weights for policy 0, policy_version 440798 (0.0008) [2023-12-26 03:06:20,078][123090] Updated weights for policy 1, policy_version 438011 (0.0007) [2023-12-26 03:06:20,094][123091] Updated weights for policy 0, policy_version 440808 (0.0009) [2023-12-26 03:06:20,897][123090] Updated weights for policy 1, policy_version 438021 (0.0009) [2023-12-26 03:06:20,960][123091] Updated weights for policy 0, policy_version 440818 (0.0009) [2023-12-26 03:06:20,967][123090] Updated weights for policy 1, policy_version 438031 (0.0009) [2023-12-26 03:06:21,026][123091] Updated weights for policy 0, policy_version 440828 (0.0009) [2023-12-26 03:06:21,029][123090] Updated weights for policy 1, policy_version 438041 (0.0006) [2023-12-26 03:06:21,101][123091] Updated weights for policy 0, policy_version 440838 (0.0008) [2023-12-26 03:06:21,172][123091] Updated weights for policy 0, policy_version 440848 (0.0010) [2023-12-26 03:06:21,829][123090] Updated weights for policy 1, policy_version 438051 (0.0007) [2023-12-26 03:06:21,902][123090] Updated weights for policy 1, policy_version 438061 (0.0006) [2023-12-26 03:06:21,973][123090] Updated weights for policy 1, policy_version 438071 (0.0006) [2023-12-26 03:06:22,038][123091] Updated weights for policy 0, policy_version 440858 (0.0006) [2023-12-26 03:06:22,109][123091] Updated weights for policy 0, policy_version 440868 (0.0006) [2023-12-26 03:06:22,184][123091] Updated weights for policy 0, policy_version 440878 (0.0007) [2023-12-26 03:06:22,736][123090] Updated weights for policy 1, policy_version 438081 (0.0007) [2023-12-26 03:06:22,798][123090] Updated weights for policy 1, policy_version 438091 (0.0009) [2023-12-26 03:06:22,856][123090] Updated weights for policy 1, policy_version 438101 (0.0009) [2023-12-26 03:06:22,921][123090] Updated weights for policy 1, policy_version 438111 (0.0006) [2023-12-26 03:06:22,931][123091] Updated weights for policy 0, policy_version 440888 (0.0009) [2023-12-26 03:06:22,980][123091] Updated weights for policy 0, policy_version 440898 (0.0008) [2023-12-26 03:06:23,031][123091] Updated weights for policy 0, policy_version 440908 (0.0005) [2023-12-26 03:06:23,623][123090] Updated weights for policy 1, policy_version 438121 (0.0005) [2023-12-26 03:06:23,681][123090] Updated weights for policy 1, policy_version 438131 (0.0005) [2023-12-26 03:06:23,722][123091] Updated weights for policy 0, policy_version 440918 (0.0008) [2023-12-26 03:06:23,740][123090] Updated weights for policy 1, policy_version 438141 (0.0005) [2023-12-26 03:06:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 225042432. Throughput: 0: 8685.2, 1: 8708.3. Samples: 225017212. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:23,785][121949] Avg episode reward: [(0, '6028.784'), (1, '5533.094')] [2023-12-26 03:06:23,788][123091] Updated weights for policy 0, policy_version 440928 (0.0010) [2023-12-26 03:06:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000438144_112164864.pth... [2023-12-26 03:06:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000437120_111902720.pth [2023-12-26 03:06:23,846][123091] Updated weights for policy 0, policy_version 440938 (0.0010) [2023-12-26 03:06:23,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000440944_112885760.pth... [2023-12-26 03:06:23,878][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000439888_112615424.pth [2023-12-26 03:06:24,357][123090] Updated weights for policy 1, policy_version 438151 (0.0005) [2023-12-26 03:06:24,424][123090] Updated weights for policy 1, policy_version 438161 (0.0006) [2023-12-26 03:06:24,486][123090] Updated weights for policy 1, policy_version 438171 (0.0008) [2023-12-26 03:06:24,601][123091] Updated weights for policy 0, policy_version 440948 (0.0009) [2023-12-26 03:06:24,658][123091] Updated weights for policy 0, policy_version 440959 (0.0011) [2023-12-26 03:06:24,711][123091] Updated weights for policy 0, policy_version 440969 (0.0011) [2023-12-26 03:06:25,176][123090] Updated weights for policy 1, policy_version 438181 (0.0007) [2023-12-26 03:06:25,239][123090] Updated weights for policy 1, policy_version 438191 (0.0005) [2023-12-26 03:06:25,315][123090] Updated weights for policy 1, policy_version 438201 (0.0005) [2023-12-26 03:06:25,509][123091] Updated weights for policy 0, policy_version 440979 (0.0009) [2023-12-26 03:06:25,556][123091] Updated weights for policy 0, policy_version 440989 (0.0005) [2023-12-26 03:06:25,616][123091] Updated weights for policy 0, policy_version 440999 (0.0005) [2023-12-26 03:06:25,977][123090] Updated weights for policy 1, policy_version 438211 (0.0005) [2023-12-26 03:06:26,035][123090] Updated weights for policy 1, policy_version 438221 (0.0006) [2023-12-26 03:06:26,101][123090] Updated weights for policy 1, policy_version 438231 (0.0005) [2023-12-26 03:06:26,299][123091] Updated weights for policy 0, policy_version 441009 (0.0005) [2023-12-26 03:06:26,353][123091] Updated weights for policy 0, policy_version 441019 (0.0005) [2023-12-26 03:06:26,407][123091] Updated weights for policy 0, policy_version 441029 (0.0005) [2023-12-26 03:06:26,470][123091] Updated weights for policy 0, policy_version 441039 (0.0005) [2023-12-26 03:06:26,720][123090] Updated weights for policy 1, policy_version 438241 (0.0005) [2023-12-26 03:06:26,773][123090] Updated weights for policy 1, policy_version 438251 (0.0008) [2023-12-26 03:06:26,831][123090] Updated weights for policy 1, policy_version 438261 (0.0009) [2023-12-26 03:06:26,883][123090] Updated weights for policy 1, policy_version 438272 (0.0010) [2023-12-26 03:06:27,103][123091] Updated weights for policy 0, policy_version 441049 (0.0005) [2023-12-26 03:06:27,162][123091] Updated weights for policy 0, policy_version 441059 (0.0005) [2023-12-26 03:06:27,224][123091] Updated weights for policy 0, policy_version 441069 (0.0005) [2023-12-26 03:06:27,677][123090] Updated weights for policy 1, policy_version 438282 (0.0005) [2023-12-26 03:06:27,729][123090] Updated weights for policy 1, policy_version 438292 (0.0005) [2023-12-26 03:06:27,776][123090] Updated weights for policy 1, policy_version 438302 (0.0005) [2023-12-26 03:06:27,903][123091] Updated weights for policy 0, policy_version 441079 (0.0006) [2023-12-26 03:06:27,954][123091] Updated weights for policy 0, policy_version 441089 (0.0005) [2023-12-26 03:06:28,004][123091] Updated weights for policy 0, policy_version 441099 (0.0005) [2023-12-26 03:06:28,587][123090] Updated weights for policy 1, policy_version 438312 (0.0008) [2023-12-26 03:06:28,656][123090] Updated weights for policy 1, policy_version 438322 (0.0009) [2023-12-26 03:06:28,722][123090] Updated weights for policy 1, policy_version 438332 (0.0007) [2023-12-26 03:06:28,725][123091] Updated weights for policy 0, policy_version 441109 (0.0007) [2023-12-26 03:06:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 225140736. Throughput: 0: 8874.3, 1: 8897.5. Samples: 225134664. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:28,785][121949] Avg episode reward: [(0, '5997.396'), (1, '5541.125')] [2023-12-26 03:06:28,790][123091] Updated weights for policy 0, policy_version 441119 (0.0010) [2023-12-26 03:06:28,853][123091] Updated weights for policy 0, policy_version 441129 (0.0010) [2023-12-26 03:06:29,513][123090] Updated weights for policy 1, policy_version 438342 (0.0008) [2023-12-26 03:06:29,571][123090] Updated weights for policy 1, policy_version 438352 (0.0009) [2023-12-26 03:06:29,627][123090] Updated weights for policy 1, policy_version 438362 (0.0009) [2023-12-26 03:06:29,673][123091] Updated weights for policy 0, policy_version 441139 (0.0009) [2023-12-26 03:06:29,736][123091] Updated weights for policy 0, policy_version 441149 (0.0006) [2023-12-26 03:06:29,804][123091] Updated weights for policy 0, policy_version 441159 (0.0010) [2023-12-26 03:06:30,395][123090] Updated weights for policy 1, policy_version 438372 (0.0007) [2023-12-26 03:06:30,451][123090] Updated weights for policy 1, policy_version 438382 (0.0005) [2023-12-26 03:06:30,504][123090] Updated weights for policy 1, policy_version 438392 (0.0005) [2023-12-26 03:06:30,536][123091] Updated weights for policy 0, policy_version 441169 (0.0011) [2023-12-26 03:06:30,598][123091] Updated weights for policy 0, policy_version 441179 (0.0011) [2023-12-26 03:06:30,660][123091] Updated weights for policy 0, policy_version 441189 (0.0010) [2023-12-26 03:06:30,715][123091] Updated weights for policy 0, policy_version 441199 (0.0010) [2023-12-26 03:06:31,133][123090] Updated weights for policy 1, policy_version 438402 (0.0006) [2023-12-26 03:06:31,201][123090] Updated weights for policy 1, policy_version 438412 (0.0010) [2023-12-26 03:06:31,268][123090] Updated weights for policy 1, policy_version 438422 (0.0011) [2023-12-26 03:06:31,327][123090] Updated weights for policy 1, policy_version 438432 (0.0008) [2023-12-26 03:06:31,552][123091] Updated weights for policy 0, policy_version 441209 (0.0006) [2023-12-26 03:06:31,626][123091] Updated weights for policy 0, policy_version 441219 (0.0006) [2023-12-26 03:06:31,691][123091] Updated weights for policy 0, policy_version 441229 (0.0007) [2023-12-26 03:06:32,065][123090] Updated weights for policy 1, policy_version 438442 (0.0009) [2023-12-26 03:06:32,120][123090] Updated weights for policy 1, policy_version 438452 (0.0010) [2023-12-26 03:06:32,168][123090] Updated weights for policy 1, policy_version 438462 (0.0010) [2023-12-26 03:06:32,372][123091] Updated weights for policy 0, policy_version 441239 (0.0009) [2023-12-26 03:06:32,443][123091] Updated weights for policy 0, policy_version 441249 (0.0009) [2023-12-26 03:06:32,507][123091] Updated weights for policy 0, policy_version 441259 (0.0009) [2023-12-26 03:06:32,986][123090] Updated weights for policy 1, policy_version 438472 (0.0006) [2023-12-26 03:06:33,034][123090] Updated weights for policy 1, policy_version 438482 (0.0005) [2023-12-26 03:06:33,095][123090] Updated weights for policy 1, policy_version 438492 (0.0005) [2023-12-26 03:06:33,298][123091] Updated weights for policy 0, policy_version 441269 (0.0009) [2023-12-26 03:06:33,352][123091] Updated weights for policy 0, policy_version 441280 (0.0010) [2023-12-26 03:06:33,409][123091] Updated weights for policy 0, policy_version 441290 (0.0010) [2023-12-26 03:06:33,647][123090] Updated weights for policy 1, policy_version 438502 (0.0005) [2023-12-26 03:06:33,700][123090] Updated weights for policy 1, policy_version 438512 (0.0010) [2023-12-26 03:06:33,747][123090] Updated weights for policy 1, policy_version 438522 (0.0010) [2023-12-26 03:06:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 225239040. Throughput: 0: 8950.7, 1: 8950.5. Samples: 225245532. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:33,785][121949] Avg episode reward: [(0, '6084.194'), (1, '5350.806')] [2023-12-26 03:06:34,289][123091] Updated weights for policy 0, policy_version 441301 (0.0010) [2023-12-26 03:06:34,350][123091] Updated weights for policy 0, policy_version 441311 (0.0009) [2023-12-26 03:06:34,407][123091] Updated weights for policy 0, policy_version 441321 (0.0008) [2023-12-26 03:06:34,462][123090] Updated weights for policy 1, policy_version 438532 (0.0010) [2023-12-26 03:06:34,528][123090] Updated weights for policy 1, policy_version 438542 (0.0009) [2023-12-26 03:06:34,592][123090] Updated weights for policy 1, policy_version 438552 (0.0011) [2023-12-26 03:06:35,198][123091] Updated weights for policy 0, policy_version 441331 (0.0008) [2023-12-26 03:06:35,247][123091] Updated weights for policy 0, policy_version 441341 (0.0009) [2023-12-26 03:06:35,293][123091] Updated weights for policy 0, policy_version 441351 (0.0008) [2023-12-26 03:06:35,405][123090] Updated weights for policy 1, policy_version 438562 (0.0011) [2023-12-26 03:06:35,470][123090] Updated weights for policy 1, policy_version 438572 (0.0010) [2023-12-26 03:06:35,517][123090] Updated weights for policy 1, policy_version 438582 (0.0010) [2023-12-26 03:06:35,572][123090] Updated weights for policy 1, policy_version 438592 (0.0010) [2023-12-26 03:06:36,154][123091] Updated weights for policy 0, policy_version 441361 (0.0008) [2023-12-26 03:06:36,213][123091] Updated weights for policy 0, policy_version 441371 (0.0009) [2023-12-26 03:06:36,278][123091] Updated weights for policy 0, policy_version 441381 (0.0009) [2023-12-26 03:06:36,342][123091] Updated weights for policy 0, policy_version 441391 (0.0009) [2023-12-26 03:06:36,403][123090] Updated weights for policy 1, policy_version 438602 (0.0011) [2023-12-26 03:06:36,459][123090] Updated weights for policy 1, policy_version 438612 (0.0010) [2023-12-26 03:06:36,515][123090] Updated weights for policy 1, policy_version 438622 (0.0010) [2023-12-26 03:06:37,172][123091] Updated weights for policy 0, policy_version 441401 (0.0009) [2023-12-26 03:06:37,221][123091] Updated weights for policy 0, policy_version 441411 (0.0009) [2023-12-26 03:06:37,278][123091] Updated weights for policy 0, policy_version 441421 (0.0009) [2023-12-26 03:06:37,364][123090] Updated weights for policy 1, policy_version 438632 (0.0011) [2023-12-26 03:06:37,430][123090] Updated weights for policy 1, policy_version 438642 (0.0011) [2023-12-26 03:06:37,499][123090] Updated weights for policy 1, policy_version 438652 (0.0011) [2023-12-26 03:06:38,135][123091] Updated weights for policy 0, policy_version 441431 (0.0009) [2023-12-26 03:06:38,183][123091] Updated weights for policy 0, policy_version 441441 (0.0009) [2023-12-26 03:06:38,230][123091] Updated weights for policy 0, policy_version 441451 (0.0008) [2023-12-26 03:06:38,305][123090] Updated weights for policy 1, policy_version 438662 (0.0011) [2023-12-26 03:06:38,377][123090] Updated weights for policy 1, policy_version 438672 (0.0010) [2023-12-26 03:06:38,441][123090] Updated weights for policy 1, policy_version 438682 (0.0010) [2023-12-26 03:06:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 225320960. Throughput: 0: 8947.7, 1: 8956.0. Samples: 225298024. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:38,785][121949] Avg episode reward: [(0, '6178.250'), (1, '5451.111')] [2023-12-26 03:06:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000441456_113016832.pth... [2023-12-26 03:06:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000438688_112304128.pth... [2023-12-26 03:06:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000440400_112746496.pth [2023-12-26 03:06:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000437632_112033792.pth [2023-12-26 03:06:39,118][123091] Updated weights for policy 0, policy_version 441461 (0.0009) [2023-12-26 03:06:39,186][123091] Updated weights for policy 0, policy_version 441471 (0.0009) [2023-12-26 03:06:39,254][123091] Updated weights for policy 0, policy_version 441481 (0.0009) [2023-12-26 03:06:39,265][123090] Updated weights for policy 1, policy_version 438692 (0.0010) [2023-12-26 03:06:39,326][123090] Updated weights for policy 1, policy_version 438702 (0.0011) [2023-12-26 03:06:39,400][123090] Updated weights for policy 1, policy_version 438712 (0.0011) [2023-12-26 03:06:40,103][123091] Updated weights for policy 0, policy_version 441491 (0.0008) [2023-12-26 03:06:40,172][123091] Updated weights for policy 0, policy_version 441501 (0.0009) [2023-12-26 03:06:40,234][123090] Updated weights for policy 1, policy_version 438722 (0.0011) [2023-12-26 03:06:40,237][123091] Updated weights for policy 0, policy_version 441511 (0.0009) [2023-12-26 03:06:40,302][123090] Updated weights for policy 1, policy_version 438732 (0.0011) [2023-12-26 03:06:40,375][123090] Updated weights for policy 1, policy_version 438742 (0.0011) [2023-12-26 03:06:40,443][123090] Updated weights for policy 1, policy_version 438752 (0.0011) [2023-12-26 03:06:41,089][123091] Updated weights for policy 0, policy_version 441521 (0.0007) [2023-12-26 03:06:41,154][123091] Updated weights for policy 0, policy_version 441531 (0.0009) [2023-12-26 03:06:41,222][123091] Updated weights for policy 0, policy_version 441541 (0.0008) [2023-12-26 03:06:41,271][123090] Updated weights for policy 1, policy_version 438762 (0.0010) [2023-12-26 03:06:41,292][123091] Updated weights for policy 0, policy_version 441551 (0.0007) [2023-12-26 03:06:41,339][123090] Updated weights for policy 1, policy_version 438772 (0.0011) [2023-12-26 03:06:41,422][123090] Updated weights for policy 1, policy_version 438782 (0.0010) [2023-12-26 03:06:42,154][123091] Updated weights for policy 0, policy_version 441561 (0.0009) [2023-12-26 03:06:42,217][123091] Updated weights for policy 0, policy_version 441571 (0.0008) [2023-12-26 03:06:42,231][123090] Updated weights for policy 1, policy_version 438792 (0.0010) [2023-12-26 03:06:42,281][123091] Updated weights for policy 0, policy_version 441581 (0.0007) [2023-12-26 03:06:42,288][123090] Updated weights for policy 1, policy_version 438802 (0.0010) [2023-12-26 03:06:42,361][123090] Updated weights for policy 1, policy_version 438812 (0.0011) [2023-12-26 03:06:42,981][123091] Updated weights for policy 0, policy_version 441591 (0.0008) [2023-12-26 03:06:43,047][123091] Updated weights for policy 0, policy_version 441601 (0.0008) [2023-12-26 03:06:43,114][123091] Updated weights for policy 0, policy_version 441611 (0.0008) [2023-12-26 03:06:43,158][123090] Updated weights for policy 1, policy_version 438822 (0.0010) [2023-12-26 03:06:43,217][123090] Updated weights for policy 1, policy_version 438832 (0.0010) [2023-12-26 03:06:43,274][123090] Updated weights for policy 1, policy_version 438842 (0.0006) [2023-12-26 03:06:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 225402880. Throughput: 0: 8877.0, 1: 8861.5. Samples: 225398492. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:43,785][121949] Avg episode reward: [(0, '6070.746'), (1, '5522.966')] [2023-12-26 03:06:43,801][123091] Updated weights for policy 0, policy_version 441621 (0.0009) [2023-12-26 03:06:43,853][123091] Updated weights for policy 0, policy_version 441631 (0.0009) [2023-12-26 03:06:43,910][123091] Updated weights for policy 0, policy_version 441641 (0.0009) [2023-12-26 03:06:43,995][123090] Updated weights for policy 1, policy_version 438852 (0.0006) [2023-12-26 03:06:44,048][123090] Updated weights for policy 1, policy_version 438862 (0.0005) [2023-12-26 03:06:44,122][123090] Updated weights for policy 1, policy_version 438872 (0.0005) [2023-12-26 03:06:44,592][123091] Updated weights for policy 0, policy_version 441651 (0.0006) [2023-12-26 03:06:44,643][123091] Updated weights for policy 0, policy_version 441661 (0.0007) [2023-12-26 03:06:44,697][123091] Updated weights for policy 0, policy_version 441671 (0.0006) [2023-12-26 03:06:44,986][123090] Updated weights for policy 1, policy_version 438882 (0.0006) [2023-12-26 03:06:45,050][123090] Updated weights for policy 1, policy_version 438892 (0.0010) [2023-12-26 03:06:45,105][123090] Updated weights for policy 1, policy_version 438902 (0.0009) [2023-12-26 03:06:45,161][123090] Updated weights for policy 1, policy_version 438912 (0.0009) [2023-12-26 03:06:45,475][123091] Updated weights for policy 0, policy_version 441681 (0.0006) [2023-12-26 03:06:45,538][123091] Updated weights for policy 0, policy_version 441691 (0.0010) [2023-12-26 03:06:45,596][123091] Updated weights for policy 0, policy_version 441701 (0.0009) [2023-12-26 03:06:45,655][123091] Updated weights for policy 0, policy_version 441711 (0.0009) [2023-12-26 03:06:45,985][123090] Updated weights for policy 1, policy_version 438922 (0.0009) [2023-12-26 03:06:46,046][123090] Updated weights for policy 1, policy_version 438932 (0.0010) [2023-12-26 03:06:46,115][123090] Updated weights for policy 1, policy_version 438942 (0.0009) [2023-12-26 03:06:46,491][123091] Updated weights for policy 0, policy_version 441721 (0.0009) [2023-12-26 03:06:46,555][123091] Updated weights for policy 0, policy_version 441731 (0.0009) [2023-12-26 03:06:46,612][123091] Updated weights for policy 0, policy_version 441741 (0.0009) [2023-12-26 03:06:46,919][123090] Updated weights for policy 1, policy_version 438952 (0.0009) [2023-12-26 03:06:46,975][123090] Updated weights for policy 1, policy_version 438962 (0.0009) [2023-12-26 03:06:47,024][123090] Updated weights for policy 1, policy_version 438972 (0.0009) [2023-12-26 03:06:47,426][123091] Updated weights for policy 0, policy_version 441751 (0.0007) [2023-12-26 03:06:47,490][123091] Updated weights for policy 0, policy_version 441761 (0.0005) [2023-12-26 03:06:47,549][123091] Updated weights for policy 0, policy_version 441771 (0.0005) [2023-12-26 03:06:47,934][123090] Updated weights for policy 1, policy_version 438982 (0.0010) [2023-12-26 03:06:47,992][123090] Updated weights for policy 1, policy_version 438992 (0.0010) [2023-12-26 03:06:48,057][123090] Updated weights for policy 1, policy_version 439002 (0.0010) [2023-12-26 03:06:48,171][123091] Updated weights for policy 0, policy_version 441781 (0.0005) [2023-12-26 03:06:48,224][123091] Updated weights for policy 0, policy_version 441791 (0.0008) [2023-12-26 03:06:48,277][123091] Updated weights for policy 0, policy_version 441801 (0.0010) [2023-12-26 03:06:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 225492992. Throughput: 0: 8960.7, 1: 8819.3. Samples: 225506664. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:48,784][121949] Avg episode reward: [(0, '5957.447'), (1, '5565.139')] [2023-12-26 03:06:48,917][123090] Updated weights for policy 1, policy_version 439012 (0.0010) [2023-12-26 03:06:48,970][123090] Updated weights for policy 1, policy_version 439022 (0.0008) [2023-12-26 03:06:49,019][123090] Updated weights for policy 1, policy_version 439032 (0.0009) [2023-12-26 03:06:49,092][123091] Updated weights for policy 0, policy_version 441811 (0.0009) [2023-12-26 03:06:49,146][123091] Updated weights for policy 0, policy_version 441821 (0.0009) [2023-12-26 03:06:49,203][123091] Updated weights for policy 0, policy_version 441831 (0.0009) [2023-12-26 03:06:49,833][123090] Updated weights for policy 1, policy_version 439042 (0.0009) [2023-12-26 03:06:49,894][123090] Updated weights for policy 1, policy_version 439052 (0.0010) [2023-12-26 03:06:49,961][123090] Updated weights for policy 1, policy_version 439062 (0.0009) [2023-12-26 03:06:50,014][123090] Updated weights for policy 1, policy_version 439072 (0.0009) [2023-12-26 03:06:50,089][123091] Updated weights for policy 0, policy_version 441841 (0.0010) [2023-12-26 03:06:50,151][123091] Updated weights for policy 0, policy_version 441851 (0.0009) [2023-12-26 03:06:50,208][123091] Updated weights for policy 0, policy_version 441861 (0.0009) [2023-12-26 03:06:50,257][123091] Updated weights for policy 0, policy_version 441871 (0.0009) [2023-12-26 03:06:50,897][123090] Updated weights for policy 1, policy_version 439082 (0.0009) [2023-12-26 03:06:50,969][123090] Updated weights for policy 1, policy_version 439092 (0.0011) [2023-12-26 03:06:51,050][123090] Updated weights for policy 1, policy_version 439102 (0.0011) [2023-12-26 03:06:51,148][123091] Updated weights for policy 0, policy_version 441881 (0.0009) [2023-12-26 03:06:51,200][123091] Updated weights for policy 0, policy_version 441891 (0.0009) [2023-12-26 03:06:51,263][123091] Updated weights for policy 0, policy_version 441901 (0.0009) [2023-12-26 03:06:51,844][123090] Updated weights for policy 1, policy_version 439112 (0.0010) [2023-12-26 03:06:51,896][123090] Updated weights for policy 1, policy_version 439122 (0.0010) [2023-12-26 03:06:51,952][123090] Updated weights for policy 1, policy_version 439132 (0.0010) [2023-12-26 03:06:52,150][123091] Updated weights for policy 0, policy_version 441911 (0.0009) [2023-12-26 03:06:52,202][123091] Updated weights for policy 0, policy_version 441921 (0.0009) [2023-12-26 03:06:52,263][123091] Updated weights for policy 0, policy_version 441931 (0.0009) [2023-12-26 03:06:52,796][123090] Updated weights for policy 1, policy_version 439142 (0.0010) [2023-12-26 03:06:52,847][123090] Updated weights for policy 1, policy_version 439152 (0.0010) [2023-12-26 03:06:52,902][123090] Updated weights for policy 1, policy_version 439162 (0.0010) [2023-12-26 03:06:53,097][123091] Updated weights for policy 0, policy_version 441941 (0.0007) [2023-12-26 03:06:53,151][123091] Updated weights for policy 0, policy_version 441951 (0.0005) [2023-12-26 03:06:53,209][123091] Updated weights for policy 0, policy_version 441961 (0.0005) [2023-12-26 03:06:53,738][123090] Updated weights for policy 1, policy_version 439172 (0.0010) [2023-12-26 03:06:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 225574912. Throughput: 0: 8951.2, 1: 8804.8. Samples: 225556664. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:53,784][121949] Avg episode reward: [(0, '5960.748'), (1, '5721.032')] [2023-12-26 03:06:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000441968_113147904.pth... [2023-12-26 03:06:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000440944_112885760.pth [2023-12-26 03:06:53,811][123090] Updated weights for policy 1, policy_version 439182 (0.0010) [2023-12-26 03:06:53,860][123091] Updated weights for policy 0, policy_version 441971 (0.0005) [2023-12-26 03:06:53,877][123090] Updated weights for policy 1, policy_version 439192 (0.0010) [2023-12-26 03:06:53,911][123091] Updated weights for policy 0, policy_version 441981 (0.0006) [2023-12-26 03:06:53,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000439200_112435200.pth... [2023-12-26 03:06:53,933][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000438144_112164864.pth [2023-12-26 03:06:53,963][123091] Updated weights for policy 0, policy_version 441991 (0.0006) [2023-12-26 03:06:54,667][123091] Updated weights for policy 0, policy_version 442001 (0.0008) [2023-12-26 03:06:54,670][123090] Updated weights for policy 1, policy_version 439202 (0.0011) [2023-12-26 03:06:54,721][123091] Updated weights for policy 0, policy_version 442011 (0.0005) [2023-12-26 03:06:54,726][123090] Updated weights for policy 1, policy_version 439212 (0.0010) [2023-12-26 03:06:54,773][123091] Updated weights for policy 0, policy_version 442021 (0.0006) [2023-12-26 03:06:54,783][123090] Updated weights for policy 1, policy_version 439222 (0.0011) [2023-12-26 03:06:54,822][123091] Updated weights for policy 0, policy_version 442031 (0.0006) [2023-12-26 03:06:54,835][123090] Updated weights for policy 1, policy_version 439232 (0.0010) [2023-12-26 03:06:55,497][123091] Updated weights for policy 0, policy_version 442041 (0.0010) [2023-12-26 03:06:55,560][123091] Updated weights for policy 0, policy_version 442051 (0.0010) [2023-12-26 03:06:55,622][123091] Updated weights for policy 0, policy_version 442061 (0.0011) [2023-12-26 03:06:55,657][123090] Updated weights for policy 1, policy_version 439242 (0.0008) [2023-12-26 03:06:55,712][123090] Updated weights for policy 1, policy_version 439252 (0.0006) [2023-12-26 03:06:55,759][123090] Updated weights for policy 1, policy_version 439262 (0.0005) [2023-12-26 03:06:56,403][123091] Updated weights for policy 0, policy_version 442071 (0.0011) [2023-12-26 03:06:56,451][123091] Updated weights for policy 0, policy_version 442081 (0.0010) [2023-12-26 03:06:56,471][123090] Updated weights for policy 1, policy_version 439272 (0.0005) [2023-12-26 03:06:56,509][123091] Updated weights for policy 0, policy_version 442091 (0.0011) [2023-12-26 03:06:56,527][123090] Updated weights for policy 1, policy_version 439282 (0.0005) [2023-12-26 03:06:56,581][123090] Updated weights for policy 1, policy_version 439292 (0.0005) [2023-12-26 03:06:57,197][123091] Updated weights for policy 0, policy_version 442101 (0.0008) [2023-12-26 03:06:57,256][123091] Updated weights for policy 0, policy_version 442111 (0.0005) [2023-12-26 03:06:57,312][123090] Updated weights for policy 1, policy_version 439302 (0.0008) [2023-12-26 03:06:57,322][123091] Updated weights for policy 0, policy_version 442121 (0.0006) [2023-12-26 03:06:57,363][123090] Updated weights for policy 1, policy_version 439312 (0.0010) [2023-12-26 03:06:57,411][123090] Updated weights for policy 1, policy_version 439322 (0.0009) [2023-12-26 03:06:57,948][123091] Updated weights for policy 0, policy_version 442131 (0.0010) [2023-12-26 03:06:58,006][123091] Updated weights for policy 0, policy_version 442141 (0.0010) [2023-12-26 03:06:58,068][123091] Updated weights for policy 0, policy_version 442151 (0.0010) [2023-12-26 03:06:58,117][123090] Updated weights for policy 1, policy_version 439332 (0.0007) [2023-12-26 03:06:58,180][123090] Updated weights for policy 1, policy_version 439342 (0.0010) [2023-12-26 03:06:58,245][123090] Updated weights for policy 1, policy_version 439352 (0.0009) [2023-12-26 03:06:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 225673216. Throughput: 0: 9080.1, 1: 8868.6. Samples: 225668140. Policy #0 lag: (min: 25.0, avg: 46.5, max: 57.0) [2023-12-26 03:06:58,785][121949] Avg episode reward: [(0, '6069.672'), (1, '5771.363')] [2023-12-26 03:06:58,956][123091] Updated weights for policy 0, policy_version 442161 (0.0008) [2023-12-26 03:06:59,016][123091] Updated weights for policy 0, policy_version 442171 (0.0009) [2023-12-26 03:06:59,080][123091] Updated weights for policy 0, policy_version 442181 (0.0009) [2023-12-26 03:06:59,139][123091] Updated weights for policy 0, policy_version 442191 (0.0009) [2023-12-26 03:06:59,146][123090] Updated weights for policy 1, policy_version 439362 (0.0010) [2023-12-26 03:06:59,207][123090] Updated weights for policy 1, policy_version 439372 (0.0010) [2023-12-26 03:06:59,283][123090] Updated weights for policy 1, policy_version 439382 (0.0010) [2023-12-26 03:06:59,350][123090] Updated weights for policy 1, policy_version 439392 (0.0010) [2023-12-26 03:06:59,939][123091] Updated weights for policy 0, policy_version 442201 (0.0009) [2023-12-26 03:07:00,006][123091] Updated weights for policy 0, policy_version 442211 (0.0009) [2023-12-26 03:07:00,063][123091] Updated weights for policy 0, policy_version 442221 (0.0009) [2023-12-26 03:07:00,192][123090] Updated weights for policy 1, policy_version 439402 (0.0005) [2023-12-26 03:07:00,254][123090] Updated weights for policy 1, policy_version 439412 (0.0005) [2023-12-26 03:07:00,312][123090] Updated weights for policy 1, policy_version 439422 (0.0005) [2023-12-26 03:07:00,974][123090] Updated weights for policy 1, policy_version 439432 (0.0005) [2023-12-26 03:07:00,985][123091] Updated weights for policy 0, policy_version 442231 (0.0008) [2023-12-26 03:07:01,051][123091] Updated weights for policy 0, policy_version 442241 (0.0008) [2023-12-26 03:07:01,051][123090] Updated weights for policy 1, policy_version 439442 (0.0007) [2023-12-26 03:07:01,104][123091] Updated weights for policy 0, policy_version 442251 (0.0009) [2023-12-26 03:07:01,109][123090] Updated weights for policy 1, policy_version 439452 (0.0005) [2023-12-26 03:07:01,889][123091] Updated weights for policy 0, policy_version 442261 (0.0009) [2023-12-26 03:07:01,904][123090] Updated weights for policy 1, policy_version 439462 (0.0007) [2023-12-26 03:07:01,954][123091] Updated weights for policy 0, policy_version 442271 (0.0009) [2023-12-26 03:07:01,955][123090] Updated weights for policy 1, policy_version 439472 (0.0008) [2023-12-26 03:07:02,002][123090] Updated weights for policy 1, policy_version 439482 (0.0009) [2023-12-26 03:07:02,010][123091] Updated weights for policy 0, policy_version 442281 (0.0008) [2023-12-26 03:07:02,795][123090] Updated weights for policy 1, policy_version 439492 (0.0007) [2023-12-26 03:07:02,839][123091] Updated weights for policy 0, policy_version 442291 (0.0009) [2023-12-26 03:07:02,848][123090] Updated weights for policy 1, policy_version 439502 (0.0005) [2023-12-26 03:07:02,888][123091] Updated weights for policy 0, policy_version 442301 (0.0009) [2023-12-26 03:07:02,912][123090] Updated weights for policy 1, policy_version 439512 (0.0005) [2023-12-26 03:07:02,936][123091] Updated weights for policy 0, policy_version 442311 (0.0009) [2023-12-26 03:07:03,501][123090] Updated weights for policy 1, policy_version 439522 (0.0005) [2023-12-26 03:07:03,559][123090] Updated weights for policy 1, policy_version 439532 (0.0005) [2023-12-26 03:07:03,612][123090] Updated weights for policy 1, policy_version 439542 (0.0005) [2023-12-26 03:07:03,657][123090] Updated weights for policy 1, policy_version 439552 (0.0005) [2023-12-26 03:07:03,748][123091] Updated weights for policy 0, policy_version 442321 (0.0009) [2023-12-26 03:07:03,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 225763328. Throughput: 0: 8958.0, 1: 8995.4. Samples: 225774916. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:03,785][121949] Avg episode reward: [(0, '5907.545'), (1, '5648.167')] [2023-12-26 03:07:03,806][123091] Updated weights for policy 0, policy_version 442331 (0.0005) [2023-12-26 03:07:03,872][123091] Updated weights for policy 0, policy_version 442341 (0.0007) [2023-12-26 03:07:03,933][123091] Updated weights for policy 0, policy_version 442351 (0.0008) [2023-12-26 03:07:04,399][123090] Updated weights for policy 1, policy_version 439562 (0.0010) [2023-12-26 03:07:04,451][123090] Updated weights for policy 1, policy_version 439572 (0.0010) [2023-12-26 03:07:04,503][123090] Updated weights for policy 1, policy_version 439582 (0.0009) [2023-12-26 03:07:04,663][123091] Updated weights for policy 0, policy_version 442361 (0.0006) [2023-12-26 03:07:04,711][123091] Updated weights for policy 0, policy_version 442371 (0.0005) [2023-12-26 03:07:04,760][123091] Updated weights for policy 0, policy_version 442381 (0.0007) [2023-12-26 03:07:05,278][123090] Updated weights for policy 1, policy_version 439592 (0.0006) [2023-12-26 03:07:05,341][123090] Updated weights for policy 1, policy_version 439602 (0.0005) [2023-12-26 03:07:05,408][123090] Updated weights for policy 1, policy_version 439612 (0.0005) [2023-12-26 03:07:05,527][123091] Updated weights for policy 0, policy_version 442391 (0.0010) [2023-12-26 03:07:05,588][123091] Updated weights for policy 0, policy_version 442401 (0.0010) [2023-12-26 03:07:05,650][123091] Updated weights for policy 0, policy_version 442411 (0.0010) [2023-12-26 03:07:06,088][123090] Updated weights for policy 1, policy_version 439622 (0.0008) [2023-12-26 03:07:06,154][123090] Updated weights for policy 1, policy_version 439632 (0.0010) [2023-12-26 03:07:06,220][123090] Updated weights for policy 1, policy_version 439642 (0.0008) [2023-12-26 03:07:06,475][123091] Updated weights for policy 0, policy_version 442421 (0.0010) [2023-12-26 03:07:06,526][123091] Updated weights for policy 0, policy_version 442431 (0.0010) [2023-12-26 03:07:06,589][123091] Updated weights for policy 0, policy_version 442441 (0.0010) [2023-12-26 03:07:06,994][123090] Updated weights for policy 1, policy_version 439652 (0.0007) [2023-12-26 03:07:07,059][123090] Updated weights for policy 1, policy_version 439662 (0.0005) [2023-12-26 03:07:07,124][123090] Updated weights for policy 1, policy_version 439672 (0.0005) [2023-12-26 03:07:07,434][123091] Updated weights for policy 0, policy_version 442451 (0.0011) [2023-12-26 03:07:07,489][123091] Updated weights for policy 0, policy_version 442461 (0.0010) [2023-12-26 03:07:07,544][123091] Updated weights for policy 0, policy_version 442471 (0.0010) [2023-12-26 03:07:07,791][123090] Updated weights for policy 1, policy_version 439682 (0.0005) [2023-12-26 03:07:07,856][123090] Updated weights for policy 1, policy_version 439692 (0.0005) [2023-12-26 03:07:07,917][123090] Updated weights for policy 1, policy_version 439702 (0.0005) [2023-12-26 03:07:07,995][123090] Updated weights for policy 1, policy_version 439712 (0.0005) [2023-12-26 03:07:08,289][123091] Updated weights for policy 0, policy_version 442481 (0.0010) [2023-12-26 03:07:08,354][123091] Updated weights for policy 0, policy_version 442491 (0.0008) [2023-12-26 03:07:08,419][123091] Updated weights for policy 0, policy_version 442501 (0.0009) [2023-12-26 03:07:08,478][123091] Updated weights for policy 0, policy_version 442511 (0.0009) [2023-12-26 03:07:08,669][123090] Updated weights for policy 1, policy_version 439722 (0.0006) [2023-12-26 03:07:08,732][123090] Updated weights for policy 1, policy_version 439732 (0.0006) [2023-12-26 03:07:08,782][123090] Updated weights for policy 1, policy_version 439742 (0.0005) [2023-12-26 03:07:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 225853440. Throughput: 0: 9027.3, 1: 9056.4. Samples: 225830976. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:08,785][121949] Avg episode reward: [(0, '5964.458'), (1, '5548.798')] [2023-12-26 03:07:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000442512_113287168.pth... [2023-12-26 03:07:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000439744_112574464.pth... [2023-12-26 03:07:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000441456_113016832.pth [2023-12-26 03:07:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000438688_112304128.pth [2023-12-26 03:07:09,358][123091] Updated weights for policy 0, policy_version 442521 (0.0010) [2023-12-26 03:07:09,432][123091] Updated weights for policy 0, policy_version 442531 (0.0010) [2023-12-26 03:07:09,498][123091] Updated weights for policy 0, policy_version 442541 (0.0009) [2023-12-26 03:07:09,553][123090] Updated weights for policy 1, policy_version 439752 (0.0009) [2023-12-26 03:07:09,625][123090] Updated weights for policy 1, policy_version 439762 (0.0006) [2023-12-26 03:07:09,693][123090] Updated weights for policy 1, policy_version 439772 (0.0005) [2023-12-26 03:07:10,410][123091] Updated weights for policy 0, policy_version 442551 (0.0010) [2023-12-26 03:07:10,456][123090] Updated weights for policy 1, policy_version 439782 (0.0007) [2023-12-26 03:07:10,472][123091] Updated weights for policy 0, policy_version 442561 (0.0008) [2023-12-26 03:07:10,524][123090] Updated weights for policy 1, policy_version 439792 (0.0008) [2023-12-26 03:07:10,531][123091] Updated weights for policy 0, policy_version 442571 (0.0009) [2023-12-26 03:07:10,580][123090] Updated weights for policy 1, policy_version 439802 (0.0007) [2023-12-26 03:07:11,337][123090] Updated weights for policy 1, policy_version 439812 (0.0006) [2023-12-26 03:07:11,407][123090] Updated weights for policy 1, policy_version 439822 (0.0009) [2023-12-26 03:07:11,457][123091] Updated weights for policy 0, policy_version 442581 (0.0008) [2023-12-26 03:07:11,470][123090] Updated weights for policy 1, policy_version 439832 (0.0008) [2023-12-26 03:07:11,504][123091] Updated weights for policy 0, policy_version 442591 (0.0009) [2023-12-26 03:07:11,553][123091] Updated weights for policy 0, policy_version 442601 (0.0009) [2023-12-26 03:07:12,277][123090] Updated weights for policy 1, policy_version 439842 (0.0008) [2023-12-26 03:07:12,349][123090] Updated weights for policy 1, policy_version 439852 (0.0009) [2023-12-26 03:07:12,412][123090] Updated weights for policy 1, policy_version 439862 (0.0008) [2023-12-26 03:07:12,461][123091] Updated weights for policy 0, policy_version 442611 (0.0008) [2023-12-26 03:07:12,476][123090] Updated weights for policy 1, policy_version 439872 (0.0008) [2023-12-26 03:07:12,525][123091] Updated weights for policy 0, policy_version 442621 (0.0010) [2023-12-26 03:07:12,588][123091] Updated weights for policy 0, policy_version 442631 (0.0010) [2023-12-26 03:07:13,322][123090] Updated weights for policy 1, policy_version 439882 (0.0007) [2023-12-26 03:07:13,393][123090] Updated weights for policy 1, policy_version 439892 (0.0007) [2023-12-26 03:07:13,403][123091] Updated weights for policy 0, policy_version 442641 (0.0009) [2023-12-26 03:07:13,450][123090] Updated weights for policy 1, policy_version 439902 (0.0006) [2023-12-26 03:07:13,462][123091] Updated weights for policy 0, policy_version 442651 (0.0006) [2023-12-26 03:07:13,524][123091] Updated weights for policy 0, policy_version 442661 (0.0006) [2023-12-26 03:07:13,583][123091] Updated weights for policy 0, policy_version 442671 (0.0009) [2023-12-26 03:07:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 225943552. Throughput: 0: 8827.4, 1: 8971.9. Samples: 225935628. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:13,785][121949] Avg episode reward: [(0, '6120.791'), (1, '5497.145')] [2023-12-26 03:07:14,202][123091] Updated weights for policy 0, policy_version 442681 (0.0006) [2023-12-26 03:07:14,249][123090] Updated weights for policy 1, policy_version 439912 (0.0007) [2023-12-26 03:07:14,268][123091] Updated weights for policy 0, policy_version 442691 (0.0008) [2023-12-26 03:07:14,310][123090] Updated weights for policy 1, policy_version 439922 (0.0008) [2023-12-26 03:07:14,332][123091] Updated weights for policy 0, policy_version 442701 (0.0007) [2023-12-26 03:07:14,373][123090] Updated weights for policy 1, policy_version 439932 (0.0009) [2023-12-26 03:07:14,984][123091] Updated weights for policy 0, policy_version 442711 (0.0010) [2023-12-26 03:07:15,065][123091] Updated weights for policy 0, policy_version 442721 (0.0010) [2023-12-26 03:07:15,144][123091] Updated weights for policy 0, policy_version 442731 (0.0010) [2023-12-26 03:07:15,250][123090] Updated weights for policy 1, policy_version 439942 (0.0008) [2023-12-26 03:07:15,324][123090] Updated weights for policy 1, policy_version 439952 (0.0007) [2023-12-26 03:07:15,395][123090] Updated weights for policy 1, policy_version 439962 (0.0008) [2023-12-26 03:07:15,914][123091] Updated weights for policy 0, policy_version 442741 (0.0010) [2023-12-26 03:07:15,975][123091] Updated weights for policy 0, policy_version 442751 (0.0009) [2023-12-26 03:07:16,045][123091] Updated weights for policy 0, policy_version 442761 (0.0010) [2023-12-26 03:07:16,122][123090] Updated weights for policy 1, policy_version 439972 (0.0008) [2023-12-26 03:07:16,175][123090] Updated weights for policy 1, policy_version 439982 (0.0005) [2023-12-26 03:07:16,222][123090] Updated weights for policy 1, policy_version 439992 (0.0005) [2023-12-26 03:07:16,903][123091] Updated weights for policy 0, policy_version 442771 (0.0008) [2023-12-26 03:07:16,953][123091] Updated weights for policy 0, policy_version 442781 (0.0007) [2023-12-26 03:07:16,990][123090] Updated weights for policy 1, policy_version 440002 (0.0006) [2023-12-26 03:07:16,999][123091] Updated weights for policy 0, policy_version 442791 (0.0009) [2023-12-26 03:07:17,051][123090] Updated weights for policy 1, policy_version 440012 (0.0010) [2023-12-26 03:07:17,119][123090] Updated weights for policy 1, policy_version 440022 (0.0009) [2023-12-26 03:07:17,177][123090] Updated weights for policy 1, policy_version 440032 (0.0008) [2023-12-26 03:07:17,852][123091] Updated weights for policy 0, policy_version 442801 (0.0009) [2023-12-26 03:07:17,909][123091] Updated weights for policy 0, policy_version 442811 (0.0010) [2023-12-26 03:07:17,953][123090] Updated weights for policy 1, policy_version 440042 (0.0005) [2023-12-26 03:07:17,957][123091] Updated weights for policy 0, policy_version 442821 (0.0008) [2023-12-26 03:07:18,003][123090] Updated weights for policy 1, policy_version 440052 (0.0006) [2023-12-26 03:07:18,008][123091] Updated weights for policy 0, policy_version 442831 (0.0009) [2023-12-26 03:07:18,061][123090] Updated weights for policy 1, policy_version 440062 (0.0010) [2023-12-26 03:07:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 226025472. Throughput: 0: 8806.8, 1: 8887.2. Samples: 226041764. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:18,785][121949] Avg episode reward: [(0, '6046.473'), (1, '5443.111')] [2023-12-26 03:07:18,873][123091] Updated weights for policy 0, policy_version 442841 (0.0009) [2023-12-26 03:07:18,915][123090] Updated weights for policy 1, policy_version 440072 (0.0008) [2023-12-26 03:07:18,939][123091] Updated weights for policy 0, policy_version 442851 (0.0010) [2023-12-26 03:07:18,972][123090] Updated weights for policy 1, policy_version 440082 (0.0008) [2023-12-26 03:07:18,998][123091] Updated weights for policy 0, policy_version 442861 (0.0007) [2023-12-26 03:07:19,028][123090] Updated weights for policy 1, policy_version 440092 (0.0009) [2023-12-26 03:07:19,794][123091] Updated weights for policy 0, policy_version 442871 (0.0010) [2023-12-26 03:07:19,819][123090] Updated weights for policy 1, policy_version 440102 (0.0008) [2023-12-26 03:07:19,863][123091] Updated weights for policy 0, policy_version 442881 (0.0009) [2023-12-26 03:07:19,893][123090] Updated weights for policy 1, policy_version 440112 (0.0009) [2023-12-26 03:07:19,929][123091] Updated weights for policy 0, policy_version 442891 (0.0008) [2023-12-26 03:07:19,964][123090] Updated weights for policy 1, policy_version 440122 (0.0010) [2023-12-26 03:07:20,712][123091] Updated weights for policy 0, policy_version 442901 (0.0009) [2023-12-26 03:07:20,777][123091] Updated weights for policy 0, policy_version 442911 (0.0009) [2023-12-26 03:07:20,805][123090] Updated weights for policy 1, policy_version 440132 (0.0008) [2023-12-26 03:07:20,842][123091] Updated weights for policy 0, policy_version 442921 (0.0008) [2023-12-26 03:07:20,867][123090] Updated weights for policy 1, policy_version 440142 (0.0005) [2023-12-26 03:07:20,937][123090] Updated weights for policy 1, policy_version 440152 (0.0007) [2023-12-26 03:07:21,704][123090] Updated weights for policy 1, policy_version 440162 (0.0008) [2023-12-26 03:07:21,780][123090] Updated weights for policy 1, policy_version 440172 (0.0008) [2023-12-26 03:07:21,799][123091] Updated weights for policy 0, policy_version 442931 (0.0009) [2023-12-26 03:07:21,842][123090] Updated weights for policy 1, policy_version 440182 (0.0008) [2023-12-26 03:07:21,863][123091] Updated weights for policy 0, policy_version 442941 (0.0008) [2023-12-26 03:07:21,898][123090] Updated weights for policy 1, policy_version 440192 (0.0008) [2023-12-26 03:07:21,921][123091] Updated weights for policy 0, policy_version 442951 (0.0008) [2023-12-26 03:07:22,626][123090] Updated weights for policy 1, policy_version 440202 (0.0009) [2023-12-26 03:07:22,694][123090] Updated weights for policy 1, policy_version 440212 (0.0011) [2023-12-26 03:07:22,765][123090] Updated weights for policy 1, policy_version 440222 (0.0009) [2023-12-26 03:07:22,797][123091] Updated weights for policy 0, policy_version 442961 (0.0009) [2023-12-26 03:07:22,870][123091] Updated weights for policy 0, policy_version 442971 (0.0009) [2023-12-26 03:07:22,963][123091] Updated weights for policy 0, policy_version 442981 (0.0009) [2023-12-26 03:07:23,024][123091] Updated weights for policy 0, policy_version 442991 (0.0009) [2023-12-26 03:07:23,527][123090] Updated weights for policy 1, policy_version 440232 (0.0006) [2023-12-26 03:07:23,596][123090] Updated weights for policy 1, policy_version 440242 (0.0006) [2023-12-26 03:07:23,653][123090] Updated weights for policy 1, policy_version 440252 (0.0006) [2023-12-26 03:07:23,746][123091] Updated weights for policy 0, policy_version 443001 (0.0009) [2023-12-26 03:07:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 226115584. Throughput: 0: 8785.9, 1: 8880.1. Samples: 226092992. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:23,785][121949] Avg episode reward: [(0, '6051.193'), (1, '5495.143')] [2023-12-26 03:07:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000440256_112705536.pth... [2023-12-26 03:07:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000439200_112435200.pth [2023-12-26 03:07:23,798][123091] Updated weights for policy 0, policy_version 443011 (0.0009) [2023-12-26 03:07:23,857][123091] Updated weights for policy 0, policy_version 443021 (0.0009) [2023-12-26 03:07:23,872][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000443024_113418240.pth... [2023-12-26 03:07:23,875][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000441968_113147904.pth [2023-12-26 03:07:24,408][123090] Updated weights for policy 1, policy_version 440262 (0.0010) [2023-12-26 03:07:24,466][123090] Updated weights for policy 1, policy_version 440272 (0.0010) [2023-12-26 03:07:24,532][123090] Updated weights for policy 1, policy_version 440282 (0.0010) [2023-12-26 03:07:24,721][123091] Updated weights for policy 0, policy_version 443031 (0.0009) [2023-12-26 03:07:24,774][123091] Updated weights for policy 0, policy_version 443041 (0.0009) [2023-12-26 03:07:24,833][123091] Updated weights for policy 0, policy_version 443051 (0.0010) [2023-12-26 03:07:25,348][123090] Updated weights for policy 1, policy_version 440292 (0.0010) [2023-12-26 03:07:25,414][123090] Updated weights for policy 1, policy_version 440302 (0.0010) [2023-12-26 03:07:25,480][123090] Updated weights for policy 1, policy_version 440312 (0.0010) [2023-12-26 03:07:25,500][123091] Updated weights for policy 0, policy_version 443061 (0.0008) [2023-12-26 03:07:25,556][123091] Updated weights for policy 0, policy_version 443071 (0.0007) [2023-12-26 03:07:25,606][123091] Updated weights for policy 0, policy_version 443081 (0.0010) [2023-12-26 03:07:26,264][123091] Updated weights for policy 0, policy_version 443091 (0.0005) [2023-12-26 03:07:26,266][123090] Updated weights for policy 1, policy_version 440322 (0.0010) [2023-12-26 03:07:26,314][123090] Updated weights for policy 1, policy_version 440332 (0.0010) [2023-12-26 03:07:26,315][123091] Updated weights for policy 0, policy_version 443101 (0.0005) [2023-12-26 03:07:26,361][123090] Updated weights for policy 1, policy_version 440342 (0.0010) [2023-12-26 03:07:26,365][123091] Updated weights for policy 0, policy_version 443111 (0.0007) [2023-12-26 03:07:26,413][123090] Updated weights for policy 1, policy_version 440352 (0.0010) [2023-12-26 03:07:27,030][123091] Updated weights for policy 0, policy_version 443121 (0.0010) [2023-12-26 03:07:27,089][123091] Updated weights for policy 0, policy_version 443131 (0.0006) [2023-12-26 03:07:27,142][123091] Updated weights for policy 0, policy_version 443141 (0.0005) [2023-12-26 03:07:27,196][123091] Updated weights for policy 0, policy_version 443151 (0.0005) [2023-12-26 03:07:27,240][123090] Updated weights for policy 1, policy_version 440362 (0.0010) [2023-12-26 03:07:27,296][123090] Updated weights for policy 1, policy_version 440372 (0.0011) [2023-12-26 03:07:27,356][123090] Updated weights for policy 1, policy_version 440382 (0.0011) [2023-12-26 03:07:27,904][123091] Updated weights for policy 0, policy_version 443161 (0.0009) [2023-12-26 03:07:27,960][123091] Updated weights for policy 0, policy_version 443171 (0.0010) [2023-12-26 03:07:28,026][123091] Updated weights for policy 0, policy_version 443181 (0.0009) [2023-12-26 03:07:28,092][123090] Updated weights for policy 1, policy_version 440392 (0.0006) [2023-12-26 03:07:28,149][123090] Updated weights for policy 1, policy_version 440402 (0.0005) [2023-12-26 03:07:28,201][123090] Updated weights for policy 1, policy_version 440412 (0.0005) [2023-12-26 03:07:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 226205696. Throughput: 0: 8912.6, 1: 8935.6. Samples: 226201664. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:28,785][121949] Avg episode reward: [(0, '6135.266'), (1, '5455.963')] [2023-12-26 03:07:28,818][123091] Updated weights for policy 0, policy_version 443191 (0.0008) [2023-12-26 03:07:28,875][123090] Updated weights for policy 1, policy_version 440422 (0.0005) [2023-12-26 03:07:28,877][123091] Updated weights for policy 0, policy_version 443201 (0.0009) [2023-12-26 03:07:28,938][123091] Updated weights for policy 0, policy_version 443211 (0.0011) [2023-12-26 03:07:28,941][123090] Updated weights for policy 1, policy_version 440432 (0.0006) [2023-12-26 03:07:29,009][123090] Updated weights for policy 1, policy_version 440442 (0.0007) [2023-12-26 03:07:29,729][123091] Updated weights for policy 0, policy_version 443221 (0.0009) [2023-12-26 03:07:29,784][123091] Updated weights for policy 0, policy_version 443231 (0.0006) [2023-12-26 03:07:29,797][123090] Updated weights for policy 1, policy_version 440452 (0.0007) [2023-12-26 03:07:29,845][123091] Updated weights for policy 0, policy_version 443241 (0.0006) [2023-12-26 03:07:29,868][123090] Updated weights for policy 1, policy_version 440462 (0.0008) [2023-12-26 03:07:29,934][123090] Updated weights for policy 1, policy_version 440472 (0.0008) [2023-12-26 03:07:30,658][123091] Updated weights for policy 0, policy_version 443251 (0.0007) [2023-12-26 03:07:30,688][123090] Updated weights for policy 1, policy_version 440482 (0.0007) [2023-12-26 03:07:30,715][123091] Updated weights for policy 0, policy_version 443261 (0.0008) [2023-12-26 03:07:30,747][123090] Updated weights for policy 1, policy_version 440492 (0.0007) [2023-12-26 03:07:30,780][123091] Updated weights for policy 0, policy_version 443271 (0.0008) [2023-12-26 03:07:30,808][123090] Updated weights for policy 1, policy_version 440502 (0.0010) [2023-12-26 03:07:30,871][123090] Updated weights for policy 1, policy_version 440512 (0.0007) [2023-12-26 03:07:31,638][123091] Updated weights for policy 0, policy_version 443281 (0.0007) [2023-12-26 03:07:31,647][123090] Updated weights for policy 1, policy_version 440522 (0.0010) [2023-12-26 03:07:31,703][123091] Updated weights for policy 0, policy_version 443291 (0.0007) [2023-12-26 03:07:31,705][123090] Updated weights for policy 1, policy_version 440532 (0.0009) [2023-12-26 03:07:31,774][123091] Updated weights for policy 0, policy_version 443301 (0.0008) [2023-12-26 03:07:31,776][123090] Updated weights for policy 1, policy_version 440542 (0.0009) [2023-12-26 03:07:31,836][123091] Updated weights for policy 0, policy_version 443311 (0.0008) [2023-12-26 03:07:32,586][123090] Updated weights for policy 1, policy_version 440552 (0.0008) [2023-12-26 03:07:32,611][123091] Updated weights for policy 0, policy_version 443321 (0.0010) [2023-12-26 03:07:32,640][123090] Updated weights for policy 1, policy_version 440562 (0.0010) [2023-12-26 03:07:32,672][123091] Updated weights for policy 0, policy_version 443331 (0.0009) [2023-12-26 03:07:32,696][123090] Updated weights for policy 1, policy_version 440572 (0.0007) [2023-12-26 03:07:32,731][123091] Updated weights for policy 0, policy_version 443341 (0.0008) [2023-12-26 03:07:33,431][123090] Updated weights for policy 1, policy_version 440582 (0.0010) [2023-12-26 03:07:33,488][123090] Updated weights for policy 1, policy_version 440592 (0.0007) [2023-12-26 03:07:33,536][123090] Updated weights for policy 1, policy_version 440602 (0.0005) [2023-12-26 03:07:33,580][123091] Updated weights for policy 0, policy_version 443351 (0.0010) [2023-12-26 03:07:33,638][123091] Updated weights for policy 0, policy_version 443361 (0.0010) [2023-12-26 03:07:33,691][123091] Updated weights for policy 0, policy_version 443371 (0.0010) [2023-12-26 03:07:33,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 226304000. Throughput: 0: 8817.1, 1: 9031.3. Samples: 226309852. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:33,785][121949] Avg episode reward: [(0, '6229.389'), (1, '5647.756')] [2023-12-26 03:07:34,195][123090] Updated weights for policy 1, policy_version 440612 (0.0007) [2023-12-26 03:07:34,251][123090] Updated weights for policy 1, policy_version 440622 (0.0011) [2023-12-26 03:07:34,318][123090] Updated weights for policy 1, policy_version 440632 (0.0011) [2023-12-26 03:07:34,502][123091] Updated weights for policy 0, policy_version 443381 (0.0009) [2023-12-26 03:07:34,568][123091] Updated weights for policy 0, policy_version 443391 (0.0008) [2023-12-26 03:07:34,645][123091] Updated weights for policy 0, policy_version 443401 (0.0005) [2023-12-26 03:07:35,166][123090] Updated weights for policy 1, policy_version 440642 (0.0010) [2023-12-26 03:07:35,226][123090] Updated weights for policy 1, policy_version 440652 (0.0010) [2023-12-26 03:07:35,273][123090] Updated weights for policy 1, policy_version 440662 (0.0010) [2023-12-26 03:07:35,324][123090] Updated weights for policy 1, policy_version 440672 (0.0010) [2023-12-26 03:07:35,414][123091] Updated weights for policy 0, policy_version 443411 (0.0007) [2023-12-26 03:07:35,474][123091] Updated weights for policy 0, policy_version 443421 (0.0009) [2023-12-26 03:07:35,535][123091] Updated weights for policy 0, policy_version 443431 (0.0009) [2023-12-26 03:07:36,047][123090] Updated weights for policy 1, policy_version 440682 (0.0009) [2023-12-26 03:07:36,104][123090] Updated weights for policy 1, policy_version 440692 (0.0009) [2023-12-26 03:07:36,175][123090] Updated weights for policy 1, policy_version 440702 (0.0009) [2023-12-26 03:07:36,402][123091] Updated weights for policy 0, policy_version 443441 (0.0009) [2023-12-26 03:07:36,463][123091] Updated weights for policy 0, policy_version 443451 (0.0010) [2023-12-26 03:07:36,528][123091] Updated weights for policy 0, policy_version 443461 (0.0010) [2023-12-26 03:07:36,603][123091] Updated weights for policy 0, policy_version 443471 (0.0010) [2023-12-26 03:07:36,845][123090] Updated weights for policy 1, policy_version 440712 (0.0005) [2023-12-26 03:07:36,924][123090] Updated weights for policy 1, policy_version 440722 (0.0006) [2023-12-26 03:07:36,992][123090] Updated weights for policy 1, policy_version 440732 (0.0010) [2023-12-26 03:07:37,455][123091] Updated weights for policy 0, policy_version 443481 (0.0010) [2023-12-26 03:07:37,511][123091] Updated weights for policy 0, policy_version 443491 (0.0010) [2023-12-26 03:07:37,565][123091] Updated weights for policy 0, policy_version 443501 (0.0009) [2023-12-26 03:07:37,682][123090] Updated weights for policy 1, policy_version 440742 (0.0007) [2023-12-26 03:07:37,744][123090] Updated weights for policy 1, policy_version 440752 (0.0006) [2023-12-26 03:07:37,806][123090] Updated weights for policy 1, policy_version 440762 (0.0006) [2023-12-26 03:07:38,323][123091] Updated weights for policy 0, policy_version 443511 (0.0007) [2023-12-26 03:07:38,395][123091] Updated weights for policy 0, policy_version 443521 (0.0007) [2023-12-26 03:07:38,458][123091] Updated weights for policy 0, policy_version 443531 (0.0006) [2023-12-26 03:07:38,504][123090] Updated weights for policy 1, policy_version 440772 (0.0005) [2023-12-26 03:07:38,564][123090] Updated weights for policy 1, policy_version 440782 (0.0006) [2023-12-26 03:07:38,633][123090] Updated weights for policy 1, policy_version 440792 (0.0006) [2023-12-26 03:07:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 226394112. Throughput: 0: 8848.4, 1: 9105.1. Samples: 226364568. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:38,785][121949] Avg episode reward: [(0, '6261.258'), (1, '5670.101')] [2023-12-26 03:07:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000443536_113549312.pth... [2023-12-26 03:07:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000440800_112844800.pth... [2023-12-26 03:07:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000439744_112574464.pth [2023-12-26 03:07:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000442512_113287168.pth [2023-12-26 03:07:39,147][123091] Updated weights for policy 0, policy_version 443541 (0.0007) [2023-12-26 03:07:39,206][123091] Updated weights for policy 0, policy_version 443551 (0.0009) [2023-12-26 03:07:39,286][123091] Updated weights for policy 0, policy_version 443561 (0.0010) [2023-12-26 03:07:39,499][123090] Updated weights for policy 1, policy_version 440802 (0.0011) [2023-12-26 03:07:39,560][123090] Updated weights for policy 1, policy_version 440812 (0.0011) [2023-12-26 03:07:39,624][123090] Updated weights for policy 1, policy_version 440822 (0.0011) [2023-12-26 03:07:39,694][123090] Updated weights for policy 1, policy_version 440832 (0.0011) [2023-12-26 03:07:40,158][123091] Updated weights for policy 0, policy_version 443571 (0.0008) [2023-12-26 03:07:40,210][123091] Updated weights for policy 0, policy_version 443581 (0.0009) [2023-12-26 03:07:40,266][123091] Updated weights for policy 0, policy_version 443591 (0.0009) [2023-12-26 03:07:40,559][123090] Updated weights for policy 1, policy_version 440842 (0.0010) [2023-12-26 03:07:40,612][123090] Updated weights for policy 1, policy_version 440852 (0.0010) [2023-12-26 03:07:40,663][123090] Updated weights for policy 1, policy_version 440862 (0.0010) [2023-12-26 03:07:41,120][123091] Updated weights for policy 0, policy_version 443601 (0.0009) [2023-12-26 03:07:41,189][123091] Updated weights for policy 0, policy_version 443611 (0.0009) [2023-12-26 03:07:41,256][123091] Updated weights for policy 0, policy_version 443621 (0.0009) [2023-12-26 03:07:41,324][123091] Updated weights for policy 0, policy_version 443631 (0.0009) [2023-12-26 03:07:41,526][123090] Updated weights for policy 1, policy_version 440872 (0.0010) [2023-12-26 03:07:41,589][123090] Updated weights for policy 1, policy_version 440882 (0.0010) [2023-12-26 03:07:41,655][123090] Updated weights for policy 1, policy_version 440892 (0.0010) [2023-12-26 03:07:42,166][123091] Updated weights for policy 0, policy_version 443641 (0.0009) [2023-12-26 03:07:42,227][123091] Updated weights for policy 0, policy_version 443651 (0.0009) [2023-12-26 03:07:42,292][123091] Updated weights for policy 0, policy_version 443661 (0.0008) [2023-12-26 03:07:42,500][123090] Updated weights for policy 1, policy_version 440902 (0.0010) [2023-12-26 03:07:42,556][123090] Updated weights for policy 1, policy_version 440912 (0.0010) [2023-12-26 03:07:42,608][123090] Updated weights for policy 1, policy_version 440922 (0.0010) [2023-12-26 03:07:43,166][123091] Updated weights for policy 0, policy_version 443671 (0.0009) [2023-12-26 03:07:43,229][123091] Updated weights for policy 0, policy_version 443681 (0.0009) [2023-12-26 03:07:43,293][123091] Updated weights for policy 0, policy_version 443691 (0.0009) [2023-12-26 03:07:43,449][123090] Updated weights for policy 1, policy_version 440932 (0.0010) [2023-12-26 03:07:43,500][123090] Updated weights for policy 1, policy_version 440942 (0.0010) [2023-12-26 03:07:43,552][123090] Updated weights for policy 1, policy_version 440952 (0.0010) [2023-12-26 03:07:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 226476032. Throughput: 0: 8710.6, 1: 9071.5. Samples: 226468340. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:43,785][121949] Avg episode reward: [(0, '6192.685'), (1, '5592.680')] [2023-12-26 03:07:44,075][123091] Updated weights for policy 0, policy_version 443701 (0.0007) [2023-12-26 03:07:44,148][123091] Updated weights for policy 0, policy_version 443711 (0.0008) [2023-12-26 03:07:44,212][123091] Updated weights for policy 0, policy_version 443721 (0.0011) [2023-12-26 03:07:44,396][123090] Updated weights for policy 1, policy_version 440962 (0.0010) [2023-12-26 03:07:44,459][123090] Updated weights for policy 1, policy_version 440972 (0.0011) [2023-12-26 03:07:44,527][123090] Updated weights for policy 1, policy_version 440982 (0.0011) [2023-12-26 03:07:44,595][123090] Updated weights for policy 1, policy_version 440992 (0.0005) [2023-12-26 03:07:44,980][123091] Updated weights for policy 0, policy_version 443731 (0.0010) [2023-12-26 03:07:45,038][123091] Updated weights for policy 0, policy_version 443741 (0.0009) [2023-12-26 03:07:45,095][123091] Updated weights for policy 0, policy_version 443751 (0.0009) [2023-12-26 03:07:45,386][123090] Updated weights for policy 1, policy_version 441002 (0.0006) [2023-12-26 03:07:45,456][123090] Updated weights for policy 1, policy_version 441012 (0.0005) [2023-12-26 03:07:45,517][123090] Updated weights for policy 1, policy_version 441022 (0.0009) [2023-12-26 03:07:45,860][123091] Updated weights for policy 0, policy_version 443761 (0.0009) [2023-12-26 03:07:45,925][123091] Updated weights for policy 0, policy_version 443771 (0.0009) [2023-12-26 03:07:45,985][123091] Updated weights for policy 0, policy_version 443781 (0.0009) [2023-12-26 03:07:46,038][123091] Updated weights for policy 0, policy_version 443791 (0.0009) [2023-12-26 03:07:46,263][123090] Updated weights for policy 1, policy_version 441032 (0.0010) [2023-12-26 03:07:46,329][123090] Updated weights for policy 1, policy_version 441042 (0.0011) [2023-12-26 03:07:46,396][123090] Updated weights for policy 1, policy_version 441052 (0.0010) [2023-12-26 03:07:46,853][123091] Updated weights for policy 0, policy_version 443801 (0.0006) [2023-12-26 03:07:46,923][123091] Updated weights for policy 0, policy_version 443811 (0.0005) [2023-12-26 03:07:46,991][123091] Updated weights for policy 0, policy_version 443821 (0.0005) [2023-12-26 03:07:47,174][123090] Updated weights for policy 1, policy_version 441062 (0.0010) [2023-12-26 03:07:47,232][123090] Updated weights for policy 1, policy_version 441072 (0.0010) [2023-12-26 03:07:47,280][123090] Updated weights for policy 1, policy_version 441082 (0.0010) [2023-12-26 03:07:47,669][123091] Updated weights for policy 0, policy_version 443831 (0.0005) [2023-12-26 03:07:47,740][123091] Updated weights for policy 0, policy_version 443841 (0.0007) [2023-12-26 03:07:47,792][123091] Updated weights for policy 0, policy_version 443851 (0.0009) [2023-12-26 03:07:48,117][123090] Updated weights for policy 1, policy_version 441092 (0.0010) [2023-12-26 03:07:48,169][123090] Updated weights for policy 1, policy_version 441102 (0.0010) [2023-12-26 03:07:48,225][123090] Updated weights for policy 1, policy_version 441112 (0.0010) [2023-12-26 03:07:48,516][123091] Updated weights for policy 0, policy_version 443861 (0.0009) [2023-12-26 03:07:48,578][123091] Updated weights for policy 0, policy_version 443871 (0.0010) [2023-12-26 03:07:48,645][123091] Updated weights for policy 0, policy_version 443881 (0.0010) [2023-12-26 03:07:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 226566144. Throughput: 0: 8770.5, 1: 9001.7. Samples: 226574664. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:48,785][121949] Avg episode reward: [(0, '6097.494'), (1, '5793.022')] [2023-12-26 03:07:48,974][123090] Updated weights for policy 1, policy_version 441122 (0.0011) [2023-12-26 03:07:49,034][123090] Updated weights for policy 1, policy_version 441132 (0.0011) [2023-12-26 03:07:49,094][123090] Updated weights for policy 1, policy_version 441142 (0.0009) [2023-12-26 03:07:49,144][123090] Updated weights for policy 1, policy_version 441152 (0.0009) [2023-12-26 03:07:49,556][123091] Updated weights for policy 0, policy_version 443891 (0.0010) [2023-12-26 03:07:49,618][123091] Updated weights for policy 0, policy_version 443901 (0.0009) [2023-12-26 03:07:49,688][123091] Updated weights for policy 0, policy_version 443911 (0.0009) [2023-12-26 03:07:49,958][123090] Updated weights for policy 1, policy_version 441162 (0.0009) [2023-12-26 03:07:50,015][123090] Updated weights for policy 1, policy_version 441172 (0.0009) [2023-12-26 03:07:50,076][123090] Updated weights for policy 1, policy_version 441182 (0.0010) [2023-12-26 03:07:50,453][123091] Updated weights for policy 0, policy_version 443921 (0.0009) [2023-12-26 03:07:50,509][123091] Updated weights for policy 0, policy_version 443931 (0.0006) [2023-12-26 03:07:50,562][123091] Updated weights for policy 0, policy_version 443941 (0.0006) [2023-12-26 03:07:50,635][123091] Updated weights for policy 0, policy_version 443951 (0.0007) [2023-12-26 03:07:50,896][123090] Updated weights for policy 1, policy_version 441192 (0.0009) [2023-12-26 03:07:50,963][123090] Updated weights for policy 1, policy_version 441202 (0.0010) [2023-12-26 03:07:51,028][123090] Updated weights for policy 1, policy_version 441212 (0.0009) [2023-12-26 03:07:51,338][123091] Updated weights for policy 0, policy_version 443961 (0.0007) [2023-12-26 03:07:51,413][123091] Updated weights for policy 0, policy_version 443971 (0.0006) [2023-12-26 03:07:51,468][123091] Updated weights for policy 0, policy_version 443981 (0.0006) [2023-12-26 03:07:51,895][123090] Updated weights for policy 1, policy_version 441222 (0.0010) [2023-12-26 03:07:51,952][123090] Updated weights for policy 1, policy_version 441232 (0.0010) [2023-12-26 03:07:52,011][123090] Updated weights for policy 1, policy_version 441242 (0.0010) [2023-12-26 03:07:52,234][123091] Updated weights for policy 0, policy_version 443991 (0.0007) [2023-12-26 03:07:52,303][123091] Updated weights for policy 0, policy_version 444001 (0.0009) [2023-12-26 03:07:52,368][123091] Updated weights for policy 0, policy_version 444011 (0.0008) [2023-12-26 03:07:52,889][123090] Updated weights for policy 1, policy_version 441252 (0.0010) [2023-12-26 03:07:52,938][123090] Updated weights for policy 1, policy_version 441262 (0.0009) [2023-12-26 03:07:52,986][123090] Updated weights for policy 1, policy_version 441272 (0.0009) [2023-12-26 03:07:53,115][123091] Updated weights for policy 0, policy_version 444021 (0.0008) [2023-12-26 03:07:53,172][123091] Updated weights for policy 0, policy_version 444031 (0.0010) [2023-12-26 03:07:53,230][123091] Updated weights for policy 0, policy_version 444041 (0.0008) [2023-12-26 03:07:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 226648064. Throughput: 0: 8763.2, 1: 8945.6. Samples: 226627876. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:53,785][121949] Avg episode reward: [(0, '6002.212'), (1, '5770.237')] [2023-12-26 03:07:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000441280_112967680.pth... [2023-12-26 03:07:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000444048_113680384.pth... [2023-12-26 03:07:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000440256_112705536.pth [2023-12-26 03:07:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000443024_113418240.pth [2023-12-26 03:07:53,831][123090] Updated weights for policy 1, policy_version 441282 (0.0008) [2023-12-26 03:07:53,892][123090] Updated weights for policy 1, policy_version 441292 (0.0010) [2023-12-26 03:07:53,945][123090] Updated weights for policy 1, policy_version 441302 (0.0010) [2023-12-26 03:07:53,993][123090] Updated weights for policy 1, policy_version 441312 (0.0009) [2023-12-26 03:07:54,025][123091] Updated weights for policy 0, policy_version 444051 (0.0009) [2023-12-26 03:07:54,091][123091] Updated weights for policy 0, policy_version 444061 (0.0009) [2023-12-26 03:07:54,156][123091] Updated weights for policy 0, policy_version 444071 (0.0009) [2023-12-26 03:07:54,705][123090] Updated weights for policy 1, policy_version 441322 (0.0007) [2023-12-26 03:07:54,760][123090] Updated weights for policy 1, policy_version 441332 (0.0008) [2023-12-26 03:07:54,818][123090] Updated weights for policy 1, policy_version 441342 (0.0009) [2023-12-26 03:07:55,040][123091] Updated weights for policy 0, policy_version 444081 (0.0009) [2023-12-26 03:07:55,094][123091] Updated weights for policy 0, policy_version 444091 (0.0009) [2023-12-26 03:07:55,147][123091] Updated weights for policy 0, policy_version 444101 (0.0007) [2023-12-26 03:07:55,202][123091] Updated weights for policy 0, policy_version 444111 (0.0009) [2023-12-26 03:07:55,597][123090] Updated weights for policy 1, policy_version 441352 (0.0010) [2023-12-26 03:07:55,660][123090] Updated weights for policy 1, policy_version 441362 (0.0011) [2023-12-26 03:07:55,716][123090] Updated weights for policy 1, policy_version 441372 (0.0010) [2023-12-26 03:07:56,058][123091] Updated weights for policy 0, policy_version 444121 (0.0010) [2023-12-26 03:07:56,125][123091] Updated weights for policy 0, policy_version 444131 (0.0010) [2023-12-26 03:07:56,178][123091] Updated weights for policy 0, policy_version 444142 (0.0010) [2023-12-26 03:07:56,436][123090] Updated weights for policy 1, policy_version 441382 (0.0007) [2023-12-26 03:07:56,492][123090] Updated weights for policy 1, policy_version 441392 (0.0005) [2023-12-26 03:07:56,557][123090] Updated weights for policy 1, policy_version 441402 (0.0005) [2023-12-26 03:07:57,096][123091] Updated weights for policy 0, policy_version 444152 (0.0009) [2023-12-26 03:07:57,148][123091] Updated weights for policy 0, policy_version 444162 (0.0009) [2023-12-26 03:07:57,200][123091] Updated weights for policy 0, policy_version 444172 (0.0009) [2023-12-26 03:07:57,227][123090] Updated weights for policy 1, policy_version 441412 (0.0005) [2023-12-26 03:07:57,282][123090] Updated weights for policy 1, policy_version 441422 (0.0005) [2023-12-26 03:07:57,353][123090] Updated weights for policy 1, policy_version 441432 (0.0005) [2023-12-26 03:07:57,967][123090] Updated weights for policy 1, policy_version 441442 (0.0005) [2023-12-26 03:07:58,038][123090] Updated weights for policy 1, policy_version 441452 (0.0008) [2023-12-26 03:07:58,103][123091] Updated weights for policy 0, policy_version 444182 (0.0007) [2023-12-26 03:07:58,108][123090] Updated weights for policy 1, policy_version 441462 (0.0008) [2023-12-26 03:07:58,172][123091] Updated weights for policy 0, policy_version 444192 (0.0006) [2023-12-26 03:07:58,177][123090] Updated weights for policy 1, policy_version 441472 (0.0008) [2023-12-26 03:07:58,242][123091] Updated weights for policy 0, policy_version 444202 (0.0007) [2023-12-26 03:07:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 226738176. Throughput: 0: 8786.2, 1: 8944.9. Samples: 226733528. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:07:58,785][121949] Avg episode reward: [(0, '6094.834'), (1, '5612.635')] [2023-12-26 03:07:58,986][123090] Updated weights for policy 1, policy_version 441482 (0.0008) [2023-12-26 03:07:59,056][123090] Updated weights for policy 1, policy_version 441493 (0.0008) [2023-12-26 03:07:59,074][123091] Updated weights for policy 0, policy_version 444212 (0.0008) [2023-12-26 03:07:59,121][123090] Updated weights for policy 1, policy_version 441503 (0.0008) [2023-12-26 03:07:59,135][123091] Updated weights for policy 0, policy_version 444222 (0.0009) [2023-12-26 03:07:59,196][123091] Updated weights for policy 0, policy_version 444232 (0.0010) [2023-12-26 03:07:59,958][123090] Updated weights for policy 1, policy_version 441514 (0.0010) [2023-12-26 03:08:00,018][123090] Updated weights for policy 1, policy_version 441524 (0.0009) [2023-12-26 03:08:00,060][123091] Updated weights for policy 0, policy_version 444242 (0.0009) [2023-12-26 03:08:00,075][123090] Updated weights for policy 1, policy_version 441534 (0.0008) [2023-12-26 03:08:00,109][123091] Updated weights for policy 0, policy_version 444252 (0.0008) [2023-12-26 03:08:00,158][123091] Updated weights for policy 0, policy_version 444262 (0.0009) [2023-12-26 03:08:00,216][123091] Updated weights for policy 0, policy_version 444272 (0.0009) [2023-12-26 03:08:00,895][123090] Updated weights for policy 1, policy_version 441544 (0.0008) [2023-12-26 03:08:00,942][123090] Updated weights for policy 1, policy_version 441554 (0.0009) [2023-12-26 03:08:00,986][123090] Updated weights for policy 1, policy_version 441564 (0.0010) [2023-12-26 03:08:01,084][123091] Updated weights for policy 0, policy_version 444282 (0.0011) [2023-12-26 03:08:01,158][123091] Updated weights for policy 0, policy_version 444292 (0.0011) [2023-12-26 03:08:01,212][123091] Updated weights for policy 0, policy_version 444302 (0.0008) [2023-12-26 03:08:01,840][123090] Updated weights for policy 1, policy_version 441574 (0.0009) [2023-12-26 03:08:01,903][123090] Updated weights for policy 1, policy_version 441584 (0.0008) [2023-12-26 03:08:01,956][123091] Updated weights for policy 0, policy_version 444312 (0.0010) [2023-12-26 03:08:01,966][123090] Updated weights for policy 1, policy_version 441594 (0.0006) [2023-12-26 03:08:02,012][123091] Updated weights for policy 0, policy_version 444322 (0.0011) [2023-12-26 03:08:02,064][123091] Updated weights for policy 0, policy_version 444332 (0.0011) [2023-12-26 03:08:02,691][123090] Updated weights for policy 1, policy_version 441604 (0.0007) [2023-12-26 03:08:02,755][123090] Updated weights for policy 1, policy_version 441614 (0.0009) [2023-12-26 03:08:02,835][123090] Updated weights for policy 1, policy_version 441624 (0.0009) [2023-12-26 03:08:02,871][123091] Updated weights for policy 0, policy_version 444342 (0.0010) [2023-12-26 03:08:02,928][123091] Updated weights for policy 0, policy_version 444352 (0.0009) [2023-12-26 03:08:02,982][123091] Updated weights for policy 0, policy_version 444362 (0.0010) [2023-12-26 03:08:03,675][123090] Updated weights for policy 1, policy_version 441634 (0.0007) [2023-12-26 03:08:03,721][123091] Updated weights for policy 0, policy_version 444372 (0.0008) [2023-12-26 03:08:03,741][123090] Updated weights for policy 1, policy_version 441644 (0.0005) [2023-12-26 03:08:03,778][123091] Updated weights for policy 0, policy_version 444382 (0.0005) [2023-12-26 03:08:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 226820096. Throughput: 0: 8773.9, 1: 8941.3. Samples: 226838944. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:08:03,784][121949] Avg episode reward: [(0, '6145.155'), (1, '5584.159')] [2023-12-26 03:08:03,803][123090] Updated weights for policy 1, policy_version 441654 (0.0005) [2023-12-26 03:08:03,835][123091] Updated weights for policy 0, policy_version 444392 (0.0006) [2023-12-26 03:08:03,869][123090] Updated weights for policy 1, policy_version 441664 (0.0006) [2023-12-26 03:08:04,509][123091] Updated weights for policy 0, policy_version 444402 (0.0008) [2023-12-26 03:08:04,577][123091] Updated weights for policy 0, policy_version 444412 (0.0008) [2023-12-26 03:08:04,634][123091] Updated weights for policy 0, policy_version 444422 (0.0006) [2023-12-26 03:08:04,636][123090] Updated weights for policy 1, policy_version 441674 (0.0009) [2023-12-26 03:08:04,685][123090] Updated weights for policy 1, policy_version 441684 (0.0009) [2023-12-26 03:08:04,699][123091] Updated weights for policy 0, policy_version 444432 (0.0005) [2023-12-26 03:08:04,750][123090] Updated weights for policy 1, policy_version 441694 (0.0009) [2023-12-26 03:08:05,352][123091] Updated weights for policy 0, policy_version 444442 (0.0005) [2023-12-26 03:08:05,414][123091] Updated weights for policy 0, policy_version 444452 (0.0005) [2023-12-26 03:08:05,460][123091] Updated weights for policy 0, policy_version 444462 (0.0005) [2023-12-26 03:08:05,599][123090] Updated weights for policy 1, policy_version 441704 (0.0010) [2023-12-26 03:08:05,661][123090] Updated weights for policy 1, policy_version 441714 (0.0010) [2023-12-26 03:08:05,727][123090] Updated weights for policy 1, policy_version 441724 (0.0010) [2023-12-26 03:08:06,106][123091] Updated weights for policy 0, policy_version 444472 (0.0006) [2023-12-26 03:08:06,170][123091] Updated weights for policy 0, policy_version 444482 (0.0007) [2023-12-26 03:08:06,220][123091] Updated weights for policy 0, policy_version 444492 (0.0005) [2023-12-26 03:08:06,608][123090] Updated weights for policy 1, policy_version 441734 (0.0010) [2023-12-26 03:08:06,672][123090] Updated weights for policy 1, policy_version 441744 (0.0010) [2023-12-26 03:08:06,728][123090] Updated weights for policy 1, policy_version 441754 (0.0010) [2023-12-26 03:08:06,920][123091] Updated weights for policy 0, policy_version 444502 (0.0008) [2023-12-26 03:08:06,990][123091] Updated weights for policy 0, policy_version 444512 (0.0011) [2023-12-26 03:08:07,061][123091] Updated weights for policy 0, policy_version 444522 (0.0011) [2023-12-26 03:08:07,557][123090] Updated weights for policy 1, policy_version 441764 (0.0011) [2023-12-26 03:08:07,611][123090] Updated weights for policy 1, policy_version 441774 (0.0010) [2023-12-26 03:08:07,658][123090] Updated weights for policy 1, policy_version 441784 (0.0010) [2023-12-26 03:08:07,844][123091] Updated weights for policy 0, policy_version 444532 (0.0009) [2023-12-26 03:08:07,913][123091] Updated weights for policy 0, policy_version 444542 (0.0005) [2023-12-26 03:08:07,977][123091] Updated weights for policy 0, policy_version 444552 (0.0005) [2023-12-26 03:08:08,510][123090] Updated weights for policy 1, policy_version 441794 (0.0010) [2023-12-26 03:08:08,573][123090] Updated weights for policy 1, policy_version 441804 (0.0010) [2023-12-26 03:08:08,619][123091] Updated weights for policy 0, policy_version 444562 (0.0006) [2023-12-26 03:08:08,636][123090] Updated weights for policy 1, policy_version 441814 (0.0010) [2023-12-26 03:08:08,685][123091] Updated weights for policy 0, policy_version 444572 (0.0008) [2023-12-26 03:08:08,700][123090] Updated weights for policy 1, policy_version 441824 (0.0010) [2023-12-26 03:08:08,750][123091] Updated weights for policy 0, policy_version 444582 (0.0006) [2023-12-26 03:08:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 226918400. Throughput: 0: 8906.7, 1: 8940.3. Samples: 226896108. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:08:08,785][121949] Avg episode reward: [(0, '6016.174'), (1, '5530.359')] [2023-12-26 03:08:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000441824_113106944.pth... [2023-12-26 03:08:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000440800_112844800.pth [2023-12-26 03:08:08,813][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000444592_113819648.pth... [2023-12-26 03:08:08,814][123091] Updated weights for policy 0, policy_version 444592 (0.0011) [2023-12-26 03:08:08,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000443536_113549312.pth [2023-12-26 03:08:09,386][123090] Updated weights for policy 1, policy_version 441834 (0.0008) [2023-12-26 03:08:09,446][123090] Updated weights for policy 1, policy_version 441844 (0.0007) [2023-12-26 03:08:09,502][123090] Updated weights for policy 1, policy_version 441854 (0.0008) [2023-12-26 03:08:09,626][123091] Updated weights for policy 0, policy_version 444602 (0.0010) [2023-12-26 03:08:09,693][123091] Updated weights for policy 0, policy_version 444612 (0.0010) [2023-12-26 03:08:09,757][123091] Updated weights for policy 0, policy_version 444622 (0.0011) [2023-12-26 03:08:10,327][123090] Updated weights for policy 1, policy_version 441864 (0.0010) [2023-12-26 03:08:10,396][123090] Updated weights for policy 1, policy_version 441874 (0.0009) [2023-12-26 03:08:10,459][123090] Updated weights for policy 1, policy_version 441884 (0.0009) [2023-12-26 03:08:10,593][123091] Updated weights for policy 0, policy_version 444632 (0.0011) [2023-12-26 03:08:10,654][123091] Updated weights for policy 0, policy_version 444642 (0.0011) [2023-12-26 03:08:10,723][123091] Updated weights for policy 0, policy_version 444652 (0.0011) [2023-12-26 03:08:11,366][123090] Updated weights for policy 1, policy_version 441894 (0.0009) [2023-12-26 03:08:11,441][123090] Updated weights for policy 1, policy_version 441904 (0.0009) [2023-12-26 03:08:11,512][123090] Updated weights for policy 1, policy_version 441914 (0.0009) [2023-12-26 03:08:11,562][123091] Updated weights for policy 0, policy_version 444662 (0.0010) [2023-12-26 03:08:11,632][123091] Updated weights for policy 0, policy_version 444672 (0.0009) [2023-12-26 03:08:11,700][123091] Updated weights for policy 0, policy_version 444682 (0.0010) [2023-12-26 03:08:12,338][123090] Updated weights for policy 1, policy_version 441924 (0.0009) [2023-12-26 03:08:12,417][123090] Updated weights for policy 1, policy_version 441934 (0.0009) [2023-12-26 03:08:12,477][123090] Updated weights for policy 1, policy_version 441944 (0.0009) [2023-12-26 03:08:12,569][123091] Updated weights for policy 0, policy_version 444692 (0.0008) [2023-12-26 03:08:12,626][123091] Updated weights for policy 0, policy_version 444702 (0.0008) [2023-12-26 03:08:12,676][123091] Updated weights for policy 0, policy_version 444712 (0.0009) [2023-12-26 03:08:13,191][123090] Updated weights for policy 1, policy_version 441954 (0.0010) [2023-12-26 03:08:13,244][123090] Updated weights for policy 1, policy_version 441964 (0.0009) [2023-12-26 03:08:13,314][123090] Updated weights for policy 1, policy_version 441974 (0.0009) [2023-12-26 03:08:13,386][123090] Updated weights for policy 1, policy_version 441984 (0.0009) [2023-12-26 03:08:13,496][123091] Updated weights for policy 0, policy_version 444722 (0.0008) [2023-12-26 03:08:13,560][123091] Updated weights for policy 0, policy_version 444732 (0.0005) [2023-12-26 03:08:13,612][123091] Updated weights for policy 0, policy_version 444742 (0.0005) [2023-12-26 03:08:13,678][123091] Updated weights for policy 0, policy_version 444752 (0.0006) [2023-12-26 03:08:13,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 227008512. Throughput: 0: 8829.2, 1: 8888.9. Samples: 226998980. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:08:13,785][121949] Avg episode reward: [(0, '6017.382'), (1, '5632.705')] [2023-12-26 03:08:14,252][123090] Updated weights for policy 1, policy_version 441994 (0.0005) [2023-12-26 03:08:14,328][123090] Updated weights for policy 1, policy_version 442004 (0.0005) [2023-12-26 03:08:14,338][123091] Updated weights for policy 0, policy_version 444762 (0.0005) [2023-12-26 03:08:14,393][123091] Updated weights for policy 0, policy_version 444772 (0.0006) [2023-12-26 03:08:14,402][123090] Updated weights for policy 1, policy_version 442014 (0.0005) [2023-12-26 03:08:14,462][123091] Updated weights for policy 0, policy_version 444782 (0.0009) [2023-12-26 03:08:15,096][123090] Updated weights for policy 1, policy_version 442024 (0.0009) [2023-12-26 03:08:15,150][123090] Updated weights for policy 1, policy_version 442034 (0.0010) [2023-12-26 03:08:15,204][123090] Updated weights for policy 1, policy_version 442044 (0.0008) [2023-12-26 03:08:15,231][123091] Updated weights for policy 0, policy_version 444792 (0.0008) [2023-12-26 03:08:15,296][123091] Updated weights for policy 0, policy_version 444802 (0.0010) [2023-12-26 03:08:15,368][123091] Updated weights for policy 0, policy_version 444812 (0.0011) [2023-12-26 03:08:16,138][123090] Updated weights for policy 1, policy_version 442054 (0.0009) [2023-12-26 03:08:16,149][123091] Updated weights for policy 0, policy_version 444822 (0.0009) [2023-12-26 03:08:16,193][123090] Updated weights for policy 1, policy_version 442064 (0.0006) [2023-12-26 03:08:16,209][123091] Updated weights for policy 0, policy_version 444832 (0.0008) [2023-12-26 03:08:16,245][123090] Updated weights for policy 1, policy_version 442074 (0.0005) [2023-12-26 03:08:16,272][123091] Updated weights for policy 0, policy_version 444842 (0.0009) [2023-12-26 03:08:17,025][123090] Updated weights for policy 1, policy_version 442084 (0.0007) [2023-12-26 03:08:17,047][123091] Updated weights for policy 0, policy_version 444852 (0.0010) [2023-12-26 03:08:17,078][123090] Updated weights for policy 1, policy_version 442094 (0.0009) [2023-12-26 03:08:17,110][123091] Updated weights for policy 0, policy_version 444862 (0.0009) [2023-12-26 03:08:17,123][123090] Updated weights for policy 1, policy_version 442104 (0.0007) [2023-12-26 03:08:17,172][123091] Updated weights for policy 0, policy_version 444872 (0.0008) [2023-12-26 03:08:17,866][123090] Updated weights for policy 1, policy_version 442114 (0.0008) [2023-12-26 03:08:17,905][123091] Updated weights for policy 0, policy_version 444882 (0.0009) [2023-12-26 03:08:17,943][123090] Updated weights for policy 1, policy_version 442124 (0.0005) [2023-12-26 03:08:17,964][123091] Updated weights for policy 0, policy_version 444892 (0.0006) [2023-12-26 03:08:18,018][123090] Updated weights for policy 1, policy_version 442134 (0.0006) [2023-12-26 03:08:18,023][123091] Updated weights for policy 0, policy_version 444902 (0.0007) [2023-12-26 03:08:18,071][123091] Updated weights for policy 0, policy_version 444912 (0.0009) [2023-12-26 03:08:18,081][123090] Updated weights for policy 1, policy_version 442144 (0.0007) [2023-12-26 03:08:18,715][123090] Updated weights for policy 1, policy_version 442154 (0.0009) [2023-12-26 03:08:18,779][123090] Updated weights for policy 1, policy_version 442164 (0.0005) [2023-12-26 03:08:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 227090432. Throughput: 0: 8884.8, 1: 8874.7. Samples: 227109024. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:08:18,785][121949] Avg episode reward: [(0, '6064.619'), (1, '5693.549')] [2023-12-26 03:08:18,844][123090] Updated weights for policy 1, policy_version 442174 (0.0005) [2023-12-26 03:08:18,888][123091] Updated weights for policy 0, policy_version 444922 (0.0005) [2023-12-26 03:08:18,938][123091] Updated weights for policy 0, policy_version 444932 (0.0005) [2023-12-26 03:08:18,994][123091] Updated weights for policy 0, policy_version 444942 (0.0005) [2023-12-26 03:08:19,626][123090] Updated weights for policy 1, policy_version 442184 (0.0007) [2023-12-26 03:08:19,693][123090] Updated weights for policy 1, policy_version 442194 (0.0007) [2023-12-26 03:08:19,765][123090] Updated weights for policy 1, policy_version 442204 (0.0008) [2023-12-26 03:08:19,800][123091] Updated weights for policy 0, policy_version 444952 (0.0010) [2023-12-26 03:08:19,875][123091] Updated weights for policy 0, policy_version 444962 (0.0010) [2023-12-26 03:08:19,948][123091] Updated weights for policy 0, policy_version 444972 (0.0011) [2023-12-26 03:08:20,567][123090] Updated weights for policy 1, policy_version 442214 (0.0011) [2023-12-26 03:08:20,633][123090] Updated weights for policy 1, policy_version 442224 (0.0010) [2023-12-26 03:08:20,700][123090] Updated weights for policy 1, policy_version 442234 (0.0011) [2023-12-26 03:08:20,772][123091] Updated weights for policy 0, policy_version 444982 (0.0011) [2023-12-26 03:08:20,840][123091] Updated weights for policy 0, policy_version 444992 (0.0011) [2023-12-26 03:08:20,912][123091] Updated weights for policy 0, policy_version 445002 (0.0011) [2023-12-26 03:08:21,548][123090] Updated weights for policy 1, policy_version 442244 (0.0011) [2023-12-26 03:08:21,616][123090] Updated weights for policy 1, policy_version 442254 (0.0011) [2023-12-26 03:08:21,687][123090] Updated weights for policy 1, policy_version 442264 (0.0011) [2023-12-26 03:08:21,701][123091] Updated weights for policy 0, policy_version 445012 (0.0011) [2023-12-26 03:08:21,767][123091] Updated weights for policy 0, policy_version 445022 (0.0010) [2023-12-26 03:08:21,822][123091] Updated weights for policy 0, policy_version 445032 (0.0011) [2023-12-26 03:08:22,518][123090] Updated weights for policy 1, policy_version 442274 (0.0011) [2023-12-26 03:08:22,581][123090] Updated weights for policy 1, policy_version 442284 (0.0010) [2023-12-26 03:08:22,637][123090] Updated weights for policy 1, policy_version 442294 (0.0010) [2023-12-26 03:08:22,678][123091] Updated weights for policy 0, policy_version 445042 (0.0011) [2023-12-26 03:08:22,700][123090] Updated weights for policy 1, policy_version 442304 (0.0010) [2023-12-26 03:08:22,741][123091] Updated weights for policy 0, policy_version 445052 (0.0010) [2023-12-26 03:08:22,795][123091] Updated weights for policy 0, policy_version 445062 (0.0006) [2023-12-26 03:08:22,847][123091] Updated weights for policy 0, policy_version 445072 (0.0005) [2023-12-26 03:08:23,414][123090] Updated weights for policy 1, policy_version 442314 (0.0006) [2023-12-26 03:08:23,475][123090] Updated weights for policy 1, policy_version 442324 (0.0009) [2023-12-26 03:08:23,523][123090] Updated weights for policy 1, policy_version 442334 (0.0010) [2023-12-26 03:08:23,636][123091] Updated weights for policy 0, policy_version 445082 (0.0010) [2023-12-26 03:08:23,699][123091] Updated weights for policy 0, policy_version 445092 (0.0011) [2023-12-26 03:08:23,769][123091] Updated weights for policy 0, policy_version 445102 (0.0011) [2023-12-26 03:08:23,788][121949] Fps is (10 sec: 18015.1, 60 sec: 17884.7, 300 sec: 17661.1). Total num frames: 227188736. Throughput: 0: 8891.5, 1: 8799.9. Samples: 227160752. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:23,790][121949] Avg episode reward: [(0, '6021.216'), (1, '5533.982')] [2023-12-26 03:08:23,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000442336_113238016.pth... [2023-12-26 03:08:23,798][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000445104_113950720.pth... [2023-12-26 03:08:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000441280_112967680.pth [2023-12-26 03:08:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000444048_113680384.pth [2023-12-26 03:08:24,244][123090] Updated weights for policy 1, policy_version 442344 (0.0006) [2023-12-26 03:08:24,300][123090] Updated weights for policy 1, policy_version 442354 (0.0005) [2023-12-26 03:08:24,368][123090] Updated weights for policy 1, policy_version 442364 (0.0005) [2023-12-26 03:08:24,408][123091] Updated weights for policy 0, policy_version 445112 (0.0007) [2023-12-26 03:08:24,486][123091] Updated weights for policy 0, policy_version 445122 (0.0005) [2023-12-26 03:08:24,559][123091] Updated weights for policy 0, policy_version 445132 (0.0005) [2023-12-26 03:08:25,056][123090] Updated weights for policy 1, policy_version 442374 (0.0010) [2023-12-26 03:08:25,126][123090] Updated weights for policy 1, policy_version 442384 (0.0010) [2023-12-26 03:08:25,200][123090] Updated weights for policy 1, policy_version 442394 (0.0010) [2023-12-26 03:08:25,236][123091] Updated weights for policy 0, policy_version 445142 (0.0009) [2023-12-26 03:08:25,295][123091] Updated weights for policy 0, policy_version 445152 (0.0011) [2023-12-26 03:08:25,339][123091] Updated weights for policy 0, policy_version 445162 (0.0010) [2023-12-26 03:08:25,988][123090] Updated weights for policy 1, policy_version 442404 (0.0010) [2023-12-26 03:08:26,035][123091] Updated weights for policy 0, policy_version 445172 (0.0008) [2023-12-26 03:08:26,048][123090] Updated weights for policy 1, policy_version 442414 (0.0010) [2023-12-26 03:08:26,093][123091] Updated weights for policy 0, policy_version 445182 (0.0007) [2023-12-26 03:08:26,112][123090] Updated weights for policy 1, policy_version 442424 (0.0011) [2023-12-26 03:08:26,154][123091] Updated weights for policy 0, policy_version 445192 (0.0006) [2023-12-26 03:08:26,852][123091] Updated weights for policy 0, policy_version 445202 (0.0005) [2023-12-26 03:08:26,911][123091] Updated weights for policy 0, policy_version 445212 (0.0005) [2023-12-26 03:08:26,915][123090] Updated weights for policy 1, policy_version 442434 (0.0009) [2023-12-26 03:08:26,962][123091] Updated weights for policy 0, policy_version 445222 (0.0005) [2023-12-26 03:08:26,978][123090] Updated weights for policy 1, policy_version 442444 (0.0005) [2023-12-26 03:08:27,017][123091] Updated weights for policy 0, policy_version 445232 (0.0005) [2023-12-26 03:08:27,042][123090] Updated weights for policy 1, policy_version 442454 (0.0005) [2023-12-26 03:08:27,106][123090] Updated weights for policy 1, policy_version 442464 (0.0006) [2023-12-26 03:08:27,606][123091] Updated weights for policy 0, policy_version 445242 (0.0005) [2023-12-26 03:08:27,659][123091] Updated weights for policy 0, policy_version 445252 (0.0005) [2023-12-26 03:08:27,709][123091] Updated weights for policy 0, policy_version 445262 (0.0005) [2023-12-26 03:08:27,868][123090] Updated weights for policy 1, policy_version 442474 (0.0010) [2023-12-26 03:08:27,932][123090] Updated weights for policy 1, policy_version 442484 (0.0010) [2023-12-26 03:08:27,986][123090] Updated weights for policy 1, policy_version 442494 (0.0010) [2023-12-26 03:08:28,335][123091] Updated weights for policy 0, policy_version 445272 (0.0006) [2023-12-26 03:08:28,401][123091] Updated weights for policy 0, policy_version 445282 (0.0011) [2023-12-26 03:08:28,467][123091] Updated weights for policy 0, policy_version 445292 (0.0011) [2023-12-26 03:08:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 227278848. Throughput: 0: 9038.6, 1: 8856.7. Samples: 227273624. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:28,785][121949] Avg episode reward: [(0, '5991.753'), (1, '5678.432')] [2023-12-26 03:08:28,789][123090] Updated weights for policy 1, policy_version 442504 (0.0010) [2023-12-26 03:08:28,840][123090] Updated weights for policy 1, policy_version 442514 (0.0010) [2023-12-26 03:08:28,894][123090] Updated weights for policy 1, policy_version 442524 (0.0010) [2023-12-26 03:08:29,244][123091] Updated weights for policy 0, policy_version 445302 (0.0011) [2023-12-26 03:08:29,307][123091] Updated weights for policy 0, policy_version 445312 (0.0011) [2023-12-26 03:08:29,374][123091] Updated weights for policy 0, policy_version 445322 (0.0014) [2023-12-26 03:08:29,726][123090] Updated weights for policy 1, policy_version 442534 (0.0010) [2023-12-26 03:08:29,772][123090] Updated weights for policy 1, policy_version 442544 (0.0006) [2023-12-26 03:08:29,822][123090] Updated weights for policy 1, policy_version 442554 (0.0006) [2023-12-26 03:08:30,204][123091] Updated weights for policy 0, policy_version 445332 (0.0010) [2023-12-26 03:08:30,257][123091] Updated weights for policy 0, policy_version 445342 (0.0009) [2023-12-26 03:08:30,305][123091] Updated weights for policy 0, policy_version 445352 (0.0009) [2023-12-26 03:08:30,626][123090] Updated weights for policy 1, policy_version 442564 (0.0008) [2023-12-26 03:08:30,695][123090] Updated weights for policy 1, policy_version 442574 (0.0008) [2023-12-26 03:08:30,761][123090] Updated weights for policy 1, policy_version 442584 (0.0008) [2023-12-26 03:08:31,119][123091] Updated weights for policy 0, policy_version 445362 (0.0007) [2023-12-26 03:08:31,174][123091] Updated weights for policy 0, policy_version 445372 (0.0008) [2023-12-26 03:08:31,224][123091] Updated weights for policy 0, policy_version 445382 (0.0008) [2023-12-26 03:08:31,282][123091] Updated weights for policy 0, policy_version 445392 (0.0010) [2023-12-26 03:08:31,516][123090] Updated weights for policy 1, policy_version 442594 (0.0008) [2023-12-26 03:08:31,565][123090] Updated weights for policy 1, policy_version 442604 (0.0009) [2023-12-26 03:08:31,625][123090] Updated weights for policy 1, policy_version 442614 (0.0009) [2023-12-26 03:08:31,684][123090] Updated weights for policy 1, policy_version 442624 (0.0009) [2023-12-26 03:08:32,151][123091] Updated weights for policy 0, policy_version 445402 (0.0005) [2023-12-26 03:08:32,215][123091] Updated weights for policy 0, policy_version 445412 (0.0005) [2023-12-26 03:08:32,279][123091] Updated weights for policy 0, policy_version 445422 (0.0006) [2023-12-26 03:08:32,583][123090] Updated weights for policy 1, policy_version 442634 (0.0010) [2023-12-26 03:08:32,639][123090] Updated weights for policy 1, policy_version 442644 (0.0010) [2023-12-26 03:08:32,700][123090] Updated weights for policy 1, policy_version 442654 (0.0009) [2023-12-26 03:08:32,948][123091] Updated weights for policy 0, policy_version 445432 (0.0010) [2023-12-26 03:08:33,015][123091] Updated weights for policy 0, policy_version 445442 (0.0011) [2023-12-26 03:08:33,072][123091] Updated weights for policy 0, policy_version 445452 (0.0010) [2023-12-26 03:08:33,581][123090] Updated weights for policy 1, policy_version 442664 (0.0010) [2023-12-26 03:08:33,640][123090] Updated weights for policy 1, policy_version 442676 (0.0010) [2023-12-26 03:08:33,695][123090] Updated weights for policy 1, policy_version 442686 (0.0009) [2023-12-26 03:08:33,727][123091] Updated weights for policy 0, policy_version 445462 (0.0005) [2023-12-26 03:08:33,784][121949] Fps is (10 sec: 18029.8, 60 sec: 17749.5, 300 sec: 17661.4). Total num frames: 227368960. Throughput: 0: 9066.8, 1: 8839.8. Samples: 227380456. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:33,784][121949] Avg episode reward: [(0, '6120.682'), (1, '5604.048')] [2023-12-26 03:08:33,786][123091] Updated weights for policy 0, policy_version 445472 (0.0008) [2023-12-26 03:08:33,837][123091] Updated weights for policy 0, policy_version 445482 (0.0009) [2023-12-26 03:08:34,535][123090] Updated weights for policy 1, policy_version 442696 (0.0006) [2023-12-26 03:08:34,595][123090] Updated weights for policy 1, policy_version 442706 (0.0010) [2023-12-26 03:08:34,646][123090] Updated weights for policy 1, policy_version 442716 (0.0009) [2023-12-26 03:08:34,667][123091] Updated weights for policy 0, policy_version 445492 (0.0008) [2023-12-26 03:08:34,727][123091] Updated weights for policy 0, policy_version 445502 (0.0010) [2023-12-26 03:08:34,780][123091] Updated weights for policy 0, policy_version 445513 (0.0010) [2023-12-26 03:08:35,385][123090] Updated weights for policy 1, policy_version 442726 (0.0008) [2023-12-26 03:08:35,435][123090] Updated weights for policy 1, policy_version 442736 (0.0008) [2023-12-26 03:08:35,486][123090] Updated weights for policy 1, policy_version 442746 (0.0010) [2023-12-26 03:08:35,667][123091] Updated weights for policy 0, policy_version 445523 (0.0010) [2023-12-26 03:08:35,726][123091] Updated weights for policy 0, policy_version 445533 (0.0009) [2023-12-26 03:08:35,788][123091] Updated weights for policy 0, policy_version 445543 (0.0009) [2023-12-26 03:08:36,263][123090] Updated weights for policy 1, policy_version 442756 (0.0009) [2023-12-26 03:08:36,319][123090] Updated weights for policy 1, policy_version 442766 (0.0008) [2023-12-26 03:08:36,378][123090] Updated weights for policy 1, policy_version 442776 (0.0008) [2023-12-26 03:08:36,641][123091] Updated weights for policy 0, policy_version 445553 (0.0009) [2023-12-26 03:08:36,704][123091] Updated weights for policy 0, policy_version 445563 (0.0009) [2023-12-26 03:08:36,760][123091] Updated weights for policy 0, policy_version 445573 (0.0010) [2023-12-26 03:08:36,827][123091] Updated weights for policy 0, policy_version 445583 (0.0008) [2023-12-26 03:08:37,165][123090] Updated weights for policy 1, policy_version 442786 (0.0008) [2023-12-26 03:08:37,240][123090] Updated weights for policy 1, policy_version 442796 (0.0006) [2023-12-26 03:08:37,307][123090] Updated weights for policy 1, policy_version 442806 (0.0006) [2023-12-26 03:08:37,371][123090] Updated weights for policy 1, policy_version 442816 (0.0007) [2023-12-26 03:08:37,717][123091] Updated weights for policy 0, policy_version 445593 (0.0009) [2023-12-26 03:08:37,772][123091] Updated weights for policy 0, policy_version 445603 (0.0010) [2023-12-26 03:08:37,825][123091] Updated weights for policy 0, policy_version 445613 (0.0010) [2023-12-26 03:08:38,111][123090] Updated weights for policy 1, policy_version 442826 (0.0005) [2023-12-26 03:08:38,170][123090] Updated weights for policy 1, policy_version 442836 (0.0007) [2023-12-26 03:08:38,218][123090] Updated weights for policy 1, policy_version 442846 (0.0008) [2023-12-26 03:08:38,738][123091] Updated weights for policy 0, policy_version 445623 (0.0010) [2023-12-26 03:08:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 227450880. Throughput: 0: 9022.3, 1: 8868.0. Samples: 227432936. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:38,785][121949] Avg episode reward: [(0, '6130.774'), (1, '5538.218')] [2023-12-26 03:08:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000442848_113369088.pth... [2023-12-26 03:08:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000441824_113106944.pth [2023-12-26 03:08:38,799][123091] Updated weights for policy 0, policy_version 445633 (0.0010) [2023-12-26 03:08:38,855][123091] Updated weights for policy 0, policy_version 445643 (0.0010) [2023-12-26 03:08:38,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000445648_114089984.pth... [2023-12-26 03:08:38,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000444592_113819648.pth [2023-12-26 03:08:39,019][123090] Updated weights for policy 1, policy_version 442856 (0.0006) [2023-12-26 03:08:39,078][123090] Updated weights for policy 1, policy_version 442866 (0.0005) [2023-12-26 03:08:39,133][123090] Updated weights for policy 1, policy_version 442876 (0.0005) [2023-12-26 03:08:39,694][123091] Updated weights for policy 0, policy_version 445653 (0.0008) [2023-12-26 03:08:39,765][123091] Updated weights for policy 0, policy_version 445663 (0.0006) [2023-12-26 03:08:39,841][123091] Updated weights for policy 0, policy_version 445673 (0.0007) [2023-12-26 03:08:39,978][123090] Updated weights for policy 1, policy_version 442886 (0.0007) [2023-12-26 03:08:40,047][123090] Updated weights for policy 1, policy_version 442896 (0.0010) [2023-12-26 03:08:40,114][123090] Updated weights for policy 1, policy_version 442906 (0.0010) [2023-12-26 03:08:40,558][123091] Updated weights for policy 0, policy_version 445683 (0.0011) [2023-12-26 03:08:40,626][123091] Updated weights for policy 0, policy_version 445693 (0.0011) [2023-12-26 03:08:40,696][123091] Updated weights for policy 0, policy_version 445703 (0.0011) [2023-12-26 03:08:40,811][123090] Updated weights for policy 1, policy_version 442916 (0.0009) [2023-12-26 03:08:40,878][123090] Updated weights for policy 1, policy_version 442926 (0.0007) [2023-12-26 03:08:40,945][123090] Updated weights for policy 1, policy_version 442936 (0.0007) [2023-12-26 03:08:41,536][123091] Updated weights for policy 0, policy_version 445713 (0.0011) [2023-12-26 03:08:41,600][123091] Updated weights for policy 0, policy_version 445723 (0.0011) [2023-12-26 03:08:41,672][123091] Updated weights for policy 0, policy_version 445733 (0.0009) [2023-12-26 03:08:41,738][123091] Updated weights for policy 0, policy_version 445743 (0.0009) [2023-12-26 03:08:41,775][123090] Updated weights for policy 1, policy_version 442946 (0.0006) [2023-12-26 03:08:41,835][123090] Updated weights for policy 1, policy_version 442956 (0.0010) [2023-12-26 03:08:41,895][123090] Updated weights for policy 1, policy_version 442966 (0.0010) [2023-12-26 03:08:41,957][123090] Updated weights for policy 1, policy_version 442976 (0.0010) [2023-12-26 03:08:42,534][123091] Updated weights for policy 0, policy_version 445753 (0.0010) [2023-12-26 03:08:42,593][123091] Updated weights for policy 0, policy_version 445763 (0.0010) [2023-12-26 03:08:42,658][123091] Updated weights for policy 0, policy_version 445773 (0.0009) [2023-12-26 03:08:42,852][123090] Updated weights for policy 1, policy_version 442986 (0.0009) [2023-12-26 03:08:42,921][123090] Updated weights for policy 1, policy_version 442996 (0.0008) [2023-12-26 03:08:42,986][123090] Updated weights for policy 1, policy_version 443006 (0.0009) [2023-12-26 03:08:43,389][123091] Updated weights for policy 0, policy_version 445783 (0.0006) [2023-12-26 03:08:43,444][123091] Updated weights for policy 0, policy_version 445793 (0.0005) [2023-12-26 03:08:43,490][123091] Updated weights for policy 0, policy_version 445803 (0.0005) [2023-12-26 03:08:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 227540992. Throughput: 0: 9041.6, 1: 8807.1. Samples: 227536720. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:43,785][121949] Avg episode reward: [(0, '6176.469'), (1, '5672.207')] [2023-12-26 03:08:43,891][123090] Updated weights for policy 1, policy_version 443016 (0.0010) [2023-12-26 03:08:43,939][123090] Updated weights for policy 1, policy_version 443026 (0.0009) [2023-12-26 03:08:43,999][123090] Updated weights for policy 1, policy_version 443038 (0.0011) [2023-12-26 03:08:44,188][123091] Updated weights for policy 0, policy_version 445813 (0.0006) [2023-12-26 03:08:44,247][123091] Updated weights for policy 0, policy_version 445823 (0.0005) [2023-12-26 03:08:44,315][123091] Updated weights for policy 0, policy_version 445833 (0.0005) [2023-12-26 03:08:44,858][123090] Updated weights for policy 1, policy_version 443048 (0.0010) [2023-12-26 03:08:44,926][123090] Updated weights for policy 1, policy_version 443058 (0.0010) [2023-12-26 03:08:44,990][123090] Updated weights for policy 1, policy_version 443068 (0.0010) [2023-12-26 03:08:45,036][123091] Updated weights for policy 0, policy_version 445843 (0.0005) [2023-12-26 03:08:45,104][123091] Updated weights for policy 0, policy_version 445853 (0.0009) [2023-12-26 03:08:45,174][123091] Updated weights for policy 0, policy_version 445863 (0.0008) [2023-12-26 03:08:45,845][123091] Updated weights for policy 0, policy_version 445873 (0.0008) [2023-12-26 03:08:45,904][123090] Updated weights for policy 1, policy_version 443078 (0.0008) [2023-12-26 03:08:45,906][123091] Updated weights for policy 0, policy_version 445883 (0.0005) [2023-12-26 03:08:45,966][123090] Updated weights for policy 1, policy_version 443088 (0.0009) [2023-12-26 03:08:45,972][123091] Updated weights for policy 0, policy_version 445893 (0.0006) [2023-12-26 03:08:46,027][123090] Updated weights for policy 1, policy_version 443098 (0.0008) [2023-12-26 03:08:46,036][123091] Updated weights for policy 0, policy_version 445903 (0.0009) [2023-12-26 03:08:46,827][123091] Updated weights for policy 0, policy_version 445913 (0.0010) [2023-12-26 03:08:46,881][123091] Updated weights for policy 0, policy_version 445923 (0.0009) [2023-12-26 03:08:46,886][123090] Updated weights for policy 1, policy_version 443108 (0.0009) [2023-12-26 03:08:46,942][123091] Updated weights for policy 0, policy_version 445933 (0.0010) [2023-12-26 03:08:46,958][123090] Updated weights for policy 1, policy_version 443118 (0.0007) [2023-12-26 03:08:47,021][123090] Updated weights for policy 1, policy_version 443128 (0.0010) [2023-12-26 03:08:47,786][123091] Updated weights for policy 0, policy_version 445943 (0.0010) [2023-12-26 03:08:47,839][123091] Updated weights for policy 0, policy_version 445953 (0.0009) [2023-12-26 03:08:47,845][123090] Updated weights for policy 1, policy_version 443138 (0.0009) [2023-12-26 03:08:47,896][123091] Updated weights for policy 0, policy_version 445963 (0.0008) [2023-12-26 03:08:47,910][123090] Updated weights for policy 1, policy_version 443148 (0.0008) [2023-12-26 03:08:47,970][123090] Updated weights for policy 1, policy_version 443158 (0.0009) [2023-12-26 03:08:48,026][123090] Updated weights for policy 1, policy_version 443168 (0.0009) [2023-12-26 03:08:48,749][123091] Updated weights for policy 0, policy_version 445973 (0.0008) [2023-12-26 03:08:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 227622912. Throughput: 0: 9096.6, 1: 8734.0. Samples: 227641324. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:48,785][121949] Avg episode reward: [(0, '6166.052'), (1, '5585.746')] [2023-12-26 03:08:48,811][123091] Updated weights for policy 0, policy_version 445983 (0.0009) [2023-12-26 03:08:48,858][123090] Updated weights for policy 1, policy_version 443178 (0.0008) [2023-12-26 03:08:48,872][123091] Updated weights for policy 0, policy_version 445993 (0.0010) [2023-12-26 03:08:48,923][123090] Updated weights for policy 1, policy_version 443188 (0.0008) [2023-12-26 03:08:48,981][123090] Updated weights for policy 1, policy_version 443198 (0.0009) [2023-12-26 03:08:49,704][123090] Updated weights for policy 1, policy_version 443208 (0.0006) [2023-12-26 03:08:49,759][123091] Updated weights for policy 0, policy_version 446003 (0.0009) [2023-12-26 03:08:49,769][123090] Updated weights for policy 1, policy_version 443218 (0.0008) [2023-12-26 03:08:49,825][123091] Updated weights for policy 0, policy_version 446013 (0.0008) [2023-12-26 03:08:49,835][123090] Updated weights for policy 1, policy_version 443228 (0.0008) [2023-12-26 03:08:49,890][123091] Updated weights for policy 0, policy_version 446023 (0.0008) [2023-12-26 03:08:50,640][123090] Updated weights for policy 1, policy_version 443238 (0.0006) [2023-12-26 03:08:50,713][123090] Updated weights for policy 1, policy_version 443248 (0.0008) [2023-12-26 03:08:50,734][123091] Updated weights for policy 0, policy_version 446033 (0.0009) [2023-12-26 03:08:50,780][123090] Updated weights for policy 1, policy_version 443258 (0.0008) [2023-12-26 03:08:50,799][123091] Updated weights for policy 0, policy_version 446043 (0.0008) [2023-12-26 03:08:50,877][123091] Updated weights for policy 0, policy_version 446053 (0.0006) [2023-12-26 03:08:50,955][123091] Updated weights for policy 0, policy_version 446063 (0.0005) [2023-12-26 03:08:51,500][123090] Updated weights for policy 1, policy_version 443268 (0.0006) [2023-12-26 03:08:51,568][123090] Updated weights for policy 1, policy_version 443278 (0.0006) [2023-12-26 03:08:51,637][123090] Updated weights for policy 1, policy_version 443288 (0.0008) [2023-12-26 03:08:51,746][123091] Updated weights for policy 0, policy_version 446073 (0.0008) [2023-12-26 03:08:51,810][123091] Updated weights for policy 0, policy_version 446083 (0.0010) [2023-12-26 03:08:51,864][123091] Updated weights for policy 0, policy_version 446093 (0.0009) [2023-12-26 03:08:52,406][123090] Updated weights for policy 1, policy_version 443298 (0.0009) [2023-12-26 03:08:52,478][123090] Updated weights for policy 1, policy_version 443308 (0.0010) [2023-12-26 03:08:52,546][123090] Updated weights for policy 1, policy_version 443318 (0.0010) [2023-12-26 03:08:52,619][123090] Updated weights for policy 1, policy_version 443328 (0.0009) [2023-12-26 03:08:52,709][123091] Updated weights for policy 0, policy_version 446103 (0.0010) [2023-12-26 03:08:52,765][123091] Updated weights for policy 0, policy_version 446113 (0.0009) [2023-12-26 03:08:52,831][123091] Updated weights for policy 0, policy_version 446123 (0.0008) [2023-12-26 03:08:53,447][123090] Updated weights for policy 1, policy_version 443338 (0.0009) [2023-12-26 03:08:53,495][123090] Updated weights for policy 1, policy_version 443348 (0.0009) [2023-12-26 03:08:53,553][123090] Updated weights for policy 1, policy_version 443358 (0.0009) [2023-12-26 03:08:53,617][123091] Updated weights for policy 0, policy_version 446133 (0.0010) [2023-12-26 03:08:53,673][123091] Updated weights for policy 0, policy_version 446143 (0.0009) [2023-12-26 03:08:53,721][123091] Updated weights for policy 0, policy_version 446153 (0.0009) [2023-12-26 03:08:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 227721216. Throughput: 0: 8959.9, 1: 8762.8. Samples: 227693628. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:53,785][121949] Avg episode reward: [(0, '6189.444'), (1, '5614.613')] [2023-12-26 03:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000443360_113500160.pth... [2023-12-26 03:08:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000446160_114221056.pth... [2023-12-26 03:08:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000445104_113950720.pth [2023-12-26 03:08:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000442336_113238016.pth [2023-12-26 03:08:54,290][123090] Updated weights for policy 1, policy_version 443368 (0.0010) [2023-12-26 03:08:54,353][123090] Updated weights for policy 1, policy_version 443378 (0.0009) [2023-12-26 03:08:54,407][123090] Updated weights for policy 1, policy_version 443388 (0.0009) [2023-12-26 03:08:54,593][123091] Updated weights for policy 0, policy_version 446163 (0.0009) [2023-12-26 03:08:54,665][123091] Updated weights for policy 0, policy_version 446173 (0.0010) [2023-12-26 03:08:54,725][123091] Updated weights for policy 0, policy_version 446183 (0.0010) [2023-12-26 03:08:55,227][123090] Updated weights for policy 1, policy_version 443398 (0.0009) [2023-12-26 03:08:55,286][123090] Updated weights for policy 1, policy_version 443408 (0.0010) [2023-12-26 03:08:55,337][123090] Updated weights for policy 1, policy_version 443418 (0.0008) [2023-12-26 03:08:55,556][123091] Updated weights for policy 0, policy_version 446193 (0.0009) [2023-12-26 03:08:55,626][123091] Updated weights for policy 0, policy_version 446203 (0.0009) [2023-12-26 03:08:55,689][123091] Updated weights for policy 0, policy_version 446213 (0.0009) [2023-12-26 03:08:55,737][123091] Updated weights for policy 0, policy_version 446223 (0.0009) [2023-12-26 03:08:56,165][123090] Updated weights for policy 1, policy_version 443428 (0.0009) [2023-12-26 03:08:56,239][123090] Updated weights for policy 1, policy_version 443438 (0.0010) [2023-12-26 03:08:56,296][123090] Updated weights for policy 1, policy_version 443448 (0.0009) [2023-12-26 03:08:56,552][123091] Updated weights for policy 0, policy_version 446233 (0.0009) [2023-12-26 03:08:56,600][123091] Updated weights for policy 0, policy_version 446243 (0.0009) [2023-12-26 03:08:56,658][123091] Updated weights for policy 0, policy_version 446254 (0.0011) [2023-12-26 03:08:57,110][123090] Updated weights for policy 1, policy_version 443458 (0.0009) [2023-12-26 03:08:57,179][123090] Updated weights for policy 1, policy_version 443468 (0.0005) [2023-12-26 03:08:57,243][123090] Updated weights for policy 1, policy_version 443478 (0.0005) [2023-12-26 03:08:57,310][123090] Updated weights for policy 1, policy_version 443488 (0.0005) [2023-12-26 03:08:57,541][123091] Updated weights for policy 0, policy_version 446264 (0.0009) [2023-12-26 03:08:57,606][123091] Updated weights for policy 0, policy_version 446274 (0.0009) [2023-12-26 03:08:57,669][123091] Updated weights for policy 0, policy_version 446284 (0.0008) [2023-12-26 03:08:58,055][123090] Updated weights for policy 1, policy_version 443498 (0.0010) [2023-12-26 03:08:58,124][123090] Updated weights for policy 1, policy_version 443508 (0.0010) [2023-12-26 03:08:58,191][123090] Updated weights for policy 1, policy_version 443518 (0.0009) [2023-12-26 03:08:58,397][123091] Updated weights for policy 0, policy_version 446294 (0.0007) [2023-12-26 03:08:58,459][123091] Updated weights for policy 0, policy_version 446304 (0.0010) [2023-12-26 03:08:58,525][123091] Updated weights for policy 0, policy_version 446314 (0.0010) [2023-12-26 03:08:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 227803136. Throughput: 0: 8932.9, 1: 8794.7. Samples: 227796720. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:08:58,785][121949] Avg episode reward: [(0, '6186.786'), (1, '5735.085')] [2023-12-26 03:08:58,968][123090] Updated weights for policy 1, policy_version 443528 (0.0007) [2023-12-26 03:08:59,035][123090] Updated weights for policy 1, policy_version 443538 (0.0009) [2023-12-26 03:08:59,095][123090] Updated weights for policy 1, policy_version 443548 (0.0009) [2023-12-26 03:08:59,406][123091] Updated weights for policy 0, policy_version 446324 (0.0010) [2023-12-26 03:08:59,453][123091] Updated weights for policy 0, policy_version 446334 (0.0009) [2023-12-26 03:08:59,508][123091] Updated weights for policy 0, policy_version 446344 (0.0010) [2023-12-26 03:08:59,876][123090] Updated weights for policy 1, policy_version 443558 (0.0008) [2023-12-26 03:08:59,946][123090] Updated weights for policy 1, policy_version 443568 (0.0007) [2023-12-26 03:09:00,008][123090] Updated weights for policy 1, policy_version 443578 (0.0007) [2023-12-26 03:09:00,431][123091] Updated weights for policy 0, policy_version 446354 (0.0008) [2023-12-26 03:09:00,499][123091] Updated weights for policy 0, policy_version 446364 (0.0009) [2023-12-26 03:09:00,560][123091] Updated weights for policy 0, policy_version 446374 (0.0009) [2023-12-26 03:09:00,622][123091] Updated weights for policy 0, policy_version 446384 (0.0009) [2023-12-26 03:09:00,688][123090] Updated weights for policy 1, policy_version 443588 (0.0008) [2023-12-26 03:09:00,759][123090] Updated weights for policy 1, policy_version 443598 (0.0005) [2023-12-26 03:09:00,819][123090] Updated weights for policy 1, policy_version 443608 (0.0005) [2023-12-26 03:09:01,508][123091] Updated weights for policy 0, policy_version 446394 (0.0009) [2023-12-26 03:09:01,563][123091] Updated weights for policy 0, policy_version 446404 (0.0008) [2023-12-26 03:09:01,591][123090] Updated weights for policy 1, policy_version 443618 (0.0005) [2023-12-26 03:09:01,632][123091] Updated weights for policy 0, policy_version 446414 (0.0007) [2023-12-26 03:09:01,657][123090] Updated weights for policy 1, policy_version 443628 (0.0007) [2023-12-26 03:09:01,721][123090] Updated weights for policy 1, policy_version 443638 (0.0007) [2023-12-26 03:09:01,783][123090] Updated weights for policy 1, policy_version 443648 (0.0006) [2023-12-26 03:09:02,468][123090] Updated weights for policy 1, policy_version 443658 (0.0008) [2023-12-26 03:09:02,468][123091] Updated weights for policy 0, policy_version 446424 (0.0009) [2023-12-26 03:09:02,521][123090] Updated weights for policy 1, policy_version 443668 (0.0009) [2023-12-26 03:09:02,527][123091] Updated weights for policy 0, policy_version 446434 (0.0007) [2023-12-26 03:09:02,577][123090] Updated weights for policy 1, policy_version 443678 (0.0006) [2023-12-26 03:09:02,588][123091] Updated weights for policy 0, policy_version 446444 (0.0010) [2023-12-26 03:09:03,362][123090] Updated weights for policy 1, policy_version 443688 (0.0009) [2023-12-26 03:09:03,367][123091] Updated weights for policy 0, policy_version 446454 (0.0007) [2023-12-26 03:09:03,418][123090] Updated weights for policy 1, policy_version 443698 (0.0008) [2023-12-26 03:09:03,419][123091] Updated weights for policy 0, policy_version 446464 (0.0005) [2023-12-26 03:09:03,471][123090] Updated weights for policy 1, policy_version 443708 (0.0007) [2023-12-26 03:09:03,478][123091] Updated weights for policy 0, policy_version 446474 (0.0009) [2023-12-26 03:09:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 227893248. Throughput: 0: 8837.6, 1: 8787.7. Samples: 227902164. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:03,785][121949] Avg episode reward: [(0, '6073.141'), (1, '5723.803')] [2023-12-26 03:09:04,314][123091] Updated weights for policy 0, policy_version 446484 (0.0007) [2023-12-26 03:09:04,320][123090] Updated weights for policy 1, policy_version 443718 (0.0009) [2023-12-26 03:09:04,370][123091] Updated weights for policy 0, policy_version 446494 (0.0007) [2023-12-26 03:09:04,387][123090] Updated weights for policy 1, policy_version 443728 (0.0010) [2023-12-26 03:09:04,424][123091] Updated weights for policy 0, policy_version 446504 (0.0008) [2023-12-26 03:09:04,451][123090] Updated weights for policy 1, policy_version 443738 (0.0010) [2023-12-26 03:09:05,147][123090] Updated weights for policy 1, policy_version 443748 (0.0008) [2023-12-26 03:09:05,209][123090] Updated weights for policy 1, policy_version 443758 (0.0005) [2023-12-26 03:09:05,255][123090] Updated weights for policy 1, policy_version 443768 (0.0005) [2023-12-26 03:09:05,312][123091] Updated weights for policy 0, policy_version 446514 (0.0008) [2023-12-26 03:09:05,374][123091] Updated weights for policy 0, policy_version 446524 (0.0010) [2023-12-26 03:09:05,445][123091] Updated weights for policy 0, policy_version 446534 (0.0010) [2023-12-26 03:09:05,507][123091] Updated weights for policy 0, policy_version 446544 (0.0009) [2023-12-26 03:09:05,945][123090] Updated weights for policy 1, policy_version 443778 (0.0008) [2023-12-26 03:09:06,007][123090] Updated weights for policy 1, policy_version 443788 (0.0010) [2023-12-26 03:09:06,065][123090] Updated weights for policy 1, policy_version 443798 (0.0010) [2023-12-26 03:09:06,131][123090] Updated weights for policy 1, policy_version 443808 (0.0011) [2023-12-26 03:09:06,379][123091] Updated weights for policy 0, policy_version 446554 (0.0009) [2023-12-26 03:09:06,440][123091] Updated weights for policy 0, policy_version 446564 (0.0009) [2023-12-26 03:09:06,508][123091] Updated weights for policy 0, policy_version 446574 (0.0009) [2023-12-26 03:09:06,948][123090] Updated weights for policy 1, policy_version 443818 (0.0010) [2023-12-26 03:09:07,015][123090] Updated weights for policy 1, policy_version 443828 (0.0010) [2023-12-26 03:09:07,080][123090] Updated weights for policy 1, policy_version 443838 (0.0010) [2023-12-26 03:09:07,293][123091] Updated weights for policy 0, policy_version 446584 (0.0006) [2023-12-26 03:09:07,355][123091] Updated weights for policy 0, policy_version 446594 (0.0008) [2023-12-26 03:09:07,425][123091] Updated weights for policy 0, policy_version 446604 (0.0009) [2023-12-26 03:09:07,826][123090] Updated weights for policy 1, policy_version 443848 (0.0007) [2023-12-26 03:09:07,882][123090] Updated weights for policy 1, policy_version 443858 (0.0006) [2023-12-26 03:09:07,932][123090] Updated weights for policy 1, policy_version 443868 (0.0005) [2023-12-26 03:09:08,253][123091] Updated weights for policy 0, policy_version 446614 (0.0009) [2023-12-26 03:09:08,315][123091] Updated weights for policy 0, policy_version 446624 (0.0009) [2023-12-26 03:09:08,386][123091] Updated weights for policy 0, policy_version 446634 (0.0009) [2023-12-26 03:09:08,725][123090] Updated weights for policy 1, policy_version 443878 (0.0008) [2023-12-26 03:09:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 227975168. Throughput: 0: 8799.2, 1: 8835.8. Samples: 227954256. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:08,785][121949] Avg episode reward: [(0, '6098.574'), (1, '5681.023')] [2023-12-26 03:09:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000446640_114343936.pth... [2023-12-26 03:09:08,791][123090] Updated weights for policy 1, policy_version 443888 (0.0010) [2023-12-26 03:09:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000445648_114089984.pth [2023-12-26 03:09:08,847][123090] Updated weights for policy 1, policy_version 443898 (0.0010) [2023-12-26 03:09:08,872][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000443904_113639424.pth... [2023-12-26 03:09:08,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000442848_113369088.pth [2023-12-26 03:09:09,219][123091] Updated weights for policy 0, policy_version 446644 (0.0009) [2023-12-26 03:09:09,286][123091] Updated weights for policy 0, policy_version 446654 (0.0009) [2023-12-26 03:09:09,359][123091] Updated weights for policy 0, policy_version 446664 (0.0009) [2023-12-26 03:09:09,653][123090] Updated weights for policy 1, policy_version 443908 (0.0010) [2023-12-26 03:09:09,717][123090] Updated weights for policy 1, policy_version 443918 (0.0009) [2023-12-26 03:09:09,778][123090] Updated weights for policy 1, policy_version 443928 (0.0009) [2023-12-26 03:09:10,170][123091] Updated weights for policy 0, policy_version 446674 (0.0010) [2023-12-26 03:09:10,235][123091] Updated weights for policy 0, policy_version 446684 (0.0009) [2023-12-26 03:09:10,311][123091] Updated weights for policy 0, policy_version 446694 (0.0010) [2023-12-26 03:09:10,373][123091] Updated weights for policy 0, policy_version 446704 (0.0010) [2023-12-26 03:09:10,635][123090] Updated weights for policy 1, policy_version 443938 (0.0009) [2023-12-26 03:09:10,713][123090] Updated weights for policy 1, policy_version 443948 (0.0009) [2023-12-26 03:09:10,768][123090] Updated weights for policy 1, policy_version 443958 (0.0008) [2023-12-26 03:09:10,818][123090] Updated weights for policy 1, policy_version 443968 (0.0009) [2023-12-26 03:09:11,123][123091] Updated weights for policy 0, policy_version 446714 (0.0009) [2023-12-26 03:09:11,190][123091] Updated weights for policy 0, policy_version 446724 (0.0010) [2023-12-26 03:09:11,253][123091] Updated weights for policy 0, policy_version 446734 (0.0009) [2023-12-26 03:09:11,731][123090] Updated weights for policy 1, policy_version 443978 (0.0009) [2023-12-26 03:09:11,802][123090] Updated weights for policy 1, policy_version 443988 (0.0009) [2023-12-26 03:09:11,864][123090] Updated weights for policy 1, policy_version 443998 (0.0010) [2023-12-26 03:09:12,141][123091] Updated weights for policy 0, policy_version 446744 (0.0008) [2023-12-26 03:09:12,205][123091] Updated weights for policy 0, policy_version 446754 (0.0008) [2023-12-26 03:09:12,269][123091] Updated weights for policy 0, policy_version 446764 (0.0007) [2023-12-26 03:09:12,713][123090] Updated weights for policy 1, policy_version 444008 (0.0007) [2023-12-26 03:09:12,776][123090] Updated weights for policy 1, policy_version 444018 (0.0010) [2023-12-26 03:09:12,832][123090] Updated weights for policy 1, policy_version 444028 (0.0009) [2023-12-26 03:09:13,026][123091] Updated weights for policy 0, policy_version 446774 (0.0008) [2023-12-26 03:09:13,076][123091] Updated weights for policy 0, policy_version 446784 (0.0005) [2023-12-26 03:09:13,124][123091] Updated weights for policy 0, policy_version 446794 (0.0005) [2023-12-26 03:09:13,694][123090] Updated weights for policy 1, policy_version 444038 (0.0007) [2023-12-26 03:09:13,754][123090] Updated weights for policy 1, policy_version 444048 (0.0006) [2023-12-26 03:09:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 228057088. Throughput: 0: 8641.2, 1: 8755.3. Samples: 228056468. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:13,785][121949] Avg episode reward: [(0, '6233.652'), (1, '5698.873')] [2023-12-26 03:09:13,809][123091] Updated weights for policy 0, policy_version 446804 (0.0005) [2023-12-26 03:09:13,825][123090] Updated weights for policy 1, policy_version 444058 (0.0005) [2023-12-26 03:09:13,867][123091] Updated weights for policy 0, policy_version 446814 (0.0006) [2023-12-26 03:09:13,916][123091] Updated weights for policy 0, policy_version 446824 (0.0005) [2023-12-26 03:09:14,556][123091] Updated weights for policy 0, policy_version 446834 (0.0005) [2023-12-26 03:09:14,604][123091] Updated weights for policy 0, policy_version 446844 (0.0005) [2023-12-26 03:09:14,677][123091] Updated weights for policy 0, policy_version 446854 (0.0005) [2023-12-26 03:09:14,692][123090] Updated weights for policy 1, policy_version 444068 (0.0006) [2023-12-26 03:09:14,744][123091] Updated weights for policy 0, policy_version 446864 (0.0010) [2023-12-26 03:09:14,755][123090] Updated weights for policy 1, policy_version 444078 (0.0006) [2023-12-26 03:09:14,822][123090] Updated weights for policy 1, policy_version 444088 (0.0009) [2023-12-26 03:09:15,539][123091] Updated weights for policy 0, policy_version 446874 (0.0011) [2023-12-26 03:09:15,594][123091] Updated weights for policy 0, policy_version 446884 (0.0010) [2023-12-26 03:09:15,649][123090] Updated weights for policy 1, policy_version 444098 (0.0009) [2023-12-26 03:09:15,650][123091] Updated weights for policy 0, policy_version 446894 (0.0010) [2023-12-26 03:09:15,712][123090] Updated weights for policy 1, policy_version 444108 (0.0010) [2023-12-26 03:09:15,777][123090] Updated weights for policy 1, policy_version 444118 (0.0010) [2023-12-26 03:09:15,836][123090] Updated weights for policy 1, policy_version 444128 (0.0010) [2023-12-26 03:09:16,483][123091] Updated weights for policy 0, policy_version 446904 (0.0011) [2023-12-26 03:09:16,542][123091] Updated weights for policy 0, policy_version 446914 (0.0010) [2023-12-26 03:09:16,593][123091] Updated weights for policy 0, policy_version 446924 (0.0010) [2023-12-26 03:09:16,650][123090] Updated weights for policy 1, policy_version 444138 (0.0007) [2023-12-26 03:09:16,714][123090] Updated weights for policy 1, policy_version 444148 (0.0008) [2023-12-26 03:09:16,777][123090] Updated weights for policy 1, policy_version 444158 (0.0009) [2023-12-26 03:09:17,422][123091] Updated weights for policy 0, policy_version 446934 (0.0010) [2023-12-26 03:09:17,476][123091] Updated weights for policy 0, policy_version 446944 (0.0010) [2023-12-26 03:09:17,528][123091] Updated weights for policy 0, policy_version 446954 (0.0010) [2023-12-26 03:09:17,583][123090] Updated weights for policy 1, policy_version 444168 (0.0009) [2023-12-26 03:09:17,646][123090] Updated weights for policy 1, policy_version 444178 (0.0010) [2023-12-26 03:09:17,708][123090] Updated weights for policy 1, policy_version 444188 (0.0010) [2023-12-26 03:09:18,253][123091] Updated weights for policy 0, policy_version 446964 (0.0008) [2023-12-26 03:09:18,324][123091] Updated weights for policy 0, policy_version 446974 (0.0007) [2023-12-26 03:09:18,396][123091] Updated weights for policy 0, policy_version 446984 (0.0009) [2023-12-26 03:09:18,524][123090] Updated weights for policy 1, policy_version 444198 (0.0009) [2023-12-26 03:09:18,588][123090] Updated weights for policy 1, policy_version 444208 (0.0008) [2023-12-26 03:09:18,640][123090] Updated weights for policy 1, policy_version 444218 (0.0009) [2023-12-26 03:09:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 228155392. Throughput: 0: 8668.6, 1: 8746.4. Samples: 228164132. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:18,785][121949] Avg episode reward: [(0, '6174.815'), (1, '5679.683')] [2023-12-26 03:09:19,230][123091] Updated weights for policy 0, policy_version 446994 (0.0009) [2023-12-26 03:09:19,301][123091] Updated weights for policy 0, policy_version 447004 (0.0007) [2023-12-26 03:09:19,369][123091] Updated weights for policy 0, policy_version 447014 (0.0007) [2023-12-26 03:09:19,431][123091] Updated weights for policy 0, policy_version 447024 (0.0010) [2023-12-26 03:09:19,451][123090] Updated weights for policy 1, policy_version 444228 (0.0009) [2023-12-26 03:09:19,522][123090] Updated weights for policy 1, policy_version 444238 (0.0007) [2023-12-26 03:09:19,593][123090] Updated weights for policy 1, policy_version 444248 (0.0006) [2023-12-26 03:09:20,274][123091] Updated weights for policy 0, policy_version 447034 (0.0010) [2023-12-26 03:09:20,343][123091] Updated weights for policy 0, policy_version 447044 (0.0010) [2023-12-26 03:09:20,380][123090] Updated weights for policy 1, policy_version 444258 (0.0007) [2023-12-26 03:09:20,405][123091] Updated weights for policy 0, policy_version 447054 (0.0009) [2023-12-26 03:09:20,436][123090] Updated weights for policy 1, policy_version 444268 (0.0008) [2023-12-26 03:09:20,493][123090] Updated weights for policy 1, policy_version 444278 (0.0009) [2023-12-26 03:09:20,546][123090] Updated weights for policy 1, policy_version 444288 (0.0009) [2023-12-26 03:09:21,207][123091] Updated weights for policy 0, policy_version 447064 (0.0010) [2023-12-26 03:09:21,281][123091] Updated weights for policy 0, policy_version 447074 (0.0009) [2023-12-26 03:09:21,348][123091] Updated weights for policy 0, policy_version 447084 (0.0010) [2023-12-26 03:09:21,461][123090] Updated weights for policy 1, policy_version 444298 (0.0009) [2023-12-26 03:09:21,533][123090] Updated weights for policy 1, policy_version 444308 (0.0006) [2023-12-26 03:09:21,598][123090] Updated weights for policy 1, policy_version 444318 (0.0005) [2023-12-26 03:09:22,129][123091] Updated weights for policy 0, policy_version 447094 (0.0007) [2023-12-26 03:09:22,183][123091] Updated weights for policy 0, policy_version 447104 (0.0006) [2023-12-26 03:09:22,256][123091] Updated weights for policy 0, policy_version 447114 (0.0007) [2023-12-26 03:09:22,427][123090] Updated weights for policy 1, policy_version 444328 (0.0009) [2023-12-26 03:09:22,488][123090] Updated weights for policy 1, policy_version 444338 (0.0009) [2023-12-26 03:09:22,540][123090] Updated weights for policy 1, policy_version 444348 (0.0008) [2023-12-26 03:09:23,019][123091] Updated weights for policy 0, policy_version 447124 (0.0009) [2023-12-26 03:09:23,088][123091] Updated weights for policy 0, policy_version 447134 (0.0005) [2023-12-26 03:09:23,152][123091] Updated weights for policy 0, policy_version 447144 (0.0006) [2023-12-26 03:09:23,343][123090] Updated weights for policy 1, policy_version 444358 (0.0009) [2023-12-26 03:09:23,395][123090] Updated weights for policy 1, policy_version 444368 (0.0006) [2023-12-26 03:09:23,443][123090] Updated weights for policy 1, policy_version 444378 (0.0005) [2023-12-26 03:09:23,771][123091] Updated weights for policy 0, policy_version 447154 (0.0006) [2023-12-26 03:09:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17477.4, 300 sec: 17661.4). Total num frames: 228237312. Throughput: 0: 8658.2, 1: 8697.0. Samples: 228213924. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:23,785][121949] Avg episode reward: [(0, '6135.544'), (1, '5732.530')] [2023-12-26 03:09:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000444384_113762304.pth... [2023-12-26 03:09:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000443360_113500160.pth [2023-12-26 03:09:23,838][123091] Updated weights for policy 0, policy_version 447164 (0.0005) [2023-12-26 03:09:23,898][123091] Updated weights for policy 0, policy_version 447174 (0.0009) [2023-12-26 03:09:23,963][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000447184_114483200.pth... [2023-12-26 03:09:23,966][123091] Updated weights for policy 0, policy_version 447184 (0.0010) [2023-12-26 03:09:23,969][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000446160_114221056.pth [2023-12-26 03:09:24,191][123090] Updated weights for policy 1, policy_version 444388 (0.0010) [2023-12-26 03:09:24,246][123090] Updated weights for policy 1, policy_version 444398 (0.0010) [2023-12-26 03:09:24,305][123090] Updated weights for policy 1, policy_version 444408 (0.0010) [2023-12-26 03:09:24,735][123091] Updated weights for policy 0, policy_version 447194 (0.0005) [2023-12-26 03:09:24,798][123091] Updated weights for policy 0, policy_version 447204 (0.0007) [2023-12-26 03:09:24,846][123091] Updated weights for policy 0, policy_version 447214 (0.0009) [2023-12-26 03:09:25,127][123090] Updated weights for policy 1, policy_version 444418 (0.0010) [2023-12-26 03:09:25,185][123090] Updated weights for policy 1, policy_version 444428 (0.0010) [2023-12-26 03:09:25,236][123090] Updated weights for policy 1, policy_version 444438 (0.0010) [2023-12-26 03:09:25,298][123090] Updated weights for policy 1, policy_version 444448 (0.0010) [2023-12-26 03:09:25,656][123091] Updated weights for policy 0, policy_version 447224 (0.0009) [2023-12-26 03:09:25,717][123091] Updated weights for policy 0, policy_version 447234 (0.0009) [2023-12-26 03:09:25,780][123091] Updated weights for policy 0, policy_version 447244 (0.0009) [2023-12-26 03:09:26,118][123090] Updated weights for policy 1, policy_version 444458 (0.0009) [2023-12-26 03:09:26,175][123090] Updated weights for policy 1, policy_version 444468 (0.0009) [2023-12-26 03:09:26,223][123090] Updated weights for policy 1, policy_version 444478 (0.0008) [2023-12-26 03:09:26,611][123091] Updated weights for policy 0, policy_version 447254 (0.0010) [2023-12-26 03:09:26,661][123091] Updated weights for policy 0, policy_version 447264 (0.0010) [2023-12-26 03:09:26,707][123091] Updated weights for policy 0, policy_version 447274 (0.0010) [2023-12-26 03:09:27,094][123090] Updated weights for policy 1, policy_version 444488 (0.0009) [2023-12-26 03:09:27,151][123090] Updated weights for policy 1, policy_version 444498 (0.0009) [2023-12-26 03:09:27,200][123090] Updated weights for policy 1, policy_version 444508 (0.0008) [2023-12-26 03:09:27,540][123091] Updated weights for policy 0, policy_version 447284 (0.0010) [2023-12-26 03:09:27,586][123091] Updated weights for policy 0, policy_version 447294 (0.0010) [2023-12-26 03:09:27,634][123091] Updated weights for policy 0, policy_version 447304 (0.0010) [2023-12-26 03:09:28,028][123090] Updated weights for policy 1, policy_version 444518 (0.0008) [2023-12-26 03:09:28,085][123090] Updated weights for policy 1, policy_version 444528 (0.0009) [2023-12-26 03:09:28,137][123090] Updated weights for policy 1, policy_version 444538 (0.0007) [2023-12-26 03:09:28,429][123091] Updated weights for policy 0, policy_version 447314 (0.0008) [2023-12-26 03:09:28,493][123091] Updated weights for policy 0, policy_version 447324 (0.0005) [2023-12-26 03:09:28,547][123091] Updated weights for policy 0, policy_version 447334 (0.0005) [2023-12-26 03:09:28,596][123091] Updated weights for policy 0, policy_version 447344 (0.0005) [2023-12-26 03:09:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 228327424. Throughput: 0: 8737.6, 1: 8684.5. Samples: 228320716. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:28,785][121949] Avg episode reward: [(0, '6153.949'), (1, '5774.432')] [2023-12-26 03:09:28,813][123090] Updated weights for policy 1, policy_version 444548 (0.0008) [2023-12-26 03:09:28,877][123090] Updated weights for policy 1, policy_version 444558 (0.0007) [2023-12-26 03:09:28,937][123090] Updated weights for policy 1, policy_version 444568 (0.0008) [2023-12-26 03:09:29,403][123091] Updated weights for policy 0, policy_version 447354 (0.0011) [2023-12-26 03:09:29,466][123091] Updated weights for policy 0, policy_version 447364 (0.0011) [2023-12-26 03:09:29,533][123091] Updated weights for policy 0, policy_version 447374 (0.0011) [2023-12-26 03:09:29,766][123090] Updated weights for policy 1, policy_version 444578 (0.0009) [2023-12-26 03:09:29,836][123090] Updated weights for policy 1, policy_version 444588 (0.0009) [2023-12-26 03:09:29,913][123090] Updated weights for policy 1, policy_version 444598 (0.0010) [2023-12-26 03:09:29,979][123090] Updated weights for policy 1, policy_version 444608 (0.0010) [2023-12-26 03:09:30,257][123091] Updated weights for policy 0, policy_version 447384 (0.0006) [2023-12-26 03:09:30,330][123091] Updated weights for policy 0, policy_version 447394 (0.0007) [2023-12-26 03:09:30,394][123091] Updated weights for policy 0, policy_version 447404 (0.0009) [2023-12-26 03:09:30,730][123090] Updated weights for policy 1, policy_version 444618 (0.0007) [2023-12-26 03:09:30,791][123090] Updated weights for policy 1, policy_version 444628 (0.0007) [2023-12-26 03:09:30,854][123090] Updated weights for policy 1, policy_version 444638 (0.0005) [2023-12-26 03:09:31,194][123091] Updated weights for policy 0, policy_version 447414 (0.0010) [2023-12-26 03:09:31,257][123091] Updated weights for policy 0, policy_version 447424 (0.0010) [2023-12-26 03:09:31,325][123091] Updated weights for policy 0, policy_version 447434 (0.0010) [2023-12-26 03:09:31,616][123090] Updated weights for policy 1, policy_version 444648 (0.0010) [2023-12-26 03:09:31,676][123090] Updated weights for policy 1, policy_version 444658 (0.0010) [2023-12-26 03:09:31,741][123090] Updated weights for policy 1, policy_version 444668 (0.0011) [2023-12-26 03:09:32,092][123091] Updated weights for policy 0, policy_version 447444 (0.0007) [2023-12-26 03:09:32,156][123091] Updated weights for policy 0, policy_version 447454 (0.0006) [2023-12-26 03:09:32,216][123091] Updated weights for policy 0, policy_version 447464 (0.0009) [2023-12-26 03:09:32,549][123090] Updated weights for policy 1, policy_version 444678 (0.0010) [2023-12-26 03:09:32,604][123090] Updated weights for policy 1, policy_version 444688 (0.0008) [2023-12-26 03:09:32,664][123090] Updated weights for policy 1, policy_version 444698 (0.0010) [2023-12-26 03:09:33,032][123091] Updated weights for policy 0, policy_version 447474 (0.0009) [2023-12-26 03:09:33,083][123091] Updated weights for policy 0, policy_version 447484 (0.0009) [2023-12-26 03:09:33,138][123091] Updated weights for policy 0, policy_version 447494 (0.0009) [2023-12-26 03:09:33,189][123091] Updated weights for policy 0, policy_version 447504 (0.0008) [2023-12-26 03:09:33,511][123090] Updated weights for policy 1, policy_version 444708 (0.0010) [2023-12-26 03:09:33,559][123090] Updated weights for policy 1, policy_version 444718 (0.0010) [2023-12-26 03:09:33,603][123090] Updated weights for policy 1, policy_version 444728 (0.0010) [2023-12-26 03:09:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 228417536. Throughput: 0: 8682.5, 1: 8779.4. Samples: 228427116. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:33,785][121949] Avg episode reward: [(0, '6127.910'), (1, '5800.686')] [2023-12-26 03:09:34,018][123091] Updated weights for policy 0, policy_version 447514 (0.0009) [2023-12-26 03:09:34,077][123091] Updated weights for policy 0, policy_version 447524 (0.0008) [2023-12-26 03:09:34,129][123091] Updated weights for policy 0, policy_version 447534 (0.0009) [2023-12-26 03:09:34,439][123090] Updated weights for policy 1, policy_version 444738 (0.0010) [2023-12-26 03:09:34,506][123090] Updated weights for policy 1, policy_version 444748 (0.0010) [2023-12-26 03:09:34,570][123090] Updated weights for policy 1, policy_version 444758 (0.0011) [2023-12-26 03:09:34,633][123090] Updated weights for policy 1, policy_version 444768 (0.0010) [2023-12-26 03:09:34,957][123091] Updated weights for policy 0, policy_version 447544 (0.0006) [2023-12-26 03:09:35,023][123091] Updated weights for policy 0, policy_version 447554 (0.0005) [2023-12-26 03:09:35,084][123091] Updated weights for policy 0, policy_version 447564 (0.0005) [2023-12-26 03:09:35,455][123090] Updated weights for policy 1, policy_version 444778 (0.0010) [2023-12-26 03:09:35,532][123090] Updated weights for policy 1, policy_version 444788 (0.0006) [2023-12-26 03:09:35,596][123090] Updated weights for policy 1, policy_version 444798 (0.0005) [2023-12-26 03:09:35,718][123091] Updated weights for policy 0, policy_version 447574 (0.0005) [2023-12-26 03:09:35,765][123091] Updated weights for policy 0, policy_version 447584 (0.0005) [2023-12-26 03:09:35,819][123091] Updated weights for policy 0, policy_version 447594 (0.0005) [2023-12-26 03:09:36,288][123090] Updated weights for policy 1, policy_version 444808 (0.0010) [2023-12-26 03:09:36,355][123090] Updated weights for policy 1, policy_version 444818 (0.0010) [2023-12-26 03:09:36,421][123090] Updated weights for policy 1, policy_version 444828 (0.0010) [2023-12-26 03:09:36,597][123091] Updated weights for policy 0, policy_version 447604 (0.0007) [2023-12-26 03:09:36,663][123091] Updated weights for policy 0, policy_version 447614 (0.0009) [2023-12-26 03:09:36,732][123091] Updated weights for policy 0, policy_version 447624 (0.0009) [2023-12-26 03:09:37,231][123090] Updated weights for policy 1, policy_version 444838 (0.0010) [2023-12-26 03:09:37,291][123090] Updated weights for policy 1, policy_version 444848 (0.0010) [2023-12-26 03:09:37,357][123090] Updated weights for policy 1, policy_version 444858 (0.0010) [2023-12-26 03:09:37,521][123091] Updated weights for policy 0, policy_version 447634 (0.0008) [2023-12-26 03:09:37,569][123091] Updated weights for policy 0, policy_version 447644 (0.0005) [2023-12-26 03:09:37,624][123091] Updated weights for policy 0, policy_version 447654 (0.0005) [2023-12-26 03:09:37,678][123091] Updated weights for policy 0, policy_version 447664 (0.0005) [2023-12-26 03:09:38,166][123090] Updated weights for policy 1, policy_version 444868 (0.0010) [2023-12-26 03:09:38,213][123090] Updated weights for policy 1, policy_version 444878 (0.0010) [2023-12-26 03:09:38,272][123090] Updated weights for policy 1, policy_version 444888 (0.0010) [2023-12-26 03:09:38,366][123091] Updated weights for policy 0, policy_version 447674 (0.0007) [2023-12-26 03:09:38,430][123091] Updated weights for policy 0, policy_version 447684 (0.0009) [2023-12-26 03:09:38,495][123091] Updated weights for policy 0, policy_version 447694 (0.0009) [2023-12-26 03:09:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 228507648. Throughput: 0: 8755.5, 1: 8768.5. Samples: 228482208. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:38,785][121949] Avg episode reward: [(0, '5999.150'), (1, '5812.210')] [2023-12-26 03:09:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000447696_114614272.pth... [2023-12-26 03:09:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000444896_113893376.pth... [2023-12-26 03:09:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000443904_113639424.pth [2023-12-26 03:09:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000446640_114343936.pth [2023-12-26 03:09:39,101][123090] Updated weights for policy 1, policy_version 444898 (0.0010) [2023-12-26 03:09:39,164][123090] Updated weights for policy 1, policy_version 444908 (0.0010) [2023-12-26 03:09:39,216][123090] Updated weights for policy 1, policy_version 444918 (0.0010) [2023-12-26 03:09:39,282][123090] Updated weights for policy 1, policy_version 444928 (0.0010) [2023-12-26 03:09:39,318][123091] Updated weights for policy 0, policy_version 447704 (0.0009) [2023-12-26 03:09:39,384][123091] Updated weights for policy 0, policy_version 447714 (0.0010) [2023-12-26 03:09:39,450][123091] Updated weights for policy 0, policy_version 447724 (0.0010) [2023-12-26 03:09:40,160][123090] Updated weights for policy 1, policy_version 444938 (0.0010) [2023-12-26 03:09:40,231][123090] Updated weights for policy 1, policy_version 444948 (0.0010) [2023-12-26 03:09:40,267][123091] Updated weights for policy 0, policy_version 447734 (0.0010) [2023-12-26 03:09:40,295][123090] Updated weights for policy 1, policy_version 444958 (0.0009) [2023-12-26 03:09:40,336][123091] Updated weights for policy 0, policy_version 447744 (0.0009) [2023-12-26 03:09:40,396][123091] Updated weights for policy 0, policy_version 447754 (0.0010) [2023-12-26 03:09:41,005][123090] Updated weights for policy 1, policy_version 444968 (0.0006) [2023-12-26 03:09:41,080][123090] Updated weights for policy 1, policy_version 444978 (0.0008) [2023-12-26 03:09:41,158][123090] Updated weights for policy 1, policy_version 444988 (0.0008) [2023-12-26 03:09:41,270][123091] Updated weights for policy 0, policy_version 447764 (0.0009) [2023-12-26 03:09:41,346][123091] Updated weights for policy 0, policy_version 447774 (0.0007) [2023-12-26 03:09:41,421][123091] Updated weights for policy 0, policy_version 447784 (0.0010) [2023-12-26 03:09:41,909][123090] Updated weights for policy 1, policy_version 444998 (0.0008) [2023-12-26 03:09:41,968][123090] Updated weights for policy 1, policy_version 445008 (0.0009) [2023-12-26 03:09:42,026][123090] Updated weights for policy 1, policy_version 445018 (0.0009) [2023-12-26 03:09:42,280][123091] Updated weights for policy 0, policy_version 447794 (0.0010) [2023-12-26 03:09:42,341][123091] Updated weights for policy 0, policy_version 447804 (0.0009) [2023-12-26 03:09:42,409][123091] Updated weights for policy 0, policy_version 447814 (0.0009) [2023-12-26 03:09:42,468][123091] Updated weights for policy 0, policy_version 447824 (0.0008) [2023-12-26 03:09:42,745][123090] Updated weights for policy 1, policy_version 445028 (0.0008) [2023-12-26 03:09:42,813][123090] Updated weights for policy 1, policy_version 445038 (0.0005) [2023-12-26 03:09:42,881][123090] Updated weights for policy 1, policy_version 445048 (0.0006) [2023-12-26 03:09:43,238][123091] Updated weights for policy 0, policy_version 447834 (0.0006) [2023-12-26 03:09:43,311][123091] Updated weights for policy 0, policy_version 447844 (0.0005) [2023-12-26 03:09:43,386][123091] Updated weights for policy 0, policy_version 447854 (0.0006) [2023-12-26 03:09:43,585][123090] Updated weights for policy 1, policy_version 445058 (0.0005) [2023-12-26 03:09:43,639][123090] Updated weights for policy 1, policy_version 445068 (0.0005) [2023-12-26 03:09:43,694][123090] Updated weights for policy 1, policy_version 445078 (0.0005) [2023-12-26 03:09:43,741][123090] Updated weights for policy 1, policy_version 445088 (0.0005) [2023-12-26 03:09:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 228597760. Throughput: 0: 8769.5, 1: 8783.5. Samples: 228586604. Policy #0 lag: (min: 23.0, avg: 26.0, max: 55.0) [2023-12-26 03:09:43,785][121949] Avg episode reward: [(0, '5887.090'), (1, '5753.935')] [2023-12-26 03:09:44,134][123091] Updated weights for policy 0, policy_version 447864 (0.0006) [2023-12-26 03:09:44,190][123091] Updated weights for policy 0, policy_version 447874 (0.0008) [2023-12-26 03:09:44,247][123091] Updated weights for policy 0, policy_version 447884 (0.0006) [2023-12-26 03:09:44,407][123090] Updated weights for policy 1, policy_version 445098 (0.0009) [2023-12-26 03:09:44,468][123090] Updated weights for policy 1, policy_version 445108 (0.0010) [2023-12-26 03:09:44,538][123090] Updated weights for policy 1, policy_version 445118 (0.0010) [2023-12-26 03:09:45,035][123091] Updated weights for policy 0, policy_version 447894 (0.0009) [2023-12-26 03:09:45,103][123091] Updated weights for policy 0, policy_version 447904 (0.0011) [2023-12-26 03:09:45,167][123091] Updated weights for policy 0, policy_version 447914 (0.0012) [2023-12-26 03:09:45,376][123090] Updated weights for policy 1, policy_version 445128 (0.0008) [2023-12-26 03:09:45,430][123090] Updated weights for policy 1, policy_version 445138 (0.0011) [2023-12-26 03:09:45,486][123090] Updated weights for policy 1, policy_version 445148 (0.0011) [2023-12-26 03:09:45,995][123091] Updated weights for policy 0, policy_version 447924 (0.0009) [2023-12-26 03:09:46,041][123091] Updated weights for policy 0, policy_version 447934 (0.0005) [2023-12-26 03:09:46,098][123091] Updated weights for policy 0, policy_version 447944 (0.0008) [2023-12-26 03:09:46,220][123090] Updated weights for policy 1, policy_version 445158 (0.0007) [2023-12-26 03:09:46,277][123090] Updated weights for policy 1, policy_version 445168 (0.0007) [2023-12-26 03:09:46,344][123090] Updated weights for policy 1, policy_version 445178 (0.0010) [2023-12-26 03:09:46,878][123091] Updated weights for policy 0, policy_version 447954 (0.0010) [2023-12-26 03:09:46,931][123091] Updated weights for policy 0, policy_version 447964 (0.0009) [2023-12-26 03:09:46,980][123091] Updated weights for policy 0, policy_version 447974 (0.0009) [2023-12-26 03:09:47,028][123091] Updated weights for policy 0, policy_version 447984 (0.0009) [2023-12-26 03:09:47,143][123090] Updated weights for policy 1, policy_version 445188 (0.0010) [2023-12-26 03:09:47,206][123090] Updated weights for policy 1, policy_version 445198 (0.0010) [2023-12-26 03:09:47,261][123090] Updated weights for policy 1, policy_version 445208 (0.0010) [2023-12-26 03:09:47,818][123091] Updated weights for policy 0, policy_version 447994 (0.0005) [2023-12-26 03:09:47,885][123091] Updated weights for policy 0, policy_version 448004 (0.0005) [2023-12-26 03:09:47,950][123091] Updated weights for policy 0, policy_version 448014 (0.0005) [2023-12-26 03:09:47,997][123090] Updated weights for policy 1, policy_version 445218 (0.0009) [2023-12-26 03:09:48,063][123090] Updated weights for policy 1, policy_version 445228 (0.0010) [2023-12-26 03:09:48,122][123090] Updated weights for policy 1, policy_version 445238 (0.0006) [2023-12-26 03:09:48,173][123090] Updated weights for policy 1, policy_version 445248 (0.0005) [2023-12-26 03:09:48,660][123091] Updated weights for policy 0, policy_version 448024 (0.0007) [2023-12-26 03:09:48,734][123091] Updated weights for policy 0, policy_version 448034 (0.0006) [2023-12-26 03:09:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 228679680. Throughput: 0: 8850.4, 1: 8809.2. Samples: 228696844. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:09:48,784][121949] Avg episode reward: [(0, '6062.710'), (1, '5680.880')] [2023-12-26 03:09:48,807][123091] Updated weights for policy 0, policy_version 448044 (0.0007) [2023-12-26 03:09:48,982][123090] Updated weights for policy 1, policy_version 445258 (0.0005) [2023-12-26 03:09:49,054][123090] Updated weights for policy 1, policy_version 445268 (0.0005) [2023-12-26 03:09:49,124][123090] Updated weights for policy 1, policy_version 445278 (0.0006) [2023-12-26 03:09:49,573][123091] Updated weights for policy 0, policy_version 448054 (0.0010) [2023-12-26 03:09:49,628][123091] Updated weights for policy 0, policy_version 448064 (0.0010) [2023-12-26 03:09:49,679][123091] Updated weights for policy 0, policy_version 448074 (0.0010) [2023-12-26 03:09:49,847][123090] Updated weights for policy 1, policy_version 445288 (0.0009) [2023-12-26 03:09:49,927][123090] Updated weights for policy 1, policy_version 445298 (0.0009) [2023-12-26 03:09:49,989][123090] Updated weights for policy 1, policy_version 445308 (0.0010) [2023-12-26 03:09:50,412][123091] Updated weights for policy 0, policy_version 448084 (0.0008) [2023-12-26 03:09:50,487][123091] Updated weights for policy 0, policy_version 448094 (0.0006) [2023-12-26 03:09:50,564][123091] Updated weights for policy 0, policy_version 448104 (0.0006) [2023-12-26 03:09:50,897][123090] Updated weights for policy 1, policy_version 445318 (0.0009) [2023-12-26 03:09:50,961][123090] Updated weights for policy 1, policy_version 445328 (0.0007) [2023-12-26 03:09:51,049][123090] Updated weights for policy 1, policy_version 445338 (0.0010) [2023-12-26 03:09:51,284][123091] Updated weights for policy 0, policy_version 448114 (0.0009) [2023-12-26 03:09:51,349][123091] Updated weights for policy 0, policy_version 448124 (0.0010) [2023-12-26 03:09:51,422][123091] Updated weights for policy 0, policy_version 448134 (0.0010) [2023-12-26 03:09:51,488][123091] Updated weights for policy 0, policy_version 448144 (0.0010) [2023-12-26 03:09:51,892][123090] Updated weights for policy 1, policy_version 445348 (0.0009) [2023-12-26 03:09:51,953][123090] Updated weights for policy 1, policy_version 445358 (0.0010) [2023-12-26 03:09:52,014][123090] Updated weights for policy 1, policy_version 445368 (0.0009) [2023-12-26 03:09:52,288][123091] Updated weights for policy 0, policy_version 448154 (0.0010) [2023-12-26 03:09:52,344][123091] Updated weights for policy 0, policy_version 448164 (0.0009) [2023-12-26 03:09:52,393][123091] Updated weights for policy 0, policy_version 448174 (0.0009) [2023-12-26 03:09:52,823][123090] Updated weights for policy 1, policy_version 445378 (0.0010) [2023-12-26 03:09:52,881][123090] Updated weights for policy 1, policy_version 445388 (0.0009) [2023-12-26 03:09:52,940][123090] Updated weights for policy 1, policy_version 445398 (0.0009) [2023-12-26 03:09:52,993][123090] Updated weights for policy 1, policy_version 445408 (0.0009) [2023-12-26 03:09:53,251][123091] Updated weights for policy 0, policy_version 448184 (0.0010) [2023-12-26 03:09:53,300][123091] Updated weights for policy 0, policy_version 448194 (0.0009) [2023-12-26 03:09:53,363][123091] Updated weights for policy 0, policy_version 448204 (0.0009) [2023-12-26 03:09:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 228769792. Throughput: 0: 8910.9, 1: 8756.1. Samples: 228749272. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:09:53,785][121949] Avg episode reward: [(0, '6147.795'), (1, '5607.870')] [2023-12-26 03:09:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000448208_114745344.pth... [2023-12-26 03:09:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000447184_114483200.pth [2023-12-26 03:09:53,829][123090] Updated weights for policy 1, policy_version 445419 (0.0009) [2023-12-26 03:09:53,887][123090] Updated weights for policy 1, policy_version 445430 (0.0010) [2023-12-26 03:09:53,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000445440_114032640.pth... [2023-12-26 03:09:53,938][123090] Updated weights for policy 1, policy_version 445440 (0.0009) [2023-12-26 03:09:53,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000444384_113762304.pth [2023-12-26 03:09:54,242][123091] Updated weights for policy 0, policy_version 448214 (0.0010) [2023-12-26 03:09:54,295][123091] Updated weights for policy 0, policy_version 448224 (0.0010) [2023-12-26 03:09:54,348][123091] Updated weights for policy 0, policy_version 448234 (0.0009) [2023-12-26 03:09:54,735][123090] Updated weights for policy 1, policy_version 445450 (0.0008) [2023-12-26 03:09:54,790][123090] Updated weights for policy 1, policy_version 445460 (0.0009) [2023-12-26 03:09:54,845][123090] Updated weights for policy 1, policy_version 445470 (0.0009) [2023-12-26 03:09:55,142][123091] Updated weights for policy 0, policy_version 448244 (0.0008) [2023-12-26 03:09:55,206][123091] Updated weights for policy 0, policy_version 448254 (0.0008) [2023-12-26 03:09:55,267][123091] Updated weights for policy 0, policy_version 448264 (0.0008) [2023-12-26 03:09:55,658][123090] Updated weights for policy 1, policy_version 445480 (0.0008) [2023-12-26 03:09:55,706][123090] Updated weights for policy 1, policy_version 445491 (0.0009) [2023-12-26 03:09:55,758][123090] Updated weights for policy 1, policy_version 445501 (0.0008) [2023-12-26 03:09:56,142][123091] Updated weights for policy 0, policy_version 448274 (0.0009) [2023-12-26 03:09:56,211][123091] Updated weights for policy 0, policy_version 448284 (0.0009) [2023-12-26 03:09:56,286][123091] Updated weights for policy 0, policy_version 448294 (0.0010) [2023-12-26 03:09:56,351][123091] Updated weights for policy 0, policy_version 448304 (0.0010) [2023-12-26 03:09:56,565][123090] Updated weights for policy 1, policy_version 445511 (0.0010) [2023-12-26 03:09:56,626][123090] Updated weights for policy 1, policy_version 445521 (0.0010) [2023-12-26 03:09:56,686][123090] Updated weights for policy 1, policy_version 445531 (0.0009) [2023-12-26 03:09:57,139][123091] Updated weights for policy 0, policy_version 448314 (0.0010) [2023-12-26 03:09:57,198][123091] Updated weights for policy 0, policy_version 448324 (0.0010) [2023-12-26 03:09:57,256][123091] Updated weights for policy 0, policy_version 448334 (0.0009) [2023-12-26 03:09:57,448][123090] Updated weights for policy 1, policy_version 445541 (0.0009) [2023-12-26 03:09:57,507][123090] Updated weights for policy 1, policy_version 445551 (0.0009) [2023-12-26 03:09:57,564][123090] Updated weights for policy 1, policy_version 445561 (0.0008) [2023-12-26 03:09:58,085][123091] Updated weights for policy 0, policy_version 448344 (0.0010) [2023-12-26 03:09:58,145][123091] Updated weights for policy 0, policy_version 448354 (0.0008) [2023-12-26 03:09:58,213][123091] Updated weights for policy 0, policy_version 448364 (0.0008) [2023-12-26 03:09:58,341][123090] Updated weights for policy 1, policy_version 445571 (0.0008) [2023-12-26 03:09:58,409][123090] Updated weights for policy 1, policy_version 445581 (0.0010) [2023-12-26 03:09:58,486][123090] Updated weights for policy 1, policy_version 445591 (0.0007) [2023-12-26 03:09:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 228859904. Throughput: 0: 8913.6, 1: 8799.3. Samples: 228853548. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:09:58,784][121949] Avg episode reward: [(0, '6074.245'), (1, '5501.726')] [2023-12-26 03:09:59,000][123091] Updated weights for policy 0, policy_version 448374 (0.0007) [2023-12-26 03:09:59,069][123091] Updated weights for policy 0, policy_version 448384 (0.0007) [2023-12-26 03:09:59,124][123091] Updated weights for policy 0, policy_version 448394 (0.0007) [2023-12-26 03:09:59,321][123090] Updated weights for policy 1, policy_version 445601 (0.0009) [2023-12-26 03:09:59,394][123090] Updated weights for policy 1, policy_version 445611 (0.0009) [2023-12-26 03:09:59,455][123090] Updated weights for policy 1, policy_version 445621 (0.0009) [2023-12-26 03:09:59,513][123090] Updated weights for policy 1, policy_version 445631 (0.0010) [2023-12-26 03:09:59,925][123091] Updated weights for policy 0, policy_version 448404 (0.0007) [2023-12-26 03:09:59,996][123091] Updated weights for policy 0, policy_version 448414 (0.0009) [2023-12-26 03:10:00,064][123091] Updated weights for policy 0, policy_version 448424 (0.0010) [2023-12-26 03:10:00,290][123090] Updated weights for policy 1, policy_version 445641 (0.0008) [2023-12-26 03:10:00,344][123090] Updated weights for policy 1, policy_version 445651 (0.0008) [2023-12-26 03:10:00,414][123090] Updated weights for policy 1, policy_version 445661 (0.0006) [2023-12-26 03:10:00,871][123091] Updated weights for policy 0, policy_version 448434 (0.0010) [2023-12-26 03:10:00,919][123091] Updated weights for policy 0, policy_version 448444 (0.0009) [2023-12-26 03:10:00,966][123091] Updated weights for policy 0, policy_version 448454 (0.0009) [2023-12-26 03:10:01,186][123090] Updated weights for policy 1, policy_version 445671 (0.0009) [2023-12-26 03:10:01,243][123090] Updated weights for policy 1, policy_version 445681 (0.0011) [2023-12-26 03:10:01,308][123090] Updated weights for policy 1, policy_version 445691 (0.0009) [2023-12-26 03:10:01,814][123091] Updated weights for policy 0, policy_version 448465 (0.0009) [2023-12-26 03:10:01,870][123091] Updated weights for policy 0, policy_version 448475 (0.0010) [2023-12-26 03:10:01,925][123091] Updated weights for policy 0, policy_version 448485 (0.0010) [2023-12-26 03:10:01,976][123091] Updated weights for policy 0, policy_version 448495 (0.0010) [2023-12-26 03:10:02,091][123090] Updated weights for policy 1, policy_version 445701 (0.0006) [2023-12-26 03:10:02,166][123090] Updated weights for policy 1, policy_version 445711 (0.0005) [2023-12-26 03:10:02,234][123090] Updated weights for policy 1, policy_version 445721 (0.0005) [2023-12-26 03:10:02,821][123091] Updated weights for policy 0, policy_version 448506 (0.0009) [2023-12-26 03:10:02,859][123090] Updated weights for policy 1, policy_version 445731 (0.0007) [2023-12-26 03:10:02,886][123091] Updated weights for policy 0, policy_version 448516 (0.0007) [2023-12-26 03:10:02,925][123090] Updated weights for policy 1, policy_version 445741 (0.0005) [2023-12-26 03:10:02,957][123091] Updated weights for policy 0, policy_version 448526 (0.0006) [2023-12-26 03:10:02,981][123090] Updated weights for policy 1, policy_version 445751 (0.0005) [2023-12-26 03:10:03,540][123091] Updated weights for policy 0, policy_version 448536 (0.0006) [2023-12-26 03:10:03,597][123091] Updated weights for policy 0, policy_version 448546 (0.0007) [2023-12-26 03:10:03,616][123090] Updated weights for policy 1, policy_version 445761 (0.0006) [2023-12-26 03:10:03,654][123091] Updated weights for policy 0, policy_version 448556 (0.0007) [2023-12-26 03:10:03,665][123090] Updated weights for policy 1, policy_version 445771 (0.0005) [2023-12-26 03:10:03,712][123090] Updated weights for policy 1, policy_version 445781 (0.0005) [2023-12-26 03:10:03,758][123090] Updated weights for policy 1, policy_version 445791 (0.0005) [2023-12-26 03:10:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 228958208. Throughput: 0: 8855.4, 1: 8897.1. Samples: 228962992. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:03,785][121949] Avg episode reward: [(0, '6175.667'), (1, '5548.737')] [2023-12-26 03:10:04,428][123091] Updated weights for policy 0, policy_version 448566 (0.0006) [2023-12-26 03:10:04,487][123091] Updated weights for policy 0, policy_version 448576 (0.0005) [2023-12-26 03:10:04,537][123091] Updated weights for policy 0, policy_version 448586 (0.0005) [2023-12-26 03:10:04,594][123090] Updated weights for policy 1, policy_version 445801 (0.0008) [2023-12-26 03:10:04,646][123090] Updated weights for policy 1, policy_version 445811 (0.0009) [2023-12-26 03:10:04,718][123090] Updated weights for policy 1, policy_version 445821 (0.0009) [2023-12-26 03:10:05,251][123091] Updated weights for policy 0, policy_version 448596 (0.0008) [2023-12-26 03:10:05,300][123091] Updated weights for policy 0, policy_version 448606 (0.0009) [2023-12-26 03:10:05,358][123091] Updated weights for policy 0, policy_version 448616 (0.0008) [2023-12-26 03:10:05,586][123090] Updated weights for policy 1, policy_version 445831 (0.0009) [2023-12-26 03:10:05,643][123090] Updated weights for policy 1, policy_version 445842 (0.0010) [2023-12-26 03:10:05,698][123090] Updated weights for policy 1, policy_version 445852 (0.0009) [2023-12-26 03:10:06,179][123091] Updated weights for policy 0, policy_version 448626 (0.0009) [2023-12-26 03:10:06,239][123091] Updated weights for policy 0, policy_version 448636 (0.0010) [2023-12-26 03:10:06,290][123091] Updated weights for policy 0, policy_version 448646 (0.0010) [2023-12-26 03:10:06,347][123091] Updated weights for policy 0, policy_version 448656 (0.0009) [2023-12-26 03:10:06,569][123090] Updated weights for policy 1, policy_version 445862 (0.0010) [2023-12-26 03:10:06,632][123090] Updated weights for policy 1, policy_version 445872 (0.0009) [2023-12-26 03:10:06,686][123090] Updated weights for policy 1, policy_version 445882 (0.0009) [2023-12-26 03:10:07,234][123091] Updated weights for policy 0, policy_version 448666 (0.0010) [2023-12-26 03:10:07,290][123091] Updated weights for policy 0, policy_version 448676 (0.0010) [2023-12-26 03:10:07,339][123091] Updated weights for policy 0, policy_version 448686 (0.0009) [2023-12-26 03:10:07,490][123090] Updated weights for policy 1, policy_version 445892 (0.0008) [2023-12-26 03:10:07,541][123090] Updated weights for policy 1, policy_version 445902 (0.0009) [2023-12-26 03:10:07,592][123090] Updated weights for policy 1, policy_version 445912 (0.0009) [2023-12-26 03:10:08,046][123091] Updated weights for policy 0, policy_version 448696 (0.0009) [2023-12-26 03:10:08,098][123091] Updated weights for policy 0, policy_version 448707 (0.0010) [2023-12-26 03:10:08,146][123091] Updated weights for policy 0, policy_version 448717 (0.0009) [2023-12-26 03:10:08,325][123090] Updated weights for policy 1, policy_version 445922 (0.0009) [2023-12-26 03:10:08,394][123090] Updated weights for policy 1, policy_version 445932 (0.0010) [2023-12-26 03:10:08,461][123090] Updated weights for policy 1, policy_version 445942 (0.0011) [2023-12-26 03:10:08,531][123090] Updated weights for policy 1, policy_version 445952 (0.0010) [2023-12-26 03:10:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 229040128. Throughput: 0: 8911.1, 1: 8897.6. Samples: 229015316. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:08,785][121949] Avg episode reward: [(0, '6139.659'), (1, '5703.448')] [2023-12-26 03:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000445952_114163712.pth... [2023-12-26 03:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000448720_114876416.pth... [2023-12-26 03:10:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000447696_114614272.pth [2023-12-26 03:10:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000444896_113893376.pth [2023-12-26 03:10:08,948][123091] Updated weights for policy 0, policy_version 448727 (0.0011) [2023-12-26 03:10:09,019][123091] Updated weights for policy 0, policy_version 448737 (0.0011) [2023-12-26 03:10:09,089][123091] Updated weights for policy 0, policy_version 448747 (0.0011) [2023-12-26 03:10:09,259][123090] Updated weights for policy 1, policy_version 445962 (0.0010) [2023-12-26 03:10:09,312][123090] Updated weights for policy 1, policy_version 445972 (0.0010) [2023-12-26 03:10:09,381][123090] Updated weights for policy 1, policy_version 445982 (0.0011) [2023-12-26 03:10:09,943][123091] Updated weights for policy 0, policy_version 448757 (0.0010) [2023-12-26 03:10:09,998][123091] Updated weights for policy 0, policy_version 448767 (0.0009) [2023-12-26 03:10:10,048][123091] Updated weights for policy 0, policy_version 448777 (0.0009) [2023-12-26 03:10:10,209][123090] Updated weights for policy 1, policy_version 445992 (0.0011) [2023-12-26 03:10:10,270][123090] Updated weights for policy 1, policy_version 446003 (0.0011) [2023-12-26 03:10:10,326][123090] Updated weights for policy 1, policy_version 446013 (0.0010) [2023-12-26 03:10:10,907][123091] Updated weights for policy 0, policy_version 448787 (0.0008) [2023-12-26 03:10:10,977][123091] Updated weights for policy 0, policy_version 448797 (0.0006) [2023-12-26 03:10:11,045][123091] Updated weights for policy 0, policy_version 448807 (0.0008) [2023-12-26 03:10:11,186][123090] Updated weights for policy 1, policy_version 446023 (0.0008) [2023-12-26 03:10:11,255][123090] Updated weights for policy 1, policy_version 446033 (0.0006) [2023-12-26 03:10:11,328][123090] Updated weights for policy 1, policy_version 446043 (0.0008) [2023-12-26 03:10:11,831][123091] Updated weights for policy 0, policy_version 448817 (0.0009) [2023-12-26 03:10:11,891][123091] Updated weights for policy 0, policy_version 448827 (0.0010) [2023-12-26 03:10:11,953][123091] Updated weights for policy 0, policy_version 448838 (0.0012) [2023-12-26 03:10:12,008][123091] Updated weights for policy 0, policy_version 448848 (0.0010) [2023-12-26 03:10:12,151][123090] Updated weights for policy 1, policy_version 446053 (0.0009) [2023-12-26 03:10:12,218][123090] Updated weights for policy 1, policy_version 446063 (0.0010) [2023-12-26 03:10:12,284][123090] Updated weights for policy 1, policy_version 446073 (0.0010) [2023-12-26 03:10:12,745][123091] Updated weights for policy 0, policy_version 448858 (0.0010) [2023-12-26 03:10:12,793][123091] Updated weights for policy 0, policy_version 448868 (0.0010) [2023-12-26 03:10:12,850][123091] Updated weights for policy 0, policy_version 448878 (0.0006) [2023-12-26 03:10:13,130][123090] Updated weights for policy 1, policy_version 446083 (0.0008) [2023-12-26 03:10:13,183][123090] Updated weights for policy 1, policy_version 446093 (0.0005) [2023-12-26 03:10:13,238][123090] Updated weights for policy 1, policy_version 446103 (0.0005) [2023-12-26 03:10:13,596][123091] Updated weights for policy 0, policy_version 448888 (0.0006) [2023-12-26 03:10:13,653][123091] Updated weights for policy 0, policy_version 448898 (0.0006) [2023-12-26 03:10:13,721][123091] Updated weights for policy 0, policy_version 448908 (0.0005) [2023-12-26 03:10:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 229130240. Throughput: 0: 8860.6, 1: 8900.3. Samples: 229119952. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:13,785][121949] Avg episode reward: [(0, '6088.465'), (1, '5731.514')] [2023-12-26 03:10:13,929][123090] Updated weights for policy 1, policy_version 446113 (0.0006) [2023-12-26 03:10:14,001][123090] Updated weights for policy 1, policy_version 446123 (0.0010) [2023-12-26 03:10:14,073][123090] Updated weights for policy 1, policy_version 446133 (0.0010) [2023-12-26 03:10:14,138][123090] Updated weights for policy 1, policy_version 446143 (0.0009) [2023-12-26 03:10:14,429][123091] Updated weights for policy 0, policy_version 448918 (0.0008) [2023-12-26 03:10:14,495][123091] Updated weights for policy 0, policy_version 448928 (0.0011) [2023-12-26 03:10:14,542][123091] Updated weights for policy 0, policy_version 448938 (0.0010) [2023-12-26 03:10:14,894][123090] Updated weights for policy 1, policy_version 446153 (0.0009) [2023-12-26 03:10:14,956][123090] Updated weights for policy 1, policy_version 446163 (0.0009) [2023-12-26 03:10:15,022][123090] Updated weights for policy 1, policy_version 446173 (0.0009) [2023-12-26 03:10:15,358][123091] Updated weights for policy 0, policy_version 448948 (0.0011) [2023-12-26 03:10:15,410][123091] Updated weights for policy 0, policy_version 448958 (0.0011) [2023-12-26 03:10:15,494][123091] Updated weights for policy 0, policy_version 448968 (0.0011) [2023-12-26 03:10:15,882][123090] Updated weights for policy 1, policy_version 446183 (0.0009) [2023-12-26 03:10:15,941][123090] Updated weights for policy 1, policy_version 446194 (0.0009) [2023-12-26 03:10:16,005][123090] Updated weights for policy 1, policy_version 446204 (0.0010) [2023-12-26 03:10:16,288][123091] Updated weights for policy 0, policy_version 448978 (0.0010) [2023-12-26 03:10:16,339][123091] Updated weights for policy 0, policy_version 448988 (0.0008) [2023-12-26 03:10:16,391][123091] Updated weights for policy 0, policy_version 448998 (0.0005) [2023-12-26 03:10:16,462][123091] Updated weights for policy 0, policy_version 449008 (0.0008) [2023-12-26 03:10:16,871][123090] Updated weights for policy 1, policy_version 446214 (0.0009) [2023-12-26 03:10:16,931][123090] Updated weights for policy 1, policy_version 446224 (0.0010) [2023-12-26 03:10:16,994][123090] Updated weights for policy 1, policy_version 446234 (0.0011) [2023-12-26 03:10:17,213][123091] Updated weights for policy 0, policy_version 449018 (0.0010) [2023-12-26 03:10:17,275][123091] Updated weights for policy 0, policy_version 449028 (0.0011) [2023-12-26 03:10:17,326][123091] Updated weights for policy 0, policy_version 449038 (0.0011) [2023-12-26 03:10:17,751][123090] Updated weights for policy 1, policy_version 446244 (0.0011) [2023-12-26 03:10:17,813][123090] Updated weights for policy 1, policy_version 446254 (0.0010) [2023-12-26 03:10:17,872][123090] Updated weights for policy 1, policy_version 446264 (0.0007) [2023-12-26 03:10:18,147][123091] Updated weights for policy 0, policy_version 449048 (0.0010) [2023-12-26 03:10:18,195][123091] Updated weights for policy 0, policy_version 449058 (0.0010) [2023-12-26 03:10:18,242][123091] Updated weights for policy 0, policy_version 449068 (0.0010) [2023-12-26 03:10:18,554][123090] Updated weights for policy 1, policy_version 446274 (0.0006) [2023-12-26 03:10:18,618][123090] Updated weights for policy 1, policy_version 446284 (0.0008) [2023-12-26 03:10:18,680][123090] Updated weights for policy 1, policy_version 446294 (0.0010) [2023-12-26 03:10:18,732][123090] Updated weights for policy 1, policy_version 446304 (0.0010) [2023-12-26 03:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 229220352. Throughput: 0: 8909.7, 1: 8920.4. Samples: 229229468. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:18,785][121949] Avg episode reward: [(0, '6070.878'), (1, '5642.092')] [2023-12-26 03:10:19,096][123091] Updated weights for policy 0, policy_version 449078 (0.0007) [2023-12-26 03:10:19,146][123091] Updated weights for policy 0, policy_version 449088 (0.0005) [2023-12-26 03:10:19,204][123091] Updated weights for policy 0, policy_version 449098 (0.0006) [2023-12-26 03:10:19,456][123090] Updated weights for policy 1, policy_version 446314 (0.0008) [2023-12-26 03:10:19,526][123090] Updated weights for policy 1, policy_version 446324 (0.0008) [2023-12-26 03:10:19,593][123090] Updated weights for policy 1, policy_version 446334 (0.0009) [2023-12-26 03:10:20,046][123091] Updated weights for policy 0, policy_version 449108 (0.0009) [2023-12-26 03:10:20,111][123091] Updated weights for policy 0, policy_version 449118 (0.0005) [2023-12-26 03:10:20,177][123091] Updated weights for policy 0, policy_version 449128 (0.0005) [2023-12-26 03:10:20,401][123090] Updated weights for policy 1, policy_version 446344 (0.0010) [2023-12-26 03:10:20,468][123090] Updated weights for policy 1, policy_version 446354 (0.0011) [2023-12-26 03:10:20,539][123090] Updated weights for policy 1, policy_version 446364 (0.0011) [2023-12-26 03:10:20,868][123091] Updated weights for policy 0, policy_version 449138 (0.0006) [2023-12-26 03:10:20,936][123091] Updated weights for policy 0, policy_version 449148 (0.0009) [2023-12-26 03:10:20,996][123091] Updated weights for policy 0, policy_version 449158 (0.0006) [2023-12-26 03:10:21,064][123091] Updated weights for policy 0, policy_version 449168 (0.0008) [2023-12-26 03:10:21,386][123090] Updated weights for policy 1, policy_version 446374 (0.0011) [2023-12-26 03:10:21,463][123090] Updated weights for policy 1, policy_version 446384 (0.0008) [2023-12-26 03:10:21,529][123090] Updated weights for policy 1, policy_version 446394 (0.0005) [2023-12-26 03:10:21,935][123091] Updated weights for policy 0, policy_version 449178 (0.0010) [2023-12-26 03:10:22,018][123091] Updated weights for policy 0, policy_version 449188 (0.0010) [2023-12-26 03:10:22,091][123091] Updated weights for policy 0, policy_version 449198 (0.0009) [2023-12-26 03:10:22,251][123090] Updated weights for policy 1, policy_version 446404 (0.0007) [2023-12-26 03:10:22,323][123090] Updated weights for policy 1, policy_version 446414 (0.0010) [2023-12-26 03:10:22,401][123090] Updated weights for policy 1, policy_version 446424 (0.0009) [2023-12-26 03:10:22,942][123091] Updated weights for policy 0, policy_version 449208 (0.0010) [2023-12-26 03:10:23,012][123091] Updated weights for policy 0, policy_version 449218 (0.0009) [2023-12-26 03:10:23,075][123091] Updated weights for policy 0, policy_version 449228 (0.0010) [2023-12-26 03:10:23,175][123090] Updated weights for policy 1, policy_version 446434 (0.0009) [2023-12-26 03:10:23,244][123090] Updated weights for policy 1, policy_version 446444 (0.0005) [2023-12-26 03:10:23,307][123090] Updated weights for policy 1, policy_version 446454 (0.0005) [2023-12-26 03:10:23,360][123090] Updated weights for policy 1, policy_version 446464 (0.0008) [2023-12-26 03:10:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 229302272. Throughput: 0: 8885.3, 1: 8894.4. Samples: 229282296. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:23,784][121949] Avg episode reward: [(0, '5983.667'), (1, '5675.324')] [2023-12-26 03:10:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000449232_115007488.pth... [2023-12-26 03:10:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000446464_114294784.pth... [2023-12-26 03:10:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000448208_114745344.pth [2023-12-26 03:10:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000445440_114032640.pth [2023-12-26 03:10:23,937][123091] Updated weights for policy 0, policy_version 449238 (0.0009) [2023-12-26 03:10:23,985][123091] Updated weights for policy 0, policy_version 449248 (0.0009) [2023-12-26 03:10:24,041][123091] Updated weights for policy 0, policy_version 449258 (0.0009) [2023-12-26 03:10:24,119][123090] Updated weights for policy 1, policy_version 446474 (0.0006) [2023-12-26 03:10:24,184][123090] Updated weights for policy 1, policy_version 446484 (0.0005) [2023-12-26 03:10:24,237][123090] Updated weights for policy 1, policy_version 446494 (0.0005) [2023-12-26 03:10:24,853][123091] Updated weights for policy 0, policy_version 449268 (0.0008) [2023-12-26 03:10:24,903][123091] Updated weights for policy 0, policy_version 449278 (0.0009) [2023-12-26 03:10:24,952][123091] Updated weights for policy 0, policy_version 449288 (0.0008) [2023-12-26 03:10:24,963][123090] Updated weights for policy 1, policy_version 446504 (0.0007) [2023-12-26 03:10:25,021][123090] Updated weights for policy 1, policy_version 446514 (0.0008) [2023-12-26 03:10:25,073][123090] Updated weights for policy 1, policy_version 446524 (0.0009) [2023-12-26 03:10:25,689][123091] Updated weights for policy 0, policy_version 449298 (0.0008) [2023-12-26 03:10:25,756][123091] Updated weights for policy 0, policy_version 449308 (0.0009) [2023-12-26 03:10:25,808][123091] Updated weights for policy 0, policy_version 449318 (0.0009) [2023-12-26 03:10:25,876][123091] Updated weights for policy 0, policy_version 449328 (0.0005) [2023-12-26 03:10:25,933][123090] Updated weights for policy 1, policy_version 446534 (0.0009) [2023-12-26 03:10:25,993][123090] Updated weights for policy 1, policy_version 446544 (0.0009) [2023-12-26 03:10:26,049][123090] Updated weights for policy 1, policy_version 446554 (0.0005) [2023-12-26 03:10:26,633][123091] Updated weights for policy 0, policy_version 449338 (0.0010) [2023-12-26 03:10:26,699][123091] Updated weights for policy 0, policy_version 449348 (0.0007) [2023-12-26 03:10:26,764][123091] Updated weights for policy 0, policy_version 449358 (0.0009) [2023-12-26 03:10:26,801][123090] Updated weights for policy 1, policy_version 446564 (0.0007) [2023-12-26 03:10:26,848][123090] Updated weights for policy 1, policy_version 446574 (0.0008) [2023-12-26 03:10:26,902][123090] Updated weights for policy 1, policy_version 446584 (0.0009) [2023-12-26 03:10:27,574][123091] Updated weights for policy 0, policy_version 449368 (0.0010) [2023-12-26 03:10:27,641][123091] Updated weights for policy 0, policy_version 449378 (0.0011) [2023-12-26 03:10:27,699][123091] Updated weights for policy 0, policy_version 449388 (0.0011) [2023-12-26 03:10:27,739][123090] Updated weights for policy 1, policy_version 446594 (0.0008) [2023-12-26 03:10:27,788][123090] Updated weights for policy 1, policy_version 446604 (0.0009) [2023-12-26 03:10:27,836][123090] Updated weights for policy 1, policy_version 446614 (0.0008) [2023-12-26 03:10:27,884][123090] Updated weights for policy 1, policy_version 446624 (0.0009) [2023-12-26 03:10:28,390][123091] Updated weights for policy 0, policy_version 449398 (0.0008) [2023-12-26 03:10:28,463][123091] Updated weights for policy 0, policy_version 449408 (0.0006) [2023-12-26 03:10:28,535][123091] Updated weights for policy 0, policy_version 449418 (0.0006) [2023-12-26 03:10:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 229392384. Throughput: 0: 8891.6, 1: 8923.5. Samples: 229388280. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:28,785][121949] Avg episode reward: [(0, '6000.958'), (1, '5633.626')] [2023-12-26 03:10:28,797][123090] Updated weights for policy 1, policy_version 446634 (0.0007) [2023-12-26 03:10:28,869][123090] Updated weights for policy 1, policy_version 446644 (0.0010) [2023-12-26 03:10:28,932][123090] Updated weights for policy 1, policy_version 446654 (0.0010) [2023-12-26 03:10:29,210][123091] Updated weights for policy 0, policy_version 449428 (0.0008) [2023-12-26 03:10:29,278][123091] Updated weights for policy 0, policy_version 449438 (0.0011) [2023-12-26 03:10:29,346][123091] Updated weights for policy 0, policy_version 449448 (0.0011) [2023-12-26 03:10:29,705][123090] Updated weights for policy 1, policy_version 446664 (0.0006) [2023-12-26 03:10:29,767][123090] Updated weights for policy 1, policy_version 446674 (0.0005) [2023-12-26 03:10:29,831][123090] Updated weights for policy 1, policy_version 446684 (0.0008) [2023-12-26 03:10:30,099][123091] Updated weights for policy 0, policy_version 449458 (0.0008) [2023-12-26 03:10:30,165][123091] Updated weights for policy 0, policy_version 449468 (0.0011) [2023-12-26 03:10:30,212][123091] Updated weights for policy 0, policy_version 449478 (0.0010) [2023-12-26 03:10:30,260][123091] Updated weights for policy 0, policy_version 449488 (0.0010) [2023-12-26 03:10:30,632][123090] Updated weights for policy 1, policy_version 446694 (0.0010) [2023-12-26 03:10:30,688][123090] Updated weights for policy 1, policy_version 446705 (0.0010) [2023-12-26 03:10:30,744][123090] Updated weights for policy 1, policy_version 446715 (0.0009) [2023-12-26 03:10:30,966][123091] Updated weights for policy 0, policy_version 449498 (0.0005) [2023-12-26 03:10:31,019][123091] Updated weights for policy 0, policy_version 449508 (0.0007) [2023-12-26 03:10:31,081][123091] Updated weights for policy 0, policy_version 449518 (0.0009) [2023-12-26 03:10:31,658][123090] Updated weights for policy 1, policy_version 446725 (0.0009) [2023-12-26 03:10:31,723][123090] Updated weights for policy 1, policy_version 446735 (0.0009) [2023-12-26 03:10:31,786][123090] Updated weights for policy 1, policy_version 446745 (0.0009) [2023-12-26 03:10:31,817][123091] Updated weights for policy 0, policy_version 449528 (0.0010) [2023-12-26 03:10:31,869][123091] Updated weights for policy 0, policy_version 449538 (0.0010) [2023-12-26 03:10:31,919][123091] Updated weights for policy 0, policy_version 449548 (0.0010) [2023-12-26 03:10:32,576][123090] Updated weights for policy 1, policy_version 446755 (0.0007) [2023-12-26 03:10:32,639][123090] Updated weights for policy 1, policy_version 446765 (0.0009) [2023-12-26 03:10:32,695][123090] Updated weights for policy 1, policy_version 446775 (0.0009) [2023-12-26 03:10:32,758][123091] Updated weights for policy 0, policy_version 449558 (0.0008) [2023-12-26 03:10:32,806][123091] Updated weights for policy 0, policy_version 449568 (0.0008) [2023-12-26 03:10:32,857][123091] Updated weights for policy 0, policy_version 449578 (0.0009) [2023-12-26 03:10:33,366][123090] Updated weights for policy 1, policy_version 446785 (0.0010) [2023-12-26 03:10:33,418][123090] Updated weights for policy 1, policy_version 446795 (0.0005) [2023-12-26 03:10:33,482][123090] Updated weights for policy 1, policy_version 446805 (0.0005) [2023-12-26 03:10:33,552][123090] Updated weights for policy 1, policy_version 446815 (0.0005) [2023-12-26 03:10:33,769][123091] Updated weights for policy 0, policy_version 449589 (0.0009) [2023-12-26 03:10:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 229482496. Throughput: 0: 8912.4, 1: 8846.8. Samples: 229496012. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:33,785][121949] Avg episode reward: [(0, '6035.139'), (1, '5608.165')] [2023-12-26 03:10:33,820][123091] Updated weights for policy 0, policy_version 449601 (0.0010) [2023-12-26 03:10:33,873][123091] Updated weights for policy 0, policy_version 449611 (0.0010) [2023-12-26 03:10:34,115][123090] Updated weights for policy 1, policy_version 446825 (0.0008) [2023-12-26 03:10:34,177][123090] Updated weights for policy 1, policy_version 446835 (0.0009) [2023-12-26 03:10:34,242][123090] Updated weights for policy 1, policy_version 446845 (0.0009) [2023-12-26 03:10:34,681][123091] Updated weights for policy 0, policy_version 449621 (0.0010) [2023-12-26 03:10:34,748][123091] Updated weights for policy 0, policy_version 449631 (0.0009) [2023-12-26 03:10:34,816][123091] Updated weights for policy 0, policy_version 449641 (0.0009) [2023-12-26 03:10:35,153][123090] Updated weights for policy 1, policy_version 446855 (0.0010) [2023-12-26 03:10:35,214][123090] Updated weights for policy 1, policy_version 446865 (0.0008) [2023-12-26 03:10:35,282][123090] Updated weights for policy 1, policy_version 446875 (0.0005) [2023-12-26 03:10:35,663][123091] Updated weights for policy 0, policy_version 449651 (0.0007) [2023-12-26 03:10:35,741][123091] Updated weights for policy 0, policy_version 449661 (0.0006) [2023-12-26 03:10:35,817][123091] Updated weights for policy 0, policy_version 449671 (0.0006) [2023-12-26 03:10:35,917][123090] Updated weights for policy 1, policy_version 446885 (0.0005) [2023-12-26 03:10:35,967][123090] Updated weights for policy 1, policy_version 446895 (0.0005) [2023-12-26 03:10:36,019][123090] Updated weights for policy 1, policy_version 446905 (0.0005) [2023-12-26 03:10:36,393][123091] Updated weights for policy 0, policy_version 449681 (0.0006) [2023-12-26 03:10:36,463][123091] Updated weights for policy 0, policy_version 449691 (0.0008) [2023-12-26 03:10:36,533][123091] Updated weights for policy 0, policy_version 449701 (0.0006) [2023-12-26 03:10:36,606][123091] Updated weights for policy 0, policy_version 449711 (0.0008) [2023-12-26 03:10:36,892][123090] Updated weights for policy 1, policy_version 446915 (0.0007) [2023-12-26 03:10:36,962][123090] Updated weights for policy 1, policy_version 446925 (0.0010) [2023-12-26 03:10:37,011][123090] Updated weights for policy 1, policy_version 446935 (0.0010) [2023-12-26 03:10:37,248][123091] Updated weights for policy 0, policy_version 449721 (0.0010) [2023-12-26 03:10:37,315][123091] Updated weights for policy 0, policy_version 449731 (0.0011) [2023-12-26 03:10:37,390][123091] Updated weights for policy 0, policy_version 449741 (0.0011) [2023-12-26 03:10:37,802][123090] Updated weights for policy 1, policy_version 446945 (0.0010) [2023-12-26 03:10:37,856][123090] Updated weights for policy 1, policy_version 446955 (0.0005) [2023-12-26 03:10:37,904][123090] Updated weights for policy 1, policy_version 446965 (0.0005) [2023-12-26 03:10:37,954][123090] Updated weights for policy 1, policy_version 446975 (0.0007) [2023-12-26 03:10:38,082][123091] Updated weights for policy 0, policy_version 449751 (0.0010) [2023-12-26 03:10:38,143][123091] Updated weights for policy 0, policy_version 449761 (0.0009) [2023-12-26 03:10:38,213][123091] Updated weights for policy 0, policy_version 449771 (0.0006) [2023-12-26 03:10:38,709][123090] Updated weights for policy 1, policy_version 446985 (0.0008) [2023-12-26 03:10:38,780][123090] Updated weights for policy 1, policy_version 446995 (0.0009) [2023-12-26 03:10:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 229572608. Throughput: 0: 8909.9, 1: 8910.2. Samples: 229551176. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:38,785][121949] Avg episode reward: [(0, '6101.292'), (1, '5716.333')] [2023-12-26 03:10:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000449776_115146752.pth... [2023-12-26 03:10:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000448720_114876416.pth [2023-12-26 03:10:38,838][123090] Updated weights for policy 1, policy_version 447005 (0.0009) [2023-12-26 03:10:38,854][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000447008_114434048.pth... [2023-12-26 03:10:38,857][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000445952_114163712.pth [2023-12-26 03:10:39,041][123091] Updated weights for policy 0, policy_version 449781 (0.0008) [2023-12-26 03:10:39,090][123091] Updated weights for policy 0, policy_version 449791 (0.0006) [2023-12-26 03:10:39,153][123091] Updated weights for policy 0, policy_version 449801 (0.0006) [2023-12-26 03:10:39,713][123090] Updated weights for policy 1, policy_version 447015 (0.0009) [2023-12-26 03:10:39,768][123090] Updated weights for policy 1, policy_version 447025 (0.0009) [2023-12-26 03:10:39,825][123090] Updated weights for policy 1, policy_version 447035 (0.0010) [2023-12-26 03:10:39,919][123091] Updated weights for policy 0, policy_version 449811 (0.0007) [2023-12-26 03:10:39,987][123091] Updated weights for policy 0, policy_version 449821 (0.0010) [2023-12-26 03:10:40,041][123091] Updated weights for policy 0, policy_version 449831 (0.0010) [2023-12-26 03:10:40,692][123090] Updated weights for policy 1, policy_version 447045 (0.0010) [2023-12-26 03:10:40,756][123090] Updated weights for policy 1, policy_version 447055 (0.0010) [2023-12-26 03:10:40,816][123090] Updated weights for policy 1, policy_version 447066 (0.0010) [2023-12-26 03:10:40,871][123091] Updated weights for policy 0, policy_version 449841 (0.0009) [2023-12-26 03:10:40,935][123091] Updated weights for policy 0, policy_version 449851 (0.0007) [2023-12-26 03:10:40,995][123091] Updated weights for policy 0, policy_version 449861 (0.0007) [2023-12-26 03:10:41,068][123091] Updated weights for policy 0, policy_version 449871 (0.0008) [2023-12-26 03:10:41,766][123090] Updated weights for policy 1, policy_version 447076 (0.0009) [2023-12-26 03:10:41,837][123090] Updated weights for policy 1, policy_version 447086 (0.0009) [2023-12-26 03:10:41,845][123091] Updated weights for policy 0, policy_version 449881 (0.0007) [2023-12-26 03:10:41,908][123090] Updated weights for policy 1, policy_version 447096 (0.0010) [2023-12-26 03:10:41,910][123091] Updated weights for policy 0, policy_version 449891 (0.0007) [2023-12-26 03:10:41,970][123091] Updated weights for policy 0, policy_version 449901 (0.0007) [2023-12-26 03:10:42,776][123091] Updated weights for policy 0, policy_version 449911 (0.0008) [2023-12-26 03:10:42,776][123090] Updated weights for policy 1, policy_version 447106 (0.0008) [2023-12-26 03:10:42,836][123091] Updated weights for policy 0, policy_version 449921 (0.0006) [2023-12-26 03:10:42,843][123090] Updated weights for policy 1, policy_version 447116 (0.0008) [2023-12-26 03:10:42,905][123091] Updated weights for policy 0, policy_version 449931 (0.0008) [2023-12-26 03:10:42,912][123090] Updated weights for policy 1, policy_version 447126 (0.0009) [2023-12-26 03:10:42,983][123090] Updated weights for policy 1, policy_version 447136 (0.0009) [2023-12-26 03:10:43,679][123091] Updated weights for policy 0, policy_version 449941 (0.0009) [2023-12-26 03:10:43,728][123091] Updated weights for policy 0, policy_version 449951 (0.0009) [2023-12-26 03:10:43,780][123091] Updated weights for policy 0, policy_version 449961 (0.0007) [2023-12-26 03:10:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 229654528. Throughput: 0: 8986.6, 1: 8836.2. Samples: 229655576. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:43,785][121949] Avg episode reward: [(0, '5973.636'), (1, '5796.475')] [2023-12-26 03:10:43,829][123090] Updated weights for policy 1, policy_version 447146 (0.0008) [2023-12-26 03:10:43,892][123090] Updated weights for policy 1, policy_version 447156 (0.0008) [2023-12-26 03:10:43,949][123090] Updated weights for policy 1, policy_version 447166 (0.0010) [2023-12-26 03:10:44,528][123091] Updated weights for policy 0, policy_version 449971 (0.0005) [2023-12-26 03:10:44,593][123091] Updated weights for policy 0, policy_version 449981 (0.0007) [2023-12-26 03:10:44,649][123091] Updated weights for policy 0, policy_version 449991 (0.0005) [2023-12-26 03:10:44,829][123090] Updated weights for policy 1, policy_version 447176 (0.0010) [2023-12-26 03:10:44,903][123090] Updated weights for policy 1, policy_version 447186 (0.0007) [2023-12-26 03:10:44,978][123090] Updated weights for policy 1, policy_version 447196 (0.0006) [2023-12-26 03:10:45,385][123091] Updated weights for policy 0, policy_version 450001 (0.0007) [2023-12-26 03:10:45,433][123091] Updated weights for policy 0, policy_version 450011 (0.0010) [2023-12-26 03:10:45,481][123091] Updated weights for policy 0, policy_version 450021 (0.0010) [2023-12-26 03:10:45,529][123091] Updated weights for policy 0, policy_version 450031 (0.0010) [2023-12-26 03:10:45,786][123090] Updated weights for policy 1, policy_version 447206 (0.0008) [2023-12-26 03:10:45,835][123090] Updated weights for policy 1, policy_version 447216 (0.0008) [2023-12-26 03:10:45,888][123090] Updated weights for policy 1, policy_version 447226 (0.0009) [2023-12-26 03:10:46,365][123091] Updated weights for policy 0, policy_version 450041 (0.0009) [2023-12-26 03:10:46,408][123091] Updated weights for policy 0, policy_version 450051 (0.0006) [2023-12-26 03:10:46,455][123091] Updated weights for policy 0, policy_version 450061 (0.0007) [2023-12-26 03:10:46,670][123090] Updated weights for policy 1, policy_version 447236 (0.0008) [2023-12-26 03:10:46,742][123090] Updated weights for policy 1, policy_version 447246 (0.0006) [2023-12-26 03:10:46,801][123090] Updated weights for policy 1, policy_version 447256 (0.0005) [2023-12-26 03:10:47,287][123091] Updated weights for policy 0, policy_version 450071 (0.0011) [2023-12-26 03:10:47,335][123091] Updated weights for policy 0, policy_version 450081 (0.0011) [2023-12-26 03:10:47,399][123091] Updated weights for policy 0, policy_version 450091 (0.0011) [2023-12-26 03:10:47,451][123090] Updated weights for policy 1, policy_version 447266 (0.0005) [2023-12-26 03:10:47,519][123090] Updated weights for policy 1, policy_version 447276 (0.0006) [2023-12-26 03:10:47,592][123090] Updated weights for policy 1, policy_version 447286 (0.0005) [2023-12-26 03:10:47,660][123090] Updated weights for policy 1, policy_version 447296 (0.0006) [2023-12-26 03:10:48,246][123091] Updated weights for policy 0, policy_version 450101 (0.0011) [2023-12-26 03:10:48,293][123091] Updated weights for policy 0, policy_version 450111 (0.0010) [2023-12-26 03:10:48,360][123091] Updated weights for policy 0, policy_version 450121 (0.0011) [2023-12-26 03:10:48,401][123090] Updated weights for policy 1, policy_version 447306 (0.0009) [2023-12-26 03:10:48,467][123090] Updated weights for policy 1, policy_version 447316 (0.0005) [2023-12-26 03:10:48,542][123090] Updated weights for policy 1, policy_version 447326 (0.0005) [2023-12-26 03:10:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 229752832. Throughput: 0: 8970.6, 1: 8775.7. Samples: 229761572. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:48,785][121949] Avg episode reward: [(0, '6007.865'), (1, '5798.702')] [2023-12-26 03:10:49,188][123091] Updated weights for policy 0, policy_version 450131 (0.0011) [2023-12-26 03:10:49,248][123091] Updated weights for policy 0, policy_version 450141 (0.0010) [2023-12-26 03:10:49,260][123090] Updated weights for policy 1, policy_version 447336 (0.0007) [2023-12-26 03:10:49,307][123091] Updated weights for policy 0, policy_version 450151 (0.0011) [2023-12-26 03:10:49,324][123090] Updated weights for policy 1, policy_version 447346 (0.0007) [2023-12-26 03:10:49,393][123090] Updated weights for policy 1, policy_version 447356 (0.0009) [2023-12-26 03:10:50,123][123091] Updated weights for policy 0, policy_version 450161 (0.0010) [2023-12-26 03:10:50,194][123091] Updated weights for policy 0, policy_version 450171 (0.0006) [2023-12-26 03:10:50,205][123090] Updated weights for policy 1, policy_version 447366 (0.0007) [2023-12-26 03:10:50,252][123091] Updated weights for policy 0, policy_version 450181 (0.0007) [2023-12-26 03:10:50,272][123090] Updated weights for policy 1, policy_version 447376 (0.0007) [2023-12-26 03:10:50,309][123091] Updated weights for policy 0, policy_version 450191 (0.0006) [2023-12-26 03:10:50,337][123090] Updated weights for policy 1, policy_version 447386 (0.0009) [2023-12-26 03:10:50,994][123091] Updated weights for policy 0, policy_version 450201 (0.0006) [2023-12-26 03:10:51,070][123091] Updated weights for policy 0, policy_version 450211 (0.0006) [2023-12-26 03:10:51,137][123091] Updated weights for policy 0, policy_version 450221 (0.0009) [2023-12-26 03:10:51,218][123090] Updated weights for policy 1, policy_version 447396 (0.0009) [2023-12-26 03:10:51,285][123090] Updated weights for policy 1, policy_version 447406 (0.0009) [2023-12-26 03:10:51,346][123090] Updated weights for policy 1, policy_version 447416 (0.0010) [2023-12-26 03:10:51,894][123091] Updated weights for policy 0, policy_version 450231 (0.0008) [2023-12-26 03:10:51,957][123091] Updated weights for policy 0, policy_version 450241 (0.0009) [2023-12-26 03:10:52,018][123091] Updated weights for policy 0, policy_version 450251 (0.0010) [2023-12-26 03:10:52,187][123090] Updated weights for policy 1, policy_version 447426 (0.0008) [2023-12-26 03:10:52,258][123090] Updated weights for policy 1, policy_version 447436 (0.0006) [2023-12-26 03:10:52,332][123090] Updated weights for policy 1, policy_version 447446 (0.0008) [2023-12-26 03:10:52,403][123090] Updated weights for policy 1, policy_version 447456 (0.0006) [2023-12-26 03:10:52,779][123091] Updated weights for policy 0, policy_version 450261 (0.0007) [2023-12-26 03:10:52,846][123091] Updated weights for policy 0, policy_version 450271 (0.0007) [2023-12-26 03:10:52,909][123091] Updated weights for policy 0, policy_version 450281 (0.0005) [2023-12-26 03:10:53,190][123090] Updated weights for policy 1, policy_version 447466 (0.0009) [2023-12-26 03:10:53,239][123090] Updated weights for policy 1, policy_version 447476 (0.0006) [2023-12-26 03:10:53,297][123090] Updated weights for policy 1, policy_version 447486 (0.0006) [2023-12-26 03:10:53,703][123091] Updated weights for policy 0, policy_version 450291 (0.0006) [2023-12-26 03:10:53,764][123091] Updated weights for policy 0, policy_version 450302 (0.0010) [2023-12-26 03:10:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 229834752. Throughput: 0: 8979.4, 1: 8771.0. Samples: 229814084. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:53,785][121949] Avg episode reward: [(0, '6019.663'), (1, '5691.506')] [2023-12-26 03:10:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000447488_114556928.pth... [2023-12-26 03:10:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000446464_114294784.pth [2023-12-26 03:10:53,817][123091] Updated weights for policy 0, policy_version 450312 (0.0007) [2023-12-26 03:10:53,861][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000450320_115286016.pth... [2023-12-26 03:10:53,865][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000449232_115007488.pth [2023-12-26 03:10:54,138][123090] Updated weights for policy 1, policy_version 447496 (0.0009) [2023-12-26 03:10:54,198][123090] Updated weights for policy 1, policy_version 447506 (0.0010) [2023-12-26 03:10:54,256][123090] Updated weights for policy 1, policy_version 447516 (0.0007) [2023-12-26 03:10:54,518][123091] Updated weights for policy 0, policy_version 450322 (0.0005) [2023-12-26 03:10:54,575][123091] Updated weights for policy 0, policy_version 450332 (0.0009) [2023-12-26 03:10:54,629][123091] Updated weights for policy 0, policy_version 450343 (0.0010) [2023-12-26 03:10:55,061][123090] Updated weights for policy 1, policy_version 447526 (0.0006) [2023-12-26 03:10:55,120][123090] Updated weights for policy 1, policy_version 447536 (0.0010) [2023-12-26 03:10:55,175][123090] Updated weights for policy 1, policy_version 447546 (0.0010) [2023-12-26 03:10:55,375][123091] Updated weights for policy 0, policy_version 450353 (0.0009) [2023-12-26 03:10:55,422][123091] Updated weights for policy 0, policy_version 450363 (0.0010) [2023-12-26 03:10:55,474][123091] Updated weights for policy 0, policy_version 450373 (0.0010) [2023-12-26 03:10:55,537][123091] Updated weights for policy 0, policy_version 450383 (0.0010) [2023-12-26 03:10:55,938][123090] Updated weights for policy 1, policy_version 447556 (0.0009) [2023-12-26 03:10:56,001][123090] Updated weights for policy 1, policy_version 447566 (0.0005) [2023-12-26 03:10:56,051][123090] Updated weights for policy 1, policy_version 447576 (0.0005) [2023-12-26 03:10:56,322][123091] Updated weights for policy 0, policy_version 450393 (0.0010) [2023-12-26 03:10:56,373][123091] Updated weights for policy 0, policy_version 450403 (0.0010) [2023-12-26 03:10:56,438][123091] Updated weights for policy 0, policy_version 450413 (0.0010) [2023-12-26 03:10:56,855][123090] Updated weights for policy 1, policy_version 447586 (0.0009) [2023-12-26 03:10:56,909][123090] Updated weights for policy 1, policy_version 447596 (0.0010) [2023-12-26 03:10:56,967][123090] Updated weights for policy 1, policy_version 447606 (0.0010) [2023-12-26 03:10:57,132][123091] Updated weights for policy 0, policy_version 450423 (0.0010) [2023-12-26 03:10:57,183][123091] Updated weights for policy 0, policy_version 450433 (0.0010) [2023-12-26 03:10:57,233][123091] Updated weights for policy 0, policy_version 450443 (0.0010) [2023-12-26 03:10:57,760][123090] Updated weights for policy 1, policy_version 447617 (0.0010) [2023-12-26 03:10:57,813][123090] Updated weights for policy 1, policy_version 447627 (0.0005) [2023-12-26 03:10:57,865][123090] Updated weights for policy 1, policy_version 447637 (0.0005) [2023-12-26 03:10:57,921][123090] Updated weights for policy 1, policy_version 447647 (0.0005) [2023-12-26 03:10:57,964][123091] Updated weights for policy 0, policy_version 450453 (0.0009) [2023-12-26 03:10:58,030][123091] Updated weights for policy 0, policy_version 450463 (0.0010) [2023-12-26 03:10:58,098][123091] Updated weights for policy 0, policy_version 450473 (0.0011) [2023-12-26 03:10:58,785][121949] Fps is (10 sec: 17201.9, 60 sec: 17749.1, 300 sec: 17716.9). Total num frames: 229924864. Throughput: 0: 9058.3, 1: 8788.8. Samples: 229923084. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:10:58,786][121949] Avg episode reward: [(0, '5960.573'), (1, '5633.623')] [2023-12-26 03:10:58,804][123090] Updated weights for policy 1, policy_version 447657 (0.0008) [2023-12-26 03:10:58,881][123090] Updated weights for policy 1, policy_version 447667 (0.0006) [2023-12-26 03:10:58,951][123090] Updated weights for policy 1, policy_version 447677 (0.0007) [2023-12-26 03:10:59,080][123091] Updated weights for policy 0, policy_version 450483 (0.0010) [2023-12-26 03:10:59,142][123091] Updated weights for policy 0, policy_version 450493 (0.0008) [2023-12-26 03:10:59,215][123091] Updated weights for policy 0, policy_version 450503 (0.0008) [2023-12-26 03:10:59,707][123090] Updated weights for policy 1, policy_version 447687 (0.0008) [2023-12-26 03:10:59,775][123090] Updated weights for policy 1, policy_version 447697 (0.0009) [2023-12-26 03:10:59,845][123090] Updated weights for policy 1, policy_version 447707 (0.0009) [2023-12-26 03:10:59,993][123091] Updated weights for policy 0, policy_version 450513 (0.0007) [2023-12-26 03:11:00,064][123091] Updated weights for policy 0, policy_version 450523 (0.0009) [2023-12-26 03:11:00,128][123091] Updated weights for policy 0, policy_version 450533 (0.0008) [2023-12-26 03:11:00,192][123091] Updated weights for policy 0, policy_version 450543 (0.0009) [2023-12-26 03:11:00,636][123090] Updated weights for policy 1, policy_version 447717 (0.0008) [2023-12-26 03:11:00,694][123090] Updated weights for policy 1, policy_version 447727 (0.0010) [2023-12-26 03:11:00,748][123090] Updated weights for policy 1, policy_version 447737 (0.0010) [2023-12-26 03:11:00,868][123091] Updated weights for policy 0, policy_version 450553 (0.0006) [2023-12-26 03:11:00,913][123091] Updated weights for policy 0, policy_version 450563 (0.0005) [2023-12-26 03:11:00,966][123091] Updated weights for policy 0, policy_version 450573 (0.0005) [2023-12-26 03:11:01,585][123090] Updated weights for policy 1, policy_version 447747 (0.0010) [2023-12-26 03:11:01,653][123090] Updated weights for policy 1, policy_version 447757 (0.0010) [2023-12-26 03:11:01,725][123090] Updated weights for policy 1, policy_version 447767 (0.0010) [2023-12-26 03:11:01,754][123091] Updated weights for policy 0, policy_version 450583 (0.0009) [2023-12-26 03:11:01,810][123091] Updated weights for policy 0, policy_version 450593 (0.0010) [2023-12-26 03:11:01,865][123091] Updated weights for policy 0, policy_version 450603 (0.0010) [2023-12-26 03:11:02,491][123090] Updated weights for policy 1, policy_version 447777 (0.0010) [2023-12-26 03:11:02,555][123090] Updated weights for policy 1, policy_version 447787 (0.0009) [2023-12-26 03:11:02,624][123090] Updated weights for policy 1, policy_version 447797 (0.0009) [2023-12-26 03:11:02,693][123090] Updated weights for policy 1, policy_version 447807 (0.0007) [2023-12-26 03:11:02,695][123091] Updated weights for policy 0, policy_version 450613 (0.0011) [2023-12-26 03:11:02,765][123091] Updated weights for policy 0, policy_version 450623 (0.0011) [2023-12-26 03:11:02,816][123091] Updated weights for policy 0, policy_version 450633 (0.0010) [2023-12-26 03:11:03,501][123090] Updated weights for policy 1, policy_version 447817 (0.0009) [2023-12-26 03:11:03,553][123090] Updated weights for policy 1, policy_version 447827 (0.0009) [2023-12-26 03:11:03,614][123090] Updated weights for policy 1, policy_version 447837 (0.0008) [2023-12-26 03:11:03,630][123091] Updated weights for policy 0, policy_version 450643 (0.0011) [2023-12-26 03:11:03,680][123091] Updated weights for policy 0, policy_version 450653 (0.0010) [2023-12-26 03:11:03,735][123091] Updated weights for policy 0, policy_version 450663 (0.0010) [2023-12-26 03:11:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 230023168. Throughput: 0: 9004.3, 1: 8725.1. Samples: 230027288. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:11:03,785][121949] Avg episode reward: [(0, '6037.329'), (1, '5666.376')] [2023-12-26 03:11:04,508][123091] Updated weights for policy 0, policy_version 450673 (0.0010) [2023-12-26 03:11:04,534][123090] Updated weights for policy 1, policy_version 447847 (0.0009) [2023-12-26 03:11:04,560][123091] Updated weights for policy 0, policy_version 450683 (0.0006) [2023-12-26 03:11:04,590][123090] Updated weights for policy 1, policy_version 447857 (0.0009) [2023-12-26 03:11:04,613][123091] Updated weights for policy 0, policy_version 450693 (0.0006) [2023-12-26 03:11:04,651][123090] Updated weights for policy 1, policy_version 447867 (0.0008) [2023-12-26 03:11:04,674][123091] Updated weights for policy 0, policy_version 450703 (0.0009) [2023-12-26 03:11:05,418][123091] Updated weights for policy 0, policy_version 450713 (0.0006) [2023-12-26 03:11:05,465][123090] Updated weights for policy 1, policy_version 447877 (0.0009) [2023-12-26 03:11:05,471][123091] Updated weights for policy 0, policy_version 450723 (0.0007) [2023-12-26 03:11:05,517][123090] Updated weights for policy 1, policy_version 447887 (0.0009) [2023-12-26 03:11:05,537][123091] Updated weights for policy 0, policy_version 450733 (0.0005) [2023-12-26 03:11:05,571][123090] Updated weights for policy 1, policy_version 447897 (0.0009) [2023-12-26 03:11:06,282][123091] Updated weights for policy 0, policy_version 450743 (0.0009) [2023-12-26 03:11:06,339][123091] Updated weights for policy 0, policy_version 450753 (0.0009) [2023-12-26 03:11:06,379][123090] Updated weights for policy 1, policy_version 447907 (0.0009) [2023-12-26 03:11:06,399][123091] Updated weights for policy 0, policy_version 450763 (0.0009) [2023-12-26 03:11:06,442][123090] Updated weights for policy 1, policy_version 447917 (0.0010) [2023-12-26 03:11:06,513][123090] Updated weights for policy 1, policy_version 447927 (0.0011) [2023-12-26 03:11:07,267][123091] Updated weights for policy 0, policy_version 450773 (0.0006) [2023-12-26 03:11:07,295][123090] Updated weights for policy 1, policy_version 447937 (0.0010) [2023-12-26 03:11:07,326][123091] Updated weights for policy 0, policy_version 450783 (0.0006) [2023-12-26 03:11:07,346][123090] Updated weights for policy 1, policy_version 447947 (0.0005) [2023-12-26 03:11:07,377][123091] Updated weights for policy 0, policy_version 450793 (0.0009) [2023-12-26 03:11:07,399][123090] Updated weights for policy 1, policy_version 447957 (0.0005) [2023-12-26 03:11:07,452][123090] Updated weights for policy 1, policy_version 447967 (0.0005) [2023-12-26 03:11:08,162][123091] Updated weights for policy 0, policy_version 450803 (0.0010) [2023-12-26 03:11:08,225][123090] Updated weights for policy 1, policy_version 447977 (0.0010) [2023-12-26 03:11:08,225][123091] Updated weights for policy 0, policy_version 450813 (0.0011) [2023-12-26 03:11:08,290][123090] Updated weights for policy 1, policy_version 447987 (0.0006) [2023-12-26 03:11:08,292][123091] Updated weights for policy 0, policy_version 450823 (0.0011) [2023-12-26 03:11:08,356][123090] Updated weights for policy 1, policy_version 447997 (0.0009) [2023-12-26 03:11:08,784][121949] Fps is (10 sec: 18023.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 230105088. Throughput: 0: 9017.1, 1: 8717.1. Samples: 230080332. Policy #0 lag: (min: 28.0, avg: 55.2, max: 56.0) [2023-12-26 03:11:08,784][121949] Avg episode reward: [(0, '6106.689'), (1, '5686.906')] [2023-12-26 03:11:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000448000_114688000.pth... [2023-12-26 03:11:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000450832_115417088.pth... [2023-12-26 03:11:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000447008_114434048.pth [2023-12-26 03:11:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000449776_115146752.pth [2023-12-26 03:11:08,988][123091] Updated weights for policy 0, policy_version 450833 (0.0010) [2023-12-26 03:11:09,048][123091] Updated weights for policy 0, policy_version 450843 (0.0009) [2023-12-26 03:11:09,096][123091] Updated weights for policy 0, policy_version 450853 (0.0009) [2023-12-26 03:11:09,148][123091] Updated weights for policy 0, policy_version 450863 (0.0006) [2023-12-26 03:11:09,264][123090] Updated weights for policy 1, policy_version 448007 (0.0009) [2023-12-26 03:11:09,336][123090] Updated weights for policy 1, policy_version 448017 (0.0009) [2023-12-26 03:11:09,418][123090] Updated weights for policy 1, policy_version 448027 (0.0008) [2023-12-26 03:11:09,918][123091] Updated weights for policy 0, policy_version 450873 (0.0006) [2023-12-26 03:11:09,987][123091] Updated weights for policy 0, policy_version 450883 (0.0009) [2023-12-26 03:11:10,046][123091] Updated weights for policy 0, policy_version 450893 (0.0008) [2023-12-26 03:11:10,333][123090] Updated weights for policy 1, policy_version 448037 (0.0009) [2023-12-26 03:11:10,398][123090] Updated weights for policy 1, policy_version 448047 (0.0009) [2023-12-26 03:11:10,466][123090] Updated weights for policy 1, policy_version 448057 (0.0010) [2023-12-26 03:11:10,776][123091] Updated weights for policy 0, policy_version 450903 (0.0009) [2023-12-26 03:11:10,827][123091] Updated weights for policy 0, policy_version 450913 (0.0010) [2023-12-26 03:11:10,894][123091] Updated weights for policy 0, policy_version 450923 (0.0011) [2023-12-26 03:11:11,303][123090] Updated weights for policy 1, policy_version 448067 (0.0010) [2023-12-26 03:11:11,371][123090] Updated weights for policy 1, policy_version 448077 (0.0010) [2023-12-26 03:11:11,432][123090] Updated weights for policy 1, policy_version 448087 (0.0007) [2023-12-26 03:11:11,712][123091] Updated weights for policy 0, policy_version 450933 (0.0011) [2023-12-26 03:11:11,787][123091] Updated weights for policy 0, policy_version 450943 (0.0010) [2023-12-26 03:11:11,853][123091] Updated weights for policy 0, policy_version 450953 (0.0010) [2023-12-26 03:11:12,269][123090] Updated weights for policy 1, policy_version 448097 (0.0008) [2023-12-26 03:11:12,336][123090] Updated weights for policy 1, policy_version 448107 (0.0008) [2023-12-26 03:11:12,404][123090] Updated weights for policy 1, policy_version 448117 (0.0007) [2023-12-26 03:11:12,465][123090] Updated weights for policy 1, policy_version 448127 (0.0006) [2023-12-26 03:11:12,667][123091] Updated weights for policy 0, policy_version 450963 (0.0010) [2023-12-26 03:11:12,726][123091] Updated weights for policy 0, policy_version 450973 (0.0010) [2023-12-26 03:11:12,784][123091] Updated weights for policy 0, policy_version 450983 (0.0009) [2023-12-26 03:11:13,186][123090] Updated weights for policy 1, policy_version 448137 (0.0005) [2023-12-26 03:11:13,235][123090] Updated weights for policy 1, policy_version 448147 (0.0005) [2023-12-26 03:11:13,296][123090] Updated weights for policy 1, policy_version 448157 (0.0006) [2023-12-26 03:11:13,564][123091] Updated weights for policy 0, policy_version 450993 (0.0009) [2023-12-26 03:11:13,616][123091] Updated weights for policy 0, policy_version 451003 (0.0007) [2023-12-26 03:11:13,669][123091] Updated weights for policy 0, policy_version 451013 (0.0010) [2023-12-26 03:11:13,721][123091] Updated weights for policy 0, policy_version 451023 (0.0010) [2023-12-26 03:11:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 230195200. Throughput: 0: 9061.7, 1: 8642.1. Samples: 230184952. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:13,785][121949] Avg episode reward: [(0, '6095.852'), (1, '5687.707')] [2023-12-26 03:11:13,992][123090] Updated weights for policy 1, policy_version 448167 (0.0009) [2023-12-26 03:11:14,052][123090] Updated weights for policy 1, policy_version 448177 (0.0009) [2023-12-26 03:11:14,101][123090] Updated weights for policy 1, policy_version 448187 (0.0009) [2023-12-26 03:11:14,561][123091] Updated weights for policy 0, policy_version 451033 (0.0010) [2023-12-26 03:11:14,609][123091] Updated weights for policy 0, policy_version 451043 (0.0010) [2023-12-26 03:11:14,669][123091] Updated weights for policy 0, policy_version 451053 (0.0011) [2023-12-26 03:11:14,970][123090] Updated weights for policy 1, policy_version 448197 (0.0007) [2023-12-26 03:11:15,026][123090] Updated weights for policy 1, policy_version 448207 (0.0006) [2023-12-26 03:11:15,092][123090] Updated weights for policy 1, policy_version 448217 (0.0008) [2023-12-26 03:11:15,555][123091] Updated weights for policy 0, policy_version 451063 (0.0011) [2023-12-26 03:11:15,620][123091] Updated weights for policy 0, policy_version 451073 (0.0011) [2023-12-26 03:11:15,684][123091] Updated weights for policy 0, policy_version 451083 (0.0011) [2023-12-26 03:11:15,854][123090] Updated weights for policy 1, policy_version 448227 (0.0007) [2023-12-26 03:11:15,924][123090] Updated weights for policy 1, policy_version 448237 (0.0009) [2023-12-26 03:11:15,978][123090] Updated weights for policy 1, policy_version 448247 (0.0009) [2023-12-26 03:11:16,508][123091] Updated weights for policy 0, policy_version 451093 (0.0011) [2023-12-26 03:11:16,570][123091] Updated weights for policy 0, policy_version 451103 (0.0005) [2023-12-26 03:11:16,628][123091] Updated weights for policy 0, policy_version 451113 (0.0007) [2023-12-26 03:11:16,797][123090] Updated weights for policy 1, policy_version 448257 (0.0008) [2023-12-26 03:11:16,853][123090] Updated weights for policy 1, policy_version 448267 (0.0008) [2023-12-26 03:11:16,912][123090] Updated weights for policy 1, policy_version 448277 (0.0010) [2023-12-26 03:11:16,977][123090] Updated weights for policy 1, policy_version 448287 (0.0010) [2023-12-26 03:11:17,291][123091] Updated weights for policy 0, policy_version 451123 (0.0009) [2023-12-26 03:11:17,350][123091] Updated weights for policy 0, policy_version 451133 (0.0006) [2023-12-26 03:11:17,440][123091] Updated weights for policy 0, policy_version 451143 (0.0008) [2023-12-26 03:11:17,746][123090] Updated weights for policy 1, policy_version 448297 (0.0010) [2023-12-26 03:11:17,800][123090] Updated weights for policy 1, policy_version 448307 (0.0010) [2023-12-26 03:11:17,857][123090] Updated weights for policy 1, policy_version 448317 (0.0011) [2023-12-26 03:11:18,196][123091] Updated weights for policy 0, policy_version 451153 (0.0008) [2023-12-26 03:11:18,261][123091] Updated weights for policy 0, policy_version 451163 (0.0009) [2023-12-26 03:11:18,323][123091] Updated weights for policy 0, policy_version 451173 (0.0010) [2023-12-26 03:11:18,388][123091] Updated weights for policy 0, policy_version 451183 (0.0009) [2023-12-26 03:11:18,613][123090] Updated weights for policy 1, policy_version 448327 (0.0010) [2023-12-26 03:11:18,666][123090] Updated weights for policy 1, policy_version 448337 (0.0010) [2023-12-26 03:11:18,718][123090] Updated weights for policy 1, policy_version 448347 (0.0010) [2023-12-26 03:11:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 230285312. Throughput: 0: 8994.7, 1: 8688.0. Samples: 230291732. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:18,785][121949] Avg episode reward: [(0, '6108.729'), (1, '5685.374')] [2023-12-26 03:11:19,249][123091] Updated weights for policy 0, policy_version 451193 (0.0009) [2023-12-26 03:11:19,310][123091] Updated weights for policy 0, policy_version 451203 (0.0009) [2023-12-26 03:11:19,380][123091] Updated weights for policy 0, policy_version 451213 (0.0009) [2023-12-26 03:11:19,600][123090] Updated weights for policy 1, policy_version 448357 (0.0010) [2023-12-26 03:11:19,659][123090] Updated weights for policy 1, policy_version 448367 (0.0010) [2023-12-26 03:11:19,725][123090] Updated weights for policy 1, policy_version 448377 (0.0009) [2023-12-26 03:11:20,250][123091] Updated weights for policy 0, policy_version 451223 (0.0009) [2023-12-26 03:11:20,307][123091] Updated weights for policy 0, policy_version 451233 (0.0009) [2023-12-26 03:11:20,359][123091] Updated weights for policy 0, policy_version 451243 (0.0009) [2023-12-26 03:11:20,543][123090] Updated weights for policy 1, policy_version 448387 (0.0011) [2023-12-26 03:11:20,604][123090] Updated weights for policy 1, policy_version 448397 (0.0009) [2023-12-26 03:11:20,661][123090] Updated weights for policy 1, policy_version 448407 (0.0011) [2023-12-26 03:11:21,235][123091] Updated weights for policy 0, policy_version 451253 (0.0009) [2023-12-26 03:11:21,308][123091] Updated weights for policy 0, policy_version 451263 (0.0009) [2023-12-26 03:11:21,380][123091] Updated weights for policy 0, policy_version 451273 (0.0009) [2023-12-26 03:11:21,580][123090] Updated weights for policy 1, policy_version 448417 (0.0011) [2023-12-26 03:11:21,652][123090] Updated weights for policy 1, policy_version 448427 (0.0009) [2023-12-26 03:11:21,722][123090] Updated weights for policy 1, policy_version 448437 (0.0008) [2023-12-26 03:11:21,793][123090] Updated weights for policy 1, policy_version 448447 (0.0009) [2023-12-26 03:11:22,294][123091] Updated weights for policy 0, policy_version 451283 (0.0008) [2023-12-26 03:11:22,362][123091] Updated weights for policy 0, policy_version 451293 (0.0009) [2023-12-26 03:11:22,424][123091] Updated weights for policy 0, policy_version 451303 (0.0009) [2023-12-26 03:11:22,587][123090] Updated weights for policy 1, policy_version 448457 (0.0009) [2023-12-26 03:11:22,644][123090] Updated weights for policy 1, policy_version 448467 (0.0008) [2023-12-26 03:11:22,700][123090] Updated weights for policy 1, policy_version 448477 (0.0010) [2023-12-26 03:11:23,239][123091] Updated weights for policy 0, policy_version 451313 (0.0008) [2023-12-26 03:11:23,287][123091] Updated weights for policy 0, policy_version 451323 (0.0008) [2023-12-26 03:11:23,336][123091] Updated weights for policy 0, policy_version 451333 (0.0009) [2023-12-26 03:11:23,393][123091] Updated weights for policy 0, policy_version 451343 (0.0009) [2023-12-26 03:11:23,541][123090] Updated weights for policy 1, policy_version 448487 (0.0009) [2023-12-26 03:11:23,596][123090] Updated weights for policy 1, policy_version 448497 (0.0009) [2023-12-26 03:11:23,645][123090] Updated weights for policy 1, policy_version 448507 (0.0009) [2023-12-26 03:11:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 230367232. Throughput: 0: 8943.2, 1: 8614.0. Samples: 230341248. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:23,784][121949] Avg episode reward: [(0, '6097.344'), (1, '5671.431')] [2023-12-26 03:11:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000451344_115548160.pth... [2023-12-26 03:11:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000448512_114819072.pth... [2023-12-26 03:11:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000447488_114556928.pth [2023-12-26 03:11:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000450320_115286016.pth [2023-12-26 03:11:24,262][123091] Updated weights for policy 0, policy_version 451353 (0.0009) [2023-12-26 03:11:24,314][123091] Updated weights for policy 0, policy_version 451363 (0.0009) [2023-12-26 03:11:24,379][123091] Updated weights for policy 0, policy_version 451373 (0.0009) [2023-12-26 03:11:24,477][123090] Updated weights for policy 1, policy_version 448517 (0.0010) [2023-12-26 03:11:24,534][123090] Updated weights for policy 1, policy_version 448527 (0.0009) [2023-12-26 03:11:24,589][123090] Updated weights for policy 1, policy_version 448537 (0.0005) [2023-12-26 03:11:25,270][123091] Updated weights for policy 0, policy_version 451383 (0.0009) [2023-12-26 03:11:25,284][123090] Updated weights for policy 1, policy_version 448547 (0.0005) [2023-12-26 03:11:25,327][123091] Updated weights for policy 0, policy_version 451393 (0.0009) [2023-12-26 03:11:25,347][123090] Updated weights for policy 1, policy_version 448557 (0.0005) [2023-12-26 03:11:25,386][123091] Updated weights for policy 0, policy_version 451403 (0.0010) [2023-12-26 03:11:25,407][123090] Updated weights for policy 1, policy_version 448567 (0.0005) [2023-12-26 03:11:26,076][123090] Updated weights for policy 1, policy_version 448577 (0.0010) [2023-12-26 03:11:26,158][123090] Updated weights for policy 1, policy_version 448587 (0.0010) [2023-12-26 03:11:26,182][123091] Updated weights for policy 0, policy_version 451413 (0.0009) [2023-12-26 03:11:26,222][123090] Updated weights for policy 1, policy_version 448597 (0.0008) [2023-12-26 03:11:26,251][123091] Updated weights for policy 0, policy_version 451423 (0.0008) [2023-12-26 03:11:26,287][123090] Updated weights for policy 1, policy_version 448607 (0.0007) [2023-12-26 03:11:26,301][123091] Updated weights for policy 0, policy_version 451433 (0.0010) [2023-12-26 03:11:26,974][123090] Updated weights for policy 1, policy_version 448617 (0.0008) [2023-12-26 03:11:27,037][123090] Updated weights for policy 1, policy_version 448627 (0.0009) [2023-12-26 03:11:27,103][123090] Updated weights for policy 1, policy_version 448637 (0.0009) [2023-12-26 03:11:27,136][123091] Updated weights for policy 0, policy_version 451443 (0.0008) [2023-12-26 03:11:27,192][123091] Updated weights for policy 0, policy_version 451453 (0.0009) [2023-12-26 03:11:27,246][123091] Updated weights for policy 0, policy_version 451463 (0.0008) [2023-12-26 03:11:27,916][123090] Updated weights for policy 1, policy_version 448647 (0.0007) [2023-12-26 03:11:27,988][123090] Updated weights for policy 1, policy_version 448657 (0.0005) [2023-12-26 03:11:28,061][123090] Updated weights for policy 1, policy_version 448667 (0.0005) [2023-12-26 03:11:28,087][123091] Updated weights for policy 0, policy_version 451473 (0.0009) [2023-12-26 03:11:28,158][123091] Updated weights for policy 0, policy_version 451483 (0.0009) [2023-12-26 03:11:28,229][123091] Updated weights for policy 0, policy_version 451493 (0.0009) [2023-12-26 03:11:28,284][123091] Updated weights for policy 0, policy_version 451503 (0.0009) [2023-12-26 03:11:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 230449152. Throughput: 0: 8861.0, 1: 8709.5. Samples: 230446248. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:28,785][121949] Avg episode reward: [(0, '6096.123'), (1, '5818.028')] [2023-12-26 03:11:28,793][123090] Updated weights for policy 1, policy_version 448677 (0.0005) [2023-12-26 03:11:28,855][123090] Updated weights for policy 1, policy_version 448687 (0.0008) [2023-12-26 03:11:28,911][123090] Updated weights for policy 1, policy_version 448697 (0.0009) [2023-12-26 03:11:29,063][123091] Updated weights for policy 0, policy_version 451513 (0.0009) [2023-12-26 03:11:29,119][123091] Updated weights for policy 0, policy_version 451523 (0.0009) [2023-12-26 03:11:29,181][123091] Updated weights for policy 0, policy_version 451533 (0.0009) [2023-12-26 03:11:29,748][123090] Updated weights for policy 1, policy_version 448707 (0.0008) [2023-12-26 03:11:29,814][123090] Updated weights for policy 1, policy_version 448717 (0.0009) [2023-12-26 03:11:29,883][123090] Updated weights for policy 1, policy_version 448727 (0.0008) [2023-12-26 03:11:30,039][123091] Updated weights for policy 0, policy_version 451543 (0.0010) [2023-12-26 03:11:30,102][123091] Updated weights for policy 0, policy_version 451553 (0.0010) [2023-12-26 03:11:30,169][123091] Updated weights for policy 0, policy_version 451563 (0.0010) [2023-12-26 03:11:30,698][123090] Updated weights for policy 1, policy_version 448737 (0.0008) [2023-12-26 03:11:30,765][123090] Updated weights for policy 1, policy_version 448747 (0.0005) [2023-12-26 03:11:30,833][123090] Updated weights for policy 1, policy_version 448757 (0.0005) [2023-12-26 03:11:30,900][123090] Updated weights for policy 1, policy_version 448767 (0.0008) [2023-12-26 03:11:31,014][123091] Updated weights for policy 0, policy_version 451573 (0.0010) [2023-12-26 03:11:31,083][123091] Updated weights for policy 0, policy_version 451583 (0.0009) [2023-12-26 03:11:31,151][123091] Updated weights for policy 0, policy_version 451593 (0.0008) [2023-12-26 03:11:31,684][123090] Updated weights for policy 1, policy_version 448777 (0.0005) [2023-12-26 03:11:31,751][123090] Updated weights for policy 1, policy_version 448787 (0.0009) [2023-12-26 03:11:31,801][123090] Updated weights for policy 1, policy_version 448797 (0.0006) [2023-12-26 03:11:31,939][123091] Updated weights for policy 0, policy_version 451603 (0.0008) [2023-12-26 03:11:32,007][123091] Updated weights for policy 0, policy_version 451613 (0.0006) [2023-12-26 03:11:32,067][123091] Updated weights for policy 0, policy_version 451623 (0.0010) [2023-12-26 03:11:32,479][123090] Updated weights for policy 1, policy_version 448807 (0.0007) [2023-12-26 03:11:32,534][123090] Updated weights for policy 1, policy_version 448817 (0.0008) [2023-12-26 03:11:32,592][123090] Updated weights for policy 1, policy_version 448827 (0.0006) [2023-12-26 03:11:32,851][123091] Updated weights for policy 0, policy_version 451633 (0.0009) [2023-12-26 03:11:32,915][123091] Updated weights for policy 0, policy_version 451643 (0.0009) [2023-12-26 03:11:32,985][123091] Updated weights for policy 0, policy_version 451653 (0.0010) [2023-12-26 03:11:33,055][123091] Updated weights for policy 0, policy_version 451663 (0.0010) [2023-12-26 03:11:33,308][123090] Updated weights for policy 1, policy_version 448837 (0.0006) [2023-12-26 03:11:33,362][123090] Updated weights for policy 1, policy_version 448847 (0.0008) [2023-12-26 03:11:33,413][123090] Updated weights for policy 1, policy_version 448857 (0.0010) [2023-12-26 03:11:33,690][123091] Updated weights for policy 0, policy_version 451673 (0.0006) [2023-12-26 03:11:33,743][123091] Updated weights for policy 0, policy_version 451683 (0.0005) [2023-12-26 03:11:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 230539264. Throughput: 0: 8845.9, 1: 8760.0. Samples: 230553844. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:33,785][121949] Avg episode reward: [(0, '6102.454'), (1, '5884.356')] [2023-12-26 03:11:33,787][123091] Updated weights for policy 0, policy_version 451693 (0.0005) [2023-12-26 03:11:34,214][123090] Updated weights for policy 1, policy_version 448867 (0.0007) [2023-12-26 03:11:34,273][123090] Updated weights for policy 1, policy_version 448877 (0.0009) [2023-12-26 03:11:34,341][123090] Updated weights for policy 1, policy_version 448887 (0.0010) [2023-12-26 03:11:34,580][123091] Updated weights for policy 0, policy_version 451703 (0.0005) [2023-12-26 03:11:34,650][123091] Updated weights for policy 0, policy_version 451713 (0.0005) [2023-12-26 03:11:34,717][123091] Updated weights for policy 0, policy_version 451723 (0.0009) [2023-12-26 03:11:35,190][123090] Updated weights for policy 1, policy_version 448897 (0.0009) [2023-12-26 03:11:35,246][123090] Updated weights for policy 1, policy_version 448907 (0.0005) [2023-12-26 03:11:35,303][123090] Updated weights for policy 1, policy_version 448917 (0.0005) [2023-12-26 03:11:35,369][123090] Updated weights for policy 1, policy_version 448928 (0.0008) [2023-12-26 03:11:35,539][123091] Updated weights for policy 0, policy_version 451733 (0.0009) [2023-12-26 03:11:35,602][123091] Updated weights for policy 0, policy_version 451743 (0.0009) [2023-12-26 03:11:35,664][123091] Updated weights for policy 0, policy_version 451753 (0.0009) [2023-12-26 03:11:36,055][123090] Updated weights for policy 1, policy_version 448938 (0.0005) [2023-12-26 03:11:36,124][123090] Updated weights for policy 1, policy_version 448948 (0.0007) [2023-12-26 03:11:36,201][123090] Updated weights for policy 1, policy_version 448958 (0.0006) [2023-12-26 03:11:36,540][123091] Updated weights for policy 0, policy_version 451763 (0.0008) [2023-12-26 03:11:36,613][123091] Updated weights for policy 0, policy_version 451773 (0.0006) [2023-12-26 03:11:36,680][123091] Updated weights for policy 0, policy_version 451783 (0.0006) [2023-12-26 03:11:36,948][123090] Updated weights for policy 1, policy_version 448968 (0.0009) [2023-12-26 03:11:37,009][123090] Updated weights for policy 1, policy_version 448978 (0.0010) [2023-12-26 03:11:37,068][123090] Updated weights for policy 1, policy_version 448988 (0.0010) [2023-12-26 03:11:37,291][123091] Updated weights for policy 0, policy_version 451793 (0.0006) [2023-12-26 03:11:37,355][123091] Updated weights for policy 0, policy_version 451803 (0.0009) [2023-12-26 03:11:37,410][123091] Updated weights for policy 0, policy_version 451813 (0.0010) [2023-12-26 03:11:37,463][123091] Updated weights for policy 0, policy_version 451823 (0.0009) [2023-12-26 03:11:37,966][123090] Updated weights for policy 1, policy_version 448998 (0.0009) [2023-12-26 03:11:38,028][123090] Updated weights for policy 1, policy_version 449008 (0.0009) [2023-12-26 03:11:38,099][123090] Updated weights for policy 1, policy_version 449018 (0.0010) [2023-12-26 03:11:38,190][123091] Updated weights for policy 0, policy_version 451833 (0.0008) [2023-12-26 03:11:38,252][123091] Updated weights for policy 0, policy_version 451843 (0.0008) [2023-12-26 03:11:38,319][123091] Updated weights for policy 0, policy_version 451853 (0.0008) [2023-12-26 03:11:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 230629376. Throughput: 0: 8823.5, 1: 8811.5. Samples: 230607656. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:38,785][121949] Avg episode reward: [(0, '6151.485'), (1, '5906.860')] [2023-12-26 03:11:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000451856_115679232.pth... [2023-12-26 03:11:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000449024_114950144.pth... [2023-12-26 03:11:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000450832_115417088.pth [2023-12-26 03:11:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000448000_114688000.pth [2023-12-26 03:11:38,946][123090] Updated weights for policy 1, policy_version 449028 (0.0008) [2023-12-26 03:11:38,966][123091] Updated weights for policy 0, policy_version 451864 (0.0009) [2023-12-26 03:11:38,994][123090] Updated weights for policy 1, policy_version 449038 (0.0008) [2023-12-26 03:11:39,025][123091] Updated weights for policy 0, policy_version 451874 (0.0008) [2023-12-26 03:11:39,044][123090] Updated weights for policy 1, policy_version 449048 (0.0009) [2023-12-26 03:11:39,083][123091] Updated weights for policy 0, policy_version 451884 (0.0008) [2023-12-26 03:11:39,922][123090] Updated weights for policy 1, policy_version 449058 (0.0009) [2023-12-26 03:11:39,957][123091] Updated weights for policy 0, policy_version 451894 (0.0009) [2023-12-26 03:11:39,986][123090] Updated weights for policy 1, policy_version 449068 (0.0008) [2023-12-26 03:11:40,022][123091] Updated weights for policy 0, policy_version 451904 (0.0010) [2023-12-26 03:11:40,046][123090] Updated weights for policy 1, policy_version 449078 (0.0008) [2023-12-26 03:11:40,080][123091] Updated weights for policy 0, policy_version 451914 (0.0008) [2023-12-26 03:11:40,108][123090] Updated weights for policy 1, policy_version 449088 (0.0009) [2023-12-26 03:11:40,852][123091] Updated weights for policy 0, policy_version 451924 (0.0009) [2023-12-26 03:11:40,906][123091] Updated weights for policy 0, policy_version 451935 (0.0010) [2023-12-26 03:11:40,951][123091] Updated weights for policy 0, policy_version 451945 (0.0008) [2023-12-26 03:11:40,954][123090] Updated weights for policy 1, policy_version 449098 (0.0009) [2023-12-26 03:11:41,014][123090] Updated weights for policy 1, policy_version 449108 (0.0007) [2023-12-26 03:11:41,087][123090] Updated weights for policy 1, policy_version 449118 (0.0010) [2023-12-26 03:11:41,833][123091] Updated weights for policy 0, policy_version 451955 (0.0010) [2023-12-26 03:11:41,902][123091] Updated weights for policy 0, policy_version 451965 (0.0009) [2023-12-26 03:11:41,946][123090] Updated weights for policy 1, policy_version 449128 (0.0007) [2023-12-26 03:11:41,953][123091] Updated weights for policy 0, policy_version 451975 (0.0010) [2023-12-26 03:11:42,013][123090] Updated weights for policy 1, policy_version 449138 (0.0008) [2023-12-26 03:11:42,083][123090] Updated weights for policy 1, policy_version 449148 (0.0008) [2023-12-26 03:11:42,766][123091] Updated weights for policy 0, policy_version 451985 (0.0008) [2023-12-26 03:11:42,834][123091] Updated weights for policy 0, policy_version 451995 (0.0006) [2023-12-26 03:11:42,872][123090] Updated weights for policy 1, policy_version 449158 (0.0006) [2023-12-26 03:11:42,900][123091] Updated weights for policy 0, policy_version 452005 (0.0006) [2023-12-26 03:11:42,923][123090] Updated weights for policy 1, policy_version 449168 (0.0005) [2023-12-26 03:11:42,968][123091] Updated weights for policy 0, policy_version 452015 (0.0005) [2023-12-26 03:11:42,968][123090] Updated weights for policy 1, policy_version 449178 (0.0005) [2023-12-26 03:11:43,607][123091] Updated weights for policy 0, policy_version 452025 (0.0005) [2023-12-26 03:11:43,676][123091] Updated weights for policy 0, policy_version 452035 (0.0005) [2023-12-26 03:11:43,756][123091] Updated weights for policy 0, policy_version 452045 (0.0005) [2023-12-26 03:11:43,766][123090] Updated weights for policy 1, policy_version 449188 (0.0008) [2023-12-26 03:11:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 230719488. Throughput: 0: 8776.5, 1: 8732.2. Samples: 230710964. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:43,785][121949] Avg episode reward: [(0, '6179.232'), (1, '5778.723')] [2023-12-26 03:11:43,829][123090] Updated weights for policy 1, policy_version 449198 (0.0009) [2023-12-26 03:11:43,883][123090] Updated weights for policy 1, policy_version 449208 (0.0005) [2023-12-26 03:11:44,442][123091] Updated weights for policy 0, policy_version 452055 (0.0005) [2023-12-26 03:11:44,503][123091] Updated weights for policy 0, policy_version 452065 (0.0005) [2023-12-26 03:11:44,561][123091] Updated weights for policy 0, policy_version 452075 (0.0006) [2023-12-26 03:11:44,605][123090] Updated weights for policy 1, policy_version 449218 (0.0005) [2023-12-26 03:11:44,676][123090] Updated weights for policy 1, policy_version 449228 (0.0005) [2023-12-26 03:11:44,732][123090] Updated weights for policy 1, policy_version 449238 (0.0005) [2023-12-26 03:11:44,796][123090] Updated weights for policy 1, policy_version 449248 (0.0008) [2023-12-26 03:11:45,262][123091] Updated weights for policy 0, policy_version 452085 (0.0007) [2023-12-26 03:11:45,328][123091] Updated weights for policy 0, policy_version 452095 (0.0006) [2023-12-26 03:11:45,388][123091] Updated weights for policy 0, policy_version 452105 (0.0005) [2023-12-26 03:11:45,513][123090] Updated weights for policy 1, policy_version 449258 (0.0011) [2023-12-26 03:11:45,573][123090] Updated weights for policy 1, policy_version 449268 (0.0010) [2023-12-26 03:11:45,630][123090] Updated weights for policy 1, policy_version 449278 (0.0010) [2023-12-26 03:11:46,076][123091] Updated weights for policy 0, policy_version 452115 (0.0005) [2023-12-26 03:11:46,131][123091] Updated weights for policy 0, policy_version 452125 (0.0007) [2023-12-26 03:11:46,197][123091] Updated weights for policy 0, policy_version 452135 (0.0006) [2023-12-26 03:11:46,466][123090] Updated weights for policy 1, policy_version 449288 (0.0010) [2023-12-26 03:11:46,513][123090] Updated weights for policy 1, policy_version 449298 (0.0010) [2023-12-26 03:11:46,557][123090] Updated weights for policy 1, policy_version 449308 (0.0010) [2023-12-26 03:11:46,919][123091] Updated weights for policy 0, policy_version 452145 (0.0006) [2023-12-26 03:11:46,985][123091] Updated weights for policy 0, policy_version 452155 (0.0006) [2023-12-26 03:11:47,049][123091] Updated weights for policy 0, policy_version 452165 (0.0006) [2023-12-26 03:11:47,110][123091] Updated weights for policy 0, policy_version 452175 (0.0011) [2023-12-26 03:11:47,414][123090] Updated weights for policy 1, policy_version 449318 (0.0010) [2023-12-26 03:11:47,495][123090] Updated weights for policy 1, policy_version 449328 (0.0010) [2023-12-26 03:11:47,572][123090] Updated weights for policy 1, policy_version 449338 (0.0008) [2023-12-26 03:11:47,864][123091] Updated weights for policy 0, policy_version 452185 (0.0009) [2023-12-26 03:11:47,927][123091] Updated weights for policy 0, policy_version 452195 (0.0011) [2023-12-26 03:11:47,988][123091] Updated weights for policy 0, policy_version 452205 (0.0009) [2023-12-26 03:11:48,316][123090] Updated weights for policy 1, policy_version 449348 (0.0009) [2023-12-26 03:11:48,386][123090] Updated weights for policy 1, policy_version 449358 (0.0008) [2023-12-26 03:11:48,457][123090] Updated weights for policy 1, policy_version 449368 (0.0005) [2023-12-26 03:11:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 230809600. Throughput: 0: 8895.4, 1: 8791.6. Samples: 230823200. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:48,784][121949] Avg episode reward: [(0, '6084.493'), (1, '5765.531')] [2023-12-26 03:11:48,853][123091] Updated weights for policy 0, policy_version 452215 (0.0010) [2023-12-26 03:11:48,911][123091] Updated weights for policy 0, policy_version 452225 (0.0010) [2023-12-26 03:11:48,964][123091] Updated weights for policy 0, policy_version 452235 (0.0010) [2023-12-26 03:11:49,107][123090] Updated weights for policy 1, policy_version 449378 (0.0005) [2023-12-26 03:11:49,177][123090] Updated weights for policy 1, policy_version 449388 (0.0005) [2023-12-26 03:11:49,249][123090] Updated weights for policy 1, policy_version 449398 (0.0006) [2023-12-26 03:11:49,304][123090] Updated weights for policy 1, policy_version 449408 (0.0007) [2023-12-26 03:11:49,862][123091] Updated weights for policy 0, policy_version 452245 (0.0010) [2023-12-26 03:11:49,919][123091] Updated weights for policy 0, policy_version 452255 (0.0009) [2023-12-26 03:11:49,971][123091] Updated weights for policy 0, policy_version 452265 (0.0009) [2023-12-26 03:11:50,104][123090] Updated weights for policy 1, policy_version 449418 (0.0010) [2023-12-26 03:11:50,169][123090] Updated weights for policy 1, policy_version 449428 (0.0011) [2023-12-26 03:11:50,229][123090] Updated weights for policy 1, policy_version 449438 (0.0010) [2023-12-26 03:11:50,852][123091] Updated weights for policy 0, policy_version 452275 (0.0010) [2023-12-26 03:11:50,919][123091] Updated weights for policy 0, policy_version 452285 (0.0009) [2023-12-26 03:11:50,979][123091] Updated weights for policy 0, policy_version 452295 (0.0009) [2023-12-26 03:11:51,076][123090] Updated weights for policy 1, policy_version 449448 (0.0011) [2023-12-26 03:11:51,140][123090] Updated weights for policy 1, policy_version 449458 (0.0011) [2023-12-26 03:11:51,198][123090] Updated weights for policy 1, policy_version 449468 (0.0010) [2023-12-26 03:11:51,823][123091] Updated weights for policy 0, policy_version 452305 (0.0009) [2023-12-26 03:11:51,890][123091] Updated weights for policy 0, policy_version 452315 (0.0009) [2023-12-26 03:11:51,958][123091] Updated weights for policy 0, policy_version 452325 (0.0009) [2023-12-26 03:11:52,011][123091] Updated weights for policy 0, policy_version 452335 (0.0009) [2023-12-26 03:11:52,048][123090] Updated weights for policy 1, policy_version 449478 (0.0010) [2023-12-26 03:11:52,100][123090] Updated weights for policy 1, policy_version 449488 (0.0010) [2023-12-26 03:11:52,149][123090] Updated weights for policy 1, policy_version 449498 (0.0010) [2023-12-26 03:11:52,858][123091] Updated weights for policy 0, policy_version 452345 (0.0009) [2023-12-26 03:11:52,921][123091] Updated weights for policy 0, policy_version 452355 (0.0009) [2023-12-26 03:11:52,976][123091] Updated weights for policy 0, policy_version 452365 (0.0009) [2023-12-26 03:11:53,046][123090] Updated weights for policy 1, policy_version 449508 (0.0010) [2023-12-26 03:11:53,109][123090] Updated weights for policy 1, policy_version 449518 (0.0010) [2023-12-26 03:11:53,160][123090] Updated weights for policy 1, policy_version 449528 (0.0010) [2023-12-26 03:11:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 230891520. Throughput: 0: 8817.5, 1: 8813.4. Samples: 230873724. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:53,785][121949] Avg episode reward: [(0, '6050.454'), (1, '5761.699')] [2023-12-26 03:11:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000449536_115081216.pth... [2023-12-26 03:11:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000448512_114819072.pth [2023-12-26 03:11:53,807][123091] Updated weights for policy 0, policy_version 452375 (0.0009) [2023-12-26 03:11:53,859][123091] Updated weights for policy 0, policy_version 452385 (0.0009) [2023-12-26 03:11:53,919][123091] Updated weights for policy 0, policy_version 452395 (0.0009) [2023-12-26 03:11:53,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000452400_115818496.pth... [2023-12-26 03:11:53,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000451344_115548160.pth [2023-12-26 03:11:53,978][123090] Updated weights for policy 1, policy_version 449538 (0.0010) [2023-12-26 03:11:54,033][123090] Updated weights for policy 1, policy_version 449548 (0.0010) [2023-12-26 03:11:54,081][123090] Updated weights for policy 1, policy_version 449558 (0.0010) [2023-12-26 03:11:54,146][123090] Updated weights for policy 1, policy_version 449568 (0.0010) [2023-12-26 03:11:54,758][123091] Updated weights for policy 0, policy_version 452405 (0.0009) [2023-12-26 03:11:54,814][123091] Updated weights for policy 0, policy_version 452415 (0.0009) [2023-12-26 03:11:54,878][123091] Updated weights for policy 0, policy_version 452425 (0.0009) [2023-12-26 03:11:54,989][123090] Updated weights for policy 1, policy_version 449578 (0.0011) [2023-12-26 03:11:55,045][123090] Updated weights for policy 1, policy_version 449588 (0.0011) [2023-12-26 03:11:55,098][123090] Updated weights for policy 1, policy_version 449598 (0.0010) [2023-12-26 03:11:55,718][123091] Updated weights for policy 0, policy_version 452435 (0.0009) [2023-12-26 03:11:55,773][123091] Updated weights for policy 0, policy_version 452445 (0.0009) [2023-12-26 03:11:55,821][123091] Updated weights for policy 0, policy_version 452455 (0.0008) [2023-12-26 03:11:55,945][123090] Updated weights for policy 1, policy_version 449608 (0.0010) [2023-12-26 03:11:56,009][123090] Updated weights for policy 1, policy_version 449618 (0.0011) [2023-12-26 03:11:56,072][123090] Updated weights for policy 1, policy_version 449628 (0.0011) [2023-12-26 03:11:56,668][123091] Updated weights for policy 0, policy_version 452465 (0.0009) [2023-12-26 03:11:56,722][123091] Updated weights for policy 0, policy_version 452475 (0.0009) [2023-12-26 03:11:56,770][123091] Updated weights for policy 0, policy_version 452485 (0.0008) [2023-12-26 03:11:56,821][123091] Updated weights for policy 0, policy_version 452495 (0.0008) [2023-12-26 03:11:56,891][123090] Updated weights for policy 1, policy_version 449638 (0.0010) [2023-12-26 03:11:56,954][123090] Updated weights for policy 1, policy_version 449648 (0.0010) [2023-12-26 03:11:57,020][123090] Updated weights for policy 1, policy_version 449658 (0.0010) [2023-12-26 03:11:57,632][123091] Updated weights for policy 0, policy_version 452505 (0.0006) [2023-12-26 03:11:57,687][123091] Updated weights for policy 0, policy_version 452515 (0.0005) [2023-12-26 03:11:57,749][123091] Updated weights for policy 0, policy_version 452525 (0.0008) [2023-12-26 03:11:57,861][123090] Updated weights for policy 1, policy_version 449668 (0.0010) [2023-12-26 03:11:57,922][123090] Updated weights for policy 1, policy_version 449678 (0.0008) [2023-12-26 03:11:57,981][123090] Updated weights for policy 1, policy_version 449688 (0.0009) [2023-12-26 03:11:58,511][123091] Updated weights for policy 0, policy_version 452535 (0.0010) [2023-12-26 03:11:58,580][123091] Updated weights for policy 0, policy_version 452545 (0.0009) [2023-12-26 03:11:58,647][123091] Updated weights for policy 0, policy_version 452555 (0.0008) [2023-12-26 03:11:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17613.0, 300 sec: 17689.2). Total num frames: 230981632. Throughput: 0: 8756.2, 1: 8812.5. Samples: 230975544. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:11:58,785][121949] Avg episode reward: [(0, '6155.045'), (1, '5772.944')] [2023-12-26 03:11:58,911][123090] Updated weights for policy 1, policy_version 449698 (0.0009) [2023-12-26 03:11:58,978][123090] Updated weights for policy 1, policy_version 449708 (0.0006) [2023-12-26 03:11:59,052][123090] Updated weights for policy 1, policy_version 449718 (0.0006) [2023-12-26 03:11:59,118][123090] Updated weights for policy 1, policy_version 449728 (0.0006) [2023-12-26 03:11:59,595][123091] Updated weights for policy 0, policy_version 452565 (0.0007) [2023-12-26 03:11:59,646][123091] Updated weights for policy 0, policy_version 452575 (0.0005) [2023-12-26 03:11:59,703][123091] Updated weights for policy 0, policy_version 452585 (0.0006) [2023-12-26 03:11:59,847][123090] Updated weights for policy 1, policy_version 449738 (0.0011) [2023-12-26 03:11:59,907][123090] Updated weights for policy 1, policy_version 449748 (0.0011) [2023-12-26 03:11:59,968][123090] Updated weights for policy 1, policy_version 449758 (0.0009) [2023-12-26 03:12:00,458][123091] Updated weights for policy 0, policy_version 452595 (0.0006) [2023-12-26 03:12:00,505][123091] Updated weights for policy 0, policy_version 452605 (0.0008) [2023-12-26 03:12:00,552][123091] Updated weights for policy 0, policy_version 452615 (0.0008) [2023-12-26 03:12:00,791][123090] Updated weights for policy 1, policy_version 449768 (0.0006) [2023-12-26 03:12:00,841][123090] Updated weights for policy 1, policy_version 449778 (0.0005) [2023-12-26 03:12:00,894][123090] Updated weights for policy 1, policy_version 449788 (0.0005) [2023-12-26 03:12:01,421][123091] Updated weights for policy 0, policy_version 452625 (0.0008) [2023-12-26 03:12:01,491][123091] Updated weights for policy 0, policy_version 452635 (0.0006) [2023-12-26 03:12:01,553][123091] Updated weights for policy 0, policy_version 452645 (0.0009) [2023-12-26 03:12:01,608][123091] Updated weights for policy 0, policy_version 452655 (0.0008) [2023-12-26 03:12:01,696][123090] Updated weights for policy 1, policy_version 449798 (0.0009) [2023-12-26 03:12:01,764][123090] Updated weights for policy 1, policy_version 449808 (0.0010) [2023-12-26 03:12:01,820][123090] Updated weights for policy 1, policy_version 449818 (0.0010) [2023-12-26 03:12:02,390][123091] Updated weights for policy 0, policy_version 452665 (0.0009) [2023-12-26 03:12:02,454][123091] Updated weights for policy 0, policy_version 452675 (0.0009) [2023-12-26 03:12:02,522][123091] Updated weights for policy 0, policy_version 452685 (0.0009) [2023-12-26 03:12:02,657][123090] Updated weights for policy 1, policy_version 449828 (0.0009) [2023-12-26 03:12:02,726][123090] Updated weights for policy 1, policy_version 449838 (0.0007) [2023-12-26 03:12:02,790][123090] Updated weights for policy 1, policy_version 449848 (0.0009) [2023-12-26 03:12:03,354][123091] Updated weights for policy 0, policy_version 452695 (0.0007) [2023-12-26 03:12:03,402][123091] Updated weights for policy 0, policy_version 452705 (0.0005) [2023-12-26 03:12:03,464][123091] Updated weights for policy 0, policy_version 452715 (0.0005) [2023-12-26 03:12:03,634][123090] Updated weights for policy 1, policy_version 449858 (0.0009) [2023-12-26 03:12:03,692][123090] Updated weights for policy 1, policy_version 449868 (0.0009) [2023-12-26 03:12:03,748][123090] Updated weights for policy 1, policy_version 449878 (0.0009) [2023-12-26 03:12:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 231063552. Throughput: 0: 8750.9, 1: 8752.9. Samples: 231079400. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:03,784][121949] Avg episode reward: [(0, '6161.415'), (1, '5793.445')] [2023-12-26 03:12:03,795][123090] Updated weights for policy 1, policy_version 449888 (0.0010) [2023-12-26 03:12:04,207][123091] Updated weights for policy 0, policy_version 452725 (0.0007) [2023-12-26 03:12:04,274][123091] Updated weights for policy 0, policy_version 452735 (0.0009) [2023-12-26 03:12:04,335][123091] Updated weights for policy 0, policy_version 452745 (0.0009) [2023-12-26 03:12:04,587][123090] Updated weights for policy 1, policy_version 449898 (0.0011) [2023-12-26 03:12:04,655][123090] Updated weights for policy 1, policy_version 449908 (0.0006) [2023-12-26 03:12:04,721][123090] Updated weights for policy 1, policy_version 449918 (0.0009) [2023-12-26 03:12:05,193][123091] Updated weights for policy 0, policy_version 452755 (0.0009) [2023-12-26 03:12:05,250][123091] Updated weights for policy 0, policy_version 452767 (0.0010) [2023-12-26 03:12:05,309][123091] Updated weights for policy 0, policy_version 452778 (0.0010) [2023-12-26 03:12:05,414][123090] Updated weights for policy 1, policy_version 449928 (0.0006) [2023-12-26 03:12:05,485][123090] Updated weights for policy 1, policy_version 449938 (0.0005) [2023-12-26 03:12:05,546][123090] Updated weights for policy 1, policy_version 449948 (0.0005) [2023-12-26 03:12:06,157][123090] Updated weights for policy 1, policy_version 449958 (0.0007) [2023-12-26 03:12:06,213][123091] Updated weights for policy 0, policy_version 452788 (0.0008) [2023-12-26 03:12:06,217][123090] Updated weights for policy 1, policy_version 449968 (0.0006) [2023-12-26 03:12:06,281][123091] Updated weights for policy 0, policy_version 452798 (0.0009) [2023-12-26 03:12:06,287][123090] Updated weights for policy 1, policy_version 449978 (0.0007) [2023-12-26 03:12:06,349][123091] Updated weights for policy 0, policy_version 452808 (0.0007) [2023-12-26 03:12:07,023][123091] Updated weights for policy 0, policy_version 452818 (0.0006) [2023-12-26 03:12:07,089][123090] Updated weights for policy 1, policy_version 449988 (0.0008) [2023-12-26 03:12:07,095][123091] Updated weights for policy 0, policy_version 452828 (0.0006) [2023-12-26 03:12:07,148][123090] Updated weights for policy 1, policy_version 449998 (0.0010) [2023-12-26 03:12:07,155][123091] Updated weights for policy 0, policy_version 452838 (0.0006) [2023-12-26 03:12:07,212][123090] Updated weights for policy 1, policy_version 450008 (0.0010) [2023-12-26 03:12:07,222][123091] Updated weights for policy 0, policy_version 452848 (0.0006) [2023-12-26 03:12:08,010][123090] Updated weights for policy 1, policy_version 450018 (0.0009) [2023-12-26 03:12:08,026][123091] Updated weights for policy 0, policy_version 452858 (0.0009) [2023-12-26 03:12:08,064][123090] Updated weights for policy 1, policy_version 450028 (0.0006) [2023-12-26 03:12:08,077][123091] Updated weights for policy 0, policy_version 452868 (0.0009) [2023-12-26 03:12:08,135][123090] Updated weights for policy 1, policy_version 450038 (0.0005) [2023-12-26 03:12:08,142][123091] Updated weights for policy 0, policy_version 452878 (0.0009) [2023-12-26 03:12:08,200][123090] Updated weights for policy 1, policy_version 450048 (0.0006) [2023-12-26 03:12:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 231153664. Throughput: 0: 8764.3, 1: 8837.6. Samples: 231133332. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:08,784][121949] Avg episode reward: [(0, '6146.626'), (1, '5752.839')] [2023-12-26 03:12:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000452880_115941376.pth... [2023-12-26 03:12:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000450048_115212288.pth... [2023-12-26 03:12:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000451856_115679232.pth [2023-12-26 03:12:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000449024_114950144.pth [2023-12-26 03:12:08,860][123090] Updated weights for policy 1, policy_version 450058 (0.0010) [2023-12-26 03:12:08,916][123090] Updated weights for policy 1, policy_version 450068 (0.0010) [2023-12-26 03:12:08,981][123090] Updated weights for policy 1, policy_version 450078 (0.0011) [2023-12-26 03:12:09,028][123091] Updated weights for policy 0, policy_version 452888 (0.0008) [2023-12-26 03:12:09,090][123091] Updated weights for policy 0, policy_version 452898 (0.0008) [2023-12-26 03:12:09,149][123091] Updated weights for policy 0, policy_version 452908 (0.0009) [2023-12-26 03:12:09,808][123090] Updated weights for policy 1, policy_version 450088 (0.0010) [2023-12-26 03:12:09,880][123090] Updated weights for policy 1, policy_version 450098 (0.0007) [2023-12-26 03:12:09,947][123090] Updated weights for policy 1, policy_version 450108 (0.0007) [2023-12-26 03:12:09,996][123091] Updated weights for policy 0, policy_version 452918 (0.0009) [2023-12-26 03:12:10,052][123091] Updated weights for policy 0, policy_version 452928 (0.0009) [2023-12-26 03:12:10,101][123091] Updated weights for policy 0, policy_version 452938 (0.0010) [2023-12-26 03:12:10,687][123090] Updated weights for policy 1, policy_version 450118 (0.0007) [2023-12-26 03:12:10,756][123090] Updated weights for policy 1, policy_version 450128 (0.0005) [2023-12-26 03:12:10,830][123090] Updated weights for policy 1, policy_version 450138 (0.0009) [2023-12-26 03:12:10,953][123091] Updated weights for policy 0, policy_version 452948 (0.0011) [2023-12-26 03:12:11,013][123091] Updated weights for policy 0, policy_version 452958 (0.0011) [2023-12-26 03:12:11,081][123091] Updated weights for policy 0, policy_version 452968 (0.0011) [2023-12-26 03:12:11,655][123090] Updated weights for policy 1, policy_version 450148 (0.0008) [2023-12-26 03:12:11,725][123090] Updated weights for policy 1, policy_version 450158 (0.0009) [2023-12-26 03:12:11,798][123090] Updated weights for policy 1, policy_version 450168 (0.0009) [2023-12-26 03:12:11,966][123091] Updated weights for policy 0, policy_version 452978 (0.0011) [2023-12-26 03:12:12,033][123091] Updated weights for policy 0, policy_version 452988 (0.0011) [2023-12-26 03:12:12,092][123091] Updated weights for policy 0, policy_version 452998 (0.0011) [2023-12-26 03:12:12,159][123091] Updated weights for policy 0, policy_version 453008 (0.0011) [2023-12-26 03:12:12,620][123090] Updated weights for policy 1, policy_version 450178 (0.0009) [2023-12-26 03:12:12,685][123090] Updated weights for policy 1, policy_version 450188 (0.0009) [2023-12-26 03:12:12,741][123090] Updated weights for policy 1, policy_version 450198 (0.0008) [2023-12-26 03:12:12,800][123090] Updated weights for policy 1, policy_version 450208 (0.0009) [2023-12-26 03:12:12,948][123091] Updated weights for policy 0, policy_version 453018 (0.0011) [2023-12-26 03:12:13,008][123091] Updated weights for policy 0, policy_version 453028 (0.0011) [2023-12-26 03:12:13,055][123091] Updated weights for policy 0, policy_version 453038 (0.0010) [2023-12-26 03:12:13,618][123090] Updated weights for policy 1, policy_version 450218 (0.0005) [2023-12-26 03:12:13,689][123090] Updated weights for policy 1, policy_version 450228 (0.0008) [2023-12-26 03:12:13,712][123091] Updated weights for policy 0, policy_version 453048 (0.0011) [2023-12-26 03:12:13,752][123090] Updated weights for policy 1, policy_version 450238 (0.0010) [2023-12-26 03:12:13,756][123091] Updated weights for policy 0, policy_version 453058 (0.0008) [2023-12-26 03:12:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 231243776. Throughput: 0: 8764.6, 1: 8794.7. Samples: 231236412. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:13,785][121949] Avg episode reward: [(0, '6082.097'), (1, '5779.584')] [2023-12-26 03:12:13,815][123091] Updated weights for policy 0, policy_version 453068 (0.0005) [2023-12-26 03:12:14,418][123090] Updated weights for policy 1, policy_version 450248 (0.0010) [2023-12-26 03:12:14,480][123090] Updated weights for policy 1, policy_version 450258 (0.0010) [2023-12-26 03:12:14,510][123091] Updated weights for policy 0, policy_version 453078 (0.0005) [2023-12-26 03:12:14,542][123090] Updated weights for policy 1, policy_version 450268 (0.0010) [2023-12-26 03:12:14,563][123091] Updated weights for policy 0, policy_version 453088 (0.0005) [2023-12-26 03:12:14,613][123091] Updated weights for policy 0, policy_version 453098 (0.0006) [2023-12-26 03:12:15,323][123090] Updated weights for policy 1, policy_version 450278 (0.0010) [2023-12-26 03:12:15,358][123091] Updated weights for policy 0, policy_version 453108 (0.0008) [2023-12-26 03:12:15,377][123090] Updated weights for policy 1, policy_version 450288 (0.0008) [2023-12-26 03:12:15,428][123091] Updated weights for policy 0, policy_version 453118 (0.0006) [2023-12-26 03:12:15,434][123090] Updated weights for policy 1, policy_version 450298 (0.0009) [2023-12-26 03:12:15,489][123091] Updated weights for policy 0, policy_version 453128 (0.0009) [2023-12-26 03:12:16,240][123091] Updated weights for policy 0, policy_version 453138 (0.0008) [2023-12-26 03:12:16,278][123090] Updated weights for policy 1, policy_version 450308 (0.0007) [2023-12-26 03:12:16,294][123091] Updated weights for policy 0, policy_version 453148 (0.0005) [2023-12-26 03:12:16,335][123090] Updated weights for policy 1, policy_version 450318 (0.0005) [2023-12-26 03:12:16,348][123091] Updated weights for policy 0, policy_version 453158 (0.0005) [2023-12-26 03:12:16,394][123090] Updated weights for policy 1, policy_version 450328 (0.0008) [2023-12-26 03:12:16,403][123091] Updated weights for policy 0, policy_version 453168 (0.0008) [2023-12-26 03:12:17,206][123090] Updated weights for policy 1, policy_version 450338 (0.0010) [2023-12-26 03:12:17,216][123091] Updated weights for policy 0, policy_version 453178 (0.0009) [2023-12-26 03:12:17,258][123090] Updated weights for policy 1, policy_version 450348 (0.0010) [2023-12-26 03:12:17,269][123091] Updated weights for policy 0, policy_version 453188 (0.0006) [2023-12-26 03:12:17,321][123090] Updated weights for policy 1, policy_version 450358 (0.0010) [2023-12-26 03:12:17,328][123091] Updated weights for policy 0, policy_version 453198 (0.0006) [2023-12-26 03:12:17,376][123090] Updated weights for policy 1, policy_version 450368 (0.0010) [2023-12-26 03:12:18,069][123091] Updated weights for policy 0, policy_version 453208 (0.0010) [2023-12-26 03:12:18,130][123091] Updated weights for policy 0, policy_version 453218 (0.0011) [2023-12-26 03:12:18,195][123091] Updated weights for policy 0, policy_version 453228 (0.0011) [2023-12-26 03:12:18,216][123090] Updated weights for policy 1, policy_version 450378 (0.0010) [2023-12-26 03:12:18,268][123090] Updated weights for policy 1, policy_version 450388 (0.0010) [2023-12-26 03:12:18,324][123090] Updated weights for policy 1, policy_version 450398 (0.0010) [2023-12-26 03:12:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 231333888. Throughput: 0: 8856.9, 1: 8740.4. Samples: 231345720. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:18,785][121949] Avg episode reward: [(0, '6161.105'), (1, '5695.225')] [2023-12-26 03:12:18,985][123091] Updated weights for policy 0, policy_version 453238 (0.0011) [2023-12-26 03:12:19,034][123091] Updated weights for policy 0, policy_version 453248 (0.0011) [2023-12-26 03:12:19,091][123091] Updated weights for policy 0, policy_version 453258 (0.0010) [2023-12-26 03:12:19,139][123090] Updated weights for policy 1, policy_version 450408 (0.0010) [2023-12-26 03:12:19,195][123090] Updated weights for policy 1, policy_version 450418 (0.0010) [2023-12-26 03:12:19,260][123090] Updated weights for policy 1, policy_version 450428 (0.0009) [2023-12-26 03:12:19,905][123091] Updated weights for policy 0, policy_version 453268 (0.0007) [2023-12-26 03:12:19,979][123091] Updated weights for policy 0, policy_version 453278 (0.0008) [2023-12-26 03:12:20,045][123091] Updated weights for policy 0, policy_version 453288 (0.0007) [2023-12-26 03:12:20,058][123090] Updated weights for policy 1, policy_version 450438 (0.0011) [2023-12-26 03:12:20,114][123090] Updated weights for policy 1, policy_version 450448 (0.0006) [2023-12-26 03:12:20,163][123090] Updated weights for policy 1, policy_version 450458 (0.0005) [2023-12-26 03:12:20,782][123091] Updated weights for policy 0, policy_version 453298 (0.0009) [2023-12-26 03:12:20,840][123091] Updated weights for policy 0, policy_version 453308 (0.0007) [2023-12-26 03:12:20,902][123091] Updated weights for policy 0, policy_version 453318 (0.0009) [2023-12-26 03:12:20,967][123091] Updated weights for policy 0, policy_version 453328 (0.0010) [2023-12-26 03:12:20,989][123090] Updated weights for policy 1, policy_version 450468 (0.0009) [2023-12-26 03:12:21,059][123090] Updated weights for policy 1, policy_version 450478 (0.0009) [2023-12-26 03:12:21,128][123090] Updated weights for policy 1, policy_version 450488 (0.0010) [2023-12-26 03:12:21,789][123091] Updated weights for policy 0, policy_version 453338 (0.0008) [2023-12-26 03:12:21,849][123091] Updated weights for policy 0, policy_version 453348 (0.0011) [2023-12-26 03:12:21,912][123091] Updated weights for policy 0, policy_version 453358 (0.0011) [2023-12-26 03:12:21,938][123090] Updated weights for policy 1, policy_version 450498 (0.0009) [2023-12-26 03:12:22,009][123090] Updated weights for policy 1, policy_version 450508 (0.0007) [2023-12-26 03:12:22,072][123090] Updated weights for policy 1, policy_version 450518 (0.0009) [2023-12-26 03:12:22,138][123090] Updated weights for policy 1, policy_version 450528 (0.0010) [2023-12-26 03:12:22,673][123091] Updated weights for policy 0, policy_version 453368 (0.0011) [2023-12-26 03:12:22,742][123091] Updated weights for policy 0, policy_version 453378 (0.0011) [2023-12-26 03:12:22,810][123091] Updated weights for policy 0, policy_version 453388 (0.0011) [2023-12-26 03:12:22,958][123090] Updated weights for policy 1, policy_version 450538 (0.0009) [2023-12-26 03:12:23,009][123090] Updated weights for policy 1, policy_version 450548 (0.0009) [2023-12-26 03:12:23,064][123090] Updated weights for policy 1, policy_version 450558 (0.0005) [2023-12-26 03:12:23,550][123091] Updated weights for policy 0, policy_version 453398 (0.0011) [2023-12-26 03:12:23,602][123091] Updated weights for policy 0, policy_version 453408 (0.0009) [2023-12-26 03:12:23,655][123091] Updated weights for policy 0, policy_version 453418 (0.0009) [2023-12-26 03:12:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 231424000. Throughput: 0: 8866.1, 1: 8713.8. Samples: 231398752. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:23,785][121949] Avg episode reward: [(0, '6184.272'), (1, '5684.970')] [2023-12-26 03:12:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000453424_116080640.pth... [2023-12-26 03:12:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000450560_115343360.pth... [2023-12-26 03:12:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000452400_115818496.pth [2023-12-26 03:12:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000449536_115081216.pth [2023-12-26 03:12:23,889][123090] Updated weights for policy 1, policy_version 450568 (0.0009) [2023-12-26 03:12:23,943][123090] Updated weights for policy 1, policy_version 450578 (0.0010) [2023-12-26 03:12:24,002][123090] Updated weights for policy 1, policy_version 450588 (0.0009) [2023-12-26 03:12:24,485][123091] Updated weights for policy 0, policy_version 453428 (0.0008) [2023-12-26 03:12:24,544][123091] Updated weights for policy 0, policy_version 453438 (0.0008) [2023-12-26 03:12:24,612][123091] Updated weights for policy 0, policy_version 453448 (0.0009) [2023-12-26 03:12:24,794][123090] Updated weights for policy 1, policy_version 450598 (0.0009) [2023-12-26 03:12:24,864][123090] Updated weights for policy 1, policy_version 450608 (0.0010) [2023-12-26 03:12:24,933][123090] Updated weights for policy 1, policy_version 450618 (0.0010) [2023-12-26 03:12:25,331][123091] Updated weights for policy 0, policy_version 453458 (0.0009) [2023-12-26 03:12:25,385][123091] Updated weights for policy 0, policy_version 453468 (0.0010) [2023-12-26 03:12:25,448][123091] Updated weights for policy 0, policy_version 453478 (0.0010) [2023-12-26 03:12:25,495][123091] Updated weights for policy 0, policy_version 453488 (0.0010) [2023-12-26 03:12:25,736][123090] Updated weights for policy 1, policy_version 450628 (0.0010) [2023-12-26 03:12:25,783][123090] Updated weights for policy 1, policy_version 450638 (0.0009) [2023-12-26 03:12:25,830][123090] Updated weights for policy 1, policy_version 450648 (0.0008) [2023-12-26 03:12:26,325][123091] Updated weights for policy 0, policy_version 453498 (0.0010) [2023-12-26 03:12:26,376][123091] Updated weights for policy 0, policy_version 453508 (0.0010) [2023-12-26 03:12:26,445][123091] Updated weights for policy 0, policy_version 453518 (0.0010) [2023-12-26 03:12:26,562][123090] Updated weights for policy 1, policy_version 450658 (0.0008) [2023-12-26 03:12:26,610][123090] Updated weights for policy 1, policy_version 450668 (0.0005) [2023-12-26 03:12:26,657][123090] Updated weights for policy 1, policy_version 450678 (0.0005) [2023-12-26 03:12:26,714][123090] Updated weights for policy 1, policy_version 450688 (0.0008) [2023-12-26 03:12:27,245][123091] Updated weights for policy 0, policy_version 453528 (0.0006) [2023-12-26 03:12:27,299][123091] Updated weights for policy 0, policy_version 453538 (0.0010) [2023-12-26 03:12:27,351][123091] Updated weights for policy 0, policy_version 453548 (0.0010) [2023-12-26 03:12:27,406][123090] Updated weights for policy 1, policy_version 450698 (0.0009) [2023-12-26 03:12:27,463][123090] Updated weights for policy 1, policy_version 450708 (0.0005) [2023-12-26 03:12:27,520][123090] Updated weights for policy 1, policy_version 450718 (0.0005) [2023-12-26 03:12:28,157][123091] Updated weights for policy 0, policy_version 453558 (0.0007) [2023-12-26 03:12:28,223][123091] Updated weights for policy 0, policy_version 453568 (0.0005) [2023-12-26 03:12:28,238][123090] Updated weights for policy 1, policy_version 450728 (0.0008) [2023-12-26 03:12:28,284][123091] Updated weights for policy 0, policy_version 453578 (0.0005) [2023-12-26 03:12:28,294][123090] Updated weights for policy 1, policy_version 450738 (0.0008) [2023-12-26 03:12:28,361][123090] Updated weights for policy 1, policy_version 450748 (0.0008) [2023-12-26 03:12:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 231514112. Throughput: 0: 8859.5, 1: 8833.4. Samples: 231507144. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:28,785][121949] Avg episode reward: [(0, '6189.554'), (1, '5776.848')] [2023-12-26 03:12:29,073][123091] Updated weights for policy 0, policy_version 453588 (0.0010) [2023-12-26 03:12:29,121][123091] Updated weights for policy 0, policy_version 453598 (0.0010) [2023-12-26 03:12:29,180][123091] Updated weights for policy 0, policy_version 453608 (0.0010) [2023-12-26 03:12:29,198][123090] Updated weights for policy 1, policy_version 450758 (0.0010) [2023-12-26 03:12:29,255][123090] Updated weights for policy 1, policy_version 450768 (0.0009) [2023-12-26 03:12:29,315][123090] Updated weights for policy 1, policy_version 450778 (0.0008) [2023-12-26 03:12:29,986][123091] Updated weights for policy 0, policy_version 453618 (0.0010) [2023-12-26 03:12:30,055][123091] Updated weights for policy 0, policy_version 453628 (0.0010) [2023-12-26 03:12:30,112][123091] Updated weights for policy 0, policy_version 453638 (0.0009) [2023-12-26 03:12:30,175][123091] Updated weights for policy 0, policy_version 453648 (0.0010) [2023-12-26 03:12:30,181][123090] Updated weights for policy 1, policy_version 450788 (0.0010) [2023-12-26 03:12:30,234][123090] Updated weights for policy 1, policy_version 450798 (0.0009) [2023-12-26 03:12:30,295][123090] Updated weights for policy 1, policy_version 450808 (0.0009) [2023-12-26 03:12:30,991][123091] Updated weights for policy 0, policy_version 453658 (0.0010) [2023-12-26 03:12:31,057][123091] Updated weights for policy 0, policy_version 453668 (0.0009) [2023-12-26 03:12:31,119][123091] Updated weights for policy 0, policy_version 453678 (0.0009) [2023-12-26 03:12:31,129][123090] Updated weights for policy 1, policy_version 450818 (0.0010) [2023-12-26 03:12:31,201][123090] Updated weights for policy 1, policy_version 450828 (0.0008) [2023-12-26 03:12:31,259][123090] Updated weights for policy 1, policy_version 450838 (0.0009) [2023-12-26 03:12:31,314][123090] Updated weights for policy 1, policy_version 450848 (0.0009) [2023-12-26 03:12:31,932][123091] Updated weights for policy 0, policy_version 453688 (0.0006) [2023-12-26 03:12:31,999][123091] Updated weights for policy 0, policy_version 453698 (0.0008) [2023-12-26 03:12:32,053][123090] Updated weights for policy 1, policy_version 450858 (0.0006) [2023-12-26 03:12:32,068][123091] Updated weights for policy 0, policy_version 453708 (0.0008) [2023-12-26 03:12:32,124][123090] Updated weights for policy 1, policy_version 450868 (0.0006) [2023-12-26 03:12:32,200][123090] Updated weights for policy 1, policy_version 450878 (0.0005) [2023-12-26 03:12:32,817][123091] Updated weights for policy 0, policy_version 453718 (0.0010) [2023-12-26 03:12:32,858][123090] Updated weights for policy 1, policy_version 450888 (0.0006) [2023-12-26 03:12:32,880][123091] Updated weights for policy 0, policy_version 453728 (0.0011) [2023-12-26 03:12:32,921][123090] Updated weights for policy 1, policy_version 450898 (0.0006) [2023-12-26 03:12:32,944][123091] Updated weights for policy 0, policy_version 453738 (0.0011) [2023-12-26 03:12:32,985][123090] Updated weights for policy 1, policy_version 450908 (0.0006) [2023-12-26 03:12:33,635][123091] Updated weights for policy 0, policy_version 453748 (0.0008) [2023-12-26 03:12:33,693][123091] Updated weights for policy 0, policy_version 453758 (0.0006) [2023-12-26 03:12:33,742][123091] Updated weights for policy 0, policy_version 453768 (0.0007) [2023-12-26 03:12:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 231596032. Throughput: 0: 8765.9, 1: 8803.0. Samples: 231613800. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 03:12:33,785][121949] Avg episode reward: [(0, '6250.935'), (1, '5663.102')] [2023-12-26 03:12:33,832][123090] Updated weights for policy 1, policy_version 450918 (0.0007) [2023-12-26 03:12:33,880][123090] Updated weights for policy 1, policy_version 450928 (0.0005) [2023-12-26 03:12:33,935][123090] Updated weights for policy 1, policy_version 450938 (0.0005) [2023-12-26 03:12:34,553][123091] Updated weights for policy 0, policy_version 453778 (0.0011) [2023-12-26 03:12:34,580][123090] Updated weights for policy 1, policy_version 450948 (0.0005) [2023-12-26 03:12:34,627][123091] Updated weights for policy 0, policy_version 453788 (0.0008) [2023-12-26 03:12:34,651][123090] Updated weights for policy 1, policy_version 450958 (0.0007) [2023-12-26 03:12:34,697][123091] Updated weights for policy 0, policy_version 453798 (0.0007) [2023-12-26 03:12:34,720][123090] Updated weights for policy 1, policy_version 450968 (0.0007) [2023-12-26 03:12:34,763][123091] Updated weights for policy 0, policy_version 453808 (0.0005) [2023-12-26 03:12:35,507][123091] Updated weights for policy 0, policy_version 453818 (0.0009) [2023-12-26 03:12:35,543][123090] Updated weights for policy 1, policy_version 450978 (0.0009) [2023-12-26 03:12:35,558][123091] Updated weights for policy 0, policy_version 453828 (0.0008) [2023-12-26 03:12:35,604][123090] Updated weights for policy 1, policy_version 450988 (0.0009) [2023-12-26 03:12:35,606][123091] Updated weights for policy 0, policy_version 453838 (0.0007) [2023-12-26 03:12:35,656][123090] Updated weights for policy 1, policy_version 450998 (0.0009) [2023-12-26 03:12:35,721][123090] Updated weights for policy 1, policy_version 451008 (0.0010) [2023-12-26 03:12:36,378][123091] Updated weights for policy 0, policy_version 453848 (0.0009) [2023-12-26 03:12:36,446][123091] Updated weights for policy 0, policy_version 453858 (0.0009) [2023-12-26 03:12:36,499][123091] Updated weights for policy 0, policy_version 453868 (0.0010) [2023-12-26 03:12:36,575][123090] Updated weights for policy 1, policy_version 451018 (0.0005) [2023-12-26 03:12:36,625][123090] Updated weights for policy 1, policy_version 451028 (0.0005) [2023-12-26 03:12:36,693][123090] Updated weights for policy 1, policy_version 451038 (0.0007) [2023-12-26 03:12:37,317][123091] Updated weights for policy 0, policy_version 453878 (0.0010) [2023-12-26 03:12:37,368][123091] Updated weights for policy 0, policy_version 453888 (0.0008) [2023-12-26 03:12:37,417][123091] Updated weights for policy 0, policy_version 453898 (0.0010) [2023-12-26 03:12:37,483][123090] Updated weights for policy 1, policy_version 451048 (0.0009) [2023-12-26 03:12:37,541][123090] Updated weights for policy 1, policy_version 451058 (0.0008) [2023-12-26 03:12:37,595][123090] Updated weights for policy 1, policy_version 451068 (0.0008) [2023-12-26 03:12:38,259][123091] Updated weights for policy 0, policy_version 453908 (0.0010) [2023-12-26 03:12:38,326][123091] Updated weights for policy 0, policy_version 453918 (0.0010) [2023-12-26 03:12:38,396][123091] Updated weights for policy 0, policy_version 453928 (0.0010) [2023-12-26 03:12:38,429][123090] Updated weights for policy 1, policy_version 451078 (0.0008) [2023-12-26 03:12:38,494][123090] Updated weights for policy 1, policy_version 451088 (0.0009) [2023-12-26 03:12:38,552][123090] Updated weights for policy 1, policy_version 451098 (0.0009) [2023-12-26 03:12:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 231694336. Throughput: 0: 8818.6, 1: 8829.3. Samples: 231667884. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:12:38,785][121949] Avg episode reward: [(0, '6177.362'), (1, '5504.411')] [2023-12-26 03:12:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000451104_115482624.pth... [2023-12-26 03:12:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000453936_116211712.pth... [2023-12-26 03:12:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000452880_115941376.pth [2023-12-26 03:12:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000450048_115212288.pth [2023-12-26 03:12:39,212][123091] Updated weights for policy 0, policy_version 453938 (0.0008) [2023-12-26 03:12:39,276][123091] Updated weights for policy 0, policy_version 453948 (0.0010) [2023-12-26 03:12:39,328][123091] Updated weights for policy 0, policy_version 453958 (0.0010) [2023-12-26 03:12:39,335][123090] Updated weights for policy 1, policy_version 451108 (0.0008) [2023-12-26 03:12:39,400][123091] Updated weights for policy 0, policy_version 453968 (0.0007) [2023-12-26 03:12:39,412][123090] Updated weights for policy 1, policy_version 451118 (0.0009) [2023-12-26 03:12:39,462][123090] Updated weights for policy 1, policy_version 451128 (0.0009) [2023-12-26 03:12:40,263][123091] Updated weights for policy 0, policy_version 453978 (0.0006) [2023-12-26 03:12:40,337][123091] Updated weights for policy 0, policy_version 453988 (0.0009) [2023-12-26 03:12:40,347][123090] Updated weights for policy 1, policy_version 451138 (0.0009) [2023-12-26 03:12:40,398][123091] Updated weights for policy 0, policy_version 453998 (0.0007) [2023-12-26 03:12:40,405][123090] Updated weights for policy 1, policy_version 451148 (0.0007) [2023-12-26 03:12:40,454][123090] Updated weights for policy 1, policy_version 451158 (0.0007) [2023-12-26 03:12:40,516][123090] Updated weights for policy 1, policy_version 451168 (0.0008) [2023-12-26 03:12:41,188][123091] Updated weights for policy 0, policy_version 454008 (0.0009) [2023-12-26 03:12:41,248][123091] Updated weights for policy 0, policy_version 454018 (0.0009) [2023-12-26 03:12:41,317][123091] Updated weights for policy 0, policy_version 454028 (0.0009) [2023-12-26 03:12:41,339][123090] Updated weights for policy 1, policy_version 451178 (0.0007) [2023-12-26 03:12:41,410][123090] Updated weights for policy 1, policy_version 451188 (0.0008) [2023-12-26 03:12:41,483][123090] Updated weights for policy 1, policy_version 451198 (0.0009) [2023-12-26 03:12:42,203][123091] Updated weights for policy 0, policy_version 454038 (0.0009) [2023-12-26 03:12:42,260][123091] Updated weights for policy 0, policy_version 454048 (0.0009) [2023-12-26 03:12:42,321][123090] Updated weights for policy 1, policy_version 451208 (0.0010) [2023-12-26 03:12:42,326][123091] Updated weights for policy 0, policy_version 454058 (0.0008) [2023-12-26 03:12:42,387][123090] Updated weights for policy 1, policy_version 451218 (0.0009) [2023-12-26 03:12:42,456][123090] Updated weights for policy 1, policy_version 451228 (0.0007) [2023-12-26 03:12:43,148][123091] Updated weights for policy 0, policy_version 454068 (0.0008) [2023-12-26 03:12:43,189][123090] Updated weights for policy 1, policy_version 451238 (0.0008) [2023-12-26 03:12:43,208][123091] Updated weights for policy 0, policy_version 454078 (0.0009) [2023-12-26 03:12:43,242][123090] Updated weights for policy 1, policy_version 451248 (0.0008) [2023-12-26 03:12:43,262][123091] Updated weights for policy 0, policy_version 454088 (0.0010) [2023-12-26 03:12:43,295][123090] Updated weights for policy 1, policy_version 451258 (0.0007) [2023-12-26 03:12:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 231776256. Throughput: 0: 8805.8, 1: 8843.9. Samples: 231769780. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:12:43,785][121949] Avg episode reward: [(0, '6109.620'), (1, '5619.729')] [2023-12-26 03:12:44,077][123090] Updated weights for policy 1, policy_version 451268 (0.0008) [2023-12-26 03:12:44,085][123091] Updated weights for policy 0, policy_version 454098 (0.0011) [2023-12-26 03:12:44,134][123090] Updated weights for policy 1, policy_version 451278 (0.0006) [2023-12-26 03:12:44,140][123091] Updated weights for policy 0, policy_version 454108 (0.0010) [2023-12-26 03:12:44,195][123090] Updated weights for policy 1, policy_version 451288 (0.0007) [2023-12-26 03:12:44,207][123091] Updated weights for policy 0, policy_version 454118 (0.0011) [2023-12-26 03:12:44,266][123091] Updated weights for policy 0, policy_version 454128 (0.0010) [2023-12-26 03:12:44,957][123091] Updated weights for policy 0, policy_version 454138 (0.0009) [2023-12-26 03:12:45,022][123091] Updated weights for policy 0, policy_version 454148 (0.0010) [2023-12-26 03:12:45,063][123090] Updated weights for policy 1, policy_version 451298 (0.0007) [2023-12-26 03:12:45,083][123091] Updated weights for policy 0, policy_version 454158 (0.0009) [2023-12-26 03:12:45,126][123090] Updated weights for policy 1, policy_version 451308 (0.0009) [2023-12-26 03:12:45,199][123090] Updated weights for policy 1, policy_version 451318 (0.0011) [2023-12-26 03:12:45,268][123090] Updated weights for policy 1, policy_version 451328 (0.0010) [2023-12-26 03:12:45,962][123090] Updated weights for policy 1, policy_version 451338 (0.0005) [2023-12-26 03:12:45,984][123091] Updated weights for policy 0, policy_version 454168 (0.0009) [2023-12-26 03:12:46,026][123090] Updated weights for policy 1, policy_version 451348 (0.0005) [2023-12-26 03:12:46,048][123091] Updated weights for policy 0, policy_version 454178 (0.0010) [2023-12-26 03:12:46,077][123090] Updated weights for policy 1, policy_version 451358 (0.0005) [2023-12-26 03:12:46,101][123091] Updated weights for policy 0, policy_version 454188 (0.0009) [2023-12-26 03:12:46,817][123090] Updated weights for policy 1, policy_version 451368 (0.0009) [2023-12-26 03:12:46,872][123090] Updated weights for policy 1, policy_version 451378 (0.0009) [2023-12-26 03:12:46,884][123091] Updated weights for policy 0, policy_version 454198 (0.0010) [2023-12-26 03:12:46,925][123090] Updated weights for policy 1, policy_version 451388 (0.0008) [2023-12-26 03:12:46,935][123091] Updated weights for policy 0, policy_version 454208 (0.0010) [2023-12-26 03:12:46,983][123091] Updated weights for policy 0, policy_version 454218 (0.0010) [2023-12-26 03:12:47,767][123091] Updated weights for policy 0, policy_version 454228 (0.0008) [2023-12-26 03:12:47,780][123090] Updated weights for policy 1, policy_version 451398 (0.0009) [2023-12-26 03:12:47,825][123091] Updated weights for policy 0, policy_version 454238 (0.0006) [2023-12-26 03:12:47,840][123090] Updated weights for policy 1, policy_version 451408 (0.0005) [2023-12-26 03:12:47,881][123091] Updated weights for policy 0, policy_version 454248 (0.0005) [2023-12-26 03:12:47,909][123090] Updated weights for policy 1, policy_version 451418 (0.0005) [2023-12-26 03:12:48,560][123091] Updated weights for policy 0, policy_version 454258 (0.0006) [2023-12-26 03:12:48,620][123091] Updated weights for policy 0, policy_version 454268 (0.0011) [2023-12-26 03:12:48,671][123090] Updated weights for policy 1, policy_version 451428 (0.0008) [2023-12-26 03:12:48,685][123091] Updated weights for policy 0, policy_version 454278 (0.0011) [2023-12-26 03:12:48,740][123090] Updated weights for policy 1, policy_version 451438 (0.0011) [2023-12-26 03:12:48,745][123091] Updated weights for policy 0, policy_version 454288 (0.0008) [2023-12-26 03:12:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 231866368. Throughput: 0: 8865.9, 1: 8890.8. Samples: 231878452. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:12:48,784][121949] Avg episode reward: [(0, '5989.814'), (1, '5600.334')] [2023-12-26 03:12:48,807][123090] Updated weights for policy 1, policy_version 451448 (0.0010) [2023-12-26 03:12:49,490][123091] Updated weights for policy 0, policy_version 454298 (0.0008) [2023-12-26 03:12:49,538][123091] Updated weights for policy 0, policy_version 454308 (0.0006) [2023-12-26 03:12:49,583][123090] Updated weights for policy 1, policy_version 451458 (0.0010) [2023-12-26 03:12:49,593][123091] Updated weights for policy 0, policy_version 454318 (0.0006) [2023-12-26 03:12:49,646][123090] Updated weights for policy 1, policy_version 451468 (0.0010) [2023-12-26 03:12:49,718][123090] Updated weights for policy 1, policy_version 451478 (0.0011) [2023-12-26 03:12:49,778][123090] Updated weights for policy 1, policy_version 451488 (0.0010) [2023-12-26 03:12:50,404][123091] Updated weights for policy 0, policy_version 454328 (0.0008) [2023-12-26 03:12:50,465][123091] Updated weights for policy 0, policy_version 454338 (0.0009) [2023-12-26 03:12:50,524][123091] Updated weights for policy 0, policy_version 454348 (0.0009) [2023-12-26 03:12:50,620][123090] Updated weights for policy 1, policy_version 451498 (0.0009) [2023-12-26 03:12:50,691][123090] Updated weights for policy 1, policy_version 451508 (0.0006) [2023-12-26 03:12:50,759][123090] Updated weights for policy 1, policy_version 451518 (0.0008) [2023-12-26 03:12:51,385][123091] Updated weights for policy 0, policy_version 454358 (0.0008) [2023-12-26 03:12:51,453][123091] Updated weights for policy 0, policy_version 454368 (0.0006) [2023-12-26 03:12:51,523][123091] Updated weights for policy 0, policy_version 454378 (0.0005) [2023-12-26 03:12:51,581][123090] Updated weights for policy 1, policy_version 451528 (0.0010) [2023-12-26 03:12:51,647][123090] Updated weights for policy 1, policy_version 451538 (0.0010) [2023-12-26 03:12:51,710][123090] Updated weights for policy 1, policy_version 451548 (0.0009) [2023-12-26 03:12:52,240][123091] Updated weights for policy 0, policy_version 454388 (0.0006) [2023-12-26 03:12:52,304][123091] Updated weights for policy 0, policy_version 454398 (0.0008) [2023-12-26 03:12:52,372][123091] Updated weights for policy 0, policy_version 454408 (0.0007) [2023-12-26 03:12:52,562][123090] Updated weights for policy 1, policy_version 451558 (0.0010) [2023-12-26 03:12:52,623][123090] Updated weights for policy 1, policy_version 451568 (0.0009) [2023-12-26 03:12:52,691][123090] Updated weights for policy 1, policy_version 451578 (0.0009) [2023-12-26 03:12:53,140][123091] Updated weights for policy 0, policy_version 454418 (0.0006) [2023-12-26 03:12:53,201][123091] Updated weights for policy 0, policy_version 454429 (0.0010) [2023-12-26 03:12:53,258][123091] Updated weights for policy 0, policy_version 454439 (0.0010) [2023-12-26 03:12:53,485][123090] Updated weights for policy 1, policy_version 451588 (0.0007) [2023-12-26 03:12:53,555][123090] Updated weights for policy 1, policy_version 451598 (0.0009) [2023-12-26 03:12:53,622][123090] Updated weights for policy 1, policy_version 451608 (0.0009) [2023-12-26 03:12:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 231956480. Throughput: 0: 8897.3, 1: 8817.9. Samples: 231930520. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:12:53,785][121949] Avg episode reward: [(0, '6006.646'), (1, '5515.353')] [2023-12-26 03:12:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000451616_115613696.pth... [2023-12-26 03:12:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000454448_116342784.pth... [2023-12-26 03:12:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000450560_115343360.pth [2023-12-26 03:12:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000453424_116080640.pth [2023-12-26 03:12:54,056][123091] Updated weights for policy 0, policy_version 454449 (0.0010) [2023-12-26 03:12:54,119][123091] Updated weights for policy 0, policy_version 454459 (0.0011) [2023-12-26 03:12:54,187][123091] Updated weights for policy 0, policy_version 454469 (0.0005) [2023-12-26 03:12:54,249][123091] Updated weights for policy 0, policy_version 454479 (0.0005) [2023-12-26 03:12:54,433][123090] Updated weights for policy 1, policy_version 451618 (0.0009) [2023-12-26 03:12:54,484][123090] Updated weights for policy 1, policy_version 451628 (0.0010) [2023-12-26 03:12:54,539][123090] Updated weights for policy 1, policy_version 451638 (0.0010) [2023-12-26 03:12:54,602][123090] Updated weights for policy 1, policy_version 451648 (0.0010) [2023-12-26 03:12:54,954][123091] Updated weights for policy 0, policy_version 454489 (0.0010) [2023-12-26 03:12:55,010][123091] Updated weights for policy 0, policy_version 454499 (0.0011) [2023-12-26 03:12:55,072][123091] Updated weights for policy 0, policy_version 454509 (0.0011) [2023-12-26 03:12:55,378][123090] Updated weights for policy 1, policy_version 451658 (0.0005) [2023-12-26 03:12:55,437][123090] Updated weights for policy 1, policy_version 451668 (0.0007) [2023-12-26 03:12:55,495][123090] Updated weights for policy 1, policy_version 451678 (0.0005) [2023-12-26 03:12:55,806][123091] Updated weights for policy 0, policy_version 454519 (0.0011) [2023-12-26 03:12:55,872][123091] Updated weights for policy 0, policy_version 454529 (0.0011) [2023-12-26 03:12:55,933][123091] Updated weights for policy 0, policy_version 454539 (0.0007) [2023-12-26 03:12:56,274][123090] Updated weights for policy 1, policy_version 451688 (0.0007) [2023-12-26 03:12:56,336][123090] Updated weights for policy 1, policy_version 451698 (0.0008) [2023-12-26 03:12:56,396][123090] Updated weights for policy 1, policy_version 451708 (0.0010) [2023-12-26 03:12:56,670][123091] Updated weights for policy 0, policy_version 454549 (0.0009) [2023-12-26 03:12:56,725][123091] Updated weights for policy 0, policy_version 454559 (0.0007) [2023-12-26 03:12:56,779][123091] Updated weights for policy 0, policy_version 454569 (0.0010) [2023-12-26 03:12:57,146][123090] Updated weights for policy 1, policy_version 451718 (0.0008) [2023-12-26 03:12:57,210][123090] Updated weights for policy 1, policy_version 451728 (0.0009) [2023-12-26 03:12:57,275][123090] Updated weights for policy 1, policy_version 451738 (0.0009) [2023-12-26 03:12:57,585][123091] Updated weights for policy 0, policy_version 454579 (0.0010) [2023-12-26 03:12:57,629][123091] Updated weights for policy 0, policy_version 454589 (0.0010) [2023-12-26 03:12:57,683][123091] Updated weights for policy 0, policy_version 454599 (0.0010) [2023-12-26 03:12:58,112][123090] Updated weights for policy 1, policy_version 451748 (0.0009) [2023-12-26 03:12:58,177][123090] Updated weights for policy 1, policy_version 451758 (0.0009) [2023-12-26 03:12:58,236][123090] Updated weights for policy 1, policy_version 451768 (0.0008) [2023-12-26 03:12:58,570][123091] Updated weights for policy 0, policy_version 454609 (0.0010) [2023-12-26 03:12:58,641][123091] Updated weights for policy 0, policy_version 454619 (0.0010) [2023-12-26 03:12:58,708][123091] Updated weights for policy 0, policy_version 454629 (0.0008) [2023-12-26 03:12:58,769][123091] Updated weights for policy 0, policy_version 454639 (0.0010) [2023-12-26 03:12:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 232046592. Throughput: 0: 8989.9, 1: 8829.6. Samples: 232038288. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:12:58,785][121949] Avg episode reward: [(0, '6124.919'), (1, '5578.358')] [2023-12-26 03:12:59,070][123090] Updated weights for policy 1, policy_version 451778 (0.0009) [2023-12-26 03:12:59,117][123090] Updated weights for policy 1, policy_version 451788 (0.0009) [2023-12-26 03:12:59,169][123090] Updated weights for policy 1, policy_version 451798 (0.0009) [2023-12-26 03:12:59,231][123090] Updated weights for policy 1, policy_version 451808 (0.0009) [2023-12-26 03:12:59,629][123091] Updated weights for policy 0, policy_version 454649 (0.0009) [2023-12-26 03:12:59,690][123091] Updated weights for policy 0, policy_version 454659 (0.0009) [2023-12-26 03:12:59,754][123091] Updated weights for policy 0, policy_version 454669 (0.0009) [2023-12-26 03:13:00,116][123090] Updated weights for policy 1, policy_version 451818 (0.0011) [2023-12-26 03:13:00,168][123090] Updated weights for policy 1, policy_version 451828 (0.0010) [2023-12-26 03:13:00,235][123090] Updated weights for policy 1, policy_version 451838 (0.0011) [2023-12-26 03:13:00,573][123091] Updated weights for policy 0, policy_version 454679 (0.0010) [2023-12-26 03:13:00,627][123091] Updated weights for policy 0, policy_version 454689 (0.0009) [2023-12-26 03:13:00,675][123091] Updated weights for policy 0, policy_version 454699 (0.0009) [2023-12-26 03:13:01,083][123090] Updated weights for policy 1, policy_version 451848 (0.0009) [2023-12-26 03:13:01,160][123090] Updated weights for policy 1, policy_version 451858 (0.0010) [2023-12-26 03:13:01,228][123090] Updated weights for policy 1, policy_version 451868 (0.0010) [2023-12-26 03:13:01,530][123091] Updated weights for policy 0, policy_version 454709 (0.0009) [2023-12-26 03:13:01,581][123091] Updated weights for policy 0, policy_version 454720 (0.0009) [2023-12-26 03:13:01,639][123091] Updated weights for policy 0, policy_version 454730 (0.0009) [2023-12-26 03:13:02,002][123090] Updated weights for policy 1, policy_version 451878 (0.0009) [2023-12-26 03:13:02,059][123090] Updated weights for policy 1, policy_version 451888 (0.0009) [2023-12-26 03:13:02,125][123090] Updated weights for policy 1, policy_version 451898 (0.0009) [2023-12-26 03:13:02,519][123091] Updated weights for policy 0, policy_version 454740 (0.0009) [2023-12-26 03:13:02,582][123091] Updated weights for policy 0, policy_version 454750 (0.0008) [2023-12-26 03:13:02,649][123091] Updated weights for policy 0, policy_version 454760 (0.0008) [2023-12-26 03:13:02,954][123090] Updated weights for policy 1, policy_version 451908 (0.0008) [2023-12-26 03:13:03,023][123090] Updated weights for policy 1, policy_version 451918 (0.0008) [2023-12-26 03:13:03,080][123090] Updated weights for policy 1, policy_version 451928 (0.0009) [2023-12-26 03:13:03,473][123091] Updated weights for policy 0, policy_version 454770 (0.0009) [2023-12-26 03:13:03,545][123091] Updated weights for policy 0, policy_version 454780 (0.0009) [2023-12-26 03:13:03,603][123091] Updated weights for policy 0, policy_version 454791 (0.0010) [2023-12-26 03:13:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 232128512. Throughput: 0: 8841.1, 1: 8791.3. Samples: 232139176. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:03,785][121949] Avg episode reward: [(0, '6147.080'), (1, '5625.476')] [2023-12-26 03:13:03,842][123090] Updated weights for policy 1, policy_version 451938 (0.0008) [2023-12-26 03:13:03,902][123090] Updated weights for policy 1, policy_version 451948 (0.0007) [2023-12-26 03:13:03,966][123090] Updated weights for policy 1, policy_version 451958 (0.0006) [2023-12-26 03:13:04,036][123090] Updated weights for policy 1, policy_version 451968 (0.0007) [2023-12-26 03:13:04,430][123091] Updated weights for policy 0, policy_version 454801 (0.0010) [2023-12-26 03:13:04,506][123091] Updated weights for policy 0, policy_version 454811 (0.0010) [2023-12-26 03:13:04,576][123091] Updated weights for policy 0, policy_version 454821 (0.0009) [2023-12-26 03:13:04,650][123091] Updated weights for policy 0, policy_version 454831 (0.0010) [2023-12-26 03:13:04,799][123090] Updated weights for policy 1, policy_version 451978 (0.0010) [2023-12-26 03:13:04,852][123090] Updated weights for policy 1, policy_version 451989 (0.0010) [2023-12-26 03:13:04,905][123090] Updated weights for policy 1, policy_version 451999 (0.0009) [2023-12-26 03:13:05,358][123091] Updated weights for policy 0, policy_version 454841 (0.0010) [2023-12-26 03:13:05,423][123091] Updated weights for policy 0, policy_version 454851 (0.0009) [2023-12-26 03:13:05,494][123091] Updated weights for policy 0, policy_version 454861 (0.0008) [2023-12-26 03:13:05,808][123090] Updated weights for policy 1, policy_version 452009 (0.0010) [2023-12-26 03:13:05,861][123090] Updated weights for policy 1, policy_version 452019 (0.0009) [2023-12-26 03:13:05,920][123090] Updated weights for policy 1, policy_version 452029 (0.0009) [2023-12-26 03:13:06,240][123091] Updated weights for policy 0, policy_version 454871 (0.0005) [2023-12-26 03:13:06,290][123091] Updated weights for policy 0, policy_version 454881 (0.0005) [2023-12-26 03:13:06,341][123091] Updated weights for policy 0, policy_version 454891 (0.0009) [2023-12-26 03:13:06,750][123090] Updated weights for policy 1, policy_version 452039 (0.0007) [2023-12-26 03:13:06,817][123090] Updated weights for policy 1, policy_version 452049 (0.0006) [2023-12-26 03:13:06,883][123090] Updated weights for policy 1, policy_version 452059 (0.0005) [2023-12-26 03:13:07,218][123091] Updated weights for policy 0, policy_version 454901 (0.0009) [2023-12-26 03:13:07,270][123091] Updated weights for policy 0, policy_version 454911 (0.0009) [2023-12-26 03:13:07,330][123091] Updated weights for policy 0, policy_version 454921 (0.0009) [2023-12-26 03:13:07,649][123090] Updated weights for policy 1, policy_version 452069 (0.0007) [2023-12-26 03:13:07,714][123090] Updated weights for policy 1, policy_version 452079 (0.0006) [2023-12-26 03:13:07,778][123090] Updated weights for policy 1, policy_version 452089 (0.0005) [2023-12-26 03:13:08,228][123091] Updated weights for policy 0, policy_version 454931 (0.0009) [2023-12-26 03:13:08,291][123091] Updated weights for policy 0, policy_version 454941 (0.0009) [2023-12-26 03:13:08,356][123091] Updated weights for policy 0, policy_version 454951 (0.0009) [2023-12-26 03:13:08,512][123090] Updated weights for policy 1, policy_version 452099 (0.0007) [2023-12-26 03:13:08,580][123090] Updated weights for policy 1, policy_version 452109 (0.0009) [2023-12-26 03:13:08,644][123090] Updated weights for policy 1, policy_version 452119 (0.0008) [2023-12-26 03:13:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 232218624. Throughput: 0: 8842.5, 1: 8791.0. Samples: 232192252. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:08,785][121949] Avg episode reward: [(0, '6090.836'), (1, '5669.795')] [2023-12-26 03:13:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000454960_116473856.pth... [2023-12-26 03:13:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000452128_115744768.pth... [2023-12-26 03:13:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000453936_116211712.pth [2023-12-26 03:13:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000451104_115482624.pth [2023-12-26 03:13:09,236][123091] Updated weights for policy 0, policy_version 454961 (0.0010) [2023-12-26 03:13:09,294][123091] Updated weights for policy 0, policy_version 454971 (0.0009) [2023-12-26 03:13:09,326][123090] Updated weights for policy 1, policy_version 452129 (0.0006) [2023-12-26 03:13:09,355][123091] Updated weights for policy 0, policy_version 454981 (0.0008) [2023-12-26 03:13:09,396][123090] Updated weights for policy 1, policy_version 452139 (0.0009) [2023-12-26 03:13:09,431][123091] Updated weights for policy 0, policy_version 454991 (0.0009) [2023-12-26 03:13:09,457][123090] Updated weights for policy 1, policy_version 452149 (0.0009) [2023-12-26 03:13:09,509][123090] Updated weights for policy 1, policy_version 452159 (0.0008) [2023-12-26 03:13:10,293][123091] Updated weights for policy 0, policy_version 455001 (0.0009) [2023-12-26 03:13:10,347][123091] Updated weights for policy 0, policy_version 455011 (0.0007) [2023-12-26 03:13:10,370][123090] Updated weights for policy 1, policy_version 452169 (0.0010) [2023-12-26 03:13:10,409][123091] Updated weights for policy 0, policy_version 455021 (0.0010) [2023-12-26 03:13:10,438][123090] Updated weights for policy 1, policy_version 452179 (0.0009) [2023-12-26 03:13:10,500][123090] Updated weights for policy 1, policy_version 452189 (0.0009) [2023-12-26 03:13:11,257][123090] Updated weights for policy 1, policy_version 452199 (0.0007) [2023-12-26 03:13:11,278][123091] Updated weights for policy 0, policy_version 455031 (0.0009) [2023-12-26 03:13:11,326][123090] Updated weights for policy 1, policy_version 452209 (0.0009) [2023-12-26 03:13:11,335][123091] Updated weights for policy 0, policy_version 455041 (0.0010) [2023-12-26 03:13:11,391][123090] Updated weights for policy 1, policy_version 452219 (0.0008) [2023-12-26 03:13:11,406][123091] Updated weights for policy 0, policy_version 455051 (0.0008) [2023-12-26 03:13:12,167][123090] Updated weights for policy 1, policy_version 452229 (0.0008) [2023-12-26 03:13:12,236][123090] Updated weights for policy 1, policy_version 452239 (0.0009) [2023-12-26 03:13:12,273][123091] Updated weights for policy 0, policy_version 455061 (0.0009) [2023-12-26 03:13:12,302][123090] Updated weights for policy 1, policy_version 452249 (0.0008) [2023-12-26 03:13:12,335][123091] Updated weights for policy 0, policy_version 455071 (0.0009) [2023-12-26 03:13:12,397][123091] Updated weights for policy 0, policy_version 455081 (0.0009) [2023-12-26 03:13:13,062][123090] Updated weights for policy 1, policy_version 452259 (0.0009) [2023-12-26 03:13:13,125][123090] Updated weights for policy 1, policy_version 452269 (0.0011) [2023-12-26 03:13:13,181][123090] Updated weights for policy 1, policy_version 452279 (0.0010) [2023-12-26 03:13:13,308][123091] Updated weights for policy 0, policy_version 455091 (0.0009) [2023-12-26 03:13:13,371][123091] Updated weights for policy 0, policy_version 455101 (0.0009) [2023-12-26 03:13:13,430][123091] Updated weights for policy 0, policy_version 455111 (0.0009) [2023-12-26 03:13:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 232300544. Throughput: 0: 8729.4, 1: 8773.1. Samples: 232294760. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:13,785][121949] Avg episode reward: [(0, '6093.724'), (1, '5666.138')] [2023-12-26 03:13:13,960][123090] Updated weights for policy 1, policy_version 452289 (0.0010) [2023-12-26 03:13:14,031][123090] Updated weights for policy 1, policy_version 452299 (0.0005) [2023-12-26 03:13:14,104][123090] Updated weights for policy 1, policy_version 452309 (0.0005) [2023-12-26 03:13:14,147][123091] Updated weights for policy 0, policy_version 455121 (0.0009) [2023-12-26 03:13:14,172][123090] Updated weights for policy 1, policy_version 452319 (0.0005) [2023-12-26 03:13:14,214][123091] Updated weights for policy 0, policy_version 455131 (0.0010) [2023-12-26 03:13:14,280][123091] Updated weights for policy 0, policy_version 455141 (0.0010) [2023-12-26 03:13:14,347][123091] Updated weights for policy 0, policy_version 455151 (0.0009) [2023-12-26 03:13:14,927][123090] Updated weights for policy 1, policy_version 452329 (0.0010) [2023-12-26 03:13:14,992][123090] Updated weights for policy 1, policy_version 452339 (0.0011) [2023-12-26 03:13:15,057][123090] Updated weights for policy 1, policy_version 452349 (0.0011) [2023-12-26 03:13:15,139][123091] Updated weights for policy 0, policy_version 455161 (0.0009) [2023-12-26 03:13:15,187][123091] Updated weights for policy 0, policy_version 455171 (0.0008) [2023-12-26 03:13:15,237][123091] Updated weights for policy 0, policy_version 455181 (0.0009) [2023-12-26 03:13:15,892][123090] Updated weights for policy 1, policy_version 452359 (0.0011) [2023-12-26 03:13:15,953][123090] Updated weights for policy 1, policy_version 452369 (0.0010) [2023-12-26 03:13:16,023][123090] Updated weights for policy 1, policy_version 452379 (0.0009) [2023-12-26 03:13:16,096][123091] Updated weights for policy 0, policy_version 455191 (0.0009) [2023-12-26 03:13:16,159][123091] Updated weights for policy 0, policy_version 455201 (0.0009) [2023-12-26 03:13:16,227][123091] Updated weights for policy 0, policy_version 455211 (0.0009) [2023-12-26 03:13:16,799][123090] Updated weights for policy 1, policy_version 452389 (0.0008) [2023-12-26 03:13:16,862][123090] Updated weights for policy 1, policy_version 452399 (0.0008) [2023-12-26 03:13:16,914][123090] Updated weights for policy 1, policy_version 452409 (0.0009) [2023-12-26 03:13:17,043][123091] Updated weights for policy 0, policy_version 455221 (0.0011) [2023-12-26 03:13:17,099][123091] Updated weights for policy 0, policy_version 455231 (0.0011) [2023-12-26 03:13:17,166][123091] Updated weights for policy 0, policy_version 455241 (0.0010) [2023-12-26 03:13:17,745][123090] Updated weights for policy 1, policy_version 452419 (0.0007) [2023-12-26 03:13:17,803][123090] Updated weights for policy 1, policy_version 452429 (0.0006) [2023-12-26 03:13:17,860][123090] Updated weights for policy 1, policy_version 452439 (0.0009) [2023-12-26 03:13:17,944][123091] Updated weights for policy 0, policy_version 455251 (0.0010) [2023-12-26 03:13:18,003][123091] Updated weights for policy 0, policy_version 455261 (0.0010) [2023-12-26 03:13:18,071][123091] Updated weights for policy 0, policy_version 455271 (0.0005) [2023-12-26 03:13:18,709][123090] Updated weights for policy 1, policy_version 452449 (0.0010) [2023-12-26 03:13:18,773][123090] Updated weights for policy 1, policy_version 452459 (0.0009) [2023-12-26 03:13:18,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17606.1). Total num frames: 232382464. Throughput: 0: 8702.0, 1: 8773.1. Samples: 232400184. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:18,785][121949] Avg episode reward: [(0, '6084.977'), (1, '5675.635')] [2023-12-26 03:13:18,835][123090] Updated weights for policy 1, policy_version 452469 (0.0010) [2023-12-26 03:13:18,858][123091] Updated weights for policy 0, policy_version 455281 (0.0008) [2023-12-26 03:13:18,904][123090] Updated weights for policy 1, policy_version 452479 (0.0008) [2023-12-26 03:13:18,926][123091] Updated weights for policy 0, policy_version 455291 (0.0011) [2023-12-26 03:13:18,986][123091] Updated weights for policy 0, policy_version 455301 (0.0011) [2023-12-26 03:13:19,057][123091] Updated weights for policy 0, policy_version 455311 (0.0011) [2023-12-26 03:13:19,775][123090] Updated weights for policy 1, policy_version 452489 (0.0008) [2023-12-26 03:13:19,846][123090] Updated weights for policy 1, policy_version 452499 (0.0007) [2023-12-26 03:13:19,910][123091] Updated weights for policy 0, policy_version 455321 (0.0011) [2023-12-26 03:13:19,916][123090] Updated weights for policy 1, policy_version 452509 (0.0009) [2023-12-26 03:13:19,980][123091] Updated weights for policy 0, policy_version 455331 (0.0011) [2023-12-26 03:13:20,046][123091] Updated weights for policy 0, policy_version 455341 (0.0011) [2023-12-26 03:13:20,811][123090] Updated weights for policy 1, policy_version 452519 (0.0008) [2023-12-26 03:13:20,854][123091] Updated weights for policy 0, policy_version 455351 (0.0010) [2023-12-26 03:13:20,879][123090] Updated weights for policy 1, policy_version 452529 (0.0008) [2023-12-26 03:13:20,917][123091] Updated weights for policy 0, policy_version 455361 (0.0007) [2023-12-26 03:13:20,946][123090] Updated weights for policy 1, policy_version 452539 (0.0009) [2023-12-26 03:13:20,983][123091] Updated weights for policy 0, policy_version 455371 (0.0007) [2023-12-26 03:13:21,844][123091] Updated weights for policy 0, policy_version 455381 (0.0010) [2023-12-26 03:13:21,868][123090] Updated weights for policy 1, policy_version 452549 (0.0007) [2023-12-26 03:13:21,901][123091] Updated weights for policy 0, policy_version 455391 (0.0009) [2023-12-26 03:13:21,921][123090] Updated weights for policy 1, policy_version 452559 (0.0008) [2023-12-26 03:13:21,954][123091] Updated weights for policy 0, policy_version 455401 (0.0007) [2023-12-26 03:13:21,983][123090] Updated weights for policy 1, policy_version 452569 (0.0008) [2023-12-26 03:13:22,839][123090] Updated weights for policy 1, policy_version 452579 (0.0010) [2023-12-26 03:13:22,856][123091] Updated weights for policy 0, policy_version 455411 (0.0007) [2023-12-26 03:13:22,896][123090] Updated weights for policy 1, policy_version 452589 (0.0010) [2023-12-26 03:13:22,920][123091] Updated weights for policy 0, policy_version 455421 (0.0008) [2023-12-26 03:13:22,960][123090] Updated weights for policy 1, policy_version 452599 (0.0009) [2023-12-26 03:13:22,985][123091] Updated weights for policy 0, policy_version 455431 (0.0010) [2023-12-26 03:13:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 232464384. Throughput: 0: 8665.0, 1: 8695.4. Samples: 232449100. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:23,785][121949] Avg episode reward: [(0, '6131.617'), (1, '5616.907')] [2023-12-26 03:13:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000455440_116596736.pth... [2023-12-26 03:13:23,791][123090] Updated weights for policy 1, policy_version 452609 (0.0009) [2023-12-26 03:13:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000454448_116342784.pth [2023-12-26 03:13:23,818][123091] Updated weights for policy 0, policy_version 455441 (0.0009) [2023-12-26 03:13:23,861][123090] Updated weights for policy 1, policy_version 452619 (0.0010) [2023-12-26 03:13:23,868][123091] Updated weights for policy 0, policy_version 455451 (0.0007) [2023-12-26 03:13:23,918][123091] Updated weights for policy 0, policy_version 455461 (0.0010) [2023-12-26 03:13:23,928][123090] Updated weights for policy 1, policy_version 452629 (0.0008) [2023-12-26 03:13:23,969][123091] Updated weights for policy 0, policy_version 455471 (0.0009) [2023-12-26 03:13:23,991][123090] Updated weights for policy 1, policy_version 452639 (0.0008) [2023-12-26 03:13:23,996][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000452640_115875840.pth... [2023-12-26 03:13:24,000][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000451616_115613696.pth [2023-12-26 03:13:24,775][123090] Updated weights for policy 1, policy_version 452649 (0.0010) [2023-12-26 03:13:24,807][123091] Updated weights for policy 0, policy_version 455481 (0.0006) [2023-12-26 03:13:24,838][123090] Updated weights for policy 1, policy_version 452659 (0.0008) [2023-12-26 03:13:24,858][123091] Updated weights for policy 0, policy_version 455491 (0.0007) [2023-12-26 03:13:24,896][123090] Updated weights for policy 1, policy_version 452669 (0.0009) [2023-12-26 03:13:24,921][123091] Updated weights for policy 0, policy_version 455501 (0.0008) [2023-12-26 03:13:25,530][123091] Updated weights for policy 0, policy_version 455511 (0.0010) [2023-12-26 03:13:25,595][123091] Updated weights for policy 0, policy_version 455521 (0.0009) [2023-12-26 03:13:25,662][123091] Updated weights for policy 0, policy_version 455531 (0.0009) [2023-12-26 03:13:25,784][123090] Updated weights for policy 1, policy_version 452679 (0.0010) [2023-12-26 03:13:25,856][123090] Updated weights for policy 1, policy_version 452689 (0.0009) [2023-12-26 03:13:25,916][123090] Updated weights for policy 1, policy_version 452699 (0.0008) [2023-12-26 03:13:26,389][123091] Updated weights for policy 0, policy_version 455541 (0.0007) [2023-12-26 03:13:26,438][123091] Updated weights for policy 0, policy_version 455551 (0.0008) [2023-12-26 03:13:26,489][123091] Updated weights for policy 0, policy_version 455561 (0.0009) [2023-12-26 03:13:26,782][123090] Updated weights for policy 1, policy_version 452709 (0.0009) [2023-12-26 03:13:26,840][123090] Updated weights for policy 1, policy_version 452719 (0.0010) [2023-12-26 03:13:26,901][123090] Updated weights for policy 1, policy_version 452729 (0.0010) [2023-12-26 03:13:27,234][123091] Updated weights for policy 0, policy_version 455571 (0.0010) [2023-12-26 03:13:27,301][123091] Updated weights for policy 0, policy_version 455581 (0.0009) [2023-12-26 03:13:27,363][123091] Updated weights for policy 0, policy_version 455591 (0.0009) [2023-12-26 03:13:27,816][123090] Updated weights for policy 1, policy_version 452739 (0.0010) [2023-12-26 03:13:27,875][123090] Updated weights for policy 1, policy_version 452749 (0.0009) [2023-12-26 03:13:27,933][123090] Updated weights for policy 1, policy_version 452759 (0.0010) [2023-12-26 03:13:28,031][123091] Updated weights for policy 0, policy_version 455601 (0.0007) [2023-12-26 03:13:28,096][123091] Updated weights for policy 0, policy_version 455611 (0.0009) [2023-12-26 03:13:28,155][123091] Updated weights for policy 0, policy_version 455621 (0.0011) [2023-12-26 03:13:28,208][123091] Updated weights for policy 0, policy_version 455631 (0.0010) [2023-12-26 03:13:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 232554496. Throughput: 0: 8753.1, 1: 8655.6. Samples: 232553172. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:28,785][121949] Avg episode reward: [(0, '6139.750'), (1, '5468.676')] [2023-12-26 03:13:28,849][123090] Updated weights for policy 1, policy_version 452770 (0.0010) [2023-12-26 03:13:28,916][123090] Updated weights for policy 1, policy_version 452780 (0.0009) [2023-12-26 03:13:28,982][123090] Updated weights for policy 1, policy_version 452790 (0.0008) [2023-12-26 03:13:28,992][123091] Updated weights for policy 0, policy_version 455641 (0.0010) [2023-12-26 03:13:29,045][123090] Updated weights for policy 1, policy_version 452800 (0.0008) [2023-12-26 03:13:29,054][123091] Updated weights for policy 0, policy_version 455651 (0.0010) [2023-12-26 03:13:29,120][123091] Updated weights for policy 0, policy_version 455661 (0.0010) [2023-12-26 03:13:29,832][123090] Updated weights for policy 1, policy_version 452810 (0.0010) [2023-12-26 03:13:29,897][123090] Updated weights for policy 1, policy_version 452820 (0.0009) [2023-12-26 03:13:29,960][123091] Updated weights for policy 0, policy_version 455671 (0.0009) [2023-12-26 03:13:29,963][123090] Updated weights for policy 1, policy_version 452830 (0.0008) [2023-12-26 03:13:30,021][123091] Updated weights for policy 0, policy_version 455681 (0.0006) [2023-12-26 03:13:30,091][123091] Updated weights for policy 0, policy_version 455691 (0.0006) [2023-12-26 03:13:30,793][123091] Updated weights for policy 0, policy_version 455701 (0.0008) [2023-12-26 03:13:30,830][123090] Updated weights for policy 1, policy_version 452840 (0.0006) [2023-12-26 03:13:30,839][123091] Updated weights for policy 0, policy_version 455711 (0.0010) [2023-12-26 03:13:30,893][123090] Updated weights for policy 1, policy_version 452850 (0.0009) [2023-12-26 03:13:30,893][123091] Updated weights for policy 0, policy_version 455721 (0.0006) [2023-12-26 03:13:30,948][123090] Updated weights for policy 1, policy_version 452860 (0.0009) [2023-12-26 03:13:31,746][123091] Updated weights for policy 0, policy_version 455731 (0.0007) [2023-12-26 03:13:31,815][123091] Updated weights for policy 0, policy_version 455741 (0.0006) [2023-12-26 03:13:31,881][123090] Updated weights for policy 1, policy_version 452870 (0.0009) [2023-12-26 03:13:31,883][123091] Updated weights for policy 0, policy_version 455751 (0.0006) [2023-12-26 03:13:31,935][123090] Updated weights for policy 1, policy_version 452880 (0.0006) [2023-12-26 03:13:31,993][123090] Updated weights for policy 1, policy_version 452890 (0.0006) [2023-12-26 03:13:32,692][123091] Updated weights for policy 0, policy_version 455761 (0.0008) [2023-12-26 03:13:32,739][123091] Updated weights for policy 0, policy_version 455771 (0.0010) [2023-12-26 03:13:32,786][123090] Updated weights for policy 1, policy_version 452900 (0.0009) [2023-12-26 03:13:32,799][123091] Updated weights for policy 0, policy_version 455781 (0.0010) [2023-12-26 03:13:32,842][123090] Updated weights for policy 1, policy_version 452910 (0.0010) [2023-12-26 03:13:32,862][123091] Updated weights for policy 0, policy_version 455791 (0.0006) [2023-12-26 03:13:32,907][123090] Updated weights for policy 1, policy_version 452920 (0.0011) [2023-12-26 03:13:33,666][123091] Updated weights for policy 0, policy_version 455801 (0.0009) [2023-12-26 03:13:33,671][123090] Updated weights for policy 1, policy_version 452930 (0.0010) [2023-12-26 03:13:33,726][123091] Updated weights for policy 0, policy_version 455811 (0.0008) [2023-12-26 03:13:33,727][123090] Updated weights for policy 1, policy_version 452940 (0.0008) [2023-12-26 03:13:33,779][123091] Updated weights for policy 0, policy_version 455821 (0.0008) [2023-12-26 03:13:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 232636416. Throughput: 0: 8727.6, 1: 8580.0. Samples: 232657292. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:33,784][121949] Avg episode reward: [(0, '6070.639'), (1, '5438.807')] [2023-12-26 03:13:33,793][123090] Updated weights for policy 1, policy_version 452950 (0.0009) [2023-12-26 03:13:33,862][123090] Updated weights for policy 1, policy_version 452960 (0.0009) [2023-12-26 03:13:34,622][123091] Updated weights for policy 0, policy_version 455831 (0.0006) [2023-12-26 03:13:34,693][123090] Updated weights for policy 1, policy_version 452970 (0.0008) [2023-12-26 03:13:34,695][123091] Updated weights for policy 0, policy_version 455841 (0.0008) [2023-12-26 03:13:34,750][123091] Updated weights for policy 0, policy_version 455851 (0.0007) [2023-12-26 03:13:34,760][123090] Updated weights for policy 1, policy_version 452980 (0.0009) [2023-12-26 03:13:34,823][123090] Updated weights for policy 1, policy_version 452990 (0.0010) [2023-12-26 03:13:35,512][123091] Updated weights for policy 0, policy_version 455861 (0.0007) [2023-12-26 03:13:35,563][123091] Updated weights for policy 0, policy_version 455871 (0.0005) [2023-12-26 03:13:35,619][123091] Updated weights for policy 0, policy_version 455881 (0.0005) [2023-12-26 03:13:35,627][123090] Updated weights for policy 1, policy_version 453000 (0.0010) [2023-12-26 03:13:35,689][123090] Updated weights for policy 1, policy_version 453010 (0.0009) [2023-12-26 03:13:35,748][123090] Updated weights for policy 1, policy_version 453020 (0.0010) [2023-12-26 03:13:36,357][123091] Updated weights for policy 0, policy_version 455891 (0.0005) [2023-12-26 03:13:36,428][123091] Updated weights for policy 0, policy_version 455901 (0.0009) [2023-12-26 03:13:36,493][123091] Updated weights for policy 0, policy_version 455911 (0.0010) [2023-12-26 03:13:36,577][123090] Updated weights for policy 1, policy_version 453030 (0.0007) [2023-12-26 03:13:36,640][123090] Updated weights for policy 1, policy_version 453040 (0.0006) [2023-12-26 03:13:36,715][123090] Updated weights for policy 1, policy_version 453050 (0.0005) [2023-12-26 03:13:37,329][123091] Updated weights for policy 0, policy_version 455921 (0.0009) [2023-12-26 03:13:37,384][123091] Updated weights for policy 0, policy_version 455931 (0.0009) [2023-12-26 03:13:37,404][123090] Updated weights for policy 1, policy_version 453060 (0.0006) [2023-12-26 03:13:37,438][123091] Updated weights for policy 0, policy_version 455941 (0.0008) [2023-12-26 03:13:37,470][123090] Updated weights for policy 1, policy_version 453070 (0.0006) [2023-12-26 03:13:37,498][123091] Updated weights for policy 0, policy_version 455951 (0.0010) [2023-12-26 03:13:37,534][123090] Updated weights for policy 1, policy_version 453080 (0.0006) [2023-12-26 03:13:38,175][123090] Updated weights for policy 1, policy_version 453090 (0.0005) [2023-12-26 03:13:38,223][123091] Updated weights for policy 0, policy_version 455961 (0.0009) [2023-12-26 03:13:38,233][123090] Updated weights for policy 1, policy_version 453100 (0.0009) [2023-12-26 03:13:38,290][123091] Updated weights for policy 0, policy_version 455971 (0.0006) [2023-12-26 03:13:38,296][123090] Updated weights for policy 1, policy_version 453110 (0.0010) [2023-12-26 03:13:38,355][123091] Updated weights for policy 0, policy_version 455981 (0.0007) [2023-12-26 03:13:38,360][123090] Updated weights for policy 1, policy_version 453120 (0.0010) [2023-12-26 03:13:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 232734720. Throughput: 0: 8729.2, 1: 8578.2. Samples: 232709352. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:38,785][121949] Avg episode reward: [(0, '6007.283'), (1, '5435.817')] [2023-12-26 03:13:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000455984_116736000.pth... [2023-12-26 03:13:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000453120_115998720.pth... [2023-12-26 03:13:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000452128_115744768.pth [2023-12-26 03:13:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000454960_116473856.pth [2023-12-26 03:13:39,084][123091] Updated weights for policy 0, policy_version 455991 (0.0006) [2023-12-26 03:13:39,094][123090] Updated weights for policy 1, policy_version 453130 (0.0009) [2023-12-26 03:13:39,154][123091] Updated weights for policy 0, policy_version 456001 (0.0006) [2023-12-26 03:13:39,164][123090] Updated weights for policy 1, policy_version 453140 (0.0009) [2023-12-26 03:13:39,211][123091] Updated weights for policy 0, policy_version 456011 (0.0007) [2023-12-26 03:13:39,229][123090] Updated weights for policy 1, policy_version 453150 (0.0009) [2023-12-26 03:13:40,014][123091] Updated weights for policy 0, policy_version 456021 (0.0008) [2023-12-26 03:13:40,078][123091] Updated weights for policy 0, policy_version 456031 (0.0009) [2023-12-26 03:13:40,082][123090] Updated weights for policy 1, policy_version 453160 (0.0007) [2023-12-26 03:13:40,139][123091] Updated weights for policy 0, policy_version 456041 (0.0008) [2023-12-26 03:13:40,146][123090] Updated weights for policy 1, policy_version 453170 (0.0009) [2023-12-26 03:13:40,211][123090] Updated weights for policy 1, policy_version 453180 (0.0011) [2023-12-26 03:13:40,862][123091] Updated weights for policy 0, policy_version 456051 (0.0009) [2023-12-26 03:13:40,916][123090] Updated weights for policy 1, policy_version 453190 (0.0007) [2023-12-26 03:13:40,921][123091] Updated weights for policy 0, policy_version 456061 (0.0010) [2023-12-26 03:13:40,967][123090] Updated weights for policy 1, policy_version 453200 (0.0007) [2023-12-26 03:13:40,976][123091] Updated weights for policy 0, policy_version 456071 (0.0010) [2023-12-26 03:13:41,036][123090] Updated weights for policy 1, policy_version 453210 (0.0008) [2023-12-26 03:13:41,845][123091] Updated weights for policy 0, policy_version 456081 (0.0008) [2023-12-26 03:13:41,871][123090] Updated weights for policy 1, policy_version 453220 (0.0006) [2023-12-26 03:13:41,899][123091] Updated weights for policy 0, policy_version 456091 (0.0009) [2023-12-26 03:13:41,927][123090] Updated weights for policy 1, policy_version 453230 (0.0006) [2023-12-26 03:13:41,966][123091] Updated weights for policy 0, policy_version 456101 (0.0009) [2023-12-26 03:13:41,986][123090] Updated weights for policy 1, policy_version 453240 (0.0007) [2023-12-26 03:13:42,026][123091] Updated weights for policy 0, policy_version 456111 (0.0008) [2023-12-26 03:13:42,724][123090] Updated weights for policy 1, policy_version 453250 (0.0008) [2023-12-26 03:13:42,793][123090] Updated weights for policy 1, policy_version 453260 (0.0008) [2023-12-26 03:13:42,856][123090] Updated weights for policy 1, policy_version 453270 (0.0009) [2023-12-26 03:13:42,923][123090] Updated weights for policy 1, policy_version 453280 (0.0009) [2023-12-26 03:13:42,943][123091] Updated weights for policy 0, policy_version 456121 (0.0006) [2023-12-26 03:13:43,009][123091] Updated weights for policy 0, policy_version 456131 (0.0006) [2023-12-26 03:13:43,066][123091] Updated weights for policy 0, policy_version 456141 (0.0009) [2023-12-26 03:13:43,622][123090] Updated weights for policy 1, policy_version 453290 (0.0005) [2023-12-26 03:13:43,683][123090] Updated weights for policy 1, policy_version 453300 (0.0006) [2023-12-26 03:13:43,727][123091] Updated weights for policy 0, policy_version 456151 (0.0006) [2023-12-26 03:13:43,737][123090] Updated weights for policy 1, policy_version 453310 (0.0009) [2023-12-26 03:13:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 232824832. Throughput: 0: 8658.7, 1: 8639.3. Samples: 232816696. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:43,785][121949] Avg episode reward: [(0, '5842.402'), (1, '5430.214')] [2023-12-26 03:13:43,794][123091] Updated weights for policy 0, policy_version 456161 (0.0005) [2023-12-26 03:13:43,865][123091] Updated weights for policy 0, policy_version 456171 (0.0005) [2023-12-26 03:13:44,544][123090] Updated weights for policy 1, policy_version 453320 (0.0007) [2023-12-26 03:13:44,593][123091] Updated weights for policy 0, policy_version 456181 (0.0007) [2023-12-26 03:13:44,605][123090] Updated weights for policy 1, policy_version 453330 (0.0006) [2023-12-26 03:13:44,659][123091] Updated weights for policy 0, policy_version 456191 (0.0006) [2023-12-26 03:13:44,668][123090] Updated weights for policy 1, policy_version 453340 (0.0006) [2023-12-26 03:13:44,717][123091] Updated weights for policy 0, policy_version 456201 (0.0006) [2023-12-26 03:13:45,405][123090] Updated weights for policy 1, policy_version 453350 (0.0006) [2023-12-26 03:13:45,475][123090] Updated weights for policy 1, policy_version 453360 (0.0005) [2023-12-26 03:13:45,493][123091] Updated weights for policy 0, policy_version 456211 (0.0008) [2023-12-26 03:13:45,544][123090] Updated weights for policy 1, policy_version 453370 (0.0010) [2023-12-26 03:13:45,551][123091] Updated weights for policy 0, policy_version 456221 (0.0009) [2023-12-26 03:13:45,610][123091] Updated weights for policy 0, policy_version 456231 (0.0008) [2023-12-26 03:13:46,250][123090] Updated weights for policy 1, policy_version 453380 (0.0008) [2023-12-26 03:13:46,294][123090] Updated weights for policy 1, policy_version 453390 (0.0005) [2023-12-26 03:13:46,341][123090] Updated weights for policy 1, policy_version 453400 (0.0005) [2023-12-26 03:13:46,493][123091] Updated weights for policy 0, policy_version 456241 (0.0009) [2023-12-26 03:13:46,546][123091] Updated weights for policy 0, policy_version 456251 (0.0010) [2023-12-26 03:13:46,601][123091] Updated weights for policy 0, policy_version 456263 (0.0011) [2023-12-26 03:13:46,925][123090] Updated weights for policy 1, policy_version 453410 (0.0006) [2023-12-26 03:13:46,972][123090] Updated weights for policy 1, policy_version 453420 (0.0008) [2023-12-26 03:13:47,018][123090] Updated weights for policy 1, policy_version 453430 (0.0005) [2023-12-26 03:13:47,065][123090] Updated weights for policy 1, policy_version 453440 (0.0005) [2023-12-26 03:13:47,447][123091] Updated weights for policy 0, policy_version 456273 (0.0009) [2023-12-26 03:13:47,502][123091] Updated weights for policy 0, policy_version 456283 (0.0005) [2023-12-26 03:13:47,561][123091] Updated weights for policy 0, policy_version 456293 (0.0005) [2023-12-26 03:13:47,637][123091] Updated weights for policy 0, policy_version 456303 (0.0005) [2023-12-26 03:13:47,794][123090] Updated weights for policy 1, policy_version 453450 (0.0007) [2023-12-26 03:13:47,865][123090] Updated weights for policy 1, policy_version 453460 (0.0006) [2023-12-26 03:13:47,932][123090] Updated weights for policy 1, policy_version 453470 (0.0008) [2023-12-26 03:13:48,275][123091] Updated weights for policy 0, policy_version 456313 (0.0009) [2023-12-26 03:13:48,338][123091] Updated weights for policy 0, policy_version 456323 (0.0009) [2023-12-26 03:13:48,400][123091] Updated weights for policy 0, policy_version 456333 (0.0007) [2023-12-26 03:13:48,605][123090] Updated weights for policy 1, policy_version 453480 (0.0006) [2023-12-26 03:13:48,659][123090] Updated weights for policy 1, policy_version 453490 (0.0005) [2023-12-26 03:13:48,708][123090] Updated weights for policy 1, policy_version 453500 (0.0005) [2023-12-26 03:13:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 232923136. Throughput: 0: 8771.1, 1: 8807.0. Samples: 232930192. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:48,785][121949] Avg episode reward: [(0, '5971.643'), (1, '5383.785')] [2023-12-26 03:13:49,279][123091] Updated weights for policy 0, policy_version 456343 (0.0009) [2023-12-26 03:13:49,341][123091] Updated weights for policy 0, policy_version 456353 (0.0013) [2023-12-26 03:13:49,395][123091] Updated weights for policy 0, policy_version 456363 (0.0009) [2023-12-26 03:13:49,464][123090] Updated weights for policy 1, policy_version 453510 (0.0007) [2023-12-26 03:13:49,532][123090] Updated weights for policy 1, policy_version 453520 (0.0009) [2023-12-26 03:13:49,590][123090] Updated weights for policy 1, policy_version 453530 (0.0006) [2023-12-26 03:13:50,179][123091] Updated weights for policy 0, policy_version 456373 (0.0010) [2023-12-26 03:13:50,243][123091] Updated weights for policy 0, policy_version 456383 (0.0010) [2023-12-26 03:13:50,307][123091] Updated weights for policy 0, policy_version 456393 (0.0011) [2023-12-26 03:13:50,369][123090] Updated weights for policy 1, policy_version 453540 (0.0007) [2023-12-26 03:13:50,433][123090] Updated weights for policy 1, policy_version 453550 (0.0011) [2023-12-26 03:13:50,502][123090] Updated weights for policy 1, policy_version 453560 (0.0011) [2023-12-26 03:13:51,055][123091] Updated weights for policy 0, policy_version 456403 (0.0010) [2023-12-26 03:13:51,117][123091] Updated weights for policy 0, policy_version 456413 (0.0009) [2023-12-26 03:13:51,177][123091] Updated weights for policy 0, policy_version 456423 (0.0010) [2023-12-26 03:13:51,342][123090] Updated weights for policy 1, policy_version 453570 (0.0010) [2023-12-26 03:13:51,412][123090] Updated weights for policy 1, policy_version 453580 (0.0008) [2023-12-26 03:13:51,487][123090] Updated weights for policy 1, policy_version 453590 (0.0006) [2023-12-26 03:13:51,564][123090] Updated weights for policy 1, policy_version 453600 (0.0009) [2023-12-26 03:13:51,982][123091] Updated weights for policy 0, policy_version 456433 (0.0010) [2023-12-26 03:13:52,049][123091] Updated weights for policy 0, policy_version 456443 (0.0010) [2023-12-26 03:13:52,115][123091] Updated weights for policy 0, policy_version 456453 (0.0009) [2023-12-26 03:13:52,184][123091] Updated weights for policy 0, policy_version 456463 (0.0008) [2023-12-26 03:13:52,377][123090] Updated weights for policy 1, policy_version 453610 (0.0008) [2023-12-26 03:13:52,448][123090] Updated weights for policy 1, policy_version 453620 (0.0006) [2023-12-26 03:13:52,505][123090] Updated weights for policy 1, policy_version 453630 (0.0008) [2023-12-26 03:13:52,928][123091] Updated weights for policy 0, policy_version 456473 (0.0005) [2023-12-26 03:13:52,985][123091] Updated weights for policy 0, policy_version 456483 (0.0006) [2023-12-26 03:13:53,046][123091] Updated weights for policy 0, policy_version 456493 (0.0005) [2023-12-26 03:13:53,149][123090] Updated weights for policy 1, policy_version 453641 (0.0010) [2023-12-26 03:13:53,201][123090] Updated weights for policy 1, policy_version 453651 (0.0010) [2023-12-26 03:13:53,253][123090] Updated weights for policy 1, policy_version 453661 (0.0009) [2023-12-26 03:13:53,674][123091] Updated weights for policy 0, policy_version 456503 (0.0008) [2023-12-26 03:13:53,729][123091] Updated weights for policy 0, policy_version 456513 (0.0009) [2023-12-26 03:13:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 233005056. Throughput: 0: 8754.9, 1: 8819.8. Samples: 232983116. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:53,785][121949] Avg episode reward: [(0, '5951.061'), (1, '5456.467')] [2023-12-26 03:13:53,786][123091] Updated weights for policy 0, policy_version 456523 (0.0009) [2023-12-26 03:13:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000453664_116137984.pth... [2023-12-26 03:13:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000452640_115875840.pth [2023-12-26 03:13:53,800][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000453664_116137984.pth [2023-12-26 03:13:53,817][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000456528_116875264.pth... [2023-12-26 03:13:53,822][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000455440_116596736.pth [2023-12-26 03:13:53,822][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000456528_116875264.pth [2023-12-26 03:13:54,098][123090] Updated weights for policy 1, policy_version 453672 (0.0011) [2023-12-26 03:13:54,156][123090] Updated weights for policy 1, policy_version 453682 (0.0009) [2023-12-26 03:13:54,218][123090] Updated weights for policy 1, policy_version 453692 (0.0009) [2023-12-26 03:13:54,657][123091] Updated weights for policy 0, policy_version 456533 (0.0010) [2023-12-26 03:13:54,708][123091] Updated weights for policy 0, policy_version 456543 (0.0010) [2023-12-26 03:13:54,755][123091] Updated weights for policy 0, policy_version 456553 (0.0010) [2023-12-26 03:13:55,079][123090] Updated weights for policy 1, policy_version 453702 (0.0010) [2023-12-26 03:13:55,134][123090] Updated weights for policy 1, policy_version 453712 (0.0010) [2023-12-26 03:13:55,187][123090] Updated weights for policy 1, policy_version 453722 (0.0009) [2023-12-26 03:13:55,509][123091] Updated weights for policy 0, policy_version 456563 (0.0009) [2023-12-26 03:13:55,572][123091] Updated weights for policy 0, policy_version 456573 (0.0006) [2023-12-26 03:13:55,627][123091] Updated weights for policy 0, policy_version 456583 (0.0006) [2023-12-26 03:13:56,099][123090] Updated weights for policy 1, policy_version 453732 (0.0010) [2023-12-26 03:13:56,161][123090] Updated weights for policy 1, policy_version 453742 (0.0009) [2023-12-26 03:13:56,218][123090] Updated weights for policy 1, policy_version 453752 (0.0010) [2023-12-26 03:13:56,336][123091] Updated weights for policy 0, policy_version 456593 (0.0010) [2023-12-26 03:13:56,382][123091] Updated weights for policy 0, policy_version 456603 (0.0008) [2023-12-26 03:13:56,435][123091] Updated weights for policy 0, policy_version 456613 (0.0009) [2023-12-26 03:13:56,483][123091] Updated weights for policy 0, policy_version 456623 (0.0008) [2023-12-26 03:13:57,136][123091] Updated weights for policy 0, policy_version 456633 (0.0006) [2023-12-26 03:13:57,145][123090] Updated weights for policy 1, policy_version 453762 (0.0009) [2023-12-26 03:13:57,195][123091] Updated weights for policy 0, policy_version 456643 (0.0005) [2023-12-26 03:13:57,206][123090] Updated weights for policy 1, policy_version 453772 (0.0009) [2023-12-26 03:13:57,252][123091] Updated weights for policy 0, policy_version 456653 (0.0006) [2023-12-26 03:13:57,266][123090] Updated weights for policy 1, policy_version 453782 (0.0009) [2023-12-26 03:13:57,319][123090] Updated weights for policy 1, policy_version 453792 (0.0010) [2023-12-26 03:13:58,002][123091] Updated weights for policy 0, policy_version 456663 (0.0008) [2023-12-26 03:13:58,067][123091] Updated weights for policy 0, policy_version 456673 (0.0010) [2023-12-26 03:13:58,127][123091] Updated weights for policy 0, policy_version 456683 (0.0011) [2023-12-26 03:13:58,212][123090] Updated weights for policy 1, policy_version 453802 (0.0009) [2023-12-26 03:13:58,278][123090] Updated weights for policy 1, policy_version 453812 (0.0009) [2023-12-26 03:13:58,347][123090] Updated weights for policy 1, policy_version 453822 (0.0008) [2023-12-26 03:13:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 233095168. Throughput: 0: 8951.8, 1: 8737.0. Samples: 233090760. Policy #0 lag: (min: 37.0, avg: 40.0, max: 40.0) [2023-12-26 03:13:58,785][121949] Avg episode reward: [(0, '6067.986'), (1, '5511.586')] [2023-12-26 03:13:59,092][123091] Updated weights for policy 0, policy_version 456693 (0.0011) [2023-12-26 03:13:59,155][123091] Updated weights for policy 0, policy_version 456703 (0.0011) [2023-12-26 03:13:59,210][123091] Updated weights for policy 0, policy_version 456713 (0.0011) [2023-12-26 03:13:59,211][123090] Updated weights for policy 1, policy_version 453832 (0.0007) [2023-12-26 03:13:59,275][123090] Updated weights for policy 1, policy_version 453842 (0.0009) [2023-12-26 03:13:59,331][123090] Updated weights for policy 1, policy_version 453852 (0.0006) [2023-12-26 03:14:00,079][123091] Updated weights for policy 0, policy_version 456723 (0.0011) [2023-12-26 03:14:00,102][123090] Updated weights for policy 1, policy_version 453862 (0.0008) [2023-12-26 03:14:00,139][123091] Updated weights for policy 0, policy_version 456733 (0.0011) [2023-12-26 03:14:00,162][123090] Updated weights for policy 1, policy_version 453872 (0.0010) [2023-12-26 03:14:00,202][123091] Updated weights for policy 0, policy_version 456743 (0.0011) [2023-12-26 03:14:00,225][123090] Updated weights for policy 1, policy_version 453882 (0.0011) [2023-12-26 03:14:01,004][123091] Updated weights for policy 0, policy_version 456753 (0.0010) [2023-12-26 03:14:01,045][123090] Updated weights for policy 1, policy_version 453892 (0.0009) [2023-12-26 03:14:01,081][123091] Updated weights for policy 0, policy_version 456763 (0.0007) [2023-12-26 03:14:01,099][123090] Updated weights for policy 1, policy_version 453902 (0.0007) [2023-12-26 03:14:01,150][123091] Updated weights for policy 0, policy_version 456773 (0.0009) [2023-12-26 03:14:01,168][123090] Updated weights for policy 1, policy_version 453912 (0.0007) [2023-12-26 03:14:01,213][123091] Updated weights for policy 0, policy_version 456783 (0.0011) [2023-12-26 03:14:01,955][123091] Updated weights for policy 0, policy_version 456793 (0.0007) [2023-12-26 03:14:01,973][123090] Updated weights for policy 1, policy_version 453922 (0.0006) [2023-12-26 03:14:02,029][123091] Updated weights for policy 0, policy_version 456803 (0.0006) [2023-12-26 03:14:02,032][123090] Updated weights for policy 1, policy_version 453932 (0.0007) [2023-12-26 03:14:02,093][123090] Updated weights for policy 1, policy_version 453942 (0.0009) [2023-12-26 03:14:02,096][123091] Updated weights for policy 0, policy_version 456813 (0.0007) [2023-12-26 03:14:02,154][123090] Updated weights for policy 1, policy_version 453952 (0.0009) [2023-12-26 03:14:02,876][123091] Updated weights for policy 0, policy_version 456823 (0.0008) [2023-12-26 03:14:02,924][123091] Updated weights for policy 0, policy_version 456834 (0.0009) [2023-12-26 03:14:02,972][123091] Updated weights for policy 0, policy_version 456844 (0.0007) [2023-12-26 03:14:02,981][123090] Updated weights for policy 1, policy_version 453962 (0.0010) [2023-12-26 03:14:03,049][123090] Updated weights for policy 1, policy_version 453972 (0.0010) [2023-12-26 03:14:03,106][123090] Updated weights for policy 1, policy_version 453982 (0.0009) [2023-12-26 03:14:03,698][123091] Updated weights for policy 0, policy_version 456854 (0.0006) [2023-12-26 03:14:03,743][123091] Updated weights for policy 0, policy_version 456864 (0.0005) [2023-12-26 03:14:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 233177088. Throughput: 0: 8954.2, 1: 8689.1. Samples: 233194128. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:03,785][121949] Avg episode reward: [(0, '6213.809'), (1, '5686.726')] [2023-12-26 03:14:03,791][123091] Updated weights for policy 0, policy_version 456874 (0.0005) [2023-12-26 03:14:04,004][123090] Updated weights for policy 1, policy_version 453992 (0.0009) [2023-12-26 03:14:04,077][123090] Updated weights for policy 1, policy_version 454002 (0.0009) [2023-12-26 03:14:04,144][123090] Updated weights for policy 1, policy_version 454012 (0.0009) [2023-12-26 03:14:04,572][123091] Updated weights for policy 0, policy_version 456884 (0.0007) [2023-12-26 03:14:04,627][123091] Updated weights for policy 0, policy_version 456894 (0.0010) [2023-12-26 03:14:04,684][123091] Updated weights for policy 0, policy_version 456904 (0.0006) [2023-12-26 03:14:04,938][123090] Updated weights for policy 1, policy_version 454022 (0.0010) [2023-12-26 03:14:05,004][123090] Updated weights for policy 1, policy_version 454032 (0.0010) [2023-12-26 03:14:05,067][123090] Updated weights for policy 1, policy_version 454042 (0.0010) [2023-12-26 03:14:05,455][123091] Updated weights for policy 0, policy_version 456914 (0.0009) [2023-12-26 03:14:05,521][123091] Updated weights for policy 0, policy_version 456924 (0.0009) [2023-12-26 03:14:05,584][123091] Updated weights for policy 0, policy_version 456934 (0.0007) [2023-12-26 03:14:05,638][123091] Updated weights for policy 0, policy_version 456944 (0.0005) [2023-12-26 03:14:05,746][123090] Updated weights for policy 1, policy_version 454052 (0.0005) [2023-12-26 03:14:05,794][123090] Updated weights for policy 1, policy_version 454062 (0.0005) [2023-12-26 03:14:05,843][123090] Updated weights for policy 1, policy_version 454072 (0.0006) [2023-12-26 03:14:06,314][123091] Updated weights for policy 0, policy_version 456954 (0.0008) [2023-12-26 03:14:06,382][123091] Updated weights for policy 0, policy_version 456964 (0.0008) [2023-12-26 03:14:06,440][123091] Updated weights for policy 0, policy_version 456974 (0.0009) [2023-12-26 03:14:06,653][123090] Updated weights for policy 1, policy_version 454082 (0.0007) [2023-12-26 03:14:06,710][123090] Updated weights for policy 1, policy_version 454092 (0.0009) [2023-12-26 03:14:06,771][123090] Updated weights for policy 1, policy_version 454102 (0.0010) [2023-12-26 03:14:06,836][123090] Updated weights for policy 1, policy_version 454112 (0.0009) [2023-12-26 03:14:07,207][123091] Updated weights for policy 0, policy_version 456984 (0.0010) [2023-12-26 03:14:07,262][123091] Updated weights for policy 0, policy_version 456994 (0.0009) [2023-12-26 03:14:07,317][123091] Updated weights for policy 0, policy_version 457004 (0.0010) [2023-12-26 03:14:07,659][123090] Updated weights for policy 1, policy_version 454122 (0.0009) [2023-12-26 03:14:07,707][123090] Updated weights for policy 1, policy_version 454132 (0.0009) [2023-12-26 03:14:07,771][123090] Updated weights for policy 1, policy_version 454142 (0.0009) [2023-12-26 03:14:08,071][123091] Updated weights for policy 0, policy_version 457014 (0.0007) [2023-12-26 03:14:08,124][123091] Updated weights for policy 0, policy_version 457024 (0.0005) [2023-12-26 03:14:08,186][123091] Updated weights for policy 0, policy_version 457034 (0.0005) [2023-12-26 03:14:08,648][123090] Updated weights for policy 1, policy_version 454152 (0.0010) [2023-12-26 03:14:08,702][123090] Updated weights for policy 1, policy_version 454162 (0.0010) [2023-12-26 03:14:08,759][123090] Updated weights for policy 1, policy_version 454172 (0.0008) [2023-12-26 03:14:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 233275392. Throughput: 0: 9015.9, 1: 8755.8. Samples: 233248820. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:08,785][121949] Avg episode reward: [(0, '6001.700'), (1, '5806.974')] [2023-12-26 03:14:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000457040_117006336.pth... [2023-12-26 03:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000454176_116269056.pth... [2023-12-26 03:14:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000455984_116736000.pth [2023-12-26 03:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000453120_115998720.pth [2023-12-26 03:14:09,016][123091] Updated weights for policy 0, policy_version 457044 (0.0008) [2023-12-26 03:14:09,080][123091] Updated weights for policy 0, policy_version 457054 (0.0009) [2023-12-26 03:14:09,150][123091] Updated weights for policy 0, policy_version 457064 (0.0009) [2023-12-26 03:14:09,580][123090] Updated weights for policy 1, policy_version 454182 (0.0010) [2023-12-26 03:14:09,646][123090] Updated weights for policy 1, policy_version 454192 (0.0009) [2023-12-26 03:14:09,710][123090] Updated weights for policy 1, policy_version 454202 (0.0010) [2023-12-26 03:14:10,009][123091] Updated weights for policy 0, policy_version 457074 (0.0009) [2023-12-26 03:14:10,063][123091] Updated weights for policy 0, policy_version 457084 (0.0009) [2023-12-26 03:14:10,132][123091] Updated weights for policy 0, policy_version 457094 (0.0010) [2023-12-26 03:14:10,191][123091] Updated weights for policy 0, policy_version 457104 (0.0010) [2023-12-26 03:14:10,559][123090] Updated weights for policy 1, policy_version 454212 (0.0010) [2023-12-26 03:14:10,626][123090] Updated weights for policy 1, policy_version 454222 (0.0008) [2023-12-26 03:14:10,691][123090] Updated weights for policy 1, policy_version 454232 (0.0009) [2023-12-26 03:14:11,035][123091] Updated weights for policy 0, policy_version 457114 (0.0010) [2023-12-26 03:14:11,105][123091] Updated weights for policy 0, policy_version 457124 (0.0006) [2023-12-26 03:14:11,180][123091] Updated weights for policy 0, policy_version 457134 (0.0009) [2023-12-26 03:14:11,540][123090] Updated weights for policy 1, policy_version 454242 (0.0009) [2023-12-26 03:14:11,606][123090] Updated weights for policy 1, policy_version 454252 (0.0009) [2023-12-26 03:14:11,674][123090] Updated weights for policy 1, policy_version 454262 (0.0010) [2023-12-26 03:14:11,740][123090] Updated weights for policy 1, policy_version 454272 (0.0010) [2023-12-26 03:14:12,003][123091] Updated weights for policy 0, policy_version 457144 (0.0010) [2023-12-26 03:14:12,064][123091] Updated weights for policy 0, policy_version 457154 (0.0010) [2023-12-26 03:14:12,122][123091] Updated weights for policy 0, policy_version 457164 (0.0010) [2023-12-26 03:14:12,570][123090] Updated weights for policy 1, policy_version 454282 (0.0009) [2023-12-26 03:14:12,638][123090] Updated weights for policy 1, policy_version 454292 (0.0008) [2023-12-26 03:14:12,691][123090] Updated weights for policy 1, policy_version 454302 (0.0009) [2023-12-26 03:14:12,967][123091] Updated weights for policy 0, policy_version 457174 (0.0010) [2023-12-26 03:14:13,025][123091] Updated weights for policy 0, policy_version 457184 (0.0010) [2023-12-26 03:14:13,069][123091] Updated weights for policy 0, policy_version 457194 (0.0007) [2023-12-26 03:14:13,538][123090] Updated weights for policy 1, policy_version 454312 (0.0006) [2023-12-26 03:14:13,599][123090] Updated weights for policy 1, policy_version 454322 (0.0005) [2023-12-26 03:14:13,669][123090] Updated weights for policy 1, policy_version 454332 (0.0005) [2023-12-26 03:14:13,753][123091] Updated weights for policy 0, policy_version 457204 (0.0006) [2023-12-26 03:14:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 233357312. Throughput: 0: 8943.8, 1: 8769.9. Samples: 233350288. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:13,784][121949] Avg episode reward: [(0, '6038.864'), (1, '5787.709')] [2023-12-26 03:14:13,800][123091] Updated weights for policy 0, policy_version 457214 (0.0005) [2023-12-26 03:14:13,852][123091] Updated weights for policy 0, policy_version 457224 (0.0005) [2023-12-26 03:14:14,344][123090] Updated weights for policy 1, policy_version 454342 (0.0005) [2023-12-26 03:14:14,402][123090] Updated weights for policy 1, policy_version 454352 (0.0005) [2023-12-26 03:14:14,464][123090] Updated weights for policy 1, policy_version 454362 (0.0005) [2023-12-26 03:14:14,523][123091] Updated weights for policy 0, policy_version 457234 (0.0005) [2023-12-26 03:14:14,577][123091] Updated weights for policy 0, policy_version 457244 (0.0005) [2023-12-26 03:14:14,627][123091] Updated weights for policy 0, policy_version 457254 (0.0005) [2023-12-26 03:14:14,686][123091] Updated weights for policy 0, policy_version 457264 (0.0005) [2023-12-26 03:14:15,342][123090] Updated weights for policy 1, policy_version 454372 (0.0006) [2023-12-26 03:14:15,390][123091] Updated weights for policy 0, policy_version 457274 (0.0009) [2023-12-26 03:14:15,412][123090] Updated weights for policy 1, policy_version 454382 (0.0008) [2023-12-26 03:14:15,461][123091] Updated weights for policy 0, policy_version 457284 (0.0006) [2023-12-26 03:14:15,474][123090] Updated weights for policy 1, policy_version 454392 (0.0009) [2023-12-26 03:14:15,536][123091] Updated weights for policy 0, policy_version 457294 (0.0006) [2023-12-26 03:14:16,170][123091] Updated weights for policy 0, policy_version 457304 (0.0010) [2023-12-26 03:14:16,225][123091] Updated weights for policy 0, policy_version 457314 (0.0010) [2023-12-26 03:14:16,272][123091] Updated weights for policy 0, policy_version 457324 (0.0010) [2023-12-26 03:14:16,358][123090] Updated weights for policy 1, policy_version 454402 (0.0009) [2023-12-26 03:14:16,420][123090] Updated weights for policy 1, policy_version 454412 (0.0005) [2023-12-26 03:14:16,468][123090] Updated weights for policy 1, policy_version 454422 (0.0005) [2023-12-26 03:14:16,516][123090] Updated weights for policy 1, policy_version 454432 (0.0005) [2023-12-26 03:14:16,976][123091] Updated weights for policy 0, policy_version 457334 (0.0007) [2023-12-26 03:14:17,022][123091] Updated weights for policy 0, policy_version 457344 (0.0005) [2023-12-26 03:14:17,077][123091] Updated weights for policy 0, policy_version 457354 (0.0005) [2023-12-26 03:14:17,339][123090] Updated weights for policy 1, policy_version 454442 (0.0008) [2023-12-26 03:14:17,405][123090] Updated weights for policy 1, policy_version 454452 (0.0005) [2023-12-26 03:14:17,463][123090] Updated weights for policy 1, policy_version 454462 (0.0010) [2023-12-26 03:14:17,752][123091] Updated weights for policy 0, policy_version 457364 (0.0008) [2023-12-26 03:14:17,807][123091] Updated weights for policy 0, policy_version 457374 (0.0005) [2023-12-26 03:14:17,855][123091] Updated weights for policy 0, policy_version 457384 (0.0005) [2023-12-26 03:14:18,201][123090] Updated weights for policy 1, policy_version 454472 (0.0006) [2023-12-26 03:14:18,253][123090] Updated weights for policy 1, policy_version 454482 (0.0005) [2023-12-26 03:14:18,302][123090] Updated weights for policy 1, policy_version 454492 (0.0006) [2023-12-26 03:14:18,552][123091] Updated weights for policy 0, policy_version 457394 (0.0006) [2023-12-26 03:14:18,615][123091] Updated weights for policy 0, policy_version 457404 (0.0009) [2023-12-26 03:14:18,679][123091] Updated weights for policy 0, policy_version 457414 (0.0010) [2023-12-26 03:14:18,743][123091] Updated weights for policy 0, policy_version 457424 (0.0010) [2023-12-26 03:14:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 233455616. Throughput: 0: 9086.5, 1: 8822.2. Samples: 233463184. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:18,785][121949] Avg episode reward: [(0, '6000.333'), (1, '5728.378')] [2023-12-26 03:14:19,088][123090] Updated weights for policy 1, policy_version 454502 (0.0008) [2023-12-26 03:14:19,140][123090] Updated weights for policy 1, policy_version 454512 (0.0008) [2023-12-26 03:14:19,202][123090] Updated weights for policy 1, policy_version 454522 (0.0009) [2023-12-26 03:14:19,589][123091] Updated weights for policy 0, policy_version 457434 (0.0010) [2023-12-26 03:14:19,641][123091] Updated weights for policy 0, policy_version 457444 (0.0010) [2023-12-26 03:14:19,691][123091] Updated weights for policy 0, policy_version 457454 (0.0009) [2023-12-26 03:14:20,045][123090] Updated weights for policy 1, policy_version 454532 (0.0009) [2023-12-26 03:14:20,112][123090] Updated weights for policy 1, policy_version 454542 (0.0010) [2023-12-26 03:14:20,174][123090] Updated weights for policy 1, policy_version 454552 (0.0009) [2023-12-26 03:14:20,560][123091] Updated weights for policy 0, policy_version 457464 (0.0009) [2023-12-26 03:14:20,624][123091] Updated weights for policy 0, policy_version 457474 (0.0010) [2023-12-26 03:14:20,683][123091] Updated weights for policy 0, policy_version 457484 (0.0010) [2023-12-26 03:14:21,021][123090] Updated weights for policy 1, policy_version 454562 (0.0010) [2023-12-26 03:14:21,103][123090] Updated weights for policy 1, policy_version 454572 (0.0010) [2023-12-26 03:14:21,173][123090] Updated weights for policy 1, policy_version 454582 (0.0009) [2023-12-26 03:14:21,233][123090] Updated weights for policy 1, policy_version 454592 (0.0005) [2023-12-26 03:14:21,552][123091] Updated weights for policy 0, policy_version 457494 (0.0010) [2023-12-26 03:14:21,622][123091] Updated weights for policy 0, policy_version 457504 (0.0010) [2023-12-26 03:14:21,696][123091] Updated weights for policy 0, policy_version 457514 (0.0009) [2023-12-26 03:14:22,115][123090] Updated weights for policy 1, policy_version 454602 (0.0010) [2023-12-26 03:14:22,174][123090] Updated weights for policy 1, policy_version 454612 (0.0010) [2023-12-26 03:14:22,228][123090] Updated weights for policy 1, policy_version 454622 (0.0010) [2023-12-26 03:14:22,474][123091] Updated weights for policy 0, policy_version 457524 (0.0010) [2023-12-26 03:14:22,535][123091] Updated weights for policy 0, policy_version 457534 (0.0009) [2023-12-26 03:14:22,602][123091] Updated weights for policy 0, policy_version 457544 (0.0010) [2023-12-26 03:14:23,118][123090] Updated weights for policy 1, policy_version 454633 (0.0009) [2023-12-26 03:14:23,171][123090] Updated weights for policy 1, policy_version 454643 (0.0009) [2023-12-26 03:14:23,234][123090] Updated weights for policy 1, policy_version 454653 (0.0010) [2023-12-26 03:14:23,440][123091] Updated weights for policy 0, policy_version 457554 (0.0010) [2023-12-26 03:14:23,495][123091] Updated weights for policy 0, policy_version 457564 (0.0009) [2023-12-26 03:14:23,545][123091] Updated weights for policy 0, policy_version 457574 (0.0009) [2023-12-26 03:14:23,603][123091] Updated weights for policy 0, policy_version 457584 (0.0010) [2023-12-26 03:14:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 233537536. Throughput: 0: 9040.3, 1: 8816.9. Samples: 233512924. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:23,785][121949] Avg episode reward: [(0, '5824.157'), (1, '5786.451')] [2023-12-26 03:14:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000457584_117145600.pth... [2023-12-26 03:14:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000454656_116391936.pth... [2023-12-26 03:14:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000456528_116875264.pth [2023-12-26 03:14:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000453664_116137984.pth [2023-12-26 03:14:24,035][123090] Updated weights for policy 1, policy_version 454663 (0.0006) [2023-12-26 03:14:24,085][123090] Updated weights for policy 1, policy_version 454673 (0.0005) [2023-12-26 03:14:24,142][123090] Updated weights for policy 1, policy_version 454683 (0.0006) [2023-12-26 03:14:24,470][123091] Updated weights for policy 0, policy_version 457594 (0.0009) [2023-12-26 03:14:24,520][123091] Updated weights for policy 0, policy_version 457604 (0.0005) [2023-12-26 03:14:24,579][123091] Updated weights for policy 0, policy_version 457614 (0.0005) [2023-12-26 03:14:24,916][123090] Updated weights for policy 1, policy_version 454693 (0.0008) [2023-12-26 03:14:24,964][123090] Updated weights for policy 1, policy_version 454703 (0.0010) [2023-12-26 03:14:25,019][123090] Updated weights for policy 1, policy_version 454713 (0.0010) [2023-12-26 03:14:25,365][123091] Updated weights for policy 0, policy_version 457624 (0.0010) [2023-12-26 03:14:25,420][123091] Updated weights for policy 0, policy_version 457634 (0.0010) [2023-12-26 03:14:25,478][123091] Updated weights for policy 0, policy_version 457644 (0.0010) [2023-12-26 03:14:25,828][123090] Updated weights for policy 1, policy_version 454723 (0.0010) [2023-12-26 03:14:25,890][123090] Updated weights for policy 1, policy_version 454733 (0.0010) [2023-12-26 03:14:25,942][123090] Updated weights for policy 1, policy_version 454743 (0.0005) [2023-12-26 03:14:26,186][123091] Updated weights for policy 0, policy_version 457654 (0.0007) [2023-12-26 03:14:26,239][123091] Updated weights for policy 0, policy_version 457664 (0.0005) [2023-12-26 03:14:26,296][123091] Updated weights for policy 0, policy_version 457674 (0.0006) [2023-12-26 03:14:26,730][123090] Updated weights for policy 1, policy_version 454753 (0.0006) [2023-12-26 03:14:26,789][123090] Updated weights for policy 1, policy_version 454763 (0.0010) [2023-12-26 03:14:26,848][123090] Updated weights for policy 1, policy_version 454773 (0.0005) [2023-12-26 03:14:26,904][123090] Updated weights for policy 1, policy_version 454783 (0.0010) [2023-12-26 03:14:27,091][123091] Updated weights for policy 0, policy_version 457684 (0.0007) [2023-12-26 03:14:27,147][123091] Updated weights for policy 0, policy_version 457694 (0.0009) [2023-12-26 03:14:27,204][123091] Updated weights for policy 0, policy_version 457704 (0.0010) [2023-12-26 03:14:27,739][123090] Updated weights for policy 1, policy_version 454793 (0.0010) [2023-12-26 03:14:27,793][123090] Updated weights for policy 1, policy_version 454803 (0.0010) [2023-12-26 03:14:27,851][123090] Updated weights for policy 1, policy_version 454813 (0.0010) [2023-12-26 03:14:28,038][123091] Updated weights for policy 0, policy_version 457714 (0.0009) [2023-12-26 03:14:28,089][123091] Updated weights for policy 0, policy_version 457724 (0.0009) [2023-12-26 03:14:28,144][123091] Updated weights for policy 0, policy_version 457734 (0.0009) [2023-12-26 03:14:28,202][123091] Updated weights for policy 0, policy_version 457744 (0.0009) [2023-12-26 03:14:28,688][123090] Updated weights for policy 1, policy_version 454823 (0.0010) [2023-12-26 03:14:28,752][123090] Updated weights for policy 1, policy_version 454833 (0.0011) [2023-12-26 03:14:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 233619456. Throughput: 0: 9073.9, 1: 8741.1. Samples: 233618368. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:28,784][121949] Avg episode reward: [(0, '6049.842'), (1, '5869.798')] [2023-12-26 03:14:28,811][123090] Updated weights for policy 1, policy_version 454843 (0.0010) [2023-12-26 03:14:29,024][123091] Updated weights for policy 0, policy_version 457754 (0.0009) [2023-12-26 03:14:29,073][123091] Updated weights for policy 0, policy_version 457764 (0.0008) [2023-12-26 03:14:29,141][123091] Updated weights for policy 0, policy_version 457774 (0.0009) [2023-12-26 03:14:29,652][123090] Updated weights for policy 1, policy_version 454853 (0.0010) [2023-12-26 03:14:29,710][123090] Updated weights for policy 1, policy_version 454863 (0.0010) [2023-12-26 03:14:29,770][123090] Updated weights for policy 1, policy_version 454873 (0.0011) [2023-12-26 03:14:29,907][123091] Updated weights for policy 0, policy_version 457784 (0.0008) [2023-12-26 03:14:29,970][123091] Updated weights for policy 0, policy_version 457794 (0.0010) [2023-12-26 03:14:30,025][123091] Updated weights for policy 0, policy_version 457804 (0.0009) [2023-12-26 03:14:30,595][123090] Updated weights for policy 1, policy_version 454883 (0.0010) [2023-12-26 03:14:30,653][123090] Updated weights for policy 1, policy_version 454893 (0.0010) [2023-12-26 03:14:30,705][123090] Updated weights for policy 1, policy_version 454903 (0.0009) [2023-12-26 03:14:30,858][123091] Updated weights for policy 0, policy_version 457814 (0.0009) [2023-12-26 03:14:30,907][123091] Updated weights for policy 0, policy_version 457824 (0.0009) [2023-12-26 03:14:30,955][123091] Updated weights for policy 0, policy_version 457834 (0.0009) [2023-12-26 03:14:31,492][123090] Updated weights for policy 1, policy_version 454913 (0.0008) [2023-12-26 03:14:31,540][123090] Updated weights for policy 1, policy_version 454923 (0.0009) [2023-12-26 03:14:31,596][123090] Updated weights for policy 1, policy_version 454934 (0.0010) [2023-12-26 03:14:31,664][123090] Updated weights for policy 1, policy_version 454944 (0.0008) [2023-12-26 03:14:31,833][123091] Updated weights for policy 0, policy_version 457844 (0.0009) [2023-12-26 03:14:31,890][123091] Updated weights for policy 0, policy_version 457854 (0.0006) [2023-12-26 03:14:31,948][123091] Updated weights for policy 0, policy_version 457864 (0.0008) [2023-12-26 03:14:32,549][123090] Updated weights for policy 1, policy_version 454954 (0.0010) [2023-12-26 03:14:32,601][123090] Updated weights for policy 1, policy_version 454964 (0.0010) [2023-12-26 03:14:32,649][123090] Updated weights for policy 1, policy_version 454974 (0.0010) [2023-12-26 03:14:32,656][123091] Updated weights for policy 0, policy_version 457874 (0.0009) [2023-12-26 03:14:32,721][123091] Updated weights for policy 0, policy_version 457884 (0.0005) [2023-12-26 03:14:32,789][123091] Updated weights for policy 0, policy_version 457894 (0.0006) [2023-12-26 03:14:32,842][123091] Updated weights for policy 0, policy_version 457904 (0.0006) [2023-12-26 03:14:33,418][123091] Updated weights for policy 0, policy_version 457914 (0.0005) [2023-12-26 03:14:33,472][123090] Updated weights for policy 1, policy_version 454984 (0.0009) [2023-12-26 03:14:33,479][123091] Updated weights for policy 0, policy_version 457924 (0.0005) [2023-12-26 03:14:33,532][123090] Updated weights for policy 1, policy_version 454994 (0.0008) [2023-12-26 03:14:33,542][123091] Updated weights for policy 0, policy_version 457934 (0.0005) [2023-12-26 03:14:33,584][123090] Updated weights for policy 1, policy_version 455004 (0.0008) [2023-12-26 03:14:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 233717760. Throughput: 0: 9085.1, 1: 8569.1. Samples: 233724628. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:33,785][121949] Avg episode reward: [(0, '6187.861'), (1, '5859.070')] [2023-12-26 03:14:34,146][123091] Updated weights for policy 0, policy_version 457944 (0.0008) [2023-12-26 03:14:34,216][123091] Updated weights for policy 0, policy_version 457954 (0.0011) [2023-12-26 03:14:34,284][123091] Updated weights for policy 0, policy_version 457964 (0.0011) [2023-12-26 03:14:34,433][123090] Updated weights for policy 1, policy_version 455014 (0.0010) [2023-12-26 03:14:34,501][123090] Updated weights for policy 1, policy_version 455024 (0.0011) [2023-12-26 03:14:34,573][123090] Updated weights for policy 1, policy_version 455034 (0.0010) [2023-12-26 03:14:35,077][123091] Updated weights for policy 0, policy_version 457974 (0.0010) [2023-12-26 03:14:35,125][123091] Updated weights for policy 0, policy_version 457984 (0.0010) [2023-12-26 03:14:35,180][123091] Updated weights for policy 0, policy_version 457994 (0.0010) [2023-12-26 03:14:35,383][123090] Updated weights for policy 1, policy_version 455044 (0.0011) [2023-12-26 03:14:35,446][123090] Updated weights for policy 1, policy_version 455054 (0.0010) [2023-12-26 03:14:35,512][123090] Updated weights for policy 1, policy_version 455064 (0.0010) [2023-12-26 03:14:36,023][123091] Updated weights for policy 0, policy_version 458004 (0.0010) [2023-12-26 03:14:36,066][123091] Updated weights for policy 0, policy_version 458014 (0.0010) [2023-12-26 03:14:36,128][123091] Updated weights for policy 0, policy_version 458024 (0.0010) [2023-12-26 03:14:36,208][123090] Updated weights for policy 1, policy_version 455074 (0.0010) [2023-12-26 03:14:36,275][123090] Updated weights for policy 1, policy_version 455084 (0.0013) [2023-12-26 03:14:36,351][123090] Updated weights for policy 1, policy_version 455094 (0.0011) [2023-12-26 03:14:36,424][123090] Updated weights for policy 1, policy_version 455104 (0.0010) [2023-12-26 03:14:36,958][123091] Updated weights for policy 0, policy_version 458034 (0.0011) [2023-12-26 03:14:37,022][123091] Updated weights for policy 0, policy_version 458044 (0.0011) [2023-12-26 03:14:37,093][123091] Updated weights for policy 0, policy_version 458054 (0.0011) [2023-12-26 03:14:37,148][123090] Updated weights for policy 1, policy_version 455114 (0.0005) [2023-12-26 03:14:37,156][123091] Updated weights for policy 0, policy_version 458064 (0.0011) [2023-12-26 03:14:37,203][123090] Updated weights for policy 1, policy_version 455124 (0.0005) [2023-12-26 03:14:37,271][123090] Updated weights for policy 1, policy_version 455134 (0.0005) [2023-12-26 03:14:37,966][123091] Updated weights for policy 0, policy_version 458074 (0.0011) [2023-12-26 03:14:37,984][123090] Updated weights for policy 1, policy_version 455144 (0.0010) [2023-12-26 03:14:38,022][123091] Updated weights for policy 0, policy_version 458084 (0.0010) [2023-12-26 03:14:38,032][123090] Updated weights for policy 1, policy_version 455154 (0.0010) [2023-12-26 03:14:38,073][123091] Updated weights for policy 0, policy_version 458094 (0.0010) [2023-12-26 03:14:38,080][123090] Updated weights for policy 1, policy_version 455164 (0.0010) [2023-12-26 03:14:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 233799680. Throughput: 0: 9107.1, 1: 8568.5. Samples: 233778520. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:38,786][121949] Avg episode reward: [(0, '6188.566'), (1, '5849.594')] [2023-12-26 03:14:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000458096_117276672.pth... [2023-12-26 03:14:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000455168_116523008.pth... [2023-12-26 03:14:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000457040_117006336.pth [2023-12-26 03:14:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000454176_116269056.pth [2023-12-26 03:14:38,853][123090] Updated weights for policy 1, policy_version 455174 (0.0009) [2023-12-26 03:14:38,894][123091] Updated weights for policy 0, policy_version 458104 (0.0011) [2023-12-26 03:14:38,914][123090] Updated weights for policy 1, policy_version 455184 (0.0011) [2023-12-26 03:14:38,957][123091] Updated weights for policy 0, policy_version 458114 (0.0011) [2023-12-26 03:14:38,969][123090] Updated weights for policy 1, policy_version 455194 (0.0010) [2023-12-26 03:14:39,019][123091] Updated weights for policy 0, policy_version 458124 (0.0011) [2023-12-26 03:14:39,753][123090] Updated weights for policy 1, policy_version 455204 (0.0008) [2023-12-26 03:14:39,810][123090] Updated weights for policy 1, policy_version 455214 (0.0006) [2023-12-26 03:14:39,877][123090] Updated weights for policy 1, policy_version 455224 (0.0008) [2023-12-26 03:14:39,904][123091] Updated weights for policy 0, policy_version 458134 (0.0010) [2023-12-26 03:14:39,970][123091] Updated weights for policy 0, policy_version 458144 (0.0009) [2023-12-26 03:14:40,024][123091] Updated weights for policy 0, policy_version 458154 (0.0010) [2023-12-26 03:14:40,640][123090] Updated weights for policy 1, policy_version 455234 (0.0009) [2023-12-26 03:14:40,711][123090] Updated weights for policy 1, policy_version 455244 (0.0007) [2023-12-26 03:14:40,776][123090] Updated weights for policy 1, policy_version 455254 (0.0008) [2023-12-26 03:14:40,837][123090] Updated weights for policy 1, policy_version 455264 (0.0008) [2023-12-26 03:14:40,897][123091] Updated weights for policy 0, policy_version 458164 (0.0010) [2023-12-26 03:14:40,954][123091] Updated weights for policy 0, policy_version 458174 (0.0010) [2023-12-26 03:14:41,010][123091] Updated weights for policy 0, policy_version 458184 (0.0010) [2023-12-26 03:14:41,601][123090] Updated weights for policy 1, policy_version 455274 (0.0011) [2023-12-26 03:14:41,675][123090] Updated weights for policy 1, policy_version 455284 (0.0011) [2023-12-26 03:14:41,750][123090] Updated weights for policy 1, policy_version 455294 (0.0011) [2023-12-26 03:14:41,920][123091] Updated weights for policy 0, policy_version 458194 (0.0009) [2023-12-26 03:14:41,985][123091] Updated weights for policy 0, policy_version 458204 (0.0009) [2023-12-26 03:14:42,057][123091] Updated weights for policy 0, policy_version 458214 (0.0010) [2023-12-26 03:14:42,125][123091] Updated weights for policy 0, policy_version 458224 (0.0010) [2023-12-26 03:14:42,511][123090] Updated weights for policy 1, policy_version 455304 (0.0009) [2023-12-26 03:14:42,575][123090] Updated weights for policy 1, policy_version 455314 (0.0010) [2023-12-26 03:14:42,629][123090] Updated weights for policy 1, policy_version 455324 (0.0010) [2023-12-26 03:14:42,842][123091] Updated weights for policy 0, policy_version 458234 (0.0009) [2023-12-26 03:14:42,891][123091] Updated weights for policy 0, policy_version 458244 (0.0009) [2023-12-26 03:14:42,943][123091] Updated weights for policy 0, policy_version 458254 (0.0009) [2023-12-26 03:14:43,513][123090] Updated weights for policy 1, policy_version 455334 (0.0010) [2023-12-26 03:14:43,566][123090] Updated weights for policy 1, policy_version 455345 (0.0009) [2023-12-26 03:14:43,625][123090] Updated weights for policy 1, policy_version 455355 (0.0009) [2023-12-26 03:14:43,764][123091] Updated weights for policy 0, policy_version 458264 (0.0009) [2023-12-26 03:14:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 233889792. Throughput: 0: 8943.9, 1: 8693.7. Samples: 233884452. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:43,785][121949] Avg episode reward: [(0, '6127.966'), (1, '5778.191')] [2023-12-26 03:14:43,818][123091] Updated weights for policy 0, policy_version 458274 (0.0009) [2023-12-26 03:14:43,876][123091] Updated weights for policy 0, policy_version 458284 (0.0010) [2023-12-26 03:14:44,495][123090] Updated weights for policy 1, policy_version 455365 (0.0009) [2023-12-26 03:14:44,548][123090] Updated weights for policy 1, policy_version 455375 (0.0010) [2023-12-26 03:14:44,599][123090] Updated weights for policy 1, policy_version 455385 (0.0009) [2023-12-26 03:14:44,610][123091] Updated weights for policy 0, policy_version 458294 (0.0007) [2023-12-26 03:14:44,668][123091] Updated weights for policy 0, policy_version 458304 (0.0006) [2023-12-26 03:14:44,729][123091] Updated weights for policy 0, policy_version 458314 (0.0006) [2023-12-26 03:14:45,487][123091] Updated weights for policy 0, policy_version 458324 (0.0009) [2023-12-26 03:14:45,504][123090] Updated weights for policy 1, policy_version 455395 (0.0009) [2023-12-26 03:14:45,536][123091] Updated weights for policy 0, policy_version 458334 (0.0005) [2023-12-26 03:14:45,555][123090] Updated weights for policy 1, policy_version 455406 (0.0009) [2023-12-26 03:14:45,585][123091] Updated weights for policy 0, policy_version 458344 (0.0005) [2023-12-26 03:14:45,607][123090] Updated weights for policy 1, policy_version 455416 (0.0011) [2023-12-26 03:14:46,260][123091] Updated weights for policy 0, policy_version 458354 (0.0006) [2023-12-26 03:14:46,315][123091] Updated weights for policy 0, policy_version 458364 (0.0010) [2023-12-26 03:14:46,380][123091] Updated weights for policy 0, policy_version 458374 (0.0010) [2023-12-26 03:14:46,449][123091] Updated weights for policy 0, policy_version 458384 (0.0010) [2023-12-26 03:14:46,506][123090] Updated weights for policy 1, policy_version 455426 (0.0009) [2023-12-26 03:14:46,554][123090] Updated weights for policy 1, policy_version 455436 (0.0005) [2023-12-26 03:14:46,606][123090] Updated weights for policy 1, policy_version 455446 (0.0005) [2023-12-26 03:14:46,662][123090] Updated weights for policy 1, policy_version 455456 (0.0006) [2023-12-26 03:14:47,188][123091] Updated weights for policy 0, policy_version 458394 (0.0010) [2023-12-26 03:14:47,242][123091] Updated weights for policy 0, policy_version 458404 (0.0010) [2023-12-26 03:14:47,301][123091] Updated weights for policy 0, policy_version 458414 (0.0010) [2023-12-26 03:14:47,499][123090] Updated weights for policy 1, policy_version 455466 (0.0009) [2023-12-26 03:14:47,556][123090] Updated weights for policy 1, policy_version 455476 (0.0009) [2023-12-26 03:14:47,616][123090] Updated weights for policy 1, policy_version 455486 (0.0009) [2023-12-26 03:14:47,987][123091] Updated weights for policy 0, policy_version 458424 (0.0009) [2023-12-26 03:14:48,048][123091] Updated weights for policy 0, policy_version 458434 (0.0009) [2023-12-26 03:14:48,112][123091] Updated weights for policy 0, policy_version 458444 (0.0009) [2023-12-26 03:14:48,428][123090] Updated weights for policy 1, policy_version 455496 (0.0008) [2023-12-26 03:14:48,483][123090] Updated weights for policy 1, policy_version 455506 (0.0008) [2023-12-26 03:14:48,546][123090] Updated weights for policy 1, policy_version 455516 (0.0010) [2023-12-26 03:14:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 233979904. Throughput: 0: 9055.8, 1: 8662.0. Samples: 233991432. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:48,785][121949] Avg episode reward: [(0, '6022.827'), (1, '5648.812')] [2023-12-26 03:14:48,902][123091] Updated weights for policy 0, policy_version 458454 (0.0010) [2023-12-26 03:14:48,963][123091] Updated weights for policy 0, policy_version 458464 (0.0009) [2023-12-26 03:14:49,027][123091] Updated weights for policy 0, policy_version 458474 (0.0009) [2023-12-26 03:14:49,400][123090] Updated weights for policy 1, policy_version 455526 (0.0010) [2023-12-26 03:14:49,459][123090] Updated weights for policy 1, policy_version 455536 (0.0009) [2023-12-26 03:14:49,520][123090] Updated weights for policy 1, policy_version 455546 (0.0009) [2023-12-26 03:14:49,875][123091] Updated weights for policy 0, policy_version 458484 (0.0009) [2023-12-26 03:14:49,938][123091] Updated weights for policy 0, policy_version 458494 (0.0009) [2023-12-26 03:14:50,001][123091] Updated weights for policy 0, policy_version 458504 (0.0010) [2023-12-26 03:14:50,344][123090] Updated weights for policy 1, policy_version 455556 (0.0009) [2023-12-26 03:14:50,404][123090] Updated weights for policy 1, policy_version 455566 (0.0006) [2023-12-26 03:14:50,465][123090] Updated weights for policy 1, policy_version 455576 (0.0006) [2023-12-26 03:14:50,882][123091] Updated weights for policy 0, policy_version 458514 (0.0010) [2023-12-26 03:14:50,947][123091] Updated weights for policy 0, policy_version 458524 (0.0010) [2023-12-26 03:14:51,018][123091] Updated weights for policy 0, policy_version 458534 (0.0008) [2023-12-26 03:14:51,080][123091] Updated weights for policy 0, policy_version 458544 (0.0010) [2023-12-26 03:14:51,117][123090] Updated weights for policy 1, policy_version 455586 (0.0010) [2023-12-26 03:14:51,181][123090] Updated weights for policy 1, policy_version 455596 (0.0010) [2023-12-26 03:14:51,236][123090] Updated weights for policy 1, policy_version 455606 (0.0010) [2023-12-26 03:14:51,306][123090] Updated weights for policy 1, policy_version 455616 (0.0011) [2023-12-26 03:14:51,934][123091] Updated weights for policy 0, policy_version 458554 (0.0009) [2023-12-26 03:14:51,994][123091] Updated weights for policy 0, policy_version 458564 (0.0008) [2023-12-26 03:14:52,045][123091] Updated weights for policy 0, policy_version 458574 (0.0009) [2023-12-26 03:14:52,137][123090] Updated weights for policy 1, policy_version 455626 (0.0008) [2023-12-26 03:14:52,193][123090] Updated weights for policy 1, policy_version 455636 (0.0009) [2023-12-26 03:14:52,253][123090] Updated weights for policy 1, policy_version 455646 (0.0009) [2023-12-26 03:14:52,804][123091] Updated weights for policy 0, policy_version 458584 (0.0006) [2023-12-26 03:14:52,874][123091] Updated weights for policy 0, policy_version 458594 (0.0008) [2023-12-26 03:14:52,932][123091] Updated weights for policy 0, policy_version 458604 (0.0009) [2023-12-26 03:14:53,067][123090] Updated weights for policy 1, policy_version 455656 (0.0009) [2023-12-26 03:14:53,130][123090] Updated weights for policy 1, policy_version 455666 (0.0009) [2023-12-26 03:14:53,192][123090] Updated weights for policy 1, policy_version 455676 (0.0009) [2023-12-26 03:14:53,701][123091] Updated weights for policy 0, policy_version 458614 (0.0008) [2023-12-26 03:14:53,776][123091] Updated weights for policy 0, policy_version 458624 (0.0005) [2023-12-26 03:14:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 234061824. Throughput: 0: 8999.8, 1: 8648.9. Samples: 234043012. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:53,785][121949] Avg episode reward: [(0, '6052.113'), (1, '5620.230')] [2023-12-26 03:14:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000455680_116654080.pth... [2023-12-26 03:14:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000454656_116391936.pth [2023-12-26 03:14:53,842][123091] Updated weights for policy 0, policy_version 458634 (0.0006) [2023-12-26 03:14:53,868][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000458640_117415936.pth... [2023-12-26 03:14:53,871][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000457584_117145600.pth [2023-12-26 03:14:54,071][123090] Updated weights for policy 1, policy_version 455686 (0.0008) [2023-12-26 03:14:54,137][123090] Updated weights for policy 1, policy_version 455696 (0.0009) [2023-12-26 03:14:54,203][123090] Updated weights for policy 1, policy_version 455706 (0.0009) [2023-12-26 03:14:54,520][123091] Updated weights for policy 0, policy_version 458644 (0.0007) [2023-12-26 03:14:54,573][123091] Updated weights for policy 0, policy_version 458654 (0.0010) [2023-12-26 03:14:54,628][123091] Updated weights for policy 0, policy_version 458664 (0.0008) [2023-12-26 03:14:55,019][123090] Updated weights for policy 1, policy_version 455716 (0.0009) [2023-12-26 03:14:55,065][123090] Updated weights for policy 1, policy_version 455726 (0.0005) [2023-12-26 03:14:55,117][123090] Updated weights for policy 1, policy_version 455736 (0.0005) [2023-12-26 03:14:55,398][123091] Updated weights for policy 0, policy_version 458674 (0.0009) [2023-12-26 03:14:55,456][123091] Updated weights for policy 0, policy_version 458684 (0.0010) [2023-12-26 03:14:55,519][123091] Updated weights for policy 0, policy_version 458694 (0.0010) [2023-12-26 03:14:55,574][123091] Updated weights for policy 0, policy_version 458704 (0.0009) [2023-12-26 03:14:55,850][123090] Updated weights for policy 1, policy_version 455746 (0.0006) [2023-12-26 03:14:55,915][123090] Updated weights for policy 1, policy_version 455756 (0.0009) [2023-12-26 03:14:55,975][123090] Updated weights for policy 1, policy_version 455766 (0.0008) [2023-12-26 03:14:56,043][123090] Updated weights for policy 1, policy_version 455776 (0.0008) [2023-12-26 03:14:56,418][123091] Updated weights for policy 0, policy_version 458714 (0.0010) [2023-12-26 03:14:56,478][123091] Updated weights for policy 0, policy_version 458724 (0.0010) [2023-12-26 03:14:56,543][123091] Updated weights for policy 0, policy_version 458734 (0.0010) [2023-12-26 03:14:56,849][123090] Updated weights for policy 1, policy_version 455786 (0.0005) [2023-12-26 03:14:56,894][123090] Updated weights for policy 1, policy_version 455796 (0.0005) [2023-12-26 03:14:56,946][123090] Updated weights for policy 1, policy_version 455806 (0.0008) [2023-12-26 03:14:57,313][123091] Updated weights for policy 0, policy_version 458744 (0.0009) [2023-12-26 03:14:57,382][123091] Updated weights for policy 0, policy_version 458754 (0.0006) [2023-12-26 03:14:57,449][123091] Updated weights for policy 0, policy_version 458764 (0.0005) [2023-12-26 03:14:57,766][123090] Updated weights for policy 1, policy_version 455816 (0.0010) [2023-12-26 03:14:57,819][123090] Updated weights for policy 1, policy_version 455826 (0.0010) [2023-12-26 03:14:57,872][123090] Updated weights for policy 1, policy_version 455837 (0.0010) [2023-12-26 03:14:58,210][123091] Updated weights for policy 0, policy_version 458774 (0.0008) [2023-12-26 03:14:58,265][123091] Updated weights for policy 0, policy_version 458784 (0.0009) [2023-12-26 03:14:58,317][123091] Updated weights for policy 0, policy_version 458794 (0.0008) [2023-12-26 03:14:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234151936. Throughput: 0: 9041.4, 1: 8687.7. Samples: 234148100. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:14:58,785][121949] Avg episode reward: [(0, '6221.781'), (1, '5611.287')] [2023-12-26 03:14:58,817][123090] Updated weights for policy 1, policy_version 455848 (0.0008) [2023-12-26 03:14:58,877][123090] Updated weights for policy 1, policy_version 455858 (0.0008) [2023-12-26 03:14:58,939][123090] Updated weights for policy 1, policy_version 455868 (0.0008) [2023-12-26 03:14:59,291][123091] Updated weights for policy 0, policy_version 458804 (0.0009) [2023-12-26 03:14:59,348][123091] Updated weights for policy 0, policy_version 458814 (0.0010) [2023-12-26 03:14:59,416][123091] Updated weights for policy 0, policy_version 458825 (0.0009) [2023-12-26 03:14:59,677][123090] Updated weights for policy 1, policy_version 455878 (0.0008) [2023-12-26 03:14:59,737][123090] Updated weights for policy 1, policy_version 455888 (0.0009) [2023-12-26 03:14:59,791][123090] Updated weights for policy 1, policy_version 455898 (0.0009) [2023-12-26 03:15:00,298][123091] Updated weights for policy 0, policy_version 458835 (0.0010) [2023-12-26 03:15:00,361][123091] Updated weights for policy 0, policy_version 458845 (0.0009) [2023-12-26 03:15:00,415][123091] Updated weights for policy 0, policy_version 458855 (0.0009) [2023-12-26 03:15:00,669][123090] Updated weights for policy 1, policy_version 455908 (0.0009) [2023-12-26 03:15:00,716][123090] Updated weights for policy 1, policy_version 455918 (0.0009) [2023-12-26 03:15:00,773][123090] Updated weights for policy 1, policy_version 455928 (0.0009) [2023-12-26 03:15:01,095][123091] Updated weights for policy 0, policy_version 458865 (0.0006) [2023-12-26 03:15:01,161][123091] Updated weights for policy 0, policy_version 458875 (0.0013) [2023-12-26 03:15:01,217][123091] Updated weights for policy 0, policy_version 458885 (0.0011) [2023-12-26 03:15:01,281][123091] Updated weights for policy 0, policy_version 458895 (0.0011) [2023-12-26 03:15:01,665][123090] Updated weights for policy 1, policy_version 455938 (0.0009) [2023-12-26 03:15:01,730][123090] Updated weights for policy 1, policy_version 455948 (0.0007) [2023-12-26 03:15:01,786][123090] Updated weights for policy 1, policy_version 455958 (0.0010) [2023-12-26 03:15:01,838][123090] Updated weights for policy 1, policy_version 455968 (0.0009) [2023-12-26 03:15:02,072][123091] Updated weights for policy 0, policy_version 458905 (0.0006) [2023-12-26 03:15:02,136][123091] Updated weights for policy 0, policy_version 458915 (0.0006) [2023-12-26 03:15:02,205][123091] Updated weights for policy 0, policy_version 458925 (0.0005) [2023-12-26 03:15:02,722][123090] Updated weights for policy 1, policy_version 455978 (0.0009) [2023-12-26 03:15:02,775][123090] Updated weights for policy 1, policy_version 455988 (0.0009) [2023-12-26 03:15:02,826][123090] Updated weights for policy 1, policy_version 455998 (0.0009) [2023-12-26 03:15:02,877][123091] Updated weights for policy 0, policy_version 458935 (0.0008) [2023-12-26 03:15:02,935][123091] Updated weights for policy 0, policy_version 458946 (0.0010) [2023-12-26 03:15:02,998][123091] Updated weights for policy 0, policy_version 458956 (0.0010) [2023-12-26 03:15:03,658][123090] Updated weights for policy 1, policy_version 456008 (0.0010) [2023-12-26 03:15:03,714][123090] Updated weights for policy 1, policy_version 456018 (0.0009) [2023-12-26 03:15:03,764][123090] Updated weights for policy 1, policy_version 456029 (0.0010) [2023-12-26 03:15:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 234242048. Throughput: 0: 8887.5, 1: 8635.9. Samples: 234251736. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:15:03,784][121949] Avg episode reward: [(0, '6182.337'), (1, '5768.420')] [2023-12-26 03:15:03,848][123091] Updated weights for policy 0, policy_version 458966 (0.0010) [2023-12-26 03:15:03,910][123091] Updated weights for policy 0, policy_version 458976 (0.0007) [2023-12-26 03:15:03,978][123091] Updated weights for policy 0, policy_version 458986 (0.0008) [2023-12-26 03:15:04,645][123090] Updated weights for policy 1, policy_version 456039 (0.0010) [2023-12-26 03:15:04,706][123090] Updated weights for policy 1, policy_version 456049 (0.0010) [2023-12-26 03:15:04,772][123090] Updated weights for policy 1, policy_version 456059 (0.0009) [2023-12-26 03:15:04,791][123091] Updated weights for policy 0, policy_version 458996 (0.0008) [2023-12-26 03:15:04,859][123091] Updated weights for policy 0, policy_version 459006 (0.0009) [2023-12-26 03:15:04,927][123091] Updated weights for policy 0, policy_version 459016 (0.0009) [2023-12-26 03:15:05,580][123090] Updated weights for policy 1, policy_version 456069 (0.0008) [2023-12-26 03:15:05,652][123090] Updated weights for policy 1, policy_version 456079 (0.0008) [2023-12-26 03:15:05,690][123091] Updated weights for policy 0, policy_version 459026 (0.0010) [2023-12-26 03:15:05,706][123090] Updated weights for policy 1, policy_version 456089 (0.0009) [2023-12-26 03:15:05,747][123091] Updated weights for policy 0, policy_version 459036 (0.0010) [2023-12-26 03:15:05,815][123091] Updated weights for policy 0, policy_version 459046 (0.0010) [2023-12-26 03:15:05,876][123091] Updated weights for policy 0, policy_version 459056 (0.0009) [2023-12-26 03:15:06,470][123090] Updated weights for policy 1, policy_version 456099 (0.0006) [2023-12-26 03:15:06,527][123090] Updated weights for policy 1, policy_version 456109 (0.0005) [2023-12-26 03:15:06,582][123090] Updated weights for policy 1, policy_version 456119 (0.0005) [2023-12-26 03:15:06,774][123091] Updated weights for policy 0, policy_version 459066 (0.0010) [2023-12-26 03:15:06,838][123091] Updated weights for policy 0, policy_version 459076 (0.0010) [2023-12-26 03:15:06,903][123091] Updated weights for policy 0, policy_version 459086 (0.0010) [2023-12-26 03:15:07,285][123090] Updated weights for policy 1, policy_version 456129 (0.0005) [2023-12-26 03:15:07,351][123090] Updated weights for policy 1, policy_version 456139 (0.0010) [2023-12-26 03:15:07,418][123090] Updated weights for policy 1, policy_version 456149 (0.0010) [2023-12-26 03:15:07,484][123090] Updated weights for policy 1, policy_version 456159 (0.0010) [2023-12-26 03:15:07,736][123091] Updated weights for policy 0, policy_version 459096 (0.0007) [2023-12-26 03:15:07,797][123091] Updated weights for policy 0, policy_version 459106 (0.0005) [2023-12-26 03:15:07,845][123091] Updated weights for policy 0, policy_version 459116 (0.0006) [2023-12-26 03:15:08,361][123090] Updated weights for policy 1, policy_version 456169 (0.0009) [2023-12-26 03:15:08,424][123090] Updated weights for policy 1, policy_version 456179 (0.0009) [2023-12-26 03:15:08,478][123090] Updated weights for policy 1, policy_version 456190 (0.0010) [2023-12-26 03:15:08,604][123091] Updated weights for policy 0, policy_version 459126 (0.0007) [2023-12-26 03:15:08,666][123091] Updated weights for policy 0, policy_version 459136 (0.0010) [2023-12-26 03:15:08,726][123091] Updated weights for policy 0, policy_version 459146 (0.0010) [2023-12-26 03:15:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 234332160. Throughput: 0: 8902.6, 1: 8667.9. Samples: 234303596. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:15:08,785][121949] Avg episode reward: [(0, '5953.631'), (1, '5963.270')] [2023-12-26 03:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000459152_117547008.pth... [2023-12-26 03:15:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000456192_116785152.pth... [2023-12-26 03:15:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000458096_117276672.pth [2023-12-26 03:15:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000455168_116523008.pth [2023-12-26 03:15:09,396][123090] Updated weights for policy 1, policy_version 456200 (0.0010) [2023-12-26 03:15:09,458][123090] Updated weights for policy 1, policy_version 456210 (0.0009) [2023-12-26 03:15:09,510][123090] Updated weights for policy 1, policy_version 456220 (0.0009) [2023-12-26 03:15:09,554][123091] Updated weights for policy 0, policy_version 459156 (0.0007) [2023-12-26 03:15:09,613][123091] Updated weights for policy 0, policy_version 459166 (0.0009) [2023-12-26 03:15:09,676][123091] Updated weights for policy 0, policy_version 459176 (0.0009) [2023-12-26 03:15:10,405][123090] Updated weights for policy 1, policy_version 456230 (0.0010) [2023-12-26 03:15:10,455][123090] Updated weights for policy 1, policy_version 456241 (0.0008) [2023-12-26 03:15:10,505][123091] Updated weights for policy 0, policy_version 459186 (0.0009) [2023-12-26 03:15:10,511][123090] Updated weights for policy 1, policy_version 456251 (0.0010) [2023-12-26 03:15:10,560][123091] Updated weights for policy 0, policy_version 459196 (0.0009) [2023-12-26 03:15:10,620][123091] Updated weights for policy 0, policy_version 459206 (0.0009) [2023-12-26 03:15:10,667][123091] Updated weights for policy 0, policy_version 459216 (0.0009) [2023-12-26 03:15:11,328][123090] Updated weights for policy 1, policy_version 456261 (0.0007) [2023-12-26 03:15:11,399][123090] Updated weights for policy 1, policy_version 456271 (0.0010) [2023-12-26 03:15:11,470][123090] Updated weights for policy 1, policy_version 456281 (0.0011) [2023-12-26 03:15:11,538][123091] Updated weights for policy 0, policy_version 459226 (0.0008) [2023-12-26 03:15:11,611][123091] Updated weights for policy 0, policy_version 459236 (0.0007) [2023-12-26 03:15:11,673][123091] Updated weights for policy 0, policy_version 459246 (0.0009) [2023-12-26 03:15:12,291][123090] Updated weights for policy 1, policy_version 456291 (0.0011) [2023-12-26 03:15:12,378][123090] Updated weights for policy 1, policy_version 456301 (0.0010) [2023-12-26 03:15:12,435][123091] Updated weights for policy 0, policy_version 459256 (0.0009) [2023-12-26 03:15:12,443][123090] Updated weights for policy 1, policy_version 456311 (0.0010) [2023-12-26 03:15:12,498][123091] Updated weights for policy 0, policy_version 459266 (0.0008) [2023-12-26 03:15:12,551][123091] Updated weights for policy 0, policy_version 459276 (0.0009) [2023-12-26 03:15:13,247][123090] Updated weights for policy 1, policy_version 456321 (0.0011) [2023-12-26 03:15:13,306][123090] Updated weights for policy 1, policy_version 456331 (0.0010) [2023-12-26 03:15:13,369][123090] Updated weights for policy 1, policy_version 456341 (0.0009) [2023-12-26 03:15:13,390][123091] Updated weights for policy 0, policy_version 459286 (0.0007) [2023-12-26 03:15:13,430][123090] Updated weights for policy 1, policy_version 456351 (0.0008) [2023-12-26 03:15:13,451][123091] Updated weights for policy 0, policy_version 459296 (0.0006) [2023-12-26 03:15:13,499][123091] Updated weights for policy 0, policy_version 459306 (0.0005) [2023-12-26 03:15:13,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 234414080. Throughput: 0: 8859.8, 1: 8637.5. Samples: 234405748. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:15:13,785][121949] Avg episode reward: [(0, '6011.748'), (1, '5931.254')] [2023-12-26 03:15:14,182][123091] Updated weights for policy 0, policy_version 459316 (0.0007) [2023-12-26 03:15:14,236][123091] Updated weights for policy 0, policy_version 459326 (0.0009) [2023-12-26 03:15:14,280][123090] Updated weights for policy 1, policy_version 456361 (0.0007) [2023-12-26 03:15:14,283][123091] Updated weights for policy 0, policy_version 459336 (0.0009) [2023-12-26 03:15:14,339][123090] Updated weights for policy 1, policy_version 456371 (0.0008) [2023-12-26 03:15:14,399][123090] Updated weights for policy 1, policy_version 456381 (0.0009) [2023-12-26 03:15:15,089][123091] Updated weights for policy 0, policy_version 459346 (0.0008) [2023-12-26 03:15:15,141][123091] Updated weights for policy 0, policy_version 459356 (0.0009) [2023-12-26 03:15:15,201][123091] Updated weights for policy 0, policy_version 459366 (0.0007) [2023-12-26 03:15:15,259][123091] Updated weights for policy 0, policy_version 459376 (0.0007) [2023-12-26 03:15:15,269][123090] Updated weights for policy 1, policy_version 456391 (0.0010) [2023-12-26 03:15:15,333][123090] Updated weights for policy 1, policy_version 456401 (0.0011) [2023-12-26 03:15:15,399][123090] Updated weights for policy 1, policy_version 456411 (0.0008) [2023-12-26 03:15:16,087][123090] Updated weights for policy 1, policy_version 456421 (0.0007) [2023-12-26 03:15:16,111][123091] Updated weights for policy 0, policy_version 459386 (0.0008) [2023-12-26 03:15:16,142][123090] Updated weights for policy 1, policy_version 456431 (0.0006) [2023-12-26 03:15:16,164][123091] Updated weights for policy 0, policy_version 459396 (0.0008) [2023-12-26 03:15:16,188][123090] Updated weights for policy 1, policy_version 456441 (0.0005) [2023-12-26 03:15:16,216][123091] Updated weights for policy 0, policy_version 459406 (0.0009) [2023-12-26 03:15:16,789][123090] Updated weights for policy 1, policy_version 456451 (0.0005) [2023-12-26 03:15:16,844][123090] Updated weights for policy 1, policy_version 456461 (0.0005) [2023-12-26 03:15:16,912][123090] Updated weights for policy 1, policy_version 456471 (0.0006) [2023-12-26 03:15:17,106][123091] Updated weights for policy 0, policy_version 459416 (0.0006) [2023-12-26 03:15:17,180][123091] Updated weights for policy 0, policy_version 459426 (0.0005) [2023-12-26 03:15:17,242][123091] Updated weights for policy 0, policy_version 459436 (0.0005) [2023-12-26 03:15:17,656][123090] Updated weights for policy 1, policy_version 456481 (0.0010) [2023-12-26 03:15:17,702][123090] Updated weights for policy 1, policy_version 456491 (0.0007) [2023-12-26 03:15:17,764][123090] Updated weights for policy 1, policy_version 456501 (0.0010) [2023-12-26 03:15:17,830][123090] Updated weights for policy 1, policy_version 456511 (0.0010) [2023-12-26 03:15:17,979][123091] Updated weights for policy 0, policy_version 459446 (0.0007) [2023-12-26 03:15:18,025][123091] Updated weights for policy 0, policy_version 459456 (0.0009) [2023-12-26 03:15:18,083][123091] Updated weights for policy 0, policy_version 459466 (0.0005) [2023-12-26 03:15:18,651][123090] Updated weights for policy 1, policy_version 456521 (0.0011) [2023-12-26 03:15:18,713][123090] Updated weights for policy 1, policy_version 456531 (0.0007) [2023-12-26 03:15:18,772][123090] Updated weights for policy 1, policy_version 456541 (0.0005) [2023-12-26 03:15:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 234496000. Throughput: 0: 8844.4, 1: 8715.0. Samples: 234514804. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:15:18,785][121949] Avg episode reward: [(0, '6167.846'), (1, '5813.590')] [2023-12-26 03:15:18,877][123091] Updated weights for policy 0, policy_version 459476 (0.0007) [2023-12-26 03:15:18,939][123091] Updated weights for policy 0, policy_version 459486 (0.0009) [2023-12-26 03:15:19,006][123091] Updated weights for policy 0, policy_version 459496 (0.0007) [2023-12-26 03:15:19,484][123090] Updated weights for policy 1, policy_version 456551 (0.0006) [2023-12-26 03:15:19,553][123090] Updated weights for policy 1, policy_version 456561 (0.0008) [2023-12-26 03:15:19,624][123090] Updated weights for policy 1, policy_version 456571 (0.0008) [2023-12-26 03:15:19,821][123091] Updated weights for policy 0, policy_version 459506 (0.0008) [2023-12-26 03:15:19,892][123091] Updated weights for policy 0, policy_version 459516 (0.0010) [2023-12-26 03:15:19,963][123091] Updated weights for policy 0, policy_version 459526 (0.0010) [2023-12-26 03:15:20,025][123091] Updated weights for policy 0, policy_version 459536 (0.0010) [2023-12-26 03:15:20,373][123090] Updated weights for policy 1, policy_version 456581 (0.0008) [2023-12-26 03:15:20,440][123090] Updated weights for policy 1, policy_version 456591 (0.0005) [2023-12-26 03:15:20,507][123090] Updated weights for policy 1, policy_version 456601 (0.0005) [2023-12-26 03:15:20,808][123091] Updated weights for policy 0, policy_version 459546 (0.0010) [2023-12-26 03:15:20,865][123091] Updated weights for policy 0, policy_version 459556 (0.0010) [2023-12-26 03:15:20,927][123091] Updated weights for policy 0, policy_version 459566 (0.0010) [2023-12-26 03:15:21,291][123090] Updated weights for policy 1, policy_version 456611 (0.0007) [2023-12-26 03:15:21,359][123090] Updated weights for policy 1, policy_version 456621 (0.0009) [2023-12-26 03:15:21,422][123090] Updated weights for policy 1, policy_version 456631 (0.0010) [2023-12-26 03:15:21,803][123091] Updated weights for policy 0, policy_version 459576 (0.0010) [2023-12-26 03:15:21,853][123091] Updated weights for policy 0, policy_version 459586 (0.0009) [2023-12-26 03:15:21,913][123091] Updated weights for policy 0, policy_version 459596 (0.0009) [2023-12-26 03:15:22,283][123090] Updated weights for policy 1, policy_version 456641 (0.0010) [2023-12-26 03:15:22,359][123090] Updated weights for policy 1, policy_version 456651 (0.0009) [2023-12-26 03:15:22,426][123090] Updated weights for policy 1, policy_version 456661 (0.0009) [2023-12-26 03:15:22,492][123090] Updated weights for policy 1, policy_version 456671 (0.0009) [2023-12-26 03:15:22,779][123091] Updated weights for policy 0, policy_version 459606 (0.0009) [2023-12-26 03:15:22,843][123091] Updated weights for policy 0, policy_version 459616 (0.0010) [2023-12-26 03:15:22,894][123091] Updated weights for policy 0, policy_version 459626 (0.0009) [2023-12-26 03:15:23,329][123090] Updated weights for policy 1, policy_version 456681 (0.0006) [2023-12-26 03:15:23,394][123090] Updated weights for policy 1, policy_version 456691 (0.0005) [2023-12-26 03:15:23,456][123090] Updated weights for policy 1, policy_version 456701 (0.0009) [2023-12-26 03:15:23,693][123091] Updated weights for policy 0, policy_version 459636 (0.0010) [2023-12-26 03:15:23,756][123091] Updated weights for policy 0, policy_version 459646 (0.0009) [2023-12-26 03:15:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 234586112. Throughput: 0: 8790.3, 1: 8724.9. Samples: 234566700. Policy #0 lag: (min: 31.0, avg: 44.0, max: 63.0) [2023-12-26 03:15:23,785][121949] Avg episode reward: [(0, '6180.859'), (1, '5707.078')] [2023-12-26 03:15:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000456704_116916224.pth... [2023-12-26 03:15:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000455680_116654080.pth [2023-12-26 03:15:23,828][123091] Updated weights for policy 0, policy_version 459656 (0.0011) [2023-12-26 03:15:23,882][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000459664_117678080.pth... [2023-12-26 03:15:23,885][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000458640_117415936.pth [2023-12-26 03:15:24,201][123090] Updated weights for policy 1, policy_version 456711 (0.0007) [2023-12-26 03:15:24,258][123090] Updated weights for policy 1, policy_version 456721 (0.0005) [2023-12-26 03:15:24,336][123090] Updated weights for policy 1, policy_version 456731 (0.0005) [2023-12-26 03:15:24,489][123091] Updated weights for policy 0, policy_version 459666 (0.0009) [2023-12-26 03:15:24,569][123091] Updated weights for policy 0, policy_version 459676 (0.0008) [2023-12-26 03:15:24,632][123091] Updated weights for policy 0, policy_version 459686 (0.0008) [2023-12-26 03:15:24,678][123091] Updated weights for policy 0, policy_version 459696 (0.0008) [2023-12-26 03:15:24,941][123090] Updated weights for policy 1, policy_version 456741 (0.0005) [2023-12-26 03:15:24,995][123090] Updated weights for policy 1, policy_version 456751 (0.0008) [2023-12-26 03:15:25,064][123090] Updated weights for policy 1, policy_version 456761 (0.0009) [2023-12-26 03:15:25,515][123091] Updated weights for policy 0, policy_version 459706 (0.0010) [2023-12-26 03:15:25,571][123091] Updated weights for policy 0, policy_version 459716 (0.0010) [2023-12-26 03:15:25,640][123091] Updated weights for policy 0, policy_version 459726 (0.0008) [2023-12-26 03:15:25,824][123090] Updated weights for policy 1, policy_version 456771 (0.0009) [2023-12-26 03:15:25,890][123090] Updated weights for policy 1, policy_version 456781 (0.0008) [2023-12-26 03:15:25,947][123090] Updated weights for policy 1, policy_version 456791 (0.0009) [2023-12-26 03:15:26,423][123091] Updated weights for policy 0, policy_version 459736 (0.0009) [2023-12-26 03:15:26,477][123091] Updated weights for policy 0, policy_version 459746 (0.0010) [2023-12-26 03:15:26,540][123091] Updated weights for policy 0, policy_version 459756 (0.0011) [2023-12-26 03:15:26,782][123090] Updated weights for policy 1, policy_version 456801 (0.0010) [2023-12-26 03:15:26,830][123090] Updated weights for policy 1, policy_version 456811 (0.0009) [2023-12-26 03:15:26,875][123090] Updated weights for policy 1, policy_version 456821 (0.0008) [2023-12-26 03:15:26,921][123090] Updated weights for policy 1, policy_version 456831 (0.0005) [2023-12-26 03:15:27,342][123091] Updated weights for policy 0, policy_version 459766 (0.0010) [2023-12-26 03:15:27,405][123091] Updated weights for policy 0, policy_version 459776 (0.0010) [2023-12-26 03:15:27,464][123091] Updated weights for policy 0, policy_version 459788 (0.0011) [2023-12-26 03:15:27,740][123090] Updated weights for policy 1, policy_version 456841 (0.0010) [2023-12-26 03:15:27,809][123090] Updated weights for policy 1, policy_version 456851 (0.0010) [2023-12-26 03:15:27,867][123090] Updated weights for policy 1, policy_version 456861 (0.0010) [2023-12-26 03:15:28,259][123091] Updated weights for policy 0, policy_version 459798 (0.0010) [2023-12-26 03:15:28,322][123091] Updated weights for policy 0, policy_version 459808 (0.0010) [2023-12-26 03:15:28,381][123091] Updated weights for policy 0, policy_version 459818 (0.0011) [2023-12-26 03:15:28,674][123090] Updated weights for policy 1, policy_version 456871 (0.0009) [2023-12-26 03:15:28,727][123090] Updated weights for policy 1, policy_version 456881 (0.0006) [2023-12-26 03:15:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234676224. Throughput: 0: 8846.2, 1: 8697.6. Samples: 234673920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:28,785][121949] Avg episode reward: [(0, '6198.810'), (1, '5818.572')] [2023-12-26 03:15:28,790][123090] Updated weights for policy 1, policy_version 456891 (0.0006) [2023-12-26 03:15:29,146][123091] Updated weights for policy 0, policy_version 459828 (0.0009) [2023-12-26 03:15:29,203][123091] Updated weights for policy 0, policy_version 459838 (0.0005) [2023-12-26 03:15:29,281][123091] Updated weights for policy 0, policy_version 459848 (0.0010) [2023-12-26 03:15:29,505][123090] Updated weights for policy 1, policy_version 456901 (0.0007) [2023-12-26 03:15:29,556][123090] Updated weights for policy 1, policy_version 456911 (0.0008) [2023-12-26 03:15:29,608][123090] Updated weights for policy 1, policy_version 456921 (0.0007) [2023-12-26 03:15:30,048][123091] Updated weights for policy 0, policy_version 459859 (0.0009) [2023-12-26 03:15:30,101][123091] Updated weights for policy 0, policy_version 459869 (0.0006) [2023-12-26 03:15:30,156][123091] Updated weights for policy 0, policy_version 459879 (0.0009) [2023-12-26 03:15:30,367][123090] Updated weights for policy 1, policy_version 456931 (0.0007) [2023-12-26 03:15:30,414][123090] Updated weights for policy 1, policy_version 456941 (0.0010) [2023-12-26 03:15:30,471][123090] Updated weights for policy 1, policy_version 456951 (0.0010) [2023-12-26 03:15:30,971][123091] Updated weights for policy 0, policy_version 459889 (0.0009) [2023-12-26 03:15:31,029][123091] Updated weights for policy 0, policy_version 459899 (0.0010) [2023-12-26 03:15:31,091][123091] Updated weights for policy 0, policy_version 459909 (0.0009) [2023-12-26 03:15:31,154][123091] Updated weights for policy 0, policy_version 459919 (0.0010) [2023-12-26 03:15:31,266][123090] Updated weights for policy 1, policy_version 456961 (0.0010) [2023-12-26 03:15:31,326][123090] Updated weights for policy 1, policy_version 456971 (0.0006) [2023-12-26 03:15:31,394][123090] Updated weights for policy 1, policy_version 456981 (0.0009) [2023-12-26 03:15:31,459][123090] Updated weights for policy 1, policy_version 456991 (0.0010) [2023-12-26 03:15:32,032][123091] Updated weights for policy 0, policy_version 459929 (0.0009) [2023-12-26 03:15:32,093][123091] Updated weights for policy 0, policy_version 459939 (0.0009) [2023-12-26 03:15:32,153][123091] Updated weights for policy 0, policy_version 459949 (0.0009) [2023-12-26 03:15:32,279][123090] Updated weights for policy 1, policy_version 457001 (0.0009) [2023-12-26 03:15:32,356][123090] Updated weights for policy 1, policy_version 457011 (0.0006) [2023-12-26 03:15:32,421][123090] Updated weights for policy 1, policy_version 457021 (0.0006) [2023-12-26 03:15:33,019][123091] Updated weights for policy 0, policy_version 459959 (0.0009) [2023-12-26 03:15:33,040][123090] Updated weights for policy 1, policy_version 457031 (0.0006) [2023-12-26 03:15:33,072][123091] Updated weights for policy 0, policy_version 459969 (0.0009) [2023-12-26 03:15:33,087][123090] Updated weights for policy 1, policy_version 457041 (0.0005) [2023-12-26 03:15:33,123][123091] Updated weights for policy 0, policy_version 459980 (0.0008) [2023-12-26 03:15:33,136][123090] Updated weights for policy 1, policy_version 457051 (0.0006) [2023-12-26 03:15:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 234766336. Throughput: 0: 8713.8, 1: 8838.9. Samples: 234781304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:33,785][121949] Avg episode reward: [(0, '6284.686'), (1, '5838.051')] [2023-12-26 03:15:33,837][123090] Updated weights for policy 1, policy_version 457061 (0.0007) [2023-12-26 03:15:33,897][123090] Updated weights for policy 1, policy_version 457071 (0.0009) [2023-12-26 03:15:33,958][123090] Updated weights for policy 1, policy_version 457081 (0.0005) [2023-12-26 03:15:34,038][123091] Updated weights for policy 0, policy_version 459990 (0.0010) [2023-12-26 03:15:34,096][123091] Updated weights for policy 0, policy_version 460000 (0.0010) [2023-12-26 03:15:34,158][123091] Updated weights for policy 0, policy_version 460010 (0.0007) [2023-12-26 03:15:34,734][123090] Updated weights for policy 1, policy_version 457091 (0.0007) [2023-12-26 03:15:34,795][123090] Updated weights for policy 1, policy_version 457101 (0.0008) [2023-12-26 03:15:34,867][123090] Updated weights for policy 1, policy_version 457111 (0.0007) [2023-12-26 03:15:34,986][123091] Updated weights for policy 0, policy_version 460020 (0.0008) [2023-12-26 03:15:35,051][123091] Updated weights for policy 0, policy_version 460030 (0.0009) [2023-12-26 03:15:35,108][123091] Updated weights for policy 0, policy_version 460041 (0.0010) [2023-12-26 03:15:35,533][123090] Updated weights for policy 1, policy_version 457121 (0.0005) [2023-12-26 03:15:35,611][123090] Updated weights for policy 1, policy_version 457131 (0.0006) [2023-12-26 03:15:35,684][123090] Updated weights for policy 1, policy_version 457141 (0.0005) [2023-12-26 03:15:35,740][123090] Updated weights for policy 1, policy_version 457151 (0.0006) [2023-12-26 03:15:35,780][123091] Updated weights for policy 0, policy_version 460051 (0.0006) [2023-12-26 03:15:35,828][123091] Updated weights for policy 0, policy_version 460061 (0.0005) [2023-12-26 03:15:35,879][123091] Updated weights for policy 0, policy_version 460071 (0.0006) [2023-12-26 03:15:36,451][123090] Updated weights for policy 1, policy_version 457161 (0.0009) [2023-12-26 03:15:36,514][123090] Updated weights for policy 1, policy_version 457171 (0.0009) [2023-12-26 03:15:36,583][123090] Updated weights for policy 1, policy_version 457181 (0.0006) [2023-12-26 03:15:36,620][123091] Updated weights for policy 0, policy_version 460081 (0.0006) [2023-12-26 03:15:36,691][123091] Updated weights for policy 0, policy_version 460091 (0.0010) [2023-12-26 03:15:36,750][123091] Updated weights for policy 0, policy_version 460101 (0.0010) [2023-12-26 03:15:36,810][123091] Updated weights for policy 0, policy_version 460111 (0.0010) [2023-12-26 03:15:37,244][123090] Updated weights for policy 1, policy_version 457191 (0.0009) [2023-12-26 03:15:37,305][123090] Updated weights for policy 1, policy_version 457201 (0.0009) [2023-12-26 03:15:37,378][123090] Updated weights for policy 1, policy_version 457211 (0.0008) [2023-12-26 03:15:37,621][123091] Updated weights for policy 0, policy_version 460121 (0.0010) [2023-12-26 03:15:37,687][123091] Updated weights for policy 0, policy_version 460131 (0.0010) [2023-12-26 03:15:37,752][123091] Updated weights for policy 0, policy_version 460141 (0.0010) [2023-12-26 03:15:38,103][123090] Updated weights for policy 1, policy_version 457221 (0.0008) [2023-12-26 03:15:38,179][123090] Updated weights for policy 1, policy_version 457231 (0.0005) [2023-12-26 03:15:38,249][123090] Updated weights for policy 1, policy_version 457241 (0.0006) [2023-12-26 03:15:38,635][123091] Updated weights for policy 0, policy_version 460151 (0.0010) [2023-12-26 03:15:38,695][123091] Updated weights for policy 0, policy_version 460161 (0.0009) [2023-12-26 03:15:38,766][123091] Updated weights for policy 0, policy_version 460171 (0.0010) [2023-12-26 03:15:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 234856448. Throughput: 0: 8769.7, 1: 8879.1. Samples: 234837212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:38,785][121949] Avg episode reward: [(0, '6208.259'), (1, '5740.517')] [2023-12-26 03:15:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000457248_117055488.pth... [2023-12-26 03:15:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000460176_117809152.pth... [2023-12-26 03:15:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000456192_116785152.pth [2023-12-26 03:15:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000459152_117547008.pth [2023-12-26 03:15:38,981][123090] Updated weights for policy 1, policy_version 457251 (0.0007) [2023-12-26 03:15:39,046][123090] Updated weights for policy 1, policy_version 457261 (0.0009) [2023-12-26 03:15:39,115][123090] Updated weights for policy 1, policy_version 457271 (0.0007) [2023-12-26 03:15:39,655][123091] Updated weights for policy 0, policy_version 460181 (0.0010) [2023-12-26 03:15:39,716][123091] Updated weights for policy 0, policy_version 460191 (0.0010) [2023-12-26 03:15:39,768][123091] Updated weights for policy 0, policy_version 460201 (0.0010) [2023-12-26 03:15:39,929][123090] Updated weights for policy 1, policy_version 457281 (0.0007) [2023-12-26 03:15:39,996][123090] Updated weights for policy 1, policy_version 457291 (0.0009) [2023-12-26 03:15:40,056][123090] Updated weights for policy 1, policy_version 457302 (0.0011) [2023-12-26 03:15:40,621][123091] Updated weights for policy 0, policy_version 460212 (0.0010) [2023-12-26 03:15:40,677][123091] Updated weights for policy 0, policy_version 460222 (0.0010) [2023-12-26 03:15:40,735][123091] Updated weights for policy 0, policy_version 460232 (0.0010) [2023-12-26 03:15:40,853][123090] Updated weights for policy 1, policy_version 457313 (0.0010) [2023-12-26 03:15:40,910][123090] Updated weights for policy 1, policy_version 457323 (0.0009) [2023-12-26 03:15:40,970][123090] Updated weights for policy 1, policy_version 457333 (0.0009) [2023-12-26 03:15:41,023][123090] Updated weights for policy 1, policy_version 457343 (0.0008) [2023-12-26 03:15:41,583][123091] Updated weights for policy 0, policy_version 460242 (0.0010) [2023-12-26 03:15:41,654][123091] Updated weights for policy 0, policy_version 460252 (0.0010) [2023-12-26 03:15:41,720][123091] Updated weights for policy 0, policy_version 460262 (0.0010) [2023-12-26 03:15:41,792][123091] Updated weights for policy 0, policy_version 460272 (0.0011) [2023-12-26 03:15:41,947][123090] Updated weights for policy 1, policy_version 457353 (0.0009) [2023-12-26 03:15:41,996][123090] Updated weights for policy 1, policy_version 457363 (0.0009) [2023-12-26 03:15:42,058][123090] Updated weights for policy 1, policy_version 457373 (0.0009) [2023-12-26 03:15:42,595][123091] Updated weights for policy 0, policy_version 460282 (0.0008) [2023-12-26 03:15:42,667][123091] Updated weights for policy 0, policy_version 460292 (0.0005) [2023-12-26 03:15:42,736][123091] Updated weights for policy 0, policy_version 460302 (0.0007) [2023-12-26 03:15:42,916][123090] Updated weights for policy 1, policy_version 457383 (0.0009) [2023-12-26 03:15:42,970][123090] Updated weights for policy 1, policy_version 457393 (0.0009) [2023-12-26 03:15:43,019][123090] Updated weights for policy 1, policy_version 457403 (0.0008) [2023-12-26 03:15:43,523][123091] Updated weights for policy 0, policy_version 460312 (0.0006) [2023-12-26 03:15:43,569][123091] Updated weights for policy 0, policy_version 460322 (0.0006) [2023-12-26 03:15:43,617][123091] Updated weights for policy 0, policy_version 460332 (0.0005) [2023-12-26 03:15:43,758][123090] Updated weights for policy 1, policy_version 457413 (0.0009) [2023-12-26 03:15:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 234946560. Throughput: 0: 8687.5, 1: 8905.3. Samples: 234939772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:43,784][121949] Avg episode reward: [(0, '6096.290'), (1, '5787.250')] [2023-12-26 03:15:43,819][123090] Updated weights for policy 1, policy_version 457423 (0.0010) [2023-12-26 03:15:43,877][123090] Updated weights for policy 1, policy_version 457433 (0.0010) [2023-12-26 03:15:44,385][123091] Updated weights for policy 0, policy_version 460342 (0.0009) [2023-12-26 03:15:44,436][123091] Updated weights for policy 0, policy_version 460352 (0.0010) [2023-12-26 03:15:44,509][123091] Updated weights for policy 0, policy_version 460362 (0.0010) [2023-12-26 03:15:44,648][123090] Updated weights for policy 1, policy_version 457443 (0.0009) [2023-12-26 03:15:44,701][123090] Updated weights for policy 1, policy_version 457453 (0.0009) [2023-12-26 03:15:44,754][123090] Updated weights for policy 1, policy_version 457463 (0.0008) [2023-12-26 03:15:45,286][123091] Updated weights for policy 0, policy_version 460372 (0.0008) [2023-12-26 03:15:45,344][123091] Updated weights for policy 0, policy_version 460382 (0.0005) [2023-12-26 03:15:45,409][123091] Updated weights for policy 0, policy_version 460392 (0.0005) [2023-12-26 03:15:45,677][123090] Updated weights for policy 1, policy_version 457473 (0.0009) [2023-12-26 03:15:45,744][123090] Updated weights for policy 1, policy_version 457483 (0.0009) [2023-12-26 03:15:45,813][123090] Updated weights for policy 1, policy_version 457493 (0.0009) [2023-12-26 03:15:45,873][123090] Updated weights for policy 1, policy_version 457503 (0.0009) [2023-12-26 03:15:46,171][123091] Updated weights for policy 0, policy_version 460402 (0.0007) [2023-12-26 03:15:46,240][123091] Updated weights for policy 0, policy_version 460412 (0.0010) [2023-12-26 03:15:46,306][123091] Updated weights for policy 0, policy_version 460422 (0.0010) [2023-12-26 03:15:46,373][123091] Updated weights for policy 0, policy_version 460432 (0.0010) [2023-12-26 03:15:46,584][123090] Updated weights for policy 1, policy_version 457513 (0.0010) [2023-12-26 03:15:46,648][123090] Updated weights for policy 1, policy_version 457523 (0.0010) [2023-12-26 03:15:46,727][123090] Updated weights for policy 1, policy_version 457533 (0.0009) [2023-12-26 03:15:47,110][123091] Updated weights for policy 0, policy_version 460442 (0.0009) [2023-12-26 03:15:47,176][123091] Updated weights for policy 0, policy_version 460452 (0.0009) [2023-12-26 03:15:47,238][123091] Updated weights for policy 0, policy_version 460462 (0.0009) [2023-12-26 03:15:47,566][123090] Updated weights for policy 1, policy_version 457543 (0.0009) [2023-12-26 03:15:47,620][123090] Updated weights for policy 1, policy_version 457553 (0.0010) [2023-12-26 03:15:47,681][123090] Updated weights for policy 1, policy_version 457563 (0.0009) [2023-12-26 03:15:47,949][123091] Updated weights for policy 0, policy_version 460472 (0.0010) [2023-12-26 03:15:48,020][123091] Updated weights for policy 0, policy_version 460482 (0.0009) [2023-12-26 03:15:48,084][123091] Updated weights for policy 0, policy_version 460492 (0.0010) [2023-12-26 03:15:48,565][123090] Updated weights for policy 1, policy_version 457573 (0.0010) [2023-12-26 03:15:48,615][123090] Updated weights for policy 1, policy_version 457584 (0.0009) [2023-12-26 03:15:48,672][123090] Updated weights for policy 1, policy_version 457594 (0.0009) [2023-12-26 03:15:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 235036672. Throughput: 0: 8718.7, 1: 8948.1. Samples: 235046744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:48,785][121949] Avg episode reward: [(0, '6136.010'), (1, '5836.402')] [2023-12-26 03:15:48,915][123091] Updated weights for policy 0, policy_version 460502 (0.0009) [2023-12-26 03:15:48,971][123091] Updated weights for policy 0, policy_version 460512 (0.0010) [2023-12-26 03:15:49,025][123091] Updated weights for policy 0, policy_version 460522 (0.0010) [2023-12-26 03:15:49,449][123090] Updated weights for policy 1, policy_version 457604 (0.0010) [2023-12-26 03:15:49,503][123090] Updated weights for policy 1, policy_version 457614 (0.0010) [2023-12-26 03:15:49,556][123090] Updated weights for policy 1, policy_version 457624 (0.0010) [2023-12-26 03:15:49,824][123091] Updated weights for policy 0, policy_version 460532 (0.0009) [2023-12-26 03:15:49,901][123091] Updated weights for policy 0, policy_version 460542 (0.0010) [2023-12-26 03:15:49,966][123091] Updated weights for policy 0, policy_version 460552 (0.0006) [2023-12-26 03:15:50,445][123090] Updated weights for policy 1, policy_version 457635 (0.0010) [2023-12-26 03:15:50,508][123090] Updated weights for policy 1, policy_version 457645 (0.0010) [2023-12-26 03:15:50,583][123090] Updated weights for policy 1, policy_version 457655 (0.0009) [2023-12-26 03:15:50,778][123091] Updated weights for policy 0, policy_version 460562 (0.0009) [2023-12-26 03:15:50,833][123091] Updated weights for policy 0, policy_version 460572 (0.0010) [2023-12-26 03:15:50,897][123091] Updated weights for policy 0, policy_version 460582 (0.0009) [2023-12-26 03:15:50,958][123091] Updated weights for policy 0, policy_version 460592 (0.0007) [2023-12-26 03:15:51,329][123090] Updated weights for policy 1, policy_version 457665 (0.0008) [2023-12-26 03:15:51,400][123090] Updated weights for policy 1, policy_version 457675 (0.0008) [2023-12-26 03:15:51,452][123090] Updated weights for policy 1, policy_version 457685 (0.0008) [2023-12-26 03:15:51,511][123090] Updated weights for policy 1, policy_version 457695 (0.0008) [2023-12-26 03:15:51,865][123091] Updated weights for policy 0, policy_version 460602 (0.0010) [2023-12-26 03:15:51,938][123091] Updated weights for policy 0, policy_version 460612 (0.0009) [2023-12-26 03:15:52,009][123091] Updated weights for policy 0, policy_version 460622 (0.0009) [2023-12-26 03:15:52,290][123090] Updated weights for policy 1, policy_version 457705 (0.0009) [2023-12-26 03:15:52,352][123090] Updated weights for policy 1, policy_version 457715 (0.0009) [2023-12-26 03:15:52,419][123090] Updated weights for policy 1, policy_version 457725 (0.0006) [2023-12-26 03:15:52,786][123091] Updated weights for policy 0, policy_version 460632 (0.0007) [2023-12-26 03:15:52,856][123091] Updated weights for policy 0, policy_version 460642 (0.0005) [2023-12-26 03:15:52,915][123091] Updated weights for policy 0, policy_version 460653 (0.0007) [2023-12-26 03:15:53,208][123090] Updated weights for policy 1, policy_version 457735 (0.0008) [2023-12-26 03:15:53,268][123090] Updated weights for policy 1, policy_version 457745 (0.0009) [2023-12-26 03:15:53,323][123090] Updated weights for policy 1, policy_version 457755 (0.0009) [2023-12-26 03:15:53,674][123091] Updated weights for policy 0, policy_version 460663 (0.0010) [2023-12-26 03:15:53,732][123091] Updated weights for policy 0, policy_version 460673 (0.0009) [2023-12-26 03:15:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235118592. Throughput: 0: 8719.5, 1: 8932.7. Samples: 235097944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:53,785][121949] Avg episode reward: [(0, '6196.605'), (1, '5899.117')] [2023-12-26 03:15:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000457760_117186560.pth... [2023-12-26 03:15:53,790][123091] Updated weights for policy 0, policy_version 460683 (0.0008) [2023-12-26 03:15:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000456704_116916224.pth [2023-12-26 03:15:53,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000460688_117940224.pth... [2023-12-26 03:15:53,822][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000459664_117678080.pth [2023-12-26 03:15:54,052][123090] Updated weights for policy 1, policy_version 457765 (0.0010) [2023-12-26 03:15:54,104][123090] Updated weights for policy 1, policy_version 457775 (0.0005) [2023-12-26 03:15:54,167][123090] Updated weights for policy 1, policy_version 457785 (0.0005) [2023-12-26 03:15:54,702][123091] Updated weights for policy 0, policy_version 460693 (0.0010) [2023-12-26 03:15:54,770][123091] Updated weights for policy 0, policy_version 460703 (0.0009) [2023-12-26 03:15:54,832][123091] Updated weights for policy 0, policy_version 460713 (0.0009) [2023-12-26 03:15:54,904][123090] Updated weights for policy 1, policy_version 457795 (0.0007) [2023-12-26 03:15:54,968][123090] Updated weights for policy 1, policy_version 457805 (0.0007) [2023-12-26 03:15:55,042][123090] Updated weights for policy 1, policy_version 457815 (0.0008) [2023-12-26 03:15:55,675][123091] Updated weights for policy 0, policy_version 460723 (0.0010) [2023-12-26 03:15:55,732][123091] Updated weights for policy 0, policy_version 460733 (0.0010) [2023-12-26 03:15:55,787][123091] Updated weights for policy 0, policy_version 460743 (0.0009) [2023-12-26 03:15:55,807][123090] Updated weights for policy 1, policy_version 457825 (0.0009) [2023-12-26 03:15:55,875][123090] Updated weights for policy 1, policy_version 457835 (0.0005) [2023-12-26 03:15:55,937][123090] Updated weights for policy 1, policy_version 457845 (0.0005) [2023-12-26 03:15:56,002][123090] Updated weights for policy 1, policy_version 457855 (0.0005) [2023-12-26 03:15:56,680][123091] Updated weights for policy 0, policy_version 460753 (0.0009) [2023-12-26 03:15:56,701][123090] Updated weights for policy 1, policy_version 457865 (0.0008) [2023-12-26 03:15:56,733][123091] Updated weights for policy 0, policy_version 460763 (0.0009) [2023-12-26 03:15:56,761][123090] Updated weights for policy 1, policy_version 457875 (0.0007) [2023-12-26 03:15:56,792][123091] Updated weights for policy 0, policy_version 460773 (0.0009) [2023-12-26 03:15:56,820][123090] Updated weights for policy 1, policy_version 457885 (0.0007) [2023-12-26 03:15:56,849][123091] Updated weights for policy 0, policy_version 460783 (0.0008) [2023-12-26 03:15:57,566][123090] Updated weights for policy 1, policy_version 457895 (0.0005) [2023-12-26 03:15:57,595][123091] Updated weights for policy 0, policy_version 460793 (0.0009) [2023-12-26 03:15:57,625][123090] Updated weights for policy 1, policy_version 457905 (0.0005) [2023-12-26 03:15:57,648][123091] Updated weights for policy 0, policy_version 460803 (0.0009) [2023-12-26 03:15:57,688][123090] Updated weights for policy 1, policy_version 457915 (0.0007) [2023-12-26 03:15:57,704][123091] Updated weights for policy 0, policy_version 460813 (0.0009) [2023-12-26 03:15:58,443][123090] Updated weights for policy 1, policy_version 457925 (0.0007) [2023-12-26 03:15:58,513][123090] Updated weights for policy 1, policy_version 457935 (0.0010) [2023-12-26 03:15:58,591][123090] Updated weights for policy 1, policy_version 457945 (0.0009) [2023-12-26 03:15:58,667][123091] Updated weights for policy 0, policy_version 460823 (0.0008) [2023-12-26 03:15:58,740][123091] Updated weights for policy 0, policy_version 460833 (0.0009) [2023-12-26 03:15:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 235208704. Throughput: 0: 8709.8, 1: 9056.2. Samples: 235205216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:15:58,785][121949] Avg episode reward: [(0, '6047.377'), (1, '5983.494')] [2023-12-26 03:15:58,817][123091] Updated weights for policy 0, policy_version 460843 (0.0009) [2023-12-26 03:15:59,536][123090] Updated weights for policy 1, policy_version 457955 (0.0008) [2023-12-26 03:15:59,592][123090] Updated weights for policy 1, policy_version 457965 (0.0009) [2023-12-26 03:15:59,648][123090] Updated weights for policy 1, policy_version 457975 (0.0007) [2023-12-26 03:15:59,756][123091] Updated weights for policy 0, policy_version 460853 (0.0010) [2023-12-26 03:15:59,819][123091] Updated weights for policy 0, policy_version 460863 (0.0010) [2023-12-26 03:15:59,886][123091] Updated weights for policy 0, policy_version 460873 (0.0009) [2023-12-26 03:16:00,484][123090] Updated weights for policy 1, policy_version 457985 (0.0009) [2023-12-26 03:16:00,541][123090] Updated weights for policy 1, policy_version 457995 (0.0010) [2023-12-26 03:16:00,605][123090] Updated weights for policy 1, policy_version 458005 (0.0009) [2023-12-26 03:16:00,666][123090] Updated weights for policy 1, policy_version 458015 (0.0009) [2023-12-26 03:16:00,736][123091] Updated weights for policy 0, policy_version 460883 (0.0010) [2023-12-26 03:16:00,800][123091] Updated weights for policy 0, policy_version 460893 (0.0010) [2023-12-26 03:16:00,861][123091] Updated weights for policy 0, policy_version 460903 (0.0010) [2023-12-26 03:16:01,533][123090] Updated weights for policy 1, policy_version 458025 (0.0010) [2023-12-26 03:16:01,594][123090] Updated weights for policy 1, policy_version 458035 (0.0009) [2023-12-26 03:16:01,640][123091] Updated weights for policy 0, policy_version 460913 (0.0011) [2023-12-26 03:16:01,665][123090] Updated weights for policy 1, policy_version 458045 (0.0009) [2023-12-26 03:16:01,702][123091] Updated weights for policy 0, policy_version 460923 (0.0010) [2023-12-26 03:16:01,769][123091] Updated weights for policy 0, policy_version 460933 (0.0010) [2023-12-26 03:16:01,832][123091] Updated weights for policy 0, policy_version 460943 (0.0008) [2023-12-26 03:16:02,555][123090] Updated weights for policy 1, policy_version 458055 (0.0008) [2023-12-26 03:16:02,580][123091] Updated weights for policy 0, policy_version 460953 (0.0007) [2023-12-26 03:16:02,618][123090] Updated weights for policy 1, policy_version 458065 (0.0008) [2023-12-26 03:16:02,633][123091] Updated weights for policy 0, policy_version 460963 (0.0007) [2023-12-26 03:16:02,682][123090] Updated weights for policy 1, policy_version 458075 (0.0009) [2023-12-26 03:16:02,698][123091] Updated weights for policy 0, policy_version 460973 (0.0006) [2023-12-26 03:16:03,425][123091] Updated weights for policy 0, policy_version 460983 (0.0006) [2023-12-26 03:16:03,433][123090] Updated weights for policy 1, policy_version 458085 (0.0007) [2023-12-26 03:16:03,476][123091] Updated weights for policy 0, policy_version 460993 (0.0007) [2023-12-26 03:16:03,501][123090] Updated weights for policy 1, policy_version 458095 (0.0007) [2023-12-26 03:16:03,527][123091] Updated weights for policy 0, policy_version 461003 (0.0008) [2023-12-26 03:16:03,565][123090] Updated weights for policy 1, policy_version 458105 (0.0009) [2023-12-26 03:16:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 235298816. Throughput: 0: 8616.6, 1: 8954.6. Samples: 235305508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:03,785][121949] Avg episode reward: [(0, '6052.786'), (1, '5935.585')] [2023-12-26 03:16:04,323][123091] Updated weights for policy 0, policy_version 461013 (0.0008) [2023-12-26 03:16:04,388][123091] Updated weights for policy 0, policy_version 461023 (0.0008) [2023-12-26 03:16:04,448][123091] Updated weights for policy 0, policy_version 461033 (0.0008) [2023-12-26 03:16:04,451][123090] Updated weights for policy 1, policy_version 458115 (0.0009) [2023-12-26 03:16:04,517][123090] Updated weights for policy 1, policy_version 458125 (0.0009) [2023-12-26 03:16:04,578][123090] Updated weights for policy 1, policy_version 458135 (0.0009) [2023-12-26 03:16:05,247][123091] Updated weights for policy 0, policy_version 461043 (0.0009) [2023-12-26 03:16:05,304][123091] Updated weights for policy 0, policy_version 461053 (0.0011) [2023-12-26 03:16:05,367][123091] Updated weights for policy 0, policy_version 461063 (0.0011) [2023-12-26 03:16:05,417][123090] Updated weights for policy 1, policy_version 458145 (0.0009) [2023-12-26 03:16:05,478][123090] Updated weights for policy 1, policy_version 458155 (0.0009) [2023-12-26 03:16:05,539][123090] Updated weights for policy 1, policy_version 458165 (0.0009) [2023-12-26 03:16:05,593][123090] Updated weights for policy 1, policy_version 458175 (0.0009) [2023-12-26 03:16:06,216][123091] Updated weights for policy 0, policy_version 461073 (0.0011) [2023-12-26 03:16:06,272][123091] Updated weights for policy 0, policy_version 461083 (0.0010) [2023-12-26 03:16:06,326][123091] Updated weights for policy 0, policy_version 461093 (0.0010) [2023-12-26 03:16:06,380][123091] Updated weights for policy 0, policy_version 461103 (0.0008) [2023-12-26 03:16:06,402][123090] Updated weights for policy 1, policy_version 458185 (0.0008) [2023-12-26 03:16:06,467][123090] Updated weights for policy 1, policy_version 458195 (0.0006) [2023-12-26 03:16:06,517][123090] Updated weights for policy 1, policy_version 458205 (0.0006) [2023-12-26 03:16:07,180][123091] Updated weights for policy 0, policy_version 461113 (0.0010) [2023-12-26 03:16:07,251][123091] Updated weights for policy 0, policy_version 461123 (0.0008) [2023-12-26 03:16:07,307][123091] Updated weights for policy 0, policy_version 461133 (0.0007) [2023-12-26 03:16:07,356][123090] Updated weights for policy 1, policy_version 458215 (0.0009) [2023-12-26 03:16:07,415][123090] Updated weights for policy 1, policy_version 458225 (0.0010) [2023-12-26 03:16:07,469][123090] Updated weights for policy 1, policy_version 458235 (0.0009) [2023-12-26 03:16:08,043][123091] Updated weights for policy 0, policy_version 461143 (0.0009) [2023-12-26 03:16:08,094][123091] Updated weights for policy 0, policy_version 461153 (0.0010) [2023-12-26 03:16:08,161][123091] Updated weights for policy 0, policy_version 461163 (0.0010) [2023-12-26 03:16:08,367][123090] Updated weights for policy 1, policy_version 458245 (0.0008) [2023-12-26 03:16:08,422][123090] Updated weights for policy 1, policy_version 458255 (0.0006) [2023-12-26 03:16:08,488][123090] Updated weights for policy 1, policy_version 458265 (0.0007) [2023-12-26 03:16:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 235380736. Throughput: 0: 8638.6, 1: 8913.5. Samples: 235356548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:08,785][121949] Avg episode reward: [(0, '6205.807'), (1, '5898.645')] [2023-12-26 03:16:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000458272_117317632.pth... [2023-12-26 03:16:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000461168_118063104.pth... [2023-12-26 03:16:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000457248_117055488.pth [2023-12-26 03:16:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000460176_117809152.pth [2023-12-26 03:16:08,980][123091] Updated weights for policy 0, policy_version 461173 (0.0008) [2023-12-26 03:16:09,048][123091] Updated weights for policy 0, policy_version 461183 (0.0005) [2023-12-26 03:16:09,116][123091] Updated weights for policy 0, policy_version 461193 (0.0008) [2023-12-26 03:16:09,299][123090] Updated weights for policy 1, policy_version 458275 (0.0009) [2023-12-26 03:16:09,380][123090] Updated weights for policy 1, policy_version 458285 (0.0009) [2023-12-26 03:16:09,451][123090] Updated weights for policy 1, policy_version 458295 (0.0009) [2023-12-26 03:16:09,885][123091] Updated weights for policy 0, policy_version 461203 (0.0009) [2023-12-26 03:16:09,965][123091] Updated weights for policy 0, policy_version 461213 (0.0011) [2023-12-26 03:16:10,038][123091] Updated weights for policy 0, policy_version 461223 (0.0011) [2023-12-26 03:16:10,307][123090] Updated weights for policy 1, policy_version 458305 (0.0008) [2023-12-26 03:16:10,379][123090] Updated weights for policy 1, policy_version 458315 (0.0010) [2023-12-26 03:16:10,447][123090] Updated weights for policy 1, policy_version 458325 (0.0008) [2023-12-26 03:16:10,528][123090] Updated weights for policy 1, policy_version 458335 (0.0007) [2023-12-26 03:16:10,789][123091] Updated weights for policy 0, policy_version 461233 (0.0010) [2023-12-26 03:16:10,841][123091] Updated weights for policy 0, policy_version 461243 (0.0011) [2023-12-26 03:16:10,889][123091] Updated weights for policy 0, policy_version 461253 (0.0010) [2023-12-26 03:16:10,940][123091] Updated weights for policy 0, policy_version 461263 (0.0010) [2023-12-26 03:16:11,359][123090] Updated weights for policy 1, policy_version 458345 (0.0010) [2023-12-26 03:16:11,427][123090] Updated weights for policy 1, policy_version 458355 (0.0010) [2023-12-26 03:16:11,494][123090] Updated weights for policy 1, policy_version 458365 (0.0009) [2023-12-26 03:16:11,814][123091] Updated weights for policy 0, policy_version 461273 (0.0008) [2023-12-26 03:16:11,880][123091] Updated weights for policy 0, policy_version 461283 (0.0009) [2023-12-26 03:16:11,956][123091] Updated weights for policy 0, policy_version 461293 (0.0006) [2023-12-26 03:16:12,306][123090] Updated weights for policy 1, policy_version 458375 (0.0009) [2023-12-26 03:16:12,376][123090] Updated weights for policy 1, policy_version 458385 (0.0009) [2023-12-26 03:16:12,447][123090] Updated weights for policy 1, policy_version 458395 (0.0010) [2023-12-26 03:16:12,805][123091] Updated weights for policy 0, policy_version 461303 (0.0010) [2023-12-26 03:16:12,866][123091] Updated weights for policy 0, policy_version 461313 (0.0008) [2023-12-26 03:16:12,921][123091] Updated weights for policy 0, policy_version 461323 (0.0009) [2023-12-26 03:16:13,211][123090] Updated weights for policy 1, policy_version 458405 (0.0010) [2023-12-26 03:16:13,279][123090] Updated weights for policy 1, policy_version 458415 (0.0006) [2023-12-26 03:16:13,327][123090] Updated weights for policy 1, policy_version 458425 (0.0005) [2023-12-26 03:16:13,713][123091] Updated weights for policy 0, policy_version 461333 (0.0007) [2023-12-26 03:16:13,760][123091] Updated weights for policy 0, policy_version 461343 (0.0006) [2023-12-26 03:16:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 235462656. Throughput: 0: 8663.5, 1: 8798.0. Samples: 235459684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:13,784][121949] Avg episode reward: [(0, '6219.070'), (1, '5921.792')] [2023-12-26 03:16:13,804][123091] Updated weights for policy 0, policy_version 461353 (0.0005) [2023-12-26 03:16:14,095][123090] Updated weights for policy 1, policy_version 458435 (0.0007) [2023-12-26 03:16:14,162][123090] Updated weights for policy 1, policy_version 458445 (0.0008) [2023-12-26 03:16:14,219][123090] Updated weights for policy 1, policy_version 458455 (0.0009) [2023-12-26 03:16:14,486][123091] Updated weights for policy 0, policy_version 461363 (0.0006) [2023-12-26 03:16:14,548][123091] Updated weights for policy 0, policy_version 461373 (0.0005) [2023-12-26 03:16:14,603][123091] Updated weights for policy 0, policy_version 461383 (0.0005) [2023-12-26 03:16:14,930][123090] Updated weights for policy 1, policy_version 458465 (0.0009) [2023-12-26 03:16:14,996][123090] Updated weights for policy 1, policy_version 458475 (0.0006) [2023-12-26 03:16:15,052][123090] Updated weights for policy 1, policy_version 458485 (0.0008) [2023-12-26 03:16:15,110][123090] Updated weights for policy 1, policy_version 458495 (0.0009) [2023-12-26 03:16:15,351][123091] Updated weights for policy 0, policy_version 461393 (0.0006) [2023-12-26 03:16:15,412][123091] Updated weights for policy 0, policy_version 461403 (0.0011) [2023-12-26 03:16:15,460][123091] Updated weights for policy 0, policy_version 461413 (0.0010) [2023-12-26 03:16:15,512][123091] Updated weights for policy 0, policy_version 461423 (0.0010) [2023-12-26 03:16:15,938][123090] Updated weights for policy 1, policy_version 458505 (0.0009) [2023-12-26 03:16:15,986][123090] Updated weights for policy 1, policy_version 458515 (0.0009) [2023-12-26 03:16:16,034][123090] Updated weights for policy 1, policy_version 458525 (0.0008) [2023-12-26 03:16:16,337][123091] Updated weights for policy 0, policy_version 461433 (0.0010) [2023-12-26 03:16:16,407][123091] Updated weights for policy 0, policy_version 461443 (0.0011) [2023-12-26 03:16:16,461][123091] Updated weights for policy 0, policy_version 461453 (0.0010) [2023-12-26 03:16:16,897][123090] Updated weights for policy 1, policy_version 458535 (0.0010) [2023-12-26 03:16:16,948][123090] Updated weights for policy 1, policy_version 458545 (0.0010) [2023-12-26 03:16:17,003][123090] Updated weights for policy 1, policy_version 458555 (0.0010) [2023-12-26 03:16:17,196][123091] Updated weights for policy 0, policy_version 461463 (0.0007) [2023-12-26 03:16:17,255][123091] Updated weights for policy 0, policy_version 461473 (0.0010) [2023-12-26 03:16:17,303][123091] Updated weights for policy 0, policy_version 461483 (0.0011) [2023-12-26 03:16:17,746][123090] Updated weights for policy 1, policy_version 458565 (0.0008) [2023-12-26 03:16:17,793][123090] Updated weights for policy 1, policy_version 458575 (0.0005) [2023-12-26 03:16:17,837][123090] Updated weights for policy 1, policy_version 458585 (0.0005) [2023-12-26 03:16:18,048][123091] Updated weights for policy 0, policy_version 461493 (0.0008) [2023-12-26 03:16:18,101][123091] Updated weights for policy 0, policy_version 461503 (0.0005) [2023-12-26 03:16:18,154][123091] Updated weights for policy 0, policy_version 461513 (0.0006) [2023-12-26 03:16:18,635][123090] Updated weights for policy 1, policy_version 458595 (0.0006) [2023-12-26 03:16:18,687][123090] Updated weights for policy 1, policy_version 458605 (0.0008) [2023-12-26 03:16:18,744][123090] Updated weights for policy 1, policy_version 458615 (0.0010) [2023-12-26 03:16:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 235552768. Throughput: 0: 8751.7, 1: 8766.7. Samples: 235569628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:18,784][121949] Avg episode reward: [(0, '6204.784'), (1, '5791.157')] [2023-12-26 03:16:18,938][123091] Updated weights for policy 0, policy_version 461523 (0.0009) [2023-12-26 03:16:18,993][123091] Updated weights for policy 0, policy_version 461533 (0.0005) [2023-12-26 03:16:19,039][123091] Updated weights for policy 0, policy_version 461543 (0.0005) [2023-12-26 03:16:19,674][123090] Updated weights for policy 1, policy_version 458625 (0.0010) [2023-12-26 03:16:19,741][123090] Updated weights for policy 1, policy_version 458635 (0.0009) [2023-12-26 03:16:19,789][123091] Updated weights for policy 0, policy_version 461553 (0.0006) [2023-12-26 03:16:19,808][123090] Updated weights for policy 1, policy_version 458645 (0.0009) [2023-12-26 03:16:19,858][123091] Updated weights for policy 0, policy_version 461563 (0.0008) [2023-12-26 03:16:19,876][123090] Updated weights for policy 1, policy_version 458655 (0.0008) [2023-12-26 03:16:19,928][123091] Updated weights for policy 0, policy_version 461573 (0.0008) [2023-12-26 03:16:19,994][123091] Updated weights for policy 0, policy_version 461583 (0.0008) [2023-12-26 03:16:20,740][123090] Updated weights for policy 1, policy_version 458665 (0.0006) [2023-12-26 03:16:20,766][123091] Updated weights for policy 0, policy_version 461593 (0.0009) [2023-12-26 03:16:20,808][123090] Updated weights for policy 1, policy_version 458675 (0.0008) [2023-12-26 03:16:20,837][123091] Updated weights for policy 0, policy_version 461603 (0.0009) [2023-12-26 03:16:20,872][123090] Updated weights for policy 1, policy_version 458685 (0.0009) [2023-12-26 03:16:20,908][123091] Updated weights for policy 0, policy_version 461613 (0.0009) [2023-12-26 03:16:21,669][123090] Updated weights for policy 1, policy_version 458695 (0.0008) [2023-12-26 03:16:21,737][123090] Updated weights for policy 1, policy_version 458705 (0.0010) [2023-12-26 03:16:21,749][123091] Updated weights for policy 0, policy_version 461623 (0.0008) [2023-12-26 03:16:21,792][123090] Updated weights for policy 1, policy_version 458715 (0.0010) [2023-12-26 03:16:21,807][123091] Updated weights for policy 0, policy_version 461633 (0.0008) [2023-12-26 03:16:21,873][123091] Updated weights for policy 0, policy_version 461643 (0.0008) [2023-12-26 03:16:22,609][123090] Updated weights for policy 1, policy_version 458725 (0.0007) [2023-12-26 03:16:22,669][123090] Updated weights for policy 1, policy_version 458735 (0.0008) [2023-12-26 03:16:22,693][123091] Updated weights for policy 0, policy_version 461653 (0.0010) [2023-12-26 03:16:22,732][123090] Updated weights for policy 1, policy_version 458745 (0.0009) [2023-12-26 03:16:22,756][123091] Updated weights for policy 0, policy_version 461663 (0.0011) [2023-12-26 03:16:22,819][123091] Updated weights for policy 0, policy_version 461673 (0.0011) [2023-12-26 03:16:23,473][123090] Updated weights for policy 1, policy_version 458755 (0.0009) [2023-12-26 03:16:23,505][123091] Updated weights for policy 0, policy_version 461683 (0.0008) [2023-12-26 03:16:23,537][123090] Updated weights for policy 1, policy_version 458765 (0.0005) [2023-12-26 03:16:23,561][123091] Updated weights for policy 0, policy_version 461693 (0.0010) [2023-12-26 03:16:23,584][123090] Updated weights for policy 1, policy_version 458775 (0.0005) [2023-12-26 03:16:23,612][123091] Updated weights for policy 0, policy_version 461703 (0.0010) [2023-12-26 03:16:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 235651072. Throughput: 0: 8727.3, 1: 8678.2. Samples: 235620460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:23,785][121949] Avg episode reward: [(0, '6170.641'), (1, '5741.045')] [2023-12-26 03:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000461712_118202368.pth... [2023-12-26 03:16:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000458784_117448704.pth... [2023-12-26 03:16:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000460688_117940224.pth [2023-12-26 03:16:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000457760_117186560.pth [2023-12-26 03:16:24,358][123090] Updated weights for policy 1, policy_version 458785 (0.0006) [2023-12-26 03:16:24,390][123091] Updated weights for policy 0, policy_version 461713 (0.0010) [2023-12-26 03:16:24,414][123090] Updated weights for policy 1, policy_version 458795 (0.0010) [2023-12-26 03:16:24,452][123091] Updated weights for policy 0, policy_version 461723 (0.0011) [2023-12-26 03:16:24,461][123090] Updated weights for policy 1, policy_version 458805 (0.0010) [2023-12-26 03:16:24,513][123090] Updated weights for policy 1, policy_version 458815 (0.0010) [2023-12-26 03:16:24,514][123091] Updated weights for policy 0, policy_version 461733 (0.0011) [2023-12-26 03:16:24,577][123091] Updated weights for policy 0, policy_version 461743 (0.0010) [2023-12-26 03:16:25,267][123091] Updated weights for policy 0, policy_version 461753 (0.0009) [2023-12-26 03:16:25,332][123090] Updated weights for policy 1, policy_version 458825 (0.0007) [2023-12-26 03:16:25,334][123091] Updated weights for policy 0, policy_version 461763 (0.0009) [2023-12-26 03:16:25,397][123090] Updated weights for policy 1, policy_version 458835 (0.0008) [2023-12-26 03:16:25,397][123091] Updated weights for policy 0, policy_version 461773 (0.0009) [2023-12-26 03:16:25,463][123090] Updated weights for policy 1, policy_version 458845 (0.0010) [2023-12-26 03:16:26,221][123090] Updated weights for policy 1, policy_version 458855 (0.0009) [2023-12-26 03:16:26,236][123091] Updated weights for policy 0, policy_version 461783 (0.0008) [2023-12-26 03:16:26,274][123090] Updated weights for policy 1, policy_version 458865 (0.0008) [2023-12-26 03:16:26,294][123091] Updated weights for policy 0, policy_version 461793 (0.0008) [2023-12-26 03:16:26,335][123090] Updated weights for policy 1, policy_version 458875 (0.0006) [2023-12-26 03:16:26,357][123091] Updated weights for policy 0, policy_version 461803 (0.0009) [2023-12-26 03:16:27,030][123090] Updated weights for policy 1, policy_version 458885 (0.0005) [2023-12-26 03:16:27,084][123090] Updated weights for policy 1, policy_version 458895 (0.0005) [2023-12-26 03:16:27,148][123090] Updated weights for policy 1, policy_version 458905 (0.0005) [2023-12-26 03:16:27,299][123091] Updated weights for policy 0, policy_version 461813 (0.0011) [2023-12-26 03:16:27,369][123091] Updated weights for policy 0, policy_version 461823 (0.0006) [2023-12-26 03:16:27,431][123091] Updated weights for policy 0, policy_version 461833 (0.0005) [2023-12-26 03:16:27,828][123090] Updated weights for policy 1, policy_version 458915 (0.0007) [2023-12-26 03:16:27,885][123090] Updated weights for policy 1, policy_version 458925 (0.0010) [2023-12-26 03:16:27,932][123090] Updated weights for policy 1, policy_version 458935 (0.0010) [2023-12-26 03:16:28,087][123091] Updated weights for policy 0, policy_version 461843 (0.0006) [2023-12-26 03:16:28,139][123091] Updated weights for policy 0, policy_version 461854 (0.0010) [2023-12-26 03:16:28,193][123091] Updated weights for policy 0, policy_version 461865 (0.0010) [2023-12-26 03:16:28,613][123090] Updated weights for policy 1, policy_version 458945 (0.0007) [2023-12-26 03:16:28,679][123090] Updated weights for policy 1, policy_version 458955 (0.0010) [2023-12-26 03:16:28,752][123090] Updated weights for policy 1, policy_version 458965 (0.0010) [2023-12-26 03:16:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 235732992. Throughput: 0: 8809.5, 1: 8745.4. Samples: 235729744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:28,785][121949] Avg episode reward: [(0, '6173.968'), (1, '5854.386')] [2023-12-26 03:16:28,826][123090] Updated weights for policy 1, policy_version 458975 (0.0010) [2023-12-26 03:16:28,928][123091] Updated weights for policy 0, policy_version 461875 (0.0008) [2023-12-26 03:16:28,984][123091] Updated weights for policy 0, policy_version 461885 (0.0007) [2023-12-26 03:16:29,046][123091] Updated weights for policy 0, policy_version 461895 (0.0006) [2023-12-26 03:16:29,578][123090] Updated weights for policy 1, policy_version 458985 (0.0009) [2023-12-26 03:16:29,643][123090] Updated weights for policy 1, policy_version 458995 (0.0009) [2023-12-26 03:16:29,711][123090] Updated weights for policy 1, policy_version 459005 (0.0008) [2023-12-26 03:16:29,852][123091] Updated weights for policy 0, policy_version 461905 (0.0007) [2023-12-26 03:16:29,926][123091] Updated weights for policy 0, policy_version 461915 (0.0011) [2023-12-26 03:16:29,982][123091] Updated weights for policy 0, policy_version 461925 (0.0010) [2023-12-26 03:16:30,038][123091] Updated weights for policy 0, policy_version 461935 (0.0011) [2023-12-26 03:16:30,509][123090] Updated weights for policy 1, policy_version 459015 (0.0008) [2023-12-26 03:16:30,570][123090] Updated weights for policy 1, policy_version 459025 (0.0008) [2023-12-26 03:16:30,619][123090] Updated weights for policy 1, policy_version 459035 (0.0009) [2023-12-26 03:16:30,847][123091] Updated weights for policy 0, policy_version 461945 (0.0010) [2023-12-26 03:16:30,908][123091] Updated weights for policy 0, policy_version 461955 (0.0010) [2023-12-26 03:16:30,966][123091] Updated weights for policy 0, policy_version 461965 (0.0008) [2023-12-26 03:16:31,472][123090] Updated weights for policy 1, policy_version 459045 (0.0007) [2023-12-26 03:16:31,534][123090] Updated weights for policy 1, policy_version 459055 (0.0005) [2023-12-26 03:16:31,596][123090] Updated weights for policy 1, policy_version 459065 (0.0005) [2023-12-26 03:16:31,806][123091] Updated weights for policy 0, policy_version 461975 (0.0008) [2023-12-26 03:16:31,857][123091] Updated weights for policy 0, policy_version 461985 (0.0010) [2023-12-26 03:16:31,904][123091] Updated weights for policy 0, policy_version 461995 (0.0009) [2023-12-26 03:16:32,317][123090] Updated weights for policy 1, policy_version 459075 (0.0007) [2023-12-26 03:16:32,381][123090] Updated weights for policy 1, policy_version 459085 (0.0009) [2023-12-26 03:16:32,452][123090] Updated weights for policy 1, policy_version 459095 (0.0009) [2023-12-26 03:16:32,811][123091] Updated weights for policy 0, policy_version 462005 (0.0010) [2023-12-26 03:16:32,866][123091] Updated weights for policy 0, policy_version 462015 (0.0009) [2023-12-26 03:16:32,922][123091] Updated weights for policy 0, policy_version 462025 (0.0009) [2023-12-26 03:16:33,272][123090] Updated weights for policy 1, policy_version 459105 (0.0009) [2023-12-26 03:16:33,343][123090] Updated weights for policy 1, policy_version 459115 (0.0005) [2023-12-26 03:16:33,409][123090] Updated weights for policy 1, policy_version 459125 (0.0005) [2023-12-26 03:16:33,463][123090] Updated weights for policy 1, policy_version 459135 (0.0005) [2023-12-26 03:16:33,711][123091] Updated weights for policy 0, policy_version 462035 (0.0009) [2023-12-26 03:16:33,758][123091] Updated weights for policy 0, policy_version 462045 (0.0009) [2023-12-26 03:16:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235823104. Throughput: 0: 8777.2, 1: 8802.2. Samples: 235837820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:33,785][121949] Avg episode reward: [(0, '6111.709'), (1, '5879.551')] [2023-12-26 03:16:33,806][123091] Updated weights for policy 0, policy_version 462055 (0.0008) [2023-12-26 03:16:34,187][123090] Updated weights for policy 1, policy_version 459145 (0.0009) [2023-12-26 03:16:34,252][123090] Updated weights for policy 1, policy_version 459155 (0.0010) [2023-12-26 03:16:34,319][123090] Updated weights for policy 1, policy_version 459165 (0.0010) [2023-12-26 03:16:34,625][123091] Updated weights for policy 0, policy_version 462065 (0.0008) [2023-12-26 03:16:34,684][123091] Updated weights for policy 0, policy_version 462075 (0.0005) [2023-12-26 03:16:34,747][123091] Updated weights for policy 0, policy_version 462085 (0.0009) [2023-12-26 03:16:34,816][123091] Updated weights for policy 0, policy_version 462095 (0.0006) [2023-12-26 03:16:35,189][123090] Updated weights for policy 1, policy_version 459175 (0.0010) [2023-12-26 03:16:35,261][123090] Updated weights for policy 1, policy_version 459185 (0.0011) [2023-12-26 03:16:35,322][123090] Updated weights for policy 1, policy_version 459195 (0.0011) [2023-12-26 03:16:35,574][123091] Updated weights for policy 0, policy_version 462105 (0.0011) [2023-12-26 03:16:35,637][123091] Updated weights for policy 0, policy_version 462115 (0.0011) [2023-12-26 03:16:35,704][123091] Updated weights for policy 0, policy_version 462125 (0.0011) [2023-12-26 03:16:36,045][123090] Updated weights for policy 1, policy_version 459205 (0.0010) [2023-12-26 03:16:36,111][123090] Updated weights for policy 1, policy_version 459215 (0.0010) [2023-12-26 03:16:36,176][123090] Updated weights for policy 1, policy_version 459225 (0.0011) [2023-12-26 03:16:36,525][123091] Updated weights for policy 0, policy_version 462135 (0.0011) [2023-12-26 03:16:36,585][123091] Updated weights for policy 0, policy_version 462145 (0.0011) [2023-12-26 03:16:36,646][123091] Updated weights for policy 0, policy_version 462155 (0.0011) [2023-12-26 03:16:36,983][123090] Updated weights for policy 1, policy_version 459235 (0.0011) [2023-12-26 03:16:37,043][123090] Updated weights for policy 1, policy_version 459245 (0.0010) [2023-12-26 03:16:37,099][123090] Updated weights for policy 1, policy_version 459255 (0.0010) [2023-12-26 03:16:37,476][123091] Updated weights for policy 0, policy_version 462165 (0.0011) [2023-12-26 03:16:37,525][123091] Updated weights for policy 0, policy_version 462175 (0.0010) [2023-12-26 03:16:37,576][123091] Updated weights for policy 0, policy_version 462185 (0.0010) [2023-12-26 03:16:37,938][123090] Updated weights for policy 1, policy_version 459265 (0.0010) [2023-12-26 03:16:38,001][123090] Updated weights for policy 1, policy_version 459275 (0.0010) [2023-12-26 03:16:38,052][123090] Updated weights for policy 1, policy_version 459285 (0.0010) [2023-12-26 03:16:38,111][123090] Updated weights for policy 1, policy_version 459295 (0.0010) [2023-12-26 03:16:38,401][123091] Updated weights for policy 0, policy_version 462195 (0.0010) [2023-12-26 03:16:38,465][123091] Updated weights for policy 0, policy_version 462205 (0.0009) [2023-12-26 03:16:38,526][123091] Updated weights for policy 0, policy_version 462215 (0.0009) [2023-12-26 03:16:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235913216. Throughput: 0: 8804.0, 1: 8807.0. Samples: 235890440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:38,785][121949] Avg episode reward: [(0, '6019.078'), (1, '5831.101')] [2023-12-26 03:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000462224_118333440.pth... [2023-12-26 03:16:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000459296_117579776.pth... [2023-12-26 03:16:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000461168_118063104.pth [2023-12-26 03:16:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000458272_117317632.pth [2023-12-26 03:16:38,931][123090] Updated weights for policy 1, policy_version 459305 (0.0010) [2023-12-26 03:16:39,005][123090] Updated weights for policy 1, policy_version 459315 (0.0010) [2023-12-26 03:16:39,060][123090] Updated weights for policy 1, policy_version 459325 (0.0010) [2023-12-26 03:16:39,251][123091] Updated weights for policy 0, policy_version 462225 (0.0009) [2023-12-26 03:16:39,314][123091] Updated weights for policy 0, policy_version 462235 (0.0008) [2023-12-26 03:16:39,385][123091] Updated weights for policy 0, policy_version 462245 (0.0009) [2023-12-26 03:16:39,453][123091] Updated weights for policy 0, policy_version 462255 (0.0009) [2023-12-26 03:16:39,877][123090] Updated weights for policy 1, policy_version 459335 (0.0011) [2023-12-26 03:16:39,941][123090] Updated weights for policy 1, policy_version 459345 (0.0010) [2023-12-26 03:16:40,018][123090] Updated weights for policy 1, policy_version 459355 (0.0011) [2023-12-26 03:16:40,227][123091] Updated weights for policy 0, policy_version 462265 (0.0011) [2023-12-26 03:16:40,295][123091] Updated weights for policy 0, policy_version 462275 (0.0011) [2023-12-26 03:16:40,362][123091] Updated weights for policy 0, policy_version 462285 (0.0011) [2023-12-26 03:16:40,757][123090] Updated weights for policy 1, policy_version 459365 (0.0008) [2023-12-26 03:16:40,818][123090] Updated weights for policy 1, policy_version 459375 (0.0007) [2023-12-26 03:16:40,871][123090] Updated weights for policy 1, policy_version 459385 (0.0009) [2023-12-26 03:16:41,109][123091] Updated weights for policy 0, policy_version 462295 (0.0011) [2023-12-26 03:16:41,183][123091] Updated weights for policy 0, policy_version 462305 (0.0008) [2023-12-26 03:16:41,248][123091] Updated weights for policy 0, policy_version 462315 (0.0010) [2023-12-26 03:16:41,668][123090] Updated weights for policy 1, policy_version 459395 (0.0010) [2023-12-26 03:16:41,742][123090] Updated weights for policy 1, policy_version 459405 (0.0009) [2023-12-26 03:16:41,811][123090] Updated weights for policy 1, policy_version 459415 (0.0011) [2023-12-26 03:16:42,130][123091] Updated weights for policy 0, policy_version 462325 (0.0009) [2023-12-26 03:16:42,196][123091] Updated weights for policy 0, policy_version 462335 (0.0009) [2023-12-26 03:16:42,269][123091] Updated weights for policy 0, policy_version 462345 (0.0009) [2023-12-26 03:16:42,641][123090] Updated weights for policy 1, policy_version 459425 (0.0011) [2023-12-26 03:16:42,709][123090] Updated weights for policy 1, policy_version 459435 (0.0009) [2023-12-26 03:16:42,773][123090] Updated weights for policy 1, policy_version 459445 (0.0006) [2023-12-26 03:16:42,837][123090] Updated weights for policy 1, policy_version 459455 (0.0009) [2023-12-26 03:16:43,089][123091] Updated weights for policy 0, policy_version 462355 (0.0010) [2023-12-26 03:16:43,143][123091] Updated weights for policy 0, policy_version 462365 (0.0010) [2023-12-26 03:16:43,195][123091] Updated weights for policy 0, policy_version 462375 (0.0009) [2023-12-26 03:16:43,630][123090] Updated weights for policy 1, policy_version 459465 (0.0010) [2023-12-26 03:16:43,681][123090] Updated weights for policy 1, policy_version 459475 (0.0007) [2023-12-26 03:16:43,735][123090] Updated weights for policy 1, policy_version 459485 (0.0005) [2023-12-26 03:16:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 236003328. Throughput: 0: 8837.4, 1: 8699.9. Samples: 235994396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:43,786][121949] Avg episode reward: [(0, '5978.355'), (1, '5710.801')] [2023-12-26 03:16:44,012][123091] Updated weights for policy 0, policy_version 462386 (0.0009) [2023-12-26 03:16:44,066][123091] Updated weights for policy 0, policy_version 462396 (0.0006) [2023-12-26 03:16:44,131][123091] Updated weights for policy 0, policy_version 462406 (0.0006) [2023-12-26 03:16:44,211][123091] Updated weights for policy 0, policy_version 462416 (0.0007) [2023-12-26 03:16:44,368][123090] Updated weights for policy 1, policy_version 459495 (0.0005) [2023-12-26 03:16:44,443][123090] Updated weights for policy 1, policy_version 459505 (0.0006) [2023-12-26 03:16:44,494][123090] Updated weights for policy 1, policy_version 459515 (0.0005) [2023-12-26 03:16:44,826][123091] Updated weights for policy 0, policy_version 462426 (0.0008) [2023-12-26 03:16:44,898][123091] Updated weights for policy 0, policy_version 462436 (0.0009) [2023-12-26 03:16:44,962][123091] Updated weights for policy 0, policy_version 462446 (0.0011) [2023-12-26 03:16:45,225][123090] Updated weights for policy 1, policy_version 459525 (0.0007) [2023-12-26 03:16:45,281][123090] Updated weights for policy 1, policy_version 459535 (0.0009) [2023-12-26 03:16:45,335][123090] Updated weights for policy 1, policy_version 459545 (0.0006) [2023-12-26 03:16:45,713][123091] Updated weights for policy 0, policy_version 462456 (0.0011) [2023-12-26 03:16:45,789][123091] Updated weights for policy 0, policy_version 462466 (0.0009) [2023-12-26 03:16:45,865][123091] Updated weights for policy 0, policy_version 462476 (0.0006) [2023-12-26 03:16:45,954][123090] Updated weights for policy 1, policy_version 459555 (0.0007) [2023-12-26 03:16:46,012][123090] Updated weights for policy 1, policy_version 459565 (0.0008) [2023-12-26 03:16:46,072][123090] Updated weights for policy 1, policy_version 459575 (0.0005) [2023-12-26 03:16:46,495][123091] Updated weights for policy 0, policy_version 462486 (0.0007) [2023-12-26 03:16:46,539][123091] Updated weights for policy 0, policy_version 462496 (0.0005) [2023-12-26 03:16:46,597][123091] Updated weights for policy 0, policy_version 462506 (0.0005) [2023-12-26 03:16:46,746][123090] Updated weights for policy 1, policy_version 459585 (0.0005) [2023-12-26 03:16:46,807][123090] Updated weights for policy 1, policy_version 459595 (0.0005) [2023-12-26 03:16:46,861][123090] Updated weights for policy 1, policy_version 459605 (0.0005) [2023-12-26 03:16:46,917][123090] Updated weights for policy 1, policy_version 459615 (0.0005) [2023-12-26 03:16:47,318][123091] Updated weights for policy 0, policy_version 462516 (0.0005) [2023-12-26 03:16:47,380][123091] Updated weights for policy 0, policy_version 462526 (0.0010) [2023-12-26 03:16:47,450][123091] Updated weights for policy 0, policy_version 462536 (0.0009) [2023-12-26 03:16:47,688][123090] Updated weights for policy 1, policy_version 459625 (0.0010) [2023-12-26 03:16:47,744][123090] Updated weights for policy 1, policy_version 459635 (0.0010) [2023-12-26 03:16:47,797][123090] Updated weights for policy 1, policy_version 459645 (0.0009) [2023-12-26 03:16:48,176][123091] Updated weights for policy 0, policy_version 462546 (0.0009) [2023-12-26 03:16:48,229][123091] Updated weights for policy 0, policy_version 462556 (0.0007) [2023-12-26 03:16:48,281][123091] Updated weights for policy 0, policy_version 462566 (0.0009) [2023-12-26 03:16:48,346][123091] Updated weights for policy 0, policy_version 462576 (0.0010) [2023-12-26 03:16:48,669][123090] Updated weights for policy 1, policy_version 459655 (0.0010) [2023-12-26 03:16:48,724][123090] Updated weights for policy 1, policy_version 459665 (0.0008) [2023-12-26 03:16:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 236093440. Throughput: 0: 8951.8, 1: 8869.6. Samples: 236107468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:16:48,784][121949] Avg episode reward: [(0, '5975.643'), (1, '5668.184')] [2023-12-26 03:16:48,793][123090] Updated weights for policy 1, policy_version 459675 (0.0009) [2023-12-26 03:16:49,192][123091] Updated weights for policy 0, policy_version 462586 (0.0009) [2023-12-26 03:16:49,254][123091] Updated weights for policy 0, policy_version 462596 (0.0009) [2023-12-26 03:16:49,317][123091] Updated weights for policy 0, policy_version 462606 (0.0009) [2023-12-26 03:16:49,636][123090] Updated weights for policy 1, policy_version 459685 (0.0010) [2023-12-26 03:16:49,702][123090] Updated weights for policy 1, policy_version 459695 (0.0010) [2023-12-26 03:16:49,760][123090] Updated weights for policy 1, policy_version 459705 (0.0009) [2023-12-26 03:16:50,157][123091] Updated weights for policy 0, policy_version 462616 (0.0010) [2023-12-26 03:16:50,210][123091] Updated weights for policy 0, policy_version 462626 (0.0009) [2023-12-26 03:16:50,261][123091] Updated weights for policy 0, policy_version 462636 (0.0010) [2023-12-26 03:16:50,573][123090] Updated weights for policy 1, policy_version 459715 (0.0010) [2023-12-26 03:16:50,635][123090] Updated weights for policy 1, policy_version 459725 (0.0009) [2023-12-26 03:16:50,707][123090] Updated weights for policy 1, policy_version 459735 (0.0010) [2023-12-26 03:16:51,136][123091] Updated weights for policy 0, policy_version 462646 (0.0009) [2023-12-26 03:16:51,208][123091] Updated weights for policy 0, policy_version 462656 (0.0010) [2023-12-26 03:16:51,270][123091] Updated weights for policy 0, policy_version 462666 (0.0009) [2023-12-26 03:16:51,541][123090] Updated weights for policy 1, policy_version 459745 (0.0009) [2023-12-26 03:16:51,594][123090] Updated weights for policy 1, policy_version 459755 (0.0006) [2023-12-26 03:16:51,660][123090] Updated weights for policy 1, policy_version 459765 (0.0010) [2023-12-26 03:16:51,727][123090] Updated weights for policy 1, policy_version 459775 (0.0009) [2023-12-26 03:16:52,052][123091] Updated weights for policy 0, policy_version 462676 (0.0009) [2023-12-26 03:16:52,106][123091] Updated weights for policy 0, policy_version 462686 (0.0009) [2023-12-26 03:16:52,155][123091] Updated weights for policy 0, policy_version 462696 (0.0009) [2023-12-26 03:16:52,587][123090] Updated weights for policy 1, policy_version 459785 (0.0009) [2023-12-26 03:16:52,648][123090] Updated weights for policy 1, policy_version 459795 (0.0009) [2023-12-26 03:16:52,707][123090] Updated weights for policy 1, policy_version 459805 (0.0010) [2023-12-26 03:16:52,959][123091] Updated weights for policy 0, policy_version 462707 (0.0008) [2023-12-26 03:16:53,016][123091] Updated weights for policy 0, policy_version 462717 (0.0006) [2023-12-26 03:16:53,066][123091] Updated weights for policy 0, policy_version 462727 (0.0005) [2023-12-26 03:16:53,453][123090] Updated weights for policy 1, policy_version 459815 (0.0009) [2023-12-26 03:16:53,502][123090] Updated weights for policy 1, policy_version 459825 (0.0008) [2023-12-26 03:16:53,557][123090] Updated weights for policy 1, policy_version 459835 (0.0009) [2023-12-26 03:16:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 236183552. Throughput: 0: 8940.2, 1: 8865.9. Samples: 236157820. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:16:53,785][121949] Avg episode reward: [(0, '5985.717'), (1, '5752.602')] [2023-12-26 03:16:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000459840_117719040.pth... [2023-12-26 03:16:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000462736_118464512.pth... [2023-12-26 03:16:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000458784_117448704.pth [2023-12-26 03:16:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000461712_118202368.pth [2023-12-26 03:16:53,824][123091] Updated weights for policy 0, policy_version 462737 (0.0006) [2023-12-26 03:16:53,879][123091] Updated weights for policy 0, policy_version 462747 (0.0011) [2023-12-26 03:16:53,930][123091] Updated weights for policy 0, policy_version 462757 (0.0010) [2023-12-26 03:16:53,974][123091] Updated weights for policy 0, policy_version 462767 (0.0010) [2023-12-26 03:16:54,430][123090] Updated weights for policy 1, policy_version 459845 (0.0009) [2023-12-26 03:16:54,487][123090] Updated weights for policy 1, policy_version 459855 (0.0008) [2023-12-26 03:16:54,535][123090] Updated weights for policy 1, policy_version 459865 (0.0008) [2023-12-26 03:16:54,758][123091] Updated weights for policy 0, policy_version 462777 (0.0006) [2023-12-26 03:16:54,806][123091] Updated weights for policy 0, policy_version 462787 (0.0005) [2023-12-26 03:16:54,858][123091] Updated weights for policy 0, policy_version 462797 (0.0006) [2023-12-26 03:16:55,247][123090] Updated weights for policy 1, policy_version 459875 (0.0006) [2023-12-26 03:16:55,295][123090] Updated weights for policy 1, policy_version 459885 (0.0008) [2023-12-26 03:16:55,349][123090] Updated weights for policy 1, policy_version 459895 (0.0010) [2023-12-26 03:16:55,632][123091] Updated weights for policy 0, policy_version 462807 (0.0005) [2023-12-26 03:16:55,691][123091] Updated weights for policy 0, policy_version 462817 (0.0005) [2023-12-26 03:16:55,750][123091] Updated weights for policy 0, policy_version 462827 (0.0011) [2023-12-26 03:16:56,271][123090] Updated weights for policy 1, policy_version 459905 (0.0009) [2023-12-26 03:16:56,338][123090] Updated weights for policy 1, policy_version 459915 (0.0009) [2023-12-26 03:16:56,404][123090] Updated weights for policy 1, policy_version 459925 (0.0010) [2023-12-26 03:16:56,431][123091] Updated weights for policy 0, policy_version 462837 (0.0008) [2023-12-26 03:16:56,459][123090] Updated weights for policy 1, policy_version 459935 (0.0010) [2023-12-26 03:16:56,489][123091] Updated weights for policy 0, policy_version 462847 (0.0006) [2023-12-26 03:16:56,550][123091] Updated weights for policy 0, policy_version 462857 (0.0005) [2023-12-26 03:16:57,217][123091] Updated weights for policy 0, policy_version 462867 (0.0005) [2023-12-26 03:16:57,246][123090] Updated weights for policy 1, policy_version 459945 (0.0007) [2023-12-26 03:16:57,278][123091] Updated weights for policy 0, policy_version 462877 (0.0005) [2023-12-26 03:16:57,327][123090] Updated weights for policy 1, policy_version 459955 (0.0006) [2023-12-26 03:16:57,352][123091] Updated weights for policy 0, policy_version 462887 (0.0008) [2023-12-26 03:16:57,387][123090] Updated weights for policy 1, policy_version 459965 (0.0009) [2023-12-26 03:16:58,068][123091] Updated weights for policy 0, policy_version 462897 (0.0006) [2023-12-26 03:16:58,129][123091] Updated weights for policy 0, policy_version 462907 (0.0011) [2023-12-26 03:16:58,176][123090] Updated weights for policy 1, policy_version 459975 (0.0007) [2023-12-26 03:16:58,185][123091] Updated weights for policy 0, policy_version 462917 (0.0011) [2023-12-26 03:16:58,239][123090] Updated weights for policy 1, policy_version 459985 (0.0006) [2023-12-26 03:16:58,245][123091] Updated weights for policy 0, policy_version 462927 (0.0010) [2023-12-26 03:16:58,306][123090] Updated weights for policy 1, policy_version 459995 (0.0008) [2023-12-26 03:16:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 236273664. Throughput: 0: 9028.1, 1: 8929.0. Samples: 236267752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:16:58,785][121949] Avg episode reward: [(0, '5996.140'), (1, '5905.653')] [2023-12-26 03:16:59,215][123091] Updated weights for policy 0, policy_version 462937 (0.0010) [2023-12-26 03:16:59,218][123090] Updated weights for policy 1, policy_version 460005 (0.0007) [2023-12-26 03:16:59,279][123091] Updated weights for policy 0, policy_version 462947 (0.0010) [2023-12-26 03:16:59,282][123090] Updated weights for policy 1, policy_version 460015 (0.0006) [2023-12-26 03:16:59,342][123091] Updated weights for policy 0, policy_version 462957 (0.0010) [2023-12-26 03:16:59,347][123090] Updated weights for policy 1, policy_version 460025 (0.0007) [2023-12-26 03:17:00,096][123091] Updated weights for policy 0, policy_version 462967 (0.0007) [2023-12-26 03:17:00,152][123091] Updated weights for policy 0, policy_version 462977 (0.0009) [2023-12-26 03:17:00,211][123091] Updated weights for policy 0, policy_version 462987 (0.0010) [2023-12-26 03:17:00,234][123090] Updated weights for policy 1, policy_version 460035 (0.0009) [2023-12-26 03:17:00,285][123090] Updated weights for policy 1, policy_version 460045 (0.0008) [2023-12-26 03:17:00,333][123090] Updated weights for policy 1, policy_version 460055 (0.0008) [2023-12-26 03:17:01,006][123091] Updated weights for policy 0, policy_version 462997 (0.0011) [2023-12-26 03:17:01,080][123091] Updated weights for policy 0, policy_version 463007 (0.0011) [2023-12-26 03:17:01,156][123091] Updated weights for policy 0, policy_version 463017 (0.0011) [2023-12-26 03:17:01,179][123090] Updated weights for policy 1, policy_version 460065 (0.0008) [2023-12-26 03:17:01,244][123090] Updated weights for policy 1, policy_version 460075 (0.0006) [2023-12-26 03:17:01,310][123090] Updated weights for policy 1, policy_version 460085 (0.0006) [2023-12-26 03:17:01,386][123090] Updated weights for policy 1, policy_version 460095 (0.0007) [2023-12-26 03:17:01,954][123091] Updated weights for policy 0, policy_version 463027 (0.0009) [2023-12-26 03:17:02,018][123091] Updated weights for policy 0, policy_version 463037 (0.0009) [2023-12-26 03:17:02,067][123091] Updated weights for policy 0, policy_version 463047 (0.0009) [2023-12-26 03:17:02,138][123090] Updated weights for policy 1, policy_version 460105 (0.0009) [2023-12-26 03:17:02,194][123090] Updated weights for policy 1, policy_version 460115 (0.0009) [2023-12-26 03:17:02,242][123090] Updated weights for policy 1, policy_version 460125 (0.0009) [2023-12-26 03:17:02,879][123091] Updated weights for policy 0, policy_version 463057 (0.0010) [2023-12-26 03:17:02,930][123091] Updated weights for policy 0, policy_version 463067 (0.0010) [2023-12-26 03:17:02,985][123091] Updated weights for policy 0, policy_version 463077 (0.0006) [2023-12-26 03:17:03,040][123091] Updated weights for policy 0, policy_version 463087 (0.0005) [2023-12-26 03:17:03,122][123090] Updated weights for policy 1, policy_version 460135 (0.0010) [2023-12-26 03:17:03,176][123090] Updated weights for policy 1, policy_version 460145 (0.0010) [2023-12-26 03:17:03,234][123090] Updated weights for policy 1, policy_version 460156 (0.0010) [2023-12-26 03:17:03,724][123091] Updated weights for policy 0, policy_version 463097 (0.0005) [2023-12-26 03:17:03,777][123091] Updated weights for policy 0, policy_version 463107 (0.0005) [2023-12-26 03:17:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 236355584. Throughput: 0: 8975.0, 1: 8820.9. Samples: 236370444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:03,784][121949] Avg episode reward: [(0, '6100.656'), (1, '5904.306')] [2023-12-26 03:17:03,829][123091] Updated weights for policy 0, policy_version 463117 (0.0005) [2023-12-26 03:17:04,192][123090] Updated weights for policy 1, policy_version 460166 (0.0009) [2023-12-26 03:17:04,257][123090] Updated weights for policy 1, policy_version 460176 (0.0007) [2023-12-26 03:17:04,311][123090] Updated weights for policy 1, policy_version 460186 (0.0006) [2023-12-26 03:17:04,615][123091] Updated weights for policy 0, policy_version 463127 (0.0010) [2023-12-26 03:17:04,673][123091] Updated weights for policy 0, policy_version 463138 (0.0008) [2023-12-26 03:17:04,727][123091] Updated weights for policy 0, policy_version 463148 (0.0009) [2023-12-26 03:17:05,091][123090] Updated weights for policy 1, policy_version 460196 (0.0007) [2023-12-26 03:17:05,138][123090] Updated weights for policy 1, policy_version 460206 (0.0008) [2023-12-26 03:17:05,199][123090] Updated weights for policy 1, policy_version 460216 (0.0010) [2023-12-26 03:17:05,514][123091] Updated weights for policy 0, policy_version 463158 (0.0009) [2023-12-26 03:17:05,581][123091] Updated weights for policy 0, policy_version 463168 (0.0008) [2023-12-26 03:17:05,645][123091] Updated weights for policy 0, policy_version 463178 (0.0007) [2023-12-26 03:17:06,071][123090] Updated weights for policy 1, policy_version 460226 (0.0009) [2023-12-26 03:17:06,140][123090] Updated weights for policy 1, policy_version 460236 (0.0009) [2023-12-26 03:17:06,203][123090] Updated weights for policy 1, policy_version 460246 (0.0006) [2023-12-26 03:17:06,266][123090] Updated weights for policy 1, policy_version 460256 (0.0006) [2023-12-26 03:17:06,446][123091] Updated weights for policy 0, policy_version 463188 (0.0007) [2023-12-26 03:17:06,515][123091] Updated weights for policy 0, policy_version 463198 (0.0010) [2023-12-26 03:17:06,574][123091] Updated weights for policy 0, policy_version 463208 (0.0010) [2023-12-26 03:17:07,005][123090] Updated weights for policy 1, policy_version 460266 (0.0008) [2023-12-26 03:17:07,052][123090] Updated weights for policy 1, policy_version 460276 (0.0005) [2023-12-26 03:17:07,099][123090] Updated weights for policy 1, policy_version 460286 (0.0005) [2023-12-26 03:17:07,395][123091] Updated weights for policy 0, policy_version 463218 (0.0008) [2023-12-26 03:17:07,456][123091] Updated weights for policy 0, policy_version 463228 (0.0006) [2023-12-26 03:17:07,507][123091] Updated weights for policy 0, policy_version 463238 (0.0006) [2023-12-26 03:17:07,562][123091] Updated weights for policy 0, policy_version 463248 (0.0005) [2023-12-26 03:17:07,838][123090] Updated weights for policy 1, policy_version 460296 (0.0009) [2023-12-26 03:17:07,901][123090] Updated weights for policy 1, policy_version 460306 (0.0010) [2023-12-26 03:17:07,961][123090] Updated weights for policy 1, policy_version 460316 (0.0010) [2023-12-26 03:17:08,236][123091] Updated weights for policy 0, policy_version 463258 (0.0011) [2023-12-26 03:17:08,280][123091] Updated weights for policy 0, policy_version 463268 (0.0010) [2023-12-26 03:17:08,328][123091] Updated weights for policy 0, policy_version 463278 (0.0010) [2023-12-26 03:17:08,762][123090] Updated weights for policy 1, policy_version 460327 (0.0008) [2023-12-26 03:17:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 236445696. Throughput: 0: 8964.3, 1: 8853.4. Samples: 236422256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:08,785][121949] Avg episode reward: [(0, '6095.917'), (1, '5930.453')] [2023-12-26 03:17:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000463280_118603776.pth... [2023-12-26 03:17:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000462224_118333440.pth [2023-12-26 03:17:08,824][123090] Updated weights for policy 1, policy_version 460337 (0.0007) [2023-12-26 03:17:08,876][123090] Updated weights for policy 1, policy_version 460347 (0.0009) [2023-12-26 03:17:08,898][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000460352_117850112.pth... [2023-12-26 03:17:08,901][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000459296_117579776.pth [2023-12-26 03:17:09,186][123091] Updated weights for policy 0, policy_version 463288 (0.0011) [2023-12-26 03:17:09,257][123091] Updated weights for policy 0, policy_version 463298 (0.0011) [2023-12-26 03:17:09,316][123091] Updated weights for policy 0, policy_version 463308 (0.0010) [2023-12-26 03:17:09,701][123090] Updated weights for policy 1, policy_version 460357 (0.0008) [2023-12-26 03:17:09,755][123090] Updated weights for policy 1, policy_version 460367 (0.0009) [2023-12-26 03:17:09,817][123090] Updated weights for policy 1, policy_version 460377 (0.0009) [2023-12-26 03:17:10,103][123091] Updated weights for policy 0, policy_version 463318 (0.0008) [2023-12-26 03:17:10,173][123091] Updated weights for policy 0, policy_version 463328 (0.0007) [2023-12-26 03:17:10,240][123091] Updated weights for policy 0, policy_version 463338 (0.0011) [2023-12-26 03:17:10,603][123090] Updated weights for policy 1, policy_version 460387 (0.0009) [2023-12-26 03:17:10,666][123090] Updated weights for policy 1, policy_version 460397 (0.0010) [2023-12-26 03:17:10,723][123090] Updated weights for policy 1, policy_version 460407 (0.0009) [2023-12-26 03:17:10,991][123091] Updated weights for policy 0, policy_version 463348 (0.0011) [2023-12-26 03:17:11,048][123091] Updated weights for policy 0, policy_version 463358 (0.0010) [2023-12-26 03:17:11,123][123091] Updated weights for policy 0, policy_version 463368 (0.0011) [2023-12-26 03:17:11,610][123090] Updated weights for policy 1, policy_version 460417 (0.0010) [2023-12-26 03:17:11,679][123090] Updated weights for policy 1, policy_version 460427 (0.0009) [2023-12-26 03:17:11,763][123090] Updated weights for policy 1, policy_version 460437 (0.0008) [2023-12-26 03:17:11,835][123090] Updated weights for policy 1, policy_version 460447 (0.0006) [2023-12-26 03:17:11,964][123091] Updated weights for policy 0, policy_version 463378 (0.0011) [2023-12-26 03:17:12,022][123091] Updated weights for policy 0, policy_version 463388 (0.0011) [2023-12-26 03:17:12,073][123091] Updated weights for policy 0, policy_version 463398 (0.0011) [2023-12-26 03:17:12,148][123091] Updated weights for policy 0, policy_version 463408 (0.0011) [2023-12-26 03:17:12,628][123090] Updated weights for policy 1, policy_version 460457 (0.0009) [2023-12-26 03:17:12,684][123090] Updated weights for policy 1, policy_version 460467 (0.0009) [2023-12-26 03:17:12,752][123090] Updated weights for policy 1, policy_version 460477 (0.0009) [2023-12-26 03:17:12,889][123091] Updated weights for policy 0, policy_version 463418 (0.0011) [2023-12-26 03:17:12,945][123091] Updated weights for policy 0, policy_version 463428 (0.0011) [2023-12-26 03:17:12,990][123091] Updated weights for policy 0, policy_version 463438 (0.0008) [2023-12-26 03:17:13,673][123091] Updated weights for policy 0, policy_version 463448 (0.0010) [2023-12-26 03:17:13,697][123090] Updated weights for policy 1, policy_version 460487 (0.0006) [2023-12-26 03:17:13,721][123091] Updated weights for policy 0, policy_version 463458 (0.0011) [2023-12-26 03:17:13,755][123090] Updated weights for policy 1, policy_version 460497 (0.0009) [2023-12-26 03:17:13,781][123091] Updated weights for policy 0, policy_version 463468 (0.0011) [2023-12-26 03:17:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 236527616. Throughput: 0: 8971.9, 1: 8797.0. Samples: 236529344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:13,785][121949] Avg episode reward: [(0, '6114.665'), (1, '5895.475')] [2023-12-26 03:17:13,822][123090] Updated weights for policy 1, policy_version 460507 (0.0009) [2023-12-26 03:17:14,589][123090] Updated weights for policy 1, policy_version 460517 (0.0007) [2023-12-26 03:17:14,624][123091] Updated weights for policy 0, policy_version 463478 (0.0011) [2023-12-26 03:17:14,644][123090] Updated weights for policy 1, policy_version 460527 (0.0006) [2023-12-26 03:17:14,679][123091] Updated weights for policy 0, policy_version 463488 (0.0011) [2023-12-26 03:17:14,708][123090] Updated weights for policy 1, policy_version 460537 (0.0006) [2023-12-26 03:17:14,732][123091] Updated weights for policy 0, policy_version 463498 (0.0010) [2023-12-26 03:17:15,455][123090] Updated weights for policy 1, policy_version 460547 (0.0008) [2023-12-26 03:17:15,521][123090] Updated weights for policy 1, policy_version 460557 (0.0009) [2023-12-26 03:17:15,573][123090] Updated weights for policy 1, policy_version 460567 (0.0009) [2023-12-26 03:17:15,579][123091] Updated weights for policy 0, policy_version 463508 (0.0009) [2023-12-26 03:17:15,652][123091] Updated weights for policy 0, policy_version 463518 (0.0006) [2023-12-26 03:17:15,731][123091] Updated weights for policy 0, policy_version 463528 (0.0006) [2023-12-26 03:17:16,373][123091] Updated weights for policy 0, policy_version 463538 (0.0005) [2023-12-26 03:17:16,418][123091] Updated weights for policy 0, policy_version 463548 (0.0010) [2023-12-26 03:17:16,421][123090] Updated weights for policy 1, policy_version 460577 (0.0007) [2023-12-26 03:17:16,465][123091] Updated weights for policy 0, policy_version 463558 (0.0010) [2023-12-26 03:17:16,468][123090] Updated weights for policy 1, policy_version 460587 (0.0005) [2023-12-26 03:17:16,514][123090] Updated weights for policy 1, policy_version 460597 (0.0007) [2023-12-26 03:17:16,516][123091] Updated weights for policy 0, policy_version 463568 (0.0010) [2023-12-26 03:17:16,566][123090] Updated weights for policy 1, policy_version 460607 (0.0010) [2023-12-26 03:17:17,293][123091] Updated weights for policy 0, policy_version 463578 (0.0005) [2023-12-26 03:17:17,314][123090] Updated weights for policy 1, policy_version 460617 (0.0006) [2023-12-26 03:17:17,354][123091] Updated weights for policy 0, policy_version 463588 (0.0005) [2023-12-26 03:17:17,373][123090] Updated weights for policy 1, policy_version 460627 (0.0006) [2023-12-26 03:17:17,419][123091] Updated weights for policy 0, policy_version 463598 (0.0008) [2023-12-26 03:17:17,427][123090] Updated weights for policy 1, policy_version 460637 (0.0005) [2023-12-26 03:17:18,134][123090] Updated weights for policy 1, policy_version 460647 (0.0007) [2023-12-26 03:17:18,192][123090] Updated weights for policy 1, policy_version 460657 (0.0009) [2023-12-26 03:17:18,216][123091] Updated weights for policy 0, policy_version 463608 (0.0006) [2023-12-26 03:17:18,251][123090] Updated weights for policy 1, policy_version 460667 (0.0009) [2023-12-26 03:17:18,285][123091] Updated weights for policy 0, policy_version 463618 (0.0006) [2023-12-26 03:17:18,354][123091] Updated weights for policy 0, policy_version 463628 (0.0010) [2023-12-26 03:17:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 236625920. Throughput: 0: 9016.7, 1: 8756.7. Samples: 236637624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:18,785][121949] Avg episode reward: [(0, '6127.652'), (1, '5969.486')] [2023-12-26 03:17:19,045][123091] Updated weights for policy 0, policy_version 463638 (0.0006) [2023-12-26 03:17:19,100][123091] Updated weights for policy 0, policy_version 463648 (0.0007) [2023-12-26 03:17:19,101][123090] Updated weights for policy 1, policy_version 460677 (0.0010) [2023-12-26 03:17:19,150][123091] Updated weights for policy 0, policy_version 463658 (0.0006) [2023-12-26 03:17:19,156][123090] Updated weights for policy 1, policy_version 460687 (0.0010) [2023-12-26 03:17:19,207][123090] Updated weights for policy 1, policy_version 460697 (0.0010) [2023-12-26 03:17:19,966][123091] Updated weights for policy 0, policy_version 463668 (0.0007) [2023-12-26 03:17:20,030][123091] Updated weights for policy 0, policy_version 463678 (0.0009) [2023-12-26 03:17:20,092][123091] Updated weights for policy 0, policy_version 463688 (0.0009) [2023-12-26 03:17:20,100][123090] Updated weights for policy 1, policy_version 460707 (0.0010) [2023-12-26 03:17:20,162][123090] Updated weights for policy 1, policy_version 460717 (0.0009) [2023-12-26 03:17:20,220][123090] Updated weights for policy 1, policy_version 460727 (0.0009) [2023-12-26 03:17:20,878][123091] Updated weights for policy 0, policy_version 463698 (0.0009) [2023-12-26 03:17:20,945][123091] Updated weights for policy 0, policy_version 463708 (0.0009) [2023-12-26 03:17:20,997][123091] Updated weights for policy 0, policy_version 463718 (0.0011) [2023-12-26 03:17:21,074][123091] Updated weights for policy 0, policy_version 463728 (0.0010) [2023-12-26 03:17:21,097][123090] Updated weights for policy 1, policy_version 460737 (0.0009) [2023-12-26 03:17:21,168][123090] Updated weights for policy 1, policy_version 460747 (0.0007) [2023-12-26 03:17:21,215][123090] Updated weights for policy 1, policy_version 460757 (0.0005) [2023-12-26 03:17:21,279][123090] Updated weights for policy 1, policy_version 460767 (0.0007) [2023-12-26 03:17:21,909][123091] Updated weights for policy 0, policy_version 463738 (0.0008) [2023-12-26 03:17:21,978][123091] Updated weights for policy 0, policy_version 463748 (0.0010) [2023-12-26 03:17:22,037][123091] Updated weights for policy 0, policy_version 463758 (0.0010) [2023-12-26 03:17:22,088][123090] Updated weights for policy 1, policy_version 460777 (0.0010) [2023-12-26 03:17:22,144][123090] Updated weights for policy 1, policy_version 460787 (0.0010) [2023-12-26 03:17:22,211][123090] Updated weights for policy 1, policy_version 460797 (0.0010) [2023-12-26 03:17:22,878][123091] Updated weights for policy 0, policy_version 463768 (0.0009) [2023-12-26 03:17:22,927][123091] Updated weights for policy 0, policy_version 463778 (0.0009) [2023-12-26 03:17:22,980][123091] Updated weights for policy 0, policy_version 463788 (0.0009) [2023-12-26 03:17:23,061][123090] Updated weights for policy 1, policy_version 460807 (0.0010) [2023-12-26 03:17:23,120][123090] Updated weights for policy 1, policy_version 460817 (0.0008) [2023-12-26 03:17:23,188][123090] Updated weights for policy 1, policy_version 460827 (0.0006) [2023-12-26 03:17:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 236707840. Throughput: 0: 9027.7, 1: 8730.3. Samples: 236689552. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:23,785][121949] Avg episode reward: [(0, '6087.853'), (1, '6007.357')] [2023-12-26 03:17:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000460832_117972992.pth... [2023-12-26 03:17:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000459840_117719040.pth [2023-12-26 03:17:23,806][123091] Updated weights for policy 0, policy_version 463798 (0.0010) [2023-12-26 03:17:23,868][123091] Updated weights for policy 0, policy_version 463808 (0.0006) [2023-12-26 03:17:23,920][123091] Updated weights for policy 0, policy_version 463818 (0.0005) [2023-12-26 03:17:23,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000463824_118743040.pth... [2023-12-26 03:17:23,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000462736_118464512.pth [2023-12-26 03:17:24,005][123090] Updated weights for policy 1, policy_version 460837 (0.0009) [2023-12-26 03:17:24,071][123090] Updated weights for policy 1, policy_version 460847 (0.0010) [2023-12-26 03:17:24,119][123090] Updated weights for policy 1, policy_version 460857 (0.0008) [2023-12-26 03:17:24,655][123091] Updated weights for policy 0, policy_version 463828 (0.0007) [2023-12-26 03:17:24,705][123091] Updated weights for policy 0, policy_version 463838 (0.0008) [2023-12-26 03:17:24,761][123091] Updated weights for policy 0, policy_version 463848 (0.0005) [2023-12-26 03:17:25,019][123090] Updated weights for policy 1, policy_version 460867 (0.0011) [2023-12-26 03:17:25,070][123090] Updated weights for policy 1, policy_version 460877 (0.0009) [2023-12-26 03:17:25,135][123090] Updated weights for policy 1, policy_version 460887 (0.0010) [2023-12-26 03:17:25,434][123091] Updated weights for policy 0, policy_version 463858 (0.0006) [2023-12-26 03:17:25,485][123091] Updated weights for policy 0, policy_version 463868 (0.0009) [2023-12-26 03:17:25,542][123091] Updated weights for policy 0, policy_version 463878 (0.0009) [2023-12-26 03:17:25,601][123091] Updated weights for policy 0, policy_version 463888 (0.0009) [2023-12-26 03:17:25,933][123090] Updated weights for policy 1, policy_version 460897 (0.0009) [2023-12-26 03:17:26,000][123090] Updated weights for policy 1, policy_version 460907 (0.0009) [2023-12-26 03:17:26,065][123090] Updated weights for policy 1, policy_version 460917 (0.0009) [2023-12-26 03:17:26,146][123090] Updated weights for policy 1, policy_version 460927 (0.0010) [2023-12-26 03:17:26,403][123091] Updated weights for policy 0, policy_version 463898 (0.0009) [2023-12-26 03:17:26,457][123091] Updated weights for policy 0, policy_version 463908 (0.0010) [2023-12-26 03:17:26,508][123091] Updated weights for policy 0, policy_version 463918 (0.0009) [2023-12-26 03:17:26,989][123090] Updated weights for policy 1, policy_version 460937 (0.0011) [2023-12-26 03:17:27,039][123090] Updated weights for policy 1, policy_version 460947 (0.0008) [2023-12-26 03:17:27,102][123090] Updated weights for policy 1, policy_version 460957 (0.0010) [2023-12-26 03:17:27,306][123091] Updated weights for policy 0, policy_version 463928 (0.0010) [2023-12-26 03:17:27,357][123091] Updated weights for policy 0, policy_version 463938 (0.0008) [2023-12-26 03:17:27,408][123091] Updated weights for policy 0, policy_version 463948 (0.0010) [2023-12-26 03:17:27,961][123090] Updated weights for policy 1, policy_version 460967 (0.0010) [2023-12-26 03:17:28,039][123090] Updated weights for policy 1, policy_version 460978 (0.0011) [2023-12-26 03:17:28,092][123090] Updated weights for policy 1, policy_version 460988 (0.0010) [2023-12-26 03:17:28,137][123091] Updated weights for policy 0, policy_version 463958 (0.0010) [2023-12-26 03:17:28,195][123091] Updated weights for policy 0, policy_version 463968 (0.0010) [2023-12-26 03:17:28,259][123091] Updated weights for policy 0, policy_version 463978 (0.0009) [2023-12-26 03:17:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 236797952. Throughput: 0: 9059.4, 1: 8712.2. Samples: 236794116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:28,785][121949] Avg episode reward: [(0, '6030.377'), (1, '5957.065')] [2023-12-26 03:17:28,877][123090] Updated weights for policy 1, policy_version 460998 (0.0008) [2023-12-26 03:17:28,942][123090] Updated weights for policy 1, policy_version 461008 (0.0008) [2023-12-26 03:17:28,997][123090] Updated weights for policy 1, policy_version 461018 (0.0010) [2023-12-26 03:17:29,099][123091] Updated weights for policy 0, policy_version 463988 (0.0010) [2023-12-26 03:17:29,145][123091] Updated weights for policy 0, policy_version 463998 (0.0009) [2023-12-26 03:17:29,211][123091] Updated weights for policy 0, policy_version 464008 (0.0009) [2023-12-26 03:17:29,733][123090] Updated weights for policy 1, policy_version 461028 (0.0007) [2023-12-26 03:17:29,798][123090] Updated weights for policy 1, policy_version 461038 (0.0005) [2023-12-26 03:17:29,867][123090] Updated weights for policy 1, policy_version 461048 (0.0009) [2023-12-26 03:17:30,003][123091] Updated weights for policy 0, policy_version 464018 (0.0009) [2023-12-26 03:17:30,068][123091] Updated weights for policy 0, policy_version 464028 (0.0007) [2023-12-26 03:17:30,138][123091] Updated weights for policy 0, policy_version 464038 (0.0011) [2023-12-26 03:17:30,200][123091] Updated weights for policy 0, policy_version 464048 (0.0010) [2023-12-26 03:17:30,677][123090] Updated weights for policy 1, policy_version 461058 (0.0008) [2023-12-26 03:17:30,739][123090] Updated weights for policy 1, policy_version 461068 (0.0009) [2023-12-26 03:17:30,803][123090] Updated weights for policy 1, policy_version 461078 (0.0009) [2023-12-26 03:17:30,867][123090] Updated weights for policy 1, policy_version 461088 (0.0008) [2023-12-26 03:17:30,918][123091] Updated weights for policy 0, policy_version 464058 (0.0009) [2023-12-26 03:17:30,983][123091] Updated weights for policy 0, policy_version 464068 (0.0006) [2023-12-26 03:17:31,057][123091] Updated weights for policy 0, policy_version 464078 (0.0007) [2023-12-26 03:17:31,697][123090] Updated weights for policy 1, policy_version 461098 (0.0010) [2023-12-26 03:17:31,768][123090] Updated weights for policy 1, policy_version 461108 (0.0008) [2023-12-26 03:17:31,820][123091] Updated weights for policy 0, policy_version 464088 (0.0006) [2023-12-26 03:17:31,823][123090] Updated weights for policy 1, policy_version 461118 (0.0008) [2023-12-26 03:17:31,876][123091] Updated weights for policy 0, policy_version 464098 (0.0005) [2023-12-26 03:17:31,921][123091] Updated weights for policy 0, policy_version 464108 (0.0005) [2023-12-26 03:17:32,634][123090] Updated weights for policy 1, policy_version 461128 (0.0010) [2023-12-26 03:17:32,646][123091] Updated weights for policy 0, policy_version 464118 (0.0006) [2023-12-26 03:17:32,693][123090] Updated weights for policy 1, policy_version 461138 (0.0010) [2023-12-26 03:17:32,698][123091] Updated weights for policy 0, policy_version 464128 (0.0005) [2023-12-26 03:17:32,750][123091] Updated weights for policy 0, policy_version 464138 (0.0005) [2023-12-26 03:17:32,768][123090] Updated weights for policy 1, policy_version 461148 (0.0010) [2023-12-26 03:17:33,430][123091] Updated weights for policy 0, policy_version 464148 (0.0005) [2023-12-26 03:17:33,497][123091] Updated weights for policy 0, policy_version 464158 (0.0005) [2023-12-26 03:17:33,556][123091] Updated weights for policy 0, policy_version 464168 (0.0008) [2023-12-26 03:17:33,576][123090] Updated weights for policy 1, policy_version 461158 (0.0010) [2023-12-26 03:17:33,624][123090] Updated weights for policy 1, policy_version 461168 (0.0010) [2023-12-26 03:17:33,674][123090] Updated weights for policy 1, policy_version 461178 (0.0010) [2023-12-26 03:17:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 236896256. Throughput: 0: 9080.5, 1: 8585.2. Samples: 236902428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:33,785][121949] Avg episode reward: [(0, '6053.350'), (1, '5931.000')] [2023-12-26 03:17:34,344][123091] Updated weights for policy 0, policy_version 464178 (0.0010) [2023-12-26 03:17:34,397][123091] Updated weights for policy 0, policy_version 464188 (0.0010) [2023-12-26 03:17:34,456][123091] Updated weights for policy 0, policy_version 464198 (0.0010) [2023-12-26 03:17:34,492][123090] Updated weights for policy 1, policy_version 461188 (0.0008) [2023-12-26 03:17:34,522][123091] Updated weights for policy 0, policy_version 464208 (0.0010) [2023-12-26 03:17:34,555][123090] Updated weights for policy 1, policy_version 461198 (0.0005) [2023-12-26 03:17:34,627][123090] Updated weights for policy 1, policy_version 461208 (0.0007) [2023-12-26 03:17:35,308][123091] Updated weights for policy 0, policy_version 464218 (0.0010) [2023-12-26 03:17:35,352][123091] Updated weights for policy 0, policy_version 464228 (0.0010) [2023-12-26 03:17:35,411][123091] Updated weights for policy 0, policy_version 464238 (0.0010) [2023-12-26 03:17:35,419][123090] Updated weights for policy 1, policy_version 461218 (0.0009) [2023-12-26 03:17:35,466][123090] Updated weights for policy 1, policy_version 461228 (0.0010) [2023-12-26 03:17:35,517][123090] Updated weights for policy 1, policy_version 461238 (0.0010) [2023-12-26 03:17:35,564][123090] Updated weights for policy 1, policy_version 461248 (0.0010) [2023-12-26 03:17:36,210][123091] Updated weights for policy 0, policy_version 464248 (0.0011) [2023-12-26 03:17:36,282][123091] Updated weights for policy 0, policy_version 464258 (0.0011) [2023-12-26 03:17:36,338][123091] Updated weights for policy 0, policy_version 464268 (0.0011) [2023-12-26 03:17:36,441][123090] Updated weights for policy 1, policy_version 461258 (0.0011) [2023-12-26 03:17:36,498][123090] Updated weights for policy 1, policy_version 461268 (0.0010) [2023-12-26 03:17:36,562][123090] Updated weights for policy 1, policy_version 461278 (0.0010) [2023-12-26 03:17:37,059][123091] Updated weights for policy 0, policy_version 464278 (0.0008) [2023-12-26 03:17:37,122][123091] Updated weights for policy 0, policy_version 464288 (0.0005) [2023-12-26 03:17:37,183][123091] Updated weights for policy 0, policy_version 464298 (0.0005) [2023-12-26 03:17:37,402][123090] Updated weights for policy 1, policy_version 461288 (0.0011) [2023-12-26 03:17:37,485][123090] Updated weights for policy 1, policy_version 461298 (0.0011) [2023-12-26 03:17:37,548][123090] Updated weights for policy 1, policy_version 461308 (0.0011) [2023-12-26 03:17:37,818][123091] Updated weights for policy 0, policy_version 464308 (0.0006) [2023-12-26 03:17:37,883][123091] Updated weights for policy 0, policy_version 464318 (0.0006) [2023-12-26 03:17:37,948][123091] Updated weights for policy 0, policy_version 464328 (0.0010) [2023-12-26 03:17:38,279][123090] Updated weights for policy 1, policy_version 461318 (0.0010) [2023-12-26 03:17:38,341][123090] Updated weights for policy 1, policy_version 461328 (0.0010) [2023-12-26 03:17:38,409][123090] Updated weights for policy 1, policy_version 461338 (0.0011) [2023-12-26 03:17:38,742][123091] Updated weights for policy 0, policy_version 464338 (0.0011) [2023-12-26 03:17:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 236978176. Throughput: 0: 9111.1, 1: 8605.4. Samples: 236955064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:38,785][121949] Avg episode reward: [(0, '6241.256'), (1, '5927.232')] [2023-12-26 03:17:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000461344_118104064.pth... [2023-12-26 03:17:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000460352_117850112.pth [2023-12-26 03:17:38,794][123091] Updated weights for policy 0, policy_version 464348 (0.0011) [2023-12-26 03:17:38,841][123091] Updated weights for policy 0, policy_version 464358 (0.0010) [2023-12-26 03:17:38,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000464368_118882304.pth... [2023-12-26 03:17:38,894][123091] Updated weights for policy 0, policy_version 464368 (0.0009) [2023-12-26 03:17:38,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000463280_118603776.pth [2023-12-26 03:17:39,244][123090] Updated weights for policy 1, policy_version 461348 (0.0011) [2023-12-26 03:17:39,311][123090] Updated weights for policy 1, policy_version 461358 (0.0011) [2023-12-26 03:17:39,395][123090] Updated weights for policy 1, policy_version 461368 (0.0010) [2023-12-26 03:17:39,738][123091] Updated weights for policy 0, policy_version 464378 (0.0009) [2023-12-26 03:17:39,791][123091] Updated weights for policy 0, policy_version 464388 (0.0009) [2023-12-26 03:17:39,851][123091] Updated weights for policy 0, policy_version 464398 (0.0009) [2023-12-26 03:17:40,265][123090] Updated weights for policy 1, policy_version 461378 (0.0010) [2023-12-26 03:17:40,320][123090] Updated weights for policy 1, policy_version 461388 (0.0010) [2023-12-26 03:17:40,376][123090] Updated weights for policy 1, policy_version 461398 (0.0010) [2023-12-26 03:17:40,442][123090] Updated weights for policy 1, policy_version 461408 (0.0011) [2023-12-26 03:17:40,704][123091] Updated weights for policy 0, policy_version 464408 (0.0007) [2023-12-26 03:17:40,757][123091] Updated weights for policy 0, policy_version 464418 (0.0009) [2023-12-26 03:17:40,805][123091] Updated weights for policy 0, policy_version 464428 (0.0009) [2023-12-26 03:17:41,326][123090] Updated weights for policy 1, policy_version 461418 (0.0006) [2023-12-26 03:17:41,401][123090] Updated weights for policy 1, policy_version 461428 (0.0009) [2023-12-26 03:17:41,469][123090] Updated weights for policy 1, policy_version 461438 (0.0010) [2023-12-26 03:17:41,656][123091] Updated weights for policy 0, policy_version 464438 (0.0010) [2023-12-26 03:17:41,729][123091] Updated weights for policy 0, policy_version 464448 (0.0010) [2023-12-26 03:17:41,791][123091] Updated weights for policy 0, policy_version 464458 (0.0010) [2023-12-26 03:17:42,190][123090] Updated weights for policy 1, policy_version 461448 (0.0008) [2023-12-26 03:17:42,246][123090] Updated weights for policy 1, policy_version 461458 (0.0009) [2023-12-26 03:17:42,311][123090] Updated weights for policy 1, policy_version 461468 (0.0009) [2023-12-26 03:17:42,655][123091] Updated weights for policy 0, policy_version 464468 (0.0011) [2023-12-26 03:17:42,720][123091] Updated weights for policy 0, policy_version 464478 (0.0009) [2023-12-26 03:17:42,783][123091] Updated weights for policy 0, policy_version 464488 (0.0010) [2023-12-26 03:17:43,188][123090] Updated weights for policy 1, policy_version 461478 (0.0009) [2023-12-26 03:17:43,249][123090] Updated weights for policy 1, policy_version 461488 (0.0009) [2023-12-26 03:17:43,317][123090] Updated weights for policy 1, policy_version 461498 (0.0009) [2023-12-26 03:17:43,610][123091] Updated weights for policy 0, policy_version 464498 (0.0010) [2023-12-26 03:17:43,658][123091] Updated weights for policy 0, policy_version 464508 (0.0010) [2023-12-26 03:17:43,713][123091] Updated weights for policy 0, policy_version 464518 (0.0010) [2023-12-26 03:17:43,761][123091] Updated weights for policy 0, policy_version 464528 (0.0010) [2023-12-26 03:17:43,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 237068288. Throughput: 0: 9012.9, 1: 8581.4. Samples: 237059504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:43,786][121949] Avg episode reward: [(0, '6280.254'), (1, '5922.904')] [2023-12-26 03:17:44,157][123090] Updated weights for policy 1, policy_version 461508 (0.0009) [2023-12-26 03:17:44,222][123090] Updated weights for policy 1, policy_version 461518 (0.0009) [2023-12-26 03:17:44,271][123090] Updated weights for policy 1, policy_version 461528 (0.0008) [2023-12-26 03:17:44,603][123091] Updated weights for policy 0, policy_version 464538 (0.0010) [2023-12-26 03:17:44,651][123091] Updated weights for policy 0, policy_version 464548 (0.0010) [2023-12-26 03:17:44,709][123091] Updated weights for policy 0, policy_version 464558 (0.0008) [2023-12-26 03:17:45,073][123090] Updated weights for policy 1, policy_version 461538 (0.0009) [2023-12-26 03:17:45,131][123090] Updated weights for policy 1, policy_version 461548 (0.0009) [2023-12-26 03:17:45,189][123090] Updated weights for policy 1, policy_version 461558 (0.0009) [2023-12-26 03:17:45,255][123090] Updated weights for policy 1, policy_version 461568 (0.0009) [2023-12-26 03:17:45,545][123091] Updated weights for policy 0, policy_version 464568 (0.0009) [2023-12-26 03:17:45,613][123091] Updated weights for policy 0, policy_version 464578 (0.0006) [2023-12-26 03:17:45,681][123091] Updated weights for policy 0, policy_version 464588 (0.0005) [2023-12-26 03:17:46,163][123090] Updated weights for policy 1, policy_version 461578 (0.0009) [2023-12-26 03:17:46,227][123090] Updated weights for policy 1, policy_version 461589 (0.0011) [2023-12-26 03:17:46,283][123090] Updated weights for policy 1, policy_version 461599 (0.0009) [2023-12-26 03:17:46,297][123091] Updated weights for policy 0, policy_version 464598 (0.0005) [2023-12-26 03:17:46,343][123091] Updated weights for policy 0, policy_version 464608 (0.0005) [2023-12-26 03:17:46,388][123091] Updated weights for policy 0, policy_version 464618 (0.0005) [2023-12-26 03:17:47,064][123091] Updated weights for policy 0, policy_version 464628 (0.0005) [2023-12-26 03:17:47,126][123091] Updated weights for policy 0, policy_version 464638 (0.0005) [2023-12-26 03:17:47,183][123091] Updated weights for policy 0, policy_version 464648 (0.0008) [2023-12-26 03:17:47,211][123090] Updated weights for policy 1, policy_version 461609 (0.0008) [2023-12-26 03:17:47,277][123090] Updated weights for policy 1, policy_version 461619 (0.0009) [2023-12-26 03:17:47,333][123090] Updated weights for policy 1, policy_version 461629 (0.0009) [2023-12-26 03:17:47,954][123091] Updated weights for policy 0, policy_version 464658 (0.0010) [2023-12-26 03:17:48,001][123091] Updated weights for policy 0, policy_version 464668 (0.0010) [2023-12-26 03:17:48,055][123091] Updated weights for policy 0, policy_version 464678 (0.0010) [2023-12-26 03:17:48,110][123091] Updated weights for policy 0, policy_version 464688 (0.0010) [2023-12-26 03:17:48,165][123090] Updated weights for policy 1, policy_version 461639 (0.0009) [2023-12-26 03:17:48,230][123090] Updated weights for policy 1, policy_version 461649 (0.0009) [2023-12-26 03:17:48,290][123090] Updated weights for policy 1, policy_version 461659 (0.0009) [2023-12-26 03:17:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 237150208. Throughput: 0: 9046.7, 1: 8573.9. Samples: 237163368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:48,785][121949] Avg episode reward: [(0, '6240.254'), (1, '5826.051')] [2023-12-26 03:17:48,957][123091] Updated weights for policy 0, policy_version 464698 (0.0011) [2023-12-26 03:17:49,008][123091] Updated weights for policy 0, policy_version 464708 (0.0010) [2023-12-26 03:17:49,055][123091] Updated weights for policy 0, policy_version 464718 (0.0009) [2023-12-26 03:17:49,152][123090] Updated weights for policy 1, policy_version 461669 (0.0008) [2023-12-26 03:17:49,202][123090] Updated weights for policy 1, policy_version 461679 (0.0009) [2023-12-26 03:17:49,263][123090] Updated weights for policy 1, policy_version 461689 (0.0009) [2023-12-26 03:17:49,878][123091] Updated weights for policy 0, policy_version 464728 (0.0009) [2023-12-26 03:17:49,953][123091] Updated weights for policy 0, policy_version 464738 (0.0010) [2023-12-26 03:17:50,019][123091] Updated weights for policy 0, policy_version 464748 (0.0010) [2023-12-26 03:17:50,024][123090] Updated weights for policy 1, policy_version 461699 (0.0006) [2023-12-26 03:17:50,089][123090] Updated weights for policy 1, policy_version 461709 (0.0007) [2023-12-26 03:17:50,152][123090] Updated weights for policy 1, policy_version 461719 (0.0009) [2023-12-26 03:17:50,813][123091] Updated weights for policy 0, policy_version 464758 (0.0006) [2023-12-26 03:17:50,885][123091] Updated weights for policy 0, policy_version 464768 (0.0007) [2023-12-26 03:17:50,955][123091] Updated weights for policy 0, policy_version 464778 (0.0010) [2023-12-26 03:17:50,975][123090] Updated weights for policy 1, policy_version 461729 (0.0009) [2023-12-26 03:17:51,054][123090] Updated weights for policy 1, policy_version 461739 (0.0006) [2023-12-26 03:17:51,132][123090] Updated weights for policy 1, policy_version 461749 (0.0007) [2023-12-26 03:17:51,206][123090] Updated weights for policy 1, policy_version 461759 (0.0009) [2023-12-26 03:17:51,739][123091] Updated weights for policy 0, policy_version 464788 (0.0010) [2023-12-26 03:17:51,804][123091] Updated weights for policy 0, policy_version 464798 (0.0011) [2023-12-26 03:17:51,875][123091] Updated weights for policy 0, policy_version 464808 (0.0007) [2023-12-26 03:17:51,991][123090] Updated weights for policy 1, policy_version 461769 (0.0011) [2023-12-26 03:17:52,057][123090] Updated weights for policy 1, policy_version 461779 (0.0010) [2023-12-26 03:17:52,121][123090] Updated weights for policy 1, policy_version 461789 (0.0010) [2023-12-26 03:17:52,629][123091] Updated weights for policy 0, policy_version 464818 (0.0006) [2023-12-26 03:17:52,693][123091] Updated weights for policy 0, policy_version 464828 (0.0007) [2023-12-26 03:17:52,766][123091] Updated weights for policy 0, policy_version 464838 (0.0007) [2023-12-26 03:17:52,836][123091] Updated weights for policy 0, policy_version 464848 (0.0011) [2023-12-26 03:17:52,924][123090] Updated weights for policy 1, policy_version 461799 (0.0011) [2023-12-26 03:17:53,000][123090] Updated weights for policy 1, policy_version 461809 (0.0011) [2023-12-26 03:17:53,069][123090] Updated weights for policy 1, policy_version 461819 (0.0011) [2023-12-26 03:17:53,555][123091] Updated weights for policy 0, policy_version 464858 (0.0009) [2023-12-26 03:17:53,614][123091] Updated weights for policy 0, policy_version 464868 (0.0009) [2023-12-26 03:17:53,676][123091] Updated weights for policy 0, policy_version 464878 (0.0008) [2023-12-26 03:17:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 237240320. Throughput: 0: 9055.3, 1: 8594.3. Samples: 237216496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:53,785][121949] Avg episode reward: [(0, '6193.589'), (1, '5801.201')] [2023-12-26 03:17:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000461824_118226944.pth... [2023-12-26 03:17:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000464880_119013376.pth... [2023-12-26 03:17:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000460832_117972992.pth [2023-12-26 03:17:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000463824_118743040.pth [2023-12-26 03:17:53,853][123090] Updated weights for policy 1, policy_version 461829 (0.0011) [2023-12-26 03:17:53,908][123090] Updated weights for policy 1, policy_version 461839 (0.0011) [2023-12-26 03:17:53,960][123090] Updated weights for policy 1, policy_version 461849 (0.0010) [2023-12-26 03:17:54,428][123091] Updated weights for policy 0, policy_version 464888 (0.0009) [2023-12-26 03:17:54,482][123091] Updated weights for policy 0, policy_version 464898 (0.0010) [2023-12-26 03:17:54,537][123091] Updated weights for policy 0, policy_version 464908 (0.0010) [2023-12-26 03:17:54,787][123090] Updated weights for policy 1, policy_version 461859 (0.0010) [2023-12-26 03:17:54,848][123090] Updated weights for policy 1, policy_version 461869 (0.0010) [2023-12-26 03:17:54,916][123090] Updated weights for policy 1, policy_version 461879 (0.0011) [2023-12-26 03:17:55,322][123091] Updated weights for policy 0, policy_version 464918 (0.0010) [2023-12-26 03:17:55,380][123091] Updated weights for policy 0, policy_version 464928 (0.0010) [2023-12-26 03:17:55,441][123091] Updated weights for policy 0, policy_version 464938 (0.0010) [2023-12-26 03:17:55,721][123090] Updated weights for policy 1, policy_version 461889 (0.0011) [2023-12-26 03:17:55,773][123090] Updated weights for policy 1, policy_version 461899 (0.0010) [2023-12-26 03:17:55,824][123090] Updated weights for policy 1, policy_version 461909 (0.0010) [2023-12-26 03:17:55,875][123090] Updated weights for policy 1, policy_version 461919 (0.0010) [2023-12-26 03:17:56,251][123091] Updated weights for policy 0, policy_version 464948 (0.0010) [2023-12-26 03:17:56,298][123091] Updated weights for policy 0, policy_version 464958 (0.0010) [2023-12-26 03:17:56,345][123091] Updated weights for policy 0, policy_version 464968 (0.0010) [2023-12-26 03:17:56,727][123090] Updated weights for policy 1, policy_version 461929 (0.0010) [2023-12-26 03:17:56,785][123090] Updated weights for policy 1, policy_version 461939 (0.0008) [2023-12-26 03:17:56,840][123090] Updated weights for policy 1, policy_version 461949 (0.0005) [2023-12-26 03:17:57,192][123091] Updated weights for policy 0, policy_version 464978 (0.0010) [2023-12-26 03:17:57,247][123091] Updated weights for policy 0, policy_version 464988 (0.0010) [2023-12-26 03:17:57,305][123091] Updated weights for policy 0, policy_version 464998 (0.0010) [2023-12-26 03:17:57,364][123091] Updated weights for policy 0, policy_version 465008 (0.0010) [2023-12-26 03:17:57,562][123090] Updated weights for policy 1, policy_version 461959 (0.0008) [2023-12-26 03:17:57,623][123090] Updated weights for policy 1, policy_version 461969 (0.0010) [2023-12-26 03:17:57,678][123090] Updated weights for policy 1, policy_version 461980 (0.0011) [2023-12-26 03:17:58,133][123091] Updated weights for policy 0, policy_version 465018 (0.0009) [2023-12-26 03:17:58,190][123091] Updated weights for policy 0, policy_version 465028 (0.0010) [2023-12-26 03:17:58,246][123091] Updated weights for policy 0, policy_version 465038 (0.0009) [2023-12-26 03:17:58,557][123090] Updated weights for policy 1, policy_version 461990 (0.0008) [2023-12-26 03:17:58,630][123090] Updated weights for policy 1, policy_version 462000 (0.0008) [2023-12-26 03:17:58,708][123090] Updated weights for policy 1, policy_version 462010 (0.0009) [2023-12-26 03:17:58,786][121949] Fps is (10 sec: 18019.1, 60 sec: 17612.3, 300 sec: 17633.5). Total num frames: 237330432. Throughput: 0: 9053.0, 1: 8569.9. Samples: 237322404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:17:58,787][121949] Avg episode reward: [(0, '6187.786'), (1, '5855.599')] [2023-12-26 03:17:59,292][123091] Updated weights for policy 0, policy_version 465048 (0.0009) [2023-12-26 03:17:59,365][123091] Updated weights for policy 0, policy_version 465058 (0.0011) [2023-12-26 03:17:59,433][123091] Updated weights for policy 0, policy_version 465068 (0.0007) [2023-12-26 03:17:59,554][123090] Updated weights for policy 1, policy_version 462020 (0.0010) [2023-12-26 03:17:59,611][123090] Updated weights for policy 1, policy_version 462030 (0.0009) [2023-12-26 03:17:59,679][123090] Updated weights for policy 1, policy_version 462040 (0.0010) [2023-12-26 03:18:00,170][123091] Updated weights for policy 0, policy_version 465078 (0.0006) [2023-12-26 03:18:00,239][123091] Updated weights for policy 0, policy_version 465088 (0.0006) [2023-12-26 03:18:00,302][123091] Updated weights for policy 0, policy_version 465098 (0.0005) [2023-12-26 03:18:00,508][123090] Updated weights for policy 1, policy_version 462050 (0.0010) [2023-12-26 03:18:00,559][123090] Updated weights for policy 1, policy_version 462060 (0.0008) [2023-12-26 03:18:00,607][123090] Updated weights for policy 1, policy_version 462070 (0.0008) [2023-12-26 03:18:00,660][123090] Updated weights for policy 1, policy_version 462080 (0.0009) [2023-12-26 03:18:01,045][123091] Updated weights for policy 0, policy_version 465108 (0.0008) [2023-12-26 03:18:01,112][123091] Updated weights for policy 0, policy_version 465118 (0.0011) [2023-12-26 03:18:01,175][123091] Updated weights for policy 0, policy_version 465128 (0.0011) [2023-12-26 03:18:01,421][123090] Updated weights for policy 1, policy_version 462090 (0.0011) [2023-12-26 03:18:01,466][123090] Updated weights for policy 1, policy_version 462100 (0.0010) [2023-12-26 03:18:01,520][123090] Updated weights for policy 1, policy_version 462110 (0.0010) [2023-12-26 03:18:01,902][123091] Updated weights for policy 0, policy_version 465138 (0.0007) [2023-12-26 03:18:01,964][123091] Updated weights for policy 0, policy_version 465148 (0.0007) [2023-12-26 03:18:02,021][123091] Updated weights for policy 0, policy_version 465158 (0.0009) [2023-12-26 03:18:02,093][123091] Updated weights for policy 0, policy_version 465168 (0.0010) [2023-12-26 03:18:02,318][123090] Updated weights for policy 1, policy_version 462120 (0.0010) [2023-12-26 03:18:02,389][123090] Updated weights for policy 1, policy_version 462130 (0.0009) [2023-12-26 03:18:02,447][123090] Updated weights for policy 1, policy_version 462140 (0.0009) [2023-12-26 03:18:02,855][123091] Updated weights for policy 0, policy_version 465178 (0.0008) [2023-12-26 03:18:02,907][123091] Updated weights for policy 0, policy_version 465188 (0.0008) [2023-12-26 03:18:02,956][123091] Updated weights for policy 0, policy_version 465198 (0.0009) [2023-12-26 03:18:03,197][123090] Updated weights for policy 1, policy_version 462150 (0.0007) [2023-12-26 03:18:03,273][123090] Updated weights for policy 1, policy_version 462160 (0.0006) [2023-12-26 03:18:03,334][123090] Updated weights for policy 1, policy_version 462170 (0.0008) [2023-12-26 03:18:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 237412352. Throughput: 0: 8989.0, 1: 8548.3. Samples: 237426808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:18:03,785][121949] Avg episode reward: [(0, '6108.681'), (1, '5834.147')] [2023-12-26 03:18:03,835][123091] Updated weights for policy 0, policy_version 465208 (0.0009) [2023-12-26 03:18:03,894][123091] Updated weights for policy 0, policy_version 465218 (0.0009) [2023-12-26 03:18:03,966][123091] Updated weights for policy 0, policy_version 465228 (0.0008) [2023-12-26 03:18:04,026][123090] Updated weights for policy 1, policy_version 462180 (0.0005) [2023-12-26 03:18:04,076][123090] Updated weights for policy 1, policy_version 462190 (0.0006) [2023-12-26 03:18:04,144][123090] Updated weights for policy 1, policy_version 462200 (0.0007) [2023-12-26 03:18:04,808][123091] Updated weights for policy 0, policy_version 465238 (0.0008) [2023-12-26 03:18:04,868][123091] Updated weights for policy 0, policy_version 465248 (0.0009) [2023-12-26 03:18:04,904][123090] Updated weights for policy 1, policy_version 462210 (0.0008) [2023-12-26 03:18:04,932][123091] Updated weights for policy 0, policy_version 465258 (0.0008) [2023-12-26 03:18:04,955][123090] Updated weights for policy 1, policy_version 462220 (0.0009) [2023-12-26 03:18:05,012][123090] Updated weights for policy 1, policy_version 462230 (0.0009) [2023-12-26 03:18:05,075][123090] Updated weights for policy 1, policy_version 462240 (0.0008) [2023-12-26 03:18:05,772][123091] Updated weights for policy 0, policy_version 465268 (0.0008) [2023-12-26 03:18:05,828][123091] Updated weights for policy 0, policy_version 465278 (0.0006) [2023-12-26 03:18:05,833][123090] Updated weights for policy 1, policy_version 462250 (0.0006) [2023-12-26 03:18:05,892][123091] Updated weights for policy 0, policy_version 465288 (0.0006) [2023-12-26 03:18:05,901][123090] Updated weights for policy 1, policy_version 462260 (0.0005) [2023-12-26 03:18:05,954][123090] Updated weights for policy 1, policy_version 462270 (0.0007) [2023-12-26 03:18:06,678][123091] Updated weights for policy 0, policy_version 465298 (0.0007) [2023-12-26 03:18:06,735][123091] Updated weights for policy 0, policy_version 465308 (0.0009) [2023-12-26 03:18:06,768][123090] Updated weights for policy 1, policy_version 462280 (0.0007) [2023-12-26 03:18:06,797][123091] Updated weights for policy 0, policy_version 465318 (0.0009) [2023-12-26 03:18:06,823][123090] Updated weights for policy 1, policy_version 462290 (0.0009) [2023-12-26 03:18:06,864][123091] Updated weights for policy 0, policy_version 465328 (0.0008) [2023-12-26 03:18:06,882][123090] Updated weights for policy 1, policy_version 462300 (0.0006) [2023-12-26 03:18:07,638][123090] Updated weights for policy 1, policy_version 462310 (0.0008) [2023-12-26 03:18:07,685][123091] Updated weights for policy 0, policy_version 465338 (0.0009) [2023-12-26 03:18:07,692][123090] Updated weights for policy 1, policy_version 462320 (0.0008) [2023-12-26 03:18:07,739][123090] Updated weights for policy 1, policy_version 462330 (0.0008) [2023-12-26 03:18:07,741][123091] Updated weights for policy 0, policy_version 465348 (0.0007) [2023-12-26 03:18:07,800][123091] Updated weights for policy 0, policy_version 465358 (0.0010) [2023-12-26 03:18:08,592][123090] Updated weights for policy 1, policy_version 462340 (0.0008) [2023-12-26 03:18:08,657][123091] Updated weights for policy 0, policy_version 465368 (0.0009) [2023-12-26 03:18:08,662][123090] Updated weights for policy 1, policy_version 462350 (0.0008) [2023-12-26 03:18:08,721][123091] Updated weights for policy 0, policy_version 465378 (0.0007) [2023-12-26 03:18:08,728][123090] Updated weights for policy 1, policy_version 462360 (0.0010) [2023-12-26 03:18:08,777][123091] Updated weights for policy 0, policy_version 465388 (0.0007) [2023-12-26 03:18:08,784][121949] Fps is (10 sec: 17206.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 237502464. Throughput: 0: 8960.6, 1: 8612.8. Samples: 237480356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:18:08,785][121949] Avg episode reward: [(0, '6076.917'), (1, '5861.110')] [2023-12-26 03:18:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000462368_118366208.pth... [2023-12-26 03:18:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000461344_118104064.pth [2023-12-26 03:18:08,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000465392_119144448.pth... [2023-12-26 03:18:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000464368_118882304.pth [2023-12-26 03:18:09,475][123091] Updated weights for policy 0, policy_version 465398 (0.0008) [2023-12-26 03:18:09,538][123091] Updated weights for policy 0, policy_version 465408 (0.0009) [2023-12-26 03:18:09,580][123090] Updated weights for policy 1, policy_version 462370 (0.0010) [2023-12-26 03:18:09,602][123091] Updated weights for policy 0, policy_version 465418 (0.0008) [2023-12-26 03:18:09,644][123090] Updated weights for policy 1, policy_version 462380 (0.0008) [2023-12-26 03:18:09,708][123090] Updated weights for policy 1, policy_version 462390 (0.0010) [2023-12-26 03:18:09,769][123090] Updated weights for policy 1, policy_version 462400 (0.0009) [2023-12-26 03:18:10,445][123091] Updated weights for policy 0, policy_version 465428 (0.0009) [2023-12-26 03:18:10,516][123091] Updated weights for policy 0, policy_version 465438 (0.0010) [2023-12-26 03:18:10,574][123091] Updated weights for policy 0, policy_version 465448 (0.0008) [2023-12-26 03:18:10,584][123090] Updated weights for policy 1, policy_version 462410 (0.0008) [2023-12-26 03:18:10,643][123090] Updated weights for policy 1, policy_version 462420 (0.0008) [2023-12-26 03:18:10,706][123090] Updated weights for policy 1, policy_version 462430 (0.0009) [2023-12-26 03:18:11,402][123091] Updated weights for policy 0, policy_version 465458 (0.0007) [2023-12-26 03:18:11,468][123091] Updated weights for policy 0, policy_version 465468 (0.0006) [2023-12-26 03:18:11,527][123091] Updated weights for policy 0, policy_version 465478 (0.0009) [2023-12-26 03:18:11,581][123090] Updated weights for policy 1, policy_version 462440 (0.0009) [2023-12-26 03:18:11,591][123091] Updated weights for policy 0, policy_version 465488 (0.0011) [2023-12-26 03:18:11,641][123090] Updated weights for policy 1, policy_version 462450 (0.0008) [2023-12-26 03:18:11,706][123090] Updated weights for policy 1, policy_version 462460 (0.0009) [2023-12-26 03:18:12,339][123091] Updated weights for policy 0, policy_version 465498 (0.0010) [2023-12-26 03:18:12,410][123091] Updated weights for policy 0, policy_version 465508 (0.0011) [2023-12-26 03:18:12,476][123091] Updated weights for policy 0, policy_version 465518 (0.0011) [2023-12-26 03:18:12,585][123090] Updated weights for policy 1, policy_version 462470 (0.0009) [2023-12-26 03:18:12,645][123090] Updated weights for policy 1, policy_version 462480 (0.0008) [2023-12-26 03:18:12,705][123090] Updated weights for policy 1, policy_version 462490 (0.0008) [2023-12-26 03:18:13,287][123091] Updated weights for policy 0, policy_version 465528 (0.0007) [2023-12-26 03:18:13,338][123091] Updated weights for policy 0, policy_version 465538 (0.0006) [2023-12-26 03:18:13,386][123091] Updated weights for policy 0, policy_version 465548 (0.0005) [2023-12-26 03:18:13,594][123090] Updated weights for policy 1, policy_version 462500 (0.0009) [2023-12-26 03:18:13,656][123090] Updated weights for policy 1, policy_version 462510 (0.0009) [2023-12-26 03:18:13,717][123090] Updated weights for policy 1, policy_version 462521 (0.0010) [2023-12-26 03:18:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 237592576. Throughput: 0: 8911.2, 1: 8610.5. Samples: 237582600. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-12-26 03:18:13,785][121949] Avg episode reward: [(0, '6119.465'), (1, '5926.373')] [2023-12-26 03:18:14,063][123091] Updated weights for policy 0, policy_version 465558 (0.0008) [2023-12-26 03:18:14,117][123091] Updated weights for policy 0, policy_version 465568 (0.0009) [2023-12-26 03:18:14,177][123091] Updated weights for policy 0, policy_version 465578 (0.0009) [2023-12-26 03:18:14,545][123090] Updated weights for policy 1, policy_version 462531 (0.0010) [2023-12-26 03:18:14,596][123090] Updated weights for policy 1, policy_version 462541 (0.0009) [2023-12-26 03:18:14,651][123090] Updated weights for policy 1, policy_version 462551 (0.0010) [2023-12-26 03:18:15,023][123091] Updated weights for policy 0, policy_version 465588 (0.0009) [2023-12-26 03:18:15,082][123091] Updated weights for policy 0, policy_version 465598 (0.0009) [2023-12-26 03:18:15,147][123091] Updated weights for policy 0, policy_version 465608 (0.0009) [2023-12-26 03:18:15,570][123090] Updated weights for policy 1, policy_version 462561 (0.0009) [2023-12-26 03:18:15,626][123090] Updated weights for policy 1, policy_version 462571 (0.0009) [2023-12-26 03:18:15,685][123090] Updated weights for policy 1, policy_version 462581 (0.0009) [2023-12-26 03:18:15,736][123090] Updated weights for policy 1, policy_version 462591 (0.0009) [2023-12-26 03:18:16,012][123091] Updated weights for policy 0, policy_version 465618 (0.0009) [2023-12-26 03:18:16,066][123091] Updated weights for policy 0, policy_version 465628 (0.0009) [2023-12-26 03:18:16,115][123091] Updated weights for policy 0, policy_version 465638 (0.0009) [2023-12-26 03:18:16,163][123091] Updated weights for policy 0, policy_version 465648 (0.0008) [2023-12-26 03:18:16,589][123090] Updated weights for policy 1, policy_version 462601 (0.0009) [2023-12-26 03:18:16,642][123090] Updated weights for policy 1, policy_version 462611 (0.0010) [2023-12-26 03:18:16,691][123090] Updated weights for policy 1, policy_version 462621 (0.0009) [2023-12-26 03:18:16,988][123091] Updated weights for policy 0, policy_version 465658 (0.0010) [2023-12-26 03:18:17,043][123091] Updated weights for policy 0, policy_version 465668 (0.0009) [2023-12-26 03:18:17,102][123091] Updated weights for policy 0, policy_version 465678 (0.0009) [2023-12-26 03:18:17,558][123090] Updated weights for policy 1, policy_version 462631 (0.0009) [2023-12-26 03:18:17,626][123090] Updated weights for policy 1, policy_version 462641 (0.0009) [2023-12-26 03:18:17,697][123090] Updated weights for policy 1, policy_version 462651 (0.0009) [2023-12-26 03:18:17,963][123091] Updated weights for policy 0, policy_version 465688 (0.0010) [2023-12-26 03:18:18,027][123091] Updated weights for policy 0, policy_version 465698 (0.0010) [2023-12-26 03:18:18,092][123091] Updated weights for policy 0, policy_version 465708 (0.0009) [2023-12-26 03:18:18,504][123090] Updated weights for policy 1, policy_version 462661 (0.0009) [2023-12-26 03:18:18,552][123090] Updated weights for policy 1, policy_version 462671 (0.0008) [2023-12-26 03:18:18,605][123090] Updated weights for policy 1, policy_version 462681 (0.0008) [2023-12-26 03:18:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 237674496. Throughput: 0: 8822.8, 1: 8568.8. Samples: 237685048. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:18,785][121949] Avg episode reward: [(0, '6141.597'), (1, '5919.026')] [2023-12-26 03:18:18,923][123091] Updated weights for policy 0, policy_version 465718 (0.0011) [2023-12-26 03:18:18,982][123091] Updated weights for policy 0, policy_version 465728 (0.0010) [2023-12-26 03:18:19,038][123091] Updated weights for policy 0, policy_version 465738 (0.0011) [2023-12-26 03:18:19,537][123090] Updated weights for policy 1, policy_version 462691 (0.0009) [2023-12-26 03:18:19,601][123090] Updated weights for policy 1, policy_version 462701 (0.0010) [2023-12-26 03:18:19,665][123090] Updated weights for policy 1, policy_version 462711 (0.0010) [2023-12-26 03:18:19,755][123091] Updated weights for policy 0, policy_version 465748 (0.0010) [2023-12-26 03:18:19,815][123091] Updated weights for policy 0, policy_version 465758 (0.0011) [2023-12-26 03:18:19,881][123091] Updated weights for policy 0, policy_version 465768 (0.0011) [2023-12-26 03:18:20,566][123090] Updated weights for policy 1, policy_version 462721 (0.0009) [2023-12-26 03:18:20,629][123090] Updated weights for policy 1, policy_version 462731 (0.0010) [2023-12-26 03:18:20,673][123091] Updated weights for policy 0, policy_version 465778 (0.0010) [2023-12-26 03:18:20,694][123090] Updated weights for policy 1, policy_version 462741 (0.0009) [2023-12-26 03:18:20,739][123091] Updated weights for policy 0, policy_version 465788 (0.0009) [2023-12-26 03:18:20,760][123090] Updated weights for policy 1, policy_version 462751 (0.0008) [2023-12-26 03:18:20,792][123091] Updated weights for policy 0, policy_version 465798 (0.0009) [2023-12-26 03:18:20,850][123091] Updated weights for policy 0, policy_version 465808 (0.0008) [2023-12-26 03:18:21,618][123090] Updated weights for policy 1, policy_version 462761 (0.0010) [2023-12-26 03:18:21,688][123090] Updated weights for policy 1, policy_version 462771 (0.0009) [2023-12-26 03:18:21,737][123091] Updated weights for policy 0, policy_version 465818 (0.0008) [2023-12-26 03:18:21,759][123090] Updated weights for policy 1, policy_version 462781 (0.0009) [2023-12-26 03:18:21,801][123091] Updated weights for policy 0, policy_version 465828 (0.0006) [2023-12-26 03:18:21,858][123091] Updated weights for policy 0, policy_version 465838 (0.0006) [2023-12-26 03:18:22,596][123090] Updated weights for policy 1, policy_version 462791 (0.0009) [2023-12-26 03:18:22,662][123090] Updated weights for policy 1, policy_version 462801 (0.0009) [2023-12-26 03:18:22,685][123091] Updated weights for policy 0, policy_version 465848 (0.0009) [2023-12-26 03:18:22,729][123090] Updated weights for policy 1, policy_version 462811 (0.0009) [2023-12-26 03:18:22,749][123091] Updated weights for policy 0, policy_version 465858 (0.0006) [2023-12-26 03:18:22,812][123091] Updated weights for policy 0, policy_version 465868 (0.0006) [2023-12-26 03:18:23,473][123091] Updated weights for policy 0, policy_version 465878 (0.0008) [2023-12-26 03:18:23,537][123091] Updated weights for policy 0, policy_version 465888 (0.0009) [2023-12-26 03:18:23,588][123090] Updated weights for policy 1, policy_version 462821 (0.0008) [2023-12-26 03:18:23,594][123091] Updated weights for policy 0, policy_version 465898 (0.0009) [2023-12-26 03:18:23,654][123090] Updated weights for policy 1, policy_version 462831 (0.0009) [2023-12-26 03:18:23,725][123090] Updated weights for policy 1, policy_version 462841 (0.0009) [2023-12-26 03:18:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 237764608. Throughput: 0: 8816.0, 1: 8534.2. Samples: 237735820. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:23,785][121949] Avg episode reward: [(0, '6112.098'), (1, '5908.228')] [2023-12-26 03:18:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000465904_119275520.pth... [2023-12-26 03:18:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000462848_118489088.pth... [2023-12-26 03:18:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000461824_118226944.pth [2023-12-26 03:18:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000464880_119013376.pth [2023-12-26 03:18:24,382][123091] Updated weights for policy 0, policy_version 465908 (0.0008) [2023-12-26 03:18:24,437][123091] Updated weights for policy 0, policy_version 465918 (0.0008) [2023-12-26 03:18:24,490][123091] Updated weights for policy 0, policy_version 465928 (0.0009) [2023-12-26 03:18:24,544][123090] Updated weights for policy 1, policy_version 462851 (0.0010) [2023-12-26 03:18:24,598][123090] Updated weights for policy 1, policy_version 462861 (0.0010) [2023-12-26 03:18:24,648][123090] Updated weights for policy 1, policy_version 462871 (0.0008) [2023-12-26 03:18:25,297][123091] Updated weights for policy 0, policy_version 465938 (0.0010) [2023-12-26 03:18:25,361][123091] Updated weights for policy 0, policy_version 465948 (0.0008) [2023-12-26 03:18:25,423][123091] Updated weights for policy 0, policy_version 465958 (0.0009) [2023-12-26 03:18:25,486][123091] Updated weights for policy 0, policy_version 465968 (0.0009) [2023-12-26 03:18:25,504][123090] Updated weights for policy 1, policy_version 462881 (0.0009) [2023-12-26 03:18:25,564][123090] Updated weights for policy 1, policy_version 462891 (0.0008) [2023-12-26 03:18:25,623][123090] Updated weights for policy 1, policy_version 462901 (0.0009) [2023-12-26 03:18:25,683][123090] Updated weights for policy 1, policy_version 462911 (0.0009) [2023-12-26 03:18:26,267][123091] Updated weights for policy 0, policy_version 465978 (0.0005) [2023-12-26 03:18:26,338][123091] Updated weights for policy 0, policy_version 465988 (0.0005) [2023-12-26 03:18:26,397][123091] Updated weights for policy 0, policy_version 465998 (0.0006) [2023-12-26 03:18:26,534][123090] Updated weights for policy 1, policy_version 462921 (0.0009) [2023-12-26 03:18:26,594][123090] Updated weights for policy 1, policy_version 462931 (0.0009) [2023-12-26 03:18:26,656][123090] Updated weights for policy 1, policy_version 462941 (0.0009) [2023-12-26 03:18:27,113][123091] Updated weights for policy 0, policy_version 466008 (0.0005) [2023-12-26 03:18:27,158][123091] Updated weights for policy 0, policy_version 466018 (0.0005) [2023-12-26 03:18:27,218][123091] Updated weights for policy 0, policy_version 466028 (0.0009) [2023-12-26 03:18:27,500][123090] Updated weights for policy 1, policy_version 462951 (0.0009) [2023-12-26 03:18:27,557][123090] Updated weights for policy 1, policy_version 462961 (0.0009) [2023-12-26 03:18:27,619][123090] Updated weights for policy 1, policy_version 462971 (0.0009) [2023-12-26 03:18:27,987][123091] Updated weights for policy 0, policy_version 466038 (0.0009) [2023-12-26 03:18:28,038][123091] Updated weights for policy 0, policy_version 466048 (0.0008) [2023-12-26 03:18:28,085][123091] Updated weights for policy 0, policy_version 466058 (0.0009) [2023-12-26 03:18:28,471][123090] Updated weights for policy 1, policy_version 462982 (0.0010) [2023-12-26 03:18:28,542][123090] Updated weights for policy 1, policy_version 462992 (0.0009) [2023-12-26 03:18:28,605][123090] Updated weights for policy 1, policy_version 463002 (0.0010) [2023-12-26 03:18:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 237846528. Throughput: 0: 8851.7, 1: 8496.6. Samples: 237840172. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:28,785][121949] Avg episode reward: [(0, '6103.498'), (1, '5898.635')] [2023-12-26 03:18:28,961][123091] Updated weights for policy 0, policy_version 466068 (0.0009) [2023-12-26 03:18:29,013][123091] Updated weights for policy 0, policy_version 466078 (0.0009) [2023-12-26 03:18:29,063][123091] Updated weights for policy 0, policy_version 466088 (0.0009) [2023-12-26 03:18:29,444][123090] Updated weights for policy 1, policy_version 463012 (0.0008) [2023-12-26 03:18:29,510][123090] Updated weights for policy 1, policy_version 463022 (0.0005) [2023-12-26 03:18:29,572][123090] Updated weights for policy 1, policy_version 463032 (0.0006) [2023-12-26 03:18:29,906][123091] Updated weights for policy 0, policy_version 466098 (0.0009) [2023-12-26 03:18:29,968][123091] Updated weights for policy 0, policy_version 466108 (0.0007) [2023-12-26 03:18:30,033][123091] Updated weights for policy 0, policy_version 466118 (0.0006) [2023-12-26 03:18:30,087][123091] Updated weights for policy 0, policy_version 466128 (0.0008) [2023-12-26 03:18:30,353][123090] Updated weights for policy 1, policy_version 463042 (0.0006) [2023-12-26 03:18:30,409][123090] Updated weights for policy 1, policy_version 463052 (0.0007) [2023-12-26 03:18:30,461][123090] Updated weights for policy 1, policy_version 463062 (0.0009) [2023-12-26 03:18:30,519][123090] Updated weights for policy 1, policy_version 463072 (0.0010) [2023-12-26 03:18:30,859][123091] Updated weights for policy 0, policy_version 466138 (0.0005) [2023-12-26 03:18:30,906][123091] Updated weights for policy 0, policy_version 466148 (0.0005) [2023-12-26 03:18:30,952][123091] Updated weights for policy 0, policy_version 466158 (0.0005) [2023-12-26 03:18:31,214][123090] Updated weights for policy 1, policy_version 463082 (0.0008) [2023-12-26 03:18:31,281][123090] Updated weights for policy 1, policy_version 463092 (0.0008) [2023-12-26 03:18:31,341][123090] Updated weights for policy 1, policy_version 463102 (0.0009) [2023-12-26 03:18:31,767][123091] Updated weights for policy 0, policy_version 466168 (0.0009) [2023-12-26 03:18:31,824][123091] Updated weights for policy 0, policy_version 466178 (0.0010) [2023-12-26 03:18:31,872][123091] Updated weights for policy 0, policy_version 466188 (0.0009) [2023-12-26 03:18:32,176][123090] Updated weights for policy 1, policy_version 463112 (0.0009) [2023-12-26 03:18:32,242][123090] Updated weights for policy 1, policy_version 463122 (0.0009) [2023-12-26 03:18:32,305][123090] Updated weights for policy 1, policy_version 463132 (0.0009) [2023-12-26 03:18:32,658][123091] Updated weights for policy 0, policy_version 466198 (0.0008) [2023-12-26 03:18:32,707][123091] Updated weights for policy 0, policy_version 466208 (0.0008) [2023-12-26 03:18:32,757][123091] Updated weights for policy 0, policy_version 466219 (0.0010) [2023-12-26 03:18:33,117][123090] Updated weights for policy 1, policy_version 463142 (0.0010) [2023-12-26 03:18:33,171][123090] Updated weights for policy 1, policy_version 463153 (0.0010) [2023-12-26 03:18:33,233][123090] Updated weights for policy 1, policy_version 463163 (0.0010) [2023-12-26 03:18:33,545][123091] Updated weights for policy 0, policy_version 466229 (0.0008) [2023-12-26 03:18:33,606][123091] Updated weights for policy 0, policy_version 466239 (0.0006) [2023-12-26 03:18:33,652][123091] Updated weights for policy 0, policy_version 466249 (0.0005) [2023-12-26 03:18:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 237936640. Throughput: 0: 8822.5, 1: 8579.7. Samples: 237946468. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:33,784][121949] Avg episode reward: [(0, '6057.528'), (1, '5810.987')] [2023-12-26 03:18:34,155][123090] Updated weights for policy 1, policy_version 463173 (0.0009) [2023-12-26 03:18:34,214][123090] Updated weights for policy 1, policy_version 463183 (0.0009) [2023-12-26 03:18:34,280][123090] Updated weights for policy 1, policy_version 463193 (0.0009) [2023-12-26 03:18:34,329][123091] Updated weights for policy 0, policy_version 466259 (0.0007) [2023-12-26 03:18:34,386][123091] Updated weights for policy 0, policy_version 466269 (0.0011) [2023-12-26 03:18:34,453][123091] Updated weights for policy 0, policy_version 466279 (0.0011) [2023-12-26 03:18:35,069][123090] Updated weights for policy 1, policy_version 463203 (0.0008) [2023-12-26 03:18:35,124][123090] Updated weights for policy 1, policy_version 463213 (0.0005) [2023-12-26 03:18:35,185][123090] Updated weights for policy 1, policy_version 463223 (0.0006) [2023-12-26 03:18:35,207][123091] Updated weights for policy 0, policy_version 466289 (0.0011) [2023-12-26 03:18:35,251][123091] Updated weights for policy 0, policy_version 466299 (0.0010) [2023-12-26 03:18:35,305][123091] Updated weights for policy 0, policy_version 466309 (0.0010) [2023-12-26 03:18:35,360][123091] Updated weights for policy 0, policy_version 466319 (0.0010) [2023-12-26 03:18:35,951][123090] Updated weights for policy 1, policy_version 463233 (0.0009) [2023-12-26 03:18:36,009][123090] Updated weights for policy 1, policy_version 463243 (0.0009) [2023-12-26 03:18:36,066][123090] Updated weights for policy 1, policy_version 463253 (0.0009) [2023-12-26 03:18:36,137][123090] Updated weights for policy 1, policy_version 463263 (0.0009) [2023-12-26 03:18:36,179][123091] Updated weights for policy 0, policy_version 466329 (0.0008) [2023-12-26 03:18:36,255][123091] Updated weights for policy 0, policy_version 466339 (0.0009) [2023-12-26 03:18:36,312][123091] Updated weights for policy 0, policy_version 466349 (0.0009) [2023-12-26 03:18:37,044][123091] Updated weights for policy 0, policy_version 466359 (0.0010) [2023-12-26 03:18:37,046][123090] Updated weights for policy 1, policy_version 463273 (0.0007) [2023-12-26 03:18:37,097][123090] Updated weights for policy 1, policy_version 463283 (0.0009) [2023-12-26 03:18:37,107][123091] Updated weights for policy 0, policy_version 466369 (0.0008) [2023-12-26 03:18:37,155][123090] Updated weights for policy 1, policy_version 463293 (0.0009) [2023-12-26 03:18:37,159][123091] Updated weights for policy 0, policy_version 466379 (0.0009) [2023-12-26 03:18:37,951][123090] Updated weights for policy 1, policy_version 463303 (0.0010) [2023-12-26 03:18:37,981][123091] Updated weights for policy 0, policy_version 466389 (0.0007) [2023-12-26 03:18:38,007][123090] Updated weights for policy 1, policy_version 463313 (0.0008) [2023-12-26 03:18:38,046][123091] Updated weights for policy 0, policy_version 466399 (0.0009) [2023-12-26 03:18:38,070][123090] Updated weights for policy 1, policy_version 463323 (0.0009) [2023-12-26 03:18:38,103][123091] Updated weights for policy 0, policy_version 466409 (0.0007) [2023-12-26 03:18:38,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17339.7, 300 sec: 17605.8). Total num frames: 238018560. Throughput: 0: 8843.4, 1: 8562.9. Samples: 237999780. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:38,785][121949] Avg episode reward: [(0, '6145.749'), (1, '5806.602')] [2023-12-26 03:18:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000466416_119406592.pth... [2023-12-26 03:18:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000463328_118611968.pth... [2023-12-26 03:18:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000465392_119144448.pth [2023-12-26 03:18:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000462368_118366208.pth [2023-12-26 03:18:38,929][123090] Updated weights for policy 1, policy_version 463333 (0.0009) [2023-12-26 03:18:38,929][123091] Updated weights for policy 0, policy_version 466419 (0.0010) [2023-12-26 03:18:38,990][123090] Updated weights for policy 1, policy_version 463343 (0.0005) [2023-12-26 03:18:38,994][123091] Updated weights for policy 0, policy_version 466429 (0.0010) [2023-12-26 03:18:39,056][123090] Updated weights for policy 1, policy_version 463353 (0.0006) [2023-12-26 03:18:39,061][123091] Updated weights for policy 0, policy_version 466439 (0.0009) [2023-12-26 03:18:39,865][123090] Updated weights for policy 1, policy_version 463363 (0.0007) [2023-12-26 03:18:39,923][123090] Updated weights for policy 1, policy_version 463373 (0.0009) [2023-12-26 03:18:39,961][123091] Updated weights for policy 0, policy_version 466450 (0.0009) [2023-12-26 03:18:39,990][123090] Updated weights for policy 1, policy_version 463383 (0.0009) [2023-12-26 03:18:40,023][123091] Updated weights for policy 0, policy_version 466460 (0.0009) [2023-12-26 03:18:40,082][123091] Updated weights for policy 0, policy_version 466470 (0.0009) [2023-12-26 03:18:40,144][123091] Updated weights for policy 0, policy_version 466480 (0.0009) [2023-12-26 03:18:40,825][123090] Updated weights for policy 1, policy_version 463393 (0.0008) [2023-12-26 03:18:40,883][123090] Updated weights for policy 1, policy_version 463403 (0.0006) [2023-12-26 03:18:40,951][123090] Updated weights for policy 1, policy_version 463413 (0.0006) [2023-12-26 03:18:40,990][123091] Updated weights for policy 0, policy_version 466490 (0.0010) [2023-12-26 03:18:41,013][123090] Updated weights for policy 1, policy_version 463423 (0.0006) [2023-12-26 03:18:41,058][123091] Updated weights for policy 0, policy_version 466500 (0.0009) [2023-12-26 03:18:41,122][123091] Updated weights for policy 0, policy_version 466510 (0.0009) [2023-12-26 03:18:41,839][123090] Updated weights for policy 1, policy_version 463433 (0.0010) [2023-12-26 03:18:41,900][123090] Updated weights for policy 1, policy_version 463443 (0.0010) [2023-12-26 03:18:41,970][123090] Updated weights for policy 1, policy_version 463453 (0.0008) [2023-12-26 03:18:41,975][123091] Updated weights for policy 0, policy_version 466520 (0.0008) [2023-12-26 03:18:42,040][123091] Updated weights for policy 0, policy_version 466530 (0.0006) [2023-12-26 03:18:42,111][123091] Updated weights for policy 0, policy_version 466540 (0.0005) [2023-12-26 03:18:42,682][123090] Updated weights for policy 1, policy_version 463463 (0.0008) [2023-12-26 03:18:42,755][123090] Updated weights for policy 1, policy_version 463473 (0.0011) [2023-12-26 03:18:42,827][123090] Updated weights for policy 1, policy_version 463483 (0.0011) [2023-12-26 03:18:42,846][123091] Updated weights for policy 0, policy_version 466550 (0.0006) [2023-12-26 03:18:42,915][123091] Updated weights for policy 0, policy_version 466560 (0.0006) [2023-12-26 03:18:42,983][123091] Updated weights for policy 0, policy_version 466571 (0.0008) [2023-12-26 03:18:43,616][123090] Updated weights for policy 1, policy_version 463493 (0.0008) [2023-12-26 03:18:43,677][123090] Updated weights for policy 1, policy_version 463503 (0.0007) [2023-12-26 03:18:43,690][123091] Updated weights for policy 0, policy_version 466581 (0.0007) [2023-12-26 03:18:43,730][123090] Updated weights for policy 1, policy_version 463513 (0.0009) [2023-12-26 03:18:43,755][123091] Updated weights for policy 0, policy_version 466591 (0.0005) [2023-12-26 03:18:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 238108672. Throughput: 0: 8793.1, 1: 8538.5. Samples: 238102292. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:43,784][121949] Avg episode reward: [(0, '6197.994'), (1, '5942.175')] [2023-12-26 03:18:43,825][123091] Updated weights for policy 0, policy_version 466601 (0.0006) [2023-12-26 03:18:44,447][123091] Updated weights for policy 0, policy_version 466611 (0.0007) [2023-12-26 03:18:44,455][123090] Updated weights for policy 1, policy_version 463523 (0.0007) [2023-12-26 03:18:44,508][123090] Updated weights for policy 1, policy_version 463533 (0.0006) [2023-12-26 03:18:44,515][123091] Updated weights for policy 0, policy_version 466621 (0.0008) [2023-12-26 03:18:44,561][123090] Updated weights for policy 1, policy_version 463543 (0.0008) [2023-12-26 03:18:44,576][123091] Updated weights for policy 0, policy_version 466631 (0.0008) [2023-12-26 03:18:45,323][123090] Updated weights for policy 1, policy_version 463553 (0.0008) [2023-12-26 03:18:45,374][123090] Updated weights for policy 1, policy_version 463563 (0.0008) [2023-12-26 03:18:45,425][123090] Updated weights for policy 1, policy_version 463573 (0.0008) [2023-12-26 03:18:45,466][123091] Updated weights for policy 0, policy_version 466641 (0.0009) [2023-12-26 03:18:45,486][123090] Updated weights for policy 1, policy_version 463583 (0.0008) [2023-12-26 03:18:45,532][123091] Updated weights for policy 0, policy_version 466651 (0.0010) [2023-12-26 03:18:45,602][123091] Updated weights for policy 0, policy_version 466661 (0.0010) [2023-12-26 03:18:45,665][123091] Updated weights for policy 0, policy_version 466671 (0.0010) [2023-12-26 03:18:46,334][123091] Updated weights for policy 0, policy_version 466681 (0.0006) [2023-12-26 03:18:46,375][123090] Updated weights for policy 1, policy_version 463593 (0.0008) [2023-12-26 03:18:46,384][123091] Updated weights for policy 0, policy_version 466691 (0.0005) [2023-12-26 03:18:46,433][123090] Updated weights for policy 1, policy_version 463603 (0.0010) [2023-12-26 03:18:46,437][123091] Updated weights for policy 0, policy_version 466701 (0.0005) [2023-12-26 03:18:46,490][123090] Updated weights for policy 1, policy_version 463613 (0.0010) [2023-12-26 03:18:47,237][123091] Updated weights for policy 0, policy_version 466711 (0.0006) [2023-12-26 03:18:47,290][123091] Updated weights for policy 0, policy_version 466721 (0.0005) [2023-12-26 03:18:47,315][123090] Updated weights for policy 1, policy_version 463623 (0.0011) [2023-12-26 03:18:47,347][123091] Updated weights for policy 0, policy_version 466731 (0.0005) [2023-12-26 03:18:47,365][123090] Updated weights for policy 1, policy_version 463634 (0.0009) [2023-12-26 03:18:47,420][123090] Updated weights for policy 1, policy_version 463644 (0.0010) [2023-12-26 03:18:48,132][123090] Updated weights for policy 1, policy_version 463654 (0.0007) [2023-12-26 03:18:48,158][123091] Updated weights for policy 0, policy_version 466741 (0.0008) [2023-12-26 03:18:48,181][123090] Updated weights for policy 1, policy_version 463664 (0.0006) [2023-12-26 03:18:48,226][123091] Updated weights for policy 0, policy_version 466751 (0.0009) [2023-12-26 03:18:48,228][123090] Updated weights for policy 1, policy_version 463674 (0.0005) [2023-12-26 03:18:48,291][123091] Updated weights for policy 0, policy_version 466761 (0.0009) [2023-12-26 03:18:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 238198784. Throughput: 0: 8859.9, 1: 8586.0. Samples: 238211872. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:48,785][121949] Avg episode reward: [(0, '6107.065'), (1, '5916.822')] [2023-12-26 03:18:48,833][123090] Updated weights for policy 1, policy_version 463684 (0.0005) [2023-12-26 03:18:48,905][123090] Updated weights for policy 1, policy_version 463694 (0.0006) [2023-12-26 03:18:48,962][123090] Updated weights for policy 1, policy_version 463704 (0.0008) [2023-12-26 03:18:49,106][123091] Updated weights for policy 0, policy_version 466771 (0.0009) [2023-12-26 03:18:49,178][123091] Updated weights for policy 0, policy_version 466781 (0.0010) [2023-12-26 03:18:49,262][123091] Updated weights for policy 0, policy_version 466791 (0.0010) [2023-12-26 03:18:49,786][123090] Updated weights for policy 1, policy_version 463714 (0.0009) [2023-12-26 03:18:49,859][123090] Updated weights for policy 1, policy_version 463724 (0.0010) [2023-12-26 03:18:49,927][123090] Updated weights for policy 1, policy_version 463734 (0.0009) [2023-12-26 03:18:49,997][123090] Updated weights for policy 1, policy_version 463744 (0.0009) [2023-12-26 03:18:50,021][123091] Updated weights for policy 0, policy_version 466801 (0.0009) [2023-12-26 03:18:50,088][123091] Updated weights for policy 0, policy_version 466811 (0.0008) [2023-12-26 03:18:50,157][123091] Updated weights for policy 0, policy_version 466821 (0.0008) [2023-12-26 03:18:50,211][123091] Updated weights for policy 0, policy_version 466831 (0.0008) [2023-12-26 03:18:50,855][123090] Updated weights for policy 1, policy_version 463754 (0.0009) [2023-12-26 03:18:50,921][123090] Updated weights for policy 1, policy_version 463764 (0.0010) [2023-12-26 03:18:50,992][123090] Updated weights for policy 1, policy_version 463774 (0.0008) [2023-12-26 03:18:51,007][123091] Updated weights for policy 0, policy_version 466841 (0.0008) [2023-12-26 03:18:51,071][123091] Updated weights for policy 0, policy_version 466851 (0.0010) [2023-12-26 03:18:51,128][123091] Updated weights for policy 0, policy_version 466861 (0.0009) [2023-12-26 03:18:51,816][123090] Updated weights for policy 1, policy_version 463784 (0.0009) [2023-12-26 03:18:51,886][123090] Updated weights for policy 1, policy_version 463794 (0.0010) [2023-12-26 03:18:51,958][123090] Updated weights for policy 1, policy_version 463804 (0.0010) [2023-12-26 03:18:51,982][123091] Updated weights for policy 0, policy_version 466871 (0.0008) [2023-12-26 03:18:52,034][123091] Updated weights for policy 0, policy_version 466881 (0.0010) [2023-12-26 03:18:52,093][123091] Updated weights for policy 0, policy_version 466891 (0.0009) [2023-12-26 03:18:52,744][123090] Updated weights for policy 1, policy_version 463814 (0.0009) [2023-12-26 03:18:52,806][123090] Updated weights for policy 1, policy_version 463824 (0.0008) [2023-12-26 03:18:52,868][123090] Updated weights for policy 1, policy_version 463834 (0.0007) [2023-12-26 03:18:52,982][123091] Updated weights for policy 0, policy_version 466901 (0.0010) [2023-12-26 03:18:53,048][123091] Updated weights for policy 0, policy_version 466911 (0.0011) [2023-12-26 03:18:53,114][123091] Updated weights for policy 0, policy_version 466921 (0.0011) [2023-12-26 03:18:53,687][123090] Updated weights for policy 1, policy_version 463844 (0.0009) [2023-12-26 03:18:53,735][123090] Updated weights for policy 1, policy_version 463854 (0.0009) [2023-12-26 03:18:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 238280704. Throughput: 0: 8861.3, 1: 8523.9. Samples: 238262692. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:53,784][121949] Avg episode reward: [(0, '5904.401'), (1, '5967.009')] [2023-12-26 03:18:53,786][123090] Updated weights for policy 1, policy_version 463864 (0.0008) [2023-12-26 03:18:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000466928_119537664.pth... [2023-12-26 03:18:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000465904_119275520.pth [2023-12-26 03:18:53,819][123091] Updated weights for policy 0, policy_version 466931 (0.0011) [2023-12-26 03:18:53,828][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000463872_118751232.pth... [2023-12-26 03:18:53,831][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000462848_118489088.pth [2023-12-26 03:18:53,863][123091] Updated weights for policy 0, policy_version 466941 (0.0010) [2023-12-26 03:18:53,925][123091] Updated weights for policy 0, policy_version 466951 (0.0010) [2023-12-26 03:18:54,652][123090] Updated weights for policy 1, policy_version 463874 (0.0008) [2023-12-26 03:18:54,701][123090] Updated weights for policy 1, policy_version 463884 (0.0009) [2023-12-26 03:18:54,756][123090] Updated weights for policy 1, policy_version 463894 (0.0008) [2023-12-26 03:18:54,758][123091] Updated weights for policy 0, policy_version 466961 (0.0010) [2023-12-26 03:18:54,817][123091] Updated weights for policy 0, policy_version 466971 (0.0011) [2023-12-26 03:18:54,819][123090] Updated weights for policy 1, policy_version 463904 (0.0006) [2023-12-26 03:18:54,879][123091] Updated weights for policy 0, policy_version 466981 (0.0010) [2023-12-26 03:18:54,942][123091] Updated weights for policy 0, policy_version 466991 (0.0011) [2023-12-26 03:18:55,677][123090] Updated weights for policy 1, policy_version 463914 (0.0009) [2023-12-26 03:18:55,728][123090] Updated weights for policy 1, policy_version 463924 (0.0009) [2023-12-26 03:18:55,769][123091] Updated weights for policy 0, policy_version 467001 (0.0011) [2023-12-26 03:18:55,785][123090] Updated weights for policy 1, policy_version 463934 (0.0006) [2023-12-26 03:18:55,824][123091] Updated weights for policy 0, policy_version 467011 (0.0010) [2023-12-26 03:18:55,875][123091] Updated weights for policy 0, policy_version 467021 (0.0010) [2023-12-26 03:18:56,624][123090] Updated weights for policy 1, policy_version 463944 (0.0008) [2023-12-26 03:18:56,679][123090] Updated weights for policy 1, policy_version 463954 (0.0009) [2023-12-26 03:18:56,691][123091] Updated weights for policy 0, policy_version 467031 (0.0010) [2023-12-26 03:18:56,738][123090] Updated weights for policy 1, policy_version 463964 (0.0007) [2023-12-26 03:18:56,752][123091] Updated weights for policy 0, policy_version 467041 (0.0010) [2023-12-26 03:18:56,813][123091] Updated weights for policy 0, policy_version 467051 (0.0010) [2023-12-26 03:18:57,584][123090] Updated weights for policy 1, policy_version 463974 (0.0008) [2023-12-26 03:18:57,626][123091] Updated weights for policy 0, policy_version 467061 (0.0011) [2023-12-26 03:18:57,645][123090] Updated weights for policy 1, policy_version 463984 (0.0006) [2023-12-26 03:18:57,672][123091] Updated weights for policy 0, policy_version 467071 (0.0010) [2023-12-26 03:18:57,690][123090] Updated weights for policy 1, policy_version 463994 (0.0009) [2023-12-26 03:18:57,723][123091] Updated weights for policy 0, policy_version 467081 (0.0010) [2023-12-26 03:18:58,535][123090] Updated weights for policy 1, policy_version 464004 (0.0006) [2023-12-26 03:18:58,571][123091] Updated weights for policy 0, policy_version 467091 (0.0009) [2023-12-26 03:18:58,609][123090] Updated weights for policy 1, policy_version 464014 (0.0008) [2023-12-26 03:18:58,652][123091] Updated weights for policy 0, policy_version 467101 (0.0009) [2023-12-26 03:18:58,682][123090] Updated weights for policy 1, policy_version 464024 (0.0007) [2023-12-26 03:18:58,726][123091] Updated weights for policy 0, policy_version 467111 (0.0010) [2023-12-26 03:18:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17340.3, 300 sec: 17605.9). Total num frames: 238370816. Throughput: 0: 8877.5, 1: 8536.8. Samples: 238366240. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:18:58,785][121949] Avg episode reward: [(0, '6014.147'), (1, '5857.432')] [2023-12-26 03:18:59,434][123091] Updated weights for policy 0, policy_version 467121 (0.0008) [2023-12-26 03:18:59,506][123091] Updated weights for policy 0, policy_version 467131 (0.0005) [2023-12-26 03:18:59,508][123090] Updated weights for policy 1, policy_version 464034 (0.0007) [2023-12-26 03:18:59,557][123091] Updated weights for policy 0, policy_version 467141 (0.0007) [2023-12-26 03:18:59,576][123090] Updated weights for policy 1, policy_version 464044 (0.0005) [2023-12-26 03:18:59,612][123091] Updated weights for policy 0, policy_version 467151 (0.0006) [2023-12-26 03:18:59,635][123090] Updated weights for policy 1, policy_version 464054 (0.0005) [2023-12-26 03:18:59,695][123090] Updated weights for policy 1, policy_version 464064 (0.0005) [2023-12-26 03:19:00,330][123091] Updated weights for policy 0, policy_version 467161 (0.0006) [2023-12-26 03:19:00,396][123091] Updated weights for policy 0, policy_version 467171 (0.0005) [2023-12-26 03:19:00,423][123090] Updated weights for policy 1, policy_version 464074 (0.0005) [2023-12-26 03:19:00,447][123091] Updated weights for policy 0, policy_version 467181 (0.0005) [2023-12-26 03:19:00,478][123090] Updated weights for policy 1, policy_version 464084 (0.0005) [2023-12-26 03:19:00,525][123090] Updated weights for policy 1, policy_version 464094 (0.0007) [2023-12-26 03:19:01,256][123090] Updated weights for policy 1, policy_version 464104 (0.0009) [2023-12-26 03:19:01,258][123091] Updated weights for policy 0, policy_version 467191 (0.0008) [2023-12-26 03:19:01,317][123090] Updated weights for policy 1, policy_version 464114 (0.0009) [2023-12-26 03:19:01,319][123091] Updated weights for policy 0, policy_version 467201 (0.0008) [2023-12-26 03:19:01,383][123090] Updated weights for policy 1, policy_version 464124 (0.0009) [2023-12-26 03:19:01,392][123091] Updated weights for policy 0, policy_version 467211 (0.0009) [2023-12-26 03:19:02,187][123090] Updated weights for policy 1, policy_version 464134 (0.0007) [2023-12-26 03:19:02,226][123091] Updated weights for policy 0, policy_version 467221 (0.0009) [2023-12-26 03:19:02,238][123090] Updated weights for policy 1, policy_version 464144 (0.0005) [2023-12-26 03:19:02,289][123091] Updated weights for policy 0, policy_version 467231 (0.0009) [2023-12-26 03:19:02,307][123090] Updated weights for policy 1, policy_version 464154 (0.0008) [2023-12-26 03:19:02,335][123091] Updated weights for policy 0, policy_version 467241 (0.0009) [2023-12-26 03:19:03,060][123090] Updated weights for policy 1, policy_version 464164 (0.0008) [2023-12-26 03:19:03,090][123091] Updated weights for policy 0, policy_version 467251 (0.0008) [2023-12-26 03:19:03,119][123090] Updated weights for policy 1, policy_version 464174 (0.0010) [2023-12-26 03:19:03,150][123091] Updated weights for policy 0, policy_version 467261 (0.0006) [2023-12-26 03:19:03,178][123090] Updated weights for policy 1, policy_version 464184 (0.0010) [2023-12-26 03:19:03,214][123091] Updated weights for policy 0, policy_version 467271 (0.0005) [2023-12-26 03:19:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 238460928. Throughput: 0: 8914.6, 1: 8641.0. Samples: 238475056. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:03,785][121949] Avg episode reward: [(0, '6153.204'), (1, '5775.118')] [2023-12-26 03:19:03,802][123091] Updated weights for policy 0, policy_version 467281 (0.0006) [2023-12-26 03:19:03,865][123091] Updated weights for policy 0, policy_version 467291 (0.0013) [2023-12-26 03:19:03,893][123090] Updated weights for policy 1, policy_version 464194 (0.0010) [2023-12-26 03:19:03,932][123091] Updated weights for policy 0, policy_version 467301 (0.0008) [2023-12-26 03:19:03,939][123090] Updated weights for policy 1, policy_version 464204 (0.0008) [2023-12-26 03:19:03,993][123090] Updated weights for policy 1, policy_version 464214 (0.0008) [2023-12-26 03:19:03,998][123091] Updated weights for policy 0, policy_version 467311 (0.0008) [2023-12-26 03:19:04,044][123090] Updated weights for policy 1, policy_version 464224 (0.0009) [2023-12-26 03:19:04,717][123091] Updated weights for policy 0, policy_version 467321 (0.0006) [2023-12-26 03:19:04,777][123091] Updated weights for policy 0, policy_version 467331 (0.0006) [2023-12-26 03:19:04,846][123091] Updated weights for policy 0, policy_version 467341 (0.0005) [2023-12-26 03:19:04,982][123090] Updated weights for policy 1, policy_version 464234 (0.0009) [2023-12-26 03:19:05,042][123090] Updated weights for policy 1, policy_version 464244 (0.0010) [2023-12-26 03:19:05,096][123090] Updated weights for policy 1, policy_version 464254 (0.0010) [2023-12-26 03:19:05,614][123091] Updated weights for policy 0, policy_version 467351 (0.0008) [2023-12-26 03:19:05,662][123091] Updated weights for policy 0, policy_version 467361 (0.0005) [2023-12-26 03:19:05,717][123091] Updated weights for policy 0, policy_version 467371 (0.0005) [2023-12-26 03:19:05,869][123090] Updated weights for policy 1, policy_version 464264 (0.0010) [2023-12-26 03:19:05,923][123090] Updated weights for policy 1, policy_version 464274 (0.0007) [2023-12-26 03:19:05,972][123090] Updated weights for policy 1, policy_version 464284 (0.0005) [2023-12-26 03:19:06,562][123091] Updated weights for policy 0, policy_version 467381 (0.0007) [2023-12-26 03:19:06,618][123091] Updated weights for policy 0, policy_version 467391 (0.0010) [2023-12-26 03:19:06,677][123091] Updated weights for policy 0, policy_version 467401 (0.0010) [2023-12-26 03:19:06,718][123090] Updated weights for policy 1, policy_version 464294 (0.0008) [2023-12-26 03:19:06,774][123090] Updated weights for policy 1, policy_version 464304 (0.0009) [2023-12-26 03:19:06,831][123090] Updated weights for policy 1, policy_version 464314 (0.0009) [2023-12-26 03:19:07,498][123091] Updated weights for policy 0, policy_version 467411 (0.0009) [2023-12-26 03:19:07,546][123091] Updated weights for policy 0, policy_version 467421 (0.0011) [2023-12-26 03:19:07,609][123091] Updated weights for policy 0, policy_version 467431 (0.0011) [2023-12-26 03:19:07,658][123090] Updated weights for policy 1, policy_version 464324 (0.0007) [2023-12-26 03:19:07,720][123090] Updated weights for policy 1, policy_version 464334 (0.0008) [2023-12-26 03:19:07,771][123090] Updated weights for policy 1, policy_version 464344 (0.0008) [2023-12-26 03:19:08,426][123091] Updated weights for policy 0, policy_version 467441 (0.0010) [2023-12-26 03:19:08,492][123091] Updated weights for policy 0, policy_version 467451 (0.0005) [2023-12-26 03:19:08,556][123091] Updated weights for policy 0, policy_version 467461 (0.0006) [2023-12-26 03:19:08,616][123090] Updated weights for policy 1, policy_version 464354 (0.0009) [2023-12-26 03:19:08,624][123091] Updated weights for policy 0, policy_version 467471 (0.0006) [2023-12-26 03:19:08,689][123090] Updated weights for policy 1, policy_version 464364 (0.0010) [2023-12-26 03:19:08,763][123090] Updated weights for policy 1, policy_version 464374 (0.0009) [2023-12-26 03:19:08,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 238551040. Throughput: 0: 8938.4, 1: 8685.9. Samples: 238528920. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:08,786][121949] Avg episode reward: [(0, '6075.287'), (1, '5738.793')] [2023-12-26 03:19:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000467472_119676928.pth... [2023-12-26 03:19:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000466416_119406592.pth [2023-12-26 03:19:08,831][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000464384_118882304.pth... [2023-12-26 03:19:08,833][123090] Updated weights for policy 1, policy_version 464384 (0.0009) [2023-12-26 03:19:08,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000463328_118611968.pth [2023-12-26 03:19:09,358][123091] Updated weights for policy 0, policy_version 467481 (0.0007) [2023-12-26 03:19:09,428][123091] Updated weights for policy 0, policy_version 467491 (0.0008) [2023-12-26 03:19:09,500][123091] Updated weights for policy 0, policy_version 467501 (0.0006) [2023-12-26 03:19:09,715][123090] Updated weights for policy 1, policy_version 464394 (0.0011) [2023-12-26 03:19:09,782][123090] Updated weights for policy 1, policy_version 464404 (0.0010) [2023-12-26 03:19:09,854][123090] Updated weights for policy 1, policy_version 464414 (0.0010) [2023-12-26 03:19:10,228][123091] Updated weights for policy 0, policy_version 467511 (0.0008) [2023-12-26 03:19:10,288][123091] Updated weights for policy 0, policy_version 467521 (0.0008) [2023-12-26 03:19:10,351][123091] Updated weights for policy 0, policy_version 467531 (0.0009) [2023-12-26 03:19:10,679][123090] Updated weights for policy 1, policy_version 464424 (0.0010) [2023-12-26 03:19:10,750][123090] Updated weights for policy 1, policy_version 464434 (0.0011) [2023-12-26 03:19:10,818][123090] Updated weights for policy 1, policy_version 464444 (0.0007) [2023-12-26 03:19:11,215][123091] Updated weights for policy 0, policy_version 467541 (0.0009) [2023-12-26 03:19:11,279][123091] Updated weights for policy 0, policy_version 467551 (0.0009) [2023-12-26 03:19:11,348][123091] Updated weights for policy 0, policy_version 467561 (0.0009) [2023-12-26 03:19:11,651][123090] Updated weights for policy 1, policy_version 464454 (0.0007) [2023-12-26 03:19:11,719][123090] Updated weights for policy 1, policy_version 464464 (0.0009) [2023-12-26 03:19:11,790][123090] Updated weights for policy 1, policy_version 464474 (0.0008) [2023-12-26 03:19:12,194][123091] Updated weights for policy 0, policy_version 467571 (0.0010) [2023-12-26 03:19:12,253][123091] Updated weights for policy 0, policy_version 467581 (0.0011) [2023-12-26 03:19:12,318][123091] Updated weights for policy 0, policy_version 467591 (0.0011) [2023-12-26 03:19:12,605][123090] Updated weights for policy 1, policy_version 464484 (0.0009) [2023-12-26 03:19:12,677][123090] Updated weights for policy 1, policy_version 464494 (0.0010) [2023-12-26 03:19:12,744][123090] Updated weights for policy 1, policy_version 464504 (0.0011) [2023-12-26 03:19:13,124][123091] Updated weights for policy 0, policy_version 467602 (0.0010) [2023-12-26 03:19:13,181][123091] Updated weights for policy 0, policy_version 467612 (0.0009) [2023-12-26 03:19:13,238][123091] Updated weights for policy 0, policy_version 467622 (0.0009) [2023-12-26 03:19:13,465][123090] Updated weights for policy 1, policy_version 464514 (0.0009) [2023-12-26 03:19:13,513][123090] Updated weights for policy 1, policy_version 464524 (0.0005) [2023-12-26 03:19:13,569][123090] Updated weights for policy 1, policy_version 464534 (0.0005) [2023-12-26 03:19:13,622][123090] Updated weights for policy 1, policy_version 464544 (0.0005) [2023-12-26 03:19:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 238641152. Throughput: 0: 8887.7, 1: 8706.2. Samples: 238631900. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:13,785][121949] Avg episode reward: [(0, '6116.855'), (1, '5814.005')] [2023-12-26 03:19:14,123][123091] Updated weights for policy 0, policy_version 467633 (0.0010) [2023-12-26 03:19:14,173][123091] Updated weights for policy 0, policy_version 467643 (0.0009) [2023-12-26 03:19:14,221][123091] Updated weights for policy 0, policy_version 467653 (0.0009) [2023-12-26 03:19:14,269][123091] Updated weights for policy 0, policy_version 467663 (0.0009) [2023-12-26 03:19:14,386][123090] Updated weights for policy 1, policy_version 464554 (0.0010) [2023-12-26 03:19:14,448][123090] Updated weights for policy 1, policy_version 464564 (0.0010) [2023-12-26 03:19:14,499][123090] Updated weights for policy 1, policy_version 464574 (0.0010) [2023-12-26 03:19:15,142][123091] Updated weights for policy 0, policy_version 467673 (0.0008) [2023-12-26 03:19:15,216][123091] Updated weights for policy 0, policy_version 467683 (0.0005) [2023-12-26 03:19:15,286][123091] Updated weights for policy 0, policy_version 467693 (0.0006) [2023-12-26 03:19:15,360][123090] Updated weights for policy 1, policy_version 464584 (0.0010) [2023-12-26 03:19:15,431][123090] Updated weights for policy 1, policy_version 464594 (0.0010) [2023-12-26 03:19:15,497][123090] Updated weights for policy 1, policy_version 464604 (0.0010) [2023-12-26 03:19:15,943][123091] Updated weights for policy 0, policy_version 467703 (0.0005) [2023-12-26 03:19:15,996][123091] Updated weights for policy 0, policy_version 467713 (0.0005) [2023-12-26 03:19:16,050][123091] Updated weights for policy 0, policy_version 467723 (0.0005) [2023-12-26 03:19:16,239][123090] Updated weights for policy 1, policy_version 464614 (0.0007) [2023-12-26 03:19:16,298][123090] Updated weights for policy 1, policy_version 464624 (0.0008) [2023-12-26 03:19:16,361][123090] Updated weights for policy 1, policy_version 464634 (0.0011) [2023-12-26 03:19:16,834][123091] Updated weights for policy 0, policy_version 467733 (0.0007) [2023-12-26 03:19:16,893][123091] Updated weights for policy 0, policy_version 467743 (0.0010) [2023-12-26 03:19:16,960][123091] Updated weights for policy 0, policy_version 467753 (0.0010) [2023-12-26 03:19:17,032][123090] Updated weights for policy 1, policy_version 464644 (0.0008) [2023-12-26 03:19:17,095][123090] Updated weights for policy 1, policy_version 464654 (0.0005) [2023-12-26 03:19:17,162][123090] Updated weights for policy 1, policy_version 464664 (0.0005) [2023-12-26 03:19:17,662][123091] Updated weights for policy 0, policy_version 467763 (0.0009) [2023-12-26 03:19:17,708][123091] Updated weights for policy 0, policy_version 467773 (0.0005) [2023-12-26 03:19:17,763][123091] Updated weights for policy 0, policy_version 467783 (0.0006) [2023-12-26 03:19:17,782][123090] Updated weights for policy 1, policy_version 464674 (0.0005) [2023-12-26 03:19:17,836][123090] Updated weights for policy 1, policy_version 464684 (0.0005) [2023-12-26 03:19:17,889][123090] Updated weights for policy 1, policy_version 464694 (0.0005) [2023-12-26 03:19:17,950][123090] Updated weights for policy 1, policy_version 464704 (0.0005) [2023-12-26 03:19:18,472][123091] Updated weights for policy 0, policy_version 467793 (0.0006) [2023-12-26 03:19:18,544][123091] Updated weights for policy 0, policy_version 467803 (0.0006) [2023-12-26 03:19:18,613][123091] Updated weights for policy 0, policy_version 467813 (0.0007) [2023-12-26 03:19:18,657][123090] Updated weights for policy 1, policy_version 464714 (0.0005) [2023-12-26 03:19:18,680][123091] Updated weights for policy 0, policy_version 467823 (0.0006) [2023-12-26 03:19:18,721][123090] Updated weights for policy 1, policy_version 464724 (0.0006) [2023-12-26 03:19:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 238731264. Throughput: 0: 8922.9, 1: 8808.1. Samples: 238744364. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:18,785][121949] Avg episode reward: [(0, '6154.498'), (1, '5855.156')] [2023-12-26 03:19:18,796][123090] Updated weights for policy 1, policy_version 464734 (0.0006) [2023-12-26 03:19:19,406][123091] Updated weights for policy 0, policy_version 467833 (0.0009) [2023-12-26 03:19:19,459][123091] Updated weights for policy 0, policy_version 467843 (0.0009) [2023-12-26 03:19:19,523][123091] Updated weights for policy 0, policy_version 467853 (0.0009) [2023-12-26 03:19:19,529][123090] Updated weights for policy 1, policy_version 464744 (0.0008) [2023-12-26 03:19:19,595][123090] Updated weights for policy 1, policy_version 464754 (0.0009) [2023-12-26 03:19:19,665][123090] Updated weights for policy 1, policy_version 464764 (0.0009) [2023-12-26 03:19:20,418][123091] Updated weights for policy 0, policy_version 467863 (0.0009) [2023-12-26 03:19:20,469][123091] Updated weights for policy 0, policy_version 467873 (0.0009) [2023-12-26 03:19:20,519][123091] Updated weights for policy 0, policy_version 467883 (0.0009) [2023-12-26 03:19:20,524][123090] Updated weights for policy 1, policy_version 464774 (0.0010) [2023-12-26 03:19:20,592][123090] Updated weights for policy 1, policy_version 464784 (0.0011) [2023-12-26 03:19:20,656][123090] Updated weights for policy 1, policy_version 464794 (0.0011) [2023-12-26 03:19:21,428][123091] Updated weights for policy 0, policy_version 467893 (0.0007) [2023-12-26 03:19:21,488][123091] Updated weights for policy 0, policy_version 467903 (0.0008) [2023-12-26 03:19:21,521][123090] Updated weights for policy 1, policy_version 464804 (0.0010) [2023-12-26 03:19:21,563][123091] Updated weights for policy 0, policy_version 467913 (0.0008) [2023-12-26 03:19:21,583][123090] Updated weights for policy 1, policy_version 464814 (0.0011) [2023-12-26 03:19:21,649][123090] Updated weights for policy 1, policy_version 464824 (0.0010) [2023-12-26 03:19:22,400][123091] Updated weights for policy 0, policy_version 467923 (0.0007) [2023-12-26 03:19:22,467][123091] Updated weights for policy 0, policy_version 467933 (0.0009) [2023-12-26 03:19:22,497][123090] Updated weights for policy 1, policy_version 464834 (0.0010) [2023-12-26 03:19:22,526][123091] Updated weights for policy 0, policy_version 467943 (0.0007) [2023-12-26 03:19:22,557][123090] Updated weights for policy 1, policy_version 464844 (0.0008) [2023-12-26 03:19:22,623][123090] Updated weights for policy 1, policy_version 464854 (0.0008) [2023-12-26 03:19:22,671][123090] Updated weights for policy 1, policy_version 464864 (0.0008) [2023-12-26 03:19:23,300][123091] Updated weights for policy 0, policy_version 467953 (0.0007) [2023-12-26 03:19:23,362][123091] Updated weights for policy 0, policy_version 467963 (0.0010) [2023-12-26 03:19:23,427][123091] Updated weights for policy 0, policy_version 467973 (0.0009) [2023-12-26 03:19:23,472][123090] Updated weights for policy 1, policy_version 464874 (0.0011) [2023-12-26 03:19:23,487][123091] Updated weights for policy 0, policy_version 467983 (0.0007) [2023-12-26 03:19:23,523][123090] Updated weights for policy 1, policy_version 464884 (0.0010) [2023-12-26 03:19:23,575][123090] Updated weights for policy 1, policy_version 464894 (0.0010) [2023-12-26 03:19:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 238821376. Throughput: 0: 8864.4, 1: 8798.2. Samples: 238794592. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:23,785][121949] Avg episode reward: [(0, '6139.021'), (1, '5910.544')] [2023-12-26 03:19:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000467984_119808000.pth... [2023-12-26 03:19:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000464896_119013376.pth... [2023-12-26 03:19:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000466928_119537664.pth [2023-12-26 03:19:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000463872_118751232.pth [2023-12-26 03:19:24,239][123091] Updated weights for policy 0, policy_version 467993 (0.0008) [2023-12-26 03:19:24,303][123091] Updated weights for policy 0, policy_version 468003 (0.0008) [2023-12-26 03:19:24,372][123091] Updated weights for policy 0, policy_version 468013 (0.0010) [2023-12-26 03:19:24,396][123090] Updated weights for policy 1, policy_version 464904 (0.0007) [2023-12-26 03:19:24,459][123090] Updated weights for policy 1, policy_version 464914 (0.0006) [2023-12-26 03:19:24,510][123090] Updated weights for policy 1, policy_version 464924 (0.0005) [2023-12-26 03:19:25,210][123091] Updated weights for policy 0, policy_version 468023 (0.0010) [2023-12-26 03:19:25,259][123091] Updated weights for policy 0, policy_version 468033 (0.0009) [2023-12-26 03:19:25,308][123090] Updated weights for policy 1, policy_version 464934 (0.0008) [2023-12-26 03:19:25,309][123091] Updated weights for policy 0, policy_version 468043 (0.0008) [2023-12-26 03:19:25,363][123090] Updated weights for policy 1, policy_version 464944 (0.0010) [2023-12-26 03:19:25,417][123090] Updated weights for policy 1, policy_version 464954 (0.0010) [2023-12-26 03:19:26,129][123090] Updated weights for policy 1, policy_version 464964 (0.0008) [2023-12-26 03:19:26,187][123090] Updated weights for policy 1, policy_version 464974 (0.0005) [2023-12-26 03:19:26,236][123091] Updated weights for policy 0, policy_version 468053 (0.0008) [2023-12-26 03:19:26,244][123090] Updated weights for policy 1, policy_version 464984 (0.0005) [2023-12-26 03:19:26,299][123091] Updated weights for policy 0, policy_version 468063 (0.0008) [2023-12-26 03:19:26,356][123091] Updated weights for policy 0, policy_version 468073 (0.0010) [2023-12-26 03:19:26,871][123090] Updated weights for policy 1, policy_version 464994 (0.0005) [2023-12-26 03:19:26,940][123090] Updated weights for policy 1, policy_version 465004 (0.0005) [2023-12-26 03:19:27,010][123090] Updated weights for policy 1, policy_version 465014 (0.0005) [2023-12-26 03:19:27,072][123090] Updated weights for policy 1, policy_version 465024 (0.0005) [2023-12-26 03:19:27,286][123091] Updated weights for policy 0, policy_version 468083 (0.0009) [2023-12-26 03:19:27,345][123091] Updated weights for policy 0, policy_version 468093 (0.0006) [2023-12-26 03:19:27,414][123091] Updated weights for policy 0, policy_version 468103 (0.0006) [2023-12-26 03:19:27,752][123090] Updated weights for policy 1, policy_version 465034 (0.0007) [2023-12-26 03:19:27,809][123090] Updated weights for policy 1, policy_version 465044 (0.0008) [2023-12-26 03:19:27,863][123090] Updated weights for policy 1, policy_version 465054 (0.0009) [2023-12-26 03:19:28,168][123091] Updated weights for policy 0, policy_version 468113 (0.0006) [2023-12-26 03:19:28,222][123091] Updated weights for policy 0, policy_version 468123 (0.0009) [2023-12-26 03:19:28,276][123091] Updated weights for policy 0, policy_version 468133 (0.0010) [2023-12-26 03:19:28,336][123091] Updated weights for policy 0, policy_version 468143 (0.0010) [2023-12-26 03:19:28,569][123090] Updated weights for policy 1, policy_version 465064 (0.0006) [2023-12-26 03:19:28,637][123090] Updated weights for policy 1, policy_version 465074 (0.0005) [2023-12-26 03:19:28,698][123090] Updated weights for policy 1, policy_version 465084 (0.0005) [2023-12-26 03:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 238911488. Throughput: 0: 8857.0, 1: 8896.4. Samples: 238901200. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:28,785][121949] Avg episode reward: [(0, '6187.019'), (1, '5900.718')] [2023-12-26 03:19:29,251][123091] Updated weights for policy 0, policy_version 468153 (0.0007) [2023-12-26 03:19:29,310][123091] Updated weights for policy 0, policy_version 468163 (0.0008) [2023-12-26 03:19:29,313][123090] Updated weights for policy 1, policy_version 465094 (0.0007) [2023-12-26 03:19:29,379][123091] Updated weights for policy 0, policy_version 468173 (0.0008) [2023-12-26 03:19:29,385][123090] Updated weights for policy 1, policy_version 465104 (0.0007) [2023-12-26 03:19:29,446][123090] Updated weights for policy 1, policy_version 465114 (0.0006) [2023-12-26 03:19:30,114][123090] Updated weights for policy 1, policy_version 465124 (0.0005) [2023-12-26 03:19:30,169][123090] Updated weights for policy 1, policy_version 465134 (0.0005) [2023-12-26 03:19:30,223][123090] Updated weights for policy 1, policy_version 465144 (0.0008) [2023-12-26 03:19:30,233][123091] Updated weights for policy 0, policy_version 468183 (0.0010) [2023-12-26 03:19:30,298][123091] Updated weights for policy 0, policy_version 468193 (0.0008) [2023-12-26 03:19:30,358][123091] Updated weights for policy 0, policy_version 468203 (0.0010) [2023-12-26 03:19:30,916][123090] Updated weights for policy 1, policy_version 465154 (0.0006) [2023-12-26 03:19:30,990][123090] Updated weights for policy 1, policy_version 465164 (0.0005) [2023-12-26 03:19:31,052][123090] Updated weights for policy 1, policy_version 465174 (0.0007) [2023-12-26 03:19:31,127][123090] Updated weights for policy 1, policy_version 465184 (0.0006) [2023-12-26 03:19:31,160][123091] Updated weights for policy 0, policy_version 468213 (0.0010) [2023-12-26 03:19:31,229][123091] Updated weights for policy 0, policy_version 468223 (0.0010) [2023-12-26 03:19:31,287][123091] Updated weights for policy 0, policy_version 468233 (0.0011) [2023-12-26 03:19:31,931][123090] Updated weights for policy 1, policy_version 465194 (0.0009) [2023-12-26 03:19:31,981][123091] Updated weights for policy 0, policy_version 468243 (0.0009) [2023-12-26 03:19:31,994][123090] Updated weights for policy 1, policy_version 465204 (0.0008) [2023-12-26 03:19:32,048][123091] Updated weights for policy 0, policy_version 468253 (0.0008) [2023-12-26 03:19:32,067][123090] Updated weights for policy 1, policy_version 465214 (0.0007) [2023-12-26 03:19:32,120][123091] Updated weights for policy 0, policy_version 468263 (0.0008) [2023-12-26 03:19:32,898][123090] Updated weights for policy 1, policy_version 465224 (0.0008) [2023-12-26 03:19:32,910][123091] Updated weights for policy 0, policy_version 468273 (0.0009) [2023-12-26 03:19:32,955][123090] Updated weights for policy 1, policy_version 465234 (0.0006) [2023-12-26 03:19:32,961][123091] Updated weights for policy 0, policy_version 468283 (0.0010) [2023-12-26 03:19:33,016][123091] Updated weights for policy 0, policy_version 468293 (0.0010) [2023-12-26 03:19:33,018][123090] Updated weights for policy 1, policy_version 465244 (0.0006) [2023-12-26 03:19:33,079][123091] Updated weights for policy 0, policy_version 468303 (0.0011) [2023-12-26 03:19:33,677][123090] Updated weights for policy 1, policy_version 465254 (0.0005) [2023-12-26 03:19:33,729][123090] Updated weights for policy 1, policy_version 465264 (0.0005) [2023-12-26 03:19:33,779][123090] Updated weights for policy 1, policy_version 465274 (0.0005) [2023-12-26 03:19:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 238993408. Throughput: 0: 8782.9, 1: 8982.8. Samples: 239011332. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:33,785][121949] Avg episode reward: [(0, '6117.160'), (1, '5841.204')] [2023-12-26 03:19:33,902][123091] Updated weights for policy 0, policy_version 468313 (0.0010) [2023-12-26 03:19:33,956][123091] Updated weights for policy 0, policy_version 468323 (0.0010) [2023-12-26 03:19:33,999][123091] Updated weights for policy 0, policy_version 468333 (0.0010) [2023-12-26 03:19:34,457][123090] Updated weights for policy 1, policy_version 465284 (0.0007) [2023-12-26 03:19:34,509][123090] Updated weights for policy 1, policy_version 465294 (0.0010) [2023-12-26 03:19:34,561][123090] Updated weights for policy 1, policy_version 465304 (0.0010) [2023-12-26 03:19:34,859][123091] Updated weights for policy 0, policy_version 468343 (0.0010) [2023-12-26 03:19:34,921][123091] Updated weights for policy 0, policy_version 468353 (0.0007) [2023-12-26 03:19:34,972][123091] Updated weights for policy 0, policy_version 468363 (0.0005) [2023-12-26 03:19:35,356][123090] Updated weights for policy 1, policy_version 465314 (0.0009) [2023-12-26 03:19:35,431][123090] Updated weights for policy 1, policy_version 465324 (0.0006) [2023-12-26 03:19:35,491][123090] Updated weights for policy 1, policy_version 465334 (0.0007) [2023-12-26 03:19:35,555][123090] Updated weights for policy 1, policy_version 465344 (0.0006) [2023-12-26 03:19:35,791][123091] Updated weights for policy 0, policy_version 468373 (0.0008) [2023-12-26 03:19:35,842][123091] Updated weights for policy 0, policy_version 468383 (0.0007) [2023-12-26 03:19:35,896][123091] Updated weights for policy 0, policy_version 468393 (0.0005) [2023-12-26 03:19:36,222][123090] Updated weights for policy 1, policy_version 465354 (0.0006) [2023-12-26 03:19:36,299][123090] Updated weights for policy 1, policy_version 465364 (0.0007) [2023-12-26 03:19:36,364][123090] Updated weights for policy 1, policy_version 465374 (0.0009) [2023-12-26 03:19:36,642][123091] Updated weights for policy 0, policy_version 468403 (0.0006) [2023-12-26 03:19:36,711][123091] Updated weights for policy 0, policy_version 468413 (0.0007) [2023-12-26 03:19:36,782][123091] Updated weights for policy 0, policy_version 468423 (0.0007) [2023-12-26 03:19:37,014][123090] Updated weights for policy 1, policy_version 465384 (0.0010) [2023-12-26 03:19:37,063][123090] Updated weights for policy 1, policy_version 465394 (0.0011) [2023-12-26 03:19:37,115][123090] Updated weights for policy 1, policy_version 465404 (0.0011) [2023-12-26 03:19:37,428][123091] Updated weights for policy 0, policy_version 468433 (0.0006) [2023-12-26 03:19:37,497][123091] Updated weights for policy 0, policy_version 468443 (0.0006) [2023-12-26 03:19:37,564][123091] Updated weights for policy 0, policy_version 468453 (0.0011) [2023-12-26 03:19:37,628][123091] Updated weights for policy 0, policy_version 468463 (0.0011) [2023-12-26 03:19:37,986][123090] Updated weights for policy 1, policy_version 465414 (0.0010) [2023-12-26 03:19:38,057][123090] Updated weights for policy 1, policy_version 465424 (0.0010) [2023-12-26 03:19:38,119][123090] Updated weights for policy 1, policy_version 465434 (0.0011) [2023-12-26 03:19:38,248][123091] Updated weights for policy 0, policy_version 468473 (0.0006) [2023-12-26 03:19:38,305][123091] Updated weights for policy 0, policy_version 468483 (0.0005) [2023-12-26 03:19:38,376][123091] Updated weights for policy 0, policy_version 468493 (0.0007) [2023-12-26 03:19:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 239091712. Throughput: 0: 8798.8, 1: 9083.8. Samples: 239067412. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 03:19:38,785][121949] Avg episode reward: [(0, '6016.949'), (1, '5725.509')] [2023-12-26 03:19:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000468496_119939072.pth... [2023-12-26 03:19:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000465440_119152640.pth... [2023-12-26 03:19:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000467472_119676928.pth [2023-12-26 03:19:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000464384_118882304.pth [2023-12-26 03:19:38,911][123090] Updated weights for policy 1, policy_version 465444 (0.0008) [2023-12-26 03:19:38,978][123090] Updated weights for policy 1, policy_version 465454 (0.0010) [2023-12-26 03:19:39,030][123090] Updated weights for policy 1, policy_version 465464 (0.0010) [2023-12-26 03:19:39,155][123091] Updated weights for policy 0, policy_version 468503 (0.0009) [2023-12-26 03:19:39,207][123091] Updated weights for policy 0, policy_version 468513 (0.0009) [2023-12-26 03:19:39,282][123091] Updated weights for policy 0, policy_version 468523 (0.0009) [2023-12-26 03:19:39,871][123090] Updated weights for policy 1, policy_version 465474 (0.0011) [2023-12-26 03:19:39,941][123090] Updated weights for policy 1, policy_version 465484 (0.0011) [2023-12-26 03:19:40,006][123090] Updated weights for policy 1, policy_version 465494 (0.0011) [2023-12-26 03:19:40,059][123090] Updated weights for policy 1, policy_version 465504 (0.0011) [2023-12-26 03:19:40,168][123091] Updated weights for policy 0, policy_version 468533 (0.0009) [2023-12-26 03:19:40,222][123091] Updated weights for policy 0, policy_version 468543 (0.0009) [2023-12-26 03:19:40,280][123091] Updated weights for policy 0, policy_version 468553 (0.0009) [2023-12-26 03:19:40,892][123090] Updated weights for policy 1, policy_version 465514 (0.0010) [2023-12-26 03:19:40,955][123090] Updated weights for policy 1, policy_version 465524 (0.0011) [2023-12-26 03:19:41,014][123090] Updated weights for policy 1, policy_version 465534 (0.0010) [2023-12-26 03:19:41,135][123091] Updated weights for policy 0, policy_version 468563 (0.0009) [2023-12-26 03:19:41,200][123091] Updated weights for policy 0, policy_version 468573 (0.0009) [2023-12-26 03:19:41,253][123091] Updated weights for policy 0, policy_version 468583 (0.0009) [2023-12-26 03:19:41,864][123090] Updated weights for policy 1, policy_version 465544 (0.0009) [2023-12-26 03:19:41,927][123090] Updated weights for policy 1, policy_version 465554 (0.0009) [2023-12-26 03:19:41,996][123090] Updated weights for policy 1, policy_version 465564 (0.0009) [2023-12-26 03:19:42,105][123091] Updated weights for policy 0, policy_version 468593 (0.0008) [2023-12-26 03:19:42,177][123091] Updated weights for policy 0, policy_version 468603 (0.0006) [2023-12-26 03:19:42,252][123091] Updated weights for policy 0, policy_version 468613 (0.0006) [2023-12-26 03:19:42,322][123091] Updated weights for policy 0, policy_version 468624 (0.0007) [2023-12-26 03:19:42,803][123090] Updated weights for policy 1, policy_version 465574 (0.0009) [2023-12-26 03:19:42,855][123090] Updated weights for policy 1, policy_version 465584 (0.0009) [2023-12-26 03:19:42,905][123090] Updated weights for policy 1, policy_version 465594 (0.0009) [2023-12-26 03:19:43,064][123091] Updated weights for policy 0, policy_version 468635 (0.0009) [2023-12-26 03:19:43,132][123091] Updated weights for policy 0, policy_version 468645 (0.0006) [2023-12-26 03:19:43,189][123091] Updated weights for policy 0, policy_version 468655 (0.0005) [2023-12-26 03:19:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 239173632. Throughput: 0: 8818.8, 1: 9086.4. Samples: 239171976. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:19:43,785][121949] Avg episode reward: [(0, '6045.625'), (1, '5664.393')] [2023-12-26 03:19:43,840][123090] Updated weights for policy 1, policy_version 465604 (0.0010) [2023-12-26 03:19:43,872][123091] Updated weights for policy 0, policy_version 468665 (0.0007) [2023-12-26 03:19:43,903][123090] Updated weights for policy 1, policy_version 465614 (0.0009) [2023-12-26 03:19:43,928][123091] Updated weights for policy 0, policy_version 468675 (0.0008) [2023-12-26 03:19:43,965][123090] Updated weights for policy 1, policy_version 465624 (0.0009) [2023-12-26 03:19:43,977][123091] Updated weights for policy 0, policy_version 468685 (0.0005) [2023-12-26 03:19:44,774][123091] Updated weights for policy 0, policy_version 468695 (0.0008) [2023-12-26 03:19:44,796][123090] Updated weights for policy 1, policy_version 465634 (0.0009) [2023-12-26 03:19:44,833][123091] Updated weights for policy 0, policy_version 468705 (0.0008) [2023-12-26 03:19:44,851][123090] Updated weights for policy 1, policy_version 465644 (0.0006) [2023-12-26 03:19:44,902][123091] Updated weights for policy 0, policy_version 468715 (0.0008) [2023-12-26 03:19:44,915][123090] Updated weights for policy 1, policy_version 465654 (0.0007) [2023-12-26 03:19:44,973][123090] Updated weights for policy 1, policy_version 465664 (0.0007) [2023-12-26 03:19:45,567][123091] Updated weights for policy 0, policy_version 468725 (0.0006) [2023-12-26 03:19:45,626][123091] Updated weights for policy 0, policy_version 468735 (0.0005) [2023-12-26 03:19:45,673][123091] Updated weights for policy 0, policy_version 468745 (0.0005) [2023-12-26 03:19:45,790][123090] Updated weights for policy 1, policy_version 465674 (0.0009) [2023-12-26 03:19:45,840][123090] Updated weights for policy 1, policy_version 465684 (0.0010) [2023-12-26 03:19:45,888][123090] Updated weights for policy 1, policy_version 465694 (0.0009) [2023-12-26 03:19:46,414][123091] Updated weights for policy 0, policy_version 468755 (0.0007) [2023-12-26 03:19:46,471][123091] Updated weights for policy 0, policy_version 468765 (0.0007) [2023-12-26 03:19:46,517][123091] Updated weights for policy 0, policy_version 468775 (0.0008) [2023-12-26 03:19:46,789][123090] Updated weights for policy 1, policy_version 465704 (0.0009) [2023-12-26 03:19:46,854][123090] Updated weights for policy 1, policy_version 465714 (0.0009) [2023-12-26 03:19:46,909][123090] Updated weights for policy 1, policy_version 465724 (0.0009) [2023-12-26 03:19:47,243][123091] Updated weights for policy 0, policy_version 468785 (0.0007) [2023-12-26 03:19:47,301][123091] Updated weights for policy 0, policy_version 468795 (0.0010) [2023-12-26 03:19:47,352][123091] Updated weights for policy 0, policy_version 468805 (0.0010) [2023-12-26 03:19:47,403][123091] Updated weights for policy 0, policy_version 468815 (0.0010) [2023-12-26 03:19:47,655][123090] Updated weights for policy 1, policy_version 465734 (0.0007) [2023-12-26 03:19:47,718][123090] Updated weights for policy 1, policy_version 465744 (0.0006) [2023-12-26 03:19:47,779][123090] Updated weights for policy 1, policy_version 465754 (0.0007) [2023-12-26 03:19:48,195][123091] Updated weights for policy 0, policy_version 468825 (0.0011) [2023-12-26 03:19:48,259][123091] Updated weights for policy 0, policy_version 468835 (0.0010) [2023-12-26 03:19:48,331][123091] Updated weights for policy 0, policy_version 468845 (0.0011) [2023-12-26 03:19:48,553][123090] Updated weights for policy 1, policy_version 465764 (0.0009) [2023-12-26 03:19:48,605][123090] Updated weights for policy 1, policy_version 465774 (0.0009) [2023-12-26 03:19:48,656][123090] Updated weights for policy 1, policy_version 465784 (0.0010) [2023-12-26 03:19:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 239271936. Throughput: 0: 8887.8, 1: 9000.8. Samples: 239280044. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:19:48,785][121949] Avg episode reward: [(0, '6115.689'), (1, '5715.980')] [2023-12-26 03:19:49,103][123091] Updated weights for policy 0, policy_version 468855 (0.0010) [2023-12-26 03:19:49,154][123091] Updated weights for policy 0, policy_version 468865 (0.0010) [2023-12-26 03:19:49,205][123091] Updated weights for policy 0, policy_version 468875 (0.0010) [2023-12-26 03:19:49,492][123090] Updated weights for policy 1, policy_version 465794 (0.0008) [2023-12-26 03:19:49,553][123090] Updated weights for policy 1, policy_version 465804 (0.0005) [2023-12-26 03:19:49,621][123090] Updated weights for policy 1, policy_version 465814 (0.0008) [2023-12-26 03:19:49,676][123090] Updated weights for policy 1, policy_version 465824 (0.0009) [2023-12-26 03:19:50,084][123091] Updated weights for policy 0, policy_version 468885 (0.0010) [2023-12-26 03:19:50,149][123091] Updated weights for policy 0, policy_version 468895 (0.0010) [2023-12-26 03:19:50,215][123091] Updated weights for policy 0, policy_version 468905 (0.0010) [2023-12-26 03:19:50,511][123090] Updated weights for policy 1, policy_version 465834 (0.0010) [2023-12-26 03:19:50,574][123090] Updated weights for policy 1, policy_version 465844 (0.0010) [2023-12-26 03:19:50,634][123090] Updated weights for policy 1, policy_version 465854 (0.0009) [2023-12-26 03:19:51,004][123091] Updated weights for policy 0, policy_version 468915 (0.0009) [2023-12-26 03:19:51,079][123091] Updated weights for policy 0, policy_version 468925 (0.0008) [2023-12-26 03:19:51,148][123091] Updated weights for policy 0, policy_version 468935 (0.0007) [2023-12-26 03:19:51,541][123090] Updated weights for policy 1, policy_version 465864 (0.0009) [2023-12-26 03:19:51,612][123090] Updated weights for policy 1, policy_version 465874 (0.0009) [2023-12-26 03:19:51,687][123090] Updated weights for policy 1, policy_version 465884 (0.0010) [2023-12-26 03:19:51,928][123091] Updated weights for policy 0, policy_version 468945 (0.0009) [2023-12-26 03:19:51,985][123091] Updated weights for policy 0, policy_version 468955 (0.0010) [2023-12-26 03:19:52,038][123091] Updated weights for policy 0, policy_version 468965 (0.0010) [2023-12-26 03:19:52,099][123091] Updated weights for policy 0, policy_version 468975 (0.0010) [2023-12-26 03:19:52,475][123090] Updated weights for policy 1, policy_version 465894 (0.0009) [2023-12-26 03:19:52,528][123090] Updated weights for policy 1, policy_version 465904 (0.0009) [2023-12-26 03:19:52,587][123090] Updated weights for policy 1, policy_version 465914 (0.0009) [2023-12-26 03:19:52,982][123091] Updated weights for policy 0, policy_version 468985 (0.0010) [2023-12-26 03:19:53,037][123091] Updated weights for policy 0, policy_version 468995 (0.0009) [2023-12-26 03:19:53,085][123091] Updated weights for policy 0, policy_version 469005 (0.0008) [2023-12-26 03:19:53,348][123090] Updated weights for policy 1, policy_version 465924 (0.0009) [2023-12-26 03:19:53,405][123090] Updated weights for policy 1, policy_version 465934 (0.0006) [2023-12-26 03:19:53,460][123090] Updated weights for policy 1, policy_version 465944 (0.0005) [2023-12-26 03:19:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 239353856. Throughput: 0: 8860.6, 1: 8973.3. Samples: 239331440. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:19:53,785][121949] Avg episode reward: [(0, '6135.479'), (1, '5547.134')] [2023-12-26 03:19:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000469008_120070144.pth... [2023-12-26 03:19:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000465952_119283712.pth... [2023-12-26 03:19:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000464896_119013376.pth [2023-12-26 03:19:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000467984_119808000.pth [2023-12-26 03:19:53,982][123091] Updated weights for policy 0, policy_version 469015 (0.0009) [2023-12-26 03:19:54,038][123091] Updated weights for policy 0, policy_version 469025 (0.0007) [2023-12-26 03:19:54,081][123090] Updated weights for policy 1, policy_version 465954 (0.0005) [2023-12-26 03:19:54,086][123091] Updated weights for policy 0, policy_version 469035 (0.0005) [2023-12-26 03:19:54,148][123090] Updated weights for policy 1, policy_version 465964 (0.0007) [2023-12-26 03:19:54,204][123090] Updated weights for policy 1, policy_version 465974 (0.0009) [2023-12-26 03:19:54,260][123090] Updated weights for policy 1, policy_version 465984 (0.0009) [2023-12-26 03:19:54,902][123091] Updated weights for policy 0, policy_version 469045 (0.0009) [2023-12-26 03:19:54,955][123091] Updated weights for policy 0, policy_version 469055 (0.0009) [2023-12-26 03:19:55,003][123091] Updated weights for policy 0, policy_version 469065 (0.0009) [2023-12-26 03:19:55,091][123090] Updated weights for policy 1, policy_version 465994 (0.0010) [2023-12-26 03:19:55,147][123090] Updated weights for policy 1, policy_version 466004 (0.0010) [2023-12-26 03:19:55,191][123090] Updated weights for policy 1, policy_version 466014 (0.0010) [2023-12-26 03:19:55,866][123091] Updated weights for policy 0, policy_version 469075 (0.0009) [2023-12-26 03:19:55,911][123091] Updated weights for policy 0, policy_version 469085 (0.0008) [2023-12-26 03:19:55,913][123090] Updated weights for policy 1, policy_version 466024 (0.0009) [2023-12-26 03:19:55,956][123091] Updated weights for policy 0, policy_version 469095 (0.0006) [2023-12-26 03:19:55,969][123090] Updated weights for policy 1, policy_version 466034 (0.0010) [2023-12-26 03:19:56,033][123090] Updated weights for policy 1, policy_version 466044 (0.0009) [2023-12-26 03:19:56,669][123090] Updated weights for policy 1, policy_version 466054 (0.0007) [2023-12-26 03:19:56,729][123090] Updated weights for policy 1, policy_version 466064 (0.0009) [2023-12-26 03:19:56,790][123090] Updated weights for policy 1, policy_version 466074 (0.0009) [2023-12-26 03:19:56,848][123091] Updated weights for policy 0, policy_version 469105 (0.0007) [2023-12-26 03:19:56,916][123091] Updated weights for policy 0, policy_version 469115 (0.0010) [2023-12-26 03:19:56,981][123091] Updated weights for policy 0, policy_version 469125 (0.0010) [2023-12-26 03:19:57,042][123091] Updated weights for policy 0, policy_version 469135 (0.0009) [2023-12-26 03:19:57,610][123090] Updated weights for policy 1, policy_version 466084 (0.0009) [2023-12-26 03:19:57,668][123090] Updated weights for policy 1, policy_version 466094 (0.0010) [2023-12-26 03:19:57,732][123090] Updated weights for policy 1, policy_version 466104 (0.0008) [2023-12-26 03:19:57,815][123091] Updated weights for policy 0, policy_version 469145 (0.0009) [2023-12-26 03:19:57,865][123091] Updated weights for policy 0, policy_version 469155 (0.0009) [2023-12-26 03:19:57,923][123091] Updated weights for policy 0, policy_version 469166 (0.0010) [2023-12-26 03:19:58,516][123090] Updated weights for policy 1, policy_version 466114 (0.0010) [2023-12-26 03:19:58,576][123090] Updated weights for policy 1, policy_version 466124 (0.0008) [2023-12-26 03:19:58,641][123090] Updated weights for policy 1, policy_version 466134 (0.0008) [2023-12-26 03:19:58,711][123090] Updated weights for policy 1, policy_version 466144 (0.0008) [2023-12-26 03:19:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 239443968. Throughput: 0: 8814.7, 1: 9114.5. Samples: 239438712. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:19:58,785][121949] Avg episode reward: [(0, '6043.538'), (1, '5622.295')] [2023-12-26 03:19:58,822][123091] Updated weights for policy 0, policy_version 469176 (0.0008) [2023-12-26 03:19:58,882][123091] Updated weights for policy 0, policy_version 469186 (0.0009) [2023-12-26 03:19:58,954][123091] Updated weights for policy 0, policy_version 469196 (0.0007) [2023-12-26 03:19:59,469][123090] Updated weights for policy 1, policy_version 466154 (0.0005) [2023-12-26 03:19:59,544][123090] Updated weights for policy 1, policy_version 466164 (0.0005) [2023-12-26 03:19:59,607][123090] Updated weights for policy 1, policy_version 466174 (0.0005) [2023-12-26 03:19:59,745][123091] Updated weights for policy 0, policy_version 469206 (0.0009) [2023-12-26 03:19:59,799][123091] Updated weights for policy 0, policy_version 469216 (0.0010) [2023-12-26 03:19:59,870][123091] Updated weights for policy 0, policy_version 469226 (0.0009) [2023-12-26 03:20:00,222][123090] Updated weights for policy 1, policy_version 466184 (0.0007) [2023-12-26 03:20:00,277][123090] Updated weights for policy 1, policy_version 466194 (0.0006) [2023-12-26 03:20:00,342][123090] Updated weights for policy 1, policy_version 466204 (0.0005) [2023-12-26 03:20:00,758][123091] Updated weights for policy 0, policy_version 469236 (0.0007) [2023-12-26 03:20:00,825][123091] Updated weights for policy 0, policy_version 469246 (0.0005) [2023-12-26 03:20:00,878][123091] Updated weights for policy 0, policy_version 469256 (0.0008) [2023-12-26 03:20:01,156][123090] Updated weights for policy 1, policy_version 466214 (0.0008) [2023-12-26 03:20:01,213][123090] Updated weights for policy 1, policy_version 466224 (0.0010) [2023-12-26 03:20:01,270][123090] Updated weights for policy 1, policy_version 466234 (0.0009) [2023-12-26 03:20:01,638][123091] Updated weights for policy 0, policy_version 469267 (0.0010) [2023-12-26 03:20:01,701][123091] Updated weights for policy 0, policy_version 469277 (0.0009) [2023-12-26 03:20:01,772][123091] Updated weights for policy 0, policy_version 469287 (0.0010) [2023-12-26 03:20:02,048][123090] Updated weights for policy 1, policy_version 466244 (0.0008) [2023-12-26 03:20:02,099][123090] Updated weights for policy 1, policy_version 466254 (0.0006) [2023-12-26 03:20:02,153][123090] Updated weights for policy 1, policy_version 466264 (0.0009) [2023-12-26 03:20:02,579][123091] Updated weights for policy 0, policy_version 469297 (0.0008) [2023-12-26 03:20:02,642][123091] Updated weights for policy 0, policy_version 469307 (0.0009) [2023-12-26 03:20:02,699][123091] Updated weights for policy 0, policy_version 469317 (0.0007) [2023-12-26 03:20:02,757][123091] Updated weights for policy 0, policy_version 469327 (0.0006) [2023-12-26 03:20:02,976][123090] Updated weights for policy 1, policy_version 466274 (0.0008) [2023-12-26 03:20:03,039][123090] Updated weights for policy 1, policy_version 466284 (0.0006) [2023-12-26 03:20:03,091][123090] Updated weights for policy 1, policy_version 466294 (0.0005) [2023-12-26 03:20:03,160][123090] Updated weights for policy 1, policy_version 466304 (0.0006) [2023-12-26 03:20:03,433][123091] Updated weights for policy 0, policy_version 469337 (0.0005) [2023-12-26 03:20:03,478][123091] Updated weights for policy 0, policy_version 469347 (0.0005) [2023-12-26 03:20:03,525][123091] Updated weights for policy 0, policy_version 469357 (0.0005) [2023-12-26 03:20:03,767][123090] Updated weights for policy 1, policy_version 466314 (0.0005) [2023-12-26 03:20:03,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17885.7, 300 sec: 17633.6). Total num frames: 239534080. Throughput: 0: 8771.3, 1: 9076.1. Samples: 239547508. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:03,786][121949] Avg episode reward: [(0, '6018.788'), (1, '5800.613')] [2023-12-26 03:20:03,823][123090] Updated weights for policy 1, policy_version 466324 (0.0005) [2023-12-26 03:20:03,885][123090] Updated weights for policy 1, policy_version 466334 (0.0009) [2023-12-26 03:20:04,290][123091] Updated weights for policy 0, policy_version 469367 (0.0009) [2023-12-26 03:20:04,354][123091] Updated weights for policy 0, policy_version 469377 (0.0010) [2023-12-26 03:20:04,420][123091] Updated weights for policy 0, policy_version 469387 (0.0009) [2023-12-26 03:20:04,647][123090] Updated weights for policy 1, policy_version 466344 (0.0009) [2023-12-26 03:20:04,710][123090] Updated weights for policy 1, policy_version 466354 (0.0010) [2023-12-26 03:20:04,763][123090] Updated weights for policy 1, policy_version 466364 (0.0010) [2023-12-26 03:20:05,218][123091] Updated weights for policy 0, policy_version 469397 (0.0010) [2023-12-26 03:20:05,280][123091] Updated weights for policy 0, policy_version 469407 (0.0010) [2023-12-26 03:20:05,336][123091] Updated weights for policy 0, policy_version 469417 (0.0006) [2023-12-26 03:20:05,667][123090] Updated weights for policy 1, policy_version 466374 (0.0010) [2023-12-26 03:20:05,721][123090] Updated weights for policy 1, policy_version 466385 (0.0010) [2023-12-26 03:20:05,776][123090] Updated weights for policy 1, policy_version 466396 (0.0011) [2023-12-26 03:20:05,940][123091] Updated weights for policy 0, policy_version 469427 (0.0005) [2023-12-26 03:20:06,009][123091] Updated weights for policy 0, policy_version 469437 (0.0007) [2023-12-26 03:20:06,072][123091] Updated weights for policy 0, policy_version 469447 (0.0010) [2023-12-26 03:20:06,734][123090] Updated weights for policy 1, policy_version 466407 (0.0009) [2023-12-26 03:20:06,784][123090] Updated weights for policy 1, policy_version 466417 (0.0009) [2023-12-26 03:20:06,810][123091] Updated weights for policy 0, policy_version 469457 (0.0007) [2023-12-26 03:20:06,850][123090] Updated weights for policy 1, policy_version 466427 (0.0010) [2023-12-26 03:20:06,884][123091] Updated weights for policy 0, policy_version 469467 (0.0009) [2023-12-26 03:20:06,953][123091] Updated weights for policy 0, policy_version 469477 (0.0011) [2023-12-26 03:20:07,026][123091] Updated weights for policy 0, policy_version 469487 (0.0011) [2023-12-26 03:20:07,679][123090] Updated weights for policy 1, policy_version 466437 (0.0008) [2023-12-26 03:20:07,733][123090] Updated weights for policy 1, policy_version 466447 (0.0006) [2023-12-26 03:20:07,788][123090] Updated weights for policy 1, policy_version 466457 (0.0005) [2023-12-26 03:20:07,801][123091] Updated weights for policy 0, policy_version 469497 (0.0008) [2023-12-26 03:20:07,847][123091] Updated weights for policy 0, policy_version 469507 (0.0005) [2023-12-26 03:20:07,901][123091] Updated weights for policy 0, policy_version 469517 (0.0005) [2023-12-26 03:20:08,585][123090] Updated weights for policy 1, policy_version 466467 (0.0008) [2023-12-26 03:20:08,649][123090] Updated weights for policy 1, policy_version 466477 (0.0010) [2023-12-26 03:20:08,674][123091] Updated weights for policy 0, policy_version 469527 (0.0006) [2023-12-26 03:20:08,710][123090] Updated weights for policy 1, policy_version 466487 (0.0009) [2023-12-26 03:20:08,727][123091] Updated weights for policy 0, policy_version 469537 (0.0005) [2023-12-26 03:20:08,781][123091] Updated weights for policy 0, policy_version 469547 (0.0006) [2023-12-26 03:20:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 239624192. Throughput: 0: 8854.2, 1: 9072.0. Samples: 239601272. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:08,785][121949] Avg episode reward: [(0, '6025.166'), (1, '5670.513')] [2023-12-26 03:20:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000466496_119422976.pth... [2023-12-26 03:20:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000465440_119152640.pth [2023-12-26 03:20:08,802][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000469552_120209408.pth... [2023-12-26 03:20:08,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000468496_119939072.pth [2023-12-26 03:20:09,526][123091] Updated weights for policy 0, policy_version 469557 (0.0008) [2023-12-26 03:20:09,583][123091] Updated weights for policy 0, policy_version 469567 (0.0011) [2023-12-26 03:20:09,608][123090] Updated weights for policy 1, policy_version 466497 (0.0009) [2023-12-26 03:20:09,644][123091] Updated weights for policy 0, policy_version 469577 (0.0011) [2023-12-26 03:20:09,677][123090] Updated weights for policy 1, policy_version 466507 (0.0011) [2023-12-26 03:20:09,737][123090] Updated weights for policy 1, policy_version 466517 (0.0010) [2023-12-26 03:20:09,800][123090] Updated weights for policy 1, policy_version 466527 (0.0011) [2023-12-26 03:20:10,481][123091] Updated weights for policy 0, policy_version 469587 (0.0011) [2023-12-26 03:20:10,545][123091] Updated weights for policy 0, policy_version 469597 (0.0011) [2023-12-26 03:20:10,609][123091] Updated weights for policy 0, policy_version 469607 (0.0011) [2023-12-26 03:20:10,646][123090] Updated weights for policy 1, policy_version 466537 (0.0007) [2023-12-26 03:20:10,708][123090] Updated weights for policy 1, policy_version 466547 (0.0009) [2023-12-26 03:20:10,771][123090] Updated weights for policy 1, policy_version 466557 (0.0006) [2023-12-26 03:20:11,460][123091] Updated weights for policy 0, policy_version 469617 (0.0011) [2023-12-26 03:20:11,533][123091] Updated weights for policy 0, policy_version 469627 (0.0010) [2023-12-26 03:20:11,556][123090] Updated weights for policy 1, policy_version 466567 (0.0005) [2023-12-26 03:20:11,600][123091] Updated weights for policy 0, policy_version 469637 (0.0010) [2023-12-26 03:20:11,629][123090] Updated weights for policy 1, policy_version 466577 (0.0007) [2023-12-26 03:20:11,670][123091] Updated weights for policy 0, policy_version 469647 (0.0009) [2023-12-26 03:20:11,701][123090] Updated weights for policy 1, policy_version 466587 (0.0007) [2023-12-26 03:20:12,407][123090] Updated weights for policy 1, policy_version 466597 (0.0008) [2023-12-26 03:20:12,460][123091] Updated weights for policy 0, policy_version 469657 (0.0010) [2023-12-26 03:20:12,460][123090] Updated weights for policy 1, policy_version 466607 (0.0009) [2023-12-26 03:20:12,517][123090] Updated weights for policy 1, policy_version 466617 (0.0007) [2023-12-26 03:20:12,523][123091] Updated weights for policy 0, policy_version 469667 (0.0011) [2023-12-26 03:20:12,590][123091] Updated weights for policy 0, policy_version 469677 (0.0011) [2023-12-26 03:20:13,304][123090] Updated weights for policy 1, policy_version 466627 (0.0007) [2023-12-26 03:20:13,359][123090] Updated weights for policy 1, policy_version 466637 (0.0008) [2023-12-26 03:20:13,409][123090] Updated weights for policy 1, policy_version 466647 (0.0007) [2023-12-26 03:20:13,415][123091] Updated weights for policy 0, policy_version 469687 (0.0011) [2023-12-26 03:20:13,463][123091] Updated weights for policy 0, policy_version 469697 (0.0010) [2023-12-26 03:20:13,521][123091] Updated weights for policy 0, policy_version 469707 (0.0010) [2023-12-26 03:20:13,784][121949] Fps is (10 sec: 18023.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 239714304. Throughput: 0: 8890.1, 1: 8973.1. Samples: 239705040. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:13,785][121949] Avg episode reward: [(0, '6014.446'), (1, '5628.041')] [2023-12-26 03:20:14,241][123090] Updated weights for policy 1, policy_version 466657 (0.0006) [2023-12-26 03:20:14,293][123090] Updated weights for policy 1, policy_version 466667 (0.0008) [2023-12-26 03:20:14,339][123091] Updated weights for policy 0, policy_version 469717 (0.0009) [2023-12-26 03:20:14,359][123090] Updated weights for policy 1, policy_version 466677 (0.0008) [2023-12-26 03:20:14,392][123091] Updated weights for policy 0, policy_version 469727 (0.0009) [2023-12-26 03:20:14,422][123090] Updated weights for policy 1, policy_version 466687 (0.0008) [2023-12-26 03:20:14,457][123091] Updated weights for policy 0, policy_version 469737 (0.0008) [2023-12-26 03:20:15,266][123090] Updated weights for policy 1, policy_version 466697 (0.0008) [2023-12-26 03:20:15,316][123090] Updated weights for policy 1, policy_version 466707 (0.0009) [2023-12-26 03:20:15,329][123091] Updated weights for policy 0, policy_version 469747 (0.0009) [2023-12-26 03:20:15,372][123090] Updated weights for policy 1, policy_version 466717 (0.0010) [2023-12-26 03:20:15,389][123091] Updated weights for policy 0, policy_version 469757 (0.0010) [2023-12-26 03:20:15,439][123091] Updated weights for policy 0, policy_version 469767 (0.0009) [2023-12-26 03:20:16,196][123090] Updated weights for policy 1, policy_version 466727 (0.0009) [2023-12-26 03:20:16,246][123090] Updated weights for policy 1, policy_version 466737 (0.0009) [2023-12-26 03:20:16,272][123091] Updated weights for policy 0, policy_version 469777 (0.0010) [2023-12-26 03:20:16,301][123090] Updated weights for policy 1, policy_version 466747 (0.0009) [2023-12-26 03:20:16,321][123091] Updated weights for policy 0, policy_version 469787 (0.0007) [2023-12-26 03:20:16,371][123091] Updated weights for policy 0, policy_version 469797 (0.0008) [2023-12-26 03:20:16,436][123091] Updated weights for policy 0, policy_version 469807 (0.0010) [2023-12-26 03:20:17,176][123090] Updated weights for policy 1, policy_version 466757 (0.0010) [2023-12-26 03:20:17,230][123090] Updated weights for policy 1, policy_version 466767 (0.0009) [2023-12-26 03:20:17,257][123091] Updated weights for policy 0, policy_version 469817 (0.0005) [2023-12-26 03:20:17,291][123090] Updated weights for policy 1, policy_version 466777 (0.0009) [2023-12-26 03:20:17,305][123091] Updated weights for policy 0, policy_version 469827 (0.0005) [2023-12-26 03:20:17,353][123091] Updated weights for policy 0, policy_version 469837 (0.0005) [2023-12-26 03:20:18,059][123091] Updated weights for policy 0, policy_version 469847 (0.0008) [2023-12-26 03:20:18,118][123091] Updated weights for policy 0, policy_version 469857 (0.0010) [2023-12-26 03:20:18,130][123090] Updated weights for policy 1, policy_version 466787 (0.0008) [2023-12-26 03:20:18,176][123091] Updated weights for policy 0, policy_version 469867 (0.0008) [2023-12-26 03:20:18,195][123090] Updated weights for policy 1, policy_version 466797 (0.0009) [2023-12-26 03:20:18,256][123090] Updated weights for policy 1, policy_version 466807 (0.0009) [2023-12-26 03:20:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 239796224. Throughput: 0: 8904.2, 1: 8817.2. Samples: 239808792. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:18,785][121949] Avg episode reward: [(0, '5779.992'), (1, '5693.114')] [2023-12-26 03:20:18,920][123091] Updated weights for policy 0, policy_version 469877 (0.0008) [2023-12-26 03:20:18,982][123091] Updated weights for policy 0, policy_version 469887 (0.0009) [2023-12-26 03:20:19,037][123091] Updated weights for policy 0, policy_version 469897 (0.0008) [2023-12-26 03:20:19,159][123090] Updated weights for policy 1, policy_version 466817 (0.0009) [2023-12-26 03:20:19,223][123090] Updated weights for policy 1, policy_version 466827 (0.0009) [2023-12-26 03:20:19,283][123090] Updated weights for policy 1, policy_version 466837 (0.0009) [2023-12-26 03:20:19,342][123090] Updated weights for policy 1, policy_version 466847 (0.0010) [2023-12-26 03:20:19,892][123091] Updated weights for policy 0, policy_version 469907 (0.0010) [2023-12-26 03:20:19,957][123091] Updated weights for policy 0, policy_version 469917 (0.0010) [2023-12-26 03:20:20,025][123091] Updated weights for policy 0, policy_version 469927 (0.0010) [2023-12-26 03:20:20,191][123090] Updated weights for policy 1, policy_version 466857 (0.0008) [2023-12-26 03:20:20,250][123090] Updated weights for policy 1, policy_version 466867 (0.0010) [2023-12-26 03:20:20,317][123090] Updated weights for policy 1, policy_version 466877 (0.0009) [2023-12-26 03:20:20,895][123091] Updated weights for policy 0, policy_version 469937 (0.0010) [2023-12-26 03:20:20,952][123091] Updated weights for policy 0, policy_version 469947 (0.0009) [2023-12-26 03:20:21,003][123091] Updated weights for policy 0, policy_version 469957 (0.0010) [2023-12-26 03:20:21,074][123091] Updated weights for policy 0, policy_version 469967 (0.0010) [2023-12-26 03:20:21,127][123090] Updated weights for policy 1, policy_version 466887 (0.0009) [2023-12-26 03:20:21,193][123090] Updated weights for policy 1, policy_version 466897 (0.0010) [2023-12-26 03:20:21,262][123090] Updated weights for policy 1, policy_version 466907 (0.0008) [2023-12-26 03:20:21,916][123091] Updated weights for policy 0, policy_version 469977 (0.0008) [2023-12-26 03:20:21,988][123091] Updated weights for policy 0, policy_version 469987 (0.0008) [2023-12-26 03:20:22,051][123091] Updated weights for policy 0, policy_version 469997 (0.0008) [2023-12-26 03:20:22,164][123090] Updated weights for policy 1, policy_version 466917 (0.0009) [2023-12-26 03:20:22,228][123090] Updated weights for policy 1, policy_version 466927 (0.0010) [2023-12-26 03:20:22,292][123090] Updated weights for policy 1, policy_version 466937 (0.0010) [2023-12-26 03:20:22,823][123091] Updated weights for policy 0, policy_version 470007 (0.0006) [2023-12-26 03:20:22,879][123091] Updated weights for policy 0, policy_version 470017 (0.0006) [2023-12-26 03:20:22,932][123091] Updated weights for policy 0, policy_version 470027 (0.0005) [2023-12-26 03:20:23,162][123090] Updated weights for policy 1, policy_version 466947 (0.0008) [2023-12-26 03:20:23,213][123090] Updated weights for policy 1, policy_version 466957 (0.0005) [2023-12-26 03:20:23,260][123090] Updated weights for policy 1, policy_version 466967 (0.0006) [2023-12-26 03:20:23,595][123091] Updated weights for policy 0, policy_version 470037 (0.0005) [2023-12-26 03:20:23,652][123091] Updated weights for policy 0, policy_version 470047 (0.0005) [2023-12-26 03:20:23,699][123091] Updated weights for policy 0, policy_version 470057 (0.0005) [2023-12-26 03:20:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 239886336. Throughput: 0: 8875.0, 1: 8717.4. Samples: 239859064. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:23,785][121949] Avg episode reward: [(0, '5677.611'), (1, '5712.346')] [2023-12-26 03:20:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000470064_120340480.pth... [2023-12-26 03:20:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000466976_119545856.pth... [2023-12-26 03:20:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000469008_120070144.pth [2023-12-26 03:20:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000465952_119283712.pth [2023-12-26 03:20:23,961][123090] Updated weights for policy 1, policy_version 466977 (0.0005) [2023-12-26 03:20:24,014][123090] Updated weights for policy 1, policy_version 466987 (0.0005) [2023-12-26 03:20:24,061][123090] Updated weights for policy 1, policy_version 466997 (0.0005) [2023-12-26 03:20:24,117][123090] Updated weights for policy 1, policy_version 467007 (0.0005) [2023-12-26 03:20:24,393][123091] Updated weights for policy 0, policy_version 470067 (0.0006) [2023-12-26 03:20:24,449][123091] Updated weights for policy 0, policy_version 470077 (0.0005) [2023-12-26 03:20:24,501][123091] Updated weights for policy 0, policy_version 470087 (0.0008) [2023-12-26 03:20:24,807][123090] Updated weights for policy 1, policy_version 467017 (0.0009) [2023-12-26 03:20:24,871][123090] Updated weights for policy 1, policy_version 467027 (0.0009) [2023-12-26 03:20:24,939][123090] Updated weights for policy 1, policy_version 467037 (0.0009) [2023-12-26 03:20:25,296][123091] Updated weights for policy 0, policy_version 470097 (0.0010) [2023-12-26 03:20:25,362][123091] Updated weights for policy 0, policy_version 470107 (0.0010) [2023-12-26 03:20:25,426][123091] Updated weights for policy 0, policy_version 470117 (0.0010) [2023-12-26 03:20:25,489][123091] Updated weights for policy 0, policy_version 470127 (0.0009) [2023-12-26 03:20:25,747][123090] Updated weights for policy 1, policy_version 467047 (0.0010) [2023-12-26 03:20:25,819][123090] Updated weights for policy 1, policy_version 467057 (0.0007) [2023-12-26 03:20:25,877][123090] Updated weights for policy 1, policy_version 467067 (0.0008) [2023-12-26 03:20:26,327][123091] Updated weights for policy 0, policy_version 470137 (0.0010) [2023-12-26 03:20:26,380][123091] Updated weights for policy 0, policy_version 470149 (0.0010) [2023-12-26 03:20:26,431][123091] Updated weights for policy 0, policy_version 470159 (0.0009) [2023-12-26 03:20:26,608][123090] Updated weights for policy 1, policy_version 467077 (0.0007) [2023-12-26 03:20:26,653][123090] Updated weights for policy 1, policy_version 467087 (0.0005) [2023-12-26 03:20:26,703][123090] Updated weights for policy 1, policy_version 467097 (0.0006) [2023-12-26 03:20:27,341][123091] Updated weights for policy 0, policy_version 470169 (0.0007) [2023-12-26 03:20:27,401][123091] Updated weights for policy 0, policy_version 470179 (0.0007) [2023-12-26 03:20:27,471][123091] Updated weights for policy 0, policy_version 470189 (0.0006) [2023-12-26 03:20:27,474][123090] Updated weights for policy 1, policy_version 467108 (0.0006) [2023-12-26 03:20:27,540][123090] Updated weights for policy 1, policy_version 467118 (0.0005) [2023-12-26 03:20:27,590][123090] Updated weights for policy 1, policy_version 467128 (0.0005) [2023-12-26 03:20:28,305][123091] Updated weights for policy 0, policy_version 470199 (0.0009) [2023-12-26 03:20:28,309][123090] Updated weights for policy 1, policy_version 467138 (0.0006) [2023-12-26 03:20:28,366][123091] Updated weights for policy 0, policy_version 470209 (0.0008) [2023-12-26 03:20:28,380][123090] Updated weights for policy 1, policy_version 467148 (0.0013) [2023-12-26 03:20:28,426][123091] Updated weights for policy 0, policy_version 470219 (0.0007) [2023-12-26 03:20:28,444][123090] Updated weights for policy 1, policy_version 467158 (0.0011) [2023-12-26 03:20:28,503][123090] Updated weights for policy 1, policy_version 467168 (0.0010) [2023-12-26 03:20:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 239976448. Throughput: 0: 8900.3, 1: 8810.2. Samples: 239968952. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:28,785][121949] Avg episode reward: [(0, '5857.429'), (1, '5792.386')] [2023-12-26 03:20:29,259][123090] Updated weights for policy 1, policy_version 467178 (0.0006) [2023-12-26 03:20:29,284][123091] Updated weights for policy 0, policy_version 470229 (0.0008) [2023-12-26 03:20:29,323][123090] Updated weights for policy 1, policy_version 467188 (0.0007) [2023-12-26 03:20:29,376][123091] Updated weights for policy 0, policy_version 470239 (0.0007) [2023-12-26 03:20:29,392][123090] Updated weights for policy 1, policy_version 467198 (0.0010) [2023-12-26 03:20:29,447][123091] Updated weights for policy 0, policy_version 470249 (0.0007) [2023-12-26 03:20:30,134][123091] Updated weights for policy 0, policy_version 470259 (0.0009) [2023-12-26 03:20:30,194][123091] Updated weights for policy 0, policy_version 470269 (0.0009) [2023-12-26 03:20:30,238][123090] Updated weights for policy 1, policy_version 467208 (0.0010) [2023-12-26 03:20:30,245][123091] Updated weights for policy 0, policy_version 470279 (0.0007) [2023-12-26 03:20:30,302][123090] Updated weights for policy 1, policy_version 467218 (0.0011) [2023-12-26 03:20:30,346][123090] Updated weights for policy 1, policy_version 467228 (0.0010) [2023-12-26 03:20:31,027][123091] Updated weights for policy 0, policy_version 470289 (0.0008) [2023-12-26 03:20:31,095][123091] Updated weights for policy 0, policy_version 470299 (0.0008) [2023-12-26 03:20:31,164][123091] Updated weights for policy 0, policy_version 470309 (0.0009) [2023-12-26 03:20:31,188][123090] Updated weights for policy 1, policy_version 467238 (0.0008) [2023-12-26 03:20:31,224][123091] Updated weights for policy 0, policy_version 470319 (0.0010) [2023-12-26 03:20:31,244][123090] Updated weights for policy 1, policy_version 467248 (0.0005) [2023-12-26 03:20:31,309][123090] Updated weights for policy 1, policy_version 467258 (0.0008) [2023-12-26 03:20:32,034][123091] Updated weights for policy 0, policy_version 470329 (0.0010) [2023-12-26 03:20:32,046][123090] Updated weights for policy 1, policy_version 467268 (0.0012) [2023-12-26 03:20:32,097][123090] Updated weights for policy 1, policy_version 467278 (0.0008) [2023-12-26 03:20:32,100][123091] Updated weights for policy 0, policy_version 470339 (0.0010) [2023-12-26 03:20:32,144][123090] Updated weights for policy 1, policy_version 467288 (0.0008) [2023-12-26 03:20:32,156][123091] Updated weights for policy 0, policy_version 470349 (0.0011) [2023-12-26 03:20:32,811][123090] Updated weights for policy 1, policy_version 467298 (0.0005) [2023-12-26 03:20:32,876][123091] Updated weights for policy 0, policy_version 470359 (0.0008) [2023-12-26 03:20:32,880][123090] Updated weights for policy 1, policy_version 467308 (0.0007) [2023-12-26 03:20:32,937][123091] Updated weights for policy 0, policy_version 470369 (0.0007) [2023-12-26 03:20:32,939][123090] Updated weights for policy 1, policy_version 467318 (0.0010) [2023-12-26 03:20:32,990][123090] Updated weights for policy 1, policy_version 467328 (0.0010) [2023-12-26 03:20:32,993][123091] Updated weights for policy 0, policy_version 470379 (0.0006) [2023-12-26 03:20:33,734][123091] Updated weights for policy 0, policy_version 470389 (0.0007) [2023-12-26 03:20:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 240058368. Throughput: 0: 8808.5, 1: 8889.9. Samples: 240076472. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:33,785][121949] Avg episode reward: [(0, '5967.317'), (1, '5804.118')] [2023-12-26 03:20:33,790][123091] Updated weights for policy 0, policy_version 470399 (0.0005) [2023-12-26 03:20:33,794][123090] Updated weights for policy 1, policy_version 467338 (0.0010) [2023-12-26 03:20:33,858][123090] Updated weights for policy 1, policy_version 467348 (0.0011) [2023-12-26 03:20:33,864][123091] Updated weights for policy 0, policy_version 470409 (0.0006) [2023-12-26 03:20:33,925][123090] Updated weights for policy 1, policy_version 467358 (0.0011) [2023-12-26 03:20:34,514][123091] Updated weights for policy 0, policy_version 470419 (0.0008) [2023-12-26 03:20:34,575][123091] Updated weights for policy 0, policy_version 470429 (0.0011) [2023-12-26 03:20:34,642][123091] Updated weights for policy 0, policy_version 470439 (0.0011) [2023-12-26 03:20:34,762][123090] Updated weights for policy 1, policy_version 467368 (0.0011) [2023-12-26 03:20:34,829][123090] Updated weights for policy 1, policy_version 467378 (0.0010) [2023-12-26 03:20:34,894][123090] Updated weights for policy 1, policy_version 467388 (0.0011) [2023-12-26 03:20:35,454][123091] Updated weights for policy 0, policy_version 470449 (0.0011) [2023-12-26 03:20:35,502][123091] Updated weights for policy 0, policy_version 470459 (0.0011) [2023-12-26 03:20:35,553][123091] Updated weights for policy 0, policy_version 470469 (0.0010) [2023-12-26 03:20:35,609][123091] Updated weights for policy 0, policy_version 470479 (0.0005) [2023-12-26 03:20:35,660][123090] Updated weights for policy 1, policy_version 467398 (0.0007) [2023-12-26 03:20:35,710][123090] Updated weights for policy 1, policy_version 467408 (0.0005) [2023-12-26 03:20:35,759][123090] Updated weights for policy 1, policy_version 467418 (0.0005) [2023-12-26 03:20:36,342][123091] Updated weights for policy 0, policy_version 470489 (0.0006) [2023-12-26 03:20:36,397][123091] Updated weights for policy 0, policy_version 470499 (0.0006) [2023-12-26 03:20:36,455][123091] Updated weights for policy 0, policy_version 470509 (0.0006) [2023-12-26 03:20:36,504][123090] Updated weights for policy 1, policy_version 467428 (0.0007) [2023-12-26 03:20:36,560][123090] Updated weights for policy 1, policy_version 467438 (0.0010) [2023-12-26 03:20:36,617][123090] Updated weights for policy 1, policy_version 467448 (0.0011) [2023-12-26 03:20:37,157][123091] Updated weights for policy 0, policy_version 470519 (0.0010) [2023-12-26 03:20:37,221][123091] Updated weights for policy 0, policy_version 470529 (0.0011) [2023-12-26 03:20:37,282][123091] Updated weights for policy 0, policy_version 470539 (0.0011) [2023-12-26 03:20:37,434][123090] Updated weights for policy 1, policy_version 467458 (0.0011) [2023-12-26 03:20:37,507][123090] Updated weights for policy 1, policy_version 467468 (0.0005) [2023-12-26 03:20:37,575][123090] Updated weights for policy 1, policy_version 467478 (0.0006) [2023-12-26 03:20:37,641][123090] Updated weights for policy 1, policy_version 467488 (0.0009) [2023-12-26 03:20:38,053][123091] Updated weights for policy 0, policy_version 470549 (0.0006) [2023-12-26 03:20:38,128][123091] Updated weights for policy 0, policy_version 470559 (0.0005) [2023-12-26 03:20:38,181][123091] Updated weights for policy 0, policy_version 470569 (0.0005) [2023-12-26 03:20:38,466][123090] Updated weights for policy 1, policy_version 467498 (0.0009) [2023-12-26 03:20:38,524][123090] Updated weights for policy 1, policy_version 467508 (0.0009) [2023-12-26 03:20:38,598][123090] Updated weights for policy 1, policy_version 467518 (0.0007) [2023-12-26 03:20:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 240156672. Throughput: 0: 8864.4, 1: 8920.9. Samples: 240131776. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:38,785][121949] Avg episode reward: [(0, '6002.812'), (1, '5766.057')] [2023-12-26 03:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000470576_120471552.pth... [2023-12-26 03:20:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000467520_119685120.pth... [2023-12-26 03:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000469552_120209408.pth [2023-12-26 03:20:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000466496_119422976.pth [2023-12-26 03:20:38,955][123091] Updated weights for policy 0, policy_version 470579 (0.0007) [2023-12-26 03:20:39,026][123091] Updated weights for policy 0, policy_version 470589 (0.0011) [2023-12-26 03:20:39,090][123091] Updated weights for policy 0, policy_version 470599 (0.0011) [2023-12-26 03:20:39,296][123090] Updated weights for policy 1, policy_version 467528 (0.0006) [2023-12-26 03:20:39,362][123090] Updated weights for policy 1, policy_version 467538 (0.0008) [2023-12-26 03:20:39,432][123090] Updated weights for policy 1, policy_version 467548 (0.0009) [2023-12-26 03:20:39,908][123091] Updated weights for policy 0, policy_version 470609 (0.0010) [2023-12-26 03:20:39,987][123091] Updated weights for policy 0, policy_version 470619 (0.0007) [2023-12-26 03:20:40,053][123091] Updated weights for policy 0, policy_version 470629 (0.0008) [2023-12-26 03:20:40,121][123091] Updated weights for policy 0, policy_version 470639 (0.0008) [2023-12-26 03:20:40,283][123090] Updated weights for policy 1, policy_version 467558 (0.0010) [2023-12-26 03:20:40,346][123090] Updated weights for policy 1, policy_version 467568 (0.0010) [2023-12-26 03:20:40,405][123090] Updated weights for policy 1, policy_version 467578 (0.0010) [2023-12-26 03:20:40,872][123091] Updated weights for policy 0, policy_version 470649 (0.0010) [2023-12-26 03:20:40,935][123091] Updated weights for policy 0, policy_version 470659 (0.0011) [2023-12-26 03:20:41,001][123091] Updated weights for policy 0, policy_version 470669 (0.0010) [2023-12-26 03:20:41,154][123090] Updated weights for policy 1, policy_version 467588 (0.0010) [2023-12-26 03:20:41,213][123090] Updated weights for policy 1, policy_version 467598 (0.0009) [2023-12-26 03:20:41,274][123090] Updated weights for policy 1, policy_version 467608 (0.0009) [2023-12-26 03:20:41,880][123091] Updated weights for policy 0, policy_version 470679 (0.0009) [2023-12-26 03:20:41,943][123091] Updated weights for policy 0, policy_version 470689 (0.0009) [2023-12-26 03:20:42,011][123091] Updated weights for policy 0, policy_version 470699 (0.0010) [2023-12-26 03:20:42,162][123090] Updated weights for policy 1, policy_version 467618 (0.0009) [2023-12-26 03:20:42,212][123090] Updated weights for policy 1, policy_version 467628 (0.0010) [2023-12-26 03:20:42,271][123090] Updated weights for policy 1, policy_version 467638 (0.0009) [2023-12-26 03:20:42,334][123090] Updated weights for policy 1, policy_version 467648 (0.0010) [2023-12-26 03:20:42,790][123091] Updated weights for policy 0, policy_version 470709 (0.0008) [2023-12-26 03:20:42,853][123091] Updated weights for policy 0, policy_version 470719 (0.0010) [2023-12-26 03:20:42,922][123091] Updated weights for policy 0, policy_version 470729 (0.0009) [2023-12-26 03:20:43,177][123090] Updated weights for policy 1, policy_version 467658 (0.0009) [2023-12-26 03:20:43,234][123090] Updated weights for policy 1, policy_version 467668 (0.0009) [2023-12-26 03:20:43,303][123090] Updated weights for policy 1, policy_version 467678 (0.0006) [2023-12-26 03:20:43,648][123091] Updated weights for policy 0, policy_version 470739 (0.0008) [2023-12-26 03:20:43,702][123091] Updated weights for policy 0, policy_version 470749 (0.0005) [2023-12-26 03:20:43,756][123091] Updated weights for policy 0, policy_version 470759 (0.0005) [2023-12-26 03:20:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 240238592. Throughput: 0: 8924.5, 1: 8812.4. Samples: 240236868. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:43,784][121949] Avg episode reward: [(0, '5928.198'), (1, '5711.349')] [2023-12-26 03:20:44,080][123090] Updated weights for policy 1, policy_version 467688 (0.0008) [2023-12-26 03:20:44,149][123090] Updated weights for policy 1, policy_version 467698 (0.0009) [2023-12-26 03:20:44,207][123090] Updated weights for policy 1, policy_version 467708 (0.0010) [2023-12-26 03:20:44,457][123091] Updated weights for policy 0, policy_version 470769 (0.0006) [2023-12-26 03:20:44,514][123091] Updated weights for policy 0, policy_version 470779 (0.0008) [2023-12-26 03:20:44,573][123091] Updated weights for policy 0, policy_version 470789 (0.0008) [2023-12-26 03:20:44,630][123091] Updated weights for policy 0, policy_version 470799 (0.0006) [2023-12-26 03:20:45,027][123090] Updated weights for policy 1, policy_version 467718 (0.0009) [2023-12-26 03:20:45,085][123090] Updated weights for policy 1, policy_version 467728 (0.0009) [2023-12-26 03:20:45,144][123090] Updated weights for policy 1, policy_version 467738 (0.0009) [2023-12-26 03:20:45,365][123091] Updated weights for policy 0, policy_version 470809 (0.0007) [2023-12-26 03:20:45,431][123091] Updated weights for policy 0, policy_version 470819 (0.0010) [2023-12-26 03:20:45,498][123091] Updated weights for policy 0, policy_version 470829 (0.0009) [2023-12-26 03:20:46,016][123090] Updated weights for policy 1, policy_version 467748 (0.0010) [2023-12-26 03:20:46,081][123090] Updated weights for policy 1, policy_version 467758 (0.0009) [2023-12-26 03:20:46,138][123090] Updated weights for policy 1, policy_version 467768 (0.0010) [2023-12-26 03:20:46,229][123091] Updated weights for policy 0, policy_version 470839 (0.0007) [2023-12-26 03:20:46,285][123091] Updated weights for policy 0, policy_version 470849 (0.0005) [2023-12-26 03:20:46,348][123091] Updated weights for policy 0, policy_version 470859 (0.0007) [2023-12-26 03:20:46,980][123091] Updated weights for policy 0, policy_version 470869 (0.0005) [2023-12-26 03:20:47,030][123090] Updated weights for policy 1, policy_version 467778 (0.0009) [2023-12-26 03:20:47,038][123091] Updated weights for policy 0, policy_version 470879 (0.0005) [2023-12-26 03:20:47,085][123091] Updated weights for policy 0, policy_version 470889 (0.0005) [2023-12-26 03:20:47,088][123090] Updated weights for policy 1, policy_version 467789 (0.0009) [2023-12-26 03:20:47,146][123090] Updated weights for policy 1, policy_version 467799 (0.0009) [2023-12-26 03:20:47,728][123091] Updated weights for policy 0, policy_version 470899 (0.0005) [2023-12-26 03:20:47,778][123091] Updated weights for policy 0, policy_version 470909 (0.0006) [2023-12-26 03:20:47,830][123091] Updated weights for policy 0, policy_version 470919 (0.0006) [2023-12-26 03:20:48,085][123090] Updated weights for policy 1, policy_version 467809 (0.0010) [2023-12-26 03:20:48,142][123090] Updated weights for policy 1, policy_version 467819 (0.0009) [2023-12-26 03:20:48,206][123090] Updated weights for policy 1, policy_version 467829 (0.0009) [2023-12-26 03:20:48,268][123090] Updated weights for policy 1, policy_version 467839 (0.0009) [2023-12-26 03:20:48,561][123091] Updated weights for policy 0, policy_version 470929 (0.0007) [2023-12-26 03:20:48,618][123091] Updated weights for policy 0, policy_version 470939 (0.0011) [2023-12-26 03:20:48,678][123091] Updated weights for policy 0, policy_version 470949 (0.0011) [2023-12-26 03:20:48,741][123091] Updated weights for policy 0, policy_version 470959 (0.0011) [2023-12-26 03:20:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 240336896. Throughput: 0: 9054.4, 1: 8670.4. Samples: 240345108. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:48,785][121949] Avg episode reward: [(0, '6086.613'), (1, '5675.874')] [2023-12-26 03:20:49,154][123090] Updated weights for policy 1, policy_version 467849 (0.0006) [2023-12-26 03:20:49,213][123090] Updated weights for policy 1, policy_version 467859 (0.0007) [2023-12-26 03:20:49,286][123090] Updated weights for policy 1, policy_version 467869 (0.0010) [2023-12-26 03:20:49,474][123091] Updated weights for policy 0, policy_version 470969 (0.0008) [2023-12-26 03:20:49,528][123091] Updated weights for policy 0, policy_version 470979 (0.0009) [2023-12-26 03:20:49,584][123091] Updated weights for policy 0, policy_version 470989 (0.0010) [2023-12-26 03:20:50,135][123090] Updated weights for policy 1, policy_version 467879 (0.0009) [2023-12-26 03:20:50,206][123090] Updated weights for policy 1, policy_version 467889 (0.0010) [2023-12-26 03:20:50,276][123090] Updated weights for policy 1, policy_version 467899 (0.0009) [2023-12-26 03:20:50,462][123091] Updated weights for policy 0, policy_version 471000 (0.0010) [2023-12-26 03:20:50,525][123091] Updated weights for policy 0, policy_version 471010 (0.0010) [2023-12-26 03:20:50,588][123091] Updated weights for policy 0, policy_version 471020 (0.0009) [2023-12-26 03:20:51,105][123090] Updated weights for policy 1, policy_version 467909 (0.0008) [2023-12-26 03:20:51,169][123090] Updated weights for policy 1, policy_version 467919 (0.0006) [2023-12-26 03:20:51,219][123090] Updated weights for policy 1, policy_version 467929 (0.0007) [2023-12-26 03:20:51,429][123091] Updated weights for policy 0, policy_version 471030 (0.0009) [2023-12-26 03:20:51,495][123091] Updated weights for policy 0, policy_version 471040 (0.0006) [2023-12-26 03:20:51,571][123091] Updated weights for policy 0, policy_version 471050 (0.0007) [2023-12-26 03:20:52,025][123090] Updated weights for policy 1, policy_version 467939 (0.0007) [2023-12-26 03:20:52,107][123090] Updated weights for policy 1, policy_version 467949 (0.0010) [2023-12-26 03:20:52,177][123090] Updated weights for policy 1, policy_version 467959 (0.0010) [2023-12-26 03:20:52,352][123091] Updated weights for policy 0, policy_version 471060 (0.0010) [2023-12-26 03:20:52,418][123091] Updated weights for policy 0, policy_version 471070 (0.0008) [2023-12-26 03:20:52,481][123091] Updated weights for policy 0, policy_version 471080 (0.0005) [2023-12-26 03:20:52,957][123090] Updated weights for policy 1, policy_version 467969 (0.0008) [2023-12-26 03:20:53,025][123090] Updated weights for policy 1, policy_version 467979 (0.0009) [2023-12-26 03:20:53,090][123090] Updated weights for policy 1, policy_version 467989 (0.0009) [2023-12-26 03:20:53,151][123090] Updated weights for policy 1, policy_version 467999 (0.0005) [2023-12-26 03:20:53,247][123091] Updated weights for policy 0, policy_version 471090 (0.0007) [2023-12-26 03:20:53,300][123091] Updated weights for policy 0, policy_version 471101 (0.0010) [2023-12-26 03:20:53,357][123091] Updated weights for policy 0, policy_version 471112 (0.0010) [2023-12-26 03:20:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 240418816. Throughput: 0: 8994.4, 1: 8675.3. Samples: 240396408. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:53,785][121949] Avg episode reward: [(0, '6126.817'), (1, '5527.027')] [2023-12-26 03:20:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000471120_120610816.pth... [2023-12-26 03:20:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000470064_120340480.pth [2023-12-26 03:20:53,859][123090] Updated weights for policy 1, policy_version 468009 (0.0005) [2023-12-26 03:20:53,922][123090] Updated weights for policy 1, policy_version 468019 (0.0005) [2023-12-26 03:20:53,993][123090] Updated weights for policy 1, policy_version 468029 (0.0005) [2023-12-26 03:20:54,010][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000468032_119816192.pth... [2023-12-26 03:20:54,015][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000466976_119545856.pth [2023-12-26 03:20:54,169][123091] Updated weights for policy 0, policy_version 471122 (0.0005) [2023-12-26 03:20:54,231][123091] Updated weights for policy 0, policy_version 471132 (0.0006) [2023-12-26 03:20:54,293][123091] Updated weights for policy 0, policy_version 471142 (0.0006) [2023-12-26 03:20:54,363][123091] Updated weights for policy 0, policy_version 471152 (0.0005) [2023-12-26 03:20:54,832][123090] Updated weights for policy 1, policy_version 468039 (0.0009) [2023-12-26 03:20:54,888][123090] Updated weights for policy 1, policy_version 468049 (0.0009) [2023-12-26 03:20:54,962][123090] Updated weights for policy 1, policy_version 468059 (0.0009) [2023-12-26 03:20:55,045][123091] Updated weights for policy 0, policy_version 471162 (0.0011) [2023-12-26 03:20:55,107][123091] Updated weights for policy 0, policy_version 471172 (0.0010) [2023-12-26 03:20:55,155][123091] Updated weights for policy 0, policy_version 471182 (0.0010) [2023-12-26 03:20:55,739][123090] Updated weights for policy 1, policy_version 468069 (0.0010) [2023-12-26 03:20:55,791][123090] Updated weights for policy 1, policy_version 468079 (0.0009) [2023-12-26 03:20:55,828][123091] Updated weights for policy 0, policy_version 471192 (0.0006) [2023-12-26 03:20:55,840][123090] Updated weights for policy 1, policy_version 468089 (0.0009) [2023-12-26 03:20:55,893][123091] Updated weights for policy 0, policy_version 471202 (0.0005) [2023-12-26 03:20:55,969][123091] Updated weights for policy 0, policy_version 471212 (0.0005) [2023-12-26 03:20:56,463][123091] Updated weights for policy 0, policy_version 471222 (0.0005) [2023-12-26 03:20:56,515][123091] Updated weights for policy 0, policy_version 471232 (0.0005) [2023-12-26 03:20:56,564][123091] Updated weights for policy 0, policy_version 471242 (0.0008) [2023-12-26 03:20:56,750][123090] Updated weights for policy 1, policy_version 468099 (0.0009) [2023-12-26 03:20:56,804][123090] Updated weights for policy 1, policy_version 468109 (0.0009) [2023-12-26 03:20:56,856][123090] Updated weights for policy 1, policy_version 468119 (0.0008) [2023-12-26 03:20:57,359][123091] Updated weights for policy 0, policy_version 471252 (0.0010) [2023-12-26 03:20:57,425][123091] Updated weights for policy 0, policy_version 471262 (0.0010) [2023-12-26 03:20:57,479][123091] Updated weights for policy 0, policy_version 471272 (0.0010) [2023-12-26 03:20:57,694][123090] Updated weights for policy 1, policy_version 468129 (0.0009) [2023-12-26 03:20:57,755][123090] Updated weights for policy 1, policy_version 468139 (0.0009) [2023-12-26 03:20:57,808][123090] Updated weights for policy 1, policy_version 468149 (0.0009) [2023-12-26 03:20:57,860][123090] Updated weights for policy 1, policy_version 468160 (0.0010) [2023-12-26 03:20:58,218][123091] Updated weights for policy 0, policy_version 471282 (0.0010) [2023-12-26 03:20:58,293][123091] Updated weights for policy 0, policy_version 471292 (0.0011) [2023-12-26 03:20:58,369][123091] Updated weights for policy 0, policy_version 471302 (0.0010) [2023-12-26 03:20:58,441][123091] Updated weights for policy 0, policy_version 471312 (0.0008) [2023-12-26 03:20:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 240508928. Throughput: 0: 9094.7, 1: 8696.2. Samples: 240505632. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:20:58,785][121949] Avg episode reward: [(0, '6155.428'), (1, '5545.451')] [2023-12-26 03:20:58,795][123090] Updated weights for policy 1, policy_version 468170 (0.0007) [2023-12-26 03:20:58,861][123090] Updated weights for policy 1, policy_version 468180 (0.0008) [2023-12-26 03:20:58,932][123090] Updated weights for policy 1, policy_version 468190 (0.0008) [2023-12-26 03:20:59,228][123091] Updated weights for policy 0, policy_version 471322 (0.0007) [2023-12-26 03:20:59,291][123091] Updated weights for policy 0, policy_version 471332 (0.0010) [2023-12-26 03:20:59,356][123091] Updated weights for policy 0, policy_version 471342 (0.0009) [2023-12-26 03:20:59,712][123090] Updated weights for policy 1, policy_version 468200 (0.0009) [2023-12-26 03:20:59,767][123090] Updated weights for policy 1, policy_version 468210 (0.0009) [2023-12-26 03:20:59,826][123090] Updated weights for policy 1, policy_version 468220 (0.0009) [2023-12-26 03:21:00,204][123091] Updated weights for policy 0, policy_version 471352 (0.0010) [2023-12-26 03:21:00,262][123091] Updated weights for policy 0, policy_version 471362 (0.0010) [2023-12-26 03:21:00,322][123091] Updated weights for policy 0, policy_version 471372 (0.0010) [2023-12-26 03:21:00,551][123090] Updated weights for policy 1, policy_version 468230 (0.0009) [2023-12-26 03:21:00,609][123090] Updated weights for policy 1, policy_version 468240 (0.0006) [2023-12-26 03:21:00,665][123090] Updated weights for policy 1, policy_version 468250 (0.0005) [2023-12-26 03:21:01,113][123091] Updated weights for policy 0, policy_version 471382 (0.0011) [2023-12-26 03:21:01,186][123091] Updated weights for policy 0, policy_version 471392 (0.0009) [2023-12-26 03:21:01,259][123091] Updated weights for policy 0, policy_version 471402 (0.0006) [2023-12-26 03:21:01,498][123090] Updated weights for policy 1, policy_version 468260 (0.0006) [2023-12-26 03:21:01,565][123090] Updated weights for policy 1, policy_version 468270 (0.0008) [2023-12-26 03:21:01,630][123090] Updated weights for policy 1, policy_version 468280 (0.0008) [2023-12-26 03:21:01,994][123091] Updated weights for policy 0, policy_version 471412 (0.0009) [2023-12-26 03:21:02,046][123091] Updated weights for policy 0, policy_version 471422 (0.0005) [2023-12-26 03:21:02,110][123091] Updated weights for policy 0, policy_version 471432 (0.0005) [2023-12-26 03:21:02,452][123090] Updated weights for policy 1, policy_version 468290 (0.0008) [2023-12-26 03:21:02,521][123090] Updated weights for policy 1, policy_version 468300 (0.0009) [2023-12-26 03:21:02,585][123090] Updated weights for policy 1, policy_version 468310 (0.0009) [2023-12-26 03:21:02,651][123090] Updated weights for policy 1, policy_version 468320 (0.0008) [2023-12-26 03:21:02,816][123091] Updated weights for policy 0, policy_version 471442 (0.0006) [2023-12-26 03:21:02,865][123091] Updated weights for policy 0, policy_version 471452 (0.0006) [2023-12-26 03:21:02,913][123091] Updated weights for policy 0, policy_version 471462 (0.0005) [2023-12-26 03:21:02,959][123091] Updated weights for policy 0, policy_version 471472 (0.0005) [2023-12-26 03:21:03,544][123090] Updated weights for policy 1, policy_version 468330 (0.0010) [2023-12-26 03:21:03,602][123090] Updated weights for policy 1, policy_version 468340 (0.0009) [2023-12-26 03:21:03,646][123091] Updated weights for policy 0, policy_version 471482 (0.0006) [2023-12-26 03:21:03,659][123090] Updated weights for policy 1, policy_version 468351 (0.0008) [2023-12-26 03:21:03,700][123091] Updated weights for policy 0, policy_version 471492 (0.0005) [2023-12-26 03:21:03,767][123091] Updated weights for policy 0, policy_version 471502 (0.0005) [2023-12-26 03:21:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 240607232. Throughput: 0: 9168.8, 1: 8688.6. Samples: 240612376. Policy #0 lag: (min: 31.0, avg: 32.6, max: 63.0) [2023-12-26 03:21:03,786][121949] Avg episode reward: [(0, '6075.111'), (1, '5795.163')] [2023-12-26 03:21:04,491][123090] Updated weights for policy 1, policy_version 468361 (0.0010) [2023-12-26 03:21:04,560][123090] Updated weights for policy 1, policy_version 468371 (0.0006) [2023-12-26 03:21:04,585][123091] Updated weights for policy 0, policy_version 471512 (0.0006) [2023-12-26 03:21:04,630][123090] Updated weights for policy 1, policy_version 468381 (0.0010) [2023-12-26 03:21:04,654][123091] Updated weights for policy 0, policy_version 471522 (0.0008) [2023-12-26 03:21:04,710][123091] Updated weights for policy 0, policy_version 471532 (0.0010) [2023-12-26 03:21:05,371][123091] Updated weights for policy 0, policy_version 471542 (0.0010) [2023-12-26 03:21:05,438][123091] Updated weights for policy 0, policy_version 471552 (0.0010) [2023-12-26 03:21:05,492][123090] Updated weights for policy 1, policy_version 468391 (0.0009) [2023-12-26 03:21:05,495][123091] Updated weights for policy 0, policy_version 471562 (0.0007) [2023-12-26 03:21:05,555][123090] Updated weights for policy 1, policy_version 468401 (0.0011) [2023-12-26 03:21:05,623][123090] Updated weights for policy 1, policy_version 468411 (0.0011) [2023-12-26 03:21:06,200][123091] Updated weights for policy 0, policy_version 471572 (0.0008) [2023-12-26 03:21:06,259][123091] Updated weights for policy 0, policy_version 471582 (0.0008) [2023-12-26 03:21:06,326][123091] Updated weights for policy 0, policy_version 471592 (0.0008) [2023-12-26 03:21:06,427][123090] Updated weights for policy 1, policy_version 468421 (0.0008) [2023-12-26 03:21:06,489][123090] Updated weights for policy 1, policy_version 468431 (0.0010) [2023-12-26 03:21:06,556][123090] Updated weights for policy 1, policy_version 468441 (0.0011) [2023-12-26 03:21:07,081][123091] Updated weights for policy 0, policy_version 471602 (0.0008) [2023-12-26 03:21:07,146][123091] Updated weights for policy 0, policy_version 471612 (0.0005) [2023-12-26 03:21:07,206][123091] Updated weights for policy 0, policy_version 471622 (0.0005) [2023-12-26 03:21:07,263][123091] Updated weights for policy 0, policy_version 471632 (0.0005) [2023-12-26 03:21:07,332][123090] Updated weights for policy 1, policy_version 468451 (0.0009) [2023-12-26 03:21:07,407][123090] Updated weights for policy 1, policy_version 468461 (0.0007) [2023-12-26 03:21:07,486][123090] Updated weights for policy 1, policy_version 468471 (0.0009) [2023-12-26 03:21:08,019][123091] Updated weights for policy 0, policy_version 471642 (0.0011) [2023-12-26 03:21:08,083][123091] Updated weights for policy 0, policy_version 471652 (0.0011) [2023-12-26 03:21:08,138][123091] Updated weights for policy 0, policy_version 471662 (0.0011) [2023-12-26 03:21:08,280][123090] Updated weights for policy 1, policy_version 468481 (0.0011) [2023-12-26 03:21:08,345][123090] Updated weights for policy 1, policy_version 468491 (0.0009) [2023-12-26 03:21:08,404][123090] Updated weights for policy 1, policy_version 468501 (0.0009) [2023-12-26 03:21:08,458][123090] Updated weights for policy 1, policy_version 468511 (0.0009) [2023-12-26 03:21:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 240689152. Throughput: 0: 9229.8, 1: 8692.2. Samples: 240665560. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:08,786][121949] Avg episode reward: [(0, '5774.583'), (1, '5659.242')] [2023-12-26 03:21:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000471664_120750080.pth... [2023-12-26 03:21:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000468512_119939072.pth... [2023-12-26 03:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000470576_120471552.pth [2023-12-26 03:21:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000467520_119685120.pth [2023-12-26 03:21:08,981][123091] Updated weights for policy 0, policy_version 471672 (0.0011) [2023-12-26 03:21:09,040][123091] Updated weights for policy 0, policy_version 471682 (0.0010) [2023-12-26 03:21:09,106][123091] Updated weights for policy 0, policy_version 471692 (0.0011) [2023-12-26 03:21:09,246][123090] Updated weights for policy 1, policy_version 468521 (0.0011) [2023-12-26 03:21:09,299][123090] Updated weights for policy 1, policy_version 468531 (0.0011) [2023-12-26 03:21:09,372][123090] Updated weights for policy 1, policy_version 468541 (0.0010) [2023-12-26 03:21:09,921][123091] Updated weights for policy 0, policy_version 471702 (0.0010) [2023-12-26 03:21:09,985][123091] Updated weights for policy 0, policy_version 471712 (0.0009) [2023-12-26 03:21:10,047][123091] Updated weights for policy 0, policy_version 471722 (0.0007) [2023-12-26 03:21:10,242][123090] Updated weights for policy 1, policy_version 468551 (0.0009) [2023-12-26 03:21:10,322][123090] Updated weights for policy 1, policy_version 468561 (0.0006) [2023-12-26 03:21:10,399][123090] Updated weights for policy 1, policy_version 468571 (0.0008) [2023-12-26 03:21:10,774][123091] Updated weights for policy 0, policy_version 471732 (0.0009) [2023-12-26 03:21:10,847][123091] Updated weights for policy 0, policy_version 471742 (0.0011) [2023-12-26 03:21:10,918][123091] Updated weights for policy 0, policy_version 471752 (0.0011) [2023-12-26 03:21:11,074][123090] Updated weights for policy 1, policy_version 468581 (0.0009) [2023-12-26 03:21:11,140][123090] Updated weights for policy 1, policy_version 468591 (0.0009) [2023-12-26 03:21:11,219][123090] Updated weights for policy 1, policy_version 468601 (0.0007) [2023-12-26 03:21:11,708][123091] Updated weights for policy 0, policy_version 471762 (0.0010) [2023-12-26 03:21:11,768][123091] Updated weights for policy 0, policy_version 471772 (0.0006) [2023-12-26 03:21:11,830][123091] Updated weights for policy 0, policy_version 471782 (0.0006) [2023-12-26 03:21:11,903][123091] Updated weights for policy 0, policy_version 471792 (0.0008) [2023-12-26 03:21:12,065][123090] Updated weights for policy 1, policy_version 468611 (0.0011) [2023-12-26 03:21:12,135][123090] Updated weights for policy 1, policy_version 468621 (0.0008) [2023-12-26 03:21:12,208][123090] Updated weights for policy 1, policy_version 468631 (0.0008) [2023-12-26 03:21:12,664][123091] Updated weights for policy 0, policy_version 471802 (0.0010) [2023-12-26 03:21:12,720][123091] Updated weights for policy 0, policy_version 471812 (0.0009) [2023-12-26 03:21:12,776][123091] Updated weights for policy 0, policy_version 471822 (0.0008) [2023-12-26 03:21:12,977][123090] Updated weights for policy 1, policy_version 468641 (0.0011) [2023-12-26 03:21:13,048][123090] Updated weights for policy 1, policy_version 468651 (0.0009) [2023-12-26 03:21:13,099][123090] Updated weights for policy 1, policy_version 468661 (0.0009) [2023-12-26 03:21:13,147][123090] Updated weights for policy 1, policy_version 468671 (0.0009) [2023-12-26 03:21:13,565][123091] Updated weights for policy 0, policy_version 471832 (0.0007) [2023-12-26 03:21:13,629][123091] Updated weights for policy 0, policy_version 471842 (0.0006) [2023-12-26 03:21:13,690][123091] Updated weights for policy 0, policy_version 471852 (0.0005) [2023-12-26 03:21:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 240779264. Throughput: 0: 9215.7, 1: 8628.2. Samples: 240771928. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:13,785][121949] Avg episode reward: [(0, '5573.350'), (1, '5566.695')] [2023-12-26 03:21:13,971][123090] Updated weights for policy 1, policy_version 468681 (0.0010) [2023-12-26 03:21:14,023][123090] Updated weights for policy 1, policy_version 468691 (0.0010) [2023-12-26 03:21:14,071][123090] Updated weights for policy 1, policy_version 468701 (0.0010) [2023-12-26 03:21:14,317][123091] Updated weights for policy 0, policy_version 471862 (0.0008) [2023-12-26 03:21:14,370][123091] Updated weights for policy 0, policy_version 471872 (0.0009) [2023-12-26 03:21:14,418][123091] Updated weights for policy 0, policy_version 471882 (0.0008) [2023-12-26 03:21:14,936][123090] Updated weights for policy 1, policy_version 468711 (0.0009) [2023-12-26 03:21:15,006][123090] Updated weights for policy 1, policy_version 468721 (0.0009) [2023-12-26 03:21:15,070][123090] Updated weights for policy 1, policy_version 468731 (0.0011) [2023-12-26 03:21:15,256][123091] Updated weights for policy 0, policy_version 471892 (0.0009) [2023-12-26 03:21:15,324][123091] Updated weights for policy 0, policy_version 471902 (0.0009) [2023-12-26 03:21:15,389][123091] Updated weights for policy 0, policy_version 471912 (0.0009) [2023-12-26 03:21:15,901][123090] Updated weights for policy 1, policy_version 468741 (0.0010) [2023-12-26 03:21:15,948][123090] Updated weights for policy 1, policy_version 468751 (0.0007) [2023-12-26 03:21:16,001][123090] Updated weights for policy 1, policy_version 468761 (0.0005) [2023-12-26 03:21:16,112][123091] Updated weights for policy 0, policy_version 471922 (0.0008) [2023-12-26 03:21:16,162][123091] Updated weights for policy 0, policy_version 471932 (0.0005) [2023-12-26 03:21:16,213][123091] Updated weights for policy 0, policy_version 471942 (0.0006) [2023-12-26 03:21:16,260][123091] Updated weights for policy 0, policy_version 471952 (0.0010) [2023-12-26 03:21:16,631][123090] Updated weights for policy 1, policy_version 468771 (0.0006) [2023-12-26 03:21:16,700][123090] Updated weights for policy 1, policy_version 468781 (0.0009) [2023-12-26 03:21:16,774][123090] Updated weights for policy 1, policy_version 468791 (0.0010) [2023-12-26 03:21:17,017][123091] Updated weights for policy 0, policy_version 471962 (0.0005) [2023-12-26 03:21:17,086][123091] Updated weights for policy 0, policy_version 471972 (0.0006) [2023-12-26 03:21:17,135][123091] Updated weights for policy 0, policy_version 471982 (0.0005) [2023-12-26 03:21:17,479][123090] Updated weights for policy 1, policy_version 468801 (0.0010) [2023-12-26 03:21:17,542][123090] Updated weights for policy 1, policy_version 468811 (0.0010) [2023-12-26 03:21:17,596][123090] Updated weights for policy 1, policy_version 468821 (0.0010) [2023-12-26 03:21:17,657][123090] Updated weights for policy 1, policy_version 468831 (0.0010) [2023-12-26 03:21:17,918][123091] Updated weights for policy 0, policy_version 471992 (0.0005) [2023-12-26 03:21:17,962][123091] Updated weights for policy 0, policy_version 472002 (0.0005) [2023-12-26 03:21:18,009][123091] Updated weights for policy 0, policy_version 472012 (0.0005) [2023-12-26 03:21:18,477][123090] Updated weights for policy 1, policy_version 468841 (0.0010) [2023-12-26 03:21:18,536][123090] Updated weights for policy 1, policy_version 468851 (0.0011) [2023-12-26 03:21:18,601][123090] Updated weights for policy 1, policy_version 468862 (0.0010) [2023-12-26 03:21:18,751][123091] Updated weights for policy 0, policy_version 472022 (0.0007) [2023-12-26 03:21:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 240869376. Throughput: 0: 9298.8, 1: 8611.1. Samples: 240882416. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:18,785][121949] Avg episode reward: [(0, '5553.674'), (1, '5518.486')] [2023-12-26 03:21:18,825][123091] Updated weights for policy 0, policy_version 472032 (0.0006) [2023-12-26 03:21:18,890][123091] Updated weights for policy 0, policy_version 472042 (0.0006) [2023-12-26 03:21:19,391][123090] Updated weights for policy 1, policy_version 468872 (0.0007) [2023-12-26 03:21:19,452][123090] Updated weights for policy 1, policy_version 468882 (0.0005) [2023-12-26 03:21:19,525][123090] Updated weights for policy 1, policy_version 468892 (0.0006) [2023-12-26 03:21:19,591][123091] Updated weights for policy 0, policy_version 472052 (0.0009) [2023-12-26 03:21:19,662][123091] Updated weights for policy 0, policy_version 472062 (0.0011) [2023-12-26 03:21:19,711][123091] Updated weights for policy 0, policy_version 472072 (0.0010) [2023-12-26 03:21:20,368][123090] Updated weights for policy 1, policy_version 468902 (0.0009) [2023-12-26 03:21:20,427][123090] Updated weights for policy 1, policy_version 468912 (0.0009) [2023-12-26 03:21:20,453][123091] Updated weights for policy 0, policy_version 472082 (0.0009) [2023-12-26 03:21:20,494][123090] Updated weights for policy 1, policy_version 468922 (0.0009) [2023-12-26 03:21:20,516][123091] Updated weights for policy 0, policy_version 472092 (0.0006) [2023-12-26 03:21:20,574][123091] Updated weights for policy 0, policy_version 472102 (0.0010) [2023-12-26 03:21:20,642][123091] Updated weights for policy 0, policy_version 472112 (0.0008) [2023-12-26 03:21:21,429][123090] Updated weights for policy 1, policy_version 468932 (0.0009) [2023-12-26 03:21:21,452][123091] Updated weights for policy 0, policy_version 472122 (0.0009) [2023-12-26 03:21:21,496][123090] Updated weights for policy 1, policy_version 468942 (0.0007) [2023-12-26 03:21:21,517][123091] Updated weights for policy 0, policy_version 472132 (0.0006) [2023-12-26 03:21:21,557][123090] Updated weights for policy 1, policy_version 468952 (0.0008) [2023-12-26 03:21:21,584][123091] Updated weights for policy 0, policy_version 472142 (0.0005) [2023-12-26 03:21:22,180][123091] Updated weights for policy 0, policy_version 472152 (0.0006) [2023-12-26 03:21:22,242][123091] Updated weights for policy 0, policy_version 472162 (0.0007) [2023-12-26 03:21:22,316][123091] Updated weights for policy 0, policy_version 472172 (0.0010) [2023-12-26 03:21:22,461][123090] Updated weights for policy 1, policy_version 468962 (0.0008) [2023-12-26 03:21:22,532][123090] Updated weights for policy 1, policy_version 468972 (0.0009) [2023-12-26 03:21:22,594][123090] Updated weights for policy 1, policy_version 468982 (0.0008) [2023-12-26 03:21:22,660][123090] Updated weights for policy 1, policy_version 468992 (0.0008) [2023-12-26 03:21:23,088][123091] Updated weights for policy 0, policy_version 472182 (0.0009) [2023-12-26 03:21:23,152][123091] Updated weights for policy 0, policy_version 472192 (0.0011) [2023-12-26 03:21:23,212][123091] Updated weights for policy 0, policy_version 472202 (0.0011) [2023-12-26 03:21:23,344][123090] Updated weights for policy 1, policy_version 469002 (0.0008) [2023-12-26 03:21:23,400][123090] Updated weights for policy 1, policy_version 469012 (0.0009) [2023-12-26 03:21:23,449][123090] Updated weights for policy 1, policy_version 469022 (0.0009) [2023-12-26 03:21:23,785][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.7, 300 sec: 17716.9). Total num frames: 240959488. Throughput: 0: 9272.0, 1: 8575.3. Samples: 240934912. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:23,785][121949] Avg episode reward: [(0, '5688.732'), (1, '5499.701')] [2023-12-26 03:21:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000472208_120889344.pth... [2023-12-26 03:21:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000469024_120070144.pth... [2023-12-26 03:21:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000468032_119816192.pth [2023-12-26 03:21:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000471120_120610816.pth [2023-12-26 03:21:24,022][123091] Updated weights for policy 0, policy_version 472212 (0.0011) [2023-12-26 03:21:24,031][123090] Updated weights for policy 1, policy_version 469032 (0.0006) [2023-12-26 03:21:24,066][123091] Updated weights for policy 0, policy_version 472222 (0.0010) [2023-12-26 03:21:24,091][123090] Updated weights for policy 1, policy_version 469042 (0.0005) [2023-12-26 03:21:24,137][123091] Updated weights for policy 0, policy_version 472232 (0.0010) [2023-12-26 03:21:24,149][123090] Updated weights for policy 1, policy_version 469052 (0.0006) [2023-12-26 03:21:24,864][123090] Updated weights for policy 1, policy_version 469062 (0.0006) [2023-12-26 03:21:24,881][123091] Updated weights for policy 0, policy_version 472242 (0.0009) [2023-12-26 03:21:24,922][123090] Updated weights for policy 1, policy_version 469072 (0.0005) [2023-12-26 03:21:24,932][123091] Updated weights for policy 0, policy_version 472252 (0.0005) [2023-12-26 03:21:24,982][123091] Updated weights for policy 0, policy_version 472262 (0.0005) [2023-12-26 03:21:24,989][123090] Updated weights for policy 1, policy_version 469082 (0.0005) [2023-12-26 03:21:25,041][123091] Updated weights for policy 0, policy_version 472272 (0.0009) [2023-12-26 03:21:25,704][123090] Updated weights for policy 1, policy_version 469092 (0.0007) [2023-12-26 03:21:25,767][123090] Updated weights for policy 1, policy_version 469102 (0.0010) [2023-12-26 03:21:25,825][123090] Updated weights for policy 1, policy_version 469112 (0.0010) [2023-12-26 03:21:25,828][123091] Updated weights for policy 0, policy_version 472282 (0.0008) [2023-12-26 03:21:25,894][123091] Updated weights for policy 0, policy_version 472292 (0.0008) [2023-12-26 03:21:25,962][123091] Updated weights for policy 0, policy_version 472302 (0.0009) [2023-12-26 03:21:26,495][123090] Updated weights for policy 1, policy_version 469122 (0.0009) [2023-12-26 03:21:26,550][123090] Updated weights for policy 1, policy_version 469132 (0.0005) [2023-12-26 03:21:26,612][123090] Updated weights for policy 1, policy_version 469142 (0.0008) [2023-12-26 03:21:26,679][123090] Updated weights for policy 1, policy_version 469152 (0.0010) [2023-12-26 03:21:26,702][123091] Updated weights for policy 0, policy_version 472312 (0.0006) [2023-12-26 03:21:26,757][123091] Updated weights for policy 0, policy_version 472322 (0.0006) [2023-12-26 03:21:26,815][123091] Updated weights for policy 0, policy_version 472332 (0.0009) [2023-12-26 03:21:27,318][123090] Updated weights for policy 1, policy_version 469162 (0.0005) [2023-12-26 03:21:27,378][123090] Updated weights for policy 1, policy_version 469172 (0.0006) [2023-12-26 03:21:27,452][123090] Updated weights for policy 1, policy_version 469182 (0.0005) [2023-12-26 03:21:27,697][123091] Updated weights for policy 0, policy_version 472342 (0.0010) [2023-12-26 03:21:27,751][123091] Updated weights for policy 0, policy_version 472352 (0.0009) [2023-12-26 03:21:27,799][123091] Updated weights for policy 0, policy_version 472362 (0.0008) [2023-12-26 03:21:28,090][123090] Updated weights for policy 1, policy_version 469192 (0.0006) [2023-12-26 03:21:28,158][123090] Updated weights for policy 1, policy_version 469202 (0.0005) [2023-12-26 03:21:28,227][123090] Updated weights for policy 1, policy_version 469212 (0.0005) [2023-12-26 03:21:28,564][123091] Updated weights for policy 0, policy_version 472372 (0.0008) [2023-12-26 03:21:28,640][123091] Updated weights for policy 0, policy_version 472382 (0.0008) [2023-12-26 03:21:28,692][123091] Updated weights for policy 0, policy_version 472392 (0.0010) [2023-12-26 03:21:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 241057792. Throughput: 0: 9305.5, 1: 8715.0. Samples: 241047796. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:28,785][121949] Avg episode reward: [(0, '5871.583'), (1, '5427.596')] [2023-12-26 03:21:28,873][123090] Updated weights for policy 1, policy_version 469222 (0.0006) [2023-12-26 03:21:28,924][123090] Updated weights for policy 1, policy_version 469232 (0.0005) [2023-12-26 03:21:28,972][123090] Updated weights for policy 1, policy_version 469242 (0.0005) [2023-12-26 03:21:29,527][123091] Updated weights for policy 0, policy_version 472402 (0.0009) [2023-12-26 03:21:29,578][123091] Updated weights for policy 0, policy_version 472412 (0.0008) [2023-12-26 03:21:29,622][123091] Updated weights for policy 0, policy_version 472422 (0.0008) [2023-12-26 03:21:29,673][123091] Updated weights for policy 0, policy_version 472432 (0.0008) [2023-12-26 03:21:29,720][123090] Updated weights for policy 1, policy_version 469252 (0.0005) [2023-12-26 03:21:29,773][123090] Updated weights for policy 1, policy_version 469262 (0.0009) [2023-12-26 03:21:29,824][123090] Updated weights for policy 1, policy_version 469272 (0.0009) [2023-12-26 03:21:30,515][123091] Updated weights for policy 0, policy_version 472442 (0.0010) [2023-12-26 03:21:30,571][123091] Updated weights for policy 0, policy_version 472452 (0.0009) [2023-12-26 03:21:30,623][123091] Updated weights for policy 0, policy_version 472462 (0.0011) [2023-12-26 03:21:30,645][123090] Updated weights for policy 1, policy_version 469282 (0.0010) [2023-12-26 03:21:30,706][123090] Updated weights for policy 1, policy_version 469292 (0.0010) [2023-12-26 03:21:30,759][123090] Updated weights for policy 1, policy_version 469302 (0.0010) [2023-12-26 03:21:30,815][123090] Updated weights for policy 1, policy_version 469312 (0.0010) [2023-12-26 03:21:31,396][123091] Updated weights for policy 0, policy_version 472472 (0.0009) [2023-12-26 03:21:31,463][123091] Updated weights for policy 0, policy_version 472482 (0.0010) [2023-12-26 03:21:31,526][123091] Updated weights for policy 0, policy_version 472492 (0.0009) [2023-12-26 03:21:31,583][123090] Updated weights for policy 1, policy_version 469322 (0.0008) [2023-12-26 03:21:31,643][123090] Updated weights for policy 1, policy_version 469332 (0.0009) [2023-12-26 03:21:31,702][123090] Updated weights for policy 1, policy_version 469342 (0.0006) [2023-12-26 03:21:32,270][123091] Updated weights for policy 0, policy_version 472502 (0.0010) [2023-12-26 03:21:32,331][123091] Updated weights for policy 0, policy_version 472512 (0.0010) [2023-12-26 03:21:32,402][123091] Updated weights for policy 0, policy_version 472522 (0.0010) [2023-12-26 03:21:32,538][123090] Updated weights for policy 1, policy_version 469352 (0.0009) [2023-12-26 03:21:32,590][123090] Updated weights for policy 1, policy_version 469362 (0.0009) [2023-12-26 03:21:32,644][123090] Updated weights for policy 1, policy_version 469372 (0.0010) [2023-12-26 03:21:33,180][123091] Updated weights for policy 0, policy_version 472532 (0.0010) [2023-12-26 03:21:33,243][123091] Updated weights for policy 0, policy_version 472542 (0.0010) [2023-12-26 03:21:33,291][123091] Updated weights for policy 0, policy_version 472552 (0.0009) [2023-12-26 03:21:33,492][123090] Updated weights for policy 1, policy_version 469382 (0.0009) [2023-12-26 03:21:33,553][123090] Updated weights for policy 1, policy_version 469392 (0.0009) [2023-12-26 03:21:33,609][123090] Updated weights for policy 1, policy_version 469402 (0.0010) [2023-12-26 03:21:33,784][121949] Fps is (10 sec: 18842.5, 60 sec: 18159.0, 300 sec: 17744.7). Total num frames: 241147904. Throughput: 0: 9167.0, 1: 8847.5. Samples: 241155760. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:33,785][121949] Avg episode reward: [(0, '5944.585'), (1, '5390.290')] [2023-12-26 03:21:34,077][123091] Updated weights for policy 0, policy_version 472562 (0.0009) [2023-12-26 03:21:34,144][123091] Updated weights for policy 0, policy_version 472572 (0.0008) [2023-12-26 03:21:34,211][123091] Updated weights for policy 0, policy_version 472582 (0.0010) [2023-12-26 03:21:34,271][123091] Updated weights for policy 0, policy_version 472592 (0.0009) [2023-12-26 03:21:34,467][123090] Updated weights for policy 1, policy_version 469412 (0.0010) [2023-12-26 03:21:34,523][123090] Updated weights for policy 1, policy_version 469422 (0.0008) [2023-12-26 03:21:34,579][123090] Updated weights for policy 1, policy_version 469432 (0.0009) [2023-12-26 03:21:35,030][123091] Updated weights for policy 0, policy_version 472602 (0.0006) [2023-12-26 03:21:35,075][123091] Updated weights for policy 0, policy_version 472612 (0.0005) [2023-12-26 03:21:35,123][123091] Updated weights for policy 0, policy_version 472622 (0.0005) [2023-12-26 03:21:35,473][123090] Updated weights for policy 1, policy_version 469442 (0.0010) [2023-12-26 03:21:35,524][123090] Updated weights for policy 1, policy_version 469452 (0.0009) [2023-12-26 03:21:35,574][123090] Updated weights for policy 1, policy_version 469462 (0.0008) [2023-12-26 03:21:35,641][123090] Updated weights for policy 1, policy_version 469472 (0.0009) [2023-12-26 03:21:35,847][123091] Updated weights for policy 0, policy_version 472632 (0.0005) [2023-12-26 03:21:35,917][123091] Updated weights for policy 0, policy_version 472642 (0.0009) [2023-12-26 03:21:35,984][123091] Updated weights for policy 0, policy_version 472652 (0.0009) [2023-12-26 03:21:36,568][123090] Updated weights for policy 1, policy_version 469482 (0.0010) [2023-12-26 03:21:36,632][123090] Updated weights for policy 1, policy_version 469492 (0.0010) [2023-12-26 03:21:36,686][123090] Updated weights for policy 1, policy_version 469502 (0.0009) [2023-12-26 03:21:36,740][123091] Updated weights for policy 0, policy_version 472662 (0.0010) [2023-12-26 03:21:36,797][123091] Updated weights for policy 0, policy_version 472672 (0.0010) [2023-12-26 03:21:36,852][123091] Updated weights for policy 0, policy_version 472682 (0.0009) [2023-12-26 03:21:37,531][123090] Updated weights for policy 1, policy_version 469512 (0.0005) [2023-12-26 03:21:37,582][123090] Updated weights for policy 1, policy_version 469522 (0.0006) [2023-12-26 03:21:37,632][123090] Updated weights for policy 1, policy_version 469532 (0.0008) [2023-12-26 03:21:37,738][123091] Updated weights for policy 0, policy_version 472692 (0.0009) [2023-12-26 03:21:37,807][123091] Updated weights for policy 0, policy_version 472702 (0.0011) [2023-12-26 03:21:37,874][123091] Updated weights for policy 0, policy_version 472712 (0.0011) [2023-12-26 03:21:38,401][123090] Updated weights for policy 1, policy_version 469542 (0.0007) [2023-12-26 03:21:38,466][123090] Updated weights for policy 1, policy_version 469552 (0.0007) [2023-12-26 03:21:38,524][123090] Updated weights for policy 1, policy_version 469562 (0.0008) [2023-12-26 03:21:38,721][123091] Updated weights for policy 0, policy_version 472722 (0.0011) [2023-12-26 03:21:38,776][123091] Updated weights for policy 0, policy_version 472732 (0.0011) [2023-12-26 03:21:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 241229824. Throughput: 0: 9219.5, 1: 8828.5. Samples: 241208564. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:38,785][121949] Avg episode reward: [(0, '5963.917'), (1, '5383.447')] [2023-12-26 03:21:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000469568_120209408.pth... [2023-12-26 03:21:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000468512_119939072.pth [2023-12-26 03:21:38,831][123091] Updated weights for policy 0, policy_version 472742 (0.0010) [2023-12-26 03:21:38,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000472752_121028608.pth... [2023-12-26 03:21:38,882][123091] Updated weights for policy 0, policy_version 472752 (0.0010) [2023-12-26 03:21:38,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000471664_120750080.pth [2023-12-26 03:21:39,355][123090] Updated weights for policy 1, policy_version 469572 (0.0010) [2023-12-26 03:21:39,428][123090] Updated weights for policy 1, policy_version 469582 (0.0009) [2023-12-26 03:21:39,497][123090] Updated weights for policy 1, policy_version 469592 (0.0009) [2023-12-26 03:21:39,746][123091] Updated weights for policy 0, policy_version 472762 (0.0006) [2023-12-26 03:21:39,813][123091] Updated weights for policy 0, policy_version 472772 (0.0006) [2023-12-26 03:21:39,876][123091] Updated weights for policy 0, policy_version 472782 (0.0007) [2023-12-26 03:21:40,340][123090] Updated weights for policy 1, policy_version 469602 (0.0008) [2023-12-26 03:21:40,412][123090] Updated weights for policy 1, policy_version 469612 (0.0006) [2023-12-26 03:21:40,475][123090] Updated weights for policy 1, policy_version 469622 (0.0010) [2023-12-26 03:21:40,530][123090] Updated weights for policy 1, policy_version 469632 (0.0008) [2023-12-26 03:21:40,577][123091] Updated weights for policy 0, policy_version 472792 (0.0010) [2023-12-26 03:21:40,644][123091] Updated weights for policy 0, policy_version 472802 (0.0011) [2023-12-26 03:21:40,714][123091] Updated weights for policy 0, policy_version 472812 (0.0011) [2023-12-26 03:21:41,365][123090] Updated weights for policy 1, policy_version 469642 (0.0009) [2023-12-26 03:21:41,441][123090] Updated weights for policy 1, policy_version 469652 (0.0010) [2023-12-26 03:21:41,499][123090] Updated weights for policy 1, policy_version 469662 (0.0010) [2023-12-26 03:21:41,563][123091] Updated weights for policy 0, policy_version 472822 (0.0010) [2023-12-26 03:21:41,634][123091] Updated weights for policy 0, policy_version 472832 (0.0009) [2023-12-26 03:21:41,690][123091] Updated weights for policy 0, policy_version 472842 (0.0008) [2023-12-26 03:21:42,188][123090] Updated weights for policy 1, policy_version 469672 (0.0006) [2023-12-26 03:21:42,249][123090] Updated weights for policy 1, policy_version 469682 (0.0006) [2023-12-26 03:21:42,324][123090] Updated weights for policy 1, policy_version 469692 (0.0007) [2023-12-26 03:21:42,446][123091] Updated weights for policy 0, policy_version 472852 (0.0009) [2023-12-26 03:21:42,512][123091] Updated weights for policy 0, policy_version 472862 (0.0006) [2023-12-26 03:21:42,587][123091] Updated weights for policy 0, policy_version 472872 (0.0009) [2023-12-26 03:21:43,106][123090] Updated weights for policy 1, policy_version 469702 (0.0010) [2023-12-26 03:21:43,176][123090] Updated weights for policy 1, policy_version 469712 (0.0009) [2023-12-26 03:21:43,249][123090] Updated weights for policy 1, policy_version 469722 (0.0009) [2023-12-26 03:21:43,275][123091] Updated weights for policy 0, policy_version 472882 (0.0006) [2023-12-26 03:21:43,341][123091] Updated weights for policy 0, policy_version 472892 (0.0009) [2023-12-26 03:21:43,409][123091] Updated weights for policy 0, policy_version 472902 (0.0006) [2023-12-26 03:21:43,470][123091] Updated weights for policy 0, policy_version 472912 (0.0011) [2023-12-26 03:21:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 241319936. Throughput: 0: 9114.0, 1: 8825.1. Samples: 241312888. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:43,785][121949] Avg episode reward: [(0, '6065.145'), (1, '5340.353')] [2023-12-26 03:21:44,063][123090] Updated weights for policy 1, policy_version 469732 (0.0008) [2023-12-26 03:21:44,132][123090] Updated weights for policy 1, policy_version 469742 (0.0009) [2023-12-26 03:21:44,184][123090] Updated weights for policy 1, policy_version 469752 (0.0009) [2023-12-26 03:21:44,225][123091] Updated weights for policy 0, policy_version 472922 (0.0006) [2023-12-26 03:21:44,274][123091] Updated weights for policy 0, policy_version 472932 (0.0005) [2023-12-26 03:21:44,323][123091] Updated weights for policy 0, policy_version 472942 (0.0005) [2023-12-26 03:21:45,053][123091] Updated weights for policy 0, policy_version 472952 (0.0009) [2023-12-26 03:21:45,074][123090] Updated weights for policy 1, policy_version 469762 (0.0008) [2023-12-26 03:21:45,114][123091] Updated weights for policy 0, policy_version 472962 (0.0010) [2023-12-26 03:21:45,132][123090] Updated weights for policy 1, policy_version 469772 (0.0007) [2023-12-26 03:21:45,175][123091] Updated weights for policy 0, policy_version 472972 (0.0011) [2023-12-26 03:21:45,188][123090] Updated weights for policy 1, policy_version 469782 (0.0009) [2023-12-26 03:21:45,236][123090] Updated weights for policy 1, policy_version 469792 (0.0009) [2023-12-26 03:21:45,992][123091] Updated weights for policy 0, policy_version 472982 (0.0011) [2023-12-26 03:21:46,051][123091] Updated weights for policy 0, policy_version 472992 (0.0011) [2023-12-26 03:21:46,105][123090] Updated weights for policy 1, policy_version 469802 (0.0008) [2023-12-26 03:21:46,110][123091] Updated weights for policy 0, policy_version 473002 (0.0011) [2023-12-26 03:21:46,174][123090] Updated weights for policy 1, policy_version 469812 (0.0008) [2023-12-26 03:21:46,230][123090] Updated weights for policy 1, policy_version 469822 (0.0008) [2023-12-26 03:21:46,939][123091] Updated weights for policy 0, policy_version 473012 (0.0010) [2023-12-26 03:21:47,013][123091] Updated weights for policy 0, policy_version 473022 (0.0009) [2023-12-26 03:21:47,052][123090] Updated weights for policy 1, policy_version 469832 (0.0006) [2023-12-26 03:21:47,077][123091] Updated weights for policy 0, policy_version 473032 (0.0006) [2023-12-26 03:21:47,102][123090] Updated weights for policy 1, policy_version 469842 (0.0006) [2023-12-26 03:21:47,152][123090] Updated weights for policy 1, policy_version 469852 (0.0009) [2023-12-26 03:21:47,722][123091] Updated weights for policy 0, policy_version 473042 (0.0005) [2023-12-26 03:21:47,771][123091] Updated weights for policy 0, policy_version 473052 (0.0005) [2023-12-26 03:21:47,822][123091] Updated weights for policy 0, policy_version 473062 (0.0005) [2023-12-26 03:21:47,885][123091] Updated weights for policy 0, policy_version 473072 (0.0008) [2023-12-26 03:21:48,006][123090] Updated weights for policy 1, policy_version 469863 (0.0009) [2023-12-26 03:21:48,058][123090] Updated weights for policy 1, policy_version 469873 (0.0009) [2023-12-26 03:21:48,130][123090] Updated weights for policy 1, policy_version 469883 (0.0010) [2023-12-26 03:21:48,630][123091] Updated weights for policy 0, policy_version 473082 (0.0006) [2023-12-26 03:21:48,692][123091] Updated weights for policy 0, policy_version 473092 (0.0006) [2023-12-26 03:21:48,760][123091] Updated weights for policy 0, policy_version 473102 (0.0008) [2023-12-26 03:21:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 241410048. Throughput: 0: 9125.4, 1: 8805.7. Samples: 241419276. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:48,785][121949] Avg episode reward: [(0, '6114.994'), (1, '5293.600')] [2023-12-26 03:21:48,998][123090] Updated weights for policy 1, policy_version 469893 (0.0007) [2023-12-26 03:21:49,067][123090] Updated weights for policy 1, policy_version 469903 (0.0009) [2023-12-26 03:21:49,127][123090] Updated weights for policy 1, policy_version 469913 (0.0009) [2023-12-26 03:21:49,516][123091] Updated weights for policy 0, policy_version 473112 (0.0010) [2023-12-26 03:21:49,570][123091] Updated weights for policy 0, policy_version 473122 (0.0009) [2023-12-26 03:21:49,636][123091] Updated weights for policy 0, policy_version 473132 (0.0010) [2023-12-26 03:21:49,966][123090] Updated weights for policy 1, policy_version 469923 (0.0008) [2023-12-26 03:21:50,038][123090] Updated weights for policy 1, policy_version 469933 (0.0009) [2023-12-26 03:21:50,102][123090] Updated weights for policy 1, policy_version 469943 (0.0009) [2023-12-26 03:21:50,472][123091] Updated weights for policy 0, policy_version 473142 (0.0009) [2023-12-26 03:21:50,540][123091] Updated weights for policy 0, policy_version 473152 (0.0006) [2023-12-26 03:21:50,604][123091] Updated weights for policy 0, policy_version 473162 (0.0008) [2023-12-26 03:21:50,879][123090] Updated weights for policy 1, policy_version 469953 (0.0010) [2023-12-26 03:21:50,948][123090] Updated weights for policy 1, policy_version 469963 (0.0010) [2023-12-26 03:21:51,015][123090] Updated weights for policy 1, policy_version 469973 (0.0010) [2023-12-26 03:21:51,086][123090] Updated weights for policy 1, policy_version 469983 (0.0010) [2023-12-26 03:21:51,364][123091] Updated weights for policy 0, policy_version 473172 (0.0008) [2023-12-26 03:21:51,437][123091] Updated weights for policy 0, policy_version 473182 (0.0010) [2023-12-26 03:21:51,508][123091] Updated weights for policy 0, policy_version 473192 (0.0010) [2023-12-26 03:21:51,919][123090] Updated weights for policy 1, policy_version 469993 (0.0009) [2023-12-26 03:21:51,978][123090] Updated weights for policy 1, policy_version 470003 (0.0006) [2023-12-26 03:21:52,035][123090] Updated weights for policy 1, policy_version 470013 (0.0009) [2023-12-26 03:21:52,372][123091] Updated weights for policy 0, policy_version 473202 (0.0009) [2023-12-26 03:21:52,427][123091] Updated weights for policy 0, policy_version 473212 (0.0010) [2023-12-26 03:21:52,484][123091] Updated weights for policy 0, policy_version 473222 (0.0010) [2023-12-26 03:21:52,803][123090] Updated weights for policy 1, policy_version 470023 (0.0008) [2023-12-26 03:21:52,867][123090] Updated weights for policy 1, policy_version 470033 (0.0005) [2023-12-26 03:21:52,929][123090] Updated weights for policy 1, policy_version 470043 (0.0009) [2023-12-26 03:21:53,384][123091] Updated weights for policy 0, policy_version 473233 (0.0010) [2023-12-26 03:21:53,438][123091] Updated weights for policy 0, policy_version 473243 (0.0010) [2023-12-26 03:21:53,491][123091] Updated weights for policy 0, policy_version 473253 (0.0009) [2023-12-26 03:21:53,667][123090] Updated weights for policy 1, policy_version 470053 (0.0009) [2023-12-26 03:21:53,719][123090] Updated weights for policy 1, policy_version 470063 (0.0009) [2023-12-26 03:21:53,770][123090] Updated weights for policy 1, policy_version 470073 (0.0010) [2023-12-26 03:21:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 241491968. Throughput: 0: 9070.3, 1: 8822.7. Samples: 241470740. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:53,785][121949] Avg episode reward: [(0, '6102.042'), (1, '5141.631')] [2023-12-26 03:21:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000473264_121159680.pth... [2023-12-26 03:21:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000472208_120889344.pth [2023-12-26 03:21:53,804][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000470080_120340480.pth... [2023-12-26 03:21:53,809][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000469024_120070144.pth [2023-12-26 03:21:54,258][123091] Updated weights for policy 0, policy_version 473265 (0.0011) [2023-12-26 03:21:54,310][123091] Updated weights for policy 0, policy_version 473275 (0.0009) [2023-12-26 03:21:54,364][123091] Updated weights for policy 0, policy_version 473285 (0.0009) [2023-12-26 03:21:54,431][123091] Updated weights for policy 0, policy_version 473295 (0.0006) [2023-12-26 03:21:54,623][123090] Updated weights for policy 1, policy_version 470084 (0.0009) [2023-12-26 03:21:54,672][123090] Updated weights for policy 1, policy_version 470094 (0.0009) [2023-12-26 03:21:54,719][123090] Updated weights for policy 1, policy_version 470104 (0.0008) [2023-12-26 03:21:55,209][123091] Updated weights for policy 0, policy_version 473306 (0.0009) [2023-12-26 03:21:55,259][123091] Updated weights for policy 0, policy_version 473316 (0.0009) [2023-12-26 03:21:55,320][123091] Updated weights for policy 0, policy_version 473326 (0.0005) [2023-12-26 03:21:55,585][123090] Updated weights for policy 1, policy_version 470114 (0.0009) [2023-12-26 03:21:55,644][123090] Updated weights for policy 1, policy_version 470126 (0.0010) [2023-12-26 03:21:55,697][123090] Updated weights for policy 1, policy_version 470136 (0.0010) [2023-12-26 03:21:56,047][123091] Updated weights for policy 0, policy_version 473336 (0.0010) [2023-12-26 03:21:56,106][123091] Updated weights for policy 0, policy_version 473346 (0.0010) [2023-12-26 03:21:56,172][123091] Updated weights for policy 0, policy_version 473356 (0.0010) [2023-12-26 03:21:56,524][123090] Updated weights for policy 1, policy_version 470146 (0.0008) [2023-12-26 03:21:56,585][123090] Updated weights for policy 1, policy_version 470156 (0.0005) [2023-12-26 03:21:56,640][123090] Updated weights for policy 1, policy_version 470166 (0.0005) [2023-12-26 03:21:56,691][123090] Updated weights for policy 1, policy_version 470176 (0.0005) [2023-12-26 03:21:56,968][123091] Updated weights for policy 0, policy_version 473366 (0.0009) [2023-12-26 03:21:57,019][123091] Updated weights for policy 0, policy_version 473376 (0.0010) [2023-12-26 03:21:57,078][123091] Updated weights for policy 0, policy_version 473386 (0.0010) [2023-12-26 03:21:57,407][123090] Updated weights for policy 1, policy_version 470186 (0.0009) [2023-12-26 03:21:57,467][123090] Updated weights for policy 1, policy_version 470196 (0.0009) [2023-12-26 03:21:57,526][123090] Updated weights for policy 1, policy_version 470206 (0.0010) [2023-12-26 03:21:57,831][123091] Updated weights for policy 0, policy_version 473396 (0.0008) [2023-12-26 03:21:57,889][123091] Updated weights for policy 0, policy_version 473406 (0.0005) [2023-12-26 03:21:57,938][123091] Updated weights for policy 0, policy_version 473416 (0.0005) [2023-12-26 03:21:58,352][123090] Updated weights for policy 1, policy_version 470216 (0.0009) [2023-12-26 03:21:58,432][123090] Updated weights for policy 1, policy_version 470227 (0.0009) [2023-12-26 03:21:58,490][123090] Updated weights for policy 1, policy_version 470237 (0.0009) [2023-12-26 03:21:58,762][123091] Updated weights for policy 0, policy_version 473426 (0.0007) [2023-12-26 03:21:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 241582080. Throughput: 0: 9057.9, 1: 8854.0. Samples: 241577968. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:21:58,785][121949] Avg episode reward: [(0, '6118.080'), (1, '5071.401')] [2023-12-26 03:21:58,834][123091] Updated weights for policy 0, policy_version 473436 (0.0011) [2023-12-26 03:21:58,909][123091] Updated weights for policy 0, policy_version 473446 (0.0010) [2023-12-26 03:21:58,975][123091] Updated weights for policy 0, policy_version 473456 (0.0011) [2023-12-26 03:21:59,422][123090] Updated weights for policy 1, policy_version 470247 (0.0007) [2023-12-26 03:21:59,488][123090] Updated weights for policy 1, policy_version 470257 (0.0006) [2023-12-26 03:21:59,557][123090] Updated weights for policy 1, policy_version 470267 (0.0006) [2023-12-26 03:21:59,732][123091] Updated weights for policy 0, policy_version 473466 (0.0005) [2023-12-26 03:21:59,803][123091] Updated weights for policy 0, policy_version 473476 (0.0007) [2023-12-26 03:21:59,868][123091] Updated weights for policy 0, policy_version 473486 (0.0011) [2023-12-26 03:22:00,304][123090] Updated weights for policy 1, policy_version 470277 (0.0007) [2023-12-26 03:22:00,369][123090] Updated weights for policy 1, policy_version 470287 (0.0009) [2023-12-26 03:22:00,433][123090] Updated weights for policy 1, policy_version 470297 (0.0009) [2023-12-26 03:22:00,605][123091] Updated weights for policy 0, policy_version 473496 (0.0010) [2023-12-26 03:22:00,655][123091] Updated weights for policy 0, policy_version 473506 (0.0010) [2023-12-26 03:22:00,725][123091] Updated weights for policy 0, policy_version 473516 (0.0010) [2023-12-26 03:22:01,297][123090] Updated weights for policy 1, policy_version 470307 (0.0008) [2023-12-26 03:22:01,348][123090] Updated weights for policy 1, policy_version 470317 (0.0008) [2023-12-26 03:22:01,420][123090] Updated weights for policy 1, policy_version 470327 (0.0008) [2023-12-26 03:22:01,477][123091] Updated weights for policy 0, policy_version 473526 (0.0009) [2023-12-26 03:22:01,540][123091] Updated weights for policy 0, policy_version 473536 (0.0010) [2023-12-26 03:22:01,601][123091] Updated weights for policy 0, policy_version 473546 (0.0009) [2023-12-26 03:22:02,228][123090] Updated weights for policy 1, policy_version 470337 (0.0008) [2023-12-26 03:22:02,296][123090] Updated weights for policy 1, policy_version 470347 (0.0006) [2023-12-26 03:22:02,353][123090] Updated weights for policy 1, policy_version 470357 (0.0008) [2023-12-26 03:22:02,417][123090] Updated weights for policy 1, policy_version 470367 (0.0010) [2023-12-26 03:22:02,519][123091] Updated weights for policy 0, policy_version 473556 (0.0009) [2023-12-26 03:22:02,577][123091] Updated weights for policy 0, policy_version 473566 (0.0010) [2023-12-26 03:22:02,638][123091] Updated weights for policy 0, policy_version 473576 (0.0010) [2023-12-26 03:22:03,216][123090] Updated weights for policy 1, policy_version 470377 (0.0006) [2023-12-26 03:22:03,296][123090] Updated weights for policy 1, policy_version 470387 (0.0005) [2023-12-26 03:22:03,349][123091] Updated weights for policy 0, policy_version 473586 (0.0006) [2023-12-26 03:22:03,371][123090] Updated weights for policy 1, policy_version 470397 (0.0005) [2023-12-26 03:22:03,413][123091] Updated weights for policy 0, policy_version 473596 (0.0005) [2023-12-26 03:22:03,469][123091] Updated weights for policy 0, policy_version 473606 (0.0005) [2023-12-26 03:22:03,515][123091] Updated weights for policy 0, policy_version 473616 (0.0005) [2023-12-26 03:22:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 241672192. Throughput: 0: 8996.8, 1: 8820.1. Samples: 241684176. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:03,785][121949] Avg episode reward: [(0, '6121.647'), (1, '5232.428')] [2023-12-26 03:22:03,971][123090] Updated weights for policy 1, policy_version 470407 (0.0007) [2023-12-26 03:22:04,038][123090] Updated weights for policy 1, policy_version 470417 (0.0009) [2023-12-26 03:22:04,092][123090] Updated weights for policy 1, policy_version 470427 (0.0009) [2023-12-26 03:22:04,229][123091] Updated weights for policy 0, policy_version 473626 (0.0011) [2023-12-26 03:22:04,292][123091] Updated weights for policy 0, policy_version 473636 (0.0011) [2023-12-26 03:22:04,359][123091] Updated weights for policy 0, policy_version 473646 (0.0011) [2023-12-26 03:22:04,823][123090] Updated weights for policy 1, policy_version 470437 (0.0007) [2023-12-26 03:22:04,878][123090] Updated weights for policy 1, policy_version 470447 (0.0007) [2023-12-26 03:22:04,937][123090] Updated weights for policy 1, policy_version 470457 (0.0009) [2023-12-26 03:22:05,179][123091] Updated weights for policy 0, policy_version 473656 (0.0010) [2023-12-26 03:22:05,227][123091] Updated weights for policy 0, policy_version 473666 (0.0009) [2023-12-26 03:22:05,275][123091] Updated weights for policy 0, policy_version 473676 (0.0009) [2023-12-26 03:22:05,700][123090] Updated weights for policy 1, policy_version 470467 (0.0007) [2023-12-26 03:22:05,755][123090] Updated weights for policy 1, policy_version 470478 (0.0007) [2023-12-26 03:22:05,812][123090] Updated weights for policy 1, policy_version 470488 (0.0006) [2023-12-26 03:22:05,997][123091] Updated weights for policy 0, policy_version 473686 (0.0008) [2023-12-26 03:22:06,062][123091] Updated weights for policy 0, policy_version 473696 (0.0008) [2023-12-26 03:22:06,138][123091] Updated weights for policy 0, policy_version 473706 (0.0007) [2023-12-26 03:22:06,459][123090] Updated weights for policy 1, policy_version 470498 (0.0006) [2023-12-26 03:22:06,526][123090] Updated weights for policy 1, policy_version 470508 (0.0006) [2023-12-26 03:22:06,597][123090] Updated weights for policy 1, policy_version 470518 (0.0009) [2023-12-26 03:22:06,665][123090] Updated weights for policy 1, policy_version 470528 (0.0006) [2023-12-26 03:22:06,975][123091] Updated weights for policy 0, policy_version 473716 (0.0010) [2023-12-26 03:22:07,042][123091] Updated weights for policy 0, policy_version 473726 (0.0010) [2023-12-26 03:22:07,100][123091] Updated weights for policy 0, policy_version 473736 (0.0010) [2023-12-26 03:22:07,319][123090] Updated weights for policy 1, policy_version 470538 (0.0009) [2023-12-26 03:22:07,373][123090] Updated weights for policy 1, policy_version 470548 (0.0008) [2023-12-26 03:22:07,431][123090] Updated weights for policy 1, policy_version 470558 (0.0009) [2023-12-26 03:22:07,977][123091] Updated weights for policy 0, policy_version 473746 (0.0010) [2023-12-26 03:22:08,041][123091] Updated weights for policy 0, policy_version 473756 (0.0009) [2023-12-26 03:22:08,095][123091] Updated weights for policy 0, policy_version 473766 (0.0009) [2023-12-26 03:22:08,154][123091] Updated weights for policy 0, policy_version 473776 (0.0007) [2023-12-26 03:22:08,173][123090] Updated weights for policy 1, policy_version 470568 (0.0008) [2023-12-26 03:22:08,239][123090] Updated weights for policy 1, policy_version 470578 (0.0008) [2023-12-26 03:22:08,310][123090] Updated weights for policy 1, policy_version 470588 (0.0009) [2023-12-26 03:22:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 241762304. Throughput: 0: 8986.8, 1: 8922.5. Samples: 241740828. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:08,785][121949] Avg episode reward: [(0, '6162.924'), (1, '5223.014')] [2023-12-26 03:22:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000470592_120471552.pth... [2023-12-26 03:22:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000473776_121290752.pth... [2023-12-26 03:22:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000472752_121028608.pth [2023-12-26 03:22:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000469568_120209408.pth [2023-12-26 03:22:09,033][123091] Updated weights for policy 0, policy_version 473786 (0.0007) [2023-12-26 03:22:09,091][123091] Updated weights for policy 0, policy_version 473796 (0.0005) [2023-12-26 03:22:09,092][123090] Updated weights for policy 1, policy_version 470598 (0.0010) [2023-12-26 03:22:09,154][123091] Updated weights for policy 0, policy_version 473806 (0.0005) [2023-12-26 03:22:09,159][123090] Updated weights for policy 1, policy_version 470608 (0.0007) [2023-12-26 03:22:09,244][123090] Updated weights for policy 1, policy_version 470618 (0.0007) [2023-12-26 03:22:09,934][123091] Updated weights for policy 0, policy_version 473816 (0.0010) [2023-12-26 03:22:09,992][123091] Updated weights for policy 0, policy_version 473826 (0.0010) [2023-12-26 03:22:10,034][123090] Updated weights for policy 1, policy_version 470628 (0.0009) [2023-12-26 03:22:10,059][123091] Updated weights for policy 0, policy_version 473836 (0.0008) [2023-12-26 03:22:10,100][123090] Updated weights for policy 1, policy_version 470638 (0.0009) [2023-12-26 03:22:10,173][123090] Updated weights for policy 1, policy_version 470648 (0.0010) [2023-12-26 03:22:10,833][123091] Updated weights for policy 0, policy_version 473846 (0.0007) [2023-12-26 03:22:10,879][123090] Updated weights for policy 1, policy_version 470658 (0.0007) [2023-12-26 03:22:10,903][123091] Updated weights for policy 0, policy_version 473856 (0.0008) [2023-12-26 03:22:10,943][123090] Updated weights for policy 1, policy_version 470668 (0.0010) [2023-12-26 03:22:10,964][123091] Updated weights for policy 0, policy_version 473866 (0.0008) [2023-12-26 03:22:10,998][123090] Updated weights for policy 1, policy_version 470678 (0.0007) [2023-12-26 03:22:11,077][123090] Updated weights for policy 1, policy_version 470688 (0.0008) [2023-12-26 03:22:11,852][123091] Updated weights for policy 0, policy_version 473876 (0.0008) [2023-12-26 03:22:11,878][123090] Updated weights for policy 1, policy_version 470698 (0.0010) [2023-12-26 03:22:11,916][123091] Updated weights for policy 0, policy_version 473886 (0.0009) [2023-12-26 03:22:11,940][123090] Updated weights for policy 1, policy_version 470708 (0.0009) [2023-12-26 03:22:11,973][123091] Updated weights for policy 0, policy_version 473896 (0.0006) [2023-12-26 03:22:12,002][123090] Updated weights for policy 1, policy_version 470718 (0.0008) [2023-12-26 03:22:12,803][123091] Updated weights for policy 0, policy_version 473906 (0.0009) [2023-12-26 03:22:12,823][123090] Updated weights for policy 1, policy_version 470728 (0.0007) [2023-12-26 03:22:12,848][123091] Updated weights for policy 0, policy_version 473916 (0.0008) [2023-12-26 03:22:12,876][123090] Updated weights for policy 1, policy_version 470738 (0.0007) [2023-12-26 03:22:12,900][123091] Updated weights for policy 0, policy_version 473926 (0.0006) [2023-12-26 03:22:12,937][123090] Updated weights for policy 1, policy_version 470748 (0.0009) [2023-12-26 03:22:12,961][123091] Updated weights for policy 0, policy_version 473936 (0.0008) [2023-12-26 03:22:13,781][123090] Updated weights for policy 1, policy_version 470758 (0.0006) [2023-12-26 03:22:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 241844224. Throughput: 0: 8892.3, 1: 8839.3. Samples: 241845716. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:13,784][121949] Avg episode reward: [(0, '6259.319'), (1, '5104.951')] [2023-12-26 03:22:13,790][123091] Updated weights for policy 0, policy_version 473946 (0.0010) [2023-12-26 03:22:13,832][123090] Updated weights for policy 1, policy_version 470768 (0.0008) [2023-12-26 03:22:13,838][123091] Updated weights for policy 0, policy_version 473956 (0.0008) [2023-12-26 03:22:13,894][123090] Updated weights for policy 1, policy_version 470778 (0.0008) [2023-12-26 03:22:13,895][123091] Updated weights for policy 0, policy_version 473966 (0.0008) [2023-12-26 03:22:14,645][123091] Updated weights for policy 0, policy_version 473976 (0.0006) [2023-12-26 03:22:14,710][123091] Updated weights for policy 0, policy_version 473986 (0.0005) [2023-12-26 03:22:14,773][123090] Updated weights for policy 1, policy_version 470788 (0.0008) [2023-12-26 03:22:14,796][123091] Updated weights for policy 0, policy_version 473999 (0.0008) [2023-12-26 03:22:14,833][123090] Updated weights for policy 1, policy_version 470798 (0.0008) [2023-12-26 03:22:14,910][123090] Updated weights for policy 1, policy_version 470808 (0.0007) [2023-12-26 03:22:15,460][123091] Updated weights for policy 0, policy_version 474009 (0.0006) [2023-12-26 03:22:15,527][123091] Updated weights for policy 0, policy_version 474019 (0.0006) [2023-12-26 03:22:15,588][123091] Updated weights for policy 0, policy_version 474029 (0.0005) [2023-12-26 03:22:15,781][123090] Updated weights for policy 1, policy_version 470818 (0.0009) [2023-12-26 03:22:15,835][123090] Updated weights for policy 1, policy_version 470828 (0.0010) [2023-12-26 03:22:15,893][123090] Updated weights for policy 1, policy_version 470838 (0.0009) [2023-12-26 03:22:15,945][123090] Updated weights for policy 1, policy_version 470848 (0.0009) [2023-12-26 03:22:16,244][123091] Updated weights for policy 0, policy_version 474039 (0.0008) [2023-12-26 03:22:16,304][123091] Updated weights for policy 0, policy_version 474050 (0.0010) [2023-12-26 03:22:16,355][123091] Updated weights for policy 0, policy_version 474060 (0.0010) [2023-12-26 03:22:16,777][123090] Updated weights for policy 1, policy_version 470858 (0.0006) [2023-12-26 03:22:16,826][123090] Updated weights for policy 1, policy_version 470868 (0.0008) [2023-12-26 03:22:16,884][123090] Updated weights for policy 1, policy_version 470878 (0.0005) [2023-12-26 03:22:17,102][123091] Updated weights for policy 0, policy_version 474070 (0.0009) [2023-12-26 03:22:17,154][123091] Updated weights for policy 0, policy_version 474080 (0.0010) [2023-12-26 03:22:17,213][123091] Updated weights for policy 0, policy_version 474090 (0.0011) [2023-12-26 03:22:17,644][123090] Updated weights for policy 1, policy_version 470888 (0.0005) [2023-12-26 03:22:17,715][123090] Updated weights for policy 1, policy_version 470898 (0.0007) [2023-12-26 03:22:17,775][123090] Updated weights for policy 1, policy_version 470908 (0.0009) [2023-12-26 03:22:17,989][123091] Updated weights for policy 0, policy_version 474100 (0.0010) [2023-12-26 03:22:18,062][123091] Updated weights for policy 0, policy_version 474110 (0.0009) [2023-12-26 03:22:18,130][123091] Updated weights for policy 0, policy_version 474120 (0.0009) [2023-12-26 03:22:18,526][123090] Updated weights for policy 1, policy_version 470918 (0.0008) [2023-12-26 03:22:18,604][123090] Updated weights for policy 1, policy_version 470928 (0.0006) [2023-12-26 03:22:18,663][123090] Updated weights for policy 1, policy_version 470938 (0.0005) [2023-12-26 03:22:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 241942528. Throughput: 0: 8966.0, 1: 8761.7. Samples: 241953504. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:18,785][121949] Avg episode reward: [(0, '6168.662'), (1, '4931.186')] [2023-12-26 03:22:18,874][123091] Updated weights for policy 0, policy_version 474130 (0.0009) [2023-12-26 03:22:18,950][123091] Updated weights for policy 0, policy_version 474140 (0.0006) [2023-12-26 03:22:19,024][123091] Updated weights for policy 0, policy_version 474150 (0.0006) [2023-12-26 03:22:19,070][123091] Updated weights for policy 0, policy_version 474160 (0.0005) [2023-12-26 03:22:19,285][123090] Updated weights for policy 1, policy_version 470948 (0.0006) [2023-12-26 03:22:19,349][123090] Updated weights for policy 1, policy_version 470958 (0.0009) [2023-12-26 03:22:19,415][123090] Updated weights for policy 1, policy_version 470968 (0.0009) [2023-12-26 03:22:19,772][123091] Updated weights for policy 0, policy_version 474170 (0.0011) [2023-12-26 03:22:19,844][123091] Updated weights for policy 0, policy_version 474180 (0.0011) [2023-12-26 03:22:19,913][123091] Updated weights for policy 0, policy_version 474190 (0.0011) [2023-12-26 03:22:20,226][123090] Updated weights for policy 1, policy_version 470978 (0.0008) [2023-12-26 03:22:20,289][123090] Updated weights for policy 1, policy_version 470988 (0.0008) [2023-12-26 03:22:20,352][123090] Updated weights for policy 1, policy_version 470998 (0.0010) [2023-12-26 03:22:20,414][123090] Updated weights for policy 1, policy_version 471008 (0.0010) [2023-12-26 03:22:20,735][123091] Updated weights for policy 0, policy_version 474200 (0.0011) [2023-12-26 03:22:20,791][123091] Updated weights for policy 0, policy_version 474210 (0.0011) [2023-12-26 03:22:20,855][123091] Updated weights for policy 0, policy_version 474220 (0.0011) [2023-12-26 03:22:21,296][123090] Updated weights for policy 1, policy_version 471018 (0.0010) [2023-12-26 03:22:21,368][123090] Updated weights for policy 1, policy_version 471028 (0.0010) [2023-12-26 03:22:21,446][123090] Updated weights for policy 1, policy_version 471038 (0.0009) [2023-12-26 03:22:21,734][123091] Updated weights for policy 0, policy_version 474230 (0.0010) [2023-12-26 03:22:21,804][123091] Updated weights for policy 0, policy_version 474240 (0.0011) [2023-12-26 03:22:21,872][123091] Updated weights for policy 0, policy_version 474250 (0.0011) [2023-12-26 03:22:22,260][123090] Updated weights for policy 1, policy_version 471048 (0.0010) [2023-12-26 03:22:22,331][123090] Updated weights for policy 1, policy_version 471058 (0.0010) [2023-12-26 03:22:22,395][123090] Updated weights for policy 1, policy_version 471068 (0.0009) [2023-12-26 03:22:22,652][123091] Updated weights for policy 0, policy_version 474260 (0.0009) [2023-12-26 03:22:22,721][123091] Updated weights for policy 0, policy_version 474270 (0.0006) [2023-12-26 03:22:22,785][123091] Updated weights for policy 0, policy_version 474280 (0.0009) [2023-12-26 03:22:23,090][123090] Updated weights for policy 1, policy_version 471078 (0.0008) [2023-12-26 03:22:23,149][123090] Updated weights for policy 1, policy_version 471088 (0.0006) [2023-12-26 03:22:23,212][123090] Updated weights for policy 1, policy_version 471098 (0.0006) [2023-12-26 03:22:23,522][123091] Updated weights for policy 0, policy_version 474290 (0.0010) [2023-12-26 03:22:23,585][123091] Updated weights for policy 0, policy_version 474300 (0.0009) [2023-12-26 03:22:23,640][123091] Updated weights for policy 0, policy_version 474310 (0.0009) [2023-12-26 03:22:23,697][123091] Updated weights for policy 0, policy_version 474320 (0.0009) [2023-12-26 03:22:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 242032640. Throughput: 0: 8920.8, 1: 8790.0. Samples: 242005552. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:23,785][121949] Avg episode reward: [(0, '6146.884'), (1, '4978.012')] [2023-12-26 03:22:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000474320_121430016.pth... [2023-12-26 03:22:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000471104_120602624.pth... [2023-12-26 03:22:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000470080_120340480.pth [2023-12-26 03:22:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000473264_121159680.pth [2023-12-26 03:22:24,018][123090] Updated weights for policy 1, policy_version 471108 (0.0010) [2023-12-26 03:22:24,085][123090] Updated weights for policy 1, policy_version 471118 (0.0010) [2023-12-26 03:22:24,153][123090] Updated weights for policy 1, policy_version 471128 (0.0011) [2023-12-26 03:22:24,395][123091] Updated weights for policy 0, policy_version 474330 (0.0008) [2023-12-26 03:22:24,465][123091] Updated weights for policy 0, policy_version 474340 (0.0010) [2023-12-26 03:22:24,530][123091] Updated weights for policy 0, policy_version 474350 (0.0010) [2023-12-26 03:22:24,937][123090] Updated weights for policy 1, policy_version 471138 (0.0010) [2023-12-26 03:22:24,997][123090] Updated weights for policy 1, policy_version 471148 (0.0009) [2023-12-26 03:22:25,053][123090] Updated weights for policy 1, policy_version 471158 (0.0008) [2023-12-26 03:22:25,101][123090] Updated weights for policy 1, policy_version 471168 (0.0008) [2023-12-26 03:22:25,275][123091] Updated weights for policy 0, policy_version 474360 (0.0010) [2023-12-26 03:22:25,322][123091] Updated weights for policy 0, policy_version 474370 (0.0010) [2023-12-26 03:22:25,387][123091] Updated weights for policy 0, policy_version 474380 (0.0010) [2023-12-26 03:22:25,908][123090] Updated weights for policy 1, policy_version 471178 (0.0005) [2023-12-26 03:22:25,964][123090] Updated weights for policy 1, policy_version 471188 (0.0005) [2023-12-26 03:22:26,021][123090] Updated weights for policy 1, policy_version 471198 (0.0008) [2023-12-26 03:22:26,211][123091] Updated weights for policy 0, policy_version 474390 (0.0010) [2023-12-26 03:22:26,261][123091] Updated weights for policy 0, policy_version 474401 (0.0010) [2023-12-26 03:22:26,313][123091] Updated weights for policy 0, policy_version 474411 (0.0009) [2023-12-26 03:22:26,765][123090] Updated weights for policy 1, policy_version 471208 (0.0010) [2023-12-26 03:22:26,836][123090] Updated weights for policy 1, policy_version 471218 (0.0010) [2023-12-26 03:22:26,897][123090] Updated weights for policy 1, policy_version 471228 (0.0009) [2023-12-26 03:22:27,070][123091] Updated weights for policy 0, policy_version 474421 (0.0008) [2023-12-26 03:22:27,117][123091] Updated weights for policy 0, policy_version 474431 (0.0005) [2023-12-26 03:22:27,170][123091] Updated weights for policy 0, policy_version 474441 (0.0005) [2023-12-26 03:22:27,610][123090] Updated weights for policy 1, policy_version 471238 (0.0007) [2023-12-26 03:22:27,654][123090] Updated weights for policy 1, policy_version 471248 (0.0005) [2023-12-26 03:22:27,700][123090] Updated weights for policy 1, policy_version 471258 (0.0005) [2023-12-26 03:22:27,917][123091] Updated weights for policy 0, policy_version 474451 (0.0007) [2023-12-26 03:22:27,976][123091] Updated weights for policy 0, policy_version 474461 (0.0010) [2023-12-26 03:22:28,024][123091] Updated weights for policy 0, policy_version 474471 (0.0010) [2023-12-26 03:22:28,446][123090] Updated weights for policy 1, policy_version 471268 (0.0009) [2023-12-26 03:22:28,494][123090] Updated weights for policy 1, policy_version 471278 (0.0008) [2023-12-26 03:22:28,542][123090] Updated weights for policy 1, policy_version 471288 (0.0009) [2023-12-26 03:22:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 242122752. Throughput: 0: 8984.1, 1: 8844.1. Samples: 242115156. Policy #0 lag: (min: 6.0, avg: 6.7, max: 27.0) [2023-12-26 03:22:28,784][121949] Avg episode reward: [(0, '6196.670'), (1, '5197.984')] [2023-12-26 03:22:28,888][123091] Updated weights for policy 0, policy_version 474481 (0.0010) [2023-12-26 03:22:28,950][123091] Updated weights for policy 0, policy_version 474491 (0.0011) [2023-12-26 03:22:29,017][123091] Updated weights for policy 0, policy_version 474501 (0.0011) [2023-12-26 03:22:29,078][123091] Updated weights for policy 0, policy_version 474511 (0.0010) [2023-12-26 03:22:29,429][123090] Updated weights for policy 1, policy_version 471298 (0.0009) [2023-12-26 03:22:29,485][123090] Updated weights for policy 1, policy_version 471308 (0.0009) [2023-12-26 03:22:29,545][123090] Updated weights for policy 1, policy_version 471318 (0.0009) [2023-12-26 03:22:29,606][123090] Updated weights for policy 1, policy_version 471328 (0.0007) [2023-12-26 03:22:29,836][123091] Updated weights for policy 0, policy_version 474521 (0.0008) [2023-12-26 03:22:29,898][123091] Updated weights for policy 0, policy_version 474531 (0.0009) [2023-12-26 03:22:29,965][123091] Updated weights for policy 0, policy_version 474541 (0.0009) [2023-12-26 03:22:30,423][123090] Updated weights for policy 1, policy_version 471338 (0.0009) [2023-12-26 03:22:30,486][123090] Updated weights for policy 1, policy_version 471348 (0.0009) [2023-12-26 03:22:30,542][123090] Updated weights for policy 1, policy_version 471358 (0.0010) [2023-12-26 03:22:30,715][123091] Updated weights for policy 0, policy_version 474551 (0.0007) [2023-12-26 03:22:30,779][123091] Updated weights for policy 0, policy_version 474561 (0.0005) [2023-12-26 03:22:30,840][123091] Updated weights for policy 0, policy_version 474571 (0.0005) [2023-12-26 03:22:31,435][123090] Updated weights for policy 1, policy_version 471368 (0.0008) [2023-12-26 03:22:31,499][123090] Updated weights for policy 1, policy_version 471378 (0.0010) [2023-12-26 03:22:31,551][123090] Updated weights for policy 1, policy_version 471388 (0.0008) [2023-12-26 03:22:31,565][123091] Updated weights for policy 0, policy_version 474581 (0.0007) [2023-12-26 03:22:31,627][123091] Updated weights for policy 0, policy_version 474591 (0.0009) [2023-12-26 03:22:31,694][123091] Updated weights for policy 0, policy_version 474601 (0.0010) [2023-12-26 03:22:32,333][123090] Updated weights for policy 1, policy_version 471398 (0.0005) [2023-12-26 03:22:32,408][123090] Updated weights for policy 1, policy_version 471408 (0.0008) [2023-12-26 03:22:32,471][123090] Updated weights for policy 1, policy_version 471418 (0.0010) [2023-12-26 03:22:32,516][123091] Updated weights for policy 0, policy_version 474611 (0.0009) [2023-12-26 03:22:32,581][123091] Updated weights for policy 0, policy_version 474621 (0.0009) [2023-12-26 03:22:32,644][123091] Updated weights for policy 0, policy_version 474631 (0.0009) [2023-12-26 03:22:33,244][123090] Updated weights for policy 1, policy_version 471428 (0.0010) [2023-12-26 03:22:33,306][123090] Updated weights for policy 1, policy_version 471438 (0.0010) [2023-12-26 03:22:33,368][123090] Updated weights for policy 1, policy_version 471448 (0.0010) [2023-12-26 03:22:33,462][123091] Updated weights for policy 0, policy_version 474641 (0.0011) [2023-12-26 03:22:33,526][123091] Updated weights for policy 0, policy_version 474651 (0.0010) [2023-12-26 03:22:33,590][123091] Updated weights for policy 0, policy_version 474661 (0.0010) [2023-12-26 03:22:33,652][123091] Updated weights for policy 0, policy_version 474671 (0.0010) [2023-12-26 03:22:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 242212864. Throughput: 0: 8917.3, 1: 8874.7. Samples: 242219912. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:33,785][121949] Avg episode reward: [(0, '6137.657'), (1, '5347.021')] [2023-12-26 03:22:34,146][123090] Updated weights for policy 1, policy_version 471458 (0.0010) [2023-12-26 03:22:34,213][123090] Updated weights for policy 1, policy_version 471468 (0.0010) [2023-12-26 03:22:34,273][123090] Updated weights for policy 1, policy_version 471478 (0.0010) [2023-12-26 03:22:34,336][123090] Updated weights for policy 1, policy_version 471488 (0.0010) [2023-12-26 03:22:34,383][123091] Updated weights for policy 0, policy_version 474681 (0.0010) [2023-12-26 03:22:34,445][123091] Updated weights for policy 0, policy_version 474691 (0.0008) [2023-12-26 03:22:34,505][123091] Updated weights for policy 0, policy_version 474701 (0.0011) [2023-12-26 03:22:35,133][123090] Updated weights for policy 1, policy_version 471498 (0.0010) [2023-12-26 03:22:35,188][123090] Updated weights for policy 1, policy_version 471508 (0.0010) [2023-12-26 03:22:35,242][123090] Updated weights for policy 1, policy_version 471518 (0.0010) [2023-12-26 03:22:35,320][123091] Updated weights for policy 0, policy_version 474711 (0.0007) [2023-12-26 03:22:35,390][123091] Updated weights for policy 0, policy_version 474721 (0.0005) [2023-12-26 03:22:35,460][123091] Updated weights for policy 0, policy_version 474731 (0.0005) [2023-12-26 03:22:36,019][123090] Updated weights for policy 1, policy_version 471528 (0.0007) [2023-12-26 03:22:36,056][123091] Updated weights for policy 0, policy_version 474741 (0.0005) [2023-12-26 03:22:36,078][123090] Updated weights for policy 1, policy_version 471538 (0.0010) [2023-12-26 03:22:36,128][123091] Updated weights for policy 0, policy_version 474751 (0.0007) [2023-12-26 03:22:36,140][123090] Updated weights for policy 1, policy_version 471548 (0.0009) [2023-12-26 03:22:36,195][123091] Updated weights for policy 0, policy_version 474761 (0.0010) [2023-12-26 03:22:36,906][123091] Updated weights for policy 0, policy_version 474771 (0.0005) [2023-12-26 03:22:36,969][123091] Updated weights for policy 0, policy_version 474781 (0.0008) [2023-12-26 03:22:36,975][123090] Updated weights for policy 1, policy_version 471558 (0.0011) [2023-12-26 03:22:37,029][123091] Updated weights for policy 0, policy_version 474791 (0.0011) [2023-12-26 03:22:37,038][123090] Updated weights for policy 1, policy_version 471568 (0.0011) [2023-12-26 03:22:37,102][123090] Updated weights for policy 1, policy_version 471578 (0.0011) [2023-12-26 03:22:37,760][123091] Updated weights for policy 0, policy_version 474801 (0.0010) [2023-12-26 03:22:37,824][123090] Updated weights for policy 1, policy_version 471588 (0.0008) [2023-12-26 03:22:37,828][123091] Updated weights for policy 0, policy_version 474811 (0.0008) [2023-12-26 03:22:37,882][123090] Updated weights for policy 1, policy_version 471598 (0.0006) [2023-12-26 03:22:37,891][123091] Updated weights for policy 0, policy_version 474821 (0.0008) [2023-12-26 03:22:37,935][123090] Updated weights for policy 1, policy_version 471608 (0.0008) [2023-12-26 03:22:37,956][123091] Updated weights for policy 0, policy_version 474831 (0.0008) [2023-12-26 03:22:38,765][123091] Updated weights for policy 0, policy_version 474841 (0.0008) [2023-12-26 03:22:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 242294784. Throughput: 0: 8996.4, 1: 8908.6. Samples: 242276464. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:38,785][121949] Avg episode reward: [(0, '6176.889'), (1, '5356.502')] [2023-12-26 03:22:38,797][123090] Updated weights for policy 1, policy_version 471618 (0.0009) [2023-12-26 03:22:38,825][123091] Updated weights for policy 0, policy_version 474851 (0.0009) [2023-12-26 03:22:38,854][123090] Updated weights for policy 1, policy_version 471628 (0.0009) [2023-12-26 03:22:38,881][123091] Updated weights for policy 0, policy_version 474861 (0.0007) [2023-12-26 03:22:38,895][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000474864_121569280.pth... [2023-12-26 03:22:38,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000473776_121290752.pth [2023-12-26 03:22:38,920][123090] Updated weights for policy 1, policy_version 471638 (0.0008) [2023-12-26 03:22:38,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000471648_120741888.pth... [2023-12-26 03:22:38,973][123090] Updated weights for policy 1, policy_version 471648 (0.0010) [2023-12-26 03:22:38,974][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000470592_120471552.pth [2023-12-26 03:22:39,703][123091] Updated weights for policy 0, policy_version 474871 (0.0009) [2023-12-26 03:22:39,771][123091] Updated weights for policy 0, policy_version 474881 (0.0008) [2023-12-26 03:22:39,837][123090] Updated weights for policy 1, policy_version 471658 (0.0009) [2023-12-26 03:22:39,843][123091] Updated weights for policy 0, policy_version 474891 (0.0009) [2023-12-26 03:22:39,909][123090] Updated weights for policy 1, policy_version 471668 (0.0009) [2023-12-26 03:22:39,986][123090] Updated weights for policy 1, policy_version 471678 (0.0010) [2023-12-26 03:22:40,703][123091] Updated weights for policy 0, policy_version 474901 (0.0010) [2023-12-26 03:22:40,756][123091] Updated weights for policy 0, policy_version 474911 (0.0009) [2023-12-26 03:22:40,781][123090] Updated weights for policy 1, policy_version 471688 (0.0009) [2023-12-26 03:22:40,809][123091] Updated weights for policy 0, policy_version 474921 (0.0009) [2023-12-26 03:22:40,845][123090] Updated weights for policy 1, policy_version 471698 (0.0008) [2023-12-26 03:22:40,918][123090] Updated weights for policy 1, policy_version 471708 (0.0010) [2023-12-26 03:22:41,657][123091] Updated weights for policy 0, policy_version 474931 (0.0007) [2023-12-26 03:22:41,658][123090] Updated weights for policy 1, policy_version 471718 (0.0009) [2023-12-26 03:22:41,728][123090] Updated weights for policy 1, policy_version 471728 (0.0007) [2023-12-26 03:22:41,728][123091] Updated weights for policy 0, policy_version 474941 (0.0010) [2023-12-26 03:22:41,794][123090] Updated weights for policy 1, policy_version 471738 (0.0007) [2023-12-26 03:22:41,802][123091] Updated weights for policy 0, policy_version 474951 (0.0010) [2023-12-26 03:22:42,546][123091] Updated weights for policy 0, policy_version 474961 (0.0008) [2023-12-26 03:22:42,604][123091] Updated weights for policy 0, policy_version 474971 (0.0008) [2023-12-26 03:22:42,647][123090] Updated weights for policy 1, policy_version 471748 (0.0008) [2023-12-26 03:22:42,671][123091] Updated weights for policy 0, policy_version 474982 (0.0009) [2023-12-26 03:22:42,710][123090] Updated weights for policy 1, policy_version 471758 (0.0013) [2023-12-26 03:22:42,727][123091] Updated weights for policy 0, policy_version 474992 (0.0008) [2023-12-26 03:22:42,766][123090] Updated weights for policy 1, policy_version 471768 (0.0009) [2023-12-26 03:22:43,537][123091] Updated weights for policy 0, policy_version 475002 (0.0009) [2023-12-26 03:22:43,586][123091] Updated weights for policy 0, policy_version 475012 (0.0009) [2023-12-26 03:22:43,609][123090] Updated weights for policy 1, policy_version 471778 (0.0011) [2023-12-26 03:22:43,633][123091] Updated weights for policy 0, policy_version 475022 (0.0007) [2023-12-26 03:22:43,656][123090] Updated weights for policy 1, policy_version 471788 (0.0010) [2023-12-26 03:22:43,711][123090] Updated weights for policy 1, policy_version 471798 (0.0010) [2023-12-26 03:22:43,762][123090] Updated weights for policy 1, policy_version 471808 (0.0010) [2023-12-26 03:22:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 242393088. Throughput: 0: 8987.6, 1: 8859.6. Samples: 242381088. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:43,785][121949] Avg episode reward: [(0, '6164.927'), (1, '5074.711')] [2023-12-26 03:22:44,413][123091] Updated weights for policy 0, policy_version 475032 (0.0005) [2023-12-26 03:22:44,478][123091] Updated weights for policy 0, policy_version 475042 (0.0005) [2023-12-26 03:22:44,546][123091] Updated weights for policy 0, policy_version 475052 (0.0005) [2023-12-26 03:22:44,617][123090] Updated weights for policy 1, policy_version 471818 (0.0011) [2023-12-26 03:22:44,679][123090] Updated weights for policy 1, policy_version 471828 (0.0010) [2023-12-26 03:22:44,756][123090] Updated weights for policy 1, policy_version 471838 (0.0010) [2023-12-26 03:22:45,253][123091] Updated weights for policy 0, policy_version 475062 (0.0008) [2023-12-26 03:22:45,306][123091] Updated weights for policy 0, policy_version 475072 (0.0009) [2023-12-26 03:22:45,360][123091] Updated weights for policy 0, policy_version 475082 (0.0009) [2023-12-26 03:22:45,566][123090] Updated weights for policy 1, policy_version 471848 (0.0011) [2023-12-26 03:22:45,636][123090] Updated weights for policy 1, policy_version 471858 (0.0011) [2023-12-26 03:22:45,699][123090] Updated weights for policy 1, policy_version 471868 (0.0011) [2023-12-26 03:22:46,245][123091] Updated weights for policy 0, policy_version 475092 (0.0009) [2023-12-26 03:22:46,302][123091] Updated weights for policy 0, policy_version 475103 (0.0011) [2023-12-26 03:22:46,351][123091] Updated weights for policy 0, policy_version 475114 (0.0009) [2023-12-26 03:22:46,459][123090] Updated weights for policy 1, policy_version 471878 (0.0007) [2023-12-26 03:22:46,526][123090] Updated weights for policy 1, policy_version 471888 (0.0009) [2023-12-26 03:22:46,592][123090] Updated weights for policy 1, policy_version 471898 (0.0009) [2023-12-26 03:22:47,106][123091] Updated weights for policy 0, policy_version 475125 (0.0008) [2023-12-26 03:22:47,170][123091] Updated weights for policy 0, policy_version 475135 (0.0007) [2023-12-26 03:22:47,236][123091] Updated weights for policy 0, policy_version 475145 (0.0009) [2023-12-26 03:22:47,402][123090] Updated weights for policy 1, policy_version 471908 (0.0009) [2023-12-26 03:22:47,458][123090] Updated weights for policy 1, policy_version 471918 (0.0007) [2023-12-26 03:22:47,515][123090] Updated weights for policy 1, policy_version 471928 (0.0005) [2023-12-26 03:22:47,945][123091] Updated weights for policy 0, policy_version 475155 (0.0008) [2023-12-26 03:22:48,009][123091] Updated weights for policy 0, policy_version 475165 (0.0008) [2023-12-26 03:22:48,076][123091] Updated weights for policy 0, policy_version 475175 (0.0008) [2023-12-26 03:22:48,158][123090] Updated weights for policy 1, policy_version 471938 (0.0006) [2023-12-26 03:22:48,224][123090] Updated weights for policy 1, policy_version 471948 (0.0009) [2023-12-26 03:22:48,285][123090] Updated weights for policy 1, policy_version 471958 (0.0009) [2023-12-26 03:22:48,349][123090] Updated weights for policy 1, policy_version 471968 (0.0009) [2023-12-26 03:22:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 242475008. Throughput: 0: 8980.8, 1: 8879.4. Samples: 242487884. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:48,784][121949] Avg episode reward: [(0, '6115.682'), (1, '5125.264')] [2023-12-26 03:22:48,840][123091] Updated weights for policy 0, policy_version 475185 (0.0009) [2023-12-26 03:22:48,911][123091] Updated weights for policy 0, policy_version 475195 (0.0007) [2023-12-26 03:22:48,980][123091] Updated weights for policy 0, policy_version 475205 (0.0007) [2023-12-26 03:22:49,052][123091] Updated weights for policy 0, policy_version 475215 (0.0007) [2023-12-26 03:22:49,205][123090] Updated weights for policy 1, policy_version 471978 (0.0009) [2023-12-26 03:22:49,266][123090] Updated weights for policy 1, policy_version 471988 (0.0009) [2023-12-26 03:22:49,327][123090] Updated weights for policy 1, policy_version 471998 (0.0009) [2023-12-26 03:22:49,788][123091] Updated weights for policy 0, policy_version 475225 (0.0009) [2023-12-26 03:22:49,854][123091] Updated weights for policy 0, policy_version 475235 (0.0010) [2023-12-26 03:22:49,908][123091] Updated weights for policy 0, policy_version 475245 (0.0010) [2023-12-26 03:22:50,179][123090] Updated weights for policy 1, policy_version 472008 (0.0006) [2023-12-26 03:22:50,244][123090] Updated weights for policy 1, policy_version 472018 (0.0005) [2023-12-26 03:22:50,306][123090] Updated weights for policy 1, policy_version 472028 (0.0005) [2023-12-26 03:22:50,747][123091] Updated weights for policy 0, policy_version 475255 (0.0009) [2023-12-26 03:22:50,821][123091] Updated weights for policy 0, policy_version 475265 (0.0010) [2023-12-26 03:22:50,888][123091] Updated weights for policy 0, policy_version 475275 (0.0009) [2023-12-26 03:22:51,019][123090] Updated weights for policy 1, policy_version 472038 (0.0006) [2023-12-26 03:22:51,087][123090] Updated weights for policy 1, policy_version 472048 (0.0008) [2023-12-26 03:22:51,156][123090] Updated weights for policy 1, policy_version 472058 (0.0008) [2023-12-26 03:22:51,816][123091] Updated weights for policy 0, policy_version 475285 (0.0009) [2023-12-26 03:22:51,892][123091] Updated weights for policy 0, policy_version 475295 (0.0010) [2023-12-26 03:22:51,944][123090] Updated weights for policy 1, policy_version 472068 (0.0007) [2023-12-26 03:22:51,953][123091] Updated weights for policy 0, policy_version 475305 (0.0009) [2023-12-26 03:22:52,000][123090] Updated weights for policy 1, policy_version 472078 (0.0006) [2023-12-26 03:22:52,058][123090] Updated weights for policy 1, policy_version 472088 (0.0006) [2023-12-26 03:22:52,801][123091] Updated weights for policy 0, policy_version 475315 (0.0009) [2023-12-26 03:22:52,860][123091] Updated weights for policy 0, policy_version 475325 (0.0005) [2023-12-26 03:22:52,875][123090] Updated weights for policy 1, policy_version 472098 (0.0010) [2023-12-26 03:22:52,908][123091] Updated weights for policy 0, policy_version 475335 (0.0005) [2023-12-26 03:22:52,935][123090] Updated weights for policy 1, policy_version 472108 (0.0010) [2023-12-26 03:22:52,993][123090] Updated weights for policy 1, policy_version 472118 (0.0010) [2023-12-26 03:22:53,053][123090] Updated weights for policy 1, policy_version 472128 (0.0010) [2023-12-26 03:22:53,637][123091] Updated weights for policy 0, policy_version 475345 (0.0006) [2023-12-26 03:22:53,707][123091] Updated weights for policy 0, policy_version 475355 (0.0008) [2023-12-26 03:22:53,766][123091] Updated weights for policy 0, policy_version 475365 (0.0008) [2023-12-26 03:22:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 242556928. Throughput: 0: 8954.3, 1: 8813.3. Samples: 242540364. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:53,785][121949] Avg episode reward: [(0, '6102.954'), (1, '5338.685')] [2023-12-26 03:22:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000472128_120864768.pth... [2023-12-26 03:22:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000471104_120602624.pth [2023-12-26 03:22:53,835][123091] Updated weights for policy 0, policy_version 475375 (0.0008) [2023-12-26 03:22:53,840][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000475376_121700352.pth... [2023-12-26 03:22:53,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000474320_121430016.pth [2023-12-26 03:22:53,880][123090] Updated weights for policy 1, policy_version 472138 (0.0008) [2023-12-26 03:22:53,949][123090] Updated weights for policy 1, policy_version 472148 (0.0010) [2023-12-26 03:22:54,010][123090] Updated weights for policy 1, policy_version 472158 (0.0008) [2023-12-26 03:22:54,657][123091] Updated weights for policy 0, policy_version 475385 (0.0009) [2023-12-26 03:22:54,730][123091] Updated weights for policy 0, policy_version 475395 (0.0009) [2023-12-26 03:22:54,753][123090] Updated weights for policy 1, policy_version 472168 (0.0005) [2023-12-26 03:22:54,791][123091] Updated weights for policy 0, policy_version 475405 (0.0010) [2023-12-26 03:22:54,809][123090] Updated weights for policy 1, policy_version 472178 (0.0005) [2023-12-26 03:22:54,859][123090] Updated weights for policy 1, policy_version 472188 (0.0005) [2023-12-26 03:22:55,594][123091] Updated weights for policy 0, policy_version 475415 (0.0009) [2023-12-26 03:22:55,625][123090] Updated weights for policy 1, policy_version 472198 (0.0005) [2023-12-26 03:22:55,651][123091] Updated weights for policy 0, policy_version 475425 (0.0008) [2023-12-26 03:22:55,684][123090] Updated weights for policy 1, policy_version 472208 (0.0005) [2023-12-26 03:22:55,700][123091] Updated weights for policy 0, policy_version 475435 (0.0005) [2023-12-26 03:22:55,751][123090] Updated weights for policy 1, policy_version 472218 (0.0005) [2023-12-26 03:22:56,390][123090] Updated weights for policy 1, policy_version 472228 (0.0005) [2023-12-26 03:22:56,443][123090] Updated weights for policy 1, policy_version 472238 (0.0006) [2023-12-26 03:22:56,474][123091] Updated weights for policy 0, policy_version 475445 (0.0005) [2023-12-26 03:22:56,499][123090] Updated weights for policy 1, policy_version 472248 (0.0005) [2023-12-26 03:22:56,523][123091] Updated weights for policy 0, policy_version 475455 (0.0005) [2023-12-26 03:22:56,570][123091] Updated weights for policy 0, policy_version 475465 (0.0005) [2023-12-26 03:22:57,217][123091] Updated weights for policy 0, policy_version 475475 (0.0005) [2023-12-26 03:22:57,266][123090] Updated weights for policy 1, policy_version 472258 (0.0006) [2023-12-26 03:22:57,272][123091] Updated weights for policy 0, policy_version 475485 (0.0005) [2023-12-26 03:22:57,328][123090] Updated weights for policy 1, policy_version 472268 (0.0010) [2023-12-26 03:22:57,332][123091] Updated weights for policy 0, policy_version 475495 (0.0006) [2023-12-26 03:22:57,375][123090] Updated weights for policy 1, policy_version 472278 (0.0010) [2023-12-26 03:22:57,422][123090] Updated weights for policy 1, policy_version 472288 (0.0010) [2023-12-26 03:22:58,008][123091] Updated weights for policy 0, policy_version 475505 (0.0006) [2023-12-26 03:22:58,070][123091] Updated weights for policy 0, policy_version 475515 (0.0010) [2023-12-26 03:22:58,138][123091] Updated weights for policy 0, policy_version 475525 (0.0009) [2023-12-26 03:22:58,146][123090] Updated weights for policy 1, policy_version 472298 (0.0008) [2023-12-26 03:22:58,199][123091] Updated weights for policy 0, policy_version 475535 (0.0009) [2023-12-26 03:22:58,212][123090] Updated weights for policy 1, policy_version 472308 (0.0008) [2023-12-26 03:22:58,274][123090] Updated weights for policy 1, policy_version 472318 (0.0008) [2023-12-26 03:22:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 242655232. Throughput: 0: 9055.9, 1: 8827.5. Samples: 242650472. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:22:58,785][121949] Avg episode reward: [(0, '6225.882'), (1, '5468.851')] [2023-12-26 03:22:59,184][123091] Updated weights for policy 0, policy_version 475545 (0.0009) [2023-12-26 03:22:59,185][123090] Updated weights for policy 1, policy_version 472328 (0.0009) [2023-12-26 03:22:59,248][123091] Updated weights for policy 0, policy_version 475555 (0.0008) [2023-12-26 03:22:59,250][123090] Updated weights for policy 1, policy_version 472338 (0.0009) [2023-12-26 03:22:59,303][123091] Updated weights for policy 0, policy_version 475565 (0.0009) [2023-12-26 03:22:59,313][123090] Updated weights for policy 1, policy_version 472348 (0.0006) [2023-12-26 03:23:00,127][123091] Updated weights for policy 0, policy_version 475575 (0.0010) [2023-12-26 03:23:00,173][123090] Updated weights for policy 1, policy_version 472358 (0.0009) [2023-12-26 03:23:00,192][123091] Updated weights for policy 0, policy_version 475585 (0.0008) [2023-12-26 03:23:00,226][123090] Updated weights for policy 1, policy_version 472368 (0.0007) [2023-12-26 03:23:00,254][123091] Updated weights for policy 0, policy_version 475595 (0.0008) [2023-12-26 03:23:00,282][123090] Updated weights for policy 1, policy_version 472378 (0.0007) [2023-12-26 03:23:01,067][123091] Updated weights for policy 0, policy_version 475605 (0.0009) [2023-12-26 03:23:01,122][123090] Updated weights for policy 1, policy_version 472388 (0.0009) [2023-12-26 03:23:01,128][123091] Updated weights for policy 0, policy_version 475615 (0.0009) [2023-12-26 03:23:01,182][123090] Updated weights for policy 1, policy_version 472398 (0.0009) [2023-12-26 03:23:01,189][123091] Updated weights for policy 0, policy_version 475625 (0.0009) [2023-12-26 03:23:01,239][123090] Updated weights for policy 1, policy_version 472408 (0.0007) [2023-12-26 03:23:01,967][123091] Updated weights for policy 0, policy_version 475635 (0.0010) [2023-12-26 03:23:02,026][123091] Updated weights for policy 0, policy_version 475645 (0.0009) [2023-12-26 03:23:02,084][123091] Updated weights for policy 0, policy_version 475655 (0.0010) [2023-12-26 03:23:02,120][123090] Updated weights for policy 1, policy_version 472418 (0.0008) [2023-12-26 03:23:02,178][123090] Updated weights for policy 1, policy_version 472428 (0.0008) [2023-12-26 03:23:02,235][123090] Updated weights for policy 1, policy_version 472438 (0.0008) [2023-12-26 03:23:02,297][123090] Updated weights for policy 1, policy_version 472448 (0.0010) [2023-12-26 03:23:02,880][123091] Updated weights for policy 0, policy_version 475665 (0.0009) [2023-12-26 03:23:02,932][123091] Updated weights for policy 0, policy_version 475675 (0.0009) [2023-12-26 03:23:02,986][123091] Updated weights for policy 0, policy_version 475685 (0.0009) [2023-12-26 03:23:03,033][123091] Updated weights for policy 0, policy_version 475695 (0.0009) [2023-12-26 03:23:03,138][123090] Updated weights for policy 1, policy_version 472458 (0.0010) [2023-12-26 03:23:03,191][123090] Updated weights for policy 1, policy_version 472469 (0.0009) [2023-12-26 03:23:03,258][123090] Updated weights for policy 1, policy_version 472480 (0.0010) [2023-12-26 03:23:03,758][123091] Updated weights for policy 0, policy_version 475705 (0.0006) [2023-12-26 03:23:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 242737152. Throughput: 0: 8978.8, 1: 8788.4. Samples: 242753024. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:03,785][121949] Avg episode reward: [(0, '6309.955'), (1, '5437.656')] [2023-12-26 03:23:03,815][123091] Updated weights for policy 0, policy_version 475715 (0.0006) [2023-12-26 03:23:03,880][123091] Updated weights for policy 0, policy_version 475725 (0.0008) [2023-12-26 03:23:04,184][123090] Updated weights for policy 1, policy_version 472490 (0.0005) [2023-12-26 03:23:04,240][123090] Updated weights for policy 1, policy_version 472500 (0.0005) [2023-12-26 03:23:04,294][123090] Updated weights for policy 1, policy_version 472510 (0.0009) [2023-12-26 03:23:04,657][123091] Updated weights for policy 0, policy_version 475735 (0.0010) [2023-12-26 03:23:04,704][123091] Updated weights for policy 0, policy_version 475745 (0.0010) [2023-12-26 03:23:04,756][123091] Updated weights for policy 0, policy_version 475755 (0.0009) [2023-12-26 03:23:04,970][123090] Updated weights for policy 1, policy_version 472520 (0.0006) [2023-12-26 03:23:05,017][123090] Updated weights for policy 1, policy_version 472530 (0.0005) [2023-12-26 03:23:05,062][123090] Updated weights for policy 1, policy_version 472540 (0.0005) [2023-12-26 03:23:05,414][123091] Updated weights for policy 0, policy_version 475765 (0.0005) [2023-12-26 03:23:05,464][123091] Updated weights for policy 0, policy_version 475775 (0.0005) [2023-12-26 03:23:05,517][123091] Updated weights for policy 0, policy_version 475785 (0.0005) [2023-12-26 03:23:05,851][123090] Updated weights for policy 1, policy_version 472550 (0.0008) [2023-12-26 03:23:05,914][123090] Updated weights for policy 1, policy_version 472560 (0.0010) [2023-12-26 03:23:05,975][123090] Updated weights for policy 1, policy_version 472570 (0.0009) [2023-12-26 03:23:06,024][123091] Updated weights for policy 0, policy_version 475795 (0.0005) [2023-12-26 03:23:06,084][123091] Updated weights for policy 0, policy_version 475805 (0.0006) [2023-12-26 03:23:06,158][123091] Updated weights for policy 0, policy_version 475815 (0.0007) [2023-12-26 03:23:06,848][123091] Updated weights for policy 0, policy_version 475825 (0.0007) [2023-12-26 03:23:06,855][123090] Updated weights for policy 1, policy_version 472580 (0.0008) [2023-12-26 03:23:06,901][123091] Updated weights for policy 0, policy_version 475835 (0.0007) [2023-12-26 03:23:06,921][123090] Updated weights for policy 1, policy_version 472590 (0.0009) [2023-12-26 03:23:06,962][123091] Updated weights for policy 0, policy_version 475845 (0.0008) [2023-12-26 03:23:06,985][123090] Updated weights for policy 1, policy_version 472600 (0.0007) [2023-12-26 03:23:07,022][123091] Updated weights for policy 0, policy_version 475855 (0.0009) [2023-12-26 03:23:07,793][123090] Updated weights for policy 1, policy_version 472610 (0.0010) [2023-12-26 03:23:07,843][123090] Updated weights for policy 1, policy_version 472620 (0.0008) [2023-12-26 03:23:07,853][123091] Updated weights for policy 0, policy_version 475865 (0.0008) [2023-12-26 03:23:07,891][123090] Updated weights for policy 1, policy_version 472630 (0.0006) [2023-12-26 03:23:07,906][123091] Updated weights for policy 0, policy_version 475875 (0.0009) [2023-12-26 03:23:07,952][123090] Updated weights for policy 1, policy_version 472640 (0.0007) [2023-12-26 03:23:07,968][123091] Updated weights for policy 0, policy_version 475885 (0.0008) [2023-12-26 03:23:08,747][123091] Updated weights for policy 0, policy_version 475895 (0.0008) [2023-12-26 03:23:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 242827264. Throughput: 0: 9058.1, 1: 8812.0. Samples: 242809704. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:08,785][121949] Avg episode reward: [(0, '6226.703'), (1, '5344.308')] [2023-12-26 03:23:08,814][123091] Updated weights for policy 0, policy_version 475905 (0.0009) [2023-12-26 03:23:08,825][123090] Updated weights for policy 1, policy_version 472650 (0.0008) [2023-12-26 03:23:08,876][123091] Updated weights for policy 0, policy_version 475915 (0.0009) [2023-12-26 03:23:08,887][123090] Updated weights for policy 1, policy_version 472660 (0.0008) [2023-12-26 03:23:08,904][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000475920_121839616.pth... [2023-12-26 03:23:08,908][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000474864_121569280.pth [2023-12-26 03:23:08,951][123090] Updated weights for policy 1, policy_version 472670 (0.0009) [2023-12-26 03:23:08,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000472672_121004032.pth... [2023-12-26 03:23:08,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000471648_120741888.pth [2023-12-26 03:23:09,685][123091] Updated weights for policy 0, policy_version 475925 (0.0009) [2023-12-26 03:23:09,752][123091] Updated weights for policy 0, policy_version 475935 (0.0010) [2023-12-26 03:23:09,819][123091] Updated weights for policy 0, policy_version 475945 (0.0010) [2023-12-26 03:23:09,854][123090] Updated weights for policy 1, policy_version 472680 (0.0008) [2023-12-26 03:23:09,922][123090] Updated weights for policy 1, policy_version 472690 (0.0009) [2023-12-26 03:23:09,989][123090] Updated weights for policy 1, policy_version 472700 (0.0006) [2023-12-26 03:23:10,667][123091] Updated weights for policy 0, policy_version 475955 (0.0009) [2023-12-26 03:23:10,731][123091] Updated weights for policy 0, policy_version 475965 (0.0008) [2023-12-26 03:23:10,759][123090] Updated weights for policy 1, policy_version 472710 (0.0010) [2023-12-26 03:23:10,781][123091] Updated weights for policy 0, policy_version 475975 (0.0005) [2023-12-26 03:23:10,826][123090] Updated weights for policy 1, policy_version 472720 (0.0009) [2023-12-26 03:23:10,893][123090] Updated weights for policy 1, policy_version 472730 (0.0010) [2023-12-26 03:23:11,623][123091] Updated weights for policy 0, policy_version 475985 (0.0008) [2023-12-26 03:23:11,685][123091] Updated weights for policy 0, policy_version 475995 (0.0009) [2023-12-26 03:23:11,759][123091] Updated weights for policy 0, policy_version 476005 (0.0008) [2023-12-26 03:23:11,763][123090] Updated weights for policy 1, policy_version 472740 (0.0008) [2023-12-26 03:23:11,829][123090] Updated weights for policy 1, policy_version 472750 (0.0007) [2023-12-26 03:23:11,833][123091] Updated weights for policy 0, policy_version 476016 (0.0008) [2023-12-26 03:23:11,895][123090] Updated weights for policy 1, policy_version 472760 (0.0006) [2023-12-26 03:23:12,650][123091] Updated weights for policy 0, policy_version 476026 (0.0010) [2023-12-26 03:23:12,713][123091] Updated weights for policy 0, policy_version 476036 (0.0010) [2023-12-26 03:23:12,733][123090] Updated weights for policy 1, policy_version 472770 (0.0007) [2023-12-26 03:23:12,767][123091] Updated weights for policy 0, policy_version 476046 (0.0008) [2023-12-26 03:23:12,789][123090] Updated weights for policy 1, policy_version 472780 (0.0009) [2023-12-26 03:23:12,839][123090] Updated weights for policy 1, policy_version 472790 (0.0009) [2023-12-26 03:23:12,906][123090] Updated weights for policy 1, policy_version 472800 (0.0008) [2023-12-26 03:23:13,578][123091] Updated weights for policy 0, policy_version 476056 (0.0009) [2023-12-26 03:23:13,648][123091] Updated weights for policy 0, policy_version 476066 (0.0009) [2023-12-26 03:23:13,695][123090] Updated weights for policy 1, policy_version 472810 (0.0011) [2023-12-26 03:23:13,706][123091] Updated weights for policy 0, policy_version 476076 (0.0007) [2023-12-26 03:23:13,761][123090] Updated weights for policy 1, policy_version 472820 (0.0010) [2023-12-26 03:23:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 242917376. Throughput: 0: 8979.7, 1: 8715.6. Samples: 242911448. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:13,785][121949] Avg episode reward: [(0, '6266.133'), (1, '5314.916')] [2023-12-26 03:23:13,823][123090] Updated weights for policy 1, policy_version 472830 (0.0010) [2023-12-26 03:23:14,511][123090] Updated weights for policy 1, policy_version 472840 (0.0007) [2023-12-26 03:23:14,570][123091] Updated weights for policy 0, policy_version 476086 (0.0008) [2023-12-26 03:23:14,584][123090] Updated weights for policy 1, policy_version 472850 (0.0007) [2023-12-26 03:23:14,630][123091] Updated weights for policy 0, policy_version 476096 (0.0008) [2023-12-26 03:23:14,643][123090] Updated weights for policy 1, policy_version 472860 (0.0011) [2023-12-26 03:23:14,686][123091] Updated weights for policy 0, policy_version 476106 (0.0010) [2023-12-26 03:23:15,419][123090] Updated weights for policy 1, policy_version 472870 (0.0010) [2023-12-26 03:23:15,435][123091] Updated weights for policy 0, policy_version 476116 (0.0008) [2023-12-26 03:23:15,483][123090] Updated weights for policy 1, policy_version 472880 (0.0010) [2023-12-26 03:23:15,501][123091] Updated weights for policy 0, policy_version 476126 (0.0009) [2023-12-26 03:23:15,531][123090] Updated weights for policy 1, policy_version 472890 (0.0010) [2023-12-26 03:23:15,556][123091] Updated weights for policy 0, policy_version 476136 (0.0010) [2023-12-26 03:23:16,234][123091] Updated weights for policy 0, policy_version 476146 (0.0009) [2023-12-26 03:23:16,303][123091] Updated weights for policy 0, policy_version 476156 (0.0005) [2023-12-26 03:23:16,352][123090] Updated weights for policy 1, policy_version 472900 (0.0010) [2023-12-26 03:23:16,375][123091] Updated weights for policy 0, policy_version 476166 (0.0009) [2023-12-26 03:23:16,410][123090] Updated weights for policy 1, policy_version 472910 (0.0010) [2023-12-26 03:23:16,430][123091] Updated weights for policy 0, policy_version 476176 (0.0010) [2023-12-26 03:23:16,462][123090] Updated weights for policy 1, policy_version 472920 (0.0010) [2023-12-26 03:23:17,158][123091] Updated weights for policy 0, policy_version 476186 (0.0011) [2023-12-26 03:23:17,220][123091] Updated weights for policy 0, policy_version 476196 (0.0011) [2023-12-26 03:23:17,284][123091] Updated weights for policy 0, policy_version 476206 (0.0011) [2023-12-26 03:23:17,290][123090] Updated weights for policy 1, policy_version 472930 (0.0010) [2023-12-26 03:23:17,345][123090] Updated weights for policy 1, policy_version 472940 (0.0010) [2023-12-26 03:23:17,403][123090] Updated weights for policy 1, policy_version 472950 (0.0010) [2023-12-26 03:23:17,457][123090] Updated weights for policy 1, policy_version 472960 (0.0010) [2023-12-26 03:23:18,064][123091] Updated weights for policy 0, policy_version 476216 (0.0006) [2023-12-26 03:23:18,162][123091] Updated weights for policy 0, policy_version 476226 (0.0005) [2023-12-26 03:23:18,174][123090] Updated weights for policy 1, policy_version 472970 (0.0007) [2023-12-26 03:23:18,213][123091] Updated weights for policy 0, policy_version 476236 (0.0005) [2023-12-26 03:23:18,244][123090] Updated weights for policy 1, policy_version 472980 (0.0009) [2023-12-26 03:23:18,305][123090] Updated weights for policy 1, policy_version 472990 (0.0010) [2023-12-26 03:23:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 243007488. Throughput: 0: 9027.2, 1: 8761.2. Samples: 243020392. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:18,785][121949] Avg episode reward: [(0, '6339.970'), (1, '5273.607')] [2023-12-26 03:23:18,920][123091] Updated weights for policy 0, policy_version 476246 (0.0008) [2023-12-26 03:23:18,989][123091] Updated weights for policy 0, policy_version 476256 (0.0010) [2023-12-26 03:23:19,064][123091] Updated weights for policy 0, policy_version 476266 (0.0010) [2023-12-26 03:23:19,175][123090] Updated weights for policy 1, policy_version 473000 (0.0010) [2023-12-26 03:23:19,234][123090] Updated weights for policy 1, policy_version 473010 (0.0009) [2023-12-26 03:23:19,290][123090] Updated weights for policy 1, policy_version 473020 (0.0009) [2023-12-26 03:23:19,843][123091] Updated weights for policy 0, policy_version 476276 (0.0009) [2023-12-26 03:23:19,907][123091] Updated weights for policy 0, policy_version 476286 (0.0010) [2023-12-26 03:23:19,976][123091] Updated weights for policy 0, policy_version 476296 (0.0009) [2023-12-26 03:23:20,201][123090] Updated weights for policy 1, policy_version 473030 (0.0009) [2023-12-26 03:23:20,269][123090] Updated weights for policy 1, policy_version 473040 (0.0010) [2023-12-26 03:23:20,333][123090] Updated weights for policy 1, policy_version 473050 (0.0010) [2023-12-26 03:23:20,793][123091] Updated weights for policy 0, policy_version 476306 (0.0010) [2023-12-26 03:23:20,863][123091] Updated weights for policy 0, policy_version 476316 (0.0009) [2023-12-26 03:23:20,930][123091] Updated weights for policy 0, policy_version 476326 (0.0010) [2023-12-26 03:23:21,001][123091] Updated weights for policy 0, policy_version 476336 (0.0010) [2023-12-26 03:23:21,173][123090] Updated weights for policy 1, policy_version 473060 (0.0009) [2023-12-26 03:23:21,242][123090] Updated weights for policy 1, policy_version 473070 (0.0006) [2023-12-26 03:23:21,315][123090] Updated weights for policy 1, policy_version 473080 (0.0008) [2023-12-26 03:23:21,883][123091] Updated weights for policy 0, policy_version 476346 (0.0010) [2023-12-26 03:23:21,951][123091] Updated weights for policy 0, policy_version 476356 (0.0009) [2023-12-26 03:23:22,016][123091] Updated weights for policy 0, policy_version 476366 (0.0011) [2023-12-26 03:23:22,119][123090] Updated weights for policy 1, policy_version 473090 (0.0008) [2023-12-26 03:23:22,174][123090] Updated weights for policy 1, policy_version 473100 (0.0010) [2023-12-26 03:23:22,233][123090] Updated weights for policy 1, policy_version 473110 (0.0010) [2023-12-26 03:23:22,297][123090] Updated weights for policy 1, policy_version 473120 (0.0009) [2023-12-26 03:23:22,837][123091] Updated weights for policy 0, policy_version 476376 (0.0010) [2023-12-26 03:23:22,886][123091] Updated weights for policy 0, policy_version 476386 (0.0009) [2023-12-26 03:23:22,953][123091] Updated weights for policy 0, policy_version 476396 (0.0008) [2023-12-26 03:23:23,177][123090] Updated weights for policy 1, policy_version 473130 (0.0010) [2023-12-26 03:23:23,239][123090] Updated weights for policy 1, policy_version 473140 (0.0010) [2023-12-26 03:23:23,305][123090] Updated weights for policy 1, policy_version 473150 (0.0010) [2023-12-26 03:23:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 243089408. Throughput: 0: 8946.0, 1: 8709.8. Samples: 243070976. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:23,785][121949] Avg episode reward: [(0, '6375.782'), (1, '5375.640')] [2023-12-26 03:23:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000473152_121126912.pth... [2023-12-26 03:23:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000472128_120864768.pth [2023-12-26 03:23:23,800][123091] Updated weights for policy 0, policy_version 476406 (0.0010) [2023-12-26 03:23:23,866][123091] Updated weights for policy 0, policy_version 476416 (0.0010) [2023-12-26 03:23:23,926][123091] Updated weights for policy 0, policy_version 476426 (0.0010) [2023-12-26 03:23:23,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000476432_121970688.pth... [2023-12-26 03:23:23,969][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000475376_121700352.pth [2023-12-26 03:23:24,013][123090] Updated weights for policy 1, policy_version 473160 (0.0006) [2023-12-26 03:23:24,089][123090] Updated weights for policy 1, policy_version 473170 (0.0005) [2023-12-26 03:23:24,158][123090] Updated weights for policy 1, policy_version 473180 (0.0007) [2023-12-26 03:23:24,808][123091] Updated weights for policy 0, policy_version 476436 (0.0010) [2023-12-26 03:23:24,872][123091] Updated weights for policy 0, policy_version 476446 (0.0009) [2023-12-26 03:23:24,883][123090] Updated weights for policy 1, policy_version 473190 (0.0006) [2023-12-26 03:23:24,932][123091] Updated weights for policy 0, policy_version 476456 (0.0009) [2023-12-26 03:23:24,945][123090] Updated weights for policy 1, policy_version 473200 (0.0005) [2023-12-26 03:23:25,006][123090] Updated weights for policy 1, policy_version 473210 (0.0006) [2023-12-26 03:23:25,775][123090] Updated weights for policy 1, policy_version 473220 (0.0007) [2023-12-26 03:23:25,813][123091] Updated weights for policy 0, policy_version 476466 (0.0008) [2023-12-26 03:23:25,824][123090] Updated weights for policy 1, policy_version 473230 (0.0009) [2023-12-26 03:23:25,861][123091] Updated weights for policy 0, policy_version 476476 (0.0007) [2023-12-26 03:23:25,868][123090] Updated weights for policy 1, policy_version 473240 (0.0008) [2023-12-26 03:23:25,907][123091] Updated weights for policy 0, policy_version 476486 (0.0009) [2023-12-26 03:23:25,970][123091] Updated weights for policy 0, policy_version 476496 (0.0009) [2023-12-26 03:23:26,687][123090] Updated weights for policy 1, policy_version 473250 (0.0007) [2023-12-26 03:23:26,743][123090] Updated weights for policy 1, policy_version 473260 (0.0010) [2023-12-26 03:23:26,799][123090] Updated weights for policy 1, policy_version 473270 (0.0010) [2023-12-26 03:23:26,824][123091] Updated weights for policy 0, policy_version 476506 (0.0006) [2023-12-26 03:23:26,846][123090] Updated weights for policy 1, policy_version 473280 (0.0010) [2023-12-26 03:23:26,873][123091] Updated weights for policy 0, policy_version 476516 (0.0009) [2023-12-26 03:23:26,931][123091] Updated weights for policy 0, policy_version 476526 (0.0009) [2023-12-26 03:23:27,686][123090] Updated weights for policy 1, policy_version 473290 (0.0010) [2023-12-26 03:23:27,737][123090] Updated weights for policy 1, policy_version 473300 (0.0010) [2023-12-26 03:23:27,764][123091] Updated weights for policy 0, policy_version 476536 (0.0006) [2023-12-26 03:23:27,785][123090] Updated weights for policy 1, policy_version 473310 (0.0010) [2023-12-26 03:23:27,810][123091] Updated weights for policy 0, policy_version 476546 (0.0005) [2023-12-26 03:23:27,856][123091] Updated weights for policy 0, policy_version 476556 (0.0005) [2023-12-26 03:23:28,556][123090] Updated weights for policy 1, policy_version 473320 (0.0007) [2023-12-26 03:23:28,629][123090] Updated weights for policy 1, policy_version 473330 (0.0006) [2023-12-26 03:23:28,644][123091] Updated weights for policy 0, policy_version 476566 (0.0007) [2023-12-26 03:23:28,689][123090] Updated weights for policy 1, policy_version 473340 (0.0007) [2023-12-26 03:23:28,699][123091] Updated weights for policy 0, policy_version 476576 (0.0008) [2023-12-26 03:23:28,760][123091] Updated weights for policy 0, policy_version 476586 (0.0008) [2023-12-26 03:23:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 243179520. Throughput: 0: 8873.0, 1: 8745.2. Samples: 243173912. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:28,785][121949] Avg episode reward: [(0, '6361.839'), (1, '5277.104')] [2023-12-26 03:23:29,461][123090] Updated weights for policy 1, policy_version 473350 (0.0009) [2023-12-26 03:23:29,526][123090] Updated weights for policy 1, policy_version 473360 (0.0009) [2023-12-26 03:23:29,587][123090] Updated weights for policy 1, policy_version 473370 (0.0009) [2023-12-26 03:23:29,619][123091] Updated weights for policy 0, policy_version 476596 (0.0009) [2023-12-26 03:23:29,685][123091] Updated weights for policy 0, policy_version 476606 (0.0010) [2023-12-26 03:23:29,740][123091] Updated weights for policy 0, policy_version 476616 (0.0010) [2023-12-26 03:23:30,392][123090] Updated weights for policy 1, policy_version 473380 (0.0009) [2023-12-26 03:23:30,459][123090] Updated weights for policy 1, policy_version 473390 (0.0011) [2023-12-26 03:23:30,515][123090] Updated weights for policy 1, policy_version 473400 (0.0010) [2023-12-26 03:23:30,572][123091] Updated weights for policy 0, policy_version 476626 (0.0009) [2023-12-26 03:23:30,620][123091] Updated weights for policy 0, policy_version 476636 (0.0008) [2023-12-26 03:23:30,668][123091] Updated weights for policy 0, policy_version 476646 (0.0009) [2023-12-26 03:23:30,715][123091] Updated weights for policy 0, policy_version 476656 (0.0008) [2023-12-26 03:23:31,367][123090] Updated weights for policy 1, policy_version 473410 (0.0010) [2023-12-26 03:23:31,438][123090] Updated weights for policy 1, policy_version 473420 (0.0010) [2023-12-26 03:23:31,497][123090] Updated weights for policy 1, policy_version 473430 (0.0009) [2023-12-26 03:23:31,539][123091] Updated weights for policy 0, policy_version 476666 (0.0010) [2023-12-26 03:23:31,559][123090] Updated weights for policy 1, policy_version 473440 (0.0009) [2023-12-26 03:23:31,588][123091] Updated weights for policy 0, policy_version 476676 (0.0008) [2023-12-26 03:23:31,647][123091] Updated weights for policy 0, policy_version 476686 (0.0009) [2023-12-26 03:23:32,244][123090] Updated weights for policy 1, policy_version 473450 (0.0006) [2023-12-26 03:23:32,301][123090] Updated weights for policy 1, policy_version 473460 (0.0008) [2023-12-26 03:23:32,367][123090] Updated weights for policy 1, policy_version 473470 (0.0008) [2023-12-26 03:23:32,575][123091] Updated weights for policy 0, policy_version 476696 (0.0010) [2023-12-26 03:23:32,634][123091] Updated weights for policy 0, policy_version 476706 (0.0010) [2023-12-26 03:23:32,692][123091] Updated weights for policy 0, policy_version 476716 (0.0010) [2023-12-26 03:23:33,084][123090] Updated weights for policy 1, policy_version 473480 (0.0010) [2023-12-26 03:23:33,131][123090] Updated weights for policy 1, policy_version 473490 (0.0010) [2023-12-26 03:23:33,186][123090] Updated weights for policy 1, policy_version 473500 (0.0010) [2023-12-26 03:23:33,584][123091] Updated weights for policy 0, policy_version 476726 (0.0009) [2023-12-26 03:23:33,645][123091] Updated weights for policy 0, policy_version 476736 (0.0009) [2023-12-26 03:23:33,705][123091] Updated weights for policy 0, policy_version 476746 (0.0009) [2023-12-26 03:23:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 243269632. Throughput: 0: 8820.1, 1: 8761.0. Samples: 243279040. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:33,785][121949] Avg episode reward: [(0, '6288.449'), (1, '5149.100')] [2023-12-26 03:23:33,991][123090] Updated weights for policy 1, policy_version 473510 (0.0007) [2023-12-26 03:23:34,040][123090] Updated weights for policy 1, policy_version 473520 (0.0005) [2023-12-26 03:23:34,099][123090] Updated weights for policy 1, policy_version 473530 (0.0005) [2023-12-26 03:23:34,541][123091] Updated weights for policy 0, policy_version 476756 (0.0007) [2023-12-26 03:23:34,607][123091] Updated weights for policy 0, policy_version 476766 (0.0009) [2023-12-26 03:23:34,670][123091] Updated weights for policy 0, policy_version 476776 (0.0009) [2023-12-26 03:23:34,908][123090] Updated weights for policy 1, policy_version 473540 (0.0007) [2023-12-26 03:23:34,975][123090] Updated weights for policy 1, policy_version 473550 (0.0010) [2023-12-26 03:23:35,042][123090] Updated weights for policy 1, policy_version 473560 (0.0011) [2023-12-26 03:23:35,494][123091] Updated weights for policy 0, policy_version 476786 (0.0009) [2023-12-26 03:23:35,564][123091] Updated weights for policy 0, policy_version 476796 (0.0009) [2023-12-26 03:23:35,635][123091] Updated weights for policy 0, policy_version 476806 (0.0010) [2023-12-26 03:23:35,694][123091] Updated weights for policy 0, policy_version 476816 (0.0010) [2023-12-26 03:23:35,810][123090] Updated weights for policy 1, policy_version 473570 (0.0010) [2023-12-26 03:23:35,865][123090] Updated weights for policy 1, policy_version 473580 (0.0010) [2023-12-26 03:23:35,916][123090] Updated weights for policy 1, policy_version 473590 (0.0010) [2023-12-26 03:23:35,975][123090] Updated weights for policy 1, policy_version 473600 (0.0007) [2023-12-26 03:23:36,579][123091] Updated weights for policy 0, policy_version 476826 (0.0010) [2023-12-26 03:23:36,639][123091] Updated weights for policy 0, policy_version 476836 (0.0010) [2023-12-26 03:23:36,709][123091] Updated weights for policy 0, policy_version 476846 (0.0009) [2023-12-26 03:23:36,761][123090] Updated weights for policy 1, policy_version 473611 (0.0009) [2023-12-26 03:23:36,814][123090] Updated weights for policy 1, policy_version 473621 (0.0010) [2023-12-26 03:23:36,872][123090] Updated weights for policy 1, policy_version 473631 (0.0009) [2023-12-26 03:23:37,556][123091] Updated weights for policy 0, policy_version 476856 (0.0009) [2023-12-26 03:23:37,592][123090] Updated weights for policy 1, policy_version 473641 (0.0006) [2023-12-26 03:23:37,619][123091] Updated weights for policy 0, policy_version 476866 (0.0009) [2023-12-26 03:23:37,654][123090] Updated weights for policy 1, policy_version 473651 (0.0006) [2023-12-26 03:23:37,680][123091] Updated weights for policy 0, policy_version 476876 (0.0008) [2023-12-26 03:23:37,715][123090] Updated weights for policy 1, policy_version 473661 (0.0008) [2023-12-26 03:23:38,415][123090] Updated weights for policy 1, policy_version 473671 (0.0008) [2023-12-26 03:23:38,471][123090] Updated weights for policy 1, policy_version 473681 (0.0009) [2023-12-26 03:23:38,521][123090] Updated weights for policy 1, policy_version 473691 (0.0010) [2023-12-26 03:23:38,564][123091] Updated weights for policy 0, policy_version 476886 (0.0010) [2023-12-26 03:23:38,628][123091] Updated weights for policy 0, policy_version 476896 (0.0010) [2023-12-26 03:23:38,681][123091] Updated weights for policy 0, policy_version 476906 (0.0009) [2023-12-26 03:23:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 243359744. Throughput: 0: 8792.9, 1: 8787.0. Samples: 243331460. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:38,785][121949] Avg episode reward: [(0, '6146.776'), (1, '5306.290')] [2023-12-26 03:23:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000476912_122093568.pth... [2023-12-26 03:23:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000473696_121266176.pth... [2023-12-26 03:23:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000472672_121004032.pth [2023-12-26 03:23:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000475920_121839616.pth [2023-12-26 03:23:39,363][123090] Updated weights for policy 1, policy_version 473701 (0.0008) [2023-12-26 03:23:39,434][123090] Updated weights for policy 1, policy_version 473711 (0.0010) [2023-12-26 03:23:39,503][123090] Updated weights for policy 1, policy_version 473721 (0.0007) [2023-12-26 03:23:39,516][123091] Updated weights for policy 0, policy_version 476916 (0.0010) [2023-12-26 03:23:39,582][123091] Updated weights for policy 0, policy_version 476926 (0.0010) [2023-12-26 03:23:39,640][123091] Updated weights for policy 0, policy_version 476936 (0.0010) [2023-12-26 03:23:40,304][123090] Updated weights for policy 1, policy_version 473731 (0.0008) [2023-12-26 03:23:40,371][123090] Updated weights for policy 1, policy_version 473741 (0.0010) [2023-12-26 03:23:40,437][123090] Updated weights for policy 1, policy_version 473751 (0.0007) [2023-12-26 03:23:40,523][123091] Updated weights for policy 0, policy_version 476946 (0.0009) [2023-12-26 03:23:40,580][123091] Updated weights for policy 0, policy_version 476956 (0.0010) [2023-12-26 03:23:40,641][123091] Updated weights for policy 0, policy_version 476966 (0.0010) [2023-12-26 03:23:40,697][123091] Updated weights for policy 0, policy_version 476976 (0.0009) [2023-12-26 03:23:41,220][123090] Updated weights for policy 1, policy_version 473761 (0.0007) [2023-12-26 03:23:41,289][123090] Updated weights for policy 1, policy_version 473771 (0.0012) [2023-12-26 03:23:41,361][123090] Updated weights for policy 1, policy_version 473781 (0.0009) [2023-12-26 03:23:41,434][123090] Updated weights for policy 1, policy_version 473791 (0.0009) [2023-12-26 03:23:41,532][123091] Updated weights for policy 0, policy_version 476986 (0.0011) [2023-12-26 03:23:41,584][123091] Updated weights for policy 0, policy_version 476996 (0.0011) [2023-12-26 03:23:41,651][123091] Updated weights for policy 0, policy_version 477006 (0.0010) [2023-12-26 03:23:42,297][123090] Updated weights for policy 1, policy_version 473801 (0.0009) [2023-12-26 03:23:42,367][123090] Updated weights for policy 1, policy_version 473811 (0.0009) [2023-12-26 03:23:42,442][123090] Updated weights for policy 1, policy_version 473821 (0.0007) [2023-12-26 03:23:42,541][123091] Updated weights for policy 0, policy_version 477016 (0.0009) [2023-12-26 03:23:42,597][123091] Updated weights for policy 0, policy_version 477026 (0.0006) [2023-12-26 03:23:42,662][123091] Updated weights for policy 0, policy_version 477036 (0.0007) [2023-12-26 03:23:43,221][123090] Updated weights for policy 1, policy_version 473831 (0.0008) [2023-12-26 03:23:43,282][123090] Updated weights for policy 1, policy_version 473841 (0.0008) [2023-12-26 03:23:43,350][123090] Updated weights for policy 1, policy_version 473851 (0.0008) [2023-12-26 03:23:43,350][123091] Updated weights for policy 0, policy_version 477046 (0.0010) [2023-12-26 03:23:43,405][123091] Updated weights for policy 0, policy_version 477056 (0.0010) [2023-12-26 03:23:43,456][123091] Updated weights for policy 0, policy_version 477066 (0.0010) [2023-12-26 03:23:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 243441664. Throughput: 0: 8666.3, 1: 8733.6. Samples: 243433468. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:43,785][121949] Avg episode reward: [(0, '6159.201'), (1, '5225.790')] [2023-12-26 03:23:44,031][123090] Updated weights for policy 1, policy_version 473861 (0.0008) [2023-12-26 03:23:44,083][123090] Updated weights for policy 1, policy_version 473871 (0.0009) [2023-12-26 03:23:44,140][123090] Updated weights for policy 1, policy_version 473881 (0.0009) [2023-12-26 03:23:44,294][123091] Updated weights for policy 0, policy_version 477076 (0.0010) [2023-12-26 03:23:44,357][123091] Updated weights for policy 0, policy_version 477086 (0.0011) [2023-12-26 03:23:44,416][123091] Updated weights for policy 0, policy_version 477096 (0.0011) [2023-12-26 03:23:44,929][123090] Updated weights for policy 1, policy_version 473891 (0.0008) [2023-12-26 03:23:44,998][123090] Updated weights for policy 1, policy_version 473901 (0.0008) [2023-12-26 03:23:45,065][123090] Updated weights for policy 1, policy_version 473911 (0.0009) [2023-12-26 03:23:45,189][123091] Updated weights for policy 0, policy_version 477106 (0.0010) [2023-12-26 03:23:45,249][123091] Updated weights for policy 0, policy_version 477116 (0.0005) [2023-12-26 03:23:45,317][123091] Updated weights for policy 0, policy_version 477126 (0.0006) [2023-12-26 03:23:45,378][123091] Updated weights for policy 0, policy_version 477136 (0.0006) [2023-12-26 03:23:45,949][123090] Updated weights for policy 1, policy_version 473921 (0.0010) [2023-12-26 03:23:46,011][123091] Updated weights for policy 0, policy_version 477146 (0.0005) [2023-12-26 03:23:46,014][123090] Updated weights for policy 1, policy_version 473931 (0.0009) [2023-12-26 03:23:46,068][123090] Updated weights for policy 1, policy_version 473941 (0.0009) [2023-12-26 03:23:46,073][123091] Updated weights for policy 0, policy_version 477156 (0.0005) [2023-12-26 03:23:46,121][123090] Updated weights for policy 1, policy_version 473951 (0.0009) [2023-12-26 03:23:46,136][123091] Updated weights for policy 0, policy_version 477166 (0.0005) [2023-12-26 03:23:46,771][123091] Updated weights for policy 0, policy_version 477176 (0.0009) [2023-12-26 03:23:46,833][123091] Updated weights for policy 0, policy_version 477186 (0.0010) [2023-12-26 03:23:46,898][123091] Updated weights for policy 0, policy_version 477196 (0.0011) [2023-12-26 03:23:46,988][123090] Updated weights for policy 1, policy_version 473961 (0.0009) [2023-12-26 03:23:47,052][123090] Updated weights for policy 1, policy_version 473971 (0.0009) [2023-12-26 03:23:47,119][123090] Updated weights for policy 1, policy_version 473981 (0.0009) [2023-12-26 03:23:47,703][123091] Updated weights for policy 0, policy_version 477206 (0.0011) [2023-12-26 03:23:47,769][123091] Updated weights for policy 0, policy_version 477216 (0.0011) [2023-12-26 03:23:47,839][123091] Updated weights for policy 0, policy_version 477226 (0.0011) [2023-12-26 03:23:47,968][123090] Updated weights for policy 1, policy_version 473991 (0.0009) [2023-12-26 03:23:48,028][123090] Updated weights for policy 1, policy_version 474001 (0.0009) [2023-12-26 03:23:48,088][123090] Updated weights for policy 1, policy_version 474011 (0.0009) [2023-12-26 03:23:48,651][123091] Updated weights for policy 0, policy_version 477236 (0.0011) [2023-12-26 03:23:48,714][123091] Updated weights for policy 0, policy_version 477246 (0.0011) [2023-12-26 03:23:48,782][123091] Updated weights for policy 0, policy_version 477256 (0.0009) [2023-12-26 03:23:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 243523584. Throughput: 0: 8732.5, 1: 8757.2. Samples: 243540060. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:48,785][121949] Avg episode reward: [(0, '6211.240'), (1, '5203.137')] [2023-12-26 03:23:48,944][123090] Updated weights for policy 1, policy_version 474021 (0.0009) [2023-12-26 03:23:49,008][123090] Updated weights for policy 1, policy_version 474031 (0.0009) [2023-12-26 03:23:49,079][123090] Updated weights for policy 1, policy_version 474041 (0.0010) [2023-12-26 03:23:49,543][123091] Updated weights for policy 0, policy_version 477266 (0.0011) [2023-12-26 03:23:49,605][123091] Updated weights for policy 0, policy_version 477276 (0.0011) [2023-12-26 03:23:49,669][123091] Updated weights for policy 0, policy_version 477286 (0.0011) [2023-12-26 03:23:49,732][123091] Updated weights for policy 0, policy_version 477296 (0.0010) [2023-12-26 03:23:49,930][123090] Updated weights for policy 1, policy_version 474051 (0.0010) [2023-12-26 03:23:50,001][123090] Updated weights for policy 1, policy_version 474061 (0.0009) [2023-12-26 03:23:50,075][123090] Updated weights for policy 1, policy_version 474071 (0.0008) [2023-12-26 03:23:50,548][123091] Updated weights for policy 0, policy_version 477306 (0.0006) [2023-12-26 03:23:50,607][123091] Updated weights for policy 0, policy_version 477316 (0.0007) [2023-12-26 03:23:50,670][123091] Updated weights for policy 0, policy_version 477326 (0.0010) [2023-12-26 03:23:50,933][123090] Updated weights for policy 1, policy_version 474081 (0.0009) [2023-12-26 03:23:50,984][123090] Updated weights for policy 1, policy_version 474091 (0.0008) [2023-12-26 03:23:51,045][123090] Updated weights for policy 1, policy_version 474101 (0.0008) [2023-12-26 03:23:51,115][123090] Updated weights for policy 1, policy_version 474111 (0.0009) [2023-12-26 03:23:51,493][123091] Updated weights for policy 0, policy_version 477336 (0.0009) [2023-12-26 03:23:51,545][123091] Updated weights for policy 0, policy_version 477346 (0.0010) [2023-12-26 03:23:51,600][123091] Updated weights for policy 0, policy_version 477356 (0.0008) [2023-12-26 03:23:51,994][123090] Updated weights for policy 1, policy_version 474121 (0.0010) [2023-12-26 03:23:52,060][123090] Updated weights for policy 1, policy_version 474131 (0.0010) [2023-12-26 03:23:52,124][123090] Updated weights for policy 1, policy_version 474141 (0.0008) [2023-12-26 03:23:52,508][123091] Updated weights for policy 0, policy_version 477366 (0.0009) [2023-12-26 03:23:52,557][123091] Updated weights for policy 0, policy_version 477376 (0.0009) [2023-12-26 03:23:52,610][123091] Updated weights for policy 0, policy_version 477386 (0.0009) [2023-12-26 03:23:52,916][123090] Updated weights for policy 1, policy_version 474151 (0.0005) [2023-12-26 03:23:52,974][123090] Updated weights for policy 1, policy_version 474161 (0.0005) [2023-12-26 03:23:53,033][123090] Updated weights for policy 1, policy_version 474171 (0.0005) [2023-12-26 03:23:53,462][123091] Updated weights for policy 0, policy_version 477396 (0.0008) [2023-12-26 03:23:53,517][123091] Updated weights for policy 0, policy_version 477406 (0.0005) [2023-12-26 03:23:53,571][123091] Updated weights for policy 0, policy_version 477416 (0.0009) [2023-12-26 03:23:53,681][123090] Updated weights for policy 1, policy_version 474181 (0.0005) [2023-12-26 03:23:53,751][123090] Updated weights for policy 1, policy_version 474191 (0.0005) [2023-12-26 03:23:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 243613696. Throughput: 0: 8652.4, 1: 8706.0. Samples: 243590836. Policy #0 lag: (min: 1.0, avg: 16.9, max: 33.0) [2023-12-26 03:23:53,785][121949] Avg episode reward: [(0, '6146.824'), (1, '5172.683')] [2023-12-26 03:23:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000477424_122224640.pth... [2023-12-26 03:23:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000476432_121970688.pth [2023-12-26 03:23:53,819][123090] Updated weights for policy 1, policy_version 474201 (0.0005) [2023-12-26 03:23:53,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000474208_121397248.pth... [2023-12-26 03:23:53,864][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000473152_121126912.pth [2023-12-26 03:23:54,260][123091] Updated weights for policy 0, policy_version 477426 (0.0011) [2023-12-26 03:23:54,308][123091] Updated weights for policy 0, policy_version 477436 (0.0010) [2023-12-26 03:23:54,359][123091] Updated weights for policy 0, policy_version 477446 (0.0010) [2023-12-26 03:23:54,422][123091] Updated weights for policy 0, policy_version 477456 (0.0011) [2023-12-26 03:23:54,625][123090] Updated weights for policy 1, policy_version 474211 (0.0006) [2023-12-26 03:23:54,680][123090] Updated weights for policy 1, policy_version 474221 (0.0005) [2023-12-26 03:23:54,754][123090] Updated weights for policy 1, policy_version 474231 (0.0005) [2023-12-26 03:23:55,228][123091] Updated weights for policy 0, policy_version 477466 (0.0006) [2023-12-26 03:23:55,279][123091] Updated weights for policy 0, policy_version 477476 (0.0006) [2023-12-26 03:23:55,342][123091] Updated weights for policy 0, policy_version 477486 (0.0006) [2023-12-26 03:23:55,498][123090] Updated weights for policy 1, policy_version 474241 (0.0006) [2023-12-26 03:23:55,558][123090] Updated weights for policy 1, policy_version 474251 (0.0010) [2023-12-26 03:23:55,614][123090] Updated weights for policy 1, policy_version 474261 (0.0010) [2023-12-26 03:23:55,662][123090] Updated weights for policy 1, policy_version 474271 (0.0010) [2023-12-26 03:23:55,983][123091] Updated weights for policy 0, policy_version 477496 (0.0006) [2023-12-26 03:23:56,045][123091] Updated weights for policy 0, policy_version 477506 (0.0005) [2023-12-26 03:23:56,108][123091] Updated weights for policy 0, policy_version 477516 (0.0006) [2023-12-26 03:23:56,417][123090] Updated weights for policy 1, policy_version 474281 (0.0007) [2023-12-26 03:23:56,480][123090] Updated weights for policy 1, policy_version 474291 (0.0009) [2023-12-26 03:23:56,536][123090] Updated weights for policy 1, policy_version 474301 (0.0009) [2023-12-26 03:23:56,818][123091] Updated weights for policy 0, policy_version 477526 (0.0008) [2023-12-26 03:23:56,877][123091] Updated weights for policy 0, policy_version 477536 (0.0010) [2023-12-26 03:23:56,927][123091] Updated weights for policy 0, policy_version 477546 (0.0010) [2023-12-26 03:23:57,275][123090] Updated weights for policy 1, policy_version 474311 (0.0006) [2023-12-26 03:23:57,343][123090] Updated weights for policy 1, policy_version 474321 (0.0007) [2023-12-26 03:23:57,390][123090] Updated weights for policy 1, policy_version 474331 (0.0010) [2023-12-26 03:23:57,590][123091] Updated weights for policy 0, policy_version 477556 (0.0008) [2023-12-26 03:23:57,644][123091] Updated weights for policy 0, policy_version 477566 (0.0005) [2023-12-26 03:23:57,697][123091] Updated weights for policy 0, policy_version 477576 (0.0005) [2023-12-26 03:23:58,156][123090] Updated weights for policy 1, policy_version 474341 (0.0008) [2023-12-26 03:23:58,218][123090] Updated weights for policy 1, policy_version 474351 (0.0006) [2023-12-26 03:23:58,286][123090] Updated weights for policy 1, policy_version 474361 (0.0010) [2023-12-26 03:23:58,362][123091] Updated weights for policy 0, policy_version 477586 (0.0006) [2023-12-26 03:23:58,436][123091] Updated weights for policy 0, policy_version 477596 (0.0008) [2023-12-26 03:23:58,499][123091] Updated weights for policy 0, policy_version 477606 (0.0010) [2023-12-26 03:23:58,557][123091] Updated weights for policy 0, policy_version 477616 (0.0010) [2023-12-26 03:23:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 243712000. Throughput: 0: 8751.5, 1: 8824.1. Samples: 243702348. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:23:58,785][121949] Avg episode reward: [(0, '6110.905'), (1, '5333.133')] [2023-12-26 03:23:59,106][123090] Updated weights for policy 1, policy_version 474371 (0.0009) [2023-12-26 03:23:59,173][123090] Updated weights for policy 1, policy_version 474381 (0.0009) [2023-12-26 03:23:59,252][123090] Updated weights for policy 1, policy_version 474391 (0.0009) [2023-12-26 03:23:59,419][123091] Updated weights for policy 0, policy_version 477626 (0.0008) [2023-12-26 03:23:59,474][123091] Updated weights for policy 0, policy_version 477636 (0.0008) [2023-12-26 03:23:59,532][123091] Updated weights for policy 0, policy_version 477646 (0.0009) [2023-12-26 03:24:00,079][123090] Updated weights for policy 1, policy_version 474401 (0.0010) [2023-12-26 03:24:00,131][123090] Updated weights for policy 1, policy_version 474411 (0.0010) [2023-12-26 03:24:00,184][123090] Updated weights for policy 1, policy_version 474421 (0.0010) [2023-12-26 03:24:00,235][123090] Updated weights for policy 1, policy_version 474431 (0.0010) [2023-12-26 03:24:00,336][123091] Updated weights for policy 0, policy_version 477656 (0.0009) [2023-12-26 03:24:00,400][123091] Updated weights for policy 0, policy_version 477666 (0.0009) [2023-12-26 03:24:00,464][123091] Updated weights for policy 0, policy_version 477676 (0.0009) [2023-12-26 03:24:01,081][123090] Updated weights for policy 1, policy_version 474441 (0.0008) [2023-12-26 03:24:01,139][123090] Updated weights for policy 1, policy_version 474451 (0.0006) [2023-12-26 03:24:01,195][123090] Updated weights for policy 1, policy_version 474461 (0.0009) [2023-12-26 03:24:01,302][123091] Updated weights for policy 0, policy_version 477686 (0.0010) [2023-12-26 03:24:01,364][123091] Updated weights for policy 0, policy_version 477696 (0.0009) [2023-12-26 03:24:01,428][123091] Updated weights for policy 0, policy_version 477706 (0.0009) [2023-12-26 03:24:02,017][123090] Updated weights for policy 1, policy_version 474471 (0.0008) [2023-12-26 03:24:02,075][123090] Updated weights for policy 1, policy_version 474481 (0.0007) [2023-12-26 03:24:02,139][123090] Updated weights for policy 1, policy_version 474491 (0.0008) [2023-12-26 03:24:02,305][123091] Updated weights for policy 0, policy_version 477716 (0.0010) [2023-12-26 03:24:02,371][123091] Updated weights for policy 0, policy_version 477726 (0.0010) [2023-12-26 03:24:02,442][123091] Updated weights for policy 0, policy_version 477736 (0.0010) [2023-12-26 03:24:02,840][123090] Updated weights for policy 1, policy_version 474501 (0.0007) [2023-12-26 03:24:02,895][123090] Updated weights for policy 1, policy_version 474511 (0.0007) [2023-12-26 03:24:02,959][123090] Updated weights for policy 1, policy_version 474521 (0.0008) [2023-12-26 03:24:03,162][123091] Updated weights for policy 0, policy_version 477746 (0.0010) [2023-12-26 03:24:03,231][123091] Updated weights for policy 0, policy_version 477756 (0.0005) [2023-12-26 03:24:03,279][123091] Updated weights for policy 0, policy_version 477766 (0.0006) [2023-12-26 03:24:03,326][123091] Updated weights for policy 0, policy_version 477776 (0.0009) [2023-12-26 03:24:03,671][123090] Updated weights for policy 1, policy_version 474531 (0.0007) [2023-12-26 03:24:03,729][123090] Updated weights for policy 1, policy_version 474541 (0.0005) [2023-12-26 03:24:03,784][123090] Updated weights for policy 1, policy_version 474551 (0.0005) [2023-12-26 03:24:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 243793920. Throughput: 0: 8717.9, 1: 8838.3. Samples: 243810420. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:03,785][121949] Avg episode reward: [(0, '6207.593'), (1, '5284.310')] [2023-12-26 03:24:03,955][123091] Updated weights for policy 0, policy_version 477786 (0.0011) [2023-12-26 03:24:04,015][123091] Updated weights for policy 0, policy_version 477796 (0.0011) [2023-12-26 03:24:04,067][123091] Updated weights for policy 0, policy_version 477806 (0.0011) [2023-12-26 03:24:04,537][123090] Updated weights for policy 1, policy_version 474561 (0.0007) [2023-12-26 03:24:04,591][123090] Updated weights for policy 1, policy_version 474571 (0.0008) [2023-12-26 03:24:04,640][123090] Updated weights for policy 1, policy_version 474581 (0.0008) [2023-12-26 03:24:04,696][123090] Updated weights for policy 1, policy_version 474591 (0.0005) [2023-12-26 03:24:04,944][123091] Updated weights for policy 0, policy_version 477816 (0.0011) [2023-12-26 03:24:05,018][123091] Updated weights for policy 0, policy_version 477826 (0.0011) [2023-12-26 03:24:05,095][123091] Updated weights for policy 0, policy_version 477836 (0.0011) [2023-12-26 03:24:05,402][123090] Updated weights for policy 1, policy_version 474601 (0.0006) [2023-12-26 03:24:05,475][123090] Updated weights for policy 1, policy_version 474611 (0.0006) [2023-12-26 03:24:05,529][123090] Updated weights for policy 1, policy_version 474621 (0.0005) [2023-12-26 03:24:05,873][123091] Updated weights for policy 0, policy_version 477846 (0.0009) [2023-12-26 03:24:05,930][123091] Updated weights for policy 0, policy_version 477856 (0.0007) [2023-12-26 03:24:06,002][123091] Updated weights for policy 0, policy_version 477866 (0.0009) [2023-12-26 03:24:06,175][123090] Updated weights for policy 1, policy_version 474631 (0.0008) [2023-12-26 03:24:06,226][123090] Updated weights for policy 1, policy_version 474641 (0.0009) [2023-12-26 03:24:06,286][123090] Updated weights for policy 1, policy_version 474651 (0.0010) [2023-12-26 03:24:06,811][123091] Updated weights for policy 0, policy_version 477876 (0.0007) [2023-12-26 03:24:06,883][123091] Updated weights for policy 0, policy_version 477886 (0.0006) [2023-12-26 03:24:06,949][123091] Updated weights for policy 0, policy_version 477896 (0.0006) [2023-12-26 03:24:07,085][123090] Updated weights for policy 1, policy_version 474661 (0.0008) [2023-12-26 03:24:07,156][123090] Updated weights for policy 1, policy_version 474671 (0.0009) [2023-12-26 03:24:07,210][123090] Updated weights for policy 1, policy_version 474681 (0.0010) [2023-12-26 03:24:07,600][123091] Updated weights for policy 0, policy_version 477906 (0.0007) [2023-12-26 03:24:07,657][123091] Updated weights for policy 0, policy_version 477916 (0.0009) [2023-12-26 03:24:07,720][123091] Updated weights for policy 0, policy_version 477926 (0.0009) [2023-12-26 03:24:07,775][123091] Updated weights for policy 0, policy_version 477936 (0.0009) [2023-12-26 03:24:08,011][123090] Updated weights for policy 1, policy_version 474691 (0.0010) [2023-12-26 03:24:08,073][123090] Updated weights for policy 1, policy_version 474701 (0.0009) [2023-12-26 03:24:08,137][123090] Updated weights for policy 1, policy_version 474711 (0.0009) [2023-12-26 03:24:08,632][123091] Updated weights for policy 0, policy_version 477946 (0.0010) [2023-12-26 03:24:08,691][123091] Updated weights for policy 0, policy_version 477956 (0.0008) [2023-12-26 03:24:08,748][123091] Updated weights for policy 0, policy_version 477966 (0.0009) [2023-12-26 03:24:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 243892224. Throughput: 0: 8736.8, 1: 8900.0. Samples: 243864632. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:08,785][121949] Avg episode reward: [(0, '6190.558'), (1, '5063.932')] [2023-12-26 03:24:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000474720_121528320.pth... [2023-12-26 03:24:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000477968_122363904.pth... [2023-12-26 03:24:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000473696_121266176.pth [2023-12-26 03:24:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000476912_122093568.pth [2023-12-26 03:24:08,981][123090] Updated weights for policy 1, policy_version 474721 (0.0010) [2023-12-26 03:24:09,043][123090] Updated weights for policy 1, policy_version 474731 (0.0009) [2023-12-26 03:24:09,096][123090] Updated weights for policy 1, policy_version 474741 (0.0010) [2023-12-26 03:24:09,159][123090] Updated weights for policy 1, policy_version 474751 (0.0009) [2023-12-26 03:24:09,611][123091] Updated weights for policy 0, policy_version 477976 (0.0010) [2023-12-26 03:24:09,674][123091] Updated weights for policy 0, policy_version 477986 (0.0010) [2023-12-26 03:24:09,734][123091] Updated weights for policy 0, policy_version 477996 (0.0009) [2023-12-26 03:24:10,042][123090] Updated weights for policy 1, policy_version 474761 (0.0011) [2023-12-26 03:24:10,106][123090] Updated weights for policy 1, policy_version 474771 (0.0011) [2023-12-26 03:24:10,177][123090] Updated weights for policy 1, policy_version 474781 (0.0011) [2023-12-26 03:24:10,588][123091] Updated weights for policy 0, policy_version 478006 (0.0009) [2023-12-26 03:24:10,648][123091] Updated weights for policy 0, policy_version 478016 (0.0009) [2023-12-26 03:24:10,709][123091] Updated weights for policy 0, policy_version 478026 (0.0009) [2023-12-26 03:24:10,974][123090] Updated weights for policy 1, policy_version 474791 (0.0011) [2023-12-26 03:24:11,036][123090] Updated weights for policy 1, policy_version 474801 (0.0009) [2023-12-26 03:24:11,106][123090] Updated weights for policy 1, policy_version 474811 (0.0009) [2023-12-26 03:24:11,604][123091] Updated weights for policy 0, policy_version 478036 (0.0009) [2023-12-26 03:24:11,675][123091] Updated weights for policy 0, policy_version 478046 (0.0009) [2023-12-26 03:24:11,741][123091] Updated weights for policy 0, policy_version 478056 (0.0009) [2023-12-26 03:24:11,988][123090] Updated weights for policy 1, policy_version 474821 (0.0009) [2023-12-26 03:24:12,051][123090] Updated weights for policy 1, policy_version 474831 (0.0010) [2023-12-26 03:24:12,116][123090] Updated weights for policy 1, policy_version 474841 (0.0009) [2023-12-26 03:24:12,597][123091] Updated weights for policy 0, policy_version 478066 (0.0010) [2023-12-26 03:24:12,649][123091] Updated weights for policy 0, policy_version 478076 (0.0007) [2023-12-26 03:24:12,714][123091] Updated weights for policy 0, policy_version 478086 (0.0005) [2023-12-26 03:24:12,776][123091] Updated weights for policy 0, policy_version 478096 (0.0007) [2023-12-26 03:24:12,971][123090] Updated weights for policy 1, policy_version 474851 (0.0010) [2023-12-26 03:24:13,031][123090] Updated weights for policy 1, policy_version 474861 (0.0009) [2023-12-26 03:24:13,092][123090] Updated weights for policy 1, policy_version 474871 (0.0009) [2023-12-26 03:24:13,608][123091] Updated weights for policy 0, policy_version 478106 (0.0010) [2023-12-26 03:24:13,670][123091] Updated weights for policy 0, policy_version 478116 (0.0010) [2023-12-26 03:24:13,745][123091] Updated weights for policy 0, policy_version 478126 (0.0010) [2023-12-26 03:24:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 243974144. Throughput: 0: 8764.5, 1: 8846.1. Samples: 243966384. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:13,785][121949] Avg episode reward: [(0, '6178.007'), (1, '5092.675')] [2023-12-26 03:24:13,915][123090] Updated weights for policy 1, policy_version 474881 (0.0009) [2023-12-26 03:24:13,978][123090] Updated weights for policy 1, policy_version 474891 (0.0009) [2023-12-26 03:24:14,030][123090] Updated weights for policy 1, policy_version 474901 (0.0009) [2023-12-26 03:24:14,082][123090] Updated weights for policy 1, policy_version 474911 (0.0009) [2023-12-26 03:24:14,590][123091] Updated weights for policy 0, policy_version 478136 (0.0011) [2023-12-26 03:24:14,656][123091] Updated weights for policy 0, policy_version 478146 (0.0011) [2023-12-26 03:24:14,714][123091] Updated weights for policy 0, policy_version 478156 (0.0010) [2023-12-26 03:24:14,931][123090] Updated weights for policy 1, policy_version 474921 (0.0009) [2023-12-26 03:24:14,992][123090] Updated weights for policy 1, policy_version 474931 (0.0009) [2023-12-26 03:24:15,057][123090] Updated weights for policy 1, policy_version 474941 (0.0009) [2023-12-26 03:24:15,539][123091] Updated weights for policy 0, policy_version 478166 (0.0011) [2023-12-26 03:24:15,586][123091] Updated weights for policy 0, policy_version 478176 (0.0010) [2023-12-26 03:24:15,632][123091] Updated weights for policy 0, policy_version 478186 (0.0010) [2023-12-26 03:24:15,896][123090] Updated weights for policy 1, policy_version 474951 (0.0009) [2023-12-26 03:24:15,953][123090] Updated weights for policy 1, policy_version 474961 (0.0009) [2023-12-26 03:24:16,006][123090] Updated weights for policy 1, policy_version 474971 (0.0008) [2023-12-26 03:24:16,486][123091] Updated weights for policy 0, policy_version 478196 (0.0011) [2023-12-26 03:24:16,540][123091] Updated weights for policy 0, policy_version 478206 (0.0010) [2023-12-26 03:24:16,591][123091] Updated weights for policy 0, policy_version 478216 (0.0010) [2023-12-26 03:24:16,849][123090] Updated weights for policy 1, policy_version 474981 (0.0008) [2023-12-26 03:24:16,908][123090] Updated weights for policy 1, policy_version 474991 (0.0007) [2023-12-26 03:24:16,962][123090] Updated weights for policy 1, policy_version 475001 (0.0006) [2023-12-26 03:24:17,362][123091] Updated weights for policy 0, policy_version 478226 (0.0010) [2023-12-26 03:24:17,416][123091] Updated weights for policy 0, policy_version 478236 (0.0010) [2023-12-26 03:24:17,472][123091] Updated weights for policy 0, policy_version 478246 (0.0010) [2023-12-26 03:24:17,527][123091] Updated weights for policy 0, policy_version 478256 (0.0010) [2023-12-26 03:24:17,630][123090] Updated weights for policy 1, policy_version 475011 (0.0006) [2023-12-26 03:24:17,676][123090] Updated weights for policy 1, policy_version 475021 (0.0005) [2023-12-26 03:24:17,729][123090] Updated weights for policy 1, policy_version 475031 (0.0005) [2023-12-26 03:24:18,334][123091] Updated weights for policy 0, policy_version 478266 (0.0006) [2023-12-26 03:24:18,408][123091] Updated weights for policy 0, policy_version 478276 (0.0007) [2023-12-26 03:24:18,466][123090] Updated weights for policy 1, policy_version 475041 (0.0008) [2023-12-26 03:24:18,480][123091] Updated weights for policy 0, policy_version 478286 (0.0007) [2023-12-26 03:24:18,520][123090] Updated weights for policy 1, policy_version 475051 (0.0005) [2023-12-26 03:24:18,576][123090] Updated weights for policy 1, policy_version 475061 (0.0005) [2023-12-26 03:24:18,641][123090] Updated weights for policy 1, policy_version 475071 (0.0005) [2023-12-26 03:24:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 244064256. Throughput: 0: 8778.2, 1: 8851.2. Samples: 244072356. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:18,785][121949] Avg episode reward: [(0, '6254.831'), (1, '4968.486')] [2023-12-26 03:24:19,175][123091] Updated weights for policy 0, policy_version 478296 (0.0007) [2023-12-26 03:24:19,247][123091] Updated weights for policy 0, policy_version 478306 (0.0007) [2023-12-26 03:24:19,313][123091] Updated weights for policy 0, policy_version 478316 (0.0006) [2023-12-26 03:24:19,392][123090] Updated weights for policy 1, policy_version 475081 (0.0006) [2023-12-26 03:24:19,464][123090] Updated weights for policy 1, policy_version 475091 (0.0007) [2023-12-26 03:24:19,540][123090] Updated weights for policy 1, policy_version 475101 (0.0009) [2023-12-26 03:24:20,097][123091] Updated weights for policy 0, policy_version 478326 (0.0010) [2023-12-26 03:24:20,161][123091] Updated weights for policy 0, policy_version 478336 (0.0009) [2023-12-26 03:24:20,231][123091] Updated weights for policy 0, policy_version 478346 (0.0010) [2023-12-26 03:24:20,375][123090] Updated weights for policy 1, policy_version 475111 (0.0010) [2023-12-26 03:24:20,424][123090] Updated weights for policy 1, policy_version 475121 (0.0009) [2023-12-26 03:24:20,480][123090] Updated weights for policy 1, policy_version 475131 (0.0008) [2023-12-26 03:24:20,966][123091] Updated weights for policy 0, policy_version 478356 (0.0010) [2023-12-26 03:24:21,042][123091] Updated weights for policy 0, policy_version 478366 (0.0010) [2023-12-26 03:24:21,116][123091] Updated weights for policy 0, policy_version 478376 (0.0009) [2023-12-26 03:24:21,385][123090] Updated weights for policy 1, policy_version 475141 (0.0010) [2023-12-26 03:24:21,443][123090] Updated weights for policy 1, policy_version 475151 (0.0010) [2023-12-26 03:24:21,498][123090] Updated weights for policy 1, policy_version 475161 (0.0010) [2023-12-26 03:24:21,865][123091] Updated weights for policy 0, policy_version 478386 (0.0009) [2023-12-26 03:24:21,928][123091] Updated weights for policy 0, policy_version 478396 (0.0006) [2023-12-26 03:24:21,993][123091] Updated weights for policy 0, policy_version 478406 (0.0006) [2023-12-26 03:24:22,051][123091] Updated weights for policy 0, policy_version 478416 (0.0006) [2023-12-26 03:24:22,445][123090] Updated weights for policy 1, policy_version 475171 (0.0009) [2023-12-26 03:24:22,509][123090] Updated weights for policy 1, policy_version 475181 (0.0008) [2023-12-26 03:24:22,573][123090] Updated weights for policy 1, policy_version 475191 (0.0009) [2023-12-26 03:24:22,822][123091] Updated weights for policy 0, policy_version 478426 (0.0011) [2023-12-26 03:24:22,874][123091] Updated weights for policy 0, policy_version 478436 (0.0011) [2023-12-26 03:24:22,932][123091] Updated weights for policy 0, policy_version 478446 (0.0010) [2023-12-26 03:24:23,412][123090] Updated weights for policy 1, policy_version 475201 (0.0009) [2023-12-26 03:24:23,470][123090] Updated weights for policy 1, policy_version 475211 (0.0008) [2023-12-26 03:24:23,529][123090] Updated weights for policy 1, policy_version 475221 (0.0005) [2023-12-26 03:24:23,584][123090] Updated weights for policy 1, policy_version 475231 (0.0005) [2023-12-26 03:24:23,758][123091] Updated weights for policy 0, policy_version 478456 (0.0009) [2023-12-26 03:24:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 244146176. Throughput: 0: 8837.5, 1: 8794.4. Samples: 244124896. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:23,785][121949] Avg episode reward: [(0, '6210.772'), (1, '4787.300')] [2023-12-26 03:24:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000475232_121659392.pth... [2023-12-26 03:24:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000474208_121397248.pth [2023-12-26 03:24:23,824][123091] Updated weights for policy 0, policy_version 478466 (0.0009) [2023-12-26 03:24:23,887][123091] Updated weights for policy 0, policy_version 478476 (0.0009) [2023-12-26 03:24:23,911][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000478480_122494976.pth... [2023-12-26 03:24:23,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000477424_122224640.pth [2023-12-26 03:24:24,313][123090] Updated weights for policy 1, policy_version 475241 (0.0009) [2023-12-26 03:24:24,376][123090] Updated weights for policy 1, policy_version 475251 (0.0010) [2023-12-26 03:24:24,442][123090] Updated weights for policy 1, policy_version 475261 (0.0009) [2023-12-26 03:24:24,717][123091] Updated weights for policy 0, policy_version 478486 (0.0010) [2023-12-26 03:24:24,766][123091] Updated weights for policy 0, policy_version 478496 (0.0009) [2023-12-26 03:24:24,815][123091] Updated weights for policy 0, policy_version 478506 (0.0009) [2023-12-26 03:24:25,240][123090] Updated weights for policy 1, policy_version 475271 (0.0006) [2023-12-26 03:24:25,288][123090] Updated weights for policy 1, policy_version 475281 (0.0005) [2023-12-26 03:24:25,332][123090] Updated weights for policy 1, policy_version 475291 (0.0005) [2023-12-26 03:24:25,754][123091] Updated weights for policy 0, policy_version 478516 (0.0009) [2023-12-26 03:24:25,810][123091] Updated weights for policy 0, policy_version 478526 (0.0009) [2023-12-26 03:24:25,874][123091] Updated weights for policy 0, policy_version 478536 (0.0009) [2023-12-26 03:24:26,045][123090] Updated weights for policy 1, policy_version 475301 (0.0006) [2023-12-26 03:24:26,108][123090] Updated weights for policy 1, policy_version 475311 (0.0009) [2023-12-26 03:24:26,154][123090] Updated weights for policy 1, policy_version 475321 (0.0008) [2023-12-26 03:24:26,675][123091] Updated weights for policy 0, policy_version 478546 (0.0008) [2023-12-26 03:24:26,743][123091] Updated weights for policy 0, policy_version 478556 (0.0005) [2023-12-26 03:24:26,798][123091] Updated weights for policy 0, policy_version 478566 (0.0005) [2023-12-26 03:24:26,863][123091] Updated weights for policy 0, policy_version 478576 (0.0008) [2023-12-26 03:24:26,999][123090] Updated weights for policy 1, policy_version 475331 (0.0008) [2023-12-26 03:24:27,079][123090] Updated weights for policy 1, policy_version 475341 (0.0005) [2023-12-26 03:24:27,140][123090] Updated weights for policy 1, policy_version 475351 (0.0005) [2023-12-26 03:24:27,540][123091] Updated weights for policy 0, policy_version 478586 (0.0005) [2023-12-26 03:24:27,610][123091] Updated weights for policy 0, policy_version 478596 (0.0005) [2023-12-26 03:24:27,689][123091] Updated weights for policy 0, policy_version 478606 (0.0005) [2023-12-26 03:24:27,778][123090] Updated weights for policy 1, policy_version 475361 (0.0006) [2023-12-26 03:24:27,835][123090] Updated weights for policy 1, policy_version 475372 (0.0010) [2023-12-26 03:24:27,888][123090] Updated weights for policy 1, policy_version 475382 (0.0008) [2023-12-26 03:24:27,951][123090] Updated weights for policy 1, policy_version 475392 (0.0009) [2023-12-26 03:24:28,377][123091] Updated weights for policy 0, policy_version 478616 (0.0008) [2023-12-26 03:24:28,431][123091] Updated weights for policy 0, policy_version 478626 (0.0005) [2023-12-26 03:24:28,487][123091] Updated weights for policy 0, policy_version 478636 (0.0009) [2023-12-26 03:24:28,782][123090] Updated weights for policy 1, policy_version 475402 (0.0005) [2023-12-26 03:24:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 244236288. Throughput: 0: 8914.8, 1: 8827.5. Samples: 244231876. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:28,785][121949] Avg episode reward: [(0, '6241.358'), (1, '4724.092')] [2023-12-26 03:24:28,857][123090] Updated weights for policy 1, policy_version 475412 (0.0005) [2023-12-26 03:24:28,916][123090] Updated weights for policy 1, policy_version 475422 (0.0008) [2023-12-26 03:24:29,167][123091] Updated weights for policy 0, policy_version 478646 (0.0006) [2023-12-26 03:24:29,234][123091] Updated weights for policy 0, policy_version 478656 (0.0008) [2023-12-26 03:24:29,300][123091] Updated weights for policy 0, policy_version 478666 (0.0010) [2023-12-26 03:24:29,668][123090] Updated weights for policy 1, policy_version 475432 (0.0006) [2023-12-26 03:24:29,724][123090] Updated weights for policy 1, policy_version 475442 (0.0007) [2023-12-26 03:24:29,785][123090] Updated weights for policy 1, policy_version 475452 (0.0009) [2023-12-26 03:24:30,111][123091] Updated weights for policy 0, policy_version 478676 (0.0009) [2023-12-26 03:24:30,169][123091] Updated weights for policy 0, policy_version 478686 (0.0006) [2023-12-26 03:24:30,241][123091] Updated weights for policy 0, policy_version 478696 (0.0007) [2023-12-26 03:24:30,655][123090] Updated weights for policy 1, policy_version 475462 (0.0008) [2023-12-26 03:24:30,721][123090] Updated weights for policy 1, policy_version 475472 (0.0008) [2023-12-26 03:24:30,783][123090] Updated weights for policy 1, policy_version 475482 (0.0010) [2023-12-26 03:24:30,974][123091] Updated weights for policy 0, policy_version 478706 (0.0009) [2023-12-26 03:24:31,031][123091] Updated weights for policy 0, policy_version 478716 (0.0006) [2023-12-26 03:24:31,098][123091] Updated weights for policy 0, policy_version 478726 (0.0007) [2023-12-26 03:24:31,169][123091] Updated weights for policy 0, policy_version 478736 (0.0010) [2023-12-26 03:24:31,684][123090] Updated weights for policy 1, policy_version 475492 (0.0010) [2023-12-26 03:24:31,756][123090] Updated weights for policy 1, policy_version 475502 (0.0008) [2023-12-26 03:24:31,813][123091] Updated weights for policy 0, policy_version 478746 (0.0007) [2023-12-26 03:24:31,827][123090] Updated weights for policy 1, policy_version 475512 (0.0006) [2023-12-26 03:24:31,869][123091] Updated weights for policy 0, policy_version 478756 (0.0007) [2023-12-26 03:24:31,917][123091] Updated weights for policy 0, policy_version 478766 (0.0010) [2023-12-26 03:24:32,531][123090] Updated weights for policy 1, policy_version 475522 (0.0005) [2023-12-26 03:24:32,605][123090] Updated weights for policy 1, policy_version 475532 (0.0005) [2023-12-26 03:24:32,681][123090] Updated weights for policy 1, policy_version 475542 (0.0005) [2023-12-26 03:24:32,735][123091] Updated weights for policy 0, policy_version 478776 (0.0009) [2023-12-26 03:24:32,737][123090] Updated weights for policy 1, policy_version 475552 (0.0006) [2023-12-26 03:24:32,800][123091] Updated weights for policy 0, policy_version 478786 (0.0008) [2023-12-26 03:24:32,868][123091] Updated weights for policy 0, policy_version 478796 (0.0009) [2023-12-26 03:24:33,517][123090] Updated weights for policy 1, policy_version 475562 (0.0009) [2023-12-26 03:24:33,567][123091] Updated weights for policy 0, policy_version 478806 (0.0007) [2023-12-26 03:24:33,567][123090] Updated weights for policy 1, policy_version 475572 (0.0009) [2023-12-26 03:24:33,614][123091] Updated weights for policy 0, policy_version 478816 (0.0005) [2023-12-26 03:24:33,615][123090] Updated weights for policy 1, policy_version 475582 (0.0008) [2023-12-26 03:24:33,671][123091] Updated weights for policy 0, policy_version 478826 (0.0005) [2023-12-26 03:24:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 244334592. Throughput: 0: 8940.0, 1: 8844.3. Samples: 244340352. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:33,785][121949] Avg episode reward: [(0, '6270.975'), (1, '4670.783')] [2023-12-26 03:24:34,371][123091] Updated weights for policy 0, policy_version 478836 (0.0007) [2023-12-26 03:24:34,434][123091] Updated weights for policy 0, policy_version 478846 (0.0011) [2023-12-26 03:24:34,501][123091] Updated weights for policy 0, policy_version 478856 (0.0011) [2023-12-26 03:24:34,565][123090] Updated weights for policy 1, policy_version 475592 (0.0008) [2023-12-26 03:24:34,621][123090] Updated weights for policy 1, policy_version 475602 (0.0006) [2023-12-26 03:24:34,681][123090] Updated weights for policy 1, policy_version 475612 (0.0006) [2023-12-26 03:24:35,291][123091] Updated weights for policy 0, policy_version 478866 (0.0011) [2023-12-26 03:24:35,339][123091] Updated weights for policy 0, policy_version 478876 (0.0010) [2023-12-26 03:24:35,345][123090] Updated weights for policy 1, policy_version 475622 (0.0010) [2023-12-26 03:24:35,394][123091] Updated weights for policy 0, policy_version 478886 (0.0010) [2023-12-26 03:24:35,414][123090] Updated weights for policy 1, policy_version 475632 (0.0009) [2023-12-26 03:24:35,464][123091] Updated weights for policy 0, policy_version 478896 (0.0011) [2023-12-26 03:24:35,482][123090] Updated weights for policy 1, policy_version 475642 (0.0010) [2023-12-26 03:24:36,270][123091] Updated weights for policy 0, policy_version 478906 (0.0009) [2023-12-26 03:24:36,273][123090] Updated weights for policy 1, policy_version 475652 (0.0010) [2023-12-26 03:24:36,322][123091] Updated weights for policy 0, policy_version 478916 (0.0007) [2023-12-26 03:24:36,344][123090] Updated weights for policy 1, policy_version 475662 (0.0010) [2023-12-26 03:24:36,384][123091] Updated weights for policy 0, policy_version 478926 (0.0007) [2023-12-26 03:24:36,413][123090] Updated weights for policy 1, policy_version 475672 (0.0011) [2023-12-26 03:24:37,190][123090] Updated weights for policy 1, policy_version 475682 (0.0011) [2023-12-26 03:24:37,224][123091] Updated weights for policy 0, policy_version 478936 (0.0009) [2023-12-26 03:24:37,254][123090] Updated weights for policy 1, policy_version 475692 (0.0010) [2023-12-26 03:24:37,287][123091] Updated weights for policy 0, policy_version 478946 (0.0010) [2023-12-26 03:24:37,325][123090] Updated weights for policy 1, policy_version 475702 (0.0011) [2023-12-26 03:24:37,344][123091] Updated weights for policy 0, policy_version 478956 (0.0009) [2023-12-26 03:24:37,384][123090] Updated weights for policy 1, policy_version 475712 (0.0010) [2023-12-26 03:24:38,121][123091] Updated weights for policy 0, policy_version 478966 (0.0008) [2023-12-26 03:24:38,184][123091] Updated weights for policy 0, policy_version 478976 (0.0009) [2023-12-26 03:24:38,184][123090] Updated weights for policy 1, policy_version 475722 (0.0005) [2023-12-26 03:24:38,238][123090] Updated weights for policy 1, policy_version 475732 (0.0007) [2023-12-26 03:24:38,243][123091] Updated weights for policy 0, policy_version 478986 (0.0008) [2023-12-26 03:24:38,290][123090] Updated weights for policy 1, policy_version 475742 (0.0010) [2023-12-26 03:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 244416512. Throughput: 0: 8969.7, 1: 8877.6. Samples: 244393964. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:38,785][121949] Avg episode reward: [(0, '6184.035'), (1, '4728.536')] [2023-12-26 03:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000478992_122626048.pth... [2023-12-26 03:24:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000475744_121790464.pth... [2023-12-26 03:24:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000477968_122363904.pth [2023-12-26 03:24:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000474720_121528320.pth [2023-12-26 03:24:39,088][123090] Updated weights for policy 1, policy_version 475752 (0.0011) [2023-12-26 03:24:39,099][123091] Updated weights for policy 0, policy_version 478996 (0.0009) [2023-12-26 03:24:39,145][123090] Updated weights for policy 1, policy_version 475762 (0.0009) [2023-12-26 03:24:39,157][123091] Updated weights for policy 0, policy_version 479006 (0.0007) [2023-12-26 03:24:39,202][123090] Updated weights for policy 1, policy_version 475772 (0.0005) [2023-12-26 03:24:39,222][123091] Updated weights for policy 0, policy_version 479016 (0.0009) [2023-12-26 03:24:40,063][123091] Updated weights for policy 0, policy_version 479026 (0.0008) [2023-12-26 03:24:40,091][123090] Updated weights for policy 1, policy_version 475782 (0.0008) [2023-12-26 03:24:40,125][123091] Updated weights for policy 0, policy_version 479036 (0.0008) [2023-12-26 03:24:40,153][123090] Updated weights for policy 1, policy_version 475792 (0.0007) [2023-12-26 03:24:40,189][123091] Updated weights for policy 0, policy_version 479046 (0.0009) [2023-12-26 03:24:40,209][123090] Updated weights for policy 1, policy_version 475802 (0.0006) [2023-12-26 03:24:40,255][123091] Updated weights for policy 0, policy_version 479056 (0.0009) [2023-12-26 03:24:40,912][123090] Updated weights for policy 1, policy_version 475812 (0.0005) [2023-12-26 03:24:40,960][123090] Updated weights for policy 1, policy_version 475822 (0.0005) [2023-12-26 03:24:41,007][123091] Updated weights for policy 0, policy_version 479066 (0.0006) [2023-12-26 03:24:41,018][123090] Updated weights for policy 1, policy_version 475832 (0.0006) [2023-12-26 03:24:41,076][123091] Updated weights for policy 0, policy_version 479076 (0.0007) [2023-12-26 03:24:41,135][123091] Updated weights for policy 0, policy_version 479086 (0.0007) [2023-12-26 03:24:41,866][123090] Updated weights for policy 1, policy_version 475842 (0.0009) [2023-12-26 03:24:41,917][123090] Updated weights for policy 1, policy_version 475852 (0.0010) [2023-12-26 03:24:41,981][123090] Updated weights for policy 1, policy_version 475862 (0.0010) [2023-12-26 03:24:41,992][123091] Updated weights for policy 0, policy_version 479096 (0.0008) [2023-12-26 03:24:42,041][123090] Updated weights for policy 1, policy_version 475872 (0.0010) [2023-12-26 03:24:42,053][123091] Updated weights for policy 0, policy_version 479106 (0.0007) [2023-12-26 03:24:42,127][123091] Updated weights for policy 0, policy_version 479116 (0.0009) [2023-12-26 03:24:42,919][123090] Updated weights for policy 1, policy_version 475882 (0.0010) [2023-12-26 03:24:42,934][123091] Updated weights for policy 0, policy_version 479126 (0.0008) [2023-12-26 03:24:42,985][123090] Updated weights for policy 1, policy_version 475892 (0.0008) [2023-12-26 03:24:42,993][123091] Updated weights for policy 0, policy_version 479136 (0.0007) [2023-12-26 03:24:43,052][123090] Updated weights for policy 1, policy_version 475902 (0.0008) [2023-12-26 03:24:43,068][123091] Updated weights for policy 0, policy_version 479146 (0.0006) [2023-12-26 03:24:43,726][123091] Updated weights for policy 0, policy_version 479156 (0.0009) [2023-12-26 03:24:43,784][123090] Updated weights for policy 1, policy_version 475912 (0.0006) [2023-12-26 03:24:43,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 244498432. Throughput: 0: 8864.1, 1: 8817.0. Samples: 244497996. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:43,785][121949] Avg episode reward: [(0, '6009.379'), (1, '4502.119')] [2023-12-26 03:24:43,794][123091] Updated weights for policy 0, policy_version 479166 (0.0007) [2023-12-26 03:24:43,845][123091] Updated weights for policy 0, policy_version 479176 (0.0007) [2023-12-26 03:24:43,848][123090] Updated weights for policy 1, policy_version 475922 (0.0005) [2023-12-26 03:24:43,908][123090] Updated weights for policy 1, policy_version 475932 (0.0005) [2023-12-26 03:24:44,573][123090] Updated weights for policy 1, policy_version 475942 (0.0008) [2023-12-26 03:24:44,594][123091] Updated weights for policy 0, policy_version 479186 (0.0007) [2023-12-26 03:24:44,641][123090] Updated weights for policy 1, policy_version 475952 (0.0007) [2023-12-26 03:24:44,657][123091] Updated weights for policy 0, policy_version 479196 (0.0009) [2023-12-26 03:24:44,695][123090] Updated weights for policy 1, policy_version 475962 (0.0008) [2023-12-26 03:24:44,712][123091] Updated weights for policy 0, policy_version 479206 (0.0007) [2023-12-26 03:24:44,782][123091] Updated weights for policy 0, policy_version 479216 (0.0006) [2023-12-26 03:24:45,484][123091] Updated weights for policy 0, policy_version 479226 (0.0009) [2023-12-26 03:24:45,503][123090] Updated weights for policy 1, policy_version 475972 (0.0009) [2023-12-26 03:24:45,539][123091] Updated weights for policy 0, policy_version 479236 (0.0006) [2023-12-26 03:24:45,563][123090] Updated weights for policy 1, policy_version 475982 (0.0007) [2023-12-26 03:24:45,595][123091] Updated weights for policy 0, policy_version 479246 (0.0006) [2023-12-26 03:24:45,618][123090] Updated weights for policy 1, policy_version 475992 (0.0008) [2023-12-26 03:24:46,263][123091] Updated weights for policy 0, policy_version 479256 (0.0005) [2023-12-26 03:24:46,331][123091] Updated weights for policy 0, policy_version 479266 (0.0005) [2023-12-26 03:24:46,380][123091] Updated weights for policy 0, policy_version 479276 (0.0005) [2023-12-26 03:24:46,473][123090] Updated weights for policy 1, policy_version 476002 (0.0010) [2023-12-26 03:24:46,546][123090] Updated weights for policy 1, policy_version 476012 (0.0009) [2023-12-26 03:24:46,611][123090] Updated weights for policy 1, policy_version 476022 (0.0010) [2023-12-26 03:24:46,684][123090] Updated weights for policy 1, policy_version 476032 (0.0009) [2023-12-26 03:24:47,090][123091] Updated weights for policy 0, policy_version 479286 (0.0008) [2023-12-26 03:24:47,145][123091] Updated weights for policy 0, policy_version 479296 (0.0009) [2023-12-26 03:24:47,205][123091] Updated weights for policy 0, policy_version 479306 (0.0009) [2023-12-26 03:24:47,505][123090] Updated weights for policy 1, policy_version 476042 (0.0005) [2023-12-26 03:24:47,553][123090] Updated weights for policy 1, policy_version 476052 (0.0005) [2023-12-26 03:24:47,604][123090] Updated weights for policy 1, policy_version 476062 (0.0005) [2023-12-26 03:24:47,994][123091] Updated weights for policy 0, policy_version 479316 (0.0009) [2023-12-26 03:24:48,050][123091] Updated weights for policy 0, policy_version 479326 (0.0010) [2023-12-26 03:24:48,111][123091] Updated weights for policy 0, policy_version 479336 (0.0009) [2023-12-26 03:24:48,334][123090] Updated weights for policy 1, policy_version 476072 (0.0008) [2023-12-26 03:24:48,397][123090] Updated weights for policy 1, policy_version 476082 (0.0010) [2023-12-26 03:24:48,460][123090] Updated weights for policy 1, policy_version 476092 (0.0009) [2023-12-26 03:24:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 244596736. Throughput: 0: 8944.4, 1: 8797.8. Samples: 244608816. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:48,785][121949] Avg episode reward: [(0, '5977.720'), (1, '4509.507')] [2023-12-26 03:24:48,863][123091] Updated weights for policy 0, policy_version 479346 (0.0008) [2023-12-26 03:24:48,927][123091] Updated weights for policy 0, policy_version 479356 (0.0005) [2023-12-26 03:24:48,985][123091] Updated weights for policy 0, policy_version 479366 (0.0009) [2023-12-26 03:24:49,035][123091] Updated weights for policy 0, policy_version 479376 (0.0009) [2023-12-26 03:24:49,365][123090] Updated weights for policy 1, policy_version 476102 (0.0010) [2023-12-26 03:24:49,434][123090] Updated weights for policy 1, policy_version 476112 (0.0010) [2023-12-26 03:24:49,502][123090] Updated weights for policy 1, policy_version 476122 (0.0009) [2023-12-26 03:24:49,883][123091] Updated weights for policy 0, policy_version 479386 (0.0009) [2023-12-26 03:24:49,953][123091] Updated weights for policy 0, policy_version 479396 (0.0010) [2023-12-26 03:24:50,024][123091] Updated weights for policy 0, policy_version 479406 (0.0010) [2023-12-26 03:24:50,358][123090] Updated weights for policy 1, policy_version 476132 (0.0010) [2023-12-26 03:24:50,425][123090] Updated weights for policy 1, policy_version 476142 (0.0009) [2023-12-26 03:24:50,493][123090] Updated weights for policy 1, policy_version 476152 (0.0009) [2023-12-26 03:24:50,808][123091] Updated weights for policy 0, policy_version 479416 (0.0010) [2023-12-26 03:24:50,864][123091] Updated weights for policy 0, policy_version 479426 (0.0009) [2023-12-26 03:24:50,919][123091] Updated weights for policy 0, policy_version 479436 (0.0009) [2023-12-26 03:24:51,333][123090] Updated weights for policy 1, policy_version 476162 (0.0009) [2023-12-26 03:24:51,406][123090] Updated weights for policy 1, policy_version 476172 (0.0008) [2023-12-26 03:24:51,471][123090] Updated weights for policy 1, policy_version 476182 (0.0009) [2023-12-26 03:24:51,533][123090] Updated weights for policy 1, policy_version 476192 (0.0009) [2023-12-26 03:24:51,793][123091] Updated weights for policy 0, policy_version 479446 (0.0010) [2023-12-26 03:24:51,843][123091] Updated weights for policy 0, policy_version 479456 (0.0009) [2023-12-26 03:24:51,897][123091] Updated weights for policy 0, policy_version 479466 (0.0009) [2023-12-26 03:24:52,379][123090] Updated weights for policy 1, policy_version 476202 (0.0009) [2023-12-26 03:24:52,448][123090] Updated weights for policy 1, policy_version 476212 (0.0010) [2023-12-26 03:24:52,515][123090] Updated weights for policy 1, policy_version 476222 (0.0009) [2023-12-26 03:24:52,725][123091] Updated weights for policy 0, policy_version 479476 (0.0009) [2023-12-26 03:24:52,781][123091] Updated weights for policy 0, policy_version 479486 (0.0009) [2023-12-26 03:24:52,828][123091] Updated weights for policy 0, policy_version 479496 (0.0009) [2023-12-26 03:24:53,358][123090] Updated weights for policy 1, policy_version 476232 (0.0009) [2023-12-26 03:24:53,418][123090] Updated weights for policy 1, policy_version 476242 (0.0008) [2023-12-26 03:24:53,471][123090] Updated weights for policy 1, policy_version 476252 (0.0009) [2023-12-26 03:24:53,641][123091] Updated weights for policy 0, policy_version 479506 (0.0009) [2023-12-26 03:24:53,694][123091] Updated weights for policy 0, policy_version 479516 (0.0010) [2023-12-26 03:24:53,749][123091] Updated weights for policy 0, policy_version 479526 (0.0010) [2023-12-26 03:24:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 244678656. Throughput: 0: 8944.5, 1: 8729.8. Samples: 244659976. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:53,785][121949] Avg episode reward: [(0, '6094.221'), (1, '4921.921')] [2023-12-26 03:24:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000476256_121921536.pth... [2023-12-26 03:24:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000475232_121659392.pth [2023-12-26 03:24:53,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000479536_122765312.pth... [2023-12-26 03:24:53,803][123091] Updated weights for policy 0, policy_version 479536 (0.0009) [2023-12-26 03:24:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000478480_122494976.pth [2023-12-26 03:24:54,299][123090] Updated weights for policy 1, policy_version 476262 (0.0009) [2023-12-26 03:24:54,369][123090] Updated weights for policy 1, policy_version 476272 (0.0009) [2023-12-26 03:24:54,435][123090] Updated weights for policy 1, policy_version 476282 (0.0009) [2023-12-26 03:24:54,640][123091] Updated weights for policy 0, policy_version 479546 (0.0008) [2023-12-26 03:24:54,714][123091] Updated weights for policy 0, policy_version 479556 (0.0006) [2023-12-26 03:24:54,784][123091] Updated weights for policy 0, policy_version 479566 (0.0005) [2023-12-26 03:24:55,265][123090] Updated weights for policy 1, policy_version 476292 (0.0009) [2023-12-26 03:24:55,325][123090] Updated weights for policy 1, policy_version 476302 (0.0009) [2023-12-26 03:24:55,393][123090] Updated weights for policy 1, policy_version 476312 (0.0008) [2023-12-26 03:24:55,503][123091] Updated weights for policy 0, policy_version 479576 (0.0010) [2023-12-26 03:24:55,552][123091] Updated weights for policy 0, policy_version 479586 (0.0010) [2023-12-26 03:24:55,600][123091] Updated weights for policy 0, policy_version 479596 (0.0009) [2023-12-26 03:24:56,222][123090] Updated weights for policy 1, policy_version 476322 (0.0010) [2023-12-26 03:24:56,286][123090] Updated weights for policy 1, policy_version 476332 (0.0009) [2023-12-26 03:24:56,357][123090] Updated weights for policy 1, policy_version 476342 (0.0009) [2023-12-26 03:24:56,424][123090] Updated weights for policy 1, policy_version 476352 (0.0010) [2023-12-26 03:24:56,437][123091] Updated weights for policy 0, policy_version 479606 (0.0009) [2023-12-26 03:24:56,504][123091] Updated weights for policy 0, policy_version 479616 (0.0009) [2023-12-26 03:24:56,563][123091] Updated weights for policy 0, policy_version 479626 (0.0008) [2023-12-26 03:24:57,235][123090] Updated weights for policy 1, policy_version 476362 (0.0008) [2023-12-26 03:24:57,296][123090] Updated weights for policy 1, policy_version 476372 (0.0009) [2023-12-26 03:24:57,363][123090] Updated weights for policy 1, policy_version 476382 (0.0005) [2023-12-26 03:24:57,395][123091] Updated weights for policy 0, policy_version 479636 (0.0009) [2023-12-26 03:24:57,446][123091] Updated weights for policy 0, policy_version 479647 (0.0010) [2023-12-26 03:24:57,494][123091] Updated weights for policy 0, policy_version 479657 (0.0009) [2023-12-26 03:24:58,141][123090] Updated weights for policy 1, policy_version 476392 (0.0008) [2023-12-26 03:24:58,205][123090] Updated weights for policy 1, policy_version 476402 (0.0009) [2023-12-26 03:24:58,269][123090] Updated weights for policy 1, policy_version 476412 (0.0009) [2023-12-26 03:24:58,360][123091] Updated weights for policy 0, policy_version 479668 (0.0009) [2023-12-26 03:24:58,431][123091] Updated weights for policy 0, policy_version 479678 (0.0008) [2023-12-26 03:24:58,497][123091] Updated weights for policy 0, policy_version 479688 (0.0008) [2023-12-26 03:24:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 244768768. Throughput: 0: 8960.4, 1: 8738.6. Samples: 244762840. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:24:58,785][121949] Avg episode reward: [(0, '6104.269'), (1, '4982.430')] [2023-12-26 03:24:59,229][123090] Updated weights for policy 1, policy_version 476422 (0.0009) [2023-12-26 03:24:59,297][123090] Updated weights for policy 1, policy_version 476432 (0.0009) [2023-12-26 03:24:59,359][123091] Updated weights for policy 0, policy_version 479699 (0.0010) [2023-12-26 03:24:59,368][123090] Updated weights for policy 1, policy_version 476442 (0.0007) [2023-12-26 03:24:59,430][123091] Updated weights for policy 0, policy_version 479709 (0.0011) [2023-12-26 03:24:59,495][123091] Updated weights for policy 0, policy_version 479719 (0.0011) [2023-12-26 03:25:00,058][123090] Updated weights for policy 1, policy_version 476452 (0.0009) [2023-12-26 03:25:00,123][123090] Updated weights for policy 1, policy_version 476462 (0.0009) [2023-12-26 03:25:00,183][123090] Updated weights for policy 1, policy_version 476472 (0.0009) [2023-12-26 03:25:00,282][123091] Updated weights for policy 0, policy_version 479729 (0.0011) [2023-12-26 03:25:00,345][123091] Updated weights for policy 0, policy_version 479739 (0.0011) [2023-12-26 03:25:00,410][123091] Updated weights for policy 0, policy_version 479749 (0.0011) [2023-12-26 03:25:00,480][123091] Updated weights for policy 0, policy_version 479759 (0.0010) [2023-12-26 03:25:01,051][123090] Updated weights for policy 1, policy_version 476482 (0.0009) [2023-12-26 03:25:01,115][123090] Updated weights for policy 1, policy_version 476492 (0.0008) [2023-12-26 03:25:01,161][123091] Updated weights for policy 0, policy_version 479769 (0.0008) [2023-12-26 03:25:01,184][123090] Updated weights for policy 1, policy_version 476502 (0.0008) [2023-12-26 03:25:01,211][123091] Updated weights for policy 0, policy_version 479779 (0.0007) [2023-12-26 03:25:01,257][123090] Updated weights for policy 1, policy_version 476512 (0.0007) [2023-12-26 03:25:01,283][123091] Updated weights for policy 0, policy_version 479789 (0.0008) [2023-12-26 03:25:02,018][123091] Updated weights for policy 0, policy_version 479799 (0.0010) [2023-12-26 03:25:02,084][123090] Updated weights for policy 1, policy_version 476522 (0.0008) [2023-12-26 03:25:02,086][123091] Updated weights for policy 0, policy_version 479809 (0.0009) [2023-12-26 03:25:02,139][123091] Updated weights for policy 0, policy_version 479819 (0.0008) [2023-12-26 03:25:02,140][123090] Updated weights for policy 1, policy_version 476532 (0.0008) [2023-12-26 03:25:02,202][123090] Updated weights for policy 1, policy_version 476542 (0.0008) [2023-12-26 03:25:02,946][123091] Updated weights for policy 0, policy_version 479829 (0.0009) [2023-12-26 03:25:03,002][123091] Updated weights for policy 0, policy_version 479839 (0.0008) [2023-12-26 03:25:03,061][123091] Updated weights for policy 0, policy_version 479849 (0.0006) [2023-12-26 03:25:03,078][123090] Updated weights for policy 1, policy_version 476552 (0.0006) [2023-12-26 03:25:03,126][123090] Updated weights for policy 1, policy_version 476562 (0.0006) [2023-12-26 03:25:03,182][123090] Updated weights for policy 1, policy_version 476572 (0.0005) [2023-12-26 03:25:03,712][123091] Updated weights for policy 0, policy_version 479859 (0.0005) [2023-12-26 03:25:03,755][123091] Updated weights for policy 0, policy_version 479869 (0.0005) [2023-12-26 03:25:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 244850688. Throughput: 0: 9004.2, 1: 8666.6. Samples: 244867540. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:25:03,785][121949] Avg episode reward: [(0, '6170.873'), (1, '5041.755')] [2023-12-26 03:25:03,806][123091] Updated weights for policy 0, policy_version 479879 (0.0006) [2023-12-26 03:25:03,822][123090] Updated weights for policy 1, policy_version 476582 (0.0005) [2023-12-26 03:25:03,884][123090] Updated weights for policy 1, policy_version 476592 (0.0007) [2023-12-26 03:25:03,958][123090] Updated weights for policy 1, policy_version 476602 (0.0005) [2023-12-26 03:25:04,620][123091] Updated weights for policy 0, policy_version 479889 (0.0008) [2023-12-26 03:25:04,675][123091] Updated weights for policy 0, policy_version 479899 (0.0010) [2023-12-26 03:25:04,732][123091] Updated weights for policy 0, policy_version 479909 (0.0009) [2023-12-26 03:25:04,751][123090] Updated weights for policy 1, policy_version 476612 (0.0009) [2023-12-26 03:25:04,788][123091] Updated weights for policy 0, policy_version 479919 (0.0008) [2023-12-26 03:25:04,808][123090] Updated weights for policy 1, policy_version 476622 (0.0008) [2023-12-26 03:25:04,860][123090] Updated weights for policy 1, policy_version 476632 (0.0009) [2023-12-26 03:25:05,537][123091] Updated weights for policy 0, policy_version 479929 (0.0009) [2023-12-26 03:25:05,586][123091] Updated weights for policy 0, policy_version 479939 (0.0009) [2023-12-26 03:25:05,636][123091] Updated weights for policy 0, policy_version 479949 (0.0007) [2023-12-26 03:25:05,733][123090] Updated weights for policy 1, policy_version 476642 (0.0009) [2023-12-26 03:25:05,802][123090] Updated weights for policy 1, policy_version 476652 (0.0010) [2023-12-26 03:25:05,866][123090] Updated weights for policy 1, policy_version 476662 (0.0006) [2023-12-26 03:25:05,935][123090] Updated weights for policy 1, policy_version 476672 (0.0005) [2023-12-26 03:25:06,411][123091] Updated weights for policy 0, policy_version 479959 (0.0009) [2023-12-26 03:25:06,473][123091] Updated weights for policy 0, policy_version 479969 (0.0011) [2023-12-26 03:25:06,544][123091] Updated weights for policy 0, policy_version 479979 (0.0011) [2023-12-26 03:25:06,627][123090] Updated weights for policy 1, policy_version 476682 (0.0007) [2023-12-26 03:25:06,684][123090] Updated weights for policy 1, policy_version 476692 (0.0009) [2023-12-26 03:25:06,742][123090] Updated weights for policy 1, policy_version 476702 (0.0009) [2023-12-26 03:25:07,360][123091] Updated weights for policy 0, policy_version 479989 (0.0011) [2023-12-26 03:25:07,415][123091] Updated weights for policy 0, policy_version 479999 (0.0010) [2023-12-26 03:25:07,468][123091] Updated weights for policy 0, policy_version 480009 (0.0009) [2023-12-26 03:25:07,608][123090] Updated weights for policy 1, policy_version 476712 (0.0010) [2023-12-26 03:25:07,661][123090] Updated weights for policy 1, policy_version 476722 (0.0010) [2023-12-26 03:25:07,724][123090] Updated weights for policy 1, policy_version 476732 (0.0008) [2023-12-26 03:25:08,381][123091] Updated weights for policy 0, policy_version 480019 (0.0008) [2023-12-26 03:25:08,425][123090] Updated weights for policy 1, policy_version 476742 (0.0006) [2023-12-26 03:25:08,442][123091] Updated weights for policy 0, policy_version 480029 (0.0008) [2023-12-26 03:25:08,491][123090] Updated weights for policy 1, policy_version 476752 (0.0006) [2023-12-26 03:25:08,492][123091] Updated weights for policy 0, policy_version 480039 (0.0009) [2023-12-26 03:25:08,564][123090] Updated weights for policy 1, policy_version 476762 (0.0006) [2023-12-26 03:25:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 244948992. Throughput: 0: 9011.3, 1: 8701.1. Samples: 244921952. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:25:08,785][121949] Avg episode reward: [(0, '6120.916'), (1, '4919.378')] [2023-12-26 03:25:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000476768_122052608.pth... [2023-12-26 03:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000480048_122896384.pth... [2023-12-26 03:25:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000475744_121790464.pth [2023-12-26 03:25:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000478992_122626048.pth [2023-12-26 03:25:09,284][123090] Updated weights for policy 1, policy_version 476772 (0.0007) [2023-12-26 03:25:09,329][123091] Updated weights for policy 0, policy_version 480049 (0.0006) [2023-12-26 03:25:09,343][123090] Updated weights for policy 1, policy_version 476782 (0.0010) [2023-12-26 03:25:09,408][123091] Updated weights for policy 0, policy_version 480059 (0.0008) [2023-12-26 03:25:09,417][123090] Updated weights for policy 1, policy_version 476792 (0.0009) [2023-12-26 03:25:09,478][123091] Updated weights for policy 0, policy_version 480069 (0.0008) [2023-12-26 03:25:09,544][123091] Updated weights for policy 0, policy_version 480079 (0.0010) [2023-12-26 03:25:10,265][123090] Updated weights for policy 1, policy_version 476802 (0.0008) [2023-12-26 03:25:10,316][123091] Updated weights for policy 0, policy_version 480089 (0.0008) [2023-12-26 03:25:10,333][123090] Updated weights for policy 1, policy_version 476812 (0.0011) [2023-12-26 03:25:10,383][123091] Updated weights for policy 0, policy_version 480099 (0.0011) [2023-12-26 03:25:10,399][123090] Updated weights for policy 1, policy_version 476822 (0.0007) [2023-12-26 03:25:10,449][123091] Updated weights for policy 0, policy_version 480109 (0.0010) [2023-12-26 03:25:10,470][123090] Updated weights for policy 1, policy_version 476832 (0.0006) [2023-12-26 03:25:11,099][123090] Updated weights for policy 1, policy_version 476842 (0.0008) [2023-12-26 03:25:11,163][123090] Updated weights for policy 1, policy_version 476852 (0.0008) [2023-12-26 03:25:11,228][123090] Updated weights for policy 1, policy_version 476862 (0.0010) [2023-12-26 03:25:11,229][123091] Updated weights for policy 0, policy_version 480119 (0.0010) [2023-12-26 03:25:11,294][123091] Updated weights for policy 0, policy_version 480129 (0.0011) [2023-12-26 03:25:11,364][123091] Updated weights for policy 0, policy_version 480139 (0.0010) [2023-12-26 03:25:12,069][123090] Updated weights for policy 1, policy_version 476872 (0.0007) [2023-12-26 03:25:12,132][123090] Updated weights for policy 1, policy_version 476882 (0.0010) [2023-12-26 03:25:12,194][123090] Updated weights for policy 1, policy_version 476892 (0.0008) [2023-12-26 03:25:12,200][123091] Updated weights for policy 0, policy_version 480149 (0.0010) [2023-12-26 03:25:12,274][123091] Updated weights for policy 0, policy_version 480159 (0.0009) [2023-12-26 03:25:12,346][123091] Updated weights for policy 0, policy_version 480169 (0.0010) [2023-12-26 03:25:12,901][123090] Updated weights for policy 1, policy_version 476902 (0.0007) [2023-12-26 03:25:12,969][123090] Updated weights for policy 1, policy_version 476912 (0.0006) [2023-12-26 03:25:13,031][123090] Updated weights for policy 1, policy_version 476922 (0.0005) [2023-12-26 03:25:13,121][123091] Updated weights for policy 0, policy_version 480179 (0.0009) [2023-12-26 03:25:13,174][123091] Updated weights for policy 0, policy_version 480189 (0.0009) [2023-12-26 03:25:13,236][123091] Updated weights for policy 0, policy_version 480199 (0.0009) [2023-12-26 03:25:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 245030912. Throughput: 0: 8973.9, 1: 8688.0. Samples: 245026660. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:25:13,785][121949] Avg episode reward: [(0, '6156.986'), (1, '5068.724')] [2023-12-26 03:25:13,796][123090] Updated weights for policy 1, policy_version 476932 (0.0009) [2023-12-26 03:25:13,855][123090] Updated weights for policy 1, policy_version 476942 (0.0010) [2023-12-26 03:25:13,911][123090] Updated weights for policy 1, policy_version 476952 (0.0010) [2023-12-26 03:25:14,088][123091] Updated weights for policy 0, policy_version 480209 (0.0010) [2023-12-26 03:25:14,145][123091] Updated weights for policy 0, policy_version 480219 (0.0009) [2023-12-26 03:25:14,212][123091] Updated weights for policy 0, policy_version 480229 (0.0009) [2023-12-26 03:25:14,276][123091] Updated weights for policy 0, policy_version 480239 (0.0009) [2023-12-26 03:25:14,763][123090] Updated weights for policy 1, policy_version 476962 (0.0011) [2023-12-26 03:25:14,835][123090] Updated weights for policy 1, policy_version 476972 (0.0011) [2023-12-26 03:25:14,901][123090] Updated weights for policy 1, policy_version 476982 (0.0010) [2023-12-26 03:25:14,965][123090] Updated weights for policy 1, policy_version 476992 (0.0010) [2023-12-26 03:25:15,110][123091] Updated weights for policy 0, policy_version 480249 (0.0009) [2023-12-26 03:25:15,183][123091] Updated weights for policy 0, policy_version 480259 (0.0009) [2023-12-26 03:25:15,248][123091] Updated weights for policy 0, policy_version 480269 (0.0009) [2023-12-26 03:25:15,759][123090] Updated weights for policy 1, policy_version 477002 (0.0011) [2023-12-26 03:25:15,825][123090] Updated weights for policy 1, policy_version 477012 (0.0007) [2023-12-26 03:25:15,889][123090] Updated weights for policy 1, policy_version 477022 (0.0011) [2023-12-26 03:25:16,104][123091] Updated weights for policy 0, policy_version 480279 (0.0009) [2023-12-26 03:25:16,154][123091] Updated weights for policy 0, policy_version 480289 (0.0009) [2023-12-26 03:25:16,202][123091] Updated weights for policy 0, policy_version 480299 (0.0008) [2023-12-26 03:25:16,619][123090] Updated weights for policy 1, policy_version 477032 (0.0006) [2023-12-26 03:25:16,682][123090] Updated weights for policy 1, policy_version 477042 (0.0005) [2023-12-26 03:25:16,745][123090] Updated weights for policy 1, policy_version 477052 (0.0005) [2023-12-26 03:25:17,108][123091] Updated weights for policy 0, policy_version 480309 (0.0009) [2023-12-26 03:25:17,162][123091] Updated weights for policy 0, policy_version 480319 (0.0010) [2023-12-26 03:25:17,216][123091] Updated weights for policy 0, policy_version 480329 (0.0010) [2023-12-26 03:25:17,452][123090] Updated weights for policy 1, policy_version 477062 (0.0007) [2023-12-26 03:25:17,500][123090] Updated weights for policy 1, policy_version 477072 (0.0005) [2023-12-26 03:25:17,554][123090] Updated weights for policy 1, policy_version 477082 (0.0005) [2023-12-26 03:25:18,094][123091] Updated weights for policy 0, policy_version 480339 (0.0009) [2023-12-26 03:25:18,143][123091] Updated weights for policy 0, policy_version 480349 (0.0009) [2023-12-26 03:25:18,191][123090] Updated weights for policy 1, policy_version 477092 (0.0007) [2023-12-26 03:25:18,198][123091] Updated weights for policy 0, policy_version 480359 (0.0008) [2023-12-26 03:25:18,246][123090] Updated weights for policy 1, policy_version 477102 (0.0010) [2023-12-26 03:25:18,313][123090] Updated weights for policy 1, policy_version 477112 (0.0010) [2023-12-26 03:25:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 245121024. Throughput: 0: 8833.3, 1: 8780.3. Samples: 245132960. Policy #0 lag: (min: 15.0, avg: 26.4, max: 47.0) [2023-12-26 03:25:18,784][121949] Avg episode reward: [(0, '6054.133'), (1, '4951.346')] [2023-12-26 03:25:18,995][123091] Updated weights for policy 0, policy_version 480369 (0.0006) [2023-12-26 03:25:19,051][123091] Updated weights for policy 0, policy_version 480379 (0.0006) [2023-12-26 03:25:19,098][123091] Updated weights for policy 0, policy_version 480389 (0.0005) [2023-12-26 03:25:19,151][123090] Updated weights for policy 1, policy_version 477122 (0.0011) [2023-12-26 03:25:19,151][123091] Updated weights for policy 0, policy_version 480399 (0.0005) [2023-12-26 03:25:19,213][123090] Updated weights for policy 1, policy_version 477132 (0.0010) [2023-12-26 03:25:19,290][123090] Updated weights for policy 1, policy_version 477142 (0.0011) [2023-12-26 03:25:19,365][123090] Updated weights for policy 1, policy_version 477152 (0.0012) [2023-12-26 03:25:19,956][123091] Updated weights for policy 0, policy_version 480409 (0.0008) [2023-12-26 03:25:20,024][123091] Updated weights for policy 0, policy_version 480419 (0.0010) [2023-12-26 03:25:20,079][123091] Updated weights for policy 0, policy_version 480429 (0.0010) [2023-12-26 03:25:20,149][123090] Updated weights for policy 1, policy_version 477162 (0.0011) [2023-12-26 03:25:20,214][123090] Updated weights for policy 1, policy_version 477172 (0.0011) [2023-12-26 03:25:20,272][123090] Updated weights for policy 1, policy_version 477182 (0.0006) [2023-12-26 03:25:20,956][123091] Updated weights for policy 0, policy_version 480439 (0.0010) [2023-12-26 03:25:21,018][123091] Updated weights for policy 0, policy_version 480449 (0.0009) [2023-12-26 03:25:21,087][123091] Updated weights for policy 0, policy_version 480459 (0.0009) [2023-12-26 03:25:21,126][123090] Updated weights for policy 1, policy_version 477192 (0.0009) [2023-12-26 03:25:21,179][123090] Updated weights for policy 1, policy_version 477202 (0.0010) [2023-12-26 03:25:21,231][123090] Updated weights for policy 1, policy_version 477212 (0.0010) [2023-12-26 03:25:21,853][123091] Updated weights for policy 0, policy_version 480469 (0.0007) [2023-12-26 03:25:21,925][123091] Updated weights for policy 0, policy_version 480479 (0.0006) [2023-12-26 03:25:21,996][123091] Updated weights for policy 0, policy_version 480489 (0.0008) [2023-12-26 03:25:22,101][123090] Updated weights for policy 1, policy_version 477222 (0.0011) [2023-12-26 03:25:22,173][123090] Updated weights for policy 1, policy_version 477232 (0.0011) [2023-12-26 03:25:22,239][123090] Updated weights for policy 1, policy_version 477242 (0.0011) [2023-12-26 03:25:22,797][123091] Updated weights for policy 0, policy_version 480499 (0.0008) [2023-12-26 03:25:22,859][123091] Updated weights for policy 0, policy_version 480509 (0.0011) [2023-12-26 03:25:22,930][123091] Updated weights for policy 0, policy_version 480519 (0.0007) [2023-12-26 03:25:23,056][123090] Updated weights for policy 1, policy_version 477252 (0.0011) [2023-12-26 03:25:23,113][123090] Updated weights for policy 1, policy_version 477262 (0.0011) [2023-12-26 03:25:23,183][123090] Updated weights for policy 1, policy_version 477272 (0.0010) [2023-12-26 03:25:23,602][123091] Updated weights for policy 0, policy_version 480529 (0.0006) [2023-12-26 03:25:23,658][123091] Updated weights for policy 0, policy_version 480539 (0.0006) [2023-12-26 03:25:23,714][123091] Updated weights for policy 0, policy_version 480549 (0.0008) [2023-12-26 03:25:23,765][123091] Updated weights for policy 0, policy_version 480559 (0.0010) [2023-12-26 03:25:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 245211136. Throughput: 0: 8792.9, 1: 8773.1. Samples: 245184440. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:23,785][121949] Avg episode reward: [(0, '6039.559'), (1, '5059.511')] [2023-12-26 03:25:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000480560_123027456.pth... [2023-12-26 03:25:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000477280_122183680.pth... [2023-12-26 03:25:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000479536_122765312.pth [2023-12-26 03:25:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000476256_121921536.pth [2023-12-26 03:25:23,833][123090] Updated weights for policy 1, policy_version 477282 (0.0010) [2023-12-26 03:25:23,886][123090] Updated weights for policy 1, policy_version 477292 (0.0009) [2023-12-26 03:25:23,939][123090] Updated weights for policy 1, policy_version 477302 (0.0009) [2023-12-26 03:25:23,987][123090] Updated weights for policy 1, policy_version 477312 (0.0009) [2023-12-26 03:25:24,509][123091] Updated weights for policy 0, policy_version 480569 (0.0010) [2023-12-26 03:25:24,560][123091] Updated weights for policy 0, policy_version 480579 (0.0010) [2023-12-26 03:25:24,623][123091] Updated weights for policy 0, policy_version 480589 (0.0010) [2023-12-26 03:25:24,875][123090] Updated weights for policy 1, policy_version 477322 (0.0009) [2023-12-26 03:25:24,939][123090] Updated weights for policy 1, policy_version 477332 (0.0009) [2023-12-26 03:25:25,001][123090] Updated weights for policy 1, policy_version 477342 (0.0009) [2023-12-26 03:25:25,426][123091] Updated weights for policy 0, policy_version 480599 (0.0009) [2023-12-26 03:25:25,486][123091] Updated weights for policy 0, policy_version 480609 (0.0005) [2023-12-26 03:25:25,548][123091] Updated weights for policy 0, policy_version 480619 (0.0006) [2023-12-26 03:25:25,837][123090] Updated weights for policy 1, policy_version 477352 (0.0008) [2023-12-26 03:25:25,896][123090] Updated weights for policy 1, policy_version 477362 (0.0006) [2023-12-26 03:25:25,944][123090] Updated weights for policy 1, policy_version 477372 (0.0008) [2023-12-26 03:25:26,303][123091] Updated weights for policy 0, policy_version 480629 (0.0008) [2023-12-26 03:25:26,361][123091] Updated weights for policy 0, policy_version 480639 (0.0005) [2023-12-26 03:25:26,410][123091] Updated weights for policy 0, policy_version 480649 (0.0005) [2023-12-26 03:25:26,881][123090] Updated weights for policy 1, policy_version 477382 (0.0007) [2023-12-26 03:25:26,948][123090] Updated weights for policy 1, policy_version 477392 (0.0008) [2023-12-26 03:25:26,992][123091] Updated weights for policy 0, policy_version 480659 (0.0006) [2023-12-26 03:25:26,998][123090] Updated weights for policy 1, policy_version 477402 (0.0009) [2023-12-26 03:25:27,055][123091] Updated weights for policy 0, policy_version 480669 (0.0007) [2023-12-26 03:25:27,121][123091] Updated weights for policy 0, policy_version 480679 (0.0011) [2023-12-26 03:25:27,728][123091] Updated weights for policy 0, policy_version 480689 (0.0010) [2023-12-26 03:25:27,792][123091] Updated weights for policy 0, policy_version 480699 (0.0006) [2023-12-26 03:25:27,851][123091] Updated weights for policy 0, policy_version 480709 (0.0011) [2023-12-26 03:25:27,894][123090] Updated weights for policy 1, policy_version 477412 (0.0009) [2023-12-26 03:25:27,910][123091] Updated weights for policy 0, policy_version 480719 (0.0011) [2023-12-26 03:25:27,944][123090] Updated weights for policy 1, policy_version 477422 (0.0007) [2023-12-26 03:25:27,997][123090] Updated weights for policy 1, policy_version 477432 (0.0009) [2023-12-26 03:25:28,700][123091] Updated weights for policy 0, policy_version 480729 (0.0011) [2023-12-26 03:25:28,752][123091] Updated weights for policy 0, policy_version 480739 (0.0010) [2023-12-26 03:25:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 245293056. Throughput: 0: 8940.1, 1: 8724.8. Samples: 245292912. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:28,784][121949] Avg episode reward: [(0, '6129.145'), (1, '5191.813')] [2023-12-26 03:25:28,807][123091] Updated weights for policy 0, policy_version 480749 (0.0011) [2023-12-26 03:25:28,831][123090] Updated weights for policy 1, policy_version 477442 (0.0009) [2023-12-26 03:25:28,883][123090] Updated weights for policy 1, policy_version 477452 (0.0008) [2023-12-26 03:25:28,932][123090] Updated weights for policy 1, policy_version 477462 (0.0009) [2023-12-26 03:25:28,993][123090] Updated weights for policy 1, policy_version 477472 (0.0009) [2023-12-26 03:25:29,618][123091] Updated weights for policy 0, policy_version 480759 (0.0009) [2023-12-26 03:25:29,682][123091] Updated weights for policy 0, policy_version 480769 (0.0005) [2023-12-26 03:25:29,751][123091] Updated weights for policy 0, policy_version 480779 (0.0008) [2023-12-26 03:25:29,911][123090] Updated weights for policy 1, policy_version 477482 (0.0009) [2023-12-26 03:25:29,986][123090] Updated weights for policy 1, policy_version 477492 (0.0009) [2023-12-26 03:25:30,053][123090] Updated weights for policy 1, policy_version 477502 (0.0009) [2023-12-26 03:25:30,459][123091] Updated weights for policy 0, policy_version 480789 (0.0007) [2023-12-26 03:25:30,528][123091] Updated weights for policy 0, policy_version 480799 (0.0006) [2023-12-26 03:25:30,585][123091] Updated weights for policy 0, policy_version 480809 (0.0005) [2023-12-26 03:25:30,792][123090] Updated weights for policy 1, policy_version 477512 (0.0006) [2023-12-26 03:25:30,850][123090] Updated weights for policy 1, policy_version 477522 (0.0005) [2023-12-26 03:25:30,905][123090] Updated weights for policy 1, policy_version 477532 (0.0009) [2023-12-26 03:25:31,263][123091] Updated weights for policy 0, policy_version 480819 (0.0007) [2023-12-26 03:25:31,327][123091] Updated weights for policy 0, policy_version 480829 (0.0011) [2023-12-26 03:25:31,398][123091] Updated weights for policy 0, policy_version 480839 (0.0011) [2023-12-26 03:25:31,679][123090] Updated weights for policy 1, policy_version 477542 (0.0007) [2023-12-26 03:25:31,759][123090] Updated weights for policy 1, policy_version 477552 (0.0007) [2023-12-26 03:25:31,819][123090] Updated weights for policy 1, policy_version 477562 (0.0006) [2023-12-26 03:25:32,115][123091] Updated weights for policy 0, policy_version 480849 (0.0008) [2023-12-26 03:25:32,183][123091] Updated weights for policy 0, policy_version 480859 (0.0007) [2023-12-26 03:25:32,256][123091] Updated weights for policy 0, policy_version 480869 (0.0008) [2023-12-26 03:25:32,320][123091] Updated weights for policy 0, policy_version 480879 (0.0011) [2023-12-26 03:25:32,523][123090] Updated weights for policy 1, policy_version 477572 (0.0005) [2023-12-26 03:25:32,590][123090] Updated weights for policy 1, policy_version 477582 (0.0007) [2023-12-26 03:25:32,645][123090] Updated weights for policy 1, policy_version 477592 (0.0007) [2023-12-26 03:25:33,173][123091] Updated weights for policy 0, policy_version 480890 (0.0010) [2023-12-26 03:25:33,232][123091] Updated weights for policy 0, policy_version 480902 (0.0011) [2023-12-26 03:25:33,283][123091] Updated weights for policy 0, policy_version 480912 (0.0009) [2023-12-26 03:25:33,305][123090] Updated weights for policy 1, policy_version 477602 (0.0009) [2023-12-26 03:25:33,356][123090] Updated weights for policy 1, policy_version 477612 (0.0007) [2023-12-26 03:25:33,411][123090] Updated weights for policy 1, policy_version 477622 (0.0010) [2023-12-26 03:25:33,472][123090] Updated weights for policy 1, policy_version 477632 (0.0010) [2023-12-26 03:25:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 245391360. Throughput: 0: 8882.2, 1: 8751.8. Samples: 245402348. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:33,785][121949] Avg episode reward: [(0, '5960.371'), (1, '5239.899')] [2023-12-26 03:25:34,079][123091] Updated weights for policy 0, policy_version 480923 (0.0008) [2023-12-26 03:25:34,143][123091] Updated weights for policy 0, policy_version 480933 (0.0010) [2023-12-26 03:25:34,205][123091] Updated weights for policy 0, policy_version 480943 (0.0009) [2023-12-26 03:25:34,216][123090] Updated weights for policy 1, policy_version 477642 (0.0007) [2023-12-26 03:25:34,270][123090] Updated weights for policy 1, policy_version 477652 (0.0009) [2023-12-26 03:25:34,345][123090] Updated weights for policy 1, policy_version 477662 (0.0008) [2023-12-26 03:25:34,945][123091] Updated weights for policy 0, policy_version 480953 (0.0005) [2023-12-26 03:25:35,018][123091] Updated weights for policy 0, policy_version 480963 (0.0005) [2023-12-26 03:25:35,070][123091] Updated weights for policy 0, policy_version 480973 (0.0005) [2023-12-26 03:25:35,248][123090] Updated weights for policy 1, policy_version 477672 (0.0009) [2023-12-26 03:25:35,300][123090] Updated weights for policy 1, policy_version 477682 (0.0009) [2023-12-26 03:25:35,352][123090] Updated weights for policy 1, policy_version 477693 (0.0010) [2023-12-26 03:25:35,581][123091] Updated weights for policy 0, policy_version 480983 (0.0006) [2023-12-26 03:25:35,627][123091] Updated weights for policy 0, policy_version 480993 (0.0005) [2023-12-26 03:25:35,673][123091] Updated weights for policy 0, policy_version 481003 (0.0005) [2023-12-26 03:25:36,282][123090] Updated weights for policy 1, policy_version 477703 (0.0010) [2023-12-26 03:25:36,357][123090] Updated weights for policy 1, policy_version 477713 (0.0009) [2023-12-26 03:25:36,420][123090] Updated weights for policy 1, policy_version 477723 (0.0008) [2023-12-26 03:25:36,429][123091] Updated weights for policy 0, policy_version 481013 (0.0008) [2023-12-26 03:25:36,490][123091] Updated weights for policy 0, policy_version 481023 (0.0009) [2023-12-26 03:25:36,562][123091] Updated weights for policy 0, policy_version 481033 (0.0008) [2023-12-26 03:25:37,251][123091] Updated weights for policy 0, policy_version 481043 (0.0009) [2023-12-26 03:25:37,293][123090] Updated weights for policy 1, policy_version 477733 (0.0010) [2023-12-26 03:25:37,313][123091] Updated weights for policy 0, policy_version 481053 (0.0008) [2023-12-26 03:25:37,359][123090] Updated weights for policy 1, policy_version 477743 (0.0009) [2023-12-26 03:25:37,364][123091] Updated weights for policy 0, policy_version 481063 (0.0009) [2023-12-26 03:25:37,421][123090] Updated weights for policy 1, policy_version 477753 (0.0008) [2023-12-26 03:25:38,175][123091] Updated weights for policy 0, policy_version 481073 (0.0009) [2023-12-26 03:25:38,227][123091] Updated weights for policy 0, policy_version 481083 (0.0009) [2023-12-26 03:25:38,248][123090] Updated weights for policy 1, policy_version 477763 (0.0008) [2023-12-26 03:25:38,283][123091] Updated weights for policy 0, policy_version 481093 (0.0009) [2023-12-26 03:25:38,301][123090] Updated weights for policy 1, policy_version 477773 (0.0005) [2023-12-26 03:25:38,344][123091] Updated weights for policy 0, policy_version 481103 (0.0009) [2023-12-26 03:25:38,375][123090] Updated weights for policy 1, policy_version 477783 (0.0008) [2023-12-26 03:25:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 245481472. Throughput: 0: 8972.3, 1: 8746.8. Samples: 245457332. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:38,785][121949] Avg episode reward: [(0, '6094.007'), (1, '5262.250')] [2023-12-26 03:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000481104_123166720.pth... [2023-12-26 03:25:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000477792_122314752.pth... [2023-12-26 03:25:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000480048_122896384.pth [2023-12-26 03:25:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000476768_122052608.pth [2023-12-26 03:25:39,174][123090] Updated weights for policy 1, policy_version 477793 (0.0008) [2023-12-26 03:25:39,192][123091] Updated weights for policy 0, policy_version 481113 (0.0011) [2023-12-26 03:25:39,245][123090] Updated weights for policy 1, policy_version 477803 (0.0007) [2023-12-26 03:25:39,260][123091] Updated weights for policy 0, policy_version 481123 (0.0010) [2023-12-26 03:25:39,307][123090] Updated weights for policy 1, policy_version 477813 (0.0008) [2023-12-26 03:25:39,312][123091] Updated weights for policy 0, policy_version 481133 (0.0010) [2023-12-26 03:25:39,368][123090] Updated weights for policy 1, policy_version 477823 (0.0008) [2023-12-26 03:25:40,172][123090] Updated weights for policy 1, policy_version 477833 (0.0008) [2023-12-26 03:25:40,223][123091] Updated weights for policy 0, policy_version 481143 (0.0008) [2023-12-26 03:25:40,232][123090] Updated weights for policy 1, policy_version 477843 (0.0008) [2023-12-26 03:25:40,272][123091] Updated weights for policy 0, policy_version 481153 (0.0008) [2023-12-26 03:25:40,280][123090] Updated weights for policy 1, policy_version 477853 (0.0008) [2023-12-26 03:25:40,327][123091] Updated weights for policy 0, policy_version 481163 (0.0009) [2023-12-26 03:25:41,108][123090] Updated weights for policy 1, policy_version 477863 (0.0010) [2023-12-26 03:25:41,178][123090] Updated weights for policy 1, policy_version 477873 (0.0010) [2023-12-26 03:25:41,205][123091] Updated weights for policy 0, policy_version 481173 (0.0010) [2023-12-26 03:25:41,241][123090] Updated weights for policy 1, policy_version 477883 (0.0009) [2023-12-26 03:25:41,263][123091] Updated weights for policy 0, policy_version 481183 (0.0008) [2023-12-26 03:25:41,331][123091] Updated weights for policy 0, policy_version 481193 (0.0008) [2023-12-26 03:25:42,105][123090] Updated weights for policy 1, policy_version 477893 (0.0009) [2023-12-26 03:25:42,156][123090] Updated weights for policy 1, policy_version 477903 (0.0010) [2023-12-26 03:25:42,206][123090] Updated weights for policy 1, policy_version 477913 (0.0009) [2023-12-26 03:25:42,213][123091] Updated weights for policy 0, policy_version 481203 (0.0008) [2023-12-26 03:25:42,276][123091] Updated weights for policy 0, policy_version 481213 (0.0009) [2023-12-26 03:25:42,340][123091] Updated weights for policy 0, policy_version 481223 (0.0010) [2023-12-26 03:25:43,060][123090] Updated weights for policy 1, policy_version 477923 (0.0008) [2023-12-26 03:25:43,124][123090] Updated weights for policy 1, policy_version 477933 (0.0009) [2023-12-26 03:25:43,192][123090] Updated weights for policy 1, policy_version 477943 (0.0010) [2023-12-26 03:25:43,195][123091] Updated weights for policy 0, policy_version 481233 (0.0009) [2023-12-26 03:25:43,250][123091] Updated weights for policy 0, policy_version 481243 (0.0008) [2023-12-26 03:25:43,302][123091] Updated weights for policy 0, policy_version 481253 (0.0009) [2023-12-26 03:25:43,351][123091] Updated weights for policy 0, policy_version 481263 (0.0009) [2023-12-26 03:25:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 245563392. Throughput: 0: 8957.2, 1: 8729.0. Samples: 245558720. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:43,785][121949] Avg episode reward: [(0, '6189.900'), (1, '5193.448')] [2023-12-26 03:25:43,963][123090] Updated weights for policy 1, policy_version 477953 (0.0008) [2023-12-26 03:25:44,038][123090] Updated weights for policy 1, policy_version 477963 (0.0006) [2023-12-26 03:25:44,101][123090] Updated weights for policy 1, policy_version 477973 (0.0006) [2023-12-26 03:25:44,172][123090] Updated weights for policy 1, policy_version 477983 (0.0007) [2023-12-26 03:25:44,202][123091] Updated weights for policy 0, policy_version 481273 (0.0007) [2023-12-26 03:25:44,263][123091] Updated weights for policy 0, policy_version 481283 (0.0010) [2023-12-26 03:25:44,320][123091] Updated weights for policy 0, policy_version 481293 (0.0009) [2023-12-26 03:25:44,793][123090] Updated weights for policy 1, policy_version 477993 (0.0008) [2023-12-26 03:25:44,858][123090] Updated weights for policy 1, policy_version 478003 (0.0007) [2023-12-26 03:25:44,924][123090] Updated weights for policy 1, policy_version 478013 (0.0010) [2023-12-26 03:25:45,199][123091] Updated weights for policy 0, policy_version 481303 (0.0010) [2023-12-26 03:25:45,268][123091] Updated weights for policy 0, policy_version 481313 (0.0009) [2023-12-26 03:25:45,331][123091] Updated weights for policy 0, policy_version 481323 (0.0009) [2023-12-26 03:25:45,703][123090] Updated weights for policy 1, policy_version 478023 (0.0009) [2023-12-26 03:25:45,767][123090] Updated weights for policy 1, policy_version 478033 (0.0007) [2023-12-26 03:25:45,815][123090] Updated weights for policy 1, policy_version 478043 (0.0005) [2023-12-26 03:25:46,220][123091] Updated weights for policy 0, policy_version 481333 (0.0010) [2023-12-26 03:25:46,273][123091] Updated weights for policy 0, policy_version 481343 (0.0010) [2023-12-26 03:25:46,325][123091] Updated weights for policy 0, policy_version 481354 (0.0010) [2023-12-26 03:25:46,502][123090] Updated weights for policy 1, policy_version 478053 (0.0005) [2023-12-26 03:25:46,559][123090] Updated weights for policy 1, policy_version 478063 (0.0007) [2023-12-26 03:25:46,610][123090] Updated weights for policy 1, policy_version 478073 (0.0010) [2023-12-26 03:25:47,064][123091] Updated weights for policy 0, policy_version 481364 (0.0009) [2023-12-26 03:25:47,130][123091] Updated weights for policy 0, policy_version 481374 (0.0005) [2023-12-26 03:25:47,194][123091] Updated weights for policy 0, policy_version 481384 (0.0005) [2023-12-26 03:25:47,359][123090] Updated weights for policy 1, policy_version 478083 (0.0010) [2023-12-26 03:25:47,418][123090] Updated weights for policy 1, policy_version 478093 (0.0010) [2023-12-26 03:25:47,470][123090] Updated weights for policy 1, policy_version 478103 (0.0010) [2023-12-26 03:25:47,800][123091] Updated weights for policy 0, policy_version 481394 (0.0005) [2023-12-26 03:25:47,868][123091] Updated weights for policy 0, policy_version 481404 (0.0005) [2023-12-26 03:25:47,934][123091] Updated weights for policy 0, policy_version 481414 (0.0005) [2023-12-26 03:25:47,988][123091] Updated weights for policy 0, policy_version 481424 (0.0005) [2023-12-26 03:25:48,282][123090] Updated weights for policy 1, policy_version 478113 (0.0010) [2023-12-26 03:25:48,346][123090] Updated weights for policy 1, policy_version 478123 (0.0007) [2023-12-26 03:25:48,419][123090] Updated weights for policy 1, policy_version 478133 (0.0011) [2023-12-26 03:25:48,488][123090] Updated weights for policy 1, policy_version 478143 (0.0011) [2023-12-26 03:25:48,715][123091] Updated weights for policy 0, policy_version 481434 (0.0005) [2023-12-26 03:25:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 245653504. Throughput: 0: 8937.3, 1: 8852.9. Samples: 245668096. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:48,785][121949] Avg episode reward: [(0, '6015.877'), (1, '5194.761')] [2023-12-26 03:25:48,788][123091] Updated weights for policy 0, policy_version 481444 (0.0005) [2023-12-26 03:25:48,853][123091] Updated weights for policy 0, policy_version 481454 (0.0007) [2023-12-26 03:25:49,217][123090] Updated weights for policy 1, policy_version 478153 (0.0008) [2023-12-26 03:25:49,289][123090] Updated weights for policy 1, policy_version 478163 (0.0010) [2023-12-26 03:25:49,354][123090] Updated weights for policy 1, policy_version 478173 (0.0011) [2023-12-26 03:25:49,548][123091] Updated weights for policy 0, policy_version 481464 (0.0009) [2023-12-26 03:25:49,616][123091] Updated weights for policy 0, policy_version 481474 (0.0008) [2023-12-26 03:25:49,682][123091] Updated weights for policy 0, policy_version 481484 (0.0011) [2023-12-26 03:25:50,206][123090] Updated weights for policy 1, policy_version 478183 (0.0009) [2023-12-26 03:25:50,279][123090] Updated weights for policy 1, policy_version 478193 (0.0006) [2023-12-26 03:25:50,351][123090] Updated weights for policy 1, policy_version 478203 (0.0006) [2023-12-26 03:25:50,477][123091] Updated weights for policy 0, policy_version 481494 (0.0011) [2023-12-26 03:25:50,540][123091] Updated weights for policy 0, policy_version 481504 (0.0011) [2023-12-26 03:25:50,612][123091] Updated weights for policy 0, policy_version 481514 (0.0011) [2023-12-26 03:25:51,137][123090] Updated weights for policy 1, policy_version 478213 (0.0007) [2023-12-26 03:25:51,201][123090] Updated weights for policy 1, policy_version 478223 (0.0006) [2023-12-26 03:25:51,257][123090] Updated weights for policy 1, policy_version 478233 (0.0008) [2023-12-26 03:25:51,442][123091] Updated weights for policy 0, policy_version 481524 (0.0009) [2023-12-26 03:25:51,517][123091] Updated weights for policy 0, policy_version 481534 (0.0008) [2023-12-26 03:25:51,579][123091] Updated weights for policy 0, policy_version 481544 (0.0009) [2023-12-26 03:25:52,040][123090] Updated weights for policy 1, policy_version 478243 (0.0006) [2023-12-26 03:25:52,094][123090] Updated weights for policy 1, policy_version 478253 (0.0008) [2023-12-26 03:25:52,159][123090] Updated weights for policy 1, policy_version 478263 (0.0007) [2023-12-26 03:25:52,301][123091] Updated weights for policy 0, policy_version 481554 (0.0009) [2023-12-26 03:25:52,376][123091] Updated weights for policy 0, policy_version 481564 (0.0009) [2023-12-26 03:25:52,440][123091] Updated weights for policy 0, policy_version 481574 (0.0009) [2023-12-26 03:25:52,496][123091] Updated weights for policy 0, policy_version 481584 (0.0009) [2023-12-26 03:25:52,930][123090] Updated weights for policy 1, policy_version 478273 (0.0006) [2023-12-26 03:25:52,988][123090] Updated weights for policy 1, policy_version 478283 (0.0008) [2023-12-26 03:25:53,036][123090] Updated weights for policy 1, policy_version 478293 (0.0008) [2023-12-26 03:25:53,087][123090] Updated weights for policy 1, policy_version 478303 (0.0008) [2023-12-26 03:25:53,333][123091] Updated weights for policy 0, policy_version 481594 (0.0005) [2023-12-26 03:25:53,387][123091] Updated weights for policy 0, policy_version 481604 (0.0005) [2023-12-26 03:25:53,445][123091] Updated weights for policy 0, policy_version 481614 (0.0006) [2023-12-26 03:25:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 245743616. Throughput: 0: 8913.4, 1: 8845.7. Samples: 245721112. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:53,785][121949] Avg episode reward: [(0, '5974.577'), (1, '5375.607')] [2023-12-26 03:25:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000481616_123297792.pth... [2023-12-26 03:25:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000480560_123027456.pth [2023-12-26 03:25:53,829][123090] Updated weights for policy 1, policy_version 478313 (0.0006) [2023-12-26 03:25:53,884][123090] Updated weights for policy 1, policy_version 478323 (0.0006) [2023-12-26 03:25:53,952][123090] Updated weights for policy 1, policy_version 478333 (0.0006) [2023-12-26 03:25:53,970][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000478336_122454016.pth... [2023-12-26 03:25:53,974][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000477280_122183680.pth [2023-12-26 03:25:54,125][123091] Updated weights for policy 0, policy_version 481624 (0.0007) [2023-12-26 03:25:54,176][123091] Updated weights for policy 0, policy_version 481635 (0.0008) [2023-12-26 03:25:54,226][123091] Updated weights for policy 0, policy_version 481645 (0.0010) [2023-12-26 03:25:54,629][123090] Updated weights for policy 1, policy_version 478343 (0.0008) [2023-12-26 03:25:54,679][123090] Updated weights for policy 1, policy_version 478353 (0.0008) [2023-12-26 03:25:54,727][123090] Updated weights for policy 1, policy_version 478363 (0.0006) [2023-12-26 03:25:55,079][123091] Updated weights for policy 0, policy_version 481655 (0.0009) [2023-12-26 03:25:55,145][123091] Updated weights for policy 0, policy_version 481665 (0.0008) [2023-12-26 03:25:55,204][123091] Updated weights for policy 0, policy_version 481675 (0.0008) [2023-12-26 03:25:55,567][123090] Updated weights for policy 1, policy_version 478373 (0.0006) [2023-12-26 03:25:55,641][123090] Updated weights for policy 1, policy_version 478383 (0.0005) [2023-12-26 03:25:55,701][123090] Updated weights for policy 1, policy_version 478393 (0.0009) [2023-12-26 03:25:55,910][123091] Updated weights for policy 0, policy_version 481685 (0.0008) [2023-12-26 03:25:55,961][123091] Updated weights for policy 0, policy_version 481695 (0.0007) [2023-12-26 03:25:56,011][123091] Updated weights for policy 0, policy_version 481705 (0.0005) [2023-12-26 03:25:56,481][123090] Updated weights for policy 1, policy_version 478403 (0.0008) [2023-12-26 03:25:56,538][123090] Updated weights for policy 1, policy_version 478413 (0.0005) [2023-12-26 03:25:56,586][123090] Updated weights for policy 1, policy_version 478423 (0.0005) [2023-12-26 03:25:56,705][123091] Updated weights for policy 0, policy_version 481715 (0.0005) [2023-12-26 03:25:56,751][123091] Updated weights for policy 0, policy_version 481725 (0.0005) [2023-12-26 03:25:56,798][123091] Updated weights for policy 0, policy_version 481735 (0.0005) [2023-12-26 03:25:57,230][123090] Updated weights for policy 1, policy_version 478433 (0.0005) [2023-12-26 03:25:57,288][123090] Updated weights for policy 1, policy_version 478443 (0.0005) [2023-12-26 03:25:57,345][123090] Updated weights for policy 1, policy_version 478453 (0.0005) [2023-12-26 03:25:57,389][123090] Updated weights for policy 1, policy_version 478463 (0.0005) [2023-12-26 03:25:57,501][123091] Updated weights for policy 0, policy_version 481745 (0.0006) [2023-12-26 03:25:57,562][123091] Updated weights for policy 0, policy_version 481755 (0.0010) [2023-12-26 03:25:57,628][123091] Updated weights for policy 0, policy_version 481765 (0.0010) [2023-12-26 03:25:57,683][123091] Updated weights for policy 0, policy_version 481775 (0.0010) [2023-12-26 03:25:58,117][123090] Updated weights for policy 1, policy_version 478473 (0.0008) [2023-12-26 03:25:58,176][123090] Updated weights for policy 1, policy_version 478483 (0.0009) [2023-12-26 03:25:58,225][123090] Updated weights for policy 1, policy_version 478493 (0.0006) [2023-12-26 03:25:58,513][123091] Updated weights for policy 0, policy_version 481785 (0.0008) [2023-12-26 03:25:58,583][123091] Updated weights for policy 0, policy_version 481795 (0.0008) [2023-12-26 03:25:58,655][123091] Updated weights for policy 0, policy_version 481805 (0.0010) [2023-12-26 03:25:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 245841920. Throughput: 0: 9029.1, 1: 8910.8. Samples: 245833952. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:25:58,785][121949] Avg episode reward: [(0, '5891.606'), (1, '5310.970')] [2023-12-26 03:25:59,115][123090] Updated weights for policy 1, policy_version 478503 (0.0008) [2023-12-26 03:25:59,166][123090] Updated weights for policy 1, policy_version 478513 (0.0008) [2023-12-26 03:25:59,218][123090] Updated weights for policy 1, policy_version 478523 (0.0009) [2023-12-26 03:25:59,573][123091] Updated weights for policy 0, policy_version 481815 (0.0009) [2023-12-26 03:25:59,632][123091] Updated weights for policy 0, policy_version 481825 (0.0010) [2023-12-26 03:25:59,695][123091] Updated weights for policy 0, policy_version 481835 (0.0011) [2023-12-26 03:26:00,039][123090] Updated weights for policy 1, policy_version 478533 (0.0009) [2023-12-26 03:26:00,083][123090] Updated weights for policy 1, policy_version 478543 (0.0009) [2023-12-26 03:26:00,150][123090] Updated weights for policy 1, policy_version 478553 (0.0010) [2023-12-26 03:26:00,503][123091] Updated weights for policy 0, policy_version 481845 (0.0008) [2023-12-26 03:26:00,564][123091] Updated weights for policy 0, policy_version 481855 (0.0005) [2023-12-26 03:26:00,622][123091] Updated weights for policy 0, policy_version 481865 (0.0005) [2023-12-26 03:26:00,948][123090] Updated weights for policy 1, policy_version 478563 (0.0009) [2023-12-26 03:26:00,997][123090] Updated weights for policy 1, policy_version 478573 (0.0005) [2023-12-26 03:26:01,063][123090] Updated weights for policy 1, policy_version 478583 (0.0007) [2023-12-26 03:26:01,395][123091] Updated weights for policy 0, policy_version 481875 (0.0007) [2023-12-26 03:26:01,464][123091] Updated weights for policy 0, policy_version 481885 (0.0011) [2023-12-26 03:26:01,534][123091] Updated weights for policy 0, policy_version 481895 (0.0011) [2023-12-26 03:26:01,918][123090] Updated weights for policy 1, policy_version 478593 (0.0008) [2023-12-26 03:26:01,967][123090] Updated weights for policy 1, policy_version 478603 (0.0010) [2023-12-26 03:26:02,019][123090] Updated weights for policy 1, policy_version 478613 (0.0010) [2023-12-26 03:26:02,070][123090] Updated weights for policy 1, policy_version 478623 (0.0010) [2023-12-26 03:26:02,312][123091] Updated weights for policy 0, policy_version 481905 (0.0010) [2023-12-26 03:26:02,383][123091] Updated weights for policy 0, policy_version 481915 (0.0010) [2023-12-26 03:26:02,438][123091] Updated weights for policy 0, policy_version 481925 (0.0010) [2023-12-26 03:26:02,492][123091] Updated weights for policy 0, policy_version 481935 (0.0010) [2023-12-26 03:26:02,837][123090] Updated weights for policy 1, policy_version 478633 (0.0009) [2023-12-26 03:26:02,899][123090] Updated weights for policy 1, policy_version 478643 (0.0008) [2023-12-26 03:26:02,960][123090] Updated weights for policy 1, policy_version 478653 (0.0008) [2023-12-26 03:26:03,319][123091] Updated weights for policy 0, policy_version 481945 (0.0010) [2023-12-26 03:26:03,367][123091] Updated weights for policy 0, policy_version 481955 (0.0010) [2023-12-26 03:26:03,414][123091] Updated weights for policy 0, policy_version 481965 (0.0010) [2023-12-26 03:26:03,763][123090] Updated weights for policy 1, policy_version 478663 (0.0008) [2023-12-26 03:26:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 245923840. Throughput: 0: 9058.1, 1: 8831.0. Samples: 245937972. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:03,784][121949] Avg episode reward: [(0, '5914.377'), (1, '5179.645')] [2023-12-26 03:26:03,827][123090] Updated weights for policy 1, policy_version 478673 (0.0009) [2023-12-26 03:26:03,892][123090] Updated weights for policy 1, policy_version 478683 (0.0009) [2023-12-26 03:26:04,274][123091] Updated weights for policy 0, policy_version 481975 (0.0011) [2023-12-26 03:26:04,327][123091] Updated weights for policy 0, policy_version 481985 (0.0011) [2023-12-26 03:26:04,379][123091] Updated weights for policy 0, policy_version 481995 (0.0011) [2023-12-26 03:26:04,710][123090] Updated weights for policy 1, policy_version 478693 (0.0009) [2023-12-26 03:26:04,772][123090] Updated weights for policy 1, policy_version 478703 (0.0008) [2023-12-26 03:26:04,843][123090] Updated weights for policy 1, policy_version 478713 (0.0010) [2023-12-26 03:26:05,156][123091] Updated weights for policy 0, policy_version 482005 (0.0008) [2023-12-26 03:26:05,217][123091] Updated weights for policy 0, policy_version 482015 (0.0005) [2023-12-26 03:26:05,280][123091] Updated weights for policy 0, policy_version 482025 (0.0006) [2023-12-26 03:26:05,592][123090] Updated weights for policy 1, policy_version 478723 (0.0008) [2023-12-26 03:26:05,653][123090] Updated weights for policy 1, policy_version 478733 (0.0005) [2023-12-26 03:26:05,712][123090] Updated weights for policy 1, policy_version 478743 (0.0005) [2023-12-26 03:26:05,945][123091] Updated weights for policy 0, policy_version 482035 (0.0009) [2023-12-26 03:26:05,990][123091] Updated weights for policy 0, policy_version 482045 (0.0005) [2023-12-26 03:26:06,055][123091] Updated weights for policy 0, policy_version 482055 (0.0006) [2023-12-26 03:26:06,411][123090] Updated weights for policy 1, policy_version 478753 (0.0006) [2023-12-26 03:26:06,468][123090] Updated weights for policy 1, policy_version 478763 (0.0009) [2023-12-26 03:26:06,521][123090] Updated weights for policy 1, policy_version 478773 (0.0008) [2023-12-26 03:26:06,586][123090] Updated weights for policy 1, policy_version 478783 (0.0009) [2023-12-26 03:26:06,760][123091] Updated weights for policy 0, policy_version 482065 (0.0008) [2023-12-26 03:26:06,823][123091] Updated weights for policy 0, policy_version 482075 (0.0005) [2023-12-26 03:26:06,875][123091] Updated weights for policy 0, policy_version 482085 (0.0005) [2023-12-26 03:26:06,922][123091] Updated weights for policy 0, policy_version 482095 (0.0005) [2023-12-26 03:26:07,522][123090] Updated weights for policy 1, policy_version 478793 (0.0008) [2023-12-26 03:26:07,541][123091] Updated weights for policy 0, policy_version 482105 (0.0005) [2023-12-26 03:26:07,582][123090] Updated weights for policy 1, policy_version 478803 (0.0008) [2023-12-26 03:26:07,607][123091] Updated weights for policy 0, policy_version 482115 (0.0007) [2023-12-26 03:26:07,646][123090] Updated weights for policy 1, policy_version 478813 (0.0010) [2023-12-26 03:26:07,673][123091] Updated weights for policy 0, policy_version 482125 (0.0011) [2023-12-26 03:26:08,397][123091] Updated weights for policy 0, policy_version 482135 (0.0011) [2023-12-26 03:26:08,467][123091] Updated weights for policy 0, policy_version 482145 (0.0009) [2023-12-26 03:26:08,527][123090] Updated weights for policy 1, policy_version 478823 (0.0008) [2023-12-26 03:26:08,533][123091] Updated weights for policy 0, policy_version 482155 (0.0005) [2023-12-26 03:26:08,590][123090] Updated weights for policy 1, policy_version 478833 (0.0010) [2023-12-26 03:26:08,654][123090] Updated weights for policy 1, policy_version 478843 (0.0011) [2023-12-26 03:26:08,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.7, 300 sec: 17772.5). Total num frames: 246022144. Throughput: 0: 9112.7, 1: 8847.7. Samples: 245992660. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:08,786][121949] Avg episode reward: [(0, '5901.089'), (1, '5282.377')] [2023-12-26 03:26:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000478848_122585088.pth... [2023-12-26 03:26:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000482160_123437056.pth... [2023-12-26 03:26:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000477792_122314752.pth [2023-12-26 03:26:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000481104_123166720.pth [2023-12-26 03:26:09,219][123091] Updated weights for policy 0, policy_version 482165 (0.0008) [2023-12-26 03:26:09,290][123091] Updated weights for policy 0, policy_version 482176 (0.0008) [2023-12-26 03:26:09,363][123091] Updated weights for policy 0, policy_version 482186 (0.0008) [2023-12-26 03:26:09,516][123090] Updated weights for policy 1, policy_version 478853 (0.0010) [2023-12-26 03:26:09,573][123090] Updated weights for policy 1, policy_version 478863 (0.0010) [2023-12-26 03:26:09,638][123090] Updated weights for policy 1, policy_version 478873 (0.0009) [2023-12-26 03:26:10,138][123091] Updated weights for policy 0, policy_version 482196 (0.0009) [2023-12-26 03:26:10,202][123091] Updated weights for policy 0, policy_version 482206 (0.0008) [2023-12-26 03:26:10,258][123091] Updated weights for policy 0, policy_version 482216 (0.0008) [2023-12-26 03:26:10,491][123090] Updated weights for policy 1, policy_version 478883 (0.0008) [2023-12-26 03:26:10,562][123090] Updated weights for policy 1, policy_version 478893 (0.0007) [2023-12-26 03:26:10,632][123090] Updated weights for policy 1, policy_version 478903 (0.0010) [2023-12-26 03:26:11,128][123091] Updated weights for policy 0, policy_version 482226 (0.0009) [2023-12-26 03:26:11,206][123091] Updated weights for policy 0, policy_version 482236 (0.0009) [2023-12-26 03:26:11,279][123091] Updated weights for policy 0, policy_version 482246 (0.0008) [2023-12-26 03:26:11,354][123091] Updated weights for policy 0, policy_version 482256 (0.0006) [2023-12-26 03:26:11,442][123090] Updated weights for policy 1, policy_version 478913 (0.0009) [2023-12-26 03:26:11,508][123090] Updated weights for policy 1, policy_version 478923 (0.0008) [2023-12-26 03:26:11,568][123090] Updated weights for policy 1, policy_version 478933 (0.0010) [2023-12-26 03:26:11,636][123090] Updated weights for policy 1, policy_version 478943 (0.0009) [2023-12-26 03:26:12,161][123091] Updated weights for policy 0, policy_version 482266 (0.0010) [2023-12-26 03:26:12,225][123091] Updated weights for policy 0, policy_version 482276 (0.0009) [2023-12-26 03:26:12,283][123091] Updated weights for policy 0, policy_version 482286 (0.0009) [2023-12-26 03:26:12,492][123090] Updated weights for policy 1, policy_version 478953 (0.0009) [2023-12-26 03:26:12,561][123090] Updated weights for policy 1, policy_version 478963 (0.0009) [2023-12-26 03:26:12,613][123090] Updated weights for policy 1, policy_version 478974 (0.0010) [2023-12-26 03:26:13,033][123091] Updated weights for policy 0, policy_version 482296 (0.0010) [2023-12-26 03:26:13,094][123091] Updated weights for policy 0, policy_version 482306 (0.0010) [2023-12-26 03:26:13,148][123091] Updated weights for policy 0, policy_version 482316 (0.0009) [2023-12-26 03:26:13,429][123090] Updated weights for policy 1, policy_version 478984 (0.0009) [2023-12-26 03:26:13,492][123090] Updated weights for policy 1, policy_version 478994 (0.0009) [2023-12-26 03:26:13,543][123090] Updated weights for policy 1, policy_version 479004 (0.0009) [2023-12-26 03:26:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 246104064. Throughput: 0: 9054.4, 1: 8816.0. Samples: 246097080. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:13,785][121949] Avg episode reward: [(0, '5957.913'), (1, '5471.364')] [2023-12-26 03:26:14,007][123091] Updated weights for policy 0, policy_version 482326 (0.0010) [2023-12-26 03:26:14,068][123091] Updated weights for policy 0, policy_version 482336 (0.0009) [2023-12-26 03:26:14,135][123091] Updated weights for policy 0, policy_version 482346 (0.0009) [2023-12-26 03:26:14,320][123090] Updated weights for policy 1, policy_version 479014 (0.0010) [2023-12-26 03:26:14,373][123090] Updated weights for policy 1, policy_version 479024 (0.0010) [2023-12-26 03:26:14,427][123090] Updated weights for policy 1, policy_version 479034 (0.0010) [2023-12-26 03:26:14,977][123091] Updated weights for policy 0, policy_version 482356 (0.0009) [2023-12-26 03:26:15,051][123091] Updated weights for policy 0, policy_version 482366 (0.0009) [2023-12-26 03:26:15,124][123091] Updated weights for policy 0, policy_version 482376 (0.0009) [2023-12-26 03:26:15,288][123090] Updated weights for policy 1, policy_version 479044 (0.0010) [2023-12-26 03:26:15,336][123090] Updated weights for policy 1, policy_version 479054 (0.0010) [2023-12-26 03:26:15,391][123090] Updated weights for policy 1, policy_version 479064 (0.0010) [2023-12-26 03:26:15,885][123091] Updated weights for policy 0, policy_version 482386 (0.0007) [2023-12-26 03:26:15,945][123091] Updated weights for policy 0, policy_version 482396 (0.0010) [2023-12-26 03:26:16,000][123091] Updated weights for policy 0, policy_version 482406 (0.0010) [2023-12-26 03:26:16,062][123091] Updated weights for policy 0, policy_version 482416 (0.0010) [2023-12-26 03:26:16,189][123090] Updated weights for policy 1, policy_version 479074 (0.0010) [2023-12-26 03:26:16,253][123090] Updated weights for policy 1, policy_version 479084 (0.0011) [2023-12-26 03:26:16,317][123090] Updated weights for policy 1, policy_version 479094 (0.0008) [2023-12-26 03:26:16,386][123090] Updated weights for policy 1, policy_version 479104 (0.0006) [2023-12-26 03:26:16,835][123091] Updated weights for policy 0, policy_version 482426 (0.0011) [2023-12-26 03:26:16,902][123091] Updated weights for policy 0, policy_version 482436 (0.0008) [2023-12-26 03:26:16,961][123091] Updated weights for policy 0, policy_version 482446 (0.0010) [2023-12-26 03:26:17,061][123090] Updated weights for policy 1, policy_version 479114 (0.0005) [2023-12-26 03:26:17,122][123090] Updated weights for policy 1, policy_version 479124 (0.0005) [2023-12-26 03:26:17,198][123090] Updated weights for policy 1, policy_version 479134 (0.0005) [2023-12-26 03:26:17,621][123091] Updated weights for policy 0, policy_version 482456 (0.0010) [2023-12-26 03:26:17,681][123091] Updated weights for policy 0, policy_version 482466 (0.0006) [2023-12-26 03:26:17,741][123091] Updated weights for policy 0, policy_version 482476 (0.0008) [2023-12-26 03:26:17,832][123090] Updated weights for policy 1, policy_version 479144 (0.0005) [2023-12-26 03:26:17,912][123090] Updated weights for policy 1, policy_version 479154 (0.0005) [2023-12-26 03:26:17,987][123090] Updated weights for policy 1, policy_version 479164 (0.0005) [2023-12-26 03:26:18,556][123091] Updated weights for policy 0, policy_version 482486 (0.0011) [2023-12-26 03:26:18,623][123091] Updated weights for policy 0, policy_version 482496 (0.0011) [2023-12-26 03:26:18,685][123091] Updated weights for policy 0, policy_version 482506 (0.0011) [2023-12-26 03:26:18,722][123090] Updated weights for policy 1, policy_version 479174 (0.0010) [2023-12-26 03:26:18,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 246194176. Throughput: 0: 9014.0, 1: 8847.7. Samples: 246206120. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:18,784][121949] Avg episode reward: [(0, '6062.371'), (1, '5566.916')] [2023-12-26 03:26:18,790][123090] Updated weights for policy 1, policy_version 479184 (0.0010) [2023-12-26 03:26:18,854][123090] Updated weights for policy 1, policy_version 479194 (0.0010) [2023-12-26 03:26:19,393][123091] Updated weights for policy 0, policy_version 482516 (0.0011) [2023-12-26 03:26:19,462][123091] Updated weights for policy 0, policy_version 482526 (0.0008) [2023-12-26 03:26:19,534][123091] Updated weights for policy 0, policy_version 482536 (0.0010) [2023-12-26 03:26:19,705][123090] Updated weights for policy 1, policy_version 479204 (0.0011) [2023-12-26 03:26:19,770][123090] Updated weights for policy 1, policy_version 479214 (0.0011) [2023-12-26 03:26:19,851][123090] Updated weights for policy 1, policy_version 479224 (0.0010) [2023-12-26 03:26:20,377][123091] Updated weights for policy 0, policy_version 482546 (0.0010) [2023-12-26 03:26:20,441][123091] Updated weights for policy 0, policy_version 482556 (0.0009) [2023-12-26 03:26:20,505][123091] Updated weights for policy 0, policy_version 482566 (0.0009) [2023-12-26 03:26:20,558][123091] Updated weights for policy 0, policy_version 482576 (0.0009) [2023-12-26 03:26:20,683][123090] Updated weights for policy 1, policy_version 479234 (0.0011) [2023-12-26 03:26:20,752][123090] Updated weights for policy 1, policy_version 479244 (0.0011) [2023-12-26 03:26:20,814][123090] Updated weights for policy 1, policy_version 479254 (0.0011) [2023-12-26 03:26:20,879][123090] Updated weights for policy 1, policy_version 479264 (0.0011) [2023-12-26 03:26:21,468][123091] Updated weights for policy 0, policy_version 482586 (0.0010) [2023-12-26 03:26:21,522][123091] Updated weights for policy 0, policy_version 482596 (0.0010) [2023-12-26 03:26:21,589][123091] Updated weights for policy 0, policy_version 482606 (0.0009) [2023-12-26 03:26:21,596][123090] Updated weights for policy 1, policy_version 479274 (0.0006) [2023-12-26 03:26:21,666][123090] Updated weights for policy 1, policy_version 479284 (0.0009) [2023-12-26 03:26:21,735][123090] Updated weights for policy 1, policy_version 479294 (0.0010) [2023-12-26 03:26:22,551][123091] Updated weights for policy 0, policy_version 482616 (0.0010) [2023-12-26 03:26:22,562][123090] Updated weights for policy 1, policy_version 479304 (0.0011) [2023-12-26 03:26:22,618][123091] Updated weights for policy 0, policy_version 482626 (0.0008) [2023-12-26 03:26:22,619][123090] Updated weights for policy 1, policy_version 479314 (0.0010) [2023-12-26 03:26:22,670][123090] Updated weights for policy 1, policy_version 479324 (0.0006) [2023-12-26 03:26:22,688][123091] Updated weights for policy 0, policy_version 482636 (0.0006) [2023-12-26 03:26:23,296][123091] Updated weights for policy 0, policy_version 482646 (0.0006) [2023-12-26 03:26:23,345][123091] Updated weights for policy 0, policy_version 482656 (0.0010) [2023-12-26 03:26:23,379][123090] Updated weights for policy 1, policy_version 479334 (0.0008) [2023-12-26 03:26:23,396][123091] Updated weights for policy 0, policy_version 482666 (0.0010) [2023-12-26 03:26:23,431][123090] Updated weights for policy 1, policy_version 479344 (0.0010) [2023-12-26 03:26:23,482][123090] Updated weights for policy 1, policy_version 479354 (0.0010) [2023-12-26 03:26:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 246284288. Throughput: 0: 8897.6, 1: 8868.7. Samples: 246256816. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:23,785][121949] Avg episode reward: [(0, '6090.829'), (1, '5515.558')] [2023-12-26 03:26:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000482672_123568128.pth... [2023-12-26 03:26:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000479360_122716160.pth... [2023-12-26 03:26:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000481616_123297792.pth [2023-12-26 03:26:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000478336_122454016.pth [2023-12-26 03:26:24,057][123091] Updated weights for policy 0, policy_version 482676 (0.0010) [2023-12-26 03:26:24,108][123091] Updated weights for policy 0, policy_version 482686 (0.0010) [2023-12-26 03:26:24,162][123091] Updated weights for policy 0, policy_version 482696 (0.0010) [2023-12-26 03:26:24,328][123090] Updated weights for policy 1, policy_version 479364 (0.0008) [2023-12-26 03:26:24,389][123090] Updated weights for policy 1, policy_version 479374 (0.0005) [2023-12-26 03:26:24,462][123090] Updated weights for policy 1, policy_version 479384 (0.0005) [2023-12-26 03:26:24,903][123091] Updated weights for policy 0, policy_version 482706 (0.0009) [2023-12-26 03:26:24,962][123091] Updated weights for policy 0, policy_version 482716 (0.0005) [2023-12-26 03:26:25,008][123091] Updated weights for policy 0, policy_version 482726 (0.0006) [2023-12-26 03:26:25,063][123091] Updated weights for policy 0, policy_version 482736 (0.0011) [2023-12-26 03:26:25,086][123090] Updated weights for policy 1, policy_version 479394 (0.0005) [2023-12-26 03:26:25,161][123090] Updated weights for policy 1, policy_version 479404 (0.0006) [2023-12-26 03:26:25,227][123090] Updated weights for policy 1, policy_version 479414 (0.0007) [2023-12-26 03:26:25,302][123090] Updated weights for policy 1, policy_version 479424 (0.0009) [2023-12-26 03:26:25,872][123091] Updated weights for policy 0, policy_version 482746 (0.0011) [2023-12-26 03:26:25,927][123091] Updated weights for policy 0, policy_version 482756 (0.0010) [2023-12-26 03:26:25,981][123091] Updated weights for policy 0, policy_version 482766 (0.0010) [2023-12-26 03:26:26,044][123090] Updated weights for policy 1, policy_version 479434 (0.0005) [2023-12-26 03:26:26,090][123090] Updated weights for policy 1, policy_version 479444 (0.0005) [2023-12-26 03:26:26,140][123090] Updated weights for policy 1, policy_version 479454 (0.0006) [2023-12-26 03:26:26,732][123091] Updated weights for policy 0, policy_version 482776 (0.0006) [2023-12-26 03:26:26,781][123091] Updated weights for policy 0, policy_version 482786 (0.0005) [2023-12-26 03:26:26,790][123090] Updated weights for policy 1, policy_version 479464 (0.0008) [2023-12-26 03:26:26,847][123091] Updated weights for policy 0, policy_version 482796 (0.0006) [2023-12-26 03:26:26,848][123090] Updated weights for policy 1, policy_version 479474 (0.0009) [2023-12-26 03:26:26,897][123090] Updated weights for policy 1, policy_version 479484 (0.0009) [2023-12-26 03:26:27,581][123091] Updated weights for policy 0, policy_version 482806 (0.0005) [2023-12-26 03:26:27,650][123091] Updated weights for policy 0, policy_version 482816 (0.0005) [2023-12-26 03:26:27,723][123091] Updated weights for policy 0, policy_version 482826 (0.0005) [2023-12-26 03:26:27,731][123090] Updated weights for policy 1, policy_version 479494 (0.0009) [2023-12-26 03:26:27,775][123090] Updated weights for policy 1, policy_version 479504 (0.0010) [2023-12-26 03:26:27,822][123090] Updated weights for policy 1, policy_version 479514 (0.0010) [2023-12-26 03:26:28,436][123091] Updated weights for policy 0, policy_version 482836 (0.0007) [2023-12-26 03:26:28,495][123091] Updated weights for policy 0, policy_version 482846 (0.0011) [2023-12-26 03:26:28,542][123091] Updated weights for policy 0, policy_version 482856 (0.0010) [2023-12-26 03:26:28,597][123090] Updated weights for policy 1, policy_version 479524 (0.0010) [2023-12-26 03:26:28,669][123090] Updated weights for policy 1, policy_version 479534 (0.0009) [2023-12-26 03:26:28,747][123090] Updated weights for policy 1, policy_version 479544 (0.0009) [2023-12-26 03:26:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 246374400. Throughput: 0: 9030.4, 1: 8990.2. Samples: 246369644. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:28,785][121949] Avg episode reward: [(0, '6064.304'), (1, '5360.029')] [2023-12-26 03:26:29,252][123091] Updated weights for policy 0, policy_version 482866 (0.0010) [2023-12-26 03:26:29,307][123091] Updated weights for policy 0, policy_version 482876 (0.0008) [2023-12-26 03:26:29,374][123091] Updated weights for policy 0, policy_version 482886 (0.0008) [2023-12-26 03:26:29,428][123091] Updated weights for policy 0, policy_version 482896 (0.0005) [2023-12-26 03:26:29,476][123090] Updated weights for policy 1, policy_version 479554 (0.0007) [2023-12-26 03:26:29,531][123090] Updated weights for policy 1, policy_version 479564 (0.0009) [2023-12-26 03:26:29,588][123090] Updated weights for policy 1, policy_version 479574 (0.0010) [2023-12-26 03:26:29,646][123090] Updated weights for policy 1, policy_version 479584 (0.0010) [2023-12-26 03:26:30,255][123091] Updated weights for policy 0, policy_version 482906 (0.0010) [2023-12-26 03:26:30,304][123091] Updated weights for policy 0, policy_version 482916 (0.0010) [2023-12-26 03:26:30,356][123091] Updated weights for policy 0, policy_version 482926 (0.0009) [2023-12-26 03:26:30,483][123090] Updated weights for policy 1, policy_version 479594 (0.0010) [2023-12-26 03:26:30,541][123090] Updated weights for policy 1, policy_version 479604 (0.0010) [2023-12-26 03:26:30,597][123090] Updated weights for policy 1, policy_version 479614 (0.0010) [2023-12-26 03:26:31,094][123091] Updated weights for policy 0, policy_version 482936 (0.0007) [2023-12-26 03:26:31,158][123091] Updated weights for policy 0, policy_version 482946 (0.0007) [2023-12-26 03:26:31,210][123091] Updated weights for policy 0, policy_version 482956 (0.0005) [2023-12-26 03:26:31,491][123090] Updated weights for policy 1, policy_version 479625 (0.0006) [2023-12-26 03:26:31,550][123090] Updated weights for policy 1, policy_version 479635 (0.0005) [2023-12-26 03:26:31,629][123090] Updated weights for policy 1, policy_version 479645 (0.0007) [2023-12-26 03:26:31,950][123091] Updated weights for policy 0, policy_version 482966 (0.0009) [2023-12-26 03:26:32,003][123091] Updated weights for policy 0, policy_version 482976 (0.0008) [2023-12-26 03:26:32,062][123091] Updated weights for policy 0, policy_version 482986 (0.0005) [2023-12-26 03:26:32,439][123090] Updated weights for policy 1, policy_version 479655 (0.0009) [2023-12-26 03:26:32,494][123090] Updated weights for policy 1, policy_version 479665 (0.0009) [2023-12-26 03:26:32,555][123090] Updated weights for policy 1, policy_version 479675 (0.0007) [2023-12-26 03:26:32,846][123091] Updated weights for policy 0, policy_version 482996 (0.0007) [2023-12-26 03:26:32,900][123091] Updated weights for policy 0, policy_version 483006 (0.0010) [2023-12-26 03:26:32,962][123091] Updated weights for policy 0, policy_version 483016 (0.0010) [2023-12-26 03:26:33,361][123090] Updated weights for policy 1, policy_version 479685 (0.0009) [2023-12-26 03:26:33,419][123090] Updated weights for policy 1, policy_version 479695 (0.0010) [2023-12-26 03:26:33,476][123090] Updated weights for policy 1, policy_version 479705 (0.0010) [2023-12-26 03:26:33,695][123091] Updated weights for policy 0, policy_version 483026 (0.0009) [2023-12-26 03:26:33,748][123091] Updated weights for policy 0, policy_version 483036 (0.0009) [2023-12-26 03:26:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 246464512. Throughput: 0: 9092.3, 1: 8908.9. Samples: 246478148. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:33,785][121949] Avg episode reward: [(0, '6000.415'), (1, '5353.514')] [2023-12-26 03:26:33,797][123091] Updated weights for policy 0, policy_version 483046 (0.0009) [2023-12-26 03:26:33,847][123091] Updated weights for policy 0, policy_version 483056 (0.0009) [2023-12-26 03:26:34,366][123090] Updated weights for policy 1, policy_version 479715 (0.0010) [2023-12-26 03:26:34,432][123090] Updated weights for policy 1, policy_version 479725 (0.0010) [2023-12-26 03:26:34,490][123090] Updated weights for policy 1, policy_version 479735 (0.0010) [2023-12-26 03:26:34,628][123091] Updated weights for policy 0, policy_version 483066 (0.0006) [2023-12-26 03:26:34,692][123091] Updated weights for policy 0, policy_version 483076 (0.0010) [2023-12-26 03:26:34,756][123091] Updated weights for policy 0, policy_version 483086 (0.0010) [2023-12-26 03:26:35,343][123090] Updated weights for policy 1, policy_version 479745 (0.0008) [2023-12-26 03:26:35,414][123090] Updated weights for policy 1, policy_version 479755 (0.0008) [2023-12-26 03:26:35,478][123090] Updated weights for policy 1, policy_version 479765 (0.0009) [2023-12-26 03:26:35,540][123090] Updated weights for policy 1, policy_version 479775 (0.0007) [2023-12-26 03:26:35,542][123091] Updated weights for policy 0, policy_version 483096 (0.0010) [2023-12-26 03:26:35,593][123091] Updated weights for policy 0, policy_version 483106 (0.0009) [2023-12-26 03:26:35,642][123091] Updated weights for policy 0, policy_version 483116 (0.0009) [2023-12-26 03:26:36,378][123090] Updated weights for policy 1, policy_version 479785 (0.0009) [2023-12-26 03:26:36,439][123090] Updated weights for policy 1, policy_version 479795 (0.0009) [2023-12-26 03:26:36,493][123091] Updated weights for policy 0, policy_version 483126 (0.0009) [2023-12-26 03:26:36,501][123090] Updated weights for policy 1, policy_version 479805 (0.0007) [2023-12-26 03:26:36,563][123091] Updated weights for policy 0, policy_version 483136 (0.0010) [2023-12-26 03:26:36,633][123091] Updated weights for policy 0, policy_version 483147 (0.0009) [2023-12-26 03:26:37,215][123090] Updated weights for policy 1, policy_version 479815 (0.0007) [2023-12-26 03:26:37,296][123090] Updated weights for policy 1, policy_version 479825 (0.0005) [2023-12-26 03:26:37,350][123090] Updated weights for policy 1, policy_version 479835 (0.0010) [2023-12-26 03:26:37,526][123091] Updated weights for policy 0, policy_version 483157 (0.0010) [2023-12-26 03:26:37,583][123091] Updated weights for policy 0, policy_version 483168 (0.0010) [2023-12-26 03:26:37,637][123091] Updated weights for policy 0, policy_version 483179 (0.0010) [2023-12-26 03:26:37,968][123090] Updated weights for policy 1, policy_version 479845 (0.0008) [2023-12-26 03:26:38,034][123090] Updated weights for policy 1, policy_version 479855 (0.0008) [2023-12-26 03:26:38,101][123090] Updated weights for policy 1, policy_version 479865 (0.0010) [2023-12-26 03:26:38,570][123091] Updated weights for policy 0, policy_version 483190 (0.0010) [2023-12-26 03:26:38,634][123091] Updated weights for policy 0, policy_version 483200 (0.0010) [2023-12-26 03:26:38,697][123091] Updated weights for policy 0, policy_version 483210 (0.0010) [2023-12-26 03:26:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 246554624. Throughput: 0: 9097.2, 1: 8878.2. Samples: 246530000. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:38,785][121949] Avg episode reward: [(0, '5964.647'), (1, '5300.864')] [2023-12-26 03:26:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000483216_123707392.pth... [2023-12-26 03:26:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000479872_122847232.pth... [2023-12-26 03:26:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000482160_123437056.pth [2023-12-26 03:26:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000478848_122585088.pth [2023-12-26 03:26:38,838][123090] Updated weights for policy 1, policy_version 479875 (0.0010) [2023-12-26 03:26:38,906][123090] Updated weights for policy 1, policy_version 479885 (0.0011) [2023-12-26 03:26:38,969][123090] Updated weights for policy 1, policy_version 479895 (0.0010) [2023-12-26 03:26:39,532][123091] Updated weights for policy 0, policy_version 483220 (0.0008) [2023-12-26 03:26:39,584][123091] Updated weights for policy 0, policy_version 483230 (0.0005) [2023-12-26 03:26:39,656][123091] Updated weights for policy 0, policy_version 483240 (0.0005) [2023-12-26 03:26:39,815][123090] Updated weights for policy 1, policy_version 479905 (0.0010) [2023-12-26 03:26:39,884][123090] Updated weights for policy 1, policy_version 479915 (0.0009) [2023-12-26 03:26:39,952][123090] Updated weights for policy 1, policy_version 479925 (0.0009) [2023-12-26 03:26:40,018][123090] Updated weights for policy 1, policy_version 479935 (0.0008) [2023-12-26 03:26:40,390][123091] Updated weights for policy 0, policy_version 483250 (0.0006) [2023-12-26 03:26:40,459][123091] Updated weights for policy 0, policy_version 483260 (0.0009) [2023-12-26 03:26:40,528][123091] Updated weights for policy 0, policy_version 483270 (0.0006) [2023-12-26 03:26:40,590][123091] Updated weights for policy 0, policy_version 483280 (0.0005) [2023-12-26 03:26:40,910][123090] Updated weights for policy 1, policy_version 479945 (0.0009) [2023-12-26 03:26:40,971][123090] Updated weights for policy 1, policy_version 479955 (0.0009) [2023-12-26 03:26:41,042][123090] Updated weights for policy 1, policy_version 479965 (0.0009) [2023-12-26 03:26:41,337][123091] Updated weights for policy 0, policy_version 483290 (0.0010) [2023-12-26 03:26:41,406][123091] Updated weights for policy 0, policy_version 483300 (0.0011) [2023-12-26 03:26:41,465][123091] Updated weights for policy 0, policy_version 483310 (0.0010) [2023-12-26 03:26:41,921][123090] Updated weights for policy 1, policy_version 479975 (0.0010) [2023-12-26 03:26:41,990][123090] Updated weights for policy 1, policy_version 479985 (0.0009) [2023-12-26 03:26:42,052][123090] Updated weights for policy 1, policy_version 479995 (0.0009) [2023-12-26 03:26:42,289][123091] Updated weights for policy 0, policy_version 483320 (0.0010) [2023-12-26 03:26:42,361][123091] Updated weights for policy 0, policy_version 483330 (0.0010) [2023-12-26 03:26:42,427][123091] Updated weights for policy 0, policy_version 483340 (0.0009) [2023-12-26 03:26:42,959][123090] Updated weights for policy 1, policy_version 480005 (0.0009) [2023-12-26 03:26:43,025][123090] Updated weights for policy 1, policy_version 480015 (0.0010) [2023-12-26 03:26:43,089][123090] Updated weights for policy 1, policy_version 480025 (0.0010) [2023-12-26 03:26:43,146][123091] Updated weights for policy 0, policy_version 483350 (0.0008) [2023-12-26 03:26:43,209][123091] Updated weights for policy 0, policy_version 483360 (0.0005) [2023-12-26 03:26:43,260][123091] Updated weights for policy 0, policy_version 483370 (0.0006) [2023-12-26 03:26:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 246636544. Throughput: 0: 8984.6, 1: 8781.1. Samples: 246633412. Policy #0 lag: (min: 31.0, avg: 32.3, max: 61.0) [2023-12-26 03:26:43,785][121949] Avg episode reward: [(0, '5997.645'), (1, '5195.280')] [2023-12-26 03:26:43,877][123090] Updated weights for policy 1, policy_version 480035 (0.0008) [2023-12-26 03:26:43,949][123090] Updated weights for policy 1, policy_version 480045 (0.0005) [2023-12-26 03:26:44,018][123090] Updated weights for policy 1, policy_version 480055 (0.0006) [2023-12-26 03:26:44,026][123091] Updated weights for policy 0, policy_version 483380 (0.0009) [2023-12-26 03:26:44,071][123091] Updated weights for policy 0, policy_version 483390 (0.0006) [2023-12-26 03:26:44,131][123091] Updated weights for policy 0, policy_version 483400 (0.0005) [2023-12-26 03:26:44,810][123090] Updated weights for policy 1, policy_version 480065 (0.0009) [2023-12-26 03:26:44,873][123090] Updated weights for policy 1, policy_version 480075 (0.0009) [2023-12-26 03:26:44,896][123091] Updated weights for policy 0, policy_version 483410 (0.0006) [2023-12-26 03:26:44,936][123090] Updated weights for policy 1, policy_version 480085 (0.0009) [2023-12-26 03:26:44,959][123091] Updated weights for policy 0, policy_version 483420 (0.0008) [2023-12-26 03:26:45,000][123090] Updated weights for policy 1, policy_version 480095 (0.0008) [2023-12-26 03:26:45,014][123091] Updated weights for policy 0, policy_version 483430 (0.0008) [2023-12-26 03:26:45,063][123091] Updated weights for policy 0, policy_version 483440 (0.0008) [2023-12-26 03:26:45,801][123090] Updated weights for policy 1, policy_version 480105 (0.0009) [2023-12-26 03:26:45,856][123090] Updated weights for policy 1, policy_version 480115 (0.0009) [2023-12-26 03:26:45,909][123091] Updated weights for policy 0, policy_version 483450 (0.0009) [2023-12-26 03:26:45,910][123090] Updated weights for policy 1, policy_version 480125 (0.0009) [2023-12-26 03:26:45,968][123091] Updated weights for policy 0, policy_version 483460 (0.0006) [2023-12-26 03:26:46,041][123091] Updated weights for policy 0, policy_version 483470 (0.0006) [2023-12-26 03:26:46,752][123091] Updated weights for policy 0, policy_version 483480 (0.0010) [2023-12-26 03:26:46,763][123090] Updated weights for policy 1, policy_version 480135 (0.0007) [2023-12-26 03:26:46,812][123091] Updated weights for policy 0, policy_version 483490 (0.0008) [2023-12-26 03:26:46,828][123090] Updated weights for policy 1, policy_version 480145 (0.0008) [2023-12-26 03:26:46,872][123090] Updated weights for policy 1, policy_version 480155 (0.0009) [2023-12-26 03:26:46,876][123091] Updated weights for policy 0, policy_version 483500 (0.0007) [2023-12-26 03:26:47,719][123091] Updated weights for policy 0, policy_version 483510 (0.0009) [2023-12-26 03:26:47,726][123090] Updated weights for policy 1, policy_version 480165 (0.0008) [2023-12-26 03:26:47,780][123091] Updated weights for policy 0, policy_version 483520 (0.0008) [2023-12-26 03:26:47,790][123090] Updated weights for policy 1, policy_version 480175 (0.0008) [2023-12-26 03:26:47,840][123091] Updated weights for policy 0, policy_version 483530 (0.0008) [2023-12-26 03:26:47,853][123090] Updated weights for policy 1, policy_version 480185 (0.0007) [2023-12-26 03:26:48,678][123091] Updated weights for policy 0, policy_version 483540 (0.0008) [2023-12-26 03:26:48,688][123090] Updated weights for policy 1, policy_version 480195 (0.0010) [2023-12-26 03:26:48,737][123091] Updated weights for policy 0, policy_version 483550 (0.0007) [2023-12-26 03:26:48,754][123090] Updated weights for policy 1, policy_version 480205 (0.0009) [2023-12-26 03:26:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 246718464. Throughput: 0: 9041.5, 1: 8749.6. Samples: 246738572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:26:48,785][121949] Avg episode reward: [(0, '6096.971'), (1, '5152.807')] [2023-12-26 03:26:48,804][123091] Updated weights for policy 0, policy_version 483560 (0.0008) [2023-12-26 03:26:48,819][123090] Updated weights for policy 1, policy_version 480215 (0.0009) [2023-12-26 03:26:49,645][123090] Updated weights for policy 1, policy_version 480225 (0.0008) [2023-12-26 03:26:49,660][123091] Updated weights for policy 0, policy_version 483570 (0.0009) [2023-12-26 03:26:49,700][123090] Updated weights for policy 1, policy_version 480235 (0.0005) [2023-12-26 03:26:49,719][123091] Updated weights for policy 0, policy_version 483580 (0.0010) [2023-12-26 03:26:49,763][123090] Updated weights for policy 1, policy_version 480245 (0.0006) [2023-12-26 03:26:49,782][123091] Updated weights for policy 0, policy_version 483590 (0.0011) [2023-12-26 03:26:49,829][123090] Updated weights for policy 1, policy_version 480255 (0.0007) [2023-12-26 03:26:49,855][123091] Updated weights for policy 0, policy_version 483600 (0.0009) [2023-12-26 03:26:50,611][123091] Updated weights for policy 0, policy_version 483610 (0.0007) [2023-12-26 03:26:50,664][123091] Updated weights for policy 0, policy_version 483620 (0.0008) [2023-12-26 03:26:50,677][123090] Updated weights for policy 1, policy_version 480265 (0.0009) [2023-12-26 03:26:50,713][123091] Updated weights for policy 0, policy_version 483630 (0.0006) [2023-12-26 03:26:50,743][123090] Updated weights for policy 1, policy_version 480275 (0.0008) [2023-12-26 03:26:50,816][123090] Updated weights for policy 1, policy_version 480285 (0.0010) [2023-12-26 03:26:51,518][123091] Updated weights for policy 0, policy_version 483640 (0.0010) [2023-12-26 03:26:51,582][123091] Updated weights for policy 0, policy_version 483650 (0.0011) [2023-12-26 03:26:51,652][123091] Updated weights for policy 0, policy_version 483660 (0.0009) [2023-12-26 03:26:51,668][123090] Updated weights for policy 1, policy_version 480295 (0.0008) [2023-12-26 03:26:51,744][123090] Updated weights for policy 1, policy_version 480305 (0.0009) [2023-12-26 03:26:51,816][123090] Updated weights for policy 1, policy_version 480315 (0.0006) [2023-12-26 03:26:52,482][123091] Updated weights for policy 0, policy_version 483670 (0.0007) [2023-12-26 03:26:52,551][123091] Updated weights for policy 0, policy_version 483680 (0.0005) [2023-12-26 03:26:52,553][123090] Updated weights for policy 1, policy_version 480325 (0.0006) [2023-12-26 03:26:52,609][123091] Updated weights for policy 0, policy_version 483690 (0.0007) [2023-12-26 03:26:52,619][123090] Updated weights for policy 1, policy_version 480335 (0.0009) [2023-12-26 03:26:52,678][123090] Updated weights for policy 1, policy_version 480345 (0.0009) [2023-12-26 03:26:53,265][123091] Updated weights for policy 0, policy_version 483700 (0.0005) [2023-12-26 03:26:53,322][123091] Updated weights for policy 0, policy_version 483710 (0.0006) [2023-12-26 03:26:53,377][123091] Updated weights for policy 0, policy_version 483720 (0.0006) [2023-12-26 03:26:53,433][123090] Updated weights for policy 1, policy_version 480355 (0.0007) [2023-12-26 03:26:53,483][123090] Updated weights for policy 1, policy_version 480365 (0.0005) [2023-12-26 03:26:53,532][123090] Updated weights for policy 1, policy_version 480375 (0.0005) [2023-12-26 03:26:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 246816768. Throughput: 0: 8997.5, 1: 8709.3. Samples: 246789464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:26:53,785][121949] Avg episode reward: [(0, '6174.453'), (1, '5294.544')] [2023-12-26 03:26:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000483728_123838464.pth... [2023-12-26 03:26:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000480384_122978304.pth... [2023-12-26 03:26:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000479360_122716160.pth [2023-12-26 03:26:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000482672_123568128.pth [2023-12-26 03:26:53,989][123091] Updated weights for policy 0, policy_version 483730 (0.0006) [2023-12-26 03:26:54,043][123091] Updated weights for policy 0, policy_version 483740 (0.0006) [2023-12-26 03:26:54,094][123091] Updated weights for policy 0, policy_version 483750 (0.0005) [2023-12-26 03:26:54,157][123091] Updated weights for policy 0, policy_version 483760 (0.0005) [2023-12-26 03:26:54,268][123090] Updated weights for policy 1, policy_version 480385 (0.0006) [2023-12-26 03:26:54,322][123090] Updated weights for policy 1, policy_version 480395 (0.0009) [2023-12-26 03:26:54,381][123090] Updated weights for policy 1, policy_version 480405 (0.0009) [2023-12-26 03:26:54,444][123090] Updated weights for policy 1, policy_version 480415 (0.0009) [2023-12-26 03:26:54,826][123091] Updated weights for policy 0, policy_version 483770 (0.0005) [2023-12-26 03:26:54,888][123091] Updated weights for policy 0, policy_version 483780 (0.0006) [2023-12-26 03:26:54,950][123091] Updated weights for policy 0, policy_version 483790 (0.0005) [2023-12-26 03:26:55,301][123090] Updated weights for policy 1, policy_version 480425 (0.0009) [2023-12-26 03:26:55,353][123090] Updated weights for policy 1, policy_version 480436 (0.0010) [2023-12-26 03:26:55,407][123090] Updated weights for policy 1, policy_version 480447 (0.0010) [2023-12-26 03:26:55,607][123091] Updated weights for policy 0, policy_version 483800 (0.0007) [2023-12-26 03:26:55,661][123091] Updated weights for policy 0, policy_version 483810 (0.0008) [2023-12-26 03:26:55,709][123091] Updated weights for policy 0, policy_version 483820 (0.0008) [2023-12-26 03:26:56,306][123090] Updated weights for policy 1, policy_version 480457 (0.0009) [2023-12-26 03:26:56,364][123090] Updated weights for policy 1, policy_version 480467 (0.0009) [2023-12-26 03:26:56,429][123090] Updated weights for policy 1, policy_version 480477 (0.0009) [2023-12-26 03:26:56,541][123091] Updated weights for policy 0, policy_version 483830 (0.0010) [2023-12-26 03:26:56,589][123091] Updated weights for policy 0, policy_version 483840 (0.0010) [2023-12-26 03:26:56,647][123091] Updated weights for policy 0, policy_version 483850 (0.0010) [2023-12-26 03:26:57,278][123090] Updated weights for policy 1, policy_version 480487 (0.0009) [2023-12-26 03:26:57,333][123090] Updated weights for policy 1, policy_version 480497 (0.0010) [2023-12-26 03:26:57,381][123091] Updated weights for policy 0, policy_version 483860 (0.0008) [2023-12-26 03:26:57,392][123090] Updated weights for policy 1, policy_version 480507 (0.0009) [2023-12-26 03:26:57,428][123091] Updated weights for policy 0, policy_version 483870 (0.0005) [2023-12-26 03:26:57,485][123091] Updated weights for policy 0, policy_version 483880 (0.0005) [2023-12-26 03:26:58,190][123091] Updated weights for policy 0, policy_version 483890 (0.0006) [2023-12-26 03:26:58,256][123091] Updated weights for policy 0, policy_version 483900 (0.0008) [2023-12-26 03:26:58,332][123091] Updated weights for policy 0, policy_version 483910 (0.0008) [2023-12-26 03:26:58,333][123090] Updated weights for policy 1, policy_version 480517 (0.0009) [2023-12-26 03:26:58,400][123091] Updated weights for policy 0, policy_version 483920 (0.0009) [2023-12-26 03:26:58,412][123090] Updated weights for policy 1, policy_version 480527 (0.0007) [2023-12-26 03:26:58,484][123090] Updated weights for policy 1, policy_version 480537 (0.0008) [2023-12-26 03:26:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 246906880. Throughput: 0: 9063.3, 1: 8775.9. Samples: 246899844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:26:58,785][121949] Avg episode reward: [(0, '6142.246'), (1, '5329.089')] [2023-12-26 03:26:59,252][123091] Updated weights for policy 0, policy_version 483930 (0.0010) [2023-12-26 03:26:59,307][123091] Updated weights for policy 0, policy_version 483940 (0.0011) [2023-12-26 03:26:59,367][123090] Updated weights for policy 1, policy_version 480547 (0.0008) [2023-12-26 03:26:59,394][123091] Updated weights for policy 0, policy_version 483950 (0.0011) [2023-12-26 03:26:59,433][123090] Updated weights for policy 1, policy_version 480557 (0.0007) [2023-12-26 03:26:59,493][123090] Updated weights for policy 1, policy_version 480567 (0.0008) [2023-12-26 03:27:00,232][123091] Updated weights for policy 0, policy_version 483960 (0.0010) [2023-12-26 03:27:00,295][123091] Updated weights for policy 0, policy_version 483970 (0.0010) [2023-12-26 03:27:00,338][123090] Updated weights for policy 1, policy_version 480577 (0.0008) [2023-12-26 03:27:00,357][123091] Updated weights for policy 0, policy_version 483980 (0.0010) [2023-12-26 03:27:00,415][123090] Updated weights for policy 1, policy_version 480587 (0.0009) [2023-12-26 03:27:00,464][123090] Updated weights for policy 1, policy_version 480597 (0.0009) [2023-12-26 03:27:00,516][123090] Updated weights for policy 1, policy_version 480607 (0.0009) [2023-12-26 03:27:01,175][123091] Updated weights for policy 0, policy_version 483990 (0.0011) [2023-12-26 03:27:01,246][123091] Updated weights for policy 0, policy_version 484000 (0.0011) [2023-12-26 03:27:01,308][123091] Updated weights for policy 0, policy_version 484010 (0.0011) [2023-12-26 03:27:01,364][123090] Updated weights for policy 1, policy_version 480617 (0.0007) [2023-12-26 03:27:01,431][123090] Updated weights for policy 1, policy_version 480627 (0.0009) [2023-12-26 03:27:01,487][123090] Updated weights for policy 1, policy_version 480637 (0.0009) [2023-12-26 03:27:02,124][123091] Updated weights for policy 0, policy_version 484020 (0.0010) [2023-12-26 03:27:02,182][123091] Updated weights for policy 0, policy_version 484030 (0.0010) [2023-12-26 03:27:02,249][123091] Updated weights for policy 0, policy_version 484040 (0.0010) [2023-12-26 03:27:02,315][123090] Updated weights for policy 1, policy_version 480647 (0.0009) [2023-12-26 03:27:02,382][123090] Updated weights for policy 1, policy_version 480657 (0.0009) [2023-12-26 03:27:02,439][123090] Updated weights for policy 1, policy_version 480667 (0.0009) [2023-12-26 03:27:03,066][123091] Updated weights for policy 0, policy_version 484050 (0.0011) [2023-12-26 03:27:03,132][123091] Updated weights for policy 0, policy_version 484060 (0.0010) [2023-12-26 03:27:03,198][123091] Updated weights for policy 0, policy_version 484070 (0.0011) [2023-12-26 03:27:03,267][123091] Updated weights for policy 0, policy_version 484080 (0.0010) [2023-12-26 03:27:03,283][123090] Updated weights for policy 1, policy_version 480677 (0.0007) [2023-12-26 03:27:03,342][123090] Updated weights for policy 1, policy_version 480687 (0.0005) [2023-12-26 03:27:03,402][123090] Updated weights for policy 1, policy_version 480697 (0.0005) [2023-12-26 03:27:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 246988800. Throughput: 0: 9025.3, 1: 8657.6. Samples: 247001852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:03,785][121949] Avg episode reward: [(0, '6177.829'), (1, '5050.323')] [2023-12-26 03:27:03,991][123091] Updated weights for policy 0, policy_version 484090 (0.0005) [2023-12-26 03:27:04,056][123091] Updated weights for policy 0, policy_version 484100 (0.0010) [2023-12-26 03:27:04,060][123090] Updated weights for policy 1, policy_version 480707 (0.0006) [2023-12-26 03:27:04,120][123091] Updated weights for policy 0, policy_version 484110 (0.0011) [2023-12-26 03:27:04,123][123090] Updated weights for policy 1, policy_version 480717 (0.0008) [2023-12-26 03:27:04,196][123090] Updated weights for policy 1, policy_version 480727 (0.0008) [2023-12-26 03:27:04,938][123091] Updated weights for policy 0, policy_version 484120 (0.0010) [2023-12-26 03:27:04,995][123090] Updated weights for policy 1, policy_version 480737 (0.0008) [2023-12-26 03:27:04,999][123091] Updated weights for policy 0, policy_version 484130 (0.0005) [2023-12-26 03:27:05,058][123091] Updated weights for policy 0, policy_version 484140 (0.0005) [2023-12-26 03:27:05,060][123090] Updated weights for policy 1, policy_version 480747 (0.0005) [2023-12-26 03:27:05,114][123090] Updated weights for policy 1, policy_version 480757 (0.0008) [2023-12-26 03:27:05,165][123090] Updated weights for policy 1, policy_version 480767 (0.0008) [2023-12-26 03:27:05,692][123091] Updated weights for policy 0, policy_version 484150 (0.0005) [2023-12-26 03:27:05,739][123091] Updated weights for policy 0, policy_version 484160 (0.0005) [2023-12-26 03:27:05,798][123091] Updated weights for policy 0, policy_version 484170 (0.0007) [2023-12-26 03:27:05,825][123090] Updated weights for policy 1, policy_version 480777 (0.0010) [2023-12-26 03:27:05,877][123090] Updated weights for policy 1, policy_version 480787 (0.0005) [2023-12-26 03:27:05,923][123090] Updated weights for policy 1, policy_version 480797 (0.0006) [2023-12-26 03:27:06,482][123091] Updated weights for policy 0, policy_version 484180 (0.0011) [2023-12-26 03:27:06,546][123091] Updated weights for policy 0, policy_version 484190 (0.0007) [2023-12-26 03:27:06,619][123091] Updated weights for policy 0, policy_version 484200 (0.0005) [2023-12-26 03:27:06,684][123090] Updated weights for policy 1, policy_version 480807 (0.0008) [2023-12-26 03:27:06,747][123090] Updated weights for policy 1, policy_version 480817 (0.0006) [2023-12-26 03:27:06,803][123090] Updated weights for policy 1, policy_version 480827 (0.0006) [2023-12-26 03:27:07,385][123091] Updated weights for policy 0, policy_version 484210 (0.0009) [2023-12-26 03:27:07,455][123091] Updated weights for policy 0, policy_version 484220 (0.0006) [2023-12-26 03:27:07,529][123091] Updated weights for policy 0, policy_version 484230 (0.0006) [2023-12-26 03:27:07,531][123090] Updated weights for policy 1, policy_version 480837 (0.0007) [2023-12-26 03:27:07,591][123090] Updated weights for policy 1, policy_version 480847 (0.0008) [2023-12-26 03:27:07,597][123091] Updated weights for policy 0, policy_version 484240 (0.0006) [2023-12-26 03:27:07,658][123090] Updated weights for policy 1, policy_version 480857 (0.0005) [2023-12-26 03:27:08,328][123090] Updated weights for policy 1, policy_version 480867 (0.0006) [2023-12-26 03:27:08,335][123091] Updated weights for policy 0, policy_version 484250 (0.0010) [2023-12-26 03:27:08,391][123090] Updated weights for policy 1, policy_version 480877 (0.0008) [2023-12-26 03:27:08,394][123091] Updated weights for policy 0, policy_version 484260 (0.0007) [2023-12-26 03:27:08,445][123091] Updated weights for policy 0, policy_version 484270 (0.0008) [2023-12-26 03:27:08,450][123090] Updated weights for policy 1, policy_version 480887 (0.0008) [2023-12-26 03:27:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 247087104. Throughput: 0: 9116.4, 1: 8718.0. Samples: 247059360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:08,785][121949] Avg episode reward: [(0, '6094.793'), (1, '4969.207')] [2023-12-26 03:27:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000480896_123109376.pth... [2023-12-26 03:27:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000484272_123977728.pth... [2023-12-26 03:27:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000479872_122847232.pth [2023-12-26 03:27:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000483216_123707392.pth [2023-12-26 03:27:09,203][123090] Updated weights for policy 1, policy_version 480897 (0.0008) [2023-12-26 03:27:09,248][123091] Updated weights for policy 0, policy_version 484280 (0.0009) [2023-12-26 03:27:09,271][123090] Updated weights for policy 1, policy_version 480907 (0.0008) [2023-12-26 03:27:09,316][123091] Updated weights for policy 0, policy_version 484290 (0.0007) [2023-12-26 03:27:09,335][123090] Updated weights for policy 1, policy_version 480917 (0.0008) [2023-12-26 03:27:09,385][123091] Updated weights for policy 0, policy_version 484300 (0.0008) [2023-12-26 03:27:09,405][123090] Updated weights for policy 1, policy_version 480927 (0.0008) [2023-12-26 03:27:10,145][123091] Updated weights for policy 0, policy_version 484310 (0.0007) [2023-12-26 03:27:10,175][123090] Updated weights for policy 1, policy_version 480937 (0.0009) [2023-12-26 03:27:10,206][123091] Updated weights for policy 0, policy_version 484320 (0.0011) [2023-12-26 03:27:10,236][123090] Updated weights for policy 1, policy_version 480947 (0.0007) [2023-12-26 03:27:10,264][123091] Updated weights for policy 0, policy_version 484330 (0.0005) [2023-12-26 03:27:10,293][123090] Updated weights for policy 1, policy_version 480957 (0.0009) [2023-12-26 03:27:11,001][123091] Updated weights for policy 0, policy_version 484340 (0.0007) [2023-12-26 03:27:11,071][123091] Updated weights for policy 0, policy_version 484350 (0.0008) [2023-12-26 03:27:11,142][123091] Updated weights for policy 0, policy_version 484360 (0.0010) [2023-12-26 03:27:11,187][123090] Updated weights for policy 1, policy_version 480967 (0.0009) [2023-12-26 03:27:11,242][123090] Updated weights for policy 1, policy_version 480977 (0.0010) [2023-12-26 03:27:11,308][123090] Updated weights for policy 1, policy_version 480987 (0.0009) [2023-12-26 03:27:11,999][123091] Updated weights for policy 0, policy_version 484370 (0.0006) [2023-12-26 03:27:12,069][123091] Updated weights for policy 0, policy_version 484380 (0.0009) [2023-12-26 03:27:12,131][123091] Updated weights for policy 0, policy_version 484390 (0.0010) [2023-12-26 03:27:12,190][123090] Updated weights for policy 1, policy_version 480997 (0.0009) [2023-12-26 03:27:12,197][123091] Updated weights for policy 0, policy_version 484400 (0.0009) [2023-12-26 03:27:12,257][123090] Updated weights for policy 1, policy_version 481007 (0.0010) [2023-12-26 03:27:12,324][123090] Updated weights for policy 1, policy_version 481017 (0.0009) [2023-12-26 03:27:12,946][123091] Updated weights for policy 0, policy_version 484410 (0.0008) [2023-12-26 03:27:13,007][123091] Updated weights for policy 0, policy_version 484420 (0.0009) [2023-12-26 03:27:13,069][123091] Updated weights for policy 0, policy_version 484430 (0.0007) [2023-12-26 03:27:13,217][123090] Updated weights for policy 1, policy_version 481027 (0.0009) [2023-12-26 03:27:13,284][123090] Updated weights for policy 1, policy_version 481037 (0.0009) [2023-12-26 03:27:13,353][123090] Updated weights for policy 1, policy_version 481047 (0.0009) [2023-12-26 03:27:13,783][123091] Updated weights for policy 0, policy_version 484440 (0.0007) [2023-12-26 03:27:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 247169024. Throughput: 0: 9043.9, 1: 8642.4. Samples: 247165528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:13,785][121949] Avg episode reward: [(0, '6076.093'), (1, '5152.148')] [2023-12-26 03:27:13,854][123091] Updated weights for policy 0, policy_version 484450 (0.0009) [2023-12-26 03:27:13,923][123091] Updated weights for policy 0, policy_version 484460 (0.0010) [2023-12-26 03:27:14,107][123090] Updated weights for policy 1, policy_version 481057 (0.0008) [2023-12-26 03:27:14,169][123090] Updated weights for policy 1, policy_version 481067 (0.0005) [2023-12-26 03:27:14,219][123090] Updated weights for policy 1, policy_version 481077 (0.0005) [2023-12-26 03:27:14,272][123090] Updated weights for policy 1, policy_version 481087 (0.0006) [2023-12-26 03:27:14,795][123091] Updated weights for policy 0, policy_version 484470 (0.0010) [2023-12-26 03:27:14,856][123091] Updated weights for policy 0, policy_version 484480 (0.0010) [2023-12-26 03:27:14,906][123091] Updated weights for policy 0, policy_version 484490 (0.0009) [2023-12-26 03:27:15,040][123090] Updated weights for policy 1, policy_version 481097 (0.0008) [2023-12-26 03:27:15,111][123090] Updated weights for policy 1, policy_version 481107 (0.0010) [2023-12-26 03:27:15,177][123090] Updated weights for policy 1, policy_version 481117 (0.0010) [2023-12-26 03:27:15,656][123091] Updated weights for policy 0, policy_version 484500 (0.0009) [2023-12-26 03:27:15,718][123091] Updated weights for policy 0, policy_version 484510 (0.0009) [2023-12-26 03:27:15,781][123091] Updated weights for policy 0, policy_version 484521 (0.0010) [2023-12-26 03:27:15,928][123090] Updated weights for policy 1, policy_version 481127 (0.0007) [2023-12-26 03:27:15,993][123090] Updated weights for policy 1, policy_version 481137 (0.0009) [2023-12-26 03:27:16,049][123090] Updated weights for policy 1, policy_version 481147 (0.0009) [2023-12-26 03:27:16,609][123091] Updated weights for policy 0, policy_version 484531 (0.0008) [2023-12-26 03:27:16,663][123091] Updated weights for policy 0, policy_version 484541 (0.0005) [2023-12-26 03:27:16,716][123091] Updated weights for policy 0, policy_version 484551 (0.0005) [2023-12-26 03:27:16,910][123090] Updated weights for policy 1, policy_version 481157 (0.0009) [2023-12-26 03:27:16,979][123090] Updated weights for policy 1, policy_version 481167 (0.0006) [2023-12-26 03:27:17,040][123090] Updated weights for policy 1, policy_version 481177 (0.0007) [2023-12-26 03:27:17,353][123091] Updated weights for policy 0, policy_version 484561 (0.0006) [2023-12-26 03:27:17,406][123091] Updated weights for policy 0, policy_version 484571 (0.0009) [2023-12-26 03:27:17,460][123091] Updated weights for policy 0, policy_version 484581 (0.0009) [2023-12-26 03:27:17,511][123091] Updated weights for policy 0, policy_version 484591 (0.0009) [2023-12-26 03:27:17,836][123090] Updated weights for policy 1, policy_version 481187 (0.0009) [2023-12-26 03:27:17,889][123090] Updated weights for policy 1, policy_version 481197 (0.0010) [2023-12-26 03:27:17,943][123090] Updated weights for policy 1, policy_version 481207 (0.0011) [2023-12-26 03:27:18,234][123091] Updated weights for policy 0, policy_version 484601 (0.0006) [2023-12-26 03:27:18,279][123091] Updated weights for policy 0, policy_version 484611 (0.0007) [2023-12-26 03:27:18,329][123091] Updated weights for policy 0, policy_version 484621 (0.0006) [2023-12-26 03:27:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 247259136. Throughput: 0: 9014.9, 1: 8630.9. Samples: 247272212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:18,785][121949] Avg episode reward: [(0, '6147.883'), (1, '5291.596')] [2023-12-26 03:27:18,894][123090] Updated weights for policy 1, policy_version 481217 (0.0009) [2023-12-26 03:27:18,949][123090] Updated weights for policy 1, policy_version 481227 (0.0010) [2023-12-26 03:27:19,009][123090] Updated weights for policy 1, policy_version 481237 (0.0009) [2023-12-26 03:27:19,063][123090] Updated weights for policy 1, policy_version 481247 (0.0010) [2023-12-26 03:27:19,144][123091] Updated weights for policy 0, policy_version 484631 (0.0010) [2023-12-26 03:27:19,210][123091] Updated weights for policy 0, policy_version 484641 (0.0011) [2023-12-26 03:27:19,272][123091] Updated weights for policy 0, policy_version 484651 (0.0011) [2023-12-26 03:27:19,872][123090] Updated weights for policy 1, policy_version 481257 (0.0007) [2023-12-26 03:27:19,948][123090] Updated weights for policy 1, policy_version 481267 (0.0008) [2023-12-26 03:27:20,022][123090] Updated weights for policy 1, policy_version 481277 (0.0010) [2023-12-26 03:27:20,123][123091] Updated weights for policy 0, policy_version 484661 (0.0008) [2023-12-26 03:27:20,188][123091] Updated weights for policy 0, policy_version 484671 (0.0009) [2023-12-26 03:27:20,256][123091] Updated weights for policy 0, policy_version 484681 (0.0011) [2023-12-26 03:27:20,873][123090] Updated weights for policy 1, policy_version 481287 (0.0010) [2023-12-26 03:27:20,940][123090] Updated weights for policy 1, policy_version 481297 (0.0010) [2023-12-26 03:27:21,003][123090] Updated weights for policy 1, policy_version 481307 (0.0009) [2023-12-26 03:27:21,048][123091] Updated weights for policy 0, policy_version 484691 (0.0010) [2023-12-26 03:27:21,118][123091] Updated weights for policy 0, policy_version 484701 (0.0009) [2023-12-26 03:27:21,182][123091] Updated weights for policy 0, policy_version 484711 (0.0009) [2023-12-26 03:27:21,868][123090] Updated weights for policy 1, policy_version 481317 (0.0007) [2023-12-26 03:27:21,932][123090] Updated weights for policy 1, policy_version 481327 (0.0009) [2023-12-26 03:27:21,996][123090] Updated weights for policy 1, policy_version 481337 (0.0007) [2023-12-26 03:27:22,071][123091] Updated weights for policy 0, policy_version 484721 (0.0009) [2023-12-26 03:27:22,135][123091] Updated weights for policy 0, policy_version 484731 (0.0010) [2023-12-26 03:27:22,207][123091] Updated weights for policy 0, policy_version 484741 (0.0010) [2023-12-26 03:27:22,276][123091] Updated weights for policy 0, policy_version 484751 (0.0007) [2023-12-26 03:27:22,745][123090] Updated weights for policy 1, policy_version 481347 (0.0009) [2023-12-26 03:27:22,814][123090] Updated weights for policy 1, policy_version 481357 (0.0006) [2023-12-26 03:27:22,882][123090] Updated weights for policy 1, policy_version 481367 (0.0005) [2023-12-26 03:27:23,201][123091] Updated weights for policy 0, policy_version 484761 (0.0010) [2023-12-26 03:27:23,261][123091] Updated weights for policy 0, policy_version 484771 (0.0008) [2023-12-26 03:27:23,320][123091] Updated weights for policy 0, policy_version 484781 (0.0010) [2023-12-26 03:27:23,533][123090] Updated weights for policy 1, policy_version 481377 (0.0006) [2023-12-26 03:27:23,584][123090] Updated weights for policy 1, policy_version 481387 (0.0006) [2023-12-26 03:27:23,640][123090] Updated weights for policy 1, policy_version 481397 (0.0009) [2023-12-26 03:27:23,698][123090] Updated weights for policy 1, policy_version 481407 (0.0010) [2023-12-26 03:27:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 247349248. Throughput: 0: 8988.6, 1: 8626.3. Samples: 247322680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:23,785][121949] Avg episode reward: [(0, '6237.486'), (1, '5336.618')] [2023-12-26 03:27:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000484784_124108800.pth... [2023-12-26 03:27:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000481408_123240448.pth... [2023-12-26 03:27:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000483728_123838464.pth [2023-12-26 03:27:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000480384_122978304.pth [2023-12-26 03:27:24,197][123091] Updated weights for policy 0, policy_version 484791 (0.0010) [2023-12-26 03:27:24,254][123091] Updated weights for policy 0, policy_version 484802 (0.0010) [2023-12-26 03:27:24,308][123091] Updated weights for policy 0, policy_version 484812 (0.0010) [2023-12-26 03:27:24,492][123090] Updated weights for policy 1, policy_version 481417 (0.0006) [2023-12-26 03:27:24,547][123090] Updated weights for policy 1, policy_version 481427 (0.0006) [2023-12-26 03:27:24,605][123090] Updated weights for policy 1, policy_version 481437 (0.0005) [2023-12-26 03:27:25,073][123091] Updated weights for policy 0, policy_version 484822 (0.0009) [2023-12-26 03:27:25,122][123091] Updated weights for policy 0, policy_version 484832 (0.0009) [2023-12-26 03:27:25,173][123091] Updated weights for policy 0, policy_version 484842 (0.0009) [2023-12-26 03:27:25,270][123090] Updated weights for policy 1, policy_version 481447 (0.0005) [2023-12-26 03:27:25,323][123090] Updated weights for policy 1, policy_version 481457 (0.0005) [2023-12-26 03:27:25,378][123090] Updated weights for policy 1, policy_version 481467 (0.0005) [2023-12-26 03:27:26,093][123090] Updated weights for policy 1, policy_version 481477 (0.0008) [2023-12-26 03:27:26,109][123091] Updated weights for policy 0, policy_version 484852 (0.0008) [2023-12-26 03:27:26,153][123090] Updated weights for policy 1, policy_version 481487 (0.0010) [2023-12-26 03:27:26,172][123091] Updated weights for policy 0, policy_version 484862 (0.0006) [2023-12-26 03:27:26,217][123090] Updated weights for policy 1, policy_version 481497 (0.0011) [2023-12-26 03:27:26,226][123091] Updated weights for policy 0, policy_version 484872 (0.0009) [2023-12-26 03:27:26,981][123090] Updated weights for policy 1, policy_version 481507 (0.0010) [2023-12-26 03:27:27,028][123091] Updated weights for policy 0, policy_version 484882 (0.0007) [2023-12-26 03:27:27,032][123090] Updated weights for policy 1, policy_version 481517 (0.0010) [2023-12-26 03:27:27,080][123091] Updated weights for policy 0, policy_version 484892 (0.0005) [2023-12-26 03:27:27,087][123090] Updated weights for policy 1, policy_version 481527 (0.0010) [2023-12-26 03:27:27,146][123091] Updated weights for policy 0, policy_version 484902 (0.0006) [2023-12-26 03:27:27,209][123091] Updated weights for policy 0, policy_version 484912 (0.0005) [2023-12-26 03:27:27,779][123090] Updated weights for policy 1, policy_version 481537 (0.0009) [2023-12-26 03:27:27,825][123091] Updated weights for policy 0, policy_version 484922 (0.0008) [2023-12-26 03:27:27,843][123090] Updated weights for policy 1, policy_version 481547 (0.0008) [2023-12-26 03:27:27,884][123091] Updated weights for policy 0, policy_version 484932 (0.0009) [2023-12-26 03:27:27,900][123090] Updated weights for policy 1, policy_version 481557 (0.0010) [2023-12-26 03:27:27,933][123091] Updated weights for policy 0, policy_version 484942 (0.0008) [2023-12-26 03:27:27,951][123090] Updated weights for policy 1, policy_version 481567 (0.0010) [2023-12-26 03:27:28,685][123090] Updated weights for policy 1, policy_version 481577 (0.0010) [2023-12-26 03:27:28,740][123091] Updated weights for policy 0, policy_version 484952 (0.0006) [2023-12-26 03:27:28,752][123090] Updated weights for policy 1, policy_version 481587 (0.0010) [2023-12-26 03:27:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 247431168. Throughput: 0: 8991.2, 1: 8759.7. Samples: 247432196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:28,784][121949] Avg episode reward: [(0, '6143.843'), (1, '5307.578')] [2023-12-26 03:27:28,796][123091] Updated weights for policy 0, policy_version 484962 (0.0008) [2023-12-26 03:27:28,814][123090] Updated weights for policy 1, policy_version 481597 (0.0010) [2023-12-26 03:27:28,850][123091] Updated weights for policy 0, policy_version 484972 (0.0007) [2023-12-26 03:27:29,586][123091] Updated weights for policy 0, policy_version 484982 (0.0008) [2023-12-26 03:27:29,654][123091] Updated weights for policy 0, policy_version 484992 (0.0005) [2023-12-26 03:27:29,661][123090] Updated weights for policy 1, policy_version 481607 (0.0007) [2023-12-26 03:27:29,721][123090] Updated weights for policy 1, policy_version 481617 (0.0006) [2023-12-26 03:27:29,726][123091] Updated weights for policy 0, policy_version 485002 (0.0007) [2023-12-26 03:27:29,771][123090] Updated weights for policy 1, policy_version 481627 (0.0009) [2023-12-26 03:27:30,470][123091] Updated weights for policy 0, policy_version 485012 (0.0007) [2023-12-26 03:27:30,520][123091] Updated weights for policy 0, policy_version 485022 (0.0009) [2023-12-26 03:27:30,568][123091] Updated weights for policy 0, policy_version 485032 (0.0009) [2023-12-26 03:27:30,609][123090] Updated weights for policy 1, policy_version 481637 (0.0008) [2023-12-26 03:27:30,658][123090] Updated weights for policy 1, policy_version 481647 (0.0009) [2023-12-26 03:27:30,705][123090] Updated weights for policy 1, policy_version 481657 (0.0009) [2023-12-26 03:27:31,396][123091] Updated weights for policy 0, policy_version 485042 (0.0008) [2023-12-26 03:27:31,466][123091] Updated weights for policy 0, policy_version 485052 (0.0010) [2023-12-26 03:27:31,532][123091] Updated weights for policy 0, policy_version 485062 (0.0009) [2023-12-26 03:27:31,591][123091] Updated weights for policy 0, policy_version 485072 (0.0006) [2023-12-26 03:27:31,595][123090] Updated weights for policy 1, policy_version 481667 (0.0008) [2023-12-26 03:27:31,668][123090] Updated weights for policy 1, policy_version 481677 (0.0009) [2023-12-26 03:27:31,733][123090] Updated weights for policy 1, policy_version 481687 (0.0008) [2023-12-26 03:27:32,334][123091] Updated weights for policy 0, policy_version 485082 (0.0009) [2023-12-26 03:27:32,397][123091] Updated weights for policy 0, policy_version 485092 (0.0006) [2023-12-26 03:27:32,452][123091] Updated weights for policy 0, policy_version 485102 (0.0005) [2023-12-26 03:27:32,515][123090] Updated weights for policy 1, policy_version 481697 (0.0006) [2023-12-26 03:27:32,572][123090] Updated weights for policy 1, policy_version 481707 (0.0005) [2023-12-26 03:27:32,627][123090] Updated weights for policy 1, policy_version 481717 (0.0005) [2023-12-26 03:27:32,691][123090] Updated weights for policy 1, policy_version 481727 (0.0005) [2023-12-26 03:27:33,123][123091] Updated weights for policy 0, policy_version 485112 (0.0006) [2023-12-26 03:27:33,186][123091] Updated weights for policy 0, policy_version 485122 (0.0006) [2023-12-26 03:27:33,253][123091] Updated weights for policy 0, policy_version 485132 (0.0007) [2023-12-26 03:27:33,315][123090] Updated weights for policy 1, policy_version 481737 (0.0010) [2023-12-26 03:27:33,373][123090] Updated weights for policy 1, policy_version 481749 (0.0010) [2023-12-26 03:27:33,430][123090] Updated weights for policy 1, policy_version 481759 (0.0009) [2023-12-26 03:27:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 247529472. Throughput: 0: 9051.4, 1: 8810.6. Samples: 247542360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:33,785][121949] Avg episode reward: [(0, '6168.291'), (1, '5331.080')] [2023-12-26 03:27:33,801][123091] Updated weights for policy 0, policy_version 485142 (0.0006) [2023-12-26 03:27:33,868][123091] Updated weights for policy 0, policy_version 485152 (0.0005) [2023-12-26 03:27:33,919][123091] Updated weights for policy 0, policy_version 485162 (0.0010) [2023-12-26 03:27:34,336][123090] Updated weights for policy 1, policy_version 481769 (0.0009) [2023-12-26 03:27:34,397][123090] Updated weights for policy 1, policy_version 481779 (0.0010) [2023-12-26 03:27:34,453][123090] Updated weights for policy 1, policy_version 481789 (0.0010) [2023-12-26 03:27:34,661][123091] Updated weights for policy 0, policy_version 485172 (0.0010) [2023-12-26 03:27:34,724][123091] Updated weights for policy 0, policy_version 485182 (0.0006) [2023-12-26 03:27:34,779][123091] Updated weights for policy 0, policy_version 485192 (0.0007) [2023-12-26 03:27:35,357][123090] Updated weights for policy 1, policy_version 481799 (0.0010) [2023-12-26 03:27:35,411][123090] Updated weights for policy 1, policy_version 481809 (0.0009) [2023-12-26 03:27:35,474][123090] Updated weights for policy 1, policy_version 481819 (0.0009) [2023-12-26 03:27:35,545][123091] Updated weights for policy 0, policy_version 485202 (0.0010) [2023-12-26 03:27:35,599][123091] Updated weights for policy 0, policy_version 485212 (0.0009) [2023-12-26 03:27:35,648][123091] Updated weights for policy 0, policy_version 485222 (0.0009) [2023-12-26 03:27:35,697][123091] Updated weights for policy 0, policy_version 485232 (0.0010) [2023-12-26 03:27:36,327][123090] Updated weights for policy 1, policy_version 481829 (0.0009) [2023-12-26 03:27:36,398][123090] Updated weights for policy 1, policy_version 481839 (0.0009) [2023-12-26 03:27:36,468][123090] Updated weights for policy 1, policy_version 481849 (0.0010) [2023-12-26 03:27:36,548][123091] Updated weights for policy 0, policy_version 485242 (0.0009) [2023-12-26 03:27:36,617][123091] Updated weights for policy 0, policy_version 485252 (0.0010) [2023-12-26 03:27:36,685][123091] Updated weights for policy 0, policy_version 485262 (0.0009) [2023-12-26 03:27:37,308][123090] Updated weights for policy 1, policy_version 481859 (0.0008) [2023-12-26 03:27:37,356][123090] Updated weights for policy 1, policy_version 481869 (0.0009) [2023-12-26 03:27:37,408][123090] Updated weights for policy 1, policy_version 481879 (0.0010) [2023-12-26 03:27:37,526][123091] Updated weights for policy 0, policy_version 485272 (0.0010) [2023-12-26 03:27:37,589][123091] Updated weights for policy 0, policy_version 485282 (0.0011) [2023-12-26 03:27:37,653][123091] Updated weights for policy 0, policy_version 485292 (0.0010) [2023-12-26 03:27:38,007][123090] Updated weights for policy 1, policy_version 481889 (0.0008) [2023-12-26 03:27:38,072][123090] Updated weights for policy 1, policy_version 481899 (0.0005) [2023-12-26 03:27:38,128][123090] Updated weights for policy 1, policy_version 481909 (0.0005) [2023-12-26 03:27:38,179][123090] Updated weights for policy 1, policy_version 481919 (0.0009) [2023-12-26 03:27:38,361][123091] Updated weights for policy 0, policy_version 485302 (0.0007) [2023-12-26 03:27:38,423][123091] Updated weights for policy 0, policy_version 485312 (0.0009) [2023-12-26 03:27:38,487][123091] Updated weights for policy 0, policy_version 485322 (0.0009) [2023-12-26 03:27:38,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 247619584. Throughput: 0: 9071.0, 1: 8805.1. Samples: 247593888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:38,785][121949] Avg episode reward: [(0, '6244.424'), (1, '5374.816')] [2023-12-26 03:27:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000485328_124248064.pth... [2023-12-26 03:27:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000481920_123371520.pth... [2023-12-26 03:27:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000484272_123977728.pth [2023-12-26 03:27:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000480896_123109376.pth [2023-12-26 03:27:38,999][123090] Updated weights for policy 1, policy_version 481929 (0.0007) [2023-12-26 03:27:39,069][123090] Updated weights for policy 1, policy_version 481939 (0.0005) [2023-12-26 03:27:39,140][123090] Updated weights for policy 1, policy_version 481949 (0.0006) [2023-12-26 03:27:39,194][123091] Updated weights for policy 0, policy_version 485332 (0.0008) [2023-12-26 03:27:39,260][123091] Updated weights for policy 0, policy_version 485342 (0.0007) [2023-12-26 03:27:39,328][123091] Updated weights for policy 0, policy_version 485352 (0.0007) [2023-12-26 03:27:39,885][123090] Updated weights for policy 1, policy_version 481959 (0.0009) [2023-12-26 03:27:39,945][123090] Updated weights for policy 1, policy_version 481969 (0.0008) [2023-12-26 03:27:40,019][123090] Updated weights for policy 1, policy_version 481979 (0.0006) [2023-12-26 03:27:40,144][123091] Updated weights for policy 0, policy_version 485362 (0.0009) [2023-12-26 03:27:40,219][123091] Updated weights for policy 0, policy_version 485372 (0.0010) [2023-12-26 03:27:40,286][123091] Updated weights for policy 0, policy_version 485382 (0.0009) [2023-12-26 03:27:40,353][123091] Updated weights for policy 0, policy_version 485392 (0.0010) [2023-12-26 03:27:40,765][123090] Updated weights for policy 1, policy_version 481989 (0.0009) [2023-12-26 03:27:40,813][123090] Updated weights for policy 1, policy_version 481999 (0.0009) [2023-12-26 03:27:40,877][123090] Updated weights for policy 1, policy_version 482009 (0.0009) [2023-12-26 03:27:41,214][123091] Updated weights for policy 0, policy_version 485402 (0.0007) [2023-12-26 03:27:41,277][123091] Updated weights for policy 0, policy_version 485412 (0.0010) [2023-12-26 03:27:41,345][123091] Updated weights for policy 0, policy_version 485422 (0.0006) [2023-12-26 03:27:41,825][123090] Updated weights for policy 1, policy_version 482019 (0.0009) [2023-12-26 03:27:41,881][123090] Updated weights for policy 1, policy_version 482029 (0.0009) [2023-12-26 03:27:41,942][123090] Updated weights for policy 1, policy_version 482039 (0.0009) [2023-12-26 03:27:42,141][123091] Updated weights for policy 0, policy_version 485432 (0.0010) [2023-12-26 03:27:42,204][123091] Updated weights for policy 0, policy_version 485442 (0.0011) [2023-12-26 03:27:42,271][123091] Updated weights for policy 0, policy_version 485452 (0.0011) [2023-12-26 03:27:42,820][123090] Updated weights for policy 1, policy_version 482049 (0.0010) [2023-12-26 03:27:42,879][123090] Updated weights for policy 1, policy_version 482059 (0.0010) [2023-12-26 03:27:42,938][123090] Updated weights for policy 1, policy_version 482069 (0.0010) [2023-12-26 03:27:42,997][123090] Updated weights for policy 1, policy_version 482080 (0.0010) [2023-12-26 03:27:43,029][123091] Updated weights for policy 0, policy_version 485462 (0.0008) [2023-12-26 03:27:43,106][123091] Updated weights for policy 0, policy_version 485472 (0.0005) [2023-12-26 03:27:43,168][123091] Updated weights for policy 0, policy_version 485482 (0.0005) [2023-12-26 03:27:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 247701504. Throughput: 0: 8951.6, 1: 8815.2. Samples: 247699356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:43,785][121949] Avg episode reward: [(0, '6213.143'), (1, '5174.606')] [2023-12-26 03:27:43,811][123091] Updated weights for policy 0, policy_version 485492 (0.0007) [2023-12-26 03:27:43,863][123091] Updated weights for policy 0, policy_version 485502 (0.0009) [2023-12-26 03:27:43,919][123090] Updated weights for policy 1, policy_version 482090 (0.0006) [2023-12-26 03:27:43,921][123091] Updated weights for policy 0, policy_version 485512 (0.0009) [2023-12-26 03:27:43,980][123090] Updated weights for policy 1, policy_version 482100 (0.0008) [2023-12-26 03:27:44,028][123090] Updated weights for policy 1, policy_version 482110 (0.0009) [2023-12-26 03:27:44,653][123091] Updated weights for policy 0, policy_version 485522 (0.0009) [2023-12-26 03:27:44,706][123091] Updated weights for policy 0, policy_version 485532 (0.0010) [2023-12-26 03:27:44,774][123091] Updated weights for policy 0, policy_version 485542 (0.0008) [2023-12-26 03:27:44,836][123091] Updated weights for policy 0, policy_version 485552 (0.0009) [2023-12-26 03:27:44,891][123090] Updated weights for policy 1, policy_version 482120 (0.0009) [2023-12-26 03:27:44,950][123090] Updated weights for policy 1, policy_version 482130 (0.0009) [2023-12-26 03:27:45,000][123090] Updated weights for policy 1, policy_version 482140 (0.0009) [2023-12-26 03:27:45,686][123091] Updated weights for policy 0, policy_version 485562 (0.0010) [2023-12-26 03:27:45,736][123091] Updated weights for policy 0, policy_version 485572 (0.0009) [2023-12-26 03:27:45,787][123091] Updated weights for policy 0, policy_version 485582 (0.0010) [2023-12-26 03:27:45,849][123090] Updated weights for policy 1, policy_version 482150 (0.0009) [2023-12-26 03:27:45,903][123090] Updated weights for policy 1, policy_version 482161 (0.0010) [2023-12-26 03:27:45,961][123090] Updated weights for policy 1, policy_version 482171 (0.0009) [2023-12-26 03:27:46,542][123091] Updated weights for policy 0, policy_version 485592 (0.0008) [2023-12-26 03:27:46,610][123091] Updated weights for policy 0, policy_version 485602 (0.0007) [2023-12-26 03:27:46,674][123091] Updated weights for policy 0, policy_version 485612 (0.0008) [2023-12-26 03:27:46,857][123090] Updated weights for policy 1, policy_version 482181 (0.0009) [2023-12-26 03:27:46,905][123090] Updated weights for policy 1, policy_version 482191 (0.0008) [2023-12-26 03:27:46,954][123090] Updated weights for policy 1, policy_version 482201 (0.0009) [2023-12-26 03:27:47,402][123091] Updated weights for policy 0, policy_version 485622 (0.0008) [2023-12-26 03:27:47,470][123091] Updated weights for policy 0, policy_version 485632 (0.0005) [2023-12-26 03:27:47,543][123091] Updated weights for policy 0, policy_version 485642 (0.0006) [2023-12-26 03:27:47,748][123090] Updated weights for policy 1, policy_version 482211 (0.0008) [2023-12-26 03:27:47,812][123090] Updated weights for policy 1, policy_version 482221 (0.0006) [2023-12-26 03:27:47,876][123090] Updated weights for policy 1, policy_version 482231 (0.0005) [2023-12-26 03:27:48,307][123091] Updated weights for policy 0, policy_version 485652 (0.0008) [2023-12-26 03:27:48,366][123091] Updated weights for policy 0, policy_version 485662 (0.0008) [2023-12-26 03:27:48,437][123091] Updated weights for policy 0, policy_version 485672 (0.0011) [2023-12-26 03:27:48,511][123090] Updated weights for policy 1, policy_version 482241 (0.0006) [2023-12-26 03:27:48,570][123090] Updated weights for policy 1, policy_version 482251 (0.0009) [2023-12-26 03:27:48,628][123090] Updated weights for policy 1, policy_version 482261 (0.0009) [2023-12-26 03:27:48,691][123090] Updated weights for policy 1, policy_version 482271 (0.0010) [2023-12-26 03:27:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 247799808. Throughput: 0: 9056.7, 1: 8826.8. Samples: 247806612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:48,785][121949] Avg episode reward: [(0, '6216.677'), (1, '5237.907')] [2023-12-26 03:27:49,149][123091] Updated weights for policy 0, policy_version 485682 (0.0009) [2023-12-26 03:27:49,208][123091] Updated weights for policy 0, policy_version 485692 (0.0006) [2023-12-26 03:27:49,282][123091] Updated weights for policy 0, policy_version 485702 (0.0008) [2023-12-26 03:27:49,350][123091] Updated weights for policy 0, policy_version 485712 (0.0008) [2023-12-26 03:27:49,515][123090] Updated weights for policy 1, policy_version 482281 (0.0009) [2023-12-26 03:27:49,584][123090] Updated weights for policy 1, policy_version 482291 (0.0010) [2023-12-26 03:27:49,651][123090] Updated weights for policy 1, policy_version 482301 (0.0009) [2023-12-26 03:27:50,096][123091] Updated weights for policy 0, policy_version 485722 (0.0011) [2023-12-26 03:27:50,153][123091] Updated weights for policy 0, policy_version 485732 (0.0008) [2023-12-26 03:27:50,210][123091] Updated weights for policy 0, policy_version 485742 (0.0006) [2023-12-26 03:27:50,564][123090] Updated weights for policy 1, policy_version 482311 (0.0007) [2023-12-26 03:27:50,626][123090] Updated weights for policy 1, policy_version 482321 (0.0006) [2023-12-26 03:27:50,695][123090] Updated weights for policy 1, policy_version 482331 (0.0006) [2023-12-26 03:27:50,932][123091] Updated weights for policy 0, policy_version 485752 (0.0005) [2023-12-26 03:27:50,997][123091] Updated weights for policy 0, policy_version 485762 (0.0010) [2023-12-26 03:27:51,075][123091] Updated weights for policy 0, policy_version 485772 (0.0007) [2023-12-26 03:27:51,404][123090] Updated weights for policy 1, policy_version 482341 (0.0007) [2023-12-26 03:27:51,471][123090] Updated weights for policy 1, policy_version 482351 (0.0008) [2023-12-26 03:27:51,538][123090] Updated weights for policy 1, policy_version 482361 (0.0008) [2023-12-26 03:27:51,809][123091] Updated weights for policy 0, policy_version 485782 (0.0006) [2023-12-26 03:27:51,863][123091] Updated weights for policy 0, policy_version 485792 (0.0008) [2023-12-26 03:27:51,931][123091] Updated weights for policy 0, policy_version 485802 (0.0011) [2023-12-26 03:27:52,388][123090] Updated weights for policy 1, policy_version 482371 (0.0009) [2023-12-26 03:27:52,455][123090] Updated weights for policy 1, policy_version 482381 (0.0010) [2023-12-26 03:27:52,515][123090] Updated weights for policy 1, policy_version 482391 (0.0010) [2023-12-26 03:27:52,701][123091] Updated weights for policy 0, policy_version 485812 (0.0011) [2023-12-26 03:27:52,757][123091] Updated weights for policy 0, policy_version 485822 (0.0011) [2023-12-26 03:27:52,820][123091] Updated weights for policy 0, policy_version 485832 (0.0011) [2023-12-26 03:27:53,369][123090] Updated weights for policy 1, policy_version 482401 (0.0009) [2023-12-26 03:27:53,435][123090] Updated weights for policy 1, policy_version 482411 (0.0010) [2023-12-26 03:27:53,489][123090] Updated weights for policy 1, policy_version 482421 (0.0009) [2023-12-26 03:27:53,544][123090] Updated weights for policy 1, policy_version 482431 (0.0009) [2023-12-26 03:27:53,648][123091] Updated weights for policy 0, policy_version 485842 (0.0010) [2023-12-26 03:27:53,700][123091] Updated weights for policy 0, policy_version 485852 (0.0010) [2023-12-26 03:27:53,760][123091] Updated weights for policy 0, policy_version 485862 (0.0010) [2023-12-26 03:27:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 247881728. Throughput: 0: 9039.0, 1: 8773.5. Samples: 247860928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:53,786][121949] Avg episode reward: [(0, '6254.982'), (1, '5356.614')] [2023-12-26 03:27:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000482432_123502592.pth... [2023-12-26 03:27:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000481408_123240448.pth [2023-12-26 03:27:53,820][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000485872_124387328.pth... [2023-12-26 03:27:53,822][123091] Updated weights for policy 0, policy_version 485872 (0.0010) [2023-12-26 03:27:53,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000484784_124108800.pth [2023-12-26 03:27:54,382][123090] Updated weights for policy 1, policy_version 482441 (0.0008) [2023-12-26 03:27:54,445][123090] Updated weights for policy 1, policy_version 482451 (0.0009) [2023-12-26 03:27:54,505][123090] Updated weights for policy 1, policy_version 482461 (0.0008) [2023-12-26 03:27:54,646][123091] Updated weights for policy 0, policy_version 485882 (0.0007) [2023-12-26 03:27:54,716][123091] Updated weights for policy 0, policy_version 485892 (0.0010) [2023-12-26 03:27:54,784][123091] Updated weights for policy 0, policy_version 485902 (0.0011) [2023-12-26 03:27:55,398][123090] Updated weights for policy 1, policy_version 482471 (0.0010) [2023-12-26 03:27:55,456][123090] Updated weights for policy 1, policy_version 482481 (0.0010) [2023-12-26 03:27:55,499][123091] Updated weights for policy 0, policy_version 485912 (0.0006) [2023-12-26 03:27:55,510][123090] Updated weights for policy 1, policy_version 482491 (0.0009) [2023-12-26 03:27:55,547][123091] Updated weights for policy 0, policy_version 485922 (0.0009) [2023-12-26 03:27:55,595][123091] Updated weights for policy 0, policy_version 485932 (0.0009) [2023-12-26 03:27:56,365][123090] Updated weights for policy 1, policy_version 482501 (0.0008) [2023-12-26 03:27:56,417][123090] Updated weights for policy 1, policy_version 482511 (0.0010) [2023-12-26 03:27:56,445][123091] Updated weights for policy 0, policy_version 485942 (0.0009) [2023-12-26 03:27:56,470][123090] Updated weights for policy 1, policy_version 482521 (0.0007) [2023-12-26 03:27:56,508][123091] Updated weights for policy 0, policy_version 485952 (0.0009) [2023-12-26 03:27:56,578][123091] Updated weights for policy 0, policy_version 485962 (0.0009) [2023-12-26 03:27:57,327][123090] Updated weights for policy 1, policy_version 482531 (0.0009) [2023-12-26 03:27:57,352][123091] Updated weights for policy 0, policy_version 485972 (0.0008) [2023-12-26 03:27:57,387][123090] Updated weights for policy 1, policy_version 482541 (0.0008) [2023-12-26 03:27:57,419][123091] Updated weights for policy 0, policy_version 485982 (0.0006) [2023-12-26 03:27:57,445][123090] Updated weights for policy 1, policy_version 482551 (0.0007) [2023-12-26 03:27:57,473][123091] Updated weights for policy 0, policy_version 485992 (0.0006) [2023-12-26 03:27:58,079][123091] Updated weights for policy 0, policy_version 486002 (0.0005) [2023-12-26 03:27:58,131][123091] Updated weights for policy 0, policy_version 486012 (0.0010) [2023-12-26 03:27:58,187][123091] Updated weights for policy 0, policy_version 486022 (0.0010) [2023-12-26 03:27:58,250][123091] Updated weights for policy 0, policy_version 486032 (0.0010) [2023-12-26 03:27:58,308][123090] Updated weights for policy 1, policy_version 482561 (0.0008) [2023-12-26 03:27:58,371][123090] Updated weights for policy 1, policy_version 482571 (0.0010) [2023-12-26 03:27:58,435][123090] Updated weights for policy 1, policy_version 482581 (0.0009) [2023-12-26 03:27:58,496][123090] Updated weights for policy 1, policy_version 482591 (0.0009) [2023-12-26 03:27:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 247971840. Throughput: 0: 9043.7, 1: 8708.3. Samples: 247964364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:27:58,785][121949] Avg episode reward: [(0, '6156.658'), (1, '5437.853')] [2023-12-26 03:27:59,179][123091] Updated weights for policy 0, policy_version 486042 (0.0006) [2023-12-26 03:27:59,252][123091] Updated weights for policy 0, policy_version 486052 (0.0010) [2023-12-26 03:27:59,319][123091] Updated weights for policy 0, policy_version 486062 (0.0008) [2023-12-26 03:27:59,410][123090] Updated weights for policy 1, policy_version 482601 (0.0010) [2023-12-26 03:27:59,476][123090] Updated weights for policy 1, policy_version 482611 (0.0010) [2023-12-26 03:27:59,533][123090] Updated weights for policy 1, policy_version 482621 (0.0009) [2023-12-26 03:27:59,919][123091] Updated weights for policy 0, policy_version 486072 (0.0007) [2023-12-26 03:27:59,989][123091] Updated weights for policy 0, policy_version 486082 (0.0010) [2023-12-26 03:28:00,044][123091] Updated weights for policy 0, policy_version 486092 (0.0010) [2023-12-26 03:28:00,369][123090] Updated weights for policy 1, policy_version 482631 (0.0008) [2023-12-26 03:28:00,420][123090] Updated weights for policy 1, policy_version 482641 (0.0005) [2023-12-26 03:28:00,476][123090] Updated weights for policy 1, policy_version 482651 (0.0007) [2023-12-26 03:28:00,738][123091] Updated weights for policy 0, policy_version 486102 (0.0007) [2023-12-26 03:28:00,784][123091] Updated weights for policy 0, policy_version 486112 (0.0005) [2023-12-26 03:28:00,829][123091] Updated weights for policy 0, policy_version 486122 (0.0005) [2023-12-26 03:28:01,281][123090] Updated weights for policy 1, policy_version 482661 (0.0011) [2023-12-26 03:28:01,352][123090] Updated weights for policy 1, policy_version 482671 (0.0009) [2023-12-26 03:28:01,415][123090] Updated weights for policy 1, policy_version 482681 (0.0012) [2023-12-26 03:28:01,575][123091] Updated weights for policy 0, policy_version 486132 (0.0005) [2023-12-26 03:28:01,674][123091] Updated weights for policy 0, policy_version 486142 (0.0009) [2023-12-26 03:28:01,740][123091] Updated weights for policy 0, policy_version 486152 (0.0010) [2023-12-26 03:28:02,137][123090] Updated weights for policy 1, policy_version 482691 (0.0007) [2023-12-26 03:28:02,192][123090] Updated weights for policy 1, policy_version 482701 (0.0006) [2023-12-26 03:28:02,254][123090] Updated weights for policy 1, policy_version 482711 (0.0006) [2023-12-26 03:28:02,525][123091] Updated weights for policy 0, policy_version 486162 (0.0010) [2023-12-26 03:28:02,586][123091] Updated weights for policy 0, policy_version 486172 (0.0005) [2023-12-26 03:28:02,655][123091] Updated weights for policy 0, policy_version 486182 (0.0009) [2023-12-26 03:28:02,707][123091] Updated weights for policy 0, policy_version 486192 (0.0011) [2023-12-26 03:28:02,990][123090] Updated weights for policy 1, policy_version 482721 (0.0006) [2023-12-26 03:28:03,055][123090] Updated weights for policy 1, policy_version 482731 (0.0009) [2023-12-26 03:28:03,130][123090] Updated weights for policy 1, policy_version 482741 (0.0011) [2023-12-26 03:28:03,186][123090] Updated weights for policy 1, policy_version 482751 (0.0010) [2023-12-26 03:28:03,370][123091] Updated weights for policy 0, policy_version 486202 (0.0009) [2023-12-26 03:28:03,421][123091] Updated weights for policy 0, policy_version 486212 (0.0009) [2023-12-26 03:28:03,468][123091] Updated weights for policy 0, policy_version 486222 (0.0009) [2023-12-26 03:28:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 248061952. Throughput: 0: 9070.2, 1: 8728.5. Samples: 248073152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:03,784][121949] Avg episode reward: [(0, '6114.960'), (1, '5663.287')] [2023-12-26 03:28:03,978][123090] Updated weights for policy 1, policy_version 482761 (0.0008) [2023-12-26 03:28:04,044][123090] Updated weights for policy 1, policy_version 482771 (0.0008) [2023-12-26 03:28:04,099][123090] Updated weights for policy 1, policy_version 482781 (0.0008) [2023-12-26 03:28:04,315][123091] Updated weights for policy 0, policy_version 486232 (0.0009) [2023-12-26 03:28:04,375][123091] Updated weights for policy 0, policy_version 486242 (0.0010) [2023-12-26 03:28:04,428][123091] Updated weights for policy 0, policy_version 486252 (0.0006) [2023-12-26 03:28:04,909][123090] Updated weights for policy 1, policy_version 482791 (0.0009) [2023-12-26 03:28:04,964][123090] Updated weights for policy 1, policy_version 482801 (0.0009) [2023-12-26 03:28:05,020][123090] Updated weights for policy 1, policy_version 482811 (0.0009) [2023-12-26 03:28:05,216][123091] Updated weights for policy 0, policy_version 486262 (0.0007) [2023-12-26 03:28:05,279][123091] Updated weights for policy 0, policy_version 486273 (0.0006) [2023-12-26 03:28:05,336][123091] Updated weights for policy 0, policy_version 486283 (0.0009) [2023-12-26 03:28:05,905][123090] Updated weights for policy 1, policy_version 482821 (0.0009) [2023-12-26 03:28:05,956][123090] Updated weights for policy 1, policy_version 482831 (0.0007) [2023-12-26 03:28:06,014][123090] Updated weights for policy 1, policy_version 482841 (0.0006) [2023-12-26 03:28:06,097][123091] Updated weights for policy 0, policy_version 486294 (0.0008) [2023-12-26 03:28:06,164][123091] Updated weights for policy 0, policy_version 486304 (0.0006) [2023-12-26 03:28:06,232][123091] Updated weights for policy 0, policy_version 486314 (0.0006) [2023-12-26 03:28:06,844][123090] Updated weights for policy 1, policy_version 482851 (0.0006) [2023-12-26 03:28:06,900][123090] Updated weights for policy 1, policy_version 482861 (0.0006) [2023-12-26 03:28:06,920][123091] Updated weights for policy 0, policy_version 486324 (0.0006) [2023-12-26 03:28:06,956][123090] Updated weights for policy 1, policy_version 482871 (0.0008) [2023-12-26 03:28:06,972][123091] Updated weights for policy 0, policy_version 486334 (0.0008) [2023-12-26 03:28:07,018][123091] Updated weights for policy 0, policy_version 486344 (0.0008) [2023-12-26 03:28:07,702][123090] Updated weights for policy 1, policy_version 482881 (0.0010) [2023-12-26 03:28:07,757][123090] Updated weights for policy 1, policy_version 482891 (0.0006) [2023-12-26 03:28:07,810][123090] Updated weights for policy 1, policy_version 482901 (0.0010) [2023-12-26 03:28:07,868][123090] Updated weights for policy 1, policy_version 482911 (0.0010) [2023-12-26 03:28:07,884][123091] Updated weights for policy 0, policy_version 486354 (0.0008) [2023-12-26 03:28:07,954][123091] Updated weights for policy 0, policy_version 486364 (0.0009) [2023-12-26 03:28:08,017][123091] Updated weights for policy 0, policy_version 486374 (0.0007) [2023-12-26 03:28:08,091][123091] Updated weights for policy 0, policy_version 486384 (0.0005) [2023-12-26 03:28:08,647][123090] Updated weights for policy 1, policy_version 482921 (0.0006) [2023-12-26 03:28:08,716][123090] Updated weights for policy 1, policy_version 482931 (0.0006) [2023-12-26 03:28:08,783][123090] Updated weights for policy 1, policy_version 482941 (0.0006) [2023-12-26 03:28:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 248143872. Throughput: 0: 9115.8, 1: 8744.0. Samples: 248126368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:08,785][121949] Avg episode reward: [(0, '6108.447'), (1, '5771.098')] [2023-12-26 03:28:08,804][123091] Updated weights for policy 0, policy_version 486394 (0.0006) [2023-12-26 03:28:08,804][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000482944_123633664.pth... [2023-12-26 03:28:08,809][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000481920_123371520.pth [2023-12-26 03:28:08,872][123091] Updated weights for policy 0, policy_version 486404 (0.0005) [2023-12-26 03:28:08,938][123091] Updated weights for policy 0, policy_version 486414 (0.0008) [2023-12-26 03:28:08,952][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000486416_124526592.pth... [2023-12-26 03:28:08,956][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000485328_124248064.pth [2023-12-26 03:28:09,594][123090] Updated weights for policy 1, policy_version 482951 (0.0010) [2023-12-26 03:28:09,648][123090] Updated weights for policy 1, policy_version 482961 (0.0009) [2023-12-26 03:28:09,681][123091] Updated weights for policy 0, policy_version 486424 (0.0010) [2023-12-26 03:28:09,701][123090] Updated weights for policy 1, policy_version 482971 (0.0007) [2023-12-26 03:28:09,744][123091] Updated weights for policy 0, policy_version 486434 (0.0007) [2023-12-26 03:28:09,814][123091] Updated weights for policy 0, policy_version 486444 (0.0008) [2023-12-26 03:28:10,604][123091] Updated weights for policy 0, policy_version 486454 (0.0011) [2023-12-26 03:28:10,611][123090] Updated weights for policy 1, policy_version 482981 (0.0008) [2023-12-26 03:28:10,667][123091] Updated weights for policy 0, policy_version 486464 (0.0011) [2023-12-26 03:28:10,671][123090] Updated weights for policy 1, policy_version 482991 (0.0008) [2023-12-26 03:28:10,722][123091] Updated weights for policy 0, policy_version 486474 (0.0010) [2023-12-26 03:28:10,738][123090] Updated weights for policy 1, policy_version 483001 (0.0008) [2023-12-26 03:28:11,515][123091] Updated weights for policy 0, policy_version 486484 (0.0010) [2023-12-26 03:28:11,547][123090] Updated weights for policy 1, policy_version 483011 (0.0008) [2023-12-26 03:28:11,578][123091] Updated weights for policy 0, policy_version 486494 (0.0009) [2023-12-26 03:28:11,617][123090] Updated weights for policy 1, policy_version 483021 (0.0008) [2023-12-26 03:28:11,646][123091] Updated weights for policy 0, policy_version 486504 (0.0009) [2023-12-26 03:28:11,684][123090] Updated weights for policy 1, policy_version 483031 (0.0010) [2023-12-26 03:28:12,457][123091] Updated weights for policy 0, policy_version 486514 (0.0010) [2023-12-26 03:28:12,508][123091] Updated weights for policy 0, policy_version 486524 (0.0010) [2023-12-26 03:28:12,558][123090] Updated weights for policy 1, policy_version 483041 (0.0009) [2023-12-26 03:28:12,560][123091] Updated weights for policy 0, policy_version 486534 (0.0009) [2023-12-26 03:28:12,619][123090] Updated weights for policy 1, policy_version 483051 (0.0007) [2023-12-26 03:28:12,629][123091] Updated weights for policy 0, policy_version 486544 (0.0010) [2023-12-26 03:28:12,689][123090] Updated weights for policy 1, policy_version 483061 (0.0009) [2023-12-26 03:28:12,755][123090] Updated weights for policy 1, policy_version 483071 (0.0008) [2023-12-26 03:28:13,449][123090] Updated weights for policy 1, policy_version 483081 (0.0010) [2023-12-26 03:28:13,475][123091] Updated weights for policy 0, policy_version 486554 (0.0005) [2023-12-26 03:28:13,504][123090] Updated weights for policy 1, policy_version 483091 (0.0008) [2023-12-26 03:28:13,546][123091] Updated weights for policy 0, policy_version 486564 (0.0007) [2023-12-26 03:28:13,558][123090] Updated weights for policy 1, policy_version 483101 (0.0005) [2023-12-26 03:28:13,606][123091] Updated weights for policy 0, policy_version 486574 (0.0009) [2023-12-26 03:28:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 248242176. Throughput: 0: 9156.2, 1: 8588.4. Samples: 248230708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:13,785][121949] Avg episode reward: [(0, '6036.119'), (1, '5667.134')] [2023-12-26 03:28:14,266][123090] Updated weights for policy 1, policy_version 483111 (0.0005) [2023-12-26 03:28:14,343][123090] Updated weights for policy 1, policy_version 483121 (0.0005) [2023-12-26 03:28:14,410][123090] Updated weights for policy 1, policy_version 483131 (0.0007) [2023-12-26 03:28:14,443][123091] Updated weights for policy 0, policy_version 486584 (0.0008) [2023-12-26 03:28:14,490][123091] Updated weights for policy 0, policy_version 486594 (0.0009) [2023-12-26 03:28:14,544][123091] Updated weights for policy 0, policy_version 486604 (0.0009) [2023-12-26 03:28:15,127][123090] Updated weights for policy 1, policy_version 483141 (0.0008) [2023-12-26 03:28:15,197][123090] Updated weights for policy 1, policy_version 483151 (0.0008) [2023-12-26 03:28:15,266][123090] Updated weights for policy 1, policy_version 483161 (0.0009) [2023-12-26 03:28:15,429][123091] Updated weights for policy 0, policy_version 486614 (0.0009) [2023-12-26 03:28:15,491][123091] Updated weights for policy 0, policy_version 486624 (0.0009) [2023-12-26 03:28:15,558][123091] Updated weights for policy 0, policy_version 486634 (0.0009) [2023-12-26 03:28:16,030][123090] Updated weights for policy 1, policy_version 483171 (0.0010) [2023-12-26 03:28:16,084][123090] Updated weights for policy 1, policy_version 483182 (0.0010) [2023-12-26 03:28:16,143][123090] Updated weights for policy 1, policy_version 483194 (0.0011) [2023-12-26 03:28:16,308][123091] Updated weights for policy 0, policy_version 486644 (0.0009) [2023-12-26 03:28:16,374][123091] Updated weights for policy 0, policy_version 486654 (0.0010) [2023-12-26 03:28:16,433][123091] Updated weights for policy 0, policy_version 486664 (0.0009) [2023-12-26 03:28:17,006][123090] Updated weights for policy 1, policy_version 483204 (0.0009) [2023-12-26 03:28:17,057][123090] Updated weights for policy 1, policy_version 483214 (0.0009) [2023-12-26 03:28:17,110][123090] Updated weights for policy 1, policy_version 483224 (0.0009) [2023-12-26 03:28:17,163][123091] Updated weights for policy 0, policy_version 486674 (0.0008) [2023-12-26 03:28:17,215][123091] Updated weights for policy 0, policy_version 486684 (0.0005) [2023-12-26 03:28:17,266][123091] Updated weights for policy 0, policy_version 486694 (0.0006) [2023-12-26 03:28:17,327][123091] Updated weights for policy 0, policy_version 486704 (0.0005) [2023-12-26 03:28:18,023][123090] Updated weights for policy 1, policy_version 483234 (0.0009) [2023-12-26 03:28:18,043][123091] Updated weights for policy 0, policy_version 486714 (0.0006) [2023-12-26 03:28:18,088][123090] Updated weights for policy 1, policy_version 483244 (0.0009) [2023-12-26 03:28:18,098][123091] Updated weights for policy 0, policy_version 486724 (0.0005) [2023-12-26 03:28:18,150][123091] Updated weights for policy 0, policy_version 486734 (0.0005) [2023-12-26 03:28:18,158][123090] Updated weights for policy 1, policy_version 483254 (0.0009) [2023-12-26 03:28:18,231][123090] Updated weights for policy 1, policy_version 483264 (0.0010) [2023-12-26 03:28:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 248324096. Throughput: 0: 9099.9, 1: 8584.0. Samples: 248338136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:18,785][121949] Avg episode reward: [(0, '6130.997'), (1, '5740.361')] [2023-12-26 03:28:18,911][123091] Updated weights for policy 0, policy_version 486744 (0.0009) [2023-12-26 03:28:18,971][123091] Updated weights for policy 0, policy_version 486754 (0.0009) [2023-12-26 03:28:19,033][123091] Updated weights for policy 0, policy_version 486764 (0.0010) [2023-12-26 03:28:19,078][123090] Updated weights for policy 1, policy_version 483274 (0.0009) [2023-12-26 03:28:19,149][123090] Updated weights for policy 1, policy_version 483284 (0.0009) [2023-12-26 03:28:19,219][123090] Updated weights for policy 1, policy_version 483294 (0.0010) [2023-12-26 03:28:19,877][123091] Updated weights for policy 0, policy_version 486774 (0.0009) [2023-12-26 03:28:19,944][123091] Updated weights for policy 0, policy_version 486784 (0.0009) [2023-12-26 03:28:19,999][123091] Updated weights for policy 0, policy_version 486794 (0.0009) [2023-12-26 03:28:20,061][123090] Updated weights for policy 1, policy_version 483304 (0.0006) [2023-12-26 03:28:20,129][123090] Updated weights for policy 1, policy_version 483314 (0.0006) [2023-12-26 03:28:20,188][123090] Updated weights for policy 1, policy_version 483324 (0.0006) [2023-12-26 03:28:20,820][123091] Updated weights for policy 0, policy_version 486804 (0.0010) [2023-12-26 03:28:20,889][123091] Updated weights for policy 0, policy_version 486814 (0.0009) [2023-12-26 03:28:20,928][123090] Updated weights for policy 1, policy_version 483334 (0.0007) [2023-12-26 03:28:20,959][123091] Updated weights for policy 0, policy_version 486824 (0.0010) [2023-12-26 03:28:20,996][123090] Updated weights for policy 1, policy_version 483344 (0.0008) [2023-12-26 03:28:21,066][123090] Updated weights for policy 1, policy_version 483354 (0.0009) [2023-12-26 03:28:21,770][123091] Updated weights for policy 0, policy_version 486834 (0.0008) [2023-12-26 03:28:21,837][123091] Updated weights for policy 0, policy_version 486844 (0.0010) [2023-12-26 03:28:21,906][123091] Updated weights for policy 0, policy_version 486854 (0.0007) [2023-12-26 03:28:21,975][123091] Updated weights for policy 0, policy_version 486864 (0.0007) [2023-12-26 03:28:21,980][123090] Updated weights for policy 1, policy_version 483364 (0.0010) [2023-12-26 03:28:22,051][123090] Updated weights for policy 1, policy_version 483374 (0.0010) [2023-12-26 03:28:22,119][123090] Updated weights for policy 1, policy_version 483384 (0.0011) [2023-12-26 03:28:22,766][123091] Updated weights for policy 0, policy_version 486874 (0.0010) [2023-12-26 03:28:22,843][123091] Updated weights for policy 0, policy_version 486884 (0.0010) [2023-12-26 03:28:22,901][123091] Updated weights for policy 0, policy_version 486894 (0.0009) [2023-12-26 03:28:22,989][123090] Updated weights for policy 1, policy_version 483394 (0.0010) [2023-12-26 03:28:23,045][123090] Updated weights for policy 1, policy_version 483404 (0.0010) [2023-12-26 03:28:23,096][123090] Updated weights for policy 1, policy_version 483414 (0.0009) [2023-12-26 03:28:23,157][123090] Updated weights for policy 1, policy_version 483424 (0.0009) [2023-12-26 03:28:23,772][123091] Updated weights for policy 0, policy_version 486904 (0.0010) [2023-12-26 03:28:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 248406016. Throughput: 0: 9068.2, 1: 8604.9. Samples: 248389176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:23,786][121949] Avg episode reward: [(0, '6158.495'), (1, '5876.564')] [2023-12-26 03:28:23,826][123091] Updated weights for policy 0, policy_version 486914 (0.0011) [2023-12-26 03:28:23,855][123090] Updated weights for policy 1, policy_version 483434 (0.0007) [2023-12-26 03:28:23,877][123091] Updated weights for policy 0, policy_version 486924 (0.0010) [2023-12-26 03:28:23,898][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000486928_124657664.pth... [2023-12-26 03:28:23,902][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000485872_124387328.pth [2023-12-26 03:28:23,914][123090] Updated weights for policy 1, policy_version 483444 (0.0006) [2023-12-26 03:28:23,962][123090] Updated weights for policy 1, policy_version 483454 (0.0008) [2023-12-26 03:28:23,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000483456_123764736.pth... [2023-12-26 03:28:23,974][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000482432_123502592.pth [2023-12-26 03:28:24,567][123091] Updated weights for policy 0, policy_version 486934 (0.0011) [2023-12-26 03:28:24,634][123091] Updated weights for policy 0, policy_version 486944 (0.0010) [2023-12-26 03:28:24,704][123091] Updated weights for policy 0, policy_version 486954 (0.0009) [2023-12-26 03:28:24,805][123090] Updated weights for policy 1, policy_version 483464 (0.0010) [2023-12-26 03:28:24,876][123090] Updated weights for policy 1, policy_version 483474 (0.0009) [2023-12-26 03:28:24,944][123090] Updated weights for policy 1, policy_version 483484 (0.0010) [2023-12-26 03:28:25,444][123091] Updated weights for policy 0, policy_version 486964 (0.0007) [2023-12-26 03:28:25,508][123091] Updated weights for policy 0, policy_version 486974 (0.0008) [2023-12-26 03:28:25,572][123091] Updated weights for policy 0, policy_version 486984 (0.0009) [2023-12-26 03:28:25,696][123090] Updated weights for policy 1, policy_version 483495 (0.0007) [2023-12-26 03:28:25,756][123090] Updated weights for policy 1, policy_version 483505 (0.0009) [2023-12-26 03:28:25,811][123090] Updated weights for policy 1, policy_version 483515 (0.0010) [2023-12-26 03:28:26,236][123091] Updated weights for policy 0, policy_version 486994 (0.0009) [2023-12-26 03:28:26,298][123091] Updated weights for policy 0, policy_version 487004 (0.0005) [2023-12-26 03:28:26,354][123091] Updated weights for policy 0, policy_version 487014 (0.0007) [2023-12-26 03:28:26,421][123091] Updated weights for policy 0, policy_version 487024 (0.0008) [2023-12-26 03:28:26,577][123090] Updated weights for policy 1, policy_version 483525 (0.0008) [2023-12-26 03:28:26,640][123090] Updated weights for policy 1, policy_version 483535 (0.0005) [2023-12-26 03:28:26,692][123090] Updated weights for policy 1, policy_version 483545 (0.0006) [2023-12-26 03:28:27,136][123091] Updated weights for policy 0, policy_version 487034 (0.0007) [2023-12-26 03:28:27,191][123091] Updated weights for policy 0, policy_version 487044 (0.0005) [2023-12-26 03:28:27,239][123091] Updated weights for policy 0, policy_version 487054 (0.0005) [2023-12-26 03:28:27,416][123090] Updated weights for policy 1, policy_version 483555 (0.0010) [2023-12-26 03:28:27,486][123090] Updated weights for policy 1, policy_version 483565 (0.0006) [2023-12-26 03:28:27,543][123090] Updated weights for policy 1, policy_version 483575 (0.0006) [2023-12-26 03:28:28,027][123091] Updated weights for policy 0, policy_version 487064 (0.0009) [2023-12-26 03:28:28,080][123091] Updated weights for policy 0, policy_version 487075 (0.0009) [2023-12-26 03:28:28,135][123091] Updated weights for policy 0, policy_version 487086 (0.0010) [2023-12-26 03:28:28,231][123090] Updated weights for policy 1, policy_version 483585 (0.0008) [2023-12-26 03:28:28,289][123090] Updated weights for policy 1, policy_version 483595 (0.0005) [2023-12-26 03:28:28,345][123090] Updated weights for policy 1, policy_version 483605 (0.0007) [2023-12-26 03:28:28,414][123090] Updated weights for policy 1, policy_version 483615 (0.0006) [2023-12-26 03:28:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 248504320. Throughput: 0: 9119.1, 1: 8637.9. Samples: 248498416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:28,784][121949] Avg episode reward: [(0, '6182.365'), (1, '5798.722')] [2023-12-26 03:28:28,931][123091] Updated weights for policy 0, policy_version 487096 (0.0009) [2023-12-26 03:28:28,978][123091] Updated weights for policy 0, policy_version 487106 (0.0010) [2023-12-26 03:28:29,026][123091] Updated weights for policy 0, policy_version 487116 (0.0010) [2023-12-26 03:28:29,071][123090] Updated weights for policy 1, policy_version 483625 (0.0009) [2023-12-26 03:28:29,129][123090] Updated weights for policy 1, policy_version 483635 (0.0008) [2023-12-26 03:28:29,176][123090] Updated weights for policy 1, policy_version 483645 (0.0009) [2023-12-26 03:28:29,883][123091] Updated weights for policy 0, policy_version 487126 (0.0009) [2023-12-26 03:28:29,957][123091] Updated weights for policy 0, policy_version 487136 (0.0010) [2023-12-26 03:28:30,011][123091] Updated weights for policy 0, policy_version 487146 (0.0006) [2023-12-26 03:28:30,029][123090] Updated weights for policy 1, policy_version 483655 (0.0007) [2023-12-26 03:28:30,102][123090] Updated weights for policy 1, policy_version 483665 (0.0006) [2023-12-26 03:28:30,171][123090] Updated weights for policy 1, policy_version 483675 (0.0005) [2023-12-26 03:28:30,817][123091] Updated weights for policy 0, policy_version 487156 (0.0009) [2023-12-26 03:28:30,875][123091] Updated weights for policy 0, policy_version 487166 (0.0010) [2023-12-26 03:28:30,918][123090] Updated weights for policy 1, policy_version 483685 (0.0008) [2023-12-26 03:28:30,925][123091] Updated weights for policy 0, policy_version 487176 (0.0010) [2023-12-26 03:28:30,966][123090] Updated weights for policy 1, policy_version 483695 (0.0010) [2023-12-26 03:28:31,021][123090] Updated weights for policy 1, policy_version 483705 (0.0010) [2023-12-26 03:28:31,743][123091] Updated weights for policy 0, policy_version 487186 (0.0010) [2023-12-26 03:28:31,802][123091] Updated weights for policy 0, policy_version 487196 (0.0010) [2023-12-26 03:28:31,841][123090] Updated weights for policy 1, policy_version 483715 (0.0011) [2023-12-26 03:28:31,857][123091] Updated weights for policy 0, policy_version 487206 (0.0011) [2023-12-26 03:28:31,892][123090] Updated weights for policy 1, policy_version 483725 (0.0010) [2023-12-26 03:28:31,911][123091] Updated weights for policy 0, policy_version 487216 (0.0010) [2023-12-26 03:28:31,943][123090] Updated weights for policy 1, policy_version 483735 (0.0010) [2023-12-26 03:28:32,684][123091] Updated weights for policy 0, policy_version 487226 (0.0005) [2023-12-26 03:28:32,750][123091] Updated weights for policy 0, policy_version 487236 (0.0005) [2023-12-26 03:28:32,791][123090] Updated weights for policy 1, policy_version 483745 (0.0010) [2023-12-26 03:28:32,815][123091] Updated weights for policy 0, policy_version 487246 (0.0006) [2023-12-26 03:28:32,851][123090] Updated weights for policy 1, policy_version 483755 (0.0011) [2023-12-26 03:28:32,903][123090] Updated weights for policy 1, policy_version 483765 (0.0010) [2023-12-26 03:28:32,952][123090] Updated weights for policy 1, policy_version 483775 (0.0006) [2023-12-26 03:28:33,545][123091] Updated weights for policy 0, policy_version 487256 (0.0009) [2023-12-26 03:28:33,602][123091] Updated weights for policy 0, policy_version 487267 (0.0009) [2023-12-26 03:28:33,650][123091] Updated weights for policy 0, policy_version 487277 (0.0006) [2023-12-26 03:28:33,763][123090] Updated weights for policy 1, policy_version 483785 (0.0007) [2023-12-26 03:28:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 248594432. Throughput: 0: 9053.3, 1: 8713.8. Samples: 248606136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:33,785][121949] Avg episode reward: [(0, '6093.279'), (1, '5649.751')] [2023-12-26 03:28:33,818][123090] Updated weights for policy 1, policy_version 483795 (0.0005) [2023-12-26 03:28:33,871][123090] Updated weights for policy 1, policy_version 483805 (0.0005) [2023-12-26 03:28:34,517][123091] Updated weights for policy 0, policy_version 487287 (0.0008) [2023-12-26 03:28:34,582][123091] Updated weights for policy 0, policy_version 487297 (0.0009) [2023-12-26 03:28:34,601][123090] Updated weights for policy 1, policy_version 483815 (0.0007) [2023-12-26 03:28:34,630][123091] Updated weights for policy 0, policy_version 487307 (0.0009) [2023-12-26 03:28:34,662][123090] Updated weights for policy 1, policy_version 483825 (0.0008) [2023-12-26 03:28:34,711][123090] Updated weights for policy 1, policy_version 483835 (0.0005) [2023-12-26 03:28:35,344][123091] Updated weights for policy 0, policy_version 487317 (0.0007) [2023-12-26 03:28:35,403][123091] Updated weights for policy 0, policy_version 487327 (0.0005) [2023-12-26 03:28:35,412][123090] Updated weights for policy 1, policy_version 483845 (0.0006) [2023-12-26 03:28:35,450][123091] Updated weights for policy 0, policy_version 487337 (0.0005) [2023-12-26 03:28:35,462][123090] Updated weights for policy 1, policy_version 483855 (0.0009) [2023-12-26 03:28:35,517][123090] Updated weights for policy 1, policy_version 483865 (0.0009) [2023-12-26 03:28:36,133][123091] Updated weights for policy 0, policy_version 487347 (0.0007) [2023-12-26 03:28:36,194][123091] Updated weights for policy 0, policy_version 487357 (0.0009) [2023-12-26 03:28:36,247][123091] Updated weights for policy 0, policy_version 487367 (0.0011) [2023-12-26 03:28:36,415][123090] Updated weights for policy 1, policy_version 483875 (0.0009) [2023-12-26 03:28:36,482][123090] Updated weights for policy 1, policy_version 483885 (0.0009) [2023-12-26 03:28:36,547][123090] Updated weights for policy 1, policy_version 483895 (0.0008) [2023-12-26 03:28:37,153][123091] Updated weights for policy 0, policy_version 487377 (0.0009) [2023-12-26 03:28:37,208][123091] Updated weights for policy 0, policy_version 487387 (0.0006) [2023-12-26 03:28:37,261][123091] Updated weights for policy 0, policy_version 487397 (0.0010) [2023-12-26 03:28:37,290][123090] Updated weights for policy 1, policy_version 483905 (0.0005) [2023-12-26 03:28:37,316][123091] Updated weights for policy 0, policy_version 487407 (0.0009) [2023-12-26 03:28:37,355][123090] Updated weights for policy 1, policy_version 483915 (0.0005) [2023-12-26 03:28:37,426][123090] Updated weights for policy 1, policy_version 483925 (0.0005) [2023-12-26 03:28:37,495][123090] Updated weights for policy 1, policy_version 483935 (0.0005) [2023-12-26 03:28:38,169][123091] Updated weights for policy 0, policy_version 487417 (0.0007) [2023-12-26 03:28:38,172][123090] Updated weights for policy 1, policy_version 483945 (0.0009) [2023-12-26 03:28:38,221][123091] Updated weights for policy 0, policy_version 487427 (0.0006) [2023-12-26 03:28:38,238][123090] Updated weights for policy 1, policy_version 483955 (0.0009) [2023-12-26 03:28:38,275][123091] Updated weights for policy 0, policy_version 487437 (0.0009) [2023-12-26 03:28:38,304][123090] Updated weights for policy 1, policy_version 483965 (0.0006) [2023-12-26 03:28:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 248684544. Throughput: 0: 9035.2, 1: 8745.6. Samples: 248661056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:38,785][121949] Avg episode reward: [(0, '6008.433'), (1, '5678.607')] [2023-12-26 03:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000487440_124788736.pth... [2023-12-26 03:28:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000483968_123895808.pth... [2023-12-26 03:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000486416_124526592.pth [2023-12-26 03:28:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000482944_123633664.pth [2023-12-26 03:28:39,040][123090] Updated weights for policy 1, policy_version 483975 (0.0006) [2023-12-26 03:28:39,105][123090] Updated weights for policy 1, policy_version 483985 (0.0008) [2023-12-26 03:28:39,171][123090] Updated weights for policy 1, policy_version 483995 (0.0008) [2023-12-26 03:28:39,186][123091] Updated weights for policy 0, policy_version 487447 (0.0009) [2023-12-26 03:28:39,247][123091] Updated weights for policy 0, policy_version 487457 (0.0009) [2023-12-26 03:28:39,316][123091] Updated weights for policy 0, policy_version 487467 (0.0008) [2023-12-26 03:28:39,895][123090] Updated weights for policy 1, policy_version 484005 (0.0007) [2023-12-26 03:28:39,960][123090] Updated weights for policy 1, policy_version 484015 (0.0007) [2023-12-26 03:28:40,031][123090] Updated weights for policy 1, policy_version 484025 (0.0009) [2023-12-26 03:28:40,170][123091] Updated weights for policy 0, policy_version 487477 (0.0010) [2023-12-26 03:28:40,240][123091] Updated weights for policy 0, policy_version 487487 (0.0009) [2023-12-26 03:28:40,311][123091] Updated weights for policy 0, policy_version 487497 (0.0009) [2023-12-26 03:28:40,669][123090] Updated weights for policy 1, policy_version 484035 (0.0009) [2023-12-26 03:28:40,743][123090] Updated weights for policy 1, policy_version 484045 (0.0006) [2023-12-26 03:28:40,817][123090] Updated weights for policy 1, policy_version 484055 (0.0006) [2023-12-26 03:28:41,092][123091] Updated weights for policy 0, policy_version 487507 (0.0010) [2023-12-26 03:28:41,158][123091] Updated weights for policy 0, policy_version 487517 (0.0010) [2023-12-26 03:28:41,222][123091] Updated weights for policy 0, policy_version 487527 (0.0010) [2023-12-26 03:28:41,572][123090] Updated weights for policy 1, policy_version 484065 (0.0007) [2023-12-26 03:28:41,638][123090] Updated weights for policy 1, policy_version 484075 (0.0008) [2023-12-26 03:28:41,692][123090] Updated weights for policy 1, policy_version 484085 (0.0006) [2023-12-26 03:28:41,766][123090] Updated weights for policy 1, policy_version 484095 (0.0009) [2023-12-26 03:28:42,142][123091] Updated weights for policy 0, policy_version 487537 (0.0008) [2023-12-26 03:28:42,200][123091] Updated weights for policy 0, policy_version 487547 (0.0009) [2023-12-26 03:28:42,267][123091] Updated weights for policy 0, policy_version 487557 (0.0010) [2023-12-26 03:28:42,328][123091] Updated weights for policy 0, policy_version 487567 (0.0009) [2023-12-26 03:28:42,546][123090] Updated weights for policy 1, policy_version 484105 (0.0009) [2023-12-26 03:28:42,607][123090] Updated weights for policy 1, policy_version 484115 (0.0009) [2023-12-26 03:28:42,665][123090] Updated weights for policy 1, policy_version 484125 (0.0009) [2023-12-26 03:28:43,230][123091] Updated weights for policy 0, policy_version 487577 (0.0010) [2023-12-26 03:28:43,289][123091] Updated weights for policy 0, policy_version 487588 (0.0010) [2023-12-26 03:28:43,342][123091] Updated weights for policy 0, policy_version 487598 (0.0008) [2023-12-26 03:28:43,375][123090] Updated weights for policy 1, policy_version 484135 (0.0009) [2023-12-26 03:28:43,423][123090] Updated weights for policy 1, policy_version 484145 (0.0009) [2023-12-26 03:28:43,471][123090] Updated weights for policy 1, policy_version 484155 (0.0008) [2023-12-26 03:28:43,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17886.0, 300 sec: 17800.2). Total num frames: 248774656. Throughput: 0: 8928.0, 1: 8900.6. Samples: 248766652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:43,785][121949] Avg episode reward: [(0, '5965.461'), (1, '5630.290')] [2023-12-26 03:28:44,156][123091] Updated weights for policy 0, policy_version 487608 (0.0006) [2023-12-26 03:28:44,222][123091] Updated weights for policy 0, policy_version 487618 (0.0005) [2023-12-26 03:28:44,292][123090] Updated weights for policy 1, policy_version 484165 (0.0007) [2023-12-26 03:28:44,293][123091] Updated weights for policy 0, policy_version 487628 (0.0006) [2023-12-26 03:28:44,340][123090] Updated weights for policy 1, policy_version 484175 (0.0005) [2023-12-26 03:28:44,391][123090] Updated weights for policy 1, policy_version 484185 (0.0006) [2023-12-26 03:28:44,930][123091] Updated weights for policy 0, policy_version 487638 (0.0006) [2023-12-26 03:28:45,006][123091] Updated weights for policy 0, policy_version 487648 (0.0007) [2023-12-26 03:28:45,073][123091] Updated weights for policy 0, policy_version 487658 (0.0008) [2023-12-26 03:28:45,159][123090] Updated weights for policy 1, policy_version 484195 (0.0008) [2023-12-26 03:28:45,231][123090] Updated weights for policy 1, policy_version 484205 (0.0010) [2023-12-26 03:28:45,285][123090] Updated weights for policy 1, policy_version 484215 (0.0009) [2023-12-26 03:28:45,855][123091] Updated weights for policy 0, policy_version 487668 (0.0009) [2023-12-26 03:28:45,902][123091] Updated weights for policy 0, policy_version 487678 (0.0010) [2023-12-26 03:28:45,950][123091] Updated weights for policy 0, policy_version 487688 (0.0010) [2023-12-26 03:28:46,087][123090] Updated weights for policy 1, policy_version 484225 (0.0009) [2023-12-26 03:28:46,154][123090] Updated weights for policy 1, policy_version 484235 (0.0009) [2023-12-26 03:28:46,205][123090] Updated weights for policy 1, policy_version 484245 (0.0005) [2023-12-26 03:28:46,263][123090] Updated weights for policy 1, policy_version 484255 (0.0005) [2023-12-26 03:28:46,802][123091] Updated weights for policy 0, policy_version 487698 (0.0010) [2023-12-26 03:28:46,859][123091] Updated weights for policy 0, policy_version 487708 (0.0010) [2023-12-26 03:28:46,910][123091] Updated weights for policy 0, policy_version 487718 (0.0009) [2023-12-26 03:28:46,934][123090] Updated weights for policy 1, policy_version 484265 (0.0005) [2023-12-26 03:28:46,968][123091] Updated weights for policy 0, policy_version 487728 (0.0009) [2023-12-26 03:28:46,991][123090] Updated weights for policy 1, policy_version 484275 (0.0005) [2023-12-26 03:28:47,052][123090] Updated weights for policy 1, policy_version 484285 (0.0005) [2023-12-26 03:28:47,777][123090] Updated weights for policy 1, policy_version 484295 (0.0005) [2023-12-26 03:28:47,827][123090] Updated weights for policy 1, policy_version 484305 (0.0005) [2023-12-26 03:28:47,849][123091] Updated weights for policy 0, policy_version 487738 (0.0006) [2023-12-26 03:28:47,880][123090] Updated weights for policy 1, policy_version 484315 (0.0005) [2023-12-26 03:28:47,900][123091] Updated weights for policy 0, policy_version 487748 (0.0009) [2023-12-26 03:28:47,956][123091] Updated weights for policy 0, policy_version 487758 (0.0011) [2023-12-26 03:28:48,615][123090] Updated weights for policy 1, policy_version 484325 (0.0006) [2023-12-26 03:28:48,682][123090] Updated weights for policy 1, policy_version 484335 (0.0005) [2023-12-26 03:28:48,732][123091] Updated weights for policy 0, policy_version 487768 (0.0008) [2023-12-26 03:28:48,746][123090] Updated weights for policy 1, policy_version 484345 (0.0006) [2023-12-26 03:28:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 248856576. Throughput: 0: 8855.1, 1: 8993.4. Samples: 248876336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:48,785][121949] Avg episode reward: [(0, '6044.103'), (1, '5683.257')] [2023-12-26 03:28:48,798][123091] Updated weights for policy 0, policy_version 487778 (0.0007) [2023-12-26 03:28:48,871][123091] Updated weights for policy 0, policy_version 487788 (0.0009) [2023-12-26 03:28:49,513][123090] Updated weights for policy 1, policy_version 484355 (0.0009) [2023-12-26 03:28:49,579][123090] Updated weights for policy 1, policy_version 484365 (0.0008) [2023-12-26 03:28:49,643][123090] Updated weights for policy 1, policy_version 484375 (0.0009) [2023-12-26 03:28:49,730][123091] Updated weights for policy 0, policy_version 487798 (0.0009) [2023-12-26 03:28:49,797][123091] Updated weights for policy 0, policy_version 487808 (0.0010) [2023-12-26 03:28:49,868][123091] Updated weights for policy 0, policy_version 487818 (0.0010) [2023-12-26 03:28:50,434][123090] Updated weights for policy 1, policy_version 484385 (0.0009) [2023-12-26 03:28:50,507][123090] Updated weights for policy 1, policy_version 484395 (0.0005) [2023-12-26 03:28:50,575][123090] Updated weights for policy 1, policy_version 484405 (0.0006) [2023-12-26 03:28:50,643][123090] Updated weights for policy 1, policy_version 484415 (0.0007) [2023-12-26 03:28:50,724][123091] Updated weights for policy 0, policy_version 487828 (0.0010) [2023-12-26 03:28:50,776][123091] Updated weights for policy 0, policy_version 487838 (0.0009) [2023-12-26 03:28:50,841][123091] Updated weights for policy 0, policy_version 487848 (0.0010) [2023-12-26 03:28:51,389][123090] Updated weights for policy 1, policy_version 484425 (0.0009) [2023-12-26 03:28:51,445][123090] Updated weights for policy 1, policy_version 484435 (0.0010) [2023-12-26 03:28:51,500][123090] Updated weights for policy 1, policy_version 484445 (0.0009) [2023-12-26 03:28:51,650][123091] Updated weights for policy 0, policy_version 487858 (0.0009) [2023-12-26 03:28:51,717][123091] Updated weights for policy 0, policy_version 487868 (0.0007) [2023-12-26 03:28:51,782][123091] Updated weights for policy 0, policy_version 487878 (0.0008) [2023-12-26 03:28:51,843][123091] Updated weights for policy 0, policy_version 487888 (0.0009) [2023-12-26 03:28:52,395][123090] Updated weights for policy 1, policy_version 484455 (0.0009) [2023-12-26 03:28:52,464][123090] Updated weights for policy 1, policy_version 484465 (0.0008) [2023-12-26 03:28:52,539][123090] Updated weights for policy 1, policy_version 484475 (0.0009) [2023-12-26 03:28:52,690][123091] Updated weights for policy 0, policy_version 487898 (0.0011) [2023-12-26 03:28:52,752][123091] Updated weights for policy 0, policy_version 487908 (0.0010) [2023-12-26 03:28:52,811][123091] Updated weights for policy 0, policy_version 487918 (0.0011) [2023-12-26 03:28:53,379][123090] Updated weights for policy 1, policy_version 484485 (0.0009) [2023-12-26 03:28:53,444][123090] Updated weights for policy 1, policy_version 484495 (0.0010) [2023-12-26 03:28:53,508][123090] Updated weights for policy 1, policy_version 484505 (0.0010) [2023-12-26 03:28:53,604][123091] Updated weights for policy 0, policy_version 487928 (0.0006) [2023-12-26 03:28:53,672][123091] Updated weights for policy 0, policy_version 487938 (0.0005) [2023-12-26 03:28:53,742][123091] Updated weights for policy 0, policy_version 487948 (0.0006) [2023-12-26 03:28:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 248954880. Throughput: 0: 8795.2, 1: 9005.9. Samples: 248927416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:53,785][121949] Avg episode reward: [(0, '6032.993'), (1, '5785.547')] [2023-12-26 03:28:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000484512_124035072.pth... [2023-12-26 03:28:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000487952_124919808.pth... [2023-12-26 03:28:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000486928_124657664.pth [2023-12-26 03:28:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000483456_123764736.pth [2023-12-26 03:28:54,420][123091] Updated weights for policy 0, policy_version 487958 (0.0006) [2023-12-26 03:28:54,420][123090] Updated weights for policy 1, policy_version 484515 (0.0009) [2023-12-26 03:28:54,487][123091] Updated weights for policy 0, policy_version 487968 (0.0006) [2023-12-26 03:28:54,489][123090] Updated weights for policy 1, policy_version 484525 (0.0009) [2023-12-26 03:28:54,552][123091] Updated weights for policy 0, policy_version 487978 (0.0008) [2023-12-26 03:28:54,552][123090] Updated weights for policy 1, policy_version 484535 (0.0010) [2023-12-26 03:28:55,308][123091] Updated weights for policy 0, policy_version 487988 (0.0009) [2023-12-26 03:28:55,364][123091] Updated weights for policy 0, policy_version 487998 (0.0009) [2023-12-26 03:28:55,404][123090] Updated weights for policy 1, policy_version 484545 (0.0011) [2023-12-26 03:28:55,423][123091] Updated weights for policy 0, policy_version 488008 (0.0008) [2023-12-26 03:28:55,458][123090] Updated weights for policy 1, policy_version 484555 (0.0007) [2023-12-26 03:28:55,517][123090] Updated weights for policy 1, policy_version 484565 (0.0005) [2023-12-26 03:28:55,585][123090] Updated weights for policy 1, policy_version 484575 (0.0006) [2023-12-26 03:28:56,090][123090] Updated weights for policy 1, policy_version 484585 (0.0005) [2023-12-26 03:28:56,159][123090] Updated weights for policy 1, policy_version 484595 (0.0005) [2023-12-26 03:28:56,234][123090] Updated weights for policy 1, policy_version 484605 (0.0009) [2023-12-26 03:28:56,264][123091] Updated weights for policy 0, policy_version 488018 (0.0009) [2023-12-26 03:28:56,335][123091] Updated weights for policy 0, policy_version 488028 (0.0007) [2023-12-26 03:28:56,408][123091] Updated weights for policy 0, policy_version 488038 (0.0006) [2023-12-26 03:28:56,465][123091] Updated weights for policy 0, policy_version 488048 (0.0005) [2023-12-26 03:28:57,004][123090] Updated weights for policy 1, policy_version 484615 (0.0007) [2023-12-26 03:28:57,071][123090] Updated weights for policy 1, policy_version 484625 (0.0006) [2023-12-26 03:28:57,120][123091] Updated weights for policy 0, policy_version 488058 (0.0008) [2023-12-26 03:28:57,135][123090] Updated weights for policy 1, policy_version 484635 (0.0008) [2023-12-26 03:28:57,186][123091] Updated weights for policy 0, policy_version 488068 (0.0006) [2023-12-26 03:28:57,249][123091] Updated weights for policy 0, policy_version 488078 (0.0009) [2023-12-26 03:28:57,861][123090] Updated weights for policy 1, policy_version 484645 (0.0007) [2023-12-26 03:28:57,907][123090] Updated weights for policy 1, policy_version 484655 (0.0006) [2023-12-26 03:28:57,947][123091] Updated weights for policy 0, policy_version 488088 (0.0008) [2023-12-26 03:28:57,958][123090] Updated weights for policy 1, policy_version 484665 (0.0007) [2023-12-26 03:28:58,019][123091] Updated weights for policy 0, policy_version 488098 (0.0007) [2023-12-26 03:28:58,089][123091] Updated weights for policy 0, policy_version 488108 (0.0007) [2023-12-26 03:28:58,770][123090] Updated weights for policy 1, policy_version 484675 (0.0009) [2023-12-26 03:28:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 249036800. Throughput: 0: 8833.2, 1: 9035.7. Samples: 249034804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:28:58,784][121949] Avg episode reward: [(0, '6004.860'), (1, '5889.170')] [2023-12-26 03:28:58,849][123091] Updated weights for policy 0, policy_version 488118 (0.0008) [2023-12-26 03:28:58,851][123090] Updated weights for policy 1, policy_version 484685 (0.0010) [2023-12-26 03:28:58,915][123091] Updated weights for policy 0, policy_version 488128 (0.0009) [2023-12-26 03:28:58,920][123090] Updated weights for policy 1, policy_version 484695 (0.0010) [2023-12-26 03:28:58,975][123091] Updated weights for policy 0, policy_version 488138 (0.0007) [2023-12-26 03:28:59,693][123090] Updated weights for policy 1, policy_version 484705 (0.0009) [2023-12-26 03:28:59,731][123091] Updated weights for policy 0, policy_version 488148 (0.0008) [2023-12-26 03:28:59,759][123090] Updated weights for policy 1, policy_version 484715 (0.0005) [2023-12-26 03:28:59,795][123091] Updated weights for policy 0, policy_version 488158 (0.0009) [2023-12-26 03:28:59,819][123090] Updated weights for policy 1, policy_version 484725 (0.0006) [2023-12-26 03:28:59,860][123091] Updated weights for policy 0, policy_version 488168 (0.0009) [2023-12-26 03:28:59,886][123090] Updated weights for policy 1, policy_version 484735 (0.0007) [2023-12-26 03:29:00,573][123090] Updated weights for policy 1, policy_version 484745 (0.0010) [2023-12-26 03:29:00,617][123090] Updated weights for policy 1, policy_version 484755 (0.0010) [2023-12-26 03:29:00,665][123090] Updated weights for policy 1, policy_version 484765 (0.0010) [2023-12-26 03:29:00,709][123091] Updated weights for policy 0, policy_version 488178 (0.0010) [2023-12-26 03:29:00,768][123091] Updated weights for policy 0, policy_version 488188 (0.0009) [2023-12-26 03:29:00,829][123091] Updated weights for policy 0, policy_version 488198 (0.0010) [2023-12-26 03:29:00,884][123091] Updated weights for policy 0, policy_version 488208 (0.0010) [2023-12-26 03:29:01,452][123090] Updated weights for policy 1, policy_version 484775 (0.0010) [2023-12-26 03:29:01,507][123090] Updated weights for policy 1, policy_version 484785 (0.0010) [2023-12-26 03:29:01,568][123090] Updated weights for policy 1, policy_version 484795 (0.0010) [2023-12-26 03:29:01,725][123091] Updated weights for policy 0, policy_version 488218 (0.0007) [2023-12-26 03:29:01,780][123091] Updated weights for policy 0, policy_version 488228 (0.0010) [2023-12-26 03:29:01,837][123091] Updated weights for policy 0, policy_version 488238 (0.0010) [2023-12-26 03:29:02,363][123090] Updated weights for policy 1, policy_version 484805 (0.0008) [2023-12-26 03:29:02,419][123090] Updated weights for policy 1, policy_version 484815 (0.0006) [2023-12-26 03:29:02,475][123090] Updated weights for policy 1, policy_version 484825 (0.0005) [2023-12-26 03:29:02,736][123091] Updated weights for policy 0, policy_version 488248 (0.0010) [2023-12-26 03:29:02,791][123091] Updated weights for policy 0, policy_version 488258 (0.0009) [2023-12-26 03:29:02,842][123091] Updated weights for policy 0, policy_version 488268 (0.0009) [2023-12-26 03:29:03,041][123090] Updated weights for policy 1, policy_version 484835 (0.0006) [2023-12-26 03:29:03,099][123090] Updated weights for policy 1, policy_version 484845 (0.0010) [2023-12-26 03:29:03,162][123090] Updated weights for policy 1, policy_version 484855 (0.0009) [2023-12-26 03:29:03,697][123091] Updated weights for policy 0, policy_version 488278 (0.0010) [2023-12-26 03:29:03,750][123091] Updated weights for policy 0, policy_version 488288 (0.0009) [2023-12-26 03:29:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 249126912. Throughput: 0: 8775.1, 1: 9104.0. Samples: 249142692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:03,784][121949] Avg episode reward: [(0, '6004.288'), (1, '5874.464')] [2023-12-26 03:29:03,808][123091] Updated weights for policy 0, policy_version 488298 (0.0010) [2023-12-26 03:29:03,912][123090] Updated weights for policy 1, policy_version 484865 (0.0009) [2023-12-26 03:29:03,986][123090] Updated weights for policy 1, policy_version 484875 (0.0008) [2023-12-26 03:29:04,047][123090] Updated weights for policy 1, policy_version 484885 (0.0011) [2023-12-26 03:29:04,114][123090] Updated weights for policy 1, policy_version 484895 (0.0011) [2023-12-26 03:29:04,663][123091] Updated weights for policy 0, policy_version 488309 (0.0010) [2023-12-26 03:29:04,727][123091] Updated weights for policy 0, policy_version 488319 (0.0011) [2023-12-26 03:29:04,798][123091] Updated weights for policy 0, policy_version 488329 (0.0011) [2023-12-26 03:29:04,935][123090] Updated weights for policy 1, policy_version 484905 (0.0006) [2023-12-26 03:29:04,994][123090] Updated weights for policy 1, policy_version 484915 (0.0006) [2023-12-26 03:29:05,051][123090] Updated weights for policy 1, policy_version 484925 (0.0008) [2023-12-26 03:29:05,620][123091] Updated weights for policy 0, policy_version 488339 (0.0011) [2023-12-26 03:29:05,678][123091] Updated weights for policy 0, policy_version 488349 (0.0010) [2023-12-26 03:29:05,734][123091] Updated weights for policy 0, policy_version 488359 (0.0010) [2023-12-26 03:29:05,819][123090] Updated weights for policy 1, policy_version 484935 (0.0006) [2023-12-26 03:29:05,869][123090] Updated weights for policy 1, policy_version 484945 (0.0005) [2023-12-26 03:29:05,917][123090] Updated weights for policy 1, policy_version 484955 (0.0005) [2023-12-26 03:29:06,573][123091] Updated weights for policy 0, policy_version 488369 (0.0011) [2023-12-26 03:29:06,637][123091] Updated weights for policy 0, policy_version 488379 (0.0011) [2023-12-26 03:29:06,685][123090] Updated weights for policy 1, policy_version 484965 (0.0008) [2023-12-26 03:29:06,693][123091] Updated weights for policy 0, policy_version 488389 (0.0011) [2023-12-26 03:29:06,737][123090] Updated weights for policy 1, policy_version 484975 (0.0010) [2023-12-26 03:29:06,749][123091] Updated weights for policy 0, policy_version 488399 (0.0011) [2023-12-26 03:29:06,797][123090] Updated weights for policy 1, policy_version 484985 (0.0010) [2023-12-26 03:29:07,460][123091] Updated weights for policy 0, policy_version 488409 (0.0011) [2023-12-26 03:29:07,533][123091] Updated weights for policy 0, policy_version 488419 (0.0005) [2023-12-26 03:29:07,607][123091] Updated weights for policy 0, policy_version 488429 (0.0008) [2023-12-26 03:29:07,631][123090] Updated weights for policy 1, policy_version 484995 (0.0010) [2023-12-26 03:29:07,686][123090] Updated weights for policy 1, policy_version 485005 (0.0010) [2023-12-26 03:29:07,743][123090] Updated weights for policy 1, policy_version 485015 (0.0010) [2023-12-26 03:29:08,387][123091] Updated weights for policy 0, policy_version 488439 (0.0008) [2023-12-26 03:29:08,443][123091] Updated weights for policy 0, policy_version 488449 (0.0011) [2023-12-26 03:29:08,478][123090] Updated weights for policy 1, policy_version 485025 (0.0007) [2023-12-26 03:29:08,495][123091] Updated weights for policy 0, policy_version 488459 (0.0011) [2023-12-26 03:29:08,530][123090] Updated weights for policy 1, policy_version 485035 (0.0010) [2023-12-26 03:29:08,585][123090] Updated weights for policy 1, policy_version 485045 (0.0008) [2023-12-26 03:29:08,647][123090] Updated weights for policy 1, policy_version 485055 (0.0007) [2023-12-26 03:29:08,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 249225216. Throughput: 0: 8766.6, 1: 9153.8. Samples: 249195592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:08,785][121949] Avg episode reward: [(0, '6026.537'), (1, '5833.307')] [2023-12-26 03:29:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000485056_124174336.pth... [2023-12-26 03:29:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000488464_125050880.pth... [2023-12-26 03:29:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000487440_124788736.pth [2023-12-26 03:29:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000483968_123895808.pth [2023-12-26 03:29:09,338][123091] Updated weights for policy 0, policy_version 488469 (0.0010) [2023-12-26 03:29:09,403][123091] Updated weights for policy 0, policy_version 488479 (0.0010) [2023-12-26 03:29:09,457][123091] Updated weights for policy 0, policy_version 488489 (0.0009) [2023-12-26 03:29:09,496][123090] Updated weights for policy 1, policy_version 485065 (0.0008) [2023-12-26 03:29:09,566][123090] Updated weights for policy 1, policy_version 485075 (0.0008) [2023-12-26 03:29:09,632][123090] Updated weights for policy 1, policy_version 485085 (0.0008) [2023-12-26 03:29:10,380][123091] Updated weights for policy 0, policy_version 488499 (0.0008) [2023-12-26 03:29:10,431][123090] Updated weights for policy 1, policy_version 485095 (0.0009) [2023-12-26 03:29:10,444][123091] Updated weights for policy 0, policy_version 488509 (0.0007) [2023-12-26 03:29:10,490][123090] Updated weights for policy 1, policy_version 485105 (0.0009) [2023-12-26 03:29:10,494][123091] Updated weights for policy 0, policy_version 488519 (0.0009) [2023-12-26 03:29:10,546][123090] Updated weights for policy 1, policy_version 485115 (0.0006) [2023-12-26 03:29:11,373][123090] Updated weights for policy 1, policy_version 485125 (0.0010) [2023-12-26 03:29:11,393][123091] Updated weights for policy 0, policy_version 488530 (0.0009) [2023-12-26 03:29:11,440][123090] Updated weights for policy 1, policy_version 485135 (0.0009) [2023-12-26 03:29:11,450][123091] Updated weights for policy 0, policy_version 488540 (0.0010) [2023-12-26 03:29:11,502][123091] Updated weights for policy 0, policy_version 488550 (0.0008) [2023-12-26 03:29:11,506][123090] Updated weights for policy 1, policy_version 485145 (0.0008) [2023-12-26 03:29:11,558][123091] Updated weights for policy 0, policy_version 488560 (0.0008) [2023-12-26 03:29:12,301][123090] Updated weights for policy 1, policy_version 485155 (0.0008) [2023-12-26 03:29:12,372][123090] Updated weights for policy 1, policy_version 485165 (0.0009) [2023-12-26 03:29:12,428][123090] Updated weights for policy 1, policy_version 485175 (0.0006) [2023-12-26 03:29:12,467][123091] Updated weights for policy 0, policy_version 488570 (0.0009) [2023-12-26 03:29:12,523][123091] Updated weights for policy 0, policy_version 488580 (0.0010) [2023-12-26 03:29:12,582][123091] Updated weights for policy 0, policy_version 488590 (0.0010) [2023-12-26 03:29:13,163][123090] Updated weights for policy 1, policy_version 485185 (0.0006) [2023-12-26 03:29:13,225][123090] Updated weights for policy 1, policy_version 485195 (0.0010) [2023-12-26 03:29:13,284][123090] Updated weights for policy 1, policy_version 485205 (0.0010) [2023-12-26 03:29:13,336][123090] Updated weights for policy 1, policy_version 485215 (0.0009) [2023-12-26 03:29:13,382][123091] Updated weights for policy 0, policy_version 488600 (0.0007) [2023-12-26 03:29:13,429][123091] Updated weights for policy 0, policy_version 488610 (0.0010) [2023-12-26 03:29:13,484][123091] Updated weights for policy 0, policy_version 488620 (0.0010) [2023-12-26 03:29:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 249307136. Throughput: 0: 8655.1, 1: 9125.3. Samples: 249298536. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:13,785][121949] Avg episode reward: [(0, '5993.674'), (1, '5862.546')] [2023-12-26 03:29:14,066][123090] Updated weights for policy 1, policy_version 485225 (0.0005) [2023-12-26 03:29:14,121][123090] Updated weights for policy 1, policy_version 485235 (0.0005) [2023-12-26 03:29:14,173][123090] Updated weights for policy 1, policy_version 485245 (0.0010) [2023-12-26 03:29:14,249][123091] Updated weights for policy 0, policy_version 488630 (0.0008) [2023-12-26 03:29:14,308][123091] Updated weights for policy 0, policy_version 488640 (0.0009) [2023-12-26 03:29:14,370][123091] Updated weights for policy 0, policy_version 488650 (0.0009) [2023-12-26 03:29:14,970][123090] Updated weights for policy 1, policy_version 485256 (0.0007) [2023-12-26 03:29:15,043][123090] Updated weights for policy 1, policy_version 485266 (0.0006) [2023-12-26 03:29:15,114][123090] Updated weights for policy 1, policy_version 485276 (0.0006) [2023-12-26 03:29:15,182][123091] Updated weights for policy 0, policy_version 488660 (0.0010) [2023-12-26 03:29:15,246][123091] Updated weights for policy 0, policy_version 488670 (0.0010) [2023-12-26 03:29:15,305][123091] Updated weights for policy 0, policy_version 488680 (0.0010) [2023-12-26 03:29:15,878][123090] Updated weights for policy 1, policy_version 485286 (0.0008) [2023-12-26 03:29:15,936][123090] Updated weights for policy 1, policy_version 485296 (0.0009) [2023-12-26 03:29:15,989][123090] Updated weights for policy 1, policy_version 485306 (0.0009) [2023-12-26 03:29:16,037][123091] Updated weights for policy 0, policy_version 488690 (0.0011) [2023-12-26 03:29:16,103][123091] Updated weights for policy 0, policy_version 488700 (0.0011) [2023-12-26 03:29:16,162][123091] Updated weights for policy 0, policy_version 488710 (0.0010) [2023-12-26 03:29:16,210][123091] Updated weights for policy 0, policy_version 488720 (0.0010) [2023-12-26 03:29:16,835][123090] Updated weights for policy 1, policy_version 485316 (0.0008) [2023-12-26 03:29:16,883][123090] Updated weights for policy 1, policy_version 485326 (0.0005) [2023-12-26 03:29:16,934][123090] Updated weights for policy 1, policy_version 485336 (0.0006) [2023-12-26 03:29:16,936][123091] Updated weights for policy 0, policy_version 488730 (0.0009) [2023-12-26 03:29:16,992][123091] Updated weights for policy 0, policy_version 488740 (0.0005) [2023-12-26 03:29:17,057][123091] Updated weights for policy 0, policy_version 488750 (0.0005) [2023-12-26 03:29:17,671][123090] Updated weights for policy 1, policy_version 485346 (0.0005) [2023-12-26 03:29:17,726][123090] Updated weights for policy 1, policy_version 485356 (0.0007) [2023-12-26 03:29:17,765][123091] Updated weights for policy 0, policy_version 488760 (0.0005) [2023-12-26 03:29:17,778][123090] Updated weights for policy 1, policy_version 485366 (0.0010) [2023-12-26 03:29:17,815][123091] Updated weights for policy 0, policy_version 488770 (0.0005) [2023-12-26 03:29:17,823][123090] Updated weights for policy 1, policy_version 485376 (0.0010) [2023-12-26 03:29:17,864][123091] Updated weights for policy 0, policy_version 488780 (0.0005) [2023-12-26 03:29:18,605][123090] Updated weights for policy 1, policy_version 485386 (0.0008) [2023-12-26 03:29:18,607][123091] Updated weights for policy 0, policy_version 488790 (0.0008) [2023-12-26 03:29:18,663][123091] Updated weights for policy 0, policy_version 488800 (0.0011) [2023-12-26 03:29:18,677][123090] Updated weights for policy 1, policy_version 485396 (0.0006) [2023-12-26 03:29:18,707][123091] Updated weights for policy 0, policy_version 488810 (0.0010) [2023-12-26 03:29:18,742][123090] Updated weights for policy 1, policy_version 485406 (0.0009) [2023-12-26 03:29:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 249405440. Throughput: 0: 8738.1, 1: 9148.5. Samples: 249411028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:18,785][121949] Avg episode reward: [(0, '6023.170'), (1, '5884.739')] [2023-12-26 03:29:19,559][123090] Updated weights for policy 1, policy_version 485416 (0.0009) [2023-12-26 03:29:19,569][123091] Updated weights for policy 0, policy_version 488820 (0.0009) [2023-12-26 03:29:19,627][123090] Updated weights for policy 1, policy_version 485426 (0.0009) [2023-12-26 03:29:19,635][123091] Updated weights for policy 0, policy_version 488830 (0.0008) [2023-12-26 03:29:19,698][123090] Updated weights for policy 1, policy_version 485436 (0.0009) [2023-12-26 03:29:19,701][123091] Updated weights for policy 0, policy_version 488840 (0.0009) [2023-12-26 03:29:20,502][123091] Updated weights for policy 0, policy_version 488850 (0.0009) [2023-12-26 03:29:20,565][123090] Updated weights for policy 1, policy_version 485446 (0.0008) [2023-12-26 03:29:20,570][123091] Updated weights for policy 0, policy_version 488860 (0.0008) [2023-12-26 03:29:20,633][123090] Updated weights for policy 1, policy_version 485456 (0.0010) [2023-12-26 03:29:20,634][123091] Updated weights for policy 0, policy_version 488870 (0.0007) [2023-12-26 03:29:20,688][123091] Updated weights for policy 0, policy_version 488880 (0.0006) [2023-12-26 03:29:20,699][123090] Updated weights for policy 1, policy_version 485466 (0.0009) [2023-12-26 03:29:21,501][123091] Updated weights for policy 0, policy_version 488890 (0.0010) [2023-12-26 03:29:21,566][123091] Updated weights for policy 0, policy_version 488900 (0.0009) [2023-12-26 03:29:21,596][123090] Updated weights for policy 1, policy_version 485476 (0.0008) [2023-12-26 03:29:21,641][123091] Updated weights for policy 0, policy_version 488910 (0.0009) [2023-12-26 03:29:21,671][123090] Updated weights for policy 1, policy_version 485486 (0.0009) [2023-12-26 03:29:21,739][123090] Updated weights for policy 1, policy_version 485496 (0.0009) [2023-12-26 03:29:22,457][123090] Updated weights for policy 1, policy_version 485506 (0.0006) [2023-12-26 03:29:22,482][123091] Updated weights for policy 0, policy_version 488920 (0.0009) [2023-12-26 03:29:22,507][123090] Updated weights for policy 1, policy_version 485516 (0.0007) [2023-12-26 03:29:22,542][123091] Updated weights for policy 0, policy_version 488930 (0.0007) [2023-12-26 03:29:22,570][123090] Updated weights for policy 1, policy_version 485526 (0.0010) [2023-12-26 03:29:22,609][123091] Updated weights for policy 0, policy_version 488940 (0.0008) [2023-12-26 03:29:22,629][123090] Updated weights for policy 1, policy_version 485536 (0.0009) [2023-12-26 03:29:23,432][123090] Updated weights for policy 1, policy_version 485546 (0.0007) [2023-12-26 03:29:23,452][123091] Updated weights for policy 0, policy_version 488950 (0.0006) [2023-12-26 03:29:23,494][123090] Updated weights for policy 1, policy_version 485556 (0.0007) [2023-12-26 03:29:23,520][123091] Updated weights for policy 0, policy_version 488960 (0.0006) [2023-12-26 03:29:23,559][123090] Updated weights for policy 1, policy_version 485566 (0.0006) [2023-12-26 03:29:23,587][123091] Updated weights for policy 0, policy_version 488970 (0.0006) [2023-12-26 03:29:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 249487360. Throughput: 0: 8694.8, 1: 9090.3. Samples: 249461388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:23,785][121949] Avg episode reward: [(0, '5954.533'), (1, '5788.887')] [2023-12-26 03:29:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000488976_125181952.pth... [2023-12-26 03:29:23,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000485568_124305408.pth... [2023-12-26 03:29:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000484512_124035072.pth [2023-12-26 03:29:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000487952_124919808.pth [2023-12-26 03:29:24,136][123090] Updated weights for policy 1, policy_version 485576 (0.0005) [2023-12-26 03:29:24,193][123090] Updated weights for policy 1, policy_version 485586 (0.0005) [2023-12-26 03:29:24,254][123090] Updated weights for policy 1, policy_version 485596 (0.0006) [2023-12-26 03:29:24,347][123091] Updated weights for policy 0, policy_version 488980 (0.0008) [2023-12-26 03:29:24,400][123091] Updated weights for policy 0, policy_version 488990 (0.0009) [2023-12-26 03:29:24,469][123091] Updated weights for policy 0, policy_version 489001 (0.0009) [2023-12-26 03:29:25,056][123090] Updated weights for policy 1, policy_version 485606 (0.0010) [2023-12-26 03:29:25,124][123090] Updated weights for policy 1, policy_version 485616 (0.0009) [2023-12-26 03:29:25,187][123090] Updated weights for policy 1, policy_version 485626 (0.0010) [2023-12-26 03:29:25,250][123091] Updated weights for policy 0, policy_version 489011 (0.0009) [2023-12-26 03:29:25,312][123091] Updated weights for policy 0, policy_version 489021 (0.0010) [2023-12-26 03:29:25,373][123091] Updated weights for policy 0, policy_version 489031 (0.0009) [2023-12-26 03:29:25,986][123090] Updated weights for policy 1, policy_version 485636 (0.0008) [2023-12-26 03:29:26,048][123090] Updated weights for policy 1, policy_version 485646 (0.0005) [2023-12-26 03:29:26,098][123090] Updated weights for policy 1, policy_version 485656 (0.0006) [2023-12-26 03:29:26,207][123091] Updated weights for policy 0, policy_version 489041 (0.0009) [2023-12-26 03:29:26,268][123091] Updated weights for policy 0, policy_version 489051 (0.0010) [2023-12-26 03:29:26,332][123091] Updated weights for policy 0, policy_version 489061 (0.0010) [2023-12-26 03:29:26,383][123091] Updated weights for policy 0, policy_version 489071 (0.0010) [2023-12-26 03:29:26,845][123090] Updated weights for policy 1, policy_version 485666 (0.0008) [2023-12-26 03:29:26,898][123090] Updated weights for policy 1, policy_version 485676 (0.0006) [2023-12-26 03:29:26,959][123090] Updated weights for policy 1, policy_version 485686 (0.0006) [2023-12-26 03:29:27,024][123090] Updated weights for policy 1, policy_version 485696 (0.0005) [2023-12-26 03:29:27,131][123091] Updated weights for policy 0, policy_version 489081 (0.0006) [2023-12-26 03:29:27,189][123091] Updated weights for policy 0, policy_version 489091 (0.0005) [2023-12-26 03:29:27,245][123091] Updated weights for policy 0, policy_version 489101 (0.0009) [2023-12-26 03:29:27,729][123090] Updated weights for policy 1, policy_version 485706 (0.0009) [2023-12-26 03:29:27,796][123090] Updated weights for policy 1, policy_version 485716 (0.0009) [2023-12-26 03:29:27,860][123090] Updated weights for policy 1, policy_version 485726 (0.0009) [2023-12-26 03:29:27,943][123091] Updated weights for policy 0, policy_version 489111 (0.0010) [2023-12-26 03:29:28,009][123091] Updated weights for policy 0, policy_version 489121 (0.0010) [2023-12-26 03:29:28,067][123091] Updated weights for policy 0, policy_version 489131 (0.0010) [2023-12-26 03:29:28,642][123090] Updated weights for policy 1, policy_version 485736 (0.0005) [2023-12-26 03:29:28,714][123090] Updated weights for policy 1, policy_version 485746 (0.0006) [2023-12-26 03:29:28,779][123090] Updated weights for policy 1, policy_version 485756 (0.0009) [2023-12-26 03:29:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 249569280. Throughput: 0: 8782.3, 1: 9069.6. Samples: 249569988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:28,785][121949] Avg episode reward: [(0, '5943.889'), (1, '5745.206')] [2023-12-26 03:29:28,862][123091] Updated weights for policy 0, policy_version 489141 (0.0010) [2023-12-26 03:29:28,915][123091] Updated weights for policy 0, policy_version 489151 (0.0007) [2023-12-26 03:29:28,970][123091] Updated weights for policy 0, policy_version 489161 (0.0006) [2023-12-26 03:29:29,482][123090] Updated weights for policy 1, policy_version 485766 (0.0010) [2023-12-26 03:29:29,537][123090] Updated weights for policy 1, policy_version 485776 (0.0007) [2023-12-26 03:29:29,603][123090] Updated weights for policy 1, policy_version 485786 (0.0006) [2023-12-26 03:29:29,752][123091] Updated weights for policy 0, policy_version 489171 (0.0005) [2023-12-26 03:29:29,831][123091] Updated weights for policy 0, policy_version 489181 (0.0008) [2023-12-26 03:29:29,897][123091] Updated weights for policy 0, policy_version 489191 (0.0008) [2023-12-26 03:29:30,299][123090] Updated weights for policy 1, policy_version 485796 (0.0005) [2023-12-26 03:29:30,346][123090] Updated weights for policy 1, policy_version 485806 (0.0005) [2023-12-26 03:29:30,410][123090] Updated weights for policy 1, policy_version 485816 (0.0005) [2023-12-26 03:29:30,622][123091] Updated weights for policy 0, policy_version 489201 (0.0008) [2023-12-26 03:29:30,681][123091] Updated weights for policy 0, policy_version 489211 (0.0006) [2023-12-26 03:29:30,729][123091] Updated weights for policy 0, policy_version 489221 (0.0006) [2023-12-26 03:29:30,779][123091] Updated weights for policy 0, policy_version 489231 (0.0005) [2023-12-26 03:29:31,039][123090] Updated weights for policy 1, policy_version 485826 (0.0006) [2023-12-26 03:29:31,096][123090] Updated weights for policy 1, policy_version 485836 (0.0006) [2023-12-26 03:29:31,162][123090] Updated weights for policy 1, policy_version 485846 (0.0007) [2023-12-26 03:29:31,235][123090] Updated weights for policy 1, policy_version 485856 (0.0006) [2023-12-26 03:29:31,421][123091] Updated weights for policy 0, policy_version 489241 (0.0010) [2023-12-26 03:29:31,491][123091] Updated weights for policy 0, policy_version 489251 (0.0011) [2023-12-26 03:29:31,558][123091] Updated weights for policy 0, policy_version 489261 (0.0010) [2023-12-26 03:29:32,007][123090] Updated weights for policy 1, policy_version 485866 (0.0005) [2023-12-26 03:29:32,073][123090] Updated weights for policy 1, policy_version 485876 (0.0005) [2023-12-26 03:29:32,150][123090] Updated weights for policy 1, policy_version 485886 (0.0005) [2023-12-26 03:29:32,285][123091] Updated weights for policy 0, policy_version 489271 (0.0008) [2023-12-26 03:29:32,355][123091] Updated weights for policy 0, policy_version 489281 (0.0005) [2023-12-26 03:29:32,413][123091] Updated weights for policy 0, policy_version 489291 (0.0008) [2023-12-26 03:29:32,796][123090] Updated weights for policy 1, policy_version 485896 (0.0005) [2023-12-26 03:29:32,860][123090] Updated weights for policy 1, policy_version 485906 (0.0005) [2023-12-26 03:29:32,915][123090] Updated weights for policy 1, policy_version 485916 (0.0008) [2023-12-26 03:29:33,060][123091] Updated weights for policy 0, policy_version 489301 (0.0007) [2023-12-26 03:29:33,104][123091] Updated weights for policy 0, policy_version 489311 (0.0005) [2023-12-26 03:29:33,165][123091] Updated weights for policy 0, policy_version 489321 (0.0006) [2023-12-26 03:29:33,583][123090] Updated weights for policy 1, policy_version 485927 (0.0009) [2023-12-26 03:29:33,636][123090] Updated weights for policy 1, policy_version 485937 (0.0009) [2023-12-26 03:29:33,688][123090] Updated weights for policy 1, policy_version 485947 (0.0009) [2023-12-26 03:29:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 249675776. Throughput: 0: 8873.0, 1: 9097.6. Samples: 249685020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:33,785][121949] Avg episode reward: [(0, '6012.279'), (1, '5795.757')] [2023-12-26 03:29:33,908][123091] Updated weights for policy 0, policy_version 489331 (0.0007) [2023-12-26 03:29:33,969][123091] Updated weights for policy 0, policy_version 489341 (0.0010) [2023-12-26 03:29:34,026][123091] Updated weights for policy 0, policy_version 489352 (0.0010) [2023-12-26 03:29:34,497][123090] Updated weights for policy 1, policy_version 485957 (0.0009) [2023-12-26 03:29:34,567][123090] Updated weights for policy 1, policy_version 485967 (0.0009) [2023-12-26 03:29:34,631][123090] Updated weights for policy 1, policy_version 485977 (0.0009) [2023-12-26 03:29:34,918][123091] Updated weights for policy 0, policy_version 489362 (0.0010) [2023-12-26 03:29:34,976][123091] Updated weights for policy 0, policy_version 489372 (0.0009) [2023-12-26 03:29:35,027][123091] Updated weights for policy 0, policy_version 489382 (0.0009) [2023-12-26 03:29:35,085][123091] Updated weights for policy 0, policy_version 489392 (0.0009) [2023-12-26 03:29:35,351][123090] Updated weights for policy 1, policy_version 485987 (0.0009) [2023-12-26 03:29:35,416][123090] Updated weights for policy 1, policy_version 485997 (0.0010) [2023-12-26 03:29:35,471][123090] Updated weights for policy 1, policy_version 486007 (0.0010) [2023-12-26 03:29:35,945][123091] Updated weights for policy 0, policy_version 489402 (0.0009) [2023-12-26 03:29:35,996][123091] Updated weights for policy 0, policy_version 489412 (0.0009) [2023-12-26 03:29:36,051][123091] Updated weights for policy 0, policy_version 489423 (0.0010) [2023-12-26 03:29:36,258][123090] Updated weights for policy 1, policy_version 486017 (0.0010) [2023-12-26 03:29:36,309][123090] Updated weights for policy 1, policy_version 486027 (0.0008) [2023-12-26 03:29:36,362][123090] Updated weights for policy 1, policy_version 486037 (0.0011) [2023-12-26 03:29:36,411][123090] Updated weights for policy 1, policy_version 486047 (0.0010) [2023-12-26 03:29:36,904][123091] Updated weights for policy 0, policy_version 489433 (0.0010) [2023-12-26 03:29:36,966][123091] Updated weights for policy 0, policy_version 489443 (0.0008) [2023-12-26 03:29:37,023][123091] Updated weights for policy 0, policy_version 489453 (0.0005) [2023-12-26 03:29:37,236][123090] Updated weights for policy 1, policy_version 486057 (0.0006) [2023-12-26 03:29:37,291][123090] Updated weights for policy 1, policy_version 486067 (0.0006) [2023-12-26 03:29:37,349][123090] Updated weights for policy 1, policy_version 486077 (0.0005) [2023-12-26 03:29:37,724][123091] Updated weights for policy 0, policy_version 489463 (0.0005) [2023-12-26 03:29:37,789][123091] Updated weights for policy 0, policy_version 489473 (0.0007) [2023-12-26 03:29:37,860][123091] Updated weights for policy 0, policy_version 489483 (0.0011) [2023-12-26 03:29:37,968][123090] Updated weights for policy 1, policy_version 486087 (0.0007) [2023-12-26 03:29:38,040][123090] Updated weights for policy 1, policy_version 486097 (0.0007) [2023-12-26 03:29:38,112][123090] Updated weights for policy 1, policy_version 486107 (0.0006) [2023-12-26 03:29:38,545][123091] Updated weights for policy 0, policy_version 489493 (0.0011) [2023-12-26 03:29:38,612][123091] Updated weights for policy 0, policy_version 489503 (0.0011) [2023-12-26 03:29:38,680][123091] Updated weights for policy 0, policy_version 489513 (0.0011) [2023-12-26 03:29:38,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 249765888. Throughput: 0: 8872.5, 1: 9119.2. Samples: 249737044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:29:38,785][121949] Avg episode reward: [(0, '5814.520'), (1, '5828.694')] [2023-12-26 03:29:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000489520_125321216.pth... [2023-12-26 03:29:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000486112_124444672.pth... [2023-12-26 03:29:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000485056_124174336.pth [2023-12-26 03:29:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000488464_125050880.pth [2023-12-26 03:29:38,889][123090] Updated weights for policy 1, policy_version 486117 (0.0009) [2023-12-26 03:29:38,953][123090] Updated weights for policy 1, policy_version 486127 (0.0011) [2023-12-26 03:29:39,016][123090] Updated weights for policy 1, policy_version 486137 (0.0011) [2023-12-26 03:29:39,418][123091] Updated weights for policy 0, policy_version 489523 (0.0009) [2023-12-26 03:29:39,482][123091] Updated weights for policy 0, policy_version 489533 (0.0010) [2023-12-26 03:29:39,550][123091] Updated weights for policy 0, policy_version 489543 (0.0009) [2023-12-26 03:29:39,884][123090] Updated weights for policy 1, policy_version 486147 (0.0010) [2023-12-26 03:29:39,957][123090] Updated weights for policy 1, policy_version 486157 (0.0011) [2023-12-26 03:29:40,025][123090] Updated weights for policy 1, policy_version 486167 (0.0011) [2023-12-26 03:29:40,281][123091] Updated weights for policy 0, policy_version 489553 (0.0005) [2023-12-26 03:29:40,336][123091] Updated weights for policy 0, policy_version 489563 (0.0005) [2023-12-26 03:29:40,396][123091] Updated weights for policy 0, policy_version 489573 (0.0010) [2023-12-26 03:29:40,457][123091] Updated weights for policy 0, policy_version 489583 (0.0007) [2023-12-26 03:29:40,864][123090] Updated weights for policy 1, policy_version 486177 (0.0011) [2023-12-26 03:29:40,931][123090] Updated weights for policy 1, policy_version 486187 (0.0011) [2023-12-26 03:29:40,994][123090] Updated weights for policy 1, policy_version 486197 (0.0011) [2023-12-26 03:29:41,076][123090] Updated weights for policy 1, policy_version 486207 (0.0010) [2023-12-26 03:29:41,092][123091] Updated weights for policy 0, policy_version 489593 (0.0007) [2023-12-26 03:29:41,151][123091] Updated weights for policy 0, policy_version 489603 (0.0009) [2023-12-26 03:29:41,219][123091] Updated weights for policy 0, policy_version 489613 (0.0009) [2023-12-26 03:29:41,878][123090] Updated weights for policy 1, policy_version 486217 (0.0009) [2023-12-26 03:29:41,939][123090] Updated weights for policy 1, policy_version 486227 (0.0008) [2023-12-26 03:29:42,003][123090] Updated weights for policy 1, policy_version 486237 (0.0009) [2023-12-26 03:29:42,077][123091] Updated weights for policy 0, policy_version 489623 (0.0010) [2023-12-26 03:29:42,137][123091] Updated weights for policy 0, policy_version 489633 (0.0010) [2023-12-26 03:29:42,192][123091] Updated weights for policy 0, policy_version 489643 (0.0010) [2023-12-26 03:29:42,800][123090] Updated weights for policy 1, policy_version 486247 (0.0006) [2023-12-26 03:29:42,875][123090] Updated weights for policy 1, policy_version 486257 (0.0005) [2023-12-26 03:29:42,948][123090] Updated weights for policy 1, policy_version 486267 (0.0005) [2023-12-26 03:29:43,080][123091] Updated weights for policy 0, policy_version 489653 (0.0008) [2023-12-26 03:29:43,132][123091] Updated weights for policy 0, policy_version 489663 (0.0005) [2023-12-26 03:29:43,179][123091] Updated weights for policy 0, policy_version 489673 (0.0005) [2023-12-26 03:29:43,669][123090] Updated weights for policy 1, policy_version 486277 (0.0007) [2023-12-26 03:29:43,724][123090] Updated weights for policy 1, policy_version 486287 (0.0009) [2023-12-26 03:29:43,781][123090] Updated weights for policy 1, policy_version 486298 (0.0010) [2023-12-26 03:29:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 249847808. Throughput: 0: 8893.3, 1: 9122.5. Samples: 249845516. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:29:43,784][121949] Avg episode reward: [(0, '5872.146'), (1, '5687.693')] [2023-12-26 03:29:43,870][123091] Updated weights for policy 0, policy_version 489683 (0.0005) [2023-12-26 03:29:43,935][123091] Updated weights for policy 0, policy_version 489693 (0.0005) [2023-12-26 03:29:43,991][123091] Updated weights for policy 0, policy_version 489703 (0.0008) [2023-12-26 03:29:44,627][123090] Updated weights for policy 1, policy_version 486308 (0.0008) [2023-12-26 03:29:44,670][123091] Updated weights for policy 0, policy_version 489713 (0.0007) [2023-12-26 03:29:44,692][123090] Updated weights for policy 1, policy_version 486318 (0.0005) [2023-12-26 03:29:44,726][123091] Updated weights for policy 0, policy_version 489723 (0.0006) [2023-12-26 03:29:44,754][123090] Updated weights for policy 1, policy_version 486328 (0.0005) [2023-12-26 03:29:44,786][123091] Updated weights for policy 0, policy_version 489733 (0.0008) [2023-12-26 03:29:44,846][123091] Updated weights for policy 0, policy_version 489743 (0.0008) [2023-12-26 03:29:45,476][123090] Updated weights for policy 1, policy_version 486338 (0.0008) [2023-12-26 03:29:45,528][123090] Updated weights for policy 1, policy_version 486348 (0.0010) [2023-12-26 03:29:45,532][123091] Updated weights for policy 0, policy_version 489753 (0.0006) [2023-12-26 03:29:45,581][123091] Updated weights for policy 0, policy_version 489763 (0.0006) [2023-12-26 03:29:45,583][123090] Updated weights for policy 1, policy_version 486358 (0.0010) [2023-12-26 03:29:45,630][123091] Updated weights for policy 0, policy_version 489773 (0.0005) [2023-12-26 03:29:45,640][123090] Updated weights for policy 1, policy_version 486368 (0.0010) [2023-12-26 03:29:46,401][123091] Updated weights for policy 0, policy_version 489783 (0.0007) [2023-12-26 03:29:46,434][123090] Updated weights for policy 1, policy_version 486378 (0.0006) [2023-12-26 03:29:46,468][123091] Updated weights for policy 0, policy_version 489793 (0.0007) [2023-12-26 03:29:46,505][123090] Updated weights for policy 1, policy_version 486388 (0.0009) [2023-12-26 03:29:46,537][123091] Updated weights for policy 0, policy_version 489803 (0.0006) [2023-12-26 03:29:46,568][123090] Updated weights for policy 1, policy_version 486398 (0.0006) [2023-12-26 03:29:47,235][123091] Updated weights for policy 0, policy_version 489813 (0.0008) [2023-12-26 03:29:47,287][123091] Updated weights for policy 0, policy_version 489823 (0.0010) [2023-12-26 03:29:47,320][123090] Updated weights for policy 1, policy_version 486408 (0.0005) [2023-12-26 03:29:47,342][123091] Updated weights for policy 0, policy_version 489833 (0.0010) [2023-12-26 03:29:47,385][123090] Updated weights for policy 1, policy_version 486418 (0.0006) [2023-12-26 03:29:47,444][123090] Updated weights for policy 1, policy_version 486428 (0.0006) [2023-12-26 03:29:48,090][123091] Updated weights for policy 0, policy_version 489843 (0.0009) [2023-12-26 03:29:48,141][123091] Updated weights for policy 0, policy_version 489853 (0.0005) [2023-12-26 03:29:48,176][123090] Updated weights for policy 1, policy_version 486438 (0.0009) [2023-12-26 03:29:48,201][123091] Updated weights for policy 0, policy_version 489863 (0.0007) [2023-12-26 03:29:48,241][123090] Updated weights for policy 1, policy_version 486448 (0.0009) [2023-12-26 03:29:48,302][123090] Updated weights for policy 1, policy_version 486458 (0.0010) [2023-12-26 03:29:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 249946112. Throughput: 0: 9058.7, 1: 9093.5. Samples: 249959548. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:29:48,785][121949] Avg episode reward: [(0, '6036.352'), (1, '5764.843')] [2023-12-26 03:29:48,894][123091] Updated weights for policy 0, policy_version 489873 (0.0007) [2023-12-26 03:29:48,962][123091] Updated weights for policy 0, policy_version 489883 (0.0009) [2023-12-26 03:29:49,026][123091] Updated weights for policy 0, policy_version 489893 (0.0009) [2023-12-26 03:29:49,088][123091] Updated weights for policy 0, policy_version 489903 (0.0009) [2023-12-26 03:29:49,173][123090] Updated weights for policy 1, policy_version 486468 (0.0010) [2023-12-26 03:29:49,228][123090] Updated weights for policy 1, policy_version 486478 (0.0009) [2023-12-26 03:29:49,299][123090] Updated weights for policy 1, policy_version 486488 (0.0010) [2023-12-26 03:29:49,803][123091] Updated weights for policy 0, policy_version 489913 (0.0009) [2023-12-26 03:29:49,868][123091] Updated weights for policy 0, policy_version 489923 (0.0009) [2023-12-26 03:29:49,936][123091] Updated weights for policy 0, policy_version 489933 (0.0009) [2023-12-26 03:29:50,209][123090] Updated weights for policy 1, policy_version 486498 (0.0009) [2023-12-26 03:29:50,281][123090] Updated weights for policy 1, policy_version 486508 (0.0006) [2023-12-26 03:29:50,351][123090] Updated weights for policy 1, policy_version 486518 (0.0005) [2023-12-26 03:29:50,420][123090] Updated weights for policy 1, policy_version 486528 (0.0006) [2023-12-26 03:29:50,723][123091] Updated weights for policy 0, policy_version 489943 (0.0007) [2023-12-26 03:29:50,786][123091] Updated weights for policy 0, policy_version 489953 (0.0006) [2023-12-26 03:29:50,850][123091] Updated weights for policy 0, policy_version 489963 (0.0009) [2023-12-26 03:29:51,130][123090] Updated weights for policy 1, policy_version 486538 (0.0011) [2023-12-26 03:29:51,206][123090] Updated weights for policy 1, policy_version 486548 (0.0011) [2023-12-26 03:29:51,273][123090] Updated weights for policy 1, policy_version 486558 (0.0009) [2023-12-26 03:29:51,600][123091] Updated weights for policy 0, policy_version 489973 (0.0008) [2023-12-26 03:29:51,673][123091] Updated weights for policy 0, policy_version 489983 (0.0010) [2023-12-26 03:29:51,742][123091] Updated weights for policy 0, policy_version 489993 (0.0010) [2023-12-26 03:29:52,041][123090] Updated weights for policy 1, policy_version 486568 (0.0008) [2023-12-26 03:29:52,097][123090] Updated weights for policy 1, policy_version 486578 (0.0008) [2023-12-26 03:29:52,166][123090] Updated weights for policy 1, policy_version 486588 (0.0009) [2023-12-26 03:29:52,526][123091] Updated weights for policy 0, policy_version 490003 (0.0009) [2023-12-26 03:29:52,594][123091] Updated weights for policy 0, policy_version 490013 (0.0010) [2023-12-26 03:29:52,646][123091] Updated weights for policy 0, policy_version 490023 (0.0009) [2023-12-26 03:29:52,903][123090] Updated weights for policy 1, policy_version 486598 (0.0009) [2023-12-26 03:29:52,968][123090] Updated weights for policy 1, policy_version 486608 (0.0009) [2023-12-26 03:29:53,028][123090] Updated weights for policy 1, policy_version 486618 (0.0009) [2023-12-26 03:29:53,456][123091] Updated weights for policy 0, policy_version 490033 (0.0009) [2023-12-26 03:29:53,517][123091] Updated weights for policy 0, policy_version 490043 (0.0010) [2023-12-26 03:29:53,579][123091] Updated weights for policy 0, policy_version 490053 (0.0010) [2023-12-26 03:29:53,640][123091] Updated weights for policy 0, policy_version 490063 (0.0010) [2023-12-26 03:29:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 250036224. Throughput: 0: 9121.6, 1: 9049.6. Samples: 250013296. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:29:53,785][121949] Avg episode reward: [(0, '5919.020'), (1, '5719.547')] [2023-12-26 03:29:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000490064_125460480.pth... [2023-12-26 03:29:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000486624_124575744.pth... [2023-12-26 03:29:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000488976_125181952.pth [2023-12-26 03:29:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000485568_124305408.pth [2023-12-26 03:29:53,836][123090] Updated weights for policy 1, policy_version 486628 (0.0009) [2023-12-26 03:29:53,895][123090] Updated weights for policy 1, policy_version 486638 (0.0009) [2023-12-26 03:29:53,946][123090] Updated weights for policy 1, policy_version 486648 (0.0009) [2023-12-26 03:29:54,310][123091] Updated weights for policy 0, policy_version 490073 (0.0009) [2023-12-26 03:29:54,378][123091] Updated weights for policy 0, policy_version 490083 (0.0011) [2023-12-26 03:29:54,441][123091] Updated weights for policy 0, policy_version 490093 (0.0010) [2023-12-26 03:29:54,841][123090] Updated weights for policy 1, policy_version 486658 (0.0010) [2023-12-26 03:29:54,906][123090] Updated weights for policy 1, policy_version 486668 (0.0009) [2023-12-26 03:29:54,979][123090] Updated weights for policy 1, policy_version 486678 (0.0009) [2023-12-26 03:29:55,047][123090] Updated weights for policy 1, policy_version 486688 (0.0010) [2023-12-26 03:29:55,210][123091] Updated weights for policy 0, policy_version 490103 (0.0007) [2023-12-26 03:29:55,263][123091] Updated weights for policy 0, policy_version 490113 (0.0005) [2023-12-26 03:29:55,306][123091] Updated weights for policy 0, policy_version 490123 (0.0005) [2023-12-26 03:29:55,950][123090] Updated weights for policy 1, policy_version 486698 (0.0009) [2023-12-26 03:29:55,961][123091] Updated weights for policy 0, policy_version 490133 (0.0005) [2023-12-26 03:29:56,014][123090] Updated weights for policy 1, policy_version 486708 (0.0008) [2023-12-26 03:29:56,019][123091] Updated weights for policy 0, policy_version 490143 (0.0005) [2023-12-26 03:29:56,067][123091] Updated weights for policy 0, policy_version 490153 (0.0007) [2023-12-26 03:29:56,069][123090] Updated weights for policy 1, policy_version 486718 (0.0007) [2023-12-26 03:29:56,809][123091] Updated weights for policy 0, policy_version 490163 (0.0010) [2023-12-26 03:29:56,876][123091] Updated weights for policy 0, policy_version 490173 (0.0009) [2023-12-26 03:29:56,927][123091] Updated weights for policy 0, policy_version 490183 (0.0009) [2023-12-26 03:29:56,936][123090] Updated weights for policy 1, policy_version 486728 (0.0007) [2023-12-26 03:29:56,999][123090] Updated weights for policy 1, policy_version 486738 (0.0008) [2023-12-26 03:29:57,067][123090] Updated weights for policy 1, policy_version 486748 (0.0009) [2023-12-26 03:29:57,784][123091] Updated weights for policy 0, policy_version 490193 (0.0009) [2023-12-26 03:29:57,832][123091] Updated weights for policy 0, policy_version 490203 (0.0009) [2023-12-26 03:29:57,883][123091] Updated weights for policy 0, policy_version 490213 (0.0010) [2023-12-26 03:29:57,884][123090] Updated weights for policy 1, policy_version 486758 (0.0008) [2023-12-26 03:29:57,935][123091] Updated weights for policy 0, policy_version 490223 (0.0008) [2023-12-26 03:29:57,945][123090] Updated weights for policy 1, policy_version 486768 (0.0008) [2023-12-26 03:29:58,011][123090] Updated weights for policy 1, policy_version 486778 (0.0010) [2023-12-26 03:29:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 250118144. Throughput: 0: 9220.7, 1: 8996.8. Samples: 250118320. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:29:58,785][121949] Avg episode reward: [(0, '5834.355'), (1, '5650.308')] [2023-12-26 03:29:58,944][123091] Updated weights for policy 0, policy_version 490233 (0.0007) [2023-12-26 03:29:58,948][123090] Updated weights for policy 1, policy_version 486788 (0.0009) [2023-12-26 03:29:59,009][123091] Updated weights for policy 0, policy_version 490243 (0.0009) [2023-12-26 03:29:59,016][123090] Updated weights for policy 1, policy_version 486798 (0.0007) [2023-12-26 03:29:59,074][123091] Updated weights for policy 0, policy_version 490253 (0.0007) [2023-12-26 03:29:59,090][123090] Updated weights for policy 1, policy_version 486808 (0.0008) [2023-12-26 03:29:59,822][123091] Updated weights for policy 0, policy_version 490263 (0.0006) [2023-12-26 03:29:59,875][123090] Updated weights for policy 1, policy_version 486818 (0.0008) [2023-12-26 03:29:59,881][123091] Updated weights for policy 0, policy_version 490273 (0.0008) [2023-12-26 03:29:59,942][123090] Updated weights for policy 1, policy_version 486828 (0.0009) [2023-12-26 03:29:59,948][123091] Updated weights for policy 0, policy_version 490283 (0.0011) [2023-12-26 03:30:00,008][123090] Updated weights for policy 1, policy_version 486838 (0.0008) [2023-12-26 03:30:00,070][123090] Updated weights for policy 1, policy_version 486848 (0.0009) [2023-12-26 03:30:00,747][123091] Updated weights for policy 0, policy_version 490293 (0.0011) [2023-12-26 03:30:00,793][123091] Updated weights for policy 0, policy_version 490303 (0.0010) [2023-12-26 03:30:00,848][123091] Updated weights for policy 0, policy_version 490313 (0.0010) [2023-12-26 03:30:00,872][123090] Updated weights for policy 1, policy_version 486858 (0.0005) [2023-12-26 03:30:00,921][123090] Updated weights for policy 1, policy_version 486868 (0.0008) [2023-12-26 03:30:00,975][123090] Updated weights for policy 1, policy_version 486878 (0.0008) [2023-12-26 03:30:01,665][123091] Updated weights for policy 0, policy_version 490323 (0.0009) [2023-12-26 03:30:01,726][123091] Updated weights for policy 0, policy_version 490333 (0.0006) [2023-12-26 03:30:01,788][123091] Updated weights for policy 0, policy_version 490343 (0.0008) [2023-12-26 03:30:01,817][123090] Updated weights for policy 1, policy_version 486888 (0.0008) [2023-12-26 03:30:01,875][123090] Updated weights for policy 1, policy_version 486898 (0.0008) [2023-12-26 03:30:01,929][123090] Updated weights for policy 1, policy_version 486908 (0.0008) [2023-12-26 03:30:02,596][123091] Updated weights for policy 0, policy_version 490353 (0.0008) [2023-12-26 03:30:02,666][123091] Updated weights for policy 0, policy_version 490363 (0.0006) [2023-12-26 03:30:02,670][123090] Updated weights for policy 1, policy_version 486918 (0.0006) [2023-12-26 03:30:02,733][123090] Updated weights for policy 1, policy_version 486928 (0.0006) [2023-12-26 03:30:02,739][123091] Updated weights for policy 0, policy_version 490373 (0.0005) [2023-12-26 03:30:02,795][123090] Updated weights for policy 1, policy_version 486938 (0.0005) [2023-12-26 03:30:02,798][123091] Updated weights for policy 0, policy_version 490383 (0.0010) [2023-12-26 03:30:03,377][123090] Updated weights for policy 1, policy_version 486948 (0.0006) [2023-12-26 03:30:03,433][123090] Updated weights for policy 1, policy_version 486958 (0.0005) [2023-12-26 03:30:03,492][123090] Updated weights for policy 1, policy_version 486968 (0.0005) [2023-12-26 03:30:03,530][123091] Updated weights for policy 0, policy_version 490393 (0.0009) [2023-12-26 03:30:03,581][123091] Updated weights for policy 0, policy_version 490403 (0.0008) [2023-12-26 03:30:03,636][123091] Updated weights for policy 0, policy_version 490413 (0.0008) [2023-12-26 03:30:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.8, 300 sec: 17855.8). Total num frames: 250216448. Throughput: 0: 9114.7, 1: 8948.7. Samples: 250223884. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:03,786][121949] Avg episode reward: [(0, '5988.997'), (1, '5761.955')] [2023-12-26 03:30:04,158][123090] Updated weights for policy 1, policy_version 486978 (0.0006) [2023-12-26 03:30:04,227][123090] Updated weights for policy 1, policy_version 486988 (0.0007) [2023-12-26 03:30:04,288][123090] Updated weights for policy 1, policy_version 486998 (0.0008) [2023-12-26 03:30:04,355][123090] Updated weights for policy 1, policy_version 487008 (0.0009) [2023-12-26 03:30:04,412][123091] Updated weights for policy 0, policy_version 490423 (0.0007) [2023-12-26 03:30:04,457][123091] Updated weights for policy 0, policy_version 490433 (0.0005) [2023-12-26 03:30:04,517][123091] Updated weights for policy 0, policy_version 490443 (0.0005) [2023-12-26 03:30:05,167][123091] Updated weights for policy 0, policy_version 490453 (0.0005) [2023-12-26 03:30:05,190][123090] Updated weights for policy 1, policy_version 487018 (0.0010) [2023-12-26 03:30:05,217][123091] Updated weights for policy 0, policy_version 490463 (0.0007) [2023-12-26 03:30:05,252][123090] Updated weights for policy 1, policy_version 487028 (0.0010) [2023-12-26 03:30:05,272][123091] Updated weights for policy 0, policy_version 490473 (0.0010) [2023-12-26 03:30:05,307][123090] Updated weights for policy 1, policy_version 487038 (0.0010) [2023-12-26 03:30:06,007][123091] Updated weights for policy 0, policy_version 490483 (0.0010) [2023-12-26 03:30:06,059][123091] Updated weights for policy 0, policy_version 490493 (0.0010) [2023-12-26 03:30:06,104][123090] Updated weights for policy 1, policy_version 487048 (0.0008) [2023-12-26 03:30:06,112][123091] Updated weights for policy 0, policy_version 490503 (0.0013) [2023-12-26 03:30:06,175][123090] Updated weights for policy 1, policy_version 487058 (0.0008) [2023-12-26 03:30:06,237][123090] Updated weights for policy 1, policy_version 487068 (0.0009) [2023-12-26 03:30:06,928][123091] Updated weights for policy 0, policy_version 490513 (0.0009) [2023-12-26 03:30:06,984][123091] Updated weights for policy 0, policy_version 490523 (0.0007) [2023-12-26 03:30:07,042][123091] Updated weights for policy 0, policy_version 490533 (0.0006) [2023-12-26 03:30:07,092][123090] Updated weights for policy 1, policy_version 487078 (0.0007) [2023-12-26 03:30:07,108][123091] Updated weights for policy 0, policy_version 490543 (0.0005) [2023-12-26 03:30:07,149][123090] Updated weights for policy 1, policy_version 487088 (0.0006) [2023-12-26 03:30:07,208][123090] Updated weights for policy 1, policy_version 487098 (0.0007) [2023-12-26 03:30:07,930][123091] Updated weights for policy 0, policy_version 490553 (0.0010) [2023-12-26 03:30:07,959][123090] Updated weights for policy 1, policy_version 487108 (0.0009) [2023-12-26 03:30:07,988][123091] Updated weights for policy 0, policy_version 490563 (0.0009) [2023-12-26 03:30:08,023][123090] Updated weights for policy 1, policy_version 487118 (0.0007) [2023-12-26 03:30:08,049][123091] Updated weights for policy 0, policy_version 490573 (0.0007) [2023-12-26 03:30:08,085][123090] Updated weights for policy 1, policy_version 487128 (0.0008) [2023-12-26 03:30:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 250298368. Throughput: 0: 9186.4, 1: 8984.8. Samples: 250279092. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:08,785][121949] Avg episode reward: [(0, '5987.522'), (1, '5768.000')] [2023-12-26 03:30:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000487136_124706816.pth... [2023-12-26 03:30:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000486112_124444672.pth [2023-12-26 03:30:08,808][123091] Updated weights for policy 0, policy_version 490583 (0.0008) [2023-12-26 03:30:08,873][123091] Updated weights for policy 0, policy_version 490593 (0.0007) [2023-12-26 03:30:08,938][123091] Updated weights for policy 0, policy_version 490603 (0.0005) [2023-12-26 03:30:08,948][123090] Updated weights for policy 1, policy_version 487138 (0.0009) [2023-12-26 03:30:08,969][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000490608_125599744.pth... [2023-12-26 03:30:08,973][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000489520_125321216.pth [2023-12-26 03:30:09,001][123090] Updated weights for policy 1, policy_version 487148 (0.0009) [2023-12-26 03:30:09,055][123090] Updated weights for policy 1, policy_version 487158 (0.0010) [2023-12-26 03:30:09,114][123090] Updated weights for policy 1, policy_version 487168 (0.0010) [2023-12-26 03:30:09,609][123091] Updated weights for policy 0, policy_version 490613 (0.0008) [2023-12-26 03:30:09,676][123091] Updated weights for policy 0, policy_version 490623 (0.0009) [2023-12-26 03:30:09,739][123091] Updated weights for policy 0, policy_version 490633 (0.0010) [2023-12-26 03:30:09,976][123090] Updated weights for policy 1, policy_version 487178 (0.0009) [2023-12-26 03:30:10,043][123090] Updated weights for policy 1, policy_version 487188 (0.0009) [2023-12-26 03:30:10,101][123090] Updated weights for policy 1, policy_version 487198 (0.0009) [2023-12-26 03:30:10,585][123091] Updated weights for policy 0, policy_version 490643 (0.0010) [2023-12-26 03:30:10,636][123091] Updated weights for policy 0, policy_version 490653 (0.0010) [2023-12-26 03:30:10,691][123091] Updated weights for policy 0, policy_version 490663 (0.0010) [2023-12-26 03:30:10,932][123090] Updated weights for policy 1, policy_version 487208 (0.0009) [2023-12-26 03:30:10,993][123090] Updated weights for policy 1, policy_version 487218 (0.0009) [2023-12-26 03:30:11,054][123090] Updated weights for policy 1, policy_version 487228 (0.0008) [2023-12-26 03:30:11,546][123091] Updated weights for policy 0, policy_version 490673 (0.0010) [2023-12-26 03:30:11,617][123091] Updated weights for policy 0, policy_version 490683 (0.0011) [2023-12-26 03:30:11,684][123091] Updated weights for policy 0, policy_version 490693 (0.0011) [2023-12-26 03:30:11,755][123091] Updated weights for policy 0, policy_version 490703 (0.0011) [2023-12-26 03:30:11,939][123090] Updated weights for policy 1, policy_version 487238 (0.0009) [2023-12-26 03:30:11,993][123090] Updated weights for policy 1, policy_version 487248 (0.0007) [2023-12-26 03:30:12,053][123090] Updated weights for policy 1, policy_version 487258 (0.0005) [2023-12-26 03:30:12,514][123091] Updated weights for policy 0, policy_version 490713 (0.0009) [2023-12-26 03:30:12,567][123091] Updated weights for policy 0, policy_version 490723 (0.0010) [2023-12-26 03:30:12,621][123091] Updated weights for policy 0, policy_version 490734 (0.0009) [2023-12-26 03:30:12,807][123090] Updated weights for policy 1, policy_version 487268 (0.0006) [2023-12-26 03:30:12,865][123090] Updated weights for policy 1, policy_version 487278 (0.0005) [2023-12-26 03:30:12,919][123090] Updated weights for policy 1, policy_version 487288 (0.0005) [2023-12-26 03:30:13,482][123091] Updated weights for policy 0, policy_version 490744 (0.0010) [2023-12-26 03:30:13,534][123091] Updated weights for policy 0, policy_version 490754 (0.0010) [2023-12-26 03:30:13,585][123091] Updated weights for policy 0, policy_version 490764 (0.0009) [2023-12-26 03:30:13,663][123090] Updated weights for policy 1, policy_version 487298 (0.0006) [2023-12-26 03:30:13,730][123090] Updated weights for policy 1, policy_version 487308 (0.0009) [2023-12-26 03:30:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 250388480. Throughput: 0: 9180.6, 1: 8876.6. Samples: 250382564. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:13,785][121949] Avg episode reward: [(0, '5954.436'), (1, '5801.950')] [2023-12-26 03:30:13,799][123090] Updated weights for policy 1, policy_version 487318 (0.0009) [2023-12-26 03:30:13,853][123090] Updated weights for policy 1, policy_version 487328 (0.0009) [2023-12-26 03:30:14,430][123091] Updated weights for policy 0, policy_version 490775 (0.0007) [2023-12-26 03:30:14,501][123091] Updated weights for policy 0, policy_version 490785 (0.0006) [2023-12-26 03:30:14,566][123091] Updated weights for policy 0, policy_version 490795 (0.0005) [2023-12-26 03:30:14,658][123090] Updated weights for policy 1, policy_version 487338 (0.0009) [2023-12-26 03:30:14,720][123090] Updated weights for policy 1, policy_version 487348 (0.0010) [2023-12-26 03:30:14,782][123090] Updated weights for policy 1, policy_version 487358 (0.0010) [2023-12-26 03:30:15,169][123091] Updated weights for policy 0, policy_version 490805 (0.0005) [2023-12-26 03:30:15,240][123091] Updated weights for policy 0, policy_version 490815 (0.0006) [2023-12-26 03:30:15,307][123091] Updated weights for policy 0, policy_version 490825 (0.0005) [2023-12-26 03:30:15,575][123090] Updated weights for policy 1, policy_version 487368 (0.0008) [2023-12-26 03:30:15,625][123090] Updated weights for policy 1, policy_version 487378 (0.0009) [2023-12-26 03:30:15,674][123090] Updated weights for policy 1, policy_version 487388 (0.0009) [2023-12-26 03:30:16,070][123091] Updated weights for policy 0, policy_version 490835 (0.0007) [2023-12-26 03:30:16,128][123091] Updated weights for policy 0, policy_version 490845 (0.0010) [2023-12-26 03:30:16,185][123091] Updated weights for policy 0, policy_version 490855 (0.0010) [2023-12-26 03:30:16,434][123090] Updated weights for policy 1, policy_version 487398 (0.0009) [2023-12-26 03:30:16,488][123090] Updated weights for policy 1, policy_version 487408 (0.0010) [2023-12-26 03:30:16,536][123090] Updated weights for policy 1, policy_version 487418 (0.0009) [2023-12-26 03:30:17,003][123091] Updated weights for policy 0, policy_version 490865 (0.0010) [2023-12-26 03:30:17,070][123091] Updated weights for policy 0, policy_version 490875 (0.0010) [2023-12-26 03:30:17,136][123091] Updated weights for policy 0, policy_version 490885 (0.0010) [2023-12-26 03:30:17,206][123090] Updated weights for policy 1, policy_version 487428 (0.0007) [2023-12-26 03:30:17,208][123091] Updated weights for policy 0, policy_version 490895 (0.0009) [2023-12-26 03:30:17,279][123090] Updated weights for policy 1, policy_version 487438 (0.0005) [2023-12-26 03:30:17,348][123090] Updated weights for policy 1, policy_version 487448 (0.0007) [2023-12-26 03:30:17,923][123090] Updated weights for policy 1, policy_version 487458 (0.0006) [2023-12-26 03:30:17,972][123090] Updated weights for policy 1, policy_version 487468 (0.0008) [2023-12-26 03:30:18,010][123091] Updated weights for policy 0, policy_version 490905 (0.0007) [2023-12-26 03:30:18,022][123090] Updated weights for policy 1, policy_version 487478 (0.0008) [2023-12-26 03:30:18,073][123091] Updated weights for policy 0, policy_version 490915 (0.0009) [2023-12-26 03:30:18,079][123090] Updated weights for policy 1, policy_version 487488 (0.0009) [2023-12-26 03:30:18,137][123091] Updated weights for policy 0, policy_version 490925 (0.0009) [2023-12-26 03:30:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 250478592. Throughput: 0: 9112.4, 1: 8846.9. Samples: 250493184. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:18,785][121949] Avg episode reward: [(0, '5991.614'), (1, '5774.415')] [2023-12-26 03:30:18,914][123090] Updated weights for policy 1, policy_version 487498 (0.0008) [2023-12-26 03:30:18,934][123091] Updated weights for policy 0, policy_version 490935 (0.0011) [2023-12-26 03:30:18,971][123090] Updated weights for policy 1, policy_version 487508 (0.0006) [2023-12-26 03:30:18,985][123091] Updated weights for policy 0, policy_version 490945 (0.0010) [2023-12-26 03:30:19,019][123090] Updated weights for policy 1, policy_version 487518 (0.0007) [2023-12-26 03:30:19,037][123091] Updated weights for policy 0, policy_version 490955 (0.0010) [2023-12-26 03:30:19,866][123091] Updated weights for policy 0, policy_version 490965 (0.0010) [2023-12-26 03:30:19,887][123090] Updated weights for policy 1, policy_version 487528 (0.0007) [2023-12-26 03:30:19,936][123091] Updated weights for policy 0, policy_version 490975 (0.0010) [2023-12-26 03:30:19,952][123090] Updated weights for policy 1, policy_version 487538 (0.0007) [2023-12-26 03:30:19,997][123091] Updated weights for policy 0, policy_version 490985 (0.0011) [2023-12-26 03:30:20,018][123090] Updated weights for policy 1, policy_version 487548 (0.0007) [2023-12-26 03:30:20,778][123091] Updated weights for policy 0, policy_version 490995 (0.0009) [2023-12-26 03:30:20,849][123091] Updated weights for policy 0, policy_version 491005 (0.0007) [2023-12-26 03:30:20,851][123090] Updated weights for policy 1, policy_version 487558 (0.0008) [2023-12-26 03:30:20,916][123090] Updated weights for policy 1, policy_version 487568 (0.0009) [2023-12-26 03:30:20,916][123091] Updated weights for policy 0, policy_version 491015 (0.0007) [2023-12-26 03:30:20,979][123090] Updated weights for policy 1, policy_version 487578 (0.0009) [2023-12-26 03:30:21,728][123091] Updated weights for policy 0, policy_version 491025 (0.0006) [2023-12-26 03:30:21,796][123090] Updated weights for policy 1, policy_version 487588 (0.0010) [2023-12-26 03:30:21,797][123091] Updated weights for policy 0, policy_version 491035 (0.0009) [2023-12-26 03:30:21,856][123091] Updated weights for policy 0, policy_version 491045 (0.0009) [2023-12-26 03:30:21,856][123090] Updated weights for policy 1, policy_version 487598 (0.0009) [2023-12-26 03:30:21,916][123091] Updated weights for policy 0, policy_version 491055 (0.0008) [2023-12-26 03:30:21,922][123090] Updated weights for policy 1, policy_version 487608 (0.0008) [2023-12-26 03:30:22,746][123091] Updated weights for policy 0, policy_version 491065 (0.0006) [2023-12-26 03:30:22,785][123090] Updated weights for policy 1, policy_version 487618 (0.0009) [2023-12-26 03:30:22,819][123091] Updated weights for policy 0, policy_version 491075 (0.0008) [2023-12-26 03:30:22,849][123090] Updated weights for policy 1, policy_version 487628 (0.0007) [2023-12-26 03:30:22,883][123091] Updated weights for policy 0, policy_version 491085 (0.0010) [2023-12-26 03:30:22,914][123090] Updated weights for policy 1, policy_version 487638 (0.0010) [2023-12-26 03:30:22,978][123090] Updated weights for policy 1, policy_version 487648 (0.0009) [2023-12-26 03:30:23,632][123091] Updated weights for policy 0, policy_version 491095 (0.0010) [2023-12-26 03:30:23,699][123091] Updated weights for policy 0, policy_version 491105 (0.0011) [2023-12-26 03:30:23,762][123091] Updated weights for policy 0, policy_version 491115 (0.0010) [2023-12-26 03:30:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 250560512. Throughput: 0: 9140.9, 1: 8808.3. Samples: 250544756. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:23,785][121949] Avg episode reward: [(0, '5999.533'), (1, '5812.121')] [2023-12-26 03:30:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000491120_125730816.pth... [2023-12-26 03:30:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000490064_125460480.pth [2023-12-26 03:30:23,837][123090] Updated weights for policy 1, policy_version 487658 (0.0009) [2023-12-26 03:30:23,898][123090] Updated weights for policy 1, policy_version 487668 (0.0009) [2023-12-26 03:30:23,958][123090] Updated weights for policy 1, policy_version 487678 (0.0009) [2023-12-26 03:30:23,969][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000487680_124846080.pth... [2023-12-26 03:30:23,973][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000486624_124575744.pth [2023-12-26 03:30:24,554][123091] Updated weights for policy 0, policy_version 491125 (0.0011) [2023-12-26 03:30:24,615][123091] Updated weights for policy 0, policy_version 491135 (0.0011) [2023-12-26 03:30:24,675][123091] Updated weights for policy 0, policy_version 491145 (0.0009) [2023-12-26 03:30:24,729][123090] Updated weights for policy 1, policy_version 487688 (0.0009) [2023-12-26 03:30:24,786][123090] Updated weights for policy 1, policy_version 487698 (0.0009) [2023-12-26 03:30:24,857][123090] Updated weights for policy 1, policy_version 487708 (0.0009) [2023-12-26 03:30:25,477][123091] Updated weights for policy 0, policy_version 491155 (0.0010) [2023-12-26 03:30:25,531][123091] Updated weights for policy 0, policy_version 491165 (0.0009) [2023-12-26 03:30:25,599][123091] Updated weights for policy 0, policy_version 491175 (0.0010) [2023-12-26 03:30:25,700][123090] Updated weights for policy 1, policy_version 487718 (0.0010) [2023-12-26 03:30:25,751][123090] Updated weights for policy 1, policy_version 487728 (0.0009) [2023-12-26 03:30:25,804][123090] Updated weights for policy 1, policy_version 487738 (0.0009) [2023-12-26 03:30:26,458][123091] Updated weights for policy 0, policy_version 491186 (0.0009) [2023-12-26 03:30:26,516][123091] Updated weights for policy 0, policy_version 491196 (0.0005) [2023-12-26 03:30:26,583][123091] Updated weights for policy 0, policy_version 491206 (0.0007) [2023-12-26 03:30:26,632][123091] Updated weights for policy 0, policy_version 491216 (0.0010) [2023-12-26 03:30:26,684][123090] Updated weights for policy 1, policy_version 487748 (0.0010) [2023-12-26 03:30:26,736][123090] Updated weights for policy 1, policy_version 487758 (0.0009) [2023-12-26 03:30:26,792][123090] Updated weights for policy 1, policy_version 487768 (0.0009) [2023-12-26 03:30:27,421][123091] Updated weights for policy 0, policy_version 491226 (0.0010) [2023-12-26 03:30:27,481][123091] Updated weights for policy 0, policy_version 491236 (0.0009) [2023-12-26 03:30:27,538][123091] Updated weights for policy 0, policy_version 491246 (0.0010) [2023-12-26 03:30:27,644][123090] Updated weights for policy 1, policy_version 487778 (0.0009) [2023-12-26 03:30:27,706][123090] Updated weights for policy 1, policy_version 487788 (0.0009) [2023-12-26 03:30:27,776][123090] Updated weights for policy 1, policy_version 487798 (0.0009) [2023-12-26 03:30:27,827][123090] Updated weights for policy 1, policy_version 487808 (0.0009) [2023-12-26 03:30:28,379][123091] Updated weights for policy 0, policy_version 491256 (0.0008) [2023-12-26 03:30:28,431][123091] Updated weights for policy 0, policy_version 491266 (0.0008) [2023-12-26 03:30:28,497][123091] Updated weights for policy 0, policy_version 491276 (0.0009) [2023-12-26 03:30:28,668][123090] Updated weights for policy 1, policy_version 487818 (0.0005) [2023-12-26 03:30:28,725][123090] Updated weights for policy 1, policy_version 487828 (0.0006) [2023-12-26 03:30:28,782][123090] Updated weights for policy 1, policy_version 487838 (0.0010) [2023-12-26 03:30:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 250650624. Throughput: 0: 9066.8, 1: 8757.0. Samples: 250647588. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:28,784][121949] Avg episode reward: [(0, '6004.127'), (1, '5857.372')] [2023-12-26 03:30:29,297][123091] Updated weights for policy 0, policy_version 491286 (0.0008) [2023-12-26 03:30:29,367][123091] Updated weights for policy 0, policy_version 491296 (0.0008) [2023-12-26 03:30:29,425][123091] Updated weights for policy 0, policy_version 491306 (0.0009) [2023-12-26 03:30:29,511][123090] Updated weights for policy 1, policy_version 487848 (0.0006) [2023-12-26 03:30:29,567][123090] Updated weights for policy 1, policy_version 487858 (0.0005) [2023-12-26 03:30:29,619][123090] Updated weights for policy 1, policy_version 487868 (0.0005) [2023-12-26 03:30:30,254][123091] Updated weights for policy 0, policy_version 491316 (0.0010) [2023-12-26 03:30:30,322][123091] Updated weights for policy 0, policy_version 491326 (0.0010) [2023-12-26 03:30:30,374][123090] Updated weights for policy 1, policy_version 487878 (0.0007) [2023-12-26 03:30:30,384][123091] Updated weights for policy 0, policy_version 491336 (0.0008) [2023-12-26 03:30:30,426][123090] Updated weights for policy 1, policy_version 487888 (0.0008) [2023-12-26 03:30:30,483][123090] Updated weights for policy 1, policy_version 487898 (0.0009) [2023-12-26 03:30:31,197][123091] Updated weights for policy 0, policy_version 491346 (0.0008) [2023-12-26 03:30:31,265][123091] Updated weights for policy 0, policy_version 491357 (0.0008) [2023-12-26 03:30:31,313][123090] Updated weights for policy 1, policy_version 487908 (0.0008) [2023-12-26 03:30:31,325][123091] Updated weights for policy 0, policy_version 491367 (0.0007) [2023-12-26 03:30:31,379][123090] Updated weights for policy 1, policy_version 487918 (0.0008) [2023-12-26 03:30:31,445][123090] Updated weights for policy 1, policy_version 487928 (0.0009) [2023-12-26 03:30:32,098][123091] Updated weights for policy 0, policy_version 491377 (0.0008) [2023-12-26 03:30:32,151][123091] Updated weights for policy 0, policy_version 491387 (0.0010) [2023-12-26 03:30:32,207][123091] Updated weights for policy 0, policy_version 491398 (0.0011) [2023-12-26 03:30:32,284][123090] Updated weights for policy 1, policy_version 487938 (0.0009) [2023-12-26 03:30:32,345][123090] Updated weights for policy 1, policy_version 487948 (0.0006) [2023-12-26 03:30:32,404][123090] Updated weights for policy 1, policy_version 487958 (0.0007) [2023-12-26 03:30:32,478][123090] Updated weights for policy 1, policy_version 487968 (0.0008) [2023-12-26 03:30:32,952][123091] Updated weights for policy 0, policy_version 491409 (0.0009) [2023-12-26 03:30:33,013][123091] Updated weights for policy 0, policy_version 491419 (0.0006) [2023-12-26 03:30:33,079][123091] Updated weights for policy 0, policy_version 491429 (0.0008) [2023-12-26 03:30:33,146][123091] Updated weights for policy 0, policy_version 491439 (0.0008) [2023-12-26 03:30:33,200][123090] Updated weights for policy 1, policy_version 487978 (0.0006) [2023-12-26 03:30:33,244][123090] Updated weights for policy 1, policy_version 487988 (0.0005) [2023-12-26 03:30:33,298][123090] Updated weights for policy 1, policy_version 487998 (0.0005) [2023-12-26 03:30:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 250740736. Throughput: 0: 8929.0, 1: 8755.4. Samples: 250755344. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:33,784][121949] Avg episode reward: [(0, '6042.215'), (1, '5920.505')] [2023-12-26 03:30:33,923][123091] Updated weights for policy 0, policy_version 491449 (0.0010) [2023-12-26 03:30:33,978][123091] Updated weights for policy 0, policy_version 491459 (0.0010) [2023-12-26 03:30:33,982][123090] Updated weights for policy 1, policy_version 488008 (0.0009) [2023-12-26 03:30:34,034][123091] Updated weights for policy 0, policy_version 491469 (0.0010) [2023-12-26 03:30:34,044][123090] Updated weights for policy 1, policy_version 488018 (0.0010) [2023-12-26 03:30:34,101][123090] Updated weights for policy 1, policy_version 488028 (0.0008) [2023-12-26 03:30:34,880][123091] Updated weights for policy 0, policy_version 491479 (0.0011) [2023-12-26 03:30:34,936][123091] Updated weights for policy 0, policy_version 491489 (0.0010) [2023-12-26 03:30:34,959][123090] Updated weights for policy 1, policy_version 488038 (0.0010) [2023-12-26 03:30:34,991][123091] Updated weights for policy 0, policy_version 491499 (0.0010) [2023-12-26 03:30:35,016][123090] Updated weights for policy 1, policy_version 488048 (0.0006) [2023-12-26 03:30:35,063][123090] Updated weights for policy 1, policy_version 488058 (0.0009) [2023-12-26 03:30:35,809][123091] Updated weights for policy 0, policy_version 491509 (0.0010) [2023-12-26 03:30:35,875][123091] Updated weights for policy 0, policy_version 491519 (0.0010) [2023-12-26 03:30:35,905][123090] Updated weights for policy 1, policy_version 488068 (0.0007) [2023-12-26 03:30:35,926][123091] Updated weights for policy 0, policy_version 491529 (0.0010) [2023-12-26 03:30:35,954][123090] Updated weights for policy 1, policy_version 488078 (0.0005) [2023-12-26 03:30:36,012][123090] Updated weights for policy 1, policy_version 488088 (0.0005) [2023-12-26 03:30:36,731][123091] Updated weights for policy 0, policy_version 491539 (0.0009) [2023-12-26 03:30:36,772][123090] Updated weights for policy 1, policy_version 488098 (0.0006) [2023-12-26 03:30:36,786][123091] Updated weights for policy 0, policy_version 491549 (0.0009) [2023-12-26 03:30:36,838][123090] Updated weights for policy 1, policy_version 488108 (0.0005) [2023-12-26 03:30:36,847][123091] Updated weights for policy 0, policy_version 491559 (0.0008) [2023-12-26 03:30:36,904][123090] Updated weights for policy 1, policy_version 488118 (0.0005) [2023-12-26 03:30:36,966][123090] Updated weights for policy 1, policy_version 488128 (0.0010) [2023-12-26 03:30:37,608][123091] Updated weights for policy 0, policy_version 491569 (0.0009) [2023-12-26 03:30:37,634][123090] Updated weights for policy 1, policy_version 488138 (0.0005) [2023-12-26 03:30:37,669][123091] Updated weights for policy 0, policy_version 491579 (0.0007) [2023-12-26 03:30:37,705][123090] Updated weights for policy 1, policy_version 488148 (0.0005) [2023-12-26 03:30:37,727][123091] Updated weights for policy 0, policy_version 491589 (0.0005) [2023-12-26 03:30:37,774][123090] Updated weights for policy 1, policy_version 488158 (0.0010) [2023-12-26 03:30:37,790][123091] Updated weights for policy 0, policy_version 491599 (0.0006) [2023-12-26 03:30:38,506][123091] Updated weights for policy 0, policy_version 491609 (0.0010) [2023-12-26 03:30:38,552][123090] Updated weights for policy 1, policy_version 488168 (0.0009) [2023-12-26 03:30:38,568][123091] Updated weights for policy 0, policy_version 491619 (0.0009) [2023-12-26 03:30:38,614][123090] Updated weights for policy 1, policy_version 488178 (0.0008) [2023-12-26 03:30:38,627][123091] Updated weights for policy 0, policy_version 491629 (0.0007) [2023-12-26 03:30:38,683][123090] Updated weights for policy 1, policy_version 488188 (0.0009) [2023-12-26 03:30:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 250839040. Throughput: 0: 8874.1, 1: 8770.1. Samples: 250807284. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:38,785][121949] Avg episode reward: [(0, '6037.653'), (1, '5877.987')] [2023-12-26 03:30:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000491632_125861888.pth... [2023-12-26 03:30:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000488192_124977152.pth... [2023-12-26 03:30:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000490608_125599744.pth [2023-12-26 03:30:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000487136_124706816.pth [2023-12-26 03:30:39,413][123090] Updated weights for policy 1, policy_version 488198 (0.0009) [2023-12-26 03:30:39,484][123090] Updated weights for policy 1, policy_version 488208 (0.0007) [2023-12-26 03:30:39,510][123091] Updated weights for policy 0, policy_version 491639 (0.0007) [2023-12-26 03:30:39,547][123090] Updated weights for policy 1, policy_version 488218 (0.0010) [2023-12-26 03:30:39,568][123091] Updated weights for policy 0, policy_version 491649 (0.0007) [2023-12-26 03:30:39,632][123091] Updated weights for policy 0, policy_version 491659 (0.0008) [2023-12-26 03:30:40,404][123090] Updated weights for policy 1, policy_version 488228 (0.0011) [2023-12-26 03:30:40,463][123090] Updated weights for policy 1, policy_version 488238 (0.0010) [2023-12-26 03:30:40,512][123091] Updated weights for policy 0, policy_version 491669 (0.0008) [2023-12-26 03:30:40,530][123090] Updated weights for policy 1, policy_version 488248 (0.0011) [2023-12-26 03:30:40,570][123091] Updated weights for policy 0, policy_version 491679 (0.0007) [2023-12-26 03:30:40,631][123091] Updated weights for policy 0, policy_version 491689 (0.0009) [2023-12-26 03:30:41,373][123090] Updated weights for policy 1, policy_version 488258 (0.0010) [2023-12-26 03:30:41,445][123090] Updated weights for policy 1, policy_version 488268 (0.0010) [2023-12-26 03:30:41,482][123091] Updated weights for policy 0, policy_version 491699 (0.0008) [2023-12-26 03:30:41,501][123090] Updated weights for policy 1, policy_version 488278 (0.0010) [2023-12-26 03:30:41,539][123091] Updated weights for policy 0, policy_version 491709 (0.0006) [2023-12-26 03:30:41,554][123090] Updated weights for policy 1, policy_version 488288 (0.0011) [2023-12-26 03:30:41,598][123091] Updated weights for policy 0, policy_version 491719 (0.0008) [2023-12-26 03:30:42,443][123090] Updated weights for policy 1, policy_version 488298 (0.0011) [2023-12-26 03:30:42,489][123091] Updated weights for policy 0, policy_version 491729 (0.0008) [2023-12-26 03:30:42,500][123090] Updated weights for policy 1, policy_version 488308 (0.0010) [2023-12-26 03:30:42,552][123091] Updated weights for policy 0, policy_version 491739 (0.0008) [2023-12-26 03:30:42,562][123090] Updated weights for policy 1, policy_version 488318 (0.0011) [2023-12-26 03:30:42,599][123091] Updated weights for policy 0, policy_version 491749 (0.0009) [2023-12-26 03:30:42,654][123091] Updated weights for policy 0, policy_version 491759 (0.0009) [2023-12-26 03:30:43,408][123090] Updated weights for policy 1, policy_version 488328 (0.0010) [2023-12-26 03:30:43,466][123090] Updated weights for policy 1, policy_version 488338 (0.0010) [2023-12-26 03:30:43,514][123091] Updated weights for policy 0, policy_version 491769 (0.0006) [2023-12-26 03:30:43,524][123090] Updated weights for policy 1, policy_version 488348 (0.0010) [2023-12-26 03:30:43,575][123091] Updated weights for policy 0, policy_version 491779 (0.0007) [2023-12-26 03:30:43,638][123091] Updated weights for policy 0, policy_version 491789 (0.0008) [2023-12-26 03:30:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 250920960. Throughput: 0: 8799.7, 1: 8805.4. Samples: 250910552. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:43,785][121949] Avg episode reward: [(0, '5881.832'), (1, '5723.490')] [2023-12-26 03:30:44,330][123090] Updated weights for policy 1, policy_version 488358 (0.0008) [2023-12-26 03:30:44,393][123090] Updated weights for policy 1, policy_version 488368 (0.0005) [2023-12-26 03:30:44,455][123090] Updated weights for policy 1, policy_version 488378 (0.0007) [2023-12-26 03:30:44,475][123091] Updated weights for policy 0, policy_version 491799 (0.0008) [2023-12-26 03:30:44,530][123091] Updated weights for policy 0, policy_version 491809 (0.0008) [2023-12-26 03:30:44,581][123091] Updated weights for policy 0, policy_version 491819 (0.0009) [2023-12-26 03:30:45,272][123090] Updated weights for policy 1, policy_version 488388 (0.0008) [2023-12-26 03:30:45,332][123090] Updated weights for policy 1, policy_version 488398 (0.0010) [2023-12-26 03:30:45,368][123091] Updated weights for policy 0, policy_version 491829 (0.0008) [2023-12-26 03:30:45,392][123090] Updated weights for policy 1, policy_version 488408 (0.0009) [2023-12-26 03:30:45,430][123091] Updated weights for policy 0, policy_version 491839 (0.0006) [2023-12-26 03:30:45,495][123091] Updated weights for policy 0, policy_version 491849 (0.0006) [2023-12-26 03:30:46,264][123090] Updated weights for policy 1, policy_version 488418 (0.0009) [2023-12-26 03:30:46,274][123091] Updated weights for policy 0, policy_version 491859 (0.0006) [2023-12-26 03:30:46,313][123090] Updated weights for policy 1, policy_version 488428 (0.0009) [2023-12-26 03:30:46,321][123091] Updated weights for policy 0, policy_version 491869 (0.0006) [2023-12-26 03:30:46,364][123090] Updated weights for policy 1, policy_version 488438 (0.0009) [2023-12-26 03:30:46,367][123091] Updated weights for policy 0, policy_version 491879 (0.0006) [2023-12-26 03:30:46,428][123090] Updated weights for policy 1, policy_version 488448 (0.0008) [2023-12-26 03:30:47,199][123091] Updated weights for policy 0, policy_version 491889 (0.0009) [2023-12-26 03:30:47,258][123091] Updated weights for policy 0, policy_version 491899 (0.0007) [2023-12-26 03:30:47,268][123090] Updated weights for policy 1, policy_version 488458 (0.0009) [2023-12-26 03:30:47,319][123091] Updated weights for policy 0, policy_version 491909 (0.0007) [2023-12-26 03:30:47,326][123090] Updated weights for policy 1, policy_version 488468 (0.0009) [2023-12-26 03:30:47,374][123091] Updated weights for policy 0, policy_version 491919 (0.0006) [2023-12-26 03:30:47,387][123090] Updated weights for policy 1, policy_version 488478 (0.0009) [2023-12-26 03:30:48,143][123091] Updated weights for policy 0, policy_version 491929 (0.0009) [2023-12-26 03:30:48,166][123090] Updated weights for policy 1, policy_version 488488 (0.0006) [2023-12-26 03:30:48,203][123091] Updated weights for policy 0, policy_version 491939 (0.0009) [2023-12-26 03:30:48,216][123090] Updated weights for policy 1, policy_version 488498 (0.0005) [2023-12-26 03:30:48,256][123091] Updated weights for policy 0, policy_version 491949 (0.0009) [2023-12-26 03:30:48,269][123090] Updated weights for policy 1, policy_version 488508 (0.0005) [2023-12-26 03:30:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 251002880. Throughput: 0: 8796.5, 1: 8791.5. Samples: 251015340. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:48,785][121949] Avg episode reward: [(0, '5730.860'), (1, '5648.290')] [2023-12-26 03:30:48,976][123090] Updated weights for policy 1, policy_version 488518 (0.0006) [2023-12-26 03:30:49,039][123090] Updated weights for policy 1, policy_version 488528 (0.0005) [2023-12-26 03:30:49,102][123090] Updated weights for policy 1, policy_version 488538 (0.0005) [2023-12-26 03:30:49,184][123091] Updated weights for policy 0, policy_version 491960 (0.0010) [2023-12-26 03:30:49,248][123091] Updated weights for policy 0, policy_version 491970 (0.0010) [2023-12-26 03:30:49,304][123091] Updated weights for policy 0, policy_version 491980 (0.0010) [2023-12-26 03:30:49,797][123090] Updated weights for policy 1, policy_version 488548 (0.0007) [2023-12-26 03:30:49,869][123090] Updated weights for policy 1, policy_version 488558 (0.0010) [2023-12-26 03:30:49,945][123090] Updated weights for policy 1, policy_version 488568 (0.0008) [2023-12-26 03:30:50,235][123091] Updated weights for policy 0, policy_version 491990 (0.0009) [2023-12-26 03:30:50,290][123091] Updated weights for policy 0, policy_version 492000 (0.0010) [2023-12-26 03:30:50,337][123091] Updated weights for policy 0, policy_version 492010 (0.0008) [2023-12-26 03:30:50,676][123090] Updated weights for policy 1, policy_version 488578 (0.0010) [2023-12-26 03:30:50,746][123090] Updated weights for policy 1, policy_version 488588 (0.0009) [2023-12-26 03:30:50,822][123090] Updated weights for policy 1, policy_version 488598 (0.0009) [2023-12-26 03:30:50,890][123090] Updated weights for policy 1, policy_version 488608 (0.0011) [2023-12-26 03:30:51,230][123091] Updated weights for policy 0, policy_version 492020 (0.0010) [2023-12-26 03:30:51,295][123091] Updated weights for policy 0, policy_version 492030 (0.0010) [2023-12-26 03:30:51,349][123091] Updated weights for policy 0, policy_version 492040 (0.0008) [2023-12-26 03:30:51,669][123090] Updated weights for policy 1, policy_version 488618 (0.0008) [2023-12-26 03:30:51,741][123090] Updated weights for policy 1, policy_version 488628 (0.0010) [2023-12-26 03:30:51,804][123090] Updated weights for policy 1, policy_version 488638 (0.0009) [2023-12-26 03:30:52,235][123091] Updated weights for policy 0, policy_version 492050 (0.0010) [2023-12-26 03:30:52,305][123091] Updated weights for policy 0, policy_version 492060 (0.0009) [2023-12-26 03:30:52,382][123091] Updated weights for policy 0, policy_version 492070 (0.0010) [2023-12-26 03:30:52,446][123091] Updated weights for policy 0, policy_version 492080 (0.0009) [2023-12-26 03:30:52,561][123090] Updated weights for policy 1, policy_version 488648 (0.0006) [2023-12-26 03:30:52,639][123090] Updated weights for policy 1, policy_version 488658 (0.0006) [2023-12-26 03:30:52,714][123090] Updated weights for policy 1, policy_version 488668 (0.0006) [2023-12-26 03:30:53,250][123091] Updated weights for policy 0, policy_version 492090 (0.0011) [2023-12-26 03:30:53,302][123091] Updated weights for policy 0, policy_version 492100 (0.0010) [2023-12-26 03:30:53,353][123091] Updated weights for policy 0, policy_version 492110 (0.0010) [2023-12-26 03:30:53,369][123090] Updated weights for policy 1, policy_version 488678 (0.0006) [2023-12-26 03:30:53,419][123090] Updated weights for policy 1, policy_version 488688 (0.0007) [2023-12-26 03:30:53,485][123090] Updated weights for policy 1, policy_version 488698 (0.0005) [2023-12-26 03:30:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 251092992. Throughput: 0: 8685.3, 1: 8814.5. Samples: 251066584. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:53,785][121949] Avg episode reward: [(0, '5827.506'), (1, '5663.654')] [2023-12-26 03:30:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000492112_125984768.pth... [2023-12-26 03:30:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000488704_125108224.pth... [2023-12-26 03:30:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000491120_125730816.pth [2023-12-26 03:30:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000487680_124846080.pth [2023-12-26 03:30:54,159][123090] Updated weights for policy 1, policy_version 488708 (0.0007) [2023-12-26 03:30:54,208][123091] Updated weights for policy 0, policy_version 492120 (0.0011) [2023-12-26 03:30:54,216][123090] Updated weights for policy 1, policy_version 488718 (0.0005) [2023-12-26 03:30:54,263][123091] Updated weights for policy 0, policy_version 492130 (0.0011) [2023-12-26 03:30:54,264][123090] Updated weights for policy 1, policy_version 488728 (0.0005) [2023-12-26 03:30:54,315][123091] Updated weights for policy 0, policy_version 492140 (0.0010) [2023-12-26 03:30:55,007][123090] Updated weights for policy 1, policy_version 488738 (0.0006) [2023-12-26 03:30:55,057][123090] Updated weights for policy 1, policy_version 488748 (0.0005) [2023-12-26 03:30:55,117][123090] Updated weights for policy 1, policy_version 488758 (0.0006) [2023-12-26 03:30:55,120][123091] Updated weights for policy 0, policy_version 492150 (0.0011) [2023-12-26 03:30:55,181][123091] Updated weights for policy 0, policy_version 492160 (0.0011) [2023-12-26 03:30:55,187][123090] Updated weights for policy 1, policy_version 488768 (0.0009) [2023-12-26 03:30:55,244][123091] Updated weights for policy 0, policy_version 492170 (0.0010) [2023-12-26 03:30:55,943][123090] Updated weights for policy 1, policy_version 488778 (0.0006) [2023-12-26 03:30:55,959][123091] Updated weights for policy 0, policy_version 492180 (0.0008) [2023-12-26 03:30:55,998][123090] Updated weights for policy 1, policy_version 488788 (0.0008) [2023-12-26 03:30:56,018][123091] Updated weights for policy 0, policy_version 492190 (0.0007) [2023-12-26 03:30:56,047][123090] Updated weights for policy 1, policy_version 488798 (0.0010) [2023-12-26 03:30:56,081][123091] Updated weights for policy 0, policy_version 492200 (0.0009) [2023-12-26 03:30:56,849][123090] Updated weights for policy 1, policy_version 488808 (0.0006) [2023-12-26 03:30:56,888][123091] Updated weights for policy 0, policy_version 492210 (0.0009) [2023-12-26 03:30:56,913][123090] Updated weights for policy 1, policy_version 488818 (0.0005) [2023-12-26 03:30:56,957][123091] Updated weights for policy 0, policy_version 492220 (0.0009) [2023-12-26 03:30:56,976][123090] Updated weights for policy 1, policy_version 488828 (0.0005) [2023-12-26 03:30:57,032][123091] Updated weights for policy 0, policy_version 492230 (0.0011) [2023-12-26 03:30:57,108][123091] Updated weights for policy 0, policy_version 492240 (0.0011) [2023-12-26 03:30:57,671][123090] Updated weights for policy 1, policy_version 488838 (0.0009) [2023-12-26 03:30:57,748][123090] Updated weights for policy 1, policy_version 488848 (0.0006) [2023-12-26 03:30:57,819][123090] Updated weights for policy 1, policy_version 488858 (0.0009) [2023-12-26 03:30:57,900][123091] Updated weights for policy 0, policy_version 492250 (0.0011) [2023-12-26 03:30:57,974][123091] Updated weights for policy 0, policy_version 492260 (0.0011) [2023-12-26 03:30:58,046][123091] Updated weights for policy 0, policy_version 492270 (0.0008) [2023-12-26 03:30:58,670][123090] Updated weights for policy 1, policy_version 488868 (0.0008) [2023-12-26 03:30:58,747][123090] Updated weights for policy 1, policy_version 488878 (0.0009) [2023-12-26 03:30:58,786][121949] Fps is (10 sec: 17199.2, 60 sec: 17612.1, 300 sec: 17800.1). Total num frames: 251174912. Throughput: 0: 8670.6, 1: 8979.6. Samples: 251176864. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:30:58,787][121949] Avg episode reward: [(0, '5907.128'), (1, '5642.799')] [2023-12-26 03:30:58,830][123090] Updated weights for policy 1, policy_version 488888 (0.0010) [2023-12-26 03:30:58,961][123091] Updated weights for policy 0, policy_version 492280 (0.0010) [2023-12-26 03:30:59,026][123091] Updated weights for policy 0, policy_version 492290 (0.0011) [2023-12-26 03:30:59,089][123091] Updated weights for policy 0, policy_version 492300 (0.0011) [2023-12-26 03:30:59,679][123090] Updated weights for policy 1, policy_version 488898 (0.0010) [2023-12-26 03:30:59,745][123090] Updated weights for policy 1, policy_version 488908 (0.0009) [2023-12-26 03:30:59,803][123090] Updated weights for policy 1, policy_version 488918 (0.0009) [2023-12-26 03:30:59,892][123090] Updated weights for policy 1, policy_version 488928 (0.0009) [2023-12-26 03:30:59,915][123091] Updated weights for policy 0, policy_version 492310 (0.0011) [2023-12-26 03:30:59,972][123091] Updated weights for policy 0, policy_version 492320 (0.0010) [2023-12-26 03:31:00,024][123091] Updated weights for policy 0, policy_version 492330 (0.0010) [2023-12-26 03:31:00,705][123090] Updated weights for policy 1, policy_version 488938 (0.0008) [2023-12-26 03:31:00,757][123090] Updated weights for policy 1, policy_version 488948 (0.0009) [2023-12-26 03:31:00,811][123090] Updated weights for policy 1, policy_version 488959 (0.0010) [2023-12-26 03:31:00,897][123091] Updated weights for policy 0, policy_version 492340 (0.0009) [2023-12-26 03:31:00,953][123091] Updated weights for policy 0, policy_version 492350 (0.0009) [2023-12-26 03:31:01,011][123091] Updated weights for policy 0, policy_version 492360 (0.0009) [2023-12-26 03:31:01,671][123090] Updated weights for policy 1, policy_version 488969 (0.0008) [2023-12-26 03:31:01,748][123090] Updated weights for policy 1, policy_version 488979 (0.0007) [2023-12-26 03:31:01,812][123090] Updated weights for policy 1, policy_version 488989 (0.0011) [2023-12-26 03:31:01,903][123091] Updated weights for policy 0, policy_version 492370 (0.0010) [2023-12-26 03:31:01,971][123091] Updated weights for policy 0, policy_version 492380 (0.0006) [2023-12-26 03:31:02,043][123091] Updated weights for policy 0, policy_version 492390 (0.0006) [2023-12-26 03:31:02,112][123091] Updated weights for policy 0, policy_version 492400 (0.0006) [2023-12-26 03:31:02,614][123090] Updated weights for policy 1, policy_version 488999 (0.0007) [2023-12-26 03:31:02,670][123090] Updated weights for policy 1, policy_version 489009 (0.0005) [2023-12-26 03:31:02,737][123090] Updated weights for policy 1, policy_version 489019 (0.0006) [2023-12-26 03:31:02,834][123091] Updated weights for policy 0, policy_version 492410 (0.0009) [2023-12-26 03:31:02,895][123091] Updated weights for policy 0, policy_version 492420 (0.0009) [2023-12-26 03:31:02,946][123091] Updated weights for policy 0, policy_version 492430 (0.0009) [2023-12-26 03:31:03,423][123090] Updated weights for policy 1, policy_version 489029 (0.0010) [2023-12-26 03:31:03,479][123090] Updated weights for policy 1, policy_version 489039 (0.0009) [2023-12-26 03:31:03,544][123090] Updated weights for policy 1, policy_version 489049 (0.0009) [2023-12-26 03:31:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17772.5). Total num frames: 251265024. Throughput: 0: 8582.4, 1: 8844.3. Samples: 251277388. Policy #0 lag: (min: 4.0, avg: 6.0, max: 36.0) [2023-12-26 03:31:03,785][121949] Avg episode reward: [(0, '5792.007'), (1, '5657.878')] [2023-12-26 03:31:03,791][123091] Updated weights for policy 0, policy_version 492440 (0.0009) [2023-12-26 03:31:03,848][123091] Updated weights for policy 0, policy_version 492450 (0.0009) [2023-12-26 03:31:03,904][123091] Updated weights for policy 0, policy_version 492460 (0.0010) [2023-12-26 03:31:04,397][123090] Updated weights for policy 1, policy_version 489059 (0.0010) [2023-12-26 03:31:04,462][123090] Updated weights for policy 1, policy_version 489069 (0.0009) [2023-12-26 03:31:04,520][123090] Updated weights for policy 1, policy_version 489079 (0.0009) [2023-12-26 03:31:04,793][123091] Updated weights for policy 0, policy_version 492470 (0.0010) [2023-12-26 03:31:04,852][123091] Updated weights for policy 0, policy_version 492480 (0.0009) [2023-12-26 03:31:04,921][123091] Updated weights for policy 0, policy_version 492490 (0.0010) [2023-12-26 03:31:05,283][123090] Updated weights for policy 1, policy_version 489089 (0.0009) [2023-12-26 03:31:05,339][123090] Updated weights for policy 1, policy_version 489099 (0.0005) [2023-12-26 03:31:05,388][123090] Updated weights for policy 1, policy_version 489109 (0.0005) [2023-12-26 03:31:05,435][123090] Updated weights for policy 1, policy_version 489119 (0.0006) [2023-12-26 03:31:05,798][123091] Updated weights for policy 0, policy_version 492500 (0.0010) [2023-12-26 03:31:05,855][123091] Updated weights for policy 0, policy_version 492510 (0.0009) [2023-12-26 03:31:05,910][123091] Updated weights for policy 0, policy_version 492520 (0.0010) [2023-12-26 03:31:06,188][123090] Updated weights for policy 1, policy_version 489129 (0.0008) [2023-12-26 03:31:06,242][123090] Updated weights for policy 1, policy_version 489139 (0.0009) [2023-12-26 03:31:06,313][123090] Updated weights for policy 1, policy_version 489149 (0.0008) [2023-12-26 03:31:06,718][123091] Updated weights for policy 0, policy_version 492530 (0.0008) [2023-12-26 03:31:06,789][123091] Updated weights for policy 0, policy_version 492540 (0.0009) [2023-12-26 03:31:06,852][123091] Updated weights for policy 0, policy_version 492550 (0.0007) [2023-12-26 03:31:06,911][123091] Updated weights for policy 0, policy_version 492560 (0.0009) [2023-12-26 03:31:07,075][123090] Updated weights for policy 1, policy_version 489159 (0.0005) [2023-12-26 03:31:07,134][123090] Updated weights for policy 1, policy_version 489169 (0.0005) [2023-12-26 03:31:07,184][123090] Updated weights for policy 1, policy_version 489179 (0.0007) [2023-12-26 03:31:07,754][123091] Updated weights for policy 0, policy_version 492570 (0.0009) [2023-12-26 03:31:07,827][123091] Updated weights for policy 0, policy_version 492580 (0.0009) [2023-12-26 03:31:07,900][123091] Updated weights for policy 0, policy_version 492590 (0.0009) [2023-12-26 03:31:07,986][123090] Updated weights for policy 1, policy_version 489189 (0.0010) [2023-12-26 03:31:08,046][123090] Updated weights for policy 1, policy_version 489199 (0.0010) [2023-12-26 03:31:08,114][123090] Updated weights for policy 1, policy_version 489209 (0.0007) [2023-12-26 03:31:08,721][123091] Updated weights for policy 0, policy_version 492600 (0.0009) [2023-12-26 03:31:08,778][123091] Updated weights for policy 0, policy_version 492610 (0.0009) [2023-12-26 03:31:08,784][121949] Fps is (10 sec: 17206.9, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 251346944. Throughput: 0: 8555.5, 1: 8871.0. Samples: 251328948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:08,785][121949] Avg episode reward: [(0, '5652.521'), (1, '5799.894')] [2023-12-26 03:31:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000489216_125239296.pth... [2023-12-26 03:31:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000488192_124977152.pth [2023-12-26 03:31:08,840][123091] Updated weights for policy 0, policy_version 492620 (0.0009) [2023-12-26 03:31:08,859][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000492624_126115840.pth... [2023-12-26 03:31:08,864][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000491632_125861888.pth [2023-12-26 03:31:08,864][123090] Updated weights for policy 1, policy_version 489219 (0.0006) [2023-12-26 03:31:08,913][123090] Updated weights for policy 1, policy_version 489229 (0.0005) [2023-12-26 03:31:08,972][123090] Updated weights for policy 1, policy_version 489239 (0.0005) [2023-12-26 03:31:09,733][123091] Updated weights for policy 0, policy_version 492630 (0.0010) [2023-12-26 03:31:09,785][123090] Updated weights for policy 1, policy_version 489249 (0.0006) [2023-12-26 03:31:09,792][123091] Updated weights for policy 0, policy_version 492640 (0.0010) [2023-12-26 03:31:09,857][123090] Updated weights for policy 1, policy_version 489259 (0.0009) [2023-12-26 03:31:09,861][123091] Updated weights for policy 0, policy_version 492650 (0.0008) [2023-12-26 03:31:09,926][123090] Updated weights for policy 1, policy_version 489269 (0.0011) [2023-12-26 03:31:09,989][123090] Updated weights for policy 1, policy_version 489279 (0.0011) [2023-12-26 03:31:10,700][123091] Updated weights for policy 0, policy_version 492660 (0.0006) [2023-12-26 03:31:10,750][123090] Updated weights for policy 1, policy_version 489289 (0.0006) [2023-12-26 03:31:10,759][123091] Updated weights for policy 0, policy_version 492670 (0.0006) [2023-12-26 03:31:10,809][123090] Updated weights for policy 1, policy_version 489299 (0.0005) [2023-12-26 03:31:10,826][123091] Updated weights for policy 0, policy_version 492680 (0.0011) [2023-12-26 03:31:10,863][123090] Updated weights for policy 1, policy_version 489309 (0.0007) [2023-12-26 03:31:11,656][123091] Updated weights for policy 0, policy_version 492690 (0.0010) [2023-12-26 03:31:11,693][123090] Updated weights for policy 1, policy_version 489319 (0.0008) [2023-12-26 03:31:11,722][123091] Updated weights for policy 0, policy_version 492700 (0.0009) [2023-12-26 03:31:11,765][123090] Updated weights for policy 1, policy_version 489329 (0.0009) [2023-12-26 03:31:11,789][123091] Updated weights for policy 0, policy_version 492710 (0.0009) [2023-12-26 03:31:11,827][123090] Updated weights for policy 1, policy_version 489339 (0.0009) [2023-12-26 03:31:11,842][123091] Updated weights for policy 0, policy_version 492720 (0.0009) [2023-12-26 03:31:12,638][123090] Updated weights for policy 1, policy_version 489349 (0.0010) [2023-12-26 03:31:12,703][123090] Updated weights for policy 1, policy_version 489359 (0.0007) [2023-12-26 03:31:12,718][123091] Updated weights for policy 0, policy_version 492730 (0.0010) [2023-12-26 03:31:12,769][123090] Updated weights for policy 1, policy_version 489369 (0.0007) [2023-12-26 03:31:12,780][123091] Updated weights for policy 0, policy_version 492740 (0.0009) [2023-12-26 03:31:12,840][123091] Updated weights for policy 0, policy_version 492750 (0.0009) [2023-12-26 03:31:13,368][123090] Updated weights for policy 1, policy_version 489379 (0.0008) [2023-12-26 03:31:13,439][123090] Updated weights for policy 1, policy_version 489389 (0.0006) [2023-12-26 03:31:13,498][123090] Updated weights for policy 1, policy_version 489399 (0.0010) [2023-12-26 03:31:13,706][123091] Updated weights for policy 0, policy_version 492760 (0.0006) [2023-12-26 03:31:13,764][123091] Updated weights for policy 0, policy_version 492770 (0.0005) [2023-12-26 03:31:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 251437056. Throughput: 0: 8490.7, 1: 8945.1. Samples: 251432204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:13,785][121949] Avg episode reward: [(0, '5819.459'), (1, '5881.135')] [2023-12-26 03:31:13,819][123091] Updated weights for policy 0, policy_version 492780 (0.0005) [2023-12-26 03:31:14,182][123090] Updated weights for policy 1, policy_version 489409 (0.0008) [2023-12-26 03:31:14,243][123090] Updated weights for policy 1, policy_version 489419 (0.0005) [2023-12-26 03:31:14,301][123090] Updated weights for policy 1, policy_version 489429 (0.0005) [2023-12-26 03:31:14,355][123090] Updated weights for policy 1, policy_version 489439 (0.0006) [2023-12-26 03:31:14,433][123091] Updated weights for policy 0, policy_version 492790 (0.0008) [2023-12-26 03:31:14,510][123091] Updated weights for policy 0, policy_version 492800 (0.0010) [2023-12-26 03:31:14,578][123091] Updated weights for policy 0, policy_version 492810 (0.0009) [2023-12-26 03:31:15,063][123090] Updated weights for policy 1, policy_version 489449 (0.0007) [2023-12-26 03:31:15,131][123090] Updated weights for policy 1, policy_version 489459 (0.0009) [2023-12-26 03:31:15,203][123090] Updated weights for policy 1, policy_version 489469 (0.0010) [2023-12-26 03:31:15,432][123091] Updated weights for policy 0, policy_version 492820 (0.0010) [2023-12-26 03:31:15,496][123091] Updated weights for policy 0, policy_version 492830 (0.0011) [2023-12-26 03:31:15,559][123091] Updated weights for policy 0, policy_version 492840 (0.0011) [2023-12-26 03:31:16,060][123090] Updated weights for policy 1, policy_version 489479 (0.0010) [2023-12-26 03:31:16,131][123090] Updated weights for policy 1, policy_version 489489 (0.0009) [2023-12-26 03:31:16,201][123090] Updated weights for policy 1, policy_version 489499 (0.0009) [2023-12-26 03:31:16,237][123091] Updated weights for policy 0, policy_version 492850 (0.0010) [2023-12-26 03:31:16,289][123091] Updated weights for policy 0, policy_version 492860 (0.0005) [2023-12-26 03:31:16,352][123091] Updated weights for policy 0, policy_version 492870 (0.0010) [2023-12-26 03:31:16,420][123091] Updated weights for policy 0, policy_version 492880 (0.0006) [2023-12-26 03:31:16,944][123090] Updated weights for policy 1, policy_version 489509 (0.0006) [2023-12-26 03:31:17,020][123090] Updated weights for policy 1, policy_version 489519 (0.0007) [2023-12-26 03:31:17,082][123090] Updated weights for policy 1, policy_version 489529 (0.0008) [2023-12-26 03:31:17,122][123091] Updated weights for policy 0, policy_version 492890 (0.0005) [2023-12-26 03:31:17,185][123091] Updated weights for policy 0, policy_version 492900 (0.0005) [2023-12-26 03:31:17,247][123091] Updated weights for policy 0, policy_version 492910 (0.0006) [2023-12-26 03:31:17,716][123090] Updated weights for policy 1, policy_version 489539 (0.0005) [2023-12-26 03:31:17,778][123090] Updated weights for policy 1, policy_version 489549 (0.0005) [2023-12-26 03:31:17,842][123090] Updated weights for policy 1, policy_version 489559 (0.0005) [2023-12-26 03:31:17,871][123091] Updated weights for policy 0, policy_version 492920 (0.0010) [2023-12-26 03:31:17,934][123091] Updated weights for policy 0, policy_version 492930 (0.0008) [2023-12-26 03:31:17,980][123091] Updated weights for policy 0, policy_version 492940 (0.0006) [2023-12-26 03:31:18,558][123090] Updated weights for policy 1, policy_version 489569 (0.0010) [2023-12-26 03:31:18,618][123090] Updated weights for policy 1, policy_version 489579 (0.0010) [2023-12-26 03:31:18,679][123091] Updated weights for policy 0, policy_version 492950 (0.0006) [2023-12-26 03:31:18,687][123090] Updated weights for policy 1, policy_version 489589 (0.0010) [2023-12-26 03:31:18,750][123091] Updated weights for policy 0, policy_version 492960 (0.0005) [2023-12-26 03:31:18,755][123090] Updated weights for policy 1, policy_version 489599 (0.0010) [2023-12-26 03:31:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 251535360. Throughput: 0: 8597.0, 1: 9002.2. Samples: 251547308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:18,784][121949] Avg episode reward: [(0, '5764.335'), (1, '5871.922')] [2023-12-26 03:31:18,815][123091] Updated weights for policy 0, policy_version 492970 (0.0008) [2023-12-26 03:31:19,498][123090] Updated weights for policy 1, policy_version 489609 (0.0008) [2023-12-26 03:31:19,528][123091] Updated weights for policy 0, policy_version 492980 (0.0011) [2023-12-26 03:31:19,561][123090] Updated weights for policy 1, policy_version 489619 (0.0006) [2023-12-26 03:31:19,592][123091] Updated weights for policy 0, policy_version 492990 (0.0011) [2023-12-26 03:31:19,629][123090] Updated weights for policy 1, policy_version 489629 (0.0006) [2023-12-26 03:31:19,655][123091] Updated weights for policy 0, policy_version 493000 (0.0011) [2023-12-26 03:31:20,423][123090] Updated weights for policy 1, policy_version 489639 (0.0007) [2023-12-26 03:31:20,496][123090] Updated weights for policy 1, policy_version 489649 (0.0008) [2023-12-26 03:31:20,506][123091] Updated weights for policy 0, policy_version 493010 (0.0011) [2023-12-26 03:31:20,561][123090] Updated weights for policy 1, policy_version 489659 (0.0005) [2023-12-26 03:31:20,570][123091] Updated weights for policy 0, policy_version 493020 (0.0011) [2023-12-26 03:31:20,635][123091] Updated weights for policy 0, policy_version 493030 (0.0011) [2023-12-26 03:31:20,691][123091] Updated weights for policy 0, policy_version 493040 (0.0011) [2023-12-26 03:31:21,313][123090] Updated weights for policy 1, policy_version 489669 (0.0009) [2023-12-26 03:31:21,367][123090] Updated weights for policy 1, policy_version 489679 (0.0009) [2023-12-26 03:31:21,442][123090] Updated weights for policy 1, policy_version 489689 (0.0009) [2023-12-26 03:31:21,533][123091] Updated weights for policy 0, policy_version 493050 (0.0011) [2023-12-26 03:31:21,602][123091] Updated weights for policy 0, policy_version 493060 (0.0011) [2023-12-26 03:31:21,677][123091] Updated weights for policy 0, policy_version 493070 (0.0008) [2023-12-26 03:31:22,328][123090] Updated weights for policy 1, policy_version 489699 (0.0009) [2023-12-26 03:31:22,396][123090] Updated weights for policy 1, policy_version 489709 (0.0010) [2023-12-26 03:31:22,458][123090] Updated weights for policy 1, policy_version 489719 (0.0009) [2023-12-26 03:31:22,502][123091] Updated weights for policy 0, policy_version 493080 (0.0006) [2023-12-26 03:31:22,573][123091] Updated weights for policy 0, policy_version 493090 (0.0009) [2023-12-26 03:31:22,639][123091] Updated weights for policy 0, policy_version 493100 (0.0009) [2023-12-26 03:31:23,264][123090] Updated weights for policy 1, policy_version 489729 (0.0008) [2023-12-26 03:31:23,316][123090] Updated weights for policy 1, policy_version 489739 (0.0005) [2023-12-26 03:31:23,382][123090] Updated weights for policy 1, policy_version 489749 (0.0005) [2023-12-26 03:31:23,442][123090] Updated weights for policy 1, policy_version 489759 (0.0005) [2023-12-26 03:31:23,471][123091] Updated weights for policy 0, policy_version 493110 (0.0007) [2023-12-26 03:31:23,527][123091] Updated weights for policy 0, policy_version 493120 (0.0005) [2023-12-26 03:31:23,593][123091] Updated weights for policy 0, policy_version 493130 (0.0005) [2023-12-26 03:31:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 251625472. Throughput: 0: 8602.6, 1: 9006.5. Samples: 251599692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:23,785][121949] Avg episode reward: [(0, '5764.145'), (1, '5781.764')] [2023-12-26 03:31:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000493136_126246912.pth... [2023-12-26 03:31:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000489760_125378560.pth... [2023-12-26 03:31:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000488704_125108224.pth [2023-12-26 03:31:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000492112_125984768.pth [2023-12-26 03:31:24,180][123090] Updated weights for policy 1, policy_version 489769 (0.0008) [2023-12-26 03:31:24,234][123091] Updated weights for policy 0, policy_version 493140 (0.0008) [2023-12-26 03:31:24,241][123090] Updated weights for policy 1, policy_version 489779 (0.0009) [2023-12-26 03:31:24,283][123091] Updated weights for policy 0, policy_version 493150 (0.0008) [2023-12-26 03:31:24,297][123090] Updated weights for policy 1, policy_version 489789 (0.0009) [2023-12-26 03:31:24,343][123091] Updated weights for policy 0, policy_version 493160 (0.0009) [2023-12-26 03:31:25,040][123090] Updated weights for policy 1, policy_version 489799 (0.0009) [2023-12-26 03:31:25,102][123090] Updated weights for policy 1, policy_version 489809 (0.0008) [2023-12-26 03:31:25,111][123091] Updated weights for policy 0, policy_version 493170 (0.0010) [2023-12-26 03:31:25,157][123090] Updated weights for policy 1, policy_version 489819 (0.0006) [2023-12-26 03:31:25,174][123091] Updated weights for policy 0, policy_version 493180 (0.0010) [2023-12-26 03:31:25,235][123091] Updated weights for policy 0, policy_version 493190 (0.0010) [2023-12-26 03:31:25,304][123091] Updated weights for policy 0, policy_version 493200 (0.0010) [2023-12-26 03:31:26,009][123090] Updated weights for policy 1, policy_version 489829 (0.0005) [2023-12-26 03:31:26,023][123091] Updated weights for policy 0, policy_version 493210 (0.0010) [2023-12-26 03:31:26,057][123090] Updated weights for policy 1, policy_version 489839 (0.0007) [2023-12-26 03:31:26,078][123091] Updated weights for policy 0, policy_version 493220 (0.0010) [2023-12-26 03:31:26,110][123090] Updated weights for policy 1, policy_version 489849 (0.0007) [2023-12-26 03:31:26,136][123091] Updated weights for policy 0, policy_version 493230 (0.0010) [2023-12-26 03:31:26,952][123090] Updated weights for policy 1, policy_version 489859 (0.0008) [2023-12-26 03:31:26,978][123091] Updated weights for policy 0, policy_version 493240 (0.0011) [2023-12-26 03:31:27,014][123090] Updated weights for policy 1, policy_version 489869 (0.0010) [2023-12-26 03:31:27,041][123091] Updated weights for policy 0, policy_version 493250 (0.0011) [2023-12-26 03:31:27,074][123090] Updated weights for policy 1, policy_version 489879 (0.0006) [2023-12-26 03:31:27,093][123091] Updated weights for policy 0, policy_version 493260 (0.0010) [2023-12-26 03:31:27,934][123090] Updated weights for policy 1, policy_version 489889 (0.0007) [2023-12-26 03:31:27,941][123091] Updated weights for policy 0, policy_version 493270 (0.0011) [2023-12-26 03:31:28,013][123091] Updated weights for policy 0, policy_version 493280 (0.0011) [2023-12-26 03:31:28,013][123090] Updated weights for policy 1, policy_version 489899 (0.0010) [2023-12-26 03:31:28,079][123090] Updated weights for policy 1, policy_version 489909 (0.0007) [2023-12-26 03:31:28,080][123091] Updated weights for policy 0, policy_version 493290 (0.0011) [2023-12-26 03:31:28,138][123090] Updated weights for policy 1, policy_version 489919 (0.0009) [2023-12-26 03:31:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 251707392. Throughput: 0: 8670.0, 1: 9019.1. Samples: 251706564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:28,785][121949] Avg episode reward: [(0, '5816.221'), (1, '5750.336')] [2023-12-26 03:31:28,888][123091] Updated weights for policy 0, policy_version 493300 (0.0011) [2023-12-26 03:31:28,937][123090] Updated weights for policy 1, policy_version 489929 (0.0006) [2023-12-26 03:31:28,947][123091] Updated weights for policy 0, policy_version 493310 (0.0011) [2023-12-26 03:31:29,005][123090] Updated weights for policy 1, policy_version 489939 (0.0006) [2023-12-26 03:31:29,010][123091] Updated weights for policy 0, policy_version 493320 (0.0011) [2023-12-26 03:31:29,071][123090] Updated weights for policy 1, policy_version 489949 (0.0005) [2023-12-26 03:31:29,762][123090] Updated weights for policy 1, policy_version 489959 (0.0006) [2023-12-26 03:31:29,763][123091] Updated weights for policy 0, policy_version 493330 (0.0011) [2023-12-26 03:31:29,824][123091] Updated weights for policy 0, policy_version 493340 (0.0011) [2023-12-26 03:31:29,833][123090] Updated weights for policy 1, policy_version 489969 (0.0007) [2023-12-26 03:31:29,884][123091] Updated weights for policy 0, policy_version 493350 (0.0011) [2023-12-26 03:31:29,905][123090] Updated weights for policy 1, policy_version 489979 (0.0012) [2023-12-26 03:31:29,950][123091] Updated weights for policy 0, policy_version 493360 (0.0011) [2023-12-26 03:31:30,707][123091] Updated weights for policy 0, policy_version 493370 (0.0005) [2023-12-26 03:31:30,737][123090] Updated weights for policy 1, policy_version 489989 (0.0010) [2023-12-26 03:31:30,763][123091] Updated weights for policy 0, policy_version 493380 (0.0005) [2023-12-26 03:31:30,800][123090] Updated weights for policy 1, policy_version 489999 (0.0010) [2023-12-26 03:31:30,819][123091] Updated weights for policy 0, policy_version 493390 (0.0005) [2023-12-26 03:31:30,854][123090] Updated weights for policy 1, policy_version 490009 (0.0010) [2023-12-26 03:31:31,532][123091] Updated weights for policy 0, policy_version 493400 (0.0006) [2023-12-26 03:31:31,598][123091] Updated weights for policy 0, policy_version 493410 (0.0005) [2023-12-26 03:31:31,663][123091] Updated weights for policy 0, policy_version 493420 (0.0007) [2023-12-26 03:31:31,703][123090] Updated weights for policy 1, policy_version 490019 (0.0010) [2023-12-26 03:31:31,772][123090] Updated weights for policy 1, policy_version 490029 (0.0011) [2023-12-26 03:31:31,842][123090] Updated weights for policy 1, policy_version 490039 (0.0010) [2023-12-26 03:31:32,492][123091] Updated weights for policy 0, policy_version 493430 (0.0008) [2023-12-26 03:31:32,553][123090] Updated weights for policy 1, policy_version 490049 (0.0008) [2023-12-26 03:31:32,559][123091] Updated weights for policy 0, policy_version 493440 (0.0010) [2023-12-26 03:31:32,602][123090] Updated weights for policy 1, policy_version 490059 (0.0008) [2023-12-26 03:31:32,619][123091] Updated weights for policy 0, policy_version 493450 (0.0008) [2023-12-26 03:31:32,653][123090] Updated weights for policy 1, policy_version 490069 (0.0008) [2023-12-26 03:31:32,708][123090] Updated weights for policy 1, policy_version 490080 (0.0009) [2023-12-26 03:31:33,251][123091] Updated weights for policy 0, policy_version 493460 (0.0008) [2023-12-26 03:31:33,303][123091] Updated weights for policy 0, policy_version 493470 (0.0009) [2023-12-26 03:31:33,358][123091] Updated weights for policy 0, policy_version 493480 (0.0009) [2023-12-26 03:31:33,481][123090] Updated weights for policy 1, policy_version 490090 (0.0010) [2023-12-26 03:31:33,532][123090] Updated weights for policy 1, policy_version 490100 (0.0008) [2023-12-26 03:31:33,581][123090] Updated weights for policy 1, policy_version 490110 (0.0008) [2023-12-26 03:31:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 251805696. Throughput: 0: 8730.1, 1: 9032.4. Samples: 251814656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:33,785][121949] Avg episode reward: [(0, '5933.643'), (1, '5768.938')] [2023-12-26 03:31:34,095][123091] Updated weights for policy 0, policy_version 493490 (0.0008) [2023-12-26 03:31:34,156][123091] Updated weights for policy 0, policy_version 493500 (0.0007) [2023-12-26 03:31:34,223][123091] Updated weights for policy 0, policy_version 493510 (0.0007) [2023-12-26 03:31:34,294][123091] Updated weights for policy 0, policy_version 493520 (0.0006) [2023-12-26 03:31:34,435][123090] Updated weights for policy 1, policy_version 490120 (0.0009) [2023-12-26 03:31:34,493][123090] Updated weights for policy 1, policy_version 490130 (0.0010) [2023-12-26 03:31:34,553][123090] Updated weights for policy 1, policy_version 490140 (0.0010) [2023-12-26 03:31:34,902][123091] Updated weights for policy 0, policy_version 493530 (0.0005) [2023-12-26 03:31:34,962][123091] Updated weights for policy 0, policy_version 493540 (0.0005) [2023-12-26 03:31:35,022][123091] Updated weights for policy 0, policy_version 493550 (0.0008) [2023-12-26 03:31:35,508][123090] Updated weights for policy 1, policy_version 490150 (0.0010) [2023-12-26 03:31:35,566][123090] Updated weights for policy 1, policy_version 490160 (0.0009) [2023-12-26 03:31:35,628][123090] Updated weights for policy 1, policy_version 490170 (0.0010) [2023-12-26 03:31:35,683][123091] Updated weights for policy 0, policy_version 493560 (0.0007) [2023-12-26 03:31:35,747][123091] Updated weights for policy 0, policy_version 493570 (0.0005) [2023-12-26 03:31:35,801][123091] Updated weights for policy 0, policy_version 493580 (0.0005) [2023-12-26 03:31:36,443][123091] Updated weights for policy 0, policy_version 493590 (0.0005) [2023-12-26 03:31:36,518][123091] Updated weights for policy 0, policy_version 493600 (0.0008) [2023-12-26 03:31:36,571][123090] Updated weights for policy 1, policy_version 490180 (0.0008) [2023-12-26 03:31:36,582][123091] Updated weights for policy 0, policy_version 493610 (0.0011) [2023-12-26 03:31:36,633][123090] Updated weights for policy 1, policy_version 490190 (0.0008) [2023-12-26 03:31:36,697][123090] Updated weights for policy 1, policy_version 490200 (0.0008) [2023-12-26 03:31:37,388][123091] Updated weights for policy 0, policy_version 493620 (0.0011) [2023-12-26 03:31:37,439][123091] Updated weights for policy 0, policy_version 493630 (0.0007) [2023-12-26 03:31:37,505][123091] Updated weights for policy 0, policy_version 493640 (0.0006) [2023-12-26 03:31:37,538][123090] Updated weights for policy 1, policy_version 490210 (0.0009) [2023-12-26 03:31:37,606][123090] Updated weights for policy 1, policy_version 490220 (0.0008) [2023-12-26 03:31:37,676][123090] Updated weights for policy 1, policy_version 490230 (0.0009) [2023-12-26 03:31:37,747][123090] Updated weights for policy 1, policy_version 490240 (0.0010) [2023-12-26 03:31:38,215][123091] Updated weights for policy 0, policy_version 493650 (0.0008) [2023-12-26 03:31:38,277][123091] Updated weights for policy 0, policy_version 493660 (0.0010) [2023-12-26 03:31:38,325][123091] Updated weights for policy 0, policy_version 493670 (0.0010) [2023-12-26 03:31:38,395][123091] Updated weights for policy 0, policy_version 493680 (0.0011) [2023-12-26 03:31:38,599][123090] Updated weights for policy 1, policy_version 490250 (0.0011) [2023-12-26 03:31:38,654][123090] Updated weights for policy 1, policy_version 490260 (0.0010) [2023-12-26 03:31:38,706][123090] Updated weights for policy 1, policy_version 490270 (0.0010) [2023-12-26 03:31:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 251895808. Throughput: 0: 8895.2, 1: 8950.0. Samples: 251869616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:38,785][121949] Avg episode reward: [(0, '5815.341'), (1, '5741.299')] [2023-12-26 03:31:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000493680_126386176.pth... [2023-12-26 03:31:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000490272_125509632.pth... [2023-12-26 03:31:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000492624_126115840.pth [2023-12-26 03:31:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000489216_125239296.pth [2023-12-26 03:31:39,253][123091] Updated weights for policy 0, policy_version 493690 (0.0006) [2023-12-26 03:31:39,322][123091] Updated weights for policy 0, policy_version 493700 (0.0007) [2023-12-26 03:31:39,389][123091] Updated weights for policy 0, policy_version 493710 (0.0009) [2023-12-26 03:31:39,515][123090] Updated weights for policy 1, policy_version 490280 (0.0010) [2023-12-26 03:31:39,573][123090] Updated weights for policy 1, policy_version 490290 (0.0009) [2023-12-26 03:31:39,633][123090] Updated weights for policy 1, policy_version 490300 (0.0008) [2023-12-26 03:31:40,193][123091] Updated weights for policy 0, policy_version 493720 (0.0010) [2023-12-26 03:31:40,243][123091] Updated weights for policy 0, policy_version 493730 (0.0010) [2023-12-26 03:31:40,303][123091] Updated weights for policy 0, policy_version 493740 (0.0010) [2023-12-26 03:31:40,489][123090] Updated weights for policy 1, policy_version 490310 (0.0010) [2023-12-26 03:31:40,539][123090] Updated weights for policy 1, policy_version 490320 (0.0009) [2023-12-26 03:31:40,595][123090] Updated weights for policy 1, policy_version 490330 (0.0009) [2023-12-26 03:31:41,149][123091] Updated weights for policy 0, policy_version 493750 (0.0009) [2023-12-26 03:31:41,210][123091] Updated weights for policy 0, policy_version 493760 (0.0010) [2023-12-26 03:31:41,262][123091] Updated weights for policy 0, policy_version 493770 (0.0009) [2023-12-26 03:31:41,475][123090] Updated weights for policy 1, policy_version 490340 (0.0009) [2023-12-26 03:31:41,542][123090] Updated weights for policy 1, policy_version 490350 (0.0010) [2023-12-26 03:31:41,610][123090] Updated weights for policy 1, policy_version 490360 (0.0009) [2023-12-26 03:31:42,052][123091] Updated weights for policy 0, policy_version 493780 (0.0008) [2023-12-26 03:31:42,122][123091] Updated weights for policy 0, policy_version 493790 (0.0008) [2023-12-26 03:31:42,185][123091] Updated weights for policy 0, policy_version 493800 (0.0010) [2023-12-26 03:31:42,467][123090] Updated weights for policy 1, policy_version 490370 (0.0009) [2023-12-26 03:31:42,534][123090] Updated weights for policy 1, policy_version 490380 (0.0009) [2023-12-26 03:31:42,605][123090] Updated weights for policy 1, policy_version 490390 (0.0009) [2023-12-26 03:31:42,677][123090] Updated weights for policy 1, policy_version 490400 (0.0010) [2023-12-26 03:31:42,950][123091] Updated weights for policy 0, policy_version 493810 (0.0010) [2023-12-26 03:31:43,011][123091] Updated weights for policy 0, policy_version 493820 (0.0009) [2023-12-26 03:31:43,069][123091] Updated weights for policy 0, policy_version 493830 (0.0010) [2023-12-26 03:31:43,128][123091] Updated weights for policy 0, policy_version 493840 (0.0009) [2023-12-26 03:31:43,513][123090] Updated weights for policy 1, policy_version 490410 (0.0009) [2023-12-26 03:31:43,563][123090] Updated weights for policy 1, policy_version 490420 (0.0009) [2023-12-26 03:31:43,630][123090] Updated weights for policy 1, policy_version 490430 (0.0008) [2023-12-26 03:31:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 251977728. Throughput: 0: 8904.0, 1: 8756.9. Samples: 251971564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:43,785][121949] Avg episode reward: [(0, '5694.433'), (1, '5668.503')] [2023-12-26 03:31:43,967][123091] Updated weights for policy 0, policy_version 493850 (0.0009) [2023-12-26 03:31:44,023][123091] Updated weights for policy 0, policy_version 493860 (0.0009) [2023-12-26 03:31:44,098][123091] Updated weights for policy 0, policy_version 493870 (0.0008) [2023-12-26 03:31:44,395][123090] Updated weights for policy 1, policy_version 490440 (0.0006) [2023-12-26 03:31:44,457][123090] Updated weights for policy 1, policy_version 490450 (0.0009) [2023-12-26 03:31:44,505][123090] Updated weights for policy 1, policy_version 490460 (0.0009) [2023-12-26 03:31:44,941][123091] Updated weights for policy 0, policy_version 493880 (0.0010) [2023-12-26 03:31:45,005][123091] Updated weights for policy 0, policy_version 493890 (0.0010) [2023-12-26 03:31:45,061][123091] Updated weights for policy 0, policy_version 493900 (0.0010) [2023-12-26 03:31:45,314][123090] Updated weights for policy 1, policy_version 490470 (0.0010) [2023-12-26 03:31:45,369][123090] Updated weights for policy 1, policy_version 490480 (0.0011) [2023-12-26 03:31:45,417][123090] Updated weights for policy 1, policy_version 490490 (0.0010) [2023-12-26 03:31:45,909][123091] Updated weights for policy 0, policy_version 493910 (0.0007) [2023-12-26 03:31:45,961][123091] Updated weights for policy 0, policy_version 493920 (0.0005) [2023-12-26 03:31:46,015][123091] Updated weights for policy 0, policy_version 493931 (0.0007) [2023-12-26 03:31:46,299][123090] Updated weights for policy 1, policy_version 490500 (0.0010) [2023-12-26 03:31:46,361][123090] Updated weights for policy 1, policy_version 490510 (0.0009) [2023-12-26 03:31:46,423][123090] Updated weights for policy 1, policy_version 490520 (0.0009) [2023-12-26 03:31:46,786][123091] Updated weights for policy 0, policy_version 493941 (0.0007) [2023-12-26 03:31:46,839][123091] Updated weights for policy 0, policy_version 493951 (0.0009) [2023-12-26 03:31:46,895][123091] Updated weights for policy 0, policy_version 493961 (0.0009) [2023-12-26 03:31:47,201][123090] Updated weights for policy 1, policy_version 490530 (0.0009) [2023-12-26 03:31:47,249][123090] Updated weights for policy 1, policy_version 490540 (0.0009) [2023-12-26 03:31:47,300][123090] Updated weights for policy 1, policy_version 490550 (0.0009) [2023-12-26 03:31:47,353][123090] Updated weights for policy 1, policy_version 490560 (0.0008) [2023-12-26 03:31:47,750][123091] Updated weights for policy 0, policy_version 493971 (0.0008) [2023-12-26 03:31:47,798][123091] Updated weights for policy 0, policy_version 493981 (0.0009) [2023-12-26 03:31:47,858][123091] Updated weights for policy 0, policy_version 493991 (0.0009) [2023-12-26 03:31:48,141][123090] Updated weights for policy 1, policy_version 490570 (0.0008) [2023-12-26 03:31:48,207][123090] Updated weights for policy 1, policy_version 490580 (0.0008) [2023-12-26 03:31:48,272][123090] Updated weights for policy 1, policy_version 490590 (0.0008) [2023-12-26 03:31:48,717][123091] Updated weights for policy 0, policy_version 494001 (0.0010) [2023-12-26 03:31:48,777][123091] Updated weights for policy 0, policy_version 494011 (0.0009) [2023-12-26 03:31:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 252059648. Throughput: 0: 8946.3, 1: 8801.2. Samples: 252076028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:48,785][121949] Avg episode reward: [(0, '5797.727'), (1, '5521.312')] [2023-12-26 03:31:48,842][123091] Updated weights for policy 0, policy_version 494021 (0.0009) [2023-12-26 03:31:48,906][123091] Updated weights for policy 0, policy_version 494031 (0.0009) [2023-12-26 03:31:49,046][123090] Updated weights for policy 1, policy_version 490600 (0.0008) [2023-12-26 03:31:49,095][123090] Updated weights for policy 1, policy_version 490610 (0.0009) [2023-12-26 03:31:49,148][123090] Updated weights for policy 1, policy_version 490620 (0.0008) [2023-12-26 03:31:49,696][123091] Updated weights for policy 0, policy_version 494041 (0.0009) [2023-12-26 03:31:49,762][123091] Updated weights for policy 0, policy_version 494051 (0.0009) [2023-12-26 03:31:49,826][123091] Updated weights for policy 0, policy_version 494061 (0.0008) [2023-12-26 03:31:50,031][123090] Updated weights for policy 1, policy_version 490630 (0.0010) [2023-12-26 03:31:50,091][123090] Updated weights for policy 1, policy_version 490640 (0.0010) [2023-12-26 03:31:50,162][123090] Updated weights for policy 1, policy_version 490650 (0.0010) [2023-12-26 03:31:50,638][123091] Updated weights for policy 0, policy_version 494071 (0.0009) [2023-12-26 03:31:50,698][123091] Updated weights for policy 0, policy_version 494081 (0.0009) [2023-12-26 03:31:50,765][123091] Updated weights for policy 0, policy_version 494091 (0.0009) [2023-12-26 03:31:50,990][123090] Updated weights for policy 1, policy_version 490660 (0.0010) [2023-12-26 03:31:51,061][123090] Updated weights for policy 1, policy_version 490670 (0.0010) [2023-12-26 03:31:51,127][123090] Updated weights for policy 1, policy_version 490680 (0.0011) [2023-12-26 03:31:51,616][123091] Updated weights for policy 0, policy_version 494101 (0.0010) [2023-12-26 03:31:51,676][123091] Updated weights for policy 0, policy_version 494111 (0.0008) [2023-12-26 03:31:51,733][123091] Updated weights for policy 0, policy_version 494121 (0.0009) [2023-12-26 03:31:52,005][123090] Updated weights for policy 1, policy_version 490690 (0.0011) [2023-12-26 03:31:52,068][123090] Updated weights for policy 1, policy_version 490700 (0.0010) [2023-12-26 03:31:52,127][123090] Updated weights for policy 1, policy_version 490710 (0.0010) [2023-12-26 03:31:52,190][123090] Updated weights for policy 1, policy_version 490720 (0.0010) [2023-12-26 03:31:52,576][123091] Updated weights for policy 0, policy_version 494131 (0.0009) [2023-12-26 03:31:52,640][123091] Updated weights for policy 0, policy_version 494141 (0.0009) [2023-12-26 03:31:52,689][123091] Updated weights for policy 0, policy_version 494151 (0.0009) [2023-12-26 03:31:53,009][123090] Updated weights for policy 1, policy_version 490730 (0.0009) [2023-12-26 03:31:53,068][123090] Updated weights for policy 1, policy_version 490740 (0.0010) [2023-12-26 03:31:53,127][123090] Updated weights for policy 1, policy_version 490750 (0.0010) [2023-12-26 03:31:53,400][123091] Updated weights for policy 0, policy_version 494161 (0.0008) [2023-12-26 03:31:53,460][123091] Updated weights for policy 0, policy_version 494171 (0.0005) [2023-12-26 03:31:53,516][123091] Updated weights for policy 0, policy_version 494181 (0.0006) [2023-12-26 03:31:53,567][123091] Updated weights for policy 0, policy_version 494191 (0.0010) [2023-12-26 03:31:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 252149760. Throughput: 0: 8953.9, 1: 8769.5. Samples: 252126504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:53,785][121949] Avg episode reward: [(0, '5885.074'), (1, '5522.968')] [2023-12-26 03:31:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000494192_126517248.pth... [2023-12-26 03:31:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000490752_125632512.pth... [2023-12-26 03:31:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000489760_125378560.pth [2023-12-26 03:31:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000493136_126246912.pth [2023-12-26 03:31:53,944][123090] Updated weights for policy 1, policy_version 490760 (0.0008) [2023-12-26 03:31:54,007][123090] Updated weights for policy 1, policy_version 490770 (0.0006) [2023-12-26 03:31:54,056][123090] Updated weights for policy 1, policy_version 490780 (0.0005) [2023-12-26 03:31:54,230][123091] Updated weights for policy 0, policy_version 494201 (0.0006) [2023-12-26 03:31:54,273][123091] Updated weights for policy 0, policy_version 494211 (0.0010) [2023-12-26 03:31:54,325][123091] Updated weights for policy 0, policy_version 494221 (0.0010) [2023-12-26 03:31:54,778][123090] Updated weights for policy 1, policy_version 490790 (0.0008) [2023-12-26 03:31:54,833][123090] Updated weights for policy 1, policy_version 490800 (0.0010) [2023-12-26 03:31:54,881][123090] Updated weights for policy 1, policy_version 490810 (0.0010) [2023-12-26 03:31:55,043][123091] Updated weights for policy 0, policy_version 494231 (0.0010) [2023-12-26 03:31:55,102][123091] Updated weights for policy 0, policy_version 494241 (0.0010) [2023-12-26 03:31:55,161][123091] Updated weights for policy 0, policy_version 494251 (0.0010) [2023-12-26 03:31:55,621][123090] Updated weights for policy 1, policy_version 490820 (0.0010) [2023-12-26 03:31:55,669][123090] Updated weights for policy 1, policy_version 490830 (0.0010) [2023-12-26 03:31:55,716][123090] Updated weights for policy 1, policy_version 490840 (0.0010) [2023-12-26 03:31:55,875][123091] Updated weights for policy 0, policy_version 494261 (0.0010) [2023-12-26 03:31:55,922][123091] Updated weights for policy 0, policy_version 494271 (0.0010) [2023-12-26 03:31:55,973][123091] Updated weights for policy 0, policy_version 494281 (0.0010) [2023-12-26 03:31:56,552][123090] Updated weights for policy 1, policy_version 490850 (0.0010) [2023-12-26 03:31:56,599][123090] Updated weights for policy 1, policy_version 490860 (0.0010) [2023-12-26 03:31:56,654][123090] Updated weights for policy 1, policy_version 490870 (0.0010) [2023-12-26 03:31:56,705][123090] Updated weights for policy 1, policy_version 490880 (0.0010) [2023-12-26 03:31:56,794][123091] Updated weights for policy 0, policy_version 494291 (0.0009) [2023-12-26 03:31:56,849][123091] Updated weights for policy 0, policy_version 494301 (0.0006) [2023-12-26 03:31:56,924][123091] Updated weights for policy 0, policy_version 494311 (0.0005) [2023-12-26 03:31:57,479][123090] Updated weights for policy 1, policy_version 490891 (0.0009) [2023-12-26 03:31:57,532][123090] Updated weights for policy 1, policy_version 490901 (0.0009) [2023-12-26 03:31:57,588][123091] Updated weights for policy 0, policy_version 494321 (0.0006) [2023-12-26 03:31:57,594][123090] Updated weights for policy 1, policy_version 490911 (0.0009) [2023-12-26 03:31:57,646][123091] Updated weights for policy 0, policy_version 494331 (0.0009) [2023-12-26 03:31:57,697][123091] Updated weights for policy 0, policy_version 494341 (0.0008) [2023-12-26 03:31:57,745][123091] Updated weights for policy 0, policy_version 494351 (0.0009) [2023-12-26 03:31:58,438][123090] Updated weights for policy 1, policy_version 490921 (0.0007) [2023-12-26 03:31:58,517][123090] Updated weights for policy 1, policy_version 490931 (0.0009) [2023-12-26 03:31:58,594][123090] Updated weights for policy 1, policy_version 490941 (0.0010) [2023-12-26 03:31:58,698][123091] Updated weights for policy 0, policy_version 494361 (0.0011) [2023-12-26 03:31:58,773][123091] Updated weights for policy 0, policy_version 494371 (0.0017) [2023-12-26 03:31:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17750.0, 300 sec: 17800.2). Total num frames: 252239872. Throughput: 0: 9126.9, 1: 8760.2. Samples: 252237124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:31:58,785][121949] Avg episode reward: [(0, '5788.436'), (1, '5604.947')] [2023-12-26 03:31:58,856][123091] Updated weights for policy 0, policy_version 494381 (0.0008) [2023-12-26 03:31:59,572][123090] Updated weights for policy 1, policy_version 490951 (0.0011) [2023-12-26 03:31:59,640][123090] Updated weights for policy 1, policy_version 490961 (0.0006) [2023-12-26 03:31:59,702][123090] Updated weights for policy 1, policy_version 490971 (0.0009) [2023-12-26 03:31:59,816][123091] Updated weights for policy 0, policy_version 494391 (0.0010) [2023-12-26 03:31:59,888][123091] Updated weights for policy 0, policy_version 494401 (0.0006) [2023-12-26 03:31:59,955][123091] Updated weights for policy 0, policy_version 494411 (0.0007) [2023-12-26 03:32:00,466][123090] Updated weights for policy 1, policy_version 490981 (0.0010) [2023-12-26 03:32:00,521][123090] Updated weights for policy 1, policy_version 490991 (0.0010) [2023-12-26 03:32:00,581][123090] Updated weights for policy 1, policy_version 491001 (0.0009) [2023-12-26 03:32:00,698][123091] Updated weights for policy 0, policy_version 494421 (0.0008) [2023-12-26 03:32:00,755][123091] Updated weights for policy 0, policy_version 494431 (0.0009) [2023-12-26 03:32:00,821][123091] Updated weights for policy 0, policy_version 494441 (0.0008) [2023-12-26 03:32:01,466][123090] Updated weights for policy 1, policy_version 491011 (0.0010) [2023-12-26 03:32:01,520][123090] Updated weights for policy 1, policy_version 491021 (0.0009) [2023-12-26 03:32:01,574][123090] Updated weights for policy 1, policy_version 491031 (0.0010) [2023-12-26 03:32:01,623][123091] Updated weights for policy 0, policy_version 494451 (0.0007) [2023-12-26 03:32:01,679][123091] Updated weights for policy 0, policy_version 494461 (0.0006) [2023-12-26 03:32:01,744][123091] Updated weights for policy 0, policy_version 494471 (0.0006) [2023-12-26 03:32:02,467][123090] Updated weights for policy 1, policy_version 491042 (0.0010) [2023-12-26 03:32:02,513][123091] Updated weights for policy 0, policy_version 494481 (0.0006) [2023-12-26 03:32:02,535][123090] Updated weights for policy 1, policy_version 491052 (0.0008) [2023-12-26 03:32:02,566][123091] Updated weights for policy 0, policy_version 494491 (0.0009) [2023-12-26 03:32:02,599][123090] Updated weights for policy 1, policy_version 491062 (0.0009) [2023-12-26 03:32:02,622][123091] Updated weights for policy 0, policy_version 494501 (0.0008) [2023-12-26 03:32:02,663][123090] Updated weights for policy 1, policy_version 491072 (0.0008) [2023-12-26 03:32:02,678][123091] Updated weights for policy 0, policy_version 494511 (0.0007) [2023-12-26 03:32:03,468][123090] Updated weights for policy 1, policy_version 491082 (0.0009) [2023-12-26 03:32:03,484][123091] Updated weights for policy 0, policy_version 494521 (0.0006) [2023-12-26 03:32:03,537][123090] Updated weights for policy 1, policy_version 491092 (0.0009) [2023-12-26 03:32:03,547][123091] Updated weights for policy 0, policy_version 494531 (0.0005) [2023-12-26 03:32:03,602][123090] Updated weights for policy 1, policy_version 491102 (0.0009) [2023-12-26 03:32:03,608][123091] Updated weights for policy 0, policy_version 494541 (0.0009) [2023-12-26 03:32:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 252329984. Throughput: 0: 8978.8, 1: 8573.9. Samples: 252337180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:03,785][121949] Avg episode reward: [(0, '5808.186'), (1, '5656.779')] [2023-12-26 03:32:04,337][123091] Updated weights for policy 0, policy_version 494551 (0.0006) [2023-12-26 03:32:04,404][123091] Updated weights for policy 0, policy_version 494561 (0.0006) [2023-12-26 03:32:04,468][123091] Updated weights for policy 0, policy_version 494571 (0.0006) [2023-12-26 03:32:04,476][123090] Updated weights for policy 1, policy_version 491112 (0.0008) [2023-12-26 03:32:04,533][123090] Updated weights for policy 1, policy_version 491122 (0.0009) [2023-12-26 03:32:04,586][123090] Updated weights for policy 1, policy_version 491132 (0.0010) [2023-12-26 03:32:05,017][123091] Updated weights for policy 0, policy_version 494581 (0.0006) [2023-12-26 03:32:05,079][123091] Updated weights for policy 0, policy_version 494591 (0.0005) [2023-12-26 03:32:05,140][123091] Updated weights for policy 0, policy_version 494601 (0.0005) [2023-12-26 03:32:05,530][123090] Updated weights for policy 1, policy_version 491143 (0.0010) [2023-12-26 03:32:05,590][123090] Updated weights for policy 1, policy_version 491153 (0.0009) [2023-12-26 03:32:05,650][123090] Updated weights for policy 1, policy_version 491163 (0.0010) [2023-12-26 03:32:05,756][123091] Updated weights for policy 0, policy_version 494611 (0.0007) [2023-12-26 03:32:05,812][123091] Updated weights for policy 0, policy_version 494623 (0.0010) [2023-12-26 03:32:05,862][123091] Updated weights for policy 0, policy_version 494633 (0.0009) [2023-12-26 03:32:06,490][123090] Updated weights for policy 1, policy_version 491173 (0.0010) [2023-12-26 03:32:06,558][123090] Updated weights for policy 1, policy_version 491183 (0.0009) [2023-12-26 03:32:06,620][123090] Updated weights for policy 1, policy_version 491193 (0.0010) [2023-12-26 03:32:06,735][123091] Updated weights for policy 0, policy_version 494643 (0.0008) [2023-12-26 03:32:06,803][123091] Updated weights for policy 0, policy_version 494653 (0.0010) [2023-12-26 03:32:06,868][123091] Updated weights for policy 0, policy_version 494663 (0.0010) [2023-12-26 03:32:07,442][123090] Updated weights for policy 1, policy_version 491203 (0.0009) [2023-12-26 03:32:07,507][123090] Updated weights for policy 1, policy_version 491214 (0.0010) [2023-12-26 03:32:07,561][123090] Updated weights for policy 1, policy_version 491225 (0.0011) [2023-12-26 03:32:07,643][123091] Updated weights for policy 0, policy_version 494673 (0.0009) [2023-12-26 03:32:07,706][123091] Updated weights for policy 0, policy_version 494683 (0.0009) [2023-12-26 03:32:07,759][123091] Updated weights for policy 0, policy_version 494693 (0.0010) [2023-12-26 03:32:07,812][123091] Updated weights for policy 0, policy_version 494703 (0.0010) [2023-12-26 03:32:08,422][123090] Updated weights for policy 1, policy_version 491235 (0.0009) [2023-12-26 03:32:08,489][123090] Updated weights for policy 1, policy_version 491245 (0.0010) [2023-12-26 03:32:08,544][123090] Updated weights for policy 1, policy_version 491255 (0.0009) [2023-12-26 03:32:08,653][123091] Updated weights for policy 0, policy_version 494713 (0.0010) [2023-12-26 03:32:08,712][123091] Updated weights for policy 0, policy_version 494723 (0.0010) [2023-12-26 03:32:08,774][123091] Updated weights for policy 0, policy_version 494733 (0.0009) [2023-12-26 03:32:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 252411904. Throughput: 0: 9062.6, 1: 8518.8. Samples: 252390852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:08,785][121949] Avg episode reward: [(0, '5845.930'), (1, '5692.270')] [2023-12-26 03:32:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000494736_126656512.pth... [2023-12-26 03:32:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000491264_125763584.pth... [2023-12-26 03:32:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000493680_126386176.pth [2023-12-26 03:32:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000490272_125509632.pth [2023-12-26 03:32:09,401][123090] Updated weights for policy 1, policy_version 491265 (0.0009) [2023-12-26 03:32:09,483][123090] Updated weights for policy 1, policy_version 491275 (0.0010) [2023-12-26 03:32:09,556][123090] Updated weights for policy 1, policy_version 491285 (0.0010) [2023-12-26 03:32:09,630][123090] Updated weights for policy 1, policy_version 491295 (0.0009) [2023-12-26 03:32:09,637][123091] Updated weights for policy 0, policy_version 494743 (0.0008) [2023-12-26 03:32:09,708][123091] Updated weights for policy 0, policy_version 494753 (0.0011) [2023-12-26 03:32:09,775][123091] Updated weights for policy 0, policy_version 494763 (0.0010) [2023-12-26 03:32:10,498][123090] Updated weights for policy 1, policy_version 491305 (0.0009) [2023-12-26 03:32:10,561][123090] Updated weights for policy 1, policy_version 491315 (0.0008) [2023-12-26 03:32:10,609][123091] Updated weights for policy 0, policy_version 494773 (0.0009) [2023-12-26 03:32:10,629][123090] Updated weights for policy 1, policy_version 491325 (0.0009) [2023-12-26 03:32:10,676][123091] Updated weights for policy 0, policy_version 494783 (0.0010) [2023-12-26 03:32:10,737][123091] Updated weights for policy 0, policy_version 494793 (0.0010) [2023-12-26 03:32:11,419][123090] Updated weights for policy 1, policy_version 491335 (0.0007) [2023-12-26 03:32:11,474][123090] Updated weights for policy 1, policy_version 491345 (0.0008) [2023-12-26 03:32:11,527][123090] Updated weights for policy 1, policy_version 491355 (0.0008) [2023-12-26 03:32:11,606][123091] Updated weights for policy 0, policy_version 494803 (0.0009) [2023-12-26 03:32:11,673][123091] Updated weights for policy 0, policy_version 494813 (0.0009) [2023-12-26 03:32:11,742][123091] Updated weights for policy 0, policy_version 494823 (0.0009) [2023-12-26 03:32:12,407][123090] Updated weights for policy 1, policy_version 491365 (0.0009) [2023-12-26 03:32:12,462][123091] Updated weights for policy 0, policy_version 494833 (0.0008) [2023-12-26 03:32:12,463][123090] Updated weights for policy 1, policy_version 491375 (0.0009) [2023-12-26 03:32:12,508][123091] Updated weights for policy 0, policy_version 494843 (0.0009) [2023-12-26 03:32:12,527][123090] Updated weights for policy 1, policy_version 491385 (0.0008) [2023-12-26 03:32:12,555][123091] Updated weights for policy 0, policy_version 494853 (0.0009) [2023-12-26 03:32:12,611][123091] Updated weights for policy 0, policy_version 494863 (0.0009) [2023-12-26 03:32:13,348][123090] Updated weights for policy 1, policy_version 491395 (0.0007) [2023-12-26 03:32:13,412][123090] Updated weights for policy 1, policy_version 491405 (0.0010) [2023-12-26 03:32:13,472][123091] Updated weights for policy 0, policy_version 494873 (0.0010) [2023-12-26 03:32:13,483][123090] Updated weights for policy 1, policy_version 491415 (0.0009) [2023-12-26 03:32:13,526][123091] Updated weights for policy 0, policy_version 494883 (0.0009) [2023-12-26 03:32:13,583][123091] Updated weights for policy 0, policy_version 494893 (0.0009) [2023-12-26 03:32:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 252502016. Throughput: 0: 8997.1, 1: 8459.8. Samples: 252492120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:13,784][121949] Avg episode reward: [(0, '5821.990'), (1, '5583.679')] [2023-12-26 03:32:14,293][123090] Updated weights for policy 1, policy_version 491425 (0.0008) [2023-12-26 03:32:14,356][123090] Updated weights for policy 1, policy_version 491435 (0.0008) [2023-12-26 03:32:14,416][123090] Updated weights for policy 1, policy_version 491445 (0.0009) [2023-12-26 03:32:14,453][123091] Updated weights for policy 0, policy_version 494903 (0.0008) [2023-12-26 03:32:14,482][123090] Updated weights for policy 1, policy_version 491455 (0.0008) [2023-12-26 03:32:14,503][123091] Updated weights for policy 0, policy_version 494913 (0.0008) [2023-12-26 03:32:14,564][123091] Updated weights for policy 0, policy_version 494923 (0.0008) [2023-12-26 03:32:15,295][123090] Updated weights for policy 1, policy_version 491465 (0.0006) [2023-12-26 03:32:15,359][123090] Updated weights for policy 1, policy_version 491475 (0.0007) [2023-12-26 03:32:15,434][123090] Updated weights for policy 1, policy_version 491485 (0.0006) [2023-12-26 03:32:15,458][123091] Updated weights for policy 0, policy_version 494933 (0.0010) [2023-12-26 03:32:15,515][123091] Updated weights for policy 0, policy_version 494943 (0.0010) [2023-12-26 03:32:15,576][123091] Updated weights for policy 0, policy_version 494953 (0.0010) [2023-12-26 03:32:16,117][123090] Updated weights for policy 1, policy_version 491495 (0.0006) [2023-12-26 03:32:16,165][123090] Updated weights for policy 1, policy_version 491505 (0.0007) [2023-12-26 03:32:16,215][123090] Updated weights for policy 1, policy_version 491515 (0.0009) [2023-12-26 03:32:16,447][123091] Updated weights for policy 0, policy_version 494963 (0.0010) [2023-12-26 03:32:16,496][123091] Updated weights for policy 0, policy_version 494973 (0.0009) [2023-12-26 03:32:16,542][123091] Updated weights for policy 0, policy_version 494983 (0.0008) [2023-12-26 03:32:17,058][123090] Updated weights for policy 1, policy_version 491525 (0.0009) [2023-12-26 03:32:17,107][123090] Updated weights for policy 1, policy_version 491535 (0.0009) [2023-12-26 03:32:17,160][123090] Updated weights for policy 1, policy_version 491545 (0.0009) [2023-12-26 03:32:17,400][123091] Updated weights for policy 0, policy_version 494993 (0.0009) [2023-12-26 03:32:17,464][123091] Updated weights for policy 0, policy_version 495003 (0.0010) [2023-12-26 03:32:17,520][123091] Updated weights for policy 0, policy_version 495013 (0.0008) [2023-12-26 03:32:17,586][123091] Updated weights for policy 0, policy_version 495023 (0.0006) [2023-12-26 03:32:18,051][123090] Updated weights for policy 1, policy_version 491555 (0.0009) [2023-12-26 03:32:18,109][123090] Updated weights for policy 1, policy_version 491565 (0.0009) [2023-12-26 03:32:18,134][123091] Updated weights for policy 0, policy_version 495033 (0.0005) [2023-12-26 03:32:18,170][123090] Updated weights for policy 1, policy_version 491575 (0.0008) [2023-12-26 03:32:18,187][123091] Updated weights for policy 0, policy_version 495043 (0.0005) [2023-12-26 03:32:18,241][123091] Updated weights for policy 0, policy_version 495053 (0.0005) [2023-12-26 03:32:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 252583936. Throughput: 0: 8943.6, 1: 8435.0. Samples: 252596696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:18,785][121949] Avg episode reward: [(0, '5968.770'), (1, '5644.041')] [2023-12-26 03:32:19,018][123090] Updated weights for policy 1, policy_version 491585 (0.0008) [2023-12-26 03:32:19,043][123091] Updated weights for policy 0, policy_version 495063 (0.0008) [2023-12-26 03:32:19,067][123090] Updated weights for policy 1, policy_version 491595 (0.0008) [2023-12-26 03:32:19,094][123091] Updated weights for policy 0, policy_version 495073 (0.0007) [2023-12-26 03:32:19,122][123090] Updated weights for policy 1, policy_version 491605 (0.0008) [2023-12-26 03:32:19,154][123091] Updated weights for policy 0, policy_version 495083 (0.0005) [2023-12-26 03:32:19,181][123090] Updated weights for policy 1, policy_version 491615 (0.0010) [2023-12-26 03:32:19,994][123091] Updated weights for policy 0, policy_version 495093 (0.0007) [2023-12-26 03:32:20,050][123090] Updated weights for policy 1, policy_version 491625 (0.0007) [2023-12-26 03:32:20,064][123091] Updated weights for policy 0, policy_version 495103 (0.0010) [2023-12-26 03:32:20,112][123090] Updated weights for policy 1, policy_version 491635 (0.0006) [2023-12-26 03:32:20,138][123091] Updated weights for policy 0, policy_version 495113 (0.0009) [2023-12-26 03:32:20,182][123090] Updated weights for policy 1, policy_version 491645 (0.0007) [2023-12-26 03:32:20,969][123090] Updated weights for policy 1, policy_version 491655 (0.0009) [2023-12-26 03:32:21,000][123091] Updated weights for policy 0, policy_version 495123 (0.0009) [2023-12-26 03:32:21,041][123090] Updated weights for policy 1, policy_version 491665 (0.0009) [2023-12-26 03:32:21,072][123091] Updated weights for policy 0, policy_version 495133 (0.0008) [2023-12-26 03:32:21,103][123090] Updated weights for policy 1, policy_version 491675 (0.0009) [2023-12-26 03:32:21,140][123091] Updated weights for policy 0, policy_version 495143 (0.0008) [2023-12-26 03:32:21,956][123090] Updated weights for policy 1, policy_version 491685 (0.0010) [2023-12-26 03:32:21,987][123091] Updated weights for policy 0, policy_version 495153 (0.0010) [2023-12-26 03:32:22,004][123090] Updated weights for policy 1, policy_version 491695 (0.0010) [2023-12-26 03:32:22,045][123091] Updated weights for policy 0, policy_version 495163 (0.0010) [2023-12-26 03:32:22,064][123090] Updated weights for policy 1, policy_version 491705 (0.0010) [2023-12-26 03:32:22,109][123091] Updated weights for policy 0, policy_version 495173 (0.0006) [2023-12-26 03:32:22,165][123091] Updated weights for policy 0, policy_version 495183 (0.0009) [2023-12-26 03:32:22,841][123090] Updated weights for policy 1, policy_version 491715 (0.0009) [2023-12-26 03:32:22,907][123090] Updated weights for policy 1, policy_version 491725 (0.0010) [2023-12-26 03:32:22,967][123090] Updated weights for policy 1, policy_version 491735 (0.0010) [2023-12-26 03:32:23,028][123091] Updated weights for policy 0, policy_version 495193 (0.0007) [2023-12-26 03:32:23,077][123091] Updated weights for policy 0, policy_version 495203 (0.0009) [2023-12-26 03:32:23,137][123091] Updated weights for policy 0, policy_version 495213 (0.0009) [2023-12-26 03:32:23,784][121949] Fps is (10 sec: 16383.4, 60 sec: 17339.7, 300 sec: 17744.7). Total num frames: 252665856. Throughput: 0: 8797.4, 1: 8476.5. Samples: 252646944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:23,786][121949] Avg episode reward: [(0, '6060.513'), (1, '5694.331')] [2023-12-26 03:32:23,790][123090] Updated weights for policy 1, policy_version 491745 (0.0010) [2023-12-26 03:32:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000495216_126779392.pth... [2023-12-26 03:32:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000494192_126517248.pth [2023-12-26 03:32:23,841][123090] Updated weights for policy 1, policy_version 491755 (0.0010) [2023-12-26 03:32:23,908][123090] Updated weights for policy 1, policy_version 491765 (0.0010) [2023-12-26 03:32:23,959][123090] Updated weights for policy 1, policy_version 491775 (0.0010) [2023-12-26 03:32:23,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000491776_125894656.pth... [2023-12-26 03:32:23,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000490752_125632512.pth [2023-12-26 03:32:23,988][123091] Updated weights for policy 0, policy_version 495223 (0.0009) [2023-12-26 03:32:24,036][123091] Updated weights for policy 0, policy_version 495233 (0.0008) [2023-12-26 03:32:24,106][123091] Updated weights for policy 0, policy_version 495243 (0.0009) [2023-12-26 03:32:24,796][123090] Updated weights for policy 1, policy_version 491785 (0.0010) [2023-12-26 03:32:24,859][123090] Updated weights for policy 1, policy_version 491795 (0.0010) [2023-12-26 03:32:24,893][123091] Updated weights for policy 0, policy_version 495253 (0.0008) [2023-12-26 03:32:24,911][123090] Updated weights for policy 1, policy_version 491805 (0.0007) [2023-12-26 03:32:24,958][123091] Updated weights for policy 0, policy_version 495263 (0.0008) [2023-12-26 03:32:25,023][123091] Updated weights for policy 0, policy_version 495273 (0.0010) [2023-12-26 03:32:25,601][123090] Updated weights for policy 1, policy_version 491815 (0.0005) [2023-12-26 03:32:25,655][123090] Updated weights for policy 1, policy_version 491825 (0.0005) [2023-12-26 03:32:25,702][123090] Updated weights for policy 1, policy_version 491835 (0.0010) [2023-12-26 03:32:25,902][123091] Updated weights for policy 0, policy_version 495283 (0.0009) [2023-12-26 03:32:25,955][123091] Updated weights for policy 0, policy_version 495293 (0.0010) [2023-12-26 03:32:26,008][123091] Updated weights for policy 0, policy_version 495303 (0.0010) [2023-12-26 03:32:26,405][123090] Updated weights for policy 1, policy_version 491845 (0.0008) [2023-12-26 03:32:26,467][123090] Updated weights for policy 1, policy_version 491855 (0.0005) [2023-12-26 03:32:26,532][123090] Updated weights for policy 1, policy_version 491865 (0.0005) [2023-12-26 03:32:26,936][123091] Updated weights for policy 0, policy_version 495313 (0.0009) [2023-12-26 03:32:26,999][123091] Updated weights for policy 0, policy_version 495323 (0.0008) [2023-12-26 03:32:27,057][123091] Updated weights for policy 0, policy_version 495333 (0.0009) [2023-12-26 03:32:27,115][123091] Updated weights for policy 0, policy_version 495343 (0.0008) [2023-12-26 03:32:27,249][123090] Updated weights for policy 1, policy_version 491875 (0.0007) [2023-12-26 03:32:27,320][123090] Updated weights for policy 1, policy_version 491885 (0.0009) [2023-12-26 03:32:27,380][123090] Updated weights for policy 1, policy_version 491895 (0.0005) [2023-12-26 03:32:27,991][123091] Updated weights for policy 0, policy_version 495353 (0.0008) [2023-12-26 03:32:28,043][123091] Updated weights for policy 0, policy_version 495363 (0.0008) [2023-12-26 03:32:28,087][123090] Updated weights for policy 1, policy_version 491905 (0.0006) [2023-12-26 03:32:28,097][123091] Updated weights for policy 0, policy_version 495373 (0.0008) [2023-12-26 03:32:28,135][123090] Updated weights for policy 1, policy_version 491915 (0.0010) [2023-12-26 03:32:28,182][123090] Updated weights for policy 1, policy_version 491925 (0.0010) [2023-12-26 03:32:28,228][123090] Updated weights for policy 1, policy_version 491935 (0.0010) [2023-12-26 03:32:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 252755968. Throughput: 0: 8732.6, 1: 8606.7. Samples: 252751836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:28,785][121949] Avg episode reward: [(0, '5995.276'), (1, '5708.541')] [2023-12-26 03:32:28,932][123091] Updated weights for policy 0, policy_version 495383 (0.0008) [2023-12-26 03:32:28,981][123091] Updated weights for policy 0, policy_version 495393 (0.0009) [2023-12-26 03:32:29,029][123091] Updated weights for policy 0, policy_version 495403 (0.0009) [2023-12-26 03:32:29,111][123090] Updated weights for policy 1, policy_version 491945 (0.0010) [2023-12-26 03:32:29,166][123090] Updated weights for policy 1, policy_version 491955 (0.0010) [2023-12-26 03:32:29,224][123090] Updated weights for policy 1, policy_version 491965 (0.0006) [2023-12-26 03:32:29,909][123090] Updated weights for policy 1, policy_version 491975 (0.0006) [2023-12-26 03:32:29,972][123091] Updated weights for policy 0, policy_version 495413 (0.0010) [2023-12-26 03:32:29,979][123090] Updated weights for policy 1, policy_version 491985 (0.0007) [2023-12-26 03:32:30,037][123091] Updated weights for policy 0, policy_version 495423 (0.0011) [2023-12-26 03:32:30,049][123090] Updated weights for policy 1, policy_version 491995 (0.0006) [2023-12-26 03:32:30,107][123091] Updated weights for policy 0, policy_version 495433 (0.0011) [2023-12-26 03:32:30,777][123090] Updated weights for policy 1, policy_version 492005 (0.0006) [2023-12-26 03:32:30,852][123090] Updated weights for policy 1, policy_version 492015 (0.0005) [2023-12-26 03:32:30,884][123091] Updated weights for policy 0, policy_version 495443 (0.0011) [2023-12-26 03:32:30,913][123090] Updated weights for policy 1, policy_version 492025 (0.0006) [2023-12-26 03:32:30,945][123091] Updated weights for policy 0, policy_version 495453 (0.0011) [2023-12-26 03:32:30,994][123091] Updated weights for policy 0, policy_version 495463 (0.0011) [2023-12-26 03:32:31,655][123090] Updated weights for policy 1, policy_version 492035 (0.0008) [2023-12-26 03:32:31,732][123090] Updated weights for policy 1, policy_version 492045 (0.0011) [2023-12-26 03:32:31,795][123090] Updated weights for policy 1, policy_version 492055 (0.0010) [2023-12-26 03:32:31,806][123091] Updated weights for policy 0, policy_version 495473 (0.0010) [2023-12-26 03:32:31,868][123091] Updated weights for policy 0, policy_version 495483 (0.0007) [2023-12-26 03:32:31,921][123091] Updated weights for policy 0, policy_version 495493 (0.0009) [2023-12-26 03:32:31,991][123091] Updated weights for policy 0, policy_version 495503 (0.0008) [2023-12-26 03:32:32,621][123090] Updated weights for policy 1, policy_version 492065 (0.0011) [2023-12-26 03:32:32,680][123090] Updated weights for policy 1, policy_version 492075 (0.0010) [2023-12-26 03:32:32,743][123090] Updated weights for policy 1, policy_version 492085 (0.0010) [2023-12-26 03:32:32,753][123091] Updated weights for policy 0, policy_version 495513 (0.0006) [2023-12-26 03:32:32,803][123090] Updated weights for policy 1, policy_version 492095 (0.0010) [2023-12-26 03:32:32,804][123091] Updated weights for policy 0, policy_version 495523 (0.0006) [2023-12-26 03:32:32,856][123091] Updated weights for policy 0, policy_version 495533 (0.0009) [2023-12-26 03:32:33,602][123091] Updated weights for policy 0, policy_version 495543 (0.0008) [2023-12-26 03:32:33,609][123090] Updated weights for policy 1, policy_version 492105 (0.0008) [2023-12-26 03:32:33,651][123091] Updated weights for policy 0, policy_version 495553 (0.0008) [2023-12-26 03:32:33,661][123090] Updated weights for policy 1, policy_version 492115 (0.0008) [2023-12-26 03:32:33,698][123091] Updated weights for policy 0, policy_version 495563 (0.0008) [2023-12-26 03:32:33,706][123090] Updated weights for policy 1, policy_version 492125 (0.0008) [2023-12-26 03:32:33,784][121949] Fps is (10 sec: 18842.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 252854272. Throughput: 0: 8767.0, 1: 8636.0. Samples: 252859160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:32:33,784][121949] Avg episode reward: [(0, '5923.645'), (1, '5335.044')] [2023-12-26 03:32:34,463][123090] Updated weights for policy 1, policy_version 492135 (0.0005) [2023-12-26 03:32:34,472][123091] Updated weights for policy 0, policy_version 495573 (0.0008) [2023-12-26 03:32:34,538][123090] Updated weights for policy 1, policy_version 492145 (0.0011) [2023-12-26 03:32:34,544][123091] Updated weights for policy 0, policy_version 495583 (0.0007) [2023-12-26 03:32:34,596][123090] Updated weights for policy 1, policy_version 492155 (0.0010) [2023-12-26 03:32:34,607][123091] Updated weights for policy 0, policy_version 495593 (0.0006) [2023-12-26 03:32:35,207][123091] Updated weights for policy 0, policy_version 495603 (0.0007) [2023-12-26 03:32:35,269][123091] Updated weights for policy 0, policy_version 495613 (0.0009) [2023-12-26 03:32:35,324][123091] Updated weights for policy 0, policy_version 495623 (0.0011) [2023-12-26 03:32:35,400][123090] Updated weights for policy 1, policy_version 492165 (0.0008) [2023-12-26 03:32:35,461][123090] Updated weights for policy 1, policy_version 492175 (0.0006) [2023-12-26 03:32:35,513][123090] Updated weights for policy 1, policy_version 492185 (0.0009) [2023-12-26 03:32:36,014][123091] Updated weights for policy 0, policy_version 495633 (0.0010) [2023-12-26 03:32:36,084][123091] Updated weights for policy 0, policy_version 495643 (0.0008) [2023-12-26 03:32:36,155][123091] Updated weights for policy 0, policy_version 495653 (0.0010) [2023-12-26 03:32:36,209][123090] Updated weights for policy 1, policy_version 492195 (0.0008) [2023-12-26 03:32:36,215][123091] Updated weights for policy 0, policy_version 495664 (0.0010) [2023-12-26 03:32:36,265][123090] Updated weights for policy 1, policy_version 492205 (0.0010) [2023-12-26 03:32:36,321][123090] Updated weights for policy 1, policy_version 492215 (0.0008) [2023-12-26 03:32:36,976][123090] Updated weights for policy 1, policy_version 492225 (0.0006) [2023-12-26 03:32:37,048][123090] Updated weights for policy 1, policy_version 492235 (0.0008) [2023-12-26 03:32:37,078][123091] Updated weights for policy 0, policy_version 495674 (0.0008) [2023-12-26 03:32:37,122][123090] Updated weights for policy 1, policy_version 492245 (0.0006) [2023-12-26 03:32:37,140][123091] Updated weights for policy 0, policy_version 495684 (0.0007) [2023-12-26 03:32:37,187][123090] Updated weights for policy 1, policy_version 492255 (0.0006) [2023-12-26 03:32:37,197][123091] Updated weights for policy 0, policy_version 495694 (0.0008) [2023-12-26 03:32:37,870][123090] Updated weights for policy 1, policy_version 492265 (0.0006) [2023-12-26 03:32:37,930][123090] Updated weights for policy 1, policy_version 492275 (0.0005) [2023-12-26 03:32:38,005][123090] Updated weights for policy 1, policy_version 492285 (0.0006) [2023-12-26 03:32:38,094][123091] Updated weights for policy 0, policy_version 495704 (0.0009) [2023-12-26 03:32:38,154][123091] Updated weights for policy 0, policy_version 495714 (0.0009) [2023-12-26 03:32:38,207][123091] Updated weights for policy 0, policy_version 495724 (0.0009) [2023-12-26 03:32:38,737][123090] Updated weights for policy 1, policy_version 492295 (0.0008) [2023-12-26 03:32:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17339.8, 300 sec: 17744.7). Total num frames: 252936192. Throughput: 0: 8835.8, 1: 8715.8. Samples: 252916320. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:32:38,785][121949] Avg episode reward: [(0, '5846.834'), (1, '4792.337')] [2023-12-26 03:32:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000495728_126910464.pth... [2023-12-26 03:32:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000494736_126656512.pth [2023-12-26 03:32:38,810][123090] Updated weights for policy 1, policy_version 492305 (0.0005) [2023-12-26 03:32:38,875][123090] Updated weights for policy 1, policy_version 492315 (0.0005) [2023-12-26 03:32:38,903][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000492320_126033920.pth... [2023-12-26 03:32:38,907][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000491264_125763584.pth [2023-12-26 03:32:39,142][123091] Updated weights for policy 0, policy_version 495734 (0.0010) [2023-12-26 03:32:39,196][123091] Updated weights for policy 0, policy_version 495744 (0.0010) [2023-12-26 03:32:39,270][123091] Updated weights for policy 0, policy_version 495754 (0.0010) [2023-12-26 03:32:39,578][123090] Updated weights for policy 1, policy_version 492325 (0.0007) [2023-12-26 03:32:39,644][123090] Updated weights for policy 1, policy_version 492335 (0.0007) [2023-12-26 03:32:39,713][123090] Updated weights for policy 1, policy_version 492345 (0.0009) [2023-12-26 03:32:40,150][123091] Updated weights for policy 0, policy_version 495764 (0.0009) [2023-12-26 03:32:40,210][123091] Updated weights for policy 0, policy_version 495774 (0.0010) [2023-12-26 03:32:40,268][123091] Updated weights for policy 0, policy_version 495784 (0.0009) [2023-12-26 03:32:40,462][123090] Updated weights for policy 1, policy_version 492355 (0.0009) [2023-12-26 03:32:40,514][123090] Updated weights for policy 1, policy_version 492365 (0.0009) [2023-12-26 03:32:40,572][123090] Updated weights for policy 1, policy_version 492375 (0.0010) [2023-12-26 03:32:41,101][123091] Updated weights for policy 0, policy_version 495794 (0.0009) [2023-12-26 03:32:41,179][123091] Updated weights for policy 0, policy_version 495804 (0.0009) [2023-12-26 03:32:41,249][123091] Updated weights for policy 0, policy_version 495814 (0.0010) [2023-12-26 03:32:41,321][123091] Updated weights for policy 0, policy_version 495824 (0.0010) [2023-12-26 03:32:41,404][123090] Updated weights for policy 1, policy_version 492385 (0.0009) [2023-12-26 03:32:41,470][123090] Updated weights for policy 1, policy_version 492395 (0.0009) [2023-12-26 03:32:41,538][123090] Updated weights for policy 1, policy_version 492405 (0.0008) [2023-12-26 03:32:41,606][123090] Updated weights for policy 1, policy_version 492415 (0.0010) [2023-12-26 03:32:42,214][123091] Updated weights for policy 0, policy_version 495834 (0.0009) [2023-12-26 03:32:42,268][123091] Updated weights for policy 0, policy_version 495844 (0.0009) [2023-12-26 03:32:42,334][123091] Updated weights for policy 0, policy_version 495854 (0.0009) [2023-12-26 03:32:42,463][123090] Updated weights for policy 1, policy_version 492425 (0.0008) [2023-12-26 03:32:42,525][123090] Updated weights for policy 1, policy_version 492435 (0.0006) [2023-12-26 03:32:42,584][123090] Updated weights for policy 1, policy_version 492445 (0.0005) [2023-12-26 03:32:43,198][123091] Updated weights for policy 0, policy_version 495864 (0.0010) [2023-12-26 03:32:43,254][123091] Updated weights for policy 0, policy_version 495874 (0.0009) [2023-12-26 03:32:43,319][123091] Updated weights for policy 0, policy_version 495884 (0.0009) [2023-12-26 03:32:43,372][123090] Updated weights for policy 1, policy_version 492455 (0.0009) [2023-12-26 03:32:43,425][123090] Updated weights for policy 1, policy_version 492465 (0.0009) [2023-12-26 03:32:43,477][123090] Updated weights for policy 1, policy_version 492475 (0.0009) [2023-12-26 03:32:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 253026304. Throughput: 0: 8627.7, 1: 8737.2. Samples: 253018544. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:32:43,785][121949] Avg episode reward: [(0, '5896.404'), (1, '4865.438')] [2023-12-26 03:32:44,149][123091] Updated weights for policy 0, policy_version 495894 (0.0008) [2023-12-26 03:32:44,211][123091] Updated weights for policy 0, policy_version 495904 (0.0010) [2023-12-26 03:32:44,267][123091] Updated weights for policy 0, policy_version 495914 (0.0009) [2023-12-26 03:32:44,334][123090] Updated weights for policy 1, policy_version 492485 (0.0009) [2023-12-26 03:32:44,406][123090] Updated weights for policy 1, policy_version 492495 (0.0009) [2023-12-26 03:32:44,462][123090] Updated weights for policy 1, policy_version 492505 (0.0009) [2023-12-26 03:32:45,132][123091] Updated weights for policy 0, policy_version 495924 (0.0010) [2023-12-26 03:32:45,190][123091] Updated weights for policy 0, policy_version 495934 (0.0010) [2023-12-26 03:32:45,258][123091] Updated weights for policy 0, policy_version 495944 (0.0009) [2023-12-26 03:32:45,268][123090] Updated weights for policy 1, policy_version 492516 (0.0009) [2023-12-26 03:32:45,328][123090] Updated weights for policy 1, policy_version 492526 (0.0008) [2023-12-26 03:32:45,397][123090] Updated weights for policy 1, policy_version 492536 (0.0010) [2023-12-26 03:32:46,097][123091] Updated weights for policy 0, policy_version 495954 (0.0008) [2023-12-26 03:32:46,157][123091] Updated weights for policy 0, policy_version 495964 (0.0010) [2023-12-26 03:32:46,206][123091] Updated weights for policy 0, policy_version 495974 (0.0009) [2023-12-26 03:32:46,227][123090] Updated weights for policy 1, policy_version 492546 (0.0008) [2023-12-26 03:32:46,260][123091] Updated weights for policy 0, policy_version 495984 (0.0007) [2023-12-26 03:32:46,319][123090] Updated weights for policy 1, policy_version 492556 (0.0010) [2023-12-26 03:32:46,380][123090] Updated weights for policy 1, policy_version 492566 (0.0008) [2023-12-26 03:32:46,439][123090] Updated weights for policy 1, policy_version 492576 (0.0009) [2023-12-26 03:32:47,114][123091] Updated weights for policy 0, policy_version 495994 (0.0010) [2023-12-26 03:32:47,176][123091] Updated weights for policy 0, policy_version 496004 (0.0010) [2023-12-26 03:32:47,238][123091] Updated weights for policy 0, policy_version 496014 (0.0011) [2023-12-26 03:32:47,250][123090] Updated weights for policy 1, policy_version 492586 (0.0007) [2023-12-26 03:32:47,298][123090] Updated weights for policy 1, policy_version 492596 (0.0009) [2023-12-26 03:32:47,346][123090] Updated weights for policy 1, policy_version 492606 (0.0009) [2023-12-26 03:32:48,003][123091] Updated weights for policy 0, policy_version 496024 (0.0006) [2023-12-26 03:32:48,071][123091] Updated weights for policy 0, policy_version 496034 (0.0005) [2023-12-26 03:32:48,140][123091] Updated weights for policy 0, policy_version 496044 (0.0006) [2023-12-26 03:32:48,195][123090] Updated weights for policy 1, policy_version 492616 (0.0009) [2023-12-26 03:32:48,243][123090] Updated weights for policy 1, policy_version 492626 (0.0009) [2023-12-26 03:32:48,296][123090] Updated weights for policy 1, policy_version 492636 (0.0009) [2023-12-26 03:32:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 253108224. Throughput: 0: 8645.0, 1: 8785.5. Samples: 253121552. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:32:48,784][121949] Avg episode reward: [(0, '5918.210'), (1, '4971.564')] [2023-12-26 03:32:48,832][123091] Updated weights for policy 0, policy_version 496054 (0.0006) [2023-12-26 03:32:48,886][123091] Updated weights for policy 0, policy_version 496064 (0.0005) [2023-12-26 03:32:48,942][123091] Updated weights for policy 0, policy_version 496074 (0.0005) [2023-12-26 03:32:49,213][123090] Updated weights for policy 1, policy_version 492646 (0.0009) [2023-12-26 03:32:49,286][123090] Updated weights for policy 1, policy_version 492656 (0.0010) [2023-12-26 03:32:49,357][123090] Updated weights for policy 1, policy_version 492666 (0.0009) [2023-12-26 03:32:49,626][123091] Updated weights for policy 0, policy_version 496084 (0.0007) [2023-12-26 03:32:49,683][123091] Updated weights for policy 0, policy_version 496094 (0.0009) [2023-12-26 03:32:49,740][123091] Updated weights for policy 0, policy_version 496104 (0.0008) [2023-12-26 03:32:50,233][123090] Updated weights for policy 1, policy_version 492676 (0.0010) [2023-12-26 03:32:50,281][123090] Updated weights for policy 1, policy_version 492686 (0.0010) [2023-12-26 03:32:50,337][123090] Updated weights for policy 1, policy_version 492696 (0.0010) [2023-12-26 03:32:50,593][123091] Updated weights for policy 0, policy_version 496114 (0.0009) [2023-12-26 03:32:50,658][123091] Updated weights for policy 0, policy_version 496124 (0.0009) [2023-12-26 03:32:50,714][123091] Updated weights for policy 0, policy_version 496134 (0.0010) [2023-12-26 03:32:50,774][123091] Updated weights for policy 0, policy_version 496144 (0.0009) [2023-12-26 03:32:51,055][123090] Updated weights for policy 1, policy_version 492706 (0.0010) [2023-12-26 03:32:51,117][123090] Updated weights for policy 1, policy_version 492716 (0.0008) [2023-12-26 03:32:51,191][123090] Updated weights for policy 1, policy_version 492726 (0.0006) [2023-12-26 03:32:51,265][123090] Updated weights for policy 1, policy_version 492736 (0.0006) [2023-12-26 03:32:51,706][123091] Updated weights for policy 0, policy_version 496154 (0.0009) [2023-12-26 03:32:51,776][123091] Updated weights for policy 0, policy_version 496164 (0.0010) [2023-12-26 03:32:51,844][123091] Updated weights for policy 0, policy_version 496175 (0.0010) [2023-12-26 03:32:52,056][123090] Updated weights for policy 1, policy_version 492746 (0.0009) [2023-12-26 03:32:52,120][123090] Updated weights for policy 1, policy_version 492756 (0.0009) [2023-12-26 03:32:52,176][123090] Updated weights for policy 1, policy_version 492766 (0.0009) [2023-12-26 03:32:52,671][123091] Updated weights for policy 0, policy_version 496185 (0.0010) [2023-12-26 03:32:52,726][123091] Updated weights for policy 0, policy_version 496195 (0.0010) [2023-12-26 03:32:52,795][123091] Updated weights for policy 0, policy_version 496205 (0.0010) [2023-12-26 03:32:52,998][123090] Updated weights for policy 1, policy_version 492776 (0.0010) [2023-12-26 03:32:53,049][123090] Updated weights for policy 1, policy_version 492786 (0.0010) [2023-12-26 03:32:53,107][123090] Updated weights for policy 1, policy_version 492796 (0.0010) [2023-12-26 03:32:53,526][123091] Updated weights for policy 0, policy_version 496215 (0.0009) [2023-12-26 03:32:53,584][123091] Updated weights for policy 0, policy_version 496225 (0.0009) [2023-12-26 03:32:53,640][123091] Updated weights for policy 0, policy_version 496235 (0.0009) [2023-12-26 03:32:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 253198336. Throughput: 0: 8562.6, 1: 8830.6. Samples: 253173552. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:32:53,785][121949] Avg episode reward: [(0, '5991.478'), (1, '5173.102')] [2023-12-26 03:32:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000496240_127041536.pth... [2023-12-26 03:32:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000492800_126156800.pth... [2023-12-26 03:32:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000491776_125894656.pth [2023-12-26 03:32:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000495216_126779392.pth [2023-12-26 03:32:53,983][123090] Updated weights for policy 1, policy_version 492806 (0.0008) [2023-12-26 03:32:54,045][123090] Updated weights for policy 1, policy_version 492816 (0.0010) [2023-12-26 03:32:54,113][123090] Updated weights for policy 1, policy_version 492826 (0.0009) [2023-12-26 03:32:54,483][123091] Updated weights for policy 0, policy_version 496245 (0.0009) [2023-12-26 03:32:54,531][123091] Updated weights for policy 0, policy_version 496255 (0.0009) [2023-12-26 03:32:54,587][123091] Updated weights for policy 0, policy_version 496265 (0.0011) [2023-12-26 03:32:54,938][123090] Updated weights for policy 1, policy_version 492836 (0.0009) [2023-12-26 03:32:55,004][123090] Updated weights for policy 1, policy_version 492846 (0.0010) [2023-12-26 03:32:55,068][123090] Updated weights for policy 1, policy_version 492856 (0.0009) [2023-12-26 03:32:55,447][123091] Updated weights for policy 0, policy_version 496275 (0.0009) [2023-12-26 03:32:55,509][123091] Updated weights for policy 0, policy_version 496285 (0.0010) [2023-12-26 03:32:55,557][123091] Updated weights for policy 0, policy_version 496295 (0.0009) [2023-12-26 03:32:55,898][123090] Updated weights for policy 1, policy_version 492866 (0.0009) [2023-12-26 03:32:55,965][123090] Updated weights for policy 1, policy_version 492876 (0.0009) [2023-12-26 03:32:56,030][123090] Updated weights for policy 1, policy_version 492886 (0.0010) [2023-12-26 03:32:56,098][123090] Updated weights for policy 1, policy_version 492896 (0.0007) [2023-12-26 03:32:56,416][123091] Updated weights for policy 0, policy_version 496305 (0.0009) [2023-12-26 03:32:56,464][123091] Updated weights for policy 0, policy_version 496315 (0.0006) [2023-12-26 03:32:56,516][123091] Updated weights for policy 0, policy_version 496325 (0.0005) [2023-12-26 03:32:56,569][123091] Updated weights for policy 0, policy_version 496335 (0.0005) [2023-12-26 03:32:56,974][123090] Updated weights for policy 1, policy_version 492906 (0.0010) [2023-12-26 03:32:57,033][123090] Updated weights for policy 1, policy_version 492916 (0.0009) [2023-12-26 03:32:57,099][123090] Updated weights for policy 1, policy_version 492926 (0.0009) [2023-12-26 03:32:57,284][123091] Updated weights for policy 0, policy_version 496345 (0.0010) [2023-12-26 03:32:57,344][123091] Updated weights for policy 0, policy_version 496355 (0.0009) [2023-12-26 03:32:57,398][123091] Updated weights for policy 0, policy_version 496365 (0.0009) [2023-12-26 03:32:57,963][123090] Updated weights for policy 1, policy_version 492936 (0.0009) [2023-12-26 03:32:58,031][123090] Updated weights for policy 1, policy_version 492946 (0.0009) [2023-12-26 03:32:58,095][123090] Updated weights for policy 1, policy_version 492956 (0.0009) [2023-12-26 03:32:58,126][123091] Updated weights for policy 0, policy_version 496375 (0.0011) [2023-12-26 03:32:58,190][123091] Updated weights for policy 0, policy_version 496385 (0.0008) [2023-12-26 03:32:58,251][123091] Updated weights for policy 0, policy_version 496395 (0.0008) [2023-12-26 03:32:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 253280256. Throughput: 0: 8593.3, 1: 8835.3. Samples: 253276408. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:32:58,785][121949] Avg episode reward: [(0, '6010.335'), (1, '5264.529')] [2023-12-26 03:32:59,028][123090] Updated weights for policy 1, policy_version 492966 (0.0007) [2023-12-26 03:32:59,102][123090] Updated weights for policy 1, policy_version 492976 (0.0009) [2023-12-26 03:32:59,105][123091] Updated weights for policy 0, policy_version 496405 (0.0009) [2023-12-26 03:32:59,165][123090] Updated weights for policy 1, policy_version 492986 (0.0007) [2023-12-26 03:32:59,166][123091] Updated weights for policy 0, policy_version 496415 (0.0010) [2023-12-26 03:32:59,235][123091] Updated weights for policy 0, policy_version 496425 (0.0010) [2023-12-26 03:32:59,882][123090] Updated weights for policy 1, policy_version 492996 (0.0008) [2023-12-26 03:32:59,948][123090] Updated weights for policy 1, policy_version 493006 (0.0006) [2023-12-26 03:33:00,012][123090] Updated weights for policy 1, policy_version 493016 (0.0009) [2023-12-26 03:33:00,019][123091] Updated weights for policy 0, policy_version 496435 (0.0011) [2023-12-26 03:33:00,079][123091] Updated weights for policy 0, policy_version 496445 (0.0011) [2023-12-26 03:33:00,141][123091] Updated weights for policy 0, policy_version 496455 (0.0010) [2023-12-26 03:33:00,854][123090] Updated weights for policy 1, policy_version 493026 (0.0007) [2023-12-26 03:33:00,908][123090] Updated weights for policy 1, policy_version 493036 (0.0010) [2023-12-26 03:33:00,916][123091] Updated weights for policy 0, policy_version 496465 (0.0010) [2023-12-26 03:33:00,958][123090] Updated weights for policy 1, policy_version 493046 (0.0008) [2023-12-26 03:33:00,984][123091] Updated weights for policy 0, policy_version 496475 (0.0006) [2023-12-26 03:33:01,015][123090] Updated weights for policy 1, policy_version 493056 (0.0008) [2023-12-26 03:33:01,055][123091] Updated weights for policy 0, policy_version 496485 (0.0007) [2023-12-26 03:33:01,120][123091] Updated weights for policy 0, policy_version 496495 (0.0011) [2023-12-26 03:33:01,921][123091] Updated weights for policy 0, policy_version 496505 (0.0006) [2023-12-26 03:33:01,926][123090] Updated weights for policy 1, policy_version 493066 (0.0007) [2023-12-26 03:33:01,978][123091] Updated weights for policy 0, policy_version 496516 (0.0008) [2023-12-26 03:33:01,996][123090] Updated weights for policy 1, policy_version 493076 (0.0005) [2023-12-26 03:33:02,030][123091] Updated weights for policy 0, policy_version 496526 (0.0008) [2023-12-26 03:33:02,065][123090] Updated weights for policy 1, policy_version 493086 (0.0009) [2023-12-26 03:33:02,735][123091] Updated weights for policy 0, policy_version 496536 (0.0006) [2023-12-26 03:33:02,795][123091] Updated weights for policy 0, policy_version 496546 (0.0005) [2023-12-26 03:33:02,854][123091] Updated weights for policy 0, policy_version 496556 (0.0007) [2023-12-26 03:33:02,896][123090] Updated weights for policy 1, policy_version 493096 (0.0009) [2023-12-26 03:33:02,961][123090] Updated weights for policy 1, policy_version 493106 (0.0009) [2023-12-26 03:33:03,013][123090] Updated weights for policy 1, policy_version 493116 (0.0009) [2023-12-26 03:33:03,633][123091] Updated weights for policy 0, policy_version 496566 (0.0008) [2023-12-26 03:33:03,681][123091] Updated weights for policy 0, policy_version 496576 (0.0009) [2023-12-26 03:33:03,736][123091] Updated weights for policy 0, policy_version 496586 (0.0009) [2023-12-26 03:33:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 253370368. Throughput: 0: 8626.4, 1: 8787.2. Samples: 253380308. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:03,785][121949] Avg episode reward: [(0, '6038.750'), (1, '5281.215')] [2023-12-26 03:33:03,874][123090] Updated weights for policy 1, policy_version 493126 (0.0009) [2023-12-26 03:33:03,927][123090] Updated weights for policy 1, policy_version 493136 (0.0009) [2023-12-26 03:33:03,990][123090] Updated weights for policy 1, policy_version 493146 (0.0010) [2023-12-26 03:33:04,561][123091] Updated weights for policy 0, policy_version 496596 (0.0009) [2023-12-26 03:33:04,616][123091] Updated weights for policy 0, policy_version 496606 (0.0009) [2023-12-26 03:33:04,674][123091] Updated weights for policy 0, policy_version 496617 (0.0010) [2023-12-26 03:33:04,817][123090] Updated weights for policy 1, policy_version 493156 (0.0008) [2023-12-26 03:33:04,866][123090] Updated weights for policy 1, policy_version 493166 (0.0005) [2023-12-26 03:33:04,921][123090] Updated weights for policy 1, policy_version 493176 (0.0005) [2023-12-26 03:33:05,551][123090] Updated weights for policy 1, policy_version 493186 (0.0006) [2023-12-26 03:33:05,580][123091] Updated weights for policy 0, policy_version 496627 (0.0009) [2023-12-26 03:33:05,608][123090] Updated weights for policy 1, policy_version 493196 (0.0007) [2023-12-26 03:33:05,630][123091] Updated weights for policy 0, policy_version 496637 (0.0009) [2023-12-26 03:33:05,657][123090] Updated weights for policy 1, policy_version 493206 (0.0007) [2023-12-26 03:33:05,680][123091] Updated weights for policy 0, policy_version 496647 (0.0010) [2023-12-26 03:33:05,708][123090] Updated weights for policy 1, policy_version 493216 (0.0008) [2023-12-26 03:33:06,498][123090] Updated weights for policy 1, policy_version 493226 (0.0010) [2023-12-26 03:33:06,537][123091] Updated weights for policy 0, policy_version 496657 (0.0008) [2023-12-26 03:33:06,561][123090] Updated weights for policy 1, policy_version 493236 (0.0010) [2023-12-26 03:33:06,596][123091] Updated weights for policy 0, policy_version 496667 (0.0008) [2023-12-26 03:33:06,627][123090] Updated weights for policy 1, policy_version 493246 (0.0008) [2023-12-26 03:33:06,664][123091] Updated weights for policy 0, policy_version 496677 (0.0009) [2023-12-26 03:33:06,725][123091] Updated weights for policy 0, policy_version 496687 (0.0010) [2023-12-26 03:33:07,442][123090] Updated weights for policy 1, policy_version 493256 (0.0010) [2023-12-26 03:33:07,497][123090] Updated weights for policy 1, policy_version 493266 (0.0010) [2023-12-26 03:33:07,535][123091] Updated weights for policy 0, policy_version 496697 (0.0008) [2023-12-26 03:33:07,542][123090] Updated weights for policy 1, policy_version 493276 (0.0007) [2023-12-26 03:33:07,601][123091] Updated weights for policy 0, policy_version 496707 (0.0010) [2023-12-26 03:33:07,657][123091] Updated weights for policy 0, policy_version 496717 (0.0011) [2023-12-26 03:33:08,415][123090] Updated weights for policy 1, policy_version 493286 (0.0008) [2023-12-26 03:33:08,458][123091] Updated weights for policy 0, policy_version 496727 (0.0007) [2023-12-26 03:33:08,480][123090] Updated weights for policy 1, policy_version 493296 (0.0009) [2023-12-26 03:33:08,524][123091] Updated weights for policy 0, policy_version 496737 (0.0009) [2023-12-26 03:33:08,536][123090] Updated weights for policy 1, policy_version 493306 (0.0007) [2023-12-26 03:33:08,589][123091] Updated weights for policy 0, policy_version 496747 (0.0010) [2023-12-26 03:33:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 253460480. Throughput: 0: 8633.2, 1: 8832.4. Samples: 253432892. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:08,784][121949] Avg episode reward: [(0, '6069.818'), (1, '5362.015')] [2023-12-26 03:33:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000496752_127172608.pth... [2023-12-26 03:33:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000493312_126287872.pth... [2023-12-26 03:33:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000495728_126910464.pth [2023-12-26 03:33:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000492320_126033920.pth [2023-12-26 03:33:09,308][123091] Updated weights for policy 0, policy_version 496757 (0.0009) [2023-12-26 03:33:09,380][123091] Updated weights for policy 0, policy_version 496767 (0.0008) [2023-12-26 03:33:09,442][123090] Updated weights for policy 1, policy_version 493316 (0.0006) [2023-12-26 03:33:09,453][123091] Updated weights for policy 0, policy_version 496777 (0.0008) [2023-12-26 03:33:09,510][123090] Updated weights for policy 1, policy_version 493326 (0.0009) [2023-12-26 03:33:09,582][123090] Updated weights for policy 1, policy_version 493336 (0.0010) [2023-12-26 03:33:10,205][123091] Updated weights for policy 0, policy_version 496787 (0.0007) [2023-12-26 03:33:10,259][123091] Updated weights for policy 0, policy_version 496797 (0.0009) [2023-12-26 03:33:10,307][123091] Updated weights for policy 0, policy_version 496807 (0.0007) [2023-12-26 03:33:10,445][123090] Updated weights for policy 1, policy_version 493346 (0.0009) [2023-12-26 03:33:10,511][123090] Updated weights for policy 1, policy_version 493356 (0.0010) [2023-12-26 03:33:10,570][123090] Updated weights for policy 1, policy_version 493366 (0.0010) [2023-12-26 03:33:10,623][123090] Updated weights for policy 1, policy_version 493376 (0.0009) [2023-12-26 03:33:11,071][123091] Updated weights for policy 0, policy_version 496817 (0.0006) [2023-12-26 03:33:11,134][123091] Updated weights for policy 0, policy_version 496827 (0.0009) [2023-12-26 03:33:11,205][123091] Updated weights for policy 0, policy_version 496837 (0.0009) [2023-12-26 03:33:11,276][123091] Updated weights for policy 0, policy_version 496847 (0.0010) [2023-12-26 03:33:11,520][123090] Updated weights for policy 1, policy_version 493386 (0.0008) [2023-12-26 03:33:11,583][123090] Updated weights for policy 1, policy_version 493396 (0.0008) [2023-12-26 03:33:11,649][123090] Updated weights for policy 1, policy_version 493406 (0.0008) [2023-12-26 03:33:12,113][123091] Updated weights for policy 0, policy_version 496857 (0.0010) [2023-12-26 03:33:12,165][123091] Updated weights for policy 0, policy_version 496867 (0.0009) [2023-12-26 03:33:12,219][123091] Updated weights for policy 0, policy_version 496877 (0.0009) [2023-12-26 03:33:12,450][123090] Updated weights for policy 1, policy_version 493416 (0.0009) [2023-12-26 03:33:12,499][123090] Updated weights for policy 1, policy_version 493426 (0.0008) [2023-12-26 03:33:12,553][123090] Updated weights for policy 1, policy_version 493436 (0.0009) [2023-12-26 03:33:13,049][123091] Updated weights for policy 0, policy_version 496887 (0.0008) [2023-12-26 03:33:13,101][123091] Updated weights for policy 0, policy_version 496897 (0.0010) [2023-12-26 03:33:13,154][123091] Updated weights for policy 0, policy_version 496907 (0.0010) [2023-12-26 03:33:13,463][123090] Updated weights for policy 1, policy_version 493446 (0.0009) [2023-12-26 03:33:13,519][123090] Updated weights for policy 1, policy_version 493456 (0.0009) [2023-12-26 03:33:13,572][123090] Updated weights for policy 1, policy_version 493466 (0.0009) [2023-12-26 03:33:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 253542400. Throughput: 0: 8719.2, 1: 8698.1. Samples: 253535608. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:13,784][121949] Avg episode reward: [(0, '6107.345'), (1, '5448.016')] [2023-12-26 03:33:13,854][123091] Updated weights for policy 0, policy_version 496917 (0.0009) [2023-12-26 03:33:13,919][123091] Updated weights for policy 0, policy_version 496927 (0.0005) [2023-12-26 03:33:13,989][123091] Updated weights for policy 0, policy_version 496937 (0.0006) [2023-12-26 03:33:14,444][123090] Updated weights for policy 1, policy_version 493477 (0.0010) [2023-12-26 03:33:14,506][123090] Updated weights for policy 1, policy_version 493487 (0.0010) [2023-12-26 03:33:14,567][123090] Updated weights for policy 1, policy_version 493497 (0.0010) [2023-12-26 03:33:14,692][123091] Updated weights for policy 0, policy_version 496947 (0.0007) [2023-12-26 03:33:14,765][123091] Updated weights for policy 0, policy_version 496957 (0.0006) [2023-12-26 03:33:14,839][123091] Updated weights for policy 0, policy_version 496967 (0.0007) [2023-12-26 03:33:15,404][123090] Updated weights for policy 1, policy_version 493507 (0.0010) [2023-12-26 03:33:15,475][123090] Updated weights for policy 1, policy_version 493517 (0.0009) [2023-12-26 03:33:15,542][123090] Updated weights for policy 1, policy_version 493527 (0.0009) [2023-12-26 03:33:15,592][123091] Updated weights for policy 0, policy_version 496977 (0.0006) [2023-12-26 03:33:15,648][123091] Updated weights for policy 0, policy_version 496987 (0.0009) [2023-12-26 03:33:15,703][123091] Updated weights for policy 0, policy_version 496997 (0.0009) [2023-12-26 03:33:15,754][123091] Updated weights for policy 0, policy_version 497007 (0.0009) [2023-12-26 03:33:16,293][123090] Updated weights for policy 1, policy_version 493537 (0.0008) [2023-12-26 03:33:16,354][123090] Updated weights for policy 1, policy_version 493547 (0.0005) [2023-12-26 03:33:16,428][123090] Updated weights for policy 1, policy_version 493557 (0.0005) [2023-12-26 03:33:16,490][123090] Updated weights for policy 1, policy_version 493567 (0.0005) [2023-12-26 03:33:16,531][123091] Updated weights for policy 0, policy_version 497017 (0.0008) [2023-12-26 03:33:16,578][123091] Updated weights for policy 0, policy_version 497027 (0.0005) [2023-12-26 03:33:16,639][123091] Updated weights for policy 0, policy_version 497037 (0.0006) [2023-12-26 03:33:17,146][123090] Updated weights for policy 1, policy_version 493577 (0.0009) [2023-12-26 03:33:17,204][123090] Updated weights for policy 1, policy_version 493587 (0.0010) [2023-12-26 03:33:17,256][123090] Updated weights for policy 1, policy_version 493597 (0.0008) [2023-12-26 03:33:17,452][123091] Updated weights for policy 0, policy_version 497047 (0.0009) [2023-12-26 03:33:17,513][123091] Updated weights for policy 0, policy_version 497057 (0.0006) [2023-12-26 03:33:17,574][123091] Updated weights for policy 0, policy_version 497067 (0.0005) [2023-12-26 03:33:18,093][123090] Updated weights for policy 1, policy_version 493607 (0.0010) [2023-12-26 03:33:18,142][123090] Updated weights for policy 1, policy_version 493617 (0.0010) [2023-12-26 03:33:18,164][123091] Updated weights for policy 0, policy_version 497077 (0.0006) [2023-12-26 03:33:18,210][123090] Updated weights for policy 1, policy_version 493627 (0.0011) [2023-12-26 03:33:18,225][123091] Updated weights for policy 0, policy_version 497087 (0.0011) [2023-12-26 03:33:18,280][123091] Updated weights for policy 0, policy_version 497097 (0.0010) [2023-12-26 03:33:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 253632512. Throughput: 0: 8796.1, 1: 8658.4. Samples: 253644612. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:18,784][121949] Avg episode reward: [(0, '5936.656'), (1, '5532.828')] [2023-12-26 03:33:19,056][123090] Updated weights for policy 1, policy_version 493637 (0.0010) [2023-12-26 03:33:19,087][123091] Updated weights for policy 0, policy_version 497107 (0.0008) [2023-12-26 03:33:19,108][123090] Updated weights for policy 1, policy_version 493647 (0.0010) [2023-12-26 03:33:19,141][123091] Updated weights for policy 0, policy_version 497117 (0.0005) [2023-12-26 03:33:19,163][123090] Updated weights for policy 1, policy_version 493657 (0.0010) [2023-12-26 03:33:19,193][123091] Updated weights for policy 0, policy_version 497127 (0.0005) [2023-12-26 03:33:20,010][123091] Updated weights for policy 0, policy_version 497137 (0.0007) [2023-12-26 03:33:20,043][123090] Updated weights for policy 1, policy_version 493667 (0.0010) [2023-12-26 03:33:20,067][123091] Updated weights for policy 0, policy_version 497147 (0.0008) [2023-12-26 03:33:20,099][123090] Updated weights for policy 1, policy_version 493677 (0.0010) [2023-12-26 03:33:20,120][123091] Updated weights for policy 0, policy_version 497157 (0.0007) [2023-12-26 03:33:20,153][123090] Updated weights for policy 1, policy_version 493687 (0.0010) [2023-12-26 03:33:20,169][123091] Updated weights for policy 0, policy_version 497167 (0.0007) [2023-12-26 03:33:21,030][123090] Updated weights for policy 1, policy_version 493697 (0.0009) [2023-12-26 03:33:21,048][123091] Updated weights for policy 0, policy_version 497177 (0.0009) [2023-12-26 03:33:21,095][123090] Updated weights for policy 1, policy_version 493707 (0.0006) [2023-12-26 03:33:21,108][123091] Updated weights for policy 0, policy_version 497187 (0.0009) [2023-12-26 03:33:21,169][123090] Updated weights for policy 1, policy_version 493717 (0.0010) [2023-12-26 03:33:21,176][123091] Updated weights for policy 0, policy_version 497197 (0.0008) [2023-12-26 03:33:21,222][123090] Updated weights for policy 1, policy_version 493727 (0.0011) [2023-12-26 03:33:22,016][123091] Updated weights for policy 0, policy_version 497207 (0.0009) [2023-12-26 03:33:22,038][123090] Updated weights for policy 1, policy_version 493737 (0.0007) [2023-12-26 03:33:22,077][123091] Updated weights for policy 0, policy_version 497217 (0.0008) [2023-12-26 03:33:22,089][123090] Updated weights for policy 1, policy_version 493747 (0.0008) [2023-12-26 03:33:22,144][123091] Updated weights for policy 0, policy_version 497227 (0.0007) [2023-12-26 03:33:22,146][123090] Updated weights for policy 1, policy_version 493757 (0.0010) [2023-12-26 03:33:22,983][123091] Updated weights for policy 0, policy_version 497237 (0.0008) [2023-12-26 03:33:23,008][123090] Updated weights for policy 1, policy_version 493767 (0.0008) [2023-12-26 03:33:23,038][123091] Updated weights for policy 0, policy_version 497247 (0.0008) [2023-12-26 03:33:23,075][123090] Updated weights for policy 1, policy_version 493777 (0.0008) [2023-12-26 03:33:23,092][123091] Updated weights for policy 0, policy_version 497257 (0.0006) [2023-12-26 03:33:23,146][123090] Updated weights for policy 1, policy_version 493787 (0.0006) [2023-12-26 03:33:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 253714432. Throughput: 0: 8740.1, 1: 8579.4. Samples: 253695696. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:23,785][121949] Avg episode reward: [(0, '5788.671'), (1, '5481.236')] [2023-12-26 03:33:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000497264_127303680.pth... [2023-12-26 03:33:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000493792_126410752.pth... [2023-12-26 03:33:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000496240_127041536.pth [2023-12-26 03:33:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000492800_126156800.pth [2023-12-26 03:33:23,866][123090] Updated weights for policy 1, policy_version 493797 (0.0010) [2023-12-26 03:33:23,917][123090] Updated weights for policy 1, policy_version 493807 (0.0009) [2023-12-26 03:33:23,943][123091] Updated weights for policy 0, policy_version 497267 (0.0008) [2023-12-26 03:33:23,967][123090] Updated weights for policy 1, policy_version 493817 (0.0006) [2023-12-26 03:33:23,998][123091] Updated weights for policy 0, policy_version 497277 (0.0008) [2023-12-26 03:33:24,051][123091] Updated weights for policy 0, policy_version 497287 (0.0009) [2023-12-26 03:33:24,804][123090] Updated weights for policy 1, policy_version 493827 (0.0007) [2023-12-26 03:33:24,854][123090] Updated weights for policy 1, policy_version 493837 (0.0009) [2023-12-26 03:33:24,893][123091] Updated weights for policy 0, policy_version 497297 (0.0009) [2023-12-26 03:33:24,903][123090] Updated weights for policy 1, policy_version 493847 (0.0010) [2023-12-26 03:33:24,954][123091] Updated weights for policy 0, policy_version 497307 (0.0009) [2023-12-26 03:33:25,021][123091] Updated weights for policy 0, policy_version 497317 (0.0009) [2023-12-26 03:33:25,076][123091] Updated weights for policy 0, policy_version 497327 (0.0009) [2023-12-26 03:33:25,674][123090] Updated weights for policy 1, policy_version 493857 (0.0008) [2023-12-26 03:33:25,738][123090] Updated weights for policy 1, policy_version 493867 (0.0005) [2023-12-26 03:33:25,797][123090] Updated weights for policy 1, policy_version 493877 (0.0009) [2023-12-26 03:33:25,853][123090] Updated weights for policy 1, policy_version 493887 (0.0009) [2023-12-26 03:33:25,926][123091] Updated weights for policy 0, policy_version 497337 (0.0010) [2023-12-26 03:33:25,977][123091] Updated weights for policy 0, policy_version 497347 (0.0009) [2023-12-26 03:33:26,031][123091] Updated weights for policy 0, policy_version 497357 (0.0010) [2023-12-26 03:33:26,625][123090] Updated weights for policy 1, policy_version 493897 (0.0006) [2023-12-26 03:33:26,674][123090] Updated weights for policy 1, policy_version 493907 (0.0005) [2023-12-26 03:33:26,728][123090] Updated weights for policy 1, policy_version 493917 (0.0005) [2023-12-26 03:33:26,892][123091] Updated weights for policy 0, policy_version 497367 (0.0010) [2023-12-26 03:33:26,948][123091] Updated weights for policy 0, policy_version 497377 (0.0009) [2023-12-26 03:33:27,012][123091] Updated weights for policy 0, policy_version 497387 (0.0010) [2023-12-26 03:33:27,527][123090] Updated weights for policy 1, policy_version 493927 (0.0009) [2023-12-26 03:33:27,578][123090] Updated weights for policy 1, policy_version 493937 (0.0010) [2023-12-26 03:33:27,626][123090] Updated weights for policy 1, policy_version 493947 (0.0010) [2023-12-26 03:33:27,858][123091] Updated weights for policy 0, policy_version 497397 (0.0010) [2023-12-26 03:33:27,923][123091] Updated weights for policy 0, policy_version 497407 (0.0010) [2023-12-26 03:33:27,974][123091] Updated weights for policy 0, policy_version 497417 (0.0010) [2023-12-26 03:33:28,474][123090] Updated weights for policy 1, policy_version 493957 (0.0008) [2023-12-26 03:33:28,534][123090] Updated weights for policy 1, policy_version 493967 (0.0010) [2023-12-26 03:33:28,613][123090] Updated weights for policy 1, policy_version 493977 (0.0007) [2023-12-26 03:33:28,738][123091] Updated weights for policy 0, policy_version 497427 (0.0011) [2023-12-26 03:33:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 253804544. Throughput: 0: 8793.2, 1: 8552.9. Samples: 253799116. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:28,785][121949] Avg episode reward: [(0, '5895.736'), (1, '5450.806')] [2023-12-26 03:33:28,798][123091] Updated weights for policy 0, policy_version 497437 (0.0011) [2023-12-26 03:33:28,863][123091] Updated weights for policy 0, policy_version 497447 (0.0010) [2023-12-26 03:33:29,367][123090] Updated weights for policy 1, policy_version 493987 (0.0006) [2023-12-26 03:33:29,442][123090] Updated weights for policy 1, policy_version 493997 (0.0008) [2023-12-26 03:33:29,497][123090] Updated weights for policy 1, policy_version 494007 (0.0008) [2023-12-26 03:33:29,584][123091] Updated weights for policy 0, policy_version 497457 (0.0010) [2023-12-26 03:33:29,654][123091] Updated weights for policy 0, policy_version 497467 (0.0006) [2023-12-26 03:33:29,723][123091] Updated weights for policy 0, policy_version 497477 (0.0005) [2023-12-26 03:33:29,772][123091] Updated weights for policy 0, policy_version 497487 (0.0005) [2023-12-26 03:33:30,272][123090] Updated weights for policy 1, policy_version 494017 (0.0008) [2023-12-26 03:33:30,324][123090] Updated weights for policy 1, policy_version 494027 (0.0005) [2023-12-26 03:33:30,380][123090] Updated weights for policy 1, policy_version 494037 (0.0009) [2023-12-26 03:33:30,436][123090] Updated weights for policy 1, policy_version 494047 (0.0010) [2023-12-26 03:33:30,447][123091] Updated weights for policy 0, policy_version 497497 (0.0006) [2023-12-26 03:33:30,498][123091] Updated weights for policy 0, policy_version 497507 (0.0010) [2023-12-26 03:33:30,553][123091] Updated weights for policy 0, policy_version 497517 (0.0010) [2023-12-26 03:33:31,254][123090] Updated weights for policy 1, policy_version 494057 (0.0010) [2023-12-26 03:33:31,314][123090] Updated weights for policy 1, policy_version 494067 (0.0010) [2023-12-26 03:33:31,367][123091] Updated weights for policy 0, policy_version 497527 (0.0008) [2023-12-26 03:33:31,370][123090] Updated weights for policy 1, policy_version 494077 (0.0010) [2023-12-26 03:33:31,427][123091] Updated weights for policy 0, policy_version 497537 (0.0011) [2023-12-26 03:33:31,478][123091] Updated weights for policy 0, policy_version 497547 (0.0010) [2023-12-26 03:33:32,215][123090] Updated weights for policy 1, policy_version 494087 (0.0009) [2023-12-26 03:33:32,280][123090] Updated weights for policy 1, policy_version 494097 (0.0008) [2023-12-26 03:33:32,306][123091] Updated weights for policy 0, policy_version 497557 (0.0011) [2023-12-26 03:33:32,337][123090] Updated weights for policy 1, policy_version 494107 (0.0010) [2023-12-26 03:33:32,374][123091] Updated weights for policy 0, policy_version 497567 (0.0010) [2023-12-26 03:33:32,452][123091] Updated weights for policy 0, policy_version 497578 (0.0010) [2023-12-26 03:33:33,145][123090] Updated weights for policy 1, policy_version 494117 (0.0007) [2023-12-26 03:33:33,198][123090] Updated weights for policy 1, policy_version 494127 (0.0005) [2023-12-26 03:33:33,257][123090] Updated weights for policy 1, policy_version 494137 (0.0005) [2023-12-26 03:33:33,289][123091] Updated weights for policy 0, policy_version 497588 (0.0011) [2023-12-26 03:33:33,340][123091] Updated weights for policy 0, policy_version 497598 (0.0010) [2023-12-26 03:33:33,383][123091] Updated weights for policy 0, policy_version 497608 (0.0010) [2023-12-26 03:33:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 253894656. Throughput: 0: 8849.1, 1: 8588.8. Samples: 253906256. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:33,785][121949] Avg episode reward: [(0, '6076.020'), (1, '5433.737')] [2023-12-26 03:33:33,978][123090] Updated weights for policy 1, policy_version 494147 (0.0006) [2023-12-26 03:33:34,044][123090] Updated weights for policy 1, policy_version 494157 (0.0006) [2023-12-26 03:33:34,100][123090] Updated weights for policy 1, policy_version 494167 (0.0009) [2023-12-26 03:33:34,241][123091] Updated weights for policy 0, policy_version 497618 (0.0010) [2023-12-26 03:33:34,308][123091] Updated weights for policy 0, policy_version 497628 (0.0009) [2023-12-26 03:33:34,370][123091] Updated weights for policy 0, policy_version 497638 (0.0009) [2023-12-26 03:33:34,441][123091] Updated weights for policy 0, policy_version 497648 (0.0008) [2023-12-26 03:33:34,954][123090] Updated weights for policy 1, policy_version 494177 (0.0010) [2023-12-26 03:33:35,015][123090] Updated weights for policy 1, policy_version 494187 (0.0006) [2023-12-26 03:33:35,078][123090] Updated weights for policy 1, policy_version 494197 (0.0005) [2023-12-26 03:33:35,133][123090] Updated weights for policy 1, policy_version 494207 (0.0005) [2023-12-26 03:33:35,171][123091] Updated weights for policy 0, policy_version 497658 (0.0011) [2023-12-26 03:33:35,229][123091] Updated weights for policy 0, policy_version 497668 (0.0010) [2023-12-26 03:33:35,280][123091] Updated weights for policy 0, policy_version 497678 (0.0010) [2023-12-26 03:33:35,843][123090] Updated weights for policy 1, policy_version 494217 (0.0010) [2023-12-26 03:33:35,906][123090] Updated weights for policy 1, policy_version 494227 (0.0010) [2023-12-26 03:33:35,961][123090] Updated weights for policy 1, policy_version 494237 (0.0010) [2023-12-26 03:33:36,091][123091] Updated weights for policy 0, policy_version 497688 (0.0007) [2023-12-26 03:33:36,155][123091] Updated weights for policy 0, policy_version 497698 (0.0008) [2023-12-26 03:33:36,211][123091] Updated weights for policy 0, policy_version 497708 (0.0006) [2023-12-26 03:33:36,805][123090] Updated weights for policy 1, policy_version 494247 (0.0009) [2023-12-26 03:33:36,871][123090] Updated weights for policy 1, policy_version 494257 (0.0010) [2023-12-26 03:33:36,931][123090] Updated weights for policy 1, policy_version 494267 (0.0010) [2023-12-26 03:33:37,014][123091] Updated weights for policy 0, policy_version 497718 (0.0008) [2023-12-26 03:33:37,067][123091] Updated weights for policy 0, policy_version 497728 (0.0010) [2023-12-26 03:33:37,121][123091] Updated weights for policy 0, policy_version 497738 (0.0009) [2023-12-26 03:33:37,811][123090] Updated weights for policy 1, policy_version 494277 (0.0009) [2023-12-26 03:33:37,863][123090] Updated weights for policy 1, policy_version 494287 (0.0008) [2023-12-26 03:33:37,915][123090] Updated weights for policy 1, policy_version 494297 (0.0009) [2023-12-26 03:33:37,922][123091] Updated weights for policy 0, policy_version 497748 (0.0008) [2023-12-26 03:33:37,977][123091] Updated weights for policy 0, policy_version 497758 (0.0010) [2023-12-26 03:33:38,028][123091] Updated weights for policy 0, policy_version 497768 (0.0010) [2023-12-26 03:33:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 253976576. Throughput: 0: 8867.5, 1: 8609.7. Samples: 253960020. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:38,785][121949] Avg episode reward: [(0, '5986.045'), (1, '5313.269')] [2023-12-26 03:33:38,800][123091] Updated weights for policy 0, policy_version 497778 (0.0010) [2023-12-26 03:33:38,802][123090] Updated weights for policy 1, policy_version 494307 (0.0008) [2023-12-26 03:33:38,854][123090] Updated weights for policy 1, policy_version 494317 (0.0009) [2023-12-26 03:33:38,854][123091] Updated weights for policy 0, policy_version 497788 (0.0005) [2023-12-26 03:33:38,912][123090] Updated weights for policy 1, policy_version 494327 (0.0007) [2023-12-26 03:33:38,913][123091] Updated weights for policy 0, policy_version 497798 (0.0005) [2023-12-26 03:33:38,965][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000494336_126550016.pth... [2023-12-26 03:33:38,966][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000497808_127442944.pth... [2023-12-26 03:33:38,967][123091] Updated weights for policy 0, policy_version 497808 (0.0005) [2023-12-26 03:33:38,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000493312_126287872.pth [2023-12-26 03:33:38,970][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000496752_127172608.pth [2023-12-26 03:33:39,734][123090] Updated weights for policy 1, policy_version 494337 (0.0010) [2023-12-26 03:33:39,771][123091] Updated weights for policy 0, policy_version 497818 (0.0007) [2023-12-26 03:33:39,790][123090] Updated weights for policy 1, policy_version 494347 (0.0011) [2023-12-26 03:33:39,838][123091] Updated weights for policy 0, policy_version 497828 (0.0006) [2023-12-26 03:33:39,856][123090] Updated weights for policy 1, policy_version 494357 (0.0010) [2023-12-26 03:33:39,904][123091] Updated weights for policy 0, policy_version 497838 (0.0010) [2023-12-26 03:33:39,922][123090] Updated weights for policy 1, policy_version 494367 (0.0010) [2023-12-26 03:33:40,733][123090] Updated weights for policy 1, policy_version 494377 (0.0009) [2023-12-26 03:33:40,768][123091] Updated weights for policy 0, policy_version 497848 (0.0007) [2023-12-26 03:33:40,794][123090] Updated weights for policy 1, policy_version 494387 (0.0010) [2023-12-26 03:33:40,833][123091] Updated weights for policy 0, policy_version 497858 (0.0007) [2023-12-26 03:33:40,846][123090] Updated weights for policy 1, policy_version 494397 (0.0010) [2023-12-26 03:33:40,891][123091] Updated weights for policy 0, policy_version 497868 (0.0010) [2023-12-26 03:33:41,636][123090] Updated weights for policy 1, policy_version 494407 (0.0009) [2023-12-26 03:33:41,700][123090] Updated weights for policy 1, policy_version 494417 (0.0008) [2023-12-26 03:33:41,730][123091] Updated weights for policy 0, policy_version 497878 (0.0010) [2023-12-26 03:33:41,776][123090] Updated weights for policy 1, policy_version 494427 (0.0008) [2023-12-26 03:33:41,798][123091] Updated weights for policy 0, policy_version 497888 (0.0011) [2023-12-26 03:33:41,874][123091] Updated weights for policy 0, policy_version 497898 (0.0009) [2023-12-26 03:33:42,469][123090] Updated weights for policy 1, policy_version 494437 (0.0006) [2023-12-26 03:33:42,525][123090] Updated weights for policy 1, policy_version 494447 (0.0006) [2023-12-26 03:33:42,587][123090] Updated weights for policy 1, policy_version 494457 (0.0009) [2023-12-26 03:33:42,625][123091] Updated weights for policy 0, policy_version 497908 (0.0007) [2023-12-26 03:33:42,678][123091] Updated weights for policy 0, policy_version 497918 (0.0009) [2023-12-26 03:33:42,730][123091] Updated weights for policy 0, policy_version 497928 (0.0008) [2023-12-26 03:33:43,394][123090] Updated weights for policy 1, policy_version 494467 (0.0011) [2023-12-26 03:33:43,458][123090] Updated weights for policy 1, policy_version 494477 (0.0011) [2023-12-26 03:33:43,506][123090] Updated weights for policy 1, policy_version 494487 (0.0010) [2023-12-26 03:33:43,549][123091] Updated weights for policy 0, policy_version 497938 (0.0008) [2023-12-26 03:33:43,620][123091] Updated weights for policy 0, policy_version 497948 (0.0005) [2023-12-26 03:33:43,691][123091] Updated weights for policy 0, policy_version 497958 (0.0005) [2023-12-26 03:33:43,758][123091] Updated weights for policy 0, policy_version 497968 (0.0006) [2023-12-26 03:33:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 254074880. Throughput: 0: 8860.7, 1: 8630.3. Samples: 254063504. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:43,784][121949] Avg episode reward: [(0, '6005.475'), (1, '5120.030')] [2023-12-26 03:33:44,293][123090] Updated weights for policy 1, policy_version 494497 (0.0010) [2023-12-26 03:33:44,360][123090] Updated weights for policy 1, policy_version 494507 (0.0011) [2023-12-26 03:33:44,376][123091] Updated weights for policy 0, policy_version 497978 (0.0010) [2023-12-26 03:33:44,420][123090] Updated weights for policy 1, policy_version 494517 (0.0011) [2023-12-26 03:33:44,436][123091] Updated weights for policy 0, policy_version 497988 (0.0007) [2023-12-26 03:33:44,479][123090] Updated weights for policy 1, policy_version 494527 (0.0010) [2023-12-26 03:33:44,504][123091] Updated weights for policy 0, policy_version 497998 (0.0007) [2023-12-26 03:33:45,243][123090] Updated weights for policy 1, policy_version 494537 (0.0007) [2023-12-26 03:33:45,303][123090] Updated weights for policy 1, policy_version 494547 (0.0010) [2023-12-26 03:33:45,342][123091] Updated weights for policy 0, policy_version 498008 (0.0010) [2023-12-26 03:33:45,359][123090] Updated weights for policy 1, policy_version 494557 (0.0010) [2023-12-26 03:33:45,394][123091] Updated weights for policy 0, policy_version 498018 (0.0008) [2023-12-26 03:33:45,446][123091] Updated weights for policy 0, policy_version 498028 (0.0009) [2023-12-26 03:33:46,129][123090] Updated weights for policy 1, policy_version 494567 (0.0011) [2023-12-26 03:33:46,175][123090] Updated weights for policy 1, policy_version 494577 (0.0010) [2023-12-26 03:33:46,221][123090] Updated weights for policy 1, policy_version 494587 (0.0005) [2023-12-26 03:33:46,365][123091] Updated weights for policy 0, policy_version 498039 (0.0009) [2023-12-26 03:33:46,418][123091] Updated weights for policy 0, policy_version 498050 (0.0010) [2023-12-26 03:33:46,472][123091] Updated weights for policy 0, policy_version 498060 (0.0010) [2023-12-26 03:33:46,966][123090] Updated weights for policy 1, policy_version 494597 (0.0008) [2023-12-26 03:33:47,018][123090] Updated weights for policy 1, policy_version 494607 (0.0010) [2023-12-26 03:33:47,069][123090] Updated weights for policy 1, policy_version 494617 (0.0010) [2023-12-26 03:33:47,346][123091] Updated weights for policy 0, policy_version 498071 (0.0010) [2023-12-26 03:33:47,401][123091] Updated weights for policy 0, policy_version 498081 (0.0010) [2023-12-26 03:33:47,471][123091] Updated weights for policy 0, policy_version 498091 (0.0010) [2023-12-26 03:33:47,865][123090] Updated weights for policy 1, policy_version 494627 (0.0009) [2023-12-26 03:33:47,922][123090] Updated weights for policy 1, policy_version 494637 (0.0005) [2023-12-26 03:33:47,970][123090] Updated weights for policy 1, policy_version 494647 (0.0005) [2023-12-26 03:33:48,229][123091] Updated weights for policy 0, policy_version 498101 (0.0010) [2023-12-26 03:33:48,310][123091] Updated weights for policy 0, policy_version 498111 (0.0011) [2023-12-26 03:33:48,365][123091] Updated weights for policy 0, policy_version 498121 (0.0009) [2023-12-26 03:33:48,745][123090] Updated weights for policy 1, policy_version 494657 (0.0006) [2023-12-26 03:33:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 254156800. Throughput: 0: 8839.0, 1: 8763.4. Samples: 254172416. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:48,784][121949] Avg episode reward: [(0, '6070.263'), (1, '5254.375')] [2023-12-26 03:33:48,797][123090] Updated weights for policy 1, policy_version 494667 (0.0009) [2023-12-26 03:33:48,853][123090] Updated weights for policy 1, policy_version 494677 (0.0009) [2023-12-26 03:33:48,916][123090] Updated weights for policy 1, policy_version 494687 (0.0007) [2023-12-26 03:33:49,060][123091] Updated weights for policy 0, policy_version 498131 (0.0006) [2023-12-26 03:33:49,127][123091] Updated weights for policy 0, policy_version 498141 (0.0008) [2023-12-26 03:33:49,180][123091] Updated weights for policy 0, policy_version 498151 (0.0008) [2023-12-26 03:33:49,736][123090] Updated weights for policy 1, policy_version 494697 (0.0009) [2023-12-26 03:33:49,788][123090] Updated weights for policy 1, policy_version 494707 (0.0009) [2023-12-26 03:33:49,852][123090] Updated weights for policy 1, policy_version 494717 (0.0009) [2023-12-26 03:33:49,936][123091] Updated weights for policy 0, policy_version 498161 (0.0009) [2023-12-26 03:33:50,005][123091] Updated weights for policy 0, policy_version 498171 (0.0011) [2023-12-26 03:33:50,066][123091] Updated weights for policy 0, policy_version 498181 (0.0011) [2023-12-26 03:33:50,125][123091] Updated weights for policy 0, policy_version 498191 (0.0010) [2023-12-26 03:33:50,728][123090] Updated weights for policy 1, policy_version 494727 (0.0010) [2023-12-26 03:33:50,795][123090] Updated weights for policy 1, policy_version 494737 (0.0009) [2023-12-26 03:33:50,850][123091] Updated weights for policy 0, policy_version 498201 (0.0008) [2023-12-26 03:33:50,866][123090] Updated weights for policy 1, policy_version 494747 (0.0008) [2023-12-26 03:33:50,907][123091] Updated weights for policy 0, policy_version 498211 (0.0008) [2023-12-26 03:33:50,980][123091] Updated weights for policy 0, policy_version 498221 (0.0009) [2023-12-26 03:33:51,663][123090] Updated weights for policy 1, policy_version 494757 (0.0009) [2023-12-26 03:33:51,729][123090] Updated weights for policy 1, policy_version 494767 (0.0010) [2023-12-26 03:33:51,792][123090] Updated weights for policy 1, policy_version 494777 (0.0008) [2023-12-26 03:33:51,833][123091] Updated weights for policy 0, policy_version 498231 (0.0009) [2023-12-26 03:33:51,886][123091] Updated weights for policy 0, policy_version 498241 (0.0009) [2023-12-26 03:33:51,947][123091] Updated weights for policy 0, policy_version 498251 (0.0009) [2023-12-26 03:33:52,680][123090] Updated weights for policy 1, policy_version 494787 (0.0008) [2023-12-26 03:33:52,718][123091] Updated weights for policy 0, policy_version 498261 (0.0008) [2023-12-26 03:33:52,738][123090] Updated weights for policy 1, policy_version 494797 (0.0008) [2023-12-26 03:33:52,782][123091] Updated weights for policy 0, policy_version 498271 (0.0008) [2023-12-26 03:33:52,785][123090] Updated weights for policy 1, policy_version 494807 (0.0009) [2023-12-26 03:33:52,844][123091] Updated weights for policy 0, policy_version 498281 (0.0008) [2023-12-26 03:33:53,600][123090] Updated weights for policy 1, policy_version 494817 (0.0009) [2023-12-26 03:33:53,650][123091] Updated weights for policy 0, policy_version 498291 (0.0007) [2023-12-26 03:33:53,665][123090] Updated weights for policy 1, policy_version 494827 (0.0005) [2023-12-26 03:33:53,698][123091] Updated weights for policy 0, policy_version 498301 (0.0009) [2023-12-26 03:33:53,719][123090] Updated weights for policy 1, policy_version 494837 (0.0005) [2023-12-26 03:33:53,755][123091] Updated weights for policy 0, policy_version 498311 (0.0009) [2023-12-26 03:33:53,774][123090] Updated weights for policy 1, policy_version 494847 (0.0005) [2023-12-26 03:33:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 254246912. Throughput: 0: 8880.0, 1: 8710.4. Samples: 254224464. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:53,785][121949] Avg episode reward: [(0, '6075.896'), (1, '5440.669')] [2023-12-26 03:33:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000494848_126681088.pth... [2023-12-26 03:33:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000493792_126410752.pth [2023-12-26 03:33:53,796][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000494848_126681088.pth [2023-12-26 03:33:53,805][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000498320_127574016.pth... [2023-12-26 03:33:53,809][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000497264_127303680.pth [2023-12-26 03:33:53,810][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000498320_127574016.pth [2023-12-26 03:33:54,473][123090] Updated weights for policy 1, policy_version 494857 (0.0005) [2023-12-26 03:33:54,531][123090] Updated weights for policy 1, policy_version 494867 (0.0005) [2023-12-26 03:33:54,595][123090] Updated weights for policy 1, policy_version 494877 (0.0009) [2023-12-26 03:33:54,670][123091] Updated weights for policy 0, policy_version 498321 (0.0009) [2023-12-26 03:33:54,722][123091] Updated weights for policy 0, policy_version 498331 (0.0008) [2023-12-26 03:33:54,769][123091] Updated weights for policy 0, policy_version 498341 (0.0005) [2023-12-26 03:33:54,815][123091] Updated weights for policy 0, policy_version 498351 (0.0005) [2023-12-26 03:33:55,411][123090] Updated weights for policy 1, policy_version 494887 (0.0010) [2023-12-26 03:33:55,460][123090] Updated weights for policy 1, policy_version 494897 (0.0007) [2023-12-26 03:33:55,524][123091] Updated weights for policy 0, policy_version 498361 (0.0005) [2023-12-26 03:33:55,526][123090] Updated weights for policy 1, policy_version 494907 (0.0006) [2023-12-26 03:33:55,578][123091] Updated weights for policy 0, policy_version 498371 (0.0005) [2023-12-26 03:33:55,631][123091] Updated weights for policy 0, policy_version 498381 (0.0005) [2023-12-26 03:33:56,316][123091] Updated weights for policy 0, policy_version 498391 (0.0005) [2023-12-26 03:33:56,381][123091] Updated weights for policy 0, policy_version 498401 (0.0005) [2023-12-26 03:33:56,382][123090] Updated weights for policy 1, policy_version 494917 (0.0009) [2023-12-26 03:33:56,431][123090] Updated weights for policy 1, policy_version 494928 (0.0008) [2023-12-26 03:33:56,438][123091] Updated weights for policy 0, policy_version 498411 (0.0005) [2023-12-26 03:33:56,484][123090] Updated weights for policy 1, policy_version 494939 (0.0010) [2023-12-26 03:33:57,133][123091] Updated weights for policy 0, policy_version 498421 (0.0005) [2023-12-26 03:33:57,199][123091] Updated weights for policy 0, policy_version 498431 (0.0008) [2023-12-26 03:33:57,274][123091] Updated weights for policy 0, policy_version 498441 (0.0005) [2023-12-26 03:33:57,406][123090] Updated weights for policy 1, policy_version 494949 (0.0010) [2023-12-26 03:33:57,464][123090] Updated weights for policy 1, policy_version 494959 (0.0010) [2023-12-26 03:33:57,524][123090] Updated weights for policy 1, policy_version 494969 (0.0009) [2023-12-26 03:33:58,000][123091] Updated weights for policy 0, policy_version 498451 (0.0006) [2023-12-26 03:33:58,068][123091] Updated weights for policy 0, policy_version 498461 (0.0008) [2023-12-26 03:33:58,136][123091] Updated weights for policy 0, policy_version 498471 (0.0008) [2023-12-26 03:33:58,244][123090] Updated weights for policy 1, policy_version 494979 (0.0007) [2023-12-26 03:33:58,311][123090] Updated weights for policy 1, policy_version 494989 (0.0010) [2023-12-26 03:33:58,387][123090] Updated weights for policy 1, policy_version 494999 (0.0011) [2023-12-26 03:33:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 254337024. Throughput: 0: 8932.5, 1: 8756.7. Samples: 254331624. Policy #0 lag: (min: 11.0, avg: 12.2, max: 30.0) [2023-12-26 03:33:58,785][121949] Avg episode reward: [(0, '6087.769'), (1, '5376.602')] [2023-12-26 03:33:58,960][123091] Updated weights for policy 0, policy_version 498481 (0.0007) [2023-12-26 03:33:59,024][123091] Updated weights for policy 0, policy_version 498491 (0.0007) [2023-12-26 03:33:59,090][123091] Updated weights for policy 0, policy_version 498501 (0.0009) [2023-12-26 03:33:59,144][123091] Updated weights for policy 0, policy_version 498511 (0.0009) [2023-12-26 03:33:59,250][123090] Updated weights for policy 1, policy_version 495009 (0.0010) [2023-12-26 03:33:59,318][123090] Updated weights for policy 1, policy_version 495019 (0.0010) [2023-12-26 03:33:59,384][123090] Updated weights for policy 1, policy_version 495029 (0.0010) [2023-12-26 03:33:59,452][123090] Updated weights for policy 1, policy_version 495039 (0.0010) [2023-12-26 03:34:00,002][123091] Updated weights for policy 0, policy_version 498521 (0.0009) [2023-12-26 03:34:00,073][123091] Updated weights for policy 0, policy_version 498531 (0.0008) [2023-12-26 03:34:00,135][123091] Updated weights for policy 0, policy_version 498541 (0.0006) [2023-12-26 03:34:00,240][123090] Updated weights for policy 1, policy_version 495049 (0.0010) [2023-12-26 03:34:00,292][123090] Updated weights for policy 1, policy_version 495059 (0.0010) [2023-12-26 03:34:00,343][123090] Updated weights for policy 1, policy_version 495069 (0.0010) [2023-12-26 03:34:00,958][123091] Updated weights for policy 0, policy_version 498553 (0.0009) [2023-12-26 03:34:01,011][123091] Updated weights for policy 0, policy_version 498564 (0.0010) [2023-12-26 03:34:01,061][123090] Updated weights for policy 1, policy_version 495079 (0.0009) [2023-12-26 03:34:01,072][123091] Updated weights for policy 0, policy_version 498574 (0.0008) [2023-12-26 03:34:01,124][123090] Updated weights for policy 1, policy_version 495089 (0.0010) [2023-12-26 03:34:01,195][123090] Updated weights for policy 1, policy_version 495099 (0.0008) [2023-12-26 03:34:01,899][123090] Updated weights for policy 1, policy_version 495109 (0.0005) [2023-12-26 03:34:01,959][123090] Updated weights for policy 1, policy_version 495119 (0.0005) [2023-12-26 03:34:02,024][123090] Updated weights for policy 1, policy_version 495129 (0.0007) [2023-12-26 03:34:02,051][123091] Updated weights for policy 0, policy_version 498584 (0.0006) [2023-12-26 03:34:02,112][123091] Updated weights for policy 0, policy_version 498594 (0.0009) [2023-12-26 03:34:02,164][123091] Updated weights for policy 0, policy_version 498604 (0.0009) [2023-12-26 03:34:02,737][123090] Updated weights for policy 1, policy_version 495139 (0.0009) [2023-12-26 03:34:02,786][123090] Updated weights for policy 1, policy_version 495149 (0.0005) [2023-12-26 03:34:02,863][123090] Updated weights for policy 1, policy_version 495159 (0.0005) [2023-12-26 03:34:02,899][123091] Updated weights for policy 0, policy_version 498614 (0.0007) [2023-12-26 03:34:02,957][123091] Updated weights for policy 0, policy_version 498624 (0.0005) [2023-12-26 03:34:03,012][123091] Updated weights for policy 0, policy_version 498634 (0.0006) [2023-12-26 03:34:03,529][123090] Updated weights for policy 1, policy_version 495169 (0.0006) [2023-12-26 03:34:03,577][123090] Updated weights for policy 1, policy_version 495179 (0.0005) [2023-12-26 03:34:03,628][123090] Updated weights for policy 1, policy_version 495189 (0.0005) [2023-12-26 03:34:03,692][123090] Updated weights for policy 1, policy_version 495199 (0.0005) [2023-12-26 03:34:03,701][123091] Updated weights for policy 0, policy_version 498644 (0.0005) [2023-12-26 03:34:03,750][123091] Updated weights for policy 0, policy_version 498654 (0.0006) [2023-12-26 03:34:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 254427136. Throughput: 0: 8825.7, 1: 8838.6. Samples: 254439504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:03,785][121949] Avg episode reward: [(0, '6057.659'), (1, '5326.978')] [2023-12-26 03:34:03,804][123091] Updated weights for policy 0, policy_version 498665 (0.0010) [2023-12-26 03:34:04,375][123090] Updated weights for policy 1, policy_version 495209 (0.0008) [2023-12-26 03:34:04,447][123090] Updated weights for policy 1, policy_version 495219 (0.0009) [2023-12-26 03:34:04,507][123090] Updated weights for policy 1, policy_version 495229 (0.0009) [2023-12-26 03:34:04,691][123091] Updated weights for policy 0, policy_version 498675 (0.0010) [2023-12-26 03:34:04,754][123091] Updated weights for policy 0, policy_version 498685 (0.0009) [2023-12-26 03:34:04,804][123091] Updated weights for policy 0, policy_version 498695 (0.0009) [2023-12-26 03:34:05,275][123090] Updated weights for policy 1, policy_version 495239 (0.0009) [2023-12-26 03:34:05,341][123090] Updated weights for policy 1, policy_version 495249 (0.0010) [2023-12-26 03:34:05,410][123090] Updated weights for policy 1, policy_version 495259 (0.0010) [2023-12-26 03:34:05,655][123091] Updated weights for policy 0, policy_version 498705 (0.0009) [2023-12-26 03:34:05,705][123091] Updated weights for policy 0, policy_version 498715 (0.0008) [2023-12-26 03:34:05,764][123091] Updated weights for policy 0, policy_version 498725 (0.0010) [2023-12-26 03:34:05,840][123091] Updated weights for policy 0, policy_version 498735 (0.0008) [2023-12-26 03:34:06,162][123090] Updated weights for policy 1, policy_version 495269 (0.0007) [2023-12-26 03:34:06,232][123090] Updated weights for policy 1, policy_version 495279 (0.0006) [2023-12-26 03:34:06,303][123090] Updated weights for policy 1, policy_version 495289 (0.0006) [2023-12-26 03:34:06,580][123091] Updated weights for policy 0, policy_version 498745 (0.0007) [2023-12-26 03:34:06,642][123091] Updated weights for policy 0, policy_version 498755 (0.0009) [2023-12-26 03:34:06,708][123091] Updated weights for policy 0, policy_version 498765 (0.0008) [2023-12-26 03:34:06,949][123090] Updated weights for policy 1, policy_version 495299 (0.0005) [2023-12-26 03:34:07,014][123090] Updated weights for policy 1, policy_version 495309 (0.0006) [2023-12-26 03:34:07,083][123090] Updated weights for policy 1, policy_version 495319 (0.0006) [2023-12-26 03:34:07,402][123091] Updated weights for policy 0, policy_version 498775 (0.0006) [2023-12-26 03:34:07,452][123091] Updated weights for policy 0, policy_version 498785 (0.0005) [2023-12-26 03:34:07,499][123091] Updated weights for policy 0, policy_version 498795 (0.0005) [2023-12-26 03:34:07,760][123090] Updated weights for policy 1, policy_version 495329 (0.0006) [2023-12-26 03:34:07,815][123090] Updated weights for policy 1, policy_version 495339 (0.0008) [2023-12-26 03:34:07,867][123090] Updated weights for policy 1, policy_version 495349 (0.0011) [2023-12-26 03:34:07,931][123090] Updated weights for policy 1, policy_version 495359 (0.0010) [2023-12-26 03:34:08,269][123091] Updated weights for policy 0, policy_version 498805 (0.0007) [2023-12-26 03:34:08,335][123091] Updated weights for policy 0, policy_version 498815 (0.0008) [2023-12-26 03:34:08,408][123091] Updated weights for policy 0, policy_version 498825 (0.0006) [2023-12-26 03:34:08,681][123090] Updated weights for policy 1, policy_version 495369 (0.0010) [2023-12-26 03:34:08,740][123090] Updated weights for policy 1, policy_version 495379 (0.0010) [2023-12-26 03:34:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 254517248. Throughput: 0: 8821.4, 1: 8898.8. Samples: 254493104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:08,785][121949] Avg episode reward: [(0, '6038.397'), (1, '5267.729')] [2023-12-26 03:34:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000498832_127705088.pth... [2023-12-26 03:34:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000497808_127442944.pth [2023-12-26 03:34:08,808][123090] Updated weights for policy 1, policy_version 495389 (0.0010) [2023-12-26 03:34:08,828][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000495392_126820352.pth... [2023-12-26 03:34:08,833][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000494336_126550016.pth [2023-12-26 03:34:09,092][123091] Updated weights for policy 0, policy_version 498835 (0.0007) [2023-12-26 03:34:09,164][123091] Updated weights for policy 0, policy_version 498845 (0.0009) [2023-12-26 03:34:09,234][123091] Updated weights for policy 0, policy_version 498856 (0.0010) [2023-12-26 03:34:09,616][123090] Updated weights for policy 1, policy_version 495399 (0.0007) [2023-12-26 03:34:09,681][123090] Updated weights for policy 1, policy_version 495409 (0.0006) [2023-12-26 03:34:09,758][123090] Updated weights for policy 1, policy_version 495419 (0.0006) [2023-12-26 03:34:10,054][123091] Updated weights for policy 0, policy_version 498866 (0.0010) [2023-12-26 03:34:10,114][123091] Updated weights for policy 0, policy_version 498876 (0.0007) [2023-12-26 03:34:10,184][123091] Updated weights for policy 0, policy_version 498886 (0.0006) [2023-12-26 03:34:10,244][123091] Updated weights for policy 0, policy_version 498896 (0.0007) [2023-12-26 03:34:10,539][123090] Updated weights for policy 1, policy_version 495429 (0.0009) [2023-12-26 03:34:10,594][123090] Updated weights for policy 1, policy_version 495439 (0.0006) [2023-12-26 03:34:10,644][123090] Updated weights for policy 1, policy_version 495449 (0.0005) [2023-12-26 03:34:10,999][123091] Updated weights for policy 0, policy_version 498906 (0.0011) [2023-12-26 03:34:11,090][123091] Updated weights for policy 0, policy_version 498916 (0.0010) [2023-12-26 03:34:11,168][123091] Updated weights for policy 0, policy_version 498926 (0.0010) [2023-12-26 03:34:11,356][123090] Updated weights for policy 1, policy_version 495459 (0.0007) [2023-12-26 03:34:11,435][123090] Updated weights for policy 1, policy_version 495469 (0.0009) [2023-12-26 03:34:11,492][123090] Updated weights for policy 1, policy_version 495479 (0.0009) [2023-12-26 03:34:12,047][123091] Updated weights for policy 0, policy_version 498936 (0.0010) [2023-12-26 03:34:12,119][123091] Updated weights for policy 0, policy_version 498946 (0.0010) [2023-12-26 03:34:12,182][123091] Updated weights for policy 0, policy_version 498956 (0.0009) [2023-12-26 03:34:12,197][123090] Updated weights for policy 1, policy_version 495489 (0.0006) [2023-12-26 03:34:12,252][123090] Updated weights for policy 1, policy_version 495499 (0.0006) [2023-12-26 03:34:12,318][123090] Updated weights for policy 1, policy_version 495509 (0.0008) [2023-12-26 03:34:12,391][123090] Updated weights for policy 1, policy_version 495519 (0.0008) [2023-12-26 03:34:13,067][123090] Updated weights for policy 1, policy_version 495529 (0.0006) [2023-12-26 03:34:13,112][123091] Updated weights for policy 0, policy_version 498966 (0.0009) [2023-12-26 03:34:13,129][123090] Updated weights for policy 1, policy_version 495539 (0.0005) [2023-12-26 03:34:13,170][123091] Updated weights for policy 0, policy_version 498976 (0.0009) [2023-12-26 03:34:13,196][123090] Updated weights for policy 1, policy_version 495549 (0.0007) [2023-12-26 03:34:13,234][123091] Updated weights for policy 0, policy_version 498986 (0.0008) [2023-12-26 03:34:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 254607360. Throughput: 0: 8881.2, 1: 8967.5. Samples: 254602304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:13,785][121949] Avg episode reward: [(0, '5983.822'), (1, '5264.783')] [2023-12-26 03:34:13,886][123090] Updated weights for policy 1, policy_version 495559 (0.0010) [2023-12-26 03:34:13,952][123090] Updated weights for policy 1, policy_version 495569 (0.0010) [2023-12-26 03:34:14,018][123090] Updated weights for policy 1, policy_version 495579 (0.0010) [2023-12-26 03:34:14,124][123091] Updated weights for policy 0, policy_version 498996 (0.0008) [2023-12-26 03:34:14,187][123091] Updated weights for policy 0, policy_version 499006 (0.0009) [2023-12-26 03:34:14,256][123091] Updated weights for policy 0, policy_version 499016 (0.0009) [2023-12-26 03:34:14,845][123090] Updated weights for policy 1, policy_version 495589 (0.0010) [2023-12-26 03:34:14,914][123090] Updated weights for policy 1, policy_version 495599 (0.0011) [2023-12-26 03:34:14,982][123090] Updated weights for policy 1, policy_version 495609 (0.0011) [2023-12-26 03:34:15,055][123091] Updated weights for policy 0, policy_version 499026 (0.0009) [2023-12-26 03:34:15,125][123091] Updated weights for policy 0, policy_version 499036 (0.0009) [2023-12-26 03:34:15,186][123091] Updated weights for policy 0, policy_version 499046 (0.0008) [2023-12-26 03:34:15,251][123091] Updated weights for policy 0, policy_version 499056 (0.0008) [2023-12-26 03:34:15,803][123090] Updated weights for policy 1, policy_version 495619 (0.0009) [2023-12-26 03:34:15,860][123090] Updated weights for policy 1, policy_version 495629 (0.0006) [2023-12-26 03:34:15,915][123090] Updated weights for policy 1, policy_version 495639 (0.0005) [2023-12-26 03:34:16,040][123091] Updated weights for policy 0, policy_version 499066 (0.0010) [2023-12-26 03:34:16,093][123091] Updated weights for policy 0, policy_version 499078 (0.0010) [2023-12-26 03:34:16,144][123091] Updated weights for policy 0, policy_version 499088 (0.0010) [2023-12-26 03:34:16,658][123090] Updated weights for policy 1, policy_version 495649 (0.0006) [2023-12-26 03:34:16,725][123090] Updated weights for policy 1, policy_version 495659 (0.0010) [2023-12-26 03:34:16,775][123090] Updated weights for policy 1, policy_version 495669 (0.0010) [2023-12-26 03:34:16,834][123090] Updated weights for policy 1, policy_version 495679 (0.0010) [2023-12-26 03:34:16,996][123091] Updated weights for policy 0, policy_version 499098 (0.0005) [2023-12-26 03:34:17,051][123091] Updated weights for policy 0, policy_version 499108 (0.0009) [2023-12-26 03:34:17,106][123091] Updated weights for policy 0, policy_version 499118 (0.0009) [2023-12-26 03:34:17,679][123090] Updated weights for policy 1, policy_version 495689 (0.0010) [2023-12-26 03:34:17,728][123090] Updated weights for policy 1, policy_version 495699 (0.0009) [2023-12-26 03:34:17,774][123090] Updated weights for policy 1, policy_version 495709 (0.0006) [2023-12-26 03:34:17,920][123091] Updated weights for policy 0, policy_version 499128 (0.0006) [2023-12-26 03:34:17,972][123091] Updated weights for policy 0, policy_version 499138 (0.0006) [2023-12-26 03:34:18,021][123091] Updated weights for policy 0, policy_version 499148 (0.0006) [2023-12-26 03:34:18,429][123090] Updated weights for policy 1, policy_version 495719 (0.0009) [2023-12-26 03:34:18,483][123090] Updated weights for policy 1, policy_version 495729 (0.0009) [2023-12-26 03:34:18,540][123090] Updated weights for policy 1, policy_version 495739 (0.0009) [2023-12-26 03:34:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 254697472. Throughput: 0: 8817.2, 1: 9030.8. Samples: 254709412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:18,784][121949] Avg episode reward: [(0, '5970.061'), (1, '5280.225')] [2023-12-26 03:34:18,797][123091] Updated weights for policy 0, policy_version 499158 (0.0008) [2023-12-26 03:34:18,876][123091] Updated weights for policy 0, policy_version 499168 (0.0010) [2023-12-26 03:34:18,944][123091] Updated weights for policy 0, policy_version 499178 (0.0009) [2023-12-26 03:34:19,407][123090] Updated weights for policy 1, policy_version 495749 (0.0010) [2023-12-26 03:34:19,466][123090] Updated weights for policy 1, policy_version 495759 (0.0009) [2023-12-26 03:34:19,535][123090] Updated weights for policy 1, policy_version 495769 (0.0009) [2023-12-26 03:34:19,774][123091] Updated weights for policy 0, policy_version 499188 (0.0010) [2023-12-26 03:34:19,833][123091] Updated weights for policy 0, policy_version 499198 (0.0009) [2023-12-26 03:34:19,893][123091] Updated weights for policy 0, policy_version 499208 (0.0009) [2023-12-26 03:34:20,377][123090] Updated weights for policy 1, policy_version 495779 (0.0008) [2023-12-26 03:34:20,429][123090] Updated weights for policy 1, policy_version 495789 (0.0009) [2023-12-26 03:34:20,490][123090] Updated weights for policy 1, policy_version 495799 (0.0010) [2023-12-26 03:34:20,736][123091] Updated weights for policy 0, policy_version 499218 (0.0009) [2023-12-26 03:34:20,807][123091] Updated weights for policy 0, policy_version 499228 (0.0006) [2023-12-26 03:34:20,874][123091] Updated weights for policy 0, policy_version 499238 (0.0009) [2023-12-26 03:34:20,940][123091] Updated weights for policy 0, policy_version 499248 (0.0009) [2023-12-26 03:34:21,264][123090] Updated weights for policy 1, policy_version 495809 (0.0010) [2023-12-26 03:34:21,327][123090] Updated weights for policy 1, policy_version 495819 (0.0008) [2023-12-26 03:34:21,401][123090] Updated weights for policy 1, policy_version 495829 (0.0008) [2023-12-26 03:34:21,468][123090] Updated weights for policy 1, policy_version 495839 (0.0008) [2023-12-26 03:34:21,722][123091] Updated weights for policy 0, policy_version 499258 (0.0010) [2023-12-26 03:34:21,795][123091] Updated weights for policy 0, policy_version 499268 (0.0010) [2023-12-26 03:34:21,858][123091] Updated weights for policy 0, policy_version 499278 (0.0009) [2023-12-26 03:34:22,288][123090] Updated weights for policy 1, policy_version 495849 (0.0008) [2023-12-26 03:34:22,349][123090] Updated weights for policy 1, policy_version 495859 (0.0009) [2023-12-26 03:34:22,404][123090] Updated weights for policy 1, policy_version 495869 (0.0009) [2023-12-26 03:34:22,729][123091] Updated weights for policy 0, policy_version 499288 (0.0009) [2023-12-26 03:34:22,799][123091] Updated weights for policy 0, policy_version 499298 (0.0009) [2023-12-26 03:34:22,853][123091] Updated weights for policy 0, policy_version 499308 (0.0009) [2023-12-26 03:34:23,274][123090] Updated weights for policy 1, policy_version 495879 (0.0010) [2023-12-26 03:34:23,330][123090] Updated weights for policy 1, policy_version 495889 (0.0010) [2023-12-26 03:34:23,397][123090] Updated weights for policy 1, policy_version 495899 (0.0010) [2023-12-26 03:34:23,600][123091] Updated weights for policy 0, policy_version 499318 (0.0010) [2023-12-26 03:34:23,650][123091] Updated weights for policy 0, policy_version 499328 (0.0010) [2023-12-26 03:34:23,702][123091] Updated weights for policy 0, policy_version 499338 (0.0010) [2023-12-26 03:34:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 254787584. Throughput: 0: 8789.1, 1: 9004.4. Samples: 254760724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:23,785][121949] Avg episode reward: [(0, '5869.904'), (1, '5367.797')] [2023-12-26 03:34:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000495904_126951424.pth... [2023-12-26 03:34:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000499344_127836160.pth... [2023-12-26 03:34:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000494848_126681088.pth [2023-12-26 03:34:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000498320_127574016.pth [2023-12-26 03:34:24,125][123090] Updated weights for policy 1, policy_version 495909 (0.0010) [2023-12-26 03:34:24,176][123090] Updated weights for policy 1, policy_version 495919 (0.0010) [2023-12-26 03:34:24,239][123090] Updated weights for policy 1, policy_version 495929 (0.0010) [2023-12-26 03:34:24,478][123091] Updated weights for policy 0, policy_version 499348 (0.0008) [2023-12-26 03:34:24,535][123091] Updated weights for policy 0, policy_version 499358 (0.0005) [2023-12-26 03:34:24,591][123091] Updated weights for policy 0, policy_version 499368 (0.0008) [2023-12-26 03:34:25,013][123090] Updated weights for policy 1, policy_version 495939 (0.0010) [2023-12-26 03:34:25,060][123090] Updated weights for policy 1, policy_version 495949 (0.0010) [2023-12-26 03:34:25,108][123090] Updated weights for policy 1, policy_version 495959 (0.0010) [2023-12-26 03:34:25,355][123091] Updated weights for policy 0, policy_version 499378 (0.0006) [2023-12-26 03:34:25,417][123091] Updated weights for policy 0, policy_version 499388 (0.0010) [2023-12-26 03:34:25,467][123091] Updated weights for policy 0, policy_version 499398 (0.0010) [2023-12-26 03:34:25,517][123091] Updated weights for policy 0, policy_version 499408 (0.0010) [2023-12-26 03:34:25,951][123090] Updated weights for policy 1, policy_version 495969 (0.0009) [2023-12-26 03:34:26,007][123090] Updated weights for policy 1, policy_version 495979 (0.0009) [2023-12-26 03:34:26,068][123090] Updated weights for policy 1, policy_version 495989 (0.0009) [2023-12-26 03:34:26,130][123090] Updated weights for policy 1, policy_version 495999 (0.0009) [2023-12-26 03:34:26,270][123091] Updated weights for policy 0, policy_version 499418 (0.0010) [2023-12-26 03:34:26,321][123091] Updated weights for policy 0, policy_version 499428 (0.0010) [2023-12-26 03:34:26,388][123091] Updated weights for policy 0, policy_version 499438 (0.0011) [2023-12-26 03:34:26,950][123090] Updated weights for policy 1, policy_version 496009 (0.0005) [2023-12-26 03:34:27,013][123090] Updated weights for policy 1, policy_version 496019 (0.0005) [2023-12-26 03:34:27,071][123090] Updated weights for policy 1, policy_version 496029 (0.0005) [2023-12-26 03:34:27,222][123091] Updated weights for policy 0, policy_version 499448 (0.0011) [2023-12-26 03:34:27,278][123091] Updated weights for policy 0, policy_version 499458 (0.0008) [2023-12-26 03:34:27,326][123091] Updated weights for policy 0, policy_version 499468 (0.0006) [2023-12-26 03:34:27,784][123090] Updated weights for policy 1, policy_version 496039 (0.0005) [2023-12-26 03:34:27,829][123090] Updated weights for policy 1, policy_version 496049 (0.0005) [2023-12-26 03:34:27,887][123090] Updated weights for policy 1, policy_version 496059 (0.0006) [2023-12-26 03:34:28,034][123091] Updated weights for policy 0, policy_version 499478 (0.0006) [2023-12-26 03:34:28,091][123091] Updated weights for policy 0, policy_version 499488 (0.0006) [2023-12-26 03:34:28,138][123091] Updated weights for policy 0, policy_version 499498 (0.0007) [2023-12-26 03:34:28,582][123090] Updated weights for policy 1, policy_version 496069 (0.0007) [2023-12-26 03:34:28,648][123090] Updated weights for policy 1, policy_version 496079 (0.0009) [2023-12-26 03:34:28,730][123090] Updated weights for policy 1, policy_version 496089 (0.0009) [2023-12-26 03:34:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 254877696. Throughput: 0: 8817.6, 1: 9055.2. Samples: 254867780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:28,785][121949] Avg episode reward: [(0, '5907.818'), (1, '5278.343')] [2023-12-26 03:34:28,927][123091] Updated weights for policy 0, policy_version 499508 (0.0007) [2023-12-26 03:34:28,985][123091] Updated weights for policy 0, policy_version 499518 (0.0005) [2023-12-26 03:34:29,058][123091] Updated weights for policy 0, policy_version 499528 (0.0006) [2023-12-26 03:34:29,513][123090] Updated weights for policy 1, policy_version 496099 (0.0009) [2023-12-26 03:34:29,576][123090] Updated weights for policy 1, policy_version 496109 (0.0009) [2023-12-26 03:34:29,633][123090] Updated weights for policy 1, policy_version 496119 (0.0009) [2023-12-26 03:34:29,799][123091] Updated weights for policy 0, policy_version 499538 (0.0009) [2023-12-26 03:34:29,867][123091] Updated weights for policy 0, policy_version 499548 (0.0010) [2023-12-26 03:34:29,940][123091] Updated weights for policy 0, policy_version 499558 (0.0010) [2023-12-26 03:34:30,012][123091] Updated weights for policy 0, policy_version 499568 (0.0009) [2023-12-26 03:34:30,390][123090] Updated weights for policy 1, policy_version 496129 (0.0009) [2023-12-26 03:34:30,462][123090] Updated weights for policy 1, policy_version 496139 (0.0009) [2023-12-26 03:34:30,523][123090] Updated weights for policy 1, policy_version 496149 (0.0009) [2023-12-26 03:34:30,576][123090] Updated weights for policy 1, policy_version 496159 (0.0009) [2023-12-26 03:34:30,825][123091] Updated weights for policy 0, policy_version 499578 (0.0009) [2023-12-26 03:34:30,878][123091] Updated weights for policy 0, policy_version 499588 (0.0009) [2023-12-26 03:34:30,931][123091] Updated weights for policy 0, policy_version 499598 (0.0010) [2023-12-26 03:34:31,383][123090] Updated weights for policy 1, policy_version 496169 (0.0009) [2023-12-26 03:34:31,443][123090] Updated weights for policy 1, policy_version 496179 (0.0009) [2023-12-26 03:34:31,495][123090] Updated weights for policy 1, policy_version 496189 (0.0009) [2023-12-26 03:34:31,836][123091] Updated weights for policy 0, policy_version 499608 (0.0006) [2023-12-26 03:34:31,898][123091] Updated weights for policy 0, policy_version 499618 (0.0005) [2023-12-26 03:34:31,947][123091] Updated weights for policy 0, policy_version 499628 (0.0005) [2023-12-26 03:34:32,352][123090] Updated weights for policy 1, policy_version 496199 (0.0010) [2023-12-26 03:34:32,415][123090] Updated weights for policy 1, policy_version 496209 (0.0010) [2023-12-26 03:34:32,466][123090] Updated weights for policy 1, policy_version 496219 (0.0009) [2023-12-26 03:34:32,643][123091] Updated weights for policy 0, policy_version 499638 (0.0009) [2023-12-26 03:34:32,700][123091] Updated weights for policy 0, policy_version 499648 (0.0010) [2023-12-26 03:34:32,756][123091] Updated weights for policy 0, policy_version 499658 (0.0005) [2023-12-26 03:34:33,357][123090] Updated weights for policy 1, policy_version 496229 (0.0008) [2023-12-26 03:34:33,420][123090] Updated weights for policy 1, policy_version 496239 (0.0009) [2023-12-26 03:34:33,441][123091] Updated weights for policy 0, policy_version 499668 (0.0005) [2023-12-26 03:34:33,476][123090] Updated weights for policy 1, policy_version 496249 (0.0008) [2023-12-26 03:34:33,502][123091] Updated weights for policy 0, policy_version 499678 (0.0006) [2023-12-26 03:34:33,552][123091] Updated weights for policy 0, policy_version 499688 (0.0009) [2023-12-26 03:34:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 254967808. Throughput: 0: 8852.3, 1: 8972.3. Samples: 254974528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:33,785][121949] Avg episode reward: [(0, '5879.588'), (1, '5289.567')] [2023-12-26 03:34:34,233][123090] Updated weights for policy 1, policy_version 496259 (0.0010) [2023-12-26 03:34:34,295][123090] Updated weights for policy 1, policy_version 496269 (0.0009) [2023-12-26 03:34:34,358][123090] Updated weights for policy 1, policy_version 496279 (0.0010) [2023-12-26 03:34:34,412][123091] Updated weights for policy 0, policy_version 499698 (0.0008) [2023-12-26 03:34:34,473][123091] Updated weights for policy 0, policy_version 499708 (0.0008) [2023-12-26 03:34:34,537][123091] Updated weights for policy 0, policy_version 499718 (0.0010) [2023-12-26 03:34:34,603][123091] Updated weights for policy 0, policy_version 499728 (0.0009) [2023-12-26 03:34:35,160][123090] Updated weights for policy 1, policy_version 496289 (0.0009) [2023-12-26 03:34:35,219][123090] Updated weights for policy 1, policy_version 496299 (0.0009) [2023-12-26 03:34:35,275][123090] Updated weights for policy 1, policy_version 496309 (0.0009) [2023-12-26 03:34:35,339][123090] Updated weights for policy 1, policy_version 496319 (0.0009) [2023-12-26 03:34:35,442][123091] Updated weights for policy 0, policy_version 499738 (0.0009) [2023-12-26 03:34:35,512][123091] Updated weights for policy 0, policy_version 499748 (0.0010) [2023-12-26 03:34:35,585][123091] Updated weights for policy 0, policy_version 499758 (0.0011) [2023-12-26 03:34:36,091][123090] Updated weights for policy 1, policy_version 496329 (0.0008) [2023-12-26 03:34:36,175][123090] Updated weights for policy 1, policy_version 496339 (0.0007) [2023-12-26 03:34:36,247][123090] Updated weights for policy 1, policy_version 496349 (0.0006) [2023-12-26 03:34:36,333][123091] Updated weights for policy 0, policy_version 499768 (0.0009) [2023-12-26 03:34:36,400][123091] Updated weights for policy 0, policy_version 499778 (0.0008) [2023-12-26 03:34:36,462][123091] Updated weights for policy 0, policy_version 499788 (0.0010) [2023-12-26 03:34:36,998][123090] Updated weights for policy 1, policy_version 496359 (0.0010) [2023-12-26 03:34:37,054][123090] Updated weights for policy 1, policy_version 496369 (0.0010) [2023-12-26 03:34:37,128][123090] Updated weights for policy 1, policy_version 496379 (0.0010) [2023-12-26 03:34:37,350][123091] Updated weights for policy 0, policy_version 499798 (0.0010) [2023-12-26 03:34:37,409][123091] Updated weights for policy 0, policy_version 499808 (0.0010) [2023-12-26 03:34:37,469][123091] Updated weights for policy 0, policy_version 499818 (0.0010) [2023-12-26 03:34:37,852][123090] Updated weights for policy 1, policy_version 496389 (0.0008) [2023-12-26 03:34:37,908][123090] Updated weights for policy 1, policy_version 496399 (0.0007) [2023-12-26 03:34:37,956][123090] Updated weights for policy 1, policy_version 496409 (0.0008) [2023-12-26 03:34:38,376][123091] Updated weights for policy 0, policy_version 499828 (0.0011) [2023-12-26 03:34:38,440][123091] Updated weights for policy 0, policy_version 499838 (0.0011) [2023-12-26 03:34:38,499][123091] Updated weights for policy 0, policy_version 499848 (0.0011) [2023-12-26 03:34:38,780][123090] Updated weights for policy 1, policy_version 496419 (0.0007) [2023-12-26 03:34:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 255049728. Throughput: 0: 8826.1, 1: 9020.9. Samples: 255027576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:38,785][121949] Avg episode reward: [(0, '5951.910'), (1, '5361.419')] [2023-12-26 03:34:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000499856_127967232.pth... [2023-12-26 03:34:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000498832_127705088.pth [2023-12-26 03:34:38,836][123090] Updated weights for policy 1, policy_version 496429 (0.0010) [2023-12-26 03:34:38,889][123090] Updated weights for policy 1, policy_version 496439 (0.0011) [2023-12-26 03:34:38,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000496448_127090688.pth... [2023-12-26 03:34:38,940][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000495392_126820352.pth [2023-12-26 03:34:39,343][123091] Updated weights for policy 0, policy_version 499858 (0.0011) [2023-12-26 03:34:39,411][123091] Updated weights for policy 0, policy_version 499868 (0.0009) [2023-12-26 03:34:39,484][123091] Updated weights for policy 0, policy_version 499878 (0.0006) [2023-12-26 03:34:39,551][123091] Updated weights for policy 0, policy_version 499888 (0.0006) [2023-12-26 03:34:39,733][123090] Updated weights for policy 1, policy_version 496449 (0.0010) [2023-12-26 03:34:39,808][123090] Updated weights for policy 1, policy_version 496459 (0.0011) [2023-12-26 03:34:39,876][123090] Updated weights for policy 1, policy_version 496469 (0.0013) [2023-12-26 03:34:39,944][123090] Updated weights for policy 1, policy_version 496479 (0.0011) [2023-12-26 03:34:40,307][123091] Updated weights for policy 0, policy_version 499898 (0.0011) [2023-12-26 03:34:40,369][123091] Updated weights for policy 0, policy_version 499908 (0.0008) [2023-12-26 03:34:40,426][123091] Updated weights for policy 0, policy_version 499918 (0.0005) [2023-12-26 03:34:40,757][123090] Updated weights for policy 1, policy_version 496489 (0.0011) [2023-12-26 03:34:40,813][123090] Updated weights for policy 1, policy_version 496499 (0.0010) [2023-12-26 03:34:40,861][123090] Updated weights for policy 1, policy_version 496509 (0.0010) [2023-12-26 03:34:41,117][123091] Updated weights for policy 0, policy_version 499928 (0.0009) [2023-12-26 03:34:41,180][123091] Updated weights for policy 0, policy_version 499938 (0.0008) [2023-12-26 03:34:41,246][123091] Updated weights for policy 0, policy_version 499948 (0.0006) [2023-12-26 03:34:41,796][123090] Updated weights for policy 1, policy_version 496519 (0.0010) [2023-12-26 03:34:41,867][123090] Updated weights for policy 1, policy_version 496529 (0.0011) [2023-12-26 03:34:41,919][123090] Updated weights for policy 1, policy_version 496539 (0.0010) [2023-12-26 03:34:42,007][123091] Updated weights for policy 0, policy_version 499958 (0.0009) [2023-12-26 03:34:42,072][123091] Updated weights for policy 0, policy_version 499968 (0.0009) [2023-12-26 03:34:42,141][123091] Updated weights for policy 0, policy_version 499978 (0.0009) [2023-12-26 03:34:42,758][123090] Updated weights for policy 1, policy_version 496549 (0.0010) [2023-12-26 03:34:42,807][123090] Updated weights for policy 1, policy_version 496559 (0.0011) [2023-12-26 03:34:42,872][123090] Updated weights for policy 1, policy_version 496569 (0.0011) [2023-12-26 03:34:42,982][123091] Updated weights for policy 0, policy_version 499988 (0.0009) [2023-12-26 03:34:43,045][123091] Updated weights for policy 0, policy_version 499998 (0.0007) [2023-12-26 03:34:43,120][123091] Updated weights for policy 0, policy_version 500008 (0.0009) [2023-12-26 03:34:43,704][123090] Updated weights for policy 1, policy_version 496579 (0.0011) [2023-12-26 03:34:43,751][123090] Updated weights for policy 1, policy_version 496589 (0.0010) [2023-12-26 03:34:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255131648. Throughput: 0: 8737.9, 1: 9028.4. Samples: 255131112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:43,785][121949] Avg episode reward: [(0, '5994.561'), (1, '5228.852')] [2023-12-26 03:34:43,803][123090] Updated weights for policy 1, policy_version 496599 (0.0010) [2023-12-26 03:34:43,880][123091] Updated weights for policy 0, policy_version 500018 (0.0010) [2023-12-26 03:34:43,942][123091] Updated weights for policy 0, policy_version 500028 (0.0005) [2023-12-26 03:34:44,011][123091] Updated weights for policy 0, policy_version 500038 (0.0005) [2023-12-26 03:34:44,073][123091] Updated weights for policy 0, policy_version 500048 (0.0005) [2023-12-26 03:34:44,659][123090] Updated weights for policy 1, policy_version 496609 (0.0010) [2023-12-26 03:34:44,708][123090] Updated weights for policy 1, policy_version 496619 (0.0010) [2023-12-26 03:34:44,730][123091] Updated weights for policy 0, policy_version 500058 (0.0011) [2023-12-26 03:34:44,771][123090] Updated weights for policy 1, policy_version 496629 (0.0011) [2023-12-26 03:34:44,792][123091] Updated weights for policy 0, policy_version 500068 (0.0010) [2023-12-26 03:34:44,835][123090] Updated weights for policy 1, policy_version 496639 (0.0011) [2023-12-26 03:34:44,855][123091] Updated weights for policy 0, policy_version 500078 (0.0011) [2023-12-26 03:34:45,595][123090] Updated weights for policy 1, policy_version 496649 (0.0011) [2023-12-26 03:34:45,654][123091] Updated weights for policy 0, policy_version 500088 (0.0011) [2023-12-26 03:34:45,655][123090] Updated weights for policy 1, policy_version 496659 (0.0010) [2023-12-26 03:34:45,710][123091] Updated weights for policy 0, policy_version 500098 (0.0011) [2023-12-26 03:34:45,723][123090] Updated weights for policy 1, policy_version 496669 (0.0011) [2023-12-26 03:34:45,758][123091] Updated weights for policy 0, policy_version 500108 (0.0010) [2023-12-26 03:34:46,508][123091] Updated weights for policy 0, policy_version 500118 (0.0007) [2023-12-26 03:34:46,516][123090] Updated weights for policy 1, policy_version 496679 (0.0007) [2023-12-26 03:34:46,568][123091] Updated weights for policy 0, policy_version 500128 (0.0005) [2023-12-26 03:34:46,580][123090] Updated weights for policy 1, policy_version 496689 (0.0007) [2023-12-26 03:34:46,639][123091] Updated weights for policy 0, policy_version 500138 (0.0005) [2023-12-26 03:34:46,644][123090] Updated weights for policy 1, policy_version 496699 (0.0006) [2023-12-26 03:34:47,318][123090] Updated weights for policy 1, policy_version 496709 (0.0009) [2023-12-26 03:34:47,347][123091] Updated weights for policy 0, policy_version 500148 (0.0006) [2023-12-26 03:34:47,383][123090] Updated weights for policy 1, policy_version 496719 (0.0008) [2023-12-26 03:34:47,416][123091] Updated weights for policy 0, policy_version 500158 (0.0006) [2023-12-26 03:34:47,439][123090] Updated weights for policy 1, policy_version 496729 (0.0008) [2023-12-26 03:34:47,467][123091] Updated weights for policy 0, policy_version 500168 (0.0007) [2023-12-26 03:34:48,056][123090] Updated weights for policy 1, policy_version 496739 (0.0005) [2023-12-26 03:34:48,121][123090] Updated weights for policy 1, policy_version 496749 (0.0009) [2023-12-26 03:34:48,186][123090] Updated weights for policy 1, policy_version 496759 (0.0005) [2023-12-26 03:34:48,246][123091] Updated weights for policy 0, policy_version 500178 (0.0009) [2023-12-26 03:34:48,302][123091] Updated weights for policy 0, policy_version 500188 (0.0009) [2023-12-26 03:34:48,359][123091] Updated weights for policy 0, policy_version 500198 (0.0009) [2023-12-26 03:34:48,420][123091] Updated weights for policy 0, policy_version 500208 (0.0010) [2023-12-26 03:34:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17605.9). Total num frames: 255229952. Throughput: 0: 8820.4, 1: 9003.5. Samples: 255241576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:48,785][121949] Avg episode reward: [(0, '6077.745'), (1, '5407.230')] [2023-12-26 03:34:48,976][123090] Updated weights for policy 1, policy_version 496769 (0.0006) [2023-12-26 03:34:49,034][123090] Updated weights for policy 1, policy_version 496779 (0.0010) [2023-12-26 03:34:49,087][123090] Updated weights for policy 1, policy_version 496789 (0.0009) [2023-12-26 03:34:49,141][123090] Updated weights for policy 1, policy_version 496799 (0.0010) [2023-12-26 03:34:49,241][123091] Updated weights for policy 0, policy_version 500218 (0.0008) [2023-12-26 03:34:49,305][123091] Updated weights for policy 0, policy_version 500228 (0.0011) [2023-12-26 03:34:49,368][123091] Updated weights for policy 0, policy_version 500238 (0.0011) [2023-12-26 03:34:49,978][123090] Updated weights for policy 1, policy_version 496809 (0.0006) [2023-12-26 03:34:50,030][123090] Updated weights for policy 1, policy_version 496819 (0.0007) [2023-12-26 03:34:50,089][123090] Updated weights for policy 1, policy_version 496829 (0.0005) [2023-12-26 03:34:50,156][123091] Updated weights for policy 0, policy_version 500248 (0.0008) [2023-12-26 03:34:50,212][123091] Updated weights for policy 0, policy_version 500258 (0.0006) [2023-12-26 03:34:50,270][123091] Updated weights for policy 0, policy_version 500268 (0.0009) [2023-12-26 03:34:50,947][123091] Updated weights for policy 0, policy_version 500278 (0.0008) [2023-12-26 03:34:50,967][123090] Updated weights for policy 1, policy_version 496839 (0.0006) [2023-12-26 03:34:51,009][123091] Updated weights for policy 0, policy_version 500288 (0.0006) [2023-12-26 03:34:51,030][123090] Updated weights for policy 1, policy_version 496849 (0.0007) [2023-12-26 03:34:51,080][123091] Updated weights for policy 0, policy_version 500298 (0.0008) [2023-12-26 03:34:51,104][123090] Updated weights for policy 1, policy_version 496859 (0.0007) [2023-12-26 03:34:51,793][123091] Updated weights for policy 0, policy_version 500308 (0.0007) [2023-12-26 03:34:51,855][123091] Updated weights for policy 0, policy_version 500318 (0.0008) [2023-12-26 03:34:51,908][123091] Updated weights for policy 0, policy_version 500328 (0.0005) [2023-12-26 03:34:51,963][123090] Updated weights for policy 1, policy_version 496869 (0.0008) [2023-12-26 03:34:52,015][123090] Updated weights for policy 1, policy_version 496879 (0.0009) [2023-12-26 03:34:52,083][123090] Updated weights for policy 1, policy_version 496889 (0.0009) [2023-12-26 03:34:52,686][123091] Updated weights for policy 0, policy_version 500338 (0.0006) [2023-12-26 03:34:52,755][123091] Updated weights for policy 0, policy_version 500348 (0.0005) [2023-12-26 03:34:52,819][123091] Updated weights for policy 0, policy_version 500358 (0.0006) [2023-12-26 03:34:52,821][123090] Updated weights for policy 1, policy_version 496899 (0.0007) [2023-12-26 03:34:52,886][123090] Updated weights for policy 1, policy_version 496909 (0.0007) [2023-12-26 03:34:52,888][123091] Updated weights for policy 0, policy_version 500368 (0.0007) [2023-12-26 03:34:52,944][123090] Updated weights for policy 1, policy_version 496919 (0.0010) [2023-12-26 03:34:53,631][123090] Updated weights for policy 1, policy_version 496929 (0.0009) [2023-12-26 03:34:53,682][123090] Updated weights for policy 1, policy_version 496939 (0.0008) [2023-12-26 03:34:53,695][123091] Updated weights for policy 0, policy_version 500378 (0.0008) [2023-12-26 03:34:53,733][123090] Updated weights for policy 1, policy_version 496949 (0.0009) [2023-12-26 03:34:53,755][123091] Updated weights for policy 0, policy_version 500388 (0.0008) [2023-12-26 03:34:53,783][123090] Updated weights for policy 1, policy_version 496959 (0.0007) [2023-12-26 03:34:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 255311872. Throughput: 0: 8877.7, 1: 8934.9. Samples: 255294672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:53,784][121949] Avg episode reward: [(0, '6115.644'), (1, '4950.987')] [2023-12-26 03:34:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000496960_127221760.pth... [2023-12-26 03:34:53,791][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000495904_126951424.pth [2023-12-26 03:34:53,814][123091] Updated weights for policy 0, policy_version 500398 (0.0009) [2023-12-26 03:34:53,822][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000500400_128106496.pth... [2023-12-26 03:34:53,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000499344_127836160.pth [2023-12-26 03:34:54,560][123090] Updated weights for policy 1, policy_version 496969 (0.0008) [2023-12-26 03:34:54,612][123090] Updated weights for policy 1, policy_version 496979 (0.0006) [2023-12-26 03:34:54,634][123091] Updated weights for policy 0, policy_version 500408 (0.0009) [2023-12-26 03:34:54,676][123090] Updated weights for policy 1, policy_version 496989 (0.0005) [2023-12-26 03:34:54,695][123091] Updated weights for policy 0, policy_version 500418 (0.0008) [2023-12-26 03:34:54,749][123091] Updated weights for policy 0, policy_version 500428 (0.0009) [2023-12-26 03:34:55,353][123090] Updated weights for policy 1, policy_version 496999 (0.0008) [2023-12-26 03:34:55,400][123090] Updated weights for policy 1, policy_version 497009 (0.0008) [2023-12-26 03:34:55,448][123090] Updated weights for policy 1, policy_version 497019 (0.0008) [2023-12-26 03:34:55,621][123091] Updated weights for policy 0, policy_version 500438 (0.0009) [2023-12-26 03:34:55,673][123091] Updated weights for policy 0, policy_version 500448 (0.0010) [2023-12-26 03:34:55,723][123091] Updated weights for policy 0, policy_version 500458 (0.0010) [2023-12-26 03:34:56,237][123090] Updated weights for policy 1, policy_version 497029 (0.0009) [2023-12-26 03:34:56,295][123090] Updated weights for policy 1, policy_version 497039 (0.0006) [2023-12-26 03:34:56,361][123090] Updated weights for policy 1, policy_version 497049 (0.0007) [2023-12-26 03:34:56,551][123091] Updated weights for policy 0, policy_version 500468 (0.0010) [2023-12-26 03:34:56,611][123091] Updated weights for policy 0, policy_version 500478 (0.0008) [2023-12-26 03:34:56,659][123091] Updated weights for policy 0, policy_version 500488 (0.0009) [2023-12-26 03:34:57,123][123090] Updated weights for policy 1, policy_version 497059 (0.0005) [2023-12-26 03:34:57,192][123090] Updated weights for policy 1, policy_version 497069 (0.0007) [2023-12-26 03:34:57,260][123090] Updated weights for policy 1, policy_version 497079 (0.0005) [2023-12-26 03:34:57,386][123091] Updated weights for policy 0, policy_version 500499 (0.0008) [2023-12-26 03:34:57,432][123091] Updated weights for policy 0, policy_version 500509 (0.0005) [2023-12-26 03:34:57,484][123091] Updated weights for policy 0, policy_version 500519 (0.0005) [2023-12-26 03:34:57,948][123090] Updated weights for policy 1, policy_version 497089 (0.0007) [2023-12-26 03:34:58,034][123090] Updated weights for policy 1, policy_version 497099 (0.0007) [2023-12-26 03:34:58,104][123090] Updated weights for policy 1, policy_version 497109 (0.0008) [2023-12-26 03:34:58,161][123091] Updated weights for policy 0, policy_version 500529 (0.0006) [2023-12-26 03:34:58,168][123090] Updated weights for policy 1, policy_version 497119 (0.0010) [2023-12-26 03:34:58,216][123091] Updated weights for policy 0, policy_version 500539 (0.0008) [2023-12-26 03:34:58,277][123091] Updated weights for policy 0, policy_version 500549 (0.0009) [2023-12-26 03:34:58,341][123091] Updated weights for policy 0, policy_version 500559 (0.0009) [2023-12-26 03:34:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 255410176. Throughput: 0: 8885.2, 1: 8948.7. Samples: 255404832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:34:58,785][121949] Avg episode reward: [(0, '5916.915'), (1, '4768.369')] [2023-12-26 03:34:58,988][123090] Updated weights for policy 1, policy_version 497129 (0.0008) [2023-12-26 03:34:59,040][123090] Updated weights for policy 1, policy_version 497139 (0.0007) [2023-12-26 03:34:59,096][123090] Updated weights for policy 1, policy_version 497149 (0.0007) [2023-12-26 03:34:59,318][123091] Updated weights for policy 0, policy_version 500569 (0.0009) [2023-12-26 03:34:59,381][123091] Updated weights for policy 0, policy_version 500579 (0.0008) [2023-12-26 03:34:59,438][123091] Updated weights for policy 0, policy_version 500589 (0.0006) [2023-12-26 03:34:59,961][123090] Updated weights for policy 1, policy_version 497159 (0.0009) [2023-12-26 03:35:00,025][123090] Updated weights for policy 1, policy_version 497169 (0.0009) [2023-12-26 03:35:00,092][123090] Updated weights for policy 1, policy_version 497180 (0.0010) [2023-12-26 03:35:00,173][123091] Updated weights for policy 0, policy_version 500599 (0.0008) [2023-12-26 03:35:00,233][123091] Updated weights for policy 0, policy_version 500609 (0.0009) [2023-12-26 03:35:00,285][123091] Updated weights for policy 0, policy_version 500620 (0.0010) [2023-12-26 03:35:00,887][123090] Updated weights for policy 1, policy_version 497190 (0.0010) [2023-12-26 03:35:00,945][123090] Updated weights for policy 1, policy_version 497200 (0.0010) [2023-12-26 03:35:00,995][123090] Updated weights for policy 1, policy_version 497210 (0.0010) [2023-12-26 03:35:01,068][123091] Updated weights for policy 0, policy_version 500630 (0.0009) [2023-12-26 03:35:01,133][123091] Updated weights for policy 0, policy_version 500640 (0.0009) [2023-12-26 03:35:01,193][123091] Updated weights for policy 0, policy_version 500650 (0.0009) [2023-12-26 03:35:01,837][123090] Updated weights for policy 1, policy_version 497220 (0.0010) [2023-12-26 03:35:01,903][123090] Updated weights for policy 1, policy_version 497230 (0.0010) [2023-12-26 03:35:01,956][123090] Updated weights for policy 1, policy_version 497240 (0.0010) [2023-12-26 03:35:02,031][123091] Updated weights for policy 0, policy_version 500660 (0.0009) [2023-12-26 03:35:02,080][123091] Updated weights for policy 0, policy_version 500670 (0.0009) [2023-12-26 03:35:02,139][123091] Updated weights for policy 0, policy_version 500680 (0.0008) [2023-12-26 03:35:02,784][123090] Updated weights for policy 1, policy_version 497250 (0.0010) [2023-12-26 03:35:02,831][123090] Updated weights for policy 1, policy_version 497260 (0.0010) [2023-12-26 03:35:02,887][123090] Updated weights for policy 1, policy_version 497270 (0.0010) [2023-12-26 03:35:02,941][123090] Updated weights for policy 1, policy_version 497280 (0.0010) [2023-12-26 03:35:02,983][123091] Updated weights for policy 0, policy_version 500690 (0.0009) [2023-12-26 03:35:03,040][123091] Updated weights for policy 0, policy_version 500700 (0.0009) [2023-12-26 03:35:03,091][123091] Updated weights for policy 0, policy_version 500710 (0.0008) [2023-12-26 03:35:03,142][123091] Updated weights for policy 0, policy_version 500720 (0.0008) [2023-12-26 03:35:03,760][123090] Updated weights for policy 1, policy_version 497290 (0.0010) [2023-12-26 03:35:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 255492096. Throughput: 0: 8891.6, 1: 8853.9. Samples: 255507964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:03,785][121949] Avg episode reward: [(0, '5897.672'), (1, '5038.788')] [2023-12-26 03:35:03,822][123090] Updated weights for policy 1, policy_version 497300 (0.0010) [2023-12-26 03:35:03,881][123090] Updated weights for policy 1, policy_version 497310 (0.0010) [2023-12-26 03:35:03,993][123091] Updated weights for policy 0, policy_version 500730 (0.0010) [2023-12-26 03:35:04,044][123091] Updated weights for policy 0, policy_version 500740 (0.0009) [2023-12-26 03:35:04,113][123091] Updated weights for policy 0, policy_version 500750 (0.0009) [2023-12-26 03:35:04,730][123090] Updated weights for policy 1, policy_version 497320 (0.0010) [2023-12-26 03:35:04,793][123090] Updated weights for policy 1, policy_version 497330 (0.0010) [2023-12-26 03:35:04,840][123090] Updated weights for policy 1, policy_version 497340 (0.0010) [2023-12-26 03:35:04,922][123091] Updated weights for policy 0, policy_version 500760 (0.0006) [2023-12-26 03:35:04,984][123091] Updated weights for policy 0, policy_version 500770 (0.0006) [2023-12-26 03:35:05,062][123091] Updated weights for policy 0, policy_version 500780 (0.0006) [2023-12-26 03:35:05,566][123090] Updated weights for policy 1, policy_version 497350 (0.0007) [2023-12-26 03:35:05,637][123090] Updated weights for policy 1, policy_version 497360 (0.0005) [2023-12-26 03:35:05,704][123090] Updated weights for policy 1, policy_version 497370 (0.0005) [2023-12-26 03:35:05,773][123091] Updated weights for policy 0, policy_version 500790 (0.0009) [2023-12-26 03:35:05,840][123091] Updated weights for policy 0, policy_version 500800 (0.0011) [2023-12-26 03:35:05,899][123091] Updated weights for policy 0, policy_version 500810 (0.0010) [2023-12-26 03:35:06,468][123090] Updated weights for policy 1, policy_version 497380 (0.0007) [2023-12-26 03:35:06,535][123090] Updated weights for policy 1, policy_version 497390 (0.0008) [2023-12-26 03:35:06,603][123091] Updated weights for policy 0, policy_version 500820 (0.0007) [2023-12-26 03:35:06,605][123090] Updated weights for policy 1, policy_version 497400 (0.0008) [2023-12-26 03:35:06,658][123091] Updated weights for policy 0, policy_version 500830 (0.0011) [2023-12-26 03:35:06,709][123091] Updated weights for policy 0, policy_version 500840 (0.0010) [2023-12-26 03:35:07,393][123090] Updated weights for policy 1, policy_version 497410 (0.0010) [2023-12-26 03:35:07,458][123090] Updated weights for policy 1, policy_version 497420 (0.0009) [2023-12-26 03:35:07,520][123090] Updated weights for policy 1, policy_version 497430 (0.0008) [2023-12-26 03:35:07,562][123091] Updated weights for policy 0, policy_version 500850 (0.0011) [2023-12-26 03:35:07,589][123090] Updated weights for policy 1, policy_version 497440 (0.0006) [2023-12-26 03:35:07,631][123091] Updated weights for policy 0, policy_version 500860 (0.0011) [2023-12-26 03:35:07,681][123091] Updated weights for policy 0, policy_version 500870 (0.0010) [2023-12-26 03:35:07,735][123091] Updated weights for policy 0, policy_version 500880 (0.0010) [2023-12-26 03:35:08,372][123090] Updated weights for policy 1, policy_version 497450 (0.0009) [2023-12-26 03:35:08,421][123090] Updated weights for policy 1, policy_version 497460 (0.0009) [2023-12-26 03:35:08,477][123090] Updated weights for policy 1, policy_version 497470 (0.0009) [2023-12-26 03:35:08,547][123091] Updated weights for policy 0, policy_version 500890 (0.0011) [2023-12-26 03:35:08,618][123091] Updated weights for policy 0, policy_version 500900 (0.0011) [2023-12-26 03:35:08,673][123091] Updated weights for policy 0, policy_version 500910 (0.0010) [2023-12-26 03:35:08,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 255590400. Throughput: 0: 8938.6, 1: 8890.5. Samples: 255563040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:08,786][121949] Avg episode reward: [(0, '5989.574'), (1, '5068.026')] [2023-12-26 03:35:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000500912_128237568.pth... [2023-12-26 03:35:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000497472_127352832.pth... [2023-12-26 03:35:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000499856_127967232.pth [2023-12-26 03:35:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000496448_127090688.pth [2023-12-26 03:35:09,372][123090] Updated weights for policy 1, policy_version 497480 (0.0009) [2023-12-26 03:35:09,443][123090] Updated weights for policy 1, policy_version 497490 (0.0008) [2023-12-26 03:35:09,511][123090] Updated weights for policy 1, policy_version 497500 (0.0008) [2023-12-26 03:35:09,528][123091] Updated weights for policy 0, policy_version 500920 (0.0009) [2023-12-26 03:35:09,588][123091] Updated weights for policy 0, policy_version 500930 (0.0008) [2023-12-26 03:35:09,647][123091] Updated weights for policy 0, policy_version 500940 (0.0011) [2023-12-26 03:35:10,298][123090] Updated weights for policy 1, policy_version 497510 (0.0009) [2023-12-26 03:35:10,368][123090] Updated weights for policy 1, policy_version 497520 (0.0009) [2023-12-26 03:35:10,426][123090] Updated weights for policy 1, policy_version 497530 (0.0009) [2023-12-26 03:35:10,473][123091] Updated weights for policy 0, policy_version 500950 (0.0011) [2023-12-26 03:35:10,527][123091] Updated weights for policy 0, policy_version 500960 (0.0010) [2023-12-26 03:35:10,585][123091] Updated weights for policy 0, policy_version 500970 (0.0010) [2023-12-26 03:35:11,295][123090] Updated weights for policy 1, policy_version 497540 (0.0008) [2023-12-26 03:35:11,368][123091] Updated weights for policy 0, policy_version 500980 (0.0010) [2023-12-26 03:35:11,370][123090] Updated weights for policy 1, policy_version 497550 (0.0009) [2023-12-26 03:35:11,431][123091] Updated weights for policy 0, policy_version 500990 (0.0010) [2023-12-26 03:35:11,435][123090] Updated weights for policy 1, policy_version 497560 (0.0009) [2023-12-26 03:35:11,493][123091] Updated weights for policy 0, policy_version 501000 (0.0011) [2023-12-26 03:35:12,262][123091] Updated weights for policy 0, policy_version 501010 (0.0010) [2023-12-26 03:35:12,314][123090] Updated weights for policy 1, policy_version 497570 (0.0007) [2023-12-26 03:35:12,326][123091] Updated weights for policy 0, policy_version 501020 (0.0008) [2023-12-26 03:35:12,385][123090] Updated weights for policy 1, policy_version 497580 (0.0009) [2023-12-26 03:35:12,397][123091] Updated weights for policy 0, policy_version 501030 (0.0008) [2023-12-26 03:35:12,460][123090] Updated weights for policy 1, policy_version 497590 (0.0007) [2023-12-26 03:35:12,468][123091] Updated weights for policy 0, policy_version 501040 (0.0008) [2023-12-26 03:35:12,536][123090] Updated weights for policy 1, policy_version 497600 (0.0006) [2023-12-26 03:35:13,227][123091] Updated weights for policy 0, policy_version 501050 (0.0005) [2023-12-26 03:35:13,235][123090] Updated weights for policy 1, policy_version 497610 (0.0006) [2023-12-26 03:35:13,287][123091] Updated weights for policy 0, policy_version 501060 (0.0005) [2023-12-26 03:35:13,294][123090] Updated weights for policy 1, policy_version 497620 (0.0006) [2023-12-26 03:35:13,340][123090] Updated weights for policy 1, policy_version 497630 (0.0007) [2023-12-26 03:35:13,341][123091] Updated weights for policy 0, policy_version 501070 (0.0005) [2023-12-26 03:35:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 255672320. Throughput: 0: 8898.2, 1: 8818.6. Samples: 255665036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:13,785][121949] Avg episode reward: [(0, '5752.968'), (1, '5179.514')] [2023-12-26 03:35:13,982][123091] Updated weights for policy 0, policy_version 501080 (0.0010) [2023-12-26 03:35:14,002][123090] Updated weights for policy 1, policy_version 497640 (0.0005) [2023-12-26 03:35:14,030][123091] Updated weights for policy 0, policy_version 501090 (0.0010) [2023-12-26 03:35:14,065][123090] Updated weights for policy 1, policy_version 497650 (0.0009) [2023-12-26 03:35:14,076][123091] Updated weights for policy 0, policy_version 501100 (0.0005) [2023-12-26 03:35:14,129][123090] Updated weights for policy 1, policy_version 497660 (0.0006) [2023-12-26 03:35:14,706][123091] Updated weights for policy 0, policy_version 501110 (0.0009) [2023-12-26 03:35:14,783][123091] Updated weights for policy 0, policy_version 501120 (0.0009) [2023-12-26 03:35:14,849][123091] Updated weights for policy 0, policy_version 501130 (0.0008) [2023-12-26 03:35:14,854][123090] Updated weights for policy 1, policy_version 497670 (0.0007) [2023-12-26 03:35:14,920][123090] Updated weights for policy 1, policy_version 497680 (0.0008) [2023-12-26 03:35:14,978][123090] Updated weights for policy 1, policy_version 497690 (0.0008) [2023-12-26 03:35:15,670][123091] Updated weights for policy 0, policy_version 501140 (0.0009) [2023-12-26 03:35:15,725][123091] Updated weights for policy 0, policy_version 501150 (0.0010) [2023-12-26 03:35:15,781][123091] Updated weights for policy 0, policy_version 501160 (0.0010) [2023-12-26 03:35:15,812][123090] Updated weights for policy 1, policy_version 497700 (0.0009) [2023-12-26 03:35:15,883][123090] Updated weights for policy 1, policy_version 497710 (0.0009) [2023-12-26 03:35:15,936][123090] Updated weights for policy 1, policy_version 497720 (0.0009) [2023-12-26 03:35:16,605][123091] Updated weights for policy 0, policy_version 501170 (0.0010) [2023-12-26 03:35:16,675][123091] Updated weights for policy 0, policy_version 501180 (0.0011) [2023-12-26 03:35:16,730][123091] Updated weights for policy 0, policy_version 501190 (0.0010) [2023-12-26 03:35:16,763][123090] Updated weights for policy 1, policy_version 497730 (0.0008) [2023-12-26 03:35:16,781][123091] Updated weights for policy 0, policy_version 501200 (0.0010) [2023-12-26 03:35:16,819][123090] Updated weights for policy 1, policy_version 497740 (0.0006) [2023-12-26 03:35:16,868][123090] Updated weights for policy 1, policy_version 497750 (0.0005) [2023-12-26 03:35:16,923][123090] Updated weights for policy 1, policy_version 497760 (0.0005) [2023-12-26 03:35:17,527][123091] Updated weights for policy 0, policy_version 501210 (0.0005) [2023-12-26 03:35:17,591][123091] Updated weights for policy 0, policy_version 501220 (0.0005) [2023-12-26 03:35:17,648][123091] Updated weights for policy 0, policy_version 501230 (0.0006) [2023-12-26 03:35:17,730][123090] Updated weights for policy 1, policy_version 497770 (0.0008) [2023-12-26 03:35:17,795][123090] Updated weights for policy 1, policy_version 497780 (0.0009) [2023-12-26 03:35:17,855][123090] Updated weights for policy 1, policy_version 497790 (0.0009) [2023-12-26 03:35:18,359][123091] Updated weights for policy 0, policy_version 501240 (0.0011) [2023-12-26 03:35:18,426][123091] Updated weights for policy 0, policy_version 501250 (0.0011) [2023-12-26 03:35:18,493][123091] Updated weights for policy 0, policy_version 501260 (0.0011) [2023-12-26 03:35:18,689][123090] Updated weights for policy 1, policy_version 497800 (0.0009) [2023-12-26 03:35:18,745][123090] Updated weights for policy 1, policy_version 497810 (0.0009) [2023-12-26 03:35:18,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 255762432. Throughput: 0: 8941.3, 1: 8877.0. Samples: 255776348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:18,785][121949] Avg episode reward: [(0, '5835.152'), (1, '5261.708')] [2023-12-26 03:35:18,801][123090] Updated weights for policy 1, policy_version 497820 (0.0009) [2023-12-26 03:35:19,302][123091] Updated weights for policy 0, policy_version 501270 (0.0011) [2023-12-26 03:35:19,365][123091] Updated weights for policy 0, policy_version 501280 (0.0010) [2023-12-26 03:35:19,430][123091] Updated weights for policy 0, policy_version 501290 (0.0010) [2023-12-26 03:35:19,635][123090] Updated weights for policy 1, policy_version 497830 (0.0009) [2023-12-26 03:35:19,700][123090] Updated weights for policy 1, policy_version 497840 (0.0009) [2023-12-26 03:35:19,774][123090] Updated weights for policy 1, policy_version 497850 (0.0009) [2023-12-26 03:35:20,244][123091] Updated weights for policy 0, policy_version 501300 (0.0007) [2023-12-26 03:35:20,315][123091] Updated weights for policy 0, policy_version 501310 (0.0006) [2023-12-26 03:35:20,378][123091] Updated weights for policy 0, policy_version 501320 (0.0009) [2023-12-26 03:35:20,517][123090] Updated weights for policy 1, policy_version 497860 (0.0007) [2023-12-26 03:35:20,597][123090] Updated weights for policy 1, policy_version 497870 (0.0007) [2023-12-26 03:35:20,659][123090] Updated weights for policy 1, policy_version 497880 (0.0010) [2023-12-26 03:35:21,229][123091] Updated weights for policy 0, policy_version 501330 (0.0010) [2023-12-26 03:35:21,298][123091] Updated weights for policy 0, policy_version 501340 (0.0010) [2023-12-26 03:35:21,371][123091] Updated weights for policy 0, policy_version 501350 (0.0008) [2023-12-26 03:35:21,429][123091] Updated weights for policy 0, policy_version 501360 (0.0006) [2023-12-26 03:35:21,501][123090] Updated weights for policy 1, policy_version 497890 (0.0010) [2023-12-26 03:35:21,559][123090] Updated weights for policy 1, policy_version 497900 (0.0010) [2023-12-26 03:35:21,620][123090] Updated weights for policy 1, policy_version 497910 (0.0008) [2023-12-26 03:35:21,693][123090] Updated weights for policy 1, policy_version 497920 (0.0009) [2023-12-26 03:35:22,251][123091] Updated weights for policy 0, policy_version 501370 (0.0010) [2023-12-26 03:35:22,314][123091] Updated weights for policy 0, policy_version 501380 (0.0010) [2023-12-26 03:35:22,378][123091] Updated weights for policy 0, policy_version 501390 (0.0010) [2023-12-26 03:35:22,538][123090] Updated weights for policy 1, policy_version 497930 (0.0008) [2023-12-26 03:35:22,615][123090] Updated weights for policy 1, policy_version 497940 (0.0006) [2023-12-26 03:35:22,692][123090] Updated weights for policy 1, policy_version 497950 (0.0007) [2023-12-26 03:35:23,194][123091] Updated weights for policy 0, policy_version 501400 (0.0008) [2023-12-26 03:35:23,260][123091] Updated weights for policy 0, policy_version 501410 (0.0007) [2023-12-26 03:35:23,330][123091] Updated weights for policy 0, policy_version 501420 (0.0006) [2023-12-26 03:35:23,483][123090] Updated weights for policy 1, policy_version 497960 (0.0010) [2023-12-26 03:35:23,544][123090] Updated weights for policy 1, policy_version 497970 (0.0010) [2023-12-26 03:35:23,596][123090] Updated weights for policy 1, policy_version 497980 (0.0009) [2023-12-26 03:35:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 255852544. Throughput: 0: 8941.3, 1: 8830.1. Samples: 255827292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:23,785][121949] Avg episode reward: [(0, '5958.994'), (1, '4826.903')] [2023-12-26 03:35:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000497984_127483904.pth... [2023-12-26 03:35:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000501424_128368640.pth... [2023-12-26 03:35:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000496960_127221760.pth [2023-12-26 03:35:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000500400_128106496.pth [2023-12-26 03:35:23,900][123091] Updated weights for policy 0, policy_version 501430 (0.0006) [2023-12-26 03:35:23,946][123091] Updated weights for policy 0, policy_version 501440 (0.0005) [2023-12-26 03:35:24,009][123091] Updated weights for policy 0, policy_version 501450 (0.0007) [2023-12-26 03:35:24,432][123090] Updated weights for policy 1, policy_version 497990 (0.0007) [2023-12-26 03:35:24,481][123090] Updated weights for policy 1, policy_version 498000 (0.0005) [2023-12-26 03:35:24,547][123090] Updated weights for policy 1, policy_version 498010 (0.0006) [2023-12-26 03:35:24,770][123091] Updated weights for policy 0, policy_version 501460 (0.0008) [2023-12-26 03:35:24,823][123091] Updated weights for policy 0, policy_version 501470 (0.0005) [2023-12-26 03:35:24,870][123091] Updated weights for policy 0, policy_version 501480 (0.0005) [2023-12-26 03:35:25,229][123090] Updated weights for policy 1, policy_version 498020 (0.0005) [2023-12-26 03:35:25,301][123090] Updated weights for policy 1, policy_version 498030 (0.0007) [2023-12-26 03:35:25,373][123090] Updated weights for policy 1, policy_version 498040 (0.0008) [2023-12-26 03:35:25,570][123091] Updated weights for policy 0, policy_version 501490 (0.0005) [2023-12-26 03:35:25,637][123091] Updated weights for policy 0, policy_version 501500 (0.0005) [2023-12-26 03:35:25,704][123091] Updated weights for policy 0, policy_version 501510 (0.0005) [2023-12-26 03:35:25,776][123091] Updated weights for policy 0, policy_version 501520 (0.0005) [2023-12-26 03:35:26,031][123090] Updated weights for policy 1, policy_version 498050 (0.0005) [2023-12-26 03:35:26,080][123090] Updated weights for policy 1, policy_version 498060 (0.0005) [2023-12-26 03:35:26,128][123090] Updated weights for policy 1, policy_version 498070 (0.0005) [2023-12-26 03:35:26,184][123090] Updated weights for policy 1, policy_version 498080 (0.0005) [2023-12-26 03:35:26,355][123091] Updated weights for policy 0, policy_version 501530 (0.0006) [2023-12-26 03:35:26,408][123091] Updated weights for policy 0, policy_version 501540 (0.0010) [2023-12-26 03:35:26,460][123091] Updated weights for policy 0, policy_version 501550 (0.0007) [2023-12-26 03:35:26,863][123090] Updated weights for policy 1, policy_version 498090 (0.0006) [2023-12-26 03:35:26,922][123090] Updated weights for policy 1, policy_version 498100 (0.0005) [2023-12-26 03:35:26,979][123090] Updated weights for policy 1, policy_version 498110 (0.0009) [2023-12-26 03:35:27,109][123091] Updated weights for policy 0, policy_version 501560 (0.0008) [2023-12-26 03:35:27,174][123091] Updated weights for policy 0, policy_version 501570 (0.0009) [2023-12-26 03:35:27,224][123091] Updated weights for policy 0, policy_version 501580 (0.0007) [2023-12-26 03:35:27,820][123090] Updated weights for policy 1, policy_version 498120 (0.0010) [2023-12-26 03:35:27,868][123090] Updated weights for policy 1, policy_version 498130 (0.0010) [2023-12-26 03:35:27,919][123090] Updated weights for policy 1, policy_version 498140 (0.0010) [2023-12-26 03:35:27,961][123091] Updated weights for policy 0, policy_version 501590 (0.0008) [2023-12-26 03:35:28,010][123091] Updated weights for policy 0, policy_version 501600 (0.0009) [2023-12-26 03:35:28,066][123091] Updated weights for policy 0, policy_version 501610 (0.0009) [2023-12-26 03:35:28,698][123090] Updated weights for policy 1, policy_version 498150 (0.0007) [2023-12-26 03:35:28,751][123090] Updated weights for policy 1, policy_version 498160 (0.0005) [2023-12-26 03:35:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 255942656. Throughput: 0: 9104.9, 1: 8914.3. Samples: 255941976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:35:28,785][121949] Avg episode reward: [(0, '5998.910'), (1, '4913.086')] [2023-12-26 03:35:28,806][123090] Updated weights for policy 1, policy_version 498170 (0.0005) [2023-12-26 03:35:28,863][123091] Updated weights for policy 0, policy_version 501620 (0.0007) [2023-12-26 03:35:28,936][123091] Updated weights for policy 0, policy_version 501630 (0.0006) [2023-12-26 03:35:29,006][123091] Updated weights for policy 0, policy_version 501640 (0.0007) [2023-12-26 03:35:29,506][123090] Updated weights for policy 1, policy_version 498180 (0.0005) [2023-12-26 03:35:29,561][123090] Updated weights for policy 1, policy_version 498190 (0.0005) [2023-12-26 03:35:29,619][123090] Updated weights for policy 1, policy_version 498200 (0.0005) [2023-12-26 03:35:29,720][123091] Updated weights for policy 0, policy_version 501650 (0.0005) [2023-12-26 03:35:29,783][123091] Updated weights for policy 0, policy_version 501660 (0.0009) [2023-12-26 03:35:29,853][123091] Updated weights for policy 0, policy_version 501670 (0.0009) [2023-12-26 03:35:29,926][123091] Updated weights for policy 0, policy_version 501680 (0.0009) [2023-12-26 03:35:30,369][123090] Updated weights for policy 1, policy_version 498210 (0.0006) [2023-12-26 03:35:30,427][123090] Updated weights for policy 1, policy_version 498220 (0.0009) [2023-12-26 03:35:30,494][123090] Updated weights for policy 1, policy_version 498230 (0.0010) [2023-12-26 03:35:30,552][123090] Updated weights for policy 1, policy_version 498240 (0.0009) [2023-12-26 03:35:30,733][123091] Updated weights for policy 0, policy_version 501690 (0.0010) [2023-12-26 03:35:30,788][123091] Updated weights for policy 0, policy_version 501700 (0.0009) [2023-12-26 03:35:30,838][123091] Updated weights for policy 0, policy_version 501710 (0.0009) [2023-12-26 03:35:31,424][123090] Updated weights for policy 1, policy_version 498250 (0.0009) [2023-12-26 03:35:31,487][123090] Updated weights for policy 1, policy_version 498260 (0.0010) [2023-12-26 03:35:31,549][123090] Updated weights for policy 1, policy_version 498270 (0.0009) [2023-12-26 03:35:31,659][123091] Updated weights for policy 0, policy_version 501720 (0.0006) [2023-12-26 03:35:31,734][123091] Updated weights for policy 0, policy_version 501730 (0.0006) [2023-12-26 03:35:31,799][123091] Updated weights for policy 0, policy_version 501740 (0.0007) [2023-12-26 03:35:32,392][123091] Updated weights for policy 0, policy_version 501750 (0.0007) [2023-12-26 03:35:32,460][123091] Updated weights for policy 0, policy_version 501760 (0.0006) [2023-12-26 03:35:32,510][123090] Updated weights for policy 1, policy_version 498280 (0.0009) [2023-12-26 03:35:32,523][123091] Updated weights for policy 0, policy_version 501770 (0.0005) [2023-12-26 03:35:32,561][123090] Updated weights for policy 1, policy_version 498290 (0.0009) [2023-12-26 03:35:32,613][123090] Updated weights for policy 1, policy_version 498300 (0.0009) [2023-12-26 03:35:33,268][123091] Updated weights for policy 0, policy_version 501780 (0.0006) [2023-12-26 03:35:33,317][123091] Updated weights for policy 0, policy_version 501790 (0.0005) [2023-12-26 03:35:33,372][123091] Updated weights for policy 0, policy_version 501800 (0.0005) [2023-12-26 03:35:33,389][123090] Updated weights for policy 1, policy_version 498310 (0.0008) [2023-12-26 03:35:33,439][123090] Updated weights for policy 1, policy_version 498320 (0.0009) [2023-12-26 03:35:33,494][123090] Updated weights for policy 1, policy_version 498331 (0.0011) [2023-12-26 03:35:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 256040960. Throughput: 0: 9098.0, 1: 8855.0. Samples: 256049464. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:33,785][121949] Avg episode reward: [(0, '5870.891'), (1, '4812.875')] [2023-12-26 03:35:34,052][123091] Updated weights for policy 0, policy_version 501810 (0.0006) [2023-12-26 03:35:34,119][123091] Updated weights for policy 0, policy_version 501820 (0.0005) [2023-12-26 03:35:34,191][123091] Updated weights for policy 0, policy_version 501830 (0.0008) [2023-12-26 03:35:34,254][123091] Updated weights for policy 0, policy_version 501840 (0.0005) [2023-12-26 03:35:34,435][123090] Updated weights for policy 1, policy_version 498342 (0.0009) [2023-12-26 03:35:34,512][123090] Updated weights for policy 1, policy_version 498352 (0.0010) [2023-12-26 03:35:34,580][123090] Updated weights for policy 1, policy_version 498362 (0.0010) [2023-12-26 03:35:34,950][123091] Updated weights for policy 0, policy_version 501850 (0.0005) [2023-12-26 03:35:35,024][123091] Updated weights for policy 0, policy_version 501860 (0.0006) [2023-12-26 03:35:35,083][123091] Updated weights for policy 0, policy_version 501870 (0.0010) [2023-12-26 03:35:35,307][123090] Updated weights for policy 1, policy_version 498372 (0.0008) [2023-12-26 03:35:35,369][123090] Updated weights for policy 1, policy_version 498382 (0.0005) [2023-12-26 03:35:35,417][123090] Updated weights for policy 1, policy_version 498392 (0.0005) [2023-12-26 03:35:35,800][123091] Updated weights for policy 0, policy_version 501880 (0.0007) [2023-12-26 03:35:35,860][123091] Updated weights for policy 0, policy_version 501890 (0.0005) [2023-12-26 03:35:35,925][123091] Updated weights for policy 0, policy_version 501900 (0.0005) [2023-12-26 03:35:36,153][123090] Updated weights for policy 1, policy_version 498402 (0.0006) [2023-12-26 03:35:36,218][123090] Updated weights for policy 1, policy_version 498412 (0.0009) [2023-12-26 03:35:36,292][123090] Updated weights for policy 1, policy_version 498422 (0.0009) [2023-12-26 03:35:36,358][123090] Updated weights for policy 1, policy_version 498432 (0.0009) [2023-12-26 03:35:36,662][123091] Updated weights for policy 0, policy_version 501910 (0.0009) [2023-12-26 03:35:36,730][123091] Updated weights for policy 0, policy_version 501920 (0.0011) [2023-12-26 03:35:36,799][123091] Updated weights for policy 0, policy_version 501930 (0.0011) [2023-12-26 03:35:37,198][123090] Updated weights for policy 1, policy_version 498442 (0.0009) [2023-12-26 03:35:37,251][123090] Updated weights for policy 1, policy_version 498452 (0.0009) [2023-12-26 03:35:37,300][123090] Updated weights for policy 1, policy_version 498462 (0.0009) [2023-12-26 03:35:37,592][123091] Updated weights for policy 0, policy_version 501940 (0.0009) [2023-12-26 03:35:37,664][123091] Updated weights for policy 0, policy_version 501950 (0.0006) [2023-12-26 03:35:37,735][123091] Updated weights for policy 0, policy_version 501960 (0.0005) [2023-12-26 03:35:38,207][123090] Updated weights for policy 1, policy_version 498472 (0.0007) [2023-12-26 03:35:38,274][123090] Updated weights for policy 1, policy_version 498482 (0.0007) [2023-12-26 03:35:38,336][123090] Updated weights for policy 1, policy_version 498492 (0.0010) [2023-12-26 03:35:38,490][123091] Updated weights for policy 0, policy_version 501970 (0.0007) [2023-12-26 03:35:38,559][123091] Updated weights for policy 0, policy_version 501980 (0.0011) [2023-12-26 03:35:38,625][123091] Updated weights for policy 0, policy_version 501990 (0.0011) [2023-12-26 03:35:38,690][123091] Updated weights for policy 0, policy_version 502000 (0.0011) [2023-12-26 03:35:38,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17661.4). Total num frames: 256131072. Throughput: 0: 9113.5, 1: 8887.5. Samples: 256104716. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:38,784][121949] Avg episode reward: [(0, '5858.904'), (1, '4704.513')] [2023-12-26 03:35:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000502000_128516096.pth... [2023-12-26 03:35:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000498496_127614976.pth... [2023-12-26 03:35:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000500912_128237568.pth [2023-12-26 03:35:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000497472_127352832.pth [2023-12-26 03:35:39,189][123090] Updated weights for policy 1, policy_version 498502 (0.0010) [2023-12-26 03:35:39,240][123090] Updated weights for policy 1, policy_version 498512 (0.0007) [2023-12-26 03:35:39,303][123090] Updated weights for policy 1, policy_version 498522 (0.0005) [2023-12-26 03:35:39,482][123091] Updated weights for policy 0, policy_version 502010 (0.0009) [2023-12-26 03:35:39,552][123091] Updated weights for policy 0, policy_version 502020 (0.0006) [2023-12-26 03:35:39,621][123091] Updated weights for policy 0, policy_version 502030 (0.0008) [2023-12-26 03:35:40,133][123090] Updated weights for policy 1, policy_version 498532 (0.0008) [2023-12-26 03:35:40,190][123090] Updated weights for policy 1, policy_version 498542 (0.0009) [2023-12-26 03:35:40,252][123090] Updated weights for policy 1, policy_version 498552 (0.0009) [2023-12-26 03:35:40,459][123091] Updated weights for policy 0, policy_version 502040 (0.0010) [2023-12-26 03:35:40,509][123091] Updated weights for policy 0, policy_version 502050 (0.0009) [2023-12-26 03:35:40,568][123091] Updated weights for policy 0, policy_version 502060 (0.0009) [2023-12-26 03:35:41,134][123090] Updated weights for policy 1, policy_version 498562 (0.0009) [2023-12-26 03:35:41,210][123090] Updated weights for policy 1, policy_version 498572 (0.0009) [2023-12-26 03:35:41,284][123090] Updated weights for policy 1, policy_version 498583 (0.0009) [2023-12-26 03:35:41,475][123091] Updated weights for policy 0, policy_version 502070 (0.0009) [2023-12-26 03:35:41,540][123091] Updated weights for policy 0, policy_version 502080 (0.0009) [2023-12-26 03:35:41,613][123091] Updated weights for policy 0, policy_version 502090 (0.0009) [2023-12-26 03:35:42,062][123090] Updated weights for policy 1, policy_version 498593 (0.0008) [2023-12-26 03:35:42,122][123090] Updated weights for policy 1, policy_version 498603 (0.0006) [2023-12-26 03:35:42,192][123090] Updated weights for policy 1, policy_version 498613 (0.0005) [2023-12-26 03:35:42,271][123090] Updated weights for policy 1, policy_version 498623 (0.0006) [2023-12-26 03:35:42,508][123091] Updated weights for policy 0, policy_version 502100 (0.0009) [2023-12-26 03:35:42,574][123091] Updated weights for policy 0, policy_version 502110 (0.0009) [2023-12-26 03:35:42,645][123091] Updated weights for policy 0, policy_version 502120 (0.0008) [2023-12-26 03:35:42,987][123090] Updated weights for policy 1, policy_version 498633 (0.0009) [2023-12-26 03:35:43,043][123090] Updated weights for policy 1, policy_version 498643 (0.0007) [2023-12-26 03:35:43,101][123090] Updated weights for policy 1, policy_version 498653 (0.0009) [2023-12-26 03:35:43,424][123091] Updated weights for policy 0, policy_version 502130 (0.0008) [2023-12-26 03:35:43,479][123091] Updated weights for policy 0, policy_version 502140 (0.0005) [2023-12-26 03:35:43,523][123091] Updated weights for policy 0, policy_version 502150 (0.0005) [2023-12-26 03:35:43,574][123091] Updated weights for policy 0, policy_version 502160 (0.0009) [2023-12-26 03:35:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 256212992. Throughput: 0: 9052.7, 1: 8758.8. Samples: 256206352. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:43,785][121949] Avg episode reward: [(0, '5825.439'), (1, '4919.164')] [2023-12-26 03:35:43,810][123090] Updated weights for policy 1, policy_version 498663 (0.0007) [2023-12-26 03:35:43,873][123090] Updated weights for policy 1, policy_version 498673 (0.0005) [2023-12-26 03:35:43,936][123090] Updated weights for policy 1, policy_version 498683 (0.0007) [2023-12-26 03:35:44,370][123091] Updated weights for policy 0, policy_version 502170 (0.0005) [2023-12-26 03:35:44,425][123091] Updated weights for policy 0, policy_version 502180 (0.0005) [2023-12-26 03:35:44,481][123091] Updated weights for policy 0, policy_version 502190 (0.0007) [2023-12-26 03:35:44,704][123090] Updated weights for policy 1, policy_version 498693 (0.0007) [2023-12-26 03:35:44,782][123090] Updated weights for policy 1, policy_version 498703 (0.0009) [2023-12-26 03:35:44,855][123090] Updated weights for policy 1, policy_version 498713 (0.0010) [2023-12-26 03:35:45,291][123091] Updated weights for policy 0, policy_version 502200 (0.0009) [2023-12-26 03:35:45,360][123091] Updated weights for policy 0, policy_version 502210 (0.0009) [2023-12-26 03:35:45,425][123091] Updated weights for policy 0, policy_version 502220 (0.0009) [2023-12-26 03:35:45,624][123090] Updated weights for policy 1, policy_version 498723 (0.0009) [2023-12-26 03:35:45,693][123090] Updated weights for policy 1, policy_version 498733 (0.0008) [2023-12-26 03:35:45,760][123090] Updated weights for policy 1, policy_version 498743 (0.0010) [2023-12-26 03:35:46,315][123091] Updated weights for policy 0, policy_version 502230 (0.0009) [2023-12-26 03:35:46,379][123091] Updated weights for policy 0, policy_version 502240 (0.0009) [2023-12-26 03:35:46,442][123091] Updated weights for policy 0, policy_version 502250 (0.0009) [2023-12-26 03:35:46,499][123090] Updated weights for policy 1, policy_version 498753 (0.0008) [2023-12-26 03:35:46,561][123090] Updated weights for policy 1, policy_version 498763 (0.0010) [2023-12-26 03:35:46,618][123090] Updated weights for policy 1, policy_version 498773 (0.0008) [2023-12-26 03:35:46,665][123090] Updated weights for policy 1, policy_version 498783 (0.0006) [2023-12-26 03:35:47,314][123091] Updated weights for policy 0, policy_version 502260 (0.0008) [2023-12-26 03:35:47,373][123091] Updated weights for policy 0, policy_version 502270 (0.0005) [2023-12-26 03:35:47,409][123090] Updated weights for policy 1, policy_version 498793 (0.0008) [2023-12-26 03:35:47,428][123091] Updated weights for policy 0, policy_version 502280 (0.0005) [2023-12-26 03:35:47,466][123090] Updated weights for policy 1, policy_version 498804 (0.0010) [2023-12-26 03:35:47,518][123090] Updated weights for policy 1, policy_version 498814 (0.0009) [2023-12-26 03:35:48,128][123091] Updated weights for policy 0, policy_version 502290 (0.0006) [2023-12-26 03:35:48,192][123091] Updated weights for policy 0, policy_version 502300 (0.0011) [2023-12-26 03:35:48,251][123091] Updated weights for policy 0, policy_version 502310 (0.0010) [2023-12-26 03:35:48,315][123091] Updated weights for policy 0, policy_version 502320 (0.0011) [2023-12-26 03:35:48,435][123090] Updated weights for policy 1, policy_version 498824 (0.0008) [2023-12-26 03:35:48,494][123090] Updated weights for policy 1, policy_version 498834 (0.0008) [2023-12-26 03:35:48,554][123090] Updated weights for policy 1, policy_version 498844 (0.0007) [2023-12-26 03:35:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 256303104. Throughput: 0: 9067.0, 1: 8824.3. Samples: 256313068. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:48,785][121949] Avg episode reward: [(0, '5893.697'), (1, '4920.883')] [2023-12-26 03:35:49,098][123091] Updated weights for policy 0, policy_version 502330 (0.0011) [2023-12-26 03:35:49,158][123091] Updated weights for policy 0, policy_version 502340 (0.0009) [2023-12-26 03:35:49,222][123091] Updated weights for policy 0, policy_version 502350 (0.0006) [2023-12-26 03:35:49,345][123090] Updated weights for policy 1, policy_version 498854 (0.0008) [2023-12-26 03:35:49,404][123090] Updated weights for policy 1, policy_version 498864 (0.0008) [2023-12-26 03:35:49,459][123090] Updated weights for policy 1, policy_version 498874 (0.0006) [2023-12-26 03:35:49,985][123091] Updated weights for policy 0, policy_version 502360 (0.0009) [2023-12-26 03:35:50,044][123091] Updated weights for policy 0, policy_version 502370 (0.0010) [2023-12-26 03:35:50,100][123091] Updated weights for policy 0, policy_version 502380 (0.0010) [2023-12-26 03:35:50,165][123090] Updated weights for policy 1, policy_version 498884 (0.0007) [2023-12-26 03:35:50,219][123090] Updated weights for policy 1, policy_version 498894 (0.0010) [2023-12-26 03:35:50,275][123090] Updated weights for policy 1, policy_version 498904 (0.0006) [2023-12-26 03:35:50,989][123091] Updated weights for policy 0, policy_version 502390 (0.0009) [2023-12-26 03:35:51,050][123091] Updated weights for policy 0, policy_version 502400 (0.0009) [2023-12-26 03:35:51,116][123091] Updated weights for policy 0, policy_version 502410 (0.0011) [2023-12-26 03:35:51,128][123090] Updated weights for policy 1, policy_version 498914 (0.0007) [2023-12-26 03:35:51,189][123090] Updated weights for policy 1, policy_version 498924 (0.0011) [2023-12-26 03:35:51,238][123090] Updated weights for policy 1, policy_version 498934 (0.0010) [2023-12-26 03:35:51,298][123090] Updated weights for policy 1, policy_version 498944 (0.0011) [2023-12-26 03:35:51,905][123091] Updated weights for policy 0, policy_version 502420 (0.0007) [2023-12-26 03:35:51,961][123091] Updated weights for policy 0, policy_version 502430 (0.0008) [2023-12-26 03:35:52,016][123091] Updated weights for policy 0, policy_version 502440 (0.0008) [2023-12-26 03:35:52,189][123090] Updated weights for policy 1, policy_version 498954 (0.0010) [2023-12-26 03:35:52,249][123090] Updated weights for policy 1, policy_version 498964 (0.0010) [2023-12-26 03:35:52,309][123090] Updated weights for policy 1, policy_version 498974 (0.0011) [2023-12-26 03:35:52,785][123091] Updated weights for policy 0, policy_version 502450 (0.0008) [2023-12-26 03:35:52,859][123091] Updated weights for policy 0, policy_version 502460 (0.0006) [2023-12-26 03:35:52,933][123091] Updated weights for policy 0, policy_version 502470 (0.0009) [2023-12-26 03:35:52,991][123091] Updated weights for policy 0, policy_version 502480 (0.0006) [2023-12-26 03:35:53,203][123090] Updated weights for policy 1, policy_version 498984 (0.0010) [2023-12-26 03:35:53,269][123090] Updated weights for policy 1, policy_version 498994 (0.0009) [2023-12-26 03:35:53,333][123090] Updated weights for policy 1, policy_version 499004 (0.0009) [2023-12-26 03:35:53,683][123091] Updated weights for policy 0, policy_version 502490 (0.0009) [2023-12-26 03:35:53,735][123091] Updated weights for policy 0, policy_version 502500 (0.0008) [2023-12-26 03:35:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17661.5). Total num frames: 256385024. Throughput: 0: 9046.7, 1: 8799.6. Samples: 256366120. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:53,786][121949] Avg episode reward: [(0, '5986.540'), (1, '4995.196')] [2023-12-26 03:35:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000499008_127746048.pth... [2023-12-26 03:35:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000497984_127483904.pth [2023-12-26 03:35:53,805][123091] Updated weights for policy 0, policy_version 502510 (0.0005) [2023-12-26 03:35:53,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000502512_128647168.pth... [2023-12-26 03:35:53,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000501424_128368640.pth [2023-12-26 03:35:54,152][123090] Updated weights for policy 1, policy_version 499014 (0.0007) [2023-12-26 03:35:54,216][123090] Updated weights for policy 1, policy_version 499024 (0.0007) [2023-12-26 03:35:54,276][123090] Updated weights for policy 1, policy_version 499034 (0.0009) [2023-12-26 03:35:54,596][123091] Updated weights for policy 0, policy_version 502520 (0.0006) [2023-12-26 03:35:54,665][123091] Updated weights for policy 0, policy_version 502530 (0.0005) [2023-12-26 03:35:54,740][123091] Updated weights for policy 0, policy_version 502540 (0.0005) [2023-12-26 03:35:55,149][123090] Updated weights for policy 1, policy_version 499044 (0.0009) [2023-12-26 03:35:55,204][123090] Updated weights for policy 1, policy_version 499054 (0.0010) [2023-12-26 03:35:55,261][123090] Updated weights for policy 1, policy_version 499064 (0.0009) [2023-12-26 03:35:55,402][123091] Updated weights for policy 0, policy_version 502550 (0.0008) [2023-12-26 03:35:55,463][123091] Updated weights for policy 0, policy_version 502560 (0.0009) [2023-12-26 03:35:55,529][123091] Updated weights for policy 0, policy_version 502570 (0.0010) [2023-12-26 03:35:56,006][123090] Updated weights for policy 1, policy_version 499074 (0.0008) [2023-12-26 03:35:56,064][123090] Updated weights for policy 1, policy_version 499084 (0.0005) [2023-12-26 03:35:56,112][123090] Updated weights for policy 1, policy_version 499094 (0.0005) [2023-12-26 03:35:56,172][123090] Updated weights for policy 1, policy_version 499104 (0.0005) [2023-12-26 03:35:56,333][123091] Updated weights for policy 0, policy_version 502580 (0.0008) [2023-12-26 03:35:56,389][123091] Updated weights for policy 0, policy_version 502590 (0.0005) [2023-12-26 03:35:56,441][123091] Updated weights for policy 0, policy_version 502600 (0.0005) [2023-12-26 03:35:56,903][123090] Updated weights for policy 1, policy_version 499114 (0.0005) [2023-12-26 03:35:56,958][123090] Updated weights for policy 1, policy_version 499124 (0.0005) [2023-12-26 03:35:57,016][123090] Updated weights for policy 1, policy_version 499134 (0.0005) [2023-12-26 03:35:57,110][123091] Updated weights for policy 0, policy_version 502610 (0.0005) [2023-12-26 03:35:57,174][123091] Updated weights for policy 0, policy_version 502620 (0.0006) [2023-12-26 03:35:57,231][123091] Updated weights for policy 0, policy_version 502630 (0.0005) [2023-12-26 03:35:57,285][123091] Updated weights for policy 0, policy_version 502640 (0.0008) [2023-12-26 03:35:57,695][123090] Updated weights for policy 1, policy_version 499144 (0.0005) [2023-12-26 03:35:57,747][123090] Updated weights for policy 1, policy_version 499154 (0.0007) [2023-12-26 03:35:57,803][123090] Updated weights for policy 1, policy_version 499164 (0.0005) [2023-12-26 03:35:57,952][123091] Updated weights for policy 0, policy_version 502650 (0.0006) [2023-12-26 03:35:58,014][123091] Updated weights for policy 0, policy_version 502660 (0.0007) [2023-12-26 03:35:58,072][123091] Updated weights for policy 0, policy_version 502670 (0.0008) [2023-12-26 03:35:58,612][123090] Updated weights for policy 1, policy_version 499174 (0.0008) [2023-12-26 03:35:58,677][123090] Updated weights for policy 1, policy_version 499184 (0.0011) [2023-12-26 03:35:58,741][123090] Updated weights for policy 1, policy_version 499194 (0.0011) [2023-12-26 03:35:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 256483328. Throughput: 0: 9143.1, 1: 8865.2. Samples: 256475412. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:35:58,784][121949] Avg episode reward: [(0, '6031.529'), (1, '5060.372')] [2023-12-26 03:35:58,828][123091] Updated weights for policy 0, policy_version 502680 (0.0009) [2023-12-26 03:35:58,888][123091] Updated weights for policy 0, policy_version 502690 (0.0008) [2023-12-26 03:35:58,955][123091] Updated weights for policy 0, policy_version 502700 (0.0008) [2023-12-26 03:35:59,491][123090] Updated weights for policy 1, policy_version 499204 (0.0008) [2023-12-26 03:35:59,549][123090] Updated weights for policy 1, policy_version 499214 (0.0005) [2023-12-26 03:35:59,631][123090] Updated weights for policy 1, policy_version 499224 (0.0005) [2023-12-26 03:35:59,757][123091] Updated weights for policy 0, policy_version 502710 (0.0007) [2023-12-26 03:35:59,827][123091] Updated weights for policy 0, policy_version 502720 (0.0006) [2023-12-26 03:35:59,895][123091] Updated weights for policy 0, policy_version 502730 (0.0008) [2023-12-26 03:36:00,394][123090] Updated weights for policy 1, policy_version 499234 (0.0006) [2023-12-26 03:36:00,460][123090] Updated weights for policy 1, policy_version 499244 (0.0008) [2023-12-26 03:36:00,525][123090] Updated weights for policy 1, policy_version 499254 (0.0010) [2023-12-26 03:36:00,586][123090] Updated weights for policy 1, policy_version 499264 (0.0010) [2023-12-26 03:36:00,651][123091] Updated weights for policy 0, policy_version 502740 (0.0009) [2023-12-26 03:36:00,707][123091] Updated weights for policy 0, policy_version 502750 (0.0009) [2023-12-26 03:36:00,772][123091] Updated weights for policy 0, policy_version 502760 (0.0009) [2023-12-26 03:36:01,391][123090] Updated weights for policy 1, policy_version 499274 (0.0008) [2023-12-26 03:36:01,451][123090] Updated weights for policy 1, policy_version 499284 (0.0009) [2023-12-26 03:36:01,518][123090] Updated weights for policy 1, policy_version 499294 (0.0009) [2023-12-26 03:36:01,618][123091] Updated weights for policy 0, policy_version 502770 (0.0008) [2023-12-26 03:36:01,679][123091] Updated weights for policy 0, policy_version 502780 (0.0010) [2023-12-26 03:36:01,734][123091] Updated weights for policy 0, policy_version 502790 (0.0010) [2023-12-26 03:36:01,799][123091] Updated weights for policy 0, policy_version 502800 (0.0009) [2023-12-26 03:36:02,243][123090] Updated weights for policy 1, policy_version 499304 (0.0005) [2023-12-26 03:36:02,313][123090] Updated weights for policy 1, policy_version 499314 (0.0008) [2023-12-26 03:36:02,389][123090] Updated weights for policy 1, policy_version 499324 (0.0010) [2023-12-26 03:36:02,698][123091] Updated weights for policy 0, policy_version 502810 (0.0009) [2023-12-26 03:36:02,754][123091] Updated weights for policy 0, policy_version 502820 (0.0009) [2023-12-26 03:36:02,805][123091] Updated weights for policy 0, policy_version 502830 (0.0010) [2023-12-26 03:36:03,115][123090] Updated weights for policy 1, policy_version 499334 (0.0007) [2023-12-26 03:36:03,161][123090] Updated weights for policy 1, policy_version 499344 (0.0005) [2023-12-26 03:36:03,210][123090] Updated weights for policy 1, policy_version 499354 (0.0005) [2023-12-26 03:36:03,588][123091] Updated weights for policy 0, policy_version 502840 (0.0010) [2023-12-26 03:36:03,639][123091] Updated weights for policy 0, policy_version 502850 (0.0010) [2023-12-26 03:36:03,693][123091] Updated weights for policy 0, policy_version 502860 (0.0010) [2023-12-26 03:36:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 256573440. Throughput: 0: 9065.3, 1: 8873.6. Samples: 256583600. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:03,784][121949] Avg episode reward: [(0, '6079.311'), (1, '5096.790')] [2023-12-26 03:36:03,954][123090] Updated weights for policy 1, policy_version 499364 (0.0007) [2023-12-26 03:36:04,019][123090] Updated weights for policy 1, policy_version 499374 (0.0009) [2023-12-26 03:36:04,084][123090] Updated weights for policy 1, policy_version 499384 (0.0006) [2023-12-26 03:36:04,416][123091] Updated weights for policy 0, policy_version 502870 (0.0008) [2023-12-26 03:36:04,482][123091] Updated weights for policy 0, policy_version 502880 (0.0009) [2023-12-26 03:36:04,555][123091] Updated weights for policy 0, policy_version 502890 (0.0009) [2023-12-26 03:36:04,870][123090] Updated weights for policy 1, policy_version 499394 (0.0009) [2023-12-26 03:36:04,918][123090] Updated weights for policy 1, policy_version 499404 (0.0010) [2023-12-26 03:36:04,965][123090] Updated weights for policy 1, policy_version 499414 (0.0010) [2023-12-26 03:36:05,021][123090] Updated weights for policy 1, policy_version 499424 (0.0010) [2023-12-26 03:36:05,368][123091] Updated weights for policy 0, policy_version 502900 (0.0010) [2023-12-26 03:36:05,422][123091] Updated weights for policy 0, policy_version 502910 (0.0009) [2023-12-26 03:36:05,474][123091] Updated weights for policy 0, policy_version 502920 (0.0005) [2023-12-26 03:36:05,865][123090] Updated weights for policy 1, policy_version 499434 (0.0010) [2023-12-26 03:36:05,916][123090] Updated weights for policy 1, policy_version 499444 (0.0010) [2023-12-26 03:36:05,971][123090] Updated weights for policy 1, policy_version 499454 (0.0010) [2023-12-26 03:36:06,159][123091] Updated weights for policy 0, policy_version 502930 (0.0006) [2023-12-26 03:36:06,215][123091] Updated weights for policy 0, policy_version 502940 (0.0011) [2023-12-26 03:36:06,264][123091] Updated weights for policy 0, policy_version 502950 (0.0010) [2023-12-26 03:36:06,327][123091] Updated weights for policy 0, policy_version 502960 (0.0011) [2023-12-26 03:36:06,819][123090] Updated weights for policy 1, policy_version 499464 (0.0010) [2023-12-26 03:36:06,863][123090] Updated weights for policy 1, policy_version 499474 (0.0010) [2023-12-26 03:36:06,910][123090] Updated weights for policy 1, policy_version 499484 (0.0010) [2023-12-26 03:36:07,183][123091] Updated weights for policy 0, policy_version 502970 (0.0011) [2023-12-26 03:36:07,242][123091] Updated weights for policy 0, policy_version 502980 (0.0011) [2023-12-26 03:36:07,306][123091] Updated weights for policy 0, policy_version 502990 (0.0011) [2023-12-26 03:36:07,698][123090] Updated weights for policy 1, policy_version 499494 (0.0010) [2023-12-26 03:36:07,750][123090] Updated weights for policy 1, policy_version 499504 (0.0010) [2023-12-26 03:36:07,814][123090] Updated weights for policy 1, policy_version 499514 (0.0011) [2023-12-26 03:36:08,153][123091] Updated weights for policy 0, policy_version 503000 (0.0011) [2023-12-26 03:36:08,216][123091] Updated weights for policy 0, policy_version 503010 (0.0010) [2023-12-26 03:36:08,277][123091] Updated weights for policy 0, policy_version 503020 (0.0008) [2023-12-26 03:36:08,634][123090] Updated weights for policy 1, policy_version 499524 (0.0009) [2023-12-26 03:36:08,690][123090] Updated weights for policy 1, policy_version 499534 (0.0005) [2023-12-26 03:36:08,756][123090] Updated weights for policy 1, policy_version 499544 (0.0005) [2023-12-26 03:36:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 256655360. Throughput: 0: 9113.1, 1: 8886.2. Samples: 256637264. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:08,785][121949] Avg episode reward: [(0, '6093.327'), (1, '4861.280')] [2023-12-26 03:36:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000503024_128778240.pth... [2023-12-26 03:36:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000502000_128516096.pth [2023-12-26 03:36:08,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000499552_127885312.pth... [2023-12-26 03:36:08,817][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000498496_127614976.pth [2023-12-26 03:36:09,120][123091] Updated weights for policy 0, policy_version 503030 (0.0006) [2023-12-26 03:36:09,190][123091] Updated weights for policy 0, policy_version 503040 (0.0006) [2023-12-26 03:36:09,276][123091] Updated weights for policy 0, policy_version 503050 (0.0010) [2023-12-26 03:36:09,495][123090] Updated weights for policy 1, policy_version 499554 (0.0006) [2023-12-26 03:36:09,554][123090] Updated weights for policy 1, policy_version 499564 (0.0008) [2023-12-26 03:36:09,612][123090] Updated weights for policy 1, policy_version 499574 (0.0008) [2023-12-26 03:36:09,669][123090] Updated weights for policy 1, policy_version 499584 (0.0008) [2023-12-26 03:36:10,076][123091] Updated weights for policy 0, policy_version 503060 (0.0011) [2023-12-26 03:36:10,136][123091] Updated weights for policy 0, policy_version 503070 (0.0010) [2023-12-26 03:36:10,192][123091] Updated weights for policy 0, policy_version 503080 (0.0009) [2023-12-26 03:36:10,529][123090] Updated weights for policy 1, policy_version 499594 (0.0009) [2023-12-26 03:36:10,587][123090] Updated weights for policy 1, policy_version 499604 (0.0009) [2023-12-26 03:36:10,642][123090] Updated weights for policy 1, policy_version 499614 (0.0009) [2023-12-26 03:36:11,038][123091] Updated weights for policy 0, policy_version 503090 (0.0009) [2023-12-26 03:36:11,106][123091] Updated weights for policy 0, policy_version 503100 (0.0010) [2023-12-26 03:36:11,176][123091] Updated weights for policy 0, policy_version 503110 (0.0010) [2023-12-26 03:36:11,249][123091] Updated weights for policy 0, policy_version 503120 (0.0006) [2023-12-26 03:36:11,500][123090] Updated weights for policy 1, policy_version 499624 (0.0009) [2023-12-26 03:36:11,560][123090] Updated weights for policy 1, policy_version 499634 (0.0009) [2023-12-26 03:36:11,631][123090] Updated weights for policy 1, policy_version 499644 (0.0009) [2023-12-26 03:36:12,002][123091] Updated weights for policy 0, policy_version 503130 (0.0006) [2023-12-26 03:36:12,070][123091] Updated weights for policy 0, policy_version 503140 (0.0006) [2023-12-26 03:36:12,131][123091] Updated weights for policy 0, policy_version 503150 (0.0010) [2023-12-26 03:36:12,528][123090] Updated weights for policy 1, policy_version 499654 (0.0010) [2023-12-26 03:36:12,594][123090] Updated weights for policy 1, policy_version 499664 (0.0009) [2023-12-26 03:36:12,659][123090] Updated weights for policy 1, policy_version 499674 (0.0010) [2023-12-26 03:36:13,020][123091] Updated weights for policy 0, policy_version 503160 (0.0010) [2023-12-26 03:36:13,083][123091] Updated weights for policy 0, policy_version 503170 (0.0009) [2023-12-26 03:36:13,144][123091] Updated weights for policy 0, policy_version 503180 (0.0009) [2023-12-26 03:36:13,520][123090] Updated weights for policy 1, policy_version 499684 (0.0010) [2023-12-26 03:36:13,580][123090] Updated weights for policy 1, policy_version 499694 (0.0009) [2023-12-26 03:36:13,637][123090] Updated weights for policy 1, policy_version 499705 (0.0009) [2023-12-26 03:36:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 256745472. Throughput: 0: 8925.9, 1: 8775.6. Samples: 256738540. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:13,785][121949] Avg episode reward: [(0, '6129.666'), (1, '4812.140')] [2023-12-26 03:36:13,970][123091] Updated weights for policy 0, policy_version 503190 (0.0010) [2023-12-26 03:36:14,038][123091] Updated weights for policy 0, policy_version 503200 (0.0009) [2023-12-26 03:36:14,096][123091] Updated weights for policy 0, policy_version 503210 (0.0009) [2023-12-26 03:36:14,506][123090] Updated weights for policy 1, policy_version 499715 (0.0009) [2023-12-26 03:36:14,570][123090] Updated weights for policy 1, policy_version 499725 (0.0009) [2023-12-26 03:36:14,623][123090] Updated weights for policy 1, policy_version 499735 (0.0008) [2023-12-26 03:36:14,851][123091] Updated weights for policy 0, policy_version 503220 (0.0008) [2023-12-26 03:36:14,916][123091] Updated weights for policy 0, policy_version 503230 (0.0010) [2023-12-26 03:36:14,979][123091] Updated weights for policy 0, policy_version 503240 (0.0005) [2023-12-26 03:36:15,463][123090] Updated weights for policy 1, policy_version 499745 (0.0009) [2023-12-26 03:36:15,528][123090] Updated weights for policy 1, policy_version 499755 (0.0010) [2023-12-26 03:36:15,617][123090] Updated weights for policy 1, policy_version 499765 (0.0010) [2023-12-26 03:36:15,682][123090] Updated weights for policy 1, policy_version 499775 (0.0010) [2023-12-26 03:36:15,714][123091] Updated weights for policy 0, policy_version 503250 (0.0006) [2023-12-26 03:36:15,788][123091] Updated weights for policy 0, policy_version 503260 (0.0009) [2023-12-26 03:36:15,844][123091] Updated weights for policy 0, policy_version 503270 (0.0011) [2023-12-26 03:36:15,909][123091] Updated weights for policy 0, policy_version 503280 (0.0011) [2023-12-26 03:36:16,527][123090] Updated weights for policy 1, policy_version 499785 (0.0009) [2023-12-26 03:36:16,590][123090] Updated weights for policy 1, policy_version 499795 (0.0006) [2023-12-26 03:36:16,661][123090] Updated weights for policy 1, policy_version 499805 (0.0009) [2023-12-26 03:36:16,714][123091] Updated weights for policy 0, policy_version 503290 (0.0010) [2023-12-26 03:36:16,761][123091] Updated weights for policy 0, policy_version 503300 (0.0010) [2023-12-26 03:36:16,805][123091] Updated weights for policy 0, policy_version 503310 (0.0010) [2023-12-26 03:36:17,472][123090] Updated weights for policy 1, policy_version 499815 (0.0008) [2023-12-26 03:36:17,525][123090] Updated weights for policy 1, policy_version 499825 (0.0009) [2023-12-26 03:36:17,582][123090] Updated weights for policy 1, policy_version 499835 (0.0009) [2023-12-26 03:36:17,663][123091] Updated weights for policy 0, policy_version 503320 (0.0010) [2023-12-26 03:36:17,706][123091] Updated weights for policy 0, policy_version 503330 (0.0010) [2023-12-26 03:36:17,753][123091] Updated weights for policy 0, policy_version 503340 (0.0010) [2023-12-26 03:36:18,427][123090] Updated weights for policy 1, policy_version 499845 (0.0009) [2023-12-26 03:36:18,475][123090] Updated weights for policy 1, policy_version 499855 (0.0009) [2023-12-26 03:36:18,531][123090] Updated weights for policy 1, policy_version 499865 (0.0009) [2023-12-26 03:36:18,602][123091] Updated weights for policy 0, policy_version 503350 (0.0011) [2023-12-26 03:36:18,662][123091] Updated weights for policy 0, policy_version 503360 (0.0011) [2023-12-26 03:36:18,713][123091] Updated weights for policy 0, policy_version 503370 (0.0010) [2023-12-26 03:36:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 256835584. Throughput: 0: 8872.1, 1: 8728.3. Samples: 256841480. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:18,785][121949] Avg episode reward: [(0, '6079.379'), (1, '5170.140')] [2023-12-26 03:36:19,293][123090] Updated weights for policy 1, policy_version 499875 (0.0007) [2023-12-26 03:36:19,368][123090] Updated weights for policy 1, policy_version 499885 (0.0009) [2023-12-26 03:36:19,428][123090] Updated weights for policy 1, policy_version 499895 (0.0010) [2023-12-26 03:36:19,564][123091] Updated weights for policy 0, policy_version 503380 (0.0010) [2023-12-26 03:36:19,618][123091] Updated weights for policy 0, policy_version 503390 (0.0010) [2023-12-26 03:36:19,676][123091] Updated weights for policy 0, policy_version 503400 (0.0010) [2023-12-26 03:36:20,219][123090] Updated weights for policy 1, policy_version 499905 (0.0010) [2023-12-26 03:36:20,273][123090] Updated weights for policy 1, policy_version 499915 (0.0008) [2023-12-26 03:36:20,323][123090] Updated weights for policy 1, policy_version 499925 (0.0005) [2023-12-26 03:36:20,377][123090] Updated weights for policy 1, policy_version 499935 (0.0006) [2023-12-26 03:36:20,583][123091] Updated weights for policy 0, policy_version 503410 (0.0009) [2023-12-26 03:36:20,651][123091] Updated weights for policy 0, policy_version 503420 (0.0009) [2023-12-26 03:36:20,716][123091] Updated weights for policy 0, policy_version 503430 (0.0010) [2023-12-26 03:36:20,785][123091] Updated weights for policy 0, policy_version 503440 (0.0010) [2023-12-26 03:36:21,092][123090] Updated weights for policy 1, policy_version 499945 (0.0010) [2023-12-26 03:36:21,156][123090] Updated weights for policy 1, policy_version 499955 (0.0011) [2023-12-26 03:36:21,233][123090] Updated weights for policy 1, policy_version 499965 (0.0011) [2023-12-26 03:36:21,618][123091] Updated weights for policy 0, policy_version 503450 (0.0007) [2023-12-26 03:36:21,693][123091] Updated weights for policy 0, policy_version 503460 (0.0009) [2023-12-26 03:36:21,761][123091] Updated weights for policy 0, policy_version 503470 (0.0007) [2023-12-26 03:36:22,087][123090] Updated weights for policy 1, policy_version 499975 (0.0010) [2023-12-26 03:36:22,145][123090] Updated weights for policy 1, policy_version 499985 (0.0009) [2023-12-26 03:36:22,207][123090] Updated weights for policy 1, policy_version 499995 (0.0009) [2023-12-26 03:36:22,471][123091] Updated weights for policy 0, policy_version 503480 (0.0009) [2023-12-26 03:36:22,537][123091] Updated weights for policy 0, policy_version 503490 (0.0009) [2023-12-26 03:36:22,589][123091] Updated weights for policy 0, policy_version 503500 (0.0009) [2023-12-26 03:36:23,066][123090] Updated weights for policy 1, policy_version 500005 (0.0009) [2023-12-26 03:36:23,130][123090] Updated weights for policy 1, policy_version 500015 (0.0010) [2023-12-26 03:36:23,201][123090] Updated weights for policy 1, policy_version 500025 (0.0010) [2023-12-26 03:36:23,407][123091] Updated weights for policy 0, policy_version 503510 (0.0010) [2023-12-26 03:36:23,459][123091] Updated weights for policy 0, policy_version 503520 (0.0009) [2023-12-26 03:36:23,511][123091] Updated weights for policy 0, policy_version 503530 (0.0008) [2023-12-26 03:36:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 256917504. Throughput: 0: 8780.5, 1: 8758.1. Samples: 256893956. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:23,785][121949] Avg episode reward: [(0, '6086.799'), (1, '5474.863')] [2023-12-26 03:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000503536_128909312.pth... [2023-12-26 03:36:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000500032_128008192.pth... [2023-12-26 03:36:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000499008_127746048.pth [2023-12-26 03:36:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000502512_128647168.pth [2023-12-26 03:36:24,036][123090] Updated weights for policy 1, policy_version 500035 (0.0010) [2023-12-26 03:36:24,087][123090] Updated weights for policy 1, policy_version 500045 (0.0009) [2023-12-26 03:36:24,148][123090] Updated weights for policy 1, policy_version 500055 (0.0009) [2023-12-26 03:36:24,367][123091] Updated weights for policy 0, policy_version 503540 (0.0009) [2023-12-26 03:36:24,433][123091] Updated weights for policy 0, policy_version 503551 (0.0010) [2023-12-26 03:36:24,497][123091] Updated weights for policy 0, policy_version 503561 (0.0009) [2023-12-26 03:36:24,951][123090] Updated weights for policy 1, policy_version 500065 (0.0010) [2023-12-26 03:36:25,011][123090] Updated weights for policy 1, policy_version 500075 (0.0006) [2023-12-26 03:36:25,065][123090] Updated weights for policy 1, policy_version 500085 (0.0005) [2023-12-26 03:36:25,122][123090] Updated weights for policy 1, policy_version 500095 (0.0005) [2023-12-26 03:36:25,362][123091] Updated weights for policy 0, policy_version 503571 (0.0010) [2023-12-26 03:36:25,411][123091] Updated weights for policy 0, policy_version 503581 (0.0008) [2023-12-26 03:36:25,460][123091] Updated weights for policy 0, policy_version 503591 (0.0009) [2023-12-26 03:36:25,872][123090] Updated weights for policy 1, policy_version 500105 (0.0009) [2023-12-26 03:36:25,921][123090] Updated weights for policy 1, policy_version 500115 (0.0009) [2023-12-26 03:36:25,976][123090] Updated weights for policy 1, policy_version 500125 (0.0009) [2023-12-26 03:36:26,324][123091] Updated weights for policy 0, policy_version 503601 (0.0009) [2023-12-26 03:36:26,383][123091] Updated weights for policy 0, policy_version 503611 (0.0010) [2023-12-26 03:36:26,442][123091] Updated weights for policy 0, policy_version 503621 (0.0010) [2023-12-26 03:36:26,499][123091] Updated weights for policy 0, policy_version 503631 (0.0009) [2023-12-26 03:36:26,725][123090] Updated weights for policy 1, policy_version 500135 (0.0009) [2023-12-26 03:36:26,787][123090] Updated weights for policy 1, policy_version 500145 (0.0010) [2023-12-26 03:36:26,838][123090] Updated weights for policy 1, policy_version 500155 (0.0008) [2023-12-26 03:36:27,358][123091] Updated weights for policy 0, policy_version 503641 (0.0006) [2023-12-26 03:36:27,423][123091] Updated weights for policy 0, policy_version 503651 (0.0009) [2023-12-26 03:36:27,488][123091] Updated weights for policy 0, policy_version 503661 (0.0007) [2023-12-26 03:36:27,593][123090] Updated weights for policy 1, policy_version 500165 (0.0007) [2023-12-26 03:36:27,642][123090] Updated weights for policy 1, policy_version 500175 (0.0005) [2023-12-26 03:36:27,693][123090] Updated weights for policy 1, policy_version 500185 (0.0005) [2023-12-26 03:36:28,155][123091] Updated weights for policy 0, policy_version 503671 (0.0007) [2023-12-26 03:36:28,215][123091] Updated weights for policy 0, policy_version 503681 (0.0005) [2023-12-26 03:36:28,271][123091] Updated weights for policy 0, policy_version 503691 (0.0005) [2023-12-26 03:36:28,412][123090] Updated weights for policy 1, policy_version 500195 (0.0006) [2023-12-26 03:36:28,485][123090] Updated weights for policy 1, policy_version 500205 (0.0006) [2023-12-26 03:36:28,552][123090] Updated weights for policy 1, policy_version 500215 (0.0009) [2023-12-26 03:36:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 257007616. Throughput: 0: 8789.8, 1: 8810.9. Samples: 256998380. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:28,784][121949] Avg episode reward: [(0, '6099.925'), (1, '5349.894')] [2023-12-26 03:36:29,010][123091] Updated weights for policy 0, policy_version 503701 (0.0007) [2023-12-26 03:36:29,056][123091] Updated weights for policy 0, policy_version 503711 (0.0010) [2023-12-26 03:36:29,103][123091] Updated weights for policy 0, policy_version 503721 (0.0010) [2023-12-26 03:36:29,307][123090] Updated weights for policy 1, policy_version 500225 (0.0010) [2023-12-26 03:36:29,373][123090] Updated weights for policy 1, policy_version 500235 (0.0011) [2023-12-26 03:36:29,436][123090] Updated weights for policy 1, policy_version 500245 (0.0010) [2023-12-26 03:36:29,491][123090] Updated weights for policy 1, policy_version 500255 (0.0010) [2023-12-26 03:36:29,934][123091] Updated weights for policy 0, policy_version 503731 (0.0009) [2023-12-26 03:36:30,011][123091] Updated weights for policy 0, policy_version 503741 (0.0007) [2023-12-26 03:36:30,058][123091] Updated weights for policy 0, policy_version 503751 (0.0006) [2023-12-26 03:36:30,277][123090] Updated weights for policy 1, policy_version 500265 (0.0008) [2023-12-26 03:36:30,349][123090] Updated weights for policy 1, policy_version 500275 (0.0008) [2023-12-26 03:36:30,408][123090] Updated weights for policy 1, policy_version 500285 (0.0010) [2023-12-26 03:36:30,767][123091] Updated weights for policy 0, policy_version 503761 (0.0005) [2023-12-26 03:36:30,831][123091] Updated weights for policy 0, policy_version 503771 (0.0009) [2023-12-26 03:36:30,904][123091] Updated weights for policy 0, policy_version 503781 (0.0010) [2023-12-26 03:36:30,969][123091] Updated weights for policy 0, policy_version 503791 (0.0010) [2023-12-26 03:36:31,148][123090] Updated weights for policy 1, policy_version 500295 (0.0011) [2023-12-26 03:36:31,211][123090] Updated weights for policy 1, policy_version 500305 (0.0011) [2023-12-26 03:36:31,280][123090] Updated weights for policy 1, policy_version 500315 (0.0009) [2023-12-26 03:36:31,775][123091] Updated weights for policy 0, policy_version 503801 (0.0010) [2023-12-26 03:36:31,831][123091] Updated weights for policy 0, policy_version 503811 (0.0009) [2023-12-26 03:36:31,904][123091] Updated weights for policy 0, policy_version 503821 (0.0007) [2023-12-26 03:36:32,153][123090] Updated weights for policy 1, policy_version 500325 (0.0010) [2023-12-26 03:36:32,216][123090] Updated weights for policy 1, policy_version 500335 (0.0010) [2023-12-26 03:36:32,282][123090] Updated weights for policy 1, policy_version 500345 (0.0011) [2023-12-26 03:36:32,621][123091] Updated weights for policy 0, policy_version 503831 (0.0005) [2023-12-26 03:36:32,688][123091] Updated weights for policy 0, policy_version 503841 (0.0009) [2023-12-26 03:36:32,755][123091] Updated weights for policy 0, policy_version 503851 (0.0010) [2023-12-26 03:36:33,033][123090] Updated weights for policy 1, policy_version 500355 (0.0009) [2023-12-26 03:36:33,092][123090] Updated weights for policy 1, policy_version 500365 (0.0005) [2023-12-26 03:36:33,159][123090] Updated weights for policy 1, policy_version 500375 (0.0005) [2023-12-26 03:36:33,446][123091] Updated weights for policy 0, policy_version 503861 (0.0009) [2023-12-26 03:36:33,504][123091] Updated weights for policy 0, policy_version 503873 (0.0011) [2023-12-26 03:36:33,558][123091] Updated weights for policy 0, policy_version 503883 (0.0009) [2023-12-26 03:36:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 257097728. Throughput: 0: 8874.1, 1: 8822.6. Samples: 257109424. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:33,785][121949] Avg episode reward: [(0, '6150.894'), (1, '5285.314')] [2023-12-26 03:36:33,847][123090] Updated weights for policy 1, policy_version 500385 (0.0006) [2023-12-26 03:36:33,905][123090] Updated weights for policy 1, policy_version 500395 (0.0009) [2023-12-26 03:36:33,957][123090] Updated weights for policy 1, policy_version 500406 (0.0010) [2023-12-26 03:36:34,006][123090] Updated weights for policy 1, policy_version 500416 (0.0009) [2023-12-26 03:36:34,287][123091] Updated weights for policy 0, policy_version 503893 (0.0008) [2023-12-26 03:36:34,346][123091] Updated weights for policy 0, policy_version 503903 (0.0008) [2023-12-26 03:36:34,410][123091] Updated weights for policy 0, policy_version 503913 (0.0010) [2023-12-26 03:36:34,806][123090] Updated weights for policy 1, policy_version 500426 (0.0006) [2023-12-26 03:36:34,878][123090] Updated weights for policy 1, policy_version 500436 (0.0005) [2023-12-26 03:36:34,942][123090] Updated weights for policy 1, policy_version 500446 (0.0006) [2023-12-26 03:36:35,282][123091] Updated weights for policy 0, policy_version 503923 (0.0010) [2023-12-26 03:36:35,333][123091] Updated weights for policy 0, policy_version 503933 (0.0010) [2023-12-26 03:36:35,380][123091] Updated weights for policy 0, policy_version 503943 (0.0009) [2023-12-26 03:36:35,698][123090] Updated weights for policy 1, policy_version 500456 (0.0010) [2023-12-26 03:36:35,763][123090] Updated weights for policy 1, policy_version 500466 (0.0009) [2023-12-26 03:36:35,821][123090] Updated weights for policy 1, policy_version 500476 (0.0010) [2023-12-26 03:36:36,151][123091] Updated weights for policy 0, policy_version 503953 (0.0009) [2023-12-26 03:36:36,221][123091] Updated weights for policy 0, policy_version 503963 (0.0005) [2023-12-26 03:36:36,302][123091] Updated weights for policy 0, policy_version 503973 (0.0006) [2023-12-26 03:36:36,368][123091] Updated weights for policy 0, policy_version 503983 (0.0010) [2023-12-26 03:36:36,694][123090] Updated weights for policy 1, policy_version 500486 (0.0010) [2023-12-26 03:36:36,765][123090] Updated weights for policy 1, policy_version 500496 (0.0009) [2023-12-26 03:36:36,831][123090] Updated weights for policy 1, policy_version 500506 (0.0009) [2023-12-26 03:36:37,117][123091] Updated weights for policy 0, policy_version 503993 (0.0009) [2023-12-26 03:36:37,183][123091] Updated weights for policy 0, policy_version 504003 (0.0009) [2023-12-26 03:36:37,254][123091] Updated weights for policy 0, policy_version 504013 (0.0010) [2023-12-26 03:36:37,642][123090] Updated weights for policy 1, policy_version 500516 (0.0010) [2023-12-26 03:36:37,716][123090] Updated weights for policy 1, policy_version 500526 (0.0010) [2023-12-26 03:36:37,772][123090] Updated weights for policy 1, policy_version 500536 (0.0008) [2023-12-26 03:36:38,034][123091] Updated weights for policy 0, policy_version 504023 (0.0007) [2023-12-26 03:36:38,106][123091] Updated weights for policy 0, policy_version 504033 (0.0005) [2023-12-26 03:36:38,171][123091] Updated weights for policy 0, policy_version 504043 (0.0005) [2023-12-26 03:36:38,655][123090] Updated weights for policy 1, policy_version 500546 (0.0009) [2023-12-26 03:36:38,720][123090] Updated weights for policy 1, policy_version 500556 (0.0009) [2023-12-26 03:36:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 257179648. Throughput: 0: 8881.9, 1: 8821.4. Samples: 257162764. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:38,785][121949] Avg episode reward: [(0, '6187.123'), (1, '5305.268')] [2023-12-26 03:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000504048_129040384.pth... [2023-12-26 03:36:38,790][123090] Updated weights for policy 1, policy_version 500566 (0.0006) [2023-12-26 03:36:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000503024_128778240.pth [2023-12-26 03:36:38,846][123090] Updated weights for policy 1, policy_version 500576 (0.0008) [2023-12-26 03:36:38,846][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000500576_128147456.pth... [2023-12-26 03:36:38,850][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000499552_127885312.pth [2023-12-26 03:36:38,923][123091] Updated weights for policy 0, policy_version 504053 (0.0007) [2023-12-26 03:36:38,991][123091] Updated weights for policy 0, policy_version 504063 (0.0011) [2023-12-26 03:36:39,063][123091] Updated weights for policy 0, policy_version 504073 (0.0011) [2023-12-26 03:36:39,639][123090] Updated weights for policy 1, policy_version 500586 (0.0006) [2023-12-26 03:36:39,696][123090] Updated weights for policy 1, policy_version 500596 (0.0008) [2023-12-26 03:36:39,748][123090] Updated weights for policy 1, policy_version 500606 (0.0006) [2023-12-26 03:36:39,938][123091] Updated weights for policy 0, policy_version 504083 (0.0010) [2023-12-26 03:36:40,005][123091] Updated weights for policy 0, policy_version 504093 (0.0010) [2023-12-26 03:36:40,102][123091] Updated weights for policy 0, policy_version 504103 (0.0006) [2023-12-26 03:36:40,549][123090] Updated weights for policy 1, policy_version 500616 (0.0005) [2023-12-26 03:36:40,615][123090] Updated weights for policy 1, policy_version 500626 (0.0005) [2023-12-26 03:36:40,690][123090] Updated weights for policy 1, policy_version 500636 (0.0006) [2023-12-26 03:36:40,851][123091] Updated weights for policy 0, policy_version 504113 (0.0007) [2023-12-26 03:36:40,918][123091] Updated weights for policy 0, policy_version 504123 (0.0010) [2023-12-26 03:36:40,979][123091] Updated weights for policy 0, policy_version 504133 (0.0011) [2023-12-26 03:36:41,046][123091] Updated weights for policy 0, policy_version 504143 (0.0011) [2023-12-26 03:36:41,468][123090] Updated weights for policy 1, policy_version 500646 (0.0008) [2023-12-26 03:36:41,538][123090] Updated weights for policy 1, policy_version 500656 (0.0009) [2023-12-26 03:36:41,603][123090] Updated weights for policy 1, policy_version 500666 (0.0009) [2023-12-26 03:36:41,916][123091] Updated weights for policy 0, policy_version 504153 (0.0006) [2023-12-26 03:36:41,988][123091] Updated weights for policy 0, policy_version 504163 (0.0006) [2023-12-26 03:36:42,051][123091] Updated weights for policy 0, policy_version 504173 (0.0006) [2023-12-26 03:36:42,339][123090] Updated weights for policy 1, policy_version 500676 (0.0009) [2023-12-26 03:36:42,416][123090] Updated weights for policy 1, policy_version 500686 (0.0009) [2023-12-26 03:36:42,486][123090] Updated weights for policy 1, policy_version 500696 (0.0009) [2023-12-26 03:36:42,778][123091] Updated weights for policy 0, policy_version 504183 (0.0009) [2023-12-26 03:36:42,830][123091] Updated weights for policy 0, policy_version 504193 (0.0009) [2023-12-26 03:36:42,896][123091] Updated weights for policy 0, policy_version 504203 (0.0009) [2023-12-26 03:36:43,283][123090] Updated weights for policy 1, policy_version 500706 (0.0010) [2023-12-26 03:36:43,345][123090] Updated weights for policy 1, policy_version 500716 (0.0010) [2023-12-26 03:36:43,403][123090] Updated weights for policy 1, policy_version 500726 (0.0009) [2023-12-26 03:36:43,463][123090] Updated weights for policy 1, policy_version 500736 (0.0009) [2023-12-26 03:36:43,712][123091] Updated weights for policy 0, policy_version 504213 (0.0009) [2023-12-26 03:36:43,767][123091] Updated weights for policy 0, policy_version 504223 (0.0009) [2023-12-26 03:36:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 257269760. Throughput: 0: 8800.9, 1: 8773.4. Samples: 257266260. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:43,785][121949] Avg episode reward: [(0, '6214.413'), (1, '5475.310')] [2023-12-26 03:36:43,820][123091] Updated weights for policy 0, policy_version 504233 (0.0009) [2023-12-26 03:36:44,279][123090] Updated weights for policy 1, policy_version 500746 (0.0008) [2023-12-26 03:36:44,334][123090] Updated weights for policy 1, policy_version 500756 (0.0007) [2023-12-26 03:36:44,383][123090] Updated weights for policy 1, policy_version 500766 (0.0009) [2023-12-26 03:36:44,646][123091] Updated weights for policy 0, policy_version 504243 (0.0010) [2023-12-26 03:36:44,718][123091] Updated weights for policy 0, policy_version 504253 (0.0009) [2023-12-26 03:36:44,798][123091] Updated weights for policy 0, policy_version 504263 (0.0008) [2023-12-26 03:36:45,291][123090] Updated weights for policy 1, policy_version 500776 (0.0009) [2023-12-26 03:36:45,361][123090] Updated weights for policy 1, policy_version 500786 (0.0010) [2023-12-26 03:36:45,416][123090] Updated weights for policy 1, policy_version 500796 (0.0009) [2023-12-26 03:36:45,506][123091] Updated weights for policy 0, policy_version 504273 (0.0010) [2023-12-26 03:36:45,559][123091] Updated weights for policy 0, policy_version 504283 (0.0008) [2023-12-26 03:36:45,613][123091] Updated weights for policy 0, policy_version 504293 (0.0007) [2023-12-26 03:36:45,658][123091] Updated weights for policy 0, policy_version 504303 (0.0005) [2023-12-26 03:36:46,271][123090] Updated weights for policy 1, policy_version 500806 (0.0007) [2023-12-26 03:36:46,330][123090] Updated weights for policy 1, policy_version 500816 (0.0008) [2023-12-26 03:36:46,390][123090] Updated weights for policy 1, policy_version 500826 (0.0009) [2023-12-26 03:36:46,417][123091] Updated weights for policy 0, policy_version 504313 (0.0007) [2023-12-26 03:36:46,469][123091] Updated weights for policy 0, policy_version 504323 (0.0010) [2023-12-26 03:36:46,524][123091] Updated weights for policy 0, policy_version 504333 (0.0010) [2023-12-26 03:36:47,189][123091] Updated weights for policy 0, policy_version 504343 (0.0007) [2023-12-26 03:36:47,191][123090] Updated weights for policy 1, policy_version 500836 (0.0006) [2023-12-26 03:36:47,246][123091] Updated weights for policy 0, policy_version 504353 (0.0005) [2023-12-26 03:36:47,251][123090] Updated weights for policy 1, policy_version 500846 (0.0005) [2023-12-26 03:36:47,297][123091] Updated weights for policy 0, policy_version 504363 (0.0005) [2023-12-26 03:36:47,306][123090] Updated weights for policy 1, policy_version 500856 (0.0005) [2023-12-26 03:36:47,986][123090] Updated weights for policy 1, policy_version 500866 (0.0006) [2023-12-26 03:36:48,002][123091] Updated weights for policy 0, policy_version 504373 (0.0006) [2023-12-26 03:36:48,050][123090] Updated weights for policy 1, policy_version 500876 (0.0011) [2023-12-26 03:36:48,053][123091] Updated weights for policy 0, policy_version 504383 (0.0010) [2023-12-26 03:36:48,117][123090] Updated weights for policy 1, policy_version 500886 (0.0008) [2023-12-26 03:36:48,121][123091] Updated weights for policy 0, policy_version 504393 (0.0007) [2023-12-26 03:36:48,177][123090] Updated weights for policy 1, policy_version 500896 (0.0008) [2023-12-26 03:36:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 257359872. Throughput: 0: 8855.0, 1: 8711.7. Samples: 257374104. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:48,784][121949] Avg episode reward: [(0, '6233.427'), (1, '5369.959')] [2023-12-26 03:36:48,891][123091] Updated weights for policy 0, policy_version 504403 (0.0009) [2023-12-26 03:36:48,946][123091] Updated weights for policy 0, policy_version 504413 (0.0011) [2023-12-26 03:36:48,993][123090] Updated weights for policy 1, policy_version 500906 (0.0009) [2023-12-26 03:36:48,998][123091] Updated weights for policy 0, policy_version 504423 (0.0011) [2023-12-26 03:36:49,044][123090] Updated weights for policy 1, policy_version 500916 (0.0010) [2023-12-26 03:36:49,092][123090] Updated weights for policy 1, policy_version 500927 (0.0007) [2023-12-26 03:36:49,822][123091] Updated weights for policy 0, policy_version 504433 (0.0011) [2023-12-26 03:36:49,886][123091] Updated weights for policy 0, policy_version 504443 (0.0011) [2023-12-26 03:36:49,906][123090] Updated weights for policy 1, policy_version 500937 (0.0007) [2023-12-26 03:36:49,942][123091] Updated weights for policy 0, policy_version 504453 (0.0010) [2023-12-26 03:36:49,981][123090] Updated weights for policy 1, policy_version 500947 (0.0007) [2023-12-26 03:36:50,006][123091] Updated weights for policy 0, policy_version 504463 (0.0010) [2023-12-26 03:36:50,046][123090] Updated weights for policy 1, policy_version 500957 (0.0009) [2023-12-26 03:36:50,840][123091] Updated weights for policy 0, policy_version 504473 (0.0006) [2023-12-26 03:36:50,896][123091] Updated weights for policy 0, policy_version 504483 (0.0007) [2023-12-26 03:36:50,896][123090] Updated weights for policy 1, policy_version 500967 (0.0008) [2023-12-26 03:36:50,952][123091] Updated weights for policy 0, policy_version 504493 (0.0007) [2023-12-26 03:36:50,964][123090] Updated weights for policy 1, policy_version 500977 (0.0007) [2023-12-26 03:36:51,035][123090] Updated weights for policy 1, policy_version 500987 (0.0009) [2023-12-26 03:36:51,794][123091] Updated weights for policy 0, policy_version 504503 (0.0010) [2023-12-26 03:36:51,830][123090] Updated weights for policy 1, policy_version 500997 (0.0008) [2023-12-26 03:36:51,861][123091] Updated weights for policy 0, policy_version 504513 (0.0011) [2023-12-26 03:36:51,895][123090] Updated weights for policy 1, policy_version 501007 (0.0006) [2023-12-26 03:36:51,916][123091] Updated weights for policy 0, policy_version 504523 (0.0011) [2023-12-26 03:36:51,958][123090] Updated weights for policy 1, policy_version 501017 (0.0007) [2023-12-26 03:36:52,722][123091] Updated weights for policy 0, policy_version 504533 (0.0010) [2023-12-26 03:36:52,795][123091] Updated weights for policy 0, policy_version 504543 (0.0008) [2023-12-26 03:36:52,798][123090] Updated weights for policy 1, policy_version 501027 (0.0008) [2023-12-26 03:36:52,853][123090] Updated weights for policy 1, policy_version 501037 (0.0009) [2023-12-26 03:36:52,854][123091] Updated weights for policy 0, policy_version 504553 (0.0010) [2023-12-26 03:36:52,914][123090] Updated weights for policy 1, policy_version 501047 (0.0009) [2023-12-26 03:36:53,489][123091] Updated weights for policy 0, policy_version 504563 (0.0008) [2023-12-26 03:36:53,534][123091] Updated weights for policy 0, policy_version 504573 (0.0006) [2023-12-26 03:36:53,577][123091] Updated weights for policy 0, policy_version 504583 (0.0010) [2023-12-26 03:36:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 257449984. Throughput: 0: 8809.2, 1: 8721.6. Samples: 257426152. Policy #0 lag: (min: 31.0, avg: 40.7, max: 63.0) [2023-12-26 03:36:53,785][121949] Avg episode reward: [(0, '6234.056'), (1, '5120.362')] [2023-12-26 03:36:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000504592_129179648.pth... [2023-12-26 03:36:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000501056_128270336.pth... [2023-12-26 03:36:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000503536_128909312.pth [2023-12-26 03:36:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000500032_128008192.pth [2023-12-26 03:36:53,826][123090] Updated weights for policy 1, policy_version 501057 (0.0010) [2023-12-26 03:36:53,894][123090] Updated weights for policy 1, policy_version 501067 (0.0010) [2023-12-26 03:36:53,949][123090] Updated weights for policy 1, policy_version 501077 (0.0010) [2023-12-26 03:36:54,004][123090] Updated weights for policy 1, policy_version 501087 (0.0011) [2023-12-26 03:36:54,297][123091] Updated weights for policy 0, policy_version 504593 (0.0010) [2023-12-26 03:36:54,349][123091] Updated weights for policy 0, policy_version 504603 (0.0005) [2023-12-26 03:36:54,400][123091] Updated weights for policy 0, policy_version 504613 (0.0005) [2023-12-26 03:36:54,457][123091] Updated weights for policy 0, policy_version 504623 (0.0005) [2023-12-26 03:36:54,802][123090] Updated weights for policy 1, policy_version 501097 (0.0006) [2023-12-26 03:36:54,866][123090] Updated weights for policy 1, policy_version 501107 (0.0009) [2023-12-26 03:36:54,928][123090] Updated weights for policy 1, policy_version 501117 (0.0010) [2023-12-26 03:36:55,086][123091] Updated weights for policy 0, policy_version 504633 (0.0010) [2023-12-26 03:36:55,138][123091] Updated weights for policy 0, policy_version 504643 (0.0006) [2023-12-26 03:36:55,198][123091] Updated weights for policy 0, policy_version 504654 (0.0007) [2023-12-26 03:36:55,756][123090] Updated weights for policy 1, policy_version 501127 (0.0010) [2023-12-26 03:36:55,804][123090] Updated weights for policy 1, policy_version 501137 (0.0010) [2023-12-26 03:36:55,859][123090] Updated weights for policy 1, policy_version 501147 (0.0010) [2023-12-26 03:36:55,918][123091] Updated weights for policy 0, policy_version 504664 (0.0006) [2023-12-26 03:36:55,971][123091] Updated weights for policy 0, policy_version 504674 (0.0005) [2023-12-26 03:36:56,018][123091] Updated weights for policy 0, policy_version 504684 (0.0005) [2023-12-26 03:36:56,607][123090] Updated weights for policy 1, policy_version 501157 (0.0008) [2023-12-26 03:36:56,666][123090] Updated weights for policy 1, policy_version 501167 (0.0007) [2023-12-26 03:36:56,697][123091] Updated weights for policy 0, policy_version 504694 (0.0006) [2023-12-26 03:36:56,721][123090] Updated weights for policy 1, policy_version 501177 (0.0010) [2023-12-26 03:36:56,746][123091] Updated weights for policy 0, policy_version 504704 (0.0006) [2023-12-26 03:36:56,798][123091] Updated weights for policy 0, policy_version 504714 (0.0006) [2023-12-26 03:36:57,499][123090] Updated weights for policy 1, policy_version 501187 (0.0010) [2023-12-26 03:36:57,515][123091] Updated weights for policy 0, policy_version 504724 (0.0007) [2023-12-26 03:36:57,565][123090] Updated weights for policy 1, policy_version 501197 (0.0010) [2023-12-26 03:36:57,566][123091] Updated weights for policy 0, policy_version 504734 (0.0007) [2023-12-26 03:36:57,624][123090] Updated weights for policy 1, policy_version 501207 (0.0010) [2023-12-26 03:36:57,633][123091] Updated weights for policy 0, policy_version 504744 (0.0005) [2023-12-26 03:36:58,349][123091] Updated weights for policy 0, policy_version 504754 (0.0007) [2023-12-26 03:36:58,421][123091] Updated weights for policy 0, policy_version 504764 (0.0011) [2023-12-26 03:36:58,465][123090] Updated weights for policy 1, policy_version 501217 (0.0010) [2023-12-26 03:36:58,479][123091] Updated weights for policy 0, policy_version 504774 (0.0010) [2023-12-26 03:36:58,529][123090] Updated weights for policy 1, policy_version 501227 (0.0008) [2023-12-26 03:36:58,540][123091] Updated weights for policy 0, policy_version 504784 (0.0010) [2023-12-26 03:36:58,595][123090] Updated weights for policy 1, policy_version 501237 (0.0010) [2023-12-26 03:36:58,673][123090] Updated weights for policy 1, policy_version 501247 (0.0010) [2023-12-26 03:36:58,785][121949] Fps is (10 sec: 18840.4, 60 sec: 17749.1, 300 sec: 17689.1). Total num frames: 257548288. Throughput: 0: 9013.7, 1: 8749.3. Samples: 257537888. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:36:58,785][121949] Avg episode reward: [(0, '6195.513'), (1, '5186.278')] [2023-12-26 03:36:59,440][123091] Updated weights for policy 0, policy_version 504794 (0.0009) [2023-12-26 03:36:59,443][123090] Updated weights for policy 1, policy_version 501257 (0.0008) [2023-12-26 03:36:59,498][123091] Updated weights for policy 0, policy_version 504804 (0.0010) [2023-12-26 03:36:59,508][123090] Updated weights for policy 1, policy_version 501267 (0.0008) [2023-12-26 03:36:59,558][123091] Updated weights for policy 0, policy_version 504814 (0.0011) [2023-12-26 03:36:59,560][123090] Updated weights for policy 1, policy_version 501277 (0.0009) [2023-12-26 03:37:00,381][123091] Updated weights for policy 0, policy_version 504824 (0.0008) [2023-12-26 03:37:00,393][123090] Updated weights for policy 1, policy_version 501287 (0.0010) [2023-12-26 03:37:00,425][123091] Updated weights for policy 0, policy_version 504834 (0.0006) [2023-12-26 03:37:00,456][123090] Updated weights for policy 1, policy_version 501297 (0.0011) [2023-12-26 03:37:00,484][123091] Updated weights for policy 0, policy_version 504844 (0.0006) [2023-12-26 03:37:00,524][123090] Updated weights for policy 1, policy_version 501307 (0.0011) [2023-12-26 03:37:01,290][123091] Updated weights for policy 0, policy_version 504854 (0.0008) [2023-12-26 03:37:01,351][123091] Updated weights for policy 0, policy_version 504864 (0.0010) [2023-12-26 03:37:01,373][123090] Updated weights for policy 1, policy_version 501317 (0.0009) [2023-12-26 03:37:01,417][123091] Updated weights for policy 0, policy_version 504874 (0.0010) [2023-12-26 03:37:01,442][123090] Updated weights for policy 1, policy_version 501327 (0.0007) [2023-12-26 03:37:01,503][123090] Updated weights for policy 1, policy_version 501337 (0.0010) [2023-12-26 03:37:02,250][123091] Updated weights for policy 0, policy_version 504884 (0.0009) [2023-12-26 03:37:02,316][123091] Updated weights for policy 0, policy_version 504894 (0.0008) [2023-12-26 03:37:02,341][123090] Updated weights for policy 1, policy_version 501347 (0.0009) [2023-12-26 03:37:02,383][123091] Updated weights for policy 0, policy_version 504904 (0.0008) [2023-12-26 03:37:02,408][123090] Updated weights for policy 1, policy_version 501357 (0.0008) [2023-12-26 03:37:02,472][123090] Updated weights for policy 1, policy_version 501367 (0.0008) [2023-12-26 03:37:03,113][123091] Updated weights for policy 0, policy_version 504914 (0.0008) [2023-12-26 03:37:03,185][123091] Updated weights for policy 0, policy_version 504924 (0.0005) [2023-12-26 03:37:03,251][123091] Updated weights for policy 0, policy_version 504934 (0.0005) [2023-12-26 03:37:03,307][123090] Updated weights for policy 1, policy_version 501377 (0.0009) [2023-12-26 03:37:03,312][123091] Updated weights for policy 0, policy_version 504944 (0.0005) [2023-12-26 03:37:03,362][123090] Updated weights for policy 1, policy_version 501387 (0.0006) [2023-12-26 03:37:03,423][123090] Updated weights for policy 1, policy_version 501397 (0.0006) [2023-12-26 03:37:03,500][123090] Updated weights for policy 1, policy_version 501407 (0.0005) [2023-12-26 03:37:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 257630208. Throughput: 0: 9039.1, 1: 8776.2. Samples: 257643172. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:03,785][121949] Avg episode reward: [(0, '6132.618'), (1, '5256.702')] [2023-12-26 03:37:03,930][123091] Updated weights for policy 0, policy_version 504954 (0.0007) [2023-12-26 03:37:03,981][123091] Updated weights for policy 0, policy_version 504964 (0.0009) [2023-12-26 03:37:04,032][123091] Updated weights for policy 0, policy_version 504974 (0.0009) [2023-12-26 03:37:04,171][123090] Updated weights for policy 1, policy_version 501417 (0.0008) [2023-12-26 03:37:04,235][123090] Updated weights for policy 1, policy_version 501427 (0.0011) [2023-12-26 03:37:04,303][123090] Updated weights for policy 1, policy_version 501437 (0.0011) [2023-12-26 03:37:04,813][123091] Updated weights for policy 0, policy_version 504984 (0.0006) [2023-12-26 03:37:04,865][123091] Updated weights for policy 0, policy_version 504994 (0.0005) [2023-12-26 03:37:04,910][123091] Updated weights for policy 0, policy_version 505004 (0.0005) [2023-12-26 03:37:05,151][123090] Updated weights for policy 1, policy_version 501447 (0.0010) [2023-12-26 03:37:05,203][123090] Updated weights for policy 1, policy_version 501457 (0.0010) [2023-12-26 03:37:05,257][123090] Updated weights for policy 1, policy_version 501467 (0.0010) [2023-12-26 03:37:05,547][123091] Updated weights for policy 0, policy_version 505014 (0.0005) [2023-12-26 03:37:05,594][123091] Updated weights for policy 0, policy_version 505024 (0.0005) [2023-12-26 03:37:05,644][123091] Updated weights for policy 0, policy_version 505034 (0.0005) [2023-12-26 03:37:05,959][123090] Updated weights for policy 1, policy_version 501477 (0.0011) [2023-12-26 03:37:06,015][123090] Updated weights for policy 1, policy_version 501487 (0.0010) [2023-12-26 03:37:06,067][123090] Updated weights for policy 1, policy_version 501497 (0.0010) [2023-12-26 03:37:06,402][123091] Updated weights for policy 0, policy_version 505044 (0.0008) [2023-12-26 03:37:06,470][123091] Updated weights for policy 0, policy_version 505054 (0.0011) [2023-12-26 03:37:06,541][123091] Updated weights for policy 0, policy_version 505064 (0.0011) [2023-12-26 03:37:06,880][123090] Updated weights for policy 1, policy_version 501507 (0.0011) [2023-12-26 03:37:06,944][123090] Updated weights for policy 1, policy_version 501517 (0.0010) [2023-12-26 03:37:07,019][123090] Updated weights for policy 1, policy_version 501527 (0.0011) [2023-12-26 03:37:07,287][123091] Updated weights for policy 0, policy_version 505074 (0.0010) [2023-12-26 03:37:07,343][123091] Updated weights for policy 0, policy_version 505084 (0.0005) [2023-12-26 03:37:07,406][123091] Updated weights for policy 0, policy_version 505094 (0.0007) [2023-12-26 03:37:07,466][123091] Updated weights for policy 0, policy_version 505104 (0.0008) [2023-12-26 03:37:07,836][123090] Updated weights for policy 1, policy_version 501537 (0.0010) [2023-12-26 03:37:07,916][123090] Updated weights for policy 1, policy_version 501547 (0.0010) [2023-12-26 03:37:07,979][123090] Updated weights for policy 1, policy_version 501557 (0.0007) [2023-12-26 03:37:08,043][123090] Updated weights for policy 1, policy_version 501567 (0.0009) [2023-12-26 03:37:08,136][123091] Updated weights for policy 0, policy_version 505114 (0.0010) [2023-12-26 03:37:08,201][123091] Updated weights for policy 0, policy_version 505124 (0.0010) [2023-12-26 03:37:08,273][123091] Updated weights for policy 0, policy_version 505134 (0.0010) [2023-12-26 03:37:08,784][121949] Fps is (10 sec: 17204.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 257720320. Throughput: 0: 9138.4, 1: 8775.9. Samples: 257700100. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:08,785][121949] Avg episode reward: [(0, '6153.630'), (1, '5327.879')] [2023-12-26 03:37:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000505136_129318912.pth... [2023-12-26 03:37:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000504048_129040384.pth [2023-12-26 03:37:08,840][123090] Updated weights for policy 1, policy_version 501577 (0.0010) [2023-12-26 03:37:08,907][123090] Updated weights for policy 1, policy_version 501587 (0.0010) [2023-12-26 03:37:08,963][123090] Updated weights for policy 1, policy_version 501597 (0.0010) [2023-12-26 03:37:08,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000501600_128409600.pth... [2023-12-26 03:37:08,985][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000500576_128147456.pth [2023-12-26 03:37:09,010][123091] Updated weights for policy 0, policy_version 505144 (0.0010) [2023-12-26 03:37:09,057][123091] Updated weights for policy 0, policy_version 505154 (0.0010) [2023-12-26 03:37:09,102][123091] Updated weights for policy 0, policy_version 505164 (0.0009) [2023-12-26 03:37:09,789][123090] Updated weights for policy 1, policy_version 501607 (0.0011) [2023-12-26 03:37:09,861][123090] Updated weights for policy 1, policy_version 501617 (0.0010) [2023-12-26 03:37:09,936][123090] Updated weights for policy 1, policy_version 501627 (0.0011) [2023-12-26 03:37:09,998][123091] Updated weights for policy 0, policy_version 505174 (0.0009) [2023-12-26 03:37:10,062][123091] Updated weights for policy 0, policy_version 505184 (0.0010) [2023-12-26 03:37:10,123][123091] Updated weights for policy 0, policy_version 505194 (0.0009) [2023-12-26 03:37:10,794][123090] Updated weights for policy 1, policy_version 501637 (0.0008) [2023-12-26 03:37:10,857][123090] Updated weights for policy 1, policy_version 501647 (0.0005) [2023-12-26 03:37:10,923][123090] Updated weights for policy 1, policy_version 501657 (0.0005) [2023-12-26 03:37:10,972][123091] Updated weights for policy 0, policy_version 505204 (0.0008) [2023-12-26 03:37:11,041][123091] Updated weights for policy 0, policy_version 505214 (0.0007) [2023-12-26 03:37:11,111][123091] Updated weights for policy 0, policy_version 505224 (0.0008) [2023-12-26 03:37:11,738][123090] Updated weights for policy 1, policy_version 501667 (0.0008) [2023-12-26 03:37:11,809][123090] Updated weights for policy 1, policy_version 501677 (0.0010) [2023-12-26 03:37:11,876][123090] Updated weights for policy 1, policy_version 501687 (0.0010) [2023-12-26 03:37:11,924][123091] Updated weights for policy 0, policy_version 505234 (0.0008) [2023-12-26 03:37:11,996][123091] Updated weights for policy 0, policy_version 505244 (0.0006) [2023-12-26 03:37:12,069][123091] Updated weights for policy 0, policy_version 505254 (0.0009) [2023-12-26 03:37:12,137][123091] Updated weights for policy 0, policy_version 505264 (0.0009) [2023-12-26 03:37:12,780][123090] Updated weights for policy 1, policy_version 501697 (0.0009) [2023-12-26 03:37:12,853][123090] Updated weights for policy 1, policy_version 501707 (0.0009) [2023-12-26 03:37:12,858][123091] Updated weights for policy 0, policy_version 505274 (0.0006) [2023-12-26 03:37:12,914][123091] Updated weights for policy 0, policy_version 505284 (0.0007) [2023-12-26 03:37:12,925][123090] Updated weights for policy 1, policy_version 501717 (0.0009) [2023-12-26 03:37:12,965][123091] Updated weights for policy 0, policy_version 505294 (0.0006) [2023-12-26 03:37:12,998][123090] Updated weights for policy 1, policy_version 501727 (0.0010) [2023-12-26 03:37:13,619][123091] Updated weights for policy 0, policy_version 505304 (0.0006) [2023-12-26 03:37:13,695][123091] Updated weights for policy 0, policy_version 505314 (0.0006) [2023-12-26 03:37:13,757][123091] Updated weights for policy 0, policy_version 505324 (0.0009) [2023-12-26 03:37:13,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 257802240. Throughput: 0: 9192.7, 1: 8708.8. Samples: 257803956. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:13,786][121949] Avg episode reward: [(0, '6120.826'), (1, '5421.579')] [2023-12-26 03:37:13,787][123090] Updated weights for policy 1, policy_version 501737 (0.0005) [2023-12-26 03:37:13,845][123090] Updated weights for policy 1, policy_version 501747 (0.0007) [2023-12-26 03:37:13,900][123090] Updated weights for policy 1, policy_version 501757 (0.0008) [2023-12-26 03:37:14,459][123091] Updated weights for policy 0, policy_version 505334 (0.0007) [2023-12-26 03:37:14,520][123091] Updated weights for policy 0, policy_version 505344 (0.0008) [2023-12-26 03:37:14,574][123091] Updated weights for policy 0, policy_version 505354 (0.0009) [2023-12-26 03:37:14,637][123090] Updated weights for policy 1, policy_version 501767 (0.0007) [2023-12-26 03:37:14,707][123090] Updated weights for policy 1, policy_version 501777 (0.0009) [2023-12-26 03:37:14,770][123090] Updated weights for policy 1, policy_version 501787 (0.0010) [2023-12-26 03:37:15,467][123091] Updated weights for policy 0, policy_version 505364 (0.0009) [2023-12-26 03:37:15,524][123091] Updated weights for policy 0, policy_version 505375 (0.0009) [2023-12-26 03:37:15,582][123091] Updated weights for policy 0, policy_version 505385 (0.0009) [2023-12-26 03:37:15,608][123090] Updated weights for policy 1, policy_version 501797 (0.0011) [2023-12-26 03:37:15,672][123090] Updated weights for policy 1, policy_version 501807 (0.0011) [2023-12-26 03:37:15,739][123090] Updated weights for policy 1, policy_version 501817 (0.0011) [2023-12-26 03:37:16,446][123090] Updated weights for policy 1, policy_version 501827 (0.0011) [2023-12-26 03:37:16,499][123091] Updated weights for policy 0, policy_version 505395 (0.0007) [2023-12-26 03:37:16,505][123090] Updated weights for policy 1, policy_version 501837 (0.0011) [2023-12-26 03:37:16,569][123091] Updated weights for policy 0, policy_version 505405 (0.0007) [2023-12-26 03:37:16,573][123090] Updated weights for policy 1, policy_version 501847 (0.0011) [2023-12-26 03:37:16,636][123091] Updated weights for policy 0, policy_version 505415 (0.0008) [2023-12-26 03:37:17,419][123090] Updated weights for policy 1, policy_version 501857 (0.0011) [2023-12-26 03:37:17,462][123091] Updated weights for policy 0, policy_version 505425 (0.0008) [2023-12-26 03:37:17,481][123090] Updated weights for policy 1, policy_version 501867 (0.0010) [2023-12-26 03:37:17,526][123091] Updated weights for policy 0, policy_version 505435 (0.0006) [2023-12-26 03:37:17,546][123090] Updated weights for policy 1, policy_version 501877 (0.0010) [2023-12-26 03:37:17,593][123091] Updated weights for policy 0, policy_version 505445 (0.0006) [2023-12-26 03:37:17,613][123090] Updated weights for policy 1, policy_version 501887 (0.0010) [2023-12-26 03:37:17,649][123091] Updated weights for policy 0, policy_version 505455 (0.0007) [2023-12-26 03:37:18,278][123091] Updated weights for policy 0, policy_version 505465 (0.0006) [2023-12-26 03:37:18,283][123090] Updated weights for policy 1, policy_version 501897 (0.0006) [2023-12-26 03:37:18,343][123091] Updated weights for policy 0, policy_version 505475 (0.0007) [2023-12-26 03:37:18,353][123090] Updated weights for policy 1, policy_version 501907 (0.0008) [2023-12-26 03:37:18,405][123090] Updated weights for policy 1, policy_version 501917 (0.0010) [2023-12-26 03:37:18,405][123091] Updated weights for policy 0, policy_version 505485 (0.0009) [2023-12-26 03:37:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 257900544. Throughput: 0: 9151.1, 1: 8671.7. Samples: 257911452. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:18,785][121949] Avg episode reward: [(0, '6111.007'), (1, '5311.107')] [2023-12-26 03:37:19,170][123091] Updated weights for policy 0, policy_version 505495 (0.0006) [2023-12-26 03:37:19,190][123090] Updated weights for policy 1, policy_version 501927 (0.0011) [2023-12-26 03:37:19,237][123091] Updated weights for policy 0, policy_version 505505 (0.0007) [2023-12-26 03:37:19,258][123090] Updated weights for policy 1, policy_version 501937 (0.0009) [2023-12-26 03:37:19,300][123091] Updated weights for policy 0, policy_version 505515 (0.0008) [2023-12-26 03:37:19,315][123090] Updated weights for policy 1, policy_version 501947 (0.0011) [2023-12-26 03:37:20,138][123090] Updated weights for policy 1, policy_version 501957 (0.0008) [2023-12-26 03:37:20,141][123091] Updated weights for policy 0, policy_version 505525 (0.0008) [2023-12-26 03:37:20,186][123090] Updated weights for policy 1, policy_version 501967 (0.0008) [2023-12-26 03:37:20,202][123091] Updated weights for policy 0, policy_version 505535 (0.0007) [2023-12-26 03:37:20,237][123090] Updated weights for policy 1, policy_version 501977 (0.0008) [2023-12-26 03:37:20,268][123091] Updated weights for policy 0, policy_version 505545 (0.0008) [2023-12-26 03:37:21,036][123090] Updated weights for policy 1, policy_version 501987 (0.0008) [2023-12-26 03:37:21,106][123090] Updated weights for policy 1, policy_version 501997 (0.0009) [2023-12-26 03:37:21,159][123091] Updated weights for policy 0, policy_version 505555 (0.0010) [2023-12-26 03:37:21,174][123090] Updated weights for policy 1, policy_version 502007 (0.0008) [2023-12-26 03:37:21,220][123091] Updated weights for policy 0, policy_version 505565 (0.0009) [2023-12-26 03:37:21,286][123091] Updated weights for policy 0, policy_version 505575 (0.0011) [2023-12-26 03:37:21,946][123090] Updated weights for policy 1, policy_version 502017 (0.0006) [2023-12-26 03:37:22,017][123090] Updated weights for policy 1, policy_version 502027 (0.0007) [2023-12-26 03:37:22,084][123090] Updated weights for policy 1, policy_version 502037 (0.0008) [2023-12-26 03:37:22,152][123090] Updated weights for policy 1, policy_version 502047 (0.0008) [2023-12-26 03:37:22,199][123091] Updated weights for policy 0, policy_version 505585 (0.0011) [2023-12-26 03:37:22,263][123091] Updated weights for policy 0, policy_version 505595 (0.0010) [2023-12-26 03:37:22,315][123091] Updated weights for policy 0, policy_version 505605 (0.0010) [2023-12-26 03:37:22,381][123091] Updated weights for policy 0, policy_version 505615 (0.0008) [2023-12-26 03:37:22,985][123090] Updated weights for policy 1, policy_version 502057 (0.0009) [2023-12-26 03:37:23,038][123090] Updated weights for policy 1, policy_version 502067 (0.0009) [2023-12-26 03:37:23,085][123090] Updated weights for policy 1, policy_version 502077 (0.0008) [2023-12-26 03:37:23,128][123091] Updated weights for policy 0, policy_version 505625 (0.0010) [2023-12-26 03:37:23,199][123091] Updated weights for policy 0, policy_version 505635 (0.0011) [2023-12-26 03:37:23,261][123091] Updated weights for policy 0, policy_version 505645 (0.0010) [2023-12-26 03:37:23,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 257982464. Throughput: 0: 9103.7, 1: 8674.4. Samples: 257962776. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:23,785][121949] Avg episode reward: [(0, '5920.585'), (1, '5478.838')] [2023-12-26 03:37:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000505648_129449984.pth... [2023-12-26 03:37:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000502080_128532480.pth... [2023-12-26 03:37:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000504592_129179648.pth [2023-12-26 03:37:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000501056_128270336.pth [2023-12-26 03:37:23,896][123090] Updated weights for policy 1, policy_version 502087 (0.0006) [2023-12-26 03:37:23,964][123090] Updated weights for policy 1, policy_version 502097 (0.0005) [2023-12-26 03:37:24,019][123090] Updated weights for policy 1, policy_version 502107 (0.0009) [2023-12-26 03:37:24,042][123091] Updated weights for policy 0, policy_version 505655 (0.0009) [2023-12-26 03:37:24,092][123091] Updated weights for policy 0, policy_version 505665 (0.0009) [2023-12-26 03:37:24,149][123091] Updated weights for policy 0, policy_version 505675 (0.0008) [2023-12-26 03:37:24,792][123090] Updated weights for policy 1, policy_version 502117 (0.0009) [2023-12-26 03:37:24,855][123090] Updated weights for policy 1, policy_version 502127 (0.0007) [2023-12-26 03:37:24,903][123090] Updated weights for policy 1, policy_version 502137 (0.0009) [2023-12-26 03:37:25,009][123091] Updated weights for policy 0, policy_version 505685 (0.0009) [2023-12-26 03:37:25,063][123091] Updated weights for policy 0, policy_version 505695 (0.0010) [2023-12-26 03:37:25,114][123091] Updated weights for policy 0, policy_version 505705 (0.0010) [2023-12-26 03:37:25,692][123090] Updated weights for policy 1, policy_version 502147 (0.0007) [2023-12-26 03:37:25,752][123090] Updated weights for policy 1, policy_version 502157 (0.0005) [2023-12-26 03:37:25,800][123090] Updated weights for policy 1, policy_version 502167 (0.0005) [2023-12-26 03:37:25,890][123091] Updated weights for policy 0, policy_version 505715 (0.0010) [2023-12-26 03:37:25,940][123091] Updated weights for policy 0, policy_version 505725 (0.0009) [2023-12-26 03:37:25,996][123091] Updated weights for policy 0, policy_version 505735 (0.0007) [2023-12-26 03:37:26,505][123090] Updated weights for policy 1, policy_version 502177 (0.0006) [2023-12-26 03:37:26,559][123090] Updated weights for policy 1, policy_version 502187 (0.0006) [2023-12-26 03:37:26,615][123090] Updated weights for policy 1, policy_version 502197 (0.0006) [2023-12-26 03:37:26,668][123090] Updated weights for policy 1, policy_version 502207 (0.0006) [2023-12-26 03:37:26,782][123091] Updated weights for policy 0, policy_version 505745 (0.0010) [2023-12-26 03:37:26,841][123091] Updated weights for policy 0, policy_version 505755 (0.0009) [2023-12-26 03:37:26,892][123091] Updated weights for policy 0, policy_version 505765 (0.0008) [2023-12-26 03:37:26,959][123091] Updated weights for policy 0, policy_version 505775 (0.0009) [2023-12-26 03:37:27,381][123090] Updated weights for policy 1, policy_version 502217 (0.0005) [2023-12-26 03:37:27,433][123090] Updated weights for policy 1, policy_version 502227 (0.0005) [2023-12-26 03:37:27,482][123090] Updated weights for policy 1, policy_version 502237 (0.0005) [2023-12-26 03:37:27,768][123091] Updated weights for policy 0, policy_version 505785 (0.0006) [2023-12-26 03:37:27,823][123091] Updated weights for policy 0, policy_version 505795 (0.0005) [2023-12-26 03:37:27,884][123091] Updated weights for policy 0, policy_version 505805 (0.0005) [2023-12-26 03:37:28,140][123090] Updated weights for policy 1, policy_version 502247 (0.0009) [2023-12-26 03:37:28,191][123090] Updated weights for policy 1, policy_version 502257 (0.0010) [2023-12-26 03:37:28,238][123090] Updated weights for policy 1, policy_version 502267 (0.0010) [2023-12-26 03:37:28,563][123091] Updated weights for policy 0, policy_version 505815 (0.0009) [2023-12-26 03:37:28,618][123091] Updated weights for policy 0, policy_version 505825 (0.0010) [2023-12-26 03:37:28,675][123091] Updated weights for policy 0, policy_version 505835 (0.0009) [2023-12-26 03:37:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 258080768. Throughput: 0: 9101.7, 1: 8775.4. Samples: 258070728. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:28,785][121949] Avg episode reward: [(0, '5961.864'), (1, '5424.431')] [2023-12-26 03:37:29,096][123090] Updated weights for policy 1, policy_version 502277 (0.0008) [2023-12-26 03:37:29,164][123090] Updated weights for policy 1, policy_version 502287 (0.0005) [2023-12-26 03:37:29,220][123090] Updated weights for policy 1, policy_version 502297 (0.0007) [2023-12-26 03:37:29,453][123091] Updated weights for policy 0, policy_version 505845 (0.0008) [2023-12-26 03:37:29,505][123091] Updated weights for policy 0, policy_version 505855 (0.0009) [2023-12-26 03:37:29,558][123091] Updated weights for policy 0, policy_version 505865 (0.0008) [2023-12-26 03:37:29,940][123090] Updated weights for policy 1, policy_version 502307 (0.0007) [2023-12-26 03:37:30,009][123090] Updated weights for policy 1, policy_version 502317 (0.0005) [2023-12-26 03:37:30,080][123090] Updated weights for policy 1, policy_version 502327 (0.0006) [2023-12-26 03:37:30,380][123091] Updated weights for policy 0, policy_version 505875 (0.0008) [2023-12-26 03:37:30,448][123091] Updated weights for policy 0, policy_version 505885 (0.0007) [2023-12-26 03:37:30,515][123091] Updated weights for policy 0, policy_version 505895 (0.0008) [2023-12-26 03:37:30,732][123090] Updated weights for policy 1, policy_version 502337 (0.0006) [2023-12-26 03:37:30,786][123090] Updated weights for policy 1, policy_version 502347 (0.0005) [2023-12-26 03:37:30,835][123090] Updated weights for policy 1, policy_version 502357 (0.0008) [2023-12-26 03:37:30,881][123090] Updated weights for policy 1, policy_version 502367 (0.0008) [2023-12-26 03:37:31,356][123091] Updated weights for policy 0, policy_version 505905 (0.0009) [2023-12-26 03:37:31,422][123091] Updated weights for policy 0, policy_version 505915 (0.0010) [2023-12-26 03:37:31,494][123091] Updated weights for policy 0, policy_version 505925 (0.0006) [2023-12-26 03:37:31,574][123091] Updated weights for policy 0, policy_version 505935 (0.0006) [2023-12-26 03:37:31,739][123090] Updated weights for policy 1, policy_version 502377 (0.0009) [2023-12-26 03:37:31,809][123090] Updated weights for policy 1, policy_version 502387 (0.0009) [2023-12-26 03:37:31,879][123090] Updated weights for policy 1, policy_version 502397 (0.0009) [2023-12-26 03:37:32,281][123091] Updated weights for policy 0, policy_version 505945 (0.0010) [2023-12-26 03:37:32,331][123091] Updated weights for policy 0, policy_version 505955 (0.0009) [2023-12-26 03:37:32,400][123091] Updated weights for policy 0, policy_version 505965 (0.0007) [2023-12-26 03:37:32,694][123090] Updated weights for policy 1, policy_version 502407 (0.0010) [2023-12-26 03:37:32,749][123090] Updated weights for policy 1, policy_version 502417 (0.0005) [2023-12-26 03:37:32,804][123090] Updated weights for policy 1, policy_version 502427 (0.0006) [2023-12-26 03:37:33,244][123091] Updated weights for policy 0, policy_version 505975 (0.0009) [2023-12-26 03:37:33,294][123091] Updated weights for policy 0, policy_version 505985 (0.0009) [2023-12-26 03:37:33,346][123091] Updated weights for policy 0, policy_version 505996 (0.0010) [2023-12-26 03:37:33,519][123090] Updated weights for policy 1, policy_version 502437 (0.0007) [2023-12-26 03:37:33,583][123090] Updated weights for policy 1, policy_version 502447 (0.0005) [2023-12-26 03:37:33,633][123090] Updated weights for policy 1, policy_version 502457 (0.0005) [2023-12-26 03:37:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 258170880. Throughput: 0: 9047.1, 1: 8847.6. Samples: 258179368. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:33,785][121949] Avg episode reward: [(0, '6103.340'), (1, '5492.607')] [2023-12-26 03:37:34,271][123091] Updated weights for policy 0, policy_version 506006 (0.0009) [2023-12-26 03:37:34,295][123090] Updated weights for policy 1, policy_version 502467 (0.0006) [2023-12-26 03:37:34,330][123091] Updated weights for policy 0, policy_version 506016 (0.0009) [2023-12-26 03:37:34,342][123090] Updated weights for policy 1, policy_version 502477 (0.0009) [2023-12-26 03:37:34,392][123091] Updated weights for policy 0, policy_version 506026 (0.0009) [2023-12-26 03:37:34,401][123090] Updated weights for policy 1, policy_version 502487 (0.0010) [2023-12-26 03:37:35,160][123090] Updated weights for policy 1, policy_version 502497 (0.0008) [2023-12-26 03:37:35,209][123090] Updated weights for policy 1, policy_version 502507 (0.0010) [2023-12-26 03:37:35,254][123091] Updated weights for policy 0, policy_version 506036 (0.0008) [2023-12-26 03:37:35,272][123090] Updated weights for policy 1, policy_version 502517 (0.0010) [2023-12-26 03:37:35,314][123091] Updated weights for policy 0, policy_version 506046 (0.0006) [2023-12-26 03:37:35,332][123090] Updated weights for policy 1, policy_version 502527 (0.0010) [2023-12-26 03:37:35,377][123091] Updated weights for policy 0, policy_version 506056 (0.0007) [2023-12-26 03:37:35,965][123090] Updated weights for policy 1, policy_version 502537 (0.0006) [2023-12-26 03:37:36,023][123090] Updated weights for policy 1, policy_version 502547 (0.0008) [2023-12-26 03:37:36,074][123090] Updated weights for policy 1, policy_version 502557 (0.0009) [2023-12-26 03:37:36,236][123091] Updated weights for policy 0, policy_version 506066 (0.0010) [2023-12-26 03:37:36,302][123091] Updated weights for policy 0, policy_version 506076 (0.0010) [2023-12-26 03:37:36,372][123091] Updated weights for policy 0, policy_version 506086 (0.0010) [2023-12-26 03:37:36,444][123091] Updated weights for policy 0, policy_version 506096 (0.0010) [2023-12-26 03:37:36,859][123090] Updated weights for policy 1, policy_version 502567 (0.0009) [2023-12-26 03:37:36,921][123090] Updated weights for policy 1, policy_version 502577 (0.0010) [2023-12-26 03:37:36,973][123090] Updated weights for policy 1, policy_version 502587 (0.0010) [2023-12-26 03:37:37,258][123091] Updated weights for policy 0, policy_version 506106 (0.0010) [2023-12-26 03:37:37,306][123091] Updated weights for policy 0, policy_version 506116 (0.0009) [2023-12-26 03:37:37,355][123091] Updated weights for policy 0, policy_version 506126 (0.0009) [2023-12-26 03:37:37,800][123090] Updated weights for policy 1, policy_version 502597 (0.0010) [2023-12-26 03:37:37,865][123090] Updated weights for policy 1, policy_version 502607 (0.0009) [2023-12-26 03:37:37,935][123090] Updated weights for policy 1, policy_version 502617 (0.0009) [2023-12-26 03:37:38,218][123091] Updated weights for policy 0, policy_version 506136 (0.0009) [2023-12-26 03:37:38,276][123091] Updated weights for policy 0, policy_version 506146 (0.0009) [2023-12-26 03:37:38,340][123091] Updated weights for policy 0, policy_version 506156 (0.0010) [2023-12-26 03:37:38,768][123090] Updated weights for policy 1, policy_version 502627 (0.0009) [2023-12-26 03:37:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 258252800. Throughput: 0: 9013.9, 1: 8914.3. Samples: 258232920. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:38,784][121949] Avg episode reward: [(0, '6179.366'), (1, '5745.196')] [2023-12-26 03:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000506160_129581056.pth... [2023-12-26 03:37:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000505136_129318912.pth [2023-12-26 03:37:38,836][123090] Updated weights for policy 1, policy_version 502637 (0.0009) [2023-12-26 03:37:38,896][123090] Updated weights for policy 1, policy_version 502647 (0.0009) [2023-12-26 03:37:38,952][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000502656_128679936.pth... [2023-12-26 03:37:38,956][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000501600_128409600.pth [2023-12-26 03:37:39,179][123091] Updated weights for policy 0, policy_version 506166 (0.0010) [2023-12-26 03:37:39,253][123091] Updated weights for policy 0, policy_version 506176 (0.0009) [2023-12-26 03:37:39,318][123091] Updated weights for policy 0, policy_version 506186 (0.0010) [2023-12-26 03:37:39,729][123090] Updated weights for policy 1, policy_version 502657 (0.0008) [2023-12-26 03:37:39,793][123090] Updated weights for policy 1, policy_version 502667 (0.0009) [2023-12-26 03:37:39,859][123090] Updated weights for policy 1, policy_version 502677 (0.0009) [2023-12-26 03:37:39,926][123090] Updated weights for policy 1, policy_version 502687 (0.0010) [2023-12-26 03:37:40,158][123091] Updated weights for policy 0, policy_version 506196 (0.0007) [2023-12-26 03:37:40,230][123091] Updated weights for policy 0, policy_version 506206 (0.0008) [2023-12-26 03:37:40,305][123091] Updated weights for policy 0, policy_version 506216 (0.0007) [2023-12-26 03:37:40,738][123090] Updated weights for policy 1, policy_version 502697 (0.0010) [2023-12-26 03:37:40,805][123090] Updated weights for policy 1, policy_version 502707 (0.0010) [2023-12-26 03:37:40,870][123090] Updated weights for policy 1, policy_version 502717 (0.0009) [2023-12-26 03:37:41,069][123091] Updated weights for policy 0, policy_version 506226 (0.0007) [2023-12-26 03:37:41,138][123091] Updated weights for policy 0, policy_version 506236 (0.0009) [2023-12-26 03:37:41,203][123091] Updated weights for policy 0, policy_version 506246 (0.0008) [2023-12-26 03:37:41,264][123091] Updated weights for policy 0, policy_version 506256 (0.0009) [2023-12-26 03:37:41,819][123090] Updated weights for policy 1, policy_version 502727 (0.0009) [2023-12-26 03:37:41,877][123090] Updated weights for policy 1, policy_version 502737 (0.0007) [2023-12-26 03:37:41,944][123090] Updated weights for policy 1, policy_version 502747 (0.0006) [2023-12-26 03:37:42,119][123091] Updated weights for policy 0, policy_version 506266 (0.0009) [2023-12-26 03:37:42,173][123091] Updated weights for policy 0, policy_version 506276 (0.0010) [2023-12-26 03:37:42,231][123091] Updated weights for policy 0, policy_version 506287 (0.0010) [2023-12-26 03:37:42,730][123090] Updated weights for policy 1, policy_version 502757 (0.0009) [2023-12-26 03:37:42,793][123090] Updated weights for policy 1, policy_version 502767 (0.0009) [2023-12-26 03:37:42,864][123090] Updated weights for policy 1, policy_version 502777 (0.0008) [2023-12-26 03:37:43,060][123091] Updated weights for policy 0, policy_version 506297 (0.0008) [2023-12-26 03:37:43,115][123091] Updated weights for policy 0, policy_version 506307 (0.0010) [2023-12-26 03:37:43,166][123091] Updated weights for policy 0, policy_version 506317 (0.0010) [2023-12-26 03:37:43,656][123090] Updated weights for policy 1, policy_version 502787 (0.0009) [2023-12-26 03:37:43,714][123090] Updated weights for policy 1, policy_version 502797 (0.0010) [2023-12-26 03:37:43,772][123090] Updated weights for policy 1, policy_version 502807 (0.0010) [2023-12-26 03:37:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 258334720. Throughput: 0: 8815.1, 1: 8879.8. Samples: 258334148. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:43,785][121949] Avg episode reward: [(0, '6152.920'), (1, '5712.868')] [2023-12-26 03:37:43,967][123091] Updated weights for policy 0, policy_version 506327 (0.0010) [2023-12-26 03:37:44,033][123091] Updated weights for policy 0, policy_version 506337 (0.0009) [2023-12-26 03:37:44,095][123091] Updated weights for policy 0, policy_version 506347 (0.0010) [2023-12-26 03:37:44,584][123090] Updated weights for policy 1, policy_version 502817 (0.0010) [2023-12-26 03:37:44,653][123090] Updated weights for policy 1, policy_version 502827 (0.0005) [2023-12-26 03:37:44,721][123090] Updated weights for policy 1, policy_version 502837 (0.0007) [2023-12-26 03:37:44,792][123090] Updated weights for policy 1, policy_version 502847 (0.0010) [2023-12-26 03:37:44,958][123091] Updated weights for policy 0, policy_version 506357 (0.0009) [2023-12-26 03:37:45,024][123091] Updated weights for policy 0, policy_version 506367 (0.0010) [2023-12-26 03:37:45,096][123091] Updated weights for policy 0, policy_version 506377 (0.0010) [2023-12-26 03:37:45,583][123090] Updated weights for policy 1, policy_version 502857 (0.0009) [2023-12-26 03:37:45,650][123090] Updated weights for policy 1, policy_version 502867 (0.0008) [2023-12-26 03:37:45,719][123090] Updated weights for policy 1, policy_version 502877 (0.0009) [2023-12-26 03:37:45,916][123091] Updated weights for policy 0, policy_version 506387 (0.0009) [2023-12-26 03:37:45,981][123091] Updated weights for policy 0, policy_version 506397 (0.0008) [2023-12-26 03:37:46,041][123091] Updated weights for policy 0, policy_version 506408 (0.0010) [2023-12-26 03:37:46,546][123090] Updated weights for policy 1, policy_version 502887 (0.0009) [2023-12-26 03:37:46,600][123090] Updated weights for policy 1, policy_version 502897 (0.0009) [2023-12-26 03:37:46,665][123090] Updated weights for policy 1, policy_version 502909 (0.0010) [2023-12-26 03:37:46,882][123091] Updated weights for policy 0, policy_version 506418 (0.0012) [2023-12-26 03:37:46,949][123091] Updated weights for policy 0, policy_version 506428 (0.0010) [2023-12-26 03:37:47,020][123091] Updated weights for policy 0, policy_version 506438 (0.0010) [2023-12-26 03:37:47,083][123091] Updated weights for policy 0, policy_version 506448 (0.0010) [2023-12-26 03:37:47,497][123090] Updated weights for policy 1, policy_version 502919 (0.0009) [2023-12-26 03:37:47,556][123090] Updated weights for policy 1, policy_version 502929 (0.0009) [2023-12-26 03:37:47,608][123090] Updated weights for policy 1, policy_version 502939 (0.0009) [2023-12-26 03:37:47,903][123091] Updated weights for policy 0, policy_version 506458 (0.0009) [2023-12-26 03:37:47,965][123091] Updated weights for policy 0, policy_version 506468 (0.0009) [2023-12-26 03:37:48,030][123091] Updated weights for policy 0, policy_version 506478 (0.0009) [2023-12-26 03:37:48,476][123090] Updated weights for policy 1, policy_version 502949 (0.0009) [2023-12-26 03:37:48,542][123090] Updated weights for policy 1, policy_version 502959 (0.0008) [2023-12-26 03:37:48,614][123090] Updated weights for policy 1, policy_version 502969 (0.0009) [2023-12-26 03:37:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 258424832. Throughput: 0: 8744.7, 1: 8872.9. Samples: 258435964. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:48,786][121949] Avg episode reward: [(0, '6181.540'), (1, '5675.167')] [2023-12-26 03:37:48,897][123091] Updated weights for policy 0, policy_version 506488 (0.0009) [2023-12-26 03:37:48,949][123091] Updated weights for policy 0, policy_version 506498 (0.0009) [2023-12-26 03:37:49,020][123091] Updated weights for policy 0, policy_version 506508 (0.0007) [2023-12-26 03:37:49,414][123090] Updated weights for policy 1, policy_version 502979 (0.0010) [2023-12-26 03:37:49,483][123090] Updated weights for policy 1, policy_version 502989 (0.0008) [2023-12-26 03:37:49,558][123090] Updated weights for policy 1, policy_version 502999 (0.0006) [2023-12-26 03:37:49,770][123091] Updated weights for policy 0, policy_version 506518 (0.0007) [2023-12-26 03:37:49,837][123091] Updated weights for policy 0, policy_version 506528 (0.0009) [2023-12-26 03:37:49,901][123091] Updated weights for policy 0, policy_version 506538 (0.0010) [2023-12-26 03:37:50,371][123090] Updated weights for policy 1, policy_version 503009 (0.0010) [2023-12-26 03:37:50,423][123090] Updated weights for policy 1, policy_version 503019 (0.0009) [2023-12-26 03:37:50,471][123090] Updated weights for policy 1, policy_version 503029 (0.0009) [2023-12-26 03:37:50,527][123090] Updated weights for policy 1, policy_version 503039 (0.0008) [2023-12-26 03:37:50,748][123091] Updated weights for policy 0, policy_version 506548 (0.0010) [2023-12-26 03:37:50,805][123091] Updated weights for policy 0, policy_version 506558 (0.0011) [2023-12-26 03:37:50,861][123091] Updated weights for policy 0, policy_version 506568 (0.0011) [2023-12-26 03:37:51,387][123090] Updated weights for policy 1, policy_version 503049 (0.0009) [2023-12-26 03:37:51,455][123090] Updated weights for policy 1, policy_version 503059 (0.0009) [2023-12-26 03:37:51,518][123090] Updated weights for policy 1, policy_version 503069 (0.0009) [2023-12-26 03:37:51,699][123091] Updated weights for policy 0, policy_version 506578 (0.0010) [2023-12-26 03:37:51,766][123091] Updated weights for policy 0, policy_version 506588 (0.0009) [2023-12-26 03:37:51,821][123091] Updated weights for policy 0, policy_version 506598 (0.0010) [2023-12-26 03:37:51,874][123091] Updated weights for policy 0, policy_version 506608 (0.0009) [2023-12-26 03:37:52,358][123090] Updated weights for policy 1, policy_version 503079 (0.0010) [2023-12-26 03:37:52,416][123090] Updated weights for policy 1, policy_version 503089 (0.0009) [2023-12-26 03:37:52,471][123090] Updated weights for policy 1, policy_version 503099 (0.0009) [2023-12-26 03:37:52,719][123091] Updated weights for policy 0, policy_version 506618 (0.0010) [2023-12-26 03:37:52,781][123091] Updated weights for policy 0, policy_version 506628 (0.0009) [2023-12-26 03:37:52,841][123091] Updated weights for policy 0, policy_version 506638 (0.0009) [2023-12-26 03:37:53,348][123090] Updated weights for policy 1, policy_version 503109 (0.0009) [2023-12-26 03:37:53,402][123090] Updated weights for policy 1, policy_version 503119 (0.0010) [2023-12-26 03:37:53,459][123090] Updated weights for policy 1, policy_version 503130 (0.0010) [2023-12-26 03:37:53,608][123091] Updated weights for policy 0, policy_version 506648 (0.0009) [2023-12-26 03:37:53,673][123091] Updated weights for policy 0, policy_version 506658 (0.0011) [2023-12-26 03:37:53,729][123091] Updated weights for policy 0, policy_version 506668 (0.0010) [2023-12-26 03:37:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 258514944. Throughput: 0: 8667.4, 1: 8818.0. Samples: 258486948. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:53,785][121949] Avg episode reward: [(0, '6138.261'), (1, '5538.604')] [2023-12-26 03:37:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000506672_129712128.pth... [2023-12-26 03:37:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000503136_128802816.pth... [2023-12-26 03:37:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000505648_129449984.pth [2023-12-26 03:37:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000502080_128532480.pth [2023-12-26 03:37:54,349][123090] Updated weights for policy 1, policy_version 503140 (0.0010) [2023-12-26 03:37:54,378][123091] Updated weights for policy 0, policy_version 506678 (0.0008) [2023-12-26 03:37:54,409][123090] Updated weights for policy 1, policy_version 503150 (0.0010) [2023-12-26 03:37:54,434][123091] Updated weights for policy 0, policy_version 506688 (0.0006) [2023-12-26 03:37:54,472][123090] Updated weights for policy 1, policy_version 503160 (0.0010) [2023-12-26 03:37:54,492][123091] Updated weights for policy 0, policy_version 506698 (0.0008) [2023-12-26 03:37:55,183][123091] Updated weights for policy 0, policy_version 506708 (0.0006) [2023-12-26 03:37:55,190][123090] Updated weights for policy 1, policy_version 503170 (0.0009) [2023-12-26 03:37:55,235][123091] Updated weights for policy 0, policy_version 506718 (0.0005) [2023-12-26 03:37:55,262][123090] Updated weights for policy 1, policy_version 503180 (0.0006) [2023-12-26 03:37:55,283][123091] Updated weights for policy 0, policy_version 506728 (0.0005) [2023-12-26 03:37:55,340][123090] Updated weights for policy 1, policy_version 503190 (0.0005) [2023-12-26 03:37:55,408][123090] Updated weights for policy 1, policy_version 503200 (0.0005) [2023-12-26 03:37:55,947][123091] Updated weights for policy 0, policy_version 506738 (0.0005) [2023-12-26 03:37:56,016][123091] Updated weights for policy 0, policy_version 506748 (0.0005) [2023-12-26 03:37:56,022][123090] Updated weights for policy 1, policy_version 503210 (0.0006) [2023-12-26 03:37:56,074][123091] Updated weights for policy 0, policy_version 506758 (0.0006) [2023-12-26 03:37:56,088][123090] Updated weights for policy 1, policy_version 503220 (0.0008) [2023-12-26 03:37:56,132][123091] Updated weights for policy 0, policy_version 506768 (0.0007) [2023-12-26 03:37:56,141][123090] Updated weights for policy 1, policy_version 503230 (0.0009) [2023-12-26 03:37:56,838][123090] Updated weights for policy 1, policy_version 503240 (0.0007) [2023-12-26 03:37:56,894][123090] Updated weights for policy 1, policy_version 503250 (0.0005) [2023-12-26 03:37:56,918][123091] Updated weights for policy 0, policy_version 506778 (0.0010) [2023-12-26 03:37:56,941][123090] Updated weights for policy 1, policy_version 503260 (0.0005) [2023-12-26 03:37:56,983][123091] Updated weights for policy 0, policy_version 506788 (0.0010) [2023-12-26 03:37:57,059][123091] Updated weights for policy 0, policy_version 506798 (0.0010) [2023-12-26 03:37:57,577][123090] Updated weights for policy 1, policy_version 503270 (0.0007) [2023-12-26 03:37:57,631][123090] Updated weights for policy 1, policy_version 503281 (0.0009) [2023-12-26 03:37:57,683][123090] Updated weights for policy 1, policy_version 503291 (0.0009) [2023-12-26 03:37:57,845][123091] Updated weights for policy 0, policy_version 506808 (0.0010) [2023-12-26 03:37:57,902][123091] Updated weights for policy 0, policy_version 506818 (0.0010) [2023-12-26 03:37:57,945][123091] Updated weights for policy 0, policy_version 506828 (0.0010) [2023-12-26 03:37:58,667][123090] Updated weights for policy 1, policy_version 503301 (0.0009) [2023-12-26 03:37:58,680][123091] Updated weights for policy 0, policy_version 506838 (0.0011) [2023-12-26 03:37:58,740][123090] Updated weights for policy 1, policy_version 503311 (0.0010) [2023-12-26 03:37:58,753][123091] Updated weights for policy 0, policy_version 506848 (0.0010) [2023-12-26 03:37:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 258596864. Throughput: 0: 8738.3, 1: 8950.8. Samples: 258599960. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:37:58,785][121949] Avg episode reward: [(0, '6142.842'), (1, '5547.523')] [2023-12-26 03:37:58,805][123090] Updated weights for policy 1, policy_version 503321 (0.0008) [2023-12-26 03:37:58,820][123091] Updated weights for policy 0, policy_version 506858 (0.0008) [2023-12-26 03:37:59,514][123090] Updated weights for policy 1, policy_version 503331 (0.0007) [2023-12-26 03:37:59,524][123091] Updated weights for policy 0, policy_version 506868 (0.0008) [2023-12-26 03:37:59,563][123090] Updated weights for policy 1, policy_version 503341 (0.0008) [2023-12-26 03:37:59,579][123091] Updated weights for policy 0, policy_version 506878 (0.0005) [2023-12-26 03:37:59,614][123090] Updated weights for policy 1, policy_version 503351 (0.0009) [2023-12-26 03:37:59,639][123091] Updated weights for policy 0, policy_version 506888 (0.0006) [2023-12-26 03:38:00,456][123091] Updated weights for policy 0, policy_version 506898 (0.0010) [2023-12-26 03:38:00,478][123090] Updated weights for policy 1, policy_version 503361 (0.0007) [2023-12-26 03:38:00,511][123091] Updated weights for policy 0, policy_version 506908 (0.0007) [2023-12-26 03:38:00,535][123090] Updated weights for policy 1, policy_version 503371 (0.0010) [2023-12-26 03:38:00,559][123091] Updated weights for policy 0, policy_version 506918 (0.0007) [2023-12-26 03:38:00,592][123090] Updated weights for policy 1, policy_version 503381 (0.0009) [2023-12-26 03:38:00,621][123091] Updated weights for policy 0, policy_version 506928 (0.0006) [2023-12-26 03:38:00,655][123090] Updated weights for policy 1, policy_version 503391 (0.0009) [2023-12-26 03:38:01,449][123090] Updated weights for policy 1, policy_version 503401 (0.0010) [2023-12-26 03:38:01,451][123091] Updated weights for policy 0, policy_version 506938 (0.0006) [2023-12-26 03:38:01,508][123090] Updated weights for policy 1, policy_version 503411 (0.0010) [2023-12-26 03:38:01,512][123091] Updated weights for policy 0, policy_version 506948 (0.0005) [2023-12-26 03:38:01,569][123090] Updated weights for policy 1, policy_version 503421 (0.0013) [2023-12-26 03:38:01,575][123091] Updated weights for policy 0, policy_version 506958 (0.0007) [2023-12-26 03:38:02,349][123090] Updated weights for policy 1, policy_version 503431 (0.0010) [2023-12-26 03:38:02,387][123091] Updated weights for policy 0, policy_version 506968 (0.0008) [2023-12-26 03:38:02,406][123090] Updated weights for policy 1, policy_version 503441 (0.0010) [2023-12-26 03:38:02,436][123091] Updated weights for policy 0, policy_version 506978 (0.0006) [2023-12-26 03:38:02,465][123090] Updated weights for policy 1, policy_version 503451 (0.0010) [2023-12-26 03:38:02,489][123091] Updated weights for policy 0, policy_version 506988 (0.0007) [2023-12-26 03:38:03,214][123090] Updated weights for policy 1, policy_version 503461 (0.0010) [2023-12-26 03:38:03,274][123090] Updated weights for policy 1, policy_version 503471 (0.0005) [2023-12-26 03:38:03,274][123091] Updated weights for policy 0, policy_version 506998 (0.0010) [2023-12-26 03:38:03,323][123091] Updated weights for policy 0, policy_version 507008 (0.0010) [2023-12-26 03:38:03,340][123090] Updated weights for policy 1, policy_version 503481 (0.0006) [2023-12-26 03:38:03,378][123091] Updated weights for policy 0, policy_version 507018 (0.0010) [2023-12-26 03:38:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 258695168. Throughput: 0: 8717.8, 1: 8934.7. Samples: 258705816. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:38:03,785][121949] Avg episode reward: [(0, '6183.619'), (1, '5710.404')] [2023-12-26 03:38:04,085][123090] Updated weights for policy 1, policy_version 503491 (0.0007) [2023-12-26 03:38:04,129][123091] Updated weights for policy 0, policy_version 507028 (0.0010) [2023-12-26 03:38:04,150][123090] Updated weights for policy 1, policy_version 503501 (0.0010) [2023-12-26 03:38:04,184][123091] Updated weights for policy 0, policy_version 507038 (0.0010) [2023-12-26 03:38:04,214][123090] Updated weights for policy 1, policy_version 503511 (0.0010) [2023-12-26 03:38:04,244][123091] Updated weights for policy 0, policy_version 507048 (0.0011) [2023-12-26 03:38:04,963][123091] Updated weights for policy 0, policy_version 507058 (0.0010) [2023-12-26 03:38:05,005][123090] Updated weights for policy 1, policy_version 503521 (0.0011) [2023-12-26 03:38:05,035][123091] Updated weights for policy 0, policy_version 507068 (0.0007) [2023-12-26 03:38:05,061][123090] Updated weights for policy 1, policy_version 503531 (0.0011) [2023-12-26 03:38:05,098][123091] Updated weights for policy 0, policy_version 507078 (0.0011) [2023-12-26 03:38:05,112][123090] Updated weights for policy 1, policy_version 503541 (0.0010) [2023-12-26 03:38:05,156][123091] Updated weights for policy 0, policy_version 507088 (0.0010) [2023-12-26 03:38:05,175][123090] Updated weights for policy 1, policy_version 503551 (0.0010) [2023-12-26 03:38:05,900][123091] Updated weights for policy 0, policy_version 507098 (0.0005) [2023-12-26 03:38:05,962][123091] Updated weights for policy 0, policy_version 507108 (0.0005) [2023-12-26 03:38:06,009][123090] Updated weights for policy 1, policy_version 503561 (0.0010) [2023-12-26 03:38:06,019][123091] Updated weights for policy 0, policy_version 507118 (0.0005) [2023-12-26 03:38:06,071][123090] Updated weights for policy 1, policy_version 503571 (0.0010) [2023-12-26 03:38:06,149][123090] Updated weights for policy 1, policy_version 503581 (0.0010) [2023-12-26 03:38:06,696][123091] Updated weights for policy 0, policy_version 507128 (0.0010) [2023-12-26 03:38:06,748][123091] Updated weights for policy 0, policy_version 507138 (0.0010) [2023-12-26 03:38:06,800][123091] Updated weights for policy 0, policy_version 507148 (0.0011) [2023-12-26 03:38:06,867][123090] Updated weights for policy 1, policy_version 503591 (0.0008) [2023-12-26 03:38:06,930][123090] Updated weights for policy 1, policy_version 503601 (0.0009) [2023-12-26 03:38:06,994][123090] Updated weights for policy 1, policy_version 503611 (0.0010) [2023-12-26 03:38:07,631][123091] Updated weights for policy 0, policy_version 507158 (0.0007) [2023-12-26 03:38:07,688][123091] Updated weights for policy 0, policy_version 507168 (0.0005) [2023-12-26 03:38:07,742][123091] Updated weights for policy 0, policy_version 507178 (0.0007) [2023-12-26 03:38:07,812][123090] Updated weights for policy 1, policy_version 503621 (0.0008) [2023-12-26 03:38:07,859][123090] Updated weights for policy 1, policy_version 503631 (0.0010) [2023-12-26 03:38:07,911][123090] Updated weights for policy 1, policy_version 503641 (0.0010) [2023-12-26 03:38:08,444][123091] Updated weights for policy 0, policy_version 507188 (0.0008) [2023-12-26 03:38:08,497][123091] Updated weights for policy 0, policy_version 507198 (0.0005) [2023-12-26 03:38:08,561][123091] Updated weights for policy 0, policy_version 507208 (0.0006) [2023-12-26 03:38:08,741][123090] Updated weights for policy 1, policy_version 503651 (0.0009) [2023-12-26 03:38:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 258785280. Throughput: 0: 8818.8, 1: 8942.9. Samples: 258762056. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:38:08,785][121949] Avg episode reward: [(0, '6198.666'), (1, '5736.314')] [2023-12-26 03:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000507216_129851392.pth... [2023-12-26 03:38:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000506160_129581056.pth [2023-12-26 03:38:08,807][123090] Updated weights for policy 1, policy_version 503661 (0.0008) [2023-12-26 03:38:08,865][123090] Updated weights for policy 1, policy_version 503671 (0.0008) [2023-12-26 03:38:08,921][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000503680_128942080.pth... [2023-12-26 03:38:08,925][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000502656_128679936.pth [2023-12-26 03:38:09,274][123091] Updated weights for policy 0, policy_version 507218 (0.0011) [2023-12-26 03:38:09,330][123091] Updated weights for policy 0, policy_version 507228 (0.0011) [2023-12-26 03:38:09,402][123091] Updated weights for policy 0, policy_version 507238 (0.0010) [2023-12-26 03:38:09,456][123091] Updated weights for policy 0, policy_version 507248 (0.0010) [2023-12-26 03:38:09,600][123090] Updated weights for policy 1, policy_version 503681 (0.0007) [2023-12-26 03:38:09,664][123090] Updated weights for policy 1, policy_version 503691 (0.0009) [2023-12-26 03:38:09,727][123090] Updated weights for policy 1, policy_version 503701 (0.0010) [2023-12-26 03:38:09,797][123090] Updated weights for policy 1, policy_version 503711 (0.0009) [2023-12-26 03:38:10,302][123091] Updated weights for policy 0, policy_version 507258 (0.0011) [2023-12-26 03:38:10,362][123091] Updated weights for policy 0, policy_version 507268 (0.0010) [2023-12-26 03:38:10,436][123091] Updated weights for policy 0, policy_version 507278 (0.0009) [2023-12-26 03:38:10,589][123090] Updated weights for policy 1, policy_version 503721 (0.0006) [2023-12-26 03:38:10,639][123090] Updated weights for policy 1, policy_version 503731 (0.0005) [2023-12-26 03:38:10,698][123090] Updated weights for policy 1, policy_version 503741 (0.0005) [2023-12-26 03:38:11,279][123091] Updated weights for policy 0, policy_version 507288 (0.0009) [2023-12-26 03:38:11,337][123091] Updated weights for policy 0, policy_version 507298 (0.0009) [2023-12-26 03:38:11,416][123091] Updated weights for policy 0, policy_version 507308 (0.0009) [2023-12-26 03:38:11,461][123090] Updated weights for policy 1, policy_version 503751 (0.0008) [2023-12-26 03:38:11,530][123090] Updated weights for policy 1, policy_version 503761 (0.0009) [2023-12-26 03:38:11,599][123090] Updated weights for policy 1, policy_version 503771 (0.0009) [2023-12-26 03:38:12,255][123091] Updated weights for policy 0, policy_version 507318 (0.0010) [2023-12-26 03:38:12,326][123091] Updated weights for policy 0, policy_version 507328 (0.0011) [2023-12-26 03:38:12,396][123091] Updated weights for policy 0, policy_version 507338 (0.0010) [2023-12-26 03:38:12,454][123090] Updated weights for policy 1, policy_version 503781 (0.0009) [2023-12-26 03:38:12,513][123090] Updated weights for policy 1, policy_version 503791 (0.0009) [2023-12-26 03:38:12,574][123090] Updated weights for policy 1, policy_version 503801 (0.0008) [2023-12-26 03:38:13,238][123091] Updated weights for policy 0, policy_version 507348 (0.0011) [2023-12-26 03:38:13,289][123091] Updated weights for policy 0, policy_version 507358 (0.0010) [2023-12-26 03:38:13,340][123091] Updated weights for policy 0, policy_version 507368 (0.0010) [2023-12-26 03:38:13,419][123090] Updated weights for policy 1, policy_version 503811 (0.0008) [2023-12-26 03:38:13,475][123090] Updated weights for policy 1, policy_version 503821 (0.0009) [2023-12-26 03:38:13,535][123090] Updated weights for policy 1, policy_version 503831 (0.0009) [2023-12-26 03:38:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 258875392. Throughput: 0: 8816.5, 1: 8873.1. Samples: 258866760. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:38:13,785][121949] Avg episode reward: [(0, '6212.497'), (1, '5681.413')] [2023-12-26 03:38:14,059][123091] Updated weights for policy 0, policy_version 507378 (0.0011) [2023-12-26 03:38:14,123][123091] Updated weights for policy 0, policy_version 507388 (0.0011) [2023-12-26 03:38:14,186][123091] Updated weights for policy 0, policy_version 507398 (0.0011) [2023-12-26 03:38:14,233][123091] Updated weights for policy 0, policy_version 507408 (0.0010) [2023-12-26 03:38:14,398][123090] Updated weights for policy 1, policy_version 503841 (0.0009) [2023-12-26 03:38:14,472][123090] Updated weights for policy 1, policy_version 503851 (0.0005) [2023-12-26 03:38:14,531][123090] Updated weights for policy 1, policy_version 503861 (0.0005) [2023-12-26 03:38:14,592][123090] Updated weights for policy 1, policy_version 503871 (0.0010) [2023-12-26 03:38:15,065][123091] Updated weights for policy 0, policy_version 507418 (0.0011) [2023-12-26 03:38:15,119][123091] Updated weights for policy 0, policy_version 507428 (0.0011) [2023-12-26 03:38:15,186][123091] Updated weights for policy 0, policy_version 507438 (0.0011) [2023-12-26 03:38:15,370][123090] Updated weights for policy 1, policy_version 503881 (0.0010) [2023-12-26 03:38:15,432][123090] Updated weights for policy 1, policy_version 503891 (0.0010) [2023-12-26 03:38:15,483][123090] Updated weights for policy 1, policy_version 503901 (0.0010) [2023-12-26 03:38:15,998][123091] Updated weights for policy 0, policy_version 507448 (0.0009) [2023-12-26 03:38:16,058][123091] Updated weights for policy 0, policy_version 507458 (0.0009) [2023-12-26 03:38:16,118][123091] Updated weights for policy 0, policy_version 507468 (0.0008) [2023-12-26 03:38:16,325][123090] Updated weights for policy 1, policy_version 503911 (0.0010) [2023-12-26 03:38:16,375][123090] Updated weights for policy 1, policy_version 503921 (0.0006) [2023-12-26 03:38:16,434][123090] Updated weights for policy 1, policy_version 503931 (0.0007) [2023-12-26 03:38:16,958][123091] Updated weights for policy 0, policy_version 507478 (0.0007) [2023-12-26 03:38:17,024][123091] Updated weights for policy 0, policy_version 507488 (0.0009) [2023-12-26 03:38:17,082][123091] Updated weights for policy 0, policy_version 507498 (0.0006) [2023-12-26 03:38:17,282][123090] Updated weights for policy 1, policy_version 503941 (0.0011) [2023-12-26 03:38:17,342][123090] Updated weights for policy 1, policy_version 503951 (0.0010) [2023-12-26 03:38:17,394][123090] Updated weights for policy 1, policy_version 503961 (0.0010) [2023-12-26 03:38:17,813][123091] Updated weights for policy 0, policy_version 507508 (0.0005) [2023-12-26 03:38:17,860][123091] Updated weights for policy 0, policy_version 507518 (0.0005) [2023-12-26 03:38:17,918][123091] Updated weights for policy 0, policy_version 507528 (0.0005) [2023-12-26 03:38:18,087][123090] Updated weights for policy 1, policy_version 503971 (0.0009) [2023-12-26 03:38:18,136][123090] Updated weights for policy 1, policy_version 503981 (0.0005) [2023-12-26 03:38:18,184][123090] Updated weights for policy 1, policy_version 503991 (0.0005) [2023-12-26 03:38:18,555][123091] Updated weights for policy 0, policy_version 507538 (0.0006) [2023-12-26 03:38:18,619][123091] Updated weights for policy 0, policy_version 507548 (0.0011) [2023-12-26 03:38:18,679][123091] Updated weights for policy 0, policy_version 507558 (0.0011) [2023-12-26 03:38:18,743][123091] Updated weights for policy 0, policy_version 507568 (0.0011) [2023-12-26 03:38:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 258965504. Throughput: 0: 8850.4, 1: 8806.4. Samples: 258973924. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:38:18,785][121949] Avg episode reward: [(0, '6144.533'), (1, '5781.223')] [2023-12-26 03:38:18,974][123090] Updated weights for policy 1, policy_version 504001 (0.0006) [2023-12-26 03:38:19,046][123090] Updated weights for policy 1, policy_version 504011 (0.0007) [2023-12-26 03:38:19,099][123090] Updated weights for policy 1, policy_version 504021 (0.0005) [2023-12-26 03:38:19,158][123090] Updated weights for policy 1, policy_version 504031 (0.0006) [2023-12-26 03:38:19,578][123091] Updated weights for policy 0, policy_version 507578 (0.0009) [2023-12-26 03:38:19,638][123091] Updated weights for policy 0, policy_version 507588 (0.0008) [2023-12-26 03:38:19,699][123091] Updated weights for policy 0, policy_version 507598 (0.0006) [2023-12-26 03:38:19,951][123090] Updated weights for policy 1, policy_version 504041 (0.0011) [2023-12-26 03:38:20,017][123090] Updated weights for policy 1, policy_version 504051 (0.0011) [2023-12-26 03:38:20,075][123090] Updated weights for policy 1, policy_version 504061 (0.0011) [2023-12-26 03:38:20,531][123091] Updated weights for policy 0, policy_version 507608 (0.0008) [2023-12-26 03:38:20,602][123091] Updated weights for policy 0, policy_version 507618 (0.0010) [2023-12-26 03:38:20,671][123091] Updated weights for policy 0, policy_version 507628 (0.0010) [2023-12-26 03:38:20,898][123090] Updated weights for policy 1, policy_version 504071 (0.0010) [2023-12-26 03:38:20,954][123090] Updated weights for policy 1, policy_version 504081 (0.0011) [2023-12-26 03:38:21,007][123090] Updated weights for policy 1, policy_version 504091 (0.0010) [2023-12-26 03:38:21,579][123091] Updated weights for policy 0, policy_version 507638 (0.0009) [2023-12-26 03:38:21,642][123091] Updated weights for policy 0, policy_version 507648 (0.0009) [2023-12-26 03:38:21,711][123091] Updated weights for policy 0, policy_version 507658 (0.0009) [2023-12-26 03:38:21,867][123090] Updated weights for policy 1, policy_version 504101 (0.0010) [2023-12-26 03:38:21,933][123090] Updated weights for policy 1, policy_version 504111 (0.0007) [2023-12-26 03:38:22,001][123090] Updated weights for policy 1, policy_version 504121 (0.0011) [2023-12-26 03:38:22,569][123091] Updated weights for policy 0, policy_version 507668 (0.0010) [2023-12-26 03:38:22,641][123091] Updated weights for policy 0, policy_version 507678 (0.0010) [2023-12-26 03:38:22,711][123091] Updated weights for policy 0, policy_version 507688 (0.0011) [2023-12-26 03:38:22,814][123090] Updated weights for policy 1, policy_version 504131 (0.0010) [2023-12-26 03:38:22,861][123090] Updated weights for policy 1, policy_version 504141 (0.0010) [2023-12-26 03:38:22,923][123090] Updated weights for policy 1, policy_version 504151 (0.0011) [2023-12-26 03:38:23,522][123091] Updated weights for policy 0, policy_version 507698 (0.0011) [2023-12-26 03:38:23,580][123091] Updated weights for policy 0, policy_version 507708 (0.0010) [2023-12-26 03:38:23,637][123091] Updated weights for policy 0, policy_version 507718 (0.0010) [2023-12-26 03:38:23,688][123091] Updated weights for policy 0, policy_version 507728 (0.0010) [2023-12-26 03:38:23,758][123090] Updated weights for policy 1, policy_version 504161 (0.0011) [2023-12-26 03:38:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 259047424. Throughput: 0: 8854.4, 1: 8735.0. Samples: 259024444. Policy #0 lag: (min: 15.0, avg: 16.0, max: 41.0) [2023-12-26 03:38:23,785][121949] Avg episode reward: [(0, '6107.909'), (1, '5743.130')] [2023-12-26 03:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000507728_129982464.pth... [2023-12-26 03:38:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000506672_129712128.pth [2023-12-26 03:38:23,809][123090] Updated weights for policy 1, policy_version 504171 (0.0010) [2023-12-26 03:38:23,852][123090] Updated weights for policy 1, policy_version 504181 (0.0010) [2023-12-26 03:38:23,907][123090] Updated weights for policy 1, policy_version 504191 (0.0010) [2023-12-26 03:38:23,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000504192_129073152.pth... [2023-12-26 03:38:23,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000503136_128802816.pth [2023-12-26 03:38:24,446][123091] Updated weights for policy 0, policy_version 507738 (0.0006) [2023-12-26 03:38:24,512][123091] Updated weights for policy 0, policy_version 507748 (0.0005) [2023-12-26 03:38:24,560][123091] Updated weights for policy 0, policy_version 507758 (0.0005) [2023-12-26 03:38:24,751][123090] Updated weights for policy 1, policy_version 504201 (0.0010) [2023-12-26 03:38:24,818][123090] Updated weights for policy 1, policy_version 504211 (0.0009) [2023-12-26 03:38:24,883][123090] Updated weights for policy 1, policy_version 504221 (0.0009) [2023-12-26 03:38:25,347][123091] Updated weights for policy 0, policy_version 507768 (0.0010) [2023-12-26 03:38:25,410][123091] Updated weights for policy 0, policy_version 507778 (0.0011) [2023-12-26 03:38:25,457][123091] Updated weights for policy 0, policy_version 507788 (0.0010) [2023-12-26 03:38:25,645][123090] Updated weights for policy 1, policy_version 504231 (0.0006) [2023-12-26 03:38:25,705][123090] Updated weights for policy 1, policy_version 504241 (0.0005) [2023-12-26 03:38:25,759][123090] Updated weights for policy 1, policy_version 504251 (0.0006) [2023-12-26 03:38:26,148][123091] Updated weights for policy 0, policy_version 507798 (0.0007) [2023-12-26 03:38:26,213][123091] Updated weights for policy 0, policy_version 507808 (0.0005) [2023-12-26 03:38:26,284][123091] Updated weights for policy 0, policy_version 507818 (0.0005) [2023-12-26 03:38:26,448][123090] Updated weights for policy 1, policy_version 504261 (0.0006) [2023-12-26 03:38:26,500][123090] Updated weights for policy 1, policy_version 504271 (0.0005) [2023-12-26 03:38:26,548][123090] Updated weights for policy 1, policy_version 504281 (0.0005) [2023-12-26 03:38:26,882][123091] Updated weights for policy 0, policy_version 507828 (0.0007) [2023-12-26 03:38:26,948][123091] Updated weights for policy 0, policy_version 507838 (0.0010) [2023-12-26 03:38:27,013][123091] Updated weights for policy 0, policy_version 507848 (0.0010) [2023-12-26 03:38:27,247][123090] Updated weights for policy 1, policy_version 504291 (0.0007) [2023-12-26 03:38:27,303][123090] Updated weights for policy 1, policy_version 504301 (0.0009) [2023-12-26 03:38:27,365][123090] Updated weights for policy 1, policy_version 504311 (0.0010) [2023-12-26 03:38:27,808][123091] Updated weights for policy 0, policy_version 507858 (0.0011) [2023-12-26 03:38:27,862][123091] Updated weights for policy 0, policy_version 507868 (0.0010) [2023-12-26 03:38:27,912][123091] Updated weights for policy 0, policy_version 507878 (0.0010) [2023-12-26 03:38:27,974][123091] Updated weights for policy 0, policy_version 507888 (0.0010) [2023-12-26 03:38:28,038][123090] Updated weights for policy 1, policy_version 504321 (0.0010) [2023-12-26 03:38:28,088][123090] Updated weights for policy 1, policy_version 504331 (0.0005) [2023-12-26 03:38:28,137][123090] Updated weights for policy 1, policy_version 504341 (0.0005) [2023-12-26 03:38:28,184][123090] Updated weights for policy 1, policy_version 504351 (0.0005) [2023-12-26 03:38:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 259137536. Throughput: 0: 8948.0, 1: 8829.7. Samples: 259134144. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:28,785][121949] Avg episode reward: [(0, '6034.878'), (1, '5620.996')] [2023-12-26 03:38:28,802][123091] Updated weights for policy 0, policy_version 507898 (0.0010) [2023-12-26 03:38:28,849][123091] Updated weights for policy 0, policy_version 507908 (0.0010) [2023-12-26 03:38:28,896][123091] Updated weights for policy 0, policy_version 507918 (0.0010) [2023-12-26 03:38:29,008][123090] Updated weights for policy 1, policy_version 504361 (0.0010) [2023-12-26 03:38:29,056][123090] Updated weights for policy 1, policy_version 504371 (0.0010) [2023-12-26 03:38:29,110][123090] Updated weights for policy 1, policy_version 504381 (0.0010) [2023-12-26 03:38:29,739][123091] Updated weights for policy 0, policy_version 507928 (0.0010) [2023-12-26 03:38:29,798][123091] Updated weights for policy 0, policy_version 507938 (0.0010) [2023-12-26 03:38:29,846][123090] Updated weights for policy 1, policy_version 504391 (0.0007) [2023-12-26 03:38:29,864][123091] Updated weights for policy 0, policy_version 507948 (0.0011) [2023-12-26 03:38:29,921][123090] Updated weights for policy 1, policy_version 504401 (0.0008) [2023-12-26 03:38:29,979][123090] Updated weights for policy 1, policy_version 504411 (0.0008) [2023-12-26 03:38:30,691][123091] Updated weights for policy 0, policy_version 507958 (0.0011) [2023-12-26 03:38:30,722][123090] Updated weights for policy 1, policy_version 504421 (0.0008) [2023-12-26 03:38:30,754][123091] Updated weights for policy 0, policy_version 507968 (0.0010) [2023-12-26 03:38:30,776][123090] Updated weights for policy 1, policy_version 504431 (0.0006) [2023-12-26 03:38:30,812][123091] Updated weights for policy 0, policy_version 507978 (0.0010) [2023-12-26 03:38:30,840][123090] Updated weights for policy 1, policy_version 504441 (0.0005) [2023-12-26 03:38:31,637][123091] Updated weights for policy 0, policy_version 507988 (0.0010) [2023-12-26 03:38:31,656][123090] Updated weights for policy 1, policy_version 504451 (0.0009) [2023-12-26 03:38:31,699][123091] Updated weights for policy 0, policy_version 507998 (0.0009) [2023-12-26 03:38:31,721][123090] Updated weights for policy 1, policy_version 504461 (0.0007) [2023-12-26 03:38:31,766][123091] Updated weights for policy 0, policy_version 508008 (0.0009) [2023-12-26 03:38:31,790][123090] Updated weights for policy 1, policy_version 504471 (0.0009) [2023-12-26 03:38:32,587][123090] Updated weights for policy 1, policy_version 504481 (0.0009) [2023-12-26 03:38:32,597][123091] Updated weights for policy 0, policy_version 508018 (0.0008) [2023-12-26 03:38:32,635][123090] Updated weights for policy 1, policy_version 504491 (0.0007) [2023-12-26 03:38:32,647][123091] Updated weights for policy 0, policy_version 508028 (0.0008) [2023-12-26 03:38:32,691][123090] Updated weights for policy 1, policy_version 504501 (0.0008) [2023-12-26 03:38:32,703][123091] Updated weights for policy 0, policy_version 508038 (0.0005) [2023-12-26 03:38:32,758][123090] Updated weights for policy 1, policy_version 504511 (0.0010) [2023-12-26 03:38:32,768][123091] Updated weights for policy 0, policy_version 508048 (0.0006) [2023-12-26 03:38:33,521][123091] Updated weights for policy 0, policy_version 508058 (0.0009) [2023-12-26 03:38:33,567][123090] Updated weights for policy 1, policy_version 504521 (0.0010) [2023-12-26 03:38:33,582][123091] Updated weights for policy 0, policy_version 508068 (0.0006) [2023-12-26 03:38:33,627][123090] Updated weights for policy 1, policy_version 504532 (0.0010) [2023-12-26 03:38:33,635][123091] Updated weights for policy 0, policy_version 508078 (0.0007) [2023-12-26 03:38:33,673][123090] Updated weights for policy 1, policy_version 504542 (0.0010) [2023-12-26 03:38:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 259235840. Throughput: 0: 8974.0, 1: 8913.7. Samples: 259240908. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:33,785][121949] Avg episode reward: [(0, '6057.530'), (1, '5683.564')] [2023-12-26 03:38:34,421][123090] Updated weights for policy 1, policy_version 504552 (0.0007) [2023-12-26 03:38:34,490][123090] Updated weights for policy 1, policy_version 504562 (0.0006) [2023-12-26 03:38:34,542][123091] Updated weights for policy 0, policy_version 508088 (0.0007) [2023-12-26 03:38:34,561][123090] Updated weights for policy 1, policy_version 504572 (0.0006) [2023-12-26 03:38:34,610][123091] Updated weights for policy 0, policy_version 508098 (0.0007) [2023-12-26 03:38:34,682][123091] Updated weights for policy 0, policy_version 508108 (0.0008) [2023-12-26 03:38:35,270][123090] Updated weights for policy 1, policy_version 504582 (0.0008) [2023-12-26 03:38:35,319][123090] Updated weights for policy 1, policy_version 504592 (0.0009) [2023-12-26 03:38:35,376][123090] Updated weights for policy 1, policy_version 504602 (0.0009) [2023-12-26 03:38:35,391][123091] Updated weights for policy 0, policy_version 508118 (0.0008) [2023-12-26 03:38:35,440][123091] Updated weights for policy 0, policy_version 508128 (0.0009) [2023-12-26 03:38:35,486][123091] Updated weights for policy 0, policy_version 508138 (0.0008) [2023-12-26 03:38:36,138][123090] Updated weights for policy 1, policy_version 504612 (0.0009) [2023-12-26 03:38:36,207][123090] Updated weights for policy 1, policy_version 504622 (0.0009) [2023-12-26 03:38:36,274][123090] Updated weights for policy 1, policy_version 504632 (0.0009) [2023-12-26 03:38:36,409][123091] Updated weights for policy 0, policy_version 508148 (0.0010) [2023-12-26 03:38:36,475][123091] Updated weights for policy 0, policy_version 508158 (0.0009) [2023-12-26 03:38:36,545][123091] Updated weights for policy 0, policy_version 508168 (0.0008) [2023-12-26 03:38:37,125][123090] Updated weights for policy 1, policy_version 504642 (0.0010) [2023-12-26 03:38:37,180][123090] Updated weights for policy 1, policy_version 504652 (0.0010) [2023-12-26 03:38:37,238][123090] Updated weights for policy 1, policy_version 504662 (0.0009) [2023-12-26 03:38:37,285][123091] Updated weights for policy 0, policy_version 508178 (0.0009) [2023-12-26 03:38:37,292][123090] Updated weights for policy 1, policy_version 504672 (0.0009) [2023-12-26 03:38:37,349][123091] Updated weights for policy 0, policy_version 508188 (0.0005) [2023-12-26 03:38:37,406][123091] Updated weights for policy 0, policy_version 508198 (0.0005) [2023-12-26 03:38:37,462][123091] Updated weights for policy 0, policy_version 508208 (0.0009) [2023-12-26 03:38:38,202][123090] Updated weights for policy 1, policy_version 504682 (0.0009) [2023-12-26 03:38:38,219][123091] Updated weights for policy 0, policy_version 508218 (0.0010) [2023-12-26 03:38:38,262][123090] Updated weights for policy 1, policy_version 504692 (0.0007) [2023-12-26 03:38:38,264][123091] Updated weights for policy 0, policy_version 508228 (0.0008) [2023-12-26 03:38:38,316][123091] Updated weights for policy 0, policy_version 508238 (0.0009) [2023-12-26 03:38:38,325][123090] Updated weights for policy 1, policy_version 504702 (0.0007) [2023-12-26 03:38:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 259317760. Throughput: 0: 8955.0, 1: 8979.5. Samples: 259293996. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:38,785][121949] Avg episode reward: [(0, '6087.779'), (1, '5696.553')] [2023-12-26 03:38:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000508240_130113536.pth... [2023-12-26 03:38:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000504704_129204224.pth... [2023-12-26 03:38:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000507216_129851392.pth [2023-12-26 03:38:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000503680_128942080.pth [2023-12-26 03:38:39,024][123090] Updated weights for policy 1, policy_version 504712 (0.0009) [2023-12-26 03:38:39,081][123090] Updated weights for policy 1, policy_version 504722 (0.0009) [2023-12-26 03:38:39,140][123090] Updated weights for policy 1, policy_version 504732 (0.0008) [2023-12-26 03:38:39,150][123091] Updated weights for policy 0, policy_version 508248 (0.0009) [2023-12-26 03:38:39,202][123091] Updated weights for policy 0, policy_version 508258 (0.0010) [2023-12-26 03:38:39,265][123091] Updated weights for policy 0, policy_version 508268 (0.0008) [2023-12-26 03:38:39,985][123090] Updated weights for policy 1, policy_version 504742 (0.0009) [2023-12-26 03:38:40,054][123090] Updated weights for policy 1, policy_version 504752 (0.0011) [2023-12-26 03:38:40,096][123091] Updated weights for policy 0, policy_version 508278 (0.0006) [2023-12-26 03:38:40,120][123090] Updated weights for policy 1, policy_version 504762 (0.0010) [2023-12-26 03:38:40,153][123091] Updated weights for policy 0, policy_version 508288 (0.0006) [2023-12-26 03:38:40,217][123091] Updated weights for policy 0, policy_version 508298 (0.0008) [2023-12-26 03:38:40,790][123090] Updated weights for policy 1, policy_version 504772 (0.0008) [2023-12-26 03:38:40,866][123090] Updated weights for policy 1, policy_version 504782 (0.0006) [2023-12-26 03:38:40,941][123090] Updated weights for policy 1, policy_version 504792 (0.0007) [2023-12-26 03:38:41,087][123091] Updated weights for policy 0, policy_version 508308 (0.0008) [2023-12-26 03:38:41,150][123091] Updated weights for policy 0, policy_version 508318 (0.0007) [2023-12-26 03:38:41,219][123091] Updated weights for policy 0, policy_version 508328 (0.0008) [2023-12-26 03:38:41,719][123090] Updated weights for policy 1, policy_version 504802 (0.0006) [2023-12-26 03:38:41,775][123090] Updated weights for policy 1, policy_version 504812 (0.0008) [2023-12-26 03:38:41,837][123090] Updated weights for policy 1, policy_version 504822 (0.0009) [2023-12-26 03:38:41,894][123090] Updated weights for policy 1, policy_version 504832 (0.0009) [2023-12-26 03:38:42,060][123091] Updated weights for policy 0, policy_version 508338 (0.0010) [2023-12-26 03:38:42,125][123091] Updated weights for policy 0, policy_version 508348 (0.0010) [2023-12-26 03:38:42,190][123091] Updated weights for policy 0, policy_version 508358 (0.0010) [2023-12-26 03:38:42,258][123091] Updated weights for policy 0, policy_version 508368 (0.0010) [2023-12-26 03:38:42,788][123090] Updated weights for policy 1, policy_version 504842 (0.0009) [2023-12-26 03:38:42,844][123090] Updated weights for policy 1, policy_version 504852 (0.0009) [2023-12-26 03:38:42,907][123090] Updated weights for policy 1, policy_version 504862 (0.0009) [2023-12-26 03:38:42,967][123091] Updated weights for policy 0, policy_version 508378 (0.0009) [2023-12-26 03:38:43,022][123091] Updated weights for policy 0, policy_version 508388 (0.0010) [2023-12-26 03:38:43,072][123091] Updated weights for policy 0, policy_version 508398 (0.0009) [2023-12-26 03:38:43,771][123091] Updated weights for policy 0, policy_version 508408 (0.0006) [2023-12-26 03:38:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 259399680. Throughput: 0: 8877.8, 1: 8877.5. Samples: 259398948. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:43,785][121949] Avg episode reward: [(0, '6102.641'), (1, '5673.188')] [2023-12-26 03:38:43,799][123090] Updated weights for policy 1, policy_version 504872 (0.0010) [2023-12-26 03:38:43,822][123091] Updated weights for policy 0, policy_version 508418 (0.0005) [2023-12-26 03:38:43,850][123090] Updated weights for policy 1, policy_version 504882 (0.0008) [2023-12-26 03:38:43,872][123091] Updated weights for policy 0, policy_version 508428 (0.0005) [2023-12-26 03:38:43,912][123090] Updated weights for policy 1, policy_version 504893 (0.0009) [2023-12-26 03:38:44,559][123091] Updated weights for policy 0, policy_version 508438 (0.0006) [2023-12-26 03:38:44,607][123091] Updated weights for policy 0, policy_version 508448 (0.0008) [2023-12-26 03:38:44,664][123091] Updated weights for policy 0, policy_version 508458 (0.0010) [2023-12-26 03:38:44,768][123090] Updated weights for policy 1, policy_version 504903 (0.0008) [2023-12-26 03:38:44,836][123090] Updated weights for policy 1, policy_version 504913 (0.0009) [2023-12-26 03:38:44,898][123090] Updated weights for policy 1, policy_version 504923 (0.0009) [2023-12-26 03:38:45,499][123091] Updated weights for policy 0, policy_version 508468 (0.0009) [2023-12-26 03:38:45,560][123091] Updated weights for policy 0, policy_version 508478 (0.0009) [2023-12-26 03:38:45,619][123091] Updated weights for policy 0, policy_version 508488 (0.0011) [2023-12-26 03:38:45,783][123090] Updated weights for policy 1, policy_version 504933 (0.0009) [2023-12-26 03:38:45,837][123090] Updated weights for policy 1, policy_version 504943 (0.0009) [2023-12-26 03:38:45,896][123090] Updated weights for policy 1, policy_version 504953 (0.0010) [2023-12-26 03:38:46,378][123091] Updated weights for policy 0, policy_version 508498 (0.0006) [2023-12-26 03:38:46,425][123091] Updated weights for policy 0, policy_version 508508 (0.0010) [2023-12-26 03:38:46,482][123091] Updated weights for policy 0, policy_version 508518 (0.0011) [2023-12-26 03:38:46,533][123091] Updated weights for policy 0, policy_version 508528 (0.0006) [2023-12-26 03:38:46,625][123090] Updated weights for policy 1, policy_version 504963 (0.0008) [2023-12-26 03:38:46,688][123090] Updated weights for policy 1, policy_version 504973 (0.0011) [2023-12-26 03:38:46,752][123090] Updated weights for policy 1, policy_version 504983 (0.0010) [2023-12-26 03:38:47,273][123091] Updated weights for policy 0, policy_version 508538 (0.0009) [2023-12-26 03:38:47,338][123091] Updated weights for policy 0, policy_version 508548 (0.0008) [2023-12-26 03:38:47,406][123091] Updated weights for policy 0, policy_version 508558 (0.0010) [2023-12-26 03:38:47,633][123090] Updated weights for policy 1, policy_version 504993 (0.0006) [2023-12-26 03:38:47,693][123090] Updated weights for policy 1, policy_version 505003 (0.0010) [2023-12-26 03:38:47,755][123090] Updated weights for policy 1, policy_version 505013 (0.0009) [2023-12-26 03:38:47,809][123090] Updated weights for policy 1, policy_version 505023 (0.0010) [2023-12-26 03:38:48,082][123091] Updated weights for policy 0, policy_version 508568 (0.0006) [2023-12-26 03:38:48,142][123091] Updated weights for policy 0, policy_version 508578 (0.0006) [2023-12-26 03:38:48,201][123091] Updated weights for policy 0, policy_version 508588 (0.0006) [2023-12-26 03:38:48,766][123090] Updated weights for policy 1, policy_version 505033 (0.0010) [2023-12-26 03:38:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 259489792. Throughput: 0: 8981.7, 1: 8811.7. Samples: 259506520. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:48,785][121949] Avg episode reward: [(0, '6074.716'), (1, '5743.829')] [2023-12-26 03:38:48,821][123090] Updated weights for policy 1, policy_version 505043 (0.0010) [2023-12-26 03:38:48,873][123090] Updated weights for policy 1, policy_version 505053 (0.0009) [2023-12-26 03:38:48,881][123091] Updated weights for policy 0, policy_version 508598 (0.0005) [2023-12-26 03:38:48,942][123091] Updated weights for policy 0, policy_version 508608 (0.0006) [2023-12-26 03:38:49,002][123091] Updated weights for policy 0, policy_version 508618 (0.0006) [2023-12-26 03:38:49,768][123091] Updated weights for policy 0, policy_version 508628 (0.0008) [2023-12-26 03:38:49,809][123090] Updated weights for policy 1, policy_version 505063 (0.0008) [2023-12-26 03:38:49,832][123091] Updated weights for policy 0, policy_version 508638 (0.0010) [2023-12-26 03:38:49,879][123090] Updated weights for policy 1, policy_version 505073 (0.0008) [2023-12-26 03:38:49,892][123091] Updated weights for policy 0, policy_version 508648 (0.0009) [2023-12-26 03:38:49,943][123090] Updated weights for policy 1, policy_version 505083 (0.0007) [2023-12-26 03:38:50,705][123091] Updated weights for policy 0, policy_version 508658 (0.0012) [2023-12-26 03:38:50,767][123091] Updated weights for policy 0, policy_version 508668 (0.0010) [2023-12-26 03:38:50,819][123090] Updated weights for policy 1, policy_version 505093 (0.0008) [2023-12-26 03:38:50,834][123091] Updated weights for policy 0, policy_version 508678 (0.0010) [2023-12-26 03:38:50,888][123090] Updated weights for policy 1, policy_version 505103 (0.0008) [2023-12-26 03:38:50,906][123091] Updated weights for policy 0, policy_version 508688 (0.0007) [2023-12-26 03:38:50,960][123090] Updated weights for policy 1, policy_version 505113 (0.0009) [2023-12-26 03:38:51,691][123091] Updated weights for policy 0, policy_version 508698 (0.0008) [2023-12-26 03:38:51,767][123091] Updated weights for policy 0, policy_version 508708 (0.0008) [2023-12-26 03:38:51,774][123090] Updated weights for policy 1, policy_version 505123 (0.0006) [2023-12-26 03:38:51,832][123090] Updated weights for policy 1, policy_version 505133 (0.0007) [2023-12-26 03:38:51,834][123091] Updated weights for policy 0, policy_version 508718 (0.0009) [2023-12-26 03:38:51,898][123090] Updated weights for policy 1, policy_version 505143 (0.0009) [2023-12-26 03:38:52,703][123091] Updated weights for policy 0, policy_version 508728 (0.0009) [2023-12-26 03:38:52,735][123090] Updated weights for policy 1, policy_version 505153 (0.0010) [2023-12-26 03:38:52,755][123091] Updated weights for policy 0, policy_version 508738 (0.0009) [2023-12-26 03:38:52,799][123090] Updated weights for policy 1, policy_version 505163 (0.0008) [2023-12-26 03:38:52,808][123091] Updated weights for policy 0, policy_version 508748 (0.0010) [2023-12-26 03:38:52,857][123090] Updated weights for policy 1, policy_version 505173 (0.0009) [2023-12-26 03:38:52,914][123090] Updated weights for policy 1, policy_version 505183 (0.0009) [2023-12-26 03:38:53,649][123091] Updated weights for policy 0, policy_version 508758 (0.0008) [2023-12-26 03:38:53,706][123091] Updated weights for policy 0, policy_version 508768 (0.0006) [2023-12-26 03:38:53,734][123090] Updated weights for policy 1, policy_version 505193 (0.0009) [2023-12-26 03:38:53,771][123091] Updated weights for policy 0, policy_version 508778 (0.0006) [2023-12-26 03:38:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 259571712. Throughput: 0: 8921.6, 1: 8758.5. Samples: 259557660. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:53,785][121949] Avg episode reward: [(0, '6122.337'), (1, '5746.237')] [2023-12-26 03:38:53,787][123090] Updated weights for policy 1, policy_version 505203 (0.0009) [2023-12-26 03:38:53,807][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000508784_130252800.pth... [2023-12-26 03:38:53,812][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000507728_129982464.pth [2023-12-26 03:38:53,838][123090] Updated weights for policy 1, policy_version 505213 (0.0008) [2023-12-26 03:38:53,854][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000505216_129335296.pth... [2023-12-26 03:38:53,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000504192_129073152.pth [2023-12-26 03:38:54,456][123091] Updated weights for policy 0, policy_version 508788 (0.0007) [2023-12-26 03:38:54,524][123091] Updated weights for policy 0, policy_version 508798 (0.0005) [2023-12-26 03:38:54,599][123091] Updated weights for policy 0, policy_version 508808 (0.0005) [2023-12-26 03:38:54,643][123090] Updated weights for policy 1, policy_version 505223 (0.0008) [2023-12-26 03:38:54,700][123090] Updated weights for policy 1, policy_version 505233 (0.0008) [2023-12-26 03:38:54,751][123090] Updated weights for policy 1, policy_version 505243 (0.0010) [2023-12-26 03:38:55,320][123091] Updated weights for policy 0, policy_version 508818 (0.0007) [2023-12-26 03:38:55,374][123091] Updated weights for policy 0, policy_version 508828 (0.0010) [2023-12-26 03:38:55,436][123091] Updated weights for policy 0, policy_version 508838 (0.0009) [2023-12-26 03:38:55,499][123091] Updated weights for policy 0, policy_version 508848 (0.0007) [2023-12-26 03:38:55,510][123090] Updated weights for policy 1, policy_version 505253 (0.0008) [2023-12-26 03:38:55,581][123090] Updated weights for policy 1, policy_version 505263 (0.0005) [2023-12-26 03:38:55,650][123090] Updated weights for policy 1, policy_version 505273 (0.0010) [2023-12-26 03:38:56,245][123091] Updated weights for policy 0, policy_version 508858 (0.0005) [2023-12-26 03:38:56,302][123091] Updated weights for policy 0, policy_version 508868 (0.0009) [2023-12-26 03:38:56,333][123090] Updated weights for policy 1, policy_version 505283 (0.0010) [2023-12-26 03:38:56,357][123091] Updated weights for policy 0, policy_version 508878 (0.0007) [2023-12-26 03:38:56,381][123090] Updated weights for policy 1, policy_version 505293 (0.0010) [2023-12-26 03:38:56,436][123090] Updated weights for policy 1, policy_version 505303 (0.0010) [2023-12-26 03:38:57,158][123091] Updated weights for policy 0, policy_version 508888 (0.0008) [2023-12-26 03:38:57,225][123091] Updated weights for policy 0, policy_version 508898 (0.0009) [2023-12-26 03:38:57,274][123090] Updated weights for policy 1, policy_version 505313 (0.0010) [2023-12-26 03:38:57,276][123091] Updated weights for policy 0, policy_version 508908 (0.0009) [2023-12-26 03:38:57,333][123090] Updated weights for policy 1, policy_version 505323 (0.0010) [2023-12-26 03:38:57,392][123090] Updated weights for policy 1, policy_version 505333 (0.0010) [2023-12-26 03:38:57,447][123090] Updated weights for policy 1, policy_version 505343 (0.0010) [2023-12-26 03:38:57,890][123091] Updated weights for policy 0, policy_version 508918 (0.0005) [2023-12-26 03:38:57,935][123091] Updated weights for policy 0, policy_version 508928 (0.0006) [2023-12-26 03:38:57,986][123091] Updated weights for policy 0, policy_version 508938 (0.0006) [2023-12-26 03:38:58,301][123090] Updated weights for policy 1, policy_version 505353 (0.0011) [2023-12-26 03:38:58,372][123090] Updated weights for policy 1, policy_version 505363 (0.0011) [2023-12-26 03:38:58,437][123090] Updated weights for policy 1, policy_version 505373 (0.0009) [2023-12-26 03:38:58,786][121949] Fps is (10 sec: 18019.4, 60 sec: 17885.3, 300 sec: 17772.4). Total num frames: 259670016. Throughput: 0: 8966.0, 1: 8782.1. Samples: 259665452. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:38:58,786][121949] Avg episode reward: [(0, '6075.619'), (1, '5679.061')] [2023-12-26 03:38:58,896][123091] Updated weights for policy 0, policy_version 508948 (0.0008) [2023-12-26 03:38:58,966][123091] Updated weights for policy 0, policy_version 508958 (0.0008) [2023-12-26 03:38:59,037][123091] Updated weights for policy 0, policy_version 508968 (0.0008) [2023-12-26 03:38:59,351][123090] Updated weights for policy 1, policy_version 505383 (0.0010) [2023-12-26 03:38:59,426][123090] Updated weights for policy 1, policy_version 505393 (0.0006) [2023-12-26 03:38:59,489][123090] Updated weights for policy 1, policy_version 505403 (0.0005) [2023-12-26 03:38:59,885][123091] Updated weights for policy 0, policy_version 508978 (0.0008) [2023-12-26 03:38:59,958][123091] Updated weights for policy 0, policy_version 508988 (0.0009) [2023-12-26 03:39:00,021][123091] Updated weights for policy 0, policy_version 508998 (0.0008) [2023-12-26 03:39:00,073][123091] Updated weights for policy 0, policy_version 509008 (0.0008) [2023-12-26 03:39:00,153][123090] Updated weights for policy 1, policy_version 505413 (0.0006) [2023-12-26 03:39:00,212][123090] Updated weights for policy 1, policy_version 505423 (0.0008) [2023-12-26 03:39:00,264][123090] Updated weights for policy 1, policy_version 505433 (0.0006) [2023-12-26 03:39:00,910][123090] Updated weights for policy 1, policy_version 505443 (0.0005) [2023-12-26 03:39:00,947][123091] Updated weights for policy 0, policy_version 509018 (0.0009) [2023-12-26 03:39:00,965][123090] Updated weights for policy 1, policy_version 505453 (0.0005) [2023-12-26 03:39:00,996][123091] Updated weights for policy 0, policy_version 509029 (0.0009) [2023-12-26 03:39:01,018][123090] Updated weights for policy 1, policy_version 505463 (0.0005) [2023-12-26 03:39:01,042][123091] Updated weights for policy 0, policy_version 509039 (0.0008) [2023-12-26 03:39:01,738][123090] Updated weights for policy 1, policy_version 505473 (0.0008) [2023-12-26 03:39:01,814][123090] Updated weights for policy 1, policy_version 505483 (0.0007) [2023-12-26 03:39:01,885][123090] Updated weights for policy 1, policy_version 505493 (0.0005) [2023-12-26 03:39:01,914][123091] Updated weights for policy 0, policy_version 509049 (0.0010) [2023-12-26 03:39:01,948][123090] Updated weights for policy 1, policy_version 505503 (0.0005) [2023-12-26 03:39:01,969][123091] Updated weights for policy 0, policy_version 509059 (0.0010) [2023-12-26 03:39:02,031][123091] Updated weights for policy 0, policy_version 509069 (0.0010) [2023-12-26 03:39:02,616][123090] Updated weights for policy 1, policy_version 505513 (0.0009) [2023-12-26 03:39:02,672][123090] Updated weights for policy 1, policy_version 505523 (0.0009) [2023-12-26 03:39:02,720][123090] Updated weights for policy 1, policy_version 505533 (0.0008) [2023-12-26 03:39:02,873][123091] Updated weights for policy 0, policy_version 509079 (0.0011) [2023-12-26 03:39:02,935][123091] Updated weights for policy 0, policy_version 509089 (0.0011) [2023-12-26 03:39:03,001][123091] Updated weights for policy 0, policy_version 509099 (0.0010) [2023-12-26 03:39:03,479][123090] Updated weights for policy 1, policy_version 505543 (0.0006) [2023-12-26 03:39:03,548][123090] Updated weights for policy 1, policy_version 505553 (0.0009) [2023-12-26 03:39:03,607][123090] Updated weights for policy 1, policy_version 505563 (0.0010) [2023-12-26 03:39:03,754][123091] Updated weights for policy 0, policy_version 509109 (0.0008) [2023-12-26 03:39:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 259760128. Throughput: 0: 8891.2, 1: 8851.4. Samples: 259772336. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:03,784][121949] Avg episode reward: [(0, '6159.161'), (1, '5725.312')] [2023-12-26 03:39:03,812][123091] Updated weights for policy 0, policy_version 509119 (0.0005) [2023-12-26 03:39:03,884][123091] Updated weights for policy 0, policy_version 509129 (0.0007) [2023-12-26 03:39:04,386][123090] Updated weights for policy 1, policy_version 505573 (0.0008) [2023-12-26 03:39:04,438][123090] Updated weights for policy 1, policy_version 505583 (0.0008) [2023-12-26 03:39:04,490][123090] Updated weights for policy 1, policy_version 505593 (0.0008) [2023-12-26 03:39:04,559][123091] Updated weights for policy 0, policy_version 509139 (0.0007) [2023-12-26 03:39:04,625][123091] Updated weights for policy 0, policy_version 509149 (0.0010) [2023-12-26 03:39:04,673][123091] Updated weights for policy 0, policy_version 509159 (0.0010) [2023-12-26 03:39:05,214][123090] Updated weights for policy 1, policy_version 505603 (0.0008) [2023-12-26 03:39:05,266][123090] Updated weights for policy 1, policy_version 505613 (0.0009) [2023-12-26 03:39:05,319][123090] Updated weights for policy 1, policy_version 505623 (0.0010) [2023-12-26 03:39:05,441][123091] Updated weights for policy 0, policy_version 509169 (0.0010) [2023-12-26 03:39:05,499][123091] Updated weights for policy 0, policy_version 509179 (0.0009) [2023-12-26 03:39:05,560][123091] Updated weights for policy 0, policy_version 509189 (0.0010) [2023-12-26 03:39:05,623][123091] Updated weights for policy 0, policy_version 509199 (0.0009) [2023-12-26 03:39:06,178][123090] Updated weights for policy 1, policy_version 505633 (0.0009) [2023-12-26 03:39:06,243][123090] Updated weights for policy 1, policy_version 505643 (0.0006) [2023-12-26 03:39:06,293][123090] Updated weights for policy 1, policy_version 505653 (0.0005) [2023-12-26 03:39:06,348][123090] Updated weights for policy 1, policy_version 505663 (0.0007) [2023-12-26 03:39:06,465][123091] Updated weights for policy 0, policy_version 509209 (0.0010) [2023-12-26 03:39:06,532][123091] Updated weights for policy 0, policy_version 509219 (0.0010) [2023-12-26 03:39:06,587][123091] Updated weights for policy 0, policy_version 509229 (0.0009) [2023-12-26 03:39:07,097][123090] Updated weights for policy 1, policy_version 505673 (0.0007) [2023-12-26 03:39:07,167][123090] Updated weights for policy 1, policy_version 505683 (0.0011) [2023-12-26 03:39:07,231][123090] Updated weights for policy 1, policy_version 505693 (0.0011) [2023-12-26 03:39:07,497][123091] Updated weights for policy 0, policy_version 509239 (0.0009) [2023-12-26 03:39:07,553][123091] Updated weights for policy 0, policy_version 509249 (0.0009) [2023-12-26 03:39:07,622][123091] Updated weights for policy 0, policy_version 509259 (0.0010) [2023-12-26 03:39:07,986][123090] Updated weights for policy 1, policy_version 505703 (0.0005) [2023-12-26 03:39:08,041][123090] Updated weights for policy 1, policy_version 505713 (0.0005) [2023-12-26 03:39:08,090][123090] Updated weights for policy 1, policy_version 505723 (0.0005) [2023-12-26 03:39:08,543][123091] Updated weights for policy 0, policy_version 509269 (0.0009) [2023-12-26 03:39:08,597][123091] Updated weights for policy 0, policy_version 509279 (0.0010) [2023-12-26 03:39:08,652][123091] Updated weights for policy 0, policy_version 509289 (0.0007) [2023-12-26 03:39:08,784][121949] Fps is (10 sec: 18025.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 259850240. Throughput: 0: 8940.0, 1: 8873.8. Samples: 259826064. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:08,785][121949] Avg episode reward: [(0, '6092.081'), (1, '5766.498')] [2023-12-26 03:39:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000509296_130383872.pth... [2023-12-26 03:39:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000508240_130113536.pth [2023-12-26 03:39:08,802][123090] Updated weights for policy 1, policy_version 505733 (0.0008) [2023-12-26 03:39:08,858][123090] Updated weights for policy 1, policy_version 505743 (0.0011) [2023-12-26 03:39:08,911][123090] Updated weights for policy 1, policy_version 505753 (0.0010) [2023-12-26 03:39:08,946][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000505760_129474560.pth... [2023-12-26 03:39:08,949][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000504704_129204224.pth [2023-12-26 03:39:09,461][123091] Updated weights for policy 0, policy_version 509299 (0.0005) [2023-12-26 03:39:09,524][123091] Updated weights for policy 0, policy_version 509309 (0.0006) [2023-12-26 03:39:09,590][123091] Updated weights for policy 0, policy_version 509319 (0.0006) [2023-12-26 03:39:09,749][123090] Updated weights for policy 1, policy_version 505763 (0.0009) [2023-12-26 03:39:09,817][123090] Updated weights for policy 1, policy_version 505773 (0.0009) [2023-12-26 03:39:09,899][123090] Updated weights for policy 1, policy_version 505783 (0.0008) [2023-12-26 03:39:10,292][123091] Updated weights for policy 0, policy_version 509329 (0.0006) [2023-12-26 03:39:10,368][123091] Updated weights for policy 0, policy_version 509339 (0.0006) [2023-12-26 03:39:10,428][123091] Updated weights for policy 0, policy_version 509349 (0.0006) [2023-12-26 03:39:10,494][123091] Updated weights for policy 0, policy_version 509359 (0.0006) [2023-12-26 03:39:10,727][123090] Updated weights for policy 1, policy_version 505793 (0.0009) [2023-12-26 03:39:10,795][123090] Updated weights for policy 1, policy_version 505803 (0.0006) [2023-12-26 03:39:10,864][123090] Updated weights for policy 1, policy_version 505813 (0.0009) [2023-12-26 03:39:10,928][123090] Updated weights for policy 1, policy_version 505823 (0.0010) [2023-12-26 03:39:11,198][123091] Updated weights for policy 0, policy_version 509369 (0.0007) [2023-12-26 03:39:11,271][123091] Updated weights for policy 0, policy_version 509379 (0.0008) [2023-12-26 03:39:11,341][123091] Updated weights for policy 0, policy_version 509389 (0.0007) [2023-12-26 03:39:11,774][123090] Updated weights for policy 1, policy_version 505833 (0.0009) [2023-12-26 03:39:11,830][123090] Updated weights for policy 1, policy_version 505843 (0.0008) [2023-12-26 03:39:11,884][123090] Updated weights for policy 1, policy_version 505853 (0.0005) [2023-12-26 03:39:12,144][123091] Updated weights for policy 0, policy_version 509399 (0.0008) [2023-12-26 03:39:12,212][123091] Updated weights for policy 0, policy_version 509409 (0.0008) [2023-12-26 03:39:12,284][123091] Updated weights for policy 0, policy_version 509419 (0.0008) [2023-12-26 03:39:12,713][123090] Updated weights for policy 1, policy_version 505863 (0.0009) [2023-12-26 03:39:12,782][123090] Updated weights for policy 1, policy_version 505873 (0.0009) [2023-12-26 03:39:12,849][123090] Updated weights for policy 1, policy_version 505883 (0.0009) [2023-12-26 03:39:13,084][123091] Updated weights for policy 0, policy_version 509429 (0.0009) [2023-12-26 03:39:13,146][123091] Updated weights for policy 0, policy_version 509439 (0.0009) [2023-12-26 03:39:13,207][123091] Updated weights for policy 0, policy_version 509450 (0.0010) [2023-12-26 03:39:13,676][123090] Updated weights for policy 1, policy_version 505893 (0.0007) [2023-12-26 03:39:13,739][123090] Updated weights for policy 1, policy_version 505903 (0.0008) [2023-12-26 03:39:13,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 259932160. Throughput: 0: 8889.6, 1: 8842.1. Samples: 259932080. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:13,785][121949] Avg episode reward: [(0, '6071.746'), (1, '5816.070')] [2023-12-26 03:39:13,803][123090] Updated weights for policy 1, policy_version 505913 (0.0011) [2023-12-26 03:39:14,079][123091] Updated weights for policy 0, policy_version 509460 (0.0010) [2023-12-26 03:39:14,141][123091] Updated weights for policy 0, policy_version 509470 (0.0011) [2023-12-26 03:39:14,209][123091] Updated weights for policy 0, policy_version 509480 (0.0009) [2023-12-26 03:39:14,557][123090] Updated weights for policy 1, policy_version 505923 (0.0010) [2023-12-26 03:39:14,610][123090] Updated weights for policy 1, policy_version 505933 (0.0009) [2023-12-26 03:39:14,675][123090] Updated weights for policy 1, policy_version 505943 (0.0009) [2023-12-26 03:39:15,010][123091] Updated weights for policy 0, policy_version 509490 (0.0010) [2023-12-26 03:39:15,067][123091] Updated weights for policy 0, policy_version 509500 (0.0011) [2023-12-26 03:39:15,120][123091] Updated weights for policy 0, policy_version 509510 (0.0011) [2023-12-26 03:39:15,181][123091] Updated weights for policy 0, policy_version 509520 (0.0010) [2023-12-26 03:39:15,509][123090] Updated weights for policy 1, policy_version 505953 (0.0011) [2023-12-26 03:39:15,569][123090] Updated weights for policy 1, policy_version 505963 (0.0006) [2023-12-26 03:39:15,632][123090] Updated weights for policy 1, policy_version 505973 (0.0010) [2023-12-26 03:39:15,699][123090] Updated weights for policy 1, policy_version 505983 (0.0010) [2023-12-26 03:39:16,016][123091] Updated weights for policy 0, policy_version 509530 (0.0010) [2023-12-26 03:39:16,072][123091] Updated weights for policy 0, policy_version 509540 (0.0010) [2023-12-26 03:39:16,128][123091] Updated weights for policy 0, policy_version 509550 (0.0009) [2023-12-26 03:39:16,322][123090] Updated weights for policy 1, policy_version 505993 (0.0007) [2023-12-26 03:39:16,383][123090] Updated weights for policy 1, policy_version 506003 (0.0009) [2023-12-26 03:39:16,436][123090] Updated weights for policy 1, policy_version 506013 (0.0009) [2023-12-26 03:39:17,040][123091] Updated weights for policy 0, policy_version 509560 (0.0006) [2023-12-26 03:39:17,107][123091] Updated weights for policy 0, policy_version 509570 (0.0006) [2023-12-26 03:39:17,120][123090] Updated weights for policy 1, policy_version 506023 (0.0006) [2023-12-26 03:39:17,170][123090] Updated weights for policy 1, policy_version 506033 (0.0006) [2023-12-26 03:39:17,183][123091] Updated weights for policy 0, policy_version 509580 (0.0006) [2023-12-26 03:39:17,239][123090] Updated weights for policy 1, policy_version 506044 (0.0007) [2023-12-26 03:39:17,959][123090] Updated weights for policy 1, policy_version 506054 (0.0007) [2023-12-26 03:39:17,987][123091] Updated weights for policy 0, policy_version 509590 (0.0008) [2023-12-26 03:39:18,022][123090] Updated weights for policy 1, policy_version 506064 (0.0007) [2023-12-26 03:39:18,045][123091] Updated weights for policy 0, policy_version 509600 (0.0009) [2023-12-26 03:39:18,086][123090] Updated weights for policy 1, policy_version 506074 (0.0005) [2023-12-26 03:39:18,105][123091] Updated weights for policy 0, policy_version 509610 (0.0008) [2023-12-26 03:39:18,761][123090] Updated weights for policy 1, policy_version 506084 (0.0008) [2023-12-26 03:39:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 260022272. Throughput: 0: 8856.0, 1: 8870.4. Samples: 260038596. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:18,785][121949] Avg episode reward: [(0, '6133.123'), (1, '5853.143')] [2023-12-26 03:39:18,821][123090] Updated weights for policy 1, policy_version 506094 (0.0011) [2023-12-26 03:39:18,885][123090] Updated weights for policy 1, policy_version 506104 (0.0010) [2023-12-26 03:39:18,890][123091] Updated weights for policy 0, policy_version 509620 (0.0010) [2023-12-26 03:39:18,942][123091] Updated weights for policy 0, policy_version 509630 (0.0010) [2023-12-26 03:39:19,000][123091] Updated weights for policy 0, policy_version 509640 (0.0005) [2023-12-26 03:39:19,669][123090] Updated weights for policy 1, policy_version 506114 (0.0009) [2023-12-26 03:39:19,699][123091] Updated weights for policy 0, policy_version 509650 (0.0006) [2023-12-26 03:39:19,733][123090] Updated weights for policy 1, policy_version 506124 (0.0009) [2023-12-26 03:39:19,761][123091] Updated weights for policy 0, policy_version 509660 (0.0006) [2023-12-26 03:39:19,797][123090] Updated weights for policy 1, policy_version 506134 (0.0006) [2023-12-26 03:39:19,844][123091] Updated weights for policy 0, policy_version 509670 (0.0006) [2023-12-26 03:39:19,870][123090] Updated weights for policy 1, policy_version 506144 (0.0008) [2023-12-26 03:39:19,917][123091] Updated weights for policy 0, policy_version 509680 (0.0007) [2023-12-26 03:39:20,587][123091] Updated weights for policy 0, policy_version 509690 (0.0009) [2023-12-26 03:39:20,609][123090] Updated weights for policy 1, policy_version 506154 (0.0009) [2023-12-26 03:39:20,657][123091] Updated weights for policy 0, policy_version 509700 (0.0010) [2023-12-26 03:39:20,674][123090] Updated weights for policy 1, policy_version 506164 (0.0011) [2023-12-26 03:39:20,720][123091] Updated weights for policy 0, policy_version 509710 (0.0010) [2023-12-26 03:39:20,745][123090] Updated weights for policy 1, policy_version 506174 (0.0007) [2023-12-26 03:39:21,420][123090] Updated weights for policy 1, policy_version 506184 (0.0006) [2023-12-26 03:39:21,467][123091] Updated weights for policy 0, policy_version 509720 (0.0008) [2023-12-26 03:39:21,495][123090] Updated weights for policy 1, policy_version 506194 (0.0006) [2023-12-26 03:39:21,531][123091] Updated weights for policy 0, policy_version 509730 (0.0010) [2023-12-26 03:39:21,561][123090] Updated weights for policy 1, policy_version 506204 (0.0006) [2023-12-26 03:39:21,602][123091] Updated weights for policy 0, policy_version 509740 (0.0009) [2023-12-26 03:39:22,281][123090] Updated weights for policy 1, policy_version 506214 (0.0008) [2023-12-26 03:39:22,349][123090] Updated weights for policy 1, policy_version 506224 (0.0010) [2023-12-26 03:39:22,387][123091] Updated weights for policy 0, policy_version 509750 (0.0009) [2023-12-26 03:39:22,410][123090] Updated weights for policy 1, policy_version 506234 (0.0013) [2023-12-26 03:39:22,458][123091] Updated weights for policy 0, policy_version 509760 (0.0008) [2023-12-26 03:39:22,527][123091] Updated weights for policy 0, policy_version 509770 (0.0010) [2023-12-26 03:39:23,145][123090] Updated weights for policy 1, policy_version 506244 (0.0007) [2023-12-26 03:39:23,204][123090] Updated weights for policy 1, policy_version 506254 (0.0006) [2023-12-26 03:39:23,269][123090] Updated weights for policy 1, policy_version 506264 (0.0006) [2023-12-26 03:39:23,348][123091] Updated weights for policy 0, policy_version 509780 (0.0007) [2023-12-26 03:39:23,423][123091] Updated weights for policy 0, policy_version 509790 (0.0010) [2023-12-26 03:39:23,502][123091] Updated weights for policy 0, policy_version 509800 (0.0010) [2023-12-26 03:39:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 260120576. Throughput: 0: 8924.3, 1: 8867.1. Samples: 260094616. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:23,785][121949] Avg episode reward: [(0, '6150.278'), (1, '5824.708')] [2023-12-26 03:39:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000509808_130514944.pth... [2023-12-26 03:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000506272_129605632.pth... [2023-12-26 03:39:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000508784_130252800.pth [2023-12-26 03:39:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000505216_129335296.pth [2023-12-26 03:39:23,994][123090] Updated weights for policy 1, policy_version 506274 (0.0005) [2023-12-26 03:39:24,040][123090] Updated weights for policy 1, policy_version 506284 (0.0005) [2023-12-26 03:39:24,085][123090] Updated weights for policy 1, policy_version 506294 (0.0005) [2023-12-26 03:39:24,152][123090] Updated weights for policy 1, policy_version 506304 (0.0005) [2023-12-26 03:39:24,242][123091] Updated weights for policy 0, policy_version 509810 (0.0009) [2023-12-26 03:39:24,313][123091] Updated weights for policy 0, policy_version 509820 (0.0010) [2023-12-26 03:39:24,373][123091] Updated weights for policy 0, policy_version 509830 (0.0010) [2023-12-26 03:39:24,443][123091] Updated weights for policy 0, policy_version 509840 (0.0008) [2023-12-26 03:39:24,841][123090] Updated weights for policy 1, policy_version 506314 (0.0005) [2023-12-26 03:39:24,894][123090] Updated weights for policy 1, policy_version 506324 (0.0005) [2023-12-26 03:39:24,951][123090] Updated weights for policy 1, policy_version 506334 (0.0005) [2023-12-26 03:39:25,191][123091] Updated weights for policy 0, policy_version 509850 (0.0007) [2023-12-26 03:39:25,250][123091] Updated weights for policy 0, policy_version 509860 (0.0006) [2023-12-26 03:39:25,309][123091] Updated weights for policy 0, policy_version 509870 (0.0006) [2023-12-26 03:39:25,668][123090] Updated weights for policy 1, policy_version 506344 (0.0009) [2023-12-26 03:39:25,727][123090] Updated weights for policy 1, policy_version 506355 (0.0010) [2023-12-26 03:39:25,778][123090] Updated weights for policy 1, policy_version 506365 (0.0008) [2023-12-26 03:39:26,018][123091] Updated weights for policy 0, policy_version 509880 (0.0009) [2023-12-26 03:39:26,069][123091] Updated weights for policy 0, policy_version 509890 (0.0010) [2023-12-26 03:39:26,128][123091] Updated weights for policy 0, policy_version 509900 (0.0010) [2023-12-26 03:39:26,650][123090] Updated weights for policy 1, policy_version 506375 (0.0010) [2023-12-26 03:39:26,710][123090] Updated weights for policy 1, policy_version 506385 (0.0009) [2023-12-26 03:39:26,769][123090] Updated weights for policy 1, policy_version 506395 (0.0006) [2023-12-26 03:39:26,886][123091] Updated weights for policy 0, policy_version 509910 (0.0009) [2023-12-26 03:39:26,948][123091] Updated weights for policy 0, policy_version 509920 (0.0009) [2023-12-26 03:39:27,003][123091] Updated weights for policy 0, policy_version 509930 (0.0009) [2023-12-26 03:39:27,571][123090] Updated weights for policy 1, policy_version 506405 (0.0007) [2023-12-26 03:39:27,624][123090] Updated weights for policy 1, policy_version 506415 (0.0005) [2023-12-26 03:39:27,680][123090] Updated weights for policy 1, policy_version 506425 (0.0008) [2023-12-26 03:39:27,692][123091] Updated weights for policy 0, policy_version 509940 (0.0007) [2023-12-26 03:39:27,747][123091] Updated weights for policy 0, policy_version 509950 (0.0005) [2023-12-26 03:39:27,804][123091] Updated weights for policy 0, policy_version 509960 (0.0005) [2023-12-26 03:39:28,377][123090] Updated weights for policy 1, policy_version 506435 (0.0007) [2023-12-26 03:39:28,445][123090] Updated weights for policy 1, policy_version 506445 (0.0008) [2023-12-26 03:39:28,473][123091] Updated weights for policy 0, policy_version 509970 (0.0006) [2023-12-26 03:39:28,514][123090] Updated weights for policy 1, policy_version 506455 (0.0005) [2023-12-26 03:39:28,540][123091] Updated weights for policy 0, policy_version 509980 (0.0009) [2023-12-26 03:39:28,597][123091] Updated weights for policy 0, policy_version 509990 (0.0009) [2023-12-26 03:39:28,655][123091] Updated weights for policy 0, policy_version 510000 (0.0010) [2023-12-26 03:39:28,784][121949] Fps is (10 sec: 19660.6, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 260218880. Throughput: 0: 8971.2, 1: 8970.7. Samples: 260206332. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:28,785][121949] Avg episode reward: [(0, '6066.019'), (1, '5681.447')] [2023-12-26 03:39:29,187][123090] Updated weights for policy 1, policy_version 506465 (0.0005) [2023-12-26 03:39:29,249][123090] Updated weights for policy 1, policy_version 506475 (0.0007) [2023-12-26 03:39:29,313][123090] Updated weights for policy 1, policy_version 506485 (0.0007) [2023-12-26 03:39:29,379][123090] Updated weights for policy 1, policy_version 506495 (0.0010) [2023-12-26 03:39:29,527][123091] Updated weights for policy 0, policy_version 510010 (0.0005) [2023-12-26 03:39:29,580][123091] Updated weights for policy 0, policy_version 510020 (0.0005) [2023-12-26 03:39:29,635][123091] Updated weights for policy 0, policy_version 510030 (0.0005) [2023-12-26 03:39:30,224][123090] Updated weights for policy 1, policy_version 506505 (0.0010) [2023-12-26 03:39:30,275][123090] Updated weights for policy 1, policy_version 506515 (0.0009) [2023-12-26 03:39:30,335][123090] Updated weights for policy 1, policy_version 506525 (0.0009) [2023-12-26 03:39:30,409][123091] Updated weights for policy 0, policy_version 510040 (0.0008) [2023-12-26 03:39:30,458][123091] Updated weights for policy 0, policy_version 510051 (0.0009) [2023-12-26 03:39:30,510][123091] Updated weights for policy 0, policy_version 510061 (0.0009) [2023-12-26 03:39:31,225][123090] Updated weights for policy 1, policy_version 506536 (0.0009) [2023-12-26 03:39:31,278][123091] Updated weights for policy 0, policy_version 510071 (0.0008) [2023-12-26 03:39:31,289][123090] Updated weights for policy 1, policy_version 506546 (0.0009) [2023-12-26 03:39:31,338][123091] Updated weights for policy 0, policy_version 510081 (0.0006) [2023-12-26 03:39:31,346][123090] Updated weights for policy 1, policy_version 506556 (0.0009) [2023-12-26 03:39:31,435][123091] Updated weights for policy 0, policy_version 510091 (0.0007) [2023-12-26 03:39:32,120][123091] Updated weights for policy 0, policy_version 510101 (0.0007) [2023-12-26 03:39:32,174][123091] Updated weights for policy 0, policy_version 510111 (0.0009) [2023-12-26 03:39:32,211][123090] Updated weights for policy 1, policy_version 506566 (0.0009) [2023-12-26 03:39:32,241][123091] Updated weights for policy 0, policy_version 510121 (0.0008) [2023-12-26 03:39:32,278][123090] Updated weights for policy 1, policy_version 506576 (0.0009) [2023-12-26 03:39:32,348][123090] Updated weights for policy 1, policy_version 506586 (0.0009) [2023-12-26 03:39:33,020][123091] Updated weights for policy 0, policy_version 510131 (0.0010) [2023-12-26 03:39:33,066][123091] Updated weights for policy 0, policy_version 510141 (0.0008) [2023-12-26 03:39:33,121][123091] Updated weights for policy 0, policy_version 510151 (0.0006) [2023-12-26 03:39:33,201][123090] Updated weights for policy 1, policy_version 506596 (0.0009) [2023-12-26 03:39:33,260][123090] Updated weights for policy 1, policy_version 506607 (0.0010) [2023-12-26 03:39:33,313][123090] Updated weights for policy 1, policy_version 506617 (0.0009) [2023-12-26 03:39:33,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 260300800. Throughput: 0: 8927.3, 1: 9015.1. Samples: 260313924. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:33,785][121949] Avg episode reward: [(0, '6034.071'), (1, '5678.875')] [2023-12-26 03:39:33,806][123091] Updated weights for policy 0, policy_version 510161 (0.0006) [2023-12-26 03:39:33,859][123091] Updated weights for policy 0, policy_version 510172 (0.0007) [2023-12-26 03:39:33,913][123091] Updated weights for policy 0, policy_version 510182 (0.0005) [2023-12-26 03:39:33,980][123091] Updated weights for policy 0, policy_version 510192 (0.0005) [2023-12-26 03:39:34,257][123090] Updated weights for policy 1, policy_version 506627 (0.0009) [2023-12-26 03:39:34,323][123090] Updated weights for policy 1, policy_version 506637 (0.0009) [2023-12-26 03:39:34,380][123090] Updated weights for policy 1, policy_version 506647 (0.0009) [2023-12-26 03:39:34,770][123091] Updated weights for policy 0, policy_version 510202 (0.0006) [2023-12-26 03:39:34,834][123091] Updated weights for policy 0, policy_version 510212 (0.0006) [2023-12-26 03:39:34,895][123091] Updated weights for policy 0, policy_version 510222 (0.0005) [2023-12-26 03:39:35,291][123090] Updated weights for policy 1, policy_version 506657 (0.0009) [2023-12-26 03:39:35,345][123090] Updated weights for policy 1, policy_version 506667 (0.0010) [2023-12-26 03:39:35,407][123090] Updated weights for policy 1, policy_version 506677 (0.0010) [2023-12-26 03:39:35,471][123090] Updated weights for policy 1, policy_version 506687 (0.0009) [2023-12-26 03:39:35,509][123091] Updated weights for policy 0, policy_version 510232 (0.0005) [2023-12-26 03:39:35,563][123091] Updated weights for policy 0, policy_version 510242 (0.0009) [2023-12-26 03:39:35,617][123091] Updated weights for policy 0, policy_version 510252 (0.0005) [2023-12-26 03:39:36,198][123091] Updated weights for policy 0, policy_version 510262 (0.0006) [2023-12-26 03:39:36,254][123091] Updated weights for policy 0, policy_version 510272 (0.0006) [2023-12-26 03:39:36,304][123091] Updated weights for policy 0, policy_version 510282 (0.0006) [2023-12-26 03:39:36,376][123090] Updated weights for policy 1, policy_version 506697 (0.0010) [2023-12-26 03:39:36,451][123090] Updated weights for policy 1, policy_version 506707 (0.0011) [2023-12-26 03:39:36,514][123090] Updated weights for policy 1, policy_version 506717 (0.0010) [2023-12-26 03:39:37,056][123091] Updated weights for policy 0, policy_version 510292 (0.0007) [2023-12-26 03:39:37,105][123091] Updated weights for policy 0, policy_version 510302 (0.0009) [2023-12-26 03:39:37,161][123091] Updated weights for policy 0, policy_version 510312 (0.0009) [2023-12-26 03:39:37,361][123090] Updated weights for policy 1, policy_version 506727 (0.0010) [2023-12-26 03:39:37,418][123090] Updated weights for policy 1, policy_version 506737 (0.0010) [2023-12-26 03:39:37,479][123090] Updated weights for policy 1, policy_version 506747 (0.0007) [2023-12-26 03:39:38,040][123091] Updated weights for policy 0, policy_version 510322 (0.0008) [2023-12-26 03:39:38,094][123091] Updated weights for policy 0, policy_version 510332 (0.0005) [2023-12-26 03:39:38,147][123091] Updated weights for policy 0, policy_version 510342 (0.0008) [2023-12-26 03:39:38,204][123091] Updated weights for policy 0, policy_version 510352 (0.0010) [2023-12-26 03:39:38,224][123090] Updated weights for policy 1, policy_version 506757 (0.0005) [2023-12-26 03:39:38,273][123090] Updated weights for policy 1, policy_version 506767 (0.0005) [2023-12-26 03:39:38,330][123090] Updated weights for policy 1, policy_version 506777 (0.0006) [2023-12-26 03:39:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 260390912. Throughput: 0: 9020.3, 1: 8996.5. Samples: 260368416. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:38,785][121949] Avg episode reward: [(0, '6118.257'), (1, '5659.668')] [2023-12-26 03:39:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000506784_129736704.pth... [2023-12-26 03:39:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000510352_130654208.pth... [2023-12-26 03:39:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000509296_130383872.pth [2023-12-26 03:39:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000505760_129474560.pth [2023-12-26 03:39:38,934][123091] Updated weights for policy 0, policy_version 510362 (0.0005) [2023-12-26 03:39:38,988][123091] Updated weights for policy 0, policy_version 510372 (0.0005) [2023-12-26 03:39:39,053][123091] Updated weights for policy 0, policy_version 510382 (0.0007) [2023-12-26 03:39:39,140][123090] Updated weights for policy 1, policy_version 506787 (0.0006) [2023-12-26 03:39:39,198][123090] Updated weights for policy 1, policy_version 506797 (0.0005) [2023-12-26 03:39:39,259][123090] Updated weights for policy 1, policy_version 506807 (0.0010) [2023-12-26 03:39:39,862][123091] Updated weights for policy 0, policy_version 510392 (0.0010) [2023-12-26 03:39:39,931][123091] Updated weights for policy 0, policy_version 510402 (0.0009) [2023-12-26 03:39:39,996][123091] Updated weights for policy 0, policy_version 510412 (0.0009) [2023-12-26 03:39:40,067][123090] Updated weights for policy 1, policy_version 506817 (0.0009) [2023-12-26 03:39:40,137][123090] Updated weights for policy 1, policy_version 506827 (0.0010) [2023-12-26 03:39:40,205][123090] Updated weights for policy 1, policy_version 506837 (0.0009) [2023-12-26 03:39:40,273][123090] Updated weights for policy 1, policy_version 506847 (0.0009) [2023-12-26 03:39:40,815][123091] Updated weights for policy 0, policy_version 510422 (0.0009) [2023-12-26 03:39:40,864][123091] Updated weights for policy 0, policy_version 510432 (0.0009) [2023-12-26 03:39:40,919][123091] Updated weights for policy 0, policy_version 510442 (0.0009) [2023-12-26 03:39:41,099][123090] Updated weights for policy 1, policy_version 506857 (0.0009) [2023-12-26 03:39:41,168][123090] Updated weights for policy 1, policy_version 506867 (0.0010) [2023-12-26 03:39:41,230][123090] Updated weights for policy 1, policy_version 506877 (0.0010) [2023-12-26 03:39:41,829][123091] Updated weights for policy 0, policy_version 510452 (0.0009) [2023-12-26 03:39:41,891][123091] Updated weights for policy 0, policy_version 510462 (0.0010) [2023-12-26 03:39:41,954][123091] Updated weights for policy 0, policy_version 510472 (0.0009) [2023-12-26 03:39:42,050][123090] Updated weights for policy 1, policy_version 506887 (0.0010) [2023-12-26 03:39:42,119][123090] Updated weights for policy 1, policy_version 506897 (0.0011) [2023-12-26 03:39:42,186][123090] Updated weights for policy 1, policy_version 506907 (0.0010) [2023-12-26 03:39:42,768][123091] Updated weights for policy 0, policy_version 510482 (0.0008) [2023-12-26 03:39:42,822][123091] Updated weights for policy 0, policy_version 510492 (0.0007) [2023-12-26 03:39:42,881][123091] Updated weights for policy 0, policy_version 510502 (0.0006) [2023-12-26 03:39:42,941][123091] Updated weights for policy 0, policy_version 510512 (0.0010) [2023-12-26 03:39:43,007][123090] Updated weights for policy 1, policy_version 506917 (0.0008) [2023-12-26 03:39:43,079][123090] Updated weights for policy 1, policy_version 506927 (0.0005) [2023-12-26 03:39:43,146][123090] Updated weights for policy 1, policy_version 506937 (0.0006) [2023-12-26 03:39:43,685][123091] Updated weights for policy 0, policy_version 510522 (0.0005) [2023-12-26 03:39:43,732][123091] Updated weights for policy 0, policy_version 510532 (0.0005) [2023-12-26 03:39:43,761][123090] Updated weights for policy 1, policy_version 506947 (0.0006) [2023-12-26 03:39:43,783][123091] Updated weights for policy 0, policy_version 510542 (0.0005) [2023-12-26 03:39:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 260472832. Throughput: 0: 8944.2, 1: 8980.4. Samples: 260472024. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:43,785][121949] Avg episode reward: [(0, '6154.721'), (1, '5394.093')] [2023-12-26 03:39:43,822][123090] Updated weights for policy 1, policy_version 506957 (0.0005) [2023-12-26 03:39:43,873][123090] Updated weights for policy 1, policy_version 506967 (0.0005) [2023-12-26 03:39:44,477][123091] Updated weights for policy 0, policy_version 510552 (0.0010) [2023-12-26 03:39:44,486][123090] Updated weights for policy 1, policy_version 506977 (0.0005) [2023-12-26 03:39:44,540][123091] Updated weights for policy 0, policy_version 510562 (0.0011) [2023-12-26 03:39:44,552][123090] Updated weights for policy 1, policy_version 506987 (0.0007) [2023-12-26 03:39:44,591][123091] Updated weights for policy 0, policy_version 510572 (0.0010) [2023-12-26 03:39:44,607][123090] Updated weights for policy 1, policy_version 506997 (0.0008) [2023-12-26 03:39:44,662][123090] Updated weights for policy 1, policy_version 507007 (0.0005) [2023-12-26 03:39:45,363][123090] Updated weights for policy 1, policy_version 507017 (0.0010) [2023-12-26 03:39:45,368][123091] Updated weights for policy 0, policy_version 510582 (0.0006) [2023-12-26 03:39:45,429][123090] Updated weights for policy 1, policy_version 507027 (0.0011) [2023-12-26 03:39:45,434][123091] Updated weights for policy 0, policy_version 510592 (0.0011) [2023-12-26 03:39:45,491][123090] Updated weights for policy 1, policy_version 507037 (0.0011) [2023-12-26 03:39:45,499][123091] Updated weights for policy 0, policy_version 510602 (0.0011) [2023-12-26 03:39:46,221][123091] Updated weights for policy 0, policy_version 510612 (0.0011) [2023-12-26 03:39:46,271][123090] Updated weights for policy 1, policy_version 507047 (0.0011) [2023-12-26 03:39:46,283][123091] Updated weights for policy 0, policy_version 510622 (0.0011) [2023-12-26 03:39:46,331][123091] Updated weights for policy 0, policy_version 510632 (0.0010) [2023-12-26 03:39:46,334][123090] Updated weights for policy 1, policy_version 507057 (0.0010) [2023-12-26 03:39:46,393][123090] Updated weights for policy 1, policy_version 507067 (0.0010) [2023-12-26 03:39:47,177][123091] Updated weights for policy 0, policy_version 510642 (0.0010) [2023-12-26 03:39:47,235][123091] Updated weights for policy 0, policy_version 510652 (0.0008) [2023-12-26 03:39:47,237][123090] Updated weights for policy 1, policy_version 507077 (0.0010) [2023-12-26 03:39:47,295][123091] Updated weights for policy 0, policy_version 510662 (0.0007) [2023-12-26 03:39:47,301][123090] Updated weights for policy 1, policy_version 507087 (0.0009) [2023-12-26 03:39:47,352][123091] Updated weights for policy 0, policy_version 510672 (0.0009) [2023-12-26 03:39:47,368][123090] Updated weights for policy 1, policy_version 507097 (0.0006) [2023-12-26 03:39:48,142][123091] Updated weights for policy 0, policy_version 510682 (0.0009) [2023-12-26 03:39:48,192][123091] Updated weights for policy 0, policy_version 510692 (0.0009) [2023-12-26 03:39:48,216][123090] Updated weights for policy 1, policy_version 507107 (0.0008) [2023-12-26 03:39:48,251][123091] Updated weights for policy 0, policy_version 510702 (0.0008) [2023-12-26 03:39:48,267][123090] Updated weights for policy 1, policy_version 507117 (0.0005) [2023-12-26 03:39:48,342][123090] Updated weights for policy 1, policy_version 507127 (0.0006) [2023-12-26 03:39:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 260571136. Throughput: 0: 9028.7, 1: 8966.2. Samples: 260582108. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:48,785][121949] Avg episode reward: [(0, '6177.556'), (1, '5500.211')] [2023-12-26 03:39:49,130][123091] Updated weights for policy 0, policy_version 510712 (0.0009) [2023-12-26 03:39:49,177][123090] Updated weights for policy 1, policy_version 507137 (0.0011) [2023-12-26 03:39:49,178][123091] Updated weights for policy 0, policy_version 510722 (0.0009) [2023-12-26 03:39:49,230][123090] Updated weights for policy 1, policy_version 507147 (0.0010) [2023-12-26 03:39:49,238][123091] Updated weights for policy 0, policy_version 510732 (0.0008) [2023-12-26 03:39:49,297][123090] Updated weights for policy 1, policy_version 507157 (0.0008) [2023-12-26 03:39:49,368][123090] Updated weights for policy 1, policy_version 507167 (0.0010) [2023-12-26 03:39:50,059][123091] Updated weights for policy 0, policy_version 510742 (0.0009) [2023-12-26 03:39:50,112][123091] Updated weights for policy 0, policy_version 510752 (0.0009) [2023-12-26 03:39:50,173][123091] Updated weights for policy 0, policy_version 510762 (0.0009) [2023-12-26 03:39:50,232][123090] Updated weights for policy 1, policy_version 507177 (0.0010) [2023-12-26 03:39:50,295][123090] Updated weights for policy 1, policy_version 507187 (0.0011) [2023-12-26 03:39:50,350][123090] Updated weights for policy 1, policy_version 507197 (0.0010) [2023-12-26 03:39:51,069][123091] Updated weights for policy 0, policy_version 510772 (0.0007) [2023-12-26 03:39:51,126][123091] Updated weights for policy 0, policy_version 510782 (0.0010) [2023-12-26 03:39:51,162][123090] Updated weights for policy 1, policy_version 507207 (0.0009) [2023-12-26 03:39:51,190][123091] Updated weights for policy 0, policy_version 510792 (0.0008) [2023-12-26 03:39:51,229][123090] Updated weights for policy 1, policy_version 507217 (0.0010) [2023-12-26 03:39:51,309][123090] Updated weights for policy 1, policy_version 507227 (0.0011) [2023-12-26 03:39:52,001][123091] Updated weights for policy 0, policy_version 510802 (0.0007) [2023-12-26 03:39:52,061][123091] Updated weights for policy 0, policy_version 510812 (0.0010) [2023-12-26 03:39:52,071][123090] Updated weights for policy 1, policy_version 507237 (0.0010) [2023-12-26 03:39:52,116][123091] Updated weights for policy 0, policy_version 510822 (0.0011) [2023-12-26 03:39:52,132][123090] Updated weights for policy 1, policy_version 507247 (0.0006) [2023-12-26 03:39:52,171][123091] Updated weights for policy 0, policy_version 510832 (0.0011) [2023-12-26 03:39:52,201][123090] Updated weights for policy 1, policy_version 507257 (0.0007) [2023-12-26 03:39:52,867][123091] Updated weights for policy 0, policy_version 510842 (0.0005) [2023-12-26 03:39:52,932][123091] Updated weights for policy 0, policy_version 510852 (0.0006) [2023-12-26 03:39:52,989][123091] Updated weights for policy 0, policy_version 510862 (0.0006) [2023-12-26 03:39:53,133][123090] Updated weights for policy 1, policy_version 507267 (0.0009) [2023-12-26 03:39:53,182][123090] Updated weights for policy 1, policy_version 507277 (0.0009) [2023-12-26 03:39:53,242][123090] Updated weights for policy 1, policy_version 507287 (0.0010) [2023-12-26 03:39:53,739][123091] Updated weights for policy 0, policy_version 510872 (0.0009) [2023-12-26 03:39:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 260653056. Throughput: 0: 9001.0, 1: 8929.4. Samples: 260632928. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 03:39:53,785][121949] Avg episode reward: [(0, '6157.854'), (1, '5796.025')] [2023-12-26 03:39:53,791][123091] Updated weights for policy 0, policy_version 510882 (0.0010) [2023-12-26 03:39:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000507296_129867776.pth... [2023-12-26 03:39:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000506272_129605632.pth [2023-12-26 03:39:53,853][123091] Updated weights for policy 0, policy_version 510892 (0.0009) [2023-12-26 03:39:53,878][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000510896_130793472.pth... [2023-12-26 03:39:53,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000509808_130514944.pth [2023-12-26 03:39:54,072][123090] Updated weights for policy 1, policy_version 507297 (0.0009) [2023-12-26 03:39:54,141][123090] Updated weights for policy 1, policy_version 507307 (0.0009) [2023-12-26 03:39:54,202][123090] Updated weights for policy 1, policy_version 507317 (0.0010) [2023-12-26 03:39:54,253][123090] Updated weights for policy 1, policy_version 507327 (0.0009) [2023-12-26 03:39:54,676][123091] Updated weights for policy 0, policy_version 510902 (0.0010) [2023-12-26 03:39:54,735][123091] Updated weights for policy 0, policy_version 510912 (0.0008) [2023-12-26 03:39:54,789][123091] Updated weights for policy 0, policy_version 510922 (0.0005) [2023-12-26 03:39:55,092][123090] Updated weights for policy 1, policy_version 507337 (0.0010) [2023-12-26 03:39:55,151][123090] Updated weights for policy 1, policy_version 507347 (0.0010) [2023-12-26 03:39:55,211][123090] Updated weights for policy 1, policy_version 507357 (0.0009) [2023-12-26 03:39:55,600][123091] Updated weights for policy 0, policy_version 510932 (0.0009) [2023-12-26 03:39:55,648][123091] Updated weights for policy 0, policy_version 510942 (0.0009) [2023-12-26 03:39:55,698][123091] Updated weights for policy 0, policy_version 510952 (0.0009) [2023-12-26 03:39:56,037][123090] Updated weights for policy 1, policy_version 507367 (0.0006) [2023-12-26 03:39:56,090][123090] Updated weights for policy 1, policy_version 507377 (0.0005) [2023-12-26 03:39:56,161][123090] Updated weights for policy 1, policy_version 507387 (0.0008) [2023-12-26 03:39:56,558][123091] Updated weights for policy 0, policy_version 510962 (0.0009) [2023-12-26 03:39:56,628][123091] Updated weights for policy 0, policy_version 510972 (0.0009) [2023-12-26 03:39:56,694][123091] Updated weights for policy 0, policy_version 510982 (0.0008) [2023-12-26 03:39:56,759][123091] Updated weights for policy 0, policy_version 510992 (0.0010) [2023-12-26 03:39:56,877][123090] Updated weights for policy 1, policy_version 507397 (0.0009) [2023-12-26 03:39:56,932][123090] Updated weights for policy 1, policy_version 507407 (0.0008) [2023-12-26 03:39:56,991][123090] Updated weights for policy 1, policy_version 507417 (0.0010) [2023-12-26 03:39:57,563][123091] Updated weights for policy 0, policy_version 511002 (0.0009) [2023-12-26 03:39:57,617][123091] Updated weights for policy 0, policy_version 511012 (0.0009) [2023-12-26 03:39:57,670][123091] Updated weights for policy 0, policy_version 511022 (0.0005) [2023-12-26 03:39:57,848][123090] Updated weights for policy 1, policy_version 507427 (0.0009) [2023-12-26 03:39:57,897][123090] Updated weights for policy 1, policy_version 507437 (0.0008) [2023-12-26 03:39:57,960][123090] Updated weights for policy 1, policy_version 507447 (0.0009) [2023-12-26 03:39:58,494][123091] Updated weights for policy 0, policy_version 511032 (0.0006) [2023-12-26 03:39:58,564][123091] Updated weights for policy 0, policy_version 511042 (0.0007) [2023-12-26 03:39:58,636][123091] Updated weights for policy 0, policy_version 511052 (0.0007) [2023-12-26 03:39:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17886.4, 300 sec: 17800.2). Total num frames: 260743168. Throughput: 0: 9018.9, 1: 8883.3. Samples: 260737672. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:39:58,785][121949] Avg episode reward: [(0, '6128.954'), (1, '5938.181')] [2023-12-26 03:39:58,832][123090] Updated weights for policy 1, policy_version 507457 (0.0009) [2023-12-26 03:39:58,900][123090] Updated weights for policy 1, policy_version 507467 (0.0006) [2023-12-26 03:39:58,962][123090] Updated weights for policy 1, policy_version 507477 (0.0008) [2023-12-26 03:39:59,037][123090] Updated weights for policy 1, policy_version 507487 (0.0008) [2023-12-26 03:39:59,506][123091] Updated weights for policy 0, policy_version 511062 (0.0006) [2023-12-26 03:39:59,568][123091] Updated weights for policy 0, policy_version 511072 (0.0005) [2023-12-26 03:39:59,627][123091] Updated weights for policy 0, policy_version 511082 (0.0005) [2023-12-26 03:39:59,777][123090] Updated weights for policy 1, policy_version 507497 (0.0006) [2023-12-26 03:39:59,843][123090] Updated weights for policy 1, policy_version 507507 (0.0006) [2023-12-26 03:39:59,919][123090] Updated weights for policy 1, policy_version 507517 (0.0008) [2023-12-26 03:40:00,273][123091] Updated weights for policy 0, policy_version 511092 (0.0006) [2023-12-26 03:40:00,319][123091] Updated weights for policy 0, policy_version 511102 (0.0005) [2023-12-26 03:40:00,370][123091] Updated weights for policy 0, policy_version 511112 (0.0010) [2023-12-26 03:40:00,647][123090] Updated weights for policy 1, policy_version 507527 (0.0006) [2023-12-26 03:40:00,710][123090] Updated weights for policy 1, policy_version 507537 (0.0005) [2023-12-26 03:40:00,772][123090] Updated weights for policy 1, policy_version 507547 (0.0005) [2023-12-26 03:40:01,182][123091] Updated weights for policy 0, policy_version 511122 (0.0010) [2023-12-26 03:40:01,230][123091] Updated weights for policy 0, policy_version 511132 (0.0010) [2023-12-26 03:40:01,293][123091] Updated weights for policy 0, policy_version 511142 (0.0010) [2023-12-26 03:40:01,359][123091] Updated weights for policy 0, policy_version 511152 (0.0011) [2023-12-26 03:40:01,465][123090] Updated weights for policy 1, policy_version 507557 (0.0007) [2023-12-26 03:40:01,513][123090] Updated weights for policy 1, policy_version 507567 (0.0009) [2023-12-26 03:40:01,569][123090] Updated weights for policy 1, policy_version 507577 (0.0009) [2023-12-26 03:40:02,213][123091] Updated weights for policy 0, policy_version 511162 (0.0011) [2023-12-26 03:40:02,265][123091] Updated weights for policy 0, policy_version 511172 (0.0011) [2023-12-26 03:40:02,324][123091] Updated weights for policy 0, policy_version 511182 (0.0010) [2023-12-26 03:40:02,432][123090] Updated weights for policy 1, policy_version 507587 (0.0009) [2023-12-26 03:40:02,483][123090] Updated weights for policy 1, policy_version 507597 (0.0009) [2023-12-26 03:40:02,536][123090] Updated weights for policy 1, policy_version 507607 (0.0006) [2023-12-26 03:40:03,156][123091] Updated weights for policy 0, policy_version 511192 (0.0010) [2023-12-26 03:40:03,199][123091] Updated weights for policy 0, policy_version 511202 (0.0010) [2023-12-26 03:40:03,253][123091] Updated weights for policy 0, policy_version 511212 (0.0010) [2023-12-26 03:40:03,315][123090] Updated weights for policy 1, policy_version 507617 (0.0009) [2023-12-26 03:40:03,367][123090] Updated weights for policy 1, policy_version 507627 (0.0006) [2023-12-26 03:40:03,443][123090] Updated weights for policy 1, policy_version 507637 (0.0005) [2023-12-26 03:40:03,500][123090] Updated weights for policy 1, policy_version 507647 (0.0005) [2023-12-26 03:40:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 260833280. Throughput: 0: 9080.0, 1: 8845.4. Samples: 260845240. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:03,785][121949] Avg episode reward: [(0, '6067.895'), (1, '5946.172')] [2023-12-26 03:40:03,929][123091] Updated weights for policy 0, policy_version 511222 (0.0010) [2023-12-26 03:40:03,977][123091] Updated weights for policy 0, policy_version 511232 (0.0011) [2023-12-26 03:40:04,033][123091] Updated weights for policy 0, policy_version 511242 (0.0011) [2023-12-26 03:40:04,185][123090] Updated weights for policy 1, policy_version 507657 (0.0009) [2023-12-26 03:40:04,249][123090] Updated weights for policy 1, policy_version 507667 (0.0009) [2023-12-26 03:40:04,309][123090] Updated weights for policy 1, policy_version 507677 (0.0009) [2023-12-26 03:40:04,855][123091] Updated weights for policy 0, policy_version 511252 (0.0009) [2023-12-26 03:40:04,929][123091] Updated weights for policy 0, policy_version 511262 (0.0006) [2023-12-26 03:40:04,982][123091] Updated weights for policy 0, policy_version 511272 (0.0005) [2023-12-26 03:40:05,082][123090] Updated weights for policy 1, policy_version 507687 (0.0006) [2023-12-26 03:40:05,152][123090] Updated weights for policy 1, policy_version 507697 (0.0005) [2023-12-26 03:40:05,200][123090] Updated weights for policy 1, policy_version 507707 (0.0005) [2023-12-26 03:40:05,613][123091] Updated weights for policy 0, policy_version 511282 (0.0006) [2023-12-26 03:40:05,669][123091] Updated weights for policy 0, policy_version 511293 (0.0010) [2023-12-26 03:40:05,727][123091] Updated weights for policy 0, policy_version 511303 (0.0010) [2023-12-26 03:40:05,850][123090] Updated weights for policy 1, policy_version 507717 (0.0008) [2023-12-26 03:40:05,903][123090] Updated weights for policy 1, policy_version 507727 (0.0010) [2023-12-26 03:40:05,958][123090] Updated weights for policy 1, policy_version 507738 (0.0011) [2023-12-26 03:40:06,475][123091] Updated weights for policy 0, policy_version 511313 (0.0010) [2023-12-26 03:40:06,540][123091] Updated weights for policy 0, policy_version 511323 (0.0006) [2023-12-26 03:40:06,605][123091] Updated weights for policy 0, policy_version 511333 (0.0007) [2023-12-26 03:40:06,673][123091] Updated weights for policy 0, policy_version 511343 (0.0008) [2023-12-26 03:40:06,752][123090] Updated weights for policy 1, policy_version 507748 (0.0008) [2023-12-26 03:40:06,809][123090] Updated weights for policy 1, policy_version 507758 (0.0008) [2023-12-26 03:40:06,881][123090] Updated weights for policy 1, policy_version 507768 (0.0011) [2023-12-26 03:40:07,346][123091] Updated weights for policy 0, policy_version 511353 (0.0005) [2023-12-26 03:40:07,396][123091] Updated weights for policy 0, policy_version 511363 (0.0005) [2023-12-26 03:40:07,459][123091] Updated weights for policy 0, policy_version 511373 (0.0009) [2023-12-26 03:40:07,682][123090] Updated weights for policy 1, policy_version 507778 (0.0010) [2023-12-26 03:40:07,746][123090] Updated weights for policy 1, policy_version 507788 (0.0009) [2023-12-26 03:40:07,813][123090] Updated weights for policy 1, policy_version 507798 (0.0010) [2023-12-26 03:40:07,891][123090] Updated weights for policy 1, policy_version 507808 (0.0009) [2023-12-26 03:40:08,195][123091] Updated weights for policy 0, policy_version 511383 (0.0008) [2023-12-26 03:40:08,247][123091] Updated weights for policy 0, policy_version 511393 (0.0010) [2023-12-26 03:40:08,301][123091] Updated weights for policy 0, policy_version 511404 (0.0009) [2023-12-26 03:40:08,746][123090] Updated weights for policy 1, policy_version 507818 (0.0009) [2023-12-26 03:40:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 260923392. Throughput: 0: 9106.4, 1: 8855.8. Samples: 260902912. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:08,785][121949] Avg episode reward: [(0, '6102.228'), (1, '5893.488')] [2023-12-26 03:40:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000511408_130924544.pth... [2023-12-26 03:40:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000510352_130654208.pth [2023-12-26 03:40:08,821][123090] Updated weights for policy 1, policy_version 507828 (0.0010) [2023-12-26 03:40:08,876][123090] Updated weights for policy 1, policy_version 507838 (0.0010) [2023-12-26 03:40:08,883][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000507840_130007040.pth... [2023-12-26 03:40:08,886][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000506784_129736704.pth [2023-12-26 03:40:09,063][123091] Updated weights for policy 0, policy_version 511414 (0.0007) [2023-12-26 03:40:09,111][123091] Updated weights for policy 0, policy_version 511424 (0.0006) [2023-12-26 03:40:09,162][123091] Updated weights for policy 0, policy_version 511434 (0.0006) [2023-12-26 03:40:09,770][123090] Updated weights for policy 1, policy_version 507848 (0.0010) [2023-12-26 03:40:09,839][123090] Updated weights for policy 1, policy_version 507858 (0.0010) [2023-12-26 03:40:09,903][123090] Updated weights for policy 1, policy_version 507868 (0.0009) [2023-12-26 03:40:09,945][123091] Updated weights for policy 0, policy_version 511444 (0.0006) [2023-12-26 03:40:10,000][123091] Updated weights for policy 0, policy_version 511454 (0.0006) [2023-12-26 03:40:10,063][123091] Updated weights for policy 0, policy_version 511464 (0.0007) [2023-12-26 03:40:10,726][123090] Updated weights for policy 1, policy_version 507878 (0.0009) [2023-12-26 03:40:10,791][123090] Updated weights for policy 1, policy_version 507888 (0.0009) [2023-12-26 03:40:10,859][123090] Updated weights for policy 1, policy_version 507898 (0.0009) [2023-12-26 03:40:10,891][123091] Updated weights for policy 0, policy_version 511474 (0.0009) [2023-12-26 03:40:10,938][123091] Updated weights for policy 0, policy_version 511484 (0.0009) [2023-12-26 03:40:11,003][123091] Updated weights for policy 0, policy_version 511494 (0.0009) [2023-12-26 03:40:11,071][123091] Updated weights for policy 0, policy_version 511504 (0.0010) [2023-12-26 03:40:11,674][123090] Updated weights for policy 1, policy_version 507908 (0.0009) [2023-12-26 03:40:11,753][123090] Updated weights for policy 1, policy_version 507918 (0.0008) [2023-12-26 03:40:11,819][123090] Updated weights for policy 1, policy_version 507928 (0.0008) [2023-12-26 03:40:11,919][123091] Updated weights for policy 0, policy_version 511514 (0.0008) [2023-12-26 03:40:11,990][123091] Updated weights for policy 0, policy_version 511524 (0.0009) [2023-12-26 03:40:12,062][123091] Updated weights for policy 0, policy_version 511534 (0.0007) [2023-12-26 03:40:12,602][123090] Updated weights for policy 1, policy_version 507938 (0.0008) [2023-12-26 03:40:12,654][123090] Updated weights for policy 1, policy_version 507948 (0.0009) [2023-12-26 03:40:12,704][123090] Updated weights for policy 1, policy_version 507958 (0.0009) [2023-12-26 03:40:12,762][123090] Updated weights for policy 1, policy_version 507968 (0.0009) [2023-12-26 03:40:12,870][123091] Updated weights for policy 0, policy_version 511544 (0.0009) [2023-12-26 03:40:12,938][123091] Updated weights for policy 0, policy_version 511554 (0.0010) [2023-12-26 03:40:13,001][123091] Updated weights for policy 0, policy_version 511564 (0.0009) [2023-12-26 03:40:13,528][123090] Updated weights for policy 1, policy_version 507978 (0.0009) [2023-12-26 03:40:13,596][123090] Updated weights for policy 1, policy_version 507988 (0.0009) [2023-12-26 03:40:13,658][123090] Updated weights for policy 1, policy_version 507998 (0.0009) [2023-12-26 03:40:13,782][123091] Updated weights for policy 0, policy_version 511574 (0.0007) [2023-12-26 03:40:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 261013504. Throughput: 0: 9073.0, 1: 8725.1. Samples: 261007244. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:13,784][121949] Avg episode reward: [(0, '6159.625'), (1, '5890.844')] [2023-12-26 03:40:13,844][123091] Updated weights for policy 0, policy_version 511584 (0.0007) [2023-12-26 03:40:13,906][123091] Updated weights for policy 0, policy_version 511594 (0.0006) [2023-12-26 03:40:14,491][123090] Updated weights for policy 1, policy_version 508008 (0.0009) [2023-12-26 03:40:14,554][123090] Updated weights for policy 1, policy_version 508018 (0.0009) [2023-12-26 03:40:14,557][123091] Updated weights for policy 0, policy_version 511604 (0.0006) [2023-12-26 03:40:14,619][123090] Updated weights for policy 1, policy_version 508028 (0.0008) [2023-12-26 03:40:14,624][123091] Updated weights for policy 0, policy_version 511614 (0.0006) [2023-12-26 03:40:14,692][123091] Updated weights for policy 0, policy_version 511624 (0.0005) [2023-12-26 03:40:15,375][123091] Updated weights for policy 0, policy_version 511634 (0.0007) [2023-12-26 03:40:15,430][123091] Updated weights for policy 0, policy_version 511644 (0.0009) [2023-12-26 03:40:15,487][123091] Updated weights for policy 0, policy_version 511654 (0.0009) [2023-12-26 03:40:15,522][123090] Updated weights for policy 1, policy_version 508038 (0.0008) [2023-12-26 03:40:15,544][123091] Updated weights for policy 0, policy_version 511664 (0.0008) [2023-12-26 03:40:15,585][123090] Updated weights for policy 1, policy_version 508048 (0.0008) [2023-12-26 03:40:15,645][123090] Updated weights for policy 1, policy_version 508058 (0.0009) [2023-12-26 03:40:16,399][123091] Updated weights for policy 0, policy_version 511674 (0.0010) [2023-12-26 03:40:16,453][123091] Updated weights for policy 0, policy_version 511684 (0.0010) [2023-12-26 03:40:16,487][123090] Updated weights for policy 1, policy_version 508068 (0.0008) [2023-12-26 03:40:16,522][123091] Updated weights for policy 0, policy_version 511694 (0.0009) [2023-12-26 03:40:16,560][123090] Updated weights for policy 1, policy_version 508078 (0.0006) [2023-12-26 03:40:16,629][123090] Updated weights for policy 1, policy_version 508088 (0.0008) [2023-12-26 03:40:17,240][123091] Updated weights for policy 0, policy_version 511704 (0.0010) [2023-12-26 03:40:17,309][123091] Updated weights for policy 0, policy_version 511714 (0.0010) [2023-12-26 03:40:17,375][123091] Updated weights for policy 0, policy_version 511724 (0.0007) [2023-12-26 03:40:17,455][123090] Updated weights for policy 1, policy_version 508098 (0.0009) [2023-12-26 03:40:17,524][123090] Updated weights for policy 1, policy_version 508108 (0.0010) [2023-12-26 03:40:17,596][123090] Updated weights for policy 1, policy_version 508118 (0.0010) [2023-12-26 03:40:17,667][123090] Updated weights for policy 1, policy_version 508128 (0.0009) [2023-12-26 03:40:18,106][123091] Updated weights for policy 0, policy_version 511734 (0.0008) [2023-12-26 03:40:18,164][123091] Updated weights for policy 0, policy_version 511744 (0.0009) [2023-12-26 03:40:18,230][123091] Updated weights for policy 0, policy_version 511754 (0.0009) [2023-12-26 03:40:18,528][123090] Updated weights for policy 1, policy_version 508138 (0.0009) [2023-12-26 03:40:18,593][123090] Updated weights for policy 1, policy_version 508148 (0.0009) [2023-12-26 03:40:18,662][123090] Updated weights for policy 1, policy_version 508158 (0.0010) [2023-12-26 03:40:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 261103616. Throughput: 0: 9055.6, 1: 8691.7. Samples: 261112556. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:18,785][121949] Avg episode reward: [(0, '6092.589'), (1, '5948.417')] [2023-12-26 03:40:19,087][123091] Updated weights for policy 0, policy_version 511764 (0.0010) [2023-12-26 03:40:19,143][123091] Updated weights for policy 0, policy_version 511774 (0.0009) [2023-12-26 03:40:19,202][123091] Updated weights for policy 0, policy_version 511784 (0.0009) [2023-12-26 03:40:19,424][123090] Updated weights for policy 1, policy_version 508168 (0.0008) [2023-12-26 03:40:19,478][123090] Updated weights for policy 1, policy_version 508178 (0.0009) [2023-12-26 03:40:19,548][123090] Updated weights for policy 1, policy_version 508188 (0.0009) [2023-12-26 03:40:19,981][123091] Updated weights for policy 0, policy_version 511794 (0.0009) [2023-12-26 03:40:20,056][123091] Updated weights for policy 0, policy_version 511804 (0.0011) [2023-12-26 03:40:20,113][123091] Updated weights for policy 0, policy_version 511814 (0.0011) [2023-12-26 03:40:20,176][123091] Updated weights for policy 0, policy_version 511824 (0.0011) [2023-12-26 03:40:20,407][123090] Updated weights for policy 1, policy_version 508198 (0.0009) [2023-12-26 03:40:20,472][123090] Updated weights for policy 1, policy_version 508208 (0.0008) [2023-12-26 03:40:20,535][123090] Updated weights for policy 1, policy_version 508218 (0.0009) [2023-12-26 03:40:21,004][123091] Updated weights for policy 0, policy_version 511834 (0.0008) [2023-12-26 03:40:21,076][123091] Updated weights for policy 0, policy_version 511844 (0.0009) [2023-12-26 03:40:21,141][123091] Updated weights for policy 0, policy_version 511854 (0.0009) [2023-12-26 03:40:21,349][123090] Updated weights for policy 1, policy_version 508228 (0.0008) [2023-12-26 03:40:21,424][123090] Updated weights for policy 1, policy_version 508238 (0.0008) [2023-12-26 03:40:21,488][123090] Updated weights for policy 1, policy_version 508248 (0.0008) [2023-12-26 03:40:22,014][123091] Updated weights for policy 0, policy_version 511864 (0.0009) [2023-12-26 03:40:22,073][123091] Updated weights for policy 0, policy_version 511874 (0.0010) [2023-12-26 03:40:22,136][123091] Updated weights for policy 0, policy_version 511884 (0.0009) [2023-12-26 03:40:22,257][123090] Updated weights for policy 1, policy_version 508258 (0.0008) [2023-12-26 03:40:22,321][123090] Updated weights for policy 1, policy_version 508268 (0.0008) [2023-12-26 03:40:22,395][123090] Updated weights for policy 1, policy_version 508278 (0.0008) [2023-12-26 03:40:22,463][123090] Updated weights for policy 1, policy_version 508288 (0.0008) [2023-12-26 03:40:23,097][123091] Updated weights for policy 0, policy_version 511894 (0.0010) [2023-12-26 03:40:23,161][123091] Updated weights for policy 0, policy_version 511904 (0.0010) [2023-12-26 03:40:23,174][123090] Updated weights for policy 1, policy_version 508298 (0.0005) [2023-12-26 03:40:23,220][123091] Updated weights for policy 0, policy_version 511914 (0.0008) [2023-12-26 03:40:23,229][123090] Updated weights for policy 1, policy_version 508308 (0.0009) [2023-12-26 03:40:23,280][123090] Updated weights for policy 1, policy_version 508318 (0.0009) [2023-12-26 03:40:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 261185536. Throughput: 0: 8931.3, 1: 8738.4. Samples: 261163552. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:23,785][121949] Avg episode reward: [(0, '6064.869'), (1, '5911.406')] [2023-12-26 03:40:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000508320_130129920.pth... [2023-12-26 03:40:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000511920_131055616.pth... [2023-12-26 03:40:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000507296_129867776.pth [2023-12-26 03:40:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000510896_130793472.pth [2023-12-26 03:40:24,058][123090] Updated weights for policy 1, policy_version 508328 (0.0006) [2023-12-26 03:40:24,106][123091] Updated weights for policy 0, policy_version 511924 (0.0009) [2023-12-26 03:40:24,113][123090] Updated weights for policy 1, policy_version 508338 (0.0006) [2023-12-26 03:40:24,160][123091] Updated weights for policy 0, policy_version 511934 (0.0009) [2023-12-26 03:40:24,171][123090] Updated weights for policy 1, policy_version 508348 (0.0005) [2023-12-26 03:40:24,210][123091] Updated weights for policy 0, policy_version 511944 (0.0008) [2023-12-26 03:40:24,913][123090] Updated weights for policy 1, policy_version 508358 (0.0005) [2023-12-26 03:40:24,914][123091] Updated weights for policy 0, policy_version 511954 (0.0009) [2023-12-26 03:40:24,970][123091] Updated weights for policy 0, policy_version 511964 (0.0005) [2023-12-26 03:40:24,974][123090] Updated weights for policy 1, policy_version 508368 (0.0007) [2023-12-26 03:40:25,035][123091] Updated weights for policy 0, policy_version 511974 (0.0005) [2023-12-26 03:40:25,049][123090] Updated weights for policy 1, policy_version 508378 (0.0008) [2023-12-26 03:40:25,109][123091] Updated weights for policy 0, policy_version 511984 (0.0008) [2023-12-26 03:40:25,671][123090] Updated weights for policy 1, policy_version 508388 (0.0009) [2023-12-26 03:40:25,732][123090] Updated weights for policy 1, policy_version 508398 (0.0009) [2023-12-26 03:40:25,785][123090] Updated weights for policy 1, policy_version 508408 (0.0010) [2023-12-26 03:40:25,891][123091] Updated weights for policy 0, policy_version 511995 (0.0006) [2023-12-26 03:40:25,951][123091] Updated weights for policy 0, policy_version 512007 (0.0009) [2023-12-26 03:40:26,562][123090] Updated weights for policy 1, policy_version 508418 (0.0009) [2023-12-26 03:40:26,629][123090] Updated weights for policy 1, policy_version 508428 (0.0006) [2023-12-26 03:40:26,679][123091] Updated weights for policy 0, policy_version 512017 (0.0009) [2023-12-26 03:40:26,682][123090] Updated weights for policy 1, policy_version 508438 (0.0009) [2023-12-26 03:40:26,739][123090] Updated weights for policy 1, policy_version 508448 (0.0009) [2023-12-26 03:40:26,745][123091] Updated weights for policy 0, policy_version 512027 (0.0005) [2023-12-26 03:40:26,792][123091] Updated weights for policy 0, policy_version 512037 (0.0005) [2023-12-26 03:40:26,837][123091] Updated weights for policy 0, policy_version 512047 (0.0005) [2023-12-26 03:40:27,468][123090] Updated weights for policy 1, policy_version 508458 (0.0010) [2023-12-26 03:40:27,518][123090] Updated weights for policy 1, policy_version 508468 (0.0010) [2023-12-26 03:40:27,572][123090] Updated weights for policy 1, policy_version 508478 (0.0010) [2023-12-26 03:40:27,605][123091] Updated weights for policy 0, policy_version 512057 (0.0010) [2023-12-26 03:40:27,659][123091] Updated weights for policy 0, policy_version 512067 (0.0010) [2023-12-26 03:40:27,719][123091] Updated weights for policy 0, policy_version 512077 (0.0010) [2023-12-26 03:40:28,400][123090] Updated weights for policy 1, policy_version 508488 (0.0010) [2023-12-26 03:40:28,406][123091] Updated weights for policy 0, policy_version 512087 (0.0010) [2023-12-26 03:40:28,453][123090] Updated weights for policy 1, policy_version 508498 (0.0010) [2023-12-26 03:40:28,458][123091] Updated weights for policy 0, policy_version 512097 (0.0010) [2023-12-26 03:40:28,505][123090] Updated weights for policy 1, policy_version 508508 (0.0010) [2023-12-26 03:40:28,506][123091] Updated weights for policy 0, policy_version 512107 (0.0010) [2023-12-26 03:40:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 261283840. Throughput: 0: 8978.0, 1: 8824.6. Samples: 261273140. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:28,784][121949] Avg episode reward: [(0, '6052.771'), (1, '5828.802')] [2023-12-26 03:40:29,250][123091] Updated weights for policy 0, policy_version 512117 (0.0007) [2023-12-26 03:40:29,318][123091] Updated weights for policy 0, policy_version 512127 (0.0006) [2023-12-26 03:40:29,351][123090] Updated weights for policy 1, policy_version 508518 (0.0008) [2023-12-26 03:40:29,390][123091] Updated weights for policy 0, policy_version 512137 (0.0007) [2023-12-26 03:40:29,418][123090] Updated weights for policy 1, policy_version 508528 (0.0008) [2023-12-26 03:40:29,484][123090] Updated weights for policy 1, policy_version 508538 (0.0008) [2023-12-26 03:40:30,171][123091] Updated weights for policy 0, policy_version 512147 (0.0007) [2023-12-26 03:40:30,221][123091] Updated weights for policy 0, policy_version 512157 (0.0009) [2023-12-26 03:40:30,228][123090] Updated weights for policy 1, policy_version 508548 (0.0009) [2023-12-26 03:40:30,270][123091] Updated weights for policy 0, policy_version 512167 (0.0007) [2023-12-26 03:40:30,279][123090] Updated weights for policy 1, policy_version 508558 (0.0009) [2023-12-26 03:40:30,333][123090] Updated weights for policy 1, policy_version 508568 (0.0009) [2023-12-26 03:40:31,040][123090] Updated weights for policy 1, policy_version 508578 (0.0010) [2023-12-26 03:40:31,103][123090] Updated weights for policy 1, policy_version 508588 (0.0008) [2023-12-26 03:40:31,162][123091] Updated weights for policy 0, policy_version 512177 (0.0006) [2023-12-26 03:40:31,176][123090] Updated weights for policy 1, policy_version 508598 (0.0011) [2023-12-26 03:40:31,222][123091] Updated weights for policy 0, policy_version 512187 (0.0008) [2023-12-26 03:40:31,232][123090] Updated weights for policy 1, policy_version 508608 (0.0010) [2023-12-26 03:40:31,285][123091] Updated weights for policy 0, policy_version 512197 (0.0009) [2023-12-26 03:40:31,351][123091] Updated weights for policy 0, policy_version 512207 (0.0008) [2023-12-26 03:40:32,095][123090] Updated weights for policy 1, policy_version 508618 (0.0011) [2023-12-26 03:40:32,147][123091] Updated weights for policy 0, policy_version 512217 (0.0008) [2023-12-26 03:40:32,154][123090] Updated weights for policy 1, policy_version 508628 (0.0010) [2023-12-26 03:40:32,205][123091] Updated weights for policy 0, policy_version 512227 (0.0006) [2023-12-26 03:40:32,218][123090] Updated weights for policy 1, policy_version 508638 (0.0011) [2023-12-26 03:40:32,259][123091] Updated weights for policy 0, policy_version 512237 (0.0006) [2023-12-26 03:40:32,977][123090] Updated weights for policy 1, policy_version 508648 (0.0007) [2023-12-26 03:40:33,032][123090] Updated weights for policy 1, policy_version 508658 (0.0007) [2023-12-26 03:40:33,092][123090] Updated weights for policy 1, policy_version 508668 (0.0009) [2023-12-26 03:40:33,124][123091] Updated weights for policy 0, policy_version 512247 (0.0009) [2023-12-26 03:40:33,181][123091] Updated weights for policy 0, policy_version 512258 (0.0010) [2023-12-26 03:40:33,234][123091] Updated weights for policy 0, policy_version 512268 (0.0010) [2023-12-26 03:40:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 261365760. Throughput: 0: 8924.0, 1: 8803.5. Samples: 261379848. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:33,786][121949] Avg episode reward: [(0, '6015.019'), (1, '5861.102')] [2023-12-26 03:40:33,843][123090] Updated weights for policy 1, policy_version 508678 (0.0006) [2023-12-26 03:40:33,904][123090] Updated weights for policy 1, policy_version 508688 (0.0009) [2023-12-26 03:40:33,966][123090] Updated weights for policy 1, policy_version 508698 (0.0010) [2023-12-26 03:40:34,122][123091] Updated weights for policy 0, policy_version 512278 (0.0009) [2023-12-26 03:40:34,184][123091] Updated weights for policy 0, policy_version 512288 (0.0009) [2023-12-26 03:40:34,242][123091] Updated weights for policy 0, policy_version 512298 (0.0009) [2023-12-26 03:40:34,715][123090] Updated weights for policy 1, policy_version 508708 (0.0010) [2023-12-26 03:40:34,767][123090] Updated weights for policy 1, policy_version 508718 (0.0011) [2023-12-26 03:40:34,815][123090] Updated weights for policy 1, policy_version 508728 (0.0010) [2023-12-26 03:40:35,080][123091] Updated weights for policy 0, policy_version 512308 (0.0010) [2023-12-26 03:40:35,131][123091] Updated weights for policy 0, policy_version 512318 (0.0008) [2023-12-26 03:40:35,179][123091] Updated weights for policy 0, policy_version 512328 (0.0008) [2023-12-26 03:40:35,658][123090] Updated weights for policy 1, policy_version 508738 (0.0010) [2023-12-26 03:40:35,726][123090] Updated weights for policy 1, policy_version 508748 (0.0008) [2023-12-26 03:40:35,786][123090] Updated weights for policy 1, policy_version 508758 (0.0005) [2023-12-26 03:40:35,845][123090] Updated weights for policy 1, policy_version 508768 (0.0005) [2023-12-26 03:40:36,048][123091] Updated weights for policy 0, policy_version 512338 (0.0009) [2023-12-26 03:40:36,099][123091] Updated weights for policy 0, policy_version 512348 (0.0009) [2023-12-26 03:40:36,164][123091] Updated weights for policy 0, policy_version 512358 (0.0010) [2023-12-26 03:40:36,226][123091] Updated weights for policy 0, policy_version 512368 (0.0010) [2023-12-26 03:40:36,473][123090] Updated weights for policy 1, policy_version 508778 (0.0009) [2023-12-26 03:40:36,532][123090] Updated weights for policy 1, policy_version 508788 (0.0009) [2023-12-26 03:40:36,603][123090] Updated weights for policy 1, policy_version 508798 (0.0009) [2023-12-26 03:40:37,071][123091] Updated weights for policy 0, policy_version 512378 (0.0010) [2023-12-26 03:40:37,126][123091] Updated weights for policy 0, policy_version 512388 (0.0010) [2023-12-26 03:40:37,180][123091] Updated weights for policy 0, policy_version 512399 (0.0010) [2023-12-26 03:40:37,338][123090] Updated weights for policy 1, policy_version 508808 (0.0010) [2023-12-26 03:40:37,401][123090] Updated weights for policy 1, policy_version 508818 (0.0009) [2023-12-26 03:40:37,458][123090] Updated weights for policy 1, policy_version 508828 (0.0009) [2023-12-26 03:40:38,105][123091] Updated weights for policy 0, policy_version 512409 (0.0009) [2023-12-26 03:40:38,161][123091] Updated weights for policy 0, policy_version 512419 (0.0009) [2023-12-26 03:40:38,222][123091] Updated weights for policy 0, policy_version 512429 (0.0008) [2023-12-26 03:40:38,224][123090] Updated weights for policy 1, policy_version 508838 (0.0009) [2023-12-26 03:40:38,282][123090] Updated weights for policy 1, policy_version 508848 (0.0006) [2023-12-26 03:40:38,351][123090] Updated weights for policy 1, policy_version 508858 (0.0007) [2023-12-26 03:40:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 261455872. Throughput: 0: 8917.5, 1: 8843.4. Samples: 261432172. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:38,785][121949] Avg episode reward: [(0, '5993.580'), (1, '5792.767')] [2023-12-26 03:40:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000512432_131186688.pth... [2023-12-26 03:40:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000508864_130269184.pth... [2023-12-26 03:40:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000507840_130007040.pth [2023-12-26 03:40:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000511408_130924544.pth [2023-12-26 03:40:39,005][123091] Updated weights for policy 0, policy_version 512439 (0.0009) [2023-12-26 03:40:39,079][123091] Updated weights for policy 0, policy_version 512449 (0.0010) [2023-12-26 03:40:39,089][123090] Updated weights for policy 1, policy_version 508868 (0.0007) [2023-12-26 03:40:39,143][123091] Updated weights for policy 0, policy_version 512459 (0.0007) [2023-12-26 03:40:39,163][123090] Updated weights for policy 1, policy_version 508878 (0.0005) [2023-12-26 03:40:39,234][123090] Updated weights for policy 1, policy_version 508888 (0.0007) [2023-12-26 03:40:39,925][123090] Updated weights for policy 1, policy_version 508898 (0.0007) [2023-12-26 03:40:39,997][123090] Updated weights for policy 1, policy_version 508908 (0.0007) [2023-12-26 03:40:40,023][123091] Updated weights for policy 0, policy_version 512469 (0.0008) [2023-12-26 03:40:40,065][123090] Updated weights for policy 1, policy_version 508918 (0.0008) [2023-12-26 03:40:40,077][123091] Updated weights for policy 0, policy_version 512479 (0.0007) [2023-12-26 03:40:40,126][123090] Updated weights for policy 1, policy_version 508928 (0.0009) [2023-12-26 03:40:40,141][123091] Updated weights for policy 0, policy_version 512489 (0.0009) [2023-12-26 03:40:40,937][123090] Updated weights for policy 1, policy_version 508938 (0.0010) [2023-12-26 03:40:40,995][123091] Updated weights for policy 0, policy_version 512499 (0.0009) [2023-12-26 03:40:40,998][123090] Updated weights for policy 1, policy_version 508948 (0.0009) [2023-12-26 03:40:41,059][123091] Updated weights for policy 0, policy_version 512509 (0.0008) [2023-12-26 03:40:41,060][123090] Updated weights for policy 1, policy_version 508958 (0.0009) [2023-12-26 03:40:41,123][123091] Updated weights for policy 0, policy_version 512519 (0.0009) [2023-12-26 03:40:41,880][123091] Updated weights for policy 0, policy_version 512529 (0.0006) [2023-12-26 03:40:41,916][123090] Updated weights for policy 1, policy_version 508968 (0.0010) [2023-12-26 03:40:41,940][123091] Updated weights for policy 0, policy_version 512539 (0.0007) [2023-12-26 03:40:41,977][123090] Updated weights for policy 1, policy_version 508978 (0.0010) [2023-12-26 03:40:42,002][123091] Updated weights for policy 0, policy_version 512549 (0.0007) [2023-12-26 03:40:42,033][123090] Updated weights for policy 1, policy_version 508988 (0.0008) [2023-12-26 03:40:42,059][123091] Updated weights for policy 0, policy_version 512559 (0.0007) [2023-12-26 03:40:42,847][123090] Updated weights for policy 1, policy_version 508998 (0.0010) [2023-12-26 03:40:42,898][123091] Updated weights for policy 0, policy_version 512569 (0.0006) [2023-12-26 03:40:42,904][123090] Updated weights for policy 1, policy_version 509008 (0.0011) [2023-12-26 03:40:42,956][123091] Updated weights for policy 0, policy_version 512579 (0.0007) [2023-12-26 03:40:42,968][123090] Updated weights for policy 1, policy_version 509018 (0.0011) [2023-12-26 03:40:43,022][123091] Updated weights for policy 0, policy_version 512589 (0.0010) [2023-12-26 03:40:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 261537792. Throughput: 0: 8844.4, 1: 8912.5. Samples: 261536736. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:43,785][121949] Avg episode reward: [(0, '5977.557'), (1, '5788.039')] [2023-12-26 03:40:43,787][123091] Updated weights for policy 0, policy_version 512599 (0.0007) [2023-12-26 03:40:43,808][123090] Updated weights for policy 1, policy_version 509028 (0.0011) [2023-12-26 03:40:43,845][123091] Updated weights for policy 0, policy_version 512609 (0.0007) [2023-12-26 03:40:43,870][123090] Updated weights for policy 1, policy_version 509038 (0.0010) [2023-12-26 03:40:43,902][123091] Updated weights for policy 0, policy_version 512619 (0.0008) [2023-12-26 03:40:43,929][123090] Updated weights for policy 1, policy_version 509048 (0.0010) [2023-12-26 03:40:44,587][123091] Updated weights for policy 0, policy_version 512629 (0.0008) [2023-12-26 03:40:44,628][123090] Updated weights for policy 1, policy_version 509058 (0.0009) [2023-12-26 03:40:44,654][123091] Updated weights for policy 0, policy_version 512639 (0.0006) [2023-12-26 03:40:44,684][123090] Updated weights for policy 1, policy_version 509068 (0.0005) [2023-12-26 03:40:44,724][123091] Updated weights for policy 0, policy_version 512649 (0.0005) [2023-12-26 03:40:44,753][123090] Updated weights for policy 1, policy_version 509078 (0.0006) [2023-12-26 03:40:44,829][123090] Updated weights for policy 1, policy_version 509088 (0.0007) [2023-12-26 03:40:45,481][123090] Updated weights for policy 1, policy_version 509098 (0.0006) [2023-12-26 03:40:45,539][123090] Updated weights for policy 1, policy_version 509108 (0.0005) [2023-12-26 03:40:45,567][123091] Updated weights for policy 0, policy_version 512659 (0.0009) [2023-12-26 03:40:45,598][123090] Updated weights for policy 1, policy_version 509118 (0.0006) [2023-12-26 03:40:45,626][123091] Updated weights for policy 0, policy_version 512669 (0.0008) [2023-12-26 03:40:45,686][123091] Updated weights for policy 0, policy_version 512679 (0.0010) [2023-12-26 03:40:46,320][123090] Updated weights for policy 1, policy_version 509128 (0.0006) [2023-12-26 03:40:46,385][123090] Updated weights for policy 1, policy_version 509138 (0.0005) [2023-12-26 03:40:46,440][123090] Updated weights for policy 1, policy_version 509148 (0.0007) [2023-12-26 03:40:46,600][123091] Updated weights for policy 0, policy_version 512689 (0.0009) [2023-12-26 03:40:46,663][123091] Updated weights for policy 0, policy_version 512699 (0.0008) [2023-12-26 03:40:46,724][123091] Updated weights for policy 0, policy_version 512709 (0.0010) [2023-12-26 03:40:46,786][123091] Updated weights for policy 0, policy_version 512719 (0.0010) [2023-12-26 03:40:47,150][123090] Updated weights for policy 1, policy_version 509158 (0.0008) [2023-12-26 03:40:47,217][123090] Updated weights for policy 1, policy_version 509168 (0.0011) [2023-12-26 03:40:47,285][123090] Updated weights for policy 1, policy_version 509178 (0.0011) [2023-12-26 03:40:47,659][123091] Updated weights for policy 0, policy_version 512729 (0.0009) [2023-12-26 03:40:47,715][123091] Updated weights for policy 0, policy_version 512739 (0.0009) [2023-12-26 03:40:47,771][123091] Updated weights for policy 0, policy_version 512749 (0.0009) [2023-12-26 03:40:48,125][123090] Updated weights for policy 1, policy_version 509188 (0.0009) [2023-12-26 03:40:48,196][123090] Updated weights for policy 1, policy_version 509198 (0.0006) [2023-12-26 03:40:48,259][123090] Updated weights for policy 1, policy_version 509208 (0.0011) [2023-12-26 03:40:48,651][123091] Updated weights for policy 0, policy_version 512759 (0.0008) [2023-12-26 03:40:48,704][123091] Updated weights for policy 0, policy_version 512769 (0.0009) [2023-12-26 03:40:48,769][123091] Updated weights for policy 0, policy_version 512779 (0.0007) [2023-12-26 03:40:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 261627904. Throughput: 0: 8805.4, 1: 8946.8. Samples: 261644084. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:48,785][121949] Avg episode reward: [(0, '6039.545'), (1, '5858.430')] [2023-12-26 03:40:49,080][123090] Updated weights for policy 1, policy_version 509218 (0.0009) [2023-12-26 03:40:49,137][123090] Updated weights for policy 1, policy_version 509228 (0.0011) [2023-12-26 03:40:49,197][123090] Updated weights for policy 1, policy_version 509238 (0.0011) [2023-12-26 03:40:49,267][123090] Updated weights for policy 1, policy_version 509248 (0.0011) [2023-12-26 03:40:49,570][123091] Updated weights for policy 0, policy_version 512789 (0.0009) [2023-12-26 03:40:49,619][123091] Updated weights for policy 0, policy_version 512799 (0.0009) [2023-12-26 03:40:49,671][123091] Updated weights for policy 0, policy_version 512809 (0.0009) [2023-12-26 03:40:50,086][123090] Updated weights for policy 1, policy_version 509258 (0.0011) [2023-12-26 03:40:50,153][123090] Updated weights for policy 1, policy_version 509268 (0.0011) [2023-12-26 03:40:50,215][123090] Updated weights for policy 1, policy_version 509278 (0.0011) [2023-12-26 03:40:50,533][123091] Updated weights for policy 0, policy_version 512819 (0.0008) [2023-12-26 03:40:50,600][123091] Updated weights for policy 0, policy_version 512829 (0.0010) [2023-12-26 03:40:50,663][123091] Updated weights for policy 0, policy_version 512839 (0.0011) [2023-12-26 03:40:51,044][123090] Updated weights for policy 1, policy_version 509288 (0.0011) [2023-12-26 03:40:51,108][123090] Updated weights for policy 1, policy_version 509298 (0.0011) [2023-12-26 03:40:51,179][123090] Updated weights for policy 1, policy_version 509308 (0.0011) [2023-12-26 03:40:51,464][123091] Updated weights for policy 0, policy_version 512849 (0.0010) [2023-12-26 03:40:51,535][123091] Updated weights for policy 0, policy_version 512859 (0.0009) [2023-12-26 03:40:51,598][123091] Updated weights for policy 0, policy_version 512869 (0.0011) [2023-12-26 03:40:51,665][123091] Updated weights for policy 0, policy_version 512879 (0.0007) [2023-12-26 03:40:52,020][123090] Updated weights for policy 1, policy_version 509318 (0.0007) [2023-12-26 03:40:52,081][123090] Updated weights for policy 1, policy_version 509328 (0.0006) [2023-12-26 03:40:52,148][123090] Updated weights for policy 1, policy_version 509338 (0.0006) [2023-12-26 03:40:52,447][123091] Updated weights for policy 0, policy_version 512889 (0.0009) [2023-12-26 03:40:52,499][123091] Updated weights for policy 0, policy_version 512899 (0.0009) [2023-12-26 03:40:52,550][123091] Updated weights for policy 0, policy_version 512909 (0.0009) [2023-12-26 03:40:52,918][123090] Updated weights for policy 1, policy_version 509348 (0.0006) [2023-12-26 03:40:52,983][123090] Updated weights for policy 1, policy_version 509358 (0.0006) [2023-12-26 03:40:53,051][123090] Updated weights for policy 1, policy_version 509368 (0.0006) [2023-12-26 03:40:53,491][123091] Updated weights for policy 0, policy_version 512920 (0.0010) [2023-12-26 03:40:53,549][123091] Updated weights for policy 0, policy_version 512930 (0.0009) [2023-12-26 03:40:53,612][123091] Updated weights for policy 0, policy_version 512940 (0.0010) [2023-12-26 03:40:53,778][123090] Updated weights for policy 1, policy_version 509378 (0.0008) [2023-12-26 03:40:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 261718016. Throughput: 0: 8729.4, 1: 8878.0. Samples: 261695248. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:53,786][121949] Avg episode reward: [(0, '6054.137'), (1, '5913.125')] [2023-12-26 03:40:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000512944_131317760.pth... [2023-12-26 03:40:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000511920_131055616.pth [2023-12-26 03:40:53,846][123090] Updated weights for policy 1, policy_version 509388 (0.0010) [2023-12-26 03:40:53,912][123090] Updated weights for policy 1, policy_version 509398 (0.0009) [2023-12-26 03:40:53,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000509408_130408448.pth... [2023-12-26 03:40:53,969][123090] Updated weights for policy 1, policy_version 509408 (0.0009) [2023-12-26 03:40:53,970][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000508320_130129920.pth [2023-12-26 03:40:54,425][123091] Updated weights for policy 0, policy_version 512950 (0.0010) [2023-12-26 03:40:54,489][123091] Updated weights for policy 0, policy_version 512960 (0.0008) [2023-12-26 03:40:54,559][123091] Updated weights for policy 0, policy_version 512970 (0.0008) [2023-12-26 03:40:54,782][123090] Updated weights for policy 1, policy_version 509418 (0.0008) [2023-12-26 03:40:54,840][123090] Updated weights for policy 1, policy_version 509428 (0.0010) [2023-12-26 03:40:54,889][123090] Updated weights for policy 1, policy_version 509438 (0.0009) [2023-12-26 03:40:55,368][123091] Updated weights for policy 0, policy_version 512980 (0.0007) [2023-12-26 03:40:55,430][123091] Updated weights for policy 0, policy_version 512990 (0.0009) [2023-12-26 03:40:55,489][123091] Updated weights for policy 0, policy_version 513000 (0.0009) [2023-12-26 03:40:55,736][123090] Updated weights for policy 1, policy_version 509448 (0.0010) [2023-12-26 03:40:55,802][123090] Updated weights for policy 1, policy_version 509458 (0.0007) [2023-12-26 03:40:55,865][123090] Updated weights for policy 1, policy_version 509468 (0.0005) [2023-12-26 03:40:56,349][123091] Updated weights for policy 0, policy_version 513010 (0.0009) [2023-12-26 03:40:56,406][123091] Updated weights for policy 0, policy_version 513021 (0.0009) [2023-12-26 03:40:56,459][123091] Updated weights for policy 0, policy_version 513032 (0.0009) [2023-12-26 03:40:56,604][123090] Updated weights for policy 1, policy_version 509478 (0.0008) [2023-12-26 03:40:56,658][123090] Updated weights for policy 1, policy_version 509488 (0.0010) [2023-12-26 03:40:56,714][123090] Updated weights for policy 1, policy_version 509498 (0.0009) [2023-12-26 03:40:57,314][123091] Updated weights for policy 0, policy_version 513042 (0.0009) [2023-12-26 03:40:57,375][123091] Updated weights for policy 0, policy_version 513052 (0.0005) [2023-12-26 03:40:57,435][123091] Updated weights for policy 0, policy_version 513062 (0.0005) [2023-12-26 03:40:57,510][123091] Updated weights for policy 0, policy_version 513072 (0.0005) [2023-12-26 03:40:57,572][123090] Updated weights for policy 1, policy_version 509508 (0.0008) [2023-12-26 03:40:57,631][123090] Updated weights for policy 1, policy_version 509518 (0.0005) [2023-12-26 03:40:57,685][123090] Updated weights for policy 1, policy_version 509528 (0.0005) [2023-12-26 03:40:58,176][123091] Updated weights for policy 0, policy_version 513082 (0.0008) [2023-12-26 03:40:58,243][123091] Updated weights for policy 0, policy_version 513092 (0.0009) [2023-12-26 03:40:58,304][123091] Updated weights for policy 0, policy_version 513102 (0.0009) [2023-12-26 03:40:58,382][123090] Updated weights for policy 1, policy_version 509538 (0.0006) [2023-12-26 03:40:58,458][123090] Updated weights for policy 1, policy_version 509548 (0.0008) [2023-12-26 03:40:58,530][123090] Updated weights for policy 1, policy_version 509558 (0.0009) [2023-12-26 03:40:58,594][123090] Updated weights for policy 1, policy_version 509568 (0.0008) [2023-12-26 03:40:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 261808128. Throughput: 0: 8658.4, 1: 8937.9. Samples: 261799080. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:40:58,785][121949] Avg episode reward: [(0, '6093.105'), (1, '5859.553')] [2023-12-26 03:40:59,151][123091] Updated weights for policy 0, policy_version 513113 (0.0011) [2023-12-26 03:40:59,198][123091] Updated weights for policy 0, policy_version 513123 (0.0008) [2023-12-26 03:40:59,262][123091] Updated weights for policy 0, policy_version 513133 (0.0011) [2023-12-26 03:40:59,431][123090] Updated weights for policy 1, policy_version 509578 (0.0009) [2023-12-26 03:40:59,483][123090] Updated weights for policy 1, policy_version 509588 (0.0009) [2023-12-26 03:40:59,540][123090] Updated weights for policy 1, policy_version 509599 (0.0009) [2023-12-26 03:41:00,130][123091] Updated weights for policy 0, policy_version 513143 (0.0010) [2023-12-26 03:41:00,199][123091] Updated weights for policy 0, policy_version 513153 (0.0009) [2023-12-26 03:41:00,261][123091] Updated weights for policy 0, policy_version 513163 (0.0008) [2023-12-26 03:41:00,419][123090] Updated weights for policy 1, policy_version 509609 (0.0010) [2023-12-26 03:41:00,478][123090] Updated weights for policy 1, policy_version 509619 (0.0008) [2023-12-26 03:41:00,542][123090] Updated weights for policy 1, policy_version 509629 (0.0006) [2023-12-26 03:41:01,016][123091] Updated weights for policy 0, policy_version 513173 (0.0007) [2023-12-26 03:41:01,084][123091] Updated weights for policy 0, policy_version 513183 (0.0011) [2023-12-26 03:41:01,156][123091] Updated weights for policy 0, policy_version 513193 (0.0011) [2023-12-26 03:41:01,176][123090] Updated weights for policy 1, policy_version 509639 (0.0007) [2023-12-26 03:41:01,230][123090] Updated weights for policy 1, policy_version 509649 (0.0007) [2023-12-26 03:41:01,280][123090] Updated weights for policy 1, policy_version 509659 (0.0008) [2023-12-26 03:41:01,925][123091] Updated weights for policy 0, policy_version 513203 (0.0009) [2023-12-26 03:41:01,993][123091] Updated weights for policy 0, policy_version 513213 (0.0007) [2023-12-26 03:41:02,013][123090] Updated weights for policy 1, policy_version 509669 (0.0007) [2023-12-26 03:41:02,042][123091] Updated weights for policy 0, policy_version 513223 (0.0008) [2023-12-26 03:41:02,066][123090] Updated weights for policy 1, policy_version 509679 (0.0009) [2023-12-26 03:41:02,112][123090] Updated weights for policy 1, policy_version 509689 (0.0008) [2023-12-26 03:41:02,673][123091] Updated weights for policy 0, policy_version 513233 (0.0007) [2023-12-26 03:41:02,723][123091] Updated weights for policy 0, policy_version 513243 (0.0006) [2023-12-26 03:41:02,782][123091] Updated weights for policy 0, policy_version 513253 (0.0005) [2023-12-26 03:41:02,851][123091] Updated weights for policy 0, policy_version 513263 (0.0006) [2023-12-26 03:41:02,998][123090] Updated weights for policy 1, policy_version 509699 (0.0008) [2023-12-26 03:41:03,061][123090] Updated weights for policy 1, policy_version 509709 (0.0006) [2023-12-26 03:41:03,111][123090] Updated weights for policy 1, policy_version 509719 (0.0009) [2023-12-26 03:41:03,629][123091] Updated weights for policy 0, policy_version 513273 (0.0009) [2023-12-26 03:41:03,687][123091] Updated weights for policy 0, policy_version 513283 (0.0010) [2023-12-26 03:41:03,736][123091] Updated weights for policy 0, policy_version 513293 (0.0009) [2023-12-26 03:41:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 261898240. Throughput: 0: 8648.1, 1: 9021.7. Samples: 261907696. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:41:03,785][121949] Avg episode reward: [(0, '5947.154'), (1, '5789.595')] [2023-12-26 03:41:03,936][123090] Updated weights for policy 1, policy_version 509729 (0.0009) [2023-12-26 03:41:04,005][123090] Updated weights for policy 1, policy_version 509739 (0.0009) [2023-12-26 03:41:04,076][123090] Updated weights for policy 1, policy_version 509749 (0.0009) [2023-12-26 03:41:04,150][123090] Updated weights for policy 1, policy_version 509759 (0.0009) [2023-12-26 03:41:04,587][123091] Updated weights for policy 0, policy_version 513303 (0.0010) [2023-12-26 03:41:04,641][123091] Updated weights for policy 0, policy_version 513315 (0.0011) [2023-12-26 03:41:04,695][123091] Updated weights for policy 0, policy_version 513325 (0.0008) [2023-12-26 03:41:04,929][123090] Updated weights for policy 1, policy_version 509769 (0.0006) [2023-12-26 03:41:04,979][123090] Updated weights for policy 1, policy_version 509779 (0.0005) [2023-12-26 03:41:05,027][123090] Updated weights for policy 1, policy_version 509789 (0.0006) [2023-12-26 03:41:05,508][123091] Updated weights for policy 0, policy_version 513336 (0.0009) [2023-12-26 03:41:05,556][123091] Updated weights for policy 0, policy_version 513346 (0.0009) [2023-12-26 03:41:05,616][123091] Updated weights for policy 0, policy_version 513356 (0.0009) [2023-12-26 03:41:05,845][123090] Updated weights for policy 1, policy_version 509799 (0.0009) [2023-12-26 03:41:05,900][123090] Updated weights for policy 1, policy_version 509809 (0.0010) [2023-12-26 03:41:05,961][123090] Updated weights for policy 1, policy_version 509819 (0.0010) [2023-12-26 03:41:06,466][123091] Updated weights for policy 0, policy_version 513366 (0.0009) [2023-12-26 03:41:06,527][123091] Updated weights for policy 0, policy_version 513376 (0.0009) [2023-12-26 03:41:06,576][123091] Updated weights for policy 0, policy_version 513386 (0.0009) [2023-12-26 03:41:06,780][123090] Updated weights for policy 1, policy_version 509829 (0.0010) [2023-12-26 03:41:06,839][123090] Updated weights for policy 1, policy_version 509839 (0.0010) [2023-12-26 03:41:06,897][123090] Updated weights for policy 1, policy_version 509849 (0.0010) [2023-12-26 03:41:07,403][123091] Updated weights for policy 0, policy_version 513396 (0.0009) [2023-12-26 03:41:07,464][123091] Updated weights for policy 0, policy_version 513406 (0.0009) [2023-12-26 03:41:07,513][123091] Updated weights for policy 0, policy_version 513416 (0.0009) [2023-12-26 03:41:07,732][123090] Updated weights for policy 1, policy_version 509859 (0.0010) [2023-12-26 03:41:07,802][123090] Updated weights for policy 1, policy_version 509869 (0.0010) [2023-12-26 03:41:07,867][123090] Updated weights for policy 1, policy_version 509879 (0.0010) [2023-12-26 03:41:08,357][123091] Updated weights for policy 0, policy_version 513426 (0.0008) [2023-12-26 03:41:08,416][123091] Updated weights for policy 0, policy_version 513436 (0.0009) [2023-12-26 03:41:08,476][123091] Updated weights for policy 0, policy_version 513446 (0.0008) [2023-12-26 03:41:08,540][123091] Updated weights for policy 0, policy_version 513456 (0.0009) [2023-12-26 03:41:08,670][123090] Updated weights for policy 1, policy_version 509889 (0.0010) [2023-12-26 03:41:08,738][123090] Updated weights for policy 1, policy_version 509899 (0.0011) [2023-12-26 03:41:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 261980160. Throughput: 0: 8647.4, 1: 9037.5. Samples: 261959372. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:41:08,785][121949] Avg episode reward: [(0, '5898.029'), (1, '5689.408')] [2023-12-26 03:41:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000513456_131448832.pth... [2023-12-26 03:41:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000512432_131186688.pth [2023-12-26 03:41:08,805][123090] Updated weights for policy 1, policy_version 509909 (0.0010) [2023-12-26 03:41:08,872][123090] Updated weights for policy 1, policy_version 509919 (0.0010) [2023-12-26 03:41:08,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000509920_130539520.pth... [2023-12-26 03:41:08,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000508864_130269184.pth [2023-12-26 03:41:09,431][123091] Updated weights for policy 0, policy_version 513466 (0.0009) [2023-12-26 03:41:09,500][123091] Updated weights for policy 0, policy_version 513476 (0.0009) [2023-12-26 03:41:09,562][123091] Updated weights for policy 0, policy_version 513486 (0.0009) [2023-12-26 03:41:09,691][123090] Updated weights for policy 1, policy_version 509929 (0.0011) [2023-12-26 03:41:09,751][123090] Updated weights for policy 1, policy_version 509939 (0.0010) [2023-12-26 03:41:09,811][123090] Updated weights for policy 1, policy_version 509949 (0.0010) [2023-12-26 03:41:10,405][123091] Updated weights for policy 0, policy_version 513496 (0.0009) [2023-12-26 03:41:10,454][123091] Updated weights for policy 0, policy_version 513506 (0.0009) [2023-12-26 03:41:10,506][123091] Updated weights for policy 0, policy_version 513516 (0.0009) [2023-12-26 03:41:10,660][123090] Updated weights for policy 1, policy_version 509959 (0.0011) [2023-12-26 03:41:10,727][123090] Updated weights for policy 1, policy_version 509969 (0.0011) [2023-12-26 03:41:10,801][123090] Updated weights for policy 1, policy_version 509979 (0.0008) [2023-12-26 03:41:11,349][123091] Updated weights for policy 0, policy_version 513526 (0.0008) [2023-12-26 03:41:11,428][123091] Updated weights for policy 0, policy_version 513536 (0.0008) [2023-12-26 03:41:11,498][123091] Updated weights for policy 0, policy_version 513546 (0.0008) [2023-12-26 03:41:11,561][123090] Updated weights for policy 1, policy_version 509989 (0.0007) [2023-12-26 03:41:11,621][123090] Updated weights for policy 1, policy_version 509999 (0.0009) [2023-12-26 03:41:11,693][123090] Updated weights for policy 1, policy_version 510009 (0.0011) [2023-12-26 03:41:12,328][123091] Updated weights for policy 0, policy_version 513556 (0.0009) [2023-12-26 03:41:12,396][123091] Updated weights for policy 0, policy_version 513566 (0.0009) [2023-12-26 03:41:12,451][123091] Updated weights for policy 0, policy_version 513576 (0.0007) [2023-12-26 03:41:12,484][123090] Updated weights for policy 1, policy_version 510019 (0.0013) [2023-12-26 03:41:12,534][123090] Updated weights for policy 1, policy_version 510029 (0.0009) [2023-12-26 03:41:12,584][123090] Updated weights for policy 1, policy_version 510039 (0.0005) [2023-12-26 03:41:13,241][123090] Updated weights for policy 1, policy_version 510049 (0.0006) [2023-12-26 03:41:13,292][123090] Updated weights for policy 1, policy_version 510059 (0.0010) [2023-12-26 03:41:13,346][123090] Updated weights for policy 1, policy_version 510069 (0.0006) [2023-12-26 03:41:13,354][123091] Updated weights for policy 0, policy_version 513586 (0.0010) [2023-12-26 03:41:13,402][123090] Updated weights for policy 1, policy_version 510079 (0.0010) [2023-12-26 03:41:13,412][123091] Updated weights for policy 0, policy_version 513596 (0.0005) [2023-12-26 03:41:13,479][123091] Updated weights for policy 0, policy_version 513606 (0.0007) [2023-12-26 03:41:13,543][123091] Updated weights for policy 0, policy_version 513616 (0.0009) [2023-12-26 03:41:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 262070272. Throughput: 0: 8587.9, 1: 8927.1. Samples: 262061316. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:41:13,785][121949] Avg episode reward: [(0, '5981.208'), (1, '5769.139')] [2023-12-26 03:41:14,124][123090] Updated weights for policy 1, policy_version 510089 (0.0006) [2023-12-26 03:41:14,190][123090] Updated weights for policy 1, policy_version 510099 (0.0008) [2023-12-26 03:41:14,260][123090] Updated weights for policy 1, policy_version 510109 (0.0010) [2023-12-26 03:41:14,268][123091] Updated weights for policy 0, policy_version 513626 (0.0008) [2023-12-26 03:41:14,317][123091] Updated weights for policy 0, policy_version 513636 (0.0008) [2023-12-26 03:41:14,365][123091] Updated weights for policy 0, policy_version 513646 (0.0006) [2023-12-26 03:41:15,036][123090] Updated weights for policy 1, policy_version 510119 (0.0008) [2023-12-26 03:41:15,088][123090] Updated weights for policy 1, policy_version 510129 (0.0010) [2023-12-26 03:41:15,144][123090] Updated weights for policy 1, policy_version 510139 (0.0010) [2023-12-26 03:41:15,168][123091] Updated weights for policy 0, policy_version 513656 (0.0010) [2023-12-26 03:41:15,236][123091] Updated weights for policy 0, policy_version 513666 (0.0011) [2023-12-26 03:41:15,299][123091] Updated weights for policy 0, policy_version 513676 (0.0011) [2023-12-26 03:41:15,968][123090] Updated weights for policy 1, policy_version 510149 (0.0007) [2023-12-26 03:41:16,025][123090] Updated weights for policy 1, policy_version 510159 (0.0005) [2023-12-26 03:41:16,092][123090] Updated weights for policy 1, policy_version 510169 (0.0010) [2023-12-26 03:41:16,106][123091] Updated weights for policy 0, policy_version 513686 (0.0011) [2023-12-26 03:41:16,168][123091] Updated weights for policy 0, policy_version 513696 (0.0010) [2023-12-26 03:41:16,223][123091] Updated weights for policy 0, policy_version 513706 (0.0011) [2023-12-26 03:41:16,791][123090] Updated weights for policy 1, policy_version 510179 (0.0009) [2023-12-26 03:41:16,838][123090] Updated weights for policy 1, policy_version 510189 (0.0005) [2023-12-26 03:41:16,884][123090] Updated weights for policy 1, policy_version 510199 (0.0005) [2023-12-26 03:41:17,052][123091] Updated weights for policy 0, policy_version 513716 (0.0011) [2023-12-26 03:41:17,099][123091] Updated weights for policy 0, policy_version 513726 (0.0010) [2023-12-26 03:41:17,143][123091] Updated weights for policy 0, policy_version 513736 (0.0010) [2023-12-26 03:41:17,569][123090] Updated weights for policy 1, policy_version 510209 (0.0005) [2023-12-26 03:41:17,629][123090] Updated weights for policy 1, policy_version 510219 (0.0009) [2023-12-26 03:41:17,674][123090] Updated weights for policy 1, policy_version 510229 (0.0006) [2023-12-26 03:41:17,723][123090] Updated weights for policy 1, policy_version 510239 (0.0008) [2023-12-26 03:41:17,890][123091] Updated weights for policy 0, policy_version 513746 (0.0009) [2023-12-26 03:41:17,958][123091] Updated weights for policy 0, policy_version 513756 (0.0005) [2023-12-26 03:41:18,026][123091] Updated weights for policy 0, policy_version 513766 (0.0005) [2023-12-26 03:41:18,082][123091] Updated weights for policy 0, policy_version 513776 (0.0005) [2023-12-26 03:41:18,607][123090] Updated weights for policy 1, policy_version 510249 (0.0010) [2023-12-26 03:41:18,674][123090] Updated weights for policy 1, policy_version 510259 (0.0010) [2023-12-26 03:41:18,737][123090] Updated weights for policy 1, policy_version 510269 (0.0010) [2023-12-26 03:41:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 262160384. Throughput: 0: 8613.6, 1: 8967.4. Samples: 262170992. Policy #0 lag: (min: 24.0, avg: 52.5, max: 56.0) [2023-12-26 03:41:18,785][121949] Avg episode reward: [(0, '6027.187'), (1, '5806.567')] [2023-12-26 03:41:18,814][123091] Updated weights for policy 0, policy_version 513786 (0.0006) [2023-12-26 03:41:18,888][123091] Updated weights for policy 0, policy_version 513796 (0.0006) [2023-12-26 03:41:18,948][123091] Updated weights for policy 0, policy_version 513806 (0.0005) [2023-12-26 03:41:19,668][123090] Updated weights for policy 1, policy_version 510279 (0.0009) [2023-12-26 03:41:19,703][123091] Updated weights for policy 0, policy_version 513816 (0.0009) [2023-12-26 03:41:19,734][123090] Updated weights for policy 1, policy_version 510289 (0.0010) [2023-12-26 03:41:19,768][123091] Updated weights for policy 0, policy_version 513826 (0.0009) [2023-12-26 03:41:19,800][123090] Updated weights for policy 1, policy_version 510299 (0.0010) [2023-12-26 03:41:19,834][123091] Updated weights for policy 0, policy_version 513836 (0.0008) [2023-12-26 03:41:20,650][123090] Updated weights for policy 1, policy_version 510309 (0.0010) [2023-12-26 03:41:20,685][123091] Updated weights for policy 0, policy_version 513846 (0.0008) [2023-12-26 03:41:20,718][123090] Updated weights for policy 1, policy_version 510319 (0.0010) [2023-12-26 03:41:20,751][123091] Updated weights for policy 0, policy_version 513856 (0.0008) [2023-12-26 03:41:20,783][123090] Updated weights for policy 1, policy_version 510329 (0.0008) [2023-12-26 03:41:20,808][123091] Updated weights for policy 0, policy_version 513866 (0.0006) [2023-12-26 03:41:21,614][123090] Updated weights for policy 1, policy_version 510339 (0.0008) [2023-12-26 03:41:21,679][123090] Updated weights for policy 1, policy_version 510349 (0.0008) [2023-12-26 03:41:21,734][123091] Updated weights for policy 0, policy_version 513876 (0.0009) [2023-12-26 03:41:21,755][123090] Updated weights for policy 1, policy_version 510359 (0.0008) [2023-12-26 03:41:21,784][123091] Updated weights for policy 0, policy_version 513886 (0.0007) [2023-12-26 03:41:21,836][123091] Updated weights for policy 0, policy_version 513896 (0.0009) [2023-12-26 03:41:22,553][123090] Updated weights for policy 1, policy_version 510369 (0.0008) [2023-12-26 03:41:22,612][123090] Updated weights for policy 1, policy_version 510379 (0.0010) [2023-12-26 03:41:22,679][123090] Updated weights for policy 1, policy_version 510389 (0.0011) [2023-12-26 03:41:22,698][123091] Updated weights for policy 0, policy_version 513906 (0.0008) [2023-12-26 03:41:22,735][123090] Updated weights for policy 1, policy_version 510399 (0.0010) [2023-12-26 03:41:22,760][123091] Updated weights for policy 0, policy_version 513916 (0.0006) [2023-12-26 03:41:22,821][123091] Updated weights for policy 0, policy_version 513926 (0.0009) [2023-12-26 03:41:22,877][123091] Updated weights for policy 0, policy_version 513936 (0.0009) [2023-12-26 03:41:23,535][123090] Updated weights for policy 1, policy_version 510409 (0.0011) [2023-12-26 03:41:23,602][123090] Updated weights for policy 1, policy_version 510419 (0.0007) [2023-12-26 03:41:23,662][123090] Updated weights for policy 1, policy_version 510429 (0.0006) [2023-12-26 03:41:23,701][123091] Updated weights for policy 0, policy_version 513946 (0.0005) [2023-12-26 03:41:23,767][123091] Updated weights for policy 0, policy_version 513956 (0.0005) [2023-12-26 03:41:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 262242304. Throughput: 0: 8622.0, 1: 8905.7. Samples: 262220916. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:23,785][121949] Avg episode reward: [(0, '6007.125'), (1, '5814.909')] [2023-12-26 03:41:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000510432_130670592.pth... [2023-12-26 03:41:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000509408_130408448.pth [2023-12-26 03:41:23,840][123091] Updated weights for policy 0, policy_version 513966 (0.0005) [2023-12-26 03:41:23,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000513968_131579904.pth... [2023-12-26 03:41:23,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000512944_131317760.pth [2023-12-26 03:41:24,472][123090] Updated weights for policy 1, policy_version 510439 (0.0007) [2023-12-26 03:41:24,489][123091] Updated weights for policy 0, policy_version 513976 (0.0008) [2023-12-26 03:41:24,532][123090] Updated weights for policy 1, policy_version 510449 (0.0010) [2023-12-26 03:41:24,552][123091] Updated weights for policy 0, policy_version 513986 (0.0009) [2023-12-26 03:41:24,588][123090] Updated weights for policy 1, policy_version 510459 (0.0008) [2023-12-26 03:41:24,617][123091] Updated weights for policy 0, policy_version 513996 (0.0009) [2023-12-26 03:41:25,359][123091] Updated weights for policy 0, policy_version 514006 (0.0007) [2023-12-26 03:41:25,390][123090] Updated weights for policy 1, policy_version 510469 (0.0009) [2023-12-26 03:41:25,419][123091] Updated weights for policy 0, policy_version 514016 (0.0006) [2023-12-26 03:41:25,439][123090] Updated weights for policy 1, policy_version 510479 (0.0010) [2023-12-26 03:41:25,479][123091] Updated weights for policy 0, policy_version 514026 (0.0006) [2023-12-26 03:41:25,494][123090] Updated weights for policy 1, policy_version 510489 (0.0010) [2023-12-26 03:41:26,172][123091] Updated weights for policy 0, policy_version 514036 (0.0005) [2023-12-26 03:41:26,225][123090] Updated weights for policy 1, policy_version 510499 (0.0009) [2023-12-26 03:41:26,230][123091] Updated weights for policy 0, policy_version 514046 (0.0010) [2023-12-26 03:41:26,286][123090] Updated weights for policy 1, policy_version 510509 (0.0008) [2023-12-26 03:41:26,294][123091] Updated weights for policy 0, policy_version 514056 (0.0008) [2023-12-26 03:41:26,347][123090] Updated weights for policy 1, policy_version 510519 (0.0010) [2023-12-26 03:41:27,014][123090] Updated weights for policy 1, policy_version 510529 (0.0010) [2023-12-26 03:41:27,056][123091] Updated weights for policy 0, policy_version 514066 (0.0005) [2023-12-26 03:41:27,075][123090] Updated weights for policy 1, policy_version 510539 (0.0010) [2023-12-26 03:41:27,100][123091] Updated weights for policy 0, policy_version 514076 (0.0006) [2023-12-26 03:41:27,131][123090] Updated weights for policy 1, policy_version 510549 (0.0011) [2023-12-26 03:41:27,156][123091] Updated weights for policy 0, policy_version 514086 (0.0007) [2023-12-26 03:41:27,187][123090] Updated weights for policy 1, policy_version 510559 (0.0010) [2023-12-26 03:41:27,215][123091] Updated weights for policy 0, policy_version 514096 (0.0007) [2023-12-26 03:41:27,929][123091] Updated weights for policy 0, policy_version 514106 (0.0008) [2023-12-26 03:41:27,980][123091] Updated weights for policy 0, policy_version 514116 (0.0009) [2023-12-26 03:41:28,007][123090] Updated weights for policy 1, policy_version 510569 (0.0006) [2023-12-26 03:41:28,036][123091] Updated weights for policy 0, policy_version 514126 (0.0006) [2023-12-26 03:41:28,060][123090] Updated weights for policy 1, policy_version 510579 (0.0006) [2023-12-26 03:41:28,115][123090] Updated weights for policy 1, policy_version 510589 (0.0006) [2023-12-26 03:41:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 262332416. Throughput: 0: 8741.5, 1: 8894.4. Samples: 262330348. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:28,785][121949] Avg episode reward: [(0, '5952.232'), (1, '5728.839')] [2023-12-26 03:41:28,792][123091] Updated weights for policy 0, policy_version 514136 (0.0008) [2023-12-26 03:41:28,852][123091] Updated weights for policy 0, policy_version 514146 (0.0009) [2023-12-26 03:41:28,910][123090] Updated weights for policy 1, policy_version 510599 (0.0008) [2023-12-26 03:41:28,914][123091] Updated weights for policy 0, policy_version 514156 (0.0010) [2023-12-26 03:41:28,976][123090] Updated weights for policy 1, policy_version 510609 (0.0010) [2023-12-26 03:41:29,045][123090] Updated weights for policy 1, policy_version 510619 (0.0010) [2023-12-26 03:41:29,738][123091] Updated weights for policy 0, policy_version 514166 (0.0010) [2023-12-26 03:41:29,769][123090] Updated weights for policy 1, policy_version 510629 (0.0009) [2023-12-26 03:41:29,803][123091] Updated weights for policy 0, policy_version 514176 (0.0008) [2023-12-26 03:41:29,832][123090] Updated weights for policy 1, policy_version 510639 (0.0007) [2023-12-26 03:41:29,874][123091] Updated weights for policy 0, policy_version 514186 (0.0007) [2023-12-26 03:41:29,893][123090] Updated weights for policy 1, policy_version 510649 (0.0009) [2023-12-26 03:41:30,640][123090] Updated weights for policy 1, policy_version 510659 (0.0009) [2023-12-26 03:41:30,665][123091] Updated weights for policy 0, policy_version 514196 (0.0009) [2023-12-26 03:41:30,690][123090] Updated weights for policy 1, policy_version 510669 (0.0006) [2023-12-26 03:41:30,718][123091] Updated weights for policy 0, policy_version 514206 (0.0008) [2023-12-26 03:41:30,747][123090] Updated weights for policy 1, policy_version 510679 (0.0007) [2023-12-26 03:41:30,779][123091] Updated weights for policy 0, policy_version 514216 (0.0008) [2023-12-26 03:41:31,519][123090] Updated weights for policy 1, policy_version 510689 (0.0007) [2023-12-26 03:41:31,545][123091] Updated weights for policy 0, policy_version 514226 (0.0009) [2023-12-26 03:41:31,583][123090] Updated weights for policy 1, policy_version 510699 (0.0007) [2023-12-26 03:41:31,599][123091] Updated weights for policy 0, policy_version 514236 (0.0005) [2023-12-26 03:41:31,650][123090] Updated weights for policy 1, policy_version 510709 (0.0009) [2023-12-26 03:41:31,666][123091] Updated weights for policy 0, policy_version 514246 (0.0008) [2023-12-26 03:41:31,714][123090] Updated weights for policy 1, policy_version 510719 (0.0009) [2023-12-26 03:41:31,720][123091] Updated weights for policy 0, policy_version 514256 (0.0008) [2023-12-26 03:41:32,541][123090] Updated weights for policy 1, policy_version 510729 (0.0006) [2023-12-26 03:41:32,546][123091] Updated weights for policy 0, policy_version 514266 (0.0008) [2023-12-26 03:41:32,598][123090] Updated weights for policy 1, policy_version 510739 (0.0006) [2023-12-26 03:41:32,608][123091] Updated weights for policy 0, policy_version 514276 (0.0010) [2023-12-26 03:41:32,653][123090] Updated weights for policy 1, policy_version 510749 (0.0006) [2023-12-26 03:41:32,671][123091] Updated weights for policy 0, policy_version 514286 (0.0010) [2023-12-26 03:41:33,351][123091] Updated weights for policy 0, policy_version 514296 (0.0010) [2023-12-26 03:41:33,402][123091] Updated weights for policy 0, policy_version 514306 (0.0010) [2023-12-26 03:41:33,462][123090] Updated weights for policy 1, policy_version 510759 (0.0009) [2023-12-26 03:41:33,470][123091] Updated weights for policy 0, policy_version 514316 (0.0011) [2023-12-26 03:41:33,525][123090] Updated weights for policy 1, policy_version 510769 (0.0009) [2023-12-26 03:41:33,574][123090] Updated weights for policy 1, policy_version 510779 (0.0008) [2023-12-26 03:41:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 262430720. Throughput: 0: 8811.2, 1: 8848.7. Samples: 262438780. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:33,785][121949] Avg episode reward: [(0, '6006.431'), (1, '5716.863')] [2023-12-26 03:41:34,297][123091] Updated weights for policy 0, policy_version 514326 (0.0010) [2023-12-26 03:41:34,365][123091] Updated weights for policy 0, policy_version 514336 (0.0008) [2023-12-26 03:41:34,419][123090] Updated weights for policy 1, policy_version 510789 (0.0009) [2023-12-26 03:41:34,423][123091] Updated weights for policy 0, policy_version 514346 (0.0009) [2023-12-26 03:41:34,490][123090] Updated weights for policy 1, policy_version 510799 (0.0009) [2023-12-26 03:41:34,541][123090] Updated weights for policy 1, policy_version 510809 (0.0009) [2023-12-26 03:41:35,219][123091] Updated weights for policy 0, policy_version 514356 (0.0007) [2023-12-26 03:41:35,297][123091] Updated weights for policy 0, policy_version 514366 (0.0006) [2023-12-26 03:41:35,360][123091] Updated weights for policy 0, policy_version 514376 (0.0007) [2023-12-26 03:41:35,370][123090] Updated weights for policy 1, policy_version 510819 (0.0010) [2023-12-26 03:41:35,433][123090] Updated weights for policy 1, policy_version 510829 (0.0010) [2023-12-26 03:41:35,481][123090] Updated weights for policy 1, policy_version 510839 (0.0009) [2023-12-26 03:41:36,117][123091] Updated weights for policy 0, policy_version 514386 (0.0008) [2023-12-26 03:41:36,182][123091] Updated weights for policy 0, policy_version 514396 (0.0010) [2023-12-26 03:41:36,240][123091] Updated weights for policy 0, policy_version 514406 (0.0009) [2023-12-26 03:41:36,294][123091] Updated weights for policy 0, policy_version 514416 (0.0009) [2023-12-26 03:41:36,318][123090] Updated weights for policy 1, policy_version 510849 (0.0009) [2023-12-26 03:41:36,373][123090] Updated weights for policy 1, policy_version 510859 (0.0010) [2023-12-26 03:41:36,444][123090] Updated weights for policy 1, policy_version 510869 (0.0009) [2023-12-26 03:41:36,511][123090] Updated weights for policy 1, policy_version 510879 (0.0009) [2023-12-26 03:41:37,163][123091] Updated weights for policy 0, policy_version 514426 (0.0009) [2023-12-26 03:41:37,226][123091] Updated weights for policy 0, policy_version 514436 (0.0007) [2023-12-26 03:41:37,284][123091] Updated weights for policy 0, policy_version 514446 (0.0006) [2023-12-26 03:41:37,317][123090] Updated weights for policy 1, policy_version 510889 (0.0007) [2023-12-26 03:41:37,381][123090] Updated weights for policy 1, policy_version 510899 (0.0011) [2023-12-26 03:41:37,441][123090] Updated weights for policy 1, policy_version 510909 (0.0010) [2023-12-26 03:41:38,033][123091] Updated weights for policy 0, policy_version 514456 (0.0010) [2023-12-26 03:41:38,091][123091] Updated weights for policy 0, policy_version 514466 (0.0011) [2023-12-26 03:41:38,158][123091] Updated weights for policy 0, policy_version 514476 (0.0011) [2023-12-26 03:41:38,172][123090] Updated weights for policy 1, policy_version 510919 (0.0009) [2023-12-26 03:41:38,233][123090] Updated weights for policy 1, policy_version 510929 (0.0008) [2023-12-26 03:41:38,293][123090] Updated weights for policy 1, policy_version 510939 (0.0005) [2023-12-26 03:41:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 262512640. Throughput: 0: 8833.9, 1: 8849.6. Samples: 262491000. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:38,785][121949] Avg episode reward: [(0, '6091.009'), (1, '5744.074')] [2023-12-26 03:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000514480_131710976.pth... [2023-12-26 03:41:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000510944_130801664.pth... [2023-12-26 03:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000513456_131448832.pth [2023-12-26 03:41:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000509920_130539520.pth [2023-12-26 03:41:38,904][123091] Updated weights for policy 0, policy_version 514486 (0.0008) [2023-12-26 03:41:38,965][123091] Updated weights for policy 0, policy_version 514496 (0.0009) [2023-12-26 03:41:39,026][123091] Updated weights for policy 0, policy_version 514506 (0.0010) [2023-12-26 03:41:39,032][123090] Updated weights for policy 1, policy_version 510949 (0.0007) [2023-12-26 03:41:39,093][123090] Updated weights for policy 1, policy_version 510959 (0.0005) [2023-12-26 03:41:39,160][123090] Updated weights for policy 1, policy_version 510969 (0.0006) [2023-12-26 03:41:39,844][123091] Updated weights for policy 0, policy_version 514516 (0.0007) [2023-12-26 03:41:39,913][123091] Updated weights for policy 0, policy_version 514526 (0.0010) [2023-12-26 03:41:39,968][123090] Updated weights for policy 1, policy_version 510979 (0.0008) [2023-12-26 03:41:39,976][123091] Updated weights for policy 0, policy_version 514536 (0.0008) [2023-12-26 03:41:40,034][123090] Updated weights for policy 1, policy_version 510989 (0.0008) [2023-12-26 03:41:40,103][123090] Updated weights for policy 1, policy_version 510999 (0.0010) [2023-12-26 03:41:40,794][123091] Updated weights for policy 0, policy_version 514546 (0.0008) [2023-12-26 03:41:40,871][123091] Updated weights for policy 0, policy_version 514556 (0.0006) [2023-12-26 03:41:40,939][123091] Updated weights for policy 0, policy_version 514566 (0.0005) [2023-12-26 03:41:40,952][123090] Updated weights for policy 1, policy_version 511009 (0.0010) [2023-12-26 03:41:40,999][123091] Updated weights for policy 0, policy_version 514576 (0.0009) [2023-12-26 03:41:41,011][123090] Updated weights for policy 1, policy_version 511019 (0.0010) [2023-12-26 03:41:41,091][123090] Updated weights for policy 1, policy_version 511029 (0.0008) [2023-12-26 03:41:41,167][123090] Updated weights for policy 1, policy_version 511039 (0.0010) [2023-12-26 03:41:41,812][123091] Updated weights for policy 0, policy_version 514586 (0.0010) [2023-12-26 03:41:41,878][123091] Updated weights for policy 0, policy_version 514596 (0.0009) [2023-12-26 03:41:41,944][123091] Updated weights for policy 0, policy_version 514606 (0.0009) [2023-12-26 03:41:42,051][123090] Updated weights for policy 1, policy_version 511049 (0.0011) [2023-12-26 03:41:42,126][123090] Updated weights for policy 1, policy_version 511059 (0.0011) [2023-12-26 03:41:42,185][123090] Updated weights for policy 1, policy_version 511069 (0.0011) [2023-12-26 03:41:42,799][123091] Updated weights for policy 0, policy_version 514616 (0.0010) [2023-12-26 03:41:42,861][123091] Updated weights for policy 0, policy_version 514626 (0.0011) [2023-12-26 03:41:42,919][123091] Updated weights for policy 0, policy_version 514636 (0.0010) [2023-12-26 03:41:42,972][123090] Updated weights for policy 1, policy_version 511079 (0.0007) [2023-12-26 03:41:43,029][123090] Updated weights for policy 1, policy_version 511089 (0.0009) [2023-12-26 03:41:43,075][123090] Updated weights for policy 1, policy_version 511099 (0.0008) [2023-12-26 03:41:43,739][123090] Updated weights for policy 1, policy_version 511109 (0.0007) [2023-12-26 03:41:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 262594560. Throughput: 0: 8856.8, 1: 8834.0. Samples: 262595164. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:43,785][121949] Avg episode reward: [(0, '6070.959'), (1, '5828.476')] [2023-12-26 03:41:43,787][123091] Updated weights for policy 0, policy_version 514646 (0.0009) [2023-12-26 03:41:43,802][123090] Updated weights for policy 1, policy_version 511119 (0.0009) [2023-12-26 03:41:43,841][123091] Updated weights for policy 0, policy_version 514656 (0.0006) [2023-12-26 03:41:43,865][123090] Updated weights for policy 1, policy_version 511129 (0.0008) [2023-12-26 03:41:43,899][123091] Updated weights for policy 0, policy_version 514666 (0.0005) [2023-12-26 03:41:44,514][123090] Updated weights for policy 1, policy_version 511139 (0.0005) [2023-12-26 03:41:44,572][123090] Updated weights for policy 1, policy_version 511149 (0.0006) [2023-12-26 03:41:44,611][123091] Updated weights for policy 0, policy_version 514676 (0.0007) [2023-12-26 03:41:44,634][123090] Updated weights for policy 1, policy_version 511159 (0.0005) [2023-12-26 03:41:44,669][123091] Updated weights for policy 0, policy_version 514686 (0.0010) [2023-12-26 03:41:44,720][123091] Updated weights for policy 0, policy_version 514696 (0.0009) [2023-12-26 03:41:45,275][123090] Updated weights for policy 1, policy_version 511169 (0.0005) [2023-12-26 03:41:45,342][123090] Updated weights for policy 1, policy_version 511179 (0.0006) [2023-12-26 03:41:45,412][123090] Updated weights for policy 1, policy_version 511189 (0.0005) [2023-12-26 03:41:45,478][123090] Updated weights for policy 1, policy_version 511199 (0.0006) [2023-12-26 03:41:45,635][123091] Updated weights for policy 0, policy_version 514706 (0.0009) [2023-12-26 03:41:45,701][123091] Updated weights for policy 0, policy_version 514716 (0.0010) [2023-12-26 03:41:45,777][123091] Updated weights for policy 0, policy_version 514726 (0.0007) [2023-12-26 03:41:45,835][123091] Updated weights for policy 0, policy_version 514736 (0.0007) [2023-12-26 03:41:46,202][123090] Updated weights for policy 1, policy_version 511209 (0.0010) [2023-12-26 03:41:46,253][123090] Updated weights for policy 1, policy_version 511219 (0.0010) [2023-12-26 03:41:46,322][123090] Updated weights for policy 1, policy_version 511229 (0.0010) [2023-12-26 03:41:46,600][123091] Updated weights for policy 0, policy_version 514746 (0.0007) [2023-12-26 03:41:46,657][123091] Updated weights for policy 0, policy_version 514756 (0.0006) [2023-12-26 03:41:46,716][123091] Updated weights for policy 0, policy_version 514766 (0.0005) [2023-12-26 03:41:47,083][123090] Updated weights for policy 1, policy_version 511239 (0.0007) [2023-12-26 03:41:47,143][123090] Updated weights for policy 1, policy_version 511249 (0.0005) [2023-12-26 03:41:47,198][123090] Updated weights for policy 1, policy_version 511259 (0.0005) [2023-12-26 03:41:47,286][123091] Updated weights for policy 0, policy_version 514776 (0.0005) [2023-12-26 03:41:47,341][123091] Updated weights for policy 0, policy_version 514786 (0.0005) [2023-12-26 03:41:47,402][123091] Updated weights for policy 0, policy_version 514797 (0.0010) [2023-12-26 03:41:47,827][123090] Updated weights for policy 1, policy_version 511269 (0.0005) [2023-12-26 03:41:47,902][123090] Updated weights for policy 1, policy_version 511279 (0.0006) [2023-12-26 03:41:47,961][123090] Updated weights for policy 1, policy_version 511289 (0.0005) [2023-12-26 03:41:48,252][123091] Updated weights for policy 0, policy_version 514807 (0.0010) [2023-12-26 03:41:48,314][123091] Updated weights for policy 0, policy_version 514817 (0.0009) [2023-12-26 03:41:48,383][123091] Updated weights for policy 0, policy_version 514827 (0.0010) [2023-12-26 03:41:48,691][123090] Updated weights for policy 1, policy_version 511299 (0.0008) [2023-12-26 03:41:48,757][123090] Updated weights for policy 1, policy_version 511309 (0.0008) [2023-12-26 03:41:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 262692864. Throughput: 0: 8804.5, 1: 8961.8. Samples: 262707180. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:48,785][121949] Avg episode reward: [(0, '5952.917'), (1, '5849.536')] [2023-12-26 03:41:48,827][123090] Updated weights for policy 1, policy_version 511319 (0.0008) [2023-12-26 03:41:49,297][123091] Updated weights for policy 0, policy_version 514837 (0.0009) [2023-12-26 03:41:49,367][123091] Updated weights for policy 0, policy_version 514847 (0.0008) [2023-12-26 03:41:49,442][123091] Updated weights for policy 0, policy_version 514857 (0.0006) [2023-12-26 03:41:49,562][123090] Updated weights for policy 1, policy_version 511329 (0.0009) [2023-12-26 03:41:49,632][123090] Updated weights for policy 1, policy_version 511339 (0.0005) [2023-12-26 03:41:49,682][123090] Updated weights for policy 1, policy_version 511349 (0.0005) [2023-12-26 03:41:49,732][123090] Updated weights for policy 1, policy_version 511359 (0.0005) [2023-12-26 03:41:50,215][123091] Updated weights for policy 0, policy_version 514867 (0.0006) [2023-12-26 03:41:50,280][123091] Updated weights for policy 0, policy_version 514877 (0.0006) [2023-12-26 03:41:50,329][123091] Updated weights for policy 0, policy_version 514887 (0.0005) [2023-12-26 03:41:50,461][123090] Updated weights for policy 1, policy_version 511369 (0.0010) [2023-12-26 03:41:50,525][123090] Updated weights for policy 1, policy_version 511379 (0.0011) [2023-12-26 03:41:50,597][123090] Updated weights for policy 1, policy_version 511389 (0.0011) [2023-12-26 03:41:51,124][123091] Updated weights for policy 0, policy_version 514897 (0.0006) [2023-12-26 03:41:51,191][123091] Updated weights for policy 0, policy_version 514907 (0.0009) [2023-12-26 03:41:51,255][123091] Updated weights for policy 0, policy_version 514917 (0.0009) [2023-12-26 03:41:51,326][123091] Updated weights for policy 0, policy_version 514927 (0.0009) [2023-12-26 03:41:51,441][123090] Updated weights for policy 1, policy_version 511399 (0.0009) [2023-12-26 03:41:51,492][123090] Updated weights for policy 1, policy_version 511409 (0.0009) [2023-12-26 03:41:51,548][123090] Updated weights for policy 1, policy_version 511419 (0.0006) [2023-12-26 03:41:52,106][123091] Updated weights for policy 0, policy_version 514937 (0.0009) [2023-12-26 03:41:52,165][123091] Updated weights for policy 0, policy_version 514947 (0.0009) [2023-12-26 03:41:52,222][123091] Updated weights for policy 0, policy_version 514957 (0.0009) [2023-12-26 03:41:52,427][123090] Updated weights for policy 1, policy_version 511429 (0.0009) [2023-12-26 03:41:52,478][123090] Updated weights for policy 1, policy_version 511439 (0.0009) [2023-12-26 03:41:52,532][123090] Updated weights for policy 1, policy_version 511449 (0.0008) [2023-12-26 03:41:52,998][123091] Updated weights for policy 0, policy_version 514967 (0.0009) [2023-12-26 03:41:53,067][123091] Updated weights for policy 0, policy_version 514977 (0.0005) [2023-12-26 03:41:53,129][123091] Updated weights for policy 0, policy_version 514987 (0.0005) [2023-12-26 03:41:53,419][123090] Updated weights for policy 1, policy_version 511459 (0.0009) [2023-12-26 03:41:53,479][123090] Updated weights for policy 1, policy_version 511469 (0.0007) [2023-12-26 03:41:53,527][123090] Updated weights for policy 1, policy_version 511479 (0.0005) [2023-12-26 03:41:53,708][123091] Updated weights for policy 0, policy_version 514997 (0.0005) [2023-12-26 03:41:53,770][123091] Updated weights for policy 0, policy_version 515007 (0.0005) [2023-12-26 03:41:53,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 262782976. Throughput: 0: 8824.3, 1: 8960.9. Samples: 262759708. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:53,785][121949] Avg episode reward: [(0, '5896.923'), (1, '5703.013')] [2023-12-26 03:41:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000511488_130940928.pth... [2023-12-26 03:41:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000510432_130670592.pth [2023-12-26 03:41:53,832][123091] Updated weights for policy 0, policy_version 515017 (0.0005) [2023-12-26 03:41:53,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000515024_131850240.pth... [2023-12-26 03:41:53,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000513968_131579904.pth [2023-12-26 03:41:54,276][123090] Updated weights for policy 1, policy_version 511489 (0.0006) [2023-12-26 03:41:54,336][123090] Updated weights for policy 1, policy_version 511499 (0.0010) [2023-12-26 03:41:54,401][123090] Updated weights for policy 1, policy_version 511509 (0.0009) [2023-12-26 03:41:54,465][123090] Updated weights for policy 1, policy_version 511519 (0.0006) [2023-12-26 03:41:54,582][123091] Updated weights for policy 0, policy_version 515027 (0.0007) [2023-12-26 03:41:54,645][123091] Updated weights for policy 0, policy_version 515037 (0.0009) [2023-12-26 03:41:54,704][123091] Updated weights for policy 0, policy_version 515047 (0.0007) [2023-12-26 03:41:55,194][123090] Updated weights for policy 1, policy_version 511529 (0.0008) [2023-12-26 03:41:55,249][123090] Updated weights for policy 1, policy_version 511539 (0.0009) [2023-12-26 03:41:55,300][123090] Updated weights for policy 1, policy_version 511549 (0.0010) [2023-12-26 03:41:55,547][123091] Updated weights for policy 0, policy_version 515057 (0.0006) [2023-12-26 03:41:55,617][123091] Updated weights for policy 0, policy_version 515067 (0.0009) [2023-12-26 03:41:55,672][123091] Updated weights for policy 0, policy_version 515077 (0.0009) [2023-12-26 03:41:55,725][123091] Updated weights for policy 0, policy_version 515087 (0.0009) [2023-12-26 03:41:56,104][123090] Updated weights for policy 1, policy_version 511559 (0.0007) [2023-12-26 03:41:56,164][123090] Updated weights for policy 1, policy_version 511569 (0.0005) [2023-12-26 03:41:56,221][123090] Updated weights for policy 1, policy_version 511579 (0.0006) [2023-12-26 03:41:56,595][123091] Updated weights for policy 0, policy_version 515097 (0.0009) [2023-12-26 03:41:56,654][123091] Updated weights for policy 0, policy_version 515107 (0.0009) [2023-12-26 03:41:56,708][123091] Updated weights for policy 0, policy_version 515117 (0.0008) [2023-12-26 03:41:56,981][123090] Updated weights for policy 1, policy_version 511589 (0.0008) [2023-12-26 03:41:57,044][123090] Updated weights for policy 1, policy_version 511599 (0.0005) [2023-12-26 03:41:57,102][123090] Updated weights for policy 1, policy_version 511609 (0.0005) [2023-12-26 03:41:57,552][123091] Updated weights for policy 0, policy_version 515127 (0.0009) [2023-12-26 03:41:57,605][123091] Updated weights for policy 0, policy_version 515137 (0.0008) [2023-12-26 03:41:57,656][123091] Updated weights for policy 0, policy_version 515147 (0.0008) [2023-12-26 03:41:57,851][123090] Updated weights for policy 1, policy_version 511619 (0.0005) [2023-12-26 03:41:57,905][123090] Updated weights for policy 1, policy_version 511629 (0.0005) [2023-12-26 03:41:57,964][123090] Updated weights for policy 1, policy_version 511639 (0.0009) [2023-12-26 03:41:58,521][123091] Updated weights for policy 0, policy_version 515157 (0.0010) [2023-12-26 03:41:58,592][123091] Updated weights for policy 0, policy_version 515167 (0.0011) [2023-12-26 03:41:58,666][123091] Updated weights for policy 0, policy_version 515177 (0.0010) [2023-12-26 03:41:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 262873088. Throughput: 0: 8898.6, 1: 9024.6. Samples: 262867860. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:41:58,785][121949] Avg episode reward: [(0, '5853.601'), (1, '5541.381')] [2023-12-26 03:41:58,842][123090] Updated weights for policy 1, policy_version 511649 (0.0010) [2023-12-26 03:41:58,897][123090] Updated weights for policy 1, policy_version 511659 (0.0007) [2023-12-26 03:41:58,967][123090] Updated weights for policy 1, policy_version 511669 (0.0008) [2023-12-26 03:41:59,029][123090] Updated weights for policy 1, policy_version 511679 (0.0008) [2023-12-26 03:41:59,579][123091] Updated weights for policy 0, policy_version 515187 (0.0011) [2023-12-26 03:41:59,633][123091] Updated weights for policy 0, policy_version 515197 (0.0005) [2023-12-26 03:41:59,687][123091] Updated weights for policy 0, policy_version 515207 (0.0006) [2023-12-26 03:41:59,850][123090] Updated weights for policy 1, policy_version 511689 (0.0009) [2023-12-26 03:41:59,922][123090] Updated weights for policy 1, policy_version 511699 (0.0009) [2023-12-26 03:41:59,995][123090] Updated weights for policy 1, policy_version 511709 (0.0007) [2023-12-26 03:42:00,506][123091] Updated weights for policy 0, policy_version 515217 (0.0011) [2023-12-26 03:42:00,566][123091] Updated weights for policy 0, policy_version 515227 (0.0011) [2023-12-26 03:42:00,620][123091] Updated weights for policy 0, policy_version 515237 (0.0010) [2023-12-26 03:42:00,651][123090] Updated weights for policy 1, policy_version 511719 (0.0007) [2023-12-26 03:42:00,673][123091] Updated weights for policy 0, policy_version 515247 (0.0010) [2023-12-26 03:42:00,698][123090] Updated weights for policy 1, policy_version 511729 (0.0005) [2023-12-26 03:42:00,763][123090] Updated weights for policy 1, policy_version 511739 (0.0007) [2023-12-26 03:42:01,484][123091] Updated weights for policy 0, policy_version 515257 (0.0009) [2023-12-26 03:42:01,534][123091] Updated weights for policy 0, policy_version 515268 (0.0010) [2023-12-26 03:42:01,590][123091] Updated weights for policy 0, policy_version 515278 (0.0010) [2023-12-26 03:42:01,612][123090] Updated weights for policy 1, policy_version 511749 (0.0008) [2023-12-26 03:42:01,680][123090] Updated weights for policy 1, policy_version 511759 (0.0009) [2023-12-26 03:42:01,740][123090] Updated weights for policy 1, policy_version 511769 (0.0010) [2023-12-26 03:42:02,408][123091] Updated weights for policy 0, policy_version 515288 (0.0009) [2023-12-26 03:42:02,465][123091] Updated weights for policy 0, policy_version 515298 (0.0007) [2023-12-26 03:42:02,471][123090] Updated weights for policy 1, policy_version 511779 (0.0009) [2023-12-26 03:42:02,529][123091] Updated weights for policy 0, policy_version 515308 (0.0007) [2023-12-26 03:42:02,535][123090] Updated weights for policy 1, policy_version 511789 (0.0011) [2023-12-26 03:42:02,598][123090] Updated weights for policy 1, policy_version 511799 (0.0010) [2023-12-26 03:42:03,293][123091] Updated weights for policy 0, policy_version 515318 (0.0006) [2023-12-26 03:42:03,301][123090] Updated weights for policy 1, policy_version 511809 (0.0010) [2023-12-26 03:42:03,348][123091] Updated weights for policy 0, policy_version 515328 (0.0006) [2023-12-26 03:42:03,362][123090] Updated weights for policy 1, policy_version 511819 (0.0005) [2023-12-26 03:42:03,400][123091] Updated weights for policy 0, policy_version 515338 (0.0008) [2023-12-26 03:42:03,411][123090] Updated weights for policy 1, policy_version 511829 (0.0005) [2023-12-26 03:42:03,459][123090] Updated weights for policy 1, policy_version 511839 (0.0005) [2023-12-26 03:42:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 262963200. Throughput: 0: 8850.8, 1: 8968.6. Samples: 262972864. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:03,785][121949] Avg episode reward: [(0, '5783.930'), (1, '5630.697')] [2023-12-26 03:42:04,125][123090] Updated weights for policy 1, policy_version 511849 (0.0007) [2023-12-26 03:42:04,186][123090] Updated weights for policy 1, policy_version 511859 (0.0005) [2023-12-26 03:42:04,248][123090] Updated weights for policy 1, policy_version 511869 (0.0008) [2023-12-26 03:42:04,282][123091] Updated weights for policy 0, policy_version 515348 (0.0009) [2023-12-26 03:42:04,346][123091] Updated weights for policy 0, policy_version 515358 (0.0009) [2023-12-26 03:42:04,407][123091] Updated weights for policy 0, policy_version 515368 (0.0009) [2023-12-26 03:42:05,035][123090] Updated weights for policy 1, policy_version 511879 (0.0007) [2023-12-26 03:42:05,108][123090] Updated weights for policy 1, policy_version 511889 (0.0005) [2023-12-26 03:42:05,181][123090] Updated weights for policy 1, policy_version 511899 (0.0005) [2023-12-26 03:42:05,278][123091] Updated weights for policy 0, policy_version 515378 (0.0009) [2023-12-26 03:42:05,330][123091] Updated weights for policy 0, policy_version 515388 (0.0010) [2023-12-26 03:42:05,375][123091] Updated weights for policy 0, policy_version 515398 (0.0010) [2023-12-26 03:42:05,423][123091] Updated weights for policy 0, policy_version 515408 (0.0010) [2023-12-26 03:42:05,802][123090] Updated weights for policy 1, policy_version 511909 (0.0005) [2023-12-26 03:42:05,857][123090] Updated weights for policy 1, policy_version 511919 (0.0005) [2023-12-26 03:42:05,929][123090] Updated weights for policy 1, policy_version 511929 (0.0005) [2023-12-26 03:42:06,186][123091] Updated weights for policy 0, policy_version 515418 (0.0008) [2023-12-26 03:42:06,245][123091] Updated weights for policy 0, policy_version 515428 (0.0008) [2023-12-26 03:42:06,297][123091] Updated weights for policy 0, policy_version 515438 (0.0008) [2023-12-26 03:42:06,690][123090] Updated weights for policy 1, policy_version 511939 (0.0007) [2023-12-26 03:42:06,743][123090] Updated weights for policy 1, policy_version 511949 (0.0010) [2023-12-26 03:42:06,807][123090] Updated weights for policy 1, policy_version 511959 (0.0009) [2023-12-26 03:42:07,041][123091] Updated weights for policy 0, policy_version 515448 (0.0010) [2023-12-26 03:42:07,097][123091] Updated weights for policy 0, policy_version 515458 (0.0007) [2023-12-26 03:42:07,161][123091] Updated weights for policy 0, policy_version 515468 (0.0006) [2023-12-26 03:42:07,731][123090] Updated weights for policy 1, policy_version 511969 (0.0008) [2023-12-26 03:42:07,781][123090] Updated weights for policy 1, policy_version 511979 (0.0009) [2023-12-26 03:42:07,836][123090] Updated weights for policy 1, policy_version 511989 (0.0008) [2023-12-26 03:42:07,838][123091] Updated weights for policy 0, policy_version 515478 (0.0008) [2023-12-26 03:42:07,880][123090] Updated weights for policy 1, policy_version 511999 (0.0007) [2023-12-26 03:42:07,881][123091] Updated weights for policy 0, policy_version 515488 (0.0010) [2023-12-26 03:42:07,928][123091] Updated weights for policy 0, policy_version 515498 (0.0010) [2023-12-26 03:42:08,745][123090] Updated weights for policy 1, policy_version 512009 (0.0008) [2023-12-26 03:42:08,772][123091] Updated weights for policy 0, policy_version 515508 (0.0010) [2023-12-26 03:42:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 263045120. Throughput: 0: 8860.5, 1: 9076.3. Samples: 263028068. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:08,785][121949] Avg episode reward: [(0, '5844.434'), (1, '5710.032')] [2023-12-26 03:42:08,807][123090] Updated weights for policy 1, policy_version 512019 (0.0005) [2023-12-26 03:42:08,835][123091] Updated weights for policy 0, policy_version 515518 (0.0011) [2023-12-26 03:42:08,869][123090] Updated weights for policy 1, policy_version 512029 (0.0005) [2023-12-26 03:42:08,887][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000512032_131080192.pth... [2023-12-26 03:42:08,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000510944_130801664.pth [2023-12-26 03:42:08,894][123091] Updated weights for policy 0, policy_version 515528 (0.0011) [2023-12-26 03:42:08,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000515536_131981312.pth... [2023-12-26 03:42:08,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000514480_131710976.pth [2023-12-26 03:42:09,670][123091] Updated weights for policy 0, policy_version 515538 (0.0009) [2023-12-26 03:42:09,702][123090] Updated weights for policy 1, policy_version 512039 (0.0008) [2023-12-26 03:42:09,736][123091] Updated weights for policy 0, policy_version 515548 (0.0008) [2023-12-26 03:42:09,773][123090] Updated weights for policy 1, policy_version 512049 (0.0008) [2023-12-26 03:42:09,796][123091] Updated weights for policy 0, policy_version 515558 (0.0007) [2023-12-26 03:42:09,849][123090] Updated weights for policy 1, policy_version 512059 (0.0006) [2023-12-26 03:42:09,867][123091] Updated weights for policy 0, policy_version 515568 (0.0010) [2023-12-26 03:42:10,639][123090] Updated weights for policy 1, policy_version 512069 (0.0008) [2023-12-26 03:42:10,667][123091] Updated weights for policy 0, policy_version 515578 (0.0011) [2023-12-26 03:42:10,692][123090] Updated weights for policy 1, policy_version 512079 (0.0006) [2023-12-26 03:42:10,720][123091] Updated weights for policy 0, policy_version 515588 (0.0011) [2023-12-26 03:42:10,750][123090] Updated weights for policy 1, policy_version 512089 (0.0010) [2023-12-26 03:42:10,775][123091] Updated weights for policy 0, policy_version 515598 (0.0010) [2023-12-26 03:42:11,621][123090] Updated weights for policy 1, policy_version 512099 (0.0007) [2023-12-26 03:42:11,663][123091] Updated weights for policy 0, policy_version 515608 (0.0009) [2023-12-26 03:42:11,690][123090] Updated weights for policy 1, policy_version 512109 (0.0011) [2023-12-26 03:42:11,729][123091] Updated weights for policy 0, policy_version 515618 (0.0007) [2023-12-26 03:42:11,764][123090] Updated weights for policy 1, policy_version 512119 (0.0009) [2023-12-26 03:42:11,798][123091] Updated weights for policy 0, policy_version 515628 (0.0010) [2023-12-26 03:42:12,591][123091] Updated weights for policy 0, policy_version 515638 (0.0010) [2023-12-26 03:42:12,636][123090] Updated weights for policy 1, policy_version 512129 (0.0008) [2023-12-26 03:42:12,647][123091] Updated weights for policy 0, policy_version 515648 (0.0010) [2023-12-26 03:42:12,693][123090] Updated weights for policy 1, policy_version 512139 (0.0008) [2023-12-26 03:42:12,714][123091] Updated weights for policy 0, policy_version 515658 (0.0008) [2023-12-26 03:42:12,750][123090] Updated weights for policy 1, policy_version 512149 (0.0009) [2023-12-26 03:42:12,805][123090] Updated weights for policy 1, policy_version 512159 (0.0010) [2023-12-26 03:42:13,536][123091] Updated weights for policy 0, policy_version 515668 (0.0009) [2023-12-26 03:42:13,593][123091] Updated weights for policy 0, policy_version 515678 (0.0009) [2023-12-26 03:42:13,650][123091] Updated weights for policy 0, policy_version 515688 (0.0006) [2023-12-26 03:42:13,656][123090] Updated weights for policy 1, policy_version 512169 (0.0009) [2023-12-26 03:42:13,730][123090] Updated weights for policy 1, policy_version 512179 (0.0010) [2023-12-26 03:42:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 263135232. Throughput: 0: 8803.9, 1: 8988.5. Samples: 263131008. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:13,785][121949] Avg episode reward: [(0, '5754.145'), (1, '5671.220')] [2023-12-26 03:42:13,801][123090] Updated weights for policy 1, policy_version 512189 (0.0010) [2023-12-26 03:42:14,337][123091] Updated weights for policy 0, policy_version 515698 (0.0005) [2023-12-26 03:42:14,409][123091] Updated weights for policy 0, policy_version 515708 (0.0005) [2023-12-26 03:42:14,481][123091] Updated weights for policy 0, policy_version 515718 (0.0005) [2023-12-26 03:42:14,554][123091] Updated weights for policy 0, policy_version 515728 (0.0008) [2023-12-26 03:42:14,693][123090] Updated weights for policy 1, policy_version 512199 (0.0009) [2023-12-26 03:42:14,752][123090] Updated weights for policy 1, policy_version 512209 (0.0009) [2023-12-26 03:42:14,827][123090] Updated weights for policy 1, policy_version 512219 (0.0009) [2023-12-26 03:42:15,335][123091] Updated weights for policy 0, policy_version 515738 (0.0010) [2023-12-26 03:42:15,397][123091] Updated weights for policy 0, policy_version 515748 (0.0009) [2023-12-26 03:42:15,448][123091] Updated weights for policy 0, policy_version 515758 (0.0010) [2023-12-26 03:42:15,643][123090] Updated weights for policy 1, policy_version 512229 (0.0009) [2023-12-26 03:42:15,715][123090] Updated weights for policy 1, policy_version 512239 (0.0008) [2023-12-26 03:42:15,786][123090] Updated weights for policy 1, policy_version 512249 (0.0011) [2023-12-26 03:42:16,223][123091] Updated weights for policy 0, policy_version 515768 (0.0006) [2023-12-26 03:42:16,271][123091] Updated weights for policy 0, policy_version 515778 (0.0005) [2023-12-26 03:42:16,323][123091] Updated weights for policy 0, policy_version 515788 (0.0005) [2023-12-26 03:42:16,604][123090] Updated weights for policy 1, policy_version 512259 (0.0011) [2023-12-26 03:42:16,663][123090] Updated weights for policy 1, policy_version 512269 (0.0010) [2023-12-26 03:42:16,719][123090] Updated weights for policy 1, policy_version 512279 (0.0010) [2023-12-26 03:42:16,981][123091] Updated weights for policy 0, policy_version 515798 (0.0006) [2023-12-26 03:42:17,041][123091] Updated weights for policy 0, policy_version 515808 (0.0005) [2023-12-26 03:42:17,089][123091] Updated weights for policy 0, policy_version 515818 (0.0005) [2023-12-26 03:42:17,554][123090] Updated weights for policy 1, policy_version 512289 (0.0010) [2023-12-26 03:42:17,616][123090] Updated weights for policy 1, policy_version 512299 (0.0010) [2023-12-26 03:42:17,667][123090] Updated weights for policy 1, policy_version 512309 (0.0010) [2023-12-26 03:42:17,727][123090] Updated weights for policy 1, policy_version 512319 (0.0010) [2023-12-26 03:42:17,729][123091] Updated weights for policy 0, policy_version 515828 (0.0005) [2023-12-26 03:42:17,780][123091] Updated weights for policy 0, policy_version 515839 (0.0009) [2023-12-26 03:42:17,833][123091] Updated weights for policy 0, policy_version 515849 (0.0009) [2023-12-26 03:42:18,555][123090] Updated weights for policy 1, policy_version 512329 (0.0010) [2023-12-26 03:42:18,604][123090] Updated weights for policy 1, policy_version 512339 (0.0010) [2023-12-26 03:42:18,659][123090] Updated weights for policy 1, policy_version 512349 (0.0010) [2023-12-26 03:42:18,662][123091] Updated weights for policy 0, policy_version 515859 (0.0010) [2023-12-26 03:42:18,726][123091] Updated weights for policy 0, policy_version 515869 (0.0011) [2023-12-26 03:42:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 263225344. Throughput: 0: 8861.2, 1: 8907.6. Samples: 263238372. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:18,785][121949] Avg episode reward: [(0, '5879.363'), (1, '5666.173')] [2023-12-26 03:42:18,789][123091] Updated weights for policy 0, policy_version 515879 (0.0011) [2023-12-26 03:42:19,547][123090] Updated weights for policy 1, policy_version 512359 (0.0010) [2023-12-26 03:42:19,549][123091] Updated weights for policy 0, policy_version 515889 (0.0010) [2023-12-26 03:42:19,607][123090] Updated weights for policy 1, policy_version 512369 (0.0010) [2023-12-26 03:42:19,609][123091] Updated weights for policy 0, policy_version 515899 (0.0011) [2023-12-26 03:42:19,664][123090] Updated weights for policy 1, policy_version 512379 (0.0010) [2023-12-26 03:42:19,670][123091] Updated weights for policy 0, policy_version 515909 (0.0011) [2023-12-26 03:42:19,743][123091] Updated weights for policy 0, policy_version 515919 (0.0011) [2023-12-26 03:42:20,513][123090] Updated weights for policy 1, policy_version 512389 (0.0010) [2023-12-26 03:42:20,577][123091] Updated weights for policy 0, policy_version 515929 (0.0009) [2023-12-26 03:42:20,606][123090] Updated weights for policy 1, policy_version 512399 (0.0009) [2023-12-26 03:42:20,644][123091] Updated weights for policy 0, policy_version 515939 (0.0009) [2023-12-26 03:42:20,668][123090] Updated weights for policy 1, policy_version 512409 (0.0009) [2023-12-26 03:42:20,708][123091] Updated weights for policy 0, policy_version 515949 (0.0008) [2023-12-26 03:42:21,502][123090] Updated weights for policy 1, policy_version 512419 (0.0007) [2023-12-26 03:42:21,572][123090] Updated weights for policy 1, policy_version 512429 (0.0008) [2023-12-26 03:42:21,603][123091] Updated weights for policy 0, policy_version 515959 (0.0009) [2023-12-26 03:42:21,642][123090] Updated weights for policy 1, policy_version 512439 (0.0012) [2023-12-26 03:42:21,671][123091] Updated weights for policy 0, policy_version 515969 (0.0009) [2023-12-26 03:42:21,743][123091] Updated weights for policy 0, policy_version 515979 (0.0008) [2023-12-26 03:42:22,509][123090] Updated weights for policy 1, policy_version 512449 (0.0013) [2023-12-26 03:42:22,509][123091] Updated weights for policy 0, policy_version 515989 (0.0008) [2023-12-26 03:42:22,580][123090] Updated weights for policy 1, policy_version 512459 (0.0006) [2023-12-26 03:42:22,582][123091] Updated weights for policy 0, policy_version 515999 (0.0008) [2023-12-26 03:42:22,643][123091] Updated weights for policy 0, policy_version 516009 (0.0008) [2023-12-26 03:42:22,643][123090] Updated weights for policy 1, policy_version 512469 (0.0010) [2023-12-26 03:42:22,710][123090] Updated weights for policy 1, policy_version 512479 (0.0010) [2023-12-26 03:42:23,369][123091] Updated weights for policy 0, policy_version 516019 (0.0007) [2023-12-26 03:42:23,387][123090] Updated weights for policy 1, policy_version 512489 (0.0006) [2023-12-26 03:42:23,433][123091] Updated weights for policy 0, policy_version 516029 (0.0007) [2023-12-26 03:42:23,458][123090] Updated weights for policy 1, policy_version 512499 (0.0006) [2023-12-26 03:42:23,488][123091] Updated weights for policy 0, policy_version 516039 (0.0008) [2023-12-26 03:42:23,518][123090] Updated weights for policy 1, policy_version 512509 (0.0010) [2023-12-26 03:42:23,785][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 263315456. Throughput: 0: 8817.3, 1: 8892.1. Samples: 263287928. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:23,786][121949] Avg episode reward: [(0, '5959.080'), (1, '5834.674')] [2023-12-26 03:42:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000516048_132112384.pth... [2023-12-26 03:42:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000512512_131203072.pth... [2023-12-26 03:42:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000511488_130940928.pth [2023-12-26 03:42:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000515024_131850240.pth [2023-12-26 03:42:24,200][123091] Updated weights for policy 0, policy_version 516049 (0.0009) [2023-12-26 03:42:24,264][123091] Updated weights for policy 0, policy_version 516059 (0.0008) [2023-12-26 03:42:24,285][123090] Updated weights for policy 1, policy_version 512519 (0.0010) [2023-12-26 03:42:24,325][123091] Updated weights for policy 0, policy_version 516069 (0.0008) [2023-12-26 03:42:24,348][123090] Updated weights for policy 1, policy_version 512529 (0.0010) [2023-12-26 03:42:24,405][123091] Updated weights for policy 0, policy_version 516079 (0.0008) [2023-12-26 03:42:24,414][123090] Updated weights for policy 1, policy_version 512539 (0.0010) [2023-12-26 03:42:25,055][123091] Updated weights for policy 0, policy_version 516089 (0.0005) [2023-12-26 03:42:25,113][123091] Updated weights for policy 0, policy_version 516099 (0.0008) [2023-12-26 03:42:25,137][123090] Updated weights for policy 1, policy_version 512549 (0.0008) [2023-12-26 03:42:25,173][123091] Updated weights for policy 0, policy_version 516109 (0.0011) [2023-12-26 03:42:25,201][123090] Updated weights for policy 1, policy_version 512559 (0.0009) [2023-12-26 03:42:25,274][123090] Updated weights for policy 1, policy_version 512569 (0.0011) [2023-12-26 03:42:25,889][123091] Updated weights for policy 0, policy_version 516119 (0.0007) [2023-12-26 03:42:25,936][123091] Updated weights for policy 0, policy_version 516129 (0.0010) [2023-12-26 03:42:25,983][123091] Updated weights for policy 0, policy_version 516139 (0.0010) [2023-12-26 03:42:26,067][123090] Updated weights for policy 1, policy_version 512579 (0.0011) [2023-12-26 03:42:26,129][123090] Updated weights for policy 1, policy_version 512589 (0.0010) [2023-12-26 03:42:26,191][123090] Updated weights for policy 1, policy_version 512599 (0.0010) [2023-12-26 03:42:26,830][123091] Updated weights for policy 0, policy_version 516149 (0.0010) [2023-12-26 03:42:26,877][123091] Updated weights for policy 0, policy_version 516159 (0.0010) [2023-12-26 03:42:26,928][123091] Updated weights for policy 0, policy_version 516169 (0.0010) [2023-12-26 03:42:27,006][123090] Updated weights for policy 1, policy_version 512609 (0.0010) [2023-12-26 03:42:27,063][123090] Updated weights for policy 1, policy_version 512619 (0.0008) [2023-12-26 03:42:27,112][123090] Updated weights for policy 1, policy_version 512629 (0.0005) [2023-12-26 03:42:27,160][123090] Updated weights for policy 1, policy_version 512639 (0.0005) [2023-12-26 03:42:27,749][123091] Updated weights for policy 0, policy_version 516179 (0.0010) [2023-12-26 03:42:27,796][123091] Updated weights for policy 0, policy_version 516189 (0.0010) [2023-12-26 03:42:27,846][123091] Updated weights for policy 0, policy_version 516199 (0.0010) [2023-12-26 03:42:27,855][123090] Updated weights for policy 1, policy_version 512649 (0.0009) [2023-12-26 03:42:27,899][123090] Updated weights for policy 1, policy_version 512659 (0.0010) [2023-12-26 03:42:27,942][123090] Updated weights for policy 1, policy_version 512669 (0.0010) [2023-12-26 03:42:28,684][123091] Updated weights for policy 0, policy_version 516209 (0.0010) [2023-12-26 03:42:28,706][123090] Updated weights for policy 1, policy_version 512679 (0.0008) [2023-12-26 03:42:28,745][123091] Updated weights for policy 0, policy_version 516219 (0.0008) [2023-12-26 03:42:28,760][123090] Updated weights for policy 1, policy_version 512689 (0.0011) [2023-12-26 03:42:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 263397376. Throughput: 0: 8901.4, 1: 8924.2. Samples: 263397312. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:28,785][121949] Avg episode reward: [(0, '5986.498'), (1, '5884.393')] [2023-12-26 03:42:28,809][123091] Updated weights for policy 0, policy_version 516229 (0.0011) [2023-12-26 03:42:28,816][123090] Updated weights for policy 1, policy_version 512699 (0.0009) [2023-12-26 03:42:28,879][123091] Updated weights for policy 0, policy_version 516239 (0.0008) [2023-12-26 03:42:29,546][123090] Updated weights for policy 1, policy_version 512709 (0.0006) [2023-12-26 03:42:29,602][123091] Updated weights for policy 0, policy_version 516249 (0.0007) [2023-12-26 03:42:29,609][123090] Updated weights for policy 1, policy_version 512719 (0.0006) [2023-12-26 03:42:29,659][123091] Updated weights for policy 0, policy_version 516259 (0.0005) [2023-12-26 03:42:29,685][123090] Updated weights for policy 1, policy_version 512729 (0.0007) [2023-12-26 03:42:29,726][123091] Updated weights for policy 0, policy_version 516269 (0.0006) [2023-12-26 03:42:30,398][123091] Updated weights for policy 0, policy_version 516279 (0.0007) [2023-12-26 03:42:30,468][123091] Updated weights for policy 0, policy_version 516289 (0.0011) [2023-12-26 03:42:30,502][123090] Updated weights for policy 1, policy_version 512739 (0.0010) [2023-12-26 03:42:30,520][123091] Updated weights for policy 0, policy_version 516299 (0.0010) [2023-12-26 03:42:30,562][123090] Updated weights for policy 1, policy_version 512749 (0.0006) [2023-12-26 03:42:30,622][123090] Updated weights for policy 1, policy_version 512759 (0.0008) [2023-12-26 03:42:31,238][123091] Updated weights for policy 0, policy_version 516309 (0.0010) [2023-12-26 03:42:31,292][123091] Updated weights for policy 0, policy_version 516319 (0.0010) [2023-12-26 03:42:31,353][123091] Updated weights for policy 0, policy_version 516329 (0.0011) [2023-12-26 03:42:31,487][123090] Updated weights for policy 1, policy_version 512769 (0.0009) [2023-12-26 03:42:31,556][123090] Updated weights for policy 1, policy_version 512779 (0.0008) [2023-12-26 03:42:31,623][123090] Updated weights for policy 1, policy_version 512789 (0.0006) [2023-12-26 03:42:31,693][123090] Updated weights for policy 1, policy_version 512799 (0.0006) [2023-12-26 03:42:32,242][123091] Updated weights for policy 0, policy_version 516339 (0.0008) [2023-12-26 03:42:32,308][123091] Updated weights for policy 0, policy_version 516349 (0.0009) [2023-12-26 03:42:32,379][123091] Updated weights for policy 0, policy_version 516359 (0.0012) [2023-12-26 03:42:32,458][123090] Updated weights for policy 1, policy_version 512809 (0.0010) [2023-12-26 03:42:32,518][123090] Updated weights for policy 1, policy_version 512819 (0.0011) [2023-12-26 03:42:32,588][123090] Updated weights for policy 1, policy_version 512829 (0.0010) [2023-12-26 03:42:33,111][123091] Updated weights for policy 0, policy_version 516369 (0.0008) [2023-12-26 03:42:33,162][123091] Updated weights for policy 0, policy_version 516379 (0.0010) [2023-12-26 03:42:33,214][123091] Updated weights for policy 0, policy_version 516389 (0.0009) [2023-12-26 03:42:33,264][123091] Updated weights for policy 0, policy_version 516399 (0.0006) [2023-12-26 03:42:33,349][123090] Updated weights for policy 1, policy_version 512839 (0.0009) [2023-12-26 03:42:33,411][123090] Updated weights for policy 1, policy_version 512849 (0.0010) [2023-12-26 03:42:33,472][123090] Updated weights for policy 1, policy_version 512859 (0.0010) [2023-12-26 03:42:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 263495680. Throughput: 0: 8971.0, 1: 8811.1. Samples: 263507380. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:33,785][121949] Avg episode reward: [(0, '5926.647'), (1, '5717.330')] [2023-12-26 03:42:33,921][123091] Updated weights for policy 0, policy_version 516409 (0.0005) [2023-12-26 03:42:33,992][123091] Updated weights for policy 0, policy_version 516419 (0.0007) [2023-12-26 03:42:34,056][123091] Updated weights for policy 0, policy_version 516429 (0.0008) [2023-12-26 03:42:34,241][123090] Updated weights for policy 1, policy_version 512869 (0.0010) [2023-12-26 03:42:34,303][123090] Updated weights for policy 1, policy_version 512879 (0.0009) [2023-12-26 03:42:34,357][123090] Updated weights for policy 1, policy_version 512889 (0.0009) [2023-12-26 03:42:34,850][123091] Updated weights for policy 0, policy_version 516439 (0.0009) [2023-12-26 03:42:34,912][123091] Updated weights for policy 0, policy_version 516449 (0.0008) [2023-12-26 03:42:34,974][123091] Updated weights for policy 0, policy_version 516459 (0.0007) [2023-12-26 03:42:35,216][123090] Updated weights for policy 1, policy_version 512899 (0.0009) [2023-12-26 03:42:35,263][123090] Updated weights for policy 1, policy_version 512909 (0.0010) [2023-12-26 03:42:35,310][123090] Updated weights for policy 1, policy_version 512919 (0.0006) [2023-12-26 03:42:35,611][123091] Updated weights for policy 0, policy_version 516469 (0.0005) [2023-12-26 03:42:35,660][123091] Updated weights for policy 0, policy_version 516479 (0.0005) [2023-12-26 03:42:35,707][123091] Updated weights for policy 0, policy_version 516489 (0.0005) [2023-12-26 03:42:36,001][123090] Updated weights for policy 1, policy_version 512929 (0.0005) [2023-12-26 03:42:36,075][123090] Updated weights for policy 1, policy_version 512939 (0.0005) [2023-12-26 03:42:36,151][123090] Updated weights for policy 1, policy_version 512949 (0.0007) [2023-12-26 03:42:36,225][123090] Updated weights for policy 1, policy_version 512959 (0.0006) [2023-12-26 03:42:36,504][123091] Updated weights for policy 0, policy_version 516499 (0.0006) [2023-12-26 03:42:36,565][123091] Updated weights for policy 0, policy_version 516509 (0.0009) [2023-12-26 03:42:36,631][123091] Updated weights for policy 0, policy_version 516519 (0.0009) [2023-12-26 03:42:36,966][123090] Updated weights for policy 1, policy_version 512969 (0.0006) [2023-12-26 03:42:37,030][123090] Updated weights for policy 1, policy_version 512979 (0.0008) [2023-12-26 03:42:37,097][123090] Updated weights for policy 1, policy_version 512989 (0.0008) [2023-12-26 03:42:37,466][123091] Updated weights for policy 0, policy_version 516529 (0.0009) [2023-12-26 03:42:37,514][123091] Updated weights for policy 0, policy_version 516539 (0.0010) [2023-12-26 03:42:37,576][123091] Updated weights for policy 0, policy_version 516549 (0.0011) [2023-12-26 03:42:37,626][123091] Updated weights for policy 0, policy_version 516559 (0.0010) [2023-12-26 03:42:37,787][123090] Updated weights for policy 1, policy_version 512999 (0.0010) [2023-12-26 03:42:37,843][123090] Updated weights for policy 1, policy_version 513009 (0.0010) [2023-12-26 03:42:37,907][123090] Updated weights for policy 1, policy_version 513019 (0.0009) [2023-12-26 03:42:38,441][123091] Updated weights for policy 0, policy_version 516569 (0.0006) [2023-12-26 03:42:38,504][123091] Updated weights for policy 0, policy_version 516579 (0.0009) [2023-12-26 03:42:38,556][123091] Updated weights for policy 0, policy_version 516590 (0.0010) [2023-12-26 03:42:38,569][123090] Updated weights for policy 1, policy_version 513029 (0.0006) [2023-12-26 03:42:38,636][123090] Updated weights for policy 1, policy_version 513039 (0.0005) [2023-12-26 03:42:38,696][123090] Updated weights for policy 1, policy_version 513049 (0.0007) [2023-12-26 03:42:38,784][121949] Fps is (10 sec: 19660.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 263593984. Throughput: 0: 9028.9, 1: 8846.8. Samples: 263564112. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:38,785][121949] Avg episode reward: [(0, '5904.458'), (1, '5711.304')] [2023-12-26 03:42:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000516592_132251648.pth... [2023-12-26 03:42:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000513056_131342336.pth... [2023-12-26 03:42:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000515536_131981312.pth [2023-12-26 03:42:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000512032_131080192.pth [2023-12-26 03:42:39,296][123091] Updated weights for policy 0, policy_version 516600 (0.0009) [2023-12-26 03:42:39,362][123091] Updated weights for policy 0, policy_version 516610 (0.0008) [2023-12-26 03:42:39,438][123091] Updated weights for policy 0, policy_version 516620 (0.0008) [2023-12-26 03:42:39,535][123090] Updated weights for policy 1, policy_version 513059 (0.0009) [2023-12-26 03:42:39,602][123090] Updated weights for policy 1, policy_version 513069 (0.0010) [2023-12-26 03:42:39,674][123090] Updated weights for policy 1, policy_version 513079 (0.0006) [2023-12-26 03:42:40,176][123091] Updated weights for policy 0, policy_version 516630 (0.0007) [2023-12-26 03:42:40,247][123091] Updated weights for policy 0, policy_version 516640 (0.0007) [2023-12-26 03:42:40,323][123091] Updated weights for policy 0, policy_version 516650 (0.0006) [2023-12-26 03:42:40,400][123090] Updated weights for policy 1, policy_version 513089 (0.0006) [2023-12-26 03:42:40,468][123090] Updated weights for policy 1, policy_version 513099 (0.0009) [2023-12-26 03:42:40,516][123090] Updated weights for policy 1, policy_version 513109 (0.0008) [2023-12-26 03:42:40,564][123090] Updated weights for policy 1, policy_version 513119 (0.0009) [2023-12-26 03:42:40,963][123091] Updated weights for policy 0, policy_version 516660 (0.0007) [2023-12-26 03:42:41,034][123091] Updated weights for policy 0, policy_version 516670 (0.0008) [2023-12-26 03:42:41,098][123091] Updated weights for policy 0, policy_version 516680 (0.0009) [2023-12-26 03:42:41,470][123090] Updated weights for policy 1, policy_version 513129 (0.0010) [2023-12-26 03:42:41,526][123090] Updated weights for policy 1, policy_version 513139 (0.0010) [2023-12-26 03:42:41,582][123090] Updated weights for policy 1, policy_version 513149 (0.0010) [2023-12-26 03:42:41,876][123091] Updated weights for policy 0, policy_version 516690 (0.0007) [2023-12-26 03:42:41,941][123091] Updated weights for policy 0, policy_version 516700 (0.0008) [2023-12-26 03:42:42,003][123091] Updated weights for policy 0, policy_version 516710 (0.0008) [2023-12-26 03:42:42,066][123091] Updated weights for policy 0, policy_version 516720 (0.0008) [2023-12-26 03:42:42,419][123090] Updated weights for policy 1, policy_version 513159 (0.0010) [2023-12-26 03:42:42,474][123090] Updated weights for policy 1, policy_version 513169 (0.0010) [2023-12-26 03:42:42,533][123090] Updated weights for policy 1, policy_version 513179 (0.0009) [2023-12-26 03:42:42,818][123091] Updated weights for policy 0, policy_version 516730 (0.0005) [2023-12-26 03:42:42,883][123091] Updated weights for policy 0, policy_version 516740 (0.0009) [2023-12-26 03:42:42,951][123091] Updated weights for policy 0, policy_version 516750 (0.0009) [2023-12-26 03:42:43,304][123090] Updated weights for policy 1, policy_version 513189 (0.0007) [2023-12-26 03:42:43,362][123090] Updated weights for policy 1, policy_version 513199 (0.0005) [2023-12-26 03:42:43,417][123090] Updated weights for policy 1, policy_version 513209 (0.0007) [2023-12-26 03:42:43,776][123091] Updated weights for policy 0, policy_version 516760 (0.0010) [2023-12-26 03:42:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 263675904. Throughput: 0: 9050.3, 1: 8824.5. Samples: 263672228. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:43,785][121949] Avg episode reward: [(0, '5896.501'), (1, '5703.056')] [2023-12-26 03:42:43,847][123091] Updated weights for policy 0, policy_version 516770 (0.0010) [2023-12-26 03:42:43,913][123091] Updated weights for policy 0, policy_version 516780 (0.0010) [2023-12-26 03:42:44,154][123090] Updated weights for policy 1, policy_version 513219 (0.0007) [2023-12-26 03:42:44,223][123090] Updated weights for policy 1, policy_version 513229 (0.0006) [2023-12-26 03:42:44,275][123090] Updated weights for policy 1, policy_version 513239 (0.0006) [2023-12-26 03:42:44,795][123091] Updated weights for policy 0, policy_version 516790 (0.0009) [2023-12-26 03:42:44,861][123091] Updated weights for policy 0, policy_version 516800 (0.0009) [2023-12-26 03:42:44,918][123091] Updated weights for policy 0, policy_version 516810 (0.0010) [2023-12-26 03:42:44,992][123090] Updated weights for policy 1, policy_version 513249 (0.0005) [2023-12-26 03:42:45,052][123090] Updated weights for policy 1, policy_version 513259 (0.0005) [2023-12-26 03:42:45,125][123090] Updated weights for policy 1, policy_version 513269 (0.0008) [2023-12-26 03:42:45,187][123090] Updated weights for policy 1, policy_version 513279 (0.0009) [2023-12-26 03:42:45,793][123091] Updated weights for policy 0, policy_version 516821 (0.0008) [2023-12-26 03:42:45,842][123091] Updated weights for policy 0, policy_version 516831 (0.0005) [2023-12-26 03:42:45,887][123091] Updated weights for policy 0, policy_version 516841 (0.0005) [2023-12-26 03:42:46,010][123090] Updated weights for policy 1, policy_version 513289 (0.0010) [2023-12-26 03:42:46,085][123090] Updated weights for policy 1, policy_version 513299 (0.0009) [2023-12-26 03:42:46,150][123090] Updated weights for policy 1, policy_version 513309 (0.0009) [2023-12-26 03:42:46,687][123091] Updated weights for policy 0, policy_version 516851 (0.0007) [2023-12-26 03:42:46,751][123091] Updated weights for policy 0, policy_version 516861 (0.0008) [2023-12-26 03:42:46,816][123091] Updated weights for policy 0, policy_version 516871 (0.0009) [2023-12-26 03:42:46,889][123090] Updated weights for policy 1, policy_version 513319 (0.0009) [2023-12-26 03:42:46,947][123090] Updated weights for policy 1, policy_version 513329 (0.0009) [2023-12-26 03:42:47,006][123090] Updated weights for policy 1, policy_version 513339 (0.0006) [2023-12-26 03:42:47,710][123091] Updated weights for policy 0, policy_version 516881 (0.0010) [2023-12-26 03:42:47,730][123090] Updated weights for policy 1, policy_version 513349 (0.0006) [2023-12-26 03:42:47,759][123091] Updated weights for policy 0, policy_version 516891 (0.0009) [2023-12-26 03:42:47,782][123090] Updated weights for policy 1, policy_version 513359 (0.0008) [2023-12-26 03:42:47,807][123091] Updated weights for policy 0, policy_version 516901 (0.0008) [2023-12-26 03:42:47,839][123090] Updated weights for policy 1, policy_version 513369 (0.0010) [2023-12-26 03:42:47,862][123091] Updated weights for policy 0, policy_version 516911 (0.0008) [2023-12-26 03:42:48,677][123091] Updated weights for policy 0, policy_version 516921 (0.0009) [2023-12-26 03:42:48,683][123090] Updated weights for policy 1, policy_version 513379 (0.0007) [2023-12-26 03:42:48,737][123091] Updated weights for policy 0, policy_version 516931 (0.0009) [2023-12-26 03:42:48,750][123090] Updated weights for policy 1, policy_version 513389 (0.0005) [2023-12-26 03:42:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 263757824. Throughput: 0: 9033.2, 1: 8874.6. Samples: 263778720. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 03:42:48,785][121949] Avg episode reward: [(0, '5983.487'), (1, '5731.444')] [2023-12-26 03:42:48,802][123091] Updated weights for policy 0, policy_version 516941 (0.0009) [2023-12-26 03:42:48,817][123090] Updated weights for policy 1, policy_version 513399 (0.0006) [2023-12-26 03:42:49,594][123090] Updated weights for policy 1, policy_version 513409 (0.0006) [2023-12-26 03:42:49,652][123090] Updated weights for policy 1, policy_version 513419 (0.0007) [2023-12-26 03:42:49,662][123091] Updated weights for policy 0, policy_version 516951 (0.0010) [2023-12-26 03:42:49,717][123090] Updated weights for policy 1, policy_version 513429 (0.0007) [2023-12-26 03:42:49,728][123091] Updated weights for policy 0, policy_version 516961 (0.0008) [2023-12-26 03:42:49,783][123090] Updated weights for policy 1, policy_version 513439 (0.0008) [2023-12-26 03:42:49,790][123091] Updated weights for policy 0, policy_version 516971 (0.0009) [2023-12-26 03:42:50,496][123090] Updated weights for policy 1, policy_version 513449 (0.0006) [2023-12-26 03:42:50,551][123090] Updated weights for policy 1, policy_version 513459 (0.0005) [2023-12-26 03:42:50,618][123090] Updated weights for policy 1, policy_version 513469 (0.0008) [2023-12-26 03:42:50,627][123091] Updated weights for policy 0, policy_version 516981 (0.0008) [2023-12-26 03:42:50,690][123091] Updated weights for policy 0, policy_version 516991 (0.0011) [2023-12-26 03:42:50,754][123091] Updated weights for policy 0, policy_version 517001 (0.0011) [2023-12-26 03:42:51,428][123090] Updated weights for policy 1, policy_version 513479 (0.0007) [2023-12-26 03:42:51,497][123090] Updated weights for policy 1, policy_version 513489 (0.0006) [2023-12-26 03:42:51,563][123090] Updated weights for policy 1, policy_version 513499 (0.0006) [2023-12-26 03:42:51,587][123091] Updated weights for policy 0, policy_version 517011 (0.0010) [2023-12-26 03:42:51,653][123091] Updated weights for policy 0, policy_version 517021 (0.0010) [2023-12-26 03:42:51,723][123091] Updated weights for policy 0, policy_version 517031 (0.0008) [2023-12-26 03:42:52,314][123090] Updated weights for policy 1, policy_version 513509 (0.0007) [2023-12-26 03:42:52,422][123090] Updated weights for policy 1, policy_version 513519 (0.0008) [2023-12-26 03:42:52,475][123090] Updated weights for policy 1, policy_version 513529 (0.0009) [2023-12-26 03:42:52,506][123091] Updated weights for policy 0, policy_version 517041 (0.0008) [2023-12-26 03:42:52,573][123091] Updated weights for policy 0, policy_version 517051 (0.0007) [2023-12-26 03:42:52,649][123091] Updated weights for policy 0, policy_version 517061 (0.0005) [2023-12-26 03:42:52,722][123091] Updated weights for policy 0, policy_version 517071 (0.0009) [2023-12-26 03:42:53,288][123090] Updated weights for policy 1, policy_version 513539 (0.0009) [2023-12-26 03:42:53,352][123090] Updated weights for policy 1, policy_version 513549 (0.0010) [2023-12-26 03:42:53,406][123090] Updated weights for policy 1, policy_version 513559 (0.0010) [2023-12-26 03:42:53,450][123091] Updated weights for policy 0, policy_version 517081 (0.0006) [2023-12-26 03:42:53,517][123091] Updated weights for policy 0, policy_version 517091 (0.0005) [2023-12-26 03:42:53,586][123091] Updated weights for policy 0, policy_version 517101 (0.0005) [2023-12-26 03:42:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 263856128. Throughput: 0: 9023.4, 1: 8816.8. Samples: 263830884. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:42:53,786][121949] Avg episode reward: [(0, '6089.597'), (1, '5720.117')] [2023-12-26 03:42:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000513568_131473408.pth... [2023-12-26 03:42:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000517104_132382720.pth... [2023-12-26 03:42:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000512512_131203072.pth [2023-12-26 03:42:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000516048_132112384.pth [2023-12-26 03:42:54,198][123091] Updated weights for policy 0, policy_version 517111 (0.0005) [2023-12-26 03:42:54,271][123091] Updated weights for policy 0, policy_version 517121 (0.0005) [2023-12-26 03:42:54,331][123091] Updated weights for policy 0, policy_version 517131 (0.0005) [2023-12-26 03:42:54,350][123090] Updated weights for policy 1, policy_version 513570 (0.0009) [2023-12-26 03:42:54,414][123090] Updated weights for policy 1, policy_version 513580 (0.0009) [2023-12-26 03:42:54,479][123090] Updated weights for policy 1, policy_version 513590 (0.0010) [2023-12-26 03:42:54,987][123091] Updated weights for policy 0, policy_version 517141 (0.0006) [2023-12-26 03:42:55,057][123091] Updated weights for policy 0, policy_version 517151 (0.0005) [2023-12-26 03:42:55,129][123091] Updated weights for policy 0, policy_version 517161 (0.0007) [2023-12-26 03:42:55,361][123090] Updated weights for policy 1, policy_version 513601 (0.0010) [2023-12-26 03:42:55,416][123090] Updated weights for policy 1, policy_version 513611 (0.0010) [2023-12-26 03:42:55,470][123090] Updated weights for policy 1, policy_version 513621 (0.0010) [2023-12-26 03:42:55,527][123090] Updated weights for policy 1, policy_version 513632 (0.0009) [2023-12-26 03:42:55,684][123091] Updated weights for policy 0, policy_version 517171 (0.0009) [2023-12-26 03:42:55,756][123091] Updated weights for policy 0, policy_version 517181 (0.0005) [2023-12-26 03:42:55,823][123091] Updated weights for policy 0, policy_version 517191 (0.0007) [2023-12-26 03:42:56,434][123090] Updated weights for policy 1, policy_version 513642 (0.0009) [2023-12-26 03:42:56,492][123090] Updated weights for policy 1, policy_version 513652 (0.0009) [2023-12-26 03:42:56,530][123091] Updated weights for policy 0, policy_version 517201 (0.0006) [2023-12-26 03:42:56,542][123090] Updated weights for policy 1, policy_version 513662 (0.0006) [2023-12-26 03:42:56,589][123091] Updated weights for policy 0, policy_version 517211 (0.0005) [2023-12-26 03:42:56,637][123091] Updated weights for policy 0, policy_version 517221 (0.0006) [2023-12-26 03:42:56,683][123091] Updated weights for policy 0, policy_version 517231 (0.0006) [2023-12-26 03:42:57,218][123090] Updated weights for policy 1, policy_version 513672 (0.0006) [2023-12-26 03:42:57,268][123090] Updated weights for policy 1, policy_version 513682 (0.0005) [2023-12-26 03:42:57,326][123090] Updated weights for policy 1, policy_version 513692 (0.0006) [2023-12-26 03:42:57,431][123091] Updated weights for policy 0, policy_version 517241 (0.0010) [2023-12-26 03:42:57,483][123091] Updated weights for policy 0, policy_version 517251 (0.0011) [2023-12-26 03:42:57,539][123091] Updated weights for policy 0, policy_version 517261 (0.0011) [2023-12-26 03:42:58,066][123090] Updated weights for policy 1, policy_version 513702 (0.0009) [2023-12-26 03:42:58,132][123090] Updated weights for policy 1, policy_version 513712 (0.0009) [2023-12-26 03:42:58,197][123090] Updated weights for policy 1, policy_version 513722 (0.0009) [2023-12-26 03:42:58,394][123091] Updated weights for policy 0, policy_version 517271 (0.0008) [2023-12-26 03:42:58,464][123091] Updated weights for policy 0, policy_version 517281 (0.0009) [2023-12-26 03:42:58,535][123091] Updated weights for policy 0, policy_version 517291 (0.0009) [2023-12-26 03:42:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 263946240. Throughput: 0: 9131.6, 1: 8840.3. Samples: 263939740. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:42:58,785][121949] Avg episode reward: [(0, '6045.199'), (1, '5627.607')] [2023-12-26 03:42:59,024][123090] Updated weights for policy 1, policy_version 513732 (0.0009) [2023-12-26 03:42:59,088][123090] Updated weights for policy 1, policy_version 513742 (0.0008) [2023-12-26 03:42:59,165][123090] Updated weights for policy 1, policy_version 513752 (0.0007) [2023-12-26 03:42:59,407][123091] Updated weights for policy 0, policy_version 517301 (0.0007) [2023-12-26 03:42:59,479][123091] Updated weights for policy 0, policy_version 517311 (0.0006) [2023-12-26 03:42:59,554][123091] Updated weights for policy 0, policy_version 517321 (0.0006) [2023-12-26 03:42:59,954][123090] Updated weights for policy 1, policy_version 513762 (0.0010) [2023-12-26 03:43:00,010][123090] Updated weights for policy 1, policy_version 513772 (0.0010) [2023-12-26 03:43:00,073][123090] Updated weights for policy 1, policy_version 513782 (0.0006) [2023-12-26 03:43:00,146][123090] Updated weights for policy 1, policy_version 513792 (0.0009) [2023-12-26 03:43:00,260][123091] Updated weights for policy 0, policy_version 517331 (0.0007) [2023-12-26 03:43:00,309][123091] Updated weights for policy 0, policy_version 517341 (0.0009) [2023-12-26 03:43:00,372][123091] Updated weights for policy 0, policy_version 517351 (0.0010) [2023-12-26 03:43:00,924][123090] Updated weights for policy 1, policy_version 513802 (0.0007) [2023-12-26 03:43:00,976][123090] Updated weights for policy 1, policy_version 513812 (0.0009) [2023-12-26 03:43:01,035][123090] Updated weights for policy 1, policy_version 513822 (0.0010) [2023-12-26 03:43:01,250][123091] Updated weights for policy 0, policy_version 517361 (0.0009) [2023-12-26 03:43:01,317][123091] Updated weights for policy 0, policy_version 517371 (0.0009) [2023-12-26 03:43:01,388][123091] Updated weights for policy 0, policy_version 517381 (0.0010) [2023-12-26 03:43:01,447][123091] Updated weights for policy 0, policy_version 517391 (0.0009) [2023-12-26 03:43:01,745][123090] Updated weights for policy 1, policy_version 513832 (0.0009) [2023-12-26 03:43:01,810][123090] Updated weights for policy 1, policy_version 513842 (0.0009) [2023-12-26 03:43:01,866][123090] Updated weights for policy 1, policy_version 513852 (0.0010) [2023-12-26 03:43:02,333][123091] Updated weights for policy 0, policy_version 517401 (0.0009) [2023-12-26 03:43:02,389][123091] Updated weights for policy 0, policy_version 517411 (0.0009) [2023-12-26 03:43:02,448][123091] Updated weights for policy 0, policy_version 517421 (0.0008) [2023-12-26 03:43:02,623][123090] Updated weights for policy 1, policy_version 513862 (0.0009) [2023-12-26 03:43:02,678][123090] Updated weights for policy 1, policy_version 513872 (0.0010) [2023-12-26 03:43:02,725][123090] Updated weights for policy 1, policy_version 513882 (0.0010) [2023-12-26 03:43:03,290][123091] Updated weights for policy 0, policy_version 517431 (0.0010) [2023-12-26 03:43:03,348][123091] Updated weights for policy 0, policy_version 517441 (0.0010) [2023-12-26 03:43:03,411][123091] Updated weights for policy 0, policy_version 517451 (0.0011) [2023-12-26 03:43:03,448][123090] Updated weights for policy 1, policy_version 513892 (0.0008) [2023-12-26 03:43:03,525][123090] Updated weights for policy 1, policy_version 513902 (0.0005) [2023-12-26 03:43:03,595][123090] Updated weights for policy 1, policy_version 513912 (0.0009) [2023-12-26 03:43:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 264036352. Throughput: 0: 8987.5, 1: 8921.0. Samples: 264044260. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:03,785][121949] Avg episode reward: [(0, '6034.719'), (1, '5502.496')] [2023-12-26 03:43:04,145][123091] Updated weights for policy 0, policy_version 517461 (0.0008) [2023-12-26 03:43:04,217][123091] Updated weights for policy 0, policy_version 517471 (0.0007) [2023-12-26 03:43:04,287][123091] Updated weights for policy 0, policy_version 517481 (0.0008) [2023-12-26 03:43:04,392][123090] Updated weights for policy 1, policy_version 513922 (0.0010) [2023-12-26 03:43:04,457][123090] Updated weights for policy 1, policy_version 513932 (0.0009) [2023-12-26 03:43:04,524][123090] Updated weights for policy 1, policy_version 513942 (0.0009) [2023-12-26 03:43:04,587][123090] Updated weights for policy 1, policy_version 513952 (0.0009) [2023-12-26 03:43:05,068][123091] Updated weights for policy 0, policy_version 517491 (0.0008) [2023-12-26 03:43:05,121][123091] Updated weights for policy 0, policy_version 517501 (0.0010) [2023-12-26 03:43:05,175][123091] Updated weights for policy 0, policy_version 517512 (0.0010) [2023-12-26 03:43:05,390][123090] Updated weights for policy 1, policy_version 513962 (0.0007) [2023-12-26 03:43:05,462][123090] Updated weights for policy 1, policy_version 513972 (0.0008) [2023-12-26 03:43:05,516][123090] Updated weights for policy 1, policy_version 513982 (0.0007) [2023-12-26 03:43:06,024][123091] Updated weights for policy 0, policy_version 517523 (0.0010) [2023-12-26 03:43:06,075][123091] Updated weights for policy 0, policy_version 517533 (0.0010) [2023-12-26 03:43:06,146][123091] Updated weights for policy 0, policy_version 517543 (0.0009) [2023-12-26 03:43:06,241][123090] Updated weights for policy 1, policy_version 513992 (0.0009) [2023-12-26 03:43:06,314][123090] Updated weights for policy 1, policy_version 514002 (0.0006) [2023-12-26 03:43:06,381][123090] Updated weights for policy 1, policy_version 514012 (0.0006) [2023-12-26 03:43:07,016][123091] Updated weights for policy 0, policy_version 517553 (0.0011) [2023-12-26 03:43:07,072][123091] Updated weights for policy 0, policy_version 517563 (0.0010) [2023-12-26 03:43:07,102][123090] Updated weights for policy 1, policy_version 514022 (0.0007) [2023-12-26 03:43:07,139][123091] Updated weights for policy 0, policy_version 517573 (0.0008) [2023-12-26 03:43:07,164][123090] Updated weights for policy 1, policy_version 514032 (0.0007) [2023-12-26 03:43:07,210][123091] Updated weights for policy 0, policy_version 517583 (0.0007) [2023-12-26 03:43:07,232][123090] Updated weights for policy 1, policy_version 514042 (0.0008) [2023-12-26 03:43:07,909][123091] Updated weights for policy 0, policy_version 517593 (0.0009) [2023-12-26 03:43:07,970][123091] Updated weights for policy 0, policy_version 517603 (0.0009) [2023-12-26 03:43:08,033][123091] Updated weights for policy 0, policy_version 517613 (0.0009) [2023-12-26 03:43:08,070][123090] Updated weights for policy 1, policy_version 514052 (0.0010) [2023-12-26 03:43:08,132][123090] Updated weights for policy 1, policy_version 514062 (0.0010) [2023-12-26 03:43:08,202][123090] Updated weights for policy 1, policy_version 514072 (0.0008) [2023-12-26 03:43:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 264118272. Throughput: 0: 9014.3, 1: 8973.6. Samples: 264097376. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:08,785][121949] Avg episode reward: [(0, '6040.314'), (1, '5309.708')] [2023-12-26 03:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000514080_131604480.pth... [2023-12-26 03:43:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000513056_131342336.pth [2023-12-26 03:43:08,812][123091] Updated weights for policy 0, policy_version 517623 (0.0007) [2023-12-26 03:43:08,873][123091] Updated weights for policy 0, policy_version 517633 (0.0006) [2023-12-26 03:43:08,930][123091] Updated weights for policy 0, policy_version 517643 (0.0005) [2023-12-26 03:43:08,958][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000517648_132521984.pth... [2023-12-26 03:43:08,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000516592_132251648.pth [2023-12-26 03:43:09,112][123090] Updated weights for policy 1, policy_version 514082 (0.0009) [2023-12-26 03:43:09,170][123090] Updated weights for policy 1, policy_version 514092 (0.0009) [2023-12-26 03:43:09,240][123090] Updated weights for policy 1, policy_version 514102 (0.0010) [2023-12-26 03:43:09,307][123090] Updated weights for policy 1, policy_version 514112 (0.0009) [2023-12-26 03:43:09,712][123091] Updated weights for policy 0, policy_version 517653 (0.0008) [2023-12-26 03:43:09,766][123091] Updated weights for policy 0, policy_version 517663 (0.0009) [2023-12-26 03:43:09,833][123091] Updated weights for policy 0, policy_version 517673 (0.0009) [2023-12-26 03:43:10,160][123090] Updated weights for policy 1, policy_version 514122 (0.0008) [2023-12-26 03:43:10,234][123090] Updated weights for policy 1, policy_version 514132 (0.0008) [2023-12-26 03:43:10,300][123090] Updated weights for policy 1, policy_version 514142 (0.0008) [2023-12-26 03:43:10,594][123091] Updated weights for policy 0, policy_version 517683 (0.0008) [2023-12-26 03:43:10,667][123091] Updated weights for policy 0, policy_version 517693 (0.0007) [2023-12-26 03:43:10,739][123091] Updated weights for policy 0, policy_version 517703 (0.0006) [2023-12-26 03:43:11,144][123090] Updated weights for policy 1, policy_version 514152 (0.0009) [2023-12-26 03:43:11,210][123090] Updated weights for policy 1, policy_version 514162 (0.0010) [2023-12-26 03:43:11,281][123090] Updated weights for policy 1, policy_version 514172 (0.0010) [2023-12-26 03:43:11,474][123091] Updated weights for policy 0, policy_version 517713 (0.0006) [2023-12-26 03:43:11,538][123091] Updated weights for policy 0, policy_version 517723 (0.0009) [2023-12-26 03:43:11,594][123091] Updated weights for policy 0, policy_version 517733 (0.0010) [2023-12-26 03:43:11,666][123091] Updated weights for policy 0, policy_version 517743 (0.0009) [2023-12-26 03:43:12,077][123090] Updated weights for policy 1, policy_version 514182 (0.0009) [2023-12-26 03:43:12,130][123090] Updated weights for policy 1, policy_version 514192 (0.0010) [2023-12-26 03:43:12,181][123090] Updated weights for policy 1, policy_version 514202 (0.0010) [2023-12-26 03:43:12,539][123091] Updated weights for policy 0, policy_version 517753 (0.0009) [2023-12-26 03:43:12,594][123091] Updated weights for policy 0, policy_version 517763 (0.0010) [2023-12-26 03:43:12,644][123091] Updated weights for policy 0, policy_version 517773 (0.0009) [2023-12-26 03:43:13,028][123090] Updated weights for policy 1, policy_version 514212 (0.0010) [2023-12-26 03:43:13,094][123090] Updated weights for policy 1, policy_version 514222 (0.0009) [2023-12-26 03:43:13,161][123090] Updated weights for policy 1, policy_version 514232 (0.0009) [2023-12-26 03:43:13,471][123091] Updated weights for policy 0, policy_version 517783 (0.0008) [2023-12-26 03:43:13,521][123091] Updated weights for policy 0, policy_version 517794 (0.0009) [2023-12-26 03:43:13,574][123091] Updated weights for policy 0, policy_version 517804 (0.0009) [2023-12-26 03:43:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 264208384. Throughput: 0: 8969.0, 1: 8893.2. Samples: 264201112. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:13,785][121949] Avg episode reward: [(0, '5922.684'), (1, '5468.417')] [2023-12-26 03:43:14,049][123090] Updated weights for policy 1, policy_version 514242 (0.0009) [2023-12-26 03:43:14,116][123090] Updated weights for policy 1, policy_version 514252 (0.0005) [2023-12-26 03:43:14,170][123090] Updated weights for policy 1, policy_version 514262 (0.0006) [2023-12-26 03:43:14,226][123090] Updated weights for policy 1, policy_version 514272 (0.0008) [2023-12-26 03:43:14,266][123091] Updated weights for policy 0, policy_version 517814 (0.0009) [2023-12-26 03:43:14,326][123091] Updated weights for policy 0, policy_version 517824 (0.0011) [2023-12-26 03:43:14,389][123091] Updated weights for policy 0, policy_version 517834 (0.0011) [2023-12-26 03:43:14,990][123090] Updated weights for policy 1, policy_version 514282 (0.0009) [2023-12-26 03:43:15,048][123090] Updated weights for policy 1, policy_version 514292 (0.0009) [2023-12-26 03:43:15,117][123090] Updated weights for policy 1, policy_version 514302 (0.0009) [2023-12-26 03:43:15,213][123091] Updated weights for policy 0, policy_version 517844 (0.0010) [2023-12-26 03:43:15,265][123091] Updated weights for policy 0, policy_version 517854 (0.0009) [2023-12-26 03:43:15,319][123091] Updated weights for policy 0, policy_version 517864 (0.0010) [2023-12-26 03:43:15,943][123090] Updated weights for policy 1, policy_version 514312 (0.0009) [2023-12-26 03:43:15,997][123090] Updated weights for policy 1, policy_version 514322 (0.0008) [2023-12-26 03:43:16,060][123090] Updated weights for policy 1, policy_version 514332 (0.0005) [2023-12-26 03:43:16,160][123091] Updated weights for policy 0, policy_version 517874 (0.0010) [2023-12-26 03:43:16,215][123091] Updated weights for policy 0, policy_version 517884 (0.0010) [2023-12-26 03:43:16,267][123091] Updated weights for policy 0, policy_version 517894 (0.0011) [2023-12-26 03:43:16,340][123091] Updated weights for policy 0, policy_version 517904 (0.0011) [2023-12-26 03:43:16,842][123090] Updated weights for policy 1, policy_version 514342 (0.0008) [2023-12-26 03:43:16,885][123090] Updated weights for policy 1, policy_version 514352 (0.0010) [2023-12-26 03:43:16,933][123090] Updated weights for policy 1, policy_version 514362 (0.0010) [2023-12-26 03:43:17,124][123091] Updated weights for policy 0, policy_version 517914 (0.0011) [2023-12-26 03:43:17,194][123091] Updated weights for policy 0, policy_version 517924 (0.0011) [2023-12-26 03:43:17,263][123091] Updated weights for policy 0, policy_version 517934 (0.0011) [2023-12-26 03:43:17,702][123090] Updated weights for policy 1, policy_version 514372 (0.0009) [2023-12-26 03:43:17,766][123090] Updated weights for policy 1, policy_version 514382 (0.0009) [2023-12-26 03:43:17,825][123090] Updated weights for policy 1, policy_version 514392 (0.0006) [2023-12-26 03:43:18,026][123091] Updated weights for policy 0, policy_version 517944 (0.0007) [2023-12-26 03:43:18,086][123091] Updated weights for policy 0, policy_version 517954 (0.0005) [2023-12-26 03:43:18,144][123091] Updated weights for policy 0, policy_version 517964 (0.0005) [2023-12-26 03:43:18,513][123090] Updated weights for policy 1, policy_version 514402 (0.0006) [2023-12-26 03:43:18,583][123090] Updated weights for policy 1, policy_version 514412 (0.0009) [2023-12-26 03:43:18,645][123090] Updated weights for policy 1, policy_version 514422 (0.0008) [2023-12-26 03:43:18,717][123090] Updated weights for policy 1, policy_version 514432 (0.0009) [2023-12-26 03:43:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 264298496. Throughput: 0: 8939.0, 1: 8875.9. Samples: 264309048. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:18,785][121949] Avg episode reward: [(0, '5978.234'), (1, '5403.494')] [2023-12-26 03:43:18,878][123091] Updated weights for policy 0, policy_version 517974 (0.0009) [2023-12-26 03:43:18,944][123091] Updated weights for policy 0, policy_version 517984 (0.0011) [2023-12-26 03:43:19,006][123091] Updated weights for policy 0, policy_version 517994 (0.0011) [2023-12-26 03:43:19,579][123090] Updated weights for policy 1, policy_version 514442 (0.0009) [2023-12-26 03:43:19,638][123090] Updated weights for policy 1, policy_version 514452 (0.0008) [2023-12-26 03:43:19,706][123090] Updated weights for policy 1, policy_version 514462 (0.0008) [2023-12-26 03:43:19,782][123091] Updated weights for policy 0, policy_version 518004 (0.0010) [2023-12-26 03:43:19,844][123091] Updated weights for policy 0, policy_version 518014 (0.0007) [2023-12-26 03:43:19,907][123091] Updated weights for policy 0, policy_version 518024 (0.0007) [2023-12-26 03:43:20,477][123090] Updated weights for policy 1, policy_version 514472 (0.0009) [2023-12-26 03:43:20,535][123090] Updated weights for policy 1, policy_version 514482 (0.0009) [2023-12-26 03:43:20,599][123090] Updated weights for policy 1, policy_version 514492 (0.0009) [2023-12-26 03:43:20,742][123091] Updated weights for policy 0, policy_version 518034 (0.0009) [2023-12-26 03:43:20,809][123091] Updated weights for policy 0, policy_version 518044 (0.0010) [2023-12-26 03:43:20,874][123091] Updated weights for policy 0, policy_version 518054 (0.0010) [2023-12-26 03:43:20,941][123091] Updated weights for policy 0, policy_version 518064 (0.0009) [2023-12-26 03:43:21,468][123090] Updated weights for policy 1, policy_version 514502 (0.0010) [2023-12-26 03:43:21,535][123090] Updated weights for policy 1, policy_version 514512 (0.0010) [2023-12-26 03:43:21,610][123090] Updated weights for policy 1, policy_version 514522 (0.0009) [2023-12-26 03:43:21,794][123091] Updated weights for policy 0, policy_version 518074 (0.0008) [2023-12-26 03:43:21,867][123091] Updated weights for policy 0, policy_version 518084 (0.0011) [2023-12-26 03:43:21,935][123091] Updated weights for policy 0, policy_version 518094 (0.0010) [2023-12-26 03:43:22,498][123090] Updated weights for policy 1, policy_version 514532 (0.0009) [2023-12-26 03:43:22,566][123090] Updated weights for policy 1, policy_version 514542 (0.0010) [2023-12-26 03:43:22,633][123090] Updated weights for policy 1, policy_version 514552 (0.0010) [2023-12-26 03:43:22,780][123091] Updated weights for policy 0, policy_version 518104 (0.0009) [2023-12-26 03:43:22,838][123091] Updated weights for policy 0, policy_version 518114 (0.0009) [2023-12-26 03:43:22,903][123091] Updated weights for policy 0, policy_version 518124 (0.0010) [2023-12-26 03:43:23,472][123090] Updated weights for policy 1, policy_version 514562 (0.0010) [2023-12-26 03:43:23,538][123090] Updated weights for policy 1, policy_version 514572 (0.0009) [2023-12-26 03:43:23,603][123090] Updated weights for policy 1, policy_version 514582 (0.0009) [2023-12-26 03:43:23,662][123090] Updated weights for policy 1, policy_version 514592 (0.0009) [2023-12-26 03:43:23,726][123091] Updated weights for policy 0, policy_version 518134 (0.0010) [2023-12-26 03:43:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 264380416. Throughput: 0: 8867.0, 1: 8809.7. Samples: 264359564. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:23,785][121949] Avg episode reward: [(0, '6015.810'), (1, '5255.631')] [2023-12-26 03:43:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000514592_131735552.pth... [2023-12-26 03:43:23,791][123091] Updated weights for policy 0, policy_version 518144 (0.0010) [2023-12-26 03:43:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000513568_131473408.pth [2023-12-26 03:43:23,861][123091] Updated weights for policy 0, policy_version 518154 (0.0010) [2023-12-26 03:43:23,895][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000518160_132653056.pth... [2023-12-26 03:43:23,899][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000517104_132382720.pth [2023-12-26 03:43:24,494][123090] Updated weights for policy 1, policy_version 514602 (0.0009) [2023-12-26 03:43:24,543][123090] Updated weights for policy 1, policy_version 514612 (0.0010) [2023-12-26 03:43:24,602][123090] Updated weights for policy 1, policy_version 514622 (0.0008) [2023-12-26 03:43:24,687][123091] Updated weights for policy 0, policy_version 518164 (0.0010) [2023-12-26 03:43:24,744][123091] Updated weights for policy 0, policy_version 518174 (0.0009) [2023-12-26 03:43:24,800][123091] Updated weights for policy 0, policy_version 518184 (0.0009) [2023-12-26 03:43:25,488][123090] Updated weights for policy 1, policy_version 514632 (0.0009) [2023-12-26 03:43:25,549][123090] Updated weights for policy 1, policy_version 514642 (0.0009) [2023-12-26 03:43:25,565][123091] Updated weights for policy 0, policy_version 518195 (0.0010) [2023-12-26 03:43:25,598][123090] Updated weights for policy 1, policy_version 514652 (0.0008) [2023-12-26 03:43:25,632][123091] Updated weights for policy 0, policy_version 518205 (0.0008) [2023-12-26 03:43:25,697][123091] Updated weights for policy 0, policy_version 518215 (0.0008) [2023-12-26 03:43:26,289][123091] Updated weights for policy 0, policy_version 518225 (0.0008) [2023-12-26 03:43:26,357][123091] Updated weights for policy 0, policy_version 518235 (0.0005) [2023-12-26 03:43:26,426][123091] Updated weights for policy 0, policy_version 518245 (0.0005) [2023-12-26 03:43:26,493][123091] Updated weights for policy 0, policy_version 518255 (0.0005) [2023-12-26 03:43:26,521][123090] Updated weights for policy 1, policy_version 514662 (0.0009) [2023-12-26 03:43:26,574][123090] Updated weights for policy 1, policy_version 514672 (0.0010) [2023-12-26 03:43:26,631][123090] Updated weights for policy 1, policy_version 514682 (0.0010) [2023-12-26 03:43:27,049][123091] Updated weights for policy 0, policy_version 518265 (0.0010) [2023-12-26 03:43:27,092][123091] Updated weights for policy 0, policy_version 518275 (0.0010) [2023-12-26 03:43:27,136][123091] Updated weights for policy 0, policy_version 518285 (0.0010) [2023-12-26 03:43:27,531][123090] Updated weights for policy 1, policy_version 514693 (0.0009) [2023-12-26 03:43:27,590][123090] Updated weights for policy 1, policy_version 514703 (0.0009) [2023-12-26 03:43:27,647][123090] Updated weights for policy 1, policy_version 514713 (0.0009) [2023-12-26 03:43:27,977][123091] Updated weights for policy 0, policy_version 518295 (0.0010) [2023-12-26 03:43:28,024][123091] Updated weights for policy 0, policy_version 518305 (0.0010) [2023-12-26 03:43:28,072][123091] Updated weights for policy 0, policy_version 518315 (0.0010) [2023-12-26 03:43:28,480][123090] Updated weights for policy 1, policy_version 514723 (0.0009) [2023-12-26 03:43:28,537][123090] Updated weights for policy 1, policy_version 514733 (0.0009) [2023-12-26 03:43:28,593][123090] Updated weights for policy 1, policy_version 514743 (0.0008) [2023-12-26 03:43:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 264470528. Throughput: 0: 8884.4, 1: 8703.4. Samples: 264463676. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:28,785][121949] Avg episode reward: [(0, '6051.804'), (1, '5305.734')] [2023-12-26 03:43:28,921][123091] Updated weights for policy 0, policy_version 518325 (0.0010) [2023-12-26 03:43:28,968][123091] Updated weights for policy 0, policy_version 518335 (0.0010) [2023-12-26 03:43:29,019][123091] Updated weights for policy 0, policy_version 518345 (0.0010) [2023-12-26 03:43:29,460][123090] Updated weights for policy 1, policy_version 514753 (0.0009) [2023-12-26 03:43:29,522][123090] Updated weights for policy 1, policy_version 514763 (0.0009) [2023-12-26 03:43:29,583][123090] Updated weights for policy 1, policy_version 514773 (0.0009) [2023-12-26 03:43:29,645][123090] Updated weights for policy 1, policy_version 514783 (0.0009) [2023-12-26 03:43:29,759][123091] Updated weights for policy 0, policy_version 518355 (0.0009) [2023-12-26 03:43:29,832][123091] Updated weights for policy 0, policy_version 518365 (0.0007) [2023-12-26 03:43:29,889][123091] Updated weights for policy 0, policy_version 518375 (0.0006) [2023-12-26 03:43:30,521][123091] Updated weights for policy 0, policy_version 518385 (0.0007) [2023-12-26 03:43:30,568][123091] Updated weights for policy 0, policy_version 518395 (0.0010) [2023-12-26 03:43:30,587][123090] Updated weights for policy 1, policy_version 514793 (0.0006) [2023-12-26 03:43:30,620][123091] Updated weights for policy 0, policy_version 518405 (0.0010) [2023-12-26 03:43:30,650][123090] Updated weights for policy 1, policy_version 514803 (0.0007) [2023-12-26 03:43:30,670][123091] Updated weights for policy 0, policy_version 518415 (0.0010) [2023-12-26 03:43:30,711][123090] Updated weights for policy 1, policy_version 514813 (0.0005) [2023-12-26 03:43:31,474][123090] Updated weights for policy 1, policy_version 514823 (0.0009) [2023-12-26 03:43:31,503][123091] Updated weights for policy 0, policy_version 518425 (0.0006) [2023-12-26 03:43:31,538][123090] Updated weights for policy 1, policy_version 514833 (0.0009) [2023-12-26 03:43:31,568][123091] Updated weights for policy 0, policy_version 518435 (0.0006) [2023-12-26 03:43:31,599][123090] Updated weights for policy 1, policy_version 514843 (0.0009) [2023-12-26 03:43:31,634][123091] Updated weights for policy 0, policy_version 518445 (0.0008) [2023-12-26 03:43:32,303][123091] Updated weights for policy 0, policy_version 518455 (0.0011) [2023-12-26 03:43:32,354][123091] Updated weights for policy 0, policy_version 518465 (0.0010) [2023-12-26 03:43:32,415][123090] Updated weights for policy 1, policy_version 514853 (0.0007) [2023-12-26 03:43:32,428][123091] Updated weights for policy 0, policy_version 518475 (0.0010) [2023-12-26 03:43:32,480][123090] Updated weights for policy 1, policy_version 514863 (0.0008) [2023-12-26 03:43:32,547][123090] Updated weights for policy 1, policy_version 514873 (0.0008) [2023-12-26 03:43:33,150][123091] Updated weights for policy 0, policy_version 518485 (0.0008) [2023-12-26 03:43:33,203][123091] Updated weights for policy 0, policy_version 518495 (0.0009) [2023-12-26 03:43:33,262][123091] Updated weights for policy 0, policy_version 518505 (0.0006) [2023-12-26 03:43:33,352][123090] Updated weights for policy 1, policy_version 514883 (0.0007) [2023-12-26 03:43:33,408][123090] Updated weights for policy 1, policy_version 514893 (0.0005) [2023-12-26 03:43:33,467][123090] Updated weights for policy 1, policy_version 514903 (0.0005) [2023-12-26 03:43:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 264560640. Throughput: 0: 9010.6, 1: 8596.0. Samples: 264571016. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:33,785][121949] Avg episode reward: [(0, '5954.658'), (1, '5546.855')] [2023-12-26 03:43:33,921][123091] Updated weights for policy 0, policy_version 518515 (0.0005) [2023-12-26 03:43:33,977][123091] Updated weights for policy 0, policy_version 518525 (0.0005) [2023-12-26 03:43:34,039][123091] Updated weights for policy 0, policy_version 518535 (0.0005) [2023-12-26 03:43:34,218][123090] Updated weights for policy 1, policy_version 514913 (0.0006) [2023-12-26 03:43:34,291][123090] Updated weights for policy 1, policy_version 514923 (0.0006) [2023-12-26 03:43:34,354][123090] Updated weights for policy 1, policy_version 514933 (0.0006) [2023-12-26 03:43:34,430][123090] Updated weights for policy 1, policy_version 514943 (0.0006) [2023-12-26 03:43:34,813][123091] Updated weights for policy 0, policy_version 518545 (0.0005) [2023-12-26 03:43:34,868][123091] Updated weights for policy 0, policy_version 518555 (0.0006) [2023-12-26 03:43:34,925][123091] Updated weights for policy 0, policy_version 518565 (0.0006) [2023-12-26 03:43:34,983][123091] Updated weights for policy 0, policy_version 518575 (0.0006) [2023-12-26 03:43:35,236][123090] Updated weights for policy 1, policy_version 514953 (0.0010) [2023-12-26 03:43:35,300][123090] Updated weights for policy 1, policy_version 514963 (0.0009) [2023-12-26 03:43:35,365][123090] Updated weights for policy 1, policy_version 514973 (0.0009) [2023-12-26 03:43:35,734][123091] Updated weights for policy 0, policy_version 518585 (0.0010) [2023-12-26 03:43:35,801][123091] Updated weights for policy 0, policy_version 518595 (0.0010) [2023-12-26 03:43:35,867][123091] Updated weights for policy 0, policy_version 518605 (0.0011) [2023-12-26 03:43:36,259][123090] Updated weights for policy 1, policy_version 514983 (0.0010) [2023-12-26 03:43:36,324][123090] Updated weights for policy 1, policy_version 514993 (0.0010) [2023-12-26 03:43:36,375][123090] Updated weights for policy 1, policy_version 515003 (0.0010) [2023-12-26 03:43:36,629][123091] Updated weights for policy 0, policy_version 518615 (0.0010) [2023-12-26 03:43:36,679][123091] Updated weights for policy 0, policy_version 518625 (0.0010) [2023-12-26 03:43:36,739][123091] Updated weights for policy 0, policy_version 518635 (0.0010) [2023-12-26 03:43:37,258][123090] Updated weights for policy 1, policy_version 515014 (0.0010) [2023-12-26 03:43:37,334][123090] Updated weights for policy 1, policy_version 515024 (0.0009) [2023-12-26 03:43:37,406][123090] Updated weights for policy 1, policy_version 515034 (0.0010) [2023-12-26 03:43:37,532][123091] Updated weights for policy 0, policy_version 518645 (0.0007) [2023-12-26 03:43:37,589][123091] Updated weights for policy 0, policy_version 518655 (0.0005) [2023-12-26 03:43:37,656][123091] Updated weights for policy 0, policy_version 518665 (0.0008) [2023-12-26 03:43:38,195][123090] Updated weights for policy 1, policy_version 515044 (0.0008) [2023-12-26 03:43:38,257][123090] Updated weights for policy 1, policy_version 515054 (0.0008) [2023-12-26 03:43:38,305][123090] Updated weights for policy 1, policy_version 515064 (0.0008) [2023-12-26 03:43:38,464][123091] Updated weights for policy 0, policy_version 518675 (0.0011) [2023-12-26 03:43:38,524][123091] Updated weights for policy 0, policy_version 518685 (0.0011) [2023-12-26 03:43:38,580][123091] Updated weights for policy 0, policy_version 518695 (0.0010) [2023-12-26 03:43:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 264650752. Throughput: 0: 9086.2, 1: 8556.7. Samples: 264624808. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:38,785][121949] Avg episode reward: [(0, '5918.299'), (1, '5373.634')] [2023-12-26 03:43:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000518704_132792320.pth... [2023-12-26 03:43:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000515072_131858432.pth... [2023-12-26 03:43:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000517648_132521984.pth [2023-12-26 03:43:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000514080_131604480.pth [2023-12-26 03:43:39,141][123090] Updated weights for policy 1, policy_version 515074 (0.0008) [2023-12-26 03:43:39,201][123090] Updated weights for policy 1, policy_version 515084 (0.0007) [2023-12-26 03:43:39,275][123090] Updated weights for policy 1, policy_version 515094 (0.0010) [2023-12-26 03:43:39,346][123090] Updated weights for policy 1, policy_version 515104 (0.0009) [2023-12-26 03:43:39,412][123091] Updated weights for policy 0, policy_version 518705 (0.0010) [2023-12-26 03:43:39,471][123091] Updated weights for policy 0, policy_version 518715 (0.0008) [2023-12-26 03:43:39,533][123091] Updated weights for policy 0, policy_version 518725 (0.0008) [2023-12-26 03:43:39,593][123091] Updated weights for policy 0, policy_version 518735 (0.0007) [2023-12-26 03:43:40,172][123090] Updated weights for policy 1, policy_version 515114 (0.0010) [2023-12-26 03:43:40,230][123090] Updated weights for policy 1, policy_version 515124 (0.0010) [2023-12-26 03:43:40,297][123090] Updated weights for policy 1, policy_version 515134 (0.0010) [2023-12-26 03:43:40,367][123091] Updated weights for policy 0, policy_version 518745 (0.0006) [2023-12-26 03:43:40,435][123091] Updated weights for policy 0, policy_version 518755 (0.0006) [2023-12-26 03:43:40,490][123091] Updated weights for policy 0, policy_version 518765 (0.0005) [2023-12-26 03:43:41,086][123091] Updated weights for policy 0, policy_version 518775 (0.0006) [2023-12-26 03:43:41,162][123091] Updated weights for policy 0, policy_version 518785 (0.0008) [2023-12-26 03:43:41,224][123091] Updated weights for policy 0, policy_version 518795 (0.0008) [2023-12-26 03:43:41,239][123090] Updated weights for policy 1, policy_version 515144 (0.0009) [2023-12-26 03:43:41,306][123090] Updated weights for policy 1, policy_version 515154 (0.0008) [2023-12-26 03:43:41,384][123090] Updated weights for policy 1, policy_version 515164 (0.0008) [2023-12-26 03:43:42,029][123091] Updated weights for policy 0, policy_version 518805 (0.0009) [2023-12-26 03:43:42,101][123091] Updated weights for policy 0, policy_version 518815 (0.0007) [2023-12-26 03:43:42,160][123091] Updated weights for policy 0, policy_version 518825 (0.0009) [2023-12-26 03:43:42,217][123090] Updated weights for policy 1, policy_version 515174 (0.0008) [2023-12-26 03:43:42,285][123090] Updated weights for policy 1, policy_version 515184 (0.0010) [2023-12-26 03:43:42,350][123090] Updated weights for policy 1, policy_version 515194 (0.0010) [2023-12-26 03:43:42,874][123091] Updated weights for policy 0, policy_version 518835 (0.0007) [2023-12-26 03:43:42,934][123091] Updated weights for policy 0, policy_version 518845 (0.0010) [2023-12-26 03:43:42,995][123091] Updated weights for policy 0, policy_version 518855 (0.0009) [2023-12-26 03:43:43,208][123090] Updated weights for policy 1, policy_version 515204 (0.0010) [2023-12-26 03:43:43,256][123090] Updated weights for policy 1, policy_version 515214 (0.0009) [2023-12-26 03:43:43,313][123090] Updated weights for policy 1, policy_version 515224 (0.0009) [2023-12-26 03:43:43,749][123091] Updated weights for policy 0, policy_version 518865 (0.0009) [2023-12-26 03:43:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 264732672. Throughput: 0: 8994.3, 1: 8521.7. Samples: 264727960. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:43,785][121949] Avg episode reward: [(0, '5898.568'), (1, '5242.369')] [2023-12-26 03:43:43,808][123091] Updated weights for policy 0, policy_version 518875 (0.0006) [2023-12-26 03:43:43,857][123091] Updated weights for policy 0, policy_version 518886 (0.0010) [2023-12-26 03:43:43,909][123091] Updated weights for policy 0, policy_version 518896 (0.0009) [2023-12-26 03:43:44,219][123090] Updated weights for policy 1, policy_version 515234 (0.0009) [2023-12-26 03:43:44,277][123090] Updated weights for policy 1, policy_version 515244 (0.0009) [2023-12-26 03:43:44,333][123090] Updated weights for policy 1, policy_version 515254 (0.0010) [2023-12-26 03:43:44,388][123090] Updated weights for policy 1, policy_version 515264 (0.0009) [2023-12-26 03:43:44,578][123091] Updated weights for policy 0, policy_version 518906 (0.0009) [2023-12-26 03:43:44,626][123091] Updated weights for policy 0, policy_version 518916 (0.0008) [2023-12-26 03:43:44,684][123091] Updated weights for policy 0, policy_version 518926 (0.0009) [2023-12-26 03:43:45,246][123090] Updated weights for policy 1, policy_version 515274 (0.0010) [2023-12-26 03:43:45,297][123090] Updated weights for policy 1, policy_version 515284 (0.0009) [2023-12-26 03:43:45,348][123090] Updated weights for policy 1, policy_version 515294 (0.0009) [2023-12-26 03:43:45,564][123091] Updated weights for policy 0, policy_version 518937 (0.0009) [2023-12-26 03:43:45,627][123091] Updated weights for policy 0, policy_version 518947 (0.0009) [2023-12-26 03:43:45,705][123091] Updated weights for policy 0, policy_version 518957 (0.0010) [2023-12-26 03:43:46,252][123090] Updated weights for policy 1, policy_version 515304 (0.0009) [2023-12-26 03:43:46,325][123090] Updated weights for policy 1, policy_version 515314 (0.0010) [2023-12-26 03:43:46,406][123090] Updated weights for policy 1, policy_version 515324 (0.0008) [2023-12-26 03:43:46,410][123091] Updated weights for policy 0, policy_version 518967 (0.0007) [2023-12-26 03:43:46,469][123091] Updated weights for policy 0, policy_version 518977 (0.0010) [2023-12-26 03:43:46,523][123091] Updated weights for policy 0, policy_version 518989 (0.0010) [2023-12-26 03:43:47,200][123091] Updated weights for policy 0, policy_version 518999 (0.0009) [2023-12-26 03:43:47,204][123090] Updated weights for policy 1, policy_version 515334 (0.0007) [2023-12-26 03:43:47,255][123091] Updated weights for policy 0, policy_version 519009 (0.0009) [2023-12-26 03:43:47,268][123090] Updated weights for policy 1, policy_version 515344 (0.0007) [2023-12-26 03:43:47,312][123091] Updated weights for policy 0, policy_version 519019 (0.0009) [2023-12-26 03:43:47,330][123090] Updated weights for policy 1, policy_version 515354 (0.0010) [2023-12-26 03:43:48,049][123091] Updated weights for policy 0, policy_version 519029 (0.0005) [2023-12-26 03:43:48,120][123091] Updated weights for policy 0, policy_version 519039 (0.0005) [2023-12-26 03:43:48,175][123090] Updated weights for policy 1, policy_version 515364 (0.0007) [2023-12-26 03:43:48,192][123091] Updated weights for policy 0, policy_version 519049 (0.0005) [2023-12-26 03:43:48,225][123090] Updated weights for policy 1, policy_version 515374 (0.0005) [2023-12-26 03:43:48,277][123090] Updated weights for policy 1, policy_version 515384 (0.0005) [2023-12-26 03:43:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 264822784. Throughput: 0: 9149.7, 1: 8443.3. Samples: 264835940. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:48,785][121949] Avg episode reward: [(0, '5951.170'), (1, '5275.662')] [2023-12-26 03:43:49,001][123090] Updated weights for policy 1, policy_version 515394 (0.0007) [2023-12-26 03:43:49,013][123091] Updated weights for policy 0, policy_version 519059 (0.0009) [2023-12-26 03:43:49,061][123090] Updated weights for policy 1, policy_version 515404 (0.0005) [2023-12-26 03:43:49,070][123091] Updated weights for policy 0, policy_version 519069 (0.0009) [2023-12-26 03:43:49,115][123090] Updated weights for policy 1, policy_version 515414 (0.0005) [2023-12-26 03:43:49,137][123091] Updated weights for policy 0, policy_version 519079 (0.0005) [2023-12-26 03:43:49,176][123090] Updated weights for policy 1, policy_version 515424 (0.0006) [2023-12-26 03:43:49,843][123091] Updated weights for policy 0, policy_version 519089 (0.0008) [2023-12-26 03:43:49,915][123091] Updated weights for policy 0, policy_version 519099 (0.0009) [2023-12-26 03:43:49,954][123090] Updated weights for policy 1, policy_version 515434 (0.0009) [2023-12-26 03:43:49,984][123091] Updated weights for policy 0, policy_version 519109 (0.0008) [2023-12-26 03:43:50,014][123090] Updated weights for policy 1, policy_version 515444 (0.0008) [2023-12-26 03:43:50,055][123091] Updated weights for policy 0, policy_version 519119 (0.0007) [2023-12-26 03:43:50,077][123090] Updated weights for policy 1, policy_version 515454 (0.0009) [2023-12-26 03:43:50,754][123091] Updated weights for policy 0, policy_version 519129 (0.0008) [2023-12-26 03:43:50,802][123091] Updated weights for policy 0, policy_version 519139 (0.0008) [2023-12-26 03:43:50,854][123091] Updated weights for policy 0, policy_version 519149 (0.0008) [2023-12-26 03:43:50,914][123090] Updated weights for policy 1, policy_version 515464 (0.0010) [2023-12-26 03:43:50,986][123090] Updated weights for policy 1, policy_version 515474 (0.0011) [2023-12-26 03:43:51,053][123090] Updated weights for policy 1, policy_version 515484 (0.0010) [2023-12-26 03:43:51,730][123091] Updated weights for policy 0, policy_version 519159 (0.0009) [2023-12-26 03:43:51,793][123091] Updated weights for policy 0, policy_version 519169 (0.0007) [2023-12-26 03:43:51,852][123091] Updated weights for policy 0, policy_version 519179 (0.0006) [2023-12-26 03:43:51,888][123090] Updated weights for policy 1, policy_version 515494 (0.0009) [2023-12-26 03:43:51,956][123090] Updated weights for policy 1, policy_version 515504 (0.0010) [2023-12-26 03:43:52,025][123090] Updated weights for policy 1, policy_version 515514 (0.0006) [2023-12-26 03:43:52,568][123091] Updated weights for policy 0, policy_version 519189 (0.0009) [2023-12-26 03:43:52,626][123091] Updated weights for policy 0, policy_version 519199 (0.0009) [2023-12-26 03:43:52,677][123091] Updated weights for policy 0, policy_version 519209 (0.0009) [2023-12-26 03:43:52,752][123090] Updated weights for policy 1, policy_version 515524 (0.0007) [2023-12-26 03:43:52,813][123090] Updated weights for policy 1, policy_version 515534 (0.0010) [2023-12-26 03:43:52,872][123090] Updated weights for policy 1, policy_version 515544 (0.0010) [2023-12-26 03:43:53,488][123091] Updated weights for policy 0, policy_version 519219 (0.0009) [2023-12-26 03:43:53,553][123091] Updated weights for policy 0, policy_version 519229 (0.0010) [2023-12-26 03:43:53,619][123091] Updated weights for policy 0, policy_version 519239 (0.0009) [2023-12-26 03:43:53,684][123090] Updated weights for policy 1, policy_version 515554 (0.0010) [2023-12-26 03:43:53,742][123090] Updated weights for policy 1, policy_version 515564 (0.0010) [2023-12-26 03:43:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17772.6). Total num frames: 264912896. Throughput: 0: 9166.0, 1: 8439.3. Samples: 264889612. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:53,784][121949] Avg episode reward: [(0, '5933.055'), (1, '5517.397')] [2023-12-26 03:43:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000519248_132931584.pth... [2023-12-26 03:43:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000518160_132653056.pth [2023-12-26 03:43:53,797][123090] Updated weights for policy 1, policy_version 515574 (0.0010) [2023-12-26 03:43:53,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000515584_131989504.pth... [2023-12-26 03:43:53,848][123090] Updated weights for policy 1, policy_version 515584 (0.0009) [2023-12-26 03:43:53,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000514592_131735552.pth [2023-12-26 03:43:54,442][123091] Updated weights for policy 0, policy_version 519249 (0.0011) [2023-12-26 03:43:54,497][123091] Updated weights for policy 0, policy_version 519259 (0.0010) [2023-12-26 03:43:54,549][123091] Updated weights for policy 0, policy_version 519269 (0.0010) [2023-12-26 03:43:54,615][123091] Updated weights for policy 0, policy_version 519279 (0.0011) [2023-12-26 03:43:54,720][123090] Updated weights for policy 1, policy_version 515594 (0.0009) [2023-12-26 03:43:54,780][123090] Updated weights for policy 1, policy_version 515604 (0.0009) [2023-12-26 03:43:54,839][123090] Updated weights for policy 1, policy_version 515614 (0.0011) [2023-12-26 03:43:55,297][123091] Updated weights for policy 0, policy_version 519289 (0.0006) [2023-12-26 03:43:55,353][123091] Updated weights for policy 0, policy_version 519299 (0.0006) [2023-12-26 03:43:55,401][123091] Updated weights for policy 0, policy_version 519309 (0.0011) [2023-12-26 03:43:55,714][123090] Updated weights for policy 1, policy_version 515624 (0.0010) [2023-12-26 03:43:55,767][123090] Updated weights for policy 1, policy_version 515634 (0.0010) [2023-12-26 03:43:55,820][123090] Updated weights for policy 1, policy_version 515644 (0.0010) [2023-12-26 03:43:56,139][123091] Updated weights for policy 0, policy_version 519319 (0.0007) [2023-12-26 03:43:56,196][123091] Updated weights for policy 0, policy_version 519329 (0.0007) [2023-12-26 03:43:56,252][123091] Updated weights for policy 0, policy_version 519340 (0.0010) [2023-12-26 03:43:56,550][123090] Updated weights for policy 1, policy_version 515654 (0.0007) [2023-12-26 03:43:56,597][123090] Updated weights for policy 1, policy_version 515664 (0.0005) [2023-12-26 03:43:56,653][123090] Updated weights for policy 1, policy_version 515674 (0.0005) [2023-12-26 03:43:56,980][123091] Updated weights for policy 0, policy_version 519351 (0.0008) [2023-12-26 03:43:57,037][123091] Updated weights for policy 0, policy_version 519361 (0.0010) [2023-12-26 03:43:57,102][123091] Updated weights for policy 0, policy_version 519371 (0.0010) [2023-12-26 03:43:57,335][123090] Updated weights for policy 1, policy_version 515684 (0.0005) [2023-12-26 03:43:57,389][123090] Updated weights for policy 1, policy_version 515694 (0.0005) [2023-12-26 03:43:57,443][123090] Updated weights for policy 1, policy_version 515704 (0.0005) [2023-12-26 03:43:57,881][123091] Updated weights for policy 0, policy_version 519381 (0.0008) [2023-12-26 03:43:57,936][123091] Updated weights for policy 0, policy_version 519391 (0.0005) [2023-12-26 03:43:58,012][123091] Updated weights for policy 0, policy_version 519401 (0.0007) [2023-12-26 03:43:58,131][123090] Updated weights for policy 1, policy_version 515714 (0.0006) [2023-12-26 03:43:58,189][123090] Updated weights for policy 1, policy_version 515724 (0.0010) [2023-12-26 03:43:58,243][123090] Updated weights for policy 1, policy_version 515734 (0.0009) [2023-12-26 03:43:58,293][123090] Updated weights for policy 1, policy_version 515744 (0.0009) [2023-12-26 03:43:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 265003008. Throughput: 0: 9197.5, 1: 8527.1. Samples: 264998720. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:43:58,785][121949] Avg episode reward: [(0, '5912.737'), (1, '5598.495')] [2023-12-26 03:43:58,844][123091] Updated weights for policy 0, policy_version 519411 (0.0007) [2023-12-26 03:43:58,916][123091] Updated weights for policy 0, policy_version 519421 (0.0009) [2023-12-26 03:43:58,982][123091] Updated weights for policy 0, policy_version 519431 (0.0010) [2023-12-26 03:43:59,284][123090] Updated weights for policy 1, policy_version 515754 (0.0010) [2023-12-26 03:43:59,352][123090] Updated weights for policy 1, policy_version 515764 (0.0008) [2023-12-26 03:43:59,428][123090] Updated weights for policy 1, policy_version 515774 (0.0006) [2023-12-26 03:43:59,907][123091] Updated weights for policy 0, policy_version 519441 (0.0009) [2023-12-26 03:43:59,971][123091] Updated weights for policy 0, policy_version 519451 (0.0006) [2023-12-26 03:44:00,032][123091] Updated weights for policy 0, policy_version 519461 (0.0006) [2023-12-26 03:44:00,104][123091] Updated weights for policy 0, policy_version 519471 (0.0005) [2023-12-26 03:44:00,190][123090] Updated weights for policy 1, policy_version 515784 (0.0009) [2023-12-26 03:44:00,248][123090] Updated weights for policy 1, policy_version 515795 (0.0010) [2023-12-26 03:44:00,298][123090] Updated weights for policy 1, policy_version 515805 (0.0009) [2023-12-26 03:44:00,776][123091] Updated weights for policy 0, policy_version 519481 (0.0006) [2023-12-26 03:44:00,841][123091] Updated weights for policy 0, policy_version 519491 (0.0005) [2023-12-26 03:44:00,899][123091] Updated weights for policy 0, policy_version 519501 (0.0005) [2023-12-26 03:44:01,208][123090] Updated weights for policy 1, policy_version 515815 (0.0009) [2023-12-26 03:44:01,263][123090] Updated weights for policy 1, policy_version 515825 (0.0009) [2023-12-26 03:44:01,316][123090] Updated weights for policy 1, policy_version 515835 (0.0010) [2023-12-26 03:44:01,605][123091] Updated weights for policy 0, policy_version 519511 (0.0007) [2023-12-26 03:44:01,666][123091] Updated weights for policy 0, policy_version 519521 (0.0009) [2023-12-26 03:44:01,713][123091] Updated weights for policy 0, policy_version 519531 (0.0007) [2023-12-26 03:44:02,107][123090] Updated weights for policy 1, policy_version 515845 (0.0009) [2023-12-26 03:44:02,156][123090] Updated weights for policy 1, policy_version 515855 (0.0005) [2023-12-26 03:44:02,210][123090] Updated weights for policy 1, policy_version 515865 (0.0005) [2023-12-26 03:44:02,520][123091] Updated weights for policy 0, policy_version 519541 (0.0009) [2023-12-26 03:44:02,590][123091] Updated weights for policy 0, policy_version 519551 (0.0010) [2023-12-26 03:44:02,656][123091] Updated weights for policy 0, policy_version 519561 (0.0010) [2023-12-26 03:44:02,843][123090] Updated weights for policy 1, policy_version 515875 (0.0006) [2023-12-26 03:44:02,913][123090] Updated weights for policy 1, policy_version 515885 (0.0005) [2023-12-26 03:44:02,963][123090] Updated weights for policy 1, policy_version 515895 (0.0005) [2023-12-26 03:44:03,502][123091] Updated weights for policy 0, policy_version 519571 (0.0010) [2023-12-26 03:44:03,562][123091] Updated weights for policy 0, policy_version 519581 (0.0010) [2023-12-26 03:44:03,606][123090] Updated weights for policy 1, policy_version 515905 (0.0005) [2023-12-26 03:44:03,618][123091] Updated weights for policy 0, policy_version 519591 (0.0009) [2023-12-26 03:44:03,666][123090] Updated weights for policy 1, policy_version 515915 (0.0005) [2023-12-26 03:44:03,734][123090] Updated weights for policy 1, policy_version 515925 (0.0005) [2023-12-26 03:44:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 265093120. Throughput: 0: 9166.9, 1: 8539.6. Samples: 265105844. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:44:03,785][121949] Avg episode reward: [(0, '5831.331'), (1, '5508.486')] [2023-12-26 03:44:03,803][123090] Updated weights for policy 1, policy_version 515935 (0.0005) [2023-12-26 03:44:04,472][123091] Updated weights for policy 0, policy_version 519601 (0.0009) [2023-12-26 03:44:04,517][123090] Updated weights for policy 1, policy_version 515945 (0.0010) [2023-12-26 03:44:04,535][123091] Updated weights for policy 0, policy_version 519611 (0.0006) [2023-12-26 03:44:04,574][123090] Updated weights for policy 1, policy_version 515955 (0.0011) [2023-12-26 03:44:04,594][123091] Updated weights for policy 0, policy_version 519621 (0.0010) [2023-12-26 03:44:04,626][123090] Updated weights for policy 1, policy_version 515965 (0.0011) [2023-12-26 03:44:04,652][123091] Updated weights for policy 0, policy_version 519631 (0.0007) [2023-12-26 03:44:05,359][123091] Updated weights for policy 0, policy_version 519641 (0.0008) [2023-12-26 03:44:05,408][123091] Updated weights for policy 0, policy_version 519651 (0.0009) [2023-12-26 03:44:05,469][123091] Updated weights for policy 0, policy_version 519661 (0.0006) [2023-12-26 03:44:05,475][123090] Updated weights for policy 1, policy_version 515975 (0.0010) [2023-12-26 03:44:05,535][123090] Updated weights for policy 1, policy_version 515985 (0.0011) [2023-12-26 03:44:05,587][123090] Updated weights for policy 1, policy_version 515995 (0.0010) [2023-12-26 03:44:06,215][123091] Updated weights for policy 0, policy_version 519671 (0.0008) [2023-12-26 03:44:06,270][123091] Updated weights for policy 0, policy_version 519681 (0.0009) [2023-12-26 03:44:06,320][123091] Updated weights for policy 0, policy_version 519691 (0.0009) [2023-12-26 03:44:06,411][123090] Updated weights for policy 1, policy_version 516005 (0.0010) [2023-12-26 03:44:06,459][123090] Updated weights for policy 1, policy_version 516015 (0.0011) [2023-12-26 03:44:06,513][123090] Updated weights for policy 1, policy_version 516025 (0.0011) [2023-12-26 03:44:07,232][123091] Updated weights for policy 0, policy_version 519701 (0.0009) [2023-12-26 03:44:07,275][123090] Updated weights for policy 1, policy_version 516035 (0.0009) [2023-12-26 03:44:07,287][123091] Updated weights for policy 0, policy_version 519711 (0.0009) [2023-12-26 03:44:07,339][123090] Updated weights for policy 1, policy_version 516045 (0.0006) [2023-12-26 03:44:07,348][123091] Updated weights for policy 0, policy_version 519721 (0.0010) [2023-12-26 03:44:07,401][123090] Updated weights for policy 1, policy_version 516055 (0.0006) [2023-12-26 03:44:08,034][123091] Updated weights for policy 0, policy_version 519731 (0.0007) [2023-12-26 03:44:08,104][123091] Updated weights for policy 0, policy_version 519741 (0.0010) [2023-12-26 03:44:08,143][123090] Updated weights for policy 1, policy_version 516065 (0.0005) [2023-12-26 03:44:08,170][123091] Updated weights for policy 0, policy_version 519751 (0.0011) [2023-12-26 03:44:08,192][123090] Updated weights for policy 1, policy_version 516075 (0.0005) [2023-12-26 03:44:08,241][123090] Updated weights for policy 1, policy_version 516085 (0.0005) [2023-12-26 03:44:08,296][123090] Updated weights for policy 1, policy_version 516095 (0.0005) [2023-12-26 03:44:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 265183232. Throughput: 0: 9191.7, 1: 8576.3. Samples: 265159128. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:44:08,785][121949] Avg episode reward: [(0, '5735.489'), (1, '5504.344')] [2023-12-26 03:44:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000519760_133062656.pth... [2023-12-26 03:44:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000516096_132120576.pth... [2023-12-26 03:44:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000518704_132792320.pth [2023-12-26 03:44:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000515072_131858432.pth [2023-12-26 03:44:08,873][123091] Updated weights for policy 0, policy_version 519761 (0.0010) [2023-12-26 03:44:08,938][123091] Updated weights for policy 0, policy_version 519771 (0.0007) [2023-12-26 03:44:09,007][123091] Updated weights for policy 0, policy_version 519781 (0.0006) [2023-12-26 03:44:09,073][123090] Updated weights for policy 1, policy_version 516105 (0.0006) [2023-12-26 03:44:09,076][123091] Updated weights for policy 0, policy_version 519791 (0.0005) [2023-12-26 03:44:09,121][123090] Updated weights for policy 1, policy_version 516115 (0.0006) [2023-12-26 03:44:09,174][123090] Updated weights for policy 1, policy_version 516125 (0.0005) [2023-12-26 03:44:09,870][123091] Updated weights for policy 0, policy_version 519801 (0.0009) [2023-12-26 03:44:09,936][123091] Updated weights for policy 0, policy_version 519811 (0.0009) [2023-12-26 03:44:09,982][123090] Updated weights for policy 1, policy_version 516135 (0.0010) [2023-12-26 03:44:09,998][123091] Updated weights for policy 0, policy_version 519821 (0.0006) [2023-12-26 03:44:10,055][123090] Updated weights for policy 1, policy_version 516145 (0.0011) [2023-12-26 03:44:10,111][123090] Updated weights for policy 1, policy_version 516155 (0.0010) [2023-12-26 03:44:10,839][123091] Updated weights for policy 0, policy_version 519831 (0.0009) [2023-12-26 03:44:10,894][123091] Updated weights for policy 0, policy_version 519841 (0.0009) [2023-12-26 03:44:10,920][123090] Updated weights for policy 1, policy_version 516165 (0.0011) [2023-12-26 03:44:10,958][123091] Updated weights for policy 0, policy_version 519851 (0.0011) [2023-12-26 03:44:10,979][123090] Updated weights for policy 1, policy_version 516175 (0.0010) [2023-12-26 03:44:11,043][123090] Updated weights for policy 1, policy_version 516185 (0.0009) [2023-12-26 03:44:11,837][123090] Updated weights for policy 1, policy_version 516195 (0.0008) [2023-12-26 03:44:11,857][123091] Updated weights for policy 0, policy_version 519861 (0.0008) [2023-12-26 03:44:11,892][123090] Updated weights for policy 1, policy_version 516205 (0.0007) [2023-12-26 03:44:11,918][123091] Updated weights for policy 0, policy_version 519871 (0.0006) [2023-12-26 03:44:11,954][123090] Updated weights for policy 1, policy_version 516215 (0.0009) [2023-12-26 03:44:11,974][123091] Updated weights for policy 0, policy_version 519881 (0.0005) [2023-12-26 03:44:12,807][123090] Updated weights for policy 1, policy_version 516225 (0.0009) [2023-12-26 03:44:12,822][123091] Updated weights for policy 0, policy_version 519891 (0.0007) [2023-12-26 03:44:12,875][123090] Updated weights for policy 1, policy_version 516235 (0.0005) [2023-12-26 03:44:12,878][123091] Updated weights for policy 0, policy_version 519901 (0.0007) [2023-12-26 03:44:12,936][123090] Updated weights for policy 1, policy_version 516245 (0.0005) [2023-12-26 03:44:12,939][123091] Updated weights for policy 0, policy_version 519911 (0.0009) [2023-12-26 03:44:12,996][123090] Updated weights for policy 1, policy_version 516255 (0.0005) [2023-12-26 03:44:13,651][123091] Updated weights for policy 0, policy_version 519921 (0.0009) [2023-12-26 03:44:13,691][123090] Updated weights for policy 1, policy_version 516265 (0.0005) [2023-12-26 03:44:13,698][123091] Updated weights for policy 0, policy_version 519931 (0.0008) [2023-12-26 03:44:13,738][123090] Updated weights for policy 1, policy_version 516275 (0.0006) [2023-12-26 03:44:13,758][123091] Updated weights for policy 0, policy_version 519941 (0.0008) [2023-12-26 03:44:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 265265152. Throughput: 0: 9120.3, 1: 8700.6. Samples: 265265612. Policy #0 lag: (min: 15.0, avg: 23.2, max: 47.0) [2023-12-26 03:44:13,784][121949] Avg episode reward: [(0, '5768.757'), (1, '5727.498')] [2023-12-26 03:44:13,787][123090] Updated weights for policy 1, policy_version 516285 (0.0007) [2023-12-26 03:44:13,819][123091] Updated weights for policy 0, policy_version 519951 (0.0005) [2023-12-26 03:44:14,477][123090] Updated weights for policy 1, policy_version 516295 (0.0007) [2023-12-26 03:44:14,478][123091] Updated weights for policy 0, policy_version 519961 (0.0009) [2023-12-26 03:44:14,538][123090] Updated weights for policy 1, policy_version 516305 (0.0005) [2023-12-26 03:44:14,540][123091] Updated weights for policy 0, policy_version 519971 (0.0010) [2023-12-26 03:44:14,604][123091] Updated weights for policy 0, policy_version 519981 (0.0005) [2023-12-26 03:44:14,612][123090] Updated weights for policy 1, policy_version 516315 (0.0005) [2023-12-26 03:44:15,375][123091] Updated weights for policy 0, policy_version 519991 (0.0008) [2023-12-26 03:44:15,395][123090] Updated weights for policy 1, policy_version 516325 (0.0008) [2023-12-26 03:44:15,430][123091] Updated weights for policy 0, policy_version 520001 (0.0011) [2023-12-26 03:44:15,447][123090] Updated weights for policy 1, policy_version 516335 (0.0010) [2023-12-26 03:44:15,482][123091] Updated weights for policy 0, policy_version 520011 (0.0011) [2023-12-26 03:44:15,503][123090] Updated weights for policy 1, policy_version 516345 (0.0010) [2023-12-26 03:44:16,213][123091] Updated weights for policy 0, policy_version 520021 (0.0008) [2023-12-26 03:44:16,273][123091] Updated weights for policy 0, policy_version 520031 (0.0005) [2023-12-26 03:44:16,342][123091] Updated weights for policy 0, policy_version 520041 (0.0005) [2023-12-26 03:44:16,351][123090] Updated weights for policy 1, policy_version 516355 (0.0010) [2023-12-26 03:44:16,417][123090] Updated weights for policy 1, policy_version 516365 (0.0010) [2023-12-26 03:44:16,491][123090] Updated weights for policy 1, policy_version 516375 (0.0010) [2023-12-26 03:44:16,933][123091] Updated weights for policy 0, policy_version 520051 (0.0005) [2023-12-26 03:44:16,981][123091] Updated weights for policy 0, policy_version 520061 (0.0006) [2023-12-26 03:44:17,031][123091] Updated weights for policy 0, policy_version 520071 (0.0005) [2023-12-26 03:44:17,297][123090] Updated weights for policy 1, policy_version 516385 (0.0010) [2023-12-26 03:44:17,359][123090] Updated weights for policy 1, policy_version 516395 (0.0010) [2023-12-26 03:44:17,415][123090] Updated weights for policy 1, policy_version 516405 (0.0010) [2023-12-26 03:44:17,458][123090] Updated weights for policy 1, policy_version 516415 (0.0010) [2023-12-26 03:44:17,667][123091] Updated weights for policy 0, policy_version 520081 (0.0005) [2023-12-26 03:44:17,732][123091] Updated weights for policy 0, policy_version 520091 (0.0005) [2023-12-26 03:44:17,805][123091] Updated weights for policy 0, policy_version 520101 (0.0006) [2023-12-26 03:44:17,857][123091] Updated weights for policy 0, policy_version 520111 (0.0005) [2023-12-26 03:44:18,318][123090] Updated weights for policy 1, policy_version 516425 (0.0011) [2023-12-26 03:44:18,385][123090] Updated weights for policy 1, policy_version 516435 (0.0009) [2023-12-26 03:44:18,453][123090] Updated weights for policy 1, policy_version 516445 (0.0010) [2023-12-26 03:44:18,613][123091] Updated weights for policy 0, policy_version 520121 (0.0010) [2023-12-26 03:44:18,677][123091] Updated weights for policy 0, policy_version 520131 (0.0011) [2023-12-26 03:44:18,740][123091] Updated weights for policy 0, policy_version 520141 (0.0011) [2023-12-26 03:44:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 265371648. Throughput: 0: 9193.3, 1: 8745.7. Samples: 265378272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:18,785][121949] Avg episode reward: [(0, '5828.493'), (1, '5807.291')] [2023-12-26 03:44:19,238][123090] Updated weights for policy 1, policy_version 516455 (0.0010) [2023-12-26 03:44:19,297][123090] Updated weights for policy 1, policy_version 516465 (0.0009) [2023-12-26 03:44:19,365][123090] Updated weights for policy 1, policy_version 516475 (0.0008) [2023-12-26 03:44:19,569][123091] Updated weights for policy 0, policy_version 520151 (0.0011) [2023-12-26 03:44:19,616][123091] Updated weights for policy 0, policy_version 520161 (0.0010) [2023-12-26 03:44:19,668][123091] Updated weights for policy 0, policy_version 520171 (0.0011) [2023-12-26 03:44:20,167][123090] Updated weights for policy 1, policy_version 516485 (0.0008) [2023-12-26 03:44:20,230][123090] Updated weights for policy 1, policy_version 516495 (0.0008) [2023-12-26 03:44:20,300][123090] Updated weights for policy 1, policy_version 516505 (0.0008) [2023-12-26 03:44:20,546][123091] Updated weights for policy 0, policy_version 520181 (0.0011) [2023-12-26 03:44:20,618][123091] Updated weights for policy 0, policy_version 520191 (0.0009) [2023-12-26 03:44:20,685][123091] Updated weights for policy 0, policy_version 520201 (0.0010) [2023-12-26 03:44:21,103][123090] Updated weights for policy 1, policy_version 516515 (0.0008) [2023-12-26 03:44:21,176][123090] Updated weights for policy 1, policy_version 516525 (0.0008) [2023-12-26 03:44:21,249][123090] Updated weights for policy 1, policy_version 516535 (0.0006) [2023-12-26 03:44:21,526][123091] Updated weights for policy 0, policy_version 520211 (0.0009) [2023-12-26 03:44:21,595][123091] Updated weights for policy 0, policy_version 520221 (0.0010) [2023-12-26 03:44:21,668][123091] Updated weights for policy 0, policy_version 520231 (0.0008) [2023-12-26 03:44:22,044][123090] Updated weights for policy 1, policy_version 516545 (0.0008) [2023-12-26 03:44:22,123][123090] Updated weights for policy 1, policy_version 516555 (0.0006) [2023-12-26 03:44:22,191][123090] Updated weights for policy 1, policy_version 516565 (0.0008) [2023-12-26 03:44:22,257][123090] Updated weights for policy 1, policy_version 516575 (0.0009) [2023-12-26 03:44:22,505][123091] Updated weights for policy 0, policy_version 520241 (0.0007) [2023-12-26 03:44:22,556][123091] Updated weights for policy 0, policy_version 520251 (0.0009) [2023-12-26 03:44:22,620][123091] Updated weights for policy 0, policy_version 520261 (0.0010) [2023-12-26 03:44:22,685][123091] Updated weights for policy 0, policy_version 520271 (0.0009) [2023-12-26 03:44:23,012][123090] Updated weights for policy 1, policy_version 516585 (0.0010) [2023-12-26 03:44:23,064][123090] Updated weights for policy 1, policy_version 516595 (0.0009) [2023-12-26 03:44:23,136][123090] Updated weights for policy 1, policy_version 516605 (0.0005) [2023-12-26 03:44:23,559][123091] Updated weights for policy 0, policy_version 520281 (0.0010) [2023-12-26 03:44:23,617][123091] Updated weights for policy 0, policy_version 520291 (0.0010) [2023-12-26 03:44:23,670][123091] Updated weights for policy 0, policy_version 520301 (0.0009) [2023-12-26 03:44:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 265453568. Throughput: 0: 9106.5, 1: 8785.9. Samples: 265429964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:23,784][121949] Avg episode reward: [(0, '5831.033'), (1, '5773.293')] [2023-12-26 03:44:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000516608_132251648.pth... [2023-12-26 03:44:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000520304_133201920.pth... [2023-12-26 03:44:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000519248_132931584.pth [2023-12-26 03:44:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000515584_131989504.pth [2023-12-26 03:44:23,854][123090] Updated weights for policy 1, policy_version 516615 (0.0005) [2023-12-26 03:44:23,905][123090] Updated weights for policy 1, policy_version 516625 (0.0005) [2023-12-26 03:44:23,958][123090] Updated weights for policy 1, policy_version 516635 (0.0005) [2023-12-26 03:44:24,572][123091] Updated weights for policy 0, policy_version 520311 (0.0010) [2023-12-26 03:44:24,616][123090] Updated weights for policy 1, policy_version 516645 (0.0007) [2023-12-26 03:44:24,633][123091] Updated weights for policy 0, policy_version 520321 (0.0009) [2023-12-26 03:44:24,679][123090] Updated weights for policy 1, policy_version 516655 (0.0007) [2023-12-26 03:44:24,695][123091] Updated weights for policy 0, policy_version 520331 (0.0010) [2023-12-26 03:44:24,742][123090] Updated weights for policy 1, policy_version 516665 (0.0010) [2023-12-26 03:44:25,515][123090] Updated weights for policy 1, policy_version 516675 (0.0009) [2023-12-26 03:44:25,546][123091] Updated weights for policy 0, policy_version 520341 (0.0008) [2023-12-26 03:44:25,577][123090] Updated weights for policy 1, policy_version 516685 (0.0008) [2023-12-26 03:44:25,592][123091] Updated weights for policy 0, policy_version 520351 (0.0009) [2023-12-26 03:44:25,639][123090] Updated weights for policy 1, policy_version 516695 (0.0008) [2023-12-26 03:44:25,654][123091] Updated weights for policy 0, policy_version 520361 (0.0008) [2023-12-26 03:44:26,472][123090] Updated weights for policy 1, policy_version 516705 (0.0009) [2023-12-26 03:44:26,488][123091] Updated weights for policy 0, policy_version 520371 (0.0010) [2023-12-26 03:44:26,526][123090] Updated weights for policy 1, policy_version 516715 (0.0008) [2023-12-26 03:44:26,547][123091] Updated weights for policy 0, policy_version 520381 (0.0007) [2023-12-26 03:44:26,579][123090] Updated weights for policy 1, policy_version 516725 (0.0008) [2023-12-26 03:44:26,607][123091] Updated weights for policy 0, policy_version 520391 (0.0008) [2023-12-26 03:44:26,630][123090] Updated weights for policy 1, policy_version 516735 (0.0007) [2023-12-26 03:44:27,304][123090] Updated weights for policy 1, policy_version 516745 (0.0006) [2023-12-26 03:44:27,356][123090] Updated weights for policy 1, policy_version 516755 (0.0005) [2023-12-26 03:44:27,374][123091] Updated weights for policy 0, policy_version 520401 (0.0008) [2023-12-26 03:44:27,418][123090] Updated weights for policy 1, policy_version 516765 (0.0008) [2023-12-26 03:44:27,429][123091] Updated weights for policy 0, policy_version 520411 (0.0006) [2023-12-26 03:44:27,476][123091] Updated weights for policy 0, policy_version 520421 (0.0005) [2023-12-26 03:44:27,527][123091] Updated weights for policy 0, policy_version 520431 (0.0005) [2023-12-26 03:44:28,152][123090] Updated weights for policy 1, policy_version 516775 (0.0010) [2023-12-26 03:44:28,206][123090] Updated weights for policy 1, policy_version 516785 (0.0009) [2023-12-26 03:44:28,230][123091] Updated weights for policy 0, policy_version 520441 (0.0005) [2023-12-26 03:44:28,261][123090] Updated weights for policy 1, policy_version 516795 (0.0007) [2023-12-26 03:44:28,289][123091] Updated weights for policy 0, policy_version 520451 (0.0006) [2023-12-26 03:44:28,347][123091] Updated weights for policy 0, policy_version 520461 (0.0007) [2023-12-26 03:44:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 265543680. Throughput: 0: 9032.8, 1: 8935.1. Samples: 265536512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:28,785][121949] Avg episode reward: [(0, '5904.444'), (1, '5703.632')] [2023-12-26 03:44:29,008][123091] Updated weights for policy 0, policy_version 520471 (0.0006) [2023-12-26 03:44:29,078][123091] Updated weights for policy 0, policy_version 520481 (0.0006) [2023-12-26 03:44:29,126][123090] Updated weights for policy 1, policy_version 516805 (0.0010) [2023-12-26 03:44:29,140][123091] Updated weights for policy 0, policy_version 520491 (0.0010) [2023-12-26 03:44:29,184][123090] Updated weights for policy 1, policy_version 516815 (0.0010) [2023-12-26 03:44:29,255][123090] Updated weights for policy 1, policy_version 516825 (0.0009) [2023-12-26 03:44:29,823][123091] Updated weights for policy 0, policy_version 520501 (0.0011) [2023-12-26 03:44:29,896][123091] Updated weights for policy 0, policy_version 520511 (0.0011) [2023-12-26 03:44:29,969][123091] Updated weights for policy 0, policy_version 520521 (0.0011) [2023-12-26 03:44:30,072][123090] Updated weights for policy 1, policy_version 516835 (0.0009) [2023-12-26 03:44:30,129][123090] Updated weights for policy 1, policy_version 516845 (0.0006) [2023-12-26 03:44:30,202][123090] Updated weights for policy 1, policy_version 516855 (0.0006) [2023-12-26 03:44:30,804][123091] Updated weights for policy 0, policy_version 520531 (0.0009) [2023-12-26 03:44:30,864][123091] Updated weights for policy 0, policy_version 520541 (0.0005) [2023-12-26 03:44:30,871][123090] Updated weights for policy 1, policy_version 516865 (0.0006) [2023-12-26 03:44:30,919][123090] Updated weights for policy 1, policy_version 516875 (0.0005) [2023-12-26 03:44:30,921][123091] Updated weights for policy 0, policy_version 520551 (0.0008) [2023-12-26 03:44:30,970][123090] Updated weights for policy 1, policy_version 516885 (0.0005) [2023-12-26 03:44:31,022][123090] Updated weights for policy 1, policy_version 516895 (0.0005) [2023-12-26 03:44:31,705][123091] Updated weights for policy 0, policy_version 520561 (0.0010) [2023-12-26 03:44:31,776][123091] Updated weights for policy 0, policy_version 520571 (0.0010) [2023-12-26 03:44:31,818][123090] Updated weights for policy 1, policy_version 516905 (0.0009) [2023-12-26 03:44:31,839][123091] Updated weights for policy 0, policy_version 520581 (0.0008) [2023-12-26 03:44:31,881][123090] Updated weights for policy 1, policy_version 516915 (0.0008) [2023-12-26 03:44:31,899][123091] Updated weights for policy 0, policy_version 520591 (0.0010) [2023-12-26 03:44:31,942][123090] Updated weights for policy 1, policy_version 516925 (0.0008) [2023-12-26 03:44:32,649][123091] Updated weights for policy 0, policy_version 520601 (0.0007) [2023-12-26 03:44:32,720][123091] Updated weights for policy 0, policy_version 520611 (0.0005) [2023-12-26 03:44:32,720][123090] Updated weights for policy 1, policy_version 516935 (0.0006) [2023-12-26 03:44:32,769][123090] Updated weights for policy 1, policy_version 516945 (0.0005) [2023-12-26 03:44:32,791][123091] Updated weights for policy 0, policy_version 520621 (0.0006) [2023-12-26 03:44:32,828][123090] Updated weights for policy 1, policy_version 516955 (0.0005) [2023-12-26 03:44:33,490][123090] Updated weights for policy 1, policy_version 516965 (0.0007) [2023-12-26 03:44:33,535][123091] Updated weights for policy 0, policy_version 520631 (0.0011) [2023-12-26 03:44:33,544][123090] Updated weights for policy 1, policy_version 516975 (0.0006) [2023-12-26 03:44:33,585][123091] Updated weights for policy 0, policy_version 520641 (0.0010) [2023-12-26 03:44:33,597][123090] Updated weights for policy 1, policy_version 516985 (0.0005) [2023-12-26 03:44:33,637][123091] Updated weights for policy 0, policy_version 520651 (0.0010) [2023-12-26 03:44:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 265641984. Throughput: 0: 9013.5, 1: 9039.0. Samples: 265648304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:33,784][121949] Avg episode reward: [(0, '5835.922'), (1, '5744.794')] [2023-12-26 03:44:34,230][123090] Updated weights for policy 1, policy_version 516995 (0.0005) [2023-12-26 03:44:34,294][123090] Updated weights for policy 1, policy_version 517005 (0.0005) [2023-12-26 03:44:34,364][123090] Updated weights for policy 1, policy_version 517015 (0.0006) [2023-12-26 03:44:34,426][123091] Updated weights for policy 0, policy_version 520661 (0.0006) [2023-12-26 03:44:34,506][123091] Updated weights for policy 0, policy_version 520671 (0.0006) [2023-12-26 03:44:34,578][123091] Updated weights for policy 0, policy_version 520681 (0.0006) [2023-12-26 03:44:35,106][123090] Updated weights for policy 1, policy_version 517025 (0.0005) [2023-12-26 03:44:35,168][123090] Updated weights for policy 1, policy_version 517035 (0.0005) [2023-12-26 03:44:35,194][123091] Updated weights for policy 0, policy_version 520691 (0.0007) [2023-12-26 03:44:35,236][123090] Updated weights for policy 1, policy_version 517045 (0.0006) [2023-12-26 03:44:35,261][123091] Updated weights for policy 0, policy_version 520701 (0.0011) [2023-12-26 03:44:35,297][123090] Updated weights for policy 1, policy_version 517055 (0.0010) [2023-12-26 03:44:35,315][123091] Updated weights for policy 0, policy_version 520711 (0.0010) [2023-12-26 03:44:36,080][123090] Updated weights for policy 1, policy_version 517065 (0.0008) [2023-12-26 03:44:36,148][123090] Updated weights for policy 1, policy_version 517075 (0.0008) [2023-12-26 03:44:36,155][123091] Updated weights for policy 0, policy_version 520721 (0.0010) [2023-12-26 03:44:36,206][123091] Updated weights for policy 0, policy_version 520731 (0.0010) [2023-12-26 03:44:36,210][123090] Updated weights for policy 1, policy_version 517085 (0.0007) [2023-12-26 03:44:36,261][123091] Updated weights for policy 0, policy_version 520741 (0.0010) [2023-12-26 03:44:36,316][123091] Updated weights for policy 0, policy_version 520752 (0.0010) [2023-12-26 03:44:36,915][123090] Updated weights for policy 1, policy_version 517095 (0.0009) [2023-12-26 03:44:36,968][123090] Updated weights for policy 1, policy_version 517105 (0.0010) [2023-12-26 03:44:37,027][123090] Updated weights for policy 1, policy_version 517115 (0.0005) [2023-12-26 03:44:37,215][123091] Updated weights for policy 0, policy_version 520762 (0.0009) [2023-12-26 03:44:37,272][123091] Updated weights for policy 0, policy_version 520772 (0.0009) [2023-12-26 03:44:37,326][123091] Updated weights for policy 0, policy_version 520782 (0.0010) [2023-12-26 03:44:37,789][123090] Updated weights for policy 1, policy_version 517125 (0.0008) [2023-12-26 03:44:37,860][123090] Updated weights for policy 1, policy_version 517135 (0.0011) [2023-12-26 03:44:37,923][123090] Updated weights for policy 1, policy_version 517145 (0.0011) [2023-12-26 03:44:38,116][123091] Updated weights for policy 0, policy_version 520792 (0.0009) [2023-12-26 03:44:38,181][123091] Updated weights for policy 0, policy_version 520802 (0.0007) [2023-12-26 03:44:38,235][123091] Updated weights for policy 0, policy_version 520812 (0.0005) [2023-12-26 03:44:38,753][123090] Updated weights for policy 1, policy_version 517155 (0.0011) [2023-12-26 03:44:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 265723904. Throughput: 0: 9010.0, 1: 9081.3. Samples: 265703720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:38,785][121949] Avg episode reward: [(0, '5871.115'), (1, '5863.838')] [2023-12-26 03:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000520816_133332992.pth... [2023-12-26 03:44:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000519760_133062656.pth [2023-12-26 03:44:38,806][123090] Updated weights for policy 1, policy_version 517165 (0.0010) [2023-12-26 03:44:38,862][123090] Updated weights for policy 1, policy_version 517175 (0.0010) [2023-12-26 03:44:38,923][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000517184_132399104.pth... [2023-12-26 03:44:38,927][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000516096_132120576.pth [2023-12-26 03:44:39,036][123091] Updated weights for policy 0, policy_version 520822 (0.0008) [2023-12-26 03:44:39,085][123091] Updated weights for policy 0, policy_version 520832 (0.0009) [2023-12-26 03:44:39,135][123091] Updated weights for policy 0, policy_version 520842 (0.0009) [2023-12-26 03:44:39,703][123090] Updated weights for policy 1, policy_version 517185 (0.0011) [2023-12-26 03:44:39,771][123090] Updated weights for policy 1, policy_version 517195 (0.0011) [2023-12-26 03:44:39,834][123090] Updated weights for policy 1, policy_version 517205 (0.0011) [2023-12-26 03:44:39,898][123090] Updated weights for policy 1, policy_version 517215 (0.0010) [2023-12-26 03:44:40,088][123091] Updated weights for policy 0, policy_version 520853 (0.0010) [2023-12-26 03:44:40,153][123091] Updated weights for policy 0, policy_version 520863 (0.0009) [2023-12-26 03:44:40,218][123091] Updated weights for policy 0, policy_version 520873 (0.0009) [2023-12-26 03:44:40,691][123090] Updated weights for policy 1, policy_version 517225 (0.0009) [2023-12-26 03:44:40,745][123090] Updated weights for policy 1, policy_version 517235 (0.0010) [2023-12-26 03:44:40,808][123090] Updated weights for policy 1, policy_version 517245 (0.0010) [2023-12-26 03:44:41,071][123091] Updated weights for policy 0, policy_version 520883 (0.0009) [2023-12-26 03:44:41,138][123091] Updated weights for policy 0, policy_version 520893 (0.0011) [2023-12-26 03:44:41,208][123091] Updated weights for policy 0, policy_version 520903 (0.0008) [2023-12-26 03:44:41,629][123090] Updated weights for policy 1, policy_version 517255 (0.0009) [2023-12-26 03:44:41,703][123090] Updated weights for policy 1, policy_version 517265 (0.0007) [2023-12-26 03:44:41,768][123090] Updated weights for policy 1, policy_version 517275 (0.0007) [2023-12-26 03:44:42,020][123091] Updated weights for policy 0, policy_version 520913 (0.0008) [2023-12-26 03:44:42,085][123091] Updated weights for policy 0, policy_version 520923 (0.0011) [2023-12-26 03:44:42,145][123091] Updated weights for policy 0, policy_version 520933 (0.0011) [2023-12-26 03:44:42,213][123091] Updated weights for policy 0, policy_version 520943 (0.0011) [2023-12-26 03:44:42,568][123090] Updated weights for policy 1, policy_version 517285 (0.0007) [2023-12-26 03:44:42,629][123090] Updated weights for policy 1, policy_version 517295 (0.0009) [2023-12-26 03:44:42,689][123090] Updated weights for policy 1, policy_version 517305 (0.0009) [2023-12-26 03:44:43,007][123091] Updated weights for policy 0, policy_version 520953 (0.0006) [2023-12-26 03:44:43,051][123091] Updated weights for policy 0, policy_version 520963 (0.0005) [2023-12-26 03:44:43,096][123091] Updated weights for policy 0, policy_version 520973 (0.0005) [2023-12-26 03:44:43,418][123090] Updated weights for policy 1, policy_version 517315 (0.0005) [2023-12-26 03:44:43,472][123090] Updated weights for policy 1, policy_version 517325 (0.0005) [2023-12-26 03:44:43,539][123090] Updated weights for policy 1, policy_version 517335 (0.0005) [2023-12-26 03:44:43,761][123091] Updated weights for policy 0, policy_version 520983 (0.0005) [2023-12-26 03:44:43,784][121949] Fps is (10 sec: 17202.4, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 265814016. Throughput: 0: 8912.5, 1: 9033.6. Samples: 265806304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:43,786][121949] Avg episode reward: [(0, '6022.375'), (1, '5853.616')] [2023-12-26 03:44:43,806][123091] Updated weights for policy 0, policy_version 520993 (0.0005) [2023-12-26 03:44:43,857][123091] Updated weights for policy 0, policy_version 521003 (0.0005) [2023-12-26 03:44:44,240][123090] Updated weights for policy 1, policy_version 517345 (0.0006) [2023-12-26 03:44:44,292][123090] Updated weights for policy 1, policy_version 517355 (0.0010) [2023-12-26 03:44:44,340][123090] Updated weights for policy 1, policy_version 517365 (0.0010) [2023-12-26 03:44:44,392][123090] Updated weights for policy 1, policy_version 517375 (0.0010) [2023-12-26 03:44:44,487][123091] Updated weights for policy 0, policy_version 521013 (0.0005) [2023-12-26 03:44:44,557][123091] Updated weights for policy 0, policy_version 521023 (0.0005) [2023-12-26 03:44:44,632][123091] Updated weights for policy 0, policy_version 521033 (0.0009) [2023-12-26 03:44:45,213][123090] Updated weights for policy 1, policy_version 517385 (0.0006) [2023-12-26 03:44:45,292][123090] Updated weights for policy 1, policy_version 517395 (0.0005) [2023-12-26 03:44:45,325][123091] Updated weights for policy 0, policy_version 521043 (0.0009) [2023-12-26 03:44:45,346][123090] Updated weights for policy 1, policy_version 517405 (0.0005) [2023-12-26 03:44:45,390][123091] Updated weights for policy 0, policy_version 521053 (0.0006) [2023-12-26 03:44:45,456][123091] Updated weights for policy 0, policy_version 521063 (0.0006) [2023-12-26 03:44:46,055][123090] Updated weights for policy 1, policy_version 517415 (0.0009) [2023-12-26 03:44:46,103][123090] Updated weights for policy 1, policy_version 517425 (0.0010) [2023-12-26 03:44:46,159][123090] Updated weights for policy 1, policy_version 517435 (0.0010) [2023-12-26 03:44:46,170][123091] Updated weights for policy 0, policy_version 521073 (0.0006) [2023-12-26 03:44:46,236][123091] Updated weights for policy 0, policy_version 521083 (0.0009) [2023-12-26 03:44:46,288][123091] Updated weights for policy 0, policy_version 521093 (0.0009) [2023-12-26 03:44:46,336][123091] Updated weights for policy 0, policy_version 521103 (0.0009) [2023-12-26 03:44:47,018][123090] Updated weights for policy 1, policy_version 517445 (0.0010) [2023-12-26 03:44:47,066][123090] Updated weights for policy 1, policy_version 517455 (0.0010) [2023-12-26 03:44:47,130][123091] Updated weights for policy 0, policy_version 521113 (0.0006) [2023-12-26 03:44:47,133][123090] Updated weights for policy 1, policy_version 517465 (0.0010) [2023-12-26 03:44:47,182][123091] Updated weights for policy 0, policy_version 521123 (0.0005) [2023-12-26 03:44:47,235][123091] Updated weights for policy 0, policy_version 521133 (0.0005) [2023-12-26 03:44:47,833][123090] Updated weights for policy 1, policy_version 517475 (0.0010) [2023-12-26 03:44:47,875][123091] Updated weights for policy 0, policy_version 521143 (0.0005) [2023-12-26 03:44:47,881][123090] Updated weights for policy 1, policy_version 517485 (0.0010) [2023-12-26 03:44:47,929][123090] Updated weights for policy 1, policy_version 517495 (0.0010) [2023-12-26 03:44:47,938][123091] Updated weights for policy 0, policy_version 521153 (0.0007) [2023-12-26 03:44:47,995][123091] Updated weights for policy 0, policy_version 521163 (0.0005) [2023-12-26 03:44:48,678][123091] Updated weights for policy 0, policy_version 521173 (0.0008) [2023-12-26 03:44:48,741][123091] Updated weights for policy 0, policy_version 521183 (0.0011) [2023-12-26 03:44:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 265904128. Throughput: 0: 9071.0, 1: 9059.6. Samples: 265921716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:48,785][121949] Avg episode reward: [(0, '6160.294'), (1, '5753.667')] [2023-12-26 03:44:48,790][123090] Updated weights for policy 1, policy_version 517505 (0.0010) [2023-12-26 03:44:48,804][123091] Updated weights for policy 0, policy_version 521193 (0.0010) [2023-12-26 03:44:48,854][123090] Updated weights for policy 1, policy_version 517515 (0.0011) [2023-12-26 03:44:48,917][123090] Updated weights for policy 1, policy_version 517525 (0.0010) [2023-12-26 03:44:48,985][123090] Updated weights for policy 1, policy_version 517535 (0.0011) [2023-12-26 03:44:49,588][123091] Updated weights for policy 0, policy_version 521203 (0.0009) [2023-12-26 03:44:49,654][123091] Updated weights for policy 0, policy_version 521213 (0.0005) [2023-12-26 03:44:49,715][123091] Updated weights for policy 0, policy_version 521223 (0.0009) [2023-12-26 03:44:49,819][123090] Updated weights for policy 1, policy_version 517545 (0.0010) [2023-12-26 03:44:49,884][123090] Updated weights for policy 1, policy_version 517555 (0.0008) [2023-12-26 03:44:49,950][123090] Updated weights for policy 1, policy_version 517565 (0.0008) [2023-12-26 03:44:50,525][123091] Updated weights for policy 0, policy_version 521233 (0.0010) [2023-12-26 03:44:50,597][123091] Updated weights for policy 0, policy_version 521243 (0.0010) [2023-12-26 03:44:50,657][123091] Updated weights for policy 0, policy_version 521253 (0.0006) [2023-12-26 03:44:50,713][123091] Updated weights for policy 0, policy_version 521263 (0.0005) [2023-12-26 03:44:50,769][123090] Updated weights for policy 1, policy_version 517575 (0.0009) [2023-12-26 03:44:50,833][123090] Updated weights for policy 1, policy_version 517585 (0.0005) [2023-12-26 03:44:50,901][123090] Updated weights for policy 1, policy_version 517595 (0.0005) [2023-12-26 03:44:51,479][123091] Updated weights for policy 0, policy_version 521273 (0.0010) [2023-12-26 03:44:51,538][123091] Updated weights for policy 0, policy_version 521283 (0.0011) [2023-12-26 03:44:51,603][123091] Updated weights for policy 0, policy_version 521293 (0.0009) [2023-12-26 03:44:51,706][123090] Updated weights for policy 1, policy_version 517605 (0.0007) [2023-12-26 03:44:51,779][123090] Updated weights for policy 1, policy_version 517615 (0.0009) [2023-12-26 03:44:51,847][123090] Updated weights for policy 1, policy_version 517625 (0.0007) [2023-12-26 03:44:52,380][123091] Updated weights for policy 0, policy_version 521303 (0.0007) [2023-12-26 03:44:52,449][123091] Updated weights for policy 0, policy_version 521313 (0.0008) [2023-12-26 03:44:52,517][123091] Updated weights for policy 0, policy_version 521323 (0.0008) [2023-12-26 03:44:52,621][123090] Updated weights for policy 1, policy_version 517635 (0.0008) [2023-12-26 03:44:52,674][123090] Updated weights for policy 1, policy_version 517645 (0.0005) [2023-12-26 03:44:52,725][123090] Updated weights for policy 1, policy_version 517655 (0.0005) [2023-12-26 03:44:53,273][123091] Updated weights for policy 0, policy_version 521333 (0.0009) [2023-12-26 03:44:53,338][123091] Updated weights for policy 0, policy_version 521343 (0.0009) [2023-12-26 03:44:53,365][123090] Updated weights for policy 1, policy_version 517665 (0.0006) [2023-12-26 03:44:53,404][123091] Updated weights for policy 0, policy_version 521353 (0.0007) [2023-12-26 03:44:53,419][123090] Updated weights for policy 1, policy_version 517675 (0.0007) [2023-12-26 03:44:53,475][123090] Updated weights for policy 1, policy_version 517685 (0.0006) [2023-12-26 03:44:53,531][123090] Updated weights for policy 1, policy_version 517695 (0.0005) [2023-12-26 03:44:53,784][121949] Fps is (10 sec: 18842.5, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 266002432. Throughput: 0: 9067.5, 1: 9036.0. Samples: 265973780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:53,784][121949] Avg episode reward: [(0, '6137.578'), (1, '5675.843')] [2023-12-26 03:44:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000521360_133472256.pth... [2023-12-26 03:44:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000517696_132530176.pth... [2023-12-26 03:44:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000516608_132251648.pth [2023-12-26 03:44:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000520304_133201920.pth [2023-12-26 03:44:54,211][123091] Updated weights for policy 0, policy_version 521363 (0.0008) [2023-12-26 03:44:54,244][123090] Updated weights for policy 1, policy_version 517705 (0.0008) [2023-12-26 03:44:54,268][123091] Updated weights for policy 0, policy_version 521373 (0.0005) [2023-12-26 03:44:54,293][123090] Updated weights for policy 1, policy_version 517715 (0.0008) [2023-12-26 03:44:54,318][123091] Updated weights for policy 0, policy_version 521383 (0.0006) [2023-12-26 03:44:54,344][123090] Updated weights for policy 1, policy_version 517725 (0.0008) [2023-12-26 03:44:54,920][123091] Updated weights for policy 0, policy_version 521393 (0.0008) [2023-12-26 03:44:54,976][123091] Updated weights for policy 0, policy_version 521403 (0.0011) [2023-12-26 03:44:55,035][123091] Updated weights for policy 0, policy_version 521413 (0.0011) [2023-12-26 03:44:55,098][123091] Updated weights for policy 0, policy_version 521423 (0.0011) [2023-12-26 03:44:55,257][123090] Updated weights for policy 1, policy_version 517735 (0.0009) [2023-12-26 03:44:55,310][123090] Updated weights for policy 1, policy_version 517745 (0.0008) [2023-12-26 03:44:55,374][123090] Updated weights for policy 1, policy_version 517755 (0.0009) [2023-12-26 03:44:55,926][123091] Updated weights for policy 0, policy_version 521433 (0.0011) [2023-12-26 03:44:55,992][123091] Updated weights for policy 0, policy_version 521443 (0.0011) [2023-12-26 03:44:56,058][123091] Updated weights for policy 0, policy_version 521453 (0.0010) [2023-12-26 03:44:56,223][123090] Updated weights for policy 1, policy_version 517765 (0.0009) [2023-12-26 03:44:56,275][123090] Updated weights for policy 1, policy_version 517775 (0.0009) [2023-12-26 03:44:56,339][123090] Updated weights for policy 1, policy_version 517785 (0.0008) [2023-12-26 03:44:56,869][123091] Updated weights for policy 0, policy_version 521463 (0.0011) [2023-12-26 03:44:56,921][123091] Updated weights for policy 0, policy_version 521473 (0.0011) [2023-12-26 03:44:56,980][123091] Updated weights for policy 0, policy_version 521483 (0.0011) [2023-12-26 03:44:57,173][123090] Updated weights for policy 1, policy_version 517795 (0.0009) [2023-12-26 03:44:57,232][123090] Updated weights for policy 1, policy_version 517805 (0.0009) [2023-12-26 03:44:57,289][123090] Updated weights for policy 1, policy_version 517815 (0.0009) [2023-12-26 03:44:57,817][123091] Updated weights for policy 0, policy_version 521493 (0.0010) [2023-12-26 03:44:57,864][123091] Updated weights for policy 0, policy_version 521503 (0.0010) [2023-12-26 03:44:57,915][123091] Updated weights for policy 0, policy_version 521513 (0.0010) [2023-12-26 03:44:58,131][123090] Updated weights for policy 1, policy_version 517825 (0.0009) [2023-12-26 03:44:58,198][123090] Updated weights for policy 1, policy_version 517835 (0.0008) [2023-12-26 03:44:58,263][123090] Updated weights for policy 1, policy_version 517845 (0.0009) [2023-12-26 03:44:58,334][123090] Updated weights for policy 1, policy_version 517856 (0.0009) [2023-12-26 03:44:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 266084352. Throughput: 0: 9106.1, 1: 9013.8. Samples: 266081008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:44:58,785][121949] Avg episode reward: [(0, '5984.654'), (1, '5786.226')] [2023-12-26 03:44:58,849][123091] Updated weights for policy 0, policy_version 521523 (0.0010) [2023-12-26 03:44:58,919][123091] Updated weights for policy 0, policy_version 521533 (0.0008) [2023-12-26 03:44:58,993][123091] Updated weights for policy 0, policy_version 521543 (0.0008) [2023-12-26 03:44:59,224][123090] Updated weights for policy 1, policy_version 517866 (0.0007) [2023-12-26 03:44:59,294][123090] Updated weights for policy 1, policy_version 517876 (0.0007) [2023-12-26 03:44:59,359][123090] Updated weights for policy 1, policy_version 517886 (0.0007) [2023-12-26 03:44:59,753][123091] Updated weights for policy 0, policy_version 521553 (0.0010) [2023-12-26 03:44:59,818][123091] Updated weights for policy 0, policy_version 521563 (0.0007) [2023-12-26 03:44:59,885][123091] Updated weights for policy 0, policy_version 521573 (0.0006) [2023-12-26 03:44:59,946][123091] Updated weights for policy 0, policy_version 521583 (0.0007) [2023-12-26 03:45:00,060][123090] Updated weights for policy 1, policy_version 517896 (0.0006) [2023-12-26 03:45:00,113][123090] Updated weights for policy 1, policy_version 517906 (0.0007) [2023-12-26 03:45:00,164][123090] Updated weights for policy 1, policy_version 517916 (0.0007) [2023-12-26 03:45:00,627][123091] Updated weights for policy 0, policy_version 521594 (0.0009) [2023-12-26 03:45:00,688][123091] Updated weights for policy 0, policy_version 521604 (0.0010) [2023-12-26 03:45:00,754][123091] Updated weights for policy 0, policy_version 521614 (0.0011) [2023-12-26 03:45:01,051][123090] Updated weights for policy 1, policy_version 517926 (0.0010) [2023-12-26 03:45:01,126][123090] Updated weights for policy 1, policy_version 517936 (0.0009) [2023-12-26 03:45:01,192][123090] Updated weights for policy 1, policy_version 517946 (0.0010) [2023-12-26 03:45:01,501][123091] Updated weights for policy 0, policy_version 521624 (0.0007) [2023-12-26 03:45:01,569][123091] Updated weights for policy 0, policy_version 521634 (0.0006) [2023-12-26 03:45:01,643][123091] Updated weights for policy 0, policy_version 521644 (0.0007) [2023-12-26 03:45:01,965][123090] Updated weights for policy 1, policy_version 517956 (0.0008) [2023-12-26 03:45:02,026][123090] Updated weights for policy 1, policy_version 517966 (0.0005) [2023-12-26 03:45:02,080][123090] Updated weights for policy 1, policy_version 517976 (0.0008) [2023-12-26 03:45:02,227][123091] Updated weights for policy 0, policy_version 521654 (0.0006) [2023-12-26 03:45:02,286][123091] Updated weights for policy 0, policy_version 521664 (0.0007) [2023-12-26 03:45:02,355][123091] Updated weights for policy 0, policy_version 521674 (0.0006) [2023-12-26 03:45:02,824][123090] Updated weights for policy 1, policy_version 517986 (0.0007) [2023-12-26 03:45:02,878][123090] Updated weights for policy 1, policy_version 517996 (0.0005) [2023-12-26 03:45:02,930][123090] Updated weights for policy 1, policy_version 518006 (0.0005) [2023-12-26 03:45:02,976][123090] Updated weights for policy 1, policy_version 518016 (0.0005) [2023-12-26 03:45:03,015][123091] Updated weights for policy 0, policy_version 521684 (0.0006) [2023-12-26 03:45:03,084][123091] Updated weights for policy 0, policy_version 521694 (0.0005) [2023-12-26 03:45:03,158][123091] Updated weights for policy 0, policy_version 521704 (0.0005) [2023-12-26 03:45:03,663][123090] Updated weights for policy 1, policy_version 518026 (0.0005) [2023-12-26 03:45:03,708][123090] Updated weights for policy 1, policy_version 518036 (0.0005) [2023-12-26 03:45:03,746][123091] Updated weights for policy 0, policy_version 521714 (0.0006) [2023-12-26 03:45:03,753][123090] Updated weights for policy 1, policy_version 518046 (0.0005) [2023-12-26 03:45:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 266182656. Throughput: 0: 9055.0, 1: 9052.3. Samples: 266193100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:03,785][121949] Avg episode reward: [(0, '5930.032'), (1, '5821.514')] [2023-12-26 03:45:03,804][123091] Updated weights for policy 0, policy_version 521724 (0.0010) [2023-12-26 03:45:03,861][123091] Updated weights for policy 0, policy_version 521734 (0.0010) [2023-12-26 03:45:03,939][123091] Updated weights for policy 0, policy_version 521744 (0.0006) [2023-12-26 03:45:04,541][123090] Updated weights for policy 1, policy_version 518056 (0.0005) [2023-12-26 03:45:04,615][123090] Updated weights for policy 1, policy_version 518066 (0.0008) [2023-12-26 03:45:04,640][123091] Updated weights for policy 0, policy_version 521754 (0.0006) [2023-12-26 03:45:04,678][123090] Updated weights for policy 1, policy_version 518076 (0.0007) [2023-12-26 03:45:04,698][123091] Updated weights for policy 0, policy_version 521764 (0.0005) [2023-12-26 03:45:04,766][123091] Updated weights for policy 0, policy_version 521774 (0.0005) [2023-12-26 03:45:05,418][123091] Updated weights for policy 0, policy_version 521784 (0.0005) [2023-12-26 03:45:05,455][123090] Updated weights for policy 1, policy_version 518086 (0.0010) [2023-12-26 03:45:05,478][123091] Updated weights for policy 0, policy_version 521794 (0.0006) [2023-12-26 03:45:05,519][123090] Updated weights for policy 1, policy_version 518096 (0.0010) [2023-12-26 03:45:05,545][123091] Updated weights for policy 0, policy_version 521804 (0.0006) [2023-12-26 03:45:05,579][123090] Updated weights for policy 1, policy_version 518106 (0.0010) [2023-12-26 03:45:06,252][123091] Updated weights for policy 0, policy_version 521814 (0.0007) [2023-12-26 03:45:06,304][123091] Updated weights for policy 0, policy_version 521824 (0.0009) [2023-12-26 03:45:06,360][123091] Updated weights for policy 0, policy_version 521834 (0.0009) [2023-12-26 03:45:06,413][123090] Updated weights for policy 1, policy_version 518116 (0.0010) [2023-12-26 03:45:06,482][123090] Updated weights for policy 1, policy_version 518126 (0.0010) [2023-12-26 03:45:06,543][123090] Updated weights for policy 1, policy_version 518136 (0.0005) [2023-12-26 03:45:07,082][123091] Updated weights for policy 0, policy_version 521844 (0.0010) [2023-12-26 03:45:07,141][123091] Updated weights for policy 0, policy_version 521854 (0.0010) [2023-12-26 03:45:07,204][123091] Updated weights for policy 0, policy_version 521864 (0.0005) [2023-12-26 03:45:07,292][123090] Updated weights for policy 1, policy_version 518146 (0.0006) [2023-12-26 03:45:07,350][123090] Updated weights for policy 1, policy_version 518156 (0.0006) [2023-12-26 03:45:07,411][123090] Updated weights for policy 1, policy_version 518166 (0.0006) [2023-12-26 03:45:07,466][123090] Updated weights for policy 1, policy_version 518176 (0.0006) [2023-12-26 03:45:07,977][123091] Updated weights for policy 0, policy_version 521874 (0.0006) [2023-12-26 03:45:08,037][123091] Updated weights for policy 0, policy_version 521884 (0.0010) [2023-12-26 03:45:08,104][123091] Updated weights for policy 0, policy_version 521894 (0.0010) [2023-12-26 03:45:08,181][123091] Updated weights for policy 0, policy_version 521904 (0.0010) [2023-12-26 03:45:08,226][123090] Updated weights for policy 1, policy_version 518186 (0.0005) [2023-12-26 03:45:08,272][123090] Updated weights for policy 1, policy_version 518196 (0.0005) [2023-12-26 03:45:08,335][123090] Updated weights for policy 1, policy_version 518206 (0.0008) [2023-12-26 03:45:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 266272768. Throughput: 0: 9158.2, 1: 9046.0. Samples: 266249152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:08,785][121949] Avg episode reward: [(0, '5936.979'), (1, '5887.735')] [2023-12-26 03:45:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000518208_132661248.pth... [2023-12-26 03:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000521904_133611520.pth... [2023-12-26 03:45:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000517184_132399104.pth [2023-12-26 03:45:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000520816_133332992.pth [2023-12-26 03:45:09,001][123091] Updated weights for policy 0, policy_version 521914 (0.0010) [2023-12-26 03:45:09,061][123091] Updated weights for policy 0, policy_version 521924 (0.0009) [2023-12-26 03:45:09,100][123090] Updated weights for policy 1, policy_version 518216 (0.0007) [2023-12-26 03:45:09,126][123091] Updated weights for policy 0, policy_version 521934 (0.0009) [2023-12-26 03:45:09,166][123090] Updated weights for policy 1, policy_version 518226 (0.0005) [2023-12-26 03:45:09,240][123090] Updated weights for policy 1, policy_version 518236 (0.0007) [2023-12-26 03:45:09,947][123090] Updated weights for policy 1, policy_version 518246 (0.0008) [2023-12-26 03:45:10,008][123090] Updated weights for policy 1, policy_version 518256 (0.0009) [2023-12-26 03:45:10,042][123091] Updated weights for policy 0, policy_version 521944 (0.0009) [2023-12-26 03:45:10,066][123090] Updated weights for policy 1, policy_version 518266 (0.0009) [2023-12-26 03:45:10,106][123091] Updated weights for policy 0, policy_version 521954 (0.0009) [2023-12-26 03:45:10,168][123091] Updated weights for policy 0, policy_version 521964 (0.0010) [2023-12-26 03:45:10,772][123090] Updated weights for policy 1, policy_version 518276 (0.0006) [2023-12-26 03:45:10,828][123090] Updated weights for policy 1, policy_version 518286 (0.0009) [2023-12-26 03:45:10,890][123090] Updated weights for policy 1, policy_version 518296 (0.0010) [2023-12-26 03:45:11,010][123091] Updated weights for policy 0, policy_version 521974 (0.0010) [2023-12-26 03:45:11,083][123091] Updated weights for policy 0, policy_version 521984 (0.0008) [2023-12-26 03:45:11,153][123091] Updated weights for policy 0, policy_version 521994 (0.0008) [2023-12-26 03:45:11,785][123090] Updated weights for policy 1, policy_version 518306 (0.0009) [2023-12-26 03:45:11,846][123090] Updated weights for policy 1, policy_version 518317 (0.0007) [2023-12-26 03:45:11,902][123090] Updated weights for policy 1, policy_version 518327 (0.0006) [2023-12-26 03:45:12,086][123091] Updated weights for policy 0, policy_version 522004 (0.0010) [2023-12-26 03:45:12,154][123091] Updated weights for policy 0, policy_version 522014 (0.0009) [2023-12-26 03:45:12,224][123091] Updated weights for policy 0, policy_version 522024 (0.0009) [2023-12-26 03:45:12,702][123090] Updated weights for policy 1, policy_version 518337 (0.0010) [2023-12-26 03:45:12,759][123090] Updated weights for policy 1, policy_version 518347 (0.0010) [2023-12-26 03:45:12,819][123090] Updated weights for policy 1, policy_version 518357 (0.0009) [2023-12-26 03:45:12,867][123090] Updated weights for policy 1, policy_version 518367 (0.0009) [2023-12-26 03:45:13,054][123091] Updated weights for policy 0, policy_version 522034 (0.0009) [2023-12-26 03:45:13,127][123091] Updated weights for policy 0, policy_version 522044 (0.0009) [2023-12-26 03:45:13,194][123091] Updated weights for policy 0, policy_version 522054 (0.0008) [2023-12-26 03:45:13,287][123091] Updated weights for policy 0, policy_version 522064 (0.0008) [2023-12-26 03:45:13,752][123090] Updated weights for policy 1, policy_version 518377 (0.0010) [2023-12-26 03:45:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18158.9, 300 sec: 17800.3). Total num frames: 266354688. Throughput: 0: 9151.6, 1: 9011.0. Samples: 266353828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:13,784][121949] Avg episode reward: [(0, '6071.278'), (1, '5810.479')] [2023-12-26 03:45:13,818][123090] Updated weights for policy 1, policy_version 518387 (0.0010) [2023-12-26 03:45:13,879][123090] Updated weights for policy 1, policy_version 518397 (0.0009) [2023-12-26 03:45:14,000][123091] Updated weights for policy 0, policy_version 522075 (0.0010) [2023-12-26 03:45:14,061][123091] Updated weights for policy 0, policy_version 522085 (0.0008) [2023-12-26 03:45:14,117][123091] Updated weights for policy 0, policy_version 522095 (0.0009) [2023-12-26 03:45:14,683][123090] Updated weights for policy 1, policy_version 518407 (0.0010) [2023-12-26 03:45:14,746][123090] Updated weights for policy 1, policy_version 518417 (0.0010) [2023-12-26 03:45:14,812][123090] Updated weights for policy 1, policy_version 518427 (0.0010) [2023-12-26 03:45:14,830][123091] Updated weights for policy 0, policy_version 522105 (0.0009) [2023-12-26 03:45:14,886][123091] Updated weights for policy 0, policy_version 522115 (0.0011) [2023-12-26 03:45:14,939][123091] Updated weights for policy 0, policy_version 522125 (0.0011) [2023-12-26 03:45:15,610][123090] Updated weights for policy 1, policy_version 518437 (0.0009) [2023-12-26 03:45:15,669][123090] Updated weights for policy 1, policy_version 518447 (0.0008) [2023-12-26 03:45:15,737][123090] Updated weights for policy 1, policy_version 518457 (0.0009) [2023-12-26 03:45:15,767][123091] Updated weights for policy 0, policy_version 522135 (0.0010) [2023-12-26 03:45:15,814][123091] Updated weights for policy 0, policy_version 522145 (0.0010) [2023-12-26 03:45:15,872][123091] Updated weights for policy 0, policy_version 522155 (0.0010) [2023-12-26 03:45:16,494][123090] Updated weights for policy 1, policy_version 518467 (0.0009) [2023-12-26 03:45:16,573][123090] Updated weights for policy 1, policy_version 518477 (0.0005) [2023-12-26 03:45:16,630][123090] Updated weights for policy 1, policy_version 518487 (0.0005) [2023-12-26 03:45:16,673][123091] Updated weights for policy 0, policy_version 522165 (0.0008) [2023-12-26 03:45:16,755][123091] Updated weights for policy 0, policy_version 522175 (0.0005) [2023-12-26 03:45:16,828][123091] Updated weights for policy 0, policy_version 522185 (0.0005) [2023-12-26 03:45:17,140][123090] Updated weights for policy 1, policy_version 518497 (0.0006) [2023-12-26 03:45:17,213][123090] Updated weights for policy 1, policy_version 518507 (0.0010) [2023-12-26 03:45:17,278][123090] Updated weights for policy 1, policy_version 518517 (0.0010) [2023-12-26 03:45:17,339][123090] Updated weights for policy 1, policy_version 518527 (0.0010) [2023-12-26 03:45:17,491][123091] Updated weights for policy 0, policy_version 522195 (0.0007) [2023-12-26 03:45:17,541][123091] Updated weights for policy 0, policy_version 522205 (0.0010) [2023-12-26 03:45:17,615][123091] Updated weights for policy 0, policy_version 522215 (0.0008) [2023-12-26 03:45:18,143][123090] Updated weights for policy 1, policy_version 518537 (0.0009) [2023-12-26 03:45:18,211][123090] Updated weights for policy 1, policy_version 518547 (0.0009) [2023-12-26 03:45:18,272][123090] Updated weights for policy 1, policy_version 518557 (0.0008) [2023-12-26 03:45:18,412][123091] Updated weights for policy 0, policy_version 522225 (0.0009) [2023-12-26 03:45:18,479][123091] Updated weights for policy 0, policy_version 522235 (0.0011) [2023-12-26 03:45:18,538][123091] Updated weights for policy 0, policy_version 522245 (0.0010) [2023-12-26 03:45:18,592][123091] Updated weights for policy 0, policy_version 522255 (0.0009) [2023-12-26 03:45:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 266452992. Throughput: 0: 9100.3, 1: 8983.8. Samples: 266462092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:18,785][121949] Avg episode reward: [(0, '6107.592'), (1, '5728.147')] [2023-12-26 03:45:19,139][123090] Updated weights for policy 1, policy_version 518567 (0.0009) [2023-12-26 03:45:19,206][123090] Updated weights for policy 1, policy_version 518577 (0.0010) [2023-12-26 03:45:19,276][123090] Updated weights for policy 1, policy_version 518587 (0.0009) [2023-12-26 03:45:19,337][123091] Updated weights for policy 0, policy_version 522265 (0.0007) [2023-12-26 03:45:19,406][123091] Updated weights for policy 0, policy_version 522275 (0.0008) [2023-12-26 03:45:19,457][123091] Updated weights for policy 0, policy_version 522285 (0.0008) [2023-12-26 03:45:20,106][123090] Updated weights for policy 1, policy_version 518597 (0.0009) [2023-12-26 03:45:20,179][123090] Updated weights for policy 1, policy_version 518607 (0.0009) [2023-12-26 03:45:20,221][123091] Updated weights for policy 0, policy_version 522295 (0.0006) [2023-12-26 03:45:20,249][123090] Updated weights for policy 1, policy_version 518617 (0.0009) [2023-12-26 03:45:20,281][123091] Updated weights for policy 0, policy_version 522305 (0.0006) [2023-12-26 03:45:20,342][123091] Updated weights for policy 0, policy_version 522315 (0.0007) [2023-12-26 03:45:21,119][123090] Updated weights for policy 1, policy_version 518627 (0.0008) [2023-12-26 03:45:21,135][123091] Updated weights for policy 0, policy_version 522325 (0.0008) [2023-12-26 03:45:21,191][123090] Updated weights for policy 1, policy_version 518637 (0.0009) [2023-12-26 03:45:21,204][123091] Updated weights for policy 0, policy_version 522335 (0.0008) [2023-12-26 03:45:21,259][123090] Updated weights for policy 1, policy_version 518647 (0.0009) [2023-12-26 03:45:21,272][123091] Updated weights for policy 0, policy_version 522345 (0.0010) [2023-12-26 03:45:21,998][123090] Updated weights for policy 1, policy_version 518657 (0.0009) [2023-12-26 03:45:22,075][123090] Updated weights for policy 1, policy_version 518667 (0.0008) [2023-12-26 03:45:22,133][123090] Updated weights for policy 1, policy_version 518677 (0.0009) [2023-12-26 03:45:22,135][123091] Updated weights for policy 0, policy_version 522355 (0.0009) [2023-12-26 03:45:22,188][123091] Updated weights for policy 0, policy_version 522365 (0.0009) [2023-12-26 03:45:22,191][123090] Updated weights for policy 1, policy_version 518687 (0.0006) [2023-12-26 03:45:22,250][123091] Updated weights for policy 0, policy_version 522375 (0.0007) [2023-12-26 03:45:23,030][123090] Updated weights for policy 1, policy_version 518697 (0.0009) [2023-12-26 03:45:23,068][123091] Updated weights for policy 0, policy_version 522385 (0.0009) [2023-12-26 03:45:23,083][123090] Updated weights for policy 1, policy_version 518707 (0.0009) [2023-12-26 03:45:23,126][123091] Updated weights for policy 0, policy_version 522395 (0.0006) [2023-12-26 03:45:23,139][123090] Updated weights for policy 1, policy_version 518717 (0.0008) [2023-12-26 03:45:23,181][123091] Updated weights for policy 0, policy_version 522405 (0.0006) [2023-12-26 03:45:23,244][123091] Updated weights for policy 0, policy_version 522415 (0.0006) [2023-12-26 03:45:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 266534912. Throughput: 0: 9111.9, 1: 8899.2. Samples: 266514228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:23,785][121949] Avg episode reward: [(0, '6027.422'), (1, '5674.507')] [2023-12-26 03:45:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000522416_133742592.pth... [2023-12-26 03:45:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000518720_132792320.pth... [2023-12-26 03:45:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000521360_133472256.pth [2023-12-26 03:45:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000517696_132530176.pth [2023-12-26 03:45:23,869][123091] Updated weights for policy 0, policy_version 522425 (0.0005) [2023-12-26 03:45:23,923][123091] Updated weights for policy 0, policy_version 522435 (0.0005) [2023-12-26 03:45:23,970][123091] Updated weights for policy 0, policy_version 522445 (0.0005) [2023-12-26 03:45:24,085][123090] Updated weights for policy 1, policy_version 518727 (0.0009) [2023-12-26 03:45:24,155][123090] Updated weights for policy 1, policy_version 518737 (0.0009) [2023-12-26 03:45:24,213][123090] Updated weights for policy 1, policy_version 518747 (0.0009) [2023-12-26 03:45:24,671][123091] Updated weights for policy 0, policy_version 522455 (0.0010) [2023-12-26 03:45:24,729][123091] Updated weights for policy 0, policy_version 522465 (0.0009) [2023-12-26 03:45:24,786][123091] Updated weights for policy 0, policy_version 522475 (0.0010) [2023-12-26 03:45:25,074][123090] Updated weights for policy 1, policy_version 518757 (0.0009) [2023-12-26 03:45:25,132][123090] Updated weights for policy 1, policy_version 518767 (0.0010) [2023-12-26 03:45:25,187][123090] Updated weights for policy 1, policy_version 518777 (0.0010) [2023-12-26 03:45:25,475][123091] Updated weights for policy 0, policy_version 522485 (0.0007) [2023-12-26 03:45:25,543][123091] Updated weights for policy 0, policy_version 522495 (0.0005) [2023-12-26 03:45:25,604][123091] Updated weights for policy 0, policy_version 522505 (0.0006) [2023-12-26 03:45:26,091][123090] Updated weights for policy 1, policy_version 518788 (0.0010) [2023-12-26 03:45:26,145][123090] Updated weights for policy 1, policy_version 518798 (0.0010) [2023-12-26 03:45:26,186][123091] Updated weights for policy 0, policy_version 522515 (0.0007) [2023-12-26 03:45:26,211][123090] Updated weights for policy 1, policy_version 518808 (0.0009) [2023-12-26 03:45:26,242][123091] Updated weights for policy 0, policy_version 522525 (0.0006) [2023-12-26 03:45:26,300][123091] Updated weights for policy 0, policy_version 522535 (0.0009) [2023-12-26 03:45:27,073][123090] Updated weights for policy 1, policy_version 518818 (0.0010) [2023-12-26 03:45:27,101][123091] Updated weights for policy 0, policy_version 522545 (0.0009) [2023-12-26 03:45:27,140][123090] Updated weights for policy 1, policy_version 518828 (0.0008) [2023-12-26 03:45:27,151][123091] Updated weights for policy 0, policy_version 522555 (0.0006) [2023-12-26 03:45:27,196][123091] Updated weights for policy 0, policy_version 522565 (0.0007) [2023-12-26 03:45:27,207][123090] Updated weights for policy 1, policy_version 518838 (0.0008) [2023-12-26 03:45:27,241][123091] Updated weights for policy 0, policy_version 522575 (0.0006) [2023-12-26 03:45:27,276][123090] Updated weights for policy 1, policy_version 518848 (0.0009) [2023-12-26 03:45:27,934][123091] Updated weights for policy 0, policy_version 522585 (0.0006) [2023-12-26 03:45:27,987][123091] Updated weights for policy 0, policy_version 522595 (0.0006) [2023-12-26 03:45:28,049][123091] Updated weights for policy 0, policy_version 522605 (0.0010) [2023-12-26 03:45:28,082][123090] Updated weights for policy 1, policy_version 518858 (0.0008) [2023-12-26 03:45:28,143][123090] Updated weights for policy 1, policy_version 518868 (0.0008) [2023-12-26 03:45:28,203][123090] Updated weights for policy 1, policy_version 518878 (0.0010) [2023-12-26 03:45:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 266625024. Throughput: 0: 9284.7, 1: 8818.1. Samples: 266620924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:28,785][121949] Avg episode reward: [(0, '6030.213'), (1, '5677.252')] [2023-12-26 03:45:28,793][123091] Updated weights for policy 0, policy_version 522615 (0.0011) [2023-12-26 03:45:28,853][123091] Updated weights for policy 0, policy_version 522625 (0.0011) [2023-12-26 03:45:28,912][123091] Updated weights for policy 0, policy_version 522635 (0.0011) [2023-12-26 03:45:29,080][123090] Updated weights for policy 1, policy_version 518888 (0.0009) [2023-12-26 03:45:29,150][123090] Updated weights for policy 1, policy_version 518898 (0.0009) [2023-12-26 03:45:29,219][123090] Updated weights for policy 1, policy_version 518908 (0.0009) [2023-12-26 03:45:29,641][123091] Updated weights for policy 0, policy_version 522645 (0.0008) [2023-12-26 03:45:29,706][123091] Updated weights for policy 0, policy_version 522655 (0.0005) [2023-12-26 03:45:29,775][123091] Updated weights for policy 0, policy_version 522665 (0.0006) [2023-12-26 03:45:29,971][123090] Updated weights for policy 1, policy_version 518918 (0.0008) [2023-12-26 03:45:30,043][123090] Updated weights for policy 1, policy_version 518928 (0.0005) [2023-12-26 03:45:30,112][123090] Updated weights for policy 1, policy_version 518938 (0.0005) [2023-12-26 03:45:30,508][123091] Updated weights for policy 0, policy_version 522675 (0.0006) [2023-12-26 03:45:30,561][123091] Updated weights for policy 0, policy_version 522685 (0.0005) [2023-12-26 03:45:30,620][123091] Updated weights for policy 0, policy_version 522695 (0.0005) [2023-12-26 03:45:30,807][123090] Updated weights for policy 1, policy_version 518948 (0.0007) [2023-12-26 03:45:30,865][123090] Updated weights for policy 1, policy_version 518958 (0.0010) [2023-12-26 03:45:30,925][123090] Updated weights for policy 1, policy_version 518968 (0.0009) [2023-12-26 03:45:31,329][123091] Updated weights for policy 0, policy_version 522705 (0.0005) [2023-12-26 03:45:31,407][123091] Updated weights for policy 0, policy_version 522715 (0.0008) [2023-12-26 03:45:31,466][123091] Updated weights for policy 0, policy_version 522725 (0.0010) [2023-12-26 03:45:31,525][123091] Updated weights for policy 0, policy_version 522735 (0.0010) [2023-12-26 03:45:31,700][123090] Updated weights for policy 1, policy_version 518978 (0.0009) [2023-12-26 03:45:31,777][123090] Updated weights for policy 1, policy_version 518988 (0.0009) [2023-12-26 03:45:31,845][123090] Updated weights for policy 1, policy_version 518998 (0.0009) [2023-12-26 03:45:31,916][123090] Updated weights for policy 1, policy_version 519008 (0.0005) [2023-12-26 03:45:32,368][123091] Updated weights for policy 0, policy_version 522745 (0.0009) [2023-12-26 03:45:32,438][123091] Updated weights for policy 0, policy_version 522755 (0.0009) [2023-12-26 03:45:32,489][123091] Updated weights for policy 0, policy_version 522765 (0.0009) [2023-12-26 03:45:32,582][123090] Updated weights for policy 1, policy_version 519018 (0.0010) [2023-12-26 03:45:32,641][123090] Updated weights for policy 1, policy_version 519028 (0.0010) [2023-12-26 03:45:32,707][123090] Updated weights for policy 1, policy_version 519038 (0.0010) [2023-12-26 03:45:33,309][123091] Updated weights for policy 0, policy_version 522775 (0.0009) [2023-12-26 03:45:33,361][123091] Updated weights for policy 0, policy_version 522785 (0.0009) [2023-12-26 03:45:33,408][123091] Updated weights for policy 0, policy_version 522795 (0.0008) [2023-12-26 03:45:33,534][123090] Updated weights for policy 1, policy_version 519048 (0.0010) [2023-12-26 03:45:33,596][123090] Updated weights for policy 1, policy_version 519058 (0.0010) [2023-12-26 03:45:33,666][123090] Updated weights for policy 1, policy_version 519068 (0.0010) [2023-12-26 03:45:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 266723328. Throughput: 0: 9162.4, 1: 8789.2. Samples: 266729540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:33,785][121949] Avg episode reward: [(0, '6077.435'), (1, '5558.384')] [2023-12-26 03:45:34,267][123091] Updated weights for policy 0, policy_version 522805 (0.0009) [2023-12-26 03:45:34,320][123091] Updated weights for policy 0, policy_version 522815 (0.0009) [2023-12-26 03:45:34,368][123091] Updated weights for policy 0, policy_version 522825 (0.0009) [2023-12-26 03:45:34,489][123090] Updated weights for policy 1, policy_version 519078 (0.0010) [2023-12-26 03:45:34,552][123090] Updated weights for policy 1, policy_version 519088 (0.0010) [2023-12-26 03:45:34,615][123090] Updated weights for policy 1, policy_version 519098 (0.0010) [2023-12-26 03:45:35,230][123091] Updated weights for policy 0, policy_version 522835 (0.0009) [2023-12-26 03:45:35,279][123091] Updated weights for policy 0, policy_version 522845 (0.0009) [2023-12-26 03:45:35,334][123091] Updated weights for policy 0, policy_version 522855 (0.0009) [2023-12-26 03:45:35,432][123090] Updated weights for policy 1, policy_version 519108 (0.0010) [2023-12-26 03:45:35,495][123090] Updated weights for policy 1, policy_version 519118 (0.0010) [2023-12-26 03:45:35,562][123090] Updated weights for policy 1, policy_version 519128 (0.0010) [2023-12-26 03:45:36,168][123091] Updated weights for policy 0, policy_version 522865 (0.0008) [2023-12-26 03:45:36,238][123091] Updated weights for policy 0, policy_version 522875 (0.0011) [2023-12-26 03:45:36,302][123091] Updated weights for policy 0, policy_version 522885 (0.0011) [2023-12-26 03:45:36,355][123091] Updated weights for policy 0, policy_version 522895 (0.0011) [2023-12-26 03:45:36,377][123090] Updated weights for policy 1, policy_version 519138 (0.0010) [2023-12-26 03:45:36,449][123090] Updated weights for policy 1, policy_version 519148 (0.0011) [2023-12-26 03:45:36,517][123090] Updated weights for policy 1, policy_version 519158 (0.0011) [2023-12-26 03:45:36,577][123090] Updated weights for policy 1, policy_version 519168 (0.0010) [2023-12-26 03:45:37,083][123091] Updated weights for policy 0, policy_version 522905 (0.0006) [2023-12-26 03:45:37,135][123091] Updated weights for policy 0, policy_version 522915 (0.0005) [2023-12-26 03:45:37,186][123091] Updated weights for policy 0, policy_version 522925 (0.0005) [2023-12-26 03:45:37,391][123090] Updated weights for policy 1, policy_version 519178 (0.0010) [2023-12-26 03:45:37,443][123090] Updated weights for policy 1, policy_version 519188 (0.0010) [2023-12-26 03:45:37,506][123090] Updated weights for policy 1, policy_version 519198 (0.0011) [2023-12-26 03:45:37,840][123091] Updated weights for policy 0, policy_version 522935 (0.0005) [2023-12-26 03:45:37,901][123091] Updated weights for policy 0, policy_version 522945 (0.0006) [2023-12-26 03:45:37,958][123091] Updated weights for policy 0, policy_version 522955 (0.0008) [2023-12-26 03:45:38,272][123090] Updated weights for policy 1, policy_version 519208 (0.0006) [2023-12-26 03:45:38,347][123090] Updated weights for policy 1, policy_version 519218 (0.0007) [2023-12-26 03:45:38,410][123090] Updated weights for policy 1, policy_version 519228 (0.0010) [2023-12-26 03:45:38,691][123091] Updated weights for policy 0, policy_version 522965 (0.0007) [2023-12-26 03:45:38,757][123091] Updated weights for policy 0, policy_version 522975 (0.0007) [2023-12-26 03:45:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 266805248. Throughput: 0: 9144.2, 1: 8788.0. Samples: 266780732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:38,785][121949] Avg episode reward: [(0, '6117.881'), (1, '5690.572')] [2023-12-26 03:45:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000519232_132923392.pth... [2023-12-26 03:45:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000518208_132661248.pth [2023-12-26 03:45:38,825][123091] Updated weights for policy 0, policy_version 522985 (0.0010) [2023-12-26 03:45:38,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000522992_133890048.pth... [2023-12-26 03:45:38,870][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000521904_133611520.pth [2023-12-26 03:45:39,193][123090] Updated weights for policy 1, policy_version 519238 (0.0010) [2023-12-26 03:45:39,286][123090] Updated weights for policy 1, policy_version 519248 (0.0010) [2023-12-26 03:45:39,352][123090] Updated weights for policy 1, policy_version 519258 (0.0011) [2023-12-26 03:45:39,652][123091] Updated weights for policy 0, policy_version 522995 (0.0009) [2023-12-26 03:45:39,702][123091] Updated weights for policy 0, policy_version 523005 (0.0009) [2023-12-26 03:45:39,762][123091] Updated weights for policy 0, policy_version 523015 (0.0009) [2023-12-26 03:45:40,161][123090] Updated weights for policy 1, policy_version 519268 (0.0010) [2023-12-26 03:45:40,228][123090] Updated weights for policy 1, policy_version 519278 (0.0009) [2023-12-26 03:45:40,280][123090] Updated weights for policy 1, policy_version 519288 (0.0009) [2023-12-26 03:45:40,633][123091] Updated weights for policy 0, policy_version 523025 (0.0010) [2023-12-26 03:45:40,704][123091] Updated weights for policy 0, policy_version 523035 (0.0009) [2023-12-26 03:45:40,764][123091] Updated weights for policy 0, policy_version 523045 (0.0010) [2023-12-26 03:45:40,822][123091] Updated weights for policy 0, policy_version 523055 (0.0010) [2023-12-26 03:45:41,128][123090] Updated weights for policy 1, policy_version 519298 (0.0009) [2023-12-26 03:45:41,201][123090] Updated weights for policy 1, policy_version 519308 (0.0008) [2023-12-26 03:45:41,271][123090] Updated weights for policy 1, policy_version 519318 (0.0007) [2023-12-26 03:45:41,327][123090] Updated weights for policy 1, policy_version 519328 (0.0009) [2023-12-26 03:45:41,677][123091] Updated weights for policy 0, policy_version 523065 (0.0007) [2023-12-26 03:45:41,749][123091] Updated weights for policy 0, policy_version 523075 (0.0008) [2023-12-26 03:45:41,811][123091] Updated weights for policy 0, policy_version 523085 (0.0010) [2023-12-26 03:45:42,163][123090] Updated weights for policy 1, policy_version 519338 (0.0011) [2023-12-26 03:45:42,220][123090] Updated weights for policy 1, policy_version 519348 (0.0010) [2023-12-26 03:45:42,289][123090] Updated weights for policy 1, policy_version 519358 (0.0011) [2023-12-26 03:45:42,705][123091] Updated weights for policy 0, policy_version 523095 (0.0009) [2023-12-26 03:45:42,763][123091] Updated weights for policy 0, policy_version 523105 (0.0009) [2023-12-26 03:45:42,823][123091] Updated weights for policy 0, policy_version 523115 (0.0009) [2023-12-26 03:45:43,145][123090] Updated weights for policy 1, policy_version 519368 (0.0010) [2023-12-26 03:45:43,200][123090] Updated weights for policy 1, policy_version 519378 (0.0010) [2023-12-26 03:45:43,251][123090] Updated weights for policy 1, policy_version 519388 (0.0010) [2023-12-26 03:45:43,665][123091] Updated weights for policy 0, policy_version 523125 (0.0009) [2023-12-26 03:45:43,717][123091] Updated weights for policy 0, policy_version 523135 (0.0006) [2023-12-26 03:45:43,769][123091] Updated weights for policy 0, policy_version 523145 (0.0005) [2023-12-26 03:45:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 266887168. Throughput: 0: 9127.4, 1: 8732.8. Samples: 266884716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:45:43,785][121949] Avg episode reward: [(0, '6095.891'), (1, '5777.757')] [2023-12-26 03:45:44,071][123090] Updated weights for policy 1, policy_version 519398 (0.0007) [2023-12-26 03:45:44,125][123090] Updated weights for policy 1, policy_version 519408 (0.0005) [2023-12-26 03:45:44,177][123090] Updated weights for policy 1, policy_version 519418 (0.0005) [2023-12-26 03:45:44,438][123091] Updated weights for policy 0, policy_version 523155 (0.0005) [2023-12-26 03:45:44,484][123091] Updated weights for policy 0, policy_version 523165 (0.0005) [2023-12-26 03:45:44,532][123091] Updated weights for policy 0, policy_version 523175 (0.0005) [2023-12-26 03:45:44,868][123090] Updated weights for policy 1, policy_version 519428 (0.0007) [2023-12-26 03:45:44,933][123090] Updated weights for policy 1, policy_version 519438 (0.0006) [2023-12-26 03:45:44,996][123090] Updated weights for policy 1, policy_version 519448 (0.0008) [2023-12-26 03:45:45,260][123091] Updated weights for policy 0, policy_version 523185 (0.0006) [2023-12-26 03:45:45,328][123091] Updated weights for policy 0, policy_version 523195 (0.0009) [2023-12-26 03:45:45,397][123091] Updated weights for policy 0, policy_version 523205 (0.0009) [2023-12-26 03:45:45,465][123091] Updated weights for policy 0, policy_version 523215 (0.0009) [2023-12-26 03:45:45,745][123090] Updated weights for policy 1, policy_version 519458 (0.0011) [2023-12-26 03:45:45,797][123090] Updated weights for policy 1, policy_version 519468 (0.0010) [2023-12-26 03:45:45,844][123090] Updated weights for policy 1, policy_version 519478 (0.0010) [2023-12-26 03:45:45,892][123090] Updated weights for policy 1, policy_version 519488 (0.0010) [2023-12-26 03:45:46,274][123091] Updated weights for policy 0, policy_version 523225 (0.0005) [2023-12-26 03:45:46,322][123091] Updated weights for policy 0, policy_version 523235 (0.0005) [2023-12-26 03:45:46,369][123091] Updated weights for policy 0, policy_version 523245 (0.0005) [2023-12-26 03:45:46,650][123090] Updated weights for policy 1, policy_version 519498 (0.0010) [2023-12-26 03:45:46,701][123090] Updated weights for policy 1, policy_version 519508 (0.0010) [2023-12-26 03:45:46,756][123090] Updated weights for policy 1, policy_version 519518 (0.0010) [2023-12-26 03:45:47,152][123091] Updated weights for policy 0, policy_version 523255 (0.0008) [2023-12-26 03:45:47,203][123091] Updated weights for policy 0, policy_version 523265 (0.0008) [2023-12-26 03:45:47,251][123091] Updated weights for policy 0, policy_version 523275 (0.0008) [2023-12-26 03:45:47,585][123090] Updated weights for policy 1, policy_version 519528 (0.0009) [2023-12-26 03:45:47,636][123090] Updated weights for policy 1, policy_version 519538 (0.0006) [2023-12-26 03:45:47,682][123090] Updated weights for policy 1, policy_version 519548 (0.0005) [2023-12-26 03:45:48,146][123091] Updated weights for policy 0, policy_version 523285 (0.0009) [2023-12-26 03:45:48,206][123091] Updated weights for policy 0, policy_version 523295 (0.0010) [2023-12-26 03:45:48,262][123091] Updated weights for policy 0, policy_version 523305 (0.0010) [2023-12-26 03:45:48,367][123090] Updated weights for policy 1, policy_version 519558 (0.0007) [2023-12-26 03:45:48,414][123090] Updated weights for policy 1, policy_version 519568 (0.0005) [2023-12-26 03:45:48,464][123090] Updated weights for policy 1, policy_version 519578 (0.0005) [2023-12-26 03:45:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 266985472. Throughput: 0: 9034.7, 1: 8767.7. Samples: 266994212. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:45:48,785][121949] Avg episode reward: [(0, '6084.867'), (1, '5685.728')] [2023-12-26 03:45:49,145][123091] Updated weights for policy 0, policy_version 523315 (0.0009) [2023-12-26 03:45:49,194][123091] Updated weights for policy 0, policy_version 523325 (0.0009) [2023-12-26 03:45:49,259][123091] Updated weights for policy 0, policy_version 523335 (0.0008) [2023-12-26 03:45:49,264][123090] Updated weights for policy 1, policy_version 519588 (0.0007) [2023-12-26 03:45:49,330][123090] Updated weights for policy 1, policy_version 519598 (0.0010) [2023-12-26 03:45:49,397][123090] Updated weights for policy 1, policy_version 519608 (0.0009) [2023-12-26 03:45:50,084][123091] Updated weights for policy 0, policy_version 523345 (0.0008) [2023-12-26 03:45:50,142][123091] Updated weights for policy 0, policy_version 523355 (0.0010) [2023-12-26 03:45:50,158][123090] Updated weights for policy 1, policy_version 519618 (0.0008) [2023-12-26 03:45:50,210][123091] Updated weights for policy 0, policy_version 523365 (0.0009) [2023-12-26 03:45:50,228][123090] Updated weights for policy 1, policy_version 519628 (0.0007) [2023-12-26 03:45:50,274][123091] Updated weights for policy 0, policy_version 523375 (0.0009) [2023-12-26 03:45:50,294][123090] Updated weights for policy 1, policy_version 519638 (0.0009) [2023-12-26 03:45:50,364][123090] Updated weights for policy 1, policy_version 519648 (0.0009) [2023-12-26 03:45:51,137][123090] Updated weights for policy 1, policy_version 519658 (0.0009) [2023-12-26 03:45:51,168][123091] Updated weights for policy 0, policy_version 523385 (0.0008) [2023-12-26 03:45:51,200][123090] Updated weights for policy 1, policy_version 519668 (0.0008) [2023-12-26 03:45:51,225][123091] Updated weights for policy 0, policy_version 523395 (0.0009) [2023-12-26 03:45:51,267][123090] Updated weights for policy 1, policy_version 519678 (0.0008) [2023-12-26 03:45:51,284][123091] Updated weights for policy 0, policy_version 523405 (0.0008) [2023-12-26 03:45:52,041][123090] Updated weights for policy 1, policy_version 519688 (0.0007) [2023-12-26 03:45:52,104][123090] Updated weights for policy 1, policy_version 519698 (0.0005) [2023-12-26 03:45:52,167][123091] Updated weights for policy 0, policy_version 523415 (0.0008) [2023-12-26 03:45:52,172][123090] Updated weights for policy 1, policy_version 519708 (0.0008) [2023-12-26 03:45:52,226][123091] Updated weights for policy 0, policy_version 523425 (0.0007) [2023-12-26 03:45:52,289][123091] Updated weights for policy 0, policy_version 523435 (0.0010) [2023-12-26 03:45:52,969][123090] Updated weights for policy 1, policy_version 519718 (0.0010) [2023-12-26 03:45:53,025][123090] Updated weights for policy 1, policy_version 519728 (0.0009) [2023-12-26 03:45:53,090][123090] Updated weights for policy 1, policy_version 519738 (0.0009) [2023-12-26 03:45:53,134][123091] Updated weights for policy 0, policy_version 523445 (0.0008) [2023-12-26 03:45:53,198][123091] Updated weights for policy 0, policy_version 523455 (0.0009) [2023-12-26 03:45:53,263][123091] Updated weights for policy 0, policy_version 523465 (0.0007) [2023-12-26 03:45:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 267067392. Throughput: 0: 8923.5, 1: 8781.7. Samples: 267045888. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:45:53,785][121949] Avg episode reward: [(0, '6075.434'), (1, '5659.901')] [2023-12-26 03:45:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000523472_134012928.pth... [2023-12-26 03:45:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000519744_133054464.pth... [2023-12-26 03:45:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000522416_133742592.pth [2023-12-26 03:45:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000518720_132792320.pth [2023-12-26 03:45:53,944][123090] Updated weights for policy 1, policy_version 519748 (0.0009) [2023-12-26 03:45:54,008][123090] Updated weights for policy 1, policy_version 519758 (0.0009) [2023-12-26 03:45:54,059][123091] Updated weights for policy 0, policy_version 523475 (0.0007) [2023-12-26 03:45:54,067][123090] Updated weights for policy 1, policy_version 519768 (0.0008) [2023-12-26 03:45:54,106][123091] Updated weights for policy 0, policy_version 523485 (0.0008) [2023-12-26 03:45:54,166][123091] Updated weights for policy 0, policy_version 523495 (0.0009) [2023-12-26 03:45:54,871][123090] Updated weights for policy 1, policy_version 519778 (0.0009) [2023-12-26 03:45:54,931][123090] Updated weights for policy 1, policy_version 519788 (0.0010) [2023-12-26 03:45:55,000][123090] Updated weights for policy 1, policy_version 519798 (0.0009) [2023-12-26 03:45:55,011][123091] Updated weights for policy 0, policy_version 523505 (0.0009) [2023-12-26 03:45:55,062][123090] Updated weights for policy 1, policy_version 519808 (0.0009) [2023-12-26 03:45:55,076][123091] Updated weights for policy 0, policy_version 523515 (0.0010) [2023-12-26 03:45:55,135][123091] Updated weights for policy 0, policy_version 523525 (0.0009) [2023-12-26 03:45:55,197][123091] Updated weights for policy 0, policy_version 523535 (0.0010) [2023-12-26 03:45:55,844][123090] Updated weights for policy 1, policy_version 519818 (0.0009) [2023-12-26 03:45:55,893][123090] Updated weights for policy 1, policy_version 519828 (0.0009) [2023-12-26 03:45:55,942][123090] Updated weights for policy 1, policy_version 519838 (0.0009) [2023-12-26 03:45:56,018][123091] Updated weights for policy 0, policy_version 523545 (0.0009) [2023-12-26 03:45:56,085][123091] Updated weights for policy 0, policy_version 523555 (0.0009) [2023-12-26 03:45:56,140][123091] Updated weights for policy 0, policy_version 523565 (0.0009) [2023-12-26 03:45:56,788][123090] Updated weights for policy 1, policy_version 519848 (0.0010) [2023-12-26 03:45:56,840][123090] Updated weights for policy 1, policy_version 519858 (0.0009) [2023-12-26 03:45:56,894][123090] Updated weights for policy 1, policy_version 519869 (0.0010) [2023-12-26 03:45:56,971][123091] Updated weights for policy 0, policy_version 523575 (0.0008) [2023-12-26 03:45:57,024][123091] Updated weights for policy 0, policy_version 523585 (0.0010) [2023-12-26 03:45:57,073][123091] Updated weights for policy 0, policy_version 523595 (0.0009) [2023-12-26 03:45:57,700][123090] Updated weights for policy 1, policy_version 519879 (0.0006) [2023-12-26 03:45:57,770][123090] Updated weights for policy 1, policy_version 519889 (0.0006) [2023-12-26 03:45:57,839][123090] Updated weights for policy 1, policy_version 519899 (0.0005) [2023-12-26 03:45:57,944][123091] Updated weights for policy 0, policy_version 523605 (0.0009) [2023-12-26 03:45:58,007][123091] Updated weights for policy 0, policy_version 523615 (0.0010) [2023-12-26 03:45:58,071][123091] Updated weights for policy 0, policy_version 523625 (0.0010) [2023-12-26 03:45:58,621][123090] Updated weights for policy 1, policy_version 519909 (0.0008) [2023-12-26 03:45:58,698][123090] Updated weights for policy 1, policy_version 519919 (0.0009) [2023-12-26 03:45:58,769][123090] Updated weights for policy 1, policy_version 519929 (0.0008) [2023-12-26 03:45:58,785][121949] Fps is (10 sec: 16382.0, 60 sec: 17748.9, 300 sec: 17800.2). Total num frames: 267149312. Throughput: 0: 8938.8, 1: 8727.5. Samples: 267148836. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:45:58,786][121949] Avg episode reward: [(0, '6093.315'), (1, '5639.816')] [2023-12-26 03:45:58,994][123091] Updated weights for policy 0, policy_version 523635 (0.0009) [2023-12-26 03:45:59,063][123091] Updated weights for policy 0, policy_version 523645 (0.0009) [2023-12-26 03:45:59,135][123091] Updated weights for policy 0, policy_version 523655 (0.0009) [2023-12-26 03:45:59,653][123090] Updated weights for policy 1, policy_version 519939 (0.0007) [2023-12-26 03:45:59,722][123090] Updated weights for policy 1, policy_version 519949 (0.0010) [2023-12-26 03:45:59,778][123090] Updated weights for policy 1, policy_version 519959 (0.0009) [2023-12-26 03:45:59,954][123091] Updated weights for policy 0, policy_version 523665 (0.0009) [2023-12-26 03:46:00,022][123091] Updated weights for policy 0, policy_version 523675 (0.0006) [2023-12-26 03:46:00,085][123091] Updated weights for policy 0, policy_version 523685 (0.0008) [2023-12-26 03:46:00,142][123091] Updated weights for policy 0, policy_version 523695 (0.0009) [2023-12-26 03:46:00,654][123090] Updated weights for policy 1, policy_version 519969 (0.0010) [2023-12-26 03:46:00,716][123090] Updated weights for policy 1, policy_version 519979 (0.0010) [2023-12-26 03:46:00,785][123090] Updated weights for policy 1, policy_version 519989 (0.0010) [2023-12-26 03:46:00,854][123090] Updated weights for policy 1, policy_version 519999 (0.0010) [2023-12-26 03:46:00,940][123091] Updated weights for policy 0, policy_version 523705 (0.0009) [2023-12-26 03:46:00,999][123091] Updated weights for policy 0, policy_version 523715 (0.0009) [2023-12-26 03:46:01,061][123091] Updated weights for policy 0, policy_version 523725 (0.0009) [2023-12-26 03:46:01,665][123090] Updated weights for policy 1, policy_version 520009 (0.0008) [2023-12-26 03:46:01,725][123090] Updated weights for policy 1, policy_version 520019 (0.0009) [2023-12-26 03:46:01,809][123090] Updated weights for policy 1, policy_version 520029 (0.0008) [2023-12-26 03:46:01,956][123091] Updated weights for policy 0, policy_version 523735 (0.0009) [2023-12-26 03:46:02,018][123091] Updated weights for policy 0, policy_version 523745 (0.0010) [2023-12-26 03:46:02,080][123091] Updated weights for policy 0, policy_version 523755 (0.0010) [2023-12-26 03:46:02,531][123090] Updated weights for policy 1, policy_version 520039 (0.0008) [2023-12-26 03:46:02,588][123090] Updated weights for policy 1, policy_version 520049 (0.0010) [2023-12-26 03:46:02,639][123090] Updated weights for policy 1, policy_version 520059 (0.0009) [2023-12-26 03:46:02,946][123091] Updated weights for policy 0, policy_version 523765 (0.0010) [2023-12-26 03:46:03,013][123091] Updated weights for policy 0, policy_version 523775 (0.0010) [2023-12-26 03:46:03,086][123091] Updated weights for policy 0, policy_version 523785 (0.0009) [2023-12-26 03:46:03,557][123090] Updated weights for policy 1, policy_version 520069 (0.0009) [2023-12-26 03:46:03,610][123090] Updated weights for policy 1, policy_version 520079 (0.0009) [2023-12-26 03:46:03,672][123090] Updated weights for policy 1, policy_version 520089 (0.0010) [2023-12-26 03:46:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 267239424. Throughput: 0: 8842.2, 1: 8663.1. Samples: 267249828. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:03,785][121949] Avg episode reward: [(0, '6190.466'), (1, '5690.851')] [2023-12-26 03:46:03,849][123091] Updated weights for policy 0, policy_version 523795 (0.0007) [2023-12-26 03:46:03,914][123091] Updated weights for policy 0, policy_version 523805 (0.0008) [2023-12-26 03:46:03,976][123091] Updated weights for policy 0, policy_version 523815 (0.0008) [2023-12-26 03:46:04,503][123090] Updated weights for policy 1, policy_version 520099 (0.0008) [2023-12-26 03:46:04,572][123090] Updated weights for policy 1, policy_version 520109 (0.0007) [2023-12-26 03:46:04,637][123090] Updated weights for policy 1, policy_version 520119 (0.0008) [2023-12-26 03:46:04,733][123091] Updated weights for policy 0, policy_version 523825 (0.0008) [2023-12-26 03:46:04,793][123091] Updated weights for policy 0, policy_version 523835 (0.0011) [2023-12-26 03:46:04,856][123091] Updated weights for policy 0, policy_version 523845 (0.0011) [2023-12-26 03:46:04,920][123091] Updated weights for policy 0, policy_version 523855 (0.0011) [2023-12-26 03:46:05,405][123090] Updated weights for policy 1, policy_version 520129 (0.0009) [2023-12-26 03:46:05,454][123090] Updated weights for policy 1, policy_version 520139 (0.0008) [2023-12-26 03:46:05,510][123090] Updated weights for policy 1, policy_version 520149 (0.0009) [2023-12-26 03:46:05,569][123090] Updated weights for policy 1, policy_version 520160 (0.0010) [2023-12-26 03:46:05,731][123091] Updated weights for policy 0, policy_version 523865 (0.0008) [2023-12-26 03:46:05,803][123091] Updated weights for policy 0, policy_version 523875 (0.0011) [2023-12-26 03:46:05,869][123091] Updated weights for policy 0, policy_version 523885 (0.0011) [2023-12-26 03:46:06,513][123090] Updated weights for policy 1, policy_version 520170 (0.0009) [2023-12-26 03:46:06,578][123090] Updated weights for policy 1, policy_version 520180 (0.0009) [2023-12-26 03:46:06,640][123090] Updated weights for policy 1, policy_version 520190 (0.0009) [2023-12-26 03:46:06,660][123091] Updated weights for policy 0, policy_version 523895 (0.0011) [2023-12-26 03:46:06,725][123091] Updated weights for policy 0, policy_version 523905 (0.0011) [2023-12-26 03:46:06,785][123091] Updated weights for policy 0, policy_version 523915 (0.0011) [2023-12-26 03:46:07,449][123090] Updated weights for policy 1, policy_version 520200 (0.0008) [2023-12-26 03:46:07,506][123090] Updated weights for policy 1, policy_version 520210 (0.0009) [2023-12-26 03:46:07,543][123091] Updated weights for policy 0, policy_version 523925 (0.0011) [2023-12-26 03:46:07,564][123090] Updated weights for policy 1, policy_version 520220 (0.0009) [2023-12-26 03:46:07,603][123091] Updated weights for policy 0, policy_version 523935 (0.0011) [2023-12-26 03:46:07,659][123091] Updated weights for policy 0, policy_version 523945 (0.0010) [2023-12-26 03:46:08,437][123090] Updated weights for policy 1, policy_version 520230 (0.0010) [2023-12-26 03:46:08,493][123091] Updated weights for policy 0, policy_version 523955 (0.0008) [2023-12-26 03:46:08,504][123090] Updated weights for policy 1, policy_version 520240 (0.0008) [2023-12-26 03:46:08,558][123091] Updated weights for policy 0, policy_version 523965 (0.0011) [2023-12-26 03:46:08,566][123090] Updated weights for policy 1, policy_version 520250 (0.0008) [2023-12-26 03:46:08,627][123091] Updated weights for policy 0, policy_version 523975 (0.0009) [2023-12-26 03:46:08,784][121949] Fps is (10 sec: 18024.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 267329536. Throughput: 0: 8835.3, 1: 8668.7. Samples: 267301904. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:08,785][121949] Avg episode reward: [(0, '6246.446'), (1, '5753.391')] [2023-12-26 03:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000523984_134144000.pth... [2023-12-26 03:46:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000520256_133185536.pth... [2023-12-26 03:46:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000519232_132923392.pth [2023-12-26 03:46:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000522992_133890048.pth [2023-12-26 03:46:09,462][123091] Updated weights for policy 0, policy_version 523985 (0.0011) [2023-12-26 03:46:09,474][123090] Updated weights for policy 1, policy_version 520260 (0.0008) [2023-12-26 03:46:09,514][123091] Updated weights for policy 0, policy_version 523995 (0.0010) [2023-12-26 03:46:09,539][123090] Updated weights for policy 1, policy_version 520270 (0.0006) [2023-12-26 03:46:09,579][123091] Updated weights for policy 0, policy_version 524005 (0.0011) [2023-12-26 03:46:09,601][123090] Updated weights for policy 1, policy_version 520280 (0.0007) [2023-12-26 03:46:09,641][123091] Updated weights for policy 0, policy_version 524015 (0.0010) [2023-12-26 03:46:10,424][123090] Updated weights for policy 1, policy_version 520290 (0.0008) [2023-12-26 03:46:10,482][123090] Updated weights for policy 1, policy_version 520300 (0.0011) [2023-12-26 03:46:10,530][123091] Updated weights for policy 0, policy_version 524025 (0.0009) [2023-12-26 03:46:10,543][123090] Updated weights for policy 1, policy_version 520310 (0.0011) [2023-12-26 03:46:10,587][123091] Updated weights for policy 0, policy_version 524035 (0.0009) [2023-12-26 03:46:10,596][123090] Updated weights for policy 1, policy_version 520320 (0.0010) [2023-12-26 03:46:10,647][123091] Updated weights for policy 0, policy_version 524045 (0.0005) [2023-12-26 03:46:11,418][123091] Updated weights for policy 0, policy_version 524055 (0.0009) [2023-12-26 03:46:11,473][123090] Updated weights for policy 1, policy_version 520330 (0.0006) [2023-12-26 03:46:11,476][123091] Updated weights for policy 0, policy_version 524065 (0.0009) [2023-12-26 03:46:11,523][123090] Updated weights for policy 1, policy_version 520340 (0.0006) [2023-12-26 03:46:11,547][123091] Updated weights for policy 0, policy_version 524075 (0.0010) [2023-12-26 03:46:11,571][123090] Updated weights for policy 1, policy_version 520350 (0.0006) [2023-12-26 03:46:12,395][123091] Updated weights for policy 0, policy_version 524085 (0.0008) [2023-12-26 03:46:12,433][123090] Updated weights for policy 1, policy_version 520360 (0.0008) [2023-12-26 03:46:12,460][123091] Updated weights for policy 0, policy_version 524095 (0.0009) [2023-12-26 03:46:12,500][123090] Updated weights for policy 1, policy_version 520370 (0.0009) [2023-12-26 03:46:12,522][123091] Updated weights for policy 0, policy_version 524105 (0.0007) [2023-12-26 03:46:12,561][123090] Updated weights for policy 1, policy_version 520380 (0.0007) [2023-12-26 03:46:13,327][123091] Updated weights for policy 0, policy_version 524115 (0.0008) [2023-12-26 03:46:13,348][123090] Updated weights for policy 1, policy_version 520390 (0.0008) [2023-12-26 03:46:13,390][123091] Updated weights for policy 0, policy_version 524125 (0.0006) [2023-12-26 03:46:13,401][123090] Updated weights for policy 1, policy_version 520400 (0.0008) [2023-12-26 03:46:13,456][123091] Updated weights for policy 0, policy_version 524135 (0.0005) [2023-12-26 03:46:13,461][123090] Updated weights for policy 1, policy_version 520410 (0.0009) [2023-12-26 03:46:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 267411456. Throughput: 0: 8679.5, 1: 8699.8. Samples: 267402992. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:13,785][121949] Avg episode reward: [(0, '6294.948'), (1, '5750.784')] [2023-12-26 03:46:14,132][123090] Updated weights for policy 1, policy_version 520420 (0.0010) [2023-12-26 03:46:14,181][123090] Updated weights for policy 1, policy_version 520430 (0.0009) [2023-12-26 03:46:14,237][123090] Updated weights for policy 1, policy_version 520440 (0.0009) [2023-12-26 03:46:14,292][123091] Updated weights for policy 0, policy_version 524145 (0.0007) [2023-12-26 03:46:14,351][123091] Updated weights for policy 0, policy_version 524155 (0.0008) [2023-12-26 03:46:14,407][123091] Updated weights for policy 0, policy_version 524165 (0.0009) [2023-12-26 03:46:14,459][123091] Updated weights for policy 0, policy_version 524175 (0.0009) [2023-12-26 03:46:14,992][123090] Updated weights for policy 1, policy_version 520450 (0.0009) [2023-12-26 03:46:15,061][123090] Updated weights for policy 1, policy_version 520460 (0.0006) [2023-12-26 03:46:15,126][123090] Updated weights for policy 1, policy_version 520470 (0.0008) [2023-12-26 03:46:15,198][123090] Updated weights for policy 1, policy_version 520480 (0.0006) [2023-12-26 03:46:15,318][123091] Updated weights for policy 0, policy_version 524185 (0.0010) [2023-12-26 03:46:15,390][123091] Updated weights for policy 0, policy_version 524195 (0.0010) [2023-12-26 03:46:15,460][123091] Updated weights for policy 0, policy_version 524205 (0.0010) [2023-12-26 03:46:15,963][123090] Updated weights for policy 1, policy_version 520490 (0.0008) [2023-12-26 03:46:16,018][123090] Updated weights for policy 1, policy_version 520500 (0.0008) [2023-12-26 03:46:16,081][123090] Updated weights for policy 1, policy_version 520510 (0.0010) [2023-12-26 03:46:16,258][123091] Updated weights for policy 0, policy_version 524215 (0.0009) [2023-12-26 03:46:16,306][123091] Updated weights for policy 0, policy_version 524225 (0.0009) [2023-12-26 03:46:16,358][123091] Updated weights for policy 0, policy_version 524236 (0.0007) [2023-12-26 03:46:16,871][123090] Updated weights for policy 1, policy_version 520520 (0.0006) [2023-12-26 03:46:16,936][123090] Updated weights for policy 1, policy_version 520530 (0.0005) [2023-12-26 03:46:17,001][123090] Updated weights for policy 1, policy_version 520540 (0.0006) [2023-12-26 03:46:17,171][123091] Updated weights for policy 0, policy_version 524246 (0.0009) [2023-12-26 03:46:17,229][123091] Updated weights for policy 0, policy_version 524256 (0.0010) [2023-12-26 03:46:17,283][123091] Updated weights for policy 0, policy_version 524266 (0.0010) [2023-12-26 03:46:17,641][123090] Updated weights for policy 1, policy_version 520550 (0.0008) [2023-12-26 03:46:17,687][123090] Updated weights for policy 1, policy_version 520560 (0.0010) [2023-12-26 03:46:17,737][123090] Updated weights for policy 1, policy_version 520570 (0.0007) [2023-12-26 03:46:17,999][123091] Updated weights for policy 0, policy_version 524276 (0.0008) [2023-12-26 03:46:18,054][123091] Updated weights for policy 0, policy_version 524286 (0.0005) [2023-12-26 03:46:18,110][123091] Updated weights for policy 0, policy_version 524296 (0.0005) [2023-12-26 03:46:18,551][123090] Updated weights for policy 1, policy_version 520580 (0.0010) [2023-12-26 03:46:18,615][123090] Updated weights for policy 1, policy_version 520590 (0.0010) [2023-12-26 03:46:18,674][123090] Updated weights for policy 1, policy_version 520600 (0.0011) [2023-12-26 03:46:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 267501568. Throughput: 0: 8658.4, 1: 8742.7. Samples: 267512588. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:18,785][121949] Avg episode reward: [(0, '6223.639'), (1, '5773.531')] [2023-12-26 03:46:18,834][123091] Updated weights for policy 0, policy_version 524306 (0.0006) [2023-12-26 03:46:18,908][123091] Updated weights for policy 0, policy_version 524316 (0.0011) [2023-12-26 03:46:18,978][123091] Updated weights for policy 0, policy_version 524326 (0.0011) [2023-12-26 03:46:19,026][123091] Updated weights for policy 0, policy_version 524336 (0.0010) [2023-12-26 03:46:19,427][123090] Updated weights for policy 1, policy_version 520610 (0.0010) [2023-12-26 03:46:19,499][123090] Updated weights for policy 1, policy_version 520620 (0.0009) [2023-12-26 03:46:19,564][123090] Updated weights for policy 1, policy_version 520630 (0.0009) [2023-12-26 03:46:19,633][123090] Updated weights for policy 1, policy_version 520640 (0.0009) [2023-12-26 03:46:19,872][123091] Updated weights for policy 0, policy_version 524346 (0.0009) [2023-12-26 03:46:19,945][123091] Updated weights for policy 0, policy_version 524356 (0.0007) [2023-12-26 03:46:20,012][123091] Updated weights for policy 0, policy_version 524366 (0.0007) [2023-12-26 03:46:20,372][123090] Updated weights for policy 1, policy_version 520650 (0.0009) [2023-12-26 03:46:20,442][123090] Updated weights for policy 1, policy_version 520660 (0.0009) [2023-12-26 03:46:20,497][123090] Updated weights for policy 1, policy_version 520670 (0.0009) [2023-12-26 03:46:20,777][123091] Updated weights for policy 0, policy_version 524376 (0.0010) [2023-12-26 03:46:20,843][123091] Updated weights for policy 0, policy_version 524386 (0.0009) [2023-12-26 03:46:20,908][123091] Updated weights for policy 0, policy_version 524396 (0.0008) [2023-12-26 03:46:21,396][123090] Updated weights for policy 1, policy_version 520680 (0.0010) [2023-12-26 03:46:21,454][123090] Updated weights for policy 1, policy_version 520690 (0.0007) [2023-12-26 03:46:21,509][123090] Updated weights for policy 1, policy_version 520700 (0.0006) [2023-12-26 03:46:21,745][123091] Updated weights for policy 0, policy_version 524406 (0.0009) [2023-12-26 03:46:21,805][123091] Updated weights for policy 0, policy_version 524416 (0.0010) [2023-12-26 03:46:21,858][123091] Updated weights for policy 0, policy_version 524426 (0.0009) [2023-12-26 03:46:22,344][123090] Updated weights for policy 1, policy_version 520710 (0.0008) [2023-12-26 03:46:22,408][123090] Updated weights for policy 1, policy_version 520720 (0.0009) [2023-12-26 03:46:22,459][123090] Updated weights for policy 1, policy_version 520730 (0.0009) [2023-12-26 03:46:22,602][123091] Updated weights for policy 0, policy_version 524436 (0.0009) [2023-12-26 03:46:22,663][123091] Updated weights for policy 0, policy_version 524446 (0.0006) [2023-12-26 03:46:22,724][123091] Updated weights for policy 0, policy_version 524456 (0.0006) [2023-12-26 03:46:23,372][123090] Updated weights for policy 1, policy_version 520740 (0.0010) [2023-12-26 03:46:23,427][123090] Updated weights for policy 1, policy_version 520751 (0.0009) [2023-12-26 03:46:23,460][123091] Updated weights for policy 0, policy_version 524466 (0.0006) [2023-12-26 03:46:23,474][123090] Updated weights for policy 1, policy_version 520761 (0.0009) [2023-12-26 03:46:23,518][123091] Updated weights for policy 0, policy_version 524476 (0.0008) [2023-12-26 03:46:23,566][123091] Updated weights for policy 0, policy_version 524486 (0.0009) [2023-12-26 03:46:23,619][123091] Updated weights for policy 0, policy_version 524496 (0.0010) [2023-12-26 03:46:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 267591680. Throughput: 0: 8663.2, 1: 8751.9. Samples: 267564412. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:23,785][121949] Avg episode reward: [(0, '6148.214'), (1, '5775.520')] [2023-12-26 03:46:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000520768_133316608.pth... [2023-12-26 03:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000524496_134275072.pth... [2023-12-26 03:46:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000519744_133054464.pth [2023-12-26 03:46:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000523472_134012928.pth [2023-12-26 03:46:24,240][123090] Updated weights for policy 1, policy_version 520771 (0.0008) [2023-12-26 03:46:24,294][123090] Updated weights for policy 1, policy_version 520781 (0.0007) [2023-12-26 03:46:24,355][123090] Updated weights for policy 1, policy_version 520791 (0.0009) [2023-12-26 03:46:24,482][123091] Updated weights for policy 0, policy_version 524506 (0.0007) [2023-12-26 03:46:24,533][123091] Updated weights for policy 0, policy_version 524516 (0.0008) [2023-12-26 03:46:24,590][123091] Updated weights for policy 0, policy_version 524526 (0.0009) [2023-12-26 03:46:25,177][123090] Updated weights for policy 1, policy_version 520801 (0.0009) [2023-12-26 03:46:25,240][123090] Updated weights for policy 1, policy_version 520811 (0.0008) [2023-12-26 03:46:25,300][123090] Updated weights for policy 1, policy_version 520821 (0.0009) [2023-12-26 03:46:25,343][123091] Updated weights for policy 0, policy_version 524536 (0.0009) [2023-12-26 03:46:25,356][123090] Updated weights for policy 1, policy_version 520831 (0.0007) [2023-12-26 03:46:25,397][123091] Updated weights for policy 0, policy_version 524547 (0.0007) [2023-12-26 03:46:25,445][123091] Updated weights for policy 0, policy_version 524557 (0.0010) [2023-12-26 03:46:26,156][123090] Updated weights for policy 1, policy_version 520841 (0.0009) [2023-12-26 03:46:26,203][123090] Updated weights for policy 1, policy_version 520851 (0.0008) [2023-12-26 03:46:26,258][123090] Updated weights for policy 1, policy_version 520862 (0.0008) [2023-12-26 03:46:26,297][123091] Updated weights for policy 0, policy_version 524567 (0.0009) [2023-12-26 03:46:26,364][123091] Updated weights for policy 0, policy_version 524577 (0.0010) [2023-12-26 03:46:26,435][123091] Updated weights for policy 0, policy_version 524587 (0.0010) [2023-12-26 03:46:26,989][123090] Updated weights for policy 1, policy_version 520872 (0.0009) [2023-12-26 03:46:27,049][123090] Updated weights for policy 1, policy_version 520882 (0.0010) [2023-12-26 03:46:27,071][123091] Updated weights for policy 0, policy_version 524597 (0.0008) [2023-12-26 03:46:27,098][123090] Updated weights for policy 1, policy_version 520892 (0.0010) [2023-12-26 03:46:27,128][123091] Updated weights for policy 0, policy_version 524607 (0.0005) [2023-12-26 03:46:27,187][123091] Updated weights for policy 0, policy_version 524617 (0.0005) [2023-12-26 03:46:27,849][123090] Updated weights for policy 1, policy_version 520902 (0.0009) [2023-12-26 03:46:27,895][123090] Updated weights for policy 1, policy_version 520912 (0.0008) [2023-12-26 03:46:27,925][123091] Updated weights for policy 0, policy_version 524627 (0.0008) [2023-12-26 03:46:27,949][123090] Updated weights for policy 1, policy_version 520922 (0.0007) [2023-12-26 03:46:27,975][123091] Updated weights for policy 0, policy_version 524637 (0.0010) [2023-12-26 03:46:28,030][123091] Updated weights for policy 0, policy_version 524647 (0.0008) [2023-12-26 03:46:28,708][123090] Updated weights for policy 1, policy_version 520932 (0.0007) [2023-12-26 03:46:28,769][123090] Updated weights for policy 1, policy_version 520942 (0.0009) [2023-12-26 03:46:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 267673600. Throughput: 0: 8700.6, 1: 8817.6. Samples: 267673036. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:28,785][121949] Avg episode reward: [(0, '6086.758'), (1, '5785.626')] [2023-12-26 03:46:28,786][123091] Updated weights for policy 0, policy_version 524657 (0.0010) [2023-12-26 03:46:28,824][123090] Updated weights for policy 1, policy_version 520952 (0.0009) [2023-12-26 03:46:28,845][123091] Updated weights for policy 0, policy_version 524667 (0.0006) [2023-12-26 03:46:28,903][123091] Updated weights for policy 0, policy_version 524677 (0.0006) [2023-12-26 03:46:28,953][123091] Updated weights for policy 0, policy_version 524687 (0.0005) [2023-12-26 03:46:29,667][123091] Updated weights for policy 0, policy_version 524697 (0.0008) [2023-12-26 03:46:29,675][123090] Updated weights for policy 1, policy_version 520962 (0.0008) [2023-12-26 03:46:29,724][123091] Updated weights for policy 0, policy_version 524707 (0.0010) [2023-12-26 03:46:29,731][123090] Updated weights for policy 1, policy_version 520972 (0.0007) [2023-12-26 03:46:29,770][123091] Updated weights for policy 0, policy_version 524717 (0.0008) [2023-12-26 03:46:29,791][123090] Updated weights for policy 1, policy_version 520982 (0.0008) [2023-12-26 03:46:29,865][123090] Updated weights for policy 1, policy_version 520992 (0.0009) [2023-12-26 03:46:30,568][123091] Updated weights for policy 0, policy_version 524727 (0.0010) [2023-12-26 03:46:30,632][123091] Updated weights for policy 0, policy_version 524737 (0.0008) [2023-12-26 03:46:30,659][123090] Updated weights for policy 1, policy_version 521002 (0.0009) [2023-12-26 03:46:30,707][123091] Updated weights for policy 0, policy_version 524747 (0.0006) [2023-12-26 03:46:30,715][123090] Updated weights for policy 1, policy_version 521012 (0.0007) [2023-12-26 03:46:30,774][123090] Updated weights for policy 1, policy_version 521022 (0.0005) [2023-12-26 03:46:31,456][123090] Updated weights for policy 1, policy_version 521032 (0.0009) [2023-12-26 03:46:31,519][123090] Updated weights for policy 1, policy_version 521042 (0.0008) [2023-12-26 03:46:31,527][123091] Updated weights for policy 0, policy_version 524757 (0.0007) [2023-12-26 03:46:31,585][123090] Updated weights for policy 1, policy_version 521052 (0.0005) [2023-12-26 03:46:31,591][123091] Updated weights for policy 0, policy_version 524767 (0.0006) [2023-12-26 03:46:31,662][123091] Updated weights for policy 0, policy_version 524777 (0.0009) [2023-12-26 03:46:32,390][123090] Updated weights for policy 1, policy_version 521062 (0.0008) [2023-12-26 03:46:32,459][123090] Updated weights for policy 1, policy_version 521072 (0.0009) [2023-12-26 03:46:32,514][123091] Updated weights for policy 0, policy_version 524787 (0.0011) [2023-12-26 03:46:32,530][123090] Updated weights for policy 1, policy_version 521082 (0.0008) [2023-12-26 03:46:32,579][123091] Updated weights for policy 0, policy_version 524797 (0.0010) [2023-12-26 03:46:32,641][123091] Updated weights for policy 0, policy_version 524807 (0.0010) [2023-12-26 03:46:33,292][123090] Updated weights for policy 1, policy_version 521092 (0.0005) [2023-12-26 03:46:33,366][123090] Updated weights for policy 1, policy_version 521102 (0.0007) [2023-12-26 03:46:33,435][123090] Updated weights for policy 1, policy_version 521112 (0.0009) [2023-12-26 03:46:33,468][123091] Updated weights for policy 0, policy_version 524817 (0.0009) [2023-12-26 03:46:33,518][123091] Updated weights for policy 0, policy_version 524827 (0.0009) [2023-12-26 03:46:33,567][123091] Updated weights for policy 0, policy_version 524837 (0.0009) [2023-12-26 03:46:33,620][123091] Updated weights for policy 0, policy_version 524847 (0.0009) [2023-12-26 03:46:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 267771904. Throughput: 0: 8697.7, 1: 8767.9. Samples: 267780168. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:33,785][121949] Avg episode reward: [(0, '6104.916'), (1, '5830.856')] [2023-12-26 03:46:34,110][123090] Updated weights for policy 1, policy_version 521122 (0.0009) [2023-12-26 03:46:34,201][123090] Updated weights for policy 1, policy_version 521132 (0.0007) [2023-12-26 03:46:34,267][123090] Updated weights for policy 1, policy_version 521142 (0.0005) [2023-12-26 03:46:34,327][123090] Updated weights for policy 1, policy_version 521152 (0.0005) [2023-12-26 03:46:34,566][123091] Updated weights for policy 0, policy_version 524857 (0.0006) [2023-12-26 03:46:34,625][123091] Updated weights for policy 0, policy_version 524867 (0.0006) [2023-12-26 03:46:34,678][123091] Updated weights for policy 0, policy_version 524877 (0.0009) [2023-12-26 03:46:35,070][123090] Updated weights for policy 1, policy_version 521162 (0.0009) [2023-12-26 03:46:35,135][123090] Updated weights for policy 1, policy_version 521172 (0.0009) [2023-12-26 03:46:35,196][123090] Updated weights for policy 1, policy_version 521182 (0.0009) [2023-12-26 03:46:35,492][123091] Updated weights for policy 0, policy_version 524887 (0.0009) [2023-12-26 03:46:35,544][123091] Updated weights for policy 0, policy_version 524898 (0.0010) [2023-12-26 03:46:35,592][123091] Updated weights for policy 0, policy_version 524908 (0.0009) [2023-12-26 03:46:35,996][123090] Updated weights for policy 1, policy_version 521192 (0.0010) [2023-12-26 03:46:36,060][123090] Updated weights for policy 1, policy_version 521202 (0.0010) [2023-12-26 03:46:36,123][123090] Updated weights for policy 1, policy_version 521212 (0.0010) [2023-12-26 03:46:36,454][123091] Updated weights for policy 0, policy_version 524918 (0.0009) [2023-12-26 03:46:36,526][123091] Updated weights for policy 0, policy_version 524928 (0.0009) [2023-12-26 03:46:36,588][123091] Updated weights for policy 0, policy_version 524938 (0.0009) [2023-12-26 03:46:36,941][123090] Updated weights for policy 1, policy_version 521222 (0.0009) [2023-12-26 03:46:36,988][123090] Updated weights for policy 1, policy_version 521232 (0.0009) [2023-12-26 03:46:37,047][123090] Updated weights for policy 1, policy_version 521242 (0.0009) [2023-12-26 03:46:37,417][123091] Updated weights for policy 0, policy_version 524948 (0.0010) [2023-12-26 03:46:37,465][123091] Updated weights for policy 0, policy_version 524958 (0.0008) [2023-12-26 03:46:37,525][123091] Updated weights for policy 0, policy_version 524968 (0.0010) [2023-12-26 03:46:37,912][123090] Updated weights for policy 1, policy_version 521252 (0.0009) [2023-12-26 03:46:38,002][123090] Updated weights for policy 1, policy_version 521262 (0.0009) [2023-12-26 03:46:38,057][123090] Updated weights for policy 1, policy_version 521272 (0.0010) [2023-12-26 03:46:38,392][123091] Updated weights for policy 0, policy_version 524978 (0.0010) [2023-12-26 03:46:38,454][123091] Updated weights for policy 0, policy_version 524988 (0.0009) [2023-12-26 03:46:38,520][123091] Updated weights for policy 0, policy_version 524998 (0.0009) [2023-12-26 03:46:38,588][123091] Updated weights for policy 0, policy_version 525008 (0.0009) [2023-12-26 03:46:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 267853824. Throughput: 0: 8702.6, 1: 8780.5. Samples: 267832624. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:38,785][121949] Avg episode reward: [(0, '6050.547'), (1, '5718.951')] [2023-12-26 03:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000525008_134406144.pth... [2023-12-26 03:46:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000521280_133447680.pth... [2023-12-26 03:46:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000520256_133185536.pth [2023-12-26 03:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000523984_134144000.pth [2023-12-26 03:46:38,895][123090] Updated weights for policy 1, policy_version 521282 (0.0009) [2023-12-26 03:46:38,952][123090] Updated weights for policy 1, policy_version 521292 (0.0009) [2023-12-26 03:46:39,014][123090] Updated weights for policy 1, policy_version 521302 (0.0009) [2023-12-26 03:46:39,076][123090] Updated weights for policy 1, policy_version 521312 (0.0009) [2023-12-26 03:46:39,429][123091] Updated weights for policy 0, policy_version 525018 (0.0010) [2023-12-26 03:46:39,479][123091] Updated weights for policy 0, policy_version 525028 (0.0009) [2023-12-26 03:46:39,545][123091] Updated weights for policy 0, policy_version 525038 (0.0010) [2023-12-26 03:46:39,925][123090] Updated weights for policy 1, policy_version 521322 (0.0010) [2023-12-26 03:46:39,991][123090] Updated weights for policy 1, policy_version 521332 (0.0010) [2023-12-26 03:46:40,059][123090] Updated weights for policy 1, policy_version 521342 (0.0009) [2023-12-26 03:46:40,363][123091] Updated weights for policy 0, policy_version 525048 (0.0008) [2023-12-26 03:46:40,425][123091] Updated weights for policy 0, policy_version 525058 (0.0009) [2023-12-26 03:46:40,481][123091] Updated weights for policy 0, policy_version 525068 (0.0007) [2023-12-26 03:46:40,878][123090] Updated weights for policy 1, policy_version 521352 (0.0009) [2023-12-26 03:46:40,931][123090] Updated weights for policy 1, policy_version 521362 (0.0010) [2023-12-26 03:46:40,985][123090] Updated weights for policy 1, policy_version 521372 (0.0010) [2023-12-26 03:46:41,306][123091] Updated weights for policy 0, policy_version 525078 (0.0008) [2023-12-26 03:46:41,370][123091] Updated weights for policy 0, policy_version 525088 (0.0008) [2023-12-26 03:46:41,443][123091] Updated weights for policy 0, policy_version 525098 (0.0008) [2023-12-26 03:46:41,907][123090] Updated weights for policy 1, policy_version 521382 (0.0010) [2023-12-26 03:46:41,983][123090] Updated weights for policy 1, policy_version 521392 (0.0010) [2023-12-26 03:46:42,056][123090] Updated weights for policy 1, policy_version 521402 (0.0010) [2023-12-26 03:46:42,212][123091] Updated weights for policy 0, policy_version 525108 (0.0009) [2023-12-26 03:46:42,272][123091] Updated weights for policy 0, policy_version 525118 (0.0010) [2023-12-26 03:46:42,336][123091] Updated weights for policy 0, policy_version 525128 (0.0009) [2023-12-26 03:46:42,888][123090] Updated weights for policy 1, policy_version 521412 (0.0010) [2023-12-26 03:46:42,956][123090] Updated weights for policy 1, policy_version 521422 (0.0010) [2023-12-26 03:46:43,020][123090] Updated weights for policy 1, policy_version 521432 (0.0010) [2023-12-26 03:46:43,162][123091] Updated weights for policy 0, policy_version 525138 (0.0010) [2023-12-26 03:46:43,222][123091] Updated weights for policy 0, policy_version 525148 (0.0008) [2023-12-26 03:46:43,287][123091] Updated weights for policy 0, policy_version 525158 (0.0009) [2023-12-26 03:46:43,349][123091] Updated weights for policy 0, policy_version 525168 (0.0006) [2023-12-26 03:46:43,704][123090] Updated weights for policy 1, policy_version 521442 (0.0009) [2023-12-26 03:46:43,761][123090] Updated weights for policy 1, policy_version 521452 (0.0005) [2023-12-26 03:46:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 267935744. Throughput: 0: 8705.0, 1: 8726.6. Samples: 267933232. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:43,785][121949] Avg episode reward: [(0, '6035.771'), (1, '5760.088')] [2023-12-26 03:46:43,816][123090] Updated weights for policy 1, policy_version 521462 (0.0005) [2023-12-26 03:46:43,873][123090] Updated weights for policy 1, policy_version 521472 (0.0005) [2023-12-26 03:46:44,043][123091] Updated weights for policy 0, policy_version 525178 (0.0005) [2023-12-26 03:46:44,115][123091] Updated weights for policy 0, policy_version 525188 (0.0006) [2023-12-26 03:46:44,183][123091] Updated weights for policy 0, policy_version 525198 (0.0008) [2023-12-26 03:46:44,532][123090] Updated weights for policy 1, policy_version 521482 (0.0006) [2023-12-26 03:46:44,596][123090] Updated weights for policy 1, policy_version 521492 (0.0009) [2023-12-26 03:46:44,650][123090] Updated weights for policy 1, policy_version 521502 (0.0009) [2023-12-26 03:46:44,982][123091] Updated weights for policy 0, policy_version 525208 (0.0010) [2023-12-26 03:46:45,050][123091] Updated weights for policy 0, policy_version 525218 (0.0010) [2023-12-26 03:46:45,121][123091] Updated weights for policy 0, policy_version 525228 (0.0010) [2023-12-26 03:46:45,491][123090] Updated weights for policy 1, policy_version 521512 (0.0009) [2023-12-26 03:46:45,558][123090] Updated weights for policy 1, policy_version 521522 (0.0010) [2023-12-26 03:46:45,629][123090] Updated weights for policy 1, policy_version 521532 (0.0008) [2023-12-26 03:46:45,911][123091] Updated weights for policy 0, policy_version 525238 (0.0007) [2023-12-26 03:46:45,965][123091] Updated weights for policy 0, policy_version 525248 (0.0008) [2023-12-26 03:46:46,019][123091] Updated weights for policy 0, policy_version 525259 (0.0010) [2023-12-26 03:46:46,302][123090] Updated weights for policy 1, policy_version 521542 (0.0007) [2023-12-26 03:46:46,356][123090] Updated weights for policy 1, policy_version 521552 (0.0005) [2023-12-26 03:46:46,414][123090] Updated weights for policy 1, policy_version 521562 (0.0005) [2023-12-26 03:46:46,920][123091] Updated weights for policy 0, policy_version 525269 (0.0010) [2023-12-26 03:46:46,974][123091] Updated weights for policy 0, policy_version 525281 (0.0010) [2023-12-26 03:46:47,028][123090] Updated weights for policy 1, policy_version 521572 (0.0005) [2023-12-26 03:46:47,033][123091] Updated weights for policy 0, policy_version 525291 (0.0009) [2023-12-26 03:46:47,094][123090] Updated weights for policy 1, policy_version 521582 (0.0005) [2023-12-26 03:46:47,162][123090] Updated weights for policy 1, policy_version 521592 (0.0005) [2023-12-26 03:46:47,870][123090] Updated weights for policy 1, policy_version 521602 (0.0006) [2023-12-26 03:46:47,878][123091] Updated weights for policy 0, policy_version 525301 (0.0007) [2023-12-26 03:46:47,925][123090] Updated weights for policy 1, policy_version 521612 (0.0010) [2023-12-26 03:46:47,927][123091] Updated weights for policy 0, policy_version 525311 (0.0005) [2023-12-26 03:46:47,978][123091] Updated weights for policy 0, policy_version 525321 (0.0006) [2023-12-26 03:46:47,978][123090] Updated weights for policy 1, policy_version 521622 (0.0010) [2023-12-26 03:46:48,026][123090] Updated weights for policy 1, policy_version 521632 (0.0010) [2023-12-26 03:46:48,699][123091] Updated weights for policy 0, policy_version 525331 (0.0009) [2023-12-26 03:46:48,756][123091] Updated weights for policy 0, policy_version 525341 (0.0010) [2023-12-26 03:46:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17772.5). Total num frames: 268025856. Throughput: 0: 8767.3, 1: 8856.5. Samples: 268042900. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:48,785][121949] Avg episode reward: [(0, '6166.851'), (1, '5834.002')] [2023-12-26 03:46:48,826][123091] Updated weights for policy 0, policy_version 525351 (0.0011) [2023-12-26 03:46:48,949][123090] Updated weights for policy 1, policy_version 521642 (0.0009) [2023-12-26 03:46:49,022][123090] Updated weights for policy 1, policy_version 521652 (0.0011) [2023-12-26 03:46:49,093][123090] Updated weights for policy 1, policy_version 521662 (0.0009) [2023-12-26 03:46:49,571][123091] Updated weights for policy 0, policy_version 525361 (0.0010) [2023-12-26 03:46:49,626][123091] Updated weights for policy 0, policy_version 525371 (0.0010) [2023-12-26 03:46:49,681][123091] Updated weights for policy 0, policy_version 525381 (0.0010) [2023-12-26 03:46:49,740][123091] Updated weights for policy 0, policy_version 525391 (0.0011) [2023-12-26 03:46:49,807][123090] Updated weights for policy 1, policy_version 521672 (0.0005) [2023-12-26 03:46:49,874][123090] Updated weights for policy 1, policy_version 521682 (0.0006) [2023-12-26 03:46:49,937][123090] Updated weights for policy 1, policy_version 521692 (0.0007) [2023-12-26 03:46:50,476][123091] Updated weights for policy 0, policy_version 525401 (0.0006) [2023-12-26 03:46:50,546][123091] Updated weights for policy 0, policy_version 525411 (0.0010) [2023-12-26 03:46:50,612][123091] Updated weights for policy 0, policy_version 525421 (0.0009) [2023-12-26 03:46:50,638][123090] Updated weights for policy 1, policy_version 521702 (0.0007) [2023-12-26 03:46:50,706][123090] Updated weights for policy 1, policy_version 521712 (0.0006) [2023-12-26 03:46:50,774][123090] Updated weights for policy 1, policy_version 521722 (0.0005) [2023-12-26 03:46:51,425][123091] Updated weights for policy 0, policy_version 525431 (0.0010) [2023-12-26 03:46:51,480][123091] Updated weights for policy 0, policy_version 525441 (0.0009) [2023-12-26 03:46:51,524][123090] Updated weights for policy 1, policy_version 521732 (0.0005) [2023-12-26 03:46:51,547][123091] Updated weights for policy 0, policy_version 525451 (0.0008) [2023-12-26 03:46:51,589][123090] Updated weights for policy 1, policy_version 521742 (0.0006) [2023-12-26 03:46:51,659][123090] Updated weights for policy 1, policy_version 521752 (0.0007) [2023-12-26 03:46:52,385][123091] Updated weights for policy 0, policy_version 525461 (0.0008) [2023-12-26 03:46:52,415][123090] Updated weights for policy 1, policy_version 521762 (0.0009) [2023-12-26 03:46:52,444][123091] Updated weights for policy 0, policy_version 525471 (0.0007) [2023-12-26 03:46:52,472][123090] Updated weights for policy 1, policy_version 521772 (0.0009) [2023-12-26 03:46:52,503][123091] Updated weights for policy 0, policy_version 525481 (0.0007) [2023-12-26 03:46:52,524][123090] Updated weights for policy 1, policy_version 521782 (0.0009) [2023-12-26 03:46:52,579][123090] Updated weights for policy 1, policy_version 521792 (0.0009) [2023-12-26 03:46:53,303][123091] Updated weights for policy 0, policy_version 525491 (0.0008) [2023-12-26 03:46:53,352][123091] Updated weights for policy 0, policy_version 525501 (0.0010) [2023-12-26 03:46:53,405][123091] Updated weights for policy 0, policy_version 525511 (0.0008) [2023-12-26 03:46:53,463][123090] Updated weights for policy 1, policy_version 521802 (0.0009) [2023-12-26 03:46:53,522][123090] Updated weights for policy 1, policy_version 521812 (0.0009) [2023-12-26 03:46:53,571][123090] Updated weights for policy 1, policy_version 521822 (0.0009) [2023-12-26 03:46:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 268124160. Throughput: 0: 8767.4, 1: 8931.2. Samples: 268098348. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:53,785][121949] Avg episode reward: [(0, '6181.408'), (1, '5716.102')] [2023-12-26 03:46:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000521824_133586944.pth... [2023-12-26 03:46:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000525520_134537216.pth... [2023-12-26 03:46:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000520768_133316608.pth [2023-12-26 03:46:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000524496_134275072.pth [2023-12-26 03:46:54,202][123091] Updated weights for policy 0, policy_version 525521 (0.0008) [2023-12-26 03:46:54,268][123091] Updated weights for policy 0, policy_version 525531 (0.0005) [2023-12-26 03:46:54,334][123091] Updated weights for policy 0, policy_version 525541 (0.0005) [2023-12-26 03:46:54,402][123091] Updated weights for policy 0, policy_version 525551 (0.0006) [2023-12-26 03:46:54,458][123090] Updated weights for policy 1, policy_version 521832 (0.0010) [2023-12-26 03:46:54,521][123090] Updated weights for policy 1, policy_version 521842 (0.0010) [2023-12-26 03:46:54,583][123090] Updated weights for policy 1, policy_version 521852 (0.0008) [2023-12-26 03:46:55,167][123091] Updated weights for policy 0, policy_version 525561 (0.0010) [2023-12-26 03:46:55,231][123091] Updated weights for policy 0, policy_version 525571 (0.0010) [2023-12-26 03:46:55,292][123091] Updated weights for policy 0, policy_version 525581 (0.0010) [2023-12-26 03:46:55,321][123090] Updated weights for policy 1, policy_version 521862 (0.0007) [2023-12-26 03:46:55,376][123090] Updated weights for policy 1, policy_version 521872 (0.0009) [2023-12-26 03:46:55,433][123090] Updated weights for policy 1, policy_version 521883 (0.0010) [2023-12-26 03:46:55,911][123091] Updated weights for policy 0, policy_version 525591 (0.0006) [2023-12-26 03:46:55,974][123091] Updated weights for policy 0, policy_version 525601 (0.0006) [2023-12-26 03:46:56,030][123091] Updated weights for policy 0, policy_version 525611 (0.0006) [2023-12-26 03:46:56,312][123090] Updated weights for policy 1, policy_version 521893 (0.0009) [2023-12-26 03:46:56,372][123090] Updated weights for policy 1, policy_version 521903 (0.0010) [2023-12-26 03:46:56,429][123090] Updated weights for policy 1, policy_version 521914 (0.0010) [2023-12-26 03:46:56,697][123091] Updated weights for policy 0, policy_version 525621 (0.0006) [2023-12-26 03:46:56,755][123091] Updated weights for policy 0, policy_version 525631 (0.0006) [2023-12-26 03:46:56,807][123091] Updated weights for policy 0, policy_version 525641 (0.0010) [2023-12-26 03:46:57,314][123090] Updated weights for policy 1, policy_version 521924 (0.0010) [2023-12-26 03:46:57,384][123090] Updated weights for policy 1, policy_version 521934 (0.0009) [2023-12-26 03:46:57,448][123090] Updated weights for policy 1, policy_version 521944 (0.0009) [2023-12-26 03:46:57,542][123091] Updated weights for policy 0, policy_version 525651 (0.0009) [2023-12-26 03:46:57,592][123091] Updated weights for policy 0, policy_version 525661 (0.0005) [2023-12-26 03:46:57,645][123091] Updated weights for policy 0, policy_version 525671 (0.0005) [2023-12-26 03:46:58,310][123090] Updated weights for policy 1, policy_version 521954 (0.0009) [2023-12-26 03:46:58,374][123090] Updated weights for policy 1, policy_version 521964 (0.0010) [2023-12-26 03:46:58,404][123091] Updated weights for policy 0, policy_version 525681 (0.0006) [2023-12-26 03:46:58,439][123090] Updated weights for policy 1, policy_version 521974 (0.0008) [2023-12-26 03:46:58,468][123091] Updated weights for policy 0, policy_version 525691 (0.0008) [2023-12-26 03:46:58,504][123090] Updated weights for policy 1, policy_version 521984 (0.0007) [2023-12-26 03:46:58,534][123091] Updated weights for policy 0, policy_version 525701 (0.0008) [2023-12-26 03:46:58,602][123091] Updated weights for policy 0, policy_version 525711 (0.0008) [2023-12-26 03:46:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.7, 300 sec: 17800.2). Total num frames: 268214272. Throughput: 0: 8890.6, 1: 8939.3. Samples: 268205336. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:46:58,785][121949] Avg episode reward: [(0, '6186.328'), (1, '5329.092')] [2023-12-26 03:46:59,422][123091] Updated weights for policy 0, policy_version 525721 (0.0010) [2023-12-26 03:46:59,482][123091] Updated weights for policy 0, policy_version 525731 (0.0007) [2023-12-26 03:46:59,484][123090] Updated weights for policy 1, policy_version 521994 (0.0010) [2023-12-26 03:46:59,539][123091] Updated weights for policy 0, policy_version 525741 (0.0006) [2023-12-26 03:46:59,551][123090] Updated weights for policy 1, policy_version 522004 (0.0009) [2023-12-26 03:46:59,631][123090] Updated weights for policy 1, policy_version 522014 (0.0010) [2023-12-26 03:47:00,376][123091] Updated weights for policy 0, policy_version 525751 (0.0009) [2023-12-26 03:47:00,410][123090] Updated weights for policy 1, policy_version 522024 (0.0009) [2023-12-26 03:47:00,427][123091] Updated weights for policy 0, policy_version 525761 (0.0007) [2023-12-26 03:47:00,464][123090] Updated weights for policy 1, policy_version 522034 (0.0007) [2023-12-26 03:47:00,493][123091] Updated weights for policy 0, policy_version 525771 (0.0009) [2023-12-26 03:47:00,514][123090] Updated weights for policy 1, policy_version 522044 (0.0007) [2023-12-26 03:47:01,247][123091] Updated weights for policy 0, policy_version 525781 (0.0008) [2023-12-26 03:47:01,310][123091] Updated weights for policy 0, policy_version 525791 (0.0010) [2023-12-26 03:47:01,381][123091] Updated weights for policy 0, policy_version 525801 (0.0010) [2023-12-26 03:47:01,443][123090] Updated weights for policy 1, policy_version 522054 (0.0008) [2023-12-26 03:47:01,496][123090] Updated weights for policy 1, policy_version 522064 (0.0009) [2023-12-26 03:47:01,552][123090] Updated weights for policy 1, policy_version 522074 (0.0009) [2023-12-26 03:47:02,146][123091] Updated weights for policy 0, policy_version 525811 (0.0008) [2023-12-26 03:47:02,212][123091] Updated weights for policy 0, policy_version 525821 (0.0008) [2023-12-26 03:47:02,272][123091] Updated weights for policy 0, policy_version 525831 (0.0008) [2023-12-26 03:47:02,457][123090] Updated weights for policy 1, policy_version 522084 (0.0009) [2023-12-26 03:47:02,513][123090] Updated weights for policy 1, policy_version 522094 (0.0009) [2023-12-26 03:47:02,567][123090] Updated weights for policy 1, policy_version 522104 (0.0010) [2023-12-26 03:47:02,932][123091] Updated weights for policy 0, policy_version 525841 (0.0006) [2023-12-26 03:47:02,992][123091] Updated weights for policy 0, policy_version 525851 (0.0005) [2023-12-26 03:47:03,062][123091] Updated weights for policy 0, policy_version 525861 (0.0005) [2023-12-26 03:47:03,126][123091] Updated weights for policy 0, policy_version 525871 (0.0005) [2023-12-26 03:47:03,504][123090] Updated weights for policy 1, policy_version 522115 (0.0010) [2023-12-26 03:47:03,556][123090] Updated weights for policy 1, policy_version 522125 (0.0010) [2023-12-26 03:47:03,612][123090] Updated weights for policy 1, policy_version 522136 (0.0009) [2023-12-26 03:47:03,743][123091] Updated weights for policy 0, policy_version 525881 (0.0005) [2023-12-26 03:47:03,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 268296192. Throughput: 0: 8934.3, 1: 8752.2. Samples: 268308480. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:47:03,784][121949] Avg episode reward: [(0, '6221.931'), (1, '5213.227')] [2023-12-26 03:47:03,792][123091] Updated weights for policy 0, policy_version 525891 (0.0009) [2023-12-26 03:47:03,851][123091] Updated weights for policy 0, policy_version 525901 (0.0009) [2023-12-26 03:47:04,493][123090] Updated weights for policy 1, policy_version 522146 (0.0010) [2023-12-26 03:47:04,550][123090] Updated weights for policy 1, policy_version 522156 (0.0009) [2023-12-26 03:47:04,601][123090] Updated weights for policy 1, policy_version 522166 (0.0008) [2023-12-26 03:47:04,693][123091] Updated weights for policy 0, policy_version 525911 (0.0008) [2023-12-26 03:47:04,759][123091] Updated weights for policy 0, policy_version 525921 (0.0005) [2023-12-26 03:47:04,831][123091] Updated weights for policy 0, policy_version 525931 (0.0009) [2023-12-26 03:47:05,392][123090] Updated weights for policy 1, policy_version 522177 (0.0009) [2023-12-26 03:47:05,441][123090] Updated weights for policy 1, policy_version 522187 (0.0007) [2023-12-26 03:47:05,501][123090] Updated weights for policy 1, policy_version 522197 (0.0009) [2023-12-26 03:47:05,558][123090] Updated weights for policy 1, policy_version 522207 (0.0009) [2023-12-26 03:47:05,678][123091] Updated weights for policy 0, policy_version 525941 (0.0009) [2023-12-26 03:47:05,733][123091] Updated weights for policy 0, policy_version 525951 (0.0009) [2023-12-26 03:47:05,788][123091] Updated weights for policy 0, policy_version 525961 (0.0009) [2023-12-26 03:47:06,370][123090] Updated weights for policy 1, policy_version 522217 (0.0008) [2023-12-26 03:47:06,440][123090] Updated weights for policy 1, policy_version 522227 (0.0008) [2023-12-26 03:47:06,514][123090] Updated weights for policy 1, policy_version 522237 (0.0011) [2023-12-26 03:47:06,661][123091] Updated weights for policy 0, policy_version 525971 (0.0009) [2023-12-26 03:47:06,721][123091] Updated weights for policy 0, policy_version 525981 (0.0009) [2023-12-26 03:47:06,781][123091] Updated weights for policy 0, policy_version 525991 (0.0009) [2023-12-26 03:47:07,294][123090] Updated weights for policy 1, policy_version 522247 (0.0007) [2023-12-26 03:47:07,343][123090] Updated weights for policy 1, policy_version 522257 (0.0005) [2023-12-26 03:47:07,399][123090] Updated weights for policy 1, policy_version 522267 (0.0005) [2023-12-26 03:47:07,604][123091] Updated weights for policy 0, policy_version 526001 (0.0009) [2023-12-26 03:47:07,671][123091] Updated weights for policy 0, policy_version 526011 (0.0007) [2023-12-26 03:47:07,747][123091] Updated weights for policy 0, policy_version 526021 (0.0008) [2023-12-26 03:47:07,807][123091] Updated weights for policy 0, policy_version 526031 (0.0009) [2023-12-26 03:47:08,026][123090] Updated weights for policy 1, policy_version 522277 (0.0008) [2023-12-26 03:47:08,092][123090] Updated weights for policy 1, policy_version 522287 (0.0010) [2023-12-26 03:47:08,165][123090] Updated weights for policy 1, policy_version 522297 (0.0010) [2023-12-26 03:47:08,560][123091] Updated weights for policy 0, policy_version 526041 (0.0009) [2023-12-26 03:47:08,609][123091] Updated weights for policy 0, policy_version 526051 (0.0009) [2023-12-26 03:47:08,662][123091] Updated weights for policy 0, policy_version 526061 (0.0009) [2023-12-26 03:47:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 268386304. Throughput: 0: 8926.0, 1: 8765.2. Samples: 268360512. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:47:08,784][121949] Avg episode reward: [(0, '6217.440'), (1, '5392.373')] [2023-12-26 03:47:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000526064_134676480.pth... [2023-12-26 03:47:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000522304_133709824.pth... [2023-12-26 03:47:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000525008_134406144.pth [2023-12-26 03:47:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000521280_133447680.pth [2023-12-26 03:47:08,966][123090] Updated weights for policy 1, policy_version 522307 (0.0010) [2023-12-26 03:47:09,028][123090] Updated weights for policy 1, policy_version 522317 (0.0010) [2023-12-26 03:47:09,090][123090] Updated weights for policy 1, policy_version 522327 (0.0010) [2023-12-26 03:47:09,562][123091] Updated weights for policy 0, policy_version 526071 (0.0009) [2023-12-26 03:47:09,622][123091] Updated weights for policy 0, policy_version 526081 (0.0010) [2023-12-26 03:47:09,684][123091] Updated weights for policy 0, policy_version 526091 (0.0010) [2023-12-26 03:47:09,902][123090] Updated weights for policy 1, policy_version 522337 (0.0010) [2023-12-26 03:47:09,975][123090] Updated weights for policy 1, policy_version 522347 (0.0011) [2023-12-26 03:47:10,036][123090] Updated weights for policy 1, policy_version 522357 (0.0011) [2023-12-26 03:47:10,085][123090] Updated weights for policy 1, policy_version 522367 (0.0009) [2023-12-26 03:47:10,572][123091] Updated weights for policy 0, policy_version 526101 (0.0009) [2023-12-26 03:47:10,629][123091] Updated weights for policy 0, policy_version 526111 (0.0010) [2023-12-26 03:47:10,686][123091] Updated weights for policy 0, policy_version 526121 (0.0009) [2023-12-26 03:47:10,926][123090] Updated weights for policy 1, policy_version 522377 (0.0009) [2023-12-26 03:47:10,990][123090] Updated weights for policy 1, policy_version 522387 (0.0009) [2023-12-26 03:47:11,054][123090] Updated weights for policy 1, policy_version 522397 (0.0009) [2023-12-26 03:47:11,500][123091] Updated weights for policy 0, policy_version 526131 (0.0009) [2023-12-26 03:47:11,563][123091] Updated weights for policy 0, policy_version 526141 (0.0011) [2023-12-26 03:47:11,632][123091] Updated weights for policy 0, policy_version 526151 (0.0012) [2023-12-26 03:47:11,951][123090] Updated weights for policy 1, policy_version 522407 (0.0010) [2023-12-26 03:47:12,017][123090] Updated weights for policy 1, policy_version 522417 (0.0010) [2023-12-26 03:47:12,069][123090] Updated weights for policy 1, policy_version 522427 (0.0009) [2023-12-26 03:47:12,370][123091] Updated weights for policy 0, policy_version 526161 (0.0010) [2023-12-26 03:47:12,430][123091] Updated weights for policy 0, policy_version 526171 (0.0009) [2023-12-26 03:47:12,488][123091] Updated weights for policy 0, policy_version 526181 (0.0008) [2023-12-26 03:47:12,544][123091] Updated weights for policy 0, policy_version 526191 (0.0009) [2023-12-26 03:47:12,979][123090] Updated weights for policy 1, policy_version 522437 (0.0009) [2023-12-26 03:47:13,031][123090] Updated weights for policy 1, policy_version 522447 (0.0010) [2023-12-26 03:47:13,086][123090] Updated weights for policy 1, policy_version 522457 (0.0009) [2023-12-26 03:47:13,309][123091] Updated weights for policy 0, policy_version 526202 (0.0008) [2023-12-26 03:47:13,354][123091] Updated weights for policy 0, policy_version 526212 (0.0005) [2023-12-26 03:47:13,401][123091] Updated weights for policy 0, policy_version 526222 (0.0005) [2023-12-26 03:47:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 268468224. Throughput: 0: 8842.1, 1: 8707.3. Samples: 268462760. Policy #0 lag: (min: 31.0, avg: 33.2, max: 63.0) [2023-12-26 03:47:13,785][121949] Avg episode reward: [(0, '6240.712'), (1, '5511.726')] [2023-12-26 03:47:13,939][123090] Updated weights for policy 1, policy_version 522467 (0.0010) [2023-12-26 03:47:13,995][123090] Updated weights for policy 1, policy_version 522477 (0.0010) [2023-12-26 03:47:14,042][123090] Updated weights for policy 1, policy_version 522487 (0.0010) [2023-12-26 03:47:14,133][123091] Updated weights for policy 0, policy_version 526232 (0.0006) [2023-12-26 03:47:14,206][123091] Updated weights for policy 0, policy_version 526242 (0.0006) [2023-12-26 03:47:14,265][123091] Updated weights for policy 0, policy_version 526252 (0.0006) [2023-12-26 03:47:14,853][123090] Updated weights for policy 1, policy_version 522497 (0.0006) [2023-12-26 03:47:14,880][123091] Updated weights for policy 0, policy_version 526262 (0.0008) [2023-12-26 03:47:14,918][123090] Updated weights for policy 1, policy_version 522507 (0.0011) [2023-12-26 03:47:14,947][123091] Updated weights for policy 0, policy_version 526272 (0.0009) [2023-12-26 03:47:14,989][123090] Updated weights for policy 1, policy_version 522517 (0.0010) [2023-12-26 03:47:15,013][123091] Updated weights for policy 0, policy_version 526282 (0.0008) [2023-12-26 03:47:15,053][123090] Updated weights for policy 1, policy_version 522527 (0.0010) [2023-12-26 03:47:15,792][123090] Updated weights for policy 1, policy_version 522537 (0.0006) [2023-12-26 03:47:15,846][123090] Updated weights for policy 1, policy_version 522547 (0.0006) [2023-12-26 03:47:15,884][123091] Updated weights for policy 0, policy_version 526292 (0.0010) [2023-12-26 03:47:15,898][123090] Updated weights for policy 1, policy_version 522557 (0.0010) [2023-12-26 03:47:15,936][123091] Updated weights for policy 0, policy_version 526302 (0.0011) [2023-12-26 03:47:15,991][123091] Updated weights for policy 0, policy_version 526312 (0.0010) [2023-12-26 03:47:16,608][123090] Updated weights for policy 1, policy_version 522567 (0.0008) [2023-12-26 03:47:16,669][123090] Updated weights for policy 1, policy_version 522577 (0.0007) [2023-12-26 03:47:16,735][123090] Updated weights for policy 1, policy_version 522587 (0.0005) [2023-12-26 03:47:16,846][123091] Updated weights for policy 0, policy_version 526322 (0.0010) [2023-12-26 03:47:16,903][123091] Updated weights for policy 0, policy_version 526332 (0.0005) [2023-12-26 03:47:16,963][123091] Updated weights for policy 0, policy_version 526342 (0.0006) [2023-12-26 03:47:17,027][123091] Updated weights for policy 0, policy_version 526352 (0.0006) [2023-12-26 03:47:17,389][123090] Updated weights for policy 1, policy_version 522597 (0.0005) [2023-12-26 03:47:17,445][123090] Updated weights for policy 1, policy_version 522607 (0.0005) [2023-12-26 03:47:17,503][123090] Updated weights for policy 1, policy_version 522617 (0.0005) [2023-12-26 03:47:17,711][123091] Updated weights for policy 0, policy_version 526362 (0.0010) [2023-12-26 03:47:17,765][123091] Updated weights for policy 0, policy_version 526374 (0.0011) [2023-12-26 03:47:17,814][123091] Updated weights for policy 0, policy_version 526384 (0.0005) [2023-12-26 03:47:18,136][123090] Updated weights for policy 1, policy_version 522627 (0.0006) [2023-12-26 03:47:18,191][123090] Updated weights for policy 1, policy_version 522637 (0.0005) [2023-12-26 03:47:18,253][123090] Updated weights for policy 1, policy_version 522647 (0.0005) [2023-12-26 03:47:18,508][123091] Updated weights for policy 0, policy_version 526394 (0.0010) [2023-12-26 03:47:18,579][123091] Updated weights for policy 0, policy_version 526404 (0.0009) [2023-12-26 03:47:18,649][123091] Updated weights for policy 0, policy_version 526414 (0.0007) [2023-12-26 03:47:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 268566528. Throughput: 0: 8907.5, 1: 8775.4. Samples: 268575896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:18,785][121949] Avg episode reward: [(0, '6211.084'), (1, '5605.559')] [2023-12-26 03:47:18,956][123090] Updated weights for policy 1, policy_version 522657 (0.0006) [2023-12-26 03:47:19,008][123090] Updated weights for policy 1, policy_version 522667 (0.0010) [2023-12-26 03:47:19,061][123090] Updated weights for policy 1, policy_version 522677 (0.0009) [2023-12-26 03:47:19,114][123090] Updated weights for policy 1, policy_version 522688 (0.0010) [2023-12-26 03:47:19,362][123091] Updated weights for policy 0, policy_version 526424 (0.0007) [2023-12-26 03:47:19,429][123091] Updated weights for policy 0, policy_version 526434 (0.0008) [2023-12-26 03:47:19,493][123091] Updated weights for policy 0, policy_version 526444 (0.0009) [2023-12-26 03:47:20,021][123090] Updated weights for policy 1, policy_version 522698 (0.0006) [2023-12-26 03:47:20,095][123090] Updated weights for policy 1, policy_version 522708 (0.0006) [2023-12-26 03:47:20,164][123090] Updated weights for policy 1, policy_version 522718 (0.0007) [2023-12-26 03:47:20,308][123091] Updated weights for policy 0, policy_version 526454 (0.0009) [2023-12-26 03:47:20,367][123091] Updated weights for policy 0, policy_version 526464 (0.0010) [2023-12-26 03:47:20,425][123091] Updated weights for policy 0, policy_version 526474 (0.0009) [2023-12-26 03:47:20,955][123090] Updated weights for policy 1, policy_version 522728 (0.0007) [2023-12-26 03:47:21,026][123090] Updated weights for policy 1, policy_version 522738 (0.0006) [2023-12-26 03:47:21,099][123090] Updated weights for policy 1, policy_version 522748 (0.0006) [2023-12-26 03:47:21,281][123091] Updated weights for policy 0, policy_version 526484 (0.0009) [2023-12-26 03:47:21,352][123091] Updated weights for policy 0, policy_version 526494 (0.0009) [2023-12-26 03:47:21,422][123091] Updated weights for policy 0, policy_version 526504 (0.0010) [2023-12-26 03:47:21,841][123090] Updated weights for policy 1, policy_version 522758 (0.0007) [2023-12-26 03:47:21,893][123090] Updated weights for policy 1, policy_version 522768 (0.0009) [2023-12-26 03:47:21,954][123090] Updated weights for policy 1, policy_version 522778 (0.0010) [2023-12-26 03:47:22,152][123091] Updated weights for policy 0, policy_version 526514 (0.0008) [2023-12-26 03:47:22,208][123091] Updated weights for policy 0, policy_version 526524 (0.0007) [2023-12-26 03:47:22,262][123091] Updated weights for policy 0, policy_version 526534 (0.0006) [2023-12-26 03:47:22,321][123091] Updated weights for policy 0, policy_version 526544 (0.0006) [2023-12-26 03:47:22,816][123090] Updated weights for policy 1, policy_version 522788 (0.0009) [2023-12-26 03:47:22,879][123090] Updated weights for policy 1, policy_version 522798 (0.0010) [2023-12-26 03:47:22,928][123090] Updated weights for policy 1, policy_version 522808 (0.0009) [2023-12-26 03:47:23,048][123091] Updated weights for policy 0, policy_version 526554 (0.0009) [2023-12-26 03:47:23,104][123091] Updated weights for policy 0, policy_version 526564 (0.0009) [2023-12-26 03:47:23,163][123091] Updated weights for policy 0, policy_version 526574 (0.0010) [2023-12-26 03:47:23,667][123090] Updated weights for policy 1, policy_version 522818 (0.0008) [2023-12-26 03:47:23,717][123090] Updated weights for policy 1, policy_version 522828 (0.0005) [2023-12-26 03:47:23,769][123090] Updated weights for policy 1, policy_version 522838 (0.0005) [2023-12-26 03:47:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 268648448. Throughput: 0: 8954.2, 1: 8739.4. Samples: 268628836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:23,785][121949] Avg episode reward: [(0, '6124.625'), (1, '5712.493')] [2023-12-26 03:47:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000526576_134807552.pth... [2023-12-26 03:47:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000525520_134537216.pth [2023-12-26 03:47:23,836][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000522848_133849088.pth... [2023-12-26 03:47:23,837][123090] Updated weights for policy 1, policy_version 522848 (0.0005) [2023-12-26 03:47:23,841][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000521824_133586944.pth [2023-12-26 03:47:24,032][123091] Updated weights for policy 0, policy_version 526584 (0.0009) [2023-12-26 03:47:24,080][123091] Updated weights for policy 0, policy_version 526594 (0.0009) [2023-12-26 03:47:24,139][123091] Updated weights for policy 0, policy_version 526605 (0.0010) [2023-12-26 03:47:24,585][123090] Updated weights for policy 1, policy_version 522858 (0.0009) [2023-12-26 03:47:24,640][123090] Updated weights for policy 1, policy_version 522868 (0.0009) [2023-12-26 03:47:24,709][123090] Updated weights for policy 1, policy_version 522878 (0.0007) [2023-12-26 03:47:24,987][123091] Updated weights for policy 0, policy_version 526615 (0.0010) [2023-12-26 03:47:25,046][123091] Updated weights for policy 0, policy_version 526625 (0.0010) [2023-12-26 03:47:25,115][123091] Updated weights for policy 0, policy_version 526635 (0.0009) [2023-12-26 03:47:25,535][123090] Updated weights for policy 1, policy_version 522888 (0.0009) [2023-12-26 03:47:25,608][123090] Updated weights for policy 1, policy_version 522898 (0.0009) [2023-12-26 03:47:25,670][123090] Updated weights for policy 1, policy_version 522908 (0.0009) [2023-12-26 03:47:25,895][123091] Updated weights for policy 0, policy_version 526645 (0.0010) [2023-12-26 03:47:25,947][123091] Updated weights for policy 0, policy_version 526655 (0.0009) [2023-12-26 03:47:25,994][123091] Updated weights for policy 0, policy_version 526665 (0.0009) [2023-12-26 03:47:26,488][123090] Updated weights for policy 1, policy_version 522918 (0.0009) [2023-12-26 03:47:26,551][123090] Updated weights for policy 1, policy_version 522928 (0.0010) [2023-12-26 03:47:26,605][123090] Updated weights for policy 1, policy_version 522938 (0.0009) [2023-12-26 03:47:26,840][123091] Updated weights for policy 0, policy_version 526675 (0.0009) [2023-12-26 03:47:26,889][123091] Updated weights for policy 0, policy_version 526686 (0.0009) [2023-12-26 03:47:26,944][123091] Updated weights for policy 0, policy_version 526696 (0.0009) [2023-12-26 03:47:27,416][123090] Updated weights for policy 1, policy_version 522948 (0.0008) [2023-12-26 03:47:27,487][123090] Updated weights for policy 1, policy_version 522958 (0.0005) [2023-12-26 03:47:27,557][123090] Updated weights for policy 1, policy_version 522968 (0.0005) [2023-12-26 03:47:27,811][123091] Updated weights for policy 0, policy_version 526706 (0.0009) [2023-12-26 03:47:27,865][123091] Updated weights for policy 0, policy_version 526717 (0.0010) [2023-12-26 03:47:27,918][123091] Updated weights for policy 0, policy_version 526728 (0.0010) [2023-12-26 03:47:28,189][123090] Updated weights for policy 1, policy_version 522978 (0.0006) [2023-12-26 03:47:28,239][123090] Updated weights for policy 1, policy_version 522988 (0.0008) [2023-12-26 03:47:28,285][123090] Updated weights for policy 1, policy_version 522998 (0.0009) [2023-12-26 03:47:28,352][123090] Updated weights for policy 1, policy_version 523008 (0.0009) [2023-12-26 03:47:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 268738560. Throughput: 0: 8986.4, 1: 8821.5. Samples: 268734588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:28,785][121949] Avg episode reward: [(0, '6089.841'), (1, '5553.695')] [2023-12-26 03:47:28,821][123091] Updated weights for policy 0, policy_version 526739 (0.0010) [2023-12-26 03:47:28,874][123091] Updated weights for policy 0, policy_version 526749 (0.0009) [2023-12-26 03:47:28,933][123091] Updated weights for policy 0, policy_version 526759 (0.0009) [2023-12-26 03:47:29,168][123090] Updated weights for policy 1, policy_version 523018 (0.0010) [2023-12-26 03:47:29,233][123090] Updated weights for policy 1, policy_version 523028 (0.0009) [2023-12-26 03:47:29,301][123090] Updated weights for policy 1, policy_version 523038 (0.0010) [2023-12-26 03:47:29,744][123091] Updated weights for policy 0, policy_version 526769 (0.0009) [2023-12-26 03:47:29,808][123091] Updated weights for policy 0, policy_version 526779 (0.0009) [2023-12-26 03:47:29,873][123091] Updated weights for policy 0, policy_version 526789 (0.0010) [2023-12-26 03:47:29,941][123091] Updated weights for policy 0, policy_version 526799 (0.0008) [2023-12-26 03:47:30,136][123090] Updated weights for policy 1, policy_version 523048 (0.0006) [2023-12-26 03:47:30,211][123090] Updated weights for policy 1, policy_version 523058 (0.0005) [2023-12-26 03:47:30,287][123090] Updated weights for policy 1, policy_version 523068 (0.0006) [2023-12-26 03:47:30,716][123091] Updated weights for policy 0, policy_version 526809 (0.0009) [2023-12-26 03:47:30,786][123091] Updated weights for policy 0, policy_version 526819 (0.0011) [2023-12-26 03:47:30,846][123091] Updated weights for policy 0, policy_version 526829 (0.0010) [2023-12-26 03:47:30,948][123090] Updated weights for policy 1, policy_version 523078 (0.0008) [2023-12-26 03:47:31,016][123090] Updated weights for policy 1, policy_version 523088 (0.0011) [2023-12-26 03:47:31,088][123090] Updated weights for policy 1, policy_version 523098 (0.0011) [2023-12-26 03:47:31,545][123091] Updated weights for policy 0, policy_version 526839 (0.0005) [2023-12-26 03:47:31,607][123091] Updated weights for policy 0, policy_version 526849 (0.0006) [2023-12-26 03:47:31,673][123091] Updated weights for policy 0, policy_version 526859 (0.0009) [2023-12-26 03:47:31,902][123090] Updated weights for policy 1, policy_version 523108 (0.0011) [2023-12-26 03:47:31,954][123090] Updated weights for policy 1, policy_version 523118 (0.0010) [2023-12-26 03:47:32,009][123090] Updated weights for policy 1, policy_version 523128 (0.0010) [2023-12-26 03:47:32,567][123091] Updated weights for policy 0, policy_version 526869 (0.0010) [2023-12-26 03:47:32,620][123091] Updated weights for policy 0, policy_version 526879 (0.0009) [2023-12-26 03:47:32,686][123091] Updated weights for policy 0, policy_version 526889 (0.0009) [2023-12-26 03:47:32,781][123090] Updated weights for policy 1, policy_version 523138 (0.0010) [2023-12-26 03:47:32,849][123090] Updated weights for policy 1, policy_version 523148 (0.0011) [2023-12-26 03:47:32,919][123090] Updated weights for policy 1, policy_version 523158 (0.0011) [2023-12-26 03:47:32,974][123090] Updated weights for policy 1, policy_version 523168 (0.0010) [2023-12-26 03:47:33,494][123091] Updated weights for policy 0, policy_version 526899 (0.0008) [2023-12-26 03:47:33,540][123091] Updated weights for policy 0, policy_version 526909 (0.0005) [2023-12-26 03:47:33,595][123091] Updated weights for policy 0, policy_version 526919 (0.0006) [2023-12-26 03:47:33,772][123090] Updated weights for policy 1, policy_version 523178 (0.0008) [2023-12-26 03:47:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 268828672. Throughput: 0: 8974.4, 1: 8762.8. Samples: 268841076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:33,785][121949] Avg episode reward: [(0, '6186.295'), (1, '5607.491')] [2023-12-26 03:47:33,825][123090] Updated weights for policy 1, policy_version 523188 (0.0005) [2023-12-26 03:47:33,871][123090] Updated weights for policy 1, policy_version 523198 (0.0005) [2023-12-26 03:47:34,196][123091] Updated weights for policy 0, policy_version 526929 (0.0008) [2023-12-26 03:47:34,268][123091] Updated weights for policy 0, policy_version 526939 (0.0006) [2023-12-26 03:47:34,337][123091] Updated weights for policy 0, policy_version 526949 (0.0006) [2023-12-26 03:47:34,409][123091] Updated weights for policy 0, policy_version 526959 (0.0010) [2023-12-26 03:47:34,610][123090] Updated weights for policy 1, policy_version 523208 (0.0010) [2023-12-26 03:47:34,676][123090] Updated weights for policy 1, policy_version 523218 (0.0007) [2023-12-26 03:47:34,742][123090] Updated weights for policy 1, policy_version 523228 (0.0007) [2023-12-26 03:47:35,096][123091] Updated weights for policy 0, policy_version 526969 (0.0006) [2023-12-26 03:47:35,159][123091] Updated weights for policy 0, policy_version 526979 (0.0005) [2023-12-26 03:47:35,222][123091] Updated weights for policy 0, policy_version 526989 (0.0005) [2023-12-26 03:47:35,410][123090] Updated weights for policy 1, policy_version 523238 (0.0008) [2023-12-26 03:47:35,478][123090] Updated weights for policy 1, policy_version 523248 (0.0008) [2023-12-26 03:47:35,542][123090] Updated weights for policy 1, policy_version 523258 (0.0008) [2023-12-26 03:47:35,893][123091] Updated weights for policy 0, policy_version 526999 (0.0009) [2023-12-26 03:47:35,960][123091] Updated weights for policy 0, policy_version 527009 (0.0011) [2023-12-26 03:47:36,011][123091] Updated weights for policy 0, policy_version 527019 (0.0011) [2023-12-26 03:47:36,285][123090] Updated weights for policy 1, policy_version 523268 (0.0009) [2023-12-26 03:47:36,354][123090] Updated weights for policy 1, policy_version 523278 (0.0011) [2023-12-26 03:47:36,427][123090] Updated weights for policy 1, policy_version 523288 (0.0011) [2023-12-26 03:47:36,864][123091] Updated weights for policy 0, policy_version 527029 (0.0011) [2023-12-26 03:47:36,915][123091] Updated weights for policy 0, policy_version 527039 (0.0010) [2023-12-26 03:47:36,964][123091] Updated weights for policy 0, policy_version 527049 (0.0010) [2023-12-26 03:47:37,258][123090] Updated weights for policy 1, policy_version 523298 (0.0011) [2023-12-26 03:47:37,309][123090] Updated weights for policy 1, policy_version 523308 (0.0010) [2023-12-26 03:47:37,379][123090] Updated weights for policy 1, policy_version 523318 (0.0010) [2023-12-26 03:47:37,445][123090] Updated weights for policy 1, policy_version 523328 (0.0010) [2023-12-26 03:47:37,814][123091] Updated weights for policy 0, policy_version 527059 (0.0011) [2023-12-26 03:47:37,879][123091] Updated weights for policy 0, policy_version 527069 (0.0010) [2023-12-26 03:47:37,940][123091] Updated weights for policy 0, policy_version 527079 (0.0005) [2023-12-26 03:47:38,207][123090] Updated weights for policy 1, policy_version 523338 (0.0010) [2023-12-26 03:47:38,268][123090] Updated weights for policy 1, policy_version 523348 (0.0010) [2023-12-26 03:47:38,324][123090] Updated weights for policy 1, policy_version 523358 (0.0009) [2023-12-26 03:47:38,632][123091] Updated weights for policy 0, policy_version 527089 (0.0007) [2023-12-26 03:47:38,700][123091] Updated weights for policy 0, policy_version 527099 (0.0005) [2023-12-26 03:47:38,762][123091] Updated weights for policy 0, policy_version 527109 (0.0006) [2023-12-26 03:47:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 268918784. Throughput: 0: 9023.6, 1: 8767.8. Samples: 268898956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:38,784][121949] Avg episode reward: [(0, '6254.868'), (1, '5607.721')] [2023-12-26 03:47:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000523360_133980160.pth... [2023-12-26 03:47:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000522304_133709824.pth [2023-12-26 03:47:38,833][123091] Updated weights for policy 0, policy_version 527119 (0.0006) [2023-12-26 03:47:38,841][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000527120_134946816.pth... [2023-12-26 03:47:38,846][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000526064_134676480.pth [2023-12-26 03:47:39,074][123090] Updated weights for policy 1, policy_version 523368 (0.0006) [2023-12-26 03:47:39,151][123090] Updated weights for policy 1, policy_version 523378 (0.0005) [2023-12-26 03:47:39,234][123090] Updated weights for policy 1, policy_version 523388 (0.0006) [2023-12-26 03:47:39,596][123091] Updated weights for policy 0, policy_version 527129 (0.0010) [2023-12-26 03:47:39,651][123091] Updated weights for policy 0, policy_version 527139 (0.0010) [2023-12-26 03:47:39,724][123091] Updated weights for policy 0, policy_version 527149 (0.0010) [2023-12-26 03:47:39,990][123090] Updated weights for policy 1, policy_version 523398 (0.0009) [2023-12-26 03:47:40,051][123090] Updated weights for policy 1, policy_version 523408 (0.0010) [2023-12-26 03:47:40,105][123090] Updated weights for policy 1, policy_version 523418 (0.0010) [2023-12-26 03:47:40,561][123091] Updated weights for policy 0, policy_version 527159 (0.0010) [2023-12-26 03:47:40,626][123091] Updated weights for policy 0, policy_version 527169 (0.0011) [2023-12-26 03:47:40,678][123091] Updated weights for policy 0, policy_version 527179 (0.0011) [2023-12-26 03:47:40,936][123090] Updated weights for policy 1, policy_version 523428 (0.0007) [2023-12-26 03:47:41,005][123090] Updated weights for policy 1, policy_version 523438 (0.0006) [2023-12-26 03:47:41,077][123090] Updated weights for policy 1, policy_version 523448 (0.0008) [2023-12-26 03:47:41,533][123091] Updated weights for policy 0, policy_version 527189 (0.0010) [2023-12-26 03:47:41,596][123091] Updated weights for policy 0, policy_version 527199 (0.0010) [2023-12-26 03:47:41,669][123091] Updated weights for policy 0, policy_version 527209 (0.0010) [2023-12-26 03:47:41,804][123090] Updated weights for policy 1, policy_version 523458 (0.0010) [2023-12-26 03:47:41,874][123090] Updated weights for policy 1, policy_version 523468 (0.0008) [2023-12-26 03:47:41,935][123090] Updated weights for policy 1, policy_version 523478 (0.0009) [2023-12-26 03:47:41,999][123090] Updated weights for policy 1, policy_version 523488 (0.0009) [2023-12-26 03:47:42,548][123091] Updated weights for policy 0, policy_version 527219 (0.0010) [2023-12-26 03:47:42,608][123091] Updated weights for policy 0, policy_version 527229 (0.0010) [2023-12-26 03:47:42,672][123091] Updated weights for policy 0, policy_version 527239 (0.0010) [2023-12-26 03:47:42,820][123090] Updated weights for policy 1, policy_version 523498 (0.0008) [2023-12-26 03:47:42,883][123090] Updated weights for policy 1, policy_version 523508 (0.0009) [2023-12-26 03:47:42,947][123090] Updated weights for policy 1, policy_version 523518 (0.0010) [2023-12-26 03:47:43,538][123091] Updated weights for policy 0, policy_version 527249 (0.0009) [2023-12-26 03:47:43,591][123091] Updated weights for policy 0, policy_version 527260 (0.0010) [2023-12-26 03:47:43,657][123091] Updated weights for policy 0, policy_version 527271 (0.0008) [2023-12-26 03:47:43,685][123090] Updated weights for policy 1, policy_version 523528 (0.0006) [2023-12-26 03:47:43,751][123090] Updated weights for policy 1, policy_version 523538 (0.0005) [2023-12-26 03:47:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 269008896. Throughput: 0: 8909.2, 1: 8828.8. Samples: 269003544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:43,784][121949] Avg episode reward: [(0, '6261.851'), (1, '5553.297')] [2023-12-26 03:47:43,802][123090] Updated weights for policy 1, policy_version 523548 (0.0005) [2023-12-26 03:47:44,437][123090] Updated weights for policy 1, policy_version 523558 (0.0005) [2023-12-26 03:47:44,496][123090] Updated weights for policy 1, policy_version 523568 (0.0008) [2023-12-26 03:47:44,558][123090] Updated weights for policy 1, policy_version 523578 (0.0005) [2023-12-26 03:47:44,586][123091] Updated weights for policy 0, policy_version 527281 (0.0008) [2023-12-26 03:47:44,638][123091] Updated weights for policy 0, policy_version 527291 (0.0009) [2023-12-26 03:47:44,691][123091] Updated weights for policy 0, policy_version 527301 (0.0009) [2023-12-26 03:47:44,744][123091] Updated weights for policy 0, policy_version 527311 (0.0009) [2023-12-26 03:47:45,279][123090] Updated weights for policy 1, policy_version 523588 (0.0007) [2023-12-26 03:47:45,339][123090] Updated weights for policy 1, policy_version 523598 (0.0010) [2023-12-26 03:47:45,392][123090] Updated weights for policy 1, policy_version 523608 (0.0009) [2023-12-26 03:47:45,648][123091] Updated weights for policy 0, policy_version 527321 (0.0008) [2023-12-26 03:47:45,718][123091] Updated weights for policy 0, policy_version 527331 (0.0009) [2023-12-26 03:47:45,782][123091] Updated weights for policy 0, policy_version 527341 (0.0010) [2023-12-26 03:47:46,233][123090] Updated weights for policy 1, policy_version 523618 (0.0010) [2023-12-26 03:47:46,295][123090] Updated weights for policy 1, policy_version 523628 (0.0009) [2023-12-26 03:47:46,353][123090] Updated weights for policy 1, policy_version 523638 (0.0009) [2023-12-26 03:47:46,416][123090] Updated weights for policy 1, policy_version 523648 (0.0010) [2023-12-26 03:47:46,619][123091] Updated weights for policy 0, policy_version 527351 (0.0009) [2023-12-26 03:47:46,677][123091] Updated weights for policy 0, policy_version 527361 (0.0009) [2023-12-26 03:47:46,726][123091] Updated weights for policy 0, policy_version 527371 (0.0009) [2023-12-26 03:47:47,164][123090] Updated weights for policy 1, policy_version 523658 (0.0009) [2023-12-26 03:47:47,213][123090] Updated weights for policy 1, policy_version 523668 (0.0009) [2023-12-26 03:47:47,269][123090] Updated weights for policy 1, policy_version 523678 (0.0008) [2023-12-26 03:47:47,593][123091] Updated weights for policy 0, policy_version 527382 (0.0008) [2023-12-26 03:47:47,643][123091] Updated weights for policy 0, policy_version 527392 (0.0009) [2023-12-26 03:47:47,702][123091] Updated weights for policy 0, policy_version 527402 (0.0010) [2023-12-26 03:47:48,150][123090] Updated weights for policy 1, policy_version 523688 (0.0010) [2023-12-26 03:47:48,211][123090] Updated weights for policy 1, policy_version 523698 (0.0010) [2023-12-26 03:47:48,278][123090] Updated weights for policy 1, policy_version 523708 (0.0009) [2023-12-26 03:47:48,539][123091] Updated weights for policy 0, policy_version 527412 (0.0007) [2023-12-26 03:47:48,592][123091] Updated weights for policy 0, policy_version 527422 (0.0009) [2023-12-26 03:47:48,648][123091] Updated weights for policy 0, policy_version 527433 (0.0010) [2023-12-26 03:47:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 269099008. Throughput: 0: 8772.3, 1: 8979.9. Samples: 269107332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:48,785][121949] Avg episode reward: [(0, '6268.000'), (1, '5493.326')] [2023-12-26 03:47:48,995][123090] Updated weights for policy 1, policy_version 523718 (0.0010) [2023-12-26 03:47:49,059][123090] Updated weights for policy 1, policy_version 523728 (0.0007) [2023-12-26 03:47:49,133][123090] Updated weights for policy 1, policy_version 523738 (0.0005) [2023-12-26 03:47:49,535][123091] Updated weights for policy 0, policy_version 527443 (0.0008) [2023-12-26 03:47:49,598][123091] Updated weights for policy 0, policy_version 527453 (0.0008) [2023-12-26 03:47:49,662][123091] Updated weights for policy 0, policy_version 527463 (0.0008) [2023-12-26 03:47:49,870][123090] Updated weights for policy 1, policy_version 523748 (0.0007) [2023-12-26 03:47:49,932][123090] Updated weights for policy 1, policy_version 523758 (0.0010) [2023-12-26 03:47:50,002][123090] Updated weights for policy 1, policy_version 523768 (0.0006) [2023-12-26 03:47:50,508][123091] Updated weights for policy 0, policy_version 527473 (0.0008) [2023-12-26 03:47:50,564][123091] Updated weights for policy 0, policy_version 527483 (0.0010) [2023-12-26 03:47:50,631][123091] Updated weights for policy 0, policy_version 527493 (0.0008) [2023-12-26 03:47:50,703][123091] Updated weights for policy 0, policy_version 527503 (0.0010) [2023-12-26 03:47:50,738][123090] Updated weights for policy 1, policy_version 523778 (0.0006) [2023-12-26 03:47:50,807][123090] Updated weights for policy 1, policy_version 523788 (0.0008) [2023-12-26 03:47:50,873][123090] Updated weights for policy 1, policy_version 523798 (0.0008) [2023-12-26 03:47:50,946][123090] Updated weights for policy 1, policy_version 523808 (0.0008) [2023-12-26 03:47:51,591][123091] Updated weights for policy 0, policy_version 527513 (0.0009) [2023-12-26 03:47:51,668][123091] Updated weights for policy 0, policy_version 527523 (0.0009) [2023-12-26 03:47:51,732][123091] Updated weights for policy 0, policy_version 527533 (0.0008) [2023-12-26 03:47:51,738][123090] Updated weights for policy 1, policy_version 523818 (0.0009) [2023-12-26 03:47:51,809][123090] Updated weights for policy 1, policy_version 523828 (0.0009) [2023-12-26 03:47:51,877][123090] Updated weights for policy 1, policy_version 523838 (0.0008) [2023-12-26 03:47:52,542][123091] Updated weights for policy 0, policy_version 527543 (0.0007) [2023-12-26 03:47:52,587][123090] Updated weights for policy 1, policy_version 523848 (0.0008) [2023-12-26 03:47:52,600][123091] Updated weights for policy 0, policy_version 527553 (0.0007) [2023-12-26 03:47:52,651][123090] Updated weights for policy 1, policy_version 523858 (0.0011) [2023-12-26 03:47:52,666][123091] Updated weights for policy 0, policy_version 527563 (0.0009) [2023-12-26 03:47:52,719][123090] Updated weights for policy 1, policy_version 523868 (0.0011) [2023-12-26 03:47:53,405][123091] Updated weights for policy 0, policy_version 527573 (0.0005) [2023-12-26 03:47:53,452][123091] Updated weights for policy 0, policy_version 527583 (0.0007) [2023-12-26 03:47:53,468][123090] Updated weights for policy 1, policy_version 523878 (0.0008) [2023-12-26 03:47:53,507][123091] Updated weights for policy 0, policy_version 527593 (0.0007) [2023-12-26 03:47:53,532][123090] Updated weights for policy 1, policy_version 523888 (0.0009) [2023-12-26 03:47:53,598][123090] Updated weights for policy 1, policy_version 523898 (0.0009) [2023-12-26 03:47:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 269189120. Throughput: 0: 8752.0, 1: 9014.7. Samples: 269160016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:53,785][121949] Avg episode reward: [(0, '6247.379'), (1, '5399.888')] [2023-12-26 03:47:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000527600_135069696.pth... [2023-12-26 03:47:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000523904_134119424.pth... [2023-12-26 03:47:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000526576_134807552.pth [2023-12-26 03:47:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000522848_133849088.pth [2023-12-26 03:47:54,198][123091] Updated weights for policy 0, policy_version 527603 (0.0008) [2023-12-26 03:47:54,263][123091] Updated weights for policy 0, policy_version 527613 (0.0010) [2023-12-26 03:47:54,326][123091] Updated weights for policy 0, policy_version 527623 (0.0010) [2023-12-26 03:47:54,421][123090] Updated weights for policy 1, policy_version 523908 (0.0010) [2023-12-26 03:47:54,483][123090] Updated weights for policy 1, policy_version 523918 (0.0010) [2023-12-26 03:47:54,542][123090] Updated weights for policy 1, policy_version 523928 (0.0010) [2023-12-26 03:47:55,072][123091] Updated weights for policy 0, policy_version 527633 (0.0010) [2023-12-26 03:47:55,126][123091] Updated weights for policy 0, policy_version 527643 (0.0010) [2023-12-26 03:47:55,179][123091] Updated weights for policy 0, policy_version 527653 (0.0009) [2023-12-26 03:47:55,247][123091] Updated weights for policy 0, policy_version 527663 (0.0005) [2023-12-26 03:47:55,260][123090] Updated weights for policy 1, policy_version 523938 (0.0009) [2023-12-26 03:47:55,310][123090] Updated weights for policy 1, policy_version 523948 (0.0005) [2023-12-26 03:47:55,356][123090] Updated weights for policy 1, policy_version 523958 (0.0007) [2023-12-26 03:47:55,400][123090] Updated weights for policy 1, policy_version 523968 (0.0007) [2023-12-26 03:47:55,879][123091] Updated weights for policy 0, policy_version 527673 (0.0005) [2023-12-26 03:47:55,930][123091] Updated weights for policy 0, policy_version 527683 (0.0006) [2023-12-26 03:47:55,991][123091] Updated weights for policy 0, policy_version 527693 (0.0006) [2023-12-26 03:47:56,159][123090] Updated weights for policy 1, policy_version 523978 (0.0010) [2023-12-26 03:47:56,219][123090] Updated weights for policy 1, policy_version 523988 (0.0006) [2023-12-26 03:47:56,272][123090] Updated weights for policy 1, policy_version 523998 (0.0005) [2023-12-26 03:47:56,771][123091] Updated weights for policy 0, policy_version 527703 (0.0008) [2023-12-26 03:47:56,830][123091] Updated weights for policy 0, policy_version 527713 (0.0010) [2023-12-26 03:47:56,878][123091] Updated weights for policy 0, policy_version 527723 (0.0010) [2023-12-26 03:47:57,026][123090] Updated weights for policy 1, policy_version 524008 (0.0009) [2023-12-26 03:47:57,081][123090] Updated weights for policy 1, policy_version 524018 (0.0010) [2023-12-26 03:47:57,134][123090] Updated weights for policy 1, policy_version 524028 (0.0010) [2023-12-26 03:47:57,559][123091] Updated weights for policy 0, policy_version 527733 (0.0007) [2023-12-26 03:47:57,606][123091] Updated weights for policy 0, policy_version 527743 (0.0005) [2023-12-26 03:47:57,649][123091] Updated weights for policy 0, policy_version 527753 (0.0005) [2023-12-26 03:47:57,846][123090] Updated weights for policy 1, policy_version 524038 (0.0005) [2023-12-26 03:47:57,912][123090] Updated weights for policy 1, policy_version 524048 (0.0005) [2023-12-26 03:47:57,970][123090] Updated weights for policy 1, policy_version 524058 (0.0010) [2023-12-26 03:47:58,425][123091] Updated weights for policy 0, policy_version 527763 (0.0006) [2023-12-26 03:47:58,491][123091] Updated weights for policy 0, policy_version 527773 (0.0008) [2023-12-26 03:47:58,561][123091] Updated weights for policy 0, policy_version 527783 (0.0008) [2023-12-26 03:47:58,773][123090] Updated weights for policy 1, policy_version 524068 (0.0008) [2023-12-26 03:47:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 269279232. Throughput: 0: 8885.8, 1: 9129.1. Samples: 269273432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:47:58,785][121949] Avg episode reward: [(0, '6251.306'), (1, '5218.452')] [2023-12-26 03:47:58,846][123090] Updated weights for policy 1, policy_version 524078 (0.0006) [2023-12-26 03:47:58,920][123090] Updated weights for policy 1, policy_version 524088 (0.0008) [2023-12-26 03:47:59,374][123091] Updated weights for policy 0, policy_version 527793 (0.0007) [2023-12-26 03:47:59,439][123091] Updated weights for policy 0, policy_version 527803 (0.0007) [2023-12-26 03:47:59,512][123091] Updated weights for policy 0, policy_version 527813 (0.0011) [2023-12-26 03:47:59,584][123091] Updated weights for policy 0, policy_version 527823 (0.0007) [2023-12-26 03:47:59,704][123090] Updated weights for policy 1, policy_version 524098 (0.0010) [2023-12-26 03:47:59,759][123090] Updated weights for policy 1, policy_version 524108 (0.0008) [2023-12-26 03:47:59,814][123090] Updated weights for policy 1, policy_version 524118 (0.0005) [2023-12-26 03:47:59,882][123090] Updated weights for policy 1, policy_version 524128 (0.0007) [2023-12-26 03:48:00,309][123091] Updated weights for policy 0, policy_version 527833 (0.0010) [2023-12-26 03:48:00,371][123091] Updated weights for policy 0, policy_version 527843 (0.0010) [2023-12-26 03:48:00,421][123091] Updated weights for policy 0, policy_version 527853 (0.0009) [2023-12-26 03:48:00,722][123090] Updated weights for policy 1, policy_version 524138 (0.0009) [2023-12-26 03:48:00,768][123090] Updated weights for policy 1, policy_version 524148 (0.0008) [2023-12-26 03:48:00,828][123090] Updated weights for policy 1, policy_version 524158 (0.0006) [2023-12-26 03:48:01,165][123091] Updated weights for policy 0, policy_version 527863 (0.0007) [2023-12-26 03:48:01,233][123091] Updated weights for policy 0, policy_version 527873 (0.0009) [2023-12-26 03:48:01,293][123091] Updated weights for policy 0, policy_version 527883 (0.0008) [2023-12-26 03:48:01,699][123090] Updated weights for policy 1, policy_version 524168 (0.0008) [2023-12-26 03:48:01,772][123090] Updated weights for policy 1, policy_version 524178 (0.0010) [2023-12-26 03:48:01,828][123090] Updated weights for policy 1, policy_version 524188 (0.0009) [2023-12-26 03:48:02,017][123091] Updated weights for policy 0, policy_version 527893 (0.0007) [2023-12-26 03:48:02,072][123091] Updated weights for policy 0, policy_version 527903 (0.0008) [2023-12-26 03:48:02,141][123091] Updated weights for policy 0, policy_version 527913 (0.0008) [2023-12-26 03:48:02,753][123090] Updated weights for policy 1, policy_version 524198 (0.0010) [2023-12-26 03:48:02,808][123090] Updated weights for policy 1, policy_version 524209 (0.0010) [2023-12-26 03:48:02,861][123090] Updated weights for policy 1, policy_version 524220 (0.0009) [2023-12-26 03:48:02,862][123091] Updated weights for policy 0, policy_version 527923 (0.0008) [2023-12-26 03:48:02,925][123091] Updated weights for policy 0, policy_version 527933 (0.0005) [2023-12-26 03:48:02,977][123091] Updated weights for policy 0, policy_version 527943 (0.0008) [2023-12-26 03:48:03,591][123091] Updated weights for policy 0, policy_version 527953 (0.0010) [2023-12-26 03:48:03,657][123091] Updated weights for policy 0, policy_version 527963 (0.0008) [2023-12-26 03:48:03,730][123091] Updated weights for policy 0, policy_version 527974 (0.0008) [2023-12-26 03:48:03,732][123090] Updated weights for policy 1, policy_version 524230 (0.0008) [2023-12-26 03:48:03,782][123091] Updated weights for policy 0, policy_version 527984 (0.0005) [2023-12-26 03:48:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 269369344. Throughput: 0: 8898.3, 1: 8989.3. Samples: 269380832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:03,784][121949] Avg episode reward: [(0, '6193.515'), (1, '5526.326')] [2023-12-26 03:48:03,791][123090] Updated weights for policy 1, policy_version 524240 (0.0009) [2023-12-26 03:48:03,849][123090] Updated weights for policy 1, policy_version 524250 (0.0010) [2023-12-26 03:48:04,548][123091] Updated weights for policy 0, policy_version 527994 (0.0010) [2023-12-26 03:48:04,602][123091] Updated weights for policy 0, policy_version 528004 (0.0010) [2023-12-26 03:48:04,664][123091] Updated weights for policy 0, policy_version 528014 (0.0010) [2023-12-26 03:48:04,692][123090] Updated weights for policy 1, policy_version 524260 (0.0009) [2023-12-26 03:48:04,748][123090] Updated weights for policy 1, policy_version 524271 (0.0010) [2023-12-26 03:48:04,804][123090] Updated weights for policy 1, policy_version 524282 (0.0010) [2023-12-26 03:48:05,541][123091] Updated weights for policy 0, policy_version 528024 (0.0008) [2023-12-26 03:48:05,565][123090] Updated weights for policy 1, policy_version 524292 (0.0009) [2023-12-26 03:48:05,598][123091] Updated weights for policy 0, policy_version 528034 (0.0008) [2023-12-26 03:48:05,627][123090] Updated weights for policy 1, policy_version 524302 (0.0007) [2023-12-26 03:48:05,650][123091] Updated weights for policy 0, policy_version 528044 (0.0009) [2023-12-26 03:48:05,686][123090] Updated weights for policy 1, policy_version 524312 (0.0006) [2023-12-26 03:48:06,522][123091] Updated weights for policy 0, policy_version 528054 (0.0009) [2023-12-26 03:48:06,552][123090] Updated weights for policy 1, policy_version 524322 (0.0006) [2023-12-26 03:48:06,580][123091] Updated weights for policy 0, policy_version 528064 (0.0007) [2023-12-26 03:48:06,619][123090] Updated weights for policy 1, policy_version 524332 (0.0009) [2023-12-26 03:48:06,652][123091] Updated weights for policy 0, policy_version 528074 (0.0006) [2023-12-26 03:48:06,687][123090] Updated weights for policy 1, policy_version 524342 (0.0009) [2023-12-26 03:48:06,754][123090] Updated weights for policy 1, policy_version 524352 (0.0010) [2023-12-26 03:48:07,345][123091] Updated weights for policy 0, policy_version 528084 (0.0008) [2023-12-26 03:48:07,397][123091] Updated weights for policy 0, policy_version 528094 (0.0011) [2023-12-26 03:48:07,462][123091] Updated weights for policy 0, policy_version 528104 (0.0011) [2023-12-26 03:48:07,668][123090] Updated weights for policy 1, policy_version 524362 (0.0009) [2023-12-26 03:48:07,722][123090] Updated weights for policy 1, policy_version 524372 (0.0009) [2023-12-26 03:48:07,783][123090] Updated weights for policy 1, policy_version 524382 (0.0008) [2023-12-26 03:48:08,296][123091] Updated weights for policy 0, policy_version 528114 (0.0011) [2023-12-26 03:48:08,358][123091] Updated weights for policy 0, policy_version 528124 (0.0011) [2023-12-26 03:48:08,420][123091] Updated weights for policy 0, policy_version 528134 (0.0011) [2023-12-26 03:48:08,483][123091] Updated weights for policy 0, policy_version 528144 (0.0011) [2023-12-26 03:48:08,624][123090] Updated weights for policy 1, policy_version 524392 (0.0006) [2023-12-26 03:48:08,689][123090] Updated weights for policy 1, policy_version 524402 (0.0005) [2023-12-26 03:48:08,757][123090] Updated weights for policy 1, policy_version 524412 (0.0007) [2023-12-26 03:48:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 269459456. Throughput: 0: 8878.1, 1: 8986.2. Samples: 269432732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:08,786][121949] Avg episode reward: [(0, '6195.384'), (1, '5635.125')] [2023-12-26 03:48:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000528144_135208960.pth... [2023-12-26 03:48:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000524416_134250496.pth... [2023-12-26 03:48:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000523360_133980160.pth [2023-12-26 03:48:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000527120_134946816.pth [2023-12-26 03:48:09,311][123091] Updated weights for policy 0, policy_version 528154 (0.0011) [2023-12-26 03:48:09,379][123091] Updated weights for policy 0, policy_version 528164 (0.0009) [2023-12-26 03:48:09,452][123091] Updated weights for policy 0, policy_version 528174 (0.0009) [2023-12-26 03:48:09,503][123090] Updated weights for policy 1, policy_version 524422 (0.0007) [2023-12-26 03:48:09,561][123090] Updated weights for policy 1, policy_version 524432 (0.0005) [2023-12-26 03:48:09,625][123090] Updated weights for policy 1, policy_version 524442 (0.0006) [2023-12-26 03:48:10,262][123091] Updated weights for policy 0, policy_version 528184 (0.0008) [2023-12-26 03:48:10,321][123090] Updated weights for policy 1, policy_version 524452 (0.0008) [2023-12-26 03:48:10,328][123091] Updated weights for policy 0, policy_version 528194 (0.0009) [2023-12-26 03:48:10,392][123091] Updated weights for policy 0, policy_version 528204 (0.0009) [2023-12-26 03:48:10,392][123090] Updated weights for policy 1, policy_version 524462 (0.0011) [2023-12-26 03:48:10,448][123090] Updated weights for policy 1, policy_version 524472 (0.0010) [2023-12-26 03:48:11,156][123090] Updated weights for policy 1, policy_version 524482 (0.0007) [2023-12-26 03:48:11,227][123090] Updated weights for policy 1, policy_version 524492 (0.0010) [2023-12-26 03:48:11,292][123091] Updated weights for policy 0, policy_version 528214 (0.0009) [2023-12-26 03:48:11,295][123090] Updated weights for policy 1, policy_version 524502 (0.0010) [2023-12-26 03:48:11,356][123091] Updated weights for policy 0, policy_version 528224 (0.0006) [2023-12-26 03:48:11,367][123090] Updated weights for policy 1, policy_version 524512 (0.0009) [2023-12-26 03:48:11,433][123091] Updated weights for policy 0, policy_version 528234 (0.0008) [2023-12-26 03:48:12,162][123090] Updated weights for policy 1, policy_version 524522 (0.0009) [2023-12-26 03:48:12,227][123090] Updated weights for policy 1, policy_version 524532 (0.0010) [2023-12-26 03:48:12,294][123091] Updated weights for policy 0, policy_version 528244 (0.0007) [2023-12-26 03:48:12,297][123090] Updated weights for policy 1, policy_version 524542 (0.0009) [2023-12-26 03:48:12,354][123091] Updated weights for policy 0, policy_version 528254 (0.0008) [2023-12-26 03:48:12,411][123091] Updated weights for policy 0, policy_version 528264 (0.0010) [2023-12-26 03:48:13,123][123090] Updated weights for policy 1, policy_version 524552 (0.0010) [2023-12-26 03:48:13,175][123090] Updated weights for policy 1, policy_version 524562 (0.0010) [2023-12-26 03:48:13,188][123091] Updated weights for policy 0, policy_version 528274 (0.0009) [2023-12-26 03:48:13,227][123090] Updated weights for policy 1, policy_version 524572 (0.0010) [2023-12-26 03:48:13,260][123091] Updated weights for policy 0, policy_version 528284 (0.0006) [2023-12-26 03:48:13,330][123091] Updated weights for policy 0, policy_version 528294 (0.0006) [2023-12-26 03:48:13,396][123091] Updated weights for policy 0, policy_version 528304 (0.0009) [2023-12-26 03:48:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 269541376. Throughput: 0: 8826.6, 1: 8967.1. Samples: 269535308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:13,785][121949] Avg episode reward: [(0, '6169.851'), (1, '5612.466')] [2023-12-26 03:48:13,967][123090] Updated weights for policy 1, policy_version 524582 (0.0007) [2023-12-26 03:48:14,018][123090] Updated weights for policy 1, policy_version 524592 (0.0005) [2023-12-26 03:48:14,070][123090] Updated weights for policy 1, policy_version 524602 (0.0005) [2023-12-26 03:48:14,106][123091] Updated weights for policy 0, policy_version 528314 (0.0009) [2023-12-26 03:48:14,168][123091] Updated weights for policy 0, policy_version 528324 (0.0009) [2023-12-26 03:48:14,244][123091] Updated weights for policy 0, policy_version 528334 (0.0010) [2023-12-26 03:48:14,742][123090] Updated weights for policy 1, policy_version 524612 (0.0005) [2023-12-26 03:48:14,799][123090] Updated weights for policy 1, policy_version 524622 (0.0006) [2023-12-26 03:48:14,864][123090] Updated weights for policy 1, policy_version 524632 (0.0008) [2023-12-26 03:48:14,961][123091] Updated weights for policy 0, policy_version 528344 (0.0010) [2023-12-26 03:48:15,023][123091] Updated weights for policy 0, policy_version 528354 (0.0010) [2023-12-26 03:48:15,079][123091] Updated weights for policy 0, policy_version 528364 (0.0010) [2023-12-26 03:48:15,647][123090] Updated weights for policy 1, policy_version 524642 (0.0008) [2023-12-26 03:48:15,723][123090] Updated weights for policy 1, policy_version 524652 (0.0007) [2023-12-26 03:48:15,777][123090] Updated weights for policy 1, policy_version 524662 (0.0005) [2023-12-26 03:48:15,841][123090] Updated weights for policy 1, policy_version 524672 (0.0005) [2023-12-26 03:48:15,884][123091] Updated weights for policy 0, policy_version 528374 (0.0010) [2023-12-26 03:48:15,954][123091] Updated weights for policy 0, policy_version 528384 (0.0010) [2023-12-26 03:48:16,007][123091] Updated weights for policy 0, policy_version 528394 (0.0010) [2023-12-26 03:48:16,434][123090] Updated weights for policy 1, policy_version 524682 (0.0005) [2023-12-26 03:48:16,494][123090] Updated weights for policy 1, policy_version 524692 (0.0005) [2023-12-26 03:48:16,566][123090] Updated weights for policy 1, policy_version 524702 (0.0005) [2023-12-26 03:48:16,820][123091] Updated weights for policy 0, policy_version 528404 (0.0008) [2023-12-26 03:48:16,874][123091] Updated weights for policy 0, policy_version 528414 (0.0005) [2023-12-26 03:48:16,923][123091] Updated weights for policy 0, policy_version 528424 (0.0007) [2023-12-26 03:48:17,232][123090] Updated weights for policy 1, policy_version 524712 (0.0005) [2023-12-26 03:48:17,293][123090] Updated weights for policy 1, policy_version 524722 (0.0005) [2023-12-26 03:48:17,348][123090] Updated weights for policy 1, policy_version 524732 (0.0010) [2023-12-26 03:48:17,624][123091] Updated weights for policy 0, policy_version 528434 (0.0006) [2023-12-26 03:48:17,694][123091] Updated weights for policy 0, policy_version 528444 (0.0006) [2023-12-26 03:48:17,755][123091] Updated weights for policy 0, policy_version 528454 (0.0005) [2023-12-26 03:48:17,826][123091] Updated weights for policy 0, policy_version 528464 (0.0005) [2023-12-26 03:48:18,066][123090] Updated weights for policy 1, policy_version 524742 (0.0007) [2023-12-26 03:48:18,130][123090] Updated weights for policy 1, policy_version 524752 (0.0008) [2023-12-26 03:48:18,198][123090] Updated weights for policy 1, policy_version 524762 (0.0008) [2023-12-26 03:48:18,481][123091] Updated weights for policy 0, policy_version 528474 (0.0007) [2023-12-26 03:48:18,542][123091] Updated weights for policy 0, policy_version 528484 (0.0005) [2023-12-26 03:48:18,602][123091] Updated weights for policy 0, policy_version 528494 (0.0006) [2023-12-26 03:48:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 269639680. Throughput: 0: 8923.2, 1: 9058.0. Samples: 269650228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:18,785][121949] Avg episode reward: [(0, '6176.266'), (1, '5553.736')] [2023-12-26 03:48:18,850][123090] Updated weights for policy 1, policy_version 524772 (0.0007) [2023-12-26 03:48:18,906][123090] Updated weights for policy 1, policy_version 524782 (0.0005) [2023-12-26 03:48:18,964][123090] Updated weights for policy 1, policy_version 524792 (0.0005) [2023-12-26 03:48:19,353][123091] Updated weights for policy 0, policy_version 528504 (0.0009) [2023-12-26 03:48:19,419][123091] Updated weights for policy 0, policy_version 528514 (0.0009) [2023-12-26 03:48:19,477][123091] Updated weights for policy 0, policy_version 528524 (0.0010) [2023-12-26 03:48:19,712][123090] Updated weights for policy 1, policy_version 524802 (0.0006) [2023-12-26 03:48:19,772][123090] Updated weights for policy 1, policy_version 524812 (0.0010) [2023-12-26 03:48:19,844][123090] Updated weights for policy 1, policy_version 524822 (0.0009) [2023-12-26 03:48:19,917][123090] Updated weights for policy 1, policy_version 524832 (0.0009) [2023-12-26 03:48:20,424][123091] Updated weights for policy 0, policy_version 528534 (0.0007) [2023-12-26 03:48:20,478][123091] Updated weights for policy 0, policy_version 528544 (0.0006) [2023-12-26 03:48:20,557][123091] Updated weights for policy 0, policy_version 528554 (0.0006) [2023-12-26 03:48:20,676][123090] Updated weights for policy 1, policy_version 524842 (0.0006) [2023-12-26 03:48:20,748][123090] Updated weights for policy 1, policy_version 524852 (0.0007) [2023-12-26 03:48:20,816][123090] Updated weights for policy 1, policy_version 524862 (0.0009) [2023-12-26 03:48:21,271][123091] Updated weights for policy 0, policy_version 528564 (0.0008) [2023-12-26 03:48:21,337][123091] Updated weights for policy 0, policy_version 528574 (0.0008) [2023-12-26 03:48:21,421][123091] Updated weights for policy 0, policy_version 528584 (0.0008) [2023-12-26 03:48:21,677][123090] Updated weights for policy 1, policy_version 524872 (0.0008) [2023-12-26 03:48:21,742][123090] Updated weights for policy 1, policy_version 524882 (0.0009) [2023-12-26 03:48:21,804][123090] Updated weights for policy 1, policy_version 524892 (0.0007) [2023-12-26 03:48:22,204][123091] Updated weights for policy 0, policy_version 528594 (0.0008) [2023-12-26 03:48:22,263][123091] Updated weights for policy 0, policy_version 528604 (0.0009) [2023-12-26 03:48:22,318][123091] Updated weights for policy 0, policy_version 528614 (0.0005) [2023-12-26 03:48:22,377][123091] Updated weights for policy 0, policy_version 528624 (0.0008) [2023-12-26 03:48:22,682][123090] Updated weights for policy 1, policy_version 524902 (0.0006) [2023-12-26 03:48:22,743][123090] Updated weights for policy 1, policy_version 524912 (0.0009) [2023-12-26 03:48:22,792][123090] Updated weights for policy 1, policy_version 524922 (0.0009) [2023-12-26 03:48:23,155][123091] Updated weights for policy 0, policy_version 528634 (0.0009) [2023-12-26 03:48:23,203][123091] Updated weights for policy 0, policy_version 528644 (0.0005) [2023-12-26 03:48:23,264][123091] Updated weights for policy 0, policy_version 528654 (0.0006) [2023-12-26 03:48:23,631][123090] Updated weights for policy 1, policy_version 524932 (0.0009) [2023-12-26 03:48:23,689][123090] Updated weights for policy 1, policy_version 524943 (0.0010) [2023-12-26 03:48:23,743][123090] Updated weights for policy 1, policy_version 524953 (0.0010) [2023-12-26 03:48:23,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 269729792. Throughput: 0: 8844.0, 1: 9026.1. Samples: 269703116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:23,785][121949] Avg episode reward: [(0, '6163.685'), (1, '5667.781')] [2023-12-26 03:48:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000528656_135340032.pth... [2023-12-26 03:48:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000524960_134389760.pth... [2023-12-26 03:48:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000527600_135069696.pth [2023-12-26 03:48:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000523904_134119424.pth [2023-12-26 03:48:23,922][123091] Updated weights for policy 0, policy_version 528664 (0.0006) [2023-12-26 03:48:23,979][123091] Updated weights for policy 0, policy_version 528674 (0.0006) [2023-12-26 03:48:24,037][123091] Updated weights for policy 0, policy_version 528684 (0.0006) [2023-12-26 03:48:24,660][123090] Updated weights for policy 1, policy_version 524964 (0.0008) [2023-12-26 03:48:24,724][123090] Updated weights for policy 1, policy_version 524974 (0.0007) [2023-12-26 03:48:24,781][123090] Updated weights for policy 1, policy_version 524984 (0.0009) [2023-12-26 03:48:24,806][123091] Updated weights for policy 0, policy_version 528694 (0.0006) [2023-12-26 03:48:24,862][123091] Updated weights for policy 0, policy_version 528704 (0.0006) [2023-12-26 03:48:24,919][123091] Updated weights for policy 0, policy_version 528714 (0.0008) [2023-12-26 03:48:25,613][123090] Updated weights for policy 1, policy_version 524994 (0.0008) [2023-12-26 03:48:25,646][123091] Updated weights for policy 0, policy_version 528724 (0.0008) [2023-12-26 03:48:25,670][123090] Updated weights for policy 1, policy_version 525004 (0.0008) [2023-12-26 03:48:25,704][123091] Updated weights for policy 0, policy_version 528734 (0.0006) [2023-12-26 03:48:25,729][123090] Updated weights for policy 1, policy_version 525014 (0.0009) [2023-12-26 03:48:25,762][123091] Updated weights for policy 0, policy_version 528744 (0.0008) [2023-12-26 03:48:26,419][123090] Updated weights for policy 1, policy_version 525025 (0.0007) [2023-12-26 03:48:26,480][123090] Updated weights for policy 1, policy_version 525035 (0.0005) [2023-12-26 03:48:26,546][123090] Updated weights for policy 1, policy_version 525045 (0.0005) [2023-12-26 03:48:26,567][123091] Updated weights for policy 0, policy_version 528754 (0.0006) [2023-12-26 03:48:26,615][123090] Updated weights for policy 1, policy_version 525055 (0.0006) [2023-12-26 03:48:26,631][123091] Updated weights for policy 0, policy_version 528764 (0.0009) [2023-12-26 03:48:26,694][123091] Updated weights for policy 0, policy_version 528774 (0.0010) [2023-12-26 03:48:26,754][123091] Updated weights for policy 0, policy_version 528784 (0.0010) [2023-12-26 03:48:27,353][123090] Updated weights for policy 1, policy_version 525065 (0.0008) [2023-12-26 03:48:27,401][123090] Updated weights for policy 1, policy_version 525075 (0.0009) [2023-12-26 03:48:27,453][123090] Updated weights for policy 1, policy_version 525086 (0.0010) [2023-12-26 03:48:27,506][123091] Updated weights for policy 0, policy_version 528794 (0.0005) [2023-12-26 03:48:27,566][123091] Updated weights for policy 0, policy_version 528804 (0.0007) [2023-12-26 03:48:27,617][123091] Updated weights for policy 0, policy_version 528814 (0.0010) [2023-12-26 03:48:28,271][123090] Updated weights for policy 1, policy_version 525096 (0.0006) [2023-12-26 03:48:28,343][123090] Updated weights for policy 1, policy_version 525106 (0.0007) [2023-12-26 03:48:28,403][123090] Updated weights for policy 1, policy_version 525116 (0.0006) [2023-12-26 03:48:28,433][123091] Updated weights for policy 0, policy_version 528824 (0.0011) [2023-12-26 03:48:28,492][123091] Updated weights for policy 0, policy_version 528834 (0.0010) [2023-12-26 03:48:28,560][123091] Updated weights for policy 0, policy_version 528844 (0.0011) [2023-12-26 03:48:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 269819904. Throughput: 0: 8948.0, 1: 8980.0. Samples: 269810304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:28,785][121949] Avg episode reward: [(0, '6150.459'), (1, '5829.989')] [2023-12-26 03:48:29,170][123090] Updated weights for policy 1, policy_version 525126 (0.0007) [2023-12-26 03:48:29,231][123090] Updated weights for policy 1, policy_version 525136 (0.0007) [2023-12-26 03:48:29,299][123090] Updated weights for policy 1, policy_version 525146 (0.0010) [2023-12-26 03:48:29,299][123091] Updated weights for policy 0, policy_version 528854 (0.0011) [2023-12-26 03:48:29,369][123091] Updated weights for policy 0, policy_version 528864 (0.0011) [2023-12-26 03:48:29,431][123091] Updated weights for policy 0, policy_version 528874 (0.0011) [2023-12-26 03:48:30,076][123090] Updated weights for policy 1, policy_version 525156 (0.0011) [2023-12-26 03:48:30,135][123090] Updated weights for policy 1, policy_version 525166 (0.0010) [2023-12-26 03:48:30,199][123090] Updated weights for policy 1, policy_version 525176 (0.0010) [2023-12-26 03:48:30,210][123091] Updated weights for policy 0, policy_version 528884 (0.0009) [2023-12-26 03:48:30,262][123091] Updated weights for policy 0, policy_version 528894 (0.0007) [2023-12-26 03:48:30,310][123091] Updated weights for policy 0, policy_version 528904 (0.0009) [2023-12-26 03:48:30,975][123090] Updated weights for policy 1, policy_version 525186 (0.0009) [2023-12-26 03:48:30,987][123091] Updated weights for policy 0, policy_version 528914 (0.0006) [2023-12-26 03:48:31,053][123091] Updated weights for policy 0, policy_version 528924 (0.0007) [2023-12-26 03:48:31,063][123090] Updated weights for policy 1, policy_version 525196 (0.0007) [2023-12-26 03:48:31,112][123091] Updated weights for policy 0, policy_version 528934 (0.0008) [2023-12-26 03:48:31,132][123090] Updated weights for policy 1, policy_version 525206 (0.0008) [2023-12-26 03:48:31,174][123091] Updated weights for policy 0, policy_version 528944 (0.0008) [2023-12-26 03:48:31,197][123090] Updated weights for policy 1, policy_version 525216 (0.0007) [2023-12-26 03:48:31,865][123091] Updated weights for policy 0, policy_version 528954 (0.0008) [2023-12-26 03:48:31,869][123090] Updated weights for policy 1, policy_version 525226 (0.0008) [2023-12-26 03:48:31,924][123091] Updated weights for policy 0, policy_version 528964 (0.0008) [2023-12-26 03:48:31,931][123090] Updated weights for policy 1, policy_version 525236 (0.0005) [2023-12-26 03:48:31,975][123091] Updated weights for policy 0, policy_version 528974 (0.0008) [2023-12-26 03:48:31,981][123090] Updated weights for policy 1, policy_version 525246 (0.0005) [2023-12-26 03:48:32,750][123090] Updated weights for policy 1, policy_version 525256 (0.0006) [2023-12-26 03:48:32,754][123091] Updated weights for policy 0, policy_version 528984 (0.0009) [2023-12-26 03:48:32,808][123091] Updated weights for policy 0, policy_version 528994 (0.0009) [2023-12-26 03:48:32,821][123090] Updated weights for policy 1, policy_version 525266 (0.0006) [2023-12-26 03:48:32,867][123091] Updated weights for policy 0, policy_version 529004 (0.0010) [2023-12-26 03:48:32,892][123090] Updated weights for policy 1, policy_version 525276 (0.0005) [2023-12-26 03:48:33,534][123090] Updated weights for policy 1, policy_version 525286 (0.0005) [2023-12-26 03:48:33,599][123090] Updated weights for policy 1, policy_version 525296 (0.0005) [2023-12-26 03:48:33,637][123091] Updated weights for policy 0, policy_version 529014 (0.0007) [2023-12-26 03:48:33,659][123090] Updated weights for policy 1, policy_version 525306 (0.0005) [2023-12-26 03:48:33,699][123091] Updated weights for policy 0, policy_version 529024 (0.0005) [2023-12-26 03:48:33,764][123091] Updated weights for policy 0, policy_version 529034 (0.0005) [2023-12-26 03:48:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 269910016. Throughput: 0: 9097.1, 1: 9027.7. Samples: 269922944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:33,785][121949] Avg episode reward: [(0, '6225.558'), (1, '5833.036')] [2023-12-26 03:48:34,374][123090] Updated weights for policy 1, policy_version 525316 (0.0007) [2023-12-26 03:48:34,404][123091] Updated weights for policy 0, policy_version 529044 (0.0006) [2023-12-26 03:48:34,435][123090] Updated weights for policy 1, policy_version 525326 (0.0008) [2023-12-26 03:48:34,473][123091] Updated weights for policy 0, policy_version 529054 (0.0009) [2023-12-26 03:48:34,505][123090] Updated weights for policy 1, policy_version 525336 (0.0006) [2023-12-26 03:48:34,537][123091] Updated weights for policy 0, policy_version 529064 (0.0009) [2023-12-26 03:48:35,200][123090] Updated weights for policy 1, policy_version 525346 (0.0006) [2023-12-26 03:48:35,265][123090] Updated weights for policy 1, policy_version 525356 (0.0006) [2023-12-26 03:48:35,323][123090] Updated weights for policy 1, policy_version 525366 (0.0006) [2023-12-26 03:48:35,377][123090] Updated weights for policy 1, policy_version 525376 (0.0006) [2023-12-26 03:48:35,429][123091] Updated weights for policy 0, policy_version 529074 (0.0009) [2023-12-26 03:48:35,495][123091] Updated weights for policy 0, policy_version 529084 (0.0010) [2023-12-26 03:48:35,557][123091] Updated weights for policy 0, policy_version 529094 (0.0010) [2023-12-26 03:48:35,623][123091] Updated weights for policy 0, policy_version 529104 (0.0010) [2023-12-26 03:48:36,181][123090] Updated weights for policy 1, policy_version 525386 (0.0008) [2023-12-26 03:48:36,250][123090] Updated weights for policy 1, policy_version 525396 (0.0008) [2023-12-26 03:48:36,321][123090] Updated weights for policy 1, policy_version 525406 (0.0009) [2023-12-26 03:48:36,346][123091] Updated weights for policy 0, policy_version 529114 (0.0011) [2023-12-26 03:48:36,397][123091] Updated weights for policy 0, policy_version 529124 (0.0010) [2023-12-26 03:48:36,457][123091] Updated weights for policy 0, policy_version 529134 (0.0010) [2023-12-26 03:48:37,166][123090] Updated weights for policy 1, policy_version 525416 (0.0006) [2023-12-26 03:48:37,212][123091] Updated weights for policy 0, policy_version 529144 (0.0006) [2023-12-26 03:48:37,235][123090] Updated weights for policy 1, policy_version 525426 (0.0006) [2023-12-26 03:48:37,279][123091] Updated weights for policy 0, policy_version 529154 (0.0006) [2023-12-26 03:48:37,301][123090] Updated weights for policy 1, policy_version 525436 (0.0008) [2023-12-26 03:48:37,338][123091] Updated weights for policy 0, policy_version 529164 (0.0007) [2023-12-26 03:48:38,066][123091] Updated weights for policy 0, policy_version 529174 (0.0009) [2023-12-26 03:48:38,107][123090] Updated weights for policy 1, policy_version 525446 (0.0008) [2023-12-26 03:48:38,134][123091] Updated weights for policy 0, policy_version 529184 (0.0008) [2023-12-26 03:48:38,170][123090] Updated weights for policy 1, policy_version 525456 (0.0008) [2023-12-26 03:48:38,201][123091] Updated weights for policy 0, policy_version 529194 (0.0008) [2023-12-26 03:48:38,231][123090] Updated weights for policy 1, policy_version 525466 (0.0011) [2023-12-26 03:48:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 270000128. Throughput: 0: 9160.3, 1: 9021.0. Samples: 269978172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:38,784][121949] Avg episode reward: [(0, '6233.063'), (1, '5825.774')] [2023-12-26 03:48:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000529200_135479296.pth... [2023-12-26 03:48:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000525472_134520832.pth... [2023-12-26 03:48:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000524416_134250496.pth [2023-12-26 03:48:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000528144_135208960.pth [2023-12-26 03:48:38,886][123091] Updated weights for policy 0, policy_version 529204 (0.0009) [2023-12-26 03:48:38,958][123091] Updated weights for policy 0, policy_version 529214 (0.0011) [2023-12-26 03:48:39,011][123090] Updated weights for policy 1, policy_version 525476 (0.0011) [2023-12-26 03:48:39,024][123091] Updated weights for policy 0, policy_version 529224 (0.0010) [2023-12-26 03:48:39,076][123090] Updated weights for policy 1, policy_version 525486 (0.0011) [2023-12-26 03:48:39,137][123090] Updated weights for policy 1, policy_version 525496 (0.0011) [2023-12-26 03:48:39,848][123091] Updated weights for policy 0, policy_version 529234 (0.0011) [2023-12-26 03:48:39,905][123091] Updated weights for policy 0, policy_version 529244 (0.0006) [2023-12-26 03:48:39,952][123090] Updated weights for policy 1, policy_version 525506 (0.0010) [2023-12-26 03:48:39,968][123091] Updated weights for policy 0, policy_version 529254 (0.0007) [2023-12-26 03:48:40,018][123090] Updated weights for policy 1, policy_version 525516 (0.0009) [2023-12-26 03:48:40,027][123091] Updated weights for policy 0, policy_version 529264 (0.0009) [2023-12-26 03:48:40,072][123090] Updated weights for policy 1, policy_version 525526 (0.0008) [2023-12-26 03:48:40,129][123090] Updated weights for policy 1, policy_version 525536 (0.0009) [2023-12-26 03:48:40,849][123091] Updated weights for policy 0, policy_version 529274 (0.0011) [2023-12-26 03:48:40,870][123090] Updated weights for policy 1, policy_version 525546 (0.0005) [2023-12-26 03:48:40,904][123091] Updated weights for policy 0, policy_version 529284 (0.0011) [2023-12-26 03:48:40,926][123090] Updated weights for policy 1, policy_version 525556 (0.0005) [2023-12-26 03:48:40,964][123091] Updated weights for policy 0, policy_version 529294 (0.0011) [2023-12-26 03:48:40,982][123090] Updated weights for policy 1, policy_version 525566 (0.0009) [2023-12-26 03:48:41,782][123090] Updated weights for policy 1, policy_version 525576 (0.0009) [2023-12-26 03:48:41,825][123091] Updated weights for policy 0, policy_version 529304 (0.0009) [2023-12-26 03:48:41,832][123090] Updated weights for policy 1, policy_version 525586 (0.0009) [2023-12-26 03:48:41,875][123091] Updated weights for policy 0, policy_version 529314 (0.0009) [2023-12-26 03:48:41,880][123090] Updated weights for policy 1, policy_version 525596 (0.0008) [2023-12-26 03:48:41,937][123091] Updated weights for policy 0, policy_version 529324 (0.0010) [2023-12-26 03:48:42,718][123090] Updated weights for policy 1, policy_version 525606 (0.0008) [2023-12-26 03:48:42,781][123090] Updated weights for policy 1, policy_version 525616 (0.0008) [2023-12-26 03:48:42,799][123091] Updated weights for policy 0, policy_version 529334 (0.0011) [2023-12-26 03:48:42,847][123090] Updated weights for policy 1, policy_version 525626 (0.0009) [2023-12-26 03:48:42,860][123091] Updated weights for policy 0, policy_version 529344 (0.0011) [2023-12-26 03:48:42,924][123091] Updated weights for policy 0, policy_version 529354 (0.0011) [2023-12-26 03:48:43,581][123091] Updated weights for policy 0, policy_version 529364 (0.0008) [2023-12-26 03:48:43,596][123090] Updated weights for policy 1, policy_version 525636 (0.0007) [2023-12-26 03:48:43,631][123091] Updated weights for policy 0, policy_version 529374 (0.0005) [2023-12-26 03:48:43,648][123090] Updated weights for policy 1, policy_version 525646 (0.0006) [2023-12-26 03:48:43,684][123091] Updated weights for policy 0, policy_version 529384 (0.0005) [2023-12-26 03:48:43,701][123090] Updated weights for policy 1, policy_version 525656 (0.0009) [2023-12-26 03:48:43,784][121949] Fps is (10 sec: 18841.1, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 270098432. Throughput: 0: 9065.5, 1: 8956.3. Samples: 270084416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:48:43,785][121949] Avg episode reward: [(0, '6193.573'), (1, '5802.250')] [2023-12-26 03:48:44,376][123090] Updated weights for policy 1, policy_version 525666 (0.0009) [2023-12-26 03:48:44,443][123090] Updated weights for policy 1, policy_version 525676 (0.0010) [2023-12-26 03:48:44,511][123090] Updated weights for policy 1, policy_version 525686 (0.0010) [2023-12-26 03:48:44,555][123091] Updated weights for policy 0, policy_version 529394 (0.0007) [2023-12-26 03:48:44,579][123090] Updated weights for policy 1, policy_version 525696 (0.0010) [2023-12-26 03:48:44,614][123091] Updated weights for policy 0, policy_version 529404 (0.0008) [2023-12-26 03:48:44,671][123091] Updated weights for policy 0, policy_version 529414 (0.0009) [2023-12-26 03:48:44,721][123091] Updated weights for policy 0, policy_version 529424 (0.0009) [2023-12-26 03:48:45,423][123090] Updated weights for policy 1, policy_version 525706 (0.0010) [2023-12-26 03:48:45,479][123090] Updated weights for policy 1, policy_version 525716 (0.0010) [2023-12-26 03:48:45,539][123090] Updated weights for policy 1, policy_version 525726 (0.0010) [2023-12-26 03:48:45,594][123091] Updated weights for policy 0, policy_version 529434 (0.0009) [2023-12-26 03:48:45,663][123091] Updated weights for policy 0, policy_version 529444 (0.0009) [2023-12-26 03:48:45,727][123091] Updated weights for policy 0, policy_version 529454 (0.0009) [2023-12-26 03:48:46,380][123090] Updated weights for policy 1, policy_version 525736 (0.0010) [2023-12-26 03:48:46,436][123090] Updated weights for policy 1, policy_version 525746 (0.0010) [2023-12-26 03:48:46,444][123091] Updated weights for policy 0, policy_version 529464 (0.0008) [2023-12-26 03:48:46,487][123090] Updated weights for policy 1, policy_version 525756 (0.0010) [2023-12-26 03:48:46,498][123091] Updated weights for policy 0, policy_version 529474 (0.0010) [2023-12-26 03:48:46,555][123091] Updated weights for policy 0, policy_version 529484 (0.0009) [2023-12-26 03:48:47,312][123090] Updated weights for policy 1, policy_version 525766 (0.0010) [2023-12-26 03:48:47,374][123090] Updated weights for policy 1, policy_version 525776 (0.0010) [2023-12-26 03:48:47,377][123091] Updated weights for policy 0, policy_version 529494 (0.0010) [2023-12-26 03:48:47,424][123091] Updated weights for policy 0, policy_version 529504 (0.0010) [2023-12-26 03:48:47,440][123090] Updated weights for policy 1, policy_version 525786 (0.0010) [2023-12-26 03:48:47,475][123091] Updated weights for policy 0, policy_version 529514 (0.0010) [2023-12-26 03:48:48,220][123090] Updated weights for policy 1, policy_version 525796 (0.0010) [2023-12-26 03:48:48,271][123091] Updated weights for policy 0, policy_version 529524 (0.0008) [2023-12-26 03:48:48,279][123090] Updated weights for policy 1, policy_version 525806 (0.0011) [2023-12-26 03:48:48,331][123091] Updated weights for policy 0, policy_version 529534 (0.0006) [2023-12-26 03:48:48,350][123090] Updated weights for policy 1, policy_version 525816 (0.0010) [2023-12-26 03:48:48,395][123091] Updated weights for policy 0, policy_version 529544 (0.0008) [2023-12-26 03:48:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 270180352. Throughput: 0: 9000.0, 1: 9012.2. Samples: 270191380. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:48:48,785][121949] Avg episode reward: [(0, '6148.042'), (1, '5834.745')] [2023-12-26 03:48:48,999][123090] Updated weights for policy 1, policy_version 525826 (0.0007) [2023-12-26 03:48:49,057][123090] Updated weights for policy 1, policy_version 525836 (0.0005) [2023-12-26 03:48:49,122][123090] Updated weights for policy 1, policy_version 525846 (0.0006) [2023-12-26 03:48:49,179][123090] Updated weights for policy 1, policy_version 525856 (0.0009) [2023-12-26 03:48:49,197][123091] Updated weights for policy 0, policy_version 529554 (0.0009) [2023-12-26 03:48:49,273][123091] Updated weights for policy 0, policy_version 529564 (0.0011) [2023-12-26 03:48:49,349][123091] Updated weights for policy 0, policy_version 529574 (0.0010) [2023-12-26 03:48:49,414][123091] Updated weights for policy 0, policy_version 529584 (0.0011) [2023-12-26 03:48:49,952][123090] Updated weights for policy 1, policy_version 525866 (0.0009) [2023-12-26 03:48:50,020][123090] Updated weights for policy 1, policy_version 525876 (0.0008) [2023-12-26 03:48:50,093][123090] Updated weights for policy 1, policy_version 525886 (0.0006) [2023-12-26 03:48:50,279][123091] Updated weights for policy 0, policy_version 529594 (0.0010) [2023-12-26 03:48:50,343][123091] Updated weights for policy 0, policy_version 529604 (0.0010) [2023-12-26 03:48:50,408][123091] Updated weights for policy 0, policy_version 529614 (0.0009) [2023-12-26 03:48:50,863][123090] Updated weights for policy 1, policy_version 525896 (0.0006) [2023-12-26 03:48:50,935][123090] Updated weights for policy 1, policy_version 525906 (0.0008) [2023-12-26 03:48:50,997][123090] Updated weights for policy 1, policy_version 525916 (0.0010) [2023-12-26 03:48:51,213][123091] Updated weights for policy 0, policy_version 529624 (0.0005) [2023-12-26 03:48:51,271][123091] Updated weights for policy 0, policy_version 529634 (0.0007) [2023-12-26 03:48:51,338][123091] Updated weights for policy 0, policy_version 529644 (0.0007) [2023-12-26 03:48:51,828][123090] Updated weights for policy 1, policy_version 525926 (0.0008) [2023-12-26 03:48:51,883][123090] Updated weights for policy 1, policy_version 525936 (0.0008) [2023-12-26 03:48:51,941][123090] Updated weights for policy 1, policy_version 525946 (0.0008) [2023-12-26 03:48:52,156][123091] Updated weights for policy 0, policy_version 529654 (0.0008) [2023-12-26 03:48:52,221][123091] Updated weights for policy 0, policy_version 529664 (0.0009) [2023-12-26 03:48:52,282][123091] Updated weights for policy 0, policy_version 529674 (0.0009) [2023-12-26 03:48:52,699][123090] Updated weights for policy 1, policy_version 525956 (0.0007) [2023-12-26 03:48:52,758][123090] Updated weights for policy 1, policy_version 525966 (0.0010) [2023-12-26 03:48:52,819][123090] Updated weights for policy 1, policy_version 525976 (0.0009) [2023-12-26 03:48:53,193][123091] Updated weights for policy 0, policy_version 529684 (0.0009) [2023-12-26 03:48:53,251][123091] Updated weights for policy 0, policy_version 529694 (0.0008) [2023-12-26 03:48:53,308][123091] Updated weights for policy 0, policy_version 529704 (0.0008) [2023-12-26 03:48:53,684][123090] Updated weights for policy 1, policy_version 525986 (0.0009) [2023-12-26 03:48:53,750][123090] Updated weights for policy 1, policy_version 525996 (0.0008) [2023-12-26 03:48:53,785][121949] Fps is (10 sec: 16383.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 270262272. Throughput: 0: 8991.9, 1: 9043.3. Samples: 270244320. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:48:53,786][121949] Avg episode reward: [(0, '6054.844'), (1, '5816.401')] [2023-12-26 03:48:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000529712_135610368.pth... [2023-12-26 03:48:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000528656_135340032.pth [2023-12-26 03:48:53,813][123090] Updated weights for policy 1, policy_version 526006 (0.0009) [2023-12-26 03:48:53,874][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000526016_134660096.pth... [2023-12-26 03:48:53,874][123090] Updated weights for policy 1, policy_version 526016 (0.0009) [2023-12-26 03:48:53,878][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000524960_134389760.pth [2023-12-26 03:48:53,952][123091] Updated weights for policy 0, policy_version 529714 (0.0006) [2023-12-26 03:48:54,004][123091] Updated weights for policy 0, policy_version 529724 (0.0009) [2023-12-26 03:48:54,065][123091] Updated weights for policy 0, policy_version 529734 (0.0009) [2023-12-26 03:48:54,119][123091] Updated weights for policy 0, policy_version 529744 (0.0009) [2023-12-26 03:48:54,693][123090] Updated weights for policy 1, policy_version 526026 (0.0009) [2023-12-26 03:48:54,749][123090] Updated weights for policy 1, policy_version 526036 (0.0008) [2023-12-26 03:48:54,797][123090] Updated weights for policy 1, policy_version 526046 (0.0009) [2023-12-26 03:48:54,948][123091] Updated weights for policy 0, policy_version 529754 (0.0009) [2023-12-26 03:48:55,011][123091] Updated weights for policy 0, policy_version 529764 (0.0009) [2023-12-26 03:48:55,082][123091] Updated weights for policy 0, policy_version 529774 (0.0009) [2023-12-26 03:48:55,667][123090] Updated weights for policy 1, policy_version 526056 (0.0009) [2023-12-26 03:48:55,722][123090] Updated weights for policy 1, policy_version 526067 (0.0010) [2023-12-26 03:48:55,778][123090] Updated weights for policy 1, policy_version 526078 (0.0010) [2023-12-26 03:48:55,829][123091] Updated weights for policy 0, policy_version 529784 (0.0006) [2023-12-26 03:48:55,883][123091] Updated weights for policy 0, policy_version 529794 (0.0005) [2023-12-26 03:48:55,933][123091] Updated weights for policy 0, policy_version 529804 (0.0005) [2023-12-26 03:48:56,673][123091] Updated weights for policy 0, policy_version 529814 (0.0006) [2023-12-26 03:48:56,680][123090] Updated weights for policy 1, policy_version 526088 (0.0008) [2023-12-26 03:48:56,725][123091] Updated weights for policy 0, policy_version 529824 (0.0009) [2023-12-26 03:48:56,745][123090] Updated weights for policy 1, policy_version 526098 (0.0008) [2023-12-26 03:48:56,774][123091] Updated weights for policy 0, policy_version 529834 (0.0008) [2023-12-26 03:48:56,794][123090] Updated weights for policy 1, policy_version 526108 (0.0009) [2023-12-26 03:48:57,596][123091] Updated weights for policy 0, policy_version 529844 (0.0008) [2023-12-26 03:48:57,620][123090] Updated weights for policy 1, policy_version 526118 (0.0006) [2023-12-26 03:48:57,651][123091] Updated weights for policy 0, policy_version 529854 (0.0009) [2023-12-26 03:48:57,667][123090] Updated weights for policy 1, policy_version 526128 (0.0007) [2023-12-26 03:48:57,703][123091] Updated weights for policy 0, policy_version 529864 (0.0009) [2023-12-26 03:48:57,715][123090] Updated weights for policy 1, policy_version 526138 (0.0007) [2023-12-26 03:48:58,547][123090] Updated weights for policy 1, policy_version 526148 (0.0009) [2023-12-26 03:48:58,568][123091] Updated weights for policy 0, policy_version 529874 (0.0008) [2023-12-26 03:48:58,631][123090] Updated weights for policy 1, policy_version 526158 (0.0008) [2023-12-26 03:48:58,636][123091] Updated weights for policy 0, policy_version 529884 (0.0007) [2023-12-26 03:48:58,698][123090] Updated weights for policy 1, policy_version 526168 (0.0008) [2023-12-26 03:48:58,711][123091] Updated weights for policy 0, policy_version 529894 (0.0007) [2023-12-26 03:48:58,783][123091] Updated weights for policy 0, policy_version 529904 (0.0009) [2023-12-26 03:48:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 270360576. Throughput: 0: 9052.8, 1: 9020.0. Samples: 270348584. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:48:58,785][121949] Avg episode reward: [(0, '6007.023'), (1, '5692.288')] [2023-12-26 03:48:59,506][123090] Updated weights for policy 1, policy_version 526178 (0.0007) [2023-12-26 03:48:59,561][123090] Updated weights for policy 1, policy_version 526188 (0.0010) [2023-12-26 03:48:59,616][123090] Updated weights for policy 1, policy_version 526198 (0.0010) [2023-12-26 03:48:59,676][123090] Updated weights for policy 1, policy_version 526208 (0.0010) [2023-12-26 03:48:59,688][123091] Updated weights for policy 0, policy_version 529914 (0.0007) [2023-12-26 03:48:59,752][123091] Updated weights for policy 0, policy_version 529924 (0.0009) [2023-12-26 03:48:59,822][123091] Updated weights for policy 0, policy_version 529934 (0.0008) [2023-12-26 03:49:00,380][123090] Updated weights for policy 1, policy_version 526218 (0.0007) [2023-12-26 03:49:00,437][123090] Updated weights for policy 1, policy_version 526228 (0.0008) [2023-12-26 03:49:00,495][123090] Updated weights for policy 1, policy_version 526238 (0.0007) [2023-12-26 03:49:00,687][123091] Updated weights for policy 0, policy_version 529944 (0.0009) [2023-12-26 03:49:00,753][123091] Updated weights for policy 0, policy_version 529954 (0.0009) [2023-12-26 03:49:00,811][123091] Updated weights for policy 0, policy_version 529964 (0.0007) [2023-12-26 03:49:01,188][123090] Updated weights for policy 1, policy_version 526248 (0.0010) [2023-12-26 03:49:01,240][123090] Updated weights for policy 1, policy_version 526258 (0.0010) [2023-12-26 03:49:01,300][123090] Updated weights for policy 1, policy_version 526268 (0.0010) [2023-12-26 03:49:01,623][123091] Updated weights for policy 0, policy_version 529974 (0.0009) [2023-12-26 03:49:01,685][123091] Updated weights for policy 0, policy_version 529984 (0.0010) [2023-12-26 03:49:01,759][123091] Updated weights for policy 0, policy_version 529994 (0.0008) [2023-12-26 03:49:02,149][123090] Updated weights for policy 1, policy_version 526278 (0.0009) [2023-12-26 03:49:02,205][123090] Updated weights for policy 1, policy_version 526288 (0.0009) [2023-12-26 03:49:02,273][123090] Updated weights for policy 1, policy_version 526298 (0.0009) [2023-12-26 03:49:02,516][123091] Updated weights for policy 0, policy_version 530004 (0.0007) [2023-12-26 03:49:02,578][123091] Updated weights for policy 0, policy_version 530014 (0.0011) [2023-12-26 03:49:02,636][123091] Updated weights for policy 0, policy_version 530024 (0.0010) [2023-12-26 03:49:03,061][123090] Updated weights for policy 1, policy_version 526308 (0.0009) [2023-12-26 03:49:03,123][123090] Updated weights for policy 1, policy_version 526318 (0.0008) [2023-12-26 03:49:03,188][123090] Updated weights for policy 1, policy_version 526328 (0.0010) [2023-12-26 03:49:03,352][123091] Updated weights for policy 0, policy_version 530034 (0.0009) [2023-12-26 03:49:03,406][123091] Updated weights for policy 0, policy_version 530044 (0.0005) [2023-12-26 03:49:03,455][123091] Updated weights for policy 0, policy_version 530054 (0.0007) [2023-12-26 03:49:03,505][123091] Updated weights for policy 0, policy_version 530064 (0.0010) [2023-12-26 03:49:03,784][121949] Fps is (10 sec: 18023.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 270442496. Throughput: 0: 8937.9, 1: 8910.5. Samples: 270453404. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:03,784][121949] Avg episode reward: [(0, '6016.962'), (1, '5634.345')] [2023-12-26 03:49:04,042][123090] Updated weights for policy 1, policy_version 526338 (0.0010) [2023-12-26 03:49:04,111][123090] Updated weights for policy 1, policy_version 526348 (0.0009) [2023-12-26 03:49:04,181][123090] Updated weights for policy 1, policy_version 526358 (0.0009) [2023-12-26 03:49:04,257][123090] Updated weights for policy 1, policy_version 526368 (0.0009) [2023-12-26 03:49:04,352][123091] Updated weights for policy 0, policy_version 530074 (0.0011) [2023-12-26 03:49:04,432][123091] Updated weights for policy 0, policy_version 530084 (0.0008) [2023-12-26 03:49:04,510][123091] Updated weights for policy 0, policy_version 530094 (0.0006) [2023-12-26 03:49:04,977][123090] Updated weights for policy 1, policy_version 526378 (0.0009) [2023-12-26 03:49:05,030][123090] Updated weights for policy 1, policy_version 526388 (0.0007) [2023-12-26 03:49:05,077][123090] Updated weights for policy 1, policy_version 526398 (0.0008) [2023-12-26 03:49:05,259][123091] Updated weights for policy 0, policy_version 530104 (0.0010) [2023-12-26 03:49:05,306][123091] Updated weights for policy 0, policy_version 530114 (0.0010) [2023-12-26 03:49:05,357][123091] Updated weights for policy 0, policy_version 530124 (0.0010) [2023-12-26 03:49:05,842][123090] Updated weights for policy 1, policy_version 526408 (0.0008) [2023-12-26 03:49:05,898][123090] Updated weights for policy 1, policy_version 526418 (0.0008) [2023-12-26 03:49:05,954][123090] Updated weights for policy 1, policy_version 526428 (0.0009) [2023-12-26 03:49:06,191][123091] Updated weights for policy 0, policy_version 530134 (0.0008) [2023-12-26 03:49:06,262][123091] Updated weights for policy 0, policy_version 530144 (0.0006) [2023-12-26 03:49:06,335][123091] Updated weights for policy 0, policy_version 530154 (0.0007) [2023-12-26 03:49:06,731][123090] Updated weights for policy 1, policy_version 526438 (0.0007) [2023-12-26 03:49:06,798][123090] Updated weights for policy 1, policy_version 526448 (0.0006) [2023-12-26 03:49:06,866][123090] Updated weights for policy 1, policy_version 526458 (0.0009) [2023-12-26 03:49:07,069][123091] Updated weights for policy 0, policy_version 530164 (0.0008) [2023-12-26 03:49:07,117][123091] Updated weights for policy 0, policy_version 530174 (0.0010) [2023-12-26 03:49:07,173][123091] Updated weights for policy 0, policy_version 530184 (0.0006) [2023-12-26 03:49:07,617][123090] Updated weights for policy 1, policy_version 526468 (0.0008) [2023-12-26 03:49:07,678][123090] Updated weights for policy 1, policy_version 526478 (0.0009) [2023-12-26 03:49:07,743][123090] Updated weights for policy 1, policy_version 526488 (0.0009) [2023-12-26 03:49:08,044][123091] Updated weights for policy 0, policy_version 530194 (0.0008) [2023-12-26 03:49:08,110][123091] Updated weights for policy 0, policy_version 530204 (0.0010) [2023-12-26 03:49:08,161][123091] Updated weights for policy 0, policy_version 530214 (0.0010) [2023-12-26 03:49:08,208][123091] Updated weights for policy 0, policy_version 530224 (0.0010) [2023-12-26 03:49:08,548][123090] Updated weights for policy 1, policy_version 526498 (0.0009) [2023-12-26 03:49:08,618][123090] Updated weights for policy 1, policy_version 526508 (0.0008) [2023-12-26 03:49:08,685][123090] Updated weights for policy 1, policy_version 526518 (0.0010) [2023-12-26 03:49:08,754][123090] Updated weights for policy 1, policy_version 526528 (0.0010) [2023-12-26 03:49:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 270532608. Throughput: 0: 8959.3, 1: 8914.9. Samples: 270507452. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:08,785][121949] Avg episode reward: [(0, '6048.175'), (1, '5747.944')] [2023-12-26 03:49:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000530224_135741440.pth... [2023-12-26 03:49:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000526528_134791168.pth... [2023-12-26 03:49:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000529200_135479296.pth [2023-12-26 03:49:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000525472_134520832.pth [2023-12-26 03:49:08,992][123091] Updated weights for policy 0, policy_version 530234 (0.0005) [2023-12-26 03:49:09,040][123091] Updated weights for policy 0, policy_version 530244 (0.0005) [2023-12-26 03:49:09,090][123091] Updated weights for policy 0, policy_version 530254 (0.0008) [2023-12-26 03:49:09,627][123090] Updated weights for policy 1, policy_version 526538 (0.0010) [2023-12-26 03:49:09,691][123090] Updated weights for policy 1, policy_version 526548 (0.0009) [2023-12-26 03:49:09,760][123090] Updated weights for policy 1, policy_version 526558 (0.0010) [2023-12-26 03:49:09,918][123091] Updated weights for policy 0, policy_version 530264 (0.0010) [2023-12-26 03:49:09,981][123091] Updated weights for policy 0, policy_version 530274 (0.0008) [2023-12-26 03:49:10,050][123091] Updated weights for policy 0, policy_version 530284 (0.0006) [2023-12-26 03:49:10,633][123090] Updated weights for policy 1, policy_version 526568 (0.0011) [2023-12-26 03:49:10,700][123090] Updated weights for policy 1, policy_version 526578 (0.0011) [2023-12-26 03:49:10,764][123090] Updated weights for policy 1, policy_version 526588 (0.0011) [2023-12-26 03:49:10,818][123091] Updated weights for policy 0, policy_version 530294 (0.0008) [2023-12-26 03:49:10,884][123091] Updated weights for policy 0, policy_version 530304 (0.0009) [2023-12-26 03:49:10,945][123091] Updated weights for policy 0, policy_version 530314 (0.0009) [2023-12-26 03:49:11,593][123090] Updated weights for policy 1, policy_version 526598 (0.0008) [2023-12-26 03:49:11,674][123090] Updated weights for policy 1, policy_version 526608 (0.0009) [2023-12-26 03:49:11,740][123090] Updated weights for policy 1, policy_version 526618 (0.0007) [2023-12-26 03:49:11,787][123091] Updated weights for policy 0, policy_version 530324 (0.0008) [2023-12-26 03:49:11,852][123091] Updated weights for policy 0, policy_version 530334 (0.0006) [2023-12-26 03:49:11,922][123091] Updated weights for policy 0, policy_version 530344 (0.0006) [2023-12-26 03:49:12,515][123090] Updated weights for policy 1, policy_version 526628 (0.0008) [2023-12-26 03:49:12,570][123090] Updated weights for policy 1, policy_version 526638 (0.0009) [2023-12-26 03:49:12,639][123090] Updated weights for policy 1, policy_version 526648 (0.0009) [2023-12-26 03:49:12,671][123091] Updated weights for policy 0, policy_version 530354 (0.0006) [2023-12-26 03:49:12,729][123091] Updated weights for policy 0, policy_version 530364 (0.0010) [2023-12-26 03:49:12,785][123091] Updated weights for policy 0, policy_version 530374 (0.0010) [2023-12-26 03:49:12,849][123091] Updated weights for policy 0, policy_version 530384 (0.0009) [2023-12-26 03:49:13,428][123090] Updated weights for policy 1, policy_version 526658 (0.0009) [2023-12-26 03:49:13,497][123090] Updated weights for policy 1, policy_version 526668 (0.0005) [2023-12-26 03:49:13,565][123090] Updated weights for policy 1, policy_version 526678 (0.0005) [2023-12-26 03:49:13,615][123090] Updated weights for policy 1, policy_version 526688 (0.0007) [2023-12-26 03:49:13,689][123091] Updated weights for policy 0, policy_version 530394 (0.0010) [2023-12-26 03:49:13,744][123091] Updated weights for policy 0, policy_version 530404 (0.0009) [2023-12-26 03:49:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 270614528. Throughput: 0: 8877.3, 1: 8917.0. Samples: 270611048. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:13,785][121949] Avg episode reward: [(0, '6129.558'), (1, '5761.272')] [2023-12-26 03:49:13,795][123091] Updated weights for policy 0, policy_version 530414 (0.0005) [2023-12-26 03:49:14,375][123090] Updated weights for policy 1, policy_version 526698 (0.0005) [2023-12-26 03:49:14,439][123090] Updated weights for policy 1, policy_version 526708 (0.0008) [2023-12-26 03:49:14,483][123091] Updated weights for policy 0, policy_version 530424 (0.0005) [2023-12-26 03:49:14,506][123090] Updated weights for policy 1, policy_version 526718 (0.0009) [2023-12-26 03:49:14,535][123091] Updated weights for policy 0, policy_version 530434 (0.0005) [2023-12-26 03:49:14,591][123091] Updated weights for policy 0, policy_version 530444 (0.0005) [2023-12-26 03:49:15,334][123090] Updated weights for policy 1, policy_version 526728 (0.0008) [2023-12-26 03:49:15,340][123091] Updated weights for policy 0, policy_version 530454 (0.0007) [2023-12-26 03:49:15,394][123090] Updated weights for policy 1, policy_version 526738 (0.0010) [2023-12-26 03:49:15,399][123091] Updated weights for policy 0, policy_version 530464 (0.0009) [2023-12-26 03:49:15,448][123090] Updated weights for policy 1, policy_version 526748 (0.0010) [2023-12-26 03:49:15,463][123091] Updated weights for policy 0, policy_version 530474 (0.0011) [2023-12-26 03:49:16,240][123091] Updated weights for policy 0, policy_version 530484 (0.0008) [2023-12-26 03:49:16,302][123091] Updated weights for policy 0, policy_version 530494 (0.0005) [2023-12-26 03:49:16,319][123090] Updated weights for policy 1, policy_version 526758 (0.0006) [2023-12-26 03:49:16,363][123091] Updated weights for policy 0, policy_version 530504 (0.0005) [2023-12-26 03:49:16,377][123090] Updated weights for policy 1, policy_version 526768 (0.0010) [2023-12-26 03:49:16,434][123090] Updated weights for policy 1, policy_version 526778 (0.0008) [2023-12-26 03:49:17,054][123091] Updated weights for policy 0, policy_version 530514 (0.0006) [2023-12-26 03:49:17,110][123091] Updated weights for policy 0, policy_version 530524 (0.0005) [2023-12-26 03:49:17,121][123090] Updated weights for policy 1, policy_version 526788 (0.0008) [2023-12-26 03:49:17,163][123091] Updated weights for policy 0, policy_version 530534 (0.0005) [2023-12-26 03:49:17,185][123090] Updated weights for policy 1, policy_version 526798 (0.0010) [2023-12-26 03:49:17,217][123091] Updated weights for policy 0, policy_version 530544 (0.0005) [2023-12-26 03:49:17,242][123090] Updated weights for policy 1, policy_version 526808 (0.0006) [2023-12-26 03:49:17,777][123091] Updated weights for policy 0, policy_version 530554 (0.0005) [2023-12-26 03:49:17,833][123091] Updated weights for policy 0, policy_version 530564 (0.0005) [2023-12-26 03:49:17,882][123091] Updated weights for policy 0, policy_version 530574 (0.0005) [2023-12-26 03:49:17,901][123090] Updated weights for policy 1, policy_version 526818 (0.0005) [2023-12-26 03:49:17,951][123090] Updated weights for policy 1, policy_version 526828 (0.0005) [2023-12-26 03:49:18,003][123090] Updated weights for policy 1, policy_version 526838 (0.0005) [2023-12-26 03:49:18,081][123090] Updated weights for policy 1, policy_version 526848 (0.0005) [2023-12-26 03:49:18,512][123091] Updated weights for policy 0, policy_version 530584 (0.0005) [2023-12-26 03:49:18,565][123091] Updated weights for policy 0, policy_version 530594 (0.0005) [2023-12-26 03:49:18,634][123091] Updated weights for policy 0, policy_version 530604 (0.0005) [2023-12-26 03:49:18,731][123090] Updated weights for policy 1, policy_version 526858 (0.0009) [2023-12-26 03:49:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 270712832. Throughput: 0: 8944.0, 1: 8905.8. Samples: 270726184. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:18,784][121949] Avg episode reward: [(0, '6115.726'), (1, '5812.538')] [2023-12-26 03:49:18,791][123090] Updated weights for policy 1, policy_version 526868 (0.0009) [2023-12-26 03:49:18,847][123090] Updated weights for policy 1, policy_version 526878 (0.0009) [2023-12-26 03:49:19,434][123091] Updated weights for policy 0, policy_version 530614 (0.0009) [2023-12-26 03:49:19,502][123091] Updated weights for policy 0, policy_version 530624 (0.0008) [2023-12-26 03:49:19,565][123091] Updated weights for policy 0, policy_version 530634 (0.0009) [2023-12-26 03:49:19,672][123090] Updated weights for policy 1, policy_version 526888 (0.0010) [2023-12-26 03:49:19,746][123090] Updated weights for policy 1, policy_version 526898 (0.0009) [2023-12-26 03:49:19,815][123090] Updated weights for policy 1, policy_version 526908 (0.0010) [2023-12-26 03:49:20,382][123091] Updated weights for policy 0, policy_version 530644 (0.0009) [2023-12-26 03:49:20,435][123091] Updated weights for policy 0, policy_version 530654 (0.0009) [2023-12-26 03:49:20,484][123091] Updated weights for policy 0, policy_version 530664 (0.0009) [2023-12-26 03:49:20,652][123090] Updated weights for policy 1, policy_version 526918 (0.0010) [2023-12-26 03:49:20,715][123090] Updated weights for policy 1, policy_version 526928 (0.0010) [2023-12-26 03:49:20,781][123090] Updated weights for policy 1, policy_version 526938 (0.0010) [2023-12-26 03:49:21,279][123091] Updated weights for policy 0, policy_version 530674 (0.0009) [2023-12-26 03:49:21,344][123091] Updated weights for policy 0, policy_version 530684 (0.0010) [2023-12-26 03:49:21,422][123091] Updated weights for policy 0, policy_version 530694 (0.0008) [2023-12-26 03:49:21,482][123091] Updated weights for policy 0, policy_version 530704 (0.0007) [2023-12-26 03:49:21,698][123090] Updated weights for policy 1, policy_version 526948 (0.0010) [2023-12-26 03:49:21,758][123090] Updated weights for policy 1, policy_version 526958 (0.0009) [2023-12-26 03:49:21,815][123090] Updated weights for policy 1, policy_version 526968 (0.0009) [2023-12-26 03:49:22,291][123091] Updated weights for policy 0, policy_version 530714 (0.0009) [2023-12-26 03:49:22,366][123091] Updated weights for policy 0, policy_version 530724 (0.0010) [2023-12-26 03:49:22,426][123091] Updated weights for policy 0, policy_version 530734 (0.0009) [2023-12-26 03:49:22,667][123090] Updated weights for policy 1, policy_version 526978 (0.0009) [2023-12-26 03:49:22,723][123090] Updated weights for policy 1, policy_version 526988 (0.0010) [2023-12-26 03:49:22,788][123090] Updated weights for policy 1, policy_version 526998 (0.0009) [2023-12-26 03:49:22,847][123090] Updated weights for policy 1, policy_version 527008 (0.0009) [2023-12-26 03:49:23,257][123091] Updated weights for policy 0, policy_version 530744 (0.0010) [2023-12-26 03:49:23,324][123091] Updated weights for policy 0, policy_version 530754 (0.0009) [2023-12-26 03:49:23,388][123091] Updated weights for policy 0, policy_version 530764 (0.0009) [2023-12-26 03:49:23,662][123090] Updated weights for policy 1, policy_version 527018 (0.0007) [2023-12-26 03:49:23,714][123090] Updated weights for policy 1, policy_version 527028 (0.0010) [2023-12-26 03:49:23,762][123090] Updated weights for policy 1, policy_version 527038 (0.0010) [2023-12-26 03:49:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 270802944. Throughput: 0: 8906.3, 1: 8830.7. Samples: 270776336. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:23,785][121949] Avg episode reward: [(0, '6138.708'), (1, '5661.158')] [2023-12-26 03:49:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000527040_134922240.pth... [2023-12-26 03:49:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000530768_135880704.pth... [2023-12-26 03:49:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000526016_134660096.pth [2023-12-26 03:49:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000529712_135610368.pth [2023-12-26 03:49:24,234][123091] Updated weights for policy 0, policy_version 530775 (0.0010) [2023-12-26 03:49:24,297][123091] Updated weights for policy 0, policy_version 530785 (0.0010) [2023-12-26 03:49:24,367][123091] Updated weights for policy 0, policy_version 530795 (0.0009) [2023-12-26 03:49:24,508][123090] Updated weights for policy 1, policy_version 527048 (0.0006) [2023-12-26 03:49:24,575][123090] Updated weights for policy 1, policy_version 527058 (0.0007) [2023-12-26 03:49:24,637][123090] Updated weights for policy 1, policy_version 527068 (0.0008) [2023-12-26 03:49:25,135][123091] Updated weights for policy 0, policy_version 530805 (0.0008) [2023-12-26 03:49:25,186][123091] Updated weights for policy 0, policy_version 530815 (0.0005) [2023-12-26 03:49:25,237][123091] Updated weights for policy 0, policy_version 530826 (0.0008) [2023-12-26 03:49:25,300][123090] Updated weights for policy 1, policy_version 527078 (0.0006) [2023-12-26 03:49:25,356][123090] Updated weights for policy 1, policy_version 527088 (0.0005) [2023-12-26 03:49:25,406][123090] Updated weights for policy 1, policy_version 527098 (0.0006) [2023-12-26 03:49:26,119][123091] Updated weights for policy 0, policy_version 530836 (0.0009) [2023-12-26 03:49:26,131][123090] Updated weights for policy 1, policy_version 527108 (0.0007) [2023-12-26 03:49:26,182][123091] Updated weights for policy 0, policy_version 530846 (0.0010) [2023-12-26 03:49:26,193][123090] Updated weights for policy 1, policy_version 527118 (0.0007) [2023-12-26 03:49:26,242][123091] Updated weights for policy 0, policy_version 530856 (0.0009) [2023-12-26 03:49:26,253][123090] Updated weights for policy 1, policy_version 527128 (0.0007) [2023-12-26 03:49:27,055][123091] Updated weights for policy 0, policy_version 530866 (0.0009) [2023-12-26 03:49:27,088][123090] Updated weights for policy 1, policy_version 527138 (0.0008) [2023-12-26 03:49:27,110][123091] Updated weights for policy 0, policy_version 530876 (0.0010) [2023-12-26 03:49:27,137][123090] Updated weights for policy 1, policy_version 527148 (0.0008) [2023-12-26 03:49:27,180][123091] Updated weights for policy 0, policy_version 530886 (0.0008) [2023-12-26 03:49:27,183][123090] Updated weights for policy 1, policy_version 527158 (0.0008) [2023-12-26 03:49:27,228][123090] Updated weights for policy 1, policy_version 527168 (0.0008) [2023-12-26 03:49:27,237][123091] Updated weights for policy 0, policy_version 530896 (0.0009) [2023-12-26 03:49:28,051][123091] Updated weights for policy 0, policy_version 530906 (0.0009) [2023-12-26 03:49:28,075][123090] Updated weights for policy 1, policy_version 527178 (0.0009) [2023-12-26 03:49:28,101][123091] Updated weights for policy 0, policy_version 530916 (0.0007) [2023-12-26 03:49:28,132][123090] Updated weights for policy 1, policy_version 527188 (0.0010) [2023-12-26 03:49:28,155][123091] Updated weights for policy 0, policy_version 530926 (0.0008) [2023-12-26 03:49:28,183][123090] Updated weights for policy 1, policy_version 527198 (0.0008) [2023-12-26 03:49:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 270884864. Throughput: 0: 8865.1, 1: 8848.1. Samples: 270881508. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:28,785][121949] Avg episode reward: [(0, '6091.929'), (1, '5501.909')] [2023-12-26 03:49:28,999][123090] Updated weights for policy 1, policy_version 527208 (0.0006) [2023-12-26 03:49:29,034][123091] Updated weights for policy 0, policy_version 530936 (0.0008) [2023-12-26 03:49:29,059][123090] Updated weights for policy 1, policy_version 527218 (0.0005) [2023-12-26 03:49:29,093][123091] Updated weights for policy 0, policy_version 530946 (0.0009) [2023-12-26 03:49:29,117][123090] Updated weights for policy 1, policy_version 527228 (0.0008) [2023-12-26 03:49:29,151][123091] Updated weights for policy 0, policy_version 530956 (0.0008) [2023-12-26 03:49:29,909][123090] Updated weights for policy 1, policy_version 527238 (0.0007) [2023-12-26 03:49:29,981][123090] Updated weights for policy 1, policy_version 527248 (0.0009) [2023-12-26 03:49:29,993][123091] Updated weights for policy 0, policy_version 530966 (0.0007) [2023-12-26 03:49:30,047][123090] Updated weights for policy 1, policy_version 527258 (0.0008) [2023-12-26 03:49:30,054][123091] Updated weights for policy 0, policy_version 530976 (0.0009) [2023-12-26 03:49:30,112][123091] Updated weights for policy 0, policy_version 530986 (0.0009) [2023-12-26 03:49:30,746][123090] Updated weights for policy 1, policy_version 527268 (0.0008) [2023-12-26 03:49:30,785][123091] Updated weights for policy 0, policy_version 530996 (0.0007) [2023-12-26 03:49:30,810][123090] Updated weights for policy 1, policy_version 527278 (0.0005) [2023-12-26 03:49:30,848][123091] Updated weights for policy 0, policy_version 531006 (0.0005) [2023-12-26 03:49:30,872][123090] Updated weights for policy 1, policy_version 527288 (0.0005) [2023-12-26 03:49:30,905][123091] Updated weights for policy 0, policy_version 531016 (0.0009) [2023-12-26 03:49:31,611][123090] Updated weights for policy 1, policy_version 527298 (0.0005) [2023-12-26 03:49:31,680][123090] Updated weights for policy 1, policy_version 527308 (0.0009) [2023-12-26 03:49:31,696][123091] Updated weights for policy 0, policy_version 531026 (0.0009) [2023-12-26 03:49:31,753][123090] Updated weights for policy 1, policy_version 527318 (0.0007) [2023-12-26 03:49:31,756][123091] Updated weights for policy 0, policy_version 531036 (0.0008) [2023-12-26 03:49:31,803][123091] Updated weights for policy 0, policy_version 531046 (0.0008) [2023-12-26 03:49:31,824][123090] Updated weights for policy 1, policy_version 527328 (0.0007) [2023-12-26 03:49:31,855][123091] Updated weights for policy 0, policy_version 531056 (0.0008) [2023-12-26 03:49:32,647][123091] Updated weights for policy 0, policy_version 531066 (0.0007) [2023-12-26 03:49:32,652][123090] Updated weights for policy 1, policy_version 527338 (0.0010) [2023-12-26 03:49:32,711][123091] Updated weights for policy 0, policy_version 531076 (0.0007) [2023-12-26 03:49:32,715][123090] Updated weights for policy 1, policy_version 527348 (0.0011) [2023-12-26 03:49:32,773][123091] Updated weights for policy 0, policy_version 531086 (0.0007) [2023-12-26 03:49:32,781][123090] Updated weights for policy 1, policy_version 527358 (0.0010) [2023-12-26 03:49:33,520][123090] Updated weights for policy 1, policy_version 527368 (0.0007) [2023-12-26 03:49:33,558][123091] Updated weights for policy 0, policy_version 531096 (0.0010) [2023-12-26 03:49:33,582][123090] Updated weights for policy 1, policy_version 527378 (0.0006) [2023-12-26 03:49:33,602][123091] Updated weights for policy 0, policy_version 531106 (0.0010) [2023-12-26 03:49:33,643][123090] Updated weights for policy 1, policy_version 527388 (0.0008) [2023-12-26 03:49:33,645][123091] Updated weights for policy 0, policy_version 531116 (0.0010) [2023-12-26 03:49:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 270983168. Throughput: 0: 8861.8, 1: 8862.3. Samples: 270988964. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:33,785][121949] Avg episode reward: [(0, '6093.298'), (1, '5428.044')] [2023-12-26 03:49:34,428][123091] Updated weights for policy 0, policy_version 531126 (0.0009) [2023-12-26 03:49:34,429][123090] Updated weights for policy 1, policy_version 527398 (0.0010) [2023-12-26 03:49:34,489][123091] Updated weights for policy 0, policy_version 531136 (0.0008) [2023-12-26 03:49:34,493][123090] Updated weights for policy 1, policy_version 527408 (0.0006) [2023-12-26 03:49:34,557][123091] Updated weights for policy 0, policy_version 531146 (0.0010) [2023-12-26 03:49:34,560][123090] Updated weights for policy 1, policy_version 527418 (0.0006) [2023-12-26 03:49:35,274][123090] Updated weights for policy 1, policy_version 527428 (0.0008) [2023-12-26 03:49:35,323][123090] Updated weights for policy 1, policy_version 527438 (0.0010) [2023-12-26 03:49:35,329][123091] Updated weights for policy 0, policy_version 531156 (0.0010) [2023-12-26 03:49:35,376][123090] Updated weights for policy 1, policy_version 527448 (0.0011) [2023-12-26 03:49:35,395][123091] Updated weights for policy 0, policy_version 531166 (0.0007) [2023-12-26 03:49:35,453][123091] Updated weights for policy 0, policy_version 531176 (0.0007) [2023-12-26 03:49:36,134][123090] Updated weights for policy 1, policy_version 527458 (0.0010) [2023-12-26 03:49:36,208][123090] Updated weights for policy 1, policy_version 527468 (0.0008) [2023-12-26 03:49:36,253][123091] Updated weights for policy 0, policy_version 531186 (0.0008) [2023-12-26 03:49:36,277][123090] Updated weights for policy 1, policy_version 527478 (0.0011) [2023-12-26 03:49:36,311][123091] Updated weights for policy 0, policy_version 531196 (0.0006) [2023-12-26 03:49:36,342][123090] Updated weights for policy 1, policy_version 527488 (0.0011) [2023-12-26 03:49:36,376][123091] Updated weights for policy 0, policy_version 531206 (0.0009) [2023-12-26 03:49:36,442][123091] Updated weights for policy 0, policy_version 531216 (0.0011) [2023-12-26 03:49:37,064][123090] Updated weights for policy 1, policy_version 527498 (0.0009) [2023-12-26 03:49:37,136][123090] Updated weights for policy 1, policy_version 527508 (0.0009) [2023-12-26 03:49:37,206][123090] Updated weights for policy 1, policy_version 527518 (0.0011) [2023-12-26 03:49:37,222][123091] Updated weights for policy 0, policy_version 531226 (0.0008) [2023-12-26 03:49:37,288][123091] Updated weights for policy 0, policy_version 531236 (0.0009) [2023-12-26 03:49:37,349][123091] Updated weights for policy 0, policy_version 531246 (0.0011) [2023-12-26 03:49:38,045][123090] Updated weights for policy 1, policy_version 527528 (0.0010) [2023-12-26 03:49:38,054][123091] Updated weights for policy 0, policy_version 531256 (0.0011) [2023-12-26 03:49:38,122][123090] Updated weights for policy 1, policy_version 527538 (0.0010) [2023-12-26 03:49:38,126][123091] Updated weights for policy 0, policy_version 531266 (0.0011) [2023-12-26 03:49:38,176][123090] Updated weights for policy 1, policy_version 527548 (0.0007) [2023-12-26 03:49:38,186][123091] Updated weights for policy 0, policy_version 531276 (0.0011) [2023-12-26 03:49:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 271065088. Throughput: 0: 8895.0, 1: 8860.5. Samples: 271043308. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:38,785][121949] Avg episode reward: [(0, '6064.284'), (1, '5376.034')] [2023-12-26 03:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000531280_136011776.pth... [2023-12-26 03:49:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000527552_135053312.pth... [2023-12-26 03:49:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000530224_135741440.pth [2023-12-26 03:49:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000526528_134791168.pth [2023-12-26 03:49:38,917][123091] Updated weights for policy 0, policy_version 531286 (0.0011) [2023-12-26 03:49:38,984][123091] Updated weights for policy 0, policy_version 531296 (0.0011) [2023-12-26 03:49:39,027][123090] Updated weights for policy 1, policy_version 527558 (0.0009) [2023-12-26 03:49:39,051][123091] Updated weights for policy 0, policy_version 531306 (0.0011) [2023-12-26 03:49:39,077][123090] Updated weights for policy 1, policy_version 527568 (0.0008) [2023-12-26 03:49:39,125][123090] Updated weights for policy 1, policy_version 527578 (0.0008) [2023-12-26 03:49:39,860][123091] Updated weights for policy 0, policy_version 531316 (0.0010) [2023-12-26 03:49:39,928][123091] Updated weights for policy 0, policy_version 531326 (0.0010) [2023-12-26 03:49:39,998][123091] Updated weights for policy 0, policy_version 531336 (0.0010) [2023-12-26 03:49:40,039][123090] Updated weights for policy 1, policy_version 527588 (0.0009) [2023-12-26 03:49:40,097][123090] Updated weights for policy 1, policy_version 527598 (0.0010) [2023-12-26 03:49:40,167][123090] Updated weights for policy 1, policy_version 527608 (0.0010) [2023-12-26 03:49:40,835][123091] Updated weights for policy 0, policy_version 531346 (0.0010) [2023-12-26 03:49:40,899][123091] Updated weights for policy 0, policy_version 531356 (0.0010) [2023-12-26 03:49:40,954][123091] Updated weights for policy 0, policy_version 531366 (0.0009) [2023-12-26 03:49:40,997][123090] Updated weights for policy 1, policy_version 527618 (0.0010) [2023-12-26 03:49:41,018][123091] Updated weights for policy 0, policy_version 531376 (0.0008) [2023-12-26 03:49:41,065][123090] Updated weights for policy 1, policy_version 527628 (0.0008) [2023-12-26 03:49:41,138][123090] Updated weights for policy 1, policy_version 527638 (0.0008) [2023-12-26 03:49:41,211][123090] Updated weights for policy 1, policy_version 527648 (0.0008) [2023-12-26 03:49:41,785][123091] Updated weights for policy 0, policy_version 531386 (0.0006) [2023-12-26 03:49:41,841][123091] Updated weights for policy 0, policy_version 531396 (0.0005) [2023-12-26 03:49:41,893][123091] Updated weights for policy 0, policy_version 531406 (0.0005) [2023-12-26 03:49:42,153][123090] Updated weights for policy 1, policy_version 527658 (0.0010) [2023-12-26 03:49:42,219][123090] Updated weights for policy 1, policy_version 527668 (0.0010) [2023-12-26 03:49:42,282][123090] Updated weights for policy 1, policy_version 527678 (0.0010) [2023-12-26 03:49:42,658][123091] Updated weights for policy 0, policy_version 531416 (0.0010) [2023-12-26 03:49:42,706][123091] Updated weights for policy 0, policy_version 531426 (0.0010) [2023-12-26 03:49:42,765][123091] Updated weights for policy 0, policy_version 531436 (0.0011) [2023-12-26 03:49:43,140][123090] Updated weights for policy 1, policy_version 527688 (0.0006) [2023-12-26 03:49:43,210][123090] Updated weights for policy 1, policy_version 527698 (0.0008) [2023-12-26 03:49:43,275][123090] Updated weights for policy 1, policy_version 527708 (0.0008) [2023-12-26 03:49:43,495][123091] Updated weights for policy 0, policy_version 531446 (0.0007) [2023-12-26 03:49:43,549][123091] Updated weights for policy 0, policy_version 531456 (0.0005) [2023-12-26 03:49:43,614][123091] Updated weights for policy 0, policy_version 531466 (0.0005) [2023-12-26 03:49:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 271155200. Throughput: 0: 8906.0, 1: 8811.6. Samples: 271145876. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:43,785][121949] Avg episode reward: [(0, '6131.006'), (1, '5377.032')] [2023-12-26 03:49:44,009][123090] Updated weights for policy 1, policy_version 527718 (0.0009) [2023-12-26 03:49:44,062][123090] Updated weights for policy 1, policy_version 527728 (0.0009) [2023-12-26 03:49:44,123][123090] Updated weights for policy 1, policy_version 527738 (0.0009) [2023-12-26 03:49:44,321][123091] Updated weights for policy 0, policy_version 531476 (0.0007) [2023-12-26 03:49:44,371][123091] Updated weights for policy 0, policy_version 531486 (0.0008) [2023-12-26 03:49:44,418][123091] Updated weights for policy 0, policy_version 531496 (0.0009) [2023-12-26 03:49:45,002][123090] Updated weights for policy 1, policy_version 527748 (0.0009) [2023-12-26 03:49:45,068][123090] Updated weights for policy 1, policy_version 527758 (0.0010) [2023-12-26 03:49:45,125][123090] Updated weights for policy 1, policy_version 527768 (0.0009) [2023-12-26 03:49:45,210][123091] Updated weights for policy 0, policy_version 531506 (0.0008) [2023-12-26 03:49:45,280][123091] Updated weights for policy 0, policy_version 531516 (0.0009) [2023-12-26 03:49:45,344][123091] Updated weights for policy 0, policy_version 531526 (0.0010) [2023-12-26 03:49:45,411][123091] Updated weights for policy 0, policy_version 531536 (0.0009) [2023-12-26 03:49:45,973][123090] Updated weights for policy 1, policy_version 527778 (0.0010) [2023-12-26 03:49:46,024][123090] Updated weights for policy 1, policy_version 527788 (0.0008) [2023-12-26 03:49:46,073][123090] Updated weights for policy 1, policy_version 527798 (0.0009) [2023-12-26 03:49:46,220][123091] Updated weights for policy 0, policy_version 531546 (0.0006) [2023-12-26 03:49:46,267][123091] Updated weights for policy 0, policy_version 531556 (0.0005) [2023-12-26 03:49:46,322][123091] Updated weights for policy 0, policy_version 531566 (0.0005) [2023-12-26 03:49:46,971][123091] Updated weights for policy 0, policy_version 531576 (0.0005) [2023-12-26 03:49:47,008][123090] Updated weights for policy 1, policy_version 527809 (0.0010) [2023-12-26 03:49:47,016][123091] Updated weights for policy 0, policy_version 531586 (0.0005) [2023-12-26 03:49:47,062][123090] Updated weights for policy 1, policy_version 527819 (0.0008) [2023-12-26 03:49:47,071][123091] Updated weights for policy 0, policy_version 531596 (0.0005) [2023-12-26 03:49:47,117][123090] Updated weights for policy 1, policy_version 527830 (0.0009) [2023-12-26 03:49:47,179][123090] Updated weights for policy 1, policy_version 527840 (0.0009) [2023-12-26 03:49:47,748][123091] Updated weights for policy 0, policy_version 531606 (0.0008) [2023-12-26 03:49:47,810][123091] Updated weights for policy 0, policy_version 531616 (0.0009) [2023-12-26 03:49:47,866][123091] Updated weights for policy 0, policy_version 531626 (0.0010) [2023-12-26 03:49:48,088][123090] Updated weights for policy 1, policy_version 527850 (0.0009) [2023-12-26 03:49:48,146][123090] Updated weights for policy 1, policy_version 527860 (0.0009) [2023-12-26 03:49:48,201][123090] Updated weights for policy 1, policy_version 527870 (0.0008) [2023-12-26 03:49:48,665][123091] Updated weights for policy 0, policy_version 531636 (0.0008) [2023-12-26 03:49:48,725][123091] Updated weights for policy 0, policy_version 531646 (0.0005) [2023-12-26 03:49:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 271237120. Throughput: 0: 9033.8, 1: 8729.3. Samples: 271252744. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:48,785][121949] Avg episode reward: [(0, '6094.836'), (1, '5383.456')] [2023-12-26 03:49:48,785][123091] Updated weights for policy 0, policy_version 531656 (0.0009) [2023-12-26 03:49:49,100][123090] Updated weights for policy 1, policy_version 527880 (0.0010) [2023-12-26 03:49:49,151][123090] Updated weights for policy 1, policy_version 527890 (0.0010) [2023-12-26 03:49:49,210][123090] Updated weights for policy 1, policy_version 527900 (0.0010) [2023-12-26 03:49:49,595][123091] Updated weights for policy 0, policy_version 531666 (0.0010) [2023-12-26 03:49:49,653][123091] Updated weights for policy 0, policy_version 531676 (0.0009) [2023-12-26 03:49:49,721][123091] Updated weights for policy 0, policy_version 531686 (0.0007) [2023-12-26 03:49:49,787][123091] Updated weights for policy 0, policy_version 531696 (0.0008) [2023-12-26 03:49:50,053][123090] Updated weights for policy 1, policy_version 527910 (0.0010) [2023-12-26 03:49:50,113][123090] Updated weights for policy 1, policy_version 527920 (0.0009) [2023-12-26 03:49:50,177][123090] Updated weights for policy 1, policy_version 527930 (0.0010) [2023-12-26 03:49:50,600][123091] Updated weights for policy 0, policy_version 531706 (0.0006) [2023-12-26 03:49:50,667][123091] Updated weights for policy 0, policy_version 531716 (0.0011) [2023-12-26 03:49:50,723][123091] Updated weights for policy 0, policy_version 531726 (0.0011) [2023-12-26 03:49:51,024][123090] Updated weights for policy 1, policy_version 527940 (0.0009) [2023-12-26 03:49:51,085][123090] Updated weights for policy 1, policy_version 527950 (0.0008) [2023-12-26 03:49:51,155][123090] Updated weights for policy 1, policy_version 527960 (0.0008) [2023-12-26 03:49:51,554][123091] Updated weights for policy 0, policy_version 531736 (0.0011) [2023-12-26 03:49:51,616][123091] Updated weights for policy 0, policy_version 531746 (0.0011) [2023-12-26 03:49:51,684][123091] Updated weights for policy 0, policy_version 531756 (0.0009) [2023-12-26 03:49:51,965][123090] Updated weights for policy 1, policy_version 527970 (0.0008) [2023-12-26 03:49:52,019][123090] Updated weights for policy 1, policy_version 527980 (0.0009) [2023-12-26 03:49:52,068][123090] Updated weights for policy 1, policy_version 527990 (0.0009) [2023-12-26 03:49:52,115][123090] Updated weights for policy 1, policy_version 528000 (0.0007) [2023-12-26 03:49:52,524][123091] Updated weights for policy 0, policy_version 531766 (0.0008) [2023-12-26 03:49:52,595][123091] Updated weights for policy 0, policy_version 531776 (0.0009) [2023-12-26 03:49:52,655][123091] Updated weights for policy 0, policy_version 531786 (0.0007) [2023-12-26 03:49:52,929][123090] Updated weights for policy 1, policy_version 528010 (0.0007) [2023-12-26 03:49:52,997][123090] Updated weights for policy 1, policy_version 528020 (0.0011) [2023-12-26 03:49:53,054][123090] Updated weights for policy 1, policy_version 528030 (0.0011) [2023-12-26 03:49:53,492][123091] Updated weights for policy 0, policy_version 531796 (0.0009) [2023-12-26 03:49:53,540][123091] Updated weights for policy 0, policy_version 531806 (0.0009) [2023-12-26 03:49:53,588][123091] Updated weights for policy 0, policy_version 531816 (0.0009) [2023-12-26 03:49:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.5, 300 sec: 17772.5). Total num frames: 271327232. Throughput: 0: 9016.5, 1: 8694.9. Samples: 271304468. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:53,785][121949] Avg episode reward: [(0, '6093.560'), (1, '5678.262')] [2023-12-26 03:49:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000531824_136151040.pth... [2023-12-26 03:49:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000530768_135880704.pth [2023-12-26 03:49:53,833][123090] Updated weights for policy 1, policy_version 528040 (0.0006) [2023-12-26 03:49:53,913][123090] Updated weights for policy 1, policy_version 528050 (0.0005) [2023-12-26 03:49:53,990][123090] Updated weights for policy 1, policy_version 528060 (0.0005) [2023-12-26 03:49:54,017][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000528064_135184384.pth... [2023-12-26 03:49:54,023][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000527040_134922240.pth [2023-12-26 03:49:54,326][123091] Updated weights for policy 0, policy_version 531826 (0.0010) [2023-12-26 03:49:54,384][123091] Updated weights for policy 0, policy_version 531836 (0.0006) [2023-12-26 03:49:54,439][123091] Updated weights for policy 0, policy_version 531846 (0.0006) [2023-12-26 03:49:54,488][123091] Updated weights for policy 0, policy_version 531856 (0.0006) [2023-12-26 03:49:54,576][123090] Updated weights for policy 1, policy_version 528070 (0.0005) [2023-12-26 03:49:54,637][123090] Updated weights for policy 1, policy_version 528080 (0.0005) [2023-12-26 03:49:54,704][123090] Updated weights for policy 1, policy_version 528090 (0.0005) [2023-12-26 03:49:55,259][123091] Updated weights for policy 0, policy_version 531866 (0.0006) [2023-12-26 03:49:55,330][123091] Updated weights for policy 0, policy_version 531876 (0.0005) [2023-12-26 03:49:55,404][123091] Updated weights for policy 0, policy_version 531886 (0.0005) [2023-12-26 03:49:55,432][123090] Updated weights for policy 1, policy_version 528100 (0.0006) [2023-12-26 03:49:55,505][123090] Updated weights for policy 1, policy_version 528110 (0.0008) [2023-12-26 03:49:55,557][123090] Updated weights for policy 1, policy_version 528120 (0.0010) [2023-12-26 03:49:56,107][123091] Updated weights for policy 0, policy_version 531896 (0.0008) [2023-12-26 03:49:56,179][123091] Updated weights for policy 0, policy_version 531906 (0.0008) [2023-12-26 03:49:56,245][123090] Updated weights for policy 1, policy_version 528130 (0.0010) [2023-12-26 03:49:56,245][123091] Updated weights for policy 0, policy_version 531916 (0.0009) [2023-12-26 03:49:56,293][123090] Updated weights for policy 1, policy_version 528140 (0.0006) [2023-12-26 03:49:56,350][123090] Updated weights for policy 1, policy_version 528150 (0.0005) [2023-12-26 03:49:56,419][123090] Updated weights for policy 1, policy_version 528160 (0.0005) [2023-12-26 03:49:57,056][123090] Updated weights for policy 1, policy_version 528170 (0.0009) [2023-12-26 03:49:57,103][123090] Updated weights for policy 1, policy_version 528180 (0.0009) [2023-12-26 03:49:57,124][123091] Updated weights for policy 0, policy_version 531926 (0.0010) [2023-12-26 03:49:57,152][123090] Updated weights for policy 1, policy_version 528190 (0.0005) [2023-12-26 03:49:57,174][123091] Updated weights for policy 0, policy_version 531936 (0.0010) [2023-12-26 03:49:57,224][123091] Updated weights for policy 0, policy_version 531946 (0.0010) [2023-12-26 03:49:58,012][123091] Updated weights for policy 0, policy_version 531956 (0.0009) [2023-12-26 03:49:58,027][123090] Updated weights for policy 1, policy_version 528200 (0.0008) [2023-12-26 03:49:58,076][123091] Updated weights for policy 0, policy_version 531966 (0.0010) [2023-12-26 03:49:58,089][123090] Updated weights for policy 1, policy_version 528210 (0.0008) [2023-12-26 03:49:58,129][123091] Updated weights for policy 0, policy_version 531976 (0.0011) [2023-12-26 03:49:58,156][123090] Updated weights for policy 1, policy_version 528220 (0.0008) [2023-12-26 03:49:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 271417344. Throughput: 0: 9027.5, 1: 8820.8. Samples: 271414220. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:49:58,785][121949] Avg episode reward: [(0, '6177.280'), (1, '5880.040')] [2023-12-26 03:49:58,955][123090] Updated weights for policy 1, policy_version 528230 (0.0009) [2023-12-26 03:49:59,017][123090] Updated weights for policy 1, policy_version 528240 (0.0009) [2023-12-26 03:49:59,053][123091] Updated weights for policy 0, policy_version 531986 (0.0007) [2023-12-26 03:49:59,085][123090] Updated weights for policy 1, policy_version 528250 (0.0009) [2023-12-26 03:49:59,110][123091] Updated weights for policy 0, policy_version 531996 (0.0006) [2023-12-26 03:49:59,164][123091] Updated weights for policy 0, policy_version 532006 (0.0009) [2023-12-26 03:49:59,226][123091] Updated weights for policy 0, policy_version 532016 (0.0009) [2023-12-26 03:49:59,983][123091] Updated weights for policy 0, policy_version 532026 (0.0007) [2023-12-26 03:49:59,985][123090] Updated weights for policy 1, policy_version 528260 (0.0009) [2023-12-26 03:50:00,041][123091] Updated weights for policy 0, policy_version 532036 (0.0006) [2023-12-26 03:50:00,044][123090] Updated weights for policy 1, policy_version 528270 (0.0007) [2023-12-26 03:50:00,094][123091] Updated weights for policy 0, policy_version 532046 (0.0005) [2023-12-26 03:50:00,103][123090] Updated weights for policy 1, policy_version 528280 (0.0009) [2023-12-26 03:50:00,831][123090] Updated weights for policy 1, policy_version 528290 (0.0008) [2023-12-26 03:50:00,889][123090] Updated weights for policy 1, policy_version 528300 (0.0009) [2023-12-26 03:50:00,921][123091] Updated weights for policy 0, policy_version 532056 (0.0009) [2023-12-26 03:50:00,944][123090] Updated weights for policy 1, policy_version 528310 (0.0007) [2023-12-26 03:50:00,982][123091] Updated weights for policy 0, policy_version 532066 (0.0007) [2023-12-26 03:50:00,999][123090] Updated weights for policy 1, policy_version 528320 (0.0008) [2023-12-26 03:50:01,047][123091] Updated weights for policy 0, policy_version 532076 (0.0009) [2023-12-26 03:50:01,856][123091] Updated weights for policy 0, policy_version 532086 (0.0006) [2023-12-26 03:50:01,924][123091] Updated weights for policy 0, policy_version 532096 (0.0006) [2023-12-26 03:50:01,951][123090] Updated weights for policy 1, policy_version 528330 (0.0009) [2023-12-26 03:50:01,981][123091] Updated weights for policy 0, policy_version 532106 (0.0009) [2023-12-26 03:50:02,009][123090] Updated weights for policy 1, policy_version 528340 (0.0008) [2023-12-26 03:50:02,075][123090] Updated weights for policy 1, policy_version 528350 (0.0009) [2023-12-26 03:50:02,772][123090] Updated weights for policy 1, policy_version 528360 (0.0007) [2023-12-26 03:50:02,786][123091] Updated weights for policy 0, policy_version 532116 (0.0007) [2023-12-26 03:50:02,846][123090] Updated weights for policy 1, policy_version 528370 (0.0006) [2023-12-26 03:50:02,850][123091] Updated weights for policy 0, policy_version 532126 (0.0009) [2023-12-26 03:50:02,918][123090] Updated weights for policy 1, policy_version 528380 (0.0006) [2023-12-26 03:50:02,920][123091] Updated weights for policy 0, policy_version 532136 (0.0009) [2023-12-26 03:50:03,660][123090] Updated weights for policy 1, policy_version 528390 (0.0007) [2023-12-26 03:50:03,722][123090] Updated weights for policy 1, policy_version 528400 (0.0010) [2023-12-26 03:50:03,763][123091] Updated weights for policy 0, policy_version 532146 (0.0009) [2023-12-26 03:50:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 271499264. Throughput: 0: 8861.2, 1: 8743.6. Samples: 271518400. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:50:03,785][121949] Avg episode reward: [(0, '6161.536'), (1, '5808.491')] [2023-12-26 03:50:03,788][123090] Updated weights for policy 1, policy_version 528410 (0.0010) [2023-12-26 03:50:03,812][123091] Updated weights for policy 0, policy_version 532156 (0.0008) [2023-12-26 03:50:03,875][123091] Updated weights for policy 0, policy_version 532166 (0.0010) [2023-12-26 03:50:03,937][123091] Updated weights for policy 0, policy_version 532176 (0.0010) [2023-12-26 03:50:04,550][123090] Updated weights for policy 1, policy_version 528420 (0.0009) [2023-12-26 03:50:04,616][123090] Updated weights for policy 1, policy_version 528430 (0.0009) [2023-12-26 03:50:04,669][123090] Updated weights for policy 1, policy_version 528440 (0.0009) [2023-12-26 03:50:04,784][123091] Updated weights for policy 0, policy_version 532186 (0.0009) [2023-12-26 03:50:04,831][123091] Updated weights for policy 0, policy_version 532196 (0.0009) [2023-12-26 03:50:04,889][123091] Updated weights for policy 0, policy_version 532206 (0.0009) [2023-12-26 03:50:05,459][123090] Updated weights for policy 1, policy_version 528450 (0.0009) [2023-12-26 03:50:05,521][123090] Updated weights for policy 1, policy_version 528460 (0.0006) [2023-12-26 03:50:05,544][123091] Updated weights for policy 0, policy_version 532216 (0.0006) [2023-12-26 03:50:05,568][123090] Updated weights for policy 1, policy_version 528470 (0.0009) [2023-12-26 03:50:05,604][123091] Updated weights for policy 0, policy_version 532226 (0.0005) [2023-12-26 03:50:05,625][123090] Updated weights for policy 1, policy_version 528480 (0.0008) [2023-12-26 03:50:05,662][123091] Updated weights for policy 0, policy_version 532236 (0.0006) [2023-12-26 03:50:06,316][123091] Updated weights for policy 0, policy_version 532246 (0.0007) [2023-12-26 03:50:06,380][123091] Updated weights for policy 0, policy_version 532256 (0.0009) [2023-12-26 03:50:06,445][123091] Updated weights for policy 0, policy_version 532266 (0.0011) [2023-12-26 03:50:06,535][123090] Updated weights for policy 1, policy_version 528490 (0.0008) [2023-12-26 03:50:06,606][123090] Updated weights for policy 1, policy_version 528500 (0.0006) [2023-12-26 03:50:06,677][123090] Updated weights for policy 1, policy_version 528510 (0.0007) [2023-12-26 03:50:07,249][123091] Updated weights for policy 0, policy_version 532276 (0.0009) [2023-12-26 03:50:07,313][123091] Updated weights for policy 0, policy_version 532286 (0.0006) [2023-12-26 03:50:07,366][123091] Updated weights for policy 0, policy_version 532296 (0.0008) [2023-12-26 03:50:07,392][123090] Updated weights for policy 1, policy_version 528520 (0.0008) [2023-12-26 03:50:07,464][123090] Updated weights for policy 1, policy_version 528530 (0.0009) [2023-12-26 03:50:07,531][123090] Updated weights for policy 1, policy_version 528540 (0.0009) [2023-12-26 03:50:08,130][123091] Updated weights for policy 0, policy_version 532306 (0.0008) [2023-12-26 03:50:08,185][123091] Updated weights for policy 0, policy_version 532316 (0.0010) [2023-12-26 03:50:08,241][123091] Updated weights for policy 0, policy_version 532326 (0.0010) [2023-12-26 03:50:08,300][123091] Updated weights for policy 0, policy_version 532336 (0.0010) [2023-12-26 03:50:08,343][123090] Updated weights for policy 1, policy_version 528550 (0.0009) [2023-12-26 03:50:08,415][123090] Updated weights for policy 1, policy_version 528560 (0.0007) [2023-12-26 03:50:08,484][123090] Updated weights for policy 1, policy_version 528570 (0.0006) [2023-12-26 03:50:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 271597568. Throughput: 0: 8912.4, 1: 8769.0. Samples: 271571996. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:50:08,785][121949] Avg episode reward: [(0, '6165.435'), (1, '5706.658')] [2023-12-26 03:50:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000532336_136282112.pth... [2023-12-26 03:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000528576_135315456.pth... [2023-12-26 03:50:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000531280_136011776.pth [2023-12-26 03:50:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000527552_135053312.pth [2023-12-26 03:50:09,158][123090] Updated weights for policy 1, policy_version 528580 (0.0008) [2023-12-26 03:50:09,209][123091] Updated weights for policy 0, policy_version 532346 (0.0008) [2023-12-26 03:50:09,233][123090] Updated weights for policy 1, policy_version 528590 (0.0006) [2023-12-26 03:50:09,276][123091] Updated weights for policy 0, policy_version 532356 (0.0009) [2023-12-26 03:50:09,299][123090] Updated weights for policy 1, policy_version 528600 (0.0007) [2023-12-26 03:50:09,348][123091] Updated weights for policy 0, policy_version 532366 (0.0009) [2023-12-26 03:50:10,000][123090] Updated weights for policy 1, policy_version 528610 (0.0006) [2023-12-26 03:50:10,074][123090] Updated weights for policy 1, policy_version 528620 (0.0006) [2023-12-26 03:50:10,143][123090] Updated weights for policy 1, policy_version 528630 (0.0009) [2023-12-26 03:50:10,196][123091] Updated weights for policy 0, policy_version 532376 (0.0010) [2023-12-26 03:50:10,210][123090] Updated weights for policy 1, policy_version 528640 (0.0008) [2023-12-26 03:50:10,266][123091] Updated weights for policy 0, policy_version 532386 (0.0008) [2023-12-26 03:50:10,337][123091] Updated weights for policy 0, policy_version 532396 (0.0009) [2023-12-26 03:50:10,929][123090] Updated weights for policy 1, policy_version 528650 (0.0010) [2023-12-26 03:50:10,990][123090] Updated weights for policy 1, policy_version 528660 (0.0009) [2023-12-26 03:50:11,063][123090] Updated weights for policy 1, policy_version 528670 (0.0009) [2023-12-26 03:50:11,175][123091] Updated weights for policy 0, policy_version 532406 (0.0008) [2023-12-26 03:50:11,248][123091] Updated weights for policy 0, policy_version 532416 (0.0010) [2023-12-26 03:50:11,316][123091] Updated weights for policy 0, policy_version 532426 (0.0009) [2023-12-26 03:50:11,899][123090] Updated weights for policy 1, policy_version 528680 (0.0006) [2023-12-26 03:50:11,963][123090] Updated weights for policy 1, policy_version 528690 (0.0006) [2023-12-26 03:50:12,025][123090] Updated weights for policy 1, policy_version 528700 (0.0006) [2023-12-26 03:50:12,226][123091] Updated weights for policy 0, policy_version 532436 (0.0010) [2023-12-26 03:50:12,294][123091] Updated weights for policy 0, policy_version 532446 (0.0009) [2023-12-26 03:50:12,363][123091] Updated weights for policy 0, policy_version 532456 (0.0007) [2023-12-26 03:50:12,834][123090] Updated weights for policy 1, policy_version 528710 (0.0010) [2023-12-26 03:50:12,894][123090] Updated weights for policy 1, policy_version 528720 (0.0010) [2023-12-26 03:50:12,946][123090] Updated weights for policy 1, policy_version 528730 (0.0009) [2023-12-26 03:50:13,211][123091] Updated weights for policy 0, policy_version 532466 (0.0008) [2023-12-26 03:50:13,271][123091] Updated weights for policy 0, policy_version 532476 (0.0009) [2023-12-26 03:50:13,318][123091] Updated weights for policy 0, policy_version 532486 (0.0008) [2023-12-26 03:50:13,373][123091] Updated weights for policy 0, policy_version 532496 (0.0008) [2023-12-26 03:50:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 271679488. Throughput: 0: 8880.2, 1: 8773.1. Samples: 271675912. Policy #0 lag: (min: 13.0, avg: 18.8, max: 45.0) [2023-12-26 03:50:13,785][121949] Avg episode reward: [(0, '6187.074'), (1, '5793.283')] [2023-12-26 03:50:13,814][123090] Updated weights for policy 1, policy_version 528740 (0.0009) [2023-12-26 03:50:13,879][123090] Updated weights for policy 1, policy_version 528750 (0.0006) [2023-12-26 03:50:13,949][123090] Updated weights for policy 1, policy_version 528760 (0.0006) [2023-12-26 03:50:14,210][123091] Updated weights for policy 0, policy_version 532506 (0.0010) [2023-12-26 03:50:14,268][123091] Updated weights for policy 0, policy_version 532516 (0.0010) [2023-12-26 03:50:14,324][123091] Updated weights for policy 0, policy_version 532526 (0.0009) [2023-12-26 03:50:14,706][123090] Updated weights for policy 1, policy_version 528770 (0.0009) [2023-12-26 03:50:14,760][123090] Updated weights for policy 1, policy_version 528780 (0.0006) [2023-12-26 03:50:14,826][123090] Updated weights for policy 1, policy_version 528790 (0.0006) [2023-12-26 03:50:14,888][123090] Updated weights for policy 1, policy_version 528800 (0.0007) [2023-12-26 03:50:15,223][123091] Updated weights for policy 0, policy_version 532536 (0.0010) [2023-12-26 03:50:15,294][123091] Updated weights for policy 0, policy_version 532546 (0.0010) [2023-12-26 03:50:15,363][123091] Updated weights for policy 0, policy_version 532556 (0.0009) [2023-12-26 03:50:15,565][123090] Updated weights for policy 1, policy_version 528810 (0.0005) [2023-12-26 03:50:15,624][123090] Updated weights for policy 1, policy_version 528820 (0.0005) [2023-12-26 03:50:15,688][123090] Updated weights for policy 1, policy_version 528830 (0.0008) [2023-12-26 03:50:16,255][123091] Updated weights for policy 0, policy_version 532566 (0.0010) [2023-12-26 03:50:16,323][123091] Updated weights for policy 0, policy_version 532576 (0.0010) [2023-12-26 03:50:16,373][123091] Updated weights for policy 0, policy_version 532586 (0.0008) [2023-12-26 03:50:16,388][123090] Updated weights for policy 1, policy_version 528840 (0.0008) [2023-12-26 03:50:16,445][123090] Updated weights for policy 1, policy_version 528850 (0.0009) [2023-12-26 03:50:16,504][123090] Updated weights for policy 1, policy_version 528860 (0.0009) [2023-12-26 03:50:17,083][123091] Updated weights for policy 0, policy_version 532596 (0.0007) [2023-12-26 03:50:17,144][123091] Updated weights for policy 0, policy_version 532606 (0.0009) [2023-12-26 03:50:17,208][123091] Updated weights for policy 0, policy_version 532616 (0.0009) [2023-12-26 03:50:17,376][123090] Updated weights for policy 1, policy_version 528870 (0.0009) [2023-12-26 03:50:17,430][123090] Updated weights for policy 1, policy_version 528880 (0.0009) [2023-12-26 03:50:17,491][123090] Updated weights for policy 1, policy_version 528890 (0.0006) [2023-12-26 03:50:17,924][123091] Updated weights for policy 0, policy_version 532626 (0.0009) [2023-12-26 03:50:18,007][123091] Updated weights for policy 0, policy_version 532636 (0.0010) [2023-12-26 03:50:18,077][123091] Updated weights for policy 0, policy_version 532646 (0.0010) [2023-12-26 03:50:18,123][123090] Updated weights for policy 1, policy_version 528900 (0.0006) [2023-12-26 03:50:18,132][123091] Updated weights for policy 0, policy_version 532656 (0.0009) [2023-12-26 03:50:18,171][123090] Updated weights for policy 1, policy_version 528910 (0.0005) [2023-12-26 03:50:18,219][123090] Updated weights for policy 1, policy_version 528920 (0.0005) [2023-12-26 03:50:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 271769600. Throughput: 0: 8840.8, 1: 8818.9. Samples: 271783648. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:18,784][121949] Avg episode reward: [(0, '6052.981'), (1, '5694.225')] [2023-12-26 03:50:18,947][123090] Updated weights for policy 1, policy_version 528930 (0.0005) [2023-12-26 03:50:19,009][123090] Updated weights for policy 1, policy_version 528940 (0.0006) [2023-12-26 03:50:19,036][123091] Updated weights for policy 0, policy_version 532666 (0.0008) [2023-12-26 03:50:19,064][123090] Updated weights for policy 1, policy_version 528950 (0.0006) [2023-12-26 03:50:19,101][123091] Updated weights for policy 0, policy_version 532676 (0.0007) [2023-12-26 03:50:19,124][123090] Updated weights for policy 1, policy_version 528960 (0.0007) [2023-12-26 03:50:19,169][123091] Updated weights for policy 0, policy_version 532686 (0.0010) [2023-12-26 03:50:19,922][123090] Updated weights for policy 1, policy_version 528970 (0.0007) [2023-12-26 03:50:19,997][123090] Updated weights for policy 1, policy_version 528980 (0.0006) [2023-12-26 03:50:20,066][123091] Updated weights for policy 0, policy_version 532696 (0.0009) [2023-12-26 03:50:20,071][123090] Updated weights for policy 1, policy_version 528990 (0.0006) [2023-12-26 03:50:20,132][123091] Updated weights for policy 0, policy_version 532706 (0.0009) [2023-12-26 03:50:20,198][123091] Updated weights for policy 0, policy_version 532716 (0.0009) [2023-12-26 03:50:20,828][123090] Updated weights for policy 1, policy_version 529000 (0.0009) [2023-12-26 03:50:20,897][123090] Updated weights for policy 1, policy_version 529010 (0.0010) [2023-12-26 03:50:20,965][123090] Updated weights for policy 1, policy_version 529020 (0.0009) [2023-12-26 03:50:21,024][123091] Updated weights for policy 0, policy_version 532726 (0.0010) [2023-12-26 03:50:21,093][123091] Updated weights for policy 0, policy_version 532736 (0.0010) [2023-12-26 03:50:21,152][123091] Updated weights for policy 0, policy_version 532746 (0.0009) [2023-12-26 03:50:21,820][123090] Updated weights for policy 1, policy_version 529030 (0.0009) [2023-12-26 03:50:21,873][123090] Updated weights for policy 1, policy_version 529040 (0.0009) [2023-12-26 03:50:21,940][123090] Updated weights for policy 1, policy_version 529050 (0.0010) [2023-12-26 03:50:22,074][123091] Updated weights for policy 0, policy_version 532756 (0.0010) [2023-12-26 03:50:22,145][123091] Updated weights for policy 0, policy_version 532766 (0.0010) [2023-12-26 03:50:22,201][123091] Updated weights for policy 0, policy_version 532776 (0.0010) [2023-12-26 03:50:22,761][123090] Updated weights for policy 1, policy_version 529060 (0.0010) [2023-12-26 03:50:22,831][123090] Updated weights for policy 1, policy_version 529070 (0.0010) [2023-12-26 03:50:22,899][123090] Updated weights for policy 1, policy_version 529080 (0.0009) [2023-12-26 03:50:23,057][123091] Updated weights for policy 0, policy_version 532786 (0.0010) [2023-12-26 03:50:23,126][123091] Updated weights for policy 0, policy_version 532796 (0.0010) [2023-12-26 03:50:23,201][123091] Updated weights for policy 0, policy_version 532806 (0.0009) [2023-12-26 03:50:23,271][123091] Updated weights for policy 0, policy_version 532816 (0.0011) [2023-12-26 03:50:23,704][123090] Updated weights for policy 1, policy_version 529090 (0.0006) [2023-12-26 03:50:23,763][123090] Updated weights for policy 1, policy_version 529100 (0.0005) [2023-12-26 03:50:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 271851520. Throughput: 0: 8772.3, 1: 8801.2. Samples: 271834112. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:23,785][121949] Avg episode reward: [(0, '6026.416'), (1, '5639.947')] [2023-12-26 03:50:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000532816_136404992.pth... [2023-12-26 03:50:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000531824_136151040.pth [2023-12-26 03:50:23,830][123090] Updated weights for policy 1, policy_version 529110 (0.0005) [2023-12-26 03:50:23,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000529120_135454720.pth... [2023-12-26 03:50:23,905][123090] Updated weights for policy 1, policy_version 529120 (0.0005) [2023-12-26 03:50:23,908][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000528064_135184384.pth [2023-12-26 03:50:24,099][123091] Updated weights for policy 0, policy_version 532826 (0.0010) [2023-12-26 03:50:24,147][123091] Updated weights for policy 0, policy_version 532836 (0.0010) [2023-12-26 03:50:24,195][123091] Updated weights for policy 0, policy_version 532846 (0.0010) [2023-12-26 03:50:24,535][123090] Updated weights for policy 1, policy_version 529130 (0.0010) [2023-12-26 03:50:24,589][123090] Updated weights for policy 1, policy_version 529140 (0.0008) [2023-12-26 03:50:24,644][123090] Updated weights for policy 1, policy_version 529150 (0.0006) [2023-12-26 03:50:24,962][123091] Updated weights for policy 0, policy_version 532856 (0.0006) [2023-12-26 03:50:25,018][123091] Updated weights for policy 0, policy_version 532866 (0.0005) [2023-12-26 03:50:25,076][123091] Updated weights for policy 0, policy_version 532876 (0.0005) [2023-12-26 03:50:25,409][123090] Updated weights for policy 1, policy_version 529160 (0.0007) [2023-12-26 03:50:25,469][123090] Updated weights for policy 1, policy_version 529170 (0.0005) [2023-12-26 03:50:25,521][123090] Updated weights for policy 1, policy_version 529180 (0.0005) [2023-12-26 03:50:25,745][123091] Updated weights for policy 0, policy_version 532886 (0.0005) [2023-12-26 03:50:25,793][123091] Updated weights for policy 0, policy_version 532896 (0.0005) [2023-12-26 03:50:25,840][123091] Updated weights for policy 0, policy_version 532906 (0.0005) [2023-12-26 03:50:26,195][123090] Updated weights for policy 1, policy_version 529190 (0.0006) [2023-12-26 03:50:26,254][123090] Updated weights for policy 1, policy_version 529200 (0.0010) [2023-12-26 03:50:26,312][123090] Updated weights for policy 1, policy_version 529210 (0.0010) [2023-12-26 03:50:26,511][123091] Updated weights for policy 0, policy_version 532916 (0.0005) [2023-12-26 03:50:26,573][123091] Updated weights for policy 0, policy_version 532926 (0.0005) [2023-12-26 03:50:26,636][123091] Updated weights for policy 0, policy_version 532936 (0.0005) [2023-12-26 03:50:27,125][123090] Updated weights for policy 1, policy_version 529220 (0.0009) [2023-12-26 03:50:27,181][123090] Updated weights for policy 1, policy_version 529230 (0.0005) [2023-12-26 03:50:27,234][123090] Updated weights for policy 1, policy_version 529240 (0.0010) [2023-12-26 03:50:27,305][123091] Updated weights for policy 0, policy_version 532946 (0.0005) [2023-12-26 03:50:27,355][123091] Updated weights for policy 0, policy_version 532956 (0.0008) [2023-12-26 03:50:27,406][123091] Updated weights for policy 0, policy_version 532966 (0.0006) [2023-12-26 03:50:27,465][123091] Updated weights for policy 0, policy_version 532976 (0.0005) [2023-12-26 03:50:27,967][123090] Updated weights for policy 1, policy_version 529250 (0.0010) [2023-12-26 03:50:28,021][123090] Updated weights for policy 1, policy_version 529260 (0.0005) [2023-12-26 03:50:28,076][123090] Updated weights for policy 1, policy_version 529270 (0.0005) [2023-12-26 03:50:28,133][123090] Updated weights for policy 1, policy_version 529280 (0.0007) [2023-12-26 03:50:28,283][123091] Updated weights for policy 0, policy_version 532986 (0.0005) [2023-12-26 03:50:28,347][123091] Updated weights for policy 0, policy_version 532996 (0.0006) [2023-12-26 03:50:28,413][123091] Updated weights for policy 0, policy_version 533006 (0.0006) [2023-12-26 03:50:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 271949824. Throughput: 0: 8828.7, 1: 8932.5. Samples: 271945132. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:28,785][121949] Avg episode reward: [(0, '6109.954'), (1, '5513.428')] [2023-12-26 03:50:28,885][123090] Updated weights for policy 1, policy_version 529290 (0.0010) [2023-12-26 03:50:28,933][123090] Updated weights for policy 1, policy_version 529300 (0.0010) [2023-12-26 03:50:28,980][123090] Updated weights for policy 1, policy_version 529310 (0.0010) [2023-12-26 03:50:29,031][123091] Updated weights for policy 0, policy_version 533016 (0.0005) [2023-12-26 03:50:29,077][123091] Updated weights for policy 0, policy_version 533026 (0.0005) [2023-12-26 03:50:29,132][123091] Updated weights for policy 0, policy_version 533036 (0.0005) [2023-12-26 03:50:29,863][123090] Updated weights for policy 1, policy_version 529320 (0.0007) [2023-12-26 03:50:29,937][123090] Updated weights for policy 1, policy_version 529330 (0.0007) [2023-12-26 03:50:29,951][123091] Updated weights for policy 0, policy_version 533046 (0.0007) [2023-12-26 03:50:29,995][123090] Updated weights for policy 1, policy_version 529340 (0.0006) [2023-12-26 03:50:30,017][123091] Updated weights for policy 0, policy_version 533056 (0.0009) [2023-12-26 03:50:30,070][123091] Updated weights for policy 0, policy_version 533066 (0.0010) [2023-12-26 03:50:30,640][123090] Updated weights for policy 1, policy_version 529350 (0.0006) [2023-12-26 03:50:30,691][123090] Updated weights for policy 1, policy_version 529360 (0.0005) [2023-12-26 03:50:30,736][123090] Updated weights for policy 1, policy_version 529370 (0.0005) [2023-12-26 03:50:30,910][123091] Updated weights for policy 0, policy_version 533076 (0.0008) [2023-12-26 03:50:30,956][123091] Updated weights for policy 0, policy_version 533086 (0.0005) [2023-12-26 03:50:30,998][123091] Updated weights for policy 0, policy_version 533096 (0.0005) [2023-12-26 03:50:31,510][123090] Updated weights for policy 1, policy_version 529380 (0.0007) [2023-12-26 03:50:31,576][123090] Updated weights for policy 1, policy_version 529390 (0.0009) [2023-12-26 03:50:31,634][123090] Updated weights for policy 1, policy_version 529400 (0.0009) [2023-12-26 03:50:31,834][123091] Updated weights for policy 0, policy_version 533106 (0.0007) [2023-12-26 03:50:31,883][123091] Updated weights for policy 0, policy_version 533116 (0.0009) [2023-12-26 03:50:31,940][123091] Updated weights for policy 0, policy_version 533126 (0.0010) [2023-12-26 03:50:32,007][123091] Updated weights for policy 0, policy_version 533136 (0.0009) [2023-12-26 03:50:32,342][123090] Updated weights for policy 1, policy_version 529410 (0.0008) [2023-12-26 03:50:32,406][123090] Updated weights for policy 1, policy_version 529420 (0.0006) [2023-12-26 03:50:32,461][123090] Updated weights for policy 1, policy_version 529430 (0.0005) [2023-12-26 03:50:32,521][123090] Updated weights for policy 1, policy_version 529440 (0.0005) [2023-12-26 03:50:32,823][123091] Updated weights for policy 0, policy_version 533146 (0.0010) [2023-12-26 03:50:32,882][123091] Updated weights for policy 0, policy_version 533156 (0.0010) [2023-12-26 03:50:32,944][123091] Updated weights for policy 0, policy_version 533166 (0.0011) [2023-12-26 03:50:33,192][123090] Updated weights for policy 1, policy_version 529450 (0.0005) [2023-12-26 03:50:33,243][123090] Updated weights for policy 1, policy_version 529460 (0.0005) [2023-12-26 03:50:33,294][123090] Updated weights for policy 1, policy_version 529470 (0.0005) [2023-12-26 03:50:33,736][123091] Updated weights for policy 0, policy_version 533176 (0.0006) [2023-12-26 03:50:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 272039936. Throughput: 0: 8743.0, 1: 9123.8. Samples: 272056752. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:33,785][121949] Avg episode reward: [(0, '6148.759'), (1, '5478.346')] [2023-12-26 03:50:33,797][123091] Updated weights for policy 0, policy_version 533186 (0.0005) [2023-12-26 03:50:33,867][123091] Updated weights for policy 0, policy_version 533196 (0.0005) [2023-12-26 03:50:33,926][123090] Updated weights for policy 1, policy_version 529480 (0.0005) [2023-12-26 03:50:33,972][123090] Updated weights for policy 1, policy_version 529490 (0.0005) [2023-12-26 03:50:34,026][123090] Updated weights for policy 1, policy_version 529500 (0.0005) [2023-12-26 03:50:34,577][123091] Updated weights for policy 0, policy_version 533206 (0.0010) [2023-12-26 03:50:34,627][123091] Updated weights for policy 0, policy_version 533216 (0.0008) [2023-12-26 03:50:34,693][123091] Updated weights for policy 0, policy_version 533226 (0.0005) [2023-12-26 03:50:34,812][123090] Updated weights for policy 1, policy_version 529510 (0.0008) [2023-12-26 03:50:34,866][123090] Updated weights for policy 1, policy_version 529520 (0.0009) [2023-12-26 03:50:34,933][123090] Updated weights for policy 1, policy_version 529530 (0.0009) [2023-12-26 03:50:35,527][123091] Updated weights for policy 0, policy_version 533236 (0.0008) [2023-12-26 03:50:35,594][123091] Updated weights for policy 0, policy_version 533246 (0.0010) [2023-12-26 03:50:35,639][123090] Updated weights for policy 1, policy_version 529540 (0.0008) [2023-12-26 03:50:35,659][123091] Updated weights for policy 0, policy_version 533256 (0.0010) [2023-12-26 03:50:35,690][123090] Updated weights for policy 1, policy_version 529550 (0.0005) [2023-12-26 03:50:35,755][123090] Updated weights for policy 1, policy_version 529560 (0.0007) [2023-12-26 03:50:36,510][123090] Updated weights for policy 1, policy_version 529570 (0.0009) [2023-12-26 03:50:36,543][123091] Updated weights for policy 0, policy_version 533266 (0.0009) [2023-12-26 03:50:36,574][123090] Updated weights for policy 1, policy_version 529580 (0.0010) [2023-12-26 03:50:36,604][123091] Updated weights for policy 0, policy_version 533276 (0.0007) [2023-12-26 03:50:36,633][123090] Updated weights for policy 1, policy_version 529590 (0.0009) [2023-12-26 03:50:36,661][123091] Updated weights for policy 0, policy_version 533286 (0.0007) [2023-12-26 03:50:36,696][123090] Updated weights for policy 1, policy_version 529600 (0.0010) [2023-12-26 03:50:36,727][123091] Updated weights for policy 0, policy_version 533296 (0.0009) [2023-12-26 03:50:37,440][123090] Updated weights for policy 1, policy_version 529610 (0.0005) [2023-12-26 03:50:37,513][123090] Updated weights for policy 1, policy_version 529620 (0.0005) [2023-12-26 03:50:37,554][123091] Updated weights for policy 0, policy_version 533306 (0.0009) [2023-12-26 03:50:37,583][123090] Updated weights for policy 1, policy_version 529630 (0.0007) [2023-12-26 03:50:37,622][123091] Updated weights for policy 0, policy_version 533316 (0.0008) [2023-12-26 03:50:37,688][123091] Updated weights for policy 0, policy_version 533326 (0.0009) [2023-12-26 03:50:38,359][123090] Updated weights for policy 1, policy_version 529640 (0.0010) [2023-12-26 03:50:38,424][123090] Updated weights for policy 1, policy_version 529650 (0.0011) [2023-12-26 03:50:38,500][123090] Updated weights for policy 1, policy_version 529660 (0.0011) [2023-12-26 03:50:38,534][123091] Updated weights for policy 0, policy_version 533336 (0.0007) [2023-12-26 03:50:38,593][123091] Updated weights for policy 0, policy_version 533346 (0.0005) [2023-12-26 03:50:38,649][123091] Updated weights for policy 0, policy_version 533356 (0.0009) [2023-12-26 03:50:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 272138240. Throughput: 0: 8748.0, 1: 9177.1. Samples: 272111100. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:38,785][121949] Avg episode reward: [(0, '6089.822'), (1, '5618.960')] [2023-12-26 03:50:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000529664_135593984.pth... [2023-12-26 03:50:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000533360_136544256.pth... [2023-12-26 03:50:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000528576_135315456.pth [2023-12-26 03:50:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000532336_136282112.pth [2023-12-26 03:50:39,274][123091] Updated weights for policy 0, policy_version 533366 (0.0009) [2023-12-26 03:50:39,290][123090] Updated weights for policy 1, policy_version 529670 (0.0011) [2023-12-26 03:50:39,334][123091] Updated weights for policy 0, policy_version 533376 (0.0009) [2023-12-26 03:50:39,359][123090] Updated weights for policy 1, policy_version 529680 (0.0010) [2023-12-26 03:50:39,400][123091] Updated weights for policy 0, policy_version 533386 (0.0009) [2023-12-26 03:50:39,434][123090] Updated weights for policy 1, policy_version 529690 (0.0011) [2023-12-26 03:50:40,184][123091] Updated weights for policy 0, policy_version 533396 (0.0007) [2023-12-26 03:50:40,217][123090] Updated weights for policy 1, policy_version 529700 (0.0009) [2023-12-26 03:50:40,245][123091] Updated weights for policy 0, policy_version 533406 (0.0006) [2023-12-26 03:50:40,287][123090] Updated weights for policy 1, policy_version 529710 (0.0006) [2023-12-26 03:50:40,304][123091] Updated weights for policy 0, policy_version 533416 (0.0008) [2023-12-26 03:50:40,347][123090] Updated weights for policy 1, policy_version 529720 (0.0006) [2023-12-26 03:50:41,015][123091] Updated weights for policy 0, policy_version 533426 (0.0009) [2023-12-26 03:50:41,078][123091] Updated weights for policy 0, policy_version 533436 (0.0009) [2023-12-26 03:50:41,103][123090] Updated weights for policy 1, policy_version 529730 (0.0006) [2023-12-26 03:50:41,145][123091] Updated weights for policy 0, policy_version 533446 (0.0008) [2023-12-26 03:50:41,173][123090] Updated weights for policy 1, policy_version 529740 (0.0009) [2023-12-26 03:50:41,212][123091] Updated weights for policy 0, policy_version 533456 (0.0007) [2023-12-26 03:50:41,245][123090] Updated weights for policy 1, policy_version 529750 (0.0006) [2023-12-26 03:50:41,326][123090] Updated weights for policy 1, policy_version 529760 (0.0013) [2023-12-26 03:50:42,031][123091] Updated weights for policy 0, policy_version 533466 (0.0008) [2023-12-26 03:50:42,101][123091] Updated weights for policy 0, policy_version 533476 (0.0008) [2023-12-26 03:50:42,129][123090] Updated weights for policy 1, policy_version 529770 (0.0006) [2023-12-26 03:50:42,154][123091] Updated weights for policy 0, policy_version 533486 (0.0010) [2023-12-26 03:50:42,192][123090] Updated weights for policy 1, policy_version 529780 (0.0007) [2023-12-26 03:50:42,258][123090] Updated weights for policy 1, policy_version 529790 (0.0008) [2023-12-26 03:50:42,979][123091] Updated weights for policy 0, policy_version 533496 (0.0009) [2023-12-26 03:50:43,023][123090] Updated weights for policy 1, policy_version 529800 (0.0009) [2023-12-26 03:50:43,042][123091] Updated weights for policy 0, policy_version 533506 (0.0007) [2023-12-26 03:50:43,071][123090] Updated weights for policy 1, policy_version 529810 (0.0005) [2023-12-26 03:50:43,109][123091] Updated weights for policy 0, policy_version 533516 (0.0007) [2023-12-26 03:50:43,136][123090] Updated weights for policy 1, policy_version 529820 (0.0007) [2023-12-26 03:50:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 272220160. Throughput: 0: 8750.4, 1: 9099.0. Samples: 272217444. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:43,785][121949] Avg episode reward: [(0, '6070.100'), (1, '5716.185')] [2023-12-26 03:50:43,912][123090] Updated weights for policy 1, policy_version 529830 (0.0007) [2023-12-26 03:50:43,974][123090] Updated weights for policy 1, policy_version 529840 (0.0005) [2023-12-26 03:50:43,987][123091] Updated weights for policy 0, policy_version 533526 (0.0008) [2023-12-26 03:50:44,029][123090] Updated weights for policy 1, policy_version 529850 (0.0005) [2023-12-26 03:50:44,048][123091] Updated weights for policy 0, policy_version 533536 (0.0009) [2023-12-26 03:50:44,108][123091] Updated weights for policy 0, policy_version 533546 (0.0009) [2023-12-26 03:50:44,761][123090] Updated weights for policy 1, policy_version 529860 (0.0007) [2023-12-26 03:50:44,825][123090] Updated weights for policy 1, policy_version 529870 (0.0007) [2023-12-26 03:50:44,893][123090] Updated weights for policy 1, policy_version 529880 (0.0007) [2023-12-26 03:50:44,922][123091] Updated weights for policy 0, policy_version 533556 (0.0008) [2023-12-26 03:50:44,970][123091] Updated weights for policy 0, policy_version 533566 (0.0009) [2023-12-26 03:50:45,022][123091] Updated weights for policy 0, policy_version 533576 (0.0009) [2023-12-26 03:50:45,563][123090] Updated weights for policy 1, policy_version 529890 (0.0009) [2023-12-26 03:50:45,649][123090] Updated weights for policy 1, policy_version 529900 (0.0006) [2023-12-26 03:50:45,720][123090] Updated weights for policy 1, policy_version 529910 (0.0008) [2023-12-26 03:50:45,797][123090] Updated weights for policy 1, policy_version 529920 (0.0006) [2023-12-26 03:50:45,889][123091] Updated weights for policy 0, policy_version 533586 (0.0009) [2023-12-26 03:50:45,955][123091] Updated weights for policy 0, policy_version 533596 (0.0010) [2023-12-26 03:50:46,025][123091] Updated weights for policy 0, policy_version 533606 (0.0009) [2023-12-26 03:50:46,094][123091] Updated weights for policy 0, policy_version 533616 (0.0009) [2023-12-26 03:50:46,458][123090] Updated weights for policy 1, policy_version 529930 (0.0009) [2023-12-26 03:50:46,513][123090] Updated weights for policy 1, policy_version 529940 (0.0010) [2023-12-26 03:50:46,564][123090] Updated weights for policy 1, policy_version 529950 (0.0010) [2023-12-26 03:50:46,923][123091] Updated weights for policy 0, policy_version 533626 (0.0009) [2023-12-26 03:50:46,975][123091] Updated weights for policy 0, policy_version 533636 (0.0009) [2023-12-26 03:50:47,027][123091] Updated weights for policy 0, policy_version 533646 (0.0008) [2023-12-26 03:50:47,360][123090] Updated weights for policy 1, policy_version 529960 (0.0007) [2023-12-26 03:50:47,417][123090] Updated weights for policy 1, policy_version 529970 (0.0007) [2023-12-26 03:50:47,479][123090] Updated weights for policy 1, policy_version 529980 (0.0010) [2023-12-26 03:50:47,830][123091] Updated weights for policy 0, policy_version 533656 (0.0009) [2023-12-26 03:50:47,886][123091] Updated weights for policy 0, policy_version 533666 (0.0008) [2023-12-26 03:50:47,945][123091] Updated weights for policy 0, policy_version 533676 (0.0009) [2023-12-26 03:50:48,284][123090] Updated weights for policy 1, policy_version 529990 (0.0009) [2023-12-26 03:50:48,361][123090] Updated weights for policy 1, policy_version 530000 (0.0009) [2023-12-26 03:50:48,427][123090] Updated weights for policy 1, policy_version 530010 (0.0009) [2023-12-26 03:50:48,720][123091] Updated weights for policy 0, policy_version 533686 (0.0008) [2023-12-26 03:50:48,776][123091] Updated weights for policy 0, policy_version 533696 (0.0009) [2023-12-26 03:50:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 272310272. Throughput: 0: 8757.2, 1: 9159.1. Samples: 272324636. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:48,785][121949] Avg episode reward: [(0, '6125.299'), (1, '5613.770')] [2023-12-26 03:50:48,825][123091] Updated weights for policy 0, policy_version 533706 (0.0008) [2023-12-26 03:50:49,237][123090] Updated weights for policy 1, policy_version 530020 (0.0009) [2023-12-26 03:50:49,311][123090] Updated weights for policy 1, policy_version 530030 (0.0006) [2023-12-26 03:50:49,379][123090] Updated weights for policy 1, policy_version 530040 (0.0007) [2023-12-26 03:50:49,701][123091] Updated weights for policy 0, policy_version 533716 (0.0008) [2023-12-26 03:50:49,768][123091] Updated weights for policy 0, policy_version 533726 (0.0009) [2023-12-26 03:50:49,836][123091] Updated weights for policy 0, policy_version 533736 (0.0009) [2023-12-26 03:50:50,156][123090] Updated weights for policy 1, policy_version 530050 (0.0008) [2023-12-26 03:50:50,221][123090] Updated weights for policy 1, policy_version 530060 (0.0006) [2023-12-26 03:50:50,287][123090] Updated weights for policy 1, policy_version 530070 (0.0006) [2023-12-26 03:50:50,352][123090] Updated weights for policy 1, policy_version 530080 (0.0008) [2023-12-26 03:50:50,687][123091] Updated weights for policy 0, policy_version 533746 (0.0008) [2023-12-26 03:50:50,758][123091] Updated weights for policy 0, policy_version 533756 (0.0007) [2023-12-26 03:50:50,829][123091] Updated weights for policy 0, policy_version 533766 (0.0009) [2023-12-26 03:50:50,892][123091] Updated weights for policy 0, policy_version 533776 (0.0010) [2023-12-26 03:50:51,092][123090] Updated weights for policy 1, policy_version 530090 (0.0007) [2023-12-26 03:50:51,162][123090] Updated weights for policy 1, policy_version 530100 (0.0009) [2023-12-26 03:50:51,218][123090] Updated weights for policy 1, policy_version 530110 (0.0008) [2023-12-26 03:50:51,734][123091] Updated weights for policy 0, policy_version 533786 (0.0009) [2023-12-26 03:50:51,792][123091] Updated weights for policy 0, policy_version 533796 (0.0008) [2023-12-26 03:50:51,841][123091] Updated weights for policy 0, policy_version 533806 (0.0005) [2023-12-26 03:50:51,952][123090] Updated weights for policy 1, policy_version 530120 (0.0009) [2023-12-26 03:50:52,000][123090] Updated weights for policy 1, policy_version 530130 (0.0009) [2023-12-26 03:50:52,045][123090] Updated weights for policy 1, policy_version 530140 (0.0006) [2023-12-26 03:50:52,659][123091] Updated weights for policy 0, policy_version 533816 (0.0009) [2023-12-26 03:50:52,726][123091] Updated weights for policy 0, policy_version 533826 (0.0009) [2023-12-26 03:50:52,800][123091] Updated weights for policy 0, policy_version 533836 (0.0010) [2023-12-26 03:50:52,839][123090] Updated weights for policy 1, policy_version 530150 (0.0007) [2023-12-26 03:50:52,908][123090] Updated weights for policy 1, policy_version 530160 (0.0009) [2023-12-26 03:50:52,978][123090] Updated weights for policy 1, policy_version 530170 (0.0009) [2023-12-26 03:50:53,579][123091] Updated weights for policy 0, policy_version 533846 (0.0007) [2023-12-26 03:50:53,642][123091] Updated weights for policy 0, policy_version 533856 (0.0007) [2023-12-26 03:50:53,705][123091] Updated weights for policy 0, policy_version 533866 (0.0007) [2023-12-26 03:50:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 272400384. Throughput: 0: 8690.2, 1: 9193.3. Samples: 272376756. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:53,785][121949] Avg episode reward: [(0, '6095.579'), (1, '5522.601')] [2023-12-26 03:50:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000533872_136675328.pth... [2023-12-26 03:50:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000532816_136404992.pth [2023-12-26 03:50:53,818][123090] Updated weights for policy 1, policy_version 530180 (0.0010) [2023-12-26 03:50:53,877][123090] Updated weights for policy 1, policy_version 530190 (0.0010) [2023-12-26 03:50:53,944][123090] Updated weights for policy 1, policy_version 530200 (0.0011) [2023-12-26 03:50:53,988][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000530208_135733248.pth... [2023-12-26 03:50:53,991][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000529120_135454720.pth [2023-12-26 03:50:54,387][123091] Updated weights for policy 0, policy_version 533876 (0.0008) [2023-12-26 03:50:54,448][123091] Updated weights for policy 0, policy_version 533886 (0.0009) [2023-12-26 03:50:54,505][123091] Updated weights for policy 0, policy_version 533896 (0.0009) [2023-12-26 03:50:54,767][123090] Updated weights for policy 1, policy_version 530210 (0.0009) [2023-12-26 03:50:54,828][123090] Updated weights for policy 1, policy_version 530220 (0.0005) [2023-12-26 03:50:54,891][123090] Updated weights for policy 1, policy_version 530230 (0.0006) [2023-12-26 03:50:54,950][123090] Updated weights for policy 1, policy_version 530240 (0.0007) [2023-12-26 03:50:55,347][123091] Updated weights for policy 0, policy_version 533906 (0.0009) [2023-12-26 03:50:55,417][123091] Updated weights for policy 0, policy_version 533916 (0.0010) [2023-12-26 03:50:55,482][123091] Updated weights for policy 0, policy_version 533926 (0.0010) [2023-12-26 03:50:55,544][123091] Updated weights for policy 0, policy_version 533936 (0.0010) [2023-12-26 03:50:55,662][123090] Updated weights for policy 1, policy_version 530250 (0.0005) [2023-12-26 03:50:55,724][123090] Updated weights for policy 1, policy_version 530260 (0.0005) [2023-12-26 03:50:55,772][123090] Updated weights for policy 1, policy_version 530270 (0.0005) [2023-12-26 03:50:56,323][123091] Updated weights for policy 0, policy_version 533946 (0.0009) [2023-12-26 03:50:56,371][123091] Updated weights for policy 0, policy_version 533956 (0.0009) [2023-12-26 03:50:56,419][123091] Updated weights for policy 0, policy_version 533966 (0.0009) [2023-12-26 03:50:56,482][123090] Updated weights for policy 1, policy_version 530280 (0.0010) [2023-12-26 03:50:56,538][123090] Updated weights for policy 1, policy_version 530290 (0.0011) [2023-12-26 03:50:56,608][123090] Updated weights for policy 1, policy_version 530300 (0.0010) [2023-12-26 03:50:57,276][123091] Updated weights for policy 0, policy_version 533976 (0.0009) [2023-12-26 03:50:57,329][123091] Updated weights for policy 0, policy_version 533986 (0.0007) [2023-12-26 03:50:57,386][123091] Updated weights for policy 0, policy_version 533996 (0.0005) [2023-12-26 03:50:57,427][123090] Updated weights for policy 1, policy_version 530310 (0.0010) [2023-12-26 03:50:57,489][123090] Updated weights for policy 1, policy_version 530320 (0.0010) [2023-12-26 03:50:57,540][123090] Updated weights for policy 1, policy_version 530330 (0.0010) [2023-12-26 03:50:58,135][123091] Updated weights for policy 0, policy_version 534006 (0.0008) [2023-12-26 03:50:58,197][123091] Updated weights for policy 0, policy_version 534016 (0.0010) [2023-12-26 03:50:58,266][123091] Updated weights for policy 0, policy_version 534026 (0.0010) [2023-12-26 03:50:58,322][123090] Updated weights for policy 1, policy_version 530340 (0.0009) [2023-12-26 03:50:58,396][123090] Updated weights for policy 1, policy_version 530350 (0.0010) [2023-12-26 03:50:58,469][123090] Updated weights for policy 1, policy_version 530360 (0.0009) [2023-12-26 03:50:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 272490496. Throughput: 0: 8769.8, 1: 9190.2. Samples: 272484108. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:50:58,785][121949] Avg episode reward: [(0, '6049.335'), (1, '5627.994')] [2023-12-26 03:50:59,278][123091] Updated weights for policy 0, policy_version 534036 (0.0010) [2023-12-26 03:50:59,282][123090] Updated weights for policy 1, policy_version 530370 (0.0008) [2023-12-26 03:50:59,328][123091] Updated weights for policy 0, policy_version 534046 (0.0008) [2023-12-26 03:50:59,340][123090] Updated weights for policy 1, policy_version 530380 (0.0006) [2023-12-26 03:50:59,398][123091] Updated weights for policy 0, policy_version 534056 (0.0008) [2023-12-26 03:50:59,404][123090] Updated weights for policy 1, policy_version 530390 (0.0007) [2023-12-26 03:50:59,468][123090] Updated weights for policy 1, policy_version 530400 (0.0008) [2023-12-26 03:51:00,172][123090] Updated weights for policy 1, policy_version 530410 (0.0005) [2023-12-26 03:51:00,221][123090] Updated weights for policy 1, policy_version 530420 (0.0005) [2023-12-26 03:51:00,251][123091] Updated weights for policy 0, policy_version 534066 (0.0008) [2023-12-26 03:51:00,285][123090] Updated weights for policy 1, policy_version 530430 (0.0005) [2023-12-26 03:51:00,305][123091] Updated weights for policy 0, policy_version 534076 (0.0005) [2023-12-26 03:51:00,360][123091] Updated weights for policy 0, policy_version 534086 (0.0005) [2023-12-26 03:51:00,412][123091] Updated weights for policy 0, policy_version 534096 (0.0005) [2023-12-26 03:51:00,989][123090] Updated weights for policy 1, policy_version 530440 (0.0009) [2023-12-26 03:51:01,052][123090] Updated weights for policy 1, policy_version 530450 (0.0010) [2023-12-26 03:51:01,059][123091] Updated weights for policy 0, policy_version 534106 (0.0009) [2023-12-26 03:51:01,107][123090] Updated weights for policy 1, policy_version 530460 (0.0010) [2023-12-26 03:51:01,119][123091] Updated weights for policy 0, policy_version 534116 (0.0011) [2023-12-26 03:51:01,179][123091] Updated weights for policy 0, policy_version 534126 (0.0011) [2023-12-26 03:51:01,835][123090] Updated weights for policy 1, policy_version 530470 (0.0007) [2023-12-26 03:51:01,889][123090] Updated weights for policy 1, policy_version 530480 (0.0005) [2023-12-26 03:51:01,954][123090] Updated weights for policy 1, policy_version 530490 (0.0007) [2023-12-26 03:51:01,967][123091] Updated weights for policy 0, policy_version 534136 (0.0009) [2023-12-26 03:51:02,034][123091] Updated weights for policy 0, policy_version 534146 (0.0009) [2023-12-26 03:51:02,100][123091] Updated weights for policy 0, policy_version 534156 (0.0008) [2023-12-26 03:51:02,736][123090] Updated weights for policy 1, policy_version 530500 (0.0010) [2023-12-26 03:51:02,795][123090] Updated weights for policy 1, policy_version 530510 (0.0011) [2023-12-26 03:51:02,859][123090] Updated weights for policy 1, policy_version 530520 (0.0011) [2023-12-26 03:51:02,872][123091] Updated weights for policy 0, policy_version 534166 (0.0005) [2023-12-26 03:51:02,933][123091] Updated weights for policy 0, policy_version 534176 (0.0005) [2023-12-26 03:51:02,993][123091] Updated weights for policy 0, policy_version 534186 (0.0005) [2023-12-26 03:51:03,669][123090] Updated weights for policy 1, policy_version 530530 (0.0010) [2023-12-26 03:51:03,723][123091] Updated weights for policy 0, policy_version 534196 (0.0008) [2023-12-26 03:51:03,730][123090] Updated weights for policy 1, policy_version 530540 (0.0010) [2023-12-26 03:51:03,775][123091] Updated weights for policy 0, policy_version 534206 (0.0009) [2023-12-26 03:51:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 272572416. Throughput: 0: 8785.2, 1: 9167.3. Samples: 272591512. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:03,785][121949] Avg episode reward: [(0, '6091.136'), (1, '5456.648')] [2023-12-26 03:51:03,792][123090] Updated weights for policy 1, policy_version 530550 (0.0010) [2023-12-26 03:51:03,842][123091] Updated weights for policy 0, policy_version 534216 (0.0008) [2023-12-26 03:51:03,876][123090] Updated weights for policy 1, policy_version 530560 (0.0009) [2023-12-26 03:51:04,595][123091] Updated weights for policy 0, policy_version 534226 (0.0008) [2023-12-26 03:51:04,666][123090] Updated weights for policy 1, policy_version 530570 (0.0010) [2023-12-26 03:51:04,666][123091] Updated weights for policy 0, policy_version 534236 (0.0006) [2023-12-26 03:51:04,721][123090] Updated weights for policy 1, policy_version 530580 (0.0010) [2023-12-26 03:51:04,729][123091] Updated weights for policy 0, policy_version 534246 (0.0006) [2023-12-26 03:51:04,774][123090] Updated weights for policy 1, policy_version 530590 (0.0010) [2023-12-26 03:51:04,791][123091] Updated weights for policy 0, policy_version 534256 (0.0006) [2023-12-26 03:51:05,415][123091] Updated weights for policy 0, policy_version 534266 (0.0005) [2023-12-26 03:51:05,482][123091] Updated weights for policy 0, policy_version 534276 (0.0005) [2023-12-26 03:51:05,561][123091] Updated weights for policy 0, policy_version 534286 (0.0005) [2023-12-26 03:51:05,580][123090] Updated weights for policy 1, policy_version 530600 (0.0007) [2023-12-26 03:51:05,636][123090] Updated weights for policy 1, policy_version 530610 (0.0005) [2023-12-26 03:51:05,695][123090] Updated weights for policy 1, policy_version 530620 (0.0006) [2023-12-26 03:51:06,154][123091] Updated weights for policy 0, policy_version 534296 (0.0008) [2023-12-26 03:51:06,215][123091] Updated weights for policy 0, policy_version 534306 (0.0009) [2023-12-26 03:51:06,270][123091] Updated weights for policy 0, policy_version 534316 (0.0010) [2023-12-26 03:51:06,324][123090] Updated weights for policy 1, policy_version 530630 (0.0007) [2023-12-26 03:51:06,382][123090] Updated weights for policy 1, policy_version 530640 (0.0009) [2023-12-26 03:51:06,439][123090] Updated weights for policy 1, policy_version 530650 (0.0009) [2023-12-26 03:51:07,089][123091] Updated weights for policy 0, policy_version 534326 (0.0011) [2023-12-26 03:51:07,141][123091] Updated weights for policy 0, policy_version 534336 (0.0011) [2023-12-26 03:51:07,193][123091] Updated weights for policy 0, policy_version 534346 (0.0011) [2023-12-26 03:51:07,248][123090] Updated weights for policy 1, policy_version 530660 (0.0008) [2023-12-26 03:51:07,309][123090] Updated weights for policy 1, policy_version 530670 (0.0008) [2023-12-26 03:51:07,370][123090] Updated weights for policy 1, policy_version 530680 (0.0009) [2023-12-26 03:51:08,044][123091] Updated weights for policy 0, policy_version 534356 (0.0011) [2023-12-26 03:51:08,094][123090] Updated weights for policy 1, policy_version 530690 (0.0008) [2023-12-26 03:51:08,099][123091] Updated weights for policy 0, policy_version 534366 (0.0010) [2023-12-26 03:51:08,146][123091] Updated weights for policy 0, policy_version 534376 (0.0010) [2023-12-26 03:51:08,149][123090] Updated weights for policy 1, policy_version 530700 (0.0006) [2023-12-26 03:51:08,202][123090] Updated weights for policy 1, policy_version 530710 (0.0005) [2023-12-26 03:51:08,289][123090] Updated weights for policy 1, policy_version 530720 (0.0008) [2023-12-26 03:51:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 272670720. Throughput: 0: 8895.3, 1: 9188.2. Samples: 272647868. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:08,785][121949] Avg episode reward: [(0, '6242.619'), (1, '5383.024')] [2023-12-26 03:51:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000534384_136806400.pth... [2023-12-26 03:51:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000530720_135864320.pth... [2023-12-26 03:51:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000529664_135593984.pth [2023-12-26 03:51:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000533360_136544256.pth [2023-12-26 03:51:09,017][123090] Updated weights for policy 1, policy_version 530730 (0.0009) [2023-12-26 03:51:09,026][123091] Updated weights for policy 0, policy_version 534386 (0.0010) [2023-12-26 03:51:09,087][123090] Updated weights for policy 1, policy_version 530740 (0.0008) [2023-12-26 03:51:09,099][123091] Updated weights for policy 0, policy_version 534396 (0.0010) [2023-12-26 03:51:09,150][123090] Updated weights for policy 1, policy_version 530750 (0.0006) [2023-12-26 03:51:09,159][123091] Updated weights for policy 0, policy_version 534406 (0.0011) [2023-12-26 03:51:09,219][123091] Updated weights for policy 0, policy_version 534416 (0.0011) [2023-12-26 03:51:09,924][123090] Updated weights for policy 1, policy_version 530760 (0.0006) [2023-12-26 03:51:10,000][123090] Updated weights for policy 1, policy_version 530770 (0.0008) [2023-12-26 03:51:10,066][123090] Updated weights for policy 1, policy_version 530780 (0.0008) [2023-12-26 03:51:10,122][123091] Updated weights for policy 0, policy_version 534426 (0.0009) [2023-12-26 03:51:10,174][123091] Updated weights for policy 0, policy_version 534436 (0.0009) [2023-12-26 03:51:10,230][123091] Updated weights for policy 0, policy_version 534446 (0.0009) [2023-12-26 03:51:10,828][123090] Updated weights for policy 1, policy_version 530790 (0.0006) [2023-12-26 03:51:10,887][123090] Updated weights for policy 1, policy_version 530800 (0.0007) [2023-12-26 03:51:10,936][123090] Updated weights for policy 1, policy_version 530810 (0.0010) [2023-12-26 03:51:11,164][123091] Updated weights for policy 0, policy_version 534456 (0.0009) [2023-12-26 03:51:11,232][123091] Updated weights for policy 0, policy_version 534466 (0.0007) [2023-12-26 03:51:11,303][123091] Updated weights for policy 0, policy_version 534476 (0.0009) [2023-12-26 03:51:11,768][123090] Updated weights for policy 1, policy_version 530820 (0.0010) [2023-12-26 03:51:11,830][123090] Updated weights for policy 1, policy_version 530830 (0.0010) [2023-12-26 03:51:11,894][123090] Updated weights for policy 1, policy_version 530840 (0.0011) [2023-12-26 03:51:12,164][123091] Updated weights for policy 0, policy_version 534486 (0.0010) [2023-12-26 03:51:12,238][123091] Updated weights for policy 0, policy_version 534496 (0.0009) [2023-12-26 03:51:12,321][123091] Updated weights for policy 0, policy_version 534506 (0.0009) [2023-12-26 03:51:12,734][123090] Updated weights for policy 1, policy_version 530850 (0.0009) [2023-12-26 03:51:12,795][123090] Updated weights for policy 1, policy_version 530860 (0.0006) [2023-12-26 03:51:12,847][123090] Updated weights for policy 1, policy_version 530870 (0.0005) [2023-12-26 03:51:12,905][123090] Updated weights for policy 1, policy_version 530880 (0.0005) [2023-12-26 03:51:13,073][123091] Updated weights for policy 0, policy_version 534516 (0.0009) [2023-12-26 03:51:13,131][123091] Updated weights for policy 0, policy_version 534526 (0.0010) [2023-12-26 03:51:13,189][123091] Updated weights for policy 0, policy_version 534536 (0.0009) [2023-12-26 03:51:13,609][123090] Updated weights for policy 1, policy_version 530890 (0.0005) [2023-12-26 03:51:13,659][123090] Updated weights for policy 1, policy_version 530900 (0.0005) [2023-12-26 03:51:13,714][123090] Updated weights for policy 1, policy_version 530910 (0.0005) [2023-12-26 03:51:13,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 272760832. Throughput: 0: 8731.3, 1: 9157.9. Samples: 272750144. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:13,785][121949] Avg episode reward: [(0, '6136.805'), (1, '5539.337')] [2023-12-26 03:51:13,920][123091] Updated weights for policy 0, policy_version 534546 (0.0008) [2023-12-26 03:51:13,974][123091] Updated weights for policy 0, policy_version 534556 (0.0006) [2023-12-26 03:51:14,022][123091] Updated weights for policy 0, policy_version 534566 (0.0005) [2023-12-26 03:51:14,070][123091] Updated weights for policy 0, policy_version 534576 (0.0007) [2023-12-26 03:51:14,380][123090] Updated weights for policy 1, policy_version 530920 (0.0009) [2023-12-26 03:51:14,439][123090] Updated weights for policy 1, policy_version 530932 (0.0011) [2023-12-26 03:51:14,495][123090] Updated weights for policy 1, policy_version 530942 (0.0008) [2023-12-26 03:51:14,835][123091] Updated weights for policy 0, policy_version 534586 (0.0008) [2023-12-26 03:51:14,906][123091] Updated weights for policy 0, policy_version 534596 (0.0008) [2023-12-26 03:51:14,973][123091] Updated weights for policy 0, policy_version 534606 (0.0009) [2023-12-26 03:51:15,397][123090] Updated weights for policy 1, policy_version 530952 (0.0009) [2023-12-26 03:51:15,453][123090] Updated weights for policy 1, policy_version 530962 (0.0008) [2023-12-26 03:51:15,506][123090] Updated weights for policy 1, policy_version 530972 (0.0010) [2023-12-26 03:51:15,727][123091] Updated weights for policy 0, policy_version 534616 (0.0006) [2023-12-26 03:51:15,791][123091] Updated weights for policy 0, policy_version 534626 (0.0008) [2023-12-26 03:51:15,856][123091] Updated weights for policy 0, policy_version 534636 (0.0005) [2023-12-26 03:51:16,243][123090] Updated weights for policy 1, policy_version 530982 (0.0007) [2023-12-26 03:51:16,290][123090] Updated weights for policy 1, policy_version 530992 (0.0005) [2023-12-26 03:51:16,337][123090] Updated weights for policy 1, policy_version 531002 (0.0005) [2023-12-26 03:51:16,560][123091] Updated weights for policy 0, policy_version 534646 (0.0009) [2023-12-26 03:51:16,612][123091] Updated weights for policy 0, policy_version 534656 (0.0009) [2023-12-26 03:51:16,670][123091] Updated weights for policy 0, policy_version 534666 (0.0008) [2023-12-26 03:51:17,051][123090] Updated weights for policy 1, policy_version 531012 (0.0007) [2023-12-26 03:51:17,103][123090] Updated weights for policy 1, policy_version 531022 (0.0009) [2023-12-26 03:51:17,153][123090] Updated weights for policy 1, policy_version 531032 (0.0009) [2023-12-26 03:51:17,426][123091] Updated weights for policy 0, policy_version 534676 (0.0009) [2023-12-26 03:51:17,485][123091] Updated weights for policy 0, policy_version 534686 (0.0009) [2023-12-26 03:51:17,537][123091] Updated weights for policy 0, policy_version 534696 (0.0010) [2023-12-26 03:51:17,914][123090] Updated weights for policy 1, policy_version 531042 (0.0009) [2023-12-26 03:51:17,981][123090] Updated weights for policy 1, policy_version 531052 (0.0006) [2023-12-26 03:51:18,050][123090] Updated weights for policy 1, policy_version 531062 (0.0005) [2023-12-26 03:51:18,123][123090] Updated weights for policy 1, policy_version 531072 (0.0005) [2023-12-26 03:51:18,320][123091] Updated weights for policy 0, policy_version 534706 (0.0010) [2023-12-26 03:51:18,382][123091] Updated weights for policy 0, policy_version 534716 (0.0009) [2023-12-26 03:51:18,438][123091] Updated weights for policy 0, policy_version 534726 (0.0010) [2023-12-26 03:51:18,503][123091] Updated weights for policy 0, policy_version 534736 (0.0005) [2023-12-26 03:51:18,779][123090] Updated weights for policy 1, policy_version 531082 (0.0010) [2023-12-26 03:51:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 272850944. Throughput: 0: 8802.1, 1: 9135.0. Samples: 272863924. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:18,785][121949] Avg episode reward: [(0, '6081.493'), (1, '5580.592')] [2023-12-26 03:51:18,847][123090] Updated weights for policy 1, policy_version 531092 (0.0011) [2023-12-26 03:51:18,910][123090] Updated weights for policy 1, policy_version 531102 (0.0011) [2023-12-26 03:51:19,309][123091] Updated weights for policy 0, policy_version 534746 (0.0009) [2023-12-26 03:51:19,381][123091] Updated weights for policy 0, policy_version 534756 (0.0009) [2023-12-26 03:51:19,448][123091] Updated weights for policy 0, policy_version 534766 (0.0009) [2023-12-26 03:51:19,744][123090] Updated weights for policy 1, policy_version 531112 (0.0010) [2023-12-26 03:51:19,799][123090] Updated weights for policy 1, policy_version 531122 (0.0010) [2023-12-26 03:51:19,869][123090] Updated weights for policy 1, policy_version 531132 (0.0008) [2023-12-26 03:51:20,305][123091] Updated weights for policy 0, policy_version 534776 (0.0009) [2023-12-26 03:51:20,372][123091] Updated weights for policy 0, policy_version 534786 (0.0009) [2023-12-26 03:51:20,436][123091] Updated weights for policy 0, policy_version 534796 (0.0010) [2023-12-26 03:51:20,701][123090] Updated weights for policy 1, policy_version 531142 (0.0008) [2023-12-26 03:51:20,767][123090] Updated weights for policy 1, policy_version 531152 (0.0009) [2023-12-26 03:51:20,838][123090] Updated weights for policy 1, policy_version 531162 (0.0008) [2023-12-26 03:51:21,218][123091] Updated weights for policy 0, policy_version 534806 (0.0009) [2023-12-26 03:51:21,278][123091] Updated weights for policy 0, policy_version 534816 (0.0008) [2023-12-26 03:51:21,345][123091] Updated weights for policy 0, policy_version 534826 (0.0009) [2023-12-26 03:51:21,688][123090] Updated weights for policy 1, policy_version 531172 (0.0009) [2023-12-26 03:51:21,769][123090] Updated weights for policy 1, policy_version 531182 (0.0007) [2023-12-26 03:51:21,846][123090] Updated weights for policy 1, policy_version 531192 (0.0006) [2023-12-26 03:51:22,201][123091] Updated weights for policy 0, policy_version 534837 (0.0009) [2023-12-26 03:51:22,269][123091] Updated weights for policy 0, policy_version 534847 (0.0011) [2023-12-26 03:51:22,341][123091] Updated weights for policy 0, policy_version 534857 (0.0011) [2023-12-26 03:51:22,676][123090] Updated weights for policy 1, policy_version 531202 (0.0009) [2023-12-26 03:51:22,734][123090] Updated weights for policy 1, policy_version 531212 (0.0010) [2023-12-26 03:51:22,801][123090] Updated weights for policy 1, policy_version 531222 (0.0009) [2023-12-26 03:51:22,862][123090] Updated weights for policy 1, policy_version 531232 (0.0009) [2023-12-26 03:51:23,052][123091] Updated weights for policy 0, policy_version 534867 (0.0010) [2023-12-26 03:51:23,106][123091] Updated weights for policy 0, policy_version 534877 (0.0009) [2023-12-26 03:51:23,173][123091] Updated weights for policy 0, policy_version 534887 (0.0006) [2023-12-26 03:51:23,727][123090] Updated weights for policy 1, policy_version 531242 (0.0006) [2023-12-26 03:51:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 272932864. Throughput: 0: 8792.5, 1: 9057.7. Samples: 272914360. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:23,785][121949] Avg episode reward: [(0, '6147.060'), (1, '5443.944')] [2023-12-26 03:51:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000534896_136937472.pth... [2023-12-26 03:51:23,793][123090] Updated weights for policy 1, policy_version 531252 (0.0005) [2023-12-26 03:51:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000533872_136675328.pth [2023-12-26 03:51:23,866][123090] Updated weights for policy 1, policy_version 531262 (0.0008) [2023-12-26 03:51:23,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000531264_136003584.pth... [2023-12-26 03:51:23,883][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000530208_135733248.pth [2023-12-26 03:51:23,985][123091] Updated weights for policy 0, policy_version 534897 (0.0009) [2023-12-26 03:51:24,048][123091] Updated weights for policy 0, policy_version 534907 (0.0011) [2023-12-26 03:51:24,115][123091] Updated weights for policy 0, policy_version 534917 (0.0011) [2023-12-26 03:51:24,182][123091] Updated weights for policy 0, policy_version 534927 (0.0011) [2023-12-26 03:51:24,544][123090] Updated weights for policy 1, policy_version 531272 (0.0006) [2023-12-26 03:51:24,613][123090] Updated weights for policy 1, policy_version 531282 (0.0010) [2023-12-26 03:51:24,680][123090] Updated weights for policy 1, policy_version 531292 (0.0008) [2023-12-26 03:51:24,935][123091] Updated weights for policy 0, policy_version 534937 (0.0011) [2023-12-26 03:51:25,001][123091] Updated weights for policy 0, policy_version 534947 (0.0011) [2023-12-26 03:51:25,072][123091] Updated weights for policy 0, policy_version 534957 (0.0011) [2023-12-26 03:51:25,485][123090] Updated weights for policy 1, policy_version 531302 (0.0009) [2023-12-26 03:51:25,540][123090] Updated weights for policy 1, policy_version 531312 (0.0009) [2023-12-26 03:51:25,599][123090] Updated weights for policy 1, policy_version 531322 (0.0008) [2023-12-26 03:51:25,850][123091] Updated weights for policy 0, policy_version 534967 (0.0007) [2023-12-26 03:51:25,897][123091] Updated weights for policy 0, policy_version 534977 (0.0010) [2023-12-26 03:51:25,945][123091] Updated weights for policy 0, policy_version 534987 (0.0010) [2023-12-26 03:51:26,480][123090] Updated weights for policy 1, policy_version 531332 (0.0009) [2023-12-26 03:51:26,536][123090] Updated weights for policy 1, policy_version 531342 (0.0009) [2023-12-26 03:51:26,588][123090] Updated weights for policy 1, policy_version 531352 (0.0009) [2023-12-26 03:51:26,646][123091] Updated weights for policy 0, policy_version 534997 (0.0010) [2023-12-26 03:51:26,712][123091] Updated weights for policy 0, policy_version 535007 (0.0010) [2023-12-26 03:51:26,774][123091] Updated weights for policy 0, policy_version 535017 (0.0010) [2023-12-26 03:51:27,430][123090] Updated weights for policy 1, policy_version 531362 (0.0008) [2023-12-26 03:51:27,492][123090] Updated weights for policy 1, policy_version 531372 (0.0008) [2023-12-26 03:51:27,546][123090] Updated weights for policy 1, policy_version 531382 (0.0005) [2023-12-26 03:51:27,576][123091] Updated weights for policy 0, policy_version 535027 (0.0010) [2023-12-26 03:51:27,597][123090] Updated weights for policy 1, policy_version 531392 (0.0008) [2023-12-26 03:51:27,634][123091] Updated weights for policy 0, policy_version 535037 (0.0010) [2023-12-26 03:51:27,688][123091] Updated weights for policy 0, policy_version 535047 (0.0010) [2023-12-26 03:51:28,367][123090] Updated weights for policy 1, policy_version 531402 (0.0006) [2023-12-26 03:51:28,440][123090] Updated weights for policy 1, policy_version 531412 (0.0007) [2023-12-26 03:51:28,499][123091] Updated weights for policy 0, policy_version 535057 (0.0010) [2023-12-26 03:51:28,513][123090] Updated weights for policy 1, policy_version 531422 (0.0007) [2023-12-26 03:51:28,559][123091] Updated weights for policy 0, policy_version 535067 (0.0005) [2023-12-26 03:51:28,627][123091] Updated weights for policy 0, policy_version 535077 (0.0005) [2023-12-26 03:51:28,697][123091] Updated weights for policy 0, policy_version 535087 (0.0005) [2023-12-26 03:51:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 273031168. Throughput: 0: 8821.2, 1: 9022.2. Samples: 273020396. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:28,785][121949] Avg episode reward: [(0, '6189.438'), (1, '5370.092')] [2023-12-26 03:51:29,260][123090] Updated weights for policy 1, policy_version 531432 (0.0011) [2023-12-26 03:51:29,325][123090] Updated weights for policy 1, policy_version 531442 (0.0011) [2023-12-26 03:51:29,359][123091] Updated weights for policy 0, policy_version 535097 (0.0010) [2023-12-26 03:51:29,389][123090] Updated weights for policy 1, policy_version 531452 (0.0009) [2023-12-26 03:51:29,425][123091] Updated weights for policy 0, policy_version 535107 (0.0010) [2023-12-26 03:51:29,490][123091] Updated weights for policy 0, policy_version 535117 (0.0011) [2023-12-26 03:51:30,248][123090] Updated weights for policy 1, policy_version 531462 (0.0010) [2023-12-26 03:51:30,267][123091] Updated weights for policy 0, policy_version 535127 (0.0007) [2023-12-26 03:51:30,296][123090] Updated weights for policy 1, policy_version 531472 (0.0010) [2023-12-26 03:51:30,319][123091] Updated weights for policy 0, policy_version 535137 (0.0006) [2023-12-26 03:51:30,355][123090] Updated weights for policy 1, policy_version 531482 (0.0010) [2023-12-26 03:51:30,374][123091] Updated weights for policy 0, policy_version 535147 (0.0010) [2023-12-26 03:51:31,033][123091] Updated weights for policy 0, policy_version 535157 (0.0009) [2023-12-26 03:51:31,089][123091] Updated weights for policy 0, policy_version 535167 (0.0010) [2023-12-26 03:51:31,124][123090] Updated weights for policy 1, policy_version 531492 (0.0009) [2023-12-26 03:51:31,153][123091] Updated weights for policy 0, policy_version 535177 (0.0010) [2023-12-26 03:51:31,196][123090] Updated weights for policy 1, policy_version 531502 (0.0007) [2023-12-26 03:51:31,251][123090] Updated weights for policy 1, policy_version 531512 (0.0006) [2023-12-26 03:51:31,959][123090] Updated weights for policy 1, policy_version 531522 (0.0006) [2023-12-26 03:51:31,992][123091] Updated weights for policy 0, policy_version 535187 (0.0009) [2023-12-26 03:51:32,014][123090] Updated weights for policy 1, policy_version 531532 (0.0010) [2023-12-26 03:51:32,043][123091] Updated weights for policy 0, policy_version 535197 (0.0006) [2023-12-26 03:51:32,071][123090] Updated weights for policy 1, policy_version 531542 (0.0010) [2023-12-26 03:51:32,095][123091] Updated weights for policy 0, policy_version 535207 (0.0007) [2023-12-26 03:51:32,134][123090] Updated weights for policy 1, policy_version 531552 (0.0007) [2023-12-26 03:51:32,770][123091] Updated weights for policy 0, policy_version 535217 (0.0006) [2023-12-26 03:51:32,819][123091] Updated weights for policy 0, policy_version 535227 (0.0006) [2023-12-26 03:51:32,881][123091] Updated weights for policy 0, policy_version 535237 (0.0006) [2023-12-26 03:51:32,883][123090] Updated weights for policy 1, policy_version 531562 (0.0007) [2023-12-26 03:51:32,937][123090] Updated weights for policy 1, policy_version 531572 (0.0007) [2023-12-26 03:51:32,949][123091] Updated weights for policy 0, policy_version 535247 (0.0005) [2023-12-26 03:51:33,000][123090] Updated weights for policy 1, policy_version 531582 (0.0006) [2023-12-26 03:51:33,585][123091] Updated weights for policy 0, policy_version 535257 (0.0010) [2023-12-26 03:51:33,638][123091] Updated weights for policy 0, policy_version 535267 (0.0010) [2023-12-26 03:51:33,698][123091] Updated weights for policy 0, policy_version 535277 (0.0011) [2023-12-26 03:51:33,727][123090] Updated weights for policy 1, policy_version 531592 (0.0005) [2023-12-26 03:51:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 273121280. Throughput: 0: 8944.7, 1: 9015.4. Samples: 273132840. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:33,785][121949] Avg episode reward: [(0, '6184.263'), (1, '5397.799')] [2023-12-26 03:51:33,788][123090] Updated weights for policy 1, policy_version 531602 (0.0005) [2023-12-26 03:51:33,844][123090] Updated weights for policy 1, policy_version 531612 (0.0010) [2023-12-26 03:51:34,524][123091] Updated weights for policy 0, policy_version 535287 (0.0010) [2023-12-26 03:51:34,576][123091] Updated weights for policy 0, policy_version 535297 (0.0009) [2023-12-26 03:51:34,640][123091] Updated weights for policy 0, policy_version 535307 (0.0009) [2023-12-26 03:51:34,644][123090] Updated weights for policy 1, policy_version 531622 (0.0006) [2023-12-26 03:51:34,712][123090] Updated weights for policy 1, policy_version 531632 (0.0007) [2023-12-26 03:51:34,774][123090] Updated weights for policy 1, policy_version 531642 (0.0009) [2023-12-26 03:51:35,467][123091] Updated weights for policy 0, policy_version 535317 (0.0008) [2023-12-26 03:51:35,533][123091] Updated weights for policy 0, policy_version 535327 (0.0005) [2023-12-26 03:51:35,577][123090] Updated weights for policy 1, policy_version 531652 (0.0008) [2023-12-26 03:51:35,584][123091] Updated weights for policy 0, policy_version 535337 (0.0008) [2023-12-26 03:51:35,644][123090] Updated weights for policy 1, policy_version 531662 (0.0007) [2023-12-26 03:51:35,709][123090] Updated weights for policy 1, policy_version 531672 (0.0008) [2023-12-26 03:51:36,263][123091] Updated weights for policy 0, policy_version 535347 (0.0010) [2023-12-26 03:51:36,334][123091] Updated weights for policy 0, policy_version 535357 (0.0009) [2023-12-26 03:51:36,390][123090] Updated weights for policy 1, policy_version 531682 (0.0008) [2023-12-26 03:51:36,394][123091] Updated weights for policy 0, policy_version 535367 (0.0009) [2023-12-26 03:51:36,461][123090] Updated weights for policy 1, policy_version 531692 (0.0006) [2023-12-26 03:51:36,536][123090] Updated weights for policy 1, policy_version 531702 (0.0005) [2023-12-26 03:51:36,613][123090] Updated weights for policy 1, policy_version 531712 (0.0006) [2023-12-26 03:51:37,028][123091] Updated weights for policy 0, policy_version 535377 (0.0006) [2023-12-26 03:51:37,093][123091] Updated weights for policy 0, policy_version 535387 (0.0006) [2023-12-26 03:51:37,165][123091] Updated weights for policy 0, policy_version 535397 (0.0006) [2023-12-26 03:51:37,238][123091] Updated weights for policy 0, policy_version 535407 (0.0005) [2023-12-26 03:51:37,239][123090] Updated weights for policy 1, policy_version 531722 (0.0005) [2023-12-26 03:51:37,301][123090] Updated weights for policy 1, policy_version 531732 (0.0005) [2023-12-26 03:51:37,359][123090] Updated weights for policy 1, policy_version 531742 (0.0005) [2023-12-26 03:51:37,876][123091] Updated weights for policy 0, policy_version 535417 (0.0008) [2023-12-26 03:51:37,927][123091] Updated weights for policy 0, policy_version 535427 (0.0007) [2023-12-26 03:51:37,975][123091] Updated weights for policy 0, policy_version 535437 (0.0007) [2023-12-26 03:51:38,040][123090] Updated weights for policy 1, policy_version 531752 (0.0006) [2023-12-26 03:51:38,085][123090] Updated weights for policy 1, policy_version 531762 (0.0005) [2023-12-26 03:51:38,135][123090] Updated weights for policy 1, policy_version 531772 (0.0005) [2023-12-26 03:51:38,717][123091] Updated weights for policy 0, policy_version 535447 (0.0008) [2023-12-26 03:51:38,782][123091] Updated weights for policy 0, policy_version 535457 (0.0009) [2023-12-26 03:51:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 273211392. Throughput: 0: 8986.9, 1: 9024.0. Samples: 273187248. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:38,784][121949] Avg episode reward: [(0, '6195.295'), (1, '5428.825')] [2023-12-26 03:51:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000531776_136134656.pth... [2023-12-26 03:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000530720_135864320.pth [2023-12-26 03:51:38,844][123091] Updated weights for policy 0, policy_version 535467 (0.0009) [2023-12-26 03:51:38,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000535472_137084928.pth... [2023-12-26 03:51:38,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000534384_136806400.pth [2023-12-26 03:51:38,970][123090] Updated weights for policy 1, policy_version 531782 (0.0008) [2023-12-26 03:51:39,027][123090] Updated weights for policy 1, policy_version 531792 (0.0009) [2023-12-26 03:51:39,089][123090] Updated weights for policy 1, policy_version 531802 (0.0010) [2023-12-26 03:51:39,698][123091] Updated weights for policy 0, policy_version 535477 (0.0008) [2023-12-26 03:51:39,758][123091] Updated weights for policy 0, policy_version 535487 (0.0010) [2023-12-26 03:51:39,813][123091] Updated weights for policy 0, policy_version 535497 (0.0010) [2023-12-26 03:51:39,974][123090] Updated weights for policy 1, policy_version 531812 (0.0009) [2023-12-26 03:51:40,045][123090] Updated weights for policy 1, policy_version 531822 (0.0009) [2023-12-26 03:51:40,112][123090] Updated weights for policy 1, policy_version 531832 (0.0010) [2023-12-26 03:51:40,672][123091] Updated weights for policy 0, policy_version 535507 (0.0010) [2023-12-26 03:51:40,720][123091] Updated weights for policy 0, policy_version 535517 (0.0009) [2023-12-26 03:51:40,780][123091] Updated weights for policy 0, policy_version 535527 (0.0010) [2023-12-26 03:51:40,937][123090] Updated weights for policy 1, policy_version 531842 (0.0010) [2023-12-26 03:51:40,985][123090] Updated weights for policy 1, policy_version 531852 (0.0010) [2023-12-26 03:51:41,044][123090] Updated weights for policy 1, policy_version 531862 (0.0009) [2023-12-26 03:51:41,106][123090] Updated weights for policy 1, policy_version 531872 (0.0009) [2023-12-26 03:51:41,632][123091] Updated weights for policy 0, policy_version 535537 (0.0009) [2023-12-26 03:51:41,702][123091] Updated weights for policy 0, policy_version 535547 (0.0008) [2023-12-26 03:51:41,775][123091] Updated weights for policy 0, policy_version 535557 (0.0008) [2023-12-26 03:51:41,842][123091] Updated weights for policy 0, policy_version 535567 (0.0008) [2023-12-26 03:51:41,986][123090] Updated weights for policy 1, policy_version 531882 (0.0010) [2023-12-26 03:51:42,057][123090] Updated weights for policy 1, policy_version 531892 (0.0010) [2023-12-26 03:51:42,121][123090] Updated weights for policy 1, policy_version 531902 (0.0010) [2023-12-26 03:51:42,639][123091] Updated weights for policy 0, policy_version 535577 (0.0009) [2023-12-26 03:51:42,698][123091] Updated weights for policy 0, policy_version 535587 (0.0009) [2023-12-26 03:51:42,766][123091] Updated weights for policy 0, policy_version 535597 (0.0005) [2023-12-26 03:51:42,955][123090] Updated weights for policy 1, policy_version 531912 (0.0007) [2023-12-26 03:51:42,998][123090] Updated weights for policy 1, policy_version 531922 (0.0010) [2023-12-26 03:51:43,052][123090] Updated weights for policy 1, policy_version 531932 (0.0009) [2023-12-26 03:51:43,524][123091] Updated weights for policy 0, policy_version 535607 (0.0007) [2023-12-26 03:51:43,596][123091] Updated weights for policy 0, policy_version 535617 (0.0006) [2023-12-26 03:51:43,664][123091] Updated weights for policy 0, policy_version 535627 (0.0009) [2023-12-26 03:51:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 273301504. Throughput: 0: 8996.4, 1: 8991.8. Samples: 273293580. Policy #0 lag: (min: 11.0, avg: 19.2, max: 43.0) [2023-12-26 03:51:43,785][121949] Avg episode reward: [(0, '6208.420'), (1, '5515.375')] [2023-12-26 03:51:43,806][123090] Updated weights for policy 1, policy_version 531942 (0.0008) [2023-12-26 03:51:43,852][123090] Updated weights for policy 1, policy_version 531952 (0.0008) [2023-12-26 03:51:43,901][123090] Updated weights for policy 1, policy_version 531962 (0.0005) [2023-12-26 03:51:44,437][123091] Updated weights for policy 0, policy_version 535637 (0.0010) [2023-12-26 03:51:44,496][123091] Updated weights for policy 0, policy_version 535647 (0.0009) [2023-12-26 03:51:44,568][123091] Updated weights for policy 0, policy_version 535657 (0.0005) [2023-12-26 03:51:44,710][123090] Updated weights for policy 1, policy_version 531972 (0.0007) [2023-12-26 03:51:44,770][123090] Updated weights for policy 1, policy_version 531982 (0.0009) [2023-12-26 03:51:44,836][123090] Updated weights for policy 1, policy_version 531992 (0.0010) [2023-12-26 03:51:45,235][123091] Updated weights for policy 0, policy_version 535667 (0.0005) [2023-12-26 03:51:45,309][123091] Updated weights for policy 0, policy_version 535677 (0.0006) [2023-12-26 03:51:45,368][123091] Updated weights for policy 0, policy_version 535687 (0.0007) [2023-12-26 03:51:45,667][123090] Updated weights for policy 1, policy_version 532002 (0.0010) [2023-12-26 03:51:45,742][123090] Updated weights for policy 1, policy_version 532012 (0.0010) [2023-12-26 03:51:45,805][123090] Updated weights for policy 1, policy_version 532022 (0.0011) [2023-12-26 03:51:45,865][123090] Updated weights for policy 1, policy_version 532032 (0.0010) [2023-12-26 03:51:46,087][123091] Updated weights for policy 0, policy_version 535697 (0.0010) [2023-12-26 03:51:46,146][123091] Updated weights for policy 0, policy_version 535707 (0.0005) [2023-12-26 03:51:46,207][123091] Updated weights for policy 0, policy_version 535717 (0.0005) [2023-12-26 03:51:46,257][123091] Updated weights for policy 0, policy_version 535727 (0.0005) [2023-12-26 03:51:46,530][123090] Updated weights for policy 1, policy_version 532042 (0.0005) [2023-12-26 03:51:46,588][123090] Updated weights for policy 1, policy_version 532052 (0.0005) [2023-12-26 03:51:46,655][123090] Updated weights for policy 1, policy_version 532062 (0.0005) [2023-12-26 03:51:46,922][123091] Updated weights for policy 0, policy_version 535737 (0.0005) [2023-12-26 03:51:46,969][123091] Updated weights for policy 0, policy_version 535747 (0.0005) [2023-12-26 03:51:47,015][123091] Updated weights for policy 0, policy_version 535757 (0.0005) [2023-12-26 03:51:47,315][123090] Updated weights for policy 1, policy_version 532072 (0.0005) [2023-12-26 03:51:47,367][123090] Updated weights for policy 1, policy_version 532082 (0.0005) [2023-12-26 03:51:47,414][123090] Updated weights for policy 1, policy_version 532092 (0.0005) [2023-12-26 03:51:47,713][123091] Updated weights for policy 0, policy_version 535767 (0.0008) [2023-12-26 03:51:47,774][123091] Updated weights for policy 0, policy_version 535777 (0.0008) [2023-12-26 03:51:47,843][123091] Updated weights for policy 0, policy_version 535787 (0.0006) [2023-12-26 03:51:48,190][123090] Updated weights for policy 1, policy_version 532102 (0.0008) [2023-12-26 03:51:48,250][123090] Updated weights for policy 1, policy_version 532112 (0.0010) [2023-12-26 03:51:48,306][123090] Updated weights for policy 1, policy_version 532122 (0.0009) [2023-12-26 03:51:48,540][123091] Updated weights for policy 0, policy_version 535797 (0.0007) [2023-12-26 03:51:48,610][123091] Updated weights for policy 0, policy_version 535807 (0.0009) [2023-12-26 03:51:48,674][123091] Updated weights for policy 0, policy_version 535817 (0.0010) [2023-12-26 03:51:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 273399808. Throughput: 0: 9123.5, 1: 9008.1. Samples: 273407432. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:51:48,785][121949] Avg episode reward: [(0, '6211.503'), (1, '5441.054')] [2023-12-26 03:51:49,071][123090] Updated weights for policy 1, policy_version 532132 (0.0007) [2023-12-26 03:51:49,130][123090] Updated weights for policy 1, policy_version 532142 (0.0005) [2023-12-26 03:51:49,179][123090] Updated weights for policy 1, policy_version 532152 (0.0005) [2023-12-26 03:51:49,450][123091] Updated weights for policy 0, policy_version 535827 (0.0010) [2023-12-26 03:51:49,517][123091] Updated weights for policy 0, policy_version 535837 (0.0011) [2023-12-26 03:51:49,592][123091] Updated weights for policy 0, policy_version 535847 (0.0009) [2023-12-26 03:51:50,038][123090] Updated weights for policy 1, policy_version 532162 (0.0007) [2023-12-26 03:51:50,102][123090] Updated weights for policy 1, policy_version 532172 (0.0009) [2023-12-26 03:51:50,156][123090] Updated weights for policy 1, policy_version 532182 (0.0009) [2023-12-26 03:51:50,212][123090] Updated weights for policy 1, policy_version 532192 (0.0009) [2023-12-26 03:51:50,403][123091] Updated weights for policy 0, policy_version 535857 (0.0009) [2023-12-26 03:51:50,467][123091] Updated weights for policy 0, policy_version 535867 (0.0006) [2023-12-26 03:51:50,520][123091] Updated weights for policy 0, policy_version 535877 (0.0006) [2023-12-26 03:51:50,587][123091] Updated weights for policy 0, policy_version 535887 (0.0008) [2023-12-26 03:51:51,033][123090] Updated weights for policy 1, policy_version 532202 (0.0006) [2023-12-26 03:51:51,088][123090] Updated weights for policy 1, policy_version 532212 (0.0009) [2023-12-26 03:51:51,149][123090] Updated weights for policy 1, policy_version 532222 (0.0009) [2023-12-26 03:51:51,367][123091] Updated weights for policy 0, policy_version 535897 (0.0009) [2023-12-26 03:51:51,430][123091] Updated weights for policy 0, policy_version 535907 (0.0009) [2023-12-26 03:51:51,497][123091] Updated weights for policy 0, policy_version 535917 (0.0009) [2023-12-26 03:51:51,980][123090] Updated weights for policy 1, policy_version 532232 (0.0009) [2023-12-26 03:51:52,042][123090] Updated weights for policy 1, policy_version 532242 (0.0009) [2023-12-26 03:51:52,106][123090] Updated weights for policy 1, policy_version 532252 (0.0009) [2023-12-26 03:51:52,322][123091] Updated weights for policy 0, policy_version 535927 (0.0009) [2023-12-26 03:51:52,389][123091] Updated weights for policy 0, policy_version 535937 (0.0010) [2023-12-26 03:51:52,454][123091] Updated weights for policy 0, policy_version 535947 (0.0009) [2023-12-26 03:51:52,997][123090] Updated weights for policy 1, policy_version 532262 (0.0009) [2023-12-26 03:51:53,050][123090] Updated weights for policy 1, policy_version 532273 (0.0010) [2023-12-26 03:51:53,102][123090] Updated weights for policy 1, policy_version 532284 (0.0010) [2023-12-26 03:51:53,193][123091] Updated weights for policy 0, policy_version 535957 (0.0007) [2023-12-26 03:51:53,242][123091] Updated weights for policy 0, policy_version 535967 (0.0005) [2023-12-26 03:51:53,302][123091] Updated weights for policy 0, policy_version 535977 (0.0008) [2023-12-26 03:51:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 273481728. Throughput: 0: 9061.3, 1: 8990.6. Samples: 273460208. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:51:53,785][121949] Avg episode reward: [(0, '6279.249'), (1, '5592.869')] [2023-12-26 03:51:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000535984_137216000.pth... [2023-12-26 03:51:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000532288_136265728.pth... [2023-12-26 03:51:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000534896_136937472.pth [2023-12-26 03:51:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000531264_136003584.pth [2023-12-26 03:51:53,958][123090] Updated weights for policy 1, policy_version 532294 (0.0007) [2023-12-26 03:51:54,023][123090] Updated weights for policy 1, policy_version 532304 (0.0006) [2023-12-26 03:51:54,090][123090] Updated weights for policy 1, policy_version 532314 (0.0007) [2023-12-26 03:51:54,157][123091] Updated weights for policy 0, policy_version 535987 (0.0010) [2023-12-26 03:51:54,214][123091] Updated weights for policy 0, policy_version 535997 (0.0011) [2023-12-26 03:51:54,274][123091] Updated weights for policy 0, policy_version 536007 (0.0011) [2023-12-26 03:51:54,923][123090] Updated weights for policy 1, policy_version 532324 (0.0009) [2023-12-26 03:51:54,958][123091] Updated weights for policy 0, policy_version 536017 (0.0010) [2023-12-26 03:51:54,978][123090] Updated weights for policy 1, policy_version 532334 (0.0009) [2023-12-26 03:51:55,020][123091] Updated weights for policy 0, policy_version 536027 (0.0006) [2023-12-26 03:51:55,041][123090] Updated weights for policy 1, policy_version 532344 (0.0009) [2023-12-26 03:51:55,071][123091] Updated weights for policy 0, policy_version 536037 (0.0005) [2023-12-26 03:51:55,125][123091] Updated weights for policy 0, policy_version 536047 (0.0006) [2023-12-26 03:51:55,685][123091] Updated weights for policy 0, policy_version 536057 (0.0005) [2023-12-26 03:51:55,751][123091] Updated weights for policy 0, policy_version 536067 (0.0011) [2023-12-26 03:51:55,820][123091] Updated weights for policy 0, policy_version 536077 (0.0011) [2023-12-26 03:51:55,903][123090] Updated weights for policy 1, policy_version 532354 (0.0008) [2023-12-26 03:51:55,958][123090] Updated weights for policy 1, policy_version 532364 (0.0010) [2023-12-26 03:51:56,011][123090] Updated weights for policy 1, policy_version 532374 (0.0010) [2023-12-26 03:51:56,064][123090] Updated weights for policy 1, policy_version 532384 (0.0009) [2023-12-26 03:51:56,535][123091] Updated weights for policy 0, policy_version 536087 (0.0010) [2023-12-26 03:51:56,584][123091] Updated weights for policy 0, policy_version 536098 (0.0008) [2023-12-26 03:51:56,630][123091] Updated weights for policy 0, policy_version 536108 (0.0008) [2023-12-26 03:51:56,947][123090] Updated weights for policy 1, policy_version 532394 (0.0009) [2023-12-26 03:51:56,998][123090] Updated weights for policy 1, policy_version 532404 (0.0008) [2023-12-26 03:51:57,055][123090] Updated weights for policy 1, policy_version 532414 (0.0009) [2023-12-26 03:51:57,458][123091] Updated weights for policy 0, policy_version 536118 (0.0009) [2023-12-26 03:51:57,518][123091] Updated weights for policy 0, policy_version 536128 (0.0008) [2023-12-26 03:51:57,583][123091] Updated weights for policy 0, policy_version 536138 (0.0010) [2023-12-26 03:51:57,821][123090] Updated weights for policy 1, policy_version 532424 (0.0006) [2023-12-26 03:51:57,870][123090] Updated weights for policy 1, policy_version 532434 (0.0005) [2023-12-26 03:51:57,920][123090] Updated weights for policy 1, policy_version 532444 (0.0006) [2023-12-26 03:51:58,342][123091] Updated weights for policy 0, policy_version 536148 (0.0009) [2023-12-26 03:51:58,412][123091] Updated weights for policy 0, policy_version 536158 (0.0008) [2023-12-26 03:51:58,482][123091] Updated weights for policy 0, policy_version 536168 (0.0008) [2023-12-26 03:51:58,750][123090] Updated weights for policy 1, policy_version 532454 (0.0007) [2023-12-26 03:51:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 273571840. Throughput: 0: 9236.1, 1: 8923.0. Samples: 273567304. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:51:58,785][121949] Avg episode reward: [(0, '6306.607'), (1, '5619.410')] [2023-12-26 03:51:58,813][123090] Updated weights for policy 1, policy_version 532464 (0.0009) [2023-12-26 03:51:58,880][123090] Updated weights for policy 1, policy_version 532474 (0.0009) [2023-12-26 03:51:59,231][123091] Updated weights for policy 0, policy_version 536178 (0.0008) [2023-12-26 03:51:59,303][123091] Updated weights for policy 0, policy_version 536188 (0.0008) [2023-12-26 03:51:59,372][123091] Updated weights for policy 0, policy_version 536198 (0.0008) [2023-12-26 03:51:59,440][123091] Updated weights for policy 0, policy_version 536208 (0.0006) [2023-12-26 03:51:59,596][123090] Updated weights for policy 1, policy_version 532484 (0.0008) [2023-12-26 03:51:59,664][123090] Updated weights for policy 1, policy_version 532494 (0.0005) [2023-12-26 03:51:59,721][123090] Updated weights for policy 1, policy_version 532504 (0.0007) [2023-12-26 03:52:00,186][123091] Updated weights for policy 0, policy_version 536218 (0.0007) [2023-12-26 03:52:00,254][123091] Updated weights for policy 0, policy_version 536228 (0.0006) [2023-12-26 03:52:00,300][123091] Updated weights for policy 0, policy_version 536238 (0.0005) [2023-12-26 03:52:00,414][123090] Updated weights for policy 1, policy_version 532514 (0.0008) [2023-12-26 03:52:00,469][123090] Updated weights for policy 1, policy_version 532524 (0.0005) [2023-12-26 03:52:00,515][123090] Updated weights for policy 1, policy_version 532534 (0.0006) [2023-12-26 03:52:00,566][123090] Updated weights for policy 1, policy_version 532544 (0.0010) [2023-12-26 03:52:00,946][123091] Updated weights for policy 0, policy_version 536248 (0.0005) [2023-12-26 03:52:00,996][123091] Updated weights for policy 0, policy_version 536258 (0.0005) [2023-12-26 03:52:01,059][123091] Updated weights for policy 0, policy_version 536268 (0.0006) [2023-12-26 03:52:01,340][123090] Updated weights for policy 1, policy_version 532554 (0.0010) [2023-12-26 03:52:01,414][123090] Updated weights for policy 1, policy_version 532564 (0.0009) [2023-12-26 03:52:01,470][123090] Updated weights for policy 1, policy_version 532574 (0.0006) [2023-12-26 03:52:01,828][123091] Updated weights for policy 0, policy_version 536278 (0.0009) [2023-12-26 03:52:01,891][123091] Updated weights for policy 0, policy_version 536288 (0.0011) [2023-12-26 03:52:01,961][123091] Updated weights for policy 0, policy_version 536298 (0.0011) [2023-12-26 03:52:02,308][123090] Updated weights for policy 1, policy_version 532584 (0.0007) [2023-12-26 03:52:02,376][123090] Updated weights for policy 1, policy_version 532594 (0.0007) [2023-12-26 03:52:02,447][123090] Updated weights for policy 1, policy_version 532604 (0.0006) [2023-12-26 03:52:02,733][123091] Updated weights for policy 0, policy_version 536308 (0.0009) [2023-12-26 03:52:02,806][123091] Updated weights for policy 0, policy_version 536318 (0.0006) [2023-12-26 03:52:02,877][123091] Updated weights for policy 0, policy_version 536328 (0.0005) [2023-12-26 03:52:03,203][123090] Updated weights for policy 1, policy_version 532614 (0.0007) [2023-12-26 03:52:03,272][123090] Updated weights for policy 1, policy_version 532624 (0.0006) [2023-12-26 03:52:03,330][123090] Updated weights for policy 1, policy_version 532634 (0.0010) [2023-12-26 03:52:03,539][123091] Updated weights for policy 0, policy_version 536338 (0.0006) [2023-12-26 03:52:03,589][123091] Updated weights for policy 0, policy_version 536348 (0.0008) [2023-12-26 03:52:03,643][123091] Updated weights for policy 0, policy_version 536358 (0.0005) [2023-12-26 03:52:03,696][123091] Updated weights for policy 0, policy_version 536368 (0.0006) [2023-12-26 03:52:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18295.4, 300 sec: 17911.3). Total num frames: 273670144. Throughput: 0: 9250.6, 1: 8850.4. Samples: 273678468. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:03,785][121949] Avg episode reward: [(0, '6227.264'), (1, '5656.399')] [2023-12-26 03:52:04,179][123090] Updated weights for policy 1, policy_version 532644 (0.0010) [2023-12-26 03:52:04,237][123090] Updated weights for policy 1, policy_version 532654 (0.0010) [2023-12-26 03:52:04,298][123090] Updated weights for policy 1, policy_version 532664 (0.0010) [2023-12-26 03:52:04,423][123091] Updated weights for policy 0, policy_version 536378 (0.0009) [2023-12-26 03:52:04,494][123091] Updated weights for policy 0, policy_version 536388 (0.0007) [2023-12-26 03:52:04,549][123091] Updated weights for policy 0, policy_version 536398 (0.0008) [2023-12-26 03:52:05,155][123090] Updated weights for policy 1, policy_version 532674 (0.0008) [2023-12-26 03:52:05,215][123090] Updated weights for policy 1, policy_version 532684 (0.0006) [2023-12-26 03:52:05,232][123091] Updated weights for policy 0, policy_version 536408 (0.0007) [2023-12-26 03:52:05,266][123090] Updated weights for policy 1, policy_version 532694 (0.0008) [2023-12-26 03:52:05,285][123091] Updated weights for policy 0, policy_version 536418 (0.0005) [2023-12-26 03:52:05,320][123090] Updated weights for policy 1, policy_version 532704 (0.0008) [2023-12-26 03:52:05,349][123091] Updated weights for policy 0, policy_version 536428 (0.0006) [2023-12-26 03:52:06,135][123091] Updated weights for policy 0, policy_version 536438 (0.0007) [2023-12-26 03:52:06,155][123090] Updated weights for policy 1, policy_version 532714 (0.0009) [2023-12-26 03:52:06,199][123091] Updated weights for policy 0, policy_version 536448 (0.0007) [2023-12-26 03:52:06,214][123090] Updated weights for policy 1, policy_version 532724 (0.0006) [2023-12-26 03:52:06,269][123091] Updated weights for policy 0, policy_version 536458 (0.0009) [2023-12-26 03:52:06,278][123090] Updated weights for policy 1, policy_version 532734 (0.0009) [2023-12-26 03:52:06,989][123090] Updated weights for policy 1, policy_version 532744 (0.0006) [2023-12-26 03:52:07,050][123090] Updated weights for policy 1, policy_version 532754 (0.0005) [2023-12-26 03:52:07,060][123091] Updated weights for policy 0, policy_version 536468 (0.0008) [2023-12-26 03:52:07,110][123090] Updated weights for policy 1, policy_version 532764 (0.0006) [2023-12-26 03:52:07,115][123091] Updated weights for policy 0, policy_version 536478 (0.0007) [2023-12-26 03:52:07,178][123091] Updated weights for policy 0, policy_version 536488 (0.0006) [2023-12-26 03:52:07,770][123090] Updated weights for policy 1, policy_version 532774 (0.0006) [2023-12-26 03:52:07,826][123090] Updated weights for policy 1, policy_version 532784 (0.0006) [2023-12-26 03:52:07,850][123091] Updated weights for policy 0, policy_version 536498 (0.0005) [2023-12-26 03:52:07,885][123090] Updated weights for policy 1, policy_version 532794 (0.0008) [2023-12-26 03:52:07,914][123091] Updated weights for policy 0, policy_version 536508 (0.0006) [2023-12-26 03:52:07,971][123091] Updated weights for policy 0, policy_version 536518 (0.0007) [2023-12-26 03:52:08,037][123091] Updated weights for policy 0, policy_version 536528 (0.0006) [2023-12-26 03:52:08,615][123090] Updated weights for policy 1, policy_version 532804 (0.0006) [2023-12-26 03:52:08,680][123090] Updated weights for policy 1, policy_version 532814 (0.0009) [2023-12-26 03:52:08,744][123090] Updated weights for policy 1, policy_version 532824 (0.0006) [2023-12-26 03:52:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17939.1). Total num frames: 273760256. Throughput: 0: 9313.1, 1: 8860.1. Samples: 273732152. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:08,785][121949] Avg episode reward: [(0, '6152.002'), (1, '5567.973')] [2023-12-26 03:52:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000532832_136404992.pth... [2023-12-26 03:52:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000531776_136134656.pth [2023-12-26 03:52:08,823][123091] Updated weights for policy 0, policy_version 536538 (0.0007) [2023-12-26 03:52:08,886][123091] Updated weights for policy 0, policy_version 536548 (0.0006) [2023-12-26 03:52:08,941][123091] Updated weights for policy 0, policy_version 536558 (0.0006) [2023-12-26 03:52:08,953][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000536560_137363456.pth... [2023-12-26 03:52:08,958][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000535472_137084928.pth [2023-12-26 03:52:09,617][123090] Updated weights for policy 1, policy_version 532834 (0.0009) [2023-12-26 03:52:09,680][123090] Updated weights for policy 1, policy_version 532844 (0.0009) [2023-12-26 03:52:09,714][123091] Updated weights for policy 0, policy_version 536568 (0.0010) [2023-12-26 03:52:09,738][123090] Updated weights for policy 1, policy_version 532854 (0.0006) [2023-12-26 03:52:09,778][123091] Updated weights for policy 0, policy_version 536578 (0.0011) [2023-12-26 03:52:09,788][123090] Updated weights for policy 1, policy_version 532864 (0.0010) [2023-12-26 03:52:09,849][123091] Updated weights for policy 0, policy_version 536588 (0.0009) [2023-12-26 03:52:10,512][123091] Updated weights for policy 0, policy_version 536598 (0.0009) [2023-12-26 03:52:10,571][123091] Updated weights for policy 0, policy_version 536608 (0.0007) [2023-12-26 03:52:10,637][123091] Updated weights for policy 0, policy_version 536618 (0.0007) [2023-12-26 03:52:10,720][123090] Updated weights for policy 1, policy_version 532874 (0.0009) [2023-12-26 03:52:10,784][123090] Updated weights for policy 1, policy_version 532884 (0.0006) [2023-12-26 03:52:10,857][123090] Updated weights for policy 1, policy_version 532894 (0.0005) [2023-12-26 03:52:11,485][123091] Updated weights for policy 0, policy_version 536628 (0.0007) [2023-12-26 03:52:11,545][123091] Updated weights for policy 0, policy_version 536638 (0.0009) [2023-12-26 03:52:11,615][123091] Updated weights for policy 0, policy_version 536648 (0.0010) [2023-12-26 03:52:11,673][123090] Updated weights for policy 1, policy_version 532904 (0.0010) [2023-12-26 03:52:11,743][123090] Updated weights for policy 1, policy_version 532914 (0.0009) [2023-12-26 03:52:11,812][123090] Updated weights for policy 1, policy_version 532924 (0.0010) [2023-12-26 03:52:12,464][123091] Updated weights for policy 0, policy_version 536658 (0.0009) [2023-12-26 03:52:12,523][123091] Updated weights for policy 0, policy_version 536668 (0.0009) [2023-12-26 03:52:12,595][123091] Updated weights for policy 0, policy_version 536678 (0.0005) [2023-12-26 03:52:12,671][123091] Updated weights for policy 0, policy_version 536688 (0.0006) [2023-12-26 03:52:12,681][123090] Updated weights for policy 1, policy_version 532934 (0.0009) [2023-12-26 03:52:12,756][123090] Updated weights for policy 1, policy_version 532944 (0.0010) [2023-12-26 03:52:12,830][123090] Updated weights for policy 1, policy_version 532954 (0.0010) [2023-12-26 03:52:13,386][123091] Updated weights for policy 0, policy_version 536698 (0.0005) [2023-12-26 03:52:13,446][123091] Updated weights for policy 0, policy_version 536709 (0.0006) [2023-12-26 03:52:13,496][123091] Updated weights for policy 0, policy_version 536719 (0.0005) [2023-12-26 03:52:13,745][123090] Updated weights for policy 1, policy_version 532964 (0.0010) [2023-12-26 03:52:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 273842176. Throughput: 0: 9301.2, 1: 8891.1. Samples: 273839052. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:13,784][121949] Avg episode reward: [(0, '6224.368'), (1, '5670.301')] [2023-12-26 03:52:13,807][123090] Updated weights for policy 1, policy_version 532974 (0.0010) [2023-12-26 03:52:13,858][123090] Updated weights for policy 1, policy_version 532984 (0.0009) [2023-12-26 03:52:14,148][123091] Updated weights for policy 0, policy_version 536729 (0.0009) [2023-12-26 03:52:14,211][123091] Updated weights for policy 0, policy_version 536739 (0.0010) [2023-12-26 03:52:14,265][123091] Updated weights for policy 0, policy_version 536749 (0.0010) [2023-12-26 03:52:14,536][123090] Updated weights for policy 1, policy_version 532994 (0.0010) [2023-12-26 03:52:14,600][123090] Updated weights for policy 1, policy_version 533004 (0.0009) [2023-12-26 03:52:14,660][123090] Updated weights for policy 1, policy_version 533014 (0.0009) [2023-12-26 03:52:14,712][123090] Updated weights for policy 1, policy_version 533024 (0.0009) [2023-12-26 03:52:15,132][123091] Updated weights for policy 0, policy_version 536759 (0.0009) [2023-12-26 03:52:15,192][123091] Updated weights for policy 0, policy_version 536769 (0.0009) [2023-12-26 03:52:15,253][123091] Updated weights for policy 0, policy_version 536779 (0.0009) [2023-12-26 03:52:15,532][123090] Updated weights for policy 1, policy_version 533034 (0.0009) [2023-12-26 03:52:15,580][123090] Updated weights for policy 1, policy_version 533044 (0.0005) [2023-12-26 03:52:15,633][123090] Updated weights for policy 1, policy_version 533054 (0.0006) [2023-12-26 03:52:16,179][123091] Updated weights for policy 0, policy_version 536789 (0.0010) [2023-12-26 03:52:16,243][123091] Updated weights for policy 0, policy_version 536799 (0.0010) [2023-12-26 03:52:16,312][123091] Updated weights for policy 0, policy_version 536809 (0.0010) [2023-12-26 03:52:16,357][123090] Updated weights for policy 1, policy_version 533064 (0.0008) [2023-12-26 03:52:16,414][123090] Updated weights for policy 1, policy_version 533074 (0.0009) [2023-12-26 03:52:16,463][123090] Updated weights for policy 1, policy_version 533084 (0.0009) [2023-12-26 03:52:17,152][123091] Updated weights for policy 0, policy_version 536819 (0.0009) [2023-12-26 03:52:17,211][123091] Updated weights for policy 0, policy_version 536829 (0.0010) [2023-12-26 03:52:17,223][123090] Updated weights for policy 1, policy_version 533094 (0.0007) [2023-12-26 03:52:17,260][123091] Updated weights for policy 0, policy_version 536839 (0.0009) [2023-12-26 03:52:17,285][123090] Updated weights for policy 1, policy_version 533104 (0.0005) [2023-12-26 03:52:17,344][123090] Updated weights for policy 1, policy_version 533114 (0.0005) [2023-12-26 03:52:17,969][123090] Updated weights for policy 1, policy_version 533124 (0.0007) [2023-12-26 03:52:18,023][123090] Updated weights for policy 1, policy_version 533134 (0.0010) [2023-12-26 03:52:18,074][123090] Updated weights for policy 1, policy_version 533144 (0.0010) [2023-12-26 03:52:18,147][123091] Updated weights for policy 0, policy_version 536850 (0.0009) [2023-12-26 03:52:18,210][123091] Updated weights for policy 0, policy_version 536860 (0.0009) [2023-12-26 03:52:18,266][123091] Updated weights for policy 0, policy_version 536870 (0.0009) [2023-12-26 03:52:18,326][123091] Updated weights for policy 0, policy_version 536880 (0.0009) [2023-12-26 03:52:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 273932288. Throughput: 0: 9168.5, 1: 8892.6. Samples: 273945592. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:18,784][121949] Avg episode reward: [(0, '6150.513'), (1, '5661.332')] [2023-12-26 03:52:18,921][123090] Updated weights for policy 1, policy_version 533154 (0.0010) [2023-12-26 03:52:18,986][123090] Updated weights for policy 1, policy_version 533164 (0.0009) [2023-12-26 03:52:19,044][123090] Updated weights for policy 1, policy_version 533174 (0.0009) [2023-12-26 03:52:19,097][123090] Updated weights for policy 1, policy_version 533184 (0.0010) [2023-12-26 03:52:19,214][123091] Updated weights for policy 0, policy_version 536890 (0.0009) [2023-12-26 03:52:19,283][123091] Updated weights for policy 0, policy_version 536900 (0.0009) [2023-12-26 03:52:19,344][123091] Updated weights for policy 0, policy_version 536910 (0.0008) [2023-12-26 03:52:19,854][123090] Updated weights for policy 1, policy_version 533194 (0.0008) [2023-12-26 03:52:19,926][123090] Updated weights for policy 1, policy_version 533204 (0.0007) [2023-12-26 03:52:19,990][123090] Updated weights for policy 1, policy_version 533214 (0.0008) [2023-12-26 03:52:20,193][123091] Updated weights for policy 0, policy_version 536920 (0.0009) [2023-12-26 03:52:20,243][123091] Updated weights for policy 0, policy_version 536930 (0.0009) [2023-12-26 03:52:20,293][123091] Updated weights for policy 0, policy_version 536940 (0.0009) [2023-12-26 03:52:20,846][123090] Updated weights for policy 1, policy_version 533224 (0.0009) [2023-12-26 03:52:20,918][123090] Updated weights for policy 1, policy_version 533234 (0.0009) [2023-12-26 03:52:20,988][123090] Updated weights for policy 1, policy_version 533244 (0.0010) [2023-12-26 03:52:21,099][123091] Updated weights for policy 0, policy_version 536950 (0.0009) [2023-12-26 03:52:21,171][123091] Updated weights for policy 0, policy_version 536960 (0.0011) [2023-12-26 03:52:21,238][123091] Updated weights for policy 0, policy_version 536970 (0.0010) [2023-12-26 03:52:21,878][123090] Updated weights for policy 1, policy_version 533254 (0.0009) [2023-12-26 03:52:21,939][123090] Updated weights for policy 1, policy_version 533264 (0.0009) [2023-12-26 03:52:22,000][123090] Updated weights for policy 1, policy_version 533274 (0.0010) [2023-12-26 03:52:22,074][123091] Updated weights for policy 0, policy_version 536980 (0.0010) [2023-12-26 03:52:22,125][123091] Updated weights for policy 0, policy_version 536990 (0.0010) [2023-12-26 03:52:22,196][123091] Updated weights for policy 0, policy_version 537000 (0.0009) [2023-12-26 03:52:22,816][123090] Updated weights for policy 1, policy_version 533284 (0.0007) [2023-12-26 03:52:22,890][123090] Updated weights for policy 1, policy_version 533294 (0.0005) [2023-12-26 03:52:22,964][123090] Updated weights for policy 1, policy_version 533304 (0.0005) [2023-12-26 03:52:23,084][123091] Updated weights for policy 0, policy_version 537010 (0.0009) [2023-12-26 03:52:23,154][123091] Updated weights for policy 0, policy_version 537020 (0.0006) [2023-12-26 03:52:23,229][123091] Updated weights for policy 0, policy_version 537030 (0.0006) [2023-12-26 03:52:23,299][123091] Updated weights for policy 0, policy_version 537040 (0.0005) [2023-12-26 03:52:23,717][123090] Updated weights for policy 1, policy_version 533314 (0.0006) [2023-12-26 03:52:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 274014208. Throughput: 0: 9127.4, 1: 8838.6. Samples: 273995716. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:23,785][121949] Avg episode reward: [(0, '6133.929'), (1, '5660.156')] [2023-12-26 03:52:23,788][123090] Updated weights for policy 1, policy_version 533324 (0.0006) [2023-12-26 03:52:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000537040_137486336.pth... [2023-12-26 03:52:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000535984_137216000.pth [2023-12-26 03:52:23,869][123090] Updated weights for policy 1, policy_version 533334 (0.0008) [2023-12-26 03:52:23,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000533344_136536064.pth... [2023-12-26 03:52:23,940][123090] Updated weights for policy 1, policy_version 533344 (0.0009) [2023-12-26 03:52:23,944][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000532288_136265728.pth [2023-12-26 03:52:23,960][123091] Updated weights for policy 0, policy_version 537050 (0.0006) [2023-12-26 03:52:24,024][123091] Updated weights for policy 0, policy_version 537060 (0.0008) [2023-12-26 03:52:24,087][123091] Updated weights for policy 0, policy_version 537070 (0.0009) [2023-12-26 03:52:24,757][123090] Updated weights for policy 1, policy_version 533354 (0.0009) [2023-12-26 03:52:24,812][123090] Updated weights for policy 1, policy_version 533364 (0.0009) [2023-12-26 03:52:24,837][123091] Updated weights for policy 0, policy_version 537080 (0.0007) [2023-12-26 03:52:24,870][123090] Updated weights for policy 1, policy_version 533374 (0.0008) [2023-12-26 03:52:24,905][123091] Updated weights for policy 0, policy_version 537090 (0.0008) [2023-12-26 03:52:24,983][123091] Updated weights for policy 0, policy_version 537100 (0.0005) [2023-12-26 03:52:25,578][123091] Updated weights for policy 0, policy_version 537110 (0.0006) [2023-12-26 03:52:25,631][123091] Updated weights for policy 0, policy_version 537120 (0.0005) [2023-12-26 03:52:25,680][123091] Updated weights for policy 0, policy_version 537130 (0.0005) [2023-12-26 03:52:25,722][123090] Updated weights for policy 1, policy_version 533384 (0.0009) [2023-12-26 03:52:25,776][123090] Updated weights for policy 1, policy_version 533394 (0.0010) [2023-12-26 03:52:25,833][123090] Updated weights for policy 1, policy_version 533404 (0.0009) [2023-12-26 03:52:26,324][123091] Updated weights for policy 0, policy_version 537140 (0.0007) [2023-12-26 03:52:26,381][123091] Updated weights for policy 0, policy_version 537150 (0.0009) [2023-12-26 03:52:26,445][123091] Updated weights for policy 0, policy_version 537160 (0.0009) [2023-12-26 03:52:26,735][123090] Updated weights for policy 1, policy_version 533414 (0.0010) [2023-12-26 03:52:26,783][123090] Updated weights for policy 1, policy_version 533424 (0.0009) [2023-12-26 03:52:26,843][123090] Updated weights for policy 1, policy_version 533434 (0.0009) [2023-12-26 03:52:27,304][123091] Updated weights for policy 0, policy_version 537170 (0.0010) [2023-12-26 03:52:27,363][123091] Updated weights for policy 0, policy_version 537180 (0.0009) [2023-12-26 03:52:27,422][123091] Updated weights for policy 0, policy_version 537190 (0.0009) [2023-12-26 03:52:27,488][123091] Updated weights for policy 0, policy_version 537200 (0.0009) [2023-12-26 03:52:27,584][123090] Updated weights for policy 1, policy_version 533444 (0.0007) [2023-12-26 03:52:27,640][123090] Updated weights for policy 1, policy_version 533454 (0.0005) [2023-12-26 03:52:27,686][123090] Updated weights for policy 1, policy_version 533464 (0.0005) [2023-12-26 03:52:28,265][123090] Updated weights for policy 1, policy_version 533474 (0.0006) [2023-12-26 03:52:28,317][123090] Updated weights for policy 1, policy_version 533484 (0.0005) [2023-12-26 03:52:28,378][123090] Updated weights for policy 1, policy_version 533494 (0.0008) [2023-12-26 03:52:28,389][123091] Updated weights for policy 0, policy_version 537210 (0.0008) [2023-12-26 03:52:28,437][123090] Updated weights for policy 1, policy_version 533504 (0.0008) [2023-12-26 03:52:28,451][123091] Updated weights for policy 0, policy_version 537220 (0.0008) [2023-12-26 03:52:28,505][123091] Updated weights for policy 0, policy_version 537230 (0.0007) [2023-12-26 03:52:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 274112512. Throughput: 0: 9161.7, 1: 8825.4. Samples: 274103000. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:28,784][121949] Avg episode reward: [(0, '6186.831'), (1, '5673.804')] [2023-12-26 03:52:29,183][123090] Updated weights for policy 1, policy_version 533514 (0.0005) [2023-12-26 03:52:29,233][123091] Updated weights for policy 0, policy_version 537240 (0.0008) [2023-12-26 03:52:29,255][123090] Updated weights for policy 1, policy_version 533524 (0.0008) [2023-12-26 03:52:29,298][123091] Updated weights for policy 0, policy_version 537250 (0.0009) [2023-12-26 03:52:29,304][123090] Updated weights for policy 1, policy_version 533534 (0.0009) [2023-12-26 03:52:29,363][123091] Updated weights for policy 0, policy_version 537260 (0.0011) [2023-12-26 03:52:30,126][123090] Updated weights for policy 1, policy_version 533544 (0.0009) [2023-12-26 03:52:30,148][123091] Updated weights for policy 0, policy_version 537270 (0.0010) [2023-12-26 03:52:30,193][123090] Updated weights for policy 1, policy_version 533554 (0.0008) [2023-12-26 03:52:30,212][123091] Updated weights for policy 0, policy_version 537280 (0.0007) [2023-12-26 03:52:30,258][123090] Updated weights for policy 1, policy_version 533564 (0.0009) [2023-12-26 03:52:30,273][123091] Updated weights for policy 0, policy_version 537290 (0.0006) [2023-12-26 03:52:30,940][123090] Updated weights for policy 1, policy_version 533574 (0.0007) [2023-12-26 03:52:30,999][123090] Updated weights for policy 1, policy_version 533584 (0.0005) [2023-12-26 03:52:31,012][123091] Updated weights for policy 0, policy_version 537300 (0.0007) [2023-12-26 03:52:31,071][123090] Updated weights for policy 1, policy_version 533594 (0.0007) [2023-12-26 03:52:31,076][123091] Updated weights for policy 0, policy_version 537310 (0.0008) [2023-12-26 03:52:31,131][123091] Updated weights for policy 0, policy_version 537320 (0.0008) [2023-12-26 03:52:31,803][123090] Updated weights for policy 1, policy_version 533604 (0.0009) [2023-12-26 03:52:31,863][123090] Updated weights for policy 1, policy_version 533614 (0.0009) [2023-12-26 03:52:31,918][123090] Updated weights for policy 1, policy_version 533624 (0.0009) [2023-12-26 03:52:31,980][123091] Updated weights for policy 0, policy_version 537330 (0.0009) [2023-12-26 03:52:32,044][123091] Updated weights for policy 0, policy_version 537340 (0.0011) [2023-12-26 03:52:32,108][123091] Updated weights for policy 0, policy_version 537350 (0.0011) [2023-12-26 03:52:32,172][123091] Updated weights for policy 0, policy_version 537360 (0.0007) [2023-12-26 03:52:32,766][123090] Updated weights for policy 1, policy_version 533634 (0.0009) [2023-12-26 03:52:32,828][123090] Updated weights for policy 1, policy_version 533644 (0.0009) [2023-12-26 03:52:32,893][123090] Updated weights for policy 1, policy_version 533654 (0.0007) [2023-12-26 03:52:32,903][123091] Updated weights for policy 0, policy_version 537370 (0.0007) [2023-12-26 03:52:32,955][123090] Updated weights for policy 1, policy_version 533664 (0.0009) [2023-12-26 03:52:32,968][123091] Updated weights for policy 0, policy_version 537380 (0.0007) [2023-12-26 03:52:33,023][123091] Updated weights for policy 0, policy_version 537390 (0.0009) [2023-12-26 03:52:33,731][123090] Updated weights for policy 1, policy_version 533674 (0.0009) [2023-12-26 03:52:33,780][123090] Updated weights for policy 1, policy_version 533684 (0.0009) [2023-12-26 03:52:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 274194432. Throughput: 0: 9081.2, 1: 8819.1. Samples: 274212948. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:33,785][121949] Avg episode reward: [(0, '6111.838'), (1, '5528.672')] [2023-12-26 03:52:33,798][123091] Updated weights for policy 0, policy_version 537400 (0.0010) [2023-12-26 03:52:33,829][123090] Updated weights for policy 1, policy_version 533694 (0.0008) [2023-12-26 03:52:33,864][123091] Updated weights for policy 0, policy_version 537410 (0.0009) [2023-12-26 03:52:33,929][123091] Updated weights for policy 0, policy_version 537420 (0.0008) [2023-12-26 03:52:34,706][123090] Updated weights for policy 1, policy_version 533704 (0.0008) [2023-12-26 03:52:34,725][123091] Updated weights for policy 0, policy_version 537430 (0.0009) [2023-12-26 03:52:34,772][123090] Updated weights for policy 1, policy_version 533714 (0.0006) [2023-12-26 03:52:34,791][123091] Updated weights for policy 0, policy_version 537440 (0.0009) [2023-12-26 03:52:34,828][123090] Updated weights for policy 1, policy_version 533724 (0.0006) [2023-12-26 03:52:34,853][123091] Updated weights for policy 0, policy_version 537450 (0.0011) [2023-12-26 03:52:35,612][123090] Updated weights for policy 1, policy_version 533734 (0.0008) [2023-12-26 03:52:35,677][123090] Updated weights for policy 1, policy_version 533744 (0.0006) [2023-12-26 03:52:35,686][123091] Updated weights for policy 0, policy_version 537460 (0.0011) [2023-12-26 03:52:35,736][123090] Updated weights for policy 1, policy_version 533754 (0.0006) [2023-12-26 03:52:35,745][123091] Updated weights for policy 0, policy_version 537470 (0.0011) [2023-12-26 03:52:35,808][123091] Updated weights for policy 0, policy_version 537480 (0.0011) [2023-12-26 03:52:36,551][123090] Updated weights for policy 1, policy_version 533764 (0.0008) [2023-12-26 03:52:36,613][123090] Updated weights for policy 1, policy_version 533774 (0.0009) [2023-12-26 03:52:36,630][123091] Updated weights for policy 0, policy_version 537490 (0.0011) [2023-12-26 03:52:36,675][123090] Updated weights for policy 1, policy_version 533784 (0.0007) [2023-12-26 03:52:36,693][123091] Updated weights for policy 0, policy_version 537500 (0.0011) [2023-12-26 03:52:36,749][123091] Updated weights for policy 0, policy_version 537510 (0.0011) [2023-12-26 03:52:36,808][123091] Updated weights for policy 0, policy_version 537520 (0.0011) [2023-12-26 03:52:37,521][123090] Updated weights for policy 1, policy_version 533794 (0.0009) [2023-12-26 03:52:37,587][123090] Updated weights for policy 1, policy_version 533804 (0.0010) [2023-12-26 03:52:37,626][123091] Updated weights for policy 0, policy_version 537530 (0.0011) [2023-12-26 03:52:37,634][123090] Updated weights for policy 1, policy_version 533814 (0.0009) [2023-12-26 03:52:37,681][123090] Updated weights for policy 1, policy_version 533824 (0.0005) [2023-12-26 03:52:37,689][123091] Updated weights for policy 0, policy_version 537540 (0.0011) [2023-12-26 03:52:37,740][123091] Updated weights for policy 0, policy_version 537550 (0.0010) [2023-12-26 03:52:38,421][123090] Updated weights for policy 1, policy_version 533834 (0.0008) [2023-12-26 03:52:38,489][123090] Updated weights for policy 1, policy_version 533844 (0.0011) [2023-12-26 03:52:38,558][123090] Updated weights for policy 1, policy_version 533854 (0.0008) [2023-12-26 03:52:38,564][123091] Updated weights for policy 0, policy_version 537560 (0.0011) [2023-12-26 03:52:38,630][123091] Updated weights for policy 0, policy_version 537570 (0.0011) [2023-12-26 03:52:38,696][123091] Updated weights for policy 0, policy_version 537580 (0.0011) [2023-12-26 03:52:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 274292736. Throughput: 0: 9075.8, 1: 8803.4. Samples: 274264772. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:38,784][121949] Avg episode reward: [(0, '6144.859'), (1, '5623.888')] [2023-12-26 03:52:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000537584_137625600.pth... [2023-12-26 03:52:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000533856_136667136.pth... [2023-12-26 03:52:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000536560_137363456.pth [2023-12-26 03:52:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000532832_136404992.pth [2023-12-26 03:52:39,188][123090] Updated weights for policy 1, policy_version 533864 (0.0005) [2023-12-26 03:52:39,256][123090] Updated weights for policy 1, policy_version 533874 (0.0009) [2023-12-26 03:52:39,312][123090] Updated weights for policy 1, policy_version 533884 (0.0010) [2023-12-26 03:52:39,556][123091] Updated weights for policy 0, policy_version 537590 (0.0010) [2023-12-26 03:52:39,619][123091] Updated weights for policy 0, policy_version 537600 (0.0010) [2023-12-26 03:52:39,685][123091] Updated weights for policy 0, policy_version 537610 (0.0009) [2023-12-26 03:52:40,138][123090] Updated weights for policy 1, policy_version 533894 (0.0009) [2023-12-26 03:52:40,201][123090] Updated weights for policy 1, policy_version 533904 (0.0009) [2023-12-26 03:52:40,267][123090] Updated weights for policy 1, policy_version 533914 (0.0009) [2023-12-26 03:52:40,531][123091] Updated weights for policy 0, policy_version 537620 (0.0007) [2023-12-26 03:52:40,583][123091] Updated weights for policy 0, policy_version 537630 (0.0007) [2023-12-26 03:52:40,646][123091] Updated weights for policy 0, policy_version 537640 (0.0011) [2023-12-26 03:52:41,056][123090] Updated weights for policy 1, policy_version 533924 (0.0009) [2023-12-26 03:52:41,121][123090] Updated weights for policy 1, policy_version 533934 (0.0010) [2023-12-26 03:52:41,194][123090] Updated weights for policy 1, policy_version 533944 (0.0010) [2023-12-26 03:52:41,443][123091] Updated weights for policy 0, policy_version 537650 (0.0010) [2023-12-26 03:52:41,515][123091] Updated weights for policy 0, policy_version 537660 (0.0010) [2023-12-26 03:52:41,588][123091] Updated weights for policy 0, policy_version 537670 (0.0010) [2023-12-26 03:52:41,654][123091] Updated weights for policy 0, policy_version 537680 (0.0010) [2023-12-26 03:52:42,113][123090] Updated weights for policy 1, policy_version 533954 (0.0010) [2023-12-26 03:52:42,190][123090] Updated weights for policy 1, policy_version 533964 (0.0010) [2023-12-26 03:52:42,263][123090] Updated weights for policy 1, policy_version 533974 (0.0010) [2023-12-26 03:52:42,332][123091] Updated weights for policy 0, policy_version 537690 (0.0007) [2023-12-26 03:52:42,335][123090] Updated weights for policy 1, policy_version 533984 (0.0009) [2023-12-26 03:52:42,402][123091] Updated weights for policy 0, policy_version 537700 (0.0009) [2023-12-26 03:52:42,470][123091] Updated weights for policy 0, policy_version 537710 (0.0006) [2023-12-26 03:52:43,147][123090] Updated weights for policy 1, policy_version 533994 (0.0010) [2023-12-26 03:52:43,199][123090] Updated weights for policy 1, policy_version 534004 (0.0010) [2023-12-26 03:52:43,265][123090] Updated weights for policy 1, policy_version 534014 (0.0008) [2023-12-26 03:52:43,325][123091] Updated weights for policy 0, policy_version 537720 (0.0009) [2023-12-26 03:52:43,392][123091] Updated weights for policy 0, policy_version 537730 (0.0009) [2023-12-26 03:52:43,456][123091] Updated weights for policy 0, policy_version 537740 (0.0010) [2023-12-26 03:52:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 274374656. Throughput: 0: 8950.6, 1: 8857.7. Samples: 274368676. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:43,785][121949] Avg episode reward: [(0, '6148.936'), (1, '5624.121')] [2023-12-26 03:52:43,966][123090] Updated weights for policy 1, policy_version 534024 (0.0008) [2023-12-26 03:52:44,034][123090] Updated weights for policy 1, policy_version 534034 (0.0008) [2023-12-26 03:52:44,105][123090] Updated weights for policy 1, policy_version 534044 (0.0007) [2023-12-26 03:52:44,317][123091] Updated weights for policy 0, policy_version 537750 (0.0007) [2023-12-26 03:52:44,370][123091] Updated weights for policy 0, policy_version 537760 (0.0005) [2023-12-26 03:52:44,428][123091] Updated weights for policy 0, policy_version 537770 (0.0005) [2023-12-26 03:52:44,859][123090] Updated weights for policy 1, policy_version 534054 (0.0006) [2023-12-26 03:52:44,909][123090] Updated weights for policy 1, policy_version 534064 (0.0005) [2023-12-26 03:52:44,963][123090] Updated weights for policy 1, policy_version 534074 (0.0006) [2023-12-26 03:52:45,152][123091] Updated weights for policy 0, policy_version 537780 (0.0008) [2023-12-26 03:52:45,228][123091] Updated weights for policy 0, policy_version 537790 (0.0011) [2023-12-26 03:52:45,294][123091] Updated weights for policy 0, policy_version 537800 (0.0011) [2023-12-26 03:52:45,719][123090] Updated weights for policy 1, policy_version 534084 (0.0007) [2023-12-26 03:52:45,771][123090] Updated weights for policy 1, policy_version 534094 (0.0008) [2023-12-26 03:52:45,841][123090] Updated weights for policy 1, policy_version 534104 (0.0005) [2023-12-26 03:52:46,111][123091] Updated weights for policy 0, policy_version 537810 (0.0011) [2023-12-26 03:52:46,169][123091] Updated weights for policy 0, policy_version 537820 (0.0010) [2023-12-26 03:52:46,221][123091] Updated weights for policy 0, policy_version 537830 (0.0010) [2023-12-26 03:52:46,486][123090] Updated weights for policy 1, policy_version 534114 (0.0007) [2023-12-26 03:52:46,560][123090] Updated weights for policy 1, policy_version 534124 (0.0005) [2023-12-26 03:52:46,629][123090] Updated weights for policy 1, policy_version 534134 (0.0008) [2023-12-26 03:52:46,690][123090] Updated weights for policy 1, policy_version 534144 (0.0009) [2023-12-26 03:52:47,092][123091] Updated weights for policy 0, policy_version 537841 (0.0010) [2023-12-26 03:52:47,155][123091] Updated weights for policy 0, policy_version 537851 (0.0009) [2023-12-26 03:52:47,212][123091] Updated weights for policy 0, policy_version 537861 (0.0010) [2023-12-26 03:52:47,267][123091] Updated weights for policy 0, policy_version 537871 (0.0009) [2023-12-26 03:52:47,444][123090] Updated weights for policy 1, policy_version 534154 (0.0008) [2023-12-26 03:52:47,511][123090] Updated weights for policy 1, policy_version 534164 (0.0009) [2023-12-26 03:52:47,566][123090] Updated weights for policy 1, policy_version 534175 (0.0010) [2023-12-26 03:52:48,055][123091] Updated weights for policy 0, policy_version 537881 (0.0008) [2023-12-26 03:52:48,109][123091] Updated weights for policy 0, policy_version 537891 (0.0008) [2023-12-26 03:52:48,165][123091] Updated weights for policy 0, policy_version 537901 (0.0008) [2023-12-26 03:52:48,432][123090] Updated weights for policy 1, policy_version 534185 (0.0009) [2023-12-26 03:52:48,497][123090] Updated weights for policy 1, policy_version 534195 (0.0009) [2023-12-26 03:52:48,561][123090] Updated weights for policy 1, policy_version 534205 (0.0007) [2023-12-26 03:52:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 274464768. Throughput: 0: 8847.1, 1: 8872.4. Samples: 274475840. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:48,784][121949] Avg episode reward: [(0, '6139.491'), (1, '5726.975')] [2023-12-26 03:52:48,906][123091] Updated weights for policy 0, policy_version 537911 (0.0008) [2023-12-26 03:52:48,980][123091] Updated weights for policy 0, policy_version 537921 (0.0008) [2023-12-26 03:52:49,033][123091] Updated weights for policy 0, policy_version 537931 (0.0005) [2023-12-26 03:52:49,381][123090] Updated weights for policy 1, policy_version 534215 (0.0007) [2023-12-26 03:52:49,459][123090] Updated weights for policy 1, policy_version 534225 (0.0006) [2023-12-26 03:52:49,521][123090] Updated weights for policy 1, policy_version 534235 (0.0009) [2023-12-26 03:52:49,910][123091] Updated weights for policy 0, policy_version 537941 (0.0007) [2023-12-26 03:52:49,976][123091] Updated weights for policy 0, policy_version 537951 (0.0010) [2023-12-26 03:52:50,036][123091] Updated weights for policy 0, policy_version 537961 (0.0010) [2023-12-26 03:52:50,266][123090] Updated weights for policy 1, policy_version 534245 (0.0005) [2023-12-26 03:52:50,329][123090] Updated weights for policy 1, policy_version 534255 (0.0009) [2023-12-26 03:52:50,397][123090] Updated weights for policy 1, policy_version 534265 (0.0009) [2023-12-26 03:52:50,901][123091] Updated weights for policy 0, policy_version 537971 (0.0010) [2023-12-26 03:52:50,960][123091] Updated weights for policy 0, policy_version 537981 (0.0009) [2023-12-26 03:52:51,024][123091] Updated weights for policy 0, policy_version 537991 (0.0009) [2023-12-26 03:52:51,224][123090] Updated weights for policy 1, policy_version 534275 (0.0009) [2023-12-26 03:52:51,294][123090] Updated weights for policy 1, policy_version 534285 (0.0010) [2023-12-26 03:52:51,367][123090] Updated weights for policy 1, policy_version 534295 (0.0009) [2023-12-26 03:52:51,862][123091] Updated weights for policy 0, policy_version 538001 (0.0010) [2023-12-26 03:52:51,934][123091] Updated weights for policy 0, policy_version 538011 (0.0010) [2023-12-26 03:52:51,994][123091] Updated weights for policy 0, policy_version 538021 (0.0011) [2023-12-26 03:52:52,049][123091] Updated weights for policy 0, policy_version 538031 (0.0011) [2023-12-26 03:52:52,238][123090] Updated weights for policy 1, policy_version 534305 (0.0009) [2023-12-26 03:52:52,307][123090] Updated weights for policy 1, policy_version 534315 (0.0009) [2023-12-26 03:52:52,382][123090] Updated weights for policy 1, policy_version 534325 (0.0009) [2023-12-26 03:52:52,450][123090] Updated weights for policy 1, policy_version 534335 (0.0008) [2023-12-26 03:52:52,867][123091] Updated weights for policy 0, policy_version 538041 (0.0011) [2023-12-26 03:52:52,933][123091] Updated weights for policy 0, policy_version 538051 (0.0009) [2023-12-26 03:52:53,001][123091] Updated weights for policy 0, policy_version 538061 (0.0009) [2023-12-26 03:52:53,281][123090] Updated weights for policy 1, policy_version 534345 (0.0009) [2023-12-26 03:52:53,339][123090] Updated weights for policy 1, policy_version 534355 (0.0009) [2023-12-26 03:52:53,409][123090] Updated weights for policy 1, policy_version 534365 (0.0010) [2023-12-26 03:52:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 274546688. Throughput: 0: 8768.2, 1: 8894.8. Samples: 274526988. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:53,785][121949] Avg episode reward: [(0, '6168.899'), (1, '5873.756')] [2023-12-26 03:52:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000534368_136798208.pth... [2023-12-26 03:52:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000533344_136536064.pth [2023-12-26 03:52:53,797][123091] Updated weights for policy 0, policy_version 538071 (0.0010) [2023-12-26 03:52:53,863][123091] Updated weights for policy 0, policy_version 538081 (0.0007) [2023-12-26 03:52:53,930][123091] Updated weights for policy 0, policy_version 538091 (0.0005) [2023-12-26 03:52:53,956][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000538096_137756672.pth... [2023-12-26 03:52:53,959][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000537040_137486336.pth [2023-12-26 03:52:54,273][123090] Updated weights for policy 1, policy_version 534375 (0.0008) [2023-12-26 03:52:54,345][123090] Updated weights for policy 1, policy_version 534385 (0.0009) [2023-12-26 03:52:54,406][123090] Updated weights for policy 1, policy_version 534395 (0.0009) [2023-12-26 03:52:54,637][123091] Updated weights for policy 0, policy_version 538101 (0.0008) [2023-12-26 03:52:54,696][123091] Updated weights for policy 0, policy_version 538111 (0.0005) [2023-12-26 03:52:54,753][123091] Updated weights for policy 0, policy_version 538121 (0.0005) [2023-12-26 03:52:55,255][123090] Updated weights for policy 1, policy_version 534405 (0.0009) [2023-12-26 03:52:55,309][123090] Updated weights for policy 1, policy_version 534416 (0.0010) [2023-12-26 03:52:55,358][123090] Updated weights for policy 1, policy_version 534426 (0.0009) [2023-12-26 03:52:55,499][123091] Updated weights for policy 0, policy_version 538131 (0.0008) [2023-12-26 03:52:55,551][123091] Updated weights for policy 0, policy_version 538141 (0.0009) [2023-12-26 03:52:55,602][123091] Updated weights for policy 0, policy_version 538151 (0.0006) [2023-12-26 03:52:56,188][123090] Updated weights for policy 1, policy_version 534436 (0.0009) [2023-12-26 03:52:56,250][123090] Updated weights for policy 1, policy_version 534446 (0.0009) [2023-12-26 03:52:56,302][123090] Updated weights for policy 1, policy_version 534456 (0.0009) [2023-12-26 03:52:56,428][123091] Updated weights for policy 0, policy_version 538161 (0.0009) [2023-12-26 03:52:56,488][123091] Updated weights for policy 0, policy_version 538171 (0.0006) [2023-12-26 03:52:56,546][123091] Updated weights for policy 0, policy_version 538181 (0.0006) [2023-12-26 03:52:56,599][123091] Updated weights for policy 0, policy_version 538191 (0.0006) [2023-12-26 03:52:57,207][123090] Updated weights for policy 1, policy_version 534466 (0.0009) [2023-12-26 03:52:57,275][123090] Updated weights for policy 1, policy_version 534476 (0.0009) [2023-12-26 03:52:57,307][123091] Updated weights for policy 0, policy_version 538201 (0.0010) [2023-12-26 03:52:57,330][123090] Updated weights for policy 1, policy_version 534486 (0.0006) [2023-12-26 03:52:57,369][123091] Updated weights for policy 0, policy_version 538211 (0.0010) [2023-12-26 03:52:57,385][123090] Updated weights for policy 1, policy_version 534496 (0.0009) [2023-12-26 03:52:57,420][123091] Updated weights for policy 0, policy_version 538221 (0.0010) [2023-12-26 03:52:58,085][123091] Updated weights for policy 0, policy_version 538231 (0.0008) [2023-12-26 03:52:58,152][123091] Updated weights for policy 0, policy_version 538241 (0.0008) [2023-12-26 03:52:58,224][123091] Updated weights for policy 0, policy_version 538251 (0.0008) [2023-12-26 03:52:58,326][123090] Updated weights for policy 1, policy_version 534506 (0.0008) [2023-12-26 03:52:58,398][123090] Updated weights for policy 1, policy_version 534516 (0.0008) [2023-12-26 03:52:58,468][123090] Updated weights for policy 1, policy_version 534526 (0.0008) [2023-12-26 03:52:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 274636800. Throughput: 0: 8776.5, 1: 8815.8. Samples: 274630708. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:52:58,785][121949] Avg episode reward: [(0, '6189.949'), (1, '5866.171')] [2023-12-26 03:52:59,035][123091] Updated weights for policy 0, policy_version 538261 (0.0009) [2023-12-26 03:52:59,086][123091] Updated weights for policy 0, policy_version 538271 (0.0010) [2023-12-26 03:52:59,129][123091] Updated weights for policy 0, policy_version 538281 (0.0010) [2023-12-26 03:52:59,253][123090] Updated weights for policy 1, policy_version 534536 (0.0009) [2023-12-26 03:52:59,312][123090] Updated weights for policy 1, policy_version 534546 (0.0006) [2023-12-26 03:52:59,380][123090] Updated weights for policy 1, policy_version 534556 (0.0009) [2023-12-26 03:52:59,992][123091] Updated weights for policy 0, policy_version 538291 (0.0010) [2023-12-26 03:53:00,048][123091] Updated weights for policy 0, policy_version 538301 (0.0010) [2023-12-26 03:53:00,114][123091] Updated weights for policy 0, policy_version 538311 (0.0010) [2023-12-26 03:53:00,182][123090] Updated weights for policy 1, policy_version 534566 (0.0007) [2023-12-26 03:53:00,233][123090] Updated weights for policy 1, policy_version 534576 (0.0005) [2023-12-26 03:53:00,299][123090] Updated weights for policy 1, policy_version 534586 (0.0005) [2023-12-26 03:53:00,854][123091] Updated weights for policy 0, policy_version 538321 (0.0010) [2023-12-26 03:53:00,898][123091] Updated weights for policy 0, policy_version 538331 (0.0010) [2023-12-26 03:53:00,948][123091] Updated weights for policy 0, policy_version 538341 (0.0010) [2023-12-26 03:53:01,008][123091] Updated weights for policy 0, policy_version 538351 (0.0011) [2023-12-26 03:53:01,013][123090] Updated weights for policy 1, policy_version 534596 (0.0008) [2023-12-26 03:53:01,072][123090] Updated weights for policy 1, policy_version 534606 (0.0008) [2023-12-26 03:53:01,122][123090] Updated weights for policy 1, policy_version 534616 (0.0005) [2023-12-26 03:53:01,795][123091] Updated weights for policy 0, policy_version 538361 (0.0011) [2023-12-26 03:53:01,869][123091] Updated weights for policy 0, policy_version 538371 (0.0010) [2023-12-26 03:53:01,902][123090] Updated weights for policy 1, policy_version 534626 (0.0009) [2023-12-26 03:53:01,936][123091] Updated weights for policy 0, policy_version 538381 (0.0011) [2023-12-26 03:53:01,964][123090] Updated weights for policy 1, policy_version 534636 (0.0005) [2023-12-26 03:53:02,025][123090] Updated weights for policy 1, policy_version 534646 (0.0006) [2023-12-26 03:53:02,084][123090] Updated weights for policy 1, policy_version 534656 (0.0008) [2023-12-26 03:53:02,642][123091] Updated weights for policy 0, policy_version 538391 (0.0007) [2023-12-26 03:53:02,702][123091] Updated weights for policy 0, policy_version 538401 (0.0006) [2023-12-26 03:53:02,765][123091] Updated weights for policy 0, policy_version 538411 (0.0005) [2023-12-26 03:53:02,814][123090] Updated weights for policy 1, policy_version 534666 (0.0009) [2023-12-26 03:53:02,877][123090] Updated weights for policy 1, policy_version 534676 (0.0009) [2023-12-26 03:53:02,933][123090] Updated weights for policy 1, policy_version 534687 (0.0010) [2023-12-26 03:53:03,560][123091] Updated weights for policy 0, policy_version 538421 (0.0007) [2023-12-26 03:53:03,571][123090] Updated weights for policy 1, policy_version 534697 (0.0006) [2023-12-26 03:53:03,623][123091] Updated weights for policy 0, policy_version 538431 (0.0007) [2023-12-26 03:53:03,633][123090] Updated weights for policy 1, policy_version 534707 (0.0008) [2023-12-26 03:53:03,685][123091] Updated weights for policy 0, policy_version 538441 (0.0007) [2023-12-26 03:53:03,693][123090] Updated weights for policy 1, policy_version 534717 (0.0008) [2023-12-26 03:53:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 274735104. Throughput: 0: 8843.2, 1: 8812.9. Samples: 274740124. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:53:03,785][121949] Avg episode reward: [(0, '6247.966'), (1, '5877.304')] [2023-12-26 03:53:04,505][123091] Updated weights for policy 0, policy_version 538451 (0.0008) [2023-12-26 03:53:04,538][123090] Updated weights for policy 1, policy_version 534727 (0.0008) [2023-12-26 03:53:04,564][123091] Updated weights for policy 0, policy_version 538461 (0.0011) [2023-12-26 03:53:04,605][123090] Updated weights for policy 1, policy_version 534737 (0.0007) [2023-12-26 03:53:04,623][123091] Updated weights for policy 0, policy_version 538471 (0.0011) [2023-12-26 03:53:04,669][123090] Updated weights for policy 1, policy_version 534747 (0.0007) [2023-12-26 03:53:05,452][123091] Updated weights for policy 0, policy_version 538481 (0.0011) [2023-12-26 03:53:05,489][123090] Updated weights for policy 1, policy_version 534757 (0.0008) [2023-12-26 03:53:05,508][123091] Updated weights for policy 0, policy_version 538491 (0.0010) [2023-12-26 03:53:05,537][123090] Updated weights for policy 1, policy_version 534767 (0.0007) [2023-12-26 03:53:05,562][123091] Updated weights for policy 0, policy_version 538501 (0.0010) [2023-12-26 03:53:05,599][123090] Updated weights for policy 1, policy_version 534777 (0.0008) [2023-12-26 03:53:05,617][123091] Updated weights for policy 0, policy_version 538511 (0.0010) [2023-12-26 03:53:06,462][123091] Updated weights for policy 0, policy_version 538521 (0.0011) [2023-12-26 03:53:06,468][123090] Updated weights for policy 1, policy_version 534787 (0.0007) [2023-12-26 03:53:06,522][123091] Updated weights for policy 0, policy_version 538531 (0.0011) [2023-12-26 03:53:06,535][123090] Updated weights for policy 1, policy_version 534797 (0.0008) [2023-12-26 03:53:06,586][123091] Updated weights for policy 0, policy_version 538541 (0.0011) [2023-12-26 03:53:06,598][123090] Updated weights for policy 1, policy_version 534807 (0.0009) [2023-12-26 03:53:07,423][123091] Updated weights for policy 0, policy_version 538551 (0.0011) [2023-12-26 03:53:07,439][123090] Updated weights for policy 1, policy_version 534817 (0.0008) [2023-12-26 03:53:07,482][123091] Updated weights for policy 0, policy_version 538561 (0.0010) [2023-12-26 03:53:07,497][123090] Updated weights for policy 1, policy_version 534827 (0.0007) [2023-12-26 03:53:07,544][123091] Updated weights for policy 0, policy_version 538571 (0.0011) [2023-12-26 03:53:07,566][123090] Updated weights for policy 1, policy_version 534837 (0.0010) [2023-12-26 03:53:07,617][123090] Updated weights for policy 1, policy_version 534847 (0.0009) [2023-12-26 03:53:08,341][123091] Updated weights for policy 0, policy_version 538581 (0.0009) [2023-12-26 03:53:08,411][123091] Updated weights for policy 0, policy_version 538591 (0.0008) [2023-12-26 03:53:08,471][123090] Updated weights for policy 1, policy_version 534857 (0.0009) [2023-12-26 03:53:08,479][123091] Updated weights for policy 0, policy_version 538601 (0.0008) [2023-12-26 03:53:08,540][123090] Updated weights for policy 1, policy_version 534867 (0.0009) [2023-12-26 03:53:08,606][123090] Updated weights for policy 1, policy_version 534877 (0.0011) [2023-12-26 03:53:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 274817024. Throughput: 0: 8854.0, 1: 8814.1. Samples: 274790784. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:53:08,785][121949] Avg episode reward: [(0, '6264.699'), (1, '5879.903')] [2023-12-26 03:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000538608_137887744.pth... [2023-12-26 03:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000534880_136929280.pth... [2023-12-26 03:53:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000533856_136667136.pth [2023-12-26 03:53:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000537584_137625600.pth [2023-12-26 03:53:09,193][123091] Updated weights for policy 0, policy_version 538611 (0.0006) [2023-12-26 03:53:09,267][123091] Updated weights for policy 0, policy_version 538621 (0.0008) [2023-12-26 03:53:09,327][123091] Updated weights for policy 0, policy_version 538631 (0.0008) [2023-12-26 03:53:09,442][123090] Updated weights for policy 1, policy_version 534887 (0.0009) [2023-12-26 03:53:09,505][123090] Updated weights for policy 1, policy_version 534897 (0.0008) [2023-12-26 03:53:09,572][123090] Updated weights for policy 1, policy_version 534907 (0.0008) [2023-12-26 03:53:10,165][123091] Updated weights for policy 0, policy_version 538641 (0.0009) [2023-12-26 03:53:10,231][123091] Updated weights for policy 0, policy_version 538651 (0.0009) [2023-12-26 03:53:10,294][123091] Updated weights for policy 0, policy_version 538661 (0.0010) [2023-12-26 03:53:10,360][123091] Updated weights for policy 0, policy_version 538671 (0.0009) [2023-12-26 03:53:10,378][123090] Updated weights for policy 1, policy_version 534917 (0.0009) [2023-12-26 03:53:10,431][123090] Updated weights for policy 1, policy_version 534927 (0.0009) [2023-12-26 03:53:10,492][123090] Updated weights for policy 1, policy_version 534937 (0.0009) [2023-12-26 03:53:11,202][123091] Updated weights for policy 0, policy_version 538681 (0.0008) [2023-12-26 03:53:11,273][123091] Updated weights for policy 0, policy_version 538691 (0.0010) [2023-12-26 03:53:11,324][123090] Updated weights for policy 1, policy_version 534947 (0.0009) [2023-12-26 03:53:11,340][123091] Updated weights for policy 0, policy_version 538701 (0.0009) [2023-12-26 03:53:11,400][123090] Updated weights for policy 1, policy_version 534957 (0.0008) [2023-12-26 03:53:11,465][123090] Updated weights for policy 1, policy_version 534967 (0.0009) [2023-12-26 03:53:12,153][123091] Updated weights for policy 0, policy_version 538711 (0.0009) [2023-12-26 03:53:12,217][123091] Updated weights for policy 0, policy_version 538721 (0.0009) [2023-12-26 03:53:12,285][123091] Updated weights for policy 0, policy_version 538731 (0.0009) [2023-12-26 03:53:12,370][123090] Updated weights for policy 1, policy_version 534977 (0.0009) [2023-12-26 03:53:12,423][123090] Updated weights for policy 1, policy_version 534987 (0.0009) [2023-12-26 03:53:12,491][123090] Updated weights for policy 1, policy_version 534997 (0.0009) [2023-12-26 03:53:12,562][123090] Updated weights for policy 1, policy_version 535007 (0.0007) [2023-12-26 03:53:13,184][123091] Updated weights for policy 0, policy_version 538741 (0.0009) [2023-12-26 03:53:13,210][123090] Updated weights for policy 1, policy_version 535017 (0.0009) [2023-12-26 03:53:13,246][123091] Updated weights for policy 0, policy_version 538751 (0.0009) [2023-12-26 03:53:13,266][123090] Updated weights for policy 1, policy_version 535027 (0.0010) [2023-12-26 03:53:13,302][123091] Updated weights for policy 0, policy_version 538761 (0.0007) [2023-12-26 03:53:13,326][123090] Updated weights for policy 1, policy_version 535037 (0.0006) [2023-12-26 03:53:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 274898944. Throughput: 0: 8765.9, 1: 8768.3. Samples: 274892040. Policy #0 lag: (min: 20.0, avg: 28.0, max: 52.0) [2023-12-26 03:53:13,784][121949] Avg episode reward: [(0, '6190.021'), (1, '5664.811')] [2023-12-26 03:53:14,102][123090] Updated weights for policy 1, policy_version 535047 (0.0009) [2023-12-26 03:53:14,130][123091] Updated weights for policy 0, policy_version 538771 (0.0008) [2023-12-26 03:53:14,165][123090] Updated weights for policy 1, policy_version 535057 (0.0009) [2023-12-26 03:53:14,192][123091] Updated weights for policy 0, policy_version 538781 (0.0006) [2023-12-26 03:53:14,235][123090] Updated weights for policy 1, policy_version 535067 (0.0007) [2023-12-26 03:53:14,260][123091] Updated weights for policy 0, policy_version 538791 (0.0006) [2023-12-26 03:53:15,022][123090] Updated weights for policy 1, policy_version 535077 (0.0009) [2023-12-26 03:53:15,082][123090] Updated weights for policy 1, policy_version 535087 (0.0010) [2023-12-26 03:53:15,108][123091] Updated weights for policy 0, policy_version 538801 (0.0005) [2023-12-26 03:53:15,141][123090] Updated weights for policy 1, policy_version 535097 (0.0008) [2023-12-26 03:53:15,173][123091] Updated weights for policy 0, policy_version 538811 (0.0010) [2023-12-26 03:53:15,233][123091] Updated weights for policy 0, policy_version 538821 (0.0010) [2023-12-26 03:53:15,299][123091] Updated weights for policy 0, policy_version 538831 (0.0010) [2023-12-26 03:53:15,976][123090] Updated weights for policy 1, policy_version 535107 (0.0008) [2023-12-26 03:53:16,023][123090] Updated weights for policy 1, policy_version 535117 (0.0008) [2023-12-26 03:53:16,073][123090] Updated weights for policy 1, policy_version 535127 (0.0009) [2023-12-26 03:53:16,146][123091] Updated weights for policy 0, policy_version 538841 (0.0008) [2023-12-26 03:53:16,197][123091] Updated weights for policy 0, policy_version 538851 (0.0010) [2023-12-26 03:53:16,253][123091] Updated weights for policy 0, policy_version 538861 (0.0008) [2023-12-26 03:53:16,938][123090] Updated weights for policy 1, policy_version 535137 (0.0009) [2023-12-26 03:53:16,988][123090] Updated weights for policy 1, policy_version 535147 (0.0009) [2023-12-26 03:53:17,040][123090] Updated weights for policy 1, policy_version 535157 (0.0009) [2023-12-26 03:53:17,089][123091] Updated weights for policy 0, policy_version 538872 (0.0010) [2023-12-26 03:53:17,099][123090] Updated weights for policy 1, policy_version 535167 (0.0007) [2023-12-26 03:53:17,140][123091] Updated weights for policy 0, policy_version 538882 (0.0008) [2023-12-26 03:53:17,189][123091] Updated weights for policy 0, policy_version 538892 (0.0009) [2023-12-26 03:53:17,963][123090] Updated weights for policy 1, policy_version 535177 (0.0010) [2023-12-26 03:53:18,026][123091] Updated weights for policy 0, policy_version 538902 (0.0007) [2023-12-26 03:53:18,027][123090] Updated weights for policy 1, policy_version 535187 (0.0008) [2023-12-26 03:53:18,084][123091] Updated weights for policy 0, policy_version 538912 (0.0005) [2023-12-26 03:53:18,102][123090] Updated weights for policy 1, policy_version 535197 (0.0008) [2023-12-26 03:53:18,141][123091] Updated weights for policy 0, policy_version 538922 (0.0005) [2023-12-26 03:53:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 274980864. Throughput: 0: 8696.8, 1: 8698.0. Samples: 274995712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:18,784][121949] Avg episode reward: [(0, '6153.594'), (1, '5734.455')] [2023-12-26 03:53:18,903][123091] Updated weights for policy 0, policy_version 538932 (0.0006) [2023-12-26 03:53:18,931][123090] Updated weights for policy 1, policy_version 535207 (0.0009) [2023-12-26 03:53:18,967][123091] Updated weights for policy 0, policy_version 538942 (0.0008) [2023-12-26 03:53:18,987][123090] Updated weights for policy 1, policy_version 535217 (0.0007) [2023-12-26 03:53:19,025][123091] Updated weights for policy 0, policy_version 538952 (0.0008) [2023-12-26 03:53:19,040][123090] Updated weights for policy 1, policy_version 535227 (0.0009) [2023-12-26 03:53:19,843][123091] Updated weights for policy 0, policy_version 538962 (0.0008) [2023-12-26 03:53:19,908][123091] Updated weights for policy 0, policy_version 538972 (0.0009) [2023-12-26 03:53:19,918][123090] Updated weights for policy 1, policy_version 535237 (0.0009) [2023-12-26 03:53:19,974][123091] Updated weights for policy 0, policy_version 538982 (0.0009) [2023-12-26 03:53:19,987][123090] Updated weights for policy 1, policy_version 535247 (0.0008) [2023-12-26 03:53:20,038][123091] Updated weights for policy 0, policy_version 538992 (0.0009) [2023-12-26 03:53:20,055][123090] Updated weights for policy 1, policy_version 535257 (0.0008) [2023-12-26 03:53:20,832][123091] Updated weights for policy 0, policy_version 539002 (0.0006) [2023-12-26 03:53:20,901][123091] Updated weights for policy 0, policy_version 539012 (0.0008) [2023-12-26 03:53:20,922][123090] Updated weights for policy 1, policy_version 535267 (0.0009) [2023-12-26 03:53:20,965][123091] Updated weights for policy 0, policy_version 539022 (0.0008) [2023-12-26 03:53:20,984][123090] Updated weights for policy 1, policy_version 535277 (0.0008) [2023-12-26 03:53:21,060][123090] Updated weights for policy 1, policy_version 535287 (0.0009) [2023-12-26 03:53:21,727][123091] Updated weights for policy 0, policy_version 539032 (0.0009) [2023-12-26 03:53:21,792][123091] Updated weights for policy 0, policy_version 539042 (0.0010) [2023-12-26 03:53:21,849][123091] Updated weights for policy 0, policy_version 539052 (0.0006) [2023-12-26 03:53:21,886][123090] Updated weights for policy 1, policy_version 535297 (0.0009) [2023-12-26 03:53:21,949][123090] Updated weights for policy 1, policy_version 535307 (0.0009) [2023-12-26 03:53:22,019][123090] Updated weights for policy 1, policy_version 535317 (0.0008) [2023-12-26 03:53:22,092][123090] Updated weights for policy 1, policy_version 535327 (0.0006) [2023-12-26 03:53:22,588][123091] Updated weights for policy 0, policy_version 539062 (0.0009) [2023-12-26 03:53:22,640][123091] Updated weights for policy 0, policy_version 539072 (0.0009) [2023-12-26 03:53:22,699][123091] Updated weights for policy 0, policy_version 539082 (0.0010) [2023-12-26 03:53:22,904][123090] Updated weights for policy 1, policy_version 535337 (0.0009) [2023-12-26 03:53:22,953][123090] Updated weights for policy 1, policy_version 535347 (0.0009) [2023-12-26 03:53:23,010][123090] Updated weights for policy 1, policy_version 535357 (0.0009) [2023-12-26 03:53:23,565][123091] Updated weights for policy 0, policy_version 539092 (0.0009) [2023-12-26 03:53:23,628][123091] Updated weights for policy 0, policy_version 539102 (0.0009) [2023-12-26 03:53:23,678][123091] Updated weights for policy 0, policy_version 539112 (0.0008) [2023-12-26 03:53:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 275070976. Throughput: 0: 8713.0, 1: 8667.3. Samples: 275046884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:23,784][121949] Avg episode reward: [(0, '6103.612'), (1, '5730.154')] [2023-12-26 03:53:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000535360_137052160.pth... [2023-12-26 03:53:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000539120_138018816.pth... [2023-12-26 03:53:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000534368_136798208.pth [2023-12-26 03:53:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000538096_137756672.pth [2023-12-26 03:53:23,870][123090] Updated weights for policy 1, policy_version 535367 (0.0008) [2023-12-26 03:53:23,924][123090] Updated weights for policy 1, policy_version 535377 (0.0009) [2023-12-26 03:53:23,977][123090] Updated weights for policy 1, policy_version 535387 (0.0009) [2023-12-26 03:53:24,508][123091] Updated weights for policy 0, policy_version 539122 (0.0009) [2023-12-26 03:53:24,565][123091] Updated weights for policy 0, policy_version 539132 (0.0011) [2023-12-26 03:53:24,632][123091] Updated weights for policy 0, policy_version 539142 (0.0011) [2023-12-26 03:53:24,688][123091] Updated weights for policy 0, policy_version 539152 (0.0011) [2023-12-26 03:53:24,868][123090] Updated weights for policy 1, policy_version 535397 (0.0009) [2023-12-26 03:53:24,940][123090] Updated weights for policy 1, policy_version 535407 (0.0009) [2023-12-26 03:53:25,005][123090] Updated weights for policy 1, policy_version 535417 (0.0009) [2023-12-26 03:53:25,515][123091] Updated weights for policy 0, policy_version 539162 (0.0005) [2023-12-26 03:53:25,587][123091] Updated weights for policy 0, policy_version 539172 (0.0005) [2023-12-26 03:53:25,648][123091] Updated weights for policy 0, policy_version 539182 (0.0005) [2023-12-26 03:53:25,865][123090] Updated weights for policy 1, policy_version 535427 (0.0009) [2023-12-26 03:53:25,922][123090] Updated weights for policy 1, policy_version 535437 (0.0009) [2023-12-26 03:53:25,978][123090] Updated weights for policy 1, policy_version 535447 (0.0010) [2023-12-26 03:53:26,258][123091] Updated weights for policy 0, policy_version 539192 (0.0005) [2023-12-26 03:53:26,311][123091] Updated weights for policy 0, policy_version 539202 (0.0005) [2023-12-26 03:53:26,369][123091] Updated weights for policy 0, policy_version 539212 (0.0006) [2023-12-26 03:53:26,938][123090] Updated weights for policy 1, policy_version 535457 (0.0009) [2023-12-26 03:53:26,993][123090] Updated weights for policy 1, policy_version 535467 (0.0009) [2023-12-26 03:53:26,997][123091] Updated weights for policy 0, policy_version 539222 (0.0005) [2023-12-26 03:53:27,042][123090] Updated weights for policy 1, policy_version 535477 (0.0008) [2023-12-26 03:53:27,046][123091] Updated weights for policy 0, policy_version 539232 (0.0005) [2023-12-26 03:53:27,094][123091] Updated weights for policy 0, policy_version 539242 (0.0005) [2023-12-26 03:53:27,098][123090] Updated weights for policy 1, policy_version 535487 (0.0008) [2023-12-26 03:53:27,670][123091] Updated weights for policy 0, policy_version 539252 (0.0008) [2023-12-26 03:53:27,735][123091] Updated weights for policy 0, policy_version 539262 (0.0005) [2023-12-26 03:53:27,802][123091] Updated weights for policy 0, policy_version 539272 (0.0005) [2023-12-26 03:53:28,023][123090] Updated weights for policy 1, policy_version 535497 (0.0009) [2023-12-26 03:53:28,080][123090] Updated weights for policy 1, policy_version 535507 (0.0009) [2023-12-26 03:53:28,135][123090] Updated weights for policy 1, policy_version 535517 (0.0010) [2023-12-26 03:53:28,446][123091] Updated weights for policy 0, policy_version 539282 (0.0005) [2023-12-26 03:53:28,521][123091] Updated weights for policy 0, policy_version 539292 (0.0006) [2023-12-26 03:53:28,585][123091] Updated weights for policy 0, policy_version 539302 (0.0008) [2023-12-26 03:53:28,652][123091] Updated weights for policy 0, policy_version 539312 (0.0008) [2023-12-26 03:53:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 275161088. Throughput: 0: 8845.4, 1: 8578.2. Samples: 275152740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:28,785][121949] Avg episode reward: [(0, '6246.406'), (1, '5701.726')] [2023-12-26 03:53:28,968][123090] Updated weights for policy 1, policy_version 535527 (0.0007) [2023-12-26 03:53:29,033][123090] Updated weights for policy 1, policy_version 535537 (0.0010) [2023-12-26 03:53:29,104][123090] Updated weights for policy 1, policy_version 535547 (0.0010) [2023-12-26 03:53:29,305][123091] Updated weights for policy 0, policy_version 539322 (0.0006) [2023-12-26 03:53:29,378][123091] Updated weights for policy 0, policy_version 539332 (0.0007) [2023-12-26 03:53:29,450][123091] Updated weights for policy 0, policy_version 539342 (0.0006) [2023-12-26 03:53:29,961][123090] Updated weights for policy 1, policy_version 535557 (0.0009) [2023-12-26 03:53:30,026][123090] Updated weights for policy 1, policy_version 535567 (0.0011) [2023-12-26 03:53:30,072][123090] Updated weights for policy 1, policy_version 535577 (0.0010) [2023-12-26 03:53:30,198][123091] Updated weights for policy 0, policy_version 539352 (0.0008) [2023-12-26 03:53:30,265][123091] Updated weights for policy 0, policy_version 539362 (0.0006) [2023-12-26 03:53:30,331][123091] Updated weights for policy 0, policy_version 539372 (0.0007) [2023-12-26 03:53:30,782][123090] Updated weights for policy 1, policy_version 535587 (0.0009) [2023-12-26 03:53:30,844][123090] Updated weights for policy 1, policy_version 535597 (0.0005) [2023-12-26 03:53:30,900][123090] Updated weights for policy 1, policy_version 535607 (0.0005) [2023-12-26 03:53:30,999][123091] Updated weights for policy 0, policy_version 539382 (0.0007) [2023-12-26 03:53:31,066][123091] Updated weights for policy 0, policy_version 539392 (0.0007) [2023-12-26 03:53:31,131][123091] Updated weights for policy 0, policy_version 539402 (0.0008) [2023-12-26 03:53:31,582][123090] Updated weights for policy 1, policy_version 535617 (0.0005) [2023-12-26 03:53:31,641][123090] Updated weights for policy 1, policy_version 535627 (0.0007) [2023-12-26 03:53:31,701][123090] Updated weights for policy 1, policy_version 535637 (0.0006) [2023-12-26 03:53:31,766][123090] Updated weights for policy 1, policy_version 535647 (0.0008) [2023-12-26 03:53:31,990][123091] Updated weights for policy 0, policy_version 539412 (0.0009) [2023-12-26 03:53:32,059][123091] Updated weights for policy 0, policy_version 539422 (0.0009) [2023-12-26 03:53:32,119][123091] Updated weights for policy 0, policy_version 539432 (0.0007) [2023-12-26 03:53:32,503][123090] Updated weights for policy 1, policy_version 535657 (0.0010) [2023-12-26 03:53:32,566][123090] Updated weights for policy 1, policy_version 535667 (0.0010) [2023-12-26 03:53:32,628][123090] Updated weights for policy 1, policy_version 535677 (0.0010) [2023-12-26 03:53:32,920][123091] Updated weights for policy 0, policy_version 539442 (0.0009) [2023-12-26 03:53:32,975][123091] Updated weights for policy 0, policy_version 539452 (0.0006) [2023-12-26 03:53:33,020][123091] Updated weights for policy 0, policy_version 539462 (0.0005) [2023-12-26 03:53:33,071][123091] Updated weights for policy 0, policy_version 539472 (0.0005) [2023-12-26 03:53:33,448][123090] Updated weights for policy 1, policy_version 535687 (0.0010) [2023-12-26 03:53:33,499][123090] Updated weights for policy 1, policy_version 535697 (0.0010) [2023-12-26 03:53:33,550][123090] Updated weights for policy 1, policy_version 535707 (0.0010) [2023-12-26 03:53:33,770][123091] Updated weights for policy 0, policy_version 539482 (0.0006) [2023-12-26 03:53:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 275251200. Throughput: 0: 8962.0, 1: 8556.7. Samples: 275264184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:33,785][121949] Avg episode reward: [(0, '6260.649'), (1, '5733.695')] [2023-12-26 03:53:33,815][123091] Updated weights for policy 0, policy_version 539492 (0.0006) [2023-12-26 03:53:33,862][123091] Updated weights for policy 0, policy_version 539502 (0.0008) [2023-12-26 03:53:34,333][123090] Updated weights for policy 1, policy_version 535717 (0.0009) [2023-12-26 03:53:34,393][123090] Updated weights for policy 1, policy_version 535727 (0.0010) [2023-12-26 03:53:34,445][123090] Updated weights for policy 1, policy_version 535737 (0.0010) [2023-12-26 03:53:34,663][123091] Updated weights for policy 0, policy_version 539512 (0.0010) [2023-12-26 03:53:34,731][123091] Updated weights for policy 0, policy_version 539522 (0.0011) [2023-12-26 03:53:34,786][123091] Updated weights for policy 0, policy_version 539532 (0.0010) [2023-12-26 03:53:35,276][123090] Updated weights for policy 1, policy_version 535747 (0.0011) [2023-12-26 03:53:35,340][123090] Updated weights for policy 1, policy_version 535757 (0.0010) [2023-12-26 03:53:35,399][123090] Updated weights for policy 1, policy_version 535767 (0.0007) [2023-12-26 03:53:35,609][123091] Updated weights for policy 0, policy_version 539542 (0.0010) [2023-12-26 03:53:35,663][123091] Updated weights for policy 0, policy_version 539552 (0.0010) [2023-12-26 03:53:35,717][123091] Updated weights for policy 0, policy_version 539562 (0.0010) [2023-12-26 03:53:36,075][123090] Updated weights for policy 1, policy_version 535777 (0.0005) [2023-12-26 03:53:36,144][123090] Updated weights for policy 1, policy_version 535787 (0.0007) [2023-12-26 03:53:36,204][123090] Updated weights for policy 1, policy_version 535797 (0.0008) [2023-12-26 03:53:36,275][123090] Updated weights for policy 1, policy_version 535807 (0.0008) [2023-12-26 03:53:36,539][123091] Updated weights for policy 0, policy_version 539572 (0.0009) [2023-12-26 03:53:36,602][123091] Updated weights for policy 0, policy_version 539582 (0.0009) [2023-12-26 03:53:36,664][123091] Updated weights for policy 0, policy_version 539592 (0.0009) [2023-12-26 03:53:37,098][123090] Updated weights for policy 1, policy_version 535817 (0.0010) [2023-12-26 03:53:37,151][123090] Updated weights for policy 1, policy_version 535827 (0.0011) [2023-12-26 03:53:37,211][123090] Updated weights for policy 1, policy_version 535837 (0.0010) [2023-12-26 03:53:37,561][123091] Updated weights for policy 0, policy_version 539602 (0.0009) [2023-12-26 03:53:37,623][123091] Updated weights for policy 0, policy_version 539612 (0.0009) [2023-12-26 03:53:37,675][123091] Updated weights for policy 0, policy_version 539622 (0.0010) [2023-12-26 03:53:37,732][123091] Updated weights for policy 0, policy_version 539632 (0.0010) [2023-12-26 03:53:38,028][123090] Updated weights for policy 1, policy_version 535847 (0.0006) [2023-12-26 03:53:38,097][123090] Updated weights for policy 1, policy_version 535857 (0.0005) [2023-12-26 03:53:38,162][123090] Updated weights for policy 1, policy_version 535867 (0.0005) [2023-12-26 03:53:38,492][123091] Updated weights for policy 0, policy_version 539642 (0.0006) [2023-12-26 03:53:38,556][123091] Updated weights for policy 0, policy_version 539652 (0.0005) [2023-12-26 03:53:38,627][123091] Updated weights for policy 0, policy_version 539662 (0.0010) [2023-12-26 03:53:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 275341312. Throughput: 0: 8987.1, 1: 8577.1. Samples: 275317376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:38,785][121949] Avg episode reward: [(0, '6257.562'), (1, '5713.300')] [2023-12-26 03:53:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000539664_138158080.pth... [2023-12-26 03:53:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000535872_137183232.pth... [2023-12-26 03:53:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000538608_137887744.pth [2023-12-26 03:53:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000534880_136929280.pth [2023-12-26 03:53:38,891][123090] Updated weights for policy 1, policy_version 535877 (0.0007) [2023-12-26 03:53:38,942][123090] Updated weights for policy 1, policy_version 535887 (0.0005) [2023-12-26 03:53:39,003][123090] Updated weights for policy 1, policy_version 535897 (0.0005) [2023-12-26 03:53:39,436][123091] Updated weights for policy 0, policy_version 539672 (0.0007) [2023-12-26 03:53:39,507][123091] Updated weights for policy 0, policy_version 539682 (0.0013) [2023-12-26 03:53:39,586][123091] Updated weights for policy 0, policy_version 539692 (0.0011) [2023-12-26 03:53:39,868][123090] Updated weights for policy 1, policy_version 535907 (0.0007) [2023-12-26 03:53:39,929][123090] Updated weights for policy 1, policy_version 535917 (0.0010) [2023-12-26 03:53:39,992][123090] Updated weights for policy 1, policy_version 535927 (0.0010) [2023-12-26 03:53:40,255][123091] Updated weights for policy 0, policy_version 539702 (0.0008) [2023-12-26 03:53:40,320][123091] Updated weights for policy 0, policy_version 539712 (0.0007) [2023-12-26 03:53:40,378][123091] Updated weights for policy 0, policy_version 539722 (0.0009) [2023-12-26 03:53:40,959][123091] Updated weights for policy 0, policy_version 539732 (0.0005) [2023-12-26 03:53:40,960][123090] Updated weights for policy 1, policy_version 535937 (0.0010) [2023-12-26 03:53:41,013][123091] Updated weights for policy 0, policy_version 539742 (0.0005) [2023-12-26 03:53:41,055][123090] Updated weights for policy 1, policy_version 535947 (0.0009) [2023-12-26 03:53:41,075][123091] Updated weights for policy 0, policy_version 539752 (0.0007) [2023-12-26 03:53:41,121][123090] Updated weights for policy 1, policy_version 535957 (0.0012) [2023-12-26 03:53:41,197][123090] Updated weights for policy 1, policy_version 535967 (0.0011) [2023-12-26 03:53:41,894][123091] Updated weights for policy 0, policy_version 539762 (0.0007) [2023-12-26 03:53:41,964][123091] Updated weights for policy 0, policy_version 539772 (0.0009) [2023-12-26 03:53:42,010][123090] Updated weights for policy 1, policy_version 535977 (0.0011) [2023-12-26 03:53:42,024][123091] Updated weights for policy 0, policy_version 539782 (0.0011) [2023-12-26 03:53:42,071][123090] Updated weights for policy 1, policy_version 535987 (0.0011) [2023-12-26 03:53:42,089][123091] Updated weights for policy 0, policy_version 539792 (0.0011) [2023-12-26 03:53:42,133][123090] Updated weights for policy 1, policy_version 535997 (0.0011) [2023-12-26 03:53:42,902][123091] Updated weights for policy 0, policy_version 539802 (0.0005) [2023-12-26 03:53:42,937][123090] Updated weights for policy 1, policy_version 536007 (0.0010) [2023-12-26 03:53:42,953][123091] Updated weights for policy 0, policy_version 539812 (0.0005) [2023-12-26 03:53:42,998][123090] Updated weights for policy 1, policy_version 536017 (0.0009) [2023-12-26 03:53:43,004][123091] Updated weights for policy 0, policy_version 539822 (0.0006) [2023-12-26 03:53:43,059][123090] Updated weights for policy 1, policy_version 536027 (0.0010) [2023-12-26 03:53:43,729][123091] Updated weights for policy 0, policy_version 539832 (0.0010) [2023-12-26 03:53:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 275423232. Throughput: 0: 8978.2, 1: 8611.7. Samples: 275422256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:43,785][121949] Avg episode reward: [(0, '6299.373'), (1, '5796.139')] [2023-12-26 03:53:43,793][123090] Updated weights for policy 1, policy_version 536037 (0.0007) [2023-12-26 03:53:43,793][123091] Updated weights for policy 0, policy_version 539842 (0.0011) [2023-12-26 03:53:43,858][123090] Updated weights for policy 1, policy_version 536047 (0.0006) [2023-12-26 03:53:43,860][123091] Updated weights for policy 0, policy_version 539852 (0.0011) [2023-12-26 03:53:43,921][123090] Updated weights for policy 1, policy_version 536057 (0.0007) [2023-12-26 03:53:44,699][123091] Updated weights for policy 0, policy_version 539862 (0.0011) [2023-12-26 03:53:44,719][123090] Updated weights for policy 1, policy_version 536067 (0.0009) [2023-12-26 03:53:44,763][123091] Updated weights for policy 0, policy_version 539872 (0.0011) [2023-12-26 03:53:44,783][123090] Updated weights for policy 1, policy_version 536077 (0.0008) [2023-12-26 03:53:44,831][123091] Updated weights for policy 0, policy_version 539882 (0.0011) [2023-12-26 03:53:44,849][123090] Updated weights for policy 1, policy_version 536087 (0.0006) [2023-12-26 03:53:45,537][123091] Updated weights for policy 0, policy_version 539892 (0.0009) [2023-12-26 03:53:45,603][123091] Updated weights for policy 0, policy_version 539902 (0.0008) [2023-12-26 03:53:45,633][123090] Updated weights for policy 1, policy_version 536097 (0.0008) [2023-12-26 03:53:45,666][123091] Updated weights for policy 0, policy_version 539912 (0.0008) [2023-12-26 03:53:45,697][123090] Updated weights for policy 1, policy_version 536107 (0.0009) [2023-12-26 03:53:45,761][123090] Updated weights for policy 1, policy_version 536117 (0.0010) [2023-12-26 03:53:45,817][123090] Updated weights for policy 1, policy_version 536127 (0.0010) [2023-12-26 03:53:46,396][123091] Updated weights for policy 0, policy_version 539922 (0.0008) [2023-12-26 03:53:46,440][123091] Updated weights for policy 0, policy_version 539932 (0.0005) [2023-12-26 03:53:46,489][123091] Updated weights for policy 0, policy_version 539942 (0.0005) [2023-12-26 03:53:46,559][123091] Updated weights for policy 0, policy_version 539952 (0.0009) [2023-12-26 03:53:46,622][123090] Updated weights for policy 1, policy_version 536137 (0.0006) [2023-12-26 03:53:46,689][123090] Updated weights for policy 1, policy_version 536147 (0.0005) [2023-12-26 03:53:46,757][123090] Updated weights for policy 1, policy_version 536157 (0.0005) [2023-12-26 03:53:47,308][123091] Updated weights for policy 0, policy_version 539962 (0.0006) [2023-12-26 03:53:47,340][123090] Updated weights for policy 1, policy_version 536167 (0.0005) [2023-12-26 03:53:47,370][123091] Updated weights for policy 0, policy_version 539972 (0.0009) [2023-12-26 03:53:47,388][123090] Updated weights for policy 1, policy_version 536177 (0.0005) [2023-12-26 03:53:47,420][123091] Updated weights for policy 0, policy_version 539982 (0.0010) [2023-12-26 03:53:47,441][123090] Updated weights for policy 1, policy_version 536187 (0.0010) [2023-12-26 03:53:48,188][123090] Updated weights for policy 1, policy_version 536197 (0.0008) [2023-12-26 03:53:48,189][123091] Updated weights for policy 0, policy_version 539992 (0.0006) [2023-12-26 03:53:48,247][123090] Updated weights for policy 1, policy_version 536207 (0.0006) [2023-12-26 03:53:48,254][123091] Updated weights for policy 0, policy_version 540002 (0.0005) [2023-12-26 03:53:48,298][123090] Updated weights for policy 1, policy_version 536217 (0.0005) [2023-12-26 03:53:48,319][123091] Updated weights for policy 0, policy_version 540012 (0.0006) [2023-12-26 03:53:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 275521536. Throughput: 0: 9019.1, 1: 8634.2. Samples: 275534524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:48,785][121949] Avg episode reward: [(0, '6222.750'), (1, '5765.557')] [2023-12-26 03:53:49,023][123091] Updated weights for policy 0, policy_version 540022 (0.0007) [2023-12-26 03:53:49,038][123090] Updated weights for policy 1, policy_version 536227 (0.0008) [2023-12-26 03:53:49,107][123090] Updated weights for policy 1, policy_version 536237 (0.0007) [2023-12-26 03:53:49,123][123091] Updated weights for policy 0, policy_version 540032 (0.0006) [2023-12-26 03:53:49,176][123090] Updated weights for policy 1, policy_version 536247 (0.0011) [2023-12-26 03:53:49,189][123091] Updated weights for policy 0, policy_version 540042 (0.0009) [2023-12-26 03:53:49,916][123091] Updated weights for policy 0, policy_version 540052 (0.0008) [2023-12-26 03:53:49,966][123090] Updated weights for policy 1, policy_version 536257 (0.0008) [2023-12-26 03:53:49,982][123091] Updated weights for policy 0, policy_version 540062 (0.0009) [2023-12-26 03:53:50,020][123090] Updated weights for policy 1, policy_version 536267 (0.0010) [2023-12-26 03:53:50,038][123091] Updated weights for policy 0, policy_version 540072 (0.0006) [2023-12-26 03:53:50,075][123090] Updated weights for policy 1, policy_version 536277 (0.0009) [2023-12-26 03:53:50,149][123090] Updated weights for policy 1, policy_version 536287 (0.0010) [2023-12-26 03:53:50,760][123091] Updated weights for policy 0, policy_version 540082 (0.0006) [2023-12-26 03:53:50,830][123091] Updated weights for policy 0, policy_version 540092 (0.0006) [2023-12-26 03:53:50,889][123090] Updated weights for policy 1, policy_version 536297 (0.0006) [2023-12-26 03:53:50,896][123091] Updated weights for policy 0, policy_version 540102 (0.0006) [2023-12-26 03:53:50,956][123090] Updated weights for policy 1, policy_version 536307 (0.0010) [2023-12-26 03:53:50,963][123091] Updated weights for policy 0, policy_version 540112 (0.0011) [2023-12-26 03:53:51,018][123090] Updated weights for policy 1, policy_version 536317 (0.0009) [2023-12-26 03:53:51,734][123091] Updated weights for policy 0, policy_version 540122 (0.0008) [2023-12-26 03:53:51,795][123091] Updated weights for policy 0, policy_version 540132 (0.0008) [2023-12-26 03:53:51,861][123090] Updated weights for policy 1, policy_version 536327 (0.0006) [2023-12-26 03:53:51,867][123091] Updated weights for policy 0, policy_version 540142 (0.0009) [2023-12-26 03:53:51,914][123090] Updated weights for policy 1, policy_version 536337 (0.0005) [2023-12-26 03:53:51,967][123090] Updated weights for policy 1, policy_version 536347 (0.0005) [2023-12-26 03:53:52,681][123091] Updated weights for policy 0, policy_version 540152 (0.0010) [2023-12-26 03:53:52,695][123090] Updated weights for policy 1, policy_version 536357 (0.0007) [2023-12-26 03:53:52,737][123091] Updated weights for policy 0, policy_version 540162 (0.0011) [2023-12-26 03:53:52,752][123090] Updated weights for policy 1, policy_version 536367 (0.0007) [2023-12-26 03:53:52,787][123091] Updated weights for policy 0, policy_version 540172 (0.0009) [2023-12-26 03:53:52,817][123090] Updated weights for policy 1, policy_version 536377 (0.0009) [2023-12-26 03:53:53,532][123091] Updated weights for policy 0, policy_version 540182 (0.0007) [2023-12-26 03:53:53,603][123091] Updated weights for policy 0, policy_version 540192 (0.0005) [2023-12-26 03:53:53,636][123090] Updated weights for policy 1, policy_version 536387 (0.0009) [2023-12-26 03:53:53,665][123091] Updated weights for policy 0, policy_version 540202 (0.0005) [2023-12-26 03:53:53,692][123090] Updated weights for policy 1, policy_version 536397 (0.0005) [2023-12-26 03:53:53,750][123090] Updated weights for policy 1, policy_version 536407 (0.0005) [2023-12-26 03:53:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 275611648. Throughput: 0: 9062.8, 1: 8655.7. Samples: 275588120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:53,785][121949] Avg episode reward: [(0, '6170.904'), (1, '5645.413')] [2023-12-26 03:53:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000540208_138297344.pth... [2023-12-26 03:53:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000539120_138018816.pth [2023-12-26 03:53:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000540208_138297344.pth [2023-12-26 03:53:53,806][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000536416_137322496.pth... [2023-12-26 03:53:53,811][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000535360_137052160.pth [2023-12-26 03:53:53,812][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000536416_137322496.pth [2023-12-26 03:53:54,384][123091] Updated weights for policy 0, policy_version 540212 (0.0007) [2023-12-26 03:53:54,439][123091] Updated weights for policy 0, policy_version 540222 (0.0009) [2023-12-26 03:53:54,489][123091] Updated weights for policy 0, policy_version 540232 (0.0009) [2023-12-26 03:53:54,523][123090] Updated weights for policy 1, policy_version 536417 (0.0008) [2023-12-26 03:53:54,593][123090] Updated weights for policy 1, policy_version 536427 (0.0010) [2023-12-26 03:53:54,656][123090] Updated weights for policy 1, policy_version 536437 (0.0009) [2023-12-26 03:53:54,722][123090] Updated weights for policy 1, policy_version 536447 (0.0009) [2023-12-26 03:53:55,338][123091] Updated weights for policy 0, policy_version 540242 (0.0010) [2023-12-26 03:53:55,399][123091] Updated weights for policy 0, policy_version 540252 (0.0011) [2023-12-26 03:53:55,446][123091] Updated weights for policy 0, policy_version 540262 (0.0010) [2023-12-26 03:53:55,492][123091] Updated weights for policy 0, policy_version 540272 (0.0006) [2023-12-26 03:53:55,558][123090] Updated weights for policy 1, policy_version 536457 (0.0010) [2023-12-26 03:53:55,612][123090] Updated weights for policy 1, policy_version 536467 (0.0010) [2023-12-26 03:53:55,672][123090] Updated weights for policy 1, policy_version 536477 (0.0009) [2023-12-26 03:53:56,214][123091] Updated weights for policy 0, policy_version 540282 (0.0005) [2023-12-26 03:53:56,280][123091] Updated weights for policy 0, policy_version 540292 (0.0005) [2023-12-26 03:53:56,337][123091] Updated weights for policy 0, policy_version 540302 (0.0005) [2023-12-26 03:53:56,392][123090] Updated weights for policy 1, policy_version 536487 (0.0007) [2023-12-26 03:53:56,448][123090] Updated weights for policy 1, policy_version 536497 (0.0005) [2023-12-26 03:53:56,505][123090] Updated weights for policy 1, policy_version 536507 (0.0005) [2023-12-26 03:53:57,074][123091] Updated weights for policy 0, policy_version 540312 (0.0007) [2023-12-26 03:53:57,128][123091] Updated weights for policy 0, policy_version 540322 (0.0010) [2023-12-26 03:53:57,147][123090] Updated weights for policy 1, policy_version 536517 (0.0008) [2023-12-26 03:53:57,182][123091] Updated weights for policy 0, policy_version 540332 (0.0010) [2023-12-26 03:53:57,208][123090] Updated weights for policy 1, policy_version 536527 (0.0010) [2023-12-26 03:53:57,256][123090] Updated weights for policy 1, policy_version 536537 (0.0010) [2023-12-26 03:53:57,873][123091] Updated weights for policy 0, policy_version 540342 (0.0007) [2023-12-26 03:53:57,934][123091] Updated weights for policy 0, policy_version 540352 (0.0005) [2023-12-26 03:53:58,003][123091] Updated weights for policy 0, policy_version 540362 (0.0006) [2023-12-26 03:53:58,011][123090] Updated weights for policy 1, policy_version 536547 (0.0009) [2023-12-26 03:53:58,075][123090] Updated weights for policy 1, policy_version 536557 (0.0008) [2023-12-26 03:53:58,138][123090] Updated weights for policy 1, policy_version 536567 (0.0008) [2023-12-26 03:53:58,725][123091] Updated weights for policy 0, policy_version 540372 (0.0008) [2023-12-26 03:53:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 275701760. Throughput: 0: 9175.3, 1: 8778.4. Samples: 275699956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:53:58,785][121949] Avg episode reward: [(0, '6164.444'), (1, '5498.594')] [2023-12-26 03:53:58,795][123091] Updated weights for policy 0, policy_version 540382 (0.0013) [2023-12-26 03:53:58,865][123091] Updated weights for policy 0, policy_version 540392 (0.0008) [2023-12-26 03:53:59,055][123090] Updated weights for policy 1, policy_version 536577 (0.0008) [2023-12-26 03:53:59,125][123090] Updated weights for policy 1, policy_version 536587 (0.0007) [2023-12-26 03:53:59,189][123090] Updated weights for policy 1, policy_version 536597 (0.0005) [2023-12-26 03:53:59,260][123090] Updated weights for policy 1, policy_version 536607 (0.0007) [2023-12-26 03:53:59,673][123091] Updated weights for policy 0, policy_version 540402 (0.0008) [2023-12-26 03:53:59,740][123091] Updated weights for policy 0, policy_version 540412 (0.0005) [2023-12-26 03:53:59,809][123091] Updated weights for policy 0, policy_version 540422 (0.0007) [2023-12-26 03:53:59,876][123091] Updated weights for policy 0, policy_version 540432 (0.0010) [2023-12-26 03:54:00,016][123090] Updated weights for policy 1, policy_version 536617 (0.0008) [2023-12-26 03:54:00,074][123090] Updated weights for policy 1, policy_version 536627 (0.0009) [2023-12-26 03:54:00,135][123090] Updated weights for policy 1, policy_version 536637 (0.0009) [2023-12-26 03:54:00,632][123091] Updated weights for policy 0, policy_version 540442 (0.0008) [2023-12-26 03:54:00,687][123091] Updated weights for policy 0, policy_version 540452 (0.0006) [2023-12-26 03:54:00,739][123091] Updated weights for policy 0, policy_version 540462 (0.0010) [2023-12-26 03:54:00,940][123090] Updated weights for policy 1, policy_version 536647 (0.0006) [2023-12-26 03:54:00,992][123090] Updated weights for policy 1, policy_version 536657 (0.0005) [2023-12-26 03:54:01,051][123090] Updated weights for policy 1, policy_version 536667 (0.0007) [2023-12-26 03:54:01,504][123091] Updated weights for policy 0, policy_version 540472 (0.0008) [2023-12-26 03:54:01,565][123091] Updated weights for policy 0, policy_version 540482 (0.0008) [2023-12-26 03:54:01,634][123091] Updated weights for policy 0, policy_version 540492 (0.0009) [2023-12-26 03:54:01,845][123090] Updated weights for policy 1, policy_version 536677 (0.0009) [2023-12-26 03:54:01,915][123090] Updated weights for policy 1, policy_version 536687 (0.0008) [2023-12-26 03:54:01,982][123090] Updated weights for policy 1, policy_version 536697 (0.0011) [2023-12-26 03:54:02,389][123091] Updated weights for policy 0, policy_version 540502 (0.0009) [2023-12-26 03:54:02,459][123091] Updated weights for policy 0, policy_version 540512 (0.0007) [2023-12-26 03:54:02,523][123091] Updated weights for policy 0, policy_version 540522 (0.0006) [2023-12-26 03:54:02,785][123090] Updated weights for policy 1, policy_version 536707 (0.0010) [2023-12-26 03:54:02,844][123090] Updated weights for policy 1, policy_version 536717 (0.0010) [2023-12-26 03:54:02,895][123090] Updated weights for policy 1, policy_version 536727 (0.0010) [2023-12-26 03:54:03,259][123091] Updated weights for policy 0, policy_version 540532 (0.0007) [2023-12-26 03:54:03,323][123091] Updated weights for policy 0, policy_version 540542 (0.0005) [2023-12-26 03:54:03,385][123091] Updated weights for policy 0, policy_version 540552 (0.0006) [2023-12-26 03:54:03,716][123090] Updated weights for policy 1, policy_version 536737 (0.0010) [2023-12-26 03:54:03,773][123090] Updated weights for policy 1, policy_version 536747 (0.0006) [2023-12-26 03:54:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 275791872. Throughput: 0: 9252.2, 1: 8773.2. Samples: 275806856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:03,784][121949] Avg episode reward: [(0, '6163.041'), (1, '5579.011')] [2023-12-26 03:54:03,818][123090] Updated weights for policy 1, policy_version 536757 (0.0005) [2023-12-26 03:54:03,868][123090] Updated weights for policy 1, policy_version 536767 (0.0007) [2023-12-26 03:54:04,087][123091] Updated weights for policy 0, policy_version 540562 (0.0009) [2023-12-26 03:54:04,159][123091] Updated weights for policy 0, policy_version 540572 (0.0011) [2023-12-26 03:54:04,231][123091] Updated weights for policy 0, policy_version 540582 (0.0011) [2023-12-26 03:54:04,287][123091] Updated weights for policy 0, policy_version 540592 (0.0011) [2023-12-26 03:54:04,700][123090] Updated weights for policy 1, policy_version 536777 (0.0009) [2023-12-26 03:54:04,757][123090] Updated weights for policy 1, policy_version 536787 (0.0010) [2023-12-26 03:54:04,810][123090] Updated weights for policy 1, policy_version 536797 (0.0009) [2023-12-26 03:54:04,993][123091] Updated weights for policy 0, policy_version 540602 (0.0005) [2023-12-26 03:54:05,043][123091] Updated weights for policy 0, policy_version 540612 (0.0005) [2023-12-26 03:54:05,090][123091] Updated weights for policy 0, policy_version 540622 (0.0005) [2023-12-26 03:54:05,632][123091] Updated weights for policy 0, policy_version 540632 (0.0005) [2023-12-26 03:54:05,679][123091] Updated weights for policy 0, policy_version 540642 (0.0005) [2023-12-26 03:54:05,743][123090] Updated weights for policy 1, policy_version 536807 (0.0009) [2023-12-26 03:54:05,752][123091] Updated weights for policy 0, policy_version 540652 (0.0006) [2023-12-26 03:54:05,791][123090] Updated weights for policy 1, policy_version 536817 (0.0009) [2023-12-26 03:54:05,844][123090] Updated weights for policy 1, policy_version 536827 (0.0009) [2023-12-26 03:54:06,524][123091] Updated weights for policy 0, policy_version 540662 (0.0009) [2023-12-26 03:54:06,580][123091] Updated weights for policy 0, policy_version 540672 (0.0011) [2023-12-26 03:54:06,633][123091] Updated weights for policy 0, policy_version 540682 (0.0010) [2023-12-26 03:54:06,715][123090] Updated weights for policy 1, policy_version 536837 (0.0010) [2023-12-26 03:54:06,774][123090] Updated weights for policy 1, policy_version 536847 (0.0010) [2023-12-26 03:54:06,830][123090] Updated weights for policy 1, policy_version 536857 (0.0010) [2023-12-26 03:54:07,440][123091] Updated weights for policy 0, policy_version 540692 (0.0009) [2023-12-26 03:54:07,488][123091] Updated weights for policy 0, policy_version 540702 (0.0006) [2023-12-26 03:54:07,544][123091] Updated weights for policy 0, policy_version 540712 (0.0007) [2023-12-26 03:54:07,657][123090] Updated weights for policy 1, policy_version 536867 (0.0010) [2023-12-26 03:54:07,709][123090] Updated weights for policy 1, policy_version 536877 (0.0010) [2023-12-26 03:54:07,763][123090] Updated weights for policy 1, policy_version 536887 (0.0005) [2023-12-26 03:54:08,297][123091] Updated weights for policy 0, policy_version 540722 (0.0008) [2023-12-26 03:54:08,376][123091] Updated weights for policy 0, policy_version 540732 (0.0008) [2023-12-26 03:54:08,450][123091] Updated weights for policy 0, policy_version 540742 (0.0010) [2023-12-26 03:54:08,464][123090] Updated weights for policy 1, policy_version 536897 (0.0006) [2023-12-26 03:54:08,514][123091] Updated weights for policy 0, policy_version 540752 (0.0008) [2023-12-26 03:54:08,533][123090] Updated weights for policy 1, policy_version 536907 (0.0011) [2023-12-26 03:54:08,597][123090] Updated weights for policy 1, policy_version 536917 (0.0011) [2023-12-26 03:54:08,670][123090] Updated weights for policy 1, policy_version 536927 (0.0011) [2023-12-26 03:54:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 275890176. Throughput: 0: 9290.7, 1: 8776.4. Samples: 275859908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:08,785][121949] Avg episode reward: [(0, '6223.866'), (1, '5622.382')] [2023-12-26 03:54:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000540752_138436608.pth... [2023-12-26 03:54:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000536928_137453568.pth... [2023-12-26 03:54:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000539664_138158080.pth [2023-12-26 03:54:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000535872_137183232.pth [2023-12-26 03:54:09,311][123091] Updated weights for policy 0, policy_version 540762 (0.0009) [2023-12-26 03:54:09,382][123091] Updated weights for policy 0, policy_version 540772 (0.0009) [2023-12-26 03:54:09,455][123091] Updated weights for policy 0, policy_version 540782 (0.0010) [2023-12-26 03:54:09,494][123090] Updated weights for policy 1, policy_version 536937 (0.0009) [2023-12-26 03:54:09,555][123090] Updated weights for policy 1, policy_version 536947 (0.0010) [2023-12-26 03:54:09,610][123090] Updated weights for policy 1, policy_version 536957 (0.0009) [2023-12-26 03:54:10,273][123091] Updated weights for policy 0, policy_version 540792 (0.0006) [2023-12-26 03:54:10,325][123091] Updated weights for policy 0, policy_version 540802 (0.0005) [2023-12-26 03:54:10,387][123091] Updated weights for policy 0, policy_version 540812 (0.0006) [2023-12-26 03:54:10,475][123090] Updated weights for policy 1, policy_version 536967 (0.0009) [2023-12-26 03:54:10,523][123090] Updated weights for policy 1, policy_version 536977 (0.0009) [2023-12-26 03:54:10,577][123090] Updated weights for policy 1, policy_version 536987 (0.0009) [2023-12-26 03:54:11,194][123091] Updated weights for policy 0, policy_version 540822 (0.0008) [2023-12-26 03:54:11,264][123091] Updated weights for policy 0, policy_version 540832 (0.0010) [2023-12-26 03:54:11,331][123091] Updated weights for policy 0, policy_version 540842 (0.0009) [2023-12-26 03:54:11,334][123090] Updated weights for policy 1, policy_version 536997 (0.0009) [2023-12-26 03:54:11,407][123090] Updated weights for policy 1, policy_version 537007 (0.0010) [2023-12-26 03:54:11,473][123090] Updated weights for policy 1, policy_version 537017 (0.0009) [2023-12-26 03:54:12,202][123091] Updated weights for policy 0, policy_version 540852 (0.0008) [2023-12-26 03:54:12,266][123091] Updated weights for policy 0, policy_version 540862 (0.0008) [2023-12-26 03:54:12,318][123090] Updated weights for policy 1, policy_version 537027 (0.0008) [2023-12-26 03:54:12,334][123091] Updated weights for policy 0, policy_version 540872 (0.0006) [2023-12-26 03:54:12,388][123090] Updated weights for policy 1, policy_version 537037 (0.0009) [2023-12-26 03:54:12,454][123090] Updated weights for policy 1, policy_version 537047 (0.0009) [2023-12-26 03:54:13,065][123091] Updated weights for policy 0, policy_version 540882 (0.0009) [2023-12-26 03:54:13,116][123091] Updated weights for policy 0, policy_version 540892 (0.0011) [2023-12-26 03:54:13,177][123091] Updated weights for policy 0, policy_version 540902 (0.0010) [2023-12-26 03:54:13,231][123091] Updated weights for policy 0, policy_version 540912 (0.0009) [2023-12-26 03:54:13,346][123090] Updated weights for policy 1, policy_version 537057 (0.0009) [2023-12-26 03:54:13,395][123090] Updated weights for policy 1, policy_version 537067 (0.0010) [2023-12-26 03:54:13,441][123090] Updated weights for policy 1, policy_version 537077 (0.0010) [2023-12-26 03:54:13,502][123090] Updated weights for policy 1, policy_version 537087 (0.0008) [2023-12-26 03:54:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 275972096. Throughput: 0: 9194.3, 1: 8838.3. Samples: 275964204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:13,785][121949] Avg episode reward: [(0, '6268.817'), (1, '5551.298')] [2023-12-26 03:54:13,931][123091] Updated weights for policy 0, policy_version 540922 (0.0005) [2023-12-26 03:54:14,002][123091] Updated weights for policy 0, policy_version 540932 (0.0005) [2023-12-26 03:54:14,062][123091] Updated weights for policy 0, policy_version 540942 (0.0005) [2023-12-26 03:54:14,244][123090] Updated weights for policy 1, policy_version 537097 (0.0005) [2023-12-26 03:54:14,293][123090] Updated weights for policy 1, policy_version 537107 (0.0005) [2023-12-26 03:54:14,362][123090] Updated weights for policy 1, policy_version 537117 (0.0005) [2023-12-26 03:54:14,757][123091] Updated weights for policy 0, policy_version 540952 (0.0007) [2023-12-26 03:54:14,835][123091] Updated weights for policy 0, policy_version 540962 (0.0007) [2023-12-26 03:54:14,907][123091] Updated weights for policy 0, policy_version 540972 (0.0006) [2023-12-26 03:54:15,170][123090] Updated weights for policy 1, policy_version 537127 (0.0011) [2023-12-26 03:54:15,219][123090] Updated weights for policy 1, policy_version 537137 (0.0010) [2023-12-26 03:54:15,283][123090] Updated weights for policy 1, policy_version 537147 (0.0011) [2023-12-26 03:54:15,662][123091] Updated weights for policy 0, policy_version 540982 (0.0009) [2023-12-26 03:54:15,723][123091] Updated weights for policy 0, policy_version 540992 (0.0011) [2023-12-26 03:54:15,791][123091] Updated weights for policy 0, policy_version 541002 (0.0011) [2023-12-26 03:54:16,150][123090] Updated weights for policy 1, policy_version 537157 (0.0010) [2023-12-26 03:54:16,213][123090] Updated weights for policy 1, policy_version 537167 (0.0007) [2023-12-26 03:54:16,269][123090] Updated weights for policy 1, policy_version 537177 (0.0006) [2023-12-26 03:54:16,575][123091] Updated weights for policy 0, policy_version 541012 (0.0009) [2023-12-26 03:54:16,652][123091] Updated weights for policy 0, policy_version 541022 (0.0006) [2023-12-26 03:54:16,710][123091] Updated weights for policy 0, policy_version 541032 (0.0011) [2023-12-26 03:54:17,002][123090] Updated weights for policy 1, policy_version 537187 (0.0008) [2023-12-26 03:54:17,062][123090] Updated weights for policy 1, policy_version 537197 (0.0008) [2023-12-26 03:54:17,127][123090] Updated weights for policy 1, policy_version 537207 (0.0006) [2023-12-26 03:54:17,433][123091] Updated weights for policy 0, policy_version 541042 (0.0010) [2023-12-26 03:54:17,481][123091] Updated weights for policy 0, policy_version 541052 (0.0007) [2023-12-26 03:54:17,533][123091] Updated weights for policy 0, policy_version 541062 (0.0005) [2023-12-26 03:54:17,583][123091] Updated weights for policy 0, policy_version 541072 (0.0006) [2023-12-26 03:54:17,870][123090] Updated weights for policy 1, policy_version 537217 (0.0006) [2023-12-26 03:54:17,924][123090] Updated weights for policy 1, policy_version 537227 (0.0010) [2023-12-26 03:54:17,984][123090] Updated weights for policy 1, policy_version 537237 (0.0010) [2023-12-26 03:54:18,039][123090] Updated weights for policy 1, policy_version 537247 (0.0010) [2023-12-26 03:54:18,228][123091] Updated weights for policy 0, policy_version 541082 (0.0005) [2023-12-26 03:54:18,288][123091] Updated weights for policy 0, policy_version 541092 (0.0005) [2023-12-26 03:54:18,351][123091] Updated weights for policy 0, policy_version 541102 (0.0007) [2023-12-26 03:54:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 276062208. Throughput: 0: 9207.7, 1: 8831.7. Samples: 276075960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:18,785][121949] Avg episode reward: [(0, '6243.034'), (1, '5726.480')] [2023-12-26 03:54:18,906][123090] Updated weights for policy 1, policy_version 537257 (0.0005) [2023-12-26 03:54:18,972][123090] Updated weights for policy 1, policy_version 537267 (0.0005) [2023-12-26 03:54:19,033][123090] Updated weights for policy 1, policy_version 537277 (0.0009) [2023-12-26 03:54:19,144][123091] Updated weights for policy 0, policy_version 541112 (0.0010) [2023-12-26 03:54:19,211][123091] Updated weights for policy 0, policy_version 541122 (0.0011) [2023-12-26 03:54:19,283][123091] Updated weights for policy 0, policy_version 541132 (0.0011) [2023-12-26 03:54:19,780][123090] Updated weights for policy 1, policy_version 537287 (0.0009) [2023-12-26 03:54:19,844][123090] Updated weights for policy 1, policy_version 537297 (0.0007) [2023-12-26 03:54:19,908][123090] Updated weights for policy 1, policy_version 537307 (0.0011) [2023-12-26 03:54:20,114][123091] Updated weights for policy 0, policy_version 541142 (0.0011) [2023-12-26 03:54:20,186][123091] Updated weights for policy 0, policy_version 541152 (0.0011) [2023-12-26 03:54:20,259][123091] Updated weights for policy 0, policy_version 541162 (0.0011) [2023-12-26 03:54:20,792][123090] Updated weights for policy 1, policy_version 537317 (0.0010) [2023-12-26 03:54:20,865][123090] Updated weights for policy 1, policy_version 537327 (0.0008) [2023-12-26 03:54:20,934][123090] Updated weights for policy 1, policy_version 537337 (0.0006) [2023-12-26 03:54:20,980][123091] Updated weights for policy 0, policy_version 541172 (0.0011) [2023-12-26 03:54:21,059][123091] Updated weights for policy 0, policy_version 541182 (0.0009) [2023-12-26 03:54:21,131][123091] Updated weights for policy 0, policy_version 541192 (0.0009) [2023-12-26 03:54:21,800][123090] Updated weights for policy 1, policy_version 537347 (0.0007) [2023-12-26 03:54:21,866][123090] Updated weights for policy 1, policy_version 537357 (0.0010) [2023-12-26 03:54:21,900][123091] Updated weights for policy 0, policy_version 541202 (0.0008) [2023-12-26 03:54:21,933][123090] Updated weights for policy 1, policy_version 537367 (0.0007) [2023-12-26 03:54:21,963][123091] Updated weights for policy 0, policy_version 541212 (0.0011) [2023-12-26 03:54:22,031][123091] Updated weights for policy 0, policy_version 541222 (0.0011) [2023-12-26 03:54:22,087][123091] Updated weights for policy 0, policy_version 541232 (0.0011) [2023-12-26 03:54:22,795][123090] Updated weights for policy 1, policy_version 537377 (0.0010) [2023-12-26 03:54:22,852][123090] Updated weights for policy 1, policy_version 537387 (0.0009) [2023-12-26 03:54:22,913][123091] Updated weights for policy 0, policy_version 541242 (0.0011) [2023-12-26 03:54:22,916][123090] Updated weights for policy 1, policy_version 537397 (0.0010) [2023-12-26 03:54:22,977][123091] Updated weights for policy 0, policy_version 541252 (0.0011) [2023-12-26 03:54:22,981][123090] Updated weights for policy 1, policy_version 537407 (0.0007) [2023-12-26 03:54:23,043][123091] Updated weights for policy 0, policy_version 541262 (0.0011) [2023-12-26 03:54:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 276144128. Throughput: 0: 9205.6, 1: 8805.6. Samples: 276127876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:23,784][121949] Avg episode reward: [(0, '6163.692'), (1, '5733.696')] [2023-12-26 03:54:23,809][123091] Updated weights for policy 0, policy_version 541272 (0.0007) [2023-12-26 03:54:23,845][123090] Updated weights for policy 1, policy_version 537417 (0.0007) [2023-12-26 03:54:23,868][123091] Updated weights for policy 0, policy_version 541282 (0.0005) [2023-12-26 03:54:23,914][123090] Updated weights for policy 1, policy_version 537427 (0.0007) [2023-12-26 03:54:23,924][123091] Updated weights for policy 0, policy_version 541292 (0.0006) [2023-12-26 03:54:23,940][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000541296_138575872.pth... [2023-12-26 03:54:23,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000540208_138297344.pth [2023-12-26 03:54:23,968][123090] Updated weights for policy 1, policy_version 537437 (0.0005) [2023-12-26 03:54:23,981][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000537440_137584640.pth... [2023-12-26 03:54:23,984][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000536416_137322496.pth [2023-12-26 03:54:24,655][123091] Updated weights for policy 0, policy_version 541302 (0.0008) [2023-12-26 03:54:24,710][123091] Updated weights for policy 0, policy_version 541312 (0.0010) [2023-12-26 03:54:24,768][123091] Updated weights for policy 0, policy_version 541322 (0.0008) [2023-12-26 03:54:24,780][123090] Updated weights for policy 1, policy_version 537447 (0.0008) [2023-12-26 03:54:24,830][123090] Updated weights for policy 1, policy_version 537457 (0.0008) [2023-12-26 03:54:24,894][123090] Updated weights for policy 1, policy_version 537467 (0.0007) [2023-12-26 03:54:25,568][123091] Updated weights for policy 0, policy_version 541332 (0.0009) [2023-12-26 03:54:25,631][123091] Updated weights for policy 0, policy_version 541342 (0.0010) [2023-12-26 03:54:25,692][123091] Updated weights for policy 0, policy_version 541352 (0.0009) [2023-12-26 03:54:25,693][123090] Updated weights for policy 1, policy_version 537477 (0.0007) [2023-12-26 03:54:25,751][123090] Updated weights for policy 1, policy_version 537487 (0.0009) [2023-12-26 03:54:25,814][123090] Updated weights for policy 1, policy_version 537497 (0.0009) [2023-12-26 03:54:26,508][123091] Updated weights for policy 0, policy_version 541362 (0.0007) [2023-12-26 03:54:26,580][123091] Updated weights for policy 0, policy_version 541372 (0.0006) [2023-12-26 03:54:26,645][123091] Updated weights for policy 0, policy_version 541382 (0.0006) [2023-12-26 03:54:26,656][123090] Updated weights for policy 1, policy_version 537507 (0.0009) [2023-12-26 03:54:26,698][123091] Updated weights for policy 0, policy_version 541392 (0.0007) [2023-12-26 03:54:26,706][123090] Updated weights for policy 1, policy_version 537517 (0.0009) [2023-12-26 03:54:26,762][123090] Updated weights for policy 1, policy_version 537527 (0.0009) [2023-12-26 03:54:27,364][123091] Updated weights for policy 0, policy_version 541402 (0.0005) [2023-12-26 03:54:27,418][123091] Updated weights for policy 0, policy_version 541412 (0.0005) [2023-12-26 03:54:27,468][123091] Updated weights for policy 0, policy_version 541422 (0.0005) [2023-12-26 03:54:27,544][123090] Updated weights for policy 1, policy_version 537537 (0.0008) [2023-12-26 03:54:27,602][123090] Updated weights for policy 1, policy_version 537547 (0.0005) [2023-12-26 03:54:27,654][123090] Updated weights for policy 1, policy_version 537557 (0.0006) [2023-12-26 03:54:27,711][123090] Updated weights for policy 1, policy_version 537567 (0.0005) [2023-12-26 03:54:28,207][123091] Updated weights for policy 0, policy_version 541432 (0.0010) [2023-12-26 03:54:28,251][123091] Updated weights for policy 0, policy_version 541442 (0.0010) [2023-12-26 03:54:28,300][123091] Updated weights for policy 0, policy_version 541452 (0.0010) [2023-12-26 03:54:28,437][123090] Updated weights for policy 1, policy_version 537577 (0.0005) [2023-12-26 03:54:28,496][123090] Updated weights for policy 1, policy_version 537587 (0.0005) [2023-12-26 03:54:28,563][123090] Updated weights for policy 1, policy_version 537597 (0.0006) [2023-12-26 03:54:28,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 276242432. Throughput: 0: 9230.8, 1: 8805.7. Samples: 276233896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:28,784][121949] Avg episode reward: [(0, '6043.364'), (1, '5773.224')] [2023-12-26 03:54:29,134][123091] Updated weights for policy 0, policy_version 541462 (0.0010) [2023-12-26 03:54:29,189][123091] Updated weights for policy 0, policy_version 541472 (0.0006) [2023-12-26 03:54:29,246][123090] Updated weights for policy 1, policy_version 537607 (0.0006) [2023-12-26 03:54:29,262][123091] Updated weights for policy 0, policy_version 541482 (0.0009) [2023-12-26 03:54:29,313][123090] Updated weights for policy 1, policy_version 537617 (0.0006) [2023-12-26 03:54:29,381][123090] Updated weights for policy 1, policy_version 537627 (0.0007) [2023-12-26 03:54:30,038][123091] Updated weights for policy 0, policy_version 541492 (0.0011) [2023-12-26 03:54:30,100][123091] Updated weights for policy 0, policy_version 541502 (0.0010) [2023-12-26 03:54:30,106][123090] Updated weights for policy 1, policy_version 537637 (0.0006) [2023-12-26 03:54:30,158][123090] Updated weights for policy 1, policy_version 537647 (0.0006) [2023-12-26 03:54:30,162][123091] Updated weights for policy 0, policy_version 541512 (0.0011) [2023-12-26 03:54:30,215][123090] Updated weights for policy 1, policy_version 537657 (0.0005) [2023-12-26 03:54:30,825][123091] Updated weights for policy 0, policy_version 541522 (0.0009) [2023-12-26 03:54:30,871][123091] Updated weights for policy 0, policy_version 541532 (0.0005) [2023-12-26 03:54:30,931][123091] Updated weights for policy 0, policy_version 541542 (0.0005) [2023-12-26 03:54:30,982][123091] Updated weights for policy 0, policy_version 541552 (0.0005) [2023-12-26 03:54:31,058][123090] Updated weights for policy 1, policy_version 537667 (0.0007) [2023-12-26 03:54:31,113][123090] Updated weights for policy 1, policy_version 537678 (0.0010) [2023-12-26 03:54:31,178][123090] Updated weights for policy 1, policy_version 537688 (0.0009) [2023-12-26 03:54:31,675][123091] Updated weights for policy 0, policy_version 541563 (0.0008) [2023-12-26 03:54:31,739][123091] Updated weights for policy 0, policy_version 541573 (0.0008) [2023-12-26 03:54:31,802][123091] Updated weights for policy 0, policy_version 541583 (0.0009) [2023-12-26 03:54:32,021][123090] Updated weights for policy 1, policy_version 537698 (0.0009) [2023-12-26 03:54:32,088][123090] Updated weights for policy 1, policy_version 537708 (0.0010) [2023-12-26 03:54:32,151][123090] Updated weights for policy 1, policy_version 537718 (0.0009) [2023-12-26 03:54:32,214][123090] Updated weights for policy 1, policy_version 537728 (0.0005) [2023-12-26 03:54:32,590][123091] Updated weights for policy 0, policy_version 541593 (0.0008) [2023-12-26 03:54:32,655][123091] Updated weights for policy 0, policy_version 541603 (0.0008) [2023-12-26 03:54:32,713][123091] Updated weights for policy 0, policy_version 541613 (0.0008) [2023-12-26 03:54:33,009][123090] Updated weights for policy 1, policy_version 537738 (0.0005) [2023-12-26 03:54:33,072][123090] Updated weights for policy 1, policy_version 537748 (0.0005) [2023-12-26 03:54:33,132][123090] Updated weights for policy 1, policy_version 537758 (0.0006) [2023-12-26 03:54:33,483][123091] Updated weights for policy 0, policy_version 541623 (0.0010) [2023-12-26 03:54:33,535][123091] Updated weights for policy 0, policy_version 541633 (0.0010) [2023-12-26 03:54:33,589][123091] Updated weights for policy 0, policy_version 541643 (0.0005) [2023-12-26 03:54:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 276332544. Throughput: 0: 9209.4, 1: 8780.8. Samples: 276344084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:33,784][121949] Avg episode reward: [(0, '6149.210'), (1, '5931.851')] [2023-12-26 03:54:33,901][123090] Updated weights for policy 1, policy_version 537768 (0.0006) [2023-12-26 03:54:33,953][123090] Updated weights for policy 1, policy_version 537778 (0.0005) [2023-12-26 03:54:34,005][123090] Updated weights for policy 1, policy_version 537788 (0.0006) [2023-12-26 03:54:34,388][123091] Updated weights for policy 0, policy_version 541653 (0.0007) [2023-12-26 03:54:34,457][123091] Updated weights for policy 0, policy_version 541663 (0.0006) [2023-12-26 03:54:34,528][123091] Updated weights for policy 0, policy_version 541673 (0.0006) [2023-12-26 03:54:34,789][123090] Updated weights for policy 1, policy_version 537798 (0.0009) [2023-12-26 03:54:34,856][123090] Updated weights for policy 1, policy_version 537808 (0.0010) [2023-12-26 03:54:34,915][123090] Updated weights for policy 1, policy_version 537818 (0.0010) [2023-12-26 03:54:35,159][123091] Updated weights for policy 0, policy_version 541683 (0.0007) [2023-12-26 03:54:35,218][123091] Updated weights for policy 0, policy_version 541693 (0.0009) [2023-12-26 03:54:35,266][123091] Updated weights for policy 0, policy_version 541703 (0.0005) [2023-12-26 03:54:35,705][123090] Updated weights for policy 1, policy_version 537828 (0.0009) [2023-12-26 03:54:35,771][123090] Updated weights for policy 1, policy_version 537838 (0.0005) [2023-12-26 03:54:35,842][123090] Updated weights for policy 1, policy_version 537848 (0.0005) [2023-12-26 03:54:36,114][123091] Updated weights for policy 0, policy_version 541713 (0.0006) [2023-12-26 03:54:36,183][123091] Updated weights for policy 0, policy_version 541723 (0.0009) [2023-12-26 03:54:36,252][123091] Updated weights for policy 0, policy_version 541733 (0.0009) [2023-12-26 03:54:36,316][123091] Updated weights for policy 0, policy_version 541743 (0.0010) [2023-12-26 03:54:36,474][123090] Updated weights for policy 1, policy_version 537858 (0.0005) [2023-12-26 03:54:36,529][123090] Updated weights for policy 1, policy_version 537868 (0.0005) [2023-12-26 03:54:36,602][123090] Updated weights for policy 1, policy_version 537878 (0.0008) [2023-12-26 03:54:36,672][123090] Updated weights for policy 1, policy_version 537888 (0.0008) [2023-12-26 03:54:37,225][123091] Updated weights for policy 0, policy_version 541753 (0.0010) [2023-12-26 03:54:37,278][123091] Updated weights for policy 0, policy_version 541763 (0.0009) [2023-12-26 03:54:37,328][123091] Updated weights for policy 0, policy_version 541773 (0.0009) [2023-12-26 03:54:37,337][123090] Updated weights for policy 1, policy_version 537898 (0.0006) [2023-12-26 03:54:37,415][123090] Updated weights for policy 1, policy_version 537908 (0.0005) [2023-12-26 03:54:37,487][123090] Updated weights for policy 1, policy_version 537918 (0.0005) [2023-12-26 03:54:38,041][123090] Updated weights for policy 1, policy_version 537928 (0.0005) [2023-12-26 03:54:38,113][123090] Updated weights for policy 1, policy_version 537938 (0.0005) [2023-12-26 03:54:38,179][123090] Updated weights for policy 1, policy_version 537948 (0.0005) [2023-12-26 03:54:38,266][123091] Updated weights for policy 0, policy_version 541783 (0.0009) [2023-12-26 03:54:38,315][123091] Updated weights for policy 0, policy_version 541793 (0.0010) [2023-12-26 03:54:38,387][123091] Updated weights for policy 0, policy_version 541803 (0.0011) [2023-12-26 03:54:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 276422656. Throughput: 0: 9191.6, 1: 8818.8. Samples: 276398592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:38,785][121949] Avg episode reward: [(0, '6170.427'), (1, '5979.145')] [2023-12-26 03:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000541808_138706944.pth... [2023-12-26 03:54:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000537952_137715712.pth... [2023-12-26 03:54:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000540752_138436608.pth [2023-12-26 03:54:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000536928_137453568.pth [2023-12-26 03:54:38,901][123090] Updated weights for policy 1, policy_version 537958 (0.0007) [2023-12-26 03:54:38,962][123090] Updated weights for policy 1, policy_version 537968 (0.0009) [2023-12-26 03:54:39,022][123090] Updated weights for policy 1, policy_version 537978 (0.0009) [2023-12-26 03:54:39,235][123091] Updated weights for policy 0, policy_version 541813 (0.0011) [2023-12-26 03:54:39,307][123091] Updated weights for policy 0, policy_version 541823 (0.0011) [2023-12-26 03:54:39,373][123091] Updated weights for policy 0, policy_version 541833 (0.0012) [2023-12-26 03:54:39,931][123090] Updated weights for policy 1, policy_version 537988 (0.0009) [2023-12-26 03:54:40,003][123090] Updated weights for policy 1, policy_version 537998 (0.0009) [2023-12-26 03:54:40,072][123090] Updated weights for policy 1, policy_version 538008 (0.0009) [2023-12-26 03:54:40,191][123091] Updated weights for policy 0, policy_version 541843 (0.0010) [2023-12-26 03:54:40,256][123091] Updated weights for policy 0, policy_version 541853 (0.0008) [2023-12-26 03:54:40,319][123091] Updated weights for policy 0, policy_version 541863 (0.0008) [2023-12-26 03:54:40,994][123090] Updated weights for policy 1, policy_version 538018 (0.0010) [2023-12-26 03:54:41,053][123091] Updated weights for policy 0, policy_version 541873 (0.0009) [2023-12-26 03:54:41,062][123090] Updated weights for policy 1, policy_version 538028 (0.0008) [2023-12-26 03:54:41,121][123091] Updated weights for policy 0, policy_version 541883 (0.0009) [2023-12-26 03:54:41,127][123090] Updated weights for policy 1, policy_version 538038 (0.0008) [2023-12-26 03:54:41,199][123091] Updated weights for policy 0, policy_version 541893 (0.0007) [2023-12-26 03:54:41,203][123090] Updated weights for policy 1, policy_version 538048 (0.0009) [2023-12-26 03:54:41,266][123091] Updated weights for policy 0, policy_version 541903 (0.0008) [2023-12-26 03:54:42,046][123091] Updated weights for policy 0, policy_version 541913 (0.0006) [2023-12-26 03:54:42,109][123091] Updated weights for policy 0, policy_version 541923 (0.0009) [2023-12-26 03:54:42,141][123090] Updated weights for policy 1, policy_version 538058 (0.0009) [2023-12-26 03:54:42,175][123091] Updated weights for policy 0, policy_version 541933 (0.0008) [2023-12-26 03:54:42,206][123090] Updated weights for policy 1, policy_version 538068 (0.0008) [2023-12-26 03:54:42,273][123090] Updated weights for policy 1, policy_version 538078 (0.0010) [2023-12-26 03:54:42,995][123091] Updated weights for policy 0, policy_version 541943 (0.0006) [2023-12-26 03:54:43,074][123091] Updated weights for policy 0, policy_version 541953 (0.0005) [2023-12-26 03:54:43,081][123090] Updated weights for policy 1, policy_version 538088 (0.0009) [2023-12-26 03:54:43,130][123090] Updated weights for policy 1, policy_version 538098 (0.0009) [2023-12-26 03:54:43,130][123091] Updated weights for policy 0, policy_version 541963 (0.0005) [2023-12-26 03:54:43,198][123090] Updated weights for policy 1, policy_version 538108 (0.0009) [2023-12-26 03:54:43,718][123091] Updated weights for policy 0, policy_version 541973 (0.0005) [2023-12-26 03:54:43,771][123091] Updated weights for policy 0, policy_version 541983 (0.0005) [2023-12-26 03:54:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 276504576. Throughput: 0: 9067.5, 1: 8747.3. Samples: 276501620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 03:54:43,785][121949] Avg episode reward: [(0, '6142.872'), (1, '5891.355')] [2023-12-26 03:54:43,823][123091] Updated weights for policy 0, policy_version 541993 (0.0005) [2023-12-26 03:54:44,165][123090] Updated weights for policy 1, policy_version 538118 (0.0010) [2023-12-26 03:54:44,218][123090] Updated weights for policy 1, policy_version 538128 (0.0009) [2023-12-26 03:54:44,266][123090] Updated weights for policy 1, policy_version 538138 (0.0008) [2023-12-26 03:54:44,535][123091] Updated weights for policy 0, policy_version 542003 (0.0007) [2023-12-26 03:54:44,587][123091] Updated weights for policy 0, policy_version 542013 (0.0010) [2023-12-26 03:54:44,637][123091] Updated weights for policy 0, policy_version 542023 (0.0010) [2023-12-26 03:54:45,140][123090] Updated weights for policy 1, policy_version 538148 (0.0009) [2023-12-26 03:54:45,205][123090] Updated weights for policy 1, policy_version 538158 (0.0009) [2023-12-26 03:54:45,266][123090] Updated weights for policy 1, policy_version 538168 (0.0009) [2023-12-26 03:54:45,479][123091] Updated weights for policy 0, policy_version 542033 (0.0009) [2023-12-26 03:54:45,538][123091] Updated weights for policy 0, policy_version 542043 (0.0011) [2023-12-26 03:54:45,598][123091] Updated weights for policy 0, policy_version 542053 (0.0011) [2023-12-26 03:54:45,654][123091] Updated weights for policy 0, policy_version 542063 (0.0011) [2023-12-26 03:54:46,115][123090] Updated weights for policy 1, policy_version 538178 (0.0009) [2023-12-26 03:54:46,182][123090] Updated weights for policy 1, policy_version 538188 (0.0010) [2023-12-26 03:54:46,235][123090] Updated weights for policy 1, policy_version 538198 (0.0009) [2023-12-26 03:54:46,295][123090] Updated weights for policy 1, policy_version 538208 (0.0010) [2023-12-26 03:54:46,468][123091] Updated weights for policy 0, policy_version 542073 (0.0006) [2023-12-26 03:54:46,528][123091] Updated weights for policy 0, policy_version 542083 (0.0007) [2023-12-26 03:54:46,585][123091] Updated weights for policy 0, policy_version 542093 (0.0009) [2023-12-26 03:54:47,165][123090] Updated weights for policy 1, policy_version 538218 (0.0010) [2023-12-26 03:54:47,226][123090] Updated weights for policy 1, policy_version 538228 (0.0008) [2023-12-26 03:54:47,282][123090] Updated weights for policy 1, policy_version 538238 (0.0009) [2023-12-26 03:54:47,372][123091] Updated weights for policy 0, policy_version 542103 (0.0010) [2023-12-26 03:54:47,438][123091] Updated weights for policy 0, policy_version 542113 (0.0009) [2023-12-26 03:54:47,502][123091] Updated weights for policy 0, policy_version 542123 (0.0008) [2023-12-26 03:54:48,094][123090] Updated weights for policy 1, policy_version 538248 (0.0010) [2023-12-26 03:54:48,144][123090] Updated weights for policy 1, policy_version 538259 (0.0009) [2023-12-26 03:54:48,204][123090] Updated weights for policy 1, policy_version 538270 (0.0010) [2023-12-26 03:54:48,242][123091] Updated weights for policy 0, policy_version 542133 (0.0005) [2023-12-26 03:54:48,306][123091] Updated weights for policy 0, policy_version 542143 (0.0007) [2023-12-26 03:54:48,375][123091] Updated weights for policy 0, policy_version 542153 (0.0009) [2023-12-26 03:54:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 276594688. Throughput: 0: 9082.7, 1: 8687.1. Samples: 276606500. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:54:48,785][121949] Avg episode reward: [(0, '6188.783'), (1, '5771.775')] [2023-12-26 03:54:48,993][123091] Updated weights for policy 0, policy_version 542163 (0.0008) [2023-12-26 03:54:49,056][123091] Updated weights for policy 0, policy_version 542173 (0.0005) [2023-12-26 03:54:49,114][123091] Updated weights for policy 0, policy_version 542183 (0.0005) [2023-12-26 03:54:49,123][123090] Updated weights for policy 1, policy_version 538280 (0.0009) [2023-12-26 03:54:49,183][123090] Updated weights for policy 1, policy_version 538290 (0.0009) [2023-12-26 03:54:49,252][123090] Updated weights for policy 1, policy_version 538300 (0.0009) [2023-12-26 03:54:49,877][123091] Updated weights for policy 0, policy_version 542193 (0.0007) [2023-12-26 03:54:49,952][123091] Updated weights for policy 0, policy_version 542203 (0.0009) [2023-12-26 03:54:50,019][123091] Updated weights for policy 0, policy_version 542213 (0.0009) [2023-12-26 03:54:50,051][123090] Updated weights for policy 1, policy_version 538310 (0.0009) [2023-12-26 03:54:50,081][123091] Updated weights for policy 0, policy_version 542223 (0.0010) [2023-12-26 03:54:50,115][123090] Updated weights for policy 1, policy_version 538320 (0.0008) [2023-12-26 03:54:50,188][123090] Updated weights for policy 1, policy_version 538330 (0.0007) [2023-12-26 03:54:50,844][123091] Updated weights for policy 0, policy_version 542233 (0.0010) [2023-12-26 03:54:50,898][123091] Updated weights for policy 0, policy_version 542243 (0.0010) [2023-12-26 03:54:50,950][123091] Updated weights for policy 0, policy_version 542254 (0.0009) [2023-12-26 03:54:51,004][123090] Updated weights for policy 1, policy_version 538340 (0.0008) [2023-12-26 03:54:51,071][123090] Updated weights for policy 1, policy_version 538350 (0.0012) [2023-12-26 03:54:51,144][123090] Updated weights for policy 1, policy_version 538360 (0.0007) [2023-12-26 03:54:51,857][123091] Updated weights for policy 0, policy_version 542264 (0.0009) [2023-12-26 03:54:51,916][123091] Updated weights for policy 0, policy_version 542274 (0.0009) [2023-12-26 03:54:51,953][123090] Updated weights for policy 1, policy_version 538370 (0.0011) [2023-12-26 03:54:51,968][123091] Updated weights for policy 0, policy_version 542284 (0.0006) [2023-12-26 03:54:52,005][123090] Updated weights for policy 1, policy_version 538380 (0.0010) [2023-12-26 03:54:52,074][123090] Updated weights for policy 1, policy_version 538390 (0.0010) [2023-12-26 03:54:52,131][123090] Updated weights for policy 1, policy_version 538400 (0.0007) [2023-12-26 03:54:52,821][123091] Updated weights for policy 0, policy_version 542294 (0.0008) [2023-12-26 03:54:52,869][123091] Updated weights for policy 0, policy_version 542304 (0.0010) [2023-12-26 03:54:52,917][123090] Updated weights for policy 1, policy_version 538410 (0.0005) [2023-12-26 03:54:52,928][123091] Updated weights for policy 0, policy_version 542314 (0.0011) [2023-12-26 03:54:52,982][123090] Updated weights for policy 1, policy_version 538420 (0.0005) [2023-12-26 03:54:53,049][123090] Updated weights for policy 1, policy_version 538430 (0.0005) [2023-12-26 03:54:53,693][123090] Updated weights for policy 1, policy_version 538440 (0.0005) [2023-12-26 03:54:53,740][123090] Updated weights for policy 1, policy_version 538450 (0.0005) [2023-12-26 03:54:53,766][123091] Updated weights for policy 0, policy_version 542324 (0.0011) [2023-12-26 03:54:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 276676608. Throughput: 0: 9041.3, 1: 8700.5. Samples: 276658292. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:54:53,785][121949] Avg episode reward: [(0, '6171.950'), (1, '5789.074')] [2023-12-26 03:54:53,788][123090] Updated weights for policy 1, policy_version 538460 (0.0005) [2023-12-26 03:54:53,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000538464_137846784.pth... [2023-12-26 03:54:53,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000537440_137584640.pth [2023-12-26 03:54:53,810][123091] Updated weights for policy 0, policy_version 542334 (0.0010) [2023-12-26 03:54:53,858][123091] Updated weights for policy 0, policy_version 542344 (0.0010) [2023-12-26 03:54:53,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000542352_138846208.pth... [2023-12-26 03:54:53,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000541296_138575872.pth [2023-12-26 03:54:54,482][123090] Updated weights for policy 1, policy_version 538470 (0.0008) [2023-12-26 03:54:54,556][123090] Updated weights for policy 1, policy_version 538480 (0.0009) [2023-12-26 03:54:54,610][123091] Updated weights for policy 0, policy_version 542354 (0.0010) [2023-12-26 03:54:54,612][123090] Updated weights for policy 1, policy_version 538490 (0.0009) [2023-12-26 03:54:54,670][123091] Updated weights for policy 0, policy_version 542364 (0.0011) [2023-12-26 03:54:54,733][123091] Updated weights for policy 0, policy_version 542374 (0.0011) [2023-12-26 03:54:54,795][123091] Updated weights for policy 0, policy_version 542384 (0.0011) [2023-12-26 03:54:55,445][123090] Updated weights for policy 1, policy_version 538500 (0.0007) [2023-12-26 03:54:55,505][123090] Updated weights for policy 1, policy_version 538510 (0.0009) [2023-12-26 03:54:55,567][123090] Updated weights for policy 1, policy_version 538520 (0.0009) [2023-12-26 03:54:55,628][123091] Updated weights for policy 0, policy_version 542394 (0.0008) [2023-12-26 03:54:55,695][123091] Updated weights for policy 0, policy_version 542404 (0.0009) [2023-12-26 03:54:55,760][123091] Updated weights for policy 0, policy_version 542414 (0.0010) [2023-12-26 03:54:56,377][123090] Updated weights for policy 1, policy_version 538530 (0.0009) [2023-12-26 03:54:56,435][123090] Updated weights for policy 1, policy_version 538540 (0.0010) [2023-12-26 03:54:56,494][123090] Updated weights for policy 1, policy_version 538550 (0.0010) [2023-12-26 03:54:56,548][123090] Updated weights for policy 1, policy_version 538560 (0.0009) [2023-12-26 03:54:56,550][123091] Updated weights for policy 0, policy_version 542424 (0.0006) [2023-12-26 03:54:56,600][123091] Updated weights for policy 0, policy_version 542434 (0.0007) [2023-12-26 03:54:56,655][123091] Updated weights for policy 0, policy_version 542444 (0.0010) [2023-12-26 03:54:57,420][123090] Updated weights for policy 1, policy_version 538570 (0.0006) [2023-12-26 03:54:57,434][123091] Updated weights for policy 0, policy_version 542454 (0.0009) [2023-12-26 03:54:57,469][123090] Updated weights for policy 1, policy_version 538580 (0.0005) [2023-12-26 03:54:57,484][123091] Updated weights for policy 0, policy_version 542464 (0.0010) [2023-12-26 03:54:57,524][123090] Updated weights for policy 1, policy_version 538590 (0.0005) [2023-12-26 03:54:57,538][123091] Updated weights for policy 0, policy_version 542474 (0.0010) [2023-12-26 03:54:58,299][123090] Updated weights for policy 1, policy_version 538600 (0.0009) [2023-12-26 03:54:58,321][123091] Updated weights for policy 0, policy_version 542484 (0.0009) [2023-12-26 03:54:58,371][123090] Updated weights for policy 1, policy_version 538610 (0.0009) [2023-12-26 03:54:58,395][123091] Updated weights for policy 0, policy_version 542494 (0.0010) [2023-12-26 03:54:58,439][123090] Updated weights for policy 1, policy_version 538620 (0.0009) [2023-12-26 03:54:58,467][123091] Updated weights for policy 0, policy_version 542504 (0.0011) [2023-12-26 03:54:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 276774912. Throughput: 0: 9051.3, 1: 8755.0. Samples: 276765488. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:54:58,785][121949] Avg episode reward: [(0, '6155.000'), (1, '5890.743')] [2023-12-26 03:54:59,278][123090] Updated weights for policy 1, policy_version 538630 (0.0010) [2023-12-26 03:54:59,296][123091] Updated weights for policy 0, policy_version 542514 (0.0010) [2023-12-26 03:54:59,340][123090] Updated weights for policy 1, policy_version 538640 (0.0008) [2023-12-26 03:54:59,358][123091] Updated weights for policy 0, policy_version 542524 (0.0008) [2023-12-26 03:54:59,402][123090] Updated weights for policy 1, policy_version 538650 (0.0011) [2023-12-26 03:54:59,424][123091] Updated weights for policy 0, policy_version 542534 (0.0010) [2023-12-26 03:54:59,477][123091] Updated weights for policy 0, policy_version 542544 (0.0009) [2023-12-26 03:55:00,224][123090] Updated weights for policy 1, policy_version 538660 (0.0010) [2023-12-26 03:55:00,238][123091] Updated weights for policy 0, policy_version 542554 (0.0011) [2023-12-26 03:55:00,288][123090] Updated weights for policy 1, policy_version 538670 (0.0010) [2023-12-26 03:55:00,300][123091] Updated weights for policy 0, policy_version 542564 (0.0011) [2023-12-26 03:55:00,350][123090] Updated weights for policy 1, policy_version 538680 (0.0008) [2023-12-26 03:55:00,360][123091] Updated weights for policy 0, policy_version 542574 (0.0011) [2023-12-26 03:55:01,050][123091] Updated weights for policy 0, policy_version 542584 (0.0008) [2023-12-26 03:55:01,107][123091] Updated weights for policy 0, policy_version 542594 (0.0008) [2023-12-26 03:55:01,165][123091] Updated weights for policy 0, policy_version 542604 (0.0008) [2023-12-26 03:55:01,238][123090] Updated weights for policy 1, policy_version 538690 (0.0008) [2023-12-26 03:55:01,298][123090] Updated weights for policy 1, policy_version 538700 (0.0010) [2023-12-26 03:55:01,359][123090] Updated weights for policy 1, policy_version 538710 (0.0009) [2023-12-26 03:55:01,425][123090] Updated weights for policy 1, policy_version 538720 (0.0009) [2023-12-26 03:55:01,961][123091] Updated weights for policy 0, policy_version 542614 (0.0009) [2023-12-26 03:55:02,009][123091] Updated weights for policy 0, policy_version 542624 (0.0010) [2023-12-26 03:55:02,055][123091] Updated weights for policy 0, policy_version 542634 (0.0010) [2023-12-26 03:55:02,288][123090] Updated weights for policy 1, policy_version 538730 (0.0008) [2023-12-26 03:55:02,362][123090] Updated weights for policy 1, policy_version 538740 (0.0007) [2023-12-26 03:55:02,432][123090] Updated weights for policy 1, policy_version 538750 (0.0009) [2023-12-26 03:55:02,873][123091] Updated weights for policy 0, policy_version 542644 (0.0008) [2023-12-26 03:55:02,925][123091] Updated weights for policy 0, policy_version 542654 (0.0005) [2023-12-26 03:55:02,973][123091] Updated weights for policy 0, policy_version 542664 (0.0009) [2023-12-26 03:55:03,205][123090] Updated weights for policy 1, policy_version 538760 (0.0008) [2023-12-26 03:55:03,255][123090] Updated weights for policy 1, policy_version 538770 (0.0008) [2023-12-26 03:55:03,305][123090] Updated weights for policy 1, policy_version 538780 (0.0008) [2023-12-26 03:55:03,757][123091] Updated weights for policy 0, policy_version 542674 (0.0010) [2023-12-26 03:55:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 276856832. Throughput: 0: 8958.3, 1: 8709.9. Samples: 276871028. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:03,785][121949] Avg episode reward: [(0, '6159.779'), (1, '5925.691')] [2023-12-26 03:55:03,819][123091] Updated weights for policy 0, policy_version 542684 (0.0010) [2023-12-26 03:55:03,884][123091] Updated weights for policy 0, policy_version 542694 (0.0008) [2023-12-26 03:55:03,944][123091] Updated weights for policy 0, policy_version 542704 (0.0011) [2023-12-26 03:55:04,001][123090] Updated weights for policy 1, policy_version 538790 (0.0008) [2023-12-26 03:55:04,062][123090] Updated weights for policy 1, policy_version 538800 (0.0006) [2023-12-26 03:55:04,128][123090] Updated weights for policy 1, policy_version 538810 (0.0008) [2023-12-26 03:55:04,788][123091] Updated weights for policy 0, policy_version 542714 (0.0009) [2023-12-26 03:55:04,837][123091] Updated weights for policy 0, policy_version 542724 (0.0009) [2023-12-26 03:55:04,904][123091] Updated weights for policy 0, policy_version 542734 (0.0009) [2023-12-26 03:55:04,933][123090] Updated weights for policy 1, policy_version 538820 (0.0010) [2023-12-26 03:55:04,995][123090] Updated weights for policy 1, policy_version 538830 (0.0009) [2023-12-26 03:55:05,062][123090] Updated weights for policy 1, policy_version 538840 (0.0009) [2023-12-26 03:55:05,706][123091] Updated weights for policy 0, policy_version 542744 (0.0006) [2023-12-26 03:55:05,762][123091] Updated weights for policy 0, policy_version 542754 (0.0008) [2023-12-26 03:55:05,821][123091] Updated weights for policy 0, policy_version 542764 (0.0010) [2023-12-26 03:55:05,881][123090] Updated weights for policy 1, policy_version 538850 (0.0010) [2023-12-26 03:55:05,943][123090] Updated weights for policy 1, policy_version 538860 (0.0009) [2023-12-26 03:55:06,011][123090] Updated weights for policy 1, policy_version 538870 (0.0009) [2023-12-26 03:55:06,066][123090] Updated weights for policy 1, policy_version 538880 (0.0009) [2023-12-26 03:55:06,628][123091] Updated weights for policy 0, policy_version 542774 (0.0008) [2023-12-26 03:55:06,686][123091] Updated weights for policy 0, policy_version 542784 (0.0010) [2023-12-26 03:55:06,756][123091] Updated weights for policy 0, policy_version 542794 (0.0009) [2023-12-26 03:55:06,902][123090] Updated weights for policy 1, policy_version 538890 (0.0010) [2023-12-26 03:55:06,969][123090] Updated weights for policy 1, policy_version 538900 (0.0009) [2023-12-26 03:55:07,035][123090] Updated weights for policy 1, policy_version 538910 (0.0009) [2023-12-26 03:55:07,612][123091] Updated weights for policy 0, policy_version 542804 (0.0009) [2023-12-26 03:55:07,660][123091] Updated weights for policy 0, policy_version 542814 (0.0009) [2023-12-26 03:55:07,715][123091] Updated weights for policy 0, policy_version 542824 (0.0010) [2023-12-26 03:55:07,774][123090] Updated weights for policy 1, policy_version 538920 (0.0008) [2023-12-26 03:55:07,836][123090] Updated weights for policy 1, policy_version 538930 (0.0009) [2023-12-26 03:55:07,889][123090] Updated weights for policy 1, policy_version 538940 (0.0010) [2023-12-26 03:55:08,469][123091] Updated weights for policy 0, policy_version 542834 (0.0009) [2023-12-26 03:55:08,520][123091] Updated weights for policy 0, policy_version 542844 (0.0010) [2023-12-26 03:55:08,575][123091] Updated weights for policy 0, policy_version 542854 (0.0010) [2023-12-26 03:55:08,638][123091] Updated weights for policy 0, policy_version 542864 (0.0009) [2023-12-26 03:55:08,777][123090] Updated weights for policy 1, policy_version 538951 (0.0009) [2023-12-26 03:55:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 276946944. Throughput: 0: 8970.0, 1: 8707.5. Samples: 276923364. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:08,785][121949] Avg episode reward: [(0, '6050.853'), (1, '5892.268')] [2023-12-26 03:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000542864_138977280.pth... [2023-12-26 03:55:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000541808_138706944.pth [2023-12-26 03:55:08,849][123090] Updated weights for policy 1, policy_version 538961 (0.0009) [2023-12-26 03:55:08,914][123090] Updated weights for policy 1, policy_version 538971 (0.0009) [2023-12-26 03:55:08,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000538976_137977856.pth... [2023-12-26 03:55:08,940][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000537952_137715712.pth [2023-12-26 03:55:09,489][123091] Updated weights for policy 0, policy_version 542874 (0.0009) [2023-12-26 03:55:09,547][123091] Updated weights for policy 0, policy_version 542884 (0.0009) [2023-12-26 03:55:09,599][123091] Updated weights for policy 0, policy_version 542894 (0.0008) [2023-12-26 03:55:09,780][123090] Updated weights for policy 1, policy_version 538981 (0.0010) [2023-12-26 03:55:09,853][123090] Updated weights for policy 1, policy_version 538991 (0.0008) [2023-12-26 03:55:09,924][123090] Updated weights for policy 1, policy_version 539001 (0.0008) [2023-12-26 03:55:10,436][123091] Updated weights for policy 0, policy_version 542904 (0.0007) [2023-12-26 03:55:10,507][123091] Updated weights for policy 0, policy_version 542914 (0.0007) [2023-12-26 03:55:10,580][123091] Updated weights for policy 0, policy_version 542924 (0.0006) [2023-12-26 03:55:10,757][123090] Updated weights for policy 1, policy_version 539011 (0.0008) [2023-12-26 03:55:10,823][123090] Updated weights for policy 1, policy_version 539021 (0.0009) [2023-12-26 03:55:10,897][123090] Updated weights for policy 1, policy_version 539031 (0.0006) [2023-12-26 03:55:11,378][123091] Updated weights for policy 0, policy_version 542934 (0.0007) [2023-12-26 03:55:11,450][123091] Updated weights for policy 0, policy_version 542944 (0.0008) [2023-12-26 03:55:11,520][123091] Updated weights for policy 0, policy_version 542954 (0.0009) [2023-12-26 03:55:11,796][123090] Updated weights for policy 1, policy_version 539041 (0.0007) [2023-12-26 03:55:11,859][123090] Updated weights for policy 1, policy_version 539051 (0.0006) [2023-12-26 03:55:11,933][123090] Updated weights for policy 1, policy_version 539061 (0.0009) [2023-12-26 03:55:12,002][123090] Updated weights for policy 1, policy_version 539071 (0.0011) [2023-12-26 03:55:12,421][123091] Updated weights for policy 0, policy_version 542964 (0.0010) [2023-12-26 03:55:12,487][123091] Updated weights for policy 0, policy_version 542974 (0.0010) [2023-12-26 03:55:12,541][123091] Updated weights for policy 0, policy_version 542984 (0.0010) [2023-12-26 03:55:12,675][123090] Updated weights for policy 1, policy_version 539081 (0.0006) [2023-12-26 03:55:12,726][123090] Updated weights for policy 1, policy_version 539091 (0.0008) [2023-12-26 03:55:12,777][123090] Updated weights for policy 1, policy_version 539101 (0.0009) [2023-12-26 03:55:13,407][123091] Updated weights for policy 0, policy_version 542994 (0.0009) [2023-12-26 03:55:13,458][123091] Updated weights for policy 0, policy_version 543004 (0.0009) [2023-12-26 03:55:13,513][123091] Updated weights for policy 0, policy_version 543014 (0.0010) [2023-12-26 03:55:13,564][123091] Updated weights for policy 0, policy_version 543024 (0.0009) [2023-12-26 03:55:13,654][123090] Updated weights for policy 1, policy_version 539111 (0.0010) [2023-12-26 03:55:13,706][123090] Updated weights for policy 1, policy_version 539121 (0.0010) [2023-12-26 03:55:13,756][123090] Updated weights for policy 1, policy_version 539131 (0.0009) [2023-12-26 03:55:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 277037056. Throughput: 0: 8872.2, 1: 8717.5. Samples: 277025436. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:13,785][121949] Avg episode reward: [(0, '6037.947'), (1, '5725.332')] [2023-12-26 03:55:14,449][123091] Updated weights for policy 0, policy_version 543034 (0.0009) [2023-12-26 03:55:14,507][123091] Updated weights for policy 0, policy_version 543044 (0.0009) [2023-12-26 03:55:14,556][123090] Updated weights for policy 1, policy_version 539141 (0.0010) [2023-12-26 03:55:14,562][123091] Updated weights for policy 0, policy_version 543054 (0.0008) [2023-12-26 03:55:14,623][123090] Updated weights for policy 1, policy_version 539151 (0.0010) [2023-12-26 03:55:14,681][123090] Updated weights for policy 1, policy_version 539161 (0.0010) [2023-12-26 03:55:15,347][123091] Updated weights for policy 0, policy_version 543064 (0.0008) [2023-12-26 03:55:15,410][123091] Updated weights for policy 0, policy_version 543074 (0.0009) [2023-12-26 03:55:15,466][123091] Updated weights for policy 0, policy_version 543084 (0.0010) [2023-12-26 03:55:15,492][123090] Updated weights for policy 1, policy_version 539171 (0.0010) [2023-12-26 03:55:15,556][123090] Updated weights for policy 1, policy_version 539181 (0.0011) [2023-12-26 03:55:15,620][123090] Updated weights for policy 1, policy_version 539191 (0.0010) [2023-12-26 03:55:16,325][123091] Updated weights for policy 0, policy_version 543094 (0.0009) [2023-12-26 03:55:16,377][123091] Updated weights for policy 0, policy_version 543104 (0.0008) [2023-12-26 03:55:16,437][123090] Updated weights for policy 1, policy_version 539201 (0.0010) [2023-12-26 03:55:16,444][123091] Updated weights for policy 0, policy_version 543114 (0.0009) [2023-12-26 03:55:16,492][123090] Updated weights for policy 1, policy_version 539211 (0.0010) [2023-12-26 03:55:16,550][123090] Updated weights for policy 1, policy_version 539221 (0.0006) [2023-12-26 03:55:16,616][123090] Updated weights for policy 1, policy_version 539231 (0.0005) [2023-12-26 03:55:17,296][123091] Updated weights for policy 0, policy_version 543124 (0.0010) [2023-12-26 03:55:17,319][123090] Updated weights for policy 1, policy_version 539241 (0.0009) [2023-12-26 03:55:17,357][123091] Updated weights for policy 0, policy_version 543134 (0.0008) [2023-12-26 03:55:17,377][123090] Updated weights for policy 1, policy_version 539251 (0.0008) [2023-12-26 03:55:17,412][123091] Updated weights for policy 0, policy_version 543144 (0.0009) [2023-12-26 03:55:17,441][123090] Updated weights for policy 1, policy_version 539261 (0.0008) [2023-12-26 03:55:18,082][123091] Updated weights for policy 0, policy_version 543154 (0.0006) [2023-12-26 03:55:18,133][123091] Updated weights for policy 0, policy_version 543164 (0.0006) [2023-12-26 03:55:18,195][123091] Updated weights for policy 0, policy_version 543174 (0.0005) [2023-12-26 03:55:18,263][123091] Updated weights for policy 0, policy_version 543184 (0.0005) [2023-12-26 03:55:18,363][123090] Updated weights for policy 1, policy_version 539271 (0.0010) [2023-12-26 03:55:18,430][123090] Updated weights for policy 1, policy_version 539281 (0.0010) [2023-12-26 03:55:18,505][123090] Updated weights for policy 1, policy_version 539291 (0.0010) [2023-12-26 03:55:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17855.8). Total num frames: 277118976. Throughput: 0: 8817.4, 1: 8650.9. Samples: 277130160. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:18,784][121949] Avg episode reward: [(0, '5995.649'), (1, '5778.713')] [2023-12-26 03:55:18,903][123091] Updated weights for policy 0, policy_version 543194 (0.0009) [2023-12-26 03:55:18,966][123091] Updated weights for policy 0, policy_version 543204 (0.0011) [2023-12-26 03:55:19,036][123091] Updated weights for policy 0, policy_version 543214 (0.0011) [2023-12-26 03:55:19,314][123090] Updated weights for policy 1, policy_version 539301 (0.0009) [2023-12-26 03:55:19,388][123090] Updated weights for policy 1, policy_version 539311 (0.0008) [2023-12-26 03:55:19,459][123090] Updated weights for policy 1, policy_version 539321 (0.0008) [2023-12-26 03:55:19,863][123091] Updated weights for policy 0, policy_version 543224 (0.0009) [2023-12-26 03:55:19,927][123091] Updated weights for policy 0, policy_version 543234 (0.0009) [2023-12-26 03:55:19,995][123091] Updated weights for policy 0, policy_version 543244 (0.0010) [2023-12-26 03:55:20,267][123090] Updated weights for policy 1, policy_version 539331 (0.0007) [2023-12-26 03:55:20,340][123090] Updated weights for policy 1, policy_version 539341 (0.0007) [2023-12-26 03:55:20,399][123090] Updated weights for policy 1, policy_version 539351 (0.0009) [2023-12-26 03:55:20,825][123091] Updated weights for policy 0, policy_version 543254 (0.0010) [2023-12-26 03:55:20,886][123091] Updated weights for policy 0, policy_version 543264 (0.0010) [2023-12-26 03:55:20,940][123091] Updated weights for policy 0, policy_version 543274 (0.0010) [2023-12-26 03:55:21,168][123090] Updated weights for policy 1, policy_version 539361 (0.0007) [2023-12-26 03:55:21,227][123090] Updated weights for policy 1, policy_version 539371 (0.0009) [2023-12-26 03:55:21,296][123090] Updated weights for policy 1, policy_version 539381 (0.0010) [2023-12-26 03:55:21,375][123090] Updated weights for policy 1, policy_version 539391 (0.0009) [2023-12-26 03:55:21,833][123091] Updated weights for policy 0, policy_version 543284 (0.0010) [2023-12-26 03:55:21,892][123091] Updated weights for policy 0, policy_version 543294 (0.0010) [2023-12-26 03:55:21,956][123091] Updated weights for policy 0, policy_version 543304 (0.0010) [2023-12-26 03:55:22,211][123090] Updated weights for policy 1, policy_version 539401 (0.0010) [2023-12-26 03:55:22,282][123090] Updated weights for policy 1, policy_version 539411 (0.0010) [2023-12-26 03:55:22,354][123090] Updated weights for policy 1, policy_version 539421 (0.0009) [2023-12-26 03:55:22,827][123091] Updated weights for policy 0, policy_version 543314 (0.0010) [2023-12-26 03:55:22,883][123091] Updated weights for policy 0, policy_version 543324 (0.0009) [2023-12-26 03:55:22,936][123091] Updated weights for policy 0, policy_version 543334 (0.0009) [2023-12-26 03:55:22,994][123091] Updated weights for policy 0, policy_version 543344 (0.0009) [2023-12-26 03:55:23,212][123090] Updated weights for policy 1, policy_version 539431 (0.0009) [2023-12-26 03:55:23,266][123090] Updated weights for policy 1, policy_version 539441 (0.0009) [2023-12-26 03:55:23,318][123090] Updated weights for policy 1, policy_version 539451 (0.0009) [2023-12-26 03:55:23,775][123091] Updated weights for policy 0, policy_version 543354 (0.0010) [2023-12-26 03:55:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 277200896. Throughput: 0: 8791.6, 1: 8615.6. Samples: 277181920. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:23,785][121949] Avg episode reward: [(0, '5919.335'), (1, '5863.994')] [2023-12-26 03:55:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000539456_138100736.pth... [2023-12-26 03:55:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000538464_137846784.pth [2023-12-26 03:55:23,830][123091] Updated weights for policy 0, policy_version 543364 (0.0010) [2023-12-26 03:55:23,888][123091] Updated weights for policy 0, policy_version 543374 (0.0010) [2023-12-26 03:55:23,897][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000543376_139108352.pth... [2023-12-26 03:55:23,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000542352_138846208.pth [2023-12-26 03:55:24,196][123090] Updated weights for policy 1, policy_version 539461 (0.0009) [2023-12-26 03:55:24,269][123090] Updated weights for policy 1, policy_version 539471 (0.0005) [2023-12-26 03:55:24,348][123090] Updated weights for policy 1, policy_version 539481 (0.0005) [2023-12-26 03:55:24,720][123091] Updated weights for policy 0, policy_version 543384 (0.0009) [2023-12-26 03:55:24,785][123091] Updated weights for policy 0, policy_version 543394 (0.0010) [2023-12-26 03:55:24,860][123091] Updated weights for policy 0, policy_version 543404 (0.0011) [2023-12-26 03:55:24,967][123090] Updated weights for policy 1, policy_version 539491 (0.0006) [2023-12-26 03:55:25,016][123090] Updated weights for policy 1, policy_version 539501 (0.0009) [2023-12-26 03:55:25,065][123090] Updated weights for policy 1, policy_version 539511 (0.0009) [2023-12-26 03:55:25,679][123091] Updated weights for policy 0, policy_version 543414 (0.0011) [2023-12-26 03:55:25,749][123091] Updated weights for policy 0, policy_version 543424 (0.0011) [2023-12-26 03:55:25,819][123091] Updated weights for policy 0, policy_version 543434 (0.0009) [2023-12-26 03:55:25,893][123090] Updated weights for policy 1, policy_version 539521 (0.0008) [2023-12-26 03:55:25,969][123090] Updated weights for policy 1, policy_version 539531 (0.0005) [2023-12-26 03:55:26,042][123090] Updated weights for policy 1, policy_version 539541 (0.0007) [2023-12-26 03:55:26,101][123090] Updated weights for policy 1, policy_version 539551 (0.0009) [2023-12-26 03:55:26,589][123091] Updated weights for policy 0, policy_version 543444 (0.0008) [2023-12-26 03:55:26,649][123091] Updated weights for policy 0, policy_version 543454 (0.0011) [2023-12-26 03:55:26,702][123091] Updated weights for policy 0, policy_version 543464 (0.0011) [2023-12-26 03:55:26,823][123090] Updated weights for policy 1, policy_version 539561 (0.0009) [2023-12-26 03:55:26,878][123090] Updated weights for policy 1, policy_version 539571 (0.0008) [2023-12-26 03:55:26,942][123090] Updated weights for policy 1, policy_version 539581 (0.0009) [2023-12-26 03:55:27,460][123091] Updated weights for policy 0, policy_version 543474 (0.0010) [2023-12-26 03:55:27,510][123091] Updated weights for policy 0, policy_version 543484 (0.0010) [2023-12-26 03:55:27,568][123091] Updated weights for policy 0, policy_version 543494 (0.0009) [2023-12-26 03:55:27,619][123091] Updated weights for policy 0, policy_version 543504 (0.0005) [2023-12-26 03:55:27,765][123090] Updated weights for policy 1, policy_version 539591 (0.0006) [2023-12-26 03:55:27,824][123090] Updated weights for policy 1, policy_version 539601 (0.0005) [2023-12-26 03:55:27,876][123090] Updated weights for policy 1, policy_version 539611 (0.0005) [2023-12-26 03:55:28,313][123091] Updated weights for policy 0, policy_version 543514 (0.0005) [2023-12-26 03:55:28,378][123091] Updated weights for policy 0, policy_version 543524 (0.0008) [2023-12-26 03:55:28,447][123091] Updated weights for policy 0, policy_version 543534 (0.0005) [2023-12-26 03:55:28,527][123090] Updated weights for policy 1, policy_version 539621 (0.0005) [2023-12-26 03:55:28,592][123090] Updated weights for policy 1, policy_version 539631 (0.0005) [2023-12-26 03:55:28,662][123090] Updated weights for policy 1, policy_version 539641 (0.0009) [2023-12-26 03:55:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 277299200. Throughput: 0: 8823.6, 1: 8626.9. Samples: 277286888. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:28,785][121949] Avg episode reward: [(0, '6134.669'), (1, '5835.277')] [2023-12-26 03:55:29,151][123091] Updated weights for policy 0, policy_version 543544 (0.0008) [2023-12-26 03:55:29,220][123091] Updated weights for policy 0, policy_version 543554 (0.0006) [2023-12-26 03:55:29,285][123091] Updated weights for policy 0, policy_version 543564 (0.0007) [2023-12-26 03:55:29,497][123090] Updated weights for policy 1, policy_version 539651 (0.0010) [2023-12-26 03:55:29,572][123090] Updated weights for policy 1, policy_version 539661 (0.0010) [2023-12-26 03:55:29,638][123090] Updated weights for policy 1, policy_version 539671 (0.0009) [2023-12-26 03:55:29,997][123091] Updated weights for policy 0, policy_version 543574 (0.0007) [2023-12-26 03:55:30,051][123091] Updated weights for policy 0, policy_version 543584 (0.0009) [2023-12-26 03:55:30,101][123091] Updated weights for policy 0, policy_version 543594 (0.0009) [2023-12-26 03:55:30,488][123090] Updated weights for policy 1, policy_version 539681 (0.0010) [2023-12-26 03:55:30,539][123090] Updated weights for policy 1, policy_version 539691 (0.0008) [2023-12-26 03:55:30,586][123090] Updated weights for policy 1, policy_version 539701 (0.0008) [2023-12-26 03:55:30,638][123090] Updated weights for policy 1, policy_version 539711 (0.0009) [2023-12-26 03:55:30,895][123091] Updated weights for policy 0, policy_version 543604 (0.0007) [2023-12-26 03:55:30,947][123091] Updated weights for policy 0, policy_version 543614 (0.0005) [2023-12-26 03:55:31,000][123091] Updated weights for policy 0, policy_version 543624 (0.0006) [2023-12-26 03:55:31,540][123090] Updated weights for policy 1, policy_version 539721 (0.0009) [2023-12-26 03:55:31,592][123090] Updated weights for policy 1, policy_version 539731 (0.0009) [2023-12-26 03:55:31,660][123090] Updated weights for policy 1, policy_version 539741 (0.0009) [2023-12-26 03:55:31,756][123091] Updated weights for policy 0, policy_version 543634 (0.0008) [2023-12-26 03:55:31,825][123091] Updated weights for policy 0, policy_version 543644 (0.0011) [2023-12-26 03:55:31,881][123091] Updated weights for policy 0, policy_version 543654 (0.0011) [2023-12-26 03:55:31,948][123091] Updated weights for policy 0, policy_version 543664 (0.0009) [2023-12-26 03:55:32,568][123090] Updated weights for policy 1, policy_version 539751 (0.0009) [2023-12-26 03:55:32,621][123090] Updated weights for policy 1, policy_version 539761 (0.0009) [2023-12-26 03:55:32,680][123090] Updated weights for policy 1, policy_version 539771 (0.0009) [2023-12-26 03:55:32,692][123091] Updated weights for policy 0, policy_version 543674 (0.0005) [2023-12-26 03:55:32,739][123091] Updated weights for policy 0, policy_version 543684 (0.0005) [2023-12-26 03:55:32,784][123091] Updated weights for policy 0, policy_version 543694 (0.0005) [2023-12-26 03:55:33,469][123091] Updated weights for policy 0, policy_version 543704 (0.0010) [2023-12-26 03:55:33,513][123091] Updated weights for policy 0, policy_version 543714 (0.0010) [2023-12-26 03:55:33,568][123091] Updated weights for policy 0, policy_version 543724 (0.0008) [2023-12-26 03:55:33,570][123090] Updated weights for policy 1, policy_version 539781 (0.0009) [2023-12-26 03:55:33,627][123090] Updated weights for policy 1, policy_version 539791 (0.0009) [2023-12-26 03:55:33,688][123090] Updated weights for policy 1, policy_version 539801 (0.0010) [2023-12-26 03:55:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 277389312. Throughput: 0: 8895.8, 1: 8657.4. Samples: 277396396. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:33,785][121949] Avg episode reward: [(0, '6186.428'), (1, '5810.931')] [2023-12-26 03:55:34,255][123091] Updated weights for policy 0, policy_version 543734 (0.0009) [2023-12-26 03:55:34,318][123091] Updated weights for policy 0, policy_version 543744 (0.0008) [2023-12-26 03:55:34,383][123091] Updated weights for policy 0, policy_version 543754 (0.0005) [2023-12-26 03:55:34,560][123090] Updated weights for policy 1, policy_version 539811 (0.0009) [2023-12-26 03:55:34,625][123090] Updated weights for policy 1, policy_version 539821 (0.0009) [2023-12-26 03:55:34,685][123090] Updated weights for policy 1, policy_version 539831 (0.0008) [2023-12-26 03:55:35,132][123091] Updated weights for policy 0, policy_version 543764 (0.0005) [2023-12-26 03:55:35,181][123091] Updated weights for policy 0, policy_version 543774 (0.0005) [2023-12-26 03:55:35,237][123091] Updated weights for policy 0, policy_version 543784 (0.0005) [2023-12-26 03:55:35,587][123090] Updated weights for policy 1, policy_version 539841 (0.0009) [2023-12-26 03:55:35,649][123090] Updated weights for policy 1, policy_version 539851 (0.0010) [2023-12-26 03:55:35,711][123090] Updated weights for policy 1, policy_version 539861 (0.0010) [2023-12-26 03:55:35,773][123090] Updated weights for policy 1, policy_version 539871 (0.0010) [2023-12-26 03:55:35,820][123091] Updated weights for policy 0, policy_version 543794 (0.0005) [2023-12-26 03:55:35,872][123091] Updated weights for policy 0, policy_version 543804 (0.0005) [2023-12-26 03:55:35,927][123091] Updated weights for policy 0, policy_version 543814 (0.0005) [2023-12-26 03:55:35,983][123091] Updated weights for policy 0, policy_version 543824 (0.0009) [2023-12-26 03:55:36,653][123090] Updated weights for policy 1, policy_version 539881 (0.0009) [2023-12-26 03:55:36,712][123090] Updated weights for policy 1, policy_version 539891 (0.0009) [2023-12-26 03:55:36,733][123091] Updated weights for policy 0, policy_version 543834 (0.0009) [2023-12-26 03:55:36,775][123090] Updated weights for policy 1, policy_version 539901 (0.0010) [2023-12-26 03:55:36,800][123091] Updated weights for policy 0, policy_version 543844 (0.0009) [2023-12-26 03:55:36,865][123091] Updated weights for policy 0, policy_version 543854 (0.0011) [2023-12-26 03:55:37,529][123091] Updated weights for policy 0, policy_version 543864 (0.0006) [2023-12-26 03:55:37,583][123091] Updated weights for policy 0, policy_version 543874 (0.0005) [2023-12-26 03:55:37,652][123091] Updated weights for policy 0, policy_version 543884 (0.0006) [2023-12-26 03:55:37,667][123090] Updated weights for policy 1, policy_version 539911 (0.0010) [2023-12-26 03:55:37,732][123090] Updated weights for policy 1, policy_version 539921 (0.0009) [2023-12-26 03:55:37,800][123090] Updated weights for policy 1, policy_version 539931 (0.0009) [2023-12-26 03:55:38,392][123091] Updated weights for policy 0, policy_version 543894 (0.0006) [2023-12-26 03:55:38,442][123091] Updated weights for policy 0, policy_version 543904 (0.0006) [2023-12-26 03:55:38,494][123091] Updated weights for policy 0, policy_version 543914 (0.0007) [2023-12-26 03:55:38,660][123090] Updated weights for policy 1, policy_version 539941 (0.0009) [2023-12-26 03:55:38,714][123090] Updated weights for policy 1, policy_version 539951 (0.0010) [2023-12-26 03:55:38,771][123090] Updated weights for policy 1, policy_version 539961 (0.0008) [2023-12-26 03:55:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 277471232. Throughput: 0: 8964.7, 1: 8635.5. Samples: 277450300. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:38,785][121949] Avg episode reward: [(0, '6195.444'), (1, '5774.458')] [2023-12-26 03:55:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000543920_139247616.pth... [2023-12-26 03:55:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000542864_138977280.pth [2023-12-26 03:55:38,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000539968_138231808.pth... [2023-12-26 03:55:38,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000538976_137977856.pth [2023-12-26 03:55:39,225][123091] Updated weights for policy 0, policy_version 543924 (0.0009) [2023-12-26 03:55:39,293][123091] Updated weights for policy 0, policy_version 543934 (0.0009) [2023-12-26 03:55:39,362][123091] Updated weights for policy 0, policy_version 543944 (0.0009) [2023-12-26 03:55:39,671][123090] Updated weights for policy 1, policy_version 539971 (0.0009) [2023-12-26 03:55:39,737][123090] Updated weights for policy 1, policy_version 539981 (0.0010) [2023-12-26 03:55:39,803][123090] Updated weights for policy 1, policy_version 539991 (0.0010) [2023-12-26 03:55:40,141][123091] Updated weights for policy 0, policy_version 543954 (0.0009) [2023-12-26 03:55:40,212][123091] Updated weights for policy 0, policy_version 543964 (0.0010) [2023-12-26 03:55:40,280][123091] Updated weights for policy 0, policy_version 543974 (0.0009) [2023-12-26 03:55:40,352][123091] Updated weights for policy 0, policy_version 543984 (0.0010) [2023-12-26 03:55:40,686][123090] Updated weights for policy 1, policy_version 540001 (0.0010) [2023-12-26 03:55:40,753][123090] Updated weights for policy 1, policy_version 540011 (0.0009) [2023-12-26 03:55:40,819][123090] Updated weights for policy 1, policy_version 540021 (0.0009) [2023-12-26 03:55:40,884][123090] Updated weights for policy 1, policy_version 540031 (0.0010) [2023-12-26 03:55:41,094][123091] Updated weights for policy 0, policy_version 543994 (0.0007) [2023-12-26 03:55:41,160][123091] Updated weights for policy 0, policy_version 544004 (0.0012) [2023-12-26 03:55:41,223][123091] Updated weights for policy 0, policy_version 544014 (0.0009) [2023-12-26 03:55:41,750][123090] Updated weights for policy 1, policy_version 540041 (0.0008) [2023-12-26 03:55:41,808][123090] Updated weights for policy 1, policy_version 540051 (0.0009) [2023-12-26 03:55:41,866][123090] Updated weights for policy 1, policy_version 540061 (0.0010) [2023-12-26 03:55:42,026][123091] Updated weights for policy 0, policy_version 544024 (0.0010) [2023-12-26 03:55:42,083][123091] Updated weights for policy 0, policy_version 544034 (0.0006) [2023-12-26 03:55:42,138][123091] Updated weights for policy 0, policy_version 544044 (0.0006) [2023-12-26 03:55:42,762][123090] Updated weights for policy 1, policy_version 540071 (0.0009) [2023-12-26 03:55:42,816][123090] Updated weights for policy 1, policy_version 540081 (0.0009) [2023-12-26 03:55:42,864][123090] Updated weights for policy 1, policy_version 540091 (0.0009) [2023-12-26 03:55:42,927][123091] Updated weights for policy 0, policy_version 544054 (0.0009) [2023-12-26 03:55:42,983][123091] Updated weights for policy 0, policy_version 544064 (0.0011) [2023-12-26 03:55:43,040][123091] Updated weights for policy 0, policy_version 544074 (0.0011) [2023-12-26 03:55:43,732][123090] Updated weights for policy 1, policy_version 540101 (0.0009) [2023-12-26 03:55:43,784][123090] Updated weights for policy 1, policy_version 540111 (0.0008) [2023-12-26 03:55:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 277553152. Throughput: 0: 9025.7, 1: 8491.4. Samples: 277553756. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:43,785][121949] Avg episode reward: [(0, '6095.507'), (1, '5833.497')] [2023-12-26 03:55:43,836][123090] Updated weights for policy 1, policy_version 540121 (0.0009) [2023-12-26 03:55:43,873][123091] Updated weights for policy 0, policy_version 544084 (0.0011) [2023-12-26 03:55:43,942][123091] Updated weights for policy 0, policy_version 544094 (0.0011) [2023-12-26 03:55:44,010][123091] Updated weights for policy 0, policy_version 544104 (0.0011) [2023-12-26 03:55:44,673][123090] Updated weights for policy 1, policy_version 540131 (0.0010) [2023-12-26 03:55:44,726][123090] Updated weights for policy 1, policy_version 540142 (0.0010) [2023-12-26 03:55:44,786][123090] Updated weights for policy 1, policy_version 540152 (0.0010) [2023-12-26 03:55:44,812][123091] Updated weights for policy 0, policy_version 544114 (0.0010) [2023-12-26 03:55:44,866][123091] Updated weights for policy 0, policy_version 544124 (0.0006) [2023-12-26 03:55:44,935][123091] Updated weights for policy 0, policy_version 544134 (0.0005) [2023-12-26 03:55:45,001][123091] Updated weights for policy 0, policy_version 544144 (0.0005) [2023-12-26 03:55:45,689][123090] Updated weights for policy 1, policy_version 540162 (0.0008) [2023-12-26 03:55:45,744][123091] Updated weights for policy 0, policy_version 544154 (0.0006) [2023-12-26 03:55:45,745][123090] Updated weights for policy 1, policy_version 540172 (0.0009) [2023-12-26 03:55:45,801][123091] Updated weights for policy 0, policy_version 544164 (0.0009) [2023-12-26 03:55:45,808][123090] Updated weights for policy 1, policy_version 540182 (0.0007) [2023-12-26 03:55:45,857][123090] Updated weights for policy 1, policy_version 540192 (0.0008) [2023-12-26 03:55:45,864][123091] Updated weights for policy 0, policy_version 544174 (0.0009) [2023-12-26 03:55:46,564][123091] Updated weights for policy 0, policy_version 544184 (0.0008) [2023-12-26 03:55:46,614][123091] Updated weights for policy 0, policy_version 544194 (0.0008) [2023-12-26 03:55:46,666][123091] Updated weights for policy 0, policy_version 544205 (0.0009) [2023-12-26 03:55:46,719][123090] Updated weights for policy 1, policy_version 540202 (0.0009) [2023-12-26 03:55:46,771][123090] Updated weights for policy 1, policy_version 540212 (0.0009) [2023-12-26 03:55:46,829][123090] Updated weights for policy 1, policy_version 540222 (0.0009) [2023-12-26 03:55:47,366][123091] Updated weights for policy 0, policy_version 544215 (0.0008) [2023-12-26 03:55:47,417][123091] Updated weights for policy 0, policy_version 544225 (0.0010) [2023-12-26 03:55:47,466][123091] Updated weights for policy 0, policy_version 544235 (0.0009) [2023-12-26 03:55:47,723][123090] Updated weights for policy 1, policy_version 540232 (0.0010) [2023-12-26 03:55:47,799][123090] Updated weights for policy 1, policy_version 540242 (0.0009) [2023-12-26 03:55:47,864][123090] Updated weights for policy 1, policy_version 540252 (0.0010) [2023-12-26 03:55:48,250][123091] Updated weights for policy 0, policy_version 544245 (0.0008) [2023-12-26 03:55:48,311][123091] Updated weights for policy 0, policy_version 544255 (0.0007) [2023-12-26 03:55:48,373][123091] Updated weights for policy 0, policy_version 544265 (0.0009) [2023-12-26 03:55:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 277643264. Throughput: 0: 9045.5, 1: 8443.3. Samples: 277658024. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:48,785][121949] Avg episode reward: [(0, '6089.636'), (1, '5917.620')] [2023-12-26 03:55:48,803][123090] Updated weights for policy 1, policy_version 540262 (0.0010) [2023-12-26 03:55:48,856][123090] Updated weights for policy 1, policy_version 540272 (0.0009) [2023-12-26 03:55:48,912][123090] Updated weights for policy 1, policy_version 540282 (0.0009) [2023-12-26 03:55:49,136][123091] Updated weights for policy 0, policy_version 544275 (0.0007) [2023-12-26 03:55:49,205][123091] Updated weights for policy 0, policy_version 544285 (0.0005) [2023-12-26 03:55:49,274][123091] Updated weights for policy 0, policy_version 544295 (0.0010) [2023-12-26 03:55:49,793][123090] Updated weights for policy 1, policy_version 540292 (0.0009) [2023-12-26 03:55:49,865][123090] Updated weights for policy 1, policy_version 540302 (0.0008) [2023-12-26 03:55:49,937][123090] Updated weights for policy 1, policy_version 540312 (0.0009) [2023-12-26 03:55:50,116][123091] Updated weights for policy 0, policy_version 544305 (0.0011) [2023-12-26 03:55:50,176][123091] Updated weights for policy 0, policy_version 544315 (0.0011) [2023-12-26 03:55:50,245][123091] Updated weights for policy 0, policy_version 544325 (0.0012) [2023-12-26 03:55:50,314][123091] Updated weights for policy 0, policy_version 544335 (0.0010) [2023-12-26 03:55:50,781][123090] Updated weights for policy 1, policy_version 540322 (0.0008) [2023-12-26 03:55:50,837][123090] Updated weights for policy 1, policy_version 540332 (0.0005) [2023-12-26 03:55:50,895][123090] Updated weights for policy 1, policy_version 540342 (0.0006) [2023-12-26 03:55:50,949][123090] Updated weights for policy 1, policy_version 540352 (0.0008) [2023-12-26 03:55:51,066][123091] Updated weights for policy 0, policy_version 544345 (0.0006) [2023-12-26 03:55:51,139][123091] Updated weights for policy 0, policy_version 544355 (0.0006) [2023-12-26 03:55:51,202][123091] Updated weights for policy 0, policy_version 544365 (0.0006) [2023-12-26 03:55:51,681][123090] Updated weights for policy 1, policy_version 540362 (0.0009) [2023-12-26 03:55:51,748][123090] Updated weights for policy 1, policy_version 540372 (0.0007) [2023-12-26 03:55:51,806][123090] Updated weights for policy 1, policy_version 540382 (0.0009) [2023-12-26 03:55:51,961][123091] Updated weights for policy 0, policy_version 544375 (0.0008) [2023-12-26 03:55:52,022][123091] Updated weights for policy 0, policy_version 544385 (0.0009) [2023-12-26 03:55:52,092][123091] Updated weights for policy 0, policy_version 544395 (0.0010) [2023-12-26 03:55:52,642][123090] Updated weights for policy 1, policy_version 540392 (0.0009) [2023-12-26 03:55:52,714][123090] Updated weights for policy 1, policy_version 540402 (0.0009) [2023-12-26 03:55:52,790][123090] Updated weights for policy 1, policy_version 540412 (0.0009) [2023-12-26 03:55:52,921][123091] Updated weights for policy 0, policy_version 544405 (0.0008) [2023-12-26 03:55:52,972][123091] Updated weights for policy 0, policy_version 544415 (0.0010) [2023-12-26 03:55:53,024][123091] Updated weights for policy 0, policy_version 544425 (0.0010) [2023-12-26 03:55:53,659][123090] Updated weights for policy 1, policy_version 540422 (0.0010) [2023-12-26 03:55:53,714][123090] Updated weights for policy 1, policy_version 540432 (0.0009) [2023-12-26 03:55:53,750][123091] Updated weights for policy 0, policy_version 544435 (0.0011) [2023-12-26 03:55:53,766][123090] Updated weights for policy 1, policy_version 540442 (0.0008) [2023-12-26 03:55:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 277725184. Throughput: 0: 9056.3, 1: 8433.0. Samples: 277710388. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:53,785][121949] Avg episode reward: [(0, '6093.482'), (1, '5874.578')] [2023-12-26 03:55:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000540448_138354688.pth... [2023-12-26 03:55:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000539456_138100736.pth [2023-12-26 03:55:53,805][123091] Updated weights for policy 0, policy_version 544445 (0.0010) [2023-12-26 03:55:53,860][123091] Updated weights for policy 0, policy_version 544455 (0.0010) [2023-12-26 03:55:53,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000544464_139386880.pth... [2023-12-26 03:55:53,910][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000543376_139108352.pth [2023-12-26 03:55:54,622][123090] Updated weights for policy 1, policy_version 540452 (0.0009) [2023-12-26 03:55:54,682][123090] Updated weights for policy 1, policy_version 540462 (0.0008) [2023-12-26 03:55:54,690][123091] Updated weights for policy 0, policy_version 544465 (0.0010) [2023-12-26 03:55:54,743][123090] Updated weights for policy 1, policy_version 540472 (0.0007) [2023-12-26 03:55:54,745][123091] Updated weights for policy 0, policy_version 544475 (0.0011) [2023-12-26 03:55:54,793][123091] Updated weights for policy 0, policy_version 544485 (0.0010) [2023-12-26 03:55:54,844][123091] Updated weights for policy 0, policy_version 544495 (0.0010) [2023-12-26 03:55:55,565][123090] Updated weights for policy 1, policy_version 540482 (0.0007) [2023-12-26 03:55:55,624][123090] Updated weights for policy 1, policy_version 540492 (0.0009) [2023-12-26 03:55:55,685][123090] Updated weights for policy 1, policy_version 540502 (0.0008) [2023-12-26 03:55:55,696][123091] Updated weights for policy 0, policy_version 544505 (0.0011) [2023-12-26 03:55:55,744][123090] Updated weights for policy 1, policy_version 540512 (0.0005) [2023-12-26 03:55:55,750][123091] Updated weights for policy 0, policy_version 544515 (0.0010) [2023-12-26 03:55:55,808][123091] Updated weights for policy 0, policy_version 544525 (0.0010) [2023-12-26 03:55:56,446][123090] Updated weights for policy 1, policy_version 540522 (0.0007) [2023-12-26 03:55:56,494][123090] Updated weights for policy 1, policy_version 540532 (0.0007) [2023-12-26 03:55:56,557][123090] Updated weights for policy 1, policy_version 540542 (0.0009) [2023-12-26 03:55:56,633][123091] Updated weights for policy 0, policy_version 544535 (0.0011) [2023-12-26 03:55:56,684][123091] Updated weights for policy 0, policy_version 544545 (0.0010) [2023-12-26 03:55:56,730][123091] Updated weights for policy 0, policy_version 544555 (0.0005) [2023-12-26 03:55:57,295][123090] Updated weights for policy 1, policy_version 540552 (0.0007) [2023-12-26 03:55:57,356][123090] Updated weights for policy 1, policy_version 540562 (0.0010) [2023-12-26 03:55:57,417][123090] Updated weights for policy 1, policy_version 540572 (0.0010) [2023-12-26 03:55:57,505][123091] Updated weights for policy 0, policy_version 544565 (0.0006) [2023-12-26 03:55:57,560][123091] Updated weights for policy 0, policy_version 544575 (0.0007) [2023-12-26 03:55:57,619][123091] Updated weights for policy 0, policy_version 544585 (0.0006) [2023-12-26 03:55:58,283][123090] Updated weights for policy 1, policy_version 540582 (0.0008) [2023-12-26 03:55:58,302][123091] Updated weights for policy 0, policy_version 544595 (0.0007) [2023-12-26 03:55:58,352][123090] Updated weights for policy 1, policy_version 540592 (0.0008) [2023-12-26 03:55:58,388][123091] Updated weights for policy 0, policy_version 544605 (0.0008) [2023-12-26 03:55:58,422][123090] Updated weights for policy 1, policy_version 540602 (0.0008) [2023-12-26 03:55:58,451][123091] Updated weights for policy 0, policy_version 544615 (0.0008) [2023-12-26 03:55:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 277823488. Throughput: 0: 9111.0, 1: 8444.5. Samples: 277815428. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:55:58,785][121949] Avg episode reward: [(0, '6115.921'), (1, '5803.594')] [2023-12-26 03:55:59,294][123090] Updated weights for policy 1, policy_version 540612 (0.0009) [2023-12-26 03:55:59,363][123090] Updated weights for policy 1, policy_version 540622 (0.0009) [2023-12-26 03:55:59,370][123091] Updated weights for policy 0, policy_version 544625 (0.0010) [2023-12-26 03:55:59,426][123090] Updated weights for policy 1, policy_version 540632 (0.0008) [2023-12-26 03:55:59,435][123091] Updated weights for policy 0, policy_version 544635 (0.0009) [2023-12-26 03:55:59,495][123091] Updated weights for policy 0, policy_version 544645 (0.0008) [2023-12-26 03:55:59,556][123091] Updated weights for policy 0, policy_version 544655 (0.0010) [2023-12-26 03:56:00,281][123090] Updated weights for policy 1, policy_version 540642 (0.0009) [2023-12-26 03:56:00,338][123090] Updated weights for policy 1, policy_version 540652 (0.0009) [2023-12-26 03:56:00,384][123091] Updated weights for policy 0, policy_version 544665 (0.0008) [2023-12-26 03:56:00,402][123090] Updated weights for policy 1, policy_version 540662 (0.0009) [2023-12-26 03:56:00,438][123091] Updated weights for policy 0, policy_version 544675 (0.0008) [2023-12-26 03:56:00,469][123090] Updated weights for policy 1, policy_version 540672 (0.0007) [2023-12-26 03:56:00,487][123091] Updated weights for policy 0, policy_version 544685 (0.0008) [2023-12-26 03:56:01,139][123091] Updated weights for policy 0, policy_version 544696 (0.0007) [2023-12-26 03:56:01,200][123091] Updated weights for policy 0, policy_version 544706 (0.0008) [2023-12-26 03:56:01,261][123091] Updated weights for policy 0, policy_version 544716 (0.0007) [2023-12-26 03:56:01,364][123090] Updated weights for policy 1, policy_version 540682 (0.0010) [2023-12-26 03:56:01,439][123090] Updated weights for policy 1, policy_version 540692 (0.0009) [2023-12-26 03:56:01,500][123090] Updated weights for policy 1, policy_version 540702 (0.0008) [2023-12-26 03:56:02,070][123091] Updated weights for policy 0, policy_version 544726 (0.0008) [2023-12-26 03:56:02,122][123091] Updated weights for policy 0, policy_version 544736 (0.0009) [2023-12-26 03:56:02,150][123090] Updated weights for policy 1, policy_version 540712 (0.0007) [2023-12-26 03:56:02,184][123091] Updated weights for policy 0, policy_version 544746 (0.0008) [2023-12-26 03:56:02,207][123090] Updated weights for policy 1, policy_version 540722 (0.0007) [2023-12-26 03:56:02,270][123090] Updated weights for policy 1, policy_version 540732 (0.0008) [2023-12-26 03:56:02,856][123091] Updated weights for policy 0, policy_version 544756 (0.0008) [2023-12-26 03:56:02,908][123091] Updated weights for policy 0, policy_version 544766 (0.0005) [2023-12-26 03:56:02,954][123091] Updated weights for policy 0, policy_version 544776 (0.0005) [2023-12-26 03:56:03,204][123090] Updated weights for policy 1, policy_version 540742 (0.0009) [2023-12-26 03:56:03,257][123090] Updated weights for policy 1, policy_version 540752 (0.0010) [2023-12-26 03:56:03,311][123090] Updated weights for policy 1, policy_version 540762 (0.0009) [2023-12-26 03:56:03,648][123091] Updated weights for policy 0, policy_version 544786 (0.0006) [2023-12-26 03:56:03,710][123091] Updated weights for policy 0, policy_version 544796 (0.0007) [2023-12-26 03:56:03,777][123091] Updated weights for policy 0, policy_version 544806 (0.0005) [2023-12-26 03:56:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 277905408. Throughput: 0: 9175.1, 1: 8378.4. Samples: 277920068. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:56:03,785][121949] Avg episode reward: [(0, '6170.502'), (1, '5760.292')] [2023-12-26 03:56:03,842][123091] Updated weights for policy 0, policy_version 544816 (0.0008) [2023-12-26 03:56:04,190][123090] Updated weights for policy 1, policy_version 540772 (0.0010) [2023-12-26 03:56:04,260][123090] Updated weights for policy 1, policy_version 540782 (0.0009) [2023-12-26 03:56:04,322][123090] Updated weights for policy 1, policy_version 540792 (0.0009) [2023-12-26 03:56:04,487][123091] Updated weights for policy 0, policy_version 544826 (0.0011) [2023-12-26 03:56:04,540][123091] Updated weights for policy 0, policy_version 544836 (0.0011) [2023-12-26 03:56:04,606][123091] Updated weights for policy 0, policy_version 544846 (0.0011) [2023-12-26 03:56:05,192][123090] Updated weights for policy 1, policy_version 540802 (0.0010) [2023-12-26 03:56:05,259][123090] Updated weights for policy 1, policy_version 540812 (0.0010) [2023-12-26 03:56:05,310][123090] Updated weights for policy 1, policy_version 540822 (0.0009) [2023-12-26 03:56:05,367][123091] Updated weights for policy 0, policy_version 544856 (0.0009) [2023-12-26 03:56:05,368][123090] Updated weights for policy 1, policy_version 540832 (0.0008) [2023-12-26 03:56:05,438][123091] Updated weights for policy 0, policy_version 544866 (0.0009) [2023-12-26 03:56:05,503][123091] Updated weights for policy 0, policy_version 544876 (0.0011) [2023-12-26 03:56:06,207][123090] Updated weights for policy 1, policy_version 540842 (0.0006) [2023-12-26 03:56:06,236][123091] Updated weights for policy 0, policy_version 544886 (0.0010) [2023-12-26 03:56:06,263][123090] Updated weights for policy 1, policy_version 540852 (0.0009) [2023-12-26 03:56:06,304][123091] Updated weights for policy 0, policy_version 544896 (0.0011) [2023-12-26 03:56:06,332][123090] Updated weights for policy 1, policy_version 540862 (0.0006) [2023-12-26 03:56:06,371][123091] Updated weights for policy 0, policy_version 544906 (0.0011) [2023-12-26 03:56:07,130][123090] Updated weights for policy 1, policy_version 540872 (0.0006) [2023-12-26 03:56:07,168][123091] Updated weights for policy 0, policy_version 544916 (0.0009) [2023-12-26 03:56:07,196][123090] Updated weights for policy 1, policy_version 540882 (0.0008) [2023-12-26 03:56:07,224][123091] Updated weights for policy 0, policy_version 544926 (0.0010) [2023-12-26 03:56:07,248][123090] Updated weights for policy 1, policy_version 540892 (0.0006) [2023-12-26 03:56:07,275][123091] Updated weights for policy 0, policy_version 544936 (0.0010) [2023-12-26 03:56:08,049][123090] Updated weights for policy 1, policy_version 540902 (0.0009) [2023-12-26 03:56:08,097][123091] Updated weights for policy 0, policy_version 544946 (0.0011) [2023-12-26 03:56:08,100][123090] Updated weights for policy 1, policy_version 540912 (0.0008) [2023-12-26 03:56:08,145][123091] Updated weights for policy 0, policy_version 544956 (0.0010) [2023-12-26 03:56:08,152][123090] Updated weights for policy 1, policy_version 540922 (0.0005) [2023-12-26 03:56:08,207][123091] Updated weights for policy 0, policy_version 544966 (0.0011) [2023-12-26 03:56:08,280][123091] Updated weights for policy 0, policy_version 544976 (0.0011) [2023-12-26 03:56:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 277995520. Throughput: 0: 9232.9, 1: 8355.4. Samples: 277973392. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:56:08,785][121949] Avg episode reward: [(0, '6097.798'), (1, '5856.565')] [2023-12-26 03:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000544976_139517952.pth... [2023-12-26 03:56:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000540928_138477568.pth... [2023-12-26 03:56:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000543920_139247616.pth [2023-12-26 03:56:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000539968_138231808.pth [2023-12-26 03:56:09,006][123091] Updated weights for policy 0, policy_version 544986 (0.0009) [2023-12-26 03:56:09,052][123090] Updated weights for policy 1, policy_version 540932 (0.0009) [2023-12-26 03:56:09,075][123091] Updated weights for policy 0, policy_version 544996 (0.0007) [2023-12-26 03:56:09,107][123090] Updated weights for policy 1, policy_version 540942 (0.0009) [2023-12-26 03:56:09,144][123091] Updated weights for policy 0, policy_version 545006 (0.0007) [2023-12-26 03:56:09,156][123090] Updated weights for policy 1, policy_version 540952 (0.0009) [2023-12-26 03:56:09,916][123091] Updated weights for policy 0, policy_version 545016 (0.0009) [2023-12-26 03:56:09,981][123091] Updated weights for policy 0, policy_version 545026 (0.0009) [2023-12-26 03:56:10,042][123091] Updated weights for policy 0, policy_version 545036 (0.0010) [2023-12-26 03:56:10,071][123090] Updated weights for policy 1, policy_version 540963 (0.0010) [2023-12-26 03:56:10,137][123090] Updated weights for policy 1, policy_version 540973 (0.0010) [2023-12-26 03:56:10,206][123090] Updated weights for policy 1, policy_version 540983 (0.0009) [2023-12-26 03:56:10,841][123091] Updated weights for policy 0, policy_version 545046 (0.0009) [2023-12-26 03:56:10,905][123091] Updated weights for policy 0, policy_version 545056 (0.0010) [2023-12-26 03:56:10,973][123091] Updated weights for policy 0, policy_version 545066 (0.0008) [2023-12-26 03:56:11,079][123090] Updated weights for policy 1, policy_version 540993 (0.0009) [2023-12-26 03:56:11,148][123090] Updated weights for policy 1, policy_version 541003 (0.0010) [2023-12-26 03:56:11,214][123090] Updated weights for policy 1, policy_version 541013 (0.0009) [2023-12-26 03:56:11,279][123090] Updated weights for policy 1, policy_version 541023 (0.0009) [2023-12-26 03:56:11,846][123091] Updated weights for policy 0, policy_version 545076 (0.0009) [2023-12-26 03:56:11,904][123091] Updated weights for policy 0, policy_version 545086 (0.0010) [2023-12-26 03:56:11,970][123091] Updated weights for policy 0, policy_version 545096 (0.0008) [2023-12-26 03:56:12,158][123090] Updated weights for policy 1, policy_version 541033 (0.0009) [2023-12-26 03:56:12,225][123090] Updated weights for policy 1, policy_version 541043 (0.0009) [2023-12-26 03:56:12,298][123090] Updated weights for policy 1, policy_version 541053 (0.0009) [2023-12-26 03:56:12,712][123091] Updated weights for policy 0, policy_version 545106 (0.0009) [2023-12-26 03:56:12,773][123091] Updated weights for policy 0, policy_version 545116 (0.0006) [2023-12-26 03:56:12,834][123091] Updated weights for policy 0, policy_version 545126 (0.0006) [2023-12-26 03:56:12,896][123091] Updated weights for policy 0, policy_version 545136 (0.0005) [2023-12-26 03:56:13,199][123090] Updated weights for policy 1, policy_version 541063 (0.0010) [2023-12-26 03:56:13,262][123090] Updated weights for policy 1, policy_version 541073 (0.0009) [2023-12-26 03:56:13,320][123090] Updated weights for policy 1, policy_version 541083 (0.0009) [2023-12-26 03:56:13,647][123091] Updated weights for policy 0, policy_version 545146 (0.0010) [2023-12-26 03:56:13,700][123091] Updated weights for policy 0, policy_version 545156 (0.0009) [2023-12-26 03:56:13,755][123091] Updated weights for policy 0, policy_version 545166 (0.0008) [2023-12-26 03:56:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 278085632. Throughput: 0: 9256.8, 1: 8270.4. Samples: 278075612. Policy #0 lag: (min: 1.0, avg: 26.5, max: 33.0) [2023-12-26 03:56:13,784][121949] Avg episode reward: [(0, '6069.983'), (1, '5880.931')] [2023-12-26 03:56:14,195][123090] Updated weights for policy 1, policy_version 541093 (0.0010) [2023-12-26 03:56:14,251][123090] Updated weights for policy 1, policy_version 541104 (0.0011) [2023-12-26 03:56:14,305][123090] Updated weights for policy 1, policy_version 541115 (0.0010) [2023-12-26 03:56:14,474][123091] Updated weights for policy 0, policy_version 545176 (0.0007) [2023-12-26 03:56:14,535][123091] Updated weights for policy 0, policy_version 545186 (0.0007) [2023-12-26 03:56:14,593][123091] Updated weights for policy 0, policy_version 545196 (0.0010) [2023-12-26 03:56:15,229][123090] Updated weights for policy 1, policy_version 541125 (0.0009) [2023-12-26 03:56:15,303][123090] Updated weights for policy 1, policy_version 541135 (0.0009) [2023-12-26 03:56:15,362][123091] Updated weights for policy 0, policy_version 545206 (0.0008) [2023-12-26 03:56:15,376][123090] Updated weights for policy 1, policy_version 541145 (0.0009) [2023-12-26 03:56:15,428][123091] Updated weights for policy 0, policy_version 545216 (0.0007) [2023-12-26 03:56:15,499][123091] Updated weights for policy 0, policy_version 545226 (0.0011) [2023-12-26 03:56:16,100][123091] Updated weights for policy 0, policy_version 545236 (0.0009) [2023-12-26 03:56:16,156][123091] Updated weights for policy 0, policy_version 545246 (0.0005) [2023-12-26 03:56:16,211][123091] Updated weights for policy 0, policy_version 545256 (0.0006) [2023-12-26 03:56:16,271][123090] Updated weights for policy 1, policy_version 541155 (0.0009) [2023-12-26 03:56:16,323][123090] Updated weights for policy 1, policy_version 541165 (0.0010) [2023-12-26 03:56:16,381][123090] Updated weights for policy 1, policy_version 541175 (0.0010) [2023-12-26 03:56:16,907][123091] Updated weights for policy 0, policy_version 545266 (0.0006) [2023-12-26 03:56:16,966][123091] Updated weights for policy 0, policy_version 545276 (0.0010) [2023-12-26 03:56:17,029][123091] Updated weights for policy 0, policy_version 545286 (0.0010) [2023-12-26 03:56:17,083][123091] Updated weights for policy 0, policy_version 545296 (0.0010) [2023-12-26 03:56:17,254][123090] Updated weights for policy 1, policy_version 541185 (0.0009) [2023-12-26 03:56:17,307][123090] Updated weights for policy 1, policy_version 541195 (0.0009) [2023-12-26 03:56:17,360][123090] Updated weights for policy 1, policy_version 541206 (0.0009) [2023-12-26 03:56:17,410][123090] Updated weights for policy 1, policy_version 541216 (0.0009) [2023-12-26 03:56:17,885][123091] Updated weights for policy 0, policy_version 545306 (0.0005) [2023-12-26 03:56:17,938][123091] Updated weights for policy 0, policy_version 545316 (0.0006) [2023-12-26 03:56:17,983][123091] Updated weights for policy 0, policy_version 545326 (0.0005) [2023-12-26 03:56:18,339][123090] Updated weights for policy 1, policy_version 541226 (0.0010) [2023-12-26 03:56:18,405][123090] Updated weights for policy 1, policy_version 541236 (0.0009) [2023-12-26 03:56:18,469][123090] Updated weights for policy 1, policy_version 541246 (0.0009) [2023-12-26 03:56:18,716][123091] Updated weights for policy 0, policy_version 545336 (0.0008) [2023-12-26 03:56:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 278167552. Throughput: 0: 9224.1, 1: 8210.0. Samples: 278180928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:18,785][121949] Avg episode reward: [(0, '6021.149'), (1, '5806.880')] [2023-12-26 03:56:18,786][123091] Updated weights for policy 0, policy_version 545346 (0.0009) [2023-12-26 03:56:18,852][123091] Updated weights for policy 0, policy_version 545356 (0.0009) [2023-12-26 03:56:19,327][123090] Updated weights for policy 1, policy_version 541256 (0.0010) [2023-12-26 03:56:19,405][123090] Updated weights for policy 1, policy_version 541266 (0.0009) [2023-12-26 03:56:19,470][123090] Updated weights for policy 1, policy_version 541276 (0.0010) [2023-12-26 03:56:19,640][123091] Updated weights for policy 0, policy_version 545366 (0.0010) [2023-12-26 03:56:19,702][123091] Updated weights for policy 0, policy_version 545376 (0.0010) [2023-12-26 03:56:19,763][123091] Updated weights for policy 0, policy_version 545386 (0.0010) [2023-12-26 03:56:20,356][123090] Updated weights for policy 1, policy_version 541286 (0.0009) [2023-12-26 03:56:20,419][123090] Updated weights for policy 1, policy_version 541296 (0.0009) [2023-12-26 03:56:20,469][123090] Updated weights for policy 1, policy_version 541306 (0.0009) [2023-12-26 03:56:20,601][123091] Updated weights for policy 0, policy_version 545396 (0.0010) [2023-12-26 03:56:20,662][123091] Updated weights for policy 0, policy_version 545406 (0.0010) [2023-12-26 03:56:20,722][123091] Updated weights for policy 0, policy_version 545416 (0.0009) [2023-12-26 03:56:21,267][123090] Updated weights for policy 1, policy_version 541316 (0.0009) [2023-12-26 03:56:21,345][123090] Updated weights for policy 1, policy_version 541326 (0.0009) [2023-12-26 03:56:21,420][123090] Updated weights for policy 1, policy_version 541336 (0.0007) [2023-12-26 03:56:21,585][123091] Updated weights for policy 0, policy_version 545426 (0.0007) [2023-12-26 03:56:21,661][123091] Updated weights for policy 0, policy_version 545436 (0.0010) [2023-12-26 03:56:21,737][123091] Updated weights for policy 0, policy_version 545446 (0.0009) [2023-12-26 03:56:21,800][123091] Updated weights for policy 0, policy_version 545456 (0.0010) [2023-12-26 03:56:22,206][123090] Updated weights for policy 1, policy_version 541346 (0.0006) [2023-12-26 03:56:22,272][123090] Updated weights for policy 1, policy_version 541356 (0.0006) [2023-12-26 03:56:22,338][123090] Updated weights for policy 1, policy_version 541366 (0.0008) [2023-12-26 03:56:22,407][123090] Updated weights for policy 1, policy_version 541376 (0.0008) [2023-12-26 03:56:22,697][123091] Updated weights for policy 0, policy_version 545466 (0.0010) [2023-12-26 03:56:22,751][123091] Updated weights for policy 0, policy_version 545476 (0.0009) [2023-12-26 03:56:22,817][123091] Updated weights for policy 0, policy_version 545486 (0.0009) [2023-12-26 03:56:23,254][123090] Updated weights for policy 1, policy_version 541386 (0.0009) [2023-12-26 03:56:23,311][123090] Updated weights for policy 1, policy_version 541396 (0.0009) [2023-12-26 03:56:23,363][123090] Updated weights for policy 1, policy_version 541406 (0.0009) [2023-12-26 03:56:23,632][123091] Updated weights for policy 0, policy_version 545496 (0.0009) [2023-12-26 03:56:23,689][123091] Updated weights for policy 0, policy_version 545506 (0.0010) [2023-12-26 03:56:23,739][123091] Updated weights for policy 0, policy_version 545516 (0.0009) [2023-12-26 03:56:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 278257664. Throughput: 0: 9114.7, 1: 8218.2. Samples: 278230280. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:23,784][121949] Avg episode reward: [(0, '5952.000'), (1, '5565.169')] [2023-12-26 03:56:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000545520_139657216.pth... [2023-12-26 03:56:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000541408_138600448.pth... [2023-12-26 03:56:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000540448_138354688.pth [2023-12-26 03:56:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000544464_139386880.pth [2023-12-26 03:56:24,234][123090] Updated weights for policy 1, policy_version 541416 (0.0010) [2023-12-26 03:56:24,288][123090] Updated weights for policy 1, policy_version 541426 (0.0009) [2023-12-26 03:56:24,340][123090] Updated weights for policy 1, policy_version 541436 (0.0010) [2023-12-26 03:56:24,594][123091] Updated weights for policy 0, policy_version 545526 (0.0009) [2023-12-26 03:56:24,659][123091] Updated weights for policy 0, policy_version 545536 (0.0010) [2023-12-26 03:56:24,715][123091] Updated weights for policy 0, policy_version 545546 (0.0010) [2023-12-26 03:56:25,175][123090] Updated weights for policy 1, policy_version 541446 (0.0010) [2023-12-26 03:56:25,230][123090] Updated weights for policy 1, policy_version 541458 (0.0010) [2023-12-26 03:56:25,297][123090] Updated weights for policy 1, policy_version 541468 (0.0009) [2023-12-26 03:56:25,472][123091] Updated weights for policy 0, policy_version 545556 (0.0008) [2023-12-26 03:56:25,517][123091] Updated weights for policy 0, policy_version 545566 (0.0005) [2023-12-26 03:56:25,564][123091] Updated weights for policy 0, policy_version 545576 (0.0005) [2023-12-26 03:56:26,189][123091] Updated weights for policy 0, policy_version 545586 (0.0006) [2023-12-26 03:56:26,241][123090] Updated weights for policy 1, policy_version 541478 (0.0008) [2023-12-26 03:56:26,252][123091] Updated weights for policy 0, policy_version 545596 (0.0009) [2023-12-26 03:56:26,306][123090] Updated weights for policy 1, policy_version 541488 (0.0007) [2023-12-26 03:56:26,312][123091] Updated weights for policy 0, policy_version 545606 (0.0008) [2023-12-26 03:56:26,369][123090] Updated weights for policy 1, policy_version 541498 (0.0008) [2023-12-26 03:56:26,378][123091] Updated weights for policy 0, policy_version 545616 (0.0008) [2023-12-26 03:56:27,143][123090] Updated weights for policy 1, policy_version 541508 (0.0009) [2023-12-26 03:56:27,205][123090] Updated weights for policy 1, policy_version 541518 (0.0006) [2023-12-26 03:56:27,216][123091] Updated weights for policy 0, policy_version 545626 (0.0008) [2023-12-26 03:56:27,257][123090] Updated weights for policy 1, policy_version 541528 (0.0006) [2023-12-26 03:56:27,278][123091] Updated weights for policy 0, policy_version 545636 (0.0008) [2023-12-26 03:56:27,333][123091] Updated weights for policy 0, policy_version 545646 (0.0008) [2023-12-26 03:56:28,065][123090] Updated weights for policy 1, policy_version 541538 (0.0006) [2023-12-26 03:56:28,122][123090] Updated weights for policy 1, policy_version 541548 (0.0010) [2023-12-26 03:56:28,145][123091] Updated weights for policy 0, policy_version 545656 (0.0006) [2023-12-26 03:56:28,184][123090] Updated weights for policy 1, policy_version 541558 (0.0010) [2023-12-26 03:56:28,199][123091] Updated weights for policy 0, policy_version 545666 (0.0006) [2023-12-26 03:56:28,239][123090] Updated weights for policy 1, policy_version 541568 (0.0010) [2023-12-26 03:56:28,258][123091] Updated weights for policy 0, policy_version 545676 (0.0006) [2023-12-26 03:56:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 278339584. Throughput: 0: 9051.3, 1: 8288.5. Samples: 278334044. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:28,785][121949] Avg episode reward: [(0, '5932.475'), (1, '5546.161')] [2023-12-26 03:56:29,088][123090] Updated weights for policy 1, policy_version 541578 (0.0011) [2023-12-26 03:56:29,100][123091] Updated weights for policy 0, policy_version 545686 (0.0009) [2023-12-26 03:56:29,145][123090] Updated weights for policy 1, policy_version 541588 (0.0011) [2023-12-26 03:56:29,160][123091] Updated weights for policy 0, policy_version 545696 (0.0006) [2023-12-26 03:56:29,205][123090] Updated weights for policy 1, policy_version 541598 (0.0010) [2023-12-26 03:56:29,217][123091] Updated weights for policy 0, policy_version 545706 (0.0006) [2023-12-26 03:56:30,015][123090] Updated weights for policy 1, policy_version 541608 (0.0007) [2023-12-26 03:56:30,064][123091] Updated weights for policy 0, policy_version 545716 (0.0009) [2023-12-26 03:56:30,081][123090] Updated weights for policy 1, policy_version 541618 (0.0008) [2023-12-26 03:56:30,128][123091] Updated weights for policy 0, policy_version 545726 (0.0009) [2023-12-26 03:56:30,143][123090] Updated weights for policy 1, policy_version 541628 (0.0008) [2023-12-26 03:56:30,188][123091] Updated weights for policy 0, policy_version 545736 (0.0008) [2023-12-26 03:56:30,855][123090] Updated weights for policy 1, policy_version 541638 (0.0006) [2023-12-26 03:56:30,916][123090] Updated weights for policy 1, policy_version 541648 (0.0005) [2023-12-26 03:56:30,974][123090] Updated weights for policy 1, policy_version 541658 (0.0005) [2023-12-26 03:56:31,048][123091] Updated weights for policy 0, policy_version 545746 (0.0010) [2023-12-26 03:56:31,098][123091] Updated weights for policy 0, policy_version 545756 (0.0010) [2023-12-26 03:56:31,154][123091] Updated weights for policy 0, policy_version 545766 (0.0010) [2023-12-26 03:56:31,209][123091] Updated weights for policy 0, policy_version 545776 (0.0009) [2023-12-26 03:56:31,721][123090] Updated weights for policy 1, policy_version 541668 (0.0007) [2023-12-26 03:56:31,783][123090] Updated weights for policy 1, policy_version 541678 (0.0008) [2023-12-26 03:56:31,835][123090] Updated weights for policy 1, policy_version 541688 (0.0009) [2023-12-26 03:56:32,090][123091] Updated weights for policy 0, policy_version 545786 (0.0009) [2023-12-26 03:56:32,138][123091] Updated weights for policy 0, policy_version 545796 (0.0009) [2023-12-26 03:56:32,185][123091] Updated weights for policy 0, policy_version 545806 (0.0008) [2023-12-26 03:56:32,636][123090] Updated weights for policy 1, policy_version 541698 (0.0008) [2023-12-26 03:56:32,688][123090] Updated weights for policy 1, policy_version 541708 (0.0009) [2023-12-26 03:56:32,736][123090] Updated weights for policy 1, policy_version 541718 (0.0009) [2023-12-26 03:56:32,789][123090] Updated weights for policy 1, policy_version 541728 (0.0009) [2023-12-26 03:56:33,039][123091] Updated weights for policy 0, policy_version 545816 (0.0006) [2023-12-26 03:56:33,102][123091] Updated weights for policy 0, policy_version 545826 (0.0007) [2023-12-26 03:56:33,170][123091] Updated weights for policy 0, policy_version 545836 (0.0009) [2023-12-26 03:56:33,676][123090] Updated weights for policy 1, policy_version 541738 (0.0007) [2023-12-26 03:56:33,748][123090] Updated weights for policy 1, policy_version 541748 (0.0007) [2023-12-26 03:56:33,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 278421504. Throughput: 0: 8974.9, 1: 8391.9. Samples: 278439532. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:33,785][121949] Avg episode reward: [(0, '6017.061'), (1, '5577.441')] [2023-12-26 03:56:33,815][123090] Updated weights for policy 1, policy_version 541758 (0.0007) [2023-12-26 03:56:33,818][123091] Updated weights for policy 0, policy_version 545846 (0.0007) [2023-12-26 03:56:33,870][123091] Updated weights for policy 0, policy_version 545856 (0.0010) [2023-12-26 03:56:33,916][123091] Updated weights for policy 0, policy_version 545866 (0.0009) [2023-12-26 03:56:34,518][123090] Updated weights for policy 1, policy_version 541768 (0.0007) [2023-12-26 03:56:34,582][123090] Updated weights for policy 1, policy_version 541778 (0.0005) [2023-12-26 03:56:34,653][123090] Updated weights for policy 1, policy_version 541788 (0.0005) [2023-12-26 03:56:34,791][123091] Updated weights for policy 0, policy_version 545876 (0.0010) [2023-12-26 03:56:34,849][123091] Updated weights for policy 0, policy_version 545886 (0.0010) [2023-12-26 03:56:34,916][123091] Updated weights for policy 0, policy_version 545896 (0.0010) [2023-12-26 03:56:35,326][123090] Updated weights for policy 1, policy_version 541798 (0.0007) [2023-12-26 03:56:35,381][123090] Updated weights for policy 1, policy_version 541808 (0.0009) [2023-12-26 03:56:35,437][123090] Updated weights for policy 1, policy_version 541818 (0.0010) [2023-12-26 03:56:35,672][123091] Updated weights for policy 0, policy_version 545906 (0.0010) [2023-12-26 03:56:35,737][123091] Updated weights for policy 0, policy_version 545916 (0.0007) [2023-12-26 03:56:35,791][123091] Updated weights for policy 0, policy_version 545926 (0.0005) [2023-12-26 03:56:35,851][123091] Updated weights for policy 0, policy_version 545936 (0.0006) [2023-12-26 03:56:36,346][123090] Updated weights for policy 1, policy_version 541828 (0.0010) [2023-12-26 03:56:36,416][123090] Updated weights for policy 1, policy_version 541838 (0.0008) [2023-12-26 03:56:36,491][123090] Updated weights for policy 1, policy_version 541848 (0.0005) [2023-12-26 03:56:36,561][123091] Updated weights for policy 0, policy_version 545946 (0.0009) [2023-12-26 03:56:36,623][123091] Updated weights for policy 0, policy_version 545956 (0.0009) [2023-12-26 03:56:36,690][123091] Updated weights for policy 0, policy_version 545966 (0.0009) [2023-12-26 03:56:37,104][123090] Updated weights for policy 1, policy_version 541858 (0.0008) [2023-12-26 03:56:37,172][123090] Updated weights for policy 1, policy_version 541868 (0.0007) [2023-12-26 03:56:37,249][123090] Updated weights for policy 1, policy_version 541878 (0.0006) [2023-12-26 03:56:37,306][123090] Updated weights for policy 1, policy_version 541888 (0.0005) [2023-12-26 03:56:37,497][123091] Updated weights for policy 0, policy_version 545976 (0.0006) [2023-12-26 03:56:37,563][123091] Updated weights for policy 0, policy_version 545986 (0.0005) [2023-12-26 03:56:37,638][123091] Updated weights for policy 0, policy_version 545996 (0.0005) [2023-12-26 03:56:37,972][123090] Updated weights for policy 1, policy_version 541898 (0.0005) [2023-12-26 03:56:38,026][123090] Updated weights for policy 1, policy_version 541908 (0.0005) [2023-12-26 03:56:38,086][123090] Updated weights for policy 1, policy_version 541918 (0.0005) [2023-12-26 03:56:38,347][123091] Updated weights for policy 0, policy_version 546006 (0.0009) [2023-12-26 03:56:38,438][123091] Updated weights for policy 0, policy_version 546016 (0.0009) [2023-12-26 03:56:38,494][123091] Updated weights for policy 0, policy_version 546026 (0.0009) [2023-12-26 03:56:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 278519808. Throughput: 0: 8981.5, 1: 8437.3. Samples: 278494228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:38,785][121949] Avg episode reward: [(0, '6090.933'), (1, '5580.274')] [2023-12-26 03:56:38,785][123090] Updated weights for policy 1, policy_version 541928 (0.0008) [2023-12-26 03:56:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000546032_139788288.pth... [2023-12-26 03:56:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000544976_139517952.pth [2023-12-26 03:56:38,849][123090] Updated weights for policy 1, policy_version 541938 (0.0009) [2023-12-26 03:56:38,918][123090] Updated weights for policy 1, policy_version 541948 (0.0010) [2023-12-26 03:56:38,943][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000541952_138739712.pth... [2023-12-26 03:56:38,949][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000540928_138477568.pth [2023-12-26 03:56:39,319][123091] Updated weights for policy 0, policy_version 546036 (0.0009) [2023-12-26 03:56:39,389][123091] Updated weights for policy 0, policy_version 546046 (0.0009) [2023-12-26 03:56:39,453][123091] Updated weights for policy 0, policy_version 546056 (0.0010) [2023-12-26 03:56:39,729][123090] Updated weights for policy 1, policy_version 541958 (0.0009) [2023-12-26 03:56:39,793][123090] Updated weights for policy 1, policy_version 541968 (0.0009) [2023-12-26 03:56:39,866][123090] Updated weights for policy 1, policy_version 541978 (0.0010) [2023-12-26 03:56:40,326][123091] Updated weights for policy 0, policy_version 546066 (0.0009) [2023-12-26 03:56:40,403][123091] Updated weights for policy 0, policy_version 546076 (0.0007) [2023-12-26 03:56:40,464][123091] Updated weights for policy 0, policy_version 546086 (0.0009) [2023-12-26 03:56:40,529][123091] Updated weights for policy 0, policy_version 546096 (0.0010) [2023-12-26 03:56:40,704][123090] Updated weights for policy 1, policy_version 541988 (0.0010) [2023-12-26 03:56:40,774][123090] Updated weights for policy 1, policy_version 541998 (0.0010) [2023-12-26 03:56:40,837][123090] Updated weights for policy 1, policy_version 542008 (0.0009) [2023-12-26 03:56:41,338][123091] Updated weights for policy 0, policy_version 546106 (0.0007) [2023-12-26 03:56:41,411][123091] Updated weights for policy 0, policy_version 546116 (0.0007) [2023-12-26 03:56:41,482][123091] Updated weights for policy 0, policy_version 546126 (0.0006) [2023-12-26 03:56:41,731][123090] Updated weights for policy 1, policy_version 542018 (0.0009) [2023-12-26 03:56:41,800][123090] Updated weights for policy 1, policy_version 542028 (0.0009) [2023-12-26 03:56:41,875][123090] Updated weights for policy 1, policy_version 542038 (0.0009) [2023-12-26 03:56:41,946][123090] Updated weights for policy 1, policy_version 542048 (0.0009) [2023-12-26 03:56:42,224][123091] Updated weights for policy 0, policy_version 546136 (0.0010) [2023-12-26 03:56:42,293][123091] Updated weights for policy 0, policy_version 546146 (0.0011) [2023-12-26 03:56:42,377][123091] Updated weights for policy 0, policy_version 546156 (0.0011) [2023-12-26 03:56:42,742][123090] Updated weights for policy 1, policy_version 542058 (0.0010) [2023-12-26 03:56:42,804][123090] Updated weights for policy 1, policy_version 542068 (0.0008) [2023-12-26 03:56:42,869][123090] Updated weights for policy 1, policy_version 542078 (0.0005) [2023-12-26 03:56:43,232][123091] Updated weights for policy 0, policy_version 546166 (0.0010) [2023-12-26 03:56:43,296][123091] Updated weights for policy 0, policy_version 546176 (0.0010) [2023-12-26 03:56:43,360][123091] Updated weights for policy 0, policy_version 546186 (0.0010) [2023-12-26 03:56:43,590][123090] Updated weights for policy 1, policy_version 542088 (0.0009) [2023-12-26 03:56:43,637][123090] Updated weights for policy 1, policy_version 542098 (0.0009) [2023-12-26 03:56:43,692][123090] Updated weights for policy 1, policy_version 542108 (0.0009) [2023-12-26 03:56:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 278609920. Throughput: 0: 8967.4, 1: 8476.2. Samples: 278600388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:43,785][121949] Avg episode reward: [(0, '6145.486'), (1, '5530.580')] [2023-12-26 03:56:44,200][123091] Updated weights for policy 0, policy_version 546196 (0.0010) [2023-12-26 03:56:44,249][123091] Updated weights for policy 0, policy_version 546206 (0.0009) [2023-12-26 03:56:44,309][123091] Updated weights for policy 0, policy_version 546216 (0.0009) [2023-12-26 03:56:44,501][123090] Updated weights for policy 1, policy_version 542118 (0.0007) [2023-12-26 03:56:44,555][123090] Updated weights for policy 1, policy_version 542128 (0.0006) [2023-12-26 03:56:44,613][123090] Updated weights for policy 1, policy_version 542138 (0.0010) [2023-12-26 03:56:45,238][123091] Updated weights for policy 0, policy_version 546226 (0.0010) [2023-12-26 03:56:45,299][123091] Updated weights for policy 0, policy_version 546236 (0.0009) [2023-12-26 03:56:45,364][123091] Updated weights for policy 0, policy_version 546246 (0.0009) [2023-12-26 03:56:45,373][123090] Updated weights for policy 1, policy_version 542148 (0.0010) [2023-12-26 03:56:45,421][123090] Updated weights for policy 1, policy_version 542158 (0.0010) [2023-12-26 03:56:45,424][123091] Updated weights for policy 0, policy_version 546256 (0.0007) [2023-12-26 03:56:45,476][123090] Updated weights for policy 1, policy_version 542168 (0.0005) [2023-12-26 03:56:46,270][123091] Updated weights for policy 0, policy_version 546266 (0.0011) [2023-12-26 03:56:46,273][123090] Updated weights for policy 1, policy_version 542178 (0.0006) [2023-12-26 03:56:46,329][123090] Updated weights for policy 1, policy_version 542188 (0.0010) [2023-12-26 03:56:46,330][123091] Updated weights for policy 0, policy_version 546276 (0.0010) [2023-12-26 03:56:46,388][123090] Updated weights for policy 1, policy_version 542198 (0.0011) [2023-12-26 03:56:46,396][123091] Updated weights for policy 0, policy_version 546286 (0.0011) [2023-12-26 03:56:46,450][123090] Updated weights for policy 1, policy_version 542208 (0.0010) [2023-12-26 03:56:47,212][123091] Updated weights for policy 0, policy_version 546296 (0.0011) [2023-12-26 03:56:47,257][123090] Updated weights for policy 1, policy_version 542218 (0.0005) [2023-12-26 03:56:47,268][123091] Updated weights for policy 0, policy_version 546306 (0.0011) [2023-12-26 03:56:47,313][123090] Updated weights for policy 1, policy_version 542228 (0.0006) [2023-12-26 03:56:47,328][123091] Updated weights for policy 0, policy_version 546316 (0.0011) [2023-12-26 03:56:47,368][123090] Updated weights for policy 1, policy_version 542238 (0.0010) [2023-12-26 03:56:48,110][123091] Updated weights for policy 0, policy_version 546326 (0.0007) [2023-12-26 03:56:48,166][123090] Updated weights for policy 1, policy_version 542248 (0.0010) [2023-12-26 03:56:48,174][123091] Updated weights for policy 0, policy_version 546336 (0.0005) [2023-12-26 03:56:48,217][123090] Updated weights for policy 1, policy_version 542258 (0.0010) [2023-12-26 03:56:48,226][123091] Updated weights for policy 0, policy_version 546346 (0.0006) [2023-12-26 03:56:48,280][123090] Updated weights for policy 1, policy_version 542268 (0.0010) [2023-12-26 03:56:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 278691840. Throughput: 0: 8853.9, 1: 8590.9. Samples: 278705088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:48,785][121949] Avg episode reward: [(0, '6201.577'), (1, '5540.643')] [2023-12-26 03:56:48,899][123091] Updated weights for policy 0, policy_version 546356 (0.0006) [2023-12-26 03:56:48,969][123091] Updated weights for policy 0, policy_version 546366 (0.0006) [2023-12-26 03:56:49,026][123091] Updated weights for policy 0, policy_version 546376 (0.0009) [2023-12-26 03:56:49,123][123090] Updated weights for policy 1, policy_version 542278 (0.0011) [2023-12-26 03:56:49,185][123090] Updated weights for policy 1, policy_version 542288 (0.0010) [2023-12-26 03:56:49,256][123090] Updated weights for policy 1, policy_version 542298 (0.0011) [2023-12-26 03:56:49,837][123091] Updated weights for policy 0, policy_version 546386 (0.0009) [2023-12-26 03:56:49,908][123091] Updated weights for policy 0, policy_version 546396 (0.0008) [2023-12-26 03:56:49,979][123091] Updated weights for policy 0, policy_version 546406 (0.0009) [2023-12-26 03:56:50,047][123091] Updated weights for policy 0, policy_version 546416 (0.0009) [2023-12-26 03:56:50,055][123090] Updated weights for policy 1, policy_version 542308 (0.0010) [2023-12-26 03:56:50,107][123090] Updated weights for policy 1, policy_version 542318 (0.0010) [2023-12-26 03:56:50,169][123090] Updated weights for policy 1, policy_version 542328 (0.0010) [2023-12-26 03:56:50,755][123091] Updated weights for policy 0, policy_version 546426 (0.0007) [2023-12-26 03:56:50,825][123091] Updated weights for policy 0, policy_version 546436 (0.0009) [2023-12-26 03:56:50,887][123091] Updated weights for policy 0, policy_version 546446 (0.0009) [2023-12-26 03:56:51,034][123090] Updated weights for policy 1, policy_version 542338 (0.0010) [2023-12-26 03:56:51,106][123090] Updated weights for policy 1, policy_version 542348 (0.0011) [2023-12-26 03:56:51,181][123090] Updated weights for policy 1, policy_version 542358 (0.0008) [2023-12-26 03:56:51,251][123090] Updated weights for policy 1, policy_version 542368 (0.0008) [2023-12-26 03:56:51,795][123091] Updated weights for policy 0, policy_version 546456 (0.0009) [2023-12-26 03:56:51,855][123091] Updated weights for policy 0, policy_version 546466 (0.0009) [2023-12-26 03:56:51,911][123091] Updated weights for policy 0, policy_version 546476 (0.0010) [2023-12-26 03:56:52,046][123090] Updated weights for policy 1, policy_version 542378 (0.0009) [2023-12-26 03:56:52,121][123090] Updated weights for policy 1, policy_version 542388 (0.0006) [2023-12-26 03:56:52,201][123090] Updated weights for policy 1, policy_version 542398 (0.0008) [2023-12-26 03:56:52,706][123091] Updated weights for policy 0, policy_version 546486 (0.0010) [2023-12-26 03:56:52,772][123091] Updated weights for policy 0, policy_version 546496 (0.0010) [2023-12-26 03:56:52,836][123091] Updated weights for policy 0, policy_version 546506 (0.0009) [2023-12-26 03:56:52,951][123090] Updated weights for policy 1, policy_version 542408 (0.0007) [2023-12-26 03:56:53,005][123090] Updated weights for policy 1, policy_version 542418 (0.0009) [2023-12-26 03:56:53,058][123090] Updated weights for policy 1, policy_version 542428 (0.0011) [2023-12-26 03:56:53,729][123091] Updated weights for policy 0, policy_version 546516 (0.0008) [2023-12-26 03:56:53,768][123090] Updated weights for policy 1, policy_version 542438 (0.0007) [2023-12-26 03:56:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 278773760. Throughput: 0: 8816.0, 1: 8597.4. Samples: 278756996. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:53,785][121949] Avg episode reward: [(0, '6103.998'), (1, '5524.147')] [2023-12-26 03:56:53,798][123091] Updated weights for policy 0, policy_version 546526 (0.0006) [2023-12-26 03:56:53,831][123090] Updated weights for policy 1, policy_version 542448 (0.0008) [2023-12-26 03:56:53,858][123091] Updated weights for policy 0, policy_version 546536 (0.0009) [2023-12-26 03:56:53,895][123090] Updated weights for policy 1, policy_version 542458 (0.0009) [2023-12-26 03:56:53,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000546544_139919360.pth... [2023-12-26 03:56:53,911][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000545520_139657216.pth [2023-12-26 03:56:53,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000542464_138870784.pth... [2023-12-26 03:56:53,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000541408_138600448.pth [2023-12-26 03:56:54,553][123090] Updated weights for policy 1, policy_version 542468 (0.0010) [2023-12-26 03:56:54,602][123090] Updated weights for policy 1, policy_version 542478 (0.0011) [2023-12-26 03:56:54,636][123091] Updated weights for policy 0, policy_version 546546 (0.0009) [2023-12-26 03:56:54,651][123090] Updated weights for policy 1, policy_version 542488 (0.0010) [2023-12-26 03:56:54,691][123091] Updated weights for policy 0, policy_version 546556 (0.0010) [2023-12-26 03:56:54,757][123091] Updated weights for policy 0, policy_version 546566 (0.0011) [2023-12-26 03:56:54,820][123091] Updated weights for policy 0, policy_version 546576 (0.0011) [2023-12-26 03:56:55,450][123090] Updated weights for policy 1, policy_version 542498 (0.0009) [2023-12-26 03:56:55,503][123090] Updated weights for policy 1, policy_version 542508 (0.0005) [2023-12-26 03:56:55,554][123090] Updated weights for policy 1, policy_version 542518 (0.0005) [2023-12-26 03:56:55,608][123090] Updated weights for policy 1, policy_version 542528 (0.0005) [2023-12-26 03:56:55,634][123091] Updated weights for policy 0, policy_version 546586 (0.0006) [2023-12-26 03:56:55,681][123091] Updated weights for policy 0, policy_version 546596 (0.0005) [2023-12-26 03:56:55,729][123091] Updated weights for policy 0, policy_version 546606 (0.0005) [2023-12-26 03:56:56,334][123090] Updated weights for policy 1, policy_version 542538 (0.0009) [2023-12-26 03:56:56,398][123090] Updated weights for policy 1, policy_version 542548 (0.0008) [2023-12-26 03:56:56,427][123091] Updated weights for policy 0, policy_version 546616 (0.0009) [2023-12-26 03:56:56,460][123090] Updated weights for policy 1, policy_version 542558 (0.0011) [2023-12-26 03:56:56,492][123091] Updated weights for policy 0, policy_version 546626 (0.0011) [2023-12-26 03:56:56,561][123091] Updated weights for policy 0, policy_version 546636 (0.0011) [2023-12-26 03:56:57,259][123091] Updated weights for policy 0, policy_version 546646 (0.0006) [2023-12-26 03:56:57,267][123090] Updated weights for policy 1, policy_version 542568 (0.0010) [2023-12-26 03:56:57,321][123090] Updated weights for policy 1, policy_version 542578 (0.0010) [2023-12-26 03:56:57,323][123091] Updated weights for policy 0, policy_version 546656 (0.0007) [2023-12-26 03:56:57,380][123090] Updated weights for policy 1, policy_version 542588 (0.0010) [2023-12-26 03:56:57,383][123091] Updated weights for policy 0, policy_version 546666 (0.0006) [2023-12-26 03:56:58,152][123091] Updated weights for policy 0, policy_version 546676 (0.0008) [2023-12-26 03:56:58,201][123090] Updated weights for policy 1, policy_version 542598 (0.0010) [2023-12-26 03:56:58,211][123091] Updated weights for policy 0, policy_version 546686 (0.0008) [2023-12-26 03:56:58,269][123090] Updated weights for policy 1, policy_version 542608 (0.0010) [2023-12-26 03:56:58,272][123091] Updated weights for policy 0, policy_version 546696 (0.0007) [2023-12-26 03:56:58,334][123090] Updated weights for policy 1, policy_version 542618 (0.0011) [2023-12-26 03:56:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 278872064. Throughput: 0: 8826.4, 1: 8737.7. Samples: 278865996. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:56:58,785][121949] Avg episode reward: [(0, '6167.100'), (1, '5640.422')] [2023-12-26 03:56:59,025][123091] Updated weights for policy 0, policy_version 546706 (0.0008) [2023-12-26 03:56:59,070][123091] Updated weights for policy 0, policy_version 546716 (0.0005) [2023-12-26 03:56:59,129][123091] Updated weights for policy 0, policy_version 546726 (0.0008) [2023-12-26 03:56:59,189][123091] Updated weights for policy 0, policy_version 546736 (0.0009) [2023-12-26 03:56:59,213][123090] Updated weights for policy 1, policy_version 542628 (0.0009) [2023-12-26 03:56:59,275][123090] Updated weights for policy 1, policy_version 542638 (0.0010) [2023-12-26 03:56:59,333][123090] Updated weights for policy 1, policy_version 542648 (0.0008) [2023-12-26 03:57:00,051][123091] Updated weights for policy 0, policy_version 546746 (0.0009) [2023-12-26 03:57:00,070][123090] Updated weights for policy 1, policy_version 542658 (0.0010) [2023-12-26 03:57:00,107][123091] Updated weights for policy 0, policy_version 546756 (0.0007) [2023-12-26 03:57:00,130][123090] Updated weights for policy 1, policy_version 542668 (0.0011) [2023-12-26 03:57:00,168][123091] Updated weights for policy 0, policy_version 546766 (0.0008) [2023-12-26 03:57:00,190][123090] Updated weights for policy 1, policy_version 542678 (0.0005) [2023-12-26 03:57:00,260][123090] Updated weights for policy 1, policy_version 542688 (0.0009) [2023-12-26 03:57:00,999][123091] Updated weights for policy 0, policy_version 546776 (0.0007) [2023-12-26 03:57:01,056][123090] Updated weights for policy 1, policy_version 542698 (0.0010) [2023-12-26 03:57:01,063][123091] Updated weights for policy 0, policy_version 546786 (0.0011) [2023-12-26 03:57:01,118][123091] Updated weights for policy 0, policy_version 546796 (0.0010) [2023-12-26 03:57:01,123][123090] Updated weights for policy 1, policy_version 542708 (0.0011) [2023-12-26 03:57:01,190][123090] Updated weights for policy 1, policy_version 542718 (0.0011) [2023-12-26 03:57:01,852][123091] Updated weights for policy 0, policy_version 546806 (0.0008) [2023-12-26 03:57:01,908][123091] Updated weights for policy 0, policy_version 546816 (0.0006) [2023-12-26 03:57:01,963][123091] Updated weights for policy 0, policy_version 546826 (0.0008) [2023-12-26 03:57:02,008][123090] Updated weights for policy 1, policy_version 542728 (0.0010) [2023-12-26 03:57:02,071][123090] Updated weights for policy 1, policy_version 542738 (0.0010) [2023-12-26 03:57:02,122][123090] Updated weights for policy 1, policy_version 542748 (0.0010) [2023-12-26 03:57:02,742][123091] Updated weights for policy 0, policy_version 546836 (0.0007) [2023-12-26 03:57:02,797][123091] Updated weights for policy 0, policy_version 546846 (0.0006) [2023-12-26 03:57:02,857][123091] Updated weights for policy 0, policy_version 546856 (0.0005) [2023-12-26 03:57:02,969][123090] Updated weights for policy 1, policy_version 542758 (0.0009) [2023-12-26 03:57:03,039][123090] Updated weights for policy 1, policy_version 542768 (0.0005) [2023-12-26 03:57:03,111][123090] Updated weights for policy 1, policy_version 542778 (0.0005) [2023-12-26 03:57:03,672][123091] Updated weights for policy 0, policy_version 546866 (0.0006) [2023-12-26 03:57:03,679][123090] Updated weights for policy 1, policy_version 542788 (0.0006) [2023-12-26 03:57:03,725][123091] Updated weights for policy 0, policy_version 546876 (0.0009) [2023-12-26 03:57:03,739][123090] Updated weights for policy 1, policy_version 542798 (0.0008) [2023-12-26 03:57:03,776][123091] Updated weights for policy 0, policy_version 546886 (0.0006) [2023-12-26 03:57:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 278953984. Throughput: 0: 8748.5, 1: 8858.6. Samples: 278973248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:03,784][121949] Avg episode reward: [(0, '6157.500'), (1, '5748.542')] [2023-12-26 03:57:03,799][123090] Updated weights for policy 1, policy_version 542808 (0.0010) [2023-12-26 03:57:03,827][123091] Updated weights for policy 0, policy_version 546896 (0.0007) [2023-12-26 03:57:04,569][123090] Updated weights for policy 1, policy_version 542818 (0.0007) [2023-12-26 03:57:04,618][123090] Updated weights for policy 1, policy_version 542828 (0.0008) [2023-12-26 03:57:04,666][123090] Updated weights for policy 1, policy_version 542838 (0.0009) [2023-12-26 03:57:04,690][123091] Updated weights for policy 0, policy_version 546906 (0.0008) [2023-12-26 03:57:04,716][123090] Updated weights for policy 1, policy_version 542848 (0.0008) [2023-12-26 03:57:04,745][123091] Updated weights for policy 0, policy_version 546916 (0.0008) [2023-12-26 03:57:04,809][123091] Updated weights for policy 0, policy_version 546926 (0.0010) [2023-12-26 03:57:05,567][123090] Updated weights for policy 1, policy_version 542858 (0.0005) [2023-12-26 03:57:05,631][123090] Updated weights for policy 1, policy_version 542868 (0.0009) [2023-12-26 03:57:05,641][123091] Updated weights for policy 0, policy_version 546936 (0.0008) [2023-12-26 03:57:05,692][123090] Updated weights for policy 1, policy_version 542878 (0.0009) [2023-12-26 03:57:05,701][123091] Updated weights for policy 0, policy_version 546946 (0.0008) [2023-12-26 03:57:05,765][123091] Updated weights for policy 0, policy_version 546956 (0.0010) [2023-12-26 03:57:06,447][123090] Updated weights for policy 1, policy_version 542888 (0.0006) [2023-12-26 03:57:06,524][123090] Updated weights for policy 1, policy_version 542898 (0.0006) [2023-12-26 03:57:06,599][123090] Updated weights for policy 1, policy_version 542908 (0.0006) [2023-12-26 03:57:06,616][123091] Updated weights for policy 0, policy_version 546966 (0.0009) [2023-12-26 03:57:06,689][123091] Updated weights for policy 0, policy_version 546976 (0.0010) [2023-12-26 03:57:06,760][123091] Updated weights for policy 0, policy_version 546986 (0.0009) [2023-12-26 03:57:07,421][123090] Updated weights for policy 1, policy_version 542918 (0.0008) [2023-12-26 03:57:07,464][123091] Updated weights for policy 0, policy_version 546996 (0.0010) [2023-12-26 03:57:07,489][123090] Updated weights for policy 1, policy_version 542928 (0.0009) [2023-12-26 03:57:07,519][123091] Updated weights for policy 0, policy_version 547006 (0.0006) [2023-12-26 03:57:07,551][123090] Updated weights for policy 1, policy_version 542938 (0.0010) [2023-12-26 03:57:07,569][123091] Updated weights for policy 0, policy_version 547016 (0.0007) [2023-12-26 03:57:08,240][123091] Updated weights for policy 0, policy_version 547026 (0.0006) [2023-12-26 03:57:08,260][123090] Updated weights for policy 1, policy_version 542948 (0.0008) [2023-12-26 03:57:08,299][123091] Updated weights for policy 0, policy_version 547036 (0.0008) [2023-12-26 03:57:08,316][123090] Updated weights for policy 1, policy_version 542958 (0.0010) [2023-12-26 03:57:08,362][123091] Updated weights for policy 0, policy_version 547046 (0.0010) [2023-12-26 03:57:08,379][123090] Updated weights for policy 1, policy_version 542968 (0.0007) [2023-12-26 03:57:08,428][123091] Updated weights for policy 0, policy_version 547056 (0.0008) [2023-12-26 03:57:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 279052288. Throughput: 0: 8754.3, 1: 8914.3. Samples: 279025372. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:08,785][121949] Avg episode reward: [(0, '6153.381'), (1, '5749.247')] [2023-12-26 03:57:08,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000542976_139001856.pth... [2023-12-26 03:57:08,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000547056_140050432.pth... [2023-12-26 03:57:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000541952_138739712.pth [2023-12-26 03:57:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000546032_139788288.pth [2023-12-26 03:57:09,129][123091] Updated weights for policy 0, policy_version 547066 (0.0009) [2023-12-26 03:57:09,184][123091] Updated weights for policy 0, policy_version 547076 (0.0008) [2023-12-26 03:57:09,194][123090] Updated weights for policy 1, policy_version 542978 (0.0008) [2023-12-26 03:57:09,244][123091] Updated weights for policy 0, policy_version 547086 (0.0008) [2023-12-26 03:57:09,263][123090] Updated weights for policy 1, policy_version 542988 (0.0008) [2023-12-26 03:57:09,329][123090] Updated weights for policy 1, policy_version 542998 (0.0008) [2023-12-26 03:57:09,403][123090] Updated weights for policy 1, policy_version 543008 (0.0008) [2023-12-26 03:57:10,093][123091] Updated weights for policy 0, policy_version 547096 (0.0008) [2023-12-26 03:57:10,159][123091] Updated weights for policy 0, policy_version 547106 (0.0008) [2023-12-26 03:57:10,214][123090] Updated weights for policy 1, policy_version 543018 (0.0009) [2023-12-26 03:57:10,222][123091] Updated weights for policy 0, policy_version 547116 (0.0008) [2023-12-26 03:57:10,278][123090] Updated weights for policy 1, policy_version 543028 (0.0010) [2023-12-26 03:57:10,343][123090] Updated weights for policy 1, policy_version 543038 (0.0009) [2023-12-26 03:57:11,044][123091] Updated weights for policy 0, policy_version 547126 (0.0009) [2023-12-26 03:57:11,111][123091] Updated weights for policy 0, policy_version 547136 (0.0010) [2023-12-26 03:57:11,151][123090] Updated weights for policy 1, policy_version 543048 (0.0008) [2023-12-26 03:57:11,178][123091] Updated weights for policy 0, policy_version 547146 (0.0009) [2023-12-26 03:57:11,215][123090] Updated weights for policy 1, policy_version 543058 (0.0008) [2023-12-26 03:57:11,281][123090] Updated weights for policy 1, policy_version 543068 (0.0010) [2023-12-26 03:57:12,057][123091] Updated weights for policy 0, policy_version 547156 (0.0008) [2023-12-26 03:57:12,112][123091] Updated weights for policy 0, policy_version 547166 (0.0010) [2023-12-26 03:57:12,135][123090] Updated weights for policy 1, policy_version 543078 (0.0009) [2023-12-26 03:57:12,166][123091] Updated weights for policy 0, policy_version 547176 (0.0008) [2023-12-26 03:57:12,186][123090] Updated weights for policy 1, policy_version 543088 (0.0009) [2023-12-26 03:57:12,239][123090] Updated weights for policy 1, policy_version 543098 (0.0009) [2023-12-26 03:57:13,023][123091] Updated weights for policy 0, policy_version 547186 (0.0008) [2023-12-26 03:57:13,070][123091] Updated weights for policy 0, policy_version 547196 (0.0009) [2023-12-26 03:57:13,112][123090] Updated weights for policy 1, policy_version 543108 (0.0009) [2023-12-26 03:57:13,115][123091] Updated weights for policy 0, policy_version 547206 (0.0007) [2023-12-26 03:57:13,158][123091] Updated weights for policy 0, policy_version 547216 (0.0007) [2023-12-26 03:57:13,168][123090] Updated weights for policy 1, policy_version 543118 (0.0010) [2023-12-26 03:57:13,231][123090] Updated weights for policy 1, policy_version 543128 (0.0010) [2023-12-26 03:57:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 279134208. Throughput: 0: 8748.5, 1: 8917.8. Samples: 279129024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:13,784][121949] Avg episode reward: [(0, '6193.447'), (1, '5728.023')] [2023-12-26 03:57:13,976][123090] Updated weights for policy 1, policy_version 543138 (0.0010) [2023-12-26 03:57:14,026][123090] Updated weights for policy 1, policy_version 543148 (0.0008) [2023-12-26 03:57:14,047][123091] Updated weights for policy 0, policy_version 547226 (0.0010) [2023-12-26 03:57:14,088][123090] Updated weights for policy 1, policy_version 543158 (0.0008) [2023-12-26 03:57:14,099][123091] Updated weights for policy 0, policy_version 547236 (0.0008) [2023-12-26 03:57:14,147][123091] Updated weights for policy 0, policy_version 547246 (0.0009) [2023-12-26 03:57:14,152][123090] Updated weights for policy 1, policy_version 543168 (0.0008) [2023-12-26 03:57:14,926][123090] Updated weights for policy 1, policy_version 543178 (0.0008) [2023-12-26 03:57:14,986][123090] Updated weights for policy 1, policy_version 543188 (0.0010) [2023-12-26 03:57:15,056][123090] Updated weights for policy 1, policy_version 543198 (0.0011) [2023-12-26 03:57:15,063][123091] Updated weights for policy 0, policy_version 547256 (0.0007) [2023-12-26 03:57:15,128][123091] Updated weights for policy 0, policy_version 547266 (0.0009) [2023-12-26 03:57:15,193][123091] Updated weights for policy 0, policy_version 547276 (0.0009) [2023-12-26 03:57:15,883][123090] Updated weights for policy 1, policy_version 543208 (0.0007) [2023-12-26 03:57:15,935][123090] Updated weights for policy 1, policy_version 543218 (0.0006) [2023-12-26 03:57:15,994][123090] Updated weights for policy 1, policy_version 543228 (0.0009) [2023-12-26 03:57:16,026][123091] Updated weights for policy 0, policy_version 547286 (0.0008) [2023-12-26 03:57:16,075][123091] Updated weights for policy 0, policy_version 547296 (0.0005) [2023-12-26 03:57:16,133][123091] Updated weights for policy 0, policy_version 547306 (0.0005) [2023-12-26 03:57:16,659][123090] Updated weights for policy 1, policy_version 543238 (0.0009) [2023-12-26 03:57:16,716][123090] Updated weights for policy 1, policy_version 543248 (0.0009) [2023-12-26 03:57:16,778][123090] Updated weights for policy 1, policy_version 543258 (0.0010) [2023-12-26 03:57:16,852][123091] Updated weights for policy 0, policy_version 547316 (0.0007) [2023-12-26 03:57:16,904][123091] Updated weights for policy 0, policy_version 547326 (0.0007) [2023-12-26 03:57:16,955][123091] Updated weights for policy 0, policy_version 547336 (0.0005) [2023-12-26 03:57:17,617][123090] Updated weights for policy 1, policy_version 543268 (0.0010) [2023-12-26 03:57:17,671][123090] Updated weights for policy 1, policy_version 543278 (0.0009) [2023-12-26 03:57:17,730][123090] Updated weights for policy 1, policy_version 543288 (0.0009) [2023-12-26 03:57:17,751][123091] Updated weights for policy 0, policy_version 547346 (0.0005) [2023-12-26 03:57:17,812][123091] Updated weights for policy 0, policy_version 547356 (0.0009) [2023-12-26 03:57:17,868][123091] Updated weights for policy 0, policy_version 547366 (0.0009) [2023-12-26 03:57:17,936][123091] Updated weights for policy 0, policy_version 547376 (0.0010) [2023-12-26 03:57:18,528][123090] Updated weights for policy 1, policy_version 543298 (0.0008) [2023-12-26 03:57:18,584][123090] Updated weights for policy 1, policy_version 543308 (0.0009) [2023-12-26 03:57:18,637][123090] Updated weights for policy 1, policy_version 543318 (0.0009) [2023-12-26 03:57:18,692][123090] Updated weights for policy 1, policy_version 543328 (0.0006) [2023-12-26 03:57:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 279224320. Throughput: 0: 8749.3, 1: 8948.2. Samples: 279235920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:18,785][121949] Avg episode reward: [(0, '6250.136'), (1, '5712.040')] [2023-12-26 03:57:18,809][123091] Updated weights for policy 0, policy_version 547386 (0.0008) [2023-12-26 03:57:18,872][123091] Updated weights for policy 0, policy_version 547396 (0.0009) [2023-12-26 03:57:18,937][123091] Updated weights for policy 0, policy_version 547406 (0.0010) [2023-12-26 03:57:19,318][123090] Updated weights for policy 1, policy_version 543338 (0.0008) [2023-12-26 03:57:19,385][123090] Updated weights for policy 1, policy_version 543348 (0.0009) [2023-12-26 03:57:19,434][123090] Updated weights for policy 1, policy_version 543358 (0.0007) [2023-12-26 03:57:19,757][123091] Updated weights for policy 0, policy_version 547416 (0.0008) [2023-12-26 03:57:19,826][123091] Updated weights for policy 0, policy_version 547426 (0.0008) [2023-12-26 03:57:19,900][123091] Updated weights for policy 0, policy_version 547436 (0.0008) [2023-12-26 03:57:20,309][123090] Updated weights for policy 1, policy_version 543368 (0.0009) [2023-12-26 03:57:20,360][123090] Updated weights for policy 1, policy_version 543378 (0.0008) [2023-12-26 03:57:20,413][123090] Updated weights for policy 1, policy_version 543389 (0.0009) [2023-12-26 03:57:20,669][123091] Updated weights for policy 0, policy_version 547446 (0.0009) [2023-12-26 03:57:20,737][123091] Updated weights for policy 0, policy_version 547456 (0.0010) [2023-12-26 03:57:20,810][123091] Updated weights for policy 0, policy_version 547466 (0.0010) [2023-12-26 03:57:21,252][123090] Updated weights for policy 1, policy_version 543399 (0.0007) [2023-12-26 03:57:21,324][123090] Updated weights for policy 1, policy_version 543409 (0.0008) [2023-12-26 03:57:21,394][123090] Updated weights for policy 1, policy_version 543419 (0.0009) [2023-12-26 03:57:21,683][123091] Updated weights for policy 0, policy_version 547476 (0.0009) [2023-12-26 03:57:21,752][123091] Updated weights for policy 0, policy_version 547486 (0.0009) [2023-12-26 03:57:21,819][123091] Updated weights for policy 0, policy_version 547496 (0.0009) [2023-12-26 03:57:22,247][123090] Updated weights for policy 1, policy_version 543429 (0.0009) [2023-12-26 03:57:22,315][123090] Updated weights for policy 1, policy_version 543439 (0.0009) [2023-12-26 03:57:22,384][123090] Updated weights for policy 1, policy_version 543449 (0.0007) [2023-12-26 03:57:22,675][123091] Updated weights for policy 0, policy_version 547506 (0.0010) [2023-12-26 03:57:22,741][123091] Updated weights for policy 0, policy_version 547516 (0.0010) [2023-12-26 03:57:22,803][123091] Updated weights for policy 0, policy_version 547526 (0.0009) [2023-12-26 03:57:22,871][123091] Updated weights for policy 0, policy_version 547536 (0.0009) [2023-12-26 03:57:23,165][123090] Updated weights for policy 1, policy_version 543459 (0.0007) [2023-12-26 03:57:23,230][123090] Updated weights for policy 1, policy_version 543469 (0.0011) [2023-12-26 03:57:23,298][123090] Updated weights for policy 1, policy_version 543479 (0.0011) [2023-12-26 03:57:23,640][123091] Updated weights for policy 0, policy_version 547546 (0.0009) [2023-12-26 03:57:23,699][123091] Updated weights for policy 0, policy_version 547557 (0.0010) [2023-12-26 03:57:23,748][123091] Updated weights for policy 0, policy_version 547567 (0.0009) [2023-12-26 03:57:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 279314432. Throughput: 0: 8702.8, 1: 8918.8. Samples: 279287204. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:23,785][121949] Avg episode reward: [(0, '6295.311'), (1, '5738.643')] [2023-12-26 03:57:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000547568_140181504.pth... [2023-12-26 03:57:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000543488_139132928.pth... [2023-12-26 03:57:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000546544_139919360.pth [2023-12-26 03:57:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000542464_138870784.pth [2023-12-26 03:57:24,100][123090] Updated weights for policy 1, policy_version 543489 (0.0010) [2023-12-26 03:57:24,163][123090] Updated weights for policy 1, policy_version 543499 (0.0010) [2023-12-26 03:57:24,215][123090] Updated weights for policy 1, policy_version 543509 (0.0008) [2023-12-26 03:57:24,265][123090] Updated weights for policy 1, policy_version 543519 (0.0006) [2023-12-26 03:57:24,593][123091] Updated weights for policy 0, policy_version 547577 (0.0008) [2023-12-26 03:57:24,653][123091] Updated weights for policy 0, policy_version 547587 (0.0009) [2023-12-26 03:57:24,711][123091] Updated weights for policy 0, policy_version 547597 (0.0009) [2023-12-26 03:57:25,107][123090] Updated weights for policy 1, policy_version 543529 (0.0005) [2023-12-26 03:57:25,178][123090] Updated weights for policy 1, policy_version 543539 (0.0006) [2023-12-26 03:57:25,240][123090] Updated weights for policy 1, policy_version 543549 (0.0010) [2023-12-26 03:57:25,578][123091] Updated weights for policy 0, policy_version 547607 (0.0008) [2023-12-26 03:57:25,635][123091] Updated weights for policy 0, policy_version 547617 (0.0010) [2023-12-26 03:57:25,693][123091] Updated weights for policy 0, policy_version 547627 (0.0010) [2023-12-26 03:57:25,890][123090] Updated weights for policy 1, policy_version 543559 (0.0005) [2023-12-26 03:57:25,954][123090] Updated weights for policy 1, policy_version 543569 (0.0005) [2023-12-26 03:57:26,010][123090] Updated weights for policy 1, policy_version 543579 (0.0005) [2023-12-26 03:57:26,588][123091] Updated weights for policy 0, policy_version 547637 (0.0008) [2023-12-26 03:57:26,641][123090] Updated weights for policy 1, policy_version 543589 (0.0006) [2023-12-26 03:57:26,642][123091] Updated weights for policy 0, policy_version 547647 (0.0005) [2023-12-26 03:57:26,694][123091] Updated weights for policy 0, policy_version 547657 (0.0006) [2023-12-26 03:57:26,699][123090] Updated weights for policy 1, policy_version 543599 (0.0006) [2023-12-26 03:57:26,758][123090] Updated weights for policy 1, policy_version 543609 (0.0006) [2023-12-26 03:57:27,411][123090] Updated weights for policy 1, policy_version 543619 (0.0005) [2023-12-26 03:57:27,416][123091] Updated weights for policy 0, policy_version 547667 (0.0006) [2023-12-26 03:57:27,464][123090] Updated weights for policy 1, policy_version 543629 (0.0006) [2023-12-26 03:57:27,469][123091] Updated weights for policy 0, policy_version 547677 (0.0005) [2023-12-26 03:57:27,518][123090] Updated weights for policy 1, policy_version 543639 (0.0005) [2023-12-26 03:57:27,524][123091] Updated weights for policy 0, policy_version 547687 (0.0005) [2023-12-26 03:57:28,164][123090] Updated weights for policy 1, policy_version 543649 (0.0005) [2023-12-26 03:57:28,192][123091] Updated weights for policy 0, policy_version 547697 (0.0006) [2023-12-26 03:57:28,234][123090] Updated weights for policy 1, policy_version 543659 (0.0006) [2023-12-26 03:57:28,253][123091] Updated weights for policy 0, policy_version 547707 (0.0006) [2023-12-26 03:57:28,298][123090] Updated weights for policy 1, policy_version 543669 (0.0005) [2023-12-26 03:57:28,305][123091] Updated weights for policy 0, policy_version 547717 (0.0005) [2023-12-26 03:57:28,364][123090] Updated weights for policy 1, policy_version 543679 (0.0008) [2023-12-26 03:57:28,365][123091] Updated weights for policy 0, policy_version 547727 (0.0007) [2023-12-26 03:57:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 279404544. Throughput: 0: 8689.0, 1: 8970.4. Samples: 279395060. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:28,785][121949] Avg episode reward: [(0, '6266.108'), (1, '5892.658')] [2023-12-26 03:57:29,063][123090] Updated weights for policy 1, policy_version 543689 (0.0009) [2023-12-26 03:57:29,118][123090] Updated weights for policy 1, policy_version 543699 (0.0008) [2023-12-26 03:57:29,124][123091] Updated weights for policy 0, policy_version 547737 (0.0006) [2023-12-26 03:57:29,177][123091] Updated weights for policy 0, policy_version 547747 (0.0005) [2023-12-26 03:57:29,180][123090] Updated weights for policy 1, policy_version 543709 (0.0009) [2023-12-26 03:57:29,236][123091] Updated weights for policy 0, policy_version 547757 (0.0006) [2023-12-26 03:57:29,981][123090] Updated weights for policy 1, policy_version 543719 (0.0009) [2023-12-26 03:57:30,038][123090] Updated weights for policy 1, policy_version 543729 (0.0009) [2023-12-26 03:57:30,073][123091] Updated weights for policy 0, policy_version 547767 (0.0008) [2023-12-26 03:57:30,090][123090] Updated weights for policy 1, policy_version 543739 (0.0009) [2023-12-26 03:57:30,134][123091] Updated weights for policy 0, policy_version 547777 (0.0009) [2023-12-26 03:57:30,193][123091] Updated weights for policy 0, policy_version 547787 (0.0010) [2023-12-26 03:57:30,901][123090] Updated weights for policy 1, policy_version 543749 (0.0009) [2023-12-26 03:57:30,966][123090] Updated weights for policy 1, policy_version 543759 (0.0008) [2023-12-26 03:57:31,008][123091] Updated weights for policy 0, policy_version 547797 (0.0008) [2023-12-26 03:57:31,036][123090] Updated weights for policy 1, policy_version 543769 (0.0006) [2023-12-26 03:57:31,074][123091] Updated weights for policy 0, policy_version 547807 (0.0008) [2023-12-26 03:57:31,146][123091] Updated weights for policy 0, policy_version 547817 (0.0008) [2023-12-26 03:57:31,805][123090] Updated weights for policy 1, policy_version 543779 (0.0007) [2023-12-26 03:57:31,881][123090] Updated weights for policy 1, policy_version 543789 (0.0006) [2023-12-26 03:57:31,882][123091] Updated weights for policy 0, policy_version 547827 (0.0006) [2023-12-26 03:57:31,935][123090] Updated weights for policy 1, policy_version 543799 (0.0005) [2023-12-26 03:57:31,943][123091] Updated weights for policy 0, policy_version 547837 (0.0009) [2023-12-26 03:57:32,010][123091] Updated weights for policy 0, policy_version 547847 (0.0009) [2023-12-26 03:57:32,637][123090] Updated weights for policy 1, policy_version 543809 (0.0006) [2023-12-26 03:57:32,701][123090] Updated weights for policy 1, policy_version 543819 (0.0009) [2023-12-26 03:57:32,702][123091] Updated weights for policy 0, policy_version 547857 (0.0009) [2023-12-26 03:57:32,756][123091] Updated weights for policy 0, policy_version 547867 (0.0005) [2023-12-26 03:57:32,765][123090] Updated weights for policy 1, policy_version 543829 (0.0008) [2023-12-26 03:57:32,806][123091] Updated weights for policy 0, policy_version 547877 (0.0005) [2023-12-26 03:57:32,826][123090] Updated weights for policy 1, policy_version 543839 (0.0009) [2023-12-26 03:57:32,867][123091] Updated weights for policy 0, policy_version 547887 (0.0005) [2023-12-26 03:57:33,623][123091] Updated weights for policy 0, policy_version 547897 (0.0008) [2023-12-26 03:57:33,661][123090] Updated weights for policy 1, policy_version 543849 (0.0007) [2023-12-26 03:57:33,682][123091] Updated weights for policy 0, policy_version 547907 (0.0010) [2023-12-26 03:57:33,711][123090] Updated weights for policy 1, policy_version 543859 (0.0006) [2023-12-26 03:57:33,739][123091] Updated weights for policy 0, policy_version 547917 (0.0009) [2023-12-26 03:57:33,767][123090] Updated weights for policy 1, policy_version 543869 (0.0008) [2023-12-26 03:57:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17661.4). Total num frames: 279502848. Throughput: 0: 8791.9, 1: 9002.1. Samples: 279505816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:33,784][121949] Avg episode reward: [(0, '6260.243'), (1, '5705.149')] [2023-12-26 03:57:34,556][123090] Updated weights for policy 1, policy_version 543879 (0.0007) [2023-12-26 03:57:34,596][123091] Updated weights for policy 0, policy_version 547927 (0.0006) [2023-12-26 03:57:34,627][123090] Updated weights for policy 1, policy_version 543889 (0.0008) [2023-12-26 03:57:34,658][123091] Updated weights for policy 0, policy_version 547937 (0.0006) [2023-12-26 03:57:34,695][123090] Updated weights for policy 1, policy_version 543899 (0.0010) [2023-12-26 03:57:34,717][123091] Updated weights for policy 0, policy_version 547947 (0.0005) [2023-12-26 03:57:35,385][123091] Updated weights for policy 0, policy_version 547957 (0.0005) [2023-12-26 03:57:35,447][123091] Updated weights for policy 0, policy_version 547967 (0.0005) [2023-12-26 03:57:35,453][123090] Updated weights for policy 1, policy_version 543909 (0.0008) [2023-12-26 03:57:35,507][123091] Updated weights for policy 0, policy_version 547977 (0.0005) [2023-12-26 03:57:35,517][123090] Updated weights for policy 1, policy_version 543919 (0.0005) [2023-12-26 03:57:35,578][123090] Updated weights for policy 1, policy_version 543929 (0.0005) [2023-12-26 03:57:36,212][123090] Updated weights for policy 1, policy_version 543939 (0.0005) [2023-12-26 03:57:36,269][123091] Updated weights for policy 0, policy_version 547987 (0.0009) [2023-12-26 03:57:36,281][123090] Updated weights for policy 1, policy_version 543949 (0.0006) [2023-12-26 03:57:36,325][123091] Updated weights for policy 0, policy_version 547997 (0.0011) [2023-12-26 03:57:36,338][123090] Updated weights for policy 1, policy_version 543959 (0.0006) [2023-12-26 03:57:36,376][123091] Updated weights for policy 0, policy_version 548007 (0.0005) [2023-12-26 03:57:37,077][123091] Updated weights for policy 0, policy_version 548017 (0.0006) [2023-12-26 03:57:37,086][123090] Updated weights for policy 1, policy_version 543969 (0.0010) [2023-12-26 03:57:37,142][123091] Updated weights for policy 0, policy_version 548027 (0.0005) [2023-12-26 03:57:37,157][123090] Updated weights for policy 1, policy_version 543979 (0.0008) [2023-12-26 03:57:37,204][123091] Updated weights for policy 0, policy_version 548037 (0.0006) [2023-12-26 03:57:37,219][123090] Updated weights for policy 1, policy_version 543989 (0.0008) [2023-12-26 03:57:37,260][123091] Updated weights for policy 0, policy_version 548047 (0.0007) [2023-12-26 03:57:37,267][123090] Updated weights for policy 1, policy_version 543999 (0.0009) [2023-12-26 03:57:38,023][123091] Updated weights for policy 0, policy_version 548057 (0.0008) [2023-12-26 03:57:38,027][123090] Updated weights for policy 1, policy_version 544009 (0.0009) [2023-12-26 03:57:38,076][123090] Updated weights for policy 1, policy_version 544019 (0.0009) [2023-12-26 03:57:38,087][123091] Updated weights for policy 0, policy_version 548067 (0.0005) [2023-12-26 03:57:38,125][123090] Updated weights for policy 1, policy_version 544029 (0.0008) [2023-12-26 03:57:38,148][123091] Updated weights for policy 0, policy_version 548077 (0.0005) [2023-12-26 03:57:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 279584768. Throughput: 0: 8827.8, 1: 9062.0. Samples: 279562036. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:38,785][121949] Avg episode reward: [(0, '6227.953'), (1, '5593.154')] [2023-12-26 03:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000548080_140312576.pth... [2023-12-26 03:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000544032_139272192.pth... [2023-12-26 03:57:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000542976_139001856.pth [2023-12-26 03:57:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000547056_140050432.pth [2023-12-26 03:57:38,882][123091] Updated weights for policy 0, policy_version 548087 (0.0008) [2023-12-26 03:57:38,941][123091] Updated weights for policy 0, policy_version 548097 (0.0010) [2023-12-26 03:57:39,007][123091] Updated weights for policy 0, policy_version 548107 (0.0010) [2023-12-26 03:57:39,019][123090] Updated weights for policy 1, policy_version 544039 (0.0008) [2023-12-26 03:57:39,078][123090] Updated weights for policy 1, policy_version 544049 (0.0009) [2023-12-26 03:57:39,137][123090] Updated weights for policy 1, policy_version 544059 (0.0009) [2023-12-26 03:57:39,814][123091] Updated weights for policy 0, policy_version 548117 (0.0010) [2023-12-26 03:57:39,893][123091] Updated weights for policy 0, policy_version 548127 (0.0013) [2023-12-26 03:57:39,955][123091] Updated weights for policy 0, policy_version 548137 (0.0011) [2023-12-26 03:57:40,020][123090] Updated weights for policy 1, policy_version 544069 (0.0008) [2023-12-26 03:57:40,084][123090] Updated weights for policy 1, policy_version 544079 (0.0009) [2023-12-26 03:57:40,146][123090] Updated weights for policy 1, policy_version 544089 (0.0009) [2023-12-26 03:57:40,693][123091] Updated weights for policy 0, policy_version 548147 (0.0009) [2023-12-26 03:57:40,765][123091] Updated weights for policy 0, policy_version 548157 (0.0008) [2023-12-26 03:57:40,839][123091] Updated weights for policy 0, policy_version 548167 (0.0011) [2023-12-26 03:57:40,901][123090] Updated weights for policy 1, policy_version 544099 (0.0008) [2023-12-26 03:57:40,962][123090] Updated weights for policy 1, policy_version 544109 (0.0007) [2023-12-26 03:57:41,029][123090] Updated weights for policy 1, policy_version 544119 (0.0007) [2023-12-26 03:57:41,627][123091] Updated weights for policy 0, policy_version 548177 (0.0010) [2023-12-26 03:57:41,697][123091] Updated weights for policy 0, policy_version 548187 (0.0009) [2023-12-26 03:57:41,769][123091] Updated weights for policy 0, policy_version 548197 (0.0008) [2023-12-26 03:57:41,827][123090] Updated weights for policy 1, policy_version 544129 (0.0008) [2023-12-26 03:57:41,840][123091] Updated weights for policy 0, policy_version 548207 (0.0009) [2023-12-26 03:57:41,894][123090] Updated weights for policy 1, policy_version 544139 (0.0007) [2023-12-26 03:57:41,963][123090] Updated weights for policy 1, policy_version 544149 (0.0006) [2023-12-26 03:57:42,027][123090] Updated weights for policy 1, policy_version 544159 (0.0006) [2023-12-26 03:57:42,708][123090] Updated weights for policy 1, policy_version 544169 (0.0006) [2023-12-26 03:57:42,730][123091] Updated weights for policy 0, policy_version 548217 (0.0009) [2023-12-26 03:57:42,779][123090] Updated weights for policy 1, policy_version 544179 (0.0007) [2023-12-26 03:57:42,795][123091] Updated weights for policy 0, policy_version 548227 (0.0005) [2023-12-26 03:57:42,839][123090] Updated weights for policy 1, policy_version 544189 (0.0010) [2023-12-26 03:57:42,846][123091] Updated weights for policy 0, policy_version 548237 (0.0006) [2023-12-26 03:57:43,537][123090] Updated weights for policy 1, policy_version 544199 (0.0009) [2023-12-26 03:57:43,597][123090] Updated weights for policy 1, policy_version 544209 (0.0008) [2023-12-26 03:57:43,598][123091] Updated weights for policy 0, policy_version 548247 (0.0005) [2023-12-26 03:57:43,656][123091] Updated weights for policy 0, policy_version 548257 (0.0005) [2023-12-26 03:57:43,657][123090] Updated weights for policy 1, policy_version 544219 (0.0010) [2023-12-26 03:57:43,724][123091] Updated weights for policy 0, policy_version 548267 (0.0005) [2023-12-26 03:57:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 279683072. Throughput: 0: 8823.9, 1: 9020.6. Samples: 279669000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 03:57:43,785][121949] Avg episode reward: [(0, '6222.867'), (1, '5786.814')] [2023-12-26 03:57:44,456][123091] Updated weights for policy 0, policy_version 548277 (0.0006) [2023-12-26 03:57:44,465][123090] Updated weights for policy 1, policy_version 544229 (0.0010) [2023-12-26 03:57:44,517][123090] Updated weights for policy 1, policy_version 544239 (0.0010) [2023-12-26 03:57:44,519][123091] Updated weights for policy 0, policy_version 548287 (0.0008) [2023-12-26 03:57:44,567][123091] Updated weights for policy 0, policy_version 548297 (0.0006) [2023-12-26 03:57:44,573][123090] Updated weights for policy 1, policy_version 544249 (0.0010) [2023-12-26 03:57:45,319][123091] Updated weights for policy 0, policy_version 548307 (0.0006) [2023-12-26 03:57:45,378][123091] Updated weights for policy 0, policy_version 548317 (0.0011) [2023-12-26 03:57:45,388][123090] Updated weights for policy 1, policy_version 544259 (0.0009) [2023-12-26 03:57:45,438][123091] Updated weights for policy 0, policy_version 548327 (0.0011) [2023-12-26 03:57:45,450][123090] Updated weights for policy 1, policy_version 544269 (0.0005) [2023-12-26 03:57:45,513][123090] Updated weights for policy 1, policy_version 544279 (0.0006) [2023-12-26 03:57:46,234][123091] Updated weights for policy 0, policy_version 548337 (0.0011) [2023-12-26 03:57:46,271][123090] Updated weights for policy 1, policy_version 544289 (0.0008) [2023-12-26 03:57:46,285][123091] Updated weights for policy 0, policy_version 548347 (0.0010) [2023-12-26 03:57:46,329][123091] Updated weights for policy 0, policy_version 548357 (0.0010) [2023-12-26 03:57:46,333][123090] Updated weights for policy 1, policy_version 544299 (0.0010) [2023-12-26 03:57:46,373][123091] Updated weights for policy 0, policy_version 548367 (0.0010) [2023-12-26 03:57:46,396][123090] Updated weights for policy 1, policy_version 544309 (0.0010) [2023-12-26 03:57:46,458][123090] Updated weights for policy 1, policy_version 544319 (0.0010) [2023-12-26 03:57:47,161][123090] Updated weights for policy 1, policy_version 544329 (0.0006) [2023-12-26 03:57:47,208][123090] Updated weights for policy 1, policy_version 544339 (0.0006) [2023-12-26 03:57:47,232][123091] Updated weights for policy 0, policy_version 548377 (0.0006) [2023-12-26 03:57:47,257][123090] Updated weights for policy 1, policy_version 544349 (0.0006) [2023-12-26 03:57:47,290][123091] Updated weights for policy 0, policy_version 548387 (0.0005) [2023-12-26 03:57:47,346][123091] Updated weights for policy 0, policy_version 548397 (0.0005) [2023-12-26 03:57:47,956][123090] Updated weights for policy 1, policy_version 544359 (0.0005) [2023-12-26 03:57:48,007][123090] Updated weights for policy 1, policy_version 544369 (0.0006) [2023-12-26 03:57:48,032][123091] Updated weights for policy 0, policy_version 548407 (0.0009) [2023-12-26 03:57:48,055][123090] Updated weights for policy 1, policy_version 544379 (0.0008) [2023-12-26 03:57:48,078][123091] Updated weights for policy 0, policy_version 548417 (0.0009) [2023-12-26 03:57:48,126][123091] Updated weights for policy 0, policy_version 548427 (0.0010) [2023-12-26 03:57:48,726][123090] Updated weights for policy 1, policy_version 544389 (0.0005) [2023-12-26 03:57:48,782][123090] Updated weights for policy 1, policy_version 544399 (0.0005) [2023-12-26 03:57:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 279764992. Throughput: 0: 8864.8, 1: 9105.7. Samples: 279781928. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:57:48,785][121949] Avg episode reward: [(0, '6156.714'), (1, '5843.248')] [2023-12-26 03:57:48,837][123090] Updated weights for policy 1, policy_version 544409 (0.0008) [2023-12-26 03:57:48,960][123091] Updated weights for policy 0, policy_version 548437 (0.0008) [2023-12-26 03:57:49,023][123091] Updated weights for policy 0, policy_version 548447 (0.0006) [2023-12-26 03:57:49,078][123091] Updated weights for policy 0, policy_version 548457 (0.0006) [2023-12-26 03:57:49,638][123090] Updated weights for policy 1, policy_version 544420 (0.0010) [2023-12-26 03:57:49,697][123090] Updated weights for policy 1, policy_version 544430 (0.0009) [2023-12-26 03:57:49,750][123090] Updated weights for policy 1, policy_version 544440 (0.0010) [2023-12-26 03:57:49,825][123091] Updated weights for policy 0, policy_version 548467 (0.0007) [2023-12-26 03:57:49,893][123091] Updated weights for policy 0, policy_version 548477 (0.0011) [2023-12-26 03:57:49,959][123091] Updated weights for policy 0, policy_version 548487 (0.0009) [2023-12-26 03:57:50,557][123090] Updated weights for policy 1, policy_version 544450 (0.0009) [2023-12-26 03:57:50,620][123090] Updated weights for policy 1, policy_version 544460 (0.0009) [2023-12-26 03:57:50,680][123090] Updated weights for policy 1, policy_version 544470 (0.0009) [2023-12-26 03:57:50,733][123090] Updated weights for policy 1, policy_version 544480 (0.0009) [2023-12-26 03:57:50,753][123091] Updated weights for policy 0, policy_version 548497 (0.0008) [2023-12-26 03:57:50,816][123091] Updated weights for policy 0, policy_version 548507 (0.0011) [2023-12-26 03:57:50,875][123091] Updated weights for policy 0, policy_version 548517 (0.0010) [2023-12-26 03:57:50,934][123091] Updated weights for policy 0, policy_version 548527 (0.0011) [2023-12-26 03:57:51,617][123090] Updated weights for policy 1, policy_version 544490 (0.0009) [2023-12-26 03:57:51,686][123090] Updated weights for policy 1, policy_version 544500 (0.0010) [2023-12-26 03:57:51,759][123090] Updated weights for policy 1, policy_version 544510 (0.0009) [2023-12-26 03:57:51,767][123091] Updated weights for policy 0, policy_version 548537 (0.0010) [2023-12-26 03:57:51,833][123091] Updated weights for policy 0, policy_version 548547 (0.0009) [2023-12-26 03:57:51,891][123091] Updated weights for policy 0, policy_version 548557 (0.0009) [2023-12-26 03:57:52,599][123090] Updated weights for policy 1, policy_version 544520 (0.0005) [2023-12-26 03:57:52,664][123091] Updated weights for policy 0, policy_version 548567 (0.0009) [2023-12-26 03:57:52,667][123090] Updated weights for policy 1, policy_version 544530 (0.0008) [2023-12-26 03:57:52,719][123091] Updated weights for policy 0, policy_version 548577 (0.0009) [2023-12-26 03:57:52,736][123090] Updated weights for policy 1, policy_version 544540 (0.0007) [2023-12-26 03:57:52,771][123091] Updated weights for policy 0, policy_version 548587 (0.0008) [2023-12-26 03:57:53,501][123090] Updated weights for policy 1, policy_version 544550 (0.0010) [2023-12-26 03:57:53,574][123090] Updated weights for policy 1, policy_version 544560 (0.0010) [2023-12-26 03:57:53,636][123090] Updated weights for policy 1, policy_version 544570 (0.0009) [2023-12-26 03:57:53,638][123091] Updated weights for policy 0, policy_version 548597 (0.0009) [2023-12-26 03:57:53,704][123091] Updated weights for policy 0, policy_version 548607 (0.0006) [2023-12-26 03:57:53,770][123091] Updated weights for policy 0, policy_version 548617 (0.0005) [2023-12-26 03:57:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 279855104. Throughput: 0: 8899.2, 1: 9079.8. Samples: 279834424. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:57:53,785][121949] Avg episode reward: [(0, '6116.449'), (1, '5752.824')] [2023-12-26 03:57:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000544576_139411456.pth... [2023-12-26 03:57:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000543488_139132928.pth [2023-12-26 03:57:53,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000548624_140451840.pth... [2023-12-26 03:57:53,808][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000547568_140181504.pth [2023-12-26 03:57:54,476][123090] Updated weights for policy 1, policy_version 544580 (0.0009) [2023-12-26 03:57:54,504][123091] Updated weights for policy 0, policy_version 548627 (0.0005) [2023-12-26 03:57:54,524][123090] Updated weights for policy 1, policy_version 544590 (0.0009) [2023-12-26 03:57:54,556][123091] Updated weights for policy 0, policy_version 548637 (0.0006) [2023-12-26 03:57:54,581][123090] Updated weights for policy 1, policy_version 544600 (0.0008) [2023-12-26 03:57:54,620][123091] Updated weights for policy 0, policy_version 548647 (0.0007) [2023-12-26 03:57:55,422][123091] Updated weights for policy 0, policy_version 548657 (0.0008) [2023-12-26 03:57:55,456][123090] Updated weights for policy 1, policy_version 544610 (0.0008) [2023-12-26 03:57:55,471][123091] Updated weights for policy 0, policy_version 548667 (0.0010) [2023-12-26 03:57:55,509][123090] Updated weights for policy 1, policy_version 544620 (0.0009) [2023-12-26 03:57:55,528][123091] Updated weights for policy 0, policy_version 548677 (0.0006) [2023-12-26 03:57:55,568][123090] Updated weights for policy 1, policy_version 544630 (0.0011) [2023-12-26 03:57:55,589][123091] Updated weights for policy 0, policy_version 548687 (0.0006) [2023-12-26 03:57:55,635][123090] Updated weights for policy 1, policy_version 544640 (0.0010) [2023-12-26 03:57:56,333][123090] Updated weights for policy 1, policy_version 544650 (0.0005) [2023-12-26 03:57:56,403][123090] Updated weights for policy 1, policy_version 544660 (0.0006) [2023-12-26 03:57:56,407][123091] Updated weights for policy 0, policy_version 548697 (0.0008) [2023-12-26 03:57:56,467][123090] Updated weights for policy 1, policy_version 544670 (0.0006) [2023-12-26 03:57:56,469][123091] Updated weights for policy 0, policy_version 548707 (0.0009) [2023-12-26 03:57:56,536][123091] Updated weights for policy 0, policy_version 548717 (0.0010) [2023-12-26 03:57:57,248][123090] Updated weights for policy 1, policy_version 544680 (0.0009) [2023-12-26 03:57:57,264][123091] Updated weights for policy 0, policy_version 548727 (0.0007) [2023-12-26 03:57:57,311][123090] Updated weights for policy 1, policy_version 544690 (0.0009) [2023-12-26 03:57:57,326][123091] Updated weights for policy 0, policy_version 548737 (0.0007) [2023-12-26 03:57:57,369][123090] Updated weights for policy 1, policy_version 544700 (0.0009) [2023-12-26 03:57:57,376][123091] Updated weights for policy 0, policy_version 548747 (0.0007) [2023-12-26 03:57:58,167][123091] Updated weights for policy 0, policy_version 548757 (0.0007) [2023-12-26 03:57:58,225][123090] Updated weights for policy 1, policy_version 544710 (0.0008) [2023-12-26 03:57:58,229][123091] Updated weights for policy 0, policy_version 548767 (0.0007) [2023-12-26 03:57:58,292][123091] Updated weights for policy 0, policy_version 548777 (0.0008) [2023-12-26 03:57:58,322][123090] Updated weights for policy 1, policy_version 544720 (0.0007) [2023-12-26 03:57:58,392][123090] Updated weights for policy 1, policy_version 544730 (0.0007) [2023-12-26 03:57:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 279945216. Throughput: 0: 8922.6, 1: 9097.1. Samples: 279939908. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:57:58,785][121949] Avg episode reward: [(0, '6164.784'), (1, '5858.804')] [2023-12-26 03:57:59,130][123090] Updated weights for policy 1, policy_version 544740 (0.0007) [2023-12-26 03:57:59,150][123091] Updated weights for policy 0, policy_version 548787 (0.0008) [2023-12-26 03:57:59,197][123090] Updated weights for policy 1, policy_version 544750 (0.0009) [2023-12-26 03:57:59,215][123091] Updated weights for policy 0, policy_version 548797 (0.0009) [2023-12-26 03:57:59,267][123090] Updated weights for policy 1, policy_version 544760 (0.0008) [2023-12-26 03:57:59,283][123091] Updated weights for policy 0, policy_version 548807 (0.0009) [2023-12-26 03:58:00,082][123091] Updated weights for policy 0, policy_version 548817 (0.0009) [2023-12-26 03:58:00,121][123090] Updated weights for policy 1, policy_version 544770 (0.0007) [2023-12-26 03:58:00,140][123091] Updated weights for policy 0, policy_version 548827 (0.0009) [2023-12-26 03:58:00,172][123090] Updated weights for policy 1, policy_version 544780 (0.0009) [2023-12-26 03:58:00,206][123091] Updated weights for policy 0, policy_version 548837 (0.0008) [2023-12-26 03:58:00,234][123090] Updated weights for policy 1, policy_version 544790 (0.0009) [2023-12-26 03:58:00,266][123091] Updated weights for policy 0, policy_version 548847 (0.0008) [2023-12-26 03:58:00,296][123090] Updated weights for policy 1, policy_version 544800 (0.0007) [2023-12-26 03:58:01,094][123091] Updated weights for policy 0, policy_version 548857 (0.0008) [2023-12-26 03:58:01,139][123090] Updated weights for policy 1, policy_version 544810 (0.0010) [2023-12-26 03:58:01,163][123091] Updated weights for policy 0, policy_version 548867 (0.0007) [2023-12-26 03:58:01,202][123090] Updated weights for policy 1, policy_version 544820 (0.0007) [2023-12-26 03:58:01,226][123091] Updated weights for policy 0, policy_version 548877 (0.0010) [2023-12-26 03:58:01,264][123090] Updated weights for policy 1, policy_version 544830 (0.0010) [2023-12-26 03:58:02,045][123091] Updated weights for policy 0, policy_version 548887 (0.0010) [2023-12-26 03:58:02,111][123090] Updated weights for policy 1, policy_version 544840 (0.0007) [2023-12-26 03:58:02,112][123091] Updated weights for policy 0, policy_version 548897 (0.0010) [2023-12-26 03:58:02,173][123091] Updated weights for policy 0, policy_version 548907 (0.0010) [2023-12-26 03:58:02,179][123090] Updated weights for policy 1, policy_version 544850 (0.0007) [2023-12-26 03:58:02,242][123090] Updated weights for policy 1, policy_version 544860 (0.0009) [2023-12-26 03:58:02,991][123091] Updated weights for policy 0, policy_version 548917 (0.0008) [2023-12-26 03:58:03,047][123091] Updated weights for policy 0, policy_version 548927 (0.0009) [2023-12-26 03:58:03,067][123090] Updated weights for policy 1, policy_version 544870 (0.0007) [2023-12-26 03:58:03,107][123091] Updated weights for policy 0, policy_version 548937 (0.0009) [2023-12-26 03:58:03,122][123090] Updated weights for policy 1, policy_version 544880 (0.0007) [2023-12-26 03:58:03,188][123090] Updated weights for policy 1, policy_version 544890 (0.0009) [2023-12-26 03:58:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 280027136. Throughput: 0: 8907.1, 1: 8997.9. Samples: 280041644. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:03,785][121949] Avg episode reward: [(0, '6155.023'), (1, '6014.185')] [2023-12-26 03:58:03,943][123091] Updated weights for policy 0, policy_version 548947 (0.0007) [2023-12-26 03:58:03,967][123090] Updated weights for policy 1, policy_version 544900 (0.0008) [2023-12-26 03:58:04,010][123091] Updated weights for policy 0, policy_version 548957 (0.0010) [2023-12-26 03:58:04,035][123090] Updated weights for policy 1, policy_version 544910 (0.0005) [2023-12-26 03:58:04,067][123091] Updated weights for policy 0, policy_version 548967 (0.0008) [2023-12-26 03:58:04,098][123090] Updated weights for policy 1, policy_version 544920 (0.0005) [2023-12-26 03:58:04,834][123090] Updated weights for policy 1, policy_version 544930 (0.0006) [2023-12-26 03:58:04,900][123090] Updated weights for policy 1, policy_version 544940 (0.0008) [2023-12-26 03:58:04,913][123091] Updated weights for policy 0, policy_version 548977 (0.0009) [2023-12-26 03:58:04,958][123091] Updated weights for policy 0, policy_version 548987 (0.0008) [2023-12-26 03:58:04,960][123090] Updated weights for policy 1, policy_version 544950 (0.0008) [2023-12-26 03:58:05,011][123090] Updated weights for policy 1, policy_version 544960 (0.0005) [2023-12-26 03:58:05,012][123091] Updated weights for policy 0, policy_version 548998 (0.0009) [2023-12-26 03:58:05,066][123091] Updated weights for policy 0, policy_version 549008 (0.0009) [2023-12-26 03:58:05,602][123090] Updated weights for policy 1, policy_version 544970 (0.0008) [2023-12-26 03:58:05,652][123090] Updated weights for policy 1, policy_version 544980 (0.0009) [2023-12-26 03:58:05,705][123090] Updated weights for policy 1, policy_version 544990 (0.0009) [2023-12-26 03:58:05,982][123091] Updated weights for policy 0, policy_version 549018 (0.0009) [2023-12-26 03:58:06,040][123091] Updated weights for policy 0, policy_version 549028 (0.0006) [2023-12-26 03:58:06,111][123091] Updated weights for policy 0, policy_version 549038 (0.0008) [2023-12-26 03:58:06,532][123090] Updated weights for policy 1, policy_version 545000 (0.0010) [2023-12-26 03:58:06,596][123090] Updated weights for policy 1, policy_version 545010 (0.0009) [2023-12-26 03:58:06,662][123090] Updated weights for policy 1, policy_version 545020 (0.0008) [2023-12-26 03:58:06,950][123091] Updated weights for policy 0, policy_version 549048 (0.0010) [2023-12-26 03:58:07,007][123091] Updated weights for policy 0, policy_version 549058 (0.0009) [2023-12-26 03:58:07,060][123091] Updated weights for policy 0, policy_version 549068 (0.0009) [2023-12-26 03:58:07,435][123090] Updated weights for policy 1, policy_version 545030 (0.0008) [2023-12-26 03:58:07,502][123090] Updated weights for policy 1, policy_version 545040 (0.0009) [2023-12-26 03:58:07,557][123090] Updated weights for policy 1, policy_version 545050 (0.0009) [2023-12-26 03:58:07,901][123091] Updated weights for policy 0, policy_version 549078 (0.0010) [2023-12-26 03:58:07,955][123091] Updated weights for policy 0, policy_version 549088 (0.0010) [2023-12-26 03:58:08,008][123091] Updated weights for policy 0, policy_version 549098 (0.0010) [2023-12-26 03:58:08,383][123090] Updated weights for policy 1, policy_version 545060 (0.0009) [2023-12-26 03:58:08,450][123090] Updated weights for policy 1, policy_version 545070 (0.0009) [2023-12-26 03:58:08,513][123090] Updated weights for policy 1, policy_version 545080 (0.0010) [2023-12-26 03:58:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 280117248. Throughput: 0: 8899.6, 1: 9046.0. Samples: 280094756. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:08,785][121949] Avg episode reward: [(0, '6166.537'), (1, '6034.643')] [2023-12-26 03:58:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000549104_140574720.pth... [2023-12-26 03:58:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000545088_139542528.pth... [2023-12-26 03:58:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000544032_139272192.pth [2023-12-26 03:58:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000548080_140312576.pth [2023-12-26 03:58:08,848][123091] Updated weights for policy 0, policy_version 549108 (0.0008) [2023-12-26 03:58:08,919][123091] Updated weights for policy 0, policy_version 549118 (0.0011) [2023-12-26 03:58:08,991][123091] Updated weights for policy 0, policy_version 549128 (0.0011) [2023-12-26 03:58:09,371][123090] Updated weights for policy 1, policy_version 545090 (0.0008) [2023-12-26 03:58:09,443][123090] Updated weights for policy 1, policy_version 545100 (0.0009) [2023-12-26 03:58:09,505][123090] Updated weights for policy 1, policy_version 545110 (0.0009) [2023-12-26 03:58:09,562][123090] Updated weights for policy 1, policy_version 545120 (0.0010) [2023-12-26 03:58:09,678][123091] Updated weights for policy 0, policy_version 549138 (0.0009) [2023-12-26 03:58:09,735][123091] Updated weights for policy 0, policy_version 549148 (0.0009) [2023-12-26 03:58:09,794][123091] Updated weights for policy 0, policy_version 549158 (0.0010) [2023-12-26 03:58:09,856][123091] Updated weights for policy 0, policy_version 549168 (0.0009) [2023-12-26 03:58:10,451][123090] Updated weights for policy 1, policy_version 545130 (0.0006) [2023-12-26 03:58:10,519][123090] Updated weights for policy 1, policy_version 545140 (0.0008) [2023-12-26 03:58:10,579][123090] Updated weights for policy 1, policy_version 545150 (0.0009) [2023-12-26 03:58:10,731][123091] Updated weights for policy 0, policy_version 549178 (0.0010) [2023-12-26 03:58:10,786][123091] Updated weights for policy 0, policy_version 549188 (0.0010) [2023-12-26 03:58:10,841][123091] Updated weights for policy 0, policy_version 549198 (0.0010) [2023-12-26 03:58:11,331][123090] Updated weights for policy 1, policy_version 545160 (0.0009) [2023-12-26 03:58:11,401][123090] Updated weights for policy 1, policy_version 545170 (0.0009) [2023-12-26 03:58:11,465][123090] Updated weights for policy 1, policy_version 545180 (0.0010) [2023-12-26 03:58:11,694][123091] Updated weights for policy 0, policy_version 549208 (0.0006) [2023-12-26 03:58:11,765][123091] Updated weights for policy 0, policy_version 549218 (0.0010) [2023-12-26 03:58:11,820][123091] Updated weights for policy 0, policy_version 549228 (0.0008) [2023-12-26 03:58:12,311][123090] Updated weights for policy 1, policy_version 545190 (0.0009) [2023-12-26 03:58:12,380][123090] Updated weights for policy 1, policy_version 545200 (0.0010) [2023-12-26 03:58:12,433][123090] Updated weights for policy 1, policy_version 545210 (0.0010) [2023-12-26 03:58:12,587][123091] Updated weights for policy 0, policy_version 549238 (0.0009) [2023-12-26 03:58:12,641][123091] Updated weights for policy 0, policy_version 549248 (0.0009) [2023-12-26 03:58:12,696][123091] Updated weights for policy 0, policy_version 549258 (0.0009) [2023-12-26 03:58:13,281][123090] Updated weights for policy 1, policy_version 545220 (0.0010) [2023-12-26 03:58:13,348][123090] Updated weights for policy 1, policy_version 545230 (0.0009) [2023-12-26 03:58:13,409][123090] Updated weights for policy 1, policy_version 545240 (0.0009) [2023-12-26 03:58:13,523][123091] Updated weights for policy 0, policy_version 549268 (0.0009) [2023-12-26 03:58:13,580][123091] Updated weights for policy 0, policy_version 549278 (0.0009) [2023-12-26 03:58:13,629][123091] Updated weights for policy 0, policy_version 549288 (0.0009) [2023-12-26 03:58:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 280207360. Throughput: 0: 8888.4, 1: 8929.1. Samples: 280196844. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:13,784][121949] Avg episode reward: [(0, '6040.235'), (1, '5982.591')] [2023-12-26 03:58:14,176][123090] Updated weights for policy 1, policy_version 545250 (0.0008) [2023-12-26 03:58:14,227][123090] Updated weights for policy 1, policy_version 545260 (0.0005) [2023-12-26 03:58:14,274][123090] Updated weights for policy 1, policy_version 545270 (0.0005) [2023-12-26 03:58:14,324][123090] Updated weights for policy 1, policy_version 545280 (0.0006) [2023-12-26 03:58:14,407][123091] Updated weights for policy 0, policy_version 549298 (0.0009) [2023-12-26 03:58:14,474][123091] Updated weights for policy 0, policy_version 549308 (0.0010) [2023-12-26 03:58:14,532][123091] Updated weights for policy 0, policy_version 549318 (0.0009) [2023-12-26 03:58:14,579][123091] Updated weights for policy 0, policy_version 549328 (0.0010) [2023-12-26 03:58:15,036][123090] Updated weights for policy 1, policy_version 545290 (0.0009) [2023-12-26 03:58:15,097][123090] Updated weights for policy 1, policy_version 545300 (0.0009) [2023-12-26 03:58:15,153][123090] Updated weights for policy 1, policy_version 545310 (0.0009) [2023-12-26 03:58:15,406][123091] Updated weights for policy 0, policy_version 549338 (0.0010) [2023-12-26 03:58:15,458][123091] Updated weights for policy 0, policy_version 549348 (0.0010) [2023-12-26 03:58:15,510][123091] Updated weights for policy 0, policy_version 549358 (0.0010) [2023-12-26 03:58:16,005][123090] Updated weights for policy 1, policy_version 545320 (0.0010) [2023-12-26 03:58:16,066][123090] Updated weights for policy 1, policy_version 545330 (0.0010) [2023-12-26 03:58:16,120][123090] Updated weights for policy 1, policy_version 545340 (0.0010) [2023-12-26 03:58:16,251][123091] Updated weights for policy 0, policy_version 549368 (0.0006) [2023-12-26 03:58:16,315][123091] Updated weights for policy 0, policy_version 549378 (0.0005) [2023-12-26 03:58:16,372][123091] Updated weights for policy 0, policy_version 549388 (0.0005) [2023-12-26 03:58:17,029][123091] Updated weights for policy 0, policy_version 549398 (0.0005) [2023-12-26 03:58:17,089][123091] Updated weights for policy 0, policy_version 549408 (0.0005) [2023-12-26 03:58:17,096][123090] Updated weights for policy 1, policy_version 545350 (0.0009) [2023-12-26 03:58:17,146][123090] Updated weights for policy 1, policy_version 545360 (0.0009) [2023-12-26 03:58:17,148][123091] Updated weights for policy 0, policy_version 549418 (0.0005) [2023-12-26 03:58:17,196][123090] Updated weights for policy 1, policy_version 545370 (0.0009) [2023-12-26 03:58:17,758][123091] Updated weights for policy 0, policy_version 549428 (0.0005) [2023-12-26 03:58:17,824][123091] Updated weights for policy 0, policy_version 549438 (0.0006) [2023-12-26 03:58:17,883][123091] Updated weights for policy 0, policy_version 549448 (0.0011) [2023-12-26 03:58:18,140][123090] Updated weights for policy 1, policy_version 545381 (0.0009) [2023-12-26 03:58:18,189][123090] Updated weights for policy 1, policy_version 545392 (0.0009) [2023-12-26 03:58:18,245][123090] Updated weights for policy 1, policy_version 545402 (0.0009) [2023-12-26 03:58:18,669][123091] Updated weights for policy 0, policy_version 549458 (0.0009) [2023-12-26 03:58:18,733][123091] Updated weights for policy 0, policy_version 549468 (0.0010) [2023-12-26 03:58:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 280289280. Throughput: 0: 8917.9, 1: 8826.2. Samples: 280304300. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:18,785][121949] Avg episode reward: [(0, '6001.960'), (1, '5938.312')] [2023-12-26 03:58:18,789][123091] Updated weights for policy 0, policy_version 549478 (0.0011) [2023-12-26 03:58:18,845][123091] Updated weights for policy 0, policy_version 549488 (0.0010) [2023-12-26 03:58:19,132][123090] Updated weights for policy 1, policy_version 545412 (0.0009) [2023-12-26 03:58:19,192][123090] Updated weights for policy 1, policy_version 545422 (0.0009) [2023-12-26 03:58:19,267][123090] Updated weights for policy 1, policy_version 545432 (0.0009) [2023-12-26 03:58:19,698][123091] Updated weights for policy 0, policy_version 549498 (0.0010) [2023-12-26 03:58:19,770][123091] Updated weights for policy 0, policy_version 549508 (0.0006) [2023-12-26 03:58:19,847][123091] Updated weights for policy 0, policy_version 549518 (0.0009) [2023-12-26 03:58:20,141][123090] Updated weights for policy 1, policy_version 545442 (0.0009) [2023-12-26 03:58:20,209][123090] Updated weights for policy 1, policy_version 545452 (0.0009) [2023-12-26 03:58:20,278][123090] Updated weights for policy 1, policy_version 545462 (0.0009) [2023-12-26 03:58:20,345][123090] Updated weights for policy 1, policy_version 545472 (0.0009) [2023-12-26 03:58:20,595][123091] Updated weights for policy 0, policy_version 549528 (0.0008) [2023-12-26 03:58:20,664][123091] Updated weights for policy 0, policy_version 549538 (0.0009) [2023-12-26 03:58:20,732][123091] Updated weights for policy 0, policy_version 549548 (0.0010) [2023-12-26 03:58:21,267][123090] Updated weights for policy 1, policy_version 545482 (0.0010) [2023-12-26 03:58:21,338][123090] Updated weights for policy 1, policy_version 545492 (0.0010) [2023-12-26 03:58:21,415][123090] Updated weights for policy 1, policy_version 545502 (0.0009) [2023-12-26 03:58:21,611][123091] Updated weights for policy 0, policy_version 549558 (0.0010) [2023-12-26 03:58:21,677][123091] Updated weights for policy 0, policy_version 549568 (0.0010) [2023-12-26 03:58:21,749][123091] Updated weights for policy 0, policy_version 549578 (0.0008) [2023-12-26 03:58:22,137][123090] Updated weights for policy 1, policy_version 545512 (0.0009) [2023-12-26 03:58:22,195][123090] Updated weights for policy 1, policy_version 545522 (0.0008) [2023-12-26 03:58:22,256][123090] Updated weights for policy 1, policy_version 545532 (0.0009) [2023-12-26 03:58:22,557][123091] Updated weights for policy 0, policy_version 549588 (0.0008) [2023-12-26 03:58:22,630][123091] Updated weights for policy 0, policy_version 549598 (0.0010) [2023-12-26 03:58:22,695][123091] Updated weights for policy 0, policy_version 549608 (0.0010) [2023-12-26 03:58:22,994][123090] Updated weights for policy 1, policy_version 545542 (0.0008) [2023-12-26 03:58:23,056][123090] Updated weights for policy 1, policy_version 545552 (0.0008) [2023-12-26 03:58:23,117][123090] Updated weights for policy 1, policy_version 545562 (0.0008) [2023-12-26 03:58:23,577][123091] Updated weights for policy 0, policy_version 549618 (0.0009) [2023-12-26 03:58:23,638][123091] Updated weights for policy 0, policy_version 549628 (0.0010) [2023-12-26 03:58:23,704][123091] Updated weights for policy 0, policy_version 549638 (0.0009) [2023-12-26 03:58:23,758][123091] Updated weights for policy 0, policy_version 549648 (0.0010) [2023-12-26 03:58:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 280379392. Throughput: 0: 8875.0, 1: 8737.3. Samples: 280354588. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:23,785][121949] Avg episode reward: [(0, '5998.125'), (1, '5970.496')] [2023-12-26 03:58:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000549648_140713984.pth... [2023-12-26 03:58:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000548624_140451840.pth [2023-12-26 03:58:23,820][123090] Updated weights for policy 1, policy_version 545572 (0.0007) [2023-12-26 03:58:23,888][123090] Updated weights for policy 1, policy_version 545582 (0.0009) [2023-12-26 03:58:23,961][123090] Updated weights for policy 1, policy_version 545592 (0.0009) [2023-12-26 03:58:24,008][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000545600_139673600.pth... [2023-12-26 03:58:24,012][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000544576_139411456.pth [2023-12-26 03:58:24,617][123091] Updated weights for policy 0, policy_version 549658 (0.0010) [2023-12-26 03:58:24,666][123091] Updated weights for policy 0, policy_version 549668 (0.0009) [2023-12-26 03:58:24,719][123091] Updated weights for policy 0, policy_version 549678 (0.0008) [2023-12-26 03:58:24,783][123090] Updated weights for policy 1, policy_version 545602 (0.0010) [2023-12-26 03:58:24,842][123090] Updated weights for policy 1, policy_version 545612 (0.0009) [2023-12-26 03:58:24,893][123090] Updated weights for policy 1, policy_version 545622 (0.0008) [2023-12-26 03:58:24,951][123090] Updated weights for policy 1, policy_version 545632 (0.0009) [2023-12-26 03:58:25,478][123091] Updated weights for policy 0, policy_version 549688 (0.0009) [2023-12-26 03:58:25,521][123091] Updated weights for policy 0, policy_version 549698 (0.0005) [2023-12-26 03:58:25,583][123091] Updated weights for policy 0, policy_version 549708 (0.0005) [2023-12-26 03:58:25,788][123090] Updated weights for policy 1, policy_version 545642 (0.0005) [2023-12-26 03:58:25,851][123090] Updated weights for policy 1, policy_version 545652 (0.0005) [2023-12-26 03:58:25,917][123090] Updated weights for policy 1, policy_version 545662 (0.0005) [2023-12-26 03:58:26,266][123091] Updated weights for policy 0, policy_version 549718 (0.0005) [2023-12-26 03:58:26,317][123091] Updated weights for policy 0, policy_version 549728 (0.0006) [2023-12-26 03:58:26,365][123091] Updated weights for policy 0, policy_version 549738 (0.0006) [2023-12-26 03:58:26,711][123090] Updated weights for policy 1, policy_version 545672 (0.0010) [2023-12-26 03:58:26,777][123090] Updated weights for policy 1, policy_version 545682 (0.0008) [2023-12-26 03:58:26,828][123090] Updated weights for policy 1, policy_version 545692 (0.0008) [2023-12-26 03:58:27,028][123091] Updated weights for policy 0, policy_version 549748 (0.0006) [2023-12-26 03:58:27,096][123091] Updated weights for policy 0, policy_version 549758 (0.0008) [2023-12-26 03:58:27,162][123091] Updated weights for policy 0, policy_version 549768 (0.0007) [2023-12-26 03:58:27,609][123090] Updated weights for policy 1, policy_version 545702 (0.0007) [2023-12-26 03:58:27,684][123090] Updated weights for policy 1, policy_version 545712 (0.0006) [2023-12-26 03:58:27,751][123090] Updated weights for policy 1, policy_version 545722 (0.0006) [2023-12-26 03:58:27,932][123091] Updated weights for policy 0, policy_version 549778 (0.0006) [2023-12-26 03:58:27,980][123091] Updated weights for policy 0, policy_version 549788 (0.0009) [2023-12-26 03:58:28,039][123091] Updated weights for policy 0, policy_version 549798 (0.0011) [2023-12-26 03:58:28,475][123090] Updated weights for policy 1, policy_version 545732 (0.0008) [2023-12-26 03:58:28,535][123090] Updated weights for policy 1, policy_version 545742 (0.0009) [2023-12-26 03:58:28,593][123090] Updated weights for policy 1, policy_version 545752 (0.0009) [2023-12-26 03:58:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 280469504. Throughput: 0: 8884.4, 1: 8760.5. Samples: 280463016. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:28,784][121949] Avg episode reward: [(0, '6080.440'), (1, '6010.960')] [2023-12-26 03:58:28,904][123091] Updated weights for policy 0, policy_version 549809 (0.0010) [2023-12-26 03:58:28,958][123091] Updated weights for policy 0, policy_version 549820 (0.0010) [2023-12-26 03:58:29,011][123091] Updated weights for policy 0, policy_version 549830 (0.0009) [2023-12-26 03:58:29,065][123091] Updated weights for policy 0, policy_version 549840 (0.0010) [2023-12-26 03:58:29,419][123090] Updated weights for policy 1, policy_version 545762 (0.0009) [2023-12-26 03:58:29,470][123090] Updated weights for policy 1, policy_version 545772 (0.0010) [2023-12-26 03:58:29,528][123090] Updated weights for policy 1, policy_version 545782 (0.0009) [2023-12-26 03:58:29,592][123090] Updated weights for policy 1, policy_version 545792 (0.0009) [2023-12-26 03:58:29,891][123091] Updated weights for policy 0, policy_version 549850 (0.0009) [2023-12-26 03:58:29,951][123091] Updated weights for policy 0, policy_version 549860 (0.0009) [2023-12-26 03:58:30,015][123091] Updated weights for policy 0, policy_version 549870 (0.0009) [2023-12-26 03:58:30,387][123090] Updated weights for policy 1, policy_version 545802 (0.0006) [2023-12-26 03:58:30,454][123090] Updated weights for policy 1, policy_version 545812 (0.0005) [2023-12-26 03:58:30,521][123090] Updated weights for policy 1, policy_version 545822 (0.0006) [2023-12-26 03:58:30,779][123091] Updated weights for policy 0, policy_version 549880 (0.0006) [2023-12-26 03:58:30,836][123091] Updated weights for policy 0, policy_version 549890 (0.0005) [2023-12-26 03:58:30,897][123091] Updated weights for policy 0, policy_version 549900 (0.0005) [2023-12-26 03:58:31,231][123090] Updated weights for policy 1, policy_version 545832 (0.0009) [2023-12-26 03:58:31,298][123090] Updated weights for policy 1, policy_version 545842 (0.0010) [2023-12-26 03:58:31,358][123090] Updated weights for policy 1, policy_version 545852 (0.0011) [2023-12-26 03:58:31,591][123091] Updated weights for policy 0, policy_version 549910 (0.0007) [2023-12-26 03:58:31,662][123091] Updated weights for policy 0, policy_version 549920 (0.0009) [2023-12-26 03:58:31,729][123091] Updated weights for policy 0, policy_version 549930 (0.0008) [2023-12-26 03:58:32,210][123090] Updated weights for policy 1, policy_version 545862 (0.0008) [2023-12-26 03:58:32,273][123090] Updated weights for policy 1, policy_version 545872 (0.0008) [2023-12-26 03:58:32,344][123090] Updated weights for policy 1, policy_version 545882 (0.0007) [2023-12-26 03:58:32,583][123091] Updated weights for policy 0, policy_version 549940 (0.0010) [2023-12-26 03:58:32,642][123091] Updated weights for policy 0, policy_version 549950 (0.0010) [2023-12-26 03:58:32,696][123091] Updated weights for policy 0, policy_version 549960 (0.0010) [2023-12-26 03:58:33,025][123090] Updated weights for policy 1, policy_version 545892 (0.0007) [2023-12-26 03:58:33,099][123090] Updated weights for policy 1, policy_version 545902 (0.0005) [2023-12-26 03:58:33,158][123090] Updated weights for policy 1, policy_version 545912 (0.0005) [2023-12-26 03:58:33,643][123091] Updated weights for policy 0, policy_version 549971 (0.0010) [2023-12-26 03:58:33,699][123091] Updated weights for policy 0, policy_version 549981 (0.0010) [2023-12-26 03:58:33,750][123091] Updated weights for policy 0, policy_version 549992 (0.0009) [2023-12-26 03:58:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 280551424. Throughput: 0: 8783.7, 1: 8720.0. Samples: 280569592. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:33,785][121949] Avg episode reward: [(0, '6087.156'), (1, '6000.106')] [2023-12-26 03:58:33,798][123090] Updated weights for policy 1, policy_version 545922 (0.0005) [2023-12-26 03:58:33,852][123090] Updated weights for policy 1, policy_version 545932 (0.0005) [2023-12-26 03:58:33,905][123090] Updated weights for policy 1, policy_version 545942 (0.0005) [2023-12-26 03:58:33,961][123090] Updated weights for policy 1, policy_version 545952 (0.0005) [2023-12-26 03:58:34,630][123091] Updated weights for policy 0, policy_version 550003 (0.0010) [2023-12-26 03:58:34,676][123090] Updated weights for policy 1, policy_version 545962 (0.0011) [2023-12-26 03:58:34,683][123091] Updated weights for policy 0, policy_version 550013 (0.0007) [2023-12-26 03:58:34,729][123090] Updated weights for policy 1, policy_version 545972 (0.0011) [2023-12-26 03:58:34,740][123091] Updated weights for policy 0, policy_version 550023 (0.0006) [2023-12-26 03:58:34,777][123090] Updated weights for policy 1, policy_version 545982 (0.0010) [2023-12-26 03:58:35,410][123091] Updated weights for policy 0, policy_version 550033 (0.0006) [2023-12-26 03:58:35,461][123091] Updated weights for policy 0, policy_version 550043 (0.0006) [2023-12-26 03:58:35,516][123091] Updated weights for policy 0, policy_version 550053 (0.0006) [2023-12-26 03:58:35,527][123090] Updated weights for policy 1, policy_version 545992 (0.0010) [2023-12-26 03:58:35,574][123091] Updated weights for policy 0, policy_version 550063 (0.0005) [2023-12-26 03:58:35,591][123090] Updated weights for policy 1, policy_version 546002 (0.0009) [2023-12-26 03:58:35,656][123090] Updated weights for policy 1, policy_version 546012 (0.0009) [2023-12-26 03:58:36,325][123091] Updated weights for policy 0, policy_version 550073 (0.0007) [2023-12-26 03:58:36,391][123091] Updated weights for policy 0, policy_version 550083 (0.0010) [2023-12-26 03:58:36,448][123090] Updated weights for policy 1, policy_version 546022 (0.0010) [2023-12-26 03:58:36,454][123091] Updated weights for policy 0, policy_version 550093 (0.0011) [2023-12-26 03:58:36,511][123090] Updated weights for policy 1, policy_version 546032 (0.0010) [2023-12-26 03:58:36,575][123090] Updated weights for policy 1, policy_version 546042 (0.0010) [2023-12-26 03:58:37,271][123091] Updated weights for policy 0, policy_version 550103 (0.0008) [2023-12-26 03:58:37,328][123091] Updated weights for policy 0, policy_version 550113 (0.0005) [2023-12-26 03:58:37,377][123090] Updated weights for policy 1, policy_version 546052 (0.0008) [2023-12-26 03:58:37,392][123091] Updated weights for policy 0, policy_version 550123 (0.0006) [2023-12-26 03:58:37,443][123090] Updated weights for policy 1, policy_version 546062 (0.0005) [2023-12-26 03:58:37,508][123090] Updated weights for policy 1, policy_version 546072 (0.0005) [2023-12-26 03:58:38,146][123091] Updated weights for policy 0, policy_version 550133 (0.0011) [2023-12-26 03:58:38,208][123091] Updated weights for policy 0, policy_version 550143 (0.0010) [2023-12-26 03:58:38,211][123090] Updated weights for policy 1, policy_version 546082 (0.0006) [2023-12-26 03:58:38,259][123090] Updated weights for policy 1, policy_version 546092 (0.0008) [2023-12-26 03:58:38,267][123091] Updated weights for policy 0, policy_version 550153 (0.0006) [2023-12-26 03:58:38,317][123090] Updated weights for policy 1, policy_version 546102 (0.0009) [2023-12-26 03:58:38,381][123090] Updated weights for policy 1, policy_version 546112 (0.0008) [2023-12-26 03:58:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 280649728. Throughput: 0: 8807.6, 1: 8763.3. Samples: 280625112. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:38,784][121949] Avg episode reward: [(0, '5955.760'), (1, '5944.556')] [2023-12-26 03:58:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000550160_140845056.pth... [2023-12-26 03:58:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000546112_139804672.pth... [2023-12-26 03:58:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000549104_140574720.pth [2023-12-26 03:58:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000545088_139542528.pth [2023-12-26 03:58:38,965][123091] Updated weights for policy 0, policy_version 550163 (0.0005) [2023-12-26 03:58:39,034][123091] Updated weights for policy 0, policy_version 550173 (0.0005) [2023-12-26 03:58:39,103][123091] Updated weights for policy 0, policy_version 550183 (0.0005) [2023-12-26 03:58:39,209][123090] Updated weights for policy 1, policy_version 546122 (0.0010) [2023-12-26 03:58:39,284][123090] Updated weights for policy 1, policy_version 546132 (0.0009) [2023-12-26 03:58:39,335][123090] Updated weights for policy 1, policy_version 546142 (0.0008) [2023-12-26 03:58:39,798][123091] Updated weights for policy 0, policy_version 550193 (0.0005) [2023-12-26 03:58:39,868][123091] Updated weights for policy 0, policy_version 550203 (0.0007) [2023-12-26 03:58:39,938][123091] Updated weights for policy 0, policy_version 550213 (0.0007) [2023-12-26 03:58:39,995][123091] Updated weights for policy 0, policy_version 550223 (0.0008) [2023-12-26 03:58:40,158][123090] Updated weights for policy 1, policy_version 546152 (0.0008) [2023-12-26 03:58:40,207][123090] Updated weights for policy 1, policy_version 546162 (0.0008) [2023-12-26 03:58:40,259][123090] Updated weights for policy 1, policy_version 546172 (0.0008) [2023-12-26 03:58:40,816][123091] Updated weights for policy 0, policy_version 550233 (0.0010) [2023-12-26 03:58:40,878][123091] Updated weights for policy 0, policy_version 550243 (0.0010) [2023-12-26 03:58:40,929][123091] Updated weights for policy 0, policy_version 550253 (0.0010) [2023-12-26 03:58:41,079][123090] Updated weights for policy 1, policy_version 546182 (0.0009) [2023-12-26 03:58:41,144][123090] Updated weights for policy 1, policy_version 546192 (0.0010) [2023-12-26 03:58:41,214][123090] Updated weights for policy 1, policy_version 546202 (0.0011) [2023-12-26 03:58:41,798][123091] Updated weights for policy 0, policy_version 550263 (0.0009) [2023-12-26 03:58:41,855][123091] Updated weights for policy 0, policy_version 550273 (0.0009) [2023-12-26 03:58:41,920][123091] Updated weights for policy 0, policy_version 550283 (0.0008) [2023-12-26 03:58:41,970][123090] Updated weights for policy 1, policy_version 546212 (0.0008) [2023-12-26 03:58:42,033][123090] Updated weights for policy 1, policy_version 546222 (0.0008) [2023-12-26 03:58:42,099][123090] Updated weights for policy 1, policy_version 546232 (0.0009) [2023-12-26 03:58:42,783][123091] Updated weights for policy 0, policy_version 550293 (0.0008) [2023-12-26 03:58:42,835][123091] Updated weights for policy 0, policy_version 550303 (0.0009) [2023-12-26 03:58:42,857][123090] Updated weights for policy 1, policy_version 546242 (0.0007) [2023-12-26 03:58:42,890][123091] Updated weights for policy 0, policy_version 550313 (0.0008) [2023-12-26 03:58:42,919][123090] Updated weights for policy 1, policy_version 546252 (0.0006) [2023-12-26 03:58:42,993][123090] Updated weights for policy 1, policy_version 546262 (0.0007) [2023-12-26 03:58:43,060][123090] Updated weights for policy 1, policy_version 546272 (0.0009) [2023-12-26 03:58:43,702][123091] Updated weights for policy 0, policy_version 550323 (0.0008) [2023-12-26 03:58:43,759][123091] Updated weights for policy 0, policy_version 550333 (0.0009) [2023-12-26 03:58:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 280731648. Throughput: 0: 8800.0, 1: 8793.2. Samples: 280731604. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:43,785][121949] Avg episode reward: [(0, '6022.700'), (1, '5985.166')] [2023-12-26 03:58:43,821][123091] Updated weights for policy 0, policy_version 550343 (0.0009) [2023-12-26 03:58:43,871][123090] Updated weights for policy 1, policy_version 546282 (0.0007) [2023-12-26 03:58:43,922][123090] Updated weights for policy 1, policy_version 546292 (0.0009) [2023-12-26 03:58:43,980][123090] Updated weights for policy 1, policy_version 546302 (0.0008) [2023-12-26 03:58:44,653][123091] Updated weights for policy 0, policy_version 550353 (0.0009) [2023-12-26 03:58:44,706][123091] Updated weights for policy 0, policy_version 550363 (0.0009) [2023-12-26 03:58:44,765][123091] Updated weights for policy 0, policy_version 550373 (0.0009) [2023-12-26 03:58:44,815][123090] Updated weights for policy 1, policy_version 546312 (0.0009) [2023-12-26 03:58:44,829][123091] Updated weights for policy 0, policy_version 550383 (0.0008) [2023-12-26 03:58:44,880][123090] Updated weights for policy 1, policy_version 546322 (0.0010) [2023-12-26 03:58:44,944][123090] Updated weights for policy 1, policy_version 546332 (0.0010) [2023-12-26 03:58:45,657][123091] Updated weights for policy 0, policy_version 550393 (0.0006) [2023-12-26 03:58:45,714][123091] Updated weights for policy 0, policy_version 550403 (0.0006) [2023-12-26 03:58:45,773][123091] Updated weights for policy 0, policy_version 550413 (0.0006) [2023-12-26 03:58:45,795][123090] Updated weights for policy 1, policy_version 546342 (0.0009) [2023-12-26 03:58:45,862][123090] Updated weights for policy 1, policy_version 546352 (0.0009) [2023-12-26 03:58:45,929][123090] Updated weights for policy 1, policy_version 546362 (0.0009) [2023-12-26 03:58:46,524][123091] Updated weights for policy 0, policy_version 550423 (0.0009) [2023-12-26 03:58:46,575][123091] Updated weights for policy 0, policy_version 550433 (0.0009) [2023-12-26 03:58:46,631][123091] Updated weights for policy 0, policy_version 550444 (0.0010) [2023-12-26 03:58:46,702][123090] Updated weights for policy 1, policy_version 546372 (0.0010) [2023-12-26 03:58:46,760][123090] Updated weights for policy 1, policy_version 546382 (0.0009) [2023-12-26 03:58:46,820][123090] Updated weights for policy 1, policy_version 546392 (0.0008) [2023-12-26 03:58:47,432][123091] Updated weights for policy 0, policy_version 550454 (0.0007) [2023-12-26 03:58:47,482][123091] Updated weights for policy 0, policy_version 550464 (0.0005) [2023-12-26 03:58:47,541][123091] Updated weights for policy 0, policy_version 550474 (0.0005) [2023-12-26 03:58:47,686][123090] Updated weights for policy 1, policy_version 546402 (0.0010) [2023-12-26 03:58:47,740][123090] Updated weights for policy 1, policy_version 546412 (0.0009) [2023-12-26 03:58:47,799][123090] Updated weights for policy 1, policy_version 546422 (0.0009) [2023-12-26 03:58:47,856][123090] Updated weights for policy 1, policy_version 546432 (0.0009) [2023-12-26 03:58:48,323][123091] Updated weights for policy 0, policy_version 550484 (0.0007) [2023-12-26 03:58:48,386][123091] Updated weights for policy 0, policy_version 550494 (0.0010) [2023-12-26 03:58:48,440][123091] Updated weights for policy 0, policy_version 550504 (0.0010) [2023-12-26 03:58:48,592][123090] Updated weights for policy 1, policy_version 546442 (0.0005) [2023-12-26 03:58:48,649][123090] Updated weights for policy 1, policy_version 546452 (0.0010) [2023-12-26 03:58:48,708][123090] Updated weights for policy 1, policy_version 546462 (0.0010) [2023-12-26 03:58:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 280829952. Throughput: 0: 8821.0, 1: 8832.5. Samples: 280836052. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:48,785][121949] Avg episode reward: [(0, '6102.783'), (1, '6013.102')] [2023-12-26 03:58:49,408][123091] Updated weights for policy 0, policy_version 550514 (0.0009) [2023-12-26 03:58:49,444][123090] Updated weights for policy 1, policy_version 546472 (0.0010) [2023-12-26 03:58:49,464][123091] Updated weights for policy 0, policy_version 550524 (0.0007) [2023-12-26 03:58:49,508][123090] Updated weights for policy 1, policy_version 546482 (0.0009) [2023-12-26 03:58:49,512][123091] Updated weights for policy 0, policy_version 550534 (0.0007) [2023-12-26 03:58:49,570][123090] Updated weights for policy 1, policy_version 546492 (0.0009) [2023-12-26 03:58:49,572][123091] Updated weights for policy 0, policy_version 550544 (0.0007) [2023-12-26 03:58:50,333][123090] Updated weights for policy 1, policy_version 546502 (0.0007) [2023-12-26 03:58:50,386][123091] Updated weights for policy 0, policy_version 550554 (0.0008) [2023-12-26 03:58:50,397][123090] Updated weights for policy 1, policy_version 546512 (0.0009) [2023-12-26 03:58:50,446][123091] Updated weights for policy 0, policy_version 550564 (0.0007) [2023-12-26 03:58:50,461][123090] Updated weights for policy 1, policy_version 546522 (0.0009) [2023-12-26 03:58:50,505][123091] Updated weights for policy 0, policy_version 550574 (0.0007) [2023-12-26 03:58:51,244][123090] Updated weights for policy 1, policy_version 546532 (0.0009) [2023-12-26 03:58:51,314][123090] Updated weights for policy 1, policy_version 546542 (0.0009) [2023-12-26 03:58:51,327][123091] Updated weights for policy 0, policy_version 550584 (0.0009) [2023-12-26 03:58:51,383][123090] Updated weights for policy 1, policy_version 546552 (0.0009) [2023-12-26 03:58:51,397][123091] Updated weights for policy 0, policy_version 550594 (0.0008) [2023-12-26 03:58:51,459][123091] Updated weights for policy 0, policy_version 550604 (0.0008) [2023-12-26 03:58:52,212][123091] Updated weights for policy 0, policy_version 550614 (0.0006) [2023-12-26 03:58:52,229][123090] Updated weights for policy 1, policy_version 546562 (0.0006) [2023-12-26 03:58:52,275][123091] Updated weights for policy 0, policy_version 550624 (0.0007) [2023-12-26 03:58:52,300][123090] Updated weights for policy 1, policy_version 546572 (0.0008) [2023-12-26 03:58:52,337][123091] Updated weights for policy 0, policy_version 550634 (0.0007) [2023-12-26 03:58:52,372][123090] Updated weights for policy 1, policy_version 546582 (0.0008) [2023-12-26 03:58:52,443][123090] Updated weights for policy 1, policy_version 546592 (0.0007) [2023-12-26 03:58:53,098][123091] Updated weights for policy 0, policy_version 550644 (0.0009) [2023-12-26 03:58:53,157][123091] Updated weights for policy 0, policy_version 550654 (0.0009) [2023-12-26 03:58:53,220][123091] Updated weights for policy 0, policy_version 550664 (0.0008) [2023-12-26 03:58:53,248][123090] Updated weights for policy 1, policy_version 546602 (0.0009) [2023-12-26 03:58:53,308][123090] Updated weights for policy 1, policy_version 546612 (0.0008) [2023-12-26 03:58:53,366][123090] Updated weights for policy 1, policy_version 546622 (0.0010) [2023-12-26 03:58:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 280911872. Throughput: 0: 8837.8, 1: 8802.7. Samples: 280888576. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:53,785][121949] Avg episode reward: [(0, '6153.763'), (1, '5975.093')] [2023-12-26 03:58:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000550672_140976128.pth... [2023-12-26 03:58:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000546624_139935744.pth... [2023-12-26 03:58:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000549648_140713984.pth [2023-12-26 03:58:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000545600_139673600.pth [2023-12-26 03:58:54,036][123091] Updated weights for policy 0, policy_version 550674 (0.0010) [2023-12-26 03:58:54,098][123091] Updated weights for policy 0, policy_version 550684 (0.0009) [2023-12-26 03:58:54,159][123091] Updated weights for policy 0, policy_version 550694 (0.0008) [2023-12-26 03:58:54,223][123091] Updated weights for policy 0, policy_version 550704 (0.0006) [2023-12-26 03:58:54,232][123090] Updated weights for policy 1, policy_version 546632 (0.0008) [2023-12-26 03:58:54,294][123090] Updated weights for policy 1, policy_version 546642 (0.0010) [2023-12-26 03:58:54,347][123090] Updated weights for policy 1, policy_version 546652 (0.0010) [2023-12-26 03:58:54,913][123091] Updated weights for policy 0, policy_version 550714 (0.0010) [2023-12-26 03:58:54,985][123091] Updated weights for policy 0, policy_version 550724 (0.0011) [2023-12-26 03:58:55,058][123091] Updated weights for policy 0, policy_version 550734 (0.0011) [2023-12-26 03:58:55,284][123090] Updated weights for policy 1, policy_version 546662 (0.0010) [2023-12-26 03:58:55,350][123090] Updated weights for policy 1, policy_version 546672 (0.0010) [2023-12-26 03:58:55,414][123090] Updated weights for policy 1, policy_version 546682 (0.0009) [2023-12-26 03:58:55,820][123091] Updated weights for policy 0, policy_version 550744 (0.0011) [2023-12-26 03:58:55,876][123091] Updated weights for policy 0, policy_version 550754 (0.0011) [2023-12-26 03:58:55,932][123091] Updated weights for policy 0, policy_version 550764 (0.0011) [2023-12-26 03:58:56,250][123090] Updated weights for policy 1, policy_version 546692 (0.0009) [2023-12-26 03:58:56,307][123090] Updated weights for policy 1, policy_version 546702 (0.0009) [2023-12-26 03:58:56,380][123090] Updated weights for policy 1, policy_version 546712 (0.0009) [2023-12-26 03:58:56,758][123091] Updated weights for policy 0, policy_version 550774 (0.0010) [2023-12-26 03:58:56,801][123091] Updated weights for policy 0, policy_version 550784 (0.0010) [2023-12-26 03:58:56,855][123091] Updated weights for policy 0, policy_version 550794 (0.0007) [2023-12-26 03:58:57,225][123090] Updated weights for policy 1, policy_version 546722 (0.0009) [2023-12-26 03:58:57,285][123090] Updated weights for policy 1, policy_version 546732 (0.0009) [2023-12-26 03:58:57,353][123090] Updated weights for policy 1, policy_version 546742 (0.0009) [2023-12-26 03:58:57,419][123090] Updated weights for policy 1, policy_version 546752 (0.0009) [2023-12-26 03:58:57,623][123091] Updated weights for policy 0, policy_version 550804 (0.0007) [2023-12-26 03:58:57,682][123091] Updated weights for policy 0, policy_version 550814 (0.0011) [2023-12-26 03:58:57,738][123091] Updated weights for policy 0, policy_version 550824 (0.0011) [2023-12-26 03:58:58,273][123090] Updated weights for policy 1, policy_version 546762 (0.0009) [2023-12-26 03:58:58,348][123090] Updated weights for policy 1, policy_version 546772 (0.0009) [2023-12-26 03:58:58,421][123090] Updated weights for policy 1, policy_version 546782 (0.0007) [2023-12-26 03:58:58,592][123091] Updated weights for policy 0, policy_version 550834 (0.0011) [2023-12-26 03:58:58,663][123091] Updated weights for policy 0, policy_version 550845 (0.0008) [2023-12-26 03:58:58,735][123091] Updated weights for policy 0, policy_version 550855 (0.0007) [2023-12-26 03:58:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 280993792. Throughput: 0: 8910.9, 1: 8771.5. Samples: 280992556. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:58:58,785][121949] Avg episode reward: [(0, '5961.768'), (1, '5926.136')] [2023-12-26 03:58:59,331][123090] Updated weights for policy 1, policy_version 546792 (0.0008) [2023-12-26 03:58:59,397][123090] Updated weights for policy 1, policy_version 546802 (0.0010) [2023-12-26 03:58:59,445][123090] Updated weights for policy 1, policy_version 546812 (0.0009) [2023-12-26 03:58:59,626][123091] Updated weights for policy 0, policy_version 550865 (0.0010) [2023-12-26 03:58:59,688][123091] Updated weights for policy 0, policy_version 550875 (0.0010) [2023-12-26 03:58:59,754][123091] Updated weights for policy 0, policy_version 550885 (0.0011) [2023-12-26 03:58:59,813][123091] Updated weights for policy 0, policy_version 550895 (0.0010) [2023-12-26 03:59:00,291][123090] Updated weights for policy 1, policy_version 546822 (0.0008) [2023-12-26 03:59:00,351][123090] Updated weights for policy 1, policy_version 546832 (0.0009) [2023-12-26 03:59:00,412][123090] Updated weights for policy 1, policy_version 546842 (0.0009) [2023-12-26 03:59:00,638][123091] Updated weights for policy 0, policy_version 550905 (0.0010) [2023-12-26 03:59:00,692][123091] Updated weights for policy 0, policy_version 550915 (0.0010) [2023-12-26 03:59:00,756][123091] Updated weights for policy 0, policy_version 550925 (0.0010) [2023-12-26 03:59:01,259][123090] Updated weights for policy 1, policy_version 546852 (0.0009) [2023-12-26 03:59:01,324][123090] Updated weights for policy 1, policy_version 546862 (0.0009) [2023-12-26 03:59:01,398][123090] Updated weights for policy 1, policy_version 546872 (0.0009) [2023-12-26 03:59:01,567][123091] Updated weights for policy 0, policy_version 550935 (0.0011) [2023-12-26 03:59:01,631][123091] Updated weights for policy 0, policy_version 550945 (0.0011) [2023-12-26 03:59:01,690][123091] Updated weights for policy 0, policy_version 550955 (0.0011) [2023-12-26 03:59:02,179][123090] Updated weights for policy 1, policy_version 546882 (0.0008) [2023-12-26 03:59:02,233][123090] Updated weights for policy 1, policy_version 546893 (0.0009) [2023-12-26 03:59:02,296][123090] Updated weights for policy 1, policy_version 546903 (0.0009) [2023-12-26 03:59:02,557][123091] Updated weights for policy 0, policy_version 550965 (0.0008) [2023-12-26 03:59:02,616][123091] Updated weights for policy 0, policy_version 550975 (0.0005) [2023-12-26 03:59:02,692][123091] Updated weights for policy 0, policy_version 550985 (0.0005) [2023-12-26 03:59:03,177][123090] Updated weights for policy 1, policy_version 546913 (0.0009) [2023-12-26 03:59:03,229][123090] Updated weights for policy 1, policy_version 546923 (0.0008) [2023-12-26 03:59:03,286][123090] Updated weights for policy 1, policy_version 546933 (0.0009) [2023-12-26 03:59:03,349][123090] Updated weights for policy 1, policy_version 546943 (0.0009) [2023-12-26 03:59:03,380][123091] Updated weights for policy 0, policy_version 550995 (0.0008) [2023-12-26 03:59:03,443][123091] Updated weights for policy 0, policy_version 551005 (0.0010) [2023-12-26 03:59:03,507][123091] Updated weights for policy 0, policy_version 551015 (0.0009) [2023-12-26 03:59:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 281083904. Throughput: 0: 8777.8, 1: 8752.4. Samples: 281093160. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:59:03,785][121949] Avg episode reward: [(0, '6055.585'), (1, '6001.990')] [2023-12-26 03:59:04,236][123090] Updated weights for policy 1, policy_version 546953 (0.0010) [2023-12-26 03:59:04,306][123090] Updated weights for policy 1, policy_version 546963 (0.0010) [2023-12-26 03:59:04,322][123091] Updated weights for policy 0, policy_version 551025 (0.0009) [2023-12-26 03:59:04,373][123090] Updated weights for policy 1, policy_version 546973 (0.0008) [2023-12-26 03:59:04,381][123091] Updated weights for policy 0, policy_version 551035 (0.0009) [2023-12-26 03:59:04,445][123091] Updated weights for policy 0, policy_version 551045 (0.0008) [2023-12-26 03:59:04,497][123091] Updated weights for policy 0, policy_version 551055 (0.0008) [2023-12-26 03:59:05,225][123090] Updated weights for policy 1, policy_version 546983 (0.0009) [2023-12-26 03:59:05,265][123091] Updated weights for policy 0, policy_version 551065 (0.0008) [2023-12-26 03:59:05,275][123090] Updated weights for policy 1, policy_version 546993 (0.0008) [2023-12-26 03:59:05,313][123091] Updated weights for policy 0, policy_version 551075 (0.0006) [2023-12-26 03:59:05,335][123090] Updated weights for policy 1, policy_version 547003 (0.0010) [2023-12-26 03:59:05,362][123091] Updated weights for policy 0, policy_version 551085 (0.0009) [2023-12-26 03:59:06,082][123091] Updated weights for policy 0, policy_version 551095 (0.0005) [2023-12-26 03:59:06,155][123091] Updated weights for policy 0, policy_version 551105 (0.0007) [2023-12-26 03:59:06,225][123091] Updated weights for policy 0, policy_version 551115 (0.0007) [2023-12-26 03:59:06,258][123090] Updated weights for policy 1, policy_version 547013 (0.0008) [2023-12-26 03:59:06,307][123090] Updated weights for policy 1, policy_version 547023 (0.0009) [2023-12-26 03:59:06,364][123090] Updated weights for policy 1, policy_version 547033 (0.0009) [2023-12-26 03:59:06,927][123091] Updated weights for policy 0, policy_version 551125 (0.0010) [2023-12-26 03:59:06,975][123091] Updated weights for policy 0, policy_version 551135 (0.0009) [2023-12-26 03:59:07,025][123091] Updated weights for policy 0, policy_version 551145 (0.0009) [2023-12-26 03:59:07,257][123090] Updated weights for policy 1, policy_version 547043 (0.0010) [2023-12-26 03:59:07,324][123090] Updated weights for policy 1, policy_version 547053 (0.0010) [2023-12-26 03:59:07,389][123090] Updated weights for policy 1, policy_version 547063 (0.0009) [2023-12-26 03:59:07,862][123091] Updated weights for policy 0, policy_version 551155 (0.0010) [2023-12-26 03:59:07,930][123091] Updated weights for policy 0, policy_version 551165 (0.0009) [2023-12-26 03:59:07,994][123091] Updated weights for policy 0, policy_version 551175 (0.0011) [2023-12-26 03:59:08,142][123090] Updated weights for policy 1, policy_version 547073 (0.0010) [2023-12-26 03:59:08,191][123090] Updated weights for policy 1, policy_version 547083 (0.0009) [2023-12-26 03:59:08,247][123090] Updated weights for policy 1, policy_version 547093 (0.0008) [2023-12-26 03:59:08,293][123090] Updated weights for policy 1, policy_version 547103 (0.0005) [2023-12-26 03:59:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 281165824. Throughput: 0: 8832.5, 1: 8749.7. Samples: 281145784. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:59:08,785][121949] Avg episode reward: [(0, '6148.109'), (1, '5952.284')] [2023-12-26 03:59:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000551184_141107200.pth... [2023-12-26 03:59:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000547104_140058624.pth... [2023-12-26 03:59:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000550160_140845056.pth [2023-12-26 03:59:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000546112_139804672.pth [2023-12-26 03:59:08,843][123091] Updated weights for policy 0, policy_version 551185 (0.0010) [2023-12-26 03:59:08,901][123091] Updated weights for policy 0, policy_version 551195 (0.0010) [2023-12-26 03:59:08,966][123091] Updated weights for policy 0, policy_version 551205 (0.0011) [2023-12-26 03:59:09,031][123091] Updated weights for policy 0, policy_version 551215 (0.0008) [2023-12-26 03:59:09,129][123090] Updated weights for policy 1, policy_version 547113 (0.0009) [2023-12-26 03:59:09,188][123090] Updated weights for policy 1, policy_version 547123 (0.0010) [2023-12-26 03:59:09,254][123090] Updated weights for policy 1, policy_version 547133 (0.0009) [2023-12-26 03:59:09,826][123091] Updated weights for policy 0, policy_version 551225 (0.0010) [2023-12-26 03:59:09,901][123091] Updated weights for policy 0, policy_version 551235 (0.0011) [2023-12-26 03:59:09,973][123091] Updated weights for policy 0, policy_version 551245 (0.0009) [2023-12-26 03:59:10,137][123090] Updated weights for policy 1, policy_version 547143 (0.0008) [2023-12-26 03:59:10,204][123090] Updated weights for policy 1, policy_version 547153 (0.0009) [2023-12-26 03:59:10,273][123090] Updated weights for policy 1, policy_version 547163 (0.0010) [2023-12-26 03:59:10,682][123091] Updated weights for policy 0, policy_version 551255 (0.0008) [2023-12-26 03:59:10,752][123091] Updated weights for policy 0, policy_version 551265 (0.0007) [2023-12-26 03:59:10,817][123091] Updated weights for policy 0, policy_version 551275 (0.0008) [2023-12-26 03:59:11,175][123090] Updated weights for policy 1, policy_version 547173 (0.0010) [2023-12-26 03:59:11,245][123090] Updated weights for policy 1, policy_version 547183 (0.0009) [2023-12-26 03:59:11,311][123090] Updated weights for policy 1, policy_version 547193 (0.0010) [2023-12-26 03:59:11,584][123091] Updated weights for policy 0, policy_version 551285 (0.0008) [2023-12-26 03:59:11,654][123091] Updated weights for policy 0, policy_version 551295 (0.0010) [2023-12-26 03:59:11,711][123091] Updated weights for policy 0, policy_version 551305 (0.0009) [2023-12-26 03:59:12,201][123090] Updated weights for policy 1, policy_version 547203 (0.0010) [2023-12-26 03:59:12,269][123090] Updated weights for policy 1, policy_version 547213 (0.0008) [2023-12-26 03:59:12,326][123090] Updated weights for policy 1, policy_version 547223 (0.0009) [2023-12-26 03:59:12,533][123091] Updated weights for policy 0, policy_version 551315 (0.0007) [2023-12-26 03:59:12,604][123091] Updated weights for policy 0, policy_version 551325 (0.0008) [2023-12-26 03:59:12,668][123091] Updated weights for policy 0, policy_version 551335 (0.0010) [2023-12-26 03:59:13,213][123090] Updated weights for policy 1, policy_version 547233 (0.0010) [2023-12-26 03:59:13,279][123090] Updated weights for policy 1, policy_version 547243 (0.0010) [2023-12-26 03:59:13,333][123091] Updated weights for policy 0, policy_version 551345 (0.0009) [2023-12-26 03:59:13,335][123090] Updated weights for policy 1, policy_version 547253 (0.0009) [2023-12-26 03:59:13,393][123091] Updated weights for policy 0, policy_version 551355 (0.0008) [2023-12-26 03:59:13,405][123090] Updated weights for policy 1, policy_version 547263 (0.0006) [2023-12-26 03:59:13,454][123091] Updated weights for policy 0, policy_version 551365 (0.0009) [2023-12-26 03:59:13,524][123091] Updated weights for policy 0, policy_version 551375 (0.0005) [2023-12-26 03:59:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 281255936. Throughput: 0: 8819.3, 1: 8636.4. Samples: 281248524. Policy #0 lag: (min: 28.0, avg: 37.4, max: 60.0) [2023-12-26 03:59:13,785][121949] Avg episode reward: [(0, '6040.651'), (1, '5937.069')] [2023-12-26 03:59:14,024][123090] Updated weights for policy 1, policy_version 547273 (0.0005) [2023-12-26 03:59:14,085][123090] Updated weights for policy 1, policy_version 547283 (0.0007) [2023-12-26 03:59:14,124][123091] Updated weights for policy 0, policy_version 551385 (0.0005) [2023-12-26 03:59:14,154][123090] Updated weights for policy 1, policy_version 547293 (0.0010) [2023-12-26 03:59:14,188][123091] Updated weights for policy 0, policy_version 551395 (0.0006) [2023-12-26 03:59:14,252][123091] Updated weights for policy 0, policy_version 551405 (0.0008) [2023-12-26 03:59:14,928][123090] Updated weights for policy 1, policy_version 547303 (0.0007) [2023-12-26 03:59:15,000][123090] Updated weights for policy 1, policy_version 547313 (0.0009) [2023-12-26 03:59:15,055][123091] Updated weights for policy 0, policy_version 551415 (0.0008) [2023-12-26 03:59:15,062][123090] Updated weights for policy 1, policy_version 547323 (0.0007) [2023-12-26 03:59:15,120][123091] Updated weights for policy 0, policy_version 551425 (0.0009) [2023-12-26 03:59:15,179][123091] Updated weights for policy 0, policy_version 551435 (0.0010) [2023-12-26 03:59:15,683][123090] Updated weights for policy 1, policy_version 547333 (0.0006) [2023-12-26 03:59:15,747][123090] Updated weights for policy 1, policy_version 547343 (0.0007) [2023-12-26 03:59:15,812][123090] Updated weights for policy 1, policy_version 547353 (0.0006) [2023-12-26 03:59:16,111][123091] Updated weights for policy 0, policy_version 551445 (0.0010) [2023-12-26 03:59:16,168][123091] Updated weights for policy 0, policy_version 551455 (0.0008) [2023-12-26 03:59:16,233][123091] Updated weights for policy 0, policy_version 551465 (0.0010) [2023-12-26 03:59:16,559][123090] Updated weights for policy 1, policy_version 547363 (0.0006) [2023-12-26 03:59:16,607][123090] Updated weights for policy 1, policy_version 547373 (0.0009) [2023-12-26 03:59:16,659][123090] Updated weights for policy 1, policy_version 547383 (0.0009) [2023-12-26 03:59:17,013][123091] Updated weights for policy 0, policy_version 551475 (0.0009) [2023-12-26 03:59:17,060][123091] Updated weights for policy 0, policy_version 551485 (0.0005) [2023-12-26 03:59:17,120][123091] Updated weights for policy 0, policy_version 551495 (0.0009) [2023-12-26 03:59:17,476][123090] Updated weights for policy 1, policy_version 547394 (0.0010) [2023-12-26 03:59:17,541][123090] Updated weights for policy 1, policy_version 547404 (0.0008) [2023-12-26 03:59:17,605][123090] Updated weights for policy 1, policy_version 547414 (0.0008) [2023-12-26 03:59:17,669][123090] Updated weights for policy 1, policy_version 547424 (0.0007) [2023-12-26 03:59:17,983][123091] Updated weights for policy 0, policy_version 551505 (0.0009) [2023-12-26 03:59:18,055][123091] Updated weights for policy 0, policy_version 551515 (0.0010) [2023-12-26 03:59:18,120][123091] Updated weights for policy 0, policy_version 551526 (0.0010) [2023-12-26 03:59:18,177][123091] Updated weights for policy 0, policy_version 551536 (0.0010) [2023-12-26 03:59:18,351][123090] Updated weights for policy 1, policy_version 547434 (0.0007) [2023-12-26 03:59:18,419][123090] Updated weights for policy 1, policy_version 547444 (0.0006) [2023-12-26 03:59:18,484][123090] Updated weights for policy 1, policy_version 547454 (0.0010) [2023-12-26 03:59:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 281346048. Throughput: 0: 8865.8, 1: 8670.4. Samples: 281358720. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:18,785][121949] Avg episode reward: [(0, '6024.453'), (1, '5878.798')] [2023-12-26 03:59:19,052][123091] Updated weights for policy 0, policy_version 551546 (0.0010) [2023-12-26 03:59:19,083][123090] Updated weights for policy 1, policy_version 547464 (0.0006) [2023-12-26 03:59:19,102][123091] Updated weights for policy 0, policy_version 551556 (0.0009) [2023-12-26 03:59:19,140][123090] Updated weights for policy 1, policy_version 547474 (0.0005) [2023-12-26 03:59:19,163][123091] Updated weights for policy 0, policy_version 551566 (0.0009) [2023-12-26 03:59:19,193][123090] Updated weights for policy 1, policy_version 547484 (0.0005) [2023-12-26 03:59:19,976][123090] Updated weights for policy 1, policy_version 547494 (0.0008) [2023-12-26 03:59:20,017][123091] Updated weights for policy 0, policy_version 551576 (0.0008) [2023-12-26 03:59:20,038][123090] Updated weights for policy 1, policy_version 547504 (0.0008) [2023-12-26 03:59:20,077][123091] Updated weights for policy 0, policy_version 551586 (0.0009) [2023-12-26 03:59:20,102][123090] Updated weights for policy 1, policy_version 547514 (0.0009) [2023-12-26 03:59:20,144][123091] Updated weights for policy 0, policy_version 551596 (0.0009) [2023-12-26 03:59:20,926][123091] Updated weights for policy 0, policy_version 551606 (0.0009) [2023-12-26 03:59:20,986][123090] Updated weights for policy 1, policy_version 547524 (0.0008) [2023-12-26 03:59:20,997][123091] Updated weights for policy 0, policy_version 551616 (0.0008) [2023-12-26 03:59:21,052][123090] Updated weights for policy 1, policy_version 547534 (0.0009) [2023-12-26 03:59:21,068][123091] Updated weights for policy 0, policy_version 551626 (0.0007) [2023-12-26 03:59:21,122][123090] Updated weights for policy 1, policy_version 547544 (0.0009) [2023-12-26 03:59:21,892][123091] Updated weights for policy 0, policy_version 551636 (0.0009) [2023-12-26 03:59:21,955][123091] Updated weights for policy 0, policy_version 551646 (0.0009) [2023-12-26 03:59:21,990][123090] Updated weights for policy 1, policy_version 547554 (0.0009) [2023-12-26 03:59:22,014][123091] Updated weights for policy 0, policy_version 551656 (0.0009) [2023-12-26 03:59:22,060][123090] Updated weights for policy 1, policy_version 547564 (0.0005) [2023-12-26 03:59:22,134][123090] Updated weights for policy 1, policy_version 547574 (0.0007) [2023-12-26 03:59:22,203][123090] Updated weights for policy 1, policy_version 547584 (0.0009) [2023-12-26 03:59:22,861][123091] Updated weights for policy 0, policy_version 551666 (0.0010) [2023-12-26 03:59:22,919][123091] Updated weights for policy 0, policy_version 551676 (0.0009) [2023-12-26 03:59:22,980][123090] Updated weights for policy 1, policy_version 547594 (0.0009) [2023-12-26 03:59:22,984][123091] Updated weights for policy 0, policy_version 551686 (0.0010) [2023-12-26 03:59:23,035][123090] Updated weights for policy 1, policy_version 547604 (0.0008) [2023-12-26 03:59:23,045][123091] Updated weights for policy 0, policy_version 551696 (0.0008) [2023-12-26 03:59:23,097][123090] Updated weights for policy 1, policy_version 547614 (0.0009) [2023-12-26 03:59:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 281427968. Throughput: 0: 8824.5, 1: 8623.4. Samples: 281410272. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:23,785][121949] Avg episode reward: [(0, '6058.937'), (1, '5850.185')] [2023-12-26 03:59:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000551696_141238272.pth... [2023-12-26 03:59:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000547616_140189696.pth... [2023-12-26 03:59:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000550672_140976128.pth [2023-12-26 03:59:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000546624_139935744.pth [2023-12-26 03:59:23,890][123091] Updated weights for policy 0, policy_version 551706 (0.0006) [2023-12-26 03:59:23,946][123090] Updated weights for policy 1, policy_version 547624 (0.0009) [2023-12-26 03:59:23,951][123091] Updated weights for policy 0, policy_version 551716 (0.0006) [2023-12-26 03:59:24,007][123091] Updated weights for policy 0, policy_version 551726 (0.0005) [2023-12-26 03:59:24,008][123090] Updated weights for policy 1, policy_version 547634 (0.0010) [2023-12-26 03:59:24,077][123090] Updated weights for policy 1, policy_version 547644 (0.0010) [2023-12-26 03:59:24,610][123091] Updated weights for policy 0, policy_version 551736 (0.0005) [2023-12-26 03:59:24,678][123091] Updated weights for policy 0, policy_version 551746 (0.0009) [2023-12-26 03:59:24,742][123091] Updated weights for policy 0, policy_version 551756 (0.0011) [2023-12-26 03:59:24,941][123090] Updated weights for policy 1, policy_version 547654 (0.0007) [2023-12-26 03:59:25,001][123090] Updated weights for policy 1, policy_version 547664 (0.0007) [2023-12-26 03:59:25,063][123090] Updated weights for policy 1, policy_version 547674 (0.0006) [2023-12-26 03:59:25,541][123091] Updated weights for policy 0, policy_version 551767 (0.0011) [2023-12-26 03:59:25,594][123091] Updated weights for policy 0, policy_version 551778 (0.0010) [2023-12-26 03:59:25,645][123091] Updated weights for policy 0, policy_version 551788 (0.0009) [2023-12-26 03:59:25,776][123090] Updated weights for policy 1, policy_version 547684 (0.0006) [2023-12-26 03:59:25,847][123090] Updated weights for policy 1, policy_version 547694 (0.0009) [2023-12-26 03:59:25,902][123090] Updated weights for policy 1, policy_version 547704 (0.0009) [2023-12-26 03:59:26,502][123091] Updated weights for policy 0, policy_version 551798 (0.0009) [2023-12-26 03:59:26,563][123091] Updated weights for policy 0, policy_version 551808 (0.0010) [2023-12-26 03:59:26,614][123091] Updated weights for policy 0, policy_version 551818 (0.0007) [2023-12-26 03:59:26,716][123090] Updated weights for policy 1, policy_version 547714 (0.0008) [2023-12-26 03:59:26,765][123090] Updated weights for policy 1, policy_version 547724 (0.0008) [2023-12-26 03:59:26,818][123090] Updated weights for policy 1, policy_version 547734 (0.0010) [2023-12-26 03:59:26,885][123090] Updated weights for policy 1, policy_version 547744 (0.0010) [2023-12-26 03:59:27,431][123091] Updated weights for policy 0, policy_version 551828 (0.0009) [2023-12-26 03:59:27,499][123091] Updated weights for policy 0, policy_version 551838 (0.0010) [2023-12-26 03:59:27,559][123091] Updated weights for policy 0, policy_version 551848 (0.0008) [2023-12-26 03:59:27,745][123090] Updated weights for policy 1, policy_version 547754 (0.0010) [2023-12-26 03:59:27,802][123090] Updated weights for policy 1, policy_version 547764 (0.0009) [2023-12-26 03:59:27,863][123090] Updated weights for policy 1, policy_version 547774 (0.0009) [2023-12-26 03:59:28,354][123091] Updated weights for policy 0, policy_version 551858 (0.0009) [2023-12-26 03:59:28,420][123091] Updated weights for policy 0, policy_version 551868 (0.0011) [2023-12-26 03:59:28,479][123091] Updated weights for policy 0, policy_version 551878 (0.0008) [2023-12-26 03:59:28,548][123091] Updated weights for policy 0, policy_version 551888 (0.0006) [2023-12-26 03:59:28,734][123090] Updated weights for policy 1, policy_version 547784 (0.0008) [2023-12-26 03:59:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 281518080. Throughput: 0: 8806.0, 1: 8597.6. Samples: 281514764. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:28,785][121949] Avg episode reward: [(0, '6043.529'), (1, '5721.335')] [2023-12-26 03:59:28,804][123090] Updated weights for policy 1, policy_version 547794 (0.0009) [2023-12-26 03:59:28,866][123090] Updated weights for policy 1, policy_version 547804 (0.0009) [2023-12-26 03:59:29,223][123091] Updated weights for policy 0, policy_version 551898 (0.0011) [2023-12-26 03:59:29,292][123091] Updated weights for policy 0, policy_version 551908 (0.0010) [2023-12-26 03:59:29,354][123091] Updated weights for policy 0, policy_version 551918 (0.0010) [2023-12-26 03:59:29,742][123090] Updated weights for policy 1, policy_version 547814 (0.0010) [2023-12-26 03:59:29,794][123090] Updated weights for policy 1, policy_version 547824 (0.0010) [2023-12-26 03:59:29,855][123090] Updated weights for policy 1, policy_version 547834 (0.0009) [2023-12-26 03:59:30,092][123091] Updated weights for policy 0, policy_version 551928 (0.0009) [2023-12-26 03:59:30,151][123091] Updated weights for policy 0, policy_version 551938 (0.0009) [2023-12-26 03:59:30,219][123091] Updated weights for policy 0, policy_version 551948 (0.0009) [2023-12-26 03:59:30,580][123090] Updated weights for policy 1, policy_version 547844 (0.0008) [2023-12-26 03:59:30,626][123090] Updated weights for policy 1, policy_version 547854 (0.0005) [2023-12-26 03:59:30,676][123090] Updated weights for policy 1, policy_version 547864 (0.0005) [2023-12-26 03:59:31,062][123091] Updated weights for policy 0, policy_version 551958 (0.0007) [2023-12-26 03:59:31,131][123091] Updated weights for policy 0, policy_version 551968 (0.0007) [2023-12-26 03:59:31,192][123091] Updated weights for policy 0, policy_version 551978 (0.0008) [2023-12-26 03:59:31,394][123090] Updated weights for policy 1, policy_version 547874 (0.0006) [2023-12-26 03:59:31,458][123090] Updated weights for policy 1, policy_version 547884 (0.0005) [2023-12-26 03:59:31,513][123090] Updated weights for policy 1, policy_version 547894 (0.0008) [2023-12-26 03:59:31,566][123090] Updated weights for policy 1, policy_version 547904 (0.0007) [2023-12-26 03:59:31,995][123091] Updated weights for policy 0, policy_version 551988 (0.0007) [2023-12-26 03:59:32,050][123091] Updated weights for policy 0, policy_version 551998 (0.0005) [2023-12-26 03:59:32,129][123091] Updated weights for policy 0, policy_version 552008 (0.0005) [2023-12-26 03:59:32,315][123090] Updated weights for policy 1, policy_version 547914 (0.0010) [2023-12-26 03:59:32,383][123090] Updated weights for policy 1, policy_version 547924 (0.0010) [2023-12-26 03:59:32,454][123090] Updated weights for policy 1, policy_version 547934 (0.0007) [2023-12-26 03:59:32,833][123091] Updated weights for policy 0, policy_version 552018 (0.0005) [2023-12-26 03:59:32,910][123091] Updated weights for policy 0, policy_version 552028 (0.0006) [2023-12-26 03:59:32,971][123091] Updated weights for policy 0, policy_version 552038 (0.0006) [2023-12-26 03:59:33,026][123091] Updated weights for policy 0, policy_version 552048 (0.0006) [2023-12-26 03:59:33,179][123090] Updated weights for policy 1, policy_version 547944 (0.0005) [2023-12-26 03:59:33,237][123090] Updated weights for policy 1, policy_version 547954 (0.0005) [2023-12-26 03:59:33,305][123090] Updated weights for policy 1, policy_version 547964 (0.0005) [2023-12-26 03:59:33,646][123091] Updated weights for policy 0, policy_version 552058 (0.0006) [2023-12-26 03:59:33,702][123091] Updated weights for policy 0, policy_version 552068 (0.0007) [2023-12-26 03:59:33,753][123091] Updated weights for policy 0, policy_version 552078 (0.0009) [2023-12-26 03:59:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 281616384. Throughput: 0: 8887.4, 1: 8654.5. Samples: 281625444. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:33,785][121949] Avg episode reward: [(0, '5990.089'), (1, '5409.940')] [2023-12-26 03:59:34,030][123090] Updated weights for policy 1, policy_version 547974 (0.0008) [2023-12-26 03:59:34,076][123090] Updated weights for policy 1, policy_version 547984 (0.0008) [2023-12-26 03:59:34,132][123090] Updated weights for policy 1, policy_version 547994 (0.0005) [2023-12-26 03:59:34,515][123091] Updated weights for policy 0, policy_version 552088 (0.0010) [2023-12-26 03:59:34,587][123091] Updated weights for policy 0, policy_version 552098 (0.0010) [2023-12-26 03:59:34,653][123091] Updated weights for policy 0, policy_version 552108 (0.0009) [2023-12-26 03:59:35,008][123090] Updated weights for policy 1, policy_version 548004 (0.0009) [2023-12-26 03:59:35,074][123090] Updated weights for policy 1, policy_version 548014 (0.0009) [2023-12-26 03:59:35,140][123090] Updated weights for policy 1, policy_version 548024 (0.0009) [2023-12-26 03:59:35,443][123091] Updated weights for policy 0, policy_version 552118 (0.0010) [2023-12-26 03:59:35,502][123091] Updated weights for policy 0, policy_version 552128 (0.0010) [2023-12-26 03:59:35,554][123091] Updated weights for policy 0, policy_version 552138 (0.0010) [2023-12-26 03:59:35,946][123090] Updated weights for policy 1, policy_version 548034 (0.0010) [2023-12-26 03:59:36,006][123090] Updated weights for policy 1, policy_version 548044 (0.0010) [2023-12-26 03:59:36,054][123090] Updated weights for policy 1, policy_version 548054 (0.0009) [2023-12-26 03:59:36,116][123090] Updated weights for policy 1, policy_version 548064 (0.0008) [2023-12-26 03:59:36,362][123091] Updated weights for policy 0, policy_version 552148 (0.0010) [2023-12-26 03:59:36,415][123091] Updated weights for policy 0, policy_version 552158 (0.0010) [2023-12-26 03:59:36,469][123091] Updated weights for policy 0, policy_version 552168 (0.0010) [2023-12-26 03:59:36,966][123090] Updated weights for policy 1, policy_version 548074 (0.0009) [2023-12-26 03:59:37,032][123090] Updated weights for policy 1, policy_version 548084 (0.0009) [2023-12-26 03:59:37,091][123090] Updated weights for policy 1, policy_version 548094 (0.0009) [2023-12-26 03:59:37,335][123091] Updated weights for policy 0, policy_version 552178 (0.0010) [2023-12-26 03:59:37,385][123091] Updated weights for policy 0, policy_version 552188 (0.0009) [2023-12-26 03:59:37,442][123091] Updated weights for policy 0, policy_version 552199 (0.0010) [2023-12-26 03:59:37,877][123090] Updated weights for policy 1, policy_version 548104 (0.0009) [2023-12-26 03:59:37,936][123090] Updated weights for policy 1, policy_version 548114 (0.0006) [2023-12-26 03:59:37,998][123090] Updated weights for policy 1, policy_version 548124 (0.0009) [2023-12-26 03:59:38,323][123091] Updated weights for policy 0, policy_version 552209 (0.0009) [2023-12-26 03:59:38,390][123091] Updated weights for policy 0, policy_version 552219 (0.0007) [2023-12-26 03:59:38,451][123091] Updated weights for policy 0, policy_version 552229 (0.0006) [2023-12-26 03:59:38,514][123091] Updated weights for policy 0, policy_version 552239 (0.0006) [2023-12-26 03:59:38,751][123090] Updated weights for policy 1, policy_version 548134 (0.0007) [2023-12-26 03:59:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 281698304. Throughput: 0: 8903.6, 1: 8620.9. Samples: 281677176. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:38,785][121949] Avg episode reward: [(0, '6019.916'), (1, '5546.683')] [2023-12-26 03:59:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000552240_141377536.pth... [2023-12-26 03:59:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000551184_141107200.pth [2023-12-26 03:59:38,821][123090] Updated weights for policy 1, policy_version 548144 (0.0008) [2023-12-26 03:59:38,892][123090] Updated weights for policy 1, policy_version 548154 (0.0009) [2023-12-26 03:59:38,931][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000548160_140328960.pth... [2023-12-26 03:59:38,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000547104_140058624.pth [2023-12-26 03:59:39,262][123091] Updated weights for policy 0, policy_version 552249 (0.0007) [2023-12-26 03:59:39,315][123091] Updated weights for policy 0, policy_version 552259 (0.0009) [2023-12-26 03:59:39,381][123091] Updated weights for policy 0, policy_version 552269 (0.0009) [2023-12-26 03:59:39,516][123090] Updated weights for policy 1, policy_version 548164 (0.0007) [2023-12-26 03:59:39,577][123090] Updated weights for policy 1, policy_version 548174 (0.0006) [2023-12-26 03:59:39,643][123090] Updated weights for policy 1, policy_version 548184 (0.0005) [2023-12-26 03:59:40,252][123091] Updated weights for policy 0, policy_version 552279 (0.0010) [2023-12-26 03:59:40,311][123091] Updated weights for policy 0, policy_version 552289 (0.0010) [2023-12-26 03:59:40,381][123091] Updated weights for policy 0, policy_version 552299 (0.0010) [2023-12-26 03:59:40,414][123090] Updated weights for policy 1, policy_version 548194 (0.0006) [2023-12-26 03:59:40,483][123090] Updated weights for policy 1, policy_version 548204 (0.0009) [2023-12-26 03:59:40,546][123090] Updated weights for policy 1, policy_version 548214 (0.0010) [2023-12-26 03:59:40,610][123090] Updated weights for policy 1, policy_version 548224 (0.0005) [2023-12-26 03:59:41,262][123091] Updated weights for policy 0, policy_version 552309 (0.0009) [2023-12-26 03:59:41,311][123091] Updated weights for policy 0, policy_version 552319 (0.0009) [2023-12-26 03:59:41,374][123091] Updated weights for policy 0, policy_version 552329 (0.0009) [2023-12-26 03:59:41,465][123090] Updated weights for policy 1, policy_version 548234 (0.0009) [2023-12-26 03:59:41,533][123090] Updated weights for policy 1, policy_version 548244 (0.0009) [2023-12-26 03:59:41,592][123090] Updated weights for policy 1, policy_version 548254 (0.0010) [2023-12-26 03:59:42,146][123091] Updated weights for policy 0, policy_version 552339 (0.0007) [2023-12-26 03:59:42,198][123091] Updated weights for policy 0, policy_version 552349 (0.0006) [2023-12-26 03:59:42,253][123091] Updated weights for policy 0, policy_version 552359 (0.0007) [2023-12-26 03:59:42,518][123090] Updated weights for policy 1, policy_version 548264 (0.0010) [2023-12-26 03:59:42,572][123090] Updated weights for policy 1, policy_version 548274 (0.0010) [2023-12-26 03:59:42,632][123090] Updated weights for policy 1, policy_version 548284 (0.0009) [2023-12-26 03:59:43,053][123091] Updated weights for policy 0, policy_version 552369 (0.0009) [2023-12-26 03:59:43,106][123091] Updated weights for policy 0, policy_version 552379 (0.0010) [2023-12-26 03:59:43,161][123091] Updated weights for policy 0, policy_version 552389 (0.0010) [2023-12-26 03:59:43,226][123091] Updated weights for policy 0, policy_version 552399 (0.0010) [2023-12-26 03:59:43,354][123090] Updated weights for policy 1, policy_version 548294 (0.0007) [2023-12-26 03:59:43,419][123090] Updated weights for policy 1, policy_version 548304 (0.0006) [2023-12-26 03:59:43,478][123090] Updated weights for policy 1, policy_version 548314 (0.0007) [2023-12-26 03:59:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 281788416. Throughput: 0: 8836.0, 1: 8698.2. Samples: 281781592. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:43,784][121949] Avg episode reward: [(0, '6107.454'), (1, '5637.622')] [2023-12-26 03:59:44,016][123091] Updated weights for policy 0, policy_version 552409 (0.0006) [2023-12-26 03:59:44,070][123091] Updated weights for policy 0, policy_version 552419 (0.0005) [2023-12-26 03:59:44,127][123091] Updated weights for policy 0, policy_version 552429 (0.0005) [2023-12-26 03:59:44,146][123090] Updated weights for policy 1, policy_version 548324 (0.0006) [2023-12-26 03:59:44,201][123090] Updated weights for policy 1, policy_version 548334 (0.0007) [2023-12-26 03:59:44,275][123090] Updated weights for policy 1, policy_version 548344 (0.0006) [2023-12-26 03:59:44,805][123091] Updated weights for policy 0, policy_version 552439 (0.0007) [2023-12-26 03:59:44,877][123091] Updated weights for policy 0, policy_version 552449 (0.0008) [2023-12-26 03:59:44,946][123091] Updated weights for policy 0, policy_version 552459 (0.0009) [2023-12-26 03:59:45,003][123090] Updated weights for policy 1, policy_version 548354 (0.0006) [2023-12-26 03:59:45,073][123090] Updated weights for policy 1, policy_version 548364 (0.0006) [2023-12-26 03:59:45,139][123090] Updated weights for policy 1, policy_version 548374 (0.0006) [2023-12-26 03:59:45,209][123090] Updated weights for policy 1, policy_version 548384 (0.0006) [2023-12-26 03:59:45,815][123091] Updated weights for policy 0, policy_version 552469 (0.0009) [2023-12-26 03:59:45,871][123091] Updated weights for policy 0, policy_version 552479 (0.0009) [2023-12-26 03:59:45,920][123091] Updated weights for policy 0, policy_version 552489 (0.0006) [2023-12-26 03:59:45,920][123090] Updated weights for policy 1, policy_version 548394 (0.0010) [2023-12-26 03:59:45,968][123090] Updated weights for policy 1, policy_version 548404 (0.0010) [2023-12-26 03:59:46,026][123090] Updated weights for policy 1, policy_version 548414 (0.0007) [2023-12-26 03:59:46,704][123090] Updated weights for policy 1, policy_version 548424 (0.0006) [2023-12-26 03:59:46,760][123090] Updated weights for policy 1, policy_version 548434 (0.0005) [2023-12-26 03:59:46,806][123091] Updated weights for policy 0, policy_version 552499 (0.0006) [2023-12-26 03:59:46,820][123090] Updated weights for policy 1, policy_version 548444 (0.0005) [2023-12-26 03:59:46,865][123091] Updated weights for policy 0, policy_version 552509 (0.0005) [2023-12-26 03:59:46,936][123091] Updated weights for policy 0, policy_version 552519 (0.0005) [2023-12-26 03:59:47,440][123090] Updated weights for policy 1, policy_version 548454 (0.0005) [2023-12-26 03:59:47,510][123090] Updated weights for policy 1, policy_version 548464 (0.0005) [2023-12-26 03:59:47,574][123090] Updated weights for policy 1, policy_version 548474 (0.0005) [2023-12-26 03:59:47,783][123091] Updated weights for policy 0, policy_version 552529 (0.0010) [2023-12-26 03:59:47,832][123091] Updated weights for policy 0, policy_version 552539 (0.0010) [2023-12-26 03:59:47,877][123091] Updated weights for policy 0, policy_version 552549 (0.0010) [2023-12-26 03:59:47,929][123091] Updated weights for policy 0, policy_version 552559 (0.0010) [2023-12-26 03:59:48,155][123090] Updated weights for policy 1, policy_version 548484 (0.0005) [2023-12-26 03:59:48,222][123090] Updated weights for policy 1, policy_version 548494 (0.0005) [2023-12-26 03:59:48,278][123090] Updated weights for policy 1, policy_version 548504 (0.0005) [2023-12-26 03:59:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 281878528. Throughput: 0: 8860.0, 1: 8925.2. Samples: 281893492. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:48,785][121949] Avg episode reward: [(0, '6255.955'), (1, '5717.815')] [2023-12-26 03:59:48,793][123091] Updated weights for policy 0, policy_version 552569 (0.0011) [2023-12-26 03:59:48,852][123091] Updated weights for policy 0, policy_version 552579 (0.0011) [2023-12-26 03:59:48,908][123091] Updated weights for policy 0, policy_version 552589 (0.0011) [2023-12-26 03:59:48,973][123090] Updated weights for policy 1, policy_version 548514 (0.0006) [2023-12-26 03:59:49,031][123090] Updated weights for policy 1, policy_version 548524 (0.0005) [2023-12-26 03:59:49,090][123090] Updated weights for policy 1, policy_version 548534 (0.0005) [2023-12-26 03:59:49,156][123090] Updated weights for policy 1, policy_version 548544 (0.0005) [2023-12-26 03:59:49,680][123091] Updated weights for policy 0, policy_version 552599 (0.0007) [2023-12-26 03:59:49,731][123091] Updated weights for policy 0, policy_version 552609 (0.0005) [2023-12-26 03:59:49,786][123091] Updated weights for policy 0, policy_version 552619 (0.0007) [2023-12-26 03:59:49,900][123090] Updated weights for policy 1, policy_version 548554 (0.0011) [2023-12-26 03:59:49,972][123090] Updated weights for policy 1, policy_version 548564 (0.0010) [2023-12-26 03:59:50,045][123090] Updated weights for policy 1, policy_version 548574 (0.0009) [2023-12-26 03:59:50,599][123091] Updated weights for policy 0, policy_version 552629 (0.0011) [2023-12-26 03:59:50,659][123091] Updated weights for policy 0, policy_version 552639 (0.0011) [2023-12-26 03:59:50,719][123091] Updated weights for policy 0, policy_version 552649 (0.0011) [2023-12-26 03:59:50,842][123090] Updated weights for policy 1, policy_version 548584 (0.0006) [2023-12-26 03:59:50,911][123090] Updated weights for policy 1, policy_version 548594 (0.0006) [2023-12-26 03:59:50,985][123090] Updated weights for policy 1, policy_version 548604 (0.0008) [2023-12-26 03:59:51,578][123091] Updated weights for policy 0, policy_version 552659 (0.0010) [2023-12-26 03:59:51,642][123091] Updated weights for policy 0, policy_version 552669 (0.0009) [2023-12-26 03:59:51,704][123091] Updated weights for policy 0, policy_version 552679 (0.0010) [2023-12-26 03:59:51,786][123090] Updated weights for policy 1, policy_version 548614 (0.0008) [2023-12-26 03:59:51,838][123090] Updated weights for policy 1, policy_version 548624 (0.0009) [2023-12-26 03:59:51,897][123090] Updated weights for policy 1, policy_version 548635 (0.0010) [2023-12-26 03:59:52,519][123091] Updated weights for policy 0, policy_version 552689 (0.0010) [2023-12-26 03:59:52,589][123091] Updated weights for policy 0, policy_version 552699 (0.0009) [2023-12-26 03:59:52,663][123091] Updated weights for policy 0, policy_version 552709 (0.0011) [2023-12-26 03:59:52,730][123091] Updated weights for policy 0, policy_version 552719 (0.0011) [2023-12-26 03:59:52,743][123090] Updated weights for policy 1, policy_version 548646 (0.0009) [2023-12-26 03:59:52,798][123090] Updated weights for policy 1, policy_version 548656 (0.0010) [2023-12-26 03:59:52,869][123090] Updated weights for policy 1, policy_version 548666 (0.0010) [2023-12-26 03:59:53,443][123091] Updated weights for policy 0, policy_version 552729 (0.0008) [2023-12-26 03:59:53,511][123091] Updated weights for policy 0, policy_version 552739 (0.0009) [2023-12-26 03:59:53,570][123091] Updated weights for policy 0, policy_version 552749 (0.0008) [2023-12-26 03:59:53,663][123090] Updated weights for policy 1, policy_version 548676 (0.0010) [2023-12-26 03:59:53,733][123090] Updated weights for policy 1, policy_version 548686 (0.0010) [2023-12-26 03:59:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 281968640. Throughput: 0: 8806.1, 1: 8982.5. Samples: 281946272. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:53,785][121949] Avg episode reward: [(0, '6197.181'), (1, '5688.475')] [2023-12-26 03:59:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000552752_141508608.pth... [2023-12-26 03:59:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000551696_141238272.pth [2023-12-26 03:59:53,795][123090] Updated weights for policy 1, policy_version 548696 (0.0010) [2023-12-26 03:59:53,842][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000548704_140468224.pth... [2023-12-26 03:59:53,845][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000547616_140189696.pth [2023-12-26 03:59:54,381][123091] Updated weights for policy 0, policy_version 552759 (0.0010) [2023-12-26 03:59:54,445][123091] Updated weights for policy 0, policy_version 552769 (0.0008) [2023-12-26 03:59:54,513][123091] Updated weights for policy 0, policy_version 552779 (0.0005) [2023-12-26 03:59:54,608][123090] Updated weights for policy 1, policy_version 548706 (0.0010) [2023-12-26 03:59:54,660][123090] Updated weights for policy 1, policy_version 548716 (0.0010) [2023-12-26 03:59:54,711][123090] Updated weights for policy 1, policy_version 548726 (0.0010) [2023-12-26 03:59:54,762][123090] Updated weights for policy 1, policy_version 548736 (0.0010) [2023-12-26 03:59:55,306][123091] Updated weights for policy 0, policy_version 552789 (0.0009) [2023-12-26 03:59:55,356][123091] Updated weights for policy 0, policy_version 552799 (0.0010) [2023-12-26 03:59:55,410][123091] Updated weights for policy 0, policy_version 552809 (0.0005) [2023-12-26 03:59:55,567][123090] Updated weights for policy 1, policy_version 548746 (0.0010) [2023-12-26 03:59:55,625][123090] Updated weights for policy 1, policy_version 548756 (0.0010) [2023-12-26 03:59:55,679][123090] Updated weights for policy 1, policy_version 548766 (0.0010) [2023-12-26 03:59:56,172][123091] Updated weights for policy 0, policy_version 552819 (0.0007) [2023-12-26 03:59:56,231][123091] Updated weights for policy 0, policy_version 552829 (0.0011) [2023-12-26 03:59:56,292][123091] Updated weights for policy 0, policy_version 552839 (0.0009) [2023-12-26 03:59:56,499][123090] Updated weights for policy 1, policy_version 548776 (0.0010) [2023-12-26 03:59:56,561][123090] Updated weights for policy 1, policy_version 548786 (0.0010) [2023-12-26 03:59:56,608][123090] Updated weights for policy 1, policy_version 548796 (0.0010) [2023-12-26 03:59:57,052][123091] Updated weights for policy 0, policy_version 552849 (0.0010) [2023-12-26 03:59:57,098][123091] Updated weights for policy 0, policy_version 552859 (0.0005) [2023-12-26 03:59:57,146][123091] Updated weights for policy 0, policy_version 552869 (0.0005) [2023-12-26 03:59:57,193][123091] Updated weights for policy 0, policy_version 552879 (0.0009) [2023-12-26 03:59:57,439][123090] Updated weights for policy 1, policy_version 548806 (0.0007) [2023-12-26 03:59:57,498][123090] Updated weights for policy 1, policy_version 548816 (0.0005) [2023-12-26 03:59:57,573][123090] Updated weights for policy 1, policy_version 548826 (0.0005) [2023-12-26 03:59:57,952][123091] Updated weights for policy 0, policy_version 552889 (0.0008) [2023-12-26 03:59:58,018][123091] Updated weights for policy 0, policy_version 552899 (0.0008) [2023-12-26 03:59:58,090][123091] Updated weights for policy 0, policy_version 552909 (0.0008) [2023-12-26 03:59:58,374][123090] Updated weights for policy 1, policy_version 548836 (0.0007) [2023-12-26 03:59:58,450][123090] Updated weights for policy 1, policy_version 548846 (0.0010) [2023-12-26 03:59:58,522][123090] Updated weights for policy 1, policy_version 548856 (0.0008) [2023-12-26 03:59:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 282058752. Throughput: 0: 8829.1, 1: 9052.6. Samples: 282053200. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 03:59:58,785][121949] Avg episode reward: [(0, '6069.512'), (1, '5560.712')] [2023-12-26 03:59:59,058][123091] Updated weights for policy 0, policy_version 552919 (0.0009) [2023-12-26 03:59:59,124][123091] Updated weights for policy 0, policy_version 552929 (0.0009) [2023-12-26 03:59:59,188][123091] Updated weights for policy 0, policy_version 552939 (0.0008) [2023-12-26 03:59:59,445][123090] Updated weights for policy 1, policy_version 548866 (0.0008) [2023-12-26 03:59:59,511][123090] Updated weights for policy 1, policy_version 548876 (0.0008) [2023-12-26 03:59:59,581][123090] Updated weights for policy 1, policy_version 548886 (0.0008) [2023-12-26 03:59:59,650][123090] Updated weights for policy 1, policy_version 548896 (0.0006) [2023-12-26 04:00:00,058][123091] Updated weights for policy 0, policy_version 552949 (0.0008) [2023-12-26 04:00:00,128][123091] Updated weights for policy 0, policy_version 552959 (0.0008) [2023-12-26 04:00:00,182][123091] Updated weights for policy 0, policy_version 552969 (0.0010) [2023-12-26 04:00:00,389][123090] Updated weights for policy 1, policy_version 548906 (0.0010) [2023-12-26 04:00:00,444][123090] Updated weights for policy 1, policy_version 548916 (0.0010) [2023-12-26 04:00:00,503][123090] Updated weights for policy 1, policy_version 548926 (0.0010) [2023-12-26 04:00:00,942][123091] Updated weights for policy 0, policy_version 552979 (0.0009) [2023-12-26 04:00:00,994][123091] Updated weights for policy 0, policy_version 552989 (0.0005) [2023-12-26 04:00:01,062][123091] Updated weights for policy 0, policy_version 552999 (0.0008) [2023-12-26 04:00:01,278][123090] Updated weights for policy 1, policy_version 548936 (0.0007) [2023-12-26 04:00:01,337][123090] Updated weights for policy 1, policy_version 548946 (0.0010) [2023-12-26 04:00:01,413][123090] Updated weights for policy 1, policy_version 548956 (0.0011) [2023-12-26 04:00:01,757][123091] Updated weights for policy 0, policy_version 553009 (0.0007) [2023-12-26 04:00:01,811][123091] Updated weights for policy 0, policy_version 553019 (0.0005) [2023-12-26 04:00:01,870][123091] Updated weights for policy 0, policy_version 553029 (0.0006) [2023-12-26 04:00:01,930][123091] Updated weights for policy 0, policy_version 553039 (0.0008) [2023-12-26 04:00:02,100][123090] Updated weights for policy 1, policy_version 548966 (0.0007) [2023-12-26 04:00:02,164][123090] Updated weights for policy 1, policy_version 548976 (0.0006) [2023-12-26 04:00:02,219][123090] Updated weights for policy 1, policy_version 548986 (0.0010) [2023-12-26 04:00:02,667][123091] Updated weights for policy 0, policy_version 553049 (0.0009) [2023-12-26 04:00:02,736][123091] Updated weights for policy 0, policy_version 553059 (0.0007) [2023-12-26 04:00:02,802][123091] Updated weights for policy 0, policy_version 553069 (0.0008) [2023-12-26 04:00:03,022][123090] Updated weights for policy 1, policy_version 548996 (0.0011) [2023-12-26 04:00:03,081][123090] Updated weights for policy 1, policy_version 549006 (0.0010) [2023-12-26 04:00:03,147][123090] Updated weights for policy 1, policy_version 549016 (0.0010) [2023-12-26 04:00:03,454][123091] Updated weights for policy 0, policy_version 553079 (0.0006) [2023-12-26 04:00:03,501][123091] Updated weights for policy 0, policy_version 553089 (0.0005) [2023-12-26 04:00:03,555][123091] Updated weights for policy 0, policy_version 553099 (0.0005) [2023-12-26 04:00:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 282148864. Throughput: 0: 8847.2, 1: 8936.6. Samples: 282158992. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:03,785][121949] Avg episode reward: [(0, '5924.502'), (1, '5668.879')] [2023-12-26 04:00:03,971][123090] Updated weights for policy 1, policy_version 549026 (0.0010) [2023-12-26 04:00:04,035][123090] Updated weights for policy 1, policy_version 549036 (0.0011) [2023-12-26 04:00:04,102][123090] Updated weights for policy 1, policy_version 549046 (0.0011) [2023-12-26 04:00:04,166][123090] Updated weights for policy 1, policy_version 549056 (0.0011) [2023-12-26 04:00:04,221][123091] Updated weights for policy 0, policy_version 553109 (0.0007) [2023-12-26 04:00:04,293][123091] Updated weights for policy 0, policy_version 553119 (0.0009) [2023-12-26 04:00:04,362][123091] Updated weights for policy 0, policy_version 553129 (0.0009) [2023-12-26 04:00:04,999][123090] Updated weights for policy 1, policy_version 549066 (0.0011) [2023-12-26 04:00:05,059][123090] Updated weights for policy 1, policy_version 549076 (0.0011) [2023-12-26 04:00:05,118][123090] Updated weights for policy 1, policy_version 549086 (0.0010) [2023-12-26 04:00:05,139][123091] Updated weights for policy 0, policy_version 553139 (0.0008) [2023-12-26 04:00:05,206][123091] Updated weights for policy 0, policy_version 553149 (0.0005) [2023-12-26 04:00:05,273][123091] Updated weights for policy 0, policy_version 553159 (0.0005) [2023-12-26 04:00:05,900][123090] Updated weights for policy 1, policy_version 549096 (0.0006) [2023-12-26 04:00:05,958][123090] Updated weights for policy 1, policy_version 549106 (0.0006) [2023-12-26 04:00:05,972][123091] Updated weights for policy 0, policy_version 553169 (0.0006) [2023-12-26 04:00:06,018][123090] Updated weights for policy 1, policy_version 549116 (0.0006) [2023-12-26 04:00:06,037][123091] Updated weights for policy 0, policy_version 553179 (0.0009) [2023-12-26 04:00:06,108][123091] Updated weights for policy 0, policy_version 553189 (0.0010) [2023-12-26 04:00:06,177][123091] Updated weights for policy 0, policy_version 553199 (0.0010) [2023-12-26 04:00:06,756][123090] Updated weights for policy 1, policy_version 549126 (0.0008) [2023-12-26 04:00:06,820][123090] Updated weights for policy 1, policy_version 549136 (0.0010) [2023-12-26 04:00:06,880][123090] Updated weights for policy 1, policy_version 549146 (0.0010) [2023-12-26 04:00:06,974][123091] Updated weights for policy 0, policy_version 553209 (0.0008) [2023-12-26 04:00:07,035][123091] Updated weights for policy 0, policy_version 553219 (0.0009) [2023-12-26 04:00:07,091][123091] Updated weights for policy 0, policy_version 553229 (0.0009) [2023-12-26 04:00:07,667][123090] Updated weights for policy 1, policy_version 549156 (0.0008) [2023-12-26 04:00:07,727][123090] Updated weights for policy 1, policy_version 549166 (0.0005) [2023-12-26 04:00:07,780][123090] Updated weights for policy 1, policy_version 549176 (0.0007) [2023-12-26 04:00:07,981][123091] Updated weights for policy 0, policy_version 553239 (0.0008) [2023-12-26 04:00:08,050][123091] Updated weights for policy 0, policy_version 553249 (0.0009) [2023-12-26 04:00:08,108][123091] Updated weights for policy 0, policy_version 553259 (0.0009) [2023-12-26 04:00:08,433][123090] Updated weights for policy 1, policy_version 549186 (0.0007) [2023-12-26 04:00:08,506][123090] Updated weights for policy 1, policy_version 549196 (0.0006) [2023-12-26 04:00:08,565][123090] Updated weights for policy 1, policy_version 549206 (0.0009) [2023-12-26 04:00:08,627][123090] Updated weights for policy 1, policy_version 549216 (0.0010) [2023-12-26 04:00:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 282238976. Throughput: 0: 8889.7, 1: 8962.9. Samples: 282213640. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:08,785][121949] Avg episode reward: [(0, '5969.927'), (1, '5470.654')] [2023-12-26 04:00:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000549216_140599296.pth... [2023-12-26 04:00:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000553264_141639680.pth... [2023-12-26 04:00:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000548160_140328960.pth [2023-12-26 04:00:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000552240_141377536.pth [2023-12-26 04:00:08,957][123091] Updated weights for policy 0, policy_version 553269 (0.0010) [2023-12-26 04:00:09,020][123091] Updated weights for policy 0, policy_version 553279 (0.0009) [2023-12-26 04:00:09,096][123091] Updated weights for policy 0, policy_version 553289 (0.0009) [2023-12-26 04:00:09,420][123090] Updated weights for policy 1, policy_version 549226 (0.0010) [2023-12-26 04:00:09,488][123090] Updated weights for policy 1, policy_version 549236 (0.0008) [2023-12-26 04:00:09,555][123090] Updated weights for policy 1, policy_version 549246 (0.0008) [2023-12-26 04:00:09,970][123091] Updated weights for policy 0, policy_version 553299 (0.0009) [2023-12-26 04:00:10,044][123091] Updated weights for policy 0, policy_version 553309 (0.0006) [2023-12-26 04:00:10,120][123091] Updated weights for policy 0, policy_version 553319 (0.0007) [2023-12-26 04:00:10,345][123090] Updated weights for policy 1, policy_version 549256 (0.0010) [2023-12-26 04:00:10,402][123090] Updated weights for policy 1, policy_version 549266 (0.0009) [2023-12-26 04:00:10,460][123090] Updated weights for policy 1, policy_version 549276 (0.0009) [2023-12-26 04:00:10,878][123091] Updated weights for policy 0, policy_version 553329 (0.0008) [2023-12-26 04:00:10,947][123091] Updated weights for policy 0, policy_version 553339 (0.0010) [2023-12-26 04:00:11,011][123091] Updated weights for policy 0, policy_version 553349 (0.0009) [2023-12-26 04:00:11,083][123091] Updated weights for policy 0, policy_version 553359 (0.0010) [2023-12-26 04:00:11,287][123090] Updated weights for policy 1, policy_version 549286 (0.0010) [2023-12-26 04:00:11,356][123090] Updated weights for policy 1, policy_version 549296 (0.0009) [2023-12-26 04:00:11,425][123090] Updated weights for policy 1, policy_version 549306 (0.0010) [2023-12-26 04:00:12,032][123091] Updated weights for policy 0, policy_version 553369 (0.0010) [2023-12-26 04:00:12,097][123091] Updated weights for policy 0, policy_version 553379 (0.0009) [2023-12-26 04:00:12,158][123091] Updated weights for policy 0, policy_version 553389 (0.0010) [2023-12-26 04:00:12,227][123090] Updated weights for policy 1, policy_version 549316 (0.0008) [2023-12-26 04:00:12,300][123090] Updated weights for policy 1, policy_version 549326 (0.0010) [2023-12-26 04:00:12,377][123090] Updated weights for policy 1, policy_version 549336 (0.0009) [2023-12-26 04:00:12,935][123091] Updated weights for policy 0, policy_version 553399 (0.0009) [2023-12-26 04:00:12,998][123091] Updated weights for policy 0, policy_version 553409 (0.0008) [2023-12-26 04:00:13,063][123091] Updated weights for policy 0, policy_version 553419 (0.0008) [2023-12-26 04:00:13,241][123090] Updated weights for policy 1, policy_version 549346 (0.0010) [2023-12-26 04:00:13,311][123090] Updated weights for policy 1, policy_version 549356 (0.0009) [2023-12-26 04:00:13,383][123090] Updated weights for policy 1, policy_version 549366 (0.0009) [2023-12-26 04:00:13,451][123090] Updated weights for policy 1, policy_version 549376 (0.0009) [2023-12-26 04:00:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 282320896. Throughput: 0: 8829.5, 1: 9005.6. Samples: 282317344. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:13,785][121949] Avg episode reward: [(0, '5989.403'), (1, '5601.503')] [2023-12-26 04:00:13,824][123091] Updated weights for policy 0, policy_version 553429 (0.0008) [2023-12-26 04:00:13,887][123091] Updated weights for policy 0, policy_version 553439 (0.0009) [2023-12-26 04:00:13,947][123091] Updated weights for policy 0, policy_version 553449 (0.0010) [2023-12-26 04:00:14,233][123090] Updated weights for policy 1, policy_version 549386 (0.0010) [2023-12-26 04:00:14,311][123090] Updated weights for policy 1, policy_version 549396 (0.0009) [2023-12-26 04:00:14,380][123090] Updated weights for policy 1, policy_version 549406 (0.0009) [2023-12-26 04:00:14,679][123091] Updated weights for policy 0, policy_version 553459 (0.0009) [2023-12-26 04:00:14,729][123091] Updated weights for policy 0, policy_version 553469 (0.0009) [2023-12-26 04:00:14,787][123091] Updated weights for policy 0, policy_version 553479 (0.0009) [2023-12-26 04:00:15,202][123090] Updated weights for policy 1, policy_version 549416 (0.0010) [2023-12-26 04:00:15,271][123090] Updated weights for policy 1, policy_version 549426 (0.0010) [2023-12-26 04:00:15,335][123090] Updated weights for policy 1, policy_version 549436 (0.0009) [2023-12-26 04:00:15,596][123091] Updated weights for policy 0, policy_version 553489 (0.0009) [2023-12-26 04:00:15,656][123091] Updated weights for policy 0, policy_version 553499 (0.0005) [2023-12-26 04:00:15,717][123091] Updated weights for policy 0, policy_version 553509 (0.0006) [2023-12-26 04:00:15,785][123091] Updated weights for policy 0, policy_version 553519 (0.0005) [2023-12-26 04:00:16,250][123090] Updated weights for policy 1, policy_version 549446 (0.0010) [2023-12-26 04:00:16,310][123090] Updated weights for policy 1, policy_version 549456 (0.0010) [2023-12-26 04:00:16,367][123090] Updated weights for policy 1, policy_version 549466 (0.0009) [2023-12-26 04:00:16,430][123091] Updated weights for policy 0, policy_version 553529 (0.0005) [2023-12-26 04:00:16,480][123091] Updated weights for policy 0, policy_version 553539 (0.0005) [2023-12-26 04:00:16,529][123091] Updated weights for policy 0, policy_version 553549 (0.0005) [2023-12-26 04:00:17,236][123090] Updated weights for policy 1, policy_version 549476 (0.0008) [2023-12-26 04:00:17,243][123091] Updated weights for policy 0, policy_version 553559 (0.0005) [2023-12-26 04:00:17,284][123090] Updated weights for policy 1, policy_version 549486 (0.0010) [2023-12-26 04:00:17,296][123091] Updated weights for policy 0, policy_version 553569 (0.0006) [2023-12-26 04:00:17,336][123090] Updated weights for policy 1, policy_version 549496 (0.0010) [2023-12-26 04:00:17,367][123091] Updated weights for policy 0, policy_version 553579 (0.0006) [2023-12-26 04:00:18,077][123091] Updated weights for policy 0, policy_version 553589 (0.0008) [2023-12-26 04:00:18,133][123091] Updated weights for policy 0, policy_version 553599 (0.0005) [2023-12-26 04:00:18,175][123090] Updated weights for policy 1, policy_version 549506 (0.0011) [2023-12-26 04:00:18,197][123091] Updated weights for policy 0, policy_version 553609 (0.0005) [2023-12-26 04:00:18,234][123090] Updated weights for policy 1, policy_version 549516 (0.0005) [2023-12-26 04:00:18,284][123090] Updated weights for policy 1, policy_version 549526 (0.0005) [2023-12-26 04:00:18,343][123090] Updated weights for policy 1, policy_version 549536 (0.0007) [2023-12-26 04:00:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 282411008. Throughput: 0: 8857.3, 1: 8898.4. Samples: 282424448. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:18,785][121949] Avg episode reward: [(0, '5973.792'), (1, '5839.143')] [2023-12-26 04:00:18,974][123091] Updated weights for policy 0, policy_version 553619 (0.0007) [2023-12-26 04:00:19,033][123091] Updated weights for policy 0, policy_version 553629 (0.0010) [2023-12-26 04:00:19,091][123091] Updated weights for policy 0, policy_version 553639 (0.0010) [2023-12-26 04:00:19,121][123090] Updated weights for policy 1, policy_version 549546 (0.0008) [2023-12-26 04:00:19,169][123090] Updated weights for policy 1, policy_version 549556 (0.0009) [2023-12-26 04:00:19,217][123090] Updated weights for policy 1, policy_version 549566 (0.0009) [2023-12-26 04:00:19,897][123091] Updated weights for policy 0, policy_version 553649 (0.0009) [2023-12-26 04:00:19,967][123091] Updated weights for policy 0, policy_version 553659 (0.0009) [2023-12-26 04:00:20,036][123091] Updated weights for policy 0, policy_version 553669 (0.0009) [2023-12-26 04:00:20,088][123090] Updated weights for policy 1, policy_version 549577 (0.0008) [2023-12-26 04:00:20,099][123091] Updated weights for policy 0, policy_version 553679 (0.0007) [2023-12-26 04:00:20,159][123090] Updated weights for policy 1, policy_version 549587 (0.0010) [2023-12-26 04:00:20,233][123090] Updated weights for policy 1, policy_version 549597 (0.0009) [2023-12-26 04:00:20,891][123091] Updated weights for policy 0, policy_version 553689 (0.0009) [2023-12-26 04:00:20,947][123091] Updated weights for policy 0, policy_version 553699 (0.0011) [2023-12-26 04:00:21,003][123091] Updated weights for policy 0, policy_version 553709 (0.0010) [2023-12-26 04:00:21,065][123090] Updated weights for policy 1, policy_version 549607 (0.0009) [2023-12-26 04:00:21,135][123090] Updated weights for policy 1, policy_version 549617 (0.0009) [2023-12-26 04:00:21,193][123090] Updated weights for policy 1, policy_version 549627 (0.0009) [2023-12-26 04:00:21,862][123091] Updated weights for policy 0, policy_version 553719 (0.0009) [2023-12-26 04:00:21,921][123091] Updated weights for policy 0, policy_version 553729 (0.0010) [2023-12-26 04:00:21,987][123091] Updated weights for policy 0, policy_version 553739 (0.0009) [2023-12-26 04:00:22,046][123090] Updated weights for policy 1, policy_version 549637 (0.0009) [2023-12-26 04:00:22,105][123090] Updated weights for policy 1, policy_version 549647 (0.0009) [2023-12-26 04:00:22,177][123090] Updated weights for policy 1, policy_version 549657 (0.0010) [2023-12-26 04:00:22,797][123091] Updated weights for policy 0, policy_version 553749 (0.0008) [2023-12-26 04:00:22,859][123091] Updated weights for policy 0, policy_version 553759 (0.0008) [2023-12-26 04:00:22,925][123091] Updated weights for policy 0, policy_version 553769 (0.0010) [2023-12-26 04:00:23,062][123090] Updated weights for policy 1, policy_version 549667 (0.0010) [2023-12-26 04:00:23,111][123090] Updated weights for policy 1, policy_version 549677 (0.0009) [2023-12-26 04:00:23,164][123090] Updated weights for policy 1, policy_version 549687 (0.0009) [2023-12-26 04:00:23,605][123091] Updated weights for policy 0, policy_version 553779 (0.0009) [2023-12-26 04:00:23,670][123091] Updated weights for policy 0, policy_version 553789 (0.0007) [2023-12-26 04:00:23,736][123091] Updated weights for policy 0, policy_version 553799 (0.0009) [2023-12-26 04:00:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 282501120. Throughput: 0: 8849.9, 1: 8886.6. Samples: 282475320. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:23,785][121949] Avg episode reward: [(0, '6047.699'), (1, '5859.048')] [2023-12-26 04:00:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000553808_141778944.pth... [2023-12-26 04:00:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000549696_140722176.pth... [2023-12-26 04:00:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000552752_141508608.pth [2023-12-26 04:00:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000548704_140468224.pth [2023-12-26 04:00:24,023][123090] Updated weights for policy 1, policy_version 549697 (0.0010) [2023-12-26 04:00:24,071][123090] Updated weights for policy 1, policy_version 549707 (0.0010) [2023-12-26 04:00:24,123][123090] Updated weights for policy 1, policy_version 549717 (0.0010) [2023-12-26 04:00:24,175][123090] Updated weights for policy 1, policy_version 549727 (0.0010) [2023-12-26 04:00:24,556][123091] Updated weights for policy 0, policy_version 553809 (0.0008) [2023-12-26 04:00:24,613][123091] Updated weights for policy 0, policy_version 553819 (0.0007) [2023-12-26 04:00:24,687][123091] Updated weights for policy 0, policy_version 553829 (0.0007) [2023-12-26 04:00:24,746][123091] Updated weights for policy 0, policy_version 553840 (0.0010) [2023-12-26 04:00:24,910][123090] Updated weights for policy 1, policy_version 549737 (0.0010) [2023-12-26 04:00:24,963][123090] Updated weights for policy 1, policy_version 549747 (0.0009) [2023-12-26 04:00:25,019][123090] Updated weights for policy 1, policy_version 549757 (0.0006) [2023-12-26 04:00:25,548][123091] Updated weights for policy 0, policy_version 553850 (0.0010) [2023-12-26 04:00:25,595][123091] Updated weights for policy 0, policy_version 553860 (0.0010) [2023-12-26 04:00:25,653][123091] Updated weights for policy 0, policy_version 553870 (0.0010) [2023-12-26 04:00:25,677][123090] Updated weights for policy 1, policy_version 549767 (0.0006) [2023-12-26 04:00:25,724][123090] Updated weights for policy 1, policy_version 549777 (0.0005) [2023-12-26 04:00:25,777][123090] Updated weights for policy 1, policy_version 549787 (0.0005) [2023-12-26 04:00:26,483][123091] Updated weights for policy 0, policy_version 553880 (0.0006) [2023-12-26 04:00:26,534][123091] Updated weights for policy 0, policy_version 553890 (0.0005) [2023-12-26 04:00:26,550][123090] Updated weights for policy 1, policy_version 549797 (0.0007) [2023-12-26 04:00:26,584][123091] Updated weights for policy 0, policy_version 553900 (0.0005) [2023-12-26 04:00:26,629][123090] Updated weights for policy 1, policy_version 549807 (0.0009) [2023-12-26 04:00:26,694][123090] Updated weights for policy 1, policy_version 549817 (0.0010) [2023-12-26 04:00:27,227][123091] Updated weights for policy 0, policy_version 553910 (0.0005) [2023-12-26 04:00:27,274][123091] Updated weights for policy 0, policy_version 553920 (0.0005) [2023-12-26 04:00:27,330][123091] Updated weights for policy 0, policy_version 553930 (0.0006) [2023-12-26 04:00:27,498][123090] Updated weights for policy 1, policy_version 549827 (0.0008) [2023-12-26 04:00:27,544][123090] Updated weights for policy 1, policy_version 549837 (0.0005) [2023-12-26 04:00:27,593][123090] Updated weights for policy 1, policy_version 549847 (0.0005) [2023-12-26 04:00:28,110][123091] Updated weights for policy 0, policy_version 553940 (0.0007) [2023-12-26 04:00:28,174][123091] Updated weights for policy 0, policy_version 553950 (0.0010) [2023-12-26 04:00:28,241][123091] Updated weights for policy 0, policy_version 553960 (0.0008) [2023-12-26 04:00:28,282][123090] Updated weights for policy 1, policy_version 549857 (0.0005) [2023-12-26 04:00:28,352][123090] Updated weights for policy 1, policy_version 549867 (0.0008) [2023-12-26 04:00:28,415][123090] Updated weights for policy 1, policy_version 549877 (0.0009) [2023-12-26 04:00:28,472][123090] Updated weights for policy 1, policy_version 549887 (0.0011) [2023-12-26 04:00:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 282591232. Throughput: 0: 8920.7, 1: 8898.4. Samples: 282583456. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:28,785][121949] Avg episode reward: [(0, '6051.686'), (1, '5897.190')] [2023-12-26 04:00:28,994][123091] Updated weights for policy 0, policy_version 553970 (0.0010) [2023-12-26 04:00:29,067][123091] Updated weights for policy 0, policy_version 553980 (0.0005) [2023-12-26 04:00:29,138][123091] Updated weights for policy 0, policy_version 553990 (0.0005) [2023-12-26 04:00:29,196][123091] Updated weights for policy 0, policy_version 554000 (0.0005) [2023-12-26 04:00:29,347][123090] Updated weights for policy 1, policy_version 549897 (0.0010) [2023-12-26 04:00:29,418][123090] Updated weights for policy 1, policy_version 549907 (0.0009) [2023-12-26 04:00:29,475][123090] Updated weights for policy 1, policy_version 549917 (0.0009) [2023-12-26 04:00:29,965][123091] Updated weights for policy 0, policy_version 554010 (0.0010) [2023-12-26 04:00:30,022][123091] Updated weights for policy 0, policy_version 554020 (0.0011) [2023-12-26 04:00:30,086][123091] Updated weights for policy 0, policy_version 554030 (0.0011) [2023-12-26 04:00:30,341][123090] Updated weights for policy 1, policy_version 549927 (0.0009) [2023-12-26 04:00:30,409][123090] Updated weights for policy 1, policy_version 549937 (0.0008) [2023-12-26 04:00:30,465][123090] Updated weights for policy 1, policy_version 549947 (0.0009) [2023-12-26 04:00:30,917][123091] Updated weights for policy 0, policy_version 554040 (0.0010) [2023-12-26 04:00:30,960][123091] Updated weights for policy 0, policy_version 554050 (0.0011) [2023-12-26 04:00:31,011][123091] Updated weights for policy 0, policy_version 554060 (0.0010) [2023-12-26 04:00:31,295][123090] Updated weights for policy 1, policy_version 549957 (0.0009) [2023-12-26 04:00:31,359][123090] Updated weights for policy 1, policy_version 549967 (0.0009) [2023-12-26 04:00:31,424][123090] Updated weights for policy 1, policy_version 549977 (0.0009) [2023-12-26 04:00:31,841][123091] Updated weights for policy 0, policy_version 554070 (0.0007) [2023-12-26 04:00:31,910][123091] Updated weights for policy 0, policy_version 554080 (0.0006) [2023-12-26 04:00:31,980][123091] Updated weights for policy 0, policy_version 554090 (0.0006) [2023-12-26 04:00:32,318][123090] Updated weights for policy 1, policy_version 549987 (0.0007) [2023-12-26 04:00:32,386][123090] Updated weights for policy 1, policy_version 549997 (0.0008) [2023-12-26 04:00:32,438][123090] Updated weights for policy 1, policy_version 550007 (0.0005) [2023-12-26 04:00:32,738][123091] Updated weights for policy 0, policy_version 554100 (0.0006) [2023-12-26 04:00:32,803][123091] Updated weights for policy 0, policy_version 554110 (0.0006) [2023-12-26 04:00:32,864][123091] Updated weights for policy 0, policy_version 554120 (0.0006) [2023-12-26 04:00:33,162][123090] Updated weights for policy 1, policy_version 550017 (0.0006) [2023-12-26 04:00:33,217][123090] Updated weights for policy 1, policy_version 550027 (0.0010) [2023-12-26 04:00:33,264][123090] Updated weights for policy 1, policy_version 550037 (0.0008) [2023-12-26 04:00:33,326][123090] Updated weights for policy 1, policy_version 550047 (0.0010) [2023-12-26 04:00:33,645][123091] Updated weights for policy 0, policy_version 554130 (0.0009) [2023-12-26 04:00:33,701][123091] Updated weights for policy 0, policy_version 554140 (0.0005) [2023-12-26 04:00:33,753][123091] Updated weights for policy 0, policy_version 554150 (0.0008) [2023-12-26 04:00:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 282673152. Throughput: 0: 8953.1, 1: 8714.9. Samples: 282688552. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:33,785][121949] Avg episode reward: [(0, '6091.440'), (1, '5951.458')] [2023-12-26 04:00:33,800][123091] Updated weights for policy 0, policy_version 554160 (0.0009) [2023-12-26 04:00:34,193][123090] Updated weights for policy 1, policy_version 550057 (0.0011) [2023-12-26 04:00:34,257][123090] Updated weights for policy 1, policy_version 550067 (0.0011) [2023-12-26 04:00:34,321][123090] Updated weights for policy 1, policy_version 550077 (0.0011) [2023-12-26 04:00:34,436][123091] Updated weights for policy 0, policy_version 554170 (0.0008) [2023-12-26 04:00:34,500][123091] Updated weights for policy 0, policy_version 554180 (0.0009) [2023-12-26 04:00:34,561][123091] Updated weights for policy 0, policy_version 554190 (0.0009) [2023-12-26 04:00:35,185][123090] Updated weights for policy 1, policy_version 550087 (0.0010) [2023-12-26 04:00:35,245][123090] Updated weights for policy 1, policy_version 550097 (0.0009) [2023-12-26 04:00:35,281][123091] Updated weights for policy 0, policy_version 554200 (0.0006) [2023-12-26 04:00:35,297][123090] Updated weights for policy 1, policy_version 550107 (0.0010) [2023-12-26 04:00:35,351][123091] Updated weights for policy 0, policy_version 554210 (0.0005) [2023-12-26 04:00:35,431][123091] Updated weights for policy 0, policy_version 554220 (0.0005) [2023-12-26 04:00:36,052][123091] Updated weights for policy 0, policy_version 554230 (0.0005) [2023-12-26 04:00:36,080][123090] Updated weights for policy 1, policy_version 550117 (0.0007) [2023-12-26 04:00:36,129][123091] Updated weights for policy 0, policy_version 554240 (0.0007) [2023-12-26 04:00:36,156][123090] Updated weights for policy 1, policy_version 550127 (0.0009) [2023-12-26 04:00:36,194][123091] Updated weights for policy 0, policy_version 554250 (0.0008) [2023-12-26 04:00:36,229][123090] Updated weights for policy 1, policy_version 550137 (0.0011) [2023-12-26 04:00:36,948][123091] Updated weights for policy 0, policy_version 554260 (0.0008) [2023-12-26 04:00:37,000][123091] Updated weights for policy 0, policy_version 554270 (0.0005) [2023-12-26 04:00:37,012][123090] Updated weights for policy 1, policy_version 550147 (0.0011) [2023-12-26 04:00:37,049][123091] Updated weights for policy 0, policy_version 554280 (0.0005) [2023-12-26 04:00:37,072][123090] Updated weights for policy 1, policy_version 550157 (0.0010) [2023-12-26 04:00:37,135][123090] Updated weights for policy 1, policy_version 550167 (0.0010) [2023-12-26 04:00:37,764][123091] Updated weights for policy 0, policy_version 554290 (0.0006) [2023-12-26 04:00:37,784][123090] Updated weights for policy 1, policy_version 550177 (0.0010) [2023-12-26 04:00:37,832][123091] Updated weights for policy 0, policy_version 554300 (0.0006) [2023-12-26 04:00:37,843][123090] Updated weights for policy 1, policy_version 550187 (0.0005) [2023-12-26 04:00:37,895][123091] Updated weights for policy 0, policy_version 554310 (0.0006) [2023-12-26 04:00:37,911][123090] Updated weights for policy 1, policy_version 550197 (0.0009) [2023-12-26 04:00:37,962][123091] Updated weights for policy 0, policy_version 554320 (0.0011) [2023-12-26 04:00:37,975][123090] Updated weights for policy 1, policy_version 550207 (0.0010) [2023-12-26 04:00:38,685][123090] Updated weights for policy 1, policy_version 550217 (0.0010) [2023-12-26 04:00:38,744][123090] Updated weights for policy 1, policy_version 550227 (0.0010) [2023-12-26 04:00:38,764][123091] Updated weights for policy 0, policy_version 554330 (0.0011) [2023-12-26 04:00:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 282763264. Throughput: 0: 9034.1, 1: 8706.4. Samples: 282744592. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:38,785][121949] Avg episode reward: [(0, '6028.623'), (1, '6010.438')] [2023-12-26 04:00:38,807][123090] Updated weights for policy 1, policy_version 550237 (0.0010) [2023-12-26 04:00:38,823][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000550240_140861440.pth... [2023-12-26 04:00:38,823][123091] Updated weights for policy 0, policy_version 554340 (0.0011) [2023-12-26 04:00:38,828][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000549216_140599296.pth [2023-12-26 04:00:38,886][123091] Updated weights for policy 0, policy_version 554350 (0.0010) [2023-12-26 04:00:38,897][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000554352_141918208.pth... [2023-12-26 04:00:38,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000553264_141639680.pth [2023-12-26 04:00:39,639][123091] Updated weights for policy 0, policy_version 554360 (0.0009) [2023-12-26 04:00:39,669][123090] Updated weights for policy 1, policy_version 550247 (0.0008) [2023-12-26 04:00:39,706][123091] Updated weights for policy 0, policy_version 554370 (0.0006) [2023-12-26 04:00:39,730][123090] Updated weights for policy 1, policy_version 550257 (0.0008) [2023-12-26 04:00:39,773][123091] Updated weights for policy 0, policy_version 554380 (0.0009) [2023-12-26 04:00:39,793][123090] Updated weights for policy 1, policy_version 550267 (0.0006) [2023-12-26 04:00:40,479][123091] Updated weights for policy 0, policy_version 554390 (0.0007) [2023-12-26 04:00:40,544][123090] Updated weights for policy 1, policy_version 550277 (0.0008) [2023-12-26 04:00:40,550][123091] Updated weights for policy 0, policy_version 554400 (0.0005) [2023-12-26 04:00:40,589][123090] Updated weights for policy 1, policy_version 550287 (0.0010) [2023-12-26 04:00:40,613][123091] Updated weights for policy 0, policy_version 554410 (0.0006) [2023-12-26 04:00:40,649][123090] Updated weights for policy 1, policy_version 550297 (0.0010) [2023-12-26 04:00:41,201][123091] Updated weights for policy 0, policy_version 554420 (0.0007) [2023-12-26 04:00:41,251][123091] Updated weights for policy 0, policy_version 554430 (0.0009) [2023-12-26 04:00:41,313][123091] Updated weights for policy 0, policy_version 554440 (0.0009) [2023-12-26 04:00:41,461][123090] Updated weights for policy 1, policy_version 550307 (0.0011) [2023-12-26 04:00:41,529][123090] Updated weights for policy 1, policy_version 550317 (0.0010) [2023-12-26 04:00:41,592][123090] Updated weights for policy 1, policy_version 550327 (0.0010) [2023-12-26 04:00:42,181][123091] Updated weights for policy 0, policy_version 554450 (0.0009) [2023-12-26 04:00:42,242][123091] Updated weights for policy 0, policy_version 554460 (0.0008) [2023-12-26 04:00:42,305][123091] Updated weights for policy 0, policy_version 554470 (0.0008) [2023-12-26 04:00:42,370][123091] Updated weights for policy 0, policy_version 554480 (0.0008) [2023-12-26 04:00:42,434][123090] Updated weights for policy 1, policy_version 550337 (0.0011) [2023-12-26 04:00:42,503][123090] Updated weights for policy 1, policy_version 550347 (0.0008) [2023-12-26 04:00:42,558][123090] Updated weights for policy 1, policy_version 550357 (0.0009) [2023-12-26 04:00:42,618][123090] Updated weights for policy 1, policy_version 550367 (0.0009) [2023-12-26 04:00:43,183][123091] Updated weights for policy 0, policy_version 554490 (0.0010) [2023-12-26 04:00:43,251][123091] Updated weights for policy 0, policy_version 554500 (0.0010) [2023-12-26 04:00:43,309][123091] Updated weights for policy 0, policy_version 554510 (0.0010) [2023-12-26 04:00:43,419][123090] Updated weights for policy 1, policy_version 550377 (0.0010) [2023-12-26 04:00:43,471][123090] Updated weights for policy 1, policy_version 550387 (0.0009) [2023-12-26 04:00:43,518][123090] Updated weights for policy 1, policy_version 550397 (0.0009) [2023-12-26 04:00:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 282861568. Throughput: 0: 9071.5, 1: 8725.0. Samples: 282854040. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 04:00:43,785][121949] Avg episode reward: [(0, '6067.662'), (1, '5962.118')] [2023-12-26 04:00:44,198][123091] Updated weights for policy 0, policy_version 554520 (0.0010) [2023-12-26 04:00:44,254][123091] Updated weights for policy 0, policy_version 554531 (0.0010) [2023-12-26 04:00:44,310][123091] Updated weights for policy 0, policy_version 554541 (0.0010) [2023-12-26 04:00:44,343][123090] Updated weights for policy 1, policy_version 550407 (0.0006) [2023-12-26 04:00:44,420][123090] Updated weights for policy 1, policy_version 550417 (0.0005) [2023-12-26 04:00:44,498][123090] Updated weights for policy 1, policy_version 550427 (0.0005) [2023-12-26 04:00:45,211][123090] Updated weights for policy 1, policy_version 550437 (0.0006) [2023-12-26 04:00:45,214][123091] Updated weights for policy 0, policy_version 554551 (0.0010) [2023-12-26 04:00:45,278][123090] Updated weights for policy 1, policy_version 550447 (0.0006) [2023-12-26 04:00:45,280][123091] Updated weights for policy 0, policy_version 554561 (0.0009) [2023-12-26 04:00:45,345][123090] Updated weights for policy 1, policy_version 550457 (0.0008) [2023-12-26 04:00:45,347][123091] Updated weights for policy 0, policy_version 554571 (0.0008) [2023-12-26 04:00:46,142][123090] Updated weights for policy 1, policy_version 550467 (0.0008) [2023-12-26 04:00:46,162][123091] Updated weights for policy 0, policy_version 554581 (0.0009) [2023-12-26 04:00:46,202][123090] Updated weights for policy 1, policy_version 550477 (0.0008) [2023-12-26 04:00:46,222][123091] Updated weights for policy 0, policy_version 554591 (0.0009) [2023-12-26 04:00:46,259][123090] Updated weights for policy 1, policy_version 550487 (0.0010) [2023-12-26 04:00:46,279][123091] Updated weights for policy 0, policy_version 554601 (0.0007) [2023-12-26 04:00:47,036][123091] Updated weights for policy 0, policy_version 554611 (0.0008) [2023-12-26 04:00:47,092][123091] Updated weights for policy 0, policy_version 554621 (0.0011) [2023-12-26 04:00:47,097][123090] Updated weights for policy 1, policy_version 550497 (0.0008) [2023-12-26 04:00:47,147][123091] Updated weights for policy 0, policy_version 554631 (0.0010) [2023-12-26 04:00:47,157][123090] Updated weights for policy 1, policy_version 550507 (0.0008) [2023-12-26 04:00:47,213][123090] Updated weights for policy 1, policy_version 550517 (0.0006) [2023-12-26 04:00:47,273][123090] Updated weights for policy 1, policy_version 550527 (0.0009) [2023-12-26 04:00:47,984][123091] Updated weights for policy 0, policy_version 554641 (0.0011) [2023-12-26 04:00:48,051][123091] Updated weights for policy 0, policy_version 554651 (0.0011) [2023-12-26 04:00:48,088][123090] Updated weights for policy 1, policy_version 550537 (0.0008) [2023-12-26 04:00:48,110][123091] Updated weights for policy 0, policy_version 554661 (0.0010) [2023-12-26 04:00:48,143][123090] Updated weights for policy 1, policy_version 550547 (0.0006) [2023-12-26 04:00:48,165][123091] Updated weights for policy 0, policy_version 554671 (0.0010) [2023-12-26 04:00:48,192][123090] Updated weights for policy 1, policy_version 550557 (0.0008) [2023-12-26 04:00:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 282943488. Throughput: 0: 9009.7, 1: 8750.7. Samples: 282958208. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:00:48,784][121949] Avg episode reward: [(0, '5961.237'), (1, '5869.624')] [2023-12-26 04:00:48,884][123091] Updated weights for policy 0, policy_version 554681 (0.0006) [2023-12-26 04:00:48,933][123091] Updated weights for policy 0, policy_version 554691 (0.0005) [2023-12-26 04:00:48,989][123091] Updated weights for policy 0, policy_version 554701 (0.0006) [2023-12-26 04:00:49,073][123090] Updated weights for policy 1, policy_version 550567 (0.0009) [2023-12-26 04:00:49,142][123090] Updated weights for policy 1, policy_version 550577 (0.0009) [2023-12-26 04:00:49,213][123090] Updated weights for policy 1, policy_version 550587 (0.0010) [2023-12-26 04:00:49,732][123091] Updated weights for policy 0, policy_version 554711 (0.0007) [2023-12-26 04:00:49,801][123091] Updated weights for policy 0, policy_version 554721 (0.0006) [2023-12-26 04:00:49,870][123091] Updated weights for policy 0, policy_version 554731 (0.0008) [2023-12-26 04:00:49,907][123090] Updated weights for policy 1, policy_version 550597 (0.0006) [2023-12-26 04:00:49,976][123090] Updated weights for policy 1, policy_version 550607 (0.0008) [2023-12-26 04:00:50,027][123090] Updated weights for policy 1, policy_version 550617 (0.0009) [2023-12-26 04:00:50,576][123091] Updated weights for policy 0, policy_version 554741 (0.0007) [2023-12-26 04:00:50,638][123091] Updated weights for policy 0, policy_version 554751 (0.0008) [2023-12-26 04:00:50,697][123091] Updated weights for policy 0, policy_version 554761 (0.0008) [2023-12-26 04:00:50,775][123090] Updated weights for policy 1, policy_version 550627 (0.0010) [2023-12-26 04:00:50,841][123090] Updated weights for policy 1, policy_version 550637 (0.0009) [2023-12-26 04:00:50,908][123090] Updated weights for policy 1, policy_version 550647 (0.0008) [2023-12-26 04:00:51,521][123091] Updated weights for policy 0, policy_version 554771 (0.0008) [2023-12-26 04:00:51,571][123091] Updated weights for policy 0, policy_version 554781 (0.0009) [2023-12-26 04:00:51,632][123091] Updated weights for policy 0, policy_version 554791 (0.0009) [2023-12-26 04:00:51,688][123090] Updated weights for policy 1, policy_version 550657 (0.0006) [2023-12-26 04:00:51,758][123090] Updated weights for policy 1, policy_version 550667 (0.0009) [2023-12-26 04:00:51,810][123090] Updated weights for policy 1, policy_version 550677 (0.0008) [2023-12-26 04:00:51,871][123090] Updated weights for policy 1, policy_version 550687 (0.0009) [2023-12-26 04:00:52,460][123091] Updated weights for policy 0, policy_version 554801 (0.0010) [2023-12-26 04:00:52,532][123091] Updated weights for policy 0, policy_version 554811 (0.0007) [2023-12-26 04:00:52,600][123091] Updated weights for policy 0, policy_version 554821 (0.0005) [2023-12-26 04:00:52,671][123091] Updated weights for policy 0, policy_version 554831 (0.0006) [2023-12-26 04:00:52,752][123090] Updated weights for policy 1, policy_version 550697 (0.0009) [2023-12-26 04:00:52,805][123090] Updated weights for policy 1, policy_version 550707 (0.0009) [2023-12-26 04:00:52,854][123090] Updated weights for policy 1, policy_version 550717 (0.0009) [2023-12-26 04:00:53,436][123091] Updated weights for policy 0, policy_version 554841 (0.0009) [2023-12-26 04:00:53,489][123091] Updated weights for policy 0, policy_version 554851 (0.0010) [2023-12-26 04:00:53,544][123091] Updated weights for policy 0, policy_version 554862 (0.0009) [2023-12-26 04:00:53,570][123090] Updated weights for policy 1, policy_version 550727 (0.0009) [2023-12-26 04:00:53,631][123090] Updated weights for policy 1, policy_version 550737 (0.0009) [2023-12-26 04:00:53,690][123090] Updated weights for policy 1, policy_version 550747 (0.0006) [2023-12-26 04:00:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 283041792. Throughput: 0: 9010.2, 1: 8751.5. Samples: 283012912. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:00:53,785][121949] Avg episode reward: [(0, '6002.022'), (1, '5918.142')] [2023-12-26 04:00:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000550752_140992512.pth... [2023-12-26 04:00:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000554864_142049280.pth... [2023-12-26 04:00:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000549696_140722176.pth [2023-12-26 04:00:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000553808_141778944.pth [2023-12-26 04:00:54,340][123091] Updated weights for policy 0, policy_version 554872 (0.0006) [2023-12-26 04:00:54,398][123091] Updated weights for policy 0, policy_version 554882 (0.0006) [2023-12-26 04:00:54,460][123091] Updated weights for policy 0, policy_version 554892 (0.0006) [2023-12-26 04:00:54,526][123090] Updated weights for policy 1, policy_version 550757 (0.0008) [2023-12-26 04:00:54,594][123090] Updated weights for policy 1, policy_version 550767 (0.0008) [2023-12-26 04:00:54,653][123090] Updated weights for policy 1, policy_version 550777 (0.0008) [2023-12-26 04:00:55,184][123091] Updated weights for policy 0, policy_version 554902 (0.0009) [2023-12-26 04:00:55,239][123091] Updated weights for policy 0, policy_version 554913 (0.0010) [2023-12-26 04:00:55,286][123091] Updated weights for policy 0, policy_version 554923 (0.0009) [2023-12-26 04:00:55,448][123090] Updated weights for policy 1, policy_version 550787 (0.0008) [2023-12-26 04:00:55,496][123090] Updated weights for policy 1, policy_version 550797 (0.0009) [2023-12-26 04:00:55,559][123090] Updated weights for policy 1, policy_version 550807 (0.0008) [2023-12-26 04:00:56,130][123091] Updated weights for policy 0, policy_version 554933 (0.0008) [2023-12-26 04:00:56,196][123091] Updated weights for policy 0, policy_version 554943 (0.0010) [2023-12-26 04:00:56,276][123091] Updated weights for policy 0, policy_version 554953 (0.0011) [2023-12-26 04:00:56,292][123090] Updated weights for policy 1, policy_version 550817 (0.0008) [2023-12-26 04:00:56,342][123090] Updated weights for policy 1, policy_version 550827 (0.0005) [2023-12-26 04:00:56,396][123090] Updated weights for policy 1, policy_version 550837 (0.0005) [2023-12-26 04:00:56,443][123090] Updated weights for policy 1, policy_version 550847 (0.0005) [2023-12-26 04:00:57,027][123091] Updated weights for policy 0, policy_version 554963 (0.0009) [2023-12-26 04:00:57,062][123090] Updated weights for policy 1, policy_version 550857 (0.0005) [2023-12-26 04:00:57,081][123091] Updated weights for policy 0, policy_version 554973 (0.0005) [2023-12-26 04:00:57,117][123090] Updated weights for policy 1, policy_version 550867 (0.0005) [2023-12-26 04:00:57,148][123091] Updated weights for policy 0, policy_version 554983 (0.0010) [2023-12-26 04:00:57,166][123090] Updated weights for policy 1, policy_version 550877 (0.0005) [2023-12-26 04:00:57,910][123090] Updated weights for policy 1, policy_version 550887 (0.0005) [2023-12-26 04:00:57,939][123091] Updated weights for policy 0, policy_version 554993 (0.0010) [2023-12-26 04:00:57,960][123090] Updated weights for policy 1, policy_version 550897 (0.0005) [2023-12-26 04:00:58,003][123091] Updated weights for policy 0, policy_version 555003 (0.0010) [2023-12-26 04:00:58,030][123090] Updated weights for policy 1, policy_version 550907 (0.0007) [2023-12-26 04:00:58,070][123091] Updated weights for policy 0, policy_version 555013 (0.0011) [2023-12-26 04:00:58,140][123091] Updated weights for policy 0, policy_version 555023 (0.0011) [2023-12-26 04:00:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 283123712. Throughput: 0: 9093.7, 1: 8778.9. Samples: 283121612. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:00:58,785][121949] Avg episode reward: [(0, '6061.001'), (1, '5995.057')] [2023-12-26 04:00:58,939][123090] Updated weights for policy 1, policy_version 550917 (0.0009) [2023-12-26 04:00:59,006][123090] Updated weights for policy 1, policy_version 550927 (0.0007) [2023-12-26 04:00:59,055][123091] Updated weights for policy 0, policy_version 555033 (0.0010) [2023-12-26 04:00:59,079][123090] Updated weights for policy 1, policy_version 550937 (0.0008) [2023-12-26 04:00:59,114][123091] Updated weights for policy 0, policy_version 555043 (0.0010) [2023-12-26 04:00:59,175][123091] Updated weights for policy 0, policy_version 555053 (0.0009) [2023-12-26 04:00:59,963][123090] Updated weights for policy 1, policy_version 550947 (0.0008) [2023-12-26 04:01:00,032][123090] Updated weights for policy 1, policy_version 550957 (0.0009) [2023-12-26 04:01:00,048][123091] Updated weights for policy 0, policy_version 555063 (0.0009) [2023-12-26 04:01:00,084][123090] Updated weights for policy 1, policy_version 550967 (0.0008) [2023-12-26 04:01:00,108][123091] Updated weights for policy 0, policy_version 555073 (0.0009) [2023-12-26 04:01:00,173][123091] Updated weights for policy 0, policy_version 555083 (0.0008) [2023-12-26 04:01:00,919][123090] Updated weights for policy 1, policy_version 550977 (0.0009) [2023-12-26 04:01:00,988][123090] Updated weights for policy 1, policy_version 550987 (0.0007) [2023-12-26 04:01:01,049][123091] Updated weights for policy 0, policy_version 555093 (0.0009) [2023-12-26 04:01:01,056][123090] Updated weights for policy 1, policy_version 550997 (0.0008) [2023-12-26 04:01:01,112][123090] Updated weights for policy 1, policy_version 551007 (0.0008) [2023-12-26 04:01:01,120][123091] Updated weights for policy 0, policy_version 555103 (0.0010) [2023-12-26 04:01:01,193][123091] Updated weights for policy 0, policy_version 555113 (0.0010) [2023-12-26 04:01:01,975][123090] Updated weights for policy 1, policy_version 551017 (0.0009) [2023-12-26 04:01:02,045][123090] Updated weights for policy 1, policy_version 551027 (0.0007) [2023-12-26 04:01:02,055][123091] Updated weights for policy 0, policy_version 555123 (0.0009) [2023-12-26 04:01:02,105][123090] Updated weights for policy 1, policy_version 551037 (0.0010) [2023-12-26 04:01:02,114][123091] Updated weights for policy 0, policy_version 555133 (0.0008) [2023-12-26 04:01:02,164][123091] Updated weights for policy 0, policy_version 555143 (0.0010) [2023-12-26 04:01:02,915][123090] Updated weights for policy 1, policy_version 551047 (0.0009) [2023-12-26 04:01:02,993][123090] Updated weights for policy 1, policy_version 551057 (0.0006) [2023-12-26 04:01:03,002][123091] Updated weights for policy 0, policy_version 555153 (0.0009) [2023-12-26 04:01:03,058][123091] Updated weights for policy 0, policy_version 555163 (0.0007) [2023-12-26 04:01:03,063][123090] Updated weights for policy 1, policy_version 551067 (0.0007) [2023-12-26 04:01:03,111][123091] Updated weights for policy 0, policy_version 555173 (0.0009) [2023-12-26 04:01:03,168][123091] Updated weights for policy 0, policy_version 555183 (0.0009) [2023-12-26 04:01:03,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 283205632. Throughput: 0: 8911.0, 1: 8779.7. Samples: 283220524. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:03,785][121949] Avg episode reward: [(0, '6123.243'), (1, '6004.520')] [2023-12-26 04:01:03,830][123090] Updated weights for policy 1, policy_version 551077 (0.0009) [2023-12-26 04:01:03,903][123090] Updated weights for policy 1, policy_version 551087 (0.0010) [2023-12-26 04:01:03,967][123090] Updated weights for policy 1, policy_version 551097 (0.0009) [2023-12-26 04:01:04,027][123091] Updated weights for policy 0, policy_version 555193 (0.0009) [2023-12-26 04:01:04,091][123091] Updated weights for policy 0, policy_version 555203 (0.0009) [2023-12-26 04:01:04,153][123091] Updated weights for policy 0, policy_version 555213 (0.0009) [2023-12-26 04:01:04,819][123090] Updated weights for policy 1, policy_version 551107 (0.0009) [2023-12-26 04:01:04,874][123090] Updated weights for policy 1, policy_version 551117 (0.0008) [2023-12-26 04:01:04,938][123090] Updated weights for policy 1, policy_version 551127 (0.0010) [2023-12-26 04:01:04,993][123091] Updated weights for policy 0, policy_version 555223 (0.0009) [2023-12-26 04:01:05,042][123091] Updated weights for policy 0, policy_version 555233 (0.0009) [2023-12-26 04:01:05,095][123091] Updated weights for policy 0, policy_version 555243 (0.0009) [2023-12-26 04:01:05,794][123090] Updated weights for policy 1, policy_version 551137 (0.0008) [2023-12-26 04:01:05,849][123090] Updated weights for policy 1, policy_version 551147 (0.0010) [2023-12-26 04:01:05,908][123090] Updated weights for policy 1, policy_version 551157 (0.0009) [2023-12-26 04:01:05,949][123091] Updated weights for policy 0, policy_version 555253 (0.0008) [2023-12-26 04:01:05,973][123090] Updated weights for policy 1, policy_version 551167 (0.0008) [2023-12-26 04:01:06,013][123091] Updated weights for policy 0, policy_version 555263 (0.0008) [2023-12-26 04:01:06,080][123091] Updated weights for policy 0, policy_version 555273 (0.0010) [2023-12-26 04:01:06,824][123090] Updated weights for policy 1, policy_version 551177 (0.0011) [2023-12-26 04:01:06,901][123090] Updated weights for policy 1, policy_version 551187 (0.0010) [2023-12-26 04:01:06,939][123091] Updated weights for policy 0, policy_version 555283 (0.0008) [2023-12-26 04:01:06,961][123090] Updated weights for policy 1, policy_version 551197 (0.0011) [2023-12-26 04:01:06,996][123091] Updated weights for policy 0, policy_version 555293 (0.0007) [2023-12-26 04:01:07,054][123091] Updated weights for policy 0, policy_version 555303 (0.0009) [2023-12-26 04:01:07,802][123090] Updated weights for policy 1, policy_version 551207 (0.0011) [2023-12-26 04:01:07,869][123090] Updated weights for policy 1, policy_version 551217 (0.0010) [2023-12-26 04:01:07,921][123091] Updated weights for policy 0, policy_version 555313 (0.0009) [2023-12-26 04:01:07,934][123090] Updated weights for policy 1, policy_version 551227 (0.0011) [2023-12-26 04:01:07,981][123091] Updated weights for policy 0, policy_version 555323 (0.0009) [2023-12-26 04:01:08,044][123091] Updated weights for policy 0, policy_version 555333 (0.0009) [2023-12-26 04:01:08,112][123091] Updated weights for policy 0, policy_version 555343 (0.0009) [2023-12-26 04:01:08,708][123090] Updated weights for policy 1, policy_version 551237 (0.0009) [2023-12-26 04:01:08,772][123090] Updated weights for policy 1, policy_version 551247 (0.0006) [2023-12-26 04:01:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 283287552. Throughput: 0: 8891.4, 1: 8780.2. Samples: 283270540. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:08,785][121949] Avg episode reward: [(0, '6225.756'), (1, '6019.603')] [2023-12-26 04:01:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000555344_142172160.pth... [2023-12-26 04:01:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000554352_141918208.pth [2023-12-26 04:01:08,833][123090] Updated weights for policy 1, policy_version 551257 (0.0006) [2023-12-26 04:01:08,880][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000551264_141123584.pth... [2023-12-26 04:01:08,884][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000550240_140861440.pth [2023-12-26 04:01:08,935][123091] Updated weights for policy 0, policy_version 555353 (0.0011) [2023-12-26 04:01:08,998][123091] Updated weights for policy 0, policy_version 555363 (0.0009) [2023-12-26 04:01:09,061][123091] Updated weights for policy 0, policy_version 555373 (0.0008) [2023-12-26 04:01:09,713][123090] Updated weights for policy 1, policy_version 551267 (0.0008) [2023-12-26 04:01:09,790][123090] Updated weights for policy 1, policy_version 551277 (0.0009) [2023-12-26 04:01:09,861][123090] Updated weights for policy 1, policy_version 551287 (0.0008) [2023-12-26 04:01:09,886][123091] Updated weights for policy 0, policy_version 555383 (0.0008) [2023-12-26 04:01:09,955][123091] Updated weights for policy 0, policy_version 555393 (0.0008) [2023-12-26 04:01:10,025][123091] Updated weights for policy 0, policy_version 555403 (0.0011) [2023-12-26 04:01:10,712][123090] Updated weights for policy 1, policy_version 551297 (0.0008) [2023-12-26 04:01:10,775][123090] Updated weights for policy 1, policy_version 551307 (0.0009) [2023-12-26 04:01:10,838][123090] Updated weights for policy 1, policy_version 551317 (0.0009) [2023-12-26 04:01:10,850][123091] Updated weights for policy 0, policy_version 555413 (0.0008) [2023-12-26 04:01:10,904][123090] Updated weights for policy 1, policy_version 551327 (0.0009) [2023-12-26 04:01:10,905][123091] Updated weights for policy 0, policy_version 555423 (0.0006) [2023-12-26 04:01:10,974][123091] Updated weights for policy 0, policy_version 555433 (0.0005) [2023-12-26 04:01:11,772][123090] Updated weights for policy 1, policy_version 551337 (0.0009) [2023-12-26 04:01:11,819][123091] Updated weights for policy 0, policy_version 555443 (0.0008) [2023-12-26 04:01:11,844][123090] Updated weights for policy 1, policy_version 551347 (0.0008) [2023-12-26 04:01:11,881][123091] Updated weights for policy 0, policy_version 555453 (0.0009) [2023-12-26 04:01:11,908][123090] Updated weights for policy 1, policy_version 551357 (0.0009) [2023-12-26 04:01:11,938][123091] Updated weights for policy 0, policy_version 555463 (0.0009) [2023-12-26 04:01:12,747][123090] Updated weights for policy 1, policy_version 551367 (0.0010) [2023-12-26 04:01:12,778][123091] Updated weights for policy 0, policy_version 555473 (0.0010) [2023-12-26 04:01:12,816][123090] Updated weights for policy 1, policy_version 551377 (0.0009) [2023-12-26 04:01:12,824][123091] Updated weights for policy 0, policy_version 555483 (0.0008) [2023-12-26 04:01:12,870][123091] Updated weights for policy 0, policy_version 555493 (0.0009) [2023-12-26 04:01:12,876][123090] Updated weights for policy 1, policy_version 551387 (0.0008) [2023-12-26 04:01:12,925][123091] Updated weights for policy 0, policy_version 555503 (0.0008) [2023-12-26 04:01:13,708][123090] Updated weights for policy 1, policy_version 551397 (0.0007) [2023-12-26 04:01:13,780][123090] Updated weights for policy 1, policy_version 551407 (0.0006) [2023-12-26 04:01:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 283369472. Throughput: 0: 8789.4, 1: 8701.7. Samples: 283370552. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:13,784][121949] Avg episode reward: [(0, '6226.638'), (1, '5990.058')] [2023-12-26 04:01:13,811][123091] Updated weights for policy 0, policy_version 555513 (0.0011) [2023-12-26 04:01:13,842][123090] Updated weights for policy 1, policy_version 551417 (0.0006) [2023-12-26 04:01:13,873][123091] Updated weights for policy 0, policy_version 555523 (0.0010) [2023-12-26 04:01:13,923][123091] Updated weights for policy 0, policy_version 555533 (0.0007) [2023-12-26 04:01:14,584][123090] Updated weights for policy 1, policy_version 551427 (0.0007) [2023-12-26 04:01:14,644][123090] Updated weights for policy 1, policy_version 551437 (0.0009) [2023-12-26 04:01:14,664][123091] Updated weights for policy 0, policy_version 555543 (0.0005) [2023-12-26 04:01:14,703][123090] Updated weights for policy 1, policy_version 551447 (0.0008) [2023-12-26 04:01:14,727][123091] Updated weights for policy 0, policy_version 555553 (0.0009) [2023-12-26 04:01:14,798][123091] Updated weights for policy 0, policy_version 555563 (0.0011) [2023-12-26 04:01:15,571][123090] Updated weights for policy 1, policy_version 551457 (0.0006) [2023-12-26 04:01:15,622][123091] Updated weights for policy 0, policy_version 555573 (0.0009) [2023-12-26 04:01:15,640][123090] Updated weights for policy 1, policy_version 551467 (0.0008) [2023-12-26 04:01:15,687][123091] Updated weights for policy 0, policy_version 555583 (0.0008) [2023-12-26 04:01:15,704][123090] Updated weights for policy 1, policy_version 551477 (0.0008) [2023-12-26 04:01:15,757][123091] Updated weights for policy 0, policy_version 555593 (0.0008) [2023-12-26 04:01:15,769][123090] Updated weights for policy 1, policy_version 551487 (0.0009) [2023-12-26 04:01:16,551][123091] Updated weights for policy 0, policy_version 555603 (0.0010) [2023-12-26 04:01:16,601][123091] Updated weights for policy 0, policy_version 555613 (0.0008) [2023-12-26 04:01:16,603][123090] Updated weights for policy 1, policy_version 551497 (0.0008) [2023-12-26 04:01:16,647][123090] Updated weights for policy 1, policy_version 551507 (0.0007) [2023-12-26 04:01:16,653][123091] Updated weights for policy 0, policy_version 555623 (0.0009) [2023-12-26 04:01:16,695][123090] Updated weights for policy 1, policy_version 551517 (0.0007) [2023-12-26 04:01:17,487][123090] Updated weights for policy 1, policy_version 551527 (0.0007) [2023-12-26 04:01:17,544][123091] Updated weights for policy 0, policy_version 555633 (0.0008) [2023-12-26 04:01:17,552][123090] Updated weights for policy 1, policy_version 551537 (0.0006) [2023-12-26 04:01:17,601][123091] Updated weights for policy 0, policy_version 555643 (0.0009) [2023-12-26 04:01:17,620][123090] Updated weights for policy 1, policy_version 551547 (0.0006) [2023-12-26 04:01:17,657][123091] Updated weights for policy 0, policy_version 555653 (0.0009) [2023-12-26 04:01:17,709][123091] Updated weights for policy 0, policy_version 555663 (0.0009) [2023-12-26 04:01:18,202][123090] Updated weights for policy 1, policy_version 551557 (0.0006) [2023-12-26 04:01:18,254][123090] Updated weights for policy 1, policy_version 551567 (0.0005) [2023-12-26 04:01:18,323][123090] Updated weights for policy 1, policy_version 551577 (0.0006) [2023-12-26 04:01:18,571][123091] Updated weights for policy 0, policy_version 555673 (0.0010) [2023-12-26 04:01:18,634][123091] Updated weights for policy 0, policy_version 555683 (0.0010) [2023-12-26 04:01:18,690][123091] Updated weights for policy 0, policy_version 555693 (0.0010) [2023-12-26 04:01:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 283467776. Throughput: 0: 8740.2, 1: 8758.3. Samples: 283475984. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:18,785][121949] Avg episode reward: [(0, '6181.833'), (1, '5945.703')] [2023-12-26 04:01:18,954][123090] Updated weights for policy 1, policy_version 551587 (0.0007) [2023-12-26 04:01:19,030][123090] Updated weights for policy 1, policy_version 551597 (0.0006) [2023-12-26 04:01:19,096][123090] Updated weights for policy 1, policy_version 551607 (0.0008) [2023-12-26 04:01:19,597][123091] Updated weights for policy 0, policy_version 555703 (0.0009) [2023-12-26 04:01:19,660][123091] Updated weights for policy 0, policy_version 555713 (0.0009) [2023-12-26 04:01:19,725][123091] Updated weights for policy 0, policy_version 555723 (0.0009) [2023-12-26 04:01:19,866][123090] Updated weights for policy 1, policy_version 551617 (0.0010) [2023-12-26 04:01:19,941][123090] Updated weights for policy 1, policy_version 551627 (0.0008) [2023-12-26 04:01:20,011][123090] Updated weights for policy 1, policy_version 551637 (0.0006) [2023-12-26 04:01:20,089][123090] Updated weights for policy 1, policy_version 551647 (0.0006) [2023-12-26 04:01:20,585][123091] Updated weights for policy 0, policy_version 555733 (0.0008) [2023-12-26 04:01:20,652][123091] Updated weights for policy 0, policy_version 555743 (0.0008) [2023-12-26 04:01:20,714][123091] Updated weights for policy 0, policy_version 555753 (0.0008) [2023-12-26 04:01:20,756][123090] Updated weights for policy 1, policy_version 551657 (0.0010) [2023-12-26 04:01:20,825][123090] Updated weights for policy 1, policy_version 551667 (0.0011) [2023-12-26 04:01:20,892][123090] Updated weights for policy 1, policy_version 551677 (0.0011) [2023-12-26 04:01:21,526][123091] Updated weights for policy 0, policy_version 555763 (0.0009) [2023-12-26 04:01:21,590][123091] Updated weights for policy 0, policy_version 555773 (0.0010) [2023-12-26 04:01:21,662][123091] Updated weights for policy 0, policy_version 555783 (0.0007) [2023-12-26 04:01:21,760][123090] Updated weights for policy 1, policy_version 551687 (0.0009) [2023-12-26 04:01:21,833][123090] Updated weights for policy 1, policy_version 551697 (0.0008) [2023-12-26 04:01:21,902][123090] Updated weights for policy 1, policy_version 551707 (0.0007) [2023-12-26 04:01:22,520][123091] Updated weights for policy 0, policy_version 555793 (0.0006) [2023-12-26 04:01:22,587][123091] Updated weights for policy 0, policy_version 555803 (0.0010) [2023-12-26 04:01:22,616][123090] Updated weights for policy 1, policy_version 551717 (0.0008) [2023-12-26 04:01:22,645][123091] Updated weights for policy 0, policy_version 555813 (0.0007) [2023-12-26 04:01:22,677][123090] Updated weights for policy 1, policy_version 551727 (0.0009) [2023-12-26 04:01:22,697][123091] Updated weights for policy 0, policy_version 555823 (0.0008) [2023-12-26 04:01:22,739][123090] Updated weights for policy 1, policy_version 551737 (0.0008) [2023-12-26 04:01:23,553][123091] Updated weights for policy 0, policy_version 555833 (0.0007) [2023-12-26 04:01:23,579][123090] Updated weights for policy 1, policy_version 551747 (0.0009) [2023-12-26 04:01:23,603][123091] Updated weights for policy 0, policy_version 555843 (0.0005) [2023-12-26 04:01:23,647][123090] Updated weights for policy 1, policy_version 551757 (0.0009) [2023-12-26 04:01:23,649][123091] Updated weights for policy 0, policy_version 555853 (0.0005) [2023-12-26 04:01:23,717][123090] Updated weights for policy 1, policy_version 551767 (0.0009) [2023-12-26 04:01:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 283557888. Throughput: 0: 8619.3, 1: 8782.2. Samples: 283527656. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:23,784][121949] Avg episode reward: [(0, '6037.582'), (1, '5973.772')] [2023-12-26 04:01:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000555856_142303232.pth... [2023-12-26 04:01:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000551776_141254656.pth... [2023-12-26 04:01:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000554864_142049280.pth [2023-12-26 04:01:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000550752_140992512.pth [2023-12-26 04:01:24,419][123091] Updated weights for policy 0, policy_version 555863 (0.0008) [2023-12-26 04:01:24,467][123091] Updated weights for policy 0, policy_version 555873 (0.0009) [2023-12-26 04:01:24,523][123091] Updated weights for policy 0, policy_version 555883 (0.0009) [2023-12-26 04:01:24,530][123090] Updated weights for policy 1, policy_version 551777 (0.0010) [2023-12-26 04:01:24,594][123090] Updated weights for policy 1, policy_version 551787 (0.0010) [2023-12-26 04:01:24,663][123090] Updated weights for policy 1, policy_version 551797 (0.0010) [2023-12-26 04:01:24,728][123090] Updated weights for policy 1, policy_version 551807 (0.0007) [2023-12-26 04:01:25,409][123091] Updated weights for policy 0, policy_version 555893 (0.0008) [2023-12-26 04:01:25,453][123091] Updated weights for policy 0, policy_version 555903 (0.0006) [2023-12-26 04:01:25,463][123090] Updated weights for policy 1, policy_version 551817 (0.0009) [2023-12-26 04:01:25,508][123091] Updated weights for policy 0, policy_version 555913 (0.0009) [2023-12-26 04:01:25,524][123090] Updated weights for policy 1, policy_version 551827 (0.0007) [2023-12-26 04:01:25,584][123090] Updated weights for policy 1, policy_version 551837 (0.0009) [2023-12-26 04:01:26,360][123091] Updated weights for policy 0, policy_version 555923 (0.0008) [2023-12-26 04:01:26,397][123090] Updated weights for policy 1, policy_version 551847 (0.0008) [2023-12-26 04:01:26,413][123091] Updated weights for policy 0, policy_version 555933 (0.0010) [2023-12-26 04:01:26,453][123090] Updated weights for policy 1, policy_version 551857 (0.0008) [2023-12-26 04:01:26,465][123091] Updated weights for policy 0, policy_version 555943 (0.0007) [2023-12-26 04:01:26,515][123090] Updated weights for policy 1, policy_version 551867 (0.0009) [2023-12-26 04:01:27,290][123091] Updated weights for policy 0, policy_version 555953 (0.0009) [2023-12-26 04:01:27,334][123090] Updated weights for policy 1, policy_version 551877 (0.0008) [2023-12-26 04:01:27,351][123091] Updated weights for policy 0, policy_version 555963 (0.0008) [2023-12-26 04:01:27,380][123090] Updated weights for policy 1, policy_version 551887 (0.0009) [2023-12-26 04:01:27,401][123091] Updated weights for policy 0, policy_version 555973 (0.0008) [2023-12-26 04:01:27,432][123090] Updated weights for policy 1, policy_version 551897 (0.0010) [2023-12-26 04:01:27,456][123091] Updated weights for policy 0, policy_version 555983 (0.0007) [2023-12-26 04:01:28,191][123090] Updated weights for policy 1, policy_version 551907 (0.0008) [2023-12-26 04:01:28,210][123091] Updated weights for policy 0, policy_version 555993 (0.0006) [2023-12-26 04:01:28,256][123090] Updated weights for policy 1, policy_version 551917 (0.0007) [2023-12-26 04:01:28,263][123091] Updated weights for policy 0, policy_version 556003 (0.0005) [2023-12-26 04:01:28,317][123090] Updated weights for policy 1, policy_version 551927 (0.0009) [2023-12-26 04:01:28,329][123091] Updated weights for policy 0, policy_version 556013 (0.0007) [2023-12-26 04:01:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 283639808. Throughput: 0: 8512.2, 1: 8778.4. Samples: 283632120. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:28,785][121949] Avg episode reward: [(0, '6067.433'), (1, '5920.572')] [2023-12-26 04:01:29,069][123090] Updated weights for policy 1, policy_version 551937 (0.0008) [2023-12-26 04:01:29,123][123090] Updated weights for policy 1, policy_version 551947 (0.0006) [2023-12-26 04:01:29,132][123091] Updated weights for policy 0, policy_version 556023 (0.0006) [2023-12-26 04:01:29,180][123090] Updated weights for policy 1, policy_version 551957 (0.0005) [2023-12-26 04:01:29,208][123091] Updated weights for policy 0, policy_version 556033 (0.0005) [2023-12-26 04:01:29,234][123090] Updated weights for policy 1, policy_version 551967 (0.0007) [2023-12-26 04:01:29,274][123091] Updated weights for policy 0, policy_version 556043 (0.0007) [2023-12-26 04:01:29,886][123090] Updated weights for policy 1, policy_version 551977 (0.0007) [2023-12-26 04:01:29,961][123090] Updated weights for policy 1, policy_version 551987 (0.0008) [2023-12-26 04:01:30,030][123090] Updated weights for policy 1, policy_version 551997 (0.0011) [2023-12-26 04:01:30,040][123091] Updated weights for policy 0, policy_version 556053 (0.0008) [2023-12-26 04:01:30,108][123091] Updated weights for policy 0, policy_version 556063 (0.0009) [2023-12-26 04:01:30,175][123091] Updated weights for policy 0, policy_version 556073 (0.0009) [2023-12-26 04:01:30,781][123090] Updated weights for policy 1, policy_version 552007 (0.0011) [2023-12-26 04:01:30,840][123090] Updated weights for policy 1, policy_version 552017 (0.0010) [2023-12-26 04:01:30,907][123090] Updated weights for policy 1, policy_version 552027 (0.0011) [2023-12-26 04:01:31,036][123091] Updated weights for policy 0, policy_version 556083 (0.0008) [2023-12-26 04:01:31,107][123091] Updated weights for policy 0, policy_version 556093 (0.0008) [2023-12-26 04:01:31,183][123091] Updated weights for policy 0, policy_version 556103 (0.0008) [2023-12-26 04:01:31,776][123090] Updated weights for policy 1, policy_version 552037 (0.0010) [2023-12-26 04:01:31,838][123090] Updated weights for policy 1, policy_version 552047 (0.0010) [2023-12-26 04:01:31,900][123090] Updated weights for policy 1, policy_version 552057 (0.0009) [2023-12-26 04:01:31,969][123091] Updated weights for policy 0, policy_version 556113 (0.0008) [2023-12-26 04:01:32,035][123091] Updated weights for policy 0, policy_version 556123 (0.0009) [2023-12-26 04:01:32,105][123091] Updated weights for policy 0, policy_version 556133 (0.0005) [2023-12-26 04:01:32,173][123091] Updated weights for policy 0, policy_version 556143 (0.0005) [2023-12-26 04:01:32,775][123090] Updated weights for policy 1, policy_version 552067 (0.0010) [2023-12-26 04:01:32,832][123090] Updated weights for policy 1, policy_version 552077 (0.0009) [2023-12-26 04:01:32,845][123091] Updated weights for policy 0, policy_version 556153 (0.0005) [2023-12-26 04:01:32,893][123090] Updated weights for policy 1, policy_version 552087 (0.0009) [2023-12-26 04:01:32,904][123091] Updated weights for policy 0, policy_version 556163 (0.0005) [2023-12-26 04:01:32,977][123091] Updated weights for policy 0, policy_version 556173 (0.0006) [2023-12-26 04:01:33,644][123091] Updated weights for policy 0, policy_version 556183 (0.0009) [2023-12-26 04:01:33,710][123091] Updated weights for policy 0, policy_version 556193 (0.0009) [2023-12-26 04:01:33,758][123091] Updated weights for policy 0, policy_version 556203 (0.0008) [2023-12-26 04:01:33,772][123090] Updated weights for policy 1, policy_version 552097 (0.0009) [2023-12-26 04:01:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 283729920. Throughput: 0: 8600.4, 1: 8773.5. Samples: 283740032. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:33,785][121949] Avg episode reward: [(0, '6146.197'), (1, '5894.072')] [2023-12-26 04:01:33,833][123090] Updated weights for policy 1, policy_version 552107 (0.0010) [2023-12-26 04:01:33,886][123090] Updated weights for policy 1, policy_version 552117 (0.0010) [2023-12-26 04:01:33,941][123090] Updated weights for policy 1, policy_version 552127 (0.0010) [2023-12-26 04:01:34,539][123091] Updated weights for policy 0, policy_version 556213 (0.0008) [2023-12-26 04:01:34,612][123091] Updated weights for policy 0, policy_version 556223 (0.0011) [2023-12-26 04:01:34,683][123091] Updated weights for policy 0, policy_version 556233 (0.0011) [2023-12-26 04:01:34,840][123090] Updated weights for policy 1, policy_version 552137 (0.0009) [2023-12-26 04:01:34,910][123090] Updated weights for policy 1, policy_version 552147 (0.0008) [2023-12-26 04:01:34,962][123090] Updated weights for policy 1, policy_version 552157 (0.0008) [2023-12-26 04:01:35,347][123091] Updated weights for policy 0, policy_version 556243 (0.0009) [2023-12-26 04:01:35,409][123091] Updated weights for policy 0, policy_version 556253 (0.0005) [2023-12-26 04:01:35,467][123091] Updated weights for policy 0, policy_version 556263 (0.0005) [2023-12-26 04:01:35,796][123090] Updated weights for policy 1, policy_version 552167 (0.0009) [2023-12-26 04:01:35,854][123090] Updated weights for policy 1, policy_version 552177 (0.0010) [2023-12-26 04:01:35,905][123090] Updated weights for policy 1, policy_version 552187 (0.0010) [2023-12-26 04:01:36,121][123091] Updated weights for policy 0, policy_version 556273 (0.0006) [2023-12-26 04:01:36,172][123091] Updated weights for policy 0, policy_version 556283 (0.0006) [2023-12-26 04:01:36,229][123091] Updated weights for policy 0, policy_version 556293 (0.0006) [2023-12-26 04:01:36,298][123091] Updated weights for policy 0, policy_version 556303 (0.0005) [2023-12-26 04:01:36,754][123090] Updated weights for policy 1, policy_version 552197 (0.0011) [2023-12-26 04:01:36,819][123090] Updated weights for policy 1, policy_version 552207 (0.0011) [2023-12-26 04:01:36,878][123090] Updated weights for policy 1, policy_version 552217 (0.0011) [2023-12-26 04:01:37,030][123091] Updated weights for policy 0, policy_version 556313 (0.0009) [2023-12-26 04:01:37,079][123091] Updated weights for policy 0, policy_version 556323 (0.0009) [2023-12-26 04:01:37,140][123091] Updated weights for policy 0, policy_version 556333 (0.0009) [2023-12-26 04:01:37,726][123090] Updated weights for policy 1, policy_version 552227 (0.0010) [2023-12-26 04:01:37,776][123090] Updated weights for policy 1, policy_version 552237 (0.0009) [2023-12-26 04:01:37,831][123090] Updated weights for policy 1, policy_version 552247 (0.0009) [2023-12-26 04:01:37,905][123091] Updated weights for policy 0, policy_version 556343 (0.0009) [2023-12-26 04:01:37,968][123091] Updated weights for policy 0, policy_version 556353 (0.0009) [2023-12-26 04:01:38,038][123091] Updated weights for policy 0, policy_version 556363 (0.0008) [2023-12-26 04:01:38,619][123090] Updated weights for policy 1, policy_version 552257 (0.0009) [2023-12-26 04:01:38,678][123090] Updated weights for policy 1, policy_version 552267 (0.0009) [2023-12-26 04:01:38,742][123090] Updated weights for policy 1, policy_version 552277 (0.0009) [2023-12-26 04:01:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 283811840. Throughput: 0: 8633.8, 1: 8735.7. Samples: 283794536. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:38,785][121949] Avg episode reward: [(0, '6188.916'), (1, '5828.335')] [2023-12-26 04:01:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000556368_142434304.pth... [2023-12-26 04:01:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000555344_142172160.pth [2023-12-26 04:01:38,815][123090] Updated weights for policy 1, policy_version 552287 (0.0009) [2023-12-26 04:01:38,818][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000552288_141385728.pth... [2023-12-26 04:01:38,824][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000551264_141123584.pth [2023-12-26 04:01:38,848][123091] Updated weights for policy 0, policy_version 556373 (0.0008) [2023-12-26 04:01:38,922][123091] Updated weights for policy 0, policy_version 556383 (0.0009) [2023-12-26 04:01:38,993][123091] Updated weights for policy 0, policy_version 556393 (0.0011) [2023-12-26 04:01:39,553][123090] Updated weights for policy 1, policy_version 552297 (0.0006) [2023-12-26 04:01:39,608][123090] Updated weights for policy 1, policy_version 552308 (0.0009) [2023-12-26 04:01:39,657][123090] Updated weights for policy 1, policy_version 552318 (0.0005) [2023-12-26 04:01:39,810][123091] Updated weights for policy 0, policy_version 556403 (0.0011) [2023-12-26 04:01:39,880][123091] Updated weights for policy 0, policy_version 556413 (0.0011) [2023-12-26 04:01:39,954][123091] Updated weights for policy 0, policy_version 556423 (0.0010) [2023-12-26 04:01:40,532][123090] Updated weights for policy 1, policy_version 552328 (0.0008) [2023-12-26 04:01:40,591][123090] Updated weights for policy 1, policy_version 552338 (0.0009) [2023-12-26 04:01:40,646][123090] Updated weights for policy 1, policy_version 552348 (0.0009) [2023-12-26 04:01:40,676][123091] Updated weights for policy 0, policy_version 556433 (0.0007) [2023-12-26 04:01:40,747][123091] Updated weights for policy 0, policy_version 556443 (0.0005) [2023-12-26 04:01:40,797][123091] Updated weights for policy 0, policy_version 556453 (0.0005) [2023-12-26 04:01:40,856][123091] Updated weights for policy 0, policy_version 556463 (0.0006) [2023-12-26 04:01:41,524][123090] Updated weights for policy 1, policy_version 552358 (0.0009) [2023-12-26 04:01:41,581][123090] Updated weights for policy 1, policy_version 552368 (0.0010) [2023-12-26 04:01:41,652][123091] Updated weights for policy 0, policy_version 556473 (0.0009) [2023-12-26 04:01:41,659][123090] Updated weights for policy 1, policy_version 552378 (0.0009) [2023-12-26 04:01:41,721][123091] Updated weights for policy 0, policy_version 556483 (0.0008) [2023-12-26 04:01:41,776][123091] Updated weights for policy 0, policy_version 556493 (0.0009) [2023-12-26 04:01:42,563][123090] Updated weights for policy 1, policy_version 552388 (0.0010) [2023-12-26 04:01:42,603][123091] Updated weights for policy 0, policy_version 556503 (0.0008) [2023-12-26 04:01:42,627][123090] Updated weights for policy 1, policy_version 552398 (0.0008) [2023-12-26 04:01:42,668][123091] Updated weights for policy 0, policy_version 556513 (0.0008) [2023-12-26 04:01:42,681][123090] Updated weights for policy 1, policy_version 552408 (0.0008) [2023-12-26 04:01:42,728][123091] Updated weights for policy 0, policy_version 556523 (0.0009) [2023-12-26 04:01:43,477][123090] Updated weights for policy 1, policy_version 552418 (0.0008) [2023-12-26 04:01:43,529][123090] Updated weights for policy 1, policy_version 552428 (0.0005) [2023-12-26 04:01:43,568][123091] Updated weights for policy 0, policy_version 556533 (0.0009) [2023-12-26 04:01:43,590][123090] Updated weights for policy 1, policy_version 552438 (0.0005) [2023-12-26 04:01:43,637][123091] Updated weights for policy 0, policy_version 556543 (0.0009) [2023-12-26 04:01:43,647][123090] Updated weights for policy 1, policy_version 552448 (0.0005) [2023-12-26 04:01:43,698][123091] Updated weights for policy 0, policy_version 556554 (0.0010) [2023-12-26 04:01:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 283910144. Throughput: 0: 8634.7, 1: 8636.6. Samples: 283898824. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:43,785][121949] Avg episode reward: [(0, '6244.424'), (1, '5871.499')] [2023-12-26 04:01:44,316][123090] Updated weights for policy 1, policy_version 552458 (0.0005) [2023-12-26 04:01:44,380][123090] Updated weights for policy 1, policy_version 552468 (0.0009) [2023-12-26 04:01:44,446][123090] Updated weights for policy 1, policy_version 552478 (0.0010) [2023-12-26 04:01:44,625][123091] Updated weights for policy 0, policy_version 556564 (0.0009) [2023-12-26 04:01:44,673][123091] Updated weights for policy 0, policy_version 556574 (0.0008) [2023-12-26 04:01:44,734][123091] Updated weights for policy 0, policy_version 556584 (0.0009) [2023-12-26 04:01:45,273][123090] Updated weights for policy 1, policy_version 552488 (0.0011) [2023-12-26 04:01:45,336][123090] Updated weights for policy 1, policy_version 552498 (0.0010) [2023-12-26 04:01:45,403][123090] Updated weights for policy 1, policy_version 552508 (0.0007) [2023-12-26 04:01:45,568][123091] Updated weights for policy 0, policy_version 556594 (0.0009) [2023-12-26 04:01:45,634][123091] Updated weights for policy 0, policy_version 556604 (0.0009) [2023-12-26 04:01:45,707][123091] Updated weights for policy 0, policy_version 556614 (0.0006) [2023-12-26 04:01:45,779][123091] Updated weights for policy 0, policy_version 556624 (0.0006) [2023-12-26 04:01:46,064][123090] Updated weights for policy 1, policy_version 552518 (0.0008) [2023-12-26 04:01:46,117][123090] Updated weights for policy 1, policy_version 552529 (0.0010) [2023-12-26 04:01:46,170][123090] Updated weights for policy 1, policy_version 552539 (0.0009) [2023-12-26 04:01:46,391][123091] Updated weights for policy 0, policy_version 556634 (0.0010) [2023-12-26 04:01:46,451][123091] Updated weights for policy 0, policy_version 556644 (0.0005) [2023-12-26 04:01:46,501][123091] Updated weights for policy 0, policy_version 556654 (0.0005) [2023-12-26 04:01:47,038][123090] Updated weights for policy 1, policy_version 552549 (0.0008) [2023-12-26 04:01:47,095][123090] Updated weights for policy 1, policy_version 552559 (0.0005) [2023-12-26 04:01:47,127][123091] Updated weights for policy 0, policy_version 556664 (0.0006) [2023-12-26 04:01:47,159][123090] Updated weights for policy 1, policy_version 552569 (0.0006) [2023-12-26 04:01:47,186][123091] Updated weights for policy 0, policy_version 556674 (0.0011) [2023-12-26 04:01:47,255][123091] Updated weights for policy 0, policy_version 556684 (0.0009) [2023-12-26 04:01:47,942][123090] Updated weights for policy 1, policy_version 552579 (0.0009) [2023-12-26 04:01:47,996][123091] Updated weights for policy 0, policy_version 556694 (0.0006) [2023-12-26 04:01:47,998][123090] Updated weights for policy 1, policy_version 552590 (0.0010) [2023-12-26 04:01:48,053][123090] Updated weights for policy 1, policy_version 552600 (0.0005) [2023-12-26 04:01:48,059][123091] Updated weights for policy 0, policy_version 556704 (0.0005) [2023-12-26 04:01:48,118][123091] Updated weights for policy 0, policy_version 556714 (0.0005) [2023-12-26 04:01:48,755][123091] Updated weights for policy 0, policy_version 556724 (0.0005) [2023-12-26 04:01:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 283992064. Throughput: 0: 8773.1, 1: 8730.2. Samples: 284008172. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:48,785][121949] Avg episode reward: [(0, '6171.572'), (1, '5709.812')] [2023-12-26 04:01:48,830][123091] Updated weights for policy 0, policy_version 556734 (0.0006) [2023-12-26 04:01:48,896][123090] Updated weights for policy 1, policy_version 552610 (0.0005) [2023-12-26 04:01:48,896][123091] Updated weights for policy 0, policy_version 556744 (0.0006) [2023-12-26 04:01:48,962][123090] Updated weights for policy 1, policy_version 552620 (0.0008) [2023-12-26 04:01:49,029][123090] Updated weights for policy 1, policy_version 552630 (0.0005) [2023-12-26 04:01:49,096][123090] Updated weights for policy 1, policy_version 552640 (0.0005) [2023-12-26 04:01:49,585][123091] Updated weights for policy 0, policy_version 556754 (0.0008) [2023-12-26 04:01:49,647][123091] Updated weights for policy 0, policy_version 556764 (0.0008) [2023-12-26 04:01:49,707][123091] Updated weights for policy 0, policy_version 556774 (0.0010) [2023-12-26 04:01:49,770][123091] Updated weights for policy 0, policy_version 556784 (0.0010) [2023-12-26 04:01:49,802][123090] Updated weights for policy 1, policy_version 552650 (0.0008) [2023-12-26 04:01:49,866][123090] Updated weights for policy 1, policy_version 552660 (0.0009) [2023-12-26 04:01:49,934][123090] Updated weights for policy 1, policy_version 552670 (0.0010) [2023-12-26 04:01:50,534][123091] Updated weights for policy 0, policy_version 556794 (0.0005) [2023-12-26 04:01:50,594][123091] Updated weights for policy 0, policy_version 556804 (0.0006) [2023-12-26 04:01:50,659][123091] Updated weights for policy 0, policy_version 556814 (0.0006) [2023-12-26 04:01:50,823][123090] Updated weights for policy 1, policy_version 552680 (0.0010) [2023-12-26 04:01:50,877][123090] Updated weights for policy 1, policy_version 552690 (0.0010) [2023-12-26 04:01:50,944][123090] Updated weights for policy 1, policy_version 552700 (0.0009) [2023-12-26 04:01:51,436][123091] Updated weights for policy 0, policy_version 556824 (0.0008) [2023-12-26 04:01:51,494][123091] Updated weights for policy 0, policy_version 556834 (0.0008) [2023-12-26 04:01:51,547][123091] Updated weights for policy 0, policy_version 556844 (0.0007) [2023-12-26 04:01:51,831][123090] Updated weights for policy 1, policy_version 552710 (0.0009) [2023-12-26 04:01:51,893][123090] Updated weights for policy 1, policy_version 552720 (0.0009) [2023-12-26 04:01:51,950][123090] Updated weights for policy 1, policy_version 552730 (0.0009) [2023-12-26 04:01:52,361][123091] Updated weights for policy 0, policy_version 556854 (0.0008) [2023-12-26 04:01:52,439][123091] Updated weights for policy 0, policy_version 556864 (0.0010) [2023-12-26 04:01:52,500][123091] Updated weights for policy 0, policy_version 556874 (0.0010) [2023-12-26 04:01:52,731][123090] Updated weights for policy 1, policy_version 552740 (0.0009) [2023-12-26 04:01:52,780][123090] Updated weights for policy 1, policy_version 552750 (0.0009) [2023-12-26 04:01:52,829][123090] Updated weights for policy 1, policy_version 552760 (0.0008) [2023-12-26 04:01:53,329][123091] Updated weights for policy 0, policy_version 556884 (0.0008) [2023-12-26 04:01:53,377][123091] Updated weights for policy 0, policy_version 556894 (0.0005) [2023-12-26 04:01:53,423][123091] Updated weights for policy 0, policy_version 556904 (0.0005) [2023-12-26 04:01:53,574][123090] Updated weights for policy 1, policy_version 552770 (0.0008) [2023-12-26 04:01:53,638][123090] Updated weights for policy 1, policy_version 552780 (0.0005) [2023-12-26 04:01:53,707][123090] Updated weights for policy 1, policy_version 552790 (0.0005) [2023-12-26 04:01:53,759][123090] Updated weights for policy 1, policy_version 552800 (0.0005) [2023-12-26 04:01:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 284090368. Throughput: 0: 8836.5, 1: 8753.0. Samples: 284062072. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:53,786][121949] Avg episode reward: [(0, '6199.929'), (1, '5719.505')] [2023-12-26 04:01:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000556912_142573568.pth... [2023-12-26 04:01:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000552800_141516800.pth... [2023-12-26 04:01:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000555856_142303232.pth [2023-12-26 04:01:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000551776_141254656.pth [2023-12-26 04:01:54,153][123091] Updated weights for policy 0, policy_version 556914 (0.0006) [2023-12-26 04:01:54,209][123091] Updated weights for policy 0, policy_version 556924 (0.0005) [2023-12-26 04:01:54,260][123091] Updated weights for policy 0, policy_version 556934 (0.0007) [2023-12-26 04:01:54,311][123091] Updated weights for policy 0, policy_version 556944 (0.0010) [2023-12-26 04:01:54,472][123090] Updated weights for policy 1, policy_version 552810 (0.0006) [2023-12-26 04:01:54,524][123090] Updated weights for policy 1, policy_version 552820 (0.0008) [2023-12-26 04:01:54,574][123090] Updated weights for policy 1, policy_version 552830 (0.0009) [2023-12-26 04:01:55,009][123091] Updated weights for policy 0, policy_version 556954 (0.0006) [2023-12-26 04:01:55,064][123091] Updated weights for policy 0, policy_version 556964 (0.0006) [2023-12-26 04:01:55,119][123091] Updated weights for policy 0, policy_version 556974 (0.0005) [2023-12-26 04:01:55,373][123090] Updated weights for policy 1, policy_version 552840 (0.0006) [2023-12-26 04:01:55,436][123090] Updated weights for policy 1, policy_version 552850 (0.0006) [2023-12-26 04:01:55,484][123090] Updated weights for policy 1, policy_version 552860 (0.0005) [2023-12-26 04:01:55,784][123091] Updated weights for policy 0, policy_version 556984 (0.0010) [2023-12-26 04:01:55,836][123091] Updated weights for policy 0, policy_version 556994 (0.0011) [2023-12-26 04:01:55,888][123091] Updated weights for policy 0, policy_version 557004 (0.0011) [2023-12-26 04:01:56,247][123090] Updated weights for policy 1, policy_version 552870 (0.0007) [2023-12-26 04:01:56,312][123090] Updated weights for policy 1, policy_version 552880 (0.0008) [2023-12-26 04:01:56,369][123090] Updated weights for policy 1, policy_version 552890 (0.0008) [2023-12-26 04:01:56,698][123091] Updated weights for policy 0, policy_version 557014 (0.0007) [2023-12-26 04:01:56,767][123091] Updated weights for policy 0, policy_version 557024 (0.0006) [2023-12-26 04:01:56,816][123091] Updated weights for policy 0, policy_version 557034 (0.0008) [2023-12-26 04:01:57,082][123090] Updated weights for policy 1, policy_version 552900 (0.0007) [2023-12-26 04:01:57,134][123090] Updated weights for policy 1, policy_version 552910 (0.0007) [2023-12-26 04:01:57,186][123090] Updated weights for policy 1, policy_version 552921 (0.0010) [2023-12-26 04:01:57,543][123091] Updated weights for policy 0, policy_version 557044 (0.0008) [2023-12-26 04:01:57,588][123091] Updated weights for policy 0, policy_version 557054 (0.0005) [2023-12-26 04:01:57,637][123091] Updated weights for policy 0, policy_version 557064 (0.0006) [2023-12-26 04:01:57,973][123090] Updated weights for policy 1, policy_version 552932 (0.0010) [2023-12-26 04:01:58,046][123090] Updated weights for policy 1, policy_version 552942 (0.0008) [2023-12-26 04:01:58,104][123090] Updated weights for policy 1, policy_version 552952 (0.0008) [2023-12-26 04:01:58,433][123091] Updated weights for policy 0, policy_version 557074 (0.0006) [2023-12-26 04:01:58,496][123091] Updated weights for policy 0, policy_version 557084 (0.0008) [2023-12-26 04:01:58,562][123091] Updated weights for policy 0, policy_version 557094 (0.0008) [2023-12-26 04:01:58,633][123091] Updated weights for policy 0, policy_version 557104 (0.0008) [2023-12-26 04:01:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 284180480. Throughput: 0: 8993.0, 1: 8866.4. Samples: 284174224. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:01:58,785][121949] Avg episode reward: [(0, '6213.175'), (1, '5433.095')] [2023-12-26 04:01:58,980][123090] Updated weights for policy 1, policy_version 552962 (0.0008) [2023-12-26 04:01:59,039][123090] Updated weights for policy 1, policy_version 552972 (0.0008) [2023-12-26 04:01:59,103][123090] Updated weights for policy 1, policy_version 552982 (0.0007) [2023-12-26 04:01:59,155][123090] Updated weights for policy 1, policy_version 552992 (0.0008) [2023-12-26 04:01:59,517][123091] Updated weights for policy 0, policy_version 557114 (0.0009) [2023-12-26 04:01:59,568][123091] Updated weights for policy 0, policy_version 557124 (0.0010) [2023-12-26 04:01:59,619][123091] Updated weights for policy 0, policy_version 557134 (0.0009) [2023-12-26 04:01:59,926][123090] Updated weights for policy 1, policy_version 553002 (0.0009) [2023-12-26 04:01:59,991][123090] Updated weights for policy 1, policy_version 553012 (0.0009) [2023-12-26 04:02:00,056][123090] Updated weights for policy 1, policy_version 553022 (0.0009) [2023-12-26 04:02:00,457][123091] Updated weights for policy 0, policy_version 557144 (0.0009) [2023-12-26 04:02:00,514][123091] Updated weights for policy 0, policy_version 557154 (0.0010) [2023-12-26 04:02:00,568][123091] Updated weights for policy 0, policy_version 557164 (0.0010) [2023-12-26 04:02:00,818][123090] Updated weights for policy 1, policy_version 553032 (0.0008) [2023-12-26 04:02:00,881][123090] Updated weights for policy 1, policy_version 553042 (0.0005) [2023-12-26 04:02:00,939][123090] Updated weights for policy 1, policy_version 553052 (0.0005) [2023-12-26 04:02:01,525][123091] Updated weights for policy 0, policy_version 557174 (0.0007) [2023-12-26 04:02:01,596][123091] Updated weights for policy 0, policy_version 557184 (0.0006) [2023-12-26 04:02:01,666][123091] Updated weights for policy 0, policy_version 557194 (0.0008) [2023-12-26 04:02:01,685][123090] Updated weights for policy 1, policy_version 553062 (0.0008) [2023-12-26 04:02:01,757][123090] Updated weights for policy 1, policy_version 553072 (0.0009) [2023-12-26 04:02:01,813][123090] Updated weights for policy 1, policy_version 553082 (0.0009) [2023-12-26 04:02:02,494][123091] Updated weights for policy 0, policy_version 557204 (0.0009) [2023-12-26 04:02:02,557][123091] Updated weights for policy 0, policy_version 557214 (0.0009) [2023-12-26 04:02:02,628][123091] Updated weights for policy 0, policy_version 557224 (0.0007) [2023-12-26 04:02:02,643][123090] Updated weights for policy 1, policy_version 553092 (0.0010) [2023-12-26 04:02:02,700][123090] Updated weights for policy 1, policy_version 553102 (0.0008) [2023-12-26 04:02:02,755][123090] Updated weights for policy 1, policy_version 553112 (0.0009) [2023-12-26 04:02:03,315][123091] Updated weights for policy 0, policy_version 557234 (0.0007) [2023-12-26 04:02:03,374][123091] Updated weights for policy 0, policy_version 557244 (0.0005) [2023-12-26 04:02:03,438][123091] Updated weights for policy 0, policy_version 557254 (0.0005) [2023-12-26 04:02:03,497][123091] Updated weights for policy 0, policy_version 557264 (0.0009) [2023-12-26 04:02:03,641][123090] Updated weights for policy 1, policy_version 553122 (0.0009) [2023-12-26 04:02:03,686][123090] Updated weights for policy 1, policy_version 553132 (0.0005) [2023-12-26 04:02:03,733][123090] Updated weights for policy 1, policy_version 553142 (0.0005) [2023-12-26 04:02:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 284262400. Throughput: 0: 8989.1, 1: 8818.7. Samples: 284277340. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:02:03,785][121949] Avg episode reward: [(0, '6214.699'), (1, '5163.962')] [2023-12-26 04:02:03,794][123090] Updated weights for policy 1, policy_version 553152 (0.0005) [2023-12-26 04:02:04,265][123091] Updated weights for policy 0, policy_version 557274 (0.0005) [2023-12-26 04:02:04,333][123091] Updated weights for policy 0, policy_version 557284 (0.0005) [2023-12-26 04:02:04,402][123091] Updated weights for policy 0, policy_version 557294 (0.0008) [2023-12-26 04:02:04,560][123090] Updated weights for policy 1, policy_version 553162 (0.0008) [2023-12-26 04:02:04,612][123090] Updated weights for policy 1, policy_version 553172 (0.0008) [2023-12-26 04:02:04,670][123090] Updated weights for policy 1, policy_version 553182 (0.0008) [2023-12-26 04:02:05,181][123091] Updated weights for policy 0, policy_version 557304 (0.0009) [2023-12-26 04:02:05,237][123091] Updated weights for policy 0, policy_version 557314 (0.0009) [2023-12-26 04:02:05,291][123091] Updated weights for policy 0, policy_version 557324 (0.0009) [2023-12-26 04:02:05,438][123090] Updated weights for policy 1, policy_version 553192 (0.0008) [2023-12-26 04:02:05,508][123090] Updated weights for policy 1, policy_version 553202 (0.0009) [2023-12-26 04:02:05,568][123090] Updated weights for policy 1, policy_version 553212 (0.0009) [2023-12-26 04:02:06,161][123091] Updated weights for policy 0, policy_version 557334 (0.0009) [2023-12-26 04:02:06,222][123091] Updated weights for policy 0, policy_version 557344 (0.0009) [2023-12-26 04:02:06,286][123091] Updated weights for policy 0, policy_version 557354 (0.0008) [2023-12-26 04:02:06,390][123090] Updated weights for policy 1, policy_version 553222 (0.0010) [2023-12-26 04:02:06,450][123090] Updated weights for policy 1, policy_version 553232 (0.0010) [2023-12-26 04:02:06,517][123090] Updated weights for policy 1, policy_version 553242 (0.0011) [2023-12-26 04:02:07,128][123091] Updated weights for policy 0, policy_version 557364 (0.0010) [2023-12-26 04:02:07,180][123091] Updated weights for policy 0, policy_version 557374 (0.0011) [2023-12-26 04:02:07,225][123090] Updated weights for policy 1, policy_version 553252 (0.0009) [2023-12-26 04:02:07,232][123091] Updated weights for policy 0, policy_version 557384 (0.0011) [2023-12-26 04:02:07,288][123090] Updated weights for policy 1, policy_version 553262 (0.0005) [2023-12-26 04:02:07,343][123090] Updated weights for policy 1, policy_version 553272 (0.0005) [2023-12-26 04:02:07,911][123091] Updated weights for policy 0, policy_version 557394 (0.0010) [2023-12-26 04:02:07,960][123091] Updated weights for policy 0, policy_version 557404 (0.0005) [2023-12-26 04:02:08,009][123091] Updated weights for policy 0, policy_version 557414 (0.0005) [2023-12-26 04:02:08,010][123090] Updated weights for policy 1, policy_version 553282 (0.0006) [2023-12-26 04:02:08,059][123091] Updated weights for policy 0, policy_version 557424 (0.0010) [2023-12-26 04:02:08,062][123090] Updated weights for policy 1, policy_version 553292 (0.0010) [2023-12-26 04:02:08,113][123090] Updated weights for policy 1, policy_version 553302 (0.0010) [2023-12-26 04:02:08,157][123090] Updated weights for policy 1, policy_version 553312 (0.0008) [2023-12-26 04:02:08,774][123091] Updated weights for policy 0, policy_version 557434 (0.0006) [2023-12-26 04:02:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 284352512. Throughput: 0: 9009.1, 1: 8816.0. Samples: 284329788. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:02:08,785][121949] Avg episode reward: [(0, '6232.906'), (1, '5126.353')] [2023-12-26 04:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000553312_141647872.pth... [2023-12-26 04:02:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000552288_141385728.pth [2023-12-26 04:02:08,832][123091] Updated weights for policy 0, policy_version 557444 (0.0005) [2023-12-26 04:02:08,897][123091] Updated weights for policy 0, policy_version 557454 (0.0008) [2023-12-26 04:02:08,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000557456_142712832.pth... [2023-12-26 04:02:08,919][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000556368_142434304.pth [2023-12-26 04:02:08,969][123090] Updated weights for policy 1, policy_version 553322 (0.0005) [2023-12-26 04:02:09,042][123090] Updated weights for policy 1, policy_version 553332 (0.0006) [2023-12-26 04:02:09,107][123090] Updated weights for policy 1, policy_version 553342 (0.0006) [2023-12-26 04:02:09,610][123091] Updated weights for policy 0, policy_version 557464 (0.0009) [2023-12-26 04:02:09,679][123091] Updated weights for policy 0, policy_version 557474 (0.0005) [2023-12-26 04:02:09,747][123091] Updated weights for policy 0, policy_version 557484 (0.0006) [2023-12-26 04:02:09,879][123090] Updated weights for policy 1, policy_version 553352 (0.0009) [2023-12-26 04:02:09,951][123090] Updated weights for policy 1, policy_version 553362 (0.0008) [2023-12-26 04:02:10,014][123090] Updated weights for policy 1, policy_version 553372 (0.0011) [2023-12-26 04:02:10,449][123091] Updated weights for policy 0, policy_version 557494 (0.0006) [2023-12-26 04:02:10,504][123091] Updated weights for policy 0, policy_version 557504 (0.0010) [2023-12-26 04:02:10,558][123091] Updated weights for policy 0, policy_version 557514 (0.0009) [2023-12-26 04:02:10,895][123090] Updated weights for policy 1, policy_version 553382 (0.0010) [2023-12-26 04:02:10,958][123090] Updated weights for policy 1, policy_version 553392 (0.0010) [2023-12-26 04:02:11,025][123090] Updated weights for policy 1, policy_version 553402 (0.0010) [2023-12-26 04:02:11,417][123091] Updated weights for policy 0, policy_version 557524 (0.0010) [2023-12-26 04:02:11,484][123091] Updated weights for policy 0, policy_version 557534 (0.0010) [2023-12-26 04:02:11,554][123091] Updated weights for policy 0, policy_version 557544 (0.0009) [2023-12-26 04:02:11,888][123090] Updated weights for policy 1, policy_version 553412 (0.0009) [2023-12-26 04:02:11,957][123090] Updated weights for policy 1, policy_version 553422 (0.0009) [2023-12-26 04:02:12,023][123090] Updated weights for policy 1, policy_version 553432 (0.0010) [2023-12-26 04:02:12,366][123091] Updated weights for policy 0, policy_version 557554 (0.0009) [2023-12-26 04:02:12,433][123091] Updated weights for policy 0, policy_version 557564 (0.0008) [2023-12-26 04:02:12,487][123091] Updated weights for policy 0, policy_version 557574 (0.0008) [2023-12-26 04:02:12,539][123091] Updated weights for policy 0, policy_version 557584 (0.0008) [2023-12-26 04:02:12,890][123090] Updated weights for policy 1, policy_version 553442 (0.0009) [2023-12-26 04:02:12,947][123090] Updated weights for policy 1, policy_version 553452 (0.0010) [2023-12-26 04:02:13,001][123090] Updated weights for policy 1, policy_version 553463 (0.0010) [2023-12-26 04:02:13,280][123091] Updated weights for policy 0, policy_version 557594 (0.0009) [2023-12-26 04:02:13,342][123091] Updated weights for policy 0, policy_version 557604 (0.0010) [2023-12-26 04:02:13,415][123091] Updated weights for policy 0, policy_version 557614 (0.0009) [2023-12-26 04:02:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 284442624. Throughput: 0: 9089.7, 1: 8800.3. Samples: 284437168. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:02:13,785][121949] Avg episode reward: [(0, '6260.270'), (1, '5156.981')] [2023-12-26 04:02:13,829][123090] Updated weights for policy 1, policy_version 553474 (0.0010) [2023-12-26 04:02:13,892][123090] Updated weights for policy 1, policy_version 553484 (0.0008) [2023-12-26 04:02:13,954][123090] Updated weights for policy 1, policy_version 553494 (0.0008) [2023-12-26 04:02:14,005][123090] Updated weights for policy 1, policy_version 553504 (0.0009) [2023-12-26 04:02:14,157][123091] Updated weights for policy 0, policy_version 557624 (0.0010) [2023-12-26 04:02:14,225][123091] Updated weights for policy 0, policy_version 557634 (0.0011) [2023-12-26 04:02:14,288][123091] Updated weights for policy 0, policy_version 557644 (0.0011) [2023-12-26 04:02:14,902][123090] Updated weights for policy 1, policy_version 553514 (0.0010) [2023-12-26 04:02:14,957][123090] Updated weights for policy 1, policy_version 553524 (0.0010) [2023-12-26 04:02:14,982][123091] Updated weights for policy 0, policy_version 557654 (0.0007) [2023-12-26 04:02:15,012][123090] Updated weights for policy 1, policy_version 553534 (0.0009) [2023-12-26 04:02:15,045][123091] Updated weights for policy 0, policy_version 557664 (0.0006) [2023-12-26 04:02:15,117][123091] Updated weights for policy 0, policy_version 557674 (0.0006) [2023-12-26 04:02:15,804][123091] Updated weights for policy 0, policy_version 557684 (0.0007) [2023-12-26 04:02:15,852][123091] Updated weights for policy 0, policy_version 557694 (0.0005) [2023-12-26 04:02:15,895][123090] Updated weights for policy 1, policy_version 553544 (0.0009) [2023-12-26 04:02:15,905][123091] Updated weights for policy 0, policy_version 557704 (0.0005) [2023-12-26 04:02:15,951][123090] Updated weights for policy 1, policy_version 553554 (0.0008) [2023-12-26 04:02:16,004][123090] Updated weights for policy 1, policy_version 553564 (0.0009) [2023-12-26 04:02:16,692][123091] Updated weights for policy 0, policy_version 557714 (0.0006) [2023-12-26 04:02:16,741][123091] Updated weights for policy 0, policy_version 557724 (0.0009) [2023-12-26 04:02:16,792][123091] Updated weights for policy 0, policy_version 557734 (0.0009) [2023-12-26 04:02:16,848][123091] Updated weights for policy 0, policy_version 557744 (0.0008) [2023-12-26 04:02:16,855][123090] Updated weights for policy 1, policy_version 553574 (0.0010) [2023-12-26 04:02:16,909][123090] Updated weights for policy 1, policy_version 553584 (0.0010) [2023-12-26 04:02:16,967][123090] Updated weights for policy 1, policy_version 553594 (0.0010) [2023-12-26 04:02:17,677][123091] Updated weights for policy 0, policy_version 557754 (0.0006) [2023-12-26 04:02:17,741][123091] Updated weights for policy 0, policy_version 557764 (0.0006) [2023-12-26 04:02:17,813][123091] Updated weights for policy 0, policy_version 557774 (0.0009) [2023-12-26 04:02:17,832][123090] Updated weights for policy 1, policy_version 553604 (0.0010) [2023-12-26 04:02:17,898][123090] Updated weights for policy 1, policy_version 553614 (0.0010) [2023-12-26 04:02:17,968][123090] Updated weights for policy 1, policy_version 553624 (0.0009) [2023-12-26 04:02:18,547][123091] Updated weights for policy 0, policy_version 557784 (0.0007) [2023-12-26 04:02:18,607][123091] Updated weights for policy 0, policy_version 557794 (0.0008) [2023-12-26 04:02:18,672][123091] Updated weights for policy 0, policy_version 557804 (0.0008) [2023-12-26 04:02:18,753][123090] Updated weights for policy 1, policy_version 553634 (0.0010) [2023-12-26 04:02:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 284532736. Throughput: 0: 9131.4, 1: 8748.7. Samples: 284544636. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:18,785][121949] Avg episode reward: [(0, '6254.259'), (1, '5244.284')] [2023-12-26 04:02:18,819][123090] Updated weights for policy 1, policy_version 553644 (0.0010) [2023-12-26 04:02:18,885][123090] Updated weights for policy 1, policy_version 553654 (0.0010) [2023-12-26 04:02:18,944][123090] Updated weights for policy 1, policy_version 553664 (0.0009) [2023-12-26 04:02:19,488][123091] Updated weights for policy 0, policy_version 557814 (0.0009) [2023-12-26 04:02:19,551][123091] Updated weights for policy 0, policy_version 557824 (0.0009) [2023-12-26 04:02:19,617][123091] Updated weights for policy 0, policy_version 557834 (0.0009) [2023-12-26 04:02:19,873][123090] Updated weights for policy 1, policy_version 553674 (0.0010) [2023-12-26 04:02:19,936][123090] Updated weights for policy 1, policy_version 553684 (0.0010) [2023-12-26 04:02:19,994][123090] Updated weights for policy 1, policy_version 553694 (0.0010) [2023-12-26 04:02:20,481][123091] Updated weights for policy 0, policy_version 557844 (0.0010) [2023-12-26 04:02:20,546][123091] Updated weights for policy 0, policy_version 557854 (0.0010) [2023-12-26 04:02:20,613][123091] Updated weights for policy 0, policy_version 557864 (0.0009) [2023-12-26 04:02:20,786][123090] Updated weights for policy 1, policy_version 553704 (0.0009) [2023-12-26 04:02:20,858][123090] Updated weights for policy 1, policy_version 553714 (0.0006) [2023-12-26 04:02:20,923][123090] Updated weights for policy 1, policy_version 553724 (0.0005) [2023-12-26 04:02:21,491][123091] Updated weights for policy 0, policy_version 557874 (0.0010) [2023-12-26 04:02:21,560][123091] Updated weights for policy 0, policy_version 557884 (0.0010) [2023-12-26 04:02:21,626][123091] Updated weights for policy 0, policy_version 557894 (0.0011) [2023-12-26 04:02:21,697][123091] Updated weights for policy 0, policy_version 557904 (0.0010) [2023-12-26 04:02:21,730][123090] Updated weights for policy 1, policy_version 553734 (0.0010) [2023-12-26 04:02:21,790][123090] Updated weights for policy 1, policy_version 553744 (0.0010) [2023-12-26 04:02:21,857][123090] Updated weights for policy 1, policy_version 553754 (0.0009) [2023-12-26 04:02:22,349][123091] Updated weights for policy 0, policy_version 557914 (0.0006) [2023-12-26 04:02:22,416][123091] Updated weights for policy 0, policy_version 557924 (0.0009) [2023-12-26 04:02:22,485][123091] Updated weights for policy 0, policy_version 557934 (0.0006) [2023-12-26 04:02:22,627][123090] Updated weights for policy 1, policy_version 553764 (0.0008) [2023-12-26 04:02:22,697][123090] Updated weights for policy 1, policy_version 553774 (0.0006) [2023-12-26 04:02:22,755][123090] Updated weights for policy 1, policy_version 553784 (0.0006) [2023-12-26 04:02:23,334][123091] Updated weights for policy 0, policy_version 557944 (0.0010) [2023-12-26 04:02:23,375][123090] Updated weights for policy 1, policy_version 553794 (0.0007) [2023-12-26 04:02:23,397][123091] Updated weights for policy 0, policy_version 557954 (0.0011) [2023-12-26 04:02:23,442][123090] Updated weights for policy 1, policy_version 553804 (0.0011) [2023-12-26 04:02:23,449][123091] Updated weights for policy 0, policy_version 557964 (0.0008) [2023-12-26 04:02:23,502][123090] Updated weights for policy 1, policy_version 553814 (0.0010) [2023-12-26 04:02:23,560][123090] Updated weights for policy 1, policy_version 553824 (0.0010) [2023-12-26 04:02:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 284622848. Throughput: 0: 9035.2, 1: 8759.9. Samples: 284595316. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:23,784][121949] Avg episode reward: [(0, '6236.126'), (1, '5291.928')] [2023-12-26 04:02:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000557968_142843904.pth... [2023-12-26 04:02:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000553824_141778944.pth... [2023-12-26 04:02:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000556912_142573568.pth [2023-12-26 04:02:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000552800_141516800.pth [2023-12-26 04:02:24,132][123091] Updated weights for policy 0, policy_version 557974 (0.0007) [2023-12-26 04:02:24,201][123091] Updated weights for policy 0, policy_version 557984 (0.0009) [2023-12-26 04:02:24,299][123091] Updated weights for policy 0, policy_version 557994 (0.0008) [2023-12-26 04:02:24,363][123090] Updated weights for policy 1, policy_version 553834 (0.0005) [2023-12-26 04:02:24,411][123090] Updated weights for policy 1, policy_version 553844 (0.0005) [2023-12-26 04:02:24,484][123090] Updated weights for policy 1, policy_version 553854 (0.0005) [2023-12-26 04:02:25,059][123091] Updated weights for policy 0, policy_version 558004 (0.0006) [2023-12-26 04:02:25,061][123090] Updated weights for policy 1, policy_version 553864 (0.0010) [2023-12-26 04:02:25,112][123090] Updated weights for policy 1, policy_version 553874 (0.0009) [2023-12-26 04:02:25,112][123091] Updated weights for policy 0, policy_version 558014 (0.0006) [2023-12-26 04:02:25,168][123091] Updated weights for policy 0, policy_version 558024 (0.0009) [2023-12-26 04:02:25,169][123090] Updated weights for policy 1, policy_version 553884 (0.0005) [2023-12-26 04:02:25,873][123090] Updated weights for policy 1, policy_version 553894 (0.0005) [2023-12-26 04:02:25,939][123090] Updated weights for policy 1, policy_version 553904 (0.0005) [2023-12-26 04:02:26,012][123090] Updated weights for policy 1, policy_version 553914 (0.0007) [2023-12-26 04:02:26,076][123091] Updated weights for policy 0, policy_version 558034 (0.0010) [2023-12-26 04:02:26,123][123091] Updated weights for policy 0, policy_version 558044 (0.0009) [2023-12-26 04:02:26,179][123091] Updated weights for policy 0, policy_version 558054 (0.0008) [2023-12-26 04:02:26,236][123091] Updated weights for policy 0, policy_version 558064 (0.0009) [2023-12-26 04:02:26,727][123090] Updated weights for policy 1, policy_version 553924 (0.0009) [2023-12-26 04:02:26,803][123090] Updated weights for policy 1, policy_version 553934 (0.0006) [2023-12-26 04:02:26,875][123090] Updated weights for policy 1, policy_version 553944 (0.0009) [2023-12-26 04:02:27,103][123091] Updated weights for policy 0, policy_version 558074 (0.0010) [2023-12-26 04:02:27,177][123091] Updated weights for policy 0, policy_version 558084 (0.0010) [2023-12-26 04:02:27,247][123091] Updated weights for policy 0, policy_version 558094 (0.0009) [2023-12-26 04:02:27,552][123090] Updated weights for policy 1, policy_version 553954 (0.0009) [2023-12-26 04:02:27,612][123090] Updated weights for policy 1, policy_version 553964 (0.0005) [2023-12-26 04:02:27,677][123090] Updated weights for policy 1, policy_version 553974 (0.0007) [2023-12-26 04:02:27,731][123090] Updated weights for policy 1, policy_version 553984 (0.0005) [2023-12-26 04:02:28,083][123091] Updated weights for policy 0, policy_version 558104 (0.0010) [2023-12-26 04:02:28,136][123091] Updated weights for policy 0, policy_version 558114 (0.0009) [2023-12-26 04:02:28,192][123091] Updated weights for policy 0, policy_version 558124 (0.0009) [2023-12-26 04:02:28,353][123090] Updated weights for policy 1, policy_version 553994 (0.0010) [2023-12-26 04:02:28,419][123090] Updated weights for policy 1, policy_version 554004 (0.0010) [2023-12-26 04:02:28,486][123090] Updated weights for policy 1, policy_version 554014 (0.0010) [2023-12-26 04:02:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 284712960. Throughput: 0: 9009.4, 1: 8926.5. Samples: 284705940. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:28,785][121949] Avg episode reward: [(0, '6186.047'), (1, '5236.461')] [2023-12-26 04:02:29,039][123091] Updated weights for policy 0, policy_version 558135 (0.0008) [2023-12-26 04:02:29,089][123091] Updated weights for policy 0, policy_version 558145 (0.0010) [2023-12-26 04:02:29,149][123091] Updated weights for policy 0, policy_version 558155 (0.0010) [2023-12-26 04:02:29,224][123090] Updated weights for policy 1, policy_version 554024 (0.0011) [2023-12-26 04:02:29,300][123090] Updated weights for policy 1, policy_version 554034 (0.0011) [2023-12-26 04:02:29,372][123090] Updated weights for policy 1, policy_version 554044 (0.0013) [2023-12-26 04:02:29,961][123091] Updated weights for policy 0, policy_version 558165 (0.0011) [2023-12-26 04:02:30,009][123091] Updated weights for policy 0, policy_version 558175 (0.0010) [2023-12-26 04:02:30,061][123091] Updated weights for policy 0, policy_version 558185 (0.0010) [2023-12-26 04:02:30,140][123090] Updated weights for policy 1, policy_version 554054 (0.0007) [2023-12-26 04:02:30,214][123090] Updated weights for policy 1, policy_version 554064 (0.0006) [2023-12-26 04:02:30,285][123090] Updated weights for policy 1, policy_version 554074 (0.0006) [2023-12-26 04:02:30,792][123091] Updated weights for policy 0, policy_version 558195 (0.0009) [2023-12-26 04:02:30,853][123091] Updated weights for policy 0, policy_version 558205 (0.0005) [2023-12-26 04:02:30,912][123090] Updated weights for policy 1, policy_version 554084 (0.0007) [2023-12-26 04:02:30,916][123091] Updated weights for policy 0, policy_version 558215 (0.0005) [2023-12-26 04:02:30,960][123090] Updated weights for policy 1, policy_version 554094 (0.0010) [2023-12-26 04:02:31,007][123090] Updated weights for policy 1, policy_version 554104 (0.0010) [2023-12-26 04:02:31,590][123091] Updated weights for policy 0, policy_version 558225 (0.0006) [2023-12-26 04:02:31,653][123091] Updated weights for policy 0, policy_version 558235 (0.0010) [2023-12-26 04:02:31,724][123091] Updated weights for policy 0, policy_version 558245 (0.0010) [2023-12-26 04:02:31,779][123090] Updated weights for policy 1, policy_version 554114 (0.0011) [2023-12-26 04:02:31,787][123091] Updated weights for policy 0, policy_version 558255 (0.0008) [2023-12-26 04:02:31,850][123090] Updated weights for policy 1, policy_version 554124 (0.0011) [2023-12-26 04:02:31,914][123090] Updated weights for policy 1, policy_version 554134 (0.0010) [2023-12-26 04:02:31,982][123090] Updated weights for policy 1, policy_version 554144 (0.0011) [2023-12-26 04:02:32,635][123091] Updated weights for policy 0, policy_version 558265 (0.0009) [2023-12-26 04:02:32,705][123091] Updated weights for policy 0, policy_version 558275 (0.0009) [2023-12-26 04:02:32,768][123091] Updated weights for policy 0, policy_version 558285 (0.0008) [2023-12-26 04:02:32,800][123090] Updated weights for policy 1, policy_version 554154 (0.0010) [2023-12-26 04:02:32,851][123090] Updated weights for policy 1, policy_version 554164 (0.0010) [2023-12-26 04:02:32,899][123090] Updated weights for policy 1, policy_version 554174 (0.0010) [2023-12-26 04:02:33,607][123091] Updated weights for policy 0, policy_version 558295 (0.0008) [2023-12-26 04:02:33,661][123091] Updated weights for policy 0, policy_version 558305 (0.0009) [2023-12-26 04:02:33,717][123091] Updated weights for policy 0, policy_version 558315 (0.0009) [2023-12-26 04:02:33,767][123090] Updated weights for policy 1, policy_version 554184 (0.0010) [2023-12-26 04:02:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 284803072. Throughput: 0: 8957.1, 1: 8940.6. Samples: 284813572. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:33,785][121949] Avg episode reward: [(0, '6178.500'), (1, '5381.692')] [2023-12-26 04:02:33,834][123090] Updated weights for policy 1, policy_version 554194 (0.0011) [2023-12-26 04:02:33,886][123090] Updated weights for policy 1, policy_version 554204 (0.0010) [2023-12-26 04:02:34,578][123091] Updated weights for policy 0, policy_version 558325 (0.0008) [2023-12-26 04:02:34,640][123091] Updated weights for policy 0, policy_version 558335 (0.0009) [2023-12-26 04:02:34,701][123091] Updated weights for policy 0, policy_version 558345 (0.0009) [2023-12-26 04:02:34,720][123090] Updated weights for policy 1, policy_version 554214 (0.0011) [2023-12-26 04:02:34,788][123090] Updated weights for policy 1, policy_version 554224 (0.0010) [2023-12-26 04:02:34,855][123090] Updated weights for policy 1, policy_version 554234 (0.0011) [2023-12-26 04:02:35,547][123091] Updated weights for policy 0, policy_version 558355 (0.0009) [2023-12-26 04:02:35,609][123091] Updated weights for policy 0, policy_version 558365 (0.0010) [2023-12-26 04:02:35,685][123090] Updated weights for policy 1, policy_version 554244 (0.0010) [2023-12-26 04:02:35,686][123091] Updated weights for policy 0, policy_version 558375 (0.0006) [2023-12-26 04:02:35,752][123090] Updated weights for policy 1, policy_version 554254 (0.0011) [2023-12-26 04:02:35,810][123090] Updated weights for policy 1, policy_version 554264 (0.0010) [2023-12-26 04:02:36,337][123091] Updated weights for policy 0, policy_version 558385 (0.0006) [2023-12-26 04:02:36,416][123091] Updated weights for policy 0, policy_version 558395 (0.0005) [2023-12-26 04:02:36,491][123091] Updated weights for policy 0, policy_version 558405 (0.0009) [2023-12-26 04:02:36,548][123091] Updated weights for policy 0, policy_version 558415 (0.0011) [2023-12-26 04:02:36,569][123090] Updated weights for policy 1, policy_version 554274 (0.0009) [2023-12-26 04:02:36,634][123090] Updated weights for policy 1, policy_version 554284 (0.0011) [2023-12-26 04:02:36,703][123090] Updated weights for policy 1, policy_version 554294 (0.0011) [2023-12-26 04:02:36,770][123090] Updated weights for policy 1, policy_version 554304 (0.0011) [2023-12-26 04:02:37,294][123091] Updated weights for policy 0, policy_version 558425 (0.0009) [2023-12-26 04:02:37,356][123091] Updated weights for policy 0, policy_version 558435 (0.0005) [2023-12-26 04:02:37,428][123091] Updated weights for policy 0, policy_version 558445 (0.0005) [2023-12-26 04:02:37,511][123090] Updated weights for policy 1, policy_version 554314 (0.0011) [2023-12-26 04:02:37,574][123090] Updated weights for policy 1, policy_version 554324 (0.0010) [2023-12-26 04:02:37,625][123090] Updated weights for policy 1, policy_version 554334 (0.0010) [2023-12-26 04:02:38,188][123091] Updated weights for policy 0, policy_version 558455 (0.0010) [2023-12-26 04:02:38,239][123091] Updated weights for policy 0, policy_version 558465 (0.0010) [2023-12-26 04:02:38,297][123091] Updated weights for policy 0, policy_version 558475 (0.0010) [2023-12-26 04:02:38,413][123090] Updated weights for policy 1, policy_version 554344 (0.0010) [2023-12-26 04:02:38,473][123090] Updated weights for policy 1, policy_version 554354 (0.0010) [2023-12-26 04:02:38,528][123090] Updated weights for policy 1, policy_version 554364 (0.0010) [2023-12-26 04:02:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 284893184. Throughput: 0: 8930.1, 1: 8941.0. Samples: 284866264. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:38,785][121949] Avg episode reward: [(0, '6160.286'), (1, '5268.046')] [2023-12-26 04:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000558480_142974976.pth... [2023-12-26 04:02:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000554368_141918208.pth... [2023-12-26 04:02:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000557456_142712832.pth [2023-12-26 04:02:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000553312_141647872.pth [2023-12-26 04:02:39,055][123091] Updated weights for policy 0, policy_version 558485 (0.0006) [2023-12-26 04:02:39,102][123091] Updated weights for policy 0, policy_version 558495 (0.0005) [2023-12-26 04:02:39,151][123091] Updated weights for policy 0, policy_version 558505 (0.0005) [2023-12-26 04:02:39,461][123090] Updated weights for policy 1, policy_version 554374 (0.0009) [2023-12-26 04:02:39,521][123090] Updated weights for policy 1, policy_version 554384 (0.0008) [2023-12-26 04:02:39,586][123090] Updated weights for policy 1, policy_version 554394 (0.0009) [2023-12-26 04:02:40,012][123091] Updated weights for policy 0, policy_version 558515 (0.0007) [2023-12-26 04:02:40,083][123091] Updated weights for policy 0, policy_version 558525 (0.0011) [2023-12-26 04:02:40,151][123091] Updated weights for policy 0, policy_version 558535 (0.0011) [2023-12-26 04:02:40,430][123090] Updated weights for policy 1, policy_version 554404 (0.0009) [2023-12-26 04:02:40,480][123090] Updated weights for policy 1, policy_version 554414 (0.0009) [2023-12-26 04:02:40,537][123090] Updated weights for policy 1, policy_version 554424 (0.0009) [2023-12-26 04:02:40,967][123091] Updated weights for policy 0, policy_version 558545 (0.0010) [2023-12-26 04:02:41,034][123091] Updated weights for policy 0, policy_version 558555 (0.0010) [2023-12-26 04:02:41,095][123091] Updated weights for policy 0, policy_version 558565 (0.0007) [2023-12-26 04:02:41,167][123091] Updated weights for policy 0, policy_version 558575 (0.0008) [2023-12-26 04:02:41,425][123090] Updated weights for policy 1, policy_version 554434 (0.0009) [2023-12-26 04:02:41,486][123090] Updated weights for policy 1, policy_version 554444 (0.0010) [2023-12-26 04:02:41,539][123090] Updated weights for policy 1, policy_version 554454 (0.0009) [2023-12-26 04:02:41,599][123090] Updated weights for policy 1, policy_version 554464 (0.0009) [2023-12-26 04:02:41,980][123091] Updated weights for policy 0, policy_version 558585 (0.0009) [2023-12-26 04:02:42,048][123091] Updated weights for policy 0, policy_version 558595 (0.0010) [2023-12-26 04:02:42,099][123091] Updated weights for policy 0, policy_version 558605 (0.0009) [2023-12-26 04:02:42,424][123090] Updated weights for policy 1, policy_version 554474 (0.0007) [2023-12-26 04:02:42,484][123090] Updated weights for policy 1, policy_version 554484 (0.0006) [2023-12-26 04:02:42,555][123090] Updated weights for policy 1, policy_version 554494 (0.0006) [2023-12-26 04:02:43,026][123091] Updated weights for policy 0, policy_version 558615 (0.0009) [2023-12-26 04:02:43,091][123091] Updated weights for policy 0, policy_version 558625 (0.0010) [2023-12-26 04:02:43,156][123091] Updated weights for policy 0, policy_version 558635 (0.0009) [2023-12-26 04:02:43,200][123090] Updated weights for policy 1, policy_version 554504 (0.0006) [2023-12-26 04:02:43,249][123090] Updated weights for policy 1, policy_version 554514 (0.0005) [2023-12-26 04:02:43,306][123090] Updated weights for policy 1, policy_version 554525 (0.0006) [2023-12-26 04:02:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 284975104. Throughput: 0: 8832.0, 1: 8858.8. Samples: 284970312. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:43,785][121949] Avg episode reward: [(0, '6131.314'), (1, '5220.562')] [2023-12-26 04:02:43,899][123091] Updated weights for policy 0, policy_version 558645 (0.0007) [2023-12-26 04:02:43,955][123091] Updated weights for policy 0, policy_version 558655 (0.0006) [2023-12-26 04:02:44,012][123091] Updated weights for policy 0, policy_version 558665 (0.0006) [2023-12-26 04:02:44,067][123090] Updated weights for policy 1, policy_version 554535 (0.0009) [2023-12-26 04:02:44,126][123090] Updated weights for policy 1, policy_version 554545 (0.0007) [2023-12-26 04:02:44,173][123090] Updated weights for policy 1, policy_version 554555 (0.0008) [2023-12-26 04:02:44,752][123091] Updated weights for policy 0, policy_version 558675 (0.0007) [2023-12-26 04:02:44,824][123091] Updated weights for policy 0, policy_version 558685 (0.0008) [2023-12-26 04:02:44,891][123091] Updated weights for policy 0, policy_version 558695 (0.0008) [2023-12-26 04:02:44,984][123090] Updated weights for policy 1, policy_version 554565 (0.0009) [2023-12-26 04:02:45,048][123090] Updated weights for policy 1, policy_version 554575 (0.0010) [2023-12-26 04:02:45,117][123090] Updated weights for policy 1, policy_version 554585 (0.0009) [2023-12-26 04:02:45,609][123091] Updated weights for policy 0, policy_version 558705 (0.0008) [2023-12-26 04:02:45,667][123091] Updated weights for policy 0, policy_version 558715 (0.0009) [2023-12-26 04:02:45,735][123091] Updated weights for policy 0, policy_version 558725 (0.0009) [2023-12-26 04:02:45,793][123091] Updated weights for policy 0, policy_version 558735 (0.0008) [2023-12-26 04:02:45,901][123090] Updated weights for policy 1, policy_version 554595 (0.0008) [2023-12-26 04:02:45,966][123090] Updated weights for policy 1, policy_version 554605 (0.0008) [2023-12-26 04:02:46,028][123090] Updated weights for policy 1, policy_version 554615 (0.0009) [2023-12-26 04:02:46,639][123091] Updated weights for policy 0, policy_version 558745 (0.0009) [2023-12-26 04:02:46,706][123091] Updated weights for policy 0, policy_version 558755 (0.0009) [2023-12-26 04:02:46,762][123091] Updated weights for policy 0, policy_version 558765 (0.0009) [2023-12-26 04:02:46,799][123090] Updated weights for policy 1, policy_version 554625 (0.0009) [2023-12-26 04:02:46,853][123090] Updated weights for policy 1, policy_version 554635 (0.0010) [2023-12-26 04:02:46,915][123090] Updated weights for policy 1, policy_version 554645 (0.0010) [2023-12-26 04:02:46,969][123090] Updated weights for policy 1, policy_version 554656 (0.0010) [2023-12-26 04:02:47,426][123091] Updated weights for policy 0, policy_version 558775 (0.0006) [2023-12-26 04:02:47,482][123091] Updated weights for policy 0, policy_version 558785 (0.0005) [2023-12-26 04:02:47,538][123091] Updated weights for policy 0, policy_version 558795 (0.0005) [2023-12-26 04:02:47,932][123090] Updated weights for policy 1, policy_version 554666 (0.0006) [2023-12-26 04:02:47,988][123090] Updated weights for policy 1, policy_version 554676 (0.0006) [2023-12-26 04:02:48,044][123090] Updated weights for policy 1, policy_version 554686 (0.0005) [2023-12-26 04:02:48,186][123091] Updated weights for policy 0, policy_version 558805 (0.0008) [2023-12-26 04:02:48,244][123091] Updated weights for policy 0, policy_version 558815 (0.0010) [2023-12-26 04:02:48,294][123091] Updated weights for policy 0, policy_version 558825 (0.0010) [2023-12-26 04:02:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 285065216. Throughput: 0: 8934.1, 1: 8880.5. Samples: 285078992. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:48,785][121949] Avg episode reward: [(0, '6162.080'), (1, '5427.746')] [2023-12-26 04:02:48,869][123090] Updated weights for policy 1, policy_version 554696 (0.0005) [2023-12-26 04:02:48,932][123090] Updated weights for policy 1, policy_version 554706 (0.0005) [2023-12-26 04:02:48,998][123091] Updated weights for policy 0, policy_version 558835 (0.0011) [2023-12-26 04:02:49,000][123090] Updated weights for policy 1, policy_version 554716 (0.0006) [2023-12-26 04:02:49,053][123091] Updated weights for policy 0, policy_version 558845 (0.0010) [2023-12-26 04:02:49,116][123091] Updated weights for policy 0, policy_version 558855 (0.0011) [2023-12-26 04:02:49,738][123090] Updated weights for policy 1, policy_version 554726 (0.0006) [2023-12-26 04:02:49,806][123090] Updated weights for policy 1, policy_version 554736 (0.0006) [2023-12-26 04:02:49,870][123090] Updated weights for policy 1, policy_version 554746 (0.0008) [2023-12-26 04:02:49,901][123091] Updated weights for policy 0, policy_version 558865 (0.0007) [2023-12-26 04:02:49,971][123091] Updated weights for policy 0, policy_version 558875 (0.0007) [2023-12-26 04:02:50,047][123091] Updated weights for policy 0, policy_version 558885 (0.0006) [2023-12-26 04:02:50,102][123091] Updated weights for policy 0, policy_version 558895 (0.0010) [2023-12-26 04:02:50,597][123090] Updated weights for policy 1, policy_version 554756 (0.0007) [2023-12-26 04:02:50,664][123090] Updated weights for policy 1, policy_version 554766 (0.0010) [2023-12-26 04:02:50,730][123090] Updated weights for policy 1, policy_version 554776 (0.0009) [2023-12-26 04:02:50,858][123091] Updated weights for policy 0, policy_version 558905 (0.0006) [2023-12-26 04:02:50,927][123091] Updated weights for policy 0, policy_version 558915 (0.0006) [2023-12-26 04:02:50,996][123091] Updated weights for policy 0, policy_version 558925 (0.0007) [2023-12-26 04:02:51,616][123090] Updated weights for policy 1, policy_version 554786 (0.0008) [2023-12-26 04:02:51,684][123090] Updated weights for policy 1, policy_version 554796 (0.0006) [2023-12-26 04:02:51,712][123091] Updated weights for policy 0, policy_version 558935 (0.0009) [2023-12-26 04:02:51,763][123090] Updated weights for policy 1, policy_version 554806 (0.0008) [2023-12-26 04:02:51,772][123091] Updated weights for policy 0, policy_version 558945 (0.0011) [2023-12-26 04:02:51,816][123091] Updated weights for policy 0, policy_version 558955 (0.0010) [2023-12-26 04:02:51,827][123090] Updated weights for policy 1, policy_version 554816 (0.0007) [2023-12-26 04:02:52,549][123090] Updated weights for policy 1, policy_version 554826 (0.0005) [2023-12-26 04:02:52,620][123090] Updated weights for policy 1, policy_version 554836 (0.0005) [2023-12-26 04:02:52,648][123091] Updated weights for policy 0, policy_version 558965 (0.0011) [2023-12-26 04:02:52,687][123090] Updated weights for policy 1, policy_version 554846 (0.0009) [2023-12-26 04:02:52,712][123091] Updated weights for policy 0, policy_version 558975 (0.0011) [2023-12-26 04:02:52,779][123091] Updated weights for policy 0, policy_version 558985 (0.0011) [2023-12-26 04:02:53,446][123090] Updated weights for policy 1, policy_version 554856 (0.0006) [2023-12-26 04:02:53,475][123091] Updated weights for policy 0, policy_version 558995 (0.0009) [2023-12-26 04:02:53,499][123090] Updated weights for policy 1, policy_version 554866 (0.0005) [2023-12-26 04:02:53,535][123091] Updated weights for policy 0, policy_version 559005 (0.0009) [2023-12-26 04:02:53,557][123090] Updated weights for policy 1, policy_version 554876 (0.0005) [2023-12-26 04:02:53,590][123091] Updated weights for policy 0, policy_version 559015 (0.0010) [2023-12-26 04:02:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17689.1). Total num frames: 285163520. Throughput: 0: 8985.4, 1: 8859.7. Samples: 285132820. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:53,785][121949] Avg episode reward: [(0, '6110.244'), (1, '5655.192')] [2023-12-26 04:02:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000554880_142049280.pth... [2023-12-26 04:02:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000559024_143114240.pth... [2023-12-26 04:02:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000553824_141778944.pth [2023-12-26 04:02:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000557968_142843904.pth [2023-12-26 04:02:54,218][123090] Updated weights for policy 1, policy_version 554886 (0.0008) [2023-12-26 04:02:54,277][123090] Updated weights for policy 1, policy_version 554896 (0.0010) [2023-12-26 04:02:54,340][123090] Updated weights for policy 1, policy_version 554906 (0.0010) [2023-12-26 04:02:54,375][123091] Updated weights for policy 0, policy_version 559025 (0.0010) [2023-12-26 04:02:54,423][123091] Updated weights for policy 0, policy_version 559035 (0.0005) [2023-12-26 04:02:54,476][123091] Updated weights for policy 0, policy_version 559045 (0.0005) [2023-12-26 04:02:54,535][123091] Updated weights for policy 0, policy_version 559055 (0.0009) [2023-12-26 04:02:55,092][123090] Updated weights for policy 1, policy_version 554916 (0.0009) [2023-12-26 04:02:55,150][123090] Updated weights for policy 1, policy_version 554926 (0.0007) [2023-12-26 04:02:55,209][123090] Updated weights for policy 1, policy_version 554936 (0.0006) [2023-12-26 04:02:55,360][123091] Updated weights for policy 0, policy_version 559065 (0.0011) [2023-12-26 04:02:55,414][123091] Updated weights for policy 0, policy_version 559075 (0.0010) [2023-12-26 04:02:55,462][123091] Updated weights for policy 0, policy_version 559085 (0.0010) [2023-12-26 04:02:55,839][123090] Updated weights for policy 1, policy_version 554946 (0.0005) [2023-12-26 04:02:55,892][123090] Updated weights for policy 1, policy_version 554956 (0.0006) [2023-12-26 04:02:55,954][123090] Updated weights for policy 1, policy_version 554966 (0.0006) [2023-12-26 04:02:56,009][123090] Updated weights for policy 1, policy_version 554976 (0.0006) [2023-12-26 04:02:56,290][123091] Updated weights for policy 0, policy_version 559095 (0.0010) [2023-12-26 04:02:56,351][123091] Updated weights for policy 0, policy_version 559105 (0.0006) [2023-12-26 04:02:56,420][123091] Updated weights for policy 0, policy_version 559115 (0.0007) [2023-12-26 04:02:56,712][123090] Updated weights for policy 1, policy_version 554986 (0.0005) [2023-12-26 04:02:56,776][123090] Updated weights for policy 1, policy_version 554996 (0.0005) [2023-12-26 04:02:56,832][123090] Updated weights for policy 1, policy_version 555006 (0.0005) [2023-12-26 04:02:57,078][123091] Updated weights for policy 0, policy_version 559125 (0.0005) [2023-12-26 04:02:57,123][123091] Updated weights for policy 0, policy_version 559135 (0.0005) [2023-12-26 04:02:57,170][123091] Updated weights for policy 0, policy_version 559145 (0.0005) [2023-12-26 04:02:57,481][123090] Updated weights for policy 1, policy_version 555016 (0.0007) [2023-12-26 04:02:57,536][123090] Updated weights for policy 1, policy_version 555026 (0.0009) [2023-12-26 04:02:57,593][123090] Updated weights for policy 1, policy_version 555037 (0.0010) [2023-12-26 04:02:57,889][123091] Updated weights for policy 0, policy_version 559155 (0.0005) [2023-12-26 04:02:57,949][123091] Updated weights for policy 0, policy_version 559165 (0.0005) [2023-12-26 04:02:58,018][123091] Updated weights for policy 0, policy_version 559175 (0.0007) [2023-12-26 04:02:58,394][123090] Updated weights for policy 1, policy_version 555047 (0.0008) [2023-12-26 04:02:58,445][123090] Updated weights for policy 1, policy_version 555057 (0.0008) [2023-12-26 04:02:58,515][123090] Updated weights for policy 1, policy_version 555067 (0.0008) [2023-12-26 04:02:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 285253632. Throughput: 0: 9014.4, 1: 8991.0. Samples: 285247412. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:02:58,785][121949] Avg episode reward: [(0, '6155.866'), (1, '5469.261')] [2023-12-26 04:02:58,830][123091] Updated weights for policy 0, policy_version 559185 (0.0008) [2023-12-26 04:02:58,888][123091] Updated weights for policy 0, policy_version 559195 (0.0009) [2023-12-26 04:02:58,952][123091] Updated weights for policy 0, policy_version 559205 (0.0008) [2023-12-26 04:02:59,024][123091] Updated weights for policy 0, policy_version 559215 (0.0009) [2023-12-26 04:02:59,414][123090] Updated weights for policy 1, policy_version 555077 (0.0007) [2023-12-26 04:02:59,484][123090] Updated weights for policy 1, policy_version 555087 (0.0007) [2023-12-26 04:02:59,541][123090] Updated weights for policy 1, policy_version 555097 (0.0006) [2023-12-26 04:02:59,883][123091] Updated weights for policy 0, policy_version 559225 (0.0009) [2023-12-26 04:02:59,945][123091] Updated weights for policy 0, policy_version 559235 (0.0010) [2023-12-26 04:03:00,002][123091] Updated weights for policy 0, policy_version 559245 (0.0010) [2023-12-26 04:03:00,245][123090] Updated weights for policy 1, policy_version 555107 (0.0005) [2023-12-26 04:03:00,314][123090] Updated weights for policy 1, policy_version 555117 (0.0010) [2023-12-26 04:03:00,377][123090] Updated weights for policy 1, policy_version 555127 (0.0010) [2023-12-26 04:03:00,785][123091] Updated weights for policy 0, policy_version 559255 (0.0007) [2023-12-26 04:03:00,841][123091] Updated weights for policy 0, policy_version 559265 (0.0009) [2023-12-26 04:03:00,909][123091] Updated weights for policy 0, policy_version 559275 (0.0009) [2023-12-26 04:03:01,203][123090] Updated weights for policy 1, policy_version 555137 (0.0010) [2023-12-26 04:03:01,272][123090] Updated weights for policy 1, policy_version 555147 (0.0009) [2023-12-26 04:03:01,341][123090] Updated weights for policy 1, policy_version 555157 (0.0009) [2023-12-26 04:03:01,413][123090] Updated weights for policy 1, policy_version 555167 (0.0008) [2023-12-26 04:03:01,821][123091] Updated weights for policy 0, policy_version 559285 (0.0010) [2023-12-26 04:03:01,873][123091] Updated weights for policy 0, policy_version 559295 (0.0011) [2023-12-26 04:03:01,936][123091] Updated weights for policy 0, policy_version 559305 (0.0011) [2023-12-26 04:03:02,250][123090] Updated weights for policy 1, policy_version 555177 (0.0007) [2023-12-26 04:03:02,319][123090] Updated weights for policy 1, policy_version 555187 (0.0009) [2023-12-26 04:03:02,389][123090] Updated weights for policy 1, policy_version 555197 (0.0008) [2023-12-26 04:03:02,782][123091] Updated weights for policy 0, policy_version 559315 (0.0011) [2023-12-26 04:03:02,841][123091] Updated weights for policy 0, policy_version 559325 (0.0011) [2023-12-26 04:03:02,893][123091] Updated weights for policy 0, policy_version 559335 (0.0011) [2023-12-26 04:03:03,214][123090] Updated weights for policy 1, policy_version 555207 (0.0010) [2023-12-26 04:03:03,282][123090] Updated weights for policy 1, policy_version 555217 (0.0009) [2023-12-26 04:03:03,345][123090] Updated weights for policy 1, policy_version 555227 (0.0010) [2023-12-26 04:03:03,710][123091] Updated weights for policy 0, policy_version 559345 (0.0011) [2023-12-26 04:03:03,765][123091] Updated weights for policy 0, policy_version 559355 (0.0011) [2023-12-26 04:03:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 285335552. Throughput: 0: 8881.7, 1: 9015.3. Samples: 285350000. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:03,785][121949] Avg episode reward: [(0, '6215.569'), (1, '5146.940')] [2023-12-26 04:03:03,835][123091] Updated weights for policy 0, policy_version 559365 (0.0011) [2023-12-26 04:03:03,902][123091] Updated weights for policy 0, policy_version 559375 (0.0011) [2023-12-26 04:03:04,211][123090] Updated weights for policy 1, policy_version 555237 (0.0009) [2023-12-26 04:03:04,272][123090] Updated weights for policy 1, policy_version 555247 (0.0009) [2023-12-26 04:03:04,343][123090] Updated weights for policy 1, policy_version 555257 (0.0009) [2023-12-26 04:03:04,728][123091] Updated weights for policy 0, policy_version 559385 (0.0011) [2023-12-26 04:03:04,796][123091] Updated weights for policy 0, policy_version 559395 (0.0011) [2023-12-26 04:03:04,856][123091] Updated weights for policy 0, policy_version 559405 (0.0011) [2023-12-26 04:03:05,200][123090] Updated weights for policy 1, policy_version 555267 (0.0009) [2023-12-26 04:03:05,255][123090] Updated weights for policy 1, policy_version 555277 (0.0010) [2023-12-26 04:03:05,308][123090] Updated weights for policy 1, policy_version 555287 (0.0009) [2023-12-26 04:03:05,558][123091] Updated weights for policy 0, policy_version 559415 (0.0010) [2023-12-26 04:03:05,628][123091] Updated weights for policy 0, policy_version 559425 (0.0008) [2023-12-26 04:03:05,689][123091] Updated weights for policy 0, policy_version 559435 (0.0006) [2023-12-26 04:03:06,259][123090] Updated weights for policy 1, policy_version 555297 (0.0010) [2023-12-26 04:03:06,320][123090] Updated weights for policy 1, policy_version 555307 (0.0010) [2023-12-26 04:03:06,381][123090] Updated weights for policy 1, policy_version 555317 (0.0009) [2023-12-26 04:03:06,434][123091] Updated weights for policy 0, policy_version 559445 (0.0008) [2023-12-26 04:03:06,455][123090] Updated weights for policy 1, policy_version 555327 (0.0007) [2023-12-26 04:03:06,495][123091] Updated weights for policy 0, policy_version 559455 (0.0010) [2023-12-26 04:03:06,558][123091] Updated weights for policy 0, policy_version 559465 (0.0010) [2023-12-26 04:03:07,236][123090] Updated weights for policy 1, policy_version 555337 (0.0010) [2023-12-26 04:03:07,302][123090] Updated weights for policy 1, policy_version 555347 (0.0010) [2023-12-26 04:03:07,359][123090] Updated weights for policy 1, policy_version 555357 (0.0009) [2023-12-26 04:03:07,398][123091] Updated weights for policy 0, policy_version 559475 (0.0009) [2023-12-26 04:03:07,450][123091] Updated weights for policy 0, policy_version 559485 (0.0009) [2023-12-26 04:03:07,506][123091] Updated weights for policy 0, policy_version 559495 (0.0010) [2023-12-26 04:03:08,206][123090] Updated weights for policy 1, policy_version 555367 (0.0009) [2023-12-26 04:03:08,258][123090] Updated weights for policy 1, policy_version 555377 (0.0009) [2023-12-26 04:03:08,312][123090] Updated weights for policy 1, policy_version 555387 (0.0009) [2023-12-26 04:03:08,324][123091] Updated weights for policy 0, policy_version 559505 (0.0009) [2023-12-26 04:03:08,389][123091] Updated weights for policy 0, policy_version 559515 (0.0009) [2023-12-26 04:03:08,446][123091] Updated weights for policy 0, policy_version 559525 (0.0010) [2023-12-26 04:03:08,498][123091] Updated weights for policy 0, policy_version 559535 (0.0009) [2023-12-26 04:03:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 285425664. Throughput: 0: 8910.2, 1: 8982.2. Samples: 285400476. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:08,785][121949] Avg episode reward: [(0, '6188.739'), (1, '5217.988')] [2023-12-26 04:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000559536_143245312.pth... [2023-12-26 04:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000555392_142180352.pth... [2023-12-26 04:03:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000558480_142974976.pth [2023-12-26 04:03:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000554368_141918208.pth [2023-12-26 04:03:09,145][123090] Updated weights for policy 1, policy_version 555397 (0.0009) [2023-12-26 04:03:09,200][123090] Updated weights for policy 1, policy_version 555408 (0.0010) [2023-12-26 04:03:09,264][123090] Updated weights for policy 1, policy_version 555419 (0.0010) [2023-12-26 04:03:09,344][123091] Updated weights for policy 0, policy_version 559545 (0.0010) [2023-12-26 04:03:09,418][123091] Updated weights for policy 0, policy_version 559555 (0.0010) [2023-12-26 04:03:09,479][123091] Updated weights for policy 0, policy_version 559565 (0.0010) [2023-12-26 04:03:10,180][123090] Updated weights for policy 1, policy_version 555429 (0.0009) [2023-12-26 04:03:10,235][123090] Updated weights for policy 1, policy_version 555439 (0.0010) [2023-12-26 04:03:10,293][123090] Updated weights for policy 1, policy_version 555449 (0.0008) [2023-12-26 04:03:10,308][123091] Updated weights for policy 0, policy_version 559575 (0.0010) [2023-12-26 04:03:10,361][123091] Updated weights for policy 0, policy_version 559585 (0.0009) [2023-12-26 04:03:10,423][123091] Updated weights for policy 0, policy_version 559595 (0.0010) [2023-12-26 04:03:11,076][123090] Updated weights for policy 1, policy_version 555459 (0.0008) [2023-12-26 04:03:11,141][123090] Updated weights for policy 1, policy_version 555469 (0.0010) [2023-12-26 04:03:11,200][123090] Updated weights for policy 1, policy_version 555479 (0.0010) [2023-12-26 04:03:11,262][123091] Updated weights for policy 0, policy_version 559605 (0.0008) [2023-12-26 04:03:11,329][123091] Updated weights for policy 0, policy_version 559615 (0.0010) [2023-12-26 04:03:11,399][123091] Updated weights for policy 0, policy_version 559625 (0.0009) [2023-12-26 04:03:12,026][123090] Updated weights for policy 1, policy_version 555489 (0.0010) [2023-12-26 04:03:12,084][123090] Updated weights for policy 1, policy_version 555499 (0.0010) [2023-12-26 04:03:12,140][123090] Updated weights for policy 1, policy_version 555509 (0.0009) [2023-12-26 04:03:12,203][123090] Updated weights for policy 1, policy_version 555519 (0.0010) [2023-12-26 04:03:12,289][123091] Updated weights for policy 0, policy_version 559635 (0.0009) [2023-12-26 04:03:12,361][123091] Updated weights for policy 0, policy_version 559645 (0.0009) [2023-12-26 04:03:12,421][123091] Updated weights for policy 0, policy_version 559655 (0.0008) [2023-12-26 04:03:13,038][123090] Updated weights for policy 1, policy_version 555529 (0.0009) [2023-12-26 04:03:13,104][123090] Updated weights for policy 1, policy_version 555539 (0.0008) [2023-12-26 04:03:13,167][123090] Updated weights for policy 1, policy_version 555549 (0.0009) [2023-12-26 04:03:13,228][123091] Updated weights for policy 0, policy_version 559665 (0.0009) [2023-12-26 04:03:13,282][123091] Updated weights for policy 0, policy_version 559675 (0.0008) [2023-12-26 04:03:13,330][123091] Updated weights for policy 0, policy_version 559685 (0.0010) [2023-12-26 04:03:13,374][123091] Updated weights for policy 0, policy_version 559695 (0.0010) [2023-12-26 04:03:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 285507584. Throughput: 0: 8866.0, 1: 8814.0. Samples: 285501540. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:13,785][121949] Avg episode reward: [(0, '6176.212'), (1, '5438.387')] [2023-12-26 04:03:13,880][123090] Updated weights for policy 1, policy_version 555559 (0.0006) [2023-12-26 04:03:13,932][123090] Updated weights for policy 1, policy_version 555569 (0.0005) [2023-12-26 04:03:13,979][123090] Updated weights for policy 1, policy_version 555579 (0.0005) [2023-12-26 04:03:14,169][123091] Updated weights for policy 0, policy_version 559705 (0.0010) [2023-12-26 04:03:14,228][123091] Updated weights for policy 0, policy_version 559715 (0.0011) [2023-12-26 04:03:14,291][123091] Updated weights for policy 0, policy_version 559725 (0.0010) [2023-12-26 04:03:14,727][123090] Updated weights for policy 1, policy_version 555589 (0.0008) [2023-12-26 04:03:14,789][123090] Updated weights for policy 1, policy_version 555600 (0.0009) [2023-12-26 04:03:14,851][123090] Updated weights for policy 1, policy_version 555610 (0.0009) [2023-12-26 04:03:15,009][123091] Updated weights for policy 0, policy_version 559735 (0.0006) [2023-12-26 04:03:15,064][123091] Updated weights for policy 0, policy_version 559745 (0.0008) [2023-12-26 04:03:15,121][123091] Updated weights for policy 0, policy_version 559755 (0.0011) [2023-12-26 04:03:15,682][123090] Updated weights for policy 1, policy_version 555620 (0.0009) [2023-12-26 04:03:15,728][123090] Updated weights for policy 1, policy_version 555630 (0.0008) [2023-12-26 04:03:15,778][123090] Updated weights for policy 1, policy_version 555640 (0.0005) [2023-12-26 04:03:15,877][123091] Updated weights for policy 0, policy_version 559765 (0.0011) [2023-12-26 04:03:15,925][123091] Updated weights for policy 0, policy_version 559775 (0.0011) [2023-12-26 04:03:15,980][123091] Updated weights for policy 0, policy_version 559785 (0.0011) [2023-12-26 04:03:16,638][123090] Updated weights for policy 1, policy_version 555650 (0.0007) [2023-12-26 04:03:16,697][123090] Updated weights for policy 1, policy_version 555660 (0.0009) [2023-12-26 04:03:16,701][123091] Updated weights for policy 0, policy_version 559795 (0.0009) [2023-12-26 04:03:16,755][123091] Updated weights for policy 0, policy_version 559805 (0.0006) [2023-12-26 04:03:16,759][123090] Updated weights for policy 1, policy_version 555670 (0.0009) [2023-12-26 04:03:16,801][123091] Updated weights for policy 0, policy_version 559815 (0.0005) [2023-12-26 04:03:16,820][123090] Updated weights for policy 1, policy_version 555680 (0.0008) [2023-12-26 04:03:17,542][123091] Updated weights for policy 0, policy_version 559825 (0.0007) [2023-12-26 04:03:17,593][123091] Updated weights for policy 0, policy_version 559835 (0.0009) [2023-12-26 04:03:17,652][123091] Updated weights for policy 0, policy_version 559845 (0.0010) [2023-12-26 04:03:17,712][123091] Updated weights for policy 0, policy_version 559855 (0.0011) [2023-12-26 04:03:17,727][123090] Updated weights for policy 1, policy_version 555690 (0.0006) [2023-12-26 04:03:17,787][123090] Updated weights for policy 1, policy_version 555700 (0.0009) [2023-12-26 04:03:17,838][123090] Updated weights for policy 1, policy_version 555710 (0.0009) [2023-12-26 04:03:18,339][123091] Updated weights for policy 0, policy_version 559865 (0.0006) [2023-12-26 04:03:18,409][123091] Updated weights for policy 0, policy_version 559875 (0.0008) [2023-12-26 04:03:18,476][123091] Updated weights for policy 0, policy_version 559885 (0.0011) [2023-12-26 04:03:18,754][123090] Updated weights for policy 1, policy_version 555720 (0.0009) [2023-12-26 04:03:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 285597696. Throughput: 0: 8995.3, 1: 8755.2. Samples: 285612344. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:18,784][121949] Avg episode reward: [(0, '6120.669'), (1, '5756.728')] [2023-12-26 04:03:18,816][123090] Updated weights for policy 1, policy_version 555730 (0.0009) [2023-12-26 04:03:18,881][123090] Updated weights for policy 1, policy_version 555740 (0.0009) [2023-12-26 04:03:19,251][123091] Updated weights for policy 0, policy_version 559895 (0.0009) [2023-12-26 04:03:19,314][123091] Updated weights for policy 0, policy_version 559905 (0.0010) [2023-12-26 04:03:19,378][123091] Updated weights for policy 0, policy_version 559915 (0.0009) [2023-12-26 04:03:19,694][123090] Updated weights for policy 1, policy_version 555750 (0.0007) [2023-12-26 04:03:19,755][123090] Updated weights for policy 1, policy_version 555760 (0.0006) [2023-12-26 04:03:19,821][123090] Updated weights for policy 1, policy_version 555770 (0.0006) [2023-12-26 04:03:20,128][123091] Updated weights for policy 0, policy_version 559925 (0.0008) [2023-12-26 04:03:20,192][123091] Updated weights for policy 0, policy_version 559935 (0.0011) [2023-12-26 04:03:20,259][123091] Updated weights for policy 0, policy_version 559945 (0.0011) [2023-12-26 04:03:20,641][123090] Updated weights for policy 1, policy_version 555780 (0.0009) [2023-12-26 04:03:20,733][123090] Updated weights for policy 1, policy_version 555790 (0.0010) [2023-12-26 04:03:20,807][123090] Updated weights for policy 1, policy_version 555800 (0.0010) [2023-12-26 04:03:20,887][123091] Updated weights for policy 0, policy_version 559955 (0.0006) [2023-12-26 04:03:20,966][123091] Updated weights for policy 0, policy_version 559965 (0.0006) [2023-12-26 04:03:21,043][123091] Updated weights for policy 0, policy_version 559975 (0.0007) [2023-12-26 04:03:21,731][123090] Updated weights for policy 1, policy_version 555810 (0.0010) [2023-12-26 04:03:21,753][123091] Updated weights for policy 0, policy_version 559985 (0.0007) [2023-12-26 04:03:21,804][123090] Updated weights for policy 1, policy_version 555820 (0.0009) [2023-12-26 04:03:21,820][123091] Updated weights for policy 0, policy_version 559995 (0.0008) [2023-12-26 04:03:21,868][123090] Updated weights for policy 1, policy_version 555830 (0.0007) [2023-12-26 04:03:21,893][123091] Updated weights for policy 0, policy_version 560005 (0.0011) [2023-12-26 04:03:21,939][123090] Updated weights for policy 1, policy_version 555840 (0.0007) [2023-12-26 04:03:21,953][123091] Updated weights for policy 0, policy_version 560015 (0.0011) [2023-12-26 04:03:22,741][123091] Updated weights for policy 0, policy_version 560025 (0.0009) [2023-12-26 04:03:22,771][123090] Updated weights for policy 1, policy_version 555850 (0.0011) [2023-12-26 04:03:22,797][123091] Updated weights for policy 0, policy_version 560035 (0.0010) [2023-12-26 04:03:22,835][123090] Updated weights for policy 1, policy_version 555860 (0.0010) [2023-12-26 04:03:22,852][123091] Updated weights for policy 0, policy_version 560045 (0.0007) [2023-12-26 04:03:22,899][123090] Updated weights for policy 1, policy_version 555870 (0.0011) [2023-12-26 04:03:23,674][123091] Updated weights for policy 0, policy_version 560055 (0.0008) [2023-12-26 04:03:23,725][123090] Updated weights for policy 1, policy_version 555880 (0.0010) [2023-12-26 04:03:23,736][123091] Updated weights for policy 0, policy_version 560065 (0.0010) [2023-12-26 04:03:23,781][123090] Updated weights for policy 1, policy_version 555890 (0.0010) [2023-12-26 04:03:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 285679616. Throughput: 0: 9018.2, 1: 8721.2. Samples: 285664536. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:23,785][121949] Avg episode reward: [(0, '6134.963'), (1, '5710.050')] [2023-12-26 04:03:23,798][123091] Updated weights for policy 0, policy_version 560075 (0.0011) [2023-12-26 04:03:23,825][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000560080_143384576.pth... [2023-12-26 04:03:23,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000559024_143114240.pth [2023-12-26 04:03:23,832][123090] Updated weights for policy 1, policy_version 555900 (0.0010) [2023-12-26 04:03:23,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000555904_142311424.pth... [2023-12-26 04:03:23,851][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000554880_142049280.pth [2023-12-26 04:03:24,538][123091] Updated weights for policy 0, policy_version 560085 (0.0008) [2023-12-26 04:03:24,599][123091] Updated weights for policy 0, policy_version 560095 (0.0006) [2023-12-26 04:03:24,637][123090] Updated weights for policy 1, policy_version 555910 (0.0010) [2023-12-26 04:03:24,657][123091] Updated weights for policy 0, policy_version 560105 (0.0005) [2023-12-26 04:03:24,696][123090] Updated weights for policy 1, policy_version 555920 (0.0010) [2023-12-26 04:03:24,751][123090] Updated weights for policy 1, policy_version 555930 (0.0010) [2023-12-26 04:03:25,321][123091] Updated weights for policy 0, policy_version 560115 (0.0005) [2023-12-26 04:03:25,374][123091] Updated weights for policy 0, policy_version 560125 (0.0005) [2023-12-26 04:03:25,424][123091] Updated weights for policy 0, policy_version 560135 (0.0005) [2023-12-26 04:03:25,577][123090] Updated weights for policy 1, policy_version 555940 (0.0010) [2023-12-26 04:03:25,654][123090] Updated weights for policy 1, policy_version 555950 (0.0010) [2023-12-26 04:03:25,719][123090] Updated weights for policy 1, policy_version 555960 (0.0010) [2023-12-26 04:03:26,112][123091] Updated weights for policy 0, policy_version 560145 (0.0005) [2023-12-26 04:03:26,176][123091] Updated weights for policy 0, policy_version 560155 (0.0005) [2023-12-26 04:03:26,222][123091] Updated weights for policy 0, policy_version 560165 (0.0005) [2023-12-26 04:03:26,269][123091] Updated weights for policy 0, policy_version 560175 (0.0005) [2023-12-26 04:03:26,504][123090] Updated weights for policy 1, policy_version 555970 (0.0010) [2023-12-26 04:03:26,566][123090] Updated weights for policy 1, policy_version 555980 (0.0010) [2023-12-26 04:03:26,643][123090] Updated weights for policy 1, policy_version 555990 (0.0011) [2023-12-26 04:03:26,723][123090] Updated weights for policy 1, policy_version 556000 (0.0010) [2023-12-26 04:03:26,949][123091] Updated weights for policy 0, policy_version 560185 (0.0005) [2023-12-26 04:03:27,005][123091] Updated weights for policy 0, policy_version 560195 (0.0005) [2023-12-26 04:03:27,068][123091] Updated weights for policy 0, policy_version 560205 (0.0005) [2023-12-26 04:03:27,425][123090] Updated weights for policy 1, policy_version 556010 (0.0007) [2023-12-26 04:03:27,473][123090] Updated weights for policy 1, policy_version 556020 (0.0010) [2023-12-26 04:03:27,528][123090] Updated weights for policy 1, policy_version 556030 (0.0007) [2023-12-26 04:03:27,718][123091] Updated weights for policy 0, policy_version 560215 (0.0009) [2023-12-26 04:03:27,781][123091] Updated weights for policy 0, policy_version 560225 (0.0005) [2023-12-26 04:03:27,845][123091] Updated weights for policy 0, policy_version 560235 (0.0006) [2023-12-26 04:03:28,345][123090] Updated weights for policy 1, policy_version 556040 (0.0008) [2023-12-26 04:03:28,414][123090] Updated weights for policy 1, policy_version 556050 (0.0007) [2023-12-26 04:03:28,475][123090] Updated weights for policy 1, policy_version 556060 (0.0005) [2023-12-26 04:03:28,568][123091] Updated weights for policy 0, policy_version 560245 (0.0008) [2023-12-26 04:03:28,635][123091] Updated weights for policy 0, policy_version 560255 (0.0011) [2023-12-26 04:03:28,682][123091] Updated weights for policy 0, policy_version 560265 (0.0011) [2023-12-26 04:03:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 285786112. Throughput: 0: 9157.9, 1: 8739.9. Samples: 285775712. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:28,784][121949] Avg episode reward: [(0, '6106.319'), (1, '5659.949')] [2023-12-26 04:03:29,218][123090] Updated weights for policy 1, policy_version 556070 (0.0006) [2023-12-26 04:03:29,287][123090] Updated weights for policy 1, policy_version 556080 (0.0008) [2023-12-26 04:03:29,357][123090] Updated weights for policy 1, policy_version 556090 (0.0010) [2023-12-26 04:03:29,512][123091] Updated weights for policy 0, policy_version 560275 (0.0009) [2023-12-26 04:03:29,575][123091] Updated weights for policy 0, policy_version 560285 (0.0011) [2023-12-26 04:03:29,630][123091] Updated weights for policy 0, policy_version 560295 (0.0010) [2023-12-26 04:03:30,169][123090] Updated weights for policy 1, policy_version 556100 (0.0010) [2023-12-26 04:03:30,243][123090] Updated weights for policy 1, policy_version 556110 (0.0010) [2023-12-26 04:03:30,303][123090] Updated weights for policy 1, policy_version 556120 (0.0010) [2023-12-26 04:03:30,315][123091] Updated weights for policy 0, policy_version 560305 (0.0010) [2023-12-26 04:03:30,365][123091] Updated weights for policy 0, policy_version 560315 (0.0010) [2023-12-26 04:03:30,417][123091] Updated weights for policy 0, policy_version 560325 (0.0005) [2023-12-26 04:03:30,469][123091] Updated weights for policy 0, policy_version 560335 (0.0007) [2023-12-26 04:03:31,055][123091] Updated weights for policy 0, policy_version 560345 (0.0006) [2023-12-26 04:03:31,068][123090] Updated weights for policy 1, policy_version 556130 (0.0011) [2023-12-26 04:03:31,121][123091] Updated weights for policy 0, policy_version 560355 (0.0006) [2023-12-26 04:03:31,140][123090] Updated weights for policy 1, policy_version 556140 (0.0011) [2023-12-26 04:03:31,182][123091] Updated weights for policy 0, policy_version 560365 (0.0007) [2023-12-26 04:03:31,205][123090] Updated weights for policy 1, policy_version 556150 (0.0007) [2023-12-26 04:03:31,253][123090] Updated weights for policy 1, policy_version 556160 (0.0006) [2023-12-26 04:03:31,915][123091] Updated weights for policy 0, policy_version 560375 (0.0007) [2023-12-26 04:03:31,974][123091] Updated weights for policy 0, policy_version 560385 (0.0009) [2023-12-26 04:03:32,013][123090] Updated weights for policy 1, policy_version 556170 (0.0010) [2023-12-26 04:03:32,020][123091] Updated weights for policy 0, policy_version 560395 (0.0008) [2023-12-26 04:03:32,079][123090] Updated weights for policy 1, policy_version 556180 (0.0010) [2023-12-26 04:03:32,149][123090] Updated weights for policy 1, policy_version 556190 (0.0010) [2023-12-26 04:03:32,830][123090] Updated weights for policy 1, policy_version 556200 (0.0010) [2023-12-26 04:03:32,893][123090] Updated weights for policy 1, policy_version 556210 (0.0010) [2023-12-26 04:03:32,901][123091] Updated weights for policy 0, policy_version 560405 (0.0007) [2023-12-26 04:03:32,950][123090] Updated weights for policy 1, policy_version 556220 (0.0011) [2023-12-26 04:03:32,965][123091] Updated weights for policy 0, policy_version 560415 (0.0006) [2023-12-26 04:03:33,025][123091] Updated weights for policy 0, policy_version 560425 (0.0008) [2023-12-26 04:03:33,779][123090] Updated weights for policy 1, policy_version 556230 (0.0011) [2023-12-26 04:03:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 285868032. Throughput: 0: 9148.0, 1: 8743.7. Samples: 285884116. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:33,784][121949] Avg episode reward: [(0, '6141.345'), (1, '5582.643')] [2023-12-26 04:03:33,811][123091] Updated weights for policy 0, policy_version 560435 (0.0008) [2023-12-26 04:03:33,845][123090] Updated weights for policy 1, policy_version 556240 (0.0010) [2023-12-26 04:03:33,861][123091] Updated weights for policy 0, policy_version 560445 (0.0010) [2023-12-26 04:03:33,910][123091] Updated weights for policy 0, policy_version 560455 (0.0009) [2023-12-26 04:03:33,912][123090] Updated weights for policy 1, policy_version 556250 (0.0010) [2023-12-26 04:03:34,635][123091] Updated weights for policy 0, policy_version 560465 (0.0006) [2023-12-26 04:03:34,696][123090] Updated weights for policy 1, policy_version 556260 (0.0011) [2023-12-26 04:03:34,702][123091] Updated weights for policy 0, policy_version 560475 (0.0011) [2023-12-26 04:03:34,758][123090] Updated weights for policy 1, policy_version 556270 (0.0010) [2023-12-26 04:03:34,766][123091] Updated weights for policy 0, policy_version 560485 (0.0010) [2023-12-26 04:03:34,810][123090] Updated weights for policy 1, policy_version 556280 (0.0010) [2023-12-26 04:03:34,830][123091] Updated weights for policy 0, policy_version 560495 (0.0011) [2023-12-26 04:03:35,636][123091] Updated weights for policy 0, policy_version 560505 (0.0011) [2023-12-26 04:03:35,638][123090] Updated weights for policy 1, policy_version 556290 (0.0010) [2023-12-26 04:03:35,686][123090] Updated weights for policy 1, policy_version 556300 (0.0010) [2023-12-26 04:03:35,699][123091] Updated weights for policy 0, policy_version 560515 (0.0011) [2023-12-26 04:03:35,738][123090] Updated weights for policy 1, policy_version 556310 (0.0010) [2023-12-26 04:03:35,765][123091] Updated weights for policy 0, policy_version 560525 (0.0009) [2023-12-26 04:03:35,794][123090] Updated weights for policy 1, policy_version 556320 (0.0010) [2023-12-26 04:03:36,457][123091] Updated weights for policy 0, policy_version 560535 (0.0008) [2023-12-26 04:03:36,521][123091] Updated weights for policy 0, policy_version 560545 (0.0008) [2023-12-26 04:03:36,591][123091] Updated weights for policy 0, policy_version 560555 (0.0010) [2023-12-26 04:03:36,598][123090] Updated weights for policy 1, policy_version 556330 (0.0011) [2023-12-26 04:03:36,659][123090] Updated weights for policy 1, policy_version 556340 (0.0011) [2023-12-26 04:03:36,723][123090] Updated weights for policy 1, policy_version 556350 (0.0011) [2023-12-26 04:03:37,450][123091] Updated weights for policy 0, policy_version 560565 (0.0011) [2023-12-26 04:03:37,480][123090] Updated weights for policy 1, policy_version 556360 (0.0010) [2023-12-26 04:03:37,510][123091] Updated weights for policy 0, policy_version 560575 (0.0011) [2023-12-26 04:03:37,537][123090] Updated weights for policy 1, policy_version 556370 (0.0010) [2023-12-26 04:03:37,563][123091] Updated weights for policy 0, policy_version 560585 (0.0011) [2023-12-26 04:03:37,601][123090] Updated weights for policy 1, policy_version 556380 (0.0011) [2023-12-26 04:03:38,274][123091] Updated weights for policy 0, policy_version 560595 (0.0011) [2023-12-26 04:03:38,342][123091] Updated weights for policy 0, policy_version 560605 (0.0010) [2023-12-26 04:03:38,387][123090] Updated weights for policy 1, policy_version 556390 (0.0009) [2023-12-26 04:03:38,410][123091] Updated weights for policy 0, policy_version 560615 (0.0010) [2023-12-26 04:03:38,449][123090] Updated weights for policy 1, policy_version 556400 (0.0009) [2023-12-26 04:03:38,519][123090] Updated weights for policy 1, policy_version 556410 (0.0010) [2023-12-26 04:03:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 285966336. Throughput: 0: 9151.8, 1: 8747.5. Samples: 285938284. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:38,785][121949] Avg episode reward: [(0, '6258.843'), (1, '5529.192')] [2023-12-26 04:03:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000556416_142442496.pth... [2023-12-26 04:03:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000560624_143523840.pth... [2023-12-26 04:03:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000555392_142180352.pth [2023-12-26 04:03:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000559536_143245312.pth [2023-12-26 04:03:39,207][123091] Updated weights for policy 0, policy_version 560625 (0.0011) [2023-12-26 04:03:39,274][123091] Updated weights for policy 0, policy_version 560635 (0.0009) [2023-12-26 04:03:39,297][123090] Updated weights for policy 1, policy_version 556420 (0.0010) [2023-12-26 04:03:39,336][123091] Updated weights for policy 0, policy_version 560645 (0.0007) [2023-12-26 04:03:39,371][123090] Updated weights for policy 1, policy_version 556430 (0.0010) [2023-12-26 04:03:39,411][123091] Updated weights for policy 0, policy_version 560655 (0.0009) [2023-12-26 04:03:39,444][123090] Updated weights for policy 1, policy_version 556440 (0.0010) [2023-12-26 04:03:40,181][123091] Updated weights for policy 0, policy_version 560665 (0.0010) [2023-12-26 04:03:40,241][123091] Updated weights for policy 0, policy_version 560675 (0.0009) [2023-12-26 04:03:40,270][123090] Updated weights for policy 1, policy_version 556450 (0.0011) [2023-12-26 04:03:40,304][123091] Updated weights for policy 0, policy_version 560685 (0.0007) [2023-12-26 04:03:40,326][123090] Updated weights for policy 1, policy_version 556460 (0.0011) [2023-12-26 04:03:40,386][123090] Updated weights for policy 1, policy_version 556470 (0.0010) [2023-12-26 04:03:40,445][123090] Updated weights for policy 1, policy_version 556480 (0.0011) [2023-12-26 04:03:41,115][123091] Updated weights for policy 0, policy_version 560695 (0.0008) [2023-12-26 04:03:41,189][123091] Updated weights for policy 0, policy_version 560705 (0.0007) [2023-12-26 04:03:41,242][123091] Updated weights for policy 0, policy_version 560715 (0.0009) [2023-12-26 04:03:41,329][123090] Updated weights for policy 1, policy_version 556490 (0.0006) [2023-12-26 04:03:41,401][123090] Updated weights for policy 1, policy_version 556500 (0.0008) [2023-12-26 04:03:41,467][123090] Updated weights for policy 1, policy_version 556510 (0.0007) [2023-12-26 04:03:42,110][123091] Updated weights for policy 0, policy_version 560725 (0.0007) [2023-12-26 04:03:42,180][123091] Updated weights for policy 0, policy_version 560735 (0.0006) [2023-12-26 04:03:42,210][123090] Updated weights for policy 1, policy_version 556520 (0.0010) [2023-12-26 04:03:42,252][123091] Updated weights for policy 0, policy_version 560745 (0.0008) [2023-12-26 04:03:42,284][123090] Updated weights for policy 1, policy_version 556530 (0.0007) [2023-12-26 04:03:42,361][123090] Updated weights for policy 1, policy_version 556540 (0.0008) [2023-12-26 04:03:42,950][123091] Updated weights for policy 0, policy_version 560755 (0.0008) [2023-12-26 04:03:43,022][123091] Updated weights for policy 0, policy_version 560765 (0.0009) [2023-12-26 04:03:43,064][123090] Updated weights for policy 1, policy_version 556550 (0.0010) [2023-12-26 04:03:43,085][123091] Updated weights for policy 0, policy_version 560775 (0.0009) [2023-12-26 04:03:43,128][123090] Updated weights for policy 1, policy_version 556560 (0.0010) [2023-12-26 04:03:43,176][123090] Updated weights for policy 1, policy_version 556570 (0.0010) [2023-12-26 04:03:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 286048256. Throughput: 0: 9083.4, 1: 8619.0. Samples: 286044020. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:43,785][121949] Avg episode reward: [(0, '6239.584'), (1, '5514.133')] [2023-12-26 04:03:43,789][123091] Updated weights for policy 0, policy_version 560785 (0.0009) [2023-12-26 04:03:43,840][123091] Updated weights for policy 0, policy_version 560795 (0.0005) [2023-12-26 04:03:43,885][123091] Updated weights for policy 0, policy_version 560805 (0.0005) [2023-12-26 04:03:43,933][123091] Updated weights for policy 0, policy_version 560815 (0.0006) [2023-12-26 04:03:44,013][123090] Updated weights for policy 1, policy_version 556580 (0.0010) [2023-12-26 04:03:44,060][123090] Updated weights for policy 1, policy_version 556590 (0.0010) [2023-12-26 04:03:44,108][123090] Updated weights for policy 1, policy_version 556600 (0.0010) [2023-12-26 04:03:44,735][123091] Updated weights for policy 0, policy_version 560825 (0.0008) [2023-12-26 04:03:44,796][123091] Updated weights for policy 0, policy_version 560835 (0.0008) [2023-12-26 04:03:44,866][123091] Updated weights for policy 0, policy_version 560845 (0.0010) [2023-12-26 04:03:44,929][123090] Updated weights for policy 1, policy_version 556610 (0.0010) [2023-12-26 04:03:45,000][123090] Updated weights for policy 1, policy_version 556620 (0.0010) [2023-12-26 04:03:45,065][123090] Updated weights for policy 1, policy_version 556630 (0.0009) [2023-12-26 04:03:45,137][123090] Updated weights for policy 1, policy_version 556640 (0.0010) [2023-12-26 04:03:45,699][123091] Updated weights for policy 0, policy_version 560855 (0.0010) [2023-12-26 04:03:45,757][123091] Updated weights for policy 0, policy_version 560865 (0.0010) [2023-12-26 04:03:45,805][123091] Updated weights for policy 0, policy_version 560875 (0.0010) [2023-12-26 04:03:45,978][123090] Updated weights for policy 1, policy_version 556650 (0.0008) [2023-12-26 04:03:46,038][123090] Updated weights for policy 1, policy_version 556660 (0.0009) [2023-12-26 04:03:46,102][123090] Updated weights for policy 1, policy_version 556670 (0.0009) [2023-12-26 04:03:46,632][123091] Updated weights for policy 0, policy_version 560885 (0.0010) [2023-12-26 04:03:46,683][123091] Updated weights for policy 0, policy_version 560895 (0.0010) [2023-12-26 04:03:46,735][123091] Updated weights for policy 0, policy_version 560905 (0.0010) [2023-12-26 04:03:46,875][123090] Updated weights for policy 1, policy_version 556680 (0.0009) [2023-12-26 04:03:46,936][123090] Updated weights for policy 1, policy_version 556690 (0.0008) [2023-12-26 04:03:47,009][123090] Updated weights for policy 1, policy_version 556700 (0.0009) [2023-12-26 04:03:47,562][123091] Updated weights for policy 0, policy_version 560915 (0.0010) [2023-12-26 04:03:47,613][123091] Updated weights for policy 0, policy_version 560925 (0.0010) [2023-12-26 04:03:47,671][123091] Updated weights for policy 0, policy_version 560935 (0.0010) [2023-12-26 04:03:47,814][123090] Updated weights for policy 1, policy_version 556710 (0.0009) [2023-12-26 04:03:47,868][123090] Updated weights for policy 1, policy_version 556720 (0.0008) [2023-12-26 04:03:47,925][123090] Updated weights for policy 1, policy_version 556730 (0.0009) [2023-12-26 04:03:48,446][123091] Updated weights for policy 0, policy_version 560945 (0.0010) [2023-12-26 04:03:48,504][123091] Updated weights for policy 0, policy_version 560955 (0.0010) [2023-12-26 04:03:48,563][123091] Updated weights for policy 0, policy_version 560965 (0.0010) [2023-12-26 04:03:48,625][123091] Updated weights for policy 0, policy_version 560976 (0.0010) [2023-12-26 04:03:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 286138368. Throughput: 0: 9132.9, 1: 8636.6. Samples: 286149624. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 04:03:48,784][121949] Avg episode reward: [(0, '6107.022'), (1, '5408.347')] [2023-12-26 04:03:48,792][123090] Updated weights for policy 1, policy_version 556740 (0.0008) [2023-12-26 04:03:48,848][123090] Updated weights for policy 1, policy_version 556750 (0.0010) [2023-12-26 04:03:48,909][123090] Updated weights for policy 1, policy_version 556760 (0.0009) [2023-12-26 04:03:49,445][123091] Updated weights for policy 0, policy_version 560986 (0.0006) [2023-12-26 04:03:49,491][123091] Updated weights for policy 0, policy_version 560996 (0.0005) [2023-12-26 04:03:49,554][123091] Updated weights for policy 0, policy_version 561006 (0.0005) [2023-12-26 04:03:49,820][123090] Updated weights for policy 1, policy_version 556770 (0.0009) [2023-12-26 04:03:49,891][123090] Updated weights for policy 1, policy_version 556780 (0.0009) [2023-12-26 04:03:49,962][123090] Updated weights for policy 1, policy_version 556790 (0.0009) [2023-12-26 04:03:50,026][123090] Updated weights for policy 1, policy_version 556800 (0.0009) [2023-12-26 04:03:50,289][123091] Updated weights for policy 0, policy_version 561016 (0.0008) [2023-12-26 04:03:50,343][123091] Updated weights for policy 0, policy_version 561026 (0.0010) [2023-12-26 04:03:50,405][123091] Updated weights for policy 0, policy_version 561036 (0.0009) [2023-12-26 04:03:50,797][123090] Updated weights for policy 1, policy_version 556810 (0.0009) [2023-12-26 04:03:50,875][123090] Updated weights for policy 1, policy_version 556820 (0.0009) [2023-12-26 04:03:50,945][123090] Updated weights for policy 1, policy_version 556830 (0.0010) [2023-12-26 04:03:51,241][123091] Updated weights for policy 0, policy_version 561046 (0.0010) [2023-12-26 04:03:51,308][123091] Updated weights for policy 0, policy_version 561056 (0.0009) [2023-12-26 04:03:51,380][123091] Updated weights for policy 0, policy_version 561066 (0.0009) [2023-12-26 04:03:51,795][123090] Updated weights for policy 1, policy_version 556840 (0.0009) [2023-12-26 04:03:51,866][123090] Updated weights for policy 1, policy_version 556850 (0.0010) [2023-12-26 04:03:51,930][123090] Updated weights for policy 1, policy_version 556860 (0.0009) [2023-12-26 04:03:52,249][123091] Updated weights for policy 0, policy_version 561076 (0.0008) [2023-12-26 04:03:52,300][123091] Updated weights for policy 0, policy_version 561086 (0.0009) [2023-12-26 04:03:52,357][123091] Updated weights for policy 0, policy_version 561096 (0.0009) [2023-12-26 04:03:52,743][123090] Updated weights for policy 1, policy_version 556870 (0.0010) [2023-12-26 04:03:52,803][123090] Updated weights for policy 1, policy_version 556880 (0.0008) [2023-12-26 04:03:52,861][123090] Updated weights for policy 1, policy_version 556890 (0.0009) [2023-12-26 04:03:53,211][123091] Updated weights for policy 0, policy_version 561106 (0.0010) [2023-12-26 04:03:53,264][123091] Updated weights for policy 0, policy_version 561116 (0.0009) [2023-12-26 04:03:53,321][123091] Updated weights for policy 0, policy_version 561126 (0.0009) [2023-12-26 04:03:53,370][123091] Updated weights for policy 0, policy_version 561136 (0.0009) [2023-12-26 04:03:53,701][123090] Updated weights for policy 1, policy_version 556900 (0.0009) [2023-12-26 04:03:53,750][123090] Updated weights for policy 1, policy_version 556910 (0.0008) [2023-12-26 04:03:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 286220288. Throughput: 0: 9145.7, 1: 8652.4. Samples: 286201388. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:03:53,785][121949] Avg episode reward: [(0, '6118.476'), (1, '5411.654')] [2023-12-26 04:03:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000561136_143654912.pth... [2023-12-26 04:03:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000560080_143384576.pth [2023-12-26 04:03:53,804][123090] Updated weights for policy 1, policy_version 556920 (0.0010) [2023-12-26 04:03:53,842][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000556928_142573568.pth... [2023-12-26 04:03:53,845][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000555904_142311424.pth [2023-12-26 04:03:54,228][123091] Updated weights for policy 0, policy_version 561146 (0.0009) [2023-12-26 04:03:54,285][123091] Updated weights for policy 0, policy_version 561156 (0.0009) [2023-12-26 04:03:54,344][123091] Updated weights for policy 0, policy_version 561166 (0.0009) [2023-12-26 04:03:54,627][123090] Updated weights for policy 1, policy_version 556930 (0.0008) [2023-12-26 04:03:54,695][123090] Updated weights for policy 1, policy_version 556940 (0.0006) [2023-12-26 04:03:54,757][123090] Updated weights for policy 1, policy_version 556950 (0.0005) [2023-12-26 04:03:54,819][123090] Updated weights for policy 1, policy_version 556960 (0.0005) [2023-12-26 04:03:55,203][123091] Updated weights for policy 0, policy_version 561176 (0.0009) [2023-12-26 04:03:55,266][123091] Updated weights for policy 0, policy_version 561186 (0.0010) [2023-12-26 04:03:55,332][123091] Updated weights for policy 0, policy_version 561196 (0.0009) [2023-12-26 04:03:55,406][123090] Updated weights for policy 1, policy_version 556970 (0.0005) [2023-12-26 04:03:55,457][123090] Updated weights for policy 1, policy_version 556980 (0.0005) [2023-12-26 04:03:55,506][123090] Updated weights for policy 1, policy_version 556990 (0.0005) [2023-12-26 04:03:56,147][123091] Updated weights for policy 0, policy_version 561206 (0.0009) [2023-12-26 04:03:56,192][123090] Updated weights for policy 1, policy_version 557000 (0.0005) [2023-12-26 04:03:56,203][123091] Updated weights for policy 0, policy_version 561217 (0.0010) [2023-12-26 04:03:56,258][123091] Updated weights for policy 0, policy_version 561227 (0.0009) [2023-12-26 04:03:56,261][123090] Updated weights for policy 1, policy_version 557010 (0.0005) [2023-12-26 04:03:56,321][123090] Updated weights for policy 1, policy_version 557020 (0.0005) [2023-12-26 04:03:56,935][123090] Updated weights for policy 1, policy_version 557030 (0.0008) [2023-12-26 04:03:56,982][123090] Updated weights for policy 1, policy_version 557040 (0.0010) [2023-12-26 04:03:57,033][123090] Updated weights for policy 1, policy_version 557050 (0.0010) [2023-12-26 04:03:57,179][123091] Updated weights for policy 0, policy_version 561237 (0.0010) [2023-12-26 04:03:57,233][123091] Updated weights for policy 0, policy_version 561247 (0.0009) [2023-12-26 04:03:57,281][123091] Updated weights for policy 0, policy_version 561257 (0.0008) [2023-12-26 04:03:57,790][123090] Updated weights for policy 1, policy_version 557060 (0.0007) [2023-12-26 04:03:57,854][123090] Updated weights for policy 1, policy_version 557070 (0.0005) [2023-12-26 04:03:57,906][123090] Updated weights for policy 1, policy_version 557080 (0.0005) [2023-12-26 04:03:58,173][123091] Updated weights for policy 0, policy_version 561267 (0.0008) [2023-12-26 04:03:58,234][123091] Updated weights for policy 0, policy_version 561277 (0.0010) [2023-12-26 04:03:58,289][123091] Updated weights for policy 0, policy_version 561287 (0.0009) [2023-12-26 04:03:58,721][123090] Updated weights for policy 1, policy_version 557090 (0.0006) [2023-12-26 04:03:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 286310400. Throughput: 0: 9125.2, 1: 8794.0. Samples: 286307900. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:03:58,785][121949] Avg episode reward: [(0, '6282.740'), (1, '5394.307')] [2023-12-26 04:03:58,790][123090] Updated weights for policy 1, policy_version 557100 (0.0007) [2023-12-26 04:03:58,861][123090] Updated weights for policy 1, policy_version 557110 (0.0006) [2023-12-26 04:03:58,926][123090] Updated weights for policy 1, policy_version 557120 (0.0006) [2023-12-26 04:03:59,274][123091] Updated weights for policy 0, policy_version 561297 (0.0010) [2023-12-26 04:03:59,334][123091] Updated weights for policy 0, policy_version 561307 (0.0009) [2023-12-26 04:03:59,402][123091] Updated weights for policy 0, policy_version 561317 (0.0009) [2023-12-26 04:03:59,465][123091] Updated weights for policy 0, policy_version 561327 (0.0010) [2023-12-26 04:03:59,597][123090] Updated weights for policy 1, policy_version 557130 (0.0008) [2023-12-26 04:03:59,653][123090] Updated weights for policy 1, policy_version 557140 (0.0006) [2023-12-26 04:03:59,708][123090] Updated weights for policy 1, policy_version 557150 (0.0006) [2023-12-26 04:04:00,319][123091] Updated weights for policy 0, policy_version 561337 (0.0010) [2023-12-26 04:04:00,387][123091] Updated weights for policy 0, policy_version 561347 (0.0009) [2023-12-26 04:04:00,443][123091] Updated weights for policy 0, policy_version 561357 (0.0009) [2023-12-26 04:04:00,507][123090] Updated weights for policy 1, policy_version 557160 (0.0006) [2023-12-26 04:04:00,556][123090] Updated weights for policy 1, policy_version 557170 (0.0005) [2023-12-26 04:04:00,613][123090] Updated weights for policy 1, policy_version 557180 (0.0006) [2023-12-26 04:04:01,296][123091] Updated weights for policy 0, policy_version 561367 (0.0009) [2023-12-26 04:04:01,329][123090] Updated weights for policy 1, policy_version 557190 (0.0007) [2023-12-26 04:04:01,362][123091] Updated weights for policy 0, policy_version 561377 (0.0007) [2023-12-26 04:04:01,396][123090] Updated weights for policy 1, policy_version 557200 (0.0009) [2023-12-26 04:04:01,425][123091] Updated weights for policy 0, policy_version 561387 (0.0009) [2023-12-26 04:04:01,460][123090] Updated weights for policy 1, policy_version 557210 (0.0008) [2023-12-26 04:04:02,181][123090] Updated weights for policy 1, policy_version 557220 (0.0008) [2023-12-26 04:04:02,243][123090] Updated weights for policy 1, policy_version 557230 (0.0006) [2023-12-26 04:04:02,308][123090] Updated weights for policy 1, policy_version 557240 (0.0008) [2023-12-26 04:04:02,311][123091] Updated weights for policy 0, policy_version 561397 (0.0006) [2023-12-26 04:04:02,367][123091] Updated weights for policy 0, policy_version 561407 (0.0007) [2023-12-26 04:04:02,428][123091] Updated weights for policy 0, policy_version 561417 (0.0010) [2023-12-26 04:04:03,023][123090] Updated weights for policy 1, policy_version 557250 (0.0008) [2023-12-26 04:04:03,082][123090] Updated weights for policy 1, policy_version 557260 (0.0007) [2023-12-26 04:04:03,134][123090] Updated weights for policy 1, policy_version 557270 (0.0005) [2023-12-26 04:04:03,180][123090] Updated weights for policy 1, policy_version 557280 (0.0005) [2023-12-26 04:04:03,354][123091] Updated weights for policy 0, policy_version 561427 (0.0010) [2023-12-26 04:04:03,411][123091] Updated weights for policy 0, policy_version 561437 (0.0009) [2023-12-26 04:04:03,464][123091] Updated weights for policy 0, policy_version 561447 (0.0010) [2023-12-26 04:04:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 286400512. Throughput: 0: 8878.3, 1: 8899.9. Samples: 286412364. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:03,785][121949] Avg episode reward: [(0, '6231.922'), (1, '5405.223')] [2023-12-26 04:04:03,901][123090] Updated weights for policy 1, policy_version 557290 (0.0007) [2023-12-26 04:04:03,971][123090] Updated weights for policy 1, policy_version 557300 (0.0007) [2023-12-26 04:04:04,024][123090] Updated weights for policy 1, policy_version 557310 (0.0009) [2023-12-26 04:04:04,344][123091] Updated weights for policy 0, policy_version 561458 (0.0010) [2023-12-26 04:04:04,401][123091] Updated weights for policy 0, policy_version 561468 (0.0009) [2023-12-26 04:04:04,462][123091] Updated weights for policy 0, policy_version 561478 (0.0009) [2023-12-26 04:04:04,514][123091] Updated weights for policy 0, policy_version 561488 (0.0009) [2023-12-26 04:04:04,802][123090] Updated weights for policy 1, policy_version 557320 (0.0010) [2023-12-26 04:04:04,869][123090] Updated weights for policy 1, policy_version 557330 (0.0006) [2023-12-26 04:04:04,941][123090] Updated weights for policy 1, policy_version 557340 (0.0009) [2023-12-26 04:04:05,355][123091] Updated weights for policy 0, policy_version 561498 (0.0009) [2023-12-26 04:04:05,409][123091] Updated weights for policy 0, policy_version 561509 (0.0010) [2023-12-26 04:04:05,464][123091] Updated weights for policy 0, policy_version 561519 (0.0011) [2023-12-26 04:04:05,667][123090] Updated weights for policy 1, policy_version 557350 (0.0008) [2023-12-26 04:04:05,730][123090] Updated weights for policy 1, policy_version 557360 (0.0010) [2023-12-26 04:04:05,785][123090] Updated weights for policy 1, policy_version 557370 (0.0010) [2023-12-26 04:04:06,363][123091] Updated weights for policy 0, policy_version 561529 (0.0009) [2023-12-26 04:04:06,420][123091] Updated weights for policy 0, policy_version 561539 (0.0010) [2023-12-26 04:04:06,488][123091] Updated weights for policy 0, policy_version 561549 (0.0010) [2023-12-26 04:04:06,608][123090] Updated weights for policy 1, policy_version 557380 (0.0010) [2023-12-26 04:04:06,682][123090] Updated weights for policy 1, policy_version 557390 (0.0009) [2023-12-26 04:04:06,759][123090] Updated weights for policy 1, policy_version 557400 (0.0009) [2023-12-26 04:04:07,329][123091] Updated weights for policy 0, policy_version 561559 (0.0010) [2023-12-26 04:04:07,387][123091] Updated weights for policy 0, policy_version 561569 (0.0010) [2023-12-26 04:04:07,415][123090] Updated weights for policy 1, policy_version 557410 (0.0008) [2023-12-26 04:04:07,437][123091] Updated weights for policy 0, policy_version 561579 (0.0009) [2023-12-26 04:04:07,474][123090] Updated weights for policy 1, policy_version 557420 (0.0006) [2023-12-26 04:04:07,556][123090] Updated weights for policy 1, policy_version 557430 (0.0011) [2023-12-26 04:04:07,620][123090] Updated weights for policy 1, policy_version 557440 (0.0011) [2023-12-26 04:04:08,183][123091] Updated weights for policy 0, policy_version 561589 (0.0009) [2023-12-26 04:04:08,241][123091] Updated weights for policy 0, policy_version 561599 (0.0009) [2023-12-26 04:04:08,307][123091] Updated weights for policy 0, policy_version 561609 (0.0008) [2023-12-26 04:04:08,339][123090] Updated weights for policy 1, policy_version 557450 (0.0011) [2023-12-26 04:04:08,403][123090] Updated weights for policy 1, policy_version 557460 (0.0007) [2023-12-26 04:04:08,468][123090] Updated weights for policy 1, policy_version 557470 (0.0011) [2023-12-26 04:04:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 286490624. Throughput: 0: 8817.3, 1: 8959.7. Samples: 286464504. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:08,785][121949] Avg episode reward: [(0, '6139.854'), (1, '5555.108')] [2023-12-26 04:04:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000557472_142712832.pth... [2023-12-26 04:04:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000561616_143777792.pth... [2023-12-26 04:04:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000556416_142442496.pth [2023-12-26 04:04:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000560624_143523840.pth [2023-12-26 04:04:09,170][123091] Updated weights for policy 0, policy_version 561619 (0.0007) [2023-12-26 04:04:09,236][123091] Updated weights for policy 0, policy_version 561629 (0.0007) [2023-12-26 04:04:09,304][123091] Updated weights for policy 0, policy_version 561639 (0.0006) [2023-12-26 04:04:09,314][123090] Updated weights for policy 1, policy_version 557480 (0.0010) [2023-12-26 04:04:09,382][123090] Updated weights for policy 1, policy_version 557490 (0.0007) [2023-12-26 04:04:09,454][123090] Updated weights for policy 1, policy_version 557500 (0.0007) [2023-12-26 04:04:10,142][123091] Updated weights for policy 0, policy_version 561649 (0.0009) [2023-12-26 04:04:10,211][123091] Updated weights for policy 0, policy_version 561659 (0.0008) [2023-12-26 04:04:10,238][123090] Updated weights for policy 1, policy_version 557510 (0.0009) [2023-12-26 04:04:10,277][123091] Updated weights for policy 0, policy_version 561669 (0.0011) [2023-12-26 04:04:10,298][123090] Updated weights for policy 1, policy_version 557520 (0.0011) [2023-12-26 04:04:10,338][123091] Updated weights for policy 0, policy_version 561679 (0.0007) [2023-12-26 04:04:10,367][123090] Updated weights for policy 1, policy_version 557530 (0.0011) [2023-12-26 04:04:11,125][123091] Updated weights for policy 0, policy_version 561689 (0.0007) [2023-12-26 04:04:11,194][123091] Updated weights for policy 0, policy_version 561699 (0.0007) [2023-12-26 04:04:11,206][123090] Updated weights for policy 1, policy_version 557540 (0.0011) [2023-12-26 04:04:11,255][123091] Updated weights for policy 0, policy_version 561709 (0.0007) [2023-12-26 04:04:11,277][123090] Updated weights for policy 1, policy_version 557550 (0.0014) [2023-12-26 04:04:11,348][123090] Updated weights for policy 1, policy_version 557560 (0.0009) [2023-12-26 04:04:12,076][123091] Updated weights for policy 0, policy_version 561719 (0.0007) [2023-12-26 04:04:12,135][123091] Updated weights for policy 0, policy_version 561729 (0.0009) [2023-12-26 04:04:12,196][123091] Updated weights for policy 0, policy_version 561739 (0.0009) [2023-12-26 04:04:12,234][123090] Updated weights for policy 1, policy_version 557570 (0.0009) [2023-12-26 04:04:12,304][123090] Updated weights for policy 1, policy_version 557580 (0.0009) [2023-12-26 04:04:12,378][123090] Updated weights for policy 1, policy_version 557590 (0.0010) [2023-12-26 04:04:12,448][123090] Updated weights for policy 1, policy_version 557600 (0.0009) [2023-12-26 04:04:12,944][123091] Updated weights for policy 0, policy_version 561749 (0.0009) [2023-12-26 04:04:13,000][123091] Updated weights for policy 0, policy_version 561759 (0.0008) [2023-12-26 04:04:13,052][123091] Updated weights for policy 0, policy_version 561769 (0.0005) [2023-12-26 04:04:13,282][123090] Updated weights for policy 1, policy_version 557610 (0.0009) [2023-12-26 04:04:13,330][123090] Updated weights for policy 1, policy_version 557620 (0.0009) [2023-12-26 04:04:13,378][123090] Updated weights for policy 1, policy_version 557630 (0.0009) [2023-12-26 04:04:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 286572544. Throughput: 0: 8676.1, 1: 8945.0. Samples: 286568660. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:13,785][121949] Avg episode reward: [(0, '6150.203'), (1, '5553.277')] [2023-12-26 04:04:13,846][123091] Updated weights for policy 0, policy_version 561779 (0.0007) [2023-12-26 04:04:13,907][123091] Updated weights for policy 0, policy_version 561789 (0.0006) [2023-12-26 04:04:13,964][123091] Updated weights for policy 0, policy_version 561799 (0.0010) [2023-12-26 04:04:14,254][123090] Updated weights for policy 1, policy_version 557640 (0.0008) [2023-12-26 04:04:14,311][123090] Updated weights for policy 1, policy_version 557650 (0.0009) [2023-12-26 04:04:14,370][123090] Updated weights for policy 1, policy_version 557660 (0.0010) [2023-12-26 04:04:14,718][123091] Updated weights for policy 0, policy_version 561809 (0.0009) [2023-12-26 04:04:14,767][123091] Updated weights for policy 0, policy_version 561819 (0.0006) [2023-12-26 04:04:14,830][123091] Updated weights for policy 0, policy_version 561829 (0.0006) [2023-12-26 04:04:14,884][123091] Updated weights for policy 0, policy_version 561839 (0.0006) [2023-12-26 04:04:15,071][123090] Updated weights for policy 1, policy_version 557670 (0.0009) [2023-12-26 04:04:15,144][123090] Updated weights for policy 1, policy_version 557680 (0.0008) [2023-12-26 04:04:15,213][123090] Updated weights for policy 1, policy_version 557690 (0.0009) [2023-12-26 04:04:15,695][123091] Updated weights for policy 0, policy_version 561849 (0.0009) [2023-12-26 04:04:15,749][123091] Updated weights for policy 0, policy_version 561859 (0.0010) [2023-12-26 04:04:15,808][123091] Updated weights for policy 0, policy_version 561869 (0.0009) [2023-12-26 04:04:16,021][123090] Updated weights for policy 1, policy_version 557700 (0.0008) [2023-12-26 04:04:16,071][123090] Updated weights for policy 1, policy_version 557710 (0.0005) [2023-12-26 04:04:16,129][123090] Updated weights for policy 1, policy_version 557720 (0.0005) [2023-12-26 04:04:16,696][123091] Updated weights for policy 0, policy_version 561879 (0.0007) [2023-12-26 04:04:16,744][123091] Updated weights for policy 0, policy_version 561889 (0.0005) [2023-12-26 04:04:16,756][123090] Updated weights for policy 1, policy_version 557730 (0.0005) [2023-12-26 04:04:16,809][123090] Updated weights for policy 1, policy_version 557740 (0.0005) [2023-12-26 04:04:16,820][123091] Updated weights for policy 0, policy_version 561899 (0.0007) [2023-12-26 04:04:16,860][123090] Updated weights for policy 1, policy_version 557750 (0.0006) [2023-12-26 04:04:16,921][123090] Updated weights for policy 1, policy_version 557760 (0.0005) [2023-12-26 04:04:17,473][123091] Updated weights for policy 0, policy_version 561909 (0.0008) [2023-12-26 04:04:17,539][123091] Updated weights for policy 0, policy_version 561919 (0.0006) [2023-12-26 04:04:17,589][123090] Updated weights for policy 1, policy_version 557770 (0.0005) [2023-12-26 04:04:17,605][123091] Updated weights for policy 0, policy_version 561929 (0.0010) [2023-12-26 04:04:17,652][123090] Updated weights for policy 1, policy_version 557780 (0.0005) [2023-12-26 04:04:17,716][123090] Updated weights for policy 1, policy_version 557790 (0.0010) [2023-12-26 04:04:18,272][123091] Updated weights for policy 0, policy_version 561939 (0.0009) [2023-12-26 04:04:18,333][123091] Updated weights for policy 0, policy_version 561949 (0.0006) [2023-12-26 04:04:18,386][123091] Updated weights for policy 0, policy_version 561959 (0.0009) [2023-12-26 04:04:18,527][123090] Updated weights for policy 1, policy_version 557800 (0.0010) [2023-12-26 04:04:18,579][123090] Updated weights for policy 1, policy_version 557810 (0.0010) [2023-12-26 04:04:18,637][123090] Updated weights for policy 1, policy_version 557820 (0.0010) [2023-12-26 04:04:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 286670848. Throughput: 0: 8688.6, 1: 8980.3. Samples: 286679220. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:18,785][121949] Avg episode reward: [(0, '6197.707'), (1, '5566.569')] [2023-12-26 04:04:19,014][123091] Updated weights for policy 0, policy_version 561969 (0.0006) [2023-12-26 04:04:19,082][123091] Updated weights for policy 0, policy_version 561979 (0.0005) [2023-12-26 04:04:19,141][123091] Updated weights for policy 0, policy_version 561989 (0.0005) [2023-12-26 04:04:19,203][123091] Updated weights for policy 0, policy_version 561999 (0.0006) [2023-12-26 04:04:19,484][123090] Updated weights for policy 1, policy_version 557830 (0.0010) [2023-12-26 04:04:19,543][123090] Updated weights for policy 1, policy_version 557840 (0.0010) [2023-12-26 04:04:19,592][123090] Updated weights for policy 1, policy_version 557850 (0.0010) [2023-12-26 04:04:19,959][123091] Updated weights for policy 0, policy_version 562009 (0.0010) [2023-12-26 04:04:20,027][123091] Updated weights for policy 0, policy_version 562019 (0.0009) [2023-12-26 04:04:20,101][123091] Updated weights for policy 0, policy_version 562029 (0.0006) [2023-12-26 04:04:20,456][123090] Updated weights for policy 1, policy_version 557860 (0.0010) [2023-12-26 04:04:20,514][123090] Updated weights for policy 1, policy_version 557870 (0.0009) [2023-12-26 04:04:20,577][123090] Updated weights for policy 1, policy_version 557880 (0.0009) [2023-12-26 04:04:20,856][123091] Updated weights for policy 0, policy_version 562039 (0.0008) [2023-12-26 04:04:20,910][123091] Updated weights for policy 0, policy_version 562049 (0.0009) [2023-12-26 04:04:20,970][123091] Updated weights for policy 0, policy_version 562059 (0.0009) [2023-12-26 04:04:21,410][123090] Updated weights for policy 1, policy_version 557890 (0.0007) [2023-12-26 04:04:21,469][123090] Updated weights for policy 1, policy_version 557900 (0.0009) [2023-12-26 04:04:21,538][123090] Updated weights for policy 1, policy_version 557910 (0.0009) [2023-12-26 04:04:21,599][123090] Updated weights for policy 1, policy_version 557920 (0.0009) [2023-12-26 04:04:21,860][123091] Updated weights for policy 0, policy_version 562069 (0.0009) [2023-12-26 04:04:21,929][123091] Updated weights for policy 0, policy_version 562079 (0.0010) [2023-12-26 04:04:21,996][123091] Updated weights for policy 0, policy_version 562089 (0.0009) [2023-12-26 04:04:22,468][123090] Updated weights for policy 1, policy_version 557930 (0.0010) [2023-12-26 04:04:22,534][123090] Updated weights for policy 1, policy_version 557940 (0.0010) [2023-12-26 04:04:22,589][123090] Updated weights for policy 1, policy_version 557950 (0.0010) [2023-12-26 04:04:22,819][123091] Updated weights for policy 0, policy_version 562099 (0.0009) [2023-12-26 04:04:22,884][123091] Updated weights for policy 0, policy_version 562109 (0.0010) [2023-12-26 04:04:22,949][123091] Updated weights for policy 0, policy_version 562119 (0.0008) [2023-12-26 04:04:23,434][123090] Updated weights for policy 1, policy_version 557960 (0.0006) [2023-12-26 04:04:23,492][123090] Updated weights for policy 1, policy_version 557970 (0.0005) [2023-12-26 04:04:23,561][123090] Updated weights for policy 1, policy_version 557980 (0.0005) [2023-12-26 04:04:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 286752768. Throughput: 0: 8679.6, 1: 8951.6. Samples: 286731688. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:23,785][121949] Avg episode reward: [(0, '6284.274'), (1, '5596.863')] [2023-12-26 04:04:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000557984_142843904.pth... [2023-12-26 04:04:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000562128_143908864.pth... [2023-12-26 04:04:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000556928_142573568.pth [2023-12-26 04:04:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000561136_143654912.pth [2023-12-26 04:04:23,822][123091] Updated weights for policy 0, policy_version 562129 (0.0010) [2023-12-26 04:04:23,882][123091] Updated weights for policy 0, policy_version 562139 (0.0009) [2023-12-26 04:04:23,934][123091] Updated weights for policy 0, policy_version 562149 (0.0009) [2023-12-26 04:04:23,985][123091] Updated weights for policy 0, policy_version 562159 (0.0008) [2023-12-26 04:04:24,229][123090] Updated weights for policy 1, policy_version 557990 (0.0008) [2023-12-26 04:04:24,279][123090] Updated weights for policy 1, policy_version 558000 (0.0009) [2023-12-26 04:04:24,335][123090] Updated weights for policy 1, policy_version 558010 (0.0009) [2023-12-26 04:04:24,815][123091] Updated weights for policy 0, policy_version 562169 (0.0009) [2023-12-26 04:04:24,879][123091] Updated weights for policy 0, policy_version 562179 (0.0008) [2023-12-26 04:04:24,941][123091] Updated weights for policy 0, policy_version 562189 (0.0008) [2023-12-26 04:04:25,155][123090] Updated weights for policy 1, policy_version 558020 (0.0009) [2023-12-26 04:04:25,208][123090] Updated weights for policy 1, policy_version 558030 (0.0009) [2023-12-26 04:04:25,265][123090] Updated weights for policy 1, policy_version 558040 (0.0009) [2023-12-26 04:04:25,729][123091] Updated weights for policy 0, policy_version 562199 (0.0006) [2023-12-26 04:04:25,794][123091] Updated weights for policy 0, policy_version 562209 (0.0006) [2023-12-26 04:04:25,852][123091] Updated weights for policy 0, policy_version 562219 (0.0006) [2023-12-26 04:04:26,171][123090] Updated weights for policy 1, policy_version 558050 (0.0009) [2023-12-26 04:04:26,223][123090] Updated weights for policy 1, policy_version 558060 (0.0009) [2023-12-26 04:04:26,274][123090] Updated weights for policy 1, policy_version 558070 (0.0009) [2023-12-26 04:04:26,322][123090] Updated weights for policy 1, policy_version 558080 (0.0009) [2023-12-26 04:04:26,482][123091] Updated weights for policy 0, policy_version 562229 (0.0005) [2023-12-26 04:04:26,536][123091] Updated weights for policy 0, policy_version 562239 (0.0005) [2023-12-26 04:04:26,598][123091] Updated weights for policy 0, policy_version 562249 (0.0005) [2023-12-26 04:04:27,203][123090] Updated weights for policy 1, policy_version 558090 (0.0010) [2023-12-26 04:04:27,203][123091] Updated weights for policy 0, policy_version 562259 (0.0005) [2023-12-26 04:04:27,252][123091] Updated weights for policy 0, policy_version 562269 (0.0006) [2023-12-26 04:04:27,254][123090] Updated weights for policy 1, policy_version 558100 (0.0009) [2023-12-26 04:04:27,299][123090] Updated weights for policy 1, policy_version 558110 (0.0008) [2023-12-26 04:04:27,301][123091] Updated weights for policy 0, policy_version 562279 (0.0007) [2023-12-26 04:04:28,112][123091] Updated weights for policy 0, policy_version 562289 (0.0009) [2023-12-26 04:04:28,118][123090] Updated weights for policy 1, policy_version 558120 (0.0009) [2023-12-26 04:04:28,164][123091] Updated weights for policy 0, policy_version 562299 (0.0005) [2023-12-26 04:04:28,175][123090] Updated weights for policy 1, policy_version 558130 (0.0009) [2023-12-26 04:04:28,227][123091] Updated weights for policy 0, policy_version 562309 (0.0006) [2023-12-26 04:04:28,235][123090] Updated weights for policy 1, policy_version 558140 (0.0008) [2023-12-26 04:04:28,287][123091] Updated weights for policy 0, policy_version 562319 (0.0007) [2023-12-26 04:04:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 286842880. Throughput: 0: 8708.8, 1: 8909.8. Samples: 286836856. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:28,784][121949] Avg episode reward: [(0, '6258.293'), (1, '5777.449')] [2023-12-26 04:04:29,023][123090] Updated weights for policy 1, policy_version 558150 (0.0008) [2023-12-26 04:04:29,089][123090] Updated weights for policy 1, policy_version 558160 (0.0010) [2023-12-26 04:04:29,097][123091] Updated weights for policy 0, policy_version 562329 (0.0006) [2023-12-26 04:04:29,153][123090] Updated weights for policy 1, policy_version 558170 (0.0010) [2023-12-26 04:04:29,161][123091] Updated weights for policy 0, policy_version 562339 (0.0007) [2023-12-26 04:04:29,236][123091] Updated weights for policy 0, policy_version 562349 (0.0007) [2023-12-26 04:04:29,926][123091] Updated weights for policy 0, policy_version 562359 (0.0010) [2023-12-26 04:04:29,985][123091] Updated weights for policy 0, policy_version 562369 (0.0010) [2023-12-26 04:04:29,988][123090] Updated weights for policy 1, policy_version 558180 (0.0010) [2023-12-26 04:04:30,042][123091] Updated weights for policy 0, policy_version 562379 (0.0008) [2023-12-26 04:04:30,050][123090] Updated weights for policy 1, policy_version 558190 (0.0010) [2023-12-26 04:04:30,116][123090] Updated weights for policy 1, policy_version 558200 (0.0010) [2023-12-26 04:04:30,846][123091] Updated weights for policy 0, policy_version 562389 (0.0010) [2023-12-26 04:04:30,898][123091] Updated weights for policy 0, policy_version 562399 (0.0009) [2023-12-26 04:04:30,935][123090] Updated weights for policy 1, policy_version 558210 (0.0010) [2023-12-26 04:04:30,953][123091] Updated weights for policy 0, policy_version 562409 (0.0009) [2023-12-26 04:04:30,998][123090] Updated weights for policy 1, policy_version 558220 (0.0010) [2023-12-26 04:04:31,076][123090] Updated weights for policy 1, policy_version 558230 (0.0011) [2023-12-26 04:04:31,152][123090] Updated weights for policy 1, policy_version 558240 (0.0011) [2023-12-26 04:04:31,856][123091] Updated weights for policy 0, policy_version 562419 (0.0007) [2023-12-26 04:04:31,929][123091] Updated weights for policy 0, policy_version 562429 (0.0010) [2023-12-26 04:04:31,985][123091] Updated weights for policy 0, policy_version 562439 (0.0007) [2023-12-26 04:04:31,994][123090] Updated weights for policy 1, policy_version 558250 (0.0011) [2023-12-26 04:04:32,053][123090] Updated weights for policy 1, policy_version 558260 (0.0010) [2023-12-26 04:04:32,121][123090] Updated weights for policy 1, policy_version 558270 (0.0009) [2023-12-26 04:04:32,715][123091] Updated weights for policy 0, policy_version 562449 (0.0009) [2023-12-26 04:04:32,780][123091] Updated weights for policy 0, policy_version 562459 (0.0006) [2023-12-26 04:04:32,804][123090] Updated weights for policy 1, policy_version 558280 (0.0005) [2023-12-26 04:04:32,838][123091] Updated weights for policy 0, policy_version 562469 (0.0007) [2023-12-26 04:04:32,852][123090] Updated weights for policy 1, policy_version 558290 (0.0005) [2023-12-26 04:04:32,887][123091] Updated weights for policy 0, policy_version 562479 (0.0009) [2023-12-26 04:04:32,897][123090] Updated weights for policy 1, policy_version 558300 (0.0005) [2023-12-26 04:04:33,636][123090] Updated weights for policy 1, policy_version 558310 (0.0005) [2023-12-26 04:04:33,654][123091] Updated weights for policy 0, policy_version 562489 (0.0007) [2023-12-26 04:04:33,701][123090] Updated weights for policy 1, policy_version 558320 (0.0005) [2023-12-26 04:04:33,703][123091] Updated weights for policy 0, policy_version 562499 (0.0005) [2023-12-26 04:04:33,751][123090] Updated weights for policy 1, policy_version 558330 (0.0006) [2023-12-26 04:04:33,753][123091] Updated weights for policy 0, policy_version 562509 (0.0005) [2023-12-26 04:04:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 286941184. Throughput: 0: 8739.7, 1: 8949.6. Samples: 286945644. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:33,785][121949] Avg episode reward: [(0, '6240.898'), (1, '5788.686')] [2023-12-26 04:04:34,375][123091] Updated weights for policy 0, policy_version 562519 (0.0005) [2023-12-26 04:04:34,422][123090] Updated weights for policy 1, policy_version 558340 (0.0008) [2023-12-26 04:04:34,439][123091] Updated weights for policy 0, policy_version 562529 (0.0006) [2023-12-26 04:04:34,476][123090] Updated weights for policy 1, policy_version 558350 (0.0009) [2023-12-26 04:04:34,507][123091] Updated weights for policy 0, policy_version 562539 (0.0010) [2023-12-26 04:04:34,530][123090] Updated weights for policy 1, policy_version 558360 (0.0005) [2023-12-26 04:04:35,229][123090] Updated weights for policy 1, policy_version 558370 (0.0005) [2023-12-26 04:04:35,292][123090] Updated weights for policy 1, policy_version 558380 (0.0005) [2023-12-26 04:04:35,351][123090] Updated weights for policy 1, policy_version 558390 (0.0006) [2023-12-26 04:04:35,398][123091] Updated weights for policy 0, policy_version 562549 (0.0010) [2023-12-26 04:04:35,413][123090] Updated weights for policy 1, policy_version 558400 (0.0006) [2023-12-26 04:04:35,459][123091] Updated weights for policy 0, policy_version 562559 (0.0010) [2023-12-26 04:04:35,513][123091] Updated weights for policy 0, policy_version 562569 (0.0009) [2023-12-26 04:04:36,141][123090] Updated weights for policy 1, policy_version 558410 (0.0009) [2023-12-26 04:04:36,197][123090] Updated weights for policy 1, policy_version 558420 (0.0010) [2023-12-26 04:04:36,272][123090] Updated weights for policy 1, policy_version 558430 (0.0006) [2023-12-26 04:04:36,433][123091] Updated weights for policy 0, policy_version 562579 (0.0010) [2023-12-26 04:04:36,506][123091] Updated weights for policy 0, policy_version 562589 (0.0010) [2023-12-26 04:04:36,573][123091] Updated weights for policy 0, policy_version 562599 (0.0010) [2023-12-26 04:04:37,063][123090] Updated weights for policy 1, policy_version 558440 (0.0009) [2023-12-26 04:04:37,116][123090] Updated weights for policy 1, policy_version 558451 (0.0010) [2023-12-26 04:04:37,170][123090] Updated weights for policy 1, policy_version 558462 (0.0010) [2023-12-26 04:04:37,371][123091] Updated weights for policy 0, policy_version 562609 (0.0009) [2023-12-26 04:04:37,422][123091] Updated weights for policy 0, policy_version 562619 (0.0009) [2023-12-26 04:04:37,475][123091] Updated weights for policy 0, policy_version 562629 (0.0010) [2023-12-26 04:04:37,526][123091] Updated weights for policy 0, policy_version 562639 (0.0009) [2023-12-26 04:04:37,967][123090] Updated weights for policy 1, policy_version 558472 (0.0011) [2023-12-26 04:04:38,028][123090] Updated weights for policy 1, policy_version 558482 (0.0010) [2023-12-26 04:04:38,091][123090] Updated weights for policy 1, policy_version 558492 (0.0009) [2023-12-26 04:04:38,344][123091] Updated weights for policy 0, policy_version 562649 (0.0009) [2023-12-26 04:04:38,412][123091] Updated weights for policy 0, policy_version 562659 (0.0009) [2023-12-26 04:04:38,477][123091] Updated weights for policy 0, policy_version 562669 (0.0009) [2023-12-26 04:04:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 287023104. Throughput: 0: 8707.7, 1: 9035.9. Samples: 286999848. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:38,785][121949] Avg episode reward: [(0, '6230.169'), (1, '5783.139')] [2023-12-26 04:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000562672_144048128.pth... [2023-12-26 04:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000558496_142974976.pth... [2023-12-26 04:04:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000561616_143777792.pth [2023-12-26 04:04:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000557472_142712832.pth [2023-12-26 04:04:38,911][123090] Updated weights for policy 1, policy_version 558502 (0.0006) [2023-12-26 04:04:38,965][123090] Updated weights for policy 1, policy_version 558512 (0.0005) [2023-12-26 04:04:39,030][123090] Updated weights for policy 1, policy_version 558522 (0.0010) [2023-12-26 04:04:39,321][123091] Updated weights for policy 0, policy_version 562679 (0.0008) [2023-12-26 04:04:39,393][123091] Updated weights for policy 0, policy_version 562689 (0.0008) [2023-12-26 04:04:39,465][123091] Updated weights for policy 0, policy_version 562699 (0.0008) [2023-12-26 04:04:39,868][123090] Updated weights for policy 1, policy_version 558532 (0.0010) [2023-12-26 04:04:39,941][123090] Updated weights for policy 1, policy_version 558542 (0.0009) [2023-12-26 04:04:40,005][123090] Updated weights for policy 1, policy_version 558552 (0.0010) [2023-12-26 04:04:40,212][123091] Updated weights for policy 0, policy_version 562709 (0.0009) [2023-12-26 04:04:40,281][123091] Updated weights for policy 0, policy_version 562719 (0.0009) [2023-12-26 04:04:40,334][123091] Updated weights for policy 0, policy_version 562729 (0.0010) [2023-12-26 04:04:40,899][123090] Updated weights for policy 1, policy_version 558562 (0.0010) [2023-12-26 04:04:40,962][123090] Updated weights for policy 1, policy_version 558572 (0.0010) [2023-12-26 04:04:41,017][123090] Updated weights for policy 1, policy_version 558582 (0.0010) [2023-12-26 04:04:41,091][123090] Updated weights for policy 1, policy_version 558592 (0.0010) [2023-12-26 04:04:41,123][123091] Updated weights for policy 0, policy_version 562739 (0.0010) [2023-12-26 04:04:41,194][123091] Updated weights for policy 0, policy_version 562749 (0.0008) [2023-12-26 04:04:41,262][123091] Updated weights for policy 0, policy_version 562759 (0.0009) [2023-12-26 04:04:42,002][123090] Updated weights for policy 1, policy_version 558602 (0.0011) [2023-12-26 04:04:42,062][123090] Updated weights for policy 1, policy_version 558612 (0.0011) [2023-12-26 04:04:42,108][123091] Updated weights for policy 0, policy_version 562769 (0.0009) [2023-12-26 04:04:42,123][123090] Updated weights for policy 1, policy_version 558622 (0.0011) [2023-12-26 04:04:42,174][123091] Updated weights for policy 0, policy_version 562779 (0.0007) [2023-12-26 04:04:42,230][123091] Updated weights for policy 0, policy_version 562789 (0.0009) [2023-12-26 04:04:42,291][123091] Updated weights for policy 0, policy_version 562799 (0.0009) [2023-12-26 04:04:42,966][123090] Updated weights for policy 1, policy_version 558632 (0.0010) [2023-12-26 04:04:43,029][123090] Updated weights for policy 1, policy_version 558642 (0.0010) [2023-12-26 04:04:43,092][123090] Updated weights for policy 1, policy_version 558652 (0.0011) [2023-12-26 04:04:43,134][123091] Updated weights for policy 0, policy_version 562809 (0.0008) [2023-12-26 04:04:43,199][123091] Updated weights for policy 0, policy_version 562819 (0.0009) [2023-12-26 04:04:43,258][123091] Updated weights for policy 0, policy_version 562829 (0.0007) [2023-12-26 04:04:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 287105024. Throughput: 0: 8757.1, 1: 8883.7. Samples: 287101736. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:43,785][121949] Avg episode reward: [(0, '6189.996'), (1, '5709.990')] [2023-12-26 04:04:43,895][123090] Updated weights for policy 1, policy_version 558662 (0.0010) [2023-12-26 04:04:43,943][123090] Updated weights for policy 1, policy_version 558672 (0.0010) [2023-12-26 04:04:44,000][123090] Updated weights for policy 1, policy_version 558682 (0.0010) [2023-12-26 04:04:44,076][123091] Updated weights for policy 0, policy_version 562839 (0.0007) [2023-12-26 04:04:44,119][123091] Updated weights for policy 0, policy_version 562849 (0.0010) [2023-12-26 04:04:44,163][123091] Updated weights for policy 0, policy_version 562859 (0.0010) [2023-12-26 04:04:44,840][123090] Updated weights for policy 1, policy_version 558692 (0.0010) [2023-12-26 04:04:44,909][123090] Updated weights for policy 1, policy_version 558702 (0.0011) [2023-12-26 04:04:44,972][123090] Updated weights for policy 1, policy_version 558712 (0.0011) [2023-12-26 04:04:44,988][123091] Updated weights for policy 0, policy_version 562869 (0.0008) [2023-12-26 04:04:45,046][123091] Updated weights for policy 0, policy_version 562879 (0.0006) [2023-12-26 04:04:45,104][123091] Updated weights for policy 0, policy_version 562889 (0.0011) [2023-12-26 04:04:45,808][123090] Updated weights for policy 1, policy_version 558722 (0.0011) [2023-12-26 04:04:45,864][123090] Updated weights for policy 1, policy_version 558732 (0.0010) [2023-12-26 04:04:45,904][123091] Updated weights for policy 0, policy_version 562899 (0.0010) [2023-12-26 04:04:45,927][123090] Updated weights for policy 1, policy_version 558742 (0.0010) [2023-12-26 04:04:45,956][123091] Updated weights for policy 0, policy_version 562909 (0.0008) [2023-12-26 04:04:45,989][123090] Updated weights for policy 1, policy_version 558752 (0.0010) [2023-12-26 04:04:46,010][123091] Updated weights for policy 0, policy_version 562919 (0.0007) [2023-12-26 04:04:46,652][123091] Updated weights for policy 0, policy_version 562929 (0.0008) [2023-12-26 04:04:46,686][123090] Updated weights for policy 1, policy_version 558762 (0.0006) [2023-12-26 04:04:46,702][123091] Updated weights for policy 0, policy_version 562939 (0.0005) [2023-12-26 04:04:46,746][123090] Updated weights for policy 1, policy_version 558772 (0.0005) [2023-12-26 04:04:46,748][123091] Updated weights for policy 0, policy_version 562949 (0.0005) [2023-12-26 04:04:46,810][123090] Updated weights for policy 1, policy_version 558782 (0.0005) [2023-12-26 04:04:46,811][123091] Updated weights for policy 0, policy_version 562959 (0.0009) [2023-12-26 04:04:47,429][123090] Updated weights for policy 1, policy_version 558792 (0.0005) [2023-12-26 04:04:47,481][123090] Updated weights for policy 1, policy_version 558802 (0.0005) [2023-12-26 04:04:47,542][123090] Updated weights for policy 1, policy_version 558812 (0.0005) [2023-12-26 04:04:47,679][123091] Updated weights for policy 0, policy_version 562969 (0.0010) [2023-12-26 04:04:47,745][123091] Updated weights for policy 0, policy_version 562979 (0.0011) [2023-12-26 04:04:47,814][123091] Updated weights for policy 0, policy_version 562989 (0.0011) [2023-12-26 04:04:48,172][123090] Updated weights for policy 1, policy_version 558822 (0.0007) [2023-12-26 04:04:48,219][123090] Updated weights for policy 1, policy_version 558832 (0.0010) [2023-12-26 04:04:48,271][123090] Updated weights for policy 1, policy_version 558842 (0.0010) [2023-12-26 04:04:48,598][123091] Updated weights for policy 0, policy_version 562999 (0.0010) [2023-12-26 04:04:48,656][123091] Updated weights for policy 0, policy_version 563009 (0.0009) [2023-12-26 04:04:48,726][123091] Updated weights for policy 0, policy_version 563019 (0.0008) [2023-12-26 04:04:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 287203328. Throughput: 0: 8896.2, 1: 8849.8. Samples: 287210932. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:48,784][121949] Avg episode reward: [(0, '6027.149'), (1, '5768.006')] [2023-12-26 04:04:49,131][123090] Updated weights for policy 1, policy_version 558852 (0.0010) [2023-12-26 04:04:49,194][123090] Updated weights for policy 1, policy_version 558862 (0.0010) [2023-12-26 04:04:49,260][123090] Updated weights for policy 1, policy_version 558872 (0.0010) [2023-12-26 04:04:49,573][123091] Updated weights for policy 0, policy_version 563029 (0.0010) [2023-12-26 04:04:49,632][123091] Updated weights for policy 0, policy_version 563039 (0.0009) [2023-12-26 04:04:49,684][123091] Updated weights for policy 0, policy_version 563049 (0.0009) [2023-12-26 04:04:50,149][123090] Updated weights for policy 1, policy_version 558882 (0.0011) [2023-12-26 04:04:50,209][123090] Updated weights for policy 1, policy_version 558892 (0.0010) [2023-12-26 04:04:50,272][123090] Updated weights for policy 1, policy_version 558902 (0.0010) [2023-12-26 04:04:50,340][123090] Updated weights for policy 1, policy_version 558912 (0.0010) [2023-12-26 04:04:50,529][123091] Updated weights for policy 0, policy_version 563059 (0.0009) [2023-12-26 04:04:50,601][123091] Updated weights for policy 0, policy_version 563069 (0.0009) [2023-12-26 04:04:50,669][123091] Updated weights for policy 0, policy_version 563079 (0.0011) [2023-12-26 04:04:51,186][123090] Updated weights for policy 1, policy_version 558922 (0.0011) [2023-12-26 04:04:51,259][123090] Updated weights for policy 1, policy_version 558932 (0.0011) [2023-12-26 04:04:51,331][123090] Updated weights for policy 1, policy_version 558942 (0.0011) [2023-12-26 04:04:51,377][123091] Updated weights for policy 0, policy_version 563089 (0.0007) [2023-12-26 04:04:51,426][123091] Updated weights for policy 0, policy_version 563099 (0.0010) [2023-12-26 04:04:51,470][123091] Updated weights for policy 0, policy_version 563109 (0.0010) [2023-12-26 04:04:51,514][123091] Updated weights for policy 0, policy_version 563119 (0.0010) [2023-12-26 04:04:52,138][123090] Updated weights for policy 1, policy_version 558952 (0.0006) [2023-12-26 04:04:52,194][123090] Updated weights for policy 1, policy_version 558962 (0.0006) [2023-12-26 04:04:52,252][123090] Updated weights for policy 1, policy_version 558972 (0.0008) [2023-12-26 04:04:52,347][123091] Updated weights for policy 0, policy_version 563129 (0.0007) [2023-12-26 04:04:52,415][123091] Updated weights for policy 0, policy_version 563139 (0.0011) [2023-12-26 04:04:52,470][123091] Updated weights for policy 0, policy_version 563149 (0.0008) [2023-12-26 04:04:53,076][123090] Updated weights for policy 1, policy_version 558982 (0.0010) [2023-12-26 04:04:53,130][123090] Updated weights for policy 1, policy_version 558992 (0.0010) [2023-12-26 04:04:53,183][123090] Updated weights for policy 1, policy_version 559002 (0.0009) [2023-12-26 04:04:53,213][123091] Updated weights for policy 0, policy_version 563159 (0.0007) [2023-12-26 04:04:53,261][123091] Updated weights for policy 0, policy_version 563169 (0.0011) [2023-12-26 04:04:53,313][123091] Updated weights for policy 0, policy_version 563179 (0.0011) [2023-12-26 04:04:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 287285248. Throughput: 0: 8922.8, 1: 8803.1. Samples: 287262168. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:53,785][121949] Avg episode reward: [(0, '6038.446'), (1, '5850.660')] [2023-12-26 04:04:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000563184_144179200.pth... [2023-12-26 04:04:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000559008_143106048.pth... [2023-12-26 04:04:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000562128_143908864.pth [2023-12-26 04:04:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000557984_142843904.pth [2023-12-26 04:04:53,912][123090] Updated weights for policy 1, policy_version 559012 (0.0009) [2023-12-26 04:04:53,959][123090] Updated weights for policy 1, policy_version 559022 (0.0010) [2023-12-26 04:04:54,007][123090] Updated weights for policy 1, policy_version 559032 (0.0010) [2023-12-26 04:04:54,047][123091] Updated weights for policy 0, policy_version 563189 (0.0011) [2023-12-26 04:04:54,105][123091] Updated weights for policy 0, policy_version 563199 (0.0011) [2023-12-26 04:04:54,172][123091] Updated weights for policy 0, policy_version 563209 (0.0010) [2023-12-26 04:04:54,729][123090] Updated weights for policy 1, policy_version 559042 (0.0009) [2023-12-26 04:04:54,782][123090] Updated weights for policy 1, policy_version 559052 (0.0006) [2023-12-26 04:04:54,830][123090] Updated weights for policy 1, policy_version 559062 (0.0006) [2023-12-26 04:04:54,888][123090] Updated weights for policy 1, policy_version 559072 (0.0009) [2023-12-26 04:04:54,932][123091] Updated weights for policy 0, policy_version 563219 (0.0008) [2023-12-26 04:04:54,980][123091] Updated weights for policy 0, policy_version 563229 (0.0005) [2023-12-26 04:04:55,044][123091] Updated weights for policy 0, policy_version 563239 (0.0005) [2023-12-26 04:04:55,589][123090] Updated weights for policy 1, policy_version 559082 (0.0009) [2023-12-26 04:04:55,636][123090] Updated weights for policy 1, policy_version 559092 (0.0008) [2023-12-26 04:04:55,692][123090] Updated weights for policy 1, policy_version 559102 (0.0010) [2023-12-26 04:04:55,821][123091] Updated weights for policy 0, policy_version 563249 (0.0005) [2023-12-26 04:04:55,878][123091] Updated weights for policy 0, policy_version 563259 (0.0005) [2023-12-26 04:04:55,934][123091] Updated weights for policy 0, policy_version 563269 (0.0007) [2023-12-26 04:04:55,993][123091] Updated weights for policy 0, policy_version 563279 (0.0009) [2023-12-26 04:04:56,514][123090] Updated weights for policy 1, policy_version 559113 (0.0009) [2023-12-26 04:04:56,582][123090] Updated weights for policy 1, policy_version 559123 (0.0010) [2023-12-26 04:04:56,606][123091] Updated weights for policy 0, policy_version 563289 (0.0006) [2023-12-26 04:04:56,634][123090] Updated weights for policy 1, policy_version 559133 (0.0010) [2023-12-26 04:04:56,656][123091] Updated weights for policy 0, policy_version 563299 (0.0006) [2023-12-26 04:04:56,707][123091] Updated weights for policy 0, policy_version 563309 (0.0010) [2023-12-26 04:04:57,409][123090] Updated weights for policy 1, policy_version 559143 (0.0009) [2023-12-26 04:04:57,463][123090] Updated weights for policy 1, policy_version 559153 (0.0010) [2023-12-26 04:04:57,483][123091] Updated weights for policy 0, policy_version 563319 (0.0008) [2023-12-26 04:04:57,529][123090] Updated weights for policy 1, policy_version 559163 (0.0010) [2023-12-26 04:04:57,545][123091] Updated weights for policy 0, policy_version 563329 (0.0005) [2023-12-26 04:04:57,605][123091] Updated weights for policy 0, policy_version 563339 (0.0007) [2023-12-26 04:04:58,290][123090] Updated weights for policy 1, policy_version 559173 (0.0010) [2023-12-26 04:04:58,360][123090] Updated weights for policy 1, policy_version 559183 (0.0008) [2023-12-26 04:04:58,414][123091] Updated weights for policy 0, policy_version 563349 (0.0008) [2023-12-26 04:04:58,430][123090] Updated weights for policy 1, policy_version 559193 (0.0008) [2023-12-26 04:04:58,480][123091] Updated weights for policy 0, policy_version 563359 (0.0008) [2023-12-26 04:04:58,548][123091] Updated weights for policy 0, policy_version 563369 (0.0008) [2023-12-26 04:04:58,786][121949] Fps is (10 sec: 18019.5, 60 sec: 17885.4, 300 sec: 17744.6). Total num frames: 287383552. Throughput: 0: 9022.8, 1: 8884.1. Samples: 287374496. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:04:58,786][121949] Avg episode reward: [(0, '6157.954'), (1, '5785.798')] [2023-12-26 04:04:59,303][123090] Updated weights for policy 1, policy_version 559203 (0.0008) [2023-12-26 04:04:59,376][123090] Updated weights for policy 1, policy_version 559213 (0.0008) [2023-12-26 04:04:59,422][123091] Updated weights for policy 0, policy_version 563379 (0.0008) [2023-12-26 04:04:59,434][123090] Updated weights for policy 1, policy_version 559223 (0.0008) [2023-12-26 04:04:59,479][123091] Updated weights for policy 0, policy_version 563389 (0.0009) [2023-12-26 04:04:59,546][123091] Updated weights for policy 0, policy_version 563399 (0.0009) [2023-12-26 04:05:00,276][123090] Updated weights for policy 1, policy_version 559233 (0.0008) [2023-12-26 04:05:00,346][123090] Updated weights for policy 1, policy_version 559243 (0.0010) [2023-12-26 04:05:00,368][123091] Updated weights for policy 0, policy_version 563409 (0.0008) [2023-12-26 04:05:00,414][123090] Updated weights for policy 1, policy_version 559253 (0.0007) [2023-12-26 04:05:00,439][123091] Updated weights for policy 0, policy_version 563419 (0.0008) [2023-12-26 04:05:00,478][123090] Updated weights for policy 1, policy_version 559263 (0.0007) [2023-12-26 04:05:00,504][123091] Updated weights for policy 0, policy_version 563429 (0.0009) [2023-12-26 04:05:00,571][123091] Updated weights for policy 0, policy_version 563439 (0.0009) [2023-12-26 04:05:01,249][123090] Updated weights for policy 1, policy_version 559273 (0.0010) [2023-12-26 04:05:01,315][123090] Updated weights for policy 1, policy_version 559283 (0.0011) [2023-12-26 04:05:01,331][123091] Updated weights for policy 0, policy_version 563449 (0.0008) [2023-12-26 04:05:01,377][123090] Updated weights for policy 1, policy_version 559293 (0.0009) [2023-12-26 04:05:01,393][123091] Updated weights for policy 0, policy_version 563459 (0.0007) [2023-12-26 04:05:01,439][123091] Updated weights for policy 0, policy_version 563469 (0.0006) [2023-12-26 04:05:02,158][123090] Updated weights for policy 1, policy_version 559303 (0.0009) [2023-12-26 04:05:02,185][123091] Updated weights for policy 0, policy_version 563479 (0.0008) [2023-12-26 04:05:02,223][123090] Updated weights for policy 1, policy_version 559313 (0.0006) [2023-12-26 04:05:02,251][123091] Updated weights for policy 0, policy_version 563489 (0.0009) [2023-12-26 04:05:02,291][123090] Updated weights for policy 1, policy_version 559323 (0.0007) [2023-12-26 04:05:02,313][123091] Updated weights for policy 0, policy_version 563499 (0.0008) [2023-12-26 04:05:03,057][123091] Updated weights for policy 0, policy_version 563509 (0.0007) [2023-12-26 04:05:03,096][123090] Updated weights for policy 1, policy_version 559333 (0.0008) [2023-12-26 04:05:03,120][123091] Updated weights for policy 0, policy_version 563519 (0.0005) [2023-12-26 04:05:03,149][123090] Updated weights for policy 1, policy_version 559343 (0.0009) [2023-12-26 04:05:03,173][123091] Updated weights for policy 0, policy_version 563529 (0.0005) [2023-12-26 04:05:03,201][123090] Updated weights for policy 1, policy_version 559353 (0.0008) [2023-12-26 04:05:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 287465472. Throughput: 0: 8958.9, 1: 8819.2. Samples: 287479232. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:05:03,785][121949] Avg episode reward: [(0, '6195.237'), (1, '5663.646')] [2023-12-26 04:05:03,959][123091] Updated weights for policy 0, policy_version 563539 (0.0008) [2023-12-26 04:05:03,999][123090] Updated weights for policy 1, policy_version 559363 (0.0006) [2023-12-26 04:05:04,015][123091] Updated weights for policy 0, policy_version 563549 (0.0011) [2023-12-26 04:05:04,051][123090] Updated weights for policy 1, policy_version 559373 (0.0005) [2023-12-26 04:05:04,067][123091] Updated weights for policy 0, policy_version 563559 (0.0011) [2023-12-26 04:05:04,104][123090] Updated weights for policy 1, policy_version 559383 (0.0005) [2023-12-26 04:05:04,874][123090] Updated weights for policy 1, policy_version 559393 (0.0009) [2023-12-26 04:05:04,906][123091] Updated weights for policy 0, policy_version 563569 (0.0011) [2023-12-26 04:05:04,935][123090] Updated weights for policy 1, policy_version 559403 (0.0005) [2023-12-26 04:05:04,976][123091] Updated weights for policy 0, policy_version 563579 (0.0011) [2023-12-26 04:05:04,997][123090] Updated weights for policy 1, policy_version 559413 (0.0006) [2023-12-26 04:05:05,039][123091] Updated weights for policy 0, policy_version 563589 (0.0011) [2023-12-26 04:05:05,050][123090] Updated weights for policy 1, policy_version 559423 (0.0006) [2023-12-26 04:05:05,087][123091] Updated weights for policy 0, policy_version 563599 (0.0008) [2023-12-26 04:05:05,775][123091] Updated weights for policy 0, policy_version 563609 (0.0010) [2023-12-26 04:05:05,838][123091] Updated weights for policy 0, policy_version 563619 (0.0011) [2023-12-26 04:05:05,894][123090] Updated weights for policy 1, policy_version 559433 (0.0009) [2023-12-26 04:05:05,902][123091] Updated weights for policy 0, policy_version 563629 (0.0006) [2023-12-26 04:05:05,957][123090] Updated weights for policy 1, policy_version 559443 (0.0009) [2023-12-26 04:05:06,021][123090] Updated weights for policy 1, policy_version 559453 (0.0010) [2023-12-26 04:05:06,600][123091] Updated weights for policy 0, policy_version 563639 (0.0006) [2023-12-26 04:05:06,663][123091] Updated weights for policy 0, policy_version 563649 (0.0006) [2023-12-26 04:05:06,725][123091] Updated weights for policy 0, policy_version 563659 (0.0009) [2023-12-26 04:05:06,977][123090] Updated weights for policy 1, policy_version 559463 (0.0010) [2023-12-26 04:05:07,037][123090] Updated weights for policy 1, policy_version 559473 (0.0006) [2023-12-26 04:05:07,103][123090] Updated weights for policy 1, policy_version 559483 (0.0005) [2023-12-26 04:05:07,569][123091] Updated weights for policy 0, policy_version 563669 (0.0010) [2023-12-26 04:05:07,630][123091] Updated weights for policy 0, policy_version 563679 (0.0010) [2023-12-26 04:05:07,683][123091] Updated weights for policy 0, policy_version 563689 (0.0009) [2023-12-26 04:05:07,766][123090] Updated weights for policy 1, policy_version 559493 (0.0007) [2023-12-26 04:05:07,819][123090] Updated weights for policy 1, policy_version 559503 (0.0009) [2023-12-26 04:05:07,870][123090] Updated weights for policy 1, policy_version 559513 (0.0009) [2023-12-26 04:05:08,533][123091] Updated weights for policy 0, policy_version 563699 (0.0009) [2023-12-26 04:05:08,595][123091] Updated weights for policy 0, policy_version 563709 (0.0009) [2023-12-26 04:05:08,646][123091] Updated weights for policy 0, policy_version 563719 (0.0010) [2023-12-26 04:05:08,678][123090] Updated weights for policy 1, policy_version 559523 (0.0010) [2023-12-26 04:05:08,740][123090] Updated weights for policy 1, policy_version 559533 (0.0009) [2023-12-26 04:05:08,784][121949] Fps is (10 sec: 17205.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 287555584. Throughput: 0: 8976.0, 1: 8820.4. Samples: 287532528. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:05:08,785][121949] Avg episode reward: [(0, '6232.006'), (1, '5770.522')] [2023-12-26 04:05:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000563728_144318464.pth... [2023-12-26 04:05:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000562672_144048128.pth [2023-12-26 04:05:08,797][123090] Updated weights for policy 1, policy_version 559543 (0.0009) [2023-12-26 04:05:08,858][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000559552_143245312.pth... [2023-12-26 04:05:08,861][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000558496_142974976.pth [2023-12-26 04:05:09,507][123091] Updated weights for policy 0, policy_version 563729 (0.0009) [2023-12-26 04:05:09,573][123091] Updated weights for policy 0, policy_version 563739 (0.0009) [2023-12-26 04:05:09,639][123091] Updated weights for policy 0, policy_version 563749 (0.0009) [2023-12-26 04:05:09,689][123090] Updated weights for policy 1, policy_version 559553 (0.0009) [2023-12-26 04:05:09,703][123091] Updated weights for policy 0, policy_version 563759 (0.0010) [2023-12-26 04:05:09,749][123090] Updated weights for policy 1, policy_version 559563 (0.0011) [2023-12-26 04:05:09,820][123090] Updated weights for policy 1, policy_version 559573 (0.0011) [2023-12-26 04:05:09,884][123090] Updated weights for policy 1, policy_version 559583 (0.0011) [2023-12-26 04:05:10,531][123091] Updated weights for policy 0, policy_version 563769 (0.0009) [2023-12-26 04:05:10,584][123091] Updated weights for policy 0, policy_version 563779 (0.0009) [2023-12-26 04:05:10,632][123091] Updated weights for policy 0, policy_version 563789 (0.0009) [2023-12-26 04:05:10,744][123090] Updated weights for policy 1, policy_version 559593 (0.0010) [2023-12-26 04:05:10,796][123090] Updated weights for policy 1, policy_version 559603 (0.0010) [2023-12-26 04:05:10,848][123090] Updated weights for policy 1, policy_version 559613 (0.0010) [2023-12-26 04:05:11,573][123091] Updated weights for policy 0, policy_version 563799 (0.0009) [2023-12-26 04:05:11,643][123091] Updated weights for policy 0, policy_version 563809 (0.0008) [2023-12-26 04:05:11,717][123091] Updated weights for policy 0, policy_version 563819 (0.0009) [2023-12-26 04:05:11,732][123090] Updated weights for policy 1, policy_version 559623 (0.0011) [2023-12-26 04:05:11,797][123090] Updated weights for policy 1, policy_version 559633 (0.0011) [2023-12-26 04:05:11,850][123090] Updated weights for policy 1, policy_version 559643 (0.0011) [2023-12-26 04:05:12,598][123091] Updated weights for policy 0, policy_version 563829 (0.0006) [2023-12-26 04:05:12,654][123091] Updated weights for policy 0, policy_version 563839 (0.0008) [2023-12-26 04:05:12,719][123091] Updated weights for policy 0, policy_version 563849 (0.0008) [2023-12-26 04:05:12,745][123090] Updated weights for policy 1, policy_version 559653 (0.0011) [2023-12-26 04:05:12,797][123090] Updated weights for policy 1, policy_version 559663 (0.0010) [2023-12-26 04:05:12,854][123090] Updated weights for policy 1, policy_version 559673 (0.0011) [2023-12-26 04:05:13,562][123091] Updated weights for policy 0, policy_version 563859 (0.0009) [2023-12-26 04:05:13,636][123091] Updated weights for policy 0, policy_version 563869 (0.0010) [2023-12-26 04:05:13,641][123090] Updated weights for policy 1, policy_version 559683 (0.0009) [2023-12-26 04:05:13,700][123090] Updated weights for policy 1, policy_version 559693 (0.0005) [2023-12-26 04:05:13,702][123091] Updated weights for policy 0, policy_version 563879 (0.0010) [2023-12-26 04:05:13,765][123090] Updated weights for policy 1, policy_version 559703 (0.0005) [2023-12-26 04:05:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 287637504. Throughput: 0: 8854.5, 1: 8833.2. Samples: 287632804. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:05:13,785][121949] Avg episode reward: [(0, '6196.875'), (1, '5908.665')] [2023-12-26 04:05:14,408][123090] Updated weights for policy 1, policy_version 559713 (0.0006) [2023-12-26 04:05:14,463][123090] Updated weights for policy 1, policy_version 559723 (0.0006) [2023-12-26 04:05:14,514][123090] Updated weights for policy 1, policy_version 559733 (0.0006) [2023-12-26 04:05:14,578][123090] Updated weights for policy 1, policy_version 559743 (0.0006) [2023-12-26 04:05:14,586][123091] Updated weights for policy 0, policy_version 563889 (0.0009) [2023-12-26 04:05:14,651][123091] Updated weights for policy 0, policy_version 563899 (0.0010) [2023-12-26 04:05:14,722][123091] Updated weights for policy 0, policy_version 563909 (0.0010) [2023-12-26 04:05:14,791][123091] Updated weights for policy 0, policy_version 563919 (0.0008) [2023-12-26 04:05:15,360][123090] Updated weights for policy 1, policy_version 559753 (0.0008) [2023-12-26 04:05:15,417][123090] Updated weights for policy 1, policy_version 559763 (0.0010) [2023-12-26 04:05:15,471][123090] Updated weights for policy 1, policy_version 559774 (0.0010) [2023-12-26 04:05:15,603][123091] Updated weights for policy 0, policy_version 563929 (0.0009) [2023-12-26 04:05:15,670][123091] Updated weights for policy 0, policy_version 563939 (0.0009) [2023-12-26 04:05:15,734][123091] Updated weights for policy 0, policy_version 563949 (0.0010) [2023-12-26 04:05:16,343][123090] Updated weights for policy 1, policy_version 559784 (0.0009) [2023-12-26 04:05:16,399][123090] Updated weights for policy 1, policy_version 559794 (0.0009) [2023-12-26 04:05:16,456][123090] Updated weights for policy 1, policy_version 559804 (0.0010) [2023-12-26 04:05:16,542][123091] Updated weights for policy 0, policy_version 563959 (0.0010) [2023-12-26 04:05:16,607][123091] Updated weights for policy 0, policy_version 563969 (0.0009) [2023-12-26 04:05:16,692][123091] Updated weights for policy 0, policy_version 563979 (0.0009) [2023-12-26 04:05:17,219][123090] Updated weights for policy 1, policy_version 559814 (0.0007) [2023-12-26 04:05:17,292][123090] Updated weights for policy 1, policy_version 559824 (0.0005) [2023-12-26 04:05:17,361][123090] Updated weights for policy 1, policy_version 559834 (0.0006) [2023-12-26 04:05:17,556][123091] Updated weights for policy 0, policy_version 563989 (0.0009) [2023-12-26 04:05:17,609][123091] Updated weights for policy 0, policy_version 563999 (0.0009) [2023-12-26 04:05:17,667][123091] Updated weights for policy 0, policy_version 564009 (0.0009) [2023-12-26 04:05:18,033][123090] Updated weights for policy 1, policy_version 559844 (0.0007) [2023-12-26 04:05:18,082][123090] Updated weights for policy 1, policy_version 559854 (0.0008) [2023-12-26 04:05:18,138][123090] Updated weights for policy 1, policy_version 559864 (0.0010) [2023-12-26 04:05:18,514][123091] Updated weights for policy 0, policy_version 564019 (0.0010) [2023-12-26 04:05:18,576][123091] Updated weights for policy 0, policy_version 564029 (0.0010) [2023-12-26 04:05:18,644][123091] Updated weights for policy 0, policy_version 564039 (0.0009) [2023-12-26 04:05:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 287727616. Throughput: 0: 8737.9, 1: 8841.3. Samples: 287736708. Policy #0 lag: (min: 7.0, avg: 9.7, max: 39.0) [2023-12-26 04:05:18,785][121949] Avg episode reward: [(0, '6156.348'), (1, '5892.555')] [2023-12-26 04:05:18,994][123090] Updated weights for policy 1, policy_version 559874 (0.0009) [2023-12-26 04:05:19,056][123090] Updated weights for policy 1, policy_version 559884 (0.0009) [2023-12-26 04:05:19,124][123090] Updated weights for policy 1, policy_version 559894 (0.0009) [2023-12-26 04:05:19,191][123090] Updated weights for policy 1, policy_version 559904 (0.0007) [2023-12-26 04:05:19,503][123091] Updated weights for policy 0, policy_version 564049 (0.0009) [2023-12-26 04:05:19,562][123091] Updated weights for policy 0, policy_version 564059 (0.0010) [2023-12-26 04:05:19,622][123091] Updated weights for policy 0, policy_version 564069 (0.0010) [2023-12-26 04:05:19,680][123091] Updated weights for policy 0, policy_version 564079 (0.0009) [2023-12-26 04:05:20,023][123090] Updated weights for policy 1, policy_version 559914 (0.0010) [2023-12-26 04:05:20,086][123090] Updated weights for policy 1, policy_version 559924 (0.0009) [2023-12-26 04:05:20,157][123090] Updated weights for policy 1, policy_version 559934 (0.0010) [2023-12-26 04:05:20,527][123091] Updated weights for policy 0, policy_version 564089 (0.0010) [2023-12-26 04:05:20,595][123091] Updated weights for policy 0, policy_version 564100 (0.0009) [2023-12-26 04:05:20,663][123091] Updated weights for policy 0, policy_version 564110 (0.0010) [2023-12-26 04:05:21,006][123090] Updated weights for policy 1, policy_version 559944 (0.0009) [2023-12-26 04:05:21,076][123090] Updated weights for policy 1, policy_version 559954 (0.0010) [2023-12-26 04:05:21,133][123090] Updated weights for policy 1, policy_version 559964 (0.0010) [2023-12-26 04:05:21,533][123091] Updated weights for policy 0, policy_version 564120 (0.0010) [2023-12-26 04:05:21,586][123091] Updated weights for policy 0, policy_version 564130 (0.0005) [2023-12-26 04:05:21,651][123091] Updated weights for policy 0, policy_version 564140 (0.0008) [2023-12-26 04:05:22,018][123090] Updated weights for policy 1, policy_version 559974 (0.0010) [2023-12-26 04:05:22,081][123090] Updated weights for policy 1, policy_version 559984 (0.0010) [2023-12-26 04:05:22,138][123090] Updated weights for policy 1, policy_version 559994 (0.0010) [2023-12-26 04:05:22,469][123091] Updated weights for policy 0, policy_version 564150 (0.0010) [2023-12-26 04:05:22,538][123091] Updated weights for policy 0, policy_version 564160 (0.0009) [2023-12-26 04:05:22,608][123091] Updated weights for policy 0, policy_version 564170 (0.0005) [2023-12-26 04:05:23,055][123090] Updated weights for policy 1, policy_version 560004 (0.0010) [2023-12-26 04:05:23,107][123090] Updated weights for policy 1, policy_version 560014 (0.0009) [2023-12-26 04:05:23,159][123090] Updated weights for policy 1, policy_version 560024 (0.0009) [2023-12-26 04:05:23,303][123091] Updated weights for policy 0, policy_version 564180 (0.0007) [2023-12-26 04:05:23,366][123091] Updated weights for policy 0, policy_version 564190 (0.0010) [2023-12-26 04:05:23,426][123091] Updated weights for policy 0, policy_version 564200 (0.0010) [2023-12-26 04:05:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 287809536. Throughput: 0: 8729.1, 1: 8746.9. Samples: 287786268. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:23,785][121949] Avg episode reward: [(0, '6134.975'), (1, '5865.174')] [2023-12-26 04:05:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000564208_144441344.pth... [2023-12-26 04:05:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000560032_143368192.pth... [2023-12-26 04:05:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000559008_143106048.pth [2023-12-26 04:05:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000563184_144179200.pth [2023-12-26 04:05:23,996][123090] Updated weights for policy 1, policy_version 560034 (0.0009) [2023-12-26 04:05:24,052][123090] Updated weights for policy 1, policy_version 560044 (0.0010) [2023-12-26 04:05:24,118][123090] Updated weights for policy 1, policy_version 560054 (0.0009) [2023-12-26 04:05:24,178][123090] Updated weights for policy 1, policy_version 560064 (0.0010) [2023-12-26 04:05:24,252][123091] Updated weights for policy 0, policy_version 564210 (0.0010) [2023-12-26 04:05:24,311][123091] Updated weights for policy 0, policy_version 564220 (0.0009) [2023-12-26 04:05:24,362][123091] Updated weights for policy 0, policy_version 564230 (0.0009) [2023-12-26 04:05:24,415][123091] Updated weights for policy 0, policy_version 564240 (0.0010) [2023-12-26 04:05:24,921][123090] Updated weights for policy 1, policy_version 560074 (0.0009) [2023-12-26 04:05:24,974][123090] Updated weights for policy 1, policy_version 560084 (0.0010) [2023-12-26 04:05:25,029][123090] Updated weights for policy 1, policy_version 560094 (0.0009) [2023-12-26 04:05:25,107][123091] Updated weights for policy 0, policy_version 564250 (0.0005) [2023-12-26 04:05:25,171][123091] Updated weights for policy 0, policy_version 564260 (0.0006) [2023-12-26 04:05:25,222][123091] Updated weights for policy 0, policy_version 564270 (0.0005) [2023-12-26 04:05:25,849][123090] Updated weights for policy 1, policy_version 560104 (0.0009) [2023-12-26 04:05:25,895][123090] Updated weights for policy 1, policy_version 560114 (0.0009) [2023-12-26 04:05:25,907][123091] Updated weights for policy 0, policy_version 564280 (0.0007) [2023-12-26 04:05:25,947][123090] Updated weights for policy 1, policy_version 560124 (0.0010) [2023-12-26 04:05:25,958][123091] Updated weights for policy 0, policy_version 564290 (0.0007) [2023-12-26 04:05:26,018][123091] Updated weights for policy 0, policy_version 564300 (0.0009) [2023-12-26 04:05:26,673][123090] Updated weights for policy 1, policy_version 560134 (0.0009) [2023-12-26 04:05:26,731][123090] Updated weights for policy 1, policy_version 560145 (0.0010) [2023-12-26 04:05:26,783][123090] Updated weights for policy 1, policy_version 560155 (0.0009) [2023-12-26 04:05:26,838][123091] Updated weights for policy 0, policy_version 564310 (0.0009) [2023-12-26 04:05:26,903][123091] Updated weights for policy 0, policy_version 564320 (0.0006) [2023-12-26 04:05:26,969][123091] Updated weights for policy 0, policy_version 564330 (0.0008) [2023-12-26 04:05:27,642][123090] Updated weights for policy 1, policy_version 560165 (0.0009) [2023-12-26 04:05:27,692][123090] Updated weights for policy 1, policy_version 560176 (0.0010) [2023-12-26 04:05:27,753][123090] Updated weights for policy 1, policy_version 560186 (0.0009) [2023-12-26 04:05:27,775][123091] Updated weights for policy 0, policy_version 564340 (0.0009) [2023-12-26 04:05:27,825][123091] Updated weights for policy 0, policy_version 564350 (0.0008) [2023-12-26 04:05:27,879][123091] Updated weights for policy 0, policy_version 564360 (0.0010) [2023-12-26 04:05:28,601][123090] Updated weights for policy 1, policy_version 560196 (0.0009) [2023-12-26 04:05:28,654][123090] Updated weights for policy 1, policy_version 560206 (0.0010) [2023-12-26 04:05:28,705][123091] Updated weights for policy 0, policy_version 564370 (0.0009) [2023-12-26 04:05:28,715][123090] Updated weights for policy 1, policy_version 560216 (0.0009) [2023-12-26 04:05:28,758][123091] Updated weights for policy 0, policy_version 564380 (0.0009) [2023-12-26 04:05:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 287899648. Throughput: 0: 8811.4, 1: 8792.7. Samples: 287893920. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:28,784][121949] Avg episode reward: [(0, '6042.363'), (1, '5792.992')] [2023-12-26 04:05:28,825][123091] Updated weights for policy 0, policy_version 564390 (0.0009) [2023-12-26 04:05:28,882][123091] Updated weights for policy 0, policy_version 564400 (0.0009) [2023-12-26 04:05:29,529][123090] Updated weights for policy 1, policy_version 560226 (0.0007) [2023-12-26 04:05:29,596][123090] Updated weights for policy 1, policy_version 560236 (0.0009) [2023-12-26 04:05:29,648][123090] Updated weights for policy 1, policy_version 560246 (0.0009) [2023-12-26 04:05:29,702][123090] Updated weights for policy 1, policy_version 560256 (0.0008) [2023-12-26 04:05:29,723][123091] Updated weights for policy 0, policy_version 564410 (0.0005) [2023-12-26 04:05:29,781][123091] Updated weights for policy 0, policy_version 564420 (0.0007) [2023-12-26 04:05:29,847][123091] Updated weights for policy 0, policy_version 564430 (0.0008) [2023-12-26 04:05:30,543][123090] Updated weights for policy 1, policy_version 560266 (0.0009) [2023-12-26 04:05:30,596][123090] Updated weights for policy 1, policy_version 560276 (0.0009) [2023-12-26 04:05:30,648][123091] Updated weights for policy 0, policy_version 564440 (0.0010) [2023-12-26 04:05:30,660][123090] Updated weights for policy 1, policy_version 560286 (0.0008) [2023-12-26 04:05:30,703][123091] Updated weights for policy 0, policy_version 564450 (0.0009) [2023-12-26 04:05:30,779][123091] Updated weights for policy 0, policy_version 564460 (0.0007) [2023-12-26 04:05:31,495][123090] Updated weights for policy 1, policy_version 560296 (0.0009) [2023-12-26 04:05:31,554][123090] Updated weights for policy 1, policy_version 560306 (0.0010) [2023-12-26 04:05:31,599][123091] Updated weights for policy 0, policy_version 564470 (0.0009) [2023-12-26 04:05:31,622][123090] Updated weights for policy 1, policy_version 560316 (0.0006) [2023-12-26 04:05:31,663][123091] Updated weights for policy 0, policy_version 564480 (0.0009) [2023-12-26 04:05:31,724][123091] Updated weights for policy 0, policy_version 564490 (0.0009) [2023-12-26 04:05:32,322][123090] Updated weights for policy 1, policy_version 560326 (0.0009) [2023-12-26 04:05:32,380][123090] Updated weights for policy 1, policy_version 560336 (0.0009) [2023-12-26 04:05:32,428][123090] Updated weights for policy 1, policy_version 560346 (0.0009) [2023-12-26 04:05:32,565][123091] Updated weights for policy 0, policy_version 564500 (0.0008) [2023-12-26 04:05:32,629][123091] Updated weights for policy 0, policy_version 564510 (0.0005) [2023-12-26 04:05:32,687][123091] Updated weights for policy 0, policy_version 564520 (0.0006) [2023-12-26 04:05:33,317][123090] Updated weights for policy 1, policy_version 560356 (0.0010) [2023-12-26 04:05:33,378][123090] Updated weights for policy 1, policy_version 560366 (0.0010) [2023-12-26 04:05:33,440][123090] Updated weights for policy 1, policy_version 560376 (0.0010) [2023-12-26 04:05:33,442][123091] Updated weights for policy 0, policy_version 564530 (0.0006) [2023-12-26 04:05:33,501][123091] Updated weights for policy 0, policy_version 564540 (0.0006) [2023-12-26 04:05:33,556][123091] Updated weights for policy 0, policy_version 564550 (0.0006) [2023-12-26 04:05:33,612][123091] Updated weights for policy 0, policy_version 564560 (0.0006) [2023-12-26 04:05:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 287989760. Throughput: 0: 8771.3, 1: 8700.0. Samples: 287997140. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:33,785][121949] Avg episode reward: [(0, '6073.755'), (1, '5787.078')] [2023-12-26 04:05:34,262][123091] Updated weights for policy 0, policy_version 564570 (0.0010) [2023-12-26 04:05:34,289][123090] Updated weights for policy 1, policy_version 560386 (0.0009) [2023-12-26 04:05:34,326][123091] Updated weights for policy 0, policy_version 564580 (0.0009) [2023-12-26 04:05:34,354][123090] Updated weights for policy 1, policy_version 560396 (0.0007) [2023-12-26 04:05:34,387][123091] Updated weights for policy 0, policy_version 564590 (0.0009) [2023-12-26 04:05:34,415][123090] Updated weights for policy 1, policy_version 560406 (0.0009) [2023-12-26 04:05:34,480][123090] Updated weights for policy 1, policy_version 560416 (0.0008) [2023-12-26 04:05:35,175][123091] Updated weights for policy 0, policy_version 564600 (0.0009) [2023-12-26 04:05:35,224][123091] Updated weights for policy 0, policy_version 564610 (0.0009) [2023-12-26 04:05:35,282][123091] Updated weights for policy 0, policy_version 564620 (0.0009) [2023-12-26 04:05:35,310][123090] Updated weights for policy 1, policy_version 560426 (0.0005) [2023-12-26 04:05:35,378][123090] Updated weights for policy 1, policy_version 560436 (0.0005) [2023-12-26 04:05:35,423][123090] Updated weights for policy 1, policy_version 560446 (0.0008) [2023-12-26 04:05:36,163][123091] Updated weights for policy 0, policy_version 564630 (0.0008) [2023-12-26 04:05:36,174][123090] Updated weights for policy 1, policy_version 560456 (0.0008) [2023-12-26 04:05:36,228][123091] Updated weights for policy 0, policy_version 564640 (0.0007) [2023-12-26 04:05:36,232][123090] Updated weights for policy 1, policy_version 560466 (0.0006) [2023-12-26 04:05:36,291][123091] Updated weights for policy 0, policy_version 564650 (0.0009) [2023-12-26 04:05:36,293][123090] Updated weights for policy 1, policy_version 560476 (0.0006) [2023-12-26 04:05:37,050][123090] Updated weights for policy 1, policy_version 560486 (0.0007) [2023-12-26 04:05:37,065][123091] Updated weights for policy 0, policy_version 564660 (0.0007) [2023-12-26 04:05:37,123][123091] Updated weights for policy 0, policy_version 564670 (0.0009) [2023-12-26 04:05:37,123][123090] Updated weights for policy 1, policy_version 560496 (0.0006) [2023-12-26 04:05:37,173][123091] Updated weights for policy 0, policy_version 564680 (0.0009) [2023-12-26 04:05:37,196][123090] Updated weights for policy 1, policy_version 560506 (0.0005) [2023-12-26 04:05:37,834][123090] Updated weights for policy 1, policy_version 560516 (0.0007) [2023-12-26 04:05:37,889][123090] Updated weights for policy 1, policy_version 560526 (0.0010) [2023-12-26 04:05:37,953][123090] Updated weights for policy 1, policy_version 560536 (0.0009) [2023-12-26 04:05:38,046][123091] Updated weights for policy 0, policy_version 564690 (0.0009) [2023-12-26 04:05:38,110][123091] Updated weights for policy 0, policy_version 564700 (0.0009) [2023-12-26 04:05:38,169][123091] Updated weights for policy 0, policy_version 564710 (0.0010) [2023-12-26 04:05:38,226][123091] Updated weights for policy 0, policy_version 564720 (0.0009) [2023-12-26 04:05:38,764][123090] Updated weights for policy 1, policy_version 560546 (0.0010) [2023-12-26 04:05:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 288071680. Throughput: 0: 8786.0, 1: 8742.9. Samples: 288050964. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:38,785][121949] Avg episode reward: [(0, '6125.250'), (1, '5796.351')] [2023-12-26 04:05:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000564720_144572416.pth... [2023-12-26 04:05:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000563728_144318464.pth [2023-12-26 04:05:38,824][123090] Updated weights for policy 1, policy_version 560556 (0.0010) [2023-12-26 04:05:38,897][123090] Updated weights for policy 1, policy_version 560566 (0.0009) [2023-12-26 04:05:38,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000560576_143507456.pth... [2023-12-26 04:05:38,967][123090] Updated weights for policy 1, policy_version 560576 (0.0010) [2023-12-26 04:05:38,971][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000559552_143245312.pth [2023-12-26 04:05:39,077][123091] Updated weights for policy 0, policy_version 564730 (0.0007) [2023-12-26 04:05:39,149][123091] Updated weights for policy 0, policy_version 564740 (0.0005) [2023-12-26 04:05:39,212][123091] Updated weights for policy 0, policy_version 564750 (0.0008) [2023-12-26 04:05:39,828][123090] Updated weights for policy 1, policy_version 560586 (0.0009) [2023-12-26 04:05:39,899][123090] Updated weights for policy 1, policy_version 560596 (0.0009) [2023-12-26 04:05:39,971][123090] Updated weights for policy 1, policy_version 560606 (0.0009) [2023-12-26 04:05:40,062][123091] Updated weights for policy 0, policy_version 564760 (0.0009) [2023-12-26 04:05:40,134][123091] Updated weights for policy 0, policy_version 564770 (0.0010) [2023-12-26 04:05:40,206][123091] Updated weights for policy 0, policy_version 564780 (0.0010) [2023-12-26 04:05:40,622][123090] Updated weights for policy 1, policy_version 560616 (0.0006) [2023-12-26 04:05:40,677][123090] Updated weights for policy 1, policy_version 560626 (0.0005) [2023-12-26 04:05:40,737][123090] Updated weights for policy 1, policy_version 560636 (0.0005) [2023-12-26 04:05:41,087][123091] Updated weights for policy 0, policy_version 564790 (0.0011) [2023-12-26 04:05:41,160][123091] Updated weights for policy 0, policy_version 564800 (0.0011) [2023-12-26 04:05:41,219][123091] Updated weights for policy 0, policy_version 564810 (0.0011) [2023-12-26 04:05:41,516][123090] Updated weights for policy 1, policy_version 560646 (0.0007) [2023-12-26 04:05:41,572][123090] Updated weights for policy 1, policy_version 560656 (0.0008) [2023-12-26 04:05:41,637][123090] Updated weights for policy 1, policy_version 560666 (0.0008) [2023-12-26 04:05:42,059][123091] Updated weights for policy 0, policy_version 564820 (0.0010) [2023-12-26 04:05:42,137][123091] Updated weights for policy 0, policy_version 564830 (0.0009) [2023-12-26 04:05:42,199][123091] Updated weights for policy 0, policy_version 564840 (0.0010) [2023-12-26 04:05:42,391][123090] Updated weights for policy 1, policy_version 560676 (0.0007) [2023-12-26 04:05:42,459][123090] Updated weights for policy 1, policy_version 560686 (0.0008) [2023-12-26 04:05:42,520][123090] Updated weights for policy 1, policy_version 560696 (0.0010) [2023-12-26 04:05:43,045][123091] Updated weights for policy 0, policy_version 564850 (0.0010) [2023-12-26 04:05:43,111][123091] Updated weights for policy 0, policy_version 564860 (0.0010) [2023-12-26 04:05:43,174][123091] Updated weights for policy 0, policy_version 564870 (0.0010) [2023-12-26 04:05:43,241][123091] Updated weights for policy 0, policy_version 564880 (0.0010) [2023-12-26 04:05:43,302][123090] Updated weights for policy 1, policy_version 560706 (0.0009) [2023-12-26 04:05:43,366][123090] Updated weights for policy 1, policy_version 560716 (0.0008) [2023-12-26 04:05:43,432][123090] Updated weights for policy 1, policy_version 560726 (0.0009) [2023-12-26 04:05:43,497][123090] Updated weights for policy 1, policy_version 560736 (0.0009) [2023-12-26 04:05:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 288161792. Throughput: 0: 8601.4, 1: 8735.8. Samples: 288154644. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:43,785][121949] Avg episode reward: [(0, '6162.532'), (1, '5801.826')] [2023-12-26 04:05:44,050][123091] Updated weights for policy 0, policy_version 564890 (0.0009) [2023-12-26 04:05:44,115][123091] Updated weights for policy 0, policy_version 564900 (0.0009) [2023-12-26 04:05:44,180][123091] Updated weights for policy 0, policy_version 564910 (0.0010) [2023-12-26 04:05:44,304][123090] Updated weights for policy 1, policy_version 560746 (0.0009) [2023-12-26 04:05:44,374][123090] Updated weights for policy 1, policy_version 560756 (0.0009) [2023-12-26 04:05:44,443][123090] Updated weights for policy 1, policy_version 560766 (0.0009) [2023-12-26 04:05:44,982][123091] Updated weights for policy 0, policy_version 564920 (0.0007) [2023-12-26 04:05:45,044][123091] Updated weights for policy 0, policy_version 564930 (0.0005) [2023-12-26 04:05:45,102][123091] Updated weights for policy 0, policy_version 564940 (0.0006) [2023-12-26 04:05:45,288][123090] Updated weights for policy 1, policy_version 560776 (0.0009) [2023-12-26 04:05:45,363][123090] Updated weights for policy 1, policy_version 560786 (0.0009) [2023-12-26 04:05:45,424][123090] Updated weights for policy 1, policy_version 560796 (0.0009) [2023-12-26 04:05:45,936][123091] Updated weights for policy 0, policy_version 564950 (0.0008) [2023-12-26 04:05:45,994][123091] Updated weights for policy 0, policy_version 564960 (0.0005) [2023-12-26 04:05:46,054][123091] Updated weights for policy 0, policy_version 564970 (0.0008) [2023-12-26 04:05:46,247][123090] Updated weights for policy 1, policy_version 560806 (0.0007) [2023-12-26 04:05:46,319][123090] Updated weights for policy 1, policy_version 560816 (0.0006) [2023-12-26 04:05:46,388][123090] Updated weights for policy 1, policy_version 560826 (0.0006) [2023-12-26 04:05:46,920][123091] Updated weights for policy 0, policy_version 564980 (0.0009) [2023-12-26 04:05:46,980][123091] Updated weights for policy 0, policy_version 564990 (0.0010) [2023-12-26 04:05:47,050][123091] Updated weights for policy 0, policy_version 565001 (0.0010) [2023-12-26 04:05:47,108][123090] Updated weights for policy 1, policy_version 560836 (0.0007) [2023-12-26 04:05:47,163][123090] Updated weights for policy 1, policy_version 560847 (0.0010) [2023-12-26 04:05:47,216][123090] Updated weights for policy 1, policy_version 560857 (0.0009) [2023-12-26 04:05:47,925][123091] Updated weights for policy 0, policy_version 565011 (0.0010) [2023-12-26 04:05:47,938][123090] Updated weights for policy 1, policy_version 560867 (0.0006) [2023-12-26 04:05:47,977][123091] Updated weights for policy 0, policy_version 565021 (0.0009) [2023-12-26 04:05:47,991][123090] Updated weights for policy 1, policy_version 560877 (0.0006) [2023-12-26 04:05:48,044][123091] Updated weights for policy 0, policy_version 565031 (0.0008) [2023-12-26 04:05:48,056][123090] Updated weights for policy 1, policy_version 560887 (0.0008) [2023-12-26 04:05:48,768][123090] Updated weights for policy 1, policy_version 560897 (0.0010) [2023-12-26 04:05:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 288243712. Throughput: 0: 8545.0, 1: 8793.7. Samples: 288259472. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:48,785][121949] Avg episode reward: [(0, '6154.143'), (1, '5583.333')] [2023-12-26 04:05:48,819][123090] Updated weights for policy 1, policy_version 560907 (0.0010) [2023-12-26 04:05:48,871][123091] Updated weights for policy 0, policy_version 565041 (0.0010) [2023-12-26 04:05:48,874][123090] Updated weights for policy 1, policy_version 560917 (0.0010) [2023-12-26 04:05:48,930][123091] Updated weights for policy 0, policy_version 565051 (0.0008) [2023-12-26 04:05:48,936][123090] Updated weights for policy 1, policy_version 560927 (0.0009) [2023-12-26 04:05:48,993][123091] Updated weights for policy 0, policy_version 565061 (0.0009) [2023-12-26 04:05:49,051][123091] Updated weights for policy 0, policy_version 565071 (0.0009) [2023-12-26 04:05:49,708][123090] Updated weights for policy 1, policy_version 560937 (0.0006) [2023-12-26 04:05:49,772][123090] Updated weights for policy 1, policy_version 560947 (0.0006) [2023-12-26 04:05:49,809][123091] Updated weights for policy 0, policy_version 565081 (0.0009) [2023-12-26 04:05:49,829][123090] Updated weights for policy 1, policy_version 560957 (0.0007) [2023-12-26 04:05:49,881][123091] Updated weights for policy 0, policy_version 565091 (0.0011) [2023-12-26 04:05:49,950][123091] Updated weights for policy 0, policy_version 565101 (0.0010) [2023-12-26 04:05:50,608][123090] Updated weights for policy 1, policy_version 560967 (0.0009) [2023-12-26 04:05:50,678][123090] Updated weights for policy 1, policy_version 560977 (0.0008) [2023-12-26 04:05:50,742][123090] Updated weights for policy 1, policy_version 560987 (0.0006) [2023-12-26 04:05:50,764][123091] Updated weights for policy 0, policy_version 565111 (0.0010) [2023-12-26 04:05:50,842][123091] Updated weights for policy 0, policy_version 565121 (0.0010) [2023-12-26 04:05:50,918][123091] Updated weights for policy 0, policy_version 565131 (0.0008) [2023-12-26 04:05:51,462][123090] Updated weights for policy 1, policy_version 560997 (0.0005) [2023-12-26 04:05:51,530][123090] Updated weights for policy 1, policy_version 561007 (0.0008) [2023-12-26 04:05:51,598][123090] Updated weights for policy 1, policy_version 561017 (0.0011) [2023-12-26 04:05:51,676][123091] Updated weights for policy 0, policy_version 565141 (0.0008) [2023-12-26 04:05:51,741][123091] Updated weights for policy 0, policy_version 565151 (0.0009) [2023-12-26 04:05:51,792][123091] Updated weights for policy 0, policy_version 565161 (0.0009) [2023-12-26 04:05:52,352][123090] Updated weights for policy 1, policy_version 561027 (0.0010) [2023-12-26 04:05:52,421][123090] Updated weights for policy 1, policy_version 561037 (0.0006) [2023-12-26 04:05:52,494][123090] Updated weights for policy 1, policy_version 561047 (0.0006) [2023-12-26 04:05:52,692][123091] Updated weights for policy 0, policy_version 565171 (0.0009) [2023-12-26 04:05:52,753][123091] Updated weights for policy 0, policy_version 565181 (0.0009) [2023-12-26 04:05:52,813][123091] Updated weights for policy 0, policy_version 565191 (0.0010) [2023-12-26 04:05:53,192][123090] Updated weights for policy 1, policy_version 561057 (0.0006) [2023-12-26 04:05:53,254][123090] Updated weights for policy 1, policy_version 561067 (0.0010) [2023-12-26 04:05:53,305][123090] Updated weights for policy 1, policy_version 561077 (0.0010) [2023-12-26 04:05:53,363][123090] Updated weights for policy 1, policy_version 561087 (0.0010) [2023-12-26 04:05:53,678][123091] Updated weights for policy 0, policy_version 565201 (0.0010) [2023-12-26 04:05:53,746][123091] Updated weights for policy 0, policy_version 565211 (0.0009) [2023-12-26 04:05:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 288333824. Throughput: 0: 8518.1, 1: 8850.1. Samples: 288314092. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:53,784][121949] Avg episode reward: [(0, '6154.587'), (1, '5592.143')] [2023-12-26 04:05:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000561088_143638528.pth... [2023-12-26 04:05:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000560032_143368192.pth [2023-12-26 04:05:53,814][123091] Updated weights for policy 0, policy_version 565221 (0.0008) [2023-12-26 04:05:53,876][123091] Updated weights for policy 0, policy_version 565231 (0.0009) [2023-12-26 04:05:53,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000565232_144703488.pth... [2023-12-26 04:05:53,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000564208_144441344.pth [2023-12-26 04:05:54,130][123090] Updated weights for policy 1, policy_version 561097 (0.0010) [2023-12-26 04:05:54,200][123090] Updated weights for policy 1, policy_version 561107 (0.0010) [2023-12-26 04:05:54,266][123090] Updated weights for policy 1, policy_version 561117 (0.0010) [2023-12-26 04:05:54,729][123091] Updated weights for policy 0, policy_version 565241 (0.0006) [2023-12-26 04:05:54,788][123091] Updated weights for policy 0, policy_version 565251 (0.0005) [2023-12-26 04:05:54,848][123091] Updated weights for policy 0, policy_version 565261 (0.0005) [2023-12-26 04:05:55,075][123090] Updated weights for policy 1, policy_version 561127 (0.0010) [2023-12-26 04:05:55,123][123090] Updated weights for policy 1, policy_version 561137 (0.0010) [2023-12-26 04:05:55,177][123090] Updated weights for policy 1, policy_version 561147 (0.0006) [2023-12-26 04:05:55,537][123091] Updated weights for policy 0, policy_version 565271 (0.0007) [2023-12-26 04:05:55,588][123091] Updated weights for policy 0, policy_version 565281 (0.0011) [2023-12-26 04:05:55,640][123091] Updated weights for policy 0, policy_version 565291 (0.0010) [2023-12-26 04:05:55,874][123090] Updated weights for policy 1, policy_version 561157 (0.0006) [2023-12-26 04:05:55,938][123090] Updated weights for policy 1, policy_version 561167 (0.0005) [2023-12-26 04:05:56,000][123090] Updated weights for policy 1, policy_version 561177 (0.0005) [2023-12-26 04:05:56,371][123091] Updated weights for policy 0, policy_version 565301 (0.0008) [2023-12-26 04:05:56,418][123091] Updated weights for policy 0, policy_version 565311 (0.0005) [2023-12-26 04:05:56,467][123091] Updated weights for policy 0, policy_version 565321 (0.0005) [2023-12-26 04:05:56,610][123090] Updated weights for policy 1, policy_version 561187 (0.0005) [2023-12-26 04:05:56,663][123090] Updated weights for policy 1, policy_version 561197 (0.0005) [2023-12-26 04:05:56,719][123090] Updated weights for policy 1, policy_version 561207 (0.0005) [2023-12-26 04:05:57,132][123091] Updated weights for policy 0, policy_version 565331 (0.0005) [2023-12-26 04:05:57,188][123091] Updated weights for policy 0, policy_version 565341 (0.0005) [2023-12-26 04:05:57,234][123091] Updated weights for policy 0, policy_version 565351 (0.0010) [2023-12-26 04:05:57,364][123090] Updated weights for policy 1, policy_version 561217 (0.0005) [2023-12-26 04:05:57,418][123090] Updated weights for policy 1, policy_version 561227 (0.0008) [2023-12-26 04:05:57,468][123090] Updated weights for policy 1, policy_version 561237 (0.0010) [2023-12-26 04:05:57,523][123090] Updated weights for policy 1, policy_version 561247 (0.0010) [2023-12-26 04:05:57,918][123091] Updated weights for policy 0, policy_version 565361 (0.0010) [2023-12-26 04:05:57,968][123091] Updated weights for policy 0, policy_version 565371 (0.0006) [2023-12-26 04:05:58,036][123091] Updated weights for policy 0, policy_version 565381 (0.0009) [2023-12-26 04:05:58,098][123091] Updated weights for policy 0, policy_version 565391 (0.0009) [2023-12-26 04:05:58,338][123090] Updated weights for policy 1, policy_version 561257 (0.0011) [2023-12-26 04:05:58,403][123090] Updated weights for policy 1, policy_version 561267 (0.0010) [2023-12-26 04:05:58,467][123090] Updated weights for policy 1, policy_version 561277 (0.0010) [2023-12-26 04:05:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17476.7, 300 sec: 17716.9). Total num frames: 288432128. Throughput: 0: 8640.3, 1: 8988.4. Samples: 288426092. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:05:58,785][121949] Avg episode reward: [(0, '6097.687'), (1, '5503.105')] [2023-12-26 04:05:58,973][123091] Updated weights for policy 0, policy_version 565401 (0.0006) [2023-12-26 04:05:59,034][123091] Updated weights for policy 0, policy_version 565411 (0.0006) [2023-12-26 04:05:59,100][123091] Updated weights for policy 0, policy_version 565421 (0.0005) [2023-12-26 04:05:59,292][123090] Updated weights for policy 1, policy_version 561287 (0.0008) [2023-12-26 04:05:59,366][123090] Updated weights for policy 1, policy_version 561297 (0.0008) [2023-12-26 04:05:59,435][123090] Updated weights for policy 1, policy_version 561307 (0.0007) [2023-12-26 04:05:59,850][123091] Updated weights for policy 0, policy_version 565431 (0.0009) [2023-12-26 04:05:59,915][123091] Updated weights for policy 0, policy_version 565441 (0.0010) [2023-12-26 04:05:59,975][123091] Updated weights for policy 0, policy_version 565451 (0.0011) [2023-12-26 04:06:00,173][123090] Updated weights for policy 1, policy_version 561317 (0.0005) [2023-12-26 04:06:00,234][123090] Updated weights for policy 1, policy_version 561327 (0.0006) [2023-12-26 04:06:00,296][123090] Updated weights for policy 1, policy_version 561337 (0.0010) [2023-12-26 04:06:00,768][123091] Updated weights for policy 0, policy_version 565461 (0.0008) [2023-12-26 04:06:00,826][123091] Updated weights for policy 0, policy_version 565471 (0.0005) [2023-12-26 04:06:00,873][123091] Updated weights for policy 0, policy_version 565481 (0.0005) [2023-12-26 04:06:01,094][123090] Updated weights for policy 1, policy_version 561347 (0.0011) [2023-12-26 04:06:01,153][123090] Updated weights for policy 1, policy_version 561357 (0.0010) [2023-12-26 04:06:01,220][123090] Updated weights for policy 1, policy_version 561367 (0.0010) [2023-12-26 04:06:01,598][123091] Updated weights for policy 0, policy_version 565491 (0.0006) [2023-12-26 04:06:01,668][123091] Updated weights for policy 0, policy_version 565501 (0.0009) [2023-12-26 04:06:01,730][123091] Updated weights for policy 0, policy_version 565511 (0.0009) [2023-12-26 04:06:02,015][123090] Updated weights for policy 1, policy_version 561377 (0.0010) [2023-12-26 04:06:02,071][123090] Updated weights for policy 1, policy_version 561387 (0.0010) [2023-12-26 04:06:02,130][123090] Updated weights for policy 1, policy_version 561397 (0.0010) [2023-12-26 04:06:02,181][123090] Updated weights for policy 1, policy_version 561407 (0.0010) [2023-12-26 04:06:02,438][123091] Updated weights for policy 0, policy_version 565521 (0.0008) [2023-12-26 04:06:02,497][123091] Updated weights for policy 0, policy_version 565531 (0.0005) [2023-12-26 04:06:02,554][123091] Updated weights for policy 0, policy_version 565541 (0.0005) [2023-12-26 04:06:02,609][123091] Updated weights for policy 0, policy_version 565551 (0.0005) [2023-12-26 04:06:03,020][123090] Updated weights for policy 1, policy_version 561417 (0.0010) [2023-12-26 04:06:03,086][123090] Updated weights for policy 1, policy_version 561427 (0.0010) [2023-12-26 04:06:03,140][123090] Updated weights for policy 1, policy_version 561437 (0.0010) [2023-12-26 04:06:03,398][123091] Updated weights for policy 0, policy_version 565561 (0.0008) [2023-12-26 04:06:03,450][123091] Updated weights for policy 0, policy_version 565571 (0.0009) [2023-12-26 04:06:03,503][123091] Updated weights for policy 0, policy_version 565582 (0.0009) [2023-12-26 04:06:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 288522240. Throughput: 0: 8772.1, 1: 8942.4. Samples: 288533860. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:03,785][121949] Avg episode reward: [(0, '6047.919'), (1, '5554.967')] [2023-12-26 04:06:03,953][123090] Updated weights for policy 1, policy_version 561447 (0.0010) [2023-12-26 04:06:04,010][123090] Updated weights for policy 1, policy_version 561457 (0.0011) [2023-12-26 04:06:04,066][123090] Updated weights for policy 1, policy_version 561467 (0.0010) [2023-12-26 04:06:04,323][123091] Updated weights for policy 0, policy_version 565592 (0.0009) [2023-12-26 04:06:04,390][123091] Updated weights for policy 0, policy_version 565602 (0.0009) [2023-12-26 04:06:04,456][123091] Updated weights for policy 0, policy_version 565612 (0.0009) [2023-12-26 04:06:04,915][123090] Updated weights for policy 1, policy_version 561477 (0.0010) [2023-12-26 04:06:04,962][123090] Updated weights for policy 1, policy_version 561487 (0.0010) [2023-12-26 04:06:05,013][123090] Updated weights for policy 1, policy_version 561497 (0.0010) [2023-12-26 04:06:05,291][123091] Updated weights for policy 0, policy_version 565623 (0.0010) [2023-12-26 04:06:05,344][123091] Updated weights for policy 0, policy_version 565633 (0.0009) [2023-12-26 04:06:05,397][123091] Updated weights for policy 0, policy_version 565644 (0.0010) [2023-12-26 04:06:05,799][123090] Updated weights for policy 1, policy_version 561507 (0.0009) [2023-12-26 04:06:05,849][123090] Updated weights for policy 1, policy_version 561517 (0.0009) [2023-12-26 04:06:05,913][123090] Updated weights for policy 1, policy_version 561527 (0.0009) [2023-12-26 04:06:06,155][123091] Updated weights for policy 0, policy_version 565654 (0.0009) [2023-12-26 04:06:06,207][123091] Updated weights for policy 0, policy_version 565664 (0.0009) [2023-12-26 04:06:06,261][123091] Updated weights for policy 0, policy_version 565674 (0.0010) [2023-12-26 04:06:06,788][123090] Updated weights for policy 1, policy_version 561537 (0.0009) [2023-12-26 04:06:06,845][123090] Updated weights for policy 1, policy_version 561547 (0.0008) [2023-12-26 04:06:06,909][123090] Updated weights for policy 1, policy_version 561557 (0.0006) [2023-12-26 04:06:06,966][123090] Updated weights for policy 1, policy_version 561567 (0.0009) [2023-12-26 04:06:06,985][123091] Updated weights for policy 0, policy_version 565684 (0.0010) [2023-12-26 04:06:07,043][123091] Updated weights for policy 0, policy_version 565695 (0.0010) [2023-12-26 04:06:07,094][123091] Updated weights for policy 0, policy_version 565705 (0.0009) [2023-12-26 04:06:07,752][123090] Updated weights for policy 1, policy_version 561577 (0.0009) [2023-12-26 04:06:07,816][123090] Updated weights for policy 1, policy_version 561587 (0.0009) [2023-12-26 04:06:07,879][123090] Updated weights for policy 1, policy_version 561597 (0.0005) [2023-12-26 04:06:07,981][123091] Updated weights for policy 0, policy_version 565715 (0.0009) [2023-12-26 04:06:08,047][123091] Updated weights for policy 0, policy_version 565725 (0.0005) [2023-12-26 04:06:08,118][123091] Updated weights for policy 0, policy_version 565735 (0.0006) [2023-12-26 04:06:08,627][123090] Updated weights for policy 1, policy_version 561607 (0.0009) [2023-12-26 04:06:08,697][123090] Updated weights for policy 1, policy_version 561617 (0.0010) [2023-12-26 04:06:08,771][123090] Updated weights for policy 1, policy_version 561627 (0.0010) [2023-12-26 04:06:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 288604160. Throughput: 0: 8806.7, 1: 8972.7. Samples: 288586336. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:08,785][121949] Avg episode reward: [(0, '6199.346'), (1, '5635.178')] [2023-12-26 04:06:08,794][123091] Updated weights for policy 0, policy_version 565745 (0.0006) [2023-12-26 04:06:08,801][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000561632_143777792.pth... [2023-12-26 04:06:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000560576_143507456.pth [2023-12-26 04:06:08,858][123091] Updated weights for policy 0, policy_version 565755 (0.0009) [2023-12-26 04:06:08,931][123091] Updated weights for policy 0, policy_version 565765 (0.0007) [2023-12-26 04:06:08,997][123091] Updated weights for policy 0, policy_version 565775 (0.0007) [2023-12-26 04:06:09,003][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000565776_144842752.pth... [2023-12-26 04:06:09,008][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000564720_144572416.pth [2023-12-26 04:06:09,657][123090] Updated weights for policy 1, policy_version 561637 (0.0008) [2023-12-26 04:06:09,697][123091] Updated weights for policy 0, policy_version 565785 (0.0006) [2023-12-26 04:06:09,722][123090] Updated weights for policy 1, policy_version 561647 (0.0009) [2023-12-26 04:06:09,760][123091] Updated weights for policy 0, policy_version 565795 (0.0010) [2023-12-26 04:06:09,786][123090] Updated weights for policy 1, policy_version 561657 (0.0010) [2023-12-26 04:06:09,826][123091] Updated weights for policy 0, policy_version 565805 (0.0008) [2023-12-26 04:06:10,632][123091] Updated weights for policy 0, policy_version 565815 (0.0008) [2023-12-26 04:06:10,644][123090] Updated weights for policy 1, policy_version 561667 (0.0010) [2023-12-26 04:06:10,687][123091] Updated weights for policy 0, policy_version 565825 (0.0010) [2023-12-26 04:06:10,708][123090] Updated weights for policy 1, policy_version 561677 (0.0007) [2023-12-26 04:06:10,735][123091] Updated weights for policy 0, policy_version 565835 (0.0008) [2023-12-26 04:06:10,775][123090] Updated weights for policy 1, policy_version 561687 (0.0006) [2023-12-26 04:06:11,628][123090] Updated weights for policy 1, policy_version 561697 (0.0007) [2023-12-26 04:06:11,646][123091] Updated weights for policy 0, policy_version 565845 (0.0008) [2023-12-26 04:06:11,698][123090] Updated weights for policy 1, policy_version 561707 (0.0010) [2023-12-26 04:06:11,702][123091] Updated weights for policy 0, policy_version 565855 (0.0010) [2023-12-26 04:06:11,766][123090] Updated weights for policy 1, policy_version 561717 (0.0008) [2023-12-26 04:06:11,782][123091] Updated weights for policy 0, policy_version 565865 (0.0009) [2023-12-26 04:06:11,839][123090] Updated weights for policy 1, policy_version 561727 (0.0009) [2023-12-26 04:06:12,663][123091] Updated weights for policy 0, policy_version 565875 (0.0008) [2023-12-26 04:06:12,663][123090] Updated weights for policy 1, policy_version 561737 (0.0009) [2023-12-26 04:06:12,724][123091] Updated weights for policy 0, policy_version 565885 (0.0007) [2023-12-26 04:06:12,728][123090] Updated weights for policy 1, policy_version 561747 (0.0011) [2023-12-26 04:06:12,790][123091] Updated weights for policy 0, policy_version 565895 (0.0006) [2023-12-26 04:06:12,796][123090] Updated weights for policy 1, policy_version 561757 (0.0011) [2023-12-26 04:06:13,441][123090] Updated weights for policy 1, policy_version 561767 (0.0007) [2023-12-26 04:06:13,523][123090] Updated weights for policy 1, policy_version 561777 (0.0005) [2023-12-26 04:06:13,583][123090] Updated weights for policy 1, policy_version 561787 (0.0005) [2023-12-26 04:06:13,647][123091] Updated weights for policy 0, policy_version 565905 (0.0008) [2023-12-26 04:06:13,710][123091] Updated weights for policy 0, policy_version 565915 (0.0010) [2023-12-26 04:06:13,769][123091] Updated weights for policy 0, policy_version 565926 (0.0010) [2023-12-26 04:06:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 288694272. Throughput: 0: 8747.5, 1: 8943.0. Samples: 288689996. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:13,785][121949] Avg episode reward: [(0, '6152.771'), (1, '5689.705')] [2023-12-26 04:06:13,823][123091] Updated weights for policy 0, policy_version 565936 (0.0010) [2023-12-26 04:06:14,195][123090] Updated weights for policy 1, policy_version 561797 (0.0005) [2023-12-26 04:06:14,239][123090] Updated weights for policy 1, policy_version 561807 (0.0005) [2023-12-26 04:06:14,287][123090] Updated weights for policy 1, policy_version 561817 (0.0005) [2023-12-26 04:06:14,752][123091] Updated weights for policy 0, policy_version 565947 (0.0010) [2023-12-26 04:06:14,813][123091] Updated weights for policy 0, policy_version 565957 (0.0008) [2023-12-26 04:06:14,874][123091] Updated weights for policy 0, policy_version 565967 (0.0008) [2023-12-26 04:06:14,947][123090] Updated weights for policy 1, policy_version 561827 (0.0008) [2023-12-26 04:06:15,018][123090] Updated weights for policy 1, policy_version 561837 (0.0006) [2023-12-26 04:06:15,091][123090] Updated weights for policy 1, policy_version 561847 (0.0009) [2023-12-26 04:06:15,698][123091] Updated weights for policy 0, policy_version 565977 (0.0006) [2023-12-26 04:06:15,761][123091] Updated weights for policy 0, policy_version 565987 (0.0005) [2023-12-26 04:06:15,815][123091] Updated weights for policy 0, policy_version 565997 (0.0006) [2023-12-26 04:06:15,912][123090] Updated weights for policy 1, policy_version 561857 (0.0011) [2023-12-26 04:06:15,979][123090] Updated weights for policy 1, policy_version 561867 (0.0011) [2023-12-26 04:06:16,039][123090] Updated weights for policy 1, policy_version 561877 (0.0010) [2023-12-26 04:06:16,102][123090] Updated weights for policy 1, policy_version 561887 (0.0010) [2023-12-26 04:06:16,437][123091] Updated weights for policy 0, policy_version 566007 (0.0009) [2023-12-26 04:06:16,504][123091] Updated weights for policy 0, policy_version 566017 (0.0011) [2023-12-26 04:06:16,566][123091] Updated weights for policy 0, policy_version 566027 (0.0011) [2023-12-26 04:06:16,962][123090] Updated weights for policy 1, policy_version 561897 (0.0011) [2023-12-26 04:06:17,030][123090] Updated weights for policy 1, policy_version 561907 (0.0011) [2023-12-26 04:06:17,093][123090] Updated weights for policy 1, policy_version 561917 (0.0009) [2023-12-26 04:06:17,313][123091] Updated weights for policy 0, policy_version 566037 (0.0010) [2023-12-26 04:06:17,371][123091] Updated weights for policy 0, policy_version 566047 (0.0011) [2023-12-26 04:06:17,426][123091] Updated weights for policy 0, policy_version 566057 (0.0010) [2023-12-26 04:06:17,854][123090] Updated weights for policy 1, policy_version 561927 (0.0009) [2023-12-26 04:06:17,913][123090] Updated weights for policy 1, policy_version 561937 (0.0009) [2023-12-26 04:06:17,983][123090] Updated weights for policy 1, policy_version 561947 (0.0008) [2023-12-26 04:06:18,251][123091] Updated weights for policy 0, policy_version 566067 (0.0010) [2023-12-26 04:06:18,310][123091] Updated weights for policy 0, policy_version 566077 (0.0005) [2023-12-26 04:06:18,374][123091] Updated weights for policy 0, policy_version 566087 (0.0008) [2023-12-26 04:06:18,733][123090] Updated weights for policy 1, policy_version 561957 (0.0008) [2023-12-26 04:06:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 288784384. Throughput: 0: 8758.0, 1: 9026.7. Samples: 288797452. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:18,785][121949] Avg episode reward: [(0, '6070.061'), (1, '5776.924')] [2023-12-26 04:06:18,798][123090] Updated weights for policy 1, policy_version 561967 (0.0005) [2023-12-26 04:06:18,847][123090] Updated weights for policy 1, policy_version 561977 (0.0005) [2023-12-26 04:06:19,198][123091] Updated weights for policy 0, policy_version 566097 (0.0006) [2023-12-26 04:06:19,252][123091] Updated weights for policy 0, policy_version 566107 (0.0009) [2023-12-26 04:06:19,312][123091] Updated weights for policy 0, policy_version 566117 (0.0011) [2023-12-26 04:06:19,376][123091] Updated weights for policy 0, policy_version 566127 (0.0011) [2023-12-26 04:06:19,634][123090] Updated weights for policy 1, policy_version 561987 (0.0007) [2023-12-26 04:06:19,702][123090] Updated weights for policy 1, policy_version 561997 (0.0010) [2023-12-26 04:06:19,773][123090] Updated weights for policy 1, policy_version 562007 (0.0010) [2023-12-26 04:06:20,170][123091] Updated weights for policy 0, policy_version 566137 (0.0007) [2023-12-26 04:06:20,227][123091] Updated weights for policy 0, policy_version 566147 (0.0009) [2023-12-26 04:06:20,283][123091] Updated weights for policy 0, policy_version 566157 (0.0005) [2023-12-26 04:06:20,587][123090] Updated weights for policy 1, policy_version 562017 (0.0010) [2023-12-26 04:06:20,655][123090] Updated weights for policy 1, policy_version 562027 (0.0007) [2023-12-26 04:06:20,718][123090] Updated weights for policy 1, policy_version 562037 (0.0008) [2023-12-26 04:06:20,767][123090] Updated weights for policy 1, policy_version 562047 (0.0009) [2023-12-26 04:06:21,062][123091] Updated weights for policy 0, policy_version 566167 (0.0008) [2023-12-26 04:06:21,126][123091] Updated weights for policy 0, policy_version 566177 (0.0009) [2023-12-26 04:06:21,197][123091] Updated weights for policy 0, policy_version 566187 (0.0010) [2023-12-26 04:06:21,629][123090] Updated weights for policy 1, policy_version 562057 (0.0008) [2023-12-26 04:06:21,700][123090] Updated weights for policy 1, policy_version 562067 (0.0009) [2023-12-26 04:06:21,774][123090] Updated weights for policy 1, policy_version 562077 (0.0010) [2023-12-26 04:06:22,026][123091] Updated weights for policy 0, policy_version 566197 (0.0009) [2023-12-26 04:06:22,088][123091] Updated weights for policy 0, policy_version 566207 (0.0008) [2023-12-26 04:06:22,148][123091] Updated weights for policy 0, policy_version 566217 (0.0010) [2023-12-26 04:06:22,519][123090] Updated weights for policy 1, policy_version 562087 (0.0010) [2023-12-26 04:06:22,583][123090] Updated weights for policy 1, policy_version 562097 (0.0008) [2023-12-26 04:06:22,633][123090] Updated weights for policy 1, policy_version 562107 (0.0006) [2023-12-26 04:06:23,048][123091] Updated weights for policy 0, policy_version 566227 (0.0009) [2023-12-26 04:06:23,116][123091] Updated weights for policy 0, policy_version 566237 (0.0011) [2023-12-26 04:06:23,184][123091] Updated weights for policy 0, policy_version 566247 (0.0011) [2023-12-26 04:06:23,433][123090] Updated weights for policy 1, policy_version 562117 (0.0009) [2023-12-26 04:06:23,482][123090] Updated weights for policy 1, policy_version 562127 (0.0009) [2023-12-26 04:06:23,538][123090] Updated weights for policy 1, policy_version 562137 (0.0008) [2023-12-26 04:06:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 288874496. Throughput: 0: 8750.6, 1: 8999.5. Samples: 288849716. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:23,784][121949] Avg episode reward: [(0, '6075.738'), (1, '5822.304')] [2023-12-26 04:06:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000566256_144965632.pth... [2023-12-26 04:06:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000562144_143908864.pth... [2023-12-26 04:06:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000565232_144703488.pth [2023-12-26 04:06:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000561088_143638528.pth [2023-12-26 04:06:24,012][123091] Updated weights for policy 0, policy_version 566257 (0.0011) [2023-12-26 04:06:24,062][123091] Updated weights for policy 0, policy_version 566267 (0.0009) [2023-12-26 04:06:24,123][123091] Updated weights for policy 0, policy_version 566277 (0.0009) [2023-12-26 04:06:24,192][123091] Updated weights for policy 0, policy_version 566287 (0.0009) [2023-12-26 04:06:24,377][123090] Updated weights for policy 1, policy_version 562147 (0.0008) [2023-12-26 04:06:24,447][123090] Updated weights for policy 1, policy_version 562157 (0.0007) [2023-12-26 04:06:24,505][123090] Updated weights for policy 1, policy_version 562167 (0.0009) [2023-12-26 04:06:25,017][123091] Updated weights for policy 0, policy_version 566297 (0.0010) [2023-12-26 04:06:25,071][123091] Updated weights for policy 0, policy_version 566307 (0.0009) [2023-12-26 04:06:25,130][123091] Updated weights for policy 0, policy_version 566317 (0.0010) [2023-12-26 04:06:25,316][123090] Updated weights for policy 1, policy_version 562177 (0.0009) [2023-12-26 04:06:25,370][123090] Updated weights for policy 1, policy_version 562187 (0.0010) [2023-12-26 04:06:25,423][123090] Updated weights for policy 1, policy_version 562198 (0.0010) [2023-12-26 04:06:25,475][123090] Updated weights for policy 1, policy_version 562208 (0.0010) [2023-12-26 04:06:25,879][123091] Updated weights for policy 0, policy_version 566327 (0.0010) [2023-12-26 04:06:25,930][123091] Updated weights for policy 0, policy_version 566337 (0.0011) [2023-12-26 04:06:25,985][123091] Updated weights for policy 0, policy_version 566347 (0.0010) [2023-12-26 04:06:26,254][123090] Updated weights for policy 1, policy_version 562218 (0.0005) [2023-12-26 04:06:26,306][123090] Updated weights for policy 1, policy_version 562228 (0.0005) [2023-12-26 04:06:26,374][123090] Updated weights for policy 1, policy_version 562238 (0.0006) [2023-12-26 04:06:26,844][123091] Updated weights for policy 0, policy_version 566357 (0.0009) [2023-12-26 04:06:26,895][123091] Updated weights for policy 0, policy_version 566367 (0.0011) [2023-12-26 04:06:26,949][123091] Updated weights for policy 0, policy_version 566377 (0.0010) [2023-12-26 04:06:27,048][123090] Updated weights for policy 1, policy_version 562248 (0.0005) [2023-12-26 04:06:27,109][123090] Updated weights for policy 1, policy_version 562258 (0.0005) [2023-12-26 04:06:27,182][123090] Updated weights for policy 1, policy_version 562268 (0.0005) [2023-12-26 04:06:27,685][123091] Updated weights for policy 0, policy_version 566387 (0.0009) [2023-12-26 04:06:27,741][123091] Updated weights for policy 0, policy_version 566397 (0.0006) [2023-12-26 04:06:27,791][123091] Updated weights for policy 0, policy_version 566407 (0.0006) [2023-12-26 04:06:27,830][123090] Updated weights for policy 1, policy_version 562278 (0.0007) [2023-12-26 04:06:27,905][123090] Updated weights for policy 1, policy_version 562288 (0.0008) [2023-12-26 04:06:27,964][123090] Updated weights for policy 1, policy_version 562298 (0.0008) [2023-12-26 04:06:28,420][123091] Updated weights for policy 0, policy_version 566417 (0.0006) [2023-12-26 04:06:28,478][123091] Updated weights for policy 0, policy_version 566427 (0.0008) [2023-12-26 04:06:28,550][123091] Updated weights for policy 0, policy_version 566437 (0.0011) [2023-12-26 04:06:28,619][123091] Updated weights for policy 0, policy_version 566447 (0.0011) [2023-12-26 04:06:28,677][123090] Updated weights for policy 1, policy_version 562308 (0.0008) [2023-12-26 04:06:28,747][123090] Updated weights for policy 1, policy_version 562318 (0.0005) [2023-12-26 04:06:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 288964608. Throughput: 0: 8827.7, 1: 9025.3. Samples: 288958028. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:28,785][121949] Avg episode reward: [(0, '6039.783'), (1, '5683.683')] [2023-12-26 04:06:28,815][123090] Updated weights for policy 1, policy_version 562328 (0.0005) [2023-12-26 04:06:29,422][123091] Updated weights for policy 0, policy_version 566457 (0.0011) [2023-12-26 04:06:29,436][123090] Updated weights for policy 1, policy_version 562338 (0.0006) [2023-12-26 04:06:29,474][123091] Updated weights for policy 0, policy_version 566467 (0.0011) [2023-12-26 04:06:29,498][123090] Updated weights for policy 1, policy_version 562348 (0.0005) [2023-12-26 04:06:29,537][123091] Updated weights for policy 0, policy_version 566477 (0.0011) [2023-12-26 04:06:29,555][123090] Updated weights for policy 1, policy_version 562358 (0.0005) [2023-12-26 04:06:29,608][123090] Updated weights for policy 1, policy_version 562368 (0.0005) [2023-12-26 04:06:30,227][123091] Updated weights for policy 0, policy_version 566487 (0.0007) [2023-12-26 04:06:30,278][123091] Updated weights for policy 0, policy_version 566497 (0.0005) [2023-12-26 04:06:30,330][123091] Updated weights for policy 0, policy_version 566507 (0.0006) [2023-12-26 04:06:30,339][123090] Updated weights for policy 1, policy_version 562378 (0.0005) [2023-12-26 04:06:30,396][123090] Updated weights for policy 1, policy_version 562388 (0.0006) [2023-12-26 04:06:30,450][123090] Updated weights for policy 1, policy_version 562398 (0.0005) [2023-12-26 04:06:31,010][123091] Updated weights for policy 0, policy_version 566517 (0.0006) [2023-12-26 04:06:31,078][123091] Updated weights for policy 0, policy_version 566527 (0.0010) [2023-12-26 04:06:31,085][123090] Updated weights for policy 1, policy_version 562408 (0.0007) [2023-12-26 04:06:31,139][123091] Updated weights for policy 0, policy_version 566537 (0.0011) [2023-12-26 04:06:31,141][123090] Updated weights for policy 1, policy_version 562418 (0.0007) [2023-12-26 04:06:31,211][123090] Updated weights for policy 1, policy_version 562428 (0.0008) [2023-12-26 04:06:31,962][123091] Updated weights for policy 0, policy_version 566547 (0.0010) [2023-12-26 04:06:31,994][123090] Updated weights for policy 1, policy_version 562438 (0.0008) [2023-12-26 04:06:32,009][123091] Updated weights for policy 0, policy_version 566557 (0.0010) [2023-12-26 04:06:32,051][123090] Updated weights for policy 1, policy_version 562448 (0.0006) [2023-12-26 04:06:32,060][123091] Updated weights for policy 0, policy_version 566567 (0.0010) [2023-12-26 04:06:32,111][123090] Updated weights for policy 1, policy_version 562458 (0.0010) [2023-12-26 04:06:32,897][123091] Updated weights for policy 0, policy_version 566577 (0.0011) [2023-12-26 04:06:32,959][123091] Updated weights for policy 0, policy_version 566587 (0.0010) [2023-12-26 04:06:32,961][123090] Updated weights for policy 1, policy_version 562468 (0.0007) [2023-12-26 04:06:33,023][123091] Updated weights for policy 0, policy_version 566597 (0.0011) [2023-12-26 04:06:33,026][123090] Updated weights for policy 1, policy_version 562478 (0.0006) [2023-12-26 04:06:33,078][123091] Updated weights for policy 0, policy_version 566607 (0.0010) [2023-12-26 04:06:33,085][123090] Updated weights for policy 1, policy_version 562488 (0.0007) [2023-12-26 04:06:33,732][123091] Updated weights for policy 0, policy_version 566617 (0.0009) [2023-12-26 04:06:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 289054720. Throughput: 0: 8972.0, 1: 9068.7. Samples: 289071308. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:33,785][121949] Avg episode reward: [(0, '6090.450'), (1, '5608.482')] [2023-12-26 04:06:33,799][123091] Updated weights for policy 0, policy_version 566627 (0.0009) [2023-12-26 04:06:33,859][123091] Updated weights for policy 0, policy_version 566637 (0.0010) [2023-12-26 04:06:33,931][123090] Updated weights for policy 1, policy_version 562498 (0.0009) [2023-12-26 04:06:33,985][123090] Updated weights for policy 1, policy_version 562508 (0.0010) [2023-12-26 04:06:34,035][123090] Updated weights for policy 1, policy_version 562518 (0.0009) [2023-12-26 04:06:34,094][123090] Updated weights for policy 1, policy_version 562528 (0.0009) [2023-12-26 04:06:34,585][123091] Updated weights for policy 0, policy_version 566647 (0.0009) [2023-12-26 04:06:34,652][123091] Updated weights for policy 0, policy_version 566657 (0.0007) [2023-12-26 04:06:34,723][123091] Updated weights for policy 0, policy_version 566667 (0.0007) [2023-12-26 04:06:35,007][123090] Updated weights for policy 1, policy_version 562538 (0.0006) [2023-12-26 04:06:35,075][123090] Updated weights for policy 1, policy_version 562548 (0.0009) [2023-12-26 04:06:35,141][123090] Updated weights for policy 1, policy_version 562558 (0.0010) [2023-12-26 04:06:35,521][123091] Updated weights for policy 0, policy_version 566677 (0.0007) [2023-12-26 04:06:35,587][123091] Updated weights for policy 0, policy_version 566687 (0.0006) [2023-12-26 04:06:35,662][123091] Updated weights for policy 0, policy_version 566697 (0.0005) [2023-12-26 04:06:35,907][123090] Updated weights for policy 1, policy_version 562568 (0.0010) [2023-12-26 04:06:35,966][123090] Updated weights for policy 1, policy_version 562578 (0.0010) [2023-12-26 04:06:36,018][123090] Updated weights for policy 1, policy_version 562588 (0.0010) [2023-12-26 04:06:36,278][123091] Updated weights for policy 0, policy_version 566707 (0.0005) [2023-12-26 04:06:36,336][123091] Updated weights for policy 0, policy_version 566717 (0.0005) [2023-12-26 04:06:36,401][123091] Updated weights for policy 0, policy_version 566727 (0.0007) [2023-12-26 04:06:36,876][123090] Updated weights for policy 1, policy_version 562598 (0.0010) [2023-12-26 04:06:36,954][123090] Updated weights for policy 1, policy_version 562608 (0.0010) [2023-12-26 04:06:37,009][123090] Updated weights for policy 1, policy_version 562618 (0.0008) [2023-12-26 04:06:37,115][123091] Updated weights for policy 0, policy_version 566737 (0.0010) [2023-12-26 04:06:37,177][123091] Updated weights for policy 0, policy_version 566747 (0.0006) [2023-12-26 04:06:37,234][123091] Updated weights for policy 0, policy_version 566757 (0.0007) [2023-12-26 04:06:37,280][123091] Updated weights for policy 0, policy_version 566767 (0.0005) [2023-12-26 04:06:37,817][123090] Updated weights for policy 1, policy_version 562628 (0.0008) [2023-12-26 04:06:37,869][123090] Updated weights for policy 1, policy_version 562638 (0.0009) [2023-12-26 04:06:37,922][123090] Updated weights for policy 1, policy_version 562648 (0.0008) [2023-12-26 04:06:38,070][123091] Updated weights for policy 0, policy_version 566777 (0.0009) [2023-12-26 04:06:38,134][123091] Updated weights for policy 0, policy_version 566787 (0.0009) [2023-12-26 04:06:38,194][123091] Updated weights for policy 0, policy_version 566797 (0.0009) [2023-12-26 04:06:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 289144832. Throughput: 0: 8995.1, 1: 9014.4. Samples: 289124520. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:38,785][121949] Avg episode reward: [(0, '6138.647'), (1, '5590.067')] [2023-12-26 04:06:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000566800_145104896.pth... [2023-12-26 04:06:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000565776_144842752.pth [2023-12-26 04:06:38,812][123090] Updated weights for policy 1, policy_version 562658 (0.0010) [2023-12-26 04:06:38,869][123090] Updated weights for policy 1, policy_version 562668 (0.0009) [2023-12-26 04:06:38,927][123090] Updated weights for policy 1, policy_version 562678 (0.0009) [2023-12-26 04:06:38,979][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000562688_144048128.pth... [2023-12-26 04:06:38,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000561632_143777792.pth [2023-12-26 04:06:38,983][123090] Updated weights for policy 1, policy_version 562688 (0.0010) [2023-12-26 04:06:39,032][123091] Updated weights for policy 0, policy_version 566807 (0.0009) [2023-12-26 04:06:39,086][123091] Updated weights for policy 0, policy_version 566817 (0.0008) [2023-12-26 04:06:39,142][123091] Updated weights for policy 0, policy_version 566827 (0.0009) [2023-12-26 04:06:39,883][123090] Updated weights for policy 1, policy_version 562698 (0.0009) [2023-12-26 04:06:39,950][123090] Updated weights for policy 1, policy_version 562708 (0.0010) [2023-12-26 04:06:40,025][123090] Updated weights for policy 1, policy_version 562718 (0.0010) [2023-12-26 04:06:40,102][123091] Updated weights for policy 0, policy_version 566837 (0.0008) [2023-12-26 04:06:40,164][123091] Updated weights for policy 0, policy_version 566847 (0.0007) [2023-12-26 04:06:40,218][123091] Updated weights for policy 0, policy_version 566857 (0.0009) [2023-12-26 04:06:40,771][123090] Updated weights for policy 1, policy_version 562728 (0.0009) [2023-12-26 04:06:40,822][123090] Updated weights for policy 1, policy_version 562738 (0.0009) [2023-12-26 04:06:40,874][123090] Updated weights for policy 1, policy_version 562748 (0.0009) [2023-12-26 04:06:41,009][123091] Updated weights for policy 0, policy_version 566867 (0.0010) [2023-12-26 04:06:41,068][123091] Updated weights for policy 0, policy_version 566877 (0.0008) [2023-12-26 04:06:41,141][123091] Updated weights for policy 0, policy_version 566887 (0.0009) [2023-12-26 04:06:41,769][123090] Updated weights for policy 1, policy_version 562758 (0.0010) [2023-12-26 04:06:41,836][123090] Updated weights for policy 1, policy_version 562768 (0.0010) [2023-12-26 04:06:41,902][123090] Updated weights for policy 1, policy_version 562778 (0.0009) [2023-12-26 04:06:42,048][123091] Updated weights for policy 0, policy_version 566897 (0.0009) [2023-12-26 04:06:42,120][123091] Updated weights for policy 0, policy_version 566907 (0.0008) [2023-12-26 04:06:42,191][123091] Updated weights for policy 0, policy_version 566917 (0.0006) [2023-12-26 04:06:42,253][123091] Updated weights for policy 0, policy_version 566927 (0.0007) [2023-12-26 04:06:42,732][123090] Updated weights for policy 1, policy_version 562788 (0.0007) [2023-12-26 04:06:42,794][123090] Updated weights for policy 1, policy_version 562798 (0.0010) [2023-12-26 04:06:42,854][123090] Updated weights for policy 1, policy_version 562808 (0.0010) [2023-12-26 04:06:43,057][123091] Updated weights for policy 0, policy_version 566937 (0.0010) [2023-12-26 04:06:43,108][123091] Updated weights for policy 0, policy_version 566948 (0.0009) [2023-12-26 04:06:43,154][123091] Updated weights for policy 0, policy_version 566958 (0.0005) [2023-12-26 04:06:43,433][123090] Updated weights for policy 1, policy_version 562818 (0.0009) [2023-12-26 04:06:43,480][123090] Updated weights for policy 1, policy_version 562828 (0.0010) [2023-12-26 04:06:43,533][123090] Updated weights for policy 1, policy_version 562838 (0.0010) [2023-12-26 04:06:43,593][123090] Updated weights for policy 1, policy_version 562848 (0.0010) [2023-12-26 04:06:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 289234944. Throughput: 0: 8945.5, 1: 8854.1. Samples: 289227076. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:43,785][121949] Avg episode reward: [(0, '6215.242'), (1, '5682.001')] [2023-12-26 04:06:43,974][123091] Updated weights for policy 0, policy_version 566968 (0.0008) [2023-12-26 04:06:44,022][123091] Updated weights for policy 0, policy_version 566978 (0.0009) [2023-12-26 04:06:44,089][123091] Updated weights for policy 0, policy_version 566988 (0.0005) [2023-12-26 04:06:44,427][123090] Updated weights for policy 1, policy_version 562858 (0.0010) [2023-12-26 04:06:44,486][123090] Updated weights for policy 1, policy_version 562868 (0.0010) [2023-12-26 04:06:44,538][123090] Updated weights for policy 1, policy_version 562878 (0.0010) [2023-12-26 04:06:44,776][123091] Updated weights for policy 0, policy_version 566998 (0.0007) [2023-12-26 04:06:44,844][123091] Updated weights for policy 0, policy_version 567008 (0.0007) [2023-12-26 04:06:44,919][123091] Updated weights for policy 0, policy_version 567018 (0.0006) [2023-12-26 04:06:45,371][123090] Updated weights for policy 1, policy_version 562888 (0.0011) [2023-12-26 04:06:45,427][123090] Updated weights for policy 1, policy_version 562898 (0.0011) [2023-12-26 04:06:45,491][123090] Updated weights for policy 1, policy_version 562908 (0.0011) [2023-12-26 04:06:45,675][123091] Updated weights for policy 0, policy_version 567028 (0.0008) [2023-12-26 04:06:45,723][123091] Updated weights for policy 0, policy_version 567038 (0.0008) [2023-12-26 04:06:45,770][123091] Updated weights for policy 0, policy_version 567048 (0.0009) [2023-12-26 04:06:46,248][123090] Updated weights for policy 1, policy_version 562918 (0.0007) [2023-12-26 04:06:46,296][123090] Updated weights for policy 1, policy_version 562928 (0.0005) [2023-12-26 04:06:46,365][123090] Updated weights for policy 1, policy_version 562938 (0.0012) [2023-12-26 04:06:46,695][123091] Updated weights for policy 0, policy_version 567058 (0.0010) [2023-12-26 04:06:46,762][123091] Updated weights for policy 0, policy_version 567068 (0.0009) [2023-12-26 04:06:46,821][123091] Updated weights for policy 0, policy_version 567078 (0.0010) [2023-12-26 04:06:46,889][123091] Updated weights for policy 0, policy_version 567088 (0.0010) [2023-12-26 04:06:47,150][123090] Updated weights for policy 1, policy_version 562948 (0.0007) [2023-12-26 04:06:47,204][123090] Updated weights for policy 1, policy_version 562958 (0.0009) [2023-12-26 04:06:47,265][123090] Updated weights for policy 1, policy_version 562968 (0.0009) [2023-12-26 04:06:47,645][123091] Updated weights for policy 0, policy_version 567098 (0.0010) [2023-12-26 04:06:47,710][123091] Updated weights for policy 0, policy_version 567108 (0.0010) [2023-12-26 04:06:47,763][123091] Updated weights for policy 0, policy_version 567118 (0.0009) [2023-12-26 04:06:48,098][123090] Updated weights for policy 1, policy_version 562978 (0.0009) [2023-12-26 04:06:48,162][123090] Updated weights for policy 1, policy_version 562988 (0.0011) [2023-12-26 04:06:48,232][123090] Updated weights for policy 1, policy_version 562998 (0.0009) [2023-12-26 04:06:48,309][123090] Updated weights for policy 1, policy_version 563008 (0.0007) [2023-12-26 04:06:48,623][123091] Updated weights for policy 0, policy_version 567128 (0.0009) [2023-12-26 04:06:48,683][123091] Updated weights for policy 0, policy_version 567138 (0.0009) [2023-12-26 04:06:48,750][123091] Updated weights for policy 0, policy_version 567148 (0.0009) [2023-12-26 04:06:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 289325056. Throughput: 0: 8887.6, 1: 8892.3. Samples: 289333952. Policy #0 lag: (min: 12.0, avg: 24.2, max: 44.0) [2023-12-26 04:06:48,785][121949] Avg episode reward: [(0, '6174.373'), (1, '5779.044')] [2023-12-26 04:06:49,084][123090] Updated weights for policy 1, policy_version 563018 (0.0010) [2023-12-26 04:06:49,138][123090] Updated weights for policy 1, policy_version 563028 (0.0010) [2023-12-26 04:06:49,208][123090] Updated weights for policy 1, policy_version 563038 (0.0011) [2023-12-26 04:06:49,531][123091] Updated weights for policy 0, policy_version 567158 (0.0009) [2023-12-26 04:06:49,598][123091] Updated weights for policy 0, policy_version 567168 (0.0010) [2023-12-26 04:06:49,668][123091] Updated weights for policy 0, policy_version 567178 (0.0010) [2023-12-26 04:06:50,011][123090] Updated weights for policy 1, policy_version 563048 (0.0011) [2023-12-26 04:06:50,087][123090] Updated weights for policy 1, policy_version 563058 (0.0011) [2023-12-26 04:06:50,153][123090] Updated weights for policy 1, policy_version 563068 (0.0010) [2023-12-26 04:06:50,530][123091] Updated weights for policy 0, policy_version 567188 (0.0010) [2023-12-26 04:06:50,588][123091] Updated weights for policy 0, policy_version 567198 (0.0010) [2023-12-26 04:06:50,653][123091] Updated weights for policy 0, policy_version 567208 (0.0009) [2023-12-26 04:06:50,940][123090] Updated weights for policy 1, policy_version 563078 (0.0008) [2023-12-26 04:06:50,997][123090] Updated weights for policy 1, policy_version 563088 (0.0005) [2023-12-26 04:06:51,064][123090] Updated weights for policy 1, policy_version 563098 (0.0009) [2023-12-26 04:06:51,583][123091] Updated weights for policy 0, policy_version 567218 (0.0009) [2023-12-26 04:06:51,645][123091] Updated weights for policy 0, policy_version 567228 (0.0009) [2023-12-26 04:06:51,710][123091] Updated weights for policy 0, policy_version 567238 (0.0009) [2023-12-26 04:06:51,779][123091] Updated weights for policy 0, policy_version 567248 (0.0010) [2023-12-26 04:06:51,847][123090] Updated weights for policy 1, policy_version 563108 (0.0010) [2023-12-26 04:06:51,908][123090] Updated weights for policy 1, policy_version 563118 (0.0009) [2023-12-26 04:06:51,969][123090] Updated weights for policy 1, policy_version 563128 (0.0006) [2023-12-26 04:06:52,675][123091] Updated weights for policy 0, policy_version 567258 (0.0010) [2023-12-26 04:06:52,733][123090] Updated weights for policy 1, policy_version 563138 (0.0008) [2023-12-26 04:06:52,738][123091] Updated weights for policy 0, policy_version 567268 (0.0010) [2023-12-26 04:06:52,798][123091] Updated weights for policy 0, policy_version 567278 (0.0009) [2023-12-26 04:06:52,803][123090] Updated weights for policy 1, policy_version 563148 (0.0008) [2023-12-26 04:06:52,865][123090] Updated weights for policy 1, policy_version 563158 (0.0008) [2023-12-26 04:06:52,935][123090] Updated weights for policy 1, policy_version 563168 (0.0006) [2023-12-26 04:06:53,522][123090] Updated weights for policy 1, policy_version 563178 (0.0009) [2023-12-26 04:06:53,575][123090] Updated weights for policy 1, policy_version 563188 (0.0009) [2023-12-26 04:06:53,620][123090] Updated weights for policy 1, policy_version 563198 (0.0006) [2023-12-26 04:06:53,664][123091] Updated weights for policy 0, policy_version 567288 (0.0009) [2023-12-26 04:06:53,717][123091] Updated weights for policy 0, policy_version 567298 (0.0010) [2023-12-26 04:06:53,768][123091] Updated weights for policy 0, policy_version 567308 (0.0010) [2023-12-26 04:06:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 289415168. Throughput: 0: 8847.3, 1: 8911.7. Samples: 289385492. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:06:53,784][121949] Avg episode reward: [(0, '6172.688'), (1, '5844.960')] [2023-12-26 04:06:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000567312_145235968.pth... [2023-12-26 04:06:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000563200_144179200.pth... [2023-12-26 04:06:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000566256_144965632.pth [2023-12-26 04:06:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000562144_143908864.pth [2023-12-26 04:06:54,385][123090] Updated weights for policy 1, policy_version 563208 (0.0006) [2023-12-26 04:06:54,453][123090] Updated weights for policy 1, policy_version 563218 (0.0005) [2023-12-26 04:06:54,520][123090] Updated weights for policy 1, policy_version 563228 (0.0005) [2023-12-26 04:06:54,631][123091] Updated weights for policy 0, policy_version 567319 (0.0006) [2023-12-26 04:06:54,690][123091] Updated weights for policy 0, policy_version 567329 (0.0006) [2023-12-26 04:06:54,746][123091] Updated weights for policy 0, policy_version 567339 (0.0006) [2023-12-26 04:06:55,196][123090] Updated weights for policy 1, policy_version 563238 (0.0005) [2023-12-26 04:06:55,242][123090] Updated weights for policy 1, policy_version 563248 (0.0005) [2023-12-26 04:06:55,296][123090] Updated weights for policy 1, policy_version 563258 (0.0005) [2023-12-26 04:06:55,583][123091] Updated weights for policy 0, policy_version 567349 (0.0007) [2023-12-26 04:06:55,637][123091] Updated weights for policy 0, policy_version 567359 (0.0010) [2023-12-26 04:06:55,694][123091] Updated weights for policy 0, policy_version 567369 (0.0010) [2023-12-26 04:06:56,007][123090] Updated weights for policy 1, policy_version 563268 (0.0007) [2023-12-26 04:06:56,063][123090] Updated weights for policy 1, policy_version 563278 (0.0010) [2023-12-26 04:06:56,124][123090] Updated weights for policy 1, policy_version 563288 (0.0009) [2023-12-26 04:06:56,350][123091] Updated weights for policy 0, policy_version 567379 (0.0009) [2023-12-26 04:06:56,398][123091] Updated weights for policy 0, policy_version 567389 (0.0010) [2023-12-26 04:06:56,450][123091] Updated weights for policy 0, policy_version 567399 (0.0010) [2023-12-26 04:06:56,969][123090] Updated weights for policy 1, policy_version 563298 (0.0009) [2023-12-26 04:06:57,016][123090] Updated weights for policy 1, policy_version 563308 (0.0008) [2023-12-26 04:06:57,063][123090] Updated weights for policy 1, policy_version 563318 (0.0008) [2023-12-26 04:06:57,110][123090] Updated weights for policy 1, policy_version 563328 (0.0009) [2023-12-26 04:06:57,291][123091] Updated weights for policy 0, policy_version 567409 (0.0010) [2023-12-26 04:06:57,342][123091] Updated weights for policy 0, policy_version 567419 (0.0010) [2023-12-26 04:06:57,390][123091] Updated weights for policy 0, policy_version 567429 (0.0010) [2023-12-26 04:06:57,444][123091] Updated weights for policy 0, policy_version 567439 (0.0010) [2023-12-26 04:06:58,027][123090] Updated weights for policy 1, policy_version 563338 (0.0007) [2023-12-26 04:06:58,095][123090] Updated weights for policy 1, policy_version 563348 (0.0011) [2023-12-26 04:06:58,163][123090] Updated weights for policy 1, policy_version 563358 (0.0011) [2023-12-26 04:06:58,203][123091] Updated weights for policy 0, policy_version 567449 (0.0008) [2023-12-26 04:06:58,266][123091] Updated weights for policy 0, policy_version 567459 (0.0007) [2023-12-26 04:06:58,333][123091] Updated weights for policy 0, policy_version 567469 (0.0008) [2023-12-26 04:06:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 289497088. Throughput: 0: 8810.1, 1: 9034.7. Samples: 289493008. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:06:58,785][121949] Avg episode reward: [(0, '6177.676'), (1, '5801.580')] [2023-12-26 04:06:59,078][123090] Updated weights for policy 1, policy_version 563368 (0.0011) [2023-12-26 04:06:59,152][123090] Updated weights for policy 1, policy_version 563378 (0.0009) [2023-12-26 04:06:59,174][123091] Updated weights for policy 0, policy_version 567479 (0.0010) [2023-12-26 04:06:59,213][123090] Updated weights for policy 1, policy_version 563388 (0.0008) [2023-12-26 04:06:59,242][123091] Updated weights for policy 0, policy_version 567489 (0.0008) [2023-12-26 04:06:59,311][123091] Updated weights for policy 0, policy_version 567499 (0.0010) [2023-12-26 04:06:59,973][123090] Updated weights for policy 1, policy_version 563398 (0.0009) [2023-12-26 04:07:00,033][123090] Updated weights for policy 1, policy_version 563408 (0.0010) [2023-12-26 04:07:00,094][123090] Updated weights for policy 1, policy_version 563418 (0.0009) [2023-12-26 04:07:00,104][123091] Updated weights for policy 0, policy_version 567509 (0.0009) [2023-12-26 04:07:00,163][123091] Updated weights for policy 0, policy_version 567519 (0.0011) [2023-12-26 04:07:00,225][123091] Updated weights for policy 0, policy_version 567529 (0.0010) [2023-12-26 04:07:00,719][123090] Updated weights for policy 1, policy_version 563428 (0.0008) [2023-12-26 04:07:00,767][123090] Updated weights for policy 1, policy_version 563438 (0.0005) [2023-12-26 04:07:00,821][123090] Updated weights for policy 1, policy_version 563448 (0.0005) [2023-12-26 04:07:00,892][123091] Updated weights for policy 0, policy_version 567539 (0.0009) [2023-12-26 04:07:00,938][123091] Updated weights for policy 0, policy_version 567549 (0.0005) [2023-12-26 04:07:00,985][123091] Updated weights for policy 0, policy_version 567559 (0.0005) [2023-12-26 04:07:01,577][123090] Updated weights for policy 1, policy_version 563458 (0.0006) [2023-12-26 04:07:01,645][123090] Updated weights for policy 1, policy_version 563468 (0.0009) [2023-12-26 04:07:01,692][123090] Updated weights for policy 1, policy_version 563478 (0.0010) [2023-12-26 04:07:01,756][123090] Updated weights for policy 1, policy_version 563488 (0.0011) [2023-12-26 04:07:01,800][123091] Updated weights for policy 0, policy_version 567569 (0.0007) [2023-12-26 04:07:01,861][123091] Updated weights for policy 0, policy_version 567579 (0.0008) [2023-12-26 04:07:01,919][123091] Updated weights for policy 0, policy_version 567589 (0.0009) [2023-12-26 04:07:01,981][123091] Updated weights for policy 0, policy_version 567599 (0.0007) [2023-12-26 04:07:02,583][123090] Updated weights for policy 1, policy_version 563498 (0.0011) [2023-12-26 04:07:02,644][123090] Updated weights for policy 1, policy_version 563508 (0.0011) [2023-12-26 04:07:02,713][123090] Updated weights for policy 1, policy_version 563518 (0.0006) [2023-12-26 04:07:02,736][123091] Updated weights for policy 0, policy_version 567609 (0.0010) [2023-12-26 04:07:02,787][123091] Updated weights for policy 0, policy_version 567619 (0.0010) [2023-12-26 04:07:02,850][123091] Updated weights for policy 0, policy_version 567629 (0.0007) [2023-12-26 04:07:03,390][123090] Updated weights for policy 1, policy_version 563528 (0.0005) [2023-12-26 04:07:03,441][123090] Updated weights for policy 1, policy_version 563538 (0.0009) [2023-12-26 04:07:03,497][123090] Updated weights for policy 1, policy_version 563548 (0.0009) [2023-12-26 04:07:03,659][123091] Updated weights for policy 0, policy_version 567640 (0.0008) [2023-12-26 04:07:03,712][123091] Updated weights for policy 0, policy_version 567651 (0.0010) [2023-12-26 04:07:03,766][123091] Updated weights for policy 0, policy_version 567663 (0.0011) [2023-12-26 04:07:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 289595392. Throughput: 0: 8866.0, 1: 9011.4. Samples: 289601936. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:03,785][121949] Avg episode reward: [(0, '6176.521'), (1, '5832.082')] [2023-12-26 04:07:04,284][123090] Updated weights for policy 1, policy_version 563558 (0.0009) [2023-12-26 04:07:04,341][123090] Updated weights for policy 1, policy_version 563568 (0.0009) [2023-12-26 04:07:04,391][123090] Updated weights for policy 1, policy_version 563578 (0.0009) [2023-12-26 04:07:04,630][123091] Updated weights for policy 0, policy_version 567673 (0.0010) [2023-12-26 04:07:04,688][123091] Updated weights for policy 0, policy_version 567683 (0.0009) [2023-12-26 04:07:04,751][123091] Updated weights for policy 0, policy_version 567693 (0.0009) [2023-12-26 04:07:05,244][123090] Updated weights for policy 1, policy_version 563588 (0.0008) [2023-12-26 04:07:05,292][123090] Updated weights for policy 1, policy_version 563598 (0.0005) [2023-12-26 04:07:05,346][123090] Updated weights for policy 1, policy_version 563608 (0.0005) [2023-12-26 04:07:05,599][123091] Updated weights for policy 0, policy_version 567703 (0.0009) [2023-12-26 04:07:05,659][123091] Updated weights for policy 0, policy_version 567713 (0.0009) [2023-12-26 04:07:05,722][123091] Updated weights for policy 0, policy_version 567723 (0.0009) [2023-12-26 04:07:06,068][123090] Updated weights for policy 1, policy_version 563618 (0.0006) [2023-12-26 04:07:06,130][123090] Updated weights for policy 1, policy_version 563628 (0.0007) [2023-12-26 04:07:06,189][123090] Updated weights for policy 1, policy_version 563638 (0.0006) [2023-12-26 04:07:06,256][123090] Updated weights for policy 1, policy_version 563648 (0.0010) [2023-12-26 04:07:06,567][123091] Updated weights for policy 0, policy_version 567733 (0.0007) [2023-12-26 04:07:06,642][123091] Updated weights for policy 0, policy_version 567743 (0.0009) [2023-12-26 04:07:06,710][123091] Updated weights for policy 0, policy_version 567753 (0.0010) [2023-12-26 04:07:06,872][123090] Updated weights for policy 1, policy_version 563658 (0.0009) [2023-12-26 04:07:06,944][123090] Updated weights for policy 1, policy_version 563668 (0.0006) [2023-12-26 04:07:07,008][123090] Updated weights for policy 1, policy_version 563678 (0.0005) [2023-12-26 04:07:07,603][123091] Updated weights for policy 0, policy_version 567763 (0.0010) [2023-12-26 04:07:07,632][123090] Updated weights for policy 1, policy_version 563688 (0.0010) [2023-12-26 04:07:07,665][123091] Updated weights for policy 0, policy_version 567773 (0.0008) [2023-12-26 04:07:07,688][123090] Updated weights for policy 1, policy_version 563698 (0.0010) [2023-12-26 04:07:07,731][123091] Updated weights for policy 0, policy_version 567783 (0.0008) [2023-12-26 04:07:07,750][123090] Updated weights for policy 1, policy_version 563708 (0.0005) [2023-12-26 04:07:08,474][123090] Updated weights for policy 1, policy_version 563718 (0.0008) [2023-12-26 04:07:08,505][123091] Updated weights for policy 0, policy_version 567793 (0.0009) [2023-12-26 04:07:08,522][123090] Updated weights for policy 1, policy_version 563728 (0.0010) [2023-12-26 04:07:08,559][123091] Updated weights for policy 0, policy_version 567803 (0.0010) [2023-12-26 04:07:08,574][123090] Updated weights for policy 1, policy_version 563738 (0.0010) [2023-12-26 04:07:08,621][123091] Updated weights for policy 0, policy_version 567813 (0.0007) [2023-12-26 04:07:08,683][123091] Updated weights for policy 0, policy_version 567823 (0.0009) [2023-12-26 04:07:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 289685504. Throughput: 0: 8844.3, 1: 9051.9. Samples: 289655044. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:08,785][121949] Avg episode reward: [(0, '6189.373'), (1, '5718.265')] [2023-12-26 04:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000563744_144318464.pth... [2023-12-26 04:07:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000567824_145367040.pth... [2023-12-26 04:07:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000566800_145104896.pth [2023-12-26 04:07:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000562688_144048128.pth [2023-12-26 04:07:09,447][123091] Updated weights for policy 0, policy_version 567833 (0.0009) [2023-12-26 04:07:09,490][123090] Updated weights for policy 1, policy_version 563748 (0.0009) [2023-12-26 04:07:09,513][123091] Updated weights for policy 0, policy_version 567843 (0.0006) [2023-12-26 04:07:09,557][123090] Updated weights for policy 1, policy_version 563758 (0.0008) [2023-12-26 04:07:09,572][123091] Updated weights for policy 0, policy_version 567853 (0.0009) [2023-12-26 04:07:09,617][123090] Updated weights for policy 1, policy_version 563768 (0.0008) [2023-12-26 04:07:10,290][123091] Updated weights for policy 0, policy_version 567863 (0.0011) [2023-12-26 04:07:10,360][123091] Updated weights for policy 0, policy_version 567873 (0.0011) [2023-12-26 04:07:10,423][123091] Updated weights for policy 0, policy_version 567883 (0.0011) [2023-12-26 04:07:10,464][123090] Updated weights for policy 1, policy_version 563778 (0.0009) [2023-12-26 04:07:10,524][123090] Updated weights for policy 1, policy_version 563788 (0.0010) [2023-12-26 04:07:10,581][123090] Updated weights for policy 1, policy_version 563798 (0.0010) [2023-12-26 04:07:10,636][123090] Updated weights for policy 1, policy_version 563808 (0.0009) [2023-12-26 04:07:11,215][123091] Updated weights for policy 0, policy_version 567893 (0.0011) [2023-12-26 04:07:11,287][123091] Updated weights for policy 0, policy_version 567903 (0.0011) [2023-12-26 04:07:11,359][123091] Updated weights for policy 0, policy_version 567913 (0.0010) [2023-12-26 04:07:11,523][123090] Updated weights for policy 1, policy_version 563818 (0.0009) [2023-12-26 04:07:11,589][123090] Updated weights for policy 1, policy_version 563828 (0.0010) [2023-12-26 04:07:11,663][123090] Updated weights for policy 1, policy_version 563838 (0.0009) [2023-12-26 04:07:12,204][123091] Updated weights for policy 0, policy_version 567923 (0.0010) [2023-12-26 04:07:12,266][123091] Updated weights for policy 0, policy_version 567933 (0.0010) [2023-12-26 04:07:12,337][123091] Updated weights for policy 0, policy_version 567943 (0.0010) [2023-12-26 04:07:12,490][123090] Updated weights for policy 1, policy_version 563848 (0.0009) [2023-12-26 04:07:12,552][123090] Updated weights for policy 1, policy_version 563858 (0.0010) [2023-12-26 04:07:12,613][123090] Updated weights for policy 1, policy_version 563869 (0.0010) [2023-12-26 04:07:13,191][123091] Updated weights for policy 0, policy_version 567953 (0.0010) [2023-12-26 04:07:13,247][123091] Updated weights for policy 0, policy_version 567963 (0.0010) [2023-12-26 04:07:13,318][123091] Updated weights for policy 0, policy_version 567973 (0.0006) [2023-12-26 04:07:13,391][123091] Updated weights for policy 0, policy_version 567983 (0.0007) [2023-12-26 04:07:13,469][123090] Updated weights for policy 1, policy_version 563879 (0.0006) [2023-12-26 04:07:13,520][123090] Updated weights for policy 1, policy_version 563889 (0.0005) [2023-12-26 04:07:13,579][123090] Updated weights for policy 1, policy_version 563899 (0.0005) [2023-12-26 04:07:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 289767424. Throughput: 0: 8814.2, 1: 8986.8. Samples: 289759072. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:13,785][121949] Avg episode reward: [(0, '6119.508'), (1, '5712.040')] [2023-12-26 04:07:14,036][123091] Updated weights for policy 0, policy_version 567993 (0.0009) [2023-12-26 04:07:14,093][123091] Updated weights for policy 0, policy_version 568003 (0.0008) [2023-12-26 04:07:14,144][123091] Updated weights for policy 0, policy_version 568013 (0.0005) [2023-12-26 04:07:14,392][123090] Updated weights for policy 1, policy_version 563909 (0.0008) [2023-12-26 04:07:14,447][123090] Updated weights for policy 1, policy_version 563920 (0.0010) [2023-12-26 04:07:14,497][123090] Updated weights for policy 1, policy_version 563930 (0.0009) [2023-12-26 04:07:14,910][123091] Updated weights for policy 0, policy_version 568023 (0.0005) [2023-12-26 04:07:14,975][123091] Updated weights for policy 0, policy_version 568033 (0.0005) [2023-12-26 04:07:15,039][123091] Updated weights for policy 0, policy_version 568043 (0.0008) [2023-12-26 04:07:15,397][123090] Updated weights for policy 1, policy_version 563940 (0.0009) [2023-12-26 04:07:15,460][123090] Updated weights for policy 1, policy_version 563950 (0.0010) [2023-12-26 04:07:15,514][123090] Updated weights for policy 1, policy_version 563960 (0.0009) [2023-12-26 04:07:15,842][123091] Updated weights for policy 0, policy_version 568053 (0.0009) [2023-12-26 04:07:15,908][123091] Updated weights for policy 0, policy_version 568063 (0.0010) [2023-12-26 04:07:15,963][123091] Updated weights for policy 0, policy_version 568074 (0.0010) [2023-12-26 04:07:16,306][123090] Updated weights for policy 1, policy_version 563970 (0.0010) [2023-12-26 04:07:16,358][123090] Updated weights for policy 1, policy_version 563980 (0.0009) [2023-12-26 04:07:16,417][123090] Updated weights for policy 1, policy_version 563990 (0.0010) [2023-12-26 04:07:16,470][123090] Updated weights for policy 1, policy_version 564000 (0.0009) [2023-12-26 04:07:16,819][123091] Updated weights for policy 0, policy_version 568084 (0.0009) [2023-12-26 04:07:16,887][123091] Updated weights for policy 0, policy_version 568094 (0.0009) [2023-12-26 04:07:16,955][123091] Updated weights for policy 0, policy_version 568104 (0.0010) [2023-12-26 04:07:17,280][123090] Updated weights for policy 1, policy_version 564010 (0.0005) [2023-12-26 04:07:17,341][123090] Updated weights for policy 1, policy_version 564020 (0.0007) [2023-12-26 04:07:17,390][123090] Updated weights for policy 1, policy_version 564030 (0.0009) [2023-12-26 04:07:17,783][123091] Updated weights for policy 0, policy_version 568114 (0.0009) [2023-12-26 04:07:17,837][123091] Updated weights for policy 0, policy_version 568124 (0.0008) [2023-12-26 04:07:17,901][123091] Updated weights for policy 0, policy_version 568134 (0.0009) [2023-12-26 04:07:17,969][123091] Updated weights for policy 0, policy_version 568144 (0.0009) [2023-12-26 04:07:18,114][123090] Updated weights for policy 1, policy_version 564040 (0.0009) [2023-12-26 04:07:18,168][123090] Updated weights for policy 1, policy_version 564050 (0.0009) [2023-12-26 04:07:18,218][123090] Updated weights for policy 1, policy_version 564060 (0.0009) [2023-12-26 04:07:18,777][123091] Updated weights for policy 0, policy_version 568154 (0.0010) [2023-12-26 04:07:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 289849344. Throughput: 0: 8734.7, 1: 8884.7. Samples: 289864180. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:18,785][121949] Avg episode reward: [(0, '6163.893'), (1, '5669.038')] [2023-12-26 04:07:18,834][123091] Updated weights for policy 0, policy_version 568164 (0.0010) [2023-12-26 04:07:18,900][123091] Updated weights for policy 0, policy_version 568174 (0.0009) [2023-12-26 04:07:19,029][123090] Updated weights for policy 1, policy_version 564070 (0.0007) [2023-12-26 04:07:19,077][123090] Updated weights for policy 1, policy_version 564080 (0.0008) [2023-12-26 04:07:19,131][123090] Updated weights for policy 1, policy_version 564090 (0.0010) [2023-12-26 04:07:19,763][123091] Updated weights for policy 0, policy_version 568184 (0.0009) [2023-12-26 04:07:19,836][123091] Updated weights for policy 0, policy_version 568194 (0.0008) [2023-12-26 04:07:19,900][123091] Updated weights for policy 0, policy_version 568204 (0.0008) [2023-12-26 04:07:19,952][123090] Updated weights for policy 1, policy_version 564100 (0.0010) [2023-12-26 04:07:20,022][123090] Updated weights for policy 1, policy_version 564110 (0.0010) [2023-12-26 04:07:20,090][123090] Updated weights for policy 1, policy_version 564120 (0.0010) [2023-12-26 04:07:20,691][123091] Updated weights for policy 0, policy_version 568214 (0.0009) [2023-12-26 04:07:20,754][123091] Updated weights for policy 0, policy_version 568224 (0.0007) [2023-12-26 04:07:20,805][123091] Updated weights for policy 0, policy_version 568234 (0.0005) [2023-12-26 04:07:20,963][123090] Updated weights for policy 1, policy_version 564130 (0.0010) [2023-12-26 04:07:21,032][123090] Updated weights for policy 1, policy_version 564140 (0.0009) [2023-12-26 04:07:21,099][123090] Updated weights for policy 1, policy_version 564150 (0.0009) [2023-12-26 04:07:21,159][123090] Updated weights for policy 1, policy_version 564160 (0.0010) [2023-12-26 04:07:21,617][123091] Updated weights for policy 0, policy_version 568244 (0.0008) [2023-12-26 04:07:21,682][123091] Updated weights for policy 0, policy_version 568254 (0.0010) [2023-12-26 04:07:21,750][123091] Updated weights for policy 0, policy_version 568264 (0.0009) [2023-12-26 04:07:22,090][123090] Updated weights for policy 1, policy_version 564170 (0.0010) [2023-12-26 04:07:22,153][123090] Updated weights for policy 1, policy_version 564180 (0.0010) [2023-12-26 04:07:22,207][123090] Updated weights for policy 1, policy_version 564190 (0.0010) [2023-12-26 04:07:22,585][123091] Updated weights for policy 0, policy_version 568274 (0.0007) [2023-12-26 04:07:22,638][123091] Updated weights for policy 0, policy_version 568284 (0.0010) [2023-12-26 04:07:22,697][123091] Updated weights for policy 0, policy_version 568295 (0.0010) [2023-12-26 04:07:23,059][123090] Updated weights for policy 1, policy_version 564200 (0.0010) [2023-12-26 04:07:23,123][123090] Updated weights for policy 1, policy_version 564210 (0.0007) [2023-12-26 04:07:23,194][123090] Updated weights for policy 1, policy_version 564220 (0.0005) [2023-12-26 04:07:23,500][123091] Updated weights for policy 0, policy_version 568305 (0.0009) [2023-12-26 04:07:23,551][123091] Updated weights for policy 0, policy_version 568315 (0.0005) [2023-12-26 04:07:23,612][123091] Updated weights for policy 0, policy_version 568325 (0.0006) [2023-12-26 04:07:23,664][123091] Updated weights for policy 0, policy_version 568335 (0.0005) [2023-12-26 04:07:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 289939456. Throughput: 0: 8687.4, 1: 8877.0. Samples: 289914924. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:23,785][121949] Avg episode reward: [(0, '6055.767'), (1, '5580.453')] [2023-12-26 04:07:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000568336_145498112.pth... [2023-12-26 04:07:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000567312_145235968.pth [2023-12-26 04:07:23,829][123090] Updated weights for policy 1, policy_version 564230 (0.0005) [2023-12-26 04:07:23,878][123090] Updated weights for policy 1, policy_version 564240 (0.0005) [2023-12-26 04:07:23,933][123090] Updated weights for policy 1, policy_version 564250 (0.0005) [2023-12-26 04:07:23,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000564256_144449536.pth... [2023-12-26 04:07:23,966][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000563200_144179200.pth [2023-12-26 04:07:24,348][123091] Updated weights for policy 0, policy_version 568345 (0.0005) [2023-12-26 04:07:24,402][123091] Updated weights for policy 0, policy_version 568355 (0.0005) [2023-12-26 04:07:24,477][123091] Updated weights for policy 0, policy_version 568365 (0.0005) [2023-12-26 04:07:24,775][123090] Updated weights for policy 1, policy_version 564260 (0.0007) [2023-12-26 04:07:24,833][123090] Updated weights for policy 1, policy_version 564270 (0.0009) [2023-12-26 04:07:24,887][123090] Updated weights for policy 1, policy_version 564280 (0.0010) [2023-12-26 04:07:25,082][123091] Updated weights for policy 0, policy_version 568375 (0.0008) [2023-12-26 04:07:25,142][123091] Updated weights for policy 0, policy_version 568385 (0.0010) [2023-12-26 04:07:25,203][123091] Updated weights for policy 0, policy_version 568395 (0.0006) [2023-12-26 04:07:25,633][123090] Updated weights for policy 1, policy_version 564290 (0.0009) [2023-12-26 04:07:25,687][123090] Updated weights for policy 1, policy_version 564300 (0.0005) [2023-12-26 04:07:25,736][123090] Updated weights for policy 1, policy_version 564310 (0.0005) [2023-12-26 04:07:25,792][123090] Updated weights for policy 1, policy_version 564320 (0.0006) [2023-12-26 04:07:25,946][123091] Updated weights for policy 0, policy_version 568405 (0.0005) [2023-12-26 04:07:26,010][123091] Updated weights for policy 0, policy_version 568415 (0.0005) [2023-12-26 04:07:26,077][123091] Updated weights for policy 0, policy_version 568425 (0.0005) [2023-12-26 04:07:26,481][123090] Updated weights for policy 1, policy_version 564330 (0.0009) [2023-12-26 04:07:26,535][123090] Updated weights for policy 1, policy_version 564341 (0.0010) [2023-12-26 04:07:26,596][123090] Updated weights for policy 1, policy_version 564352 (0.0009) [2023-12-26 04:07:26,714][123091] Updated weights for policy 0, policy_version 568435 (0.0005) [2023-12-26 04:07:26,787][123091] Updated weights for policy 0, policy_version 568445 (0.0009) [2023-12-26 04:07:26,852][123091] Updated weights for policy 0, policy_version 568455 (0.0009) [2023-12-26 04:07:27,433][123090] Updated weights for policy 1, policy_version 564362 (0.0010) [2023-12-26 04:07:27,491][123090] Updated weights for policy 1, policy_version 564372 (0.0010) [2023-12-26 04:07:27,560][123090] Updated weights for policy 1, policy_version 564382 (0.0010) [2023-12-26 04:07:27,582][123091] Updated weights for policy 0, policy_version 568465 (0.0009) [2023-12-26 04:07:27,645][123091] Updated weights for policy 0, policy_version 568475 (0.0011) [2023-12-26 04:07:27,719][123091] Updated weights for policy 0, policy_version 568485 (0.0011) [2023-12-26 04:07:27,762][123091] Updated weights for policy 0, policy_version 568495 (0.0010) [2023-12-26 04:07:28,260][123090] Updated weights for policy 1, policy_version 564392 (0.0006) [2023-12-26 04:07:28,326][123090] Updated weights for policy 1, policy_version 564402 (0.0005) [2023-12-26 04:07:28,393][123090] Updated weights for policy 1, policy_version 564412 (0.0007) [2023-12-26 04:07:28,521][123091] Updated weights for policy 0, policy_version 568505 (0.0006) [2023-12-26 04:07:28,579][123091] Updated weights for policy 0, policy_version 568515 (0.0008) [2023-12-26 04:07:28,655][123091] Updated weights for policy 0, policy_version 568525 (0.0006) [2023-12-26 04:07:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 290037760. Throughput: 0: 8818.2, 1: 8977.4. Samples: 290027876. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:28,785][121949] Avg episode reward: [(0, '6088.783'), (1, '5595.391')] [2023-12-26 04:07:29,155][123090] Updated weights for policy 1, policy_version 564422 (0.0006) [2023-12-26 04:07:29,219][123090] Updated weights for policy 1, policy_version 564432 (0.0006) [2023-12-26 04:07:29,283][123090] Updated weights for policy 1, policy_version 564442 (0.0010) [2023-12-26 04:07:29,321][123091] Updated weights for policy 0, policy_version 568535 (0.0010) [2023-12-26 04:07:29,392][123091] Updated weights for policy 0, policy_version 568545 (0.0010) [2023-12-26 04:07:29,465][123091] Updated weights for policy 0, policy_version 568555 (0.0011) [2023-12-26 04:07:30,095][123090] Updated weights for policy 1, policy_version 564452 (0.0009) [2023-12-26 04:07:30,150][123090] Updated weights for policy 1, policy_version 564462 (0.0008) [2023-12-26 04:07:30,202][123090] Updated weights for policy 1, policy_version 564472 (0.0008) [2023-12-26 04:07:30,321][123091] Updated weights for policy 0, policy_version 568565 (0.0011) [2023-12-26 04:07:30,372][123091] Updated weights for policy 0, policy_version 568575 (0.0010) [2023-12-26 04:07:30,423][123091] Updated weights for policy 0, policy_version 568585 (0.0010) [2023-12-26 04:07:30,915][123090] Updated weights for policy 1, policy_version 564482 (0.0007) [2023-12-26 04:07:30,963][123090] Updated weights for policy 1, policy_version 564492 (0.0010) [2023-12-26 04:07:31,007][123090] Updated weights for policy 1, policy_version 564502 (0.0010) [2023-12-26 04:07:31,068][123090] Updated weights for policy 1, policy_version 564512 (0.0011) [2023-12-26 04:07:31,253][123091] Updated weights for policy 0, policy_version 568595 (0.0010) [2023-12-26 04:07:31,319][123091] Updated weights for policy 0, policy_version 568605 (0.0009) [2023-12-26 04:07:31,386][123091] Updated weights for policy 0, policy_version 568615 (0.0009) [2023-12-26 04:07:31,938][123090] Updated weights for policy 1, policy_version 564522 (0.0009) [2023-12-26 04:07:31,994][123090] Updated weights for policy 1, policy_version 564532 (0.0009) [2023-12-26 04:07:32,048][123090] Updated weights for policy 1, policy_version 564542 (0.0009) [2023-12-26 04:07:32,066][123091] Updated weights for policy 0, policy_version 568625 (0.0008) [2023-12-26 04:07:32,122][123091] Updated weights for policy 0, policy_version 568635 (0.0005) [2023-12-26 04:07:32,178][123091] Updated weights for policy 0, policy_version 568645 (0.0005) [2023-12-26 04:07:32,237][123091] Updated weights for policy 0, policy_version 568655 (0.0006) [2023-12-26 04:07:32,848][123090] Updated weights for policy 1, policy_version 564552 (0.0010) [2023-12-26 04:07:32,905][123090] Updated weights for policy 1, policy_version 564562 (0.0010) [2023-12-26 04:07:32,937][123091] Updated weights for policy 0, policy_version 568665 (0.0009) [2023-12-26 04:07:32,957][123090] Updated weights for policy 1, policy_version 564572 (0.0007) [2023-12-26 04:07:32,987][123091] Updated weights for policy 0, policy_version 568676 (0.0010) [2023-12-26 04:07:33,053][123091] Updated weights for policy 0, policy_version 568686 (0.0005) [2023-12-26 04:07:33,750][123091] Updated weights for policy 0, policy_version 568696 (0.0005) [2023-12-26 04:07:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 290119680. Throughput: 0: 8884.6, 1: 8969.5. Samples: 290137388. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:33,784][121949] Avg episode reward: [(0, '6198.518'), (1, '5640.273')] [2023-12-26 04:07:33,808][123091] Updated weights for policy 0, policy_version 568706 (0.0006) [2023-12-26 04:07:33,810][123090] Updated weights for policy 1, policy_version 564582 (0.0007) [2023-12-26 04:07:33,858][123090] Updated weights for policy 1, policy_version 564592 (0.0007) [2023-12-26 04:07:33,861][123091] Updated weights for policy 0, policy_version 568716 (0.0008) [2023-12-26 04:07:33,904][123090] Updated weights for policy 1, policy_version 564602 (0.0009) [2023-12-26 04:07:34,661][123091] Updated weights for policy 0, policy_version 568726 (0.0009) [2023-12-26 04:07:34,726][123091] Updated weights for policy 0, policy_version 568736 (0.0009) [2023-12-26 04:07:34,754][123090] Updated weights for policy 1, policy_version 564612 (0.0009) [2023-12-26 04:07:34,776][123091] Updated weights for policy 0, policy_version 568746 (0.0008) [2023-12-26 04:07:34,821][123090] Updated weights for policy 1, policy_version 564622 (0.0006) [2023-12-26 04:07:34,879][123090] Updated weights for policy 1, policy_version 564632 (0.0005) [2023-12-26 04:07:35,501][123091] Updated weights for policy 0, policy_version 568756 (0.0006) [2023-12-26 04:07:35,536][123090] Updated weights for policy 1, policy_version 564642 (0.0005) [2023-12-26 04:07:35,558][123091] Updated weights for policy 0, policy_version 568766 (0.0006) [2023-12-26 04:07:35,593][123090] Updated weights for policy 1, policy_version 564652 (0.0009) [2023-12-26 04:07:35,608][123091] Updated weights for policy 0, policy_version 568776 (0.0006) [2023-12-26 04:07:35,654][123090] Updated weights for policy 1, policy_version 564662 (0.0009) [2023-12-26 04:07:35,718][123090] Updated weights for policy 1, policy_version 564672 (0.0009) [2023-12-26 04:07:36,323][123091] Updated weights for policy 0, policy_version 568786 (0.0007) [2023-12-26 04:07:36,393][123091] Updated weights for policy 0, policy_version 568796 (0.0007) [2023-12-26 04:07:36,468][123091] Updated weights for policy 0, policy_version 568806 (0.0009) [2023-12-26 04:07:36,536][123091] Updated weights for policy 0, policy_version 568816 (0.0011) [2023-12-26 04:07:36,610][123090] Updated weights for policy 1, policy_version 564682 (0.0008) [2023-12-26 04:07:36,672][123090] Updated weights for policy 1, policy_version 564692 (0.0009) [2023-12-26 04:07:36,737][123090] Updated weights for policy 1, policy_version 564702 (0.0009) [2023-12-26 04:07:37,306][123091] Updated weights for policy 0, policy_version 568826 (0.0009) [2023-12-26 04:07:37,359][123091] Updated weights for policy 0, policy_version 568836 (0.0010) [2023-12-26 04:07:37,411][123091] Updated weights for policy 0, policy_version 568846 (0.0010) [2023-12-26 04:07:37,518][123090] Updated weights for policy 1, policy_version 564712 (0.0009) [2023-12-26 04:07:37,579][123090] Updated weights for policy 1, policy_version 564722 (0.0009) [2023-12-26 04:07:37,646][123090] Updated weights for policy 1, policy_version 564732 (0.0005) [2023-12-26 04:07:38,274][123091] Updated weights for policy 0, policy_version 568856 (0.0009) [2023-12-26 04:07:38,333][123091] Updated weights for policy 0, policy_version 568866 (0.0008) [2023-12-26 04:07:38,393][123091] Updated weights for policy 0, policy_version 568876 (0.0009) [2023-12-26 04:07:38,449][123090] Updated weights for policy 1, policy_version 564742 (0.0009) [2023-12-26 04:07:38,518][123090] Updated weights for policy 1, policy_version 564752 (0.0010) [2023-12-26 04:07:38,575][123090] Updated weights for policy 1, policy_version 564762 (0.0009) [2023-12-26 04:07:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 290217984. Throughput: 0: 8969.7, 1: 8965.8. Samples: 290192588. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:38,785][121949] Avg episode reward: [(0, '6092.840'), (1, '5755.807')] [2023-12-26 04:07:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000564768_144580608.pth... [2023-12-26 04:07:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000568880_145637376.pth... [2023-12-26 04:07:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000567824_145367040.pth [2023-12-26 04:07:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000563744_144318464.pth [2023-12-26 04:07:39,191][123091] Updated weights for policy 0, policy_version 568886 (0.0010) [2023-12-26 04:07:39,264][123091] Updated weights for policy 0, policy_version 568896 (0.0011) [2023-12-26 04:07:39,332][123091] Updated weights for policy 0, policy_version 568906 (0.0011) [2023-12-26 04:07:39,447][123090] Updated weights for policy 1, policy_version 564772 (0.0009) [2023-12-26 04:07:39,500][123090] Updated weights for policy 1, policy_version 564782 (0.0008) [2023-12-26 04:07:39,562][123090] Updated weights for policy 1, policy_version 564792 (0.0009) [2023-12-26 04:07:40,114][123091] Updated weights for policy 0, policy_version 568916 (0.0008) [2023-12-26 04:07:40,173][123091] Updated weights for policy 0, policy_version 568926 (0.0005) [2023-12-26 04:07:40,227][123091] Updated weights for policy 0, policy_version 568936 (0.0006) [2023-12-26 04:07:40,486][123090] Updated weights for policy 1, policy_version 564802 (0.0009) [2023-12-26 04:07:40,555][123090] Updated weights for policy 1, policy_version 564812 (0.0009) [2023-12-26 04:07:40,617][123090] Updated weights for policy 1, policy_version 564822 (0.0008) [2023-12-26 04:07:40,684][123090] Updated weights for policy 1, policy_version 564832 (0.0011) [2023-12-26 04:07:40,921][123091] Updated weights for policy 0, policy_version 568946 (0.0006) [2023-12-26 04:07:40,986][123091] Updated weights for policy 0, policy_version 568956 (0.0009) [2023-12-26 04:07:41,052][123091] Updated weights for policy 0, policy_version 568966 (0.0009) [2023-12-26 04:07:41,117][123091] Updated weights for policy 0, policy_version 568976 (0.0009) [2023-12-26 04:07:41,531][123090] Updated weights for policy 1, policy_version 564842 (0.0011) [2023-12-26 04:07:41,587][123090] Updated weights for policy 1, policy_version 564852 (0.0010) [2023-12-26 04:07:41,651][123090] Updated weights for policy 1, policy_version 564862 (0.0010) [2023-12-26 04:07:41,987][123091] Updated weights for policy 0, policy_version 568986 (0.0009) [2023-12-26 04:07:42,057][123091] Updated weights for policy 0, policy_version 568996 (0.0009) [2023-12-26 04:07:42,118][123091] Updated weights for policy 0, policy_version 569006 (0.0009) [2023-12-26 04:07:42,511][123090] Updated weights for policy 1, policy_version 564872 (0.0009) [2023-12-26 04:07:42,580][123090] Updated weights for policy 1, policy_version 564882 (0.0011) [2023-12-26 04:07:42,649][123090] Updated weights for policy 1, policy_version 564892 (0.0011) [2023-12-26 04:07:42,977][123091] Updated weights for policy 0, policy_version 569016 (0.0009) [2023-12-26 04:07:43,031][123091] Updated weights for policy 0, policy_version 569026 (0.0009) [2023-12-26 04:07:43,080][123091] Updated weights for policy 0, policy_version 569036 (0.0009) [2023-12-26 04:07:43,479][123090] Updated weights for policy 1, policy_version 564902 (0.0011) [2023-12-26 04:07:43,541][123090] Updated weights for policy 1, policy_version 564912 (0.0010) [2023-12-26 04:07:43,602][123090] Updated weights for policy 1, policy_version 564922 (0.0010) [2023-12-26 04:07:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 290299904. Throughput: 0: 8977.8, 1: 8818.2. Samples: 290293832. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:43,785][121949] Avg episode reward: [(0, '6031.742'), (1, '5754.162')] [2023-12-26 04:07:43,948][123091] Updated weights for policy 0, policy_version 569046 (0.0009) [2023-12-26 04:07:44,004][123091] Updated weights for policy 0, policy_version 569056 (0.0009) [2023-12-26 04:07:44,058][123091] Updated weights for policy 0, policy_version 569066 (0.0009) [2023-12-26 04:07:44,398][123090] Updated weights for policy 1, policy_version 564932 (0.0010) [2023-12-26 04:07:44,466][123090] Updated weights for policy 1, policy_version 564942 (0.0008) [2023-12-26 04:07:44,534][123090] Updated weights for policy 1, policy_version 564952 (0.0005) [2023-12-26 04:07:44,867][123091] Updated weights for policy 0, policy_version 569076 (0.0010) [2023-12-26 04:07:44,935][123091] Updated weights for policy 0, policy_version 569086 (0.0008) [2023-12-26 04:07:45,004][123091] Updated weights for policy 0, policy_version 569096 (0.0006) [2023-12-26 04:07:45,358][123090] Updated weights for policy 1, policy_version 564962 (0.0006) [2023-12-26 04:07:45,420][123090] Updated weights for policy 1, policy_version 564972 (0.0010) [2023-12-26 04:07:45,476][123090] Updated weights for policy 1, policy_version 564982 (0.0009) [2023-12-26 04:07:45,526][123090] Updated weights for policy 1, policy_version 564992 (0.0008) [2023-12-26 04:07:45,634][123091] Updated weights for policy 0, policy_version 569106 (0.0006) [2023-12-26 04:07:45,700][123091] Updated weights for policy 0, policy_version 569116 (0.0008) [2023-12-26 04:07:45,766][123091] Updated weights for policy 0, policy_version 569126 (0.0011) [2023-12-26 04:07:45,825][123091] Updated weights for policy 0, policy_version 569136 (0.0010) [2023-12-26 04:07:46,334][123090] Updated weights for policy 1, policy_version 565002 (0.0011) [2023-12-26 04:07:46,390][123090] Updated weights for policy 1, policy_version 565012 (0.0010) [2023-12-26 04:07:46,440][123091] Updated weights for policy 0, policy_version 569146 (0.0005) [2023-12-26 04:07:46,454][123090] Updated weights for policy 1, policy_version 565022 (0.0010) [2023-12-26 04:07:46,503][123091] Updated weights for policy 0, policy_version 569156 (0.0005) [2023-12-26 04:07:46,567][123091] Updated weights for policy 0, policy_version 569166 (0.0005) [2023-12-26 04:07:47,277][123091] Updated weights for policy 0, policy_version 569176 (0.0009) [2023-12-26 04:07:47,289][123090] Updated weights for policy 1, policy_version 565032 (0.0008) [2023-12-26 04:07:47,330][123091] Updated weights for policy 0, policy_version 569186 (0.0006) [2023-12-26 04:07:47,365][123090] Updated weights for policy 1, policy_version 565042 (0.0010) [2023-12-26 04:07:47,389][123091] Updated weights for policy 0, policy_version 569196 (0.0007) [2023-12-26 04:07:47,434][123090] Updated weights for policy 1, policy_version 565052 (0.0009) [2023-12-26 04:07:48,227][123091] Updated weights for policy 0, policy_version 569206 (0.0009) [2023-12-26 04:07:48,257][123090] Updated weights for policy 1, policy_version 565062 (0.0009) [2023-12-26 04:07:48,272][123091] Updated weights for policy 0, policy_version 569216 (0.0008) [2023-12-26 04:07:48,319][123090] Updated weights for policy 1, policy_version 565072 (0.0008) [2023-12-26 04:07:48,327][123091] Updated weights for policy 0, policy_version 569226 (0.0010) [2023-12-26 04:07:48,383][123090] Updated weights for policy 1, policy_version 565082 (0.0008) [2023-12-26 04:07:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 290390016. Throughput: 0: 8973.2, 1: 8753.8. Samples: 290399652. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:48,785][121949] Avg episode reward: [(0, '6067.717'), (1, '5673.924')] [2023-12-26 04:07:49,173][123091] Updated weights for policy 0, policy_version 569236 (0.0010) [2023-12-26 04:07:49,213][123090] Updated weights for policy 1, policy_version 565092 (0.0008) [2023-12-26 04:07:49,231][123091] Updated weights for policy 0, policy_version 569246 (0.0008) [2023-12-26 04:07:49,278][123090] Updated weights for policy 1, policy_version 565102 (0.0008) [2023-12-26 04:07:49,298][123091] Updated weights for policy 0, policy_version 569256 (0.0008) [2023-12-26 04:07:49,344][123090] Updated weights for policy 1, policy_version 565112 (0.0008) [2023-12-26 04:07:50,134][123091] Updated weights for policy 0, policy_version 569266 (0.0009) [2023-12-26 04:07:50,164][123090] Updated weights for policy 1, policy_version 565122 (0.0008) [2023-12-26 04:07:50,209][123091] Updated weights for policy 0, policy_version 569276 (0.0006) [2023-12-26 04:07:50,236][123090] Updated weights for policy 1, policy_version 565132 (0.0009) [2023-12-26 04:07:50,275][123091] Updated weights for policy 0, policy_version 569286 (0.0009) [2023-12-26 04:07:50,300][123090] Updated weights for policy 1, policy_version 565142 (0.0010) [2023-12-26 04:07:50,333][123091] Updated weights for policy 0, policy_version 569296 (0.0009) [2023-12-26 04:07:50,369][123090] Updated weights for policy 1, policy_version 565152 (0.0009) [2023-12-26 04:07:51,078][123090] Updated weights for policy 1, policy_version 565162 (0.0008) [2023-12-26 04:07:51,154][123090] Updated weights for policy 1, policy_version 565172 (0.0006) [2023-12-26 04:07:51,222][123090] Updated weights for policy 1, policy_version 565182 (0.0008) [2023-12-26 04:07:51,230][123091] Updated weights for policy 0, policy_version 569306 (0.0008) [2023-12-26 04:07:51,294][123091] Updated weights for policy 0, policy_version 569316 (0.0010) [2023-12-26 04:07:51,344][123091] Updated weights for policy 0, policy_version 569326 (0.0009) [2023-12-26 04:07:52,047][123090] Updated weights for policy 1, policy_version 565192 (0.0010) [2023-12-26 04:07:52,111][123090] Updated weights for policy 1, policy_version 565202 (0.0010) [2023-12-26 04:07:52,167][123090] Updated weights for policy 1, policy_version 565212 (0.0010) [2023-12-26 04:07:52,208][123091] Updated weights for policy 0, policy_version 569336 (0.0006) [2023-12-26 04:07:52,269][123091] Updated weights for policy 0, policy_version 569346 (0.0007) [2023-12-26 04:07:52,337][123091] Updated weights for policy 0, policy_version 569356 (0.0009) [2023-12-26 04:07:52,938][123090] Updated weights for policy 1, policy_version 565222 (0.0008) [2023-12-26 04:07:53,011][123090] Updated weights for policy 1, policy_version 565232 (0.0006) [2023-12-26 04:07:53,068][123090] Updated weights for policy 1, policy_version 565242 (0.0006) [2023-12-26 04:07:53,195][123091] Updated weights for policy 0, policy_version 569366 (0.0010) [2023-12-26 04:07:53,241][123091] Updated weights for policy 0, policy_version 569376 (0.0006) [2023-12-26 04:07:53,294][123091] Updated weights for policy 0, policy_version 569386 (0.0006) [2023-12-26 04:07:53,756][123090] Updated weights for policy 1, policy_version 565252 (0.0005) [2023-12-26 04:07:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 290471936. Throughput: 0: 8953.0, 1: 8726.5. Samples: 290450620. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:53,785][121949] Avg episode reward: [(0, '6157.491'), (1, '5731.618')] [2023-12-26 04:07:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000569392_145768448.pth... [2023-12-26 04:07:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000568336_145498112.pth [2023-12-26 04:07:53,816][123090] Updated weights for policy 1, policy_version 565262 (0.0006) [2023-12-26 04:07:53,875][123090] Updated weights for policy 1, policy_version 565272 (0.0006) [2023-12-26 04:07:53,919][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000565280_144711680.pth... [2023-12-26 04:07:53,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000564256_144449536.pth [2023-12-26 04:07:53,993][123091] Updated weights for policy 0, policy_version 569396 (0.0005) [2023-12-26 04:07:54,042][123091] Updated weights for policy 0, policy_version 569406 (0.0008) [2023-12-26 04:07:54,101][123091] Updated weights for policy 0, policy_version 569416 (0.0007) [2023-12-26 04:07:54,665][123090] Updated weights for policy 1, policy_version 565282 (0.0007) [2023-12-26 04:07:54,718][123090] Updated weights for policy 1, policy_version 565292 (0.0007) [2023-12-26 04:07:54,765][123090] Updated weights for policy 1, policy_version 565302 (0.0010) [2023-12-26 04:07:54,816][123091] Updated weights for policy 0, policy_version 569426 (0.0005) [2023-12-26 04:07:54,823][123090] Updated weights for policy 1, policy_version 565312 (0.0006) [2023-12-26 04:07:54,875][123091] Updated weights for policy 0, policy_version 569436 (0.0007) [2023-12-26 04:07:54,928][123091] Updated weights for policy 0, policy_version 569446 (0.0010) [2023-12-26 04:07:54,977][123091] Updated weights for policy 0, policy_version 569456 (0.0011) [2023-12-26 04:07:55,607][123090] Updated weights for policy 1, policy_version 565322 (0.0010) [2023-12-26 04:07:55,670][123090] Updated weights for policy 1, policy_version 565332 (0.0010) [2023-12-26 04:07:55,691][123091] Updated weights for policy 0, policy_version 569466 (0.0008) [2023-12-26 04:07:55,736][123090] Updated weights for policy 1, policy_version 565342 (0.0010) [2023-12-26 04:07:55,753][123091] Updated weights for policy 0, policy_version 569476 (0.0010) [2023-12-26 04:07:55,819][123091] Updated weights for policy 0, policy_version 569486 (0.0011) [2023-12-26 04:07:56,488][123091] Updated weights for policy 0, policy_version 569496 (0.0005) [2023-12-26 04:07:56,531][123090] Updated weights for policy 1, policy_version 565352 (0.0006) [2023-12-26 04:07:56,543][123091] Updated weights for policy 0, policy_version 569506 (0.0007) [2023-12-26 04:07:56,589][123090] Updated weights for policy 1, policy_version 565362 (0.0005) [2023-12-26 04:07:56,597][123091] Updated weights for policy 0, policy_version 569516 (0.0006) [2023-12-26 04:07:56,644][123090] Updated weights for policy 1, policy_version 565372 (0.0005) [2023-12-26 04:07:57,325][123090] Updated weights for policy 1, policy_version 565382 (0.0008) [2023-12-26 04:07:57,335][123091] Updated weights for policy 0, policy_version 569526 (0.0006) [2023-12-26 04:07:57,386][123091] Updated weights for policy 0, policy_version 569536 (0.0008) [2023-12-26 04:07:57,391][123090] Updated weights for policy 1, policy_version 565392 (0.0005) [2023-12-26 04:07:57,428][123091] Updated weights for policy 0, policy_version 569546 (0.0007) [2023-12-26 04:07:57,453][123090] Updated weights for policy 1, policy_version 565402 (0.0005) [2023-12-26 04:07:58,106][123091] Updated weights for policy 0, policy_version 569556 (0.0008) [2023-12-26 04:07:58,155][123090] Updated weights for policy 1, policy_version 565412 (0.0007) [2023-12-26 04:07:58,166][123091] Updated weights for policy 0, policy_version 569566 (0.0009) [2023-12-26 04:07:58,218][123090] Updated weights for policy 1, policy_version 565422 (0.0010) [2023-12-26 04:07:58,231][123091] Updated weights for policy 0, policy_version 569576 (0.0008) [2023-12-26 04:07:58,289][123090] Updated weights for policy 1, policy_version 565432 (0.0010) [2023-12-26 04:07:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 290570240. Throughput: 0: 9110.6, 1: 8778.5. Samples: 290564088. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:07:58,785][121949] Avg episode reward: [(0, '6248.934'), (1, '5790.478')] [2023-12-26 04:07:59,045][123091] Updated weights for policy 0, policy_version 569586 (0.0008) [2023-12-26 04:07:59,113][123090] Updated weights for policy 1, policy_version 565442 (0.0010) [2023-12-26 04:07:59,114][123091] Updated weights for policy 0, policy_version 569596 (0.0008) [2023-12-26 04:07:59,176][123091] Updated weights for policy 0, policy_version 569606 (0.0008) [2023-12-26 04:07:59,178][123090] Updated weights for policy 1, policy_version 565452 (0.0008) [2023-12-26 04:07:59,249][123091] Updated weights for policy 0, policy_version 569616 (0.0008) [2023-12-26 04:07:59,251][123090] Updated weights for policy 1, policy_version 565462 (0.0008) [2023-12-26 04:07:59,319][123090] Updated weights for policy 1, policy_version 565472 (0.0007) [2023-12-26 04:08:00,006][123091] Updated weights for policy 0, policy_version 569626 (0.0009) [2023-12-26 04:08:00,073][123091] Updated weights for policy 0, policy_version 569636 (0.0010) [2023-12-26 04:08:00,130][123091] Updated weights for policy 0, policy_version 569646 (0.0008) [2023-12-26 04:08:00,166][123090] Updated weights for policy 1, policy_version 565482 (0.0007) [2023-12-26 04:08:00,224][123090] Updated weights for policy 1, policy_version 565492 (0.0005) [2023-12-26 04:08:00,287][123090] Updated weights for policy 1, policy_version 565502 (0.0008) [2023-12-26 04:08:00,967][123091] Updated weights for policy 0, policy_version 569656 (0.0009) [2023-12-26 04:08:00,997][123090] Updated weights for policy 1, policy_version 565512 (0.0006) [2023-12-26 04:08:01,020][123091] Updated weights for policy 0, policy_version 569667 (0.0008) [2023-12-26 04:08:01,064][123090] Updated weights for policy 1, policy_version 565522 (0.0008) [2023-12-26 04:08:01,084][123091] Updated weights for policy 0, policy_version 569677 (0.0007) [2023-12-26 04:08:01,133][123090] Updated weights for policy 1, policy_version 565532 (0.0008) [2023-12-26 04:08:01,913][123090] Updated weights for policy 1, policy_version 565542 (0.0007) [2023-12-26 04:08:01,974][123090] Updated weights for policy 1, policy_version 565552 (0.0009) [2023-12-26 04:08:01,978][123091] Updated weights for policy 0, policy_version 569687 (0.0008) [2023-12-26 04:08:02,037][123091] Updated weights for policy 0, policy_version 569697 (0.0010) [2023-12-26 04:08:02,038][123090] Updated weights for policy 1, policy_version 565562 (0.0008) [2023-12-26 04:08:02,089][123091] Updated weights for policy 0, policy_version 569707 (0.0008) [2023-12-26 04:08:02,840][123090] Updated weights for policy 1, policy_version 565572 (0.0009) [2023-12-26 04:08:02,891][123090] Updated weights for policy 1, policy_version 565582 (0.0009) [2023-12-26 04:08:02,920][123091] Updated weights for policy 0, policy_version 569717 (0.0007) [2023-12-26 04:08:02,952][123090] Updated weights for policy 1, policy_version 565592 (0.0008) [2023-12-26 04:08:02,986][123091] Updated weights for policy 0, policy_version 569727 (0.0008) [2023-12-26 04:08:03,044][123091] Updated weights for policy 0, policy_version 569737 (0.0009) [2023-12-26 04:08:03,767][123091] Updated weights for policy 0, policy_version 569747 (0.0007) [2023-12-26 04:08:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 290652160. Throughput: 0: 9107.1, 1: 8778.6. Samples: 290669036. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:08:03,785][121949] Avg episode reward: [(0, '6202.000'), (1, '5696.777')] [2023-12-26 04:08:03,797][123090] Updated weights for policy 1, policy_version 565602 (0.0009) [2023-12-26 04:08:03,824][123091] Updated weights for policy 0, policy_version 569757 (0.0005) [2023-12-26 04:08:03,862][123090] Updated weights for policy 1, policy_version 565612 (0.0007) [2023-12-26 04:08:03,888][123091] Updated weights for policy 0, policy_version 569767 (0.0008) [2023-12-26 04:08:03,926][123090] Updated weights for policy 1, policy_version 565622 (0.0006) [2023-12-26 04:08:03,993][123090] Updated weights for policy 1, policy_version 565632 (0.0006) [2023-12-26 04:08:04,729][123091] Updated weights for policy 0, policy_version 569777 (0.0009) [2023-12-26 04:08:04,738][123090] Updated weights for policy 1, policy_version 565642 (0.0009) [2023-12-26 04:08:04,784][123091] Updated weights for policy 0, policy_version 569787 (0.0010) [2023-12-26 04:08:04,799][123090] Updated weights for policy 1, policy_version 565652 (0.0007) [2023-12-26 04:08:04,834][123091] Updated weights for policy 0, policy_version 569797 (0.0009) [2023-12-26 04:08:04,846][123090] Updated weights for policy 1, policy_version 565662 (0.0007) [2023-12-26 04:08:04,886][123091] Updated weights for policy 0, policy_version 569807 (0.0010) [2023-12-26 04:08:05,642][123090] Updated weights for policy 1, policy_version 565672 (0.0010) [2023-12-26 04:08:05,706][123090] Updated weights for policy 1, policy_version 565682 (0.0009) [2023-12-26 04:08:05,746][123091] Updated weights for policy 0, policy_version 569817 (0.0010) [2023-12-26 04:08:05,768][123090] Updated weights for policy 1, policy_version 565692 (0.0009) [2023-12-26 04:08:05,816][123091] Updated weights for policy 0, policy_version 569827 (0.0010) [2023-12-26 04:08:05,868][123091] Updated weights for policy 0, policy_version 569838 (0.0010) [2023-12-26 04:08:06,624][123090] Updated weights for policy 1, policy_version 565702 (0.0009) [2023-12-26 04:08:06,680][123090] Updated weights for policy 1, policy_version 565712 (0.0010) [2023-12-26 04:08:06,725][123091] Updated weights for policy 0, policy_version 569848 (0.0009) [2023-12-26 04:08:06,740][123090] Updated weights for policy 1, policy_version 565722 (0.0008) [2023-12-26 04:08:06,783][123091] Updated weights for policy 0, policy_version 569858 (0.0006) [2023-12-26 04:08:06,839][123091] Updated weights for policy 0, policy_version 569868 (0.0010) [2023-12-26 04:08:07,592][123090] Updated weights for policy 1, policy_version 565732 (0.0009) [2023-12-26 04:08:07,653][123090] Updated weights for policy 1, policy_version 565742 (0.0010) [2023-12-26 04:08:07,672][123091] Updated weights for policy 0, policy_version 569878 (0.0009) [2023-12-26 04:08:07,709][123090] Updated weights for policy 1, policy_version 565752 (0.0008) [2023-12-26 04:08:07,729][123091] Updated weights for policy 0, policy_version 569888 (0.0009) [2023-12-26 04:08:07,782][123091] Updated weights for policy 0, policy_version 569898 (0.0007) [2023-12-26 04:08:08,553][123090] Updated weights for policy 1, policy_version 565762 (0.0008) [2023-12-26 04:08:08,612][123090] Updated weights for policy 1, policy_version 565772 (0.0009) [2023-12-26 04:08:08,654][123091] Updated weights for policy 0, policy_version 569908 (0.0009) [2023-12-26 04:08:08,671][123090] Updated weights for policy 1, policy_version 565782 (0.0008) [2023-12-26 04:08:08,715][123091] Updated weights for policy 0, policy_version 569918 (0.0008) [2023-12-26 04:08:08,725][123090] Updated weights for policy 1, policy_version 565792 (0.0008) [2023-12-26 04:08:08,779][123091] Updated weights for policy 0, policy_version 569928 (0.0008) [2023-12-26 04:08:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 290742272. Throughput: 0: 9100.6, 1: 8822.4. Samples: 290721456. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:08:08,785][121949] Avg episode reward: [(0, '6245.405'), (1, '5707.190')] [2023-12-26 04:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000565792_144842752.pth... [2023-12-26 04:08:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000564768_144580608.pth [2023-12-26 04:08:08,833][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000569936_145907712.pth... [2023-12-26 04:08:08,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000568880_145637376.pth [2023-12-26 04:08:09,594][123090] Updated weights for policy 1, policy_version 565802 (0.0009) [2023-12-26 04:08:09,630][123091] Updated weights for policy 0, policy_version 569938 (0.0009) [2023-12-26 04:08:09,661][123090] Updated weights for policy 1, policy_version 565812 (0.0009) [2023-12-26 04:08:09,691][123091] Updated weights for policy 0, policy_version 569948 (0.0008) [2023-12-26 04:08:09,712][123090] Updated weights for policy 1, policy_version 565822 (0.0008) [2023-12-26 04:08:09,741][123091] Updated weights for policy 0, policy_version 569958 (0.0008) [2023-12-26 04:08:09,828][123091] Updated weights for policy 0, policy_version 569968 (0.0009) [2023-12-26 04:08:10,532][123090] Updated weights for policy 1, policy_version 565832 (0.0010) [2023-12-26 04:08:10,592][123090] Updated weights for policy 1, policy_version 565842 (0.0010) [2023-12-26 04:08:10,647][123090] Updated weights for policy 1, policy_version 565852 (0.0009) [2023-12-26 04:08:10,658][123091] Updated weights for policy 0, policy_version 569978 (0.0005) [2023-12-26 04:08:10,720][123091] Updated weights for policy 0, policy_version 569988 (0.0009) [2023-12-26 04:08:10,774][123091] Updated weights for policy 0, policy_version 569998 (0.0010) [2023-12-26 04:08:11,445][123090] Updated weights for policy 1, policy_version 565862 (0.0010) [2023-12-26 04:08:11,511][123090] Updated weights for policy 1, policy_version 565872 (0.0010) [2023-12-26 04:08:11,563][123090] Updated weights for policy 1, policy_version 565882 (0.0010) [2023-12-26 04:08:11,578][123091] Updated weights for policy 0, policy_version 570008 (0.0010) [2023-12-26 04:08:11,645][123091] Updated weights for policy 0, policy_version 570018 (0.0011) [2023-12-26 04:08:11,720][123091] Updated weights for policy 0, policy_version 570028 (0.0011) [2023-12-26 04:08:12,418][123090] Updated weights for policy 1, policy_version 565892 (0.0010) [2023-12-26 04:08:12,485][123090] Updated weights for policy 1, policy_version 565902 (0.0010) [2023-12-26 04:08:12,495][123091] Updated weights for policy 0, policy_version 570038 (0.0009) [2023-12-26 04:08:12,548][123090] Updated weights for policy 1, policy_version 565912 (0.0010) [2023-12-26 04:08:12,557][123091] Updated weights for policy 0, policy_version 570048 (0.0008) [2023-12-26 04:08:12,617][123091] Updated weights for policy 0, policy_version 570058 (0.0009) [2023-12-26 04:08:13,276][123090] Updated weights for policy 1, policy_version 565922 (0.0007) [2023-12-26 04:08:13,340][123090] Updated weights for policy 1, policy_version 565932 (0.0011) [2023-12-26 04:08:13,396][123090] Updated weights for policy 1, policy_version 565942 (0.0010) [2023-12-26 04:08:13,400][123091] Updated weights for policy 0, policy_version 570068 (0.0010) [2023-12-26 04:08:13,456][123091] Updated weights for policy 0, policy_version 570078 (0.0009) [2023-12-26 04:08:13,457][123090] Updated weights for policy 1, policy_version 565952 (0.0009) [2023-12-26 04:08:13,509][123091] Updated weights for policy 0, policy_version 570088 (0.0009) [2023-12-26 04:08:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 290832384. Throughput: 0: 8928.9, 1: 8729.9. Samples: 290822520. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:08:13,784][121949] Avg episode reward: [(0, '6207.060'), (1, '5807.817')] [2023-12-26 04:08:14,194][123090] Updated weights for policy 1, policy_version 565962 (0.0010) [2023-12-26 04:08:14,249][123090] Updated weights for policy 1, policy_version 565972 (0.0010) [2023-12-26 04:08:14,304][123090] Updated weights for policy 1, policy_version 565982 (0.0010) [2023-12-26 04:08:14,414][123091] Updated weights for policy 0, policy_version 570098 (0.0010) [2023-12-26 04:08:14,479][123091] Updated weights for policy 0, policy_version 570108 (0.0009) [2023-12-26 04:08:14,538][123091] Updated weights for policy 0, policy_version 570118 (0.0008) [2023-12-26 04:08:14,594][123091] Updated weights for policy 0, policy_version 570128 (0.0009) [2023-12-26 04:08:15,166][123090] Updated weights for policy 1, policy_version 565992 (0.0009) [2023-12-26 04:08:15,230][123090] Updated weights for policy 1, policy_version 566002 (0.0009) [2023-12-26 04:08:15,295][123090] Updated weights for policy 1, policy_version 566012 (0.0011) [2023-12-26 04:08:15,444][123091] Updated weights for policy 0, policy_version 570138 (0.0009) [2023-12-26 04:08:15,506][123091] Updated weights for policy 0, policy_version 570148 (0.0009) [2023-12-26 04:08:15,571][123091] Updated weights for policy 0, policy_version 570158 (0.0009) [2023-12-26 04:08:16,065][123090] Updated weights for policy 1, policy_version 566022 (0.0007) [2023-12-26 04:08:16,126][123090] Updated weights for policy 1, policy_version 566032 (0.0008) [2023-12-26 04:08:16,181][123090] Updated weights for policy 1, policy_version 566042 (0.0005) [2023-12-26 04:08:16,352][123091] Updated weights for policy 0, policy_version 570168 (0.0010) [2023-12-26 04:08:16,406][123091] Updated weights for policy 0, policy_version 570178 (0.0010) [2023-12-26 04:08:16,468][123091] Updated weights for policy 0, policy_version 570189 (0.0010) [2023-12-26 04:08:16,840][123090] Updated weights for policy 1, policy_version 566052 (0.0005) [2023-12-26 04:08:16,899][123090] Updated weights for policy 1, policy_version 566062 (0.0005) [2023-12-26 04:08:16,970][123090] Updated weights for policy 1, policy_version 566072 (0.0005) [2023-12-26 04:08:17,412][123091] Updated weights for policy 0, policy_version 570199 (0.0009) [2023-12-26 04:08:17,478][123091] Updated weights for policy 0, policy_version 570209 (0.0006) [2023-12-26 04:08:17,547][123091] Updated weights for policy 0, policy_version 570219 (0.0005) [2023-12-26 04:08:17,621][123090] Updated weights for policy 1, policy_version 566082 (0.0006) [2023-12-26 04:08:17,686][123090] Updated weights for policy 1, policy_version 566092 (0.0009) [2023-12-26 04:08:17,739][123090] Updated weights for policy 1, policy_version 566102 (0.0009) [2023-12-26 04:08:17,804][123090] Updated weights for policy 1, policy_version 566112 (0.0009) [2023-12-26 04:08:18,306][123091] Updated weights for policy 0, policy_version 570229 (0.0005) [2023-12-26 04:08:18,364][123091] Updated weights for policy 0, policy_version 570239 (0.0007) [2023-12-26 04:08:18,434][123091] Updated weights for policy 0, policy_version 570249 (0.0006) [2023-12-26 04:08:18,609][123090] Updated weights for policy 1, policy_version 566122 (0.0010) [2023-12-26 04:08:18,676][123090] Updated weights for policy 1, policy_version 566132 (0.0010) [2023-12-26 04:08:18,737][123090] Updated weights for policy 1, policy_version 566142 (0.0009) [2023-12-26 04:08:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 290922496. Throughput: 0: 8822.6, 1: 8789.4. Samples: 290929928. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:08:18,784][121949] Avg episode reward: [(0, '6130.497'), (1, '5904.526')] [2023-12-26 04:08:19,196][123091] Updated weights for policy 0, policy_version 570259 (0.0007) [2023-12-26 04:08:19,263][123091] Updated weights for policy 0, policy_version 570269 (0.0009) [2023-12-26 04:08:19,333][123091] Updated weights for policy 0, policy_version 570279 (0.0006) [2023-12-26 04:08:19,585][123090] Updated weights for policy 1, policy_version 566152 (0.0006) [2023-12-26 04:08:19,657][123090] Updated weights for policy 1, policy_version 566162 (0.0006) [2023-12-26 04:08:19,727][123090] Updated weights for policy 1, policy_version 566172 (0.0010) [2023-12-26 04:08:20,108][123091] Updated weights for policy 0, policy_version 570289 (0.0008) [2023-12-26 04:08:20,175][123091] Updated weights for policy 0, policy_version 570299 (0.0008) [2023-12-26 04:08:20,245][123091] Updated weights for policy 0, policy_version 570309 (0.0008) [2023-12-26 04:08:20,314][123091] Updated weights for policy 0, policy_version 570319 (0.0008) [2023-12-26 04:08:20,487][123090] Updated weights for policy 1, policy_version 566182 (0.0010) [2023-12-26 04:08:20,546][123090] Updated weights for policy 1, policy_version 566192 (0.0010) [2023-12-26 04:08:20,608][123090] Updated weights for policy 1, policy_version 566202 (0.0010) [2023-12-26 04:08:21,048][123091] Updated weights for policy 0, policy_version 570329 (0.0009) [2023-12-26 04:08:21,112][123091] Updated weights for policy 0, policy_version 570339 (0.0009) [2023-12-26 04:08:21,186][123091] Updated weights for policy 0, policy_version 570349 (0.0008) [2023-12-26 04:08:21,498][123090] Updated weights for policy 1, policy_version 566212 (0.0008) [2023-12-26 04:08:21,552][123090] Updated weights for policy 1, policy_version 566222 (0.0005) [2023-12-26 04:08:21,615][123090] Updated weights for policy 1, policy_version 566232 (0.0008) [2023-12-26 04:08:22,012][123091] Updated weights for policy 0, policy_version 570359 (0.0009) [2023-12-26 04:08:22,075][123091] Updated weights for policy 0, policy_version 570369 (0.0009) [2023-12-26 04:08:22,140][123091] Updated weights for policy 0, policy_version 570379 (0.0009) [2023-12-26 04:08:22,459][123090] Updated weights for policy 1, policy_version 566242 (0.0010) [2023-12-26 04:08:22,524][123090] Updated weights for policy 1, policy_version 566252 (0.0011) [2023-12-26 04:08:22,591][123090] Updated weights for policy 1, policy_version 566262 (0.0011) [2023-12-26 04:08:22,643][123090] Updated weights for policy 1, policy_version 566272 (0.0010) [2023-12-26 04:08:22,985][123091] Updated weights for policy 0, policy_version 570389 (0.0008) [2023-12-26 04:08:23,055][123091] Updated weights for policy 0, policy_version 570399 (0.0009) [2023-12-26 04:08:23,119][123091] Updated weights for policy 0, policy_version 570409 (0.0010) [2023-12-26 04:08:23,404][123090] Updated weights for policy 1, policy_version 566282 (0.0009) [2023-12-26 04:08:23,464][123090] Updated weights for policy 1, policy_version 566292 (0.0009) [2023-12-26 04:08:23,522][123090] Updated weights for policy 1, policy_version 566302 (0.0010) [2023-12-26 04:08:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 291004416. Throughput: 0: 8776.8, 1: 8762.2. Samples: 290981844. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 04:08:23,785][121949] Avg episode reward: [(0, '6058.958'), (1, '6021.484')] [2023-12-26 04:08:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000566304_144973824.pth... [2023-12-26 04:08:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000565280_144711680.pth [2023-12-26 04:08:23,799][123091] Updated weights for policy 0, policy_version 570419 (0.0010) [2023-12-26 04:08:23,852][123091] Updated weights for policy 0, policy_version 570429 (0.0010) [2023-12-26 04:08:23,914][123091] Updated weights for policy 0, policy_version 570439 (0.0009) [2023-12-26 04:08:23,959][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000570448_146038784.pth... [2023-12-26 04:08:23,962][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000569392_145768448.pth [2023-12-26 04:08:24,344][123090] Updated weights for policy 1, policy_version 566312 (0.0010) [2023-12-26 04:08:24,411][123090] Updated weights for policy 1, policy_version 566322 (0.0011) [2023-12-26 04:08:24,475][123090] Updated weights for policy 1, policy_version 566332 (0.0010) [2023-12-26 04:08:24,746][123091] Updated weights for policy 0, policy_version 570449 (0.0006) [2023-12-26 04:08:24,803][123091] Updated weights for policy 0, policy_version 570459 (0.0009) [2023-12-26 04:08:24,854][123091] Updated weights for policy 0, policy_version 570469 (0.0010) [2023-12-26 04:08:24,907][123091] Updated weights for policy 0, policy_version 570479 (0.0009) [2023-12-26 04:08:25,274][123090] Updated weights for policy 1, policy_version 566342 (0.0007) [2023-12-26 04:08:25,324][123090] Updated weights for policy 1, policy_version 566352 (0.0005) [2023-12-26 04:08:25,377][123090] Updated weights for policy 1, policy_version 566362 (0.0005) [2023-12-26 04:08:25,808][123091] Updated weights for policy 0, policy_version 570489 (0.0010) [2023-12-26 04:08:25,856][123091] Updated weights for policy 0, policy_version 570499 (0.0009) [2023-12-26 04:08:25,906][123091] Updated weights for policy 0, policy_version 570510 (0.0009) [2023-12-26 04:08:26,032][123090] Updated weights for policy 1, policy_version 566372 (0.0007) [2023-12-26 04:08:26,085][123090] Updated weights for policy 1, policy_version 566382 (0.0005) [2023-12-26 04:08:26,138][123090] Updated weights for policy 1, policy_version 566392 (0.0005) [2023-12-26 04:08:26,813][123091] Updated weights for policy 0, policy_version 570520 (0.0010) [2023-12-26 04:08:26,844][123090] Updated weights for policy 1, policy_version 566402 (0.0005) [2023-12-26 04:08:26,861][123091] Updated weights for policy 0, policy_version 570530 (0.0010) [2023-12-26 04:08:26,902][123090] Updated weights for policy 1, policy_version 566412 (0.0007) [2023-12-26 04:08:26,929][123091] Updated weights for policy 0, policy_version 570540 (0.0008) [2023-12-26 04:08:26,953][123090] Updated weights for policy 1, policy_version 566422 (0.0007) [2023-12-26 04:08:27,006][123090] Updated weights for policy 1, policy_version 566432 (0.0009) [2023-12-26 04:08:27,655][123091] Updated weights for policy 0, policy_version 570550 (0.0007) [2023-12-26 04:08:27,707][123091] Updated weights for policy 0, policy_version 570560 (0.0006) [2023-12-26 04:08:27,761][123091] Updated weights for policy 0, policy_version 570570 (0.0005) [2023-12-26 04:08:27,902][123090] Updated weights for policy 1, policy_version 566442 (0.0009) [2023-12-26 04:08:27,951][123090] Updated weights for policy 1, policy_version 566452 (0.0008) [2023-12-26 04:08:28,004][123090] Updated weights for policy 1, policy_version 566462 (0.0009) [2023-12-26 04:08:28,509][123091] Updated weights for policy 0, policy_version 570580 (0.0005) [2023-12-26 04:08:28,556][123091] Updated weights for policy 0, policy_version 570590 (0.0005) [2023-12-26 04:08:28,606][123091] Updated weights for policy 0, policy_version 570600 (0.0006) [2023-12-26 04:08:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 291094528. Throughput: 0: 8780.4, 1: 8873.0. Samples: 291088232. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:28,784][121949] Avg episode reward: [(0, '6109.978'), (1, '6017.636')] [2023-12-26 04:08:28,888][123090] Updated weights for policy 1, policy_version 566472 (0.0008) [2023-12-26 04:08:28,944][123090] Updated weights for policy 1, policy_version 566482 (0.0009) [2023-12-26 04:08:29,009][123090] Updated weights for policy 1, policy_version 566492 (0.0007) [2023-12-26 04:08:29,402][123091] Updated weights for policy 0, policy_version 570610 (0.0008) [2023-12-26 04:08:29,456][123091] Updated weights for policy 0, policy_version 570620 (0.0009) [2023-12-26 04:08:29,508][123091] Updated weights for policy 0, policy_version 570630 (0.0010) [2023-12-26 04:08:29,564][123091] Updated weights for policy 0, policy_version 570640 (0.0009) [2023-12-26 04:08:29,705][123090] Updated weights for policy 1, policy_version 566502 (0.0006) [2023-12-26 04:08:29,766][123090] Updated weights for policy 1, policy_version 566512 (0.0009) [2023-12-26 04:08:29,823][123090] Updated weights for policy 1, policy_version 566522 (0.0009) [2023-12-26 04:08:30,363][123091] Updated weights for policy 0, policy_version 570650 (0.0009) [2023-12-26 04:08:30,421][123091] Updated weights for policy 0, policy_version 570660 (0.0009) [2023-12-26 04:08:30,471][123091] Updated weights for policy 0, policy_version 570671 (0.0009) [2023-12-26 04:08:30,687][123090] Updated weights for policy 1, policy_version 566532 (0.0009) [2023-12-26 04:08:30,740][123090] Updated weights for policy 1, policy_version 566542 (0.0010) [2023-12-26 04:08:30,792][123090] Updated weights for policy 1, policy_version 566552 (0.0009) [2023-12-26 04:08:31,245][123091] Updated weights for policy 0, policy_version 570681 (0.0010) [2023-12-26 04:08:31,307][123091] Updated weights for policy 0, policy_version 570691 (0.0010) [2023-12-26 04:08:31,368][123091] Updated weights for policy 0, policy_version 570701 (0.0010) [2023-12-26 04:08:31,630][123090] Updated weights for policy 1, policy_version 566562 (0.0008) [2023-12-26 04:08:31,708][123090] Updated weights for policy 1, policy_version 566572 (0.0006) [2023-12-26 04:08:31,769][123090] Updated weights for policy 1, policy_version 566582 (0.0007) [2023-12-26 04:08:31,843][123090] Updated weights for policy 1, policy_version 566592 (0.0006) [2023-12-26 04:08:32,230][123091] Updated weights for policy 0, policy_version 570711 (0.0009) [2023-12-26 04:08:32,299][123091] Updated weights for policy 0, policy_version 570721 (0.0008) [2023-12-26 04:08:32,371][123091] Updated weights for policy 0, policy_version 570731 (0.0008) [2023-12-26 04:08:32,612][123090] Updated weights for policy 1, policy_version 566602 (0.0010) [2023-12-26 04:08:32,670][123090] Updated weights for policy 1, policy_version 566612 (0.0006) [2023-12-26 04:08:32,728][123090] Updated weights for policy 1, policy_version 566622 (0.0007) [2023-12-26 04:08:33,207][123091] Updated weights for policy 0, policy_version 570741 (0.0010) [2023-12-26 04:08:33,267][123091] Updated weights for policy 0, policy_version 570751 (0.0010) [2023-12-26 04:08:33,329][123091] Updated weights for policy 0, policy_version 570761 (0.0010) [2023-12-26 04:08:33,547][123090] Updated weights for policy 1, policy_version 566632 (0.0009) [2023-12-26 04:08:33,595][123090] Updated weights for policy 1, policy_version 566642 (0.0008) [2023-12-26 04:08:33,642][123090] Updated weights for policy 1, policy_version 566652 (0.0008) [2023-12-26 04:08:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 291184640. Throughput: 0: 8756.3, 1: 8875.0. Samples: 291193056. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:33,785][121949] Avg episode reward: [(0, '6173.439'), (1, '5887.879')] [2023-12-26 04:08:34,125][123091] Updated weights for policy 0, policy_version 570771 (0.0010) [2023-12-26 04:08:34,185][123091] Updated weights for policy 0, policy_version 570781 (0.0010) [2023-12-26 04:08:34,244][123091] Updated weights for policy 0, policy_version 570791 (0.0011) [2023-12-26 04:08:34,463][123090] Updated weights for policy 1, policy_version 566662 (0.0009) [2023-12-26 04:08:34,529][123090] Updated weights for policy 1, policy_version 566672 (0.0009) [2023-12-26 04:08:34,581][123090] Updated weights for policy 1, policy_version 566682 (0.0009) [2023-12-26 04:08:35,058][123091] Updated weights for policy 0, policy_version 570801 (0.0010) [2023-12-26 04:08:35,124][123091] Updated weights for policy 0, policy_version 570811 (0.0005) [2023-12-26 04:08:35,179][123091] Updated weights for policy 0, policy_version 570821 (0.0005) [2023-12-26 04:08:35,230][123091] Updated weights for policy 0, policy_version 570831 (0.0005) [2023-12-26 04:08:35,481][123090] Updated weights for policy 1, policy_version 566692 (0.0010) [2023-12-26 04:08:35,539][123090] Updated weights for policy 1, policy_version 566702 (0.0009) [2023-12-26 04:08:35,592][123090] Updated weights for policy 1, policy_version 566712 (0.0009) [2023-12-26 04:08:35,820][123091] Updated weights for policy 0, policy_version 570841 (0.0006) [2023-12-26 04:08:35,873][123091] Updated weights for policy 0, policy_version 570851 (0.0005) [2023-12-26 04:08:35,934][123091] Updated weights for policy 0, policy_version 570861 (0.0005) [2023-12-26 04:08:36,370][123090] Updated weights for policy 1, policy_version 566722 (0.0008) [2023-12-26 04:08:36,445][123090] Updated weights for policy 1, policy_version 566732 (0.0009) [2023-12-26 04:08:36,516][123090] Updated weights for policy 1, policy_version 566742 (0.0010) [2023-12-26 04:08:36,576][123090] Updated weights for policy 1, policy_version 566752 (0.0010) [2023-12-26 04:08:36,728][123091] Updated weights for policy 0, policy_version 570871 (0.0009) [2023-12-26 04:08:36,806][123091] Updated weights for policy 0, policy_version 570881 (0.0011) [2023-12-26 04:08:36,876][123091] Updated weights for policy 0, policy_version 570891 (0.0011) [2023-12-26 04:08:37,294][123090] Updated weights for policy 1, policy_version 566762 (0.0005) [2023-12-26 04:08:37,350][123090] Updated weights for policy 1, policy_version 566772 (0.0005) [2023-12-26 04:08:37,406][123090] Updated weights for policy 1, policy_version 566782 (0.0005) [2023-12-26 04:08:37,643][123091] Updated weights for policy 0, policy_version 570901 (0.0008) [2023-12-26 04:08:37,698][123091] Updated weights for policy 0, policy_version 570911 (0.0006) [2023-12-26 04:08:37,764][123091] Updated weights for policy 0, policy_version 570921 (0.0007) [2023-12-26 04:08:38,063][123090] Updated weights for policy 1, policy_version 566792 (0.0010) [2023-12-26 04:08:38,134][123090] Updated weights for policy 1, policy_version 566802 (0.0011) [2023-12-26 04:08:38,194][123090] Updated weights for policy 1, policy_version 566812 (0.0010) [2023-12-26 04:08:38,462][123091] Updated weights for policy 0, policy_version 570931 (0.0011) [2023-12-26 04:08:38,522][123091] Updated weights for policy 0, policy_version 570941 (0.0011) [2023-12-26 04:08:38,581][123091] Updated weights for policy 0, policy_version 570951 (0.0010) [2023-12-26 04:08:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 291274752. Throughput: 0: 8850.4, 1: 8859.7. Samples: 291247572. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:38,785][121949] Avg episode reward: [(0, '6122.417'), (1, '5869.082')] [2023-12-26 04:08:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000566816_145104896.pth... [2023-12-26 04:08:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000570960_146169856.pth... [2023-12-26 04:08:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000565792_144842752.pth [2023-12-26 04:08:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000569936_145907712.pth [2023-12-26 04:08:39,028][123090] Updated weights for policy 1, policy_version 566822 (0.0008) [2023-12-26 04:08:39,110][123090] Updated weights for policy 1, policy_version 566832 (0.0006) [2023-12-26 04:08:39,179][123090] Updated weights for policy 1, policy_version 566842 (0.0010) [2023-12-26 04:08:39,319][123091] Updated weights for policy 0, policy_version 570961 (0.0010) [2023-12-26 04:08:39,392][123091] Updated weights for policy 0, policy_version 570971 (0.0009) [2023-12-26 04:08:39,455][123091] Updated weights for policy 0, policy_version 570981 (0.0009) [2023-12-26 04:08:39,519][123091] Updated weights for policy 0, policy_version 570991 (0.0009) [2023-12-26 04:08:39,930][123090] Updated weights for policy 1, policy_version 566852 (0.0011) [2023-12-26 04:08:40,003][123090] Updated weights for policy 1, policy_version 566862 (0.0009) [2023-12-26 04:08:40,071][123090] Updated weights for policy 1, policy_version 566872 (0.0009) [2023-12-26 04:08:40,355][123091] Updated weights for policy 0, policy_version 571001 (0.0010) [2023-12-26 04:08:40,407][123091] Updated weights for policy 0, policy_version 571011 (0.0010) [2023-12-26 04:08:40,459][123091] Updated weights for policy 0, policy_version 571021 (0.0010) [2023-12-26 04:08:40,793][123090] Updated weights for policy 1, policy_version 566882 (0.0007) [2023-12-26 04:08:40,864][123090] Updated weights for policy 1, policy_version 566892 (0.0005) [2023-12-26 04:08:40,935][123090] Updated weights for policy 1, policy_version 566902 (0.0005) [2023-12-26 04:08:41,001][123090] Updated weights for policy 1, policy_version 566912 (0.0006) [2023-12-26 04:08:41,333][123091] Updated weights for policy 0, policy_version 571031 (0.0009) [2023-12-26 04:08:41,401][123091] Updated weights for policy 0, policy_version 571041 (0.0008) [2023-12-26 04:08:41,472][123091] Updated weights for policy 0, policy_version 571051 (0.0008) [2023-12-26 04:08:41,777][123090] Updated weights for policy 1, policy_version 566922 (0.0009) [2023-12-26 04:08:41,846][123090] Updated weights for policy 1, policy_version 566932 (0.0009) [2023-12-26 04:08:41,912][123090] Updated weights for policy 1, policy_version 566942 (0.0009) [2023-12-26 04:08:42,305][123091] Updated weights for policy 0, policy_version 571061 (0.0009) [2023-12-26 04:08:42,377][123091] Updated weights for policy 0, policy_version 571071 (0.0007) [2023-12-26 04:08:42,443][123091] Updated weights for policy 0, policy_version 571081 (0.0008) [2023-12-26 04:08:42,763][123090] Updated weights for policy 1, policy_version 566952 (0.0009) [2023-12-26 04:08:42,822][123090] Updated weights for policy 1, policy_version 566962 (0.0007) [2023-12-26 04:08:42,888][123090] Updated weights for policy 1, policy_version 566972 (0.0005) [2023-12-26 04:08:43,164][123091] Updated weights for policy 0, policy_version 571091 (0.0005) [2023-12-26 04:08:43,226][123091] Updated weights for policy 0, policy_version 571101 (0.0007) [2023-12-26 04:08:43,285][123091] Updated weights for policy 0, policy_version 571111 (0.0010) [2023-12-26 04:08:43,593][123090] Updated weights for policy 1, policy_version 566982 (0.0005) [2023-12-26 04:08:43,648][123090] Updated weights for policy 1, policy_version 566992 (0.0005) [2023-12-26 04:08:43,702][123090] Updated weights for policy 1, policy_version 567002 (0.0005) [2023-12-26 04:08:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 291364864. Throughput: 0: 8738.0, 1: 8839.0. Samples: 291355048. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:43,784][121949] Avg episode reward: [(0, '6111.043'), (1, '5716.084')] [2023-12-26 04:08:44,097][123091] Updated weights for policy 0, policy_version 571121 (0.0010) [2023-12-26 04:08:44,162][123091] Updated weights for policy 0, policy_version 571131 (0.0010) [2023-12-26 04:08:44,223][123091] Updated weights for policy 0, policy_version 571141 (0.0009) [2023-12-26 04:08:44,258][123090] Updated weights for policy 1, policy_version 567012 (0.0007) [2023-12-26 04:08:44,282][123091] Updated weights for policy 0, policy_version 571151 (0.0007) [2023-12-26 04:08:44,325][123090] Updated weights for policy 1, policy_version 567022 (0.0011) [2023-12-26 04:08:44,390][123090] Updated weights for policy 1, policy_version 567032 (0.0008) [2023-12-26 04:08:45,010][123091] Updated weights for policy 0, policy_version 571161 (0.0006) [2023-12-26 04:08:45,081][123091] Updated weights for policy 0, policy_version 571171 (0.0008) [2023-12-26 04:08:45,103][123090] Updated weights for policy 1, policy_version 567042 (0.0009) [2023-12-26 04:08:45,153][123091] Updated weights for policy 0, policy_version 571181 (0.0009) [2023-12-26 04:08:45,172][123090] Updated weights for policy 1, policy_version 567052 (0.0008) [2023-12-26 04:08:45,237][123090] Updated weights for policy 1, policy_version 567062 (0.0008) [2023-12-26 04:08:45,301][123090] Updated weights for policy 1, policy_version 567072 (0.0010) [2023-12-26 04:08:45,797][123091] Updated weights for policy 0, policy_version 571191 (0.0007) [2023-12-26 04:08:45,854][123091] Updated weights for policy 0, policy_version 571201 (0.0006) [2023-12-26 04:08:45,930][123091] Updated weights for policy 0, policy_version 571211 (0.0005) [2023-12-26 04:08:46,136][123090] Updated weights for policy 1, policy_version 567082 (0.0008) [2023-12-26 04:08:46,202][123090] Updated weights for policy 1, policy_version 567092 (0.0009) [2023-12-26 04:08:46,266][123090] Updated weights for policy 1, policy_version 567102 (0.0009) [2023-12-26 04:08:46,670][123091] Updated weights for policy 0, policy_version 571221 (0.0008) [2023-12-26 04:08:46,724][123091] Updated weights for policy 0, policy_version 571231 (0.0010) [2023-12-26 04:08:46,779][123091] Updated weights for policy 0, policy_version 571241 (0.0010) [2023-12-26 04:08:47,062][123090] Updated weights for policy 1, policy_version 567112 (0.0006) [2023-12-26 04:08:47,120][123090] Updated weights for policy 1, policy_version 567122 (0.0005) [2023-12-26 04:08:47,173][123090] Updated weights for policy 1, policy_version 567132 (0.0005) [2023-12-26 04:08:47,573][123091] Updated weights for policy 0, policy_version 571251 (0.0009) [2023-12-26 04:08:47,640][123091] Updated weights for policy 0, policy_version 571261 (0.0009) [2023-12-26 04:08:47,710][123091] Updated weights for policy 0, policy_version 571271 (0.0006) [2023-12-26 04:08:47,908][123090] Updated weights for policy 1, policy_version 567142 (0.0005) [2023-12-26 04:08:47,970][123090] Updated weights for policy 1, policy_version 567152 (0.0005) [2023-12-26 04:08:48,031][123090] Updated weights for policy 1, policy_version 567162 (0.0009) [2023-12-26 04:08:48,364][123091] Updated weights for policy 0, policy_version 571281 (0.0005) [2023-12-26 04:08:48,425][123091] Updated weights for policy 0, policy_version 571291 (0.0010) [2023-12-26 04:08:48,481][123091] Updated weights for policy 0, policy_version 571301 (0.0010) [2023-12-26 04:08:48,533][123091] Updated weights for policy 0, policy_version 571311 (0.0011) [2023-12-26 04:08:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 291454976. Throughput: 0: 8803.7, 1: 8929.1. Samples: 291467008. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:48,785][121949] Avg episode reward: [(0, '6100.184'), (1, '5256.480')] [2023-12-26 04:08:48,824][123090] Updated weights for policy 1, policy_version 567172 (0.0009) [2023-12-26 04:08:48,893][123090] Updated weights for policy 1, policy_version 567182 (0.0008) [2023-12-26 04:08:48,969][123090] Updated weights for policy 1, policy_version 567192 (0.0008) [2023-12-26 04:08:49,407][123091] Updated weights for policy 0, policy_version 571321 (0.0010) [2023-12-26 04:08:49,470][123091] Updated weights for policy 0, policy_version 571331 (0.0010) [2023-12-26 04:08:49,529][123091] Updated weights for policy 0, policy_version 571341 (0.0010) [2023-12-26 04:08:49,683][123090] Updated weights for policy 1, policy_version 567202 (0.0008) [2023-12-26 04:08:49,749][123090] Updated weights for policy 1, policy_version 567212 (0.0009) [2023-12-26 04:08:49,819][123090] Updated weights for policy 1, policy_version 567222 (0.0008) [2023-12-26 04:08:49,882][123090] Updated weights for policy 1, policy_version 567232 (0.0006) [2023-12-26 04:08:50,420][123091] Updated weights for policy 0, policy_version 571351 (0.0010) [2023-12-26 04:08:50,478][123091] Updated weights for policy 0, policy_version 571361 (0.0010) [2023-12-26 04:08:50,541][123091] Updated weights for policy 0, policy_version 571371 (0.0010) [2023-12-26 04:08:50,611][123090] Updated weights for policy 1, policy_version 567242 (0.0008) [2023-12-26 04:08:50,667][123090] Updated weights for policy 1, policy_version 567252 (0.0010) [2023-12-26 04:08:50,734][123090] Updated weights for policy 1, policy_version 567262 (0.0009) [2023-12-26 04:08:51,457][123091] Updated weights for policy 0, policy_version 571381 (0.0007) [2023-12-26 04:08:51,512][123091] Updated weights for policy 0, policy_version 571391 (0.0005) [2023-12-26 04:08:51,568][123090] Updated weights for policy 1, policy_version 567272 (0.0007) [2023-12-26 04:08:51,572][123091] Updated weights for policy 0, policy_version 571401 (0.0006) [2023-12-26 04:08:51,633][123090] Updated weights for policy 1, policy_version 567282 (0.0009) [2023-12-26 04:08:51,699][123090] Updated weights for policy 1, policy_version 567292 (0.0008) [2023-12-26 04:08:52,220][123091] Updated weights for policy 0, policy_version 571411 (0.0007) [2023-12-26 04:08:52,292][123091] Updated weights for policy 0, policy_version 571421 (0.0010) [2023-12-26 04:08:52,366][123091] Updated weights for policy 0, policy_version 571431 (0.0010) [2023-12-26 04:08:52,521][123090] Updated weights for policy 1, policy_version 567302 (0.0007) [2023-12-26 04:08:52,588][123090] Updated weights for policy 1, policy_version 567312 (0.0006) [2023-12-26 04:08:52,657][123090] Updated weights for policy 1, policy_version 567322 (0.0006) [2023-12-26 04:08:53,132][123091] Updated weights for policy 0, policy_version 571441 (0.0010) [2023-12-26 04:08:53,202][123091] Updated weights for policy 0, policy_version 571451 (0.0009) [2023-12-26 04:08:53,266][123091] Updated weights for policy 0, policy_version 571461 (0.0010) [2023-12-26 04:08:53,329][123091] Updated weights for policy 0, policy_version 571471 (0.0010) [2023-12-26 04:08:53,433][123090] Updated weights for policy 1, policy_version 567332 (0.0007) [2023-12-26 04:08:53,483][123090] Updated weights for policy 1, policy_version 567342 (0.0010) [2023-12-26 04:08:53,530][123090] Updated weights for policy 1, policy_version 567352 (0.0007) [2023-12-26 04:08:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 291545088. Throughput: 0: 8779.2, 1: 8938.6. Samples: 291518760. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:53,785][121949] Avg episode reward: [(0, '6052.775'), (1, '5167.555')] [2023-12-26 04:08:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000567360_145244160.pth... [2023-12-26 04:08:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000571472_146300928.pth... [2023-12-26 04:08:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000566304_144973824.pth [2023-12-26 04:08:53,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000570448_146038784.pth [2023-12-26 04:08:54,187][123091] Updated weights for policy 0, policy_version 571481 (0.0010) [2023-12-26 04:08:54,236][123090] Updated weights for policy 1, policy_version 567362 (0.0005) [2023-12-26 04:08:54,256][123091] Updated weights for policy 0, policy_version 571491 (0.0010) [2023-12-26 04:08:54,304][123090] Updated weights for policy 1, policy_version 567372 (0.0006) [2023-12-26 04:08:54,319][123091] Updated weights for policy 0, policy_version 571501 (0.0009) [2023-12-26 04:08:54,374][123090] Updated weights for policy 1, policy_version 567382 (0.0009) [2023-12-26 04:08:54,441][123090] Updated weights for policy 1, policy_version 567392 (0.0009) [2023-12-26 04:08:55,140][123090] Updated weights for policy 1, policy_version 567402 (0.0007) [2023-12-26 04:08:55,144][123091] Updated weights for policy 0, policy_version 571511 (0.0006) [2023-12-26 04:08:55,191][123090] Updated weights for policy 1, policy_version 567412 (0.0008) [2023-12-26 04:08:55,197][123091] Updated weights for policy 0, policy_version 571521 (0.0005) [2023-12-26 04:08:55,249][123090] Updated weights for policy 1, policy_version 567422 (0.0009) [2023-12-26 04:08:55,254][123091] Updated weights for policy 0, policy_version 571531 (0.0006) [2023-12-26 04:08:55,938][123090] Updated weights for policy 1, policy_version 567432 (0.0010) [2023-12-26 04:08:55,994][123090] Updated weights for policy 1, policy_version 567442 (0.0010) [2023-12-26 04:08:56,045][123090] Updated weights for policy 1, policy_version 567452 (0.0010) [2023-12-26 04:08:56,083][123091] Updated weights for policy 0, policy_version 571541 (0.0007) [2023-12-26 04:08:56,135][123091] Updated weights for policy 0, policy_version 571551 (0.0009) [2023-12-26 04:08:56,188][123091] Updated weights for policy 0, policy_version 571561 (0.0009) [2023-12-26 04:08:56,878][123090] Updated weights for policy 1, policy_version 567462 (0.0010) [2023-12-26 04:08:56,939][123090] Updated weights for policy 1, policy_version 567472 (0.0010) [2023-12-26 04:08:56,986][123090] Updated weights for policy 1, policy_version 567482 (0.0010) [2023-12-26 04:08:57,025][123091] Updated weights for policy 0, policy_version 571571 (0.0008) [2023-12-26 04:08:57,073][123091] Updated weights for policy 0, policy_version 571581 (0.0005) [2023-12-26 04:08:57,124][123091] Updated weights for policy 0, policy_version 571591 (0.0005) [2023-12-26 04:08:57,812][123090] Updated weights for policy 1, policy_version 567492 (0.0010) [2023-12-26 04:08:57,814][123091] Updated weights for policy 0, policy_version 571601 (0.0006) [2023-12-26 04:08:57,860][123090] Updated weights for policy 1, policy_version 567502 (0.0010) [2023-12-26 04:08:57,863][123091] Updated weights for policy 0, policy_version 571611 (0.0006) [2023-12-26 04:08:57,911][123090] Updated weights for policy 1, policy_version 567512 (0.0010) [2023-12-26 04:08:57,919][123091] Updated weights for policy 0, policy_version 571621 (0.0008) [2023-12-26 04:08:57,968][123091] Updated weights for policy 0, policy_version 571632 (0.0008) [2023-12-26 04:08:58,731][123090] Updated weights for policy 1, policy_version 567522 (0.0010) [2023-12-26 04:08:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 291627008. Throughput: 0: 8833.5, 1: 9036.4. Samples: 291626664. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:08:58,785][121949] Avg episode reward: [(0, '6031.870'), (1, '5147.894')] [2023-12-26 04:08:58,812][123090] Updated weights for policy 1, policy_version 567532 (0.0008) [2023-12-26 04:08:58,845][123091] Updated weights for policy 0, policy_version 571642 (0.0008) [2023-12-26 04:08:58,886][123090] Updated weights for policy 1, policy_version 567542 (0.0008) [2023-12-26 04:08:58,903][123091] Updated weights for policy 0, policy_version 571652 (0.0007) [2023-12-26 04:08:58,948][123090] Updated weights for policy 1, policy_version 567552 (0.0008) [2023-12-26 04:08:58,963][123091] Updated weights for policy 0, policy_version 571662 (0.0007) [2023-12-26 04:08:59,680][123090] Updated weights for policy 1, policy_version 567562 (0.0011) [2023-12-26 04:08:59,738][123090] Updated weights for policy 1, policy_version 567572 (0.0010) [2023-12-26 04:08:59,767][123091] Updated weights for policy 0, policy_version 571672 (0.0006) [2023-12-26 04:08:59,801][123090] Updated weights for policy 1, policy_version 567582 (0.0010) [2023-12-26 04:08:59,833][123091] Updated weights for policy 0, policy_version 571682 (0.0009) [2023-12-26 04:08:59,898][123091] Updated weights for policy 0, policy_version 571692 (0.0009) [2023-12-26 04:09:00,625][123090] Updated weights for policy 1, policy_version 567592 (0.0010) [2023-12-26 04:09:00,695][123090] Updated weights for policy 1, policy_version 567602 (0.0010) [2023-12-26 04:09:00,734][123091] Updated weights for policy 0, policy_version 571702 (0.0007) [2023-12-26 04:09:00,749][123090] Updated weights for policy 1, policy_version 567612 (0.0010) [2023-12-26 04:09:00,790][123091] Updated weights for policy 0, policy_version 571712 (0.0007) [2023-12-26 04:09:00,844][123091] Updated weights for policy 0, policy_version 571722 (0.0009) [2023-12-26 04:09:01,495][123090] Updated weights for policy 1, policy_version 567622 (0.0009) [2023-12-26 04:09:01,552][123090] Updated weights for policy 1, policy_version 567632 (0.0008) [2023-12-26 04:09:01,611][123090] Updated weights for policy 1, policy_version 567642 (0.0008) [2023-12-26 04:09:01,685][123091] Updated weights for policy 0, policy_version 571733 (0.0009) [2023-12-26 04:09:01,757][123091] Updated weights for policy 0, policy_version 571743 (0.0009) [2023-12-26 04:09:01,824][123091] Updated weights for policy 0, policy_version 571753 (0.0010) [2023-12-26 04:09:02,396][123090] Updated weights for policy 1, policy_version 567652 (0.0007) [2023-12-26 04:09:02,452][123090] Updated weights for policy 1, policy_version 567662 (0.0005) [2023-12-26 04:09:02,502][123090] Updated weights for policy 1, policy_version 567672 (0.0007) [2023-12-26 04:09:02,716][123091] Updated weights for policy 0, policy_version 571763 (0.0009) [2023-12-26 04:09:02,768][123091] Updated weights for policy 0, policy_version 571773 (0.0009) [2023-12-26 04:09:02,820][123091] Updated weights for policy 0, policy_version 571783 (0.0009) [2023-12-26 04:09:03,284][123090] Updated weights for policy 1, policy_version 567682 (0.0009) [2023-12-26 04:09:03,338][123090] Updated weights for policy 1, policy_version 567692 (0.0010) [2023-12-26 04:09:03,400][123090] Updated weights for policy 1, policy_version 567702 (0.0010) [2023-12-26 04:09:03,454][123090] Updated weights for policy 1, policy_version 567712 (0.0010) [2023-12-26 04:09:03,675][123091] Updated weights for policy 0, policy_version 571793 (0.0009) [2023-12-26 04:09:03,726][123091] Updated weights for policy 0, policy_version 571803 (0.0008) [2023-12-26 04:09:03,778][123091] Updated weights for policy 0, policy_version 571813 (0.0009) [2023-12-26 04:09:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 291717120. Throughput: 0: 8832.8, 1: 8970.3. Samples: 291731068. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:03,785][121949] Avg episode reward: [(0, '6108.285'), (1, '5350.662')] [2023-12-26 04:09:03,829][123091] Updated weights for policy 0, policy_version 571823 (0.0009) [2023-12-26 04:09:04,245][123090] Updated weights for policy 1, policy_version 567722 (0.0009) [2023-12-26 04:09:04,301][123090] Updated weights for policy 1, policy_version 567732 (0.0010) [2023-12-26 04:09:04,361][123090] Updated weights for policy 1, policy_version 567742 (0.0010) [2023-12-26 04:09:04,708][123091] Updated weights for policy 0, policy_version 571833 (0.0009) [2023-12-26 04:09:04,770][123091] Updated weights for policy 0, policy_version 571843 (0.0009) [2023-12-26 04:09:04,830][123091] Updated weights for policy 0, policy_version 571853 (0.0008) [2023-12-26 04:09:05,110][123090] Updated weights for policy 1, policy_version 567752 (0.0007) [2023-12-26 04:09:05,208][123090] Updated weights for policy 1, policy_version 567762 (0.0010) [2023-12-26 04:09:05,263][123090] Updated weights for policy 1, policy_version 567772 (0.0010) [2023-12-26 04:09:05,564][123091] Updated weights for policy 0, policy_version 571863 (0.0009) [2023-12-26 04:09:05,616][123091] Updated weights for policy 0, policy_version 571873 (0.0010) [2023-12-26 04:09:05,667][123091] Updated weights for policy 0, policy_version 571883 (0.0009) [2023-12-26 04:09:06,009][123090] Updated weights for policy 1, policy_version 567782 (0.0010) [2023-12-26 04:09:06,057][123090] Updated weights for policy 1, policy_version 567792 (0.0007) [2023-12-26 04:09:06,123][123090] Updated weights for policy 1, policy_version 567802 (0.0006) [2023-12-26 04:09:06,575][123091] Updated weights for policy 0, policy_version 571893 (0.0009) [2023-12-26 04:09:06,632][123091] Updated weights for policy 0, policy_version 571903 (0.0009) [2023-12-26 04:09:06,684][123091] Updated weights for policy 0, policy_version 571913 (0.0009) [2023-12-26 04:09:06,852][123090] Updated weights for policy 1, policy_version 567812 (0.0006) [2023-12-26 04:09:06,922][123090] Updated weights for policy 1, policy_version 567822 (0.0008) [2023-12-26 04:09:06,982][123090] Updated weights for policy 1, policy_version 567832 (0.0010) [2023-12-26 04:09:07,607][123091] Updated weights for policy 0, policy_version 571923 (0.0009) [2023-12-26 04:09:07,656][123091] Updated weights for policy 0, policy_version 571934 (0.0009) [2023-12-26 04:09:07,666][123090] Updated weights for policy 1, policy_version 567842 (0.0009) [2023-12-26 04:09:07,703][123091] Updated weights for policy 0, policy_version 571944 (0.0007) [2023-12-26 04:09:07,717][123090] Updated weights for policy 1, policy_version 567852 (0.0010) [2023-12-26 04:09:07,784][123090] Updated weights for policy 1, policy_version 567862 (0.0010) [2023-12-26 04:09:07,842][123090] Updated weights for policy 1, policy_version 567872 (0.0010) [2023-12-26 04:09:08,558][123091] Updated weights for policy 0, policy_version 571954 (0.0006) [2023-12-26 04:09:08,615][123091] Updated weights for policy 0, policy_version 571964 (0.0009) [2023-12-26 04:09:08,663][123091] Updated weights for policy 0, policy_version 571974 (0.0008) [2023-12-26 04:09:08,679][123090] Updated weights for policy 1, policy_version 567882 (0.0009) [2023-12-26 04:09:08,717][123091] Updated weights for policy 0, policy_version 571984 (0.0007) [2023-12-26 04:09:08,732][123090] Updated weights for policy 1, policy_version 567892 (0.0009) [2023-12-26 04:09:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 291807232. Throughput: 0: 8812.0, 1: 9019.8. Samples: 291784276. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:08,785][121949] Avg episode reward: [(0, '6109.307'), (1, '5353.470')] [2023-12-26 04:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000571984_146432000.pth... [2023-12-26 04:09:08,792][123090] Updated weights for policy 1, policy_version 567902 (0.0009) [2023-12-26 04:09:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000570960_146169856.pth [2023-12-26 04:09:08,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000567904_145383424.pth... [2023-12-26 04:09:08,811][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000566816_145104896.pth [2023-12-26 04:09:09,577][123090] Updated weights for policy 1, policy_version 567912 (0.0006) [2023-12-26 04:09:09,647][123090] Updated weights for policy 1, policy_version 567922 (0.0006) [2023-12-26 04:09:09,648][123091] Updated weights for policy 0, policy_version 571994 (0.0009) [2023-12-26 04:09:09,704][123091] Updated weights for policy 0, policy_version 572004 (0.0009) [2023-12-26 04:09:09,718][123090] Updated weights for policy 1, policy_version 567932 (0.0008) [2023-12-26 04:09:09,774][123091] Updated weights for policy 0, policy_version 572014 (0.0007) [2023-12-26 04:09:10,430][123090] Updated weights for policy 1, policy_version 567942 (0.0011) [2023-12-26 04:09:10,498][123090] Updated weights for policy 1, policy_version 567952 (0.0011) [2023-12-26 04:09:10,567][123090] Updated weights for policy 1, policy_version 567962 (0.0011) [2023-12-26 04:09:10,601][123091] Updated weights for policy 0, policy_version 572024 (0.0008) [2023-12-26 04:09:10,658][123091] Updated weights for policy 0, policy_version 572034 (0.0009) [2023-12-26 04:09:10,727][123091] Updated weights for policy 0, policy_version 572044 (0.0009) [2023-12-26 04:09:11,395][123090] Updated weights for policy 1, policy_version 567972 (0.0010) [2023-12-26 04:09:11,464][123090] Updated weights for policy 1, policy_version 567982 (0.0009) [2023-12-26 04:09:11,523][123090] Updated weights for policy 1, policy_version 567992 (0.0007) [2023-12-26 04:09:11,558][123091] Updated weights for policy 0, policy_version 572054 (0.0008) [2023-12-26 04:09:11,624][123091] Updated weights for policy 0, policy_version 572064 (0.0010) [2023-12-26 04:09:11,691][123091] Updated weights for policy 0, policy_version 572074 (0.0009) [2023-12-26 04:09:12,324][123090] Updated weights for policy 1, policy_version 568002 (0.0006) [2023-12-26 04:09:12,397][123090] Updated weights for policy 1, policy_version 568012 (0.0009) [2023-12-26 04:09:12,452][123090] Updated weights for policy 1, policy_version 568022 (0.0009) [2023-12-26 04:09:12,516][123090] Updated weights for policy 1, policy_version 568032 (0.0009) [2023-12-26 04:09:12,577][123091] Updated weights for policy 0, policy_version 572084 (0.0010) [2023-12-26 04:09:12,644][123091] Updated weights for policy 0, policy_version 572094 (0.0009) [2023-12-26 04:09:12,705][123091] Updated weights for policy 0, policy_version 572104 (0.0009) [2023-12-26 04:09:13,365][123090] Updated weights for policy 1, policy_version 568042 (0.0009) [2023-12-26 04:09:13,419][123090] Updated weights for policy 1, policy_version 568052 (0.0010) [2023-12-26 04:09:13,471][123090] Updated weights for policy 1, policy_version 568062 (0.0010) [2023-12-26 04:09:13,505][123091] Updated weights for policy 0, policy_version 572114 (0.0009) [2023-12-26 04:09:13,558][123091] Updated weights for policy 0, policy_version 572124 (0.0010) [2023-12-26 04:09:13,613][123091] Updated weights for policy 0, policy_version 572134 (0.0010) [2023-12-26 04:09:13,665][123091] Updated weights for policy 0, policy_version 572144 (0.0009) [2023-12-26 04:09:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 291897344. Throughput: 0: 8750.4, 1: 8992.4. Samples: 291886660. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:13,785][121949] Avg episode reward: [(0, '6129.207'), (1, '5330.286')] [2023-12-26 04:09:14,296][123090] Updated weights for policy 1, policy_version 568072 (0.0008) [2023-12-26 04:09:14,345][123090] Updated weights for policy 1, policy_version 568082 (0.0009) [2023-12-26 04:09:14,417][123090] Updated weights for policy 1, policy_version 568092 (0.0009) [2023-12-26 04:09:14,496][123091] Updated weights for policy 0, policy_version 572154 (0.0009) [2023-12-26 04:09:14,558][123091] Updated weights for policy 0, policy_version 572164 (0.0009) [2023-12-26 04:09:14,618][123091] Updated weights for policy 0, policy_version 572174 (0.0010) [2023-12-26 04:09:15,247][123090] Updated weights for policy 1, policy_version 568102 (0.0009) [2023-12-26 04:09:15,314][123090] Updated weights for policy 1, policy_version 568112 (0.0010) [2023-12-26 04:09:15,383][123090] Updated weights for policy 1, policy_version 568122 (0.0009) [2023-12-26 04:09:15,470][123091] Updated weights for policy 0, policy_version 572184 (0.0010) [2023-12-26 04:09:15,534][123091] Updated weights for policy 0, policy_version 572194 (0.0009) [2023-12-26 04:09:15,591][123091] Updated weights for policy 0, policy_version 572204 (0.0007) [2023-12-26 04:09:16,125][123090] Updated weights for policy 1, policy_version 568132 (0.0009) [2023-12-26 04:09:16,179][123090] Updated weights for policy 1, policy_version 568142 (0.0009) [2023-12-26 04:09:16,230][123090] Updated weights for policy 1, policy_version 568152 (0.0009) [2023-12-26 04:09:16,442][123091] Updated weights for policy 0, policy_version 572214 (0.0010) [2023-12-26 04:09:16,491][123091] Updated weights for policy 0, policy_version 572224 (0.0009) [2023-12-26 04:09:16,540][123091] Updated weights for policy 0, policy_version 572234 (0.0009) [2023-12-26 04:09:17,092][123090] Updated weights for policy 1, policy_version 568162 (0.0009) [2023-12-26 04:09:17,151][123090] Updated weights for policy 1, policy_version 568172 (0.0010) [2023-12-26 04:09:17,217][123090] Updated weights for policy 1, policy_version 568182 (0.0009) [2023-12-26 04:09:17,282][123090] Updated weights for policy 1, policy_version 568192 (0.0008) [2023-12-26 04:09:17,407][123091] Updated weights for policy 0, policy_version 572244 (0.0009) [2023-12-26 04:09:17,467][123091] Updated weights for policy 0, policy_version 572254 (0.0009) [2023-12-26 04:09:17,522][123091] Updated weights for policy 0, policy_version 572265 (0.0011) [2023-12-26 04:09:18,039][123090] Updated weights for policy 1, policy_version 568202 (0.0007) [2023-12-26 04:09:18,113][123090] Updated weights for policy 1, policy_version 568212 (0.0006) [2023-12-26 04:09:18,184][123090] Updated weights for policy 1, policy_version 568222 (0.0005) [2023-12-26 04:09:18,530][123091] Updated weights for policy 0, policy_version 572276 (0.0010) [2023-12-26 04:09:18,604][123091] Updated weights for policy 0, policy_version 572286 (0.0009) [2023-12-26 04:09:18,669][123091] Updated weights for policy 0, policy_version 572296 (0.0010) [2023-12-26 04:09:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 291979264. Throughput: 0: 8675.7, 1: 9042.2. Samples: 291990364. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:18,785][121949] Avg episode reward: [(0, '6050.265'), (1, '5640.610')] [2023-12-26 04:09:18,928][123090] Updated weights for policy 1, policy_version 568232 (0.0008) [2023-12-26 04:09:18,993][123090] Updated weights for policy 1, policy_version 568242 (0.0010) [2023-12-26 04:09:19,047][123090] Updated weights for policy 1, policy_version 568252 (0.0009) [2023-12-26 04:09:19,500][123091] Updated weights for policy 0, policy_version 572306 (0.0009) [2023-12-26 04:09:19,566][123091] Updated weights for policy 0, policy_version 572316 (0.0010) [2023-12-26 04:09:19,636][123091] Updated weights for policy 0, policy_version 572326 (0.0010) [2023-12-26 04:09:19,712][123091] Updated weights for policy 0, policy_version 572336 (0.0010) [2023-12-26 04:09:19,862][123090] Updated weights for policy 1, policy_version 568262 (0.0010) [2023-12-26 04:09:19,928][123090] Updated weights for policy 1, policy_version 568272 (0.0010) [2023-12-26 04:09:19,994][123090] Updated weights for policy 1, policy_version 568282 (0.0009) [2023-12-26 04:09:20,534][123091] Updated weights for policy 0, policy_version 572346 (0.0009) [2023-12-26 04:09:20,594][123091] Updated weights for policy 0, policy_version 572356 (0.0009) [2023-12-26 04:09:20,658][123091] Updated weights for policy 0, policy_version 572366 (0.0010) [2023-12-26 04:09:20,861][123090] Updated weights for policy 1, policy_version 568292 (0.0009) [2023-12-26 04:09:20,920][123090] Updated weights for policy 1, policy_version 568302 (0.0009) [2023-12-26 04:09:20,970][123090] Updated weights for policy 1, policy_version 568312 (0.0009) [2023-12-26 04:09:21,477][123091] Updated weights for policy 0, policy_version 572377 (0.0009) [2023-12-26 04:09:21,544][123091] Updated weights for policy 0, policy_version 572387 (0.0009) [2023-12-26 04:09:21,613][123091] Updated weights for policy 0, policy_version 572397 (0.0009) [2023-12-26 04:09:21,873][123090] Updated weights for policy 1, policy_version 568322 (0.0010) [2023-12-26 04:09:21,928][123090] Updated weights for policy 1, policy_version 568332 (0.0009) [2023-12-26 04:09:21,996][123090] Updated weights for policy 1, policy_version 568342 (0.0008) [2023-12-26 04:09:22,059][123090] Updated weights for policy 1, policy_version 568352 (0.0009) [2023-12-26 04:09:22,464][123091] Updated weights for policy 0, policy_version 572407 (0.0009) [2023-12-26 04:09:22,527][123091] Updated weights for policy 0, policy_version 572417 (0.0008) [2023-12-26 04:09:22,587][123091] Updated weights for policy 0, policy_version 572427 (0.0008) [2023-12-26 04:09:22,847][123090] Updated weights for policy 1, policy_version 568362 (0.0009) [2023-12-26 04:09:22,909][123090] Updated weights for policy 1, policy_version 568372 (0.0010) [2023-12-26 04:09:22,966][123090] Updated weights for policy 1, policy_version 568382 (0.0010) [2023-12-26 04:09:23,416][123091] Updated weights for policy 0, policy_version 572437 (0.0009) [2023-12-26 04:09:23,483][123091] Updated weights for policy 0, policy_version 572447 (0.0009) [2023-12-26 04:09:23,550][123091] Updated weights for policy 0, policy_version 572457 (0.0010) [2023-12-26 04:09:23,751][123090] Updated weights for policy 1, policy_version 568392 (0.0006) [2023-12-26 04:09:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 292061184. Throughput: 0: 8591.5, 1: 9012.8. Samples: 292039764. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:23,784][121949] Avg episode reward: [(0, '6134.857'), (1, '5613.619')] [2023-12-26 04:09:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000572464_146554880.pth... [2023-12-26 04:09:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000571472_146300928.pth [2023-12-26 04:09:23,806][123090] Updated weights for policy 1, policy_version 568402 (0.0005) [2023-12-26 04:09:23,864][123090] Updated weights for policy 1, policy_version 568412 (0.0005) [2023-12-26 04:09:23,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000568416_145514496.pth... [2023-12-26 04:09:23,888][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000567360_145244160.pth [2023-12-26 04:09:24,460][123091] Updated weights for policy 0, policy_version 572467 (0.0010) [2023-12-26 04:09:24,481][123090] Updated weights for policy 1, policy_version 568422 (0.0005) [2023-12-26 04:09:24,525][123091] Updated weights for policy 0, policy_version 572477 (0.0009) [2023-12-26 04:09:24,541][123090] Updated weights for policy 1, policy_version 568432 (0.0007) [2023-12-26 04:09:24,587][123091] Updated weights for policy 0, policy_version 572487 (0.0009) [2023-12-26 04:09:24,598][123090] Updated weights for policy 1, policy_version 568442 (0.0007) [2023-12-26 04:09:25,375][123090] Updated weights for policy 1, policy_version 568452 (0.0007) [2023-12-26 04:09:25,423][123091] Updated weights for policy 0, policy_version 572497 (0.0009) [2023-12-26 04:09:25,428][123090] Updated weights for policy 1, policy_version 568462 (0.0006) [2023-12-26 04:09:25,476][123090] Updated weights for policy 1, policy_version 568472 (0.0005) [2023-12-26 04:09:25,485][123091] Updated weights for policy 0, policy_version 572507 (0.0008) [2023-12-26 04:09:25,549][123091] Updated weights for policy 0, policy_version 572517 (0.0010) [2023-12-26 04:09:25,620][123091] Updated weights for policy 0, policy_version 572527 (0.0010) [2023-12-26 04:09:26,183][123090] Updated weights for policy 1, policy_version 568482 (0.0006) [2023-12-26 04:09:26,250][123090] Updated weights for policy 1, policy_version 568492 (0.0010) [2023-12-26 04:09:26,319][123090] Updated weights for policy 1, policy_version 568502 (0.0010) [2023-12-26 04:09:26,383][123090] Updated weights for policy 1, policy_version 568512 (0.0010) [2023-12-26 04:09:26,486][123091] Updated weights for policy 0, policy_version 572537 (0.0010) [2023-12-26 04:09:26,547][123091] Updated weights for policy 0, policy_version 572547 (0.0009) [2023-12-26 04:09:26,602][123091] Updated weights for policy 0, policy_version 572558 (0.0009) [2023-12-26 04:09:27,176][123090] Updated weights for policy 1, policy_version 568522 (0.0010) [2023-12-26 04:09:27,223][123090] Updated weights for policy 1, policy_version 568532 (0.0010) [2023-12-26 04:09:27,274][123090] Updated weights for policy 1, policy_version 568542 (0.0008) [2023-12-26 04:09:27,379][123091] Updated weights for policy 0, policy_version 572568 (0.0007) [2023-12-26 04:09:27,445][123091] Updated weights for policy 0, policy_version 572578 (0.0005) [2023-12-26 04:09:27,509][123091] Updated weights for policy 0, policy_version 572588 (0.0010) [2023-12-26 04:09:28,068][123090] Updated weights for policy 1, policy_version 568552 (0.0006) [2023-12-26 04:09:28,126][123090] Updated weights for policy 1, policy_version 568562 (0.0006) [2023-12-26 04:09:28,179][123090] Updated weights for policy 1, policy_version 568572 (0.0006) [2023-12-26 04:09:28,259][123091] Updated weights for policy 0, policy_version 572598 (0.0007) [2023-12-26 04:09:28,326][123091] Updated weights for policy 0, policy_version 572608 (0.0006) [2023-12-26 04:09:28,391][123091] Updated weights for policy 0, policy_version 572618 (0.0010) [2023-12-26 04:09:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 292151296. Throughput: 0: 8548.1, 1: 9043.1. Samples: 292146656. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:28,785][121949] Avg episode reward: [(0, '6095.841'), (1, '5539.545')] [2023-12-26 04:09:28,894][123090] Updated weights for policy 1, policy_version 568582 (0.0006) [2023-12-26 04:09:28,942][123090] Updated weights for policy 1, policy_version 568592 (0.0007) [2023-12-26 04:09:28,994][123090] Updated weights for policy 1, policy_version 568602 (0.0008) [2023-12-26 04:09:29,173][123091] Updated weights for policy 0, policy_version 572628 (0.0011) [2023-12-26 04:09:29,227][123091] Updated weights for policy 0, policy_version 572638 (0.0009) [2023-12-26 04:09:29,286][123091] Updated weights for policy 0, policy_version 572648 (0.0008) [2023-12-26 04:09:29,891][123090] Updated weights for policy 1, policy_version 568612 (0.0009) [2023-12-26 04:09:29,963][123090] Updated weights for policy 1, policy_version 568622 (0.0010) [2023-12-26 04:09:30,016][123091] Updated weights for policy 0, policy_version 572658 (0.0008) [2023-12-26 04:09:30,034][123090] Updated weights for policy 1, policy_version 568632 (0.0009) [2023-12-26 04:09:30,072][123091] Updated weights for policy 0, policy_version 572668 (0.0005) [2023-12-26 04:09:30,147][123091] Updated weights for policy 0, policy_version 572678 (0.0005) [2023-12-26 04:09:30,211][123091] Updated weights for policy 0, policy_version 572688 (0.0005) [2023-12-26 04:09:30,846][123091] Updated weights for policy 0, policy_version 572698 (0.0011) [2023-12-26 04:09:30,852][123090] Updated weights for policy 1, policy_version 568642 (0.0008) [2023-12-26 04:09:30,901][123091] Updated weights for policy 0, policy_version 572708 (0.0010) [2023-12-26 04:09:30,915][123090] Updated weights for policy 1, policy_version 568652 (0.0006) [2023-12-26 04:09:30,951][123091] Updated weights for policy 0, policy_version 572718 (0.0010) [2023-12-26 04:09:30,971][123090] Updated weights for policy 1, policy_version 568662 (0.0006) [2023-12-26 04:09:31,027][123090] Updated weights for policy 1, policy_version 568672 (0.0009) [2023-12-26 04:09:31,745][123090] Updated weights for policy 1, policy_version 568682 (0.0010) [2023-12-26 04:09:31,773][123091] Updated weights for policy 0, policy_version 572728 (0.0009) [2023-12-26 04:09:31,800][123090] Updated weights for policy 1, policy_version 568692 (0.0010) [2023-12-26 04:09:31,826][123091] Updated weights for policy 0, policy_version 572739 (0.0007) [2023-12-26 04:09:31,848][123090] Updated weights for policy 1, policy_version 568702 (0.0010) [2023-12-26 04:09:31,873][123091] Updated weights for policy 0, policy_version 572749 (0.0010) [2023-12-26 04:09:32,685][123090] Updated weights for policy 1, policy_version 568712 (0.0009) [2023-12-26 04:09:32,729][123091] Updated weights for policy 0, policy_version 572759 (0.0010) [2023-12-26 04:09:32,744][123090] Updated weights for policy 1, policy_version 568722 (0.0007) [2023-12-26 04:09:32,781][123091] Updated weights for policy 0, policy_version 572769 (0.0010) [2023-12-26 04:09:32,806][123090] Updated weights for policy 1, policy_version 568732 (0.0006) [2023-12-26 04:09:32,835][123091] Updated weights for policy 0, policy_version 572779 (0.0010) [2023-12-26 04:09:33,619][123091] Updated weights for policy 0, policy_version 572789 (0.0009) [2023-12-26 04:09:33,631][123090] Updated weights for policy 1, policy_version 568742 (0.0006) [2023-12-26 04:09:33,673][123091] Updated weights for policy 0, policy_version 572799 (0.0009) [2023-12-26 04:09:33,697][123090] Updated weights for policy 1, policy_version 568752 (0.0010) [2023-12-26 04:09:33,734][123091] Updated weights for policy 0, policy_version 572809 (0.0006) [2023-12-26 04:09:33,751][123090] Updated weights for policy 1, policy_version 568762 (0.0007) [2023-12-26 04:09:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 292249600. Throughput: 0: 8516.5, 1: 8963.4. Samples: 292253608. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:33,785][121949] Avg episode reward: [(0, '6073.875'), (1, '5735.133')] [2023-12-26 04:09:34,469][123090] Updated weights for policy 1, policy_version 568772 (0.0007) [2023-12-26 04:09:34,535][123090] Updated weights for policy 1, policy_version 568782 (0.0007) [2023-12-26 04:09:34,605][123090] Updated weights for policy 1, policy_version 568792 (0.0010) [2023-12-26 04:09:34,621][123091] Updated weights for policy 0, policy_version 572819 (0.0009) [2023-12-26 04:09:34,682][123091] Updated weights for policy 0, policy_version 572829 (0.0009) [2023-12-26 04:09:34,751][123091] Updated weights for policy 0, policy_version 572839 (0.0009) [2023-12-26 04:09:35,221][123090] Updated weights for policy 1, policy_version 568802 (0.0009) [2023-12-26 04:09:35,288][123090] Updated weights for policy 1, policy_version 568812 (0.0009) [2023-12-26 04:09:35,353][123090] Updated weights for policy 1, policy_version 568822 (0.0010) [2023-12-26 04:09:35,428][123090] Updated weights for policy 1, policy_version 568832 (0.0010) [2023-12-26 04:09:35,578][123091] Updated weights for policy 0, policy_version 572849 (0.0009) [2023-12-26 04:09:35,634][123091] Updated weights for policy 0, policy_version 572859 (0.0006) [2023-12-26 04:09:35,678][123091] Updated weights for policy 0, policy_version 572869 (0.0005) [2023-12-26 04:09:35,730][123091] Updated weights for policy 0, policy_version 572879 (0.0005) [2023-12-26 04:09:36,205][123090] Updated weights for policy 1, policy_version 568842 (0.0010) [2023-12-26 04:09:36,269][123090] Updated weights for policy 1, policy_version 568852 (0.0011) [2023-12-26 04:09:36,340][123090] Updated weights for policy 1, policy_version 568862 (0.0010) [2023-12-26 04:09:36,532][123091] Updated weights for policy 0, policy_version 572889 (0.0009) [2023-12-26 04:09:36,592][123091] Updated weights for policy 0, policy_version 572899 (0.0009) [2023-12-26 04:09:36,647][123091] Updated weights for policy 0, policy_version 572909 (0.0010) [2023-12-26 04:09:37,093][123090] Updated weights for policy 1, policy_version 568872 (0.0010) [2023-12-26 04:09:37,156][123090] Updated weights for policy 1, policy_version 568882 (0.0010) [2023-12-26 04:09:37,220][123090] Updated weights for policy 1, policy_version 568892 (0.0009) [2023-12-26 04:09:37,506][123091] Updated weights for policy 0, policy_version 572919 (0.0009) [2023-12-26 04:09:37,571][123091] Updated weights for policy 0, policy_version 572929 (0.0010) [2023-12-26 04:09:37,643][123091] Updated weights for policy 0, policy_version 572939 (0.0007) [2023-12-26 04:09:37,977][123090] Updated weights for policy 1, policy_version 568902 (0.0007) [2023-12-26 04:09:38,042][123090] Updated weights for policy 1, policy_version 568912 (0.0007) [2023-12-26 04:09:38,099][123090] Updated weights for policy 1, policy_version 568922 (0.0005) [2023-12-26 04:09:38,345][123091] Updated weights for policy 0, policy_version 572949 (0.0007) [2023-12-26 04:09:38,412][123091] Updated weights for policy 0, policy_version 572959 (0.0008) [2023-12-26 04:09:38,467][123091] Updated weights for policy 0, policy_version 572969 (0.0008) [2023-12-26 04:09:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 292331520. Throughput: 0: 8535.0, 1: 8989.5. Samples: 292307364. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:38,785][121949] Avg episode reward: [(0, '5912.236'), (1, '5891.058')] [2023-12-26 04:09:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000572976_146685952.pth... [2023-12-26 04:09:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000568928_145645568.pth... [2023-12-26 04:09:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000571984_146432000.pth [2023-12-26 04:09:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000567904_145383424.pth [2023-12-26 04:09:38,844][123090] Updated weights for policy 1, policy_version 568932 (0.0007) [2023-12-26 04:09:38,899][123090] Updated weights for policy 1, policy_version 568942 (0.0010) [2023-12-26 04:09:38,955][123090] Updated weights for policy 1, policy_version 568952 (0.0010) [2023-12-26 04:09:39,274][123091] Updated weights for policy 0, policy_version 572979 (0.0009) [2023-12-26 04:09:39,334][123091] Updated weights for policy 0, policy_version 572989 (0.0011) [2023-12-26 04:09:39,404][123091] Updated weights for policy 0, policy_version 572999 (0.0009) [2023-12-26 04:09:39,822][123090] Updated weights for policy 1, policy_version 568962 (0.0009) [2023-12-26 04:09:39,892][123090] Updated weights for policy 1, policy_version 568972 (0.0010) [2023-12-26 04:09:39,958][123090] Updated weights for policy 1, policy_version 568982 (0.0008) [2023-12-26 04:09:40,029][123090] Updated weights for policy 1, policy_version 568992 (0.0009) [2023-12-26 04:09:40,179][123091] Updated weights for policy 0, policy_version 573009 (0.0009) [2023-12-26 04:09:40,244][123091] Updated weights for policy 0, policy_version 573019 (0.0006) [2023-12-26 04:09:40,315][123091] Updated weights for policy 0, policy_version 573029 (0.0006) [2023-12-26 04:09:40,384][123091] Updated weights for policy 0, policy_version 573039 (0.0006) [2023-12-26 04:09:40,881][123090] Updated weights for policy 1, policy_version 569002 (0.0010) [2023-12-26 04:09:40,944][123090] Updated weights for policy 1, policy_version 569012 (0.0010) [2023-12-26 04:09:41,007][123090] Updated weights for policy 1, policy_version 569022 (0.0010) [2023-12-26 04:09:41,084][123091] Updated weights for policy 0, policy_version 573049 (0.0009) [2023-12-26 04:09:41,168][123091] Updated weights for policy 0, policy_version 573059 (0.0009) [2023-12-26 04:09:41,230][123091] Updated weights for policy 0, policy_version 573069 (0.0010) [2023-12-26 04:09:41,825][123090] Updated weights for policy 1, policy_version 569032 (0.0008) [2023-12-26 04:09:41,881][123090] Updated weights for policy 1, policy_version 569042 (0.0008) [2023-12-26 04:09:41,942][123090] Updated weights for policy 1, policy_version 569052 (0.0009) [2023-12-26 04:09:42,036][123091] Updated weights for policy 0, policy_version 573079 (0.0010) [2023-12-26 04:09:42,112][123091] Updated weights for policy 0, policy_version 573089 (0.0010) [2023-12-26 04:09:42,175][123091] Updated weights for policy 0, policy_version 573099 (0.0009) [2023-12-26 04:09:42,752][123090] Updated weights for policy 1, policy_version 569062 (0.0007) [2023-12-26 04:09:42,817][123090] Updated weights for policy 1, policy_version 569072 (0.0006) [2023-12-26 04:09:42,882][123090] Updated weights for policy 1, policy_version 569082 (0.0008) [2023-12-26 04:09:42,976][123091] Updated weights for policy 0, policy_version 573109 (0.0007) [2023-12-26 04:09:43,033][123091] Updated weights for policy 0, policy_version 573119 (0.0007) [2023-12-26 04:09:43,095][123091] Updated weights for policy 0, policy_version 573129 (0.0006) [2023-12-26 04:09:43,699][123090] Updated weights for policy 1, policy_version 569092 (0.0007) [2023-12-26 04:09:43,764][123090] Updated weights for policy 1, policy_version 569102 (0.0008) [2023-12-26 04:09:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 292413440. Throughput: 0: 8528.6, 1: 8914.4. Samples: 292411600. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:43,785][121949] Avg episode reward: [(0, '5883.762'), (1, '5946.432')] [2023-12-26 04:09:43,824][123091] Updated weights for policy 0, policy_version 573139 (0.0007) [2023-12-26 04:09:43,833][123090] Updated weights for policy 1, policy_version 569112 (0.0006) [2023-12-26 04:09:43,872][123091] Updated weights for policy 0, policy_version 573149 (0.0009) [2023-12-26 04:09:43,936][123091] Updated weights for policy 0, policy_version 573159 (0.0009) [2023-12-26 04:09:44,623][123090] Updated weights for policy 1, policy_version 569122 (0.0007) [2023-12-26 04:09:44,671][123090] Updated weights for policy 1, policy_version 569132 (0.0009) [2023-12-26 04:09:44,720][123090] Updated weights for policy 1, policy_version 569142 (0.0008) [2023-12-26 04:09:44,762][123091] Updated weights for policy 0, policy_version 573169 (0.0009) [2023-12-26 04:09:44,785][123090] Updated weights for policy 1, policy_version 569152 (0.0008) [2023-12-26 04:09:44,825][123091] Updated weights for policy 0, policy_version 573179 (0.0009) [2023-12-26 04:09:44,892][123091] Updated weights for policy 0, policy_version 573189 (0.0009) [2023-12-26 04:09:44,954][123091] Updated weights for policy 0, policy_version 573199 (0.0010) [2023-12-26 04:09:45,660][123090] Updated weights for policy 1, policy_version 569162 (0.0008) [2023-12-26 04:09:45,722][123090] Updated weights for policy 1, policy_version 569172 (0.0010) [2023-12-26 04:09:45,770][123090] Updated weights for policy 1, policy_version 569182 (0.0010) [2023-12-26 04:09:45,773][123091] Updated weights for policy 0, policy_version 573209 (0.0009) [2023-12-26 04:09:45,837][123091] Updated weights for policy 0, policy_version 573219 (0.0009) [2023-12-26 04:09:45,908][123091] Updated weights for policy 0, policy_version 573229 (0.0010) [2023-12-26 04:09:46,611][123090] Updated weights for policy 1, policy_version 569192 (0.0010) [2023-12-26 04:09:46,669][123090] Updated weights for policy 1, policy_version 569202 (0.0007) [2023-12-26 04:09:46,726][123090] Updated weights for policy 1, policy_version 569212 (0.0005) [2023-12-26 04:09:46,748][123091] Updated weights for policy 0, policy_version 573240 (0.0011) [2023-12-26 04:09:46,809][123091] Updated weights for policy 0, policy_version 573250 (0.0009) [2023-12-26 04:09:46,860][123091] Updated weights for policy 0, policy_version 573260 (0.0009) [2023-12-26 04:09:47,461][123090] Updated weights for policy 1, policy_version 569222 (0.0005) [2023-12-26 04:09:47,507][123090] Updated weights for policy 1, policy_version 569232 (0.0005) [2023-12-26 04:09:47,564][123090] Updated weights for policy 1, policy_version 569242 (0.0005) [2023-12-26 04:09:47,731][123091] Updated weights for policy 0, policy_version 573270 (0.0010) [2023-12-26 04:09:47,779][123091] Updated weights for policy 0, policy_version 573280 (0.0010) [2023-12-26 04:09:47,839][123091] Updated weights for policy 0, policy_version 573290 (0.0010) [2023-12-26 04:09:48,264][123090] Updated weights for policy 1, policy_version 569252 (0.0006) [2023-12-26 04:09:48,334][123090] Updated weights for policy 1, policy_version 569262 (0.0008) [2023-12-26 04:09:48,385][123090] Updated weights for policy 1, policy_version 569272 (0.0008) [2023-12-26 04:09:48,677][123091] Updated weights for policy 0, policy_version 573300 (0.0009) [2023-12-26 04:09:48,741][123091] Updated weights for policy 0, policy_version 573310 (0.0006) [2023-12-26 04:09:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 292503552. Throughput: 0: 8565.8, 1: 8926.1. Samples: 292518204. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:48,785][121949] Avg episode reward: [(0, '6044.205'), (1, '5911.111')] [2023-12-26 04:09:48,806][123091] Updated weights for policy 0, policy_version 573320 (0.0010) [2023-12-26 04:09:49,206][123090] Updated weights for policy 1, policy_version 569282 (0.0007) [2023-12-26 04:09:49,275][123090] Updated weights for policy 1, policy_version 569292 (0.0009) [2023-12-26 04:09:49,329][123090] Updated weights for policy 1, policy_version 569302 (0.0009) [2023-12-26 04:09:49,392][123090] Updated weights for policy 1, policy_version 569312 (0.0009) [2023-12-26 04:09:49,618][123091] Updated weights for policy 0, policy_version 573330 (0.0010) [2023-12-26 04:09:49,685][123091] Updated weights for policy 0, policy_version 573340 (0.0009) [2023-12-26 04:09:49,748][123091] Updated weights for policy 0, policy_version 573350 (0.0009) [2023-12-26 04:09:49,807][123091] Updated weights for policy 0, policy_version 573360 (0.0009) [2023-12-26 04:09:50,281][123090] Updated weights for policy 1, policy_version 569322 (0.0007) [2023-12-26 04:09:50,341][123090] Updated weights for policy 1, policy_version 569332 (0.0008) [2023-12-26 04:09:50,404][123090] Updated weights for policy 1, policy_version 569342 (0.0008) [2023-12-26 04:09:50,589][123091] Updated weights for policy 0, policy_version 573370 (0.0009) [2023-12-26 04:09:50,653][123091] Updated weights for policy 0, policy_version 573380 (0.0008) [2023-12-26 04:09:50,716][123091] Updated weights for policy 0, policy_version 573390 (0.0009) [2023-12-26 04:09:51,196][123090] Updated weights for policy 1, policy_version 569352 (0.0006) [2023-12-26 04:09:51,271][123090] Updated weights for policy 1, policy_version 569362 (0.0008) [2023-12-26 04:09:51,334][123090] Updated weights for policy 1, policy_version 569372 (0.0009) [2023-12-26 04:09:51,536][123091] Updated weights for policy 0, policy_version 573400 (0.0009) [2023-12-26 04:09:51,588][123091] Updated weights for policy 0, policy_version 573410 (0.0009) [2023-12-26 04:09:51,666][123091] Updated weights for policy 0, policy_version 573420 (0.0009) [2023-12-26 04:09:52,165][123090] Updated weights for policy 1, policy_version 569382 (0.0010) [2023-12-26 04:09:52,230][123090] Updated weights for policy 1, policy_version 569392 (0.0011) [2023-12-26 04:09:52,296][123090] Updated weights for policy 1, policy_version 569402 (0.0010) [2023-12-26 04:09:52,489][123091] Updated weights for policy 0, policy_version 573430 (0.0009) [2023-12-26 04:09:52,550][123091] Updated weights for policy 0, policy_version 573440 (0.0009) [2023-12-26 04:09:52,610][123091] Updated weights for policy 0, policy_version 573450 (0.0009) [2023-12-26 04:09:53,015][123090] Updated weights for policy 1, policy_version 569412 (0.0008) [2023-12-26 04:09:53,073][123090] Updated weights for policy 1, policy_version 569422 (0.0005) [2023-12-26 04:09:53,141][123090] Updated weights for policy 1, policy_version 569432 (0.0005) [2023-12-26 04:09:53,529][123091] Updated weights for policy 0, policy_version 573460 (0.0008) [2023-12-26 04:09:53,587][123091] Updated weights for policy 0, policy_version 573470 (0.0008) [2023-12-26 04:09:53,635][123091] Updated weights for policy 0, policy_version 573480 (0.0009) [2023-12-26 04:09:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17661.5). Total num frames: 292593664. Throughput: 0: 8573.3, 1: 8872.2. Samples: 292569324. Policy #0 lag: (min: 6.0, avg: 7.8, max: 38.0) [2023-12-26 04:09:53,785][121949] Avg episode reward: [(0, '6136.482'), (1, '5802.714')] [2023-12-26 04:09:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000573488_146817024.pth... [2023-12-26 04:09:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000569440_145776640.pth... [2023-12-26 04:09:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000572464_146554880.pth [2023-12-26 04:09:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000568416_145514496.pth [2023-12-26 04:09:53,860][123090] Updated weights for policy 1, policy_version 569442 (0.0007) [2023-12-26 04:09:53,919][123090] Updated weights for policy 1, policy_version 569452 (0.0010) [2023-12-26 04:09:53,974][123090] Updated weights for policy 1, policy_version 569462 (0.0010) [2023-12-26 04:09:54,026][123090] Updated weights for policy 1, policy_version 569472 (0.0010) [2023-12-26 04:09:54,440][123091] Updated weights for policy 0, policy_version 573490 (0.0008) [2023-12-26 04:09:54,504][123091] Updated weights for policy 0, policy_version 573500 (0.0005) [2023-12-26 04:09:54,569][123091] Updated weights for policy 0, policy_version 573510 (0.0006) [2023-12-26 04:09:54,637][123091] Updated weights for policy 0, policy_version 573520 (0.0005) [2023-12-26 04:09:54,807][123090] Updated weights for policy 1, policy_version 569482 (0.0005) [2023-12-26 04:09:54,864][123090] Updated weights for policy 1, policy_version 569492 (0.0005) [2023-12-26 04:09:54,933][123090] Updated weights for policy 1, policy_version 569502 (0.0006) [2023-12-26 04:09:55,301][123091] Updated weights for policy 0, policy_version 573530 (0.0009) [2023-12-26 04:09:55,360][123091] Updated weights for policy 0, policy_version 573540 (0.0008) [2023-12-26 04:09:55,415][123091] Updated weights for policy 0, policy_version 573550 (0.0009) [2023-12-26 04:09:55,707][123090] Updated weights for policy 1, policy_version 569512 (0.0010) [2023-12-26 04:09:55,772][123090] Updated weights for policy 1, policy_version 569522 (0.0010) [2023-12-26 04:09:55,819][123090] Updated weights for policy 1, policy_version 569532 (0.0010) [2023-12-26 04:09:56,172][123091] Updated weights for policy 0, policy_version 573560 (0.0007) [2023-12-26 04:09:56,224][123091] Updated weights for policy 0, policy_version 573570 (0.0006) [2023-12-26 04:09:56,271][123091] Updated weights for policy 0, policy_version 573580 (0.0008) [2023-12-26 04:09:56,646][123090] Updated weights for policy 1, policy_version 569542 (0.0010) [2023-12-26 04:09:56,697][123090] Updated weights for policy 1, policy_version 569552 (0.0010) [2023-12-26 04:09:56,749][123090] Updated weights for policy 1, policy_version 569562 (0.0010) [2023-12-26 04:09:57,081][123091] Updated weights for policy 0, policy_version 573590 (0.0009) [2023-12-26 04:09:57,138][123091] Updated weights for policy 0, policy_version 573600 (0.0009) [2023-12-26 04:09:57,201][123091] Updated weights for policy 0, policy_version 573610 (0.0009) [2023-12-26 04:09:57,587][123090] Updated weights for policy 1, policy_version 569572 (0.0011) [2023-12-26 04:09:57,654][123090] Updated weights for policy 1, policy_version 569582 (0.0007) [2023-12-26 04:09:57,717][123090] Updated weights for policy 1, policy_version 569592 (0.0010) [2023-12-26 04:09:58,062][123091] Updated weights for policy 0, policy_version 573620 (0.0008) [2023-12-26 04:09:58,117][123091] Updated weights for policy 0, policy_version 573630 (0.0008) [2023-12-26 04:09:58,165][123091] Updated weights for policy 0, policy_version 573640 (0.0007) [2023-12-26 04:09:58,437][123090] Updated weights for policy 1, policy_version 569602 (0.0006) [2023-12-26 04:09:58,505][123090] Updated weights for policy 1, policy_version 569612 (0.0009) [2023-12-26 04:09:58,573][123090] Updated weights for policy 1, policy_version 569622 (0.0013) [2023-12-26 04:09:58,642][123090] Updated weights for policy 1, policy_version 569632 (0.0009) [2023-12-26 04:09:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 292683776. Throughput: 0: 8679.5, 1: 8871.6. Samples: 292676456. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:09:58,785][121949] Avg episode reward: [(0, '6068.959'), (1, '5775.981')] [2023-12-26 04:09:59,001][123091] Updated weights for policy 0, policy_version 573650 (0.0008) [2023-12-26 04:09:59,069][123091] Updated weights for policy 0, policy_version 573660 (0.0008) [2023-12-26 04:09:59,142][123091] Updated weights for policy 0, policy_version 573670 (0.0008) [2023-12-26 04:09:59,214][123091] Updated weights for policy 0, policy_version 573680 (0.0007) [2023-12-26 04:09:59,484][123090] Updated weights for policy 1, policy_version 569642 (0.0010) [2023-12-26 04:09:59,536][123090] Updated weights for policy 1, policy_version 569652 (0.0010) [2023-12-26 04:09:59,595][123090] Updated weights for policy 1, policy_version 569662 (0.0010) [2023-12-26 04:10:00,013][123091] Updated weights for policy 0, policy_version 573690 (0.0009) [2023-12-26 04:10:00,066][123091] Updated weights for policy 0, policy_version 573700 (0.0009) [2023-12-26 04:10:00,115][123091] Updated weights for policy 0, policy_version 573710 (0.0009) [2023-12-26 04:10:00,436][123090] Updated weights for policy 1, policy_version 569672 (0.0010) [2023-12-26 04:10:00,491][123090] Updated weights for policy 1, policy_version 569682 (0.0010) [2023-12-26 04:10:00,542][123090] Updated weights for policy 1, policy_version 569692 (0.0010) [2023-12-26 04:10:00,978][123091] Updated weights for policy 0, policy_version 573720 (0.0010) [2023-12-26 04:10:01,044][123091] Updated weights for policy 0, policy_version 573730 (0.0009) [2023-12-26 04:10:01,096][123091] Updated weights for policy 0, policy_version 573740 (0.0006) [2023-12-26 04:10:01,384][123090] Updated weights for policy 1, policy_version 569702 (0.0010) [2023-12-26 04:10:01,439][123090] Updated weights for policy 1, policy_version 569712 (0.0010) [2023-12-26 04:10:01,495][123090] Updated weights for policy 1, policy_version 569722 (0.0010) [2023-12-26 04:10:01,877][123091] Updated weights for policy 0, policy_version 573750 (0.0005) [2023-12-26 04:10:01,923][123091] Updated weights for policy 0, policy_version 573760 (0.0006) [2023-12-26 04:10:01,983][123091] Updated weights for policy 0, policy_version 573770 (0.0009) [2023-12-26 04:10:02,345][123090] Updated weights for policy 1, policy_version 569732 (0.0010) [2023-12-26 04:10:02,413][123090] Updated weights for policy 1, policy_version 569742 (0.0008) [2023-12-26 04:10:02,482][123090] Updated weights for policy 1, policy_version 569752 (0.0008) [2023-12-26 04:10:02,758][123091] Updated weights for policy 0, policy_version 573780 (0.0009) [2023-12-26 04:10:02,822][123091] Updated weights for policy 0, policy_version 573790 (0.0009) [2023-12-26 04:10:02,875][123091] Updated weights for policy 0, policy_version 573800 (0.0009) [2023-12-26 04:10:03,266][123090] Updated weights for policy 1, policy_version 569762 (0.0009) [2023-12-26 04:10:03,336][123090] Updated weights for policy 1, policy_version 569772 (0.0010) [2023-12-26 04:10:03,403][123090] Updated weights for policy 1, policy_version 569782 (0.0010) [2023-12-26 04:10:03,469][123090] Updated weights for policy 1, policy_version 569792 (0.0010) [2023-12-26 04:10:03,619][123091] Updated weights for policy 0, policy_version 573810 (0.0009) [2023-12-26 04:10:03,677][123091] Updated weights for policy 0, policy_version 573820 (0.0005) [2023-12-26 04:10:03,727][123091] Updated weights for policy 0, policy_version 573830 (0.0006) [2023-12-26 04:10:03,774][123091] Updated weights for policy 0, policy_version 573840 (0.0008) [2023-12-26 04:10:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 292773888. Throughput: 0: 8738.2, 1: 8833.7. Samples: 292781100. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:03,785][121949] Avg episode reward: [(0, '6107.066'), (1, '5822.975')] [2023-12-26 04:10:04,243][123090] Updated weights for policy 1, policy_version 569802 (0.0011) [2023-12-26 04:10:04,307][123090] Updated weights for policy 1, policy_version 569812 (0.0011) [2023-12-26 04:10:04,380][123090] Updated weights for policy 1, policy_version 569822 (0.0011) [2023-12-26 04:10:04,651][123091] Updated weights for policy 0, policy_version 573850 (0.0009) [2023-12-26 04:10:04,726][123091] Updated weights for policy 0, policy_version 573860 (0.0008) [2023-12-26 04:10:04,791][123091] Updated weights for policy 0, policy_version 573870 (0.0005) [2023-12-26 04:10:05,161][123090] Updated weights for policy 1, policy_version 569832 (0.0006) [2023-12-26 04:10:05,210][123090] Updated weights for policy 1, policy_version 569842 (0.0005) [2023-12-26 04:10:05,265][123090] Updated weights for policy 1, policy_version 569852 (0.0005) [2023-12-26 04:10:05,507][123091] Updated weights for policy 0, policy_version 573880 (0.0009) [2023-12-26 04:10:05,560][123091] Updated weights for policy 0, policy_version 573890 (0.0010) [2023-12-26 04:10:05,613][123091] Updated weights for policy 0, policy_version 573901 (0.0010) [2023-12-26 04:10:05,899][123090] Updated weights for policy 1, policy_version 569862 (0.0007) [2023-12-26 04:10:05,965][123090] Updated weights for policy 1, policy_version 569872 (0.0008) [2023-12-26 04:10:06,017][123090] Updated weights for policy 1, policy_version 569882 (0.0005) [2023-12-26 04:10:06,431][123091] Updated weights for policy 0, policy_version 573912 (0.0011) [2023-12-26 04:10:06,496][123091] Updated weights for policy 0, policy_version 573922 (0.0010) [2023-12-26 04:10:06,564][123091] Updated weights for policy 0, policy_version 573932 (0.0009) [2023-12-26 04:10:06,764][123090] Updated weights for policy 1, policy_version 569892 (0.0007) [2023-12-26 04:10:06,816][123090] Updated weights for policy 1, policy_version 569902 (0.0009) [2023-12-26 04:10:06,871][123090] Updated weights for policy 1, policy_version 569912 (0.0009) [2023-12-26 04:10:07,396][123091] Updated weights for policy 0, policy_version 573942 (0.0010) [2023-12-26 04:10:07,457][123091] Updated weights for policy 0, policy_version 573952 (0.0009) [2023-12-26 04:10:07,516][123091] Updated weights for policy 0, policy_version 573962 (0.0006) [2023-12-26 04:10:07,718][123090] Updated weights for policy 1, policy_version 569922 (0.0008) [2023-12-26 04:10:07,778][123090] Updated weights for policy 1, policy_version 569932 (0.0005) [2023-12-26 04:10:07,833][123090] Updated weights for policy 1, policy_version 569942 (0.0005) [2023-12-26 04:10:07,886][123090] Updated weights for policy 1, policy_version 569952 (0.0005) [2023-12-26 04:10:08,263][123091] Updated weights for policy 0, policy_version 573972 (0.0009) [2023-12-26 04:10:08,339][123091] Updated weights for policy 0, policy_version 573982 (0.0010) [2023-12-26 04:10:08,401][123091] Updated weights for policy 0, policy_version 573992 (0.0011) [2023-12-26 04:10:08,531][123090] Updated weights for policy 1, policy_version 569962 (0.0005) [2023-12-26 04:10:08,589][123090] Updated weights for policy 1, policy_version 569972 (0.0005) [2023-12-26 04:10:08,643][123090] Updated weights for policy 1, policy_version 569982 (0.0006) [2023-12-26 04:10:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 292864000. Throughput: 0: 8760.8, 1: 8928.0. Samples: 292835760. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:08,785][121949] Avg episode reward: [(0, '6036.617'), (1, '5826.926')] [2023-12-26 04:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000574000_146948096.pth... [2023-12-26 04:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000569984_145915904.pth... [2023-12-26 04:10:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000572976_146685952.pth [2023-12-26 04:10:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000568928_145645568.pth [2023-12-26 04:10:09,110][123091] Updated weights for policy 0, policy_version 574002 (0.0010) [2023-12-26 04:10:09,167][123091] Updated weights for policy 0, policy_version 574012 (0.0005) [2023-12-26 04:10:09,228][123091] Updated weights for policy 0, policy_version 574022 (0.0006) [2023-12-26 04:10:09,298][123091] Updated weights for policy 0, policy_version 574032 (0.0006) [2023-12-26 04:10:09,544][123090] Updated weights for policy 1, policy_version 569992 (0.0009) [2023-12-26 04:10:09,606][123090] Updated weights for policy 1, policy_version 570002 (0.0009) [2023-12-26 04:10:09,674][123090] Updated weights for policy 1, policy_version 570012 (0.0006) [2023-12-26 04:10:10,142][123091] Updated weights for policy 0, policy_version 574042 (0.0010) [2023-12-26 04:10:10,216][123091] Updated weights for policy 0, policy_version 574052 (0.0007) [2023-12-26 04:10:10,283][123091] Updated weights for policy 0, policy_version 574062 (0.0011) [2023-12-26 04:10:10,513][123090] Updated weights for policy 1, policy_version 570022 (0.0008) [2023-12-26 04:10:10,581][123090] Updated weights for policy 1, policy_version 570032 (0.0009) [2023-12-26 04:10:10,648][123090] Updated weights for policy 1, policy_version 570042 (0.0009) [2023-12-26 04:10:11,043][123091] Updated weights for policy 0, policy_version 574072 (0.0009) [2023-12-26 04:10:11,099][123091] Updated weights for policy 0, policy_version 574082 (0.0009) [2023-12-26 04:10:11,168][123091] Updated weights for policy 0, policy_version 574092 (0.0008) [2023-12-26 04:10:11,413][123090] Updated weights for policy 1, policy_version 570052 (0.0009) [2023-12-26 04:10:11,476][123090] Updated weights for policy 1, policy_version 570062 (0.0008) [2023-12-26 04:10:11,541][123090] Updated weights for policy 1, policy_version 570072 (0.0008) [2023-12-26 04:10:12,039][123091] Updated weights for policy 0, policy_version 574102 (0.0010) [2023-12-26 04:10:12,098][123091] Updated weights for policy 0, policy_version 574112 (0.0011) [2023-12-26 04:10:12,149][123091] Updated weights for policy 0, policy_version 574123 (0.0009) [2023-12-26 04:10:12,367][123090] Updated weights for policy 1, policy_version 570082 (0.0008) [2023-12-26 04:10:12,435][123090] Updated weights for policy 1, policy_version 570092 (0.0006) [2023-12-26 04:10:12,506][123090] Updated weights for policy 1, policy_version 570102 (0.0006) [2023-12-26 04:10:12,579][123090] Updated weights for policy 1, policy_version 570112 (0.0006) [2023-12-26 04:10:13,078][123091] Updated weights for policy 0, policy_version 574133 (0.0010) [2023-12-26 04:10:13,129][123091] Updated weights for policy 0, policy_version 574143 (0.0009) [2023-12-26 04:10:13,180][123091] Updated weights for policy 0, policy_version 574153 (0.0008) [2023-12-26 04:10:13,181][123090] Updated weights for policy 1, policy_version 570122 (0.0009) [2023-12-26 04:10:13,247][123090] Updated weights for policy 1, policy_version 570132 (0.0010) [2023-12-26 04:10:13,314][123090] Updated weights for policy 1, policy_version 570142 (0.0010) [2023-12-26 04:10:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 292945920. Throughput: 0: 8789.4, 1: 8869.4. Samples: 292941300. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:13,785][121949] Avg episode reward: [(0, '5869.799'), (1, '5744.161')] [2023-12-26 04:10:14,042][123091] Updated weights for policy 0, policy_version 574163 (0.0008) [2023-12-26 04:10:14,083][123090] Updated weights for policy 1, policy_version 570152 (0.0009) [2023-12-26 04:10:14,090][123091] Updated weights for policy 0, policy_version 574173 (0.0009) [2023-12-26 04:10:14,145][123090] Updated weights for policy 1, policy_version 570162 (0.0008) [2023-12-26 04:10:14,155][123091] Updated weights for policy 0, policy_version 574183 (0.0010) [2023-12-26 04:10:14,208][123090] Updated weights for policy 1, policy_version 570172 (0.0009) [2023-12-26 04:10:14,818][123091] Updated weights for policy 0, policy_version 574193 (0.0007) [2023-12-26 04:10:14,879][123091] Updated weights for policy 0, policy_version 574203 (0.0010) [2023-12-26 04:10:14,948][123091] Updated weights for policy 0, policy_version 574213 (0.0007) [2023-12-26 04:10:15,016][123091] Updated weights for policy 0, policy_version 574223 (0.0011) [2023-12-26 04:10:15,067][123090] Updated weights for policy 1, policy_version 570182 (0.0009) [2023-12-26 04:10:15,126][123090] Updated weights for policy 1, policy_version 570192 (0.0009) [2023-12-26 04:10:15,190][123090] Updated weights for policy 1, policy_version 570202 (0.0009) [2023-12-26 04:10:15,769][123091] Updated weights for policy 0, policy_version 574233 (0.0006) [2023-12-26 04:10:15,821][123091] Updated weights for policy 0, policy_version 574243 (0.0005) [2023-12-26 04:10:15,867][123091] Updated weights for policy 0, policy_version 574253 (0.0005) [2023-12-26 04:10:16,038][123090] Updated weights for policy 1, policy_version 570212 (0.0009) [2023-12-26 04:10:16,095][123090] Updated weights for policy 1, policy_version 570223 (0.0010) [2023-12-26 04:10:16,153][123090] Updated weights for policy 1, policy_version 570233 (0.0010) [2023-12-26 04:10:16,515][123091] Updated weights for policy 0, policy_version 574263 (0.0005) [2023-12-26 04:10:16,565][123091] Updated weights for policy 0, policy_version 574273 (0.0005) [2023-12-26 04:10:16,613][123091] Updated weights for policy 0, policy_version 574283 (0.0006) [2023-12-26 04:10:17,126][123090] Updated weights for policy 1, policy_version 570243 (0.0010) [2023-12-26 04:10:17,182][123090] Updated weights for policy 1, policy_version 570253 (0.0010) [2023-12-26 04:10:17,238][123090] Updated weights for policy 1, policy_version 570263 (0.0009) [2023-12-26 04:10:17,272][123091] Updated weights for policy 0, policy_version 574293 (0.0006) [2023-12-26 04:10:17,324][123091] Updated weights for policy 0, policy_version 574303 (0.0008) [2023-12-26 04:10:17,375][123091] Updated weights for policy 0, policy_version 574313 (0.0009) [2023-12-26 04:10:18,135][123091] Updated weights for policy 0, policy_version 574323 (0.0008) [2023-12-26 04:10:18,138][123090] Updated weights for policy 1, policy_version 570273 (0.0009) [2023-12-26 04:10:18,199][123090] Updated weights for policy 1, policy_version 570284 (0.0009) [2023-12-26 04:10:18,202][123091] Updated weights for policy 0, policy_version 574333 (0.0006) [2023-12-26 04:10:18,249][123090] Updated weights for policy 1, policy_version 570294 (0.0008) [2023-12-26 04:10:18,287][123091] Updated weights for policy 0, policy_version 574343 (0.0006) [2023-12-26 04:10:18,314][123090] Updated weights for policy 1, policy_version 570304 (0.0009) [2023-12-26 04:10:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 293036032. Throughput: 0: 8840.4, 1: 8814.2. Samples: 293048064. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:18,785][121949] Avg episode reward: [(0, '6096.681'), (1, '5552.581')] [2023-12-26 04:10:18,956][123091] Updated weights for policy 0, policy_version 574353 (0.0006) [2023-12-26 04:10:19,013][123091] Updated weights for policy 0, policy_version 574363 (0.0008) [2023-12-26 04:10:19,068][123091] Updated weights for policy 0, policy_version 574373 (0.0006) [2023-12-26 04:10:19,124][123091] Updated weights for policy 0, policy_version 574383 (0.0007) [2023-12-26 04:10:19,258][123090] Updated weights for policy 1, policy_version 570314 (0.0009) [2023-12-26 04:10:19,321][123090] Updated weights for policy 1, policy_version 570324 (0.0008) [2023-12-26 04:10:19,393][123090] Updated weights for policy 1, policy_version 570334 (0.0007) [2023-12-26 04:10:19,966][123091] Updated weights for policy 0, policy_version 574393 (0.0010) [2023-12-26 04:10:20,031][123091] Updated weights for policy 0, policy_version 574403 (0.0011) [2023-12-26 04:10:20,100][123091] Updated weights for policy 0, policy_version 574413 (0.0011) [2023-12-26 04:10:20,246][123090] Updated weights for policy 1, policy_version 570344 (0.0008) [2023-12-26 04:10:20,311][123090] Updated weights for policy 1, policy_version 570354 (0.0009) [2023-12-26 04:10:20,367][123090] Updated weights for policy 1, policy_version 570364 (0.0009) [2023-12-26 04:10:20,939][123091] Updated weights for policy 0, policy_version 574423 (0.0010) [2023-12-26 04:10:20,993][123091] Updated weights for policy 0, policy_version 574433 (0.0008) [2023-12-26 04:10:21,066][123091] Updated weights for policy 0, policy_version 574443 (0.0008) [2023-12-26 04:10:21,206][123090] Updated weights for policy 1, policy_version 570374 (0.0010) [2023-12-26 04:10:21,269][123090] Updated weights for policy 1, policy_version 570384 (0.0009) [2023-12-26 04:10:21,334][123090] Updated weights for policy 1, policy_version 570394 (0.0010) [2023-12-26 04:10:21,890][123091] Updated weights for policy 0, policy_version 574453 (0.0008) [2023-12-26 04:10:21,945][123091] Updated weights for policy 0, policy_version 574463 (0.0009) [2023-12-26 04:10:22,000][123091] Updated weights for policy 0, policy_version 574473 (0.0009) [2023-12-26 04:10:22,193][123090] Updated weights for policy 1, policy_version 570404 (0.0009) [2023-12-26 04:10:22,256][123090] Updated weights for policy 1, policy_version 570414 (0.0008) [2023-12-26 04:10:22,336][123090] Updated weights for policy 1, policy_version 570424 (0.0008) [2023-12-26 04:10:22,850][123091] Updated weights for policy 0, policy_version 574483 (0.0010) [2023-12-26 04:10:22,906][123091] Updated weights for policy 0, policy_version 574493 (0.0010) [2023-12-26 04:10:22,958][123091] Updated weights for policy 0, policy_version 574503 (0.0009) [2023-12-26 04:10:23,171][123090] Updated weights for policy 1, policy_version 570434 (0.0009) [2023-12-26 04:10:23,233][123090] Updated weights for policy 1, policy_version 570444 (0.0009) [2023-12-26 04:10:23,293][123090] Updated weights for policy 1, policy_version 570454 (0.0009) [2023-12-26 04:10:23,350][123090] Updated weights for policy 1, policy_version 570464 (0.0009) [2023-12-26 04:10:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 293117952. Throughput: 0: 8854.8, 1: 8729.5. Samples: 293098652. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:23,785][121949] Avg episode reward: [(0, '6235.112'), (1, '5531.338')] [2023-12-26 04:10:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000570464_146038784.pth... [2023-12-26 04:10:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000569440_145776640.pth [2023-12-26 04:10:23,801][123091] Updated weights for policy 0, policy_version 574513 (0.0009) [2023-12-26 04:10:23,863][123091] Updated weights for policy 0, policy_version 574523 (0.0005) [2023-12-26 04:10:23,922][123091] Updated weights for policy 0, policy_version 574533 (0.0005) [2023-12-26 04:10:23,973][123091] Updated weights for policy 0, policy_version 574543 (0.0006) [2023-12-26 04:10:23,977][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000574544_147087360.pth... [2023-12-26 04:10:23,980][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000573488_146817024.pth [2023-12-26 04:10:24,097][123090] Updated weights for policy 1, policy_version 570474 (0.0005) [2023-12-26 04:10:24,147][123090] Updated weights for policy 1, policy_version 570484 (0.0005) [2023-12-26 04:10:24,206][123090] Updated weights for policy 1, policy_version 570494 (0.0006) [2023-12-26 04:10:24,589][123091] Updated weights for policy 0, policy_version 574553 (0.0008) [2023-12-26 04:10:24,655][123091] Updated weights for policy 0, policy_version 574563 (0.0009) [2023-12-26 04:10:24,713][123091] Updated weights for policy 0, policy_version 574573 (0.0008) [2023-12-26 04:10:24,947][123090] Updated weights for policy 1, policy_version 570504 (0.0005) [2023-12-26 04:10:25,011][123090] Updated weights for policy 1, policy_version 570514 (0.0006) [2023-12-26 04:10:25,063][123090] Updated weights for policy 1, policy_version 570524 (0.0010) [2023-12-26 04:10:25,342][123091] Updated weights for policy 0, policy_version 574583 (0.0005) [2023-12-26 04:10:25,390][123091] Updated weights for policy 0, policy_version 574593 (0.0005) [2023-12-26 04:10:25,446][123091] Updated weights for policy 0, policy_version 574603 (0.0005) [2023-12-26 04:10:25,733][123090] Updated weights for policy 1, policy_version 570534 (0.0010) [2023-12-26 04:10:25,812][123090] Updated weights for policy 1, policy_version 570544 (0.0010) [2023-12-26 04:10:25,886][123090] Updated weights for policy 1, policy_version 570554 (0.0011) [2023-12-26 04:10:26,129][123091] Updated weights for policy 0, policy_version 574613 (0.0005) [2023-12-26 04:10:26,173][123091] Updated weights for policy 0, policy_version 574623 (0.0005) [2023-12-26 04:10:26,221][123091] Updated weights for policy 0, policy_version 574633 (0.0005) [2023-12-26 04:10:26,693][123090] Updated weights for policy 1, policy_version 570564 (0.0010) [2023-12-26 04:10:26,748][123090] Updated weights for policy 1, policy_version 570574 (0.0010) [2023-12-26 04:10:26,796][123090] Updated weights for policy 1, policy_version 570584 (0.0010) [2023-12-26 04:10:26,911][123091] Updated weights for policy 0, policy_version 574643 (0.0005) [2023-12-26 04:10:26,983][123091] Updated weights for policy 0, policy_version 574653 (0.0005) [2023-12-26 04:10:27,040][123091] Updated weights for policy 0, policy_version 574663 (0.0005) [2023-12-26 04:10:27,528][123090] Updated weights for policy 1, policy_version 570594 (0.0009) [2023-12-26 04:10:27,585][123090] Updated weights for policy 1, policy_version 570604 (0.0006) [2023-12-26 04:10:27,618][123091] Updated weights for policy 0, policy_version 574673 (0.0005) [2023-12-26 04:10:27,642][123090] Updated weights for policy 1, policy_version 570614 (0.0006) [2023-12-26 04:10:27,664][123091] Updated weights for policy 0, policy_version 574683 (0.0006) [2023-12-26 04:10:27,691][123090] Updated weights for policy 1, policy_version 570624 (0.0005) [2023-12-26 04:10:27,720][123091] Updated weights for policy 0, policy_version 574693 (0.0011) [2023-12-26 04:10:27,776][123091] Updated weights for policy 0, policy_version 574703 (0.0009) [2023-12-26 04:10:28,419][123090] Updated weights for policy 1, policy_version 570634 (0.0011) [2023-12-26 04:10:28,487][123090] Updated weights for policy 1, policy_version 570644 (0.0011) [2023-12-26 04:10:28,490][123091] Updated weights for policy 0, policy_version 574713 (0.0006) [2023-12-26 04:10:28,550][123090] Updated weights for policy 1, policy_version 570654 (0.0010) [2023-12-26 04:10:28,551][123091] Updated weights for policy 0, policy_version 574723 (0.0008) [2023-12-26 04:10:28,622][123091] Updated weights for policy 0, policy_version 574733 (0.0010) [2023-12-26 04:10:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 293224448. Throughput: 0: 9005.1, 1: 8793.1. Samples: 293212516. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:28,785][121949] Avg episode reward: [(0, '6138.239'), (1, '5637.316')] [2023-12-26 04:10:29,254][123090] Updated weights for policy 1, policy_version 570664 (0.0008) [2023-12-26 04:10:29,310][123090] Updated weights for policy 1, policy_version 570674 (0.0006) [2023-12-26 04:10:29,381][123090] Updated weights for policy 1, policy_version 570684 (0.0010) [2023-12-26 04:10:29,518][123091] Updated weights for policy 0, policy_version 574743 (0.0010) [2023-12-26 04:10:29,587][123091] Updated weights for policy 0, policy_version 574753 (0.0009) [2023-12-26 04:10:29,656][123091] Updated weights for policy 0, policy_version 574763 (0.0009) [2023-12-26 04:10:30,196][123090] Updated weights for policy 1, policy_version 570694 (0.0010) [2023-12-26 04:10:30,265][123090] Updated weights for policy 1, policy_version 570704 (0.0005) [2023-12-26 04:10:30,337][123090] Updated weights for policy 1, policy_version 570714 (0.0008) [2023-12-26 04:10:30,426][123091] Updated weights for policy 0, policy_version 574773 (0.0007) [2023-12-26 04:10:30,477][123091] Updated weights for policy 0, policy_version 574783 (0.0005) [2023-12-26 04:10:30,540][123091] Updated weights for policy 0, policy_version 574793 (0.0005) [2023-12-26 04:10:30,963][123090] Updated weights for policy 1, policy_version 570724 (0.0007) [2023-12-26 04:10:31,034][123090] Updated weights for policy 1, policy_version 570734 (0.0006) [2023-12-26 04:10:31,105][123090] Updated weights for policy 1, policy_version 570744 (0.0008) [2023-12-26 04:10:31,259][123091] Updated weights for policy 0, policy_version 574803 (0.0005) [2023-12-26 04:10:31,321][123091] Updated weights for policy 0, policy_version 574813 (0.0005) [2023-12-26 04:10:31,390][123091] Updated weights for policy 0, policy_version 574823 (0.0009) [2023-12-26 04:10:31,948][123090] Updated weights for policy 1, policy_version 570754 (0.0007) [2023-12-26 04:10:32,021][123090] Updated weights for policy 1, policy_version 570764 (0.0009) [2023-12-26 04:10:32,083][123090] Updated weights for policy 1, policy_version 570774 (0.0008) [2023-12-26 04:10:32,092][123091] Updated weights for policy 0, policy_version 574833 (0.0006) [2023-12-26 04:10:32,147][123090] Updated weights for policy 1, policy_version 570784 (0.0007) [2023-12-26 04:10:32,159][123091] Updated weights for policy 0, policy_version 574843 (0.0008) [2023-12-26 04:10:32,229][123091] Updated weights for policy 0, policy_version 574853 (0.0006) [2023-12-26 04:10:32,300][123091] Updated weights for policy 0, policy_version 574863 (0.0007) [2023-12-26 04:10:32,898][123090] Updated weights for policy 1, policy_version 570794 (0.0010) [2023-12-26 04:10:32,959][123090] Updated weights for policy 1, policy_version 570804 (0.0008) [2023-12-26 04:10:32,971][123091] Updated weights for policy 0, policy_version 574873 (0.0007) [2023-12-26 04:10:33,020][123090] Updated weights for policy 1, policy_version 570814 (0.0007) [2023-12-26 04:10:33,022][123091] Updated weights for policy 0, policy_version 574883 (0.0009) [2023-12-26 04:10:33,085][123091] Updated weights for policy 0, policy_version 574893 (0.0010) [2023-12-26 04:10:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 293306368. Throughput: 0: 9045.4, 1: 8799.8. Samples: 293321240. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:33,785][121949] Avg episode reward: [(0, '6076.337'), (1, '5581.599')] [2023-12-26 04:10:33,844][123090] Updated weights for policy 1, policy_version 570824 (0.0007) [2023-12-26 04:10:33,908][123091] Updated weights for policy 0, policy_version 574903 (0.0010) [2023-12-26 04:10:33,915][123090] Updated weights for policy 1, policy_version 570834 (0.0005) [2023-12-26 04:10:33,963][123091] Updated weights for policy 0, policy_version 574913 (0.0011) [2023-12-26 04:10:33,974][123090] Updated weights for policy 1, policy_version 570844 (0.0005) [2023-12-26 04:10:34,019][123091] Updated weights for policy 0, policy_version 574923 (0.0010) [2023-12-26 04:10:34,769][123090] Updated weights for policy 1, policy_version 570854 (0.0008) [2023-12-26 04:10:34,833][123090] Updated weights for policy 1, policy_version 570864 (0.0008) [2023-12-26 04:10:34,856][123091] Updated weights for policy 0, policy_version 574933 (0.0010) [2023-12-26 04:10:34,893][123090] Updated weights for policy 1, policy_version 570874 (0.0006) [2023-12-26 04:10:34,911][123091] Updated weights for policy 0, policy_version 574943 (0.0011) [2023-12-26 04:10:34,968][123091] Updated weights for policy 0, policy_version 574953 (0.0008) [2023-12-26 04:10:35,571][123090] Updated weights for policy 1, policy_version 570884 (0.0008) [2023-12-26 04:10:35,631][123090] Updated weights for policy 1, policy_version 570894 (0.0009) [2023-12-26 04:10:35,686][123090] Updated weights for policy 1, policy_version 570904 (0.0008) [2023-12-26 04:10:35,759][123091] Updated weights for policy 0, policy_version 574963 (0.0007) [2023-12-26 04:10:35,814][123091] Updated weights for policy 0, policy_version 574973 (0.0009) [2023-12-26 04:10:35,869][123091] Updated weights for policy 0, policy_version 574983 (0.0010) [2023-12-26 04:10:36,535][123090] Updated weights for policy 1, policy_version 570914 (0.0009) [2023-12-26 04:10:36,604][123090] Updated weights for policy 1, policy_version 570924 (0.0010) [2023-12-26 04:10:36,661][123090] Updated weights for policy 1, policy_version 570934 (0.0009) [2023-12-26 04:10:36,698][123091] Updated weights for policy 0, policy_version 574993 (0.0010) [2023-12-26 04:10:36,732][123090] Updated weights for policy 1, policy_version 570944 (0.0010) [2023-12-26 04:10:36,752][123091] Updated weights for policy 0, policy_version 575003 (0.0010) [2023-12-26 04:10:36,811][123091] Updated weights for policy 0, policy_version 575013 (0.0008) [2023-12-26 04:10:36,877][123091] Updated weights for policy 0, policy_version 575023 (0.0009) [2023-12-26 04:10:37,570][123090] Updated weights for policy 1, policy_version 570954 (0.0010) [2023-12-26 04:10:37,636][123090] Updated weights for policy 1, policy_version 570964 (0.0009) [2023-12-26 04:10:37,688][123090] Updated weights for policy 1, policy_version 570974 (0.0009) [2023-12-26 04:10:37,695][123091] Updated weights for policy 0, policy_version 575033 (0.0010) [2023-12-26 04:10:37,752][123091] Updated weights for policy 0, policy_version 575043 (0.0010) [2023-12-26 04:10:37,812][123091] Updated weights for policy 0, policy_version 575053 (0.0009) [2023-12-26 04:10:38,450][123090] Updated weights for policy 1, policy_version 570984 (0.0006) [2023-12-26 04:10:38,508][123090] Updated weights for policy 1, policy_version 570994 (0.0010) [2023-12-26 04:10:38,571][123091] Updated weights for policy 0, policy_version 575063 (0.0006) [2023-12-26 04:10:38,574][123090] Updated weights for policy 1, policy_version 571004 (0.0009) [2023-12-26 04:10:38,642][123091] Updated weights for policy 0, policy_version 575073 (0.0005) [2023-12-26 04:10:38,716][123091] Updated weights for policy 0, policy_version 575083 (0.0006) [2023-12-26 04:10:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 293404672. Throughput: 0: 9052.2, 1: 8844.2. Samples: 293374668. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:38,785][121949] Avg episode reward: [(0, '6087.475'), (1, '5685.989')] [2023-12-26 04:10:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000575088_147226624.pth... [2023-12-26 04:10:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000571008_146178048.pth... [2023-12-26 04:10:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000574000_146948096.pth [2023-12-26 04:10:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000569984_145915904.pth [2023-12-26 04:10:39,356][123090] Updated weights for policy 1, policy_version 571014 (0.0009) [2023-12-26 04:10:39,428][123090] Updated weights for policy 1, policy_version 571024 (0.0008) [2023-12-26 04:10:39,491][123090] Updated weights for policy 1, policy_version 571034 (0.0007) [2023-12-26 04:10:39,497][123091] Updated weights for policy 0, policy_version 575093 (0.0009) [2023-12-26 04:10:39,567][123091] Updated weights for policy 0, policy_version 575103 (0.0008) [2023-12-26 04:10:39,627][123091] Updated weights for policy 0, policy_version 575113 (0.0008) [2023-12-26 04:10:40,356][123091] Updated weights for policy 0, policy_version 575123 (0.0008) [2023-12-26 04:10:40,363][123090] Updated weights for policy 1, policy_version 571044 (0.0007) [2023-12-26 04:10:40,412][123091] Updated weights for policy 0, policy_version 575133 (0.0006) [2023-12-26 04:10:40,416][123090] Updated weights for policy 1, policy_version 571054 (0.0009) [2023-12-26 04:10:40,469][123090] Updated weights for policy 1, policy_version 571064 (0.0008) [2023-12-26 04:10:40,473][123091] Updated weights for policy 0, policy_version 575143 (0.0006) [2023-12-26 04:10:41,176][123091] Updated weights for policy 0, policy_version 575153 (0.0007) [2023-12-26 04:10:41,193][123090] Updated weights for policy 1, policy_version 571074 (0.0008) [2023-12-26 04:10:41,244][123091] Updated weights for policy 0, policy_version 575163 (0.0009) [2023-12-26 04:10:41,264][123090] Updated weights for policy 1, policy_version 571084 (0.0007) [2023-12-26 04:10:41,311][123091] Updated weights for policy 0, policy_version 575173 (0.0009) [2023-12-26 04:10:41,336][123090] Updated weights for policy 1, policy_version 571094 (0.0007) [2023-12-26 04:10:41,382][123091] Updated weights for policy 0, policy_version 575183 (0.0010) [2023-12-26 04:10:41,412][123090] Updated weights for policy 1, policy_version 571104 (0.0007) [2023-12-26 04:10:42,206][123090] Updated weights for policy 1, policy_version 571114 (0.0008) [2023-12-26 04:10:42,266][123090] Updated weights for policy 1, policy_version 571124 (0.0009) [2023-12-26 04:10:42,291][123091] Updated weights for policy 0, policy_version 575193 (0.0010) [2023-12-26 04:10:42,330][123090] Updated weights for policy 1, policy_version 571134 (0.0008) [2023-12-26 04:10:42,362][123091] Updated weights for policy 0, policy_version 575203 (0.0008) [2023-12-26 04:10:42,420][123091] Updated weights for policy 0, policy_version 575213 (0.0006) [2023-12-26 04:10:43,087][123090] Updated weights for policy 1, policy_version 571144 (0.0006) [2023-12-26 04:10:43,092][123091] Updated weights for policy 0, policy_version 575223 (0.0008) [2023-12-26 04:10:43,142][123090] Updated weights for policy 1, policy_version 571154 (0.0005) [2023-12-26 04:10:43,149][123091] Updated weights for policy 0, policy_version 575233 (0.0010) [2023-12-26 04:10:43,207][123090] Updated weights for policy 1, policy_version 571164 (0.0005) [2023-12-26 04:10:43,222][123091] Updated weights for policy 0, policy_version 575243 (0.0010) [2023-12-26 04:10:43,774][123090] Updated weights for policy 1, policy_version 571174 (0.0005) [2023-12-26 04:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 293486592. Throughput: 0: 9050.0, 1: 8829.0. Samples: 293481012. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:43,785][121949] Avg episode reward: [(0, '6154.692'), (1, '5839.667')] [2023-12-26 04:10:43,832][123090] Updated weights for policy 1, policy_version 571184 (0.0008) [2023-12-26 04:10:43,889][123090] Updated weights for policy 1, policy_version 571194 (0.0008) [2023-12-26 04:10:44,083][123091] Updated weights for policy 0, policy_version 575253 (0.0009) [2023-12-26 04:10:44,141][123091] Updated weights for policy 0, policy_version 575263 (0.0009) [2023-12-26 04:10:44,207][123091] Updated weights for policy 0, policy_version 575273 (0.0010) [2023-12-26 04:10:44,685][123090] Updated weights for policy 1, policy_version 571204 (0.0009) [2023-12-26 04:10:44,740][123090] Updated weights for policy 1, policy_version 571214 (0.0009) [2023-12-26 04:10:44,809][123090] Updated weights for policy 1, policy_version 571224 (0.0009) [2023-12-26 04:10:45,060][123091] Updated weights for policy 0, policy_version 575283 (0.0009) [2023-12-26 04:10:45,118][123091] Updated weights for policy 0, policy_version 575293 (0.0009) [2023-12-26 04:10:45,179][123091] Updated weights for policy 0, policy_version 575303 (0.0010) [2023-12-26 04:10:45,640][123090] Updated weights for policy 1, policy_version 571234 (0.0009) [2023-12-26 04:10:45,691][123090] Updated weights for policy 1, policy_version 571244 (0.0009) [2023-12-26 04:10:45,755][123090] Updated weights for policy 1, policy_version 571254 (0.0010) [2023-12-26 04:10:46,010][123091] Updated weights for policy 0, policy_version 575313 (0.0009) [2023-12-26 04:10:46,075][123091] Updated weights for policy 0, policy_version 575323 (0.0009) [2023-12-26 04:10:46,138][123091] Updated weights for policy 0, policy_version 575333 (0.0009) [2023-12-26 04:10:46,197][123091] Updated weights for policy 0, policy_version 575343 (0.0010) [2023-12-26 04:10:46,594][123090] Updated weights for policy 1, policy_version 571265 (0.0010) [2023-12-26 04:10:46,645][123090] Updated weights for policy 1, policy_version 571275 (0.0009) [2023-12-26 04:10:46,714][123090] Updated weights for policy 1, policy_version 571285 (0.0009) [2023-12-26 04:10:46,780][123090] Updated weights for policy 1, policy_version 571295 (0.0009) [2023-12-26 04:10:47,034][123091] Updated weights for policy 0, policy_version 575353 (0.0009) [2023-12-26 04:10:47,093][123091] Updated weights for policy 0, policy_version 575363 (0.0009) [2023-12-26 04:10:47,152][123091] Updated weights for policy 0, policy_version 575373 (0.0009) [2023-12-26 04:10:47,479][123090] Updated weights for policy 1, policy_version 571305 (0.0008) [2023-12-26 04:10:47,535][123090] Updated weights for policy 1, policy_version 571315 (0.0009) [2023-12-26 04:10:47,594][123090] Updated weights for policy 1, policy_version 571325 (0.0009) [2023-12-26 04:10:47,997][123091] Updated weights for policy 0, policy_version 575383 (0.0007) [2023-12-26 04:10:48,053][123091] Updated weights for policy 0, policy_version 575393 (0.0006) [2023-12-26 04:10:48,114][123091] Updated weights for policy 0, policy_version 575403 (0.0005) [2023-12-26 04:10:48,464][123090] Updated weights for policy 1, policy_version 571335 (0.0010) [2023-12-26 04:10:48,532][123090] Updated weights for policy 1, policy_version 571345 (0.0010) [2023-12-26 04:10:48,601][123090] Updated weights for policy 1, policy_version 571355 (0.0009) [2023-12-26 04:10:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 293576704. Throughput: 0: 9025.0, 1: 8877.3. Samples: 293586704. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:48,785][121949] Avg episode reward: [(0, '6233.723'), (1, '5670.081')] [2023-12-26 04:10:48,884][123091] Updated weights for policy 0, policy_version 575413 (0.0007) [2023-12-26 04:10:48,939][123091] Updated weights for policy 0, policy_version 575423 (0.0009) [2023-12-26 04:10:49,003][123091] Updated weights for policy 0, policy_version 575433 (0.0010) [2023-12-26 04:10:49,451][123090] Updated weights for policy 1, policy_version 571365 (0.0010) [2023-12-26 04:10:49,517][123090] Updated weights for policy 1, policy_version 571375 (0.0010) [2023-12-26 04:10:49,586][123090] Updated weights for policy 1, policy_version 571385 (0.0009) [2023-12-26 04:10:49,832][123091] Updated weights for policy 0, policy_version 575443 (0.0010) [2023-12-26 04:10:49,891][123091] Updated weights for policy 0, policy_version 575453 (0.0010) [2023-12-26 04:10:49,954][123091] Updated weights for policy 0, policy_version 575463 (0.0008) [2023-12-26 04:10:50,472][123090] Updated weights for policy 1, policy_version 571395 (0.0009) [2023-12-26 04:10:50,538][123090] Updated weights for policy 1, policy_version 571405 (0.0009) [2023-12-26 04:10:50,603][123090] Updated weights for policy 1, policy_version 571415 (0.0010) [2023-12-26 04:10:50,768][123091] Updated weights for policy 0, policy_version 575473 (0.0007) [2023-12-26 04:10:50,844][123091] Updated weights for policy 0, policy_version 575483 (0.0010) [2023-12-26 04:10:50,915][123091] Updated weights for policy 0, policy_version 575493 (0.0009) [2023-12-26 04:10:50,970][123091] Updated weights for policy 0, policy_version 575503 (0.0010) [2023-12-26 04:10:51,410][123090] Updated weights for policy 1, policy_version 571425 (0.0009) [2023-12-26 04:10:51,476][123090] Updated weights for policy 1, policy_version 571435 (0.0009) [2023-12-26 04:10:51,537][123090] Updated weights for policy 1, policy_version 571445 (0.0009) [2023-12-26 04:10:51,598][123090] Updated weights for policy 1, policy_version 571455 (0.0009) [2023-12-26 04:10:51,841][123091] Updated weights for policy 0, policy_version 575513 (0.0009) [2023-12-26 04:10:51,910][123091] Updated weights for policy 0, policy_version 575523 (0.0009) [2023-12-26 04:10:51,978][123091] Updated weights for policy 0, policy_version 575533 (0.0009) [2023-12-26 04:10:52,466][123090] Updated weights for policy 1, policy_version 571465 (0.0006) [2023-12-26 04:10:52,533][123090] Updated weights for policy 1, policy_version 571475 (0.0005) [2023-12-26 04:10:52,602][123090] Updated weights for policy 1, policy_version 571485 (0.0005) [2023-12-26 04:10:52,843][123091] Updated weights for policy 0, policy_version 575543 (0.0009) [2023-12-26 04:10:52,900][123091] Updated weights for policy 0, policy_version 575553 (0.0008) [2023-12-26 04:10:52,957][123091] Updated weights for policy 0, policy_version 575563 (0.0009) [2023-12-26 04:10:53,325][123090] Updated weights for policy 1, policy_version 571495 (0.0006) [2023-12-26 04:10:53,388][123090] Updated weights for policy 1, policy_version 571505 (0.0009) [2023-12-26 04:10:53,444][123090] Updated weights for policy 1, policy_version 571515 (0.0010) [2023-12-26 04:10:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 293658624. Throughput: 0: 9008.9, 1: 8791.1. Samples: 293636760. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:53,785][121949] Avg episode reward: [(0, '6261.257'), (1, '5662.667')] [2023-12-26 04:10:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000571520_146309120.pth... [2023-12-26 04:10:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000570464_146038784.pth [2023-12-26 04:10:53,828][123091] Updated weights for policy 0, policy_version 575573 (0.0007) [2023-12-26 04:10:53,884][123091] Updated weights for policy 0, policy_version 575583 (0.0005) [2023-12-26 04:10:53,937][123091] Updated weights for policy 0, policy_version 575593 (0.0005) [2023-12-26 04:10:53,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000575600_147357696.pth... [2023-12-26 04:10:53,977][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000574544_147087360.pth [2023-12-26 04:10:54,277][123090] Updated weights for policy 1, policy_version 571525 (0.0008) [2023-12-26 04:10:54,349][123090] Updated weights for policy 1, policy_version 571535 (0.0006) [2023-12-26 04:10:54,420][123090] Updated weights for policy 1, policy_version 571545 (0.0006) [2023-12-26 04:10:54,693][123091] Updated weights for policy 0, policy_version 575603 (0.0007) [2023-12-26 04:10:54,754][123091] Updated weights for policy 0, policy_version 575613 (0.0009) [2023-12-26 04:10:54,808][123091] Updated weights for policy 0, policy_version 575624 (0.0010) [2023-12-26 04:10:55,068][123090] Updated weights for policy 1, policy_version 571555 (0.0007) [2023-12-26 04:10:55,136][123090] Updated weights for policy 1, policy_version 571565 (0.0009) [2023-12-26 04:10:55,207][123090] Updated weights for policy 1, policy_version 571575 (0.0010) [2023-12-26 04:10:55,704][123091] Updated weights for policy 0, policy_version 575634 (0.0008) [2023-12-26 04:10:55,770][123091] Updated weights for policy 0, policy_version 575644 (0.0010) [2023-12-26 04:10:55,833][123091] Updated weights for policy 0, policy_version 575654 (0.0009) [2023-12-26 04:10:55,894][123091] Updated weights for policy 0, policy_version 575664 (0.0009) [2023-12-26 04:10:55,922][123090] Updated weights for policy 1, policy_version 571585 (0.0009) [2023-12-26 04:10:55,993][123090] Updated weights for policy 1, policy_version 571595 (0.0010) [2023-12-26 04:10:56,052][123090] Updated weights for policy 1, policy_version 571605 (0.0010) [2023-12-26 04:10:56,113][123090] Updated weights for policy 1, policy_version 571615 (0.0010) [2023-12-26 04:10:56,736][123091] Updated weights for policy 0, policy_version 575674 (0.0009) [2023-12-26 04:10:56,798][123091] Updated weights for policy 0, policy_version 575684 (0.0008) [2023-12-26 04:10:56,850][123091] Updated weights for policy 0, policy_version 575694 (0.0008) [2023-12-26 04:10:56,914][123090] Updated weights for policy 1, policy_version 571625 (0.0010) [2023-12-26 04:10:56,967][123090] Updated weights for policy 1, policy_version 571635 (0.0009) [2023-12-26 04:10:57,021][123090] Updated weights for policy 1, policy_version 571645 (0.0008) [2023-12-26 04:10:57,697][123091] Updated weights for policy 0, policy_version 575704 (0.0009) [2023-12-26 04:10:57,764][123091] Updated weights for policy 0, policy_version 575714 (0.0009) [2023-12-26 04:10:57,831][123091] Updated weights for policy 0, policy_version 575724 (0.0009) [2023-12-26 04:10:57,855][123090] Updated weights for policy 1, policy_version 571655 (0.0008) [2023-12-26 04:10:57,905][123090] Updated weights for policy 1, policy_version 571665 (0.0008) [2023-12-26 04:10:57,959][123090] Updated weights for policy 1, policy_version 571675 (0.0009) [2023-12-26 04:10:58,760][123090] Updated weights for policy 1, policy_version 571685 (0.0008) [2023-12-26 04:10:58,784][123091] Updated weights for policy 0, policy_version 575734 (0.0008) [2023-12-26 04:10:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 293740544. Throughput: 0: 8963.5, 1: 8837.2. Samples: 293742328. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:10:58,785][121949] Avg episode reward: [(0, '6193.299'), (1, '5844.616')] [2023-12-26 04:10:58,828][123090] Updated weights for policy 1, policy_version 571695 (0.0010) [2023-12-26 04:10:58,838][123091] Updated weights for policy 0, policy_version 575744 (0.0008) [2023-12-26 04:10:58,884][123091] Updated weights for policy 0, policy_version 575754 (0.0007) [2023-12-26 04:10:58,887][123090] Updated weights for policy 1, policy_version 571705 (0.0010) [2023-12-26 04:10:59,606][123090] Updated weights for policy 1, policy_version 571715 (0.0009) [2023-12-26 04:10:59,664][123090] Updated weights for policy 1, policy_version 571725 (0.0006) [2023-12-26 04:10:59,716][123090] Updated weights for policy 1, policy_version 571735 (0.0009) [2023-12-26 04:10:59,753][123091] Updated weights for policy 0, policy_version 575764 (0.0007) [2023-12-26 04:10:59,801][123091] Updated weights for policy 0, policy_version 575774 (0.0009) [2023-12-26 04:10:59,875][123091] Updated weights for policy 0, policy_version 575784 (0.0009) [2023-12-26 04:11:00,404][123090] Updated weights for policy 1, policy_version 571745 (0.0010) [2023-12-26 04:11:00,470][123090] Updated weights for policy 1, policy_version 571755 (0.0007) [2023-12-26 04:11:00,543][123090] Updated weights for policy 1, policy_version 571765 (0.0008) [2023-12-26 04:11:00,606][123090] Updated weights for policy 1, policy_version 571775 (0.0010) [2023-12-26 04:11:00,719][123091] Updated weights for policy 0, policy_version 575794 (0.0009) [2023-12-26 04:11:00,774][123091] Updated weights for policy 0, policy_version 575804 (0.0005) [2023-12-26 04:11:00,834][123091] Updated weights for policy 0, policy_version 575814 (0.0005) [2023-12-26 04:11:00,887][123091] Updated weights for policy 0, policy_version 575824 (0.0005) [2023-12-26 04:11:01,301][123090] Updated weights for policy 1, policy_version 571785 (0.0008) [2023-12-26 04:11:01,382][123090] Updated weights for policy 1, policy_version 571795 (0.0009) [2023-12-26 04:11:01,445][123090] Updated weights for policy 1, policy_version 571805 (0.0010) [2023-12-26 04:11:01,626][123091] Updated weights for policy 0, policy_version 575834 (0.0011) [2023-12-26 04:11:01,688][123091] Updated weights for policy 0, policy_version 575844 (0.0011) [2023-12-26 04:11:01,756][123091] Updated weights for policy 0, policy_version 575854 (0.0011) [2023-12-26 04:11:02,189][123090] Updated weights for policy 1, policy_version 571815 (0.0010) [2023-12-26 04:11:02,244][123090] Updated weights for policy 1, policy_version 571825 (0.0010) [2023-12-26 04:11:02,310][123090] Updated weights for policy 1, policy_version 571835 (0.0010) [2023-12-26 04:11:02,535][123091] Updated weights for policy 0, policy_version 575864 (0.0010) [2023-12-26 04:11:02,604][123091] Updated weights for policy 0, policy_version 575874 (0.0008) [2023-12-26 04:11:02,657][123091] Updated weights for policy 0, policy_version 575884 (0.0005) [2023-12-26 04:11:03,045][123090] Updated weights for policy 1, policy_version 571845 (0.0010) [2023-12-26 04:11:03,107][123090] Updated weights for policy 1, policy_version 571855 (0.0010) [2023-12-26 04:11:03,172][123090] Updated weights for policy 1, policy_version 571865 (0.0010) [2023-12-26 04:11:03,338][123091] Updated weights for policy 0, policy_version 575894 (0.0008) [2023-12-26 04:11:03,385][123091] Updated weights for policy 0, policy_version 575904 (0.0010) [2023-12-26 04:11:03,444][123091] Updated weights for policy 0, policy_version 575914 (0.0010) [2023-12-26 04:11:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 293838848. Throughput: 0: 8848.5, 1: 8962.7. Samples: 293849568. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:03,785][121949] Avg episode reward: [(0, '6140.614'), (1, '6010.681')] [2023-12-26 04:11:03,922][123090] Updated weights for policy 1, policy_version 571875 (0.0010) [2023-12-26 04:11:03,990][123090] Updated weights for policy 1, policy_version 571885 (0.0011) [2023-12-26 04:11:04,053][123090] Updated weights for policy 1, policy_version 571895 (0.0011) [2023-12-26 04:11:04,237][123091] Updated weights for policy 0, policy_version 575924 (0.0010) [2023-12-26 04:11:04,289][123091] Updated weights for policy 0, policy_version 575934 (0.0011) [2023-12-26 04:11:04,346][123091] Updated weights for policy 0, policy_version 575944 (0.0011) [2023-12-26 04:11:04,877][123090] Updated weights for policy 1, policy_version 571905 (0.0011) [2023-12-26 04:11:04,932][123090] Updated weights for policy 1, policy_version 571915 (0.0008) [2023-12-26 04:11:04,988][123090] Updated weights for policy 1, policy_version 571925 (0.0009) [2023-12-26 04:11:05,041][123090] Updated weights for policy 1, policy_version 571935 (0.0009) [2023-12-26 04:11:05,185][123091] Updated weights for policy 0, policy_version 575954 (0.0011) [2023-12-26 04:11:05,261][123091] Updated weights for policy 0, policy_version 575964 (0.0010) [2023-12-26 04:11:05,312][123091] Updated weights for policy 0, policy_version 575974 (0.0010) [2023-12-26 04:11:05,371][123091] Updated weights for policy 0, policy_version 575984 (0.0010) [2023-12-26 04:11:05,881][123090] Updated weights for policy 1, policy_version 571945 (0.0009) [2023-12-26 04:11:05,948][123090] Updated weights for policy 1, policy_version 571955 (0.0009) [2023-12-26 04:11:06,000][123090] Updated weights for policy 1, policy_version 571965 (0.0008) [2023-12-26 04:11:06,188][123091] Updated weights for policy 0, policy_version 575994 (0.0008) [2023-12-26 04:11:06,256][123091] Updated weights for policy 0, policy_version 576004 (0.0006) [2023-12-26 04:11:06,333][123091] Updated weights for policy 0, policy_version 576014 (0.0007) [2023-12-26 04:11:06,818][123090] Updated weights for policy 1, policy_version 571975 (0.0006) [2023-12-26 04:11:06,878][123090] Updated weights for policy 1, policy_version 571985 (0.0005) [2023-12-26 04:11:06,933][123090] Updated weights for policy 1, policy_version 571995 (0.0005) [2023-12-26 04:11:07,174][123091] Updated weights for policy 0, policy_version 576024 (0.0009) [2023-12-26 04:11:07,244][123091] Updated weights for policy 0, policy_version 576034 (0.0010) [2023-12-26 04:11:07,319][123091] Updated weights for policy 0, policy_version 576044 (0.0010) [2023-12-26 04:11:07,608][123090] Updated weights for policy 1, policy_version 572005 (0.0006) [2023-12-26 04:11:07,663][123090] Updated weights for policy 1, policy_version 572015 (0.0006) [2023-12-26 04:11:07,715][123090] Updated weights for policy 1, policy_version 572025 (0.0010) [2023-12-26 04:11:08,158][123091] Updated weights for policy 0, policy_version 576054 (0.0009) [2023-12-26 04:11:08,207][123091] Updated weights for policy 0, policy_version 576064 (0.0009) [2023-12-26 04:11:08,261][123091] Updated weights for policy 0, policy_version 576074 (0.0010) [2023-12-26 04:11:08,490][123090] Updated weights for policy 1, policy_version 572035 (0.0010) [2023-12-26 04:11:08,542][123090] Updated weights for policy 1, policy_version 572045 (0.0010) [2023-12-26 04:11:08,596][123090] Updated weights for policy 1, policy_version 572055 (0.0006) [2023-12-26 04:11:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 293928960. Throughput: 0: 8861.8, 1: 8990.9. Samples: 293902024. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:08,785][121949] Avg episode reward: [(0, '6103.885'), (1, '6040.066')] [2023-12-26 04:11:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000572064_146448384.pth... [2023-12-26 04:11:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000576080_147480576.pth... [2023-12-26 04:11:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000571008_146178048.pth [2023-12-26 04:11:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000575088_147226624.pth [2023-12-26 04:11:09,221][123091] Updated weights for policy 0, policy_version 576084 (0.0009) [2023-12-26 04:11:09,255][123090] Updated weights for policy 1, policy_version 572065 (0.0006) [2023-12-26 04:11:09,296][123091] Updated weights for policy 0, policy_version 576094 (0.0008) [2023-12-26 04:11:09,311][123090] Updated weights for policy 1, policy_version 572075 (0.0008) [2023-12-26 04:11:09,362][123091] Updated weights for policy 0, policy_version 576104 (0.0010) [2023-12-26 04:11:09,385][123090] Updated weights for policy 1, policy_version 572085 (0.0009) [2023-12-26 04:11:09,453][123090] Updated weights for policy 1, policy_version 572095 (0.0011) [2023-12-26 04:11:10,226][123091] Updated weights for policy 0, policy_version 576114 (0.0007) [2023-12-26 04:11:10,287][123090] Updated weights for policy 1, policy_version 572105 (0.0011) [2023-12-26 04:11:10,290][123091] Updated weights for policy 0, policy_version 576124 (0.0007) [2023-12-26 04:11:10,348][123090] Updated weights for policy 1, policy_version 572115 (0.0011) [2023-12-26 04:11:10,354][123091] Updated weights for policy 0, policy_version 576134 (0.0007) [2023-12-26 04:11:10,415][123090] Updated weights for policy 1, policy_version 572125 (0.0011) [2023-12-26 04:11:10,423][123091] Updated weights for policy 0, policy_version 576144 (0.0010) [2023-12-26 04:11:11,258][123090] Updated weights for policy 1, policy_version 572135 (0.0008) [2023-12-26 04:11:11,278][123091] Updated weights for policy 0, policy_version 576154 (0.0010) [2023-12-26 04:11:11,319][123090] Updated weights for policy 1, policy_version 572145 (0.0008) [2023-12-26 04:11:11,328][123091] Updated weights for policy 0, policy_version 576164 (0.0009) [2023-12-26 04:11:11,388][123090] Updated weights for policy 1, policy_version 572155 (0.0009) [2023-12-26 04:11:11,400][123091] Updated weights for policy 0, policy_version 576174 (0.0009) [2023-12-26 04:11:12,146][123090] Updated weights for policy 1, policy_version 572165 (0.0008) [2023-12-26 04:11:12,199][123090] Updated weights for policy 1, policy_version 572175 (0.0009) [2023-12-26 04:11:12,254][123090] Updated weights for policy 1, policy_version 572185 (0.0009) [2023-12-26 04:11:12,259][123091] Updated weights for policy 0, policy_version 576184 (0.0008) [2023-12-26 04:11:12,321][123091] Updated weights for policy 0, policy_version 576194 (0.0009) [2023-12-26 04:11:12,385][123091] Updated weights for policy 0, policy_version 576204 (0.0009) [2023-12-26 04:11:13,084][123090] Updated weights for policy 1, policy_version 572195 (0.0009) [2023-12-26 04:11:13,138][123090] Updated weights for policy 1, policy_version 572205 (0.0009) [2023-12-26 04:11:13,193][123090] Updated weights for policy 1, policy_version 572215 (0.0009) [2023-12-26 04:11:13,252][123091] Updated weights for policy 0, policy_version 576214 (0.0006) [2023-12-26 04:11:13,308][123091] Updated weights for policy 0, policy_version 576224 (0.0010) [2023-12-26 04:11:13,364][123091] Updated weights for policy 0, policy_version 576234 (0.0009) [2023-12-26 04:11:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 294010880. Throughput: 0: 8618.6, 1: 8991.8. Samples: 294004988. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:13,785][121949] Avg episode reward: [(0, '6066.841'), (1, '5921.986')] [2023-12-26 04:11:14,041][123090] Updated weights for policy 1, policy_version 572225 (0.0010) [2023-12-26 04:11:14,106][123090] Updated weights for policy 1, policy_version 572235 (0.0009) [2023-12-26 04:11:14,159][123090] Updated weights for policy 1, policy_version 572245 (0.0009) [2023-12-26 04:11:14,180][123091] Updated weights for policy 0, policy_version 576244 (0.0009) [2023-12-26 04:11:14,214][123090] Updated weights for policy 1, policy_version 572255 (0.0008) [2023-12-26 04:11:14,228][123091] Updated weights for policy 0, policy_version 576254 (0.0008) [2023-12-26 04:11:14,288][123091] Updated weights for policy 0, policy_version 576264 (0.0009) [2023-12-26 04:11:15,039][123090] Updated weights for policy 1, policy_version 572265 (0.0009) [2023-12-26 04:11:15,097][123091] Updated weights for policy 0, policy_version 576274 (0.0008) [2023-12-26 04:11:15,113][123090] Updated weights for policy 1, policy_version 572275 (0.0010) [2023-12-26 04:11:15,159][123091] Updated weights for policy 0, policy_version 576284 (0.0006) [2023-12-26 04:11:15,183][123090] Updated weights for policy 1, policy_version 572285 (0.0010) [2023-12-26 04:11:15,229][123091] Updated weights for policy 0, policy_version 576294 (0.0006) [2023-12-26 04:11:15,294][123091] Updated weights for policy 0, policy_version 576304 (0.0011) [2023-12-26 04:11:15,965][123090] Updated weights for policy 1, policy_version 572295 (0.0010) [2023-12-26 04:11:16,002][123091] Updated weights for policy 0, policy_version 576314 (0.0005) [2023-12-26 04:11:16,025][123090] Updated weights for policy 1, policy_version 572305 (0.0010) [2023-12-26 04:11:16,062][123091] Updated weights for policy 0, policy_version 576324 (0.0007) [2023-12-26 04:11:16,077][123090] Updated weights for policy 1, policy_version 572315 (0.0010) [2023-12-26 04:11:16,120][123091] Updated weights for policy 0, policy_version 576334 (0.0007) [2023-12-26 04:11:16,843][123090] Updated weights for policy 1, policy_version 572325 (0.0008) [2023-12-26 04:11:16,903][123090] Updated weights for policy 1, policy_version 572335 (0.0005) [2023-12-26 04:11:16,964][123090] Updated weights for policy 1, policy_version 572345 (0.0009) [2023-12-26 04:11:16,967][123091] Updated weights for policy 0, policy_version 576344 (0.0008) [2023-12-26 04:11:17,022][123091] Updated weights for policy 0, policy_version 576354 (0.0009) [2023-12-26 04:11:17,085][123091] Updated weights for policy 0, policy_version 576364 (0.0010) [2023-12-26 04:11:17,660][123090] Updated weights for policy 1, policy_version 572355 (0.0009) [2023-12-26 04:11:17,713][123090] Updated weights for policy 1, policy_version 572365 (0.0008) [2023-12-26 04:11:17,758][123090] Updated weights for policy 1, policy_version 572375 (0.0005) [2023-12-26 04:11:17,976][123091] Updated weights for policy 0, policy_version 576374 (0.0010) [2023-12-26 04:11:18,036][123091] Updated weights for policy 0, policy_version 576384 (0.0010) [2023-12-26 04:11:18,093][123091] Updated weights for policy 0, policy_version 576394 (0.0009) [2023-12-26 04:11:18,441][123090] Updated weights for policy 1, policy_version 572385 (0.0006) [2023-12-26 04:11:18,500][123090] Updated weights for policy 1, policy_version 572395 (0.0009) [2023-12-26 04:11:18,563][123090] Updated weights for policy 1, policy_version 572405 (0.0009) [2023-12-26 04:11:18,624][123090] Updated weights for policy 1, policy_version 572415 (0.0010) [2023-12-26 04:11:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 294100992. Throughput: 0: 8545.1, 1: 8996.8. Samples: 294110624. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:18,785][121949] Avg episode reward: [(0, '6107.268'), (1, '5864.809')] [2023-12-26 04:11:18,988][123091] Updated weights for policy 0, policy_version 576404 (0.0009) [2023-12-26 04:11:19,040][123091] Updated weights for policy 0, policy_version 576414 (0.0010) [2023-12-26 04:11:19,102][123091] Updated weights for policy 0, policy_version 576424 (0.0010) [2023-12-26 04:11:19,413][123090] Updated weights for policy 1, policy_version 572425 (0.0010) [2023-12-26 04:11:19,472][123090] Updated weights for policy 1, policy_version 572435 (0.0009) [2023-12-26 04:11:19,539][123090] Updated weights for policy 1, policy_version 572445 (0.0008) [2023-12-26 04:11:20,040][123091] Updated weights for policy 0, policy_version 576434 (0.0009) [2023-12-26 04:11:20,108][123091] Updated weights for policy 0, policy_version 576444 (0.0011) [2023-12-26 04:11:20,168][123091] Updated weights for policy 0, policy_version 576454 (0.0011) [2023-12-26 04:11:20,228][123091] Updated weights for policy 0, policy_version 576464 (0.0011) [2023-12-26 04:11:20,420][123090] Updated weights for policy 1, policy_version 572455 (0.0009) [2023-12-26 04:11:20,478][123090] Updated weights for policy 1, policy_version 572465 (0.0009) [2023-12-26 04:11:20,532][123090] Updated weights for policy 1, policy_version 572475 (0.0009) [2023-12-26 04:11:21,146][123091] Updated weights for policy 0, policy_version 576474 (0.0008) [2023-12-26 04:11:21,220][123091] Updated weights for policy 0, policy_version 576484 (0.0008) [2023-12-26 04:11:21,280][123091] Updated weights for policy 0, policy_version 576494 (0.0008) [2023-12-26 04:11:21,395][123090] Updated weights for policy 1, policy_version 572485 (0.0010) [2023-12-26 04:11:21,462][123090] Updated weights for policy 1, policy_version 572495 (0.0007) [2023-12-26 04:11:21,526][123090] Updated weights for policy 1, policy_version 572505 (0.0006) [2023-12-26 04:11:22,088][123091] Updated weights for policy 0, policy_version 576504 (0.0008) [2023-12-26 04:11:22,152][123091] Updated weights for policy 0, policy_version 576514 (0.0008) [2023-12-26 04:11:22,218][123091] Updated weights for policy 0, policy_version 576524 (0.0006) [2023-12-26 04:11:22,317][123090] Updated weights for policy 1, policy_version 572515 (0.0007) [2023-12-26 04:11:22,394][123090] Updated weights for policy 1, policy_version 572525 (0.0011) [2023-12-26 04:11:22,463][123090] Updated weights for policy 1, policy_version 572535 (0.0008) [2023-12-26 04:11:22,983][123091] Updated weights for policy 0, policy_version 576534 (0.0008) [2023-12-26 04:11:23,036][123091] Updated weights for policy 0, policy_version 576544 (0.0009) [2023-12-26 04:11:23,103][123091] Updated weights for policy 0, policy_version 576554 (0.0009) [2023-12-26 04:11:23,186][123090] Updated weights for policy 1, policy_version 572545 (0.0006) [2023-12-26 04:11:23,236][123090] Updated weights for policy 1, policy_version 572555 (0.0005) [2023-12-26 04:11:23,298][123090] Updated weights for policy 1, policy_version 572565 (0.0007) [2023-12-26 04:11:23,372][123090] Updated weights for policy 1, policy_version 572575 (0.0006) [2023-12-26 04:11:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 294182912. Throughput: 0: 8502.1, 1: 8955.9. Samples: 294160280. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:23,785][121949] Avg episode reward: [(0, '6262.510'), (1, '5940.717')] [2023-12-26 04:11:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000576560_147603456.pth... [2023-12-26 04:11:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000572576_146579456.pth... [2023-12-26 04:11:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000575600_147357696.pth [2023-12-26 04:11:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000571520_146309120.pth [2023-12-26 04:11:23,862][123091] Updated weights for policy 0, policy_version 576564 (0.0007) [2023-12-26 04:11:23,915][123091] Updated weights for policy 0, policy_version 576574 (0.0005) [2023-12-26 04:11:23,984][123091] Updated weights for policy 0, policy_version 576584 (0.0005) [2023-12-26 04:11:24,050][123090] Updated weights for policy 1, policy_version 572585 (0.0010) [2023-12-26 04:11:24,113][123090] Updated weights for policy 1, policy_version 572595 (0.0011) [2023-12-26 04:11:24,177][123090] Updated weights for policy 1, policy_version 572605 (0.0011) [2023-12-26 04:11:24,664][123091] Updated weights for policy 0, policy_version 576594 (0.0006) [2023-12-26 04:11:24,729][123091] Updated weights for policy 0, policy_version 576604 (0.0005) [2023-12-26 04:11:24,785][123091] Updated weights for policy 0, policy_version 576614 (0.0005) [2023-12-26 04:11:24,854][123091] Updated weights for policy 0, policy_version 576624 (0.0005) [2023-12-26 04:11:24,974][123090] Updated weights for policy 1, policy_version 572615 (0.0007) [2023-12-26 04:11:25,039][123090] Updated weights for policy 1, policy_version 572625 (0.0005) [2023-12-26 04:11:25,105][123090] Updated weights for policy 1, policy_version 572635 (0.0005) [2023-12-26 04:11:25,476][123091] Updated weights for policy 0, policy_version 576634 (0.0010) [2023-12-26 04:11:25,524][123091] Updated weights for policy 0, policy_version 576644 (0.0010) [2023-12-26 04:11:25,575][123091] Updated weights for policy 0, policy_version 576654 (0.0010) [2023-12-26 04:11:25,729][123090] Updated weights for policy 1, policy_version 572645 (0.0005) [2023-12-26 04:11:25,779][123090] Updated weights for policy 1, policy_version 572655 (0.0005) [2023-12-26 04:11:25,833][123090] Updated weights for policy 1, policy_version 572665 (0.0005) [2023-12-26 04:11:26,299][123091] Updated weights for policy 0, policy_version 576664 (0.0007) [2023-12-26 04:11:26,352][123091] Updated weights for policy 0, policy_version 576674 (0.0005) [2023-12-26 04:11:26,403][123091] Updated weights for policy 0, policy_version 576684 (0.0005) [2023-12-26 04:11:26,623][123090] Updated weights for policy 1, policy_version 572675 (0.0007) [2023-12-26 04:11:26,689][123090] Updated weights for policy 1, policy_version 572685 (0.0010) [2023-12-26 04:11:26,751][123090] Updated weights for policy 1, policy_version 572695 (0.0010) [2023-12-26 04:11:27,110][123091] Updated weights for policy 0, policy_version 576694 (0.0008) [2023-12-26 04:11:27,157][123091] Updated weights for policy 0, policy_version 576704 (0.0010) [2023-12-26 04:11:27,200][123091] Updated weights for policy 0, policy_version 576714 (0.0010) [2023-12-26 04:11:27,567][123090] Updated weights for policy 1, policy_version 572705 (0.0010) [2023-12-26 04:11:27,630][123090] Updated weights for policy 1, policy_version 572715 (0.0010) [2023-12-26 04:11:27,673][123090] Updated weights for policy 1, policy_version 572725 (0.0010) [2023-12-26 04:11:27,724][123090] Updated weights for policy 1, policy_version 572735 (0.0010) [2023-12-26 04:11:28,031][123091] Updated weights for policy 0, policy_version 576724 (0.0008) [2023-12-26 04:11:28,089][123091] Updated weights for policy 0, policy_version 576734 (0.0005) [2023-12-26 04:11:28,164][123091] Updated weights for policy 0, policy_version 576744 (0.0005) [2023-12-26 04:11:28,571][123090] Updated weights for policy 1, policy_version 572745 (0.0011) [2023-12-26 04:11:28,619][123090] Updated weights for policy 1, policy_version 572755 (0.0010) [2023-12-26 04:11:28,668][123090] Updated weights for policy 1, policy_version 572765 (0.0010) [2023-12-26 04:11:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 294281216. Throughput: 0: 8592.6, 1: 9010.8. Samples: 294273168. Policy #0 lag: (min: 14.0, avg: 31.8, max: 46.0) [2023-12-26 04:11:28,785][121949] Avg episode reward: [(0, '6244.752'), (1, '5985.589')] [2023-12-26 04:11:28,895][123091] Updated weights for policy 0, policy_version 576754 (0.0006) [2023-12-26 04:11:28,964][123091] Updated weights for policy 0, policy_version 576764 (0.0010) [2023-12-26 04:11:29,026][123091] Updated weights for policy 0, policy_version 576774 (0.0011) [2023-12-26 04:11:29,094][123091] Updated weights for policy 0, policy_version 576784 (0.0007) [2023-12-26 04:11:29,445][123090] Updated weights for policy 1, policy_version 572775 (0.0007) [2023-12-26 04:11:29,500][123090] Updated weights for policy 1, policy_version 572785 (0.0005) [2023-12-26 04:11:29,548][123090] Updated weights for policy 1, policy_version 572795 (0.0005) [2023-12-26 04:11:29,873][123091] Updated weights for policy 0, policy_version 576794 (0.0008) [2023-12-26 04:11:29,940][123091] Updated weights for policy 0, policy_version 576804 (0.0007) [2023-12-26 04:11:29,994][123091] Updated weights for policy 0, policy_version 576814 (0.0006) [2023-12-26 04:11:30,355][123090] Updated weights for policy 1, policy_version 572805 (0.0008) [2023-12-26 04:11:30,406][123090] Updated weights for policy 1, policy_version 572815 (0.0009) [2023-12-26 04:11:30,458][123090] Updated weights for policy 1, policy_version 572825 (0.0010) [2023-12-26 04:11:30,717][123091] Updated weights for policy 0, policy_version 576824 (0.0007) [2023-12-26 04:11:30,771][123091] Updated weights for policy 0, policy_version 576834 (0.0010) [2023-12-26 04:11:30,834][123091] Updated weights for policy 0, policy_version 576844 (0.0009) [2023-12-26 04:11:31,175][123090] Updated weights for policy 1, policy_version 572835 (0.0010) [2023-12-26 04:11:31,230][123090] Updated weights for policy 1, policy_version 572845 (0.0008) [2023-12-26 04:11:31,299][123090] Updated weights for policy 1, policy_version 572855 (0.0009) [2023-12-26 04:11:31,612][123091] Updated weights for policy 0, policy_version 576854 (0.0010) [2023-12-26 04:11:31,677][123091] Updated weights for policy 0, policy_version 576864 (0.0011) [2023-12-26 04:11:31,733][123091] Updated weights for policy 0, policy_version 576874 (0.0011) [2023-12-26 04:11:32,132][123090] Updated weights for policy 1, policy_version 572865 (0.0009) [2023-12-26 04:11:32,183][123090] Updated weights for policy 1, policy_version 572875 (0.0009) [2023-12-26 04:11:32,234][123090] Updated weights for policy 1, policy_version 572885 (0.0009) [2023-12-26 04:11:32,300][123090] Updated weights for policy 1, policy_version 572895 (0.0009) [2023-12-26 04:11:32,574][123091] Updated weights for policy 0, policy_version 576884 (0.0011) [2023-12-26 04:11:32,638][123091] Updated weights for policy 0, policy_version 576894 (0.0009) [2023-12-26 04:11:32,701][123091] Updated weights for policy 0, policy_version 576904 (0.0010) [2023-12-26 04:11:33,157][123090] Updated weights for policy 1, policy_version 572905 (0.0006) [2023-12-26 04:11:33,219][123090] Updated weights for policy 1, policy_version 572915 (0.0005) [2023-12-26 04:11:33,283][123090] Updated weights for policy 1, policy_version 572925 (0.0005) [2023-12-26 04:11:33,548][123091] Updated weights for policy 0, policy_version 576914 (0.0010) [2023-12-26 04:11:33,605][123091] Updated weights for policy 0, policy_version 576924 (0.0009) [2023-12-26 04:11:33,660][123091] Updated weights for policy 0, policy_version 576934 (0.0009) [2023-12-26 04:11:33,724][123091] Updated weights for policy 0, policy_version 576944 (0.0009) [2023-12-26 04:11:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 294371328. Throughput: 0: 8637.5, 1: 9003.2. Samples: 294380536. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:33,784][121949] Avg episode reward: [(0, '6214.272'), (1, '5868.263')] [2023-12-26 04:11:34,058][123090] Updated weights for policy 1, policy_version 572935 (0.0008) [2023-12-26 04:11:34,125][123090] Updated weights for policy 1, policy_version 572945 (0.0009) [2023-12-26 04:11:34,192][123090] Updated weights for policy 1, policy_version 572955 (0.0009) [2023-12-26 04:11:34,578][123091] Updated weights for policy 0, policy_version 576954 (0.0010) [2023-12-26 04:11:34,636][123091] Updated weights for policy 0, policy_version 576964 (0.0009) [2023-12-26 04:11:34,699][123091] Updated weights for policy 0, policy_version 576974 (0.0009) [2023-12-26 04:11:35,044][123090] Updated weights for policy 1, policy_version 572965 (0.0009) [2023-12-26 04:11:35,092][123090] Updated weights for policy 1, policy_version 572975 (0.0010) [2023-12-26 04:11:35,140][123090] Updated weights for policy 1, policy_version 572985 (0.0010) [2023-12-26 04:11:35,480][123091] Updated weights for policy 0, policy_version 576984 (0.0006) [2023-12-26 04:11:35,536][123091] Updated weights for policy 0, policy_version 576994 (0.0005) [2023-12-26 04:11:35,587][123091] Updated weights for policy 0, policy_version 577004 (0.0005) [2023-12-26 04:11:35,988][123090] Updated weights for policy 1, policy_version 572995 (0.0009) [2023-12-26 04:11:36,050][123090] Updated weights for policy 1, policy_version 573005 (0.0006) [2023-12-26 04:11:36,110][123090] Updated weights for policy 1, policy_version 573015 (0.0006) [2023-12-26 04:11:36,397][123091] Updated weights for policy 0, policy_version 577014 (0.0007) [2023-12-26 04:11:36,456][123091] Updated weights for policy 0, policy_version 577024 (0.0009) [2023-12-26 04:11:36,524][123091] Updated weights for policy 0, policy_version 577034 (0.0005) [2023-12-26 04:11:36,841][123090] Updated weights for policy 1, policy_version 573025 (0.0008) [2023-12-26 04:11:36,900][123090] Updated weights for policy 1, policy_version 573035 (0.0008) [2023-12-26 04:11:36,958][123090] Updated weights for policy 1, policy_version 573045 (0.0009) [2023-12-26 04:11:37,016][123090] Updated weights for policy 1, policy_version 573055 (0.0010) [2023-12-26 04:11:37,280][123091] Updated weights for policy 0, policy_version 577044 (0.0007) [2023-12-26 04:11:37,340][123091] Updated weights for policy 0, policy_version 577054 (0.0009) [2023-12-26 04:11:37,399][123091] Updated weights for policy 0, policy_version 577064 (0.0009) [2023-12-26 04:11:37,888][123090] Updated weights for policy 1, policy_version 573065 (0.0009) [2023-12-26 04:11:37,945][123090] Updated weights for policy 1, policy_version 573075 (0.0009) [2023-12-26 04:11:38,014][123090] Updated weights for policy 1, policy_version 573085 (0.0010) [2023-12-26 04:11:38,195][123091] Updated weights for policy 0, policy_version 577074 (0.0009) [2023-12-26 04:11:38,264][123091] Updated weights for policy 0, policy_version 577084 (0.0005) [2023-12-26 04:11:38,333][123091] Updated weights for policy 0, policy_version 577094 (0.0006) [2023-12-26 04:11:38,403][123091] Updated weights for policy 0, policy_version 577104 (0.0007) [2023-12-26 04:11:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 294453248. Throughput: 0: 8659.0, 1: 9033.6. Samples: 294432928. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:38,785][121949] Avg episode reward: [(0, '6222.940'), (1, '5717.354')] [2023-12-26 04:11:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000577104_147742720.pth... [2023-12-26 04:11:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000573088_146710528.pth... [2023-12-26 04:11:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000576080_147480576.pth [2023-12-26 04:11:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000572064_146448384.pth [2023-12-26 04:11:38,891][123090] Updated weights for policy 1, policy_version 573095 (0.0009) [2023-12-26 04:11:38,946][123090] Updated weights for policy 1, policy_version 573105 (0.0009) [2023-12-26 04:11:39,003][123090] Updated weights for policy 1, policy_version 573115 (0.0009) [2023-12-26 04:11:39,088][123091] Updated weights for policy 0, policy_version 577114 (0.0011) [2023-12-26 04:11:39,135][123091] Updated weights for policy 0, policy_version 577124 (0.0010) [2023-12-26 04:11:39,178][123091] Updated weights for policy 0, policy_version 577134 (0.0008) [2023-12-26 04:11:39,871][123090] Updated weights for policy 1, policy_version 573125 (0.0010) [2023-12-26 04:11:39,941][123090] Updated weights for policy 1, policy_version 573135 (0.0011) [2023-12-26 04:11:40,006][123090] Updated weights for policy 1, policy_version 573145 (0.0012) [2023-12-26 04:11:40,064][123091] Updated weights for policy 0, policy_version 577144 (0.0008) [2023-12-26 04:11:40,122][123091] Updated weights for policy 0, policy_version 577154 (0.0009) [2023-12-26 04:11:40,190][123091] Updated weights for policy 0, policy_version 577164 (0.0007) [2023-12-26 04:11:40,864][123090] Updated weights for policy 1, policy_version 573155 (0.0009) [2023-12-26 04:11:40,922][123090] Updated weights for policy 1, policy_version 573165 (0.0009) [2023-12-26 04:11:40,978][123090] Updated weights for policy 1, policy_version 573175 (0.0009) [2023-12-26 04:11:41,015][123091] Updated weights for policy 0, policy_version 577174 (0.0009) [2023-12-26 04:11:41,084][123091] Updated weights for policy 0, policy_version 577184 (0.0008) [2023-12-26 04:11:41,157][123091] Updated weights for policy 0, policy_version 577194 (0.0008) [2023-12-26 04:11:41,855][123090] Updated weights for policy 1, policy_version 573185 (0.0009) [2023-12-26 04:11:41,913][123090] Updated weights for policy 1, policy_version 573195 (0.0009) [2023-12-26 04:11:41,970][123090] Updated weights for policy 1, policy_version 573205 (0.0010) [2023-12-26 04:11:41,981][123091] Updated weights for policy 0, policy_version 577204 (0.0007) [2023-12-26 04:11:42,024][123090] Updated weights for policy 1, policy_version 573215 (0.0008) [2023-12-26 04:11:42,050][123091] Updated weights for policy 0, policy_version 577214 (0.0008) [2023-12-26 04:11:42,115][123091] Updated weights for policy 0, policy_version 577224 (0.0009) [2023-12-26 04:11:42,900][123091] Updated weights for policy 0, policy_version 577234 (0.0008) [2023-12-26 04:11:42,915][123090] Updated weights for policy 1, policy_version 573225 (0.0010) [2023-12-26 04:11:42,955][123091] Updated weights for policy 0, policy_version 577244 (0.0005) [2023-12-26 04:11:42,963][123090] Updated weights for policy 1, policy_version 573235 (0.0009) [2023-12-26 04:11:43,009][123091] Updated weights for policy 0, policy_version 577254 (0.0005) [2023-12-26 04:11:43,020][123090] Updated weights for policy 1, policy_version 573245 (0.0006) [2023-12-26 04:11:43,057][123091] Updated weights for policy 0, policy_version 577264 (0.0005) [2023-12-26 04:11:43,739][123091] Updated weights for policy 0, policy_version 577274 (0.0010) [2023-12-26 04:11:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 294535168. Throughput: 0: 8702.2, 1: 8908.5. Samples: 294534812. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:43,785][121949] Avg episode reward: [(0, '6094.121'), (1, '5648.193')] [2023-12-26 04:11:43,794][123091] Updated weights for policy 0, policy_version 577284 (0.0010) [2023-12-26 04:11:43,839][123090] Updated weights for policy 1, policy_version 573255 (0.0008) [2023-12-26 04:11:43,843][123091] Updated weights for policy 0, policy_version 577294 (0.0007) [2023-12-26 04:11:43,895][123090] Updated weights for policy 1, policy_version 573265 (0.0010) [2023-12-26 04:11:43,968][123090] Updated weights for policy 1, policy_version 573275 (0.0006) [2023-12-26 04:11:44,595][123091] Updated weights for policy 0, policy_version 577304 (0.0005) [2023-12-26 04:11:44,660][123091] Updated weights for policy 0, policy_version 577314 (0.0007) [2023-12-26 04:11:44,661][123090] Updated weights for policy 1, policy_version 573285 (0.0005) [2023-12-26 04:11:44,714][123091] Updated weights for policy 0, policy_version 577324 (0.0008) [2023-12-26 04:11:44,725][123090] Updated weights for policy 1, policy_version 573295 (0.0005) [2023-12-26 04:11:44,796][123090] Updated weights for policy 1, policy_version 573306 (0.0008) [2023-12-26 04:11:45,505][123091] Updated weights for policy 0, policy_version 577334 (0.0007) [2023-12-26 04:11:45,567][123091] Updated weights for policy 0, policy_version 577344 (0.0008) [2023-12-26 04:11:45,601][123090] Updated weights for policy 1, policy_version 573316 (0.0011) [2023-12-26 04:11:45,631][123091] Updated weights for policy 0, policy_version 577354 (0.0007) [2023-12-26 04:11:45,658][123090] Updated weights for policy 1, policy_version 573326 (0.0010) [2023-12-26 04:11:45,710][123090] Updated weights for policy 1, policy_version 573336 (0.0010) [2023-12-26 04:11:46,279][123091] Updated weights for policy 0, policy_version 577364 (0.0007) [2023-12-26 04:11:46,332][123091] Updated weights for policy 0, policy_version 577374 (0.0010) [2023-12-26 04:11:46,384][123091] Updated weights for policy 0, policy_version 577384 (0.0011) [2023-12-26 04:11:46,487][123090] Updated weights for policy 1, policy_version 573346 (0.0009) [2023-12-26 04:11:46,561][123090] Updated weights for policy 1, policy_version 573356 (0.0005) [2023-12-26 04:11:46,610][123090] Updated weights for policy 1, policy_version 573366 (0.0005) [2023-12-26 04:11:46,660][123090] Updated weights for policy 1, policy_version 573376 (0.0006) [2023-12-26 04:11:47,138][123091] Updated weights for policy 0, policy_version 577394 (0.0010) [2023-12-26 04:11:47,196][123091] Updated weights for policy 0, policy_version 577404 (0.0005) [2023-12-26 04:11:47,251][123091] Updated weights for policy 0, policy_version 577414 (0.0005) [2023-12-26 04:11:47,309][123091] Updated weights for policy 0, policy_version 577424 (0.0005) [2023-12-26 04:11:47,377][123090] Updated weights for policy 1, policy_version 573386 (0.0005) [2023-12-26 04:11:47,424][123090] Updated weights for policy 1, policy_version 573396 (0.0005) [2023-12-26 04:11:47,472][123090] Updated weights for policy 1, policy_version 573406 (0.0005) [2023-12-26 04:11:47,940][123091] Updated weights for policy 0, policy_version 577434 (0.0005) [2023-12-26 04:11:48,004][123091] Updated weights for policy 0, policy_version 577444 (0.0006) [2023-12-26 04:11:48,074][123091] Updated weights for policy 0, policy_version 577454 (0.0009) [2023-12-26 04:11:48,126][123090] Updated weights for policy 1, policy_version 573416 (0.0005) [2023-12-26 04:11:48,194][123090] Updated weights for policy 1, policy_version 573426 (0.0005) [2023-12-26 04:11:48,256][123090] Updated weights for policy 1, policy_version 573436 (0.0005) [2023-12-26 04:11:48,712][123091] Updated weights for policy 0, policy_version 577464 (0.0005) [2023-12-26 04:11:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 294633472. Throughput: 0: 8882.3, 1: 8918.8. Samples: 294650616. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:48,785][121949] Avg episode reward: [(0, '6034.942'), (1, '5671.243')] [2023-12-26 04:11:48,790][123091] Updated weights for policy 0, policy_version 577474 (0.0007) [2023-12-26 04:11:48,864][123091] Updated weights for policy 0, policy_version 577484 (0.0011) [2023-12-26 04:11:48,937][123090] Updated weights for policy 1, policy_version 573446 (0.0005) [2023-12-26 04:11:49,007][123090] Updated weights for policy 1, policy_version 573456 (0.0008) [2023-12-26 04:11:49,078][123090] Updated weights for policy 1, policy_version 573466 (0.0009) [2023-12-26 04:11:49,590][123091] Updated weights for policy 0, policy_version 577494 (0.0008) [2023-12-26 04:11:49,637][123091] Updated weights for policy 0, policy_version 577504 (0.0006) [2023-12-26 04:11:49,685][123091] Updated weights for policy 0, policy_version 577514 (0.0005) [2023-12-26 04:11:49,953][123090] Updated weights for policy 1, policy_version 573476 (0.0010) [2023-12-26 04:11:50,028][123090] Updated weights for policy 1, policy_version 573486 (0.0009) [2023-12-26 04:11:50,085][123090] Updated weights for policy 1, policy_version 573496 (0.0008) [2023-12-26 04:11:50,458][123091] Updated weights for policy 0, policy_version 577524 (0.0007) [2023-12-26 04:11:50,509][123091] Updated weights for policy 0, policy_version 577534 (0.0010) [2023-12-26 04:11:50,577][123091] Updated weights for policy 0, policy_version 577544 (0.0011) [2023-12-26 04:11:50,916][123090] Updated weights for policy 1, policy_version 573506 (0.0010) [2023-12-26 04:11:50,973][123090] Updated weights for policy 1, policy_version 573516 (0.0009) [2023-12-26 04:11:51,035][123090] Updated weights for policy 1, policy_version 573526 (0.0009) [2023-12-26 04:11:51,098][123090] Updated weights for policy 1, policy_version 573536 (0.0009) [2023-12-26 04:11:51,413][123091] Updated weights for policy 0, policy_version 577554 (0.0010) [2023-12-26 04:11:51,478][123091] Updated weights for policy 0, policy_version 577564 (0.0006) [2023-12-26 04:11:51,551][123091] Updated weights for policy 0, policy_version 577574 (0.0006) [2023-12-26 04:11:51,618][123091] Updated weights for policy 0, policy_version 577584 (0.0011) [2023-12-26 04:11:52,073][123090] Updated weights for policy 1, policy_version 573546 (0.0010) [2023-12-26 04:11:52,138][123090] Updated weights for policy 1, policy_version 573556 (0.0009) [2023-12-26 04:11:52,211][123090] Updated weights for policy 1, policy_version 573566 (0.0009) [2023-12-26 04:11:52,326][123091] Updated weights for policy 0, policy_version 577594 (0.0011) [2023-12-26 04:11:52,387][123091] Updated weights for policy 0, policy_version 577604 (0.0010) [2023-12-26 04:11:52,448][123091] Updated weights for policy 0, policy_version 577614 (0.0009) [2023-12-26 04:11:53,030][123090] Updated weights for policy 1, policy_version 573576 (0.0005) [2023-12-26 04:11:53,102][123090] Updated weights for policy 1, policy_version 573586 (0.0010) [2023-12-26 04:11:53,163][123090] Updated weights for policy 1, policy_version 573596 (0.0010) [2023-12-26 04:11:53,245][123091] Updated weights for policy 0, policy_version 577624 (0.0006) [2023-12-26 04:11:53,298][123091] Updated weights for policy 0, policy_version 577634 (0.0005) [2023-12-26 04:11:53,349][123091] Updated weights for policy 0, policy_version 577644 (0.0005) [2023-12-26 04:11:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 294723584. Throughput: 0: 8887.6, 1: 8897.0. Samples: 294702328. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:53,785][121949] Avg episode reward: [(0, '6251.166'), (1, '5840.791')] [2023-12-26 04:11:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000573600_146841600.pth... [2023-12-26 04:11:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000577648_147881984.pth... [2023-12-26 04:11:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000572576_146579456.pth [2023-12-26 04:11:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000576560_147603456.pth [2023-12-26 04:11:53,942][123090] Updated weights for policy 1, policy_version 573606 (0.0010) [2023-12-26 04:11:54,009][123090] Updated weights for policy 1, policy_version 573616 (0.0010) [2023-12-26 04:11:54,051][123091] Updated weights for policy 0, policy_version 577654 (0.0005) [2023-12-26 04:11:54,066][123090] Updated weights for policy 1, policy_version 573626 (0.0010) [2023-12-26 04:11:54,110][123091] Updated weights for policy 0, policy_version 577664 (0.0005) [2023-12-26 04:11:54,167][123091] Updated weights for policy 0, policy_version 577674 (0.0005) [2023-12-26 04:11:54,808][123091] Updated weights for policy 0, policy_version 577684 (0.0007) [2023-12-26 04:11:54,879][123091] Updated weights for policy 0, policy_version 577694 (0.0007) [2023-12-26 04:11:54,903][123090] Updated weights for policy 1, policy_version 573636 (0.0010) [2023-12-26 04:11:54,945][123091] Updated weights for policy 0, policy_version 577704 (0.0008) [2023-12-26 04:11:54,969][123090] Updated weights for policy 1, policy_version 573646 (0.0011) [2023-12-26 04:11:55,042][123090] Updated weights for policy 1, policy_version 573656 (0.0011) [2023-12-26 04:11:55,698][123091] Updated weights for policy 0, policy_version 577714 (0.0007) [2023-12-26 04:11:55,749][123091] Updated weights for policy 0, policy_version 577724 (0.0010) [2023-12-26 04:11:55,804][123091] Updated weights for policy 0, policy_version 577734 (0.0010) [2023-12-26 04:11:55,860][123090] Updated weights for policy 1, policy_version 573666 (0.0010) [2023-12-26 04:11:55,862][123091] Updated weights for policy 0, policy_version 577744 (0.0010) [2023-12-26 04:11:55,911][123090] Updated weights for policy 1, policy_version 573676 (0.0010) [2023-12-26 04:11:55,966][123090] Updated weights for policy 1, policy_version 573686 (0.0010) [2023-12-26 04:11:56,029][123090] Updated weights for policy 1, policy_version 573696 (0.0010) [2023-12-26 04:11:56,658][123091] Updated weights for policy 0, policy_version 577754 (0.0006) [2023-12-26 04:11:56,726][123091] Updated weights for policy 0, policy_version 577764 (0.0005) [2023-12-26 04:11:56,792][123091] Updated weights for policy 0, policy_version 577774 (0.0005) [2023-12-26 04:11:56,886][123090] Updated weights for policy 1, policy_version 573706 (0.0010) [2023-12-26 04:11:56,930][123090] Updated weights for policy 1, policy_version 573716 (0.0010) [2023-12-26 04:11:56,988][123090] Updated weights for policy 1, policy_version 573726 (0.0010) [2023-12-26 04:11:57,408][123091] Updated weights for policy 0, policy_version 577784 (0.0005) [2023-12-26 04:11:57,467][123091] Updated weights for policy 0, policy_version 577794 (0.0005) [2023-12-26 04:11:57,525][123091] Updated weights for policy 0, policy_version 577804 (0.0005) [2023-12-26 04:11:57,808][123090] Updated weights for policy 1, policy_version 573736 (0.0011) [2023-12-26 04:11:57,884][123090] Updated weights for policy 1, policy_version 573746 (0.0010) [2023-12-26 04:11:57,931][123090] Updated weights for policy 1, policy_version 573756 (0.0010) [2023-12-26 04:11:58,372][123091] Updated weights for policy 0, policy_version 577814 (0.0009) [2023-12-26 04:11:58,434][123091] Updated weights for policy 0, policy_version 577824 (0.0011) [2023-12-26 04:11:58,503][123091] Updated weights for policy 0, policy_version 577834 (0.0008) [2023-12-26 04:11:58,782][123090] Updated weights for policy 1, policy_version 573766 (0.0009) [2023-12-26 04:11:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 294813696. Throughput: 0: 9084.8, 1: 8815.1. Samples: 294810480. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:11:58,784][121949] Avg episode reward: [(0, '6280.962'), (1, '5815.184')] [2023-12-26 04:11:58,837][123090] Updated weights for policy 1, policy_version 573776 (0.0010) [2023-12-26 04:11:58,899][123090] Updated weights for policy 1, policy_version 573786 (0.0010) [2023-12-26 04:11:59,389][123091] Updated weights for policy 0, policy_version 577844 (0.0009) [2023-12-26 04:11:59,453][123091] Updated weights for policy 0, policy_version 577854 (0.0009) [2023-12-26 04:11:59,511][123091] Updated weights for policy 0, policy_version 577864 (0.0009) [2023-12-26 04:11:59,707][123090] Updated weights for policy 1, policy_version 573796 (0.0009) [2023-12-26 04:11:59,777][123090] Updated weights for policy 1, policy_version 573806 (0.0006) [2023-12-26 04:11:59,841][123090] Updated weights for policy 1, policy_version 573816 (0.0009) [2023-12-26 04:12:00,300][123091] Updated weights for policy 0, policy_version 577874 (0.0010) [2023-12-26 04:12:00,360][123091] Updated weights for policy 0, policy_version 577884 (0.0009) [2023-12-26 04:12:00,424][123091] Updated weights for policy 0, policy_version 577894 (0.0009) [2023-12-26 04:12:00,483][123091] Updated weights for policy 0, policy_version 577904 (0.0008) [2023-12-26 04:12:00,597][123090] Updated weights for policy 1, policy_version 573826 (0.0009) [2023-12-26 04:12:00,647][123090] Updated weights for policy 1, policy_version 573836 (0.0010) [2023-12-26 04:12:00,706][123090] Updated weights for policy 1, policy_version 573846 (0.0010) [2023-12-26 04:12:00,765][123090] Updated weights for policy 1, policy_version 573856 (0.0006) [2023-12-26 04:12:01,288][123091] Updated weights for policy 0, policy_version 577914 (0.0012) [2023-12-26 04:12:01,356][123091] Updated weights for policy 0, policy_version 577924 (0.0011) [2023-12-26 04:12:01,427][123091] Updated weights for policy 0, policy_version 577934 (0.0010) [2023-12-26 04:12:01,525][123090] Updated weights for policy 1, policy_version 573867 (0.0009) [2023-12-26 04:12:01,574][123090] Updated weights for policy 1, policy_version 573877 (0.0009) [2023-12-26 04:12:01,640][123090] Updated weights for policy 1, policy_version 573888 (0.0009) [2023-12-26 04:12:02,176][123091] Updated weights for policy 0, policy_version 577944 (0.0005) [2023-12-26 04:12:02,241][123091] Updated weights for policy 0, policy_version 577954 (0.0006) [2023-12-26 04:12:02,308][123091] Updated weights for policy 0, policy_version 577964 (0.0010) [2023-12-26 04:12:02,503][123090] Updated weights for policy 1, policy_version 573898 (0.0010) [2023-12-26 04:12:02,573][123090] Updated weights for policy 1, policy_version 573908 (0.0010) [2023-12-26 04:12:02,636][123090] Updated weights for policy 1, policy_version 573918 (0.0010) [2023-12-26 04:12:03,116][123091] Updated weights for policy 0, policy_version 577974 (0.0010) [2023-12-26 04:12:03,180][123091] Updated weights for policy 0, policy_version 577984 (0.0009) [2023-12-26 04:12:03,246][123091] Updated weights for policy 0, policy_version 577994 (0.0010) [2023-12-26 04:12:03,418][123090] Updated weights for policy 1, policy_version 573928 (0.0010) [2023-12-26 04:12:03,476][123090] Updated weights for policy 1, policy_version 573938 (0.0010) [2023-12-26 04:12:03,530][123090] Updated weights for policy 1, policy_version 573948 (0.0010) [2023-12-26 04:12:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 294903808. Throughput: 0: 9114.1, 1: 8765.3. Samples: 294915200. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:03,785][121949] Avg episode reward: [(0, '6231.920'), (1, '5915.548')] [2023-12-26 04:12:03,989][123091] Updated weights for policy 0, policy_version 578004 (0.0010) [2023-12-26 04:12:04,048][123091] Updated weights for policy 0, policy_version 578014 (0.0009) [2023-12-26 04:12:04,109][123091] Updated weights for policy 0, policy_version 578024 (0.0009) [2023-12-26 04:12:04,334][123090] Updated weights for policy 1, policy_version 573958 (0.0008) [2023-12-26 04:12:04,408][123090] Updated weights for policy 1, policy_version 573968 (0.0006) [2023-12-26 04:12:04,482][123090] Updated weights for policy 1, policy_version 573978 (0.0009) [2023-12-26 04:12:04,893][123091] Updated weights for policy 0, policy_version 578034 (0.0009) [2023-12-26 04:12:04,955][123091] Updated weights for policy 0, policy_version 578044 (0.0009) [2023-12-26 04:12:05,014][123091] Updated weights for policy 0, policy_version 578054 (0.0009) [2023-12-26 04:12:05,061][123091] Updated weights for policy 0, policy_version 578064 (0.0008) [2023-12-26 04:12:05,227][123090] Updated weights for policy 1, policy_version 573988 (0.0006) [2023-12-26 04:12:05,283][123090] Updated weights for policy 1, policy_version 573998 (0.0005) [2023-12-26 04:12:05,345][123090] Updated weights for policy 1, policy_version 574008 (0.0005) [2023-12-26 04:12:05,887][123090] Updated weights for policy 1, policy_version 574018 (0.0005) [2023-12-26 04:12:05,944][123091] Updated weights for policy 0, policy_version 578074 (0.0006) [2023-12-26 04:12:05,946][123090] Updated weights for policy 1, policy_version 574028 (0.0005) [2023-12-26 04:12:06,007][123090] Updated weights for policy 1, policy_version 574038 (0.0006) [2023-12-26 04:12:06,015][123091] Updated weights for policy 0, policy_version 578084 (0.0007) [2023-12-26 04:12:06,070][123090] Updated weights for policy 1, policy_version 574048 (0.0006) [2023-12-26 04:12:06,083][123091] Updated weights for policy 0, policy_version 578094 (0.0008) [2023-12-26 04:12:06,859][123090] Updated weights for policy 1, policy_version 574058 (0.0006) [2023-12-26 04:12:06,877][123091] Updated weights for policy 0, policy_version 578104 (0.0008) [2023-12-26 04:12:06,924][123090] Updated weights for policy 1, policy_version 574068 (0.0008) [2023-12-26 04:12:06,945][123091] Updated weights for policy 0, policy_version 578114 (0.0007) [2023-12-26 04:12:06,999][123090] Updated weights for policy 1, policy_version 574078 (0.0006) [2023-12-26 04:12:07,014][123091] Updated weights for policy 0, policy_version 578124 (0.0009) [2023-12-26 04:12:07,750][123091] Updated weights for policy 0, policy_version 578134 (0.0008) [2023-12-26 04:12:07,785][123090] Updated weights for policy 1, policy_version 574088 (0.0010) [2023-12-26 04:12:07,796][123091] Updated weights for policy 0, policy_version 578144 (0.0005) [2023-12-26 04:12:07,844][123091] Updated weights for policy 0, policy_version 578154 (0.0007) [2023-12-26 04:12:07,844][123090] Updated weights for policy 1, policy_version 574098 (0.0010) [2023-12-26 04:12:07,903][123090] Updated weights for policy 1, policy_version 574108 (0.0010) [2023-12-26 04:12:08,637][123091] Updated weights for policy 0, policy_version 578164 (0.0007) [2023-12-26 04:12:08,693][123091] Updated weights for policy 0, policy_version 578174 (0.0006) [2023-12-26 04:12:08,705][123090] Updated weights for policy 1, policy_version 574118 (0.0010) [2023-12-26 04:12:08,758][123091] Updated weights for policy 0, policy_version 578184 (0.0006) [2023-12-26 04:12:08,770][123090] Updated weights for policy 1, policy_version 574128 (0.0011) [2023-12-26 04:12:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 294985728. Throughput: 0: 9151.9, 1: 8829.3. Samples: 294969432. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:08,784][121949] Avg episode reward: [(0, '6327.720'), (1, '6010.244')] [2023-12-26 04:12:08,811][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000578192_148021248.pth... [2023-12-26 04:12:08,817][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000577104_147742720.pth [2023-12-26 04:12:08,837][123090] Updated weights for policy 1, policy_version 574138 (0.0010) [2023-12-26 04:12:08,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000574144_146980864.pth... [2023-12-26 04:12:08,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000573088_146710528.pth [2023-12-26 04:12:09,601][123091] Updated weights for policy 0, policy_version 578194 (0.0007) [2023-12-26 04:12:09,631][123090] Updated weights for policy 1, policy_version 574148 (0.0009) [2023-12-26 04:12:09,660][123091] Updated weights for policy 0, policy_version 578204 (0.0009) [2023-12-26 04:12:09,696][123090] Updated weights for policy 1, policy_version 574158 (0.0006) [2023-12-26 04:12:09,726][123091] Updated weights for policy 0, policy_version 578214 (0.0009) [2023-12-26 04:12:09,769][123090] Updated weights for policy 1, policy_version 574168 (0.0005) [2023-12-26 04:12:09,791][123091] Updated weights for policy 0, policy_version 578224 (0.0008) [2023-12-26 04:12:10,535][123090] Updated weights for policy 1, policy_version 574178 (0.0010) [2023-12-26 04:12:10,591][123090] Updated weights for policy 1, policy_version 574188 (0.0007) [2023-12-26 04:12:10,659][123090] Updated weights for policy 1, policy_version 574198 (0.0006) [2023-12-26 04:12:10,662][123091] Updated weights for policy 0, policy_version 578234 (0.0006) [2023-12-26 04:12:10,730][123091] Updated weights for policy 0, policy_version 578244 (0.0006) [2023-12-26 04:12:10,731][123090] Updated weights for policy 1, policy_version 574208 (0.0006) [2023-12-26 04:12:10,786][123091] Updated weights for policy 0, policy_version 578254 (0.0007) [2023-12-26 04:12:11,463][123090] Updated weights for policy 1, policy_version 574218 (0.0009) [2023-12-26 04:12:11,524][123090] Updated weights for policy 1, policy_version 574228 (0.0008) [2023-12-26 04:12:11,556][123091] Updated weights for policy 0, policy_version 578264 (0.0008) [2023-12-26 04:12:11,585][123090] Updated weights for policy 1, policy_version 574238 (0.0008) [2023-12-26 04:12:11,620][123091] Updated weights for policy 0, policy_version 578274 (0.0007) [2023-12-26 04:12:11,691][123091] Updated weights for policy 0, policy_version 578284 (0.0009) [2023-12-26 04:12:12,418][123091] Updated weights for policy 0, policy_version 578294 (0.0009) [2023-12-26 04:12:12,443][123090] Updated weights for policy 1, policy_version 574248 (0.0010) [2023-12-26 04:12:12,477][123091] Updated weights for policy 0, policy_version 578304 (0.0008) [2023-12-26 04:12:12,499][123090] Updated weights for policy 1, policy_version 574258 (0.0010) [2023-12-26 04:12:12,540][123091] Updated weights for policy 0, policy_version 578314 (0.0008) [2023-12-26 04:12:12,547][123090] Updated weights for policy 1, policy_version 574268 (0.0010) [2023-12-26 04:12:13,260][123090] Updated weights for policy 1, policy_version 574278 (0.0007) [2023-12-26 04:12:13,328][123090] Updated weights for policy 1, policy_version 574288 (0.0007) [2023-12-26 04:12:13,397][123090] Updated weights for policy 1, policy_version 574298 (0.0007) [2023-12-26 04:12:13,411][123091] Updated weights for policy 0, policy_version 578324 (0.0007) [2023-12-26 04:12:13,474][123091] Updated weights for policy 0, policy_version 578334 (0.0010) [2023-12-26 04:12:13,524][123091] Updated weights for policy 0, policy_version 578345 (0.0009) [2023-12-26 04:12:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 295084032. Throughput: 0: 9037.6, 1: 8776.2. Samples: 295074788. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:13,785][121949] Avg episode reward: [(0, '6277.109'), (1, '5948.752')] [2023-12-26 04:12:14,187][123090] Updated weights for policy 1, policy_version 574308 (0.0006) [2023-12-26 04:12:14,252][123090] Updated weights for policy 1, policy_version 574318 (0.0006) [2023-12-26 04:12:14,305][123090] Updated weights for policy 1, policy_version 574329 (0.0009) [2023-12-26 04:12:14,333][123091] Updated weights for policy 0, policy_version 578355 (0.0007) [2023-12-26 04:12:14,392][123091] Updated weights for policy 0, policy_version 578365 (0.0009) [2023-12-26 04:12:14,447][123091] Updated weights for policy 0, policy_version 578375 (0.0010) [2023-12-26 04:12:15,126][123090] Updated weights for policy 1, policy_version 574339 (0.0009) [2023-12-26 04:12:15,182][123090] Updated weights for policy 1, policy_version 574349 (0.0011) [2023-12-26 04:12:15,231][123090] Updated weights for policy 1, policy_version 574359 (0.0010) [2023-12-26 04:12:15,252][123091] Updated weights for policy 0, policy_version 578385 (0.0009) [2023-12-26 04:12:15,312][123091] Updated weights for policy 0, policy_version 578395 (0.0008) [2023-12-26 04:12:15,371][123091] Updated weights for policy 0, policy_version 578405 (0.0008) [2023-12-26 04:12:15,426][123091] Updated weights for policy 0, policy_version 578415 (0.0006) [2023-12-26 04:12:16,062][123090] Updated weights for policy 1, policy_version 574369 (0.0010) [2023-12-26 04:12:16,125][123090] Updated weights for policy 1, policy_version 574379 (0.0007) [2023-12-26 04:12:16,128][123091] Updated weights for policy 0, policy_version 578425 (0.0009) [2023-12-26 04:12:16,177][123091] Updated weights for policy 0, policy_version 578435 (0.0008) [2023-12-26 04:12:16,182][123090] Updated weights for policy 1, policy_version 574389 (0.0007) [2023-12-26 04:12:16,230][123091] Updated weights for policy 0, policy_version 578445 (0.0006) [2023-12-26 04:12:16,240][123090] Updated weights for policy 1, policy_version 574399 (0.0008) [2023-12-26 04:12:16,979][123090] Updated weights for policy 1, policy_version 574409 (0.0010) [2023-12-26 04:12:17,013][123091] Updated weights for policy 0, policy_version 578455 (0.0008) [2023-12-26 04:12:17,028][123090] Updated weights for policy 1, policy_version 574419 (0.0008) [2023-12-26 04:12:17,069][123091] Updated weights for policy 0, policy_version 578465 (0.0007) [2023-12-26 04:12:17,084][123090] Updated weights for policy 1, policy_version 574429 (0.0008) [2023-12-26 04:12:17,126][123091] Updated weights for policy 0, policy_version 578475 (0.0010) [2023-12-26 04:12:17,895][123091] Updated weights for policy 0, policy_version 578485 (0.0010) [2023-12-26 04:12:17,952][123090] Updated weights for policy 1, policy_version 574439 (0.0009) [2023-12-26 04:12:17,954][123091] Updated weights for policy 0, policy_version 578495 (0.0007) [2023-12-26 04:12:18,003][123091] Updated weights for policy 0, policy_version 578505 (0.0006) [2023-12-26 04:12:18,016][123090] Updated weights for policy 1, policy_version 574449 (0.0009) [2023-12-26 04:12:18,078][123090] Updated weights for policy 1, policy_version 574459 (0.0008) [2023-12-26 04:12:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 295165952. Throughput: 0: 9031.0, 1: 8761.9. Samples: 295181216. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:18,785][121949] Avg episode reward: [(0, '6272.199'), (1, '5893.786')] [2023-12-26 04:12:18,833][123091] Updated weights for policy 0, policy_version 578515 (0.0009) [2023-12-26 04:12:18,885][123091] Updated weights for policy 0, policy_version 578525 (0.0010) [2023-12-26 04:12:18,914][123090] Updated weights for policy 1, policy_version 574469 (0.0009) [2023-12-26 04:12:18,935][123091] Updated weights for policy 0, policy_version 578535 (0.0007) [2023-12-26 04:12:18,978][123090] Updated weights for policy 1, policy_version 574479 (0.0010) [2023-12-26 04:12:19,037][123090] Updated weights for policy 1, policy_version 574489 (0.0009) [2023-12-26 04:12:19,805][123091] Updated weights for policy 0, policy_version 578545 (0.0007) [2023-12-26 04:12:19,876][123091] Updated weights for policy 0, policy_version 578555 (0.0008) [2023-12-26 04:12:19,920][123090] Updated weights for policy 1, policy_version 574499 (0.0009) [2023-12-26 04:12:19,935][123091] Updated weights for policy 0, policy_version 578565 (0.0007) [2023-12-26 04:12:19,986][123090] Updated weights for policy 1, policy_version 574509 (0.0007) [2023-12-26 04:12:19,997][123091] Updated weights for policy 0, policy_version 578575 (0.0009) [2023-12-26 04:12:20,051][123090] Updated weights for policy 1, policy_version 574519 (0.0009) [2023-12-26 04:12:20,818][123091] Updated weights for policy 0, policy_version 578585 (0.0010) [2023-12-26 04:12:20,883][123091] Updated weights for policy 0, policy_version 578595 (0.0008) [2023-12-26 04:12:20,890][123090] Updated weights for policy 1, policy_version 574529 (0.0009) [2023-12-26 04:12:20,945][123091] Updated weights for policy 0, policy_version 578605 (0.0009) [2023-12-26 04:12:20,946][123090] Updated weights for policy 1, policy_version 574539 (0.0006) [2023-12-26 04:12:20,997][123090] Updated weights for policy 1, policy_version 574549 (0.0006) [2023-12-26 04:12:21,056][123090] Updated weights for policy 1, policy_version 574559 (0.0010) [2023-12-26 04:12:21,800][123091] Updated weights for policy 0, policy_version 578615 (0.0008) [2023-12-26 04:12:21,871][123091] Updated weights for policy 0, policy_version 578625 (0.0006) [2023-12-26 04:12:21,925][123091] Updated weights for policy 0, policy_version 578635 (0.0005) [2023-12-26 04:12:22,033][123090] Updated weights for policy 1, policy_version 574569 (0.0009) [2023-12-26 04:12:22,098][123090] Updated weights for policy 1, policy_version 574579 (0.0009) [2023-12-26 04:12:22,168][123090] Updated weights for policy 1, policy_version 574589 (0.0009) [2023-12-26 04:12:22,740][123091] Updated weights for policy 0, policy_version 578645 (0.0011) [2023-12-26 04:12:22,805][123091] Updated weights for policy 0, policy_version 578655 (0.0011) [2023-12-26 04:12:22,866][123091] Updated weights for policy 0, policy_version 578665 (0.0011) [2023-12-26 04:12:22,997][123090] Updated weights for policy 1, policy_version 574599 (0.0010) [2023-12-26 04:12:23,069][123090] Updated weights for policy 1, policy_version 574609 (0.0011) [2023-12-26 04:12:23,144][123090] Updated weights for policy 1, policy_version 574619 (0.0011) [2023-12-26 04:12:23,702][123091] Updated weights for policy 0, policy_version 578675 (0.0010) [2023-12-26 04:12:23,753][123091] Updated weights for policy 0, policy_version 578685 (0.0010) [2023-12-26 04:12:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 295247872. Throughput: 0: 9008.2, 1: 8728.2. Samples: 295231064. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:23,785][121949] Avg episode reward: [(0, '6261.571'), (1, '5529.641')] [2023-12-26 04:12:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000574624_147103744.pth... [2023-12-26 04:12:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000573600_146841600.pth [2023-12-26 04:12:23,809][123091] Updated weights for policy 0, policy_version 578695 (0.0010) [2023-12-26 04:12:23,869][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000578704_148152320.pth... [2023-12-26 04:12:23,873][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000577648_147881984.pth [2023-12-26 04:12:23,949][123090] Updated weights for policy 1, policy_version 574629 (0.0011) [2023-12-26 04:12:24,005][123090] Updated weights for policy 1, policy_version 574639 (0.0010) [2023-12-26 04:12:24,069][123090] Updated weights for policy 1, policy_version 574649 (0.0010) [2023-12-26 04:12:24,600][123091] Updated weights for policy 0, policy_version 578705 (0.0010) [2023-12-26 04:12:24,660][123091] Updated weights for policy 0, policy_version 578715 (0.0007) [2023-12-26 04:12:24,725][123091] Updated weights for policy 0, policy_version 578725 (0.0010) [2023-12-26 04:12:24,791][123091] Updated weights for policy 0, policy_version 578735 (0.0010) [2023-12-26 04:12:24,831][123090] Updated weights for policy 1, policy_version 574659 (0.0008) [2023-12-26 04:12:24,893][123090] Updated weights for policy 1, policy_version 574669 (0.0005) [2023-12-26 04:12:24,952][123090] Updated weights for policy 1, policy_version 574679 (0.0005) [2023-12-26 04:12:25,490][123091] Updated weights for policy 0, policy_version 578745 (0.0006) [2023-12-26 04:12:25,545][123091] Updated weights for policy 0, policy_version 578755 (0.0005) [2023-12-26 04:12:25,591][123091] Updated weights for policy 0, policy_version 578765 (0.0006) [2023-12-26 04:12:25,673][123090] Updated weights for policy 1, policy_version 574689 (0.0006) [2023-12-26 04:12:25,729][123090] Updated weights for policy 1, policy_version 574700 (0.0010) [2023-12-26 04:12:25,780][123090] Updated weights for policy 1, policy_version 574710 (0.0009) [2023-12-26 04:12:25,836][123090] Updated weights for policy 1, policy_version 574720 (0.0009) [2023-12-26 04:12:26,331][123091] Updated weights for policy 0, policy_version 578775 (0.0008) [2023-12-26 04:12:26,384][123091] Updated weights for policy 0, policy_version 578785 (0.0009) [2023-12-26 04:12:26,444][123091] Updated weights for policy 0, policy_version 578795 (0.0009) [2023-12-26 04:12:26,696][123090] Updated weights for policy 1, policy_version 574730 (0.0010) [2023-12-26 04:12:26,747][123090] Updated weights for policy 1, policy_version 574740 (0.0010) [2023-12-26 04:12:26,802][123090] Updated weights for policy 1, policy_version 574750 (0.0010) [2023-12-26 04:12:27,279][123091] Updated weights for policy 0, policy_version 578805 (0.0009) [2023-12-26 04:12:27,334][123091] Updated weights for policy 0, policy_version 578815 (0.0009) [2023-12-26 04:12:27,392][123091] Updated weights for policy 0, policy_version 578825 (0.0009) [2023-12-26 04:12:27,627][123090] Updated weights for policy 1, policy_version 574760 (0.0010) [2023-12-26 04:12:27,683][123090] Updated weights for policy 1, policy_version 574770 (0.0009) [2023-12-26 04:12:27,737][123090] Updated weights for policy 1, policy_version 574780 (0.0005) [2023-12-26 04:12:28,225][123091] Updated weights for policy 0, policy_version 578835 (0.0009) [2023-12-26 04:12:28,276][123091] Updated weights for policy 0, policy_version 578845 (0.0010) [2023-12-26 04:12:28,331][123091] Updated weights for policy 0, policy_version 578855 (0.0010) [2023-12-26 04:12:28,380][123090] Updated weights for policy 1, policy_version 574790 (0.0008) [2023-12-26 04:12:28,436][123090] Updated weights for policy 1, policy_version 574800 (0.0010) [2023-12-26 04:12:28,499][123090] Updated weights for policy 1, policy_version 574810 (0.0010) [2023-12-26 04:12:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 295346176. Throughput: 0: 9035.3, 1: 8788.4. Samples: 295336880. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:28,785][121949] Avg episode reward: [(0, '6265.606'), (1, '5418.235')] [2023-12-26 04:12:29,100][123091] Updated weights for policy 0, policy_version 578865 (0.0010) [2023-12-26 04:12:29,148][123091] Updated weights for policy 0, policy_version 578875 (0.0005) [2023-12-26 04:12:29,185][123090] Updated weights for policy 1, policy_version 574820 (0.0008) [2023-12-26 04:12:29,207][123091] Updated weights for policy 0, policy_version 578885 (0.0006) [2023-12-26 04:12:29,260][123090] Updated weights for policy 1, policy_version 574832 (0.0009) [2023-12-26 04:12:29,274][123091] Updated weights for policy 0, policy_version 578895 (0.0008) [2023-12-26 04:12:29,315][123090] Updated weights for policy 1, policy_version 574842 (0.0010) [2023-12-26 04:12:29,982][123091] Updated weights for policy 0, policy_version 578905 (0.0008) [2023-12-26 04:12:30,040][123091] Updated weights for policy 0, policy_version 578915 (0.0008) [2023-12-26 04:12:30,088][123091] Updated weights for policy 0, policy_version 578925 (0.0008) [2023-12-26 04:12:30,133][123090] Updated weights for policy 1, policy_version 574852 (0.0013) [2023-12-26 04:12:30,192][123090] Updated weights for policy 1, policy_version 574862 (0.0010) [2023-12-26 04:12:30,254][123090] Updated weights for policy 1, policy_version 574872 (0.0010) [2023-12-26 04:12:30,874][123091] Updated weights for policy 0, policy_version 578935 (0.0007) [2023-12-26 04:12:30,920][123091] Updated weights for policy 0, policy_version 578945 (0.0008) [2023-12-26 04:12:30,968][123091] Updated weights for policy 0, policy_version 578955 (0.0005) [2023-12-26 04:12:31,095][123090] Updated weights for policy 1, policy_version 574882 (0.0010) [2023-12-26 04:12:31,163][123090] Updated weights for policy 1, policy_version 574892 (0.0009) [2023-12-26 04:12:31,218][123090] Updated weights for policy 1, policy_version 574902 (0.0010) [2023-12-26 04:12:31,274][123090] Updated weights for policy 1, policy_version 574912 (0.0010) [2023-12-26 04:12:31,762][123091] Updated weights for policy 0, policy_version 578965 (0.0007) [2023-12-26 04:12:31,821][123091] Updated weights for policy 0, policy_version 578975 (0.0009) [2023-12-26 04:12:31,881][123091] Updated weights for policy 0, policy_version 578985 (0.0008) [2023-12-26 04:12:32,092][123090] Updated weights for policy 1, policy_version 574922 (0.0009) [2023-12-26 04:12:32,152][123090] Updated weights for policy 1, policy_version 574932 (0.0008) [2023-12-26 04:12:32,212][123090] Updated weights for policy 1, policy_version 574942 (0.0009) [2023-12-26 04:12:32,726][123091] Updated weights for policy 0, policy_version 578995 (0.0009) [2023-12-26 04:12:32,784][123091] Updated weights for policy 0, policy_version 579005 (0.0010) [2023-12-26 04:12:32,839][123091] Updated weights for policy 0, policy_version 579015 (0.0009) [2023-12-26 04:12:33,055][123090] Updated weights for policy 1, policy_version 574952 (0.0009) [2023-12-26 04:12:33,104][123090] Updated weights for policy 1, policy_version 574962 (0.0009) [2023-12-26 04:12:33,155][123090] Updated weights for policy 1, policy_version 574972 (0.0009) [2023-12-26 04:12:33,698][123091] Updated weights for policy 0, policy_version 579025 (0.0008) [2023-12-26 04:12:33,752][123091] Updated weights for policy 0, policy_version 579035 (0.0005) [2023-12-26 04:12:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 295428096. Throughput: 0: 8903.1, 1: 8730.2. Samples: 295444116. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:33,785][121949] Avg episode reward: [(0, '6208.464'), (1, '5683.904')] [2023-12-26 04:12:33,796][123091] Updated weights for policy 0, policy_version 579045 (0.0005) [2023-12-26 04:12:33,841][123091] Updated weights for policy 0, policy_version 579055 (0.0005) [2023-12-26 04:12:33,878][123090] Updated weights for policy 1, policy_version 574982 (0.0007) [2023-12-26 04:12:33,937][123090] Updated weights for policy 1, policy_version 574992 (0.0005) [2023-12-26 04:12:33,993][123090] Updated weights for policy 1, policy_version 575002 (0.0005) [2023-12-26 04:12:34,580][123091] Updated weights for policy 0, policy_version 579065 (0.0006) [2023-12-26 04:12:34,639][123091] Updated weights for policy 0, policy_version 579075 (0.0007) [2023-12-26 04:12:34,699][123091] Updated weights for policy 0, policy_version 579085 (0.0006) [2023-12-26 04:12:34,728][123090] Updated weights for policy 1, policy_version 575012 (0.0006) [2023-12-26 04:12:34,785][123090] Updated weights for policy 1, policy_version 575022 (0.0010) [2023-12-26 04:12:34,847][123090] Updated weights for policy 1, policy_version 575032 (0.0009) [2023-12-26 04:12:35,384][123091] Updated weights for policy 0, policy_version 579095 (0.0006) [2023-12-26 04:12:35,445][123091] Updated weights for policy 0, policy_version 579105 (0.0005) [2023-12-26 04:12:35,507][123091] Updated weights for policy 0, policy_version 579115 (0.0005) [2023-12-26 04:12:35,593][123090] Updated weights for policy 1, policy_version 575042 (0.0006) [2023-12-26 04:12:35,645][123090] Updated weights for policy 1, policy_version 575052 (0.0010) [2023-12-26 04:12:35,693][123090] Updated weights for policy 1, policy_version 575062 (0.0010) [2023-12-26 04:12:35,753][123090] Updated weights for policy 1, policy_version 575072 (0.0010) [2023-12-26 04:12:36,302][123091] Updated weights for policy 0, policy_version 579125 (0.0008) [2023-12-26 04:12:36,354][123091] Updated weights for policy 0, policy_version 579135 (0.0007) [2023-12-26 04:12:36,414][123091] Updated weights for policy 0, policy_version 579145 (0.0007) [2023-12-26 04:12:36,584][123090] Updated weights for policy 1, policy_version 575082 (0.0009) [2023-12-26 04:12:36,644][123090] Updated weights for policy 1, policy_version 575092 (0.0006) [2023-12-26 04:12:36,698][123090] Updated weights for policy 1, policy_version 575102 (0.0007) [2023-12-26 04:12:37,261][123091] Updated weights for policy 0, policy_version 579155 (0.0009) [2023-12-26 04:12:37,314][123091] Updated weights for policy 0, policy_version 579165 (0.0009) [2023-12-26 04:12:37,379][123091] Updated weights for policy 0, policy_version 579175 (0.0009) [2023-12-26 04:12:37,491][123090] Updated weights for policy 1, policy_version 575112 (0.0006) [2023-12-26 04:12:37,552][123090] Updated weights for policy 1, policy_version 575122 (0.0005) [2023-12-26 04:12:37,606][123090] Updated weights for policy 1, policy_version 575132 (0.0005) [2023-12-26 04:12:38,173][123091] Updated weights for policy 0, policy_version 579186 (0.0010) [2023-12-26 04:12:38,240][123091] Updated weights for policy 0, policy_version 579196 (0.0009) [2023-12-26 04:12:38,243][123090] Updated weights for policy 1, policy_version 575142 (0.0006) [2023-12-26 04:12:38,297][123091] Updated weights for policy 0, policy_version 579206 (0.0007) [2023-12-26 04:12:38,302][123090] Updated weights for policy 1, policy_version 575152 (0.0010) [2023-12-26 04:12:38,363][123091] Updated weights for policy 0, policy_version 579216 (0.0009) [2023-12-26 04:12:38,368][123090] Updated weights for policy 1, policy_version 575162 (0.0010) [2023-12-26 04:12:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 295526400. Throughput: 0: 8933.7, 1: 8805.6. Samples: 295500596. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:38,785][121949] Avg episode reward: [(0, '6178.211'), (1, '5472.830')] [2023-12-26 04:12:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000579216_148283392.pth... [2023-12-26 04:12:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000575168_147243008.pth... [2023-12-26 04:12:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000578192_148021248.pth [2023-12-26 04:12:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000574144_146980864.pth [2023-12-26 04:12:39,186][123091] Updated weights for policy 0, policy_version 579226 (0.0009) [2023-12-26 04:12:39,198][123090] Updated weights for policy 1, policy_version 575172 (0.0010) [2023-12-26 04:12:39,251][123091] Updated weights for policy 0, policy_version 579236 (0.0010) [2023-12-26 04:12:39,266][123090] Updated weights for policy 1, policy_version 575182 (0.0008) [2023-12-26 04:12:39,317][123091] Updated weights for policy 0, policy_version 579246 (0.0009) [2023-12-26 04:12:39,332][123090] Updated weights for policy 1, policy_version 575192 (0.0006) [2023-12-26 04:12:40,046][123090] Updated weights for policy 1, policy_version 575202 (0.0006) [2023-12-26 04:12:40,113][123090] Updated weights for policy 1, policy_version 575212 (0.0005) [2023-12-26 04:12:40,171][123090] Updated weights for policy 1, policy_version 575222 (0.0007) [2023-12-26 04:12:40,227][123090] Updated weights for policy 1, policy_version 575232 (0.0010) [2023-12-26 04:12:40,248][123091] Updated weights for policy 0, policy_version 579256 (0.0007) [2023-12-26 04:12:40,301][123091] Updated weights for policy 0, policy_version 579266 (0.0009) [2023-12-26 04:12:40,355][123091] Updated weights for policy 0, policy_version 579276 (0.0009) [2023-12-26 04:12:41,017][123090] Updated weights for policy 1, policy_version 575242 (0.0010) [2023-12-26 04:12:41,089][123090] Updated weights for policy 1, policy_version 575252 (0.0011) [2023-12-26 04:12:41,151][123091] Updated weights for policy 0, policy_version 579286 (0.0009) [2023-12-26 04:12:41,160][123090] Updated weights for policy 1, policy_version 575262 (0.0010) [2023-12-26 04:12:41,212][123091] Updated weights for policy 0, policy_version 579296 (0.0009) [2023-12-26 04:12:41,277][123091] Updated weights for policy 0, policy_version 579306 (0.0009) [2023-12-26 04:12:42,031][123090] Updated weights for policy 1, policy_version 575272 (0.0011) [2023-12-26 04:12:42,073][123091] Updated weights for policy 0, policy_version 579316 (0.0008) [2023-12-26 04:12:42,091][123090] Updated weights for policy 1, policy_version 575282 (0.0011) [2023-12-26 04:12:42,137][123091] Updated weights for policy 0, policy_version 579326 (0.0008) [2023-12-26 04:12:42,154][123090] Updated weights for policy 1, policy_version 575292 (0.0010) [2023-12-26 04:12:42,190][123091] Updated weights for policy 0, policy_version 579336 (0.0010) [2023-12-26 04:12:42,890][123090] Updated weights for policy 1, policy_version 575302 (0.0007) [2023-12-26 04:12:42,947][123090] Updated weights for policy 1, policy_version 575312 (0.0006) [2023-12-26 04:12:43,015][123090] Updated weights for policy 1, policy_version 575322 (0.0006) [2023-12-26 04:12:43,124][123091] Updated weights for policy 0, policy_version 579346 (0.0009) [2023-12-26 04:12:43,198][123091] Updated weights for policy 0, policy_version 579356 (0.0010) [2023-12-26 04:12:43,266][123091] Updated weights for policy 0, policy_version 579366 (0.0009) [2023-12-26 04:12:43,324][123091] Updated weights for policy 0, policy_version 579376 (0.0010) [2023-12-26 04:12:43,689][123090] Updated weights for policy 1, policy_version 575332 (0.0006) [2023-12-26 04:12:43,757][123090] Updated weights for policy 1, policy_version 575342 (0.0005) [2023-12-26 04:12:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 295608320. Throughput: 0: 8780.3, 1: 8866.9. Samples: 295604608. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:43,785][121949] Avg episode reward: [(0, '6121.107'), (1, '5234.722')] [2023-12-26 04:12:43,817][123090] Updated weights for policy 1, policy_version 575352 (0.0005) [2023-12-26 04:12:44,192][123091] Updated weights for policy 0, policy_version 579386 (0.0010) [2023-12-26 04:12:44,247][123091] Updated weights for policy 0, policy_version 579396 (0.0008) [2023-12-26 04:12:44,302][123091] Updated weights for policy 0, policy_version 579406 (0.0010) [2023-12-26 04:12:44,483][123090] Updated weights for policy 1, policy_version 575362 (0.0005) [2023-12-26 04:12:44,539][123090] Updated weights for policy 1, policy_version 575372 (0.0005) [2023-12-26 04:12:44,595][123090] Updated weights for policy 1, policy_version 575382 (0.0005) [2023-12-26 04:12:44,652][123090] Updated weights for policy 1, policy_version 575392 (0.0007) [2023-12-26 04:12:45,224][123091] Updated weights for policy 0, policy_version 579416 (0.0010) [2023-12-26 04:12:45,290][123091] Updated weights for policy 0, policy_version 579426 (0.0009) [2023-12-26 04:12:45,350][123091] Updated weights for policy 0, policy_version 579436 (0.0008) [2023-12-26 04:12:45,445][123090] Updated weights for policy 1, policy_version 575402 (0.0007) [2023-12-26 04:12:45,501][123090] Updated weights for policy 1, policy_version 575412 (0.0011) [2023-12-26 04:12:45,557][123090] Updated weights for policy 1, policy_version 575422 (0.0010) [2023-12-26 04:12:46,062][123091] Updated weights for policy 0, policy_version 579446 (0.0006) [2023-12-26 04:12:46,121][123091] Updated weights for policy 0, policy_version 579456 (0.0005) [2023-12-26 04:12:46,170][123091] Updated weights for policy 0, policy_version 579466 (0.0005) [2023-12-26 04:12:46,311][123090] Updated weights for policy 1, policy_version 575432 (0.0006) [2023-12-26 04:12:46,377][123090] Updated weights for policy 1, policy_version 575442 (0.0005) [2023-12-26 04:12:46,434][123090] Updated weights for policy 1, policy_version 575452 (0.0006) [2023-12-26 04:12:46,836][123091] Updated weights for policy 0, policy_version 579476 (0.0005) [2023-12-26 04:12:46,896][123091] Updated weights for policy 0, policy_version 579486 (0.0006) [2023-12-26 04:12:46,950][123091] Updated weights for policy 0, policy_version 579497 (0.0009) [2023-12-26 04:12:47,130][123090] Updated weights for policy 1, policy_version 575462 (0.0007) [2023-12-26 04:12:47,177][123090] Updated weights for policy 1, policy_version 575472 (0.0005) [2023-12-26 04:12:47,248][123090] Updated weights for policy 1, policy_version 575482 (0.0005) [2023-12-26 04:12:47,714][123091] Updated weights for policy 0, policy_version 579507 (0.0010) [2023-12-26 04:12:47,766][123091] Updated weights for policy 0, policy_version 579517 (0.0011) [2023-12-26 04:12:47,818][123091] Updated weights for policy 0, policy_version 579527 (0.0011) [2023-12-26 04:12:47,929][123090] Updated weights for policy 1, policy_version 575492 (0.0008) [2023-12-26 04:12:47,976][123090] Updated weights for policy 1, policy_version 575502 (0.0010) [2023-12-26 04:12:48,033][123090] Updated weights for policy 1, policy_version 575512 (0.0011) [2023-12-26 04:12:48,560][123091] Updated weights for policy 0, policy_version 579537 (0.0010) [2023-12-26 04:12:48,624][123091] Updated weights for policy 0, policy_version 579547 (0.0008) [2023-12-26 04:12:48,685][123091] Updated weights for policy 0, policy_version 579557 (0.0007) [2023-12-26 04:12:48,743][123091] Updated weights for policy 0, policy_version 579567 (0.0005) [2023-12-26 04:12:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 295706624. Throughput: 0: 8814.6, 1: 8988.6. Samples: 295716340. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:48,785][121949] Avg episode reward: [(0, '6103.984'), (1, '5544.074')] [2023-12-26 04:12:48,890][123090] Updated weights for policy 1, policy_version 575522 (0.0010) [2023-12-26 04:12:48,950][123090] Updated weights for policy 1, policy_version 575532 (0.0006) [2023-12-26 04:12:49,006][123090] Updated weights for policy 1, policy_version 575542 (0.0006) [2023-12-26 04:12:49,065][123090] Updated weights for policy 1, policy_version 575552 (0.0005) [2023-12-26 04:12:49,401][123091] Updated weights for policy 0, policy_version 579577 (0.0010) [2023-12-26 04:12:49,454][123091] Updated weights for policy 0, policy_version 579587 (0.0010) [2023-12-26 04:12:49,515][123091] Updated weights for policy 0, policy_version 579597 (0.0009) [2023-12-26 04:12:49,756][123090] Updated weights for policy 1, policy_version 575562 (0.0009) [2023-12-26 04:12:49,825][123090] Updated weights for policy 1, policy_version 575572 (0.0011) [2023-12-26 04:12:49,888][123090] Updated weights for policy 1, policy_version 575582 (0.0010) [2023-12-26 04:12:50,406][123091] Updated weights for policy 0, policy_version 579607 (0.0009) [2023-12-26 04:12:50,453][123091] Updated weights for policy 0, policy_version 579617 (0.0009) [2023-12-26 04:12:50,501][123091] Updated weights for policy 0, policy_version 579627 (0.0009) [2023-12-26 04:12:50,660][123090] Updated weights for policy 1, policy_version 575592 (0.0007) [2023-12-26 04:12:50,721][123090] Updated weights for policy 1, policy_version 575602 (0.0006) [2023-12-26 04:12:50,792][123090] Updated weights for policy 1, policy_version 575612 (0.0006) [2023-12-26 04:12:51,418][123091] Updated weights for policy 0, policy_version 579637 (0.0008) [2023-12-26 04:12:51,485][123091] Updated weights for policy 0, policy_version 579647 (0.0009) [2023-12-26 04:12:51,504][123090] Updated weights for policy 1, policy_version 575622 (0.0007) [2023-12-26 04:12:51,552][123091] Updated weights for policy 0, policy_version 579657 (0.0006) [2023-12-26 04:12:51,574][123090] Updated weights for policy 1, policy_version 575632 (0.0008) [2023-12-26 04:12:51,640][123090] Updated weights for policy 1, policy_version 575642 (0.0010) [2023-12-26 04:12:52,187][123091] Updated weights for policy 0, policy_version 579667 (0.0006) [2023-12-26 04:12:52,257][123091] Updated weights for policy 0, policy_version 579677 (0.0007) [2023-12-26 04:12:52,324][123091] Updated weights for policy 0, policy_version 579687 (0.0009) [2023-12-26 04:12:52,410][123090] Updated weights for policy 1, policy_version 575652 (0.0009) [2023-12-26 04:12:52,469][123090] Updated weights for policy 1, policy_version 575662 (0.0008) [2023-12-26 04:12:52,536][123090] Updated weights for policy 1, policy_version 575672 (0.0008) [2023-12-26 04:12:53,106][123091] Updated weights for policy 0, policy_version 579697 (0.0010) [2023-12-26 04:12:53,164][123091] Updated weights for policy 0, policy_version 579707 (0.0010) [2023-12-26 04:12:53,228][123091] Updated weights for policy 0, policy_version 579717 (0.0010) [2023-12-26 04:12:53,271][123090] Updated weights for policy 1, policy_version 575682 (0.0008) [2023-12-26 04:12:53,291][123091] Updated weights for policy 0, policy_version 579727 (0.0008) [2023-12-26 04:12:53,329][123090] Updated weights for policy 1, policy_version 575693 (0.0010) [2023-12-26 04:12:53,378][123090] Updated weights for policy 1, policy_version 575703 (0.0009) [2023-12-26 04:12:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 295796736. Throughput: 0: 8808.5, 1: 8988.5. Samples: 295770300. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:53,784][121949] Avg episode reward: [(0, '6182.588'), (1, '5758.759')] [2023-12-26 04:12:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000575712_147382272.pth... [2023-12-26 04:12:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000579728_148414464.pth... [2023-12-26 04:12:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000574624_147103744.pth [2023-12-26 04:12:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000578704_148152320.pth [2023-12-26 04:12:54,075][123091] Updated weights for policy 0, policy_version 579737 (0.0010) [2023-12-26 04:12:54,130][123091] Updated weights for policy 0, policy_version 579747 (0.0011) [2023-12-26 04:12:54,193][123091] Updated weights for policy 0, policy_version 579757 (0.0010) [2023-12-26 04:12:54,274][123090] Updated weights for policy 1, policy_version 575713 (0.0009) [2023-12-26 04:12:54,337][123090] Updated weights for policy 1, policy_version 575723 (0.0009) [2023-12-26 04:12:54,398][123090] Updated weights for policy 1, policy_version 575733 (0.0009) [2023-12-26 04:12:54,464][123090] Updated weights for policy 1, policy_version 575743 (0.0009) [2023-12-26 04:12:55,014][123091] Updated weights for policy 0, policy_version 579767 (0.0007) [2023-12-26 04:12:55,068][123091] Updated weights for policy 0, policy_version 579777 (0.0010) [2023-12-26 04:12:55,136][123091] Updated weights for policy 0, policy_version 579787 (0.0010) [2023-12-26 04:12:55,263][123090] Updated weights for policy 1, policy_version 575753 (0.0010) [2023-12-26 04:12:55,314][123090] Updated weights for policy 1, policy_version 575764 (0.0009) [2023-12-26 04:12:55,369][123090] Updated weights for policy 1, policy_version 575774 (0.0009) [2023-12-26 04:12:55,939][123091] Updated weights for policy 0, policy_version 579797 (0.0010) [2023-12-26 04:12:55,983][123091] Updated weights for policy 0, policy_version 579807 (0.0005) [2023-12-26 04:12:56,035][123091] Updated weights for policy 0, policy_version 579817 (0.0005) [2023-12-26 04:12:56,277][123090] Updated weights for policy 1, policy_version 575784 (0.0007) [2023-12-26 04:12:56,334][123090] Updated weights for policy 1, policy_version 575794 (0.0005) [2023-12-26 04:12:56,389][123090] Updated weights for policy 1, policy_version 575804 (0.0005) [2023-12-26 04:12:56,754][123091] Updated weights for policy 0, policy_version 579827 (0.0006) [2023-12-26 04:12:56,816][123091] Updated weights for policy 0, policy_version 579837 (0.0007) [2023-12-26 04:12:56,896][123091] Updated weights for policy 0, policy_version 579847 (0.0006) [2023-12-26 04:12:57,144][123090] Updated weights for policy 1, policy_version 575814 (0.0007) [2023-12-26 04:12:57,193][123090] Updated weights for policy 1, policy_version 575824 (0.0009) [2023-12-26 04:12:57,239][123090] Updated weights for policy 1, policy_version 575834 (0.0008) [2023-12-26 04:12:57,506][123091] Updated weights for policy 0, policy_version 579857 (0.0005) [2023-12-26 04:12:57,562][123091] Updated weights for policy 0, policy_version 579867 (0.0009) [2023-12-26 04:12:57,616][123091] Updated weights for policy 0, policy_version 579878 (0.0010) [2023-12-26 04:12:57,967][123090] Updated weights for policy 1, policy_version 575845 (0.0008) [2023-12-26 04:12:58,033][123090] Updated weights for policy 1, policy_version 575855 (0.0007) [2023-12-26 04:12:58,101][123090] Updated weights for policy 1, policy_version 575865 (0.0007) [2023-12-26 04:12:58,510][123091] Updated weights for policy 0, policy_version 579889 (0.0010) [2023-12-26 04:12:58,567][123091] Updated weights for policy 0, policy_version 579899 (0.0008) [2023-12-26 04:12:58,629][123091] Updated weights for policy 0, policy_version 579909 (0.0009) [2023-12-26 04:12:58,702][123091] Updated weights for policy 0, policy_version 579919 (0.0009) [2023-12-26 04:12:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 295886848. Throughput: 0: 8880.7, 1: 8977.5. Samples: 295878408. Policy #0 lag: (min: 34.0, avg: 39.9, max: 40.0) [2023-12-26 04:12:58,785][121949] Avg episode reward: [(0, '6163.168'), (1, '5754.804')] [2023-12-26 04:12:58,910][123090] Updated weights for policy 1, policy_version 575875 (0.0007) [2023-12-26 04:12:58,978][123090] Updated weights for policy 1, policy_version 575885 (0.0011) [2023-12-26 04:12:59,038][123090] Updated weights for policy 1, policy_version 575895 (0.0011) [2023-12-26 04:12:59,667][123091] Updated weights for policy 0, policy_version 579929 (0.0009) [2023-12-26 04:12:59,716][123091] Updated weights for policy 0, policy_version 579939 (0.0009) [2023-12-26 04:12:59,768][123091] Updated weights for policy 0, policy_version 579949 (0.0009) [2023-12-26 04:12:59,828][123090] Updated weights for policy 1, policy_version 575905 (0.0010) [2023-12-26 04:12:59,898][123090] Updated weights for policy 1, policy_version 575915 (0.0010) [2023-12-26 04:12:59,970][123090] Updated weights for policy 1, policy_version 575925 (0.0009) [2023-12-26 04:13:00,038][123090] Updated weights for policy 1, policy_version 575935 (0.0009) [2023-12-26 04:13:00,681][123091] Updated weights for policy 0, policy_version 579959 (0.0009) [2023-12-26 04:13:00,729][123091] Updated weights for policy 0, policy_version 579969 (0.0008) [2023-12-26 04:13:00,752][123090] Updated weights for policy 1, policy_version 575945 (0.0009) [2023-12-26 04:13:00,785][123091] Updated weights for policy 0, policy_version 579979 (0.0008) [2023-12-26 04:13:00,804][123090] Updated weights for policy 1, policy_version 575955 (0.0005) [2023-12-26 04:13:00,858][123090] Updated weights for policy 1, policy_version 575965 (0.0005) [2023-12-26 04:13:01,598][123091] Updated weights for policy 0, policy_version 579989 (0.0008) [2023-12-26 04:13:01,599][123090] Updated weights for policy 1, policy_version 575975 (0.0008) [2023-12-26 04:13:01,657][123090] Updated weights for policy 1, policy_version 575985 (0.0011) [2023-12-26 04:13:01,669][123091] Updated weights for policy 0, policy_version 579999 (0.0007) [2023-12-26 04:13:01,723][123090] Updated weights for policy 1, policy_version 575995 (0.0008) [2023-12-26 04:13:01,739][123091] Updated weights for policy 0, policy_version 580009 (0.0008) [2023-12-26 04:13:02,480][123090] Updated weights for policy 1, policy_version 576005 (0.0006) [2023-12-26 04:13:02,548][123090] Updated weights for policy 1, policy_version 576015 (0.0006) [2023-12-26 04:13:02,614][123090] Updated weights for policy 1, policy_version 576025 (0.0010) [2023-12-26 04:13:02,620][123091] Updated weights for policy 0, policy_version 580019 (0.0009) [2023-12-26 04:13:02,682][123091] Updated weights for policy 0, policy_version 580029 (0.0008) [2023-12-26 04:13:02,750][123091] Updated weights for policy 0, policy_version 580039 (0.0009) [2023-12-26 04:13:03,265][123090] Updated weights for policy 1, policy_version 576035 (0.0009) [2023-12-26 04:13:03,326][123090] Updated weights for policy 1, policy_version 576045 (0.0005) [2023-12-26 04:13:03,385][123090] Updated weights for policy 1, policy_version 576055 (0.0005) [2023-12-26 04:13:03,672][123091] Updated weights for policy 0, policy_version 580049 (0.0010) [2023-12-26 04:13:03,731][123091] Updated weights for policy 0, policy_version 580059 (0.0009) [2023-12-26 04:13:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 295968768. Throughput: 0: 8772.2, 1: 9072.9. Samples: 295984252. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:03,785][121949] Avg episode reward: [(0, '6195.841'), (1, '5629.349')] [2023-12-26 04:13:03,786][123091] Updated weights for policy 0, policy_version 580069 (0.0009) [2023-12-26 04:13:03,853][123091] Updated weights for policy 0, policy_version 580079 (0.0008) [2023-12-26 04:13:04,047][123090] Updated weights for policy 1, policy_version 576065 (0.0006) [2023-12-26 04:13:04,118][123090] Updated weights for policy 1, policy_version 576075 (0.0011) [2023-12-26 04:13:04,190][123090] Updated weights for policy 1, policy_version 576085 (0.0011) [2023-12-26 04:13:04,262][123090] Updated weights for policy 1, policy_version 576095 (0.0011) [2023-12-26 04:13:04,654][123091] Updated weights for policy 0, policy_version 580089 (0.0010) [2023-12-26 04:13:04,722][123091] Updated weights for policy 0, policy_version 580099 (0.0009) [2023-12-26 04:13:04,784][123091] Updated weights for policy 0, policy_version 580109 (0.0009) [2023-12-26 04:13:05,053][123090] Updated weights for policy 1, policy_version 576105 (0.0006) [2023-12-26 04:13:05,118][123090] Updated weights for policy 1, policy_version 576115 (0.0009) [2023-12-26 04:13:05,184][123090] Updated weights for policy 1, policy_version 576125 (0.0010) [2023-12-26 04:13:05,625][123091] Updated weights for policy 0, policy_version 580119 (0.0009) [2023-12-26 04:13:05,677][123091] Updated weights for policy 0, policy_version 580129 (0.0009) [2023-12-26 04:13:05,728][123091] Updated weights for policy 0, policy_version 580139 (0.0008) [2023-12-26 04:13:05,988][123090] Updated weights for policy 1, policy_version 576135 (0.0010) [2023-12-26 04:13:06,039][123090] Updated weights for policy 1, policy_version 576145 (0.0010) [2023-12-26 04:13:06,091][123090] Updated weights for policy 1, policy_version 576155 (0.0010) [2023-12-26 04:13:06,640][123091] Updated weights for policy 0, policy_version 580149 (0.0009) [2023-12-26 04:13:06,706][123091] Updated weights for policy 0, policy_version 580159 (0.0009) [2023-12-26 04:13:06,768][123091] Updated weights for policy 0, policy_version 580169 (0.0009) [2023-12-26 04:13:06,894][123090] Updated weights for policy 1, policy_version 576165 (0.0010) [2023-12-26 04:13:06,946][123090] Updated weights for policy 1, policy_version 576175 (0.0010) [2023-12-26 04:13:06,994][123090] Updated weights for policy 1, policy_version 576185 (0.0010) [2023-12-26 04:13:07,665][123091] Updated weights for policy 0, policy_version 580179 (0.0010) [2023-12-26 04:13:07,724][123091] Updated weights for policy 0, policy_version 580189 (0.0009) [2023-12-26 04:13:07,730][123090] Updated weights for policy 1, policy_version 576195 (0.0010) [2023-12-26 04:13:07,780][123091] Updated weights for policy 0, policy_version 580199 (0.0006) [2023-12-26 04:13:07,781][123090] Updated weights for policy 1, policy_version 576205 (0.0010) [2023-12-26 04:13:07,829][123090] Updated weights for policy 1, policy_version 576215 (0.0010) [2023-12-26 04:13:08,541][123090] Updated weights for policy 1, policy_version 576225 (0.0009) [2023-12-26 04:13:08,599][123090] Updated weights for policy 1, policy_version 576235 (0.0006) [2023-12-26 04:13:08,651][123090] Updated weights for policy 1, policy_version 576245 (0.0005) [2023-12-26 04:13:08,702][123091] Updated weights for policy 0, policy_version 580209 (0.0006) [2023-12-26 04:13:08,706][123090] Updated weights for policy 1, policy_version 576255 (0.0005) [2023-12-26 04:13:08,754][123091] Updated weights for policy 0, policy_version 580219 (0.0010) [2023-12-26 04:13:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 296058880. Throughput: 0: 8769.3, 1: 9107.7. Samples: 296035528. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:08,785][121949] Avg episode reward: [(0, '6137.639'), (1, '5545.755')] [2023-12-26 04:13:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000576256_147521536.pth... [2023-12-26 04:13:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000575168_147243008.pth [2023-12-26 04:13:08,808][123091] Updated weights for policy 0, policy_version 580230 (0.0010) [2023-12-26 04:13:08,860][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000580240_148545536.pth... [2023-12-26 04:13:08,862][123091] Updated weights for policy 0, policy_version 580240 (0.0010) [2023-12-26 04:13:08,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000579216_148283392.pth [2023-12-26 04:13:09,340][123090] Updated weights for policy 1, policy_version 576265 (0.0010) [2023-12-26 04:13:09,421][123090] Updated weights for policy 1, policy_version 576275 (0.0011) [2023-12-26 04:13:09,483][123090] Updated weights for policy 1, policy_version 576285 (0.0011) [2023-12-26 04:13:09,773][123091] Updated weights for policy 0, policy_version 580250 (0.0009) [2023-12-26 04:13:09,829][123091] Updated weights for policy 0, policy_version 580260 (0.0009) [2023-12-26 04:13:09,892][123091] Updated weights for policy 0, policy_version 580270 (0.0010) [2023-12-26 04:13:10,346][123090] Updated weights for policy 1, policy_version 576295 (0.0011) [2023-12-26 04:13:10,413][123090] Updated weights for policy 1, policy_version 576305 (0.0011) [2023-12-26 04:13:10,478][123090] Updated weights for policy 1, policy_version 576315 (0.0011) [2023-12-26 04:13:10,722][123091] Updated weights for policy 0, policy_version 580280 (0.0010) [2023-12-26 04:13:10,782][123091] Updated weights for policy 0, policy_version 580292 (0.0011) [2023-12-26 04:13:10,839][123091] Updated weights for policy 0, policy_version 580302 (0.0009) [2023-12-26 04:13:11,206][123090] Updated weights for policy 1, policy_version 576325 (0.0008) [2023-12-26 04:13:11,272][123090] Updated weights for policy 1, policy_version 576335 (0.0006) [2023-12-26 04:13:11,337][123090] Updated weights for policy 1, policy_version 576345 (0.0006) [2023-12-26 04:13:11,776][123091] Updated weights for policy 0, policy_version 580312 (0.0009) [2023-12-26 04:13:11,839][123091] Updated weights for policy 0, policy_version 580322 (0.0009) [2023-12-26 04:13:11,892][123091] Updated weights for policy 0, policy_version 580332 (0.0010) [2023-12-26 04:13:12,048][123090] Updated weights for policy 1, policy_version 576355 (0.0006) [2023-12-26 04:13:12,109][123090] Updated weights for policy 1, policy_version 576365 (0.0005) [2023-12-26 04:13:12,180][123090] Updated weights for policy 1, policy_version 576375 (0.0005) [2023-12-26 04:13:12,776][123091] Updated weights for policy 0, policy_version 580342 (0.0010) [2023-12-26 04:13:12,833][123091] Updated weights for policy 0, policy_version 580352 (0.0009) [2023-12-26 04:13:12,893][123090] Updated weights for policy 1, policy_version 576385 (0.0005) [2023-12-26 04:13:12,894][123091] Updated weights for policy 0, policy_version 580362 (0.0009) [2023-12-26 04:13:12,947][123090] Updated weights for policy 1, policy_version 576395 (0.0006) [2023-12-26 04:13:13,002][123090] Updated weights for policy 1, policy_version 576405 (0.0005) [2023-12-26 04:13:13,065][123090] Updated weights for policy 1, policy_version 576415 (0.0005) [2023-12-26 04:13:13,776][123091] Updated weights for policy 0, policy_version 580372 (0.0009) [2023-12-26 04:13:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 296140800. Throughput: 0: 8642.4, 1: 9192.2. Samples: 296139436. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:13,785][121949] Avg episode reward: [(0, '6270.013'), (1, '5661.998')] [2023-12-26 04:13:13,808][123090] Updated weights for policy 1, policy_version 576425 (0.0010) [2023-12-26 04:13:13,824][123091] Updated weights for policy 0, policy_version 580382 (0.0005) [2023-12-26 04:13:13,852][123090] Updated weights for policy 1, policy_version 576435 (0.0010) [2023-12-26 04:13:13,873][123091] Updated weights for policy 0, policy_version 580392 (0.0006) [2023-12-26 04:13:13,904][123090] Updated weights for policy 1, policy_version 576445 (0.0010) [2023-12-26 04:13:14,735][123091] Updated weights for policy 0, policy_version 580402 (0.0009) [2023-12-26 04:13:14,765][123090] Updated weights for policy 1, policy_version 576455 (0.0010) [2023-12-26 04:13:14,802][123091] Updated weights for policy 0, policy_version 580412 (0.0008) [2023-12-26 04:13:14,835][123090] Updated weights for policy 1, policy_version 576465 (0.0006) [2023-12-26 04:13:14,871][123091] Updated weights for policy 0, policy_version 580422 (0.0007) [2023-12-26 04:13:14,905][123090] Updated weights for policy 1, policy_version 576475 (0.0006) [2023-12-26 04:13:14,930][123091] Updated weights for policy 0, policy_version 580432 (0.0007) [2023-12-26 04:13:15,674][123090] Updated weights for policy 1, policy_version 576485 (0.0007) [2023-12-26 04:13:15,741][123090] Updated weights for policy 1, policy_version 576495 (0.0010) [2023-12-26 04:13:15,749][123091] Updated weights for policy 0, policy_version 580442 (0.0007) [2023-12-26 04:13:15,799][123090] Updated weights for policy 1, policy_version 576505 (0.0010) [2023-12-26 04:13:15,805][123091] Updated weights for policy 0, policy_version 580452 (0.0008) [2023-12-26 04:13:15,865][123091] Updated weights for policy 0, policy_version 580462 (0.0008) [2023-12-26 04:13:16,553][123090] Updated weights for policy 1, policy_version 576515 (0.0007) [2023-12-26 04:13:16,616][123090] Updated weights for policy 1, policy_version 576525 (0.0009) [2023-12-26 04:13:16,679][123090] Updated weights for policy 1, policy_version 576535 (0.0009) [2023-12-26 04:13:16,735][123091] Updated weights for policy 0, policy_version 580472 (0.0010) [2023-12-26 04:13:16,795][123091] Updated weights for policy 0, policy_version 580482 (0.0010) [2023-12-26 04:13:16,853][123091] Updated weights for policy 0, policy_version 580492 (0.0010) [2023-12-26 04:13:17,514][123090] Updated weights for policy 1, policy_version 576545 (0.0008) [2023-12-26 04:13:17,579][123090] Updated weights for policy 1, policy_version 576555 (0.0009) [2023-12-26 04:13:17,636][123090] Updated weights for policy 1, policy_version 576565 (0.0009) [2023-12-26 04:13:17,644][123091] Updated weights for policy 0, policy_version 580502 (0.0008) [2023-12-26 04:13:17,687][123090] Updated weights for policy 1, policy_version 576575 (0.0008) [2023-12-26 04:13:17,700][123091] Updated weights for policy 0, policy_version 580512 (0.0007) [2023-12-26 04:13:17,757][123091] Updated weights for policy 0, policy_version 580522 (0.0006) [2023-12-26 04:13:18,440][123091] Updated weights for policy 0, policy_version 580532 (0.0006) [2023-12-26 04:13:18,497][123091] Updated weights for policy 0, policy_version 580542 (0.0007) [2023-12-26 04:13:18,558][123091] Updated weights for policy 0, policy_version 580552 (0.0010) [2023-12-26 04:13:18,580][123090] Updated weights for policy 1, policy_version 576585 (0.0008) [2023-12-26 04:13:18,647][123090] Updated weights for policy 1, policy_version 576595 (0.0009) [2023-12-26 04:13:18,714][123090] Updated weights for policy 1, policy_version 576605 (0.0009) [2023-12-26 04:13:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 296239104. Throughput: 0: 8594.3, 1: 9189.6. Samples: 296244392. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:18,785][121949] Avg episode reward: [(0, '6194.862'), (1, '5463.828')] [2023-12-26 04:13:19,303][123091] Updated weights for policy 0, policy_version 580562 (0.0009) [2023-12-26 04:13:19,365][123091] Updated weights for policy 0, policy_version 580572 (0.0009) [2023-12-26 04:13:19,432][123091] Updated weights for policy 0, policy_version 580582 (0.0010) [2023-12-26 04:13:19,487][123091] Updated weights for policy 0, policy_version 580592 (0.0010) [2023-12-26 04:13:19,507][123090] Updated weights for policy 1, policy_version 576615 (0.0008) [2023-12-26 04:13:19,571][123090] Updated weights for policy 1, policy_version 576626 (0.0009) [2023-12-26 04:13:19,622][123090] Updated weights for policy 1, policy_version 576636 (0.0009) [2023-12-26 04:13:20,331][123091] Updated weights for policy 0, policy_version 580602 (0.0007) [2023-12-26 04:13:20,401][123091] Updated weights for policy 0, policy_version 580612 (0.0005) [2023-12-26 04:13:20,472][123091] Updated weights for policy 0, policy_version 580622 (0.0005) [2023-12-26 04:13:20,517][123090] Updated weights for policy 1, policy_version 576646 (0.0010) [2023-12-26 04:13:20,575][123090] Updated weights for policy 1, policy_version 576656 (0.0010) [2023-12-26 04:13:20,642][123090] Updated weights for policy 1, policy_version 576666 (0.0010) [2023-12-26 04:13:21,189][123091] Updated weights for policy 0, policy_version 580632 (0.0008) [2023-12-26 04:13:21,248][123091] Updated weights for policy 0, policy_version 580642 (0.0008) [2023-12-26 04:13:21,311][123091] Updated weights for policy 0, policy_version 580652 (0.0008) [2023-12-26 04:13:21,520][123090] Updated weights for policy 1, policy_version 576676 (0.0009) [2023-12-26 04:13:21,587][123090] Updated weights for policy 1, policy_version 576686 (0.0009) [2023-12-26 04:13:21,652][123090] Updated weights for policy 1, policy_version 576696 (0.0010) [2023-12-26 04:13:22,067][123091] Updated weights for policy 0, policy_version 580662 (0.0007) [2023-12-26 04:13:22,127][123091] Updated weights for policy 0, policy_version 580672 (0.0005) [2023-12-26 04:13:22,197][123091] Updated weights for policy 0, policy_version 580682 (0.0011) [2023-12-26 04:13:22,567][123090] Updated weights for policy 1, policy_version 576706 (0.0010) [2023-12-26 04:13:22,616][123090] Updated weights for policy 1, policy_version 576716 (0.0009) [2023-12-26 04:13:22,679][123090] Updated weights for policy 1, policy_version 576726 (0.0009) [2023-12-26 04:13:22,739][123090] Updated weights for policy 1, policy_version 576736 (0.0009) [2023-12-26 04:13:23,014][123091] Updated weights for policy 0, policy_version 580692 (0.0010) [2023-12-26 04:13:23,066][123091] Updated weights for policy 0, policy_version 580702 (0.0011) [2023-12-26 04:13:23,114][123091] Updated weights for policy 0, policy_version 580712 (0.0010) [2023-12-26 04:13:23,617][123090] Updated weights for policy 1, policy_version 576746 (0.0009) [2023-12-26 04:13:23,669][123090] Updated weights for policy 1, policy_version 576756 (0.0009) [2023-12-26 04:13:23,731][123090] Updated weights for policy 1, policy_version 576766 (0.0008) [2023-12-26 04:13:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 296321024. Throughput: 0: 8570.8, 1: 9099.5. Samples: 296295756. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:23,785][121949] Avg episode reward: [(0, '6217.976'), (1, '5226.360')] [2023-12-26 04:13:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000580720_148668416.pth... [2023-12-26 04:13:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000576768_147652608.pth... [2023-12-26 04:13:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000575712_147382272.pth [2023-12-26 04:13:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000579728_148414464.pth [2023-12-26 04:13:23,962][123091] Updated weights for policy 0, policy_version 580722 (0.0011) [2023-12-26 04:13:24,025][123091] Updated weights for policy 0, policy_version 580732 (0.0011) [2023-12-26 04:13:24,091][123091] Updated weights for policy 0, policy_version 580742 (0.0011) [2023-12-26 04:13:24,158][123091] Updated weights for policy 0, policy_version 580752 (0.0011) [2023-12-26 04:13:24,564][123090] Updated weights for policy 1, policy_version 576776 (0.0009) [2023-12-26 04:13:24,613][123090] Updated weights for policy 1, policy_version 576787 (0.0009) [2023-12-26 04:13:24,665][123090] Updated weights for policy 1, policy_version 576797 (0.0009) [2023-12-26 04:13:24,968][123091] Updated weights for policy 0, policy_version 580762 (0.0011) [2023-12-26 04:13:25,020][123091] Updated weights for policy 0, policy_version 580772 (0.0011) [2023-12-26 04:13:25,090][123091] Updated weights for policy 0, policy_version 580782 (0.0011) [2023-12-26 04:13:25,476][123090] Updated weights for policy 1, policy_version 576807 (0.0006) [2023-12-26 04:13:25,540][123090] Updated weights for policy 1, policy_version 576817 (0.0005) [2023-12-26 04:13:25,604][123090] Updated weights for policy 1, policy_version 576827 (0.0007) [2023-12-26 04:13:25,910][123091] Updated weights for policy 0, policy_version 580792 (0.0011) [2023-12-26 04:13:25,977][123091] Updated weights for policy 0, policy_version 580802 (0.0011) [2023-12-26 04:13:26,043][123091] Updated weights for policy 0, policy_version 580812 (0.0011) [2023-12-26 04:13:26,347][123090] Updated weights for policy 1, policy_version 576837 (0.0009) [2023-12-26 04:13:26,404][123090] Updated weights for policy 1, policy_version 576847 (0.0009) [2023-12-26 04:13:26,464][123090] Updated weights for policy 1, policy_version 576857 (0.0009) [2023-12-26 04:13:26,867][123091] Updated weights for policy 0, policy_version 580822 (0.0011) [2023-12-26 04:13:26,930][123091] Updated weights for policy 0, policy_version 580832 (0.0011) [2023-12-26 04:13:26,996][123091] Updated weights for policy 0, policy_version 580842 (0.0010) [2023-12-26 04:13:27,298][123090] Updated weights for policy 1, policy_version 576867 (0.0009) [2023-12-26 04:13:27,360][123090] Updated weights for policy 1, policy_version 576877 (0.0009) [2023-12-26 04:13:27,408][123090] Updated weights for policy 1, policy_version 576887 (0.0008) [2023-12-26 04:13:27,758][123091] Updated weights for policy 0, policy_version 580852 (0.0011) [2023-12-26 04:13:27,812][123091] Updated weights for policy 0, policy_version 580862 (0.0010) [2023-12-26 04:13:27,876][123091] Updated weights for policy 0, policy_version 580872 (0.0010) [2023-12-26 04:13:28,270][123090] Updated weights for policy 1, policy_version 576897 (0.0009) [2023-12-26 04:13:28,326][123090] Updated weights for policy 1, policy_version 576908 (0.0010) [2023-12-26 04:13:28,389][123090] Updated weights for policy 1, policy_version 576918 (0.0010) [2023-12-26 04:13:28,460][123090] Updated weights for policy 1, policy_version 576928 (0.0010) [2023-12-26 04:13:28,598][123091] Updated weights for policy 0, policy_version 580882 (0.0009) [2023-12-26 04:13:28,654][123091] Updated weights for policy 0, policy_version 580892 (0.0010) [2023-12-26 04:13:28,714][123091] Updated weights for policy 0, policy_version 580902 (0.0009) [2023-12-26 04:13:28,779][123091] Updated weights for policy 0, policy_version 580912 (0.0007) [2023-12-26 04:13:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 296411136. Throughput: 0: 8620.9, 1: 9035.7. Samples: 296399152. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:28,784][121949] Avg episode reward: [(0, '6343.388'), (1, '5298.467')] [2023-12-26 04:13:29,335][123090] Updated weights for policy 1, policy_version 576938 (0.0009) [2023-12-26 04:13:29,396][123090] Updated weights for policy 1, policy_version 576948 (0.0009) [2023-12-26 04:13:29,448][123090] Updated weights for policy 1, policy_version 576958 (0.0006) [2023-12-26 04:13:29,461][123091] Updated weights for policy 0, policy_version 580922 (0.0008) [2023-12-26 04:13:29,524][123091] Updated weights for policy 0, policy_version 580932 (0.0010) [2023-12-26 04:13:29,590][123091] Updated weights for policy 0, policy_version 580942 (0.0009) [2023-12-26 04:13:30,232][123090] Updated weights for policy 1, policy_version 576968 (0.0010) [2023-12-26 04:13:30,281][123090] Updated weights for policy 1, policy_version 576978 (0.0010) [2023-12-26 04:13:30,340][123090] Updated weights for policy 1, policy_version 576988 (0.0010) [2023-12-26 04:13:30,443][123091] Updated weights for policy 0, policy_version 580952 (0.0009) [2023-12-26 04:13:30,506][123091] Updated weights for policy 0, policy_version 580962 (0.0009) [2023-12-26 04:13:30,573][123091] Updated weights for policy 0, policy_version 580972 (0.0008) [2023-12-26 04:13:31,092][123090] Updated weights for policy 1, policy_version 576998 (0.0008) [2023-12-26 04:13:31,162][123090] Updated weights for policy 1, policy_version 577008 (0.0010) [2023-12-26 04:13:31,214][123090] Updated weights for policy 1, policy_version 577018 (0.0010) [2023-12-26 04:13:31,306][123091] Updated weights for policy 0, policy_version 580982 (0.0008) [2023-12-26 04:13:31,375][123091] Updated weights for policy 0, policy_version 580992 (0.0010) [2023-12-26 04:13:31,429][123091] Updated weights for policy 0, policy_version 581002 (0.0010) [2023-12-26 04:13:31,988][123090] Updated weights for policy 1, policy_version 577028 (0.0008) [2023-12-26 04:13:32,036][123090] Updated weights for policy 1, policy_version 577038 (0.0008) [2023-12-26 04:13:32,087][123090] Updated weights for policy 1, policy_version 577048 (0.0009) [2023-12-26 04:13:32,343][123091] Updated weights for policy 0, policy_version 581012 (0.0010) [2023-12-26 04:13:32,404][123091] Updated weights for policy 0, policy_version 581022 (0.0010) [2023-12-26 04:13:32,466][123091] Updated weights for policy 0, policy_version 581032 (0.0010) [2023-12-26 04:13:32,837][123090] Updated weights for policy 1, policy_version 577058 (0.0008) [2023-12-26 04:13:32,905][123090] Updated weights for policy 1, policy_version 577068 (0.0005) [2023-12-26 04:13:32,953][123090] Updated weights for policy 1, policy_version 577078 (0.0005) [2023-12-26 04:13:32,999][123090] Updated weights for policy 1, policy_version 577088 (0.0006) [2023-12-26 04:13:33,269][123091] Updated weights for policy 0, policy_version 581042 (0.0008) [2023-12-26 04:13:33,322][123091] Updated weights for policy 0, policy_version 581052 (0.0005) [2023-12-26 04:13:33,376][123091] Updated weights for policy 0, policy_version 581062 (0.0005) [2023-12-26 04:13:33,427][123091] Updated weights for policy 0, policy_version 581072 (0.0005) [2023-12-26 04:13:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 296493056. Throughput: 0: 8632.2, 1: 8935.7. Samples: 296506896. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:33,785][121949] Avg episode reward: [(0, '6098.984'), (1, '5487.530')] [2023-12-26 04:13:33,821][123090] Updated weights for policy 1, policy_version 577098 (0.0009) [2023-12-26 04:13:33,882][123090] Updated weights for policy 1, policy_version 577108 (0.0009) [2023-12-26 04:13:33,942][123090] Updated weights for policy 1, policy_version 577118 (0.0009) [2023-12-26 04:13:34,020][123091] Updated weights for policy 0, policy_version 581082 (0.0005) [2023-12-26 04:13:34,083][123091] Updated weights for policy 0, policy_version 581092 (0.0005) [2023-12-26 04:13:34,156][123091] Updated weights for policy 0, policy_version 581102 (0.0007) [2023-12-26 04:13:34,873][123090] Updated weights for policy 1, policy_version 577128 (0.0008) [2023-12-26 04:13:34,890][123091] Updated weights for policy 0, policy_version 581112 (0.0010) [2023-12-26 04:13:34,940][123090] Updated weights for policy 1, policy_version 577138 (0.0007) [2023-12-26 04:13:34,973][123091] Updated weights for policy 0, policy_version 581122 (0.0011) [2023-12-26 04:13:35,005][123090] Updated weights for policy 1, policy_version 577148 (0.0007) [2023-12-26 04:13:35,029][123091] Updated weights for policy 0, policy_version 581132 (0.0009) [2023-12-26 04:13:35,585][123091] Updated weights for policy 0, policy_version 581142 (0.0006) [2023-12-26 04:13:35,630][123091] Updated weights for policy 0, policy_version 581152 (0.0005) [2023-12-26 04:13:35,679][123091] Updated weights for policy 0, policy_version 581162 (0.0005) [2023-12-26 04:13:35,831][123090] Updated weights for policy 1, policy_version 577158 (0.0007) [2023-12-26 04:13:35,898][123090] Updated weights for policy 1, policy_version 577168 (0.0006) [2023-12-26 04:13:35,962][123090] Updated weights for policy 1, policy_version 577178 (0.0011) [2023-12-26 04:13:36,406][123091] Updated weights for policy 0, policy_version 581172 (0.0007) [2023-12-26 04:13:36,475][123091] Updated weights for policy 0, policy_version 581182 (0.0011) [2023-12-26 04:13:36,546][123091] Updated weights for policy 0, policy_version 581192 (0.0011) [2023-12-26 04:13:36,727][123090] Updated weights for policy 1, policy_version 577188 (0.0009) [2023-12-26 04:13:36,781][123090] Updated weights for policy 1, policy_version 577198 (0.0010) [2023-12-26 04:13:36,836][123090] Updated weights for policy 1, policy_version 577208 (0.0010) [2023-12-26 04:13:37,285][123091] Updated weights for policy 0, policy_version 581202 (0.0010) [2023-12-26 04:13:37,341][123091] Updated weights for policy 0, policy_version 581212 (0.0005) [2023-12-26 04:13:37,410][123091] Updated weights for policy 0, policy_version 581222 (0.0005) [2023-12-26 04:13:37,476][123091] Updated weights for policy 0, policy_version 581232 (0.0005) [2023-12-26 04:13:37,624][123090] Updated weights for policy 1, policy_version 577218 (0.0009) [2023-12-26 04:13:37,703][123090] Updated weights for policy 1, policy_version 577228 (0.0006) [2023-12-26 04:13:37,778][123090] Updated weights for policy 1, policy_version 577238 (0.0008) [2023-12-26 04:13:37,834][123090] Updated weights for policy 1, policy_version 577248 (0.0010) [2023-12-26 04:13:38,150][123091] Updated weights for policy 0, policy_version 581242 (0.0011) [2023-12-26 04:13:38,219][123091] Updated weights for policy 0, policy_version 581252 (0.0011) [2023-12-26 04:13:38,279][123091] Updated weights for policy 0, policy_version 581262 (0.0011) [2023-12-26 04:13:38,617][123090] Updated weights for policy 1, policy_version 577258 (0.0007) [2023-12-26 04:13:38,677][123090] Updated weights for policy 1, policy_version 577268 (0.0008) [2023-12-26 04:13:38,744][123090] Updated weights for policy 1, policy_version 577278 (0.0011) [2023-12-26 04:13:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 296591360. Throughput: 0: 8731.7, 1: 8867.1. Samples: 296562248. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:38,785][121949] Avg episode reward: [(0, '6087.891'), (1, '5620.628')] [2023-12-26 04:13:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000577280_147783680.pth... [2023-12-26 04:13:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000581264_148807680.pth... [2023-12-26 04:13:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000576256_147521536.pth [2023-12-26 04:13:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000580240_148545536.pth [2023-12-26 04:13:39,103][123091] Updated weights for policy 0, policy_version 581272 (0.0011) [2023-12-26 04:13:39,170][123091] Updated weights for policy 0, policy_version 581282 (0.0011) [2023-12-26 04:13:39,241][123091] Updated weights for policy 0, policy_version 581292 (0.0011) [2023-12-26 04:13:39,586][123090] Updated weights for policy 1, policy_version 577288 (0.0011) [2023-12-26 04:13:39,651][123090] Updated weights for policy 1, policy_version 577298 (0.0010) [2023-12-26 04:13:39,718][123090] Updated weights for policy 1, policy_version 577308 (0.0010) [2023-12-26 04:13:40,079][123091] Updated weights for policy 0, policy_version 581302 (0.0012) [2023-12-26 04:13:40,138][123091] Updated weights for policy 0, policy_version 581312 (0.0010) [2023-12-26 04:13:40,201][123091] Updated weights for policy 0, policy_version 581322 (0.0011) [2023-12-26 04:13:40,538][123090] Updated weights for policy 1, policy_version 577318 (0.0010) [2023-12-26 04:13:40,597][123090] Updated weights for policy 1, policy_version 577328 (0.0010) [2023-12-26 04:13:40,650][123090] Updated weights for policy 1, policy_version 577338 (0.0010) [2023-12-26 04:13:41,022][123091] Updated weights for policy 0, policy_version 581332 (0.0009) [2023-12-26 04:13:41,090][123091] Updated weights for policy 0, policy_version 581342 (0.0007) [2023-12-26 04:13:41,161][123091] Updated weights for policy 0, policy_version 581352 (0.0008) [2023-12-26 04:13:41,558][123090] Updated weights for policy 1, policy_version 577348 (0.0010) [2023-12-26 04:13:41,629][123090] Updated weights for policy 1, policy_version 577358 (0.0009) [2023-12-26 04:13:41,701][123090] Updated weights for policy 1, policy_version 577368 (0.0009) [2023-12-26 04:13:42,013][123091] Updated weights for policy 0, policy_version 581362 (0.0009) [2023-12-26 04:13:42,065][123091] Updated weights for policy 0, policy_version 581372 (0.0011) [2023-12-26 04:13:42,118][123091] Updated weights for policy 0, policy_version 581382 (0.0011) [2023-12-26 04:13:42,173][123091] Updated weights for policy 0, policy_version 581392 (0.0010) [2023-12-26 04:13:42,524][123090] Updated weights for policy 1, policy_version 577378 (0.0008) [2023-12-26 04:13:42,590][123090] Updated weights for policy 1, policy_version 577388 (0.0007) [2023-12-26 04:13:42,661][123090] Updated weights for policy 1, policy_version 577398 (0.0008) [2023-12-26 04:13:42,728][123090] Updated weights for policy 1, policy_version 577408 (0.0009) [2023-12-26 04:13:43,023][123091] Updated weights for policy 0, policy_version 581402 (0.0011) [2023-12-26 04:13:43,074][123091] Updated weights for policy 0, policy_version 581412 (0.0010) [2023-12-26 04:13:43,130][123091] Updated weights for policy 0, policy_version 581422 (0.0010) [2023-12-26 04:13:43,477][123090] Updated weights for policy 1, policy_version 577418 (0.0010) [2023-12-26 04:13:43,536][123090] Updated weights for policy 1, policy_version 577428 (0.0010) [2023-12-26 04:13:43,595][123090] Updated weights for policy 1, policy_version 577438 (0.0010) [2023-12-26 04:13:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 296673280. Throughput: 0: 8677.6, 1: 8836.8. Samples: 296666556. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:43,785][121949] Avg episode reward: [(0, '6244.642'), (1, '5684.641')] [2023-12-26 04:13:43,904][123091] Updated weights for policy 0, policy_version 581432 (0.0010) [2023-12-26 04:13:43,951][123091] Updated weights for policy 0, policy_version 581442 (0.0010) [2023-12-26 04:13:44,009][123091] Updated weights for policy 0, policy_version 581452 (0.0010) [2023-12-26 04:13:44,395][123090] Updated weights for policy 1, policy_version 577448 (0.0009) [2023-12-26 04:13:44,455][123090] Updated weights for policy 1, policy_version 577458 (0.0009) [2023-12-26 04:13:44,508][123090] Updated weights for policy 1, policy_version 577468 (0.0009) [2023-12-26 04:13:44,842][123091] Updated weights for policy 0, policy_version 581462 (0.0009) [2023-12-26 04:13:44,902][123091] Updated weights for policy 0, policy_version 581472 (0.0011) [2023-12-26 04:13:44,947][123091] Updated weights for policy 0, policy_version 581482 (0.0011) [2023-12-26 04:13:45,380][123090] Updated weights for policy 1, policy_version 577478 (0.0009) [2023-12-26 04:13:45,446][123090] Updated weights for policy 1, policy_version 577488 (0.0010) [2023-12-26 04:13:45,505][123090] Updated weights for policy 1, policy_version 577498 (0.0010) [2023-12-26 04:13:45,621][123091] Updated weights for policy 0, policy_version 581492 (0.0009) [2023-12-26 04:13:45,678][123091] Updated weights for policy 0, policy_version 581502 (0.0005) [2023-12-26 04:13:45,737][123091] Updated weights for policy 0, policy_version 581512 (0.0005) [2023-12-26 04:13:46,405][123091] Updated weights for policy 0, policy_version 581522 (0.0005) [2023-12-26 04:13:46,452][123090] Updated weights for policy 1, policy_version 577508 (0.0009) [2023-12-26 04:13:46,463][123091] Updated weights for policy 0, policy_version 581532 (0.0005) [2023-12-26 04:13:46,504][123090] Updated weights for policy 1, policy_version 577518 (0.0009) [2023-12-26 04:13:46,517][123091] Updated weights for policy 0, policy_version 581542 (0.0008) [2023-12-26 04:13:46,561][123090] Updated weights for policy 1, policy_version 577528 (0.0010) [2023-12-26 04:13:46,577][123091] Updated weights for policy 0, policy_version 581552 (0.0011) [2023-12-26 04:13:47,330][123091] Updated weights for policy 0, policy_version 581562 (0.0007) [2023-12-26 04:13:47,353][123090] Updated weights for policy 1, policy_version 577538 (0.0009) [2023-12-26 04:13:47,395][123091] Updated weights for policy 0, policy_version 581572 (0.0008) [2023-12-26 04:13:47,408][123090] Updated weights for policy 1, policy_version 577548 (0.0009) [2023-12-26 04:13:47,463][123091] Updated weights for policy 0, policy_version 581582 (0.0007) [2023-12-26 04:13:47,475][123090] Updated weights for policy 1, policy_version 577558 (0.0008) [2023-12-26 04:13:47,530][123090] Updated weights for policy 1, policy_version 577568 (0.0009) [2023-12-26 04:13:48,147][123091] Updated weights for policy 0, policy_version 581592 (0.0006) [2023-12-26 04:13:48,212][123091] Updated weights for policy 0, policy_version 581602 (0.0005) [2023-12-26 04:13:48,280][123091] Updated weights for policy 0, policy_version 581612 (0.0007) [2023-12-26 04:13:48,446][123090] Updated weights for policy 1, policy_version 577578 (0.0009) [2023-12-26 04:13:48,503][123090] Updated weights for policy 1, policy_version 577588 (0.0009) [2023-12-26 04:13:48,551][123090] Updated weights for policy 1, policy_version 577598 (0.0008) [2023-12-26 04:13:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 296763392. Throughput: 0: 8861.6, 1: 8686.4. Samples: 296773908. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:48,784][121949] Avg episode reward: [(0, '6234.690'), (1, '5393.233')] [2023-12-26 04:13:49,052][123091] Updated weights for policy 0, policy_version 581622 (0.0010) [2023-12-26 04:13:49,115][123091] Updated weights for policy 0, policy_version 581632 (0.0011) [2023-12-26 04:13:49,173][123091] Updated weights for policy 0, policy_version 581642 (0.0010) [2023-12-26 04:13:49,429][123090] Updated weights for policy 1, policy_version 577608 (0.0009) [2023-12-26 04:13:49,497][123090] Updated weights for policy 1, policy_version 577618 (0.0009) [2023-12-26 04:13:49,559][123090] Updated weights for policy 1, policy_version 577628 (0.0009) [2023-12-26 04:13:49,993][123091] Updated weights for policy 0, policy_version 581652 (0.0009) [2023-12-26 04:13:50,059][123091] Updated weights for policy 0, policy_version 581662 (0.0008) [2023-12-26 04:13:50,115][123091] Updated weights for policy 0, policy_version 581672 (0.0009) [2023-12-26 04:13:50,356][123090] Updated weights for policy 1, policy_version 577638 (0.0009) [2023-12-26 04:13:50,418][123090] Updated weights for policy 1, policy_version 577648 (0.0007) [2023-12-26 04:13:50,484][123090] Updated weights for policy 1, policy_version 577658 (0.0007) [2023-12-26 04:13:50,980][123091] Updated weights for policy 0, policy_version 581682 (0.0009) [2023-12-26 04:13:51,040][123091] Updated weights for policy 0, policy_version 581692 (0.0009) [2023-12-26 04:13:51,114][123091] Updated weights for policy 0, policy_version 581702 (0.0008) [2023-12-26 04:13:51,178][123091] Updated weights for policy 0, policy_version 581712 (0.0009) [2023-12-26 04:13:51,282][123090] Updated weights for policy 1, policy_version 577668 (0.0007) [2023-12-26 04:13:51,335][123090] Updated weights for policy 1, policy_version 577678 (0.0008) [2023-12-26 04:13:51,402][123090] Updated weights for policy 1, policy_version 577688 (0.0008) [2023-12-26 04:13:52,072][123091] Updated weights for policy 0, policy_version 581722 (0.0010) [2023-12-26 04:13:52,136][123091] Updated weights for policy 0, policy_version 581732 (0.0010) [2023-12-26 04:13:52,195][123091] Updated weights for policy 0, policy_version 581742 (0.0011) [2023-12-26 04:13:52,211][123090] Updated weights for policy 1, policy_version 577698 (0.0009) [2023-12-26 04:13:52,271][123090] Updated weights for policy 1, policy_version 577708 (0.0008) [2023-12-26 04:13:52,334][123090] Updated weights for policy 1, policy_version 577718 (0.0006) [2023-12-26 04:13:52,399][123090] Updated weights for policy 1, policy_version 577728 (0.0007) [2023-12-26 04:13:53,020][123091] Updated weights for policy 0, policy_version 581752 (0.0010) [2023-12-26 04:13:53,074][123091] Updated weights for policy 0, policy_version 581762 (0.0009) [2023-12-26 04:13:53,127][123091] Updated weights for policy 0, policy_version 581772 (0.0010) [2023-12-26 04:13:53,199][123090] Updated weights for policy 1, policy_version 577738 (0.0007) [2023-12-26 04:13:53,267][123090] Updated weights for policy 1, policy_version 577748 (0.0005) [2023-12-26 04:13:53,325][123090] Updated weights for policy 1, policy_version 577758 (0.0005) [2023-12-26 04:13:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 296845312. Throughput: 0: 8847.1, 1: 8669.6. Samples: 296823780. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:53,785][121949] Avg episode reward: [(0, '6088.284'), (1, '5257.722')] [2023-12-26 04:13:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000577760_147906560.pth... [2023-12-26 04:13:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000581776_148938752.pth... [2023-12-26 04:13:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000576768_147652608.pth [2023-12-26 04:13:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000580720_148668416.pth [2023-12-26 04:13:53,796][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000577760_147906560.pth [2023-12-26 04:13:53,796][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000581776_148938752.pth [2023-12-26 04:13:53,959][123091] Updated weights for policy 0, policy_version 581782 (0.0010) [2023-12-26 04:13:54,006][123090] Updated weights for policy 1, policy_version 577768 (0.0008) [2023-12-26 04:13:54,019][123091] Updated weights for policy 0, policy_version 581792 (0.0010) [2023-12-26 04:13:54,065][123090] Updated weights for policy 1, policy_version 577778 (0.0006) [2023-12-26 04:13:54,069][123091] Updated weights for policy 0, policy_version 581802 (0.0006) [2023-12-26 04:13:54,131][123090] Updated weights for policy 1, policy_version 577788 (0.0006) [2023-12-26 04:13:54,800][123091] Updated weights for policy 0, policy_version 581812 (0.0008) [2023-12-26 04:13:54,856][123090] Updated weights for policy 1, policy_version 577798 (0.0008) [2023-12-26 04:13:54,858][123091] Updated weights for policy 0, policy_version 581822 (0.0007) [2023-12-26 04:13:54,912][123090] Updated weights for policy 1, policy_version 577808 (0.0009) [2023-12-26 04:13:54,925][123091] Updated weights for policy 0, policy_version 581832 (0.0007) [2023-12-26 04:13:54,982][123090] Updated weights for policy 1, policy_version 577818 (0.0009) [2023-12-26 04:13:55,695][123091] Updated weights for policy 0, policy_version 581842 (0.0006) [2023-12-26 04:13:55,741][123090] Updated weights for policy 1, policy_version 577828 (0.0009) [2023-12-26 04:13:55,763][123091] Updated weights for policy 0, policy_version 581852 (0.0005) [2023-12-26 04:13:55,802][123090] Updated weights for policy 1, policy_version 577838 (0.0008) [2023-12-26 04:13:55,838][123091] Updated weights for policy 0, policy_version 581862 (0.0005) [2023-12-26 04:13:55,859][123090] Updated weights for policy 1, policy_version 577848 (0.0005) [2023-12-26 04:13:55,904][123091] Updated weights for policy 0, policy_version 581872 (0.0005) [2023-12-26 04:13:56,524][123090] Updated weights for policy 1, policy_version 577858 (0.0005) [2023-12-26 04:13:56,560][123091] Updated weights for policy 0, policy_version 581882 (0.0005) [2023-12-26 04:13:56,575][123090] Updated weights for policy 1, policy_version 577868 (0.0005) [2023-12-26 04:13:56,617][123091] Updated weights for policy 0, policy_version 581892 (0.0005) [2023-12-26 04:13:56,627][123090] Updated weights for policy 1, policy_version 577878 (0.0006) [2023-12-26 04:13:56,671][123091] Updated weights for policy 0, policy_version 581902 (0.0005) [2023-12-26 04:13:56,677][123090] Updated weights for policy 1, policy_version 577888 (0.0005) [2023-12-26 04:13:57,425][123090] Updated weights for policy 1, policy_version 577898 (0.0006) [2023-12-26 04:13:57,454][123091] Updated weights for policy 0, policy_version 581912 (0.0010) [2023-12-26 04:13:57,489][123090] Updated weights for policy 1, policy_version 577908 (0.0007) [2023-12-26 04:13:57,510][123091] Updated weights for policy 0, policy_version 581922 (0.0011) [2023-12-26 04:13:57,555][123090] Updated weights for policy 1, policy_version 577918 (0.0005) [2023-12-26 04:13:57,566][123091] Updated weights for policy 0, policy_version 581932 (0.0011) [2023-12-26 04:13:58,258][123090] Updated weights for policy 1, policy_version 577928 (0.0007) [2023-12-26 04:13:58,287][123091] Updated weights for policy 0, policy_version 581942 (0.0009) [2023-12-26 04:13:58,318][123090] Updated weights for policy 1, policy_version 577938 (0.0008) [2023-12-26 04:13:58,381][123091] Updated weights for policy 0, policy_version 581952 (0.0009) [2023-12-26 04:13:58,388][123090] Updated weights for policy 1, policy_version 577948 (0.0008) [2023-12-26 04:13:58,447][123091] Updated weights for policy 0, policy_version 581962 (0.0008) [2023-12-26 04:13:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 296943616. Throughput: 0: 8982.3, 1: 8682.8. Samples: 296934368. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:13:58,785][121949] Avg episode reward: [(0, '6046.245'), (1, '5378.090')] [2023-12-26 04:13:59,260][123091] Updated weights for policy 0, policy_version 581972 (0.0007) [2023-12-26 04:13:59,293][123090] Updated weights for policy 1, policy_version 577958 (0.0008) [2023-12-26 04:13:59,330][123091] Updated weights for policy 0, policy_version 581982 (0.0009) [2023-12-26 04:13:59,364][123090] Updated weights for policy 1, policy_version 577968 (0.0009) [2023-12-26 04:13:59,397][123091] Updated weights for policy 0, policy_version 581992 (0.0007) [2023-12-26 04:13:59,423][123090] Updated weights for policy 1, policy_version 577978 (0.0008) [2023-12-26 04:14:00,211][123091] Updated weights for policy 0, policy_version 582002 (0.0005) [2023-12-26 04:14:00,282][123091] Updated weights for policy 0, policy_version 582012 (0.0006) [2023-12-26 04:14:00,298][123090] Updated weights for policy 1, policy_version 577988 (0.0009) [2023-12-26 04:14:00,344][123091] Updated weights for policy 0, policy_version 582022 (0.0007) [2023-12-26 04:14:00,364][123090] Updated weights for policy 1, policy_version 577998 (0.0008) [2023-12-26 04:14:00,401][123091] Updated weights for policy 0, policy_version 582032 (0.0008) [2023-12-26 04:14:00,422][123090] Updated weights for policy 1, policy_version 578008 (0.0008) [2023-12-26 04:14:01,173][123090] Updated weights for policy 1, policy_version 578018 (0.0009) [2023-12-26 04:14:01,192][123091] Updated weights for policy 0, policy_version 582042 (0.0009) [2023-12-26 04:14:01,234][123090] Updated weights for policy 1, policy_version 578028 (0.0007) [2023-12-26 04:14:01,253][123091] Updated weights for policy 0, policy_version 582052 (0.0009) [2023-12-26 04:14:01,299][123090] Updated weights for policy 1, policy_version 578038 (0.0009) [2023-12-26 04:14:01,306][123091] Updated weights for policy 0, policy_version 582062 (0.0007) [2023-12-26 04:14:01,370][123090] Updated weights for policy 1, policy_version 578048 (0.0009) [2023-12-26 04:14:02,179][123091] Updated weights for policy 0, policy_version 582072 (0.0008) [2023-12-26 04:14:02,196][123090] Updated weights for policy 1, policy_version 578058 (0.0007) [2023-12-26 04:14:02,226][123091] Updated weights for policy 0, policy_version 582082 (0.0008) [2023-12-26 04:14:02,260][123090] Updated weights for policy 1, policy_version 578068 (0.0009) [2023-12-26 04:14:02,293][123091] Updated weights for policy 0, policy_version 582092 (0.0009) [2023-12-26 04:14:02,321][123090] Updated weights for policy 1, policy_version 578078 (0.0008) [2023-12-26 04:14:03,129][123091] Updated weights for policy 0, policy_version 582102 (0.0009) [2023-12-26 04:14:03,185][123090] Updated weights for policy 1, policy_version 578088 (0.0007) [2023-12-26 04:14:03,196][123091] Updated weights for policy 0, policy_version 582112 (0.0008) [2023-12-26 04:14:03,258][123090] Updated weights for policy 1, policy_version 578098 (0.0005) [2023-12-26 04:14:03,262][123091] Updated weights for policy 0, policy_version 582122 (0.0009) [2023-12-26 04:14:03,319][123090] Updated weights for policy 1, policy_version 578108 (0.0005) [2023-12-26 04:14:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 297025536. Throughput: 0: 9003.0, 1: 8651.7. Samples: 297038856. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:03,785][121949] Avg episode reward: [(0, '6185.836'), (1, '5464.611')] [2023-12-26 04:14:03,952][123090] Updated weights for policy 1, policy_version 578118 (0.0008) [2023-12-26 04:14:04,024][123090] Updated weights for policy 1, policy_version 578128 (0.0009) [2023-12-26 04:14:04,033][123091] Updated weights for policy 0, policy_version 582132 (0.0010) [2023-12-26 04:14:04,092][123090] Updated weights for policy 1, policy_version 578138 (0.0005) [2023-12-26 04:14:04,100][123091] Updated weights for policy 0, policy_version 582142 (0.0010) [2023-12-26 04:14:04,164][123091] Updated weights for policy 0, policy_version 582152 (0.0011) [2023-12-26 04:14:04,828][123090] Updated weights for policy 1, policy_version 578148 (0.0007) [2023-12-26 04:14:04,882][123090] Updated weights for policy 1, policy_version 578158 (0.0009) [2023-12-26 04:14:04,937][123090] Updated weights for policy 1, policy_version 578168 (0.0009) [2023-12-26 04:14:04,973][123091] Updated weights for policy 0, policy_version 582162 (0.0010) [2023-12-26 04:14:05,034][123091] Updated weights for policy 0, policy_version 582172 (0.0009) [2023-12-26 04:14:05,106][123091] Updated weights for policy 0, policy_version 582182 (0.0009) [2023-12-26 04:14:05,162][123091] Updated weights for policy 0, policy_version 582192 (0.0009) [2023-12-26 04:14:05,809][123090] Updated weights for policy 1, policy_version 578178 (0.0010) [2023-12-26 04:14:05,879][123090] Updated weights for policy 1, policy_version 578188 (0.0011) [2023-12-26 04:14:05,945][123090] Updated weights for policy 1, policy_version 578198 (0.0010) [2023-12-26 04:14:05,992][123091] Updated weights for policy 0, policy_version 582202 (0.0005) [2023-12-26 04:14:06,000][123090] Updated weights for policy 1, policy_version 578208 (0.0010) [2023-12-26 04:14:06,045][123091] Updated weights for policy 0, policy_version 582212 (0.0005) [2023-12-26 04:14:06,122][123091] Updated weights for policy 0, policy_version 582224 (0.0007) [2023-12-26 04:14:06,805][123090] Updated weights for policy 1, policy_version 578218 (0.0011) [2023-12-26 04:14:06,853][123091] Updated weights for policy 0, policy_version 582234 (0.0007) [2023-12-26 04:14:06,873][123090] Updated weights for policy 1, policy_version 578228 (0.0011) [2023-12-26 04:14:06,918][123091] Updated weights for policy 0, policy_version 582244 (0.0008) [2023-12-26 04:14:06,946][123090] Updated weights for policy 1, policy_version 578238 (0.0010) [2023-12-26 04:14:06,986][123091] Updated weights for policy 0, policy_version 582254 (0.0009) [2023-12-26 04:14:07,701][123090] Updated weights for policy 1, policy_version 578248 (0.0007) [2023-12-26 04:14:07,763][123091] Updated weights for policy 0, policy_version 582264 (0.0011) [2023-12-26 04:14:07,767][123090] Updated weights for policy 1, policy_version 578258 (0.0011) [2023-12-26 04:14:07,832][123091] Updated weights for policy 0, policy_version 582274 (0.0011) [2023-12-26 04:14:07,836][123090] Updated weights for policy 1, policy_version 578268 (0.0011) [2023-12-26 04:14:07,895][123091] Updated weights for policy 0, policy_version 582284 (0.0011) [2023-12-26 04:14:08,517][123090] Updated weights for policy 1, policy_version 578278 (0.0011) [2023-12-26 04:14:08,577][123090] Updated weights for policy 1, policy_version 578288 (0.0011) [2023-12-26 04:14:08,640][123090] Updated weights for policy 1, policy_version 578298 (0.0011) [2023-12-26 04:14:08,746][123091] Updated weights for policy 0, policy_version 582294 (0.0011) [2023-12-26 04:14:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 297115648. Throughput: 0: 8986.3, 1: 8705.9. Samples: 297091904. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:08,785][121949] Avg episode reward: [(0, '6202.831'), (1, '5651.858')] [2023-12-26 04:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000578304_148045824.pth... [2023-12-26 04:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000577280_147783680.pth [2023-12-26 04:14:08,801][123091] Updated weights for policy 0, policy_version 582304 (0.0010) [2023-12-26 04:14:08,853][123091] Updated weights for policy 0, policy_version 582314 (0.0011) [2023-12-26 04:14:08,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000582320_149078016.pth... [2023-12-26 04:14:08,888][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000581264_148807680.pth [2023-12-26 04:14:09,484][123090] Updated weights for policy 1, policy_version 578308 (0.0009) [2023-12-26 04:14:09,537][123090] Updated weights for policy 1, policy_version 578318 (0.0006) [2023-12-26 04:14:09,598][123091] Updated weights for policy 0, policy_version 582324 (0.0010) [2023-12-26 04:14:09,610][123090] Updated weights for policy 1, policy_version 578328 (0.0006) [2023-12-26 04:14:09,665][123091] Updated weights for policy 0, policy_version 582334 (0.0008) [2023-12-26 04:14:09,731][123091] Updated weights for policy 0, policy_version 582344 (0.0008) [2023-12-26 04:14:10,437][123090] Updated weights for policy 1, policy_version 578338 (0.0009) [2023-12-26 04:14:10,510][123090] Updated weights for policy 1, policy_version 578348 (0.0009) [2023-12-26 04:14:10,559][123091] Updated weights for policy 0, policy_version 582354 (0.0009) [2023-12-26 04:14:10,576][123090] Updated weights for policy 1, policy_version 578358 (0.0008) [2023-12-26 04:14:10,621][123091] Updated weights for policy 0, policy_version 582364 (0.0010) [2023-12-26 04:14:10,638][123090] Updated weights for policy 1, policy_version 578368 (0.0007) [2023-12-26 04:14:10,684][123091] Updated weights for policy 0, policy_version 582374 (0.0009) [2023-12-26 04:14:10,752][123091] Updated weights for policy 0, policy_version 582384 (0.0009) [2023-12-26 04:14:11,407][123090] Updated weights for policy 1, policy_version 578378 (0.0008) [2023-12-26 04:14:11,460][123090] Updated weights for policy 1, policy_version 578388 (0.0009) [2023-12-26 04:14:11,507][123090] Updated weights for policy 1, policy_version 578398 (0.0009) [2023-12-26 04:14:11,681][123091] Updated weights for policy 0, policy_version 582394 (0.0008) [2023-12-26 04:14:11,753][123091] Updated weights for policy 0, policy_version 582404 (0.0008) [2023-12-26 04:14:11,819][123091] Updated weights for policy 0, policy_version 582414 (0.0008) [2023-12-26 04:14:12,417][123090] Updated weights for policy 1, policy_version 578408 (0.0009) [2023-12-26 04:14:12,467][123090] Updated weights for policy 1, policy_version 578418 (0.0009) [2023-12-26 04:14:12,519][123090] Updated weights for policy 1, policy_version 578428 (0.0010) [2023-12-26 04:14:12,618][123091] Updated weights for policy 0, policy_version 582424 (0.0009) [2023-12-26 04:14:12,671][123091] Updated weights for policy 0, policy_version 582434 (0.0010) [2023-12-26 04:14:12,716][123091] Updated weights for policy 0, policy_version 582444 (0.0011) [2023-12-26 04:14:13,371][123090] Updated weights for policy 1, policy_version 578438 (0.0007) [2023-12-26 04:14:13,436][123090] Updated weights for policy 1, policy_version 578448 (0.0010) [2023-12-26 04:14:13,488][123090] Updated weights for policy 1, policy_version 578458 (0.0007) [2023-12-26 04:14:13,584][123091] Updated weights for policy 0, policy_version 582454 (0.0011) [2023-12-26 04:14:13,643][123091] Updated weights for policy 0, policy_version 582464 (0.0009) [2023-12-26 04:14:13,688][123091] Updated weights for policy 0, policy_version 582474 (0.0005) [2023-12-26 04:14:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 297205760. Throughput: 0: 8966.3, 1: 8718.1. Samples: 297194952. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:13,784][121949] Avg episode reward: [(0, '6127.764'), (1, '5683.320')] [2023-12-26 04:14:14,184][123090] Updated weights for policy 1, policy_version 578468 (0.0005) [2023-12-26 04:14:14,230][123090] Updated weights for policy 1, policy_version 578478 (0.0005) [2023-12-26 04:14:14,277][123090] Updated weights for policy 1, policy_version 578488 (0.0005) [2023-12-26 04:14:14,494][123091] Updated weights for policy 0, policy_version 582484 (0.0007) [2023-12-26 04:14:14,561][123091] Updated weights for policy 0, policy_version 582494 (0.0011) [2023-12-26 04:14:14,638][123091] Updated weights for policy 0, policy_version 582504 (0.0011) [2023-12-26 04:14:14,986][123090] Updated weights for policy 1, policy_version 578498 (0.0005) [2023-12-26 04:14:15,046][123090] Updated weights for policy 1, policy_version 578508 (0.0007) [2023-12-26 04:14:15,100][123090] Updated weights for policy 1, policy_version 578518 (0.0008) [2023-12-26 04:14:15,158][123090] Updated weights for policy 1, policy_version 578528 (0.0008) [2023-12-26 04:14:15,394][123091] Updated weights for policy 0, policy_version 582514 (0.0011) [2023-12-26 04:14:15,453][123091] Updated weights for policy 0, policy_version 582524 (0.0010) [2023-12-26 04:14:15,500][123091] Updated weights for policy 0, policy_version 582534 (0.0010) [2023-12-26 04:14:15,552][123091] Updated weights for policy 0, policy_version 582544 (0.0010) [2023-12-26 04:14:15,916][123090] Updated weights for policy 1, policy_version 578538 (0.0005) [2023-12-26 04:14:15,972][123090] Updated weights for policy 1, policy_version 578548 (0.0006) [2023-12-26 04:14:16,028][123090] Updated weights for policy 1, policy_version 578558 (0.0006) [2023-12-26 04:14:16,289][123091] Updated weights for policy 0, policy_version 582554 (0.0010) [2023-12-26 04:14:16,352][123091] Updated weights for policy 0, policy_version 582564 (0.0009) [2023-12-26 04:14:16,414][123091] Updated weights for policy 0, policy_version 582574 (0.0010) [2023-12-26 04:14:16,747][123090] Updated weights for policy 1, policy_version 578568 (0.0006) [2023-12-26 04:14:16,801][123090] Updated weights for policy 1, policy_version 578578 (0.0008) [2023-12-26 04:14:16,865][123090] Updated weights for policy 1, policy_version 578588 (0.0005) [2023-12-26 04:14:17,165][123091] Updated weights for policy 0, policy_version 582584 (0.0006) [2023-12-26 04:14:17,227][123091] Updated weights for policy 0, policy_version 582594 (0.0007) [2023-12-26 04:14:17,282][123091] Updated weights for policy 0, policy_version 582604 (0.0010) [2023-12-26 04:14:17,549][123090] Updated weights for policy 1, policy_version 578598 (0.0005) [2023-12-26 04:14:17,617][123090] Updated weights for policy 1, policy_version 578608 (0.0007) [2023-12-26 04:14:17,668][123090] Updated weights for policy 1, policy_version 578618 (0.0010) [2023-12-26 04:14:18,101][123091] Updated weights for policy 0, policy_version 582614 (0.0007) [2023-12-26 04:14:18,163][123091] Updated weights for policy 0, policy_version 582624 (0.0010) [2023-12-26 04:14:18,228][123091] Updated weights for policy 0, policy_version 582634 (0.0009) [2023-12-26 04:14:18,359][123090] Updated weights for policy 1, policy_version 578628 (0.0009) [2023-12-26 04:14:18,428][123090] Updated weights for policy 1, policy_version 578638 (0.0010) [2023-12-26 04:14:18,494][123090] Updated weights for policy 1, policy_version 578648 (0.0010) [2023-12-26 04:14:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 297295872. Throughput: 0: 8934.7, 1: 8837.6. Samples: 297306648. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:18,785][121949] Avg episode reward: [(0, '6055.561'), (1, '5605.939')] [2023-12-26 04:14:19,102][123091] Updated weights for policy 0, policy_version 582644 (0.0009) [2023-12-26 04:14:19,168][123091] Updated weights for policy 0, policy_version 582654 (0.0010) [2023-12-26 04:14:19,232][123091] Updated weights for policy 0, policy_version 582664 (0.0009) [2023-12-26 04:14:19,252][123090] Updated weights for policy 1, policy_version 578658 (0.0009) [2023-12-26 04:14:19,307][123090] Updated weights for policy 1, policy_version 578668 (0.0006) [2023-12-26 04:14:19,381][123090] Updated weights for policy 1, policy_version 578678 (0.0008) [2023-12-26 04:14:19,446][123090] Updated weights for policy 1, policy_version 578688 (0.0007) [2023-12-26 04:14:20,074][123091] Updated weights for policy 0, policy_version 582674 (0.0008) [2023-12-26 04:14:20,147][123091] Updated weights for policy 0, policy_version 582684 (0.0010) [2023-12-26 04:14:20,215][123091] Updated weights for policy 0, policy_version 582694 (0.0010) [2023-12-26 04:14:20,245][123090] Updated weights for policy 1, policy_version 578698 (0.0008) [2023-12-26 04:14:20,275][123091] Updated weights for policy 0, policy_version 582704 (0.0008) [2023-12-26 04:14:20,316][123090] Updated weights for policy 1, policy_version 578708 (0.0010) [2023-12-26 04:14:20,382][123090] Updated weights for policy 1, policy_version 578718 (0.0010) [2023-12-26 04:14:21,088][123091] Updated weights for policy 0, policy_version 582714 (0.0008) [2023-12-26 04:14:21,161][123091] Updated weights for policy 0, policy_version 582724 (0.0007) [2023-12-26 04:14:21,211][123090] Updated weights for policy 1, policy_version 578728 (0.0008) [2023-12-26 04:14:21,232][123091] Updated weights for policy 0, policy_version 582734 (0.0008) [2023-12-26 04:14:21,279][123090] Updated weights for policy 1, policy_version 578738 (0.0008) [2023-12-26 04:14:21,352][123090] Updated weights for policy 1, policy_version 578748 (0.0009) [2023-12-26 04:14:22,000][123091] Updated weights for policy 0, policy_version 582744 (0.0009) [2023-12-26 04:14:22,062][123091] Updated weights for policy 0, policy_version 582754 (0.0010) [2023-12-26 04:14:22,112][123091] Updated weights for policy 0, policy_version 582764 (0.0009) [2023-12-26 04:14:22,179][123090] Updated weights for policy 1, policy_version 578758 (0.0010) [2023-12-26 04:14:22,230][123090] Updated weights for policy 1, policy_version 578768 (0.0009) [2023-12-26 04:14:22,295][123090] Updated weights for policy 1, policy_version 578778 (0.0010) [2023-12-26 04:14:23,010][123091] Updated weights for policy 0, policy_version 582774 (0.0010) [2023-12-26 04:14:23,060][123091] Updated weights for policy 0, policy_version 582784 (0.0009) [2023-12-26 04:14:23,111][123091] Updated weights for policy 0, policy_version 582795 (0.0010) [2023-12-26 04:14:23,113][123090] Updated weights for policy 1, policy_version 578788 (0.0008) [2023-12-26 04:14:23,179][123090] Updated weights for policy 1, policy_version 578798 (0.0008) [2023-12-26 04:14:23,241][123090] Updated weights for policy 1, policy_version 578808 (0.0009) [2023-12-26 04:14:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 297377792. Throughput: 0: 8831.4, 1: 8851.0. Samples: 297357952. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:23,785][121949] Avg episode reward: [(0, '6072.439'), (1, '5643.771')] [2023-12-26 04:14:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000582800_149200896.pth... [2023-12-26 04:14:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000578816_148176896.pth... [2023-12-26 04:14:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000581776_148938752.pth [2023-12-26 04:14:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000577760_147906560.pth [2023-12-26 04:14:23,956][123091] Updated weights for policy 0, policy_version 582805 (0.0009) [2023-12-26 04:14:24,008][123091] Updated weights for policy 0, policy_version 582815 (0.0009) [2023-12-26 04:14:24,047][123090] Updated weights for policy 1, policy_version 578818 (0.0009) [2023-12-26 04:14:24,065][123091] Updated weights for policy 0, policy_version 582825 (0.0005) [2023-12-26 04:14:24,101][123090] Updated weights for policy 1, policy_version 578828 (0.0008) [2023-12-26 04:14:24,173][123090] Updated weights for policy 1, policy_version 578838 (0.0005) [2023-12-26 04:14:24,234][123090] Updated weights for policy 1, policy_version 578848 (0.0010) [2023-12-26 04:14:24,804][123091] Updated weights for policy 0, policy_version 582835 (0.0005) [2023-12-26 04:14:24,850][123091] Updated weights for policy 0, policy_version 582845 (0.0005) [2023-12-26 04:14:24,897][123091] Updated weights for policy 0, policy_version 582855 (0.0006) [2023-12-26 04:14:25,020][123090] Updated weights for policy 1, policy_version 578858 (0.0006) [2023-12-26 04:14:25,095][123090] Updated weights for policy 1, policy_version 578868 (0.0005) [2023-12-26 04:14:25,150][123090] Updated weights for policy 1, policy_version 578878 (0.0006) [2023-12-26 04:14:25,605][123091] Updated weights for policy 0, policy_version 582865 (0.0005) [2023-12-26 04:14:25,682][123091] Updated weights for policy 0, policy_version 582875 (0.0005) [2023-12-26 04:14:25,741][123090] Updated weights for policy 1, policy_version 578888 (0.0005) [2023-12-26 04:14:25,749][123091] Updated weights for policy 0, policy_version 582885 (0.0006) [2023-12-26 04:14:25,796][123090] Updated weights for policy 1, policy_version 578898 (0.0008) [2023-12-26 04:14:25,805][123091] Updated weights for policy 0, policy_version 582895 (0.0005) [2023-12-26 04:14:25,845][123090] Updated weights for policy 1, policy_version 578908 (0.0011) [2023-12-26 04:14:26,566][123091] Updated weights for policy 0, policy_version 582905 (0.0010) [2023-12-26 04:14:26,624][123091] Updated weights for policy 0, policy_version 582915 (0.0010) [2023-12-26 04:14:26,660][123090] Updated weights for policy 1, policy_version 578918 (0.0009) [2023-12-26 04:14:26,690][123091] Updated weights for policy 0, policy_version 582925 (0.0010) [2023-12-26 04:14:26,726][123090] Updated weights for policy 1, policy_version 578928 (0.0007) [2023-12-26 04:14:26,796][123090] Updated weights for policy 1, policy_version 578938 (0.0008) [2023-12-26 04:14:27,502][123091] Updated weights for policy 0, policy_version 582935 (0.0011) [2023-12-26 04:14:27,557][123091] Updated weights for policy 0, policy_version 582945 (0.0010) [2023-12-26 04:14:27,591][123090] Updated weights for policy 1, policy_version 578948 (0.0008) [2023-12-26 04:14:27,613][123091] Updated weights for policy 0, policy_version 582955 (0.0010) [2023-12-26 04:14:27,645][123090] Updated weights for policy 1, policy_version 578958 (0.0006) [2023-12-26 04:14:27,699][123090] Updated weights for policy 1, policy_version 578968 (0.0009) [2023-12-26 04:14:28,450][123091] Updated weights for policy 0, policy_version 582965 (0.0010) [2023-12-26 04:14:28,505][123091] Updated weights for policy 0, policy_version 582975 (0.0009) [2023-12-26 04:14:28,527][123090] Updated weights for policy 1, policy_version 578978 (0.0009) [2023-12-26 04:14:28,557][123091] Updated weights for policy 0, policy_version 582985 (0.0008) [2023-12-26 04:14:28,589][123090] Updated weights for policy 1, policy_version 578988 (0.0009) [2023-12-26 04:14:28,642][123090] Updated weights for policy 1, policy_version 578998 (0.0009) [2023-12-26 04:14:28,701][123090] Updated weights for policy 1, policy_version 579008 (0.0010) [2023-12-26 04:14:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 297476096. Throughput: 0: 8839.1, 1: 8920.3. Samples: 297465732. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:28,785][121949] Avg episode reward: [(0, '6070.208'), (1, '5417.864')] [2023-12-26 04:14:29,183][123091] Updated weights for policy 0, policy_version 582995 (0.0005) [2023-12-26 04:14:29,239][123091] Updated weights for policy 0, policy_version 583005 (0.0007) [2023-12-26 04:14:29,301][123091] Updated weights for policy 0, policy_version 583015 (0.0006) [2023-12-26 04:14:29,602][123090] Updated weights for policy 1, policy_version 579018 (0.0009) [2023-12-26 04:14:29,669][123090] Updated weights for policy 1, policy_version 579028 (0.0008) [2023-12-26 04:14:29,733][123090] Updated weights for policy 1, policy_version 579038 (0.0009) [2023-12-26 04:14:30,086][123091] Updated weights for policy 0, policy_version 583025 (0.0009) [2023-12-26 04:14:30,151][123091] Updated weights for policy 0, policy_version 583035 (0.0010) [2023-12-26 04:14:30,218][123091] Updated weights for policy 0, policy_version 583045 (0.0008) [2023-12-26 04:14:30,282][123091] Updated weights for policy 0, policy_version 583055 (0.0009) [2023-12-26 04:14:30,576][123090] Updated weights for policy 1, policy_version 579048 (0.0009) [2023-12-26 04:14:30,636][123090] Updated weights for policy 1, policy_version 579058 (0.0009) [2023-12-26 04:14:30,694][123090] Updated weights for policy 1, policy_version 579068 (0.0010) [2023-12-26 04:14:31,066][123091] Updated weights for policy 0, policy_version 583065 (0.0007) [2023-12-26 04:14:31,137][123091] Updated weights for policy 0, policy_version 583075 (0.0006) [2023-12-26 04:14:31,192][123091] Updated weights for policy 0, policy_version 583085 (0.0007) [2023-12-26 04:14:31,541][123090] Updated weights for policy 1, policy_version 579078 (0.0007) [2023-12-26 04:14:31,608][123090] Updated weights for policy 1, policy_version 579088 (0.0009) [2023-12-26 04:14:31,670][123090] Updated weights for policy 1, policy_version 579098 (0.0010) [2023-12-26 04:14:31,895][123091] Updated weights for policy 0, policy_version 583095 (0.0007) [2023-12-26 04:14:31,954][123091] Updated weights for policy 0, policy_version 583105 (0.0006) [2023-12-26 04:14:32,015][123091] Updated weights for policy 0, policy_version 583115 (0.0005) [2023-12-26 04:14:32,526][123090] Updated weights for policy 1, policy_version 579108 (0.0010) [2023-12-26 04:14:32,578][123090] Updated weights for policy 1, policy_version 579118 (0.0009) [2023-12-26 04:14:32,634][123090] Updated weights for policy 1, policy_version 579128 (0.0009) [2023-12-26 04:14:32,743][123091] Updated weights for policy 0, policy_version 583125 (0.0008) [2023-12-26 04:14:32,806][123091] Updated weights for policy 0, policy_version 583135 (0.0009) [2023-12-26 04:14:32,872][123091] Updated weights for policy 0, policy_version 583145 (0.0010) [2023-12-26 04:14:33,491][123090] Updated weights for policy 1, policy_version 579139 (0.0009) [2023-12-26 04:14:33,545][123090] Updated weights for policy 1, policy_version 579149 (0.0009) [2023-12-26 04:14:33,604][123090] Updated weights for policy 1, policy_version 579159 (0.0010) [2023-12-26 04:14:33,687][123091] Updated weights for policy 0, policy_version 583155 (0.0010) [2023-12-26 04:14:33,748][123091] Updated weights for policy 0, policy_version 583165 (0.0009) [2023-12-26 04:14:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 297558016. Throughput: 0: 8799.5, 1: 8900.0. Samples: 297570388. Policy #0 lag: (min: 15.0, avg: 20.0, max: 47.0) [2023-12-26 04:14:33,785][121949] Avg episode reward: [(0, '6159.704'), (1, '5278.869')] [2023-12-26 04:14:33,796][123091] Updated weights for policy 0, policy_version 583175 (0.0009) [2023-12-26 04:14:34,458][123090] Updated weights for policy 1, policy_version 579169 (0.0009) [2023-12-26 04:14:34,530][123090] Updated weights for policy 1, policy_version 579179 (0.0010) [2023-12-26 04:14:34,591][123090] Updated weights for policy 1, policy_version 579189 (0.0009) [2023-12-26 04:14:34,617][123091] Updated weights for policy 0, policy_version 583185 (0.0009) [2023-12-26 04:14:34,653][123090] Updated weights for policy 1, policy_version 579199 (0.0008) [2023-12-26 04:14:34,674][123091] Updated weights for policy 0, policy_version 583195 (0.0007) [2023-12-26 04:14:34,732][123091] Updated weights for policy 0, policy_version 583205 (0.0009) [2023-12-26 04:14:34,795][123091] Updated weights for policy 0, policy_version 583215 (0.0010) [2023-12-26 04:14:35,475][123090] Updated weights for policy 1, policy_version 579209 (0.0010) [2023-12-26 04:14:35,540][123090] Updated weights for policy 1, policy_version 579219 (0.0008) [2023-12-26 04:14:35,554][123091] Updated weights for policy 0, policy_version 583225 (0.0008) [2023-12-26 04:14:35,595][123090] Updated weights for policy 1, policy_version 579229 (0.0006) [2023-12-26 04:14:35,628][123091] Updated weights for policy 0, policy_version 583235 (0.0009) [2023-12-26 04:14:35,698][123091] Updated weights for policy 0, policy_version 583245 (0.0011) [2023-12-26 04:14:36,350][123090] Updated weights for policy 1, policy_version 579239 (0.0009) [2023-12-26 04:14:36,415][123090] Updated weights for policy 1, policy_version 579249 (0.0010) [2023-12-26 04:14:36,481][123090] Updated weights for policy 1, policy_version 579259 (0.0010) [2023-12-26 04:14:36,511][123091] Updated weights for policy 0, policy_version 583255 (0.0009) [2023-12-26 04:14:36,580][123091] Updated weights for policy 0, policy_version 583265 (0.0009) [2023-12-26 04:14:36,633][123091] Updated weights for policy 0, policy_version 583275 (0.0009) [2023-12-26 04:14:37,310][123090] Updated weights for policy 1, policy_version 579269 (0.0010) [2023-12-26 04:14:37,373][123090] Updated weights for policy 1, policy_version 579279 (0.0010) [2023-12-26 04:14:37,439][123090] Updated weights for policy 1, policy_version 579289 (0.0010) [2023-12-26 04:14:37,450][123091] Updated weights for policy 0, policy_version 583285 (0.0007) [2023-12-26 04:14:37,511][123091] Updated weights for policy 0, policy_version 583295 (0.0007) [2023-12-26 04:14:37,567][123091] Updated weights for policy 0, policy_version 583305 (0.0010) [2023-12-26 04:14:38,297][123090] Updated weights for policy 1, policy_version 579299 (0.0008) [2023-12-26 04:14:38,350][123091] Updated weights for policy 0, policy_version 583315 (0.0009) [2023-12-26 04:14:38,361][123090] Updated weights for policy 1, policy_version 579309 (0.0009) [2023-12-26 04:14:38,417][123091] Updated weights for policy 0, policy_version 583325 (0.0011) [2023-12-26 04:14:38,430][123090] Updated weights for policy 1, policy_version 579319 (0.0010) [2023-12-26 04:14:38,480][123091] Updated weights for policy 0, policy_version 583335 (0.0011) [2023-12-26 04:14:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 297648128. Throughput: 0: 8843.8, 1: 8897.6. Samples: 297622144. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:14:38,785][121949] Avg episode reward: [(0, '6186.962'), (1, '5348.777')] [2023-12-26 04:14:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000579328_148307968.pth... [2023-12-26 04:14:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000583344_149340160.pth... [2023-12-26 04:14:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000578304_148045824.pth [2023-12-26 04:14:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000582320_149078016.pth [2023-12-26 04:14:39,289][123090] Updated weights for policy 1, policy_version 579329 (0.0008) [2023-12-26 04:14:39,300][123091] Updated weights for policy 0, policy_version 583345 (0.0010) [2023-12-26 04:14:39,357][123090] Updated weights for policy 1, policy_version 579339 (0.0008) [2023-12-26 04:14:39,376][123091] Updated weights for policy 0, policy_version 583355 (0.0008) [2023-12-26 04:14:39,424][123090] Updated weights for policy 1, policy_version 579349 (0.0010) [2023-12-26 04:14:39,445][123091] Updated weights for policy 0, policy_version 583365 (0.0008) [2023-12-26 04:14:39,480][123090] Updated weights for policy 1, policy_version 579359 (0.0007) [2023-12-26 04:14:39,509][123091] Updated weights for policy 0, policy_version 583375 (0.0009) [2023-12-26 04:14:40,329][123090] Updated weights for policy 1, policy_version 579369 (0.0008) [2023-12-26 04:14:40,338][123091] Updated weights for policy 0, policy_version 583385 (0.0009) [2023-12-26 04:14:40,396][123090] Updated weights for policy 1, policy_version 579379 (0.0009) [2023-12-26 04:14:40,406][123091] Updated weights for policy 0, policy_version 583395 (0.0009) [2023-12-26 04:14:40,468][123090] Updated weights for policy 1, policy_version 579389 (0.0007) [2023-12-26 04:14:40,475][123091] Updated weights for policy 0, policy_version 583405 (0.0009) [2023-12-26 04:14:41,216][123090] Updated weights for policy 1, policy_version 579399 (0.0008) [2023-12-26 04:14:41,276][123091] Updated weights for policy 0, policy_version 583415 (0.0008) [2023-12-26 04:14:41,283][123090] Updated weights for policy 1, policy_version 579409 (0.0008) [2023-12-26 04:14:41,343][123091] Updated weights for policy 0, policy_version 583425 (0.0006) [2023-12-26 04:14:41,348][123090] Updated weights for policy 1, policy_version 579419 (0.0010) [2023-12-26 04:14:41,410][123091] Updated weights for policy 0, policy_version 583435 (0.0009) [2023-12-26 04:14:42,191][123091] Updated weights for policy 0, policy_version 583445 (0.0009) [2023-12-26 04:14:42,271][123091] Updated weights for policy 0, policy_version 583455 (0.0011) [2023-12-26 04:14:42,283][123090] Updated weights for policy 1, policy_version 579429 (0.0008) [2023-12-26 04:14:42,341][123091] Updated weights for policy 0, policy_version 583465 (0.0011) [2023-12-26 04:14:42,355][123090] Updated weights for policy 1, policy_version 579439 (0.0008) [2023-12-26 04:14:42,430][123090] Updated weights for policy 1, policy_version 579449 (0.0008) [2023-12-26 04:14:43,036][123091] Updated weights for policy 0, policy_version 583475 (0.0008) [2023-12-26 04:14:43,095][123091] Updated weights for policy 0, policy_version 583485 (0.0006) [2023-12-26 04:14:43,151][123091] Updated weights for policy 0, policy_version 583495 (0.0008) [2023-12-26 04:14:43,275][123090] Updated weights for policy 1, policy_version 579459 (0.0008) [2023-12-26 04:14:43,338][123090] Updated weights for policy 1, policy_version 579469 (0.0007) [2023-12-26 04:14:43,397][123090] Updated weights for policy 1, policy_version 579479 (0.0009) [2023-12-26 04:14:43,781][123091] Updated weights for policy 0, policy_version 583505 (0.0010) [2023-12-26 04:14:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 297730048. Throughput: 0: 8799.5, 1: 8748.2. Samples: 297724012. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:14:43,784][121949] Avg episode reward: [(0, '6147.041'), (1, '5395.842')] [2023-12-26 04:14:43,838][123091] Updated weights for policy 0, policy_version 583515 (0.0008) [2023-12-26 04:14:43,889][123091] Updated weights for policy 0, policy_version 583525 (0.0010) [2023-12-26 04:14:43,933][123091] Updated weights for policy 0, policy_version 583535 (0.0010) [2023-12-26 04:14:44,233][123090] Updated weights for policy 1, policy_version 579489 (0.0009) [2023-12-26 04:14:44,289][123090] Updated weights for policy 1, policy_version 579499 (0.0005) [2023-12-26 04:14:44,346][123090] Updated weights for policy 1, policy_version 579509 (0.0005) [2023-12-26 04:14:44,406][123090] Updated weights for policy 1, policy_version 579519 (0.0005) [2023-12-26 04:14:44,807][123091] Updated weights for policy 0, policy_version 583545 (0.0011) [2023-12-26 04:14:44,872][123091] Updated weights for policy 0, policy_version 583555 (0.0011) [2023-12-26 04:14:44,935][123091] Updated weights for policy 0, policy_version 583565 (0.0011) [2023-12-26 04:14:45,181][123090] Updated weights for policy 1, policy_version 579529 (0.0009) [2023-12-26 04:14:45,237][123090] Updated weights for policy 1, policy_version 579539 (0.0008) [2023-12-26 04:14:45,299][123090] Updated weights for policy 1, policy_version 579549 (0.0009) [2023-12-26 04:14:45,754][123091] Updated weights for policy 0, policy_version 583575 (0.0011) [2023-12-26 04:14:45,813][123091] Updated weights for policy 0, policy_version 583585 (0.0009) [2023-12-26 04:14:45,870][123091] Updated weights for policy 0, policy_version 583595 (0.0009) [2023-12-26 04:14:46,090][123090] Updated weights for policy 1, policy_version 579559 (0.0006) [2023-12-26 04:14:46,156][123090] Updated weights for policy 1, policy_version 579569 (0.0005) [2023-12-26 04:14:46,220][123090] Updated weights for policy 1, policy_version 579579 (0.0005) [2023-12-26 04:14:46,696][123091] Updated weights for policy 0, policy_version 583605 (0.0009) [2023-12-26 04:14:46,760][123091] Updated weights for policy 0, policy_version 583615 (0.0009) [2023-12-26 04:14:46,819][123091] Updated weights for policy 0, policy_version 583625 (0.0008) [2023-12-26 04:14:47,000][123090] Updated weights for policy 1, policy_version 579589 (0.0008) [2023-12-26 04:14:47,063][123090] Updated weights for policy 1, policy_version 579599 (0.0009) [2023-12-26 04:14:47,127][123090] Updated weights for policy 1, policy_version 579609 (0.0009) [2023-12-26 04:14:47,569][123091] Updated weights for policy 0, policy_version 583635 (0.0007) [2023-12-26 04:14:47,638][123091] Updated weights for policy 0, policy_version 583645 (0.0005) [2023-12-26 04:14:47,703][123091] Updated weights for policy 0, policy_version 583655 (0.0007) [2023-12-26 04:14:47,954][123090] Updated weights for policy 1, policy_version 579619 (0.0009) [2023-12-26 04:14:48,014][123090] Updated weights for policy 1, policy_version 579629 (0.0009) [2023-12-26 04:14:48,066][123090] Updated weights for policy 1, policy_version 579640 (0.0009) [2023-12-26 04:14:48,468][123091] Updated weights for policy 0, policy_version 583665 (0.0009) [2023-12-26 04:14:48,540][123091] Updated weights for policy 0, policy_version 583676 (0.0010) [2023-12-26 04:14:48,598][123091] Updated weights for policy 0, policy_version 583686 (0.0009) [2023-12-26 04:14:48,655][123091] Updated weights for policy 0, policy_version 583696 (0.0010) [2023-12-26 04:14:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 297820160. Throughput: 0: 8843.3, 1: 8753.9. Samples: 297830728. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:14:48,784][121949] Avg episode reward: [(0, '6112.683'), (1, '5140.808')] [2023-12-26 04:14:48,910][123090] Updated weights for policy 1, policy_version 579650 (0.0010) [2023-12-26 04:14:48,962][123090] Updated weights for policy 1, policy_version 579660 (0.0009) [2023-12-26 04:14:49,012][123090] Updated weights for policy 1, policy_version 579670 (0.0009) [2023-12-26 04:14:49,501][123091] Updated weights for policy 0, policy_version 583706 (0.0010) [2023-12-26 04:14:49,557][123091] Updated weights for policy 0, policy_version 583716 (0.0011) [2023-12-26 04:14:49,621][123091] Updated weights for policy 0, policy_version 583726 (0.0008) [2023-12-26 04:14:49,897][123090] Updated weights for policy 1, policy_version 579681 (0.0010) [2023-12-26 04:14:49,966][123090] Updated weights for policy 1, policy_version 579691 (0.0009) [2023-12-26 04:14:50,032][123090] Updated weights for policy 1, policy_version 579701 (0.0009) [2023-12-26 04:14:50,081][123090] Updated weights for policy 1, policy_version 579711 (0.0009) [2023-12-26 04:14:50,484][123091] Updated weights for policy 0, policy_version 583736 (0.0011) [2023-12-26 04:14:50,543][123091] Updated weights for policy 0, policy_version 583746 (0.0011) [2023-12-26 04:14:50,605][123091] Updated weights for policy 0, policy_version 583756 (0.0011) [2023-12-26 04:14:50,924][123090] Updated weights for policy 1, policy_version 579721 (0.0009) [2023-12-26 04:14:51,000][123090] Updated weights for policy 1, policy_version 579731 (0.0009) [2023-12-26 04:14:51,070][123090] Updated weights for policy 1, policy_version 579741 (0.0010) [2023-12-26 04:14:51,436][123091] Updated weights for policy 0, policy_version 583766 (0.0011) [2023-12-26 04:14:51,496][123091] Updated weights for policy 0, policy_version 583776 (0.0011) [2023-12-26 04:14:51,547][123091] Updated weights for policy 0, policy_version 583786 (0.0010) [2023-12-26 04:14:51,920][123090] Updated weights for policy 1, policy_version 579751 (0.0008) [2023-12-26 04:14:51,985][123090] Updated weights for policy 1, policy_version 579761 (0.0008) [2023-12-26 04:14:52,041][123090] Updated weights for policy 1, policy_version 579771 (0.0009) [2023-12-26 04:14:52,386][123091] Updated weights for policy 0, policy_version 583796 (0.0010) [2023-12-26 04:14:52,444][123091] Updated weights for policy 0, policy_version 583806 (0.0008) [2023-12-26 04:14:52,492][123091] Updated weights for policy 0, policy_version 583816 (0.0008) [2023-12-26 04:14:52,801][123090] Updated weights for policy 1, policy_version 579781 (0.0007) [2023-12-26 04:14:52,871][123090] Updated weights for policy 1, policy_version 579791 (0.0005) [2023-12-26 04:14:52,946][123090] Updated weights for policy 1, policy_version 579801 (0.0007) [2023-12-26 04:14:53,305][123091] Updated weights for policy 0, policy_version 583826 (0.0009) [2023-12-26 04:14:53,373][123091] Updated weights for policy 0, policy_version 583836 (0.0008) [2023-12-26 04:14:53,428][123091] Updated weights for policy 0, policy_version 583846 (0.0010) [2023-12-26 04:14:53,480][123091] Updated weights for policy 0, policy_version 583856 (0.0008) [2023-12-26 04:14:53,766][123090] Updated weights for policy 1, policy_version 579811 (0.0010) [2023-12-26 04:14:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 297902080. Throughput: 0: 8813.6, 1: 8713.5. Samples: 297880624. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:14:53,785][121949] Avg episode reward: [(0, '5986.469'), (1, '5011.221')] [2023-12-26 04:14:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000583856_149471232.pth... [2023-12-26 04:14:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000582800_149200896.pth [2023-12-26 04:14:53,836][123090] Updated weights for policy 1, policy_version 579821 (0.0009) [2023-12-26 04:14:53,903][123090] Updated weights for policy 1, policy_version 579831 (0.0009) [2023-12-26 04:14:53,960][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000579840_148439040.pth... [2023-12-26 04:14:53,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000578816_148176896.pth [2023-12-26 04:14:54,201][123091] Updated weights for policy 0, policy_version 583866 (0.0011) [2023-12-26 04:14:54,266][123091] Updated weights for policy 0, policy_version 583876 (0.0010) [2023-12-26 04:14:54,340][123091] Updated weights for policy 0, policy_version 583886 (0.0011) [2023-12-26 04:14:54,592][123090] Updated weights for policy 1, policy_version 579841 (0.0009) [2023-12-26 04:14:54,646][123090] Updated weights for policy 1, policy_version 579851 (0.0010) [2023-12-26 04:14:54,707][123090] Updated weights for policy 1, policy_version 579861 (0.0009) [2023-12-26 04:14:54,767][123090] Updated weights for policy 1, policy_version 579871 (0.0008) [2023-12-26 04:14:55,041][123091] Updated weights for policy 0, policy_version 583896 (0.0011) [2023-12-26 04:14:55,092][123091] Updated weights for policy 0, policy_version 583906 (0.0010) [2023-12-26 04:14:55,151][123091] Updated weights for policy 0, policy_version 583916 (0.0011) [2023-12-26 04:14:55,638][123090] Updated weights for policy 1, policy_version 579882 (0.0010) [2023-12-26 04:14:55,692][123090] Updated weights for policy 1, policy_version 579893 (0.0010) [2023-12-26 04:14:55,749][123090] Updated weights for policy 1, policy_version 579903 (0.0009) [2023-12-26 04:14:55,904][123091] Updated weights for policy 0, policy_version 583926 (0.0008) [2023-12-26 04:14:55,966][123091] Updated weights for policy 0, policy_version 583936 (0.0007) [2023-12-26 04:14:56,032][123091] Updated weights for policy 0, policy_version 583946 (0.0006) [2023-12-26 04:14:56,634][123090] Updated weights for policy 1, policy_version 579913 (0.0009) [2023-12-26 04:14:56,685][123090] Updated weights for policy 1, policy_version 579923 (0.0008) [2023-12-26 04:14:56,733][123090] Updated weights for policy 1, policy_version 579933 (0.0009) [2023-12-26 04:14:56,786][123091] Updated weights for policy 0, policy_version 583956 (0.0008) [2023-12-26 04:14:56,842][123091] Updated weights for policy 0, policy_version 583966 (0.0011) [2023-12-26 04:14:56,901][123091] Updated weights for policy 0, policy_version 583976 (0.0011) [2023-12-26 04:14:57,553][123090] Updated weights for policy 1, policy_version 579943 (0.0009) [2023-12-26 04:14:57,617][123090] Updated weights for policy 1, policy_version 579953 (0.0008) [2023-12-26 04:14:57,669][123090] Updated weights for policy 1, policy_version 579963 (0.0008) [2023-12-26 04:14:57,730][123091] Updated weights for policy 0, policy_version 583986 (0.0010) [2023-12-26 04:14:57,777][123091] Updated weights for policy 0, policy_version 583996 (0.0010) [2023-12-26 04:14:57,833][123091] Updated weights for policy 0, policy_version 584006 (0.0011) [2023-12-26 04:14:57,889][123091] Updated weights for policy 0, policy_version 584016 (0.0011) [2023-12-26 04:14:58,503][123090] Updated weights for policy 1, policy_version 579973 (0.0008) [2023-12-26 04:14:58,577][123090] Updated weights for policy 1, policy_version 579983 (0.0009) [2023-12-26 04:14:58,650][123090] Updated weights for policy 1, policy_version 579993 (0.0008) [2023-12-26 04:14:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 297992192. Throughput: 0: 8874.9, 1: 8718.6. Samples: 297986660. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:14:58,785][121949] Avg episode reward: [(0, '5972.933'), (1, '5058.060')] [2023-12-26 04:14:58,825][123091] Updated weights for policy 0, policy_version 584026 (0.0005) [2023-12-26 04:14:58,897][123091] Updated weights for policy 0, policy_version 584036 (0.0006) [2023-12-26 04:14:58,968][123091] Updated weights for policy 0, policy_version 584046 (0.0007) [2023-12-26 04:14:59,545][123090] Updated weights for policy 1, policy_version 580003 (0.0008) [2023-12-26 04:14:59,596][123090] Updated weights for policy 1, policy_version 580014 (0.0009) [2023-12-26 04:14:59,653][123090] Updated weights for policy 1, policy_version 580024 (0.0009) [2023-12-26 04:14:59,817][123091] Updated weights for policy 0, policy_version 584056 (0.0010) [2023-12-26 04:14:59,889][123091] Updated weights for policy 0, policy_version 584066 (0.0007) [2023-12-26 04:14:59,960][123091] Updated weights for policy 0, policy_version 584076 (0.0007) [2023-12-26 04:15:00,501][123090] Updated weights for policy 1, policy_version 580034 (0.0009) [2023-12-26 04:15:00,557][123090] Updated weights for policy 1, policy_version 580044 (0.0005) [2023-12-26 04:15:00,614][123090] Updated weights for policy 1, policy_version 580054 (0.0005) [2023-12-26 04:15:00,679][123090] Updated weights for policy 1, policy_version 580064 (0.0005) [2023-12-26 04:15:00,746][123091] Updated weights for policy 0, policy_version 584086 (0.0009) [2023-12-26 04:15:00,798][123091] Updated weights for policy 0, policy_version 584096 (0.0011) [2023-12-26 04:15:00,850][123091] Updated weights for policy 0, policy_version 584106 (0.0010) [2023-12-26 04:15:01,410][123090] Updated weights for policy 1, policy_version 580074 (0.0010) [2023-12-26 04:15:01,474][123090] Updated weights for policy 1, policy_version 580084 (0.0009) [2023-12-26 04:15:01,545][123090] Updated weights for policy 1, policy_version 580094 (0.0009) [2023-12-26 04:15:01,721][123091] Updated weights for policy 0, policy_version 584116 (0.0011) [2023-12-26 04:15:01,776][123091] Updated weights for policy 0, policy_version 584126 (0.0011) [2023-12-26 04:15:01,821][123091] Updated weights for policy 0, policy_version 584136 (0.0010) [2023-12-26 04:15:02,276][123090] Updated weights for policy 1, policy_version 580104 (0.0006) [2023-12-26 04:15:02,351][123090] Updated weights for policy 1, policy_version 580114 (0.0006) [2023-12-26 04:15:02,421][123090] Updated weights for policy 1, policy_version 580124 (0.0006) [2023-12-26 04:15:02,683][123091] Updated weights for policy 0, policy_version 584146 (0.0010) [2023-12-26 04:15:02,738][123091] Updated weights for policy 0, policy_version 584156 (0.0011) [2023-12-26 04:15:02,786][123091] Updated weights for policy 0, policy_version 584166 (0.0010) [2023-12-26 04:15:02,834][123091] Updated weights for policy 0, policy_version 584176 (0.0010) [2023-12-26 04:15:03,029][123090] Updated weights for policy 1, policy_version 580134 (0.0005) [2023-12-26 04:15:03,085][123090] Updated weights for policy 1, policy_version 580144 (0.0005) [2023-12-26 04:15:03,147][123090] Updated weights for policy 1, policy_version 580154 (0.0007) [2023-12-26 04:15:03,518][123091] Updated weights for policy 0, policy_version 584186 (0.0005) [2023-12-26 04:15:03,585][123091] Updated weights for policy 0, policy_version 584196 (0.0006) [2023-12-26 04:15:03,648][123091] Updated weights for policy 0, policy_version 584206 (0.0006) [2023-12-26 04:15:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 298082304. Throughput: 0: 8849.3, 1: 8622.8. Samples: 298092896. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:03,785][121949] Avg episode reward: [(0, '6055.103'), (1, '5308.315')] [2023-12-26 04:15:03,921][123090] Updated weights for policy 1, policy_version 580164 (0.0009) [2023-12-26 04:15:03,976][123090] Updated weights for policy 1, policy_version 580174 (0.0010) [2023-12-26 04:15:04,039][123090] Updated weights for policy 1, policy_version 580184 (0.0010) [2023-12-26 04:15:04,352][123091] Updated weights for policy 0, policy_version 584216 (0.0008) [2023-12-26 04:15:04,422][123091] Updated weights for policy 0, policy_version 584226 (0.0009) [2023-12-26 04:15:04,496][123091] Updated weights for policy 0, policy_version 584236 (0.0010) [2023-12-26 04:15:04,817][123090] Updated weights for policy 1, policy_version 580194 (0.0010) [2023-12-26 04:15:04,890][123090] Updated weights for policy 1, policy_version 580204 (0.0006) [2023-12-26 04:15:04,962][123090] Updated weights for policy 1, policy_version 580214 (0.0006) [2023-12-26 04:15:05,025][123090] Updated weights for policy 1, policy_version 580224 (0.0008) [2023-12-26 04:15:05,312][123091] Updated weights for policy 0, policy_version 584247 (0.0010) [2023-12-26 04:15:05,371][123091] Updated weights for policy 0, policy_version 584257 (0.0009) [2023-12-26 04:15:05,434][123091] Updated weights for policy 0, policy_version 584267 (0.0009) [2023-12-26 04:15:05,790][123090] Updated weights for policy 1, policy_version 580234 (0.0010) [2023-12-26 04:15:05,854][123090] Updated weights for policy 1, policy_version 580244 (0.0009) [2023-12-26 04:15:05,914][123090] Updated weights for policy 1, policy_version 580254 (0.0008) [2023-12-26 04:15:06,278][123091] Updated weights for policy 0, policy_version 584277 (0.0009) [2023-12-26 04:15:06,330][123091] Updated weights for policy 0, policy_version 584287 (0.0010) [2023-12-26 04:15:06,384][123091] Updated weights for policy 0, policy_version 584297 (0.0009) [2023-12-26 04:15:06,785][123090] Updated weights for policy 1, policy_version 580264 (0.0009) [2023-12-26 04:15:06,848][123090] Updated weights for policy 1, policy_version 580274 (0.0009) [2023-12-26 04:15:06,907][123090] Updated weights for policy 1, policy_version 580284 (0.0009) [2023-12-26 04:15:07,241][123091] Updated weights for policy 0, policy_version 584307 (0.0009) [2023-12-26 04:15:07,297][123091] Updated weights for policy 0, policy_version 584317 (0.0010) [2023-12-26 04:15:07,351][123091] Updated weights for policy 0, policy_version 584327 (0.0010) [2023-12-26 04:15:07,688][123090] Updated weights for policy 1, policy_version 580294 (0.0010) [2023-12-26 04:15:07,746][123090] Updated weights for policy 1, policy_version 580305 (0.0010) [2023-12-26 04:15:07,800][123090] Updated weights for policy 1, policy_version 580315 (0.0009) [2023-12-26 04:15:08,234][123091] Updated weights for policy 0, policy_version 584337 (0.0010) [2023-12-26 04:15:08,283][123091] Updated weights for policy 0, policy_version 584347 (0.0010) [2023-12-26 04:15:08,337][123091] Updated weights for policy 0, policy_version 584357 (0.0009) [2023-12-26 04:15:08,408][123091] Updated weights for policy 0, policy_version 584367 (0.0009) [2023-12-26 04:15:08,604][123090] Updated weights for policy 1, policy_version 580325 (0.0009) [2023-12-26 04:15:08,672][123090] Updated weights for policy 1, policy_version 580335 (0.0009) [2023-12-26 04:15:08,737][123090] Updated weights for policy 1, policy_version 580345 (0.0010) [2023-12-26 04:15:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 298172416. Throughput: 0: 8858.7, 1: 8630.3. Samples: 298144956. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:08,785][121949] Avg episode reward: [(0, '6105.225'), (1, '5574.397')] [2023-12-26 04:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000584368_149602304.pth... [2023-12-26 04:15:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000580352_148570112.pth... [2023-12-26 04:15:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000583344_149340160.pth [2023-12-26 04:15:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000579328_148307968.pth [2023-12-26 04:15:09,212][123091] Updated weights for policy 0, policy_version 584377 (0.0006) [2023-12-26 04:15:09,279][123091] Updated weights for policy 0, policy_version 584387 (0.0008) [2023-12-26 04:15:09,343][123091] Updated weights for policy 0, policy_version 584397 (0.0008) [2023-12-26 04:15:09,671][123090] Updated weights for policy 1, policy_version 580355 (0.0009) [2023-12-26 04:15:09,731][123090] Updated weights for policy 1, policy_version 580365 (0.0010) [2023-12-26 04:15:09,786][123090] Updated weights for policy 1, policy_version 580375 (0.0010) [2023-12-26 04:15:10,079][123091] Updated weights for policy 0, policy_version 584407 (0.0008) [2023-12-26 04:15:10,152][123091] Updated weights for policy 0, policy_version 584417 (0.0008) [2023-12-26 04:15:10,214][123091] Updated weights for policy 0, policy_version 584427 (0.0008) [2023-12-26 04:15:10,702][123090] Updated weights for policy 1, policy_version 580385 (0.0009) [2023-12-26 04:15:10,774][123090] Updated weights for policy 1, policy_version 580395 (0.0008) [2023-12-26 04:15:10,846][123090] Updated weights for policy 1, policy_version 580405 (0.0009) [2023-12-26 04:15:10,873][123091] Updated weights for policy 0, policy_version 584437 (0.0008) [2023-12-26 04:15:10,899][123090] Updated weights for policy 1, policy_version 580415 (0.0009) [2023-12-26 04:15:10,925][123091] Updated weights for policy 0, policy_version 584447 (0.0010) [2023-12-26 04:15:10,981][123091] Updated weights for policy 0, policy_version 584457 (0.0010) [2023-12-26 04:15:11,827][123090] Updated weights for policy 1, policy_version 580425 (0.0010) [2023-12-26 04:15:11,847][123091] Updated weights for policy 0, policy_version 584467 (0.0011) [2023-12-26 04:15:11,893][123090] Updated weights for policy 1, policy_version 580435 (0.0009) [2023-12-26 04:15:11,903][123091] Updated weights for policy 0, policy_version 584477 (0.0007) [2023-12-26 04:15:11,954][123090] Updated weights for policy 1, policy_version 580445 (0.0009) [2023-12-26 04:15:11,964][123091] Updated weights for policy 0, policy_version 584487 (0.0007) [2023-12-26 04:15:12,716][123090] Updated weights for policy 1, policy_version 580455 (0.0008) [2023-12-26 04:15:12,786][123090] Updated weights for policy 1, policy_version 580465 (0.0005) [2023-12-26 04:15:12,857][123091] Updated weights for policy 0, policy_version 584497 (0.0010) [2023-12-26 04:15:12,859][123090] Updated weights for policy 1, policy_version 580475 (0.0006) [2023-12-26 04:15:12,907][123091] Updated weights for policy 0, policy_version 584507 (0.0009) [2023-12-26 04:15:12,961][123091] Updated weights for policy 0, policy_version 584517 (0.0009) [2023-12-26 04:15:13,009][123091] Updated weights for policy 0, policy_version 584527 (0.0009) [2023-12-26 04:15:13,649][123090] Updated weights for policy 1, policy_version 580485 (0.0009) [2023-12-26 04:15:13,701][123090] Updated weights for policy 1, policy_version 580495 (0.0010) [2023-12-26 04:15:13,760][123090] Updated weights for policy 1, policy_version 580505 (0.0010) [2023-12-26 04:15:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 298246144. Throughput: 0: 8819.0, 1: 8549.3. Samples: 298247300. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:13,784][121949] Avg episode reward: [(0, '5954.733'), (1, '5497.294')] [2023-12-26 04:15:13,864][123091] Updated weights for policy 0, policy_version 584537 (0.0009) [2023-12-26 04:15:13,930][123091] Updated weights for policy 0, policy_version 584547 (0.0006) [2023-12-26 04:15:13,976][123091] Updated weights for policy 0, policy_version 584557 (0.0005) [2023-12-26 04:15:14,599][123090] Updated weights for policy 1, policy_version 580515 (0.0010) [2023-12-26 04:15:14,666][123090] Updated weights for policy 1, policy_version 580525 (0.0010) [2023-12-26 04:15:14,716][123091] Updated weights for policy 0, policy_version 584567 (0.0006) [2023-12-26 04:15:14,725][123090] Updated weights for policy 1, policy_version 580535 (0.0010) [2023-12-26 04:15:14,767][123091] Updated weights for policy 0, policy_version 584577 (0.0009) [2023-12-26 04:15:14,831][123091] Updated weights for policy 0, policy_version 584587 (0.0008) [2023-12-26 04:15:15,583][123090] Updated weights for policy 1, policy_version 580545 (0.0011) [2023-12-26 04:15:15,617][123091] Updated weights for policy 0, policy_version 584597 (0.0008) [2023-12-26 04:15:15,649][123090] Updated weights for policy 1, policy_version 580555 (0.0008) [2023-12-26 04:15:15,669][123091] Updated weights for policy 0, policy_version 584607 (0.0009) [2023-12-26 04:15:15,709][123090] Updated weights for policy 1, policy_version 580565 (0.0008) [2023-12-26 04:15:15,716][123091] Updated weights for policy 0, policy_version 584617 (0.0007) [2023-12-26 04:15:15,769][123090] Updated weights for policy 1, policy_version 580575 (0.0009) [2023-12-26 04:15:16,418][123090] Updated weights for policy 1, policy_version 580585 (0.0007) [2023-12-26 04:15:16,482][123090] Updated weights for policy 1, policy_version 580595 (0.0006) [2023-12-26 04:15:16,529][123091] Updated weights for policy 0, policy_version 584627 (0.0008) [2023-12-26 04:15:16,541][123090] Updated weights for policy 1, policy_version 580605 (0.0006) [2023-12-26 04:15:16,583][123091] Updated weights for policy 0, policy_version 584637 (0.0005) [2023-12-26 04:15:16,636][123091] Updated weights for policy 0, policy_version 584647 (0.0005) [2023-12-26 04:15:17,166][123090] Updated weights for policy 1, policy_version 580615 (0.0005) [2023-12-26 04:15:17,219][123090] Updated weights for policy 1, policy_version 580625 (0.0006) [2023-12-26 04:15:17,289][123090] Updated weights for policy 1, policy_version 580635 (0.0005) [2023-12-26 04:15:17,386][123091] Updated weights for policy 0, policy_version 584657 (0.0006) [2023-12-26 04:15:17,443][123091] Updated weights for policy 0, policy_version 584667 (0.0010) [2023-12-26 04:15:17,501][123091] Updated weights for policy 0, policy_version 584677 (0.0010) [2023-12-26 04:15:17,557][123091] Updated weights for policy 0, policy_version 584688 (0.0010) [2023-12-26 04:15:17,905][123090] Updated weights for policy 1, policy_version 580645 (0.0005) [2023-12-26 04:15:17,966][123090] Updated weights for policy 1, policy_version 580655 (0.0005) [2023-12-26 04:15:18,029][123090] Updated weights for policy 1, policy_version 580665 (0.0009) [2023-12-26 04:15:18,466][123091] Updated weights for policy 0, policy_version 584698 (0.0007) [2023-12-26 04:15:18,523][123091] Updated weights for policy 0, policy_version 584708 (0.0007) [2023-12-26 04:15:18,581][123091] Updated weights for policy 0, policy_version 584718 (0.0008) [2023-12-26 04:15:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 298344448. Throughput: 0: 8777.0, 1: 8669.4. Samples: 298355472. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:18,785][121949] Avg episode reward: [(0, '5860.245'), (1, '5657.498')] [2023-12-26 04:15:18,858][123090] Updated weights for policy 1, policy_version 580675 (0.0009) [2023-12-26 04:15:18,928][123090] Updated weights for policy 1, policy_version 580685 (0.0008) [2023-12-26 04:15:19,003][123090] Updated weights for policy 1, policy_version 580695 (0.0009) [2023-12-26 04:15:19,278][123091] Updated weights for policy 0, policy_version 584728 (0.0009) [2023-12-26 04:15:19,343][123091] Updated weights for policy 0, policy_version 584738 (0.0007) [2023-12-26 04:15:19,417][123091] Updated weights for policy 0, policy_version 584748 (0.0007) [2023-12-26 04:15:19,806][123090] Updated weights for policy 1, policy_version 580705 (0.0010) [2023-12-26 04:15:19,879][123090] Updated weights for policy 1, policy_version 580715 (0.0007) [2023-12-26 04:15:19,951][123090] Updated weights for policy 1, policy_version 580725 (0.0007) [2023-12-26 04:15:20,021][123090] Updated weights for policy 1, policy_version 580735 (0.0010) [2023-12-26 04:15:20,161][123091] Updated weights for policy 0, policy_version 584758 (0.0008) [2023-12-26 04:15:20,225][123091] Updated weights for policy 0, policy_version 584768 (0.0010) [2023-12-26 04:15:20,296][123091] Updated weights for policy 0, policy_version 584778 (0.0010) [2023-12-26 04:15:20,754][123090] Updated weights for policy 1, policy_version 580745 (0.0009) [2023-12-26 04:15:20,828][123090] Updated weights for policy 1, policy_version 580755 (0.0009) [2023-12-26 04:15:20,911][123090] Updated weights for policy 1, policy_version 580765 (0.0010) [2023-12-26 04:15:21,120][123091] Updated weights for policy 0, policy_version 584788 (0.0010) [2023-12-26 04:15:21,180][123091] Updated weights for policy 0, policy_version 584798 (0.0010) [2023-12-26 04:15:21,242][123091] Updated weights for policy 0, policy_version 584808 (0.0010) [2023-12-26 04:15:21,735][123090] Updated weights for policy 1, policy_version 580775 (0.0009) [2023-12-26 04:15:21,818][123090] Updated weights for policy 1, policy_version 580785 (0.0010) [2023-12-26 04:15:21,883][123090] Updated weights for policy 1, policy_version 580795 (0.0009) [2023-12-26 04:15:22,074][123091] Updated weights for policy 0, policy_version 584818 (0.0009) [2023-12-26 04:15:22,132][123091] Updated weights for policy 0, policy_version 584828 (0.0008) [2023-12-26 04:15:22,189][123091] Updated weights for policy 0, policy_version 584838 (0.0010) [2023-12-26 04:15:22,247][123091] Updated weights for policy 0, policy_version 584848 (0.0009) [2023-12-26 04:15:22,692][123090] Updated weights for policy 1, policy_version 580805 (0.0008) [2023-12-26 04:15:22,745][123090] Updated weights for policy 1, policy_version 580815 (0.0005) [2023-12-26 04:15:22,811][123090] Updated weights for policy 1, policy_version 580825 (0.0006) [2023-12-26 04:15:23,033][123091] Updated weights for policy 0, policy_version 584858 (0.0008) [2023-12-26 04:15:23,086][123091] Updated weights for policy 0, policy_version 584868 (0.0010) [2023-12-26 04:15:23,151][123091] Updated weights for policy 0, policy_version 584878 (0.0011) [2023-12-26 04:15:23,538][123090] Updated weights for policy 1, policy_version 580835 (0.0006) [2023-12-26 04:15:23,591][123090] Updated weights for policy 1, policy_version 580845 (0.0007) [2023-12-26 04:15:23,639][123090] Updated weights for policy 1, policy_version 580855 (0.0010) [2023-12-26 04:15:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 298434560. Throughput: 0: 8785.7, 1: 8678.6. Samples: 298408036. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:23,785][121949] Avg episode reward: [(0, '5706.322'), (1, '5758.047')] [2023-12-26 04:15:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000580864_148701184.pth... [2023-12-26 04:15:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000584880_149733376.pth... [2023-12-26 04:15:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000579840_148439040.pth [2023-12-26 04:15:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000583856_149471232.pth [2023-12-26 04:15:23,974][123091] Updated weights for policy 0, policy_version 584888 (0.0011) [2023-12-26 04:15:24,033][123091] Updated weights for policy 0, policy_version 584898 (0.0011) [2023-12-26 04:15:24,097][123091] Updated weights for policy 0, policy_version 584908 (0.0011) [2023-12-26 04:15:24,396][123090] Updated weights for policy 1, policy_version 580865 (0.0010) [2023-12-26 04:15:24,463][123090] Updated weights for policy 1, policy_version 580875 (0.0006) [2023-12-26 04:15:24,533][123090] Updated weights for policy 1, policy_version 580885 (0.0008) [2023-12-26 04:15:24,589][123090] Updated weights for policy 1, policy_version 580895 (0.0008) [2023-12-26 04:15:24,940][123091] Updated weights for policy 0, policy_version 584918 (0.0011) [2023-12-26 04:15:25,003][123091] Updated weights for policy 0, policy_version 584928 (0.0011) [2023-12-26 04:15:25,069][123091] Updated weights for policy 0, policy_version 584938 (0.0011) [2023-12-26 04:15:25,310][123090] Updated weights for policy 1, policy_version 580905 (0.0006) [2023-12-26 04:15:25,354][123090] Updated weights for policy 1, policy_version 580915 (0.0005) [2023-12-26 04:15:25,399][123090] Updated weights for policy 1, policy_version 580925 (0.0005) [2023-12-26 04:15:25,883][123091] Updated weights for policy 0, policy_version 584948 (0.0011) [2023-12-26 04:15:25,931][123091] Updated weights for policy 0, policy_version 584958 (0.0010) [2023-12-26 04:15:25,978][123091] Updated weights for policy 0, policy_version 584968 (0.0010) [2023-12-26 04:15:26,101][123090] Updated weights for policy 1, policy_version 580935 (0.0006) [2023-12-26 04:15:26,149][123090] Updated weights for policy 1, policy_version 580945 (0.0010) [2023-12-26 04:15:26,204][123090] Updated weights for policy 1, policy_version 580955 (0.0010) [2023-12-26 04:15:26,675][123091] Updated weights for policy 0, policy_version 584978 (0.0009) [2023-12-26 04:15:26,719][123091] Updated weights for policy 0, policy_version 584988 (0.0005) [2023-12-26 04:15:26,765][123091] Updated weights for policy 0, policy_version 584998 (0.0005) [2023-12-26 04:15:26,826][123091] Updated weights for policy 0, policy_version 585008 (0.0009) [2023-12-26 04:15:26,997][123090] Updated weights for policy 1, policy_version 580965 (0.0010) [2023-12-26 04:15:27,044][123090] Updated weights for policy 1, policy_version 580975 (0.0010) [2023-12-26 04:15:27,102][123090] Updated weights for policy 1, policy_version 580985 (0.0007) [2023-12-26 04:15:27,599][123091] Updated weights for policy 0, policy_version 585018 (0.0010) [2023-12-26 04:15:27,650][123091] Updated weights for policy 0, policy_version 585028 (0.0010) [2023-12-26 04:15:27,697][123091] Updated weights for policy 0, policy_version 585038 (0.0010) [2023-12-26 04:15:27,814][123090] Updated weights for policy 1, policy_version 580995 (0.0006) [2023-12-26 04:15:27,865][123090] Updated weights for policy 1, policy_version 581005 (0.0008) [2023-12-26 04:15:27,916][123090] Updated weights for policy 1, policy_version 581015 (0.0008) [2023-12-26 04:15:28,535][123091] Updated weights for policy 0, policy_version 585048 (0.0009) [2023-12-26 04:15:28,600][123091] Updated weights for policy 0, policy_version 585058 (0.0011) [2023-12-26 04:15:28,664][123091] Updated weights for policy 0, policy_version 585068 (0.0011) [2023-12-26 04:15:28,677][123090] Updated weights for policy 1, policy_version 581025 (0.0008) [2023-12-26 04:15:28,749][123090] Updated weights for policy 1, policy_version 581035 (0.0006) [2023-12-26 04:15:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 298524672. Throughput: 0: 8831.9, 1: 8827.5. Samples: 298518688. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:28,785][121949] Avg episode reward: [(0, '5624.176'), (1, '5672.572')] [2023-12-26 04:15:28,797][123090] Updated weights for policy 1, policy_version 581045 (0.0010) [2023-12-26 04:15:28,859][123090] Updated weights for policy 1, policy_version 581055 (0.0009) [2023-12-26 04:15:29,483][123091] Updated weights for policy 0, policy_version 585078 (0.0010) [2023-12-26 04:15:29,543][123091] Updated weights for policy 0, policy_version 585088 (0.0009) [2023-12-26 04:15:29,606][123091] Updated weights for policy 0, policy_version 585098 (0.0009) [2023-12-26 04:15:29,663][123090] Updated weights for policy 1, policy_version 581065 (0.0010) [2023-12-26 04:15:29,737][123090] Updated weights for policy 1, policy_version 581075 (0.0010) [2023-12-26 04:15:29,805][123090] Updated weights for policy 1, policy_version 581085 (0.0010) [2023-12-26 04:15:30,369][123091] Updated weights for policy 0, policy_version 585108 (0.0008) [2023-12-26 04:15:30,443][123091] Updated weights for policy 0, policy_version 585118 (0.0009) [2023-12-26 04:15:30,509][123091] Updated weights for policy 0, policy_version 585128 (0.0007) [2023-12-26 04:15:30,585][123090] Updated weights for policy 1, policy_version 581095 (0.0010) [2023-12-26 04:15:30,653][123090] Updated weights for policy 1, policy_version 581105 (0.0010) [2023-12-26 04:15:30,713][123090] Updated weights for policy 1, policy_version 581115 (0.0009) [2023-12-26 04:15:31,255][123091] Updated weights for policy 0, policy_version 585138 (0.0007) [2023-12-26 04:15:31,326][123091] Updated weights for policy 0, policy_version 585148 (0.0011) [2023-12-26 04:15:31,397][123091] Updated weights for policy 0, policy_version 585158 (0.0010) [2023-12-26 04:15:31,458][123091] Updated weights for policy 0, policy_version 585168 (0.0010) [2023-12-26 04:15:31,541][123090] Updated weights for policy 1, policy_version 581125 (0.0009) [2023-12-26 04:15:31,600][123090] Updated weights for policy 1, policy_version 581135 (0.0009) [2023-12-26 04:15:31,665][123090] Updated weights for policy 1, policy_version 581145 (0.0009) [2023-12-26 04:15:32,290][123091] Updated weights for policy 0, policy_version 585178 (0.0011) [2023-12-26 04:15:32,359][123091] Updated weights for policy 0, policy_version 585188 (0.0010) [2023-12-26 04:15:32,422][123091] Updated weights for policy 0, policy_version 585198 (0.0008) [2023-12-26 04:15:32,531][123090] Updated weights for policy 1, policy_version 581155 (0.0008) [2023-12-26 04:15:32,605][123090] Updated weights for policy 1, policy_version 581165 (0.0007) [2023-12-26 04:15:32,663][123090] Updated weights for policy 1, policy_version 581175 (0.0007) [2023-12-26 04:15:33,162][123091] Updated weights for policy 0, policy_version 585208 (0.0009) [2023-12-26 04:15:33,221][123091] Updated weights for policy 0, policy_version 585218 (0.0010) [2023-12-26 04:15:33,276][123091] Updated weights for policy 0, policy_version 585228 (0.0010) [2023-12-26 04:15:33,392][123090] Updated weights for policy 1, policy_version 581185 (0.0005) [2023-12-26 04:15:33,446][123090] Updated weights for policy 1, policy_version 581195 (0.0005) [2023-12-26 04:15:33,494][123090] Updated weights for policy 1, policy_version 581205 (0.0005) [2023-12-26 04:15:33,544][123090] Updated weights for policy 1, policy_version 581215 (0.0005) [2023-12-26 04:15:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 298614784. Throughput: 0: 8819.2, 1: 8837.5. Samples: 298625280. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:33,784][121949] Avg episode reward: [(0, '5744.989'), (1, '5621.875')] [2023-12-26 04:15:33,935][123091] Updated weights for policy 0, policy_version 585238 (0.0007) [2023-12-26 04:15:33,980][123091] Updated weights for policy 0, policy_version 585248 (0.0005) [2023-12-26 04:15:34,034][123091] Updated weights for policy 0, policy_version 585258 (0.0005) [2023-12-26 04:15:34,251][123090] Updated weights for policy 1, policy_version 581225 (0.0006) [2023-12-26 04:15:34,314][123090] Updated weights for policy 1, policy_version 581235 (0.0006) [2023-12-26 04:15:34,369][123090] Updated weights for policy 1, policy_version 581245 (0.0006) [2023-12-26 04:15:34,811][123091] Updated weights for policy 0, policy_version 585268 (0.0005) [2023-12-26 04:15:34,865][123091] Updated weights for policy 0, policy_version 585278 (0.0010) [2023-12-26 04:15:34,932][123091] Updated weights for policy 0, policy_version 585288 (0.0009) [2023-12-26 04:15:35,119][123090] Updated weights for policy 1, policy_version 581255 (0.0007) [2023-12-26 04:15:35,191][123090] Updated weights for policy 1, policy_version 581265 (0.0006) [2023-12-26 04:15:35,262][123090] Updated weights for policy 1, policy_version 581275 (0.0005) [2023-12-26 04:15:35,734][123091] Updated weights for policy 0, policy_version 585298 (0.0006) [2023-12-26 04:15:35,789][123091] Updated weights for policy 0, policy_version 585308 (0.0010) [2023-12-26 04:15:35,855][123091] Updated weights for policy 0, policy_version 585318 (0.0010) [2023-12-26 04:15:35,885][123090] Updated weights for policy 1, policy_version 581285 (0.0008) [2023-12-26 04:15:35,922][123091] Updated weights for policy 0, policy_version 585328 (0.0010) [2023-12-26 04:15:35,937][123090] Updated weights for policy 1, policy_version 581295 (0.0010) [2023-12-26 04:15:35,989][123090] Updated weights for policy 1, policy_version 581305 (0.0010) [2023-12-26 04:15:36,746][123091] Updated weights for policy 0, policy_version 585338 (0.0010) [2023-12-26 04:15:36,809][123091] Updated weights for policy 0, policy_version 585348 (0.0010) [2023-12-26 04:15:36,869][123090] Updated weights for policy 1, policy_version 581315 (0.0011) [2023-12-26 04:15:36,880][123091] Updated weights for policy 0, policy_version 585358 (0.0010) [2023-12-26 04:15:36,920][123090] Updated weights for policy 1, policy_version 581325 (0.0010) [2023-12-26 04:15:36,976][123090] Updated weights for policy 1, policy_version 581335 (0.0010) [2023-12-26 04:15:37,688][123091] Updated weights for policy 0, policy_version 585368 (0.0007) [2023-12-26 04:15:37,763][123091] Updated weights for policy 0, policy_version 585378 (0.0007) [2023-12-26 04:15:37,835][123091] Updated weights for policy 0, policy_version 585388 (0.0006) [2023-12-26 04:15:37,841][123090] Updated weights for policy 1, policy_version 581345 (0.0010) [2023-12-26 04:15:37,894][123090] Updated weights for policy 1, policy_version 581355 (0.0010) [2023-12-26 04:15:37,961][123090] Updated weights for policy 1, policy_version 581366 (0.0010) [2023-12-26 04:15:38,015][123090] Updated weights for policy 1, policy_version 581376 (0.0009) [2023-12-26 04:15:38,538][123091] Updated weights for policy 0, policy_version 585398 (0.0009) [2023-12-26 04:15:38,608][123091] Updated weights for policy 0, policy_version 585408 (0.0010) [2023-12-26 04:15:38,670][123091] Updated weights for policy 0, policy_version 585418 (0.0010) [2023-12-26 04:15:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 298704896. Throughput: 0: 8878.8, 1: 8903.7. Samples: 298680840. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:38,786][121949] Avg episode reward: [(0, '5800.360'), (1, '5632.805')] [2023-12-26 04:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000581376_148832256.pth... [2023-12-26 04:15:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000585424_149872640.pth... [2023-12-26 04:15:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000580352_148570112.pth [2023-12-26 04:15:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000584368_149602304.pth [2023-12-26 04:15:38,884][123090] Updated weights for policy 1, policy_version 581386 (0.0005) [2023-12-26 04:15:38,934][123090] Updated weights for policy 1, policy_version 581396 (0.0005) [2023-12-26 04:15:39,001][123090] Updated weights for policy 1, policy_version 581406 (0.0006) [2023-12-26 04:15:39,488][123091] Updated weights for policy 0, policy_version 585428 (0.0010) [2023-12-26 04:15:39,553][123091] Updated weights for policy 0, policy_version 585438 (0.0011) [2023-12-26 04:15:39,625][123091] Updated weights for policy 0, policy_version 585448 (0.0011) [2023-12-26 04:15:39,859][123090] Updated weights for policy 1, policy_version 581416 (0.0009) [2023-12-26 04:15:39,929][123090] Updated weights for policy 1, policy_version 581426 (0.0009) [2023-12-26 04:15:40,000][123090] Updated weights for policy 1, policy_version 581436 (0.0009) [2023-12-26 04:15:40,452][123091] Updated weights for policy 0, policy_version 585458 (0.0010) [2023-12-26 04:15:40,511][123091] Updated weights for policy 0, policy_version 585468 (0.0011) [2023-12-26 04:15:40,566][123091] Updated weights for policy 0, policy_version 585478 (0.0010) [2023-12-26 04:15:40,621][123091] Updated weights for policy 0, policy_version 585488 (0.0010) [2023-12-26 04:15:40,867][123090] Updated weights for policy 1, policy_version 581446 (0.0009) [2023-12-26 04:15:40,916][123090] Updated weights for policy 1, policy_version 581456 (0.0009) [2023-12-26 04:15:40,971][123090] Updated weights for policy 1, policy_version 581466 (0.0009) [2023-12-26 04:15:41,458][123091] Updated weights for policy 0, policy_version 585498 (0.0011) [2023-12-26 04:15:41,526][123091] Updated weights for policy 0, policy_version 585508 (0.0010) [2023-12-26 04:15:41,589][123091] Updated weights for policy 0, policy_version 585518 (0.0011) [2023-12-26 04:15:41,892][123090] Updated weights for policy 1, policy_version 581476 (0.0009) [2023-12-26 04:15:41,957][123090] Updated weights for policy 1, policy_version 581486 (0.0009) [2023-12-26 04:15:42,020][123090] Updated weights for policy 1, policy_version 581496 (0.0009) [2023-12-26 04:15:42,425][123091] Updated weights for policy 0, policy_version 585528 (0.0010) [2023-12-26 04:15:42,491][123091] Updated weights for policy 0, policy_version 585538 (0.0011) [2023-12-26 04:15:42,554][123091] Updated weights for policy 0, policy_version 585548 (0.0011) [2023-12-26 04:15:42,858][123090] Updated weights for policy 1, policy_version 581506 (0.0009) [2023-12-26 04:15:42,921][123090] Updated weights for policy 1, policy_version 581516 (0.0009) [2023-12-26 04:15:42,974][123090] Updated weights for policy 1, policy_version 581526 (0.0009) [2023-12-26 04:15:43,022][123090] Updated weights for policy 1, policy_version 581536 (0.0008) [2023-12-26 04:15:43,377][123091] Updated weights for policy 0, policy_version 585558 (0.0011) [2023-12-26 04:15:43,439][123091] Updated weights for policy 0, policy_version 585568 (0.0010) [2023-12-26 04:15:43,498][123091] Updated weights for policy 0, policy_version 585578 (0.0010) [2023-12-26 04:15:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 298786816. Throughput: 0: 8815.8, 1: 8864.6. Samples: 298782280. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:43,785][121949] Avg episode reward: [(0, '5777.184'), (1, '5845.521')] [2023-12-26 04:15:43,879][123090] Updated weights for policy 1, policy_version 581546 (0.0010) [2023-12-26 04:15:43,933][123090] Updated weights for policy 1, policy_version 581556 (0.0009) [2023-12-26 04:15:43,986][123090] Updated weights for policy 1, policy_version 581567 (0.0010) [2023-12-26 04:15:44,265][123091] Updated weights for policy 0, policy_version 585588 (0.0008) [2023-12-26 04:15:44,331][123091] Updated weights for policy 0, policy_version 585598 (0.0005) [2023-12-26 04:15:44,386][123091] Updated weights for policy 0, policy_version 585608 (0.0006) [2023-12-26 04:15:44,714][123090] Updated weights for policy 1, policy_version 581577 (0.0009) [2023-12-26 04:15:44,775][123090] Updated weights for policy 1, policy_version 581587 (0.0009) [2023-12-26 04:15:44,836][123090] Updated weights for policy 1, policy_version 581597 (0.0009) [2023-12-26 04:15:45,168][123091] Updated weights for policy 0, policy_version 585618 (0.0006) [2023-12-26 04:15:45,239][123091] Updated weights for policy 0, policy_version 585628 (0.0011) [2023-12-26 04:15:45,306][123091] Updated weights for policy 0, policy_version 585638 (0.0011) [2023-12-26 04:15:45,366][123091] Updated weights for policy 0, policy_version 585648 (0.0011) [2023-12-26 04:15:45,696][123090] Updated weights for policy 1, policy_version 581607 (0.0009) [2023-12-26 04:15:45,764][123090] Updated weights for policy 1, policy_version 581617 (0.0009) [2023-12-26 04:15:45,825][123090] Updated weights for policy 1, policy_version 581627 (0.0009) [2023-12-26 04:15:46,198][123091] Updated weights for policy 0, policy_version 585658 (0.0011) [2023-12-26 04:15:46,268][123091] Updated weights for policy 0, policy_version 585668 (0.0011) [2023-12-26 04:15:46,338][123091] Updated weights for policy 0, policy_version 585678 (0.0011) [2023-12-26 04:15:46,608][123090] Updated weights for policy 1, policy_version 581637 (0.0008) [2023-12-26 04:15:46,664][123090] Updated weights for policy 1, policy_version 581647 (0.0009) [2023-12-26 04:15:46,736][123090] Updated weights for policy 1, policy_version 581657 (0.0008) [2023-12-26 04:15:47,022][123091] Updated weights for policy 0, policy_version 585688 (0.0006) [2023-12-26 04:15:47,083][123091] Updated weights for policy 0, policy_version 585698 (0.0006) [2023-12-26 04:15:47,155][123091] Updated weights for policy 0, policy_version 585708 (0.0006) [2023-12-26 04:15:47,624][123090] Updated weights for policy 1, policy_version 581667 (0.0010) [2023-12-26 04:15:47,678][123090] Updated weights for policy 1, policy_version 581677 (0.0009) [2023-12-26 04:15:47,725][123091] Updated weights for policy 0, policy_version 585718 (0.0006) [2023-12-26 04:15:47,732][123090] Updated weights for policy 1, policy_version 581687 (0.0009) [2023-12-26 04:15:47,771][123091] Updated weights for policy 0, policy_version 585728 (0.0005) [2023-12-26 04:15:47,822][123091] Updated weights for policy 0, policy_version 585738 (0.0005) [2023-12-26 04:15:48,505][123091] Updated weights for policy 0, policy_version 585748 (0.0006) [2023-12-26 04:15:48,523][123090] Updated weights for policy 1, policy_version 581697 (0.0008) [2023-12-26 04:15:48,568][123091] Updated weights for policy 0, policy_version 585758 (0.0008) [2023-12-26 04:15:48,583][123090] Updated weights for policy 1, policy_version 581707 (0.0009) [2023-12-26 04:15:48,629][123091] Updated weights for policy 0, policy_version 585768 (0.0006) [2023-12-26 04:15:48,643][123090] Updated weights for policy 1, policy_version 581717 (0.0008) [2023-12-26 04:15:48,699][123090] Updated weights for policy 1, policy_version 581727 (0.0010) [2023-12-26 04:15:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 298885120. Throughput: 0: 8912.7, 1: 8817.7. Samples: 298890764. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:48,785][121949] Avg episode reward: [(0, '5961.034'), (1, '5906.844')] [2023-12-26 04:15:49,429][123091] Updated weights for policy 0, policy_version 585778 (0.0007) [2023-12-26 04:15:49,492][123091] Updated weights for policy 0, policy_version 585788 (0.0009) [2023-12-26 04:15:49,551][123090] Updated weights for policy 1, policy_version 581737 (0.0005) [2023-12-26 04:15:49,557][123091] Updated weights for policy 0, policy_version 585798 (0.0009) [2023-12-26 04:15:49,615][123091] Updated weights for policy 0, policy_version 585808 (0.0009) [2023-12-26 04:15:49,616][123090] Updated weights for policy 1, policy_version 581747 (0.0007) [2023-12-26 04:15:49,681][123090] Updated weights for policy 1, policy_version 581757 (0.0010) [2023-12-26 04:15:50,400][123090] Updated weights for policy 1, policy_version 581767 (0.0006) [2023-12-26 04:15:50,465][123090] Updated weights for policy 1, policy_version 581777 (0.0008) [2023-12-26 04:15:50,514][123091] Updated weights for policy 0, policy_version 585818 (0.0008) [2023-12-26 04:15:50,533][123090] Updated weights for policy 1, policy_version 581787 (0.0008) [2023-12-26 04:15:50,578][123091] Updated weights for policy 0, policy_version 585828 (0.0008) [2023-12-26 04:15:50,629][123091] Updated weights for policy 0, policy_version 585838 (0.0009) [2023-12-26 04:15:51,249][123090] Updated weights for policy 1, policy_version 581797 (0.0009) [2023-12-26 04:15:51,302][123090] Updated weights for policy 1, policy_version 581807 (0.0010) [2023-12-26 04:15:51,366][123090] Updated weights for policy 1, policy_version 581817 (0.0010) [2023-12-26 04:15:51,544][123091] Updated weights for policy 0, policy_version 585848 (0.0009) [2023-12-26 04:15:51,600][123091] Updated weights for policy 0, policy_version 585858 (0.0007) [2023-12-26 04:15:51,671][123091] Updated weights for policy 0, policy_version 585868 (0.0008) [2023-12-26 04:15:52,253][123090] Updated weights for policy 1, policy_version 581827 (0.0010) [2023-12-26 04:15:52,326][123090] Updated weights for policy 1, policy_version 581837 (0.0008) [2023-12-26 04:15:52,397][123090] Updated weights for policy 1, policy_version 581847 (0.0008) [2023-12-26 04:15:52,462][123091] Updated weights for policy 0, policy_version 585878 (0.0009) [2023-12-26 04:15:52,536][123091] Updated weights for policy 0, policy_version 585888 (0.0011) [2023-12-26 04:15:52,599][123091] Updated weights for policy 0, policy_version 585898 (0.0011) [2023-12-26 04:15:53,241][123090] Updated weights for policy 1, policy_version 581857 (0.0008) [2023-12-26 04:15:53,299][123090] Updated weights for policy 1, policy_version 581867 (0.0008) [2023-12-26 04:15:53,313][123091] Updated weights for policy 0, policy_version 585908 (0.0011) [2023-12-26 04:15:53,348][123090] Updated weights for policy 1, policy_version 581877 (0.0009) [2023-12-26 04:15:53,375][123091] Updated weights for policy 0, policy_version 585918 (0.0008) [2023-12-26 04:15:53,396][123090] Updated weights for policy 1, policy_version 581887 (0.0009) [2023-12-26 04:15:53,442][123091] Updated weights for policy 0, policy_version 585928 (0.0005) [2023-12-26 04:15:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 298967040. Throughput: 0: 8878.5, 1: 8829.7. Samples: 298941824. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:53,785][121949] Avg episode reward: [(0, '6004.428'), (1, '5911.583')] [2023-12-26 04:15:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000585936_150003712.pth... [2023-12-26 04:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000581888_148963328.pth... [2023-12-26 04:15:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000584880_149733376.pth [2023-12-26 04:15:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000580864_148701184.pth [2023-12-26 04:15:54,089][123091] Updated weights for policy 0, policy_version 585938 (0.0005) [2023-12-26 04:15:54,147][123091] Updated weights for policy 0, policy_version 585948 (0.0010) [2023-12-26 04:15:54,213][123091] Updated weights for policy 0, policy_version 585958 (0.0009) [2023-12-26 04:15:54,274][123091] Updated weights for policy 0, policy_version 585968 (0.0005) [2023-12-26 04:15:54,329][123090] Updated weights for policy 1, policy_version 581897 (0.0010) [2023-12-26 04:15:54,383][123090] Updated weights for policy 1, policy_version 581907 (0.0010) [2023-12-26 04:15:54,441][123090] Updated weights for policy 1, policy_version 581917 (0.0009) [2023-12-26 04:15:55,027][123091] Updated weights for policy 0, policy_version 585978 (0.0008) [2023-12-26 04:15:55,077][123091] Updated weights for policy 0, policy_version 585988 (0.0007) [2023-12-26 04:15:55,143][123091] Updated weights for policy 0, policy_version 585998 (0.0006) [2023-12-26 04:15:55,321][123090] Updated weights for policy 1, policy_version 581927 (0.0010) [2023-12-26 04:15:55,379][123090] Updated weights for policy 1, policy_version 581937 (0.0009) [2023-12-26 04:15:55,440][123090] Updated weights for policy 1, policy_version 581947 (0.0009) [2023-12-26 04:15:55,871][123091] Updated weights for policy 0, policy_version 586008 (0.0005) [2023-12-26 04:15:55,918][123091] Updated weights for policy 0, policy_version 586018 (0.0005) [2023-12-26 04:15:55,961][123091] Updated weights for policy 0, policy_version 586028 (0.0005) [2023-12-26 04:15:56,274][123090] Updated weights for policy 1, policy_version 581957 (0.0010) [2023-12-26 04:15:56,327][123090] Updated weights for policy 1, policy_version 581967 (0.0009) [2023-12-26 04:15:56,380][123090] Updated weights for policy 1, policy_version 581977 (0.0010) [2023-12-26 04:15:56,578][123091] Updated weights for policy 0, policy_version 586038 (0.0008) [2023-12-26 04:15:56,628][123091] Updated weights for policy 0, policy_version 586048 (0.0011) [2023-12-26 04:15:56,676][123091] Updated weights for policy 0, policy_version 586058 (0.0009) [2023-12-26 04:15:57,242][123090] Updated weights for policy 1, policy_version 581987 (0.0010) [2023-12-26 04:15:57,298][123090] Updated weights for policy 1, policy_version 581997 (0.0010) [2023-12-26 04:15:57,358][123090] Updated weights for policy 1, policy_version 582007 (0.0010) [2023-12-26 04:15:57,514][123091] Updated weights for policy 0, policy_version 586069 (0.0010) [2023-12-26 04:15:57,576][123091] Updated weights for policy 0, policy_version 586080 (0.0009) [2023-12-26 04:15:57,634][123091] Updated weights for policy 0, policy_version 586090 (0.0009) [2023-12-26 04:15:58,189][123090] Updated weights for policy 1, policy_version 582017 (0.0010) [2023-12-26 04:15:58,251][123090] Updated weights for policy 1, policy_version 582027 (0.0009) [2023-12-26 04:15:58,308][123090] Updated weights for policy 1, policy_version 582037 (0.0009) [2023-12-26 04:15:58,379][123090] Updated weights for policy 1, policy_version 582047 (0.0009) [2023-12-26 04:15:58,519][123091] Updated weights for policy 0, policy_version 586100 (0.0009) [2023-12-26 04:15:58,589][123091] Updated weights for policy 0, policy_version 586110 (0.0008) [2023-12-26 04:15:58,666][123091] Updated weights for policy 0, policy_version 586120 (0.0007) [2023-12-26 04:15:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 299057152. Throughput: 0: 8985.1, 1: 8798.9. Samples: 299047584. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:15:58,785][121949] Avg episode reward: [(0, '5858.496'), (1, '5821.272')] [2023-12-26 04:15:59,343][123090] Updated weights for policy 1, policy_version 582057 (0.0008) [2023-12-26 04:15:59,417][123090] Updated weights for policy 1, policy_version 582067 (0.0009) [2023-12-26 04:15:59,483][123090] Updated weights for policy 1, policy_version 582077 (0.0006) [2023-12-26 04:15:59,525][123091] Updated weights for policy 0, policy_version 586130 (0.0010) [2023-12-26 04:15:59,587][123091] Updated weights for policy 0, policy_version 586140 (0.0011) [2023-12-26 04:15:59,655][123091] Updated weights for policy 0, policy_version 586150 (0.0010) [2023-12-26 04:15:59,720][123091] Updated weights for policy 0, policy_version 586160 (0.0011) [2023-12-26 04:16:00,259][123090] Updated weights for policy 1, policy_version 582087 (0.0006) [2023-12-26 04:16:00,334][123090] Updated weights for policy 1, policy_version 582097 (0.0005) [2023-12-26 04:16:00,404][123090] Updated weights for policy 1, policy_version 582107 (0.0007) [2023-12-26 04:16:00,534][123091] Updated weights for policy 0, policy_version 586170 (0.0006) [2023-12-26 04:16:00,603][123091] Updated weights for policy 0, policy_version 586180 (0.0007) [2023-12-26 04:16:00,668][123091] Updated weights for policy 0, policy_version 586190 (0.0006) [2023-12-26 04:16:01,031][123090] Updated weights for policy 1, policy_version 582117 (0.0007) [2023-12-26 04:16:01,099][123090] Updated weights for policy 1, policy_version 582127 (0.0007) [2023-12-26 04:16:01,172][123090] Updated weights for policy 1, policy_version 582137 (0.0007) [2023-12-26 04:16:01,434][123091] Updated weights for policy 0, policy_version 586200 (0.0008) [2023-12-26 04:16:01,505][123091] Updated weights for policy 0, policy_version 586210 (0.0009) [2023-12-26 04:16:01,568][123091] Updated weights for policy 0, policy_version 586220 (0.0008) [2023-12-26 04:16:01,968][123090] Updated weights for policy 1, policy_version 582147 (0.0007) [2023-12-26 04:16:02,031][123090] Updated weights for policy 1, policy_version 582157 (0.0009) [2023-12-26 04:16:02,088][123090] Updated weights for policy 1, policy_version 582167 (0.0009) [2023-12-26 04:16:02,430][123091] Updated weights for policy 0, policy_version 586230 (0.0009) [2023-12-26 04:16:02,489][123091] Updated weights for policy 0, policy_version 586240 (0.0010) [2023-12-26 04:16:02,548][123091] Updated weights for policy 0, policy_version 586250 (0.0010) [2023-12-26 04:16:02,901][123090] Updated weights for policy 1, policy_version 582177 (0.0010) [2023-12-26 04:16:02,954][123090] Updated weights for policy 1, policy_version 582187 (0.0011) [2023-12-26 04:16:03,019][123090] Updated weights for policy 1, policy_version 582197 (0.0011) [2023-12-26 04:16:03,092][123090] Updated weights for policy 1, policy_version 582207 (0.0006) [2023-12-26 04:16:03,420][123091] Updated weights for policy 0, policy_version 586260 (0.0010) [2023-12-26 04:16:03,489][123091] Updated weights for policy 0, policy_version 586270 (0.0010) [2023-12-26 04:16:03,540][123091] Updated weights for policy 0, policy_version 586280 (0.0009) [2023-12-26 04:16:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 299139072. Throughput: 0: 8909.3, 1: 8758.1. Samples: 299150500. Policy #0 lag: (min: 25.0, avg: 53.3, max: 56.0) [2023-12-26 04:16:03,785][121949] Avg episode reward: [(0, '5956.616'), (1, '5728.512')] [2023-12-26 04:16:03,793][123090] Updated weights for policy 1, policy_version 582217 (0.0005) [2023-12-26 04:16:03,856][123090] Updated weights for policy 1, policy_version 582227 (0.0007) [2023-12-26 04:16:03,926][123090] Updated weights for policy 1, policy_version 582237 (0.0011) [2023-12-26 04:16:04,445][123091] Updated weights for policy 0, policy_version 586290 (0.0010) [2023-12-26 04:16:04,514][123091] Updated weights for policy 0, policy_version 586300 (0.0009) [2023-12-26 04:16:04,581][123091] Updated weights for policy 0, policy_version 586310 (0.0009) [2023-12-26 04:16:04,646][123091] Updated weights for policy 0, policy_version 586320 (0.0009) [2023-12-26 04:16:04,756][123090] Updated weights for policy 1, policy_version 582247 (0.0010) [2023-12-26 04:16:04,827][123090] Updated weights for policy 1, policy_version 582257 (0.0011) [2023-12-26 04:16:04,882][123090] Updated weights for policy 1, policy_version 582267 (0.0010) [2023-12-26 04:16:05,514][123090] Updated weights for policy 1, policy_version 582277 (0.0008) [2023-12-26 04:16:05,516][123091] Updated weights for policy 0, policy_version 586330 (0.0009) [2023-12-26 04:16:05,564][123090] Updated weights for policy 1, policy_version 582287 (0.0005) [2023-12-26 04:16:05,570][123091] Updated weights for policy 0, policy_version 586340 (0.0009) [2023-12-26 04:16:05,614][123090] Updated weights for policy 1, policy_version 582297 (0.0005) [2023-12-26 04:16:05,626][123091] Updated weights for policy 0, policy_version 586350 (0.0011) [2023-12-26 04:16:06,419][123090] Updated weights for policy 1, policy_version 582307 (0.0005) [2023-12-26 04:16:06,474][123091] Updated weights for policy 0, policy_version 586360 (0.0011) [2023-12-26 04:16:06,485][123090] Updated weights for policy 1, policy_version 582317 (0.0009) [2023-12-26 04:16:06,538][123091] Updated weights for policy 0, policy_version 586370 (0.0011) [2023-12-26 04:16:06,550][123090] Updated weights for policy 1, policy_version 582327 (0.0007) [2023-12-26 04:16:06,604][123091] Updated weights for policy 0, policy_version 586380 (0.0010) [2023-12-26 04:16:07,282][123090] Updated weights for policy 1, policy_version 582337 (0.0008) [2023-12-26 04:16:07,337][123090] Updated weights for policy 1, policy_version 582347 (0.0005) [2023-12-26 04:16:07,386][123090] Updated weights for policy 1, policy_version 582357 (0.0006) [2023-12-26 04:16:07,423][123091] Updated weights for policy 0, policy_version 586390 (0.0011) [2023-12-26 04:16:07,441][123090] Updated weights for policy 1, policy_version 582367 (0.0008) [2023-12-26 04:16:07,494][123091] Updated weights for policy 0, policy_version 586400 (0.0011) [2023-12-26 04:16:07,562][123091] Updated weights for policy 0, policy_version 586410 (0.0009) [2023-12-26 04:16:08,149][123090] Updated weights for policy 1, policy_version 582377 (0.0006) [2023-12-26 04:16:08,210][123090] Updated weights for policy 1, policy_version 582387 (0.0005) [2023-12-26 04:16:08,279][123090] Updated weights for policy 1, policy_version 582397 (0.0006) [2023-12-26 04:16:08,290][123091] Updated weights for policy 0, policy_version 586420 (0.0005) [2023-12-26 04:16:08,359][123091] Updated weights for policy 0, policy_version 586430 (0.0007) [2023-12-26 04:16:08,409][123091] Updated weights for policy 0, policy_version 586440 (0.0006) [2023-12-26 04:16:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 299229184. Throughput: 0: 8855.3, 1: 8785.7. Samples: 299201880. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:08,785][121949] Avg episode reward: [(0, '6095.225'), (1, '5781.049')] [2023-12-26 04:16:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000586448_150134784.pth... [2023-12-26 04:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000582400_149094400.pth... [2023-12-26 04:16:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000585424_149872640.pth [2023-12-26 04:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000581376_148832256.pth [2023-12-26 04:16:09,083][123090] Updated weights for policy 1, policy_version 582407 (0.0009) [2023-12-26 04:16:09,142][123090] Updated weights for policy 1, policy_version 582417 (0.0010) [2023-12-26 04:16:09,167][123091] Updated weights for policy 0, policy_version 586450 (0.0005) [2023-12-26 04:16:09,209][123090] Updated weights for policy 1, policy_version 582427 (0.0010) [2023-12-26 04:16:09,244][123091] Updated weights for policy 0, policy_version 586460 (0.0008) [2023-12-26 04:16:09,308][123091] Updated weights for policy 0, policy_version 586470 (0.0011) [2023-12-26 04:16:09,379][123091] Updated weights for policy 0, policy_version 586480 (0.0011) [2023-12-26 04:16:10,116][123090] Updated weights for policy 1, policy_version 582437 (0.0008) [2023-12-26 04:16:10,170][123091] Updated weights for policy 0, policy_version 586490 (0.0006) [2023-12-26 04:16:10,188][123090] Updated weights for policy 1, policy_version 582447 (0.0009) [2023-12-26 04:16:10,232][123091] Updated weights for policy 0, policy_version 586500 (0.0006) [2023-12-26 04:16:10,254][123090] Updated weights for policy 1, policy_version 582457 (0.0009) [2023-12-26 04:16:10,293][123091] Updated weights for policy 0, policy_version 586510 (0.0009) [2023-12-26 04:16:10,972][123090] Updated weights for policy 1, policy_version 582467 (0.0008) [2023-12-26 04:16:11,010][123091] Updated weights for policy 0, policy_version 586520 (0.0007) [2023-12-26 04:16:11,030][123090] Updated weights for policy 1, policy_version 582477 (0.0009) [2023-12-26 04:16:11,076][123091] Updated weights for policy 0, policy_version 586530 (0.0011) [2023-12-26 04:16:11,101][123090] Updated weights for policy 1, policy_version 582487 (0.0007) [2023-12-26 04:16:11,140][123091] Updated weights for policy 0, policy_version 586540 (0.0010) [2023-12-26 04:16:11,934][123090] Updated weights for policy 1, policy_version 582497 (0.0008) [2023-12-26 04:16:11,942][123091] Updated weights for policy 0, policy_version 586550 (0.0010) [2023-12-26 04:16:11,995][123091] Updated weights for policy 0, policy_version 586560 (0.0009) [2023-12-26 04:16:12,004][123090] Updated weights for policy 1, policy_version 582507 (0.0009) [2023-12-26 04:16:12,053][123091] Updated weights for policy 0, policy_version 586570 (0.0009) [2023-12-26 04:16:12,062][123090] Updated weights for policy 1, policy_version 582517 (0.0009) [2023-12-26 04:16:12,124][123090] Updated weights for policy 1, policy_version 582527 (0.0009) [2023-12-26 04:16:12,876][123091] Updated weights for policy 0, policy_version 586580 (0.0009) [2023-12-26 04:16:12,935][123091] Updated weights for policy 0, policy_version 586590 (0.0010) [2023-12-26 04:16:12,986][123091] Updated weights for policy 0, policy_version 586601 (0.0010) [2023-12-26 04:16:13,013][123090] Updated weights for policy 1, policy_version 582537 (0.0006) [2023-12-26 04:16:13,073][123090] Updated weights for policy 1, policy_version 582547 (0.0005) [2023-12-26 04:16:13,145][123090] Updated weights for policy 1, policy_version 582557 (0.0007) [2023-12-26 04:16:13,759][123091] Updated weights for policy 0, policy_version 586611 (0.0008) [2023-12-26 04:16:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 299311104. Throughput: 0: 8851.1, 1: 8703.4. Samples: 299308640. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:13,784][121949] Avg episode reward: [(0, '6099.426'), (1, '5881.741')] [2023-12-26 04:16:13,804][123091] Updated weights for policy 0, policy_version 586621 (0.0005) [2023-12-26 04:16:13,852][123091] Updated weights for policy 0, policy_version 586631 (0.0005) [2023-12-26 04:16:13,952][123090] Updated weights for policy 1, policy_version 582567 (0.0008) [2023-12-26 04:16:14,005][123090] Updated weights for policy 1, policy_version 582577 (0.0009) [2023-12-26 04:16:14,059][123090] Updated weights for policy 1, policy_version 582587 (0.0010) [2023-12-26 04:16:14,603][123091] Updated weights for policy 0, policy_version 586641 (0.0005) [2023-12-26 04:16:14,655][123091] Updated weights for policy 0, policy_version 586651 (0.0007) [2023-12-26 04:16:14,720][123091] Updated weights for policy 0, policy_version 586661 (0.0009) [2023-12-26 04:16:14,781][123091] Updated weights for policy 0, policy_version 586671 (0.0007) [2023-12-26 04:16:14,934][123090] Updated weights for policy 1, policy_version 582597 (0.0008) [2023-12-26 04:16:15,009][123090] Updated weights for policy 1, policy_version 582607 (0.0006) [2023-12-26 04:16:15,079][123090] Updated weights for policy 1, policy_version 582617 (0.0008) [2023-12-26 04:16:15,597][123091] Updated weights for policy 0, policy_version 586681 (0.0008) [2023-12-26 04:16:15,652][123091] Updated weights for policy 0, policy_version 586691 (0.0005) [2023-12-26 04:16:15,708][123091] Updated weights for policy 0, policy_version 586701 (0.0005) [2023-12-26 04:16:15,773][123090] Updated weights for policy 1, policy_version 582627 (0.0009) [2023-12-26 04:16:15,839][123090] Updated weights for policy 1, policy_version 582637 (0.0008) [2023-12-26 04:16:15,911][123090] Updated weights for policy 1, policy_version 582647 (0.0005) [2023-12-26 04:16:16,511][123091] Updated weights for policy 0, policy_version 586711 (0.0008) [2023-12-26 04:16:16,574][123091] Updated weights for policy 0, policy_version 586721 (0.0009) [2023-12-26 04:16:16,588][123090] Updated weights for policy 1, policy_version 582657 (0.0006) [2023-12-26 04:16:16,637][123091] Updated weights for policy 0, policy_version 586731 (0.0008) [2023-12-26 04:16:16,649][123090] Updated weights for policy 1, policy_version 582667 (0.0008) [2023-12-26 04:16:16,700][123090] Updated weights for policy 1, policy_version 582677 (0.0008) [2023-12-26 04:16:16,760][123090] Updated weights for policy 1, policy_version 582687 (0.0008) [2023-12-26 04:16:17,457][123091] Updated weights for policy 0, policy_version 586741 (0.0009) [2023-12-26 04:16:17,488][123090] Updated weights for policy 1, policy_version 582697 (0.0010) [2023-12-26 04:16:17,519][123091] Updated weights for policy 0, policy_version 586751 (0.0009) [2023-12-26 04:16:17,541][123090] Updated weights for policy 1, policy_version 582707 (0.0008) [2023-12-26 04:16:17,581][123091] Updated weights for policy 0, policy_version 586761 (0.0008) [2023-12-26 04:16:17,609][123090] Updated weights for policy 1, policy_version 582717 (0.0007) [2023-12-26 04:16:18,372][123091] Updated weights for policy 0, policy_version 586771 (0.0009) [2023-12-26 04:16:18,435][123091] Updated weights for policy 0, policy_version 586781 (0.0010) [2023-12-26 04:16:18,464][123090] Updated weights for policy 1, policy_version 582727 (0.0007) [2023-12-26 04:16:18,497][123091] Updated weights for policy 0, policy_version 586791 (0.0009) [2023-12-26 04:16:18,526][123090] Updated weights for policy 1, policy_version 582737 (0.0009) [2023-12-26 04:16:18,590][123090] Updated weights for policy 1, policy_version 582747 (0.0008) [2023-12-26 04:16:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 299409408. Throughput: 0: 8849.8, 1: 8728.4. Samples: 299416296. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:18,784][121949] Avg episode reward: [(0, '6037.541'), (1, '5846.791')] [2023-12-26 04:16:19,237][123091] Updated weights for policy 0, policy_version 586801 (0.0008) [2023-12-26 04:16:19,313][123091] Updated weights for policy 0, policy_version 586811 (0.0010) [2023-12-26 04:16:19,373][123090] Updated weights for policy 1, policy_version 582757 (0.0009) [2023-12-26 04:16:19,376][123091] Updated weights for policy 0, policy_version 586821 (0.0010) [2023-12-26 04:16:19,437][123090] Updated weights for policy 1, policy_version 582767 (0.0008) [2023-12-26 04:16:19,439][123091] Updated weights for policy 0, policy_version 586831 (0.0008) [2023-12-26 04:16:19,498][123090] Updated weights for policy 1, policy_version 582777 (0.0010) [2023-12-26 04:16:20,322][123091] Updated weights for policy 0, policy_version 586841 (0.0010) [2023-12-26 04:16:20,334][123090] Updated weights for policy 1, policy_version 582787 (0.0009) [2023-12-26 04:16:20,380][123091] Updated weights for policy 0, policy_version 586851 (0.0009) [2023-12-26 04:16:20,403][123090] Updated weights for policy 1, policy_version 582797 (0.0010) [2023-12-26 04:16:20,444][123091] Updated weights for policy 0, policy_version 586861 (0.0008) [2023-12-26 04:16:20,472][123090] Updated weights for policy 1, policy_version 582807 (0.0007) [2023-12-26 04:16:21,288][123091] Updated weights for policy 0, policy_version 586871 (0.0009) [2023-12-26 04:16:21,300][123090] Updated weights for policy 1, policy_version 582817 (0.0009) [2023-12-26 04:16:21,343][123091] Updated weights for policy 0, policy_version 586881 (0.0008) [2023-12-26 04:16:21,359][123090] Updated weights for policy 1, policy_version 582827 (0.0007) [2023-12-26 04:16:21,439][123090] Updated weights for policy 1, policy_version 582837 (0.0008) [2023-12-26 04:16:21,441][123091] Updated weights for policy 0, policy_version 586891 (0.0009) [2023-12-26 04:16:21,512][123090] Updated weights for policy 1, policy_version 582847 (0.0009) [2023-12-26 04:16:22,283][123091] Updated weights for policy 0, policy_version 586901 (0.0009) [2023-12-26 04:16:22,342][123091] Updated weights for policy 0, policy_version 586911 (0.0008) [2023-12-26 04:16:22,356][123090] Updated weights for policy 1, policy_version 582857 (0.0008) [2023-12-26 04:16:22,411][123091] Updated weights for policy 0, policy_version 586921 (0.0008) [2023-12-26 04:16:22,429][123090] Updated weights for policy 1, policy_version 582867 (0.0007) [2023-12-26 04:16:22,495][123090] Updated weights for policy 1, policy_version 582877 (0.0005) [2023-12-26 04:16:23,198][123091] Updated weights for policy 0, policy_version 586931 (0.0008) [2023-12-26 04:16:23,239][123090] Updated weights for policy 1, policy_version 582887 (0.0008) [2023-12-26 04:16:23,263][123091] Updated weights for policy 0, policy_version 586941 (0.0008) [2023-12-26 04:16:23,293][123090] Updated weights for policy 1, policy_version 582897 (0.0007) [2023-12-26 04:16:23,318][123091] Updated weights for policy 0, policy_version 586951 (0.0009) [2023-12-26 04:16:23,352][123090] Updated weights for policy 1, policy_version 582907 (0.0008) [2023-12-26 04:16:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 299491328. Throughput: 0: 8796.2, 1: 8670.2. Samples: 299466828. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:23,785][121949] Avg episode reward: [(0, '6044.636'), (1, '5855.021')] [2023-12-26 04:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000586960_150265856.pth... [2023-12-26 04:16:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000582912_149225472.pth... [2023-12-26 04:16:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000585936_150003712.pth [2023-12-26 04:16:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000581888_148963328.pth [2023-12-26 04:16:24,151][123091] Updated weights for policy 0, policy_version 586961 (0.0009) [2023-12-26 04:16:24,205][123091] Updated weights for policy 0, policy_version 586971 (0.0010) [2023-12-26 04:16:24,209][123090] Updated weights for policy 1, policy_version 582917 (0.0007) [2023-12-26 04:16:24,258][123091] Updated weights for policy 0, policy_version 586981 (0.0006) [2023-12-26 04:16:24,270][123090] Updated weights for policy 1, policy_version 582927 (0.0009) [2023-12-26 04:16:24,317][123091] Updated weights for policy 0, policy_version 586991 (0.0009) [2023-12-26 04:16:24,332][123090] Updated weights for policy 1, policy_version 582937 (0.0008) [2023-12-26 04:16:24,881][123090] Updated weights for policy 1, policy_version 582947 (0.0005) [2023-12-26 04:16:24,945][123090] Updated weights for policy 1, policy_version 582957 (0.0006) [2023-12-26 04:16:24,993][123090] Updated weights for policy 1, policy_version 582967 (0.0010) [2023-12-26 04:16:25,214][123091] Updated weights for policy 0, policy_version 587001 (0.0009) [2023-12-26 04:16:25,278][123091] Updated weights for policy 0, policy_version 587011 (0.0009) [2023-12-26 04:16:25,336][123091] Updated weights for policy 0, policy_version 587021 (0.0008) [2023-12-26 04:16:25,782][123090] Updated weights for policy 1, policy_version 582977 (0.0010) [2023-12-26 04:16:25,845][123090] Updated weights for policy 1, policy_version 582987 (0.0009) [2023-12-26 04:16:25,908][123090] Updated weights for policy 1, policy_version 582997 (0.0006) [2023-12-26 04:16:25,982][123090] Updated weights for policy 1, policy_version 583007 (0.0005) [2023-12-26 04:16:26,185][123091] Updated weights for policy 0, policy_version 587031 (0.0009) [2023-12-26 04:16:26,239][123091] Updated weights for policy 0, policy_version 587041 (0.0010) [2023-12-26 04:16:26,296][123091] Updated weights for policy 0, policy_version 587051 (0.0010) [2023-12-26 04:16:26,651][123090] Updated weights for policy 1, policy_version 583017 (0.0010) [2023-12-26 04:16:26,713][123090] Updated weights for policy 1, policy_version 583027 (0.0010) [2023-12-26 04:16:26,775][123090] Updated weights for policy 1, policy_version 583037 (0.0010) [2023-12-26 04:16:27,186][123091] Updated weights for policy 0, policy_version 587062 (0.0010) [2023-12-26 04:16:27,238][123091] Updated weights for policy 0, policy_version 587072 (0.0010) [2023-12-26 04:16:27,289][123091] Updated weights for policy 0, policy_version 587082 (0.0009) [2023-12-26 04:16:27,457][123090] Updated weights for policy 1, policy_version 583047 (0.0010) [2023-12-26 04:16:27,511][123090] Updated weights for policy 1, policy_version 583057 (0.0010) [2023-12-26 04:16:27,580][123090] Updated weights for policy 1, policy_version 583067 (0.0010) [2023-12-26 04:16:28,143][123091] Updated weights for policy 0, policy_version 587092 (0.0010) [2023-12-26 04:16:28,191][123091] Updated weights for policy 0, policy_version 587102 (0.0009) [2023-12-26 04:16:28,243][123091] Updated weights for policy 0, policy_version 587112 (0.0010) [2023-12-26 04:16:28,366][123090] Updated weights for policy 1, policy_version 583077 (0.0009) [2023-12-26 04:16:28,435][123090] Updated weights for policy 1, policy_version 583087 (0.0007) [2023-12-26 04:16:28,496][123090] Updated weights for policy 1, policy_version 583097 (0.0009) [2023-12-26 04:16:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 299581440. Throughput: 0: 8760.5, 1: 8818.2. Samples: 299573324. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:28,785][121949] Avg episode reward: [(0, '6141.675'), (1, '5819.234')] [2023-12-26 04:16:29,111][123091] Updated weights for policy 0, policy_version 587123 (0.0010) [2023-12-26 04:16:29,158][123091] Updated weights for policy 0, policy_version 587133 (0.0009) [2023-12-26 04:16:29,207][123091] Updated weights for policy 0, policy_version 587143 (0.0009) [2023-12-26 04:16:29,289][123090] Updated weights for policy 1, policy_version 583107 (0.0010) [2023-12-26 04:16:29,349][123090] Updated weights for policy 1, policy_version 583117 (0.0009) [2023-12-26 04:16:29,397][123090] Updated weights for policy 1, policy_version 583127 (0.0010) [2023-12-26 04:16:30,093][123091] Updated weights for policy 0, policy_version 587153 (0.0011) [2023-12-26 04:16:30,141][123091] Updated weights for policy 0, policy_version 587163 (0.0009) [2023-12-26 04:16:30,191][123091] Updated weights for policy 0, policy_version 587173 (0.0006) [2023-12-26 04:16:30,221][123090] Updated weights for policy 1, policy_version 583137 (0.0010) [2023-12-26 04:16:30,244][123091] Updated weights for policy 0, policy_version 587183 (0.0006) [2023-12-26 04:16:30,289][123090] Updated weights for policy 1, policy_version 583147 (0.0010) [2023-12-26 04:16:30,344][123090] Updated weights for policy 1, policy_version 583157 (0.0010) [2023-12-26 04:16:30,402][123090] Updated weights for policy 1, policy_version 583167 (0.0009) [2023-12-26 04:16:30,948][123091] Updated weights for policy 0, policy_version 587193 (0.0005) [2023-12-26 04:16:30,993][123091] Updated weights for policy 0, policy_version 587203 (0.0005) [2023-12-26 04:16:31,048][123091] Updated weights for policy 0, policy_version 587213 (0.0007) [2023-12-26 04:16:31,274][123090] Updated weights for policy 1, policy_version 583177 (0.0009) [2023-12-26 04:16:31,323][123090] Updated weights for policy 1, policy_version 583187 (0.0009) [2023-12-26 04:16:31,394][123090] Updated weights for policy 1, policy_version 583197 (0.0009) [2023-12-26 04:16:31,754][123091] Updated weights for policy 0, policy_version 587223 (0.0009) [2023-12-26 04:16:31,819][123091] Updated weights for policy 0, policy_version 587233 (0.0008) [2023-12-26 04:16:31,884][123091] Updated weights for policy 0, policy_version 587243 (0.0008) [2023-12-26 04:16:32,202][123090] Updated weights for policy 1, policy_version 583207 (0.0009) [2023-12-26 04:16:32,261][123090] Updated weights for policy 1, policy_version 583217 (0.0009) [2023-12-26 04:16:32,325][123090] Updated weights for policy 1, policy_version 583227 (0.0009) [2023-12-26 04:16:32,702][123091] Updated weights for policy 0, policy_version 587253 (0.0009) [2023-12-26 04:16:32,750][123091] Updated weights for policy 0, policy_version 587263 (0.0010) [2023-12-26 04:16:32,805][123091] Updated weights for policy 0, policy_version 587273 (0.0011) [2023-12-26 04:16:33,205][123090] Updated weights for policy 1, policy_version 583237 (0.0009) [2023-12-26 04:16:33,257][123090] Updated weights for policy 1, policy_version 583247 (0.0009) [2023-12-26 04:16:33,311][123090] Updated weights for policy 1, policy_version 583257 (0.0008) [2023-12-26 04:16:33,638][123091] Updated weights for policy 0, policy_version 587283 (0.0011) [2023-12-26 04:16:33,692][123091] Updated weights for policy 0, policy_version 587293 (0.0010) [2023-12-26 04:16:33,769][123091] Updated weights for policy 0, policy_version 587303 (0.0010) [2023-12-26 04:16:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 299663360. Throughput: 0: 8697.4, 1: 8801.1. Samples: 299678196. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:33,785][121949] Avg episode reward: [(0, '6213.150'), (1, '5722.853')] [2023-12-26 04:16:34,031][123090] Updated weights for policy 1, policy_version 583267 (0.0008) [2023-12-26 04:16:34,082][123090] Updated weights for policy 1, policy_version 583277 (0.0005) [2023-12-26 04:16:34,143][123090] Updated weights for policy 1, policy_version 583287 (0.0006) [2023-12-26 04:16:34,594][123091] Updated weights for policy 0, policy_version 587313 (0.0011) [2023-12-26 04:16:34,650][123091] Updated weights for policy 0, policy_version 587323 (0.0010) [2023-12-26 04:16:34,710][123091] Updated weights for policy 0, policy_version 587333 (0.0011) [2023-12-26 04:16:34,762][123091] Updated weights for policy 0, policy_version 587343 (0.0009) [2023-12-26 04:16:34,917][123090] Updated weights for policy 1, policy_version 583297 (0.0008) [2023-12-26 04:16:34,966][123090] Updated weights for policy 1, policy_version 583307 (0.0005) [2023-12-26 04:16:35,016][123090] Updated weights for policy 1, policy_version 583317 (0.0005) [2023-12-26 04:16:35,080][123090] Updated weights for policy 1, policy_version 583327 (0.0005) [2023-12-26 04:16:35,543][123091] Updated weights for policy 0, policy_version 587353 (0.0005) [2023-12-26 04:16:35,602][123091] Updated weights for policy 0, policy_version 587363 (0.0005) [2023-12-26 04:16:35,664][123091] Updated weights for policy 0, policy_version 587373 (0.0005) [2023-12-26 04:16:35,725][123090] Updated weights for policy 1, policy_version 583337 (0.0009) [2023-12-26 04:16:35,784][123090] Updated weights for policy 1, policy_version 583347 (0.0010) [2023-12-26 04:16:35,849][123090] Updated weights for policy 1, policy_version 583357 (0.0009) [2023-12-26 04:16:36,374][123091] Updated weights for policy 0, policy_version 587383 (0.0009) [2023-12-26 04:16:36,439][123091] Updated weights for policy 0, policy_version 587393 (0.0009) [2023-12-26 04:16:36,508][123091] Updated weights for policy 0, policy_version 587403 (0.0009) [2023-12-26 04:16:36,645][123090] Updated weights for policy 1, policy_version 583367 (0.0009) [2023-12-26 04:16:36,701][123090] Updated weights for policy 1, policy_version 583377 (0.0011) [2023-12-26 04:16:36,762][123090] Updated weights for policy 1, policy_version 583387 (0.0009) [2023-12-26 04:16:37,311][123091] Updated weights for policy 0, policy_version 587413 (0.0007) [2023-12-26 04:16:37,369][123091] Updated weights for policy 0, policy_version 587423 (0.0005) [2023-12-26 04:16:37,419][123091] Updated weights for policy 0, policy_version 587433 (0.0005) [2023-12-26 04:16:37,619][123090] Updated weights for policy 1, policy_version 583397 (0.0009) [2023-12-26 04:16:37,675][123090] Updated weights for policy 1, policy_version 583407 (0.0009) [2023-12-26 04:16:37,740][123090] Updated weights for policy 1, policy_version 583417 (0.0009) [2023-12-26 04:16:38,205][123091] Updated weights for policy 0, policy_version 587443 (0.0007) [2023-12-26 04:16:38,253][123091] Updated weights for policy 0, policy_version 587453 (0.0010) [2023-12-26 04:16:38,311][123091] Updated weights for policy 0, policy_version 587463 (0.0010) [2023-12-26 04:16:38,607][123090] Updated weights for policy 1, policy_version 583427 (0.0009) [2023-12-26 04:16:38,660][123090] Updated weights for policy 1, policy_version 583437 (0.0008) [2023-12-26 04:16:38,721][123090] Updated weights for policy 1, policy_version 583447 (0.0009) [2023-12-26 04:16:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 299761664. Throughput: 0: 8758.1, 1: 8857.9. Samples: 299734544. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:38,785][121949] Avg episode reward: [(0, '6260.144'), (1, '5763.656')] [2023-12-26 04:16:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000587472_150396928.pth... [2023-12-26 04:16:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000583456_149364736.pth... [2023-12-26 04:16:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000586448_150134784.pth [2023-12-26 04:16:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000582400_149094400.pth [2023-12-26 04:16:39,157][123091] Updated weights for policy 0, policy_version 587473 (0.0011) [2023-12-26 04:16:39,223][123091] Updated weights for policy 0, policy_version 587483 (0.0010) [2023-12-26 04:16:39,294][123091] Updated weights for policy 0, policy_version 587493 (0.0011) [2023-12-26 04:16:39,350][123091] Updated weights for policy 0, policy_version 587503 (0.0010) [2023-12-26 04:16:39,571][123090] Updated weights for policy 1, policy_version 583457 (0.0009) [2023-12-26 04:16:39,631][123090] Updated weights for policy 1, policy_version 583467 (0.0010) [2023-12-26 04:16:39,679][123090] Updated weights for policy 1, policy_version 583477 (0.0010) [2023-12-26 04:16:39,735][123090] Updated weights for policy 1, policy_version 583487 (0.0010) [2023-12-26 04:16:40,166][123091] Updated weights for policy 0, policy_version 587513 (0.0010) [2023-12-26 04:16:40,224][123091] Updated weights for policy 0, policy_version 587523 (0.0010) [2023-12-26 04:16:40,279][123091] Updated weights for policy 0, policy_version 587533 (0.0009) [2023-12-26 04:16:40,503][123090] Updated weights for policy 1, policy_version 583497 (0.0006) [2023-12-26 04:16:40,566][123090] Updated weights for policy 1, policy_version 583507 (0.0009) [2023-12-26 04:16:40,640][123090] Updated weights for policy 1, policy_version 583517 (0.0010) [2023-12-26 04:16:41,177][123091] Updated weights for policy 0, policy_version 587543 (0.0008) [2023-12-26 04:16:41,245][123091] Updated weights for policy 0, policy_version 587553 (0.0009) [2023-12-26 04:16:41,310][123091] Updated weights for policy 0, policy_version 587563 (0.0009) [2023-12-26 04:16:41,394][123090] Updated weights for policy 1, policy_version 583527 (0.0008) [2023-12-26 04:16:41,459][123090] Updated weights for policy 1, policy_version 583537 (0.0008) [2023-12-26 04:16:41,525][123090] Updated weights for policy 1, policy_version 583547 (0.0008) [2023-12-26 04:16:42,170][123091] Updated weights for policy 0, policy_version 587573 (0.0009) [2023-12-26 04:16:42,229][123091] Updated weights for policy 0, policy_version 587583 (0.0010) [2023-12-26 04:16:42,292][123091] Updated weights for policy 0, policy_version 587593 (0.0009) [2023-12-26 04:16:42,322][123090] Updated weights for policy 1, policy_version 583557 (0.0007) [2023-12-26 04:16:42,393][123090] Updated weights for policy 1, policy_version 583567 (0.0009) [2023-12-26 04:16:42,452][123090] Updated weights for policy 1, policy_version 583577 (0.0009) [2023-12-26 04:16:43,175][123091] Updated weights for policy 0, policy_version 587603 (0.0009) [2023-12-26 04:16:43,227][123091] Updated weights for policy 0, policy_version 587613 (0.0009) [2023-12-26 04:16:43,247][123090] Updated weights for policy 1, policy_version 583588 (0.0009) [2023-12-26 04:16:43,288][123091] Updated weights for policy 0, policy_version 587623 (0.0010) [2023-12-26 04:16:43,310][123090] Updated weights for policy 1, policy_version 583598 (0.0009) [2023-12-26 04:16:43,375][123090] Updated weights for policy 1, policy_version 583608 (0.0010) [2023-12-26 04:16:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 299843584. Throughput: 0: 8625.7, 1: 8914.4. Samples: 299836888. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:43,784][121949] Avg episode reward: [(0, '6272.076'), (1, '5781.082')] [2023-12-26 04:16:44,081][123091] Updated weights for policy 0, policy_version 587633 (0.0007) [2023-12-26 04:16:44,135][123091] Updated weights for policy 0, policy_version 587643 (0.0006) [2023-12-26 04:16:44,204][123091] Updated weights for policy 0, policy_version 587653 (0.0007) [2023-12-26 04:16:44,221][123090] Updated weights for policy 1, policy_version 583618 (0.0008) [2023-12-26 04:16:44,266][123091] Updated weights for policy 0, policy_version 587663 (0.0010) [2023-12-26 04:16:44,281][123090] Updated weights for policy 1, policy_version 583628 (0.0007) [2023-12-26 04:16:44,348][123090] Updated weights for policy 1, policy_version 583638 (0.0009) [2023-12-26 04:16:44,420][123090] Updated weights for policy 1, policy_version 583648 (0.0007) [2023-12-26 04:16:45,044][123091] Updated weights for policy 0, policy_version 587673 (0.0010) [2023-12-26 04:16:45,104][123091] Updated weights for policy 0, policy_version 587683 (0.0010) [2023-12-26 04:16:45,169][123091] Updated weights for policy 0, policy_version 587693 (0.0009) [2023-12-26 04:16:45,170][123090] Updated weights for policy 1, policy_version 583658 (0.0007) [2023-12-26 04:16:45,234][123090] Updated weights for policy 1, policy_version 583668 (0.0007) [2023-12-26 04:16:45,307][123090] Updated weights for policy 1, policy_version 583678 (0.0009) [2023-12-26 04:16:45,908][123091] Updated weights for policy 0, policy_version 587703 (0.0010) [2023-12-26 04:16:45,952][123091] Updated weights for policy 0, policy_version 587713 (0.0007) [2023-12-26 04:16:46,007][123091] Updated weights for policy 0, policy_version 587723 (0.0005) [2023-12-26 04:16:46,182][123090] Updated weights for policy 1, policy_version 583688 (0.0010) [2023-12-26 04:16:46,240][123090] Updated weights for policy 1, policy_version 583698 (0.0009) [2023-12-26 04:16:46,288][123090] Updated weights for policy 1, policy_version 583708 (0.0008) [2023-12-26 04:16:46,649][123091] Updated weights for policy 0, policy_version 587733 (0.0007) [2023-12-26 04:16:46,711][123091] Updated weights for policy 0, policy_version 587743 (0.0010) [2023-12-26 04:16:46,773][123091] Updated weights for policy 0, policy_version 587753 (0.0010) [2023-12-26 04:16:47,170][123090] Updated weights for policy 1, policy_version 583718 (0.0009) [2023-12-26 04:16:47,228][123090] Updated weights for policy 1, policy_version 583728 (0.0009) [2023-12-26 04:16:47,288][123090] Updated weights for policy 1, policy_version 583738 (0.0009) [2023-12-26 04:16:47,487][123091] Updated weights for policy 0, policy_version 587763 (0.0009) [2023-12-26 04:16:47,541][123091] Updated weights for policy 0, policy_version 587773 (0.0005) [2023-12-26 04:16:47,594][123091] Updated weights for policy 0, policy_version 587783 (0.0006) [2023-12-26 04:16:48,128][123090] Updated weights for policy 1, policy_version 583749 (0.0009) [2023-12-26 04:16:48,192][123090] Updated weights for policy 1, policy_version 583759 (0.0005) [2023-12-26 04:16:48,249][123090] Updated weights for policy 1, policy_version 583769 (0.0006) [2023-12-26 04:16:48,299][123091] Updated weights for policy 0, policy_version 587793 (0.0010) [2023-12-26 04:16:48,371][123091] Updated weights for policy 0, policy_version 587803 (0.0007) [2023-12-26 04:16:48,438][123091] Updated weights for policy 0, policy_version 587813 (0.0008) [2023-12-26 04:16:48,505][123091] Updated weights for policy 0, policy_version 587823 (0.0008) [2023-12-26 04:16:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 299933696. Throughput: 0: 8781.0, 1: 8873.1. Samples: 299944940. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:48,785][121949] Avg episode reward: [(0, '6221.196'), (1, '5803.801')] [2023-12-26 04:16:48,962][123090] Updated weights for policy 1, policy_version 583779 (0.0006) [2023-12-26 04:16:49,035][123090] Updated weights for policy 1, policy_version 583789 (0.0006) [2023-12-26 04:16:49,094][123090] Updated weights for policy 1, policy_version 583799 (0.0006) [2023-12-26 04:16:49,342][123091] Updated weights for policy 0, policy_version 587833 (0.0009) [2023-12-26 04:16:49,412][123091] Updated weights for policy 0, policy_version 587843 (0.0009) [2023-12-26 04:16:49,474][123091] Updated weights for policy 0, policy_version 587853 (0.0008) [2023-12-26 04:16:49,871][123090] Updated weights for policy 1, policy_version 583809 (0.0010) [2023-12-26 04:16:49,944][123090] Updated weights for policy 1, policy_version 583819 (0.0009) [2023-12-26 04:16:50,007][123090] Updated weights for policy 1, policy_version 583829 (0.0010) [2023-12-26 04:16:50,076][123090] Updated weights for policy 1, policy_version 583839 (0.0010) [2023-12-26 04:16:50,284][123091] Updated weights for policy 0, policy_version 587863 (0.0007) [2023-12-26 04:16:50,331][123091] Updated weights for policy 0, policy_version 587873 (0.0005) [2023-12-26 04:16:50,395][123091] Updated weights for policy 0, policy_version 587883 (0.0006) [2023-12-26 04:16:50,860][123090] Updated weights for policy 1, policy_version 583849 (0.0009) [2023-12-26 04:16:50,931][123090] Updated weights for policy 1, policy_version 583859 (0.0006) [2023-12-26 04:16:51,000][123090] Updated weights for policy 1, policy_version 583869 (0.0009) [2023-12-26 04:16:51,075][123091] Updated weights for policy 0, policy_version 587893 (0.0007) [2023-12-26 04:16:51,145][123091] Updated weights for policy 0, policy_version 587903 (0.0007) [2023-12-26 04:16:51,215][123091] Updated weights for policy 0, policy_version 587913 (0.0008) [2023-12-26 04:16:51,832][123090] Updated weights for policy 1, policy_version 583879 (0.0011) [2023-12-26 04:16:51,903][123090] Updated weights for policy 1, policy_version 583889 (0.0009) [2023-12-26 04:16:51,971][123090] Updated weights for policy 1, policy_version 583899 (0.0009) [2023-12-26 04:16:52,003][123091] Updated weights for policy 0, policy_version 587923 (0.0008) [2023-12-26 04:16:52,101][123091] Updated weights for policy 0, policy_version 587933 (0.0006) [2023-12-26 04:16:52,160][123091] Updated weights for policy 0, policy_version 587943 (0.0005) [2023-12-26 04:16:52,794][123090] Updated weights for policy 1, policy_version 583909 (0.0007) [2023-12-26 04:16:52,861][123090] Updated weights for policy 1, policy_version 583919 (0.0005) [2023-12-26 04:16:52,907][123091] Updated weights for policy 0, policy_version 587953 (0.0006) [2023-12-26 04:16:52,933][123090] Updated weights for policy 1, policy_version 583929 (0.0005) [2023-12-26 04:16:52,971][123091] Updated weights for policy 0, policy_version 587963 (0.0009) [2023-12-26 04:16:53,024][123091] Updated weights for policy 0, policy_version 587973 (0.0007) [2023-12-26 04:16:53,098][123091] Updated weights for policy 0, policy_version 587983 (0.0005) [2023-12-26 04:16:53,481][123090] Updated weights for policy 1, policy_version 583939 (0.0006) [2023-12-26 04:16:53,532][123090] Updated weights for policy 1, policy_version 583949 (0.0010) [2023-12-26 04:16:53,583][123090] Updated weights for policy 1, policy_version 583959 (0.0008) [2023-12-26 04:16:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 300023808. Throughput: 0: 8830.9, 1: 8857.8. Samples: 299997876. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:53,785][121949] Avg episode reward: [(0, '6143.968'), (1, '5695.689')] [2023-12-26 04:16:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000583968_149495808.pth... [2023-12-26 04:16:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000582912_149225472.pth [2023-12-26 04:16:53,847][123091] Updated weights for policy 0, policy_version 587993 (0.0010) [2023-12-26 04:16:53,898][123091] Updated weights for policy 0, policy_version 588003 (0.0010) [2023-12-26 04:16:53,957][123091] Updated weights for policy 0, policy_version 588013 (0.0010) [2023-12-26 04:16:53,976][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000588016_150536192.pth... [2023-12-26 04:16:53,980][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000586960_150265856.pth [2023-12-26 04:16:54,253][123090] Updated weights for policy 1, policy_version 583969 (0.0006) [2023-12-26 04:16:54,342][123090] Updated weights for policy 1, policy_version 583979 (0.0007) [2023-12-26 04:16:54,404][123090] Updated weights for policy 1, policy_version 583989 (0.0006) [2023-12-26 04:16:54,477][123090] Updated weights for policy 1, policy_version 583999 (0.0006) [2023-12-26 04:16:54,752][123091] Updated weights for policy 0, policy_version 588023 (0.0007) [2023-12-26 04:16:54,812][123091] Updated weights for policy 0, policy_version 588033 (0.0006) [2023-12-26 04:16:54,868][123091] Updated weights for policy 0, policy_version 588043 (0.0005) [2023-12-26 04:16:55,090][123090] Updated weights for policy 1, policy_version 584009 (0.0010) [2023-12-26 04:16:55,160][123090] Updated weights for policy 1, policy_version 584019 (0.0011) [2023-12-26 04:16:55,237][123090] Updated weights for policy 1, policy_version 584029 (0.0010) [2023-12-26 04:16:55,557][123091] Updated weights for policy 0, policy_version 588053 (0.0005) [2023-12-26 04:16:55,618][123091] Updated weights for policy 0, policy_version 588063 (0.0005) [2023-12-26 04:16:55,677][123091] Updated weights for policy 0, policy_version 588073 (0.0005) [2023-12-26 04:16:56,017][123090] Updated weights for policy 1, policy_version 584039 (0.0007) [2023-12-26 04:16:56,065][123090] Updated weights for policy 1, policy_version 584049 (0.0005) [2023-12-26 04:16:56,112][123090] Updated weights for policy 1, policy_version 584059 (0.0005) [2023-12-26 04:16:56,352][123091] Updated weights for policy 0, policy_version 588083 (0.0005) [2023-12-26 04:16:56,422][123091] Updated weights for policy 0, policy_version 588093 (0.0005) [2023-12-26 04:16:56,488][123091] Updated weights for policy 0, policy_version 588103 (0.0005) [2023-12-26 04:16:56,792][123090] Updated weights for policy 1, policy_version 584069 (0.0005) [2023-12-26 04:16:56,862][123090] Updated weights for policy 1, policy_version 584079 (0.0007) [2023-12-26 04:16:56,935][123090] Updated weights for policy 1, policy_version 584089 (0.0005) [2023-12-26 04:16:57,183][123091] Updated weights for policy 0, policy_version 588113 (0.0006) [2023-12-26 04:16:57,238][123091] Updated weights for policy 0, policy_version 588123 (0.0010) [2023-12-26 04:16:57,293][123091] Updated weights for policy 0, policy_version 588133 (0.0010) [2023-12-26 04:16:57,349][123091] Updated weights for policy 0, policy_version 588143 (0.0010) [2023-12-26 04:16:57,583][123090] Updated weights for policy 1, policy_version 584099 (0.0007) [2023-12-26 04:16:57,635][123090] Updated weights for policy 1, policy_version 584109 (0.0008) [2023-12-26 04:16:57,693][123090] Updated weights for policy 1, policy_version 584119 (0.0009) [2023-12-26 04:16:58,211][123091] Updated weights for policy 0, policy_version 588153 (0.0008) [2023-12-26 04:16:58,265][123091] Updated weights for policy 0, policy_version 588163 (0.0008) [2023-12-26 04:16:58,325][123091] Updated weights for policy 0, policy_version 588173 (0.0008) [2023-12-26 04:16:58,538][123090] Updated weights for policy 1, policy_version 584129 (0.0009) [2023-12-26 04:16:58,610][123090] Updated weights for policy 1, policy_version 584139 (0.0008) [2023-12-26 04:16:58,681][123090] Updated weights for policy 1, policy_version 584149 (0.0008) [2023-12-26 04:16:58,752][123090] Updated weights for policy 1, policy_version 584159 (0.0010) [2023-12-26 04:16:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 300122112. Throughput: 0: 8884.6, 1: 8996.1. Samples: 300113272. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:16:58,785][121949] Avg episode reward: [(0, '6126.464'), (1, '5756.297')] [2023-12-26 04:16:59,253][123091] Updated weights for policy 0, policy_version 588183 (0.0008) [2023-12-26 04:16:59,313][123091] Updated weights for policy 0, policy_version 588193 (0.0008) [2023-12-26 04:16:59,387][123091] Updated weights for policy 0, policy_version 588203 (0.0008) [2023-12-26 04:16:59,658][123090] Updated weights for policy 1, policy_version 584169 (0.0006) [2023-12-26 04:16:59,732][123090] Updated weights for policy 1, policy_version 584179 (0.0005) [2023-12-26 04:16:59,799][123090] Updated weights for policy 1, policy_version 584189 (0.0009) [2023-12-26 04:17:00,182][123091] Updated weights for policy 0, policy_version 588213 (0.0009) [2023-12-26 04:17:00,241][123091] Updated weights for policy 0, policy_version 588223 (0.0009) [2023-12-26 04:17:00,296][123091] Updated weights for policy 0, policy_version 588233 (0.0010) [2023-12-26 04:17:00,545][123090] Updated weights for policy 1, policy_version 584199 (0.0009) [2023-12-26 04:17:00,606][123090] Updated weights for policy 1, policy_version 584209 (0.0010) [2023-12-26 04:17:00,658][123090] Updated weights for policy 1, policy_version 584219 (0.0009) [2023-12-26 04:17:01,000][123091] Updated weights for policy 0, policy_version 588243 (0.0008) [2023-12-26 04:17:01,065][123091] Updated weights for policy 0, policy_version 588253 (0.0009) [2023-12-26 04:17:01,122][123091] Updated weights for policy 0, policy_version 588263 (0.0010) [2023-12-26 04:17:01,579][123090] Updated weights for policy 1, policy_version 584230 (0.0010) [2023-12-26 04:17:01,649][123090] Updated weights for policy 1, policy_version 584240 (0.0009) [2023-12-26 04:17:01,720][123090] Updated weights for policy 1, policy_version 584250 (0.0010) [2023-12-26 04:17:01,933][123091] Updated weights for policy 0, policy_version 588273 (0.0010) [2023-12-26 04:17:01,977][123091] Updated weights for policy 0, policy_version 588283 (0.0008) [2023-12-26 04:17:02,028][123091] Updated weights for policy 0, policy_version 588293 (0.0008) [2023-12-26 04:17:02,098][123091] Updated weights for policy 0, policy_version 588303 (0.0006) [2023-12-26 04:17:02,459][123090] Updated weights for policy 1, policy_version 584260 (0.0009) [2023-12-26 04:17:02,529][123090] Updated weights for policy 1, policy_version 584270 (0.0008) [2023-12-26 04:17:02,591][123090] Updated weights for policy 1, policy_version 584280 (0.0008) [2023-12-26 04:17:02,809][123091] Updated weights for policy 0, policy_version 588313 (0.0006) [2023-12-26 04:17:02,869][123091] Updated weights for policy 0, policy_version 588323 (0.0006) [2023-12-26 04:17:02,928][123091] Updated weights for policy 0, policy_version 588333 (0.0005) [2023-12-26 04:17:03,243][123090] Updated weights for policy 1, policy_version 584290 (0.0007) [2023-12-26 04:17:03,298][123090] Updated weights for policy 1, policy_version 584300 (0.0005) [2023-12-26 04:17:03,360][123090] Updated weights for policy 1, policy_version 584310 (0.0005) [2023-12-26 04:17:03,418][123090] Updated weights for policy 1, policy_version 584320 (0.0006) [2023-12-26 04:17:03,656][123091] Updated weights for policy 0, policy_version 588343 (0.0009) [2023-12-26 04:17:03,703][123091] Updated weights for policy 0, policy_version 588353 (0.0008) [2023-12-26 04:17:03,750][123091] Updated weights for policy 0, policy_version 588363 (0.0005) [2023-12-26 04:17:03,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 300212224. Throughput: 0: 8889.9, 1: 8963.5. Samples: 300219700. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:03,785][121949] Avg episode reward: [(0, '6171.554'), (1, '5662.218')] [2023-12-26 04:17:04,194][123090] Updated weights for policy 1, policy_version 584330 (0.0006) [2023-12-26 04:17:04,251][123090] Updated weights for policy 1, policy_version 584340 (0.0006) [2023-12-26 04:17:04,317][123090] Updated weights for policy 1, policy_version 584350 (0.0006) [2023-12-26 04:17:04,510][123091] Updated weights for policy 0, policy_version 588373 (0.0007) [2023-12-26 04:17:04,582][123091] Updated weights for policy 0, policy_version 588383 (0.0008) [2023-12-26 04:17:04,647][123091] Updated weights for policy 0, policy_version 588393 (0.0008) [2023-12-26 04:17:05,050][123090] Updated weights for policy 1, policy_version 584360 (0.0005) [2023-12-26 04:17:05,099][123090] Updated weights for policy 1, policy_version 584370 (0.0005) [2023-12-26 04:17:05,151][123090] Updated weights for policy 1, policy_version 584380 (0.0005) [2023-12-26 04:17:05,309][123091] Updated weights for policy 0, policy_version 588403 (0.0007) [2023-12-26 04:17:05,362][123091] Updated weights for policy 0, policy_version 588413 (0.0005) [2023-12-26 04:17:05,416][123091] Updated weights for policy 0, policy_version 588423 (0.0006) [2023-12-26 04:17:05,784][123090] Updated weights for policy 1, policy_version 584390 (0.0005) [2023-12-26 04:17:05,861][123090] Updated weights for policy 1, policy_version 584400 (0.0005) [2023-12-26 04:17:05,922][123090] Updated weights for policy 1, policy_version 584410 (0.0007) [2023-12-26 04:17:06,020][123091] Updated weights for policy 0, policy_version 588433 (0.0006) [2023-12-26 04:17:06,083][123091] Updated weights for policy 0, policy_version 588443 (0.0006) [2023-12-26 04:17:06,157][123091] Updated weights for policy 0, policy_version 588453 (0.0007) [2023-12-26 04:17:06,227][123091] Updated weights for policy 0, policy_version 588463 (0.0005) [2023-12-26 04:17:06,768][123090] Updated weights for policy 1, policy_version 584420 (0.0009) [2023-12-26 04:17:06,839][123090] Updated weights for policy 1, policy_version 584430 (0.0008) [2023-12-26 04:17:06,902][123090] Updated weights for policy 1, policy_version 584440 (0.0009) [2023-12-26 04:17:06,918][123091] Updated weights for policy 0, policy_version 588473 (0.0009) [2023-12-26 04:17:06,976][123091] Updated weights for policy 0, policy_version 588483 (0.0009) [2023-12-26 04:17:07,030][123091] Updated weights for policy 0, policy_version 588493 (0.0009) [2023-12-26 04:17:07,633][123090] Updated weights for policy 1, policy_version 584450 (0.0008) [2023-12-26 04:17:07,692][123090] Updated weights for policy 1, policy_version 584460 (0.0009) [2023-12-26 04:17:07,742][123090] Updated weights for policy 1, policy_version 584470 (0.0009) [2023-12-26 04:17:07,798][123090] Updated weights for policy 1, policy_version 584480 (0.0007) [2023-12-26 04:17:07,926][123091] Updated weights for policy 0, policy_version 588503 (0.0009) [2023-12-26 04:17:07,972][123091] Updated weights for policy 0, policy_version 588513 (0.0009) [2023-12-26 04:17:08,030][123091] Updated weights for policy 0, policy_version 588523 (0.0010) [2023-12-26 04:17:08,649][123090] Updated weights for policy 1, policy_version 584490 (0.0010) [2023-12-26 04:17:08,718][123090] Updated weights for policy 1, policy_version 584500 (0.0009) [2023-12-26 04:17:08,740][123091] Updated weights for policy 0, policy_version 588533 (0.0008) [2023-12-26 04:17:08,783][123090] Updated weights for policy 1, policy_version 584510 (0.0009) [2023-12-26 04:17:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 300294144. Throughput: 0: 8999.7, 1: 9025.9. Samples: 300277976. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:08,785][121949] Avg episode reward: [(0, '6167.656'), (1, '5532.669')] [2023-12-26 04:17:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000584512_149635072.pth... [2023-12-26 04:17:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000583456_149364736.pth [2023-12-26 04:17:08,810][123091] Updated weights for policy 0, policy_version 588543 (0.0006) [2023-12-26 04:17:08,872][123091] Updated weights for policy 0, policy_version 588553 (0.0006) [2023-12-26 04:17:08,917][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000588560_150675456.pth... [2023-12-26 04:17:08,923][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000587472_150396928.pth [2023-12-26 04:17:09,468][123091] Updated weights for policy 0, policy_version 588563 (0.0007) [2023-12-26 04:17:09,523][123091] Updated weights for policy 0, policy_version 588573 (0.0009) [2023-12-26 04:17:09,599][123091] Updated weights for policy 0, policy_version 588583 (0.0008) [2023-12-26 04:17:09,673][123090] Updated weights for policy 1, policy_version 584520 (0.0009) [2023-12-26 04:17:09,745][123090] Updated weights for policy 1, policy_version 584530 (0.0010) [2023-12-26 04:17:09,815][123090] Updated weights for policy 1, policy_version 584540 (0.0010) [2023-12-26 04:17:10,467][123091] Updated weights for policy 0, policy_version 588593 (0.0009) [2023-12-26 04:17:10,523][123091] Updated weights for policy 0, policy_version 588603 (0.0009) [2023-12-26 04:17:10,573][123091] Updated weights for policy 0, policy_version 588613 (0.0010) [2023-12-26 04:17:10,584][123090] Updated weights for policy 1, policy_version 584550 (0.0008) [2023-12-26 04:17:10,630][123091] Updated weights for policy 0, policy_version 588623 (0.0009) [2023-12-26 04:17:10,641][123090] Updated weights for policy 1, policy_version 584560 (0.0007) [2023-12-26 04:17:10,695][123090] Updated weights for policy 1, policy_version 584570 (0.0010) [2023-12-26 04:17:11,429][123091] Updated weights for policy 0, policy_version 588633 (0.0009) [2023-12-26 04:17:11,487][123091] Updated weights for policy 0, policy_version 588643 (0.0009) [2023-12-26 04:17:11,551][123091] Updated weights for policy 0, policy_version 588653 (0.0009) [2023-12-26 04:17:11,652][123090] Updated weights for policy 1, policy_version 584580 (0.0009) [2023-12-26 04:17:11,708][123090] Updated weights for policy 1, policy_version 584590 (0.0009) [2023-12-26 04:17:11,776][123090] Updated weights for policy 1, policy_version 584600 (0.0010) [2023-12-26 04:17:12,372][123091] Updated weights for policy 0, policy_version 588663 (0.0008) [2023-12-26 04:17:12,440][123091] Updated weights for policy 0, policy_version 588673 (0.0011) [2023-12-26 04:17:12,495][123091] Updated weights for policy 0, policy_version 588683 (0.0011) [2023-12-26 04:17:12,615][123090] Updated weights for policy 1, policy_version 584610 (0.0010) [2023-12-26 04:17:12,671][123090] Updated weights for policy 1, policy_version 584620 (0.0010) [2023-12-26 04:17:12,727][123090] Updated weights for policy 1, policy_version 584630 (0.0009) [2023-12-26 04:17:12,796][123090] Updated weights for policy 1, policy_version 584640 (0.0009) [2023-12-26 04:17:13,269][123091] Updated weights for policy 0, policy_version 588693 (0.0008) [2023-12-26 04:17:13,327][123091] Updated weights for policy 0, policy_version 588703 (0.0005) [2023-12-26 04:17:13,403][123091] Updated weights for policy 0, policy_version 588713 (0.0005) [2023-12-26 04:17:13,554][123090] Updated weights for policy 1, policy_version 584650 (0.0006) [2023-12-26 04:17:13,625][123090] Updated weights for policy 1, policy_version 584660 (0.0005) [2023-12-26 04:17:13,689][123090] Updated weights for policy 1, policy_version 584670 (0.0005) [2023-12-26 04:17:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 300392448. Throughput: 0: 9052.7, 1: 8902.4. Samples: 300381304. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:13,785][121949] Avg episode reward: [(0, '6144.295'), (1, '5389.908')] [2023-12-26 04:17:14,077][123091] Updated weights for policy 0, policy_version 588723 (0.0005) [2023-12-26 04:17:14,147][123091] Updated weights for policy 0, policy_version 588733 (0.0009) [2023-12-26 04:17:14,213][123091] Updated weights for policy 0, policy_version 588743 (0.0010) [2023-12-26 04:17:14,353][123090] Updated weights for policy 1, policy_version 584680 (0.0008) [2023-12-26 04:17:14,416][123090] Updated weights for policy 1, policy_version 584690 (0.0008) [2023-12-26 04:17:14,468][123090] Updated weights for policy 1, policy_version 584700 (0.0009) [2023-12-26 04:17:15,027][123091] Updated weights for policy 0, policy_version 588753 (0.0010) [2023-12-26 04:17:15,089][123091] Updated weights for policy 0, policy_version 588763 (0.0011) [2023-12-26 04:17:15,156][123091] Updated weights for policy 0, policy_version 588773 (0.0011) [2023-12-26 04:17:15,219][123091] Updated weights for policy 0, policy_version 588783 (0.0011) [2023-12-26 04:17:15,315][123090] Updated weights for policy 1, policy_version 584710 (0.0009) [2023-12-26 04:17:15,373][123090] Updated weights for policy 1, policy_version 584720 (0.0009) [2023-12-26 04:17:15,433][123090] Updated weights for policy 1, policy_version 584730 (0.0009) [2023-12-26 04:17:16,031][123091] Updated weights for policy 0, policy_version 588793 (0.0010) [2023-12-26 04:17:16,085][123091] Updated weights for policy 0, policy_version 588803 (0.0010) [2023-12-26 04:17:16,143][123091] Updated weights for policy 0, policy_version 588813 (0.0010) [2023-12-26 04:17:16,290][123090] Updated weights for policy 1, policy_version 584740 (0.0009) [2023-12-26 04:17:16,342][123090] Updated weights for policy 1, policy_version 584750 (0.0009) [2023-12-26 04:17:16,399][123090] Updated weights for policy 1, policy_version 584760 (0.0009) [2023-12-26 04:17:16,927][123091] Updated weights for policy 0, policy_version 588823 (0.0007) [2023-12-26 04:17:16,983][123091] Updated weights for policy 0, policy_version 588833 (0.0005) [2023-12-26 04:17:17,043][123091] Updated weights for policy 0, policy_version 588843 (0.0005) [2023-12-26 04:17:17,289][123090] Updated weights for policy 1, policy_version 584770 (0.0009) [2023-12-26 04:17:17,350][123090] Updated weights for policy 1, policy_version 584780 (0.0008) [2023-12-26 04:17:17,416][123090] Updated weights for policy 1, policy_version 584790 (0.0009) [2023-12-26 04:17:17,480][123090] Updated weights for policy 1, policy_version 584800 (0.0008) [2023-12-26 04:17:17,825][123091] Updated weights for policy 0, policy_version 588853 (0.0005) [2023-12-26 04:17:17,889][123091] Updated weights for policy 0, policy_version 588863 (0.0007) [2023-12-26 04:17:17,945][123091] Updated weights for policy 0, policy_version 588873 (0.0006) [2023-12-26 04:17:18,303][123090] Updated weights for policy 1, policy_version 584810 (0.0009) [2023-12-26 04:17:18,374][123090] Updated weights for policy 1, policy_version 584820 (0.0009) [2023-12-26 04:17:18,438][123090] Updated weights for policy 1, policy_version 584830 (0.0009) [2023-12-26 04:17:18,696][123091] Updated weights for policy 0, policy_version 588883 (0.0005) [2023-12-26 04:17:18,750][123091] Updated weights for policy 0, policy_version 588893 (0.0010) [2023-12-26 04:17:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 300474368. Throughput: 0: 9100.6, 1: 8907.1. Samples: 300488544. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:18,785][121949] Avg episode reward: [(0, '6180.169'), (1, '5464.835')] [2023-12-26 04:17:18,802][123091] Updated weights for policy 0, policy_version 588903 (0.0006) [2023-12-26 04:17:19,284][123090] Updated weights for policy 1, policy_version 584840 (0.0009) [2023-12-26 04:17:19,358][123090] Updated weights for policy 1, policy_version 584850 (0.0008) [2023-12-26 04:17:19,428][123090] Updated weights for policy 1, policy_version 584860 (0.0008) [2023-12-26 04:17:19,677][123091] Updated weights for policy 0, policy_version 588913 (0.0008) [2023-12-26 04:17:19,735][123091] Updated weights for policy 0, policy_version 588923 (0.0007) [2023-12-26 04:17:19,799][123091] Updated weights for policy 0, policy_version 588933 (0.0009) [2023-12-26 04:17:19,857][123091] Updated weights for policy 0, policy_version 588943 (0.0010) [2023-12-26 04:17:20,208][123090] Updated weights for policy 1, policy_version 584870 (0.0006) [2023-12-26 04:17:20,273][123090] Updated weights for policy 1, policy_version 584880 (0.0005) [2023-12-26 04:17:20,335][123090] Updated weights for policy 1, policy_version 584890 (0.0006) [2023-12-26 04:17:20,639][123091] Updated weights for policy 0, policy_version 588953 (0.0010) [2023-12-26 04:17:20,706][123091] Updated weights for policy 0, policy_version 588963 (0.0010) [2023-12-26 04:17:20,776][123091] Updated weights for policy 0, policy_version 588973 (0.0010) [2023-12-26 04:17:21,168][123090] Updated weights for policy 1, policy_version 584900 (0.0008) [2023-12-26 04:17:21,239][123090] Updated weights for policy 1, policy_version 584910 (0.0006) [2023-12-26 04:17:21,307][123090] Updated weights for policy 1, policy_version 584920 (0.0007) [2023-12-26 04:17:21,581][123091] Updated weights for policy 0, policy_version 588983 (0.0006) [2023-12-26 04:17:21,645][123091] Updated weights for policy 0, policy_version 588993 (0.0007) [2023-12-26 04:17:21,710][123091] Updated weights for policy 0, policy_version 589003 (0.0008) [2023-12-26 04:17:22,104][123090] Updated weights for policy 1, policy_version 584930 (0.0007) [2023-12-26 04:17:22,172][123090] Updated weights for policy 1, policy_version 584940 (0.0006) [2023-12-26 04:17:22,248][123090] Updated weights for policy 1, policy_version 584950 (0.0006) [2023-12-26 04:17:22,319][123090] Updated weights for policy 1, policy_version 584960 (0.0009) [2023-12-26 04:17:22,545][123091] Updated weights for policy 0, policy_version 589013 (0.0010) [2023-12-26 04:17:22,606][123091] Updated weights for policy 0, policy_version 589023 (0.0010) [2023-12-26 04:17:22,668][123091] Updated weights for policy 0, policy_version 589033 (0.0009) [2023-12-26 04:17:23,048][123090] Updated weights for policy 1, policy_version 584970 (0.0008) [2023-12-26 04:17:23,111][123090] Updated weights for policy 1, policy_version 584980 (0.0009) [2023-12-26 04:17:23,172][123090] Updated weights for policy 1, policy_version 584990 (0.0009) [2023-12-26 04:17:23,478][123091] Updated weights for policy 0, policy_version 589043 (0.0010) [2023-12-26 04:17:23,534][123091] Updated weights for policy 0, policy_version 589053 (0.0010) [2023-12-26 04:17:23,594][123091] Updated weights for policy 0, policy_version 589063 (0.0011) [2023-12-26 04:17:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 300564480. Throughput: 0: 9078.9, 1: 8838.4. Samples: 300540824. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:23,785][121949] Avg episode reward: [(0, '6176.818'), (1, '5575.504')] [2023-12-26 04:17:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000589072_150806528.pth... [2023-12-26 04:17:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000584992_149757952.pth... [2023-12-26 04:17:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000588016_150536192.pth [2023-12-26 04:17:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000583968_149495808.pth [2023-12-26 04:17:24,037][123090] Updated weights for policy 1, policy_version 585000 (0.0009) [2023-12-26 04:17:24,094][123090] Updated weights for policy 1, policy_version 585011 (0.0010) [2023-12-26 04:17:24,161][123090] Updated weights for policy 1, policy_version 585021 (0.0010) [2023-12-26 04:17:24,303][123091] Updated weights for policy 0, policy_version 589073 (0.0008) [2023-12-26 04:17:24,354][123091] Updated weights for policy 0, policy_version 589083 (0.0006) [2023-12-26 04:17:24,413][123091] Updated weights for policy 0, policy_version 589093 (0.0005) [2023-12-26 04:17:24,462][123091] Updated weights for policy 0, policy_version 589103 (0.0005) [2023-12-26 04:17:25,082][123090] Updated weights for policy 1, policy_version 585031 (0.0006) [2023-12-26 04:17:25,131][123091] Updated weights for policy 0, policy_version 589113 (0.0010) [2023-12-26 04:17:25,131][123090] Updated weights for policy 1, policy_version 585041 (0.0007) [2023-12-26 04:17:25,183][123090] Updated weights for policy 1, policy_version 585051 (0.0009) [2023-12-26 04:17:25,190][123091] Updated weights for policy 0, policy_version 589123 (0.0010) [2023-12-26 04:17:25,252][123091] Updated weights for policy 0, policy_version 589133 (0.0010) [2023-12-26 04:17:25,865][123090] Updated weights for policy 1, policy_version 585061 (0.0006) [2023-12-26 04:17:25,928][123090] Updated weights for policy 1, policy_version 585071 (0.0005) [2023-12-26 04:17:25,983][123090] Updated weights for policy 1, policy_version 585081 (0.0008) [2023-12-26 04:17:25,991][123091] Updated weights for policy 0, policy_version 589143 (0.0007) [2023-12-26 04:17:26,050][123091] Updated weights for policy 0, policy_version 589153 (0.0005) [2023-12-26 04:17:26,104][123091] Updated weights for policy 0, policy_version 589163 (0.0006) [2023-12-26 04:17:26,559][123090] Updated weights for policy 1, policy_version 585091 (0.0008) [2023-12-26 04:17:26,613][123090] Updated weights for policy 1, policy_version 585101 (0.0008) [2023-12-26 04:17:26,670][123090] Updated weights for policy 1, policy_version 585111 (0.0009) [2023-12-26 04:17:26,903][123091] Updated weights for policy 0, policy_version 589173 (0.0010) [2023-12-26 04:17:26,954][123091] Updated weights for policy 0, policy_version 589183 (0.0009) [2023-12-26 04:17:27,025][123091] Updated weights for policy 0, policy_version 589193 (0.0006) [2023-12-26 04:17:27,442][123090] Updated weights for policy 1, policy_version 585121 (0.0009) [2023-12-26 04:17:27,495][123090] Updated weights for policy 1, policy_version 585131 (0.0010) [2023-12-26 04:17:27,550][123090] Updated weights for policy 1, policy_version 585141 (0.0010) [2023-12-26 04:17:27,603][123090] Updated weights for policy 1, policy_version 585152 (0.0010) [2023-12-26 04:17:27,719][123091] Updated weights for policy 0, policy_version 589203 (0.0008) [2023-12-26 04:17:27,772][123091] Updated weights for policy 0, policy_version 589213 (0.0005) [2023-12-26 04:17:27,833][123091] Updated weights for policy 0, policy_version 589223 (0.0005) [2023-12-26 04:17:28,527][123091] Updated weights for policy 0, policy_version 589233 (0.0005) [2023-12-26 04:17:28,554][123090] Updated weights for policy 1, policy_version 585162 (0.0010) [2023-12-26 04:17:28,587][123091] Updated weights for policy 0, policy_version 589243 (0.0007) [2023-12-26 04:17:28,619][123090] Updated weights for policy 1, policy_version 585172 (0.0008) [2023-12-26 04:17:28,657][123091] Updated weights for policy 0, policy_version 589253 (0.0007) [2023-12-26 04:17:28,685][123090] Updated weights for policy 1, policy_version 585182 (0.0009) [2023-12-26 04:17:28,723][123091] Updated weights for policy 0, policy_version 589263 (0.0007) [2023-12-26 04:17:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 300662784. Throughput: 0: 9192.4, 1: 8871.9. Samples: 300649784. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:28,785][121949] Avg episode reward: [(0, '6116.385'), (1, '5631.460')] [2023-12-26 04:17:29,427][123091] Updated weights for policy 0, policy_version 589273 (0.0008) [2023-12-26 04:17:29,476][123091] Updated weights for policy 0, policy_version 589283 (0.0006) [2023-12-26 04:17:29,535][123091] Updated weights for policy 0, policy_version 589293 (0.0008) [2023-12-26 04:17:29,601][123090] Updated weights for policy 1, policy_version 585192 (0.0008) [2023-12-26 04:17:29,664][123090] Updated weights for policy 1, policy_version 585202 (0.0006) [2023-12-26 04:17:29,737][123090] Updated weights for policy 1, policy_version 585212 (0.0007) [2023-12-26 04:17:30,325][123091] Updated weights for policy 0, policy_version 589303 (0.0009) [2023-12-26 04:17:30,373][123091] Updated weights for policy 0, policy_version 589313 (0.0009) [2023-12-26 04:17:30,435][123091] Updated weights for policy 0, policy_version 589323 (0.0009) [2023-12-26 04:17:30,555][123090] Updated weights for policy 1, policy_version 585222 (0.0007) [2023-12-26 04:17:30,607][123090] Updated weights for policy 1, policy_version 585232 (0.0007) [2023-12-26 04:17:30,658][123090] Updated weights for policy 1, policy_version 585242 (0.0010) [2023-12-26 04:17:31,186][123091] Updated weights for policy 0, policy_version 589333 (0.0009) [2023-12-26 04:17:31,247][123091] Updated weights for policy 0, policy_version 589343 (0.0007) [2023-12-26 04:17:31,302][123091] Updated weights for policy 0, policy_version 589353 (0.0009) [2023-12-26 04:17:31,454][123090] Updated weights for policy 1, policy_version 585252 (0.0009) [2023-12-26 04:17:31,516][123090] Updated weights for policy 1, policy_version 585262 (0.0010) [2023-12-26 04:17:31,579][123090] Updated weights for policy 1, policy_version 585272 (0.0010) [2023-12-26 04:17:32,114][123091] Updated weights for policy 0, policy_version 589363 (0.0008) [2023-12-26 04:17:32,184][123091] Updated weights for policy 0, policy_version 589373 (0.0006) [2023-12-26 04:17:32,251][123091] Updated weights for policy 0, policy_version 589383 (0.0007) [2023-12-26 04:17:32,394][123090] Updated weights for policy 1, policy_version 585282 (0.0010) [2023-12-26 04:17:32,460][123090] Updated weights for policy 1, policy_version 585292 (0.0009) [2023-12-26 04:17:32,531][123090] Updated weights for policy 1, policy_version 585302 (0.0010) [2023-12-26 04:17:32,594][123090] Updated weights for policy 1, policy_version 585312 (0.0006) [2023-12-26 04:17:33,032][123091] Updated weights for policy 0, policy_version 589393 (0.0011) [2023-12-26 04:17:33,090][123091] Updated weights for policy 0, policy_version 589403 (0.0010) [2023-12-26 04:17:33,145][123091] Updated weights for policy 0, policy_version 589413 (0.0010) [2023-12-26 04:17:33,171][123090] Updated weights for policy 1, policy_version 585322 (0.0005) [2023-12-26 04:17:33,200][123091] Updated weights for policy 0, policy_version 589423 (0.0010) [2023-12-26 04:17:33,220][123090] Updated weights for policy 1, policy_version 585332 (0.0005) [2023-12-26 04:17:33,270][123090] Updated weights for policy 1, policy_version 585342 (0.0005) [2023-12-26 04:17:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.3, 300 sec: 17689.2). Total num frames: 300744704. Throughput: 0: 9174.7, 1: 8913.5. Samples: 300758908. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:33,786][121949] Avg episode reward: [(0, '6059.312'), (1, '5524.568')] [2023-12-26 04:17:33,928][123091] Updated weights for policy 0, policy_version 589433 (0.0006) [2023-12-26 04:17:33,980][123090] Updated weights for policy 1, policy_version 585352 (0.0010) [2023-12-26 04:17:33,995][123091] Updated weights for policy 0, policy_version 589443 (0.0008) [2023-12-26 04:17:34,043][123090] Updated weights for policy 1, policy_version 585362 (0.0010) [2023-12-26 04:17:34,054][123091] Updated weights for policy 0, policy_version 589453 (0.0011) [2023-12-26 04:17:34,103][123090] Updated weights for policy 1, policy_version 585372 (0.0010) [2023-12-26 04:17:34,760][123091] Updated weights for policy 0, policy_version 589463 (0.0007) [2023-12-26 04:17:34,825][123091] Updated weights for policy 0, policy_version 589473 (0.0006) [2023-12-26 04:17:34,880][123091] Updated weights for policy 0, policy_version 589483 (0.0005) [2023-12-26 04:17:34,973][123090] Updated weights for policy 1, policy_version 585382 (0.0010) [2023-12-26 04:17:35,028][123090] Updated weights for policy 1, policy_version 585393 (0.0009) [2023-12-26 04:17:35,079][123090] Updated weights for policy 1, policy_version 585404 (0.0010) [2023-12-26 04:17:35,599][123091] Updated weights for policy 0, policy_version 589493 (0.0007) [2023-12-26 04:17:35,658][123091] Updated weights for policy 0, policy_version 589503 (0.0010) [2023-12-26 04:17:35,716][123091] Updated weights for policy 0, policy_version 589515 (0.0010) [2023-12-26 04:17:35,950][123090] Updated weights for policy 1, policy_version 585414 (0.0007) [2023-12-26 04:17:35,998][123090] Updated weights for policy 1, policy_version 585424 (0.0005) [2023-12-26 04:17:36,048][123090] Updated weights for policy 1, policy_version 585434 (0.0005) [2023-12-26 04:17:36,610][123091] Updated weights for policy 0, policy_version 589525 (0.0010) [2023-12-26 04:17:36,679][123091] Updated weights for policy 0, policy_version 589535 (0.0010) [2023-12-26 04:17:36,736][123091] Updated weights for policy 0, policy_version 589545 (0.0010) [2023-12-26 04:17:36,837][123090] Updated weights for policy 1, policy_version 585444 (0.0007) [2023-12-26 04:17:36,900][123090] Updated weights for policy 1, policy_version 585454 (0.0008) [2023-12-26 04:17:36,966][123090] Updated weights for policy 1, policy_version 585464 (0.0008) [2023-12-26 04:17:37,539][123091] Updated weights for policy 0, policy_version 589555 (0.0008) [2023-12-26 04:17:37,601][123091] Updated weights for policy 0, policy_version 589565 (0.0006) [2023-12-26 04:17:37,659][123091] Updated weights for policy 0, policy_version 589575 (0.0009) [2023-12-26 04:17:37,846][123090] Updated weights for policy 1, policy_version 585474 (0.0010) [2023-12-26 04:17:37,910][123090] Updated weights for policy 1, policy_version 585484 (0.0011) [2023-12-26 04:17:37,977][123090] Updated weights for policy 1, policy_version 585494 (0.0011) [2023-12-26 04:17:38,033][123090] Updated weights for policy 1, policy_version 585504 (0.0010) [2023-12-26 04:17:38,431][123091] Updated weights for policy 0, policy_version 589585 (0.0009) [2023-12-26 04:17:38,496][123091] Updated weights for policy 0, policy_version 589595 (0.0009) [2023-12-26 04:17:38,561][123091] Updated weights for policy 0, policy_version 589605 (0.0010) [2023-12-26 04:17:38,632][123091] Updated weights for policy 0, policy_version 589615 (0.0009) [2023-12-26 04:17:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 300834816. Throughput: 0: 9196.1, 1: 8917.4. Samples: 300812980. Policy #0 lag: (min: 3.0, avg: 6.8, max: 35.0) [2023-12-26 04:17:38,785][121949] Avg episode reward: [(0, '6058.926'), (1, '5389.044')] [2023-12-26 04:17:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000589616_150945792.pth... [2023-12-26 04:17:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000588560_150675456.pth [2023-12-26 04:17:38,865][123090] Updated weights for policy 1, policy_version 585514 (0.0010) [2023-12-26 04:17:38,932][123090] Updated weights for policy 1, policy_version 585524 (0.0009) [2023-12-26 04:17:39,002][123090] Updated weights for policy 1, policy_version 585534 (0.0010) [2023-12-26 04:17:39,013][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000585536_149897216.pth... [2023-12-26 04:17:39,018][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000584512_149635072.pth [2023-12-26 04:17:39,393][123091] Updated weights for policy 0, policy_version 589625 (0.0009) [2023-12-26 04:17:39,462][123091] Updated weights for policy 0, policy_version 589635 (0.0010) [2023-12-26 04:17:39,524][123091] Updated weights for policy 0, policy_version 589645 (0.0009) [2023-12-26 04:17:39,819][123090] Updated weights for policy 1, policy_version 585544 (0.0008) [2023-12-26 04:17:39,894][123090] Updated weights for policy 1, policy_version 585554 (0.0009) [2023-12-26 04:17:39,970][123090] Updated weights for policy 1, policy_version 585564 (0.0009) [2023-12-26 04:17:40,383][123091] Updated weights for policy 0, policy_version 589655 (0.0010) [2023-12-26 04:17:40,451][123091] Updated weights for policy 0, policy_version 589665 (0.0009) [2023-12-26 04:17:40,510][123091] Updated weights for policy 0, policy_version 589675 (0.0010) [2023-12-26 04:17:40,816][123090] Updated weights for policy 1, policy_version 585574 (0.0010) [2023-12-26 04:17:40,888][123090] Updated weights for policy 1, policy_version 585584 (0.0011) [2023-12-26 04:17:40,955][123090] Updated weights for policy 1, policy_version 585594 (0.0011) [2023-12-26 04:17:41,260][123091] Updated weights for policy 0, policy_version 589685 (0.0008) [2023-12-26 04:17:41,338][123091] Updated weights for policy 0, policy_version 589695 (0.0006) [2023-12-26 04:17:41,412][123091] Updated weights for policy 0, policy_version 589705 (0.0008) [2023-12-26 04:17:41,734][123090] Updated weights for policy 1, policy_version 585604 (0.0010) [2023-12-26 04:17:41,801][123090] Updated weights for policy 1, policy_version 585614 (0.0007) [2023-12-26 04:17:41,851][123090] Updated weights for policy 1, policy_version 585624 (0.0005) [2023-12-26 04:17:42,230][123091] Updated weights for policy 0, policy_version 589715 (0.0009) [2023-12-26 04:17:42,282][123091] Updated weights for policy 0, policy_version 589725 (0.0008) [2023-12-26 04:17:42,348][123091] Updated weights for policy 0, policy_version 589735 (0.0007) [2023-12-26 04:17:42,618][123090] Updated weights for policy 1, policy_version 585634 (0.0007) [2023-12-26 04:17:42,678][123090] Updated weights for policy 1, policy_version 585644 (0.0010) [2023-12-26 04:17:42,733][123090] Updated weights for policy 1, policy_version 585654 (0.0011) [2023-12-26 04:17:42,802][123090] Updated weights for policy 1, policy_version 585664 (0.0011) [2023-12-26 04:17:43,128][123091] Updated weights for policy 0, policy_version 589745 (0.0008) [2023-12-26 04:17:43,186][123091] Updated weights for policy 0, policy_version 589755 (0.0010) [2023-12-26 04:17:43,249][123091] Updated weights for policy 0, policy_version 589765 (0.0010) [2023-12-26 04:17:43,307][123091] Updated weights for policy 0, policy_version 589775 (0.0010) [2023-12-26 04:17:43,590][123090] Updated weights for policy 1, policy_version 585674 (0.0009) [2023-12-26 04:17:43,637][123090] Updated weights for policy 1, policy_version 585684 (0.0005) [2023-12-26 04:17:43,690][123090] Updated weights for policy 1, policy_version 585694 (0.0006) [2023-12-26 04:17:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 300924928. Throughput: 0: 9098.2, 1: 8739.6. Samples: 300915976. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:17:43,785][121949] Avg episode reward: [(0, '5938.604'), (1, '5239.545')] [2023-12-26 04:17:44,116][123091] Updated weights for policy 0, policy_version 589785 (0.0010) [2023-12-26 04:17:44,167][123091] Updated weights for policy 0, policy_version 589795 (0.0010) [2023-12-26 04:17:44,219][123091] Updated weights for policy 0, policy_version 589805 (0.0010) [2023-12-26 04:17:44,365][123090] Updated weights for policy 1, policy_version 585704 (0.0008) [2023-12-26 04:17:44,439][123090] Updated weights for policy 1, policy_version 585714 (0.0005) [2023-12-26 04:17:44,513][123090] Updated weights for policy 1, policy_version 585724 (0.0007) [2023-12-26 04:17:44,954][123091] Updated weights for policy 0, policy_version 589815 (0.0010) [2023-12-26 04:17:45,014][123091] Updated weights for policy 0, policy_version 589825 (0.0009) [2023-12-26 04:17:45,087][123091] Updated weights for policy 0, policy_version 589835 (0.0006) [2023-12-26 04:17:45,341][123090] Updated weights for policy 1, policy_version 585734 (0.0010) [2023-12-26 04:17:45,394][123090] Updated weights for policy 1, policy_version 585744 (0.0009) [2023-12-26 04:17:45,452][123090] Updated weights for policy 1, policy_version 585754 (0.0009) [2023-12-26 04:17:45,857][123091] Updated weights for policy 0, policy_version 589845 (0.0010) [2023-12-26 04:17:45,917][123091] Updated weights for policy 0, policy_version 589855 (0.0009) [2023-12-26 04:17:45,972][123091] Updated weights for policy 0, policy_version 589865 (0.0009) [2023-12-26 04:17:46,311][123090] Updated weights for policy 1, policy_version 585764 (0.0010) [2023-12-26 04:17:46,379][123090] Updated weights for policy 1, policy_version 585774 (0.0008) [2023-12-26 04:17:46,441][123090] Updated weights for policy 1, policy_version 585784 (0.0009) [2023-12-26 04:17:46,813][123091] Updated weights for policy 0, policy_version 589875 (0.0009) [2023-12-26 04:17:46,866][123091] Updated weights for policy 0, policy_version 589885 (0.0009) [2023-12-26 04:17:46,925][123091] Updated weights for policy 0, policy_version 589896 (0.0011) [2023-12-26 04:17:47,033][123090] Updated weights for policy 1, policy_version 585794 (0.0007) [2023-12-26 04:17:47,081][123090] Updated weights for policy 1, policy_version 585804 (0.0005) [2023-12-26 04:17:47,136][123090] Updated weights for policy 1, policy_version 585814 (0.0008) [2023-12-26 04:17:47,199][123090] Updated weights for policy 1, policy_version 585824 (0.0009) [2023-12-26 04:17:47,824][123090] Updated weights for policy 1, policy_version 585834 (0.0006) [2023-12-26 04:17:47,856][123091] Updated weights for policy 0, policy_version 589906 (0.0009) [2023-12-26 04:17:47,889][123090] Updated weights for policy 1, policy_version 585844 (0.0006) [2023-12-26 04:17:47,904][123091] Updated weights for policy 0, policy_version 589916 (0.0008) [2023-12-26 04:17:47,957][123090] Updated weights for policy 1, policy_version 585854 (0.0006) [2023-12-26 04:17:47,959][123091] Updated weights for policy 0, policy_version 589926 (0.0009) [2023-12-26 04:17:48,018][123091] Updated weights for policy 0, policy_version 589936 (0.0010) [2023-12-26 04:17:48,707][123090] Updated weights for policy 1, policy_version 585864 (0.0005) [2023-12-26 04:17:48,767][123090] Updated weights for policy 1, policy_version 585874 (0.0006) [2023-12-26 04:17:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 301006848. Throughput: 0: 9063.8, 1: 8818.8. Samples: 301024416. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:17:48,785][121949] Avg episode reward: [(0, '6039.565'), (1, '5378.250')] [2023-12-26 04:17:48,825][123090] Updated weights for policy 1, policy_version 585884 (0.0006) [2023-12-26 04:17:48,888][123091] Updated weights for policy 0, policy_version 589946 (0.0011) [2023-12-26 04:17:48,944][123091] Updated weights for policy 0, policy_version 589956 (0.0010) [2023-12-26 04:17:48,995][123091] Updated weights for policy 0, policy_version 589966 (0.0011) [2023-12-26 04:17:49,640][123090] Updated weights for policy 1, policy_version 585894 (0.0011) [2023-12-26 04:17:49,692][123090] Updated weights for policy 1, policy_version 585904 (0.0011) [2023-12-26 04:17:49,762][123090] Updated weights for policy 1, policy_version 585914 (0.0009) [2023-12-26 04:17:49,805][123091] Updated weights for policy 0, policy_version 589976 (0.0011) [2023-12-26 04:17:49,878][123091] Updated weights for policy 0, policy_version 589986 (0.0011) [2023-12-26 04:17:49,946][123091] Updated weights for policy 0, policy_version 589996 (0.0009) [2023-12-26 04:17:50,609][123091] Updated weights for policy 0, policy_version 590006 (0.0009) [2023-12-26 04:17:50,662][123090] Updated weights for policy 1, policy_version 585924 (0.0010) [2023-12-26 04:17:50,669][123091] Updated weights for policy 0, policy_version 590016 (0.0005) [2023-12-26 04:17:50,725][123090] Updated weights for policy 1, policy_version 585934 (0.0009) [2023-12-26 04:17:50,732][123091] Updated weights for policy 0, policy_version 590026 (0.0006) [2023-12-26 04:17:50,789][123090] Updated weights for policy 1, policy_version 585944 (0.0011) [2023-12-26 04:17:51,462][123091] Updated weights for policy 0, policy_version 590036 (0.0008) [2023-12-26 04:17:51,526][123091] Updated weights for policy 0, policy_version 590046 (0.0011) [2023-12-26 04:17:51,578][123090] Updated weights for policy 1, policy_version 585954 (0.0010) [2023-12-26 04:17:51,585][123091] Updated weights for policy 0, policy_version 590056 (0.0011) [2023-12-26 04:17:51,643][123090] Updated weights for policy 1, policy_version 585964 (0.0008) [2023-12-26 04:17:51,706][123090] Updated weights for policy 1, policy_version 585974 (0.0008) [2023-12-26 04:17:51,769][123090] Updated weights for policy 1, policy_version 585984 (0.0008) [2023-12-26 04:17:52,380][123091] Updated weights for policy 0, policy_version 590066 (0.0012) [2023-12-26 04:17:52,431][123091] Updated weights for policy 0, policy_version 590076 (0.0008) [2023-12-26 04:17:52,494][123091] Updated weights for policy 0, policy_version 590086 (0.0008) [2023-12-26 04:17:52,549][123090] Updated weights for policy 1, policy_version 585994 (0.0008) [2023-12-26 04:17:52,555][123091] Updated weights for policy 0, policy_version 590096 (0.0007) [2023-12-26 04:17:52,597][123090] Updated weights for policy 1, policy_version 586004 (0.0008) [2023-12-26 04:17:52,649][123090] Updated weights for policy 1, policy_version 586014 (0.0008) [2023-12-26 04:17:53,277][123091] Updated weights for policy 0, policy_version 590106 (0.0010) [2023-12-26 04:17:53,324][123091] Updated weights for policy 0, policy_version 590116 (0.0010) [2023-12-26 04:17:53,374][123090] Updated weights for policy 1, policy_version 586024 (0.0006) [2023-12-26 04:17:53,378][123091] Updated weights for policy 0, policy_version 590126 (0.0010) [2023-12-26 04:17:53,420][123090] Updated weights for policy 1, policy_version 586034 (0.0005) [2023-12-26 04:17:53,468][123090] Updated weights for policy 1, policy_version 586044 (0.0005) [2023-12-26 04:17:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17689.2). Total num frames: 301105152. Throughput: 0: 9006.1, 1: 8763.8. Samples: 301077624. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:17:53,785][121949] Avg episode reward: [(0, '6068.040'), (1, '5204.032')] [2023-12-26 04:17:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000590128_151076864.pth... [2023-12-26 04:17:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000586048_150028288.pth... [2023-12-26 04:17:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000589072_150806528.pth [2023-12-26 04:17:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000584992_149757952.pth [2023-12-26 04:17:54,129][123091] Updated weights for policy 0, policy_version 590136 (0.0007) [2023-12-26 04:17:54,164][123090] Updated weights for policy 1, policy_version 586054 (0.0005) [2023-12-26 04:17:54,188][123091] Updated weights for policy 0, policy_version 590146 (0.0005) [2023-12-26 04:17:54,224][123090] Updated weights for policy 1, policy_version 586064 (0.0011) [2023-12-26 04:17:54,239][123091] Updated weights for policy 0, policy_version 590156 (0.0005) [2023-12-26 04:17:54,273][123090] Updated weights for policy 1, policy_version 586074 (0.0010) [2023-12-26 04:17:54,995][123091] Updated weights for policy 0, policy_version 590166 (0.0009) [2023-12-26 04:17:55,055][123091] Updated weights for policy 0, policy_version 590176 (0.0011) [2023-12-26 04:17:55,094][123090] Updated weights for policy 1, policy_version 586084 (0.0008) [2023-12-26 04:17:55,116][123091] Updated weights for policy 0, policy_version 590186 (0.0011) [2023-12-26 04:17:55,156][123090] Updated weights for policy 1, policy_version 586094 (0.0009) [2023-12-26 04:17:55,218][123090] Updated weights for policy 1, policy_version 586104 (0.0010) [2023-12-26 04:17:55,941][123091] Updated weights for policy 0, policy_version 590196 (0.0010) [2023-12-26 04:17:55,973][123090] Updated weights for policy 1, policy_version 586114 (0.0009) [2023-12-26 04:17:55,988][123091] Updated weights for policy 0, policy_version 590206 (0.0010) [2023-12-26 04:17:56,040][123090] Updated weights for policy 1, policy_version 586124 (0.0005) [2023-12-26 04:17:56,043][123091] Updated weights for policy 0, policy_version 590216 (0.0010) [2023-12-26 04:17:56,102][123090] Updated weights for policy 1, policy_version 586134 (0.0005) [2023-12-26 04:17:56,156][123090] Updated weights for policy 1, policy_version 586144 (0.0005) [2023-12-26 04:17:56,851][123090] Updated weights for policy 1, policy_version 586154 (0.0011) [2023-12-26 04:17:56,869][123091] Updated weights for policy 0, policy_version 590226 (0.0009) [2023-12-26 04:17:56,907][123090] Updated weights for policy 1, policy_version 586164 (0.0009) [2023-12-26 04:17:56,927][123091] Updated weights for policy 0, policy_version 590236 (0.0005) [2023-12-26 04:17:56,964][123090] Updated weights for policy 1, policy_version 586174 (0.0005) [2023-12-26 04:17:56,987][123091] Updated weights for policy 0, policy_version 590246 (0.0010) [2023-12-26 04:17:57,049][123091] Updated weights for policy 0, policy_version 590256 (0.0010) [2023-12-26 04:17:57,674][123090] Updated weights for policy 1, policy_version 586184 (0.0005) [2023-12-26 04:17:57,730][123091] Updated weights for policy 0, policy_version 590266 (0.0005) [2023-12-26 04:17:57,743][123090] Updated weights for policy 1, policy_version 586194 (0.0009) [2023-12-26 04:17:57,801][123091] Updated weights for policy 0, policy_version 590276 (0.0006) [2023-12-26 04:17:57,809][123090] Updated weights for policy 1, policy_version 586204 (0.0010) [2023-12-26 04:17:57,863][123091] Updated weights for policy 0, policy_version 590286 (0.0010) [2023-12-26 04:17:58,592][123091] Updated weights for policy 0, policy_version 590296 (0.0011) [2023-12-26 04:17:58,613][123090] Updated weights for policy 1, policy_version 586214 (0.0010) [2023-12-26 04:17:58,662][123091] Updated weights for policy 0, policy_version 590306 (0.0007) [2023-12-26 04:17:58,687][123090] Updated weights for policy 1, policy_version 586224 (0.0010) [2023-12-26 04:17:58,735][123091] Updated weights for policy 0, policy_version 590316 (0.0009) [2023-12-26 04:17:58,757][123090] Updated weights for policy 1, policy_version 586234 (0.0010) [2023-12-26 04:17:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 301195264. Throughput: 0: 9060.3, 1: 8909.8. Samples: 301189960. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:17:58,785][121949] Avg episode reward: [(0, '5981.294'), (1, '5067.921')] [2023-12-26 04:17:59,437][123091] Updated weights for policy 0, policy_version 590326 (0.0008) [2023-12-26 04:17:59,504][123091] Updated weights for policy 0, policy_version 590336 (0.0011) [2023-12-26 04:17:59,534][123090] Updated weights for policy 1, policy_version 586244 (0.0008) [2023-12-26 04:17:59,561][123091] Updated weights for policy 0, policy_version 590346 (0.0011) [2023-12-26 04:17:59,590][123090] Updated weights for policy 1, policy_version 586254 (0.0005) [2023-12-26 04:17:59,649][123090] Updated weights for policy 1, policy_version 586264 (0.0008) [2023-12-26 04:18:00,354][123091] Updated weights for policy 0, policy_version 590356 (0.0009) [2023-12-26 04:18:00,410][123091] Updated weights for policy 0, policy_version 590366 (0.0007) [2023-12-26 04:18:00,471][123091] Updated weights for policy 0, policy_version 590376 (0.0006) [2023-12-26 04:18:00,474][123090] Updated weights for policy 1, policy_version 586274 (0.0010) [2023-12-26 04:18:00,536][123090] Updated weights for policy 1, policy_version 586284 (0.0010) [2023-12-26 04:18:00,599][123090] Updated weights for policy 1, policy_version 586294 (0.0010) [2023-12-26 04:18:00,660][123090] Updated weights for policy 1, policy_version 586304 (0.0010) [2023-12-26 04:18:01,233][123091] Updated weights for policy 0, policy_version 590386 (0.0008) [2023-12-26 04:18:01,290][123091] Updated weights for policy 0, policy_version 590396 (0.0008) [2023-12-26 04:18:01,359][123091] Updated weights for policy 0, policy_version 590406 (0.0008) [2023-12-26 04:18:01,411][123091] Updated weights for policy 0, policy_version 590416 (0.0008) [2023-12-26 04:18:01,441][123090] Updated weights for policy 1, policy_version 586314 (0.0010) [2023-12-26 04:18:01,496][123090] Updated weights for policy 1, policy_version 586324 (0.0010) [2023-12-26 04:18:01,547][123090] Updated weights for policy 1, policy_version 586334 (0.0010) [2023-12-26 04:18:02,238][123091] Updated weights for policy 0, policy_version 590426 (0.0006) [2023-12-26 04:18:02,293][123091] Updated weights for policy 0, policy_version 590436 (0.0010) [2023-12-26 04:18:02,341][123091] Updated weights for policy 0, policy_version 590446 (0.0010) [2023-12-26 04:18:02,397][123090] Updated weights for policy 1, policy_version 586344 (0.0009) [2023-12-26 04:18:02,457][123090] Updated weights for policy 1, policy_version 586354 (0.0008) [2023-12-26 04:18:02,516][123090] Updated weights for policy 1, policy_version 586364 (0.0009) [2023-12-26 04:18:03,055][123091] Updated weights for policy 0, policy_version 590456 (0.0011) [2023-12-26 04:18:03,119][123091] Updated weights for policy 0, policy_version 590466 (0.0011) [2023-12-26 04:18:03,183][123091] Updated weights for policy 0, policy_version 590476 (0.0011) [2023-12-26 04:18:03,307][123090] Updated weights for policy 1, policy_version 586374 (0.0008) [2023-12-26 04:18:03,359][123090] Updated weights for policy 1, policy_version 586384 (0.0006) [2023-12-26 04:18:03,404][123090] Updated weights for policy 1, policy_version 586394 (0.0005) [2023-12-26 04:18:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 301285376. Throughput: 0: 9042.4, 1: 8921.7. Samples: 301296932. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:03,785][121949] Avg episode reward: [(0, '5889.312'), (1, '5082.542')] [2023-12-26 04:18:03,986][123091] Updated weights for policy 0, policy_version 590486 (0.0008) [2023-12-26 04:18:04,045][123091] Updated weights for policy 0, policy_version 590496 (0.0005) [2023-12-26 04:18:04,120][123091] Updated weights for policy 0, policy_version 590506 (0.0006) [2023-12-26 04:18:04,196][123090] Updated weights for policy 1, policy_version 586404 (0.0006) [2023-12-26 04:18:04,267][123090] Updated weights for policy 1, policy_version 586414 (0.0007) [2023-12-26 04:18:04,329][123090] Updated weights for policy 1, policy_version 586424 (0.0008) [2023-12-26 04:18:04,833][123091] Updated weights for policy 0, policy_version 590516 (0.0008) [2023-12-26 04:18:04,905][123091] Updated weights for policy 0, policy_version 590526 (0.0006) [2023-12-26 04:18:04,963][123091] Updated weights for policy 0, policy_version 590536 (0.0010) [2023-12-26 04:18:05,208][123090] Updated weights for policy 1, policy_version 586434 (0.0009) [2023-12-26 04:18:05,272][123090] Updated weights for policy 1, policy_version 586444 (0.0010) [2023-12-26 04:18:05,326][123090] Updated weights for policy 1, policy_version 586454 (0.0009) [2023-12-26 04:18:05,384][123090] Updated weights for policy 1, policy_version 586464 (0.0009) [2023-12-26 04:18:05,653][123091] Updated weights for policy 0, policy_version 590546 (0.0010) [2023-12-26 04:18:05,719][123091] Updated weights for policy 0, policy_version 590556 (0.0005) [2023-12-26 04:18:05,783][123091] Updated weights for policy 0, policy_version 590566 (0.0006) [2023-12-26 04:18:05,831][123091] Updated weights for policy 0, policy_version 590576 (0.0005) [2023-12-26 04:18:06,249][123090] Updated weights for policy 1, policy_version 586474 (0.0010) [2023-12-26 04:18:06,321][123090] Updated weights for policy 1, policy_version 586484 (0.0006) [2023-12-26 04:18:06,389][123090] Updated weights for policy 1, policy_version 586494 (0.0006) [2023-12-26 04:18:06,533][123091] Updated weights for policy 0, policy_version 590586 (0.0006) [2023-12-26 04:18:06,603][123091] Updated weights for policy 0, policy_version 590596 (0.0008) [2023-12-26 04:18:06,669][123091] Updated weights for policy 0, policy_version 590606 (0.0009) [2023-12-26 04:18:07,100][123090] Updated weights for policy 1, policy_version 586504 (0.0007) [2023-12-26 04:18:07,153][123090] Updated weights for policy 1, policy_version 586514 (0.0010) [2023-12-26 04:18:07,205][123090] Updated weights for policy 1, policy_version 586524 (0.0011) [2023-12-26 04:18:07,502][123091] Updated weights for policy 0, policy_version 590616 (0.0010) [2023-12-26 04:18:07,560][123091] Updated weights for policy 0, policy_version 590626 (0.0010) [2023-12-26 04:18:07,621][123091] Updated weights for policy 0, policy_version 590636 (0.0007) [2023-12-26 04:18:07,980][123090] Updated weights for policy 1, policy_version 586534 (0.0008) [2023-12-26 04:18:08,051][123090] Updated weights for policy 1, policy_version 586544 (0.0006) [2023-12-26 04:18:08,119][123090] Updated weights for policy 1, policy_version 586554 (0.0005) [2023-12-26 04:18:08,390][123091] Updated weights for policy 0, policy_version 590646 (0.0006) [2023-12-26 04:18:08,458][123091] Updated weights for policy 0, policy_version 590656 (0.0007) [2023-12-26 04:18:08,526][123091] Updated weights for policy 0, policy_version 590666 (0.0005) [2023-12-26 04:18:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 301375488. Throughput: 0: 9118.7, 1: 8902.9. Samples: 301351796. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:08,785][121949] Avg episode reward: [(0, '5867.558'), (1, '5053.903')] [2023-12-26 04:18:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000590672_151216128.pth... [2023-12-26 04:18:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000586560_150159360.pth... [2023-12-26 04:18:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000589616_150945792.pth [2023-12-26 04:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000585536_149897216.pth [2023-12-26 04:18:08,881][123090] Updated weights for policy 1, policy_version 586564 (0.0007) [2023-12-26 04:18:08,941][123090] Updated weights for policy 1, policy_version 586574 (0.0005) [2023-12-26 04:18:09,009][123090] Updated weights for policy 1, policy_version 586584 (0.0005) [2023-12-26 04:18:09,177][123091] Updated weights for policy 0, policy_version 590676 (0.0006) [2023-12-26 04:18:09,240][123091] Updated weights for policy 0, policy_version 590686 (0.0007) [2023-12-26 04:18:09,302][123091] Updated weights for policy 0, policy_version 590696 (0.0009) [2023-12-26 04:18:09,793][123090] Updated weights for policy 1, policy_version 586594 (0.0006) [2023-12-26 04:18:09,859][123090] Updated weights for policy 1, policy_version 586604 (0.0011) [2023-12-26 04:18:09,924][123090] Updated weights for policy 1, policy_version 586614 (0.0011) [2023-12-26 04:18:09,990][123090] Updated weights for policy 1, policy_version 586624 (0.0010) [2023-12-26 04:18:10,149][123091] Updated weights for policy 0, policy_version 590706 (0.0009) [2023-12-26 04:18:10,210][123091] Updated weights for policy 0, policy_version 590716 (0.0009) [2023-12-26 04:18:10,259][123091] Updated weights for policy 0, policy_version 590726 (0.0009) [2023-12-26 04:18:10,325][123091] Updated weights for policy 0, policy_version 590736 (0.0009) [2023-12-26 04:18:10,816][123090] Updated weights for policy 1, policy_version 586634 (0.0010) [2023-12-26 04:18:10,873][123090] Updated weights for policy 1, policy_version 586644 (0.0011) [2023-12-26 04:18:10,938][123090] Updated weights for policy 1, policy_version 586654 (0.0011) [2023-12-26 04:18:11,204][123091] Updated weights for policy 0, policy_version 590746 (0.0009) [2023-12-26 04:18:11,269][123091] Updated weights for policy 0, policy_version 590756 (0.0010) [2023-12-26 04:18:11,334][123091] Updated weights for policy 0, policy_version 590766 (0.0008) [2023-12-26 04:18:11,810][123090] Updated weights for policy 1, policy_version 586664 (0.0010) [2023-12-26 04:18:11,877][123090] Updated weights for policy 1, policy_version 586674 (0.0009) [2023-12-26 04:18:11,949][123090] Updated weights for policy 1, policy_version 586684 (0.0010) [2023-12-26 04:18:12,154][123091] Updated weights for policy 0, policy_version 590776 (0.0010) [2023-12-26 04:18:12,213][123091] Updated weights for policy 0, policy_version 590786 (0.0011) [2023-12-26 04:18:12,272][123091] Updated weights for policy 0, policy_version 590796 (0.0010) [2023-12-26 04:18:12,779][123090] Updated weights for policy 1, policy_version 586694 (0.0009) [2023-12-26 04:18:12,844][123090] Updated weights for policy 1, policy_version 586704 (0.0009) [2023-12-26 04:18:12,901][123090] Updated weights for policy 1, policy_version 586714 (0.0009) [2023-12-26 04:18:13,141][123091] Updated weights for policy 0, policy_version 590806 (0.0010) [2023-12-26 04:18:13,198][123091] Updated weights for policy 0, policy_version 590816 (0.0009) [2023-12-26 04:18:13,254][123091] Updated weights for policy 0, policy_version 590826 (0.0009) [2023-12-26 04:18:13,677][123090] Updated weights for policy 1, policy_version 586724 (0.0007) [2023-12-26 04:18:13,736][123090] Updated weights for policy 1, policy_version 586734 (0.0005) [2023-12-26 04:18:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 301457408. Throughput: 0: 9018.4, 1: 8884.3. Samples: 301455408. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:13,785][121949] Avg episode reward: [(0, '6011.483'), (1, '4622.579')] [2023-12-26 04:18:13,790][123090] Updated weights for policy 1, policy_version 586744 (0.0005) [2023-12-26 04:18:14,018][123091] Updated weights for policy 0, policy_version 590836 (0.0010) [2023-12-26 04:18:14,069][123091] Updated weights for policy 0, policy_version 590846 (0.0010) [2023-12-26 04:18:14,118][123091] Updated weights for policy 0, policy_version 590856 (0.0010) [2023-12-26 04:18:14,448][123090] Updated weights for policy 1, policy_version 586754 (0.0005) [2023-12-26 04:18:14,515][123090] Updated weights for policy 1, policy_version 586764 (0.0005) [2023-12-26 04:18:14,581][123090] Updated weights for policy 1, policy_version 586774 (0.0005) [2023-12-26 04:18:14,634][123090] Updated weights for policy 1, policy_version 586784 (0.0008) [2023-12-26 04:18:14,974][123091] Updated weights for policy 0, policy_version 590866 (0.0010) [2023-12-26 04:18:15,031][123091] Updated weights for policy 0, policy_version 590876 (0.0011) [2023-12-26 04:18:15,098][123091] Updated weights for policy 0, policy_version 590886 (0.0011) [2023-12-26 04:18:15,171][123091] Updated weights for policy 0, policy_version 590896 (0.0011) [2023-12-26 04:18:15,386][123090] Updated weights for policy 1, policy_version 586794 (0.0009) [2023-12-26 04:18:15,448][123090] Updated weights for policy 1, policy_version 586804 (0.0009) [2023-12-26 04:18:15,514][123090] Updated weights for policy 1, policy_version 586814 (0.0009) [2023-12-26 04:18:15,923][123091] Updated weights for policy 0, policy_version 590906 (0.0005) [2023-12-26 04:18:15,973][123091] Updated weights for policy 0, policy_version 590916 (0.0008) [2023-12-26 04:18:16,018][123091] Updated weights for policy 0, policy_version 590926 (0.0010) [2023-12-26 04:18:16,382][123090] Updated weights for policy 1, policy_version 586824 (0.0009) [2023-12-26 04:18:16,439][123090] Updated weights for policy 1, policy_version 586834 (0.0009) [2023-12-26 04:18:16,497][123090] Updated weights for policy 1, policy_version 586844 (0.0010) [2023-12-26 04:18:16,811][123091] Updated weights for policy 0, policy_version 590936 (0.0009) [2023-12-26 04:18:16,868][123091] Updated weights for policy 0, policy_version 590946 (0.0009) [2023-12-26 04:18:16,919][123091] Updated weights for policy 0, policy_version 590956 (0.0009) [2023-12-26 04:18:17,380][123090] Updated weights for policy 1, policy_version 586854 (0.0010) [2023-12-26 04:18:17,434][123090] Updated weights for policy 1, policy_version 586864 (0.0009) [2023-12-26 04:18:17,484][123090] Updated weights for policy 1, policy_version 586874 (0.0008) [2023-12-26 04:18:17,768][123091] Updated weights for policy 0, policy_version 590966 (0.0010) [2023-12-26 04:18:17,828][123091] Updated weights for policy 0, policy_version 590976 (0.0009) [2023-12-26 04:18:17,883][123091] Updated weights for policy 0, policy_version 590987 (0.0009) [2023-12-26 04:18:18,341][123090] Updated weights for policy 1, policy_version 586884 (0.0009) [2023-12-26 04:18:18,409][123090] Updated weights for policy 1, policy_version 586894 (0.0008) [2023-12-26 04:18:18,476][123090] Updated weights for policy 1, policy_version 586904 (0.0010) [2023-12-26 04:18:18,732][123091] Updated weights for policy 0, policy_version 590997 (0.0008) [2023-12-26 04:18:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 301547520. Throughput: 0: 8955.2, 1: 8878.4. Samples: 301561416. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:18,785][121949] Avg episode reward: [(0, '5913.058'), (1, '4867.560')] [2023-12-26 04:18:18,797][123091] Updated weights for policy 0, policy_version 591007 (0.0006) [2023-12-26 04:18:18,864][123091] Updated weights for policy 0, policy_version 591017 (0.0009) [2023-12-26 04:18:19,340][123090] Updated weights for policy 1, policy_version 586914 (0.0009) [2023-12-26 04:18:19,403][123090] Updated weights for policy 1, policy_version 586924 (0.0009) [2023-12-26 04:18:19,458][123090] Updated weights for policy 1, policy_version 586934 (0.0008) [2023-12-26 04:18:19,518][123090] Updated weights for policy 1, policy_version 586944 (0.0009) [2023-12-26 04:18:19,696][123091] Updated weights for policy 0, policy_version 591027 (0.0010) [2023-12-26 04:18:19,763][123091] Updated weights for policy 0, policy_version 591037 (0.0011) [2023-12-26 04:18:19,834][123091] Updated weights for policy 0, policy_version 591047 (0.0011) [2023-12-26 04:18:20,372][123090] Updated weights for policy 1, policy_version 586954 (0.0009) [2023-12-26 04:18:20,433][123090] Updated weights for policy 1, policy_version 586964 (0.0009) [2023-12-26 04:18:20,490][123090] Updated weights for policy 1, policy_version 586974 (0.0009) [2023-12-26 04:18:20,651][123091] Updated weights for policy 0, policy_version 591057 (0.0010) [2023-12-26 04:18:20,708][123091] Updated weights for policy 0, policy_version 591067 (0.0007) [2023-12-26 04:18:20,765][123091] Updated weights for policy 0, policy_version 591077 (0.0010) [2023-12-26 04:18:20,823][123091] Updated weights for policy 0, policy_version 591087 (0.0010) [2023-12-26 04:18:21,381][123090] Updated weights for policy 1, policy_version 586984 (0.0009) [2023-12-26 04:18:21,447][123090] Updated weights for policy 1, policy_version 586994 (0.0010) [2023-12-26 04:18:21,516][123090] Updated weights for policy 1, policy_version 587004 (0.0010) [2023-12-26 04:18:21,736][123091] Updated weights for policy 0, policy_version 591097 (0.0006) [2023-12-26 04:18:21,808][123091] Updated weights for policy 0, policy_version 591107 (0.0008) [2023-12-26 04:18:21,857][123091] Updated weights for policy 0, policy_version 591117 (0.0006) [2023-12-26 04:18:22,371][123090] Updated weights for policy 1, policy_version 587014 (0.0010) [2023-12-26 04:18:22,440][123090] Updated weights for policy 1, policy_version 587024 (0.0011) [2023-12-26 04:18:22,509][123090] Updated weights for policy 1, policy_version 587034 (0.0011) [2023-12-26 04:18:22,566][123091] Updated weights for policy 0, policy_version 591127 (0.0009) [2023-12-26 04:18:22,630][123091] Updated weights for policy 0, policy_version 591137 (0.0011) [2023-12-26 04:18:22,697][123091] Updated weights for policy 0, policy_version 591147 (0.0011) [2023-12-26 04:18:23,298][123090] Updated weights for policy 1, policy_version 587044 (0.0009) [2023-12-26 04:18:23,357][123090] Updated weights for policy 1, policy_version 587054 (0.0005) [2023-12-26 04:18:23,433][123090] Updated weights for policy 1, policy_version 587064 (0.0005) [2023-12-26 04:18:23,497][123091] Updated weights for policy 0, policy_version 591157 (0.0010) [2023-12-26 04:18:23,553][123091] Updated weights for policy 0, policy_version 591167 (0.0010) [2023-12-26 04:18:23,609][123091] Updated weights for policy 0, policy_version 591177 (0.0011) [2023-12-26 04:18:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 301637632. Throughput: 0: 8903.3, 1: 8834.6. Samples: 301611184. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:23,785][121949] Avg episode reward: [(0, '5794.444'), (1, '4613.399')] [2023-12-26 04:18:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000591184_151347200.pth... [2023-12-26 04:18:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000587072_150290432.pth... [2023-12-26 04:18:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000586048_150028288.pth [2023-12-26 04:18:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000590128_151076864.pth [2023-12-26 04:18:24,054][123090] Updated weights for policy 1, policy_version 587074 (0.0005) [2023-12-26 04:18:24,116][123090] Updated weights for policy 1, policy_version 587084 (0.0006) [2023-12-26 04:18:24,184][123090] Updated weights for policy 1, policy_version 587094 (0.0008) [2023-12-26 04:18:24,250][123090] Updated weights for policy 1, policy_version 587104 (0.0009) [2023-12-26 04:18:24,444][123091] Updated weights for policy 0, policy_version 591187 (0.0010) [2023-12-26 04:18:24,502][123091] Updated weights for policy 0, policy_version 591197 (0.0010) [2023-12-26 04:18:24,566][123091] Updated weights for policy 0, policy_version 591207 (0.0009) [2023-12-26 04:18:24,996][123090] Updated weights for policy 1, policy_version 587114 (0.0010) [2023-12-26 04:18:25,043][123090] Updated weights for policy 1, policy_version 587124 (0.0010) [2023-12-26 04:18:25,087][123090] Updated weights for policy 1, policy_version 587134 (0.0010) [2023-12-26 04:18:25,230][123091] Updated weights for policy 0, policy_version 591217 (0.0005) [2023-12-26 04:18:25,285][123091] Updated weights for policy 0, policy_version 591227 (0.0006) [2023-12-26 04:18:25,332][123091] Updated weights for policy 0, policy_version 591237 (0.0005) [2023-12-26 04:18:25,376][123091] Updated weights for policy 0, policy_version 591247 (0.0005) [2023-12-26 04:18:25,962][123090] Updated weights for policy 1, policy_version 587144 (0.0006) [2023-12-26 04:18:26,011][123090] Updated weights for policy 1, policy_version 587154 (0.0008) [2023-12-26 04:18:26,061][123090] Updated weights for policy 1, policy_version 587164 (0.0010) [2023-12-26 04:18:26,120][123091] Updated weights for policy 0, policy_version 591257 (0.0010) [2023-12-26 04:18:26,186][123091] Updated weights for policy 0, policy_version 591267 (0.0010) [2023-12-26 04:18:26,252][123091] Updated weights for policy 0, policy_version 591277 (0.0010) [2023-12-26 04:18:26,832][123090] Updated weights for policy 1, policy_version 587174 (0.0009) [2023-12-26 04:18:26,887][123090] Updated weights for policy 1, policy_version 587184 (0.0008) [2023-12-26 04:18:26,942][123090] Updated weights for policy 1, policy_version 587194 (0.0010) [2023-12-26 04:18:27,053][123091] Updated weights for policy 0, policy_version 591287 (0.0010) [2023-12-26 04:18:27,097][123091] Updated weights for policy 0, policy_version 591297 (0.0010) [2023-12-26 04:18:27,140][123091] Updated weights for policy 0, policy_version 591307 (0.0010) [2023-12-26 04:18:27,732][123090] Updated weights for policy 1, policy_version 587204 (0.0008) [2023-12-26 04:18:27,782][123090] Updated weights for policy 1, policy_version 587215 (0.0007) [2023-12-26 04:18:27,828][123090] Updated weights for policy 1, policy_version 587225 (0.0005) [2023-12-26 04:18:27,877][123091] Updated weights for policy 0, policy_version 591317 (0.0008) [2023-12-26 04:18:27,933][123091] Updated weights for policy 0, policy_version 591327 (0.0005) [2023-12-26 04:18:27,981][123091] Updated weights for policy 0, policy_version 591337 (0.0005) [2023-12-26 04:18:28,647][123090] Updated weights for policy 1, policy_version 587235 (0.0008) [2023-12-26 04:18:28,659][123091] Updated weights for policy 0, policy_version 591347 (0.0005) [2023-12-26 04:18:28,715][123090] Updated weights for policy 1, policy_version 587245 (0.0011) [2023-12-26 04:18:28,724][123091] Updated weights for policy 0, policy_version 591357 (0.0006) [2023-12-26 04:18:28,783][123090] Updated weights for policy 1, policy_version 587255 (0.0011) [2023-12-26 04:18:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 301719552. Throughput: 0: 8966.4, 1: 8899.5. Samples: 301719940. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:28,785][121949] Avg episode reward: [(0, '5912.583'), (1, '4564.089')] [2023-12-26 04:18:28,787][123091] Updated weights for policy 0, policy_version 591367 (0.0006) [2023-12-26 04:18:29,431][123091] Updated weights for policy 0, policy_version 591377 (0.0006) [2023-12-26 04:18:29,502][123091] Updated weights for policy 0, policy_version 591387 (0.0011) [2023-12-26 04:18:29,559][123090] Updated weights for policy 1, policy_version 587265 (0.0011) [2023-12-26 04:18:29,565][123091] Updated weights for policy 0, policy_version 591397 (0.0011) [2023-12-26 04:18:29,614][123090] Updated weights for policy 1, policy_version 587275 (0.0010) [2023-12-26 04:18:29,628][123091] Updated weights for policy 0, policy_version 591407 (0.0011) [2023-12-26 04:18:29,666][123090] Updated weights for policy 1, policy_version 587285 (0.0010) [2023-12-26 04:18:29,718][123090] Updated weights for policy 1, policy_version 587295 (0.0010) [2023-12-26 04:18:30,394][123091] Updated weights for policy 0, policy_version 591417 (0.0010) [2023-12-26 04:18:30,453][123091] Updated weights for policy 0, policy_version 591427 (0.0009) [2023-12-26 04:18:30,494][123090] Updated weights for policy 1, policy_version 587305 (0.0008) [2023-12-26 04:18:30,518][123091] Updated weights for policy 0, policy_version 591437 (0.0007) [2023-12-26 04:18:30,551][123090] Updated weights for policy 1, policy_version 587315 (0.0009) [2023-12-26 04:18:30,606][123090] Updated weights for policy 1, policy_version 587325 (0.0009) [2023-12-26 04:18:31,355][123091] Updated weights for policy 0, policy_version 591447 (0.0008) [2023-12-26 04:18:31,374][123090] Updated weights for policy 1, policy_version 587335 (0.0008) [2023-12-26 04:18:31,415][123091] Updated weights for policy 0, policy_version 591457 (0.0010) [2023-12-26 04:18:31,437][123090] Updated weights for policy 1, policy_version 587345 (0.0008) [2023-12-26 04:18:31,474][123091] Updated weights for policy 0, policy_version 591467 (0.0009) [2023-12-26 04:18:31,492][123090] Updated weights for policy 1, policy_version 587355 (0.0010) [2023-12-26 04:18:32,282][123091] Updated weights for policy 0, policy_version 591477 (0.0007) [2023-12-26 04:18:32,320][123090] Updated weights for policy 1, policy_version 587365 (0.0010) [2023-12-26 04:18:32,349][123091] Updated weights for policy 0, policy_version 591487 (0.0009) [2023-12-26 04:18:32,387][123090] Updated weights for policy 1, policy_version 587375 (0.0011) [2023-12-26 04:18:32,409][123091] Updated weights for policy 0, policy_version 591497 (0.0010) [2023-12-26 04:18:32,451][123090] Updated weights for policy 1, policy_version 587385 (0.0010) [2023-12-26 04:18:33,209][123091] Updated weights for policy 0, policy_version 591507 (0.0006) [2023-12-26 04:18:33,263][123090] Updated weights for policy 1, policy_version 587395 (0.0010) [2023-12-26 04:18:33,264][123091] Updated weights for policy 0, policy_version 591517 (0.0005) [2023-12-26 04:18:33,317][123090] Updated weights for policy 1, policy_version 587405 (0.0008) [2023-12-26 04:18:33,328][123091] Updated weights for policy 0, policy_version 591527 (0.0009) [2023-12-26 04:18:33,372][123090] Updated weights for policy 1, policy_version 587415 (0.0005) [2023-12-26 04:18:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 301817856. Throughput: 0: 9038.6, 1: 8847.3. Samples: 301829280. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:33,785][121949] Avg episode reward: [(0, '6065.107'), (1, '4906.877')] [2023-12-26 04:18:33,999][123090] Updated weights for policy 1, policy_version 587426 (0.0008) [2023-12-26 04:18:34,058][123090] Updated weights for policy 1, policy_version 587436 (0.0008) [2023-12-26 04:18:34,074][123091] Updated weights for policy 0, policy_version 591537 (0.0009) [2023-12-26 04:18:34,117][123090] Updated weights for policy 1, policy_version 587446 (0.0008) [2023-12-26 04:18:34,139][123091] Updated weights for policy 0, policy_version 591547 (0.0008) [2023-12-26 04:18:34,195][123090] Updated weights for policy 1, policy_version 587456 (0.0011) [2023-12-26 04:18:34,209][123091] Updated weights for policy 0, policy_version 591557 (0.0008) [2023-12-26 04:18:34,276][123091] Updated weights for policy 0, policy_version 591567 (0.0009) [2023-12-26 04:18:35,057][123090] Updated weights for policy 1, policy_version 587466 (0.0009) [2023-12-26 04:18:35,098][123091] Updated weights for policy 0, policy_version 591577 (0.0007) [2023-12-26 04:18:35,114][123090] Updated weights for policy 1, policy_version 587476 (0.0005) [2023-12-26 04:18:35,156][123091] Updated weights for policy 0, policy_version 591587 (0.0006) [2023-12-26 04:18:35,176][123090] Updated weights for policy 1, policy_version 587486 (0.0005) [2023-12-26 04:18:35,203][123091] Updated weights for policy 0, policy_version 591597 (0.0010) [2023-12-26 04:18:35,904][123090] Updated weights for policy 1, policy_version 587496 (0.0005) [2023-12-26 04:18:35,960][123090] Updated weights for policy 1, policy_version 587506 (0.0005) [2023-12-26 04:18:36,015][123090] Updated weights for policy 1, policy_version 587516 (0.0005) [2023-12-26 04:18:36,079][123091] Updated weights for policy 0, policy_version 591607 (0.0010) [2023-12-26 04:18:36,142][123091] Updated weights for policy 0, policy_version 591617 (0.0009) [2023-12-26 04:18:36,193][123091] Updated weights for policy 0, policy_version 591627 (0.0009) [2023-12-26 04:18:36,823][123090] Updated weights for policy 1, policy_version 587526 (0.0009) [2023-12-26 04:18:36,894][123090] Updated weights for policy 1, policy_version 587536 (0.0011) [2023-12-26 04:18:36,972][123090] Updated weights for policy 1, policy_version 587546 (0.0010) [2023-12-26 04:18:37,019][123091] Updated weights for policy 0, policy_version 591637 (0.0010) [2023-12-26 04:18:37,088][123091] Updated weights for policy 0, policy_version 591647 (0.0010) [2023-12-26 04:18:37,146][123091] Updated weights for policy 0, policy_version 591657 (0.0010) [2023-12-26 04:18:37,734][123090] Updated weights for policy 1, policy_version 587556 (0.0008) [2023-12-26 04:18:37,807][123090] Updated weights for policy 1, policy_version 587566 (0.0009) [2023-12-26 04:18:37,868][123090] Updated weights for policy 1, policy_version 587576 (0.0009) [2023-12-26 04:18:37,972][123091] Updated weights for policy 0, policy_version 591667 (0.0007) [2023-12-26 04:18:38,037][123091] Updated weights for policy 0, policy_version 591677 (0.0011) [2023-12-26 04:18:38,094][123091] Updated weights for policy 0, policy_version 591687 (0.0011) [2023-12-26 04:18:38,749][123090] Updated weights for policy 1, policy_version 587586 (0.0010) [2023-12-26 04:18:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 301899776. Throughput: 0: 8983.9, 1: 8897.3. Samples: 301882280. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:38,785][121949] Avg episode reward: [(0, '6022.735'), (1, '4760.696')] [2023-12-26 04:18:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000591696_151478272.pth... [2023-12-26 04:18:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000590672_151216128.pth [2023-12-26 04:18:38,814][123090] Updated weights for policy 1, policy_version 587596 (0.0009) [2023-12-26 04:18:38,872][123090] Updated weights for policy 1, policy_version 587606 (0.0010) [2023-12-26 04:18:38,916][123091] Updated weights for policy 0, policy_version 591697 (0.0011) [2023-12-26 04:18:38,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000587616_150429696.pth... [2023-12-26 04:18:38,932][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000586560_150159360.pth [2023-12-26 04:18:38,988][123091] Updated weights for policy 0, policy_version 591707 (0.0008) [2023-12-26 04:18:39,045][123091] Updated weights for policy 0, policy_version 591717 (0.0009) [2023-12-26 04:18:39,098][123091] Updated weights for policy 0, policy_version 591727 (0.0009) [2023-12-26 04:18:39,765][123090] Updated weights for policy 1, policy_version 587617 (0.0010) [2023-12-26 04:18:39,827][123090] Updated weights for policy 1, policy_version 587627 (0.0009) [2023-12-26 04:18:39,895][123090] Updated weights for policy 1, policy_version 587637 (0.0008) [2023-12-26 04:18:39,913][123091] Updated weights for policy 0, policy_version 591737 (0.0010) [2023-12-26 04:18:39,965][123090] Updated weights for policy 1, policy_version 587647 (0.0007) [2023-12-26 04:18:39,980][123091] Updated weights for policy 0, policy_version 591747 (0.0010) [2023-12-26 04:18:40,043][123091] Updated weights for policy 0, policy_version 591757 (0.0011) [2023-12-26 04:18:40,797][123090] Updated weights for policy 1, policy_version 587657 (0.0009) [2023-12-26 04:18:40,853][123090] Updated weights for policy 1, policy_version 587667 (0.0009) [2023-12-26 04:18:40,865][123091] Updated weights for policy 0, policy_version 591767 (0.0009) [2023-12-26 04:18:40,914][123090] Updated weights for policy 1, policy_version 587677 (0.0009) [2023-12-26 04:18:40,916][123091] Updated weights for policy 0, policy_version 591777 (0.0007) [2023-12-26 04:18:40,977][123091] Updated weights for policy 0, policy_version 591787 (0.0005) [2023-12-26 04:18:41,752][123090] Updated weights for policy 1, policy_version 587687 (0.0009) [2023-12-26 04:18:41,802][123090] Updated weights for policy 1, policy_version 587697 (0.0009) [2023-12-26 04:18:41,815][123091] Updated weights for policy 0, policy_version 591797 (0.0007) [2023-12-26 04:18:41,857][123090] Updated weights for policy 1, policy_version 587707 (0.0009) [2023-12-26 04:18:41,873][123091] Updated weights for policy 0, policy_version 591807 (0.0007) [2023-12-26 04:18:41,934][123091] Updated weights for policy 0, policy_version 591817 (0.0009) [2023-12-26 04:18:42,671][123090] Updated weights for policy 1, policy_version 587717 (0.0008) [2023-12-26 04:18:42,739][123090] Updated weights for policy 1, policy_version 587727 (0.0006) [2023-12-26 04:18:42,803][123091] Updated weights for policy 0, policy_version 591827 (0.0008) [2023-12-26 04:18:42,811][123090] Updated weights for policy 1, policy_version 587737 (0.0006) [2023-12-26 04:18:42,861][123091] Updated weights for policy 0, policy_version 591837 (0.0005) [2023-12-26 04:18:42,912][123091] Updated weights for policy 0, policy_version 591847 (0.0006) [2023-12-26 04:18:43,410][123090] Updated weights for policy 1, policy_version 587747 (0.0005) [2023-12-26 04:18:43,469][123090] Updated weights for policy 1, policy_version 587757 (0.0005) [2023-12-26 04:18:43,522][123090] Updated weights for policy 1, policy_version 587767 (0.0005) [2023-12-26 04:18:43,721][123091] Updated weights for policy 0, policy_version 591857 (0.0006) [2023-12-26 04:18:43,776][123091] Updated weights for policy 0, policy_version 591867 (0.0010) [2023-12-26 04:18:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 301989888. Throughput: 0: 8892.8, 1: 8741.7. Samples: 301983512. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:43,785][121949] Avg episode reward: [(0, '5947.318'), (1, '5052.296')] [2023-12-26 04:18:43,828][123091] Updated weights for policy 0, policy_version 591877 (0.0009) [2023-12-26 04:18:43,881][123091] Updated weights for policy 0, policy_version 591888 (0.0010) [2023-12-26 04:18:44,236][123090] Updated weights for policy 1, policy_version 587777 (0.0006) [2023-12-26 04:18:44,296][123090] Updated weights for policy 1, policy_version 587787 (0.0005) [2023-12-26 04:18:44,349][123090] Updated weights for policy 1, policy_version 587797 (0.0006) [2023-12-26 04:18:44,403][123090] Updated weights for policy 1, policy_version 587807 (0.0007) [2023-12-26 04:18:44,798][123091] Updated weights for policy 0, policy_version 591898 (0.0010) [2023-12-26 04:18:44,854][123091] Updated weights for policy 0, policy_version 591908 (0.0009) [2023-12-26 04:18:44,916][123091] Updated weights for policy 0, policy_version 591918 (0.0010) [2023-12-26 04:18:45,127][123090] Updated weights for policy 1, policy_version 587817 (0.0009) [2023-12-26 04:18:45,186][123090] Updated weights for policy 1, policy_version 587827 (0.0009) [2023-12-26 04:18:45,242][123090] Updated weights for policy 1, policy_version 587837 (0.0009) [2023-12-26 04:18:45,800][123091] Updated weights for policy 0, policy_version 591928 (0.0010) [2023-12-26 04:18:45,861][123091] Updated weights for policy 0, policy_version 591938 (0.0010) [2023-12-26 04:18:45,923][123091] Updated weights for policy 0, policy_version 591948 (0.0010) [2023-12-26 04:18:46,055][123090] Updated weights for policy 1, policy_version 587847 (0.0009) [2023-12-26 04:18:46,114][123090] Updated weights for policy 1, policy_version 587857 (0.0009) [2023-12-26 04:18:46,175][123090] Updated weights for policy 1, policy_version 587867 (0.0009) [2023-12-26 04:18:46,684][123091] Updated weights for policy 0, policy_version 591958 (0.0007) [2023-12-26 04:18:46,738][123091] Updated weights for policy 0, policy_version 591968 (0.0006) [2023-12-26 04:18:46,790][123091] Updated weights for policy 0, policy_version 591978 (0.0006) [2023-12-26 04:18:47,043][123090] Updated weights for policy 1, policy_version 587877 (0.0009) [2023-12-26 04:18:47,106][123090] Updated weights for policy 1, policy_version 587887 (0.0009) [2023-12-26 04:18:47,165][123090] Updated weights for policy 1, policy_version 587897 (0.0008) [2023-12-26 04:18:47,594][123091] Updated weights for policy 0, policy_version 591988 (0.0010) [2023-12-26 04:18:47,642][123091] Updated weights for policy 0, policy_version 591998 (0.0010) [2023-12-26 04:18:47,692][123091] Updated weights for policy 0, policy_version 592008 (0.0010) [2023-12-26 04:18:47,998][123090] Updated weights for policy 1, policy_version 587907 (0.0009) [2023-12-26 04:18:48,060][123090] Updated weights for policy 1, policy_version 587917 (0.0010) [2023-12-26 04:18:48,112][123090] Updated weights for policy 1, policy_version 587927 (0.0009) [2023-12-26 04:18:48,469][123091] Updated weights for policy 0, policy_version 592018 (0.0010) [2023-12-26 04:18:48,519][123091] Updated weights for policy 0, policy_version 592028 (0.0009) [2023-12-26 04:18:48,569][123091] Updated weights for policy 0, policy_version 592038 (0.0009) [2023-12-26 04:18:48,621][123091] Updated weights for policy 0, policy_version 592048 (0.0010) [2023-12-26 04:18:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 302080000. Throughput: 0: 8833.5, 1: 8787.2. Samples: 302089860. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:48,785][121949] Avg episode reward: [(0, '5990.605'), (1, '5281.552')] [2023-12-26 04:18:48,991][123090] Updated weights for policy 1, policy_version 587937 (0.0009) [2023-12-26 04:18:49,070][123090] Updated weights for policy 1, policy_version 587947 (0.0010) [2023-12-26 04:18:49,139][123090] Updated weights for policy 1, policy_version 587957 (0.0010) [2023-12-26 04:18:49,206][123090] Updated weights for policy 1, policy_version 587967 (0.0010) [2023-12-26 04:18:49,440][123091] Updated weights for policy 0, policy_version 592058 (0.0007) [2023-12-26 04:18:49,509][123091] Updated weights for policy 0, policy_version 592068 (0.0008) [2023-12-26 04:18:49,560][123091] Updated weights for policy 0, policy_version 592078 (0.0007) [2023-12-26 04:18:50,084][123090] Updated weights for policy 1, policy_version 587977 (0.0009) [2023-12-26 04:18:50,144][123090] Updated weights for policy 1, policy_version 587987 (0.0009) [2023-12-26 04:18:50,202][123090] Updated weights for policy 1, policy_version 587997 (0.0008) [2023-12-26 04:18:50,247][123091] Updated weights for policy 0, policy_version 592088 (0.0009) [2023-12-26 04:18:50,304][123091] Updated weights for policy 0, policy_version 592098 (0.0009) [2023-12-26 04:18:50,368][123091] Updated weights for policy 0, policy_version 592108 (0.0011) [2023-12-26 04:18:51,027][123090] Updated weights for policy 1, policy_version 588007 (0.0007) [2023-12-26 04:18:51,038][123091] Updated weights for policy 0, policy_version 592118 (0.0008) [2023-12-26 04:18:51,094][123090] Updated weights for policy 1, policy_version 588017 (0.0008) [2023-12-26 04:18:51,099][123091] Updated weights for policy 0, policy_version 592128 (0.0010) [2023-12-26 04:18:51,158][123091] Updated weights for policy 0, policy_version 592138 (0.0007) [2023-12-26 04:18:51,165][123090] Updated weights for policy 1, policy_version 588027 (0.0006) [2023-12-26 04:18:51,936][123091] Updated weights for policy 0, policy_version 592148 (0.0006) [2023-12-26 04:18:51,990][123090] Updated weights for policy 1, policy_version 588037 (0.0007) [2023-12-26 04:18:52,004][123091] Updated weights for policy 0, policy_version 592158 (0.0008) [2023-12-26 04:18:52,052][123090] Updated weights for policy 1, policy_version 588047 (0.0008) [2023-12-26 04:18:52,071][123091] Updated weights for policy 0, policy_version 592168 (0.0009) [2023-12-26 04:18:52,118][123090] Updated weights for policy 1, policy_version 588057 (0.0008) [2023-12-26 04:18:52,866][123091] Updated weights for policy 0, policy_version 592178 (0.0008) [2023-12-26 04:18:52,921][123090] Updated weights for policy 1, policy_version 588067 (0.0007) [2023-12-26 04:18:52,931][123091] Updated weights for policy 0, policy_version 592188 (0.0009) [2023-12-26 04:18:52,996][123090] Updated weights for policy 1, policy_version 588077 (0.0006) [2023-12-26 04:18:53,002][123091] Updated weights for policy 0, policy_version 592198 (0.0008) [2023-12-26 04:18:53,055][123090] Updated weights for policy 1, policy_version 588087 (0.0008) [2023-12-26 04:18:53,067][123091] Updated weights for policy 0, policy_version 592208 (0.0008) [2023-12-26 04:18:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 302161920. Throughput: 0: 8820.1, 1: 8777.0. Samples: 302143664. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:53,785][121949] Avg episode reward: [(0, '5963.820'), (1, '5321.653')] [2023-12-26 04:18:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000588096_150552576.pth... [2023-12-26 04:18:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000587072_150290432.pth [2023-12-26 04:18:53,822][123090] Updated weights for policy 1, policy_version 588097 (0.0006) [2023-12-26 04:18:53,846][123091] Updated weights for policy 0, policy_version 592218 (0.0009) [2023-12-26 04:18:53,887][123090] Updated weights for policy 1, policy_version 588107 (0.0005) [2023-12-26 04:18:53,905][123091] Updated weights for policy 0, policy_version 592228 (0.0009) [2023-12-26 04:18:53,959][123090] Updated weights for policy 1, policy_version 588117 (0.0005) [2023-12-26 04:18:53,964][123091] Updated weights for policy 0, policy_version 592238 (0.0010) [2023-12-26 04:18:53,973][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000592240_151617536.pth... [2023-12-26 04:18:53,976][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000591184_151347200.pth [2023-12-26 04:18:54,035][123090] Updated weights for policy 1, policy_version 588127 (0.0005) [2023-12-26 04:18:54,611][123090] Updated weights for policy 1, policy_version 588137 (0.0006) [2023-12-26 04:18:54,685][123090] Updated weights for policy 1, policy_version 588147 (0.0008) [2023-12-26 04:18:54,732][123091] Updated weights for policy 0, policy_version 592248 (0.0007) [2023-12-26 04:18:54,748][123090] Updated weights for policy 1, policy_version 588157 (0.0009) [2023-12-26 04:18:54,780][123091] Updated weights for policy 0, policy_version 592258 (0.0007) [2023-12-26 04:18:54,852][123091] Updated weights for policy 0, policy_version 592268 (0.0009) [2023-12-26 04:18:55,498][123090] Updated weights for policy 1, policy_version 588167 (0.0007) [2023-12-26 04:18:55,572][123090] Updated weights for policy 1, policy_version 588177 (0.0006) [2023-12-26 04:18:55,641][123090] Updated weights for policy 1, policy_version 588187 (0.0006) [2023-12-26 04:18:55,729][123091] Updated weights for policy 0, policy_version 592278 (0.0010) [2023-12-26 04:18:55,776][123091] Updated weights for policy 0, policy_version 592288 (0.0010) [2023-12-26 04:18:55,830][123091] Updated weights for policy 0, policy_version 592298 (0.0010) [2023-12-26 04:18:56,360][123090] Updated weights for policy 1, policy_version 588198 (0.0006) [2023-12-26 04:18:56,422][123090] Updated weights for policy 1, policy_version 588208 (0.0005) [2023-12-26 04:18:56,484][123090] Updated weights for policy 1, policy_version 588218 (0.0005) [2023-12-26 04:18:56,689][123091] Updated weights for policy 0, policy_version 592308 (0.0010) [2023-12-26 04:18:56,751][123091] Updated weights for policy 0, policy_version 592318 (0.0011) [2023-12-26 04:18:56,813][123091] Updated weights for policy 0, policy_version 592328 (0.0010) [2023-12-26 04:18:57,129][123090] Updated weights for policy 1, policy_version 588228 (0.0008) [2023-12-26 04:18:57,180][123090] Updated weights for policy 1, policy_version 588238 (0.0005) [2023-12-26 04:18:57,236][123090] Updated weights for policy 1, policy_version 588248 (0.0005) [2023-12-26 04:18:57,508][123091] Updated weights for policy 0, policy_version 592338 (0.0009) [2023-12-26 04:18:57,573][123091] Updated weights for policy 0, policy_version 592348 (0.0005) [2023-12-26 04:18:57,639][123091] Updated weights for policy 0, policy_version 592358 (0.0005) [2023-12-26 04:18:57,709][123091] Updated weights for policy 0, policy_version 592368 (0.0006) [2023-12-26 04:18:57,999][123090] Updated weights for policy 1, policy_version 588258 (0.0006) [2023-12-26 04:18:58,068][123090] Updated weights for policy 1, policy_version 588268 (0.0008) [2023-12-26 04:18:58,120][123090] Updated weights for policy 1, policy_version 588278 (0.0008) [2023-12-26 04:18:58,190][123090] Updated weights for policy 1, policy_version 588288 (0.0009) [2023-12-26 04:18:58,355][123091] Updated weights for policy 0, policy_version 592378 (0.0008) [2023-12-26 04:18:58,430][123091] Updated weights for policy 0, policy_version 592388 (0.0008) [2023-12-26 04:18:58,498][123091] Updated weights for policy 0, policy_version 592398 (0.0007) [2023-12-26 04:18:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 302260224. Throughput: 0: 8863.4, 1: 8870.6. Samples: 302253436. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:18:58,785][121949] Avg episode reward: [(0, '6131.744'), (1, '5251.088')] [2023-12-26 04:18:59,051][123090] Updated weights for policy 1, policy_version 588298 (0.0008) [2023-12-26 04:18:59,117][123090] Updated weights for policy 1, policy_version 588308 (0.0009) [2023-12-26 04:18:59,179][123090] Updated weights for policy 1, policy_version 588318 (0.0009) [2023-12-26 04:18:59,409][123091] Updated weights for policy 0, policy_version 592409 (0.0009) [2023-12-26 04:18:59,469][123091] Updated weights for policy 0, policy_version 592419 (0.0007) [2023-12-26 04:18:59,531][123091] Updated weights for policy 0, policy_version 592429 (0.0005) [2023-12-26 04:18:59,990][123090] Updated weights for policy 1, policy_version 588328 (0.0006) [2023-12-26 04:19:00,042][123090] Updated weights for policy 1, policy_version 588338 (0.0006) [2023-12-26 04:19:00,106][123090] Updated weights for policy 1, policy_version 588348 (0.0006) [2023-12-26 04:19:00,195][123091] Updated weights for policy 0, policy_version 592439 (0.0005) [2023-12-26 04:19:00,264][123091] Updated weights for policy 0, policy_version 592449 (0.0005) [2023-12-26 04:19:00,327][123091] Updated weights for policy 0, policy_version 592459 (0.0005) [2023-12-26 04:19:00,813][123090] Updated weights for policy 1, policy_version 588358 (0.0007) [2023-12-26 04:19:00,861][123090] Updated weights for policy 1, policy_version 588368 (0.0010) [2023-12-26 04:19:00,904][123090] Updated weights for policy 1, policy_version 588378 (0.0010) [2023-12-26 04:19:01,000][123091] Updated weights for policy 0, policy_version 592469 (0.0006) [2023-12-26 04:19:01,057][123091] Updated weights for policy 0, policy_version 592479 (0.0006) [2023-12-26 04:19:01,117][123091] Updated weights for policy 0, policy_version 592489 (0.0007) [2023-12-26 04:19:01,745][123090] Updated weights for policy 1, policy_version 588388 (0.0008) [2023-12-26 04:19:01,813][123090] Updated weights for policy 1, policy_version 588398 (0.0011) [2023-12-26 04:19:01,879][123090] Updated weights for policy 1, policy_version 588408 (0.0010) [2023-12-26 04:19:01,956][123091] Updated weights for policy 0, policy_version 592499 (0.0010) [2023-12-26 04:19:02,020][123091] Updated weights for policy 0, policy_version 592509 (0.0011) [2023-12-26 04:19:02,087][123091] Updated weights for policy 0, policy_version 592519 (0.0010) [2023-12-26 04:19:02,674][123090] Updated weights for policy 1, policy_version 588418 (0.0011) [2023-12-26 04:19:02,731][123090] Updated weights for policy 1, policy_version 588428 (0.0010) [2023-12-26 04:19:02,784][123090] Updated weights for policy 1, policy_version 588438 (0.0009) [2023-12-26 04:19:02,832][123090] Updated weights for policy 1, policy_version 588448 (0.0009) [2023-12-26 04:19:02,897][123091] Updated weights for policy 0, policy_version 592529 (0.0011) [2023-12-26 04:19:02,955][123091] Updated weights for policy 0, policy_version 592539 (0.0010) [2023-12-26 04:19:03,005][123091] Updated weights for policy 0, policy_version 592549 (0.0010) [2023-12-26 04:19:03,063][123091] Updated weights for policy 0, policy_version 592559 (0.0010) [2023-12-26 04:19:03,536][123090] Updated weights for policy 1, policy_version 588458 (0.0005) [2023-12-26 04:19:03,588][123090] Updated weights for policy 1, policy_version 588468 (0.0006) [2023-12-26 04:19:03,641][123090] Updated weights for policy 1, policy_version 588478 (0.0005) [2023-12-26 04:19:03,734][123091] Updated weights for policy 0, policy_version 592569 (0.0006) [2023-12-26 04:19:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 302350336. Throughput: 0: 8928.4, 1: 8886.9. Samples: 302363108. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:19:03,785][121949] Avg episode reward: [(0, '6160.628'), (1, '5320.967')] [2023-12-26 04:19:03,803][123091] Updated weights for policy 0, policy_version 592579 (0.0005) [2023-12-26 04:19:03,879][123091] Updated weights for policy 0, policy_version 592589 (0.0009) [2023-12-26 04:19:04,416][123090] Updated weights for policy 1, policy_version 588488 (0.0010) [2023-12-26 04:19:04,482][123090] Updated weights for policy 1, policy_version 588498 (0.0010) [2023-12-26 04:19:04,548][123090] Updated weights for policy 1, policy_version 588508 (0.0006) [2023-12-26 04:19:04,603][123091] Updated weights for policy 0, policy_version 592599 (0.0010) [2023-12-26 04:19:04,677][123091] Updated weights for policy 0, policy_version 592609 (0.0011) [2023-12-26 04:19:04,740][123091] Updated weights for policy 0, policy_version 592619 (0.0011) [2023-12-26 04:19:05,187][123090] Updated weights for policy 1, policy_version 588518 (0.0009) [2023-12-26 04:19:05,251][123090] Updated weights for policy 1, policy_version 588528 (0.0011) [2023-12-26 04:19:05,300][123090] Updated weights for policy 1, policy_version 588538 (0.0010) [2023-12-26 04:19:05,486][123091] Updated weights for policy 0, policy_version 592629 (0.0010) [2023-12-26 04:19:05,554][123091] Updated weights for policy 0, policy_version 592639 (0.0007) [2023-12-26 04:19:05,620][123091] Updated weights for policy 0, policy_version 592649 (0.0007) [2023-12-26 04:19:05,988][123090] Updated weights for policy 1, policy_version 588548 (0.0008) [2023-12-26 04:19:06,039][123090] Updated weights for policy 1, policy_version 588558 (0.0006) [2023-12-26 04:19:06,100][123090] Updated weights for policy 1, policy_version 588568 (0.0007) [2023-12-26 04:19:06,319][123091] Updated weights for policy 0, policy_version 592659 (0.0008) [2023-12-26 04:19:06,388][123091] Updated weights for policy 0, policy_version 592669 (0.0008) [2023-12-26 04:19:06,451][123091] Updated weights for policy 0, policy_version 592679 (0.0008) [2023-12-26 04:19:06,871][123090] Updated weights for policy 1, policy_version 588578 (0.0009) [2023-12-26 04:19:06,935][123090] Updated weights for policy 1, policy_version 588588 (0.0007) [2023-12-26 04:19:07,009][123090] Updated weights for policy 1, policy_version 588598 (0.0006) [2023-12-26 04:19:07,077][123090] Updated weights for policy 1, policy_version 588608 (0.0006) [2023-12-26 04:19:07,278][123091] Updated weights for policy 0, policy_version 592689 (0.0008) [2023-12-26 04:19:07,348][123091] Updated weights for policy 0, policy_version 592699 (0.0008) [2023-12-26 04:19:07,410][123091] Updated weights for policy 0, policy_version 592709 (0.0005) [2023-12-26 04:19:07,479][123091] Updated weights for policy 0, policy_version 592719 (0.0010) [2023-12-26 04:19:07,849][123090] Updated weights for policy 1, policy_version 588618 (0.0010) [2023-12-26 04:19:07,916][123090] Updated weights for policy 1, policy_version 588628 (0.0009) [2023-12-26 04:19:07,970][123090] Updated weights for policy 1, policy_version 588638 (0.0010) [2023-12-26 04:19:08,163][123091] Updated weights for policy 0, policy_version 592729 (0.0006) [2023-12-26 04:19:08,224][123091] Updated weights for policy 0, policy_version 592739 (0.0010) [2023-12-26 04:19:08,283][123091] Updated weights for policy 0, policy_version 592749 (0.0010) [2023-12-26 04:19:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 302440448. Throughput: 0: 8972.1, 1: 8983.5. Samples: 302419188. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:19:08,785][121949] Avg episode reward: [(0, '6142.248'), (1, '5574.507')] [2023-12-26 04:19:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000592752_151748608.pth... [2023-12-26 04:19:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000591696_151478272.pth [2023-12-26 04:19:08,849][123090] Updated weights for policy 1, policy_version 588648 (0.0010) [2023-12-26 04:19:08,914][123090] Updated weights for policy 1, policy_version 588658 (0.0010) [2023-12-26 04:19:08,965][123090] Updated weights for policy 1, policy_version 588668 (0.0010) [2023-12-26 04:19:08,984][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000588672_150700032.pth... [2023-12-26 04:19:08,987][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000587616_150429696.pth [2023-12-26 04:19:09,058][123091] Updated weights for policy 0, policy_version 592759 (0.0010) [2023-12-26 04:19:09,108][123091] Updated weights for policy 0, policy_version 592769 (0.0009) [2023-12-26 04:19:09,157][123091] Updated weights for policy 0, policy_version 592779 (0.0009) [2023-12-26 04:19:09,858][123090] Updated weights for policy 1, policy_version 588678 (0.0009) [2023-12-26 04:19:09,920][123090] Updated weights for policy 1, policy_version 588688 (0.0008) [2023-12-26 04:19:09,989][123090] Updated weights for policy 1, policy_version 588698 (0.0008) [2023-12-26 04:19:10,027][123091] Updated weights for policy 0, policy_version 592789 (0.0009) [2023-12-26 04:19:10,088][123091] Updated weights for policy 0, policy_version 592799 (0.0009) [2023-12-26 04:19:10,147][123091] Updated weights for policy 0, policy_version 592809 (0.0009) [2023-12-26 04:19:10,763][123090] Updated weights for policy 1, policy_version 588708 (0.0007) [2023-12-26 04:19:10,818][123090] Updated weights for policy 1, policy_version 588718 (0.0005) [2023-12-26 04:19:10,882][123090] Updated weights for policy 1, policy_version 588728 (0.0006) [2023-12-26 04:19:11,005][123091] Updated weights for policy 0, policy_version 592819 (0.0010) [2023-12-26 04:19:11,078][123091] Updated weights for policy 0, policy_version 592829 (0.0009) [2023-12-26 04:19:11,139][123091] Updated weights for policy 0, policy_version 592839 (0.0009) [2023-12-26 04:19:11,723][123090] Updated weights for policy 1, policy_version 588738 (0.0007) [2023-12-26 04:19:11,795][123090] Updated weights for policy 1, policy_version 588748 (0.0009) [2023-12-26 04:19:11,869][123090] Updated weights for policy 1, policy_version 588758 (0.0010) [2023-12-26 04:19:11,926][123091] Updated weights for policy 0, policy_version 592849 (0.0009) [2023-12-26 04:19:11,939][123090] Updated weights for policy 1, policy_version 588768 (0.0010) [2023-12-26 04:19:11,982][123091] Updated weights for policy 0, policy_version 592859 (0.0006) [2023-12-26 04:19:12,054][123091] Updated weights for policy 0, policy_version 592869 (0.0006) [2023-12-26 04:19:12,108][123091] Updated weights for policy 0, policy_version 592879 (0.0006) [2023-12-26 04:19:12,782][123090] Updated weights for policy 1, policy_version 588778 (0.0010) [2023-12-26 04:19:12,853][123090] Updated weights for policy 1, policy_version 588788 (0.0010) [2023-12-26 04:19:12,901][123091] Updated weights for policy 0, policy_version 592889 (0.0008) [2023-12-26 04:19:12,916][123090] Updated weights for policy 1, policy_version 588798 (0.0009) [2023-12-26 04:19:12,963][123091] Updated weights for policy 0, policy_version 592899 (0.0008) [2023-12-26 04:19:13,022][123091] Updated weights for policy 0, policy_version 592909 (0.0010) [2023-12-26 04:19:13,682][123090] Updated weights for policy 1, policy_version 588808 (0.0008) [2023-12-26 04:19:13,734][123090] Updated weights for policy 1, policy_version 588818 (0.0005) [2023-12-26 04:19:13,780][123090] Updated weights for policy 1, policy_version 588828 (0.0005) [2023-12-26 04:19:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 302522368. Throughput: 0: 8930.4, 1: 8904.0. Samples: 302522488. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 04:19:13,785][121949] Avg episode reward: [(0, '6199.460'), (1, '5428.761')] [2023-12-26 04:19:13,886][123091] Updated weights for policy 0, policy_version 592919 (0.0010) [2023-12-26 04:19:13,940][123091] Updated weights for policy 0, policy_version 592929 (0.0009) [2023-12-26 04:19:13,993][123091] Updated weights for policy 0, policy_version 592940 (0.0010) [2023-12-26 04:19:14,589][123090] Updated weights for policy 1, policy_version 588838 (0.0008) [2023-12-26 04:19:14,655][123090] Updated weights for policy 1, policy_version 588848 (0.0009) [2023-12-26 04:19:14,713][123090] Updated weights for policy 1, policy_version 588858 (0.0010) [2023-12-26 04:19:14,814][123091] Updated weights for policy 0, policy_version 592950 (0.0009) [2023-12-26 04:19:14,876][123091] Updated weights for policy 0, policy_version 592960 (0.0009) [2023-12-26 04:19:14,931][123091] Updated weights for policy 0, policy_version 592970 (0.0010) [2023-12-26 04:19:15,477][123090] Updated weights for policy 1, policy_version 588868 (0.0007) [2023-12-26 04:19:15,536][123090] Updated weights for policy 1, policy_version 588878 (0.0008) [2023-12-26 04:19:15,601][123090] Updated weights for policy 1, policy_version 588888 (0.0009) [2023-12-26 04:19:15,814][123091] Updated weights for policy 0, policy_version 592980 (0.0010) [2023-12-26 04:19:15,866][123091] Updated weights for policy 0, policy_version 592990 (0.0010) [2023-12-26 04:19:15,921][123091] Updated weights for policy 0, policy_version 593000 (0.0010) [2023-12-26 04:19:16,377][123090] Updated weights for policy 1, policy_version 588898 (0.0008) [2023-12-26 04:19:16,442][123090] Updated weights for policy 1, policy_version 588908 (0.0006) [2023-12-26 04:19:16,487][123090] Updated weights for policy 1, policy_version 588918 (0.0005) [2023-12-26 04:19:16,540][123090] Updated weights for policy 1, policy_version 588928 (0.0007) [2023-12-26 04:19:16,826][123091] Updated weights for policy 0, policy_version 593010 (0.0009) [2023-12-26 04:19:16,895][123091] Updated weights for policy 0, policy_version 593020 (0.0011) [2023-12-26 04:19:16,954][123091] Updated weights for policy 0, policy_version 593030 (0.0006) [2023-12-26 04:19:17,008][123091] Updated weights for policy 0, policy_version 593040 (0.0005) [2023-12-26 04:19:17,279][123090] Updated weights for policy 1, policy_version 588938 (0.0011) [2023-12-26 04:19:17,334][123090] Updated weights for policy 1, policy_version 588948 (0.0010) [2023-12-26 04:19:17,386][123090] Updated weights for policy 1, policy_version 588958 (0.0010) [2023-12-26 04:19:17,641][123091] Updated weights for policy 0, policy_version 593050 (0.0005) [2023-12-26 04:19:17,691][123091] Updated weights for policy 0, policy_version 593060 (0.0006) [2023-12-26 04:19:17,745][123091] Updated weights for policy 0, policy_version 593070 (0.0005) [2023-12-26 04:19:18,214][123090] Updated weights for policy 1, policy_version 588968 (0.0010) [2023-12-26 04:19:18,266][123090] Updated weights for policy 1, policy_version 588978 (0.0010) [2023-12-26 04:19:18,320][123090] Updated weights for policy 1, policy_version 588988 (0.0010) [2023-12-26 04:19:18,464][123091] Updated weights for policy 0, policy_version 593080 (0.0006) [2023-12-26 04:19:18,537][123091] Updated weights for policy 0, policy_version 593090 (0.0006) [2023-12-26 04:19:18,611][123091] Updated weights for policy 0, policy_version 593100 (0.0006) [2023-12-26 04:19:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 302620672. Throughput: 0: 8875.5, 1: 8909.8. Samples: 302629616. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:18,785][121949] Avg episode reward: [(0, '6176.399'), (1, '5400.771')] [2023-12-26 04:19:19,157][123090] Updated weights for policy 1, policy_version 588998 (0.0010) [2023-12-26 04:19:19,217][123090] Updated weights for policy 1, policy_version 589008 (0.0010) [2023-12-26 04:19:19,288][123090] Updated weights for policy 1, policy_version 589018 (0.0011) [2023-12-26 04:19:19,375][123091] Updated weights for policy 0, policy_version 593110 (0.0009) [2023-12-26 04:19:19,447][123091] Updated weights for policy 0, policy_version 593120 (0.0011) [2023-12-26 04:19:19,523][123091] Updated weights for policy 0, policy_version 593130 (0.0010) [2023-12-26 04:19:20,077][123090] Updated weights for policy 1, policy_version 589028 (0.0008) [2023-12-26 04:19:20,133][123090] Updated weights for policy 1, policy_version 589038 (0.0006) [2023-12-26 04:19:20,185][123090] Updated weights for policy 1, policy_version 589048 (0.0009) [2023-12-26 04:19:20,386][123091] Updated weights for policy 0, policy_version 593140 (0.0011) [2023-12-26 04:19:20,443][123091] Updated weights for policy 0, policy_version 593150 (0.0011) [2023-12-26 04:19:20,506][123091] Updated weights for policy 0, policy_version 593160 (0.0011) [2023-12-26 04:19:21,033][123090] Updated weights for policy 1, policy_version 589058 (0.0009) [2023-12-26 04:19:21,095][123090] Updated weights for policy 1, policy_version 589068 (0.0007) [2023-12-26 04:19:21,165][123090] Updated weights for policy 1, policy_version 589078 (0.0008) [2023-12-26 04:19:21,213][123090] Updated weights for policy 1, policy_version 589088 (0.0008) [2023-12-26 04:19:21,293][123091] Updated weights for policy 0, policy_version 593170 (0.0011) [2023-12-26 04:19:21,368][123091] Updated weights for policy 0, policy_version 593180 (0.0010) [2023-12-26 04:19:21,438][123091] Updated weights for policy 0, policy_version 593190 (0.0007) [2023-12-26 04:19:21,511][123091] Updated weights for policy 0, policy_version 593200 (0.0006) [2023-12-26 04:19:22,030][123090] Updated weights for policy 1, policy_version 589098 (0.0008) [2023-12-26 04:19:22,092][123090] Updated weights for policy 1, policy_version 589108 (0.0007) [2023-12-26 04:19:22,149][123090] Updated weights for policy 1, policy_version 589118 (0.0009) [2023-12-26 04:19:22,308][123091] Updated weights for policy 0, policy_version 593210 (0.0011) [2023-12-26 04:19:22,366][123091] Updated weights for policy 0, policy_version 593220 (0.0011) [2023-12-26 04:19:22,430][123091] Updated weights for policy 0, policy_version 593230 (0.0009) [2023-12-26 04:19:23,002][123090] Updated weights for policy 1, policy_version 589128 (0.0010) [2023-12-26 04:19:23,064][123090] Updated weights for policy 1, policy_version 589138 (0.0011) [2023-12-26 04:19:23,124][123090] Updated weights for policy 1, policy_version 589148 (0.0007) [2023-12-26 04:19:23,309][123091] Updated weights for policy 0, policy_version 593240 (0.0010) [2023-12-26 04:19:23,369][123091] Updated weights for policy 0, policy_version 593250 (0.0011) [2023-12-26 04:19:23,437][123091] Updated weights for policy 0, policy_version 593260 (0.0011) [2023-12-26 04:19:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 302702592. Throughput: 0: 8887.7, 1: 8872.2. Samples: 302681480. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:23,785][121949] Avg episode reward: [(0, '6159.094'), (1, '5725.209')] [2023-12-26 04:19:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000593264_151879680.pth... [2023-12-26 04:19:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000589152_150822912.pth... [2023-12-26 04:19:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000592240_151617536.pth [2023-12-26 04:19:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000588096_150552576.pth [2023-12-26 04:19:23,940][123090] Updated weights for policy 1, policy_version 589158 (0.0009) [2023-12-26 04:19:24,007][123090] Updated weights for policy 1, policy_version 589168 (0.0010) [2023-12-26 04:19:24,078][123090] Updated weights for policy 1, policy_version 589178 (0.0010) [2023-12-26 04:19:24,202][123091] Updated weights for policy 0, policy_version 593270 (0.0011) [2023-12-26 04:19:24,245][123091] Updated weights for policy 0, policy_version 593280 (0.0010) [2023-12-26 04:19:24,304][123091] Updated weights for policy 0, policy_version 593290 (0.0010) [2023-12-26 04:19:24,861][123090] Updated weights for policy 1, policy_version 589188 (0.0007) [2023-12-26 04:19:24,929][123090] Updated weights for policy 1, policy_version 589198 (0.0005) [2023-12-26 04:19:25,003][123090] Updated weights for policy 1, policy_version 589208 (0.0005) [2023-12-26 04:19:25,148][123091] Updated weights for policy 0, policy_version 593300 (0.0008) [2023-12-26 04:19:25,197][123091] Updated weights for policy 0, policy_version 593310 (0.0005) [2023-12-26 04:19:25,255][123091] Updated weights for policy 0, policy_version 593320 (0.0005) [2023-12-26 04:19:25,833][123090] Updated weights for policy 1, policy_version 589218 (0.0006) [2023-12-26 04:19:25,870][123091] Updated weights for policy 0, policy_version 593330 (0.0005) [2023-12-26 04:19:25,894][123090] Updated weights for policy 1, policy_version 589228 (0.0009) [2023-12-26 04:19:25,925][123091] Updated weights for policy 0, policy_version 593340 (0.0007) [2023-12-26 04:19:25,963][123090] Updated weights for policy 1, policy_version 589238 (0.0008) [2023-12-26 04:19:25,979][123091] Updated weights for policy 0, policy_version 593350 (0.0007) [2023-12-26 04:19:26,032][123090] Updated weights for policy 1, policy_version 589248 (0.0009) [2023-12-26 04:19:26,037][123091] Updated weights for policy 0, policy_version 593360 (0.0007) [2023-12-26 04:19:26,729][123091] Updated weights for policy 0, policy_version 593370 (0.0009) [2023-12-26 04:19:26,777][123091] Updated weights for policy 0, policy_version 593380 (0.0008) [2023-12-26 04:19:26,826][123091] Updated weights for policy 0, policy_version 593390 (0.0006) [2023-12-26 04:19:26,904][123090] Updated weights for policy 1, policy_version 589258 (0.0011) [2023-12-26 04:19:26,965][123090] Updated weights for policy 1, policy_version 589268 (0.0009) [2023-12-26 04:19:27,028][123090] Updated weights for policy 1, policy_version 589278 (0.0006) [2023-12-26 04:19:27,721][123090] Updated weights for policy 1, policy_version 589288 (0.0007) [2023-12-26 04:19:27,722][123091] Updated weights for policy 0, policy_version 593400 (0.0007) [2023-12-26 04:19:27,775][123091] Updated weights for policy 0, policy_version 593410 (0.0009) [2023-12-26 04:19:27,791][123090] Updated weights for policy 1, policy_version 589298 (0.0005) [2023-12-26 04:19:27,822][123091] Updated weights for policy 0, policy_version 593420 (0.0008) [2023-12-26 04:19:27,858][123090] Updated weights for policy 1, policy_version 589308 (0.0005) [2023-12-26 04:19:28,446][123090] Updated weights for policy 1, policy_version 589318 (0.0006) [2023-12-26 04:19:28,503][123090] Updated weights for policy 1, policy_version 589328 (0.0006) [2023-12-26 04:19:28,554][123090] Updated weights for policy 1, policy_version 589338 (0.0005) [2023-12-26 04:19:28,592][123091] Updated weights for policy 0, policy_version 593430 (0.0008) [2023-12-26 04:19:28,646][123091] Updated weights for policy 0, policy_version 593440 (0.0009) [2023-12-26 04:19:28,698][123091] Updated weights for policy 0, policy_version 593450 (0.0009) [2023-12-26 04:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 302800896. Throughput: 0: 8958.1, 1: 8901.2. Samples: 302787176. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:28,785][121949] Avg episode reward: [(0, '6196.691'), (1, '5656.277')] [2023-12-26 04:19:29,353][123090] Updated weights for policy 1, policy_version 589348 (0.0007) [2023-12-26 04:19:29,419][123090] Updated weights for policy 1, policy_version 589358 (0.0007) [2023-12-26 04:19:29,477][123090] Updated weights for policy 1, policy_version 589368 (0.0006) [2023-12-26 04:19:29,556][123091] Updated weights for policy 0, policy_version 593460 (0.0008) [2023-12-26 04:19:29,628][123091] Updated weights for policy 0, policy_version 593470 (0.0006) [2023-12-26 04:19:29,699][123091] Updated weights for policy 0, policy_version 593480 (0.0006) [2023-12-26 04:19:30,289][123090] Updated weights for policy 1, policy_version 589378 (0.0006) [2023-12-26 04:19:30,339][123090] Updated weights for policy 1, policy_version 589388 (0.0005) [2023-12-26 04:19:30,406][123090] Updated weights for policy 1, policy_version 589398 (0.0005) [2023-12-26 04:19:30,456][123091] Updated weights for policy 0, policy_version 593490 (0.0008) [2023-12-26 04:19:30,473][123090] Updated weights for policy 1, policy_version 589408 (0.0007) [2023-12-26 04:19:30,519][123091] Updated weights for policy 0, policy_version 593500 (0.0009) [2023-12-26 04:19:30,566][123091] Updated weights for policy 0, policy_version 593510 (0.0006) [2023-12-26 04:19:31,097][123090] Updated weights for policy 1, policy_version 589418 (0.0010) [2023-12-26 04:19:31,163][123090] Updated weights for policy 1, policy_version 589428 (0.0009) [2023-12-26 04:19:31,215][123090] Updated weights for policy 1, policy_version 589438 (0.0009) [2023-12-26 04:19:31,436][123091] Updated weights for policy 0, policy_version 593521 (0.0009) [2023-12-26 04:19:31,482][123091] Updated weights for policy 0, policy_version 593531 (0.0009) [2023-12-26 04:19:31,531][123091] Updated weights for policy 0, policy_version 593541 (0.0009) [2023-12-26 04:19:31,580][123091] Updated weights for policy 0, policy_version 593551 (0.0009) [2023-12-26 04:19:32,066][123090] Updated weights for policy 1, policy_version 589448 (0.0010) [2023-12-26 04:19:32,133][123090] Updated weights for policy 1, policy_version 589458 (0.0010) [2023-12-26 04:19:32,200][123090] Updated weights for policy 1, policy_version 589468 (0.0009) [2023-12-26 04:19:32,436][123091] Updated weights for policy 0, policy_version 593561 (0.0009) [2023-12-26 04:19:32,508][123091] Updated weights for policy 0, policy_version 593571 (0.0009) [2023-12-26 04:19:32,570][123091] Updated weights for policy 0, policy_version 593581 (0.0010) [2023-12-26 04:19:33,012][123090] Updated weights for policy 1, policy_version 589478 (0.0008) [2023-12-26 04:19:33,070][123090] Updated weights for policy 1, policy_version 589488 (0.0007) [2023-12-26 04:19:33,144][123090] Updated weights for policy 1, policy_version 589498 (0.0008) [2023-12-26 04:19:33,441][123091] Updated weights for policy 0, policy_version 593591 (0.0009) [2023-12-26 04:19:33,497][123091] Updated weights for policy 0, policy_version 593601 (0.0008) [2023-12-26 04:19:33,555][123091] Updated weights for policy 0, policy_version 593611 (0.0010) [2023-12-26 04:19:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 302882816. Throughput: 0: 8930.8, 1: 8932.7. Samples: 302893716. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:33,784][121949] Avg episode reward: [(0, '6109.946'), (1, '5708.757')] [2023-12-26 04:19:33,785][123090] Updated weights for policy 1, policy_version 589508 (0.0009) [2023-12-26 04:19:33,847][123090] Updated weights for policy 1, policy_version 589518 (0.0010) [2023-12-26 04:19:33,908][123090] Updated weights for policy 1, policy_version 589528 (0.0010) [2023-12-26 04:19:34,445][123091] Updated weights for policy 0, policy_version 593621 (0.0007) [2023-12-26 04:19:34,504][123091] Updated weights for policy 0, policy_version 593631 (0.0005) [2023-12-26 04:19:34,561][123091] Updated weights for policy 0, policy_version 593641 (0.0005) [2023-12-26 04:19:34,694][123090] Updated weights for policy 1, policy_version 589538 (0.0010) [2023-12-26 04:19:34,754][123090] Updated weights for policy 1, policy_version 589548 (0.0009) [2023-12-26 04:19:34,816][123090] Updated weights for policy 1, policy_version 589558 (0.0009) [2023-12-26 04:19:34,876][123090] Updated weights for policy 1, policy_version 589568 (0.0010) [2023-12-26 04:19:35,325][123091] Updated weights for policy 0, policy_version 593651 (0.0005) [2023-12-26 04:19:35,378][123091] Updated weights for policy 0, policy_version 593661 (0.0005) [2023-12-26 04:19:35,433][123091] Updated weights for policy 0, policy_version 593671 (0.0005) [2023-12-26 04:19:35,560][123090] Updated weights for policy 1, policy_version 589578 (0.0005) [2023-12-26 04:19:35,607][123090] Updated weights for policy 1, policy_version 589588 (0.0005) [2023-12-26 04:19:35,656][123090] Updated weights for policy 1, policy_version 589598 (0.0005) [2023-12-26 04:19:36,144][123091] Updated weights for policy 0, policy_version 593681 (0.0006) [2023-12-26 04:19:36,207][123091] Updated weights for policy 0, policy_version 593691 (0.0010) [2023-12-26 04:19:36,274][123091] Updated weights for policy 0, policy_version 593701 (0.0010) [2023-12-26 04:19:36,339][123091] Updated weights for policy 0, policy_version 593711 (0.0010) [2023-12-26 04:19:36,408][123090] Updated weights for policy 1, policy_version 589608 (0.0009) [2023-12-26 04:19:36,477][123090] Updated weights for policy 1, policy_version 589618 (0.0008) [2023-12-26 04:19:36,545][123090] Updated weights for policy 1, policy_version 589628 (0.0008) [2023-12-26 04:19:37,142][123091] Updated weights for policy 0, policy_version 593721 (0.0009) [2023-12-26 04:19:37,191][123091] Updated weights for policy 0, policy_version 593731 (0.0009) [2023-12-26 04:19:37,245][123091] Updated weights for policy 0, policy_version 593741 (0.0010) [2023-12-26 04:19:37,377][123090] Updated weights for policy 1, policy_version 589638 (0.0007) [2023-12-26 04:19:37,433][123090] Updated weights for policy 1, policy_version 589648 (0.0010) [2023-12-26 04:19:37,495][123090] Updated weights for policy 1, policy_version 589658 (0.0008) [2023-12-26 04:19:38,165][123091] Updated weights for policy 0, policy_version 593751 (0.0009) [2023-12-26 04:19:38,234][123091] Updated weights for policy 0, policy_version 593761 (0.0010) [2023-12-26 04:19:38,258][123090] Updated weights for policy 1, policy_version 589668 (0.0009) [2023-12-26 04:19:38,297][123091] Updated weights for policy 0, policy_version 593771 (0.0009) [2023-12-26 04:19:38,306][123090] Updated weights for policy 1, policy_version 589678 (0.0006) [2023-12-26 04:19:38,374][123090] Updated weights for policy 1, policy_version 589688 (0.0009) [2023-12-26 04:19:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 302972928. Throughput: 0: 8885.1, 1: 9006.9. Samples: 302948804. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:38,784][121949] Avg episode reward: [(0, '6062.278'), (1, '5860.763')] [2023-12-26 04:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000593776_152010752.pth... [2023-12-26 04:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000589696_150962176.pth... [2023-12-26 04:19:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000592752_151748608.pth [2023-12-26 04:19:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000588672_150700032.pth [2023-12-26 04:19:39,146][123091] Updated weights for policy 0, policy_version 593781 (0.0009) [2023-12-26 04:19:39,193][123091] Updated weights for policy 0, policy_version 593791 (0.0010) [2023-12-26 04:19:39,217][123090] Updated weights for policy 1, policy_version 589698 (0.0009) [2023-12-26 04:19:39,266][123091] Updated weights for policy 0, policy_version 593801 (0.0008) [2023-12-26 04:19:39,286][123090] Updated weights for policy 1, policy_version 589708 (0.0009) [2023-12-26 04:19:39,349][123090] Updated weights for policy 1, policy_version 589718 (0.0010) [2023-12-26 04:19:39,428][123090] Updated weights for policy 1, policy_version 589728 (0.0010) [2023-12-26 04:19:40,115][123091] Updated weights for policy 0, policy_version 593811 (0.0007) [2023-12-26 04:19:40,179][123091] Updated weights for policy 0, policy_version 593821 (0.0011) [2023-12-26 04:19:40,248][123091] Updated weights for policy 0, policy_version 593831 (0.0011) [2023-12-26 04:19:40,252][123090] Updated weights for policy 1, policy_version 589738 (0.0007) [2023-12-26 04:19:40,312][123090] Updated weights for policy 1, policy_version 589748 (0.0006) [2023-12-26 04:19:40,363][123090] Updated weights for policy 1, policy_version 589758 (0.0009) [2023-12-26 04:19:41,015][123091] Updated weights for policy 0, policy_version 593841 (0.0011) [2023-12-26 04:19:41,080][123091] Updated weights for policy 0, policy_version 593851 (0.0008) [2023-12-26 04:19:41,150][123091] Updated weights for policy 0, policy_version 593862 (0.0009) [2023-12-26 04:19:41,212][123091] Updated weights for policy 0, policy_version 593872 (0.0008) [2023-12-26 04:19:41,221][123090] Updated weights for policy 1, policy_version 589768 (0.0009) [2023-12-26 04:19:41,285][123090] Updated weights for policy 1, policy_version 589778 (0.0009) [2023-12-26 04:19:41,349][123090] Updated weights for policy 1, policy_version 589788 (0.0010) [2023-12-26 04:19:42,056][123091] Updated weights for policy 0, policy_version 593882 (0.0009) [2023-12-26 04:19:42,123][123091] Updated weights for policy 0, policy_version 593892 (0.0009) [2023-12-26 04:19:42,178][123091] Updated weights for policy 0, policy_version 593902 (0.0009) [2023-12-26 04:19:42,179][123090] Updated weights for policy 1, policy_version 589798 (0.0009) [2023-12-26 04:19:42,246][123090] Updated weights for policy 1, policy_version 589808 (0.0009) [2023-12-26 04:19:42,319][123090] Updated weights for policy 1, policy_version 589818 (0.0008) [2023-12-26 04:19:42,963][123091] Updated weights for policy 0, policy_version 593912 (0.0009) [2023-12-26 04:19:43,041][123091] Updated weights for policy 0, policy_version 593922 (0.0009) [2023-12-26 04:19:43,108][123091] Updated weights for policy 0, policy_version 593932 (0.0009) [2023-12-26 04:19:43,147][123090] Updated weights for policy 1, policy_version 589828 (0.0009) [2023-12-26 04:19:43,205][123090] Updated weights for policy 1, policy_version 589838 (0.0010) [2023-12-26 04:19:43,255][123090] Updated weights for policy 1, policy_version 589848 (0.0009) [2023-12-26 04:19:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 303054848. Throughput: 0: 8826.4, 1: 8894.0. Samples: 303050852. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:43,785][121949] Avg episode reward: [(0, '6175.024'), (1, '5996.836')] [2023-12-26 04:19:43,874][123091] Updated weights for policy 0, policy_version 593942 (0.0007) [2023-12-26 04:19:43,936][123091] Updated weights for policy 0, policy_version 593952 (0.0005) [2023-12-26 04:19:43,994][123091] Updated weights for policy 0, policy_version 593962 (0.0006) [2023-12-26 04:19:44,138][123090] Updated weights for policy 1, policy_version 589858 (0.0009) [2023-12-26 04:19:44,205][123090] Updated weights for policy 1, policy_version 589868 (0.0009) [2023-12-26 04:19:44,267][123090] Updated weights for policy 1, policy_version 589878 (0.0009) [2023-12-26 04:19:44,324][123090] Updated weights for policy 1, policy_version 589888 (0.0009) [2023-12-26 04:19:44,646][123091] Updated weights for policy 0, policy_version 593972 (0.0007) [2023-12-26 04:19:44,701][123091] Updated weights for policy 0, policy_version 593982 (0.0010) [2023-12-26 04:19:44,757][123091] Updated weights for policy 0, policy_version 593992 (0.0009) [2023-12-26 04:19:45,241][123090] Updated weights for policy 1, policy_version 589898 (0.0010) [2023-12-26 04:19:45,305][123090] Updated weights for policy 1, policy_version 589908 (0.0008) [2023-12-26 04:19:45,373][123090] Updated weights for policy 1, policy_version 589918 (0.0010) [2023-12-26 04:19:45,494][123091] Updated weights for policy 0, policy_version 594002 (0.0008) [2023-12-26 04:19:45,561][123091] Updated weights for policy 0, policy_version 594012 (0.0009) [2023-12-26 04:19:45,628][123091] Updated weights for policy 0, policy_version 594022 (0.0010) [2023-12-26 04:19:45,693][123091] Updated weights for policy 0, policy_version 594032 (0.0010) [2023-12-26 04:19:46,192][123090] Updated weights for policy 1, policy_version 589928 (0.0009) [2023-12-26 04:19:46,240][123090] Updated weights for policy 1, policy_version 589938 (0.0009) [2023-12-26 04:19:46,288][123090] Updated weights for policy 1, policy_version 589948 (0.0009) [2023-12-26 04:19:46,505][123091] Updated weights for policy 0, policy_version 594042 (0.0009) [2023-12-26 04:19:46,571][123091] Updated weights for policy 0, policy_version 594052 (0.0009) [2023-12-26 04:19:46,627][123091] Updated weights for policy 0, policy_version 594062 (0.0009) [2023-12-26 04:19:47,127][123090] Updated weights for policy 1, policy_version 589958 (0.0010) [2023-12-26 04:19:47,179][123090] Updated weights for policy 1, policy_version 589968 (0.0008) [2023-12-26 04:19:47,232][123090] Updated weights for policy 1, policy_version 589978 (0.0010) [2023-12-26 04:19:47,447][123091] Updated weights for policy 0, policy_version 594072 (0.0007) [2023-12-26 04:19:47,506][123091] Updated weights for policy 0, policy_version 594082 (0.0006) [2023-12-26 04:19:47,551][123091] Updated weights for policy 0, policy_version 594092 (0.0005) [2023-12-26 04:19:48,149][123090] Updated weights for policy 1, policy_version 589989 (0.0010) [2023-12-26 04:19:48,219][123090] Updated weights for policy 1, policy_version 589999 (0.0010) [2023-12-26 04:19:48,229][123091] Updated weights for policy 0, policy_version 594102 (0.0005) [2023-12-26 04:19:48,280][123091] Updated weights for policy 0, policy_version 594112 (0.0005) [2023-12-26 04:19:48,283][123090] Updated weights for policy 1, policy_version 590009 (0.0009) [2023-12-26 04:19:48,339][123091] Updated weights for policy 0, policy_version 594122 (0.0007) [2023-12-26 04:19:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 303144960. Throughput: 0: 8840.3, 1: 8795.1. Samples: 303156700. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:48,785][121949] Avg episode reward: [(0, '6160.969'), (1, '5896.220')] [2023-12-26 04:19:49,106][123090] Updated weights for policy 1, policy_version 590019 (0.0009) [2023-12-26 04:19:49,173][123091] Updated weights for policy 0, policy_version 594132 (0.0010) [2023-12-26 04:19:49,175][123090] Updated weights for policy 1, policy_version 590029 (0.0008) [2023-12-26 04:19:49,244][123090] Updated weights for policy 1, policy_version 590039 (0.0009) [2023-12-26 04:19:49,252][123091] Updated weights for policy 0, policy_version 594142 (0.0009) [2023-12-26 04:19:49,320][123091] Updated weights for policy 0, policy_version 594152 (0.0006) [2023-12-26 04:19:50,006][123091] Updated weights for policy 0, policy_version 594162 (0.0009) [2023-12-26 04:19:50,069][123091] Updated weights for policy 0, policy_version 594172 (0.0006) [2023-12-26 04:19:50,121][123090] Updated weights for policy 1, policy_version 590049 (0.0008) [2023-12-26 04:19:50,136][123091] Updated weights for policy 0, policy_version 594182 (0.0009) [2023-12-26 04:19:50,190][123090] Updated weights for policy 1, policy_version 590059 (0.0008) [2023-12-26 04:19:50,201][123091] Updated weights for policy 0, policy_version 594192 (0.0008) [2023-12-26 04:19:50,256][123090] Updated weights for policy 1, policy_version 590069 (0.0009) [2023-12-26 04:19:50,318][123090] Updated weights for policy 1, policy_version 590079 (0.0009) [2023-12-26 04:19:50,870][123091] Updated weights for policy 0, policy_version 594202 (0.0007) [2023-12-26 04:19:50,939][123091] Updated weights for policy 0, policy_version 594212 (0.0006) [2023-12-26 04:19:51,010][123091] Updated weights for policy 0, policy_version 594222 (0.0006) [2023-12-26 04:19:51,196][123090] Updated weights for policy 1, policy_version 590089 (0.0009) [2023-12-26 04:19:51,261][123090] Updated weights for policy 1, policy_version 590099 (0.0010) [2023-12-26 04:19:51,318][123090] Updated weights for policy 1, policy_version 590109 (0.0010) [2023-12-26 04:19:51,714][123091] Updated weights for policy 0, policy_version 594232 (0.0009) [2023-12-26 04:19:51,786][123091] Updated weights for policy 0, policy_version 594242 (0.0007) [2023-12-26 04:19:51,857][123091] Updated weights for policy 0, policy_version 594252 (0.0006) [2023-12-26 04:19:52,137][123090] Updated weights for policy 1, policy_version 590119 (0.0009) [2023-12-26 04:19:52,188][123090] Updated weights for policy 1, policy_version 590129 (0.0009) [2023-12-26 04:19:52,240][123090] Updated weights for policy 1, policy_version 590139 (0.0009) [2023-12-26 04:19:52,531][123091] Updated weights for policy 0, policy_version 594262 (0.0011) [2023-12-26 04:19:52,598][123091] Updated weights for policy 0, policy_version 594272 (0.0006) [2023-12-26 04:19:52,666][123091] Updated weights for policy 0, policy_version 594282 (0.0010) [2023-12-26 04:19:53,043][123090] Updated weights for policy 1, policy_version 590149 (0.0007) [2023-12-26 04:19:53,097][123090] Updated weights for policy 1, policy_version 590159 (0.0005) [2023-12-26 04:19:53,153][123090] Updated weights for policy 1, policy_version 590169 (0.0005) [2023-12-26 04:19:53,378][123091] Updated weights for policy 0, policy_version 594292 (0.0008) [2023-12-26 04:19:53,427][123091] Updated weights for policy 0, policy_version 594302 (0.0007) [2023-12-26 04:19:53,478][123091] Updated weights for policy 0, policy_version 594313 (0.0010) [2023-12-26 04:19:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 303235072. Throughput: 0: 8856.4, 1: 8697.2. Samples: 303209104. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:53,785][121949] Avg episode reward: [(0, '6075.607'), (1, '5794.137')] [2023-12-26 04:19:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000590176_151085056.pth... [2023-12-26 04:19:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000594320_152150016.pth... [2023-12-26 04:19:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000593264_151879680.pth [2023-12-26 04:19:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000589152_150822912.pth [2023-12-26 04:19:53,885][123090] Updated weights for policy 1, policy_version 590179 (0.0007) [2023-12-26 04:19:53,947][123090] Updated weights for policy 1, policy_version 590189 (0.0010) [2023-12-26 04:19:54,002][123090] Updated weights for policy 1, policy_version 590199 (0.0010) [2023-12-26 04:19:54,354][123091] Updated weights for policy 0, policy_version 594323 (0.0009) [2023-12-26 04:19:54,402][123091] Updated weights for policy 0, policy_version 594333 (0.0009) [2023-12-26 04:19:54,454][123091] Updated weights for policy 0, policy_version 594343 (0.0009) [2023-12-26 04:19:54,776][123090] Updated weights for policy 1, policy_version 590209 (0.0010) [2023-12-26 04:19:54,824][123090] Updated weights for policy 1, policy_version 590219 (0.0005) [2023-12-26 04:19:54,875][123090] Updated weights for policy 1, policy_version 590229 (0.0005) [2023-12-26 04:19:54,928][123090] Updated weights for policy 1, policy_version 590239 (0.0006) [2023-12-26 04:19:55,380][123091] Updated weights for policy 0, policy_version 594353 (0.0009) [2023-12-26 04:19:55,436][123091] Updated weights for policy 0, policy_version 594363 (0.0009) [2023-12-26 04:19:55,486][123091] Updated weights for policy 0, policy_version 594373 (0.0007) [2023-12-26 04:19:55,544][123091] Updated weights for policy 0, policy_version 594383 (0.0005) [2023-12-26 04:19:55,579][123090] Updated weights for policy 1, policy_version 590249 (0.0005) [2023-12-26 04:19:55,625][123090] Updated weights for policy 1, policy_version 590259 (0.0005) [2023-12-26 04:19:55,675][123090] Updated weights for policy 1, policy_version 590269 (0.0005) [2023-12-26 04:19:56,315][123090] Updated weights for policy 1, policy_version 590279 (0.0005) [2023-12-26 04:19:56,363][123090] Updated weights for policy 1, policy_version 590289 (0.0005) [2023-12-26 04:19:56,419][123090] Updated weights for policy 1, policy_version 590299 (0.0005) [2023-12-26 04:19:56,432][123091] Updated weights for policy 0, policy_version 594393 (0.0008) [2023-12-26 04:19:56,493][123091] Updated weights for policy 0, policy_version 594403 (0.0009) [2023-12-26 04:19:56,553][123091] Updated weights for policy 0, policy_version 594413 (0.0009) [2023-12-26 04:19:57,189][123090] Updated weights for policy 1, policy_version 590309 (0.0007) [2023-12-26 04:19:57,220][123091] Updated weights for policy 0, policy_version 594423 (0.0005) [2023-12-26 04:19:57,242][123090] Updated weights for policy 1, policy_version 590319 (0.0008) [2023-12-26 04:19:57,279][123091] Updated weights for policy 0, policy_version 594433 (0.0005) [2023-12-26 04:19:57,300][123090] Updated weights for policy 1, policy_version 590329 (0.0007) [2023-12-26 04:19:57,340][123091] Updated weights for policy 0, policy_version 594443 (0.0005) [2023-12-26 04:19:57,930][123091] Updated weights for policy 0, policy_version 594453 (0.0005) [2023-12-26 04:19:57,981][123091] Updated weights for policy 0, policy_version 594463 (0.0006) [2023-12-26 04:19:58,040][123090] Updated weights for policy 1, policy_version 590339 (0.0008) [2023-12-26 04:19:58,048][123091] Updated weights for policy 0, policy_version 594473 (0.0008) [2023-12-26 04:19:58,108][123090] Updated weights for policy 1, policy_version 590349 (0.0009) [2023-12-26 04:19:58,165][123090] Updated weights for policy 1, policy_version 590359 (0.0009) [2023-12-26 04:19:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 303325184. Throughput: 0: 8900.1, 1: 8843.9. Samples: 303320968. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:19:58,785][121949] Avg episode reward: [(0, '6135.022'), (1, '5782.460')] [2023-12-26 04:19:58,899][123091] Updated weights for policy 0, policy_version 594483 (0.0008) [2023-12-26 04:19:58,965][123091] Updated weights for policy 0, policy_version 594493 (0.0008) [2023-12-26 04:19:59,032][123091] Updated weights for policy 0, policy_version 594503 (0.0008) [2023-12-26 04:19:59,122][123090] Updated weights for policy 1, policy_version 590369 (0.0009) [2023-12-26 04:19:59,186][123090] Updated weights for policy 1, policy_version 590379 (0.0009) [2023-12-26 04:19:59,274][123090] Updated weights for policy 1, policy_version 590389 (0.0009) [2023-12-26 04:19:59,334][123090] Updated weights for policy 1, policy_version 590399 (0.0009) [2023-12-26 04:19:59,832][123091] Updated weights for policy 0, policy_version 594513 (0.0008) [2023-12-26 04:19:59,892][123091] Updated weights for policy 0, policy_version 594523 (0.0010) [2023-12-26 04:19:59,964][123091] Updated weights for policy 0, policy_version 594533 (0.0009) [2023-12-26 04:20:00,032][123091] Updated weights for policy 0, policy_version 594543 (0.0009) [2023-12-26 04:20:00,188][123090] Updated weights for policy 1, policy_version 590409 (0.0009) [2023-12-26 04:20:00,243][123090] Updated weights for policy 1, policy_version 590419 (0.0009) [2023-12-26 04:20:00,306][123090] Updated weights for policy 1, policy_version 590429 (0.0008) [2023-12-26 04:20:00,815][123091] Updated weights for policy 0, policy_version 594553 (0.0009) [2023-12-26 04:20:00,867][123091] Updated weights for policy 0, policy_version 594563 (0.0009) [2023-12-26 04:20:00,918][123091] Updated weights for policy 0, policy_version 594573 (0.0009) [2023-12-26 04:20:01,056][123090] Updated weights for policy 1, policy_version 590439 (0.0007) [2023-12-26 04:20:01,130][123090] Updated weights for policy 1, policy_version 590449 (0.0009) [2023-12-26 04:20:01,191][123090] Updated weights for policy 1, policy_version 590459 (0.0007) [2023-12-26 04:20:01,666][123091] Updated weights for policy 0, policy_version 594583 (0.0010) [2023-12-26 04:20:01,742][123091] Updated weights for policy 0, policy_version 594593 (0.0009) [2023-12-26 04:20:01,815][123091] Updated weights for policy 0, policy_version 594603 (0.0007) [2023-12-26 04:20:01,995][123090] Updated weights for policy 1, policy_version 590469 (0.0006) [2023-12-26 04:20:02,062][123090] Updated weights for policy 1, policy_version 590479 (0.0005) [2023-12-26 04:20:02,127][123090] Updated weights for policy 1, policy_version 590489 (0.0005) [2023-12-26 04:20:02,558][123091] Updated weights for policy 0, policy_version 594613 (0.0009) [2023-12-26 04:20:02,608][123091] Updated weights for policy 0, policy_version 594623 (0.0009) [2023-12-26 04:20:02,659][123091] Updated weights for policy 0, policy_version 594633 (0.0009) [2023-12-26 04:20:02,848][123090] Updated weights for policy 1, policy_version 590499 (0.0007) [2023-12-26 04:20:02,908][123090] Updated weights for policy 1, policy_version 590509 (0.0009) [2023-12-26 04:20:02,965][123090] Updated weights for policy 1, policy_version 590519 (0.0009) [2023-12-26 04:20:03,570][123091] Updated weights for policy 0, policy_version 594643 (0.0009) [2023-12-26 04:20:03,627][123091] Updated weights for policy 0, policy_version 594654 (0.0009) [2023-12-26 04:20:03,649][123090] Updated weights for policy 1, policy_version 590529 (0.0008) [2023-12-26 04:20:03,677][123091] Updated weights for policy 0, policy_version 594664 (0.0009) [2023-12-26 04:20:03,709][123090] Updated weights for policy 1, policy_version 590539 (0.0009) [2023-12-26 04:20:03,765][123090] Updated weights for policy 1, policy_version 590549 (0.0009) [2023-12-26 04:20:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 303415296. Throughput: 0: 8893.7, 1: 8841.1. Samples: 303427680. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:03,784][121949] Avg episode reward: [(0, '6285.949'), (1, '5739.587')] [2023-12-26 04:20:03,814][123090] Updated weights for policy 1, policy_version 590559 (0.0009) [2023-12-26 04:20:04,537][123091] Updated weights for policy 0, policy_version 594674 (0.0007) [2023-12-26 04:20:04,591][123091] Updated weights for policy 0, policy_version 594684 (0.0007) [2023-12-26 04:20:04,642][123091] Updated weights for policy 0, policy_version 594694 (0.0006) [2023-12-26 04:20:04,680][123090] Updated weights for policy 1, policy_version 590569 (0.0011) [2023-12-26 04:20:04,699][123091] Updated weights for policy 0, policy_version 594704 (0.0006) [2023-12-26 04:20:04,732][123090] Updated weights for policy 1, policy_version 590579 (0.0010) [2023-12-26 04:20:04,788][123090] Updated weights for policy 1, policy_version 590589 (0.0011) [2023-12-26 04:20:05,483][123091] Updated weights for policy 0, policy_version 594714 (0.0009) [2023-12-26 04:20:05,489][123090] Updated weights for policy 1, policy_version 590599 (0.0008) [2023-12-26 04:20:05,538][123090] Updated weights for policy 1, policy_version 590609 (0.0006) [2023-12-26 04:20:05,544][123091] Updated weights for policy 0, policy_version 594724 (0.0009) [2023-12-26 04:20:05,587][123090] Updated weights for policy 1, policy_version 590619 (0.0008) [2023-12-26 04:20:05,602][123091] Updated weights for policy 0, policy_version 594734 (0.0009) [2023-12-26 04:20:06,388][123091] Updated weights for policy 0, policy_version 594744 (0.0009) [2023-12-26 04:20:06,407][123090] Updated weights for policy 1, policy_version 590629 (0.0007) [2023-12-26 04:20:06,452][123091] Updated weights for policy 0, policy_version 594754 (0.0009) [2023-12-26 04:20:06,471][123090] Updated weights for policy 1, policy_version 590639 (0.0006) [2023-12-26 04:20:06,518][123091] Updated weights for policy 0, policy_version 594764 (0.0006) [2023-12-26 04:20:06,538][123090] Updated weights for policy 1, policy_version 590649 (0.0007) [2023-12-26 04:20:07,288][123091] Updated weights for policy 0, policy_version 594774 (0.0009) [2023-12-26 04:20:07,357][123091] Updated weights for policy 0, policy_version 594784 (0.0009) [2023-12-26 04:20:07,385][123090] Updated weights for policy 1, policy_version 590659 (0.0010) [2023-12-26 04:20:07,423][123091] Updated weights for policy 0, policy_version 594794 (0.0007) [2023-12-26 04:20:07,434][123090] Updated weights for policy 1, policy_version 590669 (0.0011) [2023-12-26 04:20:07,486][123090] Updated weights for policy 1, policy_version 590679 (0.0010) [2023-12-26 04:20:08,258][123091] Updated weights for policy 0, policy_version 594804 (0.0007) [2023-12-26 04:20:08,305][123090] Updated weights for policy 1, policy_version 590689 (0.0010) [2023-12-26 04:20:08,307][123091] Updated weights for policy 0, policy_version 594814 (0.0009) [2023-12-26 04:20:08,369][123091] Updated weights for policy 0, policy_version 594824 (0.0008) [2023-12-26 04:20:08,377][123090] Updated weights for policy 1, policy_version 590699 (0.0010) [2023-12-26 04:20:08,449][123090] Updated weights for policy 1, policy_version 590709 (0.0010) [2023-12-26 04:20:08,520][123090] Updated weights for policy 1, policy_version 590719 (0.0011) [2023-12-26 04:20:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 303505408. Throughput: 0: 8909.9, 1: 8848.0. Samples: 303480584. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:08,785][121949] Avg episode reward: [(0, '6247.604'), (1, '5717.822')] [2023-12-26 04:20:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000594832_152281088.pth... [2023-12-26 04:20:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000590720_151224320.pth... [2023-12-26 04:20:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000593776_152010752.pth [2023-12-26 04:20:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000589696_150962176.pth [2023-12-26 04:20:09,198][123091] Updated weights for policy 0, policy_version 594834 (0.0008) [2023-12-26 04:20:09,270][123091] Updated weights for policy 0, policy_version 594844 (0.0008) [2023-12-26 04:20:09,335][123091] Updated weights for policy 0, policy_version 594854 (0.0009) [2023-12-26 04:20:09,343][123090] Updated weights for policy 1, policy_version 590729 (0.0011) [2023-12-26 04:20:09,403][123091] Updated weights for policy 0, policy_version 594864 (0.0009) [2023-12-26 04:20:09,423][123090] Updated weights for policy 1, policy_version 590739 (0.0008) [2023-12-26 04:20:09,487][123090] Updated weights for policy 1, policy_version 590749 (0.0007) [2023-12-26 04:20:10,229][123091] Updated weights for policy 0, policy_version 594874 (0.0008) [2023-12-26 04:20:10,285][123091] Updated weights for policy 0, policy_version 594884 (0.0008) [2023-12-26 04:20:10,300][123090] Updated weights for policy 1, policy_version 590759 (0.0011) [2023-12-26 04:20:10,354][123091] Updated weights for policy 0, policy_version 594894 (0.0006) [2023-12-26 04:20:10,363][123090] Updated weights for policy 1, policy_version 590769 (0.0011) [2023-12-26 04:20:10,419][123090] Updated weights for policy 1, policy_version 590779 (0.0010) [2023-12-26 04:20:11,123][123091] Updated weights for policy 0, policy_version 594904 (0.0007) [2023-12-26 04:20:11,200][123091] Updated weights for policy 0, policy_version 594914 (0.0008) [2023-12-26 04:20:11,243][123090] Updated weights for policy 1, policy_version 590789 (0.0009) [2023-12-26 04:20:11,267][123091] Updated weights for policy 0, policy_version 594924 (0.0008) [2023-12-26 04:20:11,311][123090] Updated weights for policy 1, policy_version 590799 (0.0008) [2023-12-26 04:20:11,391][123090] Updated weights for policy 1, policy_version 590809 (0.0009) [2023-12-26 04:20:12,051][123091] Updated weights for policy 0, policy_version 594934 (0.0009) [2023-12-26 04:20:12,118][123091] Updated weights for policy 0, policy_version 594944 (0.0011) [2023-12-26 04:20:12,182][123091] Updated weights for policy 0, policy_version 594954 (0.0011) [2023-12-26 04:20:12,243][123090] Updated weights for policy 1, policy_version 590819 (0.0009) [2023-12-26 04:20:12,309][123090] Updated weights for policy 1, policy_version 590829 (0.0009) [2023-12-26 04:20:12,385][123090] Updated weights for policy 1, policy_version 590839 (0.0010) [2023-12-26 04:20:12,946][123091] Updated weights for policy 0, policy_version 594964 (0.0010) [2023-12-26 04:20:12,997][123091] Updated weights for policy 0, policy_version 594974 (0.0009) [2023-12-26 04:20:13,052][123091] Updated weights for policy 0, policy_version 594984 (0.0009) [2023-12-26 04:20:13,198][123090] Updated weights for policy 1, policy_version 590849 (0.0010) [2023-12-26 04:20:13,270][123090] Updated weights for policy 1, policy_version 590859 (0.0009) [2023-12-26 04:20:13,332][123090] Updated weights for policy 1, policy_version 590869 (0.0009) [2023-12-26 04:20:13,397][123090] Updated weights for policy 1, policy_version 590879 (0.0009) [2023-12-26 04:20:13,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 303587328. Throughput: 0: 8876.8, 1: 8811.9. Samples: 303583168. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:13,785][121949] Avg episode reward: [(0, '6145.924'), (1, '5783.038')] [2023-12-26 04:20:13,817][123091] Updated weights for policy 0, policy_version 594994 (0.0009) [2023-12-26 04:20:13,872][123091] Updated weights for policy 0, policy_version 595004 (0.0010) [2023-12-26 04:20:13,922][123091] Updated weights for policy 0, policy_version 595014 (0.0010) [2023-12-26 04:20:13,983][123091] Updated weights for policy 0, policy_version 595024 (0.0006) [2023-12-26 04:20:14,182][123090] Updated weights for policy 1, policy_version 590889 (0.0010) [2023-12-26 04:20:14,228][123090] Updated weights for policy 1, policy_version 590899 (0.0006) [2023-12-26 04:20:14,287][123090] Updated weights for policy 1, policy_version 590909 (0.0005) [2023-12-26 04:20:14,703][123091] Updated weights for policy 0, policy_version 595034 (0.0010) [2023-12-26 04:20:14,755][123091] Updated weights for policy 0, policy_version 595044 (0.0010) [2023-12-26 04:20:14,817][123091] Updated weights for policy 0, policy_version 595054 (0.0011) [2023-12-26 04:20:15,093][123090] Updated weights for policy 1, policy_version 590919 (0.0008) [2023-12-26 04:20:15,154][123090] Updated weights for policy 1, policy_version 590929 (0.0009) [2023-12-26 04:20:15,219][123090] Updated weights for policy 1, policy_version 590939 (0.0009) [2023-12-26 04:20:15,691][123091] Updated weights for policy 0, policy_version 595064 (0.0009) [2023-12-26 04:20:15,754][123091] Updated weights for policy 0, policy_version 595074 (0.0005) [2023-12-26 04:20:15,810][123091] Updated weights for policy 0, policy_version 595084 (0.0005) [2023-12-26 04:20:16,092][123090] Updated weights for policy 1, policy_version 590949 (0.0009) [2023-12-26 04:20:16,148][123090] Updated weights for policy 1, policy_version 590959 (0.0009) [2023-12-26 04:20:16,212][123090] Updated weights for policy 1, policy_version 590969 (0.0009) [2023-12-26 04:20:16,558][123091] Updated weights for policy 0, policy_version 595094 (0.0007) [2023-12-26 04:20:16,624][123091] Updated weights for policy 0, policy_version 595104 (0.0007) [2023-12-26 04:20:16,694][123091] Updated weights for policy 0, policy_version 595114 (0.0005) [2023-12-26 04:20:16,875][123090] Updated weights for policy 1, policy_version 590979 (0.0006) [2023-12-26 04:20:16,944][123090] Updated weights for policy 1, policy_version 590989 (0.0006) [2023-12-26 04:20:17,000][123090] Updated weights for policy 1, policy_version 590999 (0.0006) [2023-12-26 04:20:17,331][123091] Updated weights for policy 0, policy_version 595124 (0.0006) [2023-12-26 04:20:17,400][123091] Updated weights for policy 0, policy_version 595134 (0.0005) [2023-12-26 04:20:17,454][123091] Updated weights for policy 0, policy_version 595144 (0.0005) [2023-12-26 04:20:17,753][123090] Updated weights for policy 1, policy_version 591009 (0.0006) [2023-12-26 04:20:17,808][123090] Updated weights for policy 1, policy_version 591019 (0.0010) [2023-12-26 04:20:17,862][123090] Updated weights for policy 1, policy_version 591029 (0.0010) [2023-12-26 04:20:17,916][123090] Updated weights for policy 1, policy_version 591039 (0.0010) [2023-12-26 04:20:17,981][123091] Updated weights for policy 0, policy_version 595154 (0.0005) [2023-12-26 04:20:18,028][123091] Updated weights for policy 0, policy_version 595164 (0.0005) [2023-12-26 04:20:18,074][123091] Updated weights for policy 0, policy_version 595174 (0.0005) [2023-12-26 04:20:18,121][123091] Updated weights for policy 0, policy_version 595184 (0.0005) [2023-12-26 04:20:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 303677440. Throughput: 0: 9045.7, 1: 8746.7. Samples: 303694376. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:18,785][121949] Avg episode reward: [(0, '6181.808'), (1, '5862.335')] [2023-12-26 04:20:18,811][123091] Updated weights for policy 0, policy_version 595194 (0.0006) [2023-12-26 04:20:18,865][123090] Updated weights for policy 1, policy_version 591049 (0.0007) [2023-12-26 04:20:18,880][123091] Updated weights for policy 0, policy_version 595204 (0.0008) [2023-12-26 04:20:18,934][123090] Updated weights for policy 1, policy_version 591059 (0.0008) [2023-12-26 04:20:18,946][123091] Updated weights for policy 0, policy_version 595214 (0.0006) [2023-12-26 04:20:18,995][123090] Updated weights for policy 1, policy_version 591069 (0.0006) [2023-12-26 04:20:19,663][123091] Updated weights for policy 0, policy_version 595224 (0.0010) [2023-12-26 04:20:19,731][123091] Updated weights for policy 0, policy_version 595234 (0.0011) [2023-12-26 04:20:19,803][123091] Updated weights for policy 0, policy_version 595244 (0.0011) [2023-12-26 04:20:19,832][123090] Updated weights for policy 1, policy_version 591079 (0.0006) [2023-12-26 04:20:19,910][123090] Updated weights for policy 1, policy_version 591089 (0.0009) [2023-12-26 04:20:19,976][123090] Updated weights for policy 1, policy_version 591099 (0.0009) [2023-12-26 04:20:20,644][123091] Updated weights for policy 0, policy_version 595254 (0.0011) [2023-12-26 04:20:20,708][123091] Updated weights for policy 0, policy_version 595264 (0.0011) [2023-12-26 04:20:20,768][123091] Updated weights for policy 0, policy_version 595274 (0.0010) [2023-12-26 04:20:20,779][123090] Updated weights for policy 1, policy_version 591109 (0.0007) [2023-12-26 04:20:20,847][123090] Updated weights for policy 1, policy_version 591119 (0.0007) [2023-12-26 04:20:20,915][123090] Updated weights for policy 1, policy_version 591129 (0.0010) [2023-12-26 04:20:21,588][123091] Updated weights for policy 0, policy_version 595284 (0.0010) [2023-12-26 04:20:21,662][123091] Updated weights for policy 0, policy_version 595294 (0.0009) [2023-12-26 04:20:21,730][123091] Updated weights for policy 0, policy_version 595304 (0.0010) [2023-12-26 04:20:21,779][123090] Updated weights for policy 1, policy_version 591139 (0.0009) [2023-12-26 04:20:21,832][123090] Updated weights for policy 1, policy_version 591149 (0.0009) [2023-12-26 04:20:21,894][123090] Updated weights for policy 1, policy_version 591159 (0.0009) [2023-12-26 04:20:22,554][123091] Updated weights for policy 0, policy_version 595314 (0.0009) [2023-12-26 04:20:22,612][123091] Updated weights for policy 0, policy_version 595324 (0.0009) [2023-12-26 04:20:22,663][123091] Updated weights for policy 0, policy_version 595334 (0.0010) [2023-12-26 04:20:22,717][123091] Updated weights for policy 0, policy_version 595344 (0.0010) [2023-12-26 04:20:22,750][123090] Updated weights for policy 1, policy_version 591169 (0.0008) [2023-12-26 04:20:22,812][123090] Updated weights for policy 1, policy_version 591179 (0.0006) [2023-12-26 04:20:22,885][123090] Updated weights for policy 1, policy_version 591189 (0.0006) [2023-12-26 04:20:22,959][123090] Updated weights for policy 1, policy_version 591199 (0.0010) [2023-12-26 04:20:23,565][123091] Updated weights for policy 0, policy_version 595354 (0.0008) [2023-12-26 04:20:23,629][123091] Updated weights for policy 0, policy_version 595364 (0.0009) [2023-12-26 04:20:23,699][123091] Updated weights for policy 0, policy_version 595374 (0.0010) [2023-12-26 04:20:23,773][123090] Updated weights for policy 1, policy_version 591209 (0.0009) [2023-12-26 04:20:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 303767552. Throughput: 0: 9030.7, 1: 8675.7. Samples: 303745596. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:23,786][121949] Avg episode reward: [(0, '6208.007'), (1, '5766.567')] [2023-12-26 04:20:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000595376_152420352.pth... [2023-12-26 04:20:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000594320_152150016.pth [2023-12-26 04:20:23,842][123090] Updated weights for policy 1, policy_version 591219 (0.0006) [2023-12-26 04:20:23,916][123090] Updated weights for policy 1, policy_version 591229 (0.0006) [2023-12-26 04:20:23,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000591232_151355392.pth... [2023-12-26 04:20:23,945][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000590176_151085056.pth [2023-12-26 04:20:24,546][123091] Updated weights for policy 0, policy_version 595385 (0.0009) [2023-12-26 04:20:24,599][123091] Updated weights for policy 0, policy_version 595395 (0.0009) [2023-12-26 04:20:24,651][123090] Updated weights for policy 1, policy_version 591239 (0.0005) [2023-12-26 04:20:24,654][123091] Updated weights for policy 0, policy_version 595405 (0.0009) [2023-12-26 04:20:24,703][123090] Updated weights for policy 1, policy_version 591249 (0.0005) [2023-12-26 04:20:24,753][123090] Updated weights for policy 1, policy_version 591259 (0.0007) [2023-12-26 04:20:25,494][123090] Updated weights for policy 1, policy_version 591269 (0.0008) [2023-12-26 04:20:25,513][123091] Updated weights for policy 0, policy_version 595415 (0.0010) [2023-12-26 04:20:25,547][123090] Updated weights for policy 1, policy_version 591279 (0.0007) [2023-12-26 04:20:25,569][123091] Updated weights for policy 0, policy_version 595425 (0.0006) [2023-12-26 04:20:25,598][123090] Updated weights for policy 1, policy_version 591289 (0.0009) [2023-12-26 04:20:25,635][123091] Updated weights for policy 0, policy_version 595435 (0.0005) [2023-12-26 04:20:26,402][123091] Updated weights for policy 0, policy_version 595445 (0.0008) [2023-12-26 04:20:26,412][123090] Updated weights for policy 1, policy_version 591299 (0.0009) [2023-12-26 04:20:26,446][123091] Updated weights for policy 0, policy_version 595455 (0.0007) [2023-12-26 04:20:26,488][123090] Updated weights for policy 1, policy_version 591309 (0.0009) [2023-12-26 04:20:26,500][123091] Updated weights for policy 0, policy_version 595465 (0.0007) [2023-12-26 04:20:26,551][123090] Updated weights for policy 1, policy_version 591319 (0.0010) [2023-12-26 04:20:27,253][123090] Updated weights for policy 1, policy_version 591329 (0.0010) [2023-12-26 04:20:27,254][123091] Updated weights for policy 0, policy_version 595475 (0.0010) [2023-12-26 04:20:27,306][123091] Updated weights for policy 0, policy_version 595485 (0.0010) [2023-12-26 04:20:27,315][123090] Updated weights for policy 1, policy_version 591339 (0.0010) [2023-12-26 04:20:27,352][123091] Updated weights for policy 0, policy_version 595495 (0.0007) [2023-12-26 04:20:27,374][123090] Updated weights for policy 1, policy_version 591349 (0.0010) [2023-12-26 04:20:27,425][123090] Updated weights for policy 1, policy_version 591359 (0.0010) [2023-12-26 04:20:28,162][123091] Updated weights for policy 0, policy_version 595505 (0.0008) [2023-12-26 04:20:28,224][123091] Updated weights for policy 0, policy_version 595515 (0.0007) [2023-12-26 04:20:28,229][123090] Updated weights for policy 1, policy_version 591369 (0.0010) [2023-12-26 04:20:28,280][123090] Updated weights for policy 1, policy_version 591379 (0.0010) [2023-12-26 04:20:28,287][123091] Updated weights for policy 0, policy_version 595525 (0.0005) [2023-12-26 04:20:28,328][123090] Updated weights for policy 1, policy_version 591389 (0.0010) [2023-12-26 04:20:28,355][123091] Updated weights for policy 0, policy_version 595535 (0.0008) [2023-12-26 04:20:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 303857664. Throughput: 0: 9068.3, 1: 8734.1. Samples: 303851964. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:28,785][121949] Avg episode reward: [(0, '6164.105'), (1, '5302.078')] [2023-12-26 04:20:28,976][123091] Updated weights for policy 0, policy_version 595545 (0.0006) [2023-12-26 04:20:29,035][123091] Updated weights for policy 0, policy_version 595555 (0.0006) [2023-12-26 04:20:29,091][123091] Updated weights for policy 0, policy_version 595565 (0.0006) [2023-12-26 04:20:29,163][123090] Updated weights for policy 1, policy_version 591399 (0.0010) [2023-12-26 04:20:29,232][123090] Updated weights for policy 1, policy_version 591409 (0.0011) [2023-12-26 04:20:29,303][123090] Updated weights for policy 1, policy_version 591419 (0.0006) [2023-12-26 04:20:29,890][123091] Updated weights for policy 0, policy_version 595575 (0.0008) [2023-12-26 04:20:29,960][123091] Updated weights for policy 0, policy_version 595585 (0.0008) [2023-12-26 04:20:30,030][123091] Updated weights for policy 0, policy_version 595595 (0.0007) [2023-12-26 04:20:30,117][123090] Updated weights for policy 1, policy_version 591429 (0.0007) [2023-12-26 04:20:30,175][123090] Updated weights for policy 1, policy_version 591439 (0.0006) [2023-12-26 04:20:30,243][123090] Updated weights for policy 1, policy_version 591449 (0.0006) [2023-12-26 04:20:30,732][123091] Updated weights for policy 0, policy_version 595605 (0.0006) [2023-12-26 04:20:30,803][123091] Updated weights for policy 0, policy_version 595615 (0.0007) [2023-12-26 04:20:30,856][123091] Updated weights for policy 0, policy_version 595625 (0.0009) [2023-12-26 04:20:30,973][123090] Updated weights for policy 1, policy_version 591459 (0.0007) [2023-12-26 04:20:31,048][123090] Updated weights for policy 1, policy_version 591469 (0.0009) [2023-12-26 04:20:31,104][123090] Updated weights for policy 1, policy_version 591479 (0.0009) [2023-12-26 04:20:31,638][123091] Updated weights for policy 0, policy_version 595635 (0.0009) [2023-12-26 04:20:31,701][123091] Updated weights for policy 0, policy_version 595645 (0.0010) [2023-12-26 04:20:31,770][123091] Updated weights for policy 0, policy_version 595655 (0.0009) [2023-12-26 04:20:31,925][123090] Updated weights for policy 1, policy_version 591489 (0.0009) [2023-12-26 04:20:31,981][123090] Updated weights for policy 1, policy_version 591499 (0.0005) [2023-12-26 04:20:32,040][123090] Updated weights for policy 1, policy_version 591509 (0.0006) [2023-12-26 04:20:32,087][123090] Updated weights for policy 1, policy_version 591519 (0.0006) [2023-12-26 04:20:32,588][123091] Updated weights for policy 0, policy_version 595665 (0.0010) [2023-12-26 04:20:32,640][123091] Updated weights for policy 0, policy_version 595675 (0.0009) [2023-12-26 04:20:32,694][123091] Updated weights for policy 0, policy_version 595685 (0.0009) [2023-12-26 04:20:32,751][123091] Updated weights for policy 0, policy_version 595695 (0.0009) [2023-12-26 04:20:32,891][123090] Updated weights for policy 1, policy_version 591529 (0.0009) [2023-12-26 04:20:32,955][123090] Updated weights for policy 1, policy_version 591539 (0.0008) [2023-12-26 04:20:33,015][123090] Updated weights for policy 1, policy_version 591549 (0.0009) [2023-12-26 04:20:33,639][123091] Updated weights for policy 0, policy_version 595705 (0.0009) [2023-12-26 04:20:33,696][123091] Updated weights for policy 0, policy_version 595715 (0.0009) [2023-12-26 04:20:33,745][123091] Updated weights for policy 0, policy_version 595725 (0.0010) [2023-12-26 04:20:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 303947776. Throughput: 0: 9011.9, 1: 8813.2. Samples: 303958828. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:33,784][121949] Avg episode reward: [(0, '6097.272'), (1, '4773.576')] [2023-12-26 04:20:33,787][123090] Updated weights for policy 1, policy_version 591559 (0.0007) [2023-12-26 04:20:33,839][123090] Updated weights for policy 1, policy_version 591569 (0.0005) [2023-12-26 04:20:33,897][123090] Updated weights for policy 1, policy_version 591579 (0.0005) [2023-12-26 04:20:34,581][123090] Updated weights for policy 1, policy_version 591589 (0.0006) [2023-12-26 04:20:34,631][123091] Updated weights for policy 0, policy_version 595735 (0.0007) [2023-12-26 04:20:34,655][123090] Updated weights for policy 1, policy_version 591599 (0.0006) [2023-12-26 04:20:34,688][123091] Updated weights for policy 0, policy_version 595745 (0.0007) [2023-12-26 04:20:34,715][123090] Updated weights for policy 1, policy_version 591609 (0.0010) [2023-12-26 04:20:34,738][123091] Updated weights for policy 0, policy_version 595755 (0.0007) [2023-12-26 04:20:35,475][123090] Updated weights for policy 1, policy_version 591619 (0.0010) [2023-12-26 04:20:35,526][123090] Updated weights for policy 1, policy_version 591629 (0.0010) [2023-12-26 04:20:35,578][123090] Updated weights for policy 1, policy_version 591639 (0.0010) [2023-12-26 04:20:35,585][123091] Updated weights for policy 0, policy_version 595765 (0.0006) [2023-12-26 04:20:35,637][123091] Updated weights for policy 0, policy_version 595775 (0.0006) [2023-12-26 04:20:35,713][123091] Updated weights for policy 0, policy_version 595785 (0.0006) [2023-12-26 04:20:36,333][123090] Updated weights for policy 1, policy_version 591649 (0.0010) [2023-12-26 04:20:36,379][123091] Updated weights for policy 0, policy_version 595795 (0.0006) [2023-12-26 04:20:36,397][123090] Updated weights for policy 1, policy_version 591659 (0.0010) [2023-12-26 04:20:36,436][123091] Updated weights for policy 0, policy_version 595805 (0.0006) [2023-12-26 04:20:36,465][123090] Updated weights for policy 1, policy_version 591669 (0.0011) [2023-12-26 04:20:36,502][123091] Updated weights for policy 0, policy_version 595815 (0.0007) [2023-12-26 04:20:36,529][123090] Updated weights for policy 1, policy_version 591679 (0.0008) [2023-12-26 04:20:37,218][123091] Updated weights for policy 0, policy_version 595825 (0.0006) [2023-12-26 04:20:37,277][123091] Updated weights for policy 0, policy_version 595835 (0.0008) [2023-12-26 04:20:37,341][123091] Updated weights for policy 0, policy_version 595845 (0.0009) [2023-12-26 04:20:37,386][123090] Updated weights for policy 1, policy_version 591689 (0.0009) [2023-12-26 04:20:37,406][123091] Updated weights for policy 0, policy_version 595855 (0.0007) [2023-12-26 04:20:37,439][123090] Updated weights for policy 1, policy_version 591699 (0.0010) [2023-12-26 04:20:37,501][123090] Updated weights for policy 1, policy_version 591709 (0.0008) [2023-12-26 04:20:38,095][123091] Updated weights for policy 0, policy_version 595865 (0.0007) [2023-12-26 04:20:38,144][123091] Updated weights for policy 0, policy_version 595875 (0.0006) [2023-12-26 04:20:38,187][123090] Updated weights for policy 1, policy_version 591719 (0.0006) [2023-12-26 04:20:38,201][123091] Updated weights for policy 0, policy_version 595885 (0.0005) [2023-12-26 04:20:38,248][123090] Updated weights for policy 1, policy_version 591729 (0.0005) [2023-12-26 04:20:38,311][123090] Updated weights for policy 1, policy_version 591739 (0.0006) [2023-12-26 04:20:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 304037888. Throughput: 0: 8987.6, 1: 8892.6. Samples: 304013712. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:38,784][121949] Avg episode reward: [(0, '6172.607'), (1, '4418.784')] [2023-12-26 04:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000595888_152551424.pth... [2023-12-26 04:20:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000591744_151486464.pth... [2023-12-26 04:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000594832_152281088.pth [2023-12-26 04:20:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000590720_151224320.pth [2023-12-26 04:20:39,031][123091] Updated weights for policy 0, policy_version 595895 (0.0009) [2023-12-26 04:20:39,062][123090] Updated weights for policy 1, policy_version 591749 (0.0008) [2023-12-26 04:20:39,099][123091] Updated weights for policy 0, policy_version 595905 (0.0006) [2023-12-26 04:20:39,121][123090] Updated weights for policy 1, policy_version 591759 (0.0006) [2023-12-26 04:20:39,166][123091] Updated weights for policy 0, policy_version 595915 (0.0005) [2023-12-26 04:20:39,185][123090] Updated weights for policy 1, policy_version 591769 (0.0005) [2023-12-26 04:20:39,817][123091] Updated weights for policy 0, policy_version 595925 (0.0006) [2023-12-26 04:20:39,888][123091] Updated weights for policy 0, policy_version 595935 (0.0010) [2023-12-26 04:20:39,959][123091] Updated weights for policy 0, policy_version 595945 (0.0010) [2023-12-26 04:20:40,000][123090] Updated weights for policy 1, policy_version 591779 (0.0008) [2023-12-26 04:20:40,076][123090] Updated weights for policy 1, policy_version 591789 (0.0011) [2023-12-26 04:20:40,149][123090] Updated weights for policy 1, policy_version 591799 (0.0011) [2023-12-26 04:20:40,734][123091] Updated weights for policy 0, policy_version 595955 (0.0008) [2023-12-26 04:20:40,799][123091] Updated weights for policy 0, policy_version 595965 (0.0005) [2023-12-26 04:20:40,869][123091] Updated weights for policy 0, policy_version 595975 (0.0005) [2023-12-26 04:20:40,958][123090] Updated weights for policy 1, policy_version 591809 (0.0011) [2023-12-26 04:20:41,021][123090] Updated weights for policy 1, policy_version 591819 (0.0009) [2023-12-26 04:20:41,094][123090] Updated weights for policy 1, policy_version 591829 (0.0010) [2023-12-26 04:20:41,158][123090] Updated weights for policy 1, policy_version 591839 (0.0010) [2023-12-26 04:20:41,670][123091] Updated weights for policy 0, policy_version 595985 (0.0006) [2023-12-26 04:20:41,745][123091] Updated weights for policy 0, policy_version 595995 (0.0009) [2023-12-26 04:20:41,803][123091] Updated weights for policy 0, policy_version 596005 (0.0006) [2023-12-26 04:20:41,855][123091] Updated weights for policy 0, policy_version 596015 (0.0005) [2023-12-26 04:20:42,092][123090] Updated weights for policy 1, policy_version 591849 (0.0008) [2023-12-26 04:20:42,155][123090] Updated weights for policy 1, policy_version 591859 (0.0006) [2023-12-26 04:20:42,233][123090] Updated weights for policy 1, policy_version 591869 (0.0005) [2023-12-26 04:20:42,650][123091] Updated weights for policy 0, policy_version 596025 (0.0008) [2023-12-26 04:20:42,717][123091] Updated weights for policy 0, policy_version 596035 (0.0008) [2023-12-26 04:20:42,786][123091] Updated weights for policy 0, policy_version 596045 (0.0007) [2023-12-26 04:20:43,080][123090] Updated weights for policy 1, policy_version 591879 (0.0010) [2023-12-26 04:20:43,133][123090] Updated weights for policy 1, policy_version 591889 (0.0009) [2023-12-26 04:20:43,198][123090] Updated weights for policy 1, policy_version 591899 (0.0009) [2023-12-26 04:20:43,531][123091] Updated weights for policy 0, policy_version 596055 (0.0005) [2023-12-26 04:20:43,590][123091] Updated weights for policy 0, policy_version 596065 (0.0005) [2023-12-26 04:20:43,636][123091] Updated weights for policy 0, policy_version 596075 (0.0005) [2023-12-26 04:20:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 304128000. Throughput: 0: 8988.9, 1: 8776.5. Samples: 304120412. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:43,785][121949] Avg episode reward: [(0, '6232.626'), (1, '4372.237')] [2023-12-26 04:20:43,931][123090] Updated weights for policy 1, policy_version 591909 (0.0007) [2023-12-26 04:20:43,999][123090] Updated weights for policy 1, policy_version 591919 (0.0005) [2023-12-26 04:20:44,061][123090] Updated weights for policy 1, policy_version 591929 (0.0005) [2023-12-26 04:20:44,256][123091] Updated weights for policy 0, policy_version 596085 (0.0005) [2023-12-26 04:20:44,309][123091] Updated weights for policy 0, policy_version 596095 (0.0005) [2023-12-26 04:20:44,364][123091] Updated weights for policy 0, policy_version 596105 (0.0005) [2023-12-26 04:20:44,799][123090] Updated weights for policy 1, policy_version 591939 (0.0006) [2023-12-26 04:20:44,867][123090] Updated weights for policy 1, policy_version 591949 (0.0007) [2023-12-26 04:20:44,940][123090] Updated weights for policy 1, policy_version 591959 (0.0007) [2023-12-26 04:20:45,092][123091] Updated weights for policy 0, policy_version 596115 (0.0006) [2023-12-26 04:20:45,157][123091] Updated weights for policy 0, policy_version 596125 (0.0009) [2023-12-26 04:20:45,207][123091] Updated weights for policy 0, policy_version 596135 (0.0009) [2023-12-26 04:20:45,661][123090] Updated weights for policy 1, policy_version 591969 (0.0008) [2023-12-26 04:20:45,722][123090] Updated weights for policy 1, policy_version 591979 (0.0008) [2023-12-26 04:20:45,789][123090] Updated weights for policy 1, policy_version 591989 (0.0009) [2023-12-26 04:20:45,844][123090] Updated weights for policy 1, policy_version 591999 (0.0009) [2023-12-26 04:20:46,016][123091] Updated weights for policy 0, policy_version 596145 (0.0010) [2023-12-26 04:20:46,076][123091] Updated weights for policy 0, policy_version 596155 (0.0005) [2023-12-26 04:20:46,141][123091] Updated weights for policy 0, policy_version 596165 (0.0005) [2023-12-26 04:20:46,191][123091] Updated weights for policy 0, policy_version 596175 (0.0005) [2023-12-26 04:20:46,730][123090] Updated weights for policy 1, policy_version 592009 (0.0010) [2023-12-26 04:20:46,786][123090] Updated weights for policy 1, policy_version 592019 (0.0010) [2023-12-26 04:20:46,839][123090] Updated weights for policy 1, policy_version 592029 (0.0010) [2023-12-26 04:20:46,907][123091] Updated weights for policy 0, policy_version 596185 (0.0006) [2023-12-26 04:20:46,971][123091] Updated weights for policy 0, policy_version 596195 (0.0005) [2023-12-26 04:20:47,036][123091] Updated weights for policy 0, policy_version 596205 (0.0006) [2023-12-26 04:20:47,585][123090] Updated weights for policy 1, policy_version 592039 (0.0009) [2023-12-26 04:20:47,641][123090] Updated weights for policy 1, policy_version 592049 (0.0009) [2023-12-26 04:20:47,704][123090] Updated weights for policy 1, policy_version 592059 (0.0010) [2023-12-26 04:20:47,837][123091] Updated weights for policy 0, policy_version 596215 (0.0006) [2023-12-26 04:20:47,890][123091] Updated weights for policy 0, policy_version 596225 (0.0007) [2023-12-26 04:20:47,939][123091] Updated weights for policy 0, policy_version 596235 (0.0009) [2023-12-26 04:20:48,630][123090] Updated weights for policy 1, policy_version 592069 (0.0009) [2023-12-26 04:20:48,674][123091] Updated weights for policy 0, policy_version 596245 (0.0007) [2023-12-26 04:20:48,684][123090] Updated weights for policy 1, policy_version 592079 (0.0009) [2023-12-26 04:20:48,728][123091] Updated weights for policy 0, policy_version 596255 (0.0008) [2023-12-26 04:20:48,741][123090] Updated weights for policy 1, policy_version 592089 (0.0007) [2023-12-26 04:20:48,784][123091] Updated weights for policy 0, policy_version 596265 (0.0009) [2023-12-26 04:20:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 304218112. Throughput: 0: 9086.5, 1: 8736.4. Samples: 304229712. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 04:20:48,785][121949] Avg episode reward: [(0, '6093.359'), (1, '4983.120')] [2023-12-26 04:20:49,594][123090] Updated weights for policy 1, policy_version 592099 (0.0008) [2023-12-26 04:20:49,632][123091] Updated weights for policy 0, policy_version 596275 (0.0008) [2023-12-26 04:20:49,659][123090] Updated weights for policy 1, policy_version 592109 (0.0010) [2023-12-26 04:20:49,696][123091] Updated weights for policy 0, policy_version 596285 (0.0007) [2023-12-26 04:20:49,730][123090] Updated weights for policy 1, policy_version 592119 (0.0007) [2023-12-26 04:20:49,753][123091] Updated weights for policy 0, policy_version 596295 (0.0009) [2023-12-26 04:20:50,475][123090] Updated weights for policy 1, policy_version 592129 (0.0009) [2023-12-26 04:20:50,481][123091] Updated weights for policy 0, policy_version 596305 (0.0010) [2023-12-26 04:20:50,535][123090] Updated weights for policy 1, policy_version 592139 (0.0008) [2023-12-26 04:20:50,539][123091] Updated weights for policy 0, policy_version 596315 (0.0005) [2023-12-26 04:20:50,602][123090] Updated weights for policy 1, policy_version 592149 (0.0006) [2023-12-26 04:20:50,609][123091] Updated weights for policy 0, policy_version 596325 (0.0008) [2023-12-26 04:20:50,658][123090] Updated weights for policy 1, policy_version 592159 (0.0008) [2023-12-26 04:20:50,673][123091] Updated weights for policy 0, policy_version 596335 (0.0006) [2023-12-26 04:20:51,483][123090] Updated weights for policy 1, policy_version 592169 (0.0007) [2023-12-26 04:20:51,510][123091] Updated weights for policy 0, policy_version 596345 (0.0010) [2023-12-26 04:20:51,551][123090] Updated weights for policy 1, policy_version 592179 (0.0008) [2023-12-26 04:20:51,578][123091] Updated weights for policy 0, policy_version 596355 (0.0009) [2023-12-26 04:20:51,621][123090] Updated weights for policy 1, policy_version 592189 (0.0008) [2023-12-26 04:20:51,642][123091] Updated weights for policy 0, policy_version 596365 (0.0008) [2023-12-26 04:20:52,430][123090] Updated weights for policy 1, policy_version 592199 (0.0008) [2023-12-26 04:20:52,472][123091] Updated weights for policy 0, policy_version 596375 (0.0008) [2023-12-26 04:20:52,486][123090] Updated weights for policy 1, policy_version 592209 (0.0008) [2023-12-26 04:20:52,528][123091] Updated weights for policy 0, policy_version 596385 (0.0009) [2023-12-26 04:20:52,548][123090] Updated weights for policy 1, policy_version 592219 (0.0008) [2023-12-26 04:20:52,589][123091] Updated weights for policy 0, policy_version 596395 (0.0008) [2023-12-26 04:20:53,329][123090] Updated weights for policy 1, policy_version 592229 (0.0008) [2023-12-26 04:20:53,344][123091] Updated weights for policy 0, policy_version 596405 (0.0008) [2023-12-26 04:20:53,393][123090] Updated weights for policy 1, policy_version 592239 (0.0009) [2023-12-26 04:20:53,404][123091] Updated weights for policy 0, policy_version 596415 (0.0005) [2023-12-26 04:20:53,451][123090] Updated weights for policy 1, policy_version 592249 (0.0008) [2023-12-26 04:20:53,470][123091] Updated weights for policy 0, policy_version 596425 (0.0005) [2023-12-26 04:20:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 304308224. Throughput: 0: 9080.8, 1: 8730.2. Samples: 304282080. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:20:53,785][121949] Avg episode reward: [(0, '5966.725'), (1, '5533.312')] [2023-12-26 04:20:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000596432_152690688.pth... [2023-12-26 04:20:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000592256_151617536.pth... [2023-12-26 04:20:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000595376_152420352.pth [2023-12-26 04:20:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000591232_151355392.pth [2023-12-26 04:20:54,165][123091] Updated weights for policy 0, policy_version 596435 (0.0007) [2023-12-26 04:20:54,216][123090] Updated weights for policy 1, policy_version 592259 (0.0008) [2023-12-26 04:20:54,228][123091] Updated weights for policy 0, policy_version 596445 (0.0009) [2023-12-26 04:20:54,277][123090] Updated weights for policy 1, policy_version 592269 (0.0005) [2023-12-26 04:20:54,299][123091] Updated weights for policy 0, policy_version 596455 (0.0009) [2023-12-26 04:20:54,339][123090] Updated weights for policy 1, policy_version 592279 (0.0006) [2023-12-26 04:20:54,987][123091] Updated weights for policy 0, policy_version 596465 (0.0007) [2023-12-26 04:20:55,057][123091] Updated weights for policy 0, policy_version 596475 (0.0005) [2023-12-26 04:20:55,120][123091] Updated weights for policy 0, policy_version 596485 (0.0006) [2023-12-26 04:20:55,135][123090] Updated weights for policy 1, policy_version 592289 (0.0008) [2023-12-26 04:20:55,172][123091] Updated weights for policy 0, policy_version 596495 (0.0005) [2023-12-26 04:20:55,190][123090] Updated weights for policy 1, policy_version 592299 (0.0005) [2023-12-26 04:20:55,238][123090] Updated weights for policy 1, policy_version 592309 (0.0005) [2023-12-26 04:20:55,292][123090] Updated weights for policy 1, policy_version 592319 (0.0005) [2023-12-26 04:20:55,850][123091] Updated weights for policy 0, policy_version 596505 (0.0005) [2023-12-26 04:20:55,909][123091] Updated weights for policy 0, policy_version 596515 (0.0005) [2023-12-26 04:20:55,965][123090] Updated weights for policy 1, policy_version 592329 (0.0005) [2023-12-26 04:20:55,970][123091] Updated weights for policy 0, policy_version 596525 (0.0005) [2023-12-26 04:20:56,014][123090] Updated weights for policy 1, policy_version 592339 (0.0005) [2023-12-26 04:20:56,064][123090] Updated weights for policy 1, policy_version 592349 (0.0007) [2023-12-26 04:20:56,725][123091] Updated weights for policy 0, policy_version 596535 (0.0008) [2023-12-26 04:20:56,776][123091] Updated weights for policy 0, policy_version 596545 (0.0009) [2023-12-26 04:20:56,802][123090] Updated weights for policy 1, policy_version 592359 (0.0008) [2023-12-26 04:20:56,822][123091] Updated weights for policy 0, policy_version 596555 (0.0006) [2023-12-26 04:20:56,859][123090] Updated weights for policy 1, policy_version 592369 (0.0008) [2023-12-26 04:20:56,920][123090] Updated weights for policy 1, policy_version 592379 (0.0010) [2023-12-26 04:20:57,631][123091] Updated weights for policy 0, policy_version 596565 (0.0005) [2023-12-26 04:20:57,678][123091] Updated weights for policy 0, policy_version 596575 (0.0006) [2023-12-26 04:20:57,696][123090] Updated weights for policy 1, policy_version 592389 (0.0007) [2023-12-26 04:20:57,744][123091] Updated weights for policy 0, policy_version 596585 (0.0005) [2023-12-26 04:20:57,767][123090] Updated weights for policy 1, policy_version 592399 (0.0005) [2023-12-26 04:20:57,832][123090] Updated weights for policy 1, policy_version 592409 (0.0005) [2023-12-26 04:20:58,532][123091] Updated weights for policy 0, policy_version 596595 (0.0007) [2023-12-26 04:20:58,598][123091] Updated weights for policy 0, policy_version 596605 (0.0008) [2023-12-26 04:20:58,669][123091] Updated weights for policy 0, policy_version 596615 (0.0008) [2023-12-26 04:20:58,670][123090] Updated weights for policy 1, policy_version 592419 (0.0007) [2023-12-26 04:20:58,747][123090] Updated weights for policy 1, policy_version 592429 (0.0008) [2023-12-26 04:20:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 304398336. Throughput: 0: 9165.9, 1: 8845.5. Samples: 304393676. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:20:58,784][121949] Avg episode reward: [(0, '5957.261'), (1, '5491.298')] [2023-12-26 04:20:58,804][123090] Updated weights for policy 1, policy_version 592440 (0.0008) [2023-12-26 04:20:59,488][123091] Updated weights for policy 0, policy_version 596625 (0.0009) [2023-12-26 04:20:59,546][123091] Updated weights for policy 0, policy_version 596635 (0.0009) [2023-12-26 04:20:59,601][123091] Updated weights for policy 0, policy_version 596645 (0.0009) [2023-12-26 04:20:59,654][123091] Updated weights for policy 0, policy_version 596655 (0.0009) [2023-12-26 04:20:59,672][123090] Updated weights for policy 1, policy_version 592450 (0.0009) [2023-12-26 04:20:59,733][123090] Updated weights for policy 1, policy_version 592460 (0.0009) [2023-12-26 04:20:59,801][123090] Updated weights for policy 1, policy_version 592470 (0.0009) [2023-12-26 04:20:59,868][123090] Updated weights for policy 1, policy_version 592480 (0.0010) [2023-12-26 04:21:00,426][123091] Updated weights for policy 0, policy_version 596665 (0.0010) [2023-12-26 04:21:00,473][123091] Updated weights for policy 0, policy_version 596675 (0.0010) [2023-12-26 04:21:00,528][123091] Updated weights for policy 0, policy_version 596685 (0.0010) [2023-12-26 04:21:00,700][123090] Updated weights for policy 1, policy_version 592490 (0.0009) [2023-12-26 04:21:00,766][123090] Updated weights for policy 1, policy_version 592500 (0.0009) [2023-12-26 04:21:00,826][123090] Updated weights for policy 1, policy_version 592510 (0.0009) [2023-12-26 04:21:01,389][123091] Updated weights for policy 0, policy_version 596695 (0.0010) [2023-12-26 04:21:01,451][123091] Updated weights for policy 0, policy_version 596705 (0.0010) [2023-12-26 04:21:01,530][123091] Updated weights for policy 0, policy_version 596715 (0.0005) [2023-12-26 04:21:01,651][123090] Updated weights for policy 1, policy_version 592520 (0.0009) [2023-12-26 04:21:01,705][123090] Updated weights for policy 1, policy_version 592530 (0.0010) [2023-12-26 04:21:01,775][123090] Updated weights for policy 1, policy_version 592540 (0.0009) [2023-12-26 04:21:02,314][123091] Updated weights for policy 0, policy_version 596725 (0.0008) [2023-12-26 04:21:02,375][123091] Updated weights for policy 0, policy_version 596735 (0.0009) [2023-12-26 04:21:02,434][123091] Updated weights for policy 0, policy_version 596745 (0.0008) [2023-12-26 04:21:02,613][123090] Updated weights for policy 1, policy_version 592550 (0.0009) [2023-12-26 04:21:02,679][123090] Updated weights for policy 1, policy_version 592560 (0.0010) [2023-12-26 04:21:02,739][123090] Updated weights for policy 1, policy_version 592570 (0.0009) [2023-12-26 04:21:03,065][123091] Updated weights for policy 0, policy_version 596755 (0.0007) [2023-12-26 04:21:03,129][123091] Updated weights for policy 0, policy_version 596765 (0.0009) [2023-12-26 04:21:03,188][123091] Updated weights for policy 0, policy_version 596775 (0.0009) [2023-12-26 04:21:03,554][123090] Updated weights for policy 1, policy_version 592580 (0.0009) [2023-12-26 04:21:03,608][123090] Updated weights for policy 1, policy_version 592590 (0.0009) [2023-12-26 04:21:03,663][123090] Updated weights for policy 1, policy_version 592600 (0.0008) [2023-12-26 04:21:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 304488448. Throughput: 0: 9048.9, 1: 8795.3. Samples: 304497364. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:03,785][121949] Avg episode reward: [(0, '6107.248'), (1, '5184.183')] [2023-12-26 04:21:04,031][123091] Updated weights for policy 0, policy_version 596785 (0.0009) [2023-12-26 04:21:04,100][123091] Updated weights for policy 0, policy_version 596795 (0.0010) [2023-12-26 04:21:04,167][123091] Updated weights for policy 0, policy_version 596805 (0.0008) [2023-12-26 04:21:04,235][123091] Updated weights for policy 0, policy_version 596815 (0.0009) [2023-12-26 04:21:04,532][123090] Updated weights for policy 1, policy_version 592610 (0.0008) [2023-12-26 04:21:04,592][123090] Updated weights for policy 1, policy_version 592620 (0.0010) [2023-12-26 04:21:04,659][123090] Updated weights for policy 1, policy_version 592630 (0.0010) [2023-12-26 04:21:04,718][123090] Updated weights for policy 1, policy_version 592640 (0.0009) [2023-12-26 04:21:05,049][123091] Updated weights for policy 0, policy_version 596825 (0.0010) [2023-12-26 04:21:05,106][123091] Updated weights for policy 0, policy_version 596837 (0.0009) [2023-12-26 04:21:05,169][123091] Updated weights for policy 0, policy_version 596847 (0.0010) [2023-12-26 04:21:05,541][123090] Updated weights for policy 1, policy_version 592650 (0.0008) [2023-12-26 04:21:05,594][123090] Updated weights for policy 1, policy_version 592660 (0.0010) [2023-12-26 04:21:05,648][123090] Updated weights for policy 1, policy_version 592670 (0.0009) [2023-12-26 04:21:05,998][123091] Updated weights for policy 0, policy_version 596857 (0.0011) [2023-12-26 04:21:06,069][123091] Updated weights for policy 0, policy_version 596867 (0.0011) [2023-12-26 04:21:06,143][123091] Updated weights for policy 0, policy_version 596877 (0.0011) [2023-12-26 04:21:06,523][123090] Updated weights for policy 1, policy_version 592680 (0.0009) [2023-12-26 04:21:06,596][123090] Updated weights for policy 1, policy_version 592690 (0.0008) [2023-12-26 04:21:06,649][123090] Updated weights for policy 1, policy_version 592700 (0.0009) [2023-12-26 04:21:06,950][123091] Updated weights for policy 0, policy_version 596887 (0.0011) [2023-12-26 04:21:07,016][123091] Updated weights for policy 0, policy_version 596897 (0.0011) [2023-12-26 04:21:07,068][123091] Updated weights for policy 0, policy_version 596907 (0.0011) [2023-12-26 04:21:07,465][123090] Updated weights for policy 1, policy_version 592710 (0.0009) [2023-12-26 04:21:07,514][123090] Updated weights for policy 1, policy_version 592720 (0.0009) [2023-12-26 04:21:07,567][123090] Updated weights for policy 1, policy_version 592730 (0.0009) [2023-12-26 04:21:07,887][123091] Updated weights for policy 0, policy_version 596917 (0.0008) [2023-12-26 04:21:07,932][123091] Updated weights for policy 0, policy_version 596927 (0.0005) [2023-12-26 04:21:07,989][123091] Updated weights for policy 0, policy_version 596937 (0.0008) [2023-12-26 04:21:08,357][123090] Updated weights for policy 1, policy_version 592740 (0.0009) [2023-12-26 04:21:08,419][123090] Updated weights for policy 1, policy_version 592750 (0.0008) [2023-12-26 04:21:08,494][123090] Updated weights for policy 1, policy_version 592760 (0.0007) [2023-12-26 04:21:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 304570368. Throughput: 0: 9036.8, 1: 8796.9. Samples: 304548112. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:08,785][121949] Avg episode reward: [(0, '6133.761'), (1, '5117.794')] [2023-12-26 04:21:08,789][123091] Updated weights for policy 0, policy_version 596947 (0.0011) [2023-12-26 04:21:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000592768_151748608.pth... [2023-12-26 04:21:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000591744_151486464.pth [2023-12-26 04:21:08,844][123091] Updated weights for policy 0, policy_version 596957 (0.0011) [2023-12-26 04:21:08,905][123091] Updated weights for policy 0, policy_version 596967 (0.0009) [2023-12-26 04:21:08,970][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000596976_152829952.pth... [2023-12-26 04:21:08,975][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000595888_152551424.pth [2023-12-26 04:21:09,337][123090] Updated weights for policy 1, policy_version 592770 (0.0006) [2023-12-26 04:21:09,424][123090] Updated weights for policy 1, policy_version 592780 (0.0008) [2023-12-26 04:21:09,490][123090] Updated weights for policy 1, policy_version 592790 (0.0010) [2023-12-26 04:21:09,556][123090] Updated weights for policy 1, policy_version 592800 (0.0010) [2023-12-26 04:21:09,683][123091] Updated weights for policy 0, policy_version 596977 (0.0008) [2023-12-26 04:21:09,748][123091] Updated weights for policy 0, policy_version 596987 (0.0011) [2023-12-26 04:21:09,810][123091] Updated weights for policy 0, policy_version 596997 (0.0010) [2023-12-26 04:21:09,881][123091] Updated weights for policy 0, policy_version 597007 (0.0010) [2023-12-26 04:21:10,398][123090] Updated weights for policy 1, policy_version 592810 (0.0006) [2023-12-26 04:21:10,455][123090] Updated weights for policy 1, policy_version 592820 (0.0005) [2023-12-26 04:21:10,518][123090] Updated weights for policy 1, policy_version 592830 (0.0008) [2023-12-26 04:21:10,741][123091] Updated weights for policy 0, policy_version 597017 (0.0010) [2023-12-26 04:21:10,792][123091] Updated weights for policy 0, policy_version 597027 (0.0008) [2023-12-26 04:21:10,864][123091] Updated weights for policy 0, policy_version 597037 (0.0005) [2023-12-26 04:21:11,232][123090] Updated weights for policy 1, policy_version 592840 (0.0009) [2023-12-26 04:21:11,302][123090] Updated weights for policy 1, policy_version 592850 (0.0008) [2023-12-26 04:21:11,366][123090] Updated weights for policy 1, policy_version 592860 (0.0008) [2023-12-26 04:21:11,699][123091] Updated weights for policy 0, policy_version 597047 (0.0008) [2023-12-26 04:21:11,772][123091] Updated weights for policy 0, policy_version 597057 (0.0008) [2023-12-26 04:21:11,836][123091] Updated weights for policy 0, policy_version 597067 (0.0009) [2023-12-26 04:21:12,159][123090] Updated weights for policy 1, policy_version 592870 (0.0007) [2023-12-26 04:21:12,210][123090] Updated weights for policy 1, policy_version 592880 (0.0010) [2023-12-26 04:21:12,277][123090] Updated weights for policy 1, policy_version 592890 (0.0011) [2023-12-26 04:21:12,710][123091] Updated weights for policy 0, policy_version 597077 (0.0010) [2023-12-26 04:21:12,765][123091] Updated weights for policy 0, policy_version 597087 (0.0010) [2023-12-26 04:21:12,821][123091] Updated weights for policy 0, policy_version 597097 (0.0010) [2023-12-26 04:21:13,119][123090] Updated weights for policy 1, policy_version 592900 (0.0008) [2023-12-26 04:21:13,185][123090] Updated weights for policy 1, policy_version 592910 (0.0009) [2023-12-26 04:21:13,251][123090] Updated weights for policy 1, policy_version 592920 (0.0008) [2023-12-26 04:21:13,586][123091] Updated weights for policy 0, policy_version 597107 (0.0010) [2023-12-26 04:21:13,649][123091] Updated weights for policy 0, policy_version 597117 (0.0010) [2023-12-26 04:21:13,711][123091] Updated weights for policy 0, policy_version 597127 (0.0011) [2023-12-26 04:21:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 304660480. Throughput: 0: 9015.7, 1: 8743.6. Samples: 304651136. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:13,785][121949] Avg episode reward: [(0, '6120.186'), (1, '5099.255')] [2023-12-26 04:21:13,985][123090] Updated weights for policy 1, policy_version 592930 (0.0006) [2023-12-26 04:21:14,052][123090] Updated weights for policy 1, policy_version 592940 (0.0009) [2023-12-26 04:21:14,120][123090] Updated weights for policy 1, policy_version 592950 (0.0010) [2023-12-26 04:21:14,191][123090] Updated weights for policy 1, policy_version 592960 (0.0010) [2023-12-26 04:21:14,338][123091] Updated weights for policy 0, policy_version 597137 (0.0007) [2023-12-26 04:21:14,392][123091] Updated weights for policy 0, policy_version 597147 (0.0007) [2023-12-26 04:21:14,447][123091] Updated weights for policy 0, policy_version 597157 (0.0008) [2023-12-26 04:21:14,517][123091] Updated weights for policy 0, policy_version 597167 (0.0009) [2023-12-26 04:21:15,075][123090] Updated weights for policy 1, policy_version 592970 (0.0005) [2023-12-26 04:21:15,151][123090] Updated weights for policy 1, policy_version 592980 (0.0005) [2023-12-26 04:21:15,216][123090] Updated weights for policy 1, policy_version 592990 (0.0006) [2023-12-26 04:21:15,217][123091] Updated weights for policy 0, policy_version 597177 (0.0009) [2023-12-26 04:21:15,287][123091] Updated weights for policy 0, policy_version 597187 (0.0011) [2023-12-26 04:21:15,358][123091] Updated weights for policy 0, policy_version 597197 (0.0011) [2023-12-26 04:21:15,889][123090] Updated weights for policy 1, policy_version 593000 (0.0010) [2023-12-26 04:21:15,968][123090] Updated weights for policy 1, policy_version 593010 (0.0011) [2023-12-26 04:21:16,031][123090] Updated weights for policy 1, policy_version 593020 (0.0011) [2023-12-26 04:21:16,143][123091] Updated weights for policy 0, policy_version 597207 (0.0009) [2023-12-26 04:21:16,207][123091] Updated weights for policy 0, policy_version 597217 (0.0009) [2023-12-26 04:21:16,267][123091] Updated weights for policy 0, policy_version 597227 (0.0009) [2023-12-26 04:21:16,747][123090] Updated weights for policy 1, policy_version 593030 (0.0010) [2023-12-26 04:21:16,802][123090] Updated weights for policy 1, policy_version 593040 (0.0010) [2023-12-26 04:21:16,853][123090] Updated weights for policy 1, policy_version 593050 (0.0009) [2023-12-26 04:21:17,070][123091] Updated weights for policy 0, policy_version 597237 (0.0010) [2023-12-26 04:21:17,128][123091] Updated weights for policy 0, policy_version 597247 (0.0010) [2023-12-26 04:21:17,186][123091] Updated weights for policy 0, policy_version 597257 (0.0010) [2023-12-26 04:21:17,751][123090] Updated weights for policy 1, policy_version 593060 (0.0008) [2023-12-26 04:21:17,802][123090] Updated weights for policy 1, policy_version 593070 (0.0005) [2023-12-26 04:21:17,849][123090] Updated weights for policy 1, policy_version 593080 (0.0005) [2023-12-26 04:21:17,915][123091] Updated weights for policy 0, policy_version 597267 (0.0010) [2023-12-26 04:21:17,998][123091] Updated weights for policy 0, policy_version 597277 (0.0010) [2023-12-26 04:21:18,065][123091] Updated weights for policy 0, policy_version 597287 (0.0006) [2023-12-26 04:21:18,688][123090] Updated weights for policy 1, policy_version 593090 (0.0006) [2023-12-26 04:21:18,740][123091] Updated weights for policy 0, policy_version 597297 (0.0006) [2023-12-26 04:21:18,744][123090] Updated weights for policy 1, policy_version 593100 (0.0009) [2023-12-26 04:21:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 304742400. Throughput: 0: 9065.7, 1: 8755.5. Samples: 304760784. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:18,785][121949] Avg episode reward: [(0, '6301.603'), (1, '5349.559')] [2023-12-26 04:21:18,799][123090] Updated weights for policy 1, policy_version 593110 (0.0009) [2023-12-26 04:21:18,804][123091] Updated weights for policy 0, policy_version 597307 (0.0007) [2023-12-26 04:21:18,862][123090] Updated weights for policy 1, policy_version 593120 (0.0009) [2023-12-26 04:21:18,870][123091] Updated weights for policy 0, policy_version 597317 (0.0008) [2023-12-26 04:21:18,937][123091] Updated weights for policy 0, policy_version 597327 (0.0008) [2023-12-26 04:21:19,677][123091] Updated weights for policy 0, policy_version 597337 (0.0009) [2023-12-26 04:21:19,731][123090] Updated weights for policy 1, policy_version 593130 (0.0009) [2023-12-26 04:21:19,735][123091] Updated weights for policy 0, policy_version 597347 (0.0009) [2023-12-26 04:21:19,793][123090] Updated weights for policy 1, policy_version 593140 (0.0007) [2023-12-26 04:21:19,796][123091] Updated weights for policy 0, policy_version 597357 (0.0009) [2023-12-26 04:21:19,857][123090] Updated weights for policy 1, policy_version 593150 (0.0010) [2023-12-26 04:21:20,613][123091] Updated weights for policy 0, policy_version 597367 (0.0009) [2023-12-26 04:21:20,681][123091] Updated weights for policy 0, policy_version 597377 (0.0009) [2023-12-26 04:21:20,689][123090] Updated weights for policy 1, policy_version 593160 (0.0007) [2023-12-26 04:21:20,736][123091] Updated weights for policy 0, policy_version 597387 (0.0010) [2023-12-26 04:21:20,750][123090] Updated weights for policy 1, policy_version 593170 (0.0008) [2023-12-26 04:21:20,812][123090] Updated weights for policy 1, policy_version 593180 (0.0009) [2023-12-26 04:21:21,621][123091] Updated weights for policy 0, policy_version 597397 (0.0009) [2023-12-26 04:21:21,634][123090] Updated weights for policy 1, policy_version 593190 (0.0008) [2023-12-26 04:21:21,700][123091] Updated weights for policy 0, policy_version 597407 (0.0008) [2023-12-26 04:21:21,705][123090] Updated weights for policy 1, policy_version 593200 (0.0008) [2023-12-26 04:21:21,763][123091] Updated weights for policy 0, policy_version 597417 (0.0009) [2023-12-26 04:21:21,773][123090] Updated weights for policy 1, policy_version 593210 (0.0007) [2023-12-26 04:21:22,580][123090] Updated weights for policy 1, policy_version 593220 (0.0007) [2023-12-26 04:21:22,624][123091] Updated weights for policy 0, policy_version 597427 (0.0010) [2023-12-26 04:21:22,645][123090] Updated weights for policy 1, policy_version 593230 (0.0008) [2023-12-26 04:21:22,689][123091] Updated weights for policy 0, policy_version 597437 (0.0006) [2023-12-26 04:21:22,712][123090] Updated weights for policy 1, policy_version 593240 (0.0009) [2023-12-26 04:21:22,737][123091] Updated weights for policy 0, policy_version 597447 (0.0007) [2023-12-26 04:21:23,533][123090] Updated weights for policy 1, policy_version 593250 (0.0010) [2023-12-26 04:21:23,567][123091] Updated weights for policy 0, policy_version 597457 (0.0008) [2023-12-26 04:21:23,591][123090] Updated weights for policy 1, policy_version 593260 (0.0009) [2023-12-26 04:21:23,616][123091] Updated weights for policy 0, policy_version 597467 (0.0008) [2023-12-26 04:21:23,655][123090] Updated weights for policy 1, policy_version 593270 (0.0008) [2023-12-26 04:21:23,670][123091] Updated weights for policy 0, policy_version 597477 (0.0009) [2023-12-26 04:21:23,703][123090] Updated weights for policy 1, policy_version 593280 (0.0007) [2023-12-26 04:21:23,725][123091] Updated weights for policy 0, policy_version 597487 (0.0009) [2023-12-26 04:21:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 304840704. Throughput: 0: 9044.2, 1: 8687.6. Samples: 304811644. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:23,785][121949] Avg episode reward: [(0, '6090.958'), (1, '5343.256')] [2023-12-26 04:21:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000593280_151879680.pth... [2023-12-26 04:21:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000597488_152961024.pth... [2023-12-26 04:21:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000592256_151617536.pth [2023-12-26 04:21:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000596432_152690688.pth [2023-12-26 04:21:24,550][123090] Updated weights for policy 1, policy_version 593290 (0.0009) [2023-12-26 04:21:24,585][123091] Updated weights for policy 0, policy_version 597497 (0.0009) [2023-12-26 04:21:24,621][123090] Updated weights for policy 1, policy_version 593300 (0.0005) [2023-12-26 04:21:24,642][123091] Updated weights for policy 0, policy_version 597507 (0.0009) [2023-12-26 04:21:24,690][123090] Updated weights for policy 1, policy_version 593310 (0.0007) [2023-12-26 04:21:24,705][123091] Updated weights for policy 0, policy_version 597517 (0.0010) [2023-12-26 04:21:25,358][123090] Updated weights for policy 1, policy_version 593320 (0.0008) [2023-12-26 04:21:25,413][123090] Updated weights for policy 1, policy_version 593330 (0.0009) [2023-12-26 04:21:25,468][123090] Updated weights for policy 1, policy_version 593340 (0.0008) [2023-12-26 04:21:25,544][123091] Updated weights for policy 0, policy_version 597527 (0.0009) [2023-12-26 04:21:25,594][123091] Updated weights for policy 0, policy_version 597537 (0.0009) [2023-12-26 04:21:25,650][123091] Updated weights for policy 0, policy_version 597547 (0.0010) [2023-12-26 04:21:26,312][123090] Updated weights for policy 1, policy_version 593350 (0.0009) [2023-12-26 04:21:26,362][123090] Updated weights for policy 1, policy_version 593360 (0.0009) [2023-12-26 04:21:26,416][123090] Updated weights for policy 1, policy_version 593371 (0.0010) [2023-12-26 04:21:26,480][123091] Updated weights for policy 0, policy_version 597557 (0.0009) [2023-12-26 04:21:26,534][123091] Updated weights for policy 0, policy_version 597567 (0.0009) [2023-12-26 04:21:26,591][123091] Updated weights for policy 0, policy_version 597577 (0.0009) [2023-12-26 04:21:27,303][123090] Updated weights for policy 1, policy_version 593381 (0.0009) [2023-12-26 04:21:27,365][123090] Updated weights for policy 1, policy_version 593391 (0.0009) [2023-12-26 04:21:27,418][123091] Updated weights for policy 0, policy_version 597587 (0.0009) [2023-12-26 04:21:27,426][123090] Updated weights for policy 1, policy_version 593401 (0.0009) [2023-12-26 04:21:27,469][123091] Updated weights for policy 0, policy_version 597597 (0.0010) [2023-12-26 04:21:27,522][123091] Updated weights for policy 0, policy_version 597607 (0.0009) [2023-12-26 04:21:28,266][123090] Updated weights for policy 1, policy_version 593411 (0.0008) [2023-12-26 04:21:28,335][123090] Updated weights for policy 1, policy_version 593421 (0.0009) [2023-12-26 04:21:28,363][123091] Updated weights for policy 0, policy_version 597617 (0.0009) [2023-12-26 04:21:28,396][123090] Updated weights for policy 1, policy_version 593431 (0.0008) [2023-12-26 04:21:28,424][123091] Updated weights for policy 0, policy_version 597627 (0.0009) [2023-12-26 04:21:28,480][123091] Updated weights for policy 0, policy_version 597637 (0.0009) [2023-12-26 04:21:28,545][123091] Updated weights for policy 0, policy_version 597647 (0.0009) [2023-12-26 04:21:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 304922624. Throughput: 0: 8947.0, 1: 8691.5. Samples: 304914140. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:28,785][121949] Avg episode reward: [(0, '6038.385'), (1, '5065.021')] [2023-12-26 04:21:29,203][123090] Updated weights for policy 1, policy_version 593441 (0.0008) [2023-12-26 04:21:29,286][123090] Updated weights for policy 1, policy_version 593451 (0.0008) [2023-12-26 04:21:29,357][123090] Updated weights for policy 1, policy_version 593461 (0.0007) [2023-12-26 04:21:29,394][123091] Updated weights for policy 0, policy_version 597657 (0.0007) [2023-12-26 04:21:29,421][123090] Updated weights for policy 1, policy_version 593471 (0.0010) [2023-12-26 04:21:29,443][123091] Updated weights for policy 0, policy_version 597667 (0.0008) [2023-12-26 04:21:29,503][123091] Updated weights for policy 0, policy_version 597677 (0.0009) [2023-12-26 04:21:30,178][123090] Updated weights for policy 1, policy_version 593481 (0.0008) [2023-12-26 04:21:30,227][123090] Updated weights for policy 1, policy_version 593491 (0.0005) [2023-12-26 04:21:30,303][123090] Updated weights for policy 1, policy_version 593501 (0.0010) [2023-12-26 04:21:30,377][123091] Updated weights for policy 0, policy_version 597687 (0.0010) [2023-12-26 04:21:30,448][123091] Updated weights for policy 0, policy_version 597697 (0.0006) [2023-12-26 04:21:30,518][123091] Updated weights for policy 0, policy_version 597707 (0.0005) [2023-12-26 04:21:30,975][123090] Updated weights for policy 1, policy_version 593511 (0.0007) [2023-12-26 04:21:31,048][123090] Updated weights for policy 1, policy_version 593521 (0.0007) [2023-12-26 04:21:31,111][123090] Updated weights for policy 1, policy_version 593531 (0.0006) [2023-12-26 04:21:31,206][123091] Updated weights for policy 0, policy_version 597717 (0.0008) [2023-12-26 04:21:31,274][123091] Updated weights for policy 0, policy_version 597727 (0.0009) [2023-12-26 04:21:31,347][123091] Updated weights for policy 0, policy_version 597737 (0.0010) [2023-12-26 04:21:31,850][123090] Updated weights for policy 1, policy_version 593541 (0.0009) [2023-12-26 04:21:31,909][123090] Updated weights for policy 1, policy_version 593551 (0.0010) [2023-12-26 04:21:31,968][123090] Updated weights for policy 1, policy_version 593561 (0.0009) [2023-12-26 04:21:32,203][123091] Updated weights for policy 0, policy_version 597747 (0.0009) [2023-12-26 04:21:32,256][123091] Updated weights for policy 0, policy_version 597757 (0.0010) [2023-12-26 04:21:32,318][123091] Updated weights for policy 0, policy_version 597767 (0.0010) [2023-12-26 04:21:32,763][123090] Updated weights for policy 1, policy_version 593571 (0.0009) [2023-12-26 04:21:32,827][123090] Updated weights for policy 1, policy_version 593581 (0.0009) [2023-12-26 04:21:32,878][123090] Updated weights for policy 1, policy_version 593591 (0.0008) [2023-12-26 04:21:33,246][123091] Updated weights for policy 0, policy_version 597777 (0.0010) [2023-12-26 04:21:33,302][123091] Updated weights for policy 0, policy_version 597787 (0.0009) [2023-12-26 04:21:33,356][123091] Updated weights for policy 0, policy_version 597797 (0.0010) [2023-12-26 04:21:33,410][123091] Updated weights for policy 0, policy_version 597807 (0.0010) [2023-12-26 04:21:33,535][123090] Updated weights for policy 1, policy_version 593601 (0.0009) [2023-12-26 04:21:33,595][123090] Updated weights for policy 1, policy_version 593611 (0.0005) [2023-12-26 04:21:33,653][123090] Updated weights for policy 1, policy_version 593621 (0.0005) [2023-12-26 04:21:33,710][123090] Updated weights for policy 1, policy_version 593631 (0.0005) [2023-12-26 04:21:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 305012736. Throughput: 0: 8793.1, 1: 8771.4. Samples: 305020112. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:33,784][121949] Avg episode reward: [(0, '6039.774'), (1, '5135.340')] [2023-12-26 04:21:34,322][123091] Updated weights for policy 0, policy_version 597817 (0.0009) [2023-12-26 04:21:34,388][123091] Updated weights for policy 0, policy_version 597827 (0.0009) [2023-12-26 04:21:34,407][123090] Updated weights for policy 1, policy_version 593641 (0.0006) [2023-12-26 04:21:34,445][123091] Updated weights for policy 0, policy_version 597837 (0.0010) [2023-12-26 04:21:34,465][123090] Updated weights for policy 1, policy_version 593651 (0.0006) [2023-12-26 04:21:34,527][123090] Updated weights for policy 1, policy_version 593661 (0.0010) [2023-12-26 04:21:35,308][123091] Updated weights for policy 0, policy_version 597847 (0.0008) [2023-12-26 04:21:35,315][123090] Updated weights for policy 1, policy_version 593671 (0.0009) [2023-12-26 04:21:35,358][123091] Updated weights for policy 0, policy_version 597857 (0.0008) [2023-12-26 04:21:35,369][123090] Updated weights for policy 1, policy_version 593681 (0.0007) [2023-12-26 04:21:35,423][123091] Updated weights for policy 0, policy_version 597867 (0.0010) [2023-12-26 04:21:35,426][123090] Updated weights for policy 1, policy_version 593691 (0.0006) [2023-12-26 04:21:36,256][123090] Updated weights for policy 1, policy_version 593701 (0.0006) [2023-12-26 04:21:36,264][123091] Updated weights for policy 0, policy_version 597877 (0.0009) [2023-12-26 04:21:36,313][123090] Updated weights for policy 1, policy_version 593711 (0.0005) [2023-12-26 04:21:36,324][123091] Updated weights for policy 0, policy_version 597887 (0.0009) [2023-12-26 04:21:36,368][123090] Updated weights for policy 1, policy_version 593721 (0.0007) [2023-12-26 04:21:36,385][123091] Updated weights for policy 0, policy_version 597897 (0.0009) [2023-12-26 04:21:37,167][123090] Updated weights for policy 1, policy_version 593731 (0.0008) [2023-12-26 04:21:37,238][123090] Updated weights for policy 1, policy_version 593741 (0.0009) [2023-12-26 04:21:37,258][123091] Updated weights for policy 0, policy_version 597907 (0.0009) [2023-12-26 04:21:37,303][123090] Updated weights for policy 1, policy_version 593751 (0.0009) [2023-12-26 04:21:37,310][123091] Updated weights for policy 0, policy_version 597917 (0.0007) [2023-12-26 04:21:37,358][123091] Updated weights for policy 0, policy_version 597927 (0.0007) [2023-12-26 04:21:38,066][123090] Updated weights for policy 1, policy_version 593761 (0.0007) [2023-12-26 04:21:38,127][123091] Updated weights for policy 0, policy_version 597937 (0.0010) [2023-12-26 04:21:38,130][123090] Updated weights for policy 1, policy_version 593771 (0.0005) [2023-12-26 04:21:38,188][123091] Updated weights for policy 0, policy_version 597947 (0.0005) [2023-12-26 04:21:38,198][123090] Updated weights for policy 1, policy_version 593781 (0.0005) [2023-12-26 04:21:38,253][123091] Updated weights for policy 0, policy_version 597957 (0.0005) [2023-12-26 04:21:38,270][123090] Updated weights for policy 1, policy_version 593791 (0.0008) [2023-12-26 04:21:38,328][123091] Updated weights for policy 0, policy_version 597967 (0.0006) [2023-12-26 04:21:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 305094656. Throughput: 0: 8762.0, 1: 8781.1. Samples: 305071524. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:38,785][121949] Avg episode reward: [(0, '5838.484'), (1, '5321.436')] [2023-12-26 04:21:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000597968_153083904.pth... [2023-12-26 04:21:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000593792_152010752.pth... [2023-12-26 04:21:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000596976_152829952.pth [2023-12-26 04:21:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000592768_151748608.pth [2023-12-26 04:21:39,046][123090] Updated weights for policy 1, policy_version 593801 (0.0009) [2023-12-26 04:21:39,086][123091] Updated weights for policy 0, policy_version 597977 (0.0011) [2023-12-26 04:21:39,090][123090] Updated weights for policy 1, policy_version 593811 (0.0006) [2023-12-26 04:21:39,145][123091] Updated weights for policy 0, policy_version 597987 (0.0011) [2023-12-26 04:21:39,151][123090] Updated weights for policy 1, policy_version 593821 (0.0008) [2023-12-26 04:21:39,207][123091] Updated weights for policy 0, policy_version 597997 (0.0011) [2023-12-26 04:21:40,027][123091] Updated weights for policy 0, policy_version 598007 (0.0010) [2023-12-26 04:21:40,069][123090] Updated weights for policy 1, policy_version 593831 (0.0009) [2023-12-26 04:21:40,089][123091] Updated weights for policy 0, policy_version 598017 (0.0008) [2023-12-26 04:21:40,122][123090] Updated weights for policy 1, policy_version 593841 (0.0008) [2023-12-26 04:21:40,152][123091] Updated weights for policy 0, policy_version 598027 (0.0008) [2023-12-26 04:21:40,173][123090] Updated weights for policy 1, policy_version 593851 (0.0009) [2023-12-26 04:21:40,938][123090] Updated weights for policy 1, policy_version 593861 (0.0008) [2023-12-26 04:21:41,004][123090] Updated weights for policy 1, policy_version 593871 (0.0008) [2023-12-26 04:21:41,070][123090] Updated weights for policy 1, policy_version 593881 (0.0009) [2023-12-26 04:21:41,072][123091] Updated weights for policy 0, policy_version 598037 (0.0008) [2023-12-26 04:21:41,135][123091] Updated weights for policy 0, policy_version 598047 (0.0009) [2023-12-26 04:21:41,207][123091] Updated weights for policy 0, policy_version 598057 (0.0010) [2023-12-26 04:21:41,902][123090] Updated weights for policy 1, policy_version 593891 (0.0008) [2023-12-26 04:21:41,968][123090] Updated weights for policy 1, policy_version 593901 (0.0010) [2023-12-26 04:21:42,022][123090] Updated weights for policy 1, policy_version 593911 (0.0009) [2023-12-26 04:21:42,059][123091] Updated weights for policy 0, policy_version 598067 (0.0010) [2023-12-26 04:21:42,123][123091] Updated weights for policy 0, policy_version 598077 (0.0008) [2023-12-26 04:21:42,194][123091] Updated weights for policy 0, policy_version 598087 (0.0007) [2023-12-26 04:21:42,862][123090] Updated weights for policy 1, policy_version 593921 (0.0007) [2023-12-26 04:21:42,925][123090] Updated weights for policy 1, policy_version 593931 (0.0005) [2023-12-26 04:21:42,970][123091] Updated weights for policy 0, policy_version 598097 (0.0010) [2023-12-26 04:21:42,986][123090] Updated weights for policy 1, policy_version 593941 (0.0007) [2023-12-26 04:21:43,025][123091] Updated weights for policy 0, policy_version 598107 (0.0009) [2023-12-26 04:21:43,049][123090] Updated weights for policy 1, policy_version 593951 (0.0008) [2023-12-26 04:21:43,081][123091] Updated weights for policy 0, policy_version 598117 (0.0008) [2023-12-26 04:21:43,139][123091] Updated weights for policy 0, policy_version 598128 (0.0010) [2023-12-26 04:21:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 305176576. Throughput: 0: 8654.3, 1: 8696.7. Samples: 305174472. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:43,785][121949] Avg episode reward: [(0, '5822.578'), (1, '5615.029')] [2023-12-26 04:21:43,850][123090] Updated weights for policy 1, policy_version 593961 (0.0009) [2023-12-26 04:21:43,911][123090] Updated weights for policy 1, policy_version 593971 (0.0009) [2023-12-26 04:21:43,970][123090] Updated weights for policy 1, policy_version 593981 (0.0010) [2023-12-26 04:21:44,005][123091] Updated weights for policy 0, policy_version 598138 (0.0009) [2023-12-26 04:21:44,062][123091] Updated weights for policy 0, policy_version 598148 (0.0009) [2023-12-26 04:21:44,115][123091] Updated weights for policy 0, policy_version 598158 (0.0009) [2023-12-26 04:21:44,807][123090] Updated weights for policy 1, policy_version 593991 (0.0008) [2023-12-26 04:21:44,878][123090] Updated weights for policy 1, policy_version 594001 (0.0006) [2023-12-26 04:21:44,911][123091] Updated weights for policy 0, policy_version 598168 (0.0009) [2023-12-26 04:21:44,940][123090] Updated weights for policy 1, policy_version 594011 (0.0007) [2023-12-26 04:21:44,978][123091] Updated weights for policy 0, policy_version 598178 (0.0008) [2023-12-26 04:21:45,054][123091] Updated weights for policy 0, policy_version 598188 (0.0010) [2023-12-26 04:21:45,790][123090] Updated weights for policy 1, policy_version 594021 (0.0010) [2023-12-26 04:21:45,851][123091] Updated weights for policy 0, policy_version 598198 (0.0008) [2023-12-26 04:21:45,860][123090] Updated weights for policy 1, policy_version 594031 (0.0009) [2023-12-26 04:21:45,899][123091] Updated weights for policy 0, policy_version 598208 (0.0007) [2023-12-26 04:21:45,926][123090] Updated weights for policy 1, policy_version 594041 (0.0008) [2023-12-26 04:21:45,948][123091] Updated weights for policy 0, policy_version 598218 (0.0007) [2023-12-26 04:21:46,595][123090] Updated weights for policy 1, policy_version 594051 (0.0009) [2023-12-26 04:21:46,662][123090] Updated weights for policy 1, policy_version 594061 (0.0006) [2023-12-26 04:21:46,719][123090] Updated weights for policy 1, policy_version 594071 (0.0010) [2023-12-26 04:21:46,821][123091] Updated weights for policy 0, policy_version 598228 (0.0008) [2023-12-26 04:21:46,878][123091] Updated weights for policy 0, policy_version 598238 (0.0009) [2023-12-26 04:21:46,934][123091] Updated weights for policy 0, policy_version 598248 (0.0009) [2023-12-26 04:21:47,478][123090] Updated weights for policy 1, policy_version 594081 (0.0009) [2023-12-26 04:21:47,540][123090] Updated weights for policy 1, policy_version 594091 (0.0005) [2023-12-26 04:21:47,599][123090] Updated weights for policy 1, policy_version 594101 (0.0005) [2023-12-26 04:21:47,654][123090] Updated weights for policy 1, policy_version 594111 (0.0005) [2023-12-26 04:21:47,857][123091] Updated weights for policy 0, policy_version 598259 (0.0010) [2023-12-26 04:21:47,907][123091] Updated weights for policy 0, policy_version 598269 (0.0009) [2023-12-26 04:21:47,959][123091] Updated weights for policy 0, policy_version 598280 (0.0010) [2023-12-26 04:21:48,402][123090] Updated weights for policy 1, policy_version 594121 (0.0009) [2023-12-26 04:21:48,469][123090] Updated weights for policy 1, policy_version 594131 (0.0010) [2023-12-26 04:21:48,537][123090] Updated weights for policy 1, policy_version 594141 (0.0010) [2023-12-26 04:21:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 305266688. Throughput: 0: 8600.7, 1: 8764.9. Samples: 305278816. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:48,784][121949] Avg episode reward: [(0, '5803.131'), (1, '5619.055')] [2023-12-26 04:21:48,833][123091] Updated weights for policy 0, policy_version 598290 (0.0009) [2023-12-26 04:21:48,898][123091] Updated weights for policy 0, policy_version 598300 (0.0009) [2023-12-26 04:21:48,956][123091] Updated weights for policy 0, policy_version 598310 (0.0009) [2023-12-26 04:21:49,015][123091] Updated weights for policy 0, policy_version 598320 (0.0009) [2023-12-26 04:21:49,363][123090] Updated weights for policy 1, policy_version 594151 (0.0009) [2023-12-26 04:21:49,428][123090] Updated weights for policy 1, policy_version 594161 (0.0009) [2023-12-26 04:21:49,492][123090] Updated weights for policy 1, policy_version 594171 (0.0007) [2023-12-26 04:21:49,882][123091] Updated weights for policy 0, policy_version 598330 (0.0010) [2023-12-26 04:21:49,944][123091] Updated weights for policy 0, policy_version 598340 (0.0009) [2023-12-26 04:21:50,008][123091] Updated weights for policy 0, policy_version 598350 (0.0009) [2023-12-26 04:21:50,318][123090] Updated weights for policy 1, policy_version 594181 (0.0010) [2023-12-26 04:21:50,387][123090] Updated weights for policy 1, policy_version 594191 (0.0010) [2023-12-26 04:21:50,460][123090] Updated weights for policy 1, policy_version 594201 (0.0009) [2023-12-26 04:21:50,797][123091] Updated weights for policy 0, policy_version 598360 (0.0009) [2023-12-26 04:21:50,863][123091] Updated weights for policy 0, policy_version 598370 (0.0010) [2023-12-26 04:21:50,941][123091] Updated weights for policy 0, policy_version 598380 (0.0010) [2023-12-26 04:21:51,256][123090] Updated weights for policy 1, policy_version 594211 (0.0008) [2023-12-26 04:21:51,324][123090] Updated weights for policy 1, policy_version 594221 (0.0008) [2023-12-26 04:21:51,389][123090] Updated weights for policy 1, policy_version 594231 (0.0009) [2023-12-26 04:21:51,758][123091] Updated weights for policy 0, policy_version 598390 (0.0009) [2023-12-26 04:21:51,807][123091] Updated weights for policy 0, policy_version 598400 (0.0005) [2023-12-26 04:21:51,855][123091] Updated weights for policy 0, policy_version 598410 (0.0006) [2023-12-26 04:21:52,166][123090] Updated weights for policy 1, policy_version 594241 (0.0009) [2023-12-26 04:21:52,232][123090] Updated weights for policy 1, policy_version 594251 (0.0009) [2023-12-26 04:21:52,298][123090] Updated weights for policy 1, policy_version 594261 (0.0009) [2023-12-26 04:21:52,365][123090] Updated weights for policy 1, policy_version 594271 (0.0011) [2023-12-26 04:21:52,629][123091] Updated weights for policy 0, policy_version 598420 (0.0006) [2023-12-26 04:21:52,695][123091] Updated weights for policy 0, policy_version 598430 (0.0011) [2023-12-26 04:21:52,762][123091] Updated weights for policy 0, policy_version 598440 (0.0011) [2023-12-26 04:21:53,134][123090] Updated weights for policy 1, policy_version 594281 (0.0011) [2023-12-26 04:21:53,193][123090] Updated weights for policy 1, policy_version 594291 (0.0010) [2023-12-26 04:21:53,263][123090] Updated weights for policy 1, policy_version 594301 (0.0011) [2023-12-26 04:21:53,524][123091] Updated weights for policy 0, policy_version 598450 (0.0010) [2023-12-26 04:21:53,576][123091] Updated weights for policy 0, policy_version 598460 (0.0009) [2023-12-26 04:21:53,643][123091] Updated weights for policy 0, policy_version 598470 (0.0005) [2023-12-26 04:21:53,696][123091] Updated weights for policy 0, policy_version 598480 (0.0005) [2023-12-26 04:21:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 305356800. Throughput: 0: 8591.3, 1: 8773.7. Samples: 305329536. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:53,785][121949] Avg episode reward: [(0, '5698.103'), (1, '5575.681')] [2023-12-26 04:21:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000594304_152141824.pth... [2023-12-26 04:21:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000598480_153214976.pth... [2023-12-26 04:21:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000593280_151879680.pth [2023-12-26 04:21:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000597488_152961024.pth [2023-12-26 04:21:53,955][123090] Updated weights for policy 1, policy_version 594311 (0.0010) [2023-12-26 04:21:54,013][123090] Updated weights for policy 1, policy_version 594321 (0.0010) [2023-12-26 04:21:54,064][123090] Updated weights for policy 1, policy_version 594331 (0.0006) [2023-12-26 04:21:54,448][123091] Updated weights for policy 0, policy_version 598490 (0.0011) [2023-12-26 04:21:54,510][123091] Updated weights for policy 0, policy_version 598500 (0.0010) [2023-12-26 04:21:54,572][123091] Updated weights for policy 0, policy_version 598510 (0.0008) [2023-12-26 04:21:54,806][123090] Updated weights for policy 1, policy_version 594341 (0.0008) [2023-12-26 04:21:54,868][123090] Updated weights for policy 1, policy_version 594351 (0.0006) [2023-12-26 04:21:54,945][123090] Updated weights for policy 1, policy_version 594361 (0.0008) [2023-12-26 04:21:55,398][123091] Updated weights for policy 0, policy_version 598520 (0.0010) [2023-12-26 04:21:55,441][123091] Updated weights for policy 0, policy_version 598530 (0.0010) [2023-12-26 04:21:55,488][123091] Updated weights for policy 0, policy_version 598540 (0.0010) [2023-12-26 04:21:55,696][123090] Updated weights for policy 1, policy_version 594371 (0.0009) [2023-12-26 04:21:55,760][123090] Updated weights for policy 1, policy_version 594381 (0.0005) [2023-12-26 04:21:55,827][123090] Updated weights for policy 1, policy_version 594391 (0.0005) [2023-12-26 04:21:56,256][123091] Updated weights for policy 0, policy_version 598550 (0.0007) [2023-12-26 04:21:56,303][123091] Updated weights for policy 0, policy_version 598560 (0.0005) [2023-12-26 04:21:56,356][123091] Updated weights for policy 0, policy_version 598570 (0.0005) [2023-12-26 04:21:56,427][123090] Updated weights for policy 1, policy_version 594401 (0.0005) [2023-12-26 04:21:56,488][123090] Updated weights for policy 1, policy_version 594411 (0.0010) [2023-12-26 04:21:56,550][123090] Updated weights for policy 1, policy_version 594421 (0.0010) [2023-12-26 04:21:56,603][123090] Updated weights for policy 1, policy_version 594431 (0.0006) [2023-12-26 04:21:57,087][123091] Updated weights for policy 0, policy_version 598580 (0.0008) [2023-12-26 04:21:57,131][123091] Updated weights for policy 0, policy_version 598590 (0.0010) [2023-12-26 04:21:57,174][123091] Updated weights for policy 0, policy_version 598600 (0.0010) [2023-12-26 04:21:57,220][123090] Updated weights for policy 1, policy_version 594441 (0.0005) [2023-12-26 04:21:57,269][123090] Updated weights for policy 1, policy_version 594451 (0.0005) [2023-12-26 04:21:57,336][123090] Updated weights for policy 1, policy_version 594461 (0.0006) [2023-12-26 04:21:57,830][123091] Updated weights for policy 0, policy_version 598610 (0.0009) [2023-12-26 04:21:57,883][123091] Updated weights for policy 0, policy_version 598620 (0.0005) [2023-12-26 04:21:57,941][123091] Updated weights for policy 0, policy_version 598630 (0.0006) [2023-12-26 04:21:58,004][123091] Updated weights for policy 0, policy_version 598640 (0.0010) [2023-12-26 04:21:58,152][123090] Updated weights for policy 1, policy_version 594471 (0.0010) [2023-12-26 04:21:58,223][123090] Updated weights for policy 1, policy_version 594481 (0.0010) [2023-12-26 04:21:58,290][123090] Updated weights for policy 1, policy_version 594491 (0.0011) [2023-12-26 04:21:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 305446912. Throughput: 0: 8689.7, 1: 8916.5. Samples: 305443412. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:21:58,785][121949] Avg episode reward: [(0, '5634.121'), (1, '5708.679')] [2023-12-26 04:21:58,844][123091] Updated weights for policy 0, policy_version 598650 (0.0006) [2023-12-26 04:21:58,917][123091] Updated weights for policy 0, policy_version 598660 (0.0012) [2023-12-26 04:21:58,983][123091] Updated weights for policy 0, policy_version 598670 (0.0008) [2023-12-26 04:21:59,208][123090] Updated weights for policy 1, policy_version 594501 (0.0009) [2023-12-26 04:21:59,278][123090] Updated weights for policy 1, policy_version 594511 (0.0008) [2023-12-26 04:21:59,354][123090] Updated weights for policy 1, policy_version 594521 (0.0007) [2023-12-26 04:21:59,755][123091] Updated weights for policy 0, policy_version 598680 (0.0009) [2023-12-26 04:21:59,814][123091] Updated weights for policy 0, policy_version 598690 (0.0006) [2023-12-26 04:21:59,885][123091] Updated weights for policy 0, policy_version 598700 (0.0008) [2023-12-26 04:22:00,029][123090] Updated weights for policy 1, policy_version 594531 (0.0008) [2023-12-26 04:22:00,077][123090] Updated weights for policy 1, policy_version 594541 (0.0005) [2023-12-26 04:22:00,129][123090] Updated weights for policy 1, policy_version 594551 (0.0009) [2023-12-26 04:22:00,717][123091] Updated weights for policy 0, policy_version 598710 (0.0010) [2023-12-26 04:22:00,760][123091] Updated weights for policy 0, policy_version 598720 (0.0010) [2023-12-26 04:22:00,806][123091] Updated weights for policy 0, policy_version 598730 (0.0010) [2023-12-26 04:22:00,824][123090] Updated weights for policy 1, policy_version 594561 (0.0010) [2023-12-26 04:22:00,877][123090] Updated weights for policy 1, policy_version 594571 (0.0009) [2023-12-26 04:22:00,936][123090] Updated weights for policy 1, policy_version 594581 (0.0010) [2023-12-26 04:22:00,996][123090] Updated weights for policy 1, policy_version 594592 (0.0010) [2023-12-26 04:22:01,614][123091] Updated weights for policy 0, policy_version 598740 (0.0010) [2023-12-26 04:22:01,686][123091] Updated weights for policy 0, policy_version 598750 (0.0011) [2023-12-26 04:22:01,746][123091] Updated weights for policy 0, policy_version 598760 (0.0011) [2023-12-26 04:22:01,864][123090] Updated weights for policy 1, policy_version 594602 (0.0005) [2023-12-26 04:22:01,920][123090] Updated weights for policy 1, policy_version 594612 (0.0007) [2023-12-26 04:22:01,979][123090] Updated weights for policy 1, policy_version 594622 (0.0009) [2023-12-26 04:22:02,539][123091] Updated weights for policy 0, policy_version 598770 (0.0011) [2023-12-26 04:22:02,595][123091] Updated weights for policy 0, policy_version 598780 (0.0009) [2023-12-26 04:22:02,652][123091] Updated weights for policy 0, policy_version 598790 (0.0007) [2023-12-26 04:22:02,715][123091] Updated weights for policy 0, policy_version 598800 (0.0006) [2023-12-26 04:22:02,742][123090] Updated weights for policy 1, policy_version 594632 (0.0008) [2023-12-26 04:22:02,805][123090] Updated weights for policy 1, policy_version 594642 (0.0010) [2023-12-26 04:22:02,862][123090] Updated weights for policy 1, policy_version 594652 (0.0010) [2023-12-26 04:22:03,536][123090] Updated weights for policy 1, policy_version 594662 (0.0009) [2023-12-26 04:22:03,591][123090] Updated weights for policy 1, policy_version 594672 (0.0008) [2023-12-26 04:22:03,593][123091] Updated weights for policy 0, policy_version 598810 (0.0006) [2023-12-26 04:22:03,642][123090] Updated weights for policy 1, policy_version 594682 (0.0008) [2023-12-26 04:22:03,644][123091] Updated weights for policy 0, policy_version 598820 (0.0008) [2023-12-26 04:22:03,693][123091] Updated weights for policy 0, policy_version 598830 (0.0009) [2023-12-26 04:22:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 305545216. Throughput: 0: 8593.6, 1: 8924.2. Samples: 305549084. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:22:03,785][121949] Avg episode reward: [(0, '5807.531'), (1, '5670.504')] [2023-12-26 04:22:04,408][123090] Updated weights for policy 1, policy_version 594692 (0.0007) [2023-12-26 04:22:04,463][123090] Updated weights for policy 1, policy_version 594702 (0.0007) [2023-12-26 04:22:04,520][123090] Updated weights for policy 1, policy_version 594712 (0.0005) [2023-12-26 04:22:04,621][123091] Updated weights for policy 0, policy_version 598840 (0.0009) [2023-12-26 04:22:04,683][123091] Updated weights for policy 0, policy_version 598850 (0.0010) [2023-12-26 04:22:04,759][123091] Updated weights for policy 0, policy_version 598860 (0.0009) [2023-12-26 04:22:05,246][123090] Updated weights for policy 1, policy_version 594722 (0.0005) [2023-12-26 04:22:05,304][123090] Updated weights for policy 1, policy_version 594732 (0.0005) [2023-12-26 04:22:05,360][123090] Updated weights for policy 1, policy_version 594742 (0.0005) [2023-12-26 04:22:05,414][123090] Updated weights for policy 1, policy_version 594752 (0.0005) [2023-12-26 04:22:05,674][123091] Updated weights for policy 0, policy_version 598871 (0.0010) [2023-12-26 04:22:05,738][123091] Updated weights for policy 0, policy_version 598881 (0.0010) [2023-12-26 04:22:05,806][123091] Updated weights for policy 0, policy_version 598891 (0.0010) [2023-12-26 04:22:06,103][123090] Updated weights for policy 1, policy_version 594762 (0.0010) [2023-12-26 04:22:06,170][123090] Updated weights for policy 1, policy_version 594772 (0.0010) [2023-12-26 04:22:06,230][123090] Updated weights for policy 1, policy_version 594782 (0.0010) [2023-12-26 04:22:06,712][123091] Updated weights for policy 0, policy_version 598901 (0.0010) [2023-12-26 04:22:06,779][123091] Updated weights for policy 0, policy_version 598911 (0.0011) [2023-12-26 04:22:06,842][123091] Updated weights for policy 0, policy_version 598921 (0.0011) [2023-12-26 04:22:06,995][123090] Updated weights for policy 1, policy_version 594792 (0.0010) [2023-12-26 04:22:07,056][123090] Updated weights for policy 1, policy_version 594802 (0.0010) [2023-12-26 04:22:07,115][123090] Updated weights for policy 1, policy_version 594812 (0.0009) [2023-12-26 04:22:07,630][123091] Updated weights for policy 0, policy_version 598931 (0.0009) [2023-12-26 04:22:07,675][123091] Updated weights for policy 0, policy_version 598941 (0.0005) [2023-12-26 04:22:07,726][123091] Updated weights for policy 0, policy_version 598951 (0.0005) [2023-12-26 04:22:07,821][123090] Updated weights for policy 1, policy_version 594822 (0.0007) [2023-12-26 04:22:07,875][123090] Updated weights for policy 1, policy_version 594832 (0.0005) [2023-12-26 04:22:07,924][123090] Updated weights for policy 1, policy_version 594842 (0.0005) [2023-12-26 04:22:08,431][123091] Updated weights for policy 0, policy_version 598961 (0.0007) [2023-12-26 04:22:08,495][123091] Updated weights for policy 0, policy_version 598971 (0.0008) [2023-12-26 04:22:08,556][123091] Updated weights for policy 0, policy_version 598981 (0.0007) [2023-12-26 04:22:08,625][123091] Updated weights for policy 0, policy_version 598991 (0.0009) [2023-12-26 04:22:08,634][123090] Updated weights for policy 1, policy_version 594852 (0.0007) [2023-12-26 04:22:08,686][123090] Updated weights for policy 1, policy_version 594862 (0.0006) [2023-12-26 04:22:08,735][123090] Updated weights for policy 1, policy_version 594872 (0.0006) [2023-12-26 04:22:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 305635328. Throughput: 0: 8535.0, 1: 9026.5. Samples: 305601912. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:22:08,788][121949] Avg episode reward: [(0, '5843.841'), (1, '5724.002')] [2023-12-26 04:22:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000598992_153346048.pth... [2023-12-26 04:22:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000594880_152289280.pth... [2023-12-26 04:22:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000593792_152010752.pth [2023-12-26 04:22:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000597968_153083904.pth [2023-12-26 04:22:09,453][123091] Updated weights for policy 0, policy_version 599001 (0.0008) [2023-12-26 04:22:09,533][123091] Updated weights for policy 0, policy_version 599011 (0.0011) [2023-12-26 04:22:09,556][123090] Updated weights for policy 1, policy_version 594882 (0.0007) [2023-12-26 04:22:09,605][123091] Updated weights for policy 0, policy_version 599021 (0.0011) [2023-12-26 04:22:09,625][123090] Updated weights for policy 1, policy_version 594892 (0.0006) [2023-12-26 04:22:09,690][123090] Updated weights for policy 1, policy_version 594902 (0.0008) [2023-12-26 04:22:09,751][123090] Updated weights for policy 1, policy_version 594912 (0.0009) [2023-12-26 04:22:10,421][123091] Updated weights for policy 0, policy_version 599031 (0.0011) [2023-12-26 04:22:10,477][123091] Updated weights for policy 0, policy_version 599041 (0.0011) [2023-12-26 04:22:10,532][123091] Updated weights for policy 0, policy_version 599051 (0.0010) [2023-12-26 04:22:10,552][123090] Updated weights for policy 1, policy_version 594922 (0.0006) [2023-12-26 04:22:10,612][123090] Updated weights for policy 1, policy_version 594932 (0.0009) [2023-12-26 04:22:10,681][123090] Updated weights for policy 1, policy_version 594942 (0.0009) [2023-12-26 04:22:11,372][123091] Updated weights for policy 0, policy_version 599061 (0.0009) [2023-12-26 04:22:11,447][123091] Updated weights for policy 0, policy_version 599071 (0.0009) [2023-12-26 04:22:11,499][123091] Updated weights for policy 0, policy_version 599081 (0.0009) [2023-12-26 04:22:11,537][123090] Updated weights for policy 1, policy_version 594952 (0.0009) [2023-12-26 04:22:11,607][123090] Updated weights for policy 1, policy_version 594962 (0.0009) [2023-12-26 04:22:11,684][123090] Updated weights for policy 1, policy_version 594972 (0.0009) [2023-12-26 04:22:12,362][123091] Updated weights for policy 0, policy_version 599091 (0.0008) [2023-12-26 04:22:12,435][123091] Updated weights for policy 0, policy_version 599101 (0.0010) [2023-12-26 04:22:12,488][123090] Updated weights for policy 1, policy_version 594982 (0.0007) [2023-12-26 04:22:12,498][123091] Updated weights for policy 0, policy_version 599111 (0.0010) [2023-12-26 04:22:12,545][123090] Updated weights for policy 1, policy_version 594992 (0.0007) [2023-12-26 04:22:12,615][123090] Updated weights for policy 1, policy_version 595002 (0.0009) [2023-12-26 04:22:13,286][123091] Updated weights for policy 0, policy_version 599121 (0.0009) [2023-12-26 04:22:13,347][123091] Updated weights for policy 0, policy_version 599131 (0.0005) [2023-12-26 04:22:13,406][123091] Updated weights for policy 0, policy_version 599141 (0.0005) [2023-12-26 04:22:13,415][123090] Updated weights for policy 1, policy_version 595012 (0.0009) [2023-12-26 04:22:13,463][123091] Updated weights for policy 0, policy_version 599151 (0.0005) [2023-12-26 04:22:13,472][123090] Updated weights for policy 1, policy_version 595022 (0.0011) [2023-12-26 04:22:13,529][123090] Updated weights for policy 1, policy_version 595032 (0.0010) [2023-12-26 04:22:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 305717248. Throughput: 0: 8572.3, 1: 9051.9. Samples: 305707228. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:22:13,784][121949] Avg episode reward: [(0, '5923.044'), (1, '5612.734')] [2023-12-26 04:22:14,145][123091] Updated weights for policy 0, policy_version 599161 (0.0005) [2023-12-26 04:22:14,210][123091] Updated weights for policy 0, policy_version 599171 (0.0009) [2023-12-26 04:22:14,267][123091] Updated weights for policy 0, policy_version 599181 (0.0008) [2023-12-26 04:22:14,300][123090] Updated weights for policy 1, policy_version 595042 (0.0011) [2023-12-26 04:22:14,355][123090] Updated weights for policy 1, policy_version 595052 (0.0010) [2023-12-26 04:22:14,400][123090] Updated weights for policy 1, policy_version 595062 (0.0010) [2023-12-26 04:22:15,117][123091] Updated weights for policy 0, policy_version 599191 (0.0009) [2023-12-26 04:22:15,169][123090] Updated weights for policy 1, policy_version 595073 (0.0008) [2023-12-26 04:22:15,185][123091] Updated weights for policy 0, policy_version 599201 (0.0010) [2023-12-26 04:22:15,226][123090] Updated weights for policy 1, policy_version 595083 (0.0006) [2023-12-26 04:22:15,255][123091] Updated weights for policy 0, policy_version 599211 (0.0009) [2023-12-26 04:22:15,284][123090] Updated weights for policy 1, policy_version 595093 (0.0007) [2023-12-26 04:22:15,357][123090] Updated weights for policy 1, policy_version 595103 (0.0006) [2023-12-26 04:22:16,033][123091] Updated weights for policy 0, policy_version 599221 (0.0007) [2023-12-26 04:22:16,100][123091] Updated weights for policy 0, policy_version 599231 (0.0005) [2023-12-26 04:22:16,104][123090] Updated weights for policy 1, policy_version 595113 (0.0006) [2023-12-26 04:22:16,153][123090] Updated weights for policy 1, policy_version 595123 (0.0009) [2023-12-26 04:22:16,172][123091] Updated weights for policy 0, policy_version 599241 (0.0005) [2023-12-26 04:22:16,204][123090] Updated weights for policy 1, policy_version 595133 (0.0009) [2023-12-26 04:22:16,939][123091] Updated weights for policy 0, policy_version 599251 (0.0005) [2023-12-26 04:22:16,995][123091] Updated weights for policy 0, policy_version 599261 (0.0006) [2023-12-26 04:22:17,004][123090] Updated weights for policy 1, policy_version 595143 (0.0008) [2023-12-26 04:22:17,054][123091] Updated weights for policy 0, policy_version 599271 (0.0005) [2023-12-26 04:22:17,070][123090] Updated weights for policy 1, policy_version 595153 (0.0007) [2023-12-26 04:22:17,129][123090] Updated weights for policy 1, policy_version 595163 (0.0009) [2023-12-26 04:22:17,782][123091] Updated weights for policy 0, policy_version 599281 (0.0005) [2023-12-26 04:22:17,800][123090] Updated weights for policy 1, policy_version 595174 (0.0011) [2023-12-26 04:22:17,839][123091] Updated weights for policy 0, policy_version 599291 (0.0006) [2023-12-26 04:22:17,858][123090] Updated weights for policy 1, policy_version 595185 (0.0009) [2023-12-26 04:22:17,887][123091] Updated weights for policy 0, policy_version 599301 (0.0005) [2023-12-26 04:22:17,907][123090] Updated weights for policy 1, policy_version 595195 (0.0010) [2023-12-26 04:22:17,935][123091] Updated weights for policy 0, policy_version 599311 (0.0005) [2023-12-26 04:22:18,661][123091] Updated weights for policy 0, policy_version 599321 (0.0009) [2023-12-26 04:22:18,730][123090] Updated weights for policy 1, policy_version 595205 (0.0007) [2023-12-26 04:22:18,732][123091] Updated weights for policy 0, policy_version 599331 (0.0010) [2023-12-26 04:22:18,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 305799168. Throughput: 0: 8692.1, 1: 9053.7. Samples: 305818680. Policy #0 lag: (min: 13.0, avg: 19.4, max: 45.0) [2023-12-26 04:22:18,785][121949] Avg episode reward: [(0, '5817.544'), (1, '5531.336')] [2023-12-26 04:22:18,803][123090] Updated weights for policy 1, policy_version 595215 (0.0006) [2023-12-26 04:22:18,804][123091] Updated weights for policy 0, policy_version 599341 (0.0009) [2023-12-26 04:22:18,872][123090] Updated weights for policy 1, policy_version 595225 (0.0006) [2023-12-26 04:22:19,599][123090] Updated weights for policy 1, policy_version 595235 (0.0007) [2023-12-26 04:22:19,664][123090] Updated weights for policy 1, policy_version 595245 (0.0011) [2023-12-26 04:22:19,671][123091] Updated weights for policy 0, policy_version 599351 (0.0007) [2023-12-26 04:22:19,725][123090] Updated weights for policy 1, policy_version 595255 (0.0011) [2023-12-26 04:22:19,732][123091] Updated weights for policy 0, policy_version 599361 (0.0006) [2023-12-26 04:22:19,798][123091] Updated weights for policy 0, policy_version 599371 (0.0007) [2023-12-26 04:22:20,563][123090] Updated weights for policy 1, policy_version 595265 (0.0011) [2023-12-26 04:22:20,630][123090] Updated weights for policy 1, policy_version 595275 (0.0011) [2023-12-26 04:22:20,698][123090] Updated weights for policy 1, policy_version 595285 (0.0011) [2023-12-26 04:22:20,706][123091] Updated weights for policy 0, policy_version 599381 (0.0007) [2023-12-26 04:22:20,763][123090] Updated weights for policy 1, policy_version 595295 (0.0011) [2023-12-26 04:22:20,769][123091] Updated weights for policy 0, policy_version 599391 (0.0007) [2023-12-26 04:22:20,837][123091] Updated weights for policy 0, policy_version 599401 (0.0009) [2023-12-26 04:22:21,573][123090] Updated weights for policy 1, policy_version 595305 (0.0009) [2023-12-26 04:22:21,634][123090] Updated weights for policy 1, policy_version 595315 (0.0009) [2023-12-26 04:22:21,637][123091] Updated weights for policy 0, policy_version 599411 (0.0008) [2023-12-26 04:22:21,706][123090] Updated weights for policy 1, policy_version 595325 (0.0009) [2023-12-26 04:22:21,709][123091] Updated weights for policy 0, policy_version 599421 (0.0008) [2023-12-26 04:22:21,782][123091] Updated weights for policy 0, policy_version 599431 (0.0009) [2023-12-26 04:22:22,536][123090] Updated weights for policy 1, policy_version 595335 (0.0007) [2023-12-26 04:22:22,559][123091] Updated weights for policy 0, policy_version 599441 (0.0005) [2023-12-26 04:22:22,603][123090] Updated weights for policy 1, policy_version 595345 (0.0008) [2023-12-26 04:22:22,627][123091] Updated weights for policy 0, policy_version 599451 (0.0010) [2023-12-26 04:22:22,666][123090] Updated weights for policy 1, policy_version 595355 (0.0008) [2023-12-26 04:22:22,682][123091] Updated weights for policy 0, policy_version 599461 (0.0009) [2023-12-26 04:22:22,738][123091] Updated weights for policy 0, policy_version 599471 (0.0009) [2023-12-26 04:22:23,437][123090] Updated weights for policy 1, policy_version 595365 (0.0008) [2023-12-26 04:22:23,493][123090] Updated weights for policy 1, policy_version 595375 (0.0010) [2023-12-26 04:22:23,556][123090] Updated weights for policy 1, policy_version 595385 (0.0010) [2023-12-26 04:22:23,595][123091] Updated weights for policy 0, policy_version 599481 (0.0007) [2023-12-26 04:22:23,650][123091] Updated weights for policy 0, policy_version 599491 (0.0010) [2023-12-26 04:22:23,705][123091] Updated weights for policy 0, policy_version 599501 (0.0010) [2023-12-26 04:22:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 305897472. Throughput: 0: 8684.2, 1: 9037.6. Samples: 305869004. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:23,785][121949] Avg episode reward: [(0, '5778.804'), (1, '5241.524')] [2023-12-26 04:22:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000599504_153477120.pth... [2023-12-26 04:22:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000595392_152420352.pth... [2023-12-26 04:22:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000598480_153214976.pth [2023-12-26 04:22:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000594304_152141824.pth [2023-12-26 04:22:24,362][123090] Updated weights for policy 1, policy_version 595395 (0.0010) [2023-12-26 04:22:24,425][123090] Updated weights for policy 1, policy_version 595405 (0.0010) [2023-12-26 04:22:24,488][123090] Updated weights for policy 1, policy_version 595415 (0.0011) [2023-12-26 04:22:24,548][123091] Updated weights for policy 0, policy_version 599511 (0.0011) [2023-12-26 04:22:24,609][123091] Updated weights for policy 0, policy_version 599521 (0.0011) [2023-12-26 04:22:24,673][123091] Updated weights for policy 0, policy_version 599531 (0.0011) [2023-12-26 04:22:25,294][123090] Updated weights for policy 1, policy_version 595425 (0.0010) [2023-12-26 04:22:25,349][123090] Updated weights for policy 1, policy_version 595435 (0.0010) [2023-12-26 04:22:25,399][123090] Updated weights for policy 1, policy_version 595445 (0.0010) [2023-12-26 04:22:25,447][123090] Updated weights for policy 1, policy_version 595455 (0.0010) [2023-12-26 04:22:25,475][123091] Updated weights for policy 0, policy_version 599541 (0.0008) [2023-12-26 04:22:25,524][123091] Updated weights for policy 0, policy_version 599551 (0.0005) [2023-12-26 04:22:25,580][123091] Updated weights for policy 0, policy_version 599561 (0.0008) [2023-12-26 04:22:26,193][123090] Updated weights for policy 1, policy_version 595465 (0.0006) [2023-12-26 04:22:26,262][123090] Updated weights for policy 1, policy_version 595475 (0.0006) [2023-12-26 04:22:26,324][123090] Updated weights for policy 1, policy_version 595485 (0.0005) [2023-12-26 04:22:26,387][123091] Updated weights for policy 0, policy_version 599571 (0.0010) [2023-12-26 04:22:26,431][123091] Updated weights for policy 0, policy_version 599581 (0.0010) [2023-12-26 04:22:26,490][123091] Updated weights for policy 0, policy_version 599591 (0.0009) [2023-12-26 04:22:27,009][123090] Updated weights for policy 1, policy_version 595495 (0.0008) [2023-12-26 04:22:27,056][123090] Updated weights for policy 1, policy_version 595505 (0.0009) [2023-12-26 04:22:27,105][123090] Updated weights for policy 1, policy_version 595515 (0.0009) [2023-12-26 04:22:27,272][123091] Updated weights for policy 0, policy_version 599601 (0.0007) [2023-12-26 04:22:27,342][123091] Updated weights for policy 0, policy_version 599611 (0.0009) [2023-12-26 04:22:27,398][123091] Updated weights for policy 0, policy_version 599621 (0.0010) [2023-12-26 04:22:27,457][123091] Updated weights for policy 0, policy_version 599631 (0.0009) [2023-12-26 04:22:27,906][123090] Updated weights for policy 1, policy_version 595525 (0.0007) [2023-12-26 04:22:27,954][123090] Updated weights for policy 1, policy_version 595535 (0.0005) [2023-12-26 04:22:27,998][123090] Updated weights for policy 1, policy_version 595545 (0.0005) [2023-12-26 04:22:28,350][123091] Updated weights for policy 0, policy_version 599641 (0.0008) [2023-12-26 04:22:28,420][123091] Updated weights for policy 0, policy_version 599651 (0.0006) [2023-12-26 04:22:28,483][123091] Updated weights for policy 0, policy_version 599661 (0.0005) [2023-12-26 04:22:28,721][123090] Updated weights for policy 1, policy_version 595555 (0.0006) [2023-12-26 04:22:28,771][123090] Updated weights for policy 1, policy_version 595565 (0.0010) [2023-12-26 04:22:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 305979392. Throughput: 0: 8701.5, 1: 9107.6. Samples: 305975880. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:28,785][121949] Avg episode reward: [(0, '5712.701'), (1, '5276.936')] [2023-12-26 04:22:28,820][123090] Updated weights for policy 1, policy_version 595575 (0.0009) [2023-12-26 04:22:29,294][123091] Updated weights for policy 0, policy_version 599671 (0.0008) [2023-12-26 04:22:29,350][123091] Updated weights for policy 0, policy_version 599681 (0.0008) [2023-12-26 04:22:29,421][123091] Updated weights for policy 0, policy_version 599691 (0.0009) [2023-12-26 04:22:29,585][123090] Updated weights for policy 1, policy_version 595585 (0.0009) [2023-12-26 04:22:29,647][123090] Updated weights for policy 1, policy_version 595595 (0.0009) [2023-12-26 04:22:29,717][123090] Updated weights for policy 1, policy_version 595605 (0.0009) [2023-12-26 04:22:29,766][123090] Updated weights for policy 1, policy_version 595615 (0.0009) [2023-12-26 04:22:30,267][123091] Updated weights for policy 0, policy_version 599701 (0.0010) [2023-12-26 04:22:30,318][123091] Updated weights for policy 0, policy_version 599711 (0.0009) [2023-12-26 04:22:30,366][123091] Updated weights for policy 0, policy_version 599721 (0.0010) [2023-12-26 04:22:30,553][123090] Updated weights for policy 1, policy_version 595625 (0.0006) [2023-12-26 04:22:30,611][123090] Updated weights for policy 1, policy_version 595635 (0.0005) [2023-12-26 04:22:30,677][123090] Updated weights for policy 1, policy_version 595645 (0.0008) [2023-12-26 04:22:31,294][123091] Updated weights for policy 0, policy_version 599731 (0.0009) [2023-12-26 04:22:31,311][123090] Updated weights for policy 1, policy_version 595655 (0.0007) [2023-12-26 04:22:31,362][123091] Updated weights for policy 0, policy_version 599741 (0.0008) [2023-12-26 04:22:31,377][123090] Updated weights for policy 1, policy_version 595665 (0.0007) [2023-12-26 04:22:31,429][123091] Updated weights for policy 0, policy_version 599751 (0.0008) [2023-12-26 04:22:31,443][123090] Updated weights for policy 1, policy_version 595675 (0.0008) [2023-12-26 04:22:32,191][123091] Updated weights for policy 0, policy_version 599761 (0.0008) [2023-12-26 04:22:32,253][123091] Updated weights for policy 0, policy_version 599771 (0.0011) [2023-12-26 04:22:32,270][123090] Updated weights for policy 1, policy_version 595685 (0.0008) [2023-12-26 04:22:32,319][123091] Updated weights for policy 0, policy_version 599781 (0.0011) [2023-12-26 04:22:32,330][123090] Updated weights for policy 1, policy_version 595695 (0.0006) [2023-12-26 04:22:32,385][123091] Updated weights for policy 0, policy_version 599791 (0.0009) [2023-12-26 04:22:32,392][123090] Updated weights for policy 1, policy_version 595705 (0.0007) [2023-12-26 04:22:33,153][123091] Updated weights for policy 0, policy_version 599801 (0.0010) [2023-12-26 04:22:33,199][123090] Updated weights for policy 1, policy_version 595715 (0.0010) [2023-12-26 04:22:33,200][123091] Updated weights for policy 0, policy_version 599811 (0.0010) [2023-12-26 04:22:33,250][123091] Updated weights for policy 0, policy_version 599821 (0.0010) [2023-12-26 04:22:33,261][123090] Updated weights for policy 1, policy_version 595725 (0.0006) [2023-12-26 04:22:33,311][123090] Updated weights for policy 1, policy_version 595735 (0.0008) [2023-12-26 04:22:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 306069504. Throughput: 0: 8705.0, 1: 9127.7. Samples: 306081288. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:33,785][121949] Avg episode reward: [(0, '5688.145'), (1, '5473.449')] [2023-12-26 04:22:34,072][123091] Updated weights for policy 0, policy_version 599831 (0.0008) [2023-12-26 04:22:34,127][123091] Updated weights for policy 0, policy_version 599841 (0.0006) [2023-12-26 04:22:34,151][123090] Updated weights for policy 1, policy_version 595745 (0.0009) [2023-12-26 04:22:34,189][123091] Updated weights for policy 0, policy_version 599851 (0.0009) [2023-12-26 04:22:34,219][123090] Updated weights for policy 1, policy_version 595755 (0.0008) [2023-12-26 04:22:34,292][123090] Updated weights for policy 1, policy_version 595765 (0.0009) [2023-12-26 04:22:34,359][123090] Updated weights for policy 1, policy_version 595775 (0.0010) [2023-12-26 04:22:35,019][123091] Updated weights for policy 0, policy_version 599861 (0.0010) [2023-12-26 04:22:35,074][123091] Updated weights for policy 0, policy_version 599871 (0.0009) [2023-12-26 04:22:35,122][123091] Updated weights for policy 0, policy_version 599881 (0.0009) [2023-12-26 04:22:35,187][123090] Updated weights for policy 1, policy_version 595785 (0.0009) [2023-12-26 04:22:35,246][123090] Updated weights for policy 1, policy_version 595795 (0.0010) [2023-12-26 04:22:35,300][123090] Updated weights for policy 1, policy_version 595805 (0.0009) [2023-12-26 04:22:35,830][123091] Updated weights for policy 0, policy_version 599891 (0.0008) [2023-12-26 04:22:35,885][123091] Updated weights for policy 0, policy_version 599901 (0.0005) [2023-12-26 04:22:35,931][123091] Updated weights for policy 0, policy_version 599911 (0.0005) [2023-12-26 04:22:36,120][123090] Updated weights for policy 1, policy_version 595815 (0.0008) [2023-12-26 04:22:36,195][123090] Updated weights for policy 1, policy_version 595825 (0.0008) [2023-12-26 04:22:36,267][123090] Updated weights for policy 1, policy_version 595835 (0.0010) [2023-12-26 04:22:36,672][123091] Updated weights for policy 0, policy_version 599921 (0.0005) [2023-12-26 04:22:36,740][123091] Updated weights for policy 0, policy_version 599931 (0.0006) [2023-12-26 04:22:36,805][123091] Updated weights for policy 0, policy_version 599941 (0.0010) [2023-12-26 04:22:36,870][123091] Updated weights for policy 0, policy_version 599951 (0.0009) [2023-12-26 04:22:37,100][123090] Updated weights for policy 1, policy_version 595845 (0.0010) [2023-12-26 04:22:37,157][123090] Updated weights for policy 1, policy_version 595855 (0.0010) [2023-12-26 04:22:37,216][123090] Updated weights for policy 1, policy_version 595865 (0.0008) [2023-12-26 04:22:37,675][123091] Updated weights for policy 0, policy_version 599961 (0.0009) [2023-12-26 04:22:37,736][123091] Updated weights for policy 0, policy_version 599971 (0.0010) [2023-12-26 04:22:37,808][123091] Updated weights for policy 0, policy_version 599981 (0.0010) [2023-12-26 04:22:38,066][123090] Updated weights for policy 1, policy_version 595875 (0.0009) [2023-12-26 04:22:38,132][123090] Updated weights for policy 1, policy_version 595885 (0.0009) [2023-12-26 04:22:38,195][123090] Updated weights for policy 1, policy_version 595895 (0.0009) [2023-12-26 04:22:38,623][123091] Updated weights for policy 0, policy_version 599991 (0.0010) [2023-12-26 04:22:38,675][123091] Updated weights for policy 0, policy_version 600001 (0.0010) [2023-12-26 04:22:38,724][123091] Updated weights for policy 0, policy_version 600011 (0.0009) [2023-12-26 04:22:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 306159616. Throughput: 0: 8753.8, 1: 9132.3. Samples: 306134408. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:38,785][121949] Avg episode reward: [(0, '5830.091'), (1, '5614.436')] [2023-12-26 04:22:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000600016_153608192.pth... [2023-12-26 04:22:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000595904_152551424.pth... [2023-12-26 04:22:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000598992_153346048.pth [2023-12-26 04:22:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000594880_152289280.pth [2023-12-26 04:22:38,985][123090] Updated weights for policy 1, policy_version 595905 (0.0009) [2023-12-26 04:22:39,055][123090] Updated weights for policy 1, policy_version 595915 (0.0009) [2023-12-26 04:22:39,118][123090] Updated weights for policy 1, policy_version 595925 (0.0009) [2023-12-26 04:22:39,179][123090] Updated weights for policy 1, policy_version 595935 (0.0008) [2023-12-26 04:22:39,603][123091] Updated weights for policy 0, policy_version 600021 (0.0009) [2023-12-26 04:22:39,674][123091] Updated weights for policy 0, policy_version 600031 (0.0009) [2023-12-26 04:22:39,737][123091] Updated weights for policy 0, policy_version 600041 (0.0010) [2023-12-26 04:22:40,031][123090] Updated weights for policy 1, policy_version 595945 (0.0009) [2023-12-26 04:22:40,101][123090] Updated weights for policy 1, policy_version 595955 (0.0009) [2023-12-26 04:22:40,165][123090] Updated weights for policy 1, policy_version 595965 (0.0010) [2023-12-26 04:22:40,592][123091] Updated weights for policy 0, policy_version 600051 (0.0010) [2023-12-26 04:22:40,649][123091] Updated weights for policy 0, policy_version 600061 (0.0009) [2023-12-26 04:22:40,707][123091] Updated weights for policy 0, policy_version 600071 (0.0009) [2023-12-26 04:22:40,993][123090] Updated weights for policy 1, policy_version 595975 (0.0010) [2023-12-26 04:22:41,061][123090] Updated weights for policy 1, policy_version 595985 (0.0007) [2023-12-26 04:22:41,132][123090] Updated weights for policy 1, policy_version 595995 (0.0009) [2023-12-26 04:22:41,553][123091] Updated weights for policy 0, policy_version 600081 (0.0009) [2023-12-26 04:22:41,613][123091] Updated weights for policy 0, policy_version 600091 (0.0007) [2023-12-26 04:22:41,687][123091] Updated weights for policy 0, policy_version 600101 (0.0010) [2023-12-26 04:22:41,752][123091] Updated weights for policy 0, policy_version 600111 (0.0009) [2023-12-26 04:22:42,003][123090] Updated weights for policy 1, policy_version 596005 (0.0009) [2023-12-26 04:22:42,057][123090] Updated weights for policy 1, policy_version 596015 (0.0009) [2023-12-26 04:22:42,113][123090] Updated weights for policy 1, policy_version 596025 (0.0010) [2023-12-26 04:22:42,538][123091] Updated weights for policy 0, policy_version 600121 (0.0006) [2023-12-26 04:22:42,606][123091] Updated weights for policy 0, policy_version 600131 (0.0006) [2023-12-26 04:22:42,673][123091] Updated weights for policy 0, policy_version 600141 (0.0010) [2023-12-26 04:22:42,982][123090] Updated weights for policy 1, policy_version 596035 (0.0010) [2023-12-26 04:22:43,050][123090] Updated weights for policy 1, policy_version 596045 (0.0011) [2023-12-26 04:22:43,122][123090] Updated weights for policy 1, policy_version 596055 (0.0011) [2023-12-26 04:22:43,474][123091] Updated weights for policy 0, policy_version 600151 (0.0010) [2023-12-26 04:22:43,528][123091] Updated weights for policy 0, policy_version 600161 (0.0010) [2023-12-26 04:22:43,575][123091] Updated weights for policy 0, policy_version 600171 (0.0010) [2023-12-26 04:22:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 306241536. Throughput: 0: 8630.5, 1: 8952.2. Samples: 306234632. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:43,784][121949] Avg episode reward: [(0, '5859.535'), (1, '5659.431')] [2023-12-26 04:22:43,914][123090] Updated weights for policy 1, policy_version 596065 (0.0011) [2023-12-26 04:22:43,977][123090] Updated weights for policy 1, policy_version 596075 (0.0010) [2023-12-26 04:22:44,036][123090] Updated weights for policy 1, policy_version 596085 (0.0010) [2023-12-26 04:22:44,102][123090] Updated weights for policy 1, policy_version 596095 (0.0010) [2023-12-26 04:22:44,285][123091] Updated weights for policy 0, policy_version 600181 (0.0008) [2023-12-26 04:22:44,353][123091] Updated weights for policy 0, policy_version 600191 (0.0005) [2023-12-26 04:22:44,424][123091] Updated weights for policy 0, policy_version 600201 (0.0005) [2023-12-26 04:22:44,920][123090] Updated weights for policy 1, policy_version 596105 (0.0010) [2023-12-26 04:22:44,987][123090] Updated weights for policy 1, policy_version 596115 (0.0011) [2023-12-26 04:22:45,055][123090] Updated weights for policy 1, policy_version 596125 (0.0011) [2023-12-26 04:22:45,125][123091] Updated weights for policy 0, policy_version 600211 (0.0007) [2023-12-26 04:22:45,182][123091] Updated weights for policy 0, policy_version 600221 (0.0011) [2023-12-26 04:22:45,244][123091] Updated weights for policy 0, policy_version 600231 (0.0008) [2023-12-26 04:22:45,911][123090] Updated weights for policy 1, policy_version 596135 (0.0007) [2023-12-26 04:22:45,979][123090] Updated weights for policy 1, policy_version 596145 (0.0008) [2023-12-26 04:22:46,005][123091] Updated weights for policy 0, policy_version 600241 (0.0007) [2023-12-26 04:22:46,042][123090] Updated weights for policy 1, policy_version 596155 (0.0008) [2023-12-26 04:22:46,075][123091] Updated weights for policy 0, policy_version 600251 (0.0011) [2023-12-26 04:22:46,150][123091] Updated weights for policy 0, policy_version 600261 (0.0011) [2023-12-26 04:22:46,205][123091] Updated weights for policy 0, policy_version 600271 (0.0011) [2023-12-26 04:22:46,694][123090] Updated weights for policy 1, policy_version 596165 (0.0006) [2023-12-26 04:22:46,750][123090] Updated weights for policy 1, policy_version 596175 (0.0005) [2023-12-26 04:22:46,800][123090] Updated weights for policy 1, policy_version 596185 (0.0005) [2023-12-26 04:22:46,882][123091] Updated weights for policy 0, policy_version 600281 (0.0011) [2023-12-26 04:22:46,938][123091] Updated weights for policy 0, policy_version 600291 (0.0010) [2023-12-26 04:22:46,990][123091] Updated weights for policy 0, policy_version 600301 (0.0010) [2023-12-26 04:22:47,511][123090] Updated weights for policy 1, policy_version 596195 (0.0005) [2023-12-26 04:22:47,571][123090] Updated weights for policy 1, policy_version 596205 (0.0005) [2023-12-26 04:22:47,633][123090] Updated weights for policy 1, policy_version 596215 (0.0006) [2023-12-26 04:22:47,689][123091] Updated weights for policy 0, policy_version 600311 (0.0005) [2023-12-26 04:22:47,751][123091] Updated weights for policy 0, policy_version 600321 (0.0005) [2023-12-26 04:22:47,828][123091] Updated weights for policy 0, policy_version 600331 (0.0005) [2023-12-26 04:22:48,357][123090] Updated weights for policy 1, policy_version 596225 (0.0008) [2023-12-26 04:22:48,429][123090] Updated weights for policy 1, policy_version 596235 (0.0008) [2023-12-26 04:22:48,492][123091] Updated weights for policy 0, policy_version 600341 (0.0005) [2023-12-26 04:22:48,495][123090] Updated weights for policy 1, policy_version 596245 (0.0009) [2023-12-26 04:22:48,542][123091] Updated weights for policy 0, policy_version 600351 (0.0005) [2023-12-26 04:22:48,564][123090] Updated weights for policy 1, policy_version 596255 (0.0010) [2023-12-26 04:22:48,606][123091] Updated weights for policy 0, policy_version 600361 (0.0007) [2023-12-26 04:22:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 306339840. Throughput: 0: 8779.2, 1: 8969.5. Samples: 306347776. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:48,784][121949] Avg episode reward: [(0, '6015.073'), (1, '5779.933')] [2023-12-26 04:22:49,300][123090] Updated weights for policy 1, policy_version 596265 (0.0009) [2023-12-26 04:22:49,366][123090] Updated weights for policy 1, policy_version 596275 (0.0009) [2023-12-26 04:22:49,417][123091] Updated weights for policy 0, policy_version 600371 (0.0011) [2023-12-26 04:22:49,425][123090] Updated weights for policy 1, policy_version 596285 (0.0008) [2023-12-26 04:22:49,479][123091] Updated weights for policy 0, policy_version 600381 (0.0010) [2023-12-26 04:22:49,548][123091] Updated weights for policy 0, policy_version 600391 (0.0010) [2023-12-26 04:22:50,294][123090] Updated weights for policy 1, policy_version 596295 (0.0009) [2023-12-26 04:22:50,353][123091] Updated weights for policy 0, policy_version 600401 (0.0010) [2023-12-26 04:22:50,366][123090] Updated weights for policy 1, policy_version 596305 (0.0009) [2023-12-26 04:22:50,417][123091] Updated weights for policy 0, policy_version 600411 (0.0010) [2023-12-26 04:22:50,424][123090] Updated weights for policy 1, policy_version 596315 (0.0009) [2023-12-26 04:22:50,472][123091] Updated weights for policy 0, policy_version 600421 (0.0010) [2023-12-26 04:22:50,527][123091] Updated weights for policy 0, policy_version 600431 (0.0010) [2023-12-26 04:22:51,300][123090] Updated weights for policy 1, policy_version 596325 (0.0008) [2023-12-26 04:22:51,372][123090] Updated weights for policy 1, policy_version 596335 (0.0008) [2023-12-26 04:22:51,377][123091] Updated weights for policy 0, policy_version 600441 (0.0010) [2023-12-26 04:22:51,431][123090] Updated weights for policy 1, policy_version 596345 (0.0007) [2023-12-26 04:22:51,436][123091] Updated weights for policy 0, policy_version 600451 (0.0009) [2023-12-26 04:22:51,483][123091] Updated weights for policy 0, policy_version 600461 (0.0008) [2023-12-26 04:22:52,296][123090] Updated weights for policy 1, policy_version 596355 (0.0007) [2023-12-26 04:22:52,323][123091] Updated weights for policy 0, policy_version 600471 (0.0010) [2023-12-26 04:22:52,364][123090] Updated weights for policy 1, policy_version 596365 (0.0009) [2023-12-26 04:22:52,390][123091] Updated weights for policy 0, policy_version 600481 (0.0007) [2023-12-26 04:22:52,420][123090] Updated weights for policy 1, policy_version 596375 (0.0009) [2023-12-26 04:22:52,445][123091] Updated weights for policy 0, policy_version 600491 (0.0005) [2023-12-26 04:22:53,131][123091] Updated weights for policy 0, policy_version 600501 (0.0005) [2023-12-26 04:22:53,184][123091] Updated weights for policy 0, policy_version 600511 (0.0005) [2023-12-26 04:22:53,244][123091] Updated weights for policy 0, policy_version 600521 (0.0005) [2023-12-26 04:22:53,329][123090] Updated weights for policy 1, policy_version 596385 (0.0008) [2023-12-26 04:22:53,383][123090] Updated weights for policy 1, policy_version 596395 (0.0010) [2023-12-26 04:22:53,437][123090] Updated weights for policy 1, policy_version 596405 (0.0010) [2023-12-26 04:22:53,490][123090] Updated weights for policy 1, policy_version 596416 (0.0010) [2023-12-26 04:22:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 306421760. Throughput: 0: 8819.5, 1: 8870.4. Samples: 306397956. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:53,785][121949] Avg episode reward: [(0, '5998.986'), (1, '5733.000')] [2023-12-26 04:22:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000596416_152682496.pth... [2023-12-26 04:22:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000600528_153739264.pth... [2023-12-26 04:22:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000595392_152420352.pth [2023-12-26 04:22:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000599504_153477120.pth [2023-12-26 04:22:53,859][123091] Updated weights for policy 0, policy_version 600531 (0.0005) [2023-12-26 04:22:53,938][123091] Updated weights for policy 0, policy_version 600541 (0.0008) [2023-12-26 04:22:53,989][123091] Updated weights for policy 0, policy_version 600551 (0.0010) [2023-12-26 04:22:54,248][123090] Updated weights for policy 1, policy_version 596426 (0.0007) [2023-12-26 04:22:54,311][123090] Updated weights for policy 1, policy_version 596436 (0.0010) [2023-12-26 04:22:54,378][123090] Updated weights for policy 1, policy_version 596446 (0.0009) [2023-12-26 04:22:54,778][123091] Updated weights for policy 0, policy_version 600561 (0.0010) [2023-12-26 04:22:54,850][123091] Updated weights for policy 0, policy_version 600571 (0.0007) [2023-12-26 04:22:54,923][123091] Updated weights for policy 0, policy_version 600581 (0.0007) [2023-12-26 04:22:54,990][123091] Updated weights for policy 0, policy_version 600591 (0.0006) [2023-12-26 04:22:55,144][123090] Updated weights for policy 1, policy_version 596456 (0.0010) [2023-12-26 04:22:55,196][123090] Updated weights for policy 1, policy_version 596466 (0.0009) [2023-12-26 04:22:55,257][123090] Updated weights for policy 1, policy_version 596476 (0.0009) [2023-12-26 04:22:55,663][123091] Updated weights for policy 0, policy_version 600601 (0.0005) [2023-12-26 04:22:55,727][123091] Updated weights for policy 0, policy_version 600611 (0.0005) [2023-12-26 04:22:55,795][123091] Updated weights for policy 0, policy_version 600621 (0.0005) [2023-12-26 04:22:56,065][123090] Updated weights for policy 1, policy_version 596486 (0.0007) [2023-12-26 04:22:56,118][123090] Updated weights for policy 1, policy_version 596496 (0.0005) [2023-12-26 04:22:56,188][123090] Updated weights for policy 1, policy_version 596506 (0.0005) [2023-12-26 04:22:56,418][123091] Updated weights for policy 0, policy_version 600631 (0.0009) [2023-12-26 04:22:56,485][123091] Updated weights for policy 0, policy_version 600641 (0.0010) [2023-12-26 04:22:56,552][123091] Updated weights for policy 0, policy_version 600651 (0.0010) [2023-12-26 04:22:56,788][123090] Updated weights for policy 1, policy_version 596516 (0.0006) [2023-12-26 04:22:56,854][123090] Updated weights for policy 1, policy_version 596526 (0.0005) [2023-12-26 04:22:56,911][123090] Updated weights for policy 1, policy_version 596536 (0.0005) [2023-12-26 04:22:57,311][123091] Updated weights for policy 0, policy_version 600661 (0.0009) [2023-12-26 04:22:57,365][123091] Updated weights for policy 0, policy_version 600671 (0.0009) [2023-12-26 04:22:57,411][123091] Updated weights for policy 0, policy_version 600682 (0.0007) [2023-12-26 04:22:57,593][123090] Updated weights for policy 1, policy_version 596546 (0.0006) [2023-12-26 04:22:57,647][123090] Updated weights for policy 1, policy_version 596556 (0.0005) [2023-12-26 04:22:57,699][123090] Updated weights for policy 1, policy_version 596566 (0.0005) [2023-12-26 04:22:57,768][123090] Updated weights for policy 1, policy_version 596576 (0.0007) [2023-12-26 04:22:58,267][123091] Updated weights for policy 0, policy_version 600692 (0.0006) [2023-12-26 04:22:58,335][123091] Updated weights for policy 0, policy_version 600702 (0.0008) [2023-12-26 04:22:58,406][123091] Updated weights for policy 0, policy_version 600712 (0.0009) [2023-12-26 04:22:58,529][123090] Updated weights for policy 1, policy_version 596586 (0.0010) [2023-12-26 04:22:58,602][123090] Updated weights for policy 1, policy_version 596596 (0.0009) [2023-12-26 04:22:58,679][123090] Updated weights for policy 1, policy_version 596606 (0.0011) [2023-12-26 04:22:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 306520064. Throughput: 0: 8952.4, 1: 8900.0. Samples: 306510588. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:22:58,785][121949] Avg episode reward: [(0, '5931.466'), (1, '5720.367')] [2023-12-26 04:22:59,327][123091] Updated weights for policy 0, policy_version 600722 (0.0010) [2023-12-26 04:22:59,390][123091] Updated weights for policy 0, policy_version 600732 (0.0008) [2023-12-26 04:22:59,460][123091] Updated weights for policy 0, policy_version 600742 (0.0006) [2023-12-26 04:22:59,493][123090] Updated weights for policy 1, policy_version 596616 (0.0008) [2023-12-26 04:22:59,526][123091] Updated weights for policy 0, policy_version 600752 (0.0007) [2023-12-26 04:22:59,553][123090] Updated weights for policy 1, policy_version 596626 (0.0009) [2023-12-26 04:22:59,616][123090] Updated weights for policy 1, policy_version 596636 (0.0009) [2023-12-26 04:23:00,298][123091] Updated weights for policy 0, policy_version 600762 (0.0010) [2023-12-26 04:23:00,347][123091] Updated weights for policy 0, policy_version 600772 (0.0009) [2023-12-26 04:23:00,397][123090] Updated weights for policy 1, policy_version 596646 (0.0007) [2023-12-26 04:23:00,400][123091] Updated weights for policy 0, policy_version 600782 (0.0009) [2023-12-26 04:23:00,444][123090] Updated weights for policy 1, policy_version 596656 (0.0009) [2023-12-26 04:23:00,494][123090] Updated weights for policy 1, policy_version 596667 (0.0009) [2023-12-26 04:23:01,187][123091] Updated weights for policy 0, policy_version 600792 (0.0008) [2023-12-26 04:23:01,235][123091] Updated weights for policy 0, policy_version 600802 (0.0008) [2023-12-26 04:23:01,281][123090] Updated weights for policy 1, policy_version 596677 (0.0010) [2023-12-26 04:23:01,298][123091] Updated weights for policy 0, policy_version 600812 (0.0009) [2023-12-26 04:23:01,333][123090] Updated weights for policy 1, policy_version 596687 (0.0010) [2023-12-26 04:23:01,403][123090] Updated weights for policy 1, policy_version 596697 (0.0010) [2023-12-26 04:23:02,190][123091] Updated weights for policy 0, policy_version 600822 (0.0006) [2023-12-26 04:23:02,205][123090] Updated weights for policy 1, policy_version 596707 (0.0007) [2023-12-26 04:23:02,252][123091] Updated weights for policy 0, policy_version 600832 (0.0006) [2023-12-26 04:23:02,269][123090] Updated weights for policy 1, policy_version 596717 (0.0008) [2023-12-26 04:23:02,316][123091] Updated weights for policy 0, policy_version 600842 (0.0007) [2023-12-26 04:23:02,330][123090] Updated weights for policy 1, policy_version 596727 (0.0009) [2023-12-26 04:23:03,014][123091] Updated weights for policy 0, policy_version 600852 (0.0006) [2023-12-26 04:23:03,064][123091] Updated weights for policy 0, policy_version 600862 (0.0006) [2023-12-26 04:23:03,109][123091] Updated weights for policy 0, policy_version 600872 (0.0005) [2023-12-26 04:23:03,146][123090] Updated weights for policy 1, policy_version 596737 (0.0009) [2023-12-26 04:23:03,198][123090] Updated weights for policy 1, policy_version 596747 (0.0006) [2023-12-26 04:23:03,251][123090] Updated weights for policy 1, policy_version 596757 (0.0005) [2023-12-26 04:23:03,305][123090] Updated weights for policy 1, policy_version 596767 (0.0007) [2023-12-26 04:23:03,759][123091] Updated weights for policy 0, policy_version 600882 (0.0007) [2023-12-26 04:23:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 306601984. Throughput: 0: 8881.6, 1: 8829.4. Samples: 306615676. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:03,785][121949] Avg episode reward: [(0, '5971.808'), (1, '5784.788')] [2023-12-26 04:23:03,809][123091] Updated weights for policy 0, policy_version 600892 (0.0010) [2023-12-26 04:23:03,878][123091] Updated weights for policy 0, policy_version 600902 (0.0011) [2023-12-26 04:23:03,938][123091] Updated weights for policy 0, policy_version 600912 (0.0011) [2023-12-26 04:23:04,128][123090] Updated weights for policy 1, policy_version 596777 (0.0008) [2023-12-26 04:23:04,184][123090] Updated weights for policy 1, policy_version 596787 (0.0009) [2023-12-26 04:23:04,232][123090] Updated weights for policy 1, policy_version 596797 (0.0009) [2023-12-26 04:23:04,730][123091] Updated weights for policy 0, policy_version 600922 (0.0011) [2023-12-26 04:23:04,789][123091] Updated weights for policy 0, policy_version 600932 (0.0010) [2023-12-26 04:23:04,844][123091] Updated weights for policy 0, policy_version 600942 (0.0010) [2023-12-26 04:23:05,062][123090] Updated weights for policy 1, policy_version 596807 (0.0008) [2023-12-26 04:23:05,113][123090] Updated weights for policy 1, policy_version 596817 (0.0008) [2023-12-26 04:23:05,161][123090] Updated weights for policy 1, policy_version 596827 (0.0008) [2023-12-26 04:23:05,666][123091] Updated weights for policy 0, policy_version 600952 (0.0010) [2023-12-26 04:23:05,724][123091] Updated weights for policy 0, policy_version 600962 (0.0010) [2023-12-26 04:23:05,778][123091] Updated weights for policy 0, policy_version 600972 (0.0010) [2023-12-26 04:23:05,999][123090] Updated weights for policy 1, policy_version 596837 (0.0007) [2023-12-26 04:23:06,068][123090] Updated weights for policy 1, policy_version 596847 (0.0005) [2023-12-26 04:23:06,125][123090] Updated weights for policy 1, policy_version 596857 (0.0007) [2023-12-26 04:23:06,642][123091] Updated weights for policy 0, policy_version 600982 (0.0011) [2023-12-26 04:23:06,717][123091] Updated weights for policy 0, policy_version 600992 (0.0011) [2023-12-26 04:23:06,784][123091] Updated weights for policy 0, policy_version 601002 (0.0011) [2023-12-26 04:23:06,892][123090] Updated weights for policy 1, policy_version 596867 (0.0007) [2023-12-26 04:23:06,956][123090] Updated weights for policy 1, policy_version 596877 (0.0006) [2023-12-26 04:23:07,027][123090] Updated weights for policy 1, policy_version 596887 (0.0009) [2023-12-26 04:23:07,603][123091] Updated weights for policy 0, policy_version 601012 (0.0011) [2023-12-26 04:23:07,670][123091] Updated weights for policy 0, policy_version 601022 (0.0011) [2023-12-26 04:23:07,733][123091] Updated weights for policy 0, policy_version 601032 (0.0011) [2023-12-26 04:23:07,845][123090] Updated weights for policy 1, policy_version 596897 (0.0009) [2023-12-26 04:23:07,913][123090] Updated weights for policy 1, policy_version 596907 (0.0009) [2023-12-26 04:23:07,981][123090] Updated weights for policy 1, policy_version 596917 (0.0008) [2023-12-26 04:23:08,050][123090] Updated weights for policy 1, policy_version 596927 (0.0009) [2023-12-26 04:23:08,554][123091] Updated weights for policy 0, policy_version 601042 (0.0011) [2023-12-26 04:23:08,617][123091] Updated weights for policy 0, policy_version 601052 (0.0011) [2023-12-26 04:23:08,676][123091] Updated weights for policy 0, policy_version 601062 (0.0011) [2023-12-26 04:23:08,738][123091] Updated weights for policy 0, policy_version 601072 (0.0011) [2023-12-26 04:23:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 306692096. Throughput: 0: 8916.2, 1: 8845.0. Samples: 306668256. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:08,785][121949] Avg episode reward: [(0, '5774.256'), (1, '5832.886')] [2023-12-26 04:23:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000601072_153878528.pth... [2023-12-26 04:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000600016_153608192.pth [2023-12-26 04:23:08,823][123090] Updated weights for policy 1, policy_version 596937 (0.0010) [2023-12-26 04:23:08,882][123090] Updated weights for policy 1, policy_version 596947 (0.0010) [2023-12-26 04:23:08,949][123090] Updated weights for policy 1, policy_version 596957 (0.0009) [2023-12-26 04:23:08,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000596960_152821760.pth... [2023-12-26 04:23:08,977][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000595904_152551424.pth [2023-12-26 04:23:09,530][123091] Updated weights for policy 0, policy_version 601082 (0.0011) [2023-12-26 04:23:09,602][123091] Updated weights for policy 0, policy_version 601092 (0.0011) [2023-12-26 04:23:09,668][123091] Updated weights for policy 0, policy_version 601102 (0.0011) [2023-12-26 04:23:09,860][123090] Updated weights for policy 1, policy_version 596967 (0.0011) [2023-12-26 04:23:09,928][123090] Updated weights for policy 1, policy_version 596977 (0.0013) [2023-12-26 04:23:10,006][123090] Updated weights for policy 1, policy_version 596987 (0.0011) [2023-12-26 04:23:10,373][123091] Updated weights for policy 0, policy_version 601112 (0.0011) [2023-12-26 04:23:10,423][123091] Updated weights for policy 0, policy_version 601122 (0.0010) [2023-12-26 04:23:10,487][123091] Updated weights for policy 0, policy_version 601132 (0.0006) [2023-12-26 04:23:10,814][123090] Updated weights for policy 1, policy_version 596997 (0.0008) [2023-12-26 04:23:10,881][123090] Updated weights for policy 1, policy_version 597007 (0.0007) [2023-12-26 04:23:10,945][123090] Updated weights for policy 1, policy_version 597017 (0.0009) [2023-12-26 04:23:11,301][123091] Updated weights for policy 0, policy_version 601142 (0.0009) [2023-12-26 04:23:11,366][123091] Updated weights for policy 0, policy_version 601152 (0.0009) [2023-12-26 04:23:11,429][123091] Updated weights for policy 0, policy_version 601162 (0.0010) [2023-12-26 04:23:11,691][123090] Updated weights for policy 1, policy_version 597027 (0.0008) [2023-12-26 04:23:11,770][123090] Updated weights for policy 1, policy_version 597037 (0.0008) [2023-12-26 04:23:11,841][123090] Updated weights for policy 1, policy_version 597047 (0.0009) [2023-12-26 04:23:12,279][123091] Updated weights for policy 0, policy_version 601172 (0.0010) [2023-12-26 04:23:12,347][123091] Updated weights for policy 0, policy_version 601182 (0.0010) [2023-12-26 04:23:12,418][123091] Updated weights for policy 0, policy_version 601192 (0.0009) [2023-12-26 04:23:12,686][123090] Updated weights for policy 1, policy_version 597057 (0.0010) [2023-12-26 04:23:12,749][123090] Updated weights for policy 1, policy_version 597067 (0.0010) [2023-12-26 04:23:12,820][123090] Updated weights for policy 1, policy_version 597077 (0.0009) [2023-12-26 04:23:12,885][123090] Updated weights for policy 1, policy_version 597087 (0.0010) [2023-12-26 04:23:13,221][123091] Updated weights for policy 0, policy_version 601202 (0.0011) [2023-12-26 04:23:13,284][123091] Updated weights for policy 0, policy_version 601212 (0.0006) [2023-12-26 04:23:13,345][123091] Updated weights for policy 0, policy_version 601222 (0.0005) [2023-12-26 04:23:13,411][123091] Updated weights for policy 0, policy_version 601232 (0.0005) [2023-12-26 04:23:13,727][123090] Updated weights for policy 1, policy_version 597097 (0.0011) [2023-12-26 04:23:13,781][123090] Updated weights for policy 1, policy_version 597107 (0.0007) [2023-12-26 04:23:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 306774016. Throughput: 0: 8913.0, 1: 8783.3. Samples: 306772212. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:13,784][121949] Avg episode reward: [(0, '5734.404'), (1, '5732.554')] [2023-12-26 04:23:13,844][123090] Updated weights for policy 1, policy_version 597117 (0.0008) [2023-12-26 04:23:14,216][123091] Updated weights for policy 0, policy_version 601242 (0.0008) [2023-12-26 04:23:14,277][123091] Updated weights for policy 0, policy_version 601252 (0.0009) [2023-12-26 04:23:14,328][123091] Updated weights for policy 0, policy_version 601262 (0.0008) [2023-12-26 04:23:14,588][123090] Updated weights for policy 1, policy_version 597127 (0.0009) [2023-12-26 04:23:14,654][123090] Updated weights for policy 1, policy_version 597137 (0.0010) [2023-12-26 04:23:14,720][123090] Updated weights for policy 1, policy_version 597147 (0.0010) [2023-12-26 04:23:15,104][123091] Updated weights for policy 0, policy_version 601272 (0.0010) [2023-12-26 04:23:15,174][123091] Updated weights for policy 0, policy_version 601282 (0.0009) [2023-12-26 04:23:15,235][123091] Updated weights for policy 0, policy_version 601292 (0.0009) [2023-12-26 04:23:15,594][123090] Updated weights for policy 1, policy_version 597157 (0.0010) [2023-12-26 04:23:15,659][123090] Updated weights for policy 1, policy_version 597167 (0.0011) [2023-12-26 04:23:15,711][123090] Updated weights for policy 1, policy_version 597177 (0.0010) [2023-12-26 04:23:16,064][123091] Updated weights for policy 0, policy_version 601302 (0.0009) [2023-12-26 04:23:16,124][123091] Updated weights for policy 0, policy_version 601312 (0.0009) [2023-12-26 04:23:16,188][123091] Updated weights for policy 0, policy_version 601322 (0.0009) [2023-12-26 04:23:16,550][123090] Updated weights for policy 1, policy_version 597187 (0.0011) [2023-12-26 04:23:16,598][123090] Updated weights for policy 1, policy_version 597197 (0.0010) [2023-12-26 04:23:16,650][123090] Updated weights for policy 1, policy_version 597207 (0.0010) [2023-12-26 04:23:16,996][123091] Updated weights for policy 0, policy_version 601332 (0.0007) [2023-12-26 04:23:17,046][123091] Updated weights for policy 0, policy_version 601342 (0.0005) [2023-12-26 04:23:17,104][123091] Updated weights for policy 0, policy_version 601352 (0.0006) [2023-12-26 04:23:17,475][123090] Updated weights for policy 1, policy_version 597217 (0.0010) [2023-12-26 04:23:17,534][123090] Updated weights for policy 1, policy_version 597227 (0.0010) [2023-12-26 04:23:17,582][123090] Updated weights for policy 1, policy_version 597237 (0.0010) [2023-12-26 04:23:17,643][123090] Updated weights for policy 1, policy_version 597247 (0.0011) [2023-12-26 04:23:17,849][123091] Updated weights for policy 0, policy_version 601362 (0.0006) [2023-12-26 04:23:17,898][123091] Updated weights for policy 0, policy_version 601372 (0.0009) [2023-12-26 04:23:17,946][123091] Updated weights for policy 0, policy_version 601382 (0.0008) [2023-12-26 04:23:17,996][123091] Updated weights for policy 0, policy_version 601392 (0.0011) [2023-12-26 04:23:18,431][123090] Updated weights for policy 1, policy_version 597257 (0.0011) [2023-12-26 04:23:18,496][123090] Updated weights for policy 1, policy_version 597267 (0.0007) [2023-12-26 04:23:18,553][123090] Updated weights for policy 1, policy_version 597277 (0.0005) [2023-12-26 04:23:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 306864128. Throughput: 0: 8970.6, 1: 8719.8. Samples: 306877352. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:18,785][121949] Avg episode reward: [(0, '5942.791'), (1, '5598.978')] [2023-12-26 04:23:18,822][123091] Updated weights for policy 0, policy_version 601402 (0.0005) [2023-12-26 04:23:18,894][123091] Updated weights for policy 0, policy_version 601412 (0.0006) [2023-12-26 04:23:18,963][123091] Updated weights for policy 0, policy_version 601422 (0.0006) [2023-12-26 04:23:19,339][123090] Updated weights for policy 1, policy_version 597287 (0.0008) [2023-12-26 04:23:19,405][123090] Updated weights for policy 1, policy_version 597297 (0.0007) [2023-12-26 04:23:19,459][123090] Updated weights for policy 1, policy_version 597307 (0.0005) [2023-12-26 04:23:19,703][123091] Updated weights for policy 0, policy_version 601432 (0.0006) [2023-12-26 04:23:19,771][123091] Updated weights for policy 0, policy_version 601442 (0.0009) [2023-12-26 04:23:19,833][123091] Updated weights for policy 0, policy_version 601452 (0.0009) [2023-12-26 04:23:20,193][123090] Updated weights for policy 1, policy_version 597317 (0.0008) [2023-12-26 04:23:20,252][123090] Updated weights for policy 1, policy_version 597327 (0.0009) [2023-12-26 04:23:20,323][123090] Updated weights for policy 1, policy_version 597337 (0.0009) [2023-12-26 04:23:20,604][123091] Updated weights for policy 0, policy_version 601462 (0.0008) [2023-12-26 04:23:20,667][123091] Updated weights for policy 0, policy_version 601472 (0.0010) [2023-12-26 04:23:20,735][123091] Updated weights for policy 0, policy_version 601482 (0.0009) [2023-12-26 04:23:21,159][123090] Updated weights for policy 1, policy_version 597347 (0.0009) [2023-12-26 04:23:21,218][123090] Updated weights for policy 1, policy_version 597357 (0.0010) [2023-12-26 04:23:21,281][123090] Updated weights for policy 1, policy_version 597367 (0.0010) [2023-12-26 04:23:21,589][123091] Updated weights for policy 0, policy_version 601492 (0.0010) [2023-12-26 04:23:21,662][123091] Updated weights for policy 0, policy_version 601502 (0.0009) [2023-12-26 04:23:21,718][123091] Updated weights for policy 0, policy_version 601512 (0.0010) [2023-12-26 04:23:22,132][123090] Updated weights for policy 1, policy_version 597377 (0.0009) [2023-12-26 04:23:22,233][123090] Updated weights for policy 1, policy_version 597387 (0.0008) [2023-12-26 04:23:22,299][123090] Updated weights for policy 1, policy_version 597397 (0.0009) [2023-12-26 04:23:22,363][123090] Updated weights for policy 1, policy_version 597407 (0.0009) [2023-12-26 04:23:22,509][123091] Updated weights for policy 0, policy_version 601522 (0.0010) [2023-12-26 04:23:22,568][123091] Updated weights for policy 0, policy_version 601532 (0.0010) [2023-12-26 04:23:22,635][123091] Updated weights for policy 0, policy_version 601542 (0.0009) [2023-12-26 04:23:22,697][123091] Updated weights for policy 0, policy_version 601552 (0.0007) [2023-12-26 04:23:23,177][123090] Updated weights for policy 1, policy_version 597417 (0.0010) [2023-12-26 04:23:23,243][123090] Updated weights for policy 1, policy_version 597427 (0.0009) [2023-12-26 04:23:23,313][123090] Updated weights for policy 1, policy_version 597437 (0.0010) [2023-12-26 04:23:23,506][123091] Updated weights for policy 0, policy_version 601562 (0.0009) [2023-12-26 04:23:23,579][123091] Updated weights for policy 0, policy_version 601572 (0.0006) [2023-12-26 04:23:23,636][123091] Updated weights for policy 0, policy_version 601582 (0.0005) [2023-12-26 04:23:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 306954240. Throughput: 0: 8944.2, 1: 8727.0. Samples: 306929612. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:23,785][121949] Avg episode reward: [(0, '5961.759'), (1, '5554.231')] [2023-12-26 04:23:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000601584_154009600.pth... [2023-12-26 04:23:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000597440_152944640.pth... [2023-12-26 04:23:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000596416_152682496.pth [2023-12-26 04:23:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000600528_153739264.pth [2023-12-26 04:23:24,188][123090] Updated weights for policy 1, policy_version 597447 (0.0010) [2023-12-26 04:23:24,240][123090] Updated weights for policy 1, policy_version 597457 (0.0009) [2023-12-26 04:23:24,279][123091] Updated weights for policy 0, policy_version 601592 (0.0005) [2023-12-26 04:23:24,301][123090] Updated weights for policy 1, policy_version 597467 (0.0009) [2023-12-26 04:23:24,332][123091] Updated weights for policy 0, policy_version 601602 (0.0005) [2023-12-26 04:23:24,385][123091] Updated weights for policy 0, policy_version 601612 (0.0005) [2023-12-26 04:23:25,038][123091] Updated weights for policy 0, policy_version 601622 (0.0006) [2023-12-26 04:23:25,103][123091] Updated weights for policy 0, policy_version 601632 (0.0006) [2023-12-26 04:23:25,164][123091] Updated weights for policy 0, policy_version 601642 (0.0005) [2023-12-26 04:23:25,220][123090] Updated weights for policy 1, policy_version 597477 (0.0009) [2023-12-26 04:23:25,281][123090] Updated weights for policy 1, policy_version 597487 (0.0009) [2023-12-26 04:23:25,337][123090] Updated weights for policy 1, policy_version 597497 (0.0009) [2023-12-26 04:23:25,902][123091] Updated weights for policy 0, policy_version 601652 (0.0010) [2023-12-26 04:23:25,956][123091] Updated weights for policy 0, policy_version 601662 (0.0010) [2023-12-26 04:23:26,007][123091] Updated weights for policy 0, policy_version 601672 (0.0010) [2023-12-26 04:23:26,199][123090] Updated weights for policy 1, policy_version 597507 (0.0009) [2023-12-26 04:23:26,252][123090] Updated weights for policy 1, policy_version 597517 (0.0010) [2023-12-26 04:23:26,309][123090] Updated weights for policy 1, policy_version 597527 (0.0009) [2023-12-26 04:23:26,780][123091] Updated weights for policy 0, policy_version 601682 (0.0007) [2023-12-26 04:23:26,830][123091] Updated weights for policy 0, policy_version 601692 (0.0010) [2023-12-26 04:23:26,880][123091] Updated weights for policy 0, policy_version 601702 (0.0008) [2023-12-26 04:23:26,933][123091] Updated weights for policy 0, policy_version 601712 (0.0006) [2023-12-26 04:23:27,174][123090] Updated weights for policy 1, policy_version 597537 (0.0009) [2023-12-26 04:23:27,229][123090] Updated weights for policy 1, policy_version 597547 (0.0008) [2023-12-26 04:23:27,276][123090] Updated weights for policy 1, policy_version 597557 (0.0008) [2023-12-26 04:23:27,328][123090] Updated weights for policy 1, policy_version 597567 (0.0009) [2023-12-26 04:23:27,721][123091] Updated weights for policy 0, policy_version 601722 (0.0009) [2023-12-26 04:23:27,788][123091] Updated weights for policy 0, policy_version 601732 (0.0007) [2023-12-26 04:23:27,856][123091] Updated weights for policy 0, policy_version 601742 (0.0005) [2023-12-26 04:23:28,212][123090] Updated weights for policy 1, policy_version 597577 (0.0010) [2023-12-26 04:23:28,271][123090] Updated weights for policy 1, policy_version 597587 (0.0010) [2023-12-26 04:23:28,331][123090] Updated weights for policy 1, policy_version 597598 (0.0010) [2023-12-26 04:23:28,486][123091] Updated weights for policy 0, policy_version 601752 (0.0007) [2023-12-26 04:23:28,543][123091] Updated weights for policy 0, policy_version 601762 (0.0010) [2023-12-26 04:23:28,600][123091] Updated weights for policy 0, policy_version 601772 (0.0009) [2023-12-26 04:23:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 307044352. Throughput: 0: 9070.7, 1: 8700.7. Samples: 307034344. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:28,785][121949] Avg episode reward: [(0, '6020.921'), (1, '5621.896')] [2023-12-26 04:23:29,169][123090] Updated weights for policy 1, policy_version 597608 (0.0009) [2023-12-26 04:23:29,242][123090] Updated weights for policy 1, policy_version 597618 (0.0009) [2023-12-26 04:23:29,305][123090] Updated weights for policy 1, policy_version 597628 (0.0010) [2023-12-26 04:23:29,482][123091] Updated weights for policy 0, policy_version 601782 (0.0009) [2023-12-26 04:23:29,548][123091] Updated weights for policy 0, policy_version 601792 (0.0009) [2023-12-26 04:23:29,603][123091] Updated weights for policy 0, policy_version 601802 (0.0009) [2023-12-26 04:23:30,155][123090] Updated weights for policy 1, policy_version 597638 (0.0010) [2023-12-26 04:23:30,214][123090] Updated weights for policy 1, policy_version 597648 (0.0009) [2023-12-26 04:23:30,274][123090] Updated weights for policy 1, policy_version 597658 (0.0010) [2023-12-26 04:23:30,423][123091] Updated weights for policy 0, policy_version 601812 (0.0008) [2023-12-26 04:23:30,473][123091] Updated weights for policy 0, policy_version 601822 (0.0005) [2023-12-26 04:23:30,517][123091] Updated weights for policy 0, policy_version 601832 (0.0005) [2023-12-26 04:23:31,145][123091] Updated weights for policy 0, policy_version 601842 (0.0006) [2023-12-26 04:23:31,173][123090] Updated weights for policy 1, policy_version 597668 (0.0008) [2023-12-26 04:23:31,212][123091] Updated weights for policy 0, policy_version 601852 (0.0007) [2023-12-26 04:23:31,239][123090] Updated weights for policy 1, policy_version 597678 (0.0006) [2023-12-26 04:23:31,275][123091] Updated weights for policy 0, policy_version 601862 (0.0007) [2023-12-26 04:23:31,304][123090] Updated weights for policy 1, policy_version 597688 (0.0008) [2023-12-26 04:23:31,333][123091] Updated weights for policy 0, policy_version 601872 (0.0009) [2023-12-26 04:23:32,087][123091] Updated weights for policy 0, policy_version 601882 (0.0009) [2023-12-26 04:23:32,149][123090] Updated weights for policy 1, policy_version 597698 (0.0008) [2023-12-26 04:23:32,149][123091] Updated weights for policy 0, policy_version 601892 (0.0009) [2023-12-26 04:23:32,207][123091] Updated weights for policy 0, policy_version 601902 (0.0007) [2023-12-26 04:23:32,209][123090] Updated weights for policy 1, policy_version 597708 (0.0010) [2023-12-26 04:23:32,284][123090] Updated weights for policy 1, policy_version 597718 (0.0009) [2023-12-26 04:23:32,339][123090] Updated weights for policy 1, policy_version 597728 (0.0009) [2023-12-26 04:23:32,983][123091] Updated weights for policy 0, policy_version 601912 (0.0006) [2023-12-26 04:23:33,030][123091] Updated weights for policy 0, policy_version 601922 (0.0010) [2023-12-26 04:23:33,077][123091] Updated weights for policy 0, policy_version 601932 (0.0010) [2023-12-26 04:23:33,167][123090] Updated weights for policy 1, policy_version 597738 (0.0009) [2023-12-26 04:23:33,222][123090] Updated weights for policy 1, policy_version 597748 (0.0009) [2023-12-26 04:23:33,281][123090] Updated weights for policy 1, policy_version 597758 (0.0009) [2023-12-26 04:23:33,740][123091] Updated weights for policy 0, policy_version 601942 (0.0007) [2023-12-26 04:23:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 307126272. Throughput: 0: 9042.2, 1: 8586.8. Samples: 307141084. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:33,785][121949] Avg episode reward: [(0, '6021.119'), (1, '5389.366')] [2023-12-26 04:23:33,797][123091] Updated weights for policy 0, policy_version 601952 (0.0006) [2023-12-26 04:23:33,858][123091] Updated weights for policy 0, policy_version 601962 (0.0005) [2023-12-26 04:23:34,203][123090] Updated weights for policy 1, policy_version 597768 (0.0009) [2023-12-26 04:23:34,277][123090] Updated weights for policy 1, policy_version 597778 (0.0010) [2023-12-26 04:23:34,345][123090] Updated weights for policy 1, policy_version 597788 (0.0009) [2023-12-26 04:23:34,480][123091] Updated weights for policy 0, policy_version 601972 (0.0007) [2023-12-26 04:23:34,538][123091] Updated weights for policy 0, policy_version 601982 (0.0009) [2023-12-26 04:23:34,593][123091] Updated weights for policy 0, policy_version 601993 (0.0010) [2023-12-26 04:23:35,166][123090] Updated weights for policy 1, policy_version 597798 (0.0010) [2023-12-26 04:23:35,226][123090] Updated weights for policy 1, policy_version 597808 (0.0009) [2023-12-26 04:23:35,291][123090] Updated weights for policy 1, policy_version 597818 (0.0009) [2023-12-26 04:23:35,425][123091] Updated weights for policy 0, policy_version 602003 (0.0010) [2023-12-26 04:23:35,481][123091] Updated weights for policy 0, policy_version 602013 (0.0009) [2023-12-26 04:23:35,530][123091] Updated weights for policy 0, policy_version 602023 (0.0010) [2023-12-26 04:23:36,116][123090] Updated weights for policy 1, policy_version 597828 (0.0008) [2023-12-26 04:23:36,181][123090] Updated weights for policy 1, policy_version 597838 (0.0006) [2023-12-26 04:23:36,237][123090] Updated weights for policy 1, policy_version 597848 (0.0009) [2023-12-26 04:23:36,379][123091] Updated weights for policy 0, policy_version 602033 (0.0009) [2023-12-26 04:23:36,432][123091] Updated weights for policy 0, policy_version 602043 (0.0009) [2023-12-26 04:23:36,495][123091] Updated weights for policy 0, policy_version 602053 (0.0009) [2023-12-26 04:23:36,564][123091] Updated weights for policy 0, policy_version 602063 (0.0009) [2023-12-26 04:23:37,064][123090] Updated weights for policy 1, policy_version 597858 (0.0010) [2023-12-26 04:23:37,128][123090] Updated weights for policy 1, policy_version 597868 (0.0009) [2023-12-26 04:23:37,195][123090] Updated weights for policy 1, policy_version 597878 (0.0009) [2023-12-26 04:23:37,260][123090] Updated weights for policy 1, policy_version 597888 (0.0010) [2023-12-26 04:23:37,401][123091] Updated weights for policy 0, policy_version 602073 (0.0009) [2023-12-26 04:23:37,451][123091] Updated weights for policy 0, policy_version 602083 (0.0010) [2023-12-26 04:23:37,509][123091] Updated weights for policy 0, policy_version 602093 (0.0009) [2023-12-26 04:23:38,019][123090] Updated weights for policy 1, policy_version 597898 (0.0006) [2023-12-26 04:23:38,075][123090] Updated weights for policy 1, policy_version 597908 (0.0009) [2023-12-26 04:23:38,132][123090] Updated weights for policy 1, policy_version 597918 (0.0009) [2023-12-26 04:23:38,421][123091] Updated weights for policy 0, policy_version 602103 (0.0009) [2023-12-26 04:23:38,486][123091] Updated weights for policy 0, policy_version 602113 (0.0008) [2023-12-26 04:23:38,538][123091] Updated weights for policy 0, policy_version 602123 (0.0008) [2023-12-26 04:23:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 307216384. Throughput: 0: 9074.8, 1: 8593.4. Samples: 307193024. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:38,785][121949] Avg episode reward: [(0, '5902.591'), (1, '5018.176')] [2023-12-26 04:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000602128_154148864.pth... [2023-12-26 04:23:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000597920_153067520.pth... [2023-12-26 04:23:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000596960_152821760.pth [2023-12-26 04:23:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000601072_153878528.pth [2023-12-26 04:23:38,922][123090] Updated weights for policy 1, policy_version 597929 (0.0010) [2023-12-26 04:23:38,979][123090] Updated weights for policy 1, policy_version 597939 (0.0009) [2023-12-26 04:23:39,043][123090] Updated weights for policy 1, policy_version 597949 (0.0009) [2023-12-26 04:23:39,386][123091] Updated weights for policy 0, policy_version 602133 (0.0008) [2023-12-26 04:23:39,459][123091] Updated weights for policy 0, policy_version 602143 (0.0008) [2023-12-26 04:23:39,522][123091] Updated weights for policy 0, policy_version 602153 (0.0008) [2023-12-26 04:23:39,938][123090] Updated weights for policy 1, policy_version 597959 (0.0009) [2023-12-26 04:23:40,006][123090] Updated weights for policy 1, policy_version 597969 (0.0008) [2023-12-26 04:23:40,074][123090] Updated weights for policy 1, policy_version 597979 (0.0007) [2023-12-26 04:23:40,281][123091] Updated weights for policy 0, policy_version 602163 (0.0009) [2023-12-26 04:23:40,332][123091] Updated weights for policy 0, policy_version 602173 (0.0009) [2023-12-26 04:23:40,389][123091] Updated weights for policy 0, policy_version 602183 (0.0009) [2023-12-26 04:23:40,901][123090] Updated weights for policy 1, policy_version 597989 (0.0007) [2023-12-26 04:23:40,951][123090] Updated weights for policy 1, policy_version 597999 (0.0005) [2023-12-26 04:23:41,014][123090] Updated weights for policy 1, policy_version 598009 (0.0006) [2023-12-26 04:23:41,347][123091] Updated weights for policy 0, policy_version 602193 (0.0009) [2023-12-26 04:23:41,426][123091] Updated weights for policy 0, policy_version 602203 (0.0009) [2023-12-26 04:23:41,483][123091] Updated weights for policy 0, policy_version 602213 (0.0010) [2023-12-26 04:23:41,539][123091] Updated weights for policy 0, policy_version 602224 (0.0010) [2023-12-26 04:23:41,796][123090] Updated weights for policy 1, policy_version 598019 (0.0009) [2023-12-26 04:23:41,864][123090] Updated weights for policy 1, policy_version 598029 (0.0011) [2023-12-26 04:23:41,932][123090] Updated weights for policy 1, policy_version 598039 (0.0011) [2023-12-26 04:23:42,440][123091] Updated weights for policy 0, policy_version 602234 (0.0009) [2023-12-26 04:23:42,489][123091] Updated weights for policy 0, policy_version 602244 (0.0009) [2023-12-26 04:23:42,538][123091] Updated weights for policy 0, policy_version 602254 (0.0009) [2023-12-26 04:23:42,771][123090] Updated weights for policy 1, policy_version 598049 (0.0011) [2023-12-26 04:23:42,833][123090] Updated weights for policy 1, policy_version 598059 (0.0009) [2023-12-26 04:23:42,892][123090] Updated weights for policy 1, policy_version 598070 (0.0010) [2023-12-26 04:23:42,948][123090] Updated weights for policy 1, policy_version 598080 (0.0008) [2023-12-26 04:23:43,390][123091] Updated weights for policy 0, policy_version 602264 (0.0006) [2023-12-26 04:23:43,454][123091] Updated weights for policy 0, policy_version 602274 (0.0005) [2023-12-26 04:23:43,506][123091] Updated weights for policy 0, policy_version 602284 (0.0005) [2023-12-26 04:23:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 307298304. Throughput: 0: 8872.8, 1: 8537.7. Samples: 307294060. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:43,785][121949] Avg episode reward: [(0, '5862.912'), (1, '4924.852')] [2023-12-26 04:23:43,846][123090] Updated weights for policy 1, policy_version 598090 (0.0009) [2023-12-26 04:23:43,917][123090] Updated weights for policy 1, policy_version 598100 (0.0010) [2023-12-26 04:23:43,986][123090] Updated weights for policy 1, policy_version 598110 (0.0010) [2023-12-26 04:23:44,142][123091] Updated weights for policy 0, policy_version 602294 (0.0008) [2023-12-26 04:23:44,213][123091] Updated weights for policy 0, policy_version 602304 (0.0010) [2023-12-26 04:23:44,270][123091] Updated weights for policy 0, policy_version 602314 (0.0009) [2023-12-26 04:23:44,683][123090] Updated weights for policy 1, policy_version 598120 (0.0008) [2023-12-26 04:23:44,739][123090] Updated weights for policy 1, policy_version 598130 (0.0008) [2023-12-26 04:23:44,799][123090] Updated weights for policy 1, policy_version 598140 (0.0010) [2023-12-26 04:23:45,070][123091] Updated weights for policy 0, policy_version 602324 (0.0010) [2023-12-26 04:23:45,139][123091] Updated weights for policy 0, policy_version 602334 (0.0007) [2023-12-26 04:23:45,203][123091] Updated weights for policy 0, policy_version 602344 (0.0007) [2023-12-26 04:23:45,696][123090] Updated weights for policy 1, policy_version 598150 (0.0010) [2023-12-26 04:23:45,764][123090] Updated weights for policy 1, policy_version 598160 (0.0011) [2023-12-26 04:23:45,824][123090] Updated weights for policy 1, policy_version 598170 (0.0011) [2023-12-26 04:23:45,954][123091] Updated weights for policy 0, policy_version 602354 (0.0010) [2023-12-26 04:23:46,012][123091] Updated weights for policy 0, policy_version 602364 (0.0010) [2023-12-26 04:23:46,061][123091] Updated weights for policy 0, policy_version 602374 (0.0009) [2023-12-26 04:23:46,122][123091] Updated weights for policy 0, policy_version 602384 (0.0009) [2023-12-26 04:23:46,584][123090] Updated weights for policy 1, policy_version 598180 (0.0008) [2023-12-26 04:23:46,649][123090] Updated weights for policy 1, policy_version 598190 (0.0006) [2023-12-26 04:23:46,709][123090] Updated weights for policy 1, policy_version 598200 (0.0005) [2023-12-26 04:23:46,811][123091] Updated weights for policy 0, policy_version 602394 (0.0005) [2023-12-26 04:23:46,860][123091] Updated weights for policy 0, policy_version 602404 (0.0007) [2023-12-26 04:23:46,912][123091] Updated weights for policy 0, policy_version 602414 (0.0009) [2023-12-26 04:23:47,398][123090] Updated weights for policy 1, policy_version 598210 (0.0005) [2023-12-26 04:23:47,461][123090] Updated weights for policy 1, policy_version 598220 (0.0005) [2023-12-26 04:23:47,536][123090] Updated weights for policy 1, policy_version 598230 (0.0006) [2023-12-26 04:23:47,602][123090] Updated weights for policy 1, policy_version 598240 (0.0006) [2023-12-26 04:23:47,713][123091] Updated weights for policy 0, policy_version 602424 (0.0009) [2023-12-26 04:23:47,764][123091] Updated weights for policy 0, policy_version 602434 (0.0010) [2023-12-26 04:23:47,816][123091] Updated weights for policy 0, policy_version 602444 (0.0010) [2023-12-26 04:23:48,291][123090] Updated weights for policy 1, policy_version 598250 (0.0005) [2023-12-26 04:23:48,360][123090] Updated weights for policy 1, policy_version 598260 (0.0009) [2023-12-26 04:23:48,429][123090] Updated weights for policy 1, policy_version 598270 (0.0011) [2023-12-26 04:23:48,715][123091] Updated weights for policy 0, policy_version 602454 (0.0009) [2023-12-26 04:23:48,783][123091] Updated weights for policy 0, policy_version 602464 (0.0009) [2023-12-26 04:23:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 307388416. Throughput: 0: 8919.1, 1: 8569.9. Samples: 307402680. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:48,785][121949] Avg episode reward: [(0, '5835.281'), (1, '5249.106')] [2023-12-26 04:23:48,835][123091] Updated weights for policy 0, policy_version 602474 (0.0009) [2023-12-26 04:23:49,264][123090] Updated weights for policy 1, policy_version 598280 (0.0011) [2023-12-26 04:23:49,329][123090] Updated weights for policy 1, policy_version 598290 (0.0011) [2023-12-26 04:23:49,397][123090] Updated weights for policy 1, policy_version 598300 (0.0012) [2023-12-26 04:23:49,657][123091] Updated weights for policy 0, policy_version 602484 (0.0008) [2023-12-26 04:23:49,726][123091] Updated weights for policy 0, policy_version 602494 (0.0011) [2023-12-26 04:23:49,790][123091] Updated weights for policy 0, policy_version 602504 (0.0011) [2023-12-26 04:23:50,223][123090] Updated weights for policy 1, policy_version 598310 (0.0011) [2023-12-26 04:23:50,289][123090] Updated weights for policy 1, policy_version 598320 (0.0008) [2023-12-26 04:23:50,349][123090] Updated weights for policy 1, policy_version 598330 (0.0005) [2023-12-26 04:23:50,630][123091] Updated weights for policy 0, policy_version 602514 (0.0010) [2023-12-26 04:23:50,691][123091] Updated weights for policy 0, policy_version 602524 (0.0010) [2023-12-26 04:23:50,755][123091] Updated weights for policy 0, policy_version 602534 (0.0010) [2023-12-26 04:23:50,820][123091] Updated weights for policy 0, policy_version 602544 (0.0010) [2023-12-26 04:23:51,168][123090] Updated weights for policy 1, policy_version 598340 (0.0009) [2023-12-26 04:23:51,230][123090] Updated weights for policy 1, policy_version 598350 (0.0009) [2023-12-26 04:23:51,292][123090] Updated weights for policy 1, policy_version 598360 (0.0009) [2023-12-26 04:23:51,673][123091] Updated weights for policy 0, policy_version 602554 (0.0010) [2023-12-26 04:23:51,737][123091] Updated weights for policy 0, policy_version 602564 (0.0010) [2023-12-26 04:23:51,794][123091] Updated weights for policy 0, policy_version 602574 (0.0007) [2023-12-26 04:23:52,058][123090] Updated weights for policy 1, policy_version 598370 (0.0009) [2023-12-26 04:23:52,121][123090] Updated weights for policy 1, policy_version 598380 (0.0005) [2023-12-26 04:23:52,180][123090] Updated weights for policy 1, policy_version 598390 (0.0005) [2023-12-26 04:23:52,239][123090] Updated weights for policy 1, policy_version 598400 (0.0005) [2023-12-26 04:23:52,508][123091] Updated weights for policy 0, policy_version 602584 (0.0008) [2023-12-26 04:23:52,571][123091] Updated weights for policy 0, policy_version 602594 (0.0010) [2023-12-26 04:23:52,636][123091] Updated weights for policy 0, policy_version 602604 (0.0010) [2023-12-26 04:23:53,043][123090] Updated weights for policy 1, policy_version 598410 (0.0006) [2023-12-26 04:23:53,091][123090] Updated weights for policy 1, policy_version 598420 (0.0005) [2023-12-26 04:23:53,141][123090] Updated weights for policy 1, policy_version 598430 (0.0005) [2023-12-26 04:23:53,374][123091] Updated weights for policy 0, policy_version 602614 (0.0007) [2023-12-26 04:23:53,429][123091] Updated weights for policy 0, policy_version 602624 (0.0005) [2023-12-26 04:23:53,477][123091] Updated weights for policy 0, policy_version 602634 (0.0005) [2023-12-26 04:23:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 307478528. Throughput: 0: 8905.4, 1: 8531.8. Samples: 307452932. Policy #0 lag: (min: 27.0, avg: 31.7, max: 59.0) [2023-12-26 04:23:53,785][121949] Avg episode reward: [(0, '5830.087'), (1, '5568.335')] [2023-12-26 04:23:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000602640_154279936.pth... [2023-12-26 04:23:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000598432_153198592.pth... [2023-12-26 04:23:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000597440_152944640.pth [2023-12-26 04:23:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000601584_154009600.pth [2023-12-26 04:23:53,905][123090] Updated weights for policy 1, policy_version 598440 (0.0009) [2023-12-26 04:23:53,985][123090] Updated weights for policy 1, policy_version 598450 (0.0010) [2023-12-26 04:23:54,062][123090] Updated weights for policy 1, policy_version 598460 (0.0011) [2023-12-26 04:23:54,155][123091] Updated weights for policy 0, policy_version 602644 (0.0006) [2023-12-26 04:23:54,226][123091] Updated weights for policy 0, policy_version 602654 (0.0006) [2023-12-26 04:23:54,296][123091] Updated weights for policy 0, policy_version 602664 (0.0005) [2023-12-26 04:23:54,854][123090] Updated weights for policy 1, policy_version 598470 (0.0010) [2023-12-26 04:23:54,932][123090] Updated weights for policy 1, policy_version 598480 (0.0011) [2023-12-26 04:23:54,971][123091] Updated weights for policy 0, policy_version 602674 (0.0006) [2023-12-26 04:23:55,002][123090] Updated weights for policy 1, policy_version 598490 (0.0011) [2023-12-26 04:23:55,032][123091] Updated weights for policy 0, policy_version 602684 (0.0007) [2023-12-26 04:23:55,088][123091] Updated weights for policy 0, policy_version 602694 (0.0006) [2023-12-26 04:23:55,145][123091] Updated weights for policy 0, policy_version 602704 (0.0005) [2023-12-26 04:23:55,709][123090] Updated weights for policy 1, policy_version 598500 (0.0011) [2023-12-26 04:23:55,772][123090] Updated weights for policy 1, policy_version 598510 (0.0011) [2023-12-26 04:23:55,832][123090] Updated weights for policy 1, policy_version 598520 (0.0010) [2023-12-26 04:23:55,851][123091] Updated weights for policy 0, policy_version 602714 (0.0009) [2023-12-26 04:23:55,906][123091] Updated weights for policy 0, policy_version 602724 (0.0009) [2023-12-26 04:23:55,954][123091] Updated weights for policy 0, policy_version 602734 (0.0009) [2023-12-26 04:23:56,648][123090] Updated weights for policy 1, policy_version 598530 (0.0010) [2023-12-26 04:23:56,717][123090] Updated weights for policy 1, policy_version 598540 (0.0010) [2023-12-26 04:23:56,721][123091] Updated weights for policy 0, policy_version 602744 (0.0006) [2023-12-26 04:23:56,779][123091] Updated weights for policy 0, policy_version 602754 (0.0007) [2023-12-26 04:23:56,780][123090] Updated weights for policy 1, policy_version 598550 (0.0010) [2023-12-26 04:23:56,826][123091] Updated weights for policy 0, policy_version 602764 (0.0008) [2023-12-26 04:23:56,842][123090] Updated weights for policy 1, policy_version 598560 (0.0010) [2023-12-26 04:23:57,450][123090] Updated weights for policy 1, policy_version 598570 (0.0005) [2023-12-26 04:23:57,511][123090] Updated weights for policy 1, policy_version 598580 (0.0005) [2023-12-26 04:23:57,560][123090] Updated weights for policy 1, policy_version 598590 (0.0005) [2023-12-26 04:23:57,634][123091] Updated weights for policy 0, policy_version 602774 (0.0008) [2023-12-26 04:23:57,692][123091] Updated weights for policy 0, policy_version 602784 (0.0010) [2023-12-26 04:23:57,749][123091] Updated weights for policy 0, policy_version 602794 (0.0009) [2023-12-26 04:23:58,204][123090] Updated weights for policy 1, policy_version 598600 (0.0006) [2023-12-26 04:23:58,272][123090] Updated weights for policy 1, policy_version 598610 (0.0005) [2023-12-26 04:23:58,346][123090] Updated weights for policy 1, policy_version 598620 (0.0007) [2023-12-26 04:23:58,695][123091] Updated weights for policy 0, policy_version 602804 (0.0009) [2023-12-26 04:23:58,767][123091] Updated weights for policy 0, policy_version 602814 (0.0008) [2023-12-26 04:23:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 307568640. Throughput: 0: 9039.2, 1: 8597.5. Samples: 307565864. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:23:58,785][121949] Avg episode reward: [(0, '5830.032'), (1, '5574.387')] [2023-12-26 04:23:58,829][123091] Updated weights for policy 0, policy_version 602824 (0.0006) [2023-12-26 04:23:59,195][123090] Updated weights for policy 1, policy_version 598630 (0.0009) [2023-12-26 04:23:59,259][123090] Updated weights for policy 1, policy_version 598640 (0.0008) [2023-12-26 04:23:59,327][123090] Updated weights for policy 1, policy_version 598650 (0.0006) [2023-12-26 04:23:59,604][123091] Updated weights for policy 0, policy_version 602834 (0.0010) [2023-12-26 04:23:59,649][123091] Updated weights for policy 0, policy_version 602844 (0.0005) [2023-12-26 04:23:59,703][123091] Updated weights for policy 0, policy_version 602854 (0.0005) [2023-12-26 04:23:59,761][123091] Updated weights for policy 0, policy_version 602864 (0.0006) [2023-12-26 04:24:00,207][123090] Updated weights for policy 1, policy_version 598660 (0.0009) [2023-12-26 04:24:00,271][123090] Updated weights for policy 1, policy_version 598670 (0.0009) [2023-12-26 04:24:00,323][123090] Updated weights for policy 1, policy_version 598680 (0.0010) [2023-12-26 04:24:00,560][123091] Updated weights for policy 0, policy_version 602874 (0.0008) [2023-12-26 04:24:00,616][123091] Updated weights for policy 0, policy_version 602884 (0.0005) [2023-12-26 04:24:00,663][123091] Updated weights for policy 0, policy_version 602894 (0.0005) [2023-12-26 04:24:01,196][123090] Updated weights for policy 1, policy_version 598690 (0.0010) [2023-12-26 04:24:01,254][123090] Updated weights for policy 1, policy_version 598700 (0.0010) [2023-12-26 04:24:01,320][123090] Updated weights for policy 1, policy_version 598710 (0.0008) [2023-12-26 04:24:01,391][123090] Updated weights for policy 1, policy_version 598720 (0.0009) [2023-12-26 04:24:01,415][123091] Updated weights for policy 0, policy_version 602904 (0.0009) [2023-12-26 04:24:01,480][123091] Updated weights for policy 0, policy_version 602914 (0.0010) [2023-12-26 04:24:01,532][123091] Updated weights for policy 0, policy_version 602924 (0.0009) [2023-12-26 04:24:02,214][123090] Updated weights for policy 1, policy_version 598730 (0.0010) [2023-12-26 04:24:02,270][123090] Updated weights for policy 1, policy_version 598740 (0.0009) [2023-12-26 04:24:02,328][123090] Updated weights for policy 1, policy_version 598750 (0.0009) [2023-12-26 04:24:02,372][123091] Updated weights for policy 0, policy_version 602934 (0.0008) [2023-12-26 04:24:02,424][123091] Updated weights for policy 0, policy_version 602944 (0.0009) [2023-12-26 04:24:02,484][123091] Updated weights for policy 0, policy_version 602955 (0.0009) [2023-12-26 04:24:03,210][123090] Updated weights for policy 1, policy_version 598760 (0.0010) [2023-12-26 04:24:03,263][123090] Updated weights for policy 1, policy_version 598771 (0.0009) [2023-12-26 04:24:03,272][123091] Updated weights for policy 0, policy_version 602965 (0.0007) [2023-12-26 04:24:03,317][123091] Updated weights for policy 0, policy_version 602975 (0.0007) [2023-12-26 04:24:03,320][123090] Updated weights for policy 1, policy_version 598781 (0.0009) [2023-12-26 04:24:03,360][123091] Updated weights for policy 0, policy_version 602985 (0.0006) [2023-12-26 04:24:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 307658752. Throughput: 0: 9032.6, 1: 8573.5. Samples: 307669628. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:03,785][121949] Avg episode reward: [(0, '5956.441'), (1, '5793.679')] [2023-12-26 04:24:04,084][123090] Updated weights for policy 1, policy_version 598791 (0.0010) [2023-12-26 04:24:04,143][123090] Updated weights for policy 1, policy_version 598801 (0.0010) [2023-12-26 04:24:04,191][123090] Updated weights for policy 1, policy_version 598811 (0.0010) [2023-12-26 04:24:04,204][123091] Updated weights for policy 0, policy_version 602995 (0.0006) [2023-12-26 04:24:04,252][123091] Updated weights for policy 0, policy_version 603005 (0.0008) [2023-12-26 04:24:04,313][123091] Updated weights for policy 0, policy_version 603015 (0.0009) [2023-12-26 04:24:04,913][123090] Updated weights for policy 1, policy_version 598821 (0.0008) [2023-12-26 04:24:04,982][123090] Updated weights for policy 1, policy_version 598831 (0.0005) [2023-12-26 04:24:05,043][123090] Updated weights for policy 1, policy_version 598841 (0.0006) [2023-12-26 04:24:05,235][123091] Updated weights for policy 0, policy_version 603025 (0.0009) [2023-12-26 04:24:05,293][123091] Updated weights for policy 0, policy_version 603035 (0.0009) [2023-12-26 04:24:05,348][123091] Updated weights for policy 0, policy_version 603045 (0.0010) [2023-12-26 04:24:05,398][123091] Updated weights for policy 0, policy_version 603055 (0.0009) [2023-12-26 04:24:05,738][123090] Updated weights for policy 1, policy_version 598851 (0.0005) [2023-12-26 04:24:05,791][123090] Updated weights for policy 1, policy_version 598861 (0.0005) [2023-12-26 04:24:05,858][123090] Updated weights for policy 1, policy_version 598871 (0.0005) [2023-12-26 04:24:06,325][123091] Updated weights for policy 0, policy_version 603065 (0.0011) [2023-12-26 04:24:06,389][123091] Updated weights for policy 0, policy_version 603075 (0.0010) [2023-12-26 04:24:06,441][123091] Updated weights for policy 0, policy_version 603085 (0.0010) [2023-12-26 04:24:06,560][123090] Updated weights for policy 1, policy_version 598881 (0.0005) [2023-12-26 04:24:06,625][123090] Updated weights for policy 1, policy_version 598891 (0.0008) [2023-12-26 04:24:06,691][123090] Updated weights for policy 1, policy_version 598901 (0.0009) [2023-12-26 04:24:06,753][123090] Updated weights for policy 1, policy_version 598911 (0.0008) [2023-12-26 04:24:07,291][123091] Updated weights for policy 0, policy_version 603095 (0.0010) [2023-12-26 04:24:07,342][123091] Updated weights for policy 0, policy_version 603105 (0.0010) [2023-12-26 04:24:07,396][123091] Updated weights for policy 0, policy_version 603115 (0.0009) [2023-12-26 04:24:07,526][123090] Updated weights for policy 1, policy_version 598921 (0.0006) [2023-12-26 04:24:07,586][123090] Updated weights for policy 1, policy_version 598931 (0.0007) [2023-12-26 04:24:07,643][123090] Updated weights for policy 1, policy_version 598941 (0.0008) [2023-12-26 04:24:08,169][123091] Updated weights for policy 0, policy_version 603125 (0.0007) [2023-12-26 04:24:08,223][123091] Updated weights for policy 0, policy_version 603135 (0.0005) [2023-12-26 04:24:08,284][123091] Updated weights for policy 0, policy_version 603146 (0.0009) [2023-12-26 04:24:08,430][123090] Updated weights for policy 1, policy_version 598951 (0.0008) [2023-12-26 04:24:08,494][123090] Updated weights for policy 1, policy_version 598961 (0.0010) [2023-12-26 04:24:08,554][123090] Updated weights for policy 1, policy_version 598971 (0.0009) [2023-12-26 04:24:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 307748864. Throughput: 0: 8978.3, 1: 8669.5. Samples: 307723764. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:08,785][121949] Avg episode reward: [(0, '6053.492'), (1, '5700.782')] [2023-12-26 04:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000603152_154411008.pth... [2023-12-26 04:24:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000598976_153337856.pth... [2023-12-26 04:24:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000597920_153067520.pth [2023-12-26 04:24:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000602128_154148864.pth [2023-12-26 04:24:09,180][123091] Updated weights for policy 0, policy_version 603156 (0.0010) [2023-12-26 04:24:09,244][123090] Updated weights for policy 1, policy_version 598981 (0.0007) [2023-12-26 04:24:09,252][123091] Updated weights for policy 0, policy_version 603166 (0.0008) [2023-12-26 04:24:09,306][123090] Updated weights for policy 1, policy_version 598991 (0.0007) [2023-12-26 04:24:09,317][123091] Updated weights for policy 0, policy_version 603176 (0.0008) [2023-12-26 04:24:09,374][123090] Updated weights for policy 1, policy_version 599001 (0.0008) [2023-12-26 04:24:10,138][123090] Updated weights for policy 1, policy_version 599011 (0.0008) [2023-12-26 04:24:10,157][123091] Updated weights for policy 0, policy_version 603186 (0.0007) [2023-12-26 04:24:10,201][123090] Updated weights for policy 1, policy_version 599021 (0.0011) [2023-12-26 04:24:10,237][123091] Updated weights for policy 0, policy_version 603196 (0.0005) [2023-12-26 04:24:10,269][123090] Updated weights for policy 1, policy_version 599031 (0.0011) [2023-12-26 04:24:10,313][123091] Updated weights for policy 0, policy_version 603206 (0.0006) [2023-12-26 04:24:10,384][123091] Updated weights for policy 0, policy_version 603216 (0.0006) [2023-12-26 04:24:10,967][123091] Updated weights for policy 0, policy_version 603226 (0.0006) [2023-12-26 04:24:11,045][123091] Updated weights for policy 0, policy_version 603236 (0.0008) [2023-12-26 04:24:11,081][123090] Updated weights for policy 1, policy_version 599041 (0.0010) [2023-12-26 04:24:11,114][123091] Updated weights for policy 0, policy_version 603246 (0.0008) [2023-12-26 04:24:11,149][123090] Updated weights for policy 1, policy_version 599051 (0.0011) [2023-12-26 04:24:11,219][123090] Updated weights for policy 1, policy_version 599061 (0.0011) [2023-12-26 04:24:11,281][123090] Updated weights for policy 1, policy_version 599071 (0.0010) [2023-12-26 04:24:11,893][123091] Updated weights for policy 0, policy_version 603256 (0.0006) [2023-12-26 04:24:11,953][123091] Updated weights for policy 0, policy_version 603266 (0.0009) [2023-12-26 04:24:12,012][123091] Updated weights for policy 0, policy_version 603276 (0.0009) [2023-12-26 04:24:12,037][123090] Updated weights for policy 1, policy_version 599081 (0.0011) [2023-12-26 04:24:12,113][123090] Updated weights for policy 1, policy_version 599091 (0.0011) [2023-12-26 04:24:12,180][123090] Updated weights for policy 1, policy_version 599101 (0.0010) [2023-12-26 04:24:12,806][123091] Updated weights for policy 0, policy_version 603286 (0.0006) [2023-12-26 04:24:12,864][123091] Updated weights for policy 0, policy_version 603296 (0.0005) [2023-12-26 04:24:12,929][123091] Updated weights for policy 0, policy_version 603306 (0.0006) [2023-12-26 04:24:12,953][123090] Updated weights for policy 1, policy_version 599111 (0.0006) [2023-12-26 04:24:13,013][123090] Updated weights for policy 1, policy_version 599121 (0.0005) [2023-12-26 04:24:13,075][123090] Updated weights for policy 1, policy_version 599131 (0.0005) [2023-12-26 04:24:13,571][123091] Updated weights for policy 0, policy_version 603316 (0.0008) [2023-12-26 04:24:13,633][123091] Updated weights for policy 0, policy_version 603326 (0.0010) [2023-12-26 04:24:13,688][123091] Updated weights for policy 0, policy_version 603336 (0.0011) [2023-12-26 04:24:13,749][123090] Updated weights for policy 1, policy_version 599141 (0.0005) [2023-12-26 04:24:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 307838976. Throughput: 0: 8911.1, 1: 8774.2. Samples: 307830184. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:13,785][121949] Avg episode reward: [(0, '6005.607'), (1, '5745.275')] [2023-12-26 04:24:13,804][123090] Updated weights for policy 1, policy_version 599151 (0.0005) [2023-12-26 04:24:13,856][123090] Updated weights for policy 1, policy_version 599161 (0.0005) [2023-12-26 04:24:14,479][123091] Updated weights for policy 0, policy_version 603346 (0.0009) [2023-12-26 04:24:14,532][123091] Updated weights for policy 0, policy_version 603356 (0.0005) [2023-12-26 04:24:14,568][123090] Updated weights for policy 1, policy_version 599171 (0.0005) [2023-12-26 04:24:14,592][123091] Updated weights for policy 0, policy_version 603366 (0.0006) [2023-12-26 04:24:14,628][123090] Updated weights for policy 1, policy_version 599181 (0.0007) [2023-12-26 04:24:14,656][123091] Updated weights for policy 0, policy_version 603376 (0.0005) [2023-12-26 04:24:14,690][123090] Updated weights for policy 1, policy_version 599191 (0.0010) [2023-12-26 04:24:15,336][123091] Updated weights for policy 0, policy_version 603386 (0.0010) [2023-12-26 04:24:15,399][123091] Updated weights for policy 0, policy_version 603396 (0.0010) [2023-12-26 04:24:15,408][123090] Updated weights for policy 1, policy_version 599201 (0.0011) [2023-12-26 04:24:15,456][123091] Updated weights for policy 0, policy_version 603406 (0.0010) [2023-12-26 04:24:15,470][123090] Updated weights for policy 1, policy_version 599211 (0.0006) [2023-12-26 04:24:15,527][123090] Updated weights for policy 1, policy_version 599221 (0.0006) [2023-12-26 04:24:15,586][123090] Updated weights for policy 1, policy_version 599231 (0.0005) [2023-12-26 04:24:16,249][123091] Updated weights for policy 0, policy_version 603416 (0.0006) [2023-12-26 04:24:16,306][123091] Updated weights for policy 0, policy_version 603426 (0.0009) [2023-12-26 04:24:16,357][123091] Updated weights for policy 0, policy_version 603436 (0.0009) [2023-12-26 04:24:16,364][123090] Updated weights for policy 1, policy_version 599241 (0.0006) [2023-12-26 04:24:16,430][123090] Updated weights for policy 1, policy_version 599251 (0.0006) [2023-12-26 04:24:16,492][123090] Updated weights for policy 1, policy_version 599261 (0.0005) [2023-12-26 04:24:17,128][123090] Updated weights for policy 1, policy_version 599271 (0.0006) [2023-12-26 04:24:17,129][123091] Updated weights for policy 0, policy_version 603446 (0.0010) [2023-12-26 04:24:17,177][123091] Updated weights for policy 0, policy_version 603456 (0.0010) [2023-12-26 04:24:17,185][123090] Updated weights for policy 1, policy_version 599281 (0.0005) [2023-12-26 04:24:17,228][123091] Updated weights for policy 0, policy_version 603466 (0.0010) [2023-12-26 04:24:17,243][123090] Updated weights for policy 1, policy_version 599291 (0.0005) [2023-12-26 04:24:17,912][123090] Updated weights for policy 1, policy_version 599301 (0.0005) [2023-12-26 04:24:17,972][123090] Updated weights for policy 1, policy_version 599311 (0.0005) [2023-12-26 04:24:18,035][123090] Updated weights for policy 1, policy_version 599321 (0.0006) [2023-12-26 04:24:18,069][123091] Updated weights for policy 0, policy_version 603476 (0.0011) [2023-12-26 04:24:18,117][123091] Updated weights for policy 0, policy_version 603486 (0.0010) [2023-12-26 04:24:18,176][123091] Updated weights for policy 0, policy_version 603496 (0.0010) [2023-12-26 04:24:18,782][123090] Updated weights for policy 1, policy_version 599331 (0.0007) [2023-12-26 04:24:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 307929088. Throughput: 0: 8849.1, 1: 9000.0. Samples: 307944292. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:18,784][121949] Avg episode reward: [(0, '5832.413'), (1, '5699.187')] [2023-12-26 04:24:18,844][123090] Updated weights for policy 1, policy_version 599341 (0.0010) [2023-12-26 04:24:18,911][123090] Updated weights for policy 1, policy_version 599351 (0.0011) [2023-12-26 04:24:19,035][123091] Updated weights for policy 0, policy_version 603506 (0.0011) [2023-12-26 04:24:19,093][123091] Updated weights for policy 0, policy_version 603516 (0.0010) [2023-12-26 04:24:19,157][123091] Updated weights for policy 0, policy_version 603526 (0.0011) [2023-12-26 04:24:19,227][123091] Updated weights for policy 0, policy_version 603536 (0.0011) [2023-12-26 04:24:19,760][123090] Updated weights for policy 1, policy_version 599361 (0.0010) [2023-12-26 04:24:19,813][123090] Updated weights for policy 1, policy_version 599371 (0.0009) [2023-12-26 04:24:19,885][123090] Updated weights for policy 1, policy_version 599381 (0.0009) [2023-12-26 04:24:19,951][123090] Updated weights for policy 1, policy_version 599391 (0.0009) [2023-12-26 04:24:20,071][123091] Updated weights for policy 0, policy_version 603546 (0.0008) [2023-12-26 04:24:20,120][123091] Updated weights for policy 0, policy_version 603556 (0.0008) [2023-12-26 04:24:20,174][123091] Updated weights for policy 0, policy_version 603566 (0.0008) [2023-12-26 04:24:20,906][123090] Updated weights for policy 1, policy_version 599401 (0.0009) [2023-12-26 04:24:20,932][123091] Updated weights for policy 0, policy_version 603576 (0.0010) [2023-12-26 04:24:20,964][123090] Updated weights for policy 1, policy_version 599411 (0.0010) [2023-12-26 04:24:20,997][123091] Updated weights for policy 0, policy_version 603586 (0.0011) [2023-12-26 04:24:21,026][123090] Updated weights for policy 1, policy_version 599421 (0.0006) [2023-12-26 04:24:21,068][123091] Updated weights for policy 0, policy_version 603596 (0.0010) [2023-12-26 04:24:21,882][123090] Updated weights for policy 1, policy_version 599431 (0.0008) [2023-12-26 04:24:21,933][123091] Updated weights for policy 0, policy_version 603606 (0.0008) [2023-12-26 04:24:21,948][123090] Updated weights for policy 1, policy_version 599441 (0.0008) [2023-12-26 04:24:22,004][123091] Updated weights for policy 0, policy_version 603616 (0.0006) [2023-12-26 04:24:22,012][123090] Updated weights for policy 1, policy_version 599451 (0.0008) [2023-12-26 04:24:22,073][123091] Updated weights for policy 0, policy_version 603626 (0.0005) [2023-12-26 04:24:22,704][123090] Updated weights for policy 1, policy_version 599461 (0.0009) [2023-12-26 04:24:22,756][123090] Updated weights for policy 1, policy_version 599471 (0.0010) [2023-12-26 04:24:22,820][123090] Updated weights for policy 1, policy_version 599481 (0.0011) [2023-12-26 04:24:22,828][123091] Updated weights for policy 0, policy_version 603636 (0.0010) [2023-12-26 04:24:22,891][123091] Updated weights for policy 0, policy_version 603646 (0.0008) [2023-12-26 04:24:22,953][123091] Updated weights for policy 0, policy_version 603656 (0.0010) [2023-12-26 04:24:23,652][123090] Updated weights for policy 1, policy_version 599492 (0.0010) [2023-12-26 04:24:23,720][123090] Updated weights for policy 1, policy_version 599502 (0.0010) [2023-12-26 04:24:23,752][123091] Updated weights for policy 0, policy_version 603666 (0.0010) [2023-12-26 04:24:23,773][123090] Updated weights for policy 1, policy_version 599512 (0.0008) [2023-12-26 04:24:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 308011008. Throughput: 0: 8841.4, 1: 8969.3. Samples: 307994508. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:23,784][121949] Avg episode reward: [(0, '5720.911'), (1, '5624.993')] [2023-12-26 04:24:23,807][123091] Updated weights for policy 0, policy_version 603676 (0.0008) [2023-12-26 04:24:23,813][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000599520_153477120.pth... [2023-12-26 04:24:23,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000598432_153198592.pth [2023-12-26 04:24:23,859][123091] Updated weights for policy 0, policy_version 603686 (0.0010) [2023-12-26 04:24:23,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000603696_154550272.pth... [2023-12-26 04:24:23,907][123091] Updated weights for policy 0, policy_version 603696 (0.0008) [2023-12-26 04:24:23,909][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000602640_154279936.pth [2023-12-26 04:24:24,607][123090] Updated weights for policy 1, policy_version 599522 (0.0008) [2023-12-26 04:24:24,664][123090] Updated weights for policy 1, policy_version 599532 (0.0009) [2023-12-26 04:24:24,712][123090] Updated weights for policy 1, policy_version 599542 (0.0008) [2023-12-26 04:24:24,752][123091] Updated weights for policy 0, policy_version 603706 (0.0008) [2023-12-26 04:24:24,763][123090] Updated weights for policy 1, policy_version 599552 (0.0008) [2023-12-26 04:24:24,799][123091] Updated weights for policy 0, policy_version 603716 (0.0008) [2023-12-26 04:24:24,852][123091] Updated weights for policy 0, policy_version 603726 (0.0007) [2023-12-26 04:24:25,612][123090] Updated weights for policy 1, policy_version 599562 (0.0008) [2023-12-26 04:24:25,675][123090] Updated weights for policy 1, policy_version 599572 (0.0008) [2023-12-26 04:24:25,692][123091] Updated weights for policy 0, policy_version 603736 (0.0009) [2023-12-26 04:24:25,730][123090] Updated weights for policy 1, policy_version 599582 (0.0008) [2023-12-26 04:24:25,744][123091] Updated weights for policy 0, policy_version 603746 (0.0011) [2023-12-26 04:24:25,807][123091] Updated weights for policy 0, policy_version 603756 (0.0010) [2023-12-26 04:24:26,506][123090] Updated weights for policy 1, policy_version 599592 (0.0010) [2023-12-26 04:24:26,565][123091] Updated weights for policy 0, policy_version 603766 (0.0011) [2023-12-26 04:24:26,570][123090] Updated weights for policy 1, policy_version 599602 (0.0011) [2023-12-26 04:24:26,628][123091] Updated weights for policy 0, policy_version 603776 (0.0011) [2023-12-26 04:24:26,631][123090] Updated weights for policy 1, policy_version 599612 (0.0007) [2023-12-26 04:24:26,682][123091] Updated weights for policy 0, policy_version 603786 (0.0010) [2023-12-26 04:24:27,362][123090] Updated weights for policy 1, policy_version 599622 (0.0008) [2023-12-26 04:24:27,409][123090] Updated weights for policy 1, policy_version 599632 (0.0010) [2023-12-26 04:24:27,445][123091] Updated weights for policy 0, policy_version 603796 (0.0010) [2023-12-26 04:24:27,464][123090] Updated weights for policy 1, policy_version 599642 (0.0010) [2023-12-26 04:24:27,492][123091] Updated weights for policy 0, policy_version 603806 (0.0010) [2023-12-26 04:24:27,546][123091] Updated weights for policy 0, policy_version 603816 (0.0010) [2023-12-26 04:24:28,130][123090] Updated weights for policy 1, policy_version 599652 (0.0008) [2023-12-26 04:24:28,178][123090] Updated weights for policy 1, policy_version 599662 (0.0005) [2023-12-26 04:24:28,225][123090] Updated weights for policy 1, policy_version 599672 (0.0005) [2023-12-26 04:24:28,337][123091] Updated weights for policy 0, policy_version 603826 (0.0010) [2023-12-26 04:24:28,402][123091] Updated weights for policy 0, policy_version 603836 (0.0011) [2023-12-26 04:24:28,469][123091] Updated weights for policy 0, policy_version 603846 (0.0008) [2023-12-26 04:24:28,529][123091] Updated weights for policy 0, policy_version 603856 (0.0008) [2023-12-26 04:24:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 308109312. Throughput: 0: 8931.3, 1: 9004.7. Samples: 308101180. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:28,784][121949] Avg episode reward: [(0, '5781.710'), (1, '5776.825')] [2023-12-26 04:24:28,937][123090] Updated weights for policy 1, policy_version 599682 (0.0006) [2023-12-26 04:24:28,997][123090] Updated weights for policy 1, policy_version 599692 (0.0009) [2023-12-26 04:24:29,049][123090] Updated weights for policy 1, policy_version 599702 (0.0009) [2023-12-26 04:24:29,096][123090] Updated weights for policy 1, policy_version 599712 (0.0008) [2023-12-26 04:24:29,328][123091] Updated weights for policy 0, policy_version 603866 (0.0010) [2023-12-26 04:24:29,398][123091] Updated weights for policy 0, policy_version 603876 (0.0009) [2023-12-26 04:24:29,464][123091] Updated weights for policy 0, policy_version 603886 (0.0010) [2023-12-26 04:24:29,950][123090] Updated weights for policy 1, policy_version 599722 (0.0010) [2023-12-26 04:24:30,016][123090] Updated weights for policy 1, policy_version 599732 (0.0009) [2023-12-26 04:24:30,086][123090] Updated weights for policy 1, policy_version 599742 (0.0006) [2023-12-26 04:24:30,284][123091] Updated weights for policy 0, policy_version 603896 (0.0009) [2023-12-26 04:24:30,335][123091] Updated weights for policy 0, policy_version 603906 (0.0009) [2023-12-26 04:24:30,397][123091] Updated weights for policy 0, policy_version 603916 (0.0010) [2023-12-26 04:24:30,836][123090] Updated weights for policy 1, policy_version 599752 (0.0009) [2023-12-26 04:24:30,892][123090] Updated weights for policy 1, policy_version 599762 (0.0009) [2023-12-26 04:24:30,944][123090] Updated weights for policy 1, policy_version 599772 (0.0009) [2023-12-26 04:24:31,256][123091] Updated weights for policy 0, policy_version 603926 (0.0009) [2023-12-26 04:24:31,311][123091] Updated weights for policy 0, policy_version 603936 (0.0008) [2023-12-26 04:24:31,383][123091] Updated weights for policy 0, policy_version 603946 (0.0008) [2023-12-26 04:24:31,805][123090] Updated weights for policy 1, policy_version 599782 (0.0009) [2023-12-26 04:24:31,867][123090] Updated weights for policy 1, policy_version 599792 (0.0005) [2023-12-26 04:24:31,940][123090] Updated weights for policy 1, policy_version 599802 (0.0005) [2023-12-26 04:24:32,186][123091] Updated weights for policy 0, policy_version 603956 (0.0007) [2023-12-26 04:24:32,271][123091] Updated weights for policy 0, policy_version 603966 (0.0010) [2023-12-26 04:24:32,325][123091] Updated weights for policy 0, policy_version 603976 (0.0009) [2023-12-26 04:24:32,686][123090] Updated weights for policy 1, policy_version 599812 (0.0007) [2023-12-26 04:24:32,750][123090] Updated weights for policy 1, policy_version 599822 (0.0010) [2023-12-26 04:24:32,811][123090] Updated weights for policy 1, policy_version 599832 (0.0008) [2023-12-26 04:24:33,069][123091] Updated weights for policy 0, policy_version 603986 (0.0008) [2023-12-26 04:24:33,135][123091] Updated weights for policy 0, policy_version 603996 (0.0005) [2023-12-26 04:24:33,199][123091] Updated weights for policy 0, policy_version 604006 (0.0007) [2023-12-26 04:24:33,247][123091] Updated weights for policy 0, policy_version 604016 (0.0009) [2023-12-26 04:24:33,664][123090] Updated weights for policy 1, policy_version 599842 (0.0009) [2023-12-26 04:24:33,721][123090] Updated weights for policy 1, policy_version 599852 (0.0009) [2023-12-26 04:24:33,784][123090] Updated weights for policy 1, policy_version 599862 (0.0009) [2023-12-26 04:24:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 308191232. Throughput: 0: 8882.8, 1: 9014.7. Samples: 308208064. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:33,785][121949] Avg episode reward: [(0, '5834.237'), (1, '5601.743')] [2023-12-26 04:24:33,832][123090] Updated weights for policy 1, policy_version 599872 (0.0009) [2023-12-26 04:24:34,011][123091] Updated weights for policy 0, policy_version 604026 (0.0010) [2023-12-26 04:24:34,061][123091] Updated weights for policy 0, policy_version 604036 (0.0009) [2023-12-26 04:24:34,112][123091] Updated weights for policy 0, policy_version 604046 (0.0009) [2023-12-26 04:24:34,682][123090] Updated weights for policy 1, policy_version 599882 (0.0010) [2023-12-26 04:24:34,739][123090] Updated weights for policy 1, policy_version 599892 (0.0009) [2023-12-26 04:24:34,789][123090] Updated weights for policy 1, policy_version 599902 (0.0008) [2023-12-26 04:24:34,956][123091] Updated weights for policy 0, policy_version 604056 (0.0009) [2023-12-26 04:24:35,018][123091] Updated weights for policy 0, policy_version 604066 (0.0009) [2023-12-26 04:24:35,067][123091] Updated weights for policy 0, policy_version 604076 (0.0005) [2023-12-26 04:24:35,637][123090] Updated weights for policy 1, policy_version 599912 (0.0010) [2023-12-26 04:24:35,688][123090] Updated weights for policy 1, policy_version 599922 (0.0010) [2023-12-26 04:24:35,746][123090] Updated weights for policy 1, policy_version 599932 (0.0010) [2023-12-26 04:24:35,851][123091] Updated weights for policy 0, policy_version 604086 (0.0008) [2023-12-26 04:24:35,903][123091] Updated weights for policy 0, policy_version 604096 (0.0009) [2023-12-26 04:24:35,954][123091] Updated weights for policy 0, policy_version 604106 (0.0010) [2023-12-26 04:24:36,590][123090] Updated weights for policy 1, policy_version 599942 (0.0008) [2023-12-26 04:24:36,653][123090] Updated weights for policy 1, policy_version 599952 (0.0010) [2023-12-26 04:24:36,716][123090] Updated weights for policy 1, policy_version 599962 (0.0010) [2023-12-26 04:24:36,789][123091] Updated weights for policy 0, policy_version 604116 (0.0007) [2023-12-26 04:24:36,839][123091] Updated weights for policy 0, policy_version 604126 (0.0009) [2023-12-26 04:24:36,896][123091] Updated weights for policy 0, policy_version 604136 (0.0009) [2023-12-26 04:24:37,589][123090] Updated weights for policy 1, policy_version 599972 (0.0009) [2023-12-26 04:24:37,656][123090] Updated weights for policy 1, policy_version 599982 (0.0009) [2023-12-26 04:24:37,706][123090] Updated weights for policy 1, policy_version 599992 (0.0009) [2023-12-26 04:24:37,729][123091] Updated weights for policy 0, policy_version 604146 (0.0008) [2023-12-26 04:24:37,783][123091] Updated weights for policy 0, policy_version 604156 (0.0005) [2023-12-26 04:24:37,835][123091] Updated weights for policy 0, policy_version 604166 (0.0006) [2023-12-26 04:24:37,899][123091] Updated weights for policy 0, policy_version 604176 (0.0005) [2023-12-26 04:24:38,518][123091] Updated weights for policy 0, policy_version 604186 (0.0006) [2023-12-26 04:24:38,580][123091] Updated weights for policy 0, policy_version 604196 (0.0006) [2023-12-26 04:24:38,643][123090] Updated weights for policy 1, policy_version 600002 (0.0009) [2023-12-26 04:24:38,648][123091] Updated weights for policy 0, policy_version 604206 (0.0006) [2023-12-26 04:24:38,716][123090] Updated weights for policy 1, policy_version 600012 (0.0010) [2023-12-26 04:24:38,774][123090] Updated weights for policy 1, policy_version 600022 (0.0009) [2023-12-26 04:24:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 308281344. Throughput: 0: 8903.5, 1: 9020.7. Samples: 308259520. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:38,785][121949] Avg episode reward: [(0, '5851.284'), (1, '5637.961')] [2023-12-26 04:24:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000604208_154681344.pth... [2023-12-26 04:24:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000603152_154411008.pth [2023-12-26 04:24:38,836][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000600032_153608192.pth... [2023-12-26 04:24:38,837][123090] Updated weights for policy 1, policy_version 600032 (0.0009) [2023-12-26 04:24:38,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000598976_153337856.pth [2023-12-26 04:24:39,423][123091] Updated weights for policy 0, policy_version 604216 (0.0011) [2023-12-26 04:24:39,495][123091] Updated weights for policy 0, policy_version 604226 (0.0011) [2023-12-26 04:24:39,563][123091] Updated weights for policy 0, policy_version 604236 (0.0011) [2023-12-26 04:24:39,676][123090] Updated weights for policy 1, policy_version 600042 (0.0009) [2023-12-26 04:24:39,725][123090] Updated weights for policy 1, policy_version 600052 (0.0009) [2023-12-26 04:24:39,783][123090] Updated weights for policy 1, policy_version 600062 (0.0009) [2023-12-26 04:24:40,411][123091] Updated weights for policy 0, policy_version 604246 (0.0010) [2023-12-26 04:24:40,471][123091] Updated weights for policy 0, policy_version 604256 (0.0010) [2023-12-26 04:24:40,526][123091] Updated weights for policy 0, policy_version 604266 (0.0010) [2023-12-26 04:24:40,679][123090] Updated weights for policy 1, policy_version 600072 (0.0009) [2023-12-26 04:24:40,749][123090] Updated weights for policy 1, policy_version 600082 (0.0009) [2023-12-26 04:24:40,811][123090] Updated weights for policy 1, policy_version 600092 (0.0010) [2023-12-26 04:24:41,365][123091] Updated weights for policy 0, policy_version 604276 (0.0009) [2023-12-26 04:24:41,428][123091] Updated weights for policy 0, policy_version 604286 (0.0010) [2023-12-26 04:24:41,480][123091] Updated weights for policy 0, policy_version 604296 (0.0010) [2023-12-26 04:24:41,697][123090] Updated weights for policy 1, policy_version 600102 (0.0009) [2023-12-26 04:24:41,766][123090] Updated weights for policy 1, policy_version 600112 (0.0010) [2023-12-26 04:24:41,825][123090] Updated weights for policy 1, policy_version 600122 (0.0010) [2023-12-26 04:24:42,281][123091] Updated weights for policy 0, policy_version 604306 (0.0010) [2023-12-26 04:24:42,356][123091] Updated weights for policy 0, policy_version 604316 (0.0010) [2023-12-26 04:24:42,417][123091] Updated weights for policy 0, policy_version 604326 (0.0006) [2023-12-26 04:24:42,484][123091] Updated weights for policy 0, policy_version 604336 (0.0006) [2023-12-26 04:24:42,728][123090] Updated weights for policy 1, policy_version 600132 (0.0010) [2023-12-26 04:24:42,799][123090] Updated weights for policy 1, policy_version 600142 (0.0010) [2023-12-26 04:24:42,854][123090] Updated weights for policy 1, policy_version 600152 (0.0009) [2023-12-26 04:24:43,258][123091] Updated weights for policy 0, policy_version 604346 (0.0009) [2023-12-26 04:24:43,321][123091] Updated weights for policy 0, policy_version 604356 (0.0011) [2023-12-26 04:24:43,381][123091] Updated weights for policy 0, policy_version 604366 (0.0009) [2023-12-26 04:24:43,526][123090] Updated weights for policy 1, policy_version 600162 (0.0007) [2023-12-26 04:24:43,582][123090] Updated weights for policy 1, policy_version 600172 (0.0009) [2023-12-26 04:24:43,650][123090] Updated weights for policy 1, policy_version 600182 (0.0010) [2023-12-26 04:24:43,711][123090] Updated weights for policy 1, policy_version 600192 (0.0010) [2023-12-26 04:24:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 308371456. Throughput: 0: 8806.2, 1: 8872.0. Samples: 308361380. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:43,784][121949] Avg episode reward: [(0, '5866.578'), (1, '5599.080')] [2023-12-26 04:24:44,192][123091] Updated weights for policy 0, policy_version 604377 (0.0010) [2023-12-26 04:24:44,260][123091] Updated weights for policy 0, policy_version 604387 (0.0010) [2023-12-26 04:24:44,326][123091] Updated weights for policy 0, policy_version 604397 (0.0009) [2023-12-26 04:24:44,537][123090] Updated weights for policy 1, policy_version 600202 (0.0010) [2023-12-26 04:24:44,608][123090] Updated weights for policy 1, policy_version 600212 (0.0009) [2023-12-26 04:24:44,660][123090] Updated weights for policy 1, policy_version 600222 (0.0009) [2023-12-26 04:24:45,127][123091] Updated weights for policy 0, policy_version 604407 (0.0007) [2023-12-26 04:24:45,202][123091] Updated weights for policy 0, policy_version 604417 (0.0006) [2023-12-26 04:24:45,278][123091] Updated weights for policy 0, policy_version 604427 (0.0006) [2023-12-26 04:24:45,525][123090] Updated weights for policy 1, policy_version 600232 (0.0006) [2023-12-26 04:24:45,600][123090] Updated weights for policy 1, policy_version 600242 (0.0007) [2023-12-26 04:24:45,653][123090] Updated weights for policy 1, policy_version 600252 (0.0009) [2023-12-26 04:24:45,909][123091] Updated weights for policy 0, policy_version 604437 (0.0008) [2023-12-26 04:24:45,957][123091] Updated weights for policy 0, policy_version 604447 (0.0009) [2023-12-26 04:24:46,006][123091] Updated weights for policy 0, policy_version 604457 (0.0009) [2023-12-26 04:24:46,439][123090] Updated weights for policy 1, policy_version 600262 (0.0010) [2023-12-26 04:24:46,503][123090] Updated weights for policy 1, policy_version 600272 (0.0009) [2023-12-26 04:24:46,565][123090] Updated weights for policy 1, policy_version 600282 (0.0009) [2023-12-26 04:24:46,824][123091] Updated weights for policy 0, policy_version 604467 (0.0008) [2023-12-26 04:24:46,897][123091] Updated weights for policy 0, policy_version 604477 (0.0008) [2023-12-26 04:24:46,959][123091] Updated weights for policy 0, policy_version 604487 (0.0009) [2023-12-26 04:24:47,398][123090] Updated weights for policy 1, policy_version 600292 (0.0009) [2023-12-26 04:24:47,460][123090] Updated weights for policy 1, policy_version 600302 (0.0009) [2023-12-26 04:24:47,519][123090] Updated weights for policy 1, policy_version 600312 (0.0009) [2023-12-26 04:24:47,690][123091] Updated weights for policy 0, policy_version 604497 (0.0010) [2023-12-26 04:24:47,746][123091] Updated weights for policy 0, policy_version 604507 (0.0010) [2023-12-26 04:24:47,797][123091] Updated weights for policy 0, policy_version 604517 (0.0009) [2023-12-26 04:24:47,850][123091] Updated weights for policy 0, policy_version 604527 (0.0010) [2023-12-26 04:24:48,368][123090] Updated weights for policy 1, policy_version 600322 (0.0009) [2023-12-26 04:24:48,433][123090] Updated weights for policy 1, policy_version 600332 (0.0010) [2023-12-26 04:24:48,501][123090] Updated weights for policy 1, policy_version 600342 (0.0009) [2023-12-26 04:24:48,563][123090] Updated weights for policy 1, policy_version 600352 (0.0009) [2023-12-26 04:24:48,693][123091] Updated weights for policy 0, policy_version 604537 (0.0009) [2023-12-26 04:24:48,751][123091] Updated weights for policy 0, policy_version 604547 (0.0010) [2023-12-26 04:24:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 308453376. Throughput: 0: 8804.4, 1: 8890.8. Samples: 308465908. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:48,785][121949] Avg episode reward: [(0, '5742.959'), (1, '5652.750')] [2023-12-26 04:24:48,823][123091] Updated weights for policy 0, policy_version 604557 (0.0010) [2023-12-26 04:24:49,437][123090] Updated weights for policy 1, policy_version 600362 (0.0009) [2023-12-26 04:24:49,494][123090] Updated weights for policy 1, policy_version 600372 (0.0009) [2023-12-26 04:24:49,552][123090] Updated weights for policy 1, policy_version 600382 (0.0010) [2023-12-26 04:24:49,623][123091] Updated weights for policy 0, policy_version 604567 (0.0007) [2023-12-26 04:24:49,695][123091] Updated weights for policy 0, policy_version 604577 (0.0005) [2023-12-26 04:24:49,762][123091] Updated weights for policy 0, policy_version 604587 (0.0006) [2023-12-26 04:24:50,457][123090] Updated weights for policy 1, policy_version 600392 (0.0009) [2023-12-26 04:24:50,519][123091] Updated weights for policy 0, policy_version 604597 (0.0007) [2023-12-26 04:24:50,521][123090] Updated weights for policy 1, policy_version 600402 (0.0009) [2023-12-26 04:24:50,587][123091] Updated weights for policy 0, policy_version 604607 (0.0008) [2023-12-26 04:24:50,595][123090] Updated weights for policy 1, policy_version 600412 (0.0009) [2023-12-26 04:24:50,657][123091] Updated weights for policy 0, policy_version 604617 (0.0009) [2023-12-26 04:24:51,413][123090] Updated weights for policy 1, policy_version 600422 (0.0007) [2023-12-26 04:24:51,447][123091] Updated weights for policy 0, policy_version 604627 (0.0009) [2023-12-26 04:24:51,481][123090] Updated weights for policy 1, policy_version 600432 (0.0008) [2023-12-26 04:24:51,502][123091] Updated weights for policy 0, policy_version 604637 (0.0006) [2023-12-26 04:24:51,546][123090] Updated weights for policy 1, policy_version 600442 (0.0009) [2023-12-26 04:24:51,568][123091] Updated weights for policy 0, policy_version 604647 (0.0008) [2023-12-26 04:24:52,332][123090] Updated weights for policy 1, policy_version 600452 (0.0010) [2023-12-26 04:24:52,401][123090] Updated weights for policy 1, policy_version 600462 (0.0009) [2023-12-26 04:24:52,419][123091] Updated weights for policy 0, policy_version 604657 (0.0009) [2023-12-26 04:24:52,455][123090] Updated weights for policy 1, policy_version 600472 (0.0009) [2023-12-26 04:24:52,478][123091] Updated weights for policy 0, policy_version 604667 (0.0010) [2023-12-26 04:24:52,534][123091] Updated weights for policy 0, policy_version 604677 (0.0007) [2023-12-26 04:24:52,593][123091] Updated weights for policy 0, policy_version 604687 (0.0005) [2023-12-26 04:24:53,262][123091] Updated weights for policy 0, policy_version 604697 (0.0007) [2023-12-26 04:24:53,277][123090] Updated weights for policy 1, policy_version 600482 (0.0006) [2023-12-26 04:24:53,306][123091] Updated weights for policy 0, policy_version 604707 (0.0010) [2023-12-26 04:24:53,350][123090] Updated weights for policy 1, policy_version 600492 (0.0005) [2023-12-26 04:24:53,357][123091] Updated weights for policy 0, policy_version 604717 (0.0010) [2023-12-26 04:24:53,418][123090] Updated weights for policy 1, policy_version 600502 (0.0005) [2023-12-26 04:24:53,478][123090] Updated weights for policy 1, policy_version 600512 (0.0005) [2023-12-26 04:24:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 308543488. Throughput: 0: 8879.2, 1: 8766.9. Samples: 308517836. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:53,785][121949] Avg episode reward: [(0, '5837.540'), (1, '5674.755')] [2023-12-26 04:24:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000604720_154812416.pth... [2023-12-26 04:24:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000600512_153731072.pth... [2023-12-26 04:24:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000603696_154550272.pth [2023-12-26 04:24:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000599520_153477120.pth [2023-12-26 04:24:54,061][123090] Updated weights for policy 1, policy_version 600522 (0.0007) [2023-12-26 04:24:54,118][123090] Updated weights for policy 1, policy_version 600532 (0.0005) [2023-12-26 04:24:54,174][123090] Updated weights for policy 1, policy_version 600542 (0.0006) [2023-12-26 04:24:54,193][123091] Updated weights for policy 0, policy_version 604727 (0.0010) [2023-12-26 04:24:54,256][123091] Updated weights for policy 0, policy_version 604737 (0.0011) [2023-12-26 04:24:54,318][123091] Updated weights for policy 0, policy_version 604747 (0.0011) [2023-12-26 04:24:54,855][123090] Updated weights for policy 1, policy_version 600552 (0.0005) [2023-12-26 04:24:54,929][123090] Updated weights for policy 1, policy_version 600562 (0.0007) [2023-12-26 04:24:54,997][123090] Updated weights for policy 1, policy_version 600572 (0.0006) [2023-12-26 04:24:55,146][123091] Updated weights for policy 0, policy_version 604757 (0.0010) [2023-12-26 04:24:55,211][123091] Updated weights for policy 0, policy_version 604767 (0.0010) [2023-12-26 04:24:55,274][123091] Updated weights for policy 0, policy_version 604777 (0.0009) [2023-12-26 04:24:55,656][123090] Updated weights for policy 1, policy_version 600582 (0.0006) [2023-12-26 04:24:55,715][123090] Updated weights for policy 1, policy_version 600592 (0.0005) [2023-12-26 04:24:55,776][123090] Updated weights for policy 1, policy_version 600602 (0.0006) [2023-12-26 04:24:56,021][123091] Updated weights for policy 0, policy_version 604787 (0.0008) [2023-12-26 04:24:56,082][123091] Updated weights for policy 0, policy_version 604797 (0.0008) [2023-12-26 04:24:56,148][123091] Updated weights for policy 0, policy_version 604807 (0.0008) [2023-12-26 04:24:56,499][123090] Updated weights for policy 1, policy_version 600612 (0.0011) [2023-12-26 04:24:56,560][123090] Updated weights for policy 1, policy_version 600622 (0.0009) [2023-12-26 04:24:56,619][123090] Updated weights for policy 1, policy_version 600632 (0.0010) [2023-12-26 04:24:56,943][123091] Updated weights for policy 0, policy_version 604817 (0.0008) [2023-12-26 04:24:56,995][123091] Updated weights for policy 0, policy_version 604827 (0.0009) [2023-12-26 04:24:57,048][123091] Updated weights for policy 0, policy_version 604837 (0.0009) [2023-12-26 04:24:57,099][123091] Updated weights for policy 0, policy_version 604847 (0.0009) [2023-12-26 04:24:57,285][123090] Updated weights for policy 1, policy_version 600642 (0.0009) [2023-12-26 04:24:57,357][123090] Updated weights for policy 1, policy_version 600652 (0.0005) [2023-12-26 04:24:57,419][123090] Updated weights for policy 1, policy_version 600662 (0.0005) [2023-12-26 04:24:57,472][123090] Updated weights for policy 1, policy_version 600672 (0.0005) [2023-12-26 04:24:57,889][123091] Updated weights for policy 0, policy_version 604857 (0.0006) [2023-12-26 04:24:57,935][123091] Updated weights for policy 0, policy_version 604867 (0.0005) [2023-12-26 04:24:58,012][123091] Updated weights for policy 0, policy_version 604877 (0.0006) [2023-12-26 04:24:58,286][123090] Updated weights for policy 1, policy_version 600682 (0.0010) [2023-12-26 04:24:58,358][123090] Updated weights for policy 1, policy_version 600692 (0.0009) [2023-12-26 04:24:58,427][123090] Updated weights for policy 1, policy_version 600702 (0.0010) [2023-12-26 04:24:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 308633600. Throughput: 0: 8900.7, 1: 8874.8. Samples: 308630076. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:24:58,785][121949] Avg episode reward: [(0, '6050.932'), (1, '5609.156')] [2023-12-26 04:24:58,848][123091] Updated weights for policy 0, policy_version 604887 (0.0009) [2023-12-26 04:24:58,912][123091] Updated weights for policy 0, policy_version 604897 (0.0010) [2023-12-26 04:24:58,975][123091] Updated weights for policy 0, policy_version 604907 (0.0009) [2023-12-26 04:24:59,287][123090] Updated weights for policy 1, policy_version 600712 (0.0008) [2023-12-26 04:24:59,349][123090] Updated weights for policy 1, policy_version 600722 (0.0008) [2023-12-26 04:24:59,425][123090] Updated weights for policy 1, policy_version 600732 (0.0008) [2023-12-26 04:24:59,868][123091] Updated weights for policy 0, policy_version 604917 (0.0009) [2023-12-26 04:24:59,932][123091] Updated weights for policy 0, policy_version 604927 (0.0010) [2023-12-26 04:24:59,998][123091] Updated weights for policy 0, policy_version 604937 (0.0007) [2023-12-26 04:25:00,171][123090] Updated weights for policy 1, policy_version 600742 (0.0008) [2023-12-26 04:25:00,227][123090] Updated weights for policy 1, policy_version 600752 (0.0010) [2023-12-26 04:25:00,284][123090] Updated weights for policy 1, policy_version 600762 (0.0008) [2023-12-26 04:25:00,800][123091] Updated weights for policy 0, policy_version 604947 (0.0008) [2023-12-26 04:25:00,854][123091] Updated weights for policy 0, policy_version 604957 (0.0009) [2023-12-26 04:25:00,917][123091] Updated weights for policy 0, policy_version 604967 (0.0009) [2023-12-26 04:25:01,032][123090] Updated weights for policy 1, policy_version 600772 (0.0007) [2023-12-26 04:25:01,091][123090] Updated weights for policy 1, policy_version 600782 (0.0007) [2023-12-26 04:25:01,157][123090] Updated weights for policy 1, policy_version 600792 (0.0006) [2023-12-26 04:25:01,828][123091] Updated weights for policy 0, policy_version 604977 (0.0010) [2023-12-26 04:25:01,876][123090] Updated weights for policy 1, policy_version 600802 (0.0006) [2023-12-26 04:25:01,887][123091] Updated weights for policy 0, policy_version 604987 (0.0009) [2023-12-26 04:25:01,932][123090] Updated weights for policy 1, policy_version 600812 (0.0005) [2023-12-26 04:25:01,941][123091] Updated weights for policy 0, policy_version 604997 (0.0008) [2023-12-26 04:25:01,983][123090] Updated weights for policy 1, policy_version 600822 (0.0005) [2023-12-26 04:25:01,989][123091] Updated weights for policy 0, policy_version 605007 (0.0009) [2023-12-26 04:25:02,042][123090] Updated weights for policy 1, policy_version 600832 (0.0007) [2023-12-26 04:25:02,781][123090] Updated weights for policy 1, policy_version 600842 (0.0010) [2023-12-26 04:25:02,839][123090] Updated weights for policy 1, policy_version 600852 (0.0010) [2023-12-26 04:25:02,901][123090] Updated weights for policy 1, policy_version 600862 (0.0010) [2023-12-26 04:25:02,917][123091] Updated weights for policy 0, policy_version 605017 (0.0006) [2023-12-26 04:25:02,970][123091] Updated weights for policy 0, policy_version 605027 (0.0009) [2023-12-26 04:25:03,025][123091] Updated weights for policy 0, policy_version 605037 (0.0009) [2023-12-26 04:25:03,565][123090] Updated weights for policy 1, policy_version 600872 (0.0006) [2023-12-26 04:25:03,628][123090] Updated weights for policy 1, policy_version 600882 (0.0005) [2023-12-26 04:25:03,687][123090] Updated weights for policy 1, policy_version 600892 (0.0005) [2023-12-26 04:25:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 308723712. Throughput: 0: 8778.4, 1: 8783.9. Samples: 308734600. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:03,785][121949] Avg episode reward: [(0, '5929.737'), (1, '5480.453')] [2023-12-26 04:25:03,970][123091] Updated weights for policy 0, policy_version 605047 (0.0008) [2023-12-26 04:25:04,037][123091] Updated weights for policy 0, policy_version 605057 (0.0005) [2023-12-26 04:25:04,091][123091] Updated weights for policy 0, policy_version 605067 (0.0006) [2023-12-26 04:25:04,440][123090] Updated weights for policy 1, policy_version 600902 (0.0008) [2023-12-26 04:25:04,496][123090] Updated weights for policy 1, policy_version 600912 (0.0010) [2023-12-26 04:25:04,555][123090] Updated weights for policy 1, policy_version 600922 (0.0010) [2023-12-26 04:25:04,877][123091] Updated weights for policy 0, policy_version 605077 (0.0009) [2023-12-26 04:25:04,933][123091] Updated weights for policy 0, policy_version 605087 (0.0009) [2023-12-26 04:25:04,996][123091] Updated weights for policy 0, policy_version 605097 (0.0008) [2023-12-26 04:25:05,330][123090] Updated weights for policy 1, policy_version 600932 (0.0008) [2023-12-26 04:25:05,397][123090] Updated weights for policy 1, policy_version 600942 (0.0005) [2023-12-26 04:25:05,463][123090] Updated weights for policy 1, policy_version 600952 (0.0005) [2023-12-26 04:25:05,944][123091] Updated weights for policy 0, policy_version 605107 (0.0010) [2023-12-26 04:25:06,000][123091] Updated weights for policy 0, policy_version 605118 (0.0011) [2023-12-26 04:25:06,059][123091] Updated weights for policy 0, policy_version 605128 (0.0010) [2023-12-26 04:25:06,098][123090] Updated weights for policy 1, policy_version 600962 (0.0006) [2023-12-26 04:25:06,164][123090] Updated weights for policy 1, policy_version 600972 (0.0008) [2023-12-26 04:25:06,235][123090] Updated weights for policy 1, policy_version 600982 (0.0007) [2023-12-26 04:25:06,292][123090] Updated weights for policy 1, policy_version 600992 (0.0008) [2023-12-26 04:25:06,975][123091] Updated weights for policy 0, policy_version 605139 (0.0010) [2023-12-26 04:25:07,023][123090] Updated weights for policy 1, policy_version 601002 (0.0008) [2023-12-26 04:25:07,032][123091] Updated weights for policy 0, policy_version 605149 (0.0009) [2023-12-26 04:25:07,086][123090] Updated weights for policy 1, policy_version 601012 (0.0008) [2023-12-26 04:25:07,094][123091] Updated weights for policy 0, policy_version 605159 (0.0008) [2023-12-26 04:25:07,145][123090] Updated weights for policy 1, policy_version 601022 (0.0008) [2023-12-26 04:25:07,931][123091] Updated weights for policy 0, policy_version 605169 (0.0008) [2023-12-26 04:25:07,971][123090] Updated weights for policy 1, policy_version 601032 (0.0006) [2023-12-26 04:25:07,989][123091] Updated weights for policy 0, policy_version 605179 (0.0009) [2023-12-26 04:25:08,039][123090] Updated weights for policy 1, policy_version 601042 (0.0005) [2023-12-26 04:25:08,042][123091] Updated weights for policy 0, policy_version 605189 (0.0008) [2023-12-26 04:25:08,096][123090] Updated weights for policy 1, policy_version 601052 (0.0005) [2023-12-26 04:25:08,097][123091] Updated weights for policy 0, policy_version 605199 (0.0009) [2023-12-26 04:25:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 308805632. Throughput: 0: 8731.1, 1: 8892.6. Samples: 308787576. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:08,785][121949] Avg episode reward: [(0, '5828.865'), (1, '5187.335')] [2023-12-26 04:25:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000605200_154935296.pth... [2023-12-26 04:25:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000604208_154681344.pth [2023-12-26 04:25:08,803][123090] Updated weights for policy 1, policy_version 601062 (0.0008) [2023-12-26 04:25:08,851][123090] Updated weights for policy 1, policy_version 601072 (0.0010) [2023-12-26 04:25:08,904][123090] Updated weights for policy 1, policy_version 601082 (0.0010) [2023-12-26 04:25:08,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000601088_153878528.pth... [2023-12-26 04:25:08,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000600032_153608192.pth [2023-12-26 04:25:08,947][123091] Updated weights for policy 0, policy_version 605209 (0.0008) [2023-12-26 04:25:09,008][123091] Updated weights for policy 0, policy_version 605219 (0.0009) [2023-12-26 04:25:09,069][123091] Updated weights for policy 0, policy_version 605229 (0.0008) [2023-12-26 04:25:09,771][123090] Updated weights for policy 1, policy_version 601092 (0.0011) [2023-12-26 04:25:09,844][123090] Updated weights for policy 1, policy_version 601102 (0.0011) [2023-12-26 04:25:09,900][123090] Updated weights for policy 1, policy_version 601112 (0.0009) [2023-12-26 04:25:09,935][123091] Updated weights for policy 0, policy_version 605239 (0.0008) [2023-12-26 04:25:10,000][123091] Updated weights for policy 0, policy_version 605249 (0.0008) [2023-12-26 04:25:10,062][123091] Updated weights for policy 0, policy_version 605259 (0.0010) [2023-12-26 04:25:10,618][123090] Updated weights for policy 1, policy_version 601122 (0.0010) [2023-12-26 04:25:10,681][123090] Updated weights for policy 1, policy_version 601132 (0.0010) [2023-12-26 04:25:10,743][123090] Updated weights for policy 1, policy_version 601142 (0.0010) [2023-12-26 04:25:10,798][123090] Updated weights for policy 1, policy_version 601152 (0.0010) [2023-12-26 04:25:10,951][123091] Updated weights for policy 0, policy_version 605269 (0.0010) [2023-12-26 04:25:11,016][123091] Updated weights for policy 0, policy_version 605279 (0.0009) [2023-12-26 04:25:11,086][123091] Updated weights for policy 0, policy_version 605289 (0.0009) [2023-12-26 04:25:11,614][123090] Updated weights for policy 1, policy_version 601162 (0.0011) [2023-12-26 04:25:11,682][123090] Updated weights for policy 1, policy_version 601172 (0.0010) [2023-12-26 04:25:11,751][123090] Updated weights for policy 1, policy_version 601182 (0.0011) [2023-12-26 04:25:11,858][123091] Updated weights for policy 0, policy_version 605299 (0.0010) [2023-12-26 04:25:11,921][123091] Updated weights for policy 0, policy_version 605309 (0.0008) [2023-12-26 04:25:11,992][123091] Updated weights for policy 0, policy_version 605319 (0.0008) [2023-12-26 04:25:12,590][123090] Updated weights for policy 1, policy_version 601192 (0.0011) [2023-12-26 04:25:12,670][123090] Updated weights for policy 1, policy_version 601202 (0.0011) [2023-12-26 04:25:12,733][123090] Updated weights for policy 1, policy_version 601212 (0.0006) [2023-12-26 04:25:12,778][123091] Updated weights for policy 0, policy_version 605329 (0.0009) [2023-12-26 04:25:12,840][123091] Updated weights for policy 0, policy_version 605339 (0.0009) [2023-12-26 04:25:12,889][123091] Updated weights for policy 0, policy_version 605349 (0.0008) [2023-12-26 04:25:12,939][123091] Updated weights for policy 0, policy_version 605359 (0.0009) [2023-12-26 04:25:13,492][123090] Updated weights for policy 1, policy_version 601222 (0.0008) [2023-12-26 04:25:13,555][123090] Updated weights for policy 1, policy_version 601232 (0.0010) [2023-12-26 04:25:13,613][123090] Updated weights for policy 1, policy_version 601242 (0.0010) [2023-12-26 04:25:13,780][123091] Updated weights for policy 0, policy_version 605369 (0.0010) [2023-12-26 04:25:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 308895744. Throughput: 0: 8659.3, 1: 8877.4. Samples: 308890332. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:13,785][121949] Avg episode reward: [(0, '5696.884'), (1, '5252.149')] [2023-12-26 04:25:13,835][123091] Updated weights for policy 0, policy_version 605379 (0.0010) [2023-12-26 04:25:13,887][123091] Updated weights for policy 0, policy_version 605389 (0.0005) [2023-12-26 04:25:14,312][123090] Updated weights for policy 1, policy_version 601252 (0.0009) [2023-12-26 04:25:14,379][123090] Updated weights for policy 1, policy_version 601262 (0.0010) [2023-12-26 04:25:14,454][123090] Updated weights for policy 1, policy_version 601272 (0.0011) [2023-12-26 04:25:14,647][123091] Updated weights for policy 0, policy_version 605399 (0.0005) [2023-12-26 04:25:14,712][123091] Updated weights for policy 0, policy_version 605409 (0.0005) [2023-12-26 04:25:14,780][123091] Updated weights for policy 0, policy_version 605419 (0.0007) [2023-12-26 04:25:15,252][123090] Updated weights for policy 1, policy_version 601282 (0.0010) [2023-12-26 04:25:15,317][123090] Updated weights for policy 1, policy_version 601292 (0.0010) [2023-12-26 04:25:15,390][123090] Updated weights for policy 1, policy_version 601302 (0.0011) [2023-12-26 04:25:15,464][123090] Updated weights for policy 1, policy_version 601312 (0.0011) [2023-12-26 04:25:15,600][123091] Updated weights for policy 0, policy_version 605429 (0.0010) [2023-12-26 04:25:15,666][123091] Updated weights for policy 0, policy_version 605439 (0.0009) [2023-12-26 04:25:15,720][123091] Updated weights for policy 0, policy_version 605449 (0.0009) [2023-12-26 04:25:16,201][123090] Updated weights for policy 1, policy_version 601322 (0.0006) [2023-12-26 04:25:16,265][123090] Updated weights for policy 1, policy_version 601332 (0.0007) [2023-12-26 04:25:16,322][123090] Updated weights for policy 1, policy_version 601342 (0.0006) [2023-12-26 04:25:16,573][123091] Updated weights for policy 0, policy_version 605460 (0.0009) [2023-12-26 04:25:16,626][123091] Updated weights for policy 0, policy_version 605470 (0.0005) [2023-12-26 04:25:16,688][123091] Updated weights for policy 0, policy_version 605480 (0.0010) [2023-12-26 04:25:16,979][123090] Updated weights for policy 1, policy_version 601352 (0.0006) [2023-12-26 04:25:17,030][123090] Updated weights for policy 1, policy_version 601362 (0.0009) [2023-12-26 04:25:17,081][123090] Updated weights for policy 1, policy_version 601372 (0.0010) [2023-12-26 04:25:17,457][123091] Updated weights for policy 0, policy_version 605490 (0.0010) [2023-12-26 04:25:17,506][123091] Updated weights for policy 0, policy_version 605500 (0.0008) [2023-12-26 04:25:17,558][123091] Updated weights for policy 0, policy_version 605510 (0.0010) [2023-12-26 04:25:17,604][123091] Updated weights for policy 0, policy_version 605520 (0.0010) [2023-12-26 04:25:17,891][123090] Updated weights for policy 1, policy_version 601382 (0.0010) [2023-12-26 04:25:17,938][123090] Updated weights for policy 1, policy_version 601392 (0.0010) [2023-12-26 04:25:17,986][123090] Updated weights for policy 1, policy_version 601402 (0.0010) [2023-12-26 04:25:18,471][123091] Updated weights for policy 0, policy_version 605530 (0.0011) [2023-12-26 04:25:18,545][123091] Updated weights for policy 0, policy_version 605540 (0.0010) [2023-12-26 04:25:18,603][123091] Updated weights for policy 0, policy_version 605550 (0.0011) [2023-12-26 04:25:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 308985856. Throughput: 0: 8659.5, 1: 8885.7. Samples: 308997596. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:18,785][121949] Avg episode reward: [(0, '5786.020'), (1, '5358.582')] [2023-12-26 04:25:18,839][123090] Updated weights for policy 1, policy_version 601412 (0.0011) [2023-12-26 04:25:18,902][123090] Updated weights for policy 1, policy_version 601422 (0.0011) [2023-12-26 04:25:18,954][123090] Updated weights for policy 1, policy_version 601432 (0.0006) [2023-12-26 04:25:19,423][123091] Updated weights for policy 0, policy_version 605560 (0.0009) [2023-12-26 04:25:19,485][123091] Updated weights for policy 0, policy_version 605570 (0.0009) [2023-12-26 04:25:19,550][123091] Updated weights for policy 0, policy_version 605580 (0.0007) [2023-12-26 04:25:19,719][123090] Updated weights for policy 1, policy_version 601442 (0.0005) [2023-12-26 04:25:19,792][123090] Updated weights for policy 1, policy_version 601452 (0.0007) [2023-12-26 04:25:19,868][123090] Updated weights for policy 1, policy_version 601462 (0.0009) [2023-12-26 04:25:19,941][123090] Updated weights for policy 1, policy_version 601472 (0.0009) [2023-12-26 04:25:20,428][123091] Updated weights for policy 0, policy_version 605590 (0.0008) [2023-12-26 04:25:20,492][123091] Updated weights for policy 0, policy_version 605600 (0.0009) [2023-12-26 04:25:20,569][123091] Updated weights for policy 0, policy_version 605610 (0.0009) [2023-12-26 04:25:20,696][123090] Updated weights for policy 1, policy_version 601482 (0.0011) [2023-12-26 04:25:20,760][123090] Updated weights for policy 1, policy_version 601492 (0.0011) [2023-12-26 04:25:20,821][123090] Updated weights for policy 1, policy_version 601502 (0.0008) [2023-12-26 04:25:21,447][123091] Updated weights for policy 0, policy_version 605620 (0.0010) [2023-12-26 04:25:21,515][123091] Updated weights for policy 0, policy_version 605630 (0.0008) [2023-12-26 04:25:21,590][123091] Updated weights for policy 0, policy_version 605640 (0.0007) [2023-12-26 04:25:21,611][123090] Updated weights for policy 1, policy_version 601512 (0.0007) [2023-12-26 04:25:21,679][123090] Updated weights for policy 1, policy_version 601522 (0.0009) [2023-12-26 04:25:21,754][123090] Updated weights for policy 1, policy_version 601532 (0.0009) [2023-12-26 04:25:22,455][123091] Updated weights for policy 0, policy_version 605650 (0.0009) [2023-12-26 04:25:22,505][123090] Updated weights for policy 1, policy_version 601542 (0.0010) [2023-12-26 04:25:22,519][123091] Updated weights for policy 0, policy_version 605660 (0.0007) [2023-12-26 04:25:22,571][123090] Updated weights for policy 1, policy_version 601552 (0.0008) [2023-12-26 04:25:22,584][123091] Updated weights for policy 0, policy_version 605670 (0.0011) [2023-12-26 04:25:22,638][123090] Updated weights for policy 1, policy_version 601562 (0.0008) [2023-12-26 04:25:22,652][123091] Updated weights for policy 0, policy_version 605680 (0.0007) [2023-12-26 04:25:23,414][123091] Updated weights for policy 0, policy_version 605690 (0.0010) [2023-12-26 04:25:23,443][123090] Updated weights for policy 1, policy_version 601572 (0.0009) [2023-12-26 04:25:23,461][123091] Updated weights for policy 0, policy_version 605700 (0.0007) [2023-12-26 04:25:23,506][123090] Updated weights for policy 1, policy_version 601582 (0.0009) [2023-12-26 04:25:23,513][123091] Updated weights for policy 0, policy_version 605710 (0.0007) [2023-12-26 04:25:23,565][123090] Updated weights for policy 1, policy_version 601592 (0.0009) [2023-12-26 04:25:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 309075968. Throughput: 0: 8617.1, 1: 8922.9. Samples: 309048824. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:23,785][121949] Avg episode reward: [(0, '6061.822'), (1, '5393.208')] [2023-12-26 04:25:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000605712_155066368.pth... [2023-12-26 04:25:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000601600_154009600.pth... [2023-12-26 04:25:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000604720_154812416.pth [2023-12-26 04:25:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000600512_153731072.pth [2023-12-26 04:25:24,348][123091] Updated weights for policy 0, policy_version 605720 (0.0009) [2023-12-26 04:25:24,389][123090] Updated weights for policy 1, policy_version 601602 (0.0008) [2023-12-26 04:25:24,400][123091] Updated weights for policy 0, policy_version 605730 (0.0009) [2023-12-26 04:25:24,449][123091] Updated weights for policy 0, policy_version 605740 (0.0008) [2023-12-26 04:25:24,455][123090] Updated weights for policy 1, policy_version 601612 (0.0009) [2023-12-26 04:25:24,517][123090] Updated weights for policy 1, policy_version 601622 (0.0010) [2023-12-26 04:25:24,589][123090] Updated weights for policy 1, policy_version 601632 (0.0009) [2023-12-26 04:25:25,277][123091] Updated weights for policy 0, policy_version 605750 (0.0009) [2023-12-26 04:25:25,327][123091] Updated weights for policy 0, policy_version 605760 (0.0009) [2023-12-26 04:25:25,383][123091] Updated weights for policy 0, policy_version 605770 (0.0008) [2023-12-26 04:25:25,387][123090] Updated weights for policy 1, policy_version 601642 (0.0009) [2023-12-26 04:25:25,443][123090] Updated weights for policy 1, policy_version 601652 (0.0009) [2023-12-26 04:25:25,510][123090] Updated weights for policy 1, policy_version 601662 (0.0008) [2023-12-26 04:25:26,224][123091] Updated weights for policy 0, policy_version 605780 (0.0007) [2023-12-26 04:25:26,276][123091] Updated weights for policy 0, policy_version 605790 (0.0010) [2023-12-26 04:25:26,308][123090] Updated weights for policy 1, policy_version 601672 (0.0008) [2023-12-26 04:25:26,336][123091] Updated weights for policy 0, policy_version 605800 (0.0008) [2023-12-26 04:25:26,369][123090] Updated weights for policy 1, policy_version 601682 (0.0008) [2023-12-26 04:25:26,437][123090] Updated weights for policy 1, policy_version 601692 (0.0008) [2023-12-26 04:25:27,200][123091] Updated weights for policy 0, policy_version 605810 (0.0009) [2023-12-26 04:25:27,230][123090] Updated weights for policy 1, policy_version 601702 (0.0009) [2023-12-26 04:25:27,251][123091] Updated weights for policy 0, policy_version 605820 (0.0007) [2023-12-26 04:25:27,290][123090] Updated weights for policy 1, policy_version 601712 (0.0007) [2023-12-26 04:25:27,309][123091] Updated weights for policy 0, policy_version 605830 (0.0010) [2023-12-26 04:25:27,352][123090] Updated weights for policy 1, policy_version 601722 (0.0008) [2023-12-26 04:25:27,364][123091] Updated weights for policy 0, policy_version 605840 (0.0009) [2023-12-26 04:25:28,019][123090] Updated weights for policy 1, policy_version 601732 (0.0007) [2023-12-26 04:25:28,077][123090] Updated weights for policy 1, policy_version 601743 (0.0009) [2023-12-26 04:25:28,125][123090] Updated weights for policy 1, policy_version 601754 (0.0009) [2023-12-26 04:25:28,226][123091] Updated weights for policy 0, policy_version 605850 (0.0008) [2023-12-26 04:25:28,286][123091] Updated weights for policy 0, policy_version 605860 (0.0010) [2023-12-26 04:25:28,353][123091] Updated weights for policy 0, policy_version 605870 (0.0009) [2023-12-26 04:25:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 309157888. Throughput: 0: 8554.6, 1: 9010.1. Samples: 309151792. Policy #0 lag: (min: 31.0, avg: 40.1, max: 63.0) [2023-12-26 04:25:28,785][121949] Avg episode reward: [(0, '6001.352'), (1, '5330.072')] [2023-12-26 04:25:28,903][123090] Updated weights for policy 1, policy_version 601764 (0.0009) [2023-12-26 04:25:28,968][123090] Updated weights for policy 1, policy_version 601774 (0.0008) [2023-12-26 04:25:29,034][123090] Updated weights for policy 1, policy_version 601784 (0.0008) [2023-12-26 04:25:29,198][123091] Updated weights for policy 0, policy_version 605880 (0.0006) [2023-12-26 04:25:29,270][123091] Updated weights for policy 0, policy_version 605890 (0.0009) [2023-12-26 04:25:29,325][123091] Updated weights for policy 0, policy_version 605900 (0.0009) [2023-12-26 04:25:29,789][123090] Updated weights for policy 1, policy_version 601794 (0.0008) [2023-12-26 04:25:29,858][123090] Updated weights for policy 1, policy_version 601804 (0.0009) [2023-12-26 04:25:29,923][123090] Updated weights for policy 1, policy_version 601814 (0.0010) [2023-12-26 04:25:29,987][123090] Updated weights for policy 1, policy_version 601824 (0.0009) [2023-12-26 04:25:30,092][123091] Updated weights for policy 0, policy_version 605910 (0.0009) [2023-12-26 04:25:30,148][123091] Updated weights for policy 0, policy_version 605920 (0.0009) [2023-12-26 04:25:30,205][123091] Updated weights for policy 0, policy_version 605930 (0.0009) [2023-12-26 04:25:30,805][123090] Updated weights for policy 1, policy_version 601834 (0.0009) [2023-12-26 04:25:30,868][123090] Updated weights for policy 1, policy_version 601844 (0.0009) [2023-12-26 04:25:30,920][123090] Updated weights for policy 1, policy_version 601854 (0.0009) [2023-12-26 04:25:31,059][123091] Updated weights for policy 0, policy_version 605940 (0.0009) [2023-12-26 04:25:31,120][123091] Updated weights for policy 0, policy_version 605950 (0.0009) [2023-12-26 04:25:31,184][123091] Updated weights for policy 0, policy_version 605960 (0.0009) [2023-12-26 04:25:31,709][123090] Updated weights for policy 1, policy_version 601864 (0.0007) [2023-12-26 04:25:31,785][123090] Updated weights for policy 1, policy_version 601874 (0.0006) [2023-12-26 04:25:31,854][123090] Updated weights for policy 1, policy_version 601884 (0.0008) [2023-12-26 04:25:32,046][123091] Updated weights for policy 0, policy_version 605970 (0.0010) [2023-12-26 04:25:32,100][123091] Updated weights for policy 0, policy_version 605980 (0.0010) [2023-12-26 04:25:32,162][123091] Updated weights for policy 0, policy_version 605990 (0.0010) [2023-12-26 04:25:32,570][123090] Updated weights for policy 1, policy_version 601894 (0.0007) [2023-12-26 04:25:32,628][123090] Updated weights for policy 1, policy_version 601904 (0.0005) [2023-12-26 04:25:32,679][123090] Updated weights for policy 1, policy_version 601914 (0.0005) [2023-12-26 04:25:33,074][123091] Updated weights for policy 0, policy_version 606001 (0.0011) [2023-12-26 04:25:33,144][123091] Updated weights for policy 0, policy_version 606011 (0.0010) [2023-12-26 04:25:33,199][123091] Updated weights for policy 0, policy_version 606021 (0.0009) [2023-12-26 04:25:33,250][123091] Updated weights for policy 0, policy_version 606031 (0.0009) [2023-12-26 04:25:33,293][123090] Updated weights for policy 1, policy_version 601924 (0.0005) [2023-12-26 04:25:33,346][123090] Updated weights for policy 1, policy_version 601934 (0.0005) [2023-12-26 04:25:33,403][123090] Updated weights for policy 1, policy_version 601944 (0.0006) [2023-12-26 04:25:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 309248000. Throughput: 0: 8474.5, 1: 9136.7. Samples: 309258416. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:33,785][121949] Avg episode reward: [(0, '6008.811'), (1, '5473.908')] [2023-12-26 04:25:34,037][123090] Updated weights for policy 1, policy_version 601954 (0.0006) [2023-12-26 04:25:34,086][123090] Updated weights for policy 1, policy_version 601964 (0.0009) [2023-12-26 04:25:34,138][123090] Updated weights for policy 1, policy_version 601974 (0.0009) [2023-12-26 04:25:34,173][123091] Updated weights for policy 0, policy_version 606041 (0.0009) [2023-12-26 04:25:34,206][123090] Updated weights for policy 1, policy_version 601984 (0.0007) [2023-12-26 04:25:34,232][123091] Updated weights for policy 0, policy_version 606051 (0.0009) [2023-12-26 04:25:34,303][123091] Updated weights for policy 0, policy_version 606061 (0.0010) [2023-12-26 04:25:34,923][123090] Updated weights for policy 1, policy_version 601994 (0.0006) [2023-12-26 04:25:34,975][123090] Updated weights for policy 1, policy_version 602004 (0.0009) [2023-12-26 04:25:35,029][123090] Updated weights for policy 1, policy_version 602014 (0.0009) [2023-12-26 04:25:35,197][123091] Updated weights for policy 0, policy_version 606071 (0.0010) [2023-12-26 04:25:35,250][123091] Updated weights for policy 0, policy_version 606081 (0.0010) [2023-12-26 04:25:35,304][123091] Updated weights for policy 0, policy_version 606092 (0.0010) [2023-12-26 04:25:35,825][123090] Updated weights for policy 1, policy_version 602024 (0.0008) [2023-12-26 04:25:35,895][123090] Updated weights for policy 1, policy_version 602034 (0.0006) [2023-12-26 04:25:35,970][123090] Updated weights for policy 1, policy_version 602044 (0.0005) [2023-12-26 04:25:36,207][123091] Updated weights for policy 0, policy_version 606103 (0.0010) [2023-12-26 04:25:36,270][123091] Updated weights for policy 0, policy_version 606113 (0.0010) [2023-12-26 04:25:36,334][123091] Updated weights for policy 0, policy_version 606123 (0.0009) [2023-12-26 04:25:36,711][123090] Updated weights for policy 1, policy_version 602054 (0.0008) [2023-12-26 04:25:36,783][123090] Updated weights for policy 1, policy_version 602064 (0.0010) [2023-12-26 04:25:36,850][123090] Updated weights for policy 1, policy_version 602074 (0.0010) [2023-12-26 04:25:37,182][123091] Updated weights for policy 0, policy_version 606133 (0.0009) [2023-12-26 04:25:37,238][123091] Updated weights for policy 0, policy_version 606143 (0.0009) [2023-12-26 04:25:37,297][123091] Updated weights for policy 0, policy_version 606153 (0.0010) [2023-12-26 04:25:37,566][123090] Updated weights for policy 1, policy_version 602084 (0.0008) [2023-12-26 04:25:37,616][123090] Updated weights for policy 1, policy_version 602094 (0.0005) [2023-12-26 04:25:37,666][123090] Updated weights for policy 1, policy_version 602104 (0.0006) [2023-12-26 04:25:38,010][123091] Updated weights for policy 0, policy_version 606163 (0.0007) [2023-12-26 04:25:38,066][123091] Updated weights for policy 0, policy_version 606173 (0.0005) [2023-12-26 04:25:38,115][123091] Updated weights for policy 0, policy_version 606183 (0.0005) [2023-12-26 04:25:38,472][123090] Updated weights for policy 1, policy_version 602114 (0.0006) [2023-12-26 04:25:38,524][123090] Updated weights for policy 1, policy_version 602124 (0.0005) [2023-12-26 04:25:38,579][123090] Updated weights for policy 1, policy_version 602134 (0.0005) [2023-12-26 04:25:38,629][123090] Updated weights for policy 1, policy_version 602144 (0.0005) [2023-12-26 04:25:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 309338112. Throughput: 0: 8403.5, 1: 9232.4. Samples: 309311448. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:38,785][121949] Avg episode reward: [(0, '6018.831'), (1, '5804.538')] [2023-12-26 04:25:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000606192_155189248.pth... [2023-12-26 04:25:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000602144_154148864.pth... [2023-12-26 04:25:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000601088_153878528.pth [2023-12-26 04:25:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000605200_154935296.pth [2023-12-26 04:25:38,846][123091] Updated weights for policy 0, policy_version 606193 (0.0006) [2023-12-26 04:25:38,902][123091] Updated weights for policy 0, policy_version 606203 (0.0005) [2023-12-26 04:25:38,971][123091] Updated weights for policy 0, policy_version 606213 (0.0005) [2023-12-26 04:25:39,031][123091] Updated weights for policy 0, policy_version 606223 (0.0006) [2023-12-26 04:25:39,430][123090] Updated weights for policy 1, policy_version 602154 (0.0009) [2023-12-26 04:25:39,499][123090] Updated weights for policy 1, policy_version 602164 (0.0006) [2023-12-26 04:25:39,568][123090] Updated weights for policy 1, policy_version 602174 (0.0006) [2023-12-26 04:25:39,771][123091] Updated weights for policy 0, policy_version 606233 (0.0008) [2023-12-26 04:25:39,840][123091] Updated weights for policy 0, policy_version 606243 (0.0008) [2023-12-26 04:25:39,913][123091] Updated weights for policy 0, policy_version 606253 (0.0006) [2023-12-26 04:25:40,297][123090] Updated weights for policy 1, policy_version 602184 (0.0006) [2023-12-26 04:25:40,365][123090] Updated weights for policy 1, policy_version 602194 (0.0007) [2023-12-26 04:25:40,443][123090] Updated weights for policy 1, policy_version 602204 (0.0006) [2023-12-26 04:25:40,722][123091] Updated weights for policy 0, policy_version 606263 (0.0009) [2023-12-26 04:25:40,779][123091] Updated weights for policy 0, policy_version 606273 (0.0007) [2023-12-26 04:25:40,845][123091] Updated weights for policy 0, policy_version 606283 (0.0008) [2023-12-26 04:25:41,259][123090] Updated weights for policy 1, policy_version 602214 (0.0007) [2023-12-26 04:25:41,326][123090] Updated weights for policy 1, policy_version 602224 (0.0009) [2023-12-26 04:25:41,397][123090] Updated weights for policy 1, policy_version 602234 (0.0008) [2023-12-26 04:25:41,663][123091] Updated weights for policy 0, policy_version 606293 (0.0007) [2023-12-26 04:25:41,735][123091] Updated weights for policy 0, policy_version 606303 (0.0009) [2023-12-26 04:25:41,803][123091] Updated weights for policy 0, policy_version 606313 (0.0008) [2023-12-26 04:25:42,221][123090] Updated weights for policy 1, policy_version 602244 (0.0008) [2023-12-26 04:25:42,285][123090] Updated weights for policy 1, policy_version 602254 (0.0006) [2023-12-26 04:25:42,352][123090] Updated weights for policy 1, policy_version 602264 (0.0007) [2023-12-26 04:25:42,584][123091] Updated weights for policy 0, policy_version 606323 (0.0005) [2023-12-26 04:25:42,646][123091] Updated weights for policy 0, policy_version 606333 (0.0005) [2023-12-26 04:25:42,711][123091] Updated weights for policy 0, policy_version 606343 (0.0005) [2023-12-26 04:25:43,123][123090] Updated weights for policy 1, policy_version 602274 (0.0010) [2023-12-26 04:25:43,176][123090] Updated weights for policy 1, policy_version 602284 (0.0009) [2023-12-26 04:25:43,229][123090] Updated weights for policy 1, policy_version 602294 (0.0005) [2023-12-26 04:25:43,279][123090] Updated weights for policy 1, policy_version 602304 (0.0005) [2023-12-26 04:25:43,432][123091] Updated weights for policy 0, policy_version 606353 (0.0006) [2023-12-26 04:25:43,492][123091] Updated weights for policy 0, policy_version 606363 (0.0007) [2023-12-26 04:25:43,541][123091] Updated weights for policy 0, policy_version 606373 (0.0005) [2023-12-26 04:25:43,586][123091] Updated weights for policy 0, policy_version 606383 (0.0005) [2023-12-26 04:25:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 309428224. Throughput: 0: 8416.3, 1: 9106.0. Samples: 309418584. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:43,785][121949] Avg episode reward: [(0, '5732.383'), (1, '5761.987')] [2023-12-26 04:25:43,998][123090] Updated weights for policy 1, policy_version 602314 (0.0008) [2023-12-26 04:25:44,061][123090] Updated weights for policy 1, policy_version 602324 (0.0010) [2023-12-26 04:25:44,116][123090] Updated weights for policy 1, policy_version 602334 (0.0010) [2023-12-26 04:25:44,267][123091] Updated weights for policy 0, policy_version 606393 (0.0010) [2023-12-26 04:25:44,332][123091] Updated weights for policy 0, policy_version 606403 (0.0010) [2023-12-26 04:25:44,398][123091] Updated weights for policy 0, policy_version 606413 (0.0011) [2023-12-26 04:25:44,830][123090] Updated weights for policy 1, policy_version 602344 (0.0008) [2023-12-26 04:25:44,898][123090] Updated weights for policy 1, policy_version 602354 (0.0008) [2023-12-26 04:25:44,973][123090] Updated weights for policy 1, policy_version 602364 (0.0010) [2023-12-26 04:25:45,085][123091] Updated weights for policy 0, policy_version 606423 (0.0010) [2023-12-26 04:25:45,150][123091] Updated weights for policy 0, policy_version 606433 (0.0007) [2023-12-26 04:25:45,223][123091] Updated weights for policy 0, policy_version 606443 (0.0005) [2023-12-26 04:25:45,778][123090] Updated weights for policy 1, policy_version 602374 (0.0011) [2023-12-26 04:25:45,846][123090] Updated weights for policy 1, policy_version 602384 (0.0011) [2023-12-26 04:25:45,866][123091] Updated weights for policy 0, policy_version 606453 (0.0006) [2023-12-26 04:25:45,913][123090] Updated weights for policy 1, policy_version 602394 (0.0010) [2023-12-26 04:25:45,916][123091] Updated weights for policy 0, policy_version 606463 (0.0007) [2023-12-26 04:25:45,979][123091] Updated weights for policy 0, policy_version 606473 (0.0006) [2023-12-26 04:25:46,718][123090] Updated weights for policy 1, policy_version 602404 (0.0010) [2023-12-26 04:25:46,798][123090] Updated weights for policy 1, policy_version 602414 (0.0010) [2023-12-26 04:25:46,811][123091] Updated weights for policy 0, policy_version 606483 (0.0011) [2023-12-26 04:25:46,866][123091] Updated weights for policy 0, policy_version 606493 (0.0011) [2023-12-26 04:25:46,871][123090] Updated weights for policy 1, policy_version 602424 (0.0008) [2023-12-26 04:25:46,922][123091] Updated weights for policy 0, policy_version 606503 (0.0011) [2023-12-26 04:25:47,521][123090] Updated weights for policy 1, policy_version 602434 (0.0005) [2023-12-26 04:25:47,587][123090] Updated weights for policy 1, policy_version 602444 (0.0009) [2023-12-26 04:25:47,607][123091] Updated weights for policy 0, policy_version 606513 (0.0010) [2023-12-26 04:25:47,642][123090] Updated weights for policy 1, policy_version 602454 (0.0010) [2023-12-26 04:25:47,659][123091] Updated weights for policy 0, policy_version 606523 (0.0005) [2023-12-26 04:25:47,693][123090] Updated weights for policy 1, policy_version 602464 (0.0010) [2023-12-26 04:25:47,723][123091] Updated weights for policy 0, policy_version 606533 (0.0006) [2023-12-26 04:25:47,791][123091] Updated weights for policy 0, policy_version 606543 (0.0005) [2023-12-26 04:25:48,498][123090] Updated weights for policy 1, policy_version 602474 (0.0011) [2023-12-26 04:25:48,544][123091] Updated weights for policy 0, policy_version 606553 (0.0006) [2023-12-26 04:25:48,566][123090] Updated weights for policy 1, policy_version 602484 (0.0010) [2023-12-26 04:25:48,608][123091] Updated weights for policy 0, policy_version 606563 (0.0007) [2023-12-26 04:25:48,630][123090] Updated weights for policy 1, policy_version 602494 (0.0010) [2023-12-26 04:25:48,673][123091] Updated weights for policy 0, policy_version 606573 (0.0008) [2023-12-26 04:25:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 309526528. Throughput: 0: 8625.1, 1: 9101.9. Samples: 309532312. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:48,785][121949] Avg episode reward: [(0, '5805.194'), (1, '5727.113')] [2023-12-26 04:25:49,479][123090] Updated weights for policy 1, policy_version 602504 (0.0011) [2023-12-26 04:25:49,500][123091] Updated weights for policy 0, policy_version 606583 (0.0007) [2023-12-26 04:25:49,547][123090] Updated weights for policy 1, policy_version 602514 (0.0011) [2023-12-26 04:25:49,562][123091] Updated weights for policy 0, policy_version 606593 (0.0010) [2023-12-26 04:25:49,608][123090] Updated weights for policy 1, policy_version 602524 (0.0011) [2023-12-26 04:25:49,624][123091] Updated weights for policy 0, policy_version 606603 (0.0007) [2023-12-26 04:25:50,440][123090] Updated weights for policy 1, policy_version 602534 (0.0010) [2023-12-26 04:25:50,474][123091] Updated weights for policy 0, policy_version 606613 (0.0008) [2023-12-26 04:25:50,494][123090] Updated weights for policy 1, policy_version 602544 (0.0008) [2023-12-26 04:25:50,532][123091] Updated weights for policy 0, policy_version 606623 (0.0010) [2023-12-26 04:25:50,548][123090] Updated weights for policy 1, policy_version 602554 (0.0008) [2023-12-26 04:25:50,599][123091] Updated weights for policy 0, policy_version 606633 (0.0008) [2023-12-26 04:25:51,375][123090] Updated weights for policy 1, policy_version 602564 (0.0009) [2023-12-26 04:25:51,449][123090] Updated weights for policy 1, policy_version 602574 (0.0008) [2023-12-26 04:25:51,479][123091] Updated weights for policy 0, policy_version 606643 (0.0008) [2023-12-26 04:25:51,518][123090] Updated weights for policy 1, policy_version 602584 (0.0006) [2023-12-26 04:25:51,543][123091] Updated weights for policy 0, policy_version 606653 (0.0006) [2023-12-26 04:25:51,609][123091] Updated weights for policy 0, policy_version 606663 (0.0008) [2023-12-26 04:25:52,225][123090] Updated weights for policy 1, policy_version 602594 (0.0007) [2023-12-26 04:25:52,277][123090] Updated weights for policy 1, policy_version 602604 (0.0009) [2023-12-26 04:25:52,334][123090] Updated weights for policy 1, policy_version 602614 (0.0009) [2023-12-26 04:25:52,398][123090] Updated weights for policy 1, policy_version 602624 (0.0009) [2023-12-26 04:25:52,434][123091] Updated weights for policy 0, policy_version 606673 (0.0009) [2023-12-26 04:25:52,492][123091] Updated weights for policy 0, policy_version 606683 (0.0006) [2023-12-26 04:25:52,546][123091] Updated weights for policy 0, policy_version 606693 (0.0007) [2023-12-26 04:25:52,593][123091] Updated weights for policy 0, policy_version 606703 (0.0007) [2023-12-26 04:25:53,223][123090] Updated weights for policy 1, policy_version 602634 (0.0007) [2023-12-26 04:25:53,279][123090] Updated weights for policy 1, policy_version 602644 (0.0008) [2023-12-26 04:25:53,340][123090] Updated weights for policy 1, policy_version 602654 (0.0009) [2023-12-26 04:25:53,423][123091] Updated weights for policy 0, policy_version 606713 (0.0010) [2023-12-26 04:25:53,477][123091] Updated weights for policy 0, policy_version 606723 (0.0010) [2023-12-26 04:25:53,532][123091] Updated weights for policy 0, policy_version 606733 (0.0010) [2023-12-26 04:25:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 309608448. Throughput: 0: 8641.2, 1: 9019.9. Samples: 309582324. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:53,785][121949] Avg episode reward: [(0, '5822.478'), (1, '5747.006')] [2023-12-26 04:25:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000606736_155328512.pth... [2023-12-26 04:25:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000602656_154279936.pth... [2023-12-26 04:25:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000605712_155066368.pth [2023-12-26 04:25:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000601600_154009600.pth [2023-12-26 04:25:54,147][123090] Updated weights for policy 1, policy_version 602664 (0.0010) [2023-12-26 04:25:54,203][123090] Updated weights for policy 1, policy_version 602674 (0.0010) [2023-12-26 04:25:54,239][123091] Updated weights for policy 0, policy_version 606743 (0.0007) [2023-12-26 04:25:54,266][123090] Updated weights for policy 1, policy_version 602684 (0.0010) [2023-12-26 04:25:54,297][123091] Updated weights for policy 0, policy_version 606753 (0.0005) [2023-12-26 04:25:54,360][123091] Updated weights for policy 0, policy_version 606763 (0.0005) [2023-12-26 04:25:54,985][123090] Updated weights for policy 1, policy_version 602694 (0.0011) [2023-12-26 04:25:55,029][123091] Updated weights for policy 0, policy_version 606773 (0.0008) [2023-12-26 04:25:55,053][123090] Updated weights for policy 1, policy_version 602704 (0.0010) [2023-12-26 04:25:55,093][123091] Updated weights for policy 0, policy_version 606783 (0.0011) [2023-12-26 04:25:55,105][123090] Updated weights for policy 1, policy_version 602714 (0.0010) [2023-12-26 04:25:55,153][123091] Updated weights for policy 0, policy_version 606793 (0.0010) [2023-12-26 04:25:55,900][123091] Updated weights for policy 0, policy_version 606803 (0.0009) [2023-12-26 04:25:55,956][123091] Updated weights for policy 0, policy_version 606813 (0.0006) [2023-12-26 04:25:55,980][123090] Updated weights for policy 1, policy_version 602724 (0.0009) [2023-12-26 04:25:56,027][123091] Updated weights for policy 0, policy_version 606823 (0.0008) [2023-12-26 04:25:56,038][123090] Updated weights for policy 1, policy_version 602734 (0.0006) [2023-12-26 04:25:56,094][123090] Updated weights for policy 1, policy_version 602744 (0.0010) [2023-12-26 04:25:56,751][123091] Updated weights for policy 0, policy_version 606833 (0.0009) [2023-12-26 04:25:56,798][123090] Updated weights for policy 1, policy_version 602754 (0.0009) [2023-12-26 04:25:56,821][123091] Updated weights for policy 0, policy_version 606843 (0.0009) [2023-12-26 04:25:56,867][123090] Updated weights for policy 1, policy_version 602764 (0.0006) [2023-12-26 04:25:56,889][123091] Updated weights for policy 0, policy_version 606853 (0.0008) [2023-12-26 04:25:56,932][123090] Updated weights for policy 1, policy_version 602774 (0.0006) [2023-12-26 04:25:56,952][123091] Updated weights for policy 0, policy_version 606863 (0.0005) [2023-12-26 04:25:57,003][123090] Updated weights for policy 1, policy_version 602784 (0.0008) [2023-12-26 04:25:57,708][123091] Updated weights for policy 0, policy_version 606873 (0.0010) [2023-12-26 04:25:57,766][123091] Updated weights for policy 0, policy_version 606883 (0.0010) [2023-12-26 04:25:57,771][123090] Updated weights for policy 1, policy_version 602794 (0.0008) [2023-12-26 04:25:57,817][123091] Updated weights for policy 0, policy_version 606893 (0.0010) [2023-12-26 04:25:57,827][123090] Updated weights for policy 1, policy_version 602804 (0.0005) [2023-12-26 04:25:57,879][123090] Updated weights for policy 1, policy_version 602814 (0.0005) [2023-12-26 04:25:58,663][123091] Updated weights for policy 0, policy_version 606903 (0.0008) [2023-12-26 04:25:58,718][123090] Updated weights for policy 1, policy_version 602824 (0.0007) [2023-12-26 04:25:58,734][123091] Updated weights for policy 0, policy_version 606913 (0.0011) [2023-12-26 04:25:58,781][123090] Updated weights for policy 1, policy_version 602834 (0.0008) [2023-12-26 04:25:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 309690368. Throughput: 0: 8787.4, 1: 9043.7. Samples: 309692728. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:25:58,785][121949] Avg episode reward: [(0, '5924.904'), (1, '5787.272')] [2023-12-26 04:25:58,795][123091] Updated weights for policy 0, policy_version 606923 (0.0010) [2023-12-26 04:25:58,849][123090] Updated weights for policy 1, policy_version 602844 (0.0008) [2023-12-26 04:25:59,564][123091] Updated weights for policy 0, policy_version 606933 (0.0008) [2023-12-26 04:25:59,622][123091] Updated weights for policy 0, policy_version 606943 (0.0006) [2023-12-26 04:25:59,652][123090] Updated weights for policy 1, policy_version 602854 (0.0009) [2023-12-26 04:25:59,684][123091] Updated weights for policy 0, policy_version 606953 (0.0005) [2023-12-26 04:25:59,723][123090] Updated weights for policy 1, policy_version 602864 (0.0011) [2023-12-26 04:25:59,775][123090] Updated weights for policy 1, policy_version 602874 (0.0010) [2023-12-26 04:26:00,428][123091] Updated weights for policy 0, policy_version 606963 (0.0007) [2023-12-26 04:26:00,475][123091] Updated weights for policy 0, policy_version 606973 (0.0008) [2023-12-26 04:26:00,522][123091] Updated weights for policy 0, policy_version 606983 (0.0008) [2023-12-26 04:26:00,588][123090] Updated weights for policy 1, policy_version 602884 (0.0010) [2023-12-26 04:26:00,653][123090] Updated weights for policy 1, policy_version 602894 (0.0010) [2023-12-26 04:26:00,715][123090] Updated weights for policy 1, policy_version 602904 (0.0010) [2023-12-26 04:26:01,388][123091] Updated weights for policy 0, policy_version 606993 (0.0008) [2023-12-26 04:26:01,460][123091] Updated weights for policy 0, policy_version 607003 (0.0008) [2023-12-26 04:26:01,492][123090] Updated weights for policy 1, policy_version 602914 (0.0010) [2023-12-26 04:26:01,525][123091] Updated weights for policy 0, policy_version 607013 (0.0008) [2023-12-26 04:26:01,554][123090] Updated weights for policy 1, policy_version 602924 (0.0006) [2023-12-26 04:26:01,588][123091] Updated weights for policy 0, policy_version 607023 (0.0009) [2023-12-26 04:26:01,636][123090] Updated weights for policy 1, policy_version 602934 (0.0008) [2023-12-26 04:26:01,691][123090] Updated weights for policy 1, policy_version 602944 (0.0008) [2023-12-26 04:26:02,323][123091] Updated weights for policy 0, policy_version 607033 (0.0010) [2023-12-26 04:26:02,391][123091] Updated weights for policy 0, policy_version 607043 (0.0009) [2023-12-26 04:26:02,456][123091] Updated weights for policy 0, policy_version 607053 (0.0009) [2023-12-26 04:26:02,526][123090] Updated weights for policy 1, policy_version 602954 (0.0009) [2023-12-26 04:26:02,583][123090] Updated weights for policy 1, policy_version 602965 (0.0010) [2023-12-26 04:26:02,640][123090] Updated weights for policy 1, policy_version 602975 (0.0009) [2023-12-26 04:26:03,077][123091] Updated weights for policy 0, policy_version 607063 (0.0006) [2023-12-26 04:26:03,127][123091] Updated weights for policy 0, policy_version 607073 (0.0005) [2023-12-26 04:26:03,181][123091] Updated weights for policy 0, policy_version 607083 (0.0009) [2023-12-26 04:26:03,379][123090] Updated weights for policy 1, policy_version 602985 (0.0009) [2023-12-26 04:26:03,432][123090] Updated weights for policy 1, policy_version 602995 (0.0009) [2023-12-26 04:26:03,494][123090] Updated weights for policy 1, policy_version 603005 (0.0009) [2023-12-26 04:26:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 309788672. Throughput: 0: 8811.6, 1: 8986.8. Samples: 309798528. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:03,785][121949] Avg episode reward: [(0, '5963.956'), (1, '5793.112')] [2023-12-26 04:26:03,965][123091] Updated weights for policy 0, policy_version 607093 (0.0007) [2023-12-26 04:26:04,014][123091] Updated weights for policy 0, policy_version 607103 (0.0006) [2023-12-26 04:26:04,066][123091] Updated weights for policy 0, policy_version 607113 (0.0006) [2023-12-26 04:26:04,312][123090] Updated weights for policy 1, policy_version 603015 (0.0009) [2023-12-26 04:26:04,378][123090] Updated weights for policy 1, policy_version 603025 (0.0008) [2023-12-26 04:26:04,448][123090] Updated weights for policy 1, policy_version 603035 (0.0008) [2023-12-26 04:26:04,867][123091] Updated weights for policy 0, policy_version 607123 (0.0008) [2023-12-26 04:26:04,916][123091] Updated weights for policy 0, policy_version 607133 (0.0009) [2023-12-26 04:26:04,963][123091] Updated weights for policy 0, policy_version 607143 (0.0009) [2023-12-26 04:26:05,286][123090] Updated weights for policy 1, policy_version 603045 (0.0009) [2023-12-26 04:26:05,338][123090] Updated weights for policy 1, policy_version 603056 (0.0009) [2023-12-26 04:26:05,395][123090] Updated weights for policy 1, policy_version 603066 (0.0010) [2023-12-26 04:26:05,779][123091] Updated weights for policy 0, policy_version 607154 (0.0009) [2023-12-26 04:26:05,843][123091] Updated weights for policy 0, policy_version 607164 (0.0006) [2023-12-26 04:26:05,901][123091] Updated weights for policy 0, policy_version 607174 (0.0005) [2023-12-26 04:26:05,972][123091] Updated weights for policy 0, policy_version 607184 (0.0005) [2023-12-26 04:26:06,319][123090] Updated weights for policy 1, policy_version 603076 (0.0010) [2023-12-26 04:26:06,398][123090] Updated weights for policy 1, policy_version 603086 (0.0010) [2023-12-26 04:26:06,470][123090] Updated weights for policy 1, policy_version 603096 (0.0009) [2023-12-26 04:26:06,665][123091] Updated weights for policy 0, policy_version 607194 (0.0010) [2023-12-26 04:26:06,719][123091] Updated weights for policy 0, policy_version 607204 (0.0009) [2023-12-26 04:26:06,776][123091] Updated weights for policy 0, policy_version 607214 (0.0009) [2023-12-26 04:26:07,334][123090] Updated weights for policy 1, policy_version 603106 (0.0009) [2023-12-26 04:26:07,387][123090] Updated weights for policy 1, policy_version 603116 (0.0010) [2023-12-26 04:26:07,444][123090] Updated weights for policy 1, policy_version 603126 (0.0009) [2023-12-26 04:26:07,499][123090] Updated weights for policy 1, policy_version 603136 (0.0010) [2023-12-26 04:26:07,591][123091] Updated weights for policy 0, policy_version 607224 (0.0006) [2023-12-26 04:26:07,657][123091] Updated weights for policy 0, policy_version 607234 (0.0005) [2023-12-26 04:26:07,720][123091] Updated weights for policy 0, policy_version 607244 (0.0009) [2023-12-26 04:26:08,437][123091] Updated weights for policy 0, policy_version 607254 (0.0007) [2023-12-26 04:26:08,446][123090] Updated weights for policy 1, policy_version 603146 (0.0009) [2023-12-26 04:26:08,483][123091] Updated weights for policy 0, policy_version 607264 (0.0005) [2023-12-26 04:26:08,508][123090] Updated weights for policy 1, policy_version 603156 (0.0008) [2023-12-26 04:26:08,539][123091] Updated weights for policy 0, policy_version 607274 (0.0005) [2023-12-26 04:26:08,575][123090] Updated weights for policy 1, policy_version 603166 (0.0008) [2023-12-26 04:26:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 309878784. Throughput: 0: 8896.7, 1: 8942.7. Samples: 309851592. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:08,785][121949] Avg episode reward: [(0, '5989.442'), (1, '5619.319')] [2023-12-26 04:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000607280_155467776.pth... [2023-12-26 04:26:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000603168_154411008.pth... [2023-12-26 04:26:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000606192_155189248.pth [2023-12-26 04:26:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000602144_154148864.pth [2023-12-26 04:26:09,144][123091] Updated weights for policy 0, policy_version 607284 (0.0005) [2023-12-26 04:26:09,189][123091] Updated weights for policy 0, policy_version 607294 (0.0005) [2023-12-26 04:26:09,254][123091] Updated weights for policy 0, policy_version 607304 (0.0006) [2023-12-26 04:26:09,489][123090] Updated weights for policy 1, policy_version 603176 (0.0009) [2023-12-26 04:26:09,556][123090] Updated weights for policy 1, policy_version 603186 (0.0010) [2023-12-26 04:26:09,625][123090] Updated weights for policy 1, policy_version 603196 (0.0009) [2023-12-26 04:26:10,015][123091] Updated weights for policy 0, policy_version 607314 (0.0008) [2023-12-26 04:26:10,079][123091] Updated weights for policy 0, policy_version 607324 (0.0009) [2023-12-26 04:26:10,143][123091] Updated weights for policy 0, policy_version 607334 (0.0009) [2023-12-26 04:26:10,208][123091] Updated weights for policy 0, policy_version 607344 (0.0009) [2023-12-26 04:26:10,511][123090] Updated weights for policy 1, policy_version 603206 (0.0009) [2023-12-26 04:26:10,576][123090] Updated weights for policy 1, policy_version 603216 (0.0009) [2023-12-26 04:26:10,628][123090] Updated weights for policy 1, policy_version 603226 (0.0010) [2023-12-26 04:26:11,037][123091] Updated weights for policy 0, policy_version 607354 (0.0011) [2023-12-26 04:26:11,104][123091] Updated weights for policy 0, policy_version 607364 (0.0011) [2023-12-26 04:26:11,174][123091] Updated weights for policy 0, policy_version 607374 (0.0011) [2023-12-26 04:26:11,491][123090] Updated weights for policy 1, policy_version 603236 (0.0009) [2023-12-26 04:26:11,571][123090] Updated weights for policy 1, policy_version 603246 (0.0008) [2023-12-26 04:26:11,645][123090] Updated weights for policy 1, policy_version 603256 (0.0008) [2023-12-26 04:26:12,093][123091] Updated weights for policy 0, policy_version 607384 (0.0009) [2023-12-26 04:26:12,156][123091] Updated weights for policy 0, policy_version 607394 (0.0011) [2023-12-26 04:26:12,203][123091] Updated weights for policy 0, policy_version 607404 (0.0009) [2023-12-26 04:26:12,462][123090] Updated weights for policy 1, policy_version 603266 (0.0008) [2023-12-26 04:26:12,528][123090] Updated weights for policy 1, policy_version 603276 (0.0009) [2023-12-26 04:26:12,596][123090] Updated weights for policy 1, policy_version 603286 (0.0007) [2023-12-26 04:26:12,664][123090] Updated weights for policy 1, policy_version 603296 (0.0005) [2023-12-26 04:26:13,022][123091] Updated weights for policy 0, policy_version 607414 (0.0008) [2023-12-26 04:26:13,092][123091] Updated weights for policy 0, policy_version 607424 (0.0010) [2023-12-26 04:26:13,154][123091] Updated weights for policy 0, policy_version 607434 (0.0011) [2023-12-26 04:26:13,450][123090] Updated weights for policy 1, policy_version 603306 (0.0008) [2023-12-26 04:26:13,502][123090] Updated weights for policy 1, policy_version 603317 (0.0009) [2023-12-26 04:26:13,574][123090] Updated weights for policy 1, policy_version 603327 (0.0010) [2023-12-26 04:26:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 309960704. Throughput: 0: 8960.0, 1: 8862.7. Samples: 309953812. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:13,785][121949] Avg episode reward: [(0, '6164.435'), (1, '5638.672')] [2023-12-26 04:26:13,920][123091] Updated weights for policy 0, policy_version 607444 (0.0008) [2023-12-26 04:26:13,969][123091] Updated weights for policy 0, policy_version 607454 (0.0006) [2023-12-26 04:26:14,027][123091] Updated weights for policy 0, policy_version 607464 (0.0009) [2023-12-26 04:26:14,465][123090] Updated weights for policy 1, policy_version 603337 (0.0009) [2023-12-26 04:26:14,517][123090] Updated weights for policy 1, policy_version 603347 (0.0009) [2023-12-26 04:26:14,576][123090] Updated weights for policy 1, policy_version 603357 (0.0009) [2023-12-26 04:26:14,731][123091] Updated weights for policy 0, policy_version 607474 (0.0008) [2023-12-26 04:26:14,806][123091] Updated weights for policy 0, policy_version 607484 (0.0008) [2023-12-26 04:26:14,857][123091] Updated weights for policy 0, policy_version 607494 (0.0005) [2023-12-26 04:26:14,924][123091] Updated weights for policy 0, policy_version 607504 (0.0006) [2023-12-26 04:26:15,510][123090] Updated weights for policy 1, policy_version 603367 (0.0010) [2023-12-26 04:26:15,578][123090] Updated weights for policy 1, policy_version 603377 (0.0007) [2023-12-26 04:26:15,641][123091] Updated weights for policy 0, policy_version 607514 (0.0006) [2023-12-26 04:26:15,650][123090] Updated weights for policy 1, policy_version 603387 (0.0009) [2023-12-26 04:26:15,708][123091] Updated weights for policy 0, policy_version 607524 (0.0006) [2023-12-26 04:26:15,780][123091] Updated weights for policy 0, policy_version 607534 (0.0006) [2023-12-26 04:26:16,468][123090] Updated weights for policy 1, policy_version 603397 (0.0010) [2023-12-26 04:26:16,482][123091] Updated weights for policy 0, policy_version 607544 (0.0005) [2023-12-26 04:26:16,531][123090] Updated weights for policy 1, policy_version 603407 (0.0010) [2023-12-26 04:26:16,549][123091] Updated weights for policy 0, policy_version 607554 (0.0006) [2023-12-26 04:26:16,597][123090] Updated weights for policy 1, policy_version 603417 (0.0010) [2023-12-26 04:26:16,616][123091] Updated weights for policy 0, policy_version 607564 (0.0005) [2023-12-26 04:26:17,284][123091] Updated weights for policy 0, policy_version 607574 (0.0008) [2023-12-26 04:26:17,340][123091] Updated weights for policy 0, policy_version 607584 (0.0009) [2023-12-26 04:26:17,387][123090] Updated weights for policy 1, policy_version 603427 (0.0010) [2023-12-26 04:26:17,391][123091] Updated weights for policy 0, policy_version 607594 (0.0009) [2023-12-26 04:26:17,435][123090] Updated weights for policy 1, policy_version 603437 (0.0010) [2023-12-26 04:26:17,487][123090] Updated weights for policy 1, policy_version 603447 (0.0010) [2023-12-26 04:26:18,249][123091] Updated weights for policy 0, policy_version 607604 (0.0005) [2023-12-26 04:26:18,299][123090] Updated weights for policy 1, policy_version 603457 (0.0010) [2023-12-26 04:26:18,305][123091] Updated weights for policy 0, policy_version 607614 (0.0005) [2023-12-26 04:26:18,367][123090] Updated weights for policy 1, policy_version 603467 (0.0011) [2023-12-26 04:26:18,372][123091] Updated weights for policy 0, policy_version 607624 (0.0008) [2023-12-26 04:26:18,435][123090] Updated weights for policy 1, policy_version 603477 (0.0011) [2023-12-26 04:26:18,495][123090] Updated weights for policy 1, policy_version 603487 (0.0010) [2023-12-26 04:26:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 310050816. Throughput: 0: 9121.3, 1: 8726.8. Samples: 310061576. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:18,785][121949] Avg episode reward: [(0, '6004.138'), (1, '5732.868')] [2023-12-26 04:26:19,142][123091] Updated weights for policy 0, policy_version 607634 (0.0008) [2023-12-26 04:26:19,205][123091] Updated weights for policy 0, policy_version 607644 (0.0005) [2023-12-26 04:26:19,267][123091] Updated weights for policy 0, policy_version 607654 (0.0008) [2023-12-26 04:26:19,315][123091] Updated weights for policy 0, policy_version 607664 (0.0008) [2023-12-26 04:26:19,320][123090] Updated weights for policy 1, policy_version 603497 (0.0010) [2023-12-26 04:26:19,399][123090] Updated weights for policy 1, policy_version 603507 (0.0011) [2023-12-26 04:26:19,447][123090] Updated weights for policy 1, policy_version 603517 (0.0010) [2023-12-26 04:26:20,101][123091] Updated weights for policy 0, policy_version 607674 (0.0011) [2023-12-26 04:26:20,165][123091] Updated weights for policy 0, policy_version 607684 (0.0011) [2023-12-26 04:26:20,228][123091] Updated weights for policy 0, policy_version 607694 (0.0011) [2023-12-26 04:26:20,325][123090] Updated weights for policy 1, policy_version 603527 (0.0009) [2023-12-26 04:26:20,387][123090] Updated weights for policy 1, policy_version 603537 (0.0007) [2023-12-26 04:26:20,450][123090] Updated weights for policy 1, policy_version 603547 (0.0007) [2023-12-26 04:26:21,084][123091] Updated weights for policy 0, policy_version 607704 (0.0011) [2023-12-26 04:26:21,153][123091] Updated weights for policy 0, policy_version 607714 (0.0011) [2023-12-26 04:26:21,216][123091] Updated weights for policy 0, policy_version 607724 (0.0011) [2023-12-26 04:26:21,224][123090] Updated weights for policy 1, policy_version 603557 (0.0008) [2023-12-26 04:26:21,292][123090] Updated weights for policy 1, policy_version 603567 (0.0009) [2023-12-26 04:26:21,362][123090] Updated weights for policy 1, policy_version 603577 (0.0009) [2023-12-26 04:26:22,008][123091] Updated weights for policy 0, policy_version 607734 (0.0008) [2023-12-26 04:26:22,078][123091] Updated weights for policy 0, policy_version 607744 (0.0007) [2023-12-26 04:26:22,138][123091] Updated weights for policy 0, policy_version 607754 (0.0010) [2023-12-26 04:26:22,262][123090] Updated weights for policy 1, policy_version 603587 (0.0009) [2023-12-26 04:26:22,328][123090] Updated weights for policy 1, policy_version 603597 (0.0009) [2023-12-26 04:26:22,401][123090] Updated weights for policy 1, policy_version 603607 (0.0009) [2023-12-26 04:26:22,951][123091] Updated weights for policy 0, policy_version 607764 (0.0011) [2023-12-26 04:26:23,008][123091] Updated weights for policy 0, policy_version 607774 (0.0011) [2023-12-26 04:26:23,070][123091] Updated weights for policy 0, policy_version 607784 (0.0011) [2023-12-26 04:26:23,241][123090] Updated weights for policy 1, policy_version 603617 (0.0009) [2023-12-26 04:26:23,316][123090] Updated weights for policy 1, policy_version 603627 (0.0011) [2023-12-26 04:26:23,390][123090] Updated weights for policy 1, policy_version 603637 (0.0011) [2023-12-26 04:26:23,471][123090] Updated weights for policy 1, policy_version 603647 (0.0010) [2023-12-26 04:26:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 310132736. Throughput: 0: 9160.3, 1: 8645.2. Samples: 310112696. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:23,785][121949] Avg episode reward: [(0, '5942.780'), (1, '5589.243')] [2023-12-26 04:26:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000603648_154533888.pth... [2023-12-26 04:26:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000602656_154279936.pth [2023-12-26 04:26:23,795][123091] Updated weights for policy 0, policy_version 607794 (0.0008) [2023-12-26 04:26:23,853][123091] Updated weights for policy 0, policy_version 607804 (0.0008) [2023-12-26 04:26:23,912][123091] Updated weights for policy 0, policy_version 607814 (0.0008) [2023-12-26 04:26:23,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000607824_155607040.pth... [2023-12-26 04:26:23,965][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000606736_155328512.pth [2023-12-26 04:26:23,965][123091] Updated weights for policy 0, policy_version 607824 (0.0009) [2023-12-26 04:26:24,257][123090] Updated weights for policy 1, policy_version 603657 (0.0010) [2023-12-26 04:26:24,319][123090] Updated weights for policy 1, policy_version 603667 (0.0010) [2023-12-26 04:26:24,371][123090] Updated weights for policy 1, policy_version 603677 (0.0010) [2023-12-26 04:26:24,784][123091] Updated weights for policy 0, policy_version 607834 (0.0008) [2023-12-26 04:26:24,849][123091] Updated weights for policy 0, policy_version 607844 (0.0009) [2023-12-26 04:26:24,912][123091] Updated weights for policy 0, policy_version 607854 (0.0008) [2023-12-26 04:26:25,126][123090] Updated weights for policy 1, policy_version 603687 (0.0008) [2023-12-26 04:26:25,183][123090] Updated weights for policy 1, policy_version 603697 (0.0009) [2023-12-26 04:26:25,236][123090] Updated weights for policy 1, policy_version 603707 (0.0009) [2023-12-26 04:26:25,686][123091] Updated weights for policy 0, policy_version 607864 (0.0007) [2023-12-26 04:26:25,755][123091] Updated weights for policy 0, policy_version 607874 (0.0009) [2023-12-26 04:26:25,824][123091] Updated weights for policy 0, policy_version 607884 (0.0010) [2023-12-26 04:26:26,060][123090] Updated weights for policy 1, policy_version 603717 (0.0010) [2023-12-26 04:26:26,122][123090] Updated weights for policy 1, policy_version 603728 (0.0011) [2023-12-26 04:26:26,187][123090] Updated weights for policy 1, policy_version 603738 (0.0006) [2023-12-26 04:26:26,536][123091] Updated weights for policy 0, policy_version 607894 (0.0010) [2023-12-26 04:26:26,594][123091] Updated weights for policy 0, policy_version 607904 (0.0006) [2023-12-26 04:26:26,647][123091] Updated weights for policy 0, policy_version 607914 (0.0005) [2023-12-26 04:26:26,872][123090] Updated weights for policy 1, policy_version 603748 (0.0005) [2023-12-26 04:26:26,941][123090] Updated weights for policy 1, policy_version 603758 (0.0005) [2023-12-26 04:26:27,004][123090] Updated weights for policy 1, policy_version 603768 (0.0006) [2023-12-26 04:26:27,263][123091] Updated weights for policy 0, policy_version 607924 (0.0007) [2023-12-26 04:26:27,318][123091] Updated weights for policy 0, policy_version 607935 (0.0010) [2023-12-26 04:26:27,372][123091] Updated weights for policy 0, policy_version 607945 (0.0009) [2023-12-26 04:26:27,722][123090] Updated weights for policy 1, policy_version 603778 (0.0008) [2023-12-26 04:26:27,783][123090] Updated weights for policy 1, policy_version 603788 (0.0005) [2023-12-26 04:26:27,839][123090] Updated weights for policy 1, policy_version 603798 (0.0005) [2023-12-26 04:26:27,901][123090] Updated weights for policy 1, policy_version 603808 (0.0005) [2023-12-26 04:26:28,186][123091] Updated weights for policy 0, policy_version 607955 (0.0010) [2023-12-26 04:26:28,249][123091] Updated weights for policy 0, policy_version 607965 (0.0009) [2023-12-26 04:26:28,314][123091] Updated weights for policy 0, policy_version 607975 (0.0009) [2023-12-26 04:26:28,595][123090] Updated weights for policy 1, policy_version 603818 (0.0008) [2023-12-26 04:26:28,655][123090] Updated weights for policy 1, policy_version 603828 (0.0005) [2023-12-26 04:26:28,703][123090] Updated weights for policy 1, policy_version 603838 (0.0005) [2023-12-26 04:26:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 310231040. Throughput: 0: 9163.2, 1: 8655.2. Samples: 310220412. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:28,784][121949] Avg episode reward: [(0, '5971.201'), (1, '5489.679')] [2023-12-26 04:26:29,112][123091] Updated weights for policy 0, policy_version 607985 (0.0008) [2023-12-26 04:26:29,157][123091] Updated weights for policy 0, policy_version 607995 (0.0005) [2023-12-26 04:26:29,205][123091] Updated weights for policy 0, policy_version 608005 (0.0005) [2023-12-26 04:26:29,281][123091] Updated weights for policy 0, policy_version 608015 (0.0008) [2023-12-26 04:26:29,438][123090] Updated weights for policy 1, policy_version 603848 (0.0005) [2023-12-26 04:26:29,500][123090] Updated weights for policy 1, policy_version 603858 (0.0010) [2023-12-26 04:26:29,565][123090] Updated weights for policy 1, policy_version 603868 (0.0010) [2023-12-26 04:26:30,068][123091] Updated weights for policy 0, policy_version 608025 (0.0010) [2023-12-26 04:26:30,130][123091] Updated weights for policy 0, policy_version 608035 (0.0010) [2023-12-26 04:26:30,192][123091] Updated weights for policy 0, policy_version 608045 (0.0010) [2023-12-26 04:26:30,306][123090] Updated weights for policy 1, policy_version 603878 (0.0007) [2023-12-26 04:26:30,365][123090] Updated weights for policy 1, policy_version 603888 (0.0006) [2023-12-26 04:26:30,432][123090] Updated weights for policy 1, policy_version 603898 (0.0006) [2023-12-26 04:26:30,868][123091] Updated weights for policy 0, policy_version 608055 (0.0007) [2023-12-26 04:26:30,914][123091] Updated weights for policy 0, policy_version 608065 (0.0005) [2023-12-26 04:26:30,957][123091] Updated weights for policy 0, policy_version 608075 (0.0005) [2023-12-26 04:26:31,226][123090] Updated weights for policy 1, policy_version 603908 (0.0010) [2023-12-26 04:26:31,302][123090] Updated weights for policy 1, policy_version 603918 (0.0011) [2023-12-26 04:26:31,375][123090] Updated weights for policy 1, policy_version 603928 (0.0010) [2023-12-26 04:26:31,751][123091] Updated weights for policy 0, policy_version 608085 (0.0007) [2023-12-26 04:26:31,803][123091] Updated weights for policy 0, policy_version 608095 (0.0009) [2023-12-26 04:26:31,862][123091] Updated weights for policy 0, policy_version 608105 (0.0009) [2023-12-26 04:26:32,123][123090] Updated weights for policy 1, policy_version 603938 (0.0007) [2023-12-26 04:26:32,175][123090] Updated weights for policy 1, policy_version 603948 (0.0010) [2023-12-26 04:26:32,237][123090] Updated weights for policy 1, policy_version 603958 (0.0010) [2023-12-26 04:26:32,305][123090] Updated weights for policy 1, policy_version 603968 (0.0011) [2023-12-26 04:26:32,618][123091] Updated weights for policy 0, policy_version 608115 (0.0009) [2023-12-26 04:26:32,688][123091] Updated weights for policy 0, policy_version 608125 (0.0009) [2023-12-26 04:26:32,746][123091] Updated weights for policy 0, policy_version 608136 (0.0009) [2023-12-26 04:26:33,067][123090] Updated weights for policy 1, policy_version 603978 (0.0010) [2023-12-26 04:26:33,128][123090] Updated weights for policy 1, policy_version 603988 (0.0010) [2023-12-26 04:26:33,182][123090] Updated weights for policy 1, policy_version 603998 (0.0010) [2023-12-26 04:26:33,557][123091] Updated weights for policy 0, policy_version 608146 (0.0008) [2023-12-26 04:26:33,603][123091] Updated weights for policy 0, policy_version 608156 (0.0005) [2023-12-26 04:26:33,650][123091] Updated weights for policy 0, policy_version 608166 (0.0005) [2023-12-26 04:26:33,708][123091] Updated weights for policy 0, policy_version 608176 (0.0010) [2023-12-26 04:26:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 310321152. Throughput: 0: 9082.6, 1: 8652.0. Samples: 310330368. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:33,784][121949] Avg episode reward: [(0, '5834.906'), (1, '5624.740')] [2023-12-26 04:26:34,013][123090] Updated weights for policy 1, policy_version 604008 (0.0010) [2023-12-26 04:26:34,060][123090] Updated weights for policy 1, policy_version 604018 (0.0010) [2023-12-26 04:26:34,107][123090] Updated weights for policy 1, policy_version 604028 (0.0010) [2023-12-26 04:26:34,454][123091] Updated weights for policy 0, policy_version 608186 (0.0009) [2023-12-26 04:26:34,507][123091] Updated weights for policy 0, policy_version 608196 (0.0009) [2023-12-26 04:26:34,559][123091] Updated weights for policy 0, policy_version 608206 (0.0008) [2023-12-26 04:26:34,961][123090] Updated weights for policy 1, policy_version 604038 (0.0010) [2023-12-26 04:26:35,035][123090] Updated weights for policy 1, policy_version 604048 (0.0010) [2023-12-26 04:26:35,102][123090] Updated weights for policy 1, policy_version 604058 (0.0010) [2023-12-26 04:26:35,299][123091] Updated weights for policy 0, policy_version 608216 (0.0005) [2023-12-26 04:26:35,354][123091] Updated weights for policy 0, policy_version 608226 (0.0005) [2023-12-26 04:26:35,406][123091] Updated weights for policy 0, policy_version 608236 (0.0005) [2023-12-26 04:26:35,889][123090] Updated weights for policy 1, policy_version 604068 (0.0010) [2023-12-26 04:26:35,942][123090] Updated weights for policy 1, policy_version 604078 (0.0008) [2023-12-26 04:26:35,987][123091] Updated weights for policy 0, policy_version 608246 (0.0005) [2023-12-26 04:26:36,001][123090] Updated weights for policy 1, policy_version 604088 (0.0005) [2023-12-26 04:26:36,042][123091] Updated weights for policy 0, policy_version 608256 (0.0006) [2023-12-26 04:26:36,103][123091] Updated weights for policy 0, policy_version 608266 (0.0009) [2023-12-26 04:26:36,797][123090] Updated weights for policy 1, policy_version 604098 (0.0008) [2023-12-26 04:26:36,857][123090] Updated weights for policy 1, policy_version 604108 (0.0011) [2023-12-26 04:26:36,913][123090] Updated weights for policy 1, policy_version 604118 (0.0010) [2023-12-26 04:26:36,920][123091] Updated weights for policy 0, policy_version 608276 (0.0008) [2023-12-26 04:26:36,966][123091] Updated weights for policy 0, policy_version 608286 (0.0007) [2023-12-26 04:26:36,976][123090] Updated weights for policy 1, policy_version 604128 (0.0010) [2023-12-26 04:26:37,017][123091] Updated weights for policy 0, policy_version 608296 (0.0008) [2023-12-26 04:26:37,745][123091] Updated weights for policy 0, policy_version 608306 (0.0009) [2023-12-26 04:26:37,790][123090] Updated weights for policy 1, policy_version 604138 (0.0011) [2023-12-26 04:26:37,810][123091] Updated weights for policy 0, policy_version 608316 (0.0011) [2023-12-26 04:26:37,847][123090] Updated weights for policy 1, policy_version 604148 (0.0010) [2023-12-26 04:26:37,870][123091] Updated weights for policy 0, policy_version 608326 (0.0011) [2023-12-26 04:26:37,902][123090] Updated weights for policy 1, policy_version 604158 (0.0010) [2023-12-26 04:26:37,932][123091] Updated weights for policy 0, policy_version 608336 (0.0010) [2023-12-26 04:26:38,665][123090] Updated weights for policy 1, policy_version 604168 (0.0007) [2023-12-26 04:26:38,694][123091] Updated weights for policy 0, policy_version 608346 (0.0011) [2023-12-26 04:26:38,725][123090] Updated weights for policy 1, policy_version 604178 (0.0006) [2023-12-26 04:26:38,755][123091] Updated weights for policy 0, policy_version 608356 (0.0010) [2023-12-26 04:26:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 310403072. Throughput: 0: 9180.6, 1: 8676.9. Samples: 310385912. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:38,785][121949] Avg episode reward: [(0, '5878.067'), (1, '5397.820')] [2023-12-26 04:26:38,785][123090] Updated weights for policy 1, policy_version 604188 (0.0011) [2023-12-26 04:26:38,815][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000604192_154673152.pth... [2023-12-26 04:26:38,820][123091] Updated weights for policy 0, policy_version 608366 (0.0010) [2023-12-26 04:26:38,820][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000603168_154411008.pth [2023-12-26 04:26:38,828][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000608368_155746304.pth... [2023-12-26 04:26:38,831][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000607280_155467776.pth [2023-12-26 04:26:39,561][123090] Updated weights for policy 1, policy_version 604198 (0.0011) [2023-12-26 04:26:39,618][123090] Updated weights for policy 1, policy_version 604208 (0.0010) [2023-12-26 04:26:39,625][123091] Updated weights for policy 0, policy_version 608376 (0.0008) [2023-12-26 04:26:39,680][123090] Updated weights for policy 1, policy_version 604218 (0.0008) [2023-12-26 04:26:39,686][123091] Updated weights for policy 0, policy_version 608386 (0.0009) [2023-12-26 04:26:39,754][123091] Updated weights for policy 0, policy_version 608396 (0.0008) [2023-12-26 04:26:40,505][123090] Updated weights for policy 1, policy_version 604228 (0.0006) [2023-12-26 04:26:40,576][123090] Updated weights for policy 1, policy_version 604238 (0.0005) [2023-12-26 04:26:40,591][123091] Updated weights for policy 0, policy_version 608406 (0.0008) [2023-12-26 04:26:40,637][123090] Updated weights for policy 1, policy_version 604248 (0.0007) [2023-12-26 04:26:40,653][123091] Updated weights for policy 0, policy_version 608416 (0.0007) [2023-12-26 04:26:40,713][123091] Updated weights for policy 0, policy_version 608426 (0.0009) [2023-12-26 04:26:41,420][123090] Updated weights for policy 1, policy_version 604258 (0.0009) [2023-12-26 04:26:41,475][123090] Updated weights for policy 1, policy_version 604268 (0.0009) [2023-12-26 04:26:41,525][123090] Updated weights for policy 1, policy_version 604278 (0.0008) [2023-12-26 04:26:41,551][123091] Updated weights for policy 0, policy_version 608436 (0.0009) [2023-12-26 04:26:41,579][123090] Updated weights for policy 1, policy_version 604288 (0.0008) [2023-12-26 04:26:41,615][123091] Updated weights for policy 0, policy_version 608446 (0.0008) [2023-12-26 04:26:41,684][123091] Updated weights for policy 0, policy_version 608456 (0.0009) [2023-12-26 04:26:42,494][123090] Updated weights for policy 1, policy_version 604298 (0.0009) [2023-12-26 04:26:42,534][123091] Updated weights for policy 0, policy_version 608466 (0.0009) [2023-12-26 04:26:42,562][123090] Updated weights for policy 1, policy_version 604308 (0.0008) [2023-12-26 04:26:42,592][123091] Updated weights for policy 0, policy_version 608476 (0.0011) [2023-12-26 04:26:42,617][123090] Updated weights for policy 1, policy_version 604318 (0.0006) [2023-12-26 04:26:42,653][123091] Updated weights for policy 0, policy_version 608486 (0.0011) [2023-12-26 04:26:42,720][123091] Updated weights for policy 0, policy_version 608496 (0.0011) [2023-12-26 04:26:43,475][123090] Updated weights for policy 1, policy_version 604328 (0.0008) [2023-12-26 04:26:43,516][123091] Updated weights for policy 0, policy_version 608506 (0.0005) [2023-12-26 04:26:43,531][123090] Updated weights for policy 1, policy_version 604338 (0.0008) [2023-12-26 04:26:43,582][123091] Updated weights for policy 0, policy_version 608516 (0.0005) [2023-12-26 04:26:43,591][123090] Updated weights for policy 1, policy_version 604348 (0.0009) [2023-12-26 04:26:43,643][123091] Updated weights for policy 0, policy_version 608526 (0.0005) [2023-12-26 04:26:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 310501376. Throughput: 0: 9094.9, 1: 8623.8. Samples: 310490072. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:43,785][121949] Avg episode reward: [(0, '5986.833'), (1, '5400.186')] [2023-12-26 04:26:44,324][123091] Updated weights for policy 0, policy_version 608536 (0.0009) [2023-12-26 04:26:44,382][123091] Updated weights for policy 0, policy_version 608546 (0.0010) [2023-12-26 04:26:44,458][123091] Updated weights for policy 0, policy_version 608556 (0.0011) [2023-12-26 04:26:44,474][123090] Updated weights for policy 1, policy_version 604358 (0.0007) [2023-12-26 04:26:44,533][123090] Updated weights for policy 1, policy_version 604368 (0.0008) [2023-12-26 04:26:44,601][123090] Updated weights for policy 1, policy_version 604378 (0.0009) [2023-12-26 04:26:45,203][123091] Updated weights for policy 0, policy_version 608566 (0.0008) [2023-12-26 04:26:45,274][123091] Updated weights for policy 0, policy_version 608576 (0.0006) [2023-12-26 04:26:45,342][123091] Updated weights for policy 0, policy_version 608586 (0.0006) [2023-12-26 04:26:45,487][123090] Updated weights for policy 1, policy_version 604388 (0.0009) [2023-12-26 04:26:45,545][123090] Updated weights for policy 1, policy_version 604398 (0.0009) [2023-12-26 04:26:45,602][123090] Updated weights for policy 1, policy_version 604409 (0.0011) [2023-12-26 04:26:45,986][123091] Updated weights for policy 0, policy_version 608596 (0.0007) [2023-12-26 04:26:46,033][123091] Updated weights for policy 0, policy_version 608606 (0.0010) [2023-12-26 04:26:46,084][123091] Updated weights for policy 0, policy_version 608616 (0.0010) [2023-12-26 04:26:46,517][123090] Updated weights for policy 1, policy_version 604419 (0.0009) [2023-12-26 04:26:46,569][123090] Updated weights for policy 1, policy_version 604429 (0.0009) [2023-12-26 04:26:46,623][123090] Updated weights for policy 1, policy_version 604440 (0.0010) [2023-12-26 04:26:46,825][123091] Updated weights for policy 0, policy_version 608626 (0.0009) [2023-12-26 04:26:46,890][123091] Updated weights for policy 0, policy_version 608636 (0.0005) [2023-12-26 04:26:46,951][123091] Updated weights for policy 0, policy_version 608646 (0.0005) [2023-12-26 04:26:47,005][123091] Updated weights for policy 0, policy_version 608656 (0.0005) [2023-12-26 04:26:47,555][123090] Updated weights for policy 1, policy_version 604450 (0.0010) [2023-12-26 04:26:47,607][123090] Updated weights for policy 1, policy_version 604461 (0.0010) [2023-12-26 04:26:47,634][123091] Updated weights for policy 0, policy_version 608666 (0.0005) [2023-12-26 04:26:47,655][123090] Updated weights for policy 1, policy_version 604471 (0.0008) [2023-12-26 04:26:47,688][123091] Updated weights for policy 0, policy_version 608676 (0.0005) [2023-12-26 04:26:47,744][123091] Updated weights for policy 0, policy_version 608686 (0.0005) [2023-12-26 04:26:48,429][123091] Updated weights for policy 0, policy_version 608696 (0.0006) [2023-12-26 04:26:48,477][123091] Updated weights for policy 0, policy_version 608706 (0.0006) [2023-12-26 04:26:48,524][123090] Updated weights for policy 1, policy_version 604481 (0.0009) [2023-12-26 04:26:48,530][123091] Updated weights for policy 0, policy_version 608716 (0.0006) [2023-12-26 04:26:48,592][123090] Updated weights for policy 1, policy_version 604491 (0.0010) [2023-12-26 04:26:48,658][123090] Updated weights for policy 1, policy_version 604501 (0.0009) [2023-12-26 04:26:48,716][123090] Updated weights for policy 1, policy_version 604511 (0.0009) [2023-12-26 04:26:48,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 310591488. Throughput: 0: 9224.9, 1: 8546.4. Samples: 310598236. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:48,785][121949] Avg episode reward: [(0, '6053.761'), (1, '5591.206')] [2023-12-26 04:26:49,393][123091] Updated weights for policy 0, policy_version 608726 (0.0008) [2023-12-26 04:26:49,452][123091] Updated weights for policy 0, policy_version 608736 (0.0010) [2023-12-26 04:26:49,493][123090] Updated weights for policy 1, policy_version 604521 (0.0009) [2023-12-26 04:26:49,518][123091] Updated weights for policy 0, policy_version 608746 (0.0008) [2023-12-26 04:26:49,555][123090] Updated weights for policy 1, policy_version 604531 (0.0008) [2023-12-26 04:26:49,612][123090] Updated weights for policy 1, policy_version 604541 (0.0007) [2023-12-26 04:26:50,383][123091] Updated weights for policy 0, policy_version 608756 (0.0006) [2023-12-26 04:26:50,428][123090] Updated weights for policy 1, policy_version 604551 (0.0009) [2023-12-26 04:26:50,436][123091] Updated weights for policy 0, policy_version 608766 (0.0006) [2023-12-26 04:26:50,495][123091] Updated weights for policy 0, policy_version 608776 (0.0006) [2023-12-26 04:26:50,496][123090] Updated weights for policy 1, policy_version 604561 (0.0011) [2023-12-26 04:26:50,564][123090] Updated weights for policy 1, policy_version 604571 (0.0011) [2023-12-26 04:26:51,340][123091] Updated weights for policy 0, policy_version 608786 (0.0006) [2023-12-26 04:26:51,381][123090] Updated weights for policy 1, policy_version 604581 (0.0010) [2023-12-26 04:26:51,411][123091] Updated weights for policy 0, policy_version 608796 (0.0009) [2023-12-26 04:26:51,453][123090] Updated weights for policy 1, policy_version 604591 (0.0010) [2023-12-26 04:26:51,475][123091] Updated weights for policy 0, policy_version 608806 (0.0008) [2023-12-26 04:26:51,516][123090] Updated weights for policy 1, policy_version 604601 (0.0010) [2023-12-26 04:26:51,535][123091] Updated weights for policy 0, policy_version 608816 (0.0005) [2023-12-26 04:26:52,237][123091] Updated weights for policy 0, policy_version 608826 (0.0008) [2023-12-26 04:26:52,303][123091] Updated weights for policy 0, policy_version 608836 (0.0010) [2023-12-26 04:26:52,350][123090] Updated weights for policy 1, policy_version 604611 (0.0010) [2023-12-26 04:26:52,361][123091] Updated weights for policy 0, policy_version 608846 (0.0013) [2023-12-26 04:26:52,409][123090] Updated weights for policy 1, policy_version 604621 (0.0006) [2023-12-26 04:26:52,460][123090] Updated weights for policy 1, policy_version 604631 (0.0005) [2023-12-26 04:26:53,158][123090] Updated weights for policy 1, policy_version 604641 (0.0005) [2023-12-26 04:26:53,187][123091] Updated weights for policy 0, policy_version 608856 (0.0009) [2023-12-26 04:26:53,222][123090] Updated weights for policy 1, policy_version 604651 (0.0007) [2023-12-26 04:26:53,254][123091] Updated weights for policy 0, policy_version 608866 (0.0010) [2023-12-26 04:26:53,282][123090] Updated weights for policy 1, policy_version 604661 (0.0007) [2023-12-26 04:26:53,316][123091] Updated weights for policy 0, policy_version 608876 (0.0008) [2023-12-26 04:26:53,348][123090] Updated weights for policy 1, policy_version 604671 (0.0006) [2023-12-26 04:26:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 310673408. Throughput: 0: 9162.3, 1: 8566.3. Samples: 310649380. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:53,786][121949] Avg episode reward: [(0, '5896.574'), (1, '5449.444')] [2023-12-26 04:26:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000608880_155877376.pth... [2023-12-26 04:26:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000604672_154796032.pth... [2023-12-26 04:26:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000603648_154533888.pth [2023-12-26 04:26:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000607824_155607040.pth [2023-12-26 04:26:54,061][123091] Updated weights for policy 0, policy_version 608886 (0.0010) [2023-12-26 04:26:54,094][123090] Updated weights for policy 1, policy_version 604681 (0.0008) [2023-12-26 04:26:54,115][123091] Updated weights for policy 0, policy_version 608896 (0.0008) [2023-12-26 04:26:54,158][123090] Updated weights for policy 1, policy_version 604691 (0.0010) [2023-12-26 04:26:54,171][123091] Updated weights for policy 0, policy_version 608906 (0.0010) [2023-12-26 04:26:54,221][123090] Updated weights for policy 1, policy_version 604701 (0.0010) [2023-12-26 04:26:54,970][123090] Updated weights for policy 1, policy_version 604711 (0.0009) [2023-12-26 04:26:54,980][123091] Updated weights for policy 0, policy_version 608916 (0.0009) [2023-12-26 04:26:55,037][123090] Updated weights for policy 1, policy_version 604721 (0.0009) [2023-12-26 04:26:55,043][123091] Updated weights for policy 0, policy_version 608926 (0.0007) [2023-12-26 04:26:55,095][123091] Updated weights for policy 0, policy_version 608936 (0.0009) [2023-12-26 04:26:55,100][123090] Updated weights for policy 1, policy_version 604731 (0.0008) [2023-12-26 04:26:55,729][123090] Updated weights for policy 1, policy_version 604741 (0.0008) [2023-12-26 04:26:55,801][123090] Updated weights for policy 1, policy_version 604751 (0.0006) [2023-12-26 04:26:55,864][123091] Updated weights for policy 0, policy_version 608946 (0.0009) [2023-12-26 04:26:55,866][123090] Updated weights for policy 1, policy_version 604761 (0.0008) [2023-12-26 04:26:55,918][123091] Updated weights for policy 0, policy_version 608956 (0.0010) [2023-12-26 04:26:55,987][123091] Updated weights for policy 0, policy_version 608966 (0.0010) [2023-12-26 04:26:56,048][123091] Updated weights for policy 0, policy_version 608976 (0.0010) [2023-12-26 04:26:56,621][123090] Updated weights for policy 1, policy_version 604771 (0.0008) [2023-12-26 04:26:56,684][123090] Updated weights for policy 1, policy_version 604781 (0.0010) [2023-12-26 04:26:56,752][123090] Updated weights for policy 1, policy_version 604791 (0.0009) [2023-12-26 04:26:56,842][123091] Updated weights for policy 0, policy_version 608986 (0.0010) [2023-12-26 04:26:56,889][123091] Updated weights for policy 0, policy_version 608996 (0.0010) [2023-12-26 04:26:56,950][123091] Updated weights for policy 0, policy_version 609006 (0.0010) [2023-12-26 04:26:57,507][123090] Updated weights for policy 1, policy_version 604801 (0.0008) [2023-12-26 04:26:57,570][123090] Updated weights for policy 1, policy_version 604811 (0.0010) [2023-12-26 04:26:57,633][123090] Updated weights for policy 1, policy_version 604821 (0.0010) [2023-12-26 04:26:57,692][123090] Updated weights for policy 1, policy_version 604831 (0.0010) [2023-12-26 04:26:57,736][123091] Updated weights for policy 0, policy_version 609016 (0.0010) [2023-12-26 04:26:57,795][123091] Updated weights for policy 0, policy_version 609026 (0.0010) [2023-12-26 04:26:57,853][123091] Updated weights for policy 0, policy_version 609036 (0.0010) [2023-12-26 04:26:58,549][123090] Updated weights for policy 1, policy_version 604841 (0.0010) [2023-12-26 04:26:58,621][123090] Updated weights for policy 1, policy_version 604851 (0.0008) [2023-12-26 04:26:58,711][123090] Updated weights for policy 1, policy_version 604861 (0.0010) [2023-12-26 04:26:58,746][123091] Updated weights for policy 0, policy_version 609046 (0.0009) [2023-12-26 04:26:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 310763520. Throughput: 0: 9173.5, 1: 8728.5. Samples: 310759400. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:26:58,784][121949] Avg episode reward: [(0, '5762.266'), (1, '5381.009')] [2023-12-26 04:26:58,808][123091] Updated weights for policy 0, policy_version 609056 (0.0008) [2023-12-26 04:26:58,879][123091] Updated weights for policy 0, policy_version 609066 (0.0008) [2023-12-26 04:26:59,512][123090] Updated weights for policy 1, policy_version 604871 (0.0009) [2023-12-26 04:26:59,570][123090] Updated weights for policy 1, policy_version 604881 (0.0009) [2023-12-26 04:26:59,630][123090] Updated weights for policy 1, policy_version 604891 (0.0005) [2023-12-26 04:26:59,654][123091] Updated weights for policy 0, policy_version 609076 (0.0008) [2023-12-26 04:26:59,710][123091] Updated weights for policy 0, policy_version 609086 (0.0010) [2023-12-26 04:26:59,776][123091] Updated weights for policy 0, policy_version 609096 (0.0009) [2023-12-26 04:27:00,524][123090] Updated weights for policy 1, policy_version 604901 (0.0007) [2023-12-26 04:27:00,565][123091] Updated weights for policy 0, policy_version 609106 (0.0009) [2023-12-26 04:27:00,591][123090] Updated weights for policy 1, policy_version 604911 (0.0009) [2023-12-26 04:27:00,615][123091] Updated weights for policy 0, policy_version 609116 (0.0008) [2023-12-26 04:27:00,645][123090] Updated weights for policy 1, policy_version 604921 (0.0008) [2023-12-26 04:27:00,669][123091] Updated weights for policy 0, policy_version 609126 (0.0008) [2023-12-26 04:27:00,731][123091] Updated weights for policy 0, policy_version 609136 (0.0009) [2023-12-26 04:27:01,480][123090] Updated weights for policy 1, policy_version 604931 (0.0009) [2023-12-26 04:27:01,521][123091] Updated weights for policy 0, policy_version 609146 (0.0009) [2023-12-26 04:27:01,525][123090] Updated weights for policy 1, policy_version 604941 (0.0008) [2023-12-26 04:27:01,566][123091] Updated weights for policy 0, policy_version 609156 (0.0007) [2023-12-26 04:27:01,572][123090] Updated weights for policy 1, policy_version 604951 (0.0009) [2023-12-26 04:27:01,623][123091] Updated weights for policy 0, policy_version 609166 (0.0006) [2023-12-26 04:27:02,437][123090] Updated weights for policy 1, policy_version 604961 (0.0009) [2023-12-26 04:27:02,476][123091] Updated weights for policy 0, policy_version 609176 (0.0010) [2023-12-26 04:27:02,503][123090] Updated weights for policy 1, policy_version 604971 (0.0007) [2023-12-26 04:27:02,535][123091] Updated weights for policy 0, policy_version 609186 (0.0009) [2023-12-26 04:27:02,556][123090] Updated weights for policy 1, policy_version 604981 (0.0007) [2023-12-26 04:27:02,588][123091] Updated weights for policy 0, policy_version 609196 (0.0009) [2023-12-26 04:27:02,612][123090] Updated weights for policy 1, policy_version 604991 (0.0008) [2023-12-26 04:27:03,429][123091] Updated weights for policy 0, policy_version 609206 (0.0007) [2023-12-26 04:27:03,435][123090] Updated weights for policy 1, policy_version 605001 (0.0009) [2023-12-26 04:27:03,480][123091] Updated weights for policy 0, policy_version 609216 (0.0008) [2023-12-26 04:27:03,490][123090] Updated weights for policy 1, policy_version 605011 (0.0008) [2023-12-26 04:27:03,535][123091] Updated weights for policy 0, policy_version 609226 (0.0009) [2023-12-26 04:27:03,545][123090] Updated weights for policy 1, policy_version 605021 (0.0007) [2023-12-26 04:27:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 310853632. Throughput: 0: 9049.4, 1: 8711.4. Samples: 310860816. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 04:27:03,785][121949] Avg episode reward: [(0, '5877.714'), (1, '5296.700')] [2023-12-26 04:27:04,371][123091] Updated weights for policy 0, policy_version 609236 (0.0009) [2023-12-26 04:27:04,413][123090] Updated weights for policy 1, policy_version 605031 (0.0008) [2023-12-26 04:27:04,437][123091] Updated weights for policy 0, policy_version 609246 (0.0008) [2023-12-26 04:27:04,479][123090] Updated weights for policy 1, policy_version 605041 (0.0008) [2023-12-26 04:27:04,500][123091] Updated weights for policy 0, policy_version 609256 (0.0009) [2023-12-26 04:27:04,543][123090] Updated weights for policy 1, policy_version 605051 (0.0005) [2023-12-26 04:27:05,325][123091] Updated weights for policy 0, policy_version 609266 (0.0008) [2023-12-26 04:27:05,351][123090] Updated weights for policy 1, policy_version 605061 (0.0006) [2023-12-26 04:27:05,391][123091] Updated weights for policy 0, policy_version 609276 (0.0010) [2023-12-26 04:27:05,410][123090] Updated weights for policy 1, policy_version 605071 (0.0006) [2023-12-26 04:27:05,450][123091] Updated weights for policy 0, policy_version 609286 (0.0011) [2023-12-26 04:27:05,470][123090] Updated weights for policy 1, policy_version 605081 (0.0007) [2023-12-26 04:27:05,505][123091] Updated weights for policy 0, policy_version 609296 (0.0010) [2023-12-26 04:27:06,301][123090] Updated weights for policy 1, policy_version 605091 (0.0007) [2023-12-26 04:27:06,309][123091] Updated weights for policy 0, policy_version 609306 (0.0005) [2023-12-26 04:27:06,354][123090] Updated weights for policy 1, policy_version 605101 (0.0009) [2023-12-26 04:27:06,370][123091] Updated weights for policy 0, policy_version 609316 (0.0006) [2023-12-26 04:27:06,416][123090] Updated weights for policy 1, policy_version 605111 (0.0009) [2023-12-26 04:27:06,433][123091] Updated weights for policy 0, policy_version 609326 (0.0005) [2023-12-26 04:27:07,087][123091] Updated weights for policy 0, policy_version 609336 (0.0010) [2023-12-26 04:27:07,141][123091] Updated weights for policy 0, policy_version 609346 (0.0005) [2023-12-26 04:27:07,198][123091] Updated weights for policy 0, policy_version 609356 (0.0006) [2023-12-26 04:27:07,355][123090] Updated weights for policy 1, policy_version 605121 (0.0010) [2023-12-26 04:27:07,418][123090] Updated weights for policy 1, policy_version 605131 (0.0010) [2023-12-26 04:27:07,478][123090] Updated weights for policy 1, policy_version 605141 (0.0010) [2023-12-26 04:27:07,536][123090] Updated weights for policy 1, policy_version 605151 (0.0010) [2023-12-26 04:27:07,868][123091] Updated weights for policy 0, policy_version 609366 (0.0005) [2023-12-26 04:27:07,926][123091] Updated weights for policy 0, policy_version 609376 (0.0005) [2023-12-26 04:27:07,984][123091] Updated weights for policy 0, policy_version 609386 (0.0005) [2023-12-26 04:27:08,400][123090] Updated weights for policy 1, policy_version 605161 (0.0006) [2023-12-26 04:27:08,468][123090] Updated weights for policy 1, policy_version 605171 (0.0006) [2023-12-26 04:27:08,530][123090] Updated weights for policy 1, policy_version 605181 (0.0005) [2023-12-26 04:27:08,638][123091] Updated weights for policy 0, policy_version 609396 (0.0007) [2023-12-26 04:27:08,709][123091] Updated weights for policy 0, policy_version 609406 (0.0011) [2023-12-26 04:27:08,768][123091] Updated weights for policy 0, policy_version 609416 (0.0010) [2023-12-26 04:27:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 310935552. Throughput: 0: 9068.4, 1: 8713.4. Samples: 310912876. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:08,785][121949] Avg episode reward: [(0, '6115.933'), (1, '4642.794')] [2023-12-26 04:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000605184_154927104.pth... [2023-12-26 04:27:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000604192_154673152.pth [2023-12-26 04:27:08,820][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000609424_156016640.pth... [2023-12-26 04:27:08,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000608368_155746304.pth [2023-12-26 04:27:09,200][123090] Updated weights for policy 1, policy_version 605191 (0.0009) [2023-12-26 04:27:09,266][123090] Updated weights for policy 1, policy_version 605201 (0.0009) [2023-12-26 04:27:09,338][123090] Updated weights for policy 1, policy_version 605211 (0.0006) [2023-12-26 04:27:09,585][123091] Updated weights for policy 0, policy_version 609426 (0.0011) [2023-12-26 04:27:09,635][123091] Updated weights for policy 0, policy_version 609436 (0.0009) [2023-12-26 04:27:09,685][123091] Updated weights for policy 0, policy_version 609446 (0.0009) [2023-12-26 04:27:09,740][123091] Updated weights for policy 0, policy_version 609456 (0.0009) [2023-12-26 04:27:10,153][123090] Updated weights for policy 1, policy_version 605221 (0.0010) [2023-12-26 04:27:10,209][123090] Updated weights for policy 1, policy_version 605231 (0.0010) [2023-12-26 04:27:10,273][123090] Updated weights for policy 1, policy_version 605241 (0.0010) [2023-12-26 04:27:10,642][123091] Updated weights for policy 0, policy_version 609466 (0.0010) [2023-12-26 04:27:10,701][123091] Updated weights for policy 0, policy_version 609476 (0.0008) [2023-12-26 04:27:10,767][123091] Updated weights for policy 0, policy_version 609486 (0.0005) [2023-12-26 04:27:11,050][123090] Updated weights for policy 1, policy_version 605251 (0.0010) [2023-12-26 04:27:11,105][123090] Updated weights for policy 1, policy_version 605261 (0.0010) [2023-12-26 04:27:11,175][123090] Updated weights for policy 1, policy_version 605271 (0.0010) [2023-12-26 04:27:11,539][123091] Updated weights for policy 0, policy_version 609496 (0.0008) [2023-12-26 04:27:11,593][123091] Updated weights for policy 0, policy_version 609506 (0.0007) [2023-12-26 04:27:11,663][123091] Updated weights for policy 0, policy_version 609516 (0.0010) [2023-12-26 04:27:12,084][123090] Updated weights for policy 1, policy_version 605281 (0.0009) [2023-12-26 04:27:12,156][123090] Updated weights for policy 1, policy_version 605291 (0.0008) [2023-12-26 04:27:12,223][123090] Updated weights for policy 1, policy_version 605301 (0.0009) [2023-12-26 04:27:12,292][123090] Updated weights for policy 1, policy_version 605311 (0.0008) [2023-12-26 04:27:12,467][123091] Updated weights for policy 0, policy_version 609526 (0.0007) [2023-12-26 04:27:12,528][123091] Updated weights for policy 0, policy_version 609536 (0.0005) [2023-12-26 04:27:12,582][123091] Updated weights for policy 0, policy_version 609546 (0.0006) [2023-12-26 04:27:13,111][123090] Updated weights for policy 1, policy_version 605321 (0.0008) [2023-12-26 04:27:13,166][123090] Updated weights for policy 1, policy_version 605331 (0.0010) [2023-12-26 04:27:13,225][123090] Updated weights for policy 1, policy_version 605341 (0.0010) [2023-12-26 04:27:13,327][123091] Updated weights for policy 0, policy_version 609556 (0.0007) [2023-12-26 04:27:13,375][123091] Updated weights for policy 0, policy_version 609566 (0.0009) [2023-12-26 04:27:13,430][123091] Updated weights for policy 0, policy_version 609576 (0.0008) [2023-12-26 04:27:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 311025664. Throughput: 0: 9081.4, 1: 8670.1. Samples: 311019232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:13,784][121949] Avg episode reward: [(0, '6235.942'), (1, '3880.767')] [2023-12-26 04:27:14,057][123090] Updated weights for policy 1, policy_version 605351 (0.0010) [2023-12-26 04:27:14,112][123090] Updated weights for policy 1, policy_version 605361 (0.0010) [2023-12-26 04:27:14,163][123090] Updated weights for policy 1, policy_version 605371 (0.0010) [2023-12-26 04:27:14,278][123091] Updated weights for policy 0, policy_version 609586 (0.0009) [2023-12-26 04:27:14,340][123091] Updated weights for policy 0, policy_version 609596 (0.0008) [2023-12-26 04:27:14,408][123091] Updated weights for policy 0, policy_version 609606 (0.0009) [2023-12-26 04:27:14,455][123091] Updated weights for policy 0, policy_version 609616 (0.0008) [2023-12-26 04:27:15,008][123090] Updated weights for policy 1, policy_version 605381 (0.0010) [2023-12-26 04:27:15,068][123090] Updated weights for policy 1, policy_version 605391 (0.0010) [2023-12-26 04:27:15,128][123090] Updated weights for policy 1, policy_version 605401 (0.0011) [2023-12-26 04:27:15,294][123091] Updated weights for policy 0, policy_version 609626 (0.0009) [2023-12-26 04:27:15,355][123091] Updated weights for policy 0, policy_version 609636 (0.0009) [2023-12-26 04:27:15,416][123091] Updated weights for policy 0, policy_version 609646 (0.0009) [2023-12-26 04:27:15,961][123090] Updated weights for policy 1, policy_version 605411 (0.0011) [2023-12-26 04:27:16,014][123090] Updated weights for policy 1, policy_version 605421 (0.0010) [2023-12-26 04:27:16,061][123090] Updated weights for policy 1, policy_version 605431 (0.0010) [2023-12-26 04:27:16,260][123091] Updated weights for policy 0, policy_version 609656 (0.0009) [2023-12-26 04:27:16,308][123091] Updated weights for policy 0, policy_version 609666 (0.0008) [2023-12-26 04:27:16,364][123091] Updated weights for policy 0, policy_version 609676 (0.0009) [2023-12-26 04:27:16,829][123090] Updated weights for policy 1, policy_version 605441 (0.0010) [2023-12-26 04:27:16,883][123090] Updated weights for policy 1, policy_version 605451 (0.0005) [2023-12-26 04:27:16,944][123090] Updated weights for policy 1, policy_version 605461 (0.0005) [2023-12-26 04:27:17,011][123090] Updated weights for policy 1, policy_version 605471 (0.0006) [2023-12-26 04:27:17,261][123091] Updated weights for policy 0, policy_version 609686 (0.0009) [2023-12-26 04:27:17,312][123091] Updated weights for policy 0, policy_version 609696 (0.0009) [2023-12-26 04:27:17,363][123091] Updated weights for policy 0, policy_version 609706 (0.0009) [2023-12-26 04:27:17,671][123090] Updated weights for policy 1, policy_version 605481 (0.0009) [2023-12-26 04:27:17,726][123090] Updated weights for policy 1, policy_version 605491 (0.0009) [2023-12-26 04:27:17,780][123090] Updated weights for policy 1, policy_version 605501 (0.0008) [2023-12-26 04:27:18,260][123091] Updated weights for policy 0, policy_version 609716 (0.0009) [2023-12-26 04:27:18,311][123091] Updated weights for policy 0, policy_version 609726 (0.0009) [2023-12-26 04:27:18,366][123091] Updated weights for policy 0, policy_version 609736 (0.0009) [2023-12-26 04:27:18,538][123090] Updated weights for policy 1, policy_version 605511 (0.0009) [2023-12-26 04:27:18,592][123090] Updated weights for policy 1, policy_version 605521 (0.0009) [2023-12-26 04:27:18,651][123090] Updated weights for policy 1, policy_version 605532 (0.0009) [2023-12-26 04:27:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 311115776. Throughput: 0: 8986.0, 1: 8636.9. Samples: 311123400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:18,785][121949] Avg episode reward: [(0, '6090.156'), (1, '4086.686')] [2023-12-26 04:27:19,236][123091] Updated weights for policy 0, policy_version 609746 (0.0010) [2023-12-26 04:27:19,308][123091] Updated weights for policy 0, policy_version 609756 (0.0010) [2023-12-26 04:27:19,384][123091] Updated weights for policy 0, policy_version 609766 (0.0009) [2023-12-26 04:27:19,445][123091] Updated weights for policy 0, policy_version 609776 (0.0009) [2023-12-26 04:27:19,513][123090] Updated weights for policy 1, policy_version 605542 (0.0009) [2023-12-26 04:27:19,579][123090] Updated weights for policy 1, policy_version 605552 (0.0009) [2023-12-26 04:27:19,630][123090] Updated weights for policy 1, policy_version 605562 (0.0009) [2023-12-26 04:27:20,250][123091] Updated weights for policy 0, policy_version 609786 (0.0006) [2023-12-26 04:27:20,311][123091] Updated weights for policy 0, policy_version 609796 (0.0008) [2023-12-26 04:27:20,372][123091] Updated weights for policy 0, policy_version 609806 (0.0008) [2023-12-26 04:27:20,508][123090] Updated weights for policy 1, policy_version 605572 (0.0009) [2023-12-26 04:27:20,580][123090] Updated weights for policy 1, policy_version 605582 (0.0011) [2023-12-26 04:27:20,649][123090] Updated weights for policy 1, policy_version 605592 (0.0011) [2023-12-26 04:27:21,225][123091] Updated weights for policy 0, policy_version 609816 (0.0009) [2023-12-26 04:27:21,290][123091] Updated weights for policy 0, policy_version 609826 (0.0010) [2023-12-26 04:27:21,363][123091] Updated weights for policy 0, policy_version 609836 (0.0010) [2023-12-26 04:27:21,486][123090] Updated weights for policy 1, policy_version 605602 (0.0010) [2023-12-26 04:27:21,560][123090] Updated weights for policy 1, policy_version 605612 (0.0008) [2023-12-26 04:27:21,625][123090] Updated weights for policy 1, policy_version 605622 (0.0007) [2023-12-26 04:27:21,703][123090] Updated weights for policy 1, policy_version 605632 (0.0010) [2023-12-26 04:27:22,233][123091] Updated weights for policy 0, policy_version 609846 (0.0010) [2023-12-26 04:27:22,298][123091] Updated weights for policy 0, policy_version 609856 (0.0011) [2023-12-26 04:27:22,372][123091] Updated weights for policy 0, policy_version 609866 (0.0010) [2023-12-26 04:27:22,567][123090] Updated weights for policy 1, policy_version 605642 (0.0010) [2023-12-26 04:27:22,635][123090] Updated weights for policy 1, policy_version 605652 (0.0009) [2023-12-26 04:27:22,693][123090] Updated weights for policy 1, policy_version 605662 (0.0009) [2023-12-26 04:27:23,157][123091] Updated weights for policy 0, policy_version 609876 (0.0009) [2023-12-26 04:27:23,213][123091] Updated weights for policy 0, policy_version 609886 (0.0009) [2023-12-26 04:27:23,269][123091] Updated weights for policy 0, policy_version 609896 (0.0009) [2023-12-26 04:27:23,560][123090] Updated weights for policy 1, policy_version 605672 (0.0010) [2023-12-26 04:27:23,614][123090] Updated weights for policy 1, policy_version 605683 (0.0010) [2023-12-26 04:27:23,667][123090] Updated weights for policy 1, policy_version 605693 (0.0009) [2023-12-26 04:27:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 311197696. Throughput: 0: 8890.1, 1: 8607.5. Samples: 311173308. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:23,785][121949] Avg episode reward: [(0, '5975.106'), (1, '4443.542')] [2023-12-26 04:27:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000609904_156139520.pth... [2023-12-26 04:27:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000605696_155058176.pth... [2023-12-26 04:27:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000608880_155877376.pth [2023-12-26 04:27:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000604672_154796032.pth [2023-12-26 04:27:24,015][123091] Updated weights for policy 0, policy_version 609906 (0.0006) [2023-12-26 04:27:24,079][123091] Updated weights for policy 0, policy_version 609916 (0.0005) [2023-12-26 04:27:24,160][123091] Updated weights for policy 0, policy_version 609926 (0.0005) [2023-12-26 04:27:24,217][123091] Updated weights for policy 0, policy_version 609936 (0.0010) [2023-12-26 04:27:24,560][123090] Updated weights for policy 1, policy_version 605703 (0.0010) [2023-12-26 04:27:24,606][123090] Updated weights for policy 1, policy_version 605713 (0.0009) [2023-12-26 04:27:24,656][123090] Updated weights for policy 1, policy_version 605723 (0.0009) [2023-12-26 04:27:24,957][123091] Updated weights for policy 0, policy_version 609946 (0.0010) [2023-12-26 04:27:25,043][123091] Updated weights for policy 0, policy_version 609956 (0.0007) [2023-12-26 04:27:25,106][123091] Updated weights for policy 0, policy_version 609966 (0.0005) [2023-12-26 04:27:25,600][123090] Updated weights for policy 1, policy_version 605733 (0.0009) [2023-12-26 04:27:25,664][123090] Updated weights for policy 1, policy_version 605743 (0.0010) [2023-12-26 04:27:25,724][123090] Updated weights for policy 1, policy_version 605753 (0.0010) [2023-12-26 04:27:25,754][123091] Updated weights for policy 0, policy_version 609976 (0.0007) [2023-12-26 04:27:25,803][123091] Updated weights for policy 0, policy_version 609986 (0.0006) [2023-12-26 04:27:25,866][123091] Updated weights for policy 0, policy_version 609996 (0.0005) [2023-12-26 04:27:26,552][123091] Updated weights for policy 0, policy_version 610006 (0.0009) [2023-12-26 04:27:26,620][123091] Updated weights for policy 0, policy_version 610016 (0.0007) [2023-12-26 04:27:26,628][123090] Updated weights for policy 1, policy_version 605764 (0.0009) [2023-12-26 04:27:26,682][123090] Updated weights for policy 1, policy_version 605774 (0.0009) [2023-12-26 04:27:26,683][123091] Updated weights for policy 0, policy_version 610026 (0.0006) [2023-12-26 04:27:26,736][123090] Updated weights for policy 1, policy_version 605784 (0.0009) [2023-12-26 04:27:27,274][123091] Updated weights for policy 0, policy_version 610036 (0.0007) [2023-12-26 04:27:27,338][123091] Updated weights for policy 0, policy_version 610046 (0.0008) [2023-12-26 04:27:27,399][123091] Updated weights for policy 0, policy_version 610056 (0.0006) [2023-12-26 04:27:27,652][123090] Updated weights for policy 1, policy_version 605795 (0.0008) [2023-12-26 04:27:27,723][123090] Updated weights for policy 1, policy_version 605805 (0.0005) [2023-12-26 04:27:27,793][123090] Updated weights for policy 1, policy_version 605815 (0.0005) [2023-12-26 04:27:28,062][123091] Updated weights for policy 0, policy_version 610066 (0.0005) [2023-12-26 04:27:28,121][123091] Updated weights for policy 0, policy_version 610076 (0.0006) [2023-12-26 04:27:28,172][123091] Updated weights for policy 0, policy_version 610086 (0.0005) [2023-12-26 04:27:28,222][123091] Updated weights for policy 0, policy_version 610096 (0.0005) [2023-12-26 04:27:28,462][123090] Updated weights for policy 1, policy_version 605825 (0.0005) [2023-12-26 04:27:28,514][123090] Updated weights for policy 1, policy_version 605835 (0.0005) [2023-12-26 04:27:28,572][123090] Updated weights for policy 1, policy_version 605845 (0.0005) [2023-12-26 04:27:28,634][123090] Updated weights for policy 1, policy_version 605855 (0.0008) [2023-12-26 04:27:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 311287808. Throughput: 0: 8992.2, 1: 8525.2. Samples: 311278352. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:28,785][121949] Avg episode reward: [(0, '6181.221'), (1, '4499.380')] [2023-12-26 04:27:29,023][123091] Updated weights for policy 0, policy_version 610106 (0.0010) [2023-12-26 04:27:29,084][123091] Updated weights for policy 0, policy_version 610116 (0.0010) [2023-12-26 04:27:29,142][123091] Updated weights for policy 0, policy_version 610126 (0.0010) [2023-12-26 04:27:29,297][123090] Updated weights for policy 1, policy_version 605865 (0.0010) [2023-12-26 04:27:29,364][123090] Updated weights for policy 1, policy_version 605875 (0.0011) [2023-12-26 04:27:29,442][123090] Updated weights for policy 1, policy_version 605885 (0.0007) [2023-12-26 04:27:29,946][123091] Updated weights for policy 0, policy_version 610136 (0.0010) [2023-12-26 04:27:30,001][123091] Updated weights for policy 0, policy_version 610147 (0.0008) [2023-12-26 04:27:30,059][123091] Updated weights for policy 0, policy_version 610157 (0.0008) [2023-12-26 04:27:30,164][123090] Updated weights for policy 1, policy_version 605895 (0.0009) [2023-12-26 04:27:30,227][123090] Updated weights for policy 1, policy_version 605905 (0.0010) [2023-12-26 04:27:30,294][123090] Updated weights for policy 1, policy_version 605915 (0.0010) [2023-12-26 04:27:30,878][123091] Updated weights for policy 0, policy_version 610167 (0.0006) [2023-12-26 04:27:30,939][123091] Updated weights for policy 0, policy_version 610177 (0.0005) [2023-12-26 04:27:30,988][123091] Updated weights for policy 0, policy_version 610187 (0.0005) [2023-12-26 04:27:31,123][123090] Updated weights for policy 1, policy_version 605925 (0.0009) [2023-12-26 04:27:31,182][123090] Updated weights for policy 1, policy_version 605935 (0.0008) [2023-12-26 04:27:31,242][123090] Updated weights for policy 1, policy_version 605945 (0.0007) [2023-12-26 04:27:31,861][123091] Updated weights for policy 0, policy_version 610197 (0.0008) [2023-12-26 04:27:31,925][123091] Updated weights for policy 0, policy_version 610207 (0.0009) [2023-12-26 04:27:31,993][123091] Updated weights for policy 0, policy_version 610217 (0.0009) [2023-12-26 04:27:31,999][123090] Updated weights for policy 1, policy_version 605955 (0.0010) [2023-12-26 04:27:32,060][123090] Updated weights for policy 1, policy_version 605965 (0.0009) [2023-12-26 04:27:32,122][123090] Updated weights for policy 1, policy_version 605975 (0.0010) [2023-12-26 04:27:32,743][123091] Updated weights for policy 0, policy_version 610227 (0.0006) [2023-12-26 04:27:32,806][123091] Updated weights for policy 0, policy_version 610237 (0.0005) [2023-12-26 04:27:32,859][123091] Updated weights for policy 0, policy_version 610247 (0.0005) [2023-12-26 04:27:32,971][123090] Updated weights for policy 1, policy_version 605985 (0.0010) [2023-12-26 04:27:33,023][123090] Updated weights for policy 1, policy_version 605996 (0.0010) [2023-12-26 04:27:33,075][123090] Updated weights for policy 1, policy_version 606006 (0.0008) [2023-12-26 04:27:33,138][123090] Updated weights for policy 1, policy_version 606016 (0.0010) [2023-12-26 04:27:33,626][123091] Updated weights for policy 0, policy_version 610257 (0.0008) [2023-12-26 04:27:33,680][123091] Updated weights for policy 0, policy_version 610267 (0.0006) [2023-12-26 04:27:33,742][123091] Updated weights for policy 0, policy_version 610277 (0.0005) [2023-12-26 04:27:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 311369728. Throughput: 0: 8878.2, 1: 8652.6. Samples: 311387124. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:33,786][121949] Avg episode reward: [(0, '6196.029'), (1, '4607.874')] [2023-12-26 04:27:33,807][123091] Updated weights for policy 0, policy_version 610287 (0.0007) [2023-12-26 04:27:33,965][123090] Updated weights for policy 1, policy_version 606026 (0.0005) [2023-12-26 04:27:34,017][123090] Updated weights for policy 1, policy_version 606036 (0.0005) [2023-12-26 04:27:34,072][123090] Updated weights for policy 1, policy_version 606046 (0.0005) [2023-12-26 04:27:34,508][123091] Updated weights for policy 0, policy_version 610297 (0.0007) [2023-12-26 04:27:34,565][123091] Updated weights for policy 0, policy_version 610307 (0.0006) [2023-12-26 04:27:34,625][123091] Updated weights for policy 0, policy_version 610317 (0.0010) [2023-12-26 04:27:34,902][123090] Updated weights for policy 1, policy_version 606056 (0.0008) [2023-12-26 04:27:34,957][123090] Updated weights for policy 1, policy_version 606066 (0.0009) [2023-12-26 04:27:35,018][123090] Updated weights for policy 1, policy_version 606076 (0.0009) [2023-12-26 04:27:35,398][123091] Updated weights for policy 0, policy_version 610327 (0.0007) [2023-12-26 04:27:35,459][123091] Updated weights for policy 0, policy_version 610337 (0.0005) [2023-12-26 04:27:35,522][123091] Updated weights for policy 0, policy_version 610347 (0.0007) [2023-12-26 04:27:35,881][123090] Updated weights for policy 1, policy_version 606086 (0.0010) [2023-12-26 04:27:35,932][123090] Updated weights for policy 1, policy_version 606096 (0.0010) [2023-12-26 04:27:35,979][123090] Updated weights for policy 1, policy_version 606106 (0.0010) [2023-12-26 04:27:36,281][123091] Updated weights for policy 0, policy_version 610357 (0.0010) [2023-12-26 04:27:36,344][123091] Updated weights for policy 0, policy_version 610367 (0.0011) [2023-12-26 04:27:36,412][123091] Updated weights for policy 0, policy_version 610377 (0.0011) [2023-12-26 04:27:36,841][123090] Updated weights for policy 1, policy_version 606116 (0.0010) [2023-12-26 04:27:36,893][123090] Updated weights for policy 1, policy_version 606126 (0.0010) [2023-12-26 04:27:36,944][123090] Updated weights for policy 1, policy_version 606136 (0.0010) [2023-12-26 04:27:37,221][123091] Updated weights for policy 0, policy_version 610387 (0.0011) [2023-12-26 04:27:37,284][123091] Updated weights for policy 0, policy_version 610397 (0.0010) [2023-12-26 04:27:37,354][123091] Updated weights for policy 0, policy_version 610407 (0.0011) [2023-12-26 04:27:37,788][123090] Updated weights for policy 1, policy_version 606146 (0.0010) [2023-12-26 04:27:37,839][123090] Updated weights for policy 1, policy_version 606156 (0.0010) [2023-12-26 04:27:37,890][123090] Updated weights for policy 1, policy_version 606166 (0.0010) [2023-12-26 04:27:37,941][123090] Updated weights for policy 1, policy_version 606176 (0.0010) [2023-12-26 04:27:38,135][123091] Updated weights for policy 0, policy_version 610417 (0.0010) [2023-12-26 04:27:38,192][123091] Updated weights for policy 0, policy_version 610427 (0.0010) [2023-12-26 04:27:38,254][123091] Updated weights for policy 0, policy_version 610437 (0.0010) [2023-12-26 04:27:38,320][123091] Updated weights for policy 0, policy_version 610447 (0.0010) [2023-12-26 04:27:38,724][123090] Updated weights for policy 1, policy_version 606186 (0.0008) [2023-12-26 04:27:38,784][123090] Updated weights for policy 1, policy_version 606196 (0.0010) [2023-12-26 04:27:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 311459840. Throughput: 0: 8929.4, 1: 8650.4. Samples: 311440464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:38,785][121949] Avg episode reward: [(0, '6060.908'), (1, '4561.872')] [2023-12-26 04:27:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000610448_156278784.pth... [2023-12-26 04:27:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000609424_156016640.pth [2023-12-26 04:27:38,851][123090] Updated weights for policy 1, policy_version 606206 (0.0010) [2023-12-26 04:27:38,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000606208_155189248.pth... [2023-12-26 04:27:38,863][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000605184_154927104.pth [2023-12-26 04:27:39,065][123091] Updated weights for policy 0, policy_version 610457 (0.0010) [2023-12-26 04:27:39,124][123091] Updated weights for policy 0, policy_version 610467 (0.0010) [2023-12-26 04:27:39,183][123091] Updated weights for policy 0, policy_version 610477 (0.0011) [2023-12-26 04:27:39,689][123090] Updated weights for policy 1, policy_version 606216 (0.0010) [2023-12-26 04:27:39,756][123090] Updated weights for policy 1, policy_version 606226 (0.0009) [2023-12-26 04:27:39,826][123090] Updated weights for policy 1, policy_version 606236 (0.0010) [2023-12-26 04:27:40,007][123091] Updated weights for policy 0, policy_version 610487 (0.0010) [2023-12-26 04:27:40,083][123091] Updated weights for policy 0, policy_version 610497 (0.0009) [2023-12-26 04:27:40,156][123091] Updated weights for policy 0, policy_version 610507 (0.0010) [2023-12-26 04:27:40,557][123090] Updated weights for policy 1, policy_version 606246 (0.0009) [2023-12-26 04:27:40,627][123090] Updated weights for policy 1, policy_version 606256 (0.0007) [2023-12-26 04:27:40,700][123090] Updated weights for policy 1, policy_version 606266 (0.0008) [2023-12-26 04:27:41,059][123091] Updated weights for policy 0, policy_version 610517 (0.0010) [2023-12-26 04:27:41,129][123091] Updated weights for policy 0, policy_version 610527 (0.0010) [2023-12-26 04:27:41,204][123091] Updated weights for policy 0, policy_version 610537 (0.0009) [2023-12-26 04:27:41,434][123090] Updated weights for policy 1, policy_version 606276 (0.0008) [2023-12-26 04:27:41,494][123090] Updated weights for policy 1, policy_version 606286 (0.0009) [2023-12-26 04:27:41,557][123090] Updated weights for policy 1, policy_version 606296 (0.0009) [2023-12-26 04:27:42,019][123091] Updated weights for policy 0, policy_version 610547 (0.0008) [2023-12-26 04:27:42,067][123091] Updated weights for policy 0, policy_version 610557 (0.0005) [2023-12-26 04:27:42,118][123091] Updated weights for policy 0, policy_version 610567 (0.0005) [2023-12-26 04:27:42,472][123090] Updated weights for policy 1, policy_version 606306 (0.0010) [2023-12-26 04:27:42,540][123090] Updated weights for policy 1, policy_version 606316 (0.0009) [2023-12-26 04:27:42,599][123090] Updated weights for policy 1, policy_version 606326 (0.0009) [2023-12-26 04:27:42,651][123090] Updated weights for policy 1, policy_version 606336 (0.0009) [2023-12-26 04:27:42,852][123091] Updated weights for policy 0, policy_version 610577 (0.0006) [2023-12-26 04:27:42,905][123091] Updated weights for policy 0, policy_version 610587 (0.0009) [2023-12-26 04:27:42,963][123091] Updated weights for policy 0, policy_version 610597 (0.0010) [2023-12-26 04:27:43,020][123091] Updated weights for policy 0, policy_version 610607 (0.0010) [2023-12-26 04:27:43,546][123090] Updated weights for policy 1, policy_version 606346 (0.0010) [2023-12-26 04:27:43,612][123090] Updated weights for policy 1, policy_version 606356 (0.0010) [2023-12-26 04:27:43,674][123090] Updated weights for policy 1, policy_version 606366 (0.0010) [2023-12-26 04:27:43,768][123091] Updated weights for policy 0, policy_version 610617 (0.0005) [2023-12-26 04:27:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 311549952. Throughput: 0: 8874.5, 1: 8558.5. Samples: 311543884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:43,785][121949] Avg episode reward: [(0, '6084.420'), (1, '4663.839')] [2023-12-26 04:27:43,823][123091] Updated weights for policy 0, policy_version 610627 (0.0005) [2023-12-26 04:27:43,872][123091] Updated weights for policy 0, policy_version 610637 (0.0005) [2023-12-26 04:27:44,447][123090] Updated weights for policy 1, policy_version 606376 (0.0010) [2023-12-26 04:27:44,516][123090] Updated weights for policy 1, policy_version 606386 (0.0010) [2023-12-26 04:27:44,572][123090] Updated weights for policy 1, policy_version 606396 (0.0010) [2023-12-26 04:27:44,583][123091] Updated weights for policy 0, policy_version 610647 (0.0005) [2023-12-26 04:27:44,631][123091] Updated weights for policy 0, policy_version 610657 (0.0005) [2023-12-26 04:27:44,692][123091] Updated weights for policy 0, policy_version 610667 (0.0006) [2023-12-26 04:27:45,412][123090] Updated weights for policy 1, policy_version 606406 (0.0011) [2023-12-26 04:27:45,483][123090] Updated weights for policy 1, policy_version 606416 (0.0011) [2023-12-26 04:27:45,488][123091] Updated weights for policy 0, policy_version 610677 (0.0008) [2023-12-26 04:27:45,539][123091] Updated weights for policy 0, policy_version 610687 (0.0011) [2023-12-26 04:27:45,554][123090] Updated weights for policy 1, policy_version 606426 (0.0010) [2023-12-26 04:27:45,593][123091] Updated weights for policy 0, policy_version 610697 (0.0006) [2023-12-26 04:27:46,264][123090] Updated weights for policy 1, policy_version 606436 (0.0009) [2023-12-26 04:27:46,317][123091] Updated weights for policy 0, policy_version 610707 (0.0007) [2023-12-26 04:27:46,319][123090] Updated weights for policy 1, policy_version 606446 (0.0010) [2023-12-26 04:27:46,368][123091] Updated weights for policy 0, policy_version 610717 (0.0010) [2023-12-26 04:27:46,374][123090] Updated weights for policy 1, policy_version 606456 (0.0010) [2023-12-26 04:27:46,422][123091] Updated weights for policy 0, policy_version 610727 (0.0010) [2023-12-26 04:27:47,210][123090] Updated weights for policy 1, policy_version 606466 (0.0010) [2023-12-26 04:27:47,257][123091] Updated weights for policy 0, policy_version 610737 (0.0010) [2023-12-26 04:27:47,261][123090] Updated weights for policy 1, policy_version 606476 (0.0010) [2023-12-26 04:27:47,305][123090] Updated weights for policy 1, policy_version 606486 (0.0010) [2023-12-26 04:27:47,317][123091] Updated weights for policy 0, policy_version 610747 (0.0005) [2023-12-26 04:27:47,349][123090] Updated weights for policy 1, policy_version 606496 (0.0010) [2023-12-26 04:27:47,384][123091] Updated weights for policy 0, policy_version 610757 (0.0005) [2023-12-26 04:27:47,459][123091] Updated weights for policy 0, policy_version 610767 (0.0005) [2023-12-26 04:27:48,095][123091] Updated weights for policy 0, policy_version 610777 (0.0010) [2023-12-26 04:27:48,150][123091] Updated weights for policy 0, policy_version 610787 (0.0010) [2023-12-26 04:27:48,205][123091] Updated weights for policy 0, policy_version 610797 (0.0010) [2023-12-26 04:27:48,211][123090] Updated weights for policy 1, policy_version 606506 (0.0010) [2023-12-26 04:27:48,262][123090] Updated weights for policy 1, policy_version 606516 (0.0010) [2023-12-26 04:27:48,310][123090] Updated weights for policy 1, policy_version 606526 (0.0010) [2023-12-26 04:27:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 311640064. Throughput: 0: 8987.3, 1: 8595.3. Samples: 311652032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:48,785][121949] Avg episode reward: [(0, '6130.935'), (1, '5037.651')] [2023-12-26 04:27:49,072][123091] Updated weights for policy 0, policy_version 610807 (0.0008) [2023-12-26 04:27:49,119][123090] Updated weights for policy 1, policy_version 606536 (0.0010) [2023-12-26 04:27:49,139][123091] Updated weights for policy 0, policy_version 610817 (0.0009) [2023-12-26 04:27:49,174][123090] Updated weights for policy 1, policy_version 606546 (0.0010) [2023-12-26 04:27:49,186][123091] Updated weights for policy 0, policy_version 610827 (0.0010) [2023-12-26 04:27:49,238][123090] Updated weights for policy 1, policy_version 606556 (0.0010) [2023-12-26 04:27:50,034][123091] Updated weights for policy 0, policy_version 610837 (0.0008) [2023-12-26 04:27:50,043][123090] Updated weights for policy 1, policy_version 606566 (0.0010) [2023-12-26 04:27:50,096][123091] Updated weights for policy 0, policy_version 610847 (0.0008) [2023-12-26 04:27:50,104][123090] Updated weights for policy 1, policy_version 606576 (0.0008) [2023-12-26 04:27:50,155][123091] Updated weights for policy 0, policy_version 610857 (0.0007) [2023-12-26 04:27:50,168][123090] Updated weights for policy 1, policy_version 606586 (0.0009) [2023-12-26 04:27:50,935][123091] Updated weights for policy 0, policy_version 610867 (0.0007) [2023-12-26 04:27:51,007][123091] Updated weights for policy 0, policy_version 610877 (0.0009) [2023-12-26 04:27:51,039][123090] Updated weights for policy 1, policy_version 606596 (0.0010) [2023-12-26 04:27:51,073][123091] Updated weights for policy 0, policy_version 610887 (0.0008) [2023-12-26 04:27:51,105][123090] Updated weights for policy 1, policy_version 606606 (0.0006) [2023-12-26 04:27:51,168][123090] Updated weights for policy 1, policy_version 606616 (0.0007) [2023-12-26 04:27:51,801][123091] Updated weights for policy 0, policy_version 610897 (0.0008) [2023-12-26 04:27:51,861][123091] Updated weights for policy 0, policy_version 610907 (0.0006) [2023-12-26 04:27:51,926][123091] Updated weights for policy 0, policy_version 610917 (0.0006) [2023-12-26 04:27:51,986][123090] Updated weights for policy 1, policy_version 606626 (0.0005) [2023-12-26 04:27:51,990][123091] Updated weights for policy 0, policy_version 610927 (0.0006) [2023-12-26 04:27:52,039][123090] Updated weights for policy 1, policy_version 606636 (0.0006) [2023-12-26 04:27:52,100][123090] Updated weights for policy 1, policy_version 606646 (0.0006) [2023-12-26 04:27:52,157][123090] Updated weights for policy 1, policy_version 606656 (0.0009) [2023-12-26 04:27:52,740][123091] Updated weights for policy 0, policy_version 610937 (0.0009) [2023-12-26 04:27:52,808][123091] Updated weights for policy 0, policy_version 610947 (0.0010) [2023-12-26 04:27:52,873][123091] Updated weights for policy 0, policy_version 610957 (0.0007) [2023-12-26 04:27:52,950][123090] Updated weights for policy 1, policy_version 606666 (0.0010) [2023-12-26 04:27:53,006][123090] Updated weights for policy 1, policy_version 606676 (0.0009) [2023-12-26 04:27:53,073][123090] Updated weights for policy 1, policy_version 606686 (0.0009) [2023-12-26 04:27:53,672][123091] Updated weights for policy 0, policy_version 610967 (0.0009) [2023-12-26 04:27:53,729][123091] Updated weights for policy 0, policy_version 610977 (0.0009) [2023-12-26 04:27:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17633.6). Total num frames: 311721984. Throughput: 0: 8991.9, 1: 8597.7. Samples: 311704408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:53,785][121949] Avg episode reward: [(0, '6121.383'), (1, '5227.271')] [2023-12-26 04:27:53,786][123091] Updated weights for policy 0, policy_version 610987 (0.0009) [2023-12-26 04:27:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000606688_155312128.pth... [2023-12-26 04:27:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000605696_155058176.pth [2023-12-26 04:27:53,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000610992_156418048.pth... [2023-12-26 04:27:53,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000609904_156139520.pth [2023-12-26 04:27:53,954][123090] Updated weights for policy 1, policy_version 606696 (0.0010) [2023-12-26 04:27:54,012][123090] Updated weights for policy 1, policy_version 606706 (0.0009) [2023-12-26 04:27:54,063][123090] Updated weights for policy 1, policy_version 606716 (0.0009) [2023-12-26 04:27:54,587][123091] Updated weights for policy 0, policy_version 610997 (0.0010) [2023-12-26 04:27:54,644][123091] Updated weights for policy 0, policy_version 611007 (0.0006) [2023-12-26 04:27:54,691][123091] Updated weights for policy 0, policy_version 611017 (0.0005) [2023-12-26 04:27:54,894][123090] Updated weights for policy 1, policy_version 606726 (0.0010) [2023-12-26 04:27:54,958][123090] Updated weights for policy 1, policy_version 606736 (0.0010) [2023-12-26 04:27:55,021][123090] Updated weights for policy 1, policy_version 606747 (0.0010) [2023-12-26 04:27:55,498][123091] Updated weights for policy 0, policy_version 611027 (0.0006) [2023-12-26 04:27:55,565][123091] Updated weights for policy 0, policy_version 611037 (0.0009) [2023-12-26 04:27:55,633][123091] Updated weights for policy 0, policy_version 611047 (0.0009) [2023-12-26 04:27:55,840][123090] Updated weights for policy 1, policy_version 606757 (0.0007) [2023-12-26 04:27:55,897][123090] Updated weights for policy 1, policy_version 606767 (0.0005) [2023-12-26 04:27:55,961][123090] Updated weights for policy 1, policy_version 606777 (0.0005) [2023-12-26 04:27:56,367][123091] Updated weights for policy 0, policy_version 611057 (0.0009) [2023-12-26 04:27:56,417][123091] Updated weights for policy 0, policy_version 611067 (0.0005) [2023-12-26 04:27:56,470][123091] Updated weights for policy 0, policy_version 611077 (0.0005) [2023-12-26 04:27:56,518][123091] Updated weights for policy 0, policy_version 611087 (0.0005) [2023-12-26 04:27:56,705][123090] Updated weights for policy 1, policy_version 606787 (0.0007) [2023-12-26 04:27:56,762][123090] Updated weights for policy 1, policy_version 606797 (0.0009) [2023-12-26 04:27:56,820][123090] Updated weights for policy 1, policy_version 606807 (0.0005) [2023-12-26 04:27:57,154][123091] Updated weights for policy 0, policy_version 611097 (0.0009) [2023-12-26 04:27:57,225][123091] Updated weights for policy 0, policy_version 611107 (0.0010) [2023-12-26 04:27:57,284][123091] Updated weights for policy 0, policy_version 611117 (0.0010) [2023-12-26 04:27:57,523][123090] Updated weights for policy 1, policy_version 606817 (0.0008) [2023-12-26 04:27:57,591][123090] Updated weights for policy 1, policy_version 606827 (0.0009) [2023-12-26 04:27:57,644][123090] Updated weights for policy 1, policy_version 606837 (0.0006) [2023-12-26 04:27:57,699][123090] Updated weights for policy 1, policy_version 606847 (0.0005) [2023-12-26 04:27:58,203][123091] Updated weights for policy 0, policy_version 611127 (0.0008) [2023-12-26 04:27:58,275][123091] Updated weights for policy 0, policy_version 611137 (0.0011) [2023-12-26 04:27:58,345][123091] Updated weights for policy 0, policy_version 611147 (0.0011) [2023-12-26 04:27:58,389][123090] Updated weights for policy 1, policy_version 606857 (0.0009) [2023-12-26 04:27:58,452][123090] Updated weights for policy 1, policy_version 606867 (0.0009) [2023-12-26 04:27:58,522][123090] Updated weights for policy 1, policy_version 606877 (0.0006) [2023-12-26 04:27:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 311820288. Throughput: 0: 8962.6, 1: 8677.1. Samples: 311813020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:27:58,785][121949] Avg episode reward: [(0, '6055.607'), (1, '5210.941')] [2023-12-26 04:27:59,209][123091] Updated weights for policy 0, policy_version 611157 (0.0010) [2023-12-26 04:27:59,275][123091] Updated weights for policy 0, policy_version 611167 (0.0008) [2023-12-26 04:27:59,341][123091] Updated weights for policy 0, policy_version 611177 (0.0007) [2023-12-26 04:27:59,346][123090] Updated weights for policy 1, policy_version 606887 (0.0008) [2023-12-26 04:27:59,413][123090] Updated weights for policy 1, policy_version 606897 (0.0007) [2023-12-26 04:27:59,479][123090] Updated weights for policy 1, policy_version 606907 (0.0010) [2023-12-26 04:28:00,184][123091] Updated weights for policy 0, policy_version 611187 (0.0009) [2023-12-26 04:28:00,247][123091] Updated weights for policy 0, policy_version 611197 (0.0011) [2023-12-26 04:28:00,275][123090] Updated weights for policy 1, policy_version 606917 (0.0010) [2023-12-26 04:28:00,309][123091] Updated weights for policy 0, policy_version 611207 (0.0011) [2023-12-26 04:28:00,335][123090] Updated weights for policy 1, policy_version 606927 (0.0010) [2023-12-26 04:28:00,394][123090] Updated weights for policy 1, policy_version 606937 (0.0010) [2023-12-26 04:28:01,019][123091] Updated weights for policy 0, policy_version 611217 (0.0010) [2023-12-26 04:28:01,083][123091] Updated weights for policy 0, policy_version 611227 (0.0008) [2023-12-26 04:28:01,150][123091] Updated weights for policy 0, policy_version 611237 (0.0008) [2023-12-26 04:28:01,224][123091] Updated weights for policy 0, policy_version 611247 (0.0006) [2023-12-26 04:28:01,236][123090] Updated weights for policy 1, policy_version 606947 (0.0011) [2023-12-26 04:28:01,305][123090] Updated weights for policy 1, policy_version 606957 (0.0010) [2023-12-26 04:28:01,372][123090] Updated weights for policy 1, policy_version 606967 (0.0011) [2023-12-26 04:28:02,001][123091] Updated weights for policy 0, policy_version 611257 (0.0006) [2023-12-26 04:28:02,071][123091] Updated weights for policy 0, policy_version 611267 (0.0007) [2023-12-26 04:28:02,140][123091] Updated weights for policy 0, policy_version 611277 (0.0010) [2023-12-26 04:28:02,160][123090] Updated weights for policy 1, policy_version 606977 (0.0010) [2023-12-26 04:28:02,213][123090] Updated weights for policy 1, policy_version 606987 (0.0006) [2023-12-26 04:28:02,283][123090] Updated weights for policy 1, policy_version 606997 (0.0009) [2023-12-26 04:28:02,352][123090] Updated weights for policy 1, policy_version 607007 (0.0006) [2023-12-26 04:28:02,879][123091] Updated weights for policy 0, policy_version 611287 (0.0007) [2023-12-26 04:28:02,935][123091] Updated weights for policy 0, policy_version 611297 (0.0005) [2023-12-26 04:28:02,982][123091] Updated weights for policy 0, policy_version 611307 (0.0005) [2023-12-26 04:28:03,020][123090] Updated weights for policy 1, policy_version 607017 (0.0008) [2023-12-26 04:28:03,071][123090] Updated weights for policy 1, policy_version 607027 (0.0010) [2023-12-26 04:28:03,121][123090] Updated weights for policy 1, policy_version 607037 (0.0010) [2023-12-26 04:28:03,703][123091] Updated weights for policy 0, policy_version 611317 (0.0005) [2023-12-26 04:28:03,759][123091] Updated weights for policy 0, policy_version 611327 (0.0005) [2023-12-26 04:28:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 311902208. Throughput: 0: 9027.4, 1: 8686.9. Samples: 311920540. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:03,785][121949] Avg episode reward: [(0, '6205.119'), (1, '5215.110')] [2023-12-26 04:28:03,831][123091] Updated weights for policy 0, policy_version 611337 (0.0005) [2023-12-26 04:28:03,939][123090] Updated weights for policy 1, policy_version 607047 (0.0010) [2023-12-26 04:28:04,003][123090] Updated weights for policy 1, policy_version 607057 (0.0010) [2023-12-26 04:28:04,074][123090] Updated weights for policy 1, policy_version 607067 (0.0011) [2023-12-26 04:28:04,555][123091] Updated weights for policy 0, policy_version 611347 (0.0009) [2023-12-26 04:28:04,606][123091] Updated weights for policy 0, policy_version 611357 (0.0010) [2023-12-26 04:28:04,668][123091] Updated weights for policy 0, policy_version 611367 (0.0010) [2023-12-26 04:28:04,901][123090] Updated weights for policy 1, policy_version 607077 (0.0010) [2023-12-26 04:28:04,973][123090] Updated weights for policy 1, policy_version 607087 (0.0010) [2023-12-26 04:28:05,040][123090] Updated weights for policy 1, policy_version 607097 (0.0010) [2023-12-26 04:28:05,491][123091] Updated weights for policy 0, policy_version 611377 (0.0010) [2023-12-26 04:28:05,557][123091] Updated weights for policy 0, policy_version 611387 (0.0009) [2023-12-26 04:28:05,613][123091] Updated weights for policy 0, policy_version 611397 (0.0009) [2023-12-26 04:28:05,665][123091] Updated weights for policy 0, policy_version 611407 (0.0008) [2023-12-26 04:28:05,839][123090] Updated weights for policy 1, policy_version 607107 (0.0010) [2023-12-26 04:28:05,894][123090] Updated weights for policy 1, policy_version 607117 (0.0010) [2023-12-26 04:28:05,960][123090] Updated weights for policy 1, policy_version 607127 (0.0010) [2023-12-26 04:28:06,390][123091] Updated weights for policy 0, policy_version 611417 (0.0007) [2023-12-26 04:28:06,443][123091] Updated weights for policy 0, policy_version 611427 (0.0005) [2023-12-26 04:28:06,501][123091] Updated weights for policy 0, policy_version 611437 (0.0006) [2023-12-26 04:28:06,802][123090] Updated weights for policy 1, policy_version 607137 (0.0010) [2023-12-26 04:28:06,861][123090] Updated weights for policy 1, policy_version 607147 (0.0010) [2023-12-26 04:28:06,923][123090] Updated weights for policy 1, policy_version 607157 (0.0010) [2023-12-26 04:28:06,986][123090] Updated weights for policy 1, policy_version 607167 (0.0010) [2023-12-26 04:28:07,190][123091] Updated weights for policy 0, policy_version 611447 (0.0007) [2023-12-26 04:28:07,238][123091] Updated weights for policy 0, policy_version 611457 (0.0009) [2023-12-26 04:28:07,287][123091] Updated weights for policy 0, policy_version 611467 (0.0009) [2023-12-26 04:28:07,814][123090] Updated weights for policy 1, policy_version 607177 (0.0010) [2023-12-26 04:28:07,880][123090] Updated weights for policy 1, policy_version 607187 (0.0010) [2023-12-26 04:28:07,928][123090] Updated weights for policy 1, policy_version 607197 (0.0010) [2023-12-26 04:28:08,131][123091] Updated weights for policy 0, policy_version 611477 (0.0008) [2023-12-26 04:28:08,197][123091] Updated weights for policy 0, policy_version 611487 (0.0008) [2023-12-26 04:28:08,267][123091] Updated weights for policy 0, policy_version 611497 (0.0009) [2023-12-26 04:28:08,646][123090] Updated weights for policy 1, policy_version 607207 (0.0007) [2023-12-26 04:28:08,716][123090] Updated weights for policy 1, policy_version 607217 (0.0006) [2023-12-26 04:28:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 311992320. Throughput: 0: 9096.2, 1: 8697.9. Samples: 311974044. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:08,785][121949] Avg episode reward: [(0, '6203.456'), (1, '5400.241')] [2023-12-26 04:28:08,787][123090] Updated weights for policy 1, policy_version 607227 (0.0008) [2023-12-26 04:28:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000611504_156549120.pth... [2023-12-26 04:28:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000610448_156278784.pth [2023-12-26 04:28:08,819][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000607232_155451392.pth... [2023-12-26 04:28:08,823][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000606208_155189248.pth [2023-12-26 04:28:08,987][123091] Updated weights for policy 0, policy_version 611507 (0.0009) [2023-12-26 04:28:09,035][123091] Updated weights for policy 0, policy_version 611517 (0.0011) [2023-12-26 04:28:09,094][123091] Updated weights for policy 0, policy_version 611527 (0.0008) [2023-12-26 04:28:09,481][123090] Updated weights for policy 1, policy_version 607237 (0.0007) [2023-12-26 04:28:09,546][123090] Updated weights for policy 1, policy_version 607247 (0.0009) [2023-12-26 04:28:09,612][123090] Updated weights for policy 1, policy_version 607257 (0.0009) [2023-12-26 04:28:09,984][123091] Updated weights for policy 0, policy_version 611537 (0.0010) [2023-12-26 04:28:10,041][123091] Updated weights for policy 0, policy_version 611547 (0.0009) [2023-12-26 04:28:10,099][123091] Updated weights for policy 0, policy_version 611557 (0.0009) [2023-12-26 04:28:10,156][123091] Updated weights for policy 0, policy_version 611567 (0.0009) [2023-12-26 04:28:10,493][123090] Updated weights for policy 1, policy_version 607267 (0.0009) [2023-12-26 04:28:10,558][123090] Updated weights for policy 1, policy_version 607277 (0.0010) [2023-12-26 04:28:10,620][123090] Updated weights for policy 1, policy_version 607287 (0.0010) [2023-12-26 04:28:10,943][123091] Updated weights for policy 0, policy_version 611577 (0.0009) [2023-12-26 04:28:10,992][123091] Updated weights for policy 0, policy_version 611587 (0.0009) [2023-12-26 04:28:11,055][123091] Updated weights for policy 0, policy_version 611597 (0.0009) [2023-12-26 04:28:11,489][123090] Updated weights for policy 1, policy_version 607297 (0.0010) [2023-12-26 04:28:11,561][123090] Updated weights for policy 1, policy_version 607307 (0.0008) [2023-12-26 04:28:11,634][123090] Updated weights for policy 1, policy_version 607317 (0.0010) [2023-12-26 04:28:11,704][123090] Updated weights for policy 1, policy_version 607327 (0.0009) [2023-12-26 04:28:11,950][123091] Updated weights for policy 0, policy_version 611607 (0.0009) [2023-12-26 04:28:12,000][123091] Updated weights for policy 0, policy_version 611617 (0.0009) [2023-12-26 04:28:12,064][123091] Updated weights for policy 0, policy_version 611627 (0.0009) [2023-12-26 04:28:12,510][123090] Updated weights for policy 1, policy_version 607337 (0.0008) [2023-12-26 04:28:12,558][123090] Updated weights for policy 1, policy_version 607347 (0.0008) [2023-12-26 04:28:12,631][123090] Updated weights for policy 1, policy_version 607357 (0.0008) [2023-12-26 04:28:12,953][123091] Updated weights for policy 0, policy_version 611637 (0.0007) [2023-12-26 04:28:13,000][123091] Updated weights for policy 0, policy_version 611647 (0.0005) [2023-12-26 04:28:13,057][123091] Updated weights for policy 0, policy_version 611657 (0.0005) [2023-12-26 04:28:13,476][123090] Updated weights for policy 1, policy_version 607367 (0.0010) [2023-12-26 04:28:13,546][123090] Updated weights for policy 1, policy_version 607377 (0.0011) [2023-12-26 04:28:13,609][123090] Updated weights for policy 1, policy_version 607387 (0.0010) [2023-12-26 04:28:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 312082432. Throughput: 0: 8972.6, 1: 8785.0. Samples: 312077444. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:13,785][121949] Avg episode reward: [(0, '6066.443'), (1, '5582.413')] [2023-12-26 04:28:13,790][123091] Updated weights for policy 0, policy_version 611667 (0.0005) [2023-12-26 04:28:13,861][123091] Updated weights for policy 0, policy_version 611677 (0.0005) [2023-12-26 04:28:13,929][123091] Updated weights for policy 0, policy_version 611687 (0.0005) [2023-12-26 04:28:14,420][123090] Updated weights for policy 1, policy_version 607397 (0.0011) [2023-12-26 04:28:14,475][123090] Updated weights for policy 1, policy_version 607407 (0.0011) [2023-12-26 04:28:14,530][123090] Updated weights for policy 1, policy_version 607417 (0.0009) [2023-12-26 04:28:14,715][123091] Updated weights for policy 0, policy_version 611697 (0.0009) [2023-12-26 04:28:14,782][123091] Updated weights for policy 0, policy_version 611707 (0.0010) [2023-12-26 04:28:14,855][123091] Updated weights for policy 0, policy_version 611717 (0.0009) [2023-12-26 04:28:14,923][123091] Updated weights for policy 0, policy_version 611727 (0.0010) [2023-12-26 04:28:15,216][123090] Updated weights for policy 1, policy_version 607427 (0.0005) [2023-12-26 04:28:15,294][123090] Updated weights for policy 1, policy_version 607437 (0.0005) [2023-12-26 04:28:15,363][123090] Updated weights for policy 1, policy_version 607447 (0.0005) [2023-12-26 04:28:15,854][123091] Updated weights for policy 0, policy_version 611737 (0.0007) [2023-12-26 04:28:15,902][123091] Updated weights for policy 0, policy_version 611747 (0.0009) [2023-12-26 04:28:15,953][123091] Updated weights for policy 0, policy_version 611758 (0.0009) [2023-12-26 04:28:16,046][123090] Updated weights for policy 1, policy_version 607457 (0.0005) [2023-12-26 04:28:16,108][123090] Updated weights for policy 1, policy_version 607467 (0.0005) [2023-12-26 04:28:16,172][123090] Updated weights for policy 1, policy_version 607477 (0.0006) [2023-12-26 04:28:16,223][123090] Updated weights for policy 1, policy_version 607487 (0.0005) [2023-12-26 04:28:16,848][123090] Updated weights for policy 1, policy_version 607497 (0.0005) [2023-12-26 04:28:16,891][123091] Updated weights for policy 0, policy_version 611769 (0.0009) [2023-12-26 04:28:16,894][123090] Updated weights for policy 1, policy_version 607507 (0.0005) [2023-12-26 04:28:16,945][123091] Updated weights for policy 0, policy_version 611779 (0.0009) [2023-12-26 04:28:16,946][123090] Updated weights for policy 1, policy_version 607517 (0.0005) [2023-12-26 04:28:17,006][123091] Updated weights for policy 0, policy_version 611789 (0.0009) [2023-12-26 04:28:17,474][123090] Updated weights for policy 1, policy_version 607527 (0.0005) [2023-12-26 04:28:17,524][123090] Updated weights for policy 1, policy_version 607537 (0.0005) [2023-12-26 04:28:17,571][123090] Updated weights for policy 1, policy_version 607547 (0.0006) [2023-12-26 04:28:17,825][123091] Updated weights for policy 0, policy_version 611799 (0.0010) [2023-12-26 04:28:17,871][123091] Updated weights for policy 0, policy_version 611809 (0.0008) [2023-12-26 04:28:17,936][123091] Updated weights for policy 0, policy_version 611819 (0.0009) [2023-12-26 04:28:18,394][123090] Updated weights for policy 1, policy_version 607557 (0.0009) [2023-12-26 04:28:18,457][123090] Updated weights for policy 1, policy_version 607567 (0.0009) [2023-12-26 04:28:18,506][123090] Updated weights for policy 1, policy_version 607577 (0.0009) [2023-12-26 04:28:18,766][123091] Updated weights for policy 0, policy_version 611829 (0.0009) [2023-12-26 04:28:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 312172544. Throughput: 0: 8894.0, 1: 8834.4. Samples: 312184904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:18,785][121949] Avg episode reward: [(0, '6137.013'), (1, '5792.475')] [2023-12-26 04:28:18,835][123091] Updated weights for policy 0, policy_version 611839 (0.0009) [2023-12-26 04:28:18,899][123091] Updated weights for policy 0, policy_version 611849 (0.0009) [2023-12-26 04:28:19,374][123090] Updated weights for policy 1, policy_version 607587 (0.0010) [2023-12-26 04:28:19,444][123090] Updated weights for policy 1, policy_version 607597 (0.0008) [2023-12-26 04:28:19,512][123090] Updated weights for policy 1, policy_version 607607 (0.0008) [2023-12-26 04:28:19,731][123091] Updated weights for policy 0, policy_version 611859 (0.0009) [2023-12-26 04:28:19,784][123091] Updated weights for policy 0, policy_version 611869 (0.0009) [2023-12-26 04:28:19,837][123091] Updated weights for policy 0, policy_version 611879 (0.0009) [2023-12-26 04:28:20,379][123090] Updated weights for policy 1, policy_version 607617 (0.0009) [2023-12-26 04:28:20,454][123090] Updated weights for policy 1, policy_version 607627 (0.0010) [2023-12-26 04:28:20,521][123090] Updated weights for policy 1, policy_version 607637 (0.0010) [2023-12-26 04:28:20,596][123090] Updated weights for policy 1, policy_version 607647 (0.0011) [2023-12-26 04:28:20,744][123091] Updated weights for policy 0, policy_version 611889 (0.0009) [2023-12-26 04:28:20,798][123091] Updated weights for policy 0, policy_version 611899 (0.0009) [2023-12-26 04:28:20,862][123091] Updated weights for policy 0, policy_version 611909 (0.0009) [2023-12-26 04:28:20,926][123091] Updated weights for policy 0, policy_version 611919 (0.0009) [2023-12-26 04:28:21,411][123090] Updated weights for policy 1, policy_version 607657 (0.0010) [2023-12-26 04:28:21,470][123090] Updated weights for policy 1, policy_version 607667 (0.0010) [2023-12-26 04:28:21,537][123090] Updated weights for policy 1, policy_version 607677 (0.0009) [2023-12-26 04:28:21,775][123091] Updated weights for policy 0, policy_version 611929 (0.0010) [2023-12-26 04:28:21,846][123091] Updated weights for policy 0, policy_version 611939 (0.0010) [2023-12-26 04:28:21,907][123091] Updated weights for policy 0, policy_version 611949 (0.0010) [2023-12-26 04:28:22,410][123090] Updated weights for policy 1, policy_version 607687 (0.0010) [2023-12-26 04:28:22,478][123090] Updated weights for policy 1, policy_version 607697 (0.0010) [2023-12-26 04:28:22,545][123090] Updated weights for policy 1, policy_version 607707 (0.0010) [2023-12-26 04:28:22,743][123091] Updated weights for policy 0, policy_version 611959 (0.0009) [2023-12-26 04:28:22,820][123091] Updated weights for policy 0, policy_version 611969 (0.0010) [2023-12-26 04:28:22,878][123091] Updated weights for policy 0, policy_version 611979 (0.0009) [2023-12-26 04:28:23,311][123090] Updated weights for policy 1, policy_version 607717 (0.0010) [2023-12-26 04:28:23,365][123090] Updated weights for policy 1, policy_version 607727 (0.0009) [2023-12-26 04:28:23,412][123090] Updated weights for policy 1, policy_version 607737 (0.0009) [2023-12-26 04:28:23,730][123091] Updated weights for policy 0, policy_version 611989 (0.0010) [2023-12-26 04:28:23,782][123091] Updated weights for policy 0, policy_version 611999 (0.0009) [2023-12-26 04:28:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 312254464. Throughput: 0: 8827.1, 1: 8806.8. Samples: 312233984. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:23,784][121949] Avg episode reward: [(0, '6181.909'), (1, '5804.855')] [2023-12-26 04:28:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000607744_155582464.pth... [2023-12-26 04:28:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000606688_155312128.pth [2023-12-26 04:28:23,831][123091] Updated weights for policy 0, policy_version 612009 (0.0009) [2023-12-26 04:28:23,860][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000612016_156680192.pth... [2023-12-26 04:28:23,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000610992_156418048.pth [2023-12-26 04:28:24,268][123090] Updated weights for policy 1, policy_version 607747 (0.0009) [2023-12-26 04:28:24,331][123090] Updated weights for policy 1, policy_version 607757 (0.0010) [2023-12-26 04:28:24,399][123090] Updated weights for policy 1, policy_version 607767 (0.0008) [2023-12-26 04:28:24,674][123091] Updated weights for policy 0, policy_version 612020 (0.0010) [2023-12-26 04:28:24,738][123091] Updated weights for policy 0, policy_version 612030 (0.0009) [2023-12-26 04:28:24,802][123091] Updated weights for policy 0, policy_version 612040 (0.0008) [2023-12-26 04:28:25,231][123090] Updated weights for policy 1, policy_version 607777 (0.0006) [2023-12-26 04:28:25,287][123090] Updated weights for policy 1, policy_version 607787 (0.0009) [2023-12-26 04:28:25,338][123090] Updated weights for policy 1, policy_version 607797 (0.0009) [2023-12-26 04:28:25,392][123090] Updated weights for policy 1, policy_version 607807 (0.0009) [2023-12-26 04:28:25,621][123091] Updated weights for policy 0, policy_version 612050 (0.0009) [2023-12-26 04:28:25,688][123091] Updated weights for policy 0, policy_version 612060 (0.0007) [2023-12-26 04:28:25,753][123091] Updated weights for policy 0, policy_version 612070 (0.0008) [2023-12-26 04:28:25,822][123091] Updated weights for policy 0, policy_version 612080 (0.0008) [2023-12-26 04:28:26,312][123090] Updated weights for policy 1, policy_version 607817 (0.0010) [2023-12-26 04:28:26,365][123090] Updated weights for policy 1, policy_version 607827 (0.0009) [2023-12-26 04:28:26,424][123090] Updated weights for policy 1, policy_version 607837 (0.0009) [2023-12-26 04:28:26,475][123091] Updated weights for policy 0, policy_version 612090 (0.0006) [2023-12-26 04:28:26,539][123091] Updated weights for policy 0, policy_version 612100 (0.0005) [2023-12-26 04:28:26,591][123091] Updated weights for policy 0, policy_version 612110 (0.0005) [2023-12-26 04:28:27,187][123091] Updated weights for policy 0, policy_version 612120 (0.0005) [2023-12-26 04:28:27,248][123091] Updated weights for policy 0, policy_version 612130 (0.0006) [2023-12-26 04:28:27,291][123090] Updated weights for policy 1, policy_version 607847 (0.0007) [2023-12-26 04:28:27,315][123091] Updated weights for policy 0, policy_version 612140 (0.0006) [2023-12-26 04:28:27,352][123090] Updated weights for policy 1, policy_version 607857 (0.0007) [2023-12-26 04:28:27,416][123090] Updated weights for policy 1, policy_version 607867 (0.0010) [2023-12-26 04:28:28,008][123091] Updated weights for policy 0, policy_version 612150 (0.0011) [2023-12-26 04:28:28,071][123091] Updated weights for policy 0, policy_version 612160 (0.0011) [2023-12-26 04:28:28,134][123091] Updated weights for policy 0, policy_version 612170 (0.0011) [2023-12-26 04:28:28,262][123090] Updated weights for policy 1, policy_version 607877 (0.0010) [2023-12-26 04:28:28,325][123090] Updated weights for policy 1, policy_version 607887 (0.0010) [2023-12-26 04:28:28,381][123090] Updated weights for policy 1, policy_version 607897 (0.0009) [2023-12-26 04:28:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 312344576. Throughput: 0: 8885.5, 1: 8778.5. Samples: 312338764. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:28,785][121949] Avg episode reward: [(0, '6196.715'), (1, '5727.831')] [2023-12-26 04:28:28,912][123091] Updated weights for policy 0, policy_version 612180 (0.0011) [2023-12-26 04:28:28,976][123091] Updated weights for policy 0, policy_version 612190 (0.0009) [2023-12-26 04:28:29,035][123091] Updated weights for policy 0, policy_version 612200 (0.0005) [2023-12-26 04:28:29,278][123090] Updated weights for policy 1, policy_version 607907 (0.0008) [2023-12-26 04:28:29,343][123090] Updated weights for policy 1, policy_version 607917 (0.0008) [2023-12-26 04:28:29,408][123090] Updated weights for policy 1, policy_version 607927 (0.0006) [2023-12-26 04:28:29,776][123091] Updated weights for policy 0, policy_version 612210 (0.0006) [2023-12-26 04:28:29,835][123091] Updated weights for policy 0, policy_version 612220 (0.0011) [2023-12-26 04:28:29,901][123091] Updated weights for policy 0, policy_version 612230 (0.0009) [2023-12-26 04:28:29,963][123091] Updated weights for policy 0, policy_version 612240 (0.0008) [2023-12-26 04:28:30,193][123090] Updated weights for policy 1, policy_version 607937 (0.0008) [2023-12-26 04:28:30,256][123090] Updated weights for policy 1, policy_version 607947 (0.0009) [2023-12-26 04:28:30,320][123090] Updated weights for policy 1, policy_version 607957 (0.0010) [2023-12-26 04:28:30,397][123090] Updated weights for policy 1, policy_version 607967 (0.0010) [2023-12-26 04:28:30,714][123091] Updated weights for policy 0, policy_version 612252 (0.0011) [2023-12-26 04:28:30,779][123091] Updated weights for policy 0, policy_version 612262 (0.0009) [2023-12-26 04:28:30,852][123091] Updated weights for policy 0, policy_version 612272 (0.0010) [2023-12-26 04:28:31,122][123090] Updated weights for policy 1, policy_version 607977 (0.0007) [2023-12-26 04:28:31,193][123090] Updated weights for policy 1, policy_version 607987 (0.0007) [2023-12-26 04:28:31,259][123090] Updated weights for policy 1, policy_version 607997 (0.0009) [2023-12-26 04:28:31,766][123091] Updated weights for policy 0, policy_version 612282 (0.0010) [2023-12-26 04:28:31,837][123091] Updated weights for policy 0, policy_version 612292 (0.0011) [2023-12-26 04:28:31,905][123091] Updated weights for policy 0, policy_version 612302 (0.0011) [2023-12-26 04:28:32,026][123090] Updated weights for policy 1, policy_version 608007 (0.0009) [2023-12-26 04:28:32,096][123090] Updated weights for policy 1, policy_version 608017 (0.0009) [2023-12-26 04:28:32,176][123090] Updated weights for policy 1, policy_version 608027 (0.0009) [2023-12-26 04:28:32,573][123091] Updated weights for policy 0, policy_version 612312 (0.0010) [2023-12-26 04:28:32,621][123091] Updated weights for policy 0, policy_version 612322 (0.0010) [2023-12-26 04:28:32,686][123091] Updated weights for policy 0, policy_version 612332 (0.0011) [2023-12-26 04:28:32,962][123090] Updated weights for policy 1, policy_version 608037 (0.0008) [2023-12-26 04:28:33,015][123090] Updated weights for policy 1, policy_version 608047 (0.0005) [2023-12-26 04:28:33,061][123090] Updated weights for policy 1, policy_version 608057 (0.0005) [2023-12-26 04:28:33,374][123091] Updated weights for policy 0, policy_version 612342 (0.0007) [2023-12-26 04:28:33,432][123091] Updated weights for policy 0, policy_version 612352 (0.0005) [2023-12-26 04:28:33,487][123091] Updated weights for policy 0, policy_version 612362 (0.0010) [2023-12-26 04:28:33,764][123090] Updated weights for policy 1, policy_version 608067 (0.0005) [2023-12-26 04:28:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 312434688. Throughput: 0: 8845.5, 1: 8806.4. Samples: 312446368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:33,785][121949] Avg episode reward: [(0, '6111.113'), (1, '5604.553')] [2023-12-26 04:28:33,830][123090] Updated weights for policy 1, policy_version 608077 (0.0005) [2023-12-26 04:28:33,893][123090] Updated weights for policy 1, policy_version 608087 (0.0008) [2023-12-26 04:28:34,277][123091] Updated weights for policy 0, policy_version 612372 (0.0010) [2023-12-26 04:28:34,340][123091] Updated weights for policy 0, policy_version 612382 (0.0011) [2023-12-26 04:28:34,402][123091] Updated weights for policy 0, policy_version 612392 (0.0010) [2023-12-26 04:28:34,700][123090] Updated weights for policy 1, policy_version 608097 (0.0009) [2023-12-26 04:28:34,764][123090] Updated weights for policy 1, policy_version 608107 (0.0008) [2023-12-26 04:28:34,828][123090] Updated weights for policy 1, policy_version 608117 (0.0009) [2023-12-26 04:28:34,888][123090] Updated weights for policy 1, policy_version 608127 (0.0009) [2023-12-26 04:28:35,233][123091] Updated weights for policy 0, policy_version 612402 (0.0011) [2023-12-26 04:28:35,284][123091] Updated weights for policy 0, policy_version 612412 (0.0010) [2023-12-26 04:28:35,344][123091] Updated weights for policy 0, policy_version 612422 (0.0011) [2023-12-26 04:28:35,398][123091] Updated weights for policy 0, policy_version 612432 (0.0010) [2023-12-26 04:28:35,625][123090] Updated weights for policy 1, policy_version 608137 (0.0009) [2023-12-26 04:28:35,673][123090] Updated weights for policy 1, policy_version 608147 (0.0009) [2023-12-26 04:28:35,722][123090] Updated weights for policy 1, policy_version 608157 (0.0008) [2023-12-26 04:28:36,238][123091] Updated weights for policy 0, policy_version 612442 (0.0006) [2023-12-26 04:28:36,306][123091] Updated weights for policy 0, policy_version 612452 (0.0005) [2023-12-26 04:28:36,369][123091] Updated weights for policy 0, policy_version 612462 (0.0009) [2023-12-26 04:28:36,521][123090] Updated weights for policy 1, policy_version 608167 (0.0007) [2023-12-26 04:28:36,582][123090] Updated weights for policy 1, policy_version 608177 (0.0005) [2023-12-26 04:28:36,646][123090] Updated weights for policy 1, policy_version 608187 (0.0008) [2023-12-26 04:28:37,096][123091] Updated weights for policy 0, policy_version 612472 (0.0005) [2023-12-26 04:28:37,152][123091] Updated weights for policy 0, policy_version 612482 (0.0005) [2023-12-26 04:28:37,204][123091] Updated weights for policy 0, policy_version 612492 (0.0005) [2023-12-26 04:28:37,511][123090] Updated weights for policy 1, policy_version 608197 (0.0009) [2023-12-26 04:28:37,569][123090] Updated weights for policy 1, policy_version 608207 (0.0009) [2023-12-26 04:28:37,636][123090] Updated weights for policy 1, policy_version 608217 (0.0009) [2023-12-26 04:28:37,907][123091] Updated weights for policy 0, policy_version 612502 (0.0008) [2023-12-26 04:28:37,968][123091] Updated weights for policy 0, policy_version 612512 (0.0010) [2023-12-26 04:28:38,027][123091] Updated weights for policy 0, policy_version 612522 (0.0010) [2023-12-26 04:28:38,518][123090] Updated weights for policy 1, policy_version 608227 (0.0009) [2023-12-26 04:28:38,567][123090] Updated weights for policy 1, policy_version 608237 (0.0009) [2023-12-26 04:28:38,618][123090] Updated weights for policy 1, policy_version 608247 (0.0009) [2023-12-26 04:28:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 312524800. Throughput: 0: 8831.2, 1: 8846.0. Samples: 312499884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 04:28:38,785][121949] Avg episode reward: [(0, '6201.673'), (1, '5553.270')] [2023-12-26 04:28:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000608256_155713536.pth... [2023-12-26 04:28:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000607232_155451392.pth [2023-12-26 04:28:38,807][123091] Updated weights for policy 0, policy_version 612532 (0.0010) [2023-12-26 04:28:38,875][123091] Updated weights for policy 0, policy_version 612542 (0.0010) [2023-12-26 04:28:38,935][123091] Updated weights for policy 0, policy_version 612552 (0.0010) [2023-12-26 04:28:38,980][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000612560_156819456.pth... [2023-12-26 04:28:38,983][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000611504_156549120.pth [2023-12-26 04:28:39,501][123090] Updated weights for policy 1, policy_version 608258 (0.0010) [2023-12-26 04:28:39,561][123090] Updated weights for policy 1, policy_version 608268 (0.0011) [2023-12-26 04:28:39,625][123090] Updated weights for policy 1, policy_version 608278 (0.0011) [2023-12-26 04:28:39,689][123090] Updated weights for policy 1, policy_version 608288 (0.0010) [2023-12-26 04:28:39,727][123091] Updated weights for policy 0, policy_version 612562 (0.0010) [2023-12-26 04:28:39,793][123091] Updated weights for policy 0, policy_version 612572 (0.0005) [2023-12-26 04:28:39,872][123091] Updated weights for policy 0, policy_version 612582 (0.0008) [2023-12-26 04:28:39,942][123091] Updated weights for policy 0, policy_version 612592 (0.0010) [2023-12-26 04:28:40,498][123090] Updated weights for policy 1, policy_version 608298 (0.0010) [2023-12-26 04:28:40,568][123090] Updated weights for policy 1, policy_version 608308 (0.0009) [2023-12-26 04:28:40,632][123090] Updated weights for policy 1, policy_version 608318 (0.0010) [2023-12-26 04:28:40,691][123091] Updated weights for policy 0, policy_version 612602 (0.0006) [2023-12-26 04:28:40,759][123091] Updated weights for policy 0, policy_version 612612 (0.0006) [2023-12-26 04:28:40,831][123091] Updated weights for policy 0, policy_version 612622 (0.0006) [2023-12-26 04:28:41,404][123090] Updated weights for policy 1, policy_version 608328 (0.0009) [2023-12-26 04:28:41,468][123090] Updated weights for policy 1, policy_version 608338 (0.0007) [2023-12-26 04:28:41,534][123090] Updated weights for policy 1, policy_version 608348 (0.0007) [2023-12-26 04:28:41,573][123091] Updated weights for policy 0, policy_version 612632 (0.0005) [2023-12-26 04:28:41,631][123091] Updated weights for policy 0, policy_version 612642 (0.0008) [2023-12-26 04:28:41,701][123091] Updated weights for policy 0, policy_version 612652 (0.0009) [2023-12-26 04:28:42,393][123090] Updated weights for policy 1, policy_version 608358 (0.0009) [2023-12-26 04:28:42,446][123090] Updated weights for policy 1, policy_version 608368 (0.0009) [2023-12-26 04:28:42,502][123090] Updated weights for policy 1, policy_version 608378 (0.0009) [2023-12-26 04:28:42,525][123091] Updated weights for policy 0, policy_version 612662 (0.0008) [2023-12-26 04:28:42,589][123091] Updated weights for policy 0, policy_version 612672 (0.0009) [2023-12-26 04:28:42,648][123091] Updated weights for policy 0, policy_version 612682 (0.0006) [2023-12-26 04:28:43,381][123091] Updated weights for policy 0, policy_version 612692 (0.0005) [2023-12-26 04:28:43,422][123090] Updated weights for policy 1, policy_version 608388 (0.0008) [2023-12-26 04:28:43,430][123091] Updated weights for policy 0, policy_version 612702 (0.0005) [2023-12-26 04:28:43,471][123090] Updated weights for policy 1, policy_version 608398 (0.0008) [2023-12-26 04:28:43,477][123091] Updated weights for policy 0, policy_version 612712 (0.0007) [2023-12-26 04:28:43,531][123090] Updated weights for policy 1, policy_version 608408 (0.0006) [2023-12-26 04:28:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 312614912. Throughput: 0: 8871.0, 1: 8732.7. Samples: 312605188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:28:43,785][121949] Avg episode reward: [(0, '6194.815'), (1, '5527.237')] [2023-12-26 04:28:44,255][123090] Updated weights for policy 1, policy_version 608418 (0.0008) [2023-12-26 04:28:44,264][123091] Updated weights for policy 0, policy_version 612722 (0.0010) [2023-12-26 04:28:44,314][123091] Updated weights for policy 0, policy_version 612732 (0.0009) [2023-12-26 04:28:44,321][123090] Updated weights for policy 1, policy_version 608428 (0.0006) [2023-12-26 04:28:44,371][123091] Updated weights for policy 0, policy_version 612742 (0.0007) [2023-12-26 04:28:44,385][123090] Updated weights for policy 1, policy_version 608438 (0.0010) [2023-12-26 04:28:44,436][123091] Updated weights for policy 0, policy_version 612752 (0.0009) [2023-12-26 04:28:44,454][123090] Updated weights for policy 1, policy_version 608448 (0.0006) [2023-12-26 04:28:45,177][123090] Updated weights for policy 1, policy_version 608458 (0.0010) [2023-12-26 04:28:45,235][123090] Updated weights for policy 1, policy_version 608468 (0.0010) [2023-12-26 04:28:45,304][123090] Updated weights for policy 1, policy_version 608478 (0.0006) [2023-12-26 04:28:45,314][123091] Updated weights for policy 0, policy_version 612762 (0.0010) [2023-12-26 04:28:45,388][123091] Updated weights for policy 0, policy_version 612772 (0.0009) [2023-12-26 04:28:45,464][123091] Updated weights for policy 0, policy_version 612782 (0.0010) [2023-12-26 04:28:45,994][123090] Updated weights for policy 1, policy_version 608488 (0.0009) [2023-12-26 04:28:46,047][123090] Updated weights for policy 1, policy_version 608498 (0.0009) [2023-12-26 04:28:46,098][123090] Updated weights for policy 1, policy_version 608508 (0.0009) [2023-12-26 04:28:46,256][123091] Updated weights for policy 0, policy_version 612792 (0.0009) [2023-12-26 04:28:46,312][123091] Updated weights for policy 0, policy_version 612802 (0.0009) [2023-12-26 04:28:46,377][123091] Updated weights for policy 0, policy_version 612812 (0.0009) [2023-12-26 04:28:46,937][123090] Updated weights for policy 1, policy_version 608518 (0.0010) [2023-12-26 04:28:46,993][123090] Updated weights for policy 1, policy_version 608528 (0.0009) [2023-12-26 04:28:47,061][123090] Updated weights for policy 1, policy_version 608538 (0.0010) [2023-12-26 04:28:47,206][123091] Updated weights for policy 0, policy_version 612822 (0.0009) [2023-12-26 04:28:47,267][123091] Updated weights for policy 0, policy_version 612832 (0.0009) [2023-12-26 04:28:47,325][123091] Updated weights for policy 0, policy_version 612842 (0.0009) [2023-12-26 04:28:47,905][123090] Updated weights for policy 1, policy_version 608548 (0.0009) [2023-12-26 04:28:47,961][123090] Updated weights for policy 1, policy_version 608558 (0.0007) [2023-12-26 04:28:48,018][123090] Updated weights for policy 1, policy_version 608568 (0.0006) [2023-12-26 04:28:48,157][123091] Updated weights for policy 0, policy_version 612852 (0.0009) [2023-12-26 04:28:48,218][123091] Updated weights for policy 0, policy_version 612862 (0.0010) [2023-12-26 04:28:48,281][123091] Updated weights for policy 0, policy_version 612872 (0.0009) [2023-12-26 04:28:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 312696832. Throughput: 0: 8836.1, 1: 8725.2. Samples: 312710800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:28:48,785][121949] Avg episode reward: [(0, '6247.087'), (1, '5874.465')] [2023-12-26 04:28:48,841][123090] Updated weights for policy 1, policy_version 608578 (0.0010) [2023-12-26 04:28:48,899][123090] Updated weights for policy 1, policy_version 608588 (0.0009) [2023-12-26 04:28:48,956][123090] Updated weights for policy 1, policy_version 608598 (0.0008) [2023-12-26 04:28:49,024][123090] Updated weights for policy 1, policy_version 608608 (0.0010) [2023-12-26 04:28:49,086][123091] Updated weights for policy 0, policy_version 612882 (0.0010) [2023-12-26 04:28:49,134][123091] Updated weights for policy 0, policy_version 612892 (0.0009) [2023-12-26 04:28:49,191][123091] Updated weights for policy 0, policy_version 612902 (0.0010) [2023-12-26 04:28:49,255][123091] Updated weights for policy 0, policy_version 612912 (0.0006) [2023-12-26 04:28:49,976][123090] Updated weights for policy 1, policy_version 608618 (0.0007) [2023-12-26 04:28:50,008][123091] Updated weights for policy 0, policy_version 612922 (0.0011) [2023-12-26 04:28:50,029][123090] Updated weights for policy 1, policy_version 608628 (0.0008) [2023-12-26 04:28:50,073][123091] Updated weights for policy 0, policy_version 612932 (0.0009) [2023-12-26 04:28:50,088][123090] Updated weights for policy 1, policy_version 608638 (0.0009) [2023-12-26 04:28:50,129][123091] Updated weights for policy 0, policy_version 612942 (0.0007) [2023-12-26 04:28:50,850][123091] Updated weights for policy 0, policy_version 612952 (0.0006) [2023-12-26 04:28:50,918][123091] Updated weights for policy 0, policy_version 612962 (0.0009) [2023-12-26 04:28:50,983][123091] Updated weights for policy 0, policy_version 612972 (0.0008) [2023-12-26 04:28:51,009][123090] Updated weights for policy 1, policy_version 608648 (0.0009) [2023-12-26 04:28:51,073][123090] Updated weights for policy 1, policy_version 608658 (0.0008) [2023-12-26 04:28:51,135][123090] Updated weights for policy 1, policy_version 608668 (0.0009) [2023-12-26 04:28:51,815][123091] Updated weights for policy 0, policy_version 612982 (0.0008) [2023-12-26 04:28:51,864][123091] Updated weights for policy 0, policy_version 612992 (0.0009) [2023-12-26 04:28:51,912][123091] Updated weights for policy 0, policy_version 613002 (0.0009) [2023-12-26 04:28:51,990][123090] Updated weights for policy 1, policy_version 608678 (0.0009) [2023-12-26 04:28:52,050][123090] Updated weights for policy 1, policy_version 608688 (0.0010) [2023-12-26 04:28:52,117][123090] Updated weights for policy 1, policy_version 608698 (0.0009) [2023-12-26 04:28:52,688][123091] Updated weights for policy 0, policy_version 613012 (0.0010) [2023-12-26 04:28:52,741][123091] Updated weights for policy 0, policy_version 613022 (0.0009) [2023-12-26 04:28:52,801][123091] Updated weights for policy 0, policy_version 613032 (0.0006) [2023-12-26 04:28:52,999][123090] Updated weights for policy 1, policy_version 608708 (0.0009) [2023-12-26 04:28:53,058][123090] Updated weights for policy 1, policy_version 608718 (0.0010) [2023-12-26 04:28:53,122][123090] Updated weights for policy 1, policy_version 608728 (0.0010) [2023-12-26 04:28:53,589][123091] Updated weights for policy 0, policy_version 613042 (0.0006) [2023-12-26 04:28:53,637][123091] Updated weights for policy 0, policy_version 613052 (0.0009) [2023-12-26 04:28:53,692][123091] Updated weights for policy 0, policy_version 613062 (0.0009) [2023-12-26 04:28:53,740][123091] Updated weights for policy 0, policy_version 613072 (0.0009) [2023-12-26 04:28:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 312786944. Throughput: 0: 8828.3, 1: 8685.1. Samples: 312762144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:28:53,785][121949] Avg episode reward: [(0, '6168.914'), (1, '5594.384')] [2023-12-26 04:28:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000613072_156950528.pth... [2023-12-26 04:28:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000608736_155836416.pth... [2023-12-26 04:28:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000612016_156680192.pth [2023-12-26 04:28:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000607744_155582464.pth [2023-12-26 04:28:53,936][123090] Updated weights for policy 1, policy_version 608738 (0.0010) [2023-12-26 04:28:53,988][123090] Updated weights for policy 1, policy_version 608748 (0.0010) [2023-12-26 04:28:54,039][123090] Updated weights for policy 1, policy_version 608758 (0.0010) [2023-12-26 04:28:54,087][123090] Updated weights for policy 1, policy_version 608768 (0.0010) [2023-12-26 04:28:54,597][123091] Updated weights for policy 0, policy_version 613082 (0.0009) [2023-12-26 04:28:54,645][123091] Updated weights for policy 0, policy_version 613092 (0.0009) [2023-12-26 04:28:54,693][123091] Updated weights for policy 0, policy_version 613102 (0.0009) [2023-12-26 04:28:54,952][123090] Updated weights for policy 1, policy_version 608778 (0.0011) [2023-12-26 04:28:55,000][123090] Updated weights for policy 1, policy_version 608788 (0.0010) [2023-12-26 04:28:55,064][123090] Updated weights for policy 1, policy_version 608798 (0.0010) [2023-12-26 04:28:55,500][123091] Updated weights for policy 0, policy_version 613112 (0.0008) [2023-12-26 04:28:55,547][123091] Updated weights for policy 0, policy_version 613122 (0.0008) [2023-12-26 04:28:55,596][123091] Updated weights for policy 0, policy_version 613132 (0.0009) [2023-12-26 04:28:55,889][123090] Updated weights for policy 1, policy_version 608808 (0.0009) [2023-12-26 04:28:55,948][123090] Updated weights for policy 1, policy_version 608818 (0.0010) [2023-12-26 04:28:56,002][123090] Updated weights for policy 1, policy_version 608828 (0.0009) [2023-12-26 04:28:56,407][123091] Updated weights for policy 0, policy_version 613142 (0.0007) [2023-12-26 04:28:56,473][123091] Updated weights for policy 0, policy_version 613152 (0.0009) [2023-12-26 04:28:56,539][123091] Updated weights for policy 0, policy_version 613162 (0.0010) [2023-12-26 04:28:56,827][123090] Updated weights for policy 1, policy_version 608838 (0.0007) [2023-12-26 04:28:56,892][123090] Updated weights for policy 1, policy_version 608848 (0.0005) [2023-12-26 04:28:56,960][123090] Updated weights for policy 1, policy_version 608858 (0.0005) [2023-12-26 04:28:57,133][123091] Updated weights for policy 0, policy_version 613172 (0.0005) [2023-12-26 04:28:57,183][123091] Updated weights for policy 0, policy_version 613182 (0.0005) [2023-12-26 04:28:57,243][123091] Updated weights for policy 0, policy_version 613192 (0.0007) [2023-12-26 04:28:57,667][123090] Updated weights for policy 1, policy_version 608868 (0.0005) [2023-12-26 04:28:57,729][123090] Updated weights for policy 1, policy_version 608878 (0.0005) [2023-12-26 04:28:57,792][123090] Updated weights for policy 1, policy_version 608888 (0.0008) [2023-12-26 04:28:58,110][123091] Updated weights for policy 0, policy_version 613202 (0.0010) [2023-12-26 04:28:58,181][123091] Updated weights for policy 0, policy_version 613212 (0.0008) [2023-12-26 04:28:58,250][123091] Updated weights for policy 0, policy_version 613222 (0.0009) [2023-12-26 04:28:58,329][123091] Updated weights for policy 0, policy_version 613232 (0.0009) [2023-12-26 04:28:58,624][123090] Updated weights for policy 1, policy_version 608898 (0.0010) [2023-12-26 04:28:58,694][123090] Updated weights for policy 1, policy_version 608908 (0.0010) [2023-12-26 04:28:58,764][123090] Updated weights for policy 1, policy_version 608918 (0.0008) [2023-12-26 04:28:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 312868864. Throughput: 0: 8871.4, 1: 8697.0. Samples: 312868020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:28:58,785][121949] Avg episode reward: [(0, '6138.872'), (1, '5283.645')] [2023-12-26 04:28:58,834][123090] Updated weights for policy 1, policy_version 608928 (0.0008) [2023-12-26 04:28:59,172][123091] Updated weights for policy 0, policy_version 613242 (0.0005) [2023-12-26 04:28:59,235][123091] Updated weights for policy 0, policy_version 613252 (0.0006) [2023-12-26 04:28:59,301][123091] Updated weights for policy 0, policy_version 613262 (0.0009) [2023-12-26 04:28:59,558][123090] Updated weights for policy 1, policy_version 608938 (0.0011) [2023-12-26 04:28:59,613][123090] Updated weights for policy 1, policy_version 608948 (0.0010) [2023-12-26 04:28:59,673][123090] Updated weights for policy 1, policy_version 608958 (0.0010) [2023-12-26 04:29:00,071][123091] Updated weights for policy 0, policy_version 613272 (0.0009) [2023-12-26 04:29:00,120][123091] Updated weights for policy 0, policy_version 613282 (0.0009) [2023-12-26 04:29:00,184][123091] Updated weights for policy 0, policy_version 613292 (0.0009) [2023-12-26 04:29:00,527][123090] Updated weights for policy 1, policy_version 608968 (0.0011) [2023-12-26 04:29:00,586][123090] Updated weights for policy 1, policy_version 608978 (0.0010) [2023-12-26 04:29:00,633][123090] Updated weights for policy 1, policy_version 608988 (0.0010) [2023-12-26 04:29:01,072][123091] Updated weights for policy 0, policy_version 613302 (0.0009) [2023-12-26 04:29:01,136][123091] Updated weights for policy 0, policy_version 613312 (0.0009) [2023-12-26 04:29:01,199][123091] Updated weights for policy 0, policy_version 613322 (0.0009) [2023-12-26 04:29:01,378][123090] Updated weights for policy 1, policy_version 608998 (0.0009) [2023-12-26 04:29:01,426][123090] Updated weights for policy 1, policy_version 609008 (0.0009) [2023-12-26 04:29:01,481][123090] Updated weights for policy 1, policy_version 609018 (0.0010) [2023-12-26 04:29:02,038][123091] Updated weights for policy 0, policy_version 613332 (0.0010) [2023-12-26 04:29:02,096][123091] Updated weights for policy 0, policy_version 613342 (0.0010) [2023-12-26 04:29:02,157][123091] Updated weights for policy 0, policy_version 613352 (0.0010) [2023-12-26 04:29:02,314][123090] Updated weights for policy 1, policy_version 609028 (0.0009) [2023-12-26 04:29:02,385][123090] Updated weights for policy 1, policy_version 609038 (0.0008) [2023-12-26 04:29:02,452][123090] Updated weights for policy 1, policy_version 609048 (0.0009) [2023-12-26 04:29:02,940][123091] Updated weights for policy 0, policy_version 613362 (0.0009) [2023-12-26 04:29:03,002][123091] Updated weights for policy 0, policy_version 613372 (0.0010) [2023-12-26 04:29:03,064][123091] Updated weights for policy 0, policy_version 613382 (0.0010) [2023-12-26 04:29:03,122][123091] Updated weights for policy 0, policy_version 613392 (0.0006) [2023-12-26 04:29:03,226][123090] Updated weights for policy 1, policy_version 609058 (0.0008) [2023-12-26 04:29:03,287][123090] Updated weights for policy 1, policy_version 609068 (0.0005) [2023-12-26 04:29:03,339][123090] Updated weights for policy 1, policy_version 609078 (0.0007) [2023-12-26 04:29:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 312958976. Throughput: 0: 8890.5, 1: 8615.6. Samples: 312972676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:03,785][121949] Avg episode reward: [(0, '6156.838'), (1, '5442.858')] [2023-12-26 04:29:03,844][123091] Updated weights for policy 0, policy_version 613402 (0.0010) [2023-12-26 04:29:03,908][123091] Updated weights for policy 0, policy_version 613412 (0.0010) [2023-12-26 04:29:03,974][123091] Updated weights for policy 0, policy_version 613422 (0.0009) [2023-12-26 04:29:04,168][123090] Updated weights for policy 1, policy_version 609089 (0.0010) [2023-12-26 04:29:04,223][123090] Updated weights for policy 1, policy_version 609099 (0.0010) [2023-12-26 04:29:04,285][123090] Updated weights for policy 1, policy_version 609109 (0.0009) [2023-12-26 04:29:04,349][123090] Updated weights for policy 1, policy_version 609119 (0.0010) [2023-12-26 04:29:04,677][123091] Updated weights for policy 0, policy_version 613432 (0.0006) [2023-12-26 04:29:04,723][123091] Updated weights for policy 0, policy_version 613442 (0.0005) [2023-12-26 04:29:04,774][123091] Updated weights for policy 0, policy_version 613452 (0.0005) [2023-12-26 04:29:05,187][123090] Updated weights for policy 1, policy_version 609129 (0.0009) [2023-12-26 04:29:05,251][123090] Updated weights for policy 1, policy_version 609139 (0.0010) [2023-12-26 04:29:05,298][123090] Updated weights for policy 1, policy_version 609149 (0.0009) [2023-12-26 04:29:05,522][123091] Updated weights for policy 0, policy_version 613462 (0.0005) [2023-12-26 04:29:05,573][123091] Updated weights for policy 0, policy_version 613472 (0.0007) [2023-12-26 04:29:05,627][123091] Updated weights for policy 0, policy_version 613482 (0.0008) [2023-12-26 04:29:06,142][123090] Updated weights for policy 1, policy_version 609159 (0.0009) [2023-12-26 04:29:06,211][123090] Updated weights for policy 1, policy_version 609170 (0.0010) [2023-12-26 04:29:06,278][123090] Updated weights for policy 1, policy_version 609180 (0.0010) [2023-12-26 04:29:06,457][123091] Updated weights for policy 0, policy_version 613492 (0.0010) [2023-12-26 04:29:06,532][123091] Updated weights for policy 0, policy_version 613502 (0.0010) [2023-12-26 04:29:06,598][123091] Updated weights for policy 0, policy_version 613512 (0.0010) [2023-12-26 04:29:07,093][123090] Updated weights for policy 1, policy_version 609190 (0.0009) [2023-12-26 04:29:07,163][123090] Updated weights for policy 1, policy_version 609200 (0.0010) [2023-12-26 04:29:07,225][123090] Updated weights for policy 1, policy_version 609210 (0.0009) [2023-12-26 04:29:07,434][123091] Updated weights for policy 0, policy_version 613522 (0.0010) [2023-12-26 04:29:07,505][123091] Updated weights for policy 0, policy_version 613532 (0.0009) [2023-12-26 04:29:07,562][123091] Updated weights for policy 0, policy_version 613542 (0.0009) [2023-12-26 04:29:07,619][123091] Updated weights for policy 0, policy_version 613552 (0.0009) [2023-12-26 04:29:07,956][123090] Updated weights for policy 1, policy_version 609220 (0.0008) [2023-12-26 04:29:08,026][123090] Updated weights for policy 1, policy_version 609230 (0.0005) [2023-12-26 04:29:08,096][123090] Updated weights for policy 1, policy_version 609240 (0.0005) [2023-12-26 04:29:08,498][123091] Updated weights for policy 0, policy_version 613562 (0.0010) [2023-12-26 04:29:08,555][123091] Updated weights for policy 0, policy_version 613572 (0.0009) [2023-12-26 04:29:08,617][123091] Updated weights for policy 0, policy_version 613582 (0.0008) [2023-12-26 04:29:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 313049088. Throughput: 0: 8959.1, 1: 8634.8. Samples: 313025708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:08,785][121949] Avg episode reward: [(0, '6106.596'), (1, '5540.533')] [2023-12-26 04:29:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000613584_157081600.pth... [2023-12-26 04:29:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000609248_155967488.pth... [2023-12-26 04:29:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000608256_155713536.pth [2023-12-26 04:29:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000612560_156819456.pth [2023-12-26 04:29:08,858][123090] Updated weights for policy 1, policy_version 609250 (0.0006) [2023-12-26 04:29:08,923][123090] Updated weights for policy 1, policy_version 609260 (0.0009) [2023-12-26 04:29:08,989][123090] Updated weights for policy 1, policy_version 609270 (0.0009) [2023-12-26 04:29:09,473][123091] Updated weights for policy 0, policy_version 613592 (0.0010) [2023-12-26 04:29:09,546][123091] Updated weights for policy 0, policy_version 613602 (0.0009) [2023-12-26 04:29:09,602][123091] Updated weights for policy 0, policy_version 613612 (0.0009) [2023-12-26 04:29:09,886][123090] Updated weights for policy 1, policy_version 609281 (0.0010) [2023-12-26 04:29:09,959][123090] Updated weights for policy 1, policy_version 609291 (0.0007) [2023-12-26 04:29:10,030][123090] Updated weights for policy 1, policy_version 609301 (0.0009) [2023-12-26 04:29:10,102][123090] Updated weights for policy 1, policy_version 609311 (0.0009) [2023-12-26 04:29:10,371][123091] Updated weights for policy 0, policy_version 613622 (0.0007) [2023-12-26 04:29:10,440][123091] Updated weights for policy 0, policy_version 613632 (0.0005) [2023-12-26 04:29:10,499][123091] Updated weights for policy 0, policy_version 613642 (0.0005) [2023-12-26 04:29:10,951][123090] Updated weights for policy 1, policy_version 609321 (0.0009) [2023-12-26 04:29:11,002][123090] Updated weights for policy 1, policy_version 609331 (0.0010) [2023-12-26 04:29:11,083][123090] Updated weights for policy 1, policy_version 609341 (0.0007) [2023-12-26 04:29:11,186][123091] Updated weights for policy 0, policy_version 613652 (0.0007) [2023-12-26 04:29:11,243][123091] Updated weights for policy 0, policy_version 613662 (0.0009) [2023-12-26 04:29:11,310][123091] Updated weights for policy 0, policy_version 613672 (0.0009) [2023-12-26 04:29:11,897][123090] Updated weights for policy 1, policy_version 609351 (0.0009) [2023-12-26 04:29:11,989][123090] Updated weights for policy 1, policy_version 609361 (0.0010) [2023-12-26 04:29:12,058][123090] Updated weights for policy 1, policy_version 609371 (0.0010) [2023-12-26 04:29:12,184][123091] Updated weights for policy 0, policy_version 613682 (0.0009) [2023-12-26 04:29:12,263][123091] Updated weights for policy 0, policy_version 613692 (0.0008) [2023-12-26 04:29:12,333][123091] Updated weights for policy 0, policy_version 613702 (0.0009) [2023-12-26 04:29:12,404][123091] Updated weights for policy 0, policy_version 613712 (0.0008) [2023-12-26 04:29:12,863][123090] Updated weights for policy 1, policy_version 609381 (0.0008) [2023-12-26 04:29:12,917][123090] Updated weights for policy 1, policy_version 609391 (0.0005) [2023-12-26 04:29:12,964][123090] Updated weights for policy 1, policy_version 609401 (0.0005) [2023-12-26 04:29:13,216][123091] Updated weights for policy 0, policy_version 613722 (0.0010) [2023-12-26 04:29:13,285][123091] Updated weights for policy 0, policy_version 613732 (0.0010) [2023-12-26 04:29:13,353][123091] Updated weights for policy 0, policy_version 613742 (0.0010) [2023-12-26 04:29:13,582][123090] Updated weights for policy 1, policy_version 609411 (0.0006) [2023-12-26 04:29:13,651][123090] Updated weights for policy 1, policy_version 609421 (0.0008) [2023-12-26 04:29:13,707][123090] Updated weights for policy 1, policy_version 609431 (0.0007) [2023-12-26 04:29:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 313139200. Throughput: 0: 8904.6, 1: 8648.4. Samples: 313128644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:13,785][121949] Avg episode reward: [(0, '6014.670'), (1, '5529.741')] [2023-12-26 04:29:14,212][123091] Updated weights for policy 0, policy_version 613752 (0.0009) [2023-12-26 04:29:14,283][123091] Updated weights for policy 0, policy_version 613762 (0.0009) [2023-12-26 04:29:14,350][123091] Updated weights for policy 0, policy_version 613772 (0.0009) [2023-12-26 04:29:14,446][123090] Updated weights for policy 1, policy_version 609441 (0.0006) [2023-12-26 04:29:14,509][123090] Updated weights for policy 1, policy_version 609451 (0.0010) [2023-12-26 04:29:14,568][123090] Updated weights for policy 1, policy_version 609461 (0.0010) [2023-12-26 04:29:14,627][123090] Updated weights for policy 1, policy_version 609471 (0.0010) [2023-12-26 04:29:15,154][123091] Updated weights for policy 0, policy_version 613782 (0.0009) [2023-12-26 04:29:15,225][123091] Updated weights for policy 0, policy_version 613792 (0.0008) [2023-12-26 04:29:15,297][123091] Updated weights for policy 0, policy_version 613802 (0.0009) [2023-12-26 04:29:15,408][123090] Updated weights for policy 1, policy_version 609481 (0.0011) [2023-12-26 04:29:15,467][123090] Updated weights for policy 1, policy_version 609491 (0.0010) [2023-12-26 04:29:15,529][123090] Updated weights for policy 1, policy_version 609501 (0.0010) [2023-12-26 04:29:16,115][123091] Updated weights for policy 0, policy_version 613812 (0.0009) [2023-12-26 04:29:16,177][123091] Updated weights for policy 0, policy_version 613822 (0.0009) [2023-12-26 04:29:16,239][123091] Updated weights for policy 0, policy_version 613833 (0.0010) [2023-12-26 04:29:16,319][123090] Updated weights for policy 1, policy_version 609511 (0.0010) [2023-12-26 04:29:16,385][123090] Updated weights for policy 1, policy_version 609521 (0.0010) [2023-12-26 04:29:16,446][123090] Updated weights for policy 1, policy_version 609531 (0.0009) [2023-12-26 04:29:16,986][123091] Updated weights for policy 0, policy_version 613843 (0.0008) [2023-12-26 04:29:17,046][123091] Updated weights for policy 0, policy_version 613853 (0.0006) [2023-12-26 04:29:17,117][123091] Updated weights for policy 0, policy_version 613863 (0.0006) [2023-12-26 04:29:17,321][123090] Updated weights for policy 1, policy_version 609541 (0.0009) [2023-12-26 04:29:17,375][123090] Updated weights for policy 1, policy_version 609551 (0.0007) [2023-12-26 04:29:17,424][123090] Updated weights for policy 1, policy_version 609561 (0.0010) [2023-12-26 04:29:17,830][123091] Updated weights for policy 0, policy_version 613873 (0.0006) [2023-12-26 04:29:17,893][123091] Updated weights for policy 0, policy_version 613883 (0.0005) [2023-12-26 04:29:17,938][123091] Updated weights for policy 0, policy_version 613893 (0.0005) [2023-12-26 04:29:17,995][123091] Updated weights for policy 0, policy_version 613903 (0.0006) [2023-12-26 04:29:18,200][123090] Updated weights for policy 1, policy_version 609571 (0.0009) [2023-12-26 04:29:18,252][123090] Updated weights for policy 1, policy_version 609581 (0.0005) [2023-12-26 04:29:18,320][123090] Updated weights for policy 1, policy_version 609591 (0.0005) [2023-12-26 04:29:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 313221120. Throughput: 0: 8859.1, 1: 8685.9. Samples: 313235892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:18,784][121949] Avg episode reward: [(0, '5990.571'), (1, '5499.430')] [2023-12-26 04:29:18,835][123091] Updated weights for policy 0, policy_version 613913 (0.0010) [2023-12-26 04:29:18,883][123091] Updated weights for policy 0, policy_version 613923 (0.0010) [2023-12-26 04:29:18,927][123091] Updated weights for policy 0, policy_version 613933 (0.0010) [2023-12-26 04:29:19,088][123090] Updated weights for policy 1, policy_version 609601 (0.0010) [2023-12-26 04:29:19,147][123090] Updated weights for policy 1, policy_version 609611 (0.0010) [2023-12-26 04:29:19,191][123090] Updated weights for policy 1, policy_version 609621 (0.0010) [2023-12-26 04:29:19,263][123090] Updated weights for policy 1, policy_version 609631 (0.0011) [2023-12-26 04:29:19,723][123091] Updated weights for policy 0, policy_version 613943 (0.0007) [2023-12-26 04:29:19,799][123091] Updated weights for policy 0, policy_version 613953 (0.0008) [2023-12-26 04:29:19,872][123091] Updated weights for policy 0, policy_version 613963 (0.0008) [2023-12-26 04:29:20,074][123090] Updated weights for policy 1, policy_version 609641 (0.0011) [2023-12-26 04:29:20,134][123090] Updated weights for policy 1, policy_version 609651 (0.0011) [2023-12-26 04:29:20,190][123090] Updated weights for policy 1, policy_version 609661 (0.0011) [2023-12-26 04:29:20,570][123091] Updated weights for policy 0, policy_version 613973 (0.0008) [2023-12-26 04:29:20,636][123091] Updated weights for policy 0, policy_version 613983 (0.0009) [2023-12-26 04:29:20,702][123091] Updated weights for policy 0, policy_version 613993 (0.0009) [2023-12-26 04:29:21,049][123090] Updated weights for policy 1, policy_version 609671 (0.0011) [2023-12-26 04:29:21,120][123090] Updated weights for policy 1, policy_version 609681 (0.0011) [2023-12-26 04:29:21,188][123090] Updated weights for policy 1, policy_version 609691 (0.0011) [2023-12-26 04:29:21,533][123091] Updated weights for policy 0, policy_version 614003 (0.0009) [2023-12-26 04:29:21,603][123091] Updated weights for policy 0, policy_version 614013 (0.0008) [2023-12-26 04:29:21,674][123091] Updated weights for policy 0, policy_version 614023 (0.0008) [2023-12-26 04:29:22,029][123090] Updated weights for policy 1, policy_version 609701 (0.0010) [2023-12-26 04:29:22,096][123090] Updated weights for policy 1, policy_version 609711 (0.0009) [2023-12-26 04:29:22,150][123090] Updated weights for policy 1, policy_version 609721 (0.0009) [2023-12-26 04:29:22,419][123091] Updated weights for policy 0, policy_version 614033 (0.0007) [2023-12-26 04:29:22,477][123091] Updated weights for policy 0, policy_version 614043 (0.0009) [2023-12-26 04:29:22,541][123091] Updated weights for policy 0, policy_version 614053 (0.0007) [2023-12-26 04:29:22,606][123091] Updated weights for policy 0, policy_version 614063 (0.0005) [2023-12-26 04:29:23,073][123090] Updated weights for policy 1, policy_version 609731 (0.0009) [2023-12-26 04:29:23,126][123090] Updated weights for policy 1, policy_version 609741 (0.0010) [2023-12-26 04:29:23,185][123090] Updated weights for policy 1, policy_version 609751 (0.0010) [2023-12-26 04:29:23,302][123091] Updated weights for policy 0, policy_version 614073 (0.0009) [2023-12-26 04:29:23,369][123091] Updated weights for policy 0, policy_version 614083 (0.0010) [2023-12-26 04:29:23,435][123091] Updated weights for policy 0, policy_version 614093 (0.0009) [2023-12-26 04:29:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 313311232. Throughput: 0: 8866.7, 1: 8644.7. Samples: 313287896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:23,785][121949] Avg episode reward: [(0, '6147.507'), (1, '5456.455')] [2023-12-26 04:29:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000614096_157212672.pth... [2023-12-26 04:29:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000609760_156098560.pth... [2023-12-26 04:29:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000613072_156950528.pth [2023-12-26 04:29:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000608736_155836416.pth [2023-12-26 04:29:23,980][123090] Updated weights for policy 1, policy_version 609761 (0.0009) [2023-12-26 04:29:24,036][123090] Updated weights for policy 1, policy_version 609771 (0.0005) [2023-12-26 04:29:24,104][123090] Updated weights for policy 1, policy_version 609781 (0.0006) [2023-12-26 04:29:24,170][123090] Updated weights for policy 1, policy_version 609791 (0.0005) [2023-12-26 04:29:24,208][123091] Updated weights for policy 0, policy_version 614103 (0.0006) [2023-12-26 04:29:24,268][123091] Updated weights for policy 0, policy_version 614113 (0.0006) [2023-12-26 04:29:24,341][123091] Updated weights for policy 0, policy_version 614123 (0.0006) [2023-12-26 04:29:24,835][123090] Updated weights for policy 1, policy_version 609801 (0.0007) [2023-12-26 04:29:24,888][123090] Updated weights for policy 1, policy_version 609811 (0.0009) [2023-12-26 04:29:24,953][123090] Updated weights for policy 1, policy_version 609821 (0.0009) [2023-12-26 04:29:25,166][123091] Updated weights for policy 0, policy_version 614133 (0.0010) [2023-12-26 04:29:25,211][123091] Updated weights for policy 0, policy_version 614143 (0.0007) [2023-12-26 04:29:25,260][123091] Updated weights for policy 0, policy_version 614153 (0.0005) [2023-12-26 04:29:25,540][123090] Updated weights for policy 1, policy_version 609831 (0.0007) [2023-12-26 04:29:25,588][123090] Updated weights for policy 1, policy_version 609841 (0.0005) [2023-12-26 04:29:25,642][123090] Updated weights for policy 1, policy_version 609851 (0.0005) [2023-12-26 04:29:25,929][123091] Updated weights for policy 0, policy_version 614163 (0.0006) [2023-12-26 04:29:25,992][123091] Updated weights for policy 0, policy_version 614173 (0.0010) [2023-12-26 04:29:26,058][123091] Updated weights for policy 0, policy_version 614183 (0.0011) [2023-12-26 04:29:26,352][123090] Updated weights for policy 1, policy_version 609861 (0.0007) [2023-12-26 04:29:26,408][123090] Updated weights for policy 1, policy_version 609871 (0.0010) [2023-12-26 04:29:26,463][123090] Updated weights for policy 1, policy_version 609881 (0.0010) [2023-12-26 04:29:26,715][123091] Updated weights for policy 0, policy_version 614193 (0.0010) [2023-12-26 04:29:26,762][123091] Updated weights for policy 0, policy_version 614203 (0.0008) [2023-12-26 04:29:26,809][123091] Updated weights for policy 0, policy_version 614213 (0.0005) [2023-12-26 04:29:26,853][123091] Updated weights for policy 0, policy_version 614223 (0.0005) [2023-12-26 04:29:27,258][123090] Updated weights for policy 1, policy_version 609891 (0.0009) [2023-12-26 04:29:27,316][123090] Updated weights for policy 1, policy_version 609901 (0.0007) [2023-12-26 04:29:27,371][123090] Updated weights for policy 1, policy_version 609911 (0.0008) [2023-12-26 04:29:27,565][123091] Updated weights for policy 0, policy_version 614233 (0.0005) [2023-12-26 04:29:27,631][123091] Updated weights for policy 0, policy_version 614243 (0.0006) [2023-12-26 04:29:27,699][123091] Updated weights for policy 0, policy_version 614253 (0.0007) [2023-12-26 04:29:28,103][123090] Updated weights for policy 1, policy_version 609921 (0.0010) [2023-12-26 04:29:28,162][123090] Updated weights for policy 1, policy_version 609931 (0.0010) [2023-12-26 04:29:28,217][123090] Updated weights for policy 1, policy_version 609941 (0.0010) [2023-12-26 04:29:28,279][123090] Updated weights for policy 1, policy_version 609951 (0.0010) [2023-12-26 04:29:28,459][123091] Updated weights for policy 0, policy_version 614263 (0.0010) [2023-12-26 04:29:28,515][123091] Updated weights for policy 0, policy_version 614273 (0.0009) [2023-12-26 04:29:28,578][123091] Updated weights for policy 0, policy_version 614283 (0.0009) [2023-12-26 04:29:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 313409536. Throughput: 0: 8917.9, 1: 8777.9. Samples: 313401500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:28,785][121949] Avg episode reward: [(0, '6192.225'), (1, '5407.370')] [2023-12-26 04:29:29,120][123090] Updated weights for policy 1, policy_version 609961 (0.0010) [2023-12-26 04:29:29,186][123090] Updated weights for policy 1, policy_version 609971 (0.0010) [2023-12-26 04:29:29,254][123090] Updated weights for policy 1, policy_version 609981 (0.0011) [2023-12-26 04:29:29,427][123091] Updated weights for policy 0, policy_version 614293 (0.0008) [2023-12-26 04:29:29,493][123091] Updated weights for policy 0, policy_version 614303 (0.0008) [2023-12-26 04:29:29,557][123091] Updated weights for policy 0, policy_version 614313 (0.0009) [2023-12-26 04:29:30,046][123090] Updated weights for policy 1, policy_version 609991 (0.0008) [2023-12-26 04:29:30,120][123090] Updated weights for policy 1, policy_version 610001 (0.0005) [2023-12-26 04:29:30,189][123090] Updated weights for policy 1, policy_version 610011 (0.0005) [2023-12-26 04:29:30,311][123091] Updated weights for policy 0, policy_version 614323 (0.0008) [2023-12-26 04:29:30,371][123091] Updated weights for policy 0, policy_version 614333 (0.0008) [2023-12-26 04:29:30,436][123091] Updated weights for policy 0, policy_version 614343 (0.0009) [2023-12-26 04:29:30,920][123090] Updated weights for policy 1, policy_version 610021 (0.0008) [2023-12-26 04:29:30,982][123090] Updated weights for policy 1, policy_version 610031 (0.0010) [2023-12-26 04:29:31,037][123090] Updated weights for policy 1, policy_version 610041 (0.0010) [2023-12-26 04:29:31,256][123091] Updated weights for policy 0, policy_version 614353 (0.0008) [2023-12-26 04:29:31,318][123091] Updated weights for policy 0, policy_version 614363 (0.0009) [2023-12-26 04:29:31,386][123091] Updated weights for policy 0, policy_version 614373 (0.0009) [2023-12-26 04:29:31,444][123091] Updated weights for policy 0, policy_version 614383 (0.0008) [2023-12-26 04:29:31,915][123090] Updated weights for policy 1, policy_version 610051 (0.0011) [2023-12-26 04:29:31,970][123090] Updated weights for policy 1, policy_version 610061 (0.0010) [2023-12-26 04:29:32,029][123090] Updated weights for policy 1, policy_version 610071 (0.0010) [2023-12-26 04:29:32,318][123091] Updated weights for policy 0, policy_version 614393 (0.0009) [2023-12-26 04:29:32,382][123091] Updated weights for policy 0, policy_version 614403 (0.0008) [2023-12-26 04:29:32,441][123091] Updated weights for policy 0, policy_version 614413 (0.0005) [2023-12-26 04:29:32,759][123090] Updated weights for policy 1, policy_version 610081 (0.0010) [2023-12-26 04:29:32,815][123090] Updated weights for policy 1, policy_version 610091 (0.0005) [2023-12-26 04:29:32,870][123090] Updated weights for policy 1, policy_version 610101 (0.0005) [2023-12-26 04:29:32,920][123090] Updated weights for policy 1, policy_version 610111 (0.0005) [2023-12-26 04:29:33,113][123091] Updated weights for policy 0, policy_version 614423 (0.0005) [2023-12-26 04:29:33,170][123091] Updated weights for policy 0, policy_version 614433 (0.0005) [2023-12-26 04:29:33,231][123091] Updated weights for policy 0, policy_version 614443 (0.0007) [2023-12-26 04:29:33,581][123090] Updated weights for policy 1, policy_version 610121 (0.0005) [2023-12-26 04:29:33,641][123090] Updated weights for policy 1, policy_version 610131 (0.0005) [2023-12-26 04:29:33,688][123090] Updated weights for policy 1, policy_version 610141 (0.0005) [2023-12-26 04:29:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 313499648. Throughput: 0: 8929.5, 1: 8793.8. Samples: 313508348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:33,785][121949] Avg episode reward: [(0, '6118.156'), (1, '5360.386')] [2023-12-26 04:29:34,096][123091] Updated weights for policy 0, policy_version 614453 (0.0010) [2023-12-26 04:29:34,159][123091] Updated weights for policy 0, policy_version 614463 (0.0009) [2023-12-26 04:29:34,228][123091] Updated weights for policy 0, policy_version 614473 (0.0010) [2023-12-26 04:29:34,383][123090] Updated weights for policy 1, policy_version 610151 (0.0008) [2023-12-26 04:29:34,454][123090] Updated weights for policy 1, policy_version 610161 (0.0008) [2023-12-26 04:29:34,512][123090] Updated weights for policy 1, policy_version 610171 (0.0009) [2023-12-26 04:29:35,054][123091] Updated weights for policy 0, policy_version 614483 (0.0009) [2023-12-26 04:29:35,107][123091] Updated weights for policy 0, policy_version 614493 (0.0009) [2023-12-26 04:29:35,154][123091] Updated weights for policy 0, policy_version 614503 (0.0008) [2023-12-26 04:29:35,357][123090] Updated weights for policy 1, policy_version 610181 (0.0010) [2023-12-26 04:29:35,416][123090] Updated weights for policy 1, policy_version 610191 (0.0007) [2023-12-26 04:29:35,469][123090] Updated weights for policy 1, policy_version 610201 (0.0005) [2023-12-26 04:29:36,046][123091] Updated weights for policy 0, policy_version 614513 (0.0008) [2023-12-26 04:29:36,108][123091] Updated weights for policy 0, policy_version 614524 (0.0010) [2023-12-26 04:29:36,163][123090] Updated weights for policy 1, policy_version 610211 (0.0009) [2023-12-26 04:29:36,164][123091] Updated weights for policy 0, policy_version 614534 (0.0010) [2023-12-26 04:29:36,222][123091] Updated weights for policy 0, policy_version 614544 (0.0009) [2023-12-26 04:29:36,226][123090] Updated weights for policy 1, policy_version 610221 (0.0008) [2023-12-26 04:29:36,286][123090] Updated weights for policy 1, policy_version 610231 (0.0008) [2023-12-26 04:29:37,044][123090] Updated weights for policy 1, policy_version 610241 (0.0008) [2023-12-26 04:29:37,106][123090] Updated weights for policy 1, policy_version 610251 (0.0009) [2023-12-26 04:29:37,120][123091] Updated weights for policy 0, policy_version 614554 (0.0009) [2023-12-26 04:29:37,169][123091] Updated weights for policy 0, policy_version 614564 (0.0007) [2023-12-26 04:29:37,172][123090] Updated weights for policy 1, policy_version 610261 (0.0008) [2023-12-26 04:29:37,231][123090] Updated weights for policy 1, policy_version 610271 (0.0007) [2023-12-26 04:29:37,238][123091] Updated weights for policy 0, policy_version 614574 (0.0009) [2023-12-26 04:29:38,043][123090] Updated weights for policy 1, policy_version 610281 (0.0009) [2023-12-26 04:29:38,070][123091] Updated weights for policy 0, policy_version 614584 (0.0010) [2023-12-26 04:29:38,106][123090] Updated weights for policy 1, policy_version 610291 (0.0007) [2023-12-26 04:29:38,129][123091] Updated weights for policy 0, policy_version 614594 (0.0010) [2023-12-26 04:29:38,166][123090] Updated weights for policy 1, policy_version 610301 (0.0007) [2023-12-26 04:29:38,191][123091] Updated weights for policy 0, policy_version 614604 (0.0010) [2023-12-26 04:29:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 313581568. Throughput: 0: 8859.7, 1: 8897.2. Samples: 313561208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:38,785][121949] Avg episode reward: [(0, '6189.641'), (1, '5319.619')] [2023-12-26 04:29:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000614608_157343744.pth... [2023-12-26 04:29:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000610304_156237824.pth... [2023-12-26 04:29:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000613584_157081600.pth [2023-12-26 04:29:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000609248_155967488.pth [2023-12-26 04:29:39,010][123090] Updated weights for policy 1, policy_version 610311 (0.0010) [2023-12-26 04:29:39,017][123091] Updated weights for policy 0, policy_version 614614 (0.0009) [2023-12-26 04:29:39,075][123090] Updated weights for policy 1, policy_version 610321 (0.0007) [2023-12-26 04:29:39,084][123091] Updated weights for policy 0, policy_version 614624 (0.0009) [2023-12-26 04:29:39,126][123090] Updated weights for policy 1, policy_version 610331 (0.0009) [2023-12-26 04:29:39,131][123091] Updated weights for policy 0, policy_version 614634 (0.0006) [2023-12-26 04:29:39,999][123091] Updated weights for policy 0, policy_version 614644 (0.0009) [2023-12-26 04:29:40,014][123090] Updated weights for policy 1, policy_version 610341 (0.0009) [2023-12-26 04:29:40,056][123091] Updated weights for policy 0, policy_version 614654 (0.0009) [2023-12-26 04:29:40,081][123090] Updated weights for policy 1, policy_version 610351 (0.0006) [2023-12-26 04:29:40,113][123091] Updated weights for policy 0, policy_version 614665 (0.0009) [2023-12-26 04:29:40,139][123090] Updated weights for policy 1, policy_version 610361 (0.0007) [2023-12-26 04:29:40,803][123090] Updated weights for policy 1, policy_version 610371 (0.0008) [2023-12-26 04:29:40,872][123090] Updated weights for policy 1, policy_version 610381 (0.0005) [2023-12-26 04:29:40,944][123090] Updated weights for policy 1, policy_version 610391 (0.0005) [2023-12-26 04:29:41,029][123091] Updated weights for policy 0, policy_version 614675 (0.0010) [2023-12-26 04:29:41,091][123091] Updated weights for policy 0, policy_version 614685 (0.0010) [2023-12-26 04:29:41,158][123091] Updated weights for policy 0, policy_version 614695 (0.0009) [2023-12-26 04:29:41,653][123090] Updated weights for policy 1, policy_version 610401 (0.0006) [2023-12-26 04:29:41,710][123090] Updated weights for policy 1, policy_version 610411 (0.0010) [2023-12-26 04:29:41,776][123090] Updated weights for policy 1, policy_version 610421 (0.0009) [2023-12-26 04:29:41,838][123090] Updated weights for policy 1, policy_version 610431 (0.0009) [2023-12-26 04:29:42,046][123091] Updated weights for policy 0, policy_version 614705 (0.0010) [2023-12-26 04:29:42,099][123091] Updated weights for policy 0, policy_version 614715 (0.0010) [2023-12-26 04:29:42,151][123091] Updated weights for policy 0, policy_version 614725 (0.0010) [2023-12-26 04:29:42,202][123091] Updated weights for policy 0, policy_version 614735 (0.0009) [2023-12-26 04:29:42,595][123090] Updated weights for policy 1, policy_version 610441 (0.0009) [2023-12-26 04:29:42,650][123090] Updated weights for policy 1, policy_version 610451 (0.0010) [2023-12-26 04:29:42,707][123090] Updated weights for policy 1, policy_version 610461 (0.0009) [2023-12-26 04:29:43,081][123091] Updated weights for policy 0, policy_version 614745 (0.0010) [2023-12-26 04:29:43,146][123091] Updated weights for policy 0, policy_version 614755 (0.0009) [2023-12-26 04:29:43,209][123091] Updated weights for policy 0, policy_version 614765 (0.0009) [2023-12-26 04:29:43,576][123090] Updated weights for policy 1, policy_version 610471 (0.0010) [2023-12-26 04:29:43,633][123090] Updated weights for policy 1, policy_version 610481 (0.0009) [2023-12-26 04:29:43,690][123090] Updated weights for policy 1, policy_version 610491 (0.0009) [2023-12-26 04:29:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 313671680. Throughput: 0: 8762.3, 1: 8918.0. Samples: 313663632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:43,785][121949] Avg episode reward: [(0, '6290.475'), (1, '5008.119')] [2023-12-26 04:29:44,047][123091] Updated weights for policy 0, policy_version 614775 (0.0011) [2023-12-26 04:29:44,106][123091] Updated weights for policy 0, policy_version 614785 (0.0009) [2023-12-26 04:29:44,166][123091] Updated weights for policy 0, policy_version 614795 (0.0010) [2023-12-26 04:29:44,529][123090] Updated weights for policy 1, policy_version 610501 (0.0008) [2023-12-26 04:29:44,577][123090] Updated weights for policy 1, policy_version 610511 (0.0009) [2023-12-26 04:29:44,626][123090] Updated weights for policy 1, policy_version 610521 (0.0009) [2023-12-26 04:29:45,001][123091] Updated weights for policy 0, policy_version 614805 (0.0010) [2023-12-26 04:29:45,055][123091] Updated weights for policy 0, policy_version 614815 (0.0010) [2023-12-26 04:29:45,110][123091] Updated weights for policy 0, policy_version 614825 (0.0010) [2023-12-26 04:29:45,419][123090] Updated weights for policy 1, policy_version 610531 (0.0010) [2023-12-26 04:29:45,476][123090] Updated weights for policy 1, policy_version 610541 (0.0009) [2023-12-26 04:29:45,528][123090] Updated weights for policy 1, policy_version 610551 (0.0010) [2023-12-26 04:29:45,892][123091] Updated weights for policy 0, policy_version 614835 (0.0010) [2023-12-26 04:29:45,941][123091] Updated weights for policy 0, policy_version 614845 (0.0009) [2023-12-26 04:29:45,989][123091] Updated weights for policy 0, policy_version 614855 (0.0009) [2023-12-26 04:29:46,377][123090] Updated weights for policy 1, policy_version 610561 (0.0010) [2023-12-26 04:29:46,429][123090] Updated weights for policy 1, policy_version 610571 (0.0009) [2023-12-26 04:29:46,491][123090] Updated weights for policy 1, policy_version 610581 (0.0009) [2023-12-26 04:29:46,560][123090] Updated weights for policy 1, policy_version 610591 (0.0009) [2023-12-26 04:29:46,819][123091] Updated weights for policy 0, policy_version 614865 (0.0009) [2023-12-26 04:29:46,880][123091] Updated weights for policy 0, policy_version 614875 (0.0010) [2023-12-26 04:29:46,941][123091] Updated weights for policy 0, policy_version 614885 (0.0009) [2023-12-26 04:29:47,008][123091] Updated weights for policy 0, policy_version 614895 (0.0007) [2023-12-26 04:29:47,387][123090] Updated weights for policy 1, policy_version 610602 (0.0010) [2023-12-26 04:29:47,441][123090] Updated weights for policy 1, policy_version 610613 (0.0010) [2023-12-26 04:29:47,503][123090] Updated weights for policy 1, policy_version 610623 (0.0009) [2023-12-26 04:29:47,752][123091] Updated weights for policy 0, policy_version 614905 (0.0010) [2023-12-26 04:29:47,818][123091] Updated weights for policy 0, policy_version 614915 (0.0010) [2023-12-26 04:29:47,880][123091] Updated weights for policy 0, policy_version 614925 (0.0009) [2023-12-26 04:29:48,391][123090] Updated weights for policy 1, policy_version 610633 (0.0008) [2023-12-26 04:29:48,440][123090] Updated weights for policy 1, policy_version 610643 (0.0009) [2023-12-26 04:29:48,500][123090] Updated weights for policy 1, policy_version 610653 (0.0010) [2023-12-26 04:29:48,709][123091] Updated weights for policy 0, policy_version 614935 (0.0010) [2023-12-26 04:29:48,774][123091] Updated weights for policy 0, policy_version 614946 (0.0010) [2023-12-26 04:29:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 313753600. Throughput: 0: 8775.1, 1: 8869.0. Samples: 313766668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:48,786][121949] Avg episode reward: [(0, '6195.960'), (1, '4938.904')] [2023-12-26 04:29:48,834][123091] Updated weights for policy 0, policy_version 614956 (0.0009) [2023-12-26 04:29:49,391][123090] Updated weights for policy 1, policy_version 610663 (0.0009) [2023-12-26 04:29:49,440][123090] Updated weights for policy 1, policy_version 610673 (0.0009) [2023-12-26 04:29:49,497][123090] Updated weights for policy 1, policy_version 610683 (0.0009) [2023-12-26 04:29:49,702][123091] Updated weights for policy 0, policy_version 614966 (0.0011) [2023-12-26 04:29:49,762][123091] Updated weights for policy 0, policy_version 614976 (0.0011) [2023-12-26 04:29:49,810][123091] Updated weights for policy 0, policy_version 614986 (0.0011) [2023-12-26 04:29:50,409][123090] Updated weights for policy 1, policy_version 610693 (0.0009) [2023-12-26 04:29:50,469][123090] Updated weights for policy 1, policy_version 610703 (0.0009) [2023-12-26 04:29:50,535][123090] Updated weights for policy 1, policy_version 610713 (0.0009) [2023-12-26 04:29:50,658][123091] Updated weights for policy 0, policy_version 614996 (0.0011) [2023-12-26 04:29:50,718][123091] Updated weights for policy 0, policy_version 615006 (0.0011) [2023-12-26 04:29:50,775][123091] Updated weights for policy 0, policy_version 615016 (0.0011) [2023-12-26 04:29:51,382][123090] Updated weights for policy 1, policy_version 610723 (0.0010) [2023-12-26 04:29:51,435][123090] Updated weights for policy 1, policy_version 610733 (0.0008) [2023-12-26 04:29:51,504][123090] Updated weights for policy 1, policy_version 610743 (0.0009) [2023-12-26 04:29:51,611][123091] Updated weights for policy 0, policy_version 615026 (0.0011) [2023-12-26 04:29:51,680][123091] Updated weights for policy 0, policy_version 615036 (0.0010) [2023-12-26 04:29:51,747][123091] Updated weights for policy 0, policy_version 615046 (0.0010) [2023-12-26 04:29:51,809][123091] Updated weights for policy 0, policy_version 615056 (0.0011) [2023-12-26 04:29:52,347][123090] Updated weights for policy 1, policy_version 610753 (0.0009) [2023-12-26 04:29:52,411][123090] Updated weights for policy 1, policy_version 610763 (0.0011) [2023-12-26 04:29:52,471][123090] Updated weights for policy 1, policy_version 610773 (0.0011) [2023-12-26 04:29:52,535][123090] Updated weights for policy 1, policy_version 610783 (0.0011) [2023-12-26 04:29:52,588][123091] Updated weights for policy 0, policy_version 615066 (0.0006) [2023-12-26 04:29:52,655][123091] Updated weights for policy 0, policy_version 615076 (0.0006) [2023-12-26 04:29:52,717][123091] Updated weights for policy 0, policy_version 615086 (0.0006) [2023-12-26 04:29:53,281][123090] Updated weights for policy 1, policy_version 610793 (0.0006) [2023-12-26 04:29:53,328][123091] Updated weights for policy 0, policy_version 615096 (0.0005) [2023-12-26 04:29:53,340][123090] Updated weights for policy 1, policy_version 610803 (0.0005) [2023-12-26 04:29:53,383][123091] Updated weights for policy 0, policy_version 615106 (0.0007) [2023-12-26 04:29:53,400][123090] Updated weights for policy 1, policy_version 610813 (0.0006) [2023-12-26 04:29:53,446][123091] Updated weights for policy 0, policy_version 615116 (0.0009) [2023-12-26 04:29:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 313843712. Throughput: 0: 8713.1, 1: 8857.1. Samples: 313816372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:53,785][121949] Avg episode reward: [(0, '6163.252'), (1, '5159.264')] [2023-12-26 04:29:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000615120_157474816.pth... [2023-12-26 04:29:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000610816_156368896.pth... [2023-12-26 04:29:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000609760_156098560.pth [2023-12-26 04:29:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000614096_157212672.pth [2023-12-26 04:29:54,042][123090] Updated weights for policy 1, policy_version 610823 (0.0010) [2023-12-26 04:29:54,088][123091] Updated weights for policy 0, policy_version 615126 (0.0005) [2023-12-26 04:29:54,090][123090] Updated weights for policy 1, policy_version 610833 (0.0010) [2023-12-26 04:29:54,149][123090] Updated weights for policy 1, policy_version 610843 (0.0010) [2023-12-26 04:29:54,155][123091] Updated weights for policy 0, policy_version 615136 (0.0005) [2023-12-26 04:29:54,220][123091] Updated weights for policy 0, policy_version 615146 (0.0006) [2023-12-26 04:29:54,886][123090] Updated weights for policy 1, policy_version 610853 (0.0008) [2023-12-26 04:29:54,963][123090] Updated weights for policy 1, policy_version 610863 (0.0005) [2023-12-26 04:29:54,982][123091] Updated weights for policy 0, policy_version 615156 (0.0006) [2023-12-26 04:29:55,039][123090] Updated weights for policy 1, policy_version 610873 (0.0006) [2023-12-26 04:29:55,046][123091] Updated weights for policy 0, policy_version 615166 (0.0007) [2023-12-26 04:29:55,092][123091] Updated weights for policy 0, policy_version 615176 (0.0007) [2023-12-26 04:29:55,720][123091] Updated weights for policy 0, policy_version 615186 (0.0005) [2023-12-26 04:29:55,788][123091] Updated weights for policy 0, policy_version 615196 (0.0008) [2023-12-26 04:29:55,812][123090] Updated weights for policy 1, policy_version 610883 (0.0009) [2023-12-26 04:29:55,846][123091] Updated weights for policy 0, policy_version 615206 (0.0010) [2023-12-26 04:29:55,878][123090] Updated weights for policy 1, policy_version 610893 (0.0009) [2023-12-26 04:29:55,905][123091] Updated weights for policy 0, policy_version 615216 (0.0010) [2023-12-26 04:29:55,939][123090] Updated weights for policy 1, policy_version 610903 (0.0008) [2023-12-26 04:29:56,617][123091] Updated weights for policy 0, policy_version 615226 (0.0006) [2023-12-26 04:29:56,671][123091] Updated weights for policy 0, policy_version 615236 (0.0010) [2023-12-26 04:29:56,722][123091] Updated weights for policy 0, policy_version 615246 (0.0010) [2023-12-26 04:29:56,760][123090] Updated weights for policy 1, policy_version 610913 (0.0008) [2023-12-26 04:29:56,810][123090] Updated weights for policy 1, policy_version 610923 (0.0005) [2023-12-26 04:29:56,858][123090] Updated weights for policy 1, policy_version 610933 (0.0005) [2023-12-26 04:29:56,911][123090] Updated weights for policy 1, policy_version 610943 (0.0009) [2023-12-26 04:29:57,459][123091] Updated weights for policy 0, policy_version 615256 (0.0005) [2023-12-26 04:29:57,505][123091] Updated weights for policy 0, policy_version 615266 (0.0007) [2023-12-26 04:29:57,510][123090] Updated weights for policy 1, policy_version 610953 (0.0006) [2023-12-26 04:29:57,554][123091] Updated weights for policy 0, policy_version 615277 (0.0008) [2023-12-26 04:29:57,563][123090] Updated weights for policy 1, policy_version 610963 (0.0005) [2023-12-26 04:29:57,619][123090] Updated weights for policy 1, policy_version 610973 (0.0005) [2023-12-26 04:29:58,328][123091] Updated weights for policy 0, policy_version 615287 (0.0009) [2023-12-26 04:29:58,329][123090] Updated weights for policy 1, policy_version 610983 (0.0008) [2023-12-26 04:29:58,396][123091] Updated weights for policy 0, policy_version 615297 (0.0011) [2023-12-26 04:29:58,400][123090] Updated weights for policy 1, policy_version 610993 (0.0009) [2023-12-26 04:29:58,468][123091] Updated weights for policy 0, policy_version 615307 (0.0011) [2023-12-26 04:29:58,476][123090] Updated weights for policy 1, policy_version 611003 (0.0010) [2023-12-26 04:29:58,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 313942016. Throughput: 0: 8872.4, 1: 8967.5. Samples: 313931436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:29:58,785][121949] Avg episode reward: [(0, '6187.235'), (1, '5273.446')] [2023-12-26 04:29:59,320][123090] Updated weights for policy 1, policy_version 611013 (0.0007) [2023-12-26 04:29:59,328][123091] Updated weights for policy 0, policy_version 615317 (0.0010) [2023-12-26 04:29:59,385][123090] Updated weights for policy 1, policy_version 611023 (0.0010) [2023-12-26 04:29:59,396][123091] Updated weights for policy 0, policy_version 615327 (0.0010) [2023-12-26 04:29:59,442][123090] Updated weights for policy 1, policy_version 611033 (0.0007) [2023-12-26 04:29:59,459][123091] Updated weights for policy 0, policy_version 615337 (0.0008) [2023-12-26 04:30:00,298][123091] Updated weights for policy 0, policy_version 615347 (0.0009) [2023-12-26 04:30:00,309][123090] Updated weights for policy 1, policy_version 611043 (0.0006) [2023-12-26 04:30:00,359][123091] Updated weights for policy 0, policy_version 615357 (0.0011) [2023-12-26 04:30:00,375][123090] Updated weights for policy 1, policy_version 611053 (0.0007) [2023-12-26 04:30:00,416][123091] Updated weights for policy 0, policy_version 615367 (0.0011) [2023-12-26 04:30:00,436][123090] Updated weights for policy 1, policy_version 611063 (0.0006) [2023-12-26 04:30:01,259][123091] Updated weights for policy 0, policy_version 615377 (0.0010) [2023-12-26 04:30:01,308][123090] Updated weights for policy 1, policy_version 611073 (0.0007) [2023-12-26 04:30:01,323][123091] Updated weights for policy 0, policy_version 615387 (0.0007) [2023-12-26 04:30:01,368][123090] Updated weights for policy 1, policy_version 611083 (0.0008) [2023-12-26 04:30:01,401][123091] Updated weights for policy 0, policy_version 615397 (0.0007) [2023-12-26 04:30:01,439][123090] Updated weights for policy 1, policy_version 611093 (0.0006) [2023-12-26 04:30:01,477][123091] Updated weights for policy 0, policy_version 615407 (0.0006) [2023-12-26 04:30:01,512][123090] Updated weights for policy 1, policy_version 611103 (0.0005) [2023-12-26 04:30:02,154][123091] Updated weights for policy 0, policy_version 615417 (0.0010) [2023-12-26 04:30:02,213][123091] Updated weights for policy 0, policy_version 615427 (0.0010) [2023-12-26 04:30:02,274][123091] Updated weights for policy 0, policy_version 615437 (0.0009) [2023-12-26 04:30:02,286][123090] Updated weights for policy 1, policy_version 611113 (0.0007) [2023-12-26 04:30:02,340][123090] Updated weights for policy 1, policy_version 611123 (0.0009) [2023-12-26 04:30:02,404][123090] Updated weights for policy 1, policy_version 611133 (0.0010) [2023-12-26 04:30:03,103][123091] Updated weights for policy 0, policy_version 615447 (0.0006) [2023-12-26 04:30:03,150][123091] Updated weights for policy 0, policy_version 615457 (0.0006) [2023-12-26 04:30:03,202][123091] Updated weights for policy 0, policy_version 615467 (0.0006) [2023-12-26 04:30:03,243][123090] Updated weights for policy 1, policy_version 611143 (0.0009) [2023-12-26 04:30:03,307][123090] Updated weights for policy 1, policy_version 611153 (0.0009) [2023-12-26 04:30:03,376][123090] Updated weights for policy 1, policy_version 611163 (0.0010) [2023-12-26 04:30:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 314023936. Throughput: 0: 8879.3, 1: 8887.1. Samples: 314035380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:03,785][121949] Avg episode reward: [(0, '6265.902'), (1, '5092.103')] [2023-12-26 04:30:03,961][123091] Updated weights for policy 0, policy_version 615477 (0.0007) [2023-12-26 04:30:04,020][123091] Updated weights for policy 0, policy_version 615487 (0.0008) [2023-12-26 04:30:04,078][123091] Updated weights for policy 0, policy_version 615497 (0.0008) [2023-12-26 04:30:04,151][123090] Updated weights for policy 1, policy_version 611173 (0.0010) [2023-12-26 04:30:04,215][123090] Updated weights for policy 1, policy_version 611183 (0.0011) [2023-12-26 04:30:04,280][123090] Updated weights for policy 1, policy_version 611193 (0.0011) [2023-12-26 04:30:04,898][123091] Updated weights for policy 0, policy_version 615507 (0.0009) [2023-12-26 04:30:04,960][123091] Updated weights for policy 0, policy_version 615517 (0.0010) [2023-12-26 04:30:05,023][123091] Updated weights for policy 0, policy_version 615527 (0.0008) [2023-12-26 04:30:05,077][123090] Updated weights for policy 1, policy_version 611203 (0.0009) [2023-12-26 04:30:05,129][123090] Updated weights for policy 1, policy_version 611213 (0.0010) [2023-12-26 04:30:05,181][123090] Updated weights for policy 1, policy_version 611223 (0.0010) [2023-12-26 04:30:05,781][123091] Updated weights for policy 0, policy_version 615537 (0.0006) [2023-12-26 04:30:05,848][123091] Updated weights for policy 0, policy_version 615547 (0.0010) [2023-12-26 04:30:05,927][123091] Updated weights for policy 0, policy_version 615557 (0.0010) [2023-12-26 04:30:05,964][123090] Updated weights for policy 1, policy_version 611233 (0.0010) [2023-12-26 04:30:05,990][123091] Updated weights for policy 0, policy_version 615567 (0.0008) [2023-12-26 04:30:06,028][123090] Updated weights for policy 1, policy_version 611243 (0.0010) [2023-12-26 04:30:06,094][123090] Updated weights for policy 1, policy_version 611253 (0.0010) [2023-12-26 04:30:06,165][123090] Updated weights for policy 1, policy_version 611263 (0.0008) [2023-12-26 04:30:06,818][123091] Updated weights for policy 0, policy_version 615577 (0.0006) [2023-12-26 04:30:06,870][123090] Updated weights for policy 1, policy_version 611273 (0.0006) [2023-12-26 04:30:06,884][123091] Updated weights for policy 0, policy_version 615587 (0.0008) [2023-12-26 04:30:06,937][123090] Updated weights for policy 1, policy_version 611283 (0.0005) [2023-12-26 04:30:06,948][123091] Updated weights for policy 0, policy_version 615597 (0.0009) [2023-12-26 04:30:06,997][123090] Updated weights for policy 1, policy_version 611293 (0.0009) [2023-12-26 04:30:07,662][123090] Updated weights for policy 1, policy_version 611303 (0.0010) [2023-12-26 04:30:07,727][123091] Updated weights for policy 0, policy_version 615607 (0.0009) [2023-12-26 04:30:07,729][123090] Updated weights for policy 1, policy_version 611313 (0.0010) [2023-12-26 04:30:07,779][123091] Updated weights for policy 0, policy_version 615617 (0.0010) [2023-12-26 04:30:07,795][123090] Updated weights for policy 1, policy_version 611323 (0.0010) [2023-12-26 04:30:07,842][123091] Updated weights for policy 0, policy_version 615627 (0.0010) [2023-12-26 04:30:08,467][123090] Updated weights for policy 1, policy_version 611333 (0.0008) [2023-12-26 04:30:08,527][123090] Updated weights for policy 1, policy_version 611343 (0.0010) [2023-12-26 04:30:08,579][123090] Updated weights for policy 1, policy_version 611353 (0.0010) [2023-12-26 04:30:08,623][123091] Updated weights for policy 0, policy_version 615637 (0.0009) [2023-12-26 04:30:08,696][123091] Updated weights for policy 0, policy_version 615647 (0.0009) [2023-12-26 04:30:08,758][123091] Updated weights for policy 0, policy_version 615657 (0.0008) [2023-12-26 04:30:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 314114048. Throughput: 0: 8861.1, 1: 8936.0. Samples: 314088764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:08,785][121949] Avg episode reward: [(0, '6168.650'), (1, '5018.006')] [2023-12-26 04:30:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000611360_156508160.pth... [2023-12-26 04:30:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000610304_156237824.pth [2023-12-26 04:30:08,806][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000615664_157614080.pth... [2023-12-26 04:30:08,814][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000614608_157343744.pth [2023-12-26 04:30:09,440][123090] Updated weights for policy 1, policy_version 611363 (0.0010) [2023-12-26 04:30:09,447][123091] Updated weights for policy 0, policy_version 615667 (0.0008) [2023-12-26 04:30:09,501][123090] Updated weights for policy 1, policy_version 611373 (0.0009) [2023-12-26 04:30:09,507][123091] Updated weights for policy 0, policy_version 615677 (0.0007) [2023-12-26 04:30:09,567][123090] Updated weights for policy 1, policy_version 611383 (0.0007) [2023-12-26 04:30:09,574][123091] Updated weights for policy 0, policy_version 615687 (0.0007) [2023-12-26 04:30:10,343][123091] Updated weights for policy 0, policy_version 615697 (0.0007) [2023-12-26 04:30:10,401][123091] Updated weights for policy 0, policy_version 615707 (0.0010) [2023-12-26 04:30:10,431][123090] Updated weights for policy 1, policy_version 611393 (0.0009) [2023-12-26 04:30:10,456][123091] Updated weights for policy 0, policy_version 615717 (0.0006) [2023-12-26 04:30:10,492][123090] Updated weights for policy 1, policy_version 611403 (0.0006) [2023-12-26 04:30:10,510][123091] Updated weights for policy 0, policy_version 615727 (0.0007) [2023-12-26 04:30:10,560][123090] Updated weights for policy 1, policy_version 611413 (0.0005) [2023-12-26 04:30:10,621][123090] Updated weights for policy 1, policy_version 611423 (0.0005) [2023-12-26 04:30:11,353][123091] Updated weights for policy 0, policy_version 615737 (0.0009) [2023-12-26 04:30:11,425][123091] Updated weights for policy 0, policy_version 615747 (0.0008) [2023-12-26 04:30:11,427][123090] Updated weights for policy 1, policy_version 611433 (0.0009) [2023-12-26 04:30:11,492][123091] Updated weights for policy 0, policy_version 615757 (0.0008) [2023-12-26 04:30:11,498][123090] Updated weights for policy 1, policy_version 611443 (0.0007) [2023-12-26 04:30:11,572][123090] Updated weights for policy 1, policy_version 611453 (0.0008) [2023-12-26 04:30:12,360][123091] Updated weights for policy 0, policy_version 615767 (0.0009) [2023-12-26 04:30:12,420][123091] Updated weights for policy 0, policy_version 615777 (0.0009) [2023-12-26 04:30:12,420][123090] Updated weights for policy 1, policy_version 611463 (0.0006) [2023-12-26 04:30:12,472][123091] Updated weights for policy 0, policy_version 615787 (0.0009) [2023-12-26 04:30:12,479][123090] Updated weights for policy 1, policy_version 611473 (0.0005) [2023-12-26 04:30:12,539][123090] Updated weights for policy 1, policy_version 611483 (0.0005) [2023-12-26 04:30:13,226][123091] Updated weights for policy 0, policy_version 615797 (0.0010) [2023-12-26 04:30:13,285][123091] Updated weights for policy 0, policy_version 615807 (0.0009) [2023-12-26 04:30:13,322][123090] Updated weights for policy 1, policy_version 611493 (0.0007) [2023-12-26 04:30:13,343][123091] Updated weights for policy 0, policy_version 615817 (0.0008) [2023-12-26 04:30:13,368][123090] Updated weights for policy 1, policy_version 611503 (0.0008) [2023-12-26 04:30:13,423][123090] Updated weights for policy 1, policy_version 611513 (0.0009) [2023-12-26 04:30:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 314204160. Throughput: 0: 8752.7, 1: 8888.6. Samples: 314195360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:13,785][121949] Avg episode reward: [(0, '6175.923'), (1, '4862.174')] [2023-12-26 04:30:14,037][123091] Updated weights for policy 0, policy_version 615827 (0.0008) [2023-12-26 04:30:14,108][123091] Updated weights for policy 0, policy_version 615837 (0.0006) [2023-12-26 04:30:14,165][123091] Updated weights for policy 0, policy_version 615847 (0.0005) [2023-12-26 04:30:14,235][123090] Updated weights for policy 1, policy_version 611523 (0.0008) [2023-12-26 04:30:14,289][123090] Updated weights for policy 1, policy_version 611533 (0.0009) [2023-12-26 04:30:14,339][123090] Updated weights for policy 1, policy_version 611543 (0.0009) [2023-12-26 04:30:14,976][123091] Updated weights for policy 0, policy_version 615857 (0.0008) [2023-12-26 04:30:15,036][123091] Updated weights for policy 0, policy_version 615867 (0.0010) [2023-12-26 04:30:15,091][123091] Updated weights for policy 0, policy_version 615878 (0.0010) [2023-12-26 04:30:15,143][123091] Updated weights for policy 0, policy_version 615888 (0.0010) [2023-12-26 04:30:15,175][123090] Updated weights for policy 1, policy_version 611553 (0.0008) [2023-12-26 04:30:15,244][123090] Updated weights for policy 1, policy_version 611563 (0.0006) [2023-12-26 04:30:15,305][123090] Updated weights for policy 1, policy_version 611573 (0.0010) [2023-12-26 04:30:15,361][123090] Updated weights for policy 1, policy_version 611583 (0.0010) [2023-12-26 04:30:15,946][123091] Updated weights for policy 0, policy_version 615898 (0.0010) [2023-12-26 04:30:16,005][123091] Updated weights for policy 0, policy_version 615908 (0.0009) [2023-12-26 04:30:16,066][123091] Updated weights for policy 0, policy_version 615918 (0.0010) [2023-12-26 04:30:16,104][123090] Updated weights for policy 1, policy_version 611593 (0.0009) [2023-12-26 04:30:16,167][123090] Updated weights for policy 1, policy_version 611603 (0.0009) [2023-12-26 04:30:16,224][123090] Updated weights for policy 1, policy_version 611613 (0.0009) [2023-12-26 04:30:16,865][123091] Updated weights for policy 0, policy_version 615928 (0.0006) [2023-12-26 04:30:16,921][123091] Updated weights for policy 0, policy_version 615938 (0.0006) [2023-12-26 04:30:17,008][123091] Updated weights for policy 0, policy_version 615948 (0.0006) [2023-12-26 04:30:17,099][123090] Updated weights for policy 1, policy_version 611623 (0.0009) [2023-12-26 04:30:17,148][123090] Updated weights for policy 1, policy_version 611634 (0.0009) [2023-12-26 04:30:17,198][123090] Updated weights for policy 1, policy_version 611644 (0.0009) [2023-12-26 04:30:17,764][123091] Updated weights for policy 0, policy_version 615958 (0.0007) [2023-12-26 04:30:17,835][123091] Updated weights for policy 0, policy_version 615968 (0.0009) [2023-12-26 04:30:17,899][123091] Updated weights for policy 0, policy_version 615978 (0.0009) [2023-12-26 04:30:18,074][123090] Updated weights for policy 1, policy_version 611654 (0.0010) [2023-12-26 04:30:18,141][123090] Updated weights for policy 1, policy_version 611664 (0.0010) [2023-12-26 04:30:18,203][123090] Updated weights for policy 1, policy_version 611674 (0.0010) [2023-12-26 04:30:18,746][123091] Updated weights for policy 0, policy_version 615988 (0.0009) [2023-12-26 04:30:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 314286080. Throughput: 0: 8799.9, 1: 8841.1. Samples: 314302192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:18,784][121949] Avg episode reward: [(0, '6139.298'), (1, '4565.063')] [2023-12-26 04:30:18,808][123091] Updated weights for policy 0, policy_version 615998 (0.0009) [2023-12-26 04:30:18,873][123091] Updated weights for policy 0, policy_version 616008 (0.0009) [2023-12-26 04:30:18,963][123090] Updated weights for policy 1, policy_version 611684 (0.0008) [2023-12-26 04:30:19,026][123090] Updated weights for policy 1, policy_version 611694 (0.0005) [2023-12-26 04:30:19,094][123090] Updated weights for policy 1, policy_version 611704 (0.0008) [2023-12-26 04:30:19,752][123091] Updated weights for policy 0, policy_version 616018 (0.0010) [2023-12-26 04:30:19,818][123091] Updated weights for policy 0, policy_version 616028 (0.0010) [2023-12-26 04:30:19,881][123090] Updated weights for policy 1, policy_version 611714 (0.0009) [2023-12-26 04:30:19,887][123091] Updated weights for policy 0, policy_version 616038 (0.0009) [2023-12-26 04:30:19,946][123090] Updated weights for policy 1, policy_version 611724 (0.0007) [2023-12-26 04:30:19,957][123091] Updated weights for policy 0, policy_version 616048 (0.0009) [2023-12-26 04:30:20,019][123090] Updated weights for policy 1, policy_version 611734 (0.0008) [2023-12-26 04:30:20,076][123090] Updated weights for policy 1, policy_version 611744 (0.0005) [2023-12-26 04:30:20,771][123091] Updated weights for policy 0, policy_version 616058 (0.0009) [2023-12-26 04:30:20,848][123091] Updated weights for policy 0, policy_version 616068 (0.0010) [2023-12-26 04:30:20,874][123090] Updated weights for policy 1, policy_version 611754 (0.0006) [2023-12-26 04:30:20,918][123091] Updated weights for policy 0, policy_version 616078 (0.0008) [2023-12-26 04:30:20,944][123090] Updated weights for policy 1, policy_version 611764 (0.0009) [2023-12-26 04:30:21,016][123090] Updated weights for policy 1, policy_version 611774 (0.0010) [2023-12-26 04:30:21,743][123091] Updated weights for policy 0, policy_version 616088 (0.0009) [2023-12-26 04:30:21,814][123091] Updated weights for policy 0, policy_version 616098 (0.0010) [2023-12-26 04:30:21,847][123090] Updated weights for policy 1, policy_version 611784 (0.0006) [2023-12-26 04:30:21,872][123091] Updated weights for policy 0, policy_version 616108 (0.0009) [2023-12-26 04:30:21,912][123090] Updated weights for policy 1, policy_version 611794 (0.0007) [2023-12-26 04:30:21,974][123090] Updated weights for policy 1, policy_version 611804 (0.0010) [2023-12-26 04:30:22,684][123091] Updated weights for policy 0, policy_version 616118 (0.0010) [2023-12-26 04:30:22,743][123091] Updated weights for policy 0, policy_version 616128 (0.0011) [2023-12-26 04:30:22,788][123090] Updated weights for policy 1, policy_version 611814 (0.0010) [2023-12-26 04:30:22,810][123091] Updated weights for policy 0, policy_version 616138 (0.0011) [2023-12-26 04:30:22,840][123090] Updated weights for policy 1, policy_version 611824 (0.0010) [2023-12-26 04:30:22,896][123090] Updated weights for policy 1, policy_version 611834 (0.0010) [2023-12-26 04:30:23,538][123091] Updated weights for policy 0, policy_version 616148 (0.0010) [2023-12-26 04:30:23,585][123091] Updated weights for policy 0, policy_version 616158 (0.0010) [2023-12-26 04:30:23,643][123091] Updated weights for policy 0, policy_version 616168 (0.0010) [2023-12-26 04:30:23,708][123090] Updated weights for policy 1, policy_version 611844 (0.0011) [2023-12-26 04:30:23,765][123090] Updated weights for policy 1, policy_version 611854 (0.0007) [2023-12-26 04:30:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 314376192. Throughput: 0: 8804.0, 1: 8787.2. Samples: 314352804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:23,785][121949] Avg episode reward: [(0, '6253.794'), (1, '4696.274')] [2023-12-26 04:30:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000616176_157745152.pth... [2023-12-26 04:30:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000615120_157474816.pth [2023-12-26 04:30:23,845][123090] Updated weights for policy 1, policy_version 611864 (0.0005) [2023-12-26 04:30:23,907][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000611872_156639232.pth... [2023-12-26 04:30:23,913][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000610816_156368896.pth [2023-12-26 04:30:24,326][123091] Updated weights for policy 0, policy_version 616178 (0.0009) [2023-12-26 04:30:24,394][123091] Updated weights for policy 0, policy_version 616188 (0.0007) [2023-12-26 04:30:24,440][123091] Updated weights for policy 0, policy_version 616198 (0.0006) [2023-12-26 04:30:24,498][123091] Updated weights for policy 0, policy_version 616208 (0.0006) [2023-12-26 04:30:24,623][123090] Updated weights for policy 1, policy_version 611874 (0.0006) [2023-12-26 04:30:24,686][123090] Updated weights for policy 1, policy_version 611884 (0.0011) [2023-12-26 04:30:24,757][123090] Updated weights for policy 1, policy_version 611894 (0.0010) [2023-12-26 04:30:24,838][123090] Updated weights for policy 1, policy_version 611904 (0.0011) [2023-12-26 04:30:25,070][123091] Updated weights for policy 0, policy_version 616218 (0.0005) [2023-12-26 04:30:25,116][123091] Updated weights for policy 0, policy_version 616228 (0.0006) [2023-12-26 04:30:25,170][123091] Updated weights for policy 0, policy_version 616238 (0.0005) [2023-12-26 04:30:25,583][123090] Updated weights for policy 1, policy_version 611914 (0.0005) [2023-12-26 04:30:25,649][123090] Updated weights for policy 1, policy_version 611924 (0.0005) [2023-12-26 04:30:25,714][123090] Updated weights for policy 1, policy_version 611934 (0.0005) [2023-12-26 04:30:25,923][123091] Updated weights for policy 0, policy_version 616248 (0.0009) [2023-12-26 04:30:25,984][123091] Updated weights for policy 0, policy_version 616258 (0.0009) [2023-12-26 04:30:26,048][123091] Updated weights for policy 0, policy_version 616268 (0.0009) [2023-12-26 04:30:26,431][123090] Updated weights for policy 1, policy_version 611944 (0.0009) [2023-12-26 04:30:26,489][123090] Updated weights for policy 1, policy_version 611954 (0.0010) [2023-12-26 04:30:26,554][123090] Updated weights for policy 1, policy_version 611964 (0.0010) [2023-12-26 04:30:26,835][123091] Updated weights for policy 0, policy_version 616278 (0.0009) [2023-12-26 04:30:26,883][123091] Updated weights for policy 0, policy_version 616288 (0.0009) [2023-12-26 04:30:26,932][123091] Updated weights for policy 0, policy_version 616299 (0.0009) [2023-12-26 04:30:27,327][123090] Updated weights for policy 1, policy_version 611974 (0.0010) [2023-12-26 04:30:27,385][123090] Updated weights for policy 1, policy_version 611984 (0.0008) [2023-12-26 04:30:27,436][123090] Updated weights for policy 1, policy_version 611994 (0.0010) [2023-12-26 04:30:27,659][123091] Updated weights for policy 0, policy_version 616309 (0.0007) [2023-12-26 04:30:27,713][123091] Updated weights for policy 0, policy_version 616319 (0.0005) [2023-12-26 04:30:27,766][123091] Updated weights for policy 0, policy_version 616329 (0.0007) [2023-12-26 04:30:28,155][123090] Updated weights for policy 1, policy_version 612004 (0.0008) [2023-12-26 04:30:28,220][123090] Updated weights for policy 1, policy_version 612014 (0.0005) [2023-12-26 04:30:28,297][123090] Updated weights for policy 1, policy_version 612024 (0.0005) [2023-12-26 04:30:28,518][123091] Updated weights for policy 0, policy_version 616339 (0.0011) [2023-12-26 04:30:28,572][123091] Updated weights for policy 0, policy_version 616349 (0.0010) [2023-12-26 04:30:28,625][123091] Updated weights for policy 0, policy_version 616360 (0.0010) [2023-12-26 04:30:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 314474496. Throughput: 0: 8987.1, 1: 8789.8. Samples: 314463596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:28,785][121949] Avg episode reward: [(0, '6223.660'), (1, '4948.306')] [2023-12-26 04:30:28,955][123090] Updated weights for policy 1, policy_version 612034 (0.0008) [2023-12-26 04:30:29,011][123090] Updated weights for policy 1, policy_version 612044 (0.0010) [2023-12-26 04:30:29,063][123090] Updated weights for policy 1, policy_version 612054 (0.0010) [2023-12-26 04:30:29,120][123090] Updated weights for policy 1, policy_version 612064 (0.0011) [2023-12-26 04:30:29,510][123091] Updated weights for policy 0, policy_version 616370 (0.0010) [2023-12-26 04:30:29,574][123091] Updated weights for policy 0, policy_version 616380 (0.0009) [2023-12-26 04:30:29,639][123091] Updated weights for policy 0, policy_version 616390 (0.0009) [2023-12-26 04:30:29,695][123091] Updated weights for policy 0, policy_version 616400 (0.0009) [2023-12-26 04:30:29,978][123090] Updated weights for policy 1, policy_version 612074 (0.0010) [2023-12-26 04:30:30,042][123090] Updated weights for policy 1, policy_version 612084 (0.0010) [2023-12-26 04:30:30,109][123090] Updated weights for policy 1, policy_version 612094 (0.0011) [2023-12-26 04:30:30,551][123091] Updated weights for policy 0, policy_version 616410 (0.0009) [2023-12-26 04:30:30,597][123091] Updated weights for policy 0, policy_version 616420 (0.0008) [2023-12-26 04:30:30,646][123091] Updated weights for policy 0, policy_version 616431 (0.0009) [2023-12-26 04:30:30,934][123090] Updated weights for policy 1, policy_version 612104 (0.0010) [2023-12-26 04:30:30,988][123090] Updated weights for policy 1, policy_version 612114 (0.0010) [2023-12-26 04:30:31,044][123090] Updated weights for policy 1, policy_version 612124 (0.0009) [2023-12-26 04:30:31,559][123091] Updated weights for policy 0, policy_version 616441 (0.0009) [2023-12-26 04:30:31,626][123091] Updated weights for policy 0, policy_version 616451 (0.0009) [2023-12-26 04:30:31,685][123091] Updated weights for policy 0, policy_version 616461 (0.0009) [2023-12-26 04:30:31,937][123090] Updated weights for policy 1, policy_version 612134 (0.0008) [2023-12-26 04:30:32,007][123090] Updated weights for policy 1, policy_version 612144 (0.0006) [2023-12-26 04:30:32,079][123090] Updated weights for policy 1, policy_version 612154 (0.0007) [2023-12-26 04:30:32,587][123091] Updated weights for policy 0, policy_version 616471 (0.0009) [2023-12-26 04:30:32,656][123091] Updated weights for policy 0, policy_version 616481 (0.0008) [2023-12-26 04:30:32,722][123091] Updated weights for policy 0, policy_version 616491 (0.0008) [2023-12-26 04:30:32,855][123090] Updated weights for policy 1, policy_version 612164 (0.0008) [2023-12-26 04:30:32,902][123090] Updated weights for policy 1, policy_version 612174 (0.0010) [2023-12-26 04:30:32,960][123090] Updated weights for policy 1, policy_version 612184 (0.0010) [2023-12-26 04:30:33,509][123091] Updated weights for policy 0, policy_version 616501 (0.0006) [2023-12-26 04:30:33,566][123091] Updated weights for policy 0, policy_version 616511 (0.0005) [2023-12-26 04:30:33,617][123091] Updated weights for policy 0, policy_version 616521 (0.0005) [2023-12-26 04:30:33,673][123090] Updated weights for policy 1, policy_version 612194 (0.0009) [2023-12-26 04:30:33,731][123090] Updated weights for policy 1, policy_version 612204 (0.0010) [2023-12-26 04:30:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 314556416. Throughput: 0: 8961.4, 1: 8874.9. Samples: 314569296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:33,785][121949] Avg episode reward: [(0, '6179.333'), (1, '4840.859')] [2023-12-26 04:30:33,793][123090] Updated weights for policy 1, policy_version 612214 (0.0010) [2023-12-26 04:30:33,855][123090] Updated weights for policy 1, policy_version 612224 (0.0010) [2023-12-26 04:30:34,348][123091] Updated weights for policy 0, policy_version 616531 (0.0007) [2023-12-26 04:30:34,414][123091] Updated weights for policy 0, policy_version 616541 (0.0010) [2023-12-26 04:30:34,486][123091] Updated weights for policy 0, policy_version 616551 (0.0008) [2023-12-26 04:30:34,605][123090] Updated weights for policy 1, policy_version 612234 (0.0010) [2023-12-26 04:30:34,684][123090] Updated weights for policy 1, policy_version 612244 (0.0011) [2023-12-26 04:30:34,755][123090] Updated weights for policy 1, policy_version 612254 (0.0011) [2023-12-26 04:30:35,194][123091] Updated weights for policy 0, policy_version 616561 (0.0011) [2023-12-26 04:30:35,242][123091] Updated weights for policy 0, policy_version 616571 (0.0010) [2023-12-26 04:30:35,290][123091] Updated weights for policy 0, policy_version 616581 (0.0010) [2023-12-26 04:30:35,338][123091] Updated weights for policy 0, policy_version 616591 (0.0010) [2023-12-26 04:30:35,472][123090] Updated weights for policy 1, policy_version 612264 (0.0006) [2023-12-26 04:30:35,522][123090] Updated weights for policy 1, policy_version 612274 (0.0007) [2023-12-26 04:30:35,573][123090] Updated weights for policy 1, policy_version 612284 (0.0010) [2023-12-26 04:30:36,153][123091] Updated weights for policy 0, policy_version 616601 (0.0008) [2023-12-26 04:30:36,215][123091] Updated weights for policy 0, policy_version 616611 (0.0007) [2023-12-26 04:30:36,283][123091] Updated weights for policy 0, policy_version 616621 (0.0008) [2023-12-26 04:30:36,403][123090] Updated weights for policy 1, policy_version 612294 (0.0010) [2023-12-26 04:30:36,464][123090] Updated weights for policy 1, policy_version 612304 (0.0010) [2023-12-26 04:30:36,536][123090] Updated weights for policy 1, policy_version 612314 (0.0011) [2023-12-26 04:30:37,031][123091] Updated weights for policy 0, policy_version 616631 (0.0006) [2023-12-26 04:30:37,091][123091] Updated weights for policy 0, policy_version 616641 (0.0006) [2023-12-26 04:30:37,147][123091] Updated weights for policy 0, policy_version 616651 (0.0006) [2023-12-26 04:30:37,369][123090] Updated weights for policy 1, policy_version 612324 (0.0010) [2023-12-26 04:30:37,425][123090] Updated weights for policy 1, policy_version 612334 (0.0010) [2023-12-26 04:30:37,481][123090] Updated weights for policy 1, policy_version 612344 (0.0010) [2023-12-26 04:30:37,789][123091] Updated weights for policy 0, policy_version 616661 (0.0005) [2023-12-26 04:30:37,855][123091] Updated weights for policy 0, policy_version 616671 (0.0006) [2023-12-26 04:30:37,908][123091] Updated weights for policy 0, policy_version 616681 (0.0007) [2023-12-26 04:30:38,323][123090] Updated weights for policy 1, policy_version 612354 (0.0010) [2023-12-26 04:30:38,393][123090] Updated weights for policy 1, policy_version 612364 (0.0009) [2023-12-26 04:30:38,455][123090] Updated weights for policy 1, policy_version 612374 (0.0010) [2023-12-26 04:30:38,515][123090] Updated weights for policy 1, policy_version 612384 (0.0008) [2023-12-26 04:30:38,565][123091] Updated weights for policy 0, policy_version 616691 (0.0008) [2023-12-26 04:30:38,631][123091] Updated weights for policy 0, policy_version 616701 (0.0006) [2023-12-26 04:30:38,694][123091] Updated weights for policy 0, policy_version 616711 (0.0010) [2023-12-26 04:30:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 314654720. Throughput: 0: 9035.8, 1: 8916.1. Samples: 314624208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:38,784][121949] Avg episode reward: [(0, '6052.187'), (1, '4518.455')] [2023-12-26 04:30:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000616720_157884416.pth... [2023-12-26 04:30:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000612384_156770304.pth... [2023-12-26 04:30:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000615664_157614080.pth [2023-12-26 04:30:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000611360_156508160.pth [2023-12-26 04:30:39,412][123090] Updated weights for policy 1, policy_version 612394 (0.0008) [2023-12-26 04:30:39,434][123091] Updated weights for policy 0, policy_version 616721 (0.0010) [2023-12-26 04:30:39,479][123090] Updated weights for policy 1, policy_version 612404 (0.0009) [2023-12-26 04:30:39,497][123091] Updated weights for policy 0, policy_version 616731 (0.0008) [2023-12-26 04:30:39,543][123090] Updated weights for policy 1, policy_version 612414 (0.0010) [2023-12-26 04:30:39,562][123091] Updated weights for policy 0, policy_version 616741 (0.0007) [2023-12-26 04:30:39,630][123091] Updated weights for policy 0, policy_version 616751 (0.0010) [2023-12-26 04:30:40,390][123090] Updated weights for policy 1, policy_version 612424 (0.0009) [2023-12-26 04:30:40,440][123090] Updated weights for policy 1, policy_version 612434 (0.0007) [2023-12-26 04:30:40,441][123091] Updated weights for policy 0, policy_version 616761 (0.0011) [2023-12-26 04:30:40,502][123091] Updated weights for policy 0, policy_version 616771 (0.0011) [2023-12-26 04:30:40,504][123090] Updated weights for policy 1, policy_version 612444 (0.0006) [2023-12-26 04:30:40,565][123091] Updated weights for policy 0, policy_version 616781 (0.0011) [2023-12-26 04:30:41,355][123090] Updated weights for policy 1, policy_version 612454 (0.0008) [2023-12-26 04:30:41,411][123091] Updated weights for policy 0, policy_version 616791 (0.0011) [2023-12-26 04:30:41,417][123090] Updated weights for policy 1, policy_version 612464 (0.0008) [2023-12-26 04:30:41,475][123090] Updated weights for policy 1, policy_version 612474 (0.0006) [2023-12-26 04:30:41,475][123091] Updated weights for policy 0, policy_version 616801 (0.0011) [2023-12-26 04:30:41,528][123091] Updated weights for policy 0, policy_version 616811 (0.0011) [2023-12-26 04:30:42,389][123090] Updated weights for policy 1, policy_version 612484 (0.0007) [2023-12-26 04:30:42,389][123091] Updated weights for policy 0, policy_version 616821 (0.0009) [2023-12-26 04:30:42,446][123090] Updated weights for policy 1, policy_version 612494 (0.0008) [2023-12-26 04:30:42,451][123091] Updated weights for policy 0, policy_version 616831 (0.0008) [2023-12-26 04:30:42,508][123090] Updated weights for policy 1, policy_version 612504 (0.0008) [2023-12-26 04:30:42,509][123091] Updated weights for policy 0, policy_version 616841 (0.0008) [2023-12-26 04:30:43,304][123091] Updated weights for policy 0, policy_version 616851 (0.0009) [2023-12-26 04:30:43,354][123090] Updated weights for policy 1, policy_version 612514 (0.0009) [2023-12-26 04:30:43,373][123091] Updated weights for policy 0, policy_version 616861 (0.0008) [2023-12-26 04:30:43,406][123090] Updated weights for policy 1, policy_version 612524 (0.0008) [2023-12-26 04:30:43,434][123091] Updated weights for policy 0, policy_version 616871 (0.0010) [2023-12-26 04:30:43,471][123090] Updated weights for policy 1, policy_version 612534 (0.0009) [2023-12-26 04:30:43,521][123090] Updated weights for policy 1, policy_version 612544 (0.0008) [2023-12-26 04:30:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 314736640. Throughput: 0: 8930.3, 1: 8772.9. Samples: 314728080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:43,784][121949] Avg episode reward: [(0, '6077.007'), (1, '4479.757')] [2023-12-26 04:30:44,202][123091] Updated weights for policy 0, policy_version 616881 (0.0007) [2023-12-26 04:30:44,255][123091] Updated weights for policy 0, policy_version 616891 (0.0009) [2023-12-26 04:30:44,313][123091] Updated weights for policy 0, policy_version 616901 (0.0008) [2023-12-26 04:30:44,375][123091] Updated weights for policy 0, policy_version 616911 (0.0007) [2023-12-26 04:30:44,391][123090] Updated weights for policy 1, policy_version 612554 (0.0008) [2023-12-26 04:30:44,463][123090] Updated weights for policy 1, policy_version 612564 (0.0009) [2023-12-26 04:30:44,539][123090] Updated weights for policy 1, policy_version 612574 (0.0009) [2023-12-26 04:30:45,045][123091] Updated weights for policy 0, policy_version 616921 (0.0006) [2023-12-26 04:30:45,101][123091] Updated weights for policy 0, policy_version 616931 (0.0006) [2023-12-26 04:30:45,149][123091] Updated weights for policy 0, policy_version 616941 (0.0005) [2023-12-26 04:30:45,443][123090] Updated weights for policy 1, policy_version 612584 (0.0010) [2023-12-26 04:30:45,510][123090] Updated weights for policy 1, policy_version 612594 (0.0010) [2023-12-26 04:30:45,581][123090] Updated weights for policy 1, policy_version 612604 (0.0009) [2023-12-26 04:30:45,841][123091] Updated weights for policy 0, policy_version 616951 (0.0007) [2023-12-26 04:30:45,905][123091] Updated weights for policy 0, policy_version 616961 (0.0007) [2023-12-26 04:30:45,965][123091] Updated weights for policy 0, policy_version 616971 (0.0010) [2023-12-26 04:30:46,427][123090] Updated weights for policy 1, policy_version 612614 (0.0010) [2023-12-26 04:30:46,481][123090] Updated weights for policy 1, policy_version 612625 (0.0009) [2023-12-26 04:30:46,546][123090] Updated weights for policy 1, policy_version 612636 (0.0010) [2023-12-26 04:30:46,760][123091] Updated weights for policy 0, policy_version 616981 (0.0009) [2023-12-26 04:30:46,828][123091] Updated weights for policy 0, policy_version 616991 (0.0007) [2023-12-26 04:30:46,902][123091] Updated weights for policy 0, policy_version 617001 (0.0005) [2023-12-26 04:30:47,399][123090] Updated weights for policy 1, policy_version 612646 (0.0009) [2023-12-26 04:30:47,458][123090] Updated weights for policy 1, policy_version 612656 (0.0009) [2023-12-26 04:30:47,507][123090] Updated weights for policy 1, policy_version 612666 (0.0009) [2023-12-26 04:30:47,681][123091] Updated weights for policy 0, policy_version 617011 (0.0010) [2023-12-26 04:30:47,747][123091] Updated weights for policy 0, policy_version 617021 (0.0011) [2023-12-26 04:30:47,805][123091] Updated weights for policy 0, policy_version 617031 (0.0010) [2023-12-26 04:30:48,418][123090] Updated weights for policy 1, policy_version 612676 (0.0009) [2023-12-26 04:30:48,482][123090] Updated weights for policy 1, policy_version 612686 (0.0009) [2023-12-26 04:30:48,551][123091] Updated weights for policy 0, policy_version 617041 (0.0010) [2023-12-26 04:30:48,551][123090] Updated weights for policy 1, policy_version 612696 (0.0009) [2023-12-26 04:30:48,611][123091] Updated weights for policy 0, policy_version 617051 (0.0008) [2023-12-26 04:30:48,678][123091] Updated weights for policy 0, policy_version 617061 (0.0008) [2023-12-26 04:30:48,735][123091] Updated weights for policy 0, policy_version 617071 (0.0009) [2023-12-26 04:30:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 314826752. Throughput: 0: 9003.6, 1: 8721.5. Samples: 314833008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:48,784][121949] Avg episode reward: [(0, '6072.198'), (1, '4681.279')] [2023-12-26 04:30:49,405][123090] Updated weights for policy 1, policy_version 612706 (0.0009) [2023-12-26 04:30:49,457][123090] Updated weights for policy 1, policy_version 612716 (0.0009) [2023-12-26 04:30:49,509][123090] Updated weights for policy 1, policy_version 612726 (0.0010) [2023-12-26 04:30:49,569][123090] Updated weights for policy 1, policy_version 612736 (0.0009) [2023-12-26 04:30:49,586][123091] Updated weights for policy 0, policy_version 617081 (0.0009) [2023-12-26 04:30:49,638][123091] Updated weights for policy 0, policy_version 617091 (0.0009) [2023-12-26 04:30:49,692][123091] Updated weights for policy 0, policy_version 617101 (0.0009) [2023-12-26 04:30:50,473][123090] Updated weights for policy 1, policy_version 612746 (0.0006) [2023-12-26 04:30:50,509][123091] Updated weights for policy 0, policy_version 617111 (0.0007) [2023-12-26 04:30:50,546][123090] Updated weights for policy 1, policy_version 612756 (0.0008) [2023-12-26 04:30:50,586][123091] Updated weights for policy 0, policy_version 617121 (0.0007) [2023-12-26 04:30:50,611][123090] Updated weights for policy 1, policy_version 612766 (0.0008) [2023-12-26 04:30:50,657][123091] Updated weights for policy 0, policy_version 617131 (0.0006) [2023-12-26 04:30:51,366][123090] Updated weights for policy 1, policy_version 612776 (0.0009) [2023-12-26 04:30:51,396][123091] Updated weights for policy 0, policy_version 617141 (0.0010) [2023-12-26 04:30:51,434][123090] Updated weights for policy 1, policy_version 612786 (0.0009) [2023-12-26 04:30:51,462][123091] Updated weights for policy 0, policy_version 617151 (0.0012) [2023-12-26 04:30:51,501][123090] Updated weights for policy 1, policy_version 612796 (0.0010) [2023-12-26 04:30:51,530][123091] Updated weights for policy 0, policy_version 617161 (0.0011) [2023-12-26 04:30:52,259][123091] Updated weights for policy 0, policy_version 617171 (0.0010) [2023-12-26 04:30:52,322][123090] Updated weights for policy 1, policy_version 612806 (0.0009) [2023-12-26 04:30:52,323][123091] Updated weights for policy 0, policy_version 617181 (0.0011) [2023-12-26 04:30:52,390][123090] Updated weights for policy 1, policy_version 612816 (0.0009) [2023-12-26 04:30:52,392][123091] Updated weights for policy 0, policy_version 617191 (0.0011) [2023-12-26 04:30:52,456][123090] Updated weights for policy 1, policy_version 612826 (0.0007) [2023-12-26 04:30:53,091][123091] Updated weights for policy 0, policy_version 617201 (0.0011) [2023-12-26 04:30:53,093][123090] Updated weights for policy 1, policy_version 612836 (0.0006) [2023-12-26 04:30:53,161][123091] Updated weights for policy 0, policy_version 617211 (0.0009) [2023-12-26 04:30:53,163][123090] Updated weights for policy 1, policy_version 612846 (0.0005) [2023-12-26 04:30:53,223][123090] Updated weights for policy 1, policy_version 612856 (0.0005) [2023-12-26 04:30:53,225][123091] Updated weights for policy 0, policy_version 617221 (0.0009) [2023-12-26 04:30:53,297][123091] Updated weights for policy 0, policy_version 617231 (0.0005) [2023-12-26 04:30:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 314908672. Throughput: 0: 9015.4, 1: 8674.1. Samples: 314884796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:53,785][121949] Avg episode reward: [(0, '6159.002'), (1, '4401.092')] [2023-12-26 04:30:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000617232_158015488.pth... [2023-12-26 04:30:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000612864_156893184.pth... [2023-12-26 04:30:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000616176_157745152.pth [2023-12-26 04:30:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000611872_156639232.pth [2023-12-26 04:30:53,859][123090] Updated weights for policy 1, policy_version 612866 (0.0005) [2023-12-26 04:30:53,912][123090] Updated weights for policy 1, policy_version 612876 (0.0005) [2023-12-26 04:30:53,969][123090] Updated weights for policy 1, policy_version 612886 (0.0006) [2023-12-26 04:30:53,989][123091] Updated weights for policy 0, policy_version 617241 (0.0006) [2023-12-26 04:30:54,019][123090] Updated weights for policy 1, policy_version 612896 (0.0008) [2023-12-26 04:30:54,043][123091] Updated weights for policy 0, policy_version 617251 (0.0008) [2023-12-26 04:30:54,093][123091] Updated weights for policy 0, policy_version 617261 (0.0009) [2023-12-26 04:30:54,836][123091] Updated weights for policy 0, policy_version 617271 (0.0007) [2023-12-26 04:30:54,876][123090] Updated weights for policy 1, policy_version 612906 (0.0008) [2023-12-26 04:30:54,882][123091] Updated weights for policy 0, policy_version 617281 (0.0010) [2023-12-26 04:30:54,942][123090] Updated weights for policy 1, policy_version 612916 (0.0007) [2023-12-26 04:30:54,943][123091] Updated weights for policy 0, policy_version 617291 (0.0011) [2023-12-26 04:30:55,005][123090] Updated weights for policy 1, policy_version 612926 (0.0009) [2023-12-26 04:30:55,759][123091] Updated weights for policy 0, policy_version 617301 (0.0009) [2023-12-26 04:30:55,816][123091] Updated weights for policy 0, policy_version 617311 (0.0010) [2023-12-26 04:30:55,831][123090] Updated weights for policy 1, policy_version 612936 (0.0007) [2023-12-26 04:30:55,871][123091] Updated weights for policy 0, policy_version 617321 (0.0010) [2023-12-26 04:30:55,887][123090] Updated weights for policy 1, policy_version 612946 (0.0006) [2023-12-26 04:30:55,942][123090] Updated weights for policy 1, policy_version 612956 (0.0009) [2023-12-26 04:30:56,694][123091] Updated weights for policy 0, policy_version 617331 (0.0010) [2023-12-26 04:30:56,756][123091] Updated weights for policy 0, policy_version 617341 (0.0011) [2023-12-26 04:30:56,783][123090] Updated weights for policy 1, policy_version 612966 (0.0007) [2023-12-26 04:30:56,815][123091] Updated weights for policy 0, policy_version 617351 (0.0010) [2023-12-26 04:30:56,840][123090] Updated weights for policy 1, policy_version 612976 (0.0007) [2023-12-26 04:30:56,887][123090] Updated weights for policy 1, policy_version 612986 (0.0009) [2023-12-26 04:30:57,618][123091] Updated weights for policy 0, policy_version 617361 (0.0010) [2023-12-26 04:30:57,669][123091] Updated weights for policy 0, policy_version 617371 (0.0010) [2023-12-26 04:30:57,729][123091] Updated weights for policy 0, policy_version 617381 (0.0009) [2023-12-26 04:30:57,738][123090] Updated weights for policy 1, policy_version 612996 (0.0009) [2023-12-26 04:30:57,782][123091] Updated weights for policy 0, policy_version 617391 (0.0006) [2023-12-26 04:30:57,794][123090] Updated weights for policy 1, policy_version 613006 (0.0009) [2023-12-26 04:30:57,851][123090] Updated weights for policy 1, policy_version 613016 (0.0010) [2023-12-26 04:30:58,469][123091] Updated weights for policy 0, policy_version 617401 (0.0010) [2023-12-26 04:30:58,534][123091] Updated weights for policy 0, policy_version 617411 (0.0010) [2023-12-26 04:30:58,599][123091] Updated weights for policy 0, policy_version 617421 (0.0011) [2023-12-26 04:30:58,657][123090] Updated weights for policy 1, policy_version 613026 (0.0009) [2023-12-26 04:30:58,722][123090] Updated weights for policy 1, policy_version 613036 (0.0009) [2023-12-26 04:30:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 314998784. Throughput: 0: 9078.4, 1: 8683.2. Samples: 314994632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:30:58,785][121949] Avg episode reward: [(0, '6132.150'), (1, '4540.033')] [2023-12-26 04:30:58,797][123090] Updated weights for policy 1, policy_version 613046 (0.0008) [2023-12-26 04:30:58,871][123090] Updated weights for policy 1, policy_version 613056 (0.0009) [2023-12-26 04:30:59,458][123091] Updated weights for policy 0, policy_version 617431 (0.0005) [2023-12-26 04:30:59,529][123091] Updated weights for policy 0, policy_version 617441 (0.0006) [2023-12-26 04:30:59,593][123091] Updated weights for policy 0, policy_version 617451 (0.0009) [2023-12-26 04:30:59,730][123090] Updated weights for policy 1, policy_version 613066 (0.0011) [2023-12-26 04:30:59,785][123090] Updated weights for policy 1, policy_version 613076 (0.0008) [2023-12-26 04:30:59,855][123090] Updated weights for policy 1, policy_version 613086 (0.0010) [2023-12-26 04:31:00,324][123091] Updated weights for policy 0, policy_version 617461 (0.0011) [2023-12-26 04:31:00,386][123091] Updated weights for policy 0, policy_version 617471 (0.0011) [2023-12-26 04:31:00,449][123091] Updated weights for policy 0, policy_version 617481 (0.0010) [2023-12-26 04:31:00,597][123090] Updated weights for policy 1, policy_version 613096 (0.0007) [2023-12-26 04:31:00,651][123090] Updated weights for policy 1, policy_version 613106 (0.0009) [2023-12-26 04:31:00,701][123090] Updated weights for policy 1, policy_version 613116 (0.0009) [2023-12-26 04:31:01,232][123091] Updated weights for policy 0, policy_version 617491 (0.0011) [2023-12-26 04:31:01,303][123091] Updated weights for policy 0, policy_version 617501 (0.0011) [2023-12-26 04:31:01,369][123091] Updated weights for policy 0, policy_version 617511 (0.0011) [2023-12-26 04:31:01,575][123090] Updated weights for policy 1, policy_version 613126 (0.0009) [2023-12-26 04:31:01,643][123090] Updated weights for policy 1, policy_version 613136 (0.0009) [2023-12-26 04:31:01,711][123090] Updated weights for policy 1, policy_version 613146 (0.0009) [2023-12-26 04:31:02,203][123091] Updated weights for policy 0, policy_version 617521 (0.0010) [2023-12-26 04:31:02,272][123091] Updated weights for policy 0, policy_version 617531 (0.0007) [2023-12-26 04:31:02,343][123091] Updated weights for policy 0, policy_version 617541 (0.0007) [2023-12-26 04:31:02,409][123091] Updated weights for policy 0, policy_version 617551 (0.0009) [2023-12-26 04:31:02,523][123090] Updated weights for policy 1, policy_version 613156 (0.0009) [2023-12-26 04:31:02,572][123090] Updated weights for policy 1, policy_version 613166 (0.0009) [2023-12-26 04:31:02,621][123090] Updated weights for policy 1, policy_version 613176 (0.0009) [2023-12-26 04:31:03,229][123091] Updated weights for policy 0, policy_version 617561 (0.0011) [2023-12-26 04:31:03,281][123091] Updated weights for policy 0, policy_version 617571 (0.0011) [2023-12-26 04:31:03,330][123091] Updated weights for policy 0, policy_version 617581 (0.0011) [2023-12-26 04:31:03,510][123090] Updated weights for policy 1, policy_version 613186 (0.0009) [2023-12-26 04:31:03,568][123090] Updated weights for policy 1, policy_version 613196 (0.0008) [2023-12-26 04:31:03,624][123090] Updated weights for policy 1, policy_version 613206 (0.0008) [2023-12-26 04:31:03,690][123090] Updated weights for policy 1, policy_version 613216 (0.0011) [2023-12-26 04:31:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 315088896. Throughput: 0: 9017.9, 1: 8636.2. Samples: 315096628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:03,785][121949] Avg episode reward: [(0, '6101.669'), (1, '4603.206')] [2023-12-26 04:31:04,194][123091] Updated weights for policy 0, policy_version 617591 (0.0011) [2023-12-26 04:31:04,263][123091] Updated weights for policy 0, policy_version 617601 (0.0011) [2023-12-26 04:31:04,336][123091] Updated weights for policy 0, policy_version 617611 (0.0011) [2023-12-26 04:31:04,561][123090] Updated weights for policy 1, policy_version 613226 (0.0011) [2023-12-26 04:31:04,623][123090] Updated weights for policy 1, policy_version 613236 (0.0007) [2023-12-26 04:31:04,686][123090] Updated weights for policy 1, policy_version 613246 (0.0006) [2023-12-26 04:31:05,129][123091] Updated weights for policy 0, policy_version 617621 (0.0008) [2023-12-26 04:31:05,179][123091] Updated weights for policy 0, policy_version 617631 (0.0005) [2023-12-26 04:31:05,232][123091] Updated weights for policy 0, policy_version 617641 (0.0005) [2023-12-26 04:31:05,495][123090] Updated weights for policy 1, policy_version 613256 (0.0009) [2023-12-26 04:31:05,555][123090] Updated weights for policy 1, policy_version 613266 (0.0010) [2023-12-26 04:31:05,618][123090] Updated weights for policy 1, policy_version 613276 (0.0010) [2023-12-26 04:31:05,999][123091] Updated weights for policy 0, policy_version 617651 (0.0007) [2023-12-26 04:31:06,066][123091] Updated weights for policy 0, policy_version 617661 (0.0011) [2023-12-26 04:31:06,133][123091] Updated weights for policy 0, policy_version 617671 (0.0008) [2023-12-26 04:31:06,466][123090] Updated weights for policy 1, policy_version 613286 (0.0010) [2023-12-26 04:31:06,531][123090] Updated weights for policy 1, policy_version 613296 (0.0010) [2023-12-26 04:31:06,599][123090] Updated weights for policy 1, policy_version 613306 (0.0010) [2023-12-26 04:31:06,915][123091] Updated weights for policy 0, policy_version 617681 (0.0008) [2023-12-26 04:31:06,984][123091] Updated weights for policy 0, policy_version 617691 (0.0011) [2023-12-26 04:31:07,053][123091] Updated weights for policy 0, policy_version 617701 (0.0011) [2023-12-26 04:31:07,125][123091] Updated weights for policy 0, policy_version 617711 (0.0011) [2023-12-26 04:31:07,435][123090] Updated weights for policy 1, policy_version 613316 (0.0008) [2023-12-26 04:31:07,492][123090] Updated weights for policy 1, policy_version 613326 (0.0011) [2023-12-26 04:31:07,549][123090] Updated weights for policy 1, policy_version 613336 (0.0011) [2023-12-26 04:31:07,936][123091] Updated weights for policy 0, policy_version 617721 (0.0011) [2023-12-26 04:31:08,002][123091] Updated weights for policy 0, policy_version 617731 (0.0010) [2023-12-26 04:31:08,060][123091] Updated weights for policy 0, policy_version 617741 (0.0006) [2023-12-26 04:31:08,389][123090] Updated weights for policy 1, policy_version 613346 (0.0011) [2023-12-26 04:31:08,457][123090] Updated weights for policy 1, policy_version 613356 (0.0011) [2023-12-26 04:31:08,522][123090] Updated weights for policy 1, policy_version 613366 (0.0011) [2023-12-26 04:31:08,590][123090] Updated weights for policy 1, policy_version 613376 (0.0010) [2023-12-26 04:31:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 315170816. Throughput: 0: 9051.2, 1: 8615.9. Samples: 315147824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:08,785][121949] Avg episode reward: [(0, '6058.174'), (1, '4219.628')] [2023-12-26 04:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000617744_158146560.pth... [2023-12-26 04:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000613376_157024256.pth... [2023-12-26 04:31:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000616720_157884416.pth [2023-12-26 04:31:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000612384_156770304.pth [2023-12-26 04:31:08,874][123091] Updated weights for policy 0, policy_version 617751 (0.0007) [2023-12-26 04:31:08,937][123091] Updated weights for policy 0, policy_version 617761 (0.0008) [2023-12-26 04:31:09,008][123091] Updated weights for policy 0, policy_version 617771 (0.0006) [2023-12-26 04:31:09,455][123090] Updated weights for policy 1, policy_version 613386 (0.0009) [2023-12-26 04:31:09,529][123090] Updated weights for policy 1, policy_version 613396 (0.0006) [2023-12-26 04:31:09,598][123090] Updated weights for policy 1, policy_version 613406 (0.0005) [2023-12-26 04:31:09,830][123091] Updated weights for policy 0, policy_version 617781 (0.0008) [2023-12-26 04:31:09,894][123091] Updated weights for policy 0, policy_version 617791 (0.0009) [2023-12-26 04:31:09,963][123091] Updated weights for policy 0, policy_version 617801 (0.0009) [2023-12-26 04:31:10,384][123090] Updated weights for policy 1, policy_version 613416 (0.0009) [2023-12-26 04:31:10,445][123090] Updated weights for policy 1, policy_version 613426 (0.0009) [2023-12-26 04:31:10,498][123090] Updated weights for policy 1, policy_version 613436 (0.0009) [2023-12-26 04:31:10,784][123091] Updated weights for policy 0, policy_version 617811 (0.0010) [2023-12-26 04:31:10,837][123091] Updated weights for policy 0, policy_version 617821 (0.0009) [2023-12-26 04:31:10,894][123091] Updated weights for policy 0, policy_version 617831 (0.0009) [2023-12-26 04:31:11,383][123090] Updated weights for policy 1, policy_version 613446 (0.0010) [2023-12-26 04:31:11,446][123090] Updated weights for policy 1, policy_version 613456 (0.0011) [2023-12-26 04:31:11,507][123090] Updated weights for policy 1, policy_version 613466 (0.0011) [2023-12-26 04:31:11,836][123091] Updated weights for policy 0, policy_version 617841 (0.0008) [2023-12-26 04:31:11,908][123091] Updated weights for policy 0, policy_version 617851 (0.0006) [2023-12-26 04:31:11,983][123091] Updated weights for policy 0, policy_version 617861 (0.0007) [2023-12-26 04:31:12,054][123091] Updated weights for policy 0, policy_version 617871 (0.0008) [2023-12-26 04:31:12,377][123090] Updated weights for policy 1, policy_version 613476 (0.0010) [2023-12-26 04:31:12,440][123090] Updated weights for policy 1, policy_version 613486 (0.0011) [2023-12-26 04:31:12,508][123090] Updated weights for policy 1, policy_version 613496 (0.0011) [2023-12-26 04:31:12,876][123091] Updated weights for policy 0, policy_version 617881 (0.0006) [2023-12-26 04:31:12,951][123091] Updated weights for policy 0, policy_version 617891 (0.0011) [2023-12-26 04:31:13,023][123091] Updated weights for policy 0, policy_version 617901 (0.0010) [2023-12-26 04:31:13,274][123090] Updated weights for policy 1, policy_version 613506 (0.0010) [2023-12-26 04:31:13,340][123090] Updated weights for policy 1, policy_version 613516 (0.0005) [2023-12-26 04:31:13,387][123090] Updated weights for policy 1, policy_version 613526 (0.0005) [2023-12-26 04:31:13,437][123090] Updated weights for policy 1, policy_version 613536 (0.0005) [2023-12-26 04:31:13,781][123091] Updated weights for policy 0, policy_version 617911 (0.0007) [2023-12-26 04:31:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 315252736. Throughput: 0: 8886.3, 1: 8536.8. Samples: 315247636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:13,785][121949] Avg episode reward: [(0, '6021.964'), (1, '3908.101')] [2023-12-26 04:31:13,839][123091] Updated weights for policy 0, policy_version 617921 (0.0005) [2023-12-26 04:31:13,886][123091] Updated weights for policy 0, policy_version 617931 (0.0005) [2023-12-26 04:31:14,156][123090] Updated weights for policy 1, policy_version 613546 (0.0005) [2023-12-26 04:31:14,213][123090] Updated weights for policy 1, policy_version 613556 (0.0005) [2023-12-26 04:31:14,277][123090] Updated weights for policy 1, policy_version 613566 (0.0006) [2023-12-26 04:31:14,712][123091] Updated weights for policy 0, policy_version 617941 (0.0006) [2023-12-26 04:31:14,765][123091] Updated weights for policy 0, policy_version 617951 (0.0006) [2023-12-26 04:31:14,826][123091] Updated weights for policy 0, policy_version 617961 (0.0007) [2023-12-26 04:31:15,071][123090] Updated weights for policy 1, policy_version 613576 (0.0006) [2023-12-26 04:31:15,129][123090] Updated weights for policy 1, policy_version 613586 (0.0006) [2023-12-26 04:31:15,194][123090] Updated weights for policy 1, policy_version 613596 (0.0009) [2023-12-26 04:31:15,671][123091] Updated weights for policy 0, policy_version 617971 (0.0009) [2023-12-26 04:31:15,726][123091] Updated weights for policy 0, policy_version 617982 (0.0010) [2023-12-26 04:31:15,784][123091] Updated weights for policy 0, policy_version 617992 (0.0010) [2023-12-26 04:31:15,910][123090] Updated weights for policy 1, policy_version 613606 (0.0009) [2023-12-26 04:31:15,962][123090] Updated weights for policy 1, policy_version 613616 (0.0009) [2023-12-26 04:31:16,015][123090] Updated weights for policy 1, policy_version 613626 (0.0009) [2023-12-26 04:31:16,565][123091] Updated weights for policy 0, policy_version 618002 (0.0009) [2023-12-26 04:31:16,613][123091] Updated weights for policy 0, policy_version 618012 (0.0007) [2023-12-26 04:31:16,657][123091] Updated weights for policy 0, policy_version 618022 (0.0010) [2023-12-26 04:31:16,698][123090] Updated weights for policy 1, policy_version 613636 (0.0008) [2023-12-26 04:31:16,708][123091] Updated weights for policy 0, policy_version 618032 (0.0010) [2023-12-26 04:31:16,753][123090] Updated weights for policy 1, policy_version 613646 (0.0008) [2023-12-26 04:31:16,821][123090] Updated weights for policy 1, policy_version 613656 (0.0008) [2023-12-26 04:31:17,385][123091] Updated weights for policy 0, policy_version 618042 (0.0005) [2023-12-26 04:31:17,449][123091] Updated weights for policy 0, policy_version 618052 (0.0005) [2023-12-26 04:31:17,513][123091] Updated weights for policy 0, policy_version 618062 (0.0010) [2023-12-26 04:31:17,685][123090] Updated weights for policy 1, policy_version 613666 (0.0009) [2023-12-26 04:31:17,742][123090] Updated weights for policy 1, policy_version 613676 (0.0008) [2023-12-26 04:31:17,799][123090] Updated weights for policy 1, policy_version 613686 (0.0008) [2023-12-26 04:31:17,859][123090] Updated weights for policy 1, policy_version 613696 (0.0009) [2023-12-26 04:31:18,264][123091] Updated weights for policy 0, policy_version 618072 (0.0009) [2023-12-26 04:31:18,329][123091] Updated weights for policy 0, policy_version 618082 (0.0010) [2023-12-26 04:31:18,398][123091] Updated weights for policy 0, policy_version 618092 (0.0010) [2023-12-26 04:31:18,747][123090] Updated weights for policy 1, policy_version 613706 (0.0009) [2023-12-26 04:31:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 315342848. Throughput: 0: 8934.2, 1: 8553.7. Samples: 315356252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:18,785][121949] Avg episode reward: [(0, '6079.295'), (1, '4306.412')] [2023-12-26 04:31:18,819][123090] Updated weights for policy 1, policy_version 613716 (0.0009) [2023-12-26 04:31:18,882][123090] Updated weights for policy 1, policy_version 613726 (0.0010) [2023-12-26 04:31:19,265][123091] Updated weights for policy 0, policy_version 618102 (0.0007) [2023-12-26 04:31:19,322][123091] Updated weights for policy 0, policy_version 618112 (0.0006) [2023-12-26 04:31:19,392][123091] Updated weights for policy 0, policy_version 618122 (0.0007) [2023-12-26 04:31:19,752][123090] Updated weights for policy 1, policy_version 613736 (0.0010) [2023-12-26 04:31:19,806][123090] Updated weights for policy 1, policy_version 613746 (0.0010) [2023-12-26 04:31:19,877][123090] Updated weights for policy 1, policy_version 613756 (0.0010) [2023-12-26 04:31:20,142][123091] Updated weights for policy 0, policy_version 618132 (0.0007) [2023-12-26 04:31:20,194][123091] Updated weights for policy 0, policy_version 618142 (0.0009) [2023-12-26 04:31:20,251][123091] Updated weights for policy 0, policy_version 618152 (0.0009) [2023-12-26 04:31:20,701][123090] Updated weights for policy 1, policy_version 613766 (0.0006) [2023-12-26 04:31:20,769][123090] Updated weights for policy 1, policy_version 613776 (0.0006) [2023-12-26 04:31:20,841][123090] Updated weights for policy 1, policy_version 613786 (0.0007) [2023-12-26 04:31:21,062][123091] Updated weights for policy 0, policy_version 618162 (0.0009) [2023-12-26 04:31:21,130][123091] Updated weights for policy 0, policy_version 618172 (0.0009) [2023-12-26 04:31:21,184][123091] Updated weights for policy 0, policy_version 618182 (0.0010) [2023-12-26 04:31:21,238][123091] Updated weights for policy 0, policy_version 618192 (0.0010) [2023-12-26 04:31:21,659][123090] Updated weights for policy 1, policy_version 613796 (0.0009) [2023-12-26 04:31:21,724][123090] Updated weights for policy 1, policy_version 613806 (0.0011) [2023-12-26 04:31:21,791][123090] Updated weights for policy 1, policy_version 613816 (0.0009) [2023-12-26 04:31:22,218][123091] Updated weights for policy 0, policy_version 618202 (0.0009) [2023-12-26 04:31:22,284][123091] Updated weights for policy 0, policy_version 618212 (0.0009) [2023-12-26 04:31:22,352][123091] Updated weights for policy 0, policy_version 618222 (0.0008) [2023-12-26 04:31:22,602][123090] Updated weights for policy 1, policy_version 613826 (0.0006) [2023-12-26 04:31:22,658][123090] Updated weights for policy 1, policy_version 613836 (0.0010) [2023-12-26 04:31:22,718][123090] Updated weights for policy 1, policy_version 613846 (0.0011) [2023-12-26 04:31:22,774][123090] Updated weights for policy 1, policy_version 613856 (0.0010) [2023-12-26 04:31:23,108][123091] Updated weights for policy 0, policy_version 618232 (0.0008) [2023-12-26 04:31:23,173][123091] Updated weights for policy 0, policy_version 618242 (0.0009) [2023-12-26 04:31:23,241][123091] Updated weights for policy 0, policy_version 618252 (0.0005) [2023-12-26 04:31:23,619][123090] Updated weights for policy 1, policy_version 613866 (0.0010) [2023-12-26 04:31:23,670][123090] Updated weights for policy 1, policy_version 613876 (0.0010) [2023-12-26 04:31:23,722][123090] Updated weights for policy 1, policy_version 613886 (0.0010) [2023-12-26 04:31:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 315432960. Throughput: 0: 8879.7, 1: 8529.0. Samples: 315407600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:23,785][121949] Avg episode reward: [(0, '5993.121'), (1, '5009.362')] [2023-12-26 04:31:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000613888_157155328.pth... [2023-12-26 04:31:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000618256_158277632.pth... [2023-12-26 04:31:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000612864_156893184.pth [2023-12-26 04:31:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000617232_158015488.pth [2023-12-26 04:31:23,964][123091] Updated weights for policy 0, policy_version 618262 (0.0007) [2023-12-26 04:31:24,027][123091] Updated weights for policy 0, policy_version 618272 (0.0009) [2023-12-26 04:31:24,087][123091] Updated weights for policy 0, policy_version 618282 (0.0009) [2023-12-26 04:31:24,570][123090] Updated weights for policy 1, policy_version 613896 (0.0011) [2023-12-26 04:31:24,626][123090] Updated weights for policy 1, policy_version 613906 (0.0010) [2023-12-26 04:31:24,689][123090] Updated weights for policy 1, policy_version 613916 (0.0010) [2023-12-26 04:31:24,890][123091] Updated weights for policy 0, policy_version 618292 (0.0009) [2023-12-26 04:31:24,942][123091] Updated weights for policy 0, policy_version 618302 (0.0008) [2023-12-26 04:31:25,001][123091] Updated weights for policy 0, policy_version 618312 (0.0008) [2023-12-26 04:31:25,502][123090] Updated weights for policy 1, policy_version 613926 (0.0010) [2023-12-26 04:31:25,553][123090] Updated weights for policy 1, policy_version 613936 (0.0010) [2023-12-26 04:31:25,604][123090] Updated weights for policy 1, policy_version 613946 (0.0010) [2023-12-26 04:31:25,700][123091] Updated weights for policy 0, policy_version 618322 (0.0006) [2023-12-26 04:31:25,753][123091] Updated weights for policy 0, policy_version 618332 (0.0009) [2023-12-26 04:31:25,800][123091] Updated weights for policy 0, policy_version 618342 (0.0009) [2023-12-26 04:31:25,852][123091] Updated weights for policy 0, policy_version 618352 (0.0009) [2023-12-26 04:31:26,444][123090] Updated weights for policy 1, policy_version 613956 (0.0010) [2023-12-26 04:31:26,499][123090] Updated weights for policy 1, policy_version 613966 (0.0010) [2023-12-26 04:31:26,554][123090] Updated weights for policy 1, policy_version 613976 (0.0010) [2023-12-26 04:31:26,636][123091] Updated weights for policy 0, policy_version 618362 (0.0006) [2023-12-26 04:31:26,692][123091] Updated weights for policy 0, policy_version 618372 (0.0006) [2023-12-26 04:31:26,747][123091] Updated weights for policy 0, policy_version 618382 (0.0005) [2023-12-26 04:31:27,331][123090] Updated weights for policy 1, policy_version 613986 (0.0009) [2023-12-26 04:31:27,383][123090] Updated weights for policy 1, policy_version 613996 (0.0005) [2023-12-26 04:31:27,433][123090] Updated weights for policy 1, policy_version 614006 (0.0005) [2023-12-26 04:31:27,466][123091] Updated weights for policy 0, policy_version 618392 (0.0006) [2023-12-26 04:31:27,486][123090] Updated weights for policy 1, policy_version 614016 (0.0005) [2023-12-26 04:31:27,542][123091] Updated weights for policy 0, policy_version 618402 (0.0007) [2023-12-26 04:31:27,617][123091] Updated weights for policy 0, policy_version 618412 (0.0008) [2023-12-26 04:31:28,137][123090] Updated weights for policy 1, policy_version 614026 (0.0010) [2023-12-26 04:31:28,196][123090] Updated weights for policy 1, policy_version 614036 (0.0010) [2023-12-26 04:31:28,196][123091] Updated weights for policy 0, policy_version 618422 (0.0008) [2023-12-26 04:31:28,254][123090] Updated weights for policy 1, policy_version 614046 (0.0010) [2023-12-26 04:31:28,258][123091] Updated weights for policy 0, policy_version 618432 (0.0005) [2023-12-26 04:31:28,322][123091] Updated weights for policy 0, policy_version 618442 (0.0006) [2023-12-26 04:31:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 315523072. Throughput: 0: 8911.7, 1: 8589.8. Samples: 315515648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:28,785][121949] Avg episode reward: [(0, '6057.226'), (1, '5289.533')] [2023-12-26 04:31:28,996][123090] Updated weights for policy 1, policy_version 614056 (0.0009) [2023-12-26 04:31:29,050][123090] Updated weights for policy 1, policy_version 614066 (0.0010) [2023-12-26 04:31:29,101][123090] Updated weights for policy 1, policy_version 614076 (0.0010) [2023-12-26 04:31:29,154][123091] Updated weights for policy 0, policy_version 618452 (0.0008) [2023-12-26 04:31:29,220][123091] Updated weights for policy 0, policy_version 618462 (0.0006) [2023-12-26 04:31:29,281][123091] Updated weights for policy 0, policy_version 618472 (0.0007) [2023-12-26 04:31:29,959][123090] Updated weights for policy 1, policy_version 614086 (0.0010) [2023-12-26 04:31:30,022][123090] Updated weights for policy 1, policy_version 614096 (0.0010) [2023-12-26 04:31:30,085][123090] Updated weights for policy 1, policy_version 614106 (0.0010) [2023-12-26 04:31:30,091][123091] Updated weights for policy 0, policy_version 618482 (0.0007) [2023-12-26 04:31:30,149][123091] Updated weights for policy 0, policy_version 618492 (0.0007) [2023-12-26 04:31:30,213][123091] Updated weights for policy 0, policy_version 618502 (0.0009) [2023-12-26 04:31:30,276][123091] Updated weights for policy 0, policy_version 618512 (0.0008) [2023-12-26 04:31:30,897][123090] Updated weights for policy 1, policy_version 614116 (0.0010) [2023-12-26 04:31:30,951][123090] Updated weights for policy 1, policy_version 614126 (0.0010) [2023-12-26 04:31:30,998][123090] Updated weights for policy 1, policy_version 614136 (0.0010) [2023-12-26 04:31:31,088][123091] Updated weights for policy 0, policy_version 618522 (0.0007) [2023-12-26 04:31:31,147][123091] Updated weights for policy 0, policy_version 618532 (0.0007) [2023-12-26 04:31:31,205][123091] Updated weights for policy 0, policy_version 618542 (0.0009) [2023-12-26 04:31:31,870][123090] Updated weights for policy 1, policy_version 614146 (0.0009) [2023-12-26 04:31:31,944][123090] Updated weights for policy 1, policy_version 614156 (0.0011) [2023-12-26 04:31:32,004][123090] Updated weights for policy 1, policy_version 614166 (0.0011) [2023-12-26 04:31:32,012][123091] Updated weights for policy 0, policy_version 618552 (0.0007) [2023-12-26 04:31:32,060][123090] Updated weights for policy 1, policy_version 614176 (0.0010) [2023-12-26 04:31:32,075][123091] Updated weights for policy 0, policy_version 618562 (0.0006) [2023-12-26 04:31:32,135][123091] Updated weights for policy 0, policy_version 618572 (0.0009) [2023-12-26 04:31:32,883][123090] Updated weights for policy 1, policy_version 614186 (0.0010) [2023-12-26 04:31:32,948][123090] Updated weights for policy 1, policy_version 614196 (0.0010) [2023-12-26 04:31:32,975][123091] Updated weights for policy 0, policy_version 618582 (0.0010) [2023-12-26 04:31:32,999][123090] Updated weights for policy 1, policy_version 614206 (0.0010) [2023-12-26 04:31:33,023][123091] Updated weights for policy 0, policy_version 618592 (0.0010) [2023-12-26 04:31:33,071][123091] Updated weights for policy 0, policy_version 618602 (0.0010) [2023-12-26 04:31:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 315604992. Throughput: 0: 8860.6, 1: 8686.8. Samples: 315622644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:33,785][121949] Avg episode reward: [(0, '6189.022'), (1, '5433.911')] [2023-12-26 04:31:33,807][123090] Updated weights for policy 1, policy_version 614216 (0.0010) [2023-12-26 04:31:33,843][123091] Updated weights for policy 0, policy_version 618612 (0.0010) [2023-12-26 04:31:33,854][123090] Updated weights for policy 1, policy_version 614226 (0.0010) [2023-12-26 04:31:33,900][123091] Updated weights for policy 0, policy_version 618622 (0.0008) [2023-12-26 04:31:33,902][123090] Updated weights for policy 1, policy_version 614236 (0.0010) [2023-12-26 04:31:33,955][123091] Updated weights for policy 0, policy_version 618632 (0.0008) [2023-12-26 04:31:34,775][123090] Updated weights for policy 1, policy_version 614246 (0.0011) [2023-12-26 04:31:34,837][123090] Updated weights for policy 1, policy_version 614256 (0.0011) [2023-12-26 04:31:34,861][123091] Updated weights for policy 0, policy_version 618642 (0.0009) [2023-12-26 04:31:34,902][123090] Updated weights for policy 1, policy_version 614266 (0.0011) [2023-12-26 04:31:34,918][123091] Updated weights for policy 0, policy_version 618652 (0.0010) [2023-12-26 04:31:34,966][123091] Updated weights for policy 0, policy_version 618662 (0.0006) [2023-12-26 04:31:35,016][123091] Updated weights for policy 0, policy_version 618672 (0.0005) [2023-12-26 04:31:35,731][123090] Updated weights for policy 1, policy_version 614276 (0.0010) [2023-12-26 04:31:35,732][123091] Updated weights for policy 0, policy_version 618683 (0.0007) [2023-12-26 04:31:35,776][123091] Updated weights for policy 0, policy_version 618693 (0.0006) [2023-12-26 04:31:35,791][123090] Updated weights for policy 1, policy_version 614286 (0.0010) [2023-12-26 04:31:35,826][123091] Updated weights for policy 0, policy_version 618703 (0.0007) [2023-12-26 04:31:35,854][123090] Updated weights for policy 1, policy_version 614296 (0.0010) [2023-12-26 04:31:36,594][123091] Updated weights for policy 0, policy_version 618713 (0.0006) [2023-12-26 04:31:36,661][123091] Updated weights for policy 0, policy_version 618723 (0.0006) [2023-12-26 04:31:36,717][123090] Updated weights for policy 1, policy_version 614306 (0.0010) [2023-12-26 04:31:36,722][123091] Updated weights for policy 0, policy_version 618733 (0.0007) [2023-12-26 04:31:36,789][123090] Updated weights for policy 1, policy_version 614316 (0.0010) [2023-12-26 04:31:36,858][123090] Updated weights for policy 1, policy_version 614326 (0.0007) [2023-12-26 04:31:36,923][123090] Updated weights for policy 1, policy_version 614336 (0.0005) [2023-12-26 04:31:37,513][123091] Updated weights for policy 0, policy_version 618743 (0.0009) [2023-12-26 04:31:37,574][123091] Updated weights for policy 0, policy_version 618753 (0.0006) [2023-12-26 04:31:37,580][123090] Updated weights for policy 1, policy_version 614346 (0.0010) [2023-12-26 04:31:37,632][123091] Updated weights for policy 0, policy_version 618763 (0.0006) [2023-12-26 04:31:37,640][123090] Updated weights for policy 1, policy_version 614356 (0.0010) [2023-12-26 04:31:37,692][123090] Updated weights for policy 1, policy_version 614366 (0.0010) [2023-12-26 04:31:38,352][123091] Updated weights for policy 0, policy_version 618773 (0.0006) [2023-12-26 04:31:38,408][123091] Updated weights for policy 0, policy_version 618783 (0.0007) [2023-12-26 04:31:38,467][123091] Updated weights for policy 0, policy_version 618793 (0.0008) [2023-12-26 04:31:38,531][123090] Updated weights for policy 1, policy_version 614376 (0.0008) [2023-12-26 04:31:38,577][123090] Updated weights for policy 1, policy_version 614386 (0.0008) [2023-12-26 04:31:38,641][123090] Updated weights for policy 1, policy_version 614396 (0.0009) [2023-12-26 04:31:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 315703296. Throughput: 0: 8890.8, 1: 8674.0. Samples: 315675216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:38,785][121949] Avg episode reward: [(0, '6103.984'), (1, '5390.366')] [2023-12-26 04:31:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000614400_157286400.pth... [2023-12-26 04:31:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000618800_158416896.pth... [2023-12-26 04:31:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000613376_157024256.pth [2023-12-26 04:31:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000617744_158146560.pth [2023-12-26 04:31:39,312][123091] Updated weights for policy 0, policy_version 618803 (0.0010) [2023-12-26 04:31:39,379][123091] Updated weights for policy 0, policy_version 618813 (0.0009) [2023-12-26 04:31:39,454][123091] Updated weights for policy 0, policy_version 618823 (0.0008) [2023-12-26 04:31:39,521][123090] Updated weights for policy 1, policy_version 614406 (0.0007) [2023-12-26 04:31:39,588][123090] Updated weights for policy 1, policy_version 614416 (0.0010) [2023-12-26 04:31:39,647][123090] Updated weights for policy 1, policy_version 614426 (0.0009) [2023-12-26 04:31:40,304][123091] Updated weights for policy 0, policy_version 618833 (0.0009) [2023-12-26 04:31:40,370][123091] Updated weights for policy 0, policy_version 618843 (0.0010) [2023-12-26 04:31:40,427][123090] Updated weights for policy 1, policy_version 614436 (0.0008) [2023-12-26 04:31:40,435][123091] Updated weights for policy 0, policy_version 618853 (0.0009) [2023-12-26 04:31:40,497][123090] Updated weights for policy 1, policy_version 614446 (0.0009) [2023-12-26 04:31:40,497][123091] Updated weights for policy 0, policy_version 618863 (0.0009) [2023-12-26 04:31:40,556][123090] Updated weights for policy 1, policy_version 614456 (0.0010) [2023-12-26 04:31:41,278][123090] Updated weights for policy 1, policy_version 614466 (0.0009) [2023-12-26 04:31:41,314][123091] Updated weights for policy 0, policy_version 618873 (0.0009) [2023-12-26 04:31:41,346][123090] Updated weights for policy 1, policy_version 614476 (0.0007) [2023-12-26 04:31:41,384][123091] Updated weights for policy 0, policy_version 618883 (0.0010) [2023-12-26 04:31:41,426][123090] Updated weights for policy 1, policy_version 614486 (0.0009) [2023-12-26 04:31:41,452][123091] Updated weights for policy 0, policy_version 618893 (0.0008) [2023-12-26 04:31:41,485][123090] Updated weights for policy 1, policy_version 614496 (0.0009) [2023-12-26 04:31:42,167][123091] Updated weights for policy 0, policy_version 618903 (0.0007) [2023-12-26 04:31:42,221][123091] Updated weights for policy 0, policy_version 618914 (0.0009) [2023-12-26 04:31:42,283][123091] Updated weights for policy 0, policy_version 618924 (0.0009) [2023-12-26 04:31:42,334][123090] Updated weights for policy 1, policy_version 614506 (0.0008) [2023-12-26 04:31:42,408][123090] Updated weights for policy 1, policy_version 614516 (0.0009) [2023-12-26 04:31:42,470][123090] Updated weights for policy 1, policy_version 614526 (0.0009) [2023-12-26 04:31:43,141][123091] Updated weights for policy 0, policy_version 618934 (0.0009) [2023-12-26 04:31:43,204][123091] Updated weights for policy 0, policy_version 618944 (0.0007) [2023-12-26 04:31:43,276][123091] Updated weights for policy 0, policy_version 618954 (0.0009) [2023-12-26 04:31:43,298][123090] Updated weights for policy 1, policy_version 614536 (0.0005) [2023-12-26 04:31:43,369][123090] Updated weights for policy 1, policy_version 614546 (0.0005) [2023-12-26 04:31:43,427][123090] Updated weights for policy 1, policy_version 614556 (0.0005) [2023-12-26 04:31:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 315785216. Throughput: 0: 8805.4, 1: 8645.5. Samples: 315779924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:43,785][121949] Avg episode reward: [(0, '6144.272'), (1, '5230.411')] [2023-12-26 04:31:44,072][123091] Updated weights for policy 0, policy_version 618964 (0.0008) [2023-12-26 04:31:44,128][123091] Updated weights for policy 0, policy_version 618974 (0.0006) [2023-12-26 04:31:44,138][123090] Updated weights for policy 1, policy_version 614566 (0.0010) [2023-12-26 04:31:44,175][123091] Updated weights for policy 0, policy_version 618984 (0.0005) [2023-12-26 04:31:44,191][123090] Updated weights for policy 1, policy_version 614577 (0.0008) [2023-12-26 04:31:44,239][123090] Updated weights for policy 1, policy_version 614587 (0.0010) [2023-12-26 04:31:44,849][123091] Updated weights for policy 0, policy_version 618994 (0.0006) [2023-12-26 04:31:44,916][123091] Updated weights for policy 0, policy_version 619004 (0.0011) [2023-12-26 04:31:44,979][123091] Updated weights for policy 0, policy_version 619014 (0.0011) [2023-12-26 04:31:45,040][123091] Updated weights for policy 0, policy_version 619024 (0.0010) [2023-12-26 04:31:45,097][123090] Updated weights for policy 1, policy_version 614597 (0.0008) [2023-12-26 04:31:45,163][123090] Updated weights for policy 1, policy_version 614607 (0.0006) [2023-12-26 04:31:45,217][123090] Updated weights for policy 1, policy_version 614617 (0.0006) [2023-12-26 04:31:45,860][123091] Updated weights for policy 0, policy_version 619034 (0.0006) [2023-12-26 04:31:45,925][123091] Updated weights for policy 0, policy_version 619044 (0.0005) [2023-12-26 04:31:45,983][123090] Updated weights for policy 1, policy_version 614627 (0.0010) [2023-12-26 04:31:45,996][123091] Updated weights for policy 0, policy_version 619054 (0.0005) [2023-12-26 04:31:46,035][123090] Updated weights for policy 1, policy_version 614637 (0.0010) [2023-12-26 04:31:46,083][123090] Updated weights for policy 1, policy_version 614647 (0.0010) [2023-12-26 04:31:46,705][123091] Updated weights for policy 0, policy_version 619064 (0.0007) [2023-12-26 04:31:46,759][123091] Updated weights for policy 0, policy_version 619074 (0.0010) [2023-12-26 04:31:46,818][123091] Updated weights for policy 0, policy_version 619084 (0.0011) [2023-12-26 04:31:46,926][123090] Updated weights for policy 1, policy_version 614657 (0.0010) [2023-12-26 04:31:46,988][123090] Updated weights for policy 1, policy_version 614667 (0.0010) [2023-12-26 04:31:47,047][123090] Updated weights for policy 1, policy_version 614677 (0.0010) [2023-12-26 04:31:47,098][123090] Updated weights for policy 1, policy_version 614687 (0.0010) [2023-12-26 04:31:47,534][123091] Updated weights for policy 0, policy_version 619094 (0.0007) [2023-12-26 04:31:47,601][123091] Updated weights for policy 0, policy_version 619104 (0.0005) [2023-12-26 04:31:47,663][123091] Updated weights for policy 0, policy_version 619114 (0.0005) [2023-12-26 04:31:47,810][123090] Updated weights for policy 1, policy_version 614697 (0.0006) [2023-12-26 04:31:47,857][123090] Updated weights for policy 1, policy_version 614707 (0.0005) [2023-12-26 04:31:47,920][123090] Updated weights for policy 1, policy_version 614717 (0.0006) [2023-12-26 04:31:48,312][123091] Updated weights for policy 0, policy_version 619124 (0.0005) [2023-12-26 04:31:48,380][123091] Updated weights for policy 0, policy_version 619134 (0.0010) [2023-12-26 04:31:48,445][123091] Updated weights for policy 0, policy_version 619144 (0.0010) [2023-12-26 04:31:48,607][123090] Updated weights for policy 1, policy_version 614727 (0.0005) [2023-12-26 04:31:48,666][123090] Updated weights for policy 1, policy_version 614737 (0.0005) [2023-12-26 04:31:48,721][123090] Updated weights for policy 1, policy_version 614747 (0.0007) [2023-12-26 04:31:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 315883520. Throughput: 0: 8911.6, 1: 8750.8. Samples: 315891440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:31:48,785][121949] Avg episode reward: [(0, '6248.205'), (1, '5181.431')] [2023-12-26 04:31:49,111][123091] Updated weights for policy 0, policy_version 619154 (0.0008) [2023-12-26 04:31:49,176][123091] Updated weights for policy 0, policy_version 619164 (0.0005) [2023-12-26 04:31:49,233][123091] Updated weights for policy 0, policy_version 619174 (0.0009) [2023-12-26 04:31:49,290][123091] Updated weights for policy 0, policy_version 619184 (0.0009) [2023-12-26 04:31:49,413][123090] Updated weights for policy 1, policy_version 614757 (0.0008) [2023-12-26 04:31:49,480][123090] Updated weights for policy 1, policy_version 614767 (0.0009) [2023-12-26 04:31:49,542][123090] Updated weights for policy 1, policy_version 614777 (0.0009) [2023-12-26 04:31:50,157][123091] Updated weights for policy 0, policy_version 619194 (0.0006) [2023-12-26 04:31:50,219][123091] Updated weights for policy 0, policy_version 619204 (0.0006) [2023-12-26 04:31:50,283][123091] Updated weights for policy 0, policy_version 619214 (0.0006) [2023-12-26 04:31:50,353][123090] Updated weights for policy 1, policy_version 614787 (0.0010) [2023-12-26 04:31:50,411][123090] Updated weights for policy 1, policy_version 614797 (0.0009) [2023-12-26 04:31:50,467][123090] Updated weights for policy 1, policy_version 614807 (0.0006) [2023-12-26 04:31:51,015][123091] Updated weights for policy 0, policy_version 619224 (0.0006) [2023-12-26 04:31:51,085][123091] Updated weights for policy 0, policy_version 619234 (0.0009) [2023-12-26 04:31:51,146][123091] Updated weights for policy 0, policy_version 619244 (0.0010) [2023-12-26 04:31:51,331][123090] Updated weights for policy 1, policy_version 614817 (0.0006) [2023-12-26 04:31:51,398][123090] Updated weights for policy 1, policy_version 614827 (0.0009) [2023-12-26 04:31:51,465][123090] Updated weights for policy 1, policy_version 614837 (0.0009) [2023-12-26 04:31:51,525][123090] Updated weights for policy 1, policy_version 614847 (0.0009) [2023-12-26 04:31:51,987][123091] Updated weights for policy 0, policy_version 619254 (0.0010) [2023-12-26 04:31:52,044][123091] Updated weights for policy 0, policy_version 619264 (0.0005) [2023-12-26 04:31:52,102][123091] Updated weights for policy 0, policy_version 619274 (0.0009) [2023-12-26 04:31:52,354][123090] Updated weights for policy 1, policy_version 614857 (0.0010) [2023-12-26 04:31:52,411][123090] Updated weights for policy 1, policy_version 614867 (0.0009) [2023-12-26 04:31:52,470][123090] Updated weights for policy 1, policy_version 614877 (0.0010) [2023-12-26 04:31:52,863][123091] Updated weights for policy 0, policy_version 619284 (0.0008) [2023-12-26 04:31:52,909][123091] Updated weights for policy 0, policy_version 619294 (0.0005) [2023-12-26 04:31:52,956][123091] Updated weights for policy 0, policy_version 619304 (0.0008) [2023-12-26 04:31:53,335][123090] Updated weights for policy 1, policy_version 614887 (0.0010) [2023-12-26 04:31:53,387][123090] Updated weights for policy 1, policy_version 614897 (0.0009) [2023-12-26 04:31:53,441][123090] Updated weights for policy 1, policy_version 614907 (0.0011) [2023-12-26 04:31:53,639][123091] Updated weights for policy 0, policy_version 619314 (0.0008) [2023-12-26 04:31:53,692][123091] Updated weights for policy 0, policy_version 619324 (0.0007) [2023-12-26 04:31:53,742][123091] Updated weights for policy 0, policy_version 619334 (0.0009) [2023-12-26 04:31:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 315965440. Throughput: 0: 8940.2, 1: 8778.8. Samples: 315945180. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:31:53,785][121949] Avg episode reward: [(0, '6242.254'), (1, '5116.174')] [2023-12-26 04:31:53,791][123091] Updated weights for policy 0, policy_version 619344 (0.0009) [2023-12-26 04:31:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000619344_158556160.pth... [2023-12-26 04:31:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000614912_157417472.pth... [2023-12-26 04:31:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000618256_158277632.pth [2023-12-26 04:31:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000613888_157155328.pth [2023-12-26 04:31:54,294][123090] Updated weights for policy 1, policy_version 614917 (0.0009) [2023-12-26 04:31:54,344][123090] Updated weights for policy 1, policy_version 614927 (0.0009) [2023-12-26 04:31:54,398][123090] Updated weights for policy 1, policy_version 614938 (0.0010) [2023-12-26 04:31:54,549][123091] Updated weights for policy 0, policy_version 619354 (0.0005) [2023-12-26 04:31:54,611][123091] Updated weights for policy 0, policy_version 619364 (0.0005) [2023-12-26 04:31:54,680][123091] Updated weights for policy 0, policy_version 619374 (0.0006) [2023-12-26 04:31:55,294][123091] Updated weights for policy 0, policy_version 619384 (0.0008) [2023-12-26 04:31:55,296][123090] Updated weights for policy 1, policy_version 614948 (0.0009) [2023-12-26 04:31:55,340][123091] Updated weights for policy 0, policy_version 619394 (0.0007) [2023-12-26 04:31:55,350][123090] Updated weights for policy 1, policy_version 614958 (0.0008) [2023-12-26 04:31:55,390][123091] Updated weights for policy 0, policy_version 619404 (0.0008) [2023-12-26 04:31:55,403][123090] Updated weights for policy 1, policy_version 614968 (0.0008) [2023-12-26 04:31:56,131][123090] Updated weights for policy 1, policy_version 614978 (0.0006) [2023-12-26 04:31:56,202][123090] Updated weights for policy 1, policy_version 614988 (0.0009) [2023-12-26 04:31:56,233][123091] Updated weights for policy 0, policy_version 619414 (0.0007) [2023-12-26 04:31:56,271][123090] Updated weights for policy 1, policy_version 614998 (0.0008) [2023-12-26 04:31:56,289][123091] Updated weights for policy 0, policy_version 619424 (0.0006) [2023-12-26 04:31:56,336][123090] Updated weights for policy 1, policy_version 615008 (0.0009) [2023-12-26 04:31:56,352][123091] Updated weights for policy 0, policy_version 619434 (0.0006) [2023-12-26 04:31:57,084][123091] Updated weights for policy 0, policy_version 619444 (0.0010) [2023-12-26 04:31:57,145][123091] Updated weights for policy 0, policy_version 619454 (0.0010) [2023-12-26 04:31:57,169][123090] Updated weights for policy 1, policy_version 615018 (0.0006) [2023-12-26 04:31:57,203][123091] Updated weights for policy 0, policy_version 619464 (0.0010) [2023-12-26 04:31:57,220][123090] Updated weights for policy 1, policy_version 615028 (0.0010) [2023-12-26 04:31:57,274][123090] Updated weights for policy 1, policy_version 615038 (0.0009) [2023-12-26 04:31:58,011][123091] Updated weights for policy 0, policy_version 619474 (0.0010) [2023-12-26 04:31:58,050][123090] Updated weights for policy 1, policy_version 615048 (0.0008) [2023-12-26 04:31:58,074][123091] Updated weights for policy 0, policy_version 619485 (0.0009) [2023-12-26 04:31:58,110][123090] Updated weights for policy 1, policy_version 615058 (0.0009) [2023-12-26 04:31:58,135][123091] Updated weights for policy 0, policy_version 619495 (0.0007) [2023-12-26 04:31:58,173][123090] Updated weights for policy 1, policy_version 615068 (0.0010) [2023-12-26 04:31:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 316055552. Throughput: 0: 9063.4, 1: 8819.8. Samples: 316052380. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:31:58,785][121949] Avg episode reward: [(0, '6126.554'), (1, '5028.164')] [2023-12-26 04:31:59,024][123091] Updated weights for policy 0, policy_version 619505 (0.0008) [2023-12-26 04:31:59,079][123091] Updated weights for policy 0, policy_version 619515 (0.0007) [2023-12-26 04:31:59,114][123090] Updated weights for policy 1, policy_version 615078 (0.0008) [2023-12-26 04:31:59,138][123091] Updated weights for policy 0, policy_version 619525 (0.0006) [2023-12-26 04:31:59,181][123090] Updated weights for policy 1, policy_version 615088 (0.0006) [2023-12-26 04:31:59,214][123091] Updated weights for policy 0, policy_version 619535 (0.0006) [2023-12-26 04:31:59,252][123090] Updated weights for policy 1, policy_version 615098 (0.0007) [2023-12-26 04:31:59,986][123091] Updated weights for policy 0, policy_version 619545 (0.0009) [2023-12-26 04:32:00,048][123090] Updated weights for policy 1, policy_version 615108 (0.0007) [2023-12-26 04:32:00,055][123091] Updated weights for policy 0, policy_version 619555 (0.0010) [2023-12-26 04:32:00,106][123090] Updated weights for policy 1, policy_version 615118 (0.0008) [2023-12-26 04:32:00,113][123091] Updated weights for policy 0, policy_version 619565 (0.0008) [2023-12-26 04:32:00,168][123090] Updated weights for policy 1, policy_version 615128 (0.0006) [2023-12-26 04:32:00,876][123090] Updated weights for policy 1, policy_version 615138 (0.0005) [2023-12-26 04:32:00,948][123090] Updated weights for policy 1, policy_version 615148 (0.0005) [2023-12-26 04:32:00,993][123091] Updated weights for policy 0, policy_version 619575 (0.0009) [2023-12-26 04:32:01,011][123090] Updated weights for policy 1, policy_version 615158 (0.0005) [2023-12-26 04:32:01,059][123091] Updated weights for policy 0, policy_version 619585 (0.0010) [2023-12-26 04:32:01,094][123090] Updated weights for policy 1, policy_version 615168 (0.0007) [2023-12-26 04:32:01,122][123091] Updated weights for policy 0, policy_version 619595 (0.0007) [2023-12-26 04:32:01,800][123090] Updated weights for policy 1, policy_version 615178 (0.0005) [2023-12-26 04:32:01,867][123090] Updated weights for policy 1, policy_version 615188 (0.0005) [2023-12-26 04:32:01,949][123090] Updated weights for policy 1, policy_version 615198 (0.0005) [2023-12-26 04:32:01,965][123091] Updated weights for policy 0, policy_version 619605 (0.0009) [2023-12-26 04:32:02,031][123091] Updated weights for policy 0, policy_version 619615 (0.0010) [2023-12-26 04:32:02,094][123091] Updated weights for policy 0, policy_version 619625 (0.0010) [2023-12-26 04:32:02,617][123090] Updated weights for policy 1, policy_version 615208 (0.0009) [2023-12-26 04:32:02,675][123090] Updated weights for policy 1, policy_version 615218 (0.0008) [2023-12-26 04:32:02,743][123090] Updated weights for policy 1, policy_version 615228 (0.0006) [2023-12-26 04:32:02,982][123091] Updated weights for policy 0, policy_version 619635 (0.0010) [2023-12-26 04:32:03,044][123091] Updated weights for policy 0, policy_version 619645 (0.0010) [2023-12-26 04:32:03,093][123091] Updated weights for policy 0, policy_version 619656 (0.0009) [2023-12-26 04:32:03,431][123090] Updated weights for policy 1, policy_version 615238 (0.0005) [2023-12-26 04:32:03,490][123090] Updated weights for policy 1, policy_version 615248 (0.0005) [2023-12-26 04:32:03,552][123090] Updated weights for policy 1, policy_version 615258 (0.0005) [2023-12-26 04:32:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 316145664. Throughput: 0: 8984.8, 1: 8818.3. Samples: 316157392. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:03,785][121949] Avg episode reward: [(0, '6067.192'), (1, '5181.250')] [2023-12-26 04:32:03,881][123091] Updated weights for policy 0, policy_version 619666 (0.0007) [2023-12-26 04:32:03,942][123091] Updated weights for policy 0, policy_version 619676 (0.0006) [2023-12-26 04:32:04,004][123091] Updated weights for policy 0, policy_version 619686 (0.0005) [2023-12-26 04:32:04,061][123091] Updated weights for policy 0, policy_version 619696 (0.0005) [2023-12-26 04:32:04,148][123090] Updated weights for policy 1, policy_version 615268 (0.0005) [2023-12-26 04:32:04,224][123090] Updated weights for policy 1, policy_version 615278 (0.0006) [2023-12-26 04:32:04,298][123090] Updated weights for policy 1, policy_version 615288 (0.0007) [2023-12-26 04:32:04,858][123091] Updated weights for policy 0, policy_version 619706 (0.0005) [2023-12-26 04:32:04,912][123091] Updated weights for policy 0, policy_version 619716 (0.0009) [2023-12-26 04:32:04,963][123091] Updated weights for policy 0, policy_version 619727 (0.0009) [2023-12-26 04:32:05,030][123090] Updated weights for policy 1, policy_version 615298 (0.0009) [2023-12-26 04:32:05,101][123090] Updated weights for policy 1, policy_version 615308 (0.0005) [2023-12-26 04:32:05,170][123090] Updated weights for policy 1, policy_version 615318 (0.0005) [2023-12-26 04:32:05,231][123090] Updated weights for policy 1, policy_version 615328 (0.0006) [2023-12-26 04:32:05,726][123091] Updated weights for policy 0, policy_version 619737 (0.0010) [2023-12-26 04:32:05,785][123091] Updated weights for policy 0, policy_version 619747 (0.0011) [2023-12-26 04:32:05,837][123091] Updated weights for policy 0, policy_version 619757 (0.0010) [2023-12-26 04:32:05,852][123090] Updated weights for policy 1, policy_version 615338 (0.0006) [2023-12-26 04:32:05,912][123090] Updated weights for policy 1, policy_version 615348 (0.0009) [2023-12-26 04:32:05,976][123090] Updated weights for policy 1, policy_version 615358 (0.0006) [2023-12-26 04:32:06,686][123091] Updated weights for policy 0, policy_version 619767 (0.0009) [2023-12-26 04:32:06,719][123090] Updated weights for policy 1, policy_version 615368 (0.0009) [2023-12-26 04:32:06,744][123091] Updated weights for policy 0, policy_version 619777 (0.0007) [2023-12-26 04:32:06,783][123090] Updated weights for policy 1, policy_version 615378 (0.0008) [2023-12-26 04:32:06,809][123091] Updated weights for policy 0, policy_version 619787 (0.0009) [2023-12-26 04:32:06,836][123090] Updated weights for policy 1, policy_version 615388 (0.0009) [2023-12-26 04:32:07,499][123091] Updated weights for policy 0, policy_version 619797 (0.0007) [2023-12-26 04:32:07,557][123091] Updated weights for policy 0, policy_version 619807 (0.0006) [2023-12-26 04:32:07,616][123091] Updated weights for policy 0, policy_version 619817 (0.0007) [2023-12-26 04:32:07,788][123090] Updated weights for policy 1, policy_version 615398 (0.0010) [2023-12-26 04:32:07,850][123090] Updated weights for policy 1, policy_version 615408 (0.0009) [2023-12-26 04:32:07,903][123090] Updated weights for policy 1, policy_version 615418 (0.0010) [2023-12-26 04:32:08,307][123091] Updated weights for policy 0, policy_version 619827 (0.0006) [2023-12-26 04:32:08,383][123091] Updated weights for policy 0, policy_version 619837 (0.0010) [2023-12-26 04:32:08,446][123091] Updated weights for policy 0, policy_version 619847 (0.0011) [2023-12-26 04:32:08,705][123090] Updated weights for policy 1, policy_version 615428 (0.0009) [2023-12-26 04:32:08,766][123090] Updated weights for policy 1, policy_version 615438 (0.0009) [2023-12-26 04:32:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 316235776. Throughput: 0: 9015.1, 1: 8896.0. Samples: 316213600. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:08,785][121949] Avg episode reward: [(0, '6152.943'), (1, '5135.801')] [2023-12-26 04:32:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000619856_158687232.pth... [2023-12-26 04:32:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000618800_158416896.pth [2023-12-26 04:32:08,836][123090] Updated weights for policy 1, policy_version 615448 (0.0009) [2023-12-26 04:32:08,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000615456_157556736.pth... [2023-12-26 04:32:08,890][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000614400_157286400.pth [2023-12-26 04:32:09,220][123091] Updated weights for policy 0, policy_version 619857 (0.0010) [2023-12-26 04:32:09,277][123091] Updated weights for policy 0, policy_version 619867 (0.0008) [2023-12-26 04:32:09,336][123091] Updated weights for policy 0, policy_version 619877 (0.0008) [2023-12-26 04:32:09,410][123091] Updated weights for policy 0, policy_version 619887 (0.0009) [2023-12-26 04:32:09,690][123090] Updated weights for policy 1, policy_version 615458 (0.0009) [2023-12-26 04:32:09,761][123090] Updated weights for policy 1, policy_version 615468 (0.0008) [2023-12-26 04:32:09,827][123090] Updated weights for policy 1, policy_version 615478 (0.0007) [2023-12-26 04:32:09,899][123090] Updated weights for policy 1, policy_version 615488 (0.0007) [2023-12-26 04:32:10,337][123091] Updated weights for policy 0, policy_version 619897 (0.0011) [2023-12-26 04:32:10,409][123091] Updated weights for policy 0, policy_version 619908 (0.0010) [2023-12-26 04:32:10,473][123091] Updated weights for policy 0, policy_version 619918 (0.0010) [2023-12-26 04:32:10,628][123090] Updated weights for policy 1, policy_version 615498 (0.0009) [2023-12-26 04:32:10,680][123090] Updated weights for policy 1, policy_version 615509 (0.0010) [2023-12-26 04:32:10,744][123090] Updated weights for policy 1, policy_version 615519 (0.0009) [2023-12-26 04:32:11,307][123091] Updated weights for policy 0, policy_version 619928 (0.0010) [2023-12-26 04:32:11,382][123091] Updated weights for policy 0, policy_version 619938 (0.0010) [2023-12-26 04:32:11,449][123091] Updated weights for policy 0, policy_version 619948 (0.0010) [2023-12-26 04:32:11,639][123090] Updated weights for policy 1, policy_version 615529 (0.0010) [2023-12-26 04:32:11,697][123090] Updated weights for policy 1, policy_version 615539 (0.0010) [2023-12-26 04:32:11,765][123090] Updated weights for policy 1, policy_version 615549 (0.0009) [2023-12-26 04:32:12,293][123091] Updated weights for policy 0, policy_version 619958 (0.0010) [2023-12-26 04:32:12,382][123091] Updated weights for policy 0, policy_version 619968 (0.0010) [2023-12-26 04:32:12,443][123091] Updated weights for policy 0, policy_version 619978 (0.0010) [2023-12-26 04:32:12,524][123090] Updated weights for policy 1, policy_version 615559 (0.0008) [2023-12-26 04:32:12,584][123090] Updated weights for policy 1, policy_version 615569 (0.0008) [2023-12-26 04:32:12,646][123090] Updated weights for policy 1, policy_version 615579 (0.0009) [2023-12-26 04:32:13,308][123091] Updated weights for policy 0, policy_version 619988 (0.0009) [2023-12-26 04:32:13,359][123091] Updated weights for policy 0, policy_version 619998 (0.0009) [2023-12-26 04:32:13,403][123091] Updated weights for policy 0, policy_version 620008 (0.0005) [2023-12-26 04:32:13,467][123090] Updated weights for policy 1, policy_version 615589 (0.0008) [2023-12-26 04:32:13,522][123090] Updated weights for policy 1, policy_version 615599 (0.0008) [2023-12-26 04:32:13,573][123090] Updated weights for policy 1, policy_version 615609 (0.0008) [2023-12-26 04:32:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 316325888. Throughput: 0: 8939.4, 1: 8866.6. Samples: 316316920. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:13,785][121949] Avg episode reward: [(0, '6160.607'), (1, '5119.427')] [2023-12-26 04:32:14,117][123091] Updated weights for policy 0, policy_version 620018 (0.0006) [2023-12-26 04:32:14,167][123091] Updated weights for policy 0, policy_version 620028 (0.0009) [2023-12-26 04:32:14,211][123091] Updated weights for policy 0, policy_version 620038 (0.0010) [2023-12-26 04:32:14,267][123091] Updated weights for policy 0, policy_version 620048 (0.0010) [2023-12-26 04:32:14,343][123090] Updated weights for policy 1, policy_version 615619 (0.0009) [2023-12-26 04:32:14,402][123090] Updated weights for policy 1, policy_version 615629 (0.0009) [2023-12-26 04:32:14,470][123090] Updated weights for policy 1, policy_version 615639 (0.0010) [2023-12-26 04:32:15,109][123091] Updated weights for policy 0, policy_version 620058 (0.0011) [2023-12-26 04:32:15,180][123091] Updated weights for policy 0, policy_version 620068 (0.0011) [2023-12-26 04:32:15,182][123090] Updated weights for policy 1, policy_version 615649 (0.0006) [2023-12-26 04:32:15,238][123090] Updated weights for policy 1, policy_version 615659 (0.0007) [2023-12-26 04:32:15,244][123091] Updated weights for policy 0, policy_version 620078 (0.0011) [2023-12-26 04:32:15,292][123090] Updated weights for policy 1, policy_version 615669 (0.0006) [2023-12-26 04:32:15,365][123090] Updated weights for policy 1, policy_version 615679 (0.0007) [2023-12-26 04:32:15,984][123091] Updated weights for policy 0, policy_version 620088 (0.0006) [2023-12-26 04:32:16,055][123091] Updated weights for policy 0, policy_version 620098 (0.0005) [2023-12-26 04:32:16,062][123090] Updated weights for policy 1, policy_version 615689 (0.0007) [2023-12-26 04:32:16,111][123091] Updated weights for policy 0, policy_version 620108 (0.0005) [2023-12-26 04:32:16,122][123090] Updated weights for policy 1, policy_version 615699 (0.0007) [2023-12-26 04:32:16,195][123090] Updated weights for policy 1, policy_version 615709 (0.0005) [2023-12-26 04:32:16,826][123091] Updated weights for policy 0, policy_version 620118 (0.0008) [2023-12-26 04:32:16,872][123090] Updated weights for policy 1, policy_version 615719 (0.0009) [2023-12-26 04:32:16,887][123091] Updated weights for policy 0, policy_version 620128 (0.0006) [2023-12-26 04:32:16,931][123090] Updated weights for policy 1, policy_version 615729 (0.0008) [2023-12-26 04:32:16,958][123091] Updated weights for policy 0, policy_version 620138 (0.0008) [2023-12-26 04:32:16,989][123090] Updated weights for policy 1, policy_version 615739 (0.0010) [2023-12-26 04:32:17,682][123090] Updated weights for policy 1, policy_version 615749 (0.0009) [2023-12-26 04:32:17,687][123091] Updated weights for policy 0, policy_version 620148 (0.0006) [2023-12-26 04:32:17,740][123091] Updated weights for policy 0, policy_version 620158 (0.0006) [2023-12-26 04:32:17,747][123090] Updated weights for policy 1, policy_version 615759 (0.0008) [2023-12-26 04:32:17,802][123091] Updated weights for policy 0, policy_version 620168 (0.0006) [2023-12-26 04:32:17,809][123090] Updated weights for policy 1, policy_version 615769 (0.0008) [2023-12-26 04:32:18,462][123091] Updated weights for policy 0, policy_version 620178 (0.0008) [2023-12-26 04:32:18,469][123090] Updated weights for policy 1, policy_version 615779 (0.0007) [2023-12-26 04:32:18,524][123091] Updated weights for policy 0, policy_version 620188 (0.0008) [2023-12-26 04:32:18,524][123090] Updated weights for policy 1, policy_version 615789 (0.0010) [2023-12-26 04:32:18,580][123090] Updated weights for policy 1, policy_version 615799 (0.0010) [2023-12-26 04:32:18,587][123091] Updated weights for policy 0, policy_version 620198 (0.0008) [2023-12-26 04:32:18,649][123091] Updated weights for policy 0, policy_version 620208 (0.0008) [2023-12-26 04:32:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 316424192. Throughput: 0: 8983.5, 1: 8951.5. Samples: 316429724. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:18,785][121949] Avg episode reward: [(0, '6127.966'), (1, '5210.329')] [2023-12-26 04:32:19,417][123091] Updated weights for policy 0, policy_version 620218 (0.0006) [2023-12-26 04:32:19,470][123090] Updated weights for policy 1, policy_version 615809 (0.0010) [2023-12-26 04:32:19,470][123091] Updated weights for policy 0, policy_version 620228 (0.0006) [2023-12-26 04:32:19,538][123090] Updated weights for policy 1, policy_version 615819 (0.0009) [2023-12-26 04:32:19,541][123091] Updated weights for policy 0, policy_version 620238 (0.0008) [2023-12-26 04:32:19,594][123090] Updated weights for policy 1, policy_version 615829 (0.0009) [2023-12-26 04:32:19,654][123090] Updated weights for policy 1, policy_version 615839 (0.0009) [2023-12-26 04:32:20,364][123091] Updated weights for policy 0, policy_version 620248 (0.0010) [2023-12-26 04:32:20,423][123091] Updated weights for policy 0, policy_version 620258 (0.0011) [2023-12-26 04:32:20,475][123091] Updated weights for policy 0, policy_version 620268 (0.0010) [2023-12-26 04:32:20,517][123090] Updated weights for policy 1, policy_version 615849 (0.0009) [2023-12-26 04:32:20,579][123090] Updated weights for policy 1, policy_version 615859 (0.0006) [2023-12-26 04:32:20,649][123090] Updated weights for policy 1, policy_version 615869 (0.0006) [2023-12-26 04:32:21,318][123091] Updated weights for policy 0, policy_version 620278 (0.0008) [2023-12-26 04:32:21,387][123091] Updated weights for policy 0, policy_version 620288 (0.0009) [2023-12-26 04:32:21,454][123091] Updated weights for policy 0, policy_version 620298 (0.0007) [2023-12-26 04:32:21,489][123090] Updated weights for policy 1, policy_version 615879 (0.0008) [2023-12-26 04:32:21,538][123090] Updated weights for policy 1, policy_version 615889 (0.0006) [2023-12-26 04:32:21,597][123090] Updated weights for policy 1, policy_version 615899 (0.0007) [2023-12-26 04:32:22,159][123091] Updated weights for policy 0, policy_version 620308 (0.0006) [2023-12-26 04:32:22,207][123091] Updated weights for policy 0, policy_version 620318 (0.0005) [2023-12-26 04:32:22,264][123091] Updated weights for policy 0, policy_version 620328 (0.0009) [2023-12-26 04:32:22,448][123090] Updated weights for policy 1, policy_version 615909 (0.0008) [2023-12-26 04:32:22,524][123090] Updated weights for policy 1, policy_version 615919 (0.0009) [2023-12-26 04:32:22,592][123090] Updated weights for policy 1, policy_version 615929 (0.0006) [2023-12-26 04:32:23,025][123091] Updated weights for policy 0, policy_version 620338 (0.0010) [2023-12-26 04:32:23,089][123091] Updated weights for policy 0, policy_version 620348 (0.0005) [2023-12-26 04:32:23,150][123091] Updated weights for policy 0, policy_version 620358 (0.0005) [2023-12-26 04:32:23,216][123091] Updated weights for policy 0, policy_version 620368 (0.0005) [2023-12-26 04:32:23,250][123090] Updated weights for policy 1, policy_version 615939 (0.0006) [2023-12-26 04:32:23,317][123090] Updated weights for policy 1, policy_version 615949 (0.0005) [2023-12-26 04:32:23,376][123090] Updated weights for policy 1, policy_version 615959 (0.0006) [2023-12-26 04:32:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 316506112. Throughput: 0: 8946.5, 1: 8952.2. Samples: 316480656. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:23,786][121949] Avg episode reward: [(0, '6196.858'), (1, '4846.138')] [2023-12-26 04:32:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000620368_158818304.pth... [2023-12-26 04:32:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000615968_157687808.pth... [2023-12-26 04:32:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000614912_157417472.pth [2023-12-26 04:32:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000619344_158556160.pth [2023-12-26 04:32:23,897][123091] Updated weights for policy 0, policy_version 620378 (0.0010) [2023-12-26 04:32:23,966][123091] Updated weights for policy 0, policy_version 620388 (0.0010) [2023-12-26 04:32:24,019][123090] Updated weights for policy 1, policy_version 615969 (0.0006) [2023-12-26 04:32:24,038][123091] Updated weights for policy 0, policy_version 620398 (0.0006) [2023-12-26 04:32:24,071][123090] Updated weights for policy 1, policy_version 615979 (0.0005) [2023-12-26 04:32:24,130][123090] Updated weights for policy 1, policy_version 615989 (0.0007) [2023-12-26 04:32:24,196][123090] Updated weights for policy 1, policy_version 615999 (0.0006) [2023-12-26 04:32:24,702][123091] Updated weights for policy 0, policy_version 620408 (0.0010) [2023-12-26 04:32:24,750][123091] Updated weights for policy 0, policy_version 620418 (0.0010) [2023-12-26 04:32:24,794][123091] Updated weights for policy 0, policy_version 620428 (0.0010) [2023-12-26 04:32:24,874][123090] Updated weights for policy 1, policy_version 616009 (0.0005) [2023-12-26 04:32:24,944][123090] Updated weights for policy 1, policy_version 616019 (0.0005) [2023-12-26 04:32:25,013][123090] Updated weights for policy 1, policy_version 616029 (0.0008) [2023-12-26 04:32:25,623][123091] Updated weights for policy 0, policy_version 620438 (0.0010) [2023-12-26 04:32:25,678][123091] Updated weights for policy 0, policy_version 620448 (0.0010) [2023-12-26 04:32:25,726][123090] Updated weights for policy 1, policy_version 616039 (0.0006) [2023-12-26 04:32:25,729][123091] Updated weights for policy 0, policy_version 620458 (0.0010) [2023-12-26 04:32:25,780][123090] Updated weights for policy 1, policy_version 616049 (0.0005) [2023-12-26 04:32:25,828][123090] Updated weights for policy 1, policy_version 616059 (0.0008) [2023-12-26 04:32:26,571][123091] Updated weights for policy 0, policy_version 620468 (0.0010) [2023-12-26 04:32:26,622][123091] Updated weights for policy 0, policy_version 620478 (0.0010) [2023-12-26 04:32:26,634][123090] Updated weights for policy 1, policy_version 616069 (0.0008) [2023-12-26 04:32:26,673][123091] Updated weights for policy 0, policy_version 620488 (0.0010) [2023-12-26 04:32:26,689][123090] Updated weights for policy 1, policy_version 616079 (0.0005) [2023-12-26 04:32:26,749][123090] Updated weights for policy 1, policy_version 616089 (0.0007) [2023-12-26 04:32:27,438][123090] Updated weights for policy 1, policy_version 616099 (0.0006) [2023-12-26 04:32:27,484][123091] Updated weights for policy 0, policy_version 620498 (0.0010) [2023-12-26 04:32:27,508][123090] Updated weights for policy 1, policy_version 616109 (0.0005) [2023-12-26 04:32:27,539][123091] Updated weights for policy 0, policy_version 620508 (0.0010) [2023-12-26 04:32:27,570][123090] Updated weights for policy 1, policy_version 616119 (0.0005) [2023-12-26 04:32:27,590][123091] Updated weights for policy 0, policy_version 620518 (0.0010) [2023-12-26 04:32:27,654][123091] Updated weights for policy 0, policy_version 620528 (0.0011) [2023-12-26 04:32:28,263][123090] Updated weights for policy 1, policy_version 616129 (0.0006) [2023-12-26 04:32:28,320][123090] Updated weights for policy 1, policy_version 616139 (0.0005) [2023-12-26 04:32:28,389][123090] Updated weights for policy 1, policy_version 616149 (0.0008) [2023-12-26 04:32:28,402][123091] Updated weights for policy 0, policy_version 620538 (0.0011) [2023-12-26 04:32:28,444][123090] Updated weights for policy 1, policy_version 616159 (0.0008) [2023-12-26 04:32:28,464][123091] Updated weights for policy 0, policy_version 620548 (0.0010) [2023-12-26 04:32:28,523][123091] Updated weights for policy 0, policy_version 620558 (0.0010) [2023-12-26 04:32:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 316604416. Throughput: 0: 9035.7, 1: 9069.6. Samples: 316594660. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:28,785][121949] Avg episode reward: [(0, '6261.795'), (1, '4728.849')] [2023-12-26 04:32:29,176][123090] Updated weights for policy 1, policy_version 616169 (0.0007) [2023-12-26 04:32:29,233][123090] Updated weights for policy 1, policy_version 616179 (0.0007) [2023-12-26 04:32:29,297][123090] Updated weights for policy 1, policy_version 616189 (0.0009) [2023-12-26 04:32:29,351][123091] Updated weights for policy 0, policy_version 620568 (0.0009) [2023-12-26 04:32:29,419][123091] Updated weights for policy 0, policy_version 620578 (0.0006) [2023-12-26 04:32:29,466][123091] Updated weights for policy 0, policy_version 620588 (0.0010) [2023-12-26 04:32:30,097][123090] Updated weights for policy 1, policy_version 616199 (0.0009) [2023-12-26 04:32:30,161][123090] Updated weights for policy 1, policy_version 616209 (0.0009) [2023-12-26 04:32:30,230][123090] Updated weights for policy 1, policy_version 616219 (0.0008) [2023-12-26 04:32:30,236][123091] Updated weights for policy 0, policy_version 620598 (0.0009) [2023-12-26 04:32:30,285][123091] Updated weights for policy 0, policy_version 620608 (0.0009) [2023-12-26 04:32:30,343][123091] Updated weights for policy 0, policy_version 620618 (0.0009) [2023-12-26 04:32:30,969][123091] Updated weights for policy 0, policy_version 620628 (0.0008) [2023-12-26 04:32:31,027][123091] Updated weights for policy 0, policy_version 620638 (0.0006) [2023-12-26 04:32:31,071][123090] Updated weights for policy 1, policy_version 616229 (0.0008) [2023-12-26 04:32:31,094][123091] Updated weights for policy 0, policy_version 620648 (0.0008) [2023-12-26 04:32:31,146][123090] Updated weights for policy 1, policy_version 616239 (0.0007) [2023-12-26 04:32:31,191][123090] Updated weights for policy 1, policy_version 616249 (0.0005) [2023-12-26 04:32:31,872][123091] Updated weights for policy 0, policy_version 620658 (0.0010) [2023-12-26 04:32:31,927][123091] Updated weights for policy 0, policy_version 620668 (0.0010) [2023-12-26 04:32:31,968][123090] Updated weights for policy 1, policy_version 616259 (0.0005) [2023-12-26 04:32:31,986][123091] Updated weights for policy 0, policy_version 620678 (0.0010) [2023-12-26 04:32:32,015][123090] Updated weights for policy 1, policy_version 616269 (0.0006) [2023-12-26 04:32:32,043][123091] Updated weights for policy 0, policy_version 620688 (0.0010) [2023-12-26 04:32:32,070][123090] Updated weights for policy 1, policy_version 616279 (0.0008) [2023-12-26 04:32:32,905][123091] Updated weights for policy 0, policy_version 620698 (0.0009) [2023-12-26 04:32:32,906][123090] Updated weights for policy 1, policy_version 616289 (0.0008) [2023-12-26 04:32:32,960][123090] Updated weights for policy 1, policy_version 616299 (0.0009) [2023-12-26 04:32:32,968][123091] Updated weights for policy 0, policy_version 620708 (0.0007) [2023-12-26 04:32:33,018][123091] Updated weights for policy 0, policy_version 620718 (0.0008) [2023-12-26 04:32:33,020][123090] Updated weights for policy 1, policy_version 616309 (0.0009) [2023-12-26 04:32:33,068][123090] Updated weights for policy 1, policy_version 616319 (0.0009) [2023-12-26 04:32:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 316686336. Throughput: 0: 8983.7, 1: 9034.1. Samples: 316702236. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:33,785][121949] Avg episode reward: [(0, '6304.518'), (1, '5008.274')] [2023-12-26 04:32:33,817][123091] Updated weights for policy 0, policy_version 620728 (0.0008) [2023-12-26 04:32:33,875][123091] Updated weights for policy 0, policy_version 620738 (0.0010) [2023-12-26 04:32:33,941][123091] Updated weights for policy 0, policy_version 620748 (0.0009) [2023-12-26 04:32:33,950][123090] Updated weights for policy 1, policy_version 616329 (0.0006) [2023-12-26 04:32:34,007][123090] Updated weights for policy 1, policy_version 616339 (0.0009) [2023-12-26 04:32:34,067][123090] Updated weights for policy 1, policy_version 616349 (0.0007) [2023-12-26 04:32:34,780][123090] Updated weights for policy 1, policy_version 616359 (0.0008) [2023-12-26 04:32:34,819][123091] Updated weights for policy 0, policy_version 620758 (0.0010) [2023-12-26 04:32:34,847][123090] Updated weights for policy 1, policy_version 616369 (0.0008) [2023-12-26 04:32:34,877][123091] Updated weights for policy 0, policy_version 620768 (0.0008) [2023-12-26 04:32:34,901][123090] Updated weights for policy 1, policy_version 616379 (0.0005) [2023-12-26 04:32:34,925][123091] Updated weights for policy 0, policy_version 620778 (0.0009) [2023-12-26 04:32:35,723][123090] Updated weights for policy 1, policy_version 616389 (0.0009) [2023-12-26 04:32:35,782][123091] Updated weights for policy 0, policy_version 620788 (0.0010) [2023-12-26 04:32:35,790][123090] Updated weights for policy 1, policy_version 616399 (0.0010) [2023-12-26 04:32:35,840][123090] Updated weights for policy 1, policy_version 616409 (0.0010) [2023-12-26 04:32:35,842][123091] Updated weights for policy 0, policy_version 620798 (0.0007) [2023-12-26 04:32:35,905][123091] Updated weights for policy 0, policy_version 620808 (0.0010) [2023-12-26 04:32:36,646][123091] Updated weights for policy 0, policy_version 620818 (0.0009) [2023-12-26 04:32:36,705][123091] Updated weights for policy 0, policy_version 620828 (0.0011) [2023-12-26 04:32:36,727][123090] Updated weights for policy 1, policy_version 616419 (0.0008) [2023-12-26 04:32:36,760][123091] Updated weights for policy 0, policy_version 620838 (0.0011) [2023-12-26 04:32:36,780][123090] Updated weights for policy 1, policy_version 616429 (0.0010) [2023-12-26 04:32:36,819][123091] Updated weights for policy 0, policy_version 620848 (0.0011) [2023-12-26 04:32:36,841][123090] Updated weights for policy 1, policy_version 616439 (0.0011) [2023-12-26 04:32:37,502][123091] Updated weights for policy 0, policy_version 620858 (0.0007) [2023-12-26 04:32:37,561][123091] Updated weights for policy 0, policy_version 620868 (0.0009) [2023-12-26 04:32:37,620][123091] Updated weights for policy 0, policy_version 620878 (0.0011) [2023-12-26 04:32:37,658][123090] Updated weights for policy 1, policy_version 616449 (0.0010) [2023-12-26 04:32:37,719][123090] Updated weights for policy 1, policy_version 616459 (0.0005) [2023-12-26 04:32:37,781][123090] Updated weights for policy 1, policy_version 616469 (0.0005) [2023-12-26 04:32:37,847][123090] Updated weights for policy 1, policy_version 616479 (0.0005) [2023-12-26 04:32:38,455][123091] Updated weights for policy 0, policy_version 620888 (0.0011) [2023-12-26 04:32:38,486][123090] Updated weights for policy 1, policy_version 616489 (0.0010) [2023-12-26 04:32:38,515][123091] Updated weights for policy 0, policy_version 620898 (0.0011) [2023-12-26 04:32:38,554][123090] Updated weights for policy 1, policy_version 616499 (0.0011) [2023-12-26 04:32:38,579][123091] Updated weights for policy 0, policy_version 620908 (0.0011) [2023-12-26 04:32:38,623][123090] Updated weights for policy 1, policy_version 616509 (0.0011) [2023-12-26 04:32:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 316784640. Throughput: 0: 8941.3, 1: 9032.6. Samples: 316754004. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:38,785][121949] Avg episode reward: [(0, '6264.997'), (1, '5085.040')] [2023-12-26 04:32:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000616512_157827072.pth... [2023-12-26 04:32:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000620912_158957568.pth... [2023-12-26 04:32:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000619856_158687232.pth [2023-12-26 04:32:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000615456_157556736.pth [2023-12-26 04:32:39,389][123090] Updated weights for policy 1, policy_version 616519 (0.0010) [2023-12-26 04:32:39,395][123091] Updated weights for policy 0, policy_version 620918 (0.0009) [2023-12-26 04:32:39,453][123090] Updated weights for policy 1, policy_version 616529 (0.0008) [2023-12-26 04:32:39,463][123091] Updated weights for policy 0, policy_version 620928 (0.0008) [2023-12-26 04:32:39,508][123091] Updated weights for policy 0, policy_version 620938 (0.0008) [2023-12-26 04:32:39,510][123090] Updated weights for policy 1, policy_version 616539 (0.0006) [2023-12-26 04:32:40,280][123090] Updated weights for policy 1, policy_version 616549 (0.0007) [2023-12-26 04:32:40,302][123091] Updated weights for policy 0, policy_version 620948 (0.0008) [2023-12-26 04:32:40,340][123090] Updated weights for policy 1, policy_version 616559 (0.0007) [2023-12-26 04:32:40,367][123091] Updated weights for policy 0, policy_version 620958 (0.0010) [2023-12-26 04:32:40,400][123090] Updated weights for policy 1, policy_version 616569 (0.0006) [2023-12-26 04:32:40,427][123091] Updated weights for policy 0, policy_version 620968 (0.0011) [2023-12-26 04:32:41,259][123091] Updated weights for policy 0, policy_version 620978 (0.0010) [2023-12-26 04:32:41,268][123090] Updated weights for policy 1, policy_version 616579 (0.0006) [2023-12-26 04:32:41,329][123090] Updated weights for policy 1, policy_version 616589 (0.0008) [2023-12-26 04:32:41,329][123091] Updated weights for policy 0, policy_version 620988 (0.0010) [2023-12-26 04:32:41,402][123091] Updated weights for policy 0, policy_version 620998 (0.0010) [2023-12-26 04:32:41,404][123090] Updated weights for policy 1, policy_version 616599 (0.0008) [2023-12-26 04:32:41,467][123091] Updated weights for policy 0, policy_version 621008 (0.0007) [2023-12-26 04:32:42,268][123090] Updated weights for policy 1, policy_version 616609 (0.0009) [2023-12-26 04:32:42,324][123091] Updated weights for policy 0, policy_version 621018 (0.0008) [2023-12-26 04:32:42,342][123090] Updated weights for policy 1, policy_version 616619 (0.0007) [2023-12-26 04:32:42,391][123091] Updated weights for policy 0, policy_version 621028 (0.0008) [2023-12-26 04:32:42,412][123090] Updated weights for policy 1, policy_version 616629 (0.0008) [2023-12-26 04:32:42,454][123091] Updated weights for policy 0, policy_version 621038 (0.0008) [2023-12-26 04:32:42,474][123090] Updated weights for policy 1, policy_version 616639 (0.0008) [2023-12-26 04:32:43,241][123091] Updated weights for policy 0, policy_version 621048 (0.0006) [2023-12-26 04:32:43,301][123090] Updated weights for policy 1, policy_version 616649 (0.0009) [2023-12-26 04:32:43,307][123091] Updated weights for policy 0, policy_version 621058 (0.0005) [2023-12-26 04:32:43,363][123090] Updated weights for policy 1, policy_version 616659 (0.0008) [2023-12-26 04:32:43,370][123091] Updated weights for policy 0, policy_version 621068 (0.0008) [2023-12-26 04:32:43,421][123090] Updated weights for policy 1, policy_version 616669 (0.0009) [2023-12-26 04:32:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 316866560. Throughput: 0: 8866.6, 1: 9051.2. Samples: 316858680. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:43,785][121949] Avg episode reward: [(0, '6190.733'), (1, '5211.006')] [2023-12-26 04:32:44,157][123091] Updated weights for policy 0, policy_version 621078 (0.0009) [2023-12-26 04:32:44,208][123091] Updated weights for policy 0, policy_version 621088 (0.0009) [2023-12-26 04:32:44,245][123090] Updated weights for policy 1, policy_version 616679 (0.0007) [2023-12-26 04:32:44,269][123091] Updated weights for policy 0, policy_version 621098 (0.0008) [2023-12-26 04:32:44,307][123090] Updated weights for policy 1, policy_version 616689 (0.0008) [2023-12-26 04:32:44,368][123090] Updated weights for policy 1, policy_version 616699 (0.0009) [2023-12-26 04:32:45,120][123090] Updated weights for policy 1, policy_version 616709 (0.0009) [2023-12-26 04:32:45,182][123090] Updated weights for policy 1, policy_version 616719 (0.0008) [2023-12-26 04:32:45,186][123091] Updated weights for policy 0, policy_version 621108 (0.0008) [2023-12-26 04:32:45,241][123091] Updated weights for policy 0, policy_version 621118 (0.0006) [2023-12-26 04:32:45,251][123090] Updated weights for policy 1, policy_version 616729 (0.0009) [2023-12-26 04:32:45,303][123091] Updated weights for policy 0, policy_version 621128 (0.0010) [2023-12-26 04:32:46,024][123090] Updated weights for policy 1, policy_version 616739 (0.0010) [2023-12-26 04:32:46,083][123090] Updated weights for policy 1, policy_version 616749 (0.0009) [2023-12-26 04:32:46,144][123091] Updated weights for policy 0, policy_version 621138 (0.0009) [2023-12-26 04:32:46,145][123090] Updated weights for policy 1, policy_version 616759 (0.0009) [2023-12-26 04:32:46,191][123091] Updated weights for policy 0, policy_version 621148 (0.0009) [2023-12-26 04:32:46,239][123091] Updated weights for policy 0, policy_version 621158 (0.0008) [2023-12-26 04:32:46,290][123091] Updated weights for policy 0, policy_version 621168 (0.0009) [2023-12-26 04:32:46,940][123090] Updated weights for policy 1, policy_version 616769 (0.0009) [2023-12-26 04:32:47,006][123090] Updated weights for policy 1, policy_version 616779 (0.0010) [2023-12-26 04:32:47,070][123090] Updated weights for policy 1, policy_version 616789 (0.0009) [2023-12-26 04:32:47,138][123090] Updated weights for policy 1, policy_version 616799 (0.0009) [2023-12-26 04:32:47,159][123091] Updated weights for policy 0, policy_version 621178 (0.0008) [2023-12-26 04:32:47,211][123091] Updated weights for policy 0, policy_version 621188 (0.0009) [2023-12-26 04:32:47,259][123091] Updated weights for policy 0, policy_version 621198 (0.0009) [2023-12-26 04:32:47,979][123090] Updated weights for policy 1, policy_version 616809 (0.0009) [2023-12-26 04:32:48,000][123091] Updated weights for policy 0, policy_version 621209 (0.0006) [2023-12-26 04:32:48,046][123090] Updated weights for policy 1, policy_version 616819 (0.0009) [2023-12-26 04:32:48,053][123091] Updated weights for policy 0, policy_version 621219 (0.0007) [2023-12-26 04:32:48,100][123091] Updated weights for policy 0, policy_version 621229 (0.0008) [2023-12-26 04:32:48,101][123090] Updated weights for policy 1, policy_version 616829 (0.0008) [2023-12-26 04:32:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 316948480. Throughput: 0: 8919.2, 1: 8966.1. Samples: 316962228. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:48,784][121949] Avg episode reward: [(0, '6155.624'), (1, '4786.138')] [2023-12-26 04:32:48,947][123090] Updated weights for policy 1, policy_version 616839 (0.0009) [2023-12-26 04:32:48,968][123091] Updated weights for policy 0, policy_version 621239 (0.0007) [2023-12-26 04:32:48,997][123090] Updated weights for policy 1, policy_version 616849 (0.0008) [2023-12-26 04:32:49,032][123091] Updated weights for policy 0, policy_version 621249 (0.0008) [2023-12-26 04:32:49,054][123090] Updated weights for policy 1, policy_version 616859 (0.0009) [2023-12-26 04:32:49,096][123091] Updated weights for policy 0, policy_version 621259 (0.0007) [2023-12-26 04:32:49,879][123091] Updated weights for policy 0, policy_version 621269 (0.0008) [2023-12-26 04:32:49,931][123090] Updated weights for policy 1, policy_version 616869 (0.0009) [2023-12-26 04:32:49,948][123091] Updated weights for policy 0, policy_version 621279 (0.0009) [2023-12-26 04:32:49,996][123090] Updated weights for policy 1, policy_version 616879 (0.0011) [2023-12-26 04:32:50,008][123091] Updated weights for policy 0, policy_version 621289 (0.0011) [2023-12-26 04:32:50,063][123090] Updated weights for policy 1, policy_version 616889 (0.0011) [2023-12-26 04:32:50,770][123090] Updated weights for policy 1, policy_version 616899 (0.0006) [2023-12-26 04:32:50,835][123091] Updated weights for policy 0, policy_version 621299 (0.0010) [2023-12-26 04:32:50,840][123090] Updated weights for policy 1, policy_version 616909 (0.0006) [2023-12-26 04:32:50,899][123091] Updated weights for policy 0, policy_version 621309 (0.0011) [2023-12-26 04:32:50,908][123090] Updated weights for policy 1, policy_version 616919 (0.0006) [2023-12-26 04:32:50,958][123091] Updated weights for policy 0, policy_version 621319 (0.0011) [2023-12-26 04:32:51,704][123090] Updated weights for policy 1, policy_version 616929 (0.0009) [2023-12-26 04:32:51,790][123090] Updated weights for policy 1, policy_version 616940 (0.0010) [2023-12-26 04:32:51,797][123091] Updated weights for policy 0, policy_version 621329 (0.0011) [2023-12-26 04:32:51,855][123090] Updated weights for policy 1, policy_version 616950 (0.0011) [2023-12-26 04:32:51,865][123091] Updated weights for policy 0, policy_version 621339 (0.0011) [2023-12-26 04:32:51,917][123090] Updated weights for policy 1, policy_version 616960 (0.0011) [2023-12-26 04:32:51,926][123091] Updated weights for policy 0, policy_version 621349 (0.0011) [2023-12-26 04:32:51,986][123091] Updated weights for policy 0, policy_version 621359 (0.0011) [2023-12-26 04:32:52,732][123090] Updated weights for policy 1, policy_version 616970 (0.0011) [2023-12-26 04:32:52,734][123091] Updated weights for policy 0, policy_version 621369 (0.0011) [2023-12-26 04:32:52,791][123090] Updated weights for policy 1, policy_version 616980 (0.0010) [2023-12-26 04:32:52,796][123091] Updated weights for policy 0, policy_version 621379 (0.0010) [2023-12-26 04:32:52,847][123091] Updated weights for policy 0, policy_version 621389 (0.0010) [2023-12-26 04:32:52,848][123090] Updated weights for policy 1, policy_version 616990 (0.0010) [2023-12-26 04:32:53,524][123091] Updated weights for policy 0, policy_version 621399 (0.0009) [2023-12-26 04:32:53,541][123090] Updated weights for policy 1, policy_version 617000 (0.0006) [2023-12-26 04:32:53,576][123091] Updated weights for policy 0, policy_version 621409 (0.0009) [2023-12-26 04:32:53,596][123090] Updated weights for policy 1, policy_version 617010 (0.0005) [2023-12-26 04:32:53,625][123091] Updated weights for policy 0, policy_version 621419 (0.0009) [2023-12-26 04:32:53,662][123090] Updated weights for policy 1, policy_version 617020 (0.0008) [2023-12-26 04:32:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 317046784. Throughput: 0: 8888.1, 1: 8908.1. Samples: 317014428. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:53,785][121949] Avg episode reward: [(0, '6196.856'), (1, '4637.623')] [2023-12-26 04:32:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000621424_159088640.pth... [2023-12-26 04:32:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000617024_157958144.pth... [2023-12-26 04:32:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000620368_158818304.pth [2023-12-26 04:32:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000615968_157687808.pth [2023-12-26 04:32:54,440][123090] Updated weights for policy 1, policy_version 617030 (0.0010) [2023-12-26 04:32:54,472][123091] Updated weights for policy 0, policy_version 621429 (0.0008) [2023-12-26 04:32:54,503][123090] Updated weights for policy 1, policy_version 617040 (0.0011) [2023-12-26 04:32:54,521][123091] Updated weights for policy 0, policy_version 621439 (0.0008) [2023-12-26 04:32:54,562][123090] Updated weights for policy 1, policy_version 617050 (0.0010) [2023-12-26 04:32:54,574][123091] Updated weights for policy 0, policy_version 621449 (0.0007) [2023-12-26 04:32:55,392][123090] Updated weights for policy 1, policy_version 617060 (0.0010) [2023-12-26 04:32:55,427][123091] Updated weights for policy 0, policy_version 621459 (0.0009) [2023-12-26 04:32:55,447][123090] Updated weights for policy 1, policy_version 617070 (0.0010) [2023-12-26 04:32:55,480][123091] Updated weights for policy 0, policy_version 621469 (0.0007) [2023-12-26 04:32:55,511][123090] Updated weights for policy 1, policy_version 617080 (0.0010) [2023-12-26 04:32:55,534][123091] Updated weights for policy 0, policy_version 621479 (0.0009) [2023-12-26 04:32:56,334][123090] Updated weights for policy 1, policy_version 617090 (0.0010) [2023-12-26 04:32:56,376][123091] Updated weights for policy 0, policy_version 621489 (0.0009) [2023-12-26 04:32:56,400][123090] Updated weights for policy 1, policy_version 617100 (0.0011) [2023-12-26 04:32:56,425][123091] Updated weights for policy 0, policy_version 621499 (0.0006) [2023-12-26 04:32:56,456][123090] Updated weights for policy 1, policy_version 617110 (0.0010) [2023-12-26 04:32:56,470][123091] Updated weights for policy 0, policy_version 621509 (0.0010) [2023-12-26 04:32:56,519][123090] Updated weights for policy 1, policy_version 617120 (0.0010) [2023-12-26 04:32:56,527][123091] Updated weights for policy 0, policy_version 621519 (0.0007) [2023-12-26 04:32:57,216][123091] Updated weights for policy 0, policy_version 621529 (0.0006) [2023-12-26 04:32:57,286][123091] Updated weights for policy 0, policy_version 621539 (0.0006) [2023-12-26 04:32:57,337][123090] Updated weights for policy 1, policy_version 617130 (0.0010) [2023-12-26 04:32:57,349][123091] Updated weights for policy 0, policy_version 621549 (0.0006) [2023-12-26 04:32:57,385][123090] Updated weights for policy 1, policy_version 617140 (0.0010) [2023-12-26 04:32:57,446][123090] Updated weights for policy 1, policy_version 617150 (0.0010) [2023-12-26 04:32:58,054][123091] Updated weights for policy 0, policy_version 621559 (0.0009) [2023-12-26 04:32:58,125][123091] Updated weights for policy 0, policy_version 621569 (0.0011) [2023-12-26 04:32:58,192][123091] Updated weights for policy 0, policy_version 621579 (0.0009) [2023-12-26 04:32:58,265][123090] Updated weights for policy 1, policy_version 617160 (0.0008) [2023-12-26 04:32:58,325][123090] Updated weights for policy 1, policy_version 617170 (0.0008) [2023-12-26 04:32:58,402][123090] Updated weights for policy 1, policy_version 617180 (0.0008) [2023-12-26 04:32:58,785][121949] Fps is (10 sec: 18020.4, 60 sec: 17885.5, 300 sec: 17716.9). Total num frames: 317128704. Throughput: 0: 8940.9, 1: 8940.7. Samples: 317121608. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:32:58,786][121949] Avg episode reward: [(0, '6165.491'), (1, '4739.249')] [2023-12-26 04:32:59,043][123091] Updated weights for policy 0, policy_version 621589 (0.0011) [2023-12-26 04:32:59,086][123091] Updated weights for policy 0, policy_version 621599 (0.0010) [2023-12-26 04:32:59,132][123091] Updated weights for policy 0, policy_version 621609 (0.0010) [2023-12-26 04:32:59,203][123090] Updated weights for policy 1, policy_version 617190 (0.0008) [2023-12-26 04:32:59,271][123090] Updated weights for policy 1, policy_version 617200 (0.0011) [2023-12-26 04:32:59,337][123090] Updated weights for policy 1, policy_version 617210 (0.0010) [2023-12-26 04:32:59,922][123091] Updated weights for policy 0, policy_version 621619 (0.0009) [2023-12-26 04:32:59,992][123091] Updated weights for policy 0, policy_version 621629 (0.0007) [2023-12-26 04:33:00,042][123090] Updated weights for policy 1, policy_version 617220 (0.0008) [2023-12-26 04:33:00,054][123091] Updated weights for policy 0, policy_version 621639 (0.0006) [2023-12-26 04:33:00,101][123090] Updated weights for policy 1, policy_version 617230 (0.0006) [2023-12-26 04:33:00,167][123090] Updated weights for policy 1, policy_version 617240 (0.0006) [2023-12-26 04:33:00,739][123091] Updated weights for policy 0, policy_version 621649 (0.0006) [2023-12-26 04:33:00,814][123091] Updated weights for policy 0, policy_version 621659 (0.0006) [2023-12-26 04:33:00,829][123090] Updated weights for policy 1, policy_version 617250 (0.0007) [2023-12-26 04:33:00,876][123091] Updated weights for policy 0, policy_version 621669 (0.0011) [2023-12-26 04:33:00,889][123090] Updated weights for policy 1, policy_version 617260 (0.0008) [2023-12-26 04:33:00,936][123091] Updated weights for policy 0, policy_version 621679 (0.0011) [2023-12-26 04:33:00,944][123090] Updated weights for policy 1, policy_version 617270 (0.0010) [2023-12-26 04:33:00,992][123090] Updated weights for policy 1, policy_version 617280 (0.0010) [2023-12-26 04:33:01,709][123091] Updated weights for policy 0, policy_version 621689 (0.0010) [2023-12-26 04:33:01,774][123091] Updated weights for policy 0, policy_version 621699 (0.0009) [2023-12-26 04:33:01,806][123090] Updated weights for policy 1, policy_version 617290 (0.0007) [2023-12-26 04:33:01,835][123091] Updated weights for policy 0, policy_version 621709 (0.0009) [2023-12-26 04:33:01,855][123090] Updated weights for policy 1, policy_version 617300 (0.0006) [2023-12-26 04:33:01,914][123090] Updated weights for policy 1, policy_version 617310 (0.0007) [2023-12-26 04:33:02,672][123090] Updated weights for policy 1, policy_version 617320 (0.0007) [2023-12-26 04:33:02,705][123091] Updated weights for policy 0, policy_version 621719 (0.0008) [2023-12-26 04:33:02,730][123090] Updated weights for policy 1, policy_version 617330 (0.0008) [2023-12-26 04:33:02,758][123091] Updated weights for policy 0, policy_version 621729 (0.0009) [2023-12-26 04:33:02,795][123090] Updated weights for policy 1, policy_version 617340 (0.0005) [2023-12-26 04:33:02,822][123091] Updated weights for policy 0, policy_version 621739 (0.0009) [2023-12-26 04:33:03,535][123090] Updated weights for policy 1, policy_version 617350 (0.0008) [2023-12-26 04:33:03,581][123090] Updated weights for policy 1, policy_version 617360 (0.0009) [2023-12-26 04:33:03,640][123090] Updated weights for policy 1, policy_version 617370 (0.0008) [2023-12-26 04:33:03,690][123091] Updated weights for policy 0, policy_version 621749 (0.0009) [2023-12-26 04:33:03,751][123091] Updated weights for policy 0, policy_version 621759 (0.0008) [2023-12-26 04:33:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 317218816. Throughput: 0: 8893.7, 1: 8898.8. Samples: 317230384. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:33:03,785][121949] Avg episode reward: [(0, '6139.951'), (1, '4842.547')] [2023-12-26 04:33:03,813][123091] Updated weights for policy 0, policy_version 621769 (0.0008) [2023-12-26 04:33:04,506][123090] Updated weights for policy 1, policy_version 617380 (0.0007) [2023-12-26 04:33:04,579][123090] Updated weights for policy 1, policy_version 617390 (0.0008) [2023-12-26 04:33:04,643][123091] Updated weights for policy 0, policy_version 621779 (0.0008) [2023-12-26 04:33:04,646][123090] Updated weights for policy 1, policy_version 617400 (0.0010) [2023-12-26 04:33:04,701][123091] Updated weights for policy 0, policy_version 621789 (0.0009) [2023-12-26 04:33:04,771][123091] Updated weights for policy 0, policy_version 621799 (0.0010) [2023-12-26 04:33:05,411][123090] Updated weights for policy 1, policy_version 617410 (0.0008) [2023-12-26 04:33:05,459][123090] Updated weights for policy 1, policy_version 617420 (0.0005) [2023-12-26 04:33:05,504][123090] Updated weights for policy 1, policy_version 617430 (0.0005) [2023-12-26 04:33:05,557][123090] Updated weights for policy 1, policy_version 617440 (0.0005) [2023-12-26 04:33:05,651][123091] Updated weights for policy 0, policy_version 621809 (0.0009) [2023-12-26 04:33:05,702][123091] Updated weights for policy 0, policy_version 621819 (0.0008) [2023-12-26 04:33:05,750][123091] Updated weights for policy 0, policy_version 621829 (0.0009) [2023-12-26 04:33:05,797][123091] Updated weights for policy 0, policy_version 621839 (0.0009) [2023-12-26 04:33:06,387][123090] Updated weights for policy 1, policy_version 617450 (0.0010) [2023-12-26 04:33:06,469][123090] Updated weights for policy 1, policy_version 617460 (0.0006) [2023-12-26 04:33:06,536][123090] Updated weights for policy 1, policy_version 617470 (0.0009) [2023-12-26 04:33:06,631][123091] Updated weights for policy 0, policy_version 621849 (0.0007) [2023-12-26 04:33:06,690][123091] Updated weights for policy 0, policy_version 621859 (0.0011) [2023-12-26 04:33:06,759][123091] Updated weights for policy 0, policy_version 621869 (0.0011) [2023-12-26 04:33:07,367][123090] Updated weights for policy 1, policy_version 617480 (0.0009) [2023-12-26 04:33:07,415][123091] Updated weights for policy 0, policy_version 621879 (0.0007) [2023-12-26 04:33:07,436][123090] Updated weights for policy 1, policy_version 617490 (0.0009) [2023-12-26 04:33:07,486][123091] Updated weights for policy 0, policy_version 621889 (0.0006) [2023-12-26 04:33:07,500][123090] Updated weights for policy 1, policy_version 617500 (0.0009) [2023-12-26 04:33:07,551][123091] Updated weights for policy 0, policy_version 621899 (0.0006) [2023-12-26 04:33:08,136][123090] Updated weights for policy 1, policy_version 617510 (0.0007) [2023-12-26 04:33:08,214][123090] Updated weights for policy 1, policy_version 617520 (0.0005) [2023-12-26 04:33:08,245][123091] Updated weights for policy 0, policy_version 621909 (0.0008) [2023-12-26 04:33:08,269][123090] Updated weights for policy 1, policy_version 617530 (0.0009) [2023-12-26 04:33:08,296][123091] Updated weights for policy 0, policy_version 621919 (0.0010) [2023-12-26 04:33:08,387][123091] Updated weights for policy 0, policy_version 621929 (0.0010) [2023-12-26 04:33:08,784][121949] Fps is (10 sec: 18024.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 317308928. Throughput: 0: 8884.3, 1: 8926.6. Samples: 317282140. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:33:08,784][121949] Avg episode reward: [(0, '6109.751'), (1, '4977.960')] [2023-12-26 04:33:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000617536_158089216.pth... [2023-12-26 04:33:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000621936_159219712.pth... [2023-12-26 04:33:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000616512_157827072.pth [2023-12-26 04:33:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000620912_158957568.pth [2023-12-26 04:33:09,086][123091] Updated weights for policy 0, policy_version 621939 (0.0007) [2023-12-26 04:33:09,105][123090] Updated weights for policy 1, policy_version 617540 (0.0006) [2023-12-26 04:33:09,142][123091] Updated weights for policy 0, policy_version 621949 (0.0011) [2023-12-26 04:33:09,161][123090] Updated weights for policy 1, policy_version 617550 (0.0006) [2023-12-26 04:33:09,200][123091] Updated weights for policy 0, policy_version 621959 (0.0010) [2023-12-26 04:33:09,233][123090] Updated weights for policy 1, policy_version 617560 (0.0007) [2023-12-26 04:33:10,039][123091] Updated weights for policy 0, policy_version 621969 (0.0010) [2023-12-26 04:33:10,093][123090] Updated weights for policy 1, policy_version 617570 (0.0009) [2023-12-26 04:33:10,114][123091] Updated weights for policy 0, policy_version 621979 (0.0007) [2023-12-26 04:33:10,156][123090] Updated weights for policy 1, policy_version 617580 (0.0008) [2023-12-26 04:33:10,179][123091] Updated weights for policy 0, policy_version 621989 (0.0008) [2023-12-26 04:33:10,222][123090] Updated weights for policy 1, policy_version 617590 (0.0008) [2023-12-26 04:33:10,230][123091] Updated weights for policy 0, policy_version 621999 (0.0008) [2023-12-26 04:33:10,283][123090] Updated weights for policy 1, policy_version 617600 (0.0006) [2023-12-26 04:33:11,109][123090] Updated weights for policy 1, policy_version 617610 (0.0010) [2023-12-26 04:33:11,124][123091] Updated weights for policy 0, policy_version 622009 (0.0008) [2023-12-26 04:33:11,176][123090] Updated weights for policy 1, policy_version 617620 (0.0011) [2023-12-26 04:33:11,179][123091] Updated weights for policy 0, policy_version 622019 (0.0007) [2023-12-26 04:33:11,234][123091] Updated weights for policy 0, policy_version 622029 (0.0007) [2023-12-26 04:33:11,240][123090] Updated weights for policy 1, policy_version 617631 (0.0011) [2023-12-26 04:33:12,111][123090] Updated weights for policy 1, policy_version 617641 (0.0008) [2023-12-26 04:33:12,113][123091] Updated weights for policy 0, policy_version 622039 (0.0009) [2023-12-26 04:33:12,170][123091] Updated weights for policy 0, policy_version 622049 (0.0007) [2023-12-26 04:33:12,174][123090] Updated weights for policy 1, policy_version 617651 (0.0008) [2023-12-26 04:33:12,236][123091] Updated weights for policy 0, policy_version 622059 (0.0009) [2023-12-26 04:33:12,238][123090] Updated weights for policy 1, policy_version 617661 (0.0007) [2023-12-26 04:33:13,040][123091] Updated weights for policy 0, policy_version 622069 (0.0010) [2023-12-26 04:33:13,087][123090] Updated weights for policy 1, policy_version 617671 (0.0007) [2023-12-26 04:33:13,094][123091] Updated weights for policy 0, policy_version 622079 (0.0009) [2023-12-26 04:33:13,144][123091] Updated weights for policy 0, policy_version 622089 (0.0009) [2023-12-26 04:33:13,151][123090] Updated weights for policy 1, policy_version 617681 (0.0007) [2023-12-26 04:33:13,213][123090] Updated weights for policy 1, policy_version 617691 (0.0008) [2023-12-26 04:33:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 317390848. Throughput: 0: 8810.8, 1: 8772.6. Samples: 317385912. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:33:13,785][121949] Avg episode reward: [(0, '6119.853'), (1, '4247.584')] [2023-12-26 04:33:13,944][123091] Updated weights for policy 0, policy_version 622099 (0.0010) [2023-12-26 04:33:13,972][123090] Updated weights for policy 1, policy_version 617701 (0.0009) [2023-12-26 04:33:14,007][123091] Updated weights for policy 0, policy_version 622109 (0.0008) [2023-12-26 04:33:14,024][123090] Updated weights for policy 1, policy_version 617711 (0.0006) [2023-12-26 04:33:14,060][123091] Updated weights for policy 0, policy_version 622119 (0.0008) [2023-12-26 04:33:14,076][123090] Updated weights for policy 1, policy_version 617721 (0.0008) [2023-12-26 04:33:14,900][123091] Updated weights for policy 0, policy_version 622129 (0.0009) [2023-12-26 04:33:14,905][123090] Updated weights for policy 1, policy_version 617731 (0.0008) [2023-12-26 04:33:14,965][123091] Updated weights for policy 0, policy_version 622139 (0.0010) [2023-12-26 04:33:14,971][123090] Updated weights for policy 1, policy_version 617741 (0.0009) [2023-12-26 04:33:15,027][123091] Updated weights for policy 0, policy_version 622149 (0.0007) [2023-12-26 04:33:15,040][123090] Updated weights for policy 1, policy_version 617751 (0.0009) [2023-12-26 04:33:15,093][123091] Updated weights for policy 0, policy_version 622159 (0.0009) [2023-12-26 04:33:15,864][123090] Updated weights for policy 1, policy_version 617761 (0.0008) [2023-12-26 04:33:15,924][123090] Updated weights for policy 1, policy_version 617771 (0.0010) [2023-12-26 04:33:15,924][123091] Updated weights for policy 0, policy_version 622169 (0.0009) [2023-12-26 04:33:15,978][123090] Updated weights for policy 1, policy_version 617781 (0.0008) [2023-12-26 04:33:15,983][123091] Updated weights for policy 0, policy_version 622179 (0.0009) [2023-12-26 04:33:16,033][123091] Updated weights for policy 0, policy_version 622189 (0.0009) [2023-12-26 04:33:16,041][123090] Updated weights for policy 1, policy_version 617791 (0.0008) [2023-12-26 04:33:16,841][123091] Updated weights for policy 0, policy_version 622199 (0.0010) [2023-12-26 04:33:16,854][123090] Updated weights for policy 1, policy_version 617801 (0.0008) [2023-12-26 04:33:16,891][123091] Updated weights for policy 0, policy_version 622209 (0.0009) [2023-12-26 04:33:16,910][123090] Updated weights for policy 1, policy_version 617811 (0.0008) [2023-12-26 04:33:16,939][123091] Updated weights for policy 0, policy_version 622219 (0.0008) [2023-12-26 04:33:16,972][123090] Updated weights for policy 1, policy_version 617821 (0.0009) [2023-12-26 04:33:17,798][123090] Updated weights for policy 1, policy_version 617831 (0.0009) [2023-12-26 04:33:17,800][123091] Updated weights for policy 0, policy_version 622229 (0.0008) [2023-12-26 04:33:17,854][123090] Updated weights for policy 1, policy_version 617841 (0.0009) [2023-12-26 04:33:17,862][123091] Updated weights for policy 0, policy_version 622239 (0.0009) [2023-12-26 04:33:17,906][123090] Updated weights for policy 1, policy_version 617851 (0.0008) [2023-12-26 04:33:17,929][123091] Updated weights for policy 0, policy_version 622249 (0.0009) [2023-12-26 04:33:18,673][123090] Updated weights for policy 1, policy_version 617861 (0.0009) [2023-12-26 04:33:18,737][123090] Updated weights for policy 1, policy_version 617871 (0.0009) [2023-12-26 04:33:18,775][123091] Updated weights for policy 0, policy_version 622259 (0.0008) [2023-12-26 04:33:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 317472768. Throughput: 0: 8754.6, 1: 8768.2. Samples: 317490760. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:33:18,785][121949] Avg episode reward: [(0, '6150.539'), (1, '4106.293')] [2023-12-26 04:33:18,805][123090] Updated weights for policy 1, policy_version 617881 (0.0008) [2023-12-26 04:33:18,842][123091] Updated weights for policy 0, policy_version 622269 (0.0006) [2023-12-26 04:33:18,906][123091] Updated weights for policy 0, policy_version 622279 (0.0010) [2023-12-26 04:33:19,549][123090] Updated weights for policy 1, policy_version 617891 (0.0009) [2023-12-26 04:33:19,603][123091] Updated weights for policy 0, policy_version 622289 (0.0010) [2023-12-26 04:33:19,611][123090] Updated weights for policy 1, policy_version 617901 (0.0009) [2023-12-26 04:33:19,660][123091] Updated weights for policy 0, policy_version 622299 (0.0009) [2023-12-26 04:33:19,667][123090] Updated weights for policy 1, policy_version 617911 (0.0009) [2023-12-26 04:33:19,716][123091] Updated weights for policy 0, policy_version 622309 (0.0010) [2023-12-26 04:33:19,778][123091] Updated weights for policy 0, policy_version 622319 (0.0010) [2023-12-26 04:33:20,531][123090] Updated weights for policy 1, policy_version 617921 (0.0006) [2023-12-26 04:33:20,578][123091] Updated weights for policy 0, policy_version 622329 (0.0009) [2023-12-26 04:33:20,607][123090] Updated weights for policy 1, policy_version 617931 (0.0007) [2023-12-26 04:33:20,641][123091] Updated weights for policy 0, policy_version 622339 (0.0009) [2023-12-26 04:33:20,671][123090] Updated weights for policy 1, policy_version 617941 (0.0007) [2023-12-26 04:33:20,706][123091] Updated weights for policy 0, policy_version 622349 (0.0009) [2023-12-26 04:33:20,747][123090] Updated weights for policy 1, policy_version 617951 (0.0008) [2023-12-26 04:33:21,531][123090] Updated weights for policy 1, policy_version 617961 (0.0010) [2023-12-26 04:33:21,564][123091] Updated weights for policy 0, policy_version 622359 (0.0007) [2023-12-26 04:33:21,593][123090] Updated weights for policy 1, policy_version 617971 (0.0011) [2023-12-26 04:33:21,630][123091] Updated weights for policy 0, policy_version 622369 (0.0007) [2023-12-26 04:33:21,667][123090] Updated weights for policy 1, policy_version 617981 (0.0008) [2023-12-26 04:33:21,698][123091] Updated weights for policy 0, policy_version 622379 (0.0008) [2023-12-26 04:33:22,409][123090] Updated weights for policy 1, policy_version 617991 (0.0008) [2023-12-26 04:33:22,464][123090] Updated weights for policy 1, policy_version 618001 (0.0009) [2023-12-26 04:33:22,532][123090] Updated weights for policy 1, policy_version 618011 (0.0005) [2023-12-26 04:33:22,568][123091] Updated weights for policy 0, policy_version 622389 (0.0009) [2023-12-26 04:33:22,632][123091] Updated weights for policy 0, policy_version 622399 (0.0010) [2023-12-26 04:33:22,697][123091] Updated weights for policy 0, policy_version 622409 (0.0010) [2023-12-26 04:33:23,218][123090] Updated weights for policy 1, policy_version 618021 (0.0006) [2023-12-26 04:33:23,276][123090] Updated weights for policy 1, policy_version 618031 (0.0006) [2023-12-26 04:33:23,333][123090] Updated weights for policy 1, policy_version 618041 (0.0005) [2023-12-26 04:33:23,575][123091] Updated weights for policy 0, policy_version 622419 (0.0008) [2023-12-26 04:33:23,624][123091] Updated weights for policy 0, policy_version 622429 (0.0006) [2023-12-26 04:33:23,671][123091] Updated weights for policy 0, policy_version 622439 (0.0005) [2023-12-26 04:33:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 317571072. Throughput: 0: 8776.2, 1: 8766.4. Samples: 317543420. Policy #0 lag: (min: 10.0, avg: 29.9, max: 42.0) [2023-12-26 04:33:23,785][121949] Avg episode reward: [(0, '6164.530'), (1, '4639.184')] [2023-12-26 04:33:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000622448_159350784.pth... [2023-12-26 04:33:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000618048_158220288.pth... [2023-12-26 04:33:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000617024_157958144.pth [2023-12-26 04:33:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000621424_159088640.pth [2023-12-26 04:33:24,173][123090] Updated weights for policy 1, policy_version 618051 (0.0005) [2023-12-26 04:33:24,233][123090] Updated weights for policy 1, policy_version 618061 (0.0005) [2023-12-26 04:33:24,278][123090] Updated weights for policy 1, policy_version 618071 (0.0005) [2023-12-26 04:33:24,438][123091] Updated weights for policy 0, policy_version 622449 (0.0005) [2023-12-26 04:33:24,493][123091] Updated weights for policy 0, policy_version 622459 (0.0005) [2023-12-26 04:33:24,559][123091] Updated weights for policy 0, policy_version 622469 (0.0008) [2023-12-26 04:33:24,613][123091] Updated weights for policy 0, policy_version 622479 (0.0009) [2023-12-26 04:33:24,983][123090] Updated weights for policy 1, policy_version 618081 (0.0006) [2023-12-26 04:33:25,036][123090] Updated weights for policy 1, policy_version 618091 (0.0009) [2023-12-26 04:33:25,084][123090] Updated weights for policy 1, policy_version 618101 (0.0005) [2023-12-26 04:33:25,129][123090] Updated weights for policy 1, policy_version 618111 (0.0005) [2023-12-26 04:33:25,328][123091] Updated weights for policy 0, policy_version 622489 (0.0006) [2023-12-26 04:33:25,394][123091] Updated weights for policy 0, policy_version 622499 (0.0007) [2023-12-26 04:33:25,445][123091] Updated weights for policy 0, policy_version 622509 (0.0010) [2023-12-26 04:33:25,888][123090] Updated weights for policy 1, policy_version 618121 (0.0009) [2023-12-26 04:33:25,937][123090] Updated weights for policy 1, policy_version 618131 (0.0009) [2023-12-26 04:33:25,995][123090] Updated weights for policy 1, policy_version 618141 (0.0009) [2023-12-26 04:33:26,246][123091] Updated weights for policy 0, policy_version 622519 (0.0008) [2023-12-26 04:33:26,314][123091] Updated weights for policy 0, policy_version 622529 (0.0009) [2023-12-26 04:33:26,370][123091] Updated weights for policy 0, policy_version 622539 (0.0009) [2023-12-26 04:33:26,692][123090] Updated weights for policy 1, policy_version 618151 (0.0009) [2023-12-26 04:33:26,755][123090] Updated weights for policy 1, policy_version 618161 (0.0011) [2023-12-26 04:33:26,819][123090] Updated weights for policy 1, policy_version 618171 (0.0011) [2023-12-26 04:33:27,257][123091] Updated weights for policy 0, policy_version 622549 (0.0009) [2023-12-26 04:33:27,323][123091] Updated weights for policy 0, policy_version 622559 (0.0007) [2023-12-26 04:33:27,383][123091] Updated weights for policy 0, policy_version 622569 (0.0005) [2023-12-26 04:33:27,520][123090] Updated weights for policy 1, policy_version 618181 (0.0008) [2023-12-26 04:33:27,587][123090] Updated weights for policy 1, policy_version 618191 (0.0006) [2023-12-26 04:33:27,653][123090] Updated weights for policy 1, policy_version 618201 (0.0010) [2023-12-26 04:33:28,130][123091] Updated weights for policy 0, policy_version 622579 (0.0007) [2023-12-26 04:33:28,178][123091] Updated weights for policy 0, policy_version 622589 (0.0009) [2023-12-26 04:33:28,225][123091] Updated weights for policy 0, policy_version 622599 (0.0008) [2023-12-26 04:33:28,380][123090] Updated weights for policy 1, policy_version 618211 (0.0010) [2023-12-26 04:33:28,449][123090] Updated weights for policy 1, policy_version 618221 (0.0009) [2023-12-26 04:33:28,501][123090] Updated weights for policy 1, policy_version 618231 (0.0009) [2023-12-26 04:33:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 317661184. Throughput: 0: 8773.1, 1: 8884.0. Samples: 317653252. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:28,785][121949] Avg episode reward: [(0, '6165.732'), (1, '4547.870')] [2023-12-26 04:33:29,094][123091] Updated weights for policy 0, policy_version 622609 (0.0010) [2023-12-26 04:33:29,144][123091] Updated weights for policy 0, policy_version 622619 (0.0009) [2023-12-26 04:33:29,198][123091] Updated weights for policy 0, policy_version 622629 (0.0009) [2023-12-26 04:33:29,272][123091] Updated weights for policy 0, policy_version 622639 (0.0009) [2023-12-26 04:33:29,324][123090] Updated weights for policy 1, policy_version 618241 (0.0010) [2023-12-26 04:33:29,383][123090] Updated weights for policy 1, policy_version 618251 (0.0010) [2023-12-26 04:33:29,432][123090] Updated weights for policy 1, policy_version 618261 (0.0009) [2023-12-26 04:33:29,484][123090] Updated weights for policy 1, policy_version 618271 (0.0008) [2023-12-26 04:33:30,170][123091] Updated weights for policy 0, policy_version 622649 (0.0010) [2023-12-26 04:33:30,210][123090] Updated weights for policy 1, policy_version 618281 (0.0005) [2023-12-26 04:33:30,245][123091] Updated weights for policy 0, policy_version 622659 (0.0008) [2023-12-26 04:33:30,267][123090] Updated weights for policy 1, policy_version 618291 (0.0005) [2023-12-26 04:33:30,317][123091] Updated weights for policy 0, policy_version 622669 (0.0009) [2023-12-26 04:33:30,327][123090] Updated weights for policy 1, policy_version 618301 (0.0006) [2023-12-26 04:33:31,076][123090] Updated weights for policy 1, policy_version 618311 (0.0009) [2023-12-26 04:33:31,153][123091] Updated weights for policy 0, policy_version 622679 (0.0009) [2023-12-26 04:33:31,156][123090] Updated weights for policy 1, policy_version 618321 (0.0009) [2023-12-26 04:33:31,213][123090] Updated weights for policy 1, policy_version 618331 (0.0009) [2023-12-26 04:33:31,219][123091] Updated weights for policy 0, policy_version 622689 (0.0008) [2023-12-26 04:33:31,289][123091] Updated weights for policy 0, policy_version 622699 (0.0010) [2023-12-26 04:33:31,995][123090] Updated weights for policy 1, policy_version 618341 (0.0010) [2023-12-26 04:33:32,062][123090] Updated weights for policy 1, policy_version 618351 (0.0009) [2023-12-26 04:33:32,090][123091] Updated weights for policy 0, policy_version 622709 (0.0008) [2023-12-26 04:33:32,129][123090] Updated weights for policy 1, policy_version 618361 (0.0007) [2023-12-26 04:33:32,159][123091] Updated weights for policy 0, policy_version 622719 (0.0006) [2023-12-26 04:33:32,216][123091] Updated weights for policy 0, policy_version 622729 (0.0006) [2023-12-26 04:33:32,823][123090] Updated weights for policy 1, policy_version 618371 (0.0008) [2023-12-26 04:33:32,891][123090] Updated weights for policy 1, policy_version 618381 (0.0008) [2023-12-26 04:33:32,939][123091] Updated weights for policy 0, policy_version 622739 (0.0007) [2023-12-26 04:33:32,963][123090] Updated weights for policy 1, policy_version 618391 (0.0008) [2023-12-26 04:33:33,004][123091] Updated weights for policy 0, policy_version 622749 (0.0007) [2023-12-26 04:33:33,048][123091] Updated weights for policy 0, policy_version 622759 (0.0005) [2023-12-26 04:33:33,650][123090] Updated weights for policy 1, policy_version 618401 (0.0005) [2023-12-26 04:33:33,697][123091] Updated weights for policy 0, policy_version 622769 (0.0006) [2023-12-26 04:33:33,707][123090] Updated weights for policy 1, policy_version 618411 (0.0010) [2023-12-26 04:33:33,746][123091] Updated weights for policy 0, policy_version 622779 (0.0006) [2023-12-26 04:33:33,769][123090] Updated weights for policy 1, policy_version 618421 (0.0010) [2023-12-26 04:33:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 317743104. Throughput: 0: 8791.4, 1: 8979.2. Samples: 317761904. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:33,784][121949] Avg episode reward: [(0, '6116.263'), (1, '4730.845')] [2023-12-26 04:33:33,794][123091] Updated weights for policy 0, policy_version 622789 (0.0005) [2023-12-26 04:33:33,835][123090] Updated weights for policy 1, policy_version 618431 (0.0010) [2023-12-26 04:33:33,841][123091] Updated weights for policy 0, policy_version 622799 (0.0005) [2023-12-26 04:33:34,626][123090] Updated weights for policy 1, policy_version 618441 (0.0006) [2023-12-26 04:33:34,641][123091] Updated weights for policy 0, policy_version 622809 (0.0010) [2023-12-26 04:33:34,691][123090] Updated weights for policy 1, policy_version 618451 (0.0006) [2023-12-26 04:33:34,701][123091] Updated weights for policy 0, policy_version 622819 (0.0011) [2023-12-26 04:33:34,743][123090] Updated weights for policy 1, policy_version 618461 (0.0009) [2023-12-26 04:33:34,764][123091] Updated weights for policy 0, policy_version 622829 (0.0011) [2023-12-26 04:33:35,457][123091] Updated weights for policy 0, policy_version 622839 (0.0007) [2023-12-26 04:33:35,521][123091] Updated weights for policy 0, policy_version 622849 (0.0006) [2023-12-26 04:33:35,562][123090] Updated weights for policy 1, policy_version 618471 (0.0009) [2023-12-26 04:33:35,589][123091] Updated weights for policy 0, policy_version 622859 (0.0006) [2023-12-26 04:33:35,623][123090] Updated weights for policy 1, policy_version 618481 (0.0009) [2023-12-26 04:33:35,678][123090] Updated weights for policy 1, policy_version 618491 (0.0010) [2023-12-26 04:33:36,279][123091] Updated weights for policy 0, policy_version 622869 (0.0008) [2023-12-26 04:33:36,346][123091] Updated weights for policy 0, policy_version 622879 (0.0011) [2023-12-26 04:33:36,414][123091] Updated weights for policy 0, policy_version 622889 (0.0011) [2023-12-26 04:33:36,583][123090] Updated weights for policy 1, policy_version 618501 (0.0009) [2023-12-26 04:33:36,638][123090] Updated weights for policy 1, policy_version 618511 (0.0010) [2023-12-26 04:33:36,687][123090] Updated weights for policy 1, policy_version 618521 (0.0009) [2023-12-26 04:33:37,176][123091] Updated weights for policy 0, policy_version 622899 (0.0011) [2023-12-26 04:33:37,231][123091] Updated weights for policy 0, policy_version 622909 (0.0010) [2023-12-26 04:33:37,286][123091] Updated weights for policy 0, policy_version 622919 (0.0008) [2023-12-26 04:33:37,467][123090] Updated weights for policy 1, policy_version 618531 (0.0009) [2023-12-26 04:33:37,523][123090] Updated weights for policy 1, policy_version 618541 (0.0011) [2023-12-26 04:33:37,583][123090] Updated weights for policy 1, policy_version 618551 (0.0011) [2023-12-26 04:33:38,148][123091] Updated weights for policy 0, policy_version 622929 (0.0009) [2023-12-26 04:33:38,215][123091] Updated weights for policy 0, policy_version 622939 (0.0009) [2023-12-26 04:33:38,269][123091] Updated weights for policy 0, policy_version 622949 (0.0009) [2023-12-26 04:33:38,330][123091] Updated weights for policy 0, policy_version 622959 (0.0007) [2023-12-26 04:33:38,404][123090] Updated weights for policy 1, policy_version 618561 (0.0009) [2023-12-26 04:33:38,468][123090] Updated weights for policy 1, policy_version 618571 (0.0009) [2023-12-26 04:33:38,536][123090] Updated weights for policy 1, policy_version 618581 (0.0009) [2023-12-26 04:33:38,594][123090] Updated weights for policy 1, policy_version 618591 (0.0010) [2023-12-26 04:33:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 317841408. Throughput: 0: 8862.6, 1: 8963.8. Samples: 317816620. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:38,785][121949] Avg episode reward: [(0, '6103.051'), (1, '4645.303')] [2023-12-26 04:33:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000622960_159481856.pth... [2023-12-26 04:33:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000618592_158359552.pth... [2023-12-26 04:33:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000621936_159219712.pth [2023-12-26 04:33:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000617536_158089216.pth [2023-12-26 04:33:39,141][123091] Updated weights for policy 0, policy_version 622969 (0.0010) [2023-12-26 04:33:39,189][123091] Updated weights for policy 0, policy_version 622979 (0.0009) [2023-12-26 04:33:39,260][123091] Updated weights for policy 0, policy_version 622989 (0.0010) [2023-12-26 04:33:39,454][123090] Updated weights for policy 1, policy_version 618601 (0.0008) [2023-12-26 04:33:39,511][123090] Updated weights for policy 1, policy_version 618611 (0.0009) [2023-12-26 04:33:39,566][123090] Updated weights for policy 1, policy_version 618621 (0.0010) [2023-12-26 04:33:40,109][123091] Updated weights for policy 0, policy_version 622999 (0.0009) [2023-12-26 04:33:40,174][123091] Updated weights for policy 0, policy_version 623009 (0.0009) [2023-12-26 04:33:40,223][123091] Updated weights for policy 0, policy_version 623019 (0.0009) [2023-12-26 04:33:40,425][123090] Updated weights for policy 1, policy_version 618631 (0.0007) [2023-12-26 04:33:40,498][123090] Updated weights for policy 1, policy_version 618641 (0.0007) [2023-12-26 04:33:40,575][123090] Updated weights for policy 1, policy_version 618651 (0.0007) [2023-12-26 04:33:41,078][123091] Updated weights for policy 0, policy_version 623029 (0.0008) [2023-12-26 04:33:41,148][123091] Updated weights for policy 0, policy_version 623039 (0.0008) [2023-12-26 04:33:41,216][123091] Updated weights for policy 0, policy_version 623049 (0.0008) [2023-12-26 04:33:41,371][123090] Updated weights for policy 1, policy_version 618661 (0.0009) [2023-12-26 04:33:41,446][123090] Updated weights for policy 1, policy_version 618671 (0.0007) [2023-12-26 04:33:41,520][123090] Updated weights for policy 1, policy_version 618681 (0.0007) [2023-12-26 04:33:42,088][123091] Updated weights for policy 0, policy_version 623059 (0.0008) [2023-12-26 04:33:42,153][123091] Updated weights for policy 0, policy_version 623069 (0.0010) [2023-12-26 04:33:42,210][123091] Updated weights for policy 0, policy_version 623079 (0.0010) [2023-12-26 04:33:42,288][123090] Updated weights for policy 1, policy_version 618691 (0.0007) [2023-12-26 04:33:42,357][123090] Updated weights for policy 1, policy_version 618701 (0.0009) [2023-12-26 04:33:42,425][123090] Updated weights for policy 1, policy_version 618711 (0.0010) [2023-12-26 04:33:43,112][123091] Updated weights for policy 0, policy_version 623089 (0.0009) [2023-12-26 04:33:43,162][123091] Updated weights for policy 0, policy_version 623099 (0.0010) [2023-12-26 04:33:43,221][123091] Updated weights for policy 0, policy_version 623109 (0.0010) [2023-12-26 04:33:43,253][123090] Updated weights for policy 1, policy_version 618721 (0.0009) [2023-12-26 04:33:43,272][123091] Updated weights for policy 0, policy_version 623119 (0.0010) [2023-12-26 04:33:43,328][123090] Updated weights for policy 1, policy_version 618731 (0.0005) [2023-12-26 04:33:43,408][123090] Updated weights for policy 1, policy_version 618741 (0.0005) [2023-12-26 04:33:43,475][123090] Updated weights for policy 1, policy_version 618751 (0.0005) [2023-12-26 04:33:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 317923328. Throughput: 0: 8760.6, 1: 8931.7. Samples: 317917744. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:43,785][121949] Avg episode reward: [(0, '6223.736'), (1, '4676.493')] [2023-12-26 04:33:44,067][123091] Updated weights for policy 0, policy_version 623129 (0.0006) [2023-12-26 04:33:44,139][123091] Updated weights for policy 0, policy_version 623139 (0.0006) [2023-12-26 04:33:44,189][123091] Updated weights for policy 0, policy_version 623149 (0.0005) [2023-12-26 04:33:44,194][123090] Updated weights for policy 1, policy_version 618761 (0.0005) [2023-12-26 04:33:44,263][123090] Updated weights for policy 1, policy_version 618771 (0.0005) [2023-12-26 04:33:44,316][123090] Updated weights for policy 1, policy_version 618781 (0.0008) [2023-12-26 04:33:44,892][123091] Updated weights for policy 0, policy_version 623159 (0.0009) [2023-12-26 04:33:44,951][123091] Updated weights for policy 0, policy_version 623169 (0.0011) [2023-12-26 04:33:45,010][123090] Updated weights for policy 1, policy_version 618791 (0.0006) [2023-12-26 04:33:45,017][123091] Updated weights for policy 0, policy_version 623179 (0.0008) [2023-12-26 04:33:45,067][123090] Updated weights for policy 1, policy_version 618801 (0.0006) [2023-12-26 04:33:45,132][123090] Updated weights for policy 1, policy_version 618811 (0.0008) [2023-12-26 04:33:45,783][123091] Updated weights for policy 0, policy_version 623189 (0.0007) [2023-12-26 04:33:45,852][123091] Updated weights for policy 0, policy_version 623199 (0.0007) [2023-12-26 04:33:45,909][123091] Updated weights for policy 0, policy_version 623209 (0.0009) [2023-12-26 04:33:45,942][123090] Updated weights for policy 1, policy_version 618821 (0.0010) [2023-12-26 04:33:46,016][123090] Updated weights for policy 1, policy_version 618831 (0.0006) [2023-12-26 04:33:46,079][123090] Updated weights for policy 1, policy_version 618841 (0.0005) [2023-12-26 04:33:46,527][123091] Updated weights for policy 0, policy_version 623219 (0.0007) [2023-12-26 04:33:46,592][123091] Updated weights for policy 0, policy_version 623229 (0.0005) [2023-12-26 04:33:46,653][123091] Updated weights for policy 0, policy_version 623239 (0.0005) [2023-12-26 04:33:46,694][123090] Updated weights for policy 1, policy_version 618851 (0.0005) [2023-12-26 04:33:46,696][123007] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000004 [2023-12-26 04:33:46,770][123090] Updated weights for policy 1, policy_version 618861 (0.0006) [2023-12-26 04:33:46,838][123090] Updated weights for policy 1, policy_version 618871 (0.0005) [2023-12-26 04:33:47,299][123091] Updated weights for policy 0, policy_version 623249 (0.0006) [2023-12-26 04:33:47,363][123091] Updated weights for policy 0, policy_version 623259 (0.0010) [2023-12-26 04:33:47,431][123091] Updated weights for policy 0, policy_version 623269 (0.0010) [2023-12-26 04:33:47,499][123091] Updated weights for policy 0, policy_version 623279 (0.0009) [2023-12-26 04:33:47,589][123090] Updated weights for policy 1, policy_version 618881 (0.0005) [2023-12-26 04:33:47,646][123090] Updated weights for policy 1, policy_version 618891 (0.0005) [2023-12-26 04:33:47,715][123090] Updated weights for policy 1, policy_version 618901 (0.0009) [2023-12-26 04:33:47,780][123090] Updated weights for policy 1, policy_version 618911 (0.0009) [2023-12-26 04:33:48,300][123091] Updated weights for policy 0, policy_version 623289 (0.0006) [2023-12-26 04:33:48,358][123091] Updated weights for policy 0, policy_version 623299 (0.0007) [2023-12-26 04:33:48,412][123091] Updated weights for policy 0, policy_version 623309 (0.0008) [2023-12-26 04:33:48,544][123090] Updated weights for policy 1, policy_version 618921 (0.0006) [2023-12-26 04:33:48,596][123090] Updated weights for policy 1, policy_version 618931 (0.0005) [2023-12-26 04:33:48,661][123090] Updated weights for policy 1, policy_version 618941 (0.0005) [2023-12-26 04:33:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 318021632. Throughput: 0: 8818.2, 1: 8935.5. Samples: 318029304. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:48,785][121949] Avg episode reward: [(0, '6257.379'), (1, '4799.936')] [2023-12-26 04:33:49,284][123091] Updated weights for policy 0, policy_version 623319 (0.0010) [2023-12-26 04:33:49,351][123091] Updated weights for policy 0, policy_version 623329 (0.0011) [2023-12-26 04:33:49,399][123090] Updated weights for policy 1, policy_version 618951 (0.0010) [2023-12-26 04:33:49,432][123091] Updated weights for policy 0, policy_version 623339 (0.0013) [2023-12-26 04:33:49,460][123090] Updated weights for policy 1, policy_version 618961 (0.0005) [2023-12-26 04:33:49,525][123090] Updated weights for policy 1, policy_version 618971 (0.0006) [2023-12-26 04:33:50,248][123091] Updated weights for policy 0, policy_version 623349 (0.0010) [2023-12-26 04:33:50,312][123091] Updated weights for policy 0, policy_version 623359 (0.0009) [2023-12-26 04:33:50,338][123090] Updated weights for policy 1, policy_version 618981 (0.0008) [2023-12-26 04:33:50,378][123091] Updated weights for policy 0, policy_version 623369 (0.0007) [2023-12-26 04:33:50,397][123090] Updated weights for policy 1, policy_version 618991 (0.0007) [2023-12-26 04:33:50,455][123090] Updated weights for policy 1, policy_version 619001 (0.0007) [2023-12-26 04:33:51,080][123091] Updated weights for policy 0, policy_version 623379 (0.0007) [2023-12-26 04:33:51,144][123091] Updated weights for policy 0, policy_version 623389 (0.0010) [2023-12-26 04:33:51,208][123091] Updated weights for policy 0, policy_version 623399 (0.0005) [2023-12-26 04:33:51,337][123090] Updated weights for policy 1, policy_version 619011 (0.0008) [2023-12-26 04:33:51,410][123090] Updated weights for policy 1, policy_version 619021 (0.0010) [2023-12-26 04:33:51,478][123090] Updated weights for policy 1, policy_version 619031 (0.0006) [2023-12-26 04:33:52,023][123091] Updated weights for policy 0, policy_version 623409 (0.0008) [2023-12-26 04:33:52,086][123091] Updated weights for policy 0, policy_version 623419 (0.0011) [2023-12-26 04:33:52,149][123091] Updated weights for policy 0, policy_version 623429 (0.0010) [2023-12-26 04:33:52,194][123090] Updated weights for policy 1, policy_version 619041 (0.0006) [2023-12-26 04:33:52,208][123091] Updated weights for policy 0, policy_version 623439 (0.0011) [2023-12-26 04:33:52,261][123090] Updated weights for policy 1, policy_version 619051 (0.0006) [2023-12-26 04:33:52,334][123090] Updated weights for policy 1, policy_version 619061 (0.0005) [2023-12-26 04:33:52,412][123090] Updated weights for policy 1, policy_version 619071 (0.0009) [2023-12-26 04:33:52,938][123091] Updated weights for policy 0, policy_version 623449 (0.0006) [2023-12-26 04:33:52,985][123091] Updated weights for policy 0, policy_version 623459 (0.0005) [2023-12-26 04:33:53,044][123091] Updated weights for policy 0, policy_version 623469 (0.0008) [2023-12-26 04:33:53,130][123090] Updated weights for policy 1, policy_version 619081 (0.0010) [2023-12-26 04:33:53,197][123090] Updated weights for policy 1, policy_version 619091 (0.0010) [2023-12-26 04:33:53,249][123090] Updated weights for policy 1, policy_version 619101 (0.0010) [2023-12-26 04:33:53,718][123091] Updated weights for policy 0, policy_version 623479 (0.0008) [2023-12-26 04:33:53,776][123091] Updated weights for policy 0, policy_version 623489 (0.0005) [2023-12-26 04:33:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 318103552. Throughput: 0: 8832.2, 1: 8935.0. Samples: 318081668. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:53,785][121949] Avg episode reward: [(0, '6308.967'), (1, '5002.489')] [2023-12-26 04:33:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000619104_158490624.pth... [2023-12-26 04:33:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000618048_158220288.pth [2023-12-26 04:33:53,793][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000619104_158490624.pth [2023-12-26 04:33:53,843][123091] Updated weights for policy 0, policy_version 623499 (0.0006) [2023-12-26 04:33:53,870][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000623504_159621120.pth... [2023-12-26 04:33:53,873][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000622448_159350784.pth [2023-12-26 04:33:53,873][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000623504_159621120.pth [2023-12-26 04:33:53,879][123090] Updated weights for policy 1, policy_version 619111 (0.0008) [2023-12-26 04:33:53,948][123090] Updated weights for policy 1, policy_version 619121 (0.0005) [2023-12-26 04:33:54,010][123090] Updated weights for policy 1, policy_version 619131 (0.0005) [2023-12-26 04:33:54,630][123091] Updated weights for policy 0, policy_version 623509 (0.0010) [2023-12-26 04:33:54,687][123091] Updated weights for policy 0, policy_version 623519 (0.0009) [2023-12-26 04:33:54,737][123090] Updated weights for policy 1, policy_version 619141 (0.0008) [2023-12-26 04:33:54,748][123091] Updated weights for policy 0, policy_version 623529 (0.0007) [2023-12-26 04:33:54,795][123090] Updated weights for policy 1, policy_version 619151 (0.0010) [2023-12-26 04:33:54,843][123090] Updated weights for policy 1, policy_version 619161 (0.0010) [2023-12-26 04:33:55,481][123091] Updated weights for policy 0, policy_version 623539 (0.0005) [2023-12-26 04:33:55,553][123091] Updated weights for policy 0, policy_version 623549 (0.0005) [2023-12-26 04:33:55,556][123090] Updated weights for policy 1, policy_version 619171 (0.0009) [2023-12-26 04:33:55,611][123090] Updated weights for policy 1, policy_version 619181 (0.0005) [2023-12-26 04:33:55,612][123091] Updated weights for policy 0, policy_version 623559 (0.0005) [2023-12-26 04:33:55,663][123090] Updated weights for policy 1, policy_version 619191 (0.0005) [2023-12-26 04:33:56,357][123091] Updated weights for policy 0, policy_version 623569 (0.0009) [2023-12-26 04:33:56,410][123091] Updated weights for policy 0, policy_version 623579 (0.0008) [2023-12-26 04:33:56,441][123090] Updated weights for policy 1, policy_version 619201 (0.0006) [2023-12-26 04:33:56,472][123091] Updated weights for policy 0, policy_version 623589 (0.0008) [2023-12-26 04:33:56,492][123090] Updated weights for policy 1, policy_version 619211 (0.0008) [2023-12-26 04:33:56,527][123091] Updated weights for policy 0, policy_version 623599 (0.0007) [2023-12-26 04:33:56,547][123090] Updated weights for policy 1, policy_version 619221 (0.0009) [2023-12-26 04:33:56,610][123090] Updated weights for policy 1, policy_version 619231 (0.0009) [2023-12-26 04:33:57,355][123091] Updated weights for policy 0, policy_version 623609 (0.0008) [2023-12-26 04:33:57,388][123090] Updated weights for policy 1, policy_version 619241 (0.0008) [2023-12-26 04:33:57,406][123091] Updated weights for policy 0, policy_version 623619 (0.0005) [2023-12-26 04:33:57,436][123090] Updated weights for policy 1, policy_version 619251 (0.0009) [2023-12-26 04:33:57,459][123091] Updated weights for policy 0, policy_version 623629 (0.0005) [2023-12-26 04:33:57,490][123090] Updated weights for policy 1, policy_version 619261 (0.0010) [2023-12-26 04:33:58,236][123090] Updated weights for policy 1, policy_version 619271 (0.0009) [2023-12-26 04:33:58,300][123091] Updated weights for policy 0, policy_version 623639 (0.0008) [2023-12-26 04:33:58,302][123090] Updated weights for policy 1, policy_version 619281 (0.0007) [2023-12-26 04:33:58,374][123090] Updated weights for policy 1, policy_version 619291 (0.0008) [2023-12-26 04:33:58,381][123091] Updated weights for policy 0, policy_version 623649 (0.0008) [2023-12-26 04:33:58,450][123091] Updated weights for policy 0, policy_version 623659 (0.0008) [2023-12-26 04:33:58,785][121949] Fps is (10 sec: 18020.6, 60 sec: 17885.8, 300 sec: 17772.4). Total num frames: 318201856. Throughput: 0: 8887.0, 1: 9065.6. Samples: 318193800. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:33:58,786][121949] Avg episode reward: [(0, '6204.210'), (1, '4947.060')] [2023-12-26 04:33:59,203][123090] Updated weights for policy 1, policy_version 619301 (0.0009) [2023-12-26 04:33:59,275][123090] Updated weights for policy 1, policy_version 619311 (0.0009) [2023-12-26 04:33:59,342][123090] Updated weights for policy 1, policy_version 619321 (0.0010) [2023-12-26 04:33:59,371][123091] Updated weights for policy 0, policy_version 623669 (0.0008) [2023-12-26 04:33:59,431][123091] Updated weights for policy 0, policy_version 623679 (0.0009) [2023-12-26 04:33:59,480][123091] Updated weights for policy 0, policy_version 623689 (0.0008) [2023-12-26 04:34:00,147][123090] Updated weights for policy 1, policy_version 619331 (0.0009) [2023-12-26 04:34:00,192][123090] Updated weights for policy 1, policy_version 619341 (0.0005) [2023-12-26 04:34:00,239][123090] Updated weights for policy 1, policy_version 619351 (0.0005) [2023-12-26 04:34:00,308][123091] Updated weights for policy 0, policy_version 623699 (0.0009) [2023-12-26 04:34:00,362][123091] Updated weights for policy 0, policy_version 623709 (0.0009) [2023-12-26 04:34:00,417][123091] Updated weights for policy 0, policy_version 623719 (0.0009) [2023-12-26 04:34:01,052][123090] Updated weights for policy 1, policy_version 619361 (0.0006) [2023-12-26 04:34:01,118][123090] Updated weights for policy 1, policy_version 619371 (0.0010) [2023-12-26 04:34:01,174][123090] Updated weights for policy 1, policy_version 619381 (0.0009) [2023-12-26 04:34:01,228][123090] Updated weights for policy 1, policy_version 619392 (0.0010) [2023-12-26 04:34:01,249][123091] Updated weights for policy 0, policy_version 623729 (0.0008) [2023-12-26 04:34:01,311][123091] Updated weights for policy 0, policy_version 623739 (0.0008) [2023-12-26 04:34:01,383][123091] Updated weights for policy 0, policy_version 623749 (0.0008) [2023-12-26 04:34:01,439][123091] Updated weights for policy 0, policy_version 623759 (0.0008) [2023-12-26 04:34:02,177][123090] Updated weights for policy 1, policy_version 619402 (0.0010) [2023-12-26 04:34:02,211][123091] Updated weights for policy 0, policy_version 623769 (0.0008) [2023-12-26 04:34:02,224][123090] Updated weights for policy 1, policy_version 619412 (0.0009) [2023-12-26 04:34:02,276][123091] Updated weights for policy 0, policy_version 623779 (0.0009) [2023-12-26 04:34:02,279][123090] Updated weights for policy 1, policy_version 619422 (0.0008) [2023-12-26 04:34:02,339][123091] Updated weights for policy 0, policy_version 623789 (0.0008) [2023-12-26 04:34:03,117][123090] Updated weights for policy 1, policy_version 619432 (0.0006) [2023-12-26 04:34:03,179][123090] Updated weights for policy 1, policy_version 619442 (0.0005) [2023-12-26 04:34:03,181][123091] Updated weights for policy 0, policy_version 623799 (0.0007) [2023-12-26 04:34:03,236][123091] Updated weights for policy 0, policy_version 623809 (0.0005) [2023-12-26 04:34:03,240][123090] Updated weights for policy 1, policy_version 619452 (0.0005) [2023-12-26 04:34:03,285][123091] Updated weights for policy 0, policy_version 623819 (0.0005) [2023-12-26 04:34:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 318283776. Throughput: 0: 8882.4, 1: 9065.4. Samples: 318298412. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:03,784][121949] Avg episode reward: [(0, '6127.263'), (1, '4583.003')] [2023-12-26 04:34:03,944][123090] Updated weights for policy 1, policy_version 619462 (0.0007) [2023-12-26 04:34:03,983][123091] Updated weights for policy 0, policy_version 623829 (0.0006) [2023-12-26 04:34:04,008][123090] Updated weights for policy 1, policy_version 619472 (0.0007) [2023-12-26 04:34:04,050][123091] Updated weights for policy 0, policy_version 623839 (0.0007) [2023-12-26 04:34:04,078][123090] Updated weights for policy 1, policy_version 619482 (0.0010) [2023-12-26 04:34:04,113][123091] Updated weights for policy 0, policy_version 623849 (0.0006) [2023-12-26 04:34:04,855][123091] Updated weights for policy 0, policy_version 623859 (0.0007) [2023-12-26 04:34:04,906][123091] Updated weights for policy 0, policy_version 623869 (0.0010) [2023-12-26 04:34:04,917][123090] Updated weights for policy 1, policy_version 619492 (0.0007) [2023-12-26 04:34:04,961][123091] Updated weights for policy 0, policy_version 623879 (0.0008) [2023-12-26 04:34:04,977][123090] Updated weights for policy 1, policy_version 619502 (0.0008) [2023-12-26 04:34:05,039][123090] Updated weights for policy 1, policy_version 619512 (0.0010) [2023-12-26 04:34:05,684][123091] Updated weights for policy 0, policy_version 623889 (0.0011) [2023-12-26 04:34:05,735][123091] Updated weights for policy 0, policy_version 623899 (0.0010) [2023-12-26 04:34:05,790][123091] Updated weights for policy 0, policy_version 623909 (0.0010) [2023-12-26 04:34:05,825][123090] Updated weights for policy 1, policy_version 619522 (0.0008) [2023-12-26 04:34:05,852][123091] Updated weights for policy 0, policy_version 623919 (0.0010) [2023-12-26 04:34:05,881][123090] Updated weights for policy 1, policy_version 619532 (0.0005) [2023-12-26 04:34:05,937][123090] Updated weights for policy 1, policy_version 619542 (0.0005) [2023-12-26 04:34:06,004][123090] Updated weights for policy 1, policy_version 619552 (0.0007) [2023-12-26 04:34:06,703][123091] Updated weights for policy 0, policy_version 623929 (0.0011) [2023-12-26 04:34:06,775][123091] Updated weights for policy 0, policy_version 623939 (0.0011) [2023-12-26 04:34:06,781][123090] Updated weights for policy 1, policy_version 619562 (0.0009) [2023-12-26 04:34:06,839][123091] Updated weights for policy 0, policy_version 623949 (0.0011) [2023-12-26 04:34:06,843][123090] Updated weights for policy 1, policy_version 619572 (0.0006) [2023-12-26 04:34:06,899][123090] Updated weights for policy 1, policy_version 619582 (0.0009) [2023-12-26 04:34:07,640][123091] Updated weights for policy 0, policy_version 623959 (0.0009) [2023-12-26 04:34:07,698][123091] Updated weights for policy 0, policy_version 623969 (0.0009) [2023-12-26 04:34:07,727][123090] Updated weights for policy 1, policy_version 619592 (0.0006) [2023-12-26 04:34:07,755][123091] Updated weights for policy 0, policy_version 623979 (0.0008) [2023-12-26 04:34:07,797][123090] Updated weights for policy 1, policy_version 619602 (0.0005) [2023-12-26 04:34:07,859][123090] Updated weights for policy 1, policy_version 619612 (0.0005) [2023-12-26 04:34:08,495][123090] Updated weights for policy 1, policy_version 619622 (0.0007) [2023-12-26 04:34:08,549][123090] Updated weights for policy 1, policy_version 619632 (0.0009) [2023-12-26 04:34:08,581][123091] Updated weights for policy 0, policy_version 623989 (0.0008) [2023-12-26 04:34:08,614][123090] Updated weights for policy 1, policy_version 619642 (0.0006) [2023-12-26 04:34:08,637][123091] Updated weights for policy 0, policy_version 623999 (0.0008) [2023-12-26 04:34:08,697][123091] Updated weights for policy 0, policy_version 624009 (0.0008) [2023-12-26 04:34:08,785][121949] Fps is (10 sec: 18023.6, 60 sec: 17885.7, 300 sec: 17772.5). Total num frames: 318382080. Throughput: 0: 8921.0, 1: 9066.2. Samples: 318352852. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:08,785][121949] Avg episode reward: [(0, '6178.295'), (1, '4580.189')] [2023-12-26 04:34:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000624016_159752192.pth... [2023-12-26 04:34:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000619648_158629888.pth... [2023-12-26 04:34:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000618592_158359552.pth [2023-12-26 04:34:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000622960_159481856.pth [2023-12-26 04:34:09,472][123090] Updated weights for policy 1, policy_version 619652 (0.0009) [2023-12-26 04:34:09,529][123091] Updated weights for policy 0, policy_version 624019 (0.0009) [2023-12-26 04:34:09,538][123090] Updated weights for policy 1, policy_version 619662 (0.0011) [2023-12-26 04:34:09,596][123091] Updated weights for policy 0, policy_version 624029 (0.0008) [2023-12-26 04:34:09,604][123090] Updated weights for policy 1, policy_version 619672 (0.0011) [2023-12-26 04:34:09,654][123091] Updated weights for policy 0, policy_version 624039 (0.0008) [2023-12-26 04:34:10,424][123090] Updated weights for policy 1, policy_version 619682 (0.0010) [2023-12-26 04:34:10,446][123091] Updated weights for policy 0, policy_version 624049 (0.0008) [2023-12-26 04:34:10,487][123090] Updated weights for policy 1, policy_version 619692 (0.0006) [2023-12-26 04:34:10,505][123091] Updated weights for policy 0, policy_version 624059 (0.0006) [2023-12-26 04:34:10,549][123090] Updated weights for policy 1, policy_version 619702 (0.0006) [2023-12-26 04:34:10,564][123091] Updated weights for policy 0, policy_version 624069 (0.0006) [2023-12-26 04:34:10,612][123090] Updated weights for policy 1, policy_version 619712 (0.0006) [2023-12-26 04:34:10,627][123091] Updated weights for policy 0, policy_version 624079 (0.0006) [2023-12-26 04:34:11,305][123091] Updated weights for policy 0, policy_version 624089 (0.0010) [2023-12-26 04:34:11,372][123091] Updated weights for policy 0, policy_version 624099 (0.0009) [2023-12-26 04:34:11,380][123090] Updated weights for policy 1, policy_version 619722 (0.0008) [2023-12-26 04:34:11,434][123091] Updated weights for policy 0, policy_version 624109 (0.0010) [2023-12-26 04:34:11,453][123090] Updated weights for policy 1, policy_version 619732 (0.0007) [2023-12-26 04:34:11,522][123090] Updated weights for policy 1, policy_version 619742 (0.0009) [2023-12-26 04:34:12,275][123091] Updated weights for policy 0, policy_version 624119 (0.0010) [2023-12-26 04:34:12,344][123091] Updated weights for policy 0, policy_version 624129 (0.0011) [2023-12-26 04:34:12,383][123090] Updated weights for policy 1, policy_version 619752 (0.0009) [2023-12-26 04:34:12,409][123091] Updated weights for policy 0, policy_version 624139 (0.0013) [2023-12-26 04:34:12,443][123090] Updated weights for policy 1, policy_version 619762 (0.0006) [2023-12-26 04:34:12,504][123090] Updated weights for policy 1, policy_version 619772 (0.0009) [2023-12-26 04:34:13,232][123091] Updated weights for policy 0, policy_version 624149 (0.0010) [2023-12-26 04:34:13,259][123090] Updated weights for policy 1, policy_version 619782 (0.0006) [2023-12-26 04:34:13,297][123091] Updated weights for policy 0, policy_version 624159 (0.0011) [2023-12-26 04:34:13,316][123090] Updated weights for policy 1, policy_version 619792 (0.0006) [2023-12-26 04:34:13,357][123091] Updated weights for policy 0, policy_version 624169 (0.0011) [2023-12-26 04:34:13,363][123090] Updated weights for policy 1, policy_version 619802 (0.0008) [2023-12-26 04:34:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 318464000. Throughput: 0: 8923.8, 1: 8945.9. Samples: 318457384. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:13,784][121949] Avg episode reward: [(0, '6188.768'), (1, '4754.876')] [2023-12-26 04:34:14,086][123091] Updated weights for policy 0, policy_version 624179 (0.0009) [2023-12-26 04:34:14,094][123090] Updated weights for policy 1, policy_version 619812 (0.0007) [2023-12-26 04:34:14,152][123091] Updated weights for policy 0, policy_version 624189 (0.0006) [2023-12-26 04:34:14,157][123090] Updated weights for policy 1, policy_version 619822 (0.0010) [2023-12-26 04:34:14,214][123090] Updated weights for policy 1, policy_version 619832 (0.0010) [2023-12-26 04:34:14,216][123091] Updated weights for policy 0, policy_version 624199 (0.0008) [2023-12-26 04:34:14,879][123090] Updated weights for policy 1, policy_version 619842 (0.0010) [2023-12-26 04:34:14,905][123091] Updated weights for policy 0, policy_version 624209 (0.0010) [2023-12-26 04:34:14,943][123090] Updated weights for policy 1, policy_version 619852 (0.0008) [2023-12-26 04:34:14,973][123091] Updated weights for policy 0, policy_version 624219 (0.0005) [2023-12-26 04:34:15,010][123090] Updated weights for policy 1, policy_version 619862 (0.0008) [2023-12-26 04:34:15,038][123091] Updated weights for policy 0, policy_version 624229 (0.0006) [2023-12-26 04:34:15,076][123090] Updated weights for policy 1, policy_version 619872 (0.0008) [2023-12-26 04:34:15,108][123091] Updated weights for policy 0, policy_version 624239 (0.0007) [2023-12-26 04:34:15,871][123091] Updated weights for policy 0, policy_version 624249 (0.0008) [2023-12-26 04:34:15,872][123090] Updated weights for policy 1, policy_version 619882 (0.0009) [2023-12-26 04:34:15,935][123090] Updated weights for policy 1, policy_version 619892 (0.0009) [2023-12-26 04:34:15,935][123091] Updated weights for policy 0, policy_version 624259 (0.0009) [2023-12-26 04:34:15,998][123091] Updated weights for policy 0, policy_version 624269 (0.0010) [2023-12-26 04:34:16,005][123090] Updated weights for policy 1, policy_version 619902 (0.0007) [2023-12-26 04:34:16,690][123090] Updated weights for policy 1, policy_version 619912 (0.0005) [2023-12-26 04:34:16,765][123090] Updated weights for policy 1, policy_version 619922 (0.0005) [2023-12-26 04:34:16,782][123091] Updated weights for policy 0, policy_version 624279 (0.0007) [2023-12-26 04:34:16,823][123090] Updated weights for policy 1, policy_version 619932 (0.0006) [2023-12-26 04:34:16,831][123091] Updated weights for policy 0, policy_version 624289 (0.0006) [2023-12-26 04:34:16,874][123091] Updated weights for policy 0, policy_version 624299 (0.0005) [2023-12-26 04:34:17,560][123090] Updated weights for policy 1, policy_version 619942 (0.0005) [2023-12-26 04:34:17,629][123090] Updated weights for policy 1, policy_version 619952 (0.0005) [2023-12-26 04:34:17,663][123091] Updated weights for policy 0, policy_version 624309 (0.0008) [2023-12-26 04:34:17,695][123090] Updated weights for policy 1, policy_version 619962 (0.0008) [2023-12-26 04:34:17,727][123091] Updated weights for policy 0, policy_version 624319 (0.0010) [2023-12-26 04:34:17,790][123091] Updated weights for policy 0, policy_version 624329 (0.0011) [2023-12-26 04:34:18,356][123090] Updated weights for policy 1, policy_version 619972 (0.0010) [2023-12-26 04:34:18,420][123090] Updated weights for policy 1, policy_version 619982 (0.0006) [2023-12-26 04:34:18,482][123090] Updated weights for policy 1, policy_version 619992 (0.0005) [2023-12-26 04:34:18,597][123091] Updated weights for policy 0, policy_version 624339 (0.0010) [2023-12-26 04:34:18,661][123091] Updated weights for policy 0, policy_version 624349 (0.0010) [2023-12-26 04:34:18,732][123091] Updated weights for policy 0, policy_version 624359 (0.0010) [2023-12-26 04:34:18,784][121949] Fps is (10 sec: 17204.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 318554112. Throughput: 0: 8953.7, 1: 8984.7. Samples: 318569132. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:18,785][121949] Avg episode reward: [(0, '6219.347'), (1, '4665.702')] [2023-12-26 04:34:19,227][123090] Updated weights for policy 1, policy_version 620002 (0.0006) [2023-12-26 04:34:19,309][123090] Updated weights for policy 1, policy_version 620013 (0.0007) [2023-12-26 04:34:19,380][123090] Updated weights for policy 1, policy_version 620023 (0.0010) [2023-12-26 04:34:19,546][123091] Updated weights for policy 0, policy_version 624369 (0.0009) [2023-12-26 04:34:19,598][123091] Updated weights for policy 0, policy_version 624379 (0.0010) [2023-12-26 04:34:19,649][123091] Updated weights for policy 0, policy_version 624389 (0.0010) [2023-12-26 04:34:19,697][123091] Updated weights for policy 0, policy_version 624399 (0.0010) [2023-12-26 04:34:20,171][123090] Updated weights for policy 1, policy_version 620033 (0.0010) [2023-12-26 04:34:20,245][123090] Updated weights for policy 1, policy_version 620043 (0.0006) [2023-12-26 04:34:20,318][123090] Updated weights for policy 1, policy_version 620053 (0.0010) [2023-12-26 04:34:20,377][123090] Updated weights for policy 1, policy_version 620063 (0.0010) [2023-12-26 04:34:20,576][123091] Updated weights for policy 0, policy_version 624409 (0.0011) [2023-12-26 04:34:20,643][123091] Updated weights for policy 0, policy_version 624419 (0.0010) [2023-12-26 04:34:20,711][123091] Updated weights for policy 0, policy_version 624429 (0.0011) [2023-12-26 04:34:21,167][123090] Updated weights for policy 1, policy_version 620073 (0.0008) [2023-12-26 04:34:21,235][123090] Updated weights for policy 1, policy_version 620083 (0.0008) [2023-12-26 04:34:21,300][123090] Updated weights for policy 1, policy_version 620093 (0.0009) [2023-12-26 04:34:21,507][123091] Updated weights for policy 0, policy_version 624439 (0.0009) [2023-12-26 04:34:21,570][123091] Updated weights for policy 0, policy_version 624449 (0.0011) [2023-12-26 04:34:21,635][123091] Updated weights for policy 0, policy_version 624459 (0.0011) [2023-12-26 04:34:22,166][123090] Updated weights for policy 1, policy_version 620103 (0.0010) [2023-12-26 04:34:22,236][123090] Updated weights for policy 1, policy_version 620113 (0.0010) [2023-12-26 04:34:22,302][123090] Updated weights for policy 1, policy_version 620123 (0.0009) [2023-12-26 04:34:22,372][123091] Updated weights for policy 0, policy_version 624469 (0.0008) [2023-12-26 04:34:22,435][123091] Updated weights for policy 0, policy_version 624479 (0.0007) [2023-12-26 04:34:22,507][123091] Updated weights for policy 0, policy_version 624489 (0.0007) [2023-12-26 04:34:23,204][123090] Updated weights for policy 1, policy_version 620133 (0.0009) [2023-12-26 04:34:23,215][123091] Updated weights for policy 0, policy_version 624499 (0.0006) [2023-12-26 04:34:23,263][123090] Updated weights for policy 1, policy_version 620143 (0.0008) [2023-12-26 04:34:23,263][123091] Updated weights for policy 0, policy_version 624509 (0.0005) [2023-12-26 04:34:23,317][123091] Updated weights for policy 0, policy_version 624519 (0.0006) [2023-12-26 04:34:23,325][123090] Updated weights for policy 1, policy_version 620153 (0.0008) [2023-12-26 04:34:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 318644224. Throughput: 0: 8874.8, 1: 8987.5. Samples: 318620420. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:23,785][121949] Avg episode reward: [(0, '6153.592'), (1, '4649.774')] [2023-12-26 04:34:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000624528_159883264.pth... [2023-12-26 04:34:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000620160_158760960.pth... [2023-12-26 04:34:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000623504_159621120.pth [2023-12-26 04:34:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000619104_158490624.pth [2023-12-26 04:34:24,031][123091] Updated weights for policy 0, policy_version 624529 (0.0008) [2023-12-26 04:34:24,097][123091] Updated weights for policy 0, policy_version 624539 (0.0010) [2023-12-26 04:34:24,159][123091] Updated weights for policy 0, policy_version 624549 (0.0009) [2023-12-26 04:34:24,221][123091] Updated weights for policy 0, policy_version 624559 (0.0009) [2023-12-26 04:34:24,221][123090] Updated weights for policy 1, policy_version 620163 (0.0009) [2023-12-26 04:34:24,270][123090] Updated weights for policy 1, policy_version 620173 (0.0009) [2023-12-26 04:34:24,320][123090] Updated weights for policy 1, policy_version 620183 (0.0009) [2023-12-26 04:34:25,022][123091] Updated weights for policy 0, policy_version 624570 (0.0009) [2023-12-26 04:34:25,080][123091] Updated weights for policy 0, policy_version 624580 (0.0009) [2023-12-26 04:34:25,135][123091] Updated weights for policy 0, policy_version 624590 (0.0011) [2023-12-26 04:34:25,181][123090] Updated weights for policy 1, policy_version 620193 (0.0009) [2023-12-26 04:34:25,241][123090] Updated weights for policy 1, policy_version 620203 (0.0006) [2023-12-26 04:34:25,301][123090] Updated weights for policy 1, policy_version 620213 (0.0009) [2023-12-26 04:34:25,354][123090] Updated weights for policy 1, policy_version 620223 (0.0009) [2023-12-26 04:34:25,974][123091] Updated weights for policy 0, policy_version 624601 (0.0010) [2023-12-26 04:34:26,026][123091] Updated weights for policy 0, policy_version 624612 (0.0009) [2023-12-26 04:34:26,075][123091] Updated weights for policy 0, policy_version 624622 (0.0009) [2023-12-26 04:34:26,187][123090] Updated weights for policy 1, policy_version 620233 (0.0010) [2023-12-26 04:34:26,235][123090] Updated weights for policy 1, policy_version 620243 (0.0009) [2023-12-26 04:34:26,287][123090] Updated weights for policy 1, policy_version 620253 (0.0009) [2023-12-26 04:34:26,936][123091] Updated weights for policy 0, policy_version 624632 (0.0007) [2023-12-26 04:34:26,984][123091] Updated weights for policy 0, policy_version 624642 (0.0007) [2023-12-26 04:34:27,050][123091] Updated weights for policy 0, policy_version 624652 (0.0006) [2023-12-26 04:34:27,130][123090] Updated weights for policy 1, policy_version 620263 (0.0009) [2023-12-26 04:34:27,183][123090] Updated weights for policy 1, policy_version 620274 (0.0009) [2023-12-26 04:34:27,251][123090] Updated weights for policy 1, policy_version 620284 (0.0009) [2023-12-26 04:34:27,741][123091] Updated weights for policy 0, policy_version 624662 (0.0008) [2023-12-26 04:34:27,790][123091] Updated weights for policy 0, policy_version 624672 (0.0010) [2023-12-26 04:34:27,836][123091] Updated weights for policy 0, policy_version 624682 (0.0005) [2023-12-26 04:34:28,156][123090] Updated weights for policy 1, policy_version 620294 (0.0009) [2023-12-26 04:34:28,205][123090] Updated weights for policy 1, policy_version 620304 (0.0009) [2023-12-26 04:34:28,267][123090] Updated weights for policy 1, policy_version 620314 (0.0008) [2023-12-26 04:34:28,500][123091] Updated weights for policy 0, policy_version 624692 (0.0007) [2023-12-26 04:34:28,562][123091] Updated weights for policy 0, policy_version 624702 (0.0011) [2023-12-26 04:34:28,621][123091] Updated weights for policy 0, policy_version 624712 (0.0010) [2023-12-26 04:34:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 318734336. Throughput: 0: 8991.2, 1: 8944.3. Samples: 318724840. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:28,785][121949] Avg episode reward: [(0, '6090.209'), (1, '4690.591')] [2023-12-26 04:34:29,113][123090] Updated weights for policy 1, policy_version 620324 (0.0009) [2023-12-26 04:34:29,176][123090] Updated weights for policy 1, policy_version 620334 (0.0009) [2023-12-26 04:34:29,234][123090] Updated weights for policy 1, policy_version 620344 (0.0009) [2023-12-26 04:34:29,435][123091] Updated weights for policy 0, policy_version 624722 (0.0009) [2023-12-26 04:34:29,499][123091] Updated weights for policy 0, policy_version 624732 (0.0006) [2023-12-26 04:34:29,557][123091] Updated weights for policy 0, policy_version 624742 (0.0009) [2023-12-26 04:34:29,620][123091] Updated weights for policy 0, policy_version 624752 (0.0006) [2023-12-26 04:34:30,091][123090] Updated weights for policy 1, policy_version 620354 (0.0009) [2023-12-26 04:34:30,141][123090] Updated weights for policy 1, policy_version 620364 (0.0009) [2023-12-26 04:34:30,193][123090] Updated weights for policy 1, policy_version 620374 (0.0009) [2023-12-26 04:34:30,250][123090] Updated weights for policy 1, policy_version 620384 (0.0009) [2023-12-26 04:34:30,350][123091] Updated weights for policy 0, policy_version 624762 (0.0010) [2023-12-26 04:34:30,413][123091] Updated weights for policy 0, policy_version 624772 (0.0010) [2023-12-26 04:34:30,474][123091] Updated weights for policy 0, policy_version 624782 (0.0009) [2023-12-26 04:34:31,117][123090] Updated weights for policy 1, policy_version 620394 (0.0009) [2023-12-26 04:34:31,175][123090] Updated weights for policy 1, policy_version 620404 (0.0009) [2023-12-26 04:34:31,228][123090] Updated weights for policy 1, policy_version 620414 (0.0009) [2023-12-26 04:34:31,313][123091] Updated weights for policy 0, policy_version 624792 (0.0009) [2023-12-26 04:34:31,378][123091] Updated weights for policy 0, policy_version 624802 (0.0011) [2023-12-26 04:34:31,434][123091] Updated weights for policy 0, policy_version 624812 (0.0009) [2023-12-26 04:34:32,001][123090] Updated weights for policy 1, policy_version 620424 (0.0008) [2023-12-26 04:34:32,064][123090] Updated weights for policy 1, policy_version 620434 (0.0009) [2023-12-26 04:34:32,117][123090] Updated weights for policy 1, policy_version 620444 (0.0010) [2023-12-26 04:34:32,287][123091] Updated weights for policy 0, policy_version 624822 (0.0009) [2023-12-26 04:34:32,346][123091] Updated weights for policy 0, policy_version 624832 (0.0009) [2023-12-26 04:34:32,417][123091] Updated weights for policy 0, policy_version 624843 (0.0010) [2023-12-26 04:34:32,925][123090] Updated weights for policy 1, policy_version 620455 (0.0008) [2023-12-26 04:34:32,979][123090] Updated weights for policy 1, policy_version 620465 (0.0008) [2023-12-26 04:34:33,038][123090] Updated weights for policy 1, policy_version 620475 (0.0008) [2023-12-26 04:34:33,274][123091] Updated weights for policy 0, policy_version 624853 (0.0010) [2023-12-26 04:34:33,327][123091] Updated weights for policy 0, policy_version 624863 (0.0009) [2023-12-26 04:34:33,385][123091] Updated weights for policy 0, policy_version 624874 (0.0010) [2023-12-26 04:34:33,759][123090] Updated weights for policy 1, policy_version 620485 (0.0006) [2023-12-26 04:34:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 318816256. Throughput: 0: 8914.1, 1: 8872.5. Samples: 318829696. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:33,784][121949] Avg episode reward: [(0, '6104.806'), (1, '4491.256')] [2023-12-26 04:34:33,818][123090] Updated weights for policy 1, policy_version 620495 (0.0005) [2023-12-26 04:34:33,872][123090] Updated weights for policy 1, policy_version 620505 (0.0005) [2023-12-26 04:34:34,283][123091] Updated weights for policy 0, policy_version 624884 (0.0010) [2023-12-26 04:34:34,354][123091] Updated weights for policy 0, policy_version 624894 (0.0010) [2023-12-26 04:34:34,421][123091] Updated weights for policy 0, policy_version 624904 (0.0010) [2023-12-26 04:34:34,548][123090] Updated weights for policy 1, policy_version 620515 (0.0006) [2023-12-26 04:34:34,618][123090] Updated weights for policy 1, policy_version 620525 (0.0010) [2023-12-26 04:34:34,691][123090] Updated weights for policy 1, policy_version 620535 (0.0010) [2023-12-26 04:34:35,271][123091] Updated weights for policy 0, policy_version 624914 (0.0010) [2023-12-26 04:34:35,339][123091] Updated weights for policy 0, policy_version 624924 (0.0009) [2023-12-26 04:34:35,401][123091] Updated weights for policy 0, policy_version 624934 (0.0010) [2023-12-26 04:34:35,457][123091] Updated weights for policy 0, policy_version 624944 (0.0009) [2023-12-26 04:34:35,519][123090] Updated weights for policy 1, policy_version 620545 (0.0010) [2023-12-26 04:34:35,577][123090] Updated weights for policy 1, policy_version 620555 (0.0008) [2023-12-26 04:34:35,631][123090] Updated weights for policy 1, policy_version 620565 (0.0009) [2023-12-26 04:34:35,698][123090] Updated weights for policy 1, policy_version 620575 (0.0009) [2023-12-26 04:34:36,315][123091] Updated weights for policy 0, policy_version 624954 (0.0006) [2023-12-26 04:34:36,389][123091] Updated weights for policy 0, policy_version 624964 (0.0006) [2023-12-26 04:34:36,456][123091] Updated weights for policy 0, policy_version 624974 (0.0006) [2023-12-26 04:34:36,535][123090] Updated weights for policy 1, policy_version 620585 (0.0010) [2023-12-26 04:34:36,606][123090] Updated weights for policy 1, policy_version 620595 (0.0010) [2023-12-26 04:34:36,672][123090] Updated weights for policy 1, policy_version 620605 (0.0010) [2023-12-26 04:34:37,132][123091] Updated weights for policy 0, policy_version 624984 (0.0007) [2023-12-26 04:34:37,205][123091] Updated weights for policy 0, policy_version 624994 (0.0008) [2023-12-26 04:34:37,276][123091] Updated weights for policy 0, policy_version 625004 (0.0006) [2023-12-26 04:34:37,463][123090] Updated weights for policy 1, policy_version 620615 (0.0007) [2023-12-26 04:34:37,544][123090] Updated weights for policy 1, policy_version 620625 (0.0006) [2023-12-26 04:34:37,605][123090] Updated weights for policy 1, policy_version 620635 (0.0006) [2023-12-26 04:34:37,955][123091] Updated weights for policy 0, policy_version 625014 (0.0007) [2023-12-26 04:34:38,014][123091] Updated weights for policy 0, policy_version 625024 (0.0009) [2023-12-26 04:34:38,073][123091] Updated weights for policy 0, policy_version 625034 (0.0009) [2023-12-26 04:34:38,328][123090] Updated weights for policy 1, policy_version 620645 (0.0006) [2023-12-26 04:34:38,398][123090] Updated weights for policy 1, policy_version 620655 (0.0008) [2023-12-26 04:34:38,454][123090] Updated weights for policy 1, policy_version 620665 (0.0009) [2023-12-26 04:34:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 318906368. Throughput: 0: 8906.6, 1: 8872.1. Samples: 318881708. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:38,785][121949] Avg episode reward: [(0, '6116.464'), (1, '4343.284')] [2023-12-26 04:34:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000625040_160014336.pth... [2023-12-26 04:34:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000620672_158892032.pth... [2023-12-26 04:34:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000624016_159752192.pth [2023-12-26 04:34:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000619648_158629888.pth [2023-12-26 04:34:38,913][123091] Updated weights for policy 0, policy_version 625044 (0.0007) [2023-12-26 04:34:38,982][123091] Updated weights for policy 0, policy_version 625054 (0.0006) [2023-12-26 04:34:39,046][123091] Updated weights for policy 0, policy_version 625064 (0.0006) [2023-12-26 04:34:39,257][123090] Updated weights for policy 1, policy_version 620675 (0.0009) [2023-12-26 04:34:39,324][123090] Updated weights for policy 1, policy_version 620685 (0.0007) [2023-12-26 04:34:39,397][123090] Updated weights for policy 1, policy_version 620695 (0.0010) [2023-12-26 04:34:39,819][123091] Updated weights for policy 0, policy_version 625074 (0.0006) [2023-12-26 04:34:39,887][123091] Updated weights for policy 0, policy_version 625084 (0.0010) [2023-12-26 04:34:39,963][123091] Updated weights for policy 0, policy_version 625094 (0.0008) [2023-12-26 04:34:40,032][123091] Updated weights for policy 0, policy_version 625104 (0.0010) [2023-12-26 04:34:40,260][123090] Updated weights for policy 1, policy_version 620705 (0.0009) [2023-12-26 04:34:40,332][123090] Updated weights for policy 1, policy_version 620715 (0.0009) [2023-12-26 04:34:40,399][123090] Updated weights for policy 1, policy_version 620725 (0.0007) [2023-12-26 04:34:40,461][123090] Updated weights for policy 1, policy_version 620735 (0.0009) [2023-12-26 04:34:40,807][123091] Updated weights for policy 0, policy_version 625114 (0.0010) [2023-12-26 04:34:40,864][123091] Updated weights for policy 0, policy_version 625124 (0.0010) [2023-12-26 04:34:40,921][123091] Updated weights for policy 0, policy_version 625134 (0.0009) [2023-12-26 04:34:41,265][123090] Updated weights for policy 1, policy_version 620745 (0.0008) [2023-12-26 04:34:41,345][123090] Updated weights for policy 1, policy_version 620755 (0.0007) [2023-12-26 04:34:41,407][123090] Updated weights for policy 1, policy_version 620765 (0.0008) [2023-12-26 04:34:41,882][123091] Updated weights for policy 0, policy_version 625144 (0.0006) [2023-12-26 04:34:41,942][123091] Updated weights for policy 0, policy_version 625154 (0.0009) [2023-12-26 04:34:42,002][123091] Updated weights for policy 0, policy_version 625164 (0.0010) [2023-12-26 04:34:42,129][123090] Updated weights for policy 1, policy_version 620775 (0.0009) [2023-12-26 04:34:42,183][123090] Updated weights for policy 1, policy_version 620786 (0.0009) [2023-12-26 04:34:42,232][123090] Updated weights for policy 1, policy_version 620796 (0.0005) [2023-12-26 04:34:42,783][123091] Updated weights for policy 0, policy_version 625174 (0.0008) [2023-12-26 04:34:42,840][123091] Updated weights for policy 0, policy_version 625184 (0.0009) [2023-12-26 04:34:42,902][123091] Updated weights for policy 0, policy_version 625194 (0.0008) [2023-12-26 04:34:43,114][123090] Updated weights for policy 1, policy_version 620806 (0.0009) [2023-12-26 04:34:43,166][123090] Updated weights for policy 1, policy_version 620816 (0.0010) [2023-12-26 04:34:43,222][123090] Updated weights for policy 1, policy_version 620826 (0.0011) [2023-12-26 04:34:43,578][123091] Updated weights for policy 0, policy_version 625204 (0.0007) [2023-12-26 04:34:43,636][123091] Updated weights for policy 0, policy_version 625214 (0.0005) [2023-12-26 04:34:43,696][123091] Updated weights for policy 0, policy_version 625224 (0.0005) [2023-12-26 04:34:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 318996480. Throughput: 0: 8840.8, 1: 8789.6. Samples: 318987148. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:43,785][121949] Avg episode reward: [(0, '6126.260'), (1, '4290.692')] [2023-12-26 04:34:43,903][123090] Updated weights for policy 1, policy_version 620836 (0.0007) [2023-12-26 04:34:43,971][123090] Updated weights for policy 1, policy_version 620846 (0.0006) [2023-12-26 04:34:44,040][123090] Updated weights for policy 1, policy_version 620856 (0.0006) [2023-12-26 04:34:44,358][123091] Updated weights for policy 0, policy_version 625234 (0.0007) [2023-12-26 04:34:44,405][123091] Updated weights for policy 0, policy_version 625244 (0.0010) [2023-12-26 04:34:44,449][123091] Updated weights for policy 0, policy_version 625254 (0.0010) [2023-12-26 04:34:44,496][123091] Updated weights for policy 0, policy_version 625264 (0.0010) [2023-12-26 04:34:44,707][123090] Updated weights for policy 1, policy_version 620866 (0.0009) [2023-12-26 04:34:44,770][123090] Updated weights for policy 1, policy_version 620876 (0.0010) [2023-12-26 04:34:44,839][123090] Updated weights for policy 1, policy_version 620886 (0.0007) [2023-12-26 04:34:44,910][123090] Updated weights for policy 1, policy_version 620896 (0.0007) [2023-12-26 04:34:45,332][123091] Updated weights for policy 0, policy_version 625274 (0.0009) [2023-12-26 04:34:45,402][123091] Updated weights for policy 0, policy_version 625284 (0.0011) [2023-12-26 04:34:45,459][123091] Updated weights for policy 0, policy_version 625294 (0.0011) [2023-12-26 04:34:45,681][123090] Updated weights for policy 1, policy_version 620906 (0.0009) [2023-12-26 04:34:45,748][123090] Updated weights for policy 1, policy_version 620916 (0.0009) [2023-12-26 04:34:45,809][123090] Updated weights for policy 1, policy_version 620926 (0.0009) [2023-12-26 04:34:46,252][123091] Updated weights for policy 0, policy_version 625304 (0.0009) [2023-12-26 04:34:46,304][123091] Updated weights for policy 0, policy_version 625314 (0.0008) [2023-12-26 04:34:46,366][123091] Updated weights for policy 0, policy_version 625324 (0.0008) [2023-12-26 04:34:46,621][123090] Updated weights for policy 1, policy_version 620936 (0.0008) [2023-12-26 04:34:46,679][123090] Updated weights for policy 1, policy_version 620946 (0.0010) [2023-12-26 04:34:46,731][123090] Updated weights for policy 1, policy_version 620956 (0.0009) [2023-12-26 04:34:47,030][123091] Updated weights for policy 0, policy_version 625334 (0.0010) [2023-12-26 04:34:47,092][123091] Updated weights for policy 0, policy_version 625344 (0.0010) [2023-12-26 04:34:47,158][123091] Updated weights for policy 0, policy_version 625354 (0.0010) [2023-12-26 04:34:47,563][123090] Updated weights for policy 1, policy_version 620966 (0.0006) [2023-12-26 04:34:47,610][123090] Updated weights for policy 1, policy_version 620976 (0.0005) [2023-12-26 04:34:47,655][123090] Updated weights for policy 1, policy_version 620986 (0.0005) [2023-12-26 04:34:47,923][123091] Updated weights for policy 0, policy_version 625364 (0.0010) [2023-12-26 04:34:47,981][123091] Updated weights for policy 0, policy_version 625374 (0.0009) [2023-12-26 04:34:48,040][123091] Updated weights for policy 0, policy_version 625384 (0.0008) [2023-12-26 04:34:48,418][123090] Updated weights for policy 1, policy_version 620996 (0.0009) [2023-12-26 04:34:48,470][123090] Updated weights for policy 1, policy_version 621006 (0.0010) [2023-12-26 04:34:48,515][123090] Updated weights for policy 1, policy_version 621016 (0.0010) [2023-12-26 04:34:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 319086592. Throughput: 0: 8926.5, 1: 8824.2. Samples: 319097192. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:48,784][121949] Avg episode reward: [(0, '6204.564'), (1, '4292.453')] [2023-12-26 04:34:48,872][123091] Updated weights for policy 0, policy_version 625394 (0.0009) [2023-12-26 04:34:48,928][123091] Updated weights for policy 0, policy_version 625404 (0.0009) [2023-12-26 04:34:48,976][123091] Updated weights for policy 0, policy_version 625414 (0.0008) [2023-12-26 04:34:49,034][123091] Updated weights for policy 0, policy_version 625424 (0.0008) [2023-12-26 04:34:49,385][123090] Updated weights for policy 1, policy_version 621026 (0.0010) [2023-12-26 04:34:49,447][123090] Updated weights for policy 1, policy_version 621036 (0.0008) [2023-12-26 04:34:49,510][123090] Updated weights for policy 1, policy_version 621046 (0.0005) [2023-12-26 04:34:49,575][123090] Updated weights for policy 1, policy_version 621056 (0.0005) [2023-12-26 04:34:49,834][123091] Updated weights for policy 0, policy_version 625434 (0.0009) [2023-12-26 04:34:49,905][123091] Updated weights for policy 0, policy_version 625444 (0.0008) [2023-12-26 04:34:49,973][123091] Updated weights for policy 0, policy_version 625454 (0.0010) [2023-12-26 04:34:50,325][123090] Updated weights for policy 1, policy_version 621066 (0.0010) [2023-12-26 04:34:50,390][123090] Updated weights for policy 1, policy_version 621076 (0.0007) [2023-12-26 04:34:50,453][123090] Updated weights for policy 1, policy_version 621086 (0.0006) [2023-12-26 04:34:50,765][123091] Updated weights for policy 0, policy_version 625464 (0.0008) [2023-12-26 04:34:50,835][123091] Updated weights for policy 0, policy_version 625474 (0.0007) [2023-12-26 04:34:50,908][123091] Updated weights for policy 0, policy_version 625484 (0.0006) [2023-12-26 04:34:51,244][123090] Updated weights for policy 1, policy_version 621096 (0.0011) [2023-12-26 04:34:51,304][123090] Updated weights for policy 1, policy_version 621106 (0.0010) [2023-12-26 04:34:51,373][123090] Updated weights for policy 1, policy_version 621116 (0.0011) [2023-12-26 04:34:51,665][123091] Updated weights for policy 0, policy_version 625494 (0.0008) [2023-12-26 04:34:51,732][123091] Updated weights for policy 0, policy_version 625504 (0.0009) [2023-12-26 04:34:51,780][123091] Updated weights for policy 0, policy_version 625514 (0.0006) [2023-12-26 04:34:52,194][123090] Updated weights for policy 1, policy_version 621126 (0.0009) [2023-12-26 04:34:52,263][123090] Updated weights for policy 1, policy_version 621136 (0.0009) [2023-12-26 04:34:52,327][123090] Updated weights for policy 1, policy_version 621146 (0.0010) [2023-12-26 04:34:52,597][123091] Updated weights for policy 0, policy_version 625524 (0.0008) [2023-12-26 04:34:52,654][123091] Updated weights for policy 0, policy_version 625534 (0.0009) [2023-12-26 04:34:52,713][123091] Updated weights for policy 0, policy_version 625544 (0.0010) [2023-12-26 04:34:53,116][123090] Updated weights for policy 1, policy_version 621156 (0.0009) [2023-12-26 04:34:53,184][123090] Updated weights for policy 1, policy_version 621166 (0.0010) [2023-12-26 04:34:53,242][123090] Updated weights for policy 1, policy_version 621176 (0.0010) [2023-12-26 04:34:53,566][123091] Updated weights for policy 0, policy_version 625554 (0.0008) [2023-12-26 04:34:53,617][123091] Updated weights for policy 0, policy_version 625564 (0.0009) [2023-12-26 04:34:53,665][123091] Updated weights for policy 0, policy_version 625574 (0.0008) [2023-12-26 04:34:53,714][123091] Updated weights for policy 0, policy_version 625584 (0.0009) [2023-12-26 04:34:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 319176704. Throughput: 0: 8905.3, 1: 8833.6. Samples: 319151100. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:53,785][121949] Avg episode reward: [(0, '6276.366'), (1, '4567.758')] [2023-12-26 04:34:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000621184_159023104.pth... [2023-12-26 04:34:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000625584_160153600.pth... [2023-12-26 04:34:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000624528_159883264.pth [2023-12-26 04:34:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000620160_158760960.pth [2023-12-26 04:34:54,044][123090] Updated weights for policy 1, policy_version 621186 (0.0010) [2023-12-26 04:34:54,095][123090] Updated weights for policy 1, policy_version 621196 (0.0010) [2023-12-26 04:34:54,153][123090] Updated weights for policy 1, policy_version 621206 (0.0010) [2023-12-26 04:34:54,204][123090] Updated weights for policy 1, policy_version 621216 (0.0010) [2023-12-26 04:34:54,548][123091] Updated weights for policy 0, policy_version 625594 (0.0009) [2023-12-26 04:34:54,600][123091] Updated weights for policy 0, policy_version 625604 (0.0008) [2023-12-26 04:34:54,657][123091] Updated weights for policy 0, policy_version 625614 (0.0009) [2023-12-26 04:34:55,050][123090] Updated weights for policy 1, policy_version 621226 (0.0010) [2023-12-26 04:34:55,097][123090] Updated weights for policy 1, policy_version 621236 (0.0010) [2023-12-26 04:34:55,156][123090] Updated weights for policy 1, policy_version 621246 (0.0010) [2023-12-26 04:34:55,383][123091] Updated weights for policy 0, policy_version 625624 (0.0007) [2023-12-26 04:34:55,434][123091] Updated weights for policy 0, policy_version 625634 (0.0006) [2023-12-26 04:34:55,491][123091] Updated weights for policy 0, policy_version 625644 (0.0006) [2023-12-26 04:34:55,881][123090] Updated weights for policy 1, policy_version 621256 (0.0009) [2023-12-26 04:34:55,944][123090] Updated weights for policy 1, policy_version 621266 (0.0010) [2023-12-26 04:34:56,008][123090] Updated weights for policy 1, policy_version 621276 (0.0011) [2023-12-26 04:34:56,217][123091] Updated weights for policy 0, policy_version 625654 (0.0006) [2023-12-26 04:34:56,270][123091] Updated weights for policy 0, policy_version 625664 (0.0005) [2023-12-26 04:34:56,330][123091] Updated weights for policy 0, policy_version 625674 (0.0005) [2023-12-26 04:34:56,799][123090] Updated weights for policy 1, policy_version 621286 (0.0008) [2023-12-26 04:34:56,878][123090] Updated weights for policy 1, policy_version 621296 (0.0005) [2023-12-26 04:34:56,954][123090] Updated weights for policy 1, policy_version 621306 (0.0005) [2023-12-26 04:34:56,984][123091] Updated weights for policy 0, policy_version 625684 (0.0006) [2023-12-26 04:34:57,027][123091] Updated weights for policy 0, policy_version 625694 (0.0010) [2023-12-26 04:34:57,074][123091] Updated weights for policy 0, policy_version 625704 (0.0010) [2023-12-26 04:34:57,688][123090] Updated weights for policy 1, policy_version 621316 (0.0007) [2023-12-26 04:34:57,759][123091] Updated weights for policy 0, policy_version 625714 (0.0008) [2023-12-26 04:34:57,776][123090] Updated weights for policy 1, policy_version 621326 (0.0009) [2023-12-26 04:34:57,816][123091] Updated weights for policy 0, policy_version 625724 (0.0005) [2023-12-26 04:34:57,833][123090] Updated weights for policy 1, policy_version 621336 (0.0005) [2023-12-26 04:34:57,869][123091] Updated weights for policy 0, policy_version 625734 (0.0005) [2023-12-26 04:34:57,927][123091] Updated weights for policy 0, policy_version 625744 (0.0005) [2023-12-26 04:34:58,592][123090] Updated weights for policy 1, policy_version 621346 (0.0006) [2023-12-26 04:34:58,655][123090] Updated weights for policy 1, policy_version 621356 (0.0008) [2023-12-26 04:34:58,707][123091] Updated weights for policy 0, policy_version 625754 (0.0009) [2023-12-26 04:34:58,724][123090] Updated weights for policy 1, policy_version 621366 (0.0008) [2023-12-26 04:34:58,772][123091] Updated weights for policy 0, policy_version 625764 (0.0008) [2023-12-26 04:34:58,789][121949] Fps is (10 sec: 18013.1, 60 sec: 17748.2, 300 sec: 17772.2). Total num frames: 319266816. Throughput: 0: 8983.0, 1: 8855.3. Samples: 319260200. Policy #0 lag: (min: 17.0, avg: 33.8, max: 49.0) [2023-12-26 04:34:58,790][121949] Avg episode reward: [(0, '6193.342'), (1, '4940.146')] [2023-12-26 04:34:58,844][123091] Updated weights for policy 0, policy_version 625774 (0.0008) [2023-12-26 04:34:59,515][123090] Updated weights for policy 1, policy_version 621378 (0.0009) [2023-12-26 04:34:59,570][123090] Updated weights for policy 1, policy_version 621388 (0.0007) [2023-12-26 04:34:59,631][123090] Updated weights for policy 1, policy_version 621398 (0.0005) [2023-12-26 04:34:59,691][123090] Updated weights for policy 1, policy_version 621408 (0.0005) [2023-12-26 04:34:59,737][123091] Updated weights for policy 0, policy_version 625784 (0.0006) [2023-12-26 04:34:59,795][123091] Updated weights for policy 0, policy_version 625794 (0.0005) [2023-12-26 04:34:59,875][123091] Updated weights for policy 0, policy_version 625804 (0.0007) [2023-12-26 04:35:00,467][123090] Updated weights for policy 1, policy_version 621418 (0.0010) [2023-12-26 04:35:00,500][123091] Updated weights for policy 0, policy_version 625814 (0.0006) [2023-12-26 04:35:00,529][123090] Updated weights for policy 1, policy_version 621428 (0.0010) [2023-12-26 04:35:00,554][123091] Updated weights for policy 0, policy_version 625824 (0.0006) [2023-12-26 04:35:00,596][123090] Updated weights for policy 1, policy_version 621438 (0.0010) [2023-12-26 04:35:00,624][123091] Updated weights for policy 0, policy_version 625834 (0.0008) [2023-12-26 04:35:01,289][123090] Updated weights for policy 1, policy_version 621448 (0.0007) [2023-12-26 04:35:01,358][123090] Updated weights for policy 1, policy_version 621458 (0.0008) [2023-12-26 04:35:01,427][123090] Updated weights for policy 1, policy_version 621468 (0.0007) [2023-12-26 04:35:01,430][123091] Updated weights for policy 0, policy_version 625844 (0.0010) [2023-12-26 04:35:01,498][123091] Updated weights for policy 0, policy_version 625854 (0.0010) [2023-12-26 04:35:01,569][123091] Updated weights for policy 0, policy_version 625864 (0.0006) [2023-12-26 04:35:02,139][123090] Updated weights for policy 1, policy_version 621478 (0.0005) [2023-12-26 04:35:02,185][123090] Updated weights for policy 1, policy_version 621488 (0.0005) [2023-12-26 04:35:02,230][123090] Updated weights for policy 1, policy_version 621498 (0.0005) [2023-12-26 04:35:02,386][123091] Updated weights for policy 0, policy_version 625874 (0.0007) [2023-12-26 04:35:02,434][123091] Updated weights for policy 0, policy_version 625884 (0.0009) [2023-12-26 04:35:02,489][123091] Updated weights for policy 0, policy_version 625894 (0.0010) [2023-12-26 04:35:02,542][123091] Updated weights for policy 0, policy_version 625904 (0.0009) [2023-12-26 04:35:03,046][123090] Updated weights for policy 1, policy_version 621508 (0.0009) [2023-12-26 04:35:03,104][123090] Updated weights for policy 1, policy_version 621518 (0.0010) [2023-12-26 04:35:03,158][123090] Updated weights for policy 1, policy_version 621528 (0.0010) [2023-12-26 04:35:03,356][123091] Updated weights for policy 0, policy_version 625914 (0.0010) [2023-12-26 04:35:03,403][123091] Updated weights for policy 0, policy_version 625924 (0.0006) [2023-12-26 04:35:03,457][123091] Updated weights for policy 0, policy_version 625934 (0.0005) [2023-12-26 04:35:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 319356928. Throughput: 0: 8972.5, 1: 8786.1. Samples: 319368272. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:03,785][121949] Avg episode reward: [(0, '6251.067'), (1, '5131.834')] [2023-12-26 04:35:03,961][123090] Updated weights for policy 1, policy_version 621538 (0.0008) [2023-12-26 04:35:04,020][123090] Updated weights for policy 1, policy_version 621548 (0.0007) [2023-12-26 04:35:04,072][123090] Updated weights for policy 1, policy_version 621558 (0.0006) [2023-12-26 04:35:04,118][123091] Updated weights for policy 0, policy_version 625944 (0.0010) [2023-12-26 04:35:04,133][123090] Updated weights for policy 1, policy_version 621568 (0.0006) [2023-12-26 04:35:04,170][123091] Updated weights for policy 0, policy_version 625954 (0.0011) [2023-12-26 04:35:04,230][123091] Updated weights for policy 0, policy_version 625964 (0.0011) [2023-12-26 04:35:04,841][123090] Updated weights for policy 1, policy_version 621578 (0.0005) [2023-12-26 04:35:04,911][123090] Updated weights for policy 1, policy_version 621588 (0.0007) [2023-12-26 04:35:04,981][123090] Updated weights for policy 1, policy_version 621598 (0.0006) [2023-12-26 04:35:05,057][123091] Updated weights for policy 0, policy_version 625974 (0.0007) [2023-12-26 04:35:05,123][123091] Updated weights for policy 0, policy_version 625984 (0.0005) [2023-12-26 04:35:05,188][123091] Updated weights for policy 0, policy_version 625994 (0.0005) [2023-12-26 04:35:05,747][123090] Updated weights for policy 1, policy_version 621608 (0.0005) [2023-12-26 04:35:05,821][123090] Updated weights for policy 1, policy_version 621618 (0.0005) [2023-12-26 04:35:05,866][123090] Updated weights for policy 1, policy_version 621628 (0.0007) [2023-12-26 04:35:05,914][123091] Updated weights for policy 0, policy_version 626004 (0.0007) [2023-12-26 04:35:05,966][123091] Updated weights for policy 0, policy_version 626014 (0.0009) [2023-12-26 04:35:06,021][123091] Updated weights for policy 0, policy_version 626024 (0.0009) [2023-12-26 04:35:06,613][123090] Updated weights for policy 1, policy_version 621638 (0.0009) [2023-12-26 04:35:06,680][123090] Updated weights for policy 1, policy_version 621648 (0.0009) [2023-12-26 04:35:06,748][123090] Updated weights for policy 1, policy_version 621658 (0.0010) [2023-12-26 04:35:06,890][123091] Updated weights for policy 0, policy_version 626034 (0.0009) [2023-12-26 04:35:06,956][123091] Updated weights for policy 0, policy_version 626044 (0.0010) [2023-12-26 04:35:07,028][123091] Updated weights for policy 0, policy_version 626054 (0.0009) [2023-12-26 04:35:07,089][123091] Updated weights for policy 0, policy_version 626064 (0.0009) [2023-12-26 04:35:07,588][123090] Updated weights for policy 1, policy_version 621668 (0.0010) [2023-12-26 04:35:07,654][123090] Updated weights for policy 1, policy_version 621678 (0.0009) [2023-12-26 04:35:07,720][123090] Updated weights for policy 1, policy_version 621688 (0.0010) [2023-12-26 04:35:07,883][123091] Updated weights for policy 0, policy_version 626074 (0.0011) [2023-12-26 04:35:07,931][123091] Updated weights for policy 0, policy_version 626084 (0.0010) [2023-12-26 04:35:07,983][123091] Updated weights for policy 0, policy_version 626094 (0.0010) [2023-12-26 04:35:08,520][123090] Updated weights for policy 1, policy_version 621698 (0.0009) [2023-12-26 04:35:08,586][123090] Updated weights for policy 1, policy_version 621708 (0.0008) [2023-12-26 04:35:08,654][123090] Updated weights for policy 1, policy_version 621718 (0.0008) [2023-12-26 04:35:08,718][123090] Updated weights for policy 1, policy_version 621728 (0.0009) [2023-12-26 04:35:08,748][123091] Updated weights for policy 0, policy_version 626104 (0.0007) [2023-12-26 04:35:08,784][121949] Fps is (10 sec: 18031.6, 60 sec: 17749.5, 300 sec: 17772.5). Total num frames: 319447040. Throughput: 0: 9019.7, 1: 8840.4. Samples: 319424120. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:08,785][121949] Avg episode reward: [(0, '6139.824'), (1, '5346.623')] [2023-12-26 04:35:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000621728_159162368.pth... [2023-12-26 04:35:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000620672_158892032.pth [2023-12-26 04:35:08,814][123091] Updated weights for policy 0, policy_version 626114 (0.0009) [2023-12-26 04:35:08,881][123091] Updated weights for policy 0, policy_version 626124 (0.0005) [2023-12-26 04:35:08,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000626128_160292864.pth... [2023-12-26 04:35:08,910][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000625040_160014336.pth [2023-12-26 04:35:09,594][123090] Updated weights for policy 1, policy_version 621738 (0.0010) [2023-12-26 04:35:09,631][123091] Updated weights for policy 0, policy_version 626134 (0.0007) [2023-12-26 04:35:09,655][123090] Updated weights for policy 1, policy_version 621748 (0.0009) [2023-12-26 04:35:09,695][123091] Updated weights for policy 0, policy_version 626144 (0.0006) [2023-12-26 04:35:09,721][123090] Updated weights for policy 1, policy_version 621758 (0.0009) [2023-12-26 04:35:09,751][123091] Updated weights for policy 0, policy_version 626154 (0.0006) [2023-12-26 04:35:10,531][123090] Updated weights for policy 1, policy_version 621768 (0.0010) [2023-12-26 04:35:10,547][123091] Updated weights for policy 0, policy_version 626164 (0.0007) [2023-12-26 04:35:10,590][123090] Updated weights for policy 1, policy_version 621778 (0.0011) [2023-12-26 04:35:10,614][123091] Updated weights for policy 0, policy_version 626174 (0.0009) [2023-12-26 04:35:10,655][123090] Updated weights for policy 1, policy_version 621788 (0.0010) [2023-12-26 04:35:10,675][123091] Updated weights for policy 0, policy_version 626184 (0.0006) [2023-12-26 04:35:11,508][123090] Updated weights for policy 1, policy_version 621798 (0.0007) [2023-12-26 04:35:11,555][123091] Updated weights for policy 0, policy_version 626194 (0.0009) [2023-12-26 04:35:11,579][123090] Updated weights for policy 1, policy_version 621808 (0.0008) [2023-12-26 04:35:11,613][123091] Updated weights for policy 0, policy_version 626204 (0.0009) [2023-12-26 04:35:11,653][123090] Updated weights for policy 1, policy_version 621818 (0.0009) [2023-12-26 04:35:11,684][123091] Updated weights for policy 0, policy_version 626214 (0.0009) [2023-12-26 04:35:11,756][123091] Updated weights for policy 0, policy_version 626224 (0.0009) [2023-12-26 04:35:12,501][123090] Updated weights for policy 1, policy_version 621828 (0.0008) [2023-12-26 04:35:12,558][123090] Updated weights for policy 1, policy_version 621838 (0.0005) [2023-12-26 04:35:12,611][123090] Updated weights for policy 1, policy_version 621848 (0.0008) [2023-12-26 04:35:12,616][123091] Updated weights for policy 0, policy_version 626234 (0.0005) [2023-12-26 04:35:12,681][123091] Updated weights for policy 0, policy_version 626244 (0.0008) [2023-12-26 04:35:12,745][123091] Updated weights for policy 0, policy_version 626254 (0.0010) [2023-12-26 04:35:13,243][123090] Updated weights for policy 1, policy_version 621858 (0.0008) [2023-12-26 04:35:13,302][123090] Updated weights for policy 1, policy_version 621868 (0.0005) [2023-12-26 04:35:13,351][123090] Updated weights for policy 1, policy_version 621878 (0.0005) [2023-12-26 04:35:13,409][123090] Updated weights for policy 1, policy_version 621888 (0.0009) [2023-12-26 04:35:13,590][123091] Updated weights for policy 0, policy_version 626264 (0.0009) [2023-12-26 04:35:13,656][123091] Updated weights for policy 0, policy_version 626274 (0.0010) [2023-12-26 04:35:13,723][123091] Updated weights for policy 0, policy_version 626284 (0.0010) [2023-12-26 04:35:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 319537152. Throughput: 0: 8961.4, 1: 8864.3. Samples: 319526996. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:13,785][121949] Avg episode reward: [(0, '6112.149'), (1, '5341.137')] [2023-12-26 04:35:14,151][123090] Updated weights for policy 1, policy_version 621898 (0.0006) [2023-12-26 04:35:14,211][123090] Updated weights for policy 1, policy_version 621908 (0.0007) [2023-12-26 04:35:14,267][123090] Updated weights for policy 1, policy_version 621918 (0.0006) [2023-12-26 04:35:14,460][123091] Updated weights for policy 0, policy_version 626294 (0.0009) [2023-12-26 04:35:14,513][123091] Updated weights for policy 0, policy_version 626304 (0.0010) [2023-12-26 04:35:14,567][123091] Updated weights for policy 0, policy_version 626314 (0.0009) [2023-12-26 04:35:14,998][123090] Updated weights for policy 1, policy_version 621928 (0.0008) [2023-12-26 04:35:15,059][123090] Updated weights for policy 1, policy_version 621938 (0.0008) [2023-12-26 04:35:15,115][123090] Updated weights for policy 1, policy_version 621948 (0.0008) [2023-12-26 04:35:15,495][123091] Updated weights for policy 0, policy_version 626325 (0.0010) [2023-12-26 04:35:15,558][123091] Updated weights for policy 0, policy_version 626335 (0.0010) [2023-12-26 04:35:15,617][123091] Updated weights for policy 0, policy_version 626345 (0.0010) [2023-12-26 04:35:15,880][123090] Updated weights for policy 1, policy_version 621958 (0.0009) [2023-12-26 04:35:15,933][123090] Updated weights for policy 1, policy_version 621968 (0.0009) [2023-12-26 04:35:15,986][123090] Updated weights for policy 1, policy_version 621978 (0.0009) [2023-12-26 04:35:16,466][123091] Updated weights for policy 0, policy_version 626355 (0.0009) [2023-12-26 04:35:16,517][123091] Updated weights for policy 0, policy_version 626365 (0.0010) [2023-12-26 04:35:16,577][123091] Updated weights for policy 0, policy_version 626375 (0.0010) [2023-12-26 04:35:16,792][123090] Updated weights for policy 1, policy_version 621988 (0.0009) [2023-12-26 04:35:16,854][123090] Updated weights for policy 1, policy_version 621998 (0.0008) [2023-12-26 04:35:16,924][123090] Updated weights for policy 1, policy_version 622008 (0.0008) [2023-12-26 04:35:17,456][123091] Updated weights for policy 0, policy_version 626385 (0.0010) [2023-12-26 04:35:17,512][123091] Updated weights for policy 0, policy_version 626395 (0.0009) [2023-12-26 04:35:17,565][123091] Updated weights for policy 0, policy_version 626406 (0.0010) [2023-12-26 04:35:17,620][123091] Updated weights for policy 0, policy_version 626416 (0.0010) [2023-12-26 04:35:17,718][123090] Updated weights for policy 1, policy_version 622018 (0.0009) [2023-12-26 04:35:17,777][123090] Updated weights for policy 1, policy_version 622028 (0.0009) [2023-12-26 04:35:17,838][123090] Updated weights for policy 1, policy_version 622038 (0.0009) [2023-12-26 04:35:17,908][123090] Updated weights for policy 1, policy_version 622048 (0.0006) [2023-12-26 04:35:18,495][123091] Updated weights for policy 0, policy_version 626426 (0.0005) [2023-12-26 04:35:18,554][123091] Updated weights for policy 0, policy_version 626436 (0.0009) [2023-12-26 04:35:18,592][123090] Updated weights for policy 1, policy_version 622058 (0.0009) [2023-12-26 04:35:18,610][123091] Updated weights for policy 0, policy_version 626446 (0.0007) [2023-12-26 04:35:18,648][123090] Updated weights for policy 1, policy_version 622068 (0.0009) [2023-12-26 04:35:18,712][123090] Updated weights for policy 1, policy_version 622078 (0.0010) [2023-12-26 04:35:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 319627264. Throughput: 0: 8892.1, 1: 8947.0. Samples: 319632456. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:18,784][121949] Avg episode reward: [(0, '6205.616'), (1, '5171.658')] [2023-12-26 04:35:19,302][123091] Updated weights for policy 0, policy_version 626456 (0.0009) [2023-12-26 04:35:19,373][123091] Updated weights for policy 0, policy_version 626466 (0.0009) [2023-12-26 04:35:19,433][123091] Updated weights for policy 0, policy_version 626476 (0.0009) [2023-12-26 04:35:19,588][123090] Updated weights for policy 1, policy_version 622088 (0.0009) [2023-12-26 04:35:19,652][123090] Updated weights for policy 1, policy_version 622098 (0.0010) [2023-12-26 04:35:19,712][123090] Updated weights for policy 1, policy_version 622108 (0.0010) [2023-12-26 04:35:20,212][123091] Updated weights for policy 0, policy_version 626486 (0.0007) [2023-12-26 04:35:20,267][123091] Updated weights for policy 0, policy_version 626496 (0.0007) [2023-12-26 04:35:20,326][123091] Updated weights for policy 0, policy_version 626506 (0.0009) [2023-12-26 04:35:20,623][123090] Updated weights for policy 1, policy_version 622118 (0.0010) [2023-12-26 04:35:20,685][123090] Updated weights for policy 1, policy_version 622128 (0.0010) [2023-12-26 04:35:20,758][123090] Updated weights for policy 1, policy_version 622138 (0.0008) [2023-12-26 04:35:21,074][123091] Updated weights for policy 0, policy_version 626516 (0.0009) [2023-12-26 04:35:21,143][123091] Updated weights for policy 0, policy_version 626526 (0.0009) [2023-12-26 04:35:21,211][123091] Updated weights for policy 0, policy_version 626536 (0.0009) [2023-12-26 04:35:21,582][123090] Updated weights for policy 1, policy_version 622148 (0.0009) [2023-12-26 04:35:21,649][123090] Updated weights for policy 1, policy_version 622158 (0.0009) [2023-12-26 04:35:21,711][123090] Updated weights for policy 1, policy_version 622168 (0.0010) [2023-12-26 04:35:22,095][123091] Updated weights for policy 0, policy_version 626546 (0.0009) [2023-12-26 04:35:22,170][123091] Updated weights for policy 0, policy_version 626556 (0.0005) [2023-12-26 04:35:22,244][123091] Updated weights for policy 0, policy_version 626566 (0.0006) [2023-12-26 04:35:22,305][123091] Updated weights for policy 0, policy_version 626576 (0.0008) [2023-12-26 04:35:22,642][123090] Updated weights for policy 1, policy_version 622178 (0.0009) [2023-12-26 04:35:22,701][123090] Updated weights for policy 1, policy_version 622188 (0.0010) [2023-12-26 04:35:22,757][123090] Updated weights for policy 1, policy_version 622198 (0.0010) [2023-12-26 04:35:22,817][123090] Updated weights for policy 1, policy_version 622208 (0.0011) [2023-12-26 04:35:23,082][123091] Updated weights for policy 0, policy_version 626586 (0.0009) [2023-12-26 04:35:23,142][123091] Updated weights for policy 0, policy_version 626596 (0.0008) [2023-12-26 04:35:23,202][123091] Updated weights for policy 0, policy_version 626606 (0.0009) [2023-12-26 04:35:23,653][123090] Updated weights for policy 1, policy_version 622218 (0.0010) [2023-12-26 04:35:23,701][123090] Updated weights for policy 1, policy_version 622228 (0.0010) [2023-12-26 04:35:23,763][123090] Updated weights for policy 1, policy_version 622238 (0.0010) [2023-12-26 04:35:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 319709184. Throughput: 0: 8900.1, 1: 8908.5. Samples: 319683096. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:23,785][121949] Avg episode reward: [(0, '6101.521'), (1, '5109.880')] [2023-12-26 04:35:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000626608_160415744.pth... [2023-12-26 04:35:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000622240_159293440.pth... [2023-12-26 04:35:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000625584_160153600.pth [2023-12-26 04:35:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000621184_159023104.pth [2023-12-26 04:35:23,933][123091] Updated weights for policy 0, policy_version 626616 (0.0006) [2023-12-26 04:35:23,978][123091] Updated weights for policy 0, policy_version 626626 (0.0007) [2023-12-26 04:35:24,026][123091] Updated weights for policy 0, policy_version 626636 (0.0006) [2023-12-26 04:35:24,587][123090] Updated weights for policy 1, policy_version 622248 (0.0010) [2023-12-26 04:35:24,637][123090] Updated weights for policy 1, policy_version 622258 (0.0010) [2023-12-26 04:35:24,686][123090] Updated weights for policy 1, policy_version 622268 (0.0010) [2023-12-26 04:35:24,760][123091] Updated weights for policy 0, policy_version 626646 (0.0008) [2023-12-26 04:35:24,830][123091] Updated weights for policy 0, policy_version 626656 (0.0010) [2023-12-26 04:35:24,885][123091] Updated weights for policy 0, policy_version 626666 (0.0010) [2023-12-26 04:35:25,433][123090] Updated weights for policy 1, policy_version 622278 (0.0007) [2023-12-26 04:35:25,493][123090] Updated weights for policy 1, policy_version 622288 (0.0005) [2023-12-26 04:35:25,553][123090] Updated weights for policy 1, policy_version 622298 (0.0005) [2023-12-26 04:35:25,686][123091] Updated weights for policy 0, policy_version 626676 (0.0008) [2023-12-26 04:35:25,739][123091] Updated weights for policy 0, policy_version 626686 (0.0005) [2023-12-26 04:35:25,791][123091] Updated weights for policy 0, policy_version 626696 (0.0005) [2023-12-26 04:35:26,280][123090] Updated weights for policy 1, policy_version 622308 (0.0007) [2023-12-26 04:35:26,335][123090] Updated weights for policy 1, policy_version 622318 (0.0010) [2023-12-26 04:35:26,393][123090] Updated weights for policy 1, policy_version 622328 (0.0009) [2023-12-26 04:35:26,478][123091] Updated weights for policy 0, policy_version 626706 (0.0005) [2023-12-26 04:35:26,530][123091] Updated weights for policy 0, policy_version 626716 (0.0010) [2023-12-26 04:35:26,580][123091] Updated weights for policy 0, policy_version 626726 (0.0010) [2023-12-26 04:35:26,627][123091] Updated weights for policy 0, policy_version 626736 (0.0010) [2023-12-26 04:35:27,100][123090] Updated weights for policy 1, policy_version 622338 (0.0006) [2023-12-26 04:35:27,156][123090] Updated weights for policy 1, policy_version 622348 (0.0009) [2023-12-26 04:35:27,205][123090] Updated weights for policy 1, policy_version 622358 (0.0008) [2023-12-26 04:35:27,258][123090] Updated weights for policy 1, policy_version 622368 (0.0009) [2023-12-26 04:35:27,392][123091] Updated weights for policy 0, policy_version 626746 (0.0005) [2023-12-26 04:35:27,451][123091] Updated weights for policy 0, policy_version 626756 (0.0005) [2023-12-26 04:35:27,512][123091] Updated weights for policy 0, policy_version 626766 (0.0008) [2023-12-26 04:35:28,161][123090] Updated weights for policy 1, policy_version 622378 (0.0010) [2023-12-26 04:35:28,225][123090] Updated weights for policy 1, policy_version 622388 (0.0008) [2023-12-26 04:35:28,230][123091] Updated weights for policy 0, policy_version 626776 (0.0006) [2023-12-26 04:35:28,277][123091] Updated weights for policy 0, policy_version 626786 (0.0007) [2023-12-26 04:35:28,283][123090] Updated weights for policy 1, policy_version 622398 (0.0008) [2023-12-26 04:35:28,325][123091] Updated weights for policy 0, policy_version 626796 (0.0007) [2023-12-26 04:35:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 319799296. Throughput: 0: 8972.2, 1: 8908.8. Samples: 319791796. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:28,785][121949] Avg episode reward: [(0, '6136.933'), (1, '5269.825')] [2023-12-26 04:35:29,129][123091] Updated weights for policy 0, policy_version 626806 (0.0008) [2023-12-26 04:35:29,147][123090] Updated weights for policy 1, policy_version 622408 (0.0010) [2023-12-26 04:35:29,191][123091] Updated weights for policy 0, policy_version 626816 (0.0009) [2023-12-26 04:35:29,195][123090] Updated weights for policy 1, policy_version 622418 (0.0008) [2023-12-26 04:35:29,252][123090] Updated weights for policy 1, policy_version 622428 (0.0008) [2023-12-26 04:35:29,254][123091] Updated weights for policy 0, policy_version 626826 (0.0009) [2023-12-26 04:35:30,093][123090] Updated weights for policy 1, policy_version 622438 (0.0009) [2023-12-26 04:35:30,098][123091] Updated weights for policy 0, policy_version 626836 (0.0009) [2023-12-26 04:35:30,144][123090] Updated weights for policy 1, policy_version 622448 (0.0006) [2023-12-26 04:35:30,168][123091] Updated weights for policy 0, policy_version 626846 (0.0009) [2023-12-26 04:35:30,193][123090] Updated weights for policy 1, policy_version 622458 (0.0008) [2023-12-26 04:35:30,227][123091] Updated weights for policy 0, policy_version 626856 (0.0006) [2023-12-26 04:35:30,938][123091] Updated weights for policy 0, policy_version 626866 (0.0007) [2023-12-26 04:35:31,002][123091] Updated weights for policy 0, policy_version 626876 (0.0009) [2023-12-26 04:35:31,063][123091] Updated weights for policy 0, policy_version 626886 (0.0009) [2023-12-26 04:35:31,075][123090] Updated weights for policy 1, policy_version 622468 (0.0008) [2023-12-26 04:35:31,132][123091] Updated weights for policy 0, policy_version 626896 (0.0007) [2023-12-26 04:35:31,146][123090] Updated weights for policy 1, policy_version 622478 (0.0009) [2023-12-26 04:35:31,214][123090] Updated weights for policy 1, policy_version 622488 (0.0009) [2023-12-26 04:35:31,935][123091] Updated weights for policy 0, policy_version 626906 (0.0009) [2023-12-26 04:35:32,002][123091] Updated weights for policy 0, policy_version 626916 (0.0010) [2023-12-26 04:35:32,028][123090] Updated weights for policy 1, policy_version 622498 (0.0010) [2023-12-26 04:35:32,054][123091] Updated weights for policy 0, policy_version 626926 (0.0008) [2023-12-26 04:35:32,093][123090] Updated weights for policy 1, policy_version 622508 (0.0009) [2023-12-26 04:35:32,162][123090] Updated weights for policy 1, policy_version 622518 (0.0010) [2023-12-26 04:35:32,865][123091] Updated weights for policy 0, policy_version 626936 (0.0007) [2023-12-26 04:35:32,922][123091] Updated weights for policy 0, policy_version 626946 (0.0006) [2023-12-26 04:35:32,971][123091] Updated weights for policy 0, policy_version 626956 (0.0007) [2023-12-26 04:35:33,026][123090] Updated weights for policy 1, policy_version 622529 (0.0010) [2023-12-26 04:35:33,090][123090] Updated weights for policy 1, policy_version 622539 (0.0010) [2023-12-26 04:35:33,154][123090] Updated weights for policy 1, policy_version 622549 (0.0009) [2023-12-26 04:35:33,206][123090] Updated weights for policy 1, policy_version 622559 (0.0009) [2023-12-26 04:35:33,689][123091] Updated weights for policy 0, policy_version 626966 (0.0006) [2023-12-26 04:35:33,740][123091] Updated weights for policy 0, policy_version 626976 (0.0006) [2023-12-26 04:35:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 319881216. Throughput: 0: 8979.5, 1: 8793.8. Samples: 319896996. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:33,785][121949] Avg episode reward: [(0, '6265.664'), (1, '5209.061')] [2023-12-26 04:35:33,787][123091] Updated weights for policy 0, policy_version 626986 (0.0010) [2023-12-26 04:35:34,036][123090] Updated weights for policy 1, policy_version 622569 (0.0006) [2023-12-26 04:35:34,091][123090] Updated weights for policy 1, policy_version 622579 (0.0005) [2023-12-26 04:35:34,141][123090] Updated weights for policy 1, policy_version 622589 (0.0006) [2023-12-26 04:35:34,551][123091] Updated weights for policy 0, policy_version 626996 (0.0008) [2023-12-26 04:35:34,624][123091] Updated weights for policy 0, policy_version 627006 (0.0010) [2023-12-26 04:35:34,690][123091] Updated weights for policy 0, policy_version 627016 (0.0011) [2023-12-26 04:35:34,917][123090] Updated weights for policy 1, policy_version 622599 (0.0007) [2023-12-26 04:35:34,973][123090] Updated weights for policy 1, policy_version 622609 (0.0005) [2023-12-26 04:35:35,027][123090] Updated weights for policy 1, policy_version 622619 (0.0006) [2023-12-26 04:35:35,374][123091] Updated weights for policy 0, policy_version 627026 (0.0009) [2023-12-26 04:35:35,453][123091] Updated weights for policy 0, policy_version 627036 (0.0008) [2023-12-26 04:35:35,522][123091] Updated weights for policy 0, policy_version 627046 (0.0010) [2023-12-26 04:35:35,590][123091] Updated weights for policy 0, policy_version 627056 (0.0011) [2023-12-26 04:35:35,683][123090] Updated weights for policy 1, policy_version 622629 (0.0008) [2023-12-26 04:35:35,737][123090] Updated weights for policy 1, policy_version 622639 (0.0010) [2023-12-26 04:35:35,792][123090] Updated weights for policy 1, policy_version 622649 (0.0010) [2023-12-26 04:35:36,320][123091] Updated weights for policy 0, policy_version 627066 (0.0011) [2023-12-26 04:35:36,382][123091] Updated weights for policy 0, policy_version 627076 (0.0011) [2023-12-26 04:35:36,451][123091] Updated weights for policy 0, policy_version 627086 (0.0011) [2023-12-26 04:35:36,523][123090] Updated weights for policy 1, policy_version 622659 (0.0006) [2023-12-26 04:35:36,583][123090] Updated weights for policy 1, policy_version 622669 (0.0008) [2023-12-26 04:35:36,640][123090] Updated weights for policy 1, policy_version 622679 (0.0006) [2023-12-26 04:35:37,266][123091] Updated weights for policy 0, policy_version 627096 (0.0008) [2023-12-26 04:35:37,341][123091] Updated weights for policy 0, policy_version 627106 (0.0006) [2023-12-26 04:35:37,414][123091] Updated weights for policy 0, policy_version 627116 (0.0006) [2023-12-26 04:35:37,436][123090] Updated weights for policy 1, policy_version 622689 (0.0006) [2023-12-26 04:35:37,488][123090] Updated weights for policy 1, policy_version 622699 (0.0010) [2023-12-26 04:35:37,536][123090] Updated weights for policy 1, policy_version 622709 (0.0010) [2023-12-26 04:35:37,587][123090] Updated weights for policy 1, policy_version 622719 (0.0010) [2023-12-26 04:35:38,093][123091] Updated weights for policy 0, policy_version 627126 (0.0006) [2023-12-26 04:35:38,158][123091] Updated weights for policy 0, policy_version 627136 (0.0006) [2023-12-26 04:35:38,216][123091] Updated weights for policy 0, policy_version 627146 (0.0006) [2023-12-26 04:35:38,449][123090] Updated weights for policy 1, policy_version 622729 (0.0010) [2023-12-26 04:35:38,518][123090] Updated weights for policy 1, policy_version 622739 (0.0010) [2023-12-26 04:35:38,588][123090] Updated weights for policy 1, policy_version 622749 (0.0010) [2023-12-26 04:35:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 319979520. Throughput: 0: 8991.2, 1: 8850.3. Samples: 319953964. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:38,785][121949] Avg episode reward: [(0, '6073.731'), (1, '5173.848')] [2023-12-26 04:35:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000627152_160555008.pth... [2023-12-26 04:35:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000622752_159424512.pth... [2023-12-26 04:35:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000626128_160292864.pth [2023-12-26 04:35:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000621728_159162368.pth [2023-12-26 04:35:38,964][123091] Updated weights for policy 0, policy_version 627156 (0.0006) [2023-12-26 04:35:39,033][123091] Updated weights for policy 0, policy_version 627166 (0.0008) [2023-12-26 04:35:39,096][123091] Updated weights for policy 0, policy_version 627176 (0.0009) [2023-12-26 04:35:39,417][123090] Updated weights for policy 1, policy_version 622759 (0.0011) [2023-12-26 04:35:39,482][123090] Updated weights for policy 1, policy_version 622769 (0.0011) [2023-12-26 04:35:39,548][123090] Updated weights for policy 1, policy_version 622779 (0.0010) [2023-12-26 04:35:39,904][123091] Updated weights for policy 0, policy_version 627186 (0.0006) [2023-12-26 04:35:39,970][123091] Updated weights for policy 0, policy_version 627196 (0.0008) [2023-12-26 04:35:40,030][123091] Updated weights for policy 0, policy_version 627206 (0.0010) [2023-12-26 04:35:40,090][123091] Updated weights for policy 0, policy_version 627216 (0.0010) [2023-12-26 04:35:40,399][123090] Updated weights for policy 1, policy_version 622789 (0.0010) [2023-12-26 04:35:40,469][123090] Updated weights for policy 1, policy_version 622799 (0.0009) [2023-12-26 04:35:40,542][123090] Updated weights for policy 1, policy_version 622809 (0.0009) [2023-12-26 04:35:40,932][123091] Updated weights for policy 0, policy_version 627226 (0.0005) [2023-12-26 04:35:40,992][123091] Updated weights for policy 0, policy_version 627236 (0.0005) [2023-12-26 04:35:41,058][123091] Updated weights for policy 0, policy_version 627246 (0.0007) [2023-12-26 04:35:41,350][123090] Updated weights for policy 1, policy_version 622819 (0.0007) [2023-12-26 04:35:41,422][123090] Updated weights for policy 1, policy_version 622829 (0.0007) [2023-12-26 04:35:41,471][123090] Updated weights for policy 1, policy_version 622839 (0.0006) [2023-12-26 04:35:41,808][123091] Updated weights for policy 0, policy_version 627256 (0.0009) [2023-12-26 04:35:41,867][123091] Updated weights for policy 0, policy_version 627266 (0.0010) [2023-12-26 04:35:41,929][123091] Updated weights for policy 0, policy_version 627276 (0.0010) [2023-12-26 04:35:42,212][123090] Updated weights for policy 1, policy_version 622849 (0.0006) [2023-12-26 04:35:42,282][123090] Updated weights for policy 1, policy_version 622859 (0.0010) [2023-12-26 04:35:42,354][123090] Updated weights for policy 1, policy_version 622869 (0.0010) [2023-12-26 04:35:42,418][123090] Updated weights for policy 1, policy_version 622879 (0.0009) [2023-12-26 04:35:42,856][123091] Updated weights for policy 0, policy_version 627286 (0.0008) [2023-12-26 04:35:42,917][123091] Updated weights for policy 0, policy_version 627296 (0.0007) [2023-12-26 04:35:42,974][123091] Updated weights for policy 0, policy_version 627307 (0.0009) [2023-12-26 04:35:43,263][123090] Updated weights for policy 1, policy_version 622889 (0.0006) [2023-12-26 04:35:43,310][123090] Updated weights for policy 1, policy_version 622899 (0.0006) [2023-12-26 04:35:43,354][123090] Updated weights for policy 1, policy_version 622909 (0.0005) [2023-12-26 04:35:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 320061440. Throughput: 0: 8924.2, 1: 8799.9. Samples: 320057696. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:43,785][121949] Avg episode reward: [(0, '6090.956'), (1, '5245.725')] [2023-12-26 04:35:43,825][123091] Updated weights for policy 0, policy_version 627317 (0.0009) [2023-12-26 04:35:43,883][123091] Updated weights for policy 0, policy_version 627327 (0.0009) [2023-12-26 04:35:43,935][123091] Updated weights for policy 0, policy_version 627337 (0.0010) [2023-12-26 04:35:44,108][123090] Updated weights for policy 1, policy_version 622919 (0.0008) [2023-12-26 04:35:44,175][123090] Updated weights for policy 1, policy_version 622929 (0.0005) [2023-12-26 04:35:44,236][123090] Updated weights for policy 1, policy_version 622939 (0.0005) [2023-12-26 04:35:44,668][123091] Updated weights for policy 0, policy_version 627347 (0.0009) [2023-12-26 04:35:44,729][123091] Updated weights for policy 0, policy_version 627357 (0.0005) [2023-12-26 04:35:44,796][123091] Updated weights for policy 0, policy_version 627367 (0.0009) [2023-12-26 04:35:44,954][123090] Updated weights for policy 1, policy_version 622949 (0.0008) [2023-12-26 04:35:45,016][123090] Updated weights for policy 1, policy_version 622959 (0.0010) [2023-12-26 04:35:45,089][123090] Updated weights for policy 1, policy_version 622969 (0.0010) [2023-12-26 04:35:45,616][123091] Updated weights for policy 0, policy_version 627377 (0.0009) [2023-12-26 04:35:45,668][123091] Updated weights for policy 0, policy_version 627387 (0.0009) [2023-12-26 04:35:45,724][123091] Updated weights for policy 0, policy_version 627397 (0.0010) [2023-12-26 04:35:45,782][123091] Updated weights for policy 0, policy_version 627407 (0.0010) [2023-12-26 04:35:45,853][123090] Updated weights for policy 1, policy_version 622979 (0.0008) [2023-12-26 04:35:45,911][123090] Updated weights for policy 1, policy_version 622989 (0.0006) [2023-12-26 04:35:45,971][123090] Updated weights for policy 1, policy_version 622999 (0.0006) [2023-12-26 04:35:46,706][123091] Updated weights for policy 0, policy_version 627417 (0.0010) [2023-12-26 04:35:46,710][123090] Updated weights for policy 1, policy_version 623009 (0.0006) [2023-12-26 04:35:46,773][123090] Updated weights for policy 1, policy_version 623019 (0.0009) [2023-12-26 04:35:46,775][123091] Updated weights for policy 0, policy_version 627427 (0.0008) [2023-12-26 04:35:46,837][123090] Updated weights for policy 1, policy_version 623029 (0.0007) [2023-12-26 04:35:46,839][123091] Updated weights for policy 0, policy_version 627437 (0.0009) [2023-12-26 04:35:46,904][123090] Updated weights for policy 1, policy_version 623039 (0.0009) [2023-12-26 04:35:47,687][123090] Updated weights for policy 1, policy_version 623049 (0.0008) [2023-12-26 04:35:47,689][123091] Updated weights for policy 0, policy_version 627447 (0.0009) [2023-12-26 04:35:47,739][123091] Updated weights for policy 0, policy_version 627457 (0.0007) [2023-12-26 04:35:47,755][123090] Updated weights for policy 1, policy_version 623059 (0.0008) [2023-12-26 04:35:47,797][123091] Updated weights for policy 0, policy_version 627467 (0.0007) [2023-12-26 04:35:47,823][123090] Updated weights for policy 1, policy_version 623069 (0.0008) [2023-12-26 04:35:48,582][123091] Updated weights for policy 0, policy_version 627477 (0.0008) [2023-12-26 04:35:48,637][123091] Updated weights for policy 0, policy_version 627487 (0.0008) [2023-12-26 04:35:48,674][123090] Updated weights for policy 1, policy_version 623079 (0.0010) [2023-12-26 04:35:48,701][123091] Updated weights for policy 0, policy_version 627497 (0.0006) [2023-12-26 04:35:48,743][123090] Updated weights for policy 1, policy_version 623089 (0.0010) [2023-12-26 04:35:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 320151552. Throughput: 0: 8871.5, 1: 8833.4. Samples: 320164988. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:48,784][121949] Avg episode reward: [(0, '6120.914'), (1, '5278.530')] [2023-12-26 04:35:48,808][123090] Updated weights for policy 1, policy_version 623099 (0.0011) [2023-12-26 04:35:49,537][123091] Updated weights for policy 0, policy_version 627507 (0.0009) [2023-12-26 04:35:49,608][123091] Updated weights for policy 0, policy_version 627517 (0.0009) [2023-12-26 04:35:49,656][123090] Updated weights for policy 1, policy_version 623109 (0.0010) [2023-12-26 04:35:49,671][123091] Updated weights for policy 0, policy_version 627527 (0.0009) [2023-12-26 04:35:49,708][123090] Updated weights for policy 1, policy_version 623119 (0.0010) [2023-12-26 04:35:49,769][123090] Updated weights for policy 1, policy_version 623129 (0.0010) [2023-12-26 04:35:50,452][123090] Updated weights for policy 1, policy_version 623139 (0.0010) [2023-12-26 04:35:50,519][123090] Updated weights for policy 1, policy_version 623149 (0.0010) [2023-12-26 04:35:50,531][123091] Updated weights for policy 0, policy_version 627537 (0.0006) [2023-12-26 04:35:50,584][123091] Updated weights for policy 0, policy_version 627547 (0.0008) [2023-12-26 04:35:50,586][123090] Updated weights for policy 1, policy_version 623159 (0.0010) [2023-12-26 04:35:50,640][123091] Updated weights for policy 0, policy_version 627557 (0.0006) [2023-12-26 04:35:50,697][123091] Updated weights for policy 0, policy_version 627567 (0.0008) [2023-12-26 04:35:51,412][123090] Updated weights for policy 1, policy_version 623169 (0.0010) [2023-12-26 04:35:51,474][123090] Updated weights for policy 1, policy_version 623179 (0.0006) [2023-12-26 04:35:51,539][123091] Updated weights for policy 0, policy_version 627577 (0.0007) [2023-12-26 04:35:51,542][123090] Updated weights for policy 1, policy_version 623189 (0.0006) [2023-12-26 04:35:51,605][123090] Updated weights for policy 1, policy_version 623199 (0.0007) [2023-12-26 04:35:51,608][123091] Updated weights for policy 0, policy_version 627587 (0.0006) [2023-12-26 04:35:51,672][123091] Updated weights for policy 0, policy_version 627597 (0.0008) [2023-12-26 04:35:52,381][123090] Updated weights for policy 1, policy_version 623209 (0.0010) [2023-12-26 04:35:52,442][123090] Updated weights for policy 1, policy_version 623219 (0.0011) [2023-12-26 04:35:52,461][123091] Updated weights for policy 0, policy_version 627607 (0.0008) [2023-12-26 04:35:52,503][123090] Updated weights for policy 1, policy_version 623229 (0.0010) [2023-12-26 04:35:52,527][123091] Updated weights for policy 0, policy_version 627617 (0.0007) [2023-12-26 04:35:52,583][123091] Updated weights for policy 0, policy_version 627627 (0.0009) [2023-12-26 04:35:53,253][123090] Updated weights for policy 1, policy_version 623239 (0.0007) [2023-12-26 04:35:53,306][123090] Updated weights for policy 1, policy_version 623249 (0.0006) [2023-12-26 04:35:53,361][123090] Updated weights for policy 1, policy_version 623259 (0.0009) [2023-12-26 04:35:53,468][123091] Updated weights for policy 0, policy_version 627637 (0.0009) [2023-12-26 04:35:53,515][123091] Updated weights for policy 0, policy_version 627647 (0.0010) [2023-12-26 04:35:53,566][123091] Updated weights for policy 0, policy_version 627657 (0.0010) [2023-12-26 04:35:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 320241664. Throughput: 0: 8826.3, 1: 8780.0. Samples: 320216412. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:53,786][121949] Avg episode reward: [(0, '6134.465'), (1, '5254.146')] [2023-12-26 04:35:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000627664_160686080.pth... [2023-12-26 04:35:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000623264_159555584.pth... [2023-12-26 04:35:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000626608_160415744.pth [2023-12-26 04:35:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000622240_159293440.pth [2023-12-26 04:35:54,137][123090] Updated weights for policy 1, policy_version 623269 (0.0008) [2023-12-26 04:35:54,193][123090] Updated weights for policy 1, policy_version 623279 (0.0005) [2023-12-26 04:35:54,246][123090] Updated weights for policy 1, policy_version 623289 (0.0005) [2023-12-26 04:35:54,363][123091] Updated weights for policy 0, policy_version 627667 (0.0010) [2023-12-26 04:35:54,410][123091] Updated weights for policy 0, policy_version 627677 (0.0010) [2023-12-26 04:35:54,470][123091] Updated weights for policy 0, policy_version 627687 (0.0009) [2023-12-26 04:35:55,058][123090] Updated weights for policy 1, policy_version 623299 (0.0010) [2023-12-26 04:35:55,111][123090] Updated weights for policy 1, policy_version 623309 (0.0009) [2023-12-26 04:35:55,174][123090] Updated weights for policy 1, policy_version 623319 (0.0009) [2023-12-26 04:35:55,186][123091] Updated weights for policy 0, policy_version 627697 (0.0009) [2023-12-26 04:35:55,240][123091] Updated weights for policy 0, policy_version 627707 (0.0010) [2023-12-26 04:35:55,290][123091] Updated weights for policy 0, policy_version 627717 (0.0010) [2023-12-26 04:35:55,344][123091] Updated weights for policy 0, policy_version 627727 (0.0008) [2023-12-26 04:35:56,016][123090] Updated weights for policy 1, policy_version 623329 (0.0007) [2023-12-26 04:35:56,072][123090] Updated weights for policy 1, policy_version 623339 (0.0009) [2023-12-26 04:35:56,110][123091] Updated weights for policy 0, policy_version 627737 (0.0006) [2023-12-26 04:35:56,123][123090] Updated weights for policy 1, policy_version 623349 (0.0009) [2023-12-26 04:35:56,168][123091] Updated weights for policy 0, policy_version 627747 (0.0010) [2023-12-26 04:35:56,176][123090] Updated weights for policy 1, policy_version 623359 (0.0008) [2023-12-26 04:35:56,226][123091] Updated weights for policy 0, policy_version 627757 (0.0007) [2023-12-26 04:35:56,954][123090] Updated weights for policy 1, policy_version 623369 (0.0008) [2023-12-26 04:35:57,004][123090] Updated weights for policy 1, policy_version 623379 (0.0009) [2023-12-26 04:35:57,032][123091] Updated weights for policy 0, policy_version 627767 (0.0008) [2023-12-26 04:35:57,068][123090] Updated weights for policy 1, policy_version 623389 (0.0006) [2023-12-26 04:35:57,094][123091] Updated weights for policy 0, policy_version 627777 (0.0010) [2023-12-26 04:35:57,156][123091] Updated weights for policy 0, policy_version 627787 (0.0010) [2023-12-26 04:35:57,817][123090] Updated weights for policy 1, policy_version 623399 (0.0007) [2023-12-26 04:35:57,838][123091] Updated weights for policy 0, policy_version 627797 (0.0010) [2023-12-26 04:35:57,876][123090] Updated weights for policy 1, policy_version 623409 (0.0010) [2023-12-26 04:35:57,888][123091] Updated weights for policy 0, policy_version 627807 (0.0010) [2023-12-26 04:35:57,927][123090] Updated weights for policy 1, policy_version 623419 (0.0007) [2023-12-26 04:35:57,946][123091] Updated weights for policy 0, policy_version 627817 (0.0010) [2023-12-26 04:35:58,776][123090] Updated weights for policy 1, policy_version 623429 (0.0007) [2023-12-26 04:35:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17614.3, 300 sec: 17744.7). Total num frames: 320323584. Throughput: 0: 8853.7, 1: 8866.5. Samples: 320324404. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:35:58,785][121949] Avg episode reward: [(0, '6160.480'), (1, '5337.359')] [2023-12-26 04:35:58,841][123090] Updated weights for policy 1, policy_version 623439 (0.0009) [2023-12-26 04:35:58,890][123091] Updated weights for policy 0, policy_version 627827 (0.0010) [2023-12-26 04:35:58,905][123090] Updated weights for policy 1, policy_version 623449 (0.0010) [2023-12-26 04:35:58,959][123091] Updated weights for policy 0, policy_version 627837 (0.0009) [2023-12-26 04:35:59,024][123091] Updated weights for policy 0, policy_version 627847 (0.0009) [2023-12-26 04:35:59,759][123090] Updated weights for policy 1, policy_version 623459 (0.0010) [2023-12-26 04:35:59,821][123090] Updated weights for policy 1, policy_version 623469 (0.0009) [2023-12-26 04:35:59,841][123091] Updated weights for policy 0, policy_version 627857 (0.0009) [2023-12-26 04:35:59,889][123090] Updated weights for policy 1, policy_version 623479 (0.0007) [2023-12-26 04:35:59,901][123091] Updated weights for policy 0, policy_version 627867 (0.0006) [2023-12-26 04:35:59,964][123091] Updated weights for policy 0, policy_version 627877 (0.0008) [2023-12-26 04:36:00,023][123091] Updated weights for policy 0, policy_version 627887 (0.0008) [2023-12-26 04:36:00,604][123090] Updated weights for policy 1, policy_version 623489 (0.0008) [2023-12-26 04:36:00,660][123090] Updated weights for policy 1, policy_version 623499 (0.0010) [2023-12-26 04:36:00,731][123090] Updated weights for policy 1, policy_version 623509 (0.0010) [2023-12-26 04:36:00,796][123090] Updated weights for policy 1, policy_version 623519 (0.0009) [2023-12-26 04:36:00,840][123091] Updated weights for policy 0, policy_version 627897 (0.0006) [2023-12-26 04:36:00,917][123091] Updated weights for policy 0, policy_version 627907 (0.0005) [2023-12-26 04:36:01,009][123091] Updated weights for policy 0, policy_version 627917 (0.0008) [2023-12-26 04:36:01,539][123090] Updated weights for policy 1, policy_version 623529 (0.0006) [2023-12-26 04:36:01,603][123090] Updated weights for policy 1, policy_version 623539 (0.0007) [2023-12-26 04:36:01,672][123090] Updated weights for policy 1, policy_version 623549 (0.0008) [2023-12-26 04:36:01,685][123091] Updated weights for policy 0, policy_version 627927 (0.0008) [2023-12-26 04:36:01,750][123091] Updated weights for policy 0, policy_version 627938 (0.0010) [2023-12-26 04:36:01,812][123091] Updated weights for policy 0, policy_version 627948 (0.0010) [2023-12-26 04:36:02,340][123090] Updated weights for policy 1, policy_version 623559 (0.0009) [2023-12-26 04:36:02,412][123090] Updated weights for policy 1, policy_version 623569 (0.0011) [2023-12-26 04:36:02,471][123090] Updated weights for policy 1, policy_version 623579 (0.0011) [2023-12-26 04:36:02,671][123091] Updated weights for policy 0, policy_version 627958 (0.0009) [2023-12-26 04:36:02,728][123091] Updated weights for policy 0, policy_version 627968 (0.0009) [2023-12-26 04:36:02,786][123091] Updated weights for policy 0, policy_version 627978 (0.0008) [2023-12-26 04:36:03,287][123090] Updated weights for policy 1, policy_version 623589 (0.0010) [2023-12-26 04:36:03,346][123090] Updated weights for policy 1, policy_version 623599 (0.0010) [2023-12-26 04:36:03,405][123090] Updated weights for policy 1, policy_version 623609 (0.0010) [2023-12-26 04:36:03,430][123091] Updated weights for policy 0, policy_version 627988 (0.0006) [2023-12-26 04:36:03,483][123091] Updated weights for policy 0, policy_version 627998 (0.0005) [2023-12-26 04:36:03,530][123091] Updated weights for policy 0, policy_version 628008 (0.0005) [2023-12-26 04:36:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 320421888. Throughput: 0: 8923.0, 1: 8812.1. Samples: 320430536. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:03,784][121949] Avg episode reward: [(0, '6135.041'), (1, '5133.581')] [2023-12-26 04:36:04,228][123090] Updated weights for policy 1, policy_version 623619 (0.0010) [2023-12-26 04:36:04,283][123091] Updated weights for policy 0, policy_version 628018 (0.0006) [2023-12-26 04:36:04,295][123090] Updated weights for policy 1, policy_version 623629 (0.0011) [2023-12-26 04:36:04,337][123091] Updated weights for policy 0, policy_version 628028 (0.0010) [2023-12-26 04:36:04,348][123090] Updated weights for policy 1, policy_version 623639 (0.0011) [2023-12-26 04:36:04,397][123091] Updated weights for policy 0, policy_version 628038 (0.0008) [2023-12-26 04:36:04,451][123091] Updated weights for policy 0, policy_version 628048 (0.0008) [2023-12-26 04:36:05,202][123090] Updated weights for policy 1, policy_version 623649 (0.0011) [2023-12-26 04:36:05,223][123091] Updated weights for policy 0, policy_version 628058 (0.0005) [2023-12-26 04:36:05,261][123090] Updated weights for policy 1, policy_version 623659 (0.0010) [2023-12-26 04:36:05,284][123091] Updated weights for policy 0, policy_version 628068 (0.0010) [2023-12-26 04:36:05,319][123090] Updated weights for policy 1, policy_version 623669 (0.0010) [2023-12-26 04:36:05,335][123091] Updated weights for policy 0, policy_version 628078 (0.0010) [2023-12-26 04:36:05,367][123090] Updated weights for policy 1, policy_version 623679 (0.0010) [2023-12-26 04:36:06,048][123091] Updated weights for policy 0, policy_version 628088 (0.0010) [2023-12-26 04:36:06,119][123091] Updated weights for policy 0, policy_version 628098 (0.0009) [2023-12-26 04:36:06,174][123091] Updated weights for policy 0, policy_version 628108 (0.0010) [2023-12-26 04:36:06,198][123090] Updated weights for policy 1, policy_version 623689 (0.0008) [2023-12-26 04:36:06,256][123090] Updated weights for policy 1, policy_version 623699 (0.0009) [2023-12-26 04:36:06,306][123090] Updated weights for policy 1, policy_version 623709 (0.0009) [2023-12-26 04:36:06,934][123091] Updated weights for policy 0, policy_version 628118 (0.0009) [2023-12-26 04:36:06,995][123091] Updated weights for policy 0, policy_version 628128 (0.0005) [2023-12-26 04:36:07,057][123091] Updated weights for policy 0, policy_version 628138 (0.0005) [2023-12-26 04:36:07,248][123090] Updated weights for policy 1, policy_version 623719 (0.0009) [2023-12-26 04:36:07,301][123090] Updated weights for policy 1, policy_version 623729 (0.0009) [2023-12-26 04:36:07,357][123090] Updated weights for policy 1, policy_version 623739 (0.0009) [2023-12-26 04:36:07,853][123091] Updated weights for policy 0, policy_version 628148 (0.0005) [2023-12-26 04:36:07,925][123091] Updated weights for policy 0, policy_version 628158 (0.0005) [2023-12-26 04:36:07,991][123091] Updated weights for policy 0, policy_version 628168 (0.0005) [2023-12-26 04:36:08,193][123090] Updated weights for policy 1, policy_version 623749 (0.0010) [2023-12-26 04:36:08,259][123090] Updated weights for policy 1, policy_version 623759 (0.0010) [2023-12-26 04:36:08,330][123090] Updated weights for policy 1, policy_version 623769 (0.0010) [2023-12-26 04:36:08,632][123091] Updated weights for policy 0, policy_version 628178 (0.0006) [2023-12-26 04:36:08,684][123091] Updated weights for policy 0, policy_version 628188 (0.0010) [2023-12-26 04:36:08,742][123091] Updated weights for policy 0, policy_version 628198 (0.0009) [2023-12-26 04:36:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 320503808. Throughput: 0: 8971.5, 1: 8828.2. Samples: 320484088. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:08,785][121949] Avg episode reward: [(0, '6206.058'), (1, '4994.650')] [2023-12-26 04:36:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000623776_159686656.pth... [2023-12-26 04:36:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000622752_159424512.pth [2023-12-26 04:36:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000628208_160825344.pth... [2023-12-26 04:36:08,796][123091] Updated weights for policy 0, policy_version 628208 (0.0009) [2023-12-26 04:36:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000627152_160555008.pth [2023-12-26 04:36:09,049][123090] Updated weights for policy 1, policy_version 623779 (0.0010) [2023-12-26 04:36:09,111][123090] Updated weights for policy 1, policy_version 623789 (0.0010) [2023-12-26 04:36:09,162][123090] Updated weights for policy 1, policy_version 623799 (0.0009) [2023-12-26 04:36:09,606][123091] Updated weights for policy 0, policy_version 628218 (0.0007) [2023-12-26 04:36:09,673][123091] Updated weights for policy 0, policy_version 628228 (0.0006) [2023-12-26 04:36:09,739][123091] Updated weights for policy 0, policy_version 628238 (0.0008) [2023-12-26 04:36:10,053][123090] Updated weights for policy 1, policy_version 623809 (0.0010) [2023-12-26 04:36:10,110][123090] Updated weights for policy 1, policy_version 623819 (0.0009) [2023-12-26 04:36:10,162][123090] Updated weights for policy 1, policy_version 623829 (0.0010) [2023-12-26 04:36:10,217][123090] Updated weights for policy 1, policy_version 623839 (0.0010) [2023-12-26 04:36:10,555][123091] Updated weights for policy 0, policy_version 628248 (0.0010) [2023-12-26 04:36:10,617][123091] Updated weights for policy 0, policy_version 628258 (0.0011) [2023-12-26 04:36:10,674][123091] Updated weights for policy 0, policy_version 628268 (0.0008) [2023-12-26 04:36:11,109][123090] Updated weights for policy 1, policy_version 623849 (0.0010) [2023-12-26 04:36:11,181][123090] Updated weights for policy 1, policy_version 623859 (0.0013) [2023-12-26 04:36:11,243][123090] Updated weights for policy 1, policy_version 623869 (0.0010) [2023-12-26 04:36:11,533][123091] Updated weights for policy 0, policy_version 628278 (0.0007) [2023-12-26 04:36:11,596][123091] Updated weights for policy 0, policy_version 628288 (0.0008) [2023-12-26 04:36:11,682][123091] Updated weights for policy 0, policy_version 628298 (0.0009) [2023-12-26 04:36:12,117][123090] Updated weights for policy 1, policy_version 623879 (0.0007) [2023-12-26 04:36:12,188][123090] Updated weights for policy 1, policy_version 623889 (0.0007) [2023-12-26 04:36:12,250][123090] Updated weights for policy 1, policy_version 623899 (0.0009) [2023-12-26 04:36:12,463][123091] Updated weights for policy 0, policy_version 628308 (0.0009) [2023-12-26 04:36:12,539][123091] Updated weights for policy 0, policy_version 628318 (0.0008) [2023-12-26 04:36:12,608][123091] Updated weights for policy 0, policy_version 628328 (0.0008) [2023-12-26 04:36:13,052][123090] Updated weights for policy 1, policy_version 623909 (0.0010) [2023-12-26 04:36:13,104][123090] Updated weights for policy 1, policy_version 623919 (0.0010) [2023-12-26 04:36:13,164][123090] Updated weights for policy 1, policy_version 623929 (0.0011) [2023-12-26 04:36:13,421][123091] Updated weights for policy 0, policy_version 628338 (0.0009) [2023-12-26 04:36:13,484][123091] Updated weights for policy 0, policy_version 628348 (0.0009) [2023-12-26 04:36:13,532][123091] Updated weights for policy 0, policy_version 628358 (0.0009) [2023-12-26 04:36:13,586][123091] Updated weights for policy 0, policy_version 628368 (0.0010) [2023-12-26 04:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 320593920. Throughput: 0: 8926.7, 1: 8751.7. Samples: 320587320. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:13,785][121949] Avg episode reward: [(0, '6196.284'), (1, '4980.686')] [2023-12-26 04:36:13,971][123090] Updated weights for policy 1, policy_version 623939 (0.0009) [2023-12-26 04:36:14,025][123090] Updated weights for policy 1, policy_version 623949 (0.0006) [2023-12-26 04:36:14,082][123090] Updated weights for policy 1, policy_version 623959 (0.0006) [2023-12-26 04:36:14,504][123091] Updated weights for policy 0, policy_version 628378 (0.0008) [2023-12-26 04:36:14,577][123091] Updated weights for policy 0, policy_version 628388 (0.0007) [2023-12-26 04:36:14,652][123091] Updated weights for policy 0, policy_version 628398 (0.0007) [2023-12-26 04:36:14,845][123090] Updated weights for policy 1, policy_version 623969 (0.0006) [2023-12-26 04:36:14,904][123090] Updated weights for policy 1, policy_version 623979 (0.0011) [2023-12-26 04:36:14,967][123090] Updated weights for policy 1, policy_version 623989 (0.0011) [2023-12-26 04:36:15,035][123090] Updated weights for policy 1, policy_version 623999 (0.0011) [2023-12-26 04:36:15,321][123091] Updated weights for policy 0, policy_version 628408 (0.0007) [2023-12-26 04:36:15,392][123091] Updated weights for policy 0, policy_version 628418 (0.0007) [2023-12-26 04:36:15,458][123091] Updated weights for policy 0, policy_version 628428 (0.0008) [2023-12-26 04:36:15,876][123090] Updated weights for policy 1, policy_version 624009 (0.0010) [2023-12-26 04:36:15,922][123090] Updated weights for policy 1, policy_version 624019 (0.0010) [2023-12-26 04:36:15,984][123090] Updated weights for policy 1, policy_version 624029 (0.0010) [2023-12-26 04:36:16,271][123091] Updated weights for policy 0, policy_version 628438 (0.0008) [2023-12-26 04:36:16,324][123091] Updated weights for policy 0, policy_version 628448 (0.0009) [2023-12-26 04:36:16,384][123091] Updated weights for policy 0, policy_version 628458 (0.0010) [2023-12-26 04:36:16,743][123090] Updated weights for policy 1, policy_version 624039 (0.0007) [2023-12-26 04:36:16,814][123090] Updated weights for policy 1, policy_version 624049 (0.0005) [2023-12-26 04:36:16,882][123090] Updated weights for policy 1, policy_version 624059 (0.0006) [2023-12-26 04:36:17,339][123091] Updated weights for policy 0, policy_version 628468 (0.0009) [2023-12-26 04:36:17,399][123091] Updated weights for policy 0, policy_version 628478 (0.0009) [2023-12-26 04:36:17,457][123091] Updated weights for policy 0, policy_version 628488 (0.0009) [2023-12-26 04:36:17,607][123090] Updated weights for policy 1, policy_version 624069 (0.0008) [2023-12-26 04:36:17,679][123090] Updated weights for policy 1, policy_version 624079 (0.0006) [2023-12-26 04:36:17,741][123090] Updated weights for policy 1, policy_version 624089 (0.0007) [2023-12-26 04:36:18,367][123091] Updated weights for policy 0, policy_version 628498 (0.0009) [2023-12-26 04:36:18,378][123090] Updated weights for policy 1, policy_version 624099 (0.0006) [2023-12-26 04:36:18,423][123091] Updated weights for policy 0, policy_version 628508 (0.0008) [2023-12-26 04:36:18,438][123090] Updated weights for policy 1, policy_version 624109 (0.0009) [2023-12-26 04:36:18,492][123091] Updated weights for policy 0, policy_version 628518 (0.0006) [2023-12-26 04:36:18,501][123090] Updated weights for policy 1, policy_version 624119 (0.0008) [2023-12-26 04:36:18,551][123091] Updated weights for policy 0, policy_version 628528 (0.0008) [2023-12-26 04:36:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 320684032. Throughput: 0: 8796.9, 1: 8881.7. Samples: 320692532. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:18,785][121949] Avg episode reward: [(0, '6206.992'), (1, '5106.264')] [2023-12-26 04:36:19,319][123090] Updated weights for policy 1, policy_version 624129 (0.0006) [2023-12-26 04:36:19,377][123091] Updated weights for policy 0, policy_version 628538 (0.0010) [2023-12-26 04:36:19,391][123090] Updated weights for policy 1, policy_version 624139 (0.0008) [2023-12-26 04:36:19,439][123091] Updated weights for policy 0, policy_version 628548 (0.0011) [2023-12-26 04:36:19,454][123090] Updated weights for policy 1, policy_version 624149 (0.0006) [2023-12-26 04:36:19,510][123091] Updated weights for policy 0, policy_version 628558 (0.0013) [2023-12-26 04:36:19,517][123090] Updated weights for policy 1, policy_version 624159 (0.0008) [2023-12-26 04:36:20,291][123091] Updated weights for policy 0, policy_version 628568 (0.0007) [2023-12-26 04:36:20,361][123091] Updated weights for policy 0, policy_version 628578 (0.0008) [2023-12-26 04:36:20,411][123090] Updated weights for policy 1, policy_version 624169 (0.0006) [2023-12-26 04:36:20,424][123091] Updated weights for policy 0, policy_version 628588 (0.0011) [2023-12-26 04:36:20,481][123090] Updated weights for policy 1, policy_version 624179 (0.0009) [2023-12-26 04:36:20,551][123090] Updated weights for policy 1, policy_version 624189 (0.0009) [2023-12-26 04:36:21,224][123091] Updated weights for policy 0, policy_version 628598 (0.0011) [2023-12-26 04:36:21,285][123091] Updated weights for policy 0, policy_version 628608 (0.0011) [2023-12-26 04:36:21,338][123091] Updated weights for policy 0, policy_version 628618 (0.0011) [2023-12-26 04:36:21,433][123090] Updated weights for policy 1, policy_version 624199 (0.0009) [2023-12-26 04:36:21,505][123090] Updated weights for policy 1, policy_version 624209 (0.0008) [2023-12-26 04:36:21,571][123090] Updated weights for policy 1, policy_version 624219 (0.0009) [2023-12-26 04:36:22,137][123091] Updated weights for policy 0, policy_version 628628 (0.0010) [2023-12-26 04:36:22,199][123091] Updated weights for policy 0, policy_version 628638 (0.0010) [2023-12-26 04:36:22,259][123091] Updated weights for policy 0, policy_version 628648 (0.0009) [2023-12-26 04:36:22,461][123090] Updated weights for policy 1, policy_version 624229 (0.0009) [2023-12-26 04:36:22,542][123090] Updated weights for policy 1, policy_version 624239 (0.0006) [2023-12-26 04:36:22,598][123090] Updated weights for policy 1, policy_version 624249 (0.0010) [2023-12-26 04:36:23,078][123091] Updated weights for policy 0, policy_version 628658 (0.0009) [2023-12-26 04:36:23,136][123091] Updated weights for policy 0, policy_version 628668 (0.0008) [2023-12-26 04:36:23,192][123091] Updated weights for policy 0, policy_version 628678 (0.0009) [2023-12-26 04:36:23,246][123091] Updated weights for policy 0, policy_version 628688 (0.0009) [2023-12-26 04:36:23,383][123090] Updated weights for policy 1, policy_version 624259 (0.0010) [2023-12-26 04:36:23,451][123090] Updated weights for policy 1, policy_version 624269 (0.0011) [2023-12-26 04:36:23,513][123090] Updated weights for policy 1, policy_version 624279 (0.0010) [2023-12-26 04:36:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 320765952. Throughput: 0: 8752.7, 1: 8768.3. Samples: 320742408. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:23,784][121949] Avg episode reward: [(0, '6200.867'), (1, '5190.968')] [2023-12-26 04:36:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000624288_159817728.pth... [2023-12-26 04:36:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000628688_160948224.pth... [2023-12-26 04:36:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000623264_159555584.pth [2023-12-26 04:36:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000627664_160686080.pth [2023-12-26 04:36:24,033][123091] Updated weights for policy 0, policy_version 628698 (0.0005) [2023-12-26 04:36:24,107][123091] Updated weights for policy 0, policy_version 628708 (0.0006) [2023-12-26 04:36:24,170][123091] Updated weights for policy 0, policy_version 628718 (0.0005) [2023-12-26 04:36:24,179][123090] Updated weights for policy 1, policy_version 624289 (0.0010) [2023-12-26 04:36:24,240][123090] Updated weights for policy 1, policy_version 624299 (0.0005) [2023-12-26 04:36:24,308][123090] Updated weights for policy 1, policy_version 624309 (0.0005) [2023-12-26 04:36:24,375][123090] Updated weights for policy 1, policy_version 624319 (0.0005) [2023-12-26 04:36:24,821][123091] Updated weights for policy 0, policy_version 628728 (0.0005) [2023-12-26 04:36:24,873][123091] Updated weights for policy 0, policy_version 628738 (0.0005) [2023-12-26 04:36:24,930][123091] Updated weights for policy 0, policy_version 628748 (0.0005) [2023-12-26 04:36:25,015][123090] Updated weights for policy 1, policy_version 624329 (0.0005) [2023-12-26 04:36:25,092][123090] Updated weights for policy 1, policy_version 624339 (0.0005) [2023-12-26 04:36:25,164][123090] Updated weights for policy 1, policy_version 624349 (0.0005) [2023-12-26 04:36:25,543][123091] Updated weights for policy 0, policy_version 628758 (0.0005) [2023-12-26 04:36:25,593][123091] Updated weights for policy 0, policy_version 628768 (0.0005) [2023-12-26 04:36:25,640][123091] Updated weights for policy 0, policy_version 628778 (0.0005) [2023-12-26 04:36:25,783][123090] Updated weights for policy 1, policy_version 624359 (0.0006) [2023-12-26 04:36:25,841][123090] Updated weights for policy 1, policy_version 624369 (0.0010) [2023-12-26 04:36:25,900][123090] Updated weights for policy 1, policy_version 624379 (0.0010) [2023-12-26 04:36:26,300][123091] Updated weights for policy 0, policy_version 628788 (0.0005) [2023-12-26 04:36:26,351][123091] Updated weights for policy 0, policy_version 628798 (0.0005) [2023-12-26 04:36:26,405][123091] Updated weights for policy 0, policy_version 628808 (0.0005) [2023-12-26 04:36:26,655][123090] Updated weights for policy 1, policy_version 624389 (0.0010) [2023-12-26 04:36:26,702][123090] Updated weights for policy 1, policy_version 624399 (0.0010) [2023-12-26 04:36:26,753][123090] Updated weights for policy 1, policy_version 624409 (0.0010) [2023-12-26 04:36:27,060][123091] Updated weights for policy 0, policy_version 628818 (0.0006) [2023-12-26 04:36:27,114][123091] Updated weights for policy 0, policy_version 628829 (0.0010) [2023-12-26 04:36:27,167][123091] Updated weights for policy 0, policy_version 628839 (0.0008) [2023-12-26 04:36:27,496][123090] Updated weights for policy 1, policy_version 624419 (0.0008) [2023-12-26 04:36:27,560][123090] Updated weights for policy 1, policy_version 624429 (0.0005) [2023-12-26 04:36:27,624][123090] Updated weights for policy 1, policy_version 624439 (0.0005) [2023-12-26 04:36:27,864][123091] Updated weights for policy 0, policy_version 628849 (0.0009) [2023-12-26 04:36:27,909][123091] Updated weights for policy 0, policy_version 628859 (0.0005) [2023-12-26 04:36:27,963][123091] Updated weights for policy 0, policy_version 628869 (0.0005) [2023-12-26 04:36:28,011][123091] Updated weights for policy 0, policy_version 628879 (0.0006) [2023-12-26 04:36:28,273][123090] Updated weights for policy 1, policy_version 624449 (0.0005) [2023-12-26 04:36:28,322][123090] Updated weights for policy 1, policy_version 624459 (0.0005) [2023-12-26 04:36:28,383][123090] Updated weights for policy 1, policy_version 624469 (0.0007) [2023-12-26 04:36:28,451][123090] Updated weights for policy 1, policy_version 624479 (0.0008) [2023-12-26 04:36:28,736][123091] Updated weights for policy 0, policy_version 628889 (0.0005) [2023-12-26 04:36:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 320864256. Throughput: 0: 8880.4, 1: 8904.6. Samples: 320858024. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:28,785][121949] Avg episode reward: [(0, '6136.122'), (1, '4785.317')] [2023-12-26 04:36:28,806][123091] Updated weights for policy 0, policy_version 628899 (0.0009) [2023-12-26 04:36:28,874][123091] Updated weights for policy 0, policy_version 628909 (0.0011) [2023-12-26 04:36:29,094][123090] Updated weights for policy 1, policy_version 624489 (0.0006) [2023-12-26 04:36:29,168][123090] Updated weights for policy 1, policy_version 624499 (0.0005) [2023-12-26 04:36:29,224][123090] Updated weights for policy 1, policy_version 624509 (0.0006) [2023-12-26 04:36:29,616][123091] Updated weights for policy 0, policy_version 628919 (0.0010) [2023-12-26 04:36:29,670][123091] Updated weights for policy 0, policy_version 628929 (0.0010) [2023-12-26 04:36:29,722][123091] Updated weights for policy 0, policy_version 628939 (0.0010) [2023-12-26 04:36:30,006][123090] Updated weights for policy 1, policy_version 624519 (0.0010) [2023-12-26 04:36:30,061][123090] Updated weights for policy 1, policy_version 624529 (0.0010) [2023-12-26 04:36:30,120][123090] Updated weights for policy 1, policy_version 624539 (0.0010) [2023-12-26 04:36:30,558][123091] Updated weights for policy 0, policy_version 628949 (0.0008) [2023-12-26 04:36:30,608][123091] Updated weights for policy 0, policy_version 628959 (0.0005) [2023-12-26 04:36:30,656][123091] Updated weights for policy 0, policy_version 628969 (0.0007) [2023-12-26 04:36:30,884][123090] Updated weights for policy 1, policy_version 624549 (0.0008) [2023-12-26 04:36:30,932][123090] Updated weights for policy 1, policy_version 624559 (0.0006) [2023-12-26 04:36:30,983][123090] Updated weights for policy 1, policy_version 624569 (0.0007) [2023-12-26 04:36:31,514][123091] Updated weights for policy 0, policy_version 628979 (0.0006) [2023-12-26 04:36:31,588][123091] Updated weights for policy 0, policy_version 628989 (0.0009) [2023-12-26 04:36:31,653][123091] Updated weights for policy 0, policy_version 628999 (0.0010) [2023-12-26 04:36:31,761][123090] Updated weights for policy 1, policy_version 624579 (0.0009) [2023-12-26 04:36:31,830][123090] Updated weights for policy 1, policy_version 624589 (0.0009) [2023-12-26 04:36:31,899][123090] Updated weights for policy 1, policy_version 624599 (0.0009) [2023-12-26 04:36:32,390][123091] Updated weights for policy 0, policy_version 629009 (0.0009) [2023-12-26 04:36:32,457][123091] Updated weights for policy 0, policy_version 629019 (0.0009) [2023-12-26 04:36:32,520][123091] Updated weights for policy 0, policy_version 629029 (0.0010) [2023-12-26 04:36:32,586][123091] Updated weights for policy 0, policy_version 629039 (0.0009) [2023-12-26 04:36:32,756][123090] Updated weights for policy 1, policy_version 624609 (0.0009) [2023-12-26 04:36:32,816][123090] Updated weights for policy 1, policy_version 624619 (0.0009) [2023-12-26 04:36:32,877][123090] Updated weights for policy 1, policy_version 624629 (0.0009) [2023-12-26 04:36:32,940][123090] Updated weights for policy 1, policy_version 624639 (0.0008) [2023-12-26 04:36:33,433][123091] Updated weights for policy 0, policy_version 629049 (0.0006) [2023-12-26 04:36:33,505][123091] Updated weights for policy 0, policy_version 629059 (0.0005) [2023-12-26 04:36:33,571][123091] Updated weights for policy 0, policy_version 629069 (0.0005) [2023-12-26 04:36:33,778][123090] Updated weights for policy 1, policy_version 624649 (0.0009) [2023-12-26 04:36:33,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 320954368. Throughput: 0: 8964.3, 1: 8897.3. Samples: 320968764. Policy #0 lag: (min: 30.0, avg: 38.0, max: 62.0) [2023-12-26 04:36:33,786][121949] Avg episode reward: [(0, '6191.632'), (1, '4632.764')] [2023-12-26 04:36:33,838][123090] Updated weights for policy 1, policy_version 624659 (0.0010) [2023-12-26 04:36:33,890][123090] Updated weights for policy 1, policy_version 624669 (0.0009) [2023-12-26 04:36:34,170][123091] Updated weights for policy 0, policy_version 629079 (0.0007) [2023-12-26 04:36:34,238][123091] Updated weights for policy 0, policy_version 629089 (0.0008) [2023-12-26 04:36:34,303][123091] Updated weights for policy 0, policy_version 629099 (0.0008) [2023-12-26 04:36:34,752][123090] Updated weights for policy 1, policy_version 624679 (0.0006) [2023-12-26 04:36:34,819][123090] Updated weights for policy 1, policy_version 624689 (0.0006) [2023-12-26 04:36:34,882][123090] Updated weights for policy 1, policy_version 624699 (0.0008) [2023-12-26 04:36:35,051][123091] Updated weights for policy 0, policy_version 629109 (0.0007) [2023-12-26 04:36:35,112][123091] Updated weights for policy 0, policy_version 629119 (0.0005) [2023-12-26 04:36:35,187][123091] Updated weights for policy 0, policy_version 629129 (0.0005) [2023-12-26 04:36:35,510][123090] Updated weights for policy 1, policy_version 624709 (0.0007) [2023-12-26 04:36:35,571][123090] Updated weights for policy 1, policy_version 624719 (0.0005) [2023-12-26 04:36:35,632][123090] Updated weights for policy 1, policy_version 624729 (0.0009) [2023-12-26 04:36:35,747][123091] Updated weights for policy 0, policy_version 629139 (0.0008) [2023-12-26 04:36:35,807][123091] Updated weights for policy 0, policy_version 629149 (0.0008) [2023-12-26 04:36:35,879][123091] Updated weights for policy 0, policy_version 629159 (0.0009) [2023-12-26 04:36:36,376][123090] Updated weights for policy 1, policy_version 624739 (0.0009) [2023-12-26 04:36:36,444][123090] Updated weights for policy 1, policy_version 624749 (0.0008) [2023-12-26 04:36:36,515][123090] Updated weights for policy 1, policy_version 624759 (0.0008) [2023-12-26 04:36:36,576][123091] Updated weights for policy 0, policy_version 629169 (0.0007) [2023-12-26 04:36:36,644][123091] Updated weights for policy 0, policy_version 629179 (0.0010) [2023-12-26 04:36:36,705][123091] Updated weights for policy 0, policy_version 629189 (0.0009) [2023-12-26 04:36:36,766][123091] Updated weights for policy 0, policy_version 629199 (0.0007) [2023-12-26 04:36:37,202][123090] Updated weights for policy 1, policy_version 624769 (0.0011) [2023-12-26 04:36:37,256][123090] Updated weights for policy 1, policy_version 624779 (0.0009) [2023-12-26 04:36:37,318][123090] Updated weights for policy 1, policy_version 624789 (0.0008) [2023-12-26 04:36:37,371][123090] Updated weights for policy 1, policy_version 624799 (0.0010) [2023-12-26 04:36:37,561][123091] Updated weights for policy 0, policy_version 629209 (0.0006) [2023-12-26 04:36:37,618][123091] Updated weights for policy 0, policy_version 629219 (0.0011) [2023-12-26 04:36:37,673][123091] Updated weights for policy 0, policy_version 629229 (0.0010) [2023-12-26 04:36:38,169][123090] Updated weights for policy 1, policy_version 624809 (0.0006) [2023-12-26 04:36:38,231][123090] Updated weights for policy 1, policy_version 624819 (0.0005) [2023-12-26 04:36:38,302][123090] Updated weights for policy 1, policy_version 624829 (0.0005) [2023-12-26 04:36:38,402][123091] Updated weights for policy 0, policy_version 629239 (0.0009) [2023-12-26 04:36:38,465][123091] Updated weights for policy 0, policy_version 629249 (0.0011) [2023-12-26 04:36:38,532][123091] Updated weights for policy 0, policy_version 629259 (0.0011) [2023-12-26 04:36:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 321052672. Throughput: 0: 9064.2, 1: 8932.0. Samples: 321026236. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:36:38,785][121949] Avg episode reward: [(0, '6264.535'), (1, '4818.322')] [2023-12-26 04:36:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000629264_161095680.pth... [2023-12-26 04:36:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000624832_159956992.pth... [2023-12-26 04:36:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000628208_160825344.pth [2023-12-26 04:36:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000623776_159686656.pth [2023-12-26 04:36:39,015][123090] Updated weights for policy 1, policy_version 624839 (0.0009) [2023-12-26 04:36:39,077][123090] Updated weights for policy 1, policy_version 624849 (0.0009) [2023-12-26 04:36:39,137][123090] Updated weights for policy 1, policy_version 624859 (0.0009) [2023-12-26 04:36:39,391][123091] Updated weights for policy 0, policy_version 629269 (0.0010) [2023-12-26 04:36:39,460][123091] Updated weights for policy 0, policy_version 629279 (0.0010) [2023-12-26 04:36:39,513][123091] Updated weights for policy 0, policy_version 629289 (0.0009) [2023-12-26 04:36:39,986][123090] Updated weights for policy 1, policy_version 624869 (0.0009) [2023-12-26 04:36:40,055][123090] Updated weights for policy 1, policy_version 624879 (0.0010) [2023-12-26 04:36:40,106][123090] Updated weights for policy 1, policy_version 624889 (0.0009) [2023-12-26 04:36:40,364][123091] Updated weights for policy 0, policy_version 629299 (0.0010) [2023-12-26 04:36:40,430][123091] Updated weights for policy 0, policy_version 629309 (0.0008) [2023-12-26 04:36:40,499][123091] Updated weights for policy 0, policy_version 629319 (0.0010) [2023-12-26 04:36:40,868][123090] Updated weights for policy 1, policy_version 624899 (0.0009) [2023-12-26 04:36:40,926][123090] Updated weights for policy 1, policy_version 624909 (0.0009) [2023-12-26 04:36:40,990][123090] Updated weights for policy 1, policy_version 624919 (0.0009) [2023-12-26 04:36:41,381][123091] Updated weights for policy 0, policy_version 629329 (0.0009) [2023-12-26 04:36:41,442][123091] Updated weights for policy 0, policy_version 629339 (0.0010) [2023-12-26 04:36:41,503][123091] Updated weights for policy 0, policy_version 629349 (0.0009) [2023-12-26 04:36:41,577][123091] Updated weights for policy 0, policy_version 629359 (0.0011) [2023-12-26 04:36:41,906][123090] Updated weights for policy 1, policy_version 624929 (0.0009) [2023-12-26 04:36:41,967][123090] Updated weights for policy 1, policy_version 624939 (0.0009) [2023-12-26 04:36:42,039][123090] Updated weights for policy 1, policy_version 624949 (0.0009) [2023-12-26 04:36:42,102][123090] Updated weights for policy 1, policy_version 624959 (0.0009) [2023-12-26 04:36:42,474][123091] Updated weights for policy 0, policy_version 629369 (0.0011) [2023-12-26 04:36:42,538][123091] Updated weights for policy 0, policy_version 629379 (0.0011) [2023-12-26 04:36:42,602][123091] Updated weights for policy 0, policy_version 629389 (0.0011) [2023-12-26 04:36:42,943][123090] Updated weights for policy 1, policy_version 624969 (0.0009) [2023-12-26 04:36:42,995][123090] Updated weights for policy 1, policy_version 624979 (0.0009) [2023-12-26 04:36:43,044][123090] Updated weights for policy 1, policy_version 624989 (0.0009) [2023-12-26 04:36:43,407][123091] Updated weights for policy 0, policy_version 629399 (0.0010) [2023-12-26 04:36:43,462][123091] Updated weights for policy 0, policy_version 629409 (0.0010) [2023-12-26 04:36:43,525][123091] Updated weights for policy 0, policy_version 629419 (0.0011) [2023-12-26 04:36:43,752][123090] Updated weights for policy 1, policy_version 624999 (0.0009) [2023-12-26 04:36:43,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 321134592. Throughput: 0: 9008.9, 1: 8907.3. Samples: 321130632. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:36:43,784][121949] Avg episode reward: [(0, '6274.050'), (1, '5115.375')] [2023-12-26 04:36:43,815][123090] Updated weights for policy 1, policy_version 625009 (0.0009) [2023-12-26 04:36:43,871][123090] Updated weights for policy 1, policy_version 625019 (0.0010) [2023-12-26 04:36:44,184][123091] Updated weights for policy 0, policy_version 629429 (0.0009) [2023-12-26 04:36:44,236][123091] Updated weights for policy 0, policy_version 629439 (0.0006) [2023-12-26 04:36:44,293][123091] Updated weights for policy 0, policy_version 629449 (0.0007) [2023-12-26 04:36:44,731][123090] Updated weights for policy 1, policy_version 625029 (0.0010) [2023-12-26 04:36:44,799][123090] Updated weights for policy 1, policy_version 625039 (0.0009) [2023-12-26 04:36:44,861][123090] Updated weights for policy 1, policy_version 625049 (0.0010) [2023-12-26 04:36:45,127][123091] Updated weights for policy 0, policy_version 629459 (0.0010) [2023-12-26 04:36:45,186][123091] Updated weights for policy 0, policy_version 629469 (0.0010) [2023-12-26 04:36:45,246][123091] Updated weights for policy 0, policy_version 629479 (0.0009) [2023-12-26 04:36:45,698][123090] Updated weights for policy 1, policy_version 625059 (0.0009) [2023-12-26 04:36:45,764][123090] Updated weights for policy 1, policy_version 625069 (0.0009) [2023-12-26 04:36:45,823][123090] Updated weights for policy 1, policy_version 625079 (0.0010) [2023-12-26 04:36:46,079][123091] Updated weights for policy 0, policy_version 629489 (0.0009) [2023-12-26 04:36:46,129][123091] Updated weights for policy 0, policy_version 629499 (0.0009) [2023-12-26 04:36:46,179][123091] Updated weights for policy 0, policy_version 629509 (0.0009) [2023-12-26 04:36:46,235][123091] Updated weights for policy 0, policy_version 629519 (0.0008) [2023-12-26 04:36:46,660][123090] Updated weights for policy 1, policy_version 625089 (0.0010) [2023-12-26 04:36:46,715][123090] Updated weights for policy 1, policy_version 625099 (0.0009) [2023-12-26 04:36:46,771][123090] Updated weights for policy 1, policy_version 625109 (0.0009) [2023-12-26 04:36:46,834][123090] Updated weights for policy 1, policy_version 625119 (0.0010) [2023-12-26 04:36:47,095][123091] Updated weights for policy 0, policy_version 629529 (0.0010) [2023-12-26 04:36:47,154][123091] Updated weights for policy 0, policy_version 629539 (0.0010) [2023-12-26 04:36:47,220][123091] Updated weights for policy 0, policy_version 629549 (0.0010) [2023-12-26 04:36:47,644][123090] Updated weights for policy 1, policy_version 625129 (0.0010) [2023-12-26 04:36:47,718][123090] Updated weights for policy 1, policy_version 625139 (0.0009) [2023-12-26 04:36:47,787][123090] Updated weights for policy 1, policy_version 625149 (0.0005) [2023-12-26 04:36:48,119][123091] Updated weights for policy 0, policy_version 629560 (0.0010) [2023-12-26 04:36:48,180][123091] Updated weights for policy 0, policy_version 629570 (0.0010) [2023-12-26 04:36:48,245][123091] Updated weights for policy 0, policy_version 629580 (0.0011) [2023-12-26 04:36:48,501][123090] Updated weights for policy 1, policy_version 625159 (0.0006) [2023-12-26 04:36:48,566][123090] Updated weights for policy 1, policy_version 625169 (0.0009) [2023-12-26 04:36:48,626][123090] Updated weights for policy 1, policy_version 625179 (0.0010) [2023-12-26 04:36:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 321224704. Throughput: 0: 8962.1, 1: 8882.5. Samples: 321233544. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:36:48,784][121949] Avg episode reward: [(0, '6194.685'), (1, '5176.993')] [2023-12-26 04:36:49,174][123091] Updated weights for policy 0, policy_version 629590 (0.0009) [2023-12-26 04:36:49,236][123091] Updated weights for policy 0, policy_version 629600 (0.0009) [2023-12-26 04:36:49,301][123091] Updated weights for policy 0, policy_version 629610 (0.0009) [2023-12-26 04:36:49,355][123090] Updated weights for policy 1, policy_version 625189 (0.0009) [2023-12-26 04:36:49,426][123090] Updated weights for policy 1, policy_version 625199 (0.0008) [2023-12-26 04:36:49,485][123090] Updated weights for policy 1, policy_version 625209 (0.0006) [2023-12-26 04:36:50,172][123091] Updated weights for policy 0, policy_version 629620 (0.0008) [2023-12-26 04:36:50,232][123090] Updated weights for policy 1, policy_version 625219 (0.0005) [2023-12-26 04:36:50,240][123091] Updated weights for policy 0, policy_version 629630 (0.0008) [2023-12-26 04:36:50,301][123090] Updated weights for policy 1, policy_version 625229 (0.0006) [2023-12-26 04:36:50,307][123091] Updated weights for policy 0, policy_version 629640 (0.0009) [2023-12-26 04:36:50,366][123090] Updated weights for policy 1, policy_version 625239 (0.0009) [2023-12-26 04:36:51,138][123091] Updated weights for policy 0, policy_version 629650 (0.0008) [2023-12-26 04:36:51,184][123090] Updated weights for policy 1, policy_version 625249 (0.0008) [2023-12-26 04:36:51,197][123091] Updated weights for policy 0, policy_version 629660 (0.0010) [2023-12-26 04:36:51,244][123090] Updated weights for policy 1, policy_version 625259 (0.0007) [2023-12-26 04:36:51,256][123091] Updated weights for policy 0, policy_version 629670 (0.0007) [2023-12-26 04:36:51,310][123090] Updated weights for policy 1, policy_version 625269 (0.0008) [2023-12-26 04:36:51,316][123091] Updated weights for policy 0, policy_version 629680 (0.0009) [2023-12-26 04:36:51,374][123090] Updated weights for policy 1, policy_version 625279 (0.0009) [2023-12-26 04:36:52,175][123090] Updated weights for policy 1, policy_version 625289 (0.0006) [2023-12-26 04:36:52,237][123091] Updated weights for policy 0, policy_version 629690 (0.0008) [2023-12-26 04:36:52,239][123090] Updated weights for policy 1, policy_version 625299 (0.0007) [2023-12-26 04:36:52,302][123091] Updated weights for policy 0, policy_version 629700 (0.0008) [2023-12-26 04:36:52,304][123090] Updated weights for policy 1, policy_version 625309 (0.0009) [2023-12-26 04:36:52,366][123091] Updated weights for policy 0, policy_version 629710 (0.0009) [2023-12-26 04:36:53,141][123090] Updated weights for policy 1, policy_version 625319 (0.0010) [2023-12-26 04:36:53,201][123090] Updated weights for policy 1, policy_version 625329 (0.0009) [2023-12-26 04:36:53,202][123091] Updated weights for policy 0, policy_version 629720 (0.0008) [2023-12-26 04:36:53,262][123090] Updated weights for policy 1, policy_version 625339 (0.0007) [2023-12-26 04:36:53,265][123091] Updated weights for policy 0, policy_version 629730 (0.0009) [2023-12-26 04:36:53,330][123091] Updated weights for policy 0, policy_version 629740 (0.0009) [2023-12-26 04:36:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 321306624. Throughput: 0: 8882.5, 1: 8922.1. Samples: 321285296. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:36:53,785][121949] Avg episode reward: [(0, '6171.959'), (1, '5200.807')] [2023-12-26 04:36:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000629744_161218560.pth... [2023-12-26 04:36:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000625344_160088064.pth... [2023-12-26 04:36:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000628688_160948224.pth [2023-12-26 04:36:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000624288_159817728.pth [2023-12-26 04:36:54,078][123090] Updated weights for policy 1, policy_version 625349 (0.0009) [2023-12-26 04:36:54,134][123090] Updated weights for policy 1, policy_version 625359 (0.0008) [2023-12-26 04:36:54,157][123091] Updated weights for policy 0, policy_version 629750 (0.0010) [2023-12-26 04:36:54,186][123090] Updated weights for policy 1, policy_version 625369 (0.0008) [2023-12-26 04:36:54,215][123091] Updated weights for policy 0, policy_version 629760 (0.0008) [2023-12-26 04:36:54,277][123091] Updated weights for policy 0, policy_version 629770 (0.0009) [2023-12-26 04:36:55,044][123090] Updated weights for policy 1, policy_version 625379 (0.0010) [2023-12-26 04:36:55,102][123090] Updated weights for policy 1, policy_version 625389 (0.0009) [2023-12-26 04:36:55,123][123091] Updated weights for policy 0, policy_version 629780 (0.0009) [2023-12-26 04:36:55,163][123090] Updated weights for policy 1, policy_version 625399 (0.0008) [2023-12-26 04:36:55,177][123091] Updated weights for policy 0, policy_version 629790 (0.0010) [2023-12-26 04:36:55,231][123091] Updated weights for policy 0, policy_version 629800 (0.0007) [2023-12-26 04:36:55,970][123090] Updated weights for policy 1, policy_version 625409 (0.0009) [2023-12-26 04:36:56,022][123090] Updated weights for policy 1, policy_version 625419 (0.0008) [2023-12-26 04:36:56,071][123090] Updated weights for policy 1, policy_version 625429 (0.0009) [2023-12-26 04:36:56,087][123091] Updated weights for policy 0, policy_version 629810 (0.0009) [2023-12-26 04:36:56,116][123090] Updated weights for policy 1, policy_version 625439 (0.0008) [2023-12-26 04:36:56,142][123091] Updated weights for policy 0, policy_version 629820 (0.0009) [2023-12-26 04:36:56,202][123091] Updated weights for policy 0, policy_version 629830 (0.0008) [2023-12-26 04:36:56,265][123091] Updated weights for policy 0, policy_version 629840 (0.0010) [2023-12-26 04:36:56,924][123090] Updated weights for policy 1, policy_version 625449 (0.0006) [2023-12-26 04:36:56,980][123090] Updated weights for policy 1, policy_version 625459 (0.0005) [2023-12-26 04:36:57,041][123090] Updated weights for policy 1, policy_version 625469 (0.0005) [2023-12-26 04:36:57,109][123091] Updated weights for policy 0, policy_version 629850 (0.0009) [2023-12-26 04:36:57,163][123091] Updated weights for policy 0, policy_version 629860 (0.0009) [2023-12-26 04:36:57,217][123091] Updated weights for policy 0, policy_version 629870 (0.0009) [2023-12-26 04:36:57,782][123090] Updated weights for policy 1, policy_version 625479 (0.0005) [2023-12-26 04:36:57,841][123090] Updated weights for policy 1, policy_version 625489 (0.0006) [2023-12-26 04:36:57,897][123090] Updated weights for policy 1, policy_version 625499 (0.0006) [2023-12-26 04:36:58,011][123091] Updated weights for policy 0, policy_version 629880 (0.0007) [2023-12-26 04:36:58,075][123091] Updated weights for policy 0, policy_version 629890 (0.0010) [2023-12-26 04:36:58,139][123091] Updated weights for policy 0, policy_version 629900 (0.0010) [2023-12-26 04:36:58,705][123090] Updated weights for policy 1, policy_version 625509 (0.0010) [2023-12-26 04:36:58,770][123090] Updated weights for policy 1, policy_version 625519 (0.0009) [2023-12-26 04:36:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 321388544. Throughput: 0: 8808.4, 1: 8991.7. Samples: 321388328. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:36:58,785][121949] Avg episode reward: [(0, '6092.368'), (1, '5294.895')] [2023-12-26 04:36:58,847][123090] Updated weights for policy 1, policy_version 625529 (0.0009) [2023-12-26 04:36:59,017][123091] Updated weights for policy 0, policy_version 629910 (0.0010) [2023-12-26 04:36:59,078][123091] Updated weights for policy 0, policy_version 629920 (0.0008) [2023-12-26 04:36:59,131][123091] Updated weights for policy 0, policy_version 629930 (0.0010) [2023-12-26 04:36:59,671][123090] Updated weights for policy 1, policy_version 625539 (0.0009) [2023-12-26 04:36:59,730][123090] Updated weights for policy 1, policy_version 625549 (0.0009) [2023-12-26 04:36:59,794][123090] Updated weights for policy 1, policy_version 625559 (0.0007) [2023-12-26 04:36:59,894][123091] Updated weights for policy 0, policy_version 629940 (0.0009) [2023-12-26 04:36:59,962][123091] Updated weights for policy 0, policy_version 629950 (0.0010) [2023-12-26 04:37:00,020][123091] Updated weights for policy 0, policy_version 629960 (0.0008) [2023-12-26 04:37:00,563][123090] Updated weights for policy 1, policy_version 625569 (0.0008) [2023-12-26 04:37:00,618][123090] Updated weights for policy 1, policy_version 625579 (0.0010) [2023-12-26 04:37:00,679][123090] Updated weights for policy 1, policy_version 625589 (0.0009) [2023-12-26 04:37:00,718][123091] Updated weights for policy 0, policy_version 629970 (0.0005) [2023-12-26 04:37:00,741][123090] Updated weights for policy 1, policy_version 625599 (0.0009) [2023-12-26 04:37:00,785][123091] Updated weights for policy 0, policy_version 629980 (0.0006) [2023-12-26 04:37:00,842][123091] Updated weights for policy 0, policy_version 629990 (0.0006) [2023-12-26 04:37:00,910][123091] Updated weights for policy 0, policy_version 630000 (0.0005) [2023-12-26 04:37:01,465][123090] Updated weights for policy 1, policy_version 625609 (0.0009) [2023-12-26 04:37:01,528][123090] Updated weights for policy 1, policy_version 625619 (0.0009) [2023-12-26 04:37:01,575][123091] Updated weights for policy 0, policy_version 630010 (0.0008) [2023-12-26 04:37:01,584][123090] Updated weights for policy 1, policy_version 625629 (0.0008) [2023-12-26 04:37:01,638][123091] Updated weights for policy 0, policy_version 630020 (0.0009) [2023-12-26 04:37:01,692][123091] Updated weights for policy 0, policy_version 630030 (0.0009) [2023-12-26 04:37:02,308][123090] Updated weights for policy 1, policy_version 625639 (0.0008) [2023-12-26 04:37:02,376][123090] Updated weights for policy 1, policy_version 625649 (0.0010) [2023-12-26 04:37:02,443][123090] Updated weights for policy 1, policy_version 625659 (0.0010) [2023-12-26 04:37:02,571][123091] Updated weights for policy 0, policy_version 630040 (0.0010) [2023-12-26 04:37:02,624][123091] Updated weights for policy 0, policy_version 630050 (0.0009) [2023-12-26 04:37:02,674][123091] Updated weights for policy 0, policy_version 630060 (0.0009) [2023-12-26 04:37:03,278][123090] Updated weights for policy 1, policy_version 625669 (0.0009) [2023-12-26 04:37:03,332][123090] Updated weights for policy 1, policy_version 625679 (0.0010) [2023-12-26 04:37:03,379][123090] Updated weights for policy 1, policy_version 625690 (0.0009) [2023-12-26 04:37:03,479][123091] Updated weights for policy 0, policy_version 630071 (0.0010) [2023-12-26 04:37:03,534][123091] Updated weights for policy 0, policy_version 630082 (0.0009) [2023-12-26 04:37:03,594][123091] Updated weights for policy 0, policy_version 630093 (0.0008) [2023-12-26 04:37:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 321486848. Throughput: 0: 8893.1, 1: 8933.9. Samples: 321494744. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:03,785][121949] Avg episode reward: [(0, '6054.743'), (1, '5290.183')] [2023-12-26 04:37:04,241][123090] Updated weights for policy 1, policy_version 625700 (0.0009) [2023-12-26 04:37:04,300][123090] Updated weights for policy 1, policy_version 625710 (0.0005) [2023-12-26 04:37:04,365][123090] Updated weights for policy 1, policy_version 625720 (0.0007) [2023-12-26 04:37:04,446][123091] Updated weights for policy 0, policy_version 630103 (0.0008) [2023-12-26 04:37:04,500][123091] Updated weights for policy 0, policy_version 630113 (0.0009) [2023-12-26 04:37:04,551][123091] Updated weights for policy 0, policy_version 630124 (0.0010) [2023-12-26 04:37:05,160][123090] Updated weights for policy 1, policy_version 625730 (0.0007) [2023-12-26 04:37:05,219][123090] Updated weights for policy 1, policy_version 625740 (0.0010) [2023-12-26 04:37:05,285][123090] Updated weights for policy 1, policy_version 625750 (0.0010) [2023-12-26 04:37:05,334][123091] Updated weights for policy 0, policy_version 630134 (0.0007) [2023-12-26 04:37:05,347][123090] Updated weights for policy 1, policy_version 625760 (0.0010) [2023-12-26 04:37:05,385][123091] Updated weights for policy 0, policy_version 630144 (0.0006) [2023-12-26 04:37:05,452][123091] Updated weights for policy 0, policy_version 630154 (0.0008) [2023-12-26 04:37:06,043][123090] Updated weights for policy 1, policy_version 625770 (0.0005) [2023-12-26 04:37:06,109][123090] Updated weights for policy 1, policy_version 625780 (0.0007) [2023-12-26 04:37:06,181][123090] Updated weights for policy 1, policy_version 625790 (0.0007) [2023-12-26 04:37:06,256][123091] Updated weights for policy 0, policy_version 630164 (0.0009) [2023-12-26 04:37:06,327][123091] Updated weights for policy 0, policy_version 630174 (0.0011) [2023-12-26 04:37:06,398][123091] Updated weights for policy 0, policy_version 630184 (0.0011) [2023-12-26 04:37:06,885][123090] Updated weights for policy 1, policy_version 625800 (0.0008) [2023-12-26 04:37:06,941][123090] Updated weights for policy 1, policy_version 625810 (0.0008) [2023-12-26 04:37:06,996][123090] Updated weights for policy 1, policy_version 625820 (0.0008) [2023-12-26 04:37:07,149][123091] Updated weights for policy 0, policy_version 630194 (0.0010) [2023-12-26 04:37:07,220][123091] Updated weights for policy 0, policy_version 630204 (0.0006) [2023-12-26 04:37:07,291][123091] Updated weights for policy 0, policy_version 630214 (0.0005) [2023-12-26 04:37:07,343][123091] Updated weights for policy 0, policy_version 630224 (0.0005) [2023-12-26 04:37:07,666][123090] Updated weights for policy 1, policy_version 625830 (0.0006) [2023-12-26 04:37:07,717][123090] Updated weights for policy 1, policy_version 625840 (0.0008) [2023-12-26 04:37:07,765][123090] Updated weights for policy 1, policy_version 625850 (0.0010) [2023-12-26 04:37:07,992][123091] Updated weights for policy 0, policy_version 630234 (0.0005) [2023-12-26 04:37:08,043][123091] Updated weights for policy 0, policy_version 630244 (0.0006) [2023-12-26 04:37:08,104][123091] Updated weights for policy 0, policy_version 630255 (0.0008) [2023-12-26 04:37:08,523][123090] Updated weights for policy 1, policy_version 625860 (0.0010) [2023-12-26 04:37:08,598][123090] Updated weights for policy 1, policy_version 625870 (0.0008) [2023-12-26 04:37:08,659][123090] Updated weights for policy 1, policy_version 625880 (0.0010) [2023-12-26 04:37:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 321576960. Throughput: 0: 8906.9, 1: 9018.8. Samples: 321549068. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:08,785][121949] Avg episode reward: [(0, '6123.711'), (1, '5370.891')] [2023-12-26 04:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000625888_160227328.pth... [2023-12-26 04:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000624832_159956992.pth [2023-12-26 04:37:08,837][123091] Updated weights for policy 0, policy_version 630265 (0.0006) [2023-12-26 04:37:08,904][123091] Updated weights for policy 0, policy_version 630275 (0.0005) [2023-12-26 04:37:08,967][123091] Updated weights for policy 0, policy_version 630285 (0.0005) [2023-12-26 04:37:08,987][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000630288_161357824.pth... [2023-12-26 04:37:08,992][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000629264_161095680.pth [2023-12-26 04:37:09,607][123090] Updated weights for policy 1, policy_version 625890 (0.0010) [2023-12-26 04:37:09,669][123090] Updated weights for policy 1, policy_version 625900 (0.0010) [2023-12-26 04:37:09,691][123091] Updated weights for policy 0, policy_version 630295 (0.0006) [2023-12-26 04:37:09,730][123090] Updated weights for policy 1, policy_version 625910 (0.0009) [2023-12-26 04:37:09,754][123091] Updated weights for policy 0, policy_version 630305 (0.0006) [2023-12-26 04:37:09,790][123090] Updated weights for policy 1, policy_version 625920 (0.0010) [2023-12-26 04:37:09,819][123091] Updated weights for policy 0, policy_version 630315 (0.0006) [2023-12-26 04:37:10,479][123091] Updated weights for policy 0, policy_version 630325 (0.0006) [2023-12-26 04:37:10,533][123091] Updated weights for policy 0, policy_version 630335 (0.0005) [2023-12-26 04:37:10,587][123091] Updated weights for policy 0, policy_version 630345 (0.0006) [2023-12-26 04:37:10,682][123090] Updated weights for policy 1, policy_version 625930 (0.0010) [2023-12-26 04:37:10,738][123090] Updated weights for policy 1, policy_version 625940 (0.0009) [2023-12-26 04:37:10,791][123090] Updated weights for policy 1, policy_version 625950 (0.0009) [2023-12-26 04:37:11,377][123091] Updated weights for policy 0, policy_version 630355 (0.0007) [2023-12-26 04:37:11,440][123091] Updated weights for policy 0, policy_version 630365 (0.0010) [2023-12-26 04:37:11,508][123091] Updated weights for policy 0, policy_version 630375 (0.0011) [2023-12-26 04:37:11,682][123090] Updated weights for policy 1, policy_version 625960 (0.0009) [2023-12-26 04:37:11,754][123090] Updated weights for policy 1, policy_version 625970 (0.0009) [2023-12-26 04:37:11,820][123090] Updated weights for policy 1, policy_version 625980 (0.0007) [2023-12-26 04:37:12,245][123091] Updated weights for policy 0, policy_version 630385 (0.0010) [2023-12-26 04:37:12,317][123091] Updated weights for policy 0, policy_version 630395 (0.0009) [2023-12-26 04:37:12,385][123091] Updated weights for policy 0, policy_version 630405 (0.0009) [2023-12-26 04:37:12,451][123091] Updated weights for policy 0, policy_version 630415 (0.0006) [2023-12-26 04:37:12,687][123090] Updated weights for policy 1, policy_version 625990 (0.0007) [2023-12-26 04:37:12,759][123090] Updated weights for policy 1, policy_version 626000 (0.0008) [2023-12-26 04:37:12,833][123090] Updated weights for policy 1, policy_version 626010 (0.0009) [2023-12-26 04:37:13,195][123091] Updated weights for policy 0, policy_version 630425 (0.0006) [2023-12-26 04:37:13,253][123091] Updated weights for policy 0, policy_version 630435 (0.0006) [2023-12-26 04:37:13,310][123091] Updated weights for policy 0, policy_version 630445 (0.0006) [2023-12-26 04:37:13,682][123090] Updated weights for policy 1, policy_version 626020 (0.0009) [2023-12-26 04:37:13,751][123090] Updated weights for policy 1, policy_version 626030 (0.0008) [2023-12-26 04:37:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 321658880. Throughput: 0: 8881.5, 1: 8864.7. Samples: 321656604. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:13,784][121949] Avg episode reward: [(0, '6188.583'), (1, '5440.054')] [2023-12-26 04:37:13,819][123090] Updated weights for policy 1, policy_version 626040 (0.0008) [2023-12-26 04:37:14,037][123091] Updated weights for policy 0, policy_version 630455 (0.0009) [2023-12-26 04:37:14,101][123091] Updated weights for policy 0, policy_version 630465 (0.0009) [2023-12-26 04:37:14,166][123091] Updated weights for policy 0, policy_version 630475 (0.0011) [2023-12-26 04:37:14,597][123090] Updated weights for policy 1, policy_version 626050 (0.0006) [2023-12-26 04:37:14,669][123090] Updated weights for policy 1, policy_version 626060 (0.0005) [2023-12-26 04:37:14,742][123090] Updated weights for policy 1, policy_version 626070 (0.0005) [2023-12-26 04:37:14,810][123090] Updated weights for policy 1, policy_version 626080 (0.0007) [2023-12-26 04:37:14,955][123091] Updated weights for policy 0, policy_version 630485 (0.0011) [2023-12-26 04:37:15,021][123091] Updated weights for policy 0, policy_version 630495 (0.0010) [2023-12-26 04:37:15,084][123091] Updated weights for policy 0, policy_version 630505 (0.0009) [2023-12-26 04:37:15,593][123090] Updated weights for policy 1, policy_version 626090 (0.0011) [2023-12-26 04:37:15,652][123090] Updated weights for policy 1, policy_version 626100 (0.0008) [2023-12-26 04:37:15,715][123090] Updated weights for policy 1, policy_version 626110 (0.0005) [2023-12-26 04:37:15,973][123091] Updated weights for policy 0, policy_version 630515 (0.0010) [2023-12-26 04:37:16,037][123091] Updated weights for policy 0, policy_version 630525 (0.0010) [2023-12-26 04:37:16,093][123091] Updated weights for policy 0, policy_version 630536 (0.0010) [2023-12-26 04:37:16,386][123090] Updated weights for policy 1, policy_version 626120 (0.0005) [2023-12-26 04:37:16,465][123090] Updated weights for policy 1, policy_version 626130 (0.0009) [2023-12-26 04:37:16,527][123090] Updated weights for policy 1, policy_version 626140 (0.0010) [2023-12-26 04:37:16,994][123091] Updated weights for policy 0, policy_version 630547 (0.0011) [2023-12-26 04:37:17,048][123091] Updated weights for policy 0, policy_version 630558 (0.0011) [2023-12-26 04:37:17,109][123091] Updated weights for policy 0, policy_version 630570 (0.0010) [2023-12-26 04:37:17,256][123090] Updated weights for policy 1, policy_version 626150 (0.0007) [2023-12-26 04:37:17,313][123090] Updated weights for policy 1, policy_version 626160 (0.0005) [2023-12-26 04:37:17,376][123090] Updated weights for policy 1, policy_version 626170 (0.0005) [2023-12-26 04:37:18,049][123091] Updated weights for policy 0, policy_version 630580 (0.0009) [2023-12-26 04:37:18,099][123091] Updated weights for policy 0, policy_version 630590 (0.0009) [2023-12-26 04:37:18,137][123090] Updated weights for policy 1, policy_version 626180 (0.0008) [2023-12-26 04:37:18,144][123091] Updated weights for policy 0, policy_version 630600 (0.0007) [2023-12-26 04:37:18,185][123090] Updated weights for policy 1, policy_version 626190 (0.0010) [2023-12-26 04:37:18,232][123090] Updated weights for policy 1, policy_version 626200 (0.0010) [2023-12-26 04:37:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 321748992. Throughput: 0: 8771.7, 1: 8831.3. Samples: 321760896. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:18,785][121949] Avg episode reward: [(0, '6196.576'), (1, '5346.502')] [2023-12-26 04:37:19,026][123091] Updated weights for policy 0, policy_version 630610 (0.0007) [2023-12-26 04:37:19,096][123091] Updated weights for policy 0, policy_version 630620 (0.0006) [2023-12-26 04:37:19,112][123090] Updated weights for policy 1, policy_version 626211 (0.0010) [2023-12-26 04:37:19,160][123091] Updated weights for policy 0, policy_version 630630 (0.0008) [2023-12-26 04:37:19,163][123090] Updated weights for policy 1, policy_version 626221 (0.0008) [2023-12-26 04:37:19,216][123090] Updated weights for policy 1, policy_version 626231 (0.0009) [2023-12-26 04:37:19,223][123091] Updated weights for policy 0, policy_version 630640 (0.0010) [2023-12-26 04:37:19,922][123091] Updated weights for policy 0, policy_version 630650 (0.0008) [2023-12-26 04:37:19,984][123091] Updated weights for policy 0, policy_version 630660 (0.0007) [2023-12-26 04:37:20,058][123091] Updated weights for policy 0, policy_version 630670 (0.0008) [2023-12-26 04:37:20,141][123090] Updated weights for policy 1, policy_version 626241 (0.0009) [2023-12-26 04:37:20,196][123090] Updated weights for policy 1, policy_version 626251 (0.0010) [2023-12-26 04:37:20,256][123090] Updated weights for policy 1, policy_version 626261 (0.0010) [2023-12-26 04:37:20,315][123090] Updated weights for policy 1, policy_version 626271 (0.0010) [2023-12-26 04:37:20,742][123091] Updated weights for policy 0, policy_version 630680 (0.0008) [2023-12-26 04:37:20,804][123091] Updated weights for policy 0, policy_version 630690 (0.0008) [2023-12-26 04:37:20,877][123091] Updated weights for policy 0, policy_version 630700 (0.0008) [2023-12-26 04:37:21,205][123090] Updated weights for policy 1, policy_version 626281 (0.0009) [2023-12-26 04:37:21,274][123090] Updated weights for policy 1, policy_version 626291 (0.0009) [2023-12-26 04:37:21,351][123090] Updated weights for policy 1, policy_version 626301 (0.0008) [2023-12-26 04:37:21,692][123091] Updated weights for policy 0, policy_version 630710 (0.0010) [2023-12-26 04:37:21,754][123091] Updated weights for policy 0, policy_version 630720 (0.0007) [2023-12-26 04:37:21,810][123091] Updated weights for policy 0, policy_version 630730 (0.0006) [2023-12-26 04:37:22,231][123090] Updated weights for policy 1, policy_version 626311 (0.0009) [2023-12-26 04:37:22,304][123090] Updated weights for policy 1, policy_version 626321 (0.0009) [2023-12-26 04:37:22,384][123090] Updated weights for policy 1, policy_version 626331 (0.0009) [2023-12-26 04:37:22,566][123091] Updated weights for policy 0, policy_version 630740 (0.0006) [2023-12-26 04:37:22,622][123091] Updated weights for policy 0, policy_version 630750 (0.0009) [2023-12-26 04:37:22,677][123091] Updated weights for policy 0, policy_version 630760 (0.0010) [2023-12-26 04:37:23,260][123090] Updated weights for policy 1, policy_version 626341 (0.0010) [2023-12-26 04:37:23,328][123090] Updated weights for policy 1, policy_version 626351 (0.0010) [2023-12-26 04:37:23,395][123090] Updated weights for policy 1, policy_version 626361 (0.0009) [2023-12-26 04:37:23,527][123091] Updated weights for policy 0, policy_version 630770 (0.0009) [2023-12-26 04:37:23,602][123091] Updated weights for policy 0, policy_version 630780 (0.0006) [2023-12-26 04:37:23,668][123091] Updated weights for policy 0, policy_version 630790 (0.0006) [2023-12-26 04:37:23,741][123091] Updated weights for policy 0, policy_version 630800 (0.0006) [2023-12-26 04:37:23,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 321839104. Throughput: 0: 8721.1, 1: 8753.2. Samples: 321812588. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:23,786][121949] Avg episode reward: [(0, '6144.797'), (1, '5300.217')] [2023-12-26 04:37:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000626368_160350208.pth... [2023-12-26 04:37:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000630800_161488896.pth... [2023-12-26 04:37:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000629744_161218560.pth [2023-12-26 04:37:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000625344_160088064.pth [2023-12-26 04:37:24,189][123090] Updated weights for policy 1, policy_version 626371 (0.0007) [2023-12-26 04:37:24,262][123090] Updated weights for policy 1, policy_version 626381 (0.0010) [2023-12-26 04:37:24,320][123090] Updated weights for policy 1, policy_version 626391 (0.0009) [2023-12-26 04:37:24,353][123091] Updated weights for policy 0, policy_version 630810 (0.0008) [2023-12-26 04:37:24,414][123091] Updated weights for policy 0, policy_version 630820 (0.0009) [2023-12-26 04:37:24,470][123091] Updated weights for policy 0, policy_version 630830 (0.0011) [2023-12-26 04:37:25,113][123090] Updated weights for policy 1, policy_version 626401 (0.0008) [2023-12-26 04:37:25,166][123090] Updated weights for policy 1, policy_version 626411 (0.0007) [2023-12-26 04:37:25,218][123090] Updated weights for policy 1, policy_version 626421 (0.0008) [2023-12-26 04:37:25,284][123090] Updated weights for policy 1, policy_version 626431 (0.0009) [2023-12-26 04:37:25,299][123091] Updated weights for policy 0, policy_version 630840 (0.0010) [2023-12-26 04:37:25,353][123091] Updated weights for policy 0, policy_version 630850 (0.0010) [2023-12-26 04:37:25,408][123091] Updated weights for policy 0, policy_version 630860 (0.0010) [2023-12-26 04:37:26,082][123090] Updated weights for policy 1, policy_version 626441 (0.0009) [2023-12-26 04:37:26,139][123090] Updated weights for policy 1, policy_version 626451 (0.0007) [2023-12-26 04:37:26,185][123090] Updated weights for policy 1, policy_version 626462 (0.0006) [2023-12-26 04:37:26,240][123091] Updated weights for policy 0, policy_version 630870 (0.0011) [2023-12-26 04:37:26,291][123091] Updated weights for policy 0, policy_version 630880 (0.0010) [2023-12-26 04:37:26,345][123091] Updated weights for policy 0, policy_version 630890 (0.0010) [2023-12-26 04:37:26,864][123090] Updated weights for policy 1, policy_version 626472 (0.0005) [2023-12-26 04:37:26,927][123090] Updated weights for policy 1, policy_version 626482 (0.0007) [2023-12-26 04:37:26,985][123090] Updated weights for policy 1, policy_version 626492 (0.0010) [2023-12-26 04:37:27,186][123091] Updated weights for policy 0, policy_version 630900 (0.0011) [2023-12-26 04:37:27,251][123091] Updated weights for policy 0, policy_version 630910 (0.0010) [2023-12-26 04:37:27,321][123091] Updated weights for policy 0, policy_version 630920 (0.0011) [2023-12-26 04:37:27,630][123090] Updated weights for policy 1, policy_version 626502 (0.0007) [2023-12-26 04:37:27,698][123090] Updated weights for policy 1, policy_version 626512 (0.0008) [2023-12-26 04:37:27,753][123090] Updated weights for policy 1, policy_version 626522 (0.0010) [2023-12-26 04:37:28,033][123091] Updated weights for policy 0, policy_version 630930 (0.0010) [2023-12-26 04:37:28,092][123091] Updated weights for policy 0, policy_version 630940 (0.0008) [2023-12-26 04:37:28,150][123091] Updated weights for policy 0, policy_version 630950 (0.0005) [2023-12-26 04:37:28,215][123091] Updated weights for policy 0, policy_version 630960 (0.0005) [2023-12-26 04:37:28,548][123090] Updated weights for policy 1, policy_version 626532 (0.0010) [2023-12-26 04:37:28,610][123090] Updated weights for policy 1, policy_version 626542 (0.0010) [2023-12-26 04:37:28,673][123090] Updated weights for policy 1, policy_version 626552 (0.0010) [2023-12-26 04:37:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 321929216. Throughput: 0: 8772.1, 1: 8770.3. Samples: 321920040. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:28,784][121949] Avg episode reward: [(0, '6174.874'), (1, '5565.518')] [2023-12-26 04:37:28,840][123091] Updated weights for policy 0, policy_version 630970 (0.0005) [2023-12-26 04:37:28,909][123091] Updated weights for policy 0, policy_version 630980 (0.0007) [2023-12-26 04:37:28,970][123091] Updated weights for policy 0, policy_version 630990 (0.0007) [2023-12-26 04:37:29,465][123090] Updated weights for policy 1, policy_version 626562 (0.0010) [2023-12-26 04:37:29,513][123090] Updated weights for policy 1, policy_version 626572 (0.0008) [2023-12-26 04:37:29,565][123090] Updated weights for policy 1, policy_version 626582 (0.0010) [2023-12-26 04:37:29,617][123090] Updated weights for policy 1, policy_version 626592 (0.0010) [2023-12-26 04:37:29,722][123091] Updated weights for policy 0, policy_version 631000 (0.0008) [2023-12-26 04:37:29,786][123091] Updated weights for policy 0, policy_version 631010 (0.0009) [2023-12-26 04:37:29,843][123091] Updated weights for policy 0, policy_version 631020 (0.0009) [2023-12-26 04:37:30,381][123090] Updated weights for policy 1, policy_version 626602 (0.0009) [2023-12-26 04:37:30,433][123090] Updated weights for policy 1, policy_version 626612 (0.0010) [2023-12-26 04:37:30,484][123090] Updated weights for policy 1, policy_version 626622 (0.0010) [2023-12-26 04:37:30,690][123091] Updated weights for policy 0, policy_version 631030 (0.0008) [2023-12-26 04:37:30,750][123091] Updated weights for policy 0, policy_version 631040 (0.0010) [2023-12-26 04:37:30,807][123091] Updated weights for policy 0, policy_version 631050 (0.0010) [2023-12-26 04:37:31,245][123090] Updated weights for policy 1, policy_version 626632 (0.0010) [2023-12-26 04:37:31,321][123090] Updated weights for policy 1, policy_version 626642 (0.0006) [2023-12-26 04:37:31,397][123090] Updated weights for policy 1, policy_version 626652 (0.0007) [2023-12-26 04:37:31,647][123091] Updated weights for policy 0, policy_version 631060 (0.0011) [2023-12-26 04:37:31,703][123091] Updated weights for policy 0, policy_version 631070 (0.0011) [2023-12-26 04:37:31,771][123091] Updated weights for policy 0, policy_version 631080 (0.0011) [2023-12-26 04:37:32,172][123090] Updated weights for policy 1, policy_version 626662 (0.0009) [2023-12-26 04:37:32,223][123090] Updated weights for policy 1, policy_version 626672 (0.0008) [2023-12-26 04:37:32,292][123090] Updated weights for policy 1, policy_version 626682 (0.0009) [2023-12-26 04:37:32,598][123091] Updated weights for policy 0, policy_version 631090 (0.0008) [2023-12-26 04:37:32,666][123091] Updated weights for policy 0, policy_version 631100 (0.0005) [2023-12-26 04:37:32,739][123091] Updated weights for policy 0, policy_version 631110 (0.0005) [2023-12-26 04:37:32,787][123091] Updated weights for policy 0, policy_version 631120 (0.0005) [2023-12-26 04:37:33,151][123090] Updated weights for policy 1, policy_version 626692 (0.0008) [2023-12-26 04:37:33,206][123090] Updated weights for policy 1, policy_version 626702 (0.0008) [2023-12-26 04:37:33,265][123090] Updated weights for policy 1, policy_version 626712 (0.0008) [2023-12-26 04:37:33,520][123091] Updated weights for policy 0, policy_version 631130 (0.0010) [2023-12-26 04:37:33,567][123091] Updated weights for policy 0, policy_version 631140 (0.0010) [2023-12-26 04:37:33,610][123091] Updated weights for policy 0, policy_version 631150 (0.0010) [2023-12-26 04:37:33,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 322019328. Throughput: 0: 8850.2, 1: 8806.0. Samples: 322028076. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:33,785][121949] Avg episode reward: [(0, '6216.065'), (1, '5404.000')] [2023-12-26 04:37:34,027][123090] Updated weights for policy 1, policy_version 626722 (0.0009) [2023-12-26 04:37:34,079][123090] Updated weights for policy 1, policy_version 626732 (0.0009) [2023-12-26 04:37:34,140][123090] Updated weights for policy 1, policy_version 626742 (0.0009) [2023-12-26 04:37:34,196][123090] Updated weights for policy 1, policy_version 626752 (0.0009) [2023-12-26 04:37:34,425][123091] Updated weights for policy 0, policy_version 631160 (0.0010) [2023-12-26 04:37:34,480][123091] Updated weights for policy 0, policy_version 631170 (0.0009) [2023-12-26 04:37:34,539][123091] Updated weights for policy 0, policy_version 631180 (0.0008) [2023-12-26 04:37:35,077][123090] Updated weights for policy 1, policy_version 626762 (0.0009) [2023-12-26 04:37:35,126][123090] Updated weights for policy 1, policy_version 626772 (0.0010) [2023-12-26 04:37:35,175][123090] Updated weights for policy 1, policy_version 626782 (0.0009) [2023-12-26 04:37:35,370][123091] Updated weights for policy 0, policy_version 631190 (0.0008) [2023-12-26 04:37:35,436][123091] Updated weights for policy 0, policy_version 631200 (0.0009) [2023-12-26 04:37:35,491][123091] Updated weights for policy 0, policy_version 631210 (0.0009) [2023-12-26 04:37:35,867][123090] Updated weights for policy 1, policy_version 626792 (0.0010) [2023-12-26 04:37:35,935][123090] Updated weights for policy 1, policy_version 626802 (0.0011) [2023-12-26 04:37:35,986][123090] Updated weights for policy 1, policy_version 626812 (0.0010) [2023-12-26 04:37:36,363][123091] Updated weights for policy 0, policy_version 631221 (0.0010) [2023-12-26 04:37:36,415][123091] Updated weights for policy 0, policy_version 631231 (0.0009) [2023-12-26 04:37:36,467][123091] Updated weights for policy 0, policy_version 631241 (0.0009) [2023-12-26 04:37:36,845][123090] Updated weights for policy 1, policy_version 626822 (0.0010) [2023-12-26 04:37:36,913][123090] Updated weights for policy 1, policy_version 626832 (0.0011) [2023-12-26 04:37:36,962][123090] Updated weights for policy 1, policy_version 626842 (0.0010) [2023-12-26 04:37:37,350][123091] Updated weights for policy 0, policy_version 631251 (0.0010) [2023-12-26 04:37:37,405][123091] Updated weights for policy 0, policy_version 631261 (0.0010) [2023-12-26 04:37:37,459][123091] Updated weights for policy 0, policy_version 631271 (0.0010) [2023-12-26 04:37:37,689][123090] Updated weights for policy 1, policy_version 626852 (0.0009) [2023-12-26 04:37:37,753][123090] Updated weights for policy 1, policy_version 626862 (0.0009) [2023-12-26 04:37:37,820][123090] Updated weights for policy 1, policy_version 626872 (0.0008) [2023-12-26 04:37:38,226][123091] Updated weights for policy 0, policy_version 631281 (0.0009) [2023-12-26 04:37:38,282][123091] Updated weights for policy 0, policy_version 631291 (0.0005) [2023-12-26 04:37:38,341][123091] Updated weights for policy 0, policy_version 631301 (0.0008) [2023-12-26 04:37:38,400][123091] Updated weights for policy 0, policy_version 631311 (0.0009) [2023-12-26 04:37:38,573][123090] Updated weights for policy 1, policy_version 626882 (0.0008) [2023-12-26 04:37:38,625][123090] Updated weights for policy 1, policy_version 626892 (0.0010) [2023-12-26 04:37:38,673][123090] Updated weights for policy 1, policy_version 626902 (0.0010) [2023-12-26 04:37:38,725][123090] Updated weights for policy 1, policy_version 626912 (0.0010) [2023-12-26 04:37:38,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17612.7, 300 sec: 17772.4). Total num frames: 322109440. Throughput: 0: 8870.9, 1: 8796.6. Samples: 322080340. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:38,786][121949] Avg episode reward: [(0, '6203.273'), (1, '5072.274')] [2023-12-26 04:37:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000631312_161619968.pth... [2023-12-26 04:37:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000626912_160489472.pth... [2023-12-26 04:37:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000630288_161357824.pth [2023-12-26 04:37:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000625888_160227328.pth [2023-12-26 04:37:39,095][123091] Updated weights for policy 0, policy_version 631321 (0.0006) [2023-12-26 04:37:39,155][123091] Updated weights for policy 0, policy_version 631331 (0.0009) [2023-12-26 04:37:39,216][123091] Updated weights for policy 0, policy_version 631341 (0.0009) [2023-12-26 04:37:39,589][123090] Updated weights for policy 1, policy_version 626922 (0.0008) [2023-12-26 04:37:39,639][123090] Updated weights for policy 1, policy_version 626932 (0.0008) [2023-12-26 04:37:39,710][123090] Updated weights for policy 1, policy_version 626942 (0.0006) [2023-12-26 04:37:40,020][123091] Updated weights for policy 0, policy_version 631351 (0.0009) [2023-12-26 04:37:40,085][123091] Updated weights for policy 0, policy_version 631361 (0.0009) [2023-12-26 04:37:40,141][123091] Updated weights for policy 0, policy_version 631371 (0.0009) [2023-12-26 04:37:40,549][123090] Updated weights for policy 1, policy_version 626952 (0.0010) [2023-12-26 04:37:40,612][123090] Updated weights for policy 1, policy_version 626962 (0.0011) [2023-12-26 04:37:40,675][123090] Updated weights for policy 1, policy_version 626972 (0.0010) [2023-12-26 04:37:40,977][123091] Updated weights for policy 0, policy_version 631381 (0.0009) [2023-12-26 04:37:41,040][123091] Updated weights for policy 0, policy_version 631391 (0.0009) [2023-12-26 04:37:41,116][123091] Updated weights for policy 0, policy_version 631401 (0.0009) [2023-12-26 04:37:41,439][123090] Updated weights for policy 1, policy_version 626982 (0.0009) [2023-12-26 04:37:41,511][123090] Updated weights for policy 1, policy_version 626992 (0.0011) [2023-12-26 04:37:41,565][123090] Updated weights for policy 1, policy_version 627002 (0.0011) [2023-12-26 04:37:41,928][123091] Updated weights for policy 0, policy_version 631411 (0.0009) [2023-12-26 04:37:41,991][123091] Updated weights for policy 0, policy_version 631421 (0.0011) [2023-12-26 04:37:42,050][123091] Updated weights for policy 0, policy_version 631431 (0.0009) [2023-12-26 04:37:42,440][123090] Updated weights for policy 1, policy_version 627012 (0.0009) [2023-12-26 04:37:42,502][123090] Updated weights for policy 1, policy_version 627022 (0.0010) [2023-12-26 04:37:42,555][123090] Updated weights for policy 1, policy_version 627032 (0.0010) [2023-12-26 04:37:42,809][123091] Updated weights for policy 0, policy_version 631441 (0.0010) [2023-12-26 04:37:42,874][123091] Updated weights for policy 0, policy_version 631451 (0.0010) [2023-12-26 04:37:42,942][123091] Updated weights for policy 0, policy_version 631461 (0.0009) [2023-12-26 04:37:43,015][123091] Updated weights for policy 0, policy_version 631471 (0.0009) [2023-12-26 04:37:43,423][123090] Updated weights for policy 1, policy_version 627042 (0.0010) [2023-12-26 04:37:43,488][123090] Updated weights for policy 1, policy_version 627052 (0.0009) [2023-12-26 04:37:43,555][123090] Updated weights for policy 1, policy_version 627062 (0.0009) [2023-12-26 04:37:43,624][123090] Updated weights for policy 1, policy_version 627072 (0.0010) [2023-12-26 04:37:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 322191360. Throughput: 0: 8941.1, 1: 8787.7. Samples: 322186120. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:43,785][121949] Avg episode reward: [(0, '6197.087'), (1, '5152.900')] [2023-12-26 04:37:43,831][123091] Updated weights for policy 0, policy_version 631481 (0.0009) [2023-12-26 04:37:43,889][123091] Updated weights for policy 0, policy_version 631491 (0.0009) [2023-12-26 04:37:43,954][123091] Updated weights for policy 0, policy_version 631501 (0.0009) [2023-12-26 04:37:44,457][123090] Updated weights for policy 1, policy_version 627082 (0.0009) [2023-12-26 04:37:44,521][123090] Updated weights for policy 1, policy_version 627092 (0.0009) [2023-12-26 04:37:44,583][123090] Updated weights for policy 1, policy_version 627102 (0.0009) [2023-12-26 04:37:44,806][123091] Updated weights for policy 0, policy_version 631511 (0.0009) [2023-12-26 04:37:44,867][123091] Updated weights for policy 0, policy_version 631521 (0.0009) [2023-12-26 04:37:44,932][123091] Updated weights for policy 0, policy_version 631531 (0.0009) [2023-12-26 04:37:45,410][123090] Updated weights for policy 1, policy_version 627112 (0.0011) [2023-12-26 04:37:45,477][123090] Updated weights for policy 1, policy_version 627122 (0.0010) [2023-12-26 04:37:45,547][123090] Updated weights for policy 1, policy_version 627132 (0.0010) [2023-12-26 04:37:45,763][123091] Updated weights for policy 0, policy_version 631541 (0.0008) [2023-12-26 04:37:45,819][123091] Updated weights for policy 0, policy_version 631551 (0.0009) [2023-12-26 04:37:45,883][123091] Updated weights for policy 0, policy_version 631561 (0.0008) [2023-12-26 04:37:46,201][123090] Updated weights for policy 1, policy_version 627142 (0.0005) [2023-12-26 04:37:46,266][123090] Updated weights for policy 1, policy_version 627152 (0.0005) [2023-12-26 04:37:46,321][123090] Updated weights for policy 1, policy_version 627162 (0.0005) [2023-12-26 04:37:46,680][123091] Updated weights for policy 0, policy_version 631571 (0.0006) [2023-12-26 04:37:46,731][123091] Updated weights for policy 0, policy_version 631581 (0.0009) [2023-12-26 04:37:46,803][123091] Updated weights for policy 0, policy_version 631591 (0.0005) [2023-12-26 04:37:46,989][123090] Updated weights for policy 1, policy_version 627172 (0.0007) [2023-12-26 04:37:47,061][123090] Updated weights for policy 1, policy_version 627182 (0.0011) [2023-12-26 04:37:47,131][123090] Updated weights for policy 1, policy_version 627192 (0.0010) [2023-12-26 04:37:47,531][123091] Updated weights for policy 0, policy_version 631601 (0.0006) [2023-12-26 04:37:47,590][123091] Updated weights for policy 0, policy_version 631611 (0.0010) [2023-12-26 04:37:47,648][123091] Updated weights for policy 0, policy_version 631621 (0.0011) [2023-12-26 04:37:47,724][123091] Updated weights for policy 0, policy_version 631631 (0.0013) [2023-12-26 04:37:47,831][123090] Updated weights for policy 1, policy_version 627202 (0.0008) [2023-12-26 04:37:47,902][123090] Updated weights for policy 1, policy_version 627212 (0.0009) [2023-12-26 04:37:47,971][123090] Updated weights for policy 1, policy_version 627222 (0.0006) [2023-12-26 04:37:48,035][123090] Updated weights for policy 1, policy_version 627232 (0.0006) [2023-12-26 04:37:48,514][123091] Updated weights for policy 0, policy_version 631641 (0.0008) [2023-12-26 04:37:48,571][123091] Updated weights for policy 0, policy_version 631651 (0.0008) [2023-12-26 04:37:48,640][123091] Updated weights for policy 0, policy_version 631661 (0.0008) [2023-12-26 04:37:48,711][123090] Updated weights for policy 1, policy_version 627242 (0.0010) [2023-12-26 04:37:48,778][123090] Updated weights for policy 1, policy_version 627252 (0.0010) [2023-12-26 04:37:48,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 322281472. Throughput: 0: 8921.9, 1: 8846.7. Samples: 322294328. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:48,785][121949] Avg episode reward: [(0, '6108.854'), (1, '5261.968')] [2023-12-26 04:37:48,845][123090] Updated weights for policy 1, policy_version 627262 (0.0010) [2023-12-26 04:37:49,330][123091] Updated weights for policy 0, policy_version 631671 (0.0008) [2023-12-26 04:37:49,399][123091] Updated weights for policy 0, policy_version 631681 (0.0009) [2023-12-26 04:37:49,453][123091] Updated weights for policy 0, policy_version 631691 (0.0009) [2023-12-26 04:37:49,660][123090] Updated weights for policy 1, policy_version 627272 (0.0010) [2023-12-26 04:37:49,719][123090] Updated weights for policy 1, policy_version 627282 (0.0010) [2023-12-26 04:37:49,782][123090] Updated weights for policy 1, policy_version 627292 (0.0010) [2023-12-26 04:37:50,276][123091] Updated weights for policy 0, policy_version 631701 (0.0007) [2023-12-26 04:37:50,348][123091] Updated weights for policy 0, policy_version 631711 (0.0007) [2023-12-26 04:37:50,405][123091] Updated weights for policy 0, policy_version 631721 (0.0009) [2023-12-26 04:37:50,623][123090] Updated weights for policy 1, policy_version 627302 (0.0011) [2023-12-26 04:37:50,707][123090] Updated weights for policy 1, policy_version 627312 (0.0011) [2023-12-26 04:37:50,777][123090] Updated weights for policy 1, policy_version 627322 (0.0010) [2023-12-26 04:37:51,272][123091] Updated weights for policy 0, policy_version 631731 (0.0009) [2023-12-26 04:37:51,337][123091] Updated weights for policy 0, policy_version 631741 (0.0006) [2023-12-26 04:37:51,409][123091] Updated weights for policy 0, policy_version 631751 (0.0007) [2023-12-26 04:37:51,570][123090] Updated weights for policy 1, policy_version 627332 (0.0008) [2023-12-26 04:37:51,640][123090] Updated weights for policy 1, policy_version 627342 (0.0011) [2023-12-26 04:37:51,703][123090] Updated weights for policy 1, policy_version 627352 (0.0010) [2023-12-26 04:37:52,194][123091] Updated weights for policy 0, policy_version 631761 (0.0006) [2023-12-26 04:37:52,248][123091] Updated weights for policy 0, policy_version 631771 (0.0011) [2023-12-26 04:37:52,308][123091] Updated weights for policy 0, policy_version 631781 (0.0009) [2023-12-26 04:37:52,378][123091] Updated weights for policy 0, policy_version 631791 (0.0007) [2023-12-26 04:37:52,535][123090] Updated weights for policy 1, policy_version 627362 (0.0011) [2023-12-26 04:37:52,603][123090] Updated weights for policy 1, policy_version 627372 (0.0011) [2023-12-26 04:37:52,674][123090] Updated weights for policy 1, policy_version 627382 (0.0010) [2023-12-26 04:37:52,742][123090] Updated weights for policy 1, policy_version 627392 (0.0011) [2023-12-26 04:37:53,193][123091] Updated weights for policy 0, policy_version 631801 (0.0010) [2023-12-26 04:37:53,258][123091] Updated weights for policy 0, policy_version 631811 (0.0010) [2023-12-26 04:37:53,316][123091] Updated weights for policy 0, policy_version 631821 (0.0010) [2023-12-26 04:37:53,538][123090] Updated weights for policy 1, policy_version 627402 (0.0010) [2023-12-26 04:37:53,590][123090] Updated weights for policy 1, policy_version 627412 (0.0010) [2023-12-26 04:37:53,649][123090] Updated weights for policy 1, policy_version 627422 (0.0010) [2023-12-26 04:37:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 322371584. Throughput: 0: 8923.0, 1: 8799.6. Samples: 322346588. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:53,785][121949] Avg episode reward: [(0, '6183.155'), (1, '5260.252')] [2023-12-26 04:37:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000631824_161751040.pth... [2023-12-26 04:37:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000627424_160620544.pth... [2023-12-26 04:37:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000630800_161488896.pth [2023-12-26 04:37:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000626368_160350208.pth [2023-12-26 04:37:54,108][123091] Updated weights for policy 0, policy_version 631831 (0.0007) [2023-12-26 04:37:54,158][123091] Updated weights for policy 0, policy_version 631841 (0.0005) [2023-12-26 04:37:54,219][123091] Updated weights for policy 0, policy_version 631851 (0.0007) [2023-12-26 04:37:54,388][123090] Updated weights for policy 1, policy_version 627432 (0.0007) [2023-12-26 04:37:54,433][123090] Updated weights for policy 1, policy_version 627442 (0.0005) [2023-12-26 04:37:54,483][123090] Updated weights for policy 1, policy_version 627453 (0.0009) [2023-12-26 04:37:54,856][123091] Updated weights for policy 0, policy_version 631861 (0.0009) [2023-12-26 04:37:54,910][123091] Updated weights for policy 0, policy_version 631871 (0.0005) [2023-12-26 04:37:54,971][123091] Updated weights for policy 0, policy_version 631881 (0.0008) [2023-12-26 04:37:55,228][123090] Updated weights for policy 1, policy_version 627463 (0.0009) [2023-12-26 04:37:55,290][123090] Updated weights for policy 1, policy_version 627473 (0.0010) [2023-12-26 04:37:55,363][123090] Updated weights for policy 1, policy_version 627483 (0.0005) [2023-12-26 04:37:55,754][123091] Updated weights for policy 0, policy_version 631891 (0.0011) [2023-12-26 04:37:55,814][123091] Updated weights for policy 0, policy_version 631901 (0.0011) [2023-12-26 04:37:55,881][123091] Updated weights for policy 0, policy_version 631911 (0.0011) [2023-12-26 04:37:56,018][123090] Updated weights for policy 1, policy_version 627493 (0.0008) [2023-12-26 04:37:56,078][123090] Updated weights for policy 1, policy_version 627503 (0.0010) [2023-12-26 04:37:56,133][123090] Updated weights for policy 1, policy_version 627513 (0.0007) [2023-12-26 04:37:56,692][123091] Updated weights for policy 0, policy_version 631921 (0.0008) [2023-12-26 04:37:56,742][123091] Updated weights for policy 0, policy_version 631931 (0.0006) [2023-12-26 04:37:56,768][123090] Updated weights for policy 1, policy_version 627523 (0.0005) [2023-12-26 04:37:56,798][123091] Updated weights for policy 0, policy_version 631941 (0.0005) [2023-12-26 04:37:56,816][123090] Updated weights for policy 1, policy_version 627533 (0.0005) [2023-12-26 04:37:56,846][123091] Updated weights for policy 0, policy_version 631951 (0.0005) [2023-12-26 04:37:56,868][123090] Updated weights for policy 1, policy_version 627543 (0.0005) [2023-12-26 04:37:57,594][123091] Updated weights for policy 0, policy_version 631961 (0.0009) [2023-12-26 04:37:57,614][123090] Updated weights for policy 1, policy_version 627553 (0.0005) [2023-12-26 04:37:57,645][123091] Updated weights for policy 0, policy_version 631972 (0.0009) [2023-12-26 04:37:57,659][123090] Updated weights for policy 1, policy_version 627563 (0.0005) [2023-12-26 04:37:57,693][123091] Updated weights for policy 0, policy_version 631982 (0.0009) [2023-12-26 04:37:57,710][123090] Updated weights for policy 1, policy_version 627573 (0.0007) [2023-12-26 04:37:57,761][123090] Updated weights for policy 1, policy_version 627583 (0.0010) [2023-12-26 04:37:58,534][123090] Updated weights for policy 1, policy_version 627593 (0.0009) [2023-12-26 04:37:58,595][123090] Updated weights for policy 1, policy_version 627603 (0.0009) [2023-12-26 04:37:58,654][123091] Updated weights for policy 0, policy_version 631992 (0.0011) [2023-12-26 04:37:58,665][123090] Updated weights for policy 1, policy_version 627613 (0.0010) [2023-12-26 04:37:58,717][123091] Updated weights for policy 0, policy_version 632002 (0.0010) [2023-12-26 04:37:58,785][121949] Fps is (10 sec: 18021.1, 60 sec: 17885.7, 300 sec: 17772.4). Total num frames: 322461696. Throughput: 0: 8855.0, 1: 8942.1. Samples: 322457488. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:37:58,785][121949] Avg episode reward: [(0, '6181.258'), (1, '5166.182')] [2023-12-26 04:37:58,795][123091] Updated weights for policy 0, policy_version 632012 (0.0010) [2023-12-26 04:37:59,545][123090] Updated weights for policy 1, policy_version 627623 (0.0007) [2023-12-26 04:37:59,612][123090] Updated weights for policy 1, policy_version 627633 (0.0006) [2023-12-26 04:37:59,640][123091] Updated weights for policy 0, policy_version 632022 (0.0009) [2023-12-26 04:37:59,674][123090] Updated weights for policy 1, policy_version 627643 (0.0010) [2023-12-26 04:37:59,699][123091] Updated weights for policy 0, policy_version 632032 (0.0006) [2023-12-26 04:37:59,754][123091] Updated weights for policy 0, policy_version 632042 (0.0006) [2023-12-26 04:38:00,464][123090] Updated weights for policy 1, policy_version 627653 (0.0008) [2023-12-26 04:38:00,525][123090] Updated weights for policy 1, policy_version 627663 (0.0009) [2023-12-26 04:38:00,547][123091] Updated weights for policy 0, policy_version 632052 (0.0009) [2023-12-26 04:38:00,593][123090] Updated weights for policy 1, policy_version 627673 (0.0008) [2023-12-26 04:38:00,600][123091] Updated weights for policy 0, policy_version 632062 (0.0006) [2023-12-26 04:38:00,659][123091] Updated weights for policy 0, policy_version 632072 (0.0006) [2023-12-26 04:38:01,442][123090] Updated weights for policy 1, policy_version 627683 (0.0009) [2023-12-26 04:38:01,463][123091] Updated weights for policy 0, policy_version 632082 (0.0010) [2023-12-26 04:38:01,500][123090] Updated weights for policy 1, policy_version 627693 (0.0009) [2023-12-26 04:38:01,525][123091] Updated weights for policy 0, policy_version 632092 (0.0006) [2023-12-26 04:38:01,560][123090] Updated weights for policy 1, policy_version 627703 (0.0009) [2023-12-26 04:38:01,588][123091] Updated weights for policy 0, policy_version 632102 (0.0008) [2023-12-26 04:38:01,654][123091] Updated weights for policy 0, policy_version 632112 (0.0010) [2023-12-26 04:38:02,395][123090] Updated weights for policy 1, policy_version 627713 (0.0008) [2023-12-26 04:38:02,452][123090] Updated weights for policy 1, policy_version 627723 (0.0009) [2023-12-26 04:38:02,485][123091] Updated weights for policy 0, policy_version 632122 (0.0010) [2023-12-26 04:38:02,514][123090] Updated weights for policy 1, policy_version 627733 (0.0008) [2023-12-26 04:38:02,551][123091] Updated weights for policy 0, policy_version 632132 (0.0007) [2023-12-26 04:38:02,569][123090] Updated weights for policy 1, policy_version 627743 (0.0008) [2023-12-26 04:38:02,607][123091] Updated weights for policy 0, policy_version 632142 (0.0007) [2023-12-26 04:38:03,349][123091] Updated weights for policy 0, policy_version 632152 (0.0006) [2023-12-26 04:38:03,395][123090] Updated weights for policy 1, policy_version 627753 (0.0008) [2023-12-26 04:38:03,402][123091] Updated weights for policy 0, policy_version 632162 (0.0008) [2023-12-26 04:38:03,445][123090] Updated weights for policy 1, policy_version 627763 (0.0008) [2023-12-26 04:38:03,447][123091] Updated weights for policy 0, policy_version 632172 (0.0006) [2023-12-26 04:38:03,502][123090] Updated weights for policy 1, policy_version 627773 (0.0008) [2023-12-26 04:38:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 322551808. Throughput: 0: 8881.0, 1: 8865.2. Samples: 322559476. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:38:03,785][121949] Avg episode reward: [(0, '6209.807'), (1, '5035.590')] [2023-12-26 04:38:04,276][123090] Updated weights for policy 1, policy_version 627783 (0.0010) [2023-12-26 04:38:04,283][123091] Updated weights for policy 0, policy_version 632182 (0.0007) [2023-12-26 04:38:04,335][123091] Updated weights for policy 0, policy_version 632192 (0.0007) [2023-12-26 04:38:04,341][123090] Updated weights for policy 1, policy_version 627793 (0.0010) [2023-12-26 04:38:04,400][123091] Updated weights for policy 0, policy_version 632202 (0.0009) [2023-12-26 04:38:04,404][123090] Updated weights for policy 1, policy_version 627803 (0.0005) [2023-12-26 04:38:05,092][123090] Updated weights for policy 1, policy_version 627813 (0.0006) [2023-12-26 04:38:05,133][123091] Updated weights for policy 0, policy_version 632212 (0.0008) [2023-12-26 04:38:05,152][123090] Updated weights for policy 1, policy_version 627823 (0.0006) [2023-12-26 04:38:05,190][123091] Updated weights for policy 0, policy_version 632222 (0.0005) [2023-12-26 04:38:05,211][123090] Updated weights for policy 1, policy_version 627833 (0.0005) [2023-12-26 04:38:05,241][123091] Updated weights for policy 0, policy_version 632232 (0.0007) [2023-12-26 04:38:05,854][123090] Updated weights for policy 1, policy_version 627843 (0.0005) [2023-12-26 04:38:05,901][123090] Updated weights for policy 1, policy_version 627853 (0.0005) [2023-12-26 04:38:05,948][123090] Updated weights for policy 1, policy_version 627863 (0.0005) [2023-12-26 04:38:06,146][123091] Updated weights for policy 0, policy_version 632242 (0.0009) [2023-12-26 04:38:06,200][123091] Updated weights for policy 0, policy_version 632252 (0.0010) [2023-12-26 04:38:06,255][123091] Updated weights for policy 0, policy_version 632263 (0.0011) [2023-12-26 04:38:06,693][123090] Updated weights for policy 1, policy_version 627873 (0.0006) [2023-12-26 04:38:06,747][123090] Updated weights for policy 1, policy_version 627883 (0.0005) [2023-12-26 04:38:06,812][123090] Updated weights for policy 1, policy_version 627893 (0.0009) [2023-12-26 04:38:06,861][123090] Updated weights for policy 1, policy_version 627903 (0.0008) [2023-12-26 04:38:07,170][123091] Updated weights for policy 0, policy_version 632273 (0.0010) [2023-12-26 04:38:07,237][123091] Updated weights for policy 0, policy_version 632283 (0.0010) [2023-12-26 04:38:07,303][123091] Updated weights for policy 0, policy_version 632293 (0.0010) [2023-12-26 04:38:07,358][123091] Updated weights for policy 0, policy_version 632303 (0.0009) [2023-12-26 04:38:07,601][123090] Updated weights for policy 1, policy_version 627913 (0.0005) [2023-12-26 04:38:07,679][123090] Updated weights for policy 1, policy_version 627923 (0.0005) [2023-12-26 04:38:07,743][123090] Updated weights for policy 1, policy_version 627933 (0.0005) [2023-12-26 04:38:08,214][123091] Updated weights for policy 0, policy_version 632313 (0.0009) [2023-12-26 04:38:08,276][123091] Updated weights for policy 0, policy_version 632323 (0.0010) [2023-12-26 04:38:08,340][123091] Updated weights for policy 0, policy_version 632333 (0.0010) [2023-12-26 04:38:08,501][123090] Updated weights for policy 1, policy_version 627943 (0.0007) [2023-12-26 04:38:08,552][123090] Updated weights for policy 1, policy_version 627953 (0.0008) [2023-12-26 04:38:08,605][123090] Updated weights for policy 1, policy_version 627963 (0.0009) [2023-12-26 04:38:08,784][121949] Fps is (10 sec: 18023.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 322641920. Throughput: 0: 8824.4, 1: 9005.5. Samples: 322614924. Policy #0 lag: (min: 22.0, avg: 36.3, max: 54.0) [2023-12-26 04:38:08,785][121949] Avg episode reward: [(0, '6169.754'), (1, '4757.296')] [2023-12-26 04:38:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000627968_160759808.pth... [2023-12-26 04:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000632336_161882112.pth... [2023-12-26 04:38:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000626912_160489472.pth [2023-12-26 04:38:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000631312_161619968.pth [2023-12-26 04:38:09,205][123091] Updated weights for policy 0, policy_version 632343 (0.0010) [2023-12-26 04:38:09,276][123091] Updated weights for policy 0, policy_version 632353 (0.0008) [2023-12-26 04:38:09,336][123091] Updated weights for policy 0, policy_version 632363 (0.0008) [2023-12-26 04:38:09,459][123090] Updated weights for policy 1, policy_version 627973 (0.0009) [2023-12-26 04:38:09,527][123090] Updated weights for policy 1, policy_version 627983 (0.0010) [2023-12-26 04:38:09,593][123090] Updated weights for policy 1, policy_version 627993 (0.0010) [2023-12-26 04:38:10,145][123091] Updated weights for policy 0, policy_version 632373 (0.0007) [2023-12-26 04:38:10,211][123091] Updated weights for policy 0, policy_version 632383 (0.0010) [2023-12-26 04:38:10,276][123091] Updated weights for policy 0, policy_version 632393 (0.0007) [2023-12-26 04:38:10,410][123090] Updated weights for policy 1, policy_version 628003 (0.0009) [2023-12-26 04:38:10,482][123090] Updated weights for policy 1, policy_version 628013 (0.0006) [2023-12-26 04:38:10,546][123090] Updated weights for policy 1, policy_version 628023 (0.0005) [2023-12-26 04:38:11,045][123091] Updated weights for policy 0, policy_version 632403 (0.0009) [2023-12-26 04:38:11,100][123091] Updated weights for policy 0, policy_version 632413 (0.0009) [2023-12-26 04:38:11,175][123091] Updated weights for policy 0, policy_version 632423 (0.0007) [2023-12-26 04:38:11,230][123090] Updated weights for policy 1, policy_version 628033 (0.0006) [2023-12-26 04:38:11,299][123090] Updated weights for policy 1, policy_version 628043 (0.0006) [2023-12-26 04:38:11,370][123090] Updated weights for policy 1, policy_version 628053 (0.0009) [2023-12-26 04:38:11,439][123090] Updated weights for policy 1, policy_version 628063 (0.0006) [2023-12-26 04:38:12,026][123091] Updated weights for policy 0, policy_version 632433 (0.0008) [2023-12-26 04:38:12,085][123091] Updated weights for policy 0, policy_version 632443 (0.0009) [2023-12-26 04:38:12,142][123091] Updated weights for policy 0, policy_version 632453 (0.0009) [2023-12-26 04:38:12,206][123091] Updated weights for policy 0, policy_version 632463 (0.0009) [2023-12-26 04:38:12,243][123090] Updated weights for policy 1, policy_version 628073 (0.0009) [2023-12-26 04:38:12,315][123090] Updated weights for policy 1, policy_version 628083 (0.0009) [2023-12-26 04:38:12,393][123090] Updated weights for policy 1, policy_version 628093 (0.0009) [2023-12-26 04:38:13,028][123091] Updated weights for policy 0, policy_version 632473 (0.0007) [2023-12-26 04:38:13,087][123091] Updated weights for policy 0, policy_version 632483 (0.0007) [2023-12-26 04:38:13,146][123091] Updated weights for policy 0, policy_version 632493 (0.0008) [2023-12-26 04:38:13,237][123090] Updated weights for policy 1, policy_version 628103 (0.0010) [2023-12-26 04:38:13,288][123090] Updated weights for policy 1, policy_version 628113 (0.0010) [2023-12-26 04:38:13,350][123090] Updated weights for policy 1, policy_version 628123 (0.0010) [2023-12-26 04:38:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 322723840. Throughput: 0: 8757.7, 1: 9004.4. Samples: 322719340. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:13,785][121949] Avg episode reward: [(0, '6242.152'), (1, '4630.730')] [2023-12-26 04:38:13,969][123091] Updated weights for policy 0, policy_version 632503 (0.0006) [2023-12-26 04:38:13,979][123090] Updated weights for policy 1, policy_version 628133 (0.0010) [2023-12-26 04:38:14,015][123091] Updated weights for policy 0, policy_version 632513 (0.0005) [2023-12-26 04:38:14,031][123090] Updated weights for policy 1, policy_version 628143 (0.0010) [2023-12-26 04:38:14,063][123091] Updated weights for policy 0, policy_version 632523 (0.0005) [2023-12-26 04:38:14,086][123090] Updated weights for policy 1, policy_version 628153 (0.0007) [2023-12-26 04:38:14,876][123091] Updated weights for policy 0, policy_version 632533 (0.0008) [2023-12-26 04:38:14,935][123090] Updated weights for policy 1, policy_version 628163 (0.0008) [2023-12-26 04:38:14,948][123091] Updated weights for policy 0, policy_version 632543 (0.0010) [2023-12-26 04:38:14,999][123090] Updated weights for policy 1, policy_version 628173 (0.0011) [2023-12-26 04:38:15,012][123091] Updated weights for policy 0, policy_version 632553 (0.0011) [2023-12-26 04:38:15,068][123090] Updated weights for policy 1, policy_version 628183 (0.0011) [2023-12-26 04:38:15,817][123091] Updated weights for policy 0, policy_version 632563 (0.0011) [2023-12-26 04:38:15,883][123091] Updated weights for policy 0, policy_version 632573 (0.0011) [2023-12-26 04:38:15,889][123090] Updated weights for policy 1, policy_version 628193 (0.0011) [2023-12-26 04:38:15,937][123091] Updated weights for policy 0, policy_version 632583 (0.0010) [2023-12-26 04:38:15,942][123090] Updated weights for policy 1, policy_version 628203 (0.0009) [2023-12-26 04:38:15,989][123090] Updated weights for policy 1, policy_version 628213 (0.0010) [2023-12-26 04:38:16,059][123090] Updated weights for policy 1, policy_version 628223 (0.0010) [2023-12-26 04:38:16,748][123091] Updated weights for policy 0, policy_version 632593 (0.0008) [2023-12-26 04:38:16,807][123091] Updated weights for policy 0, policy_version 632603 (0.0011) [2023-12-26 04:38:16,859][123091] Updated weights for policy 0, policy_version 632613 (0.0011) [2023-12-26 04:38:16,892][123090] Updated weights for policy 1, policy_version 628233 (0.0006) [2023-12-26 04:38:16,911][123091] Updated weights for policy 0, policy_version 632623 (0.0011) [2023-12-26 04:38:16,943][123090] Updated weights for policy 1, policy_version 628243 (0.0007) [2023-12-26 04:38:17,004][123090] Updated weights for policy 1, policy_version 628253 (0.0009) [2023-12-26 04:38:17,751][123091] Updated weights for policy 0, policy_version 632633 (0.0010) [2023-12-26 04:38:17,803][123091] Updated weights for policy 0, policy_version 632643 (0.0010) [2023-12-26 04:38:17,822][123090] Updated weights for policy 1, policy_version 628263 (0.0007) [2023-12-26 04:38:17,858][123091] Updated weights for policy 0, policy_version 632653 (0.0010) [2023-12-26 04:38:17,881][123090] Updated weights for policy 1, policy_version 628273 (0.0007) [2023-12-26 04:38:17,938][123090] Updated weights for policy 1, policy_version 628283 (0.0009) [2023-12-26 04:38:18,735][123091] Updated weights for policy 0, policy_version 632663 (0.0011) [2023-12-26 04:38:18,779][123090] Updated weights for policy 1, policy_version 628293 (0.0009) [2023-12-26 04:38:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 322805760. Throughput: 0: 8704.6, 1: 8974.8. Samples: 322823648. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:18,785][121949] Avg episode reward: [(0, '6182.281'), (1, '4714.368')] [2023-12-26 04:38:18,790][123091] Updated weights for policy 0, policy_version 632673 (0.0011) [2023-12-26 04:38:18,838][123090] Updated weights for policy 1, policy_version 628303 (0.0006) [2023-12-26 04:38:18,857][123091] Updated weights for policy 0, policy_version 632683 (0.0010) [2023-12-26 04:38:18,889][123090] Updated weights for policy 1, policy_version 628313 (0.0005) [2023-12-26 04:38:19,671][123090] Updated weights for policy 1, policy_version 628323 (0.0005) [2023-12-26 04:38:19,680][123091] Updated weights for policy 0, policy_version 632693 (0.0011) [2023-12-26 04:38:19,738][123090] Updated weights for policy 1, policy_version 628333 (0.0008) [2023-12-26 04:38:19,754][123091] Updated weights for policy 0, policy_version 632703 (0.0007) [2023-12-26 04:38:19,806][123090] Updated weights for policy 1, policy_version 628343 (0.0008) [2023-12-26 04:38:19,820][123091] Updated weights for policy 0, policy_version 632713 (0.0008) [2023-12-26 04:38:20,514][123090] Updated weights for policy 1, policy_version 628353 (0.0008) [2023-12-26 04:38:20,515][123091] Updated weights for policy 0, policy_version 632723 (0.0007) [2023-12-26 04:38:20,576][123090] Updated weights for policy 1, policy_version 628363 (0.0009) [2023-12-26 04:38:20,585][123091] Updated weights for policy 0, policy_version 632733 (0.0007) [2023-12-26 04:38:20,640][123090] Updated weights for policy 1, policy_version 628373 (0.0006) [2023-12-26 04:38:20,654][123091] Updated weights for policy 0, policy_version 632743 (0.0011) [2023-12-26 04:38:20,708][123090] Updated weights for policy 1, policy_version 628383 (0.0007) [2023-12-26 04:38:21,447][123091] Updated weights for policy 0, policy_version 632753 (0.0010) [2023-12-26 04:38:21,518][123091] Updated weights for policy 0, policy_version 632763 (0.0008) [2023-12-26 04:38:21,585][123091] Updated weights for policy 0, policy_version 632773 (0.0008) [2023-12-26 04:38:21,597][123090] Updated weights for policy 1, policy_version 628393 (0.0008) [2023-12-26 04:38:21,656][123091] Updated weights for policy 0, policy_version 632783 (0.0008) [2023-12-26 04:38:21,662][123090] Updated weights for policy 1, policy_version 628403 (0.0010) [2023-12-26 04:38:21,732][123090] Updated weights for policy 1, policy_version 628413 (0.0009) [2023-12-26 04:38:22,472][123091] Updated weights for policy 0, policy_version 632793 (0.0010) [2023-12-26 04:38:22,539][123091] Updated weights for policy 0, policy_version 632803 (0.0011) [2023-12-26 04:38:22,602][123091] Updated weights for policy 0, policy_version 632813 (0.0011) [2023-12-26 04:38:22,608][123090] Updated weights for policy 1, policy_version 628423 (0.0009) [2023-12-26 04:38:22,666][123090] Updated weights for policy 1, policy_version 628433 (0.0009) [2023-12-26 04:38:22,730][123090] Updated weights for policy 1, policy_version 628443 (0.0008) [2023-12-26 04:38:23,414][123091] Updated weights for policy 0, policy_version 632823 (0.0011) [2023-12-26 04:38:23,476][123091] Updated weights for policy 0, policy_version 632833 (0.0011) [2023-12-26 04:38:23,538][123091] Updated weights for policy 0, policy_version 632843 (0.0011) [2023-12-26 04:38:23,588][123090] Updated weights for policy 1, policy_version 628453 (0.0008) [2023-12-26 04:38:23,638][123090] Updated weights for policy 1, policy_version 628463 (0.0009) [2023-12-26 04:38:23,687][123090] Updated weights for policy 1, policy_version 628473 (0.0009) [2023-12-26 04:38:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.5, 300 sec: 17772.5). Total num frames: 322904064. Throughput: 0: 8726.0, 1: 8979.6. Samples: 322877084. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:23,785][121949] Avg episode reward: [(0, '6180.428'), (1, '4831.488')] [2023-12-26 04:38:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000632848_162013184.pth... [2023-12-26 04:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000628480_160890880.pth... [2023-12-26 04:38:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000631824_161751040.pth [2023-12-26 04:38:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000627424_160620544.pth [2023-12-26 04:38:24,350][123091] Updated weights for policy 0, policy_version 632853 (0.0010) [2023-12-26 04:38:24,405][123091] Updated weights for policy 0, policy_version 632863 (0.0010) [2023-12-26 04:38:24,469][123091] Updated weights for policy 0, policy_version 632873 (0.0010) [2023-12-26 04:38:24,542][123090] Updated weights for policy 1, policy_version 628483 (0.0009) [2023-12-26 04:38:24,603][123090] Updated weights for policy 1, policy_version 628493 (0.0009) [2023-12-26 04:38:24,652][123090] Updated weights for policy 1, policy_version 628503 (0.0009) [2023-12-26 04:38:25,279][123091] Updated weights for policy 0, policy_version 632883 (0.0010) [2023-12-26 04:38:25,330][123091] Updated weights for policy 0, policy_version 632893 (0.0010) [2023-12-26 04:38:25,380][123091] Updated weights for policy 0, policy_version 632903 (0.0010) [2023-12-26 04:38:25,499][123090] Updated weights for policy 1, policy_version 628513 (0.0009) [2023-12-26 04:38:25,547][123090] Updated weights for policy 1, policy_version 628523 (0.0009) [2023-12-26 04:38:25,600][123090] Updated weights for policy 1, policy_version 628533 (0.0009) [2023-12-26 04:38:25,650][123090] Updated weights for policy 1, policy_version 628543 (0.0009) [2023-12-26 04:38:26,138][123091] Updated weights for policy 0, policy_version 632913 (0.0010) [2023-12-26 04:38:26,200][123091] Updated weights for policy 0, policy_version 632923 (0.0011) [2023-12-26 04:38:26,250][123091] Updated weights for policy 0, policy_version 632933 (0.0010) [2023-12-26 04:38:26,323][123091] Updated weights for policy 0, policy_version 632943 (0.0005) [2023-12-26 04:38:26,561][123090] Updated weights for policy 1, policy_version 628553 (0.0005) [2023-12-26 04:38:26,612][123090] Updated weights for policy 1, policy_version 628563 (0.0005) [2023-12-26 04:38:26,667][123090] Updated weights for policy 1, policy_version 628573 (0.0005) [2023-12-26 04:38:27,074][123091] Updated weights for policy 0, policy_version 632953 (0.0010) [2023-12-26 04:38:27,124][123091] Updated weights for policy 0, policy_version 632963 (0.0010) [2023-12-26 04:38:27,175][123091] Updated weights for policy 0, policy_version 632973 (0.0010) [2023-12-26 04:38:27,388][123090] Updated weights for policy 1, policy_version 628583 (0.0008) [2023-12-26 04:38:27,447][123090] Updated weights for policy 1, policy_version 628593 (0.0008) [2023-12-26 04:38:27,502][123090] Updated weights for policy 1, policy_version 628603 (0.0009) [2023-12-26 04:38:28,002][123091] Updated weights for policy 0, policy_version 632983 (0.0011) [2023-12-26 04:38:28,060][123091] Updated weights for policy 0, policy_version 632993 (0.0010) [2023-12-26 04:38:28,115][123091] Updated weights for policy 0, policy_version 633003 (0.0010) [2023-12-26 04:38:28,349][123090] Updated weights for policy 1, policy_version 628613 (0.0009) [2023-12-26 04:38:28,409][123090] Updated weights for policy 1, policy_version 628623 (0.0009) [2023-12-26 04:38:28,472][123090] Updated weights for policy 1, policy_version 628633 (0.0008) [2023-12-26 04:38:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 322985984. Throughput: 0: 8723.4, 1: 8931.4. Samples: 322980584. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:28,785][121949] Avg episode reward: [(0, '6334.652'), (1, '5108.986')] [2023-12-26 04:38:28,932][123091] Updated weights for policy 0, policy_version 633013 (0.0008) [2023-12-26 04:38:28,995][123091] Updated weights for policy 0, policy_version 633023 (0.0005) [2023-12-26 04:38:29,055][123091] Updated weights for policy 0, policy_version 633033 (0.0005) [2023-12-26 04:38:29,232][123090] Updated weights for policy 1, policy_version 628643 (0.0008) [2023-12-26 04:38:29,301][123090] Updated weights for policy 1, policy_version 628653 (0.0010) [2023-12-26 04:38:29,369][123090] Updated weights for policy 1, policy_version 628663 (0.0009) [2023-12-26 04:38:29,705][123091] Updated weights for policy 0, policy_version 633043 (0.0007) [2023-12-26 04:38:29,769][123091] Updated weights for policy 0, policy_version 633053 (0.0010) [2023-12-26 04:38:29,835][123091] Updated weights for policy 0, policy_version 633063 (0.0008) [2023-12-26 04:38:30,217][123090] Updated weights for policy 1, policy_version 628673 (0.0009) [2023-12-26 04:38:30,286][123090] Updated weights for policy 1, policy_version 628683 (0.0010) [2023-12-26 04:38:30,351][123090] Updated weights for policy 1, policy_version 628693 (0.0005) [2023-12-26 04:38:30,406][123090] Updated weights for policy 1, policy_version 628703 (0.0005) [2023-12-26 04:38:30,601][123091] Updated weights for policy 0, policy_version 633073 (0.0009) [2023-12-26 04:38:30,673][123091] Updated weights for policy 0, policy_version 633083 (0.0006) [2023-12-26 04:38:30,743][123091] Updated weights for policy 0, policy_version 633093 (0.0009) [2023-12-26 04:38:30,802][123091] Updated weights for policy 0, policy_version 633103 (0.0009) [2023-12-26 04:38:31,117][123090] Updated weights for policy 1, policy_version 628713 (0.0010) [2023-12-26 04:38:31,187][123090] Updated weights for policy 1, policy_version 628723 (0.0009) [2023-12-26 04:38:31,251][123090] Updated weights for policy 1, policy_version 628733 (0.0010) [2023-12-26 04:38:31,564][123091] Updated weights for policy 0, policy_version 633113 (0.0006) [2023-12-26 04:38:31,637][123091] Updated weights for policy 0, policy_version 633123 (0.0009) [2023-12-26 04:38:31,699][123091] Updated weights for policy 0, policy_version 633133 (0.0011) [2023-12-26 04:38:32,084][123090] Updated weights for policy 1, policy_version 628743 (0.0009) [2023-12-26 04:38:32,139][123090] Updated weights for policy 1, policy_version 628753 (0.0005) [2023-12-26 04:38:32,194][123090] Updated weights for policy 1, policy_version 628763 (0.0005) [2023-12-26 04:38:32,356][123091] Updated weights for policy 0, policy_version 633143 (0.0010) [2023-12-26 04:38:32,426][123091] Updated weights for policy 0, policy_version 633153 (0.0011) [2023-12-26 04:38:32,491][123091] Updated weights for policy 0, policy_version 633163 (0.0011) [2023-12-26 04:38:32,966][123090] Updated weights for policy 1, policy_version 628773 (0.0008) [2023-12-26 04:38:33,039][123090] Updated weights for policy 1, policy_version 628783 (0.0010) [2023-12-26 04:38:33,105][123090] Updated weights for policy 1, policy_version 628793 (0.0010) [2023-12-26 04:38:33,222][123091] Updated weights for policy 0, policy_version 633173 (0.0008) [2023-12-26 04:38:33,283][123091] Updated weights for policy 0, policy_version 633183 (0.0006) [2023-12-26 04:38:33,358][123091] Updated weights for policy 0, policy_version 633193 (0.0006) [2023-12-26 04:38:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 323076096. Throughput: 0: 8793.8, 1: 8879.8. Samples: 323089644. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:33,785][121949] Avg episode reward: [(0, '6263.005'), (1, '4975.584')] [2023-12-26 04:38:33,828][123090] Updated weights for policy 1, policy_version 628803 (0.0007) [2023-12-26 04:38:33,885][123090] Updated weights for policy 1, policy_version 628813 (0.0005) [2023-12-26 04:38:33,933][123090] Updated weights for policy 1, policy_version 628823 (0.0005) [2023-12-26 04:38:34,057][123091] Updated weights for policy 0, policy_version 633203 (0.0005) [2023-12-26 04:38:34,124][123091] Updated weights for policy 0, policy_version 633213 (0.0005) [2023-12-26 04:38:34,189][123091] Updated weights for policy 0, policy_version 633224 (0.0012) [2023-12-26 04:38:34,650][123090] Updated weights for policy 1, policy_version 628833 (0.0006) [2023-12-26 04:38:34,720][123090] Updated weights for policy 1, policy_version 628843 (0.0010) [2023-12-26 04:38:34,793][123090] Updated weights for policy 1, policy_version 628853 (0.0006) [2023-12-26 04:38:34,853][123090] Updated weights for policy 1, policy_version 628863 (0.0010) [2023-12-26 04:38:34,999][123091] Updated weights for policy 0, policy_version 633234 (0.0011) [2023-12-26 04:38:35,061][123091] Updated weights for policy 0, policy_version 633244 (0.0010) [2023-12-26 04:38:35,115][123091] Updated weights for policy 0, policy_version 633254 (0.0010) [2023-12-26 04:38:35,175][123091] Updated weights for policy 0, policy_version 633264 (0.0010) [2023-12-26 04:38:35,638][123090] Updated weights for policy 1, policy_version 628873 (0.0006) [2023-12-26 04:38:35,712][123090] Updated weights for policy 1, policy_version 628883 (0.0005) [2023-12-26 04:38:35,776][123090] Updated weights for policy 1, policy_version 628893 (0.0005) [2023-12-26 04:38:35,923][123091] Updated weights for policy 0, policy_version 633274 (0.0010) [2023-12-26 04:38:35,970][123091] Updated weights for policy 0, policy_version 633284 (0.0009) [2023-12-26 04:38:36,023][123091] Updated weights for policy 0, policy_version 633294 (0.0009) [2023-12-26 04:38:36,494][123090] Updated weights for policy 1, policy_version 628903 (0.0008) [2023-12-26 04:38:36,561][123090] Updated weights for policy 1, policy_version 628913 (0.0009) [2023-12-26 04:38:36,618][123090] Updated weights for policy 1, policy_version 628923 (0.0009) [2023-12-26 04:38:36,775][123091] Updated weights for policy 0, policy_version 633304 (0.0009) [2023-12-26 04:38:36,845][123091] Updated weights for policy 0, policy_version 633314 (0.0007) [2023-12-26 04:38:36,912][123091] Updated weights for policy 0, policy_version 633324 (0.0006) [2023-12-26 04:38:37,506][123090] Updated weights for policy 1, policy_version 628933 (0.0009) [2023-12-26 04:38:37,568][123090] Updated weights for policy 1, policy_version 628943 (0.0009) [2023-12-26 04:38:37,635][123090] Updated weights for policy 1, policy_version 628953 (0.0010) [2023-12-26 04:38:37,653][123091] Updated weights for policy 0, policy_version 633334 (0.0007) [2023-12-26 04:38:37,705][123091] Updated weights for policy 0, policy_version 633344 (0.0008) [2023-12-26 04:38:37,761][123091] Updated weights for policy 0, policy_version 633354 (0.0009) [2023-12-26 04:38:38,465][123091] Updated weights for policy 0, policy_version 633364 (0.0007) [2023-12-26 04:38:38,521][123090] Updated weights for policy 1, policy_version 628963 (0.0007) [2023-12-26 04:38:38,527][123091] Updated weights for policy 0, policy_version 633374 (0.0008) [2023-12-26 04:38:38,583][123091] Updated weights for policy 0, policy_version 633384 (0.0008) [2023-12-26 04:38:38,584][123090] Updated weights for policy 1, policy_version 628973 (0.0008) [2023-12-26 04:38:38,642][123090] Updated weights for policy 1, policy_version 628983 (0.0009) [2023-12-26 04:38:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 323174400. Throughput: 0: 8813.0, 1: 8914.8. Samples: 323144344. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:38,785][121949] Avg episode reward: [(0, '6194.816'), (1, '4751.700')] [2023-12-26 04:38:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000633392_162152448.pth... [2023-12-26 04:38:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000628992_161021952.pth... [2023-12-26 04:38:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000632336_161882112.pth [2023-12-26 04:38:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000627968_160759808.pth [2023-12-26 04:38:39,413][123091] Updated weights for policy 0, policy_version 633394 (0.0008) [2023-12-26 04:38:39,473][123091] Updated weights for policy 0, policy_version 633404 (0.0010) [2023-12-26 04:38:39,482][123090] Updated weights for policy 1, policy_version 628993 (0.0009) [2023-12-26 04:38:39,529][123091] Updated weights for policy 0, policy_version 633414 (0.0006) [2023-12-26 04:38:39,545][123090] Updated weights for policy 1, policy_version 629003 (0.0008) [2023-12-26 04:38:39,591][123091] Updated weights for policy 0, policy_version 633424 (0.0005) [2023-12-26 04:38:39,614][123090] Updated weights for policy 1, policy_version 629013 (0.0008) [2023-12-26 04:38:39,675][123090] Updated weights for policy 1, policy_version 629023 (0.0009) [2023-12-26 04:38:40,324][123091] Updated weights for policy 0, policy_version 633434 (0.0007) [2023-12-26 04:38:40,384][123091] Updated weights for policy 0, policy_version 633444 (0.0010) [2023-12-26 04:38:40,442][123091] Updated weights for policy 0, policy_version 633454 (0.0007) [2023-12-26 04:38:40,540][123090] Updated weights for policy 1, policy_version 629033 (0.0009) [2023-12-26 04:38:40,605][123090] Updated weights for policy 1, policy_version 629043 (0.0009) [2023-12-26 04:38:40,661][123090] Updated weights for policy 1, policy_version 629053 (0.0009) [2023-12-26 04:38:41,218][123091] Updated weights for policy 0, policy_version 633464 (0.0009) [2023-12-26 04:38:41,274][123091] Updated weights for policy 0, policy_version 633474 (0.0008) [2023-12-26 04:38:41,358][123091] Updated weights for policy 0, policy_version 633484 (0.0009) [2023-12-26 04:38:41,512][123090] Updated weights for policy 1, policy_version 629063 (0.0010) [2023-12-26 04:38:41,576][123090] Updated weights for policy 1, policy_version 629073 (0.0008) [2023-12-26 04:38:41,645][123090] Updated weights for policy 1, policy_version 629083 (0.0009) [2023-12-26 04:38:42,196][123091] Updated weights for policy 0, policy_version 633494 (0.0007) [2023-12-26 04:38:42,271][123091] Updated weights for policy 0, policy_version 633504 (0.0008) [2023-12-26 04:38:42,347][123091] Updated weights for policy 0, policy_version 633514 (0.0006) [2023-12-26 04:38:42,579][123090] Updated weights for policy 1, policy_version 629093 (0.0010) [2023-12-26 04:38:42,628][123090] Updated weights for policy 1, policy_version 629103 (0.0009) [2023-12-26 04:38:42,690][123090] Updated weights for policy 1, policy_version 629113 (0.0009) [2023-12-26 04:38:43,119][123091] Updated weights for policy 0, policy_version 633524 (0.0008) [2023-12-26 04:38:43,178][123091] Updated weights for policy 0, policy_version 633534 (0.0009) [2023-12-26 04:38:43,226][123091] Updated weights for policy 0, policy_version 633544 (0.0009) [2023-12-26 04:38:43,543][123090] Updated weights for policy 1, policy_version 629123 (0.0008) [2023-12-26 04:38:43,613][123090] Updated weights for policy 1, policy_version 629133 (0.0009) [2023-12-26 04:38:43,672][123090] Updated weights for policy 1, policy_version 629143 (0.0009) [2023-12-26 04:38:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 323256320. Throughput: 0: 8821.0, 1: 8734.9. Samples: 323247492. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:43,785][121949] Avg episode reward: [(0, '6208.783'), (1, '4867.648')] [2023-12-26 04:38:44,089][123091] Updated weights for policy 0, policy_version 633554 (0.0010) [2023-12-26 04:38:44,142][123091] Updated weights for policy 0, policy_version 633564 (0.0010) [2023-12-26 04:38:44,193][123091] Updated weights for policy 0, policy_version 633574 (0.0009) [2023-12-26 04:38:44,253][123091] Updated weights for policy 0, policy_version 633584 (0.0010) [2023-12-26 04:38:44,506][123090] Updated weights for policy 1, policy_version 629153 (0.0009) [2023-12-26 04:38:44,561][123090] Updated weights for policy 1, policy_version 629163 (0.0010) [2023-12-26 04:38:44,627][123090] Updated weights for policy 1, policy_version 629173 (0.0010) [2023-12-26 04:38:44,685][123090] Updated weights for policy 1, policy_version 629183 (0.0010) [2023-12-26 04:38:45,071][123091] Updated weights for policy 0, policy_version 633594 (0.0011) [2023-12-26 04:38:45,118][123091] Updated weights for policy 0, policy_version 633604 (0.0010) [2023-12-26 04:38:45,167][123091] Updated weights for policy 0, policy_version 633614 (0.0005) [2023-12-26 04:38:45,430][123090] Updated weights for policy 1, policy_version 629193 (0.0008) [2023-12-26 04:38:45,488][123090] Updated weights for policy 1, policy_version 629203 (0.0011) [2023-12-26 04:38:45,546][123090] Updated weights for policy 1, policy_version 629213 (0.0011) [2023-12-26 04:38:45,895][123091] Updated weights for policy 0, policy_version 633624 (0.0006) [2023-12-26 04:38:45,964][123091] Updated weights for policy 0, policy_version 633634 (0.0011) [2023-12-26 04:38:46,027][123091] Updated weights for policy 0, policy_version 633644 (0.0011) [2023-12-26 04:38:46,391][123090] Updated weights for policy 1, policy_version 629223 (0.0009) [2023-12-26 04:38:46,448][123090] Updated weights for policy 1, policy_version 629233 (0.0009) [2023-12-26 04:38:46,498][123090] Updated weights for policy 1, policy_version 629243 (0.0009) [2023-12-26 04:38:46,838][123091] Updated weights for policy 0, policy_version 633654 (0.0011) [2023-12-26 04:38:46,897][123091] Updated weights for policy 0, policy_version 633664 (0.0011) [2023-12-26 04:38:46,957][123091] Updated weights for policy 0, policy_version 633674 (0.0010) [2023-12-26 04:38:47,340][123090] Updated weights for policy 1, policy_version 629253 (0.0008) [2023-12-26 04:38:47,390][123090] Updated weights for policy 1, policy_version 629263 (0.0008) [2023-12-26 04:38:47,442][123090] Updated weights for policy 1, policy_version 629273 (0.0009) [2023-12-26 04:38:47,789][123091] Updated weights for policy 0, policy_version 633684 (0.0008) [2023-12-26 04:38:47,866][123091] Updated weights for policy 0, policy_version 633694 (0.0005) [2023-12-26 04:38:47,927][123091] Updated weights for policy 0, policy_version 633704 (0.0008) [2023-12-26 04:38:48,259][123090] Updated weights for policy 1, policy_version 629283 (0.0009) [2023-12-26 04:38:48,328][123090] Updated weights for policy 1, policy_version 629293 (0.0009) [2023-12-26 04:38:48,396][123090] Updated weights for policy 1, policy_version 629303 (0.0009) [2023-12-26 04:38:48,718][123091] Updated weights for policy 0, policy_version 633714 (0.0010) [2023-12-26 04:38:48,783][123091] Updated weights for policy 0, policy_version 633724 (0.0006) [2023-12-26 04:38:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 323338240. Throughput: 0: 8857.6, 1: 8756.0. Samples: 323352088. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:48,784][121949] Avg episode reward: [(0, '6222.799'), (1, '4915.842')] [2023-12-26 04:38:48,847][123091] Updated weights for policy 0, policy_version 633734 (0.0007) [2023-12-26 04:38:48,900][123091] Updated weights for policy 0, policy_version 633744 (0.0011) [2023-12-26 04:38:49,292][123090] Updated weights for policy 1, policy_version 629313 (0.0009) [2023-12-26 04:38:49,360][123090] Updated weights for policy 1, policy_version 629323 (0.0010) [2023-12-26 04:38:49,437][123090] Updated weights for policy 1, policy_version 629333 (0.0009) [2023-12-26 04:38:49,504][123090] Updated weights for policy 1, policy_version 629343 (0.0010) [2023-12-26 04:38:49,664][123091] Updated weights for policy 0, policy_version 633754 (0.0006) [2023-12-26 04:38:49,735][123091] Updated weights for policy 0, policy_version 633764 (0.0009) [2023-12-26 04:38:49,803][123091] Updated weights for policy 0, policy_version 633774 (0.0010) [2023-12-26 04:38:50,367][123090] Updated weights for policy 1, policy_version 629353 (0.0010) [2023-12-26 04:38:50,431][123090] Updated weights for policy 1, policy_version 629363 (0.0009) [2023-12-26 04:38:50,496][123090] Updated weights for policy 1, policy_version 629373 (0.0009) [2023-12-26 04:38:50,576][123091] Updated weights for policy 0, policy_version 633784 (0.0009) [2023-12-26 04:38:50,654][123091] Updated weights for policy 0, policy_version 633794 (0.0006) [2023-12-26 04:38:50,726][123091] Updated weights for policy 0, policy_version 633804 (0.0006) [2023-12-26 04:38:51,338][123090] Updated weights for policy 1, policy_version 629383 (0.0009) [2023-12-26 04:38:51,418][123091] Updated weights for policy 0, policy_version 633814 (0.0007) [2023-12-26 04:38:51,420][123090] Updated weights for policy 1, policy_version 629393 (0.0008) [2023-12-26 04:38:51,480][123090] Updated weights for policy 1, policy_version 629403 (0.0008) [2023-12-26 04:38:51,482][123091] Updated weights for policy 0, policy_version 633824 (0.0010) [2023-12-26 04:38:51,542][123091] Updated weights for policy 0, policy_version 633834 (0.0011) [2023-12-26 04:38:52,316][123090] Updated weights for policy 1, policy_version 629413 (0.0009) [2023-12-26 04:38:52,380][123090] Updated weights for policy 1, policy_version 629423 (0.0009) [2023-12-26 04:38:52,392][123091] Updated weights for policy 0, policy_version 633844 (0.0010) [2023-12-26 04:38:52,446][123090] Updated weights for policy 1, policy_version 629433 (0.0007) [2023-12-26 04:38:52,456][123091] Updated weights for policy 0, policy_version 633854 (0.0011) [2023-12-26 04:38:52,508][123091] Updated weights for policy 0, policy_version 633864 (0.0011) [2023-12-26 04:38:53,266][123091] Updated weights for policy 0, policy_version 633874 (0.0008) [2023-12-26 04:38:53,327][123090] Updated weights for policy 1, policy_version 629443 (0.0006) [2023-12-26 04:38:53,331][123091] Updated weights for policy 0, policy_version 633884 (0.0011) [2023-12-26 04:38:53,391][123090] Updated weights for policy 1, policy_version 629453 (0.0005) [2023-12-26 04:38:53,394][123091] Updated weights for policy 0, policy_version 633894 (0.0011) [2023-12-26 04:38:53,447][123090] Updated weights for policy 1, policy_version 629463 (0.0009) [2023-12-26 04:38:53,482][123091] Updated weights for policy 0, policy_version 633904 (0.0011) [2023-12-26 04:38:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 323428352. Throughput: 0: 8900.0, 1: 8628.7. Samples: 323403716. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:53,785][121949] Avg episode reward: [(0, '6146.310'), (1, '4303.529')] [2023-12-26 04:38:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000629472_161144832.pth... [2023-12-26 04:38:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000633904_162283520.pth... [2023-12-26 04:38:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000628480_160890880.pth [2023-12-26 04:38:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000632848_162013184.pth [2023-12-26 04:38:54,101][123091] Updated weights for policy 0, policy_version 633914 (0.0005) [2023-12-26 04:38:54,148][123091] Updated weights for policy 0, policy_version 633924 (0.0006) [2023-12-26 04:38:54,204][123091] Updated weights for policy 0, policy_version 633934 (0.0005) [2023-12-26 04:38:54,265][123090] Updated weights for policy 1, policy_version 629473 (0.0010) [2023-12-26 04:38:54,323][123090] Updated weights for policy 1, policy_version 629483 (0.0010) [2023-12-26 04:38:54,379][123090] Updated weights for policy 1, policy_version 629493 (0.0010) [2023-12-26 04:38:54,442][123090] Updated weights for policy 1, policy_version 629503 (0.0010) [2023-12-26 04:38:54,787][123091] Updated weights for policy 0, policy_version 633944 (0.0005) [2023-12-26 04:38:54,846][123091] Updated weights for policy 0, policy_version 633954 (0.0010) [2023-12-26 04:38:54,894][123091] Updated weights for policy 0, policy_version 633964 (0.0010) [2023-12-26 04:38:55,341][123090] Updated weights for policy 1, policy_version 629513 (0.0006) [2023-12-26 04:38:55,397][123090] Updated weights for policy 1, policy_version 629523 (0.0007) [2023-12-26 04:38:55,446][123090] Updated weights for policy 1, policy_version 629533 (0.0008) [2023-12-26 04:38:55,689][123091] Updated weights for policy 0, policy_version 633974 (0.0010) [2023-12-26 04:38:55,747][123091] Updated weights for policy 0, policy_version 633984 (0.0011) [2023-12-26 04:38:55,794][123091] Updated weights for policy 0, policy_version 633994 (0.0010) [2023-12-26 04:38:56,219][123090] Updated weights for policy 1, policy_version 629543 (0.0009) [2023-12-26 04:38:56,284][123090] Updated weights for policy 1, policy_version 629553 (0.0009) [2023-12-26 04:38:56,337][123090] Updated weights for policy 1, policy_version 629563 (0.0006) [2023-12-26 04:38:56,621][123091] Updated weights for policy 0, policy_version 634004 (0.0010) [2023-12-26 04:38:56,664][123091] Updated weights for policy 0, policy_version 634014 (0.0010) [2023-12-26 04:38:56,711][123091] Updated weights for policy 0, policy_version 634024 (0.0010) [2023-12-26 04:38:57,040][123090] Updated weights for policy 1, policy_version 629573 (0.0005) [2023-12-26 04:38:57,109][123090] Updated weights for policy 1, policy_version 629583 (0.0010) [2023-12-26 04:38:57,179][123090] Updated weights for policy 1, policy_version 629593 (0.0010) [2023-12-26 04:38:57,437][123091] Updated weights for policy 0, policy_version 634034 (0.0009) [2023-12-26 04:38:57,494][123091] Updated weights for policy 0, policy_version 634044 (0.0005) [2023-12-26 04:38:57,542][123091] Updated weights for policy 0, policy_version 634054 (0.0005) [2023-12-26 04:38:57,587][123091] Updated weights for policy 0, policy_version 634064 (0.0005) [2023-12-26 04:38:57,948][123090] Updated weights for policy 1, policy_version 629603 (0.0010) [2023-12-26 04:38:58,026][123090] Updated weights for policy 1, policy_version 629613 (0.0011) [2023-12-26 04:38:58,094][123090] Updated weights for policy 1, policy_version 629623 (0.0011) [2023-12-26 04:38:58,243][123091] Updated weights for policy 0, policy_version 634074 (0.0009) [2023-12-26 04:38:58,306][123091] Updated weights for policy 0, policy_version 634084 (0.0009) [2023-12-26 04:38:58,386][123091] Updated weights for policy 0, policy_version 634094 (0.0008) [2023-12-26 04:38:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17744.7). Total num frames: 323518464. Throughput: 0: 9042.0, 1: 8602.2. Samples: 323513324. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:38:58,785][121949] Avg episode reward: [(0, '6167.626'), (1, '4578.531')] [2023-12-26 04:38:58,968][123090] Updated weights for policy 1, policy_version 629633 (0.0010) [2023-12-26 04:38:59,039][123090] Updated weights for policy 1, policy_version 629643 (0.0008) [2023-12-26 04:38:59,103][123090] Updated weights for policy 1, policy_version 629653 (0.0008) [2023-12-26 04:38:59,171][123090] Updated weights for policy 1, policy_version 629663 (0.0009) [2023-12-26 04:38:59,355][123091] Updated weights for policy 0, policy_version 634104 (0.0009) [2023-12-26 04:38:59,422][123091] Updated weights for policy 0, policy_version 634114 (0.0011) [2023-12-26 04:38:59,487][123091] Updated weights for policy 0, policy_version 634124 (0.0011) [2023-12-26 04:38:59,966][123090] Updated weights for policy 1, policy_version 629673 (0.0009) [2023-12-26 04:39:00,023][123090] Updated weights for policy 1, policy_version 629683 (0.0010) [2023-12-26 04:39:00,079][123090] Updated weights for policy 1, policy_version 629693 (0.0010) [2023-12-26 04:39:00,207][123091] Updated weights for policy 0, policy_version 634134 (0.0008) [2023-12-26 04:39:00,261][123091] Updated weights for policy 0, policy_version 634144 (0.0008) [2023-12-26 04:39:00,315][123091] Updated weights for policy 0, policy_version 634154 (0.0010) [2023-12-26 04:39:00,815][123090] Updated weights for policy 1, policy_version 629704 (0.0006) [2023-12-26 04:39:00,869][123090] Updated weights for policy 1, policy_version 629714 (0.0007) [2023-12-26 04:39:00,926][123090] Updated weights for policy 1, policy_version 629724 (0.0005) [2023-12-26 04:39:01,091][123091] Updated weights for policy 0, policy_version 634164 (0.0010) [2023-12-26 04:39:01,159][123091] Updated weights for policy 0, policy_version 634174 (0.0008) [2023-12-26 04:39:01,218][123091] Updated weights for policy 0, policy_version 634184 (0.0008) [2023-12-26 04:39:01,684][123090] Updated weights for policy 1, policy_version 629734 (0.0009) [2023-12-26 04:39:01,762][123090] Updated weights for policy 1, policy_version 629744 (0.0011) [2023-12-26 04:39:01,833][123090] Updated weights for policy 1, policy_version 629754 (0.0011) [2023-12-26 04:39:02,062][123091] Updated weights for policy 0, policy_version 634194 (0.0009) [2023-12-26 04:39:02,133][123091] Updated weights for policy 0, policy_version 634204 (0.0009) [2023-12-26 04:39:02,193][123091] Updated weights for policy 0, policy_version 634214 (0.0005) [2023-12-26 04:39:02,249][123091] Updated weights for policy 0, policy_version 634224 (0.0006) [2023-12-26 04:39:02,681][123090] Updated weights for policy 1, policy_version 629764 (0.0010) [2023-12-26 04:39:02,737][123090] Updated weights for policy 1, policy_version 629774 (0.0008) [2023-12-26 04:39:02,793][123090] Updated weights for policy 1, policy_version 629784 (0.0008) [2023-12-26 04:39:03,029][123091] Updated weights for policy 0, policy_version 634234 (0.0009) [2023-12-26 04:39:03,086][123091] Updated weights for policy 0, policy_version 634244 (0.0007) [2023-12-26 04:39:03,145][123091] Updated weights for policy 0, policy_version 634254 (0.0009) [2023-12-26 04:39:03,432][123090] Updated weights for policy 1, policy_version 629794 (0.0009) [2023-12-26 04:39:03,502][123090] Updated weights for policy 1, policy_version 629804 (0.0008) [2023-12-26 04:39:03,570][123090] Updated weights for policy 1, policy_version 629814 (0.0008) [2023-12-26 04:39:03,629][123090] Updated weights for policy 1, policy_version 629824 (0.0008) [2023-12-26 04:39:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 323608576. Throughput: 0: 9071.3, 1: 8613.8. Samples: 323619476. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:03,785][121949] Avg episode reward: [(0, '6253.602'), (1, '4974.134')] [2023-12-26 04:39:03,933][123091] Updated weights for policy 0, policy_version 634264 (0.0010) [2023-12-26 04:39:03,985][123091] Updated weights for policy 0, policy_version 634274 (0.0011) [2023-12-26 04:39:04,037][123091] Updated weights for policy 0, policy_version 634284 (0.0010) [2023-12-26 04:39:04,361][123090] Updated weights for policy 1, policy_version 629834 (0.0010) [2023-12-26 04:39:04,408][123090] Updated weights for policy 1, policy_version 629844 (0.0010) [2023-12-26 04:39:04,468][123090] Updated weights for policy 1, policy_version 629854 (0.0010) [2023-12-26 04:39:04,772][123091] Updated weights for policy 0, policy_version 634294 (0.0009) [2023-12-26 04:39:04,833][123091] Updated weights for policy 0, policy_version 634304 (0.0007) [2023-12-26 04:39:04,887][123091] Updated weights for policy 0, policy_version 634314 (0.0005) [2023-12-26 04:39:05,315][123090] Updated weights for policy 1, policy_version 629864 (0.0006) [2023-12-26 04:39:05,374][123090] Updated weights for policy 1, policy_version 629874 (0.0005) [2023-12-26 04:39:05,431][123090] Updated weights for policy 1, policy_version 629884 (0.0005) [2023-12-26 04:39:05,631][123091] Updated weights for policy 0, policy_version 634324 (0.0008) [2023-12-26 04:39:05,700][123091] Updated weights for policy 0, policy_version 634334 (0.0011) [2023-12-26 04:39:05,766][123091] Updated weights for policy 0, policy_version 634344 (0.0010) [2023-12-26 04:39:06,169][123090] Updated weights for policy 1, policy_version 629894 (0.0008) [2023-12-26 04:39:06,218][123090] Updated weights for policy 1, policy_version 629904 (0.0009) [2023-12-26 04:39:06,279][123090] Updated weights for policy 1, policy_version 629914 (0.0009) [2023-12-26 04:39:06,585][123091] Updated weights for policy 0, policy_version 634354 (0.0009) [2023-12-26 04:39:06,634][123091] Updated weights for policy 0, policy_version 634364 (0.0011) [2023-12-26 04:39:06,697][123091] Updated weights for policy 0, policy_version 634374 (0.0011) [2023-12-26 04:39:06,755][123091] Updated weights for policy 0, policy_version 634384 (0.0011) [2023-12-26 04:39:07,071][123090] Updated weights for policy 1, policy_version 629924 (0.0009) [2023-12-26 04:39:07,126][123090] Updated weights for policy 1, policy_version 629934 (0.0009) [2023-12-26 04:39:07,182][123090] Updated weights for policy 1, policy_version 629944 (0.0009) [2023-12-26 04:39:07,586][123091] Updated weights for policy 0, policy_version 634394 (0.0009) [2023-12-26 04:39:07,654][123091] Updated weights for policy 0, policy_version 634404 (0.0006) [2023-12-26 04:39:07,728][123091] Updated weights for policy 0, policy_version 634414 (0.0005) [2023-12-26 04:39:08,083][123090] Updated weights for policy 1, policy_version 629954 (0.0009) [2023-12-26 04:39:08,137][123090] Updated weights for policy 1, policy_version 629964 (0.0010) [2023-12-26 04:39:08,199][123090] Updated weights for policy 1, policy_version 629975 (0.0010) [2023-12-26 04:39:08,342][123091] Updated weights for policy 0, policy_version 634424 (0.0008) [2023-12-26 04:39:08,406][123091] Updated weights for policy 0, policy_version 634434 (0.0010) [2023-12-26 04:39:08,464][123091] Updated weights for policy 0, policy_version 634444 (0.0009) [2023-12-26 04:39:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 323698688. Throughput: 0: 9084.0, 1: 8619.5. Samples: 323673744. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:08,785][121949] Avg episode reward: [(0, '6248.607'), (1, '4811.913')] [2023-12-26 04:39:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000634448_162422784.pth... [2023-12-26 04:39:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000629984_161275904.pth... [2023-12-26 04:39:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000628992_161021952.pth [2023-12-26 04:39:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000633392_162152448.pth [2023-12-26 04:39:09,095][123090] Updated weights for policy 1, policy_version 629985 (0.0010) [2023-12-26 04:39:09,158][123090] Updated weights for policy 1, policy_version 629996 (0.0010) [2023-12-26 04:39:09,210][123090] Updated weights for policy 1, policy_version 630006 (0.0009) [2023-12-26 04:39:09,241][123091] Updated weights for policy 0, policy_version 634455 (0.0008) [2023-12-26 04:39:09,279][123090] Updated weights for policy 1, policy_version 630016 (0.0008) [2023-12-26 04:39:09,302][123091] Updated weights for policy 0, policy_version 634465 (0.0008) [2023-12-26 04:39:09,364][123091] Updated weights for policy 0, policy_version 634475 (0.0008) [2023-12-26 04:39:10,158][123090] Updated weights for policy 1, policy_version 630026 (0.0009) [2023-12-26 04:39:10,207][123091] Updated weights for policy 0, policy_version 634485 (0.0009) [2023-12-26 04:39:10,226][123090] Updated weights for policy 1, policy_version 630036 (0.0009) [2023-12-26 04:39:10,268][123091] Updated weights for policy 0, policy_version 634495 (0.0006) [2023-12-26 04:39:10,287][123090] Updated weights for policy 1, policy_version 630046 (0.0009) [2023-12-26 04:39:10,330][123091] Updated weights for policy 0, policy_version 634505 (0.0009) [2023-12-26 04:39:11,103][123091] Updated weights for policy 0, policy_version 634515 (0.0009) [2023-12-26 04:39:11,167][123090] Updated weights for policy 1, policy_version 630056 (0.0008) [2023-12-26 04:39:11,167][123091] Updated weights for policy 0, policy_version 634525 (0.0008) [2023-12-26 04:39:11,219][123091] Updated weights for policy 0, policy_version 634535 (0.0008) [2023-12-26 04:39:11,236][123090] Updated weights for policy 1, policy_version 630066 (0.0007) [2023-12-26 04:39:11,301][123090] Updated weights for policy 1, policy_version 630076 (0.0007) [2023-12-26 04:39:12,081][123090] Updated weights for policy 1, policy_version 630086 (0.0006) [2023-12-26 04:39:12,093][123091] Updated weights for policy 0, policy_version 634545 (0.0008) [2023-12-26 04:39:12,147][123090] Updated weights for policy 1, policy_version 630096 (0.0010) [2023-12-26 04:39:12,154][123091] Updated weights for policy 0, policy_version 634555 (0.0007) [2023-12-26 04:39:12,215][123090] Updated weights for policy 1, policy_version 630106 (0.0010) [2023-12-26 04:39:12,219][123091] Updated weights for policy 0, policy_version 634565 (0.0008) [2023-12-26 04:39:12,287][123091] Updated weights for policy 0, policy_version 634575 (0.0008) [2023-12-26 04:39:13,054][123090] Updated weights for policy 1, policy_version 630116 (0.0008) [2023-12-26 04:39:13,111][123091] Updated weights for policy 0, policy_version 634585 (0.0006) [2023-12-26 04:39:13,125][123090] Updated weights for policy 1, policy_version 630126 (0.0005) [2023-12-26 04:39:13,159][123091] Updated weights for policy 0, policy_version 634595 (0.0005) [2023-12-26 04:39:13,177][123090] Updated weights for policy 1, policy_version 630136 (0.0005) [2023-12-26 04:39:13,205][123091] Updated weights for policy 0, policy_version 634605 (0.0005) [2023-12-26 04:39:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 323780608. Throughput: 0: 9079.8, 1: 8607.1. Samples: 323776492. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:13,785][121949] Avg episode reward: [(0, '6193.759'), (1, '4749.977')] [2023-12-26 04:39:13,826][123090] Updated weights for policy 1, policy_version 630146 (0.0005) [2023-12-26 04:39:13,882][123090] Updated weights for policy 1, policy_version 630156 (0.0005) [2023-12-26 04:39:13,944][123090] Updated weights for policy 1, policy_version 630166 (0.0005) [2023-12-26 04:39:13,959][123091] Updated weights for policy 0, policy_version 634615 (0.0008) [2023-12-26 04:39:14,003][123090] Updated weights for policy 1, policy_version 630176 (0.0008) [2023-12-26 04:39:14,010][123091] Updated weights for policy 0, policy_version 634625 (0.0007) [2023-12-26 04:39:14,058][123091] Updated weights for policy 0, policy_version 634635 (0.0009) [2023-12-26 04:39:14,733][123090] Updated weights for policy 1, policy_version 630186 (0.0007) [2023-12-26 04:39:14,806][123090] Updated weights for policy 1, policy_version 630196 (0.0010) [2023-12-26 04:39:14,823][123091] Updated weights for policy 0, policy_version 634645 (0.0009) [2023-12-26 04:39:14,863][123090] Updated weights for policy 1, policy_version 630206 (0.0011) [2023-12-26 04:39:14,887][123091] Updated weights for policy 0, policy_version 634655 (0.0008) [2023-12-26 04:39:14,960][123091] Updated weights for policy 0, policy_version 634665 (0.0008) [2023-12-26 04:39:15,628][123090] Updated weights for policy 1, policy_version 630216 (0.0010) [2023-12-26 04:39:15,687][123090] Updated weights for policy 1, policy_version 630226 (0.0010) [2023-12-26 04:39:15,737][123091] Updated weights for policy 0, policy_version 634675 (0.0009) [2023-12-26 04:39:15,753][123090] Updated weights for policy 1, policy_version 630236 (0.0010) [2023-12-26 04:39:15,788][123091] Updated weights for policy 0, policy_version 634685 (0.0010) [2023-12-26 04:39:15,858][123091] Updated weights for policy 0, policy_version 634695 (0.0011) [2023-12-26 04:39:16,553][123090] Updated weights for policy 1, policy_version 630246 (0.0008) [2023-12-26 04:39:16,615][123090] Updated weights for policy 1, policy_version 630256 (0.0005) [2023-12-26 04:39:16,681][123090] Updated weights for policy 1, policy_version 630266 (0.0005) [2023-12-26 04:39:16,694][123091] Updated weights for policy 0, policy_version 634705 (0.0011) [2023-12-26 04:39:16,762][123091] Updated weights for policy 0, policy_version 634715 (0.0011) [2023-12-26 04:39:16,817][123091] Updated weights for policy 0, policy_version 634725 (0.0010) [2023-12-26 04:39:16,883][123091] Updated weights for policy 0, policy_version 634735 (0.0010) [2023-12-26 04:39:17,270][123090] Updated weights for policy 1, policy_version 630276 (0.0006) [2023-12-26 04:39:17,343][123090] Updated weights for policy 1, policy_version 630286 (0.0005) [2023-12-26 04:39:17,410][123090] Updated weights for policy 1, policy_version 630296 (0.0006) [2023-12-26 04:39:17,597][123091] Updated weights for policy 0, policy_version 634745 (0.0010) [2023-12-26 04:39:17,644][123091] Updated weights for policy 0, policy_version 634755 (0.0010) [2023-12-26 04:39:17,698][123091] Updated weights for policy 0, policy_version 634765 (0.0010) [2023-12-26 04:39:18,072][123090] Updated weights for policy 1, policy_version 630306 (0.0006) [2023-12-26 04:39:18,124][123090] Updated weights for policy 1, policy_version 630317 (0.0007) [2023-12-26 04:39:18,170][123090] Updated weights for policy 1, policy_version 630327 (0.0006) [2023-12-26 04:39:18,455][123091] Updated weights for policy 0, policy_version 634775 (0.0009) [2023-12-26 04:39:18,529][123091] Updated weights for policy 0, policy_version 634785 (0.0010) [2023-12-26 04:39:18,602][123091] Updated weights for policy 0, policy_version 634795 (0.0009) [2023-12-26 04:39:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 323878912. Throughput: 0: 9043.8, 1: 8710.0. Samples: 323888560. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:18,784][121949] Avg episode reward: [(0, '6122.065'), (1, '4805.500')] [2023-12-26 04:39:19,013][123090] Updated weights for policy 1, policy_version 630337 (0.0006) [2023-12-26 04:39:19,079][123090] Updated weights for policy 1, policy_version 630347 (0.0009) [2023-12-26 04:39:19,149][123090] Updated weights for policy 1, policy_version 630357 (0.0009) [2023-12-26 04:39:19,214][123090] Updated weights for policy 1, policy_version 630367 (0.0010) [2023-12-26 04:39:19,467][123091] Updated weights for policy 0, policy_version 634805 (0.0009) [2023-12-26 04:39:19,538][123091] Updated weights for policy 0, policy_version 634815 (0.0010) [2023-12-26 04:39:19,605][123091] Updated weights for policy 0, policy_version 634825 (0.0009) [2023-12-26 04:39:20,043][123090] Updated weights for policy 1, policy_version 630377 (0.0008) [2023-12-26 04:39:20,115][123090] Updated weights for policy 1, policy_version 630387 (0.0006) [2023-12-26 04:39:20,168][123090] Updated weights for policy 1, policy_version 630397 (0.0011) [2023-12-26 04:39:20,446][123091] Updated weights for policy 0, policy_version 634835 (0.0010) [2023-12-26 04:39:20,515][123091] Updated weights for policy 0, policy_version 634845 (0.0010) [2023-12-26 04:39:20,585][123091] Updated weights for policy 0, policy_version 634855 (0.0009) [2023-12-26 04:39:20,989][123090] Updated weights for policy 1, policy_version 630407 (0.0011) [2023-12-26 04:39:21,062][123090] Updated weights for policy 1, policy_version 630417 (0.0011) [2023-12-26 04:39:21,132][123090] Updated weights for policy 1, policy_version 630427 (0.0011) [2023-12-26 04:39:21,490][123091] Updated weights for policy 0, policy_version 634865 (0.0009) [2023-12-26 04:39:21,560][123091] Updated weights for policy 0, policy_version 634875 (0.0008) [2023-12-26 04:39:21,632][123091] Updated weights for policy 0, policy_version 634885 (0.0008) [2023-12-26 04:39:21,693][123091] Updated weights for policy 0, policy_version 634895 (0.0008) [2023-12-26 04:39:21,989][123090] Updated weights for policy 1, policy_version 630437 (0.0008) [2023-12-26 04:39:22,062][123090] Updated weights for policy 1, policy_version 630447 (0.0006) [2023-12-26 04:39:22,143][123090] Updated weights for policy 1, policy_version 630457 (0.0007) [2023-12-26 04:39:22,357][123091] Updated weights for policy 0, policy_version 634905 (0.0008) [2023-12-26 04:39:22,429][123091] Updated weights for policy 0, policy_version 634915 (0.0009) [2023-12-26 04:39:22,501][123091] Updated weights for policy 0, policy_version 634925 (0.0009) [2023-12-26 04:39:22,912][123090] Updated weights for policy 1, policy_version 630467 (0.0009) [2023-12-26 04:39:22,976][123090] Updated weights for policy 1, policy_version 630477 (0.0011) [2023-12-26 04:39:23,044][123090] Updated weights for policy 1, policy_version 630487 (0.0011) [2023-12-26 04:39:23,335][123091] Updated weights for policy 0, policy_version 634935 (0.0011) [2023-12-26 04:39:23,399][123091] Updated weights for policy 0, policy_version 634945 (0.0011) [2023-12-26 04:39:23,461][123091] Updated weights for policy 0, policy_version 634955 (0.0011) [2023-12-26 04:39:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 323960832. Throughput: 0: 8982.0, 1: 8658.7. Samples: 323938176. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:23,785][121949] Avg episode reward: [(0, '6091.324'), (1, '5128.900')] [2023-12-26 04:39:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000634960_162553856.pth... [2023-12-26 04:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000630496_161406976.pth... [2023-12-26 04:39:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000633904_162283520.pth [2023-12-26 04:39:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000629472_161144832.pth [2023-12-26 04:39:23,831][123090] Updated weights for policy 1, policy_version 630497 (0.0010) [2023-12-26 04:39:23,896][123090] Updated weights for policy 1, policy_version 630507 (0.0010) [2023-12-26 04:39:23,947][123090] Updated weights for policy 1, policy_version 630517 (0.0010) [2023-12-26 04:39:24,006][123090] Updated weights for policy 1, policy_version 630527 (0.0010) [2023-12-26 04:39:24,202][123091] Updated weights for policy 0, policy_version 634965 (0.0011) [2023-12-26 04:39:24,260][123091] Updated weights for policy 0, policy_version 634975 (0.0011) [2023-12-26 04:39:24,308][123091] Updated weights for policy 0, policy_version 634985 (0.0010) [2023-12-26 04:39:24,673][123090] Updated weights for policy 1, policy_version 630537 (0.0006) [2023-12-26 04:39:24,725][123090] Updated weights for policy 1, policy_version 630547 (0.0006) [2023-12-26 04:39:24,774][123090] Updated weights for policy 1, policy_version 630557 (0.0005) [2023-12-26 04:39:25,073][123091] Updated weights for policy 0, policy_version 634995 (0.0008) [2023-12-26 04:39:25,128][123091] Updated weights for policy 0, policy_version 635005 (0.0010) [2023-12-26 04:39:25,178][123091] Updated weights for policy 0, policy_version 635015 (0.0010) [2023-12-26 04:39:25,534][123090] Updated weights for policy 1, policy_version 630567 (0.0009) [2023-12-26 04:39:25,598][123090] Updated weights for policy 1, policy_version 630577 (0.0010) [2023-12-26 04:39:25,650][123090] Updated weights for policy 1, policy_version 630587 (0.0010) [2023-12-26 04:39:25,995][123091] Updated weights for policy 0, policy_version 635025 (0.0010) [2023-12-26 04:39:26,048][123091] Updated weights for policy 0, policy_version 635035 (0.0005) [2023-12-26 04:39:26,095][123091] Updated weights for policy 0, policy_version 635045 (0.0005) [2023-12-26 04:39:26,142][123091] Updated weights for policy 0, policy_version 635055 (0.0006) [2023-12-26 04:39:26,499][123090] Updated weights for policy 1, policy_version 630597 (0.0010) [2023-12-26 04:39:26,562][123090] Updated weights for policy 1, policy_version 630607 (0.0010) [2023-12-26 04:39:26,626][123090] Updated weights for policy 1, policy_version 630617 (0.0010) [2023-12-26 04:39:26,848][123091] Updated weights for policy 0, policy_version 635065 (0.0006) [2023-12-26 04:39:26,904][123091] Updated weights for policy 0, policy_version 635075 (0.0007) [2023-12-26 04:39:26,959][123091] Updated weights for policy 0, policy_version 635085 (0.0009) [2023-12-26 04:39:27,437][123090] Updated weights for policy 1, policy_version 630627 (0.0010) [2023-12-26 04:39:27,499][123090] Updated weights for policy 1, policy_version 630637 (0.0010) [2023-12-26 04:39:27,553][123090] Updated weights for policy 1, policy_version 630647 (0.0010) [2023-12-26 04:39:27,709][123091] Updated weights for policy 0, policy_version 635095 (0.0006) [2023-12-26 04:39:27,753][123091] Updated weights for policy 0, policy_version 635105 (0.0006) [2023-12-26 04:39:27,809][123091] Updated weights for policy 0, policy_version 635115 (0.0006) [2023-12-26 04:39:28,380][123090] Updated weights for policy 1, policy_version 630657 (0.0010) [2023-12-26 04:39:28,436][123090] Updated weights for policy 1, policy_version 630667 (0.0008) [2023-12-26 04:39:28,495][123090] Updated weights for policy 1, policy_version 630677 (0.0009) [2023-12-26 04:39:28,545][123090] Updated weights for policy 1, policy_version 630687 (0.0009) [2023-12-26 04:39:28,588][123091] Updated weights for policy 0, policy_version 635125 (0.0007) [2023-12-26 04:39:28,653][123091] Updated weights for policy 0, policy_version 635135 (0.0009) [2023-12-26 04:39:28,715][123091] Updated weights for policy 0, policy_version 635145 (0.0009) [2023-12-26 04:39:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 324059136. Throughput: 0: 8996.0, 1: 8763.1. Samples: 324046648. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:28,785][121949] Avg episode reward: [(0, '6128.899'), (1, '5236.879')] [2023-12-26 04:39:29,328][123090] Updated weights for policy 1, policy_version 630697 (0.0007) [2023-12-26 04:39:29,391][123090] Updated weights for policy 1, policy_version 630707 (0.0007) [2023-12-26 04:39:29,448][123090] Updated weights for policy 1, policy_version 630717 (0.0005) [2023-12-26 04:39:29,488][123091] Updated weights for policy 0, policy_version 635155 (0.0008) [2023-12-26 04:39:29,552][123091] Updated weights for policy 0, policy_version 635165 (0.0008) [2023-12-26 04:39:29,602][123091] Updated weights for policy 0, policy_version 635175 (0.0010) [2023-12-26 04:39:30,248][123090] Updated weights for policy 1, policy_version 630727 (0.0008) [2023-12-26 04:39:30,316][123090] Updated weights for policy 1, policy_version 630737 (0.0009) [2023-12-26 04:39:30,379][123091] Updated weights for policy 0, policy_version 635185 (0.0010) [2023-12-26 04:39:30,387][123090] Updated weights for policy 1, policy_version 630747 (0.0009) [2023-12-26 04:39:30,440][123091] Updated weights for policy 0, policy_version 635195 (0.0006) [2023-12-26 04:39:30,498][123091] Updated weights for policy 0, policy_version 635205 (0.0005) [2023-12-26 04:39:30,545][123091] Updated weights for policy 0, policy_version 635215 (0.0005) [2023-12-26 04:39:31,299][123090] Updated weights for policy 1, policy_version 630757 (0.0008) [2023-12-26 04:39:31,305][123091] Updated weights for policy 0, policy_version 635225 (0.0009) [2023-12-26 04:39:31,362][123090] Updated weights for policy 1, policy_version 630767 (0.0009) [2023-12-26 04:39:31,371][123091] Updated weights for policy 0, policy_version 635235 (0.0007) [2023-12-26 04:39:31,437][123090] Updated weights for policy 1, policy_version 630777 (0.0008) [2023-12-26 04:39:31,438][123091] Updated weights for policy 0, policy_version 635245 (0.0011) [2023-12-26 04:39:32,201][123091] Updated weights for policy 0, policy_version 635255 (0.0010) [2023-12-26 04:39:32,222][123090] Updated weights for policy 1, policy_version 630787 (0.0007) [2023-12-26 04:39:32,256][123091] Updated weights for policy 0, policy_version 635265 (0.0010) [2023-12-26 04:39:32,281][123090] Updated weights for policy 1, policy_version 630797 (0.0005) [2023-12-26 04:39:32,318][123091] Updated weights for policy 0, policy_version 635275 (0.0011) [2023-12-26 04:39:32,344][123090] Updated weights for policy 1, policy_version 630807 (0.0006) [2023-12-26 04:39:33,042][123090] Updated weights for policy 1, policy_version 630817 (0.0005) [2023-12-26 04:39:33,105][123090] Updated weights for policy 1, policy_version 630827 (0.0005) [2023-12-26 04:39:33,142][123091] Updated weights for policy 0, policy_version 635285 (0.0010) [2023-12-26 04:39:33,173][123090] Updated weights for policy 1, policy_version 630837 (0.0005) [2023-12-26 04:39:33,201][123091] Updated weights for policy 0, policy_version 635295 (0.0010) [2023-12-26 04:39:33,244][123090] Updated weights for policy 1, policy_version 630847 (0.0006) [2023-12-26 04:39:33,264][123091] Updated weights for policy 0, policy_version 635305 (0.0010) [2023-12-26 04:39:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 324141056. Throughput: 0: 9023.5, 1: 8802.6. Samples: 324154264. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:33,785][121949] Avg episode reward: [(0, '6181.848'), (1, '5319.402')] [2023-12-26 04:39:34,018][123090] Updated weights for policy 1, policy_version 630857 (0.0006) [2023-12-26 04:39:34,019][123091] Updated weights for policy 0, policy_version 635315 (0.0010) [2023-12-26 04:39:34,088][123091] Updated weights for policy 0, policy_version 635325 (0.0008) [2023-12-26 04:39:34,090][123090] Updated weights for policy 1, policy_version 630867 (0.0007) [2023-12-26 04:39:34,160][123091] Updated weights for policy 0, policy_version 635335 (0.0009) [2023-12-26 04:39:34,165][123090] Updated weights for policy 1, policy_version 630877 (0.0007) [2023-12-26 04:39:34,837][123090] Updated weights for policy 1, policy_version 630887 (0.0008) [2023-12-26 04:39:34,908][123090] Updated weights for policy 1, policy_version 630897 (0.0009) [2023-12-26 04:39:34,972][123090] Updated weights for policy 1, policy_version 630907 (0.0009) [2023-12-26 04:39:35,016][123091] Updated weights for policy 0, policy_version 635345 (0.0010) [2023-12-26 04:39:35,067][123091] Updated weights for policy 0, policy_version 635355 (0.0010) [2023-12-26 04:39:35,118][123091] Updated weights for policy 0, policy_version 635365 (0.0010) [2023-12-26 04:39:35,160][123091] Updated weights for policy 0, policy_version 635375 (0.0010) [2023-12-26 04:39:35,739][123090] Updated weights for policy 1, policy_version 630917 (0.0007) [2023-12-26 04:39:35,790][123090] Updated weights for policy 1, policy_version 630927 (0.0008) [2023-12-26 04:39:35,836][123090] Updated weights for policy 1, policy_version 630937 (0.0005) [2023-12-26 04:39:35,987][123091] Updated weights for policy 0, policy_version 635385 (0.0009) [2023-12-26 04:39:36,045][123091] Updated weights for policy 0, policy_version 635395 (0.0010) [2023-12-26 04:39:36,102][123091] Updated weights for policy 0, policy_version 635405 (0.0009) [2023-12-26 04:39:36,643][123090] Updated weights for policy 1, policy_version 630947 (0.0006) [2023-12-26 04:39:36,710][123090] Updated weights for policy 1, policy_version 630957 (0.0010) [2023-12-26 04:39:36,775][123090] Updated weights for policy 1, policy_version 630967 (0.0009) [2023-12-26 04:39:36,940][123091] Updated weights for policy 0, policy_version 635416 (0.0006) [2023-12-26 04:39:36,988][123091] Updated weights for policy 0, policy_version 635426 (0.0005) [2023-12-26 04:39:37,049][123091] Updated weights for policy 0, policy_version 635436 (0.0009) [2023-12-26 04:39:37,503][123090] Updated weights for policy 1, policy_version 630977 (0.0009) [2023-12-26 04:39:37,558][123090] Updated weights for policy 1, policy_version 630987 (0.0005) [2023-12-26 04:39:37,615][123090] Updated weights for policy 1, policy_version 630997 (0.0009) [2023-12-26 04:39:37,672][123090] Updated weights for policy 1, policy_version 631007 (0.0010) [2023-12-26 04:39:37,821][123091] Updated weights for policy 0, policy_version 635446 (0.0007) [2023-12-26 04:39:37,878][123091] Updated weights for policy 0, policy_version 635456 (0.0010) [2023-12-26 04:39:37,933][123091] Updated weights for policy 0, policy_version 635466 (0.0010) [2023-12-26 04:39:38,459][123090] Updated weights for policy 1, policy_version 631017 (0.0009) [2023-12-26 04:39:38,525][123090] Updated weights for policy 1, policy_version 631027 (0.0009) [2023-12-26 04:39:38,588][123090] Updated weights for policy 1, policy_version 631037 (0.0009) [2023-12-26 04:39:38,707][123091] Updated weights for policy 0, policy_version 635476 (0.0010) [2023-12-26 04:39:38,762][123091] Updated weights for policy 0, policy_version 635486 (0.0011) [2023-12-26 04:39:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 324231168. Throughput: 0: 8985.8, 1: 8855.9. Samples: 324206588. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:38,785][121949] Avg episode reward: [(0, '6225.205'), (1, '5416.419')] [2023-12-26 04:39:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000631040_161546240.pth... [2023-12-26 04:39:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000629984_161275904.pth [2023-12-26 04:39:38,818][123091] Updated weights for policy 0, policy_version 635496 (0.0011) [2023-12-26 04:39:38,873][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000635504_162693120.pth... [2023-12-26 04:39:38,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000634448_162422784.pth [2023-12-26 04:39:39,456][123090] Updated weights for policy 1, policy_version 631047 (0.0007) [2023-12-26 04:39:39,514][123090] Updated weights for policy 1, policy_version 631057 (0.0005) [2023-12-26 04:39:39,571][123090] Updated weights for policy 1, policy_version 631067 (0.0005) [2023-12-26 04:39:39,615][123091] Updated weights for policy 0, policy_version 635506 (0.0010) [2023-12-26 04:39:39,678][123091] Updated weights for policy 0, policy_version 635516 (0.0010) [2023-12-26 04:39:39,734][123091] Updated weights for policy 0, policy_version 635526 (0.0011) [2023-12-26 04:39:39,797][123091] Updated weights for policy 0, policy_version 635536 (0.0011) [2023-12-26 04:39:40,382][123090] Updated weights for policy 1, policy_version 631077 (0.0008) [2023-12-26 04:39:40,437][123090] Updated weights for policy 1, policy_version 631087 (0.0010) [2023-12-26 04:39:40,490][123090] Updated weights for policy 1, policy_version 631097 (0.0006) [2023-12-26 04:39:40,552][123091] Updated weights for policy 0, policy_version 635546 (0.0005) [2023-12-26 04:39:40,602][123091] Updated weights for policy 0, policy_version 635556 (0.0005) [2023-12-26 04:39:40,647][123091] Updated weights for policy 0, policy_version 635566 (0.0007) [2023-12-26 04:39:41,281][123090] Updated weights for policy 1, policy_version 631107 (0.0006) [2023-12-26 04:39:41,352][123090] Updated weights for policy 1, policy_version 631117 (0.0011) [2023-12-26 04:39:41,359][123091] Updated weights for policy 0, policy_version 635576 (0.0008) [2023-12-26 04:39:41,427][123090] Updated weights for policy 1, policy_version 631127 (0.0008) [2023-12-26 04:39:41,429][123091] Updated weights for policy 0, policy_version 635586 (0.0008) [2023-12-26 04:39:41,495][123091] Updated weights for policy 0, policy_version 635596 (0.0008) [2023-12-26 04:39:42,260][123090] Updated weights for policy 1, policy_version 631137 (0.0006) [2023-12-26 04:39:42,321][123090] Updated weights for policy 1, policy_version 631147 (0.0011) [2023-12-26 04:39:42,350][123091] Updated weights for policy 0, policy_version 635606 (0.0009) [2023-12-26 04:39:42,390][123090] Updated weights for policy 1, policy_version 631157 (0.0011) [2023-12-26 04:39:42,417][123091] Updated weights for policy 0, policy_version 635616 (0.0006) [2023-12-26 04:39:42,449][123090] Updated weights for policy 1, policy_version 631167 (0.0011) [2023-12-26 04:39:42,475][123091] Updated weights for policy 0, policy_version 635626 (0.0008) [2023-12-26 04:39:43,178][123091] Updated weights for policy 0, policy_version 635636 (0.0007) [2023-12-26 04:39:43,197][123090] Updated weights for policy 1, policy_version 631177 (0.0006) [2023-12-26 04:39:43,239][123091] Updated weights for policy 0, policy_version 635646 (0.0005) [2023-12-26 04:39:43,247][123090] Updated weights for policy 1, policy_version 631187 (0.0005) [2023-12-26 04:39:43,299][123091] Updated weights for policy 0, policy_version 635656 (0.0005) [2023-12-26 04:39:43,307][123090] Updated weights for policy 1, policy_version 631197 (0.0005) [2023-12-26 04:39:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 324321280. Throughput: 0: 8917.1, 1: 8843.3. Samples: 324312540. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:43,785][121949] Avg episode reward: [(0, '6261.259'), (1, '5469.741')] [2023-12-26 04:39:44,016][123091] Updated weights for policy 0, policy_version 635666 (0.0005) [2023-12-26 04:39:44,089][123091] Updated weights for policy 0, policy_version 635676 (0.0006) [2023-12-26 04:39:44,126][123090] Updated weights for policy 1, policy_version 631207 (0.0008) [2023-12-26 04:39:44,154][123091] Updated weights for policy 0, policy_version 635686 (0.0010) [2023-12-26 04:39:44,183][123090] Updated weights for policy 1, policy_version 631217 (0.0008) [2023-12-26 04:39:44,216][123091] Updated weights for policy 0, policy_version 635696 (0.0009) [2023-12-26 04:39:44,233][123090] Updated weights for policy 1, policy_version 631227 (0.0007) [2023-12-26 04:39:44,958][123091] Updated weights for policy 0, policy_version 635706 (0.0008) [2023-12-26 04:39:45,025][123091] Updated weights for policy 0, policy_version 635716 (0.0008) [2023-12-26 04:39:45,087][123091] Updated weights for policy 0, policy_version 635726 (0.0008) [2023-12-26 04:39:45,115][123090] Updated weights for policy 1, policy_version 631237 (0.0010) [2023-12-26 04:39:45,175][123090] Updated weights for policy 1, policy_version 631247 (0.0010) [2023-12-26 04:39:45,256][123090] Updated weights for policy 1, policy_version 631257 (0.0009) [2023-12-26 04:39:45,741][123091] Updated weights for policy 0, policy_version 635736 (0.0008) [2023-12-26 04:39:45,799][123091] Updated weights for policy 0, policy_version 635747 (0.0010) [2023-12-26 04:39:45,852][123091] Updated weights for policy 0, policy_version 635757 (0.0009) [2023-12-26 04:39:46,134][123090] Updated weights for policy 1, policy_version 631267 (0.0010) [2023-12-26 04:39:46,202][123090] Updated weights for policy 1, policy_version 631277 (0.0009) [2023-12-26 04:39:46,258][123090] Updated weights for policy 1, policy_version 631287 (0.0009) [2023-12-26 04:39:46,582][123091] Updated weights for policy 0, policy_version 635767 (0.0007) [2023-12-26 04:39:46,644][123091] Updated weights for policy 0, policy_version 635777 (0.0008) [2023-12-26 04:39:46,702][123091] Updated weights for policy 0, policy_version 635787 (0.0010) [2023-12-26 04:39:47,118][123090] Updated weights for policy 1, policy_version 631297 (0.0010) [2023-12-26 04:39:47,174][123090] Updated weights for policy 1, policy_version 631307 (0.0009) [2023-12-26 04:39:47,226][123090] Updated weights for policy 1, policy_version 631317 (0.0008) [2023-12-26 04:39:47,294][123090] Updated weights for policy 1, policy_version 631327 (0.0009) [2023-12-26 04:39:47,528][123091] Updated weights for policy 0, policy_version 635797 (0.0010) [2023-12-26 04:39:47,576][123091] Updated weights for policy 0, policy_version 635807 (0.0008) [2023-12-26 04:39:47,627][123091] Updated weights for policy 0, policy_version 635817 (0.0005) [2023-12-26 04:39:48,134][123090] Updated weights for policy 1, policy_version 631337 (0.0009) [2023-12-26 04:39:48,203][123090] Updated weights for policy 1, policy_version 631347 (0.0009) [2023-12-26 04:39:48,277][123090] Updated weights for policy 1, policy_version 631357 (0.0009) [2023-12-26 04:39:48,451][123091] Updated weights for policy 0, policy_version 635827 (0.0007) [2023-12-26 04:39:48,507][123091] Updated weights for policy 0, policy_version 635837 (0.0009) [2023-12-26 04:39:48,575][123091] Updated weights for policy 0, policy_version 635847 (0.0009) [2023-12-26 04:39:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 324411392. Throughput: 0: 8994.8, 1: 8789.9. Samples: 324419788. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 04:39:48,785][121949] Avg episode reward: [(0, '6250.603'), (1, '5562.195')] [2023-12-26 04:39:49,109][123090] Updated weights for policy 1, policy_version 631367 (0.0010) [2023-12-26 04:39:49,172][123090] Updated weights for policy 1, policy_version 631377 (0.0010) [2023-12-26 04:39:49,244][123090] Updated weights for policy 1, policy_version 631387 (0.0009) [2023-12-26 04:39:49,375][123091] Updated weights for policy 0, policy_version 635857 (0.0006) [2023-12-26 04:39:49,448][123091] Updated weights for policy 0, policy_version 635867 (0.0010) [2023-12-26 04:39:49,515][123091] Updated weights for policy 0, policy_version 635877 (0.0010) [2023-12-26 04:39:49,563][123091] Updated weights for policy 0, policy_version 635887 (0.0009) [2023-12-26 04:39:50,113][123090] Updated weights for policy 1, policy_version 631397 (0.0009) [2023-12-26 04:39:50,180][123090] Updated weights for policy 1, policy_version 631407 (0.0010) [2023-12-26 04:39:50,244][123090] Updated weights for policy 1, policy_version 631417 (0.0006) [2023-12-26 04:39:50,363][123091] Updated weights for policy 0, policy_version 635897 (0.0009) [2023-12-26 04:39:50,420][123091] Updated weights for policy 0, policy_version 635907 (0.0010) [2023-12-26 04:39:50,483][123091] Updated weights for policy 0, policy_version 635917 (0.0009) [2023-12-26 04:39:51,010][123090] Updated weights for policy 1, policy_version 631427 (0.0006) [2023-12-26 04:39:51,099][123090] Updated weights for policy 1, policy_version 631437 (0.0009) [2023-12-26 04:39:51,169][123090] Updated weights for policy 1, policy_version 631447 (0.0011) [2023-12-26 04:39:51,327][123091] Updated weights for policy 0, policy_version 635927 (0.0008) [2023-12-26 04:39:51,403][123091] Updated weights for policy 0, policy_version 635937 (0.0008) [2023-12-26 04:39:51,459][123091] Updated weights for policy 0, policy_version 635947 (0.0008) [2023-12-26 04:39:52,079][123090] Updated weights for policy 1, policy_version 631457 (0.0009) [2023-12-26 04:39:52,140][123090] Updated weights for policy 1, policy_version 631467 (0.0009) [2023-12-26 04:39:52,204][123090] Updated weights for policy 1, policy_version 631477 (0.0010) [2023-12-26 04:39:52,212][123091] Updated weights for policy 0, policy_version 635957 (0.0007) [2023-12-26 04:39:52,268][123090] Updated weights for policy 1, policy_version 631487 (0.0007) [2023-12-26 04:39:52,271][123091] Updated weights for policy 0, policy_version 635967 (0.0010) [2023-12-26 04:39:52,326][123091] Updated weights for policy 0, policy_version 635977 (0.0009) [2023-12-26 04:39:53,042][123091] Updated weights for policy 0, policy_version 635987 (0.0008) [2023-12-26 04:39:53,057][123090] Updated weights for policy 1, policy_version 631497 (0.0010) [2023-12-26 04:39:53,099][123091] Updated weights for policy 0, policy_version 635997 (0.0005) [2023-12-26 04:39:53,109][123090] Updated weights for policy 1, policy_version 631507 (0.0010) [2023-12-26 04:39:53,152][123091] Updated weights for policy 0, policy_version 636007 (0.0006) [2023-12-26 04:39:53,169][123090] Updated weights for policy 1, policy_version 631517 (0.0010) [2023-12-26 04:39:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17717.2). Total num frames: 324493312. Throughput: 0: 8960.8, 1: 8742.0. Samples: 324470372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:39:53,785][121949] Avg episode reward: [(0, '6248.799'), (1, '5437.658')] [2023-12-26 04:39:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000636016_162824192.pth... [2023-12-26 04:39:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000631520_161669120.pth... [2023-12-26 04:39:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000630496_161406976.pth [2023-12-26 04:39:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000634960_162553856.pth [2023-12-26 04:39:53,901][123091] Updated weights for policy 0, policy_version 636017 (0.0005) [2023-12-26 04:39:53,959][123091] Updated weights for policy 0, policy_version 636027 (0.0009) [2023-12-26 04:39:54,003][123090] Updated weights for policy 1, policy_version 631527 (0.0010) [2023-12-26 04:39:54,010][123091] Updated weights for policy 0, policy_version 636037 (0.0006) [2023-12-26 04:39:54,062][123091] Updated weights for policy 0, policy_version 636047 (0.0007) [2023-12-26 04:39:54,074][123090] Updated weights for policy 1, policy_version 631537 (0.0011) [2023-12-26 04:39:54,144][123090] Updated weights for policy 1, policy_version 631547 (0.0010) [2023-12-26 04:39:54,796][123091] Updated weights for policy 0, policy_version 636057 (0.0007) [2023-12-26 04:39:54,858][123091] Updated weights for policy 0, policy_version 636067 (0.0008) [2023-12-26 04:39:54,859][123090] Updated weights for policy 1, policy_version 631557 (0.0010) [2023-12-26 04:39:54,908][123090] Updated weights for policy 1, policy_version 631567 (0.0010) [2023-12-26 04:39:54,928][123091] Updated weights for policy 0, policy_version 636077 (0.0008) [2023-12-26 04:39:54,979][123090] Updated weights for policy 1, policy_version 631577 (0.0011) [2023-12-26 04:39:55,560][123091] Updated weights for policy 0, policy_version 636087 (0.0007) [2023-12-26 04:39:55,609][123091] Updated weights for policy 0, policy_version 636097 (0.0009) [2023-12-26 04:39:55,654][123091] Updated weights for policy 0, policy_version 636107 (0.0006) [2023-12-26 04:39:55,822][123090] Updated weights for policy 1, policy_version 631587 (0.0010) [2023-12-26 04:39:55,884][123090] Updated weights for policy 1, policy_version 631597 (0.0009) [2023-12-26 04:39:55,933][123090] Updated weights for policy 1, policy_version 631607 (0.0009) [2023-12-26 04:39:56,459][123091] Updated weights for policy 0, policy_version 636117 (0.0008) [2023-12-26 04:39:56,507][123091] Updated weights for policy 0, policy_version 636127 (0.0009) [2023-12-26 04:39:56,565][123091] Updated weights for policy 0, policy_version 636137 (0.0009) [2023-12-26 04:39:56,793][123090] Updated weights for policy 1, policy_version 631617 (0.0010) [2023-12-26 04:39:56,853][123090] Updated weights for policy 1, policy_version 631627 (0.0008) [2023-12-26 04:39:56,916][123090] Updated weights for policy 1, policy_version 631637 (0.0009) [2023-12-26 04:39:56,978][123090] Updated weights for policy 1, policy_version 631647 (0.0009) [2023-12-26 04:39:57,412][123091] Updated weights for policy 0, policy_version 636147 (0.0009) [2023-12-26 04:39:57,472][123091] Updated weights for policy 0, policy_version 636157 (0.0009) [2023-12-26 04:39:57,535][123091] Updated weights for policy 0, policy_version 636167 (0.0008) [2023-12-26 04:39:57,771][123090] Updated weights for policy 1, policy_version 631657 (0.0008) [2023-12-26 04:39:57,829][123090] Updated weights for policy 1, policy_version 631667 (0.0008) [2023-12-26 04:39:57,894][123090] Updated weights for policy 1, policy_version 631677 (0.0006) [2023-12-26 04:39:58,425][123091] Updated weights for policy 0, policy_version 636177 (0.0010) [2023-12-26 04:39:58,489][123091] Updated weights for policy 0, policy_version 636187 (0.0008) [2023-12-26 04:39:58,554][123091] Updated weights for policy 0, policy_version 636197 (0.0009) [2023-12-26 04:39:58,618][123091] Updated weights for policy 0, policy_version 636207 (0.0008) [2023-12-26 04:39:58,663][123090] Updated weights for policy 1, policy_version 631687 (0.0009) [2023-12-26 04:39:58,736][123090] Updated weights for policy 1, policy_version 631697 (0.0010) [2023-12-26 04:39:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 324583424. Throughput: 0: 9033.6, 1: 8801.0. Samples: 324579048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:39:58,785][121949] Avg episode reward: [(0, '6272.610'), (1, '5479.960')] [2023-12-26 04:39:58,809][123090] Updated weights for policy 1, policy_version 631707 (0.0008) [2023-12-26 04:39:59,500][123091] Updated weights for policy 0, policy_version 636217 (0.0011) [2023-12-26 04:39:59,560][123091] Updated weights for policy 0, policy_version 636227 (0.0009) [2023-12-26 04:39:59,618][123091] Updated weights for policy 0, policy_version 636237 (0.0005) [2023-12-26 04:39:59,656][123090] Updated weights for policy 1, policy_version 631717 (0.0007) [2023-12-26 04:39:59,715][123090] Updated weights for policy 1, policy_version 631727 (0.0010) [2023-12-26 04:39:59,780][123090] Updated weights for policy 1, policy_version 631737 (0.0010) [2023-12-26 04:40:00,429][123090] Updated weights for policy 1, policy_version 631747 (0.0007) [2023-12-26 04:40:00,477][123091] Updated weights for policy 0, policy_version 636247 (0.0008) [2023-12-26 04:40:00,487][123090] Updated weights for policy 1, policy_version 631757 (0.0005) [2023-12-26 04:40:00,531][123091] Updated weights for policy 0, policy_version 636257 (0.0009) [2023-12-26 04:40:00,548][123090] Updated weights for policy 1, policy_version 631767 (0.0006) [2023-12-26 04:40:00,598][123091] Updated weights for policy 0, policy_version 636267 (0.0009) [2023-12-26 04:40:01,364][123090] Updated weights for policy 1, policy_version 631777 (0.0010) [2023-12-26 04:40:01,390][123091] Updated weights for policy 0, policy_version 636277 (0.0009) [2023-12-26 04:40:01,422][123090] Updated weights for policy 1, policy_version 631787 (0.0010) [2023-12-26 04:40:01,457][123091] Updated weights for policy 0, policy_version 636287 (0.0011) [2023-12-26 04:40:01,484][123090] Updated weights for policy 1, policy_version 631797 (0.0013) [2023-12-26 04:40:01,523][123091] Updated weights for policy 0, policy_version 636297 (0.0011) [2023-12-26 04:40:01,532][123090] Updated weights for policy 1, policy_version 631807 (0.0010) [2023-12-26 04:40:02,317][123091] Updated weights for policy 0, policy_version 636307 (0.0009) [2023-12-26 04:40:02,389][123091] Updated weights for policy 0, policy_version 636317 (0.0008) [2023-12-26 04:40:02,413][123090] Updated weights for policy 1, policy_version 631817 (0.0010) [2023-12-26 04:40:02,456][123091] Updated weights for policy 0, policy_version 636327 (0.0007) [2023-12-26 04:40:02,484][123090] Updated weights for policy 1, policy_version 631827 (0.0007) [2023-12-26 04:40:02,551][123090] Updated weights for policy 1, policy_version 631837 (0.0007) [2023-12-26 04:40:03,230][123091] Updated weights for policy 0, policy_version 636337 (0.0009) [2023-12-26 04:40:03,279][123091] Updated weights for policy 0, policy_version 636347 (0.0009) [2023-12-26 04:40:03,325][123090] Updated weights for policy 1, policy_version 631847 (0.0008) [2023-12-26 04:40:03,335][123091] Updated weights for policy 0, policy_version 636357 (0.0007) [2023-12-26 04:40:03,376][123090] Updated weights for policy 1, policy_version 631857 (0.0008) [2023-12-26 04:40:03,388][123091] Updated weights for policy 0, policy_version 636367 (0.0005) [2023-12-26 04:40:03,427][123090] Updated weights for policy 1, policy_version 631867 (0.0009) [2023-12-26 04:40:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 324673536. Throughput: 0: 8972.1, 1: 8688.2. Samples: 324683280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:03,785][121949] Avg episode reward: [(0, '6268.291'), (1, '5482.987')] [2023-12-26 04:40:04,111][123091] Updated weights for policy 0, policy_version 636377 (0.0008) [2023-12-26 04:40:04,170][123091] Updated weights for policy 0, policy_version 636387 (0.0009) [2023-12-26 04:40:04,224][123091] Updated weights for policy 0, policy_version 636397 (0.0009) [2023-12-26 04:40:04,307][123090] Updated weights for policy 1, policy_version 631877 (0.0010) [2023-12-26 04:40:04,363][123090] Updated weights for policy 1, policy_version 631887 (0.0010) [2023-12-26 04:40:04,419][123090] Updated weights for policy 1, policy_version 631897 (0.0010) [2023-12-26 04:40:05,096][123090] Updated weights for policy 1, policy_version 631907 (0.0009) [2023-12-26 04:40:05,129][123091] Updated weights for policy 0, policy_version 636407 (0.0007) [2023-12-26 04:40:05,148][123090] Updated weights for policy 1, policy_version 631917 (0.0010) [2023-12-26 04:40:05,178][123091] Updated weights for policy 0, policy_version 636417 (0.0008) [2023-12-26 04:40:05,196][123090] Updated weights for policy 1, policy_version 631927 (0.0010) [2023-12-26 04:40:05,229][123091] Updated weights for policy 0, policy_version 636427 (0.0007) [2023-12-26 04:40:06,019][123090] Updated weights for policy 1, policy_version 631937 (0.0010) [2023-12-26 04:40:06,032][123091] Updated weights for policy 0, policy_version 636437 (0.0008) [2023-12-26 04:40:06,074][123090] Updated weights for policy 1, policy_version 631947 (0.0010) [2023-12-26 04:40:06,077][123091] Updated weights for policy 0, policy_version 636447 (0.0007) [2023-12-26 04:40:06,132][123090] Updated weights for policy 1, policy_version 631957 (0.0010) [2023-12-26 04:40:06,152][123091] Updated weights for policy 0, policy_version 636457 (0.0009) [2023-12-26 04:40:06,196][123090] Updated weights for policy 1, policy_version 631968 (0.0009) [2023-12-26 04:40:06,983][123091] Updated weights for policy 0, policy_version 636467 (0.0008) [2023-12-26 04:40:07,026][123090] Updated weights for policy 1, policy_version 631978 (0.0008) [2023-12-26 04:40:07,037][123091] Updated weights for policy 0, policy_version 636477 (0.0009) [2023-12-26 04:40:07,083][123090] Updated weights for policy 1, policy_version 631988 (0.0006) [2023-12-26 04:40:07,090][123091] Updated weights for policy 0, policy_version 636487 (0.0009) [2023-12-26 04:40:07,141][123090] Updated weights for policy 1, policy_version 631998 (0.0005) [2023-12-26 04:40:07,853][123090] Updated weights for policy 1, policy_version 632008 (0.0010) [2023-12-26 04:40:07,911][123090] Updated weights for policy 1, policy_version 632018 (0.0010) [2023-12-26 04:40:07,956][123091] Updated weights for policy 0, policy_version 636497 (0.0009) [2023-12-26 04:40:07,967][123090] Updated weights for policy 1, policy_version 632028 (0.0010) [2023-12-26 04:40:08,010][123091] Updated weights for policy 0, policy_version 636507 (0.0007) [2023-12-26 04:40:08,063][123091] Updated weights for policy 0, policy_version 636517 (0.0009) [2023-12-26 04:40:08,116][123091] Updated weights for policy 0, policy_version 636527 (0.0009) [2023-12-26 04:40:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 324755456. Throughput: 0: 9004.4, 1: 8726.3. Samples: 324736056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:08,785][121949] Avg episode reward: [(0, '6281.150'), (1, '5637.287')] [2023-12-26 04:40:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000636528_162955264.pth... [2023-12-26 04:40:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000635504_162693120.pth [2023-12-26 04:40:08,820][123090] Updated weights for policy 1, policy_version 632038 (0.0010) [2023-12-26 04:40:08,872][123090] Updated weights for policy 1, policy_version 632048 (0.0010) [2023-12-26 04:40:08,924][123090] Updated weights for policy 1, policy_version 632058 (0.0010) [2023-12-26 04:40:08,960][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000632064_161808384.pth... [2023-12-26 04:40:08,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000631040_161546240.pth [2023-12-26 04:40:08,974][123091] Updated weights for policy 0, policy_version 636537 (0.0006) [2023-12-26 04:40:09,028][123091] Updated weights for policy 0, policy_version 636547 (0.0006) [2023-12-26 04:40:09,090][123091] Updated weights for policy 0, policy_version 636557 (0.0006) [2023-12-26 04:40:09,793][123091] Updated weights for policy 0, policy_version 636567 (0.0006) [2023-12-26 04:40:09,827][123090] Updated weights for policy 1, policy_version 632068 (0.0011) [2023-12-26 04:40:09,868][123091] Updated weights for policy 0, policy_version 636577 (0.0007) [2023-12-26 04:40:09,897][123090] Updated weights for policy 1, policy_version 632078 (0.0008) [2023-12-26 04:40:09,934][123091] Updated weights for policy 0, policy_version 636587 (0.0009) [2023-12-26 04:40:09,967][123090] Updated weights for policy 1, policy_version 632088 (0.0009) [2023-12-26 04:40:10,729][123091] Updated weights for policy 0, policy_version 636597 (0.0007) [2023-12-26 04:40:10,780][123090] Updated weights for policy 1, policy_version 632098 (0.0010) [2023-12-26 04:40:10,791][123091] Updated weights for policy 0, policy_version 636607 (0.0008) [2023-12-26 04:40:10,835][123090] Updated weights for policy 1, policy_version 632108 (0.0010) [2023-12-26 04:40:10,860][123091] Updated weights for policy 0, policy_version 636617 (0.0006) [2023-12-26 04:40:10,887][123090] Updated weights for policy 1, policy_version 632118 (0.0010) [2023-12-26 04:40:10,939][123090] Updated weights for policy 1, policy_version 632128 (0.0010) [2023-12-26 04:40:11,651][123091] Updated weights for policy 0, policy_version 636627 (0.0007) [2023-12-26 04:40:11,715][123091] Updated weights for policy 0, policy_version 636637 (0.0011) [2023-12-26 04:40:11,781][123091] Updated weights for policy 0, policy_version 636647 (0.0009) [2023-12-26 04:40:11,811][123090] Updated weights for policy 1, policy_version 632138 (0.0009) [2023-12-26 04:40:11,873][123090] Updated weights for policy 1, policy_version 632148 (0.0009) [2023-12-26 04:40:11,938][123090] Updated weights for policy 1, policy_version 632158 (0.0009) [2023-12-26 04:40:12,678][123091] Updated weights for policy 0, policy_version 636657 (0.0009) [2023-12-26 04:40:12,737][123091] Updated weights for policy 0, policy_version 636667 (0.0009) [2023-12-26 04:40:12,752][123090] Updated weights for policy 1, policy_version 632168 (0.0010) [2023-12-26 04:40:12,797][123091] Updated weights for policy 0, policy_version 636677 (0.0008) [2023-12-26 04:40:12,815][123090] Updated weights for policy 1, policy_version 632178 (0.0006) [2023-12-26 04:40:12,848][123091] Updated weights for policy 0, policy_version 636687 (0.0009) [2023-12-26 04:40:12,881][123090] Updated weights for policy 1, policy_version 632188 (0.0009) [2023-12-26 04:40:13,647][123090] Updated weights for policy 1, policy_version 632198 (0.0010) [2023-12-26 04:40:13,698][123090] Updated weights for policy 1, policy_version 632208 (0.0008) [2023-12-26 04:40:13,727][123091] Updated weights for policy 0, policy_version 636697 (0.0008) [2023-12-26 04:40:13,758][123090] Updated weights for policy 1, policy_version 632218 (0.0009) [2023-12-26 04:40:13,781][123091] Updated weights for policy 0, policy_version 636707 (0.0010) [2023-12-26 04:40:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 324837376. Throughput: 0: 8920.6, 1: 8692.2. Samples: 324839224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:13,785][121949] Avg episode reward: [(0, '6242.296'), (1, '5632.387')] [2023-12-26 04:40:13,841][123091] Updated weights for policy 0, policy_version 636717 (0.0010) [2023-12-26 04:40:14,492][123090] Updated weights for policy 1, policy_version 632228 (0.0008) [2023-12-26 04:40:14,545][123090] Updated weights for policy 1, policy_version 632238 (0.0009) [2023-12-26 04:40:14,602][123090] Updated weights for policy 1, policy_version 632249 (0.0009) [2023-12-26 04:40:14,640][123091] Updated weights for policy 0, policy_version 636727 (0.0008) [2023-12-26 04:40:14,701][123091] Updated weights for policy 0, policy_version 636738 (0.0009) [2023-12-26 04:40:14,756][123091] Updated weights for policy 0, policy_version 636748 (0.0010) [2023-12-26 04:40:15,425][123090] Updated weights for policy 1, policy_version 632259 (0.0010) [2023-12-26 04:40:15,488][123090] Updated weights for policy 1, policy_version 632269 (0.0009) [2023-12-26 04:40:15,556][123090] Updated weights for policy 1, policy_version 632280 (0.0010) [2023-12-26 04:40:15,641][123091] Updated weights for policy 0, policy_version 636758 (0.0009) [2023-12-26 04:40:15,704][123091] Updated weights for policy 0, policy_version 636768 (0.0008) [2023-12-26 04:40:15,775][123091] Updated weights for policy 0, policy_version 636778 (0.0006) [2023-12-26 04:40:16,405][123090] Updated weights for policy 1, policy_version 632290 (0.0009) [2023-12-26 04:40:16,410][123091] Updated weights for policy 0, policy_version 636788 (0.0006) [2023-12-26 04:40:16,462][123091] Updated weights for policy 0, policy_version 636798 (0.0005) [2023-12-26 04:40:16,462][123090] Updated weights for policy 1, policy_version 632300 (0.0009) [2023-12-26 04:40:16,516][123090] Updated weights for policy 1, policy_version 632310 (0.0008) [2023-12-26 04:40:16,521][123091] Updated weights for policy 0, policy_version 636808 (0.0006) [2023-12-26 04:40:16,568][123090] Updated weights for policy 1, policy_version 632320 (0.0010) [2023-12-26 04:40:17,233][123091] Updated weights for policy 0, policy_version 636818 (0.0006) [2023-12-26 04:40:17,293][123091] Updated weights for policy 0, policy_version 636828 (0.0005) [2023-12-26 04:40:17,360][123091] Updated weights for policy 0, policy_version 636838 (0.0005) [2023-12-26 04:40:17,426][123091] Updated weights for policy 0, policy_version 636848 (0.0006) [2023-12-26 04:40:17,428][123090] Updated weights for policy 1, policy_version 632330 (0.0006) [2023-12-26 04:40:17,483][123090] Updated weights for policy 1, policy_version 632340 (0.0005) [2023-12-26 04:40:17,536][123090] Updated weights for policy 1, policy_version 632350 (0.0005) [2023-12-26 04:40:18,146][123091] Updated weights for policy 0, policy_version 636858 (0.0010) [2023-12-26 04:40:18,218][123091] Updated weights for policy 0, policy_version 636868 (0.0010) [2023-12-26 04:40:18,261][123090] Updated weights for policy 1, policy_version 632360 (0.0007) [2023-12-26 04:40:18,271][123091] Updated weights for policy 0, policy_version 636878 (0.0008) [2023-12-26 04:40:18,319][123090] Updated weights for policy 1, policy_version 632370 (0.0008) [2023-12-26 04:40:18,385][123090] Updated weights for policy 1, policy_version 632380 (0.0010) [2023-12-26 04:40:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 324935680. Throughput: 0: 8926.5, 1: 8689.8. Samples: 324946996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:18,784][121949] Avg episode reward: [(0, '6216.193'), (1, '5598.135')] [2023-12-26 04:40:19,030][123091] Updated weights for policy 0, policy_version 636888 (0.0010) [2023-12-26 04:40:19,093][123091] Updated weights for policy 0, policy_version 636898 (0.0011) [2023-12-26 04:40:19,154][123091] Updated weights for policy 0, policy_version 636908 (0.0011) [2023-12-26 04:40:19,288][123090] Updated weights for policy 1, policy_version 632390 (0.0010) [2023-12-26 04:40:19,360][123090] Updated weights for policy 1, policy_version 632400 (0.0010) [2023-12-26 04:40:19,415][123090] Updated weights for policy 1, policy_version 632410 (0.0010) [2023-12-26 04:40:20,036][123091] Updated weights for policy 0, policy_version 636918 (0.0011) [2023-12-26 04:40:20,098][123091] Updated weights for policy 0, policy_version 636928 (0.0009) [2023-12-26 04:40:20,169][123091] Updated weights for policy 0, policy_version 636938 (0.0006) [2023-12-26 04:40:20,337][123090] Updated weights for policy 1, policy_version 632420 (0.0009) [2023-12-26 04:40:20,396][123090] Updated weights for policy 1, policy_version 632430 (0.0010) [2023-12-26 04:40:20,455][123090] Updated weights for policy 1, policy_version 632440 (0.0008) [2023-12-26 04:40:20,924][123091] Updated weights for policy 0, policy_version 636948 (0.0007) [2023-12-26 04:40:20,986][123091] Updated weights for policy 0, policy_version 636958 (0.0009) [2023-12-26 04:40:21,055][123091] Updated weights for policy 0, policy_version 636968 (0.0008) [2023-12-26 04:40:21,321][123090] Updated weights for policy 1, policy_version 632450 (0.0008) [2023-12-26 04:40:21,397][123090] Updated weights for policy 1, policy_version 632460 (0.0009) [2023-12-26 04:40:21,462][123090] Updated weights for policy 1, policy_version 632470 (0.0011) [2023-12-26 04:40:21,530][123090] Updated weights for policy 1, policy_version 632480 (0.0011) [2023-12-26 04:40:21,938][123091] Updated weights for policy 0, policy_version 636978 (0.0009) [2023-12-26 04:40:21,999][123091] Updated weights for policy 0, policy_version 636988 (0.0009) [2023-12-26 04:40:22,050][123091] Updated weights for policy 0, policy_version 636998 (0.0009) [2023-12-26 04:40:22,101][123091] Updated weights for policy 0, policy_version 637008 (0.0009) [2023-12-26 04:40:22,402][123090] Updated weights for policy 1, policy_version 632490 (0.0010) [2023-12-26 04:40:22,465][123090] Updated weights for policy 1, policy_version 632500 (0.0011) [2023-12-26 04:40:22,522][123090] Updated weights for policy 1, policy_version 632510 (0.0011) [2023-12-26 04:40:23,002][123091] Updated weights for policy 0, policy_version 637018 (0.0009) [2023-12-26 04:40:23,067][123091] Updated weights for policy 0, policy_version 637028 (0.0009) [2023-12-26 04:40:23,132][123091] Updated weights for policy 0, policy_version 637038 (0.0009) [2023-12-26 04:40:23,359][123090] Updated weights for policy 1, policy_version 632520 (0.0010) [2023-12-26 04:40:23,411][123090] Updated weights for policy 1, policy_version 632530 (0.0010) [2023-12-26 04:40:23,461][123090] Updated weights for policy 1, policy_version 632540 (0.0010) [2023-12-26 04:40:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 325017600. Throughput: 0: 8930.1, 1: 8620.3. Samples: 324996360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:23,785][121949] Avg episode reward: [(0, '6294.624'), (1, '5549.581')] [2023-12-26 04:40:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000637040_163086336.pth... [2023-12-26 04:40:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000632544_161931264.pth... [2023-12-26 04:40:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000636016_162824192.pth [2023-12-26 04:40:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000631520_161669120.pth [2023-12-26 04:40:23,906][123091] Updated weights for policy 0, policy_version 637048 (0.0006) [2023-12-26 04:40:23,975][123091] Updated weights for policy 0, policy_version 637058 (0.0006) [2023-12-26 04:40:24,026][123091] Updated weights for policy 0, policy_version 637068 (0.0005) [2023-12-26 04:40:24,307][123090] Updated weights for policy 1, policy_version 632550 (0.0010) [2023-12-26 04:40:24,370][123090] Updated weights for policy 1, policy_version 632560 (0.0010) [2023-12-26 04:40:24,436][123090] Updated weights for policy 1, policy_version 632570 (0.0010) [2023-12-26 04:40:24,590][123091] Updated weights for policy 0, policy_version 637078 (0.0005) [2023-12-26 04:40:24,646][123091] Updated weights for policy 0, policy_version 637088 (0.0005) [2023-12-26 04:40:24,708][123091] Updated weights for policy 0, policy_version 637098 (0.0005) [2023-12-26 04:40:25,255][123090] Updated weights for policy 1, policy_version 632580 (0.0010) [2023-12-26 04:40:25,307][123090] Updated weights for policy 1, policy_version 632590 (0.0010) [2023-12-26 04:40:25,359][123090] Updated weights for policy 1, policy_version 632600 (0.0010) [2023-12-26 04:40:25,386][123091] Updated weights for policy 0, policy_version 637108 (0.0005) [2023-12-26 04:40:25,450][123091] Updated weights for policy 0, policy_version 637118 (0.0005) [2023-12-26 04:40:25,513][123091] Updated weights for policy 0, policy_version 637128 (0.0005) [2023-12-26 04:40:26,191][123090] Updated weights for policy 1, policy_version 632610 (0.0010) [2023-12-26 04:40:26,242][123090] Updated weights for policy 1, policy_version 632620 (0.0010) [2023-12-26 04:40:26,292][123091] Updated weights for policy 0, policy_version 637138 (0.0010) [2023-12-26 04:40:26,293][123090] Updated weights for policy 1, policy_version 632630 (0.0010) [2023-12-26 04:40:26,355][123090] Updated weights for policy 1, policy_version 632640 (0.0010) [2023-12-26 04:40:26,355][123091] Updated weights for policy 0, policy_version 637148 (0.0010) [2023-12-26 04:40:26,406][123091] Updated weights for policy 0, policy_version 637158 (0.0010) [2023-12-26 04:40:26,468][123091] Updated weights for policy 0, policy_version 637168 (0.0010) [2023-12-26 04:40:27,118][123090] Updated weights for policy 1, policy_version 632650 (0.0005) [2023-12-26 04:40:27,173][123090] Updated weights for policy 1, policy_version 632660 (0.0005) [2023-12-26 04:40:27,217][123091] Updated weights for policy 0, policy_version 637178 (0.0006) [2023-12-26 04:40:27,226][123090] Updated weights for policy 1, policy_version 632670 (0.0005) [2023-12-26 04:40:27,262][123091] Updated weights for policy 0, policy_version 637188 (0.0005) [2023-12-26 04:40:27,319][123091] Updated weights for policy 0, policy_version 637198 (0.0006) [2023-12-26 04:40:28,036][123090] Updated weights for policy 1, policy_version 632680 (0.0008) [2023-12-26 04:40:28,050][123091] Updated weights for policy 0, policy_version 637208 (0.0009) [2023-12-26 04:40:28,099][123090] Updated weights for policy 1, policy_version 632690 (0.0006) [2023-12-26 04:40:28,105][123091] Updated weights for policy 0, policy_version 637218 (0.0011) [2023-12-26 04:40:28,159][123091] Updated weights for policy 0, policy_version 637228 (0.0010) [2023-12-26 04:40:28,161][123090] Updated weights for policy 1, policy_version 632700 (0.0006) [2023-12-26 04:40:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 325107712. Throughput: 0: 8977.6, 1: 8617.6. Samples: 325104324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:28,785][121949] Avg episode reward: [(0, '6221.618'), (1, '5421.043')] [2023-12-26 04:40:28,975][123090] Updated weights for policy 1, policy_version 632710 (0.0009) [2023-12-26 04:40:28,985][123091] Updated weights for policy 0, policy_version 637238 (0.0008) [2023-12-26 04:40:29,041][123090] Updated weights for policy 1, policy_version 632720 (0.0009) [2023-12-26 04:40:29,051][123091] Updated weights for policy 0, policy_version 637248 (0.0007) [2023-12-26 04:40:29,112][123090] Updated weights for policy 1, policy_version 632730 (0.0009) [2023-12-26 04:40:29,115][123091] Updated weights for policy 0, policy_version 637258 (0.0007) [2023-12-26 04:40:29,834][123091] Updated weights for policy 0, policy_version 637268 (0.0008) [2023-12-26 04:40:29,899][123091] Updated weights for policy 0, policy_version 637278 (0.0008) [2023-12-26 04:40:29,956][123090] Updated weights for policy 1, policy_version 632740 (0.0009) [2023-12-26 04:40:29,967][123091] Updated weights for policy 0, policy_version 637288 (0.0009) [2023-12-26 04:40:30,018][123090] Updated weights for policy 1, policy_version 632750 (0.0008) [2023-12-26 04:40:30,078][123090] Updated weights for policy 1, policy_version 632760 (0.0009) [2023-12-26 04:40:30,669][123091] Updated weights for policy 0, policy_version 637298 (0.0006) [2023-12-26 04:40:30,723][123091] Updated weights for policy 0, policy_version 637308 (0.0005) [2023-12-26 04:40:30,770][123091] Updated weights for policy 0, policy_version 637318 (0.0005) [2023-12-26 04:40:30,815][123091] Updated weights for policy 0, policy_version 637328 (0.0005) [2023-12-26 04:40:30,996][123090] Updated weights for policy 1, policy_version 632770 (0.0009) [2023-12-26 04:40:31,062][123090] Updated weights for policy 1, policy_version 632780 (0.0009) [2023-12-26 04:40:31,117][123090] Updated weights for policy 1, policy_version 632790 (0.0009) [2023-12-26 04:40:31,192][123090] Updated weights for policy 1, policy_version 632800 (0.0010) [2023-12-26 04:40:31,564][123091] Updated weights for policy 0, policy_version 637338 (0.0009) [2023-12-26 04:40:31,634][123091] Updated weights for policy 0, policy_version 637348 (0.0010) [2023-12-26 04:40:31,691][123091] Updated weights for policy 0, policy_version 637358 (0.0009) [2023-12-26 04:40:32,033][123090] Updated weights for policy 1, policy_version 632810 (0.0009) [2023-12-26 04:40:32,087][123090] Updated weights for policy 1, policy_version 632820 (0.0009) [2023-12-26 04:40:32,150][123090] Updated weights for policy 1, policy_version 632830 (0.0010) [2023-12-26 04:40:32,515][123091] Updated weights for policy 0, policy_version 637368 (0.0006) [2023-12-26 04:40:32,579][123091] Updated weights for policy 0, policy_version 637378 (0.0008) [2023-12-26 04:40:32,639][123091] Updated weights for policy 0, policy_version 637388 (0.0008) [2023-12-26 04:40:33,047][123090] Updated weights for policy 1, policy_version 632840 (0.0008) [2023-12-26 04:40:33,124][123090] Updated weights for policy 1, policy_version 632850 (0.0006) [2023-12-26 04:40:33,185][123090] Updated weights for policy 1, policy_version 632860 (0.0005) [2023-12-26 04:40:33,391][123091] Updated weights for policy 0, policy_version 637398 (0.0009) [2023-12-26 04:40:33,447][123091] Updated weights for policy 0, policy_version 637409 (0.0009) [2023-12-26 04:40:33,498][123091] Updated weights for policy 0, policy_version 637419 (0.0009) [2023-12-26 04:40:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 325197824. Throughput: 0: 8941.5, 1: 8597.9. Samples: 325209060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:33,785][121949] Avg episode reward: [(0, '6192.174'), (1, '5193.876')] [2023-12-26 04:40:33,958][123090] Updated weights for policy 1, policy_version 632870 (0.0008) [2023-12-26 04:40:34,011][123090] Updated weights for policy 1, policy_version 632880 (0.0009) [2023-12-26 04:40:34,060][123090] Updated weights for policy 1, policy_version 632890 (0.0009) [2023-12-26 04:40:34,386][123091] Updated weights for policy 0, policy_version 637429 (0.0010) [2023-12-26 04:40:34,450][123091] Updated weights for policy 0, policy_version 637439 (0.0009) [2023-12-26 04:40:34,511][123091] Updated weights for policy 0, policy_version 637449 (0.0009) [2023-12-26 04:40:34,924][123090] Updated weights for policy 1, policy_version 632901 (0.0010) [2023-12-26 04:40:34,990][123090] Updated weights for policy 1, policy_version 632911 (0.0010) [2023-12-26 04:40:35,057][123090] Updated weights for policy 1, policy_version 632921 (0.0010) [2023-12-26 04:40:35,352][123091] Updated weights for policy 0, policy_version 637459 (0.0009) [2023-12-26 04:40:35,407][123091] Updated weights for policy 0, policy_version 637470 (0.0010) [2023-12-26 04:40:35,455][123091] Updated weights for policy 0, policy_version 637480 (0.0008) [2023-12-26 04:40:35,782][123090] Updated weights for policy 1, policy_version 632931 (0.0009) [2023-12-26 04:40:35,831][123090] Updated weights for policy 1, policy_version 632941 (0.0005) [2023-12-26 04:40:35,878][123090] Updated weights for policy 1, policy_version 632951 (0.0005) [2023-12-26 04:40:36,433][123091] Updated weights for policy 0, policy_version 637490 (0.0009) [2023-12-26 04:40:36,492][123091] Updated weights for policy 0, policy_version 637500 (0.0010) [2023-12-26 04:40:36,547][123091] Updated weights for policy 0, policy_version 637510 (0.0010) [2023-12-26 04:40:36,603][123090] Updated weights for policy 1, policy_version 632961 (0.0008) [2023-12-26 04:40:36,667][123090] Updated weights for policy 1, policy_version 632971 (0.0010) [2023-12-26 04:40:36,722][123090] Updated weights for policy 1, policy_version 632981 (0.0010) [2023-12-26 04:40:36,779][123090] Updated weights for policy 1, policy_version 632991 (0.0010) [2023-12-26 04:40:37,461][123091] Updated weights for policy 0, policy_version 637521 (0.0010) [2023-12-26 04:40:37,489][123090] Updated weights for policy 1, policy_version 633001 (0.0007) [2023-12-26 04:40:37,530][123091] Updated weights for policy 0, policy_version 637531 (0.0008) [2023-12-26 04:40:37,547][123090] Updated weights for policy 1, policy_version 633011 (0.0007) [2023-12-26 04:40:37,596][123091] Updated weights for policy 0, policy_version 637541 (0.0006) [2023-12-26 04:40:37,610][123090] Updated weights for policy 1, policy_version 633021 (0.0009) [2023-12-26 04:40:37,660][123091] Updated weights for policy 0, policy_version 637551 (0.0006) [2023-12-26 04:40:38,305][123090] Updated weights for policy 1, policy_version 633031 (0.0007) [2023-12-26 04:40:38,376][123090] Updated weights for policy 1, policy_version 633041 (0.0008) [2023-12-26 04:40:38,449][123090] Updated weights for policy 1, policy_version 633051 (0.0008) [2023-12-26 04:40:38,468][123091] Updated weights for policy 0, policy_version 637561 (0.0007) [2023-12-26 04:40:38,538][123091] Updated weights for policy 0, policy_version 637571 (0.0007) [2023-12-26 04:40:38,614][123091] Updated weights for policy 0, policy_version 637581 (0.0007) [2023-12-26 04:40:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 325287936. Throughput: 0: 8908.4, 1: 8660.5. Samples: 325260972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:38,785][121949] Avg episode reward: [(0, '6185.176'), (1, '5458.277')] [2023-12-26 04:40:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000637584_163225600.pth... [2023-12-26 04:40:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000633056_162062336.pth... [2023-12-26 04:40:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000636528_162955264.pth [2023-12-26 04:40:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000632064_161808384.pth [2023-12-26 04:40:39,124][123090] Updated weights for policy 1, policy_version 633061 (0.0007) [2023-12-26 04:40:39,180][123090] Updated weights for policy 1, policy_version 633071 (0.0006) [2023-12-26 04:40:39,246][123091] Updated weights for policy 0, policy_version 637591 (0.0007) [2023-12-26 04:40:39,247][123090] Updated weights for policy 1, policy_version 633081 (0.0007) [2023-12-26 04:40:39,317][123091] Updated weights for policy 0, policy_version 637601 (0.0008) [2023-12-26 04:40:39,381][123091] Updated weights for policy 0, policy_version 637611 (0.0009) [2023-12-26 04:40:40,048][123090] Updated weights for policy 1, policy_version 633091 (0.0007) [2023-12-26 04:40:40,117][123090] Updated weights for policy 1, policy_version 633101 (0.0005) [2023-12-26 04:40:40,168][123090] Updated weights for policy 1, policy_version 633111 (0.0006) [2023-12-26 04:40:40,256][123091] Updated weights for policy 0, policy_version 637621 (0.0009) [2023-12-26 04:40:40,313][123091] Updated weights for policy 0, policy_version 637631 (0.0010) [2023-12-26 04:40:40,388][123091] Updated weights for policy 0, policy_version 637641 (0.0007) [2023-12-26 04:40:40,932][123090] Updated weights for policy 1, policy_version 633121 (0.0007) [2023-12-26 04:40:41,000][123090] Updated weights for policy 1, policy_version 633131 (0.0008) [2023-12-26 04:40:41,073][123090] Updated weights for policy 1, policy_version 633141 (0.0010) [2023-12-26 04:40:41,141][123090] Updated weights for policy 1, policy_version 633151 (0.0008) [2023-12-26 04:40:41,218][123091] Updated weights for policy 0, policy_version 637651 (0.0009) [2023-12-26 04:40:41,287][123091] Updated weights for policy 0, policy_version 637661 (0.0009) [2023-12-26 04:40:41,356][123091] Updated weights for policy 0, policy_version 637671 (0.0010) [2023-12-26 04:40:41,984][123090] Updated weights for policy 1, policy_version 633161 (0.0009) [2023-12-26 04:40:42,047][123090] Updated weights for policy 1, policy_version 633171 (0.0010) [2023-12-26 04:40:42,106][123090] Updated weights for policy 1, policy_version 633181 (0.0010) [2023-12-26 04:40:42,160][123091] Updated weights for policy 0, policy_version 637681 (0.0009) [2023-12-26 04:40:42,210][123091] Updated weights for policy 0, policy_version 637691 (0.0009) [2023-12-26 04:40:42,276][123091] Updated weights for policy 0, policy_version 637701 (0.0010) [2023-12-26 04:40:42,338][123091] Updated weights for policy 0, policy_version 637711 (0.0010) [2023-12-26 04:40:42,933][123090] Updated weights for policy 1, policy_version 633191 (0.0009) [2023-12-26 04:40:43,011][123090] Updated weights for policy 1, policy_version 633201 (0.0010) [2023-12-26 04:40:43,068][123090] Updated weights for policy 1, policy_version 633211 (0.0009) [2023-12-26 04:40:43,098][123091] Updated weights for policy 0, policy_version 637721 (0.0006) [2023-12-26 04:40:43,146][123091] Updated weights for policy 0, policy_version 637731 (0.0005) [2023-12-26 04:40:43,196][123091] Updated weights for policy 0, policy_version 637741 (0.0005) [2023-12-26 04:40:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 325369856. Throughput: 0: 8786.5, 1: 8711.3. Samples: 325366448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:43,785][121949] Avg episode reward: [(0, '6200.183'), (1, '5562.237')] [2023-12-26 04:40:43,858][123090] Updated weights for policy 1, policy_version 633221 (0.0005) [2023-12-26 04:40:43,917][123090] Updated weights for policy 1, policy_version 633231 (0.0005) [2023-12-26 04:40:43,945][123091] Updated weights for policy 0, policy_version 637751 (0.0009) [2023-12-26 04:40:43,965][123090] Updated weights for policy 1, policy_version 633241 (0.0005) [2023-12-26 04:40:43,993][123091] Updated weights for policy 0, policy_version 637761 (0.0008) [2023-12-26 04:40:44,050][123091] Updated weights for policy 0, policy_version 637771 (0.0010) [2023-12-26 04:40:44,659][123090] Updated weights for policy 1, policy_version 633251 (0.0005) [2023-12-26 04:40:44,721][123090] Updated weights for policy 1, policy_version 633261 (0.0007) [2023-12-26 04:40:44,779][123090] Updated weights for policy 1, policy_version 633271 (0.0010) [2023-12-26 04:40:44,959][123091] Updated weights for policy 0, policy_version 637781 (0.0009) [2023-12-26 04:40:45,036][123091] Updated weights for policy 0, policy_version 637791 (0.0009) [2023-12-26 04:40:45,103][123091] Updated weights for policy 0, policy_version 637801 (0.0006) [2023-12-26 04:40:45,575][123090] Updated weights for policy 1, policy_version 633281 (0.0010) [2023-12-26 04:40:45,622][123090] Updated weights for policy 1, policy_version 633291 (0.0010) [2023-12-26 04:40:45,708][123090] Updated weights for policy 1, policy_version 633301 (0.0011) [2023-12-26 04:40:45,767][123090] Updated weights for policy 1, policy_version 633311 (0.0011) [2023-12-26 04:40:45,862][123091] Updated weights for policy 0, policy_version 637811 (0.0006) [2023-12-26 04:40:45,921][123091] Updated weights for policy 0, policy_version 637821 (0.0005) [2023-12-26 04:40:45,980][123091] Updated weights for policy 0, policy_version 637831 (0.0005) [2023-12-26 04:40:46,571][123090] Updated weights for policy 1, policy_version 633321 (0.0010) [2023-12-26 04:40:46,623][123090] Updated weights for policy 1, policy_version 633331 (0.0010) [2023-12-26 04:40:46,625][123091] Updated weights for policy 0, policy_version 637841 (0.0005) [2023-12-26 04:40:46,671][123090] Updated weights for policy 1, policy_version 633341 (0.0010) [2023-12-26 04:40:46,686][123091] Updated weights for policy 0, policy_version 637851 (0.0005) [2023-12-26 04:40:46,739][123091] Updated weights for policy 0, policy_version 637861 (0.0005) [2023-12-26 04:40:46,783][123091] Updated weights for policy 0, policy_version 637871 (0.0005) [2023-12-26 04:40:47,456][123091] Updated weights for policy 0, policy_version 637881 (0.0005) [2023-12-26 04:40:47,509][123091] Updated weights for policy 0, policy_version 637891 (0.0005) [2023-12-26 04:40:47,522][123090] Updated weights for policy 1, policy_version 633351 (0.0010) [2023-12-26 04:40:47,576][123091] Updated weights for policy 0, policy_version 637901 (0.0006) [2023-12-26 04:40:47,582][123090] Updated weights for policy 1, policy_version 633361 (0.0011) [2023-12-26 04:40:47,637][123090] Updated weights for policy 1, policy_version 633371 (0.0010) [2023-12-26 04:40:48,198][123091] Updated weights for policy 0, policy_version 637911 (0.0009) [2023-12-26 04:40:48,245][123091] Updated weights for policy 0, policy_version 637921 (0.0010) [2023-12-26 04:40:48,300][123091] Updated weights for policy 0, policy_version 637931 (0.0010) [2023-12-26 04:40:48,476][123090] Updated weights for policy 1, policy_version 633381 (0.0010) [2023-12-26 04:40:48,531][123090] Updated weights for policy 1, policy_version 633391 (0.0010) [2023-12-26 04:40:48,595][123090] Updated weights for policy 1, policy_version 633401 (0.0010) [2023-12-26 04:40:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 325468160. Throughput: 0: 8928.0, 1: 8728.7. Samples: 325477828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:48,784][121949] Avg episode reward: [(0, '6237.308'), (1, '5565.955')] [2023-12-26 04:40:49,111][123091] Updated weights for policy 0, policy_version 637941 (0.0010) [2023-12-26 04:40:49,166][123091] Updated weights for policy 0, policy_version 637951 (0.0010) [2023-12-26 04:40:49,229][123091] Updated weights for policy 0, policy_version 637961 (0.0010) [2023-12-26 04:40:49,307][123090] Updated weights for policy 1, policy_version 633411 (0.0010) [2023-12-26 04:40:49,376][123090] Updated weights for policy 1, policy_version 633421 (0.0010) [2023-12-26 04:40:49,443][123090] Updated weights for policy 1, policy_version 633431 (0.0010) [2023-12-26 04:40:50,026][123091] Updated weights for policy 0, policy_version 637971 (0.0010) [2023-12-26 04:40:50,092][123091] Updated weights for policy 0, policy_version 637981 (0.0010) [2023-12-26 04:40:50,157][123091] Updated weights for policy 0, policy_version 637991 (0.0009) [2023-12-26 04:40:50,291][123090] Updated weights for policy 1, policy_version 633441 (0.0010) [2023-12-26 04:40:50,352][123090] Updated weights for policy 1, policy_version 633451 (0.0009) [2023-12-26 04:40:50,417][123090] Updated weights for policy 1, policy_version 633461 (0.0009) [2023-12-26 04:40:50,488][123090] Updated weights for policy 1, policy_version 633471 (0.0010) [2023-12-26 04:40:50,954][123091] Updated weights for policy 0, policy_version 638001 (0.0010) [2023-12-26 04:40:51,024][123091] Updated weights for policy 0, policy_version 638011 (0.0009) [2023-12-26 04:40:51,102][123091] Updated weights for policy 0, policy_version 638021 (0.0009) [2023-12-26 04:40:51,167][123091] Updated weights for policy 0, policy_version 638031 (0.0010) [2023-12-26 04:40:51,303][123090] Updated weights for policy 1, policy_version 633481 (0.0010) [2023-12-26 04:40:51,368][123090] Updated weights for policy 1, policy_version 633491 (0.0009) [2023-12-26 04:40:51,437][123090] Updated weights for policy 1, policy_version 633501 (0.0010) [2023-12-26 04:40:51,999][123091] Updated weights for policy 0, policy_version 638041 (0.0010) [2023-12-26 04:40:52,068][123091] Updated weights for policy 0, policy_version 638051 (0.0010) [2023-12-26 04:40:52,139][123091] Updated weights for policy 0, policy_version 638061 (0.0011) [2023-12-26 04:40:52,258][123090] Updated weights for policy 1, policy_version 633511 (0.0008) [2023-12-26 04:40:52,318][123090] Updated weights for policy 1, policy_version 633521 (0.0009) [2023-12-26 04:40:52,381][123090] Updated weights for policy 1, policy_version 633531 (0.0010) [2023-12-26 04:40:52,963][123091] Updated weights for policy 0, policy_version 638071 (0.0010) [2023-12-26 04:40:53,029][123091] Updated weights for policy 0, policy_version 638081 (0.0008) [2023-12-26 04:40:53,096][123091] Updated weights for policy 0, policy_version 638091 (0.0009) [2023-12-26 04:40:53,182][123090] Updated weights for policy 1, policy_version 633541 (0.0008) [2023-12-26 04:40:53,261][123090] Updated weights for policy 1, policy_version 633551 (0.0005) [2023-12-26 04:40:53,326][123090] Updated weights for policy 1, policy_version 633561 (0.0005) [2023-12-26 04:40:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 325550080. Throughput: 0: 8938.3, 1: 8712.4. Samples: 325530340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:53,785][121949] Avg episode reward: [(0, '6253.672'), (1, '5583.287')] [2023-12-26 04:40:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000638096_163356672.pth... [2023-12-26 04:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000633568_162193408.pth... [2023-12-26 04:40:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000637040_163086336.pth [2023-12-26 04:40:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000632544_161931264.pth [2023-12-26 04:40:53,953][123090] Updated weights for policy 1, policy_version 633571 (0.0007) [2023-12-26 04:40:54,007][123091] Updated weights for policy 0, policy_version 638101 (0.0009) [2023-12-26 04:40:54,018][123090] Updated weights for policy 1, policy_version 633581 (0.0010) [2023-12-26 04:40:54,057][123091] Updated weights for policy 0, policy_version 638111 (0.0007) [2023-12-26 04:40:54,068][123090] Updated weights for policy 1, policy_version 633591 (0.0006) [2023-12-26 04:40:54,110][123091] Updated weights for policy 0, policy_version 638121 (0.0009) [2023-12-26 04:40:54,798][123090] Updated weights for policy 1, policy_version 633601 (0.0008) [2023-12-26 04:40:54,852][123090] Updated weights for policy 1, policy_version 633611 (0.0009) [2023-12-26 04:40:54,912][123090] Updated weights for policy 1, policy_version 633621 (0.0010) [2023-12-26 04:40:54,970][123090] Updated weights for policy 1, policy_version 633631 (0.0009) [2023-12-26 04:40:54,972][123091] Updated weights for policy 0, policy_version 638131 (0.0009) [2023-12-26 04:40:55,025][123091] Updated weights for policy 0, policy_version 638141 (0.0009) [2023-12-26 04:40:55,078][123091] Updated weights for policy 0, policy_version 638151 (0.0009) [2023-12-26 04:40:55,826][123090] Updated weights for policy 1, policy_version 633641 (0.0009) [2023-12-26 04:40:55,881][123090] Updated weights for policy 1, policy_version 633651 (0.0009) [2023-12-26 04:40:55,916][123091] Updated weights for policy 0, policy_version 638161 (0.0010) [2023-12-26 04:40:55,946][123090] Updated weights for policy 1, policy_version 633661 (0.0008) [2023-12-26 04:40:55,979][123091] Updated weights for policy 0, policy_version 638171 (0.0010) [2023-12-26 04:40:56,031][123091] Updated weights for policy 0, policy_version 638181 (0.0009) [2023-12-26 04:40:56,095][123091] Updated weights for policy 0, policy_version 638191 (0.0009) [2023-12-26 04:40:56,750][123090] Updated weights for policy 1, policy_version 633671 (0.0009) [2023-12-26 04:40:56,799][123090] Updated weights for policy 1, policy_version 633681 (0.0009) [2023-12-26 04:40:56,848][123090] Updated weights for policy 1, policy_version 633691 (0.0009) [2023-12-26 04:40:56,924][123091] Updated weights for policy 0, policy_version 638201 (0.0010) [2023-12-26 04:40:56,992][123091] Updated weights for policy 0, policy_version 638211 (0.0008) [2023-12-26 04:40:57,058][123091] Updated weights for policy 0, policy_version 638221 (0.0010) [2023-12-26 04:40:57,663][123090] Updated weights for policy 1, policy_version 633701 (0.0009) [2023-12-26 04:40:57,718][123090] Updated weights for policy 1, policy_version 633711 (0.0006) [2023-12-26 04:40:57,770][123090] Updated weights for policy 1, policy_version 633721 (0.0005) [2023-12-26 04:40:57,894][123091] Updated weights for policy 0, policy_version 638231 (0.0009) [2023-12-26 04:40:57,945][123091] Updated weights for policy 0, policy_version 638241 (0.0009) [2023-12-26 04:40:58,012][123091] Updated weights for policy 0, policy_version 638251 (0.0009) [2023-12-26 04:40:58,515][123090] Updated weights for policy 1, policy_version 633731 (0.0006) [2023-12-26 04:40:58,584][123090] Updated weights for policy 1, policy_version 633741 (0.0007) [2023-12-26 04:40:58,663][123090] Updated weights for policy 1, policy_version 633751 (0.0009) [2023-12-26 04:40:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 325640192. Throughput: 0: 8906.2, 1: 8770.7. Samples: 325634688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:40:58,785][121949] Avg episode reward: [(0, '6258.092'), (1, '5498.078')] [2023-12-26 04:40:58,936][123091] Updated weights for policy 0, policy_version 638261 (0.0008) [2023-12-26 04:40:59,009][123091] Updated weights for policy 0, policy_version 638271 (0.0007) [2023-12-26 04:40:59,084][123091] Updated weights for policy 0, policy_version 638281 (0.0006) [2023-12-26 04:40:59,465][123090] Updated weights for policy 1, policy_version 633761 (0.0009) [2023-12-26 04:40:59,526][123090] Updated weights for policy 1, policy_version 633771 (0.0009) [2023-12-26 04:40:59,585][123090] Updated weights for policy 1, policy_version 633781 (0.0009) [2023-12-26 04:40:59,644][123090] Updated weights for policy 1, policy_version 633791 (0.0009) [2023-12-26 04:40:59,815][123091] Updated weights for policy 0, policy_version 638291 (0.0006) [2023-12-26 04:40:59,888][123091] Updated weights for policy 0, policy_version 638301 (0.0007) [2023-12-26 04:40:59,951][123091] Updated weights for policy 0, policy_version 638311 (0.0009) [2023-12-26 04:41:00,550][123090] Updated weights for policy 1, policy_version 633801 (0.0009) [2023-12-26 04:41:00,585][123091] Updated weights for policy 0, policy_version 638321 (0.0007) [2023-12-26 04:41:00,605][123090] Updated weights for policy 1, policy_version 633812 (0.0008) [2023-12-26 04:41:00,640][123091] Updated weights for policy 0, policy_version 638331 (0.0007) [2023-12-26 04:41:00,662][123090] Updated weights for policy 1, policy_version 633822 (0.0006) [2023-12-26 04:41:00,697][123091] Updated weights for policy 0, policy_version 638341 (0.0010) [2023-12-26 04:41:00,758][123091] Updated weights for policy 0, policy_version 638352 (0.0010) [2023-12-26 04:41:01,475][123090] Updated weights for policy 1, policy_version 633832 (0.0008) [2023-12-26 04:41:01,536][123090] Updated weights for policy 1, policy_version 633842 (0.0009) [2023-12-26 04:41:01,594][123090] Updated weights for policy 1, policy_version 633852 (0.0010) [2023-12-26 04:41:01,595][123091] Updated weights for policy 0, policy_version 638362 (0.0008) [2023-12-26 04:41:01,657][123091] Updated weights for policy 0, policy_version 638372 (0.0010) [2023-12-26 04:41:01,711][123091] Updated weights for policy 0, policy_version 638382 (0.0009) [2023-12-26 04:41:02,418][123090] Updated weights for policy 1, policy_version 633862 (0.0006) [2023-12-26 04:41:02,476][123090] Updated weights for policy 1, policy_version 633872 (0.0009) [2023-12-26 04:41:02,536][123090] Updated weights for policy 1, policy_version 633882 (0.0010) [2023-12-26 04:41:02,555][123091] Updated weights for policy 0, policy_version 638392 (0.0006) [2023-12-26 04:41:02,603][123091] Updated weights for policy 0, policy_version 638402 (0.0006) [2023-12-26 04:41:02,653][123091] Updated weights for policy 0, policy_version 638412 (0.0005) [2023-12-26 04:41:03,304][123090] Updated weights for policy 1, policy_version 633892 (0.0010) [2023-12-26 04:41:03,357][123090] Updated weights for policy 1, policy_version 633902 (0.0009) [2023-12-26 04:41:03,407][123090] Updated weights for policy 1, policy_version 633912 (0.0008) [2023-12-26 04:41:03,414][123091] Updated weights for policy 0, policy_version 638422 (0.0007) [2023-12-26 04:41:03,470][123091] Updated weights for policy 0, policy_version 638432 (0.0008) [2023-12-26 04:41:03,520][123091] Updated weights for policy 0, policy_version 638442 (0.0008) [2023-12-26 04:41:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 325730304. Throughput: 0: 8856.9, 1: 8738.5. Samples: 325738788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:41:03,784][121949] Avg episode reward: [(0, '6177.553'), (1, '5273.303')] [2023-12-26 04:41:04,254][123090] Updated weights for policy 1, policy_version 633922 (0.0009) [2023-12-26 04:41:04,309][123090] Updated weights for policy 1, policy_version 633932 (0.0009) [2023-12-26 04:41:04,373][123090] Updated weights for policy 1, policy_version 633942 (0.0009) [2023-12-26 04:41:04,386][123091] Updated weights for policy 0, policy_version 638452 (0.0009) [2023-12-26 04:41:04,441][123090] Updated weights for policy 1, policy_version 633952 (0.0008) [2023-12-26 04:41:04,449][123091] Updated weights for policy 0, policy_version 638462 (0.0009) [2023-12-26 04:41:04,507][123091] Updated weights for policy 0, policy_version 638472 (0.0009) [2023-12-26 04:41:05,327][123090] Updated weights for policy 1, policy_version 633962 (0.0011) [2023-12-26 04:41:05,363][123091] Updated weights for policy 0, policy_version 638482 (0.0010) [2023-12-26 04:41:05,395][123090] Updated weights for policy 1, policy_version 633972 (0.0011) [2023-12-26 04:41:05,416][123091] Updated weights for policy 0, policy_version 638492 (0.0008) [2023-12-26 04:41:05,459][123090] Updated weights for policy 1, policy_version 633982 (0.0010) [2023-12-26 04:41:05,475][123091] Updated weights for policy 0, policy_version 638502 (0.0007) [2023-12-26 04:41:05,536][123091] Updated weights for policy 0, policy_version 638512 (0.0009) [2023-12-26 04:41:06,284][123090] Updated weights for policy 1, policy_version 633992 (0.0011) [2023-12-26 04:41:06,356][123090] Updated weights for policy 1, policy_version 634002 (0.0011) [2023-12-26 04:41:06,395][123091] Updated weights for policy 0, policy_version 638522 (0.0007) [2023-12-26 04:41:06,412][123090] Updated weights for policy 1, policy_version 634012 (0.0011) [2023-12-26 04:41:06,460][123091] Updated weights for policy 0, policy_version 638532 (0.0009) [2023-12-26 04:41:06,522][123091] Updated weights for policy 0, policy_version 638542 (0.0009) [2023-12-26 04:41:07,251][123090] Updated weights for policy 1, policy_version 634022 (0.0011) [2023-12-26 04:41:07,298][123091] Updated weights for policy 0, policy_version 638552 (0.0009) [2023-12-26 04:41:07,310][123090] Updated weights for policy 1, policy_version 634032 (0.0010) [2023-12-26 04:41:07,344][123091] Updated weights for policy 0, policy_version 638562 (0.0008) [2023-12-26 04:41:07,377][123090] Updated weights for policy 1, policy_version 634042 (0.0010) [2023-12-26 04:41:07,388][123091] Updated weights for policy 0, policy_version 638572 (0.0008) [2023-12-26 04:41:08,178][123091] Updated weights for policy 0, policy_version 638582 (0.0008) [2023-12-26 04:41:08,207][123090] Updated weights for policy 1, policy_version 634052 (0.0010) [2023-12-26 04:41:08,228][123091] Updated weights for policy 0, policy_version 638592 (0.0008) [2023-12-26 04:41:08,266][123090] Updated weights for policy 1, policy_version 634062 (0.0009) [2023-12-26 04:41:08,277][123091] Updated weights for policy 0, policy_version 638602 (0.0008) [2023-12-26 04:41:08,322][123090] Updated weights for policy 1, policy_version 634072 (0.0009) [2023-12-26 04:41:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 325812224. Throughput: 0: 8841.2, 1: 8777.0. Samples: 325789176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:41:08,785][121949] Avg episode reward: [(0, '6065.742'), (1, '5022.758')] [2023-12-26 04:41:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000638608_163487744.pth... [2023-12-26 04:41:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000634080_162324480.pth... [2023-12-26 04:41:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000637584_163225600.pth [2023-12-26 04:41:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000633056_162062336.pth [2023-12-26 04:41:09,089][123090] Updated weights for policy 1, policy_version 634082 (0.0010) [2023-12-26 04:41:09,156][123090] Updated weights for policy 1, policy_version 634092 (0.0011) [2023-12-26 04:41:09,162][123091] Updated weights for policy 0, policy_version 638612 (0.0007) [2023-12-26 04:41:09,216][123090] Updated weights for policy 1, policy_version 634102 (0.0010) [2023-12-26 04:41:09,227][123091] Updated weights for policy 0, policy_version 638622 (0.0006) [2023-12-26 04:41:09,283][123090] Updated weights for policy 1, policy_version 634112 (0.0009) [2023-12-26 04:41:09,294][123091] Updated weights for policy 0, policy_version 638632 (0.0006) [2023-12-26 04:41:10,110][123090] Updated weights for policy 1, policy_version 634122 (0.0011) [2023-12-26 04:41:10,114][123091] Updated weights for policy 0, policy_version 638642 (0.0009) [2023-12-26 04:41:10,159][123090] Updated weights for policy 1, policy_version 634132 (0.0011) [2023-12-26 04:41:10,174][123091] Updated weights for policy 0, policy_version 638652 (0.0009) [2023-12-26 04:41:10,219][123090] Updated weights for policy 1, policy_version 634142 (0.0011) [2023-12-26 04:41:10,235][123091] Updated weights for policy 0, policy_version 638662 (0.0007) [2023-12-26 04:41:10,302][123091] Updated weights for policy 0, policy_version 638672 (0.0006) [2023-12-26 04:41:11,023][123090] Updated weights for policy 1, policy_version 634152 (0.0009) [2023-12-26 04:41:11,075][123091] Updated weights for policy 0, policy_version 638682 (0.0009) [2023-12-26 04:41:11,090][123090] Updated weights for policy 1, policy_version 634162 (0.0009) [2023-12-26 04:41:11,138][123091] Updated weights for policy 0, policy_version 638692 (0.0008) [2023-12-26 04:41:11,152][123090] Updated weights for policy 1, policy_version 634172 (0.0009) [2023-12-26 04:41:11,196][123091] Updated weights for policy 0, policy_version 638702 (0.0009) [2023-12-26 04:41:12,042][123091] Updated weights for policy 0, policy_version 638712 (0.0010) [2023-12-26 04:41:12,071][123090] Updated weights for policy 1, policy_version 634182 (0.0008) [2023-12-26 04:41:12,106][123091] Updated weights for policy 0, policy_version 638722 (0.0008) [2023-12-26 04:41:12,132][123090] Updated weights for policy 1, policy_version 634192 (0.0009) [2023-12-26 04:41:12,171][123091] Updated weights for policy 0, policy_version 638732 (0.0009) [2023-12-26 04:41:12,196][123090] Updated weights for policy 1, policy_version 634202 (0.0010) [2023-12-26 04:41:12,987][123090] Updated weights for policy 1, policy_version 634212 (0.0008) [2023-12-26 04:41:13,047][123091] Updated weights for policy 0, policy_version 638742 (0.0007) [2023-12-26 04:41:13,058][123090] Updated weights for policy 1, policy_version 634222 (0.0007) [2023-12-26 04:41:13,107][123091] Updated weights for policy 0, policy_version 638752 (0.0005) [2023-12-26 04:41:13,132][123090] Updated weights for policy 1, policy_version 634232 (0.0009) [2023-12-26 04:41:13,173][123091] Updated weights for policy 0, policy_version 638762 (0.0008) [2023-12-26 04:41:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 325894144. Throughput: 0: 8738.5, 1: 8756.9. Samples: 325891616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:41:13,785][121949] Avg episode reward: [(0, '6087.942'), (1, '4733.268')] [2023-12-26 04:41:13,901][123090] Updated weights for policy 1, policy_version 634242 (0.0007) [2023-12-26 04:41:13,964][123091] Updated weights for policy 0, policy_version 638772 (0.0010) [2023-12-26 04:41:13,971][123090] Updated weights for policy 1, policy_version 634252 (0.0007) [2023-12-26 04:41:14,019][123091] Updated weights for policy 0, policy_version 638782 (0.0010) [2023-12-26 04:41:14,027][123090] Updated weights for policy 1, policy_version 634262 (0.0005) [2023-12-26 04:41:14,077][123091] Updated weights for policy 0, policy_version 638792 (0.0006) [2023-12-26 04:41:14,088][123090] Updated weights for policy 1, policy_version 634272 (0.0009) [2023-12-26 04:41:14,818][123091] Updated weights for policy 0, policy_version 638802 (0.0006) [2023-12-26 04:41:14,884][123091] Updated weights for policy 0, policy_version 638812 (0.0008) [2023-12-26 04:41:14,944][123091] Updated weights for policy 0, policy_version 638822 (0.0008) [2023-12-26 04:41:14,951][123090] Updated weights for policy 1, policy_version 634282 (0.0006) [2023-12-26 04:41:15,003][123091] Updated weights for policy 0, policy_version 638832 (0.0008) [2023-12-26 04:41:15,017][123090] Updated weights for policy 1, policy_version 634292 (0.0008) [2023-12-26 04:41:15,082][123090] Updated weights for policy 1, policy_version 634302 (0.0008) [2023-12-26 04:41:15,830][123091] Updated weights for policy 0, policy_version 638842 (0.0006) [2023-12-26 04:41:15,879][123091] Updated weights for policy 0, policy_version 638852 (0.0005) [2023-12-26 04:41:15,910][123090] Updated weights for policy 1, policy_version 634312 (0.0009) [2023-12-26 04:41:15,941][123091] Updated weights for policy 0, policy_version 638862 (0.0007) [2023-12-26 04:41:15,965][123090] Updated weights for policy 1, policy_version 634322 (0.0008) [2023-12-26 04:41:16,018][123090] Updated weights for policy 1, policy_version 634332 (0.0010) [2023-12-26 04:41:16,557][123091] Updated weights for policy 0, policy_version 638872 (0.0005) [2023-12-26 04:41:16,611][123091] Updated weights for policy 0, policy_version 638882 (0.0005) [2023-12-26 04:41:16,669][123091] Updated weights for policy 0, policy_version 638892 (0.0005) [2023-12-26 04:41:16,943][123090] Updated weights for policy 1, policy_version 634342 (0.0009) [2023-12-26 04:41:16,990][123090] Updated weights for policy 1, policy_version 634352 (0.0008) [2023-12-26 04:41:17,039][123090] Updated weights for policy 1, policy_version 634362 (0.0009) [2023-12-26 04:41:17,422][123091] Updated weights for policy 0, policy_version 638902 (0.0008) [2023-12-26 04:41:17,483][123091] Updated weights for policy 0, policy_version 638912 (0.0010) [2023-12-26 04:41:17,546][123091] Updated weights for policy 0, policy_version 638922 (0.0010) [2023-12-26 04:41:17,897][123090] Updated weights for policy 1, policy_version 634372 (0.0009) [2023-12-26 04:41:17,949][123090] Updated weights for policy 1, policy_version 634382 (0.0009) [2023-12-26 04:41:17,996][123090] Updated weights for policy 1, policy_version 634392 (0.0008) [2023-12-26 04:41:18,354][123091] Updated weights for policy 0, policy_version 638932 (0.0010) [2023-12-26 04:41:18,418][123091] Updated weights for policy 0, policy_version 638942 (0.0008) [2023-12-26 04:41:18,466][123091] Updated weights for policy 0, policy_version 638952 (0.0008) [2023-12-26 04:41:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 325984256. Throughput: 0: 8730.7, 1: 8774.7. Samples: 325996804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:41:18,785][121949] Avg episode reward: [(0, '6253.020'), (1, '4738.301')] [2023-12-26 04:41:18,831][123090] Updated weights for policy 1, policy_version 634402 (0.0009) [2023-12-26 04:41:18,895][123090] Updated weights for policy 1, policy_version 634412 (0.0009) [2023-12-26 04:41:18,955][123090] Updated weights for policy 1, policy_version 634422 (0.0009) [2023-12-26 04:41:19,019][123090] Updated weights for policy 1, policy_version 634432 (0.0010) [2023-12-26 04:41:19,275][123091] Updated weights for policy 0, policy_version 638962 (0.0009) [2023-12-26 04:41:19,323][123091] Updated weights for policy 0, policy_version 638972 (0.0010) [2023-12-26 04:41:19,385][123091] Updated weights for policy 0, policy_version 638982 (0.0011) [2023-12-26 04:41:19,453][123091] Updated weights for policy 0, policy_version 638992 (0.0006) [2023-12-26 04:41:19,873][123090] Updated weights for policy 1, policy_version 634442 (0.0010) [2023-12-26 04:41:19,945][123090] Updated weights for policy 1, policy_version 634452 (0.0010) [2023-12-26 04:41:20,013][123090] Updated weights for policy 1, policy_version 634462 (0.0010) [2023-12-26 04:41:20,311][123091] Updated weights for policy 0, policy_version 639002 (0.0011) [2023-12-26 04:41:20,381][123091] Updated weights for policy 0, policy_version 639012 (0.0011) [2023-12-26 04:41:20,450][123091] Updated weights for policy 0, policy_version 639022 (0.0008) [2023-12-26 04:41:20,854][123090] Updated weights for policy 1, policy_version 634472 (0.0011) [2023-12-26 04:41:20,922][123090] Updated weights for policy 1, policy_version 634482 (0.0011) [2023-12-26 04:41:20,994][123090] Updated weights for policy 1, policy_version 634492 (0.0011) [2023-12-26 04:41:21,260][123091] Updated weights for policy 0, policy_version 639032 (0.0010) [2023-12-26 04:41:21,328][123091] Updated weights for policy 0, policy_version 639042 (0.0011) [2023-12-26 04:41:21,404][123091] Updated weights for policy 0, policy_version 639052 (0.0010) [2023-12-26 04:41:21,836][123090] Updated weights for policy 1, policy_version 634502 (0.0011) [2023-12-26 04:41:21,896][123090] Updated weights for policy 1, policy_version 634512 (0.0011) [2023-12-26 04:41:21,969][123090] Updated weights for policy 1, policy_version 634522 (0.0011) [2023-12-26 04:41:22,240][123091] Updated weights for policy 0, policy_version 639062 (0.0010) [2023-12-26 04:41:22,301][123091] Updated weights for policy 0, policy_version 639072 (0.0009) [2023-12-26 04:41:22,364][123091] Updated weights for policy 0, policy_version 639082 (0.0009) [2023-12-26 04:41:22,787][123090] Updated weights for policy 1, policy_version 634532 (0.0011) [2023-12-26 04:41:22,840][123090] Updated weights for policy 1, policy_version 634542 (0.0011) [2023-12-26 04:41:22,901][123090] Updated weights for policy 1, policy_version 634552 (0.0011) [2023-12-26 04:41:23,207][123091] Updated weights for policy 0, policy_version 639092 (0.0009) [2023-12-26 04:41:23,263][123091] Updated weights for policy 0, policy_version 639102 (0.0009) [2023-12-26 04:41:23,311][123091] Updated weights for policy 0, policy_version 639112 (0.0009) [2023-12-26 04:41:23,758][123090] Updated weights for policy 1, policy_version 634562 (0.0011) [2023-12-26 04:41:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 326066176. Throughput: 0: 8780.3, 1: 8708.3. Samples: 326047956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 04:41:23,785][121949] Avg episode reward: [(0, '6205.530'), (1, '4909.345')] [2023-12-26 04:41:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000639120_163618816.pth... [2023-12-26 04:41:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000638096_163356672.pth [2023-12-26 04:41:23,825][123090] Updated weights for policy 1, policy_version 634572 (0.0011) [2023-12-26 04:41:23,896][123090] Updated weights for policy 1, policy_version 634582 (0.0011) [2023-12-26 04:41:23,964][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000634592_162455552.pth... [2023-12-26 04:41:23,965][123090] Updated weights for policy 1, policy_version 634592 (0.0007) [2023-12-26 04:41:23,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000633568_162193408.pth [2023-12-26 04:41:24,195][123091] Updated weights for policy 0, policy_version 639122 (0.0008) [2023-12-26 04:41:24,248][123091] Updated weights for policy 0, policy_version 639132 (0.0010) [2023-12-26 04:41:24,293][123091] Updated weights for policy 0, policy_version 639142 (0.0011) [2023-12-26 04:41:24,341][123091] Updated weights for policy 0, policy_version 639152 (0.0010) [2023-12-26 04:41:24,621][123090] Updated weights for policy 1, policy_version 634602 (0.0008) [2023-12-26 04:41:24,691][123090] Updated weights for policy 1, policy_version 634612 (0.0010) [2023-12-26 04:41:24,755][123090] Updated weights for policy 1, policy_version 634622 (0.0011) [2023-12-26 04:41:25,163][123091] Updated weights for policy 0, policy_version 639162 (0.0009) [2023-12-26 04:41:25,216][123091] Updated weights for policy 0, policy_version 639172 (0.0010) [2023-12-26 04:41:25,274][123091] Updated weights for policy 0, policy_version 639183 (0.0008) [2023-12-26 04:41:25,473][123090] Updated weights for policy 1, policy_version 634632 (0.0006) [2023-12-26 04:41:25,550][123090] Updated weights for policy 1, policy_version 634642 (0.0005) [2023-12-26 04:41:25,618][123090] Updated weights for policy 1, policy_version 634652 (0.0005) [2023-12-26 04:41:25,974][123091] Updated weights for policy 0, policy_version 639193 (0.0007) [2023-12-26 04:41:26,037][123091] Updated weights for policy 0, policy_version 639203 (0.0006) [2023-12-26 04:41:26,101][123091] Updated weights for policy 0, policy_version 639213 (0.0006) [2023-12-26 04:41:26,205][123090] Updated weights for policy 1, policy_version 634662 (0.0005) [2023-12-26 04:41:26,277][123090] Updated weights for policy 1, policy_version 634672 (0.0005) [2023-12-26 04:41:26,340][123090] Updated weights for policy 1, policy_version 634682 (0.0005) [2023-12-26 04:41:26,712][123091] Updated weights for policy 0, policy_version 639223 (0.0006) [2023-12-26 04:41:26,768][123091] Updated weights for policy 0, policy_version 639233 (0.0007) [2023-12-26 04:41:26,815][123091] Updated weights for policy 0, policy_version 639243 (0.0007) [2023-12-26 04:41:26,957][123090] Updated weights for policy 1, policy_version 634692 (0.0005) [2023-12-26 04:41:27,019][123090] Updated weights for policy 1, policy_version 634702 (0.0005) [2023-12-26 04:41:27,080][123090] Updated weights for policy 1, policy_version 634712 (0.0005) [2023-12-26 04:41:27,605][123091] Updated weights for policy 0, policy_version 639253 (0.0006) [2023-12-26 04:41:27,661][123091] Updated weights for policy 0, policy_version 639263 (0.0006) [2023-12-26 04:41:27,709][123091] Updated weights for policy 0, policy_version 639273 (0.0006) [2023-12-26 04:41:27,828][123090] Updated weights for policy 1, policy_version 634722 (0.0006) [2023-12-26 04:41:27,887][123090] Updated weights for policy 1, policy_version 634732 (0.0010) [2023-12-26 04:41:27,946][123090] Updated weights for policy 1, policy_version 634742 (0.0010) [2023-12-26 04:41:28,000][123090] Updated weights for policy 1, policy_version 634752 (0.0010) [2023-12-26 04:41:28,350][123091] Updated weights for policy 0, policy_version 639283 (0.0011) [2023-12-26 04:41:28,407][123091] Updated weights for policy 0, policy_version 639293 (0.0008) [2023-12-26 04:41:28,466][123091] Updated weights for policy 0, policy_version 639303 (0.0009) [2023-12-26 04:41:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 326164480. Throughput: 0: 8852.0, 1: 8747.0. Samples: 326158404. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:28,785][121949] Avg episode reward: [(0, '6113.739'), (1, '5011.016')] [2023-12-26 04:41:28,827][123090] Updated weights for policy 1, policy_version 634762 (0.0011) [2023-12-26 04:41:28,890][123090] Updated weights for policy 1, policy_version 634772 (0.0010) [2023-12-26 04:41:28,941][123090] Updated weights for policy 1, policy_version 634782 (0.0010) [2023-12-26 04:41:29,233][123091] Updated weights for policy 0, policy_version 639313 (0.0008) [2023-12-26 04:41:29,303][123091] Updated weights for policy 0, policy_version 639323 (0.0008) [2023-12-26 04:41:29,365][123091] Updated weights for policy 0, policy_version 639333 (0.0009) [2023-12-26 04:41:29,429][123091] Updated weights for policy 0, policy_version 639343 (0.0007) [2023-12-26 04:41:29,797][123090] Updated weights for policy 1, policy_version 634792 (0.0009) [2023-12-26 04:41:29,872][123090] Updated weights for policy 1, policy_version 634802 (0.0009) [2023-12-26 04:41:29,946][123090] Updated weights for policy 1, policy_version 634812 (0.0007) [2023-12-26 04:41:30,178][123091] Updated weights for policy 0, policy_version 639353 (0.0009) [2023-12-26 04:41:30,230][123091] Updated weights for policy 0, policy_version 639363 (0.0009) [2023-12-26 04:41:30,293][123091] Updated weights for policy 0, policy_version 639373 (0.0010) [2023-12-26 04:41:30,580][123090] Updated weights for policy 1, policy_version 634822 (0.0006) [2023-12-26 04:41:30,642][123090] Updated weights for policy 1, policy_version 634832 (0.0009) [2023-12-26 04:41:30,692][123090] Updated weights for policy 1, policy_version 634842 (0.0009) [2023-12-26 04:41:31,168][123091] Updated weights for policy 0, policy_version 639383 (0.0010) [2023-12-26 04:41:31,221][123091] Updated weights for policy 0, policy_version 639393 (0.0009) [2023-12-26 04:41:31,276][123091] Updated weights for policy 0, policy_version 639403 (0.0010) [2023-12-26 04:41:31,534][123090] Updated weights for policy 1, policy_version 634852 (0.0008) [2023-12-26 04:41:31,591][123090] Updated weights for policy 1, policy_version 634862 (0.0009) [2023-12-26 04:41:31,660][123090] Updated weights for policy 1, policy_version 634872 (0.0009) [2023-12-26 04:41:32,101][123091] Updated weights for policy 0, policy_version 639413 (0.0008) [2023-12-26 04:41:32,173][123091] Updated weights for policy 0, policy_version 639423 (0.0005) [2023-12-26 04:41:32,232][123091] Updated weights for policy 0, policy_version 639433 (0.0005) [2023-12-26 04:41:32,531][123090] Updated weights for policy 1, policy_version 634882 (0.0010) [2023-12-26 04:41:32,597][123090] Updated weights for policy 1, policy_version 634892 (0.0009) [2023-12-26 04:41:32,671][123090] Updated weights for policy 1, policy_version 634902 (0.0006) [2023-12-26 04:41:32,737][123090] Updated weights for policy 1, policy_version 634912 (0.0007) [2023-12-26 04:41:32,917][123091] Updated weights for policy 0, policy_version 639443 (0.0008) [2023-12-26 04:41:32,983][123091] Updated weights for policy 0, policy_version 639453 (0.0007) [2023-12-26 04:41:33,050][123091] Updated weights for policy 0, policy_version 639463 (0.0007) [2023-12-26 04:41:33,592][123090] Updated weights for policy 1, policy_version 634922 (0.0009) [2023-12-26 04:41:33,653][123090] Updated weights for policy 1, policy_version 634932 (0.0010) [2023-12-26 04:41:33,664][123091] Updated weights for policy 0, policy_version 639473 (0.0009) [2023-12-26 04:41:33,714][123090] Updated weights for policy 1, policy_version 634942 (0.0008) [2023-12-26 04:41:33,721][123091] Updated weights for policy 0, policy_version 639483 (0.0008) [2023-12-26 04:41:33,772][123091] Updated weights for policy 0, policy_version 639493 (0.0009) [2023-12-26 04:41:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 326254592. Throughput: 0: 8811.8, 1: 8698.2. Samples: 326265780. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:33,785][121949] Avg episode reward: [(0, '6199.009'), (1, '5047.871')] [2023-12-26 04:41:33,828][123091] Updated weights for policy 0, policy_version 639503 (0.0010) [2023-12-26 04:41:34,537][123090] Updated weights for policy 1, policy_version 634952 (0.0008) [2023-12-26 04:41:34,594][123090] Updated weights for policy 1, policy_version 634962 (0.0009) [2023-12-26 04:41:34,660][123091] Updated weights for policy 0, policy_version 639513 (0.0010) [2023-12-26 04:41:34,663][123090] Updated weights for policy 1, policy_version 634972 (0.0007) [2023-12-26 04:41:34,728][123091] Updated weights for policy 0, policy_version 639523 (0.0011) [2023-12-26 04:41:34,797][123091] Updated weights for policy 0, policy_version 639533 (0.0011) [2023-12-26 04:41:35,449][123090] Updated weights for policy 1, policy_version 634982 (0.0006) [2023-12-26 04:41:35,500][123090] Updated weights for policy 1, policy_version 634992 (0.0005) [2023-12-26 04:41:35,545][123090] Updated weights for policy 1, policy_version 635002 (0.0005) [2023-12-26 04:41:35,620][123091] Updated weights for policy 0, policy_version 639543 (0.0010) [2023-12-26 04:41:35,672][123091] Updated weights for policy 0, policy_version 639553 (0.0010) [2023-12-26 04:41:35,716][123091] Updated weights for policy 0, policy_version 639563 (0.0010) [2023-12-26 04:41:36,255][123090] Updated weights for policy 1, policy_version 635012 (0.0007) [2023-12-26 04:41:36,329][123090] Updated weights for policy 1, policy_version 635022 (0.0009) [2023-12-26 04:41:36,401][123090] Updated weights for policy 1, policy_version 635032 (0.0011) [2023-12-26 04:41:36,553][123091] Updated weights for policy 0, policy_version 639573 (0.0010) [2023-12-26 04:41:36,619][123091] Updated weights for policy 0, policy_version 639583 (0.0010) [2023-12-26 04:41:36,675][123091] Updated weights for policy 0, policy_version 639593 (0.0009) [2023-12-26 04:41:37,115][123090] Updated weights for policy 1, policy_version 635042 (0.0008) [2023-12-26 04:41:37,182][123090] Updated weights for policy 1, policy_version 635052 (0.0005) [2023-12-26 04:41:37,251][123090] Updated weights for policy 1, policy_version 635062 (0.0005) [2023-12-26 04:41:37,322][123090] Updated weights for policy 1, policy_version 635072 (0.0005) [2023-12-26 04:41:37,602][123091] Updated weights for policy 0, policy_version 639603 (0.0008) [2023-12-26 04:41:37,663][123091] Updated weights for policy 0, policy_version 639613 (0.0006) [2023-12-26 04:41:37,729][123091] Updated weights for policy 0, policy_version 639623 (0.0009) [2023-12-26 04:41:38,050][123090] Updated weights for policy 1, policy_version 635082 (0.0010) [2023-12-26 04:41:38,113][123090] Updated weights for policy 1, policy_version 635092 (0.0010) [2023-12-26 04:41:38,177][123090] Updated weights for policy 1, policy_version 635102 (0.0010) [2023-12-26 04:41:38,623][123091] Updated weights for policy 0, policy_version 639633 (0.0009) [2023-12-26 04:41:38,677][123091] Updated weights for policy 0, policy_version 639643 (0.0009) [2023-12-26 04:41:38,728][123091] Updated weights for policy 0, policy_version 639653 (0.0009) [2023-12-26 04:41:38,777][123091] Updated weights for policy 0, policy_version 639663 (0.0009) [2023-12-26 04:41:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 326344704. Throughput: 0: 8793.9, 1: 8722.2. Samples: 326318560. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:38,785][121949] Avg episode reward: [(0, '6161.911'), (1, '4898.877')] [2023-12-26 04:41:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000639664_163758080.pth... [2023-12-26 04:41:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000635104_162586624.pth... [2023-12-26 04:41:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000638608_163487744.pth [2023-12-26 04:41:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000634080_162324480.pth [2023-12-26 04:41:38,963][123090] Updated weights for policy 1, policy_version 635112 (0.0010) [2023-12-26 04:41:39,015][123090] Updated weights for policy 1, policy_version 635122 (0.0010) [2023-12-26 04:41:39,067][123090] Updated weights for policy 1, policy_version 635132 (0.0010) [2023-12-26 04:41:39,668][123091] Updated weights for policy 0, policy_version 639673 (0.0010) [2023-12-26 04:41:39,729][123091] Updated weights for policy 0, policy_version 639683 (0.0009) [2023-12-26 04:41:39,791][123091] Updated weights for policy 0, policy_version 639693 (0.0010) [2023-12-26 04:41:39,907][123090] Updated weights for policy 1, policy_version 635142 (0.0008) [2023-12-26 04:41:39,991][123090] Updated weights for policy 1, policy_version 635152 (0.0008) [2023-12-26 04:41:40,047][123090] Updated weights for policy 1, policy_version 635162 (0.0008) [2023-12-26 04:41:40,690][123091] Updated weights for policy 0, policy_version 639703 (0.0006) [2023-12-26 04:41:40,759][123091] Updated weights for policy 0, policy_version 639713 (0.0006) [2023-12-26 04:41:40,813][123091] Updated weights for policy 0, policy_version 639723 (0.0007) [2023-12-26 04:41:40,817][123090] Updated weights for policy 1, policy_version 635172 (0.0009) [2023-12-26 04:41:40,887][123090] Updated weights for policy 1, policy_version 635182 (0.0010) [2023-12-26 04:41:40,955][123090] Updated weights for policy 1, policy_version 635192 (0.0011) [2023-12-26 04:41:41,617][123091] Updated weights for policy 0, policy_version 639733 (0.0008) [2023-12-26 04:41:41,690][123091] Updated weights for policy 0, policy_version 639743 (0.0007) [2023-12-26 04:41:41,759][123091] Updated weights for policy 0, policy_version 639753 (0.0010) [2023-12-26 04:41:41,825][123090] Updated weights for policy 1, policy_version 635202 (0.0007) [2023-12-26 04:41:41,883][123090] Updated weights for policy 1, policy_version 635212 (0.0009) [2023-12-26 04:41:41,951][123090] Updated weights for policy 1, policy_version 635222 (0.0009) [2023-12-26 04:41:42,016][123090] Updated weights for policy 1, policy_version 635232 (0.0009) [2023-12-26 04:41:42,572][123091] Updated weights for policy 0, policy_version 639763 (0.0009) [2023-12-26 04:41:42,635][123091] Updated weights for policy 0, policy_version 639773 (0.0009) [2023-12-26 04:41:42,694][123091] Updated weights for policy 0, policy_version 639783 (0.0010) [2023-12-26 04:41:42,840][123090] Updated weights for policy 1, policy_version 635242 (0.0010) [2023-12-26 04:41:42,906][123090] Updated weights for policy 1, policy_version 635252 (0.0009) [2023-12-26 04:41:42,969][123090] Updated weights for policy 1, policy_version 635262 (0.0009) [2023-12-26 04:41:43,543][123091] Updated weights for policy 0, policy_version 639793 (0.0008) [2023-12-26 04:41:43,617][123091] Updated weights for policy 0, policy_version 639803 (0.0009) [2023-12-26 04:41:43,679][123091] Updated weights for policy 0, policy_version 639813 (0.0009) [2023-12-26 04:41:43,732][123091] Updated weights for policy 0, policy_version 639823 (0.0010) [2023-12-26 04:41:43,766][123090] Updated weights for policy 1, policy_version 635272 (0.0009) [2023-12-26 04:41:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 326426624. Throughput: 0: 8781.0, 1: 8676.0. Samples: 326420252. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:43,784][121949] Avg episode reward: [(0, '6054.414'), (1, '4961.354')] [2023-12-26 04:41:43,818][123090] Updated weights for policy 1, policy_version 635282 (0.0009) [2023-12-26 04:41:43,869][123090] Updated weights for policy 1, policy_version 635292 (0.0009) [2023-12-26 04:41:44,535][123091] Updated weights for policy 0, policy_version 639833 (0.0010) [2023-12-26 04:41:44,602][123091] Updated weights for policy 0, policy_version 639843 (0.0010) [2023-12-26 04:41:44,659][123091] Updated weights for policy 0, policy_version 639853 (0.0010) [2023-12-26 04:41:44,708][123090] Updated weights for policy 1, policy_version 635302 (0.0006) [2023-12-26 04:41:44,780][123090] Updated weights for policy 1, policy_version 635312 (0.0008) [2023-12-26 04:41:44,836][123090] Updated weights for policy 1, policy_version 635322 (0.0009) [2023-12-26 04:41:45,496][123091] Updated weights for policy 0, policy_version 639863 (0.0009) [2023-12-26 04:41:45,547][123091] Updated weights for policy 0, policy_version 639873 (0.0009) [2023-12-26 04:41:45,593][123091] Updated weights for policy 0, policy_version 639883 (0.0007) [2023-12-26 04:41:45,665][123090] Updated weights for policy 1, policy_version 635332 (0.0007) [2023-12-26 04:41:45,734][123090] Updated weights for policy 1, policy_version 635342 (0.0006) [2023-12-26 04:41:45,785][123090] Updated weights for policy 1, policy_version 635352 (0.0008) [2023-12-26 04:41:46,468][123091] Updated weights for policy 0, policy_version 639893 (0.0008) [2023-12-26 04:41:46,519][123090] Updated weights for policy 1, policy_version 635362 (0.0009) [2023-12-26 04:41:46,550][123091] Updated weights for policy 0, policy_version 639903 (0.0008) [2023-12-26 04:41:46,582][123090] Updated weights for policy 1, policy_version 635372 (0.0006) [2023-12-26 04:41:46,613][123091] Updated weights for policy 0, policy_version 639913 (0.0008) [2023-12-26 04:41:46,638][123090] Updated weights for policy 1, policy_version 635382 (0.0010) [2023-12-26 04:41:46,686][123090] Updated weights for policy 1, policy_version 635392 (0.0010) [2023-12-26 04:41:47,318][123091] Updated weights for policy 0, policy_version 639923 (0.0007) [2023-12-26 04:41:47,360][123090] Updated weights for policy 1, policy_version 635402 (0.0006) [2023-12-26 04:41:47,366][123091] Updated weights for policy 0, policy_version 639933 (0.0010) [2023-12-26 04:41:47,420][123090] Updated weights for policy 1, policy_version 635412 (0.0007) [2023-12-26 04:41:47,422][123091] Updated weights for policy 0, policy_version 639943 (0.0011) [2023-12-26 04:41:47,475][123090] Updated weights for policy 1, policy_version 635422 (0.0010) [2023-12-26 04:41:48,176][123091] Updated weights for policy 0, policy_version 639953 (0.0010) [2023-12-26 04:41:48,209][123090] Updated weights for policy 1, policy_version 635432 (0.0007) [2023-12-26 04:41:48,226][123091] Updated weights for policy 0, policy_version 639963 (0.0008) [2023-12-26 04:41:48,270][123090] Updated weights for policy 1, policy_version 635442 (0.0010) [2023-12-26 04:41:48,287][123091] Updated weights for policy 0, policy_version 639973 (0.0011) [2023-12-26 04:41:48,329][123090] Updated weights for policy 1, policy_version 635452 (0.0010) [2023-12-26 04:41:48,342][123091] Updated weights for policy 0, policy_version 639983 (0.0008) [2023-12-26 04:41:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 326516736. Throughput: 0: 8795.3, 1: 8751.3. Samples: 326528384. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:48,785][121949] Avg episode reward: [(0, '6063.668'), (1, '5058.503')] [2023-12-26 04:41:49,045][123091] Updated weights for policy 0, policy_version 639993 (0.0006) [2023-12-26 04:41:49,101][123091] Updated weights for policy 0, policy_version 640003 (0.0005) [2023-12-26 04:41:49,148][123090] Updated weights for policy 1, policy_version 635462 (0.0010) [2023-12-26 04:41:49,155][123091] Updated weights for policy 0, policy_version 640013 (0.0006) [2023-12-26 04:41:49,202][123090] Updated weights for policy 1, policy_version 635472 (0.0010) [2023-12-26 04:41:49,272][123090] Updated weights for policy 1, policy_version 635482 (0.0010) [2023-12-26 04:41:49,862][123091] Updated weights for policy 0, policy_version 640023 (0.0007) [2023-12-26 04:41:49,940][123091] Updated weights for policy 0, policy_version 640033 (0.0007) [2023-12-26 04:41:50,001][123091] Updated weights for policy 0, policy_version 640043 (0.0010) [2023-12-26 04:41:50,111][123090] Updated weights for policy 1, policy_version 635492 (0.0008) [2023-12-26 04:41:50,175][123090] Updated weights for policy 1, policy_version 635502 (0.0009) [2023-12-26 04:41:50,234][123090] Updated weights for policy 1, policy_version 635512 (0.0007) [2023-12-26 04:41:50,865][123091] Updated weights for policy 0, policy_version 640053 (0.0008) [2023-12-26 04:41:50,872][123090] Updated weights for policy 1, policy_version 635522 (0.0005) [2023-12-26 04:41:50,930][123091] Updated weights for policy 0, policy_version 640063 (0.0007) [2023-12-26 04:41:50,931][123090] Updated weights for policy 1, policy_version 635532 (0.0006) [2023-12-26 04:41:50,983][123090] Updated weights for policy 1, policy_version 635542 (0.0006) [2023-12-26 04:41:50,987][123091] Updated weights for policy 0, policy_version 640073 (0.0005) [2023-12-26 04:41:51,044][123090] Updated weights for policy 1, policy_version 635552 (0.0008) [2023-12-26 04:41:51,758][123091] Updated weights for policy 0, policy_version 640083 (0.0007) [2023-12-26 04:41:51,822][123091] Updated weights for policy 0, policy_version 640093 (0.0009) [2023-12-26 04:41:51,882][123091] Updated weights for policy 0, policy_version 640103 (0.0009) [2023-12-26 04:41:51,893][123090] Updated weights for policy 1, policy_version 635562 (0.0008) [2023-12-26 04:41:51,956][123090] Updated weights for policy 1, policy_version 635572 (0.0008) [2023-12-26 04:41:52,017][123090] Updated weights for policy 1, policy_version 635582 (0.0010) [2023-12-26 04:41:52,620][123091] Updated weights for policy 0, policy_version 640113 (0.0008) [2023-12-26 04:41:52,691][123091] Updated weights for policy 0, policy_version 640123 (0.0007) [2023-12-26 04:41:52,757][123091] Updated weights for policy 0, policy_version 640133 (0.0009) [2023-12-26 04:41:52,824][123091] Updated weights for policy 0, policy_version 640143 (0.0010) [2023-12-26 04:41:52,907][123090] Updated weights for policy 1, policy_version 635592 (0.0006) [2023-12-26 04:41:52,979][123090] Updated weights for policy 1, policy_version 635602 (0.0007) [2023-12-26 04:41:53,052][123090] Updated weights for policy 1, policy_version 635612 (0.0007) [2023-12-26 04:41:53,608][123091] Updated weights for policy 0, policy_version 640153 (0.0010) [2023-12-26 04:41:53,660][123091] Updated weights for policy 0, policy_version 640163 (0.0009) [2023-12-26 04:41:53,715][123091] Updated weights for policy 0, policy_version 640173 (0.0010) [2023-12-26 04:41:53,769][123090] Updated weights for policy 1, policy_version 635622 (0.0007) [2023-12-26 04:41:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 326606848. Throughput: 0: 8853.2, 1: 8785.7. Samples: 326582924. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:53,785][121949] Avg episode reward: [(0, '6229.277'), (1, '5166.330')] [2023-12-26 04:41:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000640176_163889152.pth... [2023-12-26 04:41:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000639120_163618816.pth [2023-12-26 04:41:53,823][123090] Updated weights for policy 1, policy_version 635632 (0.0009) [2023-12-26 04:41:53,887][123090] Updated weights for policy 1, policy_version 635642 (0.0009) [2023-12-26 04:41:53,920][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000635648_162725888.pth... [2023-12-26 04:41:53,925][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000634592_162455552.pth [2023-12-26 04:41:54,610][123091] Updated weights for policy 0, policy_version 640183 (0.0007) [2023-12-26 04:41:54,643][123090] Updated weights for policy 1, policy_version 635652 (0.0009) [2023-12-26 04:41:54,676][123091] Updated weights for policy 0, policy_version 640193 (0.0007) [2023-12-26 04:41:54,698][123090] Updated weights for policy 1, policy_version 635662 (0.0009) [2023-12-26 04:41:54,736][123091] Updated weights for policy 0, policy_version 640203 (0.0011) [2023-12-26 04:41:54,762][123090] Updated weights for policy 1, policy_version 635672 (0.0006) [2023-12-26 04:41:55,366][123091] Updated weights for policy 0, policy_version 640213 (0.0007) [2023-12-26 04:41:55,412][123091] Updated weights for policy 0, policy_version 640223 (0.0005) [2023-12-26 04:41:55,470][123090] Updated weights for policy 1, policy_version 635682 (0.0006) [2023-12-26 04:41:55,479][123091] Updated weights for policy 0, policy_version 640233 (0.0007) [2023-12-26 04:41:55,540][123090] Updated weights for policy 1, policy_version 635692 (0.0008) [2023-12-26 04:41:55,594][123090] Updated weights for policy 1, policy_version 635702 (0.0009) [2023-12-26 04:41:55,654][123090] Updated weights for policy 1, policy_version 635712 (0.0009) [2023-12-26 04:41:56,191][123091] Updated weights for policy 0, policy_version 640243 (0.0009) [2023-12-26 04:41:56,240][123091] Updated weights for policy 0, policy_version 640253 (0.0005) [2023-12-26 04:41:56,292][123091] Updated weights for policy 0, policy_version 640263 (0.0005) [2023-12-26 04:41:56,313][123090] Updated weights for policy 1, policy_version 635722 (0.0005) [2023-12-26 04:41:56,363][123090] Updated weights for policy 1, policy_version 635732 (0.0005) [2023-12-26 04:41:56,418][123090] Updated weights for policy 1, policy_version 635742 (0.0005) [2023-12-26 04:41:56,970][123091] Updated weights for policy 0, policy_version 640273 (0.0005) [2023-12-26 04:41:57,033][123091] Updated weights for policy 0, policy_version 640283 (0.0006) [2023-12-26 04:41:57,082][123090] Updated weights for policy 1, policy_version 635752 (0.0007) [2023-12-26 04:41:57,102][123091] Updated weights for policy 0, policy_version 640293 (0.0006) [2023-12-26 04:41:57,143][123090] Updated weights for policy 1, policy_version 635762 (0.0008) [2023-12-26 04:41:57,173][123091] Updated weights for policy 0, policy_version 640303 (0.0005) [2023-12-26 04:41:57,212][123090] Updated weights for policy 1, policy_version 635772 (0.0006) [2023-12-26 04:41:57,842][123091] Updated weights for policy 0, policy_version 640313 (0.0010) [2023-12-26 04:41:57,892][123091] Updated weights for policy 0, policy_version 640323 (0.0010) [2023-12-26 04:41:57,943][123091] Updated weights for policy 0, policy_version 640333 (0.0005) [2023-12-26 04:41:57,972][123090] Updated weights for policy 1, policy_version 635782 (0.0007) [2023-12-26 04:41:58,038][123090] Updated weights for policy 1, policy_version 635792 (0.0009) [2023-12-26 04:41:58,106][123090] Updated weights for policy 1, policy_version 635802 (0.0008) [2023-12-26 04:41:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 326696960. Throughput: 0: 8965.5, 1: 8905.8. Samples: 326695824. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:41:58,785][121949] Avg episode reward: [(0, '6120.292'), (1, '5384.683')] [2023-12-26 04:41:58,892][123091] Updated weights for policy 0, policy_version 640343 (0.0009) [2023-12-26 04:41:58,957][123091] Updated weights for policy 0, policy_version 640353 (0.0009) [2023-12-26 04:41:59,015][123090] Updated weights for policy 1, policy_version 635812 (0.0008) [2023-12-26 04:41:59,027][123091] Updated weights for policy 0, policy_version 640363 (0.0009) [2023-12-26 04:41:59,079][123090] Updated weights for policy 1, policy_version 635822 (0.0008) [2023-12-26 04:41:59,139][123090] Updated weights for policy 1, policy_version 635832 (0.0008) [2023-12-26 04:41:59,856][123091] Updated weights for policy 0, policy_version 640373 (0.0010) [2023-12-26 04:41:59,919][123091] Updated weights for policy 0, policy_version 640383 (0.0011) [2023-12-26 04:41:59,939][123090] Updated weights for policy 1, policy_version 635842 (0.0008) [2023-12-26 04:41:59,977][123091] Updated weights for policy 0, policy_version 640393 (0.0011) [2023-12-26 04:41:59,988][123090] Updated weights for policy 1, policy_version 635852 (0.0007) [2023-12-26 04:42:00,048][123090] Updated weights for policy 1, policy_version 635862 (0.0008) [2023-12-26 04:42:00,103][123090] Updated weights for policy 1, policy_version 635872 (0.0008) [2023-12-26 04:42:00,789][123091] Updated weights for policy 0, policy_version 640403 (0.0010) [2023-12-26 04:42:00,839][123091] Updated weights for policy 0, policy_version 640413 (0.0010) [2023-12-26 04:42:00,886][123091] Updated weights for policy 0, policy_version 640423 (0.0010) [2023-12-26 04:42:00,940][123090] Updated weights for policy 1, policy_version 635882 (0.0007) [2023-12-26 04:42:00,995][123090] Updated weights for policy 1, policy_version 635892 (0.0008) [2023-12-26 04:42:01,062][123090] Updated weights for policy 1, policy_version 635902 (0.0009) [2023-12-26 04:42:01,755][123091] Updated weights for policy 0, policy_version 640433 (0.0010) [2023-12-26 04:42:01,806][123091] Updated weights for policy 0, policy_version 640443 (0.0010) [2023-12-26 04:42:01,857][123091] Updated weights for policy 0, policy_version 640453 (0.0010) [2023-12-26 04:42:01,908][123091] Updated weights for policy 0, policy_version 640463 (0.0010) [2023-12-26 04:42:01,924][123090] Updated weights for policy 1, policy_version 635912 (0.0006) [2023-12-26 04:42:01,989][123090] Updated weights for policy 1, policy_version 635922 (0.0009) [2023-12-26 04:42:02,049][123090] Updated weights for policy 1, policy_version 635932 (0.0009) [2023-12-26 04:42:02,751][123091] Updated weights for policy 0, policy_version 640473 (0.0011) [2023-12-26 04:42:02,802][123091] Updated weights for policy 0, policy_version 640483 (0.0010) [2023-12-26 04:42:02,856][123091] Updated weights for policy 0, policy_version 640493 (0.0010) [2023-12-26 04:42:02,889][123090] Updated weights for policy 1, policy_version 635942 (0.0008) [2023-12-26 04:42:02,940][123090] Updated weights for policy 1, policy_version 635952 (0.0008) [2023-12-26 04:42:02,987][123090] Updated weights for policy 1, policy_version 635962 (0.0008) [2023-12-26 04:42:03,692][123091] Updated weights for policy 0, policy_version 640503 (0.0010) [2023-12-26 04:42:03,746][123091] Updated weights for policy 0, policy_version 640513 (0.0010) [2023-12-26 04:42:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 326778880. Throughput: 0: 8878.4, 1: 8898.8. Samples: 326796780. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:03,784][121949] Avg episode reward: [(0, '6161.373'), (1, '5535.357')] [2023-12-26 04:42:03,800][123091] Updated weights for policy 0, policy_version 640523 (0.0010) [2023-12-26 04:42:03,829][123090] Updated weights for policy 1, policy_version 635972 (0.0010) [2023-12-26 04:42:03,890][123090] Updated weights for policy 1, policy_version 635982 (0.0009) [2023-12-26 04:42:03,954][123090] Updated weights for policy 1, policy_version 635992 (0.0009) [2023-12-26 04:42:04,644][123091] Updated weights for policy 0, policy_version 640533 (0.0011) [2023-12-26 04:42:04,708][123091] Updated weights for policy 0, policy_version 640543 (0.0010) [2023-12-26 04:42:04,774][123091] Updated weights for policy 0, policy_version 640553 (0.0011) [2023-12-26 04:42:04,792][123090] Updated weights for policy 1, policy_version 636002 (0.0009) [2023-12-26 04:42:04,862][123090] Updated weights for policy 1, policy_version 636012 (0.0009) [2023-12-26 04:42:04,928][123090] Updated weights for policy 1, policy_version 636022 (0.0009) [2023-12-26 04:42:04,985][123090] Updated weights for policy 1, policy_version 636032 (0.0009) [2023-12-26 04:42:05,594][123091] Updated weights for policy 0, policy_version 640563 (0.0010) [2023-12-26 04:42:05,653][123091] Updated weights for policy 0, policy_version 640573 (0.0010) [2023-12-26 04:42:05,704][123091] Updated weights for policy 0, policy_version 640583 (0.0010) [2023-12-26 04:42:05,816][123090] Updated weights for policy 1, policy_version 636042 (0.0009) [2023-12-26 04:42:05,864][123090] Updated weights for policy 1, policy_version 636052 (0.0009) [2023-12-26 04:42:05,911][123090] Updated weights for policy 1, policy_version 636062 (0.0008) [2023-12-26 04:42:06,536][123091] Updated weights for policy 0, policy_version 640593 (0.0010) [2023-12-26 04:42:06,592][123091] Updated weights for policy 0, policy_version 640603 (0.0010) [2023-12-26 04:42:06,647][123091] Updated weights for policy 0, policy_version 640613 (0.0010) [2023-12-26 04:42:06,705][123091] Updated weights for policy 0, policy_version 640623 (0.0009) [2023-12-26 04:42:06,761][123090] Updated weights for policy 1, policy_version 636072 (0.0010) [2023-12-26 04:42:06,822][123090] Updated weights for policy 1, policy_version 636082 (0.0009) [2023-12-26 04:42:06,872][123090] Updated weights for policy 1, policy_version 636092 (0.0009) [2023-12-26 04:42:07,603][123091] Updated weights for policy 0, policy_version 640633 (0.0010) [2023-12-26 04:42:07,668][123091] Updated weights for policy 0, policy_version 640643 (0.0009) [2023-12-26 04:42:07,670][123090] Updated weights for policy 1, policy_version 636102 (0.0009) [2023-12-26 04:42:07,725][123091] Updated weights for policy 0, policy_version 640653 (0.0008) [2023-12-26 04:42:07,729][123090] Updated weights for policy 1, policy_version 636112 (0.0008) [2023-12-26 04:42:07,788][123090] Updated weights for policy 1, policy_version 636122 (0.0009) [2023-12-26 04:42:08,595][123091] Updated weights for policy 0, policy_version 640663 (0.0008) [2023-12-26 04:42:08,628][123090] Updated weights for policy 1, policy_version 636132 (0.0008) [2023-12-26 04:42:08,647][123091] Updated weights for policy 0, policy_version 640673 (0.0009) [2023-12-26 04:42:08,694][123090] Updated weights for policy 1, policy_version 636142 (0.0009) [2023-12-26 04:42:08,702][123091] Updated weights for policy 0, policy_version 640683 (0.0007) [2023-12-26 04:42:08,756][123090] Updated weights for policy 1, policy_version 636152 (0.0009) [2023-12-26 04:42:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 326868992. Throughput: 0: 8854.7, 1: 8912.6. Samples: 326847480. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:08,785][121949] Avg episode reward: [(0, '6240.310'), (1, '5640.169')] [2023-12-26 04:42:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000640688_164020224.pth... [2023-12-26 04:42:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000639664_163758080.pth [2023-12-26 04:42:08,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000636160_162856960.pth... [2023-12-26 04:42:08,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000635104_162586624.pth [2023-12-26 04:42:09,594][123091] Updated weights for policy 0, policy_version 640693 (0.0010) [2023-12-26 04:42:09,602][123090] Updated weights for policy 1, policy_version 636162 (0.0008) [2023-12-26 04:42:09,653][123091] Updated weights for policy 0, policy_version 640703 (0.0008) [2023-12-26 04:42:09,663][123090] Updated weights for policy 1, policy_version 636172 (0.0009) [2023-12-26 04:42:09,718][123091] Updated weights for policy 0, policy_version 640713 (0.0009) [2023-12-26 04:42:09,727][123090] Updated weights for policy 1, policy_version 636182 (0.0007) [2023-12-26 04:42:09,789][123090] Updated weights for policy 1, policy_version 636192 (0.0008) [2023-12-26 04:42:10,538][123091] Updated weights for policy 0, policy_version 640723 (0.0010) [2023-12-26 04:42:10,598][123091] Updated weights for policy 0, policy_version 640733 (0.0008) [2023-12-26 04:42:10,618][123090] Updated weights for policy 1, policy_version 636202 (0.0008) [2023-12-26 04:42:10,661][123091] Updated weights for policy 0, policy_version 640743 (0.0007) [2023-12-26 04:42:10,676][123090] Updated weights for policy 1, policy_version 636212 (0.0009) [2023-12-26 04:42:10,737][123090] Updated weights for policy 1, policy_version 636222 (0.0008) [2023-12-26 04:42:11,496][123091] Updated weights for policy 0, policy_version 640753 (0.0009) [2023-12-26 04:42:11,551][123091] Updated weights for policy 0, policy_version 640763 (0.0008) [2023-12-26 04:42:11,604][123090] Updated weights for policy 1, policy_version 636232 (0.0010) [2023-12-26 04:42:11,614][123091] Updated weights for policy 0, policy_version 640773 (0.0008) [2023-12-26 04:42:11,682][123090] Updated weights for policy 1, policy_version 636242 (0.0008) [2023-12-26 04:42:11,684][123091] Updated weights for policy 0, policy_version 640783 (0.0007) [2023-12-26 04:42:11,759][123090] Updated weights for policy 1, policy_version 636252 (0.0010) [2023-12-26 04:42:12,517][123091] Updated weights for policy 0, policy_version 640793 (0.0010) [2023-12-26 04:42:12,572][123091] Updated weights for policy 0, policy_version 640803 (0.0010) [2023-12-26 04:42:12,579][123090] Updated weights for policy 1, policy_version 636262 (0.0009) [2023-12-26 04:42:12,639][123091] Updated weights for policy 0, policy_version 640813 (0.0008) [2023-12-26 04:42:12,640][123090] Updated weights for policy 1, policy_version 636272 (0.0009) [2023-12-26 04:42:12,702][123090] Updated weights for policy 1, policy_version 636282 (0.0009) [2023-12-26 04:42:13,497][123091] Updated weights for policy 0, policy_version 640823 (0.0009) [2023-12-26 04:42:13,524][123090] Updated weights for policy 1, policy_version 636292 (0.0008) [2023-12-26 04:42:13,564][123091] Updated weights for policy 0, policy_version 640833 (0.0009) [2023-12-26 04:42:13,584][123090] Updated weights for policy 1, policy_version 636302 (0.0006) [2023-12-26 04:42:13,623][123091] Updated weights for policy 0, policy_version 640843 (0.0009) [2023-12-26 04:42:13,651][123090] Updated weights for policy 1, policy_version 636312 (0.0005) [2023-12-26 04:42:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 326959104. Throughput: 0: 8766.1, 1: 8783.8. Samples: 326948152. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:13,785][121949] Avg episode reward: [(0, '6137.593'), (1, '5647.755')] [2023-12-26 04:42:14,357][123090] Updated weights for policy 1, policy_version 636322 (0.0006) [2023-12-26 04:42:14,414][123090] Updated weights for policy 1, policy_version 636332 (0.0009) [2023-12-26 04:42:14,474][123090] Updated weights for policy 1, policy_version 636343 (0.0010) [2023-12-26 04:42:14,480][123091] Updated weights for policy 0, policy_version 640853 (0.0009) [2023-12-26 04:42:14,524][123091] Updated weights for policy 0, policy_version 640863 (0.0007) [2023-12-26 04:42:14,573][123091] Updated weights for policy 0, policy_version 640873 (0.0010) [2023-12-26 04:42:15,334][123090] Updated weights for policy 1, policy_version 636353 (0.0010) [2023-12-26 04:42:15,387][123090] Updated weights for policy 1, policy_version 636363 (0.0009) [2023-12-26 04:42:15,438][123091] Updated weights for policy 0, policy_version 640884 (0.0010) [2023-12-26 04:42:15,442][123090] Updated weights for policy 1, policy_version 636373 (0.0009) [2023-12-26 04:42:15,487][123091] Updated weights for policy 0, policy_version 640894 (0.0010) [2023-12-26 04:42:15,489][123090] Updated weights for policy 1, policy_version 636383 (0.0007) [2023-12-26 04:42:15,546][123091] Updated weights for policy 0, policy_version 640904 (0.0008) [2023-12-26 04:42:16,295][123090] Updated weights for policy 1, policy_version 636393 (0.0006) [2023-12-26 04:42:16,360][123090] Updated weights for policy 1, policy_version 636403 (0.0006) [2023-12-26 04:42:16,414][123090] Updated weights for policy 1, policy_version 636413 (0.0009) [2023-12-26 04:42:16,415][123091] Updated weights for policy 0, policy_version 640914 (0.0010) [2023-12-26 04:42:16,467][123091] Updated weights for policy 0, policy_version 640924 (0.0010) [2023-12-26 04:42:16,520][123091] Updated weights for policy 0, policy_version 640934 (0.0009) [2023-12-26 04:42:16,579][123091] Updated weights for policy 0, policy_version 640944 (0.0009) [2023-12-26 04:42:17,190][123090] Updated weights for policy 1, policy_version 636423 (0.0008) [2023-12-26 04:42:17,242][123090] Updated weights for policy 1, policy_version 636433 (0.0008) [2023-12-26 04:42:17,306][123090] Updated weights for policy 1, policy_version 636443 (0.0009) [2023-12-26 04:42:17,400][123091] Updated weights for policy 0, policy_version 640954 (0.0009) [2023-12-26 04:42:17,459][123091] Updated weights for policy 0, policy_version 640964 (0.0009) [2023-12-26 04:42:17,510][123091] Updated weights for policy 0, policy_version 640975 (0.0010) [2023-12-26 04:42:18,141][123090] Updated weights for policy 1, policy_version 636453 (0.0009) [2023-12-26 04:42:18,196][123090] Updated weights for policy 1, policy_version 636463 (0.0009) [2023-12-26 04:42:18,250][123090] Updated weights for policy 1, policy_version 636473 (0.0009) [2023-12-26 04:42:18,350][123091] Updated weights for policy 0, policy_version 640985 (0.0009) [2023-12-26 04:42:18,413][123091] Updated weights for policy 0, policy_version 640995 (0.0010) [2023-12-26 04:42:18,479][123091] Updated weights for policy 0, policy_version 641005 (0.0009) [2023-12-26 04:42:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.7). Total num frames: 327041024. Throughput: 0: 8636.6, 1: 8827.0. Samples: 327051640. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:18,785][121949] Avg episode reward: [(0, '6197.536'), (1, '5796.928')] [2023-12-26 04:42:19,099][123090] Updated weights for policy 1, policy_version 636483 (0.0009) [2023-12-26 04:42:19,151][123090] Updated weights for policy 1, policy_version 636493 (0.0009) [2023-12-26 04:42:19,221][123090] Updated weights for policy 1, policy_version 636503 (0.0009) [2023-12-26 04:42:19,290][123091] Updated weights for policy 0, policy_version 641015 (0.0009) [2023-12-26 04:42:19,356][123091] Updated weights for policy 0, policy_version 641025 (0.0009) [2023-12-26 04:42:19,418][123091] Updated weights for policy 0, policy_version 641035 (0.0009) [2023-12-26 04:42:20,054][123090] Updated weights for policy 1, policy_version 636513 (0.0010) [2023-12-26 04:42:20,112][123090] Updated weights for policy 1, policy_version 636523 (0.0009) [2023-12-26 04:42:20,183][123090] Updated weights for policy 1, policy_version 636533 (0.0006) [2023-12-26 04:42:20,248][123091] Updated weights for policy 0, policy_version 641045 (0.0007) [2023-12-26 04:42:20,257][123090] Updated weights for policy 1, policy_version 636543 (0.0008) [2023-12-26 04:42:20,312][123091] Updated weights for policy 0, policy_version 641055 (0.0007) [2023-12-26 04:42:20,373][123091] Updated weights for policy 0, policy_version 641065 (0.0009) [2023-12-26 04:42:21,077][123090] Updated weights for policy 1, policy_version 636553 (0.0009) [2023-12-26 04:42:21,114][123091] Updated weights for policy 0, policy_version 641075 (0.0006) [2023-12-26 04:42:21,148][123090] Updated weights for policy 1, policy_version 636563 (0.0009) [2023-12-26 04:42:21,185][123091] Updated weights for policy 0, policy_version 641085 (0.0010) [2023-12-26 04:42:21,218][123090] Updated weights for policy 1, policy_version 636573 (0.0006) [2023-12-26 04:42:21,250][123091] Updated weights for policy 0, policy_version 641095 (0.0011) [2023-12-26 04:42:21,989][123090] Updated weights for policy 1, policy_version 636583 (0.0005) [2023-12-26 04:42:22,051][123090] Updated weights for policy 1, policy_version 636593 (0.0006) [2023-12-26 04:42:22,114][123090] Updated weights for policy 1, policy_version 636603 (0.0006) [2023-12-26 04:42:22,114][123091] Updated weights for policy 0, policy_version 641105 (0.0008) [2023-12-26 04:42:22,179][123091] Updated weights for policy 0, policy_version 641115 (0.0010) [2023-12-26 04:42:22,247][123091] Updated weights for policy 0, policy_version 641125 (0.0009) [2023-12-26 04:42:22,312][123091] Updated weights for policy 0, policy_version 641135 (0.0010) [2023-12-26 04:42:22,867][123090] Updated weights for policy 1, policy_version 636613 (0.0008) [2023-12-26 04:42:22,925][123090] Updated weights for policy 1, policy_version 636623 (0.0005) [2023-12-26 04:42:22,976][123090] Updated weights for policy 1, policy_version 636633 (0.0008) [2023-12-26 04:42:23,181][123091] Updated weights for policy 0, policy_version 641145 (0.0011) [2023-12-26 04:42:23,252][123091] Updated weights for policy 0, policy_version 641155 (0.0010) [2023-12-26 04:42:23,327][123091] Updated weights for policy 0, policy_version 641165 (0.0008) [2023-12-26 04:42:23,742][123090] Updated weights for policy 1, policy_version 636643 (0.0009) [2023-12-26 04:42:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 327122944. Throughput: 0: 8653.2, 1: 8782.4. Samples: 327103160. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:23,785][121949] Avg episode reward: [(0, '6245.080'), (1, '5800.869')] [2023-12-26 04:42:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000641168_164143104.pth... [2023-12-26 04:42:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000640176_163889152.pth [2023-12-26 04:42:23,808][123090] Updated weights for policy 1, policy_version 636653 (0.0008) [2023-12-26 04:42:23,857][123090] Updated weights for policy 1, policy_version 636663 (0.0010) [2023-12-26 04:42:23,909][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000636672_162988032.pth... [2023-12-26 04:42:23,914][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000635648_162725888.pth [2023-12-26 04:42:24,031][123091] Updated weights for policy 0, policy_version 641175 (0.0006) [2023-12-26 04:42:24,091][123091] Updated weights for policy 0, policy_version 641185 (0.0005) [2023-12-26 04:42:24,156][123091] Updated weights for policy 0, policy_version 641195 (0.0010) [2023-12-26 04:42:24,653][123090] Updated weights for policy 1, policy_version 636673 (0.0010) [2023-12-26 04:42:24,704][123090] Updated weights for policy 1, policy_version 636683 (0.0010) [2023-12-26 04:42:24,763][123090] Updated weights for policy 1, policy_version 636693 (0.0010) [2023-12-26 04:42:24,831][123090] Updated weights for policy 1, policy_version 636703 (0.0010) [2023-12-26 04:42:24,939][123091] Updated weights for policy 0, policy_version 641205 (0.0011) [2023-12-26 04:42:24,997][123091] Updated weights for policy 0, policy_version 641215 (0.0010) [2023-12-26 04:42:25,063][123091] Updated weights for policy 0, policy_version 641225 (0.0011) [2023-12-26 04:42:25,605][123090] Updated weights for policy 1, policy_version 636713 (0.0007) [2023-12-26 04:42:25,653][123090] Updated weights for policy 1, policy_version 636723 (0.0010) [2023-12-26 04:42:25,708][123090] Updated weights for policy 1, policy_version 636733 (0.0010) [2023-12-26 04:42:25,857][123091] Updated weights for policy 0, policy_version 641235 (0.0010) [2023-12-26 04:42:25,922][123091] Updated weights for policy 0, policy_version 641245 (0.0008) [2023-12-26 04:42:25,982][123091] Updated weights for policy 0, policy_version 641255 (0.0005) [2023-12-26 04:42:26,543][123090] Updated weights for policy 1, policy_version 636743 (0.0010) [2023-12-26 04:42:26,610][123090] Updated weights for policy 1, policy_version 636753 (0.0010) [2023-12-26 04:42:26,666][123090] Updated weights for policy 1, policy_version 636763 (0.0010) [2023-12-26 04:42:26,697][123091] Updated weights for policy 0, policy_version 641265 (0.0008) [2023-12-26 04:42:26,748][123091] Updated weights for policy 0, policy_version 641275 (0.0005) [2023-12-26 04:42:26,796][123091] Updated weights for policy 0, policy_version 641285 (0.0005) [2023-12-26 04:42:26,849][123091] Updated weights for policy 0, policy_version 641295 (0.0005) [2023-12-26 04:42:27,474][123091] Updated weights for policy 0, policy_version 641305 (0.0005) [2023-12-26 04:42:27,484][123090] Updated weights for policy 1, policy_version 636773 (0.0010) [2023-12-26 04:42:27,530][123091] Updated weights for policy 0, policy_version 641315 (0.0005) [2023-12-26 04:42:27,546][123090] Updated weights for policy 1, policy_version 636783 (0.0010) [2023-12-26 04:42:27,585][123091] Updated weights for policy 0, policy_version 641325 (0.0006) [2023-12-26 04:42:27,608][123090] Updated weights for policy 1, policy_version 636793 (0.0010) [2023-12-26 04:42:28,287][123091] Updated weights for policy 0, policy_version 641335 (0.0007) [2023-12-26 04:42:28,350][123091] Updated weights for policy 0, policy_version 641345 (0.0010) [2023-12-26 04:42:28,400][123090] Updated weights for policy 1, policy_version 636803 (0.0010) [2023-12-26 04:42:28,417][123091] Updated weights for policy 0, policy_version 641355 (0.0009) [2023-12-26 04:42:28,455][123090] Updated weights for policy 1, policy_version 636813 (0.0010) [2023-12-26 04:42:28,511][123090] Updated weights for policy 1, policy_version 636823 (0.0010) [2023-12-26 04:42:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 327221248. Throughput: 0: 8769.1, 1: 8810.9. Samples: 327211352. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:28,784][121949] Avg episode reward: [(0, '6186.109'), (1, '5711.249')] [2023-12-26 04:42:29,209][123091] Updated weights for policy 0, policy_version 641365 (0.0008) [2023-12-26 04:42:29,276][123091] Updated weights for policy 0, policy_version 641375 (0.0006) [2023-12-26 04:42:29,335][123091] Updated weights for policy 0, policy_version 641385 (0.0008) [2023-12-26 04:42:29,337][123090] Updated weights for policy 1, policy_version 636833 (0.0010) [2023-12-26 04:42:29,413][123090] Updated weights for policy 1, policy_version 636843 (0.0010) [2023-12-26 04:42:29,483][123090] Updated weights for policy 1, policy_version 636853 (0.0010) [2023-12-26 04:42:29,545][123090] Updated weights for policy 1, policy_version 636863 (0.0010) [2023-12-26 04:42:30,143][123091] Updated weights for policy 0, policy_version 641395 (0.0008) [2023-12-26 04:42:30,209][123091] Updated weights for policy 0, policy_version 641405 (0.0010) [2023-12-26 04:42:30,272][123091] Updated weights for policy 0, policy_version 641415 (0.0009) [2023-12-26 04:42:30,318][123090] Updated weights for policy 1, policy_version 636874 (0.0009) [2023-12-26 04:42:30,379][123090] Updated weights for policy 1, policy_version 636884 (0.0010) [2023-12-26 04:42:30,438][123090] Updated weights for policy 1, policy_version 636894 (0.0010) [2023-12-26 04:42:31,118][123091] Updated weights for policy 0, policy_version 641425 (0.0010) [2023-12-26 04:42:31,183][123091] Updated weights for policy 0, policy_version 641435 (0.0008) [2023-12-26 04:42:31,196][123090] Updated weights for policy 1, policy_version 636904 (0.0008) [2023-12-26 04:42:31,252][123091] Updated weights for policy 0, policy_version 641445 (0.0008) [2023-12-26 04:42:31,262][123090] Updated weights for policy 1, policy_version 636914 (0.0008) [2023-12-26 04:42:31,318][123091] Updated weights for policy 0, policy_version 641455 (0.0008) [2023-12-26 04:42:31,329][123090] Updated weights for policy 1, policy_version 636924 (0.0009) [2023-12-26 04:42:32,086][123091] Updated weights for policy 0, policy_version 641465 (0.0009) [2023-12-26 04:42:32,153][123091] Updated weights for policy 0, policy_version 641475 (0.0009) [2023-12-26 04:42:32,154][123090] Updated weights for policy 1, policy_version 636934 (0.0009) [2023-12-26 04:42:32,201][123090] Updated weights for policy 1, policy_version 636944 (0.0005) [2023-12-26 04:42:32,201][123091] Updated weights for policy 0, policy_version 641485 (0.0008) [2023-12-26 04:42:32,272][123090] Updated weights for policy 1, policy_version 636954 (0.0006) [2023-12-26 04:42:33,023][123091] Updated weights for policy 0, policy_version 641495 (0.0009) [2023-12-26 04:42:33,071][123090] Updated weights for policy 1, policy_version 636964 (0.0009) [2023-12-26 04:42:33,082][123091] Updated weights for policy 0, policy_version 641505 (0.0009) [2023-12-26 04:42:33,128][123090] Updated weights for policy 1, policy_version 636974 (0.0009) [2023-12-26 04:42:33,142][123091] Updated weights for policy 0, policy_version 641515 (0.0008) [2023-12-26 04:42:33,184][123090] Updated weights for policy 1, policy_version 636984 (0.0007) [2023-12-26 04:42:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 327303168. Throughput: 0: 8762.8, 1: 8786.4. Samples: 327318100. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:33,785][121949] Avg episode reward: [(0, '6042.908'), (1, '5597.494')] [2023-12-26 04:42:33,917][123090] Updated weights for policy 1, policy_version 636994 (0.0007) [2023-12-26 04:42:33,957][123091] Updated weights for policy 0, policy_version 641525 (0.0007) [2023-12-26 04:42:33,966][123090] Updated weights for policy 1, policy_version 637004 (0.0009) [2023-12-26 04:42:34,016][123091] Updated weights for policy 0, policy_version 641535 (0.0005) [2023-12-26 04:42:34,022][123090] Updated weights for policy 1, policy_version 637014 (0.0009) [2023-12-26 04:42:34,071][123091] Updated weights for policy 0, policy_version 641545 (0.0005) [2023-12-26 04:42:34,087][123090] Updated weights for policy 1, policy_version 637024 (0.0008) [2023-12-26 04:42:34,787][123090] Updated weights for policy 1, policy_version 637034 (0.0006) [2023-12-26 04:42:34,849][123090] Updated weights for policy 1, policy_version 637044 (0.0008) [2023-12-26 04:42:34,853][123091] Updated weights for policy 0, policy_version 641555 (0.0008) [2023-12-26 04:42:34,907][123090] Updated weights for policy 1, policy_version 637054 (0.0005) [2023-12-26 04:42:34,924][123091] Updated weights for policy 0, policy_version 641565 (0.0005) [2023-12-26 04:42:34,987][123091] Updated weights for policy 0, policy_version 641575 (0.0005) [2023-12-26 04:42:35,557][123090] Updated weights for policy 1, policy_version 637064 (0.0009) [2023-12-26 04:42:35,612][123091] Updated weights for policy 0, policy_version 641585 (0.0006) [2023-12-26 04:42:35,624][123090] Updated weights for policy 1, policy_version 637074 (0.0009) [2023-12-26 04:42:35,668][123091] Updated weights for policy 0, policy_version 641595 (0.0011) [2023-12-26 04:42:35,688][123090] Updated weights for policy 1, policy_version 637084 (0.0006) [2023-12-26 04:42:35,726][123091] Updated weights for policy 0, policy_version 641605 (0.0010) [2023-12-26 04:42:35,802][123091] Updated weights for policy 0, policy_version 641615 (0.0007) [2023-12-26 04:42:36,565][123090] Updated weights for policy 1, policy_version 637094 (0.0006) [2023-12-26 04:42:36,586][123091] Updated weights for policy 0, policy_version 641625 (0.0009) [2023-12-26 04:42:36,625][123090] Updated weights for policy 1, policy_version 637104 (0.0006) [2023-12-26 04:42:36,659][123091] Updated weights for policy 0, policy_version 641635 (0.0010) [2023-12-26 04:42:36,683][123090] Updated weights for policy 1, policy_version 637114 (0.0007) [2023-12-26 04:42:36,713][123091] Updated weights for policy 0, policy_version 641645 (0.0007) [2023-12-26 04:42:37,493][123090] Updated weights for policy 1, policy_version 637124 (0.0009) [2023-12-26 04:42:37,500][123091] Updated weights for policy 0, policy_version 641655 (0.0009) [2023-12-26 04:42:37,550][123090] Updated weights for policy 1, policy_version 637134 (0.0007) [2023-12-26 04:42:37,565][123091] Updated weights for policy 0, policy_version 641665 (0.0008) [2023-12-26 04:42:37,614][123090] Updated weights for policy 1, policy_version 637144 (0.0010) [2023-12-26 04:42:37,634][123091] Updated weights for policy 0, policy_version 641675 (0.0007) [2023-12-26 04:42:38,254][123091] Updated weights for policy 0, policy_version 641685 (0.0008) [2023-12-26 04:42:38,325][123091] Updated weights for policy 0, policy_version 641695 (0.0006) [2023-12-26 04:42:38,392][123091] Updated weights for policy 0, policy_version 641705 (0.0008) [2023-12-26 04:42:38,530][123090] Updated weights for policy 1, policy_version 637154 (0.0008) [2023-12-26 04:42:38,588][123090] Updated weights for policy 1, policy_version 637164 (0.0009) [2023-12-26 04:42:38,642][123090] Updated weights for policy 1, policy_version 637174 (0.0009) [2023-12-26 04:42:38,707][123090] Updated weights for policy 1, policy_version 637184 (0.0009) [2023-12-26 04:42:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 327401472. Throughput: 0: 8780.2, 1: 8792.5. Samples: 327373696. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:38,785][121949] Avg episode reward: [(0, '6033.260'), (1, '5260.911')] [2023-12-26 04:42:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000641712_164282368.pth... [2023-12-26 04:42:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000637184_163119104.pth... [2023-12-26 04:42:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000640688_164020224.pth [2023-12-26 04:42:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000636160_162856960.pth [2023-12-26 04:42:39,074][123091] Updated weights for policy 0, policy_version 641715 (0.0008) [2023-12-26 04:42:39,126][123091] Updated weights for policy 0, policy_version 641725 (0.0009) [2023-12-26 04:42:39,190][123091] Updated weights for policy 0, policy_version 641735 (0.0008) [2023-12-26 04:42:39,565][123090] Updated weights for policy 1, policy_version 637194 (0.0008) [2023-12-26 04:42:39,619][123090] Updated weights for policy 1, policy_version 637204 (0.0009) [2023-12-26 04:42:39,674][123090] Updated weights for policy 1, policy_version 637214 (0.0009) [2023-12-26 04:42:40,114][123091] Updated weights for policy 0, policy_version 641745 (0.0008) [2023-12-26 04:42:40,177][123091] Updated weights for policy 0, policy_version 641755 (0.0010) [2023-12-26 04:42:40,247][123091] Updated weights for policy 0, policy_version 641765 (0.0010) [2023-12-26 04:42:40,320][123091] Updated weights for policy 0, policy_version 641775 (0.0010) [2023-12-26 04:42:40,508][123090] Updated weights for policy 1, policy_version 637224 (0.0010) [2023-12-26 04:42:40,574][123090] Updated weights for policy 1, policy_version 637234 (0.0010) [2023-12-26 04:42:40,640][123090] Updated weights for policy 1, policy_version 637244 (0.0009) [2023-12-26 04:42:41,183][123091] Updated weights for policy 0, policy_version 641785 (0.0010) [2023-12-26 04:42:41,246][123091] Updated weights for policy 0, policy_version 641795 (0.0010) [2023-12-26 04:42:41,307][123091] Updated weights for policy 0, policy_version 641805 (0.0010) [2023-12-26 04:42:41,491][123090] Updated weights for policy 1, policy_version 637254 (0.0010) [2023-12-26 04:42:41,546][123090] Updated weights for policy 1, policy_version 637264 (0.0010) [2023-12-26 04:42:41,607][123090] Updated weights for policy 1, policy_version 637274 (0.0010) [2023-12-26 04:42:42,218][123091] Updated weights for policy 0, policy_version 641815 (0.0010) [2023-12-26 04:42:42,285][123091] Updated weights for policy 0, policy_version 641825 (0.0009) [2023-12-26 04:42:42,353][123091] Updated weights for policy 0, policy_version 641835 (0.0010) [2023-12-26 04:42:42,436][123090] Updated weights for policy 1, policy_version 637284 (0.0010) [2023-12-26 04:42:42,501][123090] Updated weights for policy 1, policy_version 637294 (0.0011) [2023-12-26 04:42:42,559][123090] Updated weights for policy 1, policy_version 637304 (0.0011) [2023-12-26 04:42:43,171][123091] Updated weights for policy 0, policy_version 641845 (0.0008) [2023-12-26 04:42:43,236][123091] Updated weights for policy 0, policy_version 641855 (0.0009) [2023-12-26 04:42:43,291][123091] Updated weights for policy 0, policy_version 641865 (0.0009) [2023-12-26 04:42:43,380][123090] Updated weights for policy 1, policy_version 637314 (0.0009) [2023-12-26 04:42:43,427][123090] Updated weights for policy 1, policy_version 637324 (0.0005) [2023-12-26 04:42:43,474][123090] Updated weights for policy 1, policy_version 637334 (0.0005) [2023-12-26 04:42:43,519][123090] Updated weights for policy 1, policy_version 637344 (0.0005) [2023-12-26 04:42:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 327483392. Throughput: 0: 8668.3, 1: 8655.1. Samples: 327475376. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:43,785][121949] Avg episode reward: [(0, '6214.178'), (1, '5267.909')] [2023-12-26 04:42:44,007][123091] Updated weights for policy 0, policy_version 641875 (0.0008) [2023-12-26 04:42:44,078][123091] Updated weights for policy 0, policy_version 641885 (0.0008) [2023-12-26 04:42:44,139][123091] Updated weights for policy 0, policy_version 641895 (0.0010) [2023-12-26 04:42:44,213][123090] Updated weights for policy 1, policy_version 637354 (0.0009) [2023-12-26 04:42:44,265][123090] Updated weights for policy 1, policy_version 637364 (0.0010) [2023-12-26 04:42:44,317][123090] Updated weights for policy 1, policy_version 637374 (0.0010) [2023-12-26 04:42:44,904][123091] Updated weights for policy 0, policy_version 641905 (0.0006) [2023-12-26 04:42:44,969][123091] Updated weights for policy 0, policy_version 641915 (0.0009) [2023-12-26 04:42:45,034][123091] Updated weights for policy 0, policy_version 641925 (0.0009) [2023-12-26 04:42:45,104][123091] Updated weights for policy 0, policy_version 641935 (0.0009) [2023-12-26 04:42:45,161][123090] Updated weights for policy 1, policy_version 637384 (0.0007) [2023-12-26 04:42:45,217][123090] Updated weights for policy 1, policy_version 637394 (0.0005) [2023-12-26 04:42:45,278][123090] Updated weights for policy 1, policy_version 637404 (0.0005) [2023-12-26 04:42:45,920][123091] Updated weights for policy 0, policy_version 641945 (0.0010) [2023-12-26 04:42:45,975][123091] Updated weights for policy 0, policy_version 641955 (0.0009) [2023-12-26 04:42:46,037][123091] Updated weights for policy 0, policy_version 641965 (0.0008) [2023-12-26 04:42:46,050][123090] Updated weights for policy 1, policy_version 637414 (0.0006) [2023-12-26 04:42:46,099][123090] Updated weights for policy 1, policy_version 637424 (0.0005) [2023-12-26 04:42:46,149][123090] Updated weights for policy 1, policy_version 637434 (0.0005) [2023-12-26 04:42:46,892][123090] Updated weights for policy 1, policy_version 637444 (0.0008) [2023-12-26 04:42:46,922][123091] Updated weights for policy 0, policy_version 641975 (0.0008) [2023-12-26 04:42:46,946][123090] Updated weights for policy 1, policy_version 637454 (0.0008) [2023-12-26 04:42:46,970][123091] Updated weights for policy 0, policy_version 641986 (0.0007) [2023-12-26 04:42:46,995][123090] Updated weights for policy 1, policy_version 637464 (0.0007) [2023-12-26 04:42:47,018][123091] Updated weights for policy 0, policy_version 641996 (0.0008) [2023-12-26 04:42:47,836][123091] Updated weights for policy 0, policy_version 642006 (0.0009) [2023-12-26 04:42:47,851][123090] Updated weights for policy 1, policy_version 637474 (0.0008) [2023-12-26 04:42:47,902][123091] Updated weights for policy 0, policy_version 642016 (0.0008) [2023-12-26 04:42:47,904][123090] Updated weights for policy 1, policy_version 637484 (0.0008) [2023-12-26 04:42:47,953][123090] Updated weights for policy 1, policy_version 637494 (0.0009) [2023-12-26 04:42:47,965][123091] Updated weights for policy 0, policy_version 642026 (0.0010) [2023-12-26 04:42:48,010][123090] Updated weights for policy 1, policy_version 637504 (0.0007) [2023-12-26 04:42:48,724][123091] Updated weights for policy 0, policy_version 642036 (0.0009) [2023-12-26 04:42:48,779][123091] Updated weights for policy 0, policy_version 642046 (0.0005) [2023-12-26 04:42:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 327565312. Throughput: 0: 8732.8, 1: 8762.7. Samples: 327584076. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:48,785][121949] Avg episode reward: [(0, '6212.170'), (1, '5421.113')] [2023-12-26 04:42:48,835][123090] Updated weights for policy 1, policy_version 637514 (0.0009) [2023-12-26 04:42:48,840][123091] Updated weights for policy 0, policy_version 642056 (0.0006) [2023-12-26 04:42:48,897][123090] Updated weights for policy 1, policy_version 637524 (0.0008) [2023-12-26 04:42:48,954][123090] Updated weights for policy 1, policy_version 637534 (0.0010) [2023-12-26 04:42:49,471][123091] Updated weights for policy 0, policy_version 642066 (0.0005) [2023-12-26 04:42:49,541][123091] Updated weights for policy 0, policy_version 642076 (0.0005) [2023-12-26 04:42:49,605][123091] Updated weights for policy 0, policy_version 642086 (0.0008) [2023-12-26 04:42:49,671][123091] Updated weights for policy 0, policy_version 642096 (0.0009) [2023-12-26 04:42:49,826][123090] Updated weights for policy 1, policy_version 637544 (0.0009) [2023-12-26 04:42:49,900][123090] Updated weights for policy 1, policy_version 637554 (0.0008) [2023-12-26 04:42:49,976][123090] Updated weights for policy 1, policy_version 637564 (0.0007) [2023-12-26 04:42:50,429][123091] Updated weights for policy 0, policy_version 642106 (0.0010) [2023-12-26 04:42:50,483][123091] Updated weights for policy 0, policy_version 642116 (0.0009) [2023-12-26 04:42:50,537][123091] Updated weights for policy 0, policy_version 642126 (0.0009) [2023-12-26 04:42:50,790][123090] Updated weights for policy 1, policy_version 637574 (0.0007) [2023-12-26 04:42:50,844][123090] Updated weights for policy 1, policy_version 637584 (0.0005) [2023-12-26 04:42:50,899][123090] Updated weights for policy 1, policy_version 637594 (0.0006) [2023-12-26 04:42:51,425][123091] Updated weights for policy 0, policy_version 642136 (0.0010) [2023-12-26 04:42:51,491][123091] Updated weights for policy 0, policy_version 642146 (0.0010) [2023-12-26 04:42:51,564][123091] Updated weights for policy 0, policy_version 642156 (0.0008) [2023-12-26 04:42:51,637][123090] Updated weights for policy 1, policy_version 637604 (0.0006) [2023-12-26 04:42:51,707][123090] Updated weights for policy 1, policy_version 637614 (0.0006) [2023-12-26 04:42:51,779][123090] Updated weights for policy 1, policy_version 637624 (0.0007) [2023-12-26 04:42:52,404][123091] Updated weights for policy 0, policy_version 642166 (0.0010) [2023-12-26 04:42:52,464][123091] Updated weights for policy 0, policy_version 642177 (0.0008) [2023-12-26 04:42:52,468][123090] Updated weights for policy 1, policy_version 637634 (0.0008) [2023-12-26 04:42:52,528][123090] Updated weights for policy 1, policy_version 637644 (0.0006) [2023-12-26 04:42:52,528][123091] Updated weights for policy 0, policy_version 642187 (0.0006) [2023-12-26 04:42:52,595][123090] Updated weights for policy 1, policy_version 637654 (0.0005) [2023-12-26 04:42:52,654][123090] Updated weights for policy 1, policy_version 637664 (0.0009) [2023-12-26 04:42:53,274][123091] Updated weights for policy 0, policy_version 642197 (0.0007) [2023-12-26 04:42:53,325][123091] Updated weights for policy 0, policy_version 642207 (0.0010) [2023-12-26 04:42:53,369][123090] Updated weights for policy 1, policy_version 637674 (0.0005) [2023-12-26 04:42:53,384][123091] Updated weights for policy 0, policy_version 642217 (0.0011) [2023-12-26 04:42:53,441][123090] Updated weights for policy 1, policy_version 637684 (0.0005) [2023-12-26 04:42:53,490][123090] Updated weights for policy 1, policy_version 637694 (0.0005) [2023-12-26 04:42:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.7). Total num frames: 327663616. Throughput: 0: 8759.5, 1: 8773.8. Samples: 327636476. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:53,785][121949] Avg episode reward: [(0, '6213.379'), (1, '5529.006')] [2023-12-26 04:42:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000642224_164413440.pth... [2023-12-26 04:42:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000637696_163250176.pth... [2023-12-26 04:42:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000636672_162988032.pth [2023-12-26 04:42:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000641168_164143104.pth [2023-12-26 04:42:54,148][123090] Updated weights for policy 1, policy_version 637704 (0.0009) [2023-12-26 04:42:54,201][123091] Updated weights for policy 0, policy_version 642227 (0.0007) [2023-12-26 04:42:54,201][123090] Updated weights for policy 1, policy_version 637714 (0.0006) [2023-12-26 04:42:54,263][123090] Updated weights for policy 1, policy_version 637724 (0.0008) [2023-12-26 04:42:54,266][123091] Updated weights for policy 0, policy_version 642237 (0.0011) [2023-12-26 04:42:54,321][123091] Updated weights for policy 0, policy_version 642247 (0.0011) [2023-12-26 04:42:55,050][123090] Updated weights for policy 1, policy_version 637734 (0.0010) [2023-12-26 04:42:55,108][123090] Updated weights for policy 1, policy_version 637745 (0.0009) [2023-12-26 04:42:55,142][123091] Updated weights for policy 0, policy_version 642257 (0.0010) [2023-12-26 04:42:55,167][123090] Updated weights for policy 1, policy_version 637755 (0.0008) [2023-12-26 04:42:55,192][123091] Updated weights for policy 0, policy_version 642267 (0.0010) [2023-12-26 04:42:55,245][123091] Updated weights for policy 0, policy_version 642277 (0.0009) [2023-12-26 04:42:55,294][123091] Updated weights for policy 0, policy_version 642287 (0.0008) [2023-12-26 04:42:55,800][123090] Updated weights for policy 1, policy_version 637765 (0.0008) [2023-12-26 04:42:55,861][123090] Updated weights for policy 1, policy_version 637775 (0.0010) [2023-12-26 04:42:55,913][123090] Updated weights for policy 1, policy_version 637786 (0.0010) [2023-12-26 04:42:56,000][123091] Updated weights for policy 0, policy_version 642297 (0.0009) [2023-12-26 04:42:56,053][123091] Updated weights for policy 0, policy_version 642307 (0.0009) [2023-12-26 04:42:56,102][123091] Updated weights for policy 0, policy_version 642317 (0.0009) [2023-12-26 04:42:56,749][123090] Updated weights for policy 1, policy_version 637796 (0.0008) [2023-12-26 04:42:56,811][123090] Updated weights for policy 1, policy_version 637806 (0.0005) [2023-12-26 04:42:56,858][123090] Updated weights for policy 1, policy_version 637816 (0.0005) [2023-12-26 04:42:56,968][123091] Updated weights for policy 0, policy_version 642327 (0.0010) [2023-12-26 04:42:57,023][123091] Updated weights for policy 0, policy_version 642337 (0.0010) [2023-12-26 04:42:57,075][123091] Updated weights for policy 0, policy_version 642347 (0.0011) [2023-12-26 04:42:57,620][123090] Updated weights for policy 1, policy_version 637826 (0.0006) [2023-12-26 04:42:57,674][123090] Updated weights for policy 1, policy_version 637836 (0.0009) [2023-12-26 04:42:57,747][123090] Updated weights for policy 1, policy_version 637846 (0.0010) [2023-12-26 04:42:57,814][123090] Updated weights for policy 1, policy_version 637856 (0.0010) [2023-12-26 04:42:57,888][123091] Updated weights for policy 0, policy_version 642357 (0.0008) [2023-12-26 04:42:57,942][123091] Updated weights for policy 0, policy_version 642367 (0.0006) [2023-12-26 04:42:57,999][123091] Updated weights for policy 0, policy_version 642377 (0.0005) [2023-12-26 04:42:58,761][123090] Updated weights for policy 1, policy_version 637866 (0.0009) [2023-12-26 04:42:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 327745536. Throughput: 0: 8829.6, 1: 8912.2. Samples: 327746532. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 04:42:58,785][121949] Avg episode reward: [(0, '6224.686'), (1, '5594.596')] [2023-12-26 04:42:58,837][123090] Updated weights for policy 1, policy_version 637876 (0.0009) [2023-12-26 04:42:58,872][123091] Updated weights for policy 0, policy_version 642387 (0.0008) [2023-12-26 04:42:58,906][123090] Updated weights for policy 1, policy_version 637886 (0.0010) [2023-12-26 04:42:58,935][123091] Updated weights for policy 0, policy_version 642397 (0.0010) [2023-12-26 04:42:59,002][123091] Updated weights for policy 0, policy_version 642407 (0.0008) [2023-12-26 04:42:59,687][123090] Updated weights for policy 1, policy_version 637896 (0.0006) [2023-12-26 04:42:59,742][123091] Updated weights for policy 0, policy_version 642417 (0.0009) [2023-12-26 04:42:59,759][123090] Updated weights for policy 1, policy_version 637906 (0.0005) [2023-12-26 04:42:59,796][123091] Updated weights for policy 0, policy_version 642427 (0.0005) [2023-12-26 04:42:59,833][123090] Updated weights for policy 1, policy_version 637916 (0.0006) [2023-12-26 04:42:59,869][123091] Updated weights for policy 0, policy_version 642437 (0.0008) [2023-12-26 04:42:59,934][123091] Updated weights for policy 0, policy_version 642447 (0.0008) [2023-12-26 04:43:00,544][123090] Updated weights for policy 1, policy_version 637926 (0.0009) [2023-12-26 04:43:00,593][123090] Updated weights for policy 1, policy_version 637936 (0.0008) [2023-12-26 04:43:00,640][123090] Updated weights for policy 1, policy_version 637947 (0.0008) [2023-12-26 04:43:00,733][123091] Updated weights for policy 0, policy_version 642457 (0.0010) [2023-12-26 04:43:00,785][123091] Updated weights for policy 0, policy_version 642467 (0.0010) [2023-12-26 04:43:00,836][123091] Updated weights for policy 0, policy_version 642477 (0.0011) [2023-12-26 04:43:01,539][123090] Updated weights for policy 1, policy_version 637957 (0.0007) [2023-12-26 04:43:01,597][123090] Updated weights for policy 1, policy_version 637967 (0.0006) [2023-12-26 04:43:01,657][123090] Updated weights for policy 1, policy_version 637977 (0.0007) [2023-12-26 04:43:01,661][123091] Updated weights for policy 0, policy_version 642487 (0.0009) [2023-12-26 04:43:01,720][123091] Updated weights for policy 0, policy_version 642497 (0.0009) [2023-12-26 04:43:01,775][123091] Updated weights for policy 0, policy_version 642507 (0.0007) [2023-12-26 04:43:02,428][123090] Updated weights for policy 1, policy_version 637987 (0.0008) [2023-12-26 04:43:02,487][123090] Updated weights for policy 1, policy_version 637997 (0.0008) [2023-12-26 04:43:02,552][123090] Updated weights for policy 1, policy_version 638007 (0.0009) [2023-12-26 04:43:02,615][123091] Updated weights for policy 0, policy_version 642517 (0.0008) [2023-12-26 04:43:02,670][123091] Updated weights for policy 0, policy_version 642527 (0.0010) [2023-12-26 04:43:02,725][123091] Updated weights for policy 0, policy_version 642537 (0.0010) [2023-12-26 04:43:03,351][123090] Updated weights for policy 1, policy_version 638017 (0.0009) [2023-12-26 04:43:03,408][123090] Updated weights for policy 1, policy_version 638027 (0.0005) [2023-12-26 04:43:03,467][123090] Updated weights for policy 1, policy_version 638037 (0.0005) [2023-12-26 04:43:03,520][123090] Updated weights for policy 1, policy_version 638047 (0.0005) [2023-12-26 04:43:03,523][123091] Updated weights for policy 0, policy_version 642547 (0.0009) [2023-12-26 04:43:03,578][123091] Updated weights for policy 0, policy_version 642557 (0.0007) [2023-12-26 04:43:03,627][123091] Updated weights for policy 0, policy_version 642568 (0.0007) [2023-12-26 04:43:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 327843840. Throughput: 0: 8884.1, 1: 8884.3. Samples: 327851216. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:03,785][121949] Avg episode reward: [(0, '6252.681'), (1, '5718.719')] [2023-12-26 04:43:04,178][123090] Updated weights for policy 1, policy_version 638057 (0.0009) [2023-12-26 04:43:04,238][123090] Updated weights for policy 1, policy_version 638067 (0.0008) [2023-12-26 04:43:04,300][123090] Updated weights for policy 1, policy_version 638077 (0.0009) [2023-12-26 04:43:04,454][123091] Updated weights for policy 0, policy_version 642578 (0.0006) [2023-12-26 04:43:04,507][123091] Updated weights for policy 0, policy_version 642588 (0.0010) [2023-12-26 04:43:04,567][123091] Updated weights for policy 0, policy_version 642598 (0.0010) [2023-12-26 04:43:04,999][123090] Updated weights for policy 1, policy_version 638087 (0.0006) [2023-12-26 04:43:05,050][123090] Updated weights for policy 1, policy_version 638097 (0.0006) [2023-12-26 04:43:05,104][123090] Updated weights for policy 1, policy_version 638107 (0.0009) [2023-12-26 04:43:05,407][123091] Updated weights for policy 0, policy_version 642609 (0.0010) [2023-12-26 04:43:05,476][123091] Updated weights for policy 0, policy_version 642619 (0.0008) [2023-12-26 04:43:05,524][123091] Updated weights for policy 0, policy_version 642629 (0.0009) [2023-12-26 04:43:05,579][123091] Updated weights for policy 0, policy_version 642639 (0.0009) [2023-12-26 04:43:05,942][123090] Updated weights for policy 1, policy_version 638117 (0.0007) [2023-12-26 04:43:06,004][123090] Updated weights for policy 1, policy_version 638127 (0.0006) [2023-12-26 04:43:06,070][123090] Updated weights for policy 1, policy_version 638137 (0.0010) [2023-12-26 04:43:06,425][123091] Updated weights for policy 0, policy_version 642649 (0.0008) [2023-12-26 04:43:06,489][123091] Updated weights for policy 0, policy_version 642659 (0.0010) [2023-12-26 04:43:06,553][123091] Updated weights for policy 0, policy_version 642669 (0.0009) [2023-12-26 04:43:06,793][123090] Updated weights for policy 1, policy_version 638147 (0.0010) [2023-12-26 04:43:06,848][123090] Updated weights for policy 1, policy_version 638157 (0.0010) [2023-12-26 04:43:06,904][123090] Updated weights for policy 1, policy_version 638167 (0.0009) [2023-12-26 04:43:07,368][123091] Updated weights for policy 0, policy_version 642679 (0.0009) [2023-12-26 04:43:07,420][123091] Updated weights for policy 0, policy_version 642689 (0.0009) [2023-12-26 04:43:07,476][123091] Updated weights for policy 0, policy_version 642699 (0.0009) [2023-12-26 04:43:07,649][123090] Updated weights for policy 1, policy_version 638177 (0.0010) [2023-12-26 04:43:07,724][123090] Updated weights for policy 1, policy_version 638187 (0.0006) [2023-12-26 04:43:07,792][123090] Updated weights for policy 1, policy_version 638197 (0.0005) [2023-12-26 04:43:07,859][123090] Updated weights for policy 1, policy_version 638207 (0.0005) [2023-12-26 04:43:08,360][123091] Updated weights for policy 0, policy_version 642709 (0.0009) [2023-12-26 04:43:08,423][123091] Updated weights for policy 0, policy_version 642719 (0.0009) [2023-12-26 04:43:08,486][123091] Updated weights for policy 0, policy_version 642729 (0.0009) [2023-12-26 04:43:08,569][123090] Updated weights for policy 1, policy_version 638217 (0.0007) [2023-12-26 04:43:08,633][123090] Updated weights for policy 1, policy_version 638227 (0.0010) [2023-12-26 04:43:08,697][123090] Updated weights for policy 1, policy_version 638237 (0.0011) [2023-12-26 04:43:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 327933952. Throughput: 0: 8868.0, 1: 8971.7. Samples: 327905948. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:08,785][121949] Avg episode reward: [(0, '6119.493'), (1, '5778.000')] [2023-12-26 04:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000642736_164544512.pth... [2023-12-26 04:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000638240_163389440.pth... [2023-12-26 04:43:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000641712_164282368.pth [2023-12-26 04:43:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000637184_163119104.pth [2023-12-26 04:43:09,333][123091] Updated weights for policy 0, policy_version 642739 (0.0009) [2023-12-26 04:43:09,405][123091] Updated weights for policy 0, policy_version 642749 (0.0009) [2023-12-26 04:43:09,469][123091] Updated weights for policy 0, policy_version 642759 (0.0009) [2023-12-26 04:43:09,542][123090] Updated weights for policy 1, policy_version 638247 (0.0010) [2023-12-26 04:43:09,607][123090] Updated weights for policy 1, policy_version 638257 (0.0011) [2023-12-26 04:43:09,673][123090] Updated weights for policy 1, policy_version 638267 (0.0010) [2023-12-26 04:43:10,294][123091] Updated weights for policy 0, policy_version 642769 (0.0007) [2023-12-26 04:43:10,362][123091] Updated weights for policy 0, policy_version 642779 (0.0006) [2023-12-26 04:43:10,431][123091] Updated weights for policy 0, policy_version 642789 (0.0006) [2023-12-26 04:43:10,497][123091] Updated weights for policy 0, policy_version 642799 (0.0007) [2023-12-26 04:43:10,500][123090] Updated weights for policy 1, policy_version 638277 (0.0011) [2023-12-26 04:43:10,559][123090] Updated weights for policy 1, policy_version 638287 (0.0010) [2023-12-26 04:43:10,615][123090] Updated weights for policy 1, policy_version 638297 (0.0010) [2023-12-26 04:43:11,312][123091] Updated weights for policy 0, policy_version 642809 (0.0008) [2023-12-26 04:43:11,385][123091] Updated weights for policy 0, policy_version 642819 (0.0008) [2023-12-26 04:43:11,445][123091] Updated weights for policy 0, policy_version 642829 (0.0008) [2023-12-26 04:43:11,502][123090] Updated weights for policy 1, policy_version 638307 (0.0010) [2023-12-26 04:43:11,575][123090] Updated weights for policy 1, policy_version 638317 (0.0008) [2023-12-26 04:43:11,646][123090] Updated weights for policy 1, policy_version 638327 (0.0011) [2023-12-26 04:43:12,257][123091] Updated weights for policy 0, policy_version 642839 (0.0010) [2023-12-26 04:43:12,329][123091] Updated weights for policy 0, policy_version 642849 (0.0011) [2023-12-26 04:43:12,397][123091] Updated weights for policy 0, policy_version 642859 (0.0011) [2023-12-26 04:43:12,458][123090] Updated weights for policy 1, policy_version 638337 (0.0010) [2023-12-26 04:43:12,520][123090] Updated weights for policy 1, policy_version 638347 (0.0008) [2023-12-26 04:43:12,579][123090] Updated weights for policy 1, policy_version 638357 (0.0009) [2023-12-26 04:43:12,646][123090] Updated weights for policy 1, policy_version 638367 (0.0009) [2023-12-26 04:43:13,167][123091] Updated weights for policy 0, policy_version 642869 (0.0008) [2023-12-26 04:43:13,221][123091] Updated weights for policy 0, policy_version 642879 (0.0005) [2023-12-26 04:43:13,276][123091] Updated weights for policy 0, policy_version 642889 (0.0005) [2023-12-26 04:43:13,365][123090] Updated weights for policy 1, policy_version 638377 (0.0007) [2023-12-26 04:43:13,409][123090] Updated weights for policy 1, policy_version 638387 (0.0008) [2023-12-26 04:43:13,464][123090] Updated weights for policy 1, policy_version 638397 (0.0007) [2023-12-26 04:43:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 328015872. Throughput: 0: 8778.3, 1: 8929.8. Samples: 328008216. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:13,785][121949] Avg episode reward: [(0, '6104.926'), (1, '5556.065')] [2023-12-26 04:43:14,095][123091] Updated weights for policy 0, policy_version 642899 (0.0008) [2023-12-26 04:43:14,098][123090] Updated weights for policy 1, policy_version 638407 (0.0007) [2023-12-26 04:43:14,158][123091] Updated weights for policy 0, policy_version 642909 (0.0011) [2023-12-26 04:43:14,158][123090] Updated weights for policy 1, policy_version 638417 (0.0006) [2023-12-26 04:43:14,214][123091] Updated weights for policy 0, policy_version 642919 (0.0011) [2023-12-26 04:43:14,218][123090] Updated weights for policy 1, policy_version 638427 (0.0009) [2023-12-26 04:43:14,985][123091] Updated weights for policy 0, policy_version 642929 (0.0010) [2023-12-26 04:43:15,062][123091] Updated weights for policy 0, policy_version 642939 (0.0006) [2023-12-26 04:43:15,105][123090] Updated weights for policy 1, policy_version 638437 (0.0009) [2023-12-26 04:43:15,126][123091] Updated weights for policy 0, policy_version 642949 (0.0009) [2023-12-26 04:43:15,166][123090] Updated weights for policy 1, policy_version 638447 (0.0009) [2023-12-26 04:43:15,194][123091] Updated weights for policy 0, policy_version 642959 (0.0008) [2023-12-26 04:43:15,233][123090] Updated weights for policy 1, policy_version 638457 (0.0009) [2023-12-26 04:43:15,870][123091] Updated weights for policy 0, policy_version 642969 (0.0005) [2023-12-26 04:43:15,938][123091] Updated weights for policy 0, policy_version 642979 (0.0005) [2023-12-26 04:43:15,991][123090] Updated weights for policy 1, policy_version 638467 (0.0008) [2023-12-26 04:43:16,002][123091] Updated weights for policy 0, policy_version 642989 (0.0009) [2023-12-26 04:43:16,054][123090] Updated weights for policy 1, policy_version 638477 (0.0006) [2023-12-26 04:43:16,113][123090] Updated weights for policy 1, policy_version 638487 (0.0008) [2023-12-26 04:43:16,766][123091] Updated weights for policy 0, policy_version 642999 (0.0010) [2023-12-26 04:43:16,788][123090] Updated weights for policy 1, policy_version 638497 (0.0009) [2023-12-26 04:43:16,825][123091] Updated weights for policy 0, policy_version 643009 (0.0010) [2023-12-26 04:43:16,842][123090] Updated weights for policy 1, policy_version 638507 (0.0010) [2023-12-26 04:43:16,894][123091] Updated weights for policy 0, policy_version 643019 (0.0011) [2023-12-26 04:43:16,908][123090] Updated weights for policy 1, policy_version 638517 (0.0005) [2023-12-26 04:43:16,971][123090] Updated weights for policy 1, policy_version 638527 (0.0005) [2023-12-26 04:43:17,616][123091] Updated weights for policy 0, policy_version 643029 (0.0010) [2023-12-26 04:43:17,666][123091] Updated weights for policy 0, policy_version 643039 (0.0009) [2023-12-26 04:43:17,694][123090] Updated weights for policy 1, policy_version 638537 (0.0005) [2023-12-26 04:43:17,720][123091] Updated weights for policy 0, policy_version 643049 (0.0009) [2023-12-26 04:43:17,767][123090] Updated weights for policy 1, policy_version 638547 (0.0005) [2023-12-26 04:43:17,846][123090] Updated weights for policy 1, policy_version 638557 (0.0005) [2023-12-26 04:43:18,518][123090] Updated weights for policy 1, policy_version 638567 (0.0009) [2023-12-26 04:43:18,570][123090] Updated weights for policy 1, policy_version 638577 (0.0010) [2023-12-26 04:43:18,602][123091] Updated weights for policy 0, policy_version 643059 (0.0008) [2023-12-26 04:43:18,627][123090] Updated weights for policy 1, policy_version 638587 (0.0010) [2023-12-26 04:43:18,673][123091] Updated weights for policy 0, policy_version 643069 (0.0006) [2023-12-26 04:43:18,740][123091] Updated weights for policy 0, policy_version 643079 (0.0008) [2023-12-26 04:43:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 328105984. Throughput: 0: 8824.6, 1: 8990.0. Samples: 328119760. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:18,785][121949] Avg episode reward: [(0, '6081.459'), (1, '5473.689')] [2023-12-26 04:43:19,378][123090] Updated weights for policy 1, policy_version 638597 (0.0009) [2023-12-26 04:43:19,395][123091] Updated weights for policy 0, policy_version 643089 (0.0006) [2023-12-26 04:43:19,434][123090] Updated weights for policy 1, policy_version 638607 (0.0010) [2023-12-26 04:43:19,447][123091] Updated weights for policy 0, policy_version 643099 (0.0010) [2023-12-26 04:43:19,496][123090] Updated weights for policy 1, policy_version 638617 (0.0009) [2023-12-26 04:43:19,513][123091] Updated weights for policy 0, policy_version 643109 (0.0011) [2023-12-26 04:43:19,573][123091] Updated weights for policy 0, policy_version 643119 (0.0010) [2023-12-26 04:43:20,297][123090] Updated weights for policy 1, policy_version 638627 (0.0008) [2023-12-26 04:43:20,357][123090] Updated weights for policy 1, policy_version 638637 (0.0010) [2023-12-26 04:43:20,421][123090] Updated weights for policy 1, policy_version 638647 (0.0010) [2023-12-26 04:43:20,440][123091] Updated weights for policy 0, policy_version 643129 (0.0007) [2023-12-26 04:43:20,504][123091] Updated weights for policy 0, policy_version 643139 (0.0007) [2023-12-26 04:43:20,561][123091] Updated weights for policy 0, policy_version 643149 (0.0009) [2023-12-26 04:43:21,305][123091] Updated weights for policy 0, policy_version 643159 (0.0012) [2023-12-26 04:43:21,321][123090] Updated weights for policy 1, policy_version 638657 (0.0010) [2023-12-26 04:43:21,379][123091] Updated weights for policy 0, policy_version 643169 (0.0010) [2023-12-26 04:43:21,387][123090] Updated weights for policy 1, policy_version 638667 (0.0010) [2023-12-26 04:43:21,444][123091] Updated weights for policy 0, policy_version 643179 (0.0010) [2023-12-26 04:43:21,454][123090] Updated weights for policy 1, policy_version 638677 (0.0008) [2023-12-26 04:43:21,521][123090] Updated weights for policy 1, policy_version 638687 (0.0008) [2023-12-26 04:43:22,221][123091] Updated weights for policy 0, policy_version 643189 (0.0008) [2023-12-26 04:43:22,249][123090] Updated weights for policy 1, policy_version 638697 (0.0006) [2023-12-26 04:43:22,295][123091] Updated weights for policy 0, policy_version 643199 (0.0008) [2023-12-26 04:43:22,310][123090] Updated weights for policy 1, policy_version 638707 (0.0008) [2023-12-26 04:43:22,370][123091] Updated weights for policy 0, policy_version 643209 (0.0008) [2023-12-26 04:43:22,384][123090] Updated weights for policy 1, policy_version 638717 (0.0009) [2023-12-26 04:43:23,150][123090] Updated weights for policy 1, policy_version 638727 (0.0006) [2023-12-26 04:43:23,193][123091] Updated weights for policy 0, policy_version 643219 (0.0008) [2023-12-26 04:43:23,218][123090] Updated weights for policy 1, policy_version 638737 (0.0007) [2023-12-26 04:43:23,261][123091] Updated weights for policy 0, policy_version 643229 (0.0007) [2023-12-26 04:43:23,288][123090] Updated weights for policy 1, policy_version 638747 (0.0010) [2023-12-26 04:43:23,327][123091] Updated weights for policy 0, policy_version 643239 (0.0007) [2023-12-26 04:43:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 328196096. Throughput: 0: 8788.4, 1: 8962.0. Samples: 328172460. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:23,785][121949] Avg episode reward: [(0, '6107.625'), (1, '5723.754')] [2023-12-26 04:43:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000643248_164675584.pth... [2023-12-26 04:43:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000638752_163520512.pth... [2023-12-26 04:43:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000642224_164413440.pth [2023-12-26 04:43:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000637696_163250176.pth [2023-12-26 04:43:23,927][123091] Updated weights for policy 0, policy_version 643249 (0.0005) [2023-12-26 04:43:23,988][123091] Updated weights for policy 0, policy_version 643259 (0.0005) [2023-12-26 04:43:24,062][123091] Updated weights for policy 0, policy_version 643269 (0.0005) [2023-12-26 04:43:24,103][123090] Updated weights for policy 1, policy_version 638757 (0.0009) [2023-12-26 04:43:24,124][123091] Updated weights for policy 0, policy_version 643279 (0.0009) [2023-12-26 04:43:24,158][123090] Updated weights for policy 1, policy_version 638767 (0.0008) [2023-12-26 04:43:24,223][123090] Updated weights for policy 1, policy_version 638777 (0.0008) [2023-12-26 04:43:24,790][123091] Updated weights for policy 0, policy_version 643290 (0.0010) [2023-12-26 04:43:24,844][123091] Updated weights for policy 0, policy_version 643301 (0.0010) [2023-12-26 04:43:24,896][123091] Updated weights for policy 0, policy_version 643311 (0.0010) [2023-12-26 04:43:24,910][123090] Updated weights for policy 1, policy_version 638787 (0.0005) [2023-12-26 04:43:24,957][123090] Updated weights for policy 1, policy_version 638797 (0.0005) [2023-12-26 04:43:25,005][123090] Updated weights for policy 1, policy_version 638807 (0.0005) [2023-12-26 04:43:25,666][123090] Updated weights for policy 1, policy_version 638817 (0.0005) [2023-12-26 04:43:25,734][123090] Updated weights for policy 1, policy_version 638827 (0.0008) [2023-12-26 04:43:25,771][123091] Updated weights for policy 0, policy_version 643321 (0.0006) [2023-12-26 04:43:25,802][123090] Updated weights for policy 1, policy_version 638837 (0.0011) [2023-12-26 04:43:25,822][123091] Updated weights for policy 0, policy_version 643331 (0.0008) [2023-12-26 04:43:25,865][123090] Updated weights for policy 1, policy_version 638847 (0.0010) [2023-12-26 04:43:25,883][123091] Updated weights for policy 0, policy_version 643341 (0.0009) [2023-12-26 04:43:26,647][123090] Updated weights for policy 1, policy_version 638857 (0.0006) [2023-12-26 04:43:26,696][123090] Updated weights for policy 1, policy_version 638867 (0.0005) [2023-12-26 04:43:26,732][123091] Updated weights for policy 0, policy_version 643351 (0.0009) [2023-12-26 04:43:26,755][123090] Updated weights for policy 1, policy_version 638877 (0.0005) [2023-12-26 04:43:26,782][123091] Updated weights for policy 0, policy_version 643361 (0.0009) [2023-12-26 04:43:26,847][123091] Updated weights for policy 0, policy_version 643371 (0.0009) [2023-12-26 04:43:27,486][123090] Updated weights for policy 1, policy_version 638887 (0.0005) [2023-12-26 04:43:27,550][123090] Updated weights for policy 1, policy_version 638897 (0.0005) [2023-12-26 04:43:27,600][123090] Updated weights for policy 1, policy_version 638907 (0.0005) [2023-12-26 04:43:27,667][123091] Updated weights for policy 0, policy_version 643381 (0.0008) [2023-12-26 04:43:27,721][123091] Updated weights for policy 0, policy_version 643391 (0.0006) [2023-12-26 04:43:27,779][123091] Updated weights for policy 0, policy_version 643401 (0.0006) [2023-12-26 04:43:28,213][123090] Updated weights for policy 1, policy_version 638917 (0.0008) [2023-12-26 04:43:28,266][123090] Updated weights for policy 1, policy_version 638927 (0.0010) [2023-12-26 04:43:28,317][123090] Updated weights for policy 1, policy_version 638937 (0.0010) [2023-12-26 04:43:28,501][123091] Updated weights for policy 0, policy_version 643411 (0.0007) [2023-12-26 04:43:28,566][123091] Updated weights for policy 0, policy_version 643421 (0.0009) [2023-12-26 04:43:28,630][123091] Updated weights for policy 0, policy_version 643431 (0.0009) [2023-12-26 04:43:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 328294400. Throughput: 0: 8852.2, 1: 9114.4. Samples: 328283872. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:28,785][121949] Avg episode reward: [(0, '6112.192'), (1, '5679.944')] [2023-12-26 04:43:29,222][123090] Updated weights for policy 1, policy_version 638947 (0.0011) [2023-12-26 04:43:29,295][123090] Updated weights for policy 1, policy_version 638957 (0.0011) [2023-12-26 04:43:29,362][123090] Updated weights for policy 1, policy_version 638967 (0.0011) [2023-12-26 04:43:29,461][123091] Updated weights for policy 0, policy_version 643441 (0.0009) [2023-12-26 04:43:29,527][123091] Updated weights for policy 0, policy_version 643451 (0.0009) [2023-12-26 04:43:29,597][123091] Updated weights for policy 0, policy_version 643461 (0.0009) [2023-12-26 04:43:29,666][123091] Updated weights for policy 0, policy_version 643471 (0.0009) [2023-12-26 04:43:30,165][123090] Updated weights for policy 1, policy_version 638977 (0.0008) [2023-12-26 04:43:30,230][123090] Updated weights for policy 1, policy_version 638987 (0.0009) [2023-12-26 04:43:30,304][123090] Updated weights for policy 1, policy_version 638997 (0.0010) [2023-12-26 04:43:30,375][123090] Updated weights for policy 1, policy_version 639007 (0.0009) [2023-12-26 04:43:30,447][123091] Updated weights for policy 0, policy_version 643481 (0.0006) [2023-12-26 04:43:30,497][123091] Updated weights for policy 0, policy_version 643491 (0.0005) [2023-12-26 04:43:30,546][123091] Updated weights for policy 0, policy_version 643501 (0.0005) [2023-12-26 04:43:31,192][123090] Updated weights for policy 1, policy_version 639017 (0.0010) [2023-12-26 04:43:31,248][123090] Updated weights for policy 1, policy_version 639027 (0.0009) [2023-12-26 04:43:31,304][123090] Updated weights for policy 1, policy_version 639037 (0.0009) [2023-12-26 04:43:31,319][123091] Updated weights for policy 0, policy_version 643511 (0.0009) [2023-12-26 04:43:31,384][123091] Updated weights for policy 0, policy_version 643521 (0.0008) [2023-12-26 04:43:31,443][123091] Updated weights for policy 0, policy_version 643531 (0.0006) [2023-12-26 04:43:32,128][123090] Updated weights for policy 1, policy_version 639047 (0.0008) [2023-12-26 04:43:32,190][123090] Updated weights for policy 1, policy_version 639057 (0.0009) [2023-12-26 04:43:32,246][123090] Updated weights for policy 1, policy_version 639067 (0.0009) [2023-12-26 04:43:32,294][123091] Updated weights for policy 0, policy_version 643541 (0.0008) [2023-12-26 04:43:32,363][123091] Updated weights for policy 0, policy_version 643551 (0.0009) [2023-12-26 04:43:32,427][123091] Updated weights for policy 0, policy_version 643561 (0.0010) [2023-12-26 04:43:33,108][123091] Updated weights for policy 0, policy_version 643571 (0.0008) [2023-12-26 04:43:33,116][123090] Updated weights for policy 1, policy_version 639077 (0.0010) [2023-12-26 04:43:33,164][123091] Updated weights for policy 0, policy_version 643581 (0.0006) [2023-12-26 04:43:33,185][123090] Updated weights for policy 1, policy_version 639087 (0.0010) [2023-12-26 04:43:33,241][123091] Updated weights for policy 0, policy_version 643591 (0.0006) [2023-12-26 04:43:33,265][123090] Updated weights for policy 1, policy_version 639097 (0.0007) [2023-12-26 04:43:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 328376320. Throughput: 0: 8881.1, 1: 9054.9. Samples: 328391200. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:33,785][121949] Avg episode reward: [(0, '6093.605'), (1, '5356.873')] [2023-12-26 04:43:33,891][123091] Updated weights for policy 0, policy_version 643601 (0.0005) [2023-12-26 04:43:33,934][123090] Updated weights for policy 1, policy_version 639107 (0.0005) [2023-12-26 04:43:33,946][123091] Updated weights for policy 0, policy_version 643611 (0.0006) [2023-12-26 04:43:33,988][123090] Updated weights for policy 1, policy_version 639117 (0.0008) [2023-12-26 04:43:33,995][123091] Updated weights for policy 0, policy_version 643621 (0.0005) [2023-12-26 04:43:34,044][123091] Updated weights for policy 0, policy_version 643631 (0.0006) [2023-12-26 04:43:34,045][123090] Updated weights for policy 1, policy_version 639127 (0.0006) [2023-12-26 04:43:34,740][123090] Updated weights for policy 1, policy_version 639137 (0.0006) [2023-12-26 04:43:34,794][123091] Updated weights for policy 0, policy_version 643641 (0.0008) [2023-12-26 04:43:34,812][123090] Updated weights for policy 1, policy_version 639147 (0.0006) [2023-12-26 04:43:34,858][123091] Updated weights for policy 0, policy_version 643651 (0.0009) [2023-12-26 04:43:34,877][123090] Updated weights for policy 1, policy_version 639157 (0.0007) [2023-12-26 04:43:34,914][123091] Updated weights for policy 0, policy_version 643661 (0.0006) [2023-12-26 04:43:34,938][123090] Updated weights for policy 1, policy_version 639167 (0.0007) [2023-12-26 04:43:35,568][123090] Updated weights for policy 1, policy_version 639177 (0.0005) [2023-12-26 04:43:35,633][123090] Updated weights for policy 1, policy_version 639187 (0.0005) [2023-12-26 04:43:35,666][123091] Updated weights for policy 0, policy_version 643671 (0.0008) [2023-12-26 04:43:35,696][123090] Updated weights for policy 1, policy_version 639197 (0.0006) [2023-12-26 04:43:35,722][123091] Updated weights for policy 0, policy_version 643681 (0.0008) [2023-12-26 04:43:35,778][123091] Updated weights for policy 0, policy_version 643691 (0.0010) [2023-12-26 04:43:36,485][123090] Updated weights for policy 1, policy_version 639207 (0.0006) [2023-12-26 04:43:36,554][123090] Updated weights for policy 1, policy_version 639217 (0.0005) [2023-12-26 04:43:36,584][123091] Updated weights for policy 0, policy_version 643701 (0.0009) [2023-12-26 04:43:36,616][123090] Updated weights for policy 1, policy_version 639227 (0.0005) [2023-12-26 04:43:36,636][123091] Updated weights for policy 0, policy_version 643712 (0.0010) [2023-12-26 04:43:36,690][123091] Updated weights for policy 0, policy_version 643722 (0.0010) [2023-12-26 04:43:37,390][123090] Updated weights for policy 1, policy_version 639237 (0.0005) [2023-12-26 04:43:37,456][123090] Updated weights for policy 1, policy_version 639247 (0.0006) [2023-12-26 04:43:37,520][123090] Updated weights for policy 1, policy_version 639257 (0.0005) [2023-12-26 04:43:37,578][123091] Updated weights for policy 0, policy_version 643733 (0.0010) [2023-12-26 04:43:37,632][123091] Updated weights for policy 0, policy_version 643745 (0.0010) [2023-12-26 04:43:37,681][123091] Updated weights for policy 0, policy_version 643755 (0.0008) [2023-12-26 04:43:38,165][123090] Updated weights for policy 1, policy_version 639267 (0.0005) [2023-12-26 04:43:38,213][123090] Updated weights for policy 1, policy_version 639277 (0.0005) [2023-12-26 04:43:38,305][123090] Updated weights for policy 1, policy_version 639287 (0.0006) [2023-12-26 04:43:38,482][123091] Updated weights for policy 0, policy_version 643765 (0.0006) [2023-12-26 04:43:38,552][123091] Updated weights for policy 0, policy_version 643775 (0.0005) [2023-12-26 04:43:38,619][123091] Updated weights for policy 0, policy_version 643785 (0.0007) [2023-12-26 04:43:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 328474624. Throughput: 0: 8909.8, 1: 9133.9. Samples: 328448444. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:38,785][121949] Avg episode reward: [(0, '6158.439'), (1, '5262.986')] [2023-12-26 04:43:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000643792_164814848.pth... [2023-12-26 04:43:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000639296_163659776.pth... [2023-12-26 04:43:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000642736_164544512.pth [2023-12-26 04:43:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000638240_163389440.pth [2023-12-26 04:43:39,035][123090] Updated weights for policy 1, policy_version 639297 (0.0009) [2023-12-26 04:43:39,097][123090] Updated weights for policy 1, policy_version 639307 (0.0006) [2023-12-26 04:43:39,158][123090] Updated weights for policy 1, policy_version 639317 (0.0005) [2023-12-26 04:43:39,220][123090] Updated weights for policy 1, policy_version 639327 (0.0006) [2023-12-26 04:43:39,368][123091] Updated weights for policy 0, policy_version 643795 (0.0009) [2023-12-26 04:43:39,438][123091] Updated weights for policy 0, policy_version 643805 (0.0008) [2023-12-26 04:43:39,505][123091] Updated weights for policy 0, policy_version 643815 (0.0009) [2023-12-26 04:43:40,010][123090] Updated weights for policy 1, policy_version 639337 (0.0010) [2023-12-26 04:43:40,063][123090] Updated weights for policy 1, policy_version 639347 (0.0010) [2023-12-26 04:43:40,112][123090] Updated weights for policy 1, policy_version 639357 (0.0010) [2023-12-26 04:43:40,317][123091] Updated weights for policy 0, policy_version 643825 (0.0009) [2023-12-26 04:43:40,390][123091] Updated weights for policy 0, policy_version 643835 (0.0010) [2023-12-26 04:43:40,452][123091] Updated weights for policy 0, policy_version 643845 (0.0009) [2023-12-26 04:43:40,501][123091] Updated weights for policy 0, policy_version 643855 (0.0009) [2023-12-26 04:43:40,953][123090] Updated weights for policy 1, policy_version 639367 (0.0010) [2023-12-26 04:43:41,015][123090] Updated weights for policy 1, policy_version 639377 (0.0010) [2023-12-26 04:43:41,078][123090] Updated weights for policy 1, policy_version 639387 (0.0007) [2023-12-26 04:43:41,401][123091] Updated weights for policy 0, policy_version 643865 (0.0009) [2023-12-26 04:43:41,455][123091] Updated weights for policy 0, policy_version 643875 (0.0009) [2023-12-26 04:43:41,513][123091] Updated weights for policy 0, policy_version 643885 (0.0010) [2023-12-26 04:43:41,898][123090] Updated weights for policy 1, policy_version 639397 (0.0008) [2023-12-26 04:43:41,948][123090] Updated weights for policy 1, policy_version 639407 (0.0009) [2023-12-26 04:43:42,016][123090] Updated weights for policy 1, policy_version 639417 (0.0006) [2023-12-26 04:43:42,408][123091] Updated weights for policy 0, policy_version 643895 (0.0008) [2023-12-26 04:43:42,477][123091] Updated weights for policy 0, policy_version 643905 (0.0010) [2023-12-26 04:43:42,539][123091] Updated weights for policy 0, policy_version 643915 (0.0010) [2023-12-26 04:43:42,774][123090] Updated weights for policy 1, policy_version 639427 (0.0007) [2023-12-26 04:43:42,846][123090] Updated weights for policy 1, policy_version 639437 (0.0009) [2023-12-26 04:43:42,914][123090] Updated weights for policy 1, policy_version 639447 (0.0009) [2023-12-26 04:43:43,389][123091] Updated weights for policy 0, policy_version 643925 (0.0009) [2023-12-26 04:43:43,445][123091] Updated weights for policy 0, policy_version 643935 (0.0009) [2023-12-26 04:43:43,516][123091] Updated weights for policy 0, policy_version 643945 (0.0010) [2023-12-26 04:43:43,701][123090] Updated weights for policy 1, policy_version 639457 (0.0009) [2023-12-26 04:43:43,756][123090] Updated weights for policy 1, policy_version 639467 (0.0009) [2023-12-26 04:43:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 328556544. Throughput: 0: 8850.6, 1: 9079.2. Samples: 328553372. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:43,785][121949] Avg episode reward: [(0, '6082.220'), (1, '5484.822')] [2023-12-26 04:43:43,822][123090] Updated weights for policy 1, policy_version 639477 (0.0008) [2023-12-26 04:43:43,889][123090] Updated weights for policy 1, policy_version 639487 (0.0009) [2023-12-26 04:43:44,265][123091] Updated weights for policy 0, policy_version 643955 (0.0010) [2023-12-26 04:43:44,331][123091] Updated weights for policy 0, policy_version 643965 (0.0010) [2023-12-26 04:43:44,400][123091] Updated weights for policy 0, policy_version 643975 (0.0010) [2023-12-26 04:43:44,676][123090] Updated weights for policy 1, policy_version 639497 (0.0008) [2023-12-26 04:43:44,750][123090] Updated weights for policy 1, policy_version 639507 (0.0007) [2023-12-26 04:43:44,819][123090] Updated weights for policy 1, policy_version 639517 (0.0011) [2023-12-26 04:43:45,227][123091] Updated weights for policy 0, policy_version 643986 (0.0010) [2023-12-26 04:43:45,280][123091] Updated weights for policy 0, policy_version 643996 (0.0009) [2023-12-26 04:43:45,333][123091] Updated weights for policy 0, policy_version 644006 (0.0009) [2023-12-26 04:43:45,382][123091] Updated weights for policy 0, policy_version 644016 (0.0009) [2023-12-26 04:43:45,620][123090] Updated weights for policy 1, policy_version 639527 (0.0008) [2023-12-26 04:43:45,695][123090] Updated weights for policy 1, policy_version 639537 (0.0008) [2023-12-26 04:43:45,751][123090] Updated weights for policy 1, policy_version 639547 (0.0010) [2023-12-26 04:43:46,279][123091] Updated weights for policy 0, policy_version 644026 (0.0010) [2023-12-26 04:43:46,332][123091] Updated weights for policy 0, policy_version 644037 (0.0010) [2023-12-26 04:43:46,439][123090] Updated weights for policy 1, policy_version 639557 (0.0008) [2023-12-26 04:43:46,505][123090] Updated weights for policy 1, policy_version 639567 (0.0007) [2023-12-26 04:43:46,566][123090] Updated weights for policy 1, policy_version 639577 (0.0008) [2023-12-26 04:43:47,153][123091] Updated weights for policy 0, policy_version 644049 (0.0010) [2023-12-26 04:43:47,206][123091] Updated weights for policy 0, policy_version 644059 (0.0009) [2023-12-26 04:43:47,258][123091] Updated weights for policy 0, policy_version 644069 (0.0009) [2023-12-26 04:43:47,308][123090] Updated weights for policy 1, policy_version 639587 (0.0007) [2023-12-26 04:43:47,312][123091] Updated weights for policy 0, policy_version 644079 (0.0008) [2023-12-26 04:43:47,360][123090] Updated weights for policy 1, policy_version 639597 (0.0009) [2023-12-26 04:43:47,412][123090] Updated weights for policy 1, policy_version 639607 (0.0009) [2023-12-26 04:43:48,116][123091] Updated weights for policy 0, policy_version 644089 (0.0010) [2023-12-26 04:43:48,139][123090] Updated weights for policy 1, policy_version 639617 (0.0008) [2023-12-26 04:43:48,171][123091] Updated weights for policy 0, policy_version 644099 (0.0010) [2023-12-26 04:43:48,202][123090] Updated weights for policy 1, policy_version 639627 (0.0005) [2023-12-26 04:43:48,219][123091] Updated weights for policy 0, policy_version 644109 (0.0010) [2023-12-26 04:43:48,264][123090] Updated weights for policy 1, policy_version 639637 (0.0005) [2023-12-26 04:43:48,329][123090] Updated weights for policy 1, policy_version 639647 (0.0006) [2023-12-26 04:43:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 328646656. Throughput: 0: 8831.5, 1: 9157.1. Samples: 328660700. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:48,785][121949] Avg episode reward: [(0, '6088.728'), (1, '5468.736')] [2023-12-26 04:43:49,045][123090] Updated weights for policy 1, policy_version 639657 (0.0009) [2023-12-26 04:43:49,090][123091] Updated weights for policy 0, policy_version 644119 (0.0011) [2023-12-26 04:43:49,098][123090] Updated weights for policy 1, policy_version 639667 (0.0008) [2023-12-26 04:43:49,149][123091] Updated weights for policy 0, policy_version 644129 (0.0010) [2023-12-26 04:43:49,156][123090] Updated weights for policy 1, policy_version 639677 (0.0008) [2023-12-26 04:43:49,204][123091] Updated weights for policy 0, policy_version 644139 (0.0010) [2023-12-26 04:43:49,992][123090] Updated weights for policy 1, policy_version 639687 (0.0009) [2023-12-26 04:43:50,056][123090] Updated weights for policy 1, policy_version 639697 (0.0008) [2023-12-26 04:43:50,057][123091] Updated weights for policy 0, policy_version 644149 (0.0010) [2023-12-26 04:43:50,103][123091] Updated weights for policy 0, policy_version 644159 (0.0009) [2023-12-26 04:43:50,122][123090] Updated weights for policy 1, policy_version 639707 (0.0007) [2023-12-26 04:43:50,157][123091] Updated weights for policy 0, policy_version 644169 (0.0007) [2023-12-26 04:43:50,821][123090] Updated weights for policy 1, policy_version 639717 (0.0007) [2023-12-26 04:43:50,894][123090] Updated weights for policy 1, policy_version 639727 (0.0007) [2023-12-26 04:43:50,966][123090] Updated weights for policy 1, policy_version 639737 (0.0006) [2023-12-26 04:43:51,099][123091] Updated weights for policy 0, policy_version 644179 (0.0009) [2023-12-26 04:43:51,171][123091] Updated weights for policy 0, policy_version 644189 (0.0008) [2023-12-26 04:43:51,235][123091] Updated weights for policy 0, policy_version 644199 (0.0008) [2023-12-26 04:43:51,728][123090] Updated weights for policy 1, policy_version 639747 (0.0007) [2023-12-26 04:43:51,797][123090] Updated weights for policy 1, policy_version 639757 (0.0007) [2023-12-26 04:43:51,874][123090] Updated weights for policy 1, policy_version 639767 (0.0006) [2023-12-26 04:43:51,990][123091] Updated weights for policy 0, policy_version 644209 (0.0009) [2023-12-26 04:43:52,059][123091] Updated weights for policy 0, policy_version 644219 (0.0005) [2023-12-26 04:43:52,130][123091] Updated weights for policy 0, policy_version 644229 (0.0006) [2023-12-26 04:43:52,198][123091] Updated weights for policy 0, policy_version 644239 (0.0006) [2023-12-26 04:43:52,623][123090] Updated weights for policy 1, policy_version 639777 (0.0006) [2023-12-26 04:43:52,679][123090] Updated weights for policy 1, policy_version 639787 (0.0010) [2023-12-26 04:43:52,727][123090] Updated weights for policy 1, policy_version 639797 (0.0009) [2023-12-26 04:43:52,779][123090] Updated weights for policy 1, policy_version 639807 (0.0010) [2023-12-26 04:43:52,947][123091] Updated weights for policy 0, policy_version 644249 (0.0011) [2023-12-26 04:43:53,010][123091] Updated weights for policy 0, policy_version 644259 (0.0011) [2023-12-26 04:43:53,074][123091] Updated weights for policy 0, policy_version 644269 (0.0011) [2023-12-26 04:43:53,581][123090] Updated weights for policy 1, policy_version 639817 (0.0010) [2023-12-26 04:43:53,635][123090] Updated weights for policy 1, policy_version 639827 (0.0010) [2023-12-26 04:43:53,689][123090] Updated weights for policy 1, policy_version 639837 (0.0010) [2023-12-26 04:43:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 328736768. Throughput: 0: 8812.0, 1: 9108.1. Samples: 328712356. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:53,785][121949] Avg episode reward: [(0, '6189.768'), (1, '5483.375')] [2023-12-26 04:43:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000639840_163799040.pth... [2023-12-26 04:43:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000638752_163520512.pth [2023-12-26 04:43:53,814][123091] Updated weights for policy 0, policy_version 644279 (0.0009) [2023-12-26 04:43:53,873][123091] Updated weights for policy 0, policy_version 644289 (0.0010) [2023-12-26 04:43:53,931][123091] Updated weights for policy 0, policy_version 644299 (0.0009) [2023-12-26 04:43:53,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000644304_164945920.pth... [2023-12-26 04:43:53,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000643248_164675584.pth [2023-12-26 04:43:54,501][123090] Updated weights for policy 1, policy_version 639848 (0.0007) [2023-12-26 04:43:54,570][123090] Updated weights for policy 1, policy_version 639858 (0.0005) [2023-12-26 04:43:54,625][123091] Updated weights for policy 0, policy_version 644309 (0.0008) [2023-12-26 04:43:54,629][123090] Updated weights for policy 1, policy_version 639868 (0.0005) [2023-12-26 04:43:54,684][123091] Updated weights for policy 0, policy_version 644319 (0.0011) [2023-12-26 04:43:54,746][123091] Updated weights for policy 0, policy_version 644329 (0.0011) [2023-12-26 04:43:55,301][123090] Updated weights for policy 1, policy_version 639878 (0.0008) [2023-12-26 04:43:55,361][123090] Updated weights for policy 1, policy_version 639888 (0.0006) [2023-12-26 04:43:55,430][123090] Updated weights for policy 1, policy_version 639898 (0.0008) [2023-12-26 04:43:55,521][123091] Updated weights for policy 0, policy_version 644339 (0.0009) [2023-12-26 04:43:55,568][123091] Updated weights for policy 0, policy_version 644349 (0.0005) [2023-12-26 04:43:55,617][123091] Updated weights for policy 0, policy_version 644359 (0.0005) [2023-12-26 04:43:56,074][123090] Updated weights for policy 1, policy_version 639908 (0.0008) [2023-12-26 04:43:56,144][123090] Updated weights for policy 1, policy_version 639918 (0.0008) [2023-12-26 04:43:56,208][123090] Updated weights for policy 1, policy_version 639928 (0.0008) [2023-12-26 04:43:56,313][123091] Updated weights for policy 0, policy_version 644369 (0.0006) [2023-12-26 04:43:56,386][123091] Updated weights for policy 0, policy_version 644379 (0.0006) [2023-12-26 04:43:56,458][123091] Updated weights for policy 0, policy_version 644389 (0.0006) [2023-12-26 04:43:56,512][123091] Updated weights for policy 0, policy_version 644399 (0.0006) [2023-12-26 04:43:56,856][123090] Updated weights for policy 1, policy_version 639938 (0.0007) [2023-12-26 04:43:56,908][123090] Updated weights for policy 1, policy_version 639948 (0.0005) [2023-12-26 04:43:56,969][123090] Updated weights for policy 1, policy_version 639958 (0.0005) [2023-12-26 04:43:57,025][123090] Updated weights for policy 1, policy_version 639968 (0.0005) [2023-12-26 04:43:57,243][123091] Updated weights for policy 0, policy_version 644409 (0.0010) [2023-12-26 04:43:57,290][123091] Updated weights for policy 0, policy_version 644419 (0.0010) [2023-12-26 04:43:57,358][123091] Updated weights for policy 0, policy_version 644429 (0.0006) [2023-12-26 04:43:57,664][123090] Updated weights for policy 1, policy_version 639978 (0.0005) [2023-12-26 04:43:57,717][123090] Updated weights for policy 1, policy_version 639988 (0.0007) [2023-12-26 04:43:57,775][123090] Updated weights for policy 1, policy_version 639998 (0.0010) [2023-12-26 04:43:57,984][123091] Updated weights for policy 0, policy_version 644439 (0.0005) [2023-12-26 04:43:58,051][123091] Updated weights for policy 0, policy_version 644449 (0.0007) [2023-12-26 04:43:58,116][123091] Updated weights for policy 0, policy_version 644459 (0.0008) [2023-12-26 04:43:58,557][123090] Updated weights for policy 1, policy_version 640008 (0.0008) [2023-12-26 04:43:58,634][123090] Updated weights for policy 1, policy_version 640018 (0.0010) [2023-12-26 04:43:58,705][123090] Updated weights for policy 1, policy_version 640028 (0.0008) [2023-12-26 04:43:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18159.0, 300 sec: 17716.9). Total num frames: 328835072. Throughput: 0: 8941.3, 1: 9257.3. Samples: 328827156. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:43:58,785][121949] Avg episode reward: [(0, '6264.817'), (1, '5574.553')] [2023-12-26 04:43:58,985][123091] Updated weights for policy 0, policy_version 644469 (0.0009) [2023-12-26 04:43:59,048][123091] Updated weights for policy 0, policy_version 644479 (0.0009) [2023-12-26 04:43:59,117][123091] Updated weights for policy 0, policy_version 644489 (0.0009) [2023-12-26 04:43:59,563][123090] Updated weights for policy 1, policy_version 640038 (0.0010) [2023-12-26 04:43:59,619][123090] Updated weights for policy 1, policy_version 640048 (0.0010) [2023-12-26 04:43:59,679][123090] Updated weights for policy 1, policy_version 640058 (0.0011) [2023-12-26 04:44:00,005][123091] Updated weights for policy 0, policy_version 644499 (0.0009) [2023-12-26 04:44:00,069][123091] Updated weights for policy 0, policy_version 644509 (0.0011) [2023-12-26 04:44:00,145][123091] Updated weights for policy 0, policy_version 644519 (0.0010) [2023-12-26 04:44:00,533][123090] Updated weights for policy 1, policy_version 640068 (0.0011) [2023-12-26 04:44:00,607][123090] Updated weights for policy 1, policy_version 640078 (0.0011) [2023-12-26 04:44:00,675][123090] Updated weights for policy 1, policy_version 640088 (0.0011) [2023-12-26 04:44:00,900][123091] Updated weights for policy 0, policy_version 644529 (0.0010) [2023-12-26 04:44:00,949][123091] Updated weights for policy 0, policy_version 644539 (0.0006) [2023-12-26 04:44:01,006][123091] Updated weights for policy 0, policy_version 644549 (0.0008) [2023-12-26 04:44:01,080][123091] Updated weights for policy 0, policy_version 644559 (0.0009) [2023-12-26 04:44:01,476][123090] Updated weights for policy 1, policy_version 640098 (0.0010) [2023-12-26 04:44:01,542][123090] Updated weights for policy 1, policy_version 640108 (0.0008) [2023-12-26 04:44:01,593][123090] Updated weights for policy 1, policy_version 640118 (0.0008) [2023-12-26 04:44:01,660][123090] Updated weights for policy 1, policy_version 640128 (0.0010) [2023-12-26 04:44:01,896][123091] Updated weights for policy 0, policy_version 644569 (0.0009) [2023-12-26 04:44:01,958][123091] Updated weights for policy 0, policy_version 644579 (0.0009) [2023-12-26 04:44:02,008][123091] Updated weights for policy 0, policy_version 644589 (0.0009) [2023-12-26 04:44:02,511][123090] Updated weights for policy 1, policy_version 640138 (0.0009) [2023-12-26 04:44:02,568][123090] Updated weights for policy 1, policy_version 640148 (0.0010) [2023-12-26 04:44:02,620][123090] Updated weights for policy 1, policy_version 640158 (0.0009) [2023-12-26 04:44:02,725][123091] Updated weights for policy 0, policy_version 644599 (0.0007) [2023-12-26 04:44:02,797][123091] Updated weights for policy 0, policy_version 644609 (0.0006) [2023-12-26 04:44:02,870][123091] Updated weights for policy 0, policy_version 644619 (0.0006) [2023-12-26 04:44:03,399][123091] Updated weights for policy 0, policy_version 644629 (0.0006) [2023-12-26 04:44:03,448][123090] Updated weights for policy 1, policy_version 640168 (0.0006) [2023-12-26 04:44:03,454][123091] Updated weights for policy 0, policy_version 644639 (0.0005) [2023-12-26 04:44:03,499][123090] Updated weights for policy 1, policy_version 640178 (0.0005) [2023-12-26 04:44:03,510][123091] Updated weights for policy 0, policy_version 644649 (0.0008) [2023-12-26 04:44:03,555][123090] Updated weights for policy 1, policy_version 640188 (0.0005) [2023-12-26 04:44:03,785][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 328925184. Throughput: 0: 8938.6, 1: 9133.6. Samples: 328933016. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:03,786][121949] Avg episode reward: [(0, '6224.820'), (1, '5526.932')] [2023-12-26 04:44:04,250][123091] Updated weights for policy 0, policy_version 644659 (0.0009) [2023-12-26 04:44:04,317][123090] Updated weights for policy 1, policy_version 640198 (0.0007) [2023-12-26 04:44:04,317][123091] Updated weights for policy 0, policy_version 644669 (0.0008) [2023-12-26 04:44:04,367][123091] Updated weights for policy 0, policy_version 644679 (0.0008) [2023-12-26 04:44:04,368][123090] Updated weights for policy 1, policy_version 640208 (0.0008) [2023-12-26 04:44:04,416][123090] Updated weights for policy 1, policy_version 640218 (0.0005) [2023-12-26 04:44:05,088][123091] Updated weights for policy 0, policy_version 644689 (0.0007) [2023-12-26 04:44:05,148][123091] Updated weights for policy 0, policy_version 644699 (0.0005) [2023-12-26 04:44:05,198][123091] Updated weights for policy 0, policy_version 644709 (0.0007) [2023-12-26 04:44:05,219][123090] Updated weights for policy 1, policy_version 640228 (0.0007) [2023-12-26 04:44:05,250][123091] Updated weights for policy 0, policy_version 644719 (0.0005) [2023-12-26 04:44:05,267][123090] Updated weights for policy 1, policy_version 640238 (0.0010) [2023-12-26 04:44:05,318][123090] Updated weights for policy 1, policy_version 640248 (0.0010) [2023-12-26 04:44:05,911][123091] Updated weights for policy 0, policy_version 644729 (0.0006) [2023-12-26 04:44:05,974][123091] Updated weights for policy 0, policy_version 644739 (0.0006) [2023-12-26 04:44:06,044][123091] Updated weights for policy 0, policy_version 644750 (0.0008) [2023-12-26 04:44:06,153][123090] Updated weights for policy 1, policy_version 640258 (0.0009) [2023-12-26 04:44:06,217][123090] Updated weights for policy 1, policy_version 640268 (0.0006) [2023-12-26 04:44:06,279][123090] Updated weights for policy 1, policy_version 640278 (0.0007) [2023-12-26 04:44:06,335][123090] Updated weights for policy 1, policy_version 640288 (0.0006) [2023-12-26 04:44:06,816][123091] Updated weights for policy 0, policy_version 644760 (0.0010) [2023-12-26 04:44:06,879][123091] Updated weights for policy 0, policy_version 644770 (0.0011) [2023-12-26 04:44:06,946][123091] Updated weights for policy 0, policy_version 644780 (0.0011) [2023-12-26 04:44:06,998][123090] Updated weights for policy 1, policy_version 640298 (0.0006) [2023-12-26 04:44:07,067][123090] Updated weights for policy 1, policy_version 640308 (0.0005) [2023-12-26 04:44:07,141][123090] Updated weights for policy 1, policy_version 640318 (0.0006) [2023-12-26 04:44:07,765][123091] Updated weights for policy 0, policy_version 644790 (0.0011) [2023-12-26 04:44:07,830][123091] Updated weights for policy 0, policy_version 644800 (0.0010) [2023-12-26 04:44:07,887][123091] Updated weights for policy 0, policy_version 644810 (0.0011) [2023-12-26 04:44:07,888][123090] Updated weights for policy 1, policy_version 640328 (0.0010) [2023-12-26 04:44:07,939][123090] Updated weights for policy 1, policy_version 640338 (0.0010) [2023-12-26 04:44:07,990][123090] Updated weights for policy 1, policy_version 640348 (0.0010) [2023-12-26 04:44:08,677][123091] Updated weights for policy 0, policy_version 644820 (0.0008) [2023-12-26 04:44:08,731][123091] Updated weights for policy 0, policy_version 644830 (0.0005) [2023-12-26 04:44:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 329007104. Throughput: 0: 8999.4, 1: 9161.3. Samples: 328989692. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:08,785][121949] Avg episode reward: [(0, '6147.346'), (1, '5479.945')] [2023-12-26 04:44:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000640352_163930112.pth... [2023-12-26 04:44:08,794][123091] Updated weights for policy 0, policy_version 644840 (0.0006) [2023-12-26 04:44:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000639296_163659776.pth [2023-12-26 04:44:08,845][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000644848_165085184.pth... [2023-12-26 04:44:08,849][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000643792_164814848.pth [2023-12-26 04:44:08,864][123090] Updated weights for policy 1, policy_version 640358 (0.0008) [2023-12-26 04:44:08,927][123090] Updated weights for policy 1, policy_version 640368 (0.0006) [2023-12-26 04:44:08,998][123090] Updated weights for policy 1, policy_version 640378 (0.0006) [2023-12-26 04:44:09,552][123091] Updated weights for policy 0, policy_version 644850 (0.0010) [2023-12-26 04:44:09,620][123091] Updated weights for policy 0, policy_version 644860 (0.0011) [2023-12-26 04:44:09,655][123090] Updated weights for policy 1, policy_version 640388 (0.0007) [2023-12-26 04:44:09,681][123091] Updated weights for policy 0, policy_version 644870 (0.0010) [2023-12-26 04:44:09,722][123090] Updated weights for policy 1, policy_version 640398 (0.0007) [2023-12-26 04:44:09,745][123091] Updated weights for policy 0, policy_version 644880 (0.0011) [2023-12-26 04:44:09,797][123090] Updated weights for policy 1, policy_version 640408 (0.0006) [2023-12-26 04:44:10,588][123091] Updated weights for policy 0, policy_version 644890 (0.0011) [2023-12-26 04:44:10,615][123090] Updated weights for policy 1, policy_version 640418 (0.0009) [2023-12-26 04:44:10,654][123091] Updated weights for policy 0, policy_version 644900 (0.0011) [2023-12-26 04:44:10,678][123090] Updated weights for policy 1, policy_version 640428 (0.0008) [2023-12-26 04:44:10,715][123091] Updated weights for policy 0, policy_version 644910 (0.0009) [2023-12-26 04:44:10,744][123090] Updated weights for policy 1, policy_version 640438 (0.0009) [2023-12-26 04:44:10,802][123090] Updated weights for policy 1, policy_version 640448 (0.0009) [2023-12-26 04:44:11,547][123091] Updated weights for policy 0, policy_version 644920 (0.0010) [2023-12-26 04:44:11,614][123091] Updated weights for policy 0, policy_version 644930 (0.0011) [2023-12-26 04:44:11,631][123090] Updated weights for policy 1, policy_version 640458 (0.0008) [2023-12-26 04:44:11,674][123091] Updated weights for policy 0, policy_version 644940 (0.0009) [2023-12-26 04:44:11,697][123090] Updated weights for policy 1, policy_version 640468 (0.0009) [2023-12-26 04:44:11,766][123090] Updated weights for policy 1, policy_version 640478 (0.0009) [2023-12-26 04:44:12,497][123091] Updated weights for policy 0, policy_version 644950 (0.0008) [2023-12-26 04:44:12,557][123091] Updated weights for policy 0, policy_version 644960 (0.0010) [2023-12-26 04:44:12,619][123091] Updated weights for policy 0, policy_version 644970 (0.0008) [2023-12-26 04:44:12,644][123090] Updated weights for policy 1, policy_version 640488 (0.0007) [2023-12-26 04:44:12,701][123090] Updated weights for policy 1, policy_version 640498 (0.0006) [2023-12-26 04:44:12,771][123090] Updated weights for policy 1, policy_version 640508 (0.0006) [2023-12-26 04:44:13,471][123091] Updated weights for policy 0, policy_version 644980 (0.0009) [2023-12-26 04:44:13,518][123091] Updated weights for policy 0, policy_version 644990 (0.0008) [2023-12-26 04:44:13,552][123090] Updated weights for policy 1, policy_version 640518 (0.0008) [2023-12-26 04:44:13,566][123091] Updated weights for policy 0, policy_version 645000 (0.0007) [2023-12-26 04:44:13,609][123090] Updated weights for policy 1, policy_version 640528 (0.0009) [2023-12-26 04:44:13,661][123090] Updated weights for policy 1, policy_version 640538 (0.0009) [2023-12-26 04:44:13,784][121949] Fps is (10 sec: 18023.2, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 329105408. Throughput: 0: 8935.6, 1: 9075.6. Samples: 329094380. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:13,785][121949] Avg episode reward: [(0, '6086.467'), (1, '5546.351')] [2023-12-26 04:44:14,416][123091] Updated weights for policy 0, policy_version 645010 (0.0009) [2023-12-26 04:44:14,467][123091] Updated weights for policy 0, policy_version 645020 (0.0009) [2023-12-26 04:44:14,495][123090] Updated weights for policy 1, policy_version 640548 (0.0009) [2023-12-26 04:44:14,527][123091] Updated weights for policy 0, policy_version 645030 (0.0006) [2023-12-26 04:44:14,551][123090] Updated weights for policy 1, policy_version 640558 (0.0010) [2023-12-26 04:44:14,591][123091] Updated weights for policy 0, policy_version 645040 (0.0006) [2023-12-26 04:44:14,606][123090] Updated weights for policy 1, policy_version 640568 (0.0010) [2023-12-26 04:44:15,457][123091] Updated weights for policy 0, policy_version 645050 (0.0009) [2023-12-26 04:44:15,489][123090] Updated weights for policy 1, policy_version 640578 (0.0011) [2023-12-26 04:44:15,521][123091] Updated weights for policy 0, policy_version 645060 (0.0007) [2023-12-26 04:44:15,552][123090] Updated weights for policy 1, policy_version 640588 (0.0010) [2023-12-26 04:44:15,579][123091] Updated weights for policy 0, policy_version 645070 (0.0006) [2023-12-26 04:44:15,613][123090] Updated weights for policy 1, policy_version 640598 (0.0011) [2023-12-26 04:44:15,676][123090] Updated weights for policy 1, policy_version 640608 (0.0010) [2023-12-26 04:44:16,282][123091] Updated weights for policy 0, policy_version 645080 (0.0006) [2023-12-26 04:44:16,338][123091] Updated weights for policy 0, policy_version 645090 (0.0005) [2023-12-26 04:44:16,388][123091] Updated weights for policy 0, policy_version 645100 (0.0009) [2023-12-26 04:44:16,476][123090] Updated weights for policy 1, policy_version 640618 (0.0009) [2023-12-26 04:44:16,542][123090] Updated weights for policy 1, policy_version 640628 (0.0009) [2023-12-26 04:44:16,593][123090] Updated weights for policy 1, policy_version 640638 (0.0009) [2023-12-26 04:44:17,194][123091] Updated weights for policy 0, policy_version 645110 (0.0011) [2023-12-26 04:44:17,267][123091] Updated weights for policy 0, policy_version 645120 (0.0010) [2023-12-26 04:44:17,322][123091] Updated weights for policy 0, policy_version 645130 (0.0010) [2023-12-26 04:44:17,437][123090] Updated weights for policy 1, policy_version 640648 (0.0009) [2023-12-26 04:44:17,489][123090] Updated weights for policy 1, policy_version 640658 (0.0009) [2023-12-26 04:44:17,538][123090] Updated weights for policy 1, policy_version 640668 (0.0009) [2023-12-26 04:44:18,125][123091] Updated weights for policy 0, policy_version 645140 (0.0010) [2023-12-26 04:44:18,168][123091] Updated weights for policy 0, policy_version 645150 (0.0010) [2023-12-26 04:44:18,224][123091] Updated weights for policy 0, policy_version 645160 (0.0010) [2023-12-26 04:44:18,375][123090] Updated weights for policy 1, policy_version 640678 (0.0008) [2023-12-26 04:44:18,423][123090] Updated weights for policy 1, policy_version 640688 (0.0008) [2023-12-26 04:44:18,477][123090] Updated weights for policy 1, policy_version 640698 (0.0009) [2023-12-26 04:44:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 329187328. Throughput: 0: 8877.2, 1: 9050.0. Samples: 329197920. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:18,785][121949] Avg episode reward: [(0, '6025.953'), (1, '5575.944')] [2023-12-26 04:44:19,093][123091] Updated weights for policy 0, policy_version 645170 (0.0010) [2023-12-26 04:44:19,155][123091] Updated weights for policy 0, policy_version 645180 (0.0010) [2023-12-26 04:44:19,215][123091] Updated weights for policy 0, policy_version 645190 (0.0010) [2023-12-26 04:44:19,248][123090] Updated weights for policy 1, policy_version 640708 (0.0008) [2023-12-26 04:44:19,282][123091] Updated weights for policy 0, policy_version 645200 (0.0010) [2023-12-26 04:44:19,320][123090] Updated weights for policy 1, policy_version 640718 (0.0006) [2023-12-26 04:44:19,391][123090] Updated weights for policy 1, policy_version 640728 (0.0008) [2023-12-26 04:44:20,097][123091] Updated weights for policy 0, policy_version 645210 (0.0006) [2023-12-26 04:44:20,104][123090] Updated weights for policy 1, policy_version 640738 (0.0009) [2023-12-26 04:44:20,158][123091] Updated weights for policy 0, policy_version 645220 (0.0006) [2023-12-26 04:44:20,174][123090] Updated weights for policy 1, policy_version 640748 (0.0007) [2023-12-26 04:44:20,212][123091] Updated weights for policy 0, policy_version 645230 (0.0005) [2023-12-26 04:44:20,242][123090] Updated weights for policy 1, policy_version 640758 (0.0011) [2023-12-26 04:44:20,315][123090] Updated weights for policy 1, policy_version 640768 (0.0011) [2023-12-26 04:44:20,884][123091] Updated weights for policy 0, policy_version 645240 (0.0006) [2023-12-26 04:44:20,942][123091] Updated weights for policy 0, policy_version 645250 (0.0006) [2023-12-26 04:44:20,995][123091] Updated weights for policy 0, policy_version 645260 (0.0006) [2023-12-26 04:44:21,112][123090] Updated weights for policy 1, policy_version 640778 (0.0013) [2023-12-26 04:44:21,181][123090] Updated weights for policy 1, policy_version 640788 (0.0011) [2023-12-26 04:44:21,243][123090] Updated weights for policy 1, policy_version 640798 (0.0010) [2023-12-26 04:44:21,818][123091] Updated weights for policy 0, policy_version 645270 (0.0009) [2023-12-26 04:44:21,880][123091] Updated weights for policy 0, policy_version 645280 (0.0009) [2023-12-26 04:44:21,946][123091] Updated weights for policy 0, policy_version 645290 (0.0009) [2023-12-26 04:44:22,127][123090] Updated weights for policy 1, policy_version 640808 (0.0007) [2023-12-26 04:44:22,196][123090] Updated weights for policy 1, policy_version 640818 (0.0008) [2023-12-26 04:44:22,277][123090] Updated weights for policy 1, policy_version 640828 (0.0009) [2023-12-26 04:44:22,799][123091] Updated weights for policy 0, policy_version 645300 (0.0010) [2023-12-26 04:44:22,862][123091] Updated weights for policy 0, policy_version 645310 (0.0011) [2023-12-26 04:44:22,926][123091] Updated weights for policy 0, policy_version 645320 (0.0011) [2023-12-26 04:44:22,982][123090] Updated weights for policy 1, policy_version 640838 (0.0008) [2023-12-26 04:44:23,053][123090] Updated weights for policy 1, policy_version 640848 (0.0009) [2023-12-26 04:44:23,107][123090] Updated weights for policy 1, policy_version 640858 (0.0009) [2023-12-26 04:44:23,751][123091] Updated weights for policy 0, policy_version 645330 (0.0011) [2023-12-26 04:44:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 329269248. Throughput: 0: 8859.4, 1: 8980.8. Samples: 329251252. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:23,785][121949] Avg episode reward: [(0, '6132.713'), (1, '5535.681')] [2023-12-26 04:44:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000640864_164061184.pth... [2023-12-26 04:44:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000639840_163799040.pth [2023-12-26 04:44:23,805][123091] Updated weights for policy 0, policy_version 645340 (0.0010) [2023-12-26 04:44:23,860][123091] Updated weights for policy 0, policy_version 645350 (0.0010) [2023-12-26 04:44:23,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000645360_165216256.pth... [2023-12-26 04:44:23,915][123091] Updated weights for policy 0, policy_version 645360 (0.0010) [2023-12-26 04:44:23,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000644304_164945920.pth [2023-12-26 04:44:23,930][123090] Updated weights for policy 1, policy_version 640868 (0.0009) [2023-12-26 04:44:24,003][123090] Updated weights for policy 1, policy_version 640878 (0.0009) [2023-12-26 04:44:24,053][123090] Updated weights for policy 1, policy_version 640888 (0.0005) [2023-12-26 04:44:24,682][123091] Updated weights for policy 0, policy_version 645370 (0.0009) [2023-12-26 04:44:24,740][123090] Updated weights for policy 1, policy_version 640898 (0.0005) [2023-12-26 04:44:24,747][123091] Updated weights for policy 0, policy_version 645380 (0.0010) [2023-12-26 04:44:24,802][123090] Updated weights for policy 1, policy_version 640908 (0.0005) [2023-12-26 04:44:24,810][123091] Updated weights for policy 0, policy_version 645390 (0.0010) [2023-12-26 04:44:24,858][123090] Updated weights for policy 1, policy_version 640918 (0.0005) [2023-12-26 04:44:24,916][123090] Updated weights for policy 1, policy_version 640928 (0.0005) [2023-12-26 04:44:25,639][123091] Updated weights for policy 0, policy_version 645400 (0.0006) [2023-12-26 04:44:25,673][123090] Updated weights for policy 1, policy_version 640938 (0.0010) [2023-12-26 04:44:25,697][123091] Updated weights for policy 0, policy_version 645410 (0.0005) [2023-12-26 04:44:25,728][123090] Updated weights for policy 1, policy_version 640948 (0.0009) [2023-12-26 04:44:25,759][123091] Updated weights for policy 0, policy_version 645420 (0.0005) [2023-12-26 04:44:25,781][123090] Updated weights for policy 1, policy_version 640958 (0.0005) [2023-12-26 04:44:26,482][123090] Updated weights for policy 1, policy_version 640968 (0.0009) [2023-12-26 04:44:26,511][123091] Updated weights for policy 0, policy_version 645430 (0.0005) [2023-12-26 04:44:26,548][123090] Updated weights for policy 1, policy_version 640978 (0.0010) [2023-12-26 04:44:26,563][123091] Updated weights for policy 0, policy_version 645440 (0.0005) [2023-12-26 04:44:26,604][123090] Updated weights for policy 1, policy_version 640988 (0.0010) [2023-12-26 04:44:26,613][123091] Updated weights for policy 0, policy_version 645450 (0.0005) [2023-12-26 04:44:27,363][123091] Updated weights for policy 0, policy_version 645460 (0.0007) [2023-12-26 04:44:27,406][123090] Updated weights for policy 1, policy_version 640998 (0.0010) [2023-12-26 04:44:27,426][123091] Updated weights for policy 0, policy_version 645470 (0.0007) [2023-12-26 04:44:27,465][123090] Updated weights for policy 1, policy_version 641008 (0.0010) [2023-12-26 04:44:27,490][123091] Updated weights for policy 0, policy_version 645480 (0.0006) [2023-12-26 04:44:27,521][123090] Updated weights for policy 1, policy_version 641018 (0.0010) [2023-12-26 04:44:28,191][123091] Updated weights for policy 0, policy_version 645490 (0.0006) [2023-12-26 04:44:28,213][123090] Updated weights for policy 1, policy_version 641028 (0.0008) [2023-12-26 04:44:28,242][123091] Updated weights for policy 0, policy_version 645500 (0.0006) [2023-12-26 04:44:28,275][123090] Updated weights for policy 1, policy_version 641038 (0.0005) [2023-12-26 04:44:28,295][123091] Updated weights for policy 0, policy_version 645510 (0.0005) [2023-12-26 04:44:28,326][123090] Updated weights for policy 1, policy_version 641048 (0.0006) [2023-12-26 04:44:28,356][123091] Updated weights for policy 0, policy_version 645520 (0.0008) [2023-12-26 04:44:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 329367552. Throughput: 0: 8919.3, 1: 8998.4. Samples: 329359672. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:28,785][121949] Avg episode reward: [(0, '6093.737'), (1, '5539.609')] [2023-12-26 04:44:29,007][123091] Updated weights for policy 0, policy_version 645530 (0.0005) [2023-12-26 04:44:29,013][123090] Updated weights for policy 1, policy_version 641058 (0.0008) [2023-12-26 04:44:29,061][123091] Updated weights for policy 0, policy_version 645540 (0.0005) [2023-12-26 04:44:29,067][123090] Updated weights for policy 1, policy_version 641068 (0.0005) [2023-12-26 04:44:29,122][123090] Updated weights for policy 1, policy_version 641078 (0.0005) [2023-12-26 04:44:29,125][123091] Updated weights for policy 0, policy_version 645550 (0.0005) [2023-12-26 04:44:29,176][123090] Updated weights for policy 1, policy_version 641088 (0.0005) [2023-12-26 04:44:29,880][123090] Updated weights for policy 1, policy_version 641098 (0.0008) [2023-12-26 04:44:29,903][123091] Updated weights for policy 0, policy_version 645560 (0.0009) [2023-12-26 04:44:29,934][123090] Updated weights for policy 1, policy_version 641108 (0.0009) [2023-12-26 04:44:29,969][123091] Updated weights for policy 0, policy_version 645570 (0.0009) [2023-12-26 04:44:30,003][123090] Updated weights for policy 1, policy_version 641118 (0.0009) [2023-12-26 04:44:30,027][123091] Updated weights for policy 0, policy_version 645580 (0.0009) [2023-12-26 04:44:30,846][123090] Updated weights for policy 1, policy_version 641128 (0.0009) [2023-12-26 04:44:30,897][123091] Updated weights for policy 0, policy_version 645590 (0.0008) [2023-12-26 04:44:30,907][123090] Updated weights for policy 1, policy_version 641138 (0.0009) [2023-12-26 04:44:30,943][123091] Updated weights for policy 0, policy_version 645600 (0.0008) [2023-12-26 04:44:30,962][123090] Updated weights for policy 1, policy_version 641148 (0.0009) [2023-12-26 04:44:30,988][123091] Updated weights for policy 0, policy_version 645610 (0.0006) [2023-12-26 04:44:31,793][123090] Updated weights for policy 1, policy_version 641158 (0.0009) [2023-12-26 04:44:31,855][123090] Updated weights for policy 1, policy_version 641168 (0.0009) [2023-12-26 04:44:31,877][123091] Updated weights for policy 0, policy_version 645620 (0.0009) [2023-12-26 04:44:31,901][123090] Updated weights for policy 1, policy_version 641178 (0.0009) [2023-12-26 04:44:31,930][123091] Updated weights for policy 0, policy_version 645630 (0.0009) [2023-12-26 04:44:31,979][123091] Updated weights for policy 0, policy_version 645640 (0.0008) [2023-12-26 04:44:32,796][123090] Updated weights for policy 1, policy_version 641188 (0.0007) [2023-12-26 04:44:32,832][123091] Updated weights for policy 0, policy_version 645651 (0.0009) [2023-12-26 04:44:32,844][123090] Updated weights for policy 1, policy_version 641198 (0.0009) [2023-12-26 04:44:32,893][123091] Updated weights for policy 0, policy_version 645661 (0.0006) [2023-12-26 04:44:32,905][123090] Updated weights for policy 1, policy_version 641208 (0.0009) [2023-12-26 04:44:32,943][123091] Updated weights for policy 0, policy_version 645671 (0.0008) [2023-12-26 04:44:33,607][123091] Updated weights for policy 0, policy_version 645681 (0.0009) [2023-12-26 04:44:33,670][123091] Updated weights for policy 0, policy_version 645691 (0.0009) [2023-12-26 04:44:33,719][123091] Updated weights for policy 0, policy_version 645701 (0.0009) [2023-12-26 04:44:33,771][123090] Updated weights for policy 1, policy_version 641218 (0.0006) [2023-12-26 04:44:33,782][123091] Updated weights for policy 0, policy_version 645711 (0.0010) [2023-12-26 04:44:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 329449472. Throughput: 0: 8980.3, 1: 8971.5. Samples: 329468528. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:33,785][121949] Avg episode reward: [(0, '6101.208'), (1, '5614.932')] [2023-12-26 04:44:33,827][123090] Updated weights for policy 1, policy_version 641228 (0.0009) [2023-12-26 04:44:33,879][123090] Updated weights for policy 1, policy_version 641238 (0.0009) [2023-12-26 04:44:33,934][123090] Updated weights for policy 1, policy_version 641248 (0.0009) [2023-12-26 04:44:34,635][123091] Updated weights for policy 0, policy_version 645721 (0.0010) [2023-12-26 04:44:34,683][123091] Updated weights for policy 0, policy_version 645731 (0.0009) [2023-12-26 04:44:34,740][123091] Updated weights for policy 0, policy_version 645742 (0.0011) [2023-12-26 04:44:34,775][123090] Updated weights for policy 1, policy_version 641258 (0.0008) [2023-12-26 04:44:34,840][123090] Updated weights for policy 1, policy_version 641268 (0.0009) [2023-12-26 04:44:34,908][123090] Updated weights for policy 1, policy_version 641278 (0.0009) [2023-12-26 04:44:35,552][123091] Updated weights for policy 0, policy_version 645752 (0.0006) [2023-12-26 04:44:35,623][123091] Updated weights for policy 0, policy_version 645762 (0.0005) [2023-12-26 04:44:35,688][123091] Updated weights for policy 0, policy_version 645772 (0.0005) [2023-12-26 04:44:35,748][123090] Updated weights for policy 1, policy_version 641288 (0.0009) [2023-12-26 04:44:35,802][123090] Updated weights for policy 1, policy_version 641298 (0.0009) [2023-12-26 04:44:35,867][123090] Updated weights for policy 1, policy_version 641308 (0.0009) [2023-12-26 04:44:36,433][123091] Updated weights for policy 0, policy_version 645782 (0.0009) [2023-12-26 04:44:36,502][123091] Updated weights for policy 0, policy_version 645792 (0.0010) [2023-12-26 04:44:36,567][123091] Updated weights for policy 0, policy_version 645802 (0.0010) [2023-12-26 04:44:36,707][123090] Updated weights for policy 1, policy_version 641318 (0.0010) [2023-12-26 04:44:36,767][123090] Updated weights for policy 1, policy_version 641328 (0.0008) [2023-12-26 04:44:36,823][123090] Updated weights for policy 1, policy_version 641338 (0.0008) [2023-12-26 04:44:37,381][123091] Updated weights for policy 0, policy_version 645812 (0.0010) [2023-12-26 04:44:37,438][123091] Updated weights for policy 0, policy_version 645822 (0.0009) [2023-12-26 04:44:37,491][123091] Updated weights for policy 0, policy_version 645832 (0.0009) [2023-12-26 04:44:37,686][123090] Updated weights for policy 1, policy_version 641348 (0.0010) [2023-12-26 04:44:37,750][123090] Updated weights for policy 1, policy_version 641358 (0.0010) [2023-12-26 04:44:37,817][123090] Updated weights for policy 1, policy_version 641368 (0.0009) [2023-12-26 04:44:38,331][123091] Updated weights for policy 0, policy_version 645842 (0.0010) [2023-12-26 04:44:38,395][123091] Updated weights for policy 0, policy_version 645852 (0.0009) [2023-12-26 04:44:38,459][123091] Updated weights for policy 0, policy_version 645862 (0.0009) [2023-12-26 04:44:38,517][123091] Updated weights for policy 0, policy_version 645872 (0.0009) [2023-12-26 04:44:38,672][123090] Updated weights for policy 1, policy_version 641378 (0.0009) [2023-12-26 04:44:38,737][123090] Updated weights for policy 1, policy_version 641389 (0.0009) [2023-12-26 04:44:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 329539584. Throughput: 0: 9005.8, 1: 8934.8. Samples: 329519680. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 04:44:38,785][121949] Avg episode reward: [(0, '6198.562'), (1, '5457.155')] [2023-12-26 04:44:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000645872_165347328.pth... [2023-12-26 04:44:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000644848_165085184.pth [2023-12-26 04:44:38,804][123090] Updated weights for policy 1, policy_version 641399 (0.0009) [2023-12-26 04:44:38,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000641408_164200448.pth... [2023-12-26 04:44:38,864][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000640352_163930112.pth [2023-12-26 04:44:39,396][123091] Updated weights for policy 0, policy_version 645882 (0.0010) [2023-12-26 04:44:39,460][123091] Updated weights for policy 0, policy_version 645892 (0.0011) [2023-12-26 04:44:39,520][123091] Updated weights for policy 0, policy_version 645902 (0.0010) [2023-12-26 04:44:39,655][123090] Updated weights for policy 1, policy_version 641409 (0.0010) [2023-12-26 04:44:39,704][123090] Updated weights for policy 1, policy_version 641419 (0.0009) [2023-12-26 04:44:39,756][123090] Updated weights for policy 1, policy_version 641429 (0.0009) [2023-12-26 04:44:39,808][123090] Updated weights for policy 1, policy_version 641439 (0.0010) [2023-12-26 04:44:40,387][123091] Updated weights for policy 0, policy_version 645912 (0.0009) [2023-12-26 04:44:40,444][123091] Updated weights for policy 0, policy_version 645922 (0.0010) [2023-12-26 04:44:40,495][123091] Updated weights for policy 0, policy_version 645932 (0.0009) [2023-12-26 04:44:40,681][123090] Updated weights for policy 1, policy_version 641449 (0.0009) [2023-12-26 04:44:40,740][123090] Updated weights for policy 1, policy_version 641459 (0.0010) [2023-12-26 04:44:40,797][123090] Updated weights for policy 1, policy_version 641469 (0.0009) [2023-12-26 04:44:41,454][123091] Updated weights for policy 0, policy_version 645942 (0.0009) [2023-12-26 04:44:41,507][123091] Updated weights for policy 0, policy_version 645952 (0.0007) [2023-12-26 04:44:41,584][123091] Updated weights for policy 0, policy_version 645962 (0.0008) [2023-12-26 04:44:41,626][123090] Updated weights for policy 1, policy_version 641479 (0.0009) [2023-12-26 04:44:41,684][123090] Updated weights for policy 1, policy_version 641489 (0.0009) [2023-12-26 04:44:41,763][123090] Updated weights for policy 1, policy_version 641499 (0.0010) [2023-12-26 04:44:42,291][123091] Updated weights for policy 0, policy_version 645972 (0.0008) [2023-12-26 04:44:42,352][123091] Updated weights for policy 0, policy_version 645982 (0.0010) [2023-12-26 04:44:42,424][123091] Updated weights for policy 0, policy_version 645992 (0.0009) [2023-12-26 04:44:42,581][123090] Updated weights for policy 1, policy_version 641509 (0.0009) [2023-12-26 04:44:42,639][123090] Updated weights for policy 1, policy_version 641519 (0.0005) [2023-12-26 04:44:42,704][123090] Updated weights for policy 1, policy_version 641529 (0.0008) [2023-12-26 04:44:43,258][123091] Updated weights for policy 0, policy_version 646002 (0.0009) [2023-12-26 04:44:43,317][123091] Updated weights for policy 0, policy_version 646012 (0.0006) [2023-12-26 04:44:43,380][123091] Updated weights for policy 0, policy_version 646022 (0.0007) [2023-12-26 04:44:43,447][123091] Updated weights for policy 0, policy_version 646032 (0.0009) [2023-12-26 04:44:43,476][123090] Updated weights for policy 1, policy_version 641539 (0.0010) [2023-12-26 04:44:43,543][123090] Updated weights for policy 1, policy_version 641549 (0.0010) [2023-12-26 04:44:43,612][123090] Updated weights for policy 1, policy_version 641559 (0.0009) [2023-12-26 04:44:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 329629696. Throughput: 0: 8881.8, 1: 8753.5. Samples: 329620748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:44:43,785][121949] Avg episode reward: [(0, '6162.868'), (1, '5353.891')] [2023-12-26 04:44:44,230][123091] Updated weights for policy 0, policy_version 646042 (0.0010) [2023-12-26 04:44:44,282][123091] Updated weights for policy 0, policy_version 646052 (0.0009) [2023-12-26 04:44:44,343][123091] Updated weights for policy 0, policy_version 646062 (0.0006) [2023-12-26 04:44:44,423][123090] Updated weights for policy 1, policy_version 641569 (0.0007) [2023-12-26 04:44:44,470][123090] Updated weights for policy 1, policy_version 641579 (0.0010) [2023-12-26 04:44:44,525][123090] Updated weights for policy 1, policy_version 641589 (0.0010) [2023-12-26 04:44:44,595][123090] Updated weights for policy 1, policy_version 641599 (0.0006) [2023-12-26 04:44:45,101][123091] Updated weights for policy 0, policy_version 646072 (0.0009) [2023-12-26 04:44:45,174][123091] Updated weights for policy 0, policy_version 646082 (0.0007) [2023-12-26 04:44:45,236][123091] Updated weights for policy 0, policy_version 646092 (0.0005) [2023-12-26 04:44:45,290][123090] Updated weights for policy 1, policy_version 641609 (0.0006) [2023-12-26 04:44:45,365][123090] Updated weights for policy 1, policy_version 641619 (0.0005) [2023-12-26 04:44:45,440][123090] Updated weights for policy 1, policy_version 641629 (0.0006) [2023-12-26 04:44:45,975][123091] Updated weights for policy 0, policy_version 646102 (0.0006) [2023-12-26 04:44:46,050][123091] Updated weights for policy 0, policy_version 646112 (0.0005) [2023-12-26 04:44:46,118][123091] Updated weights for policy 0, policy_version 646122 (0.0007) [2023-12-26 04:44:46,158][123090] Updated weights for policy 1, policy_version 641639 (0.0007) [2023-12-26 04:44:46,213][123090] Updated weights for policy 1, policy_version 641649 (0.0009) [2023-12-26 04:44:46,266][123090] Updated weights for policy 1, policy_version 641659 (0.0008) [2023-12-26 04:44:46,702][123091] Updated weights for policy 0, policy_version 646132 (0.0006) [2023-12-26 04:44:46,750][123091] Updated weights for policy 0, policy_version 646142 (0.0005) [2023-12-26 04:44:46,809][123091] Updated weights for policy 0, policy_version 646152 (0.0005) [2023-12-26 04:44:47,078][123090] Updated weights for policy 1, policy_version 641669 (0.0010) [2023-12-26 04:44:47,145][123090] Updated weights for policy 1, policy_version 641679 (0.0011) [2023-12-26 04:44:47,209][123090] Updated weights for policy 1, policy_version 641689 (0.0010) [2023-12-26 04:44:47,492][123091] Updated weights for policy 0, policy_version 646162 (0.0005) [2023-12-26 04:44:47,560][123091] Updated weights for policy 0, policy_version 646172 (0.0005) [2023-12-26 04:44:47,631][123091] Updated weights for policy 0, policy_version 646182 (0.0005) [2023-12-26 04:44:47,697][123091] Updated weights for policy 0, policy_version 646192 (0.0008) [2023-12-26 04:44:48,014][123090] Updated weights for policy 1, policy_version 641699 (0.0010) [2023-12-26 04:44:48,070][123090] Updated weights for policy 1, policy_version 641709 (0.0009) [2023-12-26 04:44:48,126][123090] Updated weights for policy 1, policy_version 641719 (0.0008) [2023-12-26 04:44:48,455][123091] Updated weights for policy 0, policy_version 646202 (0.0011) [2023-12-26 04:44:48,510][123091] Updated weights for policy 0, policy_version 646212 (0.0011) [2023-12-26 04:44:48,569][123091] Updated weights for policy 0, policy_version 646222 (0.0010) [2023-12-26 04:44:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 329719808. Throughput: 0: 8913.0, 1: 8804.3. Samples: 329730284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:44:48,785][121949] Avg episode reward: [(0, '6184.475'), (1, '5529.212')] [2023-12-26 04:44:48,954][123090] Updated weights for policy 1, policy_version 641729 (0.0009) [2023-12-26 04:44:49,002][123090] Updated weights for policy 1, policy_version 641739 (0.0009) [2023-12-26 04:44:49,058][123090] Updated weights for policy 1, policy_version 641749 (0.0008) [2023-12-26 04:44:49,110][123090] Updated weights for policy 1, policy_version 641759 (0.0008) [2023-12-26 04:44:49,409][123091] Updated weights for policy 0, policy_version 646232 (0.0011) [2023-12-26 04:44:49,472][123091] Updated weights for policy 0, policy_version 646242 (0.0010) [2023-12-26 04:44:49,534][123091] Updated weights for policy 0, policy_version 646252 (0.0011) [2023-12-26 04:44:50,036][123090] Updated weights for policy 1, policy_version 641769 (0.0008) [2023-12-26 04:44:50,091][123090] Updated weights for policy 1, policy_version 641779 (0.0009) [2023-12-26 04:44:50,152][123090] Updated weights for policy 1, policy_version 641789 (0.0009) [2023-12-26 04:44:50,378][123091] Updated weights for policy 0, policy_version 646262 (0.0011) [2023-12-26 04:44:50,441][123091] Updated weights for policy 0, policy_version 646272 (0.0010) [2023-12-26 04:44:50,503][123091] Updated weights for policy 0, policy_version 646282 (0.0010) [2023-12-26 04:44:50,995][123090] Updated weights for policy 1, policy_version 641799 (0.0009) [2023-12-26 04:44:51,062][123090] Updated weights for policy 1, policy_version 641809 (0.0009) [2023-12-26 04:44:51,124][123090] Updated weights for policy 1, policy_version 641819 (0.0009) [2023-12-26 04:44:51,349][123091] Updated weights for policy 0, policy_version 646292 (0.0011) [2023-12-26 04:44:51,418][123091] Updated weights for policy 0, policy_version 646302 (0.0011) [2023-12-26 04:44:51,477][123091] Updated weights for policy 0, policy_version 646312 (0.0011) [2023-12-26 04:44:51,990][123090] Updated weights for policy 1, policy_version 641829 (0.0009) [2023-12-26 04:44:52,058][123090] Updated weights for policy 1, policy_version 641839 (0.0009) [2023-12-26 04:44:52,126][123090] Updated weights for policy 1, policy_version 641849 (0.0009) [2023-12-26 04:44:52,307][123091] Updated weights for policy 0, policy_version 646322 (0.0010) [2023-12-26 04:44:52,382][123091] Updated weights for policy 0, policy_version 646332 (0.0011) [2023-12-26 04:44:52,451][123091] Updated weights for policy 0, policy_version 646342 (0.0008) [2023-12-26 04:44:52,518][123091] Updated weights for policy 0, policy_version 646352 (0.0005) [2023-12-26 04:44:53,023][123090] Updated weights for policy 1, policy_version 641859 (0.0009) [2023-12-26 04:44:53,090][123090] Updated weights for policy 1, policy_version 641869 (0.0009) [2023-12-26 04:44:53,145][123090] Updated weights for policy 1, policy_version 641879 (0.0009) [2023-12-26 04:44:53,202][123091] Updated weights for policy 0, policy_version 646362 (0.0011) [2023-12-26 04:44:53,261][123091] Updated weights for policy 0, policy_version 646372 (0.0008) [2023-12-26 04:44:53,309][123091] Updated weights for policy 0, policy_version 646382 (0.0006) [2023-12-26 04:44:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 329801728. Throughput: 0: 8819.3, 1: 8746.8. Samples: 329780164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:44:53,785][121949] Avg episode reward: [(0, '6133.627'), (1, '5696.138')] [2023-12-26 04:44:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000646384_165478400.pth... [2023-12-26 04:44:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000641888_164323328.pth... [2023-12-26 04:44:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000645360_165216256.pth [2023-12-26 04:44:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000640864_164061184.pth [2023-12-26 04:44:54,011][123090] Updated weights for policy 1, policy_version 641889 (0.0009) [2023-12-26 04:44:54,057][123091] Updated weights for policy 0, policy_version 646392 (0.0009) [2023-12-26 04:44:54,072][123090] Updated weights for policy 1, policy_version 641899 (0.0007) [2023-12-26 04:44:54,119][123091] Updated weights for policy 0, policy_version 646402 (0.0009) [2023-12-26 04:44:54,129][123090] Updated weights for policy 1, policy_version 641909 (0.0007) [2023-12-26 04:44:54,183][123091] Updated weights for policy 0, policy_version 646412 (0.0008) [2023-12-26 04:44:54,186][123090] Updated weights for policy 1, policy_version 641919 (0.0009) [2023-12-26 04:44:54,852][123091] Updated weights for policy 0, policy_version 646422 (0.0005) [2023-12-26 04:44:54,910][123091] Updated weights for policy 0, policy_version 646432 (0.0007) [2023-12-26 04:44:54,971][123091] Updated weights for policy 0, policy_version 646442 (0.0008) [2023-12-26 04:44:55,068][123090] Updated weights for policy 1, policy_version 641929 (0.0009) [2023-12-26 04:44:55,121][123090] Updated weights for policy 1, policy_version 641940 (0.0010) [2023-12-26 04:44:55,178][123090] Updated weights for policy 1, policy_version 641950 (0.0009) [2023-12-26 04:44:55,681][123091] Updated weights for policy 0, policy_version 646452 (0.0007) [2023-12-26 04:44:55,732][123091] Updated weights for policy 0, policy_version 646462 (0.0005) [2023-12-26 04:44:55,799][123091] Updated weights for policy 0, policy_version 646472 (0.0005) [2023-12-26 04:44:56,073][123090] Updated weights for policy 1, policy_version 641960 (0.0010) [2023-12-26 04:44:56,132][123090] Updated weights for policy 1, policy_version 641970 (0.0009) [2023-12-26 04:44:56,182][123090] Updated weights for policy 1, policy_version 641980 (0.0009) [2023-12-26 04:44:56,555][123091] Updated weights for policy 0, policy_version 646482 (0.0006) [2023-12-26 04:44:56,612][123091] Updated weights for policy 0, policy_version 646492 (0.0010) [2023-12-26 04:44:56,671][123091] Updated weights for policy 0, policy_version 646502 (0.0009) [2023-12-26 04:44:56,730][123091] Updated weights for policy 0, policy_version 646512 (0.0009) [2023-12-26 04:44:57,031][123090] Updated weights for policy 1, policy_version 641990 (0.0009) [2023-12-26 04:44:57,084][123090] Updated weights for policy 1, policy_version 642000 (0.0008) [2023-12-26 04:44:57,138][123090] Updated weights for policy 1, policy_version 642010 (0.0009) [2023-12-26 04:44:57,564][123091] Updated weights for policy 0, policy_version 646523 (0.0009) [2023-12-26 04:44:57,617][123091] Updated weights for policy 0, policy_version 646534 (0.0009) [2023-12-26 04:44:57,668][123091] Updated weights for policy 0, policy_version 646544 (0.0006) [2023-12-26 04:44:57,988][123090] Updated weights for policy 1, policy_version 642020 (0.0009) [2023-12-26 04:44:58,055][123090] Updated weights for policy 1, policy_version 642030 (0.0008) [2023-12-26 04:44:58,125][123090] Updated weights for policy 1, policy_version 642040 (0.0008) [2023-12-26 04:44:58,585][123091] Updated weights for policy 0, policy_version 646554 (0.0010) [2023-12-26 04:44:58,656][123091] Updated weights for policy 0, policy_version 646564 (0.0010) [2023-12-26 04:44:58,732][123091] Updated weights for policy 0, policy_version 646574 (0.0009) [2023-12-26 04:44:58,785][121949] Fps is (10 sec: 17201.9, 60 sec: 17612.6, 300 sec: 17689.1). Total num frames: 329891840. Throughput: 0: 8913.6, 1: 8654.4. Samples: 329884952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:44:58,786][121949] Avg episode reward: [(0, '5984.189'), (1, '5657.467')] [2023-12-26 04:44:59,031][123090] Updated weights for policy 1, policy_version 642050 (0.0008) [2023-12-26 04:44:59,102][123090] Updated weights for policy 1, policy_version 642060 (0.0008) [2023-12-26 04:44:59,175][123090] Updated weights for policy 1, policy_version 642070 (0.0007) [2023-12-26 04:44:59,247][123090] Updated weights for policy 1, policy_version 642080 (0.0008) [2023-12-26 04:44:59,645][123091] Updated weights for policy 0, policy_version 646584 (0.0009) [2023-12-26 04:44:59,700][123091] Updated weights for policy 0, policy_version 646594 (0.0009) [2023-12-26 04:44:59,754][123091] Updated weights for policy 0, policy_version 646604 (0.0009) [2023-12-26 04:45:00,051][123090] Updated weights for policy 1, policy_version 642090 (0.0010) [2023-12-26 04:45:00,118][123090] Updated weights for policy 1, policy_version 642100 (0.0011) [2023-12-26 04:45:00,178][123090] Updated weights for policy 1, policy_version 642110 (0.0010) [2023-12-26 04:45:00,632][123091] Updated weights for policy 0, policy_version 646614 (0.0010) [2023-12-26 04:45:00,687][123091] Updated weights for policy 0, policy_version 646624 (0.0009) [2023-12-26 04:45:00,739][123091] Updated weights for policy 0, policy_version 646634 (0.0009) [2023-12-26 04:45:00,971][123090] Updated weights for policy 1, policy_version 642120 (0.0009) [2023-12-26 04:45:01,027][123090] Updated weights for policy 1, policy_version 642130 (0.0010) [2023-12-26 04:45:01,093][123090] Updated weights for policy 1, policy_version 642140 (0.0010) [2023-12-26 04:45:01,602][123091] Updated weights for policy 0, policy_version 646644 (0.0009) [2023-12-26 04:45:01,667][123091] Updated weights for policy 0, policy_version 646654 (0.0008) [2023-12-26 04:45:01,728][123091] Updated weights for policy 0, policy_version 646664 (0.0008) [2023-12-26 04:45:01,999][123090] Updated weights for policy 1, policy_version 642150 (0.0009) [2023-12-26 04:45:02,052][123090] Updated weights for policy 1, policy_version 642160 (0.0009) [2023-12-26 04:45:02,105][123090] Updated weights for policy 1, policy_version 642170 (0.0009) [2023-12-26 04:45:02,461][123091] Updated weights for policy 0, policy_version 646674 (0.0007) [2023-12-26 04:45:02,525][123091] Updated weights for policy 0, policy_version 646684 (0.0007) [2023-12-26 04:45:02,592][123091] Updated weights for policy 0, policy_version 646694 (0.0011) [2023-12-26 04:45:02,660][123091] Updated weights for policy 0, policy_version 646704 (0.0009) [2023-12-26 04:45:02,888][123090] Updated weights for policy 1, policy_version 642180 (0.0009) [2023-12-26 04:45:02,946][123090] Updated weights for policy 1, policy_version 642190 (0.0007) [2023-12-26 04:45:03,008][123090] Updated weights for policy 1, policy_version 642200 (0.0008) [2023-12-26 04:45:03,383][123091] Updated weights for policy 0, policy_version 646714 (0.0010) [2023-12-26 04:45:03,429][123091] Updated weights for policy 0, policy_version 646724 (0.0010) [2023-12-26 04:45:03,476][123091] Updated weights for policy 0, policy_version 646734 (0.0010) [2023-12-26 04:45:03,612][123090] Updated weights for policy 1, policy_version 642210 (0.0007) [2023-12-26 04:45:03,686][123090] Updated weights for policy 1, policy_version 642220 (0.0008) [2023-12-26 04:45:03,748][123090] Updated weights for policy 1, policy_version 642230 (0.0005) [2023-12-26 04:45:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 329973760. Throughput: 0: 8884.6, 1: 8667.6. Samples: 329987768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:03,784][121949] Avg episode reward: [(0, '5993.829'), (1, '5479.368')] [2023-12-26 04:45:03,831][123090] Updated weights for policy 1, policy_version 642240 (0.0007) [2023-12-26 04:45:04,117][123091] Updated weights for policy 0, policy_version 646744 (0.0009) [2023-12-26 04:45:04,180][123091] Updated weights for policy 0, policy_version 646755 (0.0009) [2023-12-26 04:45:04,241][123091] Updated weights for policy 0, policy_version 646765 (0.0008) [2023-12-26 04:45:04,566][123090] Updated weights for policy 1, policy_version 642250 (0.0007) [2023-12-26 04:45:04,621][123090] Updated weights for policy 1, policy_version 642260 (0.0008) [2023-12-26 04:45:04,679][123090] Updated weights for policy 1, policy_version 642270 (0.0009) [2023-12-26 04:45:05,130][123091] Updated weights for policy 0, policy_version 646775 (0.0010) [2023-12-26 04:45:05,200][123091] Updated weights for policy 0, policy_version 646785 (0.0010) [2023-12-26 04:45:05,263][123091] Updated weights for policy 0, policy_version 646795 (0.0010) [2023-12-26 04:45:05,404][123090] Updated weights for policy 1, policy_version 642280 (0.0006) [2023-12-26 04:45:05,458][123090] Updated weights for policy 1, policy_version 642290 (0.0005) [2023-12-26 04:45:05,512][123090] Updated weights for policy 1, policy_version 642300 (0.0007) [2023-12-26 04:45:06,075][123091] Updated weights for policy 0, policy_version 646805 (0.0008) [2023-12-26 04:45:06,139][123091] Updated weights for policy 0, policy_version 646815 (0.0008) [2023-12-26 04:45:06,177][123090] Updated weights for policy 1, policy_version 642310 (0.0006) [2023-12-26 04:45:06,195][123091] Updated weights for policy 0, policy_version 646825 (0.0009) [2023-12-26 04:45:06,240][123090] Updated weights for policy 1, policy_version 642320 (0.0008) [2023-12-26 04:45:06,304][123090] Updated weights for policy 1, policy_version 642330 (0.0009) [2023-12-26 04:45:07,008][123091] Updated weights for policy 0, policy_version 646835 (0.0010) [2023-12-26 04:45:07,067][123091] Updated weights for policy 0, policy_version 646845 (0.0010) [2023-12-26 04:45:07,123][123090] Updated weights for policy 1, policy_version 642340 (0.0007) [2023-12-26 04:45:07,130][123091] Updated weights for policy 0, policy_version 646855 (0.0011) [2023-12-26 04:45:07,182][123090] Updated weights for policy 1, policy_version 642350 (0.0007) [2023-12-26 04:45:07,243][123090] Updated weights for policy 1, policy_version 642360 (0.0009) [2023-12-26 04:45:07,875][123091] Updated weights for policy 0, policy_version 646865 (0.0010) [2023-12-26 04:45:07,922][123090] Updated weights for policy 1, policy_version 642370 (0.0006) [2023-12-26 04:45:07,934][123091] Updated weights for policy 0, policy_version 646875 (0.0007) [2023-12-26 04:45:07,989][123091] Updated weights for policy 0, policy_version 646885 (0.0007) [2023-12-26 04:45:07,990][123090] Updated weights for policy 1, policy_version 642380 (0.0005) [2023-12-26 04:45:08,050][123091] Updated weights for policy 0, policy_version 646895 (0.0007) [2023-12-26 04:45:08,051][123090] Updated weights for policy 1, policy_version 642390 (0.0006) [2023-12-26 04:45:08,099][123090] Updated weights for policy 1, policy_version 642400 (0.0005) [2023-12-26 04:45:08,762][123091] Updated weights for policy 0, policy_version 646905 (0.0009) [2023-12-26 04:45:08,784][121949] Fps is (10 sec: 17204.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 330063872. Throughput: 0: 8875.7, 1: 8712.0. Samples: 330042696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:08,784][121949] Avg episode reward: [(0, '6212.034'), (1, '5441.427')] [2023-12-26 04:45:08,814][123090] Updated weights for policy 1, policy_version 642410 (0.0009) [2023-12-26 04:45:08,816][123091] Updated weights for policy 0, policy_version 646915 (0.0008) [2023-12-26 04:45:08,861][123090] Updated weights for policy 1, policy_version 642420 (0.0008) [2023-12-26 04:45:08,878][123091] Updated weights for policy 0, policy_version 646925 (0.0008) [2023-12-26 04:45:08,895][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000646928_165617664.pth... [2023-12-26 04:45:08,899][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000645872_165347328.pth [2023-12-26 04:45:08,922][123090] Updated weights for policy 1, policy_version 642430 (0.0009) [2023-12-26 04:45:08,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000642432_164462592.pth... [2023-12-26 04:45:08,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000641408_164200448.pth [2023-12-26 04:45:09,659][123091] Updated weights for policy 0, policy_version 646935 (0.0010) [2023-12-26 04:45:09,722][123091] Updated weights for policy 0, policy_version 646945 (0.0011) [2023-12-26 04:45:09,795][123091] Updated weights for policy 0, policy_version 646955 (0.0006) [2023-12-26 04:45:09,899][123090] Updated weights for policy 1, policy_version 642440 (0.0009) [2023-12-26 04:45:09,968][123090] Updated weights for policy 1, policy_version 642450 (0.0009) [2023-12-26 04:45:10,031][123090] Updated weights for policy 1, policy_version 642460 (0.0009) [2023-12-26 04:45:10,497][123091] Updated weights for policy 0, policy_version 646965 (0.0007) [2023-12-26 04:45:10,560][123091] Updated weights for policy 0, policy_version 646975 (0.0005) [2023-12-26 04:45:10,612][123091] Updated weights for policy 0, policy_version 646985 (0.0005) [2023-12-26 04:45:10,952][123090] Updated weights for policy 1, policy_version 642470 (0.0009) [2023-12-26 04:45:11,021][123090] Updated weights for policy 1, policy_version 642480 (0.0006) [2023-12-26 04:45:11,098][123090] Updated weights for policy 1, policy_version 642490 (0.0015) [2023-12-26 04:45:11,203][123091] Updated weights for policy 0, policy_version 646995 (0.0007) [2023-12-26 04:45:11,274][123091] Updated weights for policy 0, policy_version 647005 (0.0008) [2023-12-26 04:45:11,343][123091] Updated weights for policy 0, policy_version 647015 (0.0006) [2023-12-26 04:45:11,944][123090] Updated weights for policy 1, policy_version 642500 (0.0008) [2023-12-26 04:45:12,005][123090] Updated weights for policy 1, policy_version 642510 (0.0006) [2023-12-26 04:45:12,077][123090] Updated weights for policy 1, policy_version 642520 (0.0006) [2023-12-26 04:45:12,135][123091] Updated weights for policy 0, policy_version 647025 (0.0009) [2023-12-26 04:45:12,209][123091] Updated weights for policy 0, policy_version 647035 (0.0009) [2023-12-26 04:45:12,289][123091] Updated weights for policy 0, policy_version 647045 (0.0010) [2023-12-26 04:45:12,357][123091] Updated weights for policy 0, policy_version 647055 (0.0011) [2023-12-26 04:45:12,864][123090] Updated weights for policy 1, policy_version 642530 (0.0006) [2023-12-26 04:45:12,922][123090] Updated weights for policy 1, policy_version 642540 (0.0010) [2023-12-26 04:45:12,985][123090] Updated weights for policy 1, policy_version 642550 (0.0010) [2023-12-26 04:45:13,039][123090] Updated weights for policy 1, policy_version 642560 (0.0010) [2023-12-26 04:45:13,143][123091] Updated weights for policy 0, policy_version 647065 (0.0009) [2023-12-26 04:45:13,195][123091] Updated weights for policy 0, policy_version 647075 (0.0010) [2023-12-26 04:45:13,246][123091] Updated weights for policy 0, policy_version 647085 (0.0010) [2023-12-26 04:45:13,763][123090] Updated weights for policy 1, policy_version 642570 (0.0005) [2023-12-26 04:45:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 330153984. Throughput: 0: 8928.9, 1: 8647.8. Samples: 330150624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:13,785][121949] Avg episode reward: [(0, '6153.571'), (1, '5523.492')] [2023-12-26 04:45:13,815][123090] Updated weights for policy 1, policy_version 642580 (0.0005) [2023-12-26 04:45:13,866][123090] Updated weights for policy 1, policy_version 642590 (0.0005) [2023-12-26 04:45:14,034][123091] Updated weights for policy 0, policy_version 647095 (0.0011) [2023-12-26 04:45:14,099][123091] Updated weights for policy 0, policy_version 647105 (0.0011) [2023-12-26 04:45:14,148][123091] Updated weights for policy 0, policy_version 647115 (0.0010) [2023-12-26 04:45:14,621][123090] Updated weights for policy 1, policy_version 642600 (0.0006) [2023-12-26 04:45:14,684][123090] Updated weights for policy 1, policy_version 642610 (0.0006) [2023-12-26 04:45:14,732][123090] Updated weights for policy 1, policy_version 642620 (0.0005) [2023-12-26 04:45:14,887][123091] Updated weights for policy 0, policy_version 647125 (0.0008) [2023-12-26 04:45:14,959][123091] Updated weights for policy 0, policy_version 647135 (0.0006) [2023-12-26 04:45:15,033][123091] Updated weights for policy 0, policy_version 647145 (0.0005) [2023-12-26 04:45:15,509][123090] Updated weights for policy 1, policy_version 642630 (0.0009) [2023-12-26 04:45:15,565][123090] Updated weights for policy 1, policy_version 642640 (0.0010) [2023-12-26 04:45:15,614][123090] Updated weights for policy 1, policy_version 642650 (0.0010) [2023-12-26 04:45:15,689][123091] Updated weights for policy 0, policy_version 647155 (0.0009) [2023-12-26 04:45:15,759][123091] Updated weights for policy 0, policy_version 647165 (0.0005) [2023-12-26 04:45:15,813][123091] Updated weights for policy 0, policy_version 647175 (0.0006) [2023-12-26 04:45:16,458][123090] Updated weights for policy 1, policy_version 642660 (0.0010) [2023-12-26 04:45:16,529][123090] Updated weights for policy 1, policy_version 642670 (0.0008) [2023-12-26 04:45:16,592][123090] Updated weights for policy 1, policy_version 642680 (0.0009) [2023-12-26 04:45:16,603][123091] Updated weights for policy 0, policy_version 647185 (0.0010) [2023-12-26 04:45:16,651][123091] Updated weights for policy 0, policy_version 647195 (0.0010) [2023-12-26 04:45:16,694][123091] Updated weights for policy 0, policy_version 647205 (0.0010) [2023-12-26 04:45:16,764][123091] Updated weights for policy 0, policy_version 647215 (0.0010) [2023-12-26 04:45:17,358][123090] Updated weights for policy 1, policy_version 642690 (0.0008) [2023-12-26 04:45:17,417][123090] Updated weights for policy 1, policy_version 642700 (0.0009) [2023-12-26 04:45:17,470][123090] Updated weights for policy 1, policy_version 642710 (0.0010) [2023-12-26 04:45:17,529][123090] Updated weights for policy 1, policy_version 642720 (0.0010) [2023-12-26 04:45:17,591][123091] Updated weights for policy 0, policy_version 647225 (0.0011) [2023-12-26 04:45:17,646][123091] Updated weights for policy 0, policy_version 647235 (0.0010) [2023-12-26 04:45:17,705][123091] Updated weights for policy 0, policy_version 647245 (0.0010) [2023-12-26 04:45:18,283][123090] Updated weights for policy 1, policy_version 642730 (0.0011) [2023-12-26 04:45:18,351][123090] Updated weights for policy 1, policy_version 642740 (0.0009) [2023-12-26 04:45:18,416][123090] Updated weights for policy 1, policy_version 642750 (0.0006) [2023-12-26 04:45:18,542][123091] Updated weights for policy 0, policy_version 647255 (0.0011) [2023-12-26 04:45:18,610][123091] Updated weights for policy 0, policy_version 647265 (0.0011) [2023-12-26 04:45:18,675][123091] Updated weights for policy 0, policy_version 647275 (0.0010) [2023-12-26 04:45:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 330252288. Throughput: 0: 8937.8, 1: 8663.7. Samples: 330260592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:18,784][121949] Avg episode reward: [(0, '6126.286'), (1, '5529.342')] [2023-12-26 04:45:19,102][123090] Updated weights for policy 1, policy_version 642760 (0.0007) [2023-12-26 04:45:19,163][123090] Updated weights for policy 1, policy_version 642770 (0.0005) [2023-12-26 04:45:19,236][123090] Updated weights for policy 1, policy_version 642780 (0.0007) [2023-12-26 04:45:19,426][123091] Updated weights for policy 0, policy_version 647285 (0.0008) [2023-12-26 04:45:19,486][123091] Updated weights for policy 0, policy_version 647295 (0.0006) [2023-12-26 04:45:19,547][123091] Updated weights for policy 0, policy_version 647305 (0.0008) [2023-12-26 04:45:19,879][123090] Updated weights for policy 1, policy_version 642790 (0.0008) [2023-12-26 04:45:19,950][123090] Updated weights for policy 1, policy_version 642800 (0.0007) [2023-12-26 04:45:20,018][123090] Updated weights for policy 1, policy_version 642810 (0.0008) [2023-12-26 04:45:20,407][123091] Updated weights for policy 0, policy_version 647315 (0.0009) [2023-12-26 04:45:20,462][123091] Updated weights for policy 0, policy_version 647325 (0.0006) [2023-12-26 04:45:20,520][123091] Updated weights for policy 0, policy_version 647335 (0.0006) [2023-12-26 04:45:20,703][123090] Updated weights for policy 1, policy_version 642820 (0.0009) [2023-12-26 04:45:20,774][123090] Updated weights for policy 1, policy_version 642830 (0.0011) [2023-12-26 04:45:20,840][123090] Updated weights for policy 1, policy_version 642840 (0.0010) [2023-12-26 04:45:21,257][123091] Updated weights for policy 0, policy_version 647345 (0.0006) [2023-12-26 04:45:21,319][123091] Updated weights for policy 0, policy_version 647355 (0.0008) [2023-12-26 04:45:21,390][123091] Updated weights for policy 0, policy_version 647365 (0.0009) [2023-12-26 04:45:21,448][123091] Updated weights for policy 0, policy_version 647375 (0.0009) [2023-12-26 04:45:21,629][123090] Updated weights for policy 1, policy_version 642850 (0.0011) [2023-12-26 04:45:21,690][123090] Updated weights for policy 1, policy_version 642860 (0.0010) [2023-12-26 04:45:21,757][123090] Updated weights for policy 1, policy_version 642870 (0.0009) [2023-12-26 04:45:21,814][123090] Updated weights for policy 1, policy_version 642880 (0.0011) [2023-12-26 04:45:22,355][123091] Updated weights for policy 0, policy_version 647385 (0.0010) [2023-12-26 04:45:22,409][123091] Updated weights for policy 0, policy_version 647395 (0.0009) [2023-12-26 04:45:22,467][123091] Updated weights for policy 0, policy_version 647405 (0.0010) [2023-12-26 04:45:22,599][123090] Updated weights for policy 1, policy_version 642890 (0.0009) [2023-12-26 04:45:22,666][123090] Updated weights for policy 1, policy_version 642900 (0.0011) [2023-12-26 04:45:22,734][123090] Updated weights for policy 1, policy_version 642910 (0.0011) [2023-12-26 04:45:23,364][123091] Updated weights for policy 0, policy_version 647415 (0.0010) [2023-12-26 04:45:23,423][123091] Updated weights for policy 0, policy_version 647425 (0.0010) [2023-12-26 04:45:23,461][123090] Updated weights for policy 1, policy_version 642920 (0.0007) [2023-12-26 04:45:23,487][123091] Updated weights for policy 0, policy_version 647435 (0.0009) [2023-12-26 04:45:23,524][123090] Updated weights for policy 1, policy_version 642930 (0.0005) [2023-12-26 04:45:23,593][123090] Updated weights for policy 1, policy_version 642940 (0.0006) [2023-12-26 04:45:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 330342400. Throughput: 0: 8957.9, 1: 8731.8. Samples: 330315716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:23,785][121949] Avg episode reward: [(0, '6073.425'), (1, '5601.290')] [2023-12-26 04:45:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000647440_165748736.pth... [2023-12-26 04:45:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000642944_164593664.pth... [2023-12-26 04:45:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000646384_165478400.pth [2023-12-26 04:45:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000641888_164323328.pth [2023-12-26 04:45:24,196][123091] Updated weights for policy 0, policy_version 647445 (0.0008) [2023-12-26 04:45:24,255][123091] Updated weights for policy 0, policy_version 647455 (0.0010) [2023-12-26 04:45:24,317][123091] Updated weights for policy 0, policy_version 647465 (0.0010) [2023-12-26 04:45:24,324][123090] Updated weights for policy 1, policy_version 642950 (0.0008) [2023-12-26 04:45:24,381][123090] Updated weights for policy 1, policy_version 642960 (0.0006) [2023-12-26 04:45:24,445][123090] Updated weights for policy 1, policy_version 642970 (0.0005) [2023-12-26 04:45:25,064][123091] Updated weights for policy 0, policy_version 647475 (0.0009) [2023-12-26 04:45:25,115][123091] Updated weights for policy 0, policy_version 647485 (0.0005) [2023-12-26 04:45:25,164][123091] Updated weights for policy 0, policy_version 647495 (0.0005) [2023-12-26 04:45:25,282][123090] Updated weights for policy 1, policy_version 642980 (0.0009) [2023-12-26 04:45:25,338][123090] Updated weights for policy 1, policy_version 642991 (0.0010) [2023-12-26 04:45:25,393][123090] Updated weights for policy 1, policy_version 643002 (0.0010) [2023-12-26 04:45:25,785][123091] Updated weights for policy 0, policy_version 647505 (0.0005) [2023-12-26 04:45:25,838][123091] Updated weights for policy 0, policy_version 647515 (0.0008) [2023-12-26 04:45:25,885][123091] Updated weights for policy 0, policy_version 647525 (0.0008) [2023-12-26 04:45:25,933][123091] Updated weights for policy 0, policy_version 647535 (0.0009) [2023-12-26 04:45:26,354][123090] Updated weights for policy 1, policy_version 643013 (0.0010) [2023-12-26 04:45:26,407][123090] Updated weights for policy 1, policy_version 643023 (0.0010) [2023-12-26 04:45:26,459][123090] Updated weights for policy 1, policy_version 643034 (0.0010) [2023-12-26 04:45:26,735][123091] Updated weights for policy 0, policy_version 647545 (0.0007) [2023-12-26 04:45:26,805][123091] Updated weights for policy 0, policy_version 647555 (0.0006) [2023-12-26 04:45:26,872][123091] Updated weights for policy 0, policy_version 647565 (0.0009) [2023-12-26 04:45:27,381][123090] Updated weights for policy 1, policy_version 643044 (0.0009) [2023-12-26 04:45:27,440][123090] Updated weights for policy 1, policy_version 643054 (0.0009) [2023-12-26 04:45:27,497][123090] Updated weights for policy 1, policy_version 643064 (0.0009) [2023-12-26 04:45:27,587][123091] Updated weights for policy 0, policy_version 647575 (0.0010) [2023-12-26 04:45:27,635][123091] Updated weights for policy 0, policy_version 647585 (0.0010) [2023-12-26 04:45:27,689][123091] Updated weights for policy 0, policy_version 647595 (0.0010) [2023-12-26 04:45:28,376][123090] Updated weights for policy 1, policy_version 643074 (0.0009) [2023-12-26 04:45:28,424][123091] Updated weights for policy 0, policy_version 647605 (0.0008) [2023-12-26 04:45:28,433][123090] Updated weights for policy 1, policy_version 643084 (0.0009) [2023-12-26 04:45:28,487][123091] Updated weights for policy 0, policy_version 647615 (0.0007) [2023-12-26 04:45:28,496][123090] Updated weights for policy 1, policy_version 643094 (0.0010) [2023-12-26 04:45:28,549][123091] Updated weights for policy 0, policy_version 647625 (0.0006) [2023-12-26 04:45:28,553][123090] Updated weights for policy 1, policy_version 643104 (0.0009) [2023-12-26 04:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 330432512. Throughput: 0: 9065.9, 1: 8761.4. Samples: 330422972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:28,785][121949] Avg episode reward: [(0, '5896.587'), (1, '5417.229')] [2023-12-26 04:45:29,311][123091] Updated weights for policy 0, policy_version 647635 (0.0007) [2023-12-26 04:45:29,384][123091] Updated weights for policy 0, policy_version 647645 (0.0008) [2023-12-26 04:45:29,439][123090] Updated weights for policy 1, policy_version 643114 (0.0009) [2023-12-26 04:45:29,452][123091] Updated weights for policy 0, policy_version 647655 (0.0007) [2023-12-26 04:45:29,496][123090] Updated weights for policy 1, policy_version 643124 (0.0009) [2023-12-26 04:45:29,555][123090] Updated weights for policy 1, policy_version 643134 (0.0009) [2023-12-26 04:45:30,174][123091] Updated weights for policy 0, policy_version 647665 (0.0006) [2023-12-26 04:45:30,228][123091] Updated weights for policy 0, policy_version 647675 (0.0005) [2023-12-26 04:45:30,279][123091] Updated weights for policy 0, policy_version 647685 (0.0005) [2023-12-26 04:45:30,333][123091] Updated weights for policy 0, policy_version 647695 (0.0005) [2023-12-26 04:45:30,407][123090] Updated weights for policy 1, policy_version 643144 (0.0009) [2023-12-26 04:45:30,461][123090] Updated weights for policy 1, policy_version 643154 (0.0010) [2023-12-26 04:45:30,527][123090] Updated weights for policy 1, policy_version 643164 (0.0008) [2023-12-26 04:45:31,002][123091] Updated weights for policy 0, policy_version 647705 (0.0005) [2023-12-26 04:45:31,068][123091] Updated weights for policy 0, policy_version 647715 (0.0009) [2023-12-26 04:45:31,139][123091] Updated weights for policy 0, policy_version 647726 (0.0009) [2023-12-26 04:45:31,351][123090] Updated weights for policy 1, policy_version 643174 (0.0009) [2023-12-26 04:45:31,414][123090] Updated weights for policy 1, policy_version 643184 (0.0011) [2023-12-26 04:45:31,465][123090] Updated weights for policy 1, policy_version 643194 (0.0010) [2023-12-26 04:45:31,921][123091] Updated weights for policy 0, policy_version 647736 (0.0006) [2023-12-26 04:45:31,985][123091] Updated weights for policy 0, policy_version 647746 (0.0007) [2023-12-26 04:45:32,040][123091] Updated weights for policy 0, policy_version 647756 (0.0006) [2023-12-26 04:45:32,264][123090] Updated weights for policy 1, policy_version 643204 (0.0010) [2023-12-26 04:45:32,326][123090] Updated weights for policy 1, policy_version 643214 (0.0008) [2023-12-26 04:45:32,401][123090] Updated weights for policy 1, policy_version 643224 (0.0011) [2023-12-26 04:45:32,853][123091] Updated weights for policy 0, policy_version 647766 (0.0008) [2023-12-26 04:45:32,916][123091] Updated weights for policy 0, policy_version 647776 (0.0010) [2023-12-26 04:45:32,991][123091] Updated weights for policy 0, policy_version 647786 (0.0009) [2023-12-26 04:45:33,128][123090] Updated weights for policy 1, policy_version 643234 (0.0009) [2023-12-26 04:45:33,185][123090] Updated weights for policy 1, policy_version 643244 (0.0010) [2023-12-26 04:45:33,247][123090] Updated weights for policy 1, policy_version 643254 (0.0010) [2023-12-26 04:45:33,295][123090] Updated weights for policy 1, policy_version 643264 (0.0006) [2023-12-26 04:45:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 330514432. Throughput: 0: 9034.0, 1: 8731.1. Samples: 330529712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:33,784][121949] Avg episode reward: [(0, '5887.882'), (1, '5154.314')] [2023-12-26 04:45:33,798][123091] Updated weights for policy 0, policy_version 647796 (0.0011) [2023-12-26 04:45:33,849][123091] Updated weights for policy 0, policy_version 647806 (0.0010) [2023-12-26 04:45:33,900][123091] Updated weights for policy 0, policy_version 647816 (0.0010) [2023-12-26 04:45:33,984][123090] Updated weights for policy 1, policy_version 643274 (0.0005) [2023-12-26 04:45:34,038][123090] Updated weights for policy 1, policy_version 643284 (0.0005) [2023-12-26 04:45:34,085][123090] Updated weights for policy 1, policy_version 643294 (0.0005) [2023-12-26 04:45:34,702][123091] Updated weights for policy 0, policy_version 647826 (0.0009) [2023-12-26 04:45:34,774][123091] Updated weights for policy 0, policy_version 647836 (0.0005) [2023-12-26 04:45:34,840][123091] Updated weights for policy 0, policy_version 647846 (0.0009) [2023-12-26 04:45:34,849][123090] Updated weights for policy 1, policy_version 643304 (0.0005) [2023-12-26 04:45:34,908][123090] Updated weights for policy 1, policy_version 643314 (0.0006) [2023-12-26 04:45:34,911][123091] Updated weights for policy 0, policy_version 647856 (0.0006) [2023-12-26 04:45:34,976][123090] Updated weights for policy 1, policy_version 643324 (0.0009) [2023-12-26 04:45:35,607][123091] Updated weights for policy 0, policy_version 647866 (0.0010) [2023-12-26 04:45:35,677][123091] Updated weights for policy 0, policy_version 647876 (0.0011) [2023-12-26 04:45:35,756][123091] Updated weights for policy 0, policy_version 647886 (0.0011) [2023-12-26 04:45:35,769][123090] Updated weights for policy 1, policy_version 643334 (0.0007) [2023-12-26 04:45:35,830][123090] Updated weights for policy 1, policy_version 643344 (0.0006) [2023-12-26 04:45:35,899][123090] Updated weights for policy 1, policy_version 643354 (0.0007) [2023-12-26 04:45:36,534][123091] Updated weights for policy 0, policy_version 647896 (0.0011) [2023-12-26 04:45:36,605][123091] Updated weights for policy 0, policy_version 647906 (0.0011) [2023-12-26 04:45:36,659][123090] Updated weights for policy 1, policy_version 643364 (0.0009) [2023-12-26 04:45:36,670][123091] Updated weights for policy 0, policy_version 647916 (0.0008) [2023-12-26 04:45:36,727][123090] Updated weights for policy 1, policy_version 643374 (0.0008) [2023-12-26 04:45:36,794][123090] Updated weights for policy 1, policy_version 643384 (0.0008) [2023-12-26 04:45:37,365][123091] Updated weights for policy 0, policy_version 647926 (0.0007) [2023-12-26 04:45:37,444][123091] Updated weights for policy 0, policy_version 647936 (0.0006) [2023-12-26 04:45:37,510][123091] Updated weights for policy 0, policy_version 647946 (0.0006) [2023-12-26 04:45:37,575][123090] Updated weights for policy 1, policy_version 643394 (0.0007) [2023-12-26 04:45:37,633][123090] Updated weights for policy 1, policy_version 643404 (0.0010) [2023-12-26 04:45:37,709][123090] Updated weights for policy 1, policy_version 643414 (0.0010) [2023-12-26 04:45:37,774][123090] Updated weights for policy 1, policy_version 643424 (0.0009) [2023-12-26 04:45:38,154][123091] Updated weights for policy 0, policy_version 647956 (0.0006) [2023-12-26 04:45:38,225][123091] Updated weights for policy 0, policy_version 647966 (0.0008) [2023-12-26 04:45:38,287][123091] Updated weights for policy 0, policy_version 647976 (0.0010) [2023-12-26 04:45:38,654][123090] Updated weights for policy 1, policy_version 643434 (0.0010) [2023-12-26 04:45:38,706][123090] Updated weights for policy 1, policy_version 643444 (0.0010) [2023-12-26 04:45:38,750][123090] Updated weights for policy 1, policy_version 643454 (0.0010) [2023-12-26 04:45:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 330612736. Throughput: 0: 9081.7, 1: 8798.7. Samples: 330584780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:38,785][121949] Avg episode reward: [(0, '5943.354'), (1, '4896.396')] [2023-12-26 04:45:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000647984_165888000.pth... [2023-12-26 04:45:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000643456_164724736.pth... [2023-12-26 04:45:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000642432_164462592.pth [2023-12-26 04:45:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000646928_165617664.pth [2023-12-26 04:45:39,072][123091] Updated weights for policy 0, policy_version 647986 (0.0010) [2023-12-26 04:45:39,131][123091] Updated weights for policy 0, policy_version 647996 (0.0010) [2023-12-26 04:45:39,190][123091] Updated weights for policy 0, policy_version 648006 (0.0011) [2023-12-26 04:45:39,256][123091] Updated weights for policy 0, policy_version 648016 (0.0010) [2023-12-26 04:45:39,625][123090] Updated weights for policy 1, policy_version 643464 (0.0011) [2023-12-26 04:45:39,688][123090] Updated weights for policy 1, policy_version 643474 (0.0011) [2023-12-26 04:45:39,752][123090] Updated weights for policy 1, policy_version 643484 (0.0011) [2023-12-26 04:45:40,121][123091] Updated weights for policy 0, policy_version 648026 (0.0009) [2023-12-26 04:45:40,183][123091] Updated weights for policy 0, policy_version 648036 (0.0009) [2023-12-26 04:45:40,248][123091] Updated weights for policy 0, policy_version 648046 (0.0009) [2023-12-26 04:45:40,594][123090] Updated weights for policy 1, policy_version 643494 (0.0008) [2023-12-26 04:45:40,647][123090] Updated weights for policy 1, policy_version 643504 (0.0010) [2023-12-26 04:45:40,696][123090] Updated weights for policy 1, policy_version 643514 (0.0010) [2023-12-26 04:45:41,051][123091] Updated weights for policy 0, policy_version 648056 (0.0009) [2023-12-26 04:45:41,111][123091] Updated weights for policy 0, policy_version 648066 (0.0009) [2023-12-26 04:45:41,180][123091] Updated weights for policy 0, policy_version 648076 (0.0009) [2023-12-26 04:45:41,561][123090] Updated weights for policy 1, policy_version 643524 (0.0009) [2023-12-26 04:45:41,649][123090] Updated weights for policy 1, policy_version 643534 (0.0010) [2023-12-26 04:45:41,721][123090] Updated weights for policy 1, policy_version 643544 (0.0007) [2023-12-26 04:45:42,074][123091] Updated weights for policy 0, policy_version 648086 (0.0010) [2023-12-26 04:45:42,145][123091] Updated weights for policy 0, policy_version 648096 (0.0009) [2023-12-26 04:45:42,211][123091] Updated weights for policy 0, policy_version 648106 (0.0009) [2023-12-26 04:45:42,482][123090] Updated weights for policy 1, policy_version 643554 (0.0006) [2023-12-26 04:45:42,546][123090] Updated weights for policy 1, policy_version 643564 (0.0007) [2023-12-26 04:45:42,609][123090] Updated weights for policy 1, policy_version 643574 (0.0010) [2023-12-26 04:45:42,673][123090] Updated weights for policy 1, policy_version 643584 (0.0009) [2023-12-26 04:45:43,036][123091] Updated weights for policy 0, policy_version 648116 (0.0009) [2023-12-26 04:45:43,099][123091] Updated weights for policy 0, policy_version 648126 (0.0010) [2023-12-26 04:45:43,160][123091] Updated weights for policy 0, policy_version 648136 (0.0009) [2023-12-26 04:45:43,360][123090] Updated weights for policy 1, policy_version 643594 (0.0009) [2023-12-26 04:45:43,416][123090] Updated weights for policy 1, policy_version 643604 (0.0009) [2023-12-26 04:45:43,475][123090] Updated weights for policy 1, policy_version 643614 (0.0010) [2023-12-26 04:45:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 330694656. Throughput: 0: 9018.5, 1: 8835.2. Samples: 330688352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:43,785][121949] Avg episode reward: [(0, '6007.538'), (1, '4897.311')] [2023-12-26 04:45:43,902][123091] Updated weights for policy 0, policy_version 648146 (0.0009) [2023-12-26 04:45:43,974][123091] Updated weights for policy 0, policy_version 648156 (0.0007) [2023-12-26 04:45:44,035][123091] Updated weights for policy 0, policy_version 648166 (0.0009) [2023-12-26 04:45:44,098][123091] Updated weights for policy 0, policy_version 648176 (0.0009) [2023-12-26 04:45:44,380][123090] Updated weights for policy 1, policy_version 643624 (0.0006) [2023-12-26 04:45:44,450][123090] Updated weights for policy 1, policy_version 643634 (0.0005) [2023-12-26 04:45:44,512][123090] Updated weights for policy 1, policy_version 643644 (0.0011) [2023-12-26 04:45:44,862][123091] Updated weights for policy 0, policy_version 648186 (0.0009) [2023-12-26 04:45:44,926][123091] Updated weights for policy 0, policy_version 648196 (0.0009) [2023-12-26 04:45:44,986][123091] Updated weights for policy 0, policy_version 648206 (0.0009) [2023-12-26 04:45:45,313][123090] Updated weights for policy 1, policy_version 643654 (0.0007) [2023-12-26 04:45:45,387][123090] Updated weights for policy 1, policy_version 643664 (0.0005) [2023-12-26 04:45:45,455][123090] Updated weights for policy 1, policy_version 643674 (0.0005) [2023-12-26 04:45:45,839][123091] Updated weights for policy 0, policy_version 648216 (0.0009) [2023-12-26 04:45:45,896][123091] Updated weights for policy 0, policy_version 648226 (0.0009) [2023-12-26 04:45:45,959][123091] Updated weights for policy 0, policy_version 648236 (0.0009) [2023-12-26 04:45:46,231][123090] Updated weights for policy 1, policy_version 643684 (0.0005) [2023-12-26 04:45:46,302][123090] Updated weights for policy 1, policy_version 643694 (0.0007) [2023-12-26 04:45:46,364][123090] Updated weights for policy 1, policy_version 643704 (0.0010) [2023-12-26 04:45:46,812][123091] Updated weights for policy 0, policy_version 648246 (0.0009) [2023-12-26 04:45:46,876][123091] Updated weights for policy 0, policy_version 648256 (0.0008) [2023-12-26 04:45:46,931][123091] Updated weights for policy 0, policy_version 648266 (0.0009) [2023-12-26 04:45:47,154][123090] Updated weights for policy 1, policy_version 643714 (0.0011) [2023-12-26 04:45:47,205][123090] Updated weights for policy 1, policy_version 643724 (0.0010) [2023-12-26 04:45:47,249][123090] Updated weights for policy 1, policy_version 643734 (0.0010) [2023-12-26 04:45:47,293][123090] Updated weights for policy 1, policy_version 643744 (0.0009) [2023-12-26 04:45:47,782][123091] Updated weights for policy 0, policy_version 648276 (0.0009) [2023-12-26 04:45:47,846][123091] Updated weights for policy 0, policy_version 648286 (0.0009) [2023-12-26 04:45:47,899][123091] Updated weights for policy 0, policy_version 648296 (0.0010) [2023-12-26 04:45:47,906][123090] Updated weights for policy 1, policy_version 643754 (0.0005) [2023-12-26 04:45:47,962][123090] Updated weights for policy 1, policy_version 643764 (0.0005) [2023-12-26 04:45:48,019][123090] Updated weights for policy 1, policy_version 643774 (0.0007) [2023-12-26 04:45:48,770][123091] Updated weights for policy 0, policy_version 648306 (0.0008) [2023-12-26 04:45:48,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 330776576. Throughput: 0: 9023.8, 1: 8893.4. Samples: 330794044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:48,785][121949] Avg episode reward: [(0, '6149.209'), (1, '5292.688')] [2023-12-26 04:45:48,803][123090] Updated weights for policy 1, policy_version 643784 (0.0007) [2023-12-26 04:45:48,827][123091] Updated weights for policy 0, policy_version 648316 (0.0007) [2023-12-26 04:45:48,862][123090] Updated weights for policy 1, policy_version 643794 (0.0009) [2023-12-26 04:45:48,884][123091] Updated weights for policy 0, policy_version 648326 (0.0008) [2023-12-26 04:45:48,928][123090] Updated weights for policy 1, policy_version 643804 (0.0008) [2023-12-26 04:45:48,948][123091] Updated weights for policy 0, policy_version 648336 (0.0009) [2023-12-26 04:45:49,719][123090] Updated weights for policy 1, policy_version 643814 (0.0008) [2023-12-26 04:45:49,780][123090] Updated weights for policy 1, policy_version 643824 (0.0009) [2023-12-26 04:45:49,843][123091] Updated weights for policy 0, policy_version 648346 (0.0008) [2023-12-26 04:45:49,845][123090] Updated weights for policy 1, policy_version 643834 (0.0008) [2023-12-26 04:45:49,915][123091] Updated weights for policy 0, policy_version 648356 (0.0008) [2023-12-26 04:45:49,994][123091] Updated weights for policy 0, policy_version 648366 (0.0010) [2023-12-26 04:45:50,689][123091] Updated weights for policy 0, policy_version 648376 (0.0010) [2023-12-26 04:45:50,699][123090] Updated weights for policy 1, policy_version 643844 (0.0007) [2023-12-26 04:45:50,750][123091] Updated weights for policy 0, policy_version 648386 (0.0006) [2023-12-26 04:45:50,760][123090] Updated weights for policy 1, policy_version 643854 (0.0010) [2023-12-26 04:45:50,815][123091] Updated weights for policy 0, policy_version 648396 (0.0009) [2023-12-26 04:45:50,827][123090] Updated weights for policy 1, policy_version 643864 (0.0009) [2023-12-26 04:45:51,656][123090] Updated weights for policy 1, policy_version 643874 (0.0008) [2023-12-26 04:45:51,689][123091] Updated weights for policy 0, policy_version 648406 (0.0008) [2023-12-26 04:45:51,723][123090] Updated weights for policy 1, policy_version 643884 (0.0008) [2023-12-26 04:45:51,758][123091] Updated weights for policy 0, policy_version 648416 (0.0009) [2023-12-26 04:45:51,797][123090] Updated weights for policy 1, policy_version 643894 (0.0008) [2023-12-26 04:45:51,824][123091] Updated weights for policy 0, policy_version 648426 (0.0008) [2023-12-26 04:45:51,867][123090] Updated weights for policy 1, policy_version 643904 (0.0008) [2023-12-26 04:45:52,640][123091] Updated weights for policy 0, policy_version 648436 (0.0007) [2023-12-26 04:45:52,650][123090] Updated weights for policy 1, policy_version 643914 (0.0011) [2023-12-26 04:45:52,704][123091] Updated weights for policy 0, policy_version 648446 (0.0006) [2023-12-26 04:45:52,718][123090] Updated weights for policy 1, policy_version 643924 (0.0011) [2023-12-26 04:45:52,760][123091] Updated weights for policy 0, policy_version 648456 (0.0006) [2023-12-26 04:45:52,783][123090] Updated weights for policy 1, policy_version 643934 (0.0011) [2023-12-26 04:45:53,487][123091] Updated weights for policy 0, policy_version 648466 (0.0006) [2023-12-26 04:45:53,554][123091] Updated weights for policy 0, policy_version 648476 (0.0007) [2023-12-26 04:45:53,564][123090] Updated weights for policy 1, policy_version 643944 (0.0006) [2023-12-26 04:45:53,616][123091] Updated weights for policy 0, policy_version 648486 (0.0006) [2023-12-26 04:45:53,620][123090] Updated weights for policy 1, policy_version 643954 (0.0006) [2023-12-26 04:45:53,669][123090] Updated weights for policy 1, policy_version 643964 (0.0009) [2023-12-26 04:45:53,675][123091] Updated weights for policy 0, policy_version 648496 (0.0005) [2023-12-26 04:45:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 330874880. Throughput: 0: 8994.9, 1: 8833.6. Samples: 330844984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:53,785][121949] Avg episode reward: [(0, '6124.980'), (1, '5437.735')] [2023-12-26 04:45:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000648496_166019072.pth... [2023-12-26 04:45:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000643968_164855808.pth... [2023-12-26 04:45:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000647440_165748736.pth [2023-12-26 04:45:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000642944_164593664.pth [2023-12-26 04:45:54,414][123091] Updated weights for policy 0, policy_version 648506 (0.0009) [2023-12-26 04:45:54,471][123091] Updated weights for policy 0, policy_version 648516 (0.0009) [2023-12-26 04:45:54,473][123090] Updated weights for policy 1, policy_version 643974 (0.0007) [2023-12-26 04:45:54,531][123091] Updated weights for policy 0, policy_version 648526 (0.0009) [2023-12-26 04:45:54,535][123090] Updated weights for policy 1, policy_version 643984 (0.0006) [2023-12-26 04:45:54,595][123090] Updated weights for policy 1, policy_version 643994 (0.0009) [2023-12-26 04:45:55,336][123091] Updated weights for policy 0, policy_version 648536 (0.0009) [2023-12-26 04:45:55,391][123091] Updated weights for policy 0, policy_version 648546 (0.0009) [2023-12-26 04:45:55,431][123090] Updated weights for policy 1, policy_version 644004 (0.0008) [2023-12-26 04:45:55,454][123091] Updated weights for policy 0, policy_version 648556 (0.0010) [2023-12-26 04:45:55,485][123090] Updated weights for policy 1, policy_version 644014 (0.0008) [2023-12-26 04:45:55,546][123090] Updated weights for policy 1, policy_version 644024 (0.0009) [2023-12-26 04:45:56,186][123091] Updated weights for policy 0, policy_version 648566 (0.0006) [2023-12-26 04:45:56,267][123091] Updated weights for policy 0, policy_version 648576 (0.0005) [2023-12-26 04:45:56,271][123090] Updated weights for policy 1, policy_version 644034 (0.0010) [2023-12-26 04:45:56,330][123091] Updated weights for policy 0, policy_version 648586 (0.0010) [2023-12-26 04:45:56,336][123090] Updated weights for policy 1, policy_version 644044 (0.0010) [2023-12-26 04:45:56,397][123090] Updated weights for policy 1, policy_version 644054 (0.0007) [2023-12-26 04:45:56,461][123090] Updated weights for policy 1, policy_version 644064 (0.0009) [2023-12-26 04:45:57,014][123091] Updated weights for policy 0, policy_version 648596 (0.0010) [2023-12-26 04:45:57,060][123091] Updated weights for policy 0, policy_version 648606 (0.0010) [2023-12-26 04:45:57,104][123091] Updated weights for policy 0, policy_version 648616 (0.0010) [2023-12-26 04:45:57,273][123090] Updated weights for policy 1, policy_version 644074 (0.0005) [2023-12-26 04:45:57,332][123090] Updated weights for policy 1, policy_version 644084 (0.0005) [2023-12-26 04:45:57,394][123090] Updated weights for policy 1, policy_version 644094 (0.0005) [2023-12-26 04:45:57,806][123091] Updated weights for policy 0, policy_version 648626 (0.0006) [2023-12-26 04:45:57,866][123091] Updated weights for policy 0, policy_version 648637 (0.0008) [2023-12-26 04:45:57,920][123091] Updated weights for policy 0, policy_version 648647 (0.0010) [2023-12-26 04:45:57,983][123090] Updated weights for policy 1, policy_version 644104 (0.0007) [2023-12-26 04:45:58,048][123090] Updated weights for policy 1, policy_version 644114 (0.0009) [2023-12-26 04:45:58,113][123090] Updated weights for policy 1, policy_version 644124 (0.0009) [2023-12-26 04:45:58,786][121949] Fps is (10 sec: 18019.3, 60 sec: 17749.0, 300 sec: 17716.8). Total num frames: 330956800. Throughput: 0: 8994.6, 1: 8866.3. Samples: 330954396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:45:58,786][121949] Avg episode reward: [(0, '6032.861'), (1, '5543.893')] [2023-12-26 04:45:58,827][123091] Updated weights for policy 0, policy_version 648657 (0.0009) [2023-12-26 04:45:58,895][123091] Updated weights for policy 0, policy_version 648667 (0.0006) [2023-12-26 04:45:58,964][123091] Updated weights for policy 0, policy_version 648677 (0.0008) [2023-12-26 04:45:59,036][123091] Updated weights for policy 0, policy_version 648687 (0.0008) [2023-12-26 04:45:59,097][123090] Updated weights for policy 1, policy_version 644134 (0.0009) [2023-12-26 04:45:59,168][123090] Updated weights for policy 1, policy_version 644144 (0.0009) [2023-12-26 04:45:59,236][123090] Updated weights for policy 1, policy_version 644154 (0.0009) [2023-12-26 04:45:59,717][123091] Updated weights for policy 0, policy_version 648697 (0.0006) [2023-12-26 04:45:59,780][123091] Updated weights for policy 0, policy_version 648707 (0.0007) [2023-12-26 04:45:59,848][123091] Updated weights for policy 0, policy_version 648717 (0.0009) [2023-12-26 04:46:00,096][123090] Updated weights for policy 1, policy_version 644164 (0.0009) [2023-12-26 04:46:00,164][123090] Updated weights for policy 1, policy_version 644174 (0.0008) [2023-12-26 04:46:00,236][123090] Updated weights for policy 1, policy_version 644184 (0.0008) [2023-12-26 04:46:00,616][123091] Updated weights for policy 0, policy_version 648727 (0.0009) [2023-12-26 04:46:00,680][123091] Updated weights for policy 0, policy_version 648737 (0.0009) [2023-12-26 04:46:00,737][123091] Updated weights for policy 0, policy_version 648747 (0.0009) [2023-12-26 04:46:01,025][123090] Updated weights for policy 1, policy_version 644194 (0.0008) [2023-12-26 04:46:01,088][123090] Updated weights for policy 1, policy_version 644204 (0.0007) [2023-12-26 04:46:01,162][123090] Updated weights for policy 1, policy_version 644214 (0.0008) [2023-12-26 04:46:01,234][123090] Updated weights for policy 1, policy_version 644224 (0.0006) [2023-12-26 04:46:01,589][123091] Updated weights for policy 0, policy_version 648757 (0.0008) [2023-12-26 04:46:01,651][123091] Updated weights for policy 0, policy_version 648767 (0.0007) [2023-12-26 04:46:01,714][123091] Updated weights for policy 0, policy_version 648777 (0.0006) [2023-12-26 04:46:02,021][123090] Updated weights for policy 1, policy_version 644234 (0.0010) [2023-12-26 04:46:02,072][123090] Updated weights for policy 1, policy_version 644244 (0.0008) [2023-12-26 04:46:02,128][123090] Updated weights for policy 1, policy_version 644254 (0.0008) [2023-12-26 04:46:02,456][123091] Updated weights for policy 0, policy_version 648787 (0.0008) [2023-12-26 04:46:02,518][123091] Updated weights for policy 0, policy_version 648797 (0.0008) [2023-12-26 04:46:02,581][123091] Updated weights for policy 0, policy_version 648807 (0.0008) [2023-12-26 04:46:03,019][123090] Updated weights for policy 1, policy_version 644264 (0.0010) [2023-12-26 04:46:03,072][123090] Updated weights for policy 1, policy_version 644274 (0.0009) [2023-12-26 04:46:03,135][123090] Updated weights for policy 1, policy_version 644284 (0.0009) [2023-12-26 04:46:03,415][123091] Updated weights for policy 0, policy_version 648817 (0.0008) [2023-12-26 04:46:03,487][123091] Updated weights for policy 0, policy_version 648827 (0.0009) [2023-12-26 04:46:03,554][123091] Updated weights for policy 0, policy_version 648838 (0.0010) [2023-12-26 04:46:03,620][123091] Updated weights for policy 0, policy_version 648848 (0.0008) [2023-12-26 04:46:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 331046912. Throughput: 0: 8932.7, 1: 8771.5. Samples: 331057284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:46:03,785][121949] Avg episode reward: [(0, '6002.252'), (1, '5465.433')] [2023-12-26 04:46:03,953][123090] Updated weights for policy 1, policy_version 644294 (0.0008) [2023-12-26 04:46:04,029][123090] Updated weights for policy 1, policy_version 644304 (0.0009) [2023-12-26 04:46:04,101][123090] Updated weights for policy 1, policy_version 644314 (0.0010) [2023-12-26 04:46:04,468][123091] Updated weights for policy 0, policy_version 648858 (0.0008) [2023-12-26 04:46:04,538][123091] Updated weights for policy 0, policy_version 648868 (0.0008) [2023-12-26 04:46:04,591][123091] Updated weights for policy 0, policy_version 648878 (0.0008) [2023-12-26 04:46:04,971][123090] Updated weights for policy 1, policy_version 644324 (0.0010) [2023-12-26 04:46:05,039][123090] Updated weights for policy 1, policy_version 644334 (0.0006) [2023-12-26 04:46:05,107][123090] Updated weights for policy 1, policy_version 644344 (0.0005) [2023-12-26 04:46:05,445][123091] Updated weights for policy 0, policy_version 648888 (0.0010) [2023-12-26 04:46:05,513][123091] Updated weights for policy 0, policy_version 648898 (0.0010) [2023-12-26 04:46:05,583][123091] Updated weights for policy 0, policy_version 648908 (0.0006) [2023-12-26 04:46:05,788][123090] Updated weights for policy 1, policy_version 644354 (0.0007) [2023-12-26 04:46:05,853][123090] Updated weights for policy 1, policy_version 644364 (0.0010) [2023-12-26 04:46:05,920][123090] Updated weights for policy 1, policy_version 644374 (0.0011) [2023-12-26 04:46:05,987][123090] Updated weights for policy 1, policy_version 644384 (0.0010) [2023-12-26 04:46:06,304][123091] Updated weights for policy 0, policy_version 648918 (0.0006) [2023-12-26 04:46:06,376][123091] Updated weights for policy 0, policy_version 648928 (0.0006) [2023-12-26 04:46:06,447][123091] Updated weights for policy 0, policy_version 648938 (0.0006) [2023-12-26 04:46:06,783][123090] Updated weights for policy 1, policy_version 644394 (0.0007) [2023-12-26 04:46:06,853][123090] Updated weights for policy 1, policy_version 644404 (0.0007) [2023-12-26 04:46:06,917][123090] Updated weights for policy 1, policy_version 644414 (0.0010) [2023-12-26 04:46:07,215][123091] Updated weights for policy 0, policy_version 648948 (0.0006) [2023-12-26 04:46:07,290][123091] Updated weights for policy 0, policy_version 648958 (0.0007) [2023-12-26 04:46:07,368][123091] Updated weights for policy 0, policy_version 648968 (0.0007) [2023-12-26 04:46:07,755][123090] Updated weights for policy 1, policy_version 644424 (0.0010) [2023-12-26 04:46:07,823][123090] Updated weights for policy 1, policy_version 644434 (0.0009) [2023-12-26 04:46:07,890][123090] Updated weights for policy 1, policy_version 644444 (0.0010) [2023-12-26 04:46:08,135][123091] Updated weights for policy 0, policy_version 648978 (0.0009) [2023-12-26 04:46:08,207][123091] Updated weights for policy 0, policy_version 648988 (0.0009) [2023-12-26 04:46:08,277][123091] Updated weights for policy 0, policy_version 648998 (0.0010) [2023-12-26 04:46:08,344][123091] Updated weights for policy 0, policy_version 649008 (0.0010) [2023-12-26 04:46:08,606][123090] Updated weights for policy 1, policy_version 644454 (0.0010) [2023-12-26 04:46:08,679][123090] Updated weights for policy 1, policy_version 644464 (0.0008) [2023-12-26 04:46:08,754][123090] Updated weights for policy 1, policy_version 644474 (0.0006) [2023-12-26 04:46:08,784][121949] Fps is (10 sec: 17206.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 331128832. Throughput: 0: 8919.1, 1: 8738.7. Samples: 331110320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:46:08,785][121949] Avg episode reward: [(0, '6047.746'), (1, '5399.933')] [2023-12-26 04:46:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000649008_166150144.pth... [2023-12-26 04:46:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000647984_165888000.pth [2023-12-26 04:46:08,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000644480_164986880.pth... [2023-12-26 04:46:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000643456_164724736.pth [2023-12-26 04:46:09,184][123091] Updated weights for policy 0, policy_version 649018 (0.0009) [2023-12-26 04:46:09,239][123091] Updated weights for policy 0, policy_version 649028 (0.0009) [2023-12-26 04:46:09,303][123091] Updated weights for policy 0, policy_version 649038 (0.0008) [2023-12-26 04:46:09,415][123090] Updated weights for policy 1, policy_version 644484 (0.0008) [2023-12-26 04:46:09,482][123090] Updated weights for policy 1, policy_version 644494 (0.0010) [2023-12-26 04:46:09,549][123090] Updated weights for policy 1, policy_version 644504 (0.0006) [2023-12-26 04:46:10,126][123091] Updated weights for policy 0, policy_version 649048 (0.0007) [2023-12-26 04:46:10,190][123091] Updated weights for policy 0, policy_version 649058 (0.0009) [2023-12-26 04:46:10,251][123091] Updated weights for policy 0, policy_version 649068 (0.0009) [2023-12-26 04:46:10,387][123090] Updated weights for policy 1, policy_version 644514 (0.0010) [2023-12-26 04:46:10,464][123090] Updated weights for policy 1, policy_version 644524 (0.0011) [2023-12-26 04:46:10,532][123090] Updated weights for policy 1, policy_version 644534 (0.0011) [2023-12-26 04:46:10,596][123090] Updated weights for policy 1, policy_version 644544 (0.0011) [2023-12-26 04:46:11,059][123091] Updated weights for policy 0, policy_version 649078 (0.0009) [2023-12-26 04:46:11,129][123091] Updated weights for policy 0, policy_version 649088 (0.0008) [2023-12-26 04:46:11,197][123091] Updated weights for policy 0, policy_version 649098 (0.0007) [2023-12-26 04:46:11,435][123090] Updated weights for policy 1, policy_version 644554 (0.0007) [2023-12-26 04:46:11,500][123090] Updated weights for policy 1, policy_version 644564 (0.0010) [2023-12-26 04:46:11,568][123090] Updated weights for policy 1, policy_version 644574 (0.0009) [2023-12-26 04:46:11,981][123091] Updated weights for policy 0, policy_version 649108 (0.0006) [2023-12-26 04:46:12,058][123091] Updated weights for policy 0, policy_version 649118 (0.0007) [2023-12-26 04:46:12,126][123091] Updated weights for policy 0, policy_version 649128 (0.0006) [2023-12-26 04:46:12,422][123090] Updated weights for policy 1, policy_version 644584 (0.0010) [2023-12-26 04:46:12,469][123090] Updated weights for policy 1, policy_version 644594 (0.0009) [2023-12-26 04:46:12,535][123090] Updated weights for policy 1, policy_version 644604 (0.0005) [2023-12-26 04:46:12,969][123091] Updated weights for policy 0, policy_version 649138 (0.0009) [2023-12-26 04:46:13,034][123091] Updated weights for policy 0, policy_version 649148 (0.0009) [2023-12-26 04:46:13,100][123091] Updated weights for policy 0, policy_version 649158 (0.0005) [2023-12-26 04:46:13,174][123091] Updated weights for policy 0, policy_version 649168 (0.0005) [2023-12-26 04:46:13,356][123090] Updated weights for policy 1, policy_version 644614 (0.0008) [2023-12-26 04:46:13,411][123090] Updated weights for policy 1, policy_version 644624 (0.0010) [2023-12-26 04:46:13,470][123090] Updated weights for policy 1, policy_version 644634 (0.0010) [2023-12-26 04:46:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 331218944. Throughput: 0: 8822.4, 1: 8743.3. Samples: 331213436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 04:46:13,785][121949] Avg episode reward: [(0, '6162.093'), (1, '5481.547')] [2023-12-26 04:46:13,788][123091] Updated weights for policy 0, policy_version 649178 (0.0005) [2023-12-26 04:46:13,858][123091] Updated weights for policy 0, policy_version 649188 (0.0009) [2023-12-26 04:46:13,914][123091] Updated weights for policy 0, policy_version 649198 (0.0010) [2023-12-26 04:46:14,376][123090] Updated weights for policy 1, policy_version 644644 (0.0010) [2023-12-26 04:46:14,440][123090] Updated weights for policy 1, policy_version 644654 (0.0011) [2023-12-26 04:46:14,505][123090] Updated weights for policy 1, policy_version 644664 (0.0011) [2023-12-26 04:46:14,630][123091] Updated weights for policy 0, policy_version 649208 (0.0009) [2023-12-26 04:46:14,690][123091] Updated weights for policy 0, policy_version 649218 (0.0009) [2023-12-26 04:46:14,748][123091] Updated weights for policy 0, policy_version 649228 (0.0008) [2023-12-26 04:46:15,344][123090] Updated weights for policy 1, policy_version 644674 (0.0011) [2023-12-26 04:46:15,414][123090] Updated weights for policy 1, policy_version 644684 (0.0011) [2023-12-26 04:46:15,451][123091] Updated weights for policy 0, policy_version 649238 (0.0009) [2023-12-26 04:46:15,478][123090] Updated weights for policy 1, policy_version 644694 (0.0011) [2023-12-26 04:46:15,510][123091] Updated weights for policy 0, policy_version 649248 (0.0006) [2023-12-26 04:46:15,541][123090] Updated weights for policy 1, policy_version 644704 (0.0010) [2023-12-26 04:46:15,563][123091] Updated weights for policy 0, policy_version 649258 (0.0008) [2023-12-26 04:46:16,288][123090] Updated weights for policy 1, policy_version 644714 (0.0005) [2023-12-26 04:46:16,296][123091] Updated weights for policy 0, policy_version 649268 (0.0008) [2023-12-26 04:46:16,349][123090] Updated weights for policy 1, policy_version 644724 (0.0007) [2023-12-26 04:46:16,356][123091] Updated weights for policy 0, policy_version 649278 (0.0006) [2023-12-26 04:46:16,404][123090] Updated weights for policy 1, policy_version 644734 (0.0006) [2023-12-26 04:46:16,417][123091] Updated weights for policy 0, policy_version 649288 (0.0005) [2023-12-26 04:46:17,078][123090] Updated weights for policy 1, policy_version 644744 (0.0005) [2023-12-26 04:46:17,144][123090] Updated weights for policy 1, policy_version 644754 (0.0005) [2023-12-26 04:46:17,205][123090] Updated weights for policy 1, policy_version 644764 (0.0005) [2023-12-26 04:46:17,220][123091] Updated weights for policy 0, policy_version 649298 (0.0006) [2023-12-26 04:46:17,268][123091] Updated weights for policy 0, policy_version 649308 (0.0005) [2023-12-26 04:46:17,314][123091] Updated weights for policy 0, policy_version 649318 (0.0005) [2023-12-26 04:46:17,362][123091] Updated weights for policy 0, policy_version 649328 (0.0005) [2023-12-26 04:46:17,782][123090] Updated weights for policy 1, policy_version 644774 (0.0005) [2023-12-26 04:46:17,836][123090] Updated weights for policy 1, policy_version 644784 (0.0005) [2023-12-26 04:46:17,886][123090] Updated weights for policy 1, policy_version 644794 (0.0005) [2023-12-26 04:46:18,069][123091] Updated weights for policy 0, policy_version 649338 (0.0010) [2023-12-26 04:46:18,118][123091] Updated weights for policy 0, policy_version 649348 (0.0009) [2023-12-26 04:46:18,174][123091] Updated weights for policy 0, policy_version 649358 (0.0009) [2023-12-26 04:46:18,663][123090] Updated weights for policy 1, policy_version 644804 (0.0007) [2023-12-26 04:46:18,729][123090] Updated weights for policy 1, policy_version 644814 (0.0010) [2023-12-26 04:46:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 331309056. Throughput: 0: 8870.6, 1: 8822.7. Samples: 331325912. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:18,785][121949] Avg episode reward: [(0, '6298.804'), (1, '5565.543')] [2023-12-26 04:46:18,793][123090] Updated weights for policy 1, policy_version 644824 (0.0010) [2023-12-26 04:46:19,043][123091] Updated weights for policy 0, policy_version 649368 (0.0006) [2023-12-26 04:46:19,104][123091] Updated weights for policy 0, policy_version 649378 (0.0005) [2023-12-26 04:46:19,166][123091] Updated weights for policy 0, policy_version 649388 (0.0006) [2023-12-26 04:46:19,604][123090] Updated weights for policy 1, policy_version 644834 (0.0010) [2023-12-26 04:46:19,674][123090] Updated weights for policy 1, policy_version 644844 (0.0011) [2023-12-26 04:46:19,738][123090] Updated weights for policy 1, policy_version 644854 (0.0011) [2023-12-26 04:46:19,815][123090] Updated weights for policy 1, policy_version 644864 (0.0011) [2023-12-26 04:46:19,966][123091] Updated weights for policy 0, policy_version 649398 (0.0008) [2023-12-26 04:46:20,035][123091] Updated weights for policy 0, policy_version 649408 (0.0009) [2023-12-26 04:46:20,099][123091] Updated weights for policy 0, policy_version 649418 (0.0009) [2023-12-26 04:46:20,582][123090] Updated weights for policy 1, policy_version 644874 (0.0007) [2023-12-26 04:46:20,658][123090] Updated weights for policy 1, policy_version 644884 (0.0011) [2023-12-26 04:46:20,731][123090] Updated weights for policy 1, policy_version 644894 (0.0007) [2023-12-26 04:46:20,995][123091] Updated weights for policy 0, policy_version 649428 (0.0010) [2023-12-26 04:46:21,074][123091] Updated weights for policy 0, policy_version 649438 (0.0009) [2023-12-26 04:46:21,152][123091] Updated weights for policy 0, policy_version 649448 (0.0008) [2023-12-26 04:46:21,492][123090] Updated weights for policy 1, policy_version 644904 (0.0010) [2023-12-26 04:46:21,549][123090] Updated weights for policy 1, policy_version 644914 (0.0011) [2023-12-26 04:46:21,612][123090] Updated weights for policy 1, policy_version 644924 (0.0011) [2023-12-26 04:46:21,954][123091] Updated weights for policy 0, policy_version 649458 (0.0011) [2023-12-26 04:46:22,020][123091] Updated weights for policy 0, policy_version 649468 (0.0008) [2023-12-26 04:46:22,084][123091] Updated weights for policy 0, policy_version 649478 (0.0008) [2023-12-26 04:46:22,147][123091] Updated weights for policy 0, policy_version 649488 (0.0011) [2023-12-26 04:46:22,486][123090] Updated weights for policy 1, policy_version 644934 (0.0011) [2023-12-26 04:46:22,538][123090] Updated weights for policy 1, policy_version 644944 (0.0010) [2023-12-26 04:46:22,617][123090] Updated weights for policy 1, policy_version 644954 (0.0011) [2023-12-26 04:46:22,893][123091] Updated weights for policy 0, policy_version 649498 (0.0011) [2023-12-26 04:46:22,956][123091] Updated weights for policy 0, policy_version 649508 (0.0011) [2023-12-26 04:46:23,027][123091] Updated weights for policy 0, policy_version 649518 (0.0011) [2023-12-26 04:46:23,432][123090] Updated weights for policy 1, policy_version 644964 (0.0011) [2023-12-26 04:46:23,496][123090] Updated weights for policy 1, policy_version 644974 (0.0011) [2023-12-26 04:46:23,556][123090] Updated weights for policy 1, policy_version 644984 (0.0011) [2023-12-26 04:46:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 331399168. Throughput: 0: 8817.4, 1: 8771.9. Samples: 331376300. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:23,785][121949] Avg episode reward: [(0, '6216.478'), (1, '5717.245')] [2023-12-26 04:46:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000644992_165117952.pth... [2023-12-26 04:46:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000643968_164855808.pth [2023-12-26 04:46:23,836][123091] Updated weights for policy 0, policy_version 649528 (0.0011) [2023-12-26 04:46:23,887][123091] Updated weights for policy 0, policy_version 649538 (0.0010) [2023-12-26 04:46:23,945][123091] Updated weights for policy 0, policy_version 649548 (0.0010) [2023-12-26 04:46:23,975][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000649552_166289408.pth... [2023-12-26 04:46:23,980][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000648496_166019072.pth [2023-12-26 04:46:24,282][123090] Updated weights for policy 1, policy_version 644994 (0.0010) [2023-12-26 04:46:24,349][123090] Updated weights for policy 1, policy_version 645004 (0.0005) [2023-12-26 04:46:24,412][123090] Updated weights for policy 1, policy_version 645014 (0.0005) [2023-12-26 04:46:24,481][123090] Updated weights for policy 1, policy_version 645024 (0.0008) [2023-12-26 04:46:24,774][123091] Updated weights for policy 0, policy_version 649558 (0.0011) [2023-12-26 04:46:24,836][123091] Updated weights for policy 0, policy_version 649568 (0.0010) [2023-12-26 04:46:24,891][123091] Updated weights for policy 0, policy_version 649578 (0.0010) [2023-12-26 04:46:25,181][123090] Updated weights for policy 1, policy_version 645034 (0.0005) [2023-12-26 04:46:25,249][123090] Updated weights for policy 1, policy_version 645044 (0.0005) [2023-12-26 04:46:25,307][123090] Updated weights for policy 1, policy_version 645054 (0.0005) [2023-12-26 04:46:25,611][123091] Updated weights for policy 0, policy_version 649588 (0.0008) [2023-12-26 04:46:25,664][123091] Updated weights for policy 0, policy_version 649598 (0.0005) [2023-12-26 04:46:25,709][123091] Updated weights for policy 0, policy_version 649608 (0.0005) [2023-12-26 04:46:25,932][123090] Updated weights for policy 1, policy_version 645064 (0.0005) [2023-12-26 04:46:25,991][123090] Updated weights for policy 1, policy_version 645074 (0.0005) [2023-12-26 04:46:26,040][123090] Updated weights for policy 1, policy_version 645084 (0.0005) [2023-12-26 04:46:26,492][123091] Updated weights for policy 0, policy_version 649618 (0.0006) [2023-12-26 04:46:26,553][123091] Updated weights for policy 0, policy_version 649628 (0.0010) [2023-12-26 04:46:26,628][123091] Updated weights for policy 0, policy_version 649638 (0.0010) [2023-12-26 04:46:26,664][123090] Updated weights for policy 1, policy_version 645094 (0.0006) [2023-12-26 04:46:26,685][123091] Updated weights for policy 0, policy_version 649648 (0.0009) [2023-12-26 04:46:26,723][123090] Updated weights for policy 1, policy_version 645104 (0.0007) [2023-12-26 04:46:26,797][123090] Updated weights for policy 1, policy_version 645114 (0.0006) [2023-12-26 04:46:27,467][123091] Updated weights for policy 0, policy_version 649658 (0.0006) [2023-12-26 04:46:27,497][123090] Updated weights for policy 1, policy_version 645124 (0.0007) [2023-12-26 04:46:27,540][123091] Updated weights for policy 0, policy_version 649668 (0.0006) [2023-12-26 04:46:27,561][123090] Updated weights for policy 1, policy_version 645134 (0.0005) [2023-12-26 04:46:27,611][123091] Updated weights for policy 0, policy_version 649678 (0.0007) [2023-12-26 04:46:27,623][123090] Updated weights for policy 1, policy_version 645144 (0.0005) [2023-12-26 04:46:28,285][123091] Updated weights for policy 0, policy_version 649688 (0.0010) [2023-12-26 04:46:28,351][123091] Updated weights for policy 0, policy_version 649698 (0.0011) [2023-12-26 04:46:28,374][123090] Updated weights for policy 1, policy_version 645154 (0.0005) [2023-12-26 04:46:28,418][123091] Updated weights for policy 0, policy_version 649708 (0.0011) [2023-12-26 04:46:28,433][123090] Updated weights for policy 1, policy_version 645164 (0.0008) [2023-12-26 04:46:28,490][123090] Updated weights for policy 1, policy_version 645174 (0.0005) [2023-12-26 04:46:28,560][123090] Updated weights for policy 1, policy_version 645184 (0.0005) [2023-12-26 04:46:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 331497472. Throughput: 0: 8830.7, 1: 8940.2. Samples: 331488044. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:28,785][121949] Avg episode reward: [(0, '6124.896'), (1, '5599.906')] [2023-12-26 04:46:29,132][123091] Updated weights for policy 0, policy_version 649718 (0.0011) [2023-12-26 04:46:29,193][123090] Updated weights for policy 1, policy_version 645194 (0.0010) [2023-12-26 04:46:29,194][123091] Updated weights for policy 0, policy_version 649728 (0.0011) [2023-12-26 04:46:29,250][123091] Updated weights for policy 0, policy_version 649738 (0.0009) [2023-12-26 04:46:29,257][123090] Updated weights for policy 1, policy_version 645204 (0.0008) [2023-12-26 04:46:29,314][123090] Updated weights for policy 1, policy_version 645214 (0.0010) [2023-12-26 04:46:30,112][123090] Updated weights for policy 1, policy_version 645224 (0.0007) [2023-12-26 04:46:30,131][123091] Updated weights for policy 0, policy_version 649748 (0.0007) [2023-12-26 04:46:30,175][123090] Updated weights for policy 1, policy_version 645234 (0.0006) [2023-12-26 04:46:30,196][123091] Updated weights for policy 0, policy_version 649758 (0.0009) [2023-12-26 04:46:30,236][123090] Updated weights for policy 1, policy_version 645244 (0.0005) [2023-12-26 04:46:30,256][123091] Updated weights for policy 0, policy_version 649768 (0.0009) [2023-12-26 04:46:31,044][123090] Updated weights for policy 1, policy_version 645254 (0.0008) [2023-12-26 04:46:31,050][123091] Updated weights for policy 0, policy_version 649778 (0.0010) [2023-12-26 04:46:31,114][123090] Updated weights for policy 1, policy_version 645264 (0.0008) [2023-12-26 04:46:31,118][123091] Updated weights for policy 0, policy_version 649788 (0.0009) [2023-12-26 04:46:31,191][123091] Updated weights for policy 0, policy_version 649798 (0.0009) [2023-12-26 04:46:31,216][123090] Updated weights for policy 1, policy_version 645274 (0.0009) [2023-12-26 04:46:31,262][123091] Updated weights for policy 0, policy_version 649808 (0.0008) [2023-12-26 04:46:31,995][123091] Updated weights for policy 0, policy_version 649818 (0.0009) [2023-12-26 04:46:32,051][123090] Updated weights for policy 1, policy_version 645284 (0.0008) [2023-12-26 04:46:32,061][123091] Updated weights for policy 0, policy_version 649828 (0.0009) [2023-12-26 04:46:32,109][123090] Updated weights for policy 1, policy_version 645294 (0.0010) [2023-12-26 04:46:32,117][123091] Updated weights for policy 0, policy_version 649838 (0.0006) [2023-12-26 04:46:32,168][123090] Updated weights for policy 1, policy_version 645304 (0.0010) [2023-12-26 04:46:32,897][123090] Updated weights for policy 1, policy_version 645314 (0.0010) [2023-12-26 04:46:32,951][123090] Updated weights for policy 1, policy_version 645324 (0.0007) [2023-12-26 04:46:32,961][123091] Updated weights for policy 0, policy_version 649848 (0.0008) [2023-12-26 04:46:32,995][123090] Updated weights for policy 1, policy_version 645334 (0.0008) [2023-12-26 04:46:33,020][123091] Updated weights for policy 0, policy_version 649858 (0.0006) [2023-12-26 04:46:33,043][123090] Updated weights for policy 1, policy_version 645344 (0.0010) [2023-12-26 04:46:33,073][123091] Updated weights for policy 0, policy_version 649868 (0.0007) [2023-12-26 04:46:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 331579392. Throughput: 0: 8881.0, 1: 8917.2. Samples: 331594964. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:33,785][121949] Avg episode reward: [(0, '6208.681'), (1, '5618.132')] [2023-12-26 04:46:33,877][123090] Updated weights for policy 1, policy_version 645354 (0.0010) [2023-12-26 04:46:33,906][123091] Updated weights for policy 0, policy_version 649878 (0.0007) [2023-12-26 04:46:33,948][123090] Updated weights for policy 1, policy_version 645364 (0.0010) [2023-12-26 04:46:33,959][123091] Updated weights for policy 0, policy_version 649888 (0.0007) [2023-12-26 04:46:34,016][123090] Updated weights for policy 1, policy_version 645374 (0.0011) [2023-12-26 04:46:34,018][123091] Updated weights for policy 0, policy_version 649898 (0.0008) [2023-12-26 04:46:34,845][123090] Updated weights for policy 1, policy_version 645384 (0.0010) [2023-12-26 04:46:34,870][123091] Updated weights for policy 0, policy_version 649908 (0.0008) [2023-12-26 04:46:34,901][123090] Updated weights for policy 1, policy_version 645394 (0.0010) [2023-12-26 04:46:34,922][123091] Updated weights for policy 0, policy_version 649918 (0.0009) [2023-12-26 04:46:34,957][123090] Updated weights for policy 1, policy_version 645404 (0.0010) [2023-12-26 04:46:34,978][123091] Updated weights for policy 0, policy_version 649928 (0.0010) [2023-12-26 04:46:35,763][123090] Updated weights for policy 1, policy_version 645414 (0.0010) [2023-12-26 04:46:35,825][123090] Updated weights for policy 1, policy_version 645424 (0.0008) [2023-12-26 04:46:35,858][123091] Updated weights for policy 0, policy_version 649938 (0.0009) [2023-12-26 04:46:35,887][123090] Updated weights for policy 1, policy_version 645434 (0.0008) [2023-12-26 04:46:35,908][123091] Updated weights for policy 0, policy_version 649948 (0.0008) [2023-12-26 04:46:35,961][123091] Updated weights for policy 0, policy_version 649958 (0.0010) [2023-12-26 04:46:36,010][123091] Updated weights for policy 0, policy_version 649968 (0.0009) [2023-12-26 04:46:36,715][123090] Updated weights for policy 1, policy_version 645444 (0.0010) [2023-12-26 04:46:36,786][123090] Updated weights for policy 1, policy_version 645454 (0.0010) [2023-12-26 04:46:36,848][123090] Updated weights for policy 1, policy_version 645464 (0.0008) [2023-12-26 04:46:36,868][123091] Updated weights for policy 0, policy_version 649978 (0.0009) [2023-12-26 04:46:36,927][123091] Updated weights for policy 0, policy_version 649988 (0.0008) [2023-12-26 04:46:36,983][123091] Updated weights for policy 0, policy_version 649998 (0.0010) [2023-12-26 04:46:37,690][123090] Updated weights for policy 1, policy_version 645474 (0.0007) [2023-12-26 04:46:37,755][123090] Updated weights for policy 1, policy_version 645484 (0.0010) [2023-12-26 04:46:37,822][123090] Updated weights for policy 1, policy_version 645494 (0.0008) [2023-12-26 04:46:37,836][123091] Updated weights for policy 0, policy_version 650008 (0.0010) [2023-12-26 04:46:37,878][123090] Updated weights for policy 1, policy_version 645504 (0.0006) [2023-12-26 04:46:37,901][123091] Updated weights for policy 0, policy_version 650018 (0.0010) [2023-12-26 04:46:37,955][123091] Updated weights for policy 0, policy_version 650028 (0.0010) [2023-12-26 04:46:38,657][123090] Updated weights for policy 1, policy_version 645514 (0.0010) [2023-12-26 04:46:38,719][123090] Updated weights for policy 1, policy_version 645524 (0.0008) [2023-12-26 04:46:38,780][123090] Updated weights for policy 1, policy_version 645534 (0.0009) [2023-12-26 04:46:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 331661312. Throughput: 0: 8875.4, 1: 8929.6. Samples: 331646208. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:38,785][121949] Avg episode reward: [(0, '6297.400'), (1, '5624.389')] [2023-12-26 04:46:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000645536_165257216.pth... [2023-12-26 04:46:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000644480_164986880.pth [2023-12-26 04:46:38,826][123091] Updated weights for policy 0, policy_version 650038 (0.0009) [2023-12-26 04:46:38,893][123091] Updated weights for policy 0, policy_version 650048 (0.0009) [2023-12-26 04:46:38,959][123091] Updated weights for policy 0, policy_version 650058 (0.0009) [2023-12-26 04:46:38,998][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000650064_166420480.pth... [2023-12-26 04:46:39,012][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000649008_166150144.pth [2023-12-26 04:46:39,656][123090] Updated weights for policy 1, policy_version 645544 (0.0009) [2023-12-26 04:46:39,718][123090] Updated weights for policy 1, policy_version 645554 (0.0010) [2023-12-26 04:46:39,783][123090] Updated weights for policy 1, policy_version 645564 (0.0008) [2023-12-26 04:46:39,790][123091] Updated weights for policy 0, policy_version 650068 (0.0010) [2023-12-26 04:46:39,846][123091] Updated weights for policy 0, policy_version 650078 (0.0010) [2023-12-26 04:46:39,914][123091] Updated weights for policy 0, policy_version 650088 (0.0010) [2023-12-26 04:46:40,577][123090] Updated weights for policy 1, policy_version 645574 (0.0008) [2023-12-26 04:46:40,635][123090] Updated weights for policy 1, policy_version 645584 (0.0005) [2023-12-26 04:46:40,685][123091] Updated weights for policy 0, policy_version 650098 (0.0008) [2023-12-26 04:46:40,704][123090] Updated weights for policy 1, policy_version 645594 (0.0006) [2023-12-26 04:46:40,750][123091] Updated weights for policy 0, policy_version 650108 (0.0005) [2023-12-26 04:46:40,821][123091] Updated weights for policy 0, policy_version 650118 (0.0006) [2023-12-26 04:46:40,895][123091] Updated weights for policy 0, policy_version 650128 (0.0006) [2023-12-26 04:46:41,437][123090] Updated weights for policy 1, policy_version 645604 (0.0010) [2023-12-26 04:46:41,503][123090] Updated weights for policy 1, policy_version 645614 (0.0009) [2023-12-26 04:46:41,563][123090] Updated weights for policy 1, policy_version 645624 (0.0009) [2023-12-26 04:46:41,672][123091] Updated weights for policy 0, policy_version 650138 (0.0008) [2023-12-26 04:46:41,739][123091] Updated weights for policy 0, policy_version 650148 (0.0008) [2023-12-26 04:46:41,794][123091] Updated weights for policy 0, policy_version 650158 (0.0006) [2023-12-26 04:46:42,406][123090] Updated weights for policy 1, policy_version 645634 (0.0008) [2023-12-26 04:46:42,457][123090] Updated weights for policy 1, policy_version 645644 (0.0009) [2023-12-26 04:46:42,508][123090] Updated weights for policy 1, policy_version 645654 (0.0010) [2023-12-26 04:46:42,534][123091] Updated weights for policy 0, policy_version 650168 (0.0007) [2023-12-26 04:46:42,568][123090] Updated weights for policy 1, policy_version 645664 (0.0009) [2023-12-26 04:46:42,601][123091] Updated weights for policy 0, policy_version 650178 (0.0009) [2023-12-26 04:46:42,661][123091] Updated weights for policy 0, policy_version 650188 (0.0010) [2023-12-26 04:46:43,299][123090] Updated weights for policy 1, policy_version 645674 (0.0010) [2023-12-26 04:46:43,354][123090] Updated weights for policy 1, policy_version 645684 (0.0010) [2023-12-26 04:46:43,382][123091] Updated weights for policy 0, policy_version 650198 (0.0010) [2023-12-26 04:46:43,410][123090] Updated weights for policy 1, policy_version 645694 (0.0010) [2023-12-26 04:46:43,426][123091] Updated weights for policy 0, policy_version 650208 (0.0005) [2023-12-26 04:46:43,474][123091] Updated weights for policy 0, policy_version 650218 (0.0005) [2023-12-26 04:46:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 331759616. Throughput: 0: 8798.3, 1: 8875.1. Samples: 331749668. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:43,785][121949] Avg episode reward: [(0, '6260.763'), (1, '5551.388')] [2023-12-26 04:46:44,068][123090] Updated weights for policy 1, policy_version 645704 (0.0006) [2023-12-26 04:46:44,115][123090] Updated weights for policy 1, policy_version 645714 (0.0005) [2023-12-26 04:46:44,172][123090] Updated weights for policy 1, policy_version 645724 (0.0009) [2023-12-26 04:46:44,262][123091] Updated weights for policy 0, policy_version 650228 (0.0007) [2023-12-26 04:46:44,309][123091] Updated weights for policy 0, policy_version 650238 (0.0010) [2023-12-26 04:46:44,356][123091] Updated weights for policy 0, policy_version 650248 (0.0010) [2023-12-26 04:46:44,980][123090] Updated weights for policy 1, policy_version 645734 (0.0010) [2023-12-26 04:46:45,032][123091] Updated weights for policy 0, policy_version 650258 (0.0006) [2023-12-26 04:46:45,041][123090] Updated weights for policy 1, policy_version 645744 (0.0011) [2023-12-26 04:46:45,101][123091] Updated weights for policy 0, policy_version 650268 (0.0008) [2023-12-26 04:46:45,101][123090] Updated weights for policy 1, policy_version 645754 (0.0011) [2023-12-26 04:46:45,167][123091] Updated weights for policy 0, policy_version 650278 (0.0008) [2023-12-26 04:46:45,229][123091] Updated weights for policy 0, policy_version 650288 (0.0008) [2023-12-26 04:46:45,885][123091] Updated weights for policy 0, policy_version 650298 (0.0011) [2023-12-26 04:46:45,900][123090] Updated weights for policy 1, policy_version 645764 (0.0009) [2023-12-26 04:46:45,940][123091] Updated weights for policy 0, policy_version 650308 (0.0010) [2023-12-26 04:46:45,957][123090] Updated weights for policy 1, policy_version 645774 (0.0007) [2023-12-26 04:46:45,998][123091] Updated weights for policy 0, policy_version 650318 (0.0011) [2023-12-26 04:46:46,022][123090] Updated weights for policy 1, policy_version 645784 (0.0010) [2023-12-26 04:46:46,762][123090] Updated weights for policy 1, policy_version 645794 (0.0008) [2023-12-26 04:46:46,820][123091] Updated weights for policy 0, policy_version 650328 (0.0010) [2023-12-26 04:46:46,823][123090] Updated weights for policy 1, policy_version 645804 (0.0008) [2023-12-26 04:46:46,879][123091] Updated weights for policy 0, policy_version 650338 (0.0011) [2023-12-26 04:46:46,890][123090] Updated weights for policy 1, policy_version 645814 (0.0006) [2023-12-26 04:46:46,930][123091] Updated weights for policy 0, policy_version 650348 (0.0010) [2023-12-26 04:46:46,949][123090] Updated weights for policy 1, policy_version 645824 (0.0005) [2023-12-26 04:46:47,731][123091] Updated weights for policy 0, policy_version 650358 (0.0010) [2023-12-26 04:46:47,778][123090] Updated weights for policy 1, policy_version 645834 (0.0010) [2023-12-26 04:46:47,784][123091] Updated weights for policy 0, policy_version 650368 (0.0007) [2023-12-26 04:46:47,832][123090] Updated weights for policy 1, policy_version 645844 (0.0009) [2023-12-26 04:46:47,859][123091] Updated weights for policy 0, policy_version 650378 (0.0005) [2023-12-26 04:46:47,893][123090] Updated weights for policy 1, policy_version 645854 (0.0009) [2023-12-26 04:46:48,528][123091] Updated weights for policy 0, policy_version 650388 (0.0006) [2023-12-26 04:46:48,592][123091] Updated weights for policy 0, policy_version 650398 (0.0007) [2023-12-26 04:46:48,638][123090] Updated weights for policy 1, policy_version 645864 (0.0007) [2023-12-26 04:46:48,645][123091] Updated weights for policy 0, policy_version 650408 (0.0008) [2023-12-26 04:46:48,704][123090] Updated weights for policy 1, policy_version 645874 (0.0010) [2023-12-26 04:46:48,770][123090] Updated weights for policy 1, policy_version 645884 (0.0009) [2023-12-26 04:46:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 331849728. Throughput: 0: 8901.6, 1: 8980.9. Samples: 331861996. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:48,785][121949] Avg episode reward: [(0, '6228.685'), (1, '5664.516')] [2023-12-26 04:46:49,436][123091] Updated weights for policy 0, policy_version 650418 (0.0006) [2023-12-26 04:46:49,490][123091] Updated weights for policy 0, policy_version 650428 (0.0005) [2023-12-26 04:46:49,540][123091] Updated weights for policy 0, policy_version 650438 (0.0005) [2023-12-26 04:46:49,590][123091] Updated weights for policy 0, policy_version 650448 (0.0006) [2023-12-26 04:46:49,599][123090] Updated weights for policy 1, policy_version 645894 (0.0007) [2023-12-26 04:46:49,663][123090] Updated weights for policy 1, policy_version 645904 (0.0006) [2023-12-26 04:46:49,735][123090] Updated weights for policy 1, policy_version 645914 (0.0006) [2023-12-26 04:46:50,354][123091] Updated weights for policy 0, policy_version 650458 (0.0009) [2023-12-26 04:46:50,400][123091] Updated weights for policy 0, policy_version 650468 (0.0008) [2023-12-26 04:46:50,465][123091] Updated weights for policy 0, policy_version 650478 (0.0009) [2023-12-26 04:46:50,472][123090] Updated weights for policy 1, policy_version 645924 (0.0006) [2023-12-26 04:46:50,546][123090] Updated weights for policy 1, policy_version 645934 (0.0006) [2023-12-26 04:46:50,621][123090] Updated weights for policy 1, policy_version 645944 (0.0008) [2023-12-26 04:46:51,299][123091] Updated weights for policy 0, policy_version 650488 (0.0008) [2023-12-26 04:46:51,365][123091] Updated weights for policy 0, policy_version 650498 (0.0006) [2023-12-26 04:46:51,414][123090] Updated weights for policy 1, policy_version 645954 (0.0008) [2023-12-26 04:46:51,432][123091] Updated weights for policy 0, policy_version 650508 (0.0006) [2023-12-26 04:46:51,478][123090] Updated weights for policy 1, policy_version 645964 (0.0010) [2023-12-26 04:46:51,545][123090] Updated weights for policy 1, policy_version 645974 (0.0009) [2023-12-26 04:46:51,608][123090] Updated weights for policy 1, policy_version 645984 (0.0008) [2023-12-26 04:46:52,223][123091] Updated weights for policy 0, policy_version 650518 (0.0009) [2023-12-26 04:46:52,289][123091] Updated weights for policy 0, policy_version 650528 (0.0010) [2023-12-26 04:46:52,359][123091] Updated weights for policy 0, policy_version 650538 (0.0009) [2023-12-26 04:46:52,460][123090] Updated weights for policy 1, policy_version 645994 (0.0010) [2023-12-26 04:46:52,525][123090] Updated weights for policy 1, policy_version 646004 (0.0010) [2023-12-26 04:46:52,589][123090] Updated weights for policy 1, policy_version 646014 (0.0007) [2023-12-26 04:46:53,173][123091] Updated weights for policy 0, policy_version 650548 (0.0007) [2023-12-26 04:46:53,220][123091] Updated weights for policy 0, policy_version 650558 (0.0005) [2023-12-26 04:46:53,266][123091] Updated weights for policy 0, policy_version 650568 (0.0005) [2023-12-26 04:46:53,385][123090] Updated weights for policy 1, policy_version 646024 (0.0009) [2023-12-26 04:46:53,441][123090] Updated weights for policy 1, policy_version 646034 (0.0009) [2023-12-26 04:46:53,491][123090] Updated weights for policy 1, policy_version 646044 (0.0009) [2023-12-26 04:46:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 331939840. Throughput: 0: 8912.6, 1: 8966.3. Samples: 331914868. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:53,785][121949] Avg episode reward: [(0, '6206.609'), (1, '5488.881')] [2023-12-26 04:46:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000646048_165388288.pth... [2023-12-26 04:46:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000650576_166551552.pth... [2023-12-26 04:46:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000644992_165117952.pth [2023-12-26 04:46:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000649552_166289408.pth [2023-12-26 04:46:53,973][123091] Updated weights for policy 0, policy_version 650578 (0.0005) [2023-12-26 04:46:54,030][123091] Updated weights for policy 0, policy_version 650588 (0.0005) [2023-12-26 04:46:54,076][123091] Updated weights for policy 0, policy_version 650598 (0.0005) [2023-12-26 04:46:54,130][123091] Updated weights for policy 0, policy_version 650608 (0.0005) [2023-12-26 04:46:54,417][123090] Updated weights for policy 1, policy_version 646054 (0.0009) [2023-12-26 04:46:54,472][123090] Updated weights for policy 1, policy_version 646064 (0.0009) [2023-12-26 04:46:54,522][123090] Updated weights for policy 1, policy_version 646074 (0.0009) [2023-12-26 04:46:54,772][123091] Updated weights for policy 0, policy_version 650618 (0.0005) [2023-12-26 04:46:54,819][123091] Updated weights for policy 0, policy_version 650628 (0.0005) [2023-12-26 04:46:54,872][123091] Updated weights for policy 0, policy_version 650638 (0.0005) [2023-12-26 04:46:55,422][123090] Updated weights for policy 1, policy_version 646085 (0.0010) [2023-12-26 04:46:55,476][123090] Updated weights for policy 1, policy_version 646095 (0.0010) [2023-12-26 04:46:55,531][123090] Updated weights for policy 1, policy_version 646105 (0.0010) [2023-12-26 04:46:55,651][123091] Updated weights for policy 0, policy_version 650648 (0.0009) [2023-12-26 04:46:55,704][123091] Updated weights for policy 0, policy_version 650658 (0.0008) [2023-12-26 04:46:55,762][123091] Updated weights for policy 0, policy_version 650668 (0.0009) [2023-12-26 04:46:56,403][123090] Updated weights for policy 1, policy_version 646115 (0.0010) [2023-12-26 04:46:56,462][123090] Updated weights for policy 1, policy_version 646125 (0.0009) [2023-12-26 04:46:56,518][123090] Updated weights for policy 1, policy_version 646135 (0.0009) [2023-12-26 04:46:56,591][123091] Updated weights for policy 0, policy_version 650678 (0.0009) [2023-12-26 04:46:56,644][123091] Updated weights for policy 0, policy_version 650688 (0.0009) [2023-12-26 04:46:56,693][123091] Updated weights for policy 0, policy_version 650698 (0.0009) [2023-12-26 04:46:57,311][123090] Updated weights for policy 1, policy_version 646145 (0.0009) [2023-12-26 04:46:57,362][123090] Updated weights for policy 1, policy_version 646155 (0.0010) [2023-12-26 04:46:57,408][123090] Updated weights for policy 1, policy_version 646165 (0.0010) [2023-12-26 04:46:57,457][123091] Updated weights for policy 0, policy_version 650708 (0.0007) [2023-12-26 04:46:57,459][123090] Updated weights for policy 1, policy_version 646175 (0.0010) [2023-12-26 04:46:57,512][123091] Updated weights for policy 0, policy_version 650718 (0.0008) [2023-12-26 04:46:57,558][123091] Updated weights for policy 0, policy_version 650729 (0.0008) [2023-12-26 04:46:58,197][123090] Updated weights for policy 1, policy_version 646185 (0.0011) [2023-12-26 04:46:58,273][123090] Updated weights for policy 1, policy_version 646195 (0.0010) [2023-12-26 04:46:58,311][123091] Updated weights for policy 0, policy_version 650739 (0.0006) [2023-12-26 04:46:58,341][123090] Updated weights for policy 1, policy_version 646205 (0.0011) [2023-12-26 04:46:58,380][123091] Updated weights for policy 0, policy_version 650749 (0.0010) [2023-12-26 04:46:58,447][123091] Updated weights for policy 0, policy_version 650759 (0.0010) [2023-12-26 04:46:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.4, 300 sec: 17800.2). Total num frames: 332029952. Throughput: 0: 9024.6, 1: 8932.7. Samples: 332021512. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:46:58,785][121949] Avg episode reward: [(0, '6175.411'), (1, '5377.245')] [2023-12-26 04:46:59,124][123090] Updated weights for policy 1, policy_version 646215 (0.0007) [2023-12-26 04:46:59,194][123090] Updated weights for policy 1, policy_version 646225 (0.0006) [2023-12-26 04:46:59,264][123090] Updated weights for policy 1, policy_version 646235 (0.0010) [2023-12-26 04:46:59,285][123091] Updated weights for policy 0, policy_version 650769 (0.0010) [2023-12-26 04:46:59,344][123091] Updated weights for policy 0, policy_version 650779 (0.0010) [2023-12-26 04:46:59,408][123091] Updated weights for policy 0, policy_version 650789 (0.0010) [2023-12-26 04:46:59,477][123091] Updated weights for policy 0, policy_version 650799 (0.0010) [2023-12-26 04:47:00,019][123090] Updated weights for policy 1, policy_version 646245 (0.0010) [2023-12-26 04:47:00,072][123090] Updated weights for policy 1, policy_version 646255 (0.0008) [2023-12-26 04:47:00,126][123090] Updated weights for policy 1, policy_version 646265 (0.0009) [2023-12-26 04:47:00,260][123091] Updated weights for policy 0, policy_version 650809 (0.0006) [2023-12-26 04:47:00,318][123091] Updated weights for policy 0, policy_version 650819 (0.0006) [2023-12-26 04:47:00,373][123091] Updated weights for policy 0, policy_version 650829 (0.0007) [2023-12-26 04:47:00,988][123090] Updated weights for policy 1, policy_version 646275 (0.0010) [2023-12-26 04:47:01,052][123090] Updated weights for policy 1, policy_version 646285 (0.0010) [2023-12-26 04:47:01,114][123090] Updated weights for policy 1, policy_version 646295 (0.0011) [2023-12-26 04:47:01,147][123091] Updated weights for policy 0, policy_version 650839 (0.0007) [2023-12-26 04:47:01,210][123091] Updated weights for policy 0, policy_version 650849 (0.0009) [2023-12-26 04:47:01,271][123091] Updated weights for policy 0, policy_version 650859 (0.0009) [2023-12-26 04:47:01,913][123090] Updated weights for policy 1, policy_version 646305 (0.0010) [2023-12-26 04:47:01,979][123090] Updated weights for policy 1, policy_version 646315 (0.0007) [2023-12-26 04:47:02,046][123090] Updated weights for policy 1, policy_version 646325 (0.0010) [2023-12-26 04:47:02,095][123091] Updated weights for policy 0, policy_version 650869 (0.0010) [2023-12-26 04:47:02,116][123090] Updated weights for policy 1, policy_version 646335 (0.0006) [2023-12-26 04:47:02,168][123091] Updated weights for policy 0, policy_version 650879 (0.0009) [2023-12-26 04:47:02,239][123091] Updated weights for policy 0, policy_version 650889 (0.0010) [2023-12-26 04:47:02,836][123090] Updated weights for policy 1, policy_version 646345 (0.0008) [2023-12-26 04:47:02,901][123090] Updated weights for policy 1, policy_version 646355 (0.0010) [2023-12-26 04:47:02,964][123090] Updated weights for policy 1, policy_version 646365 (0.0008) [2023-12-26 04:47:03,095][123091] Updated weights for policy 0, policy_version 650899 (0.0009) [2023-12-26 04:47:03,144][123091] Updated weights for policy 0, policy_version 650909 (0.0009) [2023-12-26 04:47:03,197][123091] Updated weights for policy 0, policy_version 650919 (0.0010) [2023-12-26 04:47:03,714][123090] Updated weights for policy 1, policy_version 646375 (0.0006) [2023-12-26 04:47:03,778][123090] Updated weights for policy 1, policy_version 646385 (0.0005) [2023-12-26 04:47:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 332111872. Throughput: 0: 8929.2, 1: 8899.9. Samples: 332128220. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:03,784][121949] Avg episode reward: [(0, '6187.143'), (1, '5462.649')] [2023-12-26 04:47:03,834][123090] Updated weights for policy 1, policy_version 646395 (0.0006) [2023-12-26 04:47:04,041][123091] Updated weights for policy 0, policy_version 650929 (0.0009) [2023-12-26 04:47:04,115][123091] Updated weights for policy 0, policy_version 650939 (0.0010) [2023-12-26 04:47:04,184][123091] Updated weights for policy 0, policy_version 650949 (0.0010) [2023-12-26 04:47:04,250][123091] Updated weights for policy 0, policy_version 650959 (0.0010) [2023-12-26 04:47:04,637][123090] Updated weights for policy 1, policy_version 646405 (0.0009) [2023-12-26 04:47:04,689][123090] Updated weights for policy 1, policy_version 646415 (0.0010) [2023-12-26 04:47:04,758][123090] Updated weights for policy 1, policy_version 646425 (0.0009) [2023-12-26 04:47:05,047][123091] Updated weights for policy 0, policy_version 650969 (0.0010) [2023-12-26 04:47:05,099][123091] Updated weights for policy 0, policy_version 650979 (0.0010) [2023-12-26 04:47:05,150][123091] Updated weights for policy 0, policy_version 650989 (0.0010) [2023-12-26 04:47:05,610][123090] Updated weights for policy 1, policy_version 646435 (0.0010) [2023-12-26 04:47:05,663][123090] Updated weights for policy 1, policy_version 646445 (0.0009) [2023-12-26 04:47:05,710][123090] Updated weights for policy 1, policy_version 646455 (0.0009) [2023-12-26 04:47:05,998][123091] Updated weights for policy 0, policy_version 650999 (0.0007) [2023-12-26 04:47:06,067][123091] Updated weights for policy 0, policy_version 651009 (0.0006) [2023-12-26 04:47:06,138][123091] Updated weights for policy 0, policy_version 651019 (0.0010) [2023-12-26 04:47:06,574][123090] Updated weights for policy 1, policy_version 646465 (0.0009) [2023-12-26 04:47:06,634][123090] Updated weights for policy 1, policy_version 646475 (0.0009) [2023-12-26 04:47:06,703][123090] Updated weights for policy 1, policy_version 646485 (0.0010) [2023-12-26 04:47:06,766][123090] Updated weights for policy 1, policy_version 646495 (0.0009) [2023-12-26 04:47:06,855][123091] Updated weights for policy 0, policy_version 651029 (0.0011) [2023-12-26 04:47:06,913][123091] Updated weights for policy 0, policy_version 651039 (0.0009) [2023-12-26 04:47:06,976][123091] Updated weights for policy 0, policy_version 651049 (0.0006) [2023-12-26 04:47:07,519][123090] Updated weights for policy 1, policy_version 646505 (0.0006) [2023-12-26 04:47:07,593][123090] Updated weights for policy 1, policy_version 646515 (0.0005) [2023-12-26 04:47:07,665][123090] Updated weights for policy 1, policy_version 646525 (0.0005) [2023-12-26 04:47:07,725][123091] Updated weights for policy 0, policy_version 651059 (0.0006) [2023-12-26 04:47:07,779][123091] Updated weights for policy 0, policy_version 651069 (0.0005) [2023-12-26 04:47:07,828][123091] Updated weights for policy 0, policy_version 651079 (0.0005) [2023-12-26 04:47:08,486][123090] Updated weights for policy 1, policy_version 646535 (0.0008) [2023-12-26 04:47:08,548][123090] Updated weights for policy 1, policy_version 646545 (0.0009) [2023-12-26 04:47:08,603][123090] Updated weights for policy 1, policy_version 646555 (0.0008) [2023-12-26 04:47:08,627][123091] Updated weights for policy 0, policy_version 651089 (0.0008) [2023-12-26 04:47:08,679][123091] Updated weights for policy 0, policy_version 651099 (0.0010) [2023-12-26 04:47:08,743][123091] Updated weights for policy 0, policy_version 651109 (0.0011) [2023-12-26 04:47:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 332201984. Throughput: 0: 8959.4, 1: 8905.4. Samples: 332180216. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:08,785][121949] Avg episode reward: [(0, '6220.120'), (1, '5424.769')] [2023-12-26 04:47:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000646560_165519360.pth... [2023-12-26 04:47:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000645536_165257216.pth [2023-12-26 04:47:08,806][123091] Updated weights for policy 0, policy_version 651119 (0.0011) [2023-12-26 04:47:08,813][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000651120_166690816.pth... [2023-12-26 04:47:08,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000650064_166420480.pth [2023-12-26 04:47:09,454][123090] Updated weights for policy 1, policy_version 646565 (0.0008) [2023-12-26 04:47:09,521][123090] Updated weights for policy 1, policy_version 646575 (0.0006) [2023-12-26 04:47:09,584][123090] Updated weights for policy 1, policy_version 646585 (0.0006) [2023-12-26 04:47:09,654][123091] Updated weights for policy 0, policy_version 651129 (0.0011) [2023-12-26 04:47:09,729][123091] Updated weights for policy 0, policy_version 651139 (0.0010) [2023-12-26 04:47:09,786][123091] Updated weights for policy 0, policy_version 651149 (0.0011) [2023-12-26 04:47:10,350][123090] Updated weights for policy 1, policy_version 646595 (0.0007) [2023-12-26 04:47:10,398][123090] Updated weights for policy 1, policy_version 646605 (0.0009) [2023-12-26 04:47:10,448][123090] Updated weights for policy 1, policy_version 646615 (0.0006) [2023-12-26 04:47:10,644][123091] Updated weights for policy 0, policy_version 651159 (0.0011) [2023-12-26 04:47:10,713][123091] Updated weights for policy 0, policy_version 651169 (0.0010) [2023-12-26 04:47:10,775][123091] Updated weights for policy 0, policy_version 651179 (0.0010) [2023-12-26 04:47:11,234][123090] Updated weights for policy 1, policy_version 646625 (0.0006) [2023-12-26 04:47:11,309][123090] Updated weights for policy 1, policy_version 646635 (0.0008) [2023-12-26 04:47:11,379][123090] Updated weights for policy 1, policy_version 646645 (0.0007) [2023-12-26 04:47:11,455][123090] Updated weights for policy 1, policy_version 646655 (0.0008) [2023-12-26 04:47:11,580][123091] Updated weights for policy 0, policy_version 651189 (0.0011) [2023-12-26 04:47:11,650][123091] Updated weights for policy 0, policy_version 651199 (0.0008) [2023-12-26 04:47:11,724][123091] Updated weights for policy 0, policy_version 651209 (0.0011) [2023-12-26 04:47:12,140][123090] Updated weights for policy 1, policy_version 646665 (0.0009) [2023-12-26 04:47:12,216][123090] Updated weights for policy 1, policy_version 646675 (0.0011) [2023-12-26 04:47:12,283][123090] Updated weights for policy 1, policy_version 646685 (0.0010) [2023-12-26 04:47:12,530][123091] Updated weights for policy 0, policy_version 651219 (0.0011) [2023-12-26 04:47:12,588][123091] Updated weights for policy 0, policy_version 651229 (0.0006) [2023-12-26 04:47:12,637][123091] Updated weights for policy 0, policy_version 651239 (0.0007) [2023-12-26 04:47:12,977][123090] Updated weights for policy 1, policy_version 646695 (0.0006) [2023-12-26 04:47:13,028][123090] Updated weights for policy 1, policy_version 646705 (0.0005) [2023-12-26 04:47:13,075][123090] Updated weights for policy 1, policy_version 646715 (0.0006) [2023-12-26 04:47:13,230][123091] Updated weights for policy 0, policy_version 651249 (0.0006) [2023-12-26 04:47:13,290][123091] Updated weights for policy 0, policy_version 651259 (0.0005) [2023-12-26 04:47:13,350][123091] Updated weights for policy 0, policy_version 651269 (0.0006) [2023-12-26 04:47:13,404][123091] Updated weights for policy 0, policy_version 651279 (0.0008) [2023-12-26 04:47:13,751][123090] Updated weights for policy 1, policy_version 646725 (0.0005) [2023-12-26 04:47:13,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 332292096. Throughput: 0: 8931.7, 1: 8800.8. Samples: 332286012. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:13,786][121949] Avg episode reward: [(0, '6262.736'), (1, '5553.922')] [2023-12-26 04:47:13,829][123090] Updated weights for policy 1, policy_version 646735 (0.0006) [2023-12-26 04:47:13,904][123090] Updated weights for policy 1, policy_version 646745 (0.0005) [2023-12-26 04:47:14,068][123091] Updated weights for policy 0, policy_version 651289 (0.0006) [2023-12-26 04:47:14,126][123091] Updated weights for policy 0, policy_version 651299 (0.0005) [2023-12-26 04:47:14,171][123091] Updated weights for policy 0, policy_version 651309 (0.0005) [2023-12-26 04:47:14,625][123090] Updated weights for policy 1, policy_version 646755 (0.0006) [2023-12-26 04:47:14,678][123090] Updated weights for policy 1, policy_version 646765 (0.0009) [2023-12-26 04:47:14,724][123090] Updated weights for policy 1, policy_version 646775 (0.0007) [2023-12-26 04:47:14,949][123091] Updated weights for policy 0, policy_version 651319 (0.0009) [2023-12-26 04:47:15,005][123091] Updated weights for policy 0, policy_version 651329 (0.0010) [2023-12-26 04:47:15,064][123091] Updated weights for policy 0, policy_version 651339 (0.0009) [2023-12-26 04:47:15,498][123090] Updated weights for policy 1, policy_version 646785 (0.0007) [2023-12-26 04:47:15,559][123090] Updated weights for policy 1, policy_version 646795 (0.0005) [2023-12-26 04:47:15,621][123090] Updated weights for policy 1, policy_version 646805 (0.0006) [2023-12-26 04:47:15,671][123090] Updated weights for policy 1, policy_version 646815 (0.0008) [2023-12-26 04:47:15,778][123091] Updated weights for policy 0, policy_version 651349 (0.0009) [2023-12-26 04:47:15,842][123091] Updated weights for policy 0, policy_version 651359 (0.0010) [2023-12-26 04:47:15,901][123091] Updated weights for policy 0, policy_version 651369 (0.0009) [2023-12-26 04:47:16,468][123090] Updated weights for policy 1, policy_version 646825 (0.0010) [2023-12-26 04:47:16,526][123090] Updated weights for policy 1, policy_version 646835 (0.0011) [2023-12-26 04:47:16,599][123090] Updated weights for policy 1, policy_version 646845 (0.0006) [2023-12-26 04:47:16,649][123091] Updated weights for policy 0, policy_version 651379 (0.0009) [2023-12-26 04:47:16,705][123091] Updated weights for policy 0, policy_version 651389 (0.0010) [2023-12-26 04:47:16,764][123091] Updated weights for policy 0, policy_version 651400 (0.0011) [2023-12-26 04:47:17,286][123090] Updated weights for policy 1, policy_version 646855 (0.0005) [2023-12-26 04:47:17,343][123090] Updated weights for policy 1, policy_version 646865 (0.0006) [2023-12-26 04:47:17,402][123090] Updated weights for policy 1, policy_version 646875 (0.0010) [2023-12-26 04:47:17,686][123091] Updated weights for policy 0, policy_version 651411 (0.0010) [2023-12-26 04:47:17,750][123091] Updated weights for policy 0, policy_version 651421 (0.0009) [2023-12-26 04:47:17,807][123091] Updated weights for policy 0, policy_version 651431 (0.0009) [2023-12-26 04:47:18,120][123090] Updated weights for policy 1, policy_version 646885 (0.0008) [2023-12-26 04:47:18,174][123090] Updated weights for policy 1, policy_version 646895 (0.0006) [2023-12-26 04:47:18,224][123090] Updated weights for policy 1, policy_version 646905 (0.0005) [2023-12-26 04:47:18,717][123091] Updated weights for policy 0, policy_version 651441 (0.0009) [2023-12-26 04:47:18,766][123091] Updated weights for policy 0, policy_version 651451 (0.0005) [2023-12-26 04:47:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 332382208. Throughput: 0: 8964.0, 1: 8897.6. Samples: 332398732. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:18,785][121949] Avg episode reward: [(0, '6244.751'), (1, '5552.534')] [2023-12-26 04:47:18,819][123091] Updated weights for policy 0, policy_version 651461 (0.0008) [2023-12-26 04:47:18,878][123091] Updated weights for policy 0, policy_version 651471 (0.0005) [2023-12-26 04:47:19,018][123090] Updated weights for policy 1, policy_version 646915 (0.0009) [2023-12-26 04:47:19,066][123090] Updated weights for policy 1, policy_version 646925 (0.0010) [2023-12-26 04:47:19,129][123090] Updated weights for policy 1, policy_version 646935 (0.0010) [2023-12-26 04:47:19,682][123091] Updated weights for policy 0, policy_version 651481 (0.0007) [2023-12-26 04:47:19,745][123091] Updated weights for policy 0, policy_version 651491 (0.0008) [2023-12-26 04:47:19,806][123091] Updated weights for policy 0, policy_version 651501 (0.0009) [2023-12-26 04:47:19,928][123090] Updated weights for policy 1, policy_version 646945 (0.0010) [2023-12-26 04:47:20,002][123090] Updated weights for policy 1, policy_version 646955 (0.0009) [2023-12-26 04:47:20,072][123090] Updated weights for policy 1, policy_version 646965 (0.0009) [2023-12-26 04:47:20,134][123090] Updated weights for policy 1, policy_version 646975 (0.0009) [2023-12-26 04:47:20,612][123091] Updated weights for policy 0, policy_version 651511 (0.0009) [2023-12-26 04:47:20,675][123091] Updated weights for policy 0, policy_version 651521 (0.0010) [2023-12-26 04:47:20,740][123091] Updated weights for policy 0, policy_version 651531 (0.0007) [2023-12-26 04:47:20,935][123090] Updated weights for policy 1, policy_version 646985 (0.0010) [2023-12-26 04:47:21,007][123090] Updated weights for policy 1, policy_version 646995 (0.0010) [2023-12-26 04:47:21,074][123090] Updated weights for policy 1, policy_version 647005 (0.0010) [2023-12-26 04:47:21,497][123091] Updated weights for policy 0, policy_version 651541 (0.0008) [2023-12-26 04:47:21,553][123091] Updated weights for policy 0, policy_version 651551 (0.0006) [2023-12-26 04:47:21,602][123091] Updated weights for policy 0, policy_version 651561 (0.0006) [2023-12-26 04:47:22,014][123090] Updated weights for policy 1, policy_version 647015 (0.0009) [2023-12-26 04:47:22,069][123090] Updated weights for policy 1, policy_version 647025 (0.0008) [2023-12-26 04:47:22,131][123090] Updated weights for policy 1, policy_version 647035 (0.0009) [2023-12-26 04:47:22,444][123091] Updated weights for policy 0, policy_version 651571 (0.0010) [2023-12-26 04:47:22,512][123091] Updated weights for policy 0, policy_version 651581 (0.0010) [2023-12-26 04:47:22,583][123091] Updated weights for policy 0, policy_version 651591 (0.0008) [2023-12-26 04:47:22,996][123090] Updated weights for policy 1, policy_version 647045 (0.0007) [2023-12-26 04:47:23,059][123090] Updated weights for policy 1, policy_version 647055 (0.0008) [2023-12-26 04:47:23,109][123090] Updated weights for policy 1, policy_version 647065 (0.0009) [2023-12-26 04:47:23,435][123091] Updated weights for policy 0, policy_version 651601 (0.0010) [2023-12-26 04:47:23,491][123091] Updated weights for policy 0, policy_version 651611 (0.0009) [2023-12-26 04:47:23,552][123091] Updated weights for policy 0, policy_version 651621 (0.0009) [2023-12-26 04:47:23,613][123091] Updated weights for policy 0, policy_version 651631 (0.0009) [2023-12-26 04:47:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 332472320. Throughput: 0: 9002.7, 1: 8874.3. Samples: 332450676. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:23,785][121949] Avg episode reward: [(0, '6262.494'), (1, '5407.497')] [2023-12-26 04:47:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000647072_165650432.pth... [2023-12-26 04:47:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000651632_166821888.pth... [2023-12-26 04:47:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000650576_166551552.pth [2023-12-26 04:47:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000646048_165388288.pth [2023-12-26 04:47:23,929][123090] Updated weights for policy 1, policy_version 647075 (0.0008) [2023-12-26 04:47:23,985][123090] Updated weights for policy 1, policy_version 647085 (0.0005) [2023-12-26 04:47:24,034][123090] Updated weights for policy 1, policy_version 647095 (0.0005) [2023-12-26 04:47:24,436][123091] Updated weights for policy 0, policy_version 651641 (0.0008) [2023-12-26 04:47:24,506][123091] Updated weights for policy 0, policy_version 651651 (0.0006) [2023-12-26 04:47:24,559][123091] Updated weights for policy 0, policy_version 651661 (0.0005) [2023-12-26 04:47:24,699][123090] Updated weights for policy 1, policy_version 647105 (0.0006) [2023-12-26 04:47:24,755][123090] Updated weights for policy 1, policy_version 647115 (0.0011) [2023-12-26 04:47:24,822][123090] Updated weights for policy 1, policy_version 647125 (0.0010) [2023-12-26 04:47:24,889][123090] Updated weights for policy 1, policy_version 647135 (0.0011) [2023-12-26 04:47:25,242][123091] Updated weights for policy 0, policy_version 651671 (0.0006) [2023-12-26 04:47:25,300][123091] Updated weights for policy 0, policy_version 651681 (0.0008) [2023-12-26 04:47:25,358][123091] Updated weights for policy 0, policy_version 651691 (0.0010) [2023-12-26 04:47:25,706][123090] Updated weights for policy 1, policy_version 647145 (0.0011) [2023-12-26 04:47:25,753][123090] Updated weights for policy 1, policy_version 647155 (0.0010) [2023-12-26 04:47:25,808][123090] Updated weights for policy 1, policy_version 647165 (0.0010) [2023-12-26 04:47:26,048][123091] Updated weights for policy 0, policy_version 651701 (0.0008) [2023-12-26 04:47:26,122][123091] Updated weights for policy 0, policy_version 651711 (0.0009) [2023-12-26 04:47:26,183][123091] Updated weights for policy 0, policy_version 651721 (0.0009) [2023-12-26 04:47:26,642][123090] Updated weights for policy 1, policy_version 647175 (0.0010) [2023-12-26 04:47:26,688][123090] Updated weights for policy 1, policy_version 647185 (0.0010) [2023-12-26 04:47:26,738][123090] Updated weights for policy 1, policy_version 647195 (0.0010) [2023-12-26 04:47:26,920][123091] Updated weights for policy 0, policy_version 651731 (0.0010) [2023-12-26 04:47:26,984][123091] Updated weights for policy 0, policy_version 651741 (0.0011) [2023-12-26 04:47:27,048][123091] Updated weights for policy 0, policy_version 651751 (0.0011) [2023-12-26 04:47:27,523][123090] Updated weights for policy 1, policy_version 647205 (0.0008) [2023-12-26 04:47:27,570][123090] Updated weights for policy 1, policy_version 647215 (0.0005) [2023-12-26 04:47:27,619][123090] Updated weights for policy 1, policy_version 647225 (0.0005) [2023-12-26 04:47:27,854][123091] Updated weights for policy 0, policy_version 651761 (0.0011) [2023-12-26 04:47:27,901][123091] Updated weights for policy 0, policy_version 651771 (0.0010) [2023-12-26 04:47:27,948][123091] Updated weights for policy 0, policy_version 651781 (0.0010) [2023-12-26 04:47:27,992][123091] Updated weights for policy 0, policy_version 651791 (0.0010) [2023-12-26 04:47:28,249][123090] Updated weights for policy 1, policy_version 647235 (0.0005) [2023-12-26 04:47:28,302][123090] Updated weights for policy 1, policy_version 647245 (0.0005) [2023-12-26 04:47:28,371][123090] Updated weights for policy 1, policy_version 647255 (0.0007) [2023-12-26 04:47:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 332562432. Throughput: 0: 9042.8, 1: 8907.5. Samples: 332557428. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:28,785][121949] Avg episode reward: [(0, '6207.114'), (1, '5500.214')] [2023-12-26 04:47:28,844][123091] Updated weights for policy 0, policy_version 651801 (0.0006) [2023-12-26 04:47:28,904][123091] Updated weights for policy 0, policy_version 651811 (0.0005) [2023-12-26 04:47:28,950][123091] Updated weights for policy 0, policy_version 651821 (0.0005) [2023-12-26 04:47:29,101][123090] Updated weights for policy 1, policy_version 647265 (0.0005) [2023-12-26 04:47:29,152][123090] Updated weights for policy 1, policy_version 647275 (0.0009) [2023-12-26 04:47:29,215][123090] Updated weights for policy 1, policy_version 647285 (0.0009) [2023-12-26 04:47:29,283][123090] Updated weights for policy 1, policy_version 647295 (0.0009) [2023-12-26 04:47:29,703][123091] Updated weights for policy 0, policy_version 651831 (0.0005) [2023-12-26 04:47:29,768][123091] Updated weights for policy 0, policy_version 651841 (0.0010) [2023-12-26 04:47:29,833][123091] Updated weights for policy 0, policy_version 651851 (0.0011) [2023-12-26 04:47:30,170][123090] Updated weights for policy 1, policy_version 647305 (0.0010) [2023-12-26 04:47:30,224][123090] Updated weights for policy 1, policy_version 647315 (0.0010) [2023-12-26 04:47:30,286][123090] Updated weights for policy 1, policy_version 647325 (0.0010) [2023-12-26 04:47:30,495][123091] Updated weights for policy 0, policy_version 651861 (0.0008) [2023-12-26 04:47:30,557][123091] Updated weights for policy 0, policy_version 651871 (0.0006) [2023-12-26 04:47:30,624][123091] Updated weights for policy 0, policy_version 651881 (0.0005) [2023-12-26 04:47:31,148][123090] Updated weights for policy 1, policy_version 647335 (0.0008) [2023-12-26 04:47:31,219][123090] Updated weights for policy 1, policy_version 647345 (0.0007) [2023-12-26 04:47:31,291][123090] Updated weights for policy 1, policy_version 647355 (0.0007) [2023-12-26 04:47:31,366][123091] Updated weights for policy 0, policy_version 651891 (0.0006) [2023-12-26 04:47:31,423][123091] Updated weights for policy 0, policy_version 651901 (0.0009) [2023-12-26 04:47:31,479][123091] Updated weights for policy 0, policy_version 651911 (0.0010) [2023-12-26 04:47:31,999][123090] Updated weights for policy 1, policy_version 647365 (0.0007) [2023-12-26 04:47:32,074][123090] Updated weights for policy 1, policy_version 647375 (0.0006) [2023-12-26 04:47:32,149][123090] Updated weights for policy 1, policy_version 647385 (0.0006) [2023-12-26 04:47:32,349][123091] Updated weights for policy 0, policy_version 651921 (0.0009) [2023-12-26 04:47:32,416][123091] Updated weights for policy 0, policy_version 651931 (0.0006) [2023-12-26 04:47:32,486][123091] Updated weights for policy 0, policy_version 651941 (0.0010) [2023-12-26 04:47:32,538][123091] Updated weights for policy 0, policy_version 651951 (0.0011) [2023-12-26 04:47:32,832][123090] Updated weights for policy 1, policy_version 647395 (0.0005) [2023-12-26 04:47:32,881][123090] Updated weights for policy 1, policy_version 647405 (0.0005) [2023-12-26 04:47:32,934][123090] Updated weights for policy 1, policy_version 647415 (0.0005) [2023-12-26 04:47:33,415][123091] Updated weights for policy 0, policy_version 651961 (0.0010) [2023-12-26 04:47:33,469][123091] Updated weights for policy 0, policy_version 651971 (0.0010) [2023-12-26 04:47:33,518][123091] Updated weights for policy 0, policy_version 651981 (0.0009) [2023-12-26 04:47:33,641][123090] Updated weights for policy 1, policy_version 647425 (0.0005) [2023-12-26 04:47:33,689][123090] Updated weights for policy 1, policy_version 647435 (0.0009) [2023-12-26 04:47:33,737][123090] Updated weights for policy 1, policy_version 647445 (0.0010) [2023-12-26 04:47:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 332652544. Throughput: 0: 8958.7, 1: 8929.3. Samples: 332666960. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:33,785][121949] Avg episode reward: [(0, '6194.772'), (1, '5682.179')] [2023-12-26 04:47:33,787][123090] Updated weights for policy 1, policy_version 647455 (0.0010) [2023-12-26 04:47:34,403][123091] Updated weights for policy 0, policy_version 651991 (0.0006) [2023-12-26 04:47:34,466][123091] Updated weights for policy 0, policy_version 652001 (0.0005) [2023-12-26 04:47:34,530][123091] Updated weights for policy 0, policy_version 652011 (0.0005) [2023-12-26 04:47:34,634][123090] Updated weights for policy 1, policy_version 647465 (0.0010) [2023-12-26 04:47:34,690][123090] Updated weights for policy 1, policy_version 647475 (0.0009) [2023-12-26 04:47:34,744][123090] Updated weights for policy 1, policy_version 647485 (0.0010) [2023-12-26 04:47:35,126][123091] Updated weights for policy 0, policy_version 652021 (0.0005) [2023-12-26 04:47:35,178][123091] Updated weights for policy 0, policy_version 652031 (0.0006) [2023-12-26 04:47:35,224][123091] Updated weights for policy 0, policy_version 652041 (0.0005) [2023-12-26 04:47:35,395][123090] Updated weights for policy 1, policy_version 647495 (0.0006) [2023-12-26 04:47:35,441][123090] Updated weights for policy 1, policy_version 647505 (0.0005) [2023-12-26 04:47:35,487][123090] Updated weights for policy 1, policy_version 647515 (0.0005) [2023-12-26 04:47:35,994][123091] Updated weights for policy 0, policy_version 652051 (0.0006) [2023-12-26 04:47:36,057][123091] Updated weights for policy 0, policy_version 652061 (0.0010) [2023-12-26 04:47:36,126][123091] Updated weights for policy 0, policy_version 652071 (0.0009) [2023-12-26 04:47:36,127][123090] Updated weights for policy 1, policy_version 647525 (0.0007) [2023-12-26 04:47:36,199][123090] Updated weights for policy 1, policy_version 647535 (0.0009) [2023-12-26 04:47:36,264][123090] Updated weights for policy 1, policy_version 647545 (0.0011) [2023-12-26 04:47:36,989][123091] Updated weights for policy 0, policy_version 652081 (0.0009) [2023-12-26 04:47:37,053][123091] Updated weights for policy 0, policy_version 652091 (0.0009) [2023-12-26 04:47:37,067][123090] Updated weights for policy 1, policy_version 647555 (0.0011) [2023-12-26 04:47:37,105][123091] Updated weights for policy 0, policy_version 652101 (0.0006) [2023-12-26 04:47:37,123][123090] Updated weights for policy 1, policy_version 647565 (0.0010) [2023-12-26 04:47:37,165][123091] Updated weights for policy 0, policy_version 652111 (0.0008) [2023-12-26 04:47:37,182][123090] Updated weights for policy 1, policy_version 647575 (0.0010) [2023-12-26 04:47:38,000][123091] Updated weights for policy 0, policy_version 652121 (0.0009) [2023-12-26 04:47:38,053][123091] Updated weights for policy 0, policy_version 652131 (0.0009) [2023-12-26 04:47:38,064][123090] Updated weights for policy 1, policy_version 647585 (0.0010) [2023-12-26 04:47:38,111][123091] Updated weights for policy 0, policy_version 652141 (0.0006) [2023-12-26 04:47:38,135][123090] Updated weights for policy 1, policy_version 647595 (0.0010) [2023-12-26 04:47:38,192][123090] Updated weights for policy 1, policy_version 647605 (0.0011) [2023-12-26 04:47:38,251][123090] Updated weights for policy 1, policy_version 647615 (0.0010) [2023-12-26 04:47:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 332742656. Throughput: 0: 8975.3, 1: 8974.9. Samples: 332722636. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:38,786][121949] Avg episode reward: [(0, '6177.771'), (1, '5411.882')] [2023-12-26 04:47:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000652144_166952960.pth... [2023-12-26 04:47:38,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000647616_165789696.pth... [2023-12-26 04:47:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000651120_166690816.pth [2023-12-26 04:47:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000646560_165519360.pth [2023-12-26 04:47:38,882][123091] Updated weights for policy 0, policy_version 652151 (0.0006) [2023-12-26 04:47:38,952][123091] Updated weights for policy 0, policy_version 652161 (0.0005) [2023-12-26 04:47:38,998][123091] Updated weights for policy 0, policy_version 652171 (0.0005) [2023-12-26 04:47:39,077][123090] Updated weights for policy 1, policy_version 647625 (0.0010) [2023-12-26 04:47:39,128][123090] Updated weights for policy 1, policy_version 647635 (0.0010) [2023-12-26 04:47:39,190][123090] Updated weights for policy 1, policy_version 647645 (0.0010) [2023-12-26 04:47:39,778][123091] Updated weights for policy 0, policy_version 652181 (0.0007) [2023-12-26 04:47:39,840][123091] Updated weights for policy 0, policy_version 652191 (0.0009) [2023-12-26 04:47:39,900][123091] Updated weights for policy 0, policy_version 652201 (0.0009) [2023-12-26 04:47:40,038][123090] Updated weights for policy 1, policy_version 647655 (0.0007) [2023-12-26 04:47:40,114][123090] Updated weights for policy 1, policy_version 647665 (0.0011) [2023-12-26 04:47:40,188][123090] Updated weights for policy 1, policy_version 647675 (0.0009) [2023-12-26 04:47:40,802][123091] Updated weights for policy 0, policy_version 652211 (0.0009) [2023-12-26 04:47:40,815][123090] Updated weights for policy 1, policy_version 647685 (0.0009) [2023-12-26 04:47:40,852][123091] Updated weights for policy 0, policy_version 652221 (0.0008) [2023-12-26 04:47:40,875][123090] Updated weights for policy 1, policy_version 647695 (0.0010) [2023-12-26 04:47:40,896][123091] Updated weights for policy 0, policy_version 652231 (0.0008) [2023-12-26 04:47:40,934][123090] Updated weights for policy 1, policy_version 647705 (0.0010) [2023-12-26 04:47:41,818][123090] Updated weights for policy 1, policy_version 647715 (0.0011) [2023-12-26 04:47:41,875][123091] Updated weights for policy 0, policy_version 652241 (0.0008) [2023-12-26 04:47:41,890][123090] Updated weights for policy 1, policy_version 647725 (0.0011) [2023-12-26 04:47:41,933][123091] Updated weights for policy 0, policy_version 652251 (0.0007) [2023-12-26 04:47:41,954][123090] Updated weights for policy 1, policy_version 647735 (0.0011) [2023-12-26 04:47:41,983][123091] Updated weights for policy 0, policy_version 652261 (0.0007) [2023-12-26 04:47:42,040][123091] Updated weights for policy 0, policy_version 652271 (0.0009) [2023-12-26 04:47:42,787][123090] Updated weights for policy 1, policy_version 647745 (0.0011) [2023-12-26 04:47:42,850][123090] Updated weights for policy 1, policy_version 647755 (0.0010) [2023-12-26 04:47:42,909][123091] Updated weights for policy 0, policy_version 652281 (0.0007) [2023-12-26 04:47:42,910][123090] Updated weights for policy 1, policy_version 647765 (0.0010) [2023-12-26 04:47:42,973][123091] Updated weights for policy 0, policy_version 652291 (0.0006) [2023-12-26 04:47:42,974][123090] Updated weights for policy 1, policy_version 647775 (0.0011) [2023-12-26 04:47:43,030][123091] Updated weights for policy 0, policy_version 652301 (0.0009) [2023-12-26 04:47:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 332824576. Throughput: 0: 8845.2, 1: 8996.9. Samples: 332824408. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:43,785][121949] Avg episode reward: [(0, '6186.377'), (1, '5426.495')] [2023-12-26 04:47:43,807][123091] Updated weights for policy 0, policy_version 652311 (0.0010) [2023-12-26 04:47:43,818][123090] Updated weights for policy 1, policy_version 647785 (0.0010) [2023-12-26 04:47:43,871][123091] Updated weights for policy 0, policy_version 652321 (0.0006) [2023-12-26 04:47:43,877][123090] Updated weights for policy 1, policy_version 647795 (0.0010) [2023-12-26 04:47:43,935][123091] Updated weights for policy 0, policy_version 652331 (0.0006) [2023-12-26 04:47:43,940][123090] Updated weights for policy 1, policy_version 647805 (0.0010) [2023-12-26 04:47:44,665][123091] Updated weights for policy 0, policy_version 652341 (0.0006) [2023-12-26 04:47:44,727][123091] Updated weights for policy 0, policy_version 652351 (0.0005) [2023-12-26 04:47:44,780][123090] Updated weights for policy 1, policy_version 647815 (0.0011) [2023-12-26 04:47:44,790][123091] Updated weights for policy 0, policy_version 652361 (0.0007) [2023-12-26 04:47:44,851][123090] Updated weights for policy 1, policy_version 647825 (0.0010) [2023-12-26 04:47:44,930][123090] Updated weights for policy 1, policy_version 647835 (0.0011) [2023-12-26 04:47:45,561][123091] Updated weights for policy 0, policy_version 652371 (0.0007) [2023-12-26 04:47:45,625][123091] Updated weights for policy 0, policy_version 652381 (0.0009) [2023-12-26 04:47:45,673][123091] Updated weights for policy 0, policy_version 652391 (0.0009) [2023-12-26 04:47:45,738][123090] Updated weights for policy 1, policy_version 647845 (0.0011) [2023-12-26 04:47:45,805][123090] Updated weights for policy 1, policy_version 647855 (0.0010) [2023-12-26 04:47:45,870][123090] Updated weights for policy 1, policy_version 647865 (0.0010) [2023-12-26 04:47:46,498][123091] Updated weights for policy 0, policy_version 652401 (0.0009) [2023-12-26 04:47:46,565][123091] Updated weights for policy 0, policy_version 652411 (0.0008) [2023-12-26 04:47:46,628][123091] Updated weights for policy 0, policy_version 652421 (0.0008) [2023-12-26 04:47:46,689][123090] Updated weights for policy 1, policy_version 647875 (0.0010) [2023-12-26 04:47:46,692][123091] Updated weights for policy 0, policy_version 652431 (0.0009) [2023-12-26 04:47:46,755][123090] Updated weights for policy 1, policy_version 647885 (0.0010) [2023-12-26 04:47:46,814][123090] Updated weights for policy 1, policy_version 647895 (0.0010) [2023-12-26 04:47:47,421][123091] Updated weights for policy 0, policy_version 652441 (0.0007) [2023-12-26 04:47:47,469][123091] Updated weights for policy 0, policy_version 652451 (0.0009) [2023-12-26 04:47:47,522][123091] Updated weights for policy 0, policy_version 652461 (0.0009) [2023-12-26 04:47:47,633][123090] Updated weights for policy 1, policy_version 647905 (0.0010) [2023-12-26 04:47:47,708][123090] Updated weights for policy 1, policy_version 647915 (0.0011) [2023-12-26 04:47:47,771][123090] Updated weights for policy 1, policy_version 647925 (0.0011) [2023-12-26 04:47:47,842][123090] Updated weights for policy 1, policy_version 647935 (0.0010) [2023-12-26 04:47:48,273][123091] Updated weights for policy 0, policy_version 652471 (0.0010) [2023-12-26 04:47:48,336][123091] Updated weights for policy 0, policy_version 652481 (0.0011) [2023-12-26 04:47:48,398][123091] Updated weights for policy 0, policy_version 652491 (0.0011) [2023-12-26 04:47:48,664][123090] Updated weights for policy 1, policy_version 647945 (0.0008) [2023-12-26 04:47:48,731][123090] Updated weights for policy 1, policy_version 647955 (0.0009) [2023-12-26 04:47:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 332914688. Throughput: 0: 8887.0, 1: 8923.9. Samples: 332929720. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:48,785][121949] Avg episode reward: [(0, '6162.726'), (1, '5715.152')] [2023-12-26 04:47:48,799][123090] Updated weights for policy 1, policy_version 647965 (0.0008) [2023-12-26 04:47:49,240][123091] Updated weights for policy 0, policy_version 652501 (0.0011) [2023-12-26 04:47:49,298][123091] Updated weights for policy 0, policy_version 652511 (0.0011) [2023-12-26 04:47:49,351][123091] Updated weights for policy 0, policy_version 652521 (0.0010) [2023-12-26 04:47:49,517][123090] Updated weights for policy 1, policy_version 647975 (0.0008) [2023-12-26 04:47:49,584][123090] Updated weights for policy 1, policy_version 647985 (0.0009) [2023-12-26 04:47:49,640][123090] Updated weights for policy 1, policy_version 647995 (0.0010) [2023-12-26 04:47:50,210][123091] Updated weights for policy 0, policy_version 652531 (0.0010) [2023-12-26 04:47:50,273][123091] Updated weights for policy 0, policy_version 652541 (0.0009) [2023-12-26 04:47:50,342][123091] Updated weights for policy 0, policy_version 652551 (0.0010) [2023-12-26 04:47:50,450][123090] Updated weights for policy 1, policy_version 648005 (0.0006) [2023-12-26 04:47:50,521][123090] Updated weights for policy 1, policy_version 648015 (0.0008) [2023-12-26 04:47:50,597][123090] Updated weights for policy 1, policy_version 648025 (0.0007) [2023-12-26 04:47:51,163][123091] Updated weights for policy 0, policy_version 652561 (0.0009) [2023-12-26 04:47:51,218][123091] Updated weights for policy 0, policy_version 652571 (0.0005) [2023-12-26 04:47:51,279][123091] Updated weights for policy 0, policy_version 652581 (0.0006) [2023-12-26 04:47:51,333][123091] Updated weights for policy 0, policy_version 652591 (0.0006) [2023-12-26 04:47:51,358][123090] Updated weights for policy 1, policy_version 648035 (0.0007) [2023-12-26 04:47:51,430][123090] Updated weights for policy 1, policy_version 648045 (0.0009) [2023-12-26 04:47:51,494][123090] Updated weights for policy 1, policy_version 648055 (0.0009) [2023-12-26 04:47:52,170][123091] Updated weights for policy 0, policy_version 652601 (0.0010) [2023-12-26 04:47:52,219][123091] Updated weights for policy 0, policy_version 652611 (0.0006) [2023-12-26 04:47:52,234][123090] Updated weights for policy 1, policy_version 648065 (0.0009) [2023-12-26 04:47:52,280][123091] Updated weights for policy 0, policy_version 652621 (0.0007) [2023-12-26 04:47:52,298][123090] Updated weights for policy 1, policy_version 648075 (0.0008) [2023-12-26 04:47:52,367][123090] Updated weights for policy 1, policy_version 648085 (0.0010) [2023-12-26 04:47:52,431][123090] Updated weights for policy 1, policy_version 648095 (0.0009) [2023-12-26 04:47:53,159][123091] Updated weights for policy 0, policy_version 652631 (0.0009) [2023-12-26 04:47:53,211][123090] Updated weights for policy 1, policy_version 648105 (0.0009) [2023-12-26 04:47:53,223][123091] Updated weights for policy 0, policy_version 652641 (0.0009) [2023-12-26 04:47:53,271][123090] Updated weights for policy 1, policy_version 648115 (0.0010) [2023-12-26 04:47:53,278][123091] Updated weights for policy 0, policy_version 652651 (0.0006) [2023-12-26 04:47:53,327][123090] Updated weights for policy 1, policy_version 648125 (0.0010) [2023-12-26 04:47:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 333004800. Throughput: 0: 8871.3, 1: 8942.1. Samples: 332981820. Policy #0 lag: (min: 20.0, avg: 20.0, max: 20.0) [2023-12-26 04:47:53,785][121949] Avg episode reward: [(0, '6085.862'), (1, '5627.929')] [2023-12-26 04:47:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000652656_167084032.pth... [2023-12-26 04:47:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000648128_165920768.pth... [2023-12-26 04:47:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000651632_166821888.pth [2023-12-26 04:47:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000647072_165650432.pth [2023-12-26 04:47:53,995][123091] Updated weights for policy 0, policy_version 652661 (0.0005) [2023-12-26 04:47:54,058][123091] Updated weights for policy 0, policy_version 652671 (0.0005) [2023-12-26 04:47:54,125][123091] Updated weights for policy 0, policy_version 652681 (0.0010) [2023-12-26 04:47:54,131][123090] Updated weights for policy 1, policy_version 648135 (0.0009) [2023-12-26 04:47:54,189][123090] Updated weights for policy 1, policy_version 648145 (0.0007) [2023-12-26 04:47:54,242][123090] Updated weights for policy 1, policy_version 648155 (0.0009) [2023-12-26 04:47:54,882][123091] Updated weights for policy 0, policy_version 652691 (0.0010) [2023-12-26 04:47:54,950][123091] Updated weights for policy 0, policy_version 652701 (0.0009) [2023-12-26 04:47:55,013][123091] Updated weights for policy 0, policy_version 652711 (0.0010) [2023-12-26 04:47:55,074][123090] Updated weights for policy 1, policy_version 648165 (0.0009) [2023-12-26 04:47:55,143][123090] Updated weights for policy 1, policy_version 648175 (0.0009) [2023-12-26 04:47:55,197][123090] Updated weights for policy 1, policy_version 648185 (0.0009) [2023-12-26 04:47:55,733][123091] Updated weights for policy 0, policy_version 652721 (0.0010) [2023-12-26 04:47:55,796][123091] Updated weights for policy 0, policy_version 652731 (0.0005) [2023-12-26 04:47:55,844][123091] Updated weights for policy 0, policy_version 652741 (0.0005) [2023-12-26 04:47:55,911][123091] Updated weights for policy 0, policy_version 652751 (0.0005) [2023-12-26 04:47:56,087][123090] Updated weights for policy 1, policy_version 648195 (0.0007) [2023-12-26 04:47:56,135][123090] Updated weights for policy 1, policy_version 648205 (0.0005) [2023-12-26 04:47:56,198][123090] Updated weights for policy 1, policy_version 648215 (0.0005) [2023-12-26 04:47:56,512][123091] Updated weights for policy 0, policy_version 652761 (0.0005) [2023-12-26 04:47:56,571][123091] Updated weights for policy 0, policy_version 652771 (0.0005) [2023-12-26 04:47:56,632][123091] Updated weights for policy 0, policy_version 652781 (0.0005) [2023-12-26 04:47:56,975][123090] Updated weights for policy 1, policy_version 648225 (0.0006) [2023-12-26 04:47:57,041][123090] Updated weights for policy 1, policy_version 648235 (0.0010) [2023-12-26 04:47:57,103][123090] Updated weights for policy 1, policy_version 648245 (0.0006) [2023-12-26 04:47:57,157][123090] Updated weights for policy 1, policy_version 648255 (0.0005) [2023-12-26 04:47:57,316][123091] Updated weights for policy 0, policy_version 652791 (0.0007) [2023-12-26 04:47:57,384][123091] Updated weights for policy 0, policy_version 652801 (0.0009) [2023-12-26 04:47:57,445][123091] Updated weights for policy 0, policy_version 652811 (0.0009) [2023-12-26 04:47:57,864][123090] Updated weights for policy 1, policy_version 648265 (0.0005) [2023-12-26 04:47:57,930][123090] Updated weights for policy 1, policy_version 648275 (0.0005) [2023-12-26 04:47:57,994][123090] Updated weights for policy 1, policy_version 648285 (0.0009) [2023-12-26 04:47:58,249][123091] Updated weights for policy 0, policy_version 652821 (0.0010) [2023-12-26 04:47:58,307][123091] Updated weights for policy 0, policy_version 652831 (0.0010) [2023-12-26 04:47:58,377][123091] Updated weights for policy 0, policy_version 652841 (0.0009) [2023-12-26 04:47:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 333094912. Throughput: 0: 8934.0, 1: 8947.5. Samples: 333090676. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:47:58,785][121949] Avg episode reward: [(0, '6092.735'), (1, '5542.609')] [2023-12-26 04:47:58,840][123090] Updated weights for policy 1, policy_version 648295 (0.0008) [2023-12-26 04:47:58,903][123090] Updated weights for policy 1, policy_version 648305 (0.0008) [2023-12-26 04:47:58,977][123090] Updated weights for policy 1, policy_version 648315 (0.0008) [2023-12-26 04:47:59,327][123091] Updated weights for policy 0, policy_version 652851 (0.0010) [2023-12-26 04:47:59,394][123091] Updated weights for policy 0, policy_version 652861 (0.0009) [2023-12-26 04:47:59,449][123091] Updated weights for policy 0, policy_version 652871 (0.0008) [2023-12-26 04:47:59,793][123090] Updated weights for policy 1, policy_version 648325 (0.0009) [2023-12-26 04:47:59,853][123090] Updated weights for policy 1, policy_version 648335 (0.0010) [2023-12-26 04:47:59,916][123090] Updated weights for policy 1, policy_version 648345 (0.0011) [2023-12-26 04:48:00,248][123091] Updated weights for policy 0, policy_version 652881 (0.0009) [2023-12-26 04:48:00,314][123091] Updated weights for policy 0, policy_version 652891 (0.0011) [2023-12-26 04:48:00,376][123091] Updated weights for policy 0, policy_version 652901 (0.0010) [2023-12-26 04:48:00,429][123091] Updated weights for policy 0, policy_version 652911 (0.0008) [2023-12-26 04:48:00,644][123090] Updated weights for policy 1, policy_version 648355 (0.0009) [2023-12-26 04:48:00,700][123090] Updated weights for policy 1, policy_version 648365 (0.0005) [2023-12-26 04:48:00,755][123090] Updated weights for policy 1, policy_version 648375 (0.0005) [2023-12-26 04:48:01,153][123091] Updated weights for policy 0, policy_version 652921 (0.0006) [2023-12-26 04:48:01,209][123091] Updated weights for policy 0, policy_version 652931 (0.0006) [2023-12-26 04:48:01,282][123091] Updated weights for policy 0, policy_version 652941 (0.0008) [2023-12-26 04:48:01,473][123090] Updated weights for policy 1, policy_version 648385 (0.0006) [2023-12-26 04:48:01,527][123090] Updated weights for policy 1, policy_version 648395 (0.0005) [2023-12-26 04:48:01,594][123090] Updated weights for policy 1, policy_version 648405 (0.0006) [2023-12-26 04:48:01,662][123090] Updated weights for policy 1, policy_version 648415 (0.0008) [2023-12-26 04:48:02,032][123091] Updated weights for policy 0, policy_version 652951 (0.0010) [2023-12-26 04:48:02,091][123091] Updated weights for policy 0, policy_version 652961 (0.0011) [2023-12-26 04:48:02,142][123091] Updated weights for policy 0, policy_version 652971 (0.0010) [2023-12-26 04:48:02,465][123090] Updated weights for policy 1, policy_version 648425 (0.0011) [2023-12-26 04:48:02,521][123090] Updated weights for policy 1, policy_version 648435 (0.0010) [2023-12-26 04:48:02,587][123090] Updated weights for policy 1, policy_version 648445 (0.0010) [2023-12-26 04:48:02,968][123091] Updated weights for policy 0, policy_version 652981 (0.0010) [2023-12-26 04:48:03,035][123091] Updated weights for policy 0, policy_version 652991 (0.0011) [2023-12-26 04:48:03,097][123091] Updated weights for policy 0, policy_version 653001 (0.0011) [2023-12-26 04:48:03,350][123090] Updated weights for policy 1, policy_version 648455 (0.0010) [2023-12-26 04:48:03,419][123090] Updated weights for policy 1, policy_version 648465 (0.0010) [2023-12-26 04:48:03,484][123090] Updated weights for policy 1, policy_version 648475 (0.0010) [2023-12-26 04:48:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 333185024. Throughput: 0: 8876.1, 1: 8852.2. Samples: 333196504. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:03,785][121949] Avg episode reward: [(0, '6024.204'), (1, '5439.491')] [2023-12-26 04:48:03,910][123091] Updated weights for policy 0, policy_version 653011 (0.0010) [2023-12-26 04:48:03,972][123091] Updated weights for policy 0, policy_version 653021 (0.0010) [2023-12-26 04:48:04,040][123091] Updated weights for policy 0, policy_version 653031 (0.0010) [2023-12-26 04:48:04,290][123090] Updated weights for policy 1, policy_version 648485 (0.0010) [2023-12-26 04:48:04,358][123090] Updated weights for policy 1, policy_version 648495 (0.0011) [2023-12-26 04:48:04,427][123090] Updated weights for policy 1, policy_version 648505 (0.0011) [2023-12-26 04:48:04,935][123091] Updated weights for policy 0, policy_version 653041 (0.0009) [2023-12-26 04:48:05,008][123091] Updated weights for policy 0, policy_version 653051 (0.0008) [2023-12-26 04:48:05,059][123091] Updated weights for policy 0, policy_version 653061 (0.0009) [2023-12-26 04:48:05,106][123091] Updated weights for policy 0, policy_version 653071 (0.0008) [2023-12-26 04:48:05,141][123090] Updated weights for policy 1, policy_version 648515 (0.0011) [2023-12-26 04:48:05,207][123090] Updated weights for policy 1, policy_version 648525 (0.0010) [2023-12-26 04:48:05,272][123090] Updated weights for policy 1, policy_version 648535 (0.0010) [2023-12-26 04:48:05,824][123091] Updated weights for policy 0, policy_version 653081 (0.0010) [2023-12-26 04:48:05,882][123091] Updated weights for policy 0, policy_version 653091 (0.0009) [2023-12-26 04:48:05,938][123091] Updated weights for policy 0, policy_version 653101 (0.0008) [2023-12-26 04:48:06,074][123090] Updated weights for policy 1, policy_version 648545 (0.0010) [2023-12-26 04:48:06,144][123090] Updated weights for policy 1, policy_version 648555 (0.0011) [2023-12-26 04:48:06,195][123090] Updated weights for policy 1, policy_version 648565 (0.0010) [2023-12-26 04:48:06,248][123090] Updated weights for policy 1, policy_version 648575 (0.0010) [2023-12-26 04:48:06,788][123091] Updated weights for policy 0, policy_version 653111 (0.0009) [2023-12-26 04:48:06,850][123091] Updated weights for policy 0, policy_version 653121 (0.0009) [2023-12-26 04:48:06,908][123091] Updated weights for policy 0, policy_version 653131 (0.0009) [2023-12-26 04:48:07,101][123090] Updated weights for policy 1, policy_version 648585 (0.0010) [2023-12-26 04:48:07,161][123090] Updated weights for policy 1, policy_version 648595 (0.0010) [2023-12-26 04:48:07,221][123090] Updated weights for policy 1, policy_version 648605 (0.0010) [2023-12-26 04:48:07,784][123091] Updated weights for policy 0, policy_version 653141 (0.0007) [2023-12-26 04:48:07,861][123091] Updated weights for policy 0, policy_version 653151 (0.0005) [2023-12-26 04:48:07,938][123091] Updated weights for policy 0, policy_version 653161 (0.0006) [2023-12-26 04:48:07,971][123090] Updated weights for policy 1, policy_version 648615 (0.0010) [2023-12-26 04:48:08,028][123090] Updated weights for policy 1, policy_version 648625 (0.0009) [2023-12-26 04:48:08,080][123090] Updated weights for policy 1, policy_version 648635 (0.0009) [2023-12-26 04:48:08,611][123091] Updated weights for policy 0, policy_version 653171 (0.0005) [2023-12-26 04:48:08,665][123091] Updated weights for policy 0, policy_version 653181 (0.0005) [2023-12-26 04:48:08,728][123091] Updated weights for policy 0, policy_version 653191 (0.0009) [2023-12-26 04:48:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 333275136. Throughput: 0: 8859.3, 1: 8878.2. Samples: 333248856. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:08,785][121949] Avg episode reward: [(0, '6109.188'), (1, '5493.661')] [2023-12-26 04:48:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000653200_167223296.pth... [2023-12-26 04:48:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000648640_166051840.pth... [2023-12-26 04:48:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000652144_166952960.pth [2023-12-26 04:48:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000647616_165789696.pth [2023-12-26 04:48:08,980][123090] Updated weights for policy 1, policy_version 648645 (0.0010) [2023-12-26 04:48:09,040][123090] Updated weights for policy 1, policy_version 648655 (0.0009) [2023-12-26 04:48:09,099][123090] Updated weights for policy 1, policy_version 648665 (0.0009) [2023-12-26 04:48:09,507][123091] Updated weights for policy 0, policy_version 653201 (0.0009) [2023-12-26 04:48:09,574][123091] Updated weights for policy 0, policy_version 653211 (0.0008) [2023-12-26 04:48:09,645][123091] Updated weights for policy 0, policy_version 653221 (0.0009) [2023-12-26 04:48:09,707][123091] Updated weights for policy 0, policy_version 653231 (0.0010) [2023-12-26 04:48:09,973][123090] Updated weights for policy 1, policy_version 648675 (0.0009) [2023-12-26 04:48:10,035][123090] Updated weights for policy 1, policy_version 648685 (0.0009) [2023-12-26 04:48:10,103][123090] Updated weights for policy 1, policy_version 648695 (0.0010) [2023-12-26 04:48:10,569][123091] Updated weights for policy 0, policy_version 653241 (0.0009) [2023-12-26 04:48:10,632][123091] Updated weights for policy 0, policy_version 653251 (0.0011) [2023-12-26 04:48:10,689][123091] Updated weights for policy 0, policy_version 653261 (0.0011) [2023-12-26 04:48:10,905][123090] Updated weights for policy 1, policy_version 648705 (0.0010) [2023-12-26 04:48:10,970][123090] Updated weights for policy 1, policy_version 648715 (0.0009) [2023-12-26 04:48:11,034][123090] Updated weights for policy 1, policy_version 648725 (0.0009) [2023-12-26 04:48:11,094][123090] Updated weights for policy 1, policy_version 648735 (0.0008) [2023-12-26 04:48:11,536][123091] Updated weights for policy 0, policy_version 653271 (0.0010) [2023-12-26 04:48:11,604][123091] Updated weights for policy 0, policy_version 653281 (0.0011) [2023-12-26 04:48:11,676][123091] Updated weights for policy 0, policy_version 653291 (0.0013) [2023-12-26 04:48:11,873][123090] Updated weights for policy 1, policy_version 648745 (0.0008) [2023-12-26 04:48:11,949][123090] Updated weights for policy 1, policy_version 648755 (0.0007) [2023-12-26 04:48:12,007][123090] Updated weights for policy 1, policy_version 648765 (0.0005) [2023-12-26 04:48:12,445][123091] Updated weights for policy 0, policy_version 653301 (0.0009) [2023-12-26 04:48:12,518][123091] Updated weights for policy 0, policy_version 653311 (0.0008) [2023-12-26 04:48:12,587][123091] Updated weights for policy 0, policy_version 653321 (0.0006) [2023-12-26 04:48:12,684][123090] Updated weights for policy 1, policy_version 648775 (0.0006) [2023-12-26 04:48:12,733][123090] Updated weights for policy 1, policy_version 648785 (0.0005) [2023-12-26 04:48:12,791][123090] Updated weights for policy 1, policy_version 648795 (0.0005) [2023-12-26 04:48:13,258][123091] Updated weights for policy 0, policy_version 653331 (0.0006) [2023-12-26 04:48:13,309][123091] Updated weights for policy 0, policy_version 653341 (0.0005) [2023-12-26 04:48:13,356][123091] Updated weights for policy 0, policy_version 653351 (0.0005) [2023-12-26 04:48:13,475][123090] Updated weights for policy 1, policy_version 648805 (0.0005) [2023-12-26 04:48:13,538][123090] Updated weights for policy 1, policy_version 648815 (0.0005) [2023-12-26 04:48:13,589][123090] Updated weights for policy 1, policy_version 648825 (0.0005) [2023-12-26 04:48:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 333365248. Throughput: 0: 8814.3, 1: 8868.2. Samples: 333353140. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:13,785][121949] Avg episode reward: [(0, '6076.722'), (1, '5567.859')] [2023-12-26 04:48:14,033][123091] Updated weights for policy 0, policy_version 653361 (0.0005) [2023-12-26 04:48:14,091][123091] Updated weights for policy 0, policy_version 653371 (0.0006) [2023-12-26 04:48:14,150][123091] Updated weights for policy 0, policy_version 653381 (0.0005) [2023-12-26 04:48:14,201][123091] Updated weights for policy 0, policy_version 653391 (0.0006) [2023-12-26 04:48:14,237][123090] Updated weights for policy 1, policy_version 648835 (0.0005) [2023-12-26 04:48:14,291][123090] Updated weights for policy 1, policy_version 648845 (0.0005) [2023-12-26 04:48:14,343][123090] Updated weights for policy 1, policy_version 648855 (0.0005) [2023-12-26 04:48:14,870][123091] Updated weights for policy 0, policy_version 653401 (0.0006) [2023-12-26 04:48:14,927][123091] Updated weights for policy 0, policy_version 653411 (0.0006) [2023-12-26 04:48:14,997][123091] Updated weights for policy 0, policy_version 653421 (0.0007) [2023-12-26 04:48:15,123][123090] Updated weights for policy 1, policy_version 648865 (0.0005) [2023-12-26 04:48:15,193][123090] Updated weights for policy 1, policy_version 648875 (0.0005) [2023-12-26 04:48:15,264][123090] Updated weights for policy 1, policy_version 648885 (0.0008) [2023-12-26 04:48:15,337][123090] Updated weights for policy 1, policy_version 648895 (0.0006) [2023-12-26 04:48:15,797][123091] Updated weights for policy 0, policy_version 653431 (0.0011) [2023-12-26 04:48:15,848][123091] Updated weights for policy 0, policy_version 653441 (0.0010) [2023-12-26 04:48:15,892][123091] Updated weights for policy 0, policy_version 653451 (0.0010) [2023-12-26 04:48:15,983][123090] Updated weights for policy 1, policy_version 648905 (0.0005) [2023-12-26 04:48:16,041][123090] Updated weights for policy 1, policy_version 648915 (0.0010) [2023-12-26 04:48:16,089][123090] Updated weights for policy 1, policy_version 648925 (0.0010) [2023-12-26 04:48:16,678][123091] Updated weights for policy 0, policy_version 653461 (0.0011) [2023-12-26 04:48:16,748][123091] Updated weights for policy 0, policy_version 653471 (0.0011) [2023-12-26 04:48:16,814][123091] Updated weights for policy 0, policy_version 653481 (0.0011) [2023-12-26 04:48:16,882][123090] Updated weights for policy 1, policy_version 648935 (0.0011) [2023-12-26 04:48:16,952][123090] Updated weights for policy 1, policy_version 648945 (0.0010) [2023-12-26 04:48:17,011][123090] Updated weights for policy 1, policy_version 648955 (0.0010) [2023-12-26 04:48:17,617][123091] Updated weights for policy 0, policy_version 653491 (0.0010) [2023-12-26 04:48:17,675][123091] Updated weights for policy 0, policy_version 653501 (0.0011) [2023-12-26 04:48:17,723][123091] Updated weights for policy 0, policy_version 653511 (0.0010) [2023-12-26 04:48:17,791][123090] Updated weights for policy 1, policy_version 648965 (0.0009) [2023-12-26 04:48:17,839][123090] Updated weights for policy 1, policy_version 648975 (0.0010) [2023-12-26 04:48:17,898][123090] Updated weights for policy 1, policy_version 648985 (0.0010) [2023-12-26 04:48:18,537][123091] Updated weights for policy 0, policy_version 653521 (0.0010) [2023-12-26 04:48:18,604][123091] Updated weights for policy 0, policy_version 653531 (0.0011) [2023-12-26 04:48:18,672][123091] Updated weights for policy 0, policy_version 653541 (0.0011) [2023-12-26 04:48:18,714][123090] Updated weights for policy 1, policy_version 648995 (0.0010) [2023-12-26 04:48:18,736][123091] Updated weights for policy 0, policy_version 653551 (0.0011) [2023-12-26 04:48:18,775][123090] Updated weights for policy 1, policy_version 649005 (0.0008) [2023-12-26 04:48:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 333455360. Throughput: 0: 8896.2, 1: 8890.2. Samples: 333467344. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:18,785][121949] Avg episode reward: [(0, '6101.625'), (1, '5682.555')] [2023-12-26 04:48:18,832][123090] Updated weights for policy 1, policy_version 649015 (0.0011) [2023-12-26 04:48:19,511][123091] Updated weights for policy 0, policy_version 653561 (0.0011) [2023-12-26 04:48:19,582][123091] Updated weights for policy 0, policy_version 653571 (0.0008) [2023-12-26 04:48:19,613][123090] Updated weights for policy 1, policy_version 649025 (0.0009) [2023-12-26 04:48:19,651][123091] Updated weights for policy 0, policy_version 653581 (0.0009) [2023-12-26 04:48:19,677][123090] Updated weights for policy 1, policy_version 649035 (0.0011) [2023-12-26 04:48:19,739][123090] Updated weights for policy 1, policy_version 649045 (0.0011) [2023-12-26 04:48:19,807][123090] Updated weights for policy 1, policy_version 649055 (0.0010) [2023-12-26 04:48:20,310][123091] Updated weights for policy 0, policy_version 653591 (0.0010) [2023-12-26 04:48:20,379][123091] Updated weights for policy 0, policy_version 653601 (0.0011) [2023-12-26 04:48:20,441][123091] Updated weights for policy 0, policy_version 653611 (0.0009) [2023-12-26 04:48:20,651][123090] Updated weights for policy 1, policy_version 649065 (0.0009) [2023-12-26 04:48:20,727][123090] Updated weights for policy 1, policy_version 649075 (0.0008) [2023-12-26 04:48:20,793][123090] Updated weights for policy 1, policy_version 649085 (0.0009) [2023-12-26 04:48:21,309][123091] Updated weights for policy 0, policy_version 653621 (0.0010) [2023-12-26 04:48:21,374][123091] Updated weights for policy 0, policy_version 653631 (0.0008) [2023-12-26 04:48:21,441][123091] Updated weights for policy 0, policy_version 653641 (0.0007) [2023-12-26 04:48:21,547][123090] Updated weights for policy 1, policy_version 649095 (0.0009) [2023-12-26 04:48:21,609][123090] Updated weights for policy 1, policy_version 649105 (0.0010) [2023-12-26 04:48:21,678][123090] Updated weights for policy 1, policy_version 649115 (0.0011) [2023-12-26 04:48:22,270][123091] Updated weights for policy 0, policy_version 653651 (0.0006) [2023-12-26 04:48:22,328][123091] Updated weights for policy 0, policy_version 653661 (0.0006) [2023-12-26 04:48:22,399][123091] Updated weights for policy 0, policy_version 653671 (0.0009) [2023-12-26 04:48:22,497][123090] Updated weights for policy 1, policy_version 649125 (0.0009) [2023-12-26 04:48:22,566][123090] Updated weights for policy 1, policy_version 649135 (0.0008) [2023-12-26 04:48:22,639][123090] Updated weights for policy 1, policy_version 649145 (0.0008) [2023-12-26 04:48:23,168][123091] Updated weights for policy 0, policy_version 653681 (0.0009) [2023-12-26 04:48:23,232][123091] Updated weights for policy 0, policy_version 653691 (0.0010) [2023-12-26 04:48:23,293][123091] Updated weights for policy 0, policy_version 653701 (0.0009) [2023-12-26 04:48:23,357][123091] Updated weights for policy 0, policy_version 653711 (0.0009) [2023-12-26 04:48:23,416][123090] Updated weights for policy 1, policy_version 649155 (0.0009) [2023-12-26 04:48:23,468][123090] Updated weights for policy 1, policy_version 649165 (0.0009) [2023-12-26 04:48:23,520][123090] Updated weights for policy 1, policy_version 649175 (0.0009) [2023-12-26 04:48:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 333545472. Throughput: 0: 8858.7, 1: 8846.1. Samples: 333519348. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:23,786][121949] Avg episode reward: [(0, '6113.380'), (1, '5667.240')] [2023-12-26 04:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000649184_166191104.pth... [2023-12-26 04:48:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000653712_167354368.pth... [2023-12-26 04:48:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000648128_165920768.pth [2023-12-26 04:48:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000652656_167084032.pth [2023-12-26 04:48:24,144][123091] Updated weights for policy 0, policy_version 653721 (0.0007) [2023-12-26 04:48:24,201][123091] Updated weights for policy 0, policy_version 653731 (0.0010) [2023-12-26 04:48:24,259][123091] Updated weights for policy 0, policy_version 653741 (0.0009) [2023-12-26 04:48:24,410][123090] Updated weights for policy 1, policy_version 649185 (0.0009) [2023-12-26 04:48:24,468][123090] Updated weights for policy 1, policy_version 649195 (0.0009) [2023-12-26 04:48:24,526][123090] Updated weights for policy 1, policy_version 649205 (0.0010) [2023-12-26 04:48:24,600][123090] Updated weights for policy 1, policy_version 649215 (0.0009) [2023-12-26 04:48:24,950][123091] Updated weights for policy 0, policy_version 653751 (0.0007) [2023-12-26 04:48:25,010][123091] Updated weights for policy 0, policy_version 653761 (0.0006) [2023-12-26 04:48:25,077][123091] Updated weights for policy 0, policy_version 653771 (0.0010) [2023-12-26 04:48:25,475][123090] Updated weights for policy 1, policy_version 649225 (0.0010) [2023-12-26 04:48:25,538][123090] Updated weights for policy 1, policy_version 649235 (0.0009) [2023-12-26 04:48:25,602][123090] Updated weights for policy 1, policy_version 649245 (0.0010) [2023-12-26 04:48:25,887][123091] Updated weights for policy 0, policy_version 653781 (0.0010) [2023-12-26 04:48:25,935][123091] Updated weights for policy 0, policy_version 653791 (0.0009) [2023-12-26 04:48:25,989][123091] Updated weights for policy 0, policy_version 653801 (0.0009) [2023-12-26 04:48:26,400][123090] Updated weights for policy 1, policy_version 649255 (0.0009) [2023-12-26 04:48:26,466][123090] Updated weights for policy 1, policy_version 649265 (0.0008) [2023-12-26 04:48:26,515][123090] Updated weights for policy 1, policy_version 649275 (0.0009) [2023-12-26 04:48:26,862][123091] Updated weights for policy 0, policy_version 653812 (0.0010) [2023-12-26 04:48:26,911][123091] Updated weights for policy 0, policy_version 653822 (0.0009) [2023-12-26 04:48:26,962][123091] Updated weights for policy 0, policy_version 653832 (0.0009) [2023-12-26 04:48:27,363][123090] Updated weights for policy 1, policy_version 649285 (0.0008) [2023-12-26 04:48:27,417][123090] Updated weights for policy 1, policy_version 649295 (0.0005) [2023-12-26 04:48:27,463][123090] Updated weights for policy 1, policy_version 649305 (0.0005) [2023-12-26 04:48:27,815][123091] Updated weights for policy 0, policy_version 653842 (0.0009) [2023-12-26 04:48:27,873][123091] Updated weights for policy 0, policy_version 653852 (0.0010) [2023-12-26 04:48:27,930][123091] Updated weights for policy 0, policy_version 653862 (0.0009) [2023-12-26 04:48:27,991][123091] Updated weights for policy 0, policy_version 653872 (0.0009) [2023-12-26 04:48:28,119][123090] Updated weights for policy 1, policy_version 649315 (0.0005) [2023-12-26 04:48:28,187][123090] Updated weights for policy 1, policy_version 649325 (0.0005) [2023-12-26 04:48:28,245][123090] Updated weights for policy 1, policy_version 649335 (0.0009) [2023-12-26 04:48:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 333627392. Throughput: 0: 8923.2, 1: 8846.5. Samples: 333624044. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:28,785][121949] Avg episode reward: [(0, '6153.556'), (1, '5446.546')] [2023-12-26 04:48:28,838][123091] Updated weights for policy 0, policy_version 653882 (0.0010) [2023-12-26 04:48:28,899][123091] Updated weights for policy 0, policy_version 653892 (0.0010) [2023-12-26 04:48:28,964][123091] Updated weights for policy 0, policy_version 653902 (0.0009) [2023-12-26 04:48:29,012][123090] Updated weights for policy 1, policy_version 649345 (0.0008) [2023-12-26 04:48:29,069][123090] Updated weights for policy 1, policy_version 649355 (0.0009) [2023-12-26 04:48:29,126][123090] Updated weights for policy 1, policy_version 649365 (0.0008) [2023-12-26 04:48:29,182][123090] Updated weights for policy 1, policy_version 649375 (0.0009) [2023-12-26 04:48:29,792][123091] Updated weights for policy 0, policy_version 653912 (0.0009) [2023-12-26 04:48:29,851][123091] Updated weights for policy 0, policy_version 653922 (0.0009) [2023-12-26 04:48:29,918][123091] Updated weights for policy 0, policy_version 653932 (0.0010) [2023-12-26 04:48:30,028][123090] Updated weights for policy 1, policy_version 649385 (0.0009) [2023-12-26 04:48:30,086][123090] Updated weights for policy 1, policy_version 649395 (0.0010) [2023-12-26 04:48:30,151][123090] Updated weights for policy 1, policy_version 649405 (0.0009) [2023-12-26 04:48:30,715][123091] Updated weights for policy 0, policy_version 653942 (0.0010) [2023-12-26 04:48:30,768][123091] Updated weights for policy 0, policy_version 653953 (0.0010) [2023-12-26 04:48:30,818][123091] Updated weights for policy 0, policy_version 653963 (0.0010) [2023-12-26 04:48:30,971][123090] Updated weights for policy 1, policy_version 649415 (0.0007) [2023-12-26 04:48:31,047][123090] Updated weights for policy 1, policy_version 649425 (0.0006) [2023-12-26 04:48:31,113][123090] Updated weights for policy 1, policy_version 649435 (0.0006) [2023-12-26 04:48:31,658][123091] Updated weights for policy 0, policy_version 653973 (0.0009) [2023-12-26 04:48:31,724][123091] Updated weights for policy 0, policy_version 653983 (0.0009) [2023-12-26 04:48:31,782][123091] Updated weights for policy 0, policy_version 653993 (0.0010) [2023-12-26 04:48:31,885][123090] Updated weights for policy 1, policy_version 649445 (0.0009) [2023-12-26 04:48:31,955][123090] Updated weights for policy 1, policy_version 649455 (0.0007) [2023-12-26 04:48:32,015][123090] Updated weights for policy 1, policy_version 649465 (0.0011) [2023-12-26 04:48:32,500][123091] Updated weights for policy 0, policy_version 654003 (0.0008) [2023-12-26 04:48:32,547][123091] Updated weights for policy 0, policy_version 654013 (0.0005) [2023-12-26 04:48:32,600][123091] Updated weights for policy 0, policy_version 654023 (0.0005) [2023-12-26 04:48:32,760][123090] Updated weights for policy 1, policy_version 649475 (0.0010) [2023-12-26 04:48:32,824][123090] Updated weights for policy 1, policy_version 649485 (0.0009) [2023-12-26 04:48:32,873][123090] Updated weights for policy 1, policy_version 649495 (0.0009) [2023-12-26 04:48:33,385][123091] Updated weights for policy 0, policy_version 654033 (0.0006) [2023-12-26 04:48:33,443][123091] Updated weights for policy 0, policy_version 654043 (0.0009) [2023-12-26 04:48:33,501][123091] Updated weights for policy 0, policy_version 654053 (0.0010) [2023-12-26 04:48:33,551][123091] Updated weights for policy 0, policy_version 654063 (0.0007) [2023-12-26 04:48:33,725][123090] Updated weights for policy 1, policy_version 649505 (0.0009) [2023-12-26 04:48:33,775][123090] Updated weights for policy 1, policy_version 649515 (0.0010) [2023-12-26 04:48:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 333717504. Throughput: 0: 8893.8, 1: 8905.6. Samples: 333730688. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:33,785][121949] Avg episode reward: [(0, '6094.552'), (1, '5286.112')] [2023-12-26 04:48:33,822][123090] Updated weights for policy 1, policy_version 649525 (0.0010) [2023-12-26 04:48:33,869][123090] Updated weights for policy 1, policy_version 649535 (0.0010) [2023-12-26 04:48:34,292][123091] Updated weights for policy 0, policy_version 654073 (0.0010) [2023-12-26 04:48:34,341][123091] Updated weights for policy 0, policy_version 654083 (0.0011) [2023-12-26 04:48:34,397][123091] Updated weights for policy 0, policy_version 654093 (0.0011) [2023-12-26 04:48:34,712][123090] Updated weights for policy 1, policy_version 649545 (0.0008) [2023-12-26 04:48:34,775][123090] Updated weights for policy 1, policy_version 649555 (0.0010) [2023-12-26 04:48:34,847][123090] Updated weights for policy 1, policy_version 649565 (0.0009) [2023-12-26 04:48:35,229][123091] Updated weights for policy 0, policy_version 654103 (0.0011) [2023-12-26 04:48:35,289][123091] Updated weights for policy 0, policy_version 654113 (0.0011) [2023-12-26 04:48:35,358][123091] Updated weights for policy 0, policy_version 654123 (0.0011) [2023-12-26 04:48:35,656][123090] Updated weights for policy 1, policy_version 649575 (0.0011) [2023-12-26 04:48:35,731][123090] Updated weights for policy 1, policy_version 649585 (0.0008) [2023-12-26 04:48:35,792][123090] Updated weights for policy 1, policy_version 649595 (0.0005) [2023-12-26 04:48:36,082][123091] Updated weights for policy 0, policy_version 654133 (0.0008) [2023-12-26 04:48:36,159][123091] Updated weights for policy 0, policy_version 654143 (0.0009) [2023-12-26 04:48:36,218][123091] Updated weights for policy 0, policy_version 654153 (0.0011) [2023-12-26 04:48:36,511][123090] Updated weights for policy 1, policy_version 649605 (0.0005) [2023-12-26 04:48:36,577][123090] Updated weights for policy 1, policy_version 649615 (0.0007) [2023-12-26 04:48:36,646][123090] Updated weights for policy 1, policy_version 649625 (0.0011) [2023-12-26 04:48:37,013][123091] Updated weights for policy 0, policy_version 654163 (0.0011) [2023-12-26 04:48:37,077][123091] Updated weights for policy 0, policy_version 654173 (0.0011) [2023-12-26 04:48:37,141][123091] Updated weights for policy 0, policy_version 654183 (0.0011) [2023-12-26 04:48:37,285][123090] Updated weights for policy 1, policy_version 649635 (0.0006) [2023-12-26 04:48:37,345][123090] Updated weights for policy 1, policy_version 649645 (0.0005) [2023-12-26 04:48:37,417][123090] Updated weights for policy 1, policy_version 649655 (0.0005) [2023-12-26 04:48:37,922][123091] Updated weights for policy 0, policy_version 654193 (0.0010) [2023-12-26 04:48:37,978][123091] Updated weights for policy 0, policy_version 654203 (0.0005) [2023-12-26 04:48:38,034][123091] Updated weights for policy 0, policy_version 654213 (0.0006) [2023-12-26 04:48:38,089][123090] Updated weights for policy 1, policy_version 649665 (0.0006) [2023-12-26 04:48:38,090][123091] Updated weights for policy 0, policy_version 654223 (0.0007) [2023-12-26 04:48:38,176][123090] Updated weights for policy 1, policy_version 649675 (0.0010) [2023-12-26 04:48:38,249][123090] Updated weights for policy 1, policy_version 649685 (0.0009) [2023-12-26 04:48:38,302][123090] Updated weights for policy 1, policy_version 649695 (0.0010) [2023-12-26 04:48:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 333807616. Throughput: 0: 8929.5, 1: 8913.9. Samples: 333784772. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:38,785][121949] Avg episode reward: [(0, '6172.156'), (1, '5396.580')] [2023-12-26 04:48:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000649696_166322176.pth... [2023-12-26 04:48:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000648640_166051840.pth [2023-12-26 04:48:38,844][123091] Updated weights for policy 0, policy_version 654233 (0.0006) [2023-12-26 04:48:38,911][123091] Updated weights for policy 0, policy_version 654243 (0.0005) [2023-12-26 04:48:38,962][123091] Updated weights for policy 0, policy_version 654253 (0.0005) [2023-12-26 04:48:38,976][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000654256_167493632.pth... [2023-12-26 04:48:38,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000653200_167223296.pth [2023-12-26 04:48:39,045][123090] Updated weights for policy 1, policy_version 649705 (0.0006) [2023-12-26 04:48:39,092][123090] Updated weights for policy 1, policy_version 649715 (0.0005) [2023-12-26 04:48:39,151][123090] Updated weights for policy 1, policy_version 649725 (0.0005) [2023-12-26 04:48:39,696][123091] Updated weights for policy 0, policy_version 654263 (0.0009) [2023-12-26 04:48:39,758][123091] Updated weights for policy 0, policy_version 654273 (0.0010) [2023-12-26 04:48:39,822][123091] Updated weights for policy 0, policy_version 654283 (0.0010) [2023-12-26 04:48:39,975][123090] Updated weights for policy 1, policy_version 649735 (0.0007) [2023-12-26 04:48:40,045][123090] Updated weights for policy 1, policy_version 649745 (0.0010) [2023-12-26 04:48:40,100][123090] Updated weights for policy 1, policy_version 649755 (0.0010) [2023-12-26 04:48:40,620][123091] Updated weights for policy 0, policy_version 654293 (0.0009) [2023-12-26 04:48:40,682][123091] Updated weights for policy 0, policy_version 654303 (0.0010) [2023-12-26 04:48:40,752][123091] Updated weights for policy 0, policy_version 654313 (0.0010) [2023-12-26 04:48:40,915][123090] Updated weights for policy 1, policy_version 649765 (0.0009) [2023-12-26 04:48:40,973][123090] Updated weights for policy 1, policy_version 649775 (0.0007) [2023-12-26 04:48:41,032][123090] Updated weights for policy 1, policy_version 649785 (0.0009) [2023-12-26 04:48:41,604][123091] Updated weights for policy 0, policy_version 654323 (0.0009) [2023-12-26 04:48:41,671][123091] Updated weights for policy 0, policy_version 654333 (0.0007) [2023-12-26 04:48:41,738][123091] Updated weights for policy 0, policy_version 654343 (0.0011) [2023-12-26 04:48:41,904][123090] Updated weights for policy 1, policy_version 649795 (0.0010) [2023-12-26 04:48:41,963][123090] Updated weights for policy 1, policy_version 649805 (0.0009) [2023-12-26 04:48:42,016][123090] Updated weights for policy 1, policy_version 649815 (0.0009) [2023-12-26 04:48:42,540][123091] Updated weights for policy 0, policy_version 654353 (0.0010) [2023-12-26 04:48:42,612][123091] Updated weights for policy 0, policy_version 654363 (0.0007) [2023-12-26 04:48:42,681][123091] Updated weights for policy 0, policy_version 654373 (0.0008) [2023-12-26 04:48:42,744][123091] Updated weights for policy 0, policy_version 654383 (0.0010) [2023-12-26 04:48:42,867][123090] Updated weights for policy 1, policy_version 649825 (0.0007) [2023-12-26 04:48:42,922][123090] Updated weights for policy 1, policy_version 649835 (0.0010) [2023-12-26 04:48:42,973][123090] Updated weights for policy 1, policy_version 649845 (0.0010) [2023-12-26 04:48:43,033][123090] Updated weights for policy 1, policy_version 649855 (0.0010) [2023-12-26 04:48:43,429][123091] Updated weights for policy 0, policy_version 654393 (0.0009) [2023-12-26 04:48:43,492][123091] Updated weights for policy 0, policy_version 654403 (0.0011) [2023-12-26 04:48:43,557][123091] Updated weights for policy 0, policy_version 654413 (0.0010) [2023-12-26 04:48:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 333897728. Throughput: 0: 8884.2, 1: 8917.3. Samples: 333891740. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:43,784][121949] Avg episode reward: [(0, '6227.761'), (1, '5402.031')] [2023-12-26 04:48:43,880][123090] Updated weights for policy 1, policy_version 649865 (0.0008) [2023-12-26 04:48:43,936][123090] Updated weights for policy 1, policy_version 649875 (0.0010) [2023-12-26 04:48:43,997][123090] Updated weights for policy 1, policy_version 649885 (0.0010) [2023-12-26 04:48:44,372][123091] Updated weights for policy 0, policy_version 654423 (0.0010) [2023-12-26 04:48:44,433][123091] Updated weights for policy 0, policy_version 654433 (0.0010) [2023-12-26 04:48:44,492][123091] Updated weights for policy 0, policy_version 654443 (0.0010) [2023-12-26 04:48:44,714][123090] Updated weights for policy 1, policy_version 649895 (0.0007) [2023-12-26 04:48:44,785][123090] Updated weights for policy 1, policy_version 649905 (0.0008) [2023-12-26 04:48:44,864][123090] Updated weights for policy 1, policy_version 649915 (0.0011) [2023-12-26 04:48:45,205][123091] Updated weights for policy 0, policy_version 654453 (0.0008) [2023-12-26 04:48:45,276][123091] Updated weights for policy 0, policy_version 654463 (0.0009) [2023-12-26 04:48:45,339][123091] Updated weights for policy 0, policy_version 654473 (0.0011) [2023-12-26 04:48:45,604][123090] Updated weights for policy 1, policy_version 649925 (0.0010) [2023-12-26 04:48:45,663][123090] Updated weights for policy 1, policy_version 649935 (0.0006) [2023-12-26 04:48:45,724][123090] Updated weights for policy 1, policy_version 649945 (0.0006) [2023-12-26 04:48:46,218][123091] Updated weights for policy 0, policy_version 654483 (0.0010) [2023-12-26 04:48:46,279][123091] Updated weights for policy 0, policy_version 654493 (0.0009) [2023-12-26 04:48:46,352][123091] Updated weights for policy 0, policy_version 654503 (0.0009) [2023-12-26 04:48:46,478][123090] Updated weights for policy 1, policy_version 649955 (0.0007) [2023-12-26 04:48:46,541][123090] Updated weights for policy 1, policy_version 649965 (0.0011) [2023-12-26 04:48:46,600][123090] Updated weights for policy 1, policy_version 649975 (0.0010) [2023-12-26 04:48:47,187][123091] Updated weights for policy 0, policy_version 654513 (0.0009) [2023-12-26 04:48:47,239][123091] Updated weights for policy 0, policy_version 654523 (0.0009) [2023-12-26 04:48:47,286][123091] Updated weights for policy 0, policy_version 654533 (0.0009) [2023-12-26 04:48:47,334][123091] Updated weights for policy 0, policy_version 654543 (0.0009) [2023-12-26 04:48:47,426][123090] Updated weights for policy 1, policy_version 649985 (0.0010) [2023-12-26 04:48:47,484][123090] Updated weights for policy 1, policy_version 649995 (0.0010) [2023-12-26 04:48:47,536][123090] Updated weights for policy 1, policy_version 650005 (0.0010) [2023-12-26 04:48:47,583][123090] Updated weights for policy 1, policy_version 650015 (0.0010) [2023-12-26 04:48:48,213][123090] Updated weights for policy 1, policy_version 650025 (0.0007) [2023-12-26 04:48:48,230][123091] Updated weights for policy 0, policy_version 654553 (0.0006) [2023-12-26 04:48:48,267][123090] Updated weights for policy 1, policy_version 650035 (0.0007) [2023-12-26 04:48:48,283][123091] Updated weights for policy 0, policy_version 654563 (0.0005) [2023-12-26 04:48:48,319][123090] Updated weights for policy 1, policy_version 650045 (0.0010) [2023-12-26 04:48:48,338][123091] Updated weights for policy 0, policy_version 654573 (0.0007) [2023-12-26 04:48:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17886.0, 300 sec: 17800.3). Total num frames: 333987840. Throughput: 0: 8901.0, 1: 8943.6. Samples: 333999508. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:48,785][121949] Avg episode reward: [(0, '6222.731'), (1, '5224.473')] [2023-12-26 04:48:49,057][123091] Updated weights for policy 0, policy_version 654583 (0.0008) [2023-12-26 04:48:49,108][123091] Updated weights for policy 0, policy_version 654593 (0.0009) [2023-12-26 04:48:49,142][123090] Updated weights for policy 1, policy_version 650055 (0.0007) [2023-12-26 04:48:49,162][123091] Updated weights for policy 0, policy_version 654603 (0.0009) [2023-12-26 04:48:49,197][123090] Updated weights for policy 1, policy_version 650065 (0.0005) [2023-12-26 04:48:49,272][123090] Updated weights for policy 1, policy_version 650075 (0.0009) [2023-12-26 04:48:49,995][123091] Updated weights for policy 0, policy_version 654613 (0.0007) [2023-12-26 04:48:50,012][123090] Updated weights for policy 1, policy_version 650085 (0.0011) [2023-12-26 04:48:50,071][123091] Updated weights for policy 0, policy_version 654623 (0.0006) [2023-12-26 04:48:50,083][123090] Updated weights for policy 1, policy_version 650095 (0.0008) [2023-12-26 04:48:50,137][123091] Updated weights for policy 0, policy_version 654633 (0.0007) [2023-12-26 04:48:50,152][123090] Updated weights for policy 1, policy_version 650105 (0.0006) [2023-12-26 04:48:50,869][123090] Updated weights for policy 1, policy_version 650115 (0.0011) [2023-12-26 04:48:50,933][123091] Updated weights for policy 0, policy_version 654643 (0.0007) [2023-12-26 04:48:50,939][123090] Updated weights for policy 1, policy_version 650125 (0.0011) [2023-12-26 04:48:51,001][123091] Updated weights for policy 0, policy_version 654653 (0.0007) [2023-12-26 04:48:51,003][123090] Updated weights for policy 1, policy_version 650135 (0.0011) [2023-12-26 04:48:51,067][123091] Updated weights for policy 0, policy_version 654663 (0.0007) [2023-12-26 04:48:51,901][123091] Updated weights for policy 0, policy_version 654673 (0.0009) [2023-12-26 04:48:51,902][123090] Updated weights for policy 1, policy_version 650145 (0.0013) [2023-12-26 04:48:51,963][123090] Updated weights for policy 1, policy_version 650155 (0.0010) [2023-12-26 04:48:51,965][123091] Updated weights for policy 0, policy_version 654683 (0.0007) [2023-12-26 04:48:52,023][123091] Updated weights for policy 0, policy_version 654693 (0.0008) [2023-12-26 04:48:52,029][123090] Updated weights for policy 1, policy_version 650165 (0.0008) [2023-12-26 04:48:52,088][123091] Updated weights for policy 0, policy_version 654703 (0.0005) [2023-12-26 04:48:52,092][123090] Updated weights for policy 1, policy_version 650175 (0.0010) [2023-12-26 04:48:52,798][123091] Updated weights for policy 0, policy_version 654713 (0.0010) [2023-12-26 04:48:52,835][123090] Updated weights for policy 1, policy_version 650185 (0.0010) [2023-12-26 04:48:52,842][123091] Updated weights for policy 0, policy_version 654723 (0.0011) [2023-12-26 04:48:52,896][123090] Updated weights for policy 1, policy_version 650195 (0.0006) [2023-12-26 04:48:52,898][123091] Updated weights for policy 0, policy_version 654733 (0.0011) [2023-12-26 04:48:52,956][123090] Updated weights for policy 1, policy_version 650205 (0.0005) [2023-12-26 04:48:53,742][123090] Updated weights for policy 1, policy_version 650215 (0.0006) [2023-12-26 04:48:53,745][123091] Updated weights for policy 0, policy_version 654743 (0.0011) [2023-12-26 04:48:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 334069760. Throughput: 0: 8908.8, 1: 8950.7. Samples: 334052532. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:53,785][121949] Avg episode reward: [(0, '6158.914'), (1, '5287.480')] [2023-12-26 04:48:53,803][123090] Updated weights for policy 1, policy_version 650225 (0.0006) [2023-12-26 04:48:53,809][123091] Updated weights for policy 0, policy_version 654753 (0.0011) [2023-12-26 04:48:53,862][123090] Updated weights for policy 1, policy_version 650235 (0.0007) [2023-12-26 04:48:53,864][123091] Updated weights for policy 0, policy_version 654763 (0.0011) [2023-12-26 04:48:53,890][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000654768_167624704.pth... [2023-12-26 04:48:53,893][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000653712_167354368.pth [2023-12-26 04:48:53,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000650240_166461440.pth... [2023-12-26 04:48:53,900][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000649184_166191104.pth [2023-12-26 04:48:54,591][123090] Updated weights for policy 1, policy_version 650245 (0.0006) [2023-12-26 04:48:54,640][123090] Updated weights for policy 1, policy_version 650255 (0.0005) [2023-12-26 04:48:54,693][123090] Updated weights for policy 1, policy_version 650265 (0.0008) [2023-12-26 04:48:54,700][123091] Updated weights for policy 0, policy_version 654773 (0.0011) [2023-12-26 04:48:54,762][123091] Updated weights for policy 0, policy_version 654783 (0.0011) [2023-12-26 04:48:54,821][123091] Updated weights for policy 0, policy_version 654793 (0.0010) [2023-12-26 04:48:55,464][123090] Updated weights for policy 1, policy_version 650275 (0.0006) [2023-12-26 04:48:55,531][123090] Updated weights for policy 1, policy_version 650285 (0.0005) [2023-12-26 04:48:55,552][123091] Updated weights for policy 0, policy_version 654803 (0.0010) [2023-12-26 04:48:55,596][123090] Updated weights for policy 1, policy_version 650295 (0.0005) [2023-12-26 04:48:55,600][123091] Updated weights for policy 0, policy_version 654813 (0.0010) [2023-12-26 04:48:55,651][123091] Updated weights for policy 0, policy_version 654823 (0.0011) [2023-12-26 04:48:56,349][123090] Updated weights for policy 1, policy_version 650305 (0.0006) [2023-12-26 04:48:56,402][123090] Updated weights for policy 1, policy_version 650315 (0.0009) [2023-12-26 04:48:56,437][123091] Updated weights for policy 0, policy_version 654833 (0.0010) [2023-12-26 04:48:56,466][123090] Updated weights for policy 1, policy_version 650325 (0.0007) [2023-12-26 04:48:56,497][123091] Updated weights for policy 0, policy_version 654843 (0.0011) [2023-12-26 04:48:56,511][123090] Updated weights for policy 1, policy_version 650335 (0.0008) [2023-12-26 04:48:56,562][123091] Updated weights for policy 0, policy_version 654853 (0.0011) [2023-12-26 04:48:56,634][123091] Updated weights for policy 0, policy_version 654863 (0.0006) [2023-12-26 04:48:57,245][123091] Updated weights for policy 0, policy_version 654873 (0.0006) [2023-12-26 04:48:57,307][123091] Updated weights for policy 0, policy_version 654883 (0.0008) [2023-12-26 04:48:57,367][123091] Updated weights for policy 0, policy_version 654893 (0.0009) [2023-12-26 04:48:57,434][123090] Updated weights for policy 1, policy_version 650345 (0.0009) [2023-12-26 04:48:57,496][123090] Updated weights for policy 1, policy_version 650355 (0.0008) [2023-12-26 04:48:57,542][123090] Updated weights for policy 1, policy_version 650365 (0.0008) [2023-12-26 04:48:58,068][123091] Updated weights for policy 0, policy_version 654903 (0.0010) [2023-12-26 04:48:58,129][123091] Updated weights for policy 0, policy_version 654913 (0.0010) [2023-12-26 04:48:58,187][123091] Updated weights for policy 0, policy_version 654923 (0.0010) [2023-12-26 04:48:58,383][123090] Updated weights for policy 1, policy_version 650375 (0.0009) [2023-12-26 04:48:58,459][123090] Updated weights for policy 1, policy_version 650385 (0.0009) [2023-12-26 04:48:58,523][123090] Updated weights for policy 1, policy_version 650395 (0.0009) [2023-12-26 04:48:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 334168064. Throughput: 0: 8964.0, 1: 8969.1. Samples: 334160124. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:48:58,785][121949] Avg episode reward: [(0, '6144.183'), (1, '5207.725')] [2023-12-26 04:48:59,106][123091] Updated weights for policy 0, policy_version 654933 (0.0009) [2023-12-26 04:48:59,166][123091] Updated weights for policy 0, policy_version 654943 (0.0010) [2023-12-26 04:48:59,230][123091] Updated weights for policy 0, policy_version 654953 (0.0009) [2023-12-26 04:48:59,439][123090] Updated weights for policy 1, policy_version 650405 (0.0010) [2023-12-26 04:48:59,502][123090] Updated weights for policy 1, policy_version 650415 (0.0010) [2023-12-26 04:48:59,568][123090] Updated weights for policy 1, policy_version 650425 (0.0009) [2023-12-26 04:49:00,112][123091] Updated weights for policy 0, policy_version 654963 (0.0009) [2023-12-26 04:49:00,171][123091] Updated weights for policy 0, policy_version 654973 (0.0006) [2023-12-26 04:49:00,233][123091] Updated weights for policy 0, policy_version 654983 (0.0005) [2023-12-26 04:49:00,420][123090] Updated weights for policy 1, policy_version 650435 (0.0009) [2023-12-26 04:49:00,480][123090] Updated weights for policy 1, policy_version 650445 (0.0009) [2023-12-26 04:49:00,528][123090] Updated weights for policy 1, policy_version 650455 (0.0009) [2023-12-26 04:49:01,039][123091] Updated weights for policy 0, policy_version 654993 (0.0008) [2023-12-26 04:49:01,104][123091] Updated weights for policy 0, policy_version 655003 (0.0010) [2023-12-26 04:49:01,171][123091] Updated weights for policy 0, policy_version 655013 (0.0008) [2023-12-26 04:49:01,234][123091] Updated weights for policy 0, policy_version 655023 (0.0009) [2023-12-26 04:49:01,321][123090] Updated weights for policy 1, policy_version 650465 (0.0009) [2023-12-26 04:49:01,389][123090] Updated weights for policy 1, policy_version 650475 (0.0009) [2023-12-26 04:49:01,445][123090] Updated weights for policy 1, policy_version 650485 (0.0009) [2023-12-26 04:49:01,499][123090] Updated weights for policy 1, policy_version 650495 (0.0009) [2023-12-26 04:49:01,939][123091] Updated weights for policy 0, policy_version 655033 (0.0006) [2023-12-26 04:49:01,985][123091] Updated weights for policy 0, policy_version 655043 (0.0005) [2023-12-26 04:49:02,046][123091] Updated weights for policy 0, policy_version 655053 (0.0005) [2023-12-26 04:49:02,436][123090] Updated weights for policy 1, policy_version 650505 (0.0010) [2023-12-26 04:49:02,501][123090] Updated weights for policy 1, policy_version 650515 (0.0010) [2023-12-26 04:49:02,567][123090] Updated weights for policy 1, policy_version 650525 (0.0009) [2023-12-26 04:49:02,780][123091] Updated weights for policy 0, policy_version 655063 (0.0008) [2023-12-26 04:49:02,850][123091] Updated weights for policy 0, policy_version 655075 (0.0010) [2023-12-26 04:49:02,910][123091] Updated weights for policy 0, policy_version 655085 (0.0009) [2023-12-26 04:49:03,387][123090] Updated weights for policy 1, policy_version 650535 (0.0009) [2023-12-26 04:49:03,436][123090] Updated weights for policy 1, policy_version 650545 (0.0009) [2023-12-26 04:49:03,484][123090] Updated weights for policy 1, policy_version 650555 (0.0009) [2023-12-26 04:49:03,736][123091] Updated weights for policy 0, policy_version 655095 (0.0009) [2023-12-26 04:49:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 334249984. Throughput: 0: 8892.8, 1: 8788.3. Samples: 334262992. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:03,784][121949] Avg episode reward: [(0, '6119.129'), (1, '5205.961')] [2023-12-26 04:49:03,791][123091] Updated weights for policy 0, policy_version 655105 (0.0009) [2023-12-26 04:49:03,838][123091] Updated weights for policy 0, policy_version 655115 (0.0009) [2023-12-26 04:49:04,259][123090] Updated weights for policy 1, policy_version 650565 (0.0009) [2023-12-26 04:49:04,319][123090] Updated weights for policy 1, policy_version 650575 (0.0009) [2023-12-26 04:49:04,388][123090] Updated weights for policy 1, policy_version 650585 (0.0007) [2023-12-26 04:49:04,710][123091] Updated weights for policy 0, policy_version 655125 (0.0009) [2023-12-26 04:49:04,770][123091] Updated weights for policy 0, policy_version 655135 (0.0010) [2023-12-26 04:49:04,828][123091] Updated weights for policy 0, policy_version 655145 (0.0010) [2023-12-26 04:49:05,166][123090] Updated weights for policy 1, policy_version 650595 (0.0007) [2023-12-26 04:49:05,219][123090] Updated weights for policy 1, policy_version 650605 (0.0010) [2023-12-26 04:49:05,278][123090] Updated weights for policy 1, policy_version 650616 (0.0010) [2023-12-26 04:49:05,588][123091] Updated weights for policy 0, policy_version 655156 (0.0009) [2023-12-26 04:49:05,653][123091] Updated weights for policy 0, policy_version 655166 (0.0008) [2023-12-26 04:49:05,716][123091] Updated weights for policy 0, policy_version 655176 (0.0008) [2023-12-26 04:49:06,237][123090] Updated weights for policy 1, policy_version 650627 (0.0010) [2023-12-26 04:49:06,289][123090] Updated weights for policy 1, policy_version 650637 (0.0010) [2023-12-26 04:49:06,354][123090] Updated weights for policy 1, policy_version 650647 (0.0010) [2023-12-26 04:49:06,355][123091] Updated weights for policy 0, policy_version 655186 (0.0008) [2023-12-26 04:49:06,425][123091] Updated weights for policy 0, policy_version 655196 (0.0008) [2023-12-26 04:49:06,500][123091] Updated weights for policy 0, policy_version 655206 (0.0007) [2023-12-26 04:49:06,570][123091] Updated weights for policy 0, policy_version 655216 (0.0007) [2023-12-26 04:49:07,189][123091] Updated weights for policy 0, policy_version 655226 (0.0010) [2023-12-26 04:49:07,252][123091] Updated weights for policy 0, policy_version 655236 (0.0010) [2023-12-26 04:49:07,287][123090] Updated weights for policy 1, policy_version 650657 (0.0009) [2023-12-26 04:49:07,317][123091] Updated weights for policy 0, policy_version 655246 (0.0010) [2023-12-26 04:49:07,348][123090] Updated weights for policy 1, policy_version 650667 (0.0010) [2023-12-26 04:49:07,407][123090] Updated weights for policy 1, policy_version 650677 (0.0010) [2023-12-26 04:49:07,473][123090] Updated weights for policy 1, policy_version 650687 (0.0010) [2023-12-26 04:49:08,137][123091] Updated weights for policy 0, policy_version 655256 (0.0006) [2023-12-26 04:49:08,196][123091] Updated weights for policy 0, policy_version 655266 (0.0005) [2023-12-26 04:49:08,253][123091] Updated weights for policy 0, policy_version 655276 (0.0005) [2023-12-26 04:49:08,319][123090] Updated weights for policy 1, policy_version 650697 (0.0009) [2023-12-26 04:49:08,382][123090] Updated weights for policy 1, policy_version 650707 (0.0010) [2023-12-26 04:49:08,432][123090] Updated weights for policy 1, policy_version 650717 (0.0010) [2023-12-26 04:49:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 334340096. Throughput: 0: 8919.9, 1: 8770.2. Samples: 334315404. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:08,785][121949] Avg episode reward: [(0, '6175.154'), (1, '5297.714')] [2023-12-26 04:49:08,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000655280_167755776.pth... [2023-12-26 04:49:08,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000650720_166584320.pth... [2023-12-26 04:49:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000654256_167493632.pth [2023-12-26 04:49:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000649696_166322176.pth [2023-12-26 04:49:09,030][123091] Updated weights for policy 0, policy_version 655286 (0.0009) [2023-12-26 04:49:09,079][123091] Updated weights for policy 0, policy_version 655296 (0.0011) [2023-12-26 04:49:09,136][123091] Updated weights for policy 0, policy_version 655306 (0.0011) [2023-12-26 04:49:09,335][123090] Updated weights for policy 1, policy_version 650727 (0.0009) [2023-12-26 04:49:09,407][123090] Updated weights for policy 1, policy_version 650737 (0.0009) [2023-12-26 04:49:09,469][123090] Updated weights for policy 1, policy_version 650747 (0.0009) [2023-12-26 04:49:09,997][123091] Updated weights for policy 0, policy_version 655316 (0.0011) [2023-12-26 04:49:10,061][123091] Updated weights for policy 0, policy_version 655326 (0.0011) [2023-12-26 04:49:10,118][123091] Updated weights for policy 0, policy_version 655336 (0.0011) [2023-12-26 04:49:10,394][123090] Updated weights for policy 1, policy_version 650757 (0.0009) [2023-12-26 04:49:10,461][123090] Updated weights for policy 1, policy_version 650767 (0.0009) [2023-12-26 04:49:10,529][123090] Updated weights for policy 1, policy_version 650777 (0.0009) [2023-12-26 04:49:10,955][123091] Updated weights for policy 0, policy_version 655346 (0.0011) [2023-12-26 04:49:11,018][123091] Updated weights for policy 0, policy_version 655356 (0.0010) [2023-12-26 04:49:11,091][123091] Updated weights for policy 0, policy_version 655366 (0.0010) [2023-12-26 04:49:11,157][123091] Updated weights for policy 0, policy_version 655376 (0.0009) [2023-12-26 04:49:11,368][123090] Updated weights for policy 1, policy_version 650787 (0.0009) [2023-12-26 04:49:11,440][123090] Updated weights for policy 1, policy_version 650797 (0.0009) [2023-12-26 04:49:11,509][123090] Updated weights for policy 1, policy_version 650807 (0.0010) [2023-12-26 04:49:12,030][123091] Updated weights for policy 0, policy_version 655386 (0.0007) [2023-12-26 04:49:12,090][123091] Updated weights for policy 0, policy_version 655396 (0.0010) [2023-12-26 04:49:12,145][123091] Updated weights for policy 0, policy_version 655406 (0.0009) [2023-12-26 04:49:12,390][123090] Updated weights for policy 1, policy_version 650817 (0.0009) [2023-12-26 04:49:12,459][123090] Updated weights for policy 1, policy_version 650827 (0.0010) [2023-12-26 04:49:12,519][123090] Updated weights for policy 1, policy_version 650837 (0.0010) [2023-12-26 04:49:12,578][123090] Updated weights for policy 1, policy_version 650847 (0.0009) [2023-12-26 04:49:12,983][123091] Updated weights for policy 0, policy_version 655416 (0.0009) [2023-12-26 04:49:13,050][123091] Updated weights for policy 0, policy_version 655426 (0.0010) [2023-12-26 04:49:13,117][123091] Updated weights for policy 0, policy_version 655436 (0.0010) [2023-12-26 04:49:13,468][123090] Updated weights for policy 1, policy_version 650857 (0.0009) [2023-12-26 04:49:13,537][123090] Updated weights for policy 1, policy_version 650867 (0.0009) [2023-12-26 04:49:13,604][123090] Updated weights for policy 1, policy_version 650877 (0.0009) [2023-12-26 04:49:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 334422016. Throughput: 0: 8895.9, 1: 8702.9. Samples: 334415992. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:13,785][121949] Avg episode reward: [(0, '6181.964'), (1, '5269.272')] [2023-12-26 04:49:13,889][123091] Updated weights for policy 0, policy_version 655446 (0.0010) [2023-12-26 04:49:13,951][123091] Updated weights for policy 0, policy_version 655456 (0.0009) [2023-12-26 04:49:14,017][123091] Updated weights for policy 0, policy_version 655466 (0.0009) [2023-12-26 04:49:14,405][123090] Updated weights for policy 1, policy_version 650887 (0.0010) [2023-12-26 04:49:14,470][123090] Updated weights for policy 1, policy_version 650897 (0.0009) [2023-12-26 04:49:14,539][123090] Updated weights for policy 1, policy_version 650907 (0.0010) [2023-12-26 04:49:14,844][123091] Updated weights for policy 0, policy_version 655476 (0.0008) [2023-12-26 04:49:14,907][123091] Updated weights for policy 0, policy_version 655486 (0.0010) [2023-12-26 04:49:14,974][123091] Updated weights for policy 0, policy_version 655496 (0.0010) [2023-12-26 04:49:15,341][123090] Updated weights for policy 1, policy_version 650917 (0.0009) [2023-12-26 04:49:15,406][123090] Updated weights for policy 1, policy_version 650927 (0.0010) [2023-12-26 04:49:15,468][123090] Updated weights for policy 1, policy_version 650937 (0.0009) [2023-12-26 04:49:15,760][123091] Updated weights for policy 0, policy_version 655506 (0.0009) [2023-12-26 04:49:15,827][123091] Updated weights for policy 0, policy_version 655516 (0.0005) [2023-12-26 04:49:15,899][123091] Updated weights for policy 0, policy_version 655526 (0.0006) [2023-12-26 04:49:15,950][123091] Updated weights for policy 0, policy_version 655536 (0.0005) [2023-12-26 04:49:16,289][123090] Updated weights for policy 1, policy_version 650947 (0.0008) [2023-12-26 04:49:16,361][123090] Updated weights for policy 1, policy_version 650957 (0.0005) [2023-12-26 04:49:16,424][123090] Updated weights for policy 1, policy_version 650967 (0.0005) [2023-12-26 04:49:16,580][123091] Updated weights for policy 0, policy_version 655546 (0.0008) [2023-12-26 04:49:16,632][123091] Updated weights for policy 0, policy_version 655556 (0.0009) [2023-12-26 04:49:16,684][123091] Updated weights for policy 0, policy_version 655566 (0.0009) [2023-12-26 04:49:17,067][123090] Updated weights for policy 1, policy_version 650977 (0.0006) [2023-12-26 04:49:17,126][123090] Updated weights for policy 1, policy_version 650987 (0.0009) [2023-12-26 04:49:17,177][123090] Updated weights for policy 1, policy_version 650997 (0.0010) [2023-12-26 04:49:17,221][123090] Updated weights for policy 1, policy_version 651007 (0.0010) [2023-12-26 04:49:17,518][123091] Updated weights for policy 0, policy_version 655576 (0.0006) [2023-12-26 04:49:17,589][123091] Updated weights for policy 0, policy_version 655586 (0.0005) [2023-12-26 04:49:17,656][123091] Updated weights for policy 0, policy_version 655596 (0.0005) [2023-12-26 04:49:18,023][123090] Updated weights for policy 1, policy_version 651017 (0.0011) [2023-12-26 04:49:18,091][123090] Updated weights for policy 1, policy_version 651027 (0.0011) [2023-12-26 04:49:18,154][123090] Updated weights for policy 1, policy_version 651037 (0.0009) [2023-12-26 04:49:18,375][123091] Updated weights for policy 0, policy_version 655606 (0.0008) [2023-12-26 04:49:18,436][123091] Updated weights for policy 0, policy_version 655616 (0.0007) [2023-12-26 04:49:18,499][123091] Updated weights for policy 0, policy_version 655626 (0.0008) [2023-12-26 04:49:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 334512128. Throughput: 0: 8924.3, 1: 8697.9. Samples: 334523684. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:18,785][121949] Avg episode reward: [(0, '6117.482'), (1, '5311.945')] [2023-12-26 04:49:18,869][123090] Updated weights for policy 1, policy_version 651047 (0.0009) [2023-12-26 04:49:18,937][123090] Updated weights for policy 1, policy_version 651057 (0.0011) [2023-12-26 04:49:18,996][123090] Updated weights for policy 1, policy_version 651067 (0.0010) [2023-12-26 04:49:19,279][123091] Updated weights for policy 0, policy_version 655636 (0.0009) [2023-12-26 04:49:19,339][123091] Updated weights for policy 0, policy_version 655646 (0.0009) [2023-12-26 04:49:19,404][123091] Updated weights for policy 0, policy_version 655656 (0.0010) [2023-12-26 04:49:19,790][123090] Updated weights for policy 1, policy_version 651077 (0.0011) [2023-12-26 04:49:19,857][123090] Updated weights for policy 1, policy_version 651087 (0.0010) [2023-12-26 04:49:19,925][123090] Updated weights for policy 1, policy_version 651097 (0.0013) [2023-12-26 04:49:20,235][123091] Updated weights for policy 0, policy_version 655666 (0.0006) [2023-12-26 04:49:20,305][123091] Updated weights for policy 0, policy_version 655676 (0.0009) [2023-12-26 04:49:20,377][123091] Updated weights for policy 0, policy_version 655687 (0.0010) [2023-12-26 04:49:20,780][123090] Updated weights for policy 1, policy_version 651107 (0.0011) [2023-12-26 04:49:20,853][123090] Updated weights for policy 1, policy_version 651117 (0.0011) [2023-12-26 04:49:20,923][123090] Updated weights for policy 1, policy_version 651127 (0.0011) [2023-12-26 04:49:21,223][123091] Updated weights for policy 0, policy_version 655698 (0.0009) [2023-12-26 04:49:21,285][123091] Updated weights for policy 0, policy_version 655708 (0.0010) [2023-12-26 04:49:21,338][123091] Updated weights for policy 0, policy_version 655718 (0.0009) [2023-12-26 04:49:21,413][123091] Updated weights for policy 0, policy_version 655728 (0.0009) [2023-12-26 04:49:21,739][123090] Updated weights for policy 1, policy_version 651137 (0.0011) [2023-12-26 04:49:21,801][123090] Updated weights for policy 1, policy_version 651147 (0.0009) [2023-12-26 04:49:21,862][123090] Updated weights for policy 1, policy_version 651157 (0.0010) [2023-12-26 04:49:21,925][123090] Updated weights for policy 1, policy_version 651167 (0.0010) [2023-12-26 04:49:22,235][123091] Updated weights for policy 0, policy_version 655738 (0.0006) [2023-12-26 04:49:22,297][123091] Updated weights for policy 0, policy_version 655748 (0.0008) [2023-12-26 04:49:22,360][123091] Updated weights for policy 0, policy_version 655758 (0.0008) [2023-12-26 04:49:22,882][123090] Updated weights for policy 1, policy_version 651177 (0.0010) [2023-12-26 04:49:22,943][123090] Updated weights for policy 1, policy_version 651187 (0.0009) [2023-12-26 04:49:22,999][123090] Updated weights for policy 1, policy_version 651198 (0.0010) [2023-12-26 04:49:23,028][123091] Updated weights for policy 0, policy_version 655768 (0.0008) [2023-12-26 04:49:23,085][123091] Updated weights for policy 0, policy_version 655778 (0.0011) [2023-12-26 04:49:23,130][123091] Updated weights for policy 0, policy_version 655788 (0.0009) [2023-12-26 04:49:23,748][123090] Updated weights for policy 1, policy_version 651208 (0.0006) [2023-12-26 04:49:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 334594048. Throughput: 0: 8883.5, 1: 8674.7. Samples: 334574888. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:23,785][121949] Avg episode reward: [(0, '6168.237'), (1, '5057.882')] [2023-12-26 04:49:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000655792_167886848.pth... [2023-12-26 04:49:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000654768_167624704.pth [2023-12-26 04:49:23,819][123090] Updated weights for policy 1, policy_version 651218 (0.0006) [2023-12-26 04:49:23,888][123090] Updated weights for policy 1, policy_version 651228 (0.0006) [2023-12-26 04:49:23,898][123091] Updated weights for policy 0, policy_version 655798 (0.0010) [2023-12-26 04:49:23,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000651232_166715392.pth... [2023-12-26 04:49:23,916][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000650240_166461440.pth [2023-12-26 04:49:23,969][123091] Updated weights for policy 0, policy_version 655808 (0.0009) [2023-12-26 04:49:24,028][123091] Updated weights for policy 0, policy_version 655818 (0.0010) [2023-12-26 04:49:24,575][123090] Updated weights for policy 1, policy_version 651238 (0.0006) [2023-12-26 04:49:24,637][123090] Updated weights for policy 1, policy_version 651248 (0.0005) [2023-12-26 04:49:24,708][123090] Updated weights for policy 1, policy_version 651258 (0.0005) [2023-12-26 04:49:24,780][123091] Updated weights for policy 0, policy_version 655828 (0.0008) [2023-12-26 04:49:24,828][123091] Updated weights for policy 0, policy_version 655838 (0.0005) [2023-12-26 04:49:24,879][123091] Updated weights for policy 0, policy_version 655848 (0.0005) [2023-12-26 04:49:25,365][123090] Updated weights for policy 1, policy_version 651268 (0.0005) [2023-12-26 04:49:25,421][123090] Updated weights for policy 1, policy_version 651278 (0.0005) [2023-12-26 04:49:25,480][123090] Updated weights for policy 1, policy_version 651288 (0.0008) [2023-12-26 04:49:25,527][123091] Updated weights for policy 0, policy_version 655858 (0.0006) [2023-12-26 04:49:25,581][123091] Updated weights for policy 0, policy_version 655868 (0.0006) [2023-12-26 04:49:25,632][123091] Updated weights for policy 0, policy_version 655878 (0.0005) [2023-12-26 04:49:25,681][123091] Updated weights for policy 0, policy_version 655888 (0.0005) [2023-12-26 04:49:26,302][123090] Updated weights for policy 1, policy_version 651298 (0.0009) [2023-12-26 04:49:26,363][123090] Updated weights for policy 1, policy_version 651308 (0.0009) [2023-12-26 04:49:26,421][123091] Updated weights for policy 0, policy_version 655898 (0.0009) [2023-12-26 04:49:26,425][123090] Updated weights for policy 1, policy_version 651318 (0.0008) [2023-12-26 04:49:26,471][123091] Updated weights for policy 0, policy_version 655908 (0.0010) [2023-12-26 04:49:26,489][123090] Updated weights for policy 1, policy_version 651328 (0.0008) [2023-12-26 04:49:26,529][123091] Updated weights for policy 0, policy_version 655918 (0.0009) [2023-12-26 04:49:27,308][123091] Updated weights for policy 0, policy_version 655928 (0.0008) [2023-12-26 04:49:27,334][123090] Updated weights for policy 1, policy_version 651338 (0.0008) [2023-12-26 04:49:27,364][123091] Updated weights for policy 0, policy_version 655938 (0.0007) [2023-12-26 04:49:27,389][123090] Updated weights for policy 1, policy_version 651348 (0.0009) [2023-12-26 04:49:27,418][123091] Updated weights for policy 0, policy_version 655948 (0.0005) [2023-12-26 04:49:27,442][123090] Updated weights for policy 1, policy_version 651358 (0.0009) [2023-12-26 04:49:28,054][123091] Updated weights for policy 0, policy_version 655958 (0.0007) [2023-12-26 04:49:28,117][123091] Updated weights for policy 0, policy_version 655968 (0.0009) [2023-12-26 04:49:28,178][123091] Updated weights for policy 0, policy_version 655978 (0.0008) [2023-12-26 04:49:28,368][123090] Updated weights for policy 1, policy_version 651369 (0.0009) [2023-12-26 04:49:28,422][123090] Updated weights for policy 1, policy_version 651379 (0.0010) [2023-12-26 04:49:28,476][123090] Updated weights for policy 1, policy_version 651389 (0.0010) [2023-12-26 04:49:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 334692352. Throughput: 0: 8993.5, 1: 8648.5. Samples: 334685632. Policy #0 lag: (min: 10.0, avg: 22.9, max: 42.0) [2023-12-26 04:49:28,785][121949] Avg episode reward: [(0, '6122.841'), (1, '5108.464')] [2023-12-26 04:49:28,937][123091] Updated weights for policy 0, policy_version 655988 (0.0008) [2023-12-26 04:49:28,988][123091] Updated weights for policy 0, policy_version 655998 (0.0009) [2023-12-26 04:49:29,041][123091] Updated weights for policy 0, policy_version 656008 (0.0010) [2023-12-26 04:49:29,364][123090] Updated weights for policy 1, policy_version 651399 (0.0010) [2023-12-26 04:49:29,426][123090] Updated weights for policy 1, policy_version 651409 (0.0009) [2023-12-26 04:49:29,486][123090] Updated weights for policy 1, policy_version 651419 (0.0010) [2023-12-26 04:49:29,887][123091] Updated weights for policy 0, policy_version 656018 (0.0008) [2023-12-26 04:49:29,948][123091] Updated weights for policy 0, policy_version 656028 (0.0008) [2023-12-26 04:49:30,006][123091] Updated weights for policy 0, policy_version 656038 (0.0008) [2023-12-26 04:49:30,064][123091] Updated weights for policy 0, policy_version 656048 (0.0008) [2023-12-26 04:49:30,370][123090] Updated weights for policy 1, policy_version 651429 (0.0009) [2023-12-26 04:49:30,446][123090] Updated weights for policy 1, policy_version 651439 (0.0008) [2023-12-26 04:49:30,523][123090] Updated weights for policy 1, policy_version 651449 (0.0005) [2023-12-26 04:49:30,852][123091] Updated weights for policy 0, policy_version 656058 (0.0010) [2023-12-26 04:49:30,907][123091] Updated weights for policy 0, policy_version 656068 (0.0010) [2023-12-26 04:49:30,960][123091] Updated weights for policy 0, policy_version 656078 (0.0010) [2023-12-26 04:49:31,275][123090] Updated weights for policy 1, policy_version 651459 (0.0007) [2023-12-26 04:49:31,339][123090] Updated weights for policy 1, policy_version 651469 (0.0010) [2023-12-26 04:49:31,416][123090] Updated weights for policy 1, policy_version 651479 (0.0010) [2023-12-26 04:49:31,852][123091] Updated weights for policy 0, policy_version 656088 (0.0009) [2023-12-26 04:49:31,920][123091] Updated weights for policy 0, policy_version 656098 (0.0009) [2023-12-26 04:49:31,987][123091] Updated weights for policy 0, policy_version 656108 (0.0010) [2023-12-26 04:49:32,208][123090] Updated weights for policy 1, policy_version 651489 (0.0009) [2023-12-26 04:49:32,271][123090] Updated weights for policy 1, policy_version 651499 (0.0007) [2023-12-26 04:49:32,333][123090] Updated weights for policy 1, policy_version 651509 (0.0010) [2023-12-26 04:49:32,406][123090] Updated weights for policy 1, policy_version 651519 (0.0010) [2023-12-26 04:49:32,856][123091] Updated weights for policy 0, policy_version 656118 (0.0009) [2023-12-26 04:49:32,916][123091] Updated weights for policy 0, policy_version 656128 (0.0009) [2023-12-26 04:49:32,974][123091] Updated weights for policy 0, policy_version 656138 (0.0010) [2023-12-26 04:49:33,103][123090] Updated weights for policy 1, policy_version 651529 (0.0009) [2023-12-26 04:49:33,158][123090] Updated weights for policy 1, policy_version 651539 (0.0009) [2023-12-26 04:49:33,209][123090] Updated weights for policy 1, policy_version 651549 (0.0009) [2023-12-26 04:49:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 334774272. Throughput: 0: 8974.2, 1: 8590.7. Samples: 334789932. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:33,785][121949] Avg episode reward: [(0, '6021.747'), (1, '5100.103')] [2023-12-26 04:49:33,828][123091] Updated weights for policy 0, policy_version 656148 (0.0010) [2023-12-26 04:49:33,882][123091] Updated weights for policy 0, policy_version 656158 (0.0009) [2023-12-26 04:49:33,938][123091] Updated weights for policy 0, policy_version 656168 (0.0009) [2023-12-26 04:49:33,969][123090] Updated weights for policy 1, policy_version 651559 (0.0010) [2023-12-26 04:49:34,030][123090] Updated weights for policy 1, policy_version 651569 (0.0007) [2023-12-26 04:49:34,095][123090] Updated weights for policy 1, policy_version 651579 (0.0007) [2023-12-26 04:49:34,820][123091] Updated weights for policy 0, policy_version 656178 (0.0008) [2023-12-26 04:49:34,831][123090] Updated weights for policy 1, policy_version 651589 (0.0007) [2023-12-26 04:49:34,881][123090] Updated weights for policy 1, policy_version 651599 (0.0008) [2023-12-26 04:49:34,886][123091] Updated weights for policy 0, policy_version 656188 (0.0008) [2023-12-26 04:49:34,933][123090] Updated weights for policy 1, policy_version 651609 (0.0006) [2023-12-26 04:49:34,947][123091] Updated weights for policy 0, policy_version 656198 (0.0010) [2023-12-26 04:49:35,007][123091] Updated weights for policy 0, policy_version 656208 (0.0010) [2023-12-26 04:49:35,573][123090] Updated weights for policy 1, policy_version 651619 (0.0006) [2023-12-26 04:49:35,627][123090] Updated weights for policy 1, policy_version 651629 (0.0006) [2023-12-26 04:49:35,691][123090] Updated weights for policy 1, policy_version 651639 (0.0006) [2023-12-26 04:49:35,886][123091] Updated weights for policy 0, policy_version 656218 (0.0010) [2023-12-26 04:49:35,948][123091] Updated weights for policy 0, policy_version 656228 (0.0010) [2023-12-26 04:49:36,008][123091] Updated weights for policy 0, policy_version 656238 (0.0009) [2023-12-26 04:49:36,435][123090] Updated weights for policy 1, policy_version 651649 (0.0006) [2023-12-26 04:49:36,504][123090] Updated weights for policy 1, policy_version 651659 (0.0006) [2023-12-26 04:49:36,583][123090] Updated weights for policy 1, policy_version 651669 (0.0007) [2023-12-26 04:49:36,656][123090] Updated weights for policy 1, policy_version 651679 (0.0009) [2023-12-26 04:49:36,782][123091] Updated weights for policy 0, policy_version 656248 (0.0009) [2023-12-26 04:49:36,844][123091] Updated weights for policy 0, policy_version 656258 (0.0010) [2023-12-26 04:49:36,906][123091] Updated weights for policy 0, policy_version 656268 (0.0010) [2023-12-26 04:49:37,423][123090] Updated weights for policy 1, policy_version 651689 (0.0008) [2023-12-26 04:49:37,489][123090] Updated weights for policy 1, policy_version 651699 (0.0009) [2023-12-26 04:49:37,557][123090] Updated weights for policy 1, policy_version 651709 (0.0010) [2023-12-26 04:49:37,804][123091] Updated weights for policy 0, policy_version 656278 (0.0009) [2023-12-26 04:49:37,875][123091] Updated weights for policy 0, policy_version 656288 (0.0008) [2023-12-26 04:49:37,951][123091] Updated weights for policy 0, policy_version 656298 (0.0005) [2023-12-26 04:49:38,428][123090] Updated weights for policy 1, policy_version 651719 (0.0009) [2023-12-26 04:49:38,496][123090] Updated weights for policy 1, policy_version 651729 (0.0010) [2023-12-26 04:49:38,557][123090] Updated weights for policy 1, policy_version 651739 (0.0006) [2023-12-26 04:49:38,635][123091] Updated weights for policy 0, policy_version 656308 (0.0006) [2023-12-26 04:49:38,701][123091] Updated weights for policy 0, policy_version 656318 (0.0009) [2023-12-26 04:49:38,757][123091] Updated weights for policy 0, policy_version 656328 (0.0009) [2023-12-26 04:49:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 334864384. Throughput: 0: 8934.3, 1: 8651.8. Samples: 334843908. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:38,785][121949] Avg episode reward: [(0, '6070.386'), (1, '5125.703')] [2023-12-26 04:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000651744_166846464.pth... [2023-12-26 04:49:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000650720_166584320.pth [2023-12-26 04:49:38,800][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000656336_168026112.pth... [2023-12-26 04:49:38,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000655280_167755776.pth [2023-12-26 04:49:39,158][123090] Updated weights for policy 1, policy_version 651749 (0.0005) [2023-12-26 04:49:39,224][123090] Updated weights for policy 1, policy_version 651759 (0.0008) [2023-12-26 04:49:39,283][123090] Updated weights for policy 1, policy_version 651769 (0.0010) [2023-12-26 04:49:39,626][123091] Updated weights for policy 0, policy_version 656338 (0.0010) [2023-12-26 04:49:39,691][123091] Updated weights for policy 0, policy_version 656348 (0.0009) [2023-12-26 04:49:39,758][123091] Updated weights for policy 0, policy_version 656358 (0.0010) [2023-12-26 04:49:39,830][123091] Updated weights for policy 0, policy_version 656368 (0.0009) [2023-12-26 04:49:40,102][123090] Updated weights for policy 1, policy_version 651779 (0.0010) [2023-12-26 04:49:40,155][123090] Updated weights for policy 1, policy_version 651789 (0.0009) [2023-12-26 04:49:40,209][123090] Updated weights for policy 1, policy_version 651799 (0.0009) [2023-12-26 04:49:40,671][123091] Updated weights for policy 0, policy_version 656378 (0.0010) [2023-12-26 04:49:40,731][123091] Updated weights for policy 0, policy_version 656388 (0.0008) [2023-12-26 04:49:40,785][123091] Updated weights for policy 0, policy_version 656398 (0.0010) [2023-12-26 04:49:41,066][123090] Updated weights for policy 1, policy_version 651809 (0.0010) [2023-12-26 04:49:41,133][123090] Updated weights for policy 1, policy_version 651819 (0.0010) [2023-12-26 04:49:41,204][123090] Updated weights for policy 1, policy_version 651829 (0.0008) [2023-12-26 04:49:41,260][123090] Updated weights for policy 1, policy_version 651839 (0.0010) [2023-12-26 04:49:41,596][123091] Updated weights for policy 0, policy_version 656408 (0.0007) [2023-12-26 04:49:41,659][123091] Updated weights for policy 0, policy_version 656418 (0.0008) [2023-12-26 04:49:41,722][123091] Updated weights for policy 0, policy_version 656428 (0.0007) [2023-12-26 04:49:42,138][123090] Updated weights for policy 1, policy_version 651849 (0.0010) [2023-12-26 04:49:42,210][123090] Updated weights for policy 1, policy_version 651859 (0.0010) [2023-12-26 04:49:42,281][123090] Updated weights for policy 1, policy_version 651869 (0.0010) [2023-12-26 04:49:42,536][123091] Updated weights for policy 0, policy_version 656438 (0.0008) [2023-12-26 04:49:42,605][123091] Updated weights for policy 0, policy_version 656448 (0.0008) [2023-12-26 04:49:42,664][123091] Updated weights for policy 0, policy_version 656458 (0.0008) [2023-12-26 04:49:43,105][123090] Updated weights for policy 1, policy_version 651879 (0.0008) [2023-12-26 04:49:43,178][123090] Updated weights for policy 1, policy_version 651889 (0.0007) [2023-12-26 04:49:43,240][123090] Updated weights for policy 1, policy_version 651899 (0.0005) [2023-12-26 04:49:43,286][123091] Updated weights for policy 0, policy_version 656468 (0.0007) [2023-12-26 04:49:43,355][123091] Updated weights for policy 0, policy_version 656478 (0.0006) [2023-12-26 04:49:43,430][123091] Updated weights for policy 0, policy_version 656488 (0.0006) [2023-12-26 04:49:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 334954496. Throughput: 0: 8875.3, 1: 8601.9. Samples: 334946600. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:43,785][121949] Avg episode reward: [(0, '6163.761'), (1, '5410.386')] [2023-12-26 04:49:43,944][123090] Updated weights for policy 1, policy_version 651909 (0.0005) [2023-12-26 04:49:44,013][123090] Updated weights for policy 1, policy_version 651919 (0.0008) [2023-12-26 04:49:44,077][123091] Updated weights for policy 0, policy_version 656498 (0.0006) [2023-12-26 04:49:44,079][123090] Updated weights for policy 1, policy_version 651929 (0.0010) [2023-12-26 04:49:44,142][123091] Updated weights for policy 0, policy_version 656508 (0.0006) [2023-12-26 04:49:44,207][123091] Updated weights for policy 0, policy_version 656518 (0.0006) [2023-12-26 04:49:44,281][123091] Updated weights for policy 0, policy_version 656528 (0.0005) [2023-12-26 04:49:44,798][123090] Updated weights for policy 1, policy_version 651939 (0.0009) [2023-12-26 04:49:44,847][123090] Updated weights for policy 1, policy_version 651949 (0.0005) [2023-12-26 04:49:44,907][123090] Updated weights for policy 1, policy_version 651959 (0.0005) [2023-12-26 04:49:44,932][123091] Updated weights for policy 0, policy_version 656538 (0.0009) [2023-12-26 04:49:44,991][123091] Updated weights for policy 0, policy_version 656548 (0.0009) [2023-12-26 04:49:45,054][123091] Updated weights for policy 0, policy_version 656558 (0.0009) [2023-12-26 04:49:45,665][123090] Updated weights for policy 1, policy_version 651969 (0.0005) [2023-12-26 04:49:45,719][123090] Updated weights for policy 1, policy_version 651979 (0.0005) [2023-12-26 04:49:45,774][123090] Updated weights for policy 1, policy_version 651989 (0.0005) [2023-12-26 04:49:45,830][123090] Updated weights for policy 1, policy_version 651999 (0.0005) [2023-12-26 04:49:45,935][123091] Updated weights for policy 0, policy_version 656568 (0.0010) [2023-12-26 04:49:45,997][123091] Updated weights for policy 0, policy_version 656578 (0.0010) [2023-12-26 04:49:46,069][123091] Updated weights for policy 0, policy_version 656588 (0.0010) [2023-12-26 04:49:46,468][123090] Updated weights for policy 1, policy_version 652009 (0.0005) [2023-12-26 04:49:46,514][123090] Updated weights for policy 1, policy_version 652019 (0.0005) [2023-12-26 04:49:46,572][123090] Updated weights for policy 1, policy_version 652029 (0.0010) [2023-12-26 04:49:46,937][123091] Updated weights for policy 0, policy_version 656598 (0.0007) [2023-12-26 04:49:46,984][123091] Updated weights for policy 0, policy_version 656608 (0.0005) [2023-12-26 04:49:47,038][123091] Updated weights for policy 0, policy_version 656618 (0.0005) [2023-12-26 04:49:47,401][123090] Updated weights for policy 1, policy_version 652039 (0.0010) [2023-12-26 04:49:47,452][123090] Updated weights for policy 1, policy_version 652049 (0.0010) [2023-12-26 04:49:47,519][123090] Updated weights for policy 1, policy_version 652059 (0.0008) [2023-12-26 04:49:47,776][123091] Updated weights for policy 0, policy_version 656628 (0.0007) [2023-12-26 04:49:47,836][123091] Updated weights for policy 0, policy_version 656638 (0.0010) [2023-12-26 04:49:47,892][123091] Updated weights for policy 0, policy_version 656648 (0.0009) [2023-12-26 04:49:48,281][123090] Updated weights for policy 1, policy_version 652069 (0.0008) [2023-12-26 04:49:48,343][123090] Updated weights for policy 1, policy_version 652079 (0.0008) [2023-12-26 04:49:48,407][123090] Updated weights for policy 1, policy_version 652089 (0.0008) [2023-12-26 04:49:48,751][123091] Updated weights for policy 0, policy_version 656658 (0.0009) [2023-12-26 04:49:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 335044608. Throughput: 0: 8896.3, 1: 8772.0. Samples: 335058064. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:48,785][121949] Avg episode reward: [(0, '6152.287'), (1, '5559.031')] [2023-12-26 04:49:48,821][123091] Updated weights for policy 0, policy_version 656668 (0.0009) [2023-12-26 04:49:48,889][123091] Updated weights for policy 0, policy_version 656678 (0.0008) [2023-12-26 04:49:48,949][123091] Updated weights for policy 0, policy_version 656688 (0.0010) [2023-12-26 04:49:49,229][123090] Updated weights for policy 1, policy_version 652099 (0.0008) [2023-12-26 04:49:49,291][123090] Updated weights for policy 1, policy_version 652109 (0.0010) [2023-12-26 04:49:49,351][123090] Updated weights for policy 1, policy_version 652119 (0.0009) [2023-12-26 04:49:49,753][123091] Updated weights for policy 0, policy_version 656698 (0.0009) [2023-12-26 04:49:49,813][123091] Updated weights for policy 0, policy_version 656708 (0.0008) [2023-12-26 04:49:49,885][123091] Updated weights for policy 0, policy_version 656718 (0.0009) [2023-12-26 04:49:50,165][123090] Updated weights for policy 1, policy_version 652129 (0.0010) [2023-12-26 04:49:50,241][123090] Updated weights for policy 1, policy_version 652139 (0.0006) [2023-12-26 04:49:50,313][123090] Updated weights for policy 1, policy_version 652149 (0.0005) [2023-12-26 04:49:50,387][123090] Updated weights for policy 1, policy_version 652159 (0.0008) [2023-12-26 04:49:50,598][123091] Updated weights for policy 0, policy_version 656728 (0.0009) [2023-12-26 04:49:50,657][123091] Updated weights for policy 0, policy_version 656738 (0.0006) [2023-12-26 04:49:50,715][123091] Updated weights for policy 0, policy_version 656748 (0.0009) [2023-12-26 04:49:51,169][123090] Updated weights for policy 1, policy_version 652169 (0.0011) [2023-12-26 04:49:51,232][123090] Updated weights for policy 1, policy_version 652179 (0.0010) [2023-12-26 04:49:51,301][123090] Updated weights for policy 1, policy_version 652189 (0.0011) [2023-12-26 04:49:51,569][123091] Updated weights for policy 0, policy_version 656758 (0.0009) [2023-12-26 04:49:51,647][123091] Updated weights for policy 0, policy_version 656768 (0.0009) [2023-12-26 04:49:51,712][123091] Updated weights for policy 0, policy_version 656778 (0.0009) [2023-12-26 04:49:52,069][123090] Updated weights for policy 1, policy_version 652199 (0.0009) [2023-12-26 04:49:52,133][123090] Updated weights for policy 1, policy_version 652209 (0.0010) [2023-12-26 04:49:52,192][123090] Updated weights for policy 1, policy_version 652219 (0.0010) [2023-12-26 04:49:52,585][123091] Updated weights for policy 0, policy_version 656789 (0.0009) [2023-12-26 04:49:52,653][123091] Updated weights for policy 0, policy_version 656799 (0.0009) [2023-12-26 04:49:52,721][123091] Updated weights for policy 0, policy_version 656809 (0.0008) [2023-12-26 04:49:53,025][123090] Updated weights for policy 1, policy_version 652229 (0.0010) [2023-12-26 04:49:53,085][123090] Updated weights for policy 1, policy_version 652239 (0.0010) [2023-12-26 04:49:53,142][123090] Updated weights for policy 1, policy_version 652249 (0.0010) [2023-12-26 04:49:53,375][123091] Updated weights for policy 0, policy_version 656819 (0.0005) [2023-12-26 04:49:53,430][123091] Updated weights for policy 0, policy_version 656829 (0.0005) [2023-12-26 04:49:53,486][123091] Updated weights for policy 0, policy_version 656839 (0.0005) [2023-12-26 04:49:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 335134720. Throughput: 0: 8869.4, 1: 8784.2. Samples: 335109812. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:53,785][121949] Avg episode reward: [(0, '6129.111'), (1, '5597.453')] [2023-12-26 04:49:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000656848_168157184.pth... [2023-12-26 04:49:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000652256_166977536.pth... [2023-12-26 04:49:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000655792_167886848.pth [2023-12-26 04:49:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000651232_166715392.pth [2023-12-26 04:49:54,036][123090] Updated weights for policy 1, policy_version 652259 (0.0009) [2023-12-26 04:49:54,104][123090] Updated weights for policy 1, policy_version 652269 (0.0009) [2023-12-26 04:49:54,163][123090] Updated weights for policy 1, policy_version 652279 (0.0010) [2023-12-26 04:49:54,225][123091] Updated weights for policy 0, policy_version 656849 (0.0006) [2023-12-26 04:49:54,296][123091] Updated weights for policy 0, policy_version 656859 (0.0011) [2023-12-26 04:49:54,359][123091] Updated weights for policy 0, policy_version 656869 (0.0011) [2023-12-26 04:49:54,423][123091] Updated weights for policy 0, policy_version 656879 (0.0011) [2023-12-26 04:49:54,947][123090] Updated weights for policy 1, policy_version 652289 (0.0007) [2023-12-26 04:49:55,004][123090] Updated weights for policy 1, policy_version 652299 (0.0006) [2023-12-26 04:49:55,072][123090] Updated weights for policy 1, policy_version 652309 (0.0008) [2023-12-26 04:49:55,136][123090] Updated weights for policy 1, policy_version 652319 (0.0009) [2023-12-26 04:49:55,234][123091] Updated weights for policy 0, policy_version 656889 (0.0010) [2023-12-26 04:49:55,281][123091] Updated weights for policy 0, policy_version 656899 (0.0010) [2023-12-26 04:49:55,332][123091] Updated weights for policy 0, policy_version 656909 (0.0010) [2023-12-26 04:49:55,828][123090] Updated weights for policy 1, policy_version 652329 (0.0006) [2023-12-26 04:49:55,874][123090] Updated weights for policy 1, policy_version 652339 (0.0005) [2023-12-26 04:49:55,919][123090] Updated weights for policy 1, policy_version 652349 (0.0005) [2023-12-26 04:49:56,105][123091] Updated weights for policy 0, policy_version 656919 (0.0010) [2023-12-26 04:49:56,164][123091] Updated weights for policy 0, policy_version 656929 (0.0010) [2023-12-26 04:49:56,225][123091] Updated weights for policy 0, policy_version 656939 (0.0010) [2023-12-26 04:49:56,598][123090] Updated weights for policy 1, policy_version 652359 (0.0005) [2023-12-26 04:49:56,656][123090] Updated weights for policy 1, policy_version 652369 (0.0005) [2023-12-26 04:49:56,717][123090] Updated weights for policy 1, policy_version 652379 (0.0005) [2023-12-26 04:49:56,983][123091] Updated weights for policy 0, policy_version 656949 (0.0010) [2023-12-26 04:49:57,039][123091] Updated weights for policy 0, policy_version 656959 (0.0010) [2023-12-26 04:49:57,099][123091] Updated weights for policy 0, policy_version 656969 (0.0010) [2023-12-26 04:49:57,283][123090] Updated weights for policy 1, policy_version 652389 (0.0007) [2023-12-26 04:49:57,335][123090] Updated weights for policy 1, policy_version 652399 (0.0008) [2023-12-26 04:49:57,394][123090] Updated weights for policy 1, policy_version 652409 (0.0007) [2023-12-26 04:49:57,922][123091] Updated weights for policy 0, policy_version 656979 (0.0011) [2023-12-26 04:49:57,968][123091] Updated weights for policy 0, policy_version 656989 (0.0010) [2023-12-26 04:49:58,033][123091] Updated weights for policy 0, policy_version 656999 (0.0009) [2023-12-26 04:49:58,067][123090] Updated weights for policy 1, policy_version 652419 (0.0005) [2023-12-26 04:49:58,129][123090] Updated weights for policy 1, policy_version 652429 (0.0009) [2023-12-26 04:49:58,192][123090] Updated weights for policy 1, policy_version 652439 (0.0009) [2023-12-26 04:49:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 335224832. Throughput: 0: 8905.0, 1: 8951.6. Samples: 335219536. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:49:58,785][121949] Avg episode reward: [(0, '6138.032'), (1, '5452.393')] [2023-12-26 04:49:58,927][123091] Updated weights for policy 0, policy_version 657009 (0.0010) [2023-12-26 04:49:58,986][123091] Updated weights for policy 0, policy_version 657019 (0.0008) [2023-12-26 04:49:59,051][123091] Updated weights for policy 0, policy_version 657029 (0.0008) [2023-12-26 04:49:59,113][123091] Updated weights for policy 0, policy_version 657039 (0.0008) [2023-12-26 04:49:59,218][123090] Updated weights for policy 1, policy_version 652449 (0.0010) [2023-12-26 04:49:59,287][123090] Updated weights for policy 1, policy_version 652459 (0.0010) [2023-12-26 04:49:59,354][123090] Updated weights for policy 1, policy_version 652469 (0.0010) [2023-12-26 04:49:59,422][123090] Updated weights for policy 1, policy_version 652479 (0.0009) [2023-12-26 04:49:59,821][123091] Updated weights for policy 0, policy_version 657049 (0.0009) [2023-12-26 04:49:59,886][123091] Updated weights for policy 0, policy_version 657059 (0.0009) [2023-12-26 04:49:59,935][123091] Updated weights for policy 0, policy_version 657069 (0.0009) [2023-12-26 04:50:00,225][123090] Updated weights for policy 1, policy_version 652489 (0.0009) [2023-12-26 04:50:00,281][123090] Updated weights for policy 1, policy_version 652499 (0.0009) [2023-12-26 04:50:00,335][123090] Updated weights for policy 1, policy_version 652509 (0.0009) [2023-12-26 04:50:00,819][123091] Updated weights for policy 0, policy_version 657079 (0.0010) [2023-12-26 04:50:00,865][123091] Updated weights for policy 0, policy_version 657089 (0.0008) [2023-12-26 04:50:00,910][123091] Updated weights for policy 0, policy_version 657099 (0.0007) [2023-12-26 04:50:01,170][123090] Updated weights for policy 1, policy_version 652519 (0.0010) [2023-12-26 04:50:01,228][123090] Updated weights for policy 1, policy_version 652529 (0.0009) [2023-12-26 04:50:01,297][123090] Updated weights for policy 1, policy_version 652539 (0.0008) [2023-12-26 04:50:01,740][123091] Updated weights for policy 0, policy_version 657109 (0.0008) [2023-12-26 04:50:01,798][123091] Updated weights for policy 0, policy_version 657119 (0.0009) [2023-12-26 04:50:01,859][123091] Updated weights for policy 0, policy_version 657129 (0.0009) [2023-12-26 04:50:02,129][123090] Updated weights for policy 1, policy_version 652549 (0.0008) [2023-12-26 04:50:02,197][123090] Updated weights for policy 1, policy_version 652559 (0.0005) [2023-12-26 04:50:02,270][123090] Updated weights for policy 1, policy_version 652569 (0.0007) [2023-12-26 04:50:02,675][123091] Updated weights for policy 0, policy_version 657139 (0.0007) [2023-12-26 04:50:02,732][123091] Updated weights for policy 0, policy_version 657149 (0.0007) [2023-12-26 04:50:02,785][123091] Updated weights for policy 0, policy_version 657159 (0.0010) [2023-12-26 04:50:03,129][123090] Updated weights for policy 1, policy_version 652579 (0.0009) [2023-12-26 04:50:03,208][123090] Updated weights for policy 1, policy_version 652589 (0.0010) [2023-12-26 04:50:03,273][123090] Updated weights for policy 1, policy_version 652599 (0.0008) [2023-12-26 04:50:03,470][123091] Updated weights for policy 0, policy_version 657169 (0.0006) [2023-12-26 04:50:03,522][123091] Updated weights for policy 0, policy_version 657179 (0.0009) [2023-12-26 04:50:03,572][123091] Updated weights for policy 0, policy_version 657189 (0.0009) [2023-12-26 04:50:03,624][123091] Updated weights for policy 0, policy_version 657199 (0.0005) [2023-12-26 04:50:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 335314944. Throughput: 0: 8879.9, 1: 8892.5. Samples: 335323444. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:03,785][121949] Avg episode reward: [(0, '6086.400'), (1, '5466.708')] [2023-12-26 04:50:03,946][123090] Updated weights for policy 1, policy_version 652609 (0.0009) [2023-12-26 04:50:04,008][123090] Updated weights for policy 1, policy_version 652619 (0.0008) [2023-12-26 04:50:04,066][123090] Updated weights for policy 1, policy_version 652629 (0.0007) [2023-12-26 04:50:04,134][123090] Updated weights for policy 1, policy_version 652639 (0.0005) [2023-12-26 04:50:04,413][123091] Updated weights for policy 0, policy_version 657209 (0.0010) [2023-12-26 04:50:04,479][123091] Updated weights for policy 0, policy_version 657219 (0.0011) [2023-12-26 04:50:04,543][123091] Updated weights for policy 0, policy_version 657229 (0.0011) [2023-12-26 04:50:04,889][123090] Updated weights for policy 1, policy_version 652649 (0.0005) [2023-12-26 04:50:04,945][123090] Updated weights for policy 1, policy_version 652659 (0.0005) [2023-12-26 04:50:04,998][123090] Updated weights for policy 1, policy_version 652669 (0.0009) [2023-12-26 04:50:05,374][123091] Updated weights for policy 0, policy_version 657239 (0.0011) [2023-12-26 04:50:05,437][123091] Updated weights for policy 0, policy_version 657249 (0.0011) [2023-12-26 04:50:05,503][123091] Updated weights for policy 0, policy_version 657259 (0.0011) [2023-12-26 04:50:05,720][123090] Updated weights for policy 1, policy_version 652679 (0.0009) [2023-12-26 04:50:05,794][123090] Updated weights for policy 1, policy_version 652689 (0.0006) [2023-12-26 04:50:05,863][123090] Updated weights for policy 1, policy_version 652699 (0.0005) [2023-12-26 04:50:06,271][123091] Updated weights for policy 0, policy_version 657269 (0.0011) [2023-12-26 04:50:06,331][123091] Updated weights for policy 0, policy_version 657279 (0.0011) [2023-12-26 04:50:06,398][123091] Updated weights for policy 0, policy_version 657289 (0.0011) [2023-12-26 04:50:06,614][123090] Updated weights for policy 1, policy_version 652709 (0.0007) [2023-12-26 04:50:06,667][123090] Updated weights for policy 1, policy_version 652719 (0.0007) [2023-12-26 04:50:06,731][123090] Updated weights for policy 1, policy_version 652729 (0.0005) [2023-12-26 04:50:07,231][123091] Updated weights for policy 0, policy_version 657299 (0.0011) [2023-12-26 04:50:07,302][123091] Updated weights for policy 0, policy_version 657309 (0.0011) [2023-12-26 04:50:07,372][123091] Updated weights for policy 0, policy_version 657319 (0.0011) [2023-12-26 04:50:07,454][123090] Updated weights for policy 1, policy_version 652739 (0.0007) [2023-12-26 04:50:07,525][123090] Updated weights for policy 1, policy_version 652749 (0.0009) [2023-12-26 04:50:07,586][123090] Updated weights for policy 1, policy_version 652759 (0.0009) [2023-12-26 04:50:08,172][123091] Updated weights for policy 0, policy_version 657329 (0.0011) [2023-12-26 04:50:08,225][123091] Updated weights for policy 0, policy_version 657339 (0.0011) [2023-12-26 04:50:08,278][123091] Updated weights for policy 0, policy_version 657349 (0.0011) [2023-12-26 04:50:08,341][123091] Updated weights for policy 0, policy_version 657359 (0.0010) [2023-12-26 04:50:08,408][123090] Updated weights for policy 1, policy_version 652769 (0.0008) [2023-12-26 04:50:08,472][123090] Updated weights for policy 1, policy_version 652779 (0.0010) [2023-12-26 04:50:08,537][123090] Updated weights for policy 1, policy_version 652789 (0.0009) [2023-12-26 04:50:08,605][123090] Updated weights for policy 1, policy_version 652799 (0.0008) [2023-12-26 04:50:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 335405056. Throughput: 0: 8907.5, 1: 8944.1. Samples: 335378212. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:08,785][121949] Avg episode reward: [(0, '6072.068'), (1, '5394.669')] [2023-12-26 04:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000652800_167116800.pth... [2023-12-26 04:50:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000657360_168288256.pth... [2023-12-26 04:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000651744_166846464.pth [2023-12-26 04:50:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000656336_168026112.pth [2023-12-26 04:50:09,165][123091] Updated weights for policy 0, policy_version 657369 (0.0010) [2023-12-26 04:50:09,237][123091] Updated weights for policy 0, policy_version 657379 (0.0011) [2023-12-26 04:50:09,293][123091] Updated weights for policy 0, policy_version 657389 (0.0011) [2023-12-26 04:50:09,417][123090] Updated weights for policy 1, policy_version 652809 (0.0011) [2023-12-26 04:50:09,480][123090] Updated weights for policy 1, policy_version 652819 (0.0009) [2023-12-26 04:50:09,532][123090] Updated weights for policy 1, policy_version 652829 (0.0010) [2023-12-26 04:50:10,056][123091] Updated weights for policy 0, policy_version 657399 (0.0011) [2023-12-26 04:50:10,119][123091] Updated weights for policy 0, policy_version 657409 (0.0011) [2023-12-26 04:50:10,175][123091] Updated weights for policy 0, policy_version 657419 (0.0011) [2023-12-26 04:50:10,400][123090] Updated weights for policy 1, policy_version 652839 (0.0007) [2023-12-26 04:50:10,457][123090] Updated weights for policy 1, policy_version 652849 (0.0005) [2023-12-26 04:50:10,535][123090] Updated weights for policy 1, policy_version 652859 (0.0006) [2023-12-26 04:50:11,015][123091] Updated weights for policy 0, policy_version 657429 (0.0011) [2023-12-26 04:50:11,085][123091] Updated weights for policy 0, policy_version 657439 (0.0010) [2023-12-26 04:50:11,152][123091] Updated weights for policy 0, policy_version 657449 (0.0011) [2023-12-26 04:50:11,288][123090] Updated weights for policy 1, policy_version 652869 (0.0008) [2023-12-26 04:50:11,361][123090] Updated weights for policy 1, policy_version 652879 (0.0011) [2023-12-26 04:50:11,431][123090] Updated weights for policy 1, policy_version 652889 (0.0011) [2023-12-26 04:50:12,021][123091] Updated weights for policy 0, policy_version 657459 (0.0011) [2023-12-26 04:50:12,089][123091] Updated weights for policy 0, policy_version 657469 (0.0011) [2023-12-26 04:50:12,156][123091] Updated weights for policy 0, policy_version 657479 (0.0011) [2023-12-26 04:50:12,257][123090] Updated weights for policy 1, policy_version 652899 (0.0011) [2023-12-26 04:50:12,314][123090] Updated weights for policy 1, policy_version 652909 (0.0011) [2023-12-26 04:50:12,382][123090] Updated weights for policy 1, policy_version 652919 (0.0011) [2023-12-26 04:50:12,990][123091] Updated weights for policy 0, policy_version 657489 (0.0009) [2023-12-26 04:50:13,040][123091] Updated weights for policy 0, policy_version 657499 (0.0007) [2023-12-26 04:50:13,107][123091] Updated weights for policy 0, policy_version 657509 (0.0005) [2023-12-26 04:50:13,164][123091] Updated weights for policy 0, policy_version 657519 (0.0005) [2023-12-26 04:50:13,177][123090] Updated weights for policy 1, policy_version 652929 (0.0010) [2023-12-26 04:50:13,234][123090] Updated weights for policy 1, policy_version 652939 (0.0005) [2023-12-26 04:50:13,303][123090] Updated weights for policy 1, policy_version 652949 (0.0005) [2023-12-26 04:50:13,376][123090] Updated weights for policy 1, policy_version 652959 (0.0005) [2023-12-26 04:50:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 335486976. Throughput: 0: 8745.5, 1: 8939.1. Samples: 335481440. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:13,785][121949] Avg episode reward: [(0, '5980.373'), (1, '5341.603')] [2023-12-26 04:50:13,952][123091] Updated weights for policy 0, policy_version 657529 (0.0009) [2023-12-26 04:50:14,004][123091] Updated weights for policy 0, policy_version 657539 (0.0009) [2023-12-26 04:50:14,058][123091] Updated weights for policy 0, policy_version 657549 (0.0007) [2023-12-26 04:50:14,077][123090] Updated weights for policy 1, policy_version 652969 (0.0009) [2023-12-26 04:50:14,151][123090] Updated weights for policy 1, policy_version 652979 (0.0008) [2023-12-26 04:50:14,214][123090] Updated weights for policy 1, policy_version 652989 (0.0010) [2023-12-26 04:50:14,914][123090] Updated weights for policy 1, policy_version 652999 (0.0007) [2023-12-26 04:50:14,916][123091] Updated weights for policy 0, policy_version 657559 (0.0009) [2023-12-26 04:50:14,965][123090] Updated weights for policy 1, policy_version 653009 (0.0008) [2023-12-26 04:50:14,980][123091] Updated weights for policy 0, policy_version 657569 (0.0011) [2023-12-26 04:50:15,030][123090] Updated weights for policy 1, policy_version 653019 (0.0006) [2023-12-26 04:50:15,048][123091] Updated weights for policy 0, policy_version 657579 (0.0011) [2023-12-26 04:50:15,862][123091] Updated weights for policy 0, policy_version 657589 (0.0011) [2023-12-26 04:50:15,905][123090] Updated weights for policy 1, policy_version 653029 (0.0008) [2023-12-26 04:50:15,919][123091] Updated weights for policy 0, policy_version 657599 (0.0010) [2023-12-26 04:50:15,965][123090] Updated weights for policy 1, policy_version 653039 (0.0006) [2023-12-26 04:50:15,971][123091] Updated weights for policy 0, policy_version 657609 (0.0010) [2023-12-26 04:50:16,027][123090] Updated weights for policy 1, policy_version 653049 (0.0007) [2023-12-26 04:50:16,807][123091] Updated weights for policy 0, policy_version 657619 (0.0009) [2023-12-26 04:50:16,868][123091] Updated weights for policy 0, policy_version 657629 (0.0005) [2023-12-26 04:50:16,869][123090] Updated weights for policy 1, policy_version 653059 (0.0009) [2023-12-26 04:50:16,931][123091] Updated weights for policy 0, policy_version 657639 (0.0007) [2023-12-26 04:50:16,936][123090] Updated weights for policy 1, policy_version 653069 (0.0008) [2023-12-26 04:50:16,994][123090] Updated weights for policy 1, policy_version 653079 (0.0009) [2023-12-26 04:50:17,644][123091] Updated weights for policy 0, policy_version 657649 (0.0006) [2023-12-26 04:50:17,698][123091] Updated weights for policy 0, policy_version 657659 (0.0010) [2023-12-26 04:50:17,756][123091] Updated weights for policy 0, policy_version 657669 (0.0010) [2023-12-26 04:50:17,826][123091] Updated weights for policy 0, policy_version 657679 (0.0008) [2023-12-26 04:50:17,850][123090] Updated weights for policy 1, policy_version 653089 (0.0008) [2023-12-26 04:50:17,905][123090] Updated weights for policy 1, policy_version 653099 (0.0009) [2023-12-26 04:50:17,963][123090] Updated weights for policy 1, policy_version 653109 (0.0009) [2023-12-26 04:50:18,020][123090] Updated weights for policy 1, policy_version 653119 (0.0009) [2023-12-26 04:50:18,543][123091] Updated weights for policy 0, policy_version 657689 (0.0006) [2023-12-26 04:50:18,605][123091] Updated weights for policy 0, policy_version 657699 (0.0009) [2023-12-26 04:50:18,667][123091] Updated weights for policy 0, policy_version 657709 (0.0011) [2023-12-26 04:50:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 335577088. Throughput: 0: 8802.3, 1: 8963.1. Samples: 335589376. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:18,785][121949] Avg episode reward: [(0, '5943.266'), (1, '5360.717')] [2023-12-26 04:50:18,841][123090] Updated weights for policy 1, policy_version 653129 (0.0008) [2023-12-26 04:50:18,906][123090] Updated weights for policy 1, policy_version 653139 (0.0009) [2023-12-26 04:50:18,974][123090] Updated weights for policy 1, policy_version 653149 (0.0006) [2023-12-26 04:50:19,474][123091] Updated weights for policy 0, policy_version 657719 (0.0009) [2023-12-26 04:50:19,544][123091] Updated weights for policy 0, policy_version 657729 (0.0007) [2023-12-26 04:50:19,613][123091] Updated weights for policy 0, policy_version 657739 (0.0006) [2023-12-26 04:50:19,714][123090] Updated weights for policy 1, policy_version 653159 (0.0008) [2023-12-26 04:50:19,789][123090] Updated weights for policy 1, policy_version 653169 (0.0009) [2023-12-26 04:50:19,865][123090] Updated weights for policy 1, policy_version 653179 (0.0010) [2023-12-26 04:50:20,351][123091] Updated weights for policy 0, policy_version 657749 (0.0008) [2023-12-26 04:50:20,417][123091] Updated weights for policy 0, policy_version 657759 (0.0006) [2023-12-26 04:50:20,484][123091] Updated weights for policy 0, policy_version 657769 (0.0006) [2023-12-26 04:50:20,749][123090] Updated weights for policy 1, policy_version 653189 (0.0010) [2023-12-26 04:50:20,804][123090] Updated weights for policy 1, policy_version 653199 (0.0010) [2023-12-26 04:50:20,864][123090] Updated weights for policy 1, policy_version 653209 (0.0010) [2023-12-26 04:50:21,178][123091] Updated weights for policy 0, policy_version 657779 (0.0007) [2023-12-26 04:50:21,245][123091] Updated weights for policy 0, policy_version 657789 (0.0009) [2023-12-26 04:50:21,313][123091] Updated weights for policy 0, policy_version 657799 (0.0009) [2023-12-26 04:50:21,826][123090] Updated weights for policy 1, policy_version 653219 (0.0009) [2023-12-26 04:50:21,895][123090] Updated weights for policy 1, policy_version 653229 (0.0008) [2023-12-26 04:50:21,973][123090] Updated weights for policy 1, policy_version 653239 (0.0010) [2023-12-26 04:50:22,115][123091] Updated weights for policy 0, policy_version 657809 (0.0009) [2023-12-26 04:50:22,181][123091] Updated weights for policy 0, policy_version 657819 (0.0010) [2023-12-26 04:50:22,237][123091] Updated weights for policy 0, policy_version 657829 (0.0010) [2023-12-26 04:50:22,296][123091] Updated weights for policy 0, policy_version 657839 (0.0009) [2023-12-26 04:50:22,803][123090] Updated weights for policy 1, policy_version 653249 (0.0009) [2023-12-26 04:50:22,858][123090] Updated weights for policy 1, policy_version 653259 (0.0010) [2023-12-26 04:50:22,923][123090] Updated weights for policy 1, policy_version 653269 (0.0010) [2023-12-26 04:50:22,975][123090] Updated weights for policy 1, policy_version 653279 (0.0009) [2023-12-26 04:50:23,157][123091] Updated weights for policy 0, policy_version 657849 (0.0010) [2023-12-26 04:50:23,217][123091] Updated weights for policy 0, policy_version 657859 (0.0010) [2023-12-26 04:50:23,276][123091] Updated weights for policy 0, policy_version 657869 (0.0010) [2023-12-26 04:50:23,756][123090] Updated weights for policy 1, policy_version 653290 (0.0009) [2023-12-26 04:50:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 335659008. Throughput: 0: 8843.2, 1: 8857.1. Samples: 335640424. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:23,785][121949] Avg episode reward: [(0, '5978.163'), (1, '5281.797')] [2023-12-26 04:50:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000657872_168419328.pth... [2023-12-26 04:50:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000656848_168157184.pth [2023-12-26 04:50:23,808][123090] Updated weights for policy 1, policy_version 653300 (0.0009) [2023-12-26 04:50:23,859][123090] Updated weights for policy 1, policy_version 653310 (0.0008) [2023-12-26 04:50:23,866][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000653312_167247872.pth... [2023-12-26 04:50:23,870][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000652256_166977536.pth [2023-12-26 04:50:24,140][123091] Updated weights for policy 0, policy_version 657879 (0.0009) [2023-12-26 04:50:24,191][123091] Updated weights for policy 0, policy_version 657889 (0.0009) [2023-12-26 04:50:24,254][123091] Updated weights for policy 0, policy_version 657899 (0.0010) [2023-12-26 04:50:24,686][123090] Updated weights for policy 1, policy_version 653320 (0.0007) [2023-12-26 04:50:24,757][123090] Updated weights for policy 1, policy_version 653330 (0.0006) [2023-12-26 04:50:24,821][123090] Updated weights for policy 1, policy_version 653340 (0.0006) [2023-12-26 04:50:25,150][123091] Updated weights for policy 0, policy_version 657909 (0.0009) [2023-12-26 04:50:25,213][123091] Updated weights for policy 0, policy_version 657919 (0.0009) [2023-12-26 04:50:25,272][123091] Updated weights for policy 0, policy_version 657929 (0.0009) [2023-12-26 04:50:25,569][123090] Updated weights for policy 1, policy_version 653350 (0.0009) [2023-12-26 04:50:25,612][123090] Updated weights for policy 1, policy_version 653360 (0.0010) [2023-12-26 04:50:25,659][123090] Updated weights for policy 1, policy_version 653370 (0.0010) [2023-12-26 04:50:26,081][123091] Updated weights for policy 0, policy_version 657939 (0.0009) [2023-12-26 04:50:26,134][123091] Updated weights for policy 0, policy_version 657949 (0.0009) [2023-12-26 04:50:26,186][123091] Updated weights for policy 0, policy_version 657959 (0.0008) [2023-12-26 04:50:26,494][123090] Updated weights for policy 1, policy_version 653380 (0.0010) [2023-12-26 04:50:26,554][123090] Updated weights for policy 1, policy_version 653390 (0.0010) [2023-12-26 04:50:26,610][123090] Updated weights for policy 1, policy_version 653400 (0.0010) [2023-12-26 04:50:27,067][123091] Updated weights for policy 0, policy_version 657969 (0.0009) [2023-12-26 04:50:27,126][123091] Updated weights for policy 0, policy_version 657979 (0.0010) [2023-12-26 04:50:27,193][123091] Updated weights for policy 0, policy_version 657989 (0.0010) [2023-12-26 04:50:27,251][123091] Updated weights for policy 0, policy_version 657999 (0.0010) [2023-12-26 04:50:27,319][123090] Updated weights for policy 1, policy_version 653410 (0.0009) [2023-12-26 04:50:27,374][123090] Updated weights for policy 1, policy_version 653420 (0.0005) [2023-12-26 04:50:27,432][123090] Updated weights for policy 1, policy_version 653430 (0.0005) [2023-12-26 04:50:27,485][123090] Updated weights for policy 1, policy_version 653440 (0.0005) [2023-12-26 04:50:28,159][123090] Updated weights for policy 1, policy_version 653450 (0.0009) [2023-12-26 04:50:28,177][123091] Updated weights for policy 0, policy_version 658009 (0.0008) [2023-12-26 04:50:28,210][123090] Updated weights for policy 1, policy_version 653460 (0.0008) [2023-12-26 04:50:28,228][123091] Updated weights for policy 0, policy_version 658019 (0.0010) [2023-12-26 04:50:28,269][123090] Updated weights for policy 1, policy_version 653470 (0.0006) [2023-12-26 04:50:28,285][123091] Updated weights for policy 0, policy_version 658029 (0.0009) [2023-12-26 04:50:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 335749120. Throughput: 0: 8793.6, 1: 8919.2. Samples: 335743672. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:28,784][121949] Avg episode reward: [(0, '5936.201'), (1, '5209.055')] [2023-12-26 04:50:29,054][123090] Updated weights for policy 1, policy_version 653480 (0.0010) [2023-12-26 04:50:29,117][123090] Updated weights for policy 1, policy_version 653490 (0.0010) [2023-12-26 04:50:29,179][123090] Updated weights for policy 1, policy_version 653500 (0.0010) [2023-12-26 04:50:29,199][123091] Updated weights for policy 0, policy_version 658040 (0.0008) [2023-12-26 04:50:29,271][123091] Updated weights for policy 0, policy_version 658050 (0.0007) [2023-12-26 04:50:29,333][123091] Updated weights for policy 0, policy_version 658060 (0.0009) [2023-12-26 04:50:29,989][123090] Updated weights for policy 1, policy_version 653510 (0.0008) [2023-12-26 04:50:30,057][123090] Updated weights for policy 1, policy_version 653520 (0.0009) [2023-12-26 04:50:30,121][123090] Updated weights for policy 1, policy_version 653530 (0.0009) [2023-12-26 04:50:30,158][123091] Updated weights for policy 0, policy_version 658070 (0.0007) [2023-12-26 04:50:30,218][123091] Updated weights for policy 0, policy_version 658080 (0.0009) [2023-12-26 04:50:30,283][123091] Updated weights for policy 0, policy_version 658090 (0.0009) [2023-12-26 04:50:30,889][123090] Updated weights for policy 1, policy_version 653540 (0.0007) [2023-12-26 04:50:30,944][123090] Updated weights for policy 1, policy_version 653550 (0.0005) [2023-12-26 04:50:30,997][123090] Updated weights for policy 1, policy_version 653560 (0.0005) [2023-12-26 04:50:31,148][123091] Updated weights for policy 0, policy_version 658100 (0.0009) [2023-12-26 04:50:31,209][123091] Updated weights for policy 0, policy_version 658110 (0.0010) [2023-12-26 04:50:31,267][123091] Updated weights for policy 0, policy_version 658121 (0.0010) [2023-12-26 04:50:31,726][123090] Updated weights for policy 1, policy_version 653570 (0.0007) [2023-12-26 04:50:31,798][123090] Updated weights for policy 1, policy_version 653580 (0.0006) [2023-12-26 04:50:31,868][123090] Updated weights for policy 1, policy_version 653590 (0.0005) [2023-12-26 04:50:31,923][123090] Updated weights for policy 1, policy_version 653600 (0.0005) [2023-12-26 04:50:32,143][123091] Updated weights for policy 0, policy_version 658131 (0.0008) [2023-12-26 04:50:32,202][123091] Updated weights for policy 0, policy_version 658141 (0.0010) [2023-12-26 04:50:32,268][123091] Updated weights for policy 0, policy_version 658151 (0.0011) [2023-12-26 04:50:32,599][123090] Updated weights for policy 1, policy_version 653610 (0.0005) [2023-12-26 04:50:32,662][123090] Updated weights for policy 1, policy_version 653620 (0.0007) [2023-12-26 04:50:32,724][123090] Updated weights for policy 1, policy_version 653630 (0.0009) [2023-12-26 04:50:33,084][123091] Updated weights for policy 0, policy_version 658161 (0.0010) [2023-12-26 04:50:33,138][123091] Updated weights for policy 0, policy_version 658171 (0.0005) [2023-12-26 04:50:33,192][123091] Updated weights for policy 0, policy_version 658181 (0.0006) [2023-12-26 04:50:33,239][123091] Updated weights for policy 0, policy_version 658191 (0.0005) [2023-12-26 04:50:33,438][123090] Updated weights for policy 1, policy_version 653640 (0.0006) [2023-12-26 04:50:33,499][123090] Updated weights for policy 1, policy_version 653650 (0.0007) [2023-12-26 04:50:33,557][123090] Updated weights for policy 1, policy_version 653660 (0.0009) [2023-12-26 04:50:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 335839232. Throughput: 0: 8703.3, 1: 8915.3. Samples: 335850900. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:33,785][121949] Avg episode reward: [(0, '5906.547'), (1, '5368.698')] [2023-12-26 04:50:33,981][123091] Updated weights for policy 0, policy_version 658201 (0.0009) [2023-12-26 04:50:34,046][123091] Updated weights for policy 0, policy_version 658211 (0.0009) [2023-12-26 04:50:34,098][123091] Updated weights for policy 0, policy_version 658221 (0.0010) [2023-12-26 04:50:34,366][123090] Updated weights for policy 1, policy_version 653670 (0.0009) [2023-12-26 04:50:34,431][123090] Updated weights for policy 1, policy_version 653680 (0.0009) [2023-12-26 04:50:34,499][123090] Updated weights for policy 1, policy_version 653690 (0.0010) [2023-12-26 04:50:34,941][123091] Updated weights for policy 0, policy_version 658232 (0.0010) [2023-12-26 04:50:34,996][123091] Updated weights for policy 0, policy_version 658243 (0.0010) [2023-12-26 04:50:35,049][123091] Updated weights for policy 0, policy_version 658253 (0.0009) [2023-12-26 04:50:35,271][123090] Updated weights for policy 1, policy_version 653700 (0.0009) [2023-12-26 04:50:35,324][123090] Updated weights for policy 1, policy_version 653710 (0.0009) [2023-12-26 04:50:35,390][123090] Updated weights for policy 1, policy_version 653720 (0.0008) [2023-12-26 04:50:35,940][123091] Updated weights for policy 0, policy_version 658263 (0.0009) [2023-12-26 04:50:35,988][123091] Updated weights for policy 0, policy_version 658273 (0.0009) [2023-12-26 04:50:36,039][123091] Updated weights for policy 0, policy_version 658283 (0.0009) [2023-12-26 04:50:36,169][123090] Updated weights for policy 1, policy_version 653730 (0.0009) [2023-12-26 04:50:36,230][123090] Updated weights for policy 1, policy_version 653740 (0.0011) [2023-12-26 04:50:36,290][123090] Updated weights for policy 1, policy_version 653750 (0.0011) [2023-12-26 04:50:36,354][123090] Updated weights for policy 1, policy_version 653760 (0.0011) [2023-12-26 04:50:36,878][123091] Updated weights for policy 0, policy_version 658293 (0.0008) [2023-12-26 04:50:36,934][123091] Updated weights for policy 0, policy_version 658303 (0.0010) [2023-12-26 04:50:36,997][123091] Updated weights for policy 0, policy_version 658313 (0.0010) [2023-12-26 04:50:37,210][123090] Updated weights for policy 1, policy_version 653770 (0.0011) [2023-12-26 04:50:37,282][123090] Updated weights for policy 1, policy_version 653780 (0.0011) [2023-12-26 04:50:37,356][123090] Updated weights for policy 1, policy_version 653790 (0.0010) [2023-12-26 04:50:37,831][123091] Updated weights for policy 0, policy_version 658323 (0.0011) [2023-12-26 04:50:37,884][123091] Updated weights for policy 0, policy_version 658333 (0.0010) [2023-12-26 04:50:37,943][123091] Updated weights for policy 0, policy_version 658344 (0.0010) [2023-12-26 04:50:38,124][123090] Updated weights for policy 1, policy_version 653800 (0.0011) [2023-12-26 04:50:38,183][123090] Updated weights for policy 1, policy_version 653810 (0.0010) [2023-12-26 04:50:38,235][123090] Updated weights for policy 1, policy_version 653820 (0.0010) [2023-12-26 04:50:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 335921152. Throughput: 0: 8693.9, 1: 8919.3. Samples: 335902404. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:38,785][121949] Avg episode reward: [(0, '5976.420'), (1, '5501.476')] [2023-12-26 04:50:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000658352_168542208.pth... [2023-12-26 04:50:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000653824_167378944.pth... [2023-12-26 04:50:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000652800_167116800.pth [2023-12-26 04:50:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000657360_168288256.pth [2023-12-26 04:50:38,827][123091] Updated weights for policy 0, policy_version 658354 (0.0009) [2023-12-26 04:50:38,887][123091] Updated weights for policy 0, policy_version 658364 (0.0009) [2023-12-26 04:50:38,945][123091] Updated weights for policy 0, policy_version 658374 (0.0009) [2023-12-26 04:50:38,989][123090] Updated weights for policy 1, policy_version 653830 (0.0011) [2023-12-26 04:50:39,006][123091] Updated weights for policy 0, policy_version 658384 (0.0010) [2023-12-26 04:50:39,047][123090] Updated weights for policy 1, policy_version 653840 (0.0011) [2023-12-26 04:50:39,101][123090] Updated weights for policy 1, policy_version 653850 (0.0011) [2023-12-26 04:50:39,849][123091] Updated weights for policy 0, policy_version 658394 (0.0008) [2023-12-26 04:50:39,913][123091] Updated weights for policy 0, policy_version 658404 (0.0010) [2023-12-26 04:50:39,964][123091] Updated weights for policy 0, policy_version 658414 (0.0010) [2023-12-26 04:50:40,001][123090] Updated weights for policy 1, policy_version 653860 (0.0009) [2023-12-26 04:50:40,063][123090] Updated weights for policy 1, policy_version 653870 (0.0009) [2023-12-26 04:50:40,116][123090] Updated weights for policy 1, policy_version 653880 (0.0009) [2023-12-26 04:50:40,718][123091] Updated weights for policy 0, policy_version 658424 (0.0011) [2023-12-26 04:50:40,766][123091] Updated weights for policy 0, policy_version 658434 (0.0011) [2023-12-26 04:50:40,818][123091] Updated weights for policy 0, policy_version 658444 (0.0011) [2023-12-26 04:50:41,008][123090] Updated weights for policy 1, policy_version 653890 (0.0009) [2023-12-26 04:50:41,071][123090] Updated weights for policy 1, policy_version 653900 (0.0010) [2023-12-26 04:50:41,129][123090] Updated weights for policy 1, policy_version 653910 (0.0010) [2023-12-26 04:50:41,192][123090] Updated weights for policy 1, policy_version 653920 (0.0009) [2023-12-26 04:50:41,682][123091] Updated weights for policy 0, policy_version 658454 (0.0010) [2023-12-26 04:50:41,758][123091] Updated weights for policy 0, policy_version 658464 (0.0011) [2023-12-26 04:50:41,815][123091] Updated weights for policy 0, policy_version 658474 (0.0011) [2023-12-26 04:50:42,086][123090] Updated weights for policy 1, policy_version 653930 (0.0009) [2023-12-26 04:50:42,155][123090] Updated weights for policy 1, policy_version 653940 (0.0007) [2023-12-26 04:50:42,214][123090] Updated weights for policy 1, policy_version 653950 (0.0006) [2023-12-26 04:50:42,612][123091] Updated weights for policy 0, policy_version 658484 (0.0010) [2023-12-26 04:50:42,673][123091] Updated weights for policy 0, policy_version 658494 (0.0010) [2023-12-26 04:50:42,737][123091] Updated weights for policy 0, policy_version 658504 (0.0010) [2023-12-26 04:50:43,052][123090] Updated weights for policy 1, policy_version 653960 (0.0009) [2023-12-26 04:50:43,117][123090] Updated weights for policy 1, policy_version 653970 (0.0009) [2023-12-26 04:50:43,176][123090] Updated weights for policy 1, policy_version 653980 (0.0008) [2023-12-26 04:50:43,495][123091] Updated weights for policy 0, policy_version 658514 (0.0009) [2023-12-26 04:50:43,562][123091] Updated weights for policy 0, policy_version 658524 (0.0005) [2023-12-26 04:50:43,611][123091] Updated weights for policy 0, policy_version 658534 (0.0005) [2023-12-26 04:50:43,665][123091] Updated weights for policy 0, policy_version 658544 (0.0005) [2023-12-26 04:50:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 336011264. Throughput: 0: 8640.9, 1: 8790.8. Samples: 336003960. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:43,784][121949] Avg episode reward: [(0, '5904.758'), (1, '5426.951')] [2023-12-26 04:50:43,887][123090] Updated weights for policy 1, policy_version 653990 (0.0007) [2023-12-26 04:50:43,936][123090] Updated weights for policy 1, policy_version 654000 (0.0006) [2023-12-26 04:50:43,984][123090] Updated weights for policy 1, policy_version 654010 (0.0005) [2023-12-26 04:50:44,339][123091] Updated weights for policy 0, policy_version 658554 (0.0010) [2023-12-26 04:50:44,391][123091] Updated weights for policy 0, policy_version 658564 (0.0009) [2023-12-26 04:50:44,452][123091] Updated weights for policy 0, policy_version 658574 (0.0009) [2023-12-26 04:50:44,707][123090] Updated weights for policy 1, policy_version 654020 (0.0005) [2023-12-26 04:50:44,780][123090] Updated weights for policy 1, policy_version 654030 (0.0010) [2023-12-26 04:50:44,846][123090] Updated weights for policy 1, policy_version 654040 (0.0011) [2023-12-26 04:50:45,300][123091] Updated weights for policy 0, policy_version 658584 (0.0010) [2023-12-26 04:50:45,366][123091] Updated weights for policy 0, policy_version 658594 (0.0010) [2023-12-26 04:50:45,433][123091] Updated weights for policy 0, policy_version 658604 (0.0010) [2023-12-26 04:50:45,551][123090] Updated weights for policy 1, policy_version 654050 (0.0010) [2023-12-26 04:50:45,608][123090] Updated weights for policy 1, policy_version 654060 (0.0005) [2023-12-26 04:50:45,657][123090] Updated weights for policy 1, policy_version 654070 (0.0005) [2023-12-26 04:50:45,706][123090] Updated weights for policy 1, policy_version 654080 (0.0005) [2023-12-26 04:50:46,290][123091] Updated weights for policy 0, policy_version 658614 (0.0011) [2023-12-26 04:50:46,344][123090] Updated weights for policy 1, policy_version 654090 (0.0006) [2023-12-26 04:50:46,357][123091] Updated weights for policy 0, policy_version 658624 (0.0011) [2023-12-26 04:50:46,402][123090] Updated weights for policy 1, policy_version 654100 (0.0006) [2023-12-26 04:50:46,417][123091] Updated weights for policy 0, policy_version 658634 (0.0011) [2023-12-26 04:50:46,459][123090] Updated weights for policy 1, policy_version 654110 (0.0005) [2023-12-26 04:50:47,139][123091] Updated weights for policy 0, policy_version 658644 (0.0010) [2023-12-26 04:50:47,166][123090] Updated weights for policy 1, policy_version 654120 (0.0008) [2023-12-26 04:50:47,190][123091] Updated weights for policy 0, policy_version 658654 (0.0005) [2023-12-26 04:50:47,236][123090] Updated weights for policy 1, policy_version 654130 (0.0009) [2023-12-26 04:50:47,245][123091] Updated weights for policy 0, policy_version 658664 (0.0005) [2023-12-26 04:50:47,302][123090] Updated weights for policy 1, policy_version 654140 (0.0008) [2023-12-26 04:50:47,931][123091] Updated weights for policy 0, policy_version 658674 (0.0005) [2023-12-26 04:50:47,991][123091] Updated weights for policy 0, policy_version 658684 (0.0005) [2023-12-26 04:50:48,044][123090] Updated weights for policy 1, policy_version 654150 (0.0007) [2023-12-26 04:50:48,061][123091] Updated weights for policy 0, policy_version 658694 (0.0008) [2023-12-26 04:50:48,098][123090] Updated weights for policy 1, policy_version 654160 (0.0006) [2023-12-26 04:50:48,112][123091] Updated weights for policy 0, policy_version 658704 (0.0010) [2023-12-26 04:50:48,160][123090] Updated weights for policy 1, policy_version 654170 (0.0008) [2023-12-26 04:50:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 336101376. Throughput: 0: 8697.3, 1: 8948.6. Samples: 336117504. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:48,784][121949] Avg episode reward: [(0, '6053.170'), (1, '5472.917')] [2023-12-26 04:50:48,795][123091] Updated weights for policy 0, policy_version 658714 (0.0006) [2023-12-26 04:50:48,856][123091] Updated weights for policy 0, policy_version 658724 (0.0006) [2023-12-26 04:50:48,928][123091] Updated weights for policy 0, policy_version 658734 (0.0006) [2023-12-26 04:50:49,006][123090] Updated weights for policy 1, policy_version 654180 (0.0009) [2023-12-26 04:50:49,066][123090] Updated weights for policy 1, policy_version 654190 (0.0011) [2023-12-26 04:50:49,134][123090] Updated weights for policy 1, policy_version 654200 (0.0011) [2023-12-26 04:50:49,667][123091] Updated weights for policy 0, policy_version 658744 (0.0010) [2023-12-26 04:50:49,724][123091] Updated weights for policy 0, policy_version 658754 (0.0006) [2023-12-26 04:50:49,778][123091] Updated weights for policy 0, policy_version 658764 (0.0005) [2023-12-26 04:50:49,960][123090] Updated weights for policy 1, policy_version 654210 (0.0010) [2023-12-26 04:50:50,020][123090] Updated weights for policy 1, policy_version 654220 (0.0011) [2023-12-26 04:50:50,076][123090] Updated weights for policy 1, policy_version 654230 (0.0010) [2023-12-26 04:50:50,136][123090] Updated weights for policy 1, policy_version 654240 (0.0010) [2023-12-26 04:50:50,584][123091] Updated weights for policy 0, policy_version 658774 (0.0011) [2023-12-26 04:50:50,650][123091] Updated weights for policy 0, policy_version 658784 (0.0011) [2023-12-26 04:50:50,714][123091] Updated weights for policy 0, policy_version 658794 (0.0011) [2023-12-26 04:50:50,984][123090] Updated weights for policy 1, policy_version 654250 (0.0009) [2023-12-26 04:50:51,050][123090] Updated weights for policy 1, policy_version 654260 (0.0007) [2023-12-26 04:50:51,122][123090] Updated weights for policy 1, policy_version 654270 (0.0006) [2023-12-26 04:50:51,528][123091] Updated weights for policy 0, policy_version 658804 (0.0010) [2023-12-26 04:50:51,585][123091] Updated weights for policy 0, policy_version 658814 (0.0009) [2023-12-26 04:50:51,652][123091] Updated weights for policy 0, policy_version 658824 (0.0010) [2023-12-26 04:50:51,849][123090] Updated weights for policy 1, policy_version 654280 (0.0005) [2023-12-26 04:50:51,914][123090] Updated weights for policy 1, policy_version 654290 (0.0005) [2023-12-26 04:50:51,974][123090] Updated weights for policy 1, policy_version 654300 (0.0005) [2023-12-26 04:50:52,500][123091] Updated weights for policy 0, policy_version 658834 (0.0010) [2023-12-26 04:50:52,558][123091] Updated weights for policy 0, policy_version 658844 (0.0010) [2023-12-26 04:50:52,618][123091] Updated weights for policy 0, policy_version 658854 (0.0009) [2023-12-26 04:50:52,671][123091] Updated weights for policy 0, policy_version 658864 (0.0009) [2023-12-26 04:50:52,724][123090] Updated weights for policy 1, policy_version 654310 (0.0008) [2023-12-26 04:50:52,781][123090] Updated weights for policy 1, policy_version 654320 (0.0009) [2023-12-26 04:50:52,832][123090] Updated weights for policy 1, policy_version 654330 (0.0009) [2023-12-26 04:50:53,438][123091] Updated weights for policy 0, policy_version 658874 (0.0008) [2023-12-26 04:50:53,499][123091] Updated weights for policy 0, policy_version 658884 (0.0009) [2023-12-26 04:50:53,562][123091] Updated weights for policy 0, policy_version 658894 (0.0009) [2023-12-26 04:50:53,678][123090] Updated weights for policy 1, policy_version 654340 (0.0009) [2023-12-26 04:50:53,741][123090] Updated weights for policy 1, policy_version 654350 (0.0009) [2023-12-26 04:50:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.8). Total num frames: 336191488. Throughput: 0: 8697.3, 1: 8891.4. Samples: 336169700. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:53,785][121949] Avg episode reward: [(0, '6114.545'), (1, '5562.558')] [2023-12-26 04:50:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000658896_168681472.pth... [2023-12-26 04:50:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000657872_168419328.pth [2023-12-26 04:50:53,809][123090] Updated weights for policy 1, policy_version 654360 (0.0008) [2023-12-26 04:50:53,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000654368_167518208.pth... [2023-12-26 04:50:53,864][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000653312_167247872.pth [2023-12-26 04:50:54,267][123091] Updated weights for policy 0, policy_version 658904 (0.0006) [2023-12-26 04:50:54,325][123091] Updated weights for policy 0, policy_version 658914 (0.0005) [2023-12-26 04:50:54,402][123091] Updated weights for policy 0, policy_version 658924 (0.0008) [2023-12-26 04:50:54,667][123090] Updated weights for policy 1, policy_version 654370 (0.0010) [2023-12-26 04:50:54,733][123090] Updated weights for policy 1, policy_version 654380 (0.0009) [2023-12-26 04:50:54,798][123090] Updated weights for policy 1, policy_version 654390 (0.0009) [2023-12-26 04:50:54,869][123090] Updated weights for policy 1, policy_version 654400 (0.0009) [2023-12-26 04:50:55,252][123091] Updated weights for policy 0, policy_version 658934 (0.0009) [2023-12-26 04:50:55,317][123091] Updated weights for policy 0, policy_version 658944 (0.0009) [2023-12-26 04:50:55,365][123091] Updated weights for policy 0, policy_version 658955 (0.0009) [2023-12-26 04:50:55,682][123090] Updated weights for policy 1, policy_version 654410 (0.0010) [2023-12-26 04:50:55,734][123090] Updated weights for policy 1, policy_version 654420 (0.0009) [2023-12-26 04:50:55,801][123090] Updated weights for policy 1, policy_version 654430 (0.0010) [2023-12-26 04:50:56,128][123091] Updated weights for policy 0, policy_version 658965 (0.0009) [2023-12-26 04:50:56,183][123091] Updated weights for policy 0, policy_version 658975 (0.0010) [2023-12-26 04:50:56,246][123091] Updated weights for policy 0, policy_version 658985 (0.0009) [2023-12-26 04:50:56,601][123090] Updated weights for policy 1, policy_version 654440 (0.0009) [2023-12-26 04:50:56,675][123090] Updated weights for policy 1, policy_version 654450 (0.0010) [2023-12-26 04:50:56,752][123090] Updated weights for policy 1, policy_version 654460 (0.0009) [2023-12-26 04:50:57,008][123091] Updated weights for policy 0, policy_version 658995 (0.0010) [2023-12-26 04:50:57,060][123091] Updated weights for policy 0, policy_version 659005 (0.0007) [2023-12-26 04:50:57,112][123091] Updated weights for policy 0, policy_version 659015 (0.0005) [2023-12-26 04:50:57,496][123090] Updated weights for policy 1, policy_version 654470 (0.0007) [2023-12-26 04:50:57,560][123090] Updated weights for policy 1, policy_version 654480 (0.0005) [2023-12-26 04:50:57,622][123090] Updated weights for policy 1, policy_version 654490 (0.0005) [2023-12-26 04:50:57,817][123091] Updated weights for policy 0, policy_version 659025 (0.0005) [2023-12-26 04:50:57,884][123091] Updated weights for policy 0, policy_version 659035 (0.0005) [2023-12-26 04:50:57,954][123091] Updated weights for policy 0, policy_version 659045 (0.0006) [2023-12-26 04:50:58,020][123091] Updated weights for policy 0, policy_version 659055 (0.0007) [2023-12-26 04:50:58,299][123090] Updated weights for policy 1, policy_version 654500 (0.0007) [2023-12-26 04:50:58,373][123090] Updated weights for policy 1, policy_version 654510 (0.0009) [2023-12-26 04:50:58,436][123090] Updated weights for policy 1, policy_version 654520 (0.0009) [2023-12-26 04:50:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 336281600. Throughput: 0: 8800.4, 1: 8885.3. Samples: 336277300. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:50:58,785][121949] Avg episode reward: [(0, '6119.824'), (1, '5638.749')] [2023-12-26 04:50:58,826][123091] Updated weights for policy 0, policy_version 659065 (0.0010) [2023-12-26 04:50:58,886][123091] Updated weights for policy 0, policy_version 659075 (0.0009) [2023-12-26 04:50:58,951][123091] Updated weights for policy 0, policy_version 659085 (0.0009) [2023-12-26 04:50:59,296][123090] Updated weights for policy 1, policy_version 654530 (0.0009) [2023-12-26 04:50:59,360][123090] Updated weights for policy 1, policy_version 654540 (0.0009) [2023-12-26 04:50:59,423][123090] Updated weights for policy 1, policy_version 654550 (0.0009) [2023-12-26 04:50:59,474][123090] Updated weights for policy 1, policy_version 654560 (0.0009) [2023-12-26 04:50:59,695][123091] Updated weights for policy 0, policy_version 659095 (0.0009) [2023-12-26 04:50:59,753][123091] Updated weights for policy 0, policy_version 659105 (0.0007) [2023-12-26 04:50:59,816][123091] Updated weights for policy 0, policy_version 659115 (0.0007) [2023-12-26 04:51:00,373][123090] Updated weights for policy 1, policy_version 654570 (0.0009) [2023-12-26 04:51:00,431][123090] Updated weights for policy 1, policy_version 654580 (0.0010) [2023-12-26 04:51:00,484][123090] Updated weights for policy 1, policy_version 654590 (0.0009) [2023-12-26 04:51:00,596][123091] Updated weights for policy 0, policy_version 659125 (0.0007) [2023-12-26 04:51:00,667][123091] Updated weights for policy 0, policy_version 659135 (0.0006) [2023-12-26 04:51:00,736][123091] Updated weights for policy 0, policy_version 659145 (0.0006) [2023-12-26 04:51:01,390][123090] Updated weights for policy 1, policy_version 654600 (0.0009) [2023-12-26 04:51:01,407][123091] Updated weights for policy 0, policy_version 659155 (0.0006) [2023-12-26 04:51:01,455][123090] Updated weights for policy 1, policy_version 654610 (0.0007) [2023-12-26 04:51:01,470][123091] Updated weights for policy 0, policy_version 659165 (0.0006) [2023-12-26 04:51:01,515][123090] Updated weights for policy 1, policy_version 654620 (0.0005) [2023-12-26 04:51:01,540][123091] Updated weights for policy 0, policy_version 659175 (0.0007) [2023-12-26 04:51:02,201][123090] Updated weights for policy 1, policy_version 654630 (0.0008) [2023-12-26 04:51:02,253][123090] Updated weights for policy 1, policy_version 654640 (0.0009) [2023-12-26 04:51:02,317][123090] Updated weights for policy 1, policy_version 654650 (0.0007) [2023-12-26 04:51:02,373][123091] Updated weights for policy 0, policy_version 659185 (0.0009) [2023-12-26 04:51:02,438][123091] Updated weights for policy 0, policy_version 659195 (0.0009) [2023-12-26 04:51:02,500][123091] Updated weights for policy 0, policy_version 659205 (0.0007) [2023-12-26 04:51:02,567][123091] Updated weights for policy 0, policy_version 659215 (0.0010) [2023-12-26 04:51:03,032][123090] Updated weights for policy 1, policy_version 654660 (0.0007) [2023-12-26 04:51:03,079][123090] Updated weights for policy 1, policy_version 654670 (0.0005) [2023-12-26 04:51:03,127][123090] Updated weights for policy 1, policy_version 654680 (0.0005) [2023-12-26 04:51:03,469][123091] Updated weights for policy 0, policy_version 659225 (0.0009) [2023-12-26 04:51:03,522][123091] Updated weights for policy 0, policy_version 659235 (0.0009) [2023-12-26 04:51:03,576][123091] Updated weights for policy 0, policy_version 659245 (0.0009) [2023-12-26 04:51:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 336371712. Throughput: 0: 8743.1, 1: 8893.4. Samples: 336383020. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:51:03,785][121949] Avg episode reward: [(0, '6116.788'), (1, '5734.328')] [2023-12-26 04:51:03,854][123090] Updated weights for policy 1, policy_version 654690 (0.0006) [2023-12-26 04:51:03,918][123090] Updated weights for policy 1, policy_version 654700 (0.0011) [2023-12-26 04:51:03,983][123090] Updated weights for policy 1, policy_version 654710 (0.0011) [2023-12-26 04:51:04,041][123090] Updated weights for policy 1, policy_version 654720 (0.0009) [2023-12-26 04:51:04,491][123091] Updated weights for policy 0, policy_version 659255 (0.0009) [2023-12-26 04:51:04,536][123091] Updated weights for policy 0, policy_version 659265 (0.0006) [2023-12-26 04:51:04,590][123091] Updated weights for policy 0, policy_version 659277 (0.0010) [2023-12-26 04:51:04,754][123090] Updated weights for policy 1, policy_version 654730 (0.0009) [2023-12-26 04:51:04,809][123090] Updated weights for policy 1, policy_version 654740 (0.0010) [2023-12-26 04:51:04,857][123090] Updated weights for policy 1, policy_version 654750 (0.0010) [2023-12-26 04:51:05,476][123091] Updated weights for policy 0, policy_version 659287 (0.0009) [2023-12-26 04:51:05,525][123091] Updated weights for policy 0, policy_version 659297 (0.0009) [2023-12-26 04:51:05,575][123091] Updated weights for policy 0, policy_version 659307 (0.0009) [2023-12-26 04:51:05,682][123090] Updated weights for policy 1, policy_version 654760 (0.0011) [2023-12-26 04:51:05,734][123090] Updated weights for policy 1, policy_version 654770 (0.0010) [2023-12-26 04:51:05,793][123090] Updated weights for policy 1, policy_version 654780 (0.0010) [2023-12-26 04:51:06,464][123091] Updated weights for policy 0, policy_version 659317 (0.0009) [2023-12-26 04:51:06,527][123091] Updated weights for policy 0, policy_version 659327 (0.0009) [2023-12-26 04:51:06,594][123091] Updated weights for policy 0, policy_version 659337 (0.0007) [2023-12-26 04:51:06,600][123090] Updated weights for policy 1, policy_version 654790 (0.0011) [2023-12-26 04:51:06,667][123090] Updated weights for policy 1, policy_version 654800 (0.0010) [2023-12-26 04:51:06,742][123090] Updated weights for policy 1, policy_version 654810 (0.0011) [2023-12-26 04:51:07,357][123091] Updated weights for policy 0, policy_version 659347 (0.0009) [2023-12-26 04:51:07,424][123091] Updated weights for policy 0, policy_version 659357 (0.0009) [2023-12-26 04:51:07,492][123091] Updated weights for policy 0, policy_version 659367 (0.0010) [2023-12-26 04:51:07,549][123090] Updated weights for policy 1, policy_version 654820 (0.0007) [2023-12-26 04:51:07,605][123090] Updated weights for policy 1, policy_version 654830 (0.0006) [2023-12-26 04:51:07,653][123090] Updated weights for policy 1, policy_version 654840 (0.0008) [2023-12-26 04:51:08,264][123091] Updated weights for policy 0, policy_version 659377 (0.0010) [2023-12-26 04:51:08,320][123091] Updated weights for policy 0, policy_version 659387 (0.0006) [2023-12-26 04:51:08,387][123091] Updated weights for policy 0, policy_version 659397 (0.0010) [2023-12-26 04:51:08,458][123091] Updated weights for policy 0, policy_version 659407 (0.0011) [2023-12-26 04:51:08,519][123090] Updated weights for policy 1, policy_version 654850 (0.0009) [2023-12-26 04:51:08,578][123090] Updated weights for policy 1, policy_version 654860 (0.0010) [2023-12-26 04:51:08,639][123090] Updated weights for policy 1, policy_version 654870 (0.0009) [2023-12-26 04:51:08,710][123090] Updated weights for policy 1, policy_version 654880 (0.0005) [2023-12-26 04:51:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 336461824. Throughput: 0: 8703.4, 1: 8947.8. Samples: 336434728. Policy #0 lag: (min: 31.0, avg: 31.3, max: 46.0) [2023-12-26 04:51:08,785][121949] Avg episode reward: [(0, '6144.041'), (1, '5386.509')] [2023-12-26 04:51:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000659408_168812544.pth... [2023-12-26 04:51:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000654880_167649280.pth... [2023-12-26 04:51:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000658352_168542208.pth [2023-12-26 04:51:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000653824_167378944.pth [2023-12-26 04:51:09,254][123091] Updated weights for policy 0, policy_version 659417 (0.0010) [2023-12-26 04:51:09,320][123091] Updated weights for policy 0, policy_version 659427 (0.0009) [2023-12-26 04:51:09,395][123091] Updated weights for policy 0, policy_version 659437 (0.0009) [2023-12-26 04:51:09,544][123090] Updated weights for policy 1, policy_version 654890 (0.0006) [2023-12-26 04:51:09,615][123090] Updated weights for policy 1, policy_version 654900 (0.0006) [2023-12-26 04:51:09,679][123090] Updated weights for policy 1, policy_version 654910 (0.0008) [2023-12-26 04:51:10,277][123091] Updated weights for policy 0, policy_version 659447 (0.0010) [2023-12-26 04:51:10,335][123091] Updated weights for policy 0, policy_version 659457 (0.0009) [2023-12-26 04:51:10,398][123091] Updated weights for policy 0, policy_version 659467 (0.0010) [2023-12-26 04:51:10,474][123090] Updated weights for policy 1, policy_version 654920 (0.0010) [2023-12-26 04:51:10,531][123090] Updated weights for policy 1, policy_version 654930 (0.0008) [2023-12-26 04:51:10,602][123090] Updated weights for policy 1, policy_version 654940 (0.0011) [2023-12-26 04:51:11,227][123091] Updated weights for policy 0, policy_version 659477 (0.0010) [2023-12-26 04:51:11,286][123091] Updated weights for policy 0, policy_version 659487 (0.0010) [2023-12-26 04:51:11,354][123091] Updated weights for policy 0, policy_version 659497 (0.0009) [2023-12-26 04:51:11,470][123090] Updated weights for policy 1, policy_version 654950 (0.0009) [2023-12-26 04:51:11,529][123090] Updated weights for policy 1, policy_version 654960 (0.0009) [2023-12-26 04:51:11,590][123090] Updated weights for policy 1, policy_version 654970 (0.0009) [2023-12-26 04:51:12,190][123091] Updated weights for policy 0, policy_version 659507 (0.0010) [2023-12-26 04:51:12,261][123091] Updated weights for policy 0, policy_version 659517 (0.0009) [2023-12-26 04:51:12,321][123091] Updated weights for policy 0, policy_version 659527 (0.0009) [2023-12-26 04:51:12,449][123090] Updated weights for policy 1, policy_version 654980 (0.0008) [2023-12-26 04:51:12,510][123090] Updated weights for policy 1, policy_version 654990 (0.0005) [2023-12-26 04:51:12,571][123090] Updated weights for policy 1, policy_version 655000 (0.0005) [2023-12-26 04:51:13,209][123091] Updated weights for policy 0, policy_version 659537 (0.0010) [2023-12-26 04:51:13,275][123091] Updated weights for policy 0, policy_version 659547 (0.0005) [2023-12-26 04:51:13,302][123090] Updated weights for policy 1, policy_version 655010 (0.0005) [2023-12-26 04:51:13,349][123091] Updated weights for policy 0, policy_version 659557 (0.0005) [2023-12-26 04:51:13,354][123090] Updated weights for policy 1, policy_version 655020 (0.0005) [2023-12-26 04:51:13,400][123090] Updated weights for policy 1, policy_version 655030 (0.0005) [2023-12-26 04:51:13,407][123091] Updated weights for policy 0, policy_version 659567 (0.0005) [2023-12-26 04:51:13,449][123090] Updated weights for policy 1, policy_version 655040 (0.0005) [2023-12-26 04:51:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 336543744. Throughput: 0: 8737.4, 1: 8885.1. Samples: 336536684. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:13,784][121949] Avg episode reward: [(0, '6218.281'), (1, '5044.796')] [2023-12-26 04:51:13,982][123091] Updated weights for policy 0, policy_version 659577 (0.0009) [2023-12-26 04:51:14,041][123091] Updated weights for policy 0, policy_version 659587 (0.0009) [2023-12-26 04:51:14,090][123091] Updated weights for policy 0, policy_version 659597 (0.0009) [2023-12-26 04:51:14,214][123090] Updated weights for policy 1, policy_version 655050 (0.0007) [2023-12-26 04:51:14,277][123090] Updated weights for policy 1, policy_version 655060 (0.0005) [2023-12-26 04:51:14,331][123090] Updated weights for policy 1, policy_version 655070 (0.0005) [2023-12-26 04:51:14,970][123091] Updated weights for policy 0, policy_version 659607 (0.0009) [2023-12-26 04:51:15,035][123091] Updated weights for policy 0, policy_version 659617 (0.0008) [2023-12-26 04:51:15,098][123090] Updated weights for policy 1, policy_version 655080 (0.0010) [2023-12-26 04:51:15,100][123091] Updated weights for policy 0, policy_version 659627 (0.0007) [2023-12-26 04:51:15,165][123090] Updated weights for policy 1, policy_version 655090 (0.0011) [2023-12-26 04:51:15,248][123090] Updated weights for policy 1, policy_version 655100 (0.0011) [2023-12-26 04:51:15,668][123091] Updated weights for policy 0, policy_version 659637 (0.0007) [2023-12-26 04:51:15,718][123091] Updated weights for policy 0, policy_version 659647 (0.0009) [2023-12-26 04:51:15,774][123091] Updated weights for policy 0, policy_version 659657 (0.0008) [2023-12-26 04:51:16,068][123090] Updated weights for policy 1, policy_version 655110 (0.0010) [2023-12-26 04:51:16,119][123090] Updated weights for policy 1, policy_version 655120 (0.0010) [2023-12-26 04:51:16,175][123090] Updated weights for policy 1, policy_version 655130 (0.0010) [2023-12-26 04:51:16,603][123091] Updated weights for policy 0, policy_version 659667 (0.0008) [2023-12-26 04:51:16,651][123091] Updated weights for policy 0, policy_version 659677 (0.0007) [2023-12-26 04:51:16,701][123091] Updated weights for policy 0, policy_version 659687 (0.0005) [2023-12-26 04:51:16,977][123090] Updated weights for policy 1, policy_version 655140 (0.0008) [2023-12-26 04:51:17,036][123090] Updated weights for policy 1, policy_version 655150 (0.0008) [2023-12-26 04:51:17,092][123090] Updated weights for policy 1, policy_version 655160 (0.0010) [2023-12-26 04:51:17,426][123091] Updated weights for policy 0, policy_version 659697 (0.0006) [2023-12-26 04:51:17,476][123091] Updated weights for policy 0, policy_version 659707 (0.0009) [2023-12-26 04:51:17,537][123091] Updated weights for policy 0, policy_version 659718 (0.0009) [2023-12-26 04:51:17,596][123091] Updated weights for policy 0, policy_version 659728 (0.0010) [2023-12-26 04:51:17,874][123090] Updated weights for policy 1, policy_version 655170 (0.0010) [2023-12-26 04:51:17,935][123090] Updated weights for policy 1, policy_version 655180 (0.0007) [2023-12-26 04:51:17,983][123090] Updated weights for policy 1, policy_version 655190 (0.0009) [2023-12-26 04:51:18,037][123090] Updated weights for policy 1, policy_version 655200 (0.0009) [2023-12-26 04:51:18,427][123091] Updated weights for policy 0, policy_version 659738 (0.0011) [2023-12-26 04:51:18,498][123091] Updated weights for policy 0, policy_version 659748 (0.0011) [2023-12-26 04:51:18,573][123091] Updated weights for policy 0, policy_version 659758 (0.0011) [2023-12-26 04:51:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 336633856. Throughput: 0: 8839.3, 1: 8834.8. Samples: 336646236. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:18,785][121949] Avg episode reward: [(0, '6250.706'), (1, '5232.682')] [2023-12-26 04:51:18,790][123090] Updated weights for policy 1, policy_version 655210 (0.0005) [2023-12-26 04:51:18,855][123090] Updated weights for policy 1, policy_version 655220 (0.0006) [2023-12-26 04:51:18,913][123090] Updated weights for policy 1, policy_version 655230 (0.0006) [2023-12-26 04:51:19,301][123091] Updated weights for policy 0, policy_version 659768 (0.0007) [2023-12-26 04:51:19,382][123091] Updated weights for policy 0, policy_version 659779 (0.0009) [2023-12-26 04:51:19,445][123091] Updated weights for policy 0, policy_version 659789 (0.0007) [2023-12-26 04:51:19,637][123090] Updated weights for policy 1, policy_version 655240 (0.0006) [2023-12-26 04:51:19,709][123090] Updated weights for policy 1, policy_version 655250 (0.0007) [2023-12-26 04:51:19,783][123090] Updated weights for policy 1, policy_version 655260 (0.0006) [2023-12-26 04:51:20,277][123091] Updated weights for policy 0, policy_version 659799 (0.0011) [2023-12-26 04:51:20,344][123091] Updated weights for policy 0, policy_version 659809 (0.0006) [2023-12-26 04:51:20,397][123091] Updated weights for policy 0, policy_version 659819 (0.0005) [2023-12-26 04:51:20,571][123090] Updated weights for policy 1, policy_version 655270 (0.0008) [2023-12-26 04:51:20,639][123090] Updated weights for policy 1, policy_version 655280 (0.0011) [2023-12-26 04:51:20,711][123090] Updated weights for policy 1, policy_version 655290 (0.0011) [2023-12-26 04:51:21,190][123091] Updated weights for policy 0, policy_version 659829 (0.0008) [2023-12-26 04:51:21,256][123091] Updated weights for policy 0, policy_version 659839 (0.0010) [2023-12-26 04:51:21,326][123091] Updated weights for policy 0, policy_version 659849 (0.0009) [2023-12-26 04:51:21,450][123090] Updated weights for policy 1, policy_version 655300 (0.0008) [2023-12-26 04:51:21,502][123090] Updated weights for policy 1, policy_version 655310 (0.0009) [2023-12-26 04:51:21,569][123090] Updated weights for policy 1, policy_version 655320 (0.0009) [2023-12-26 04:51:22,144][123091] Updated weights for policy 0, policy_version 659859 (0.0010) [2023-12-26 04:51:22,204][123091] Updated weights for policy 0, policy_version 659869 (0.0009) [2023-12-26 04:51:22,267][123091] Updated weights for policy 0, policy_version 659879 (0.0009) [2023-12-26 04:51:22,462][123090] Updated weights for policy 1, policy_version 655330 (0.0010) [2023-12-26 04:51:22,525][123090] Updated weights for policy 1, policy_version 655340 (0.0011) [2023-12-26 04:51:22,585][123090] Updated weights for policy 1, policy_version 655350 (0.0011) [2023-12-26 04:51:22,645][123090] Updated weights for policy 1, policy_version 655360 (0.0010) [2023-12-26 04:51:23,119][123091] Updated weights for policy 0, policy_version 659889 (0.0008) [2023-12-26 04:51:23,185][123091] Updated weights for policy 0, policy_version 659899 (0.0009) [2023-12-26 04:51:23,253][123091] Updated weights for policy 0, policy_version 659909 (0.0009) [2023-12-26 04:51:23,308][123091] Updated weights for policy 0, policy_version 659919 (0.0009) [2023-12-26 04:51:23,449][123090] Updated weights for policy 1, policy_version 655370 (0.0010) [2023-12-26 04:51:23,506][123090] Updated weights for policy 1, policy_version 655380 (0.0009) [2023-12-26 04:51:23,556][123090] Updated weights for policy 1, policy_version 655390 (0.0010) [2023-12-26 04:51:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 336723968. Throughput: 0: 8872.7, 1: 8841.6. Samples: 336699552. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:23,785][121949] Avg episode reward: [(0, '6215.753'), (1, '5415.272')] [2023-12-26 04:51:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000655392_167780352.pth... [2023-12-26 04:51:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000659920_168943616.pth... [2023-12-26 04:51:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000654368_167518208.pth [2023-12-26 04:51:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000658896_168681472.pth [2023-12-26 04:51:24,123][123091] Updated weights for policy 0, policy_version 659929 (0.0010) [2023-12-26 04:51:24,180][123091] Updated weights for policy 0, policy_version 659939 (0.0010) [2023-12-26 04:51:24,235][123091] Updated weights for policy 0, policy_version 659949 (0.0009) [2023-12-26 04:51:24,337][123090] Updated weights for policy 1, policy_version 655400 (0.0010) [2023-12-26 04:51:24,390][123090] Updated weights for policy 1, policy_version 655410 (0.0009) [2023-12-26 04:51:24,452][123090] Updated weights for policy 1, policy_version 655420 (0.0009) [2023-12-26 04:51:25,026][123091] Updated weights for policy 0, policy_version 659959 (0.0009) [2023-12-26 04:51:25,088][123091] Updated weights for policy 0, policy_version 659969 (0.0010) [2023-12-26 04:51:25,145][123091] Updated weights for policy 0, policy_version 659979 (0.0009) [2023-12-26 04:51:25,373][123090] Updated weights for policy 1, policy_version 655430 (0.0010) [2023-12-26 04:51:25,444][123090] Updated weights for policy 1, policy_version 655440 (0.0009) [2023-12-26 04:51:25,513][123090] Updated weights for policy 1, policy_version 655450 (0.0009) [2023-12-26 04:51:25,935][123091] Updated weights for policy 0, policy_version 659990 (0.0008) [2023-12-26 04:51:26,010][123091] Updated weights for policy 0, policy_version 660000 (0.0006) [2023-12-26 04:51:26,056][123091] Updated weights for policy 0, policy_version 660010 (0.0008) [2023-12-26 04:51:26,248][123090] Updated weights for policy 1, policy_version 655460 (0.0007) [2023-12-26 04:51:26,296][123090] Updated weights for policy 1, policy_version 655470 (0.0005) [2023-12-26 04:51:26,341][123090] Updated weights for policy 1, policy_version 655480 (0.0005) [2023-12-26 04:51:26,677][123091] Updated weights for policy 0, policy_version 660020 (0.0006) [2023-12-26 04:51:26,723][123091] Updated weights for policy 0, policy_version 660030 (0.0005) [2023-12-26 04:51:26,771][123091] Updated weights for policy 0, policy_version 660040 (0.0005) [2023-12-26 04:51:27,007][123090] Updated weights for policy 1, policy_version 655490 (0.0005) [2023-12-26 04:51:27,068][123090] Updated weights for policy 1, policy_version 655500 (0.0005) [2023-12-26 04:51:27,135][123090] Updated weights for policy 1, policy_version 655510 (0.0005) [2023-12-26 04:51:27,216][123090] Updated weights for policy 1, policy_version 655520 (0.0005) [2023-12-26 04:51:27,461][123091] Updated weights for policy 0, policy_version 660050 (0.0006) [2023-12-26 04:51:27,513][123091] Updated weights for policy 0, policy_version 660060 (0.0005) [2023-12-26 04:51:27,567][123091] Updated weights for policy 0, policy_version 660070 (0.0005) [2023-12-26 04:51:27,614][123091] Updated weights for policy 0, policy_version 660080 (0.0005) [2023-12-26 04:51:27,895][123090] Updated weights for policy 1, policy_version 655530 (0.0010) [2023-12-26 04:51:27,942][123090] Updated weights for policy 1, policy_version 655540 (0.0010) [2023-12-26 04:51:27,992][123090] Updated weights for policy 1, policy_version 655550 (0.0010) [2023-12-26 04:51:28,237][123091] Updated weights for policy 0, policy_version 660090 (0.0005) [2023-12-26 04:51:28,286][123091] Updated weights for policy 0, policy_version 660100 (0.0006) [2023-12-26 04:51:28,342][123091] Updated weights for policy 0, policy_version 660110 (0.0009) [2023-12-26 04:51:28,666][123090] Updated weights for policy 1, policy_version 655560 (0.0009) [2023-12-26 04:51:28,715][123090] Updated weights for policy 1, policy_version 655570 (0.0009) [2023-12-26 04:51:28,767][123090] Updated weights for policy 1, policy_version 655580 (0.0009) [2023-12-26 04:51:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 336814080. Throughput: 0: 8954.4, 1: 8944.9. Samples: 336809436. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:28,785][121949] Avg episode reward: [(0, '6108.763'), (1, '5575.994')] [2023-12-26 04:51:29,122][123091] Updated weights for policy 0, policy_version 660120 (0.0006) [2023-12-26 04:51:29,177][123091] Updated weights for policy 0, policy_version 660130 (0.0010) [2023-12-26 04:51:29,237][123091] Updated weights for policy 0, policy_version 660140 (0.0010) [2023-12-26 04:51:29,627][123090] Updated weights for policy 1, policy_version 655590 (0.0008) [2023-12-26 04:51:29,678][123090] Updated weights for policy 1, policy_version 655600 (0.0008) [2023-12-26 04:51:29,729][123090] Updated weights for policy 1, policy_version 655610 (0.0008) [2023-12-26 04:51:29,998][123091] Updated weights for policy 0, policy_version 660150 (0.0010) [2023-12-26 04:51:30,061][123091] Updated weights for policy 0, policy_version 660160 (0.0010) [2023-12-26 04:51:30,126][123091] Updated weights for policy 0, policy_version 660170 (0.0010) [2023-12-26 04:51:30,480][123090] Updated weights for policy 1, policy_version 655620 (0.0009) [2023-12-26 04:51:30,542][123090] Updated weights for policy 1, policy_version 655630 (0.0010) [2023-12-26 04:51:30,601][123090] Updated weights for policy 1, policy_version 655640 (0.0010) [2023-12-26 04:51:31,054][123091] Updated weights for policy 0, policy_version 660180 (0.0010) [2023-12-26 04:51:31,117][123091] Updated weights for policy 0, policy_version 660190 (0.0009) [2023-12-26 04:51:31,184][123091] Updated weights for policy 0, policy_version 660200 (0.0009) [2023-12-26 04:51:31,308][123090] Updated weights for policy 1, policy_version 655650 (0.0009) [2023-12-26 04:51:31,379][123090] Updated weights for policy 1, policy_version 655660 (0.0010) [2023-12-26 04:51:31,456][123090] Updated weights for policy 1, policy_version 655670 (0.0005) [2023-12-26 04:51:31,527][123090] Updated weights for policy 1, policy_version 655680 (0.0005) [2023-12-26 04:51:32,066][123091] Updated weights for policy 0, policy_version 660210 (0.0010) [2023-12-26 04:51:32,122][123091] Updated weights for policy 0, policy_version 660220 (0.0009) [2023-12-26 04:51:32,174][123091] Updated weights for policy 0, policy_version 660230 (0.0009) [2023-12-26 04:51:32,208][123090] Updated weights for policy 1, policy_version 655690 (0.0005) [2023-12-26 04:51:32,222][123091] Updated weights for policy 0, policy_version 660240 (0.0008) [2023-12-26 04:51:32,262][123090] Updated weights for policy 1, policy_version 655700 (0.0005) [2023-12-26 04:51:32,326][123090] Updated weights for policy 1, policy_version 655710 (0.0009) [2023-12-26 04:51:32,985][123091] Updated weights for policy 0, policy_version 660250 (0.0005) [2023-12-26 04:51:33,009][123090] Updated weights for policy 1, policy_version 655720 (0.0006) [2023-12-26 04:51:33,030][123091] Updated weights for policy 0, policy_version 660260 (0.0005) [2023-12-26 04:51:33,057][123090] Updated weights for policy 1, policy_version 655730 (0.0005) [2023-12-26 04:51:33,075][123091] Updated weights for policy 0, policy_version 660270 (0.0005) [2023-12-26 04:51:33,108][123090] Updated weights for policy 1, policy_version 655740 (0.0005) [2023-12-26 04:51:33,763][123091] Updated weights for policy 0, policy_version 660280 (0.0005) [2023-12-26 04:51:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 336904192. Throughput: 0: 8929.0, 1: 8940.9. Samples: 336921648. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:33,784][121949] Avg episode reward: [(0, '6115.966'), (1, '5509.099')] [2023-12-26 04:51:33,789][123090] Updated weights for policy 1, policy_version 655750 (0.0006) [2023-12-26 04:51:33,808][123091] Updated weights for policy 0, policy_version 660290 (0.0005) [2023-12-26 04:51:33,838][123090] Updated weights for policy 1, policy_version 655760 (0.0005) [2023-12-26 04:51:33,854][123091] Updated weights for policy 0, policy_version 660300 (0.0005) [2023-12-26 04:51:33,884][123090] Updated weights for policy 1, policy_version 655770 (0.0005) [2023-12-26 04:51:34,545][123090] Updated weights for policy 1, policy_version 655780 (0.0006) [2023-12-26 04:51:34,554][123091] Updated weights for policy 0, policy_version 660310 (0.0008) [2023-12-26 04:51:34,611][123090] Updated weights for policy 1, policy_version 655790 (0.0008) [2023-12-26 04:51:34,616][123091] Updated weights for policy 0, policy_version 660320 (0.0010) [2023-12-26 04:51:34,678][123090] Updated weights for policy 1, policy_version 655800 (0.0009) [2023-12-26 04:51:34,678][123091] Updated weights for policy 0, policy_version 660330 (0.0009) [2023-12-26 04:51:35,438][123090] Updated weights for policy 1, policy_version 655810 (0.0010) [2023-12-26 04:51:35,503][123090] Updated weights for policy 1, policy_version 655820 (0.0009) [2023-12-26 04:51:35,543][123091] Updated weights for policy 0, policy_version 660340 (0.0008) [2023-12-26 04:51:35,560][123090] Updated weights for policy 1, policy_version 655830 (0.0009) [2023-12-26 04:51:35,600][123091] Updated weights for policy 0, policy_version 660350 (0.0009) [2023-12-26 04:51:35,623][123090] Updated weights for policy 1, policy_version 655840 (0.0008) [2023-12-26 04:51:35,664][123091] Updated weights for policy 0, policy_version 660360 (0.0008) [2023-12-26 04:51:36,436][123090] Updated weights for policy 1, policy_version 655850 (0.0010) [2023-12-26 04:51:36,452][123091] Updated weights for policy 0, policy_version 660370 (0.0009) [2023-12-26 04:51:36,496][123090] Updated weights for policy 1, policy_version 655860 (0.0008) [2023-12-26 04:51:36,507][123091] Updated weights for policy 0, policy_version 660380 (0.0008) [2023-12-26 04:51:36,563][123090] Updated weights for policy 1, policy_version 655870 (0.0008) [2023-12-26 04:51:36,570][123091] Updated weights for policy 0, policy_version 660390 (0.0009) [2023-12-26 04:51:36,627][123091] Updated weights for policy 0, policy_version 660400 (0.0009) [2023-12-26 04:51:37,344][123090] Updated weights for policy 1, policy_version 655880 (0.0006) [2023-12-26 04:51:37,401][123090] Updated weights for policy 1, policy_version 655890 (0.0006) [2023-12-26 04:51:37,459][123090] Updated weights for policy 1, policy_version 655900 (0.0009) [2023-12-26 04:51:37,514][123091] Updated weights for policy 0, policy_version 660410 (0.0009) [2023-12-26 04:51:37,567][123091] Updated weights for policy 0, policy_version 660420 (0.0009) [2023-12-26 04:51:37,623][123091] Updated weights for policy 0, policy_version 660430 (0.0010) [2023-12-26 04:51:38,243][123090] Updated weights for policy 1, policy_version 655910 (0.0009) [2023-12-26 04:51:38,311][123090] Updated weights for policy 1, policy_version 655920 (0.0009) [2023-12-26 04:51:38,387][123090] Updated weights for policy 1, policy_version 655930 (0.0011) [2023-12-26 04:51:38,489][123091] Updated weights for policy 0, policy_version 660440 (0.0008) [2023-12-26 04:51:38,548][123091] Updated weights for policy 0, policy_version 660450 (0.0005) [2023-12-26 04:51:38,594][123091] Updated weights for policy 0, policy_version 660460 (0.0005) [2023-12-26 04:51:38,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 337002496. Throughput: 0: 8927.3, 1: 8984.1. Samples: 336975712. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:38,784][121949] Avg episode reward: [(0, '6233.571'), (1, '5284.253')] [2023-12-26 04:51:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000660464_169082880.pth... [2023-12-26 04:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000655936_167919616.pth... [2023-12-26 04:51:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000659408_168812544.pth [2023-12-26 04:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000654880_167649280.pth [2023-12-26 04:51:39,203][123090] Updated weights for policy 1, policy_version 655940 (0.0010) [2023-12-26 04:51:39,269][123090] Updated weights for policy 1, policy_version 655950 (0.0010) [2023-12-26 04:51:39,334][123090] Updated weights for policy 1, policy_version 655960 (0.0011) [2023-12-26 04:51:39,406][123091] Updated weights for policy 0, policy_version 660470 (0.0008) [2023-12-26 04:51:39,470][123091] Updated weights for policy 0, policy_version 660480 (0.0010) [2023-12-26 04:51:39,533][123091] Updated weights for policy 0, policy_version 660490 (0.0009) [2023-12-26 04:51:40,180][123090] Updated weights for policy 1, policy_version 655970 (0.0008) [2023-12-26 04:51:40,243][123090] Updated weights for policy 1, policy_version 655980 (0.0008) [2023-12-26 04:51:40,296][123090] Updated weights for policy 1, policy_version 655990 (0.0010) [2023-12-26 04:51:40,353][123091] Updated weights for policy 0, policy_version 660500 (0.0009) [2023-12-26 04:51:40,360][123090] Updated weights for policy 1, policy_version 656000 (0.0010) [2023-12-26 04:51:40,410][123091] Updated weights for policy 0, policy_version 660510 (0.0009) [2023-12-26 04:51:40,468][123091] Updated weights for policy 0, policy_version 660520 (0.0009) [2023-12-26 04:51:41,176][123090] Updated weights for policy 1, policy_version 656010 (0.0008) [2023-12-26 04:51:41,252][123090] Updated weights for policy 1, policy_version 656020 (0.0008) [2023-12-26 04:51:41,316][123090] Updated weights for policy 1, policy_version 656030 (0.0007) [2023-12-26 04:51:41,410][123091] Updated weights for policy 0, policy_version 660530 (0.0010) [2023-12-26 04:51:41,482][123091] Updated weights for policy 0, policy_version 660540 (0.0008) [2023-12-26 04:51:41,551][123091] Updated weights for policy 0, policy_version 660550 (0.0006) [2023-12-26 04:51:41,622][123091] Updated weights for policy 0, policy_version 660560 (0.0006) [2023-12-26 04:51:42,167][123090] Updated weights for policy 1, policy_version 656040 (0.0009) [2023-12-26 04:51:42,235][123090] Updated weights for policy 1, policy_version 656050 (0.0010) [2023-12-26 04:51:42,308][123090] Updated weights for policy 1, policy_version 656060 (0.0008) [2023-12-26 04:51:42,343][123091] Updated weights for policy 0, policy_version 660570 (0.0008) [2023-12-26 04:51:42,407][123091] Updated weights for policy 0, policy_version 660580 (0.0008) [2023-12-26 04:51:42,476][123091] Updated weights for policy 0, policy_version 660590 (0.0008) [2023-12-26 04:51:43,110][123090] Updated weights for policy 1, policy_version 656070 (0.0007) [2023-12-26 04:51:43,175][123090] Updated weights for policy 1, policy_version 656080 (0.0006) [2023-12-26 04:51:43,230][123090] Updated weights for policy 1, policy_version 656090 (0.0005) [2023-12-26 04:51:43,251][123091] Updated weights for policy 0, policy_version 660600 (0.0010) [2023-12-26 04:51:43,310][123091] Updated weights for policy 0, policy_version 660610 (0.0011) [2023-12-26 04:51:43,375][123091] Updated weights for policy 0, policy_version 660620 (0.0008) [2023-12-26 04:51:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 337084416. Throughput: 0: 8806.7, 1: 8984.5. Samples: 337077908. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:43,785][121949] Avg episode reward: [(0, '6250.930'), (1, '5119.961')] [2023-12-26 04:51:43,886][123090] Updated weights for policy 1, policy_version 656100 (0.0008) [2023-12-26 04:51:43,957][123090] Updated weights for policy 1, policy_version 656110 (0.0011) [2023-12-26 04:51:44,024][123090] Updated weights for policy 1, policy_version 656120 (0.0011) [2023-12-26 04:51:44,050][123091] Updated weights for policy 0, policy_version 660630 (0.0006) [2023-12-26 04:51:44,107][123091] Updated weights for policy 0, policy_version 660640 (0.0008) [2023-12-26 04:51:44,167][123091] Updated weights for policy 0, policy_version 660650 (0.0011) [2023-12-26 04:51:44,855][123090] Updated weights for policy 1, policy_version 656130 (0.0010) [2023-12-26 04:51:44,874][123091] Updated weights for policy 0, policy_version 660660 (0.0006) [2023-12-26 04:51:44,923][123090] Updated weights for policy 1, policy_version 656140 (0.0010) [2023-12-26 04:51:44,942][123091] Updated weights for policy 0, policy_version 660670 (0.0007) [2023-12-26 04:51:44,987][123090] Updated weights for policy 1, policy_version 656150 (0.0008) [2023-12-26 04:51:45,005][123091] Updated weights for policy 0, policy_version 660680 (0.0009) [2023-12-26 04:51:45,059][123090] Updated weights for policy 1, policy_version 656160 (0.0008) [2023-12-26 04:51:45,688][123091] Updated weights for policy 0, policy_version 660690 (0.0006) [2023-12-26 04:51:45,737][123091] Updated weights for policy 0, policy_version 660700 (0.0005) [2023-12-26 04:51:45,795][123091] Updated weights for policy 0, policy_version 660710 (0.0006) [2023-12-26 04:51:45,854][123091] Updated weights for policy 0, policy_version 660720 (0.0006) [2023-12-26 04:51:45,859][123090] Updated weights for policy 1, policy_version 656170 (0.0005) [2023-12-26 04:51:45,931][123090] Updated weights for policy 1, policy_version 656180 (0.0007) [2023-12-26 04:51:45,990][123090] Updated weights for policy 1, policy_version 656190 (0.0005) [2023-12-26 04:51:46,625][123091] Updated weights for policy 0, policy_version 660730 (0.0006) [2023-12-26 04:51:46,688][123091] Updated weights for policy 0, policy_version 660740 (0.0006) [2023-12-26 04:51:46,705][123090] Updated weights for policy 1, policy_version 656200 (0.0006) [2023-12-26 04:51:46,762][123091] Updated weights for policy 0, policy_version 660750 (0.0005) [2023-12-26 04:51:46,765][123090] Updated weights for policy 1, policy_version 656210 (0.0005) [2023-12-26 04:51:46,825][123090] Updated weights for policy 1, policy_version 656220 (0.0006) [2023-12-26 04:51:47,452][123091] Updated weights for policy 0, policy_version 660760 (0.0010) [2023-12-26 04:51:47,500][123091] Updated weights for policy 0, policy_version 660770 (0.0010) [2023-12-26 04:51:47,551][123091] Updated weights for policy 0, policy_version 660780 (0.0010) [2023-12-26 04:51:47,657][123090] Updated weights for policy 1, policy_version 656230 (0.0008) [2023-12-26 04:51:47,716][123090] Updated weights for policy 1, policy_version 656240 (0.0009) [2023-12-26 04:51:47,771][123090] Updated weights for policy 1, policy_version 656250 (0.0010) [2023-12-26 04:51:48,275][123091] Updated weights for policy 0, policy_version 660790 (0.0007) [2023-12-26 04:51:48,326][123091] Updated weights for policy 0, policy_version 660800 (0.0006) [2023-12-26 04:51:48,395][123091] Updated weights for policy 0, policy_version 660810 (0.0008) [2023-12-26 04:51:48,703][123090] Updated weights for policy 1, policy_version 656260 (0.0009) [2023-12-26 04:51:48,773][123090] Updated weights for policy 1, policy_version 656270 (0.0009) [2023-12-26 04:51:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 337174528. Throughput: 0: 8952.8, 1: 8971.3. Samples: 337189604. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:48,785][121949] Avg episode reward: [(0, '6154.856'), (1, '4856.850')] [2023-12-26 04:51:48,849][123090] Updated weights for policy 1, policy_version 656280 (0.0010) [2023-12-26 04:51:49,106][123091] Updated weights for policy 0, policy_version 660820 (0.0007) [2023-12-26 04:51:49,165][123091] Updated weights for policy 0, policy_version 660830 (0.0010) [2023-12-26 04:51:49,227][123091] Updated weights for policy 0, policy_version 660840 (0.0009) [2023-12-26 04:51:49,663][123090] Updated weights for policy 1, policy_version 656290 (0.0010) [2023-12-26 04:51:49,730][123090] Updated weights for policy 1, policy_version 656300 (0.0010) [2023-12-26 04:51:49,801][123090] Updated weights for policy 1, policy_version 656310 (0.0010) [2023-12-26 04:51:49,871][123090] Updated weights for policy 1, policy_version 656320 (0.0008) [2023-12-26 04:51:50,101][123091] Updated weights for policy 0, policy_version 660850 (0.0009) [2023-12-26 04:51:50,169][123091] Updated weights for policy 0, policy_version 660860 (0.0011) [2023-12-26 04:51:50,233][123091] Updated weights for policy 0, policy_version 660870 (0.0011) [2023-12-26 04:51:50,307][123091] Updated weights for policy 0, policy_version 660880 (0.0011) [2023-12-26 04:51:50,698][123090] Updated weights for policy 1, policy_version 656330 (0.0009) [2023-12-26 04:51:50,763][123090] Updated weights for policy 1, policy_version 656340 (0.0009) [2023-12-26 04:51:50,824][123090] Updated weights for policy 1, policy_version 656350 (0.0009) [2023-12-26 04:51:51,112][123091] Updated weights for policy 0, policy_version 660890 (0.0010) [2023-12-26 04:51:51,177][123091] Updated weights for policy 0, policy_version 660900 (0.0010) [2023-12-26 04:51:51,238][123091] Updated weights for policy 0, policy_version 660910 (0.0010) [2023-12-26 04:51:51,657][123090] Updated weights for policy 1, policy_version 656360 (0.0009) [2023-12-26 04:51:51,721][123090] Updated weights for policy 1, policy_version 656370 (0.0009) [2023-12-26 04:51:51,799][123090] Updated weights for policy 1, policy_version 656380 (0.0010) [2023-12-26 04:51:52,117][123091] Updated weights for policy 0, policy_version 660920 (0.0010) [2023-12-26 04:51:52,171][123091] Updated weights for policy 0, policy_version 660930 (0.0010) [2023-12-26 04:51:52,228][123091] Updated weights for policy 0, policy_version 660940 (0.0009) [2023-12-26 04:51:52,555][123090] Updated weights for policy 1, policy_version 656390 (0.0010) [2023-12-26 04:51:52,621][123090] Updated weights for policy 1, policy_version 656400 (0.0010) [2023-12-26 04:51:52,686][123090] Updated weights for policy 1, policy_version 656410 (0.0009) [2023-12-26 04:51:52,996][123091] Updated weights for policy 0, policy_version 660950 (0.0007) [2023-12-26 04:51:53,050][123091] Updated weights for policy 0, policy_version 660960 (0.0005) [2023-12-26 04:51:53,111][123091] Updated weights for policy 0, policy_version 660970 (0.0005) [2023-12-26 04:51:53,558][123090] Updated weights for policy 1, policy_version 656420 (0.0008) [2023-12-26 04:51:53,617][123090] Updated weights for policy 1, policy_version 656430 (0.0005) [2023-12-26 04:51:53,671][123090] Updated weights for policy 1, policy_version 656440 (0.0005) [2023-12-26 04:51:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 337264640. Throughput: 0: 8964.3, 1: 8929.4. Samples: 337239944. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:53,785][121949] Avg episode reward: [(0, '6151.935'), (1, '4861.930')] [2023-12-26 04:51:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000656448_168050688.pth... [2023-12-26 04:51:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000660976_169213952.pth... [2023-12-26 04:51:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000655392_167780352.pth [2023-12-26 04:51:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000659920_168943616.pth [2023-12-26 04:51:53,849][123091] Updated weights for policy 0, policy_version 660980 (0.0007) [2023-12-26 04:51:53,897][123091] Updated weights for policy 0, policy_version 660990 (0.0009) [2023-12-26 04:51:53,943][123091] Updated weights for policy 0, policy_version 661000 (0.0009) [2023-12-26 04:51:54,461][123090] Updated weights for policy 1, policy_version 656450 (0.0006) [2023-12-26 04:51:54,511][123090] Updated weights for policy 1, policy_version 656460 (0.0009) [2023-12-26 04:51:54,567][123090] Updated weights for policy 1, policy_version 656470 (0.0008) [2023-12-26 04:51:54,748][123091] Updated weights for policy 0, policy_version 661011 (0.0008) [2023-12-26 04:51:54,807][123091] Updated weights for policy 0, policy_version 661021 (0.0009) [2023-12-26 04:51:54,858][123091] Updated weights for policy 0, policy_version 661031 (0.0007) [2023-12-26 04:51:55,412][123090] Updated weights for policy 1, policy_version 656481 (0.0010) [2023-12-26 04:51:55,486][123090] Updated weights for policy 1, policy_version 656491 (0.0006) [2023-12-26 04:51:55,564][123090] Updated weights for policy 1, policy_version 656501 (0.0007) [2023-12-26 04:51:55,635][123090] Updated weights for policy 1, policy_version 656511 (0.0010) [2023-12-26 04:51:55,738][123091] Updated weights for policy 0, policy_version 661041 (0.0009) [2023-12-26 04:51:55,796][123091] Updated weights for policy 0, policy_version 661051 (0.0006) [2023-12-26 04:51:55,857][123091] Updated weights for policy 0, policy_version 661061 (0.0008) [2023-12-26 04:51:55,913][123091] Updated weights for policy 0, policy_version 661071 (0.0009) [2023-12-26 04:51:56,380][123090] Updated weights for policy 1, policy_version 656521 (0.0006) [2023-12-26 04:51:56,438][123090] Updated weights for policy 1, policy_version 656531 (0.0010) [2023-12-26 04:51:56,494][123090] Updated weights for policy 1, policy_version 656541 (0.0010) [2023-12-26 04:51:56,714][123091] Updated weights for policy 0, policy_version 661081 (0.0009) [2023-12-26 04:51:56,763][123091] Updated weights for policy 0, policy_version 661092 (0.0009) [2023-12-26 04:51:56,810][123091] Updated weights for policy 0, policy_version 661102 (0.0008) [2023-12-26 04:51:57,231][123090] Updated weights for policy 1, policy_version 656551 (0.0007) [2023-12-26 04:51:57,299][123090] Updated weights for policy 1, policy_version 656561 (0.0005) [2023-12-26 04:51:57,366][123090] Updated weights for policy 1, policy_version 656571 (0.0007) [2023-12-26 04:51:57,591][123091] Updated weights for policy 0, policy_version 661112 (0.0007) [2023-12-26 04:51:57,647][123091] Updated weights for policy 0, policy_version 661123 (0.0008) [2023-12-26 04:51:57,695][123091] Updated weights for policy 0, policy_version 661133 (0.0009) [2023-12-26 04:51:58,143][123090] Updated weights for policy 1, policy_version 656581 (0.0010) [2023-12-26 04:51:58,217][123090] Updated weights for policy 1, policy_version 656591 (0.0011) [2023-12-26 04:51:58,278][123090] Updated weights for policy 1, policy_version 656601 (0.0010) [2023-12-26 04:51:58,485][123091] Updated weights for policy 0, policy_version 661143 (0.0008) [2023-12-26 04:51:58,556][123091] Updated weights for policy 0, policy_version 661153 (0.0008) [2023-12-26 04:51:58,626][123091] Updated weights for policy 0, policy_version 661163 (0.0008) [2023-12-26 04:51:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 337354752. Throughput: 0: 9019.0, 1: 8964.5. Samples: 337345944. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:51:58,785][121949] Avg episode reward: [(0, '6253.115'), (1, '4617.563')] [2023-12-26 04:51:59,129][123090] Updated weights for policy 1, policy_version 656611 (0.0009) [2023-12-26 04:51:59,189][123090] Updated weights for policy 1, policy_version 656621 (0.0006) [2023-12-26 04:51:59,261][123090] Updated weights for policy 1, policy_version 656631 (0.0007) [2023-12-26 04:51:59,514][123091] Updated weights for policy 0, policy_version 661173 (0.0008) [2023-12-26 04:51:59,574][123091] Updated weights for policy 0, policy_version 661183 (0.0008) [2023-12-26 04:51:59,633][123091] Updated weights for policy 0, policy_version 661193 (0.0008) [2023-12-26 04:52:00,083][123090] Updated weights for policy 1, policy_version 656641 (0.0011) [2023-12-26 04:52:00,149][123090] Updated weights for policy 1, policy_version 656651 (0.0010) [2023-12-26 04:52:00,208][123090] Updated weights for policy 1, policy_version 656661 (0.0010) [2023-12-26 04:52:00,271][123090] Updated weights for policy 1, policy_version 656671 (0.0010) [2023-12-26 04:52:00,467][123091] Updated weights for policy 0, policy_version 661203 (0.0009) [2023-12-26 04:52:00,525][123091] Updated weights for policy 0, policy_version 661213 (0.0009) [2023-12-26 04:52:00,595][123091] Updated weights for policy 0, policy_version 661223 (0.0010) [2023-12-26 04:52:00,901][123090] Updated weights for policy 1, policy_version 656681 (0.0007) [2023-12-26 04:52:00,951][123090] Updated weights for policy 1, policy_version 656691 (0.0010) [2023-12-26 04:52:00,998][123090] Updated weights for policy 1, policy_version 656701 (0.0010) [2023-12-26 04:52:01,468][123091] Updated weights for policy 0, policy_version 661233 (0.0009) [2023-12-26 04:52:01,525][123091] Updated weights for policy 0, policy_version 661243 (0.0009) [2023-12-26 04:52:01,577][123091] Updated weights for policy 0, policy_version 661253 (0.0009) [2023-12-26 04:52:01,630][123091] Updated weights for policy 0, policy_version 661263 (0.0009) [2023-12-26 04:52:01,778][123090] Updated weights for policy 1, policy_version 656711 (0.0012) [2023-12-26 04:52:01,845][123090] Updated weights for policy 1, policy_version 656721 (0.0006) [2023-12-26 04:52:01,904][123090] Updated weights for policy 1, policy_version 656731 (0.0005) [2023-12-26 04:52:02,507][123091] Updated weights for policy 0, policy_version 661273 (0.0009) [2023-12-26 04:52:02,562][123091] Updated weights for policy 0, policy_version 661283 (0.0008) [2023-12-26 04:52:02,624][123091] Updated weights for policy 0, policy_version 661293 (0.0006) [2023-12-26 04:52:02,638][123090] Updated weights for policy 1, policy_version 656741 (0.0007) [2023-12-26 04:52:02,700][123090] Updated weights for policy 1, policy_version 656751 (0.0010) [2023-12-26 04:52:02,763][123090] Updated weights for policy 1, policy_version 656761 (0.0010) [2023-12-26 04:52:03,297][123091] Updated weights for policy 0, policy_version 661303 (0.0005) [2023-12-26 04:52:03,357][123091] Updated weights for policy 0, policy_version 661313 (0.0005) [2023-12-26 04:52:03,431][123091] Updated weights for policy 0, policy_version 661323 (0.0005) [2023-12-26 04:52:03,686][123090] Updated weights for policy 1, policy_version 656771 (0.0009) [2023-12-26 04:52:03,733][123090] Updated weights for policy 1, policy_version 656781 (0.0008) [2023-12-26 04:52:03,782][123090] Updated weights for policy 1, policy_version 656791 (0.0009) [2023-12-26 04:52:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 337436672. Throughput: 0: 8956.1, 1: 8910.0. Samples: 337450212. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:03,785][121949] Avg episode reward: [(0, '6168.821'), (1, '4585.369')] [2023-12-26 04:52:04,109][123091] Updated weights for policy 0, policy_version 661333 (0.0007) [2023-12-26 04:52:04,168][123091] Updated weights for policy 0, policy_version 661343 (0.0009) [2023-12-26 04:52:04,235][123091] Updated weights for policy 0, policy_version 661354 (0.0009) [2023-12-26 04:52:04,659][123090] Updated weights for policy 1, policy_version 656801 (0.0009) [2023-12-26 04:52:04,726][123090] Updated weights for policy 1, policy_version 656811 (0.0010) [2023-12-26 04:52:04,795][123090] Updated weights for policy 1, policy_version 656821 (0.0010) [2023-12-26 04:52:04,847][123090] Updated weights for policy 1, policy_version 656831 (0.0010) [2023-12-26 04:52:04,988][123091] Updated weights for policy 0, policy_version 661364 (0.0008) [2023-12-26 04:52:05,055][123091] Updated weights for policy 0, policy_version 661374 (0.0011) [2023-12-26 04:52:05,114][123091] Updated weights for policy 0, policy_version 661384 (0.0011) [2023-12-26 04:52:05,550][123090] Updated weights for policy 1, policy_version 656841 (0.0010) [2023-12-26 04:52:05,607][123090] Updated weights for policy 1, policy_version 656851 (0.0005) [2023-12-26 04:52:05,672][123090] Updated weights for policy 1, policy_version 656861 (0.0008) [2023-12-26 04:52:05,908][123091] Updated weights for policy 0, policy_version 661394 (0.0009) [2023-12-26 04:52:05,961][123091] Updated weights for policy 0, policy_version 661404 (0.0005) [2023-12-26 04:52:06,014][123091] Updated weights for policy 0, policy_version 661414 (0.0005) [2023-12-26 04:52:06,072][123091] Updated weights for policy 0, policy_version 661424 (0.0005) [2023-12-26 04:52:06,480][123090] Updated weights for policy 1, policy_version 656871 (0.0010) [2023-12-26 04:52:06,540][123090] Updated weights for policy 1, policy_version 656881 (0.0010) [2023-12-26 04:52:06,597][123090] Updated weights for policy 1, policy_version 656891 (0.0009) [2023-12-26 04:52:06,777][123091] Updated weights for policy 0, policy_version 661434 (0.0011) [2023-12-26 04:52:06,824][123091] Updated weights for policy 0, policy_version 661444 (0.0010) [2023-12-26 04:52:06,874][123091] Updated weights for policy 0, policy_version 661454 (0.0010) [2023-12-26 04:52:07,518][123090] Updated weights for policy 1, policy_version 656901 (0.0009) [2023-12-26 04:52:07,576][123090] Updated weights for policy 1, policy_version 656911 (0.0008) [2023-12-26 04:52:07,587][123091] Updated weights for policy 0, policy_version 661464 (0.0007) [2023-12-26 04:52:07,638][123090] Updated weights for policy 1, policy_version 656921 (0.0009) [2023-12-26 04:52:07,650][123091] Updated weights for policy 0, policy_version 661474 (0.0005) [2023-12-26 04:52:07,703][123091] Updated weights for policy 0, policy_version 661484 (0.0005) [2023-12-26 04:52:08,426][123091] Updated weights for policy 0, policy_version 661494 (0.0007) [2023-12-26 04:52:08,502][123091] Updated weights for policy 0, policy_version 661504 (0.0005) [2023-12-26 04:52:08,527][123090] Updated weights for policy 1, policy_version 656931 (0.0009) [2023-12-26 04:52:08,562][123091] Updated weights for policy 0, policy_version 661514 (0.0006) [2023-12-26 04:52:08,589][123090] Updated weights for policy 1, policy_version 656941 (0.0009) [2023-12-26 04:52:08,654][123090] Updated weights for policy 1, policy_version 656951 (0.0009) [2023-12-26 04:52:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 337534976. Throughput: 0: 8990.1, 1: 8905.9. Samples: 337504868. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:08,785][121949] Avg episode reward: [(0, '6112.166'), (1, '4537.392')] [2023-12-26 04:52:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000656960_168181760.pth... [2023-12-26 04:52:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000661520_169353216.pth... [2023-12-26 04:52:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000655936_167919616.pth [2023-12-26 04:52:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000660464_169082880.pth [2023-12-26 04:52:09,337][123091] Updated weights for policy 0, policy_version 661524 (0.0009) [2023-12-26 04:52:09,406][123091] Updated weights for policy 0, policy_version 661534 (0.0009) [2023-12-26 04:52:09,480][123091] Updated weights for policy 0, policy_version 661544 (0.0007) [2023-12-26 04:52:09,522][123090] Updated weights for policy 1, policy_version 656961 (0.0009) [2023-12-26 04:52:09,594][123090] Updated weights for policy 1, policy_version 656971 (0.0009) [2023-12-26 04:52:09,649][123090] Updated weights for policy 1, policy_version 656981 (0.0010) [2023-12-26 04:52:09,716][123090] Updated weights for policy 1, policy_version 656991 (0.0009) [2023-12-26 04:52:10,278][123091] Updated weights for policy 0, policy_version 661554 (0.0009) [2023-12-26 04:52:10,336][123091] Updated weights for policy 0, policy_version 661564 (0.0010) [2023-12-26 04:52:10,401][123091] Updated weights for policy 0, policy_version 661574 (0.0010) [2023-12-26 04:52:10,456][123091] Updated weights for policy 0, policy_version 661584 (0.0010) [2023-12-26 04:52:10,581][123090] Updated weights for policy 1, policy_version 657001 (0.0009) [2023-12-26 04:52:10,641][123090] Updated weights for policy 1, policy_version 657011 (0.0009) [2023-12-26 04:52:10,706][123090] Updated weights for policy 1, policy_version 657021 (0.0008) [2023-12-26 04:52:11,302][123091] Updated weights for policy 0, policy_version 661594 (0.0008) [2023-12-26 04:52:11,366][123091] Updated weights for policy 0, policy_version 661604 (0.0009) [2023-12-26 04:52:11,437][123091] Updated weights for policy 0, policy_version 661614 (0.0010) [2023-12-26 04:52:11,539][123090] Updated weights for policy 1, policy_version 657031 (0.0010) [2023-12-26 04:52:11,596][123090] Updated weights for policy 1, policy_version 657041 (0.0010) [2023-12-26 04:52:11,664][123090] Updated weights for policy 1, policy_version 657051 (0.0009) [2023-12-26 04:52:12,329][123091] Updated weights for policy 0, policy_version 661624 (0.0009) [2023-12-26 04:52:12,411][123091] Updated weights for policy 0, policy_version 661634 (0.0010) [2023-12-26 04:52:12,471][123091] Updated weights for policy 0, policy_version 661644 (0.0009) [2023-12-26 04:52:12,504][123090] Updated weights for policy 1, policy_version 657061 (0.0009) [2023-12-26 04:52:12,571][123090] Updated weights for policy 1, policy_version 657071 (0.0008) [2023-12-26 04:52:12,635][123090] Updated weights for policy 1, policy_version 657081 (0.0008) [2023-12-26 04:52:13,251][123091] Updated weights for policy 0, policy_version 661654 (0.0009) [2023-12-26 04:52:13,302][123091] Updated weights for policy 0, policy_version 661664 (0.0009) [2023-12-26 04:52:13,353][123091] Updated weights for policy 0, policy_version 661674 (0.0009) [2023-12-26 04:52:13,409][123090] Updated weights for policy 1, policy_version 657091 (0.0009) [2023-12-26 04:52:13,472][123090] Updated weights for policy 1, policy_version 657101 (0.0008) [2023-12-26 04:52:13,537][123090] Updated weights for policy 1, policy_version 657111 (0.0009) [2023-12-26 04:52:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 337616896. Throughput: 0: 8927.4, 1: 8785.3. Samples: 337606504. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:13,785][121949] Avg episode reward: [(0, '6128.198'), (1, '4759.041')] [2023-12-26 04:52:14,146][123091] Updated weights for policy 0, policy_version 661684 (0.0009) [2023-12-26 04:52:14,209][123091] Updated weights for policy 0, policy_version 661694 (0.0010) [2023-12-26 04:52:14,260][123091] Updated weights for policy 0, policy_version 661704 (0.0007) [2023-12-26 04:52:14,384][123090] Updated weights for policy 1, policy_version 657121 (0.0009) [2023-12-26 04:52:14,447][123090] Updated weights for policy 1, policy_version 657131 (0.0008) [2023-12-26 04:52:14,497][123090] Updated weights for policy 1, policy_version 657141 (0.0007) [2023-12-26 04:52:14,559][123090] Updated weights for policy 1, policy_version 657151 (0.0005) [2023-12-26 04:52:15,086][123091] Updated weights for policy 0, policy_version 661714 (0.0009) [2023-12-26 04:52:15,151][123091] Updated weights for policy 0, policy_version 661724 (0.0011) [2023-12-26 04:52:15,219][123091] Updated weights for policy 0, policy_version 661734 (0.0011) [2023-12-26 04:52:15,284][123091] Updated weights for policy 0, policy_version 661744 (0.0011) [2023-12-26 04:52:15,390][123090] Updated weights for policy 1, policy_version 657161 (0.0009) [2023-12-26 04:52:15,447][123090] Updated weights for policy 1, policy_version 657171 (0.0009) [2023-12-26 04:52:15,501][123090] Updated weights for policy 1, policy_version 657181 (0.0010) [2023-12-26 04:52:16,059][123091] Updated weights for policy 0, policy_version 661754 (0.0011) [2023-12-26 04:52:16,121][123091] Updated weights for policy 0, policy_version 661764 (0.0010) [2023-12-26 04:52:16,172][123091] Updated weights for policy 0, policy_version 661774 (0.0010) [2023-12-26 04:52:16,370][123090] Updated weights for policy 1, policy_version 657191 (0.0009) [2023-12-26 04:52:16,433][123090] Updated weights for policy 1, policy_version 657201 (0.0009) [2023-12-26 04:52:16,492][123090] Updated weights for policy 1, policy_version 657211 (0.0009) [2023-12-26 04:52:16,960][123091] Updated weights for policy 0, policy_version 661784 (0.0006) [2023-12-26 04:52:17,020][123091] Updated weights for policy 0, policy_version 661794 (0.0007) [2023-12-26 04:52:17,067][123091] Updated weights for policy 0, policy_version 661804 (0.0010) [2023-12-26 04:52:17,268][123090] Updated weights for policy 1, policy_version 657221 (0.0010) [2023-12-26 04:52:17,320][123090] Updated weights for policy 1, policy_version 657231 (0.0009) [2023-12-26 04:52:17,377][123090] Updated weights for policy 1, policy_version 657241 (0.0008) [2023-12-26 04:52:17,823][123091] Updated weights for policy 0, policy_version 661814 (0.0009) [2023-12-26 04:52:17,883][123091] Updated weights for policy 0, policy_version 661824 (0.0011) [2023-12-26 04:52:17,938][123091] Updated weights for policy 0, policy_version 661834 (0.0011) [2023-12-26 04:52:18,139][123090] Updated weights for policy 1, policy_version 657251 (0.0006) [2023-12-26 04:52:18,202][123090] Updated weights for policy 1, policy_version 657261 (0.0007) [2023-12-26 04:52:18,268][123090] Updated weights for policy 1, policy_version 657271 (0.0007) [2023-12-26 04:52:18,740][123091] Updated weights for policy 0, policy_version 661844 (0.0008) [2023-12-26 04:52:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 337698816. Throughput: 0: 8927.6, 1: 8661.5. Samples: 337713160. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:18,785][121949] Avg episode reward: [(0, '6039.174'), (1, '4810.041')] [2023-12-26 04:52:18,806][123091] Updated weights for policy 0, policy_version 661854 (0.0010) [2023-12-26 04:52:18,871][123091] Updated weights for policy 0, policy_version 661864 (0.0009) [2023-12-26 04:52:19,143][123090] Updated weights for policy 1, policy_version 657281 (0.0007) [2023-12-26 04:52:19,208][123090] Updated weights for policy 1, policy_version 657291 (0.0009) [2023-12-26 04:52:19,280][123090] Updated weights for policy 1, policy_version 657301 (0.0007) [2023-12-26 04:52:19,349][123090] Updated weights for policy 1, policy_version 657311 (0.0008) [2023-12-26 04:52:19,661][123091] Updated weights for policy 0, policy_version 661874 (0.0011) [2023-12-26 04:52:19,727][123091] Updated weights for policy 0, policy_version 661884 (0.0011) [2023-12-26 04:52:19,797][123091] Updated weights for policy 0, policy_version 661894 (0.0011) [2023-12-26 04:52:19,862][123091] Updated weights for policy 0, policy_version 661904 (0.0011) [2023-12-26 04:52:20,183][123090] Updated weights for policy 1, policy_version 657321 (0.0009) [2023-12-26 04:52:20,236][123090] Updated weights for policy 1, policy_version 657331 (0.0009) [2023-12-26 04:52:20,298][123090] Updated weights for policy 1, policy_version 657341 (0.0009) [2023-12-26 04:52:20,725][123091] Updated weights for policy 0, policy_version 661914 (0.0010) [2023-12-26 04:52:20,791][123091] Updated weights for policy 0, policy_version 661924 (0.0010) [2023-12-26 04:52:20,859][123091] Updated weights for policy 0, policy_version 661934 (0.0010) [2023-12-26 04:52:21,192][123090] Updated weights for policy 1, policy_version 657351 (0.0009) [2023-12-26 04:52:21,260][123090] Updated weights for policy 1, policy_version 657361 (0.0009) [2023-12-26 04:52:21,321][123090] Updated weights for policy 1, policy_version 657371 (0.0010) [2023-12-26 04:52:21,718][123091] Updated weights for policy 0, policy_version 661944 (0.0009) [2023-12-26 04:52:21,779][123091] Updated weights for policy 0, policy_version 661954 (0.0009) [2023-12-26 04:52:21,834][123091] Updated weights for policy 0, policy_version 661964 (0.0010) [2023-12-26 04:52:22,126][123090] Updated weights for policy 1, policy_version 657381 (0.0009) [2023-12-26 04:52:22,191][123090] Updated weights for policy 1, policy_version 657391 (0.0011) [2023-12-26 04:52:22,259][123090] Updated weights for policy 1, policy_version 657401 (0.0011) [2023-12-26 04:52:22,644][123091] Updated weights for policy 0, policy_version 661974 (0.0008) [2023-12-26 04:52:22,700][123091] Updated weights for policy 0, policy_version 661984 (0.0006) [2023-12-26 04:52:22,763][123091] Updated weights for policy 0, policy_version 661994 (0.0006) [2023-12-26 04:52:22,988][123090] Updated weights for policy 1, policy_version 657411 (0.0009) [2023-12-26 04:52:23,055][123090] Updated weights for policy 1, policy_version 657421 (0.0008) [2023-12-26 04:52:23,112][123090] Updated weights for policy 1, policy_version 657431 (0.0006) [2023-12-26 04:52:23,453][123091] Updated weights for policy 0, policy_version 662004 (0.0006) [2023-12-26 04:52:23,511][123091] Updated weights for policy 0, policy_version 662014 (0.0006) [2023-12-26 04:52:23,564][123091] Updated weights for policy 0, policy_version 662024 (0.0006) [2023-12-26 04:52:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 337788928. Throughput: 0: 8898.6, 1: 8593.7. Samples: 337762868. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:23,785][121949] Avg episode reward: [(0, '6019.410'), (1, '4529.355')] [2023-12-26 04:52:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000662032_169484288.pth... [2023-12-26 04:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000657440_168304640.pth... [2023-12-26 04:52:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000660976_169213952.pth [2023-12-26 04:52:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000656448_168050688.pth [2023-12-26 04:52:23,897][123090] Updated weights for policy 1, policy_version 657441 (0.0005) [2023-12-26 04:52:23,959][123090] Updated weights for policy 1, policy_version 657451 (0.0006) [2023-12-26 04:52:24,025][123090] Updated weights for policy 1, policy_version 657461 (0.0005) [2023-12-26 04:52:24,102][123090] Updated weights for policy 1, policy_version 657471 (0.0005) [2023-12-26 04:52:24,282][123091] Updated weights for policy 0, policy_version 662034 (0.0006) [2023-12-26 04:52:24,341][123091] Updated weights for policy 0, policy_version 662044 (0.0010) [2023-12-26 04:52:24,403][123091] Updated weights for policy 0, policy_version 662054 (0.0011) [2023-12-26 04:52:24,461][123091] Updated weights for policy 0, policy_version 662064 (0.0006) [2023-12-26 04:52:24,692][123090] Updated weights for policy 1, policy_version 657481 (0.0006) [2023-12-26 04:52:24,746][123090] Updated weights for policy 1, policy_version 657491 (0.0009) [2023-12-26 04:52:24,802][123090] Updated weights for policy 1, policy_version 657501 (0.0009) [2023-12-26 04:52:25,235][123091] Updated weights for policy 0, policy_version 662074 (0.0007) [2023-12-26 04:52:25,304][123091] Updated weights for policy 0, policy_version 662084 (0.0007) [2023-12-26 04:52:25,367][123091] Updated weights for policy 0, policy_version 662094 (0.0011) [2023-12-26 04:52:25,589][123090] Updated weights for policy 1, policy_version 657511 (0.0009) [2023-12-26 04:52:25,650][123090] Updated weights for policy 1, policy_version 657521 (0.0009) [2023-12-26 04:52:25,712][123090] Updated weights for policy 1, policy_version 657531 (0.0009) [2023-12-26 04:52:26,056][123091] Updated weights for policy 0, policy_version 662104 (0.0007) [2023-12-26 04:52:26,120][123091] Updated weights for policy 0, policy_version 662114 (0.0006) [2023-12-26 04:52:26,186][123091] Updated weights for policy 0, policy_version 662124 (0.0005) [2023-12-26 04:52:26,527][123090] Updated weights for policy 1, policy_version 657541 (0.0007) [2023-12-26 04:52:26,603][123090] Updated weights for policy 1, policy_version 657551 (0.0005) [2023-12-26 04:52:26,667][123090] Updated weights for policy 1, policy_version 657561 (0.0006) [2023-12-26 04:52:26,801][123091] Updated weights for policy 0, policy_version 662134 (0.0006) [2023-12-26 04:52:26,848][123091] Updated weights for policy 0, policy_version 662144 (0.0005) [2023-12-26 04:52:26,899][123091] Updated weights for policy 0, policy_version 662154 (0.0005) [2023-12-26 04:52:27,293][123090] Updated weights for policy 1, policy_version 657571 (0.0006) [2023-12-26 04:52:27,358][123090] Updated weights for policy 1, policy_version 657581 (0.0006) [2023-12-26 04:52:27,418][123090] Updated weights for policy 1, policy_version 657591 (0.0006) [2023-12-26 04:52:27,678][123091] Updated weights for policy 0, policy_version 662164 (0.0005) [2023-12-26 04:52:27,743][123091] Updated weights for policy 0, policy_version 662175 (0.0010) [2023-12-26 04:52:27,799][123091] Updated weights for policy 0, policy_version 662186 (0.0010) [2023-12-26 04:52:28,121][123090] Updated weights for policy 1, policy_version 657601 (0.0007) [2023-12-26 04:52:28,173][123090] Updated weights for policy 1, policy_version 657611 (0.0009) [2023-12-26 04:52:28,226][123090] Updated weights for policy 1, policy_version 657621 (0.0005) [2023-12-26 04:52:28,276][123090] Updated weights for policy 1, policy_version 657631 (0.0005) [2023-12-26 04:52:28,652][123091] Updated weights for policy 0, policy_version 662196 (0.0008) [2023-12-26 04:52:28,712][123091] Updated weights for policy 0, policy_version 662206 (0.0005) [2023-12-26 04:52:28,782][123091] Updated weights for policy 0, policy_version 662216 (0.0005) [2023-12-26 04:52:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 337879040. Throughput: 0: 9060.0, 1: 8709.5. Samples: 337877528. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:28,785][121949] Avg episode reward: [(0, '6097.143'), (1, '4323.444')] [2023-12-26 04:52:29,106][123090] Updated weights for policy 1, policy_version 657641 (0.0010) [2023-12-26 04:52:29,153][123090] Updated weights for policy 1, policy_version 657651 (0.0010) [2023-12-26 04:52:29,204][123090] Updated weights for policy 1, policy_version 657661 (0.0010) [2023-12-26 04:52:29,488][123091] Updated weights for policy 0, policy_version 662226 (0.0006) [2023-12-26 04:52:29,550][123091] Updated weights for policy 0, policy_version 662236 (0.0009) [2023-12-26 04:52:29,609][123091] Updated weights for policy 0, policy_version 662246 (0.0009) [2023-12-26 04:52:29,671][123091] Updated weights for policy 0, policy_version 662256 (0.0009) [2023-12-26 04:52:30,056][123090] Updated weights for policy 1, policy_version 657671 (0.0011) [2023-12-26 04:52:30,118][123090] Updated weights for policy 1, policy_version 657681 (0.0010) [2023-12-26 04:52:30,189][123090] Updated weights for policy 1, policy_version 657691 (0.0010) [2023-12-26 04:52:30,480][123091] Updated weights for policy 0, policy_version 662266 (0.0009) [2023-12-26 04:52:30,542][123091] Updated weights for policy 0, policy_version 662276 (0.0008) [2023-12-26 04:52:30,605][123091] Updated weights for policy 0, policy_version 662286 (0.0009) [2023-12-26 04:52:31,012][123090] Updated weights for policy 1, policy_version 657701 (0.0010) [2023-12-26 04:52:31,077][123090] Updated weights for policy 1, policy_version 657711 (0.0010) [2023-12-26 04:52:31,137][123090] Updated weights for policy 1, policy_version 657721 (0.0009) [2023-12-26 04:52:31,377][123091] Updated weights for policy 0, policy_version 662296 (0.0009) [2023-12-26 04:52:31,444][123091] Updated weights for policy 0, policy_version 662306 (0.0010) [2023-12-26 04:52:31,511][123091] Updated weights for policy 0, policy_version 662316 (0.0009) [2023-12-26 04:52:31,978][123090] Updated weights for policy 1, policy_version 657731 (0.0007) [2023-12-26 04:52:32,052][123090] Updated weights for policy 1, policy_version 657741 (0.0008) [2023-12-26 04:52:32,121][123090] Updated weights for policy 1, policy_version 657751 (0.0008) [2023-12-26 04:52:32,327][123091] Updated weights for policy 0, policy_version 662326 (0.0010) [2023-12-26 04:52:32,396][123091] Updated weights for policy 0, policy_version 662336 (0.0009) [2023-12-26 04:52:32,459][123091] Updated weights for policy 0, policy_version 662346 (0.0010) [2023-12-26 04:52:32,799][123090] Updated weights for policy 1, policy_version 657761 (0.0008) [2023-12-26 04:52:32,860][123090] Updated weights for policy 1, policy_version 657771 (0.0005) [2023-12-26 04:52:32,921][123090] Updated weights for policy 1, policy_version 657781 (0.0005) [2023-12-26 04:52:32,990][123090] Updated weights for policy 1, policy_version 657791 (0.0005) [2023-12-26 04:52:33,211][123091] Updated weights for policy 0, policy_version 662356 (0.0008) [2023-12-26 04:52:33,265][123091] Updated weights for policy 0, policy_version 662366 (0.0005) [2023-12-26 04:52:33,321][123091] Updated weights for policy 0, policy_version 662376 (0.0005) [2023-12-26 04:52:33,511][123090] Updated weights for policy 1, policy_version 657801 (0.0005) [2023-12-26 04:52:33,573][123090] Updated weights for policy 1, policy_version 657811 (0.0006) [2023-12-26 04:52:33,639][123090] Updated weights for policy 1, policy_version 657821 (0.0009) [2023-12-26 04:52:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 337977344. Throughput: 0: 8930.2, 1: 8755.2. Samples: 337985448. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:33,784][121949] Avg episode reward: [(0, '6050.378'), (1, '4628.850')] [2023-12-26 04:52:34,083][123091] Updated weights for policy 0, policy_version 662386 (0.0006) [2023-12-26 04:52:34,134][123091] Updated weights for policy 0, policy_version 662396 (0.0006) [2023-12-26 04:52:34,205][123091] Updated weights for policy 0, policy_version 662407 (0.0009) [2023-12-26 04:52:34,401][123090] Updated weights for policy 1, policy_version 657831 (0.0011) [2023-12-26 04:52:34,461][123090] Updated weights for policy 1, policy_version 657841 (0.0010) [2023-12-26 04:52:34,522][123090] Updated weights for policy 1, policy_version 657851 (0.0009) [2023-12-26 04:52:34,931][123091] Updated weights for policy 0, policy_version 662417 (0.0006) [2023-12-26 04:52:34,992][123091] Updated weights for policy 0, policy_version 662427 (0.0010) [2023-12-26 04:52:35,057][123091] Updated weights for policy 0, policy_version 662437 (0.0010) [2023-12-26 04:52:35,126][123091] Updated weights for policy 0, policy_version 662447 (0.0011) [2023-12-26 04:52:35,361][123090] Updated weights for policy 1, policy_version 657861 (0.0010) [2023-12-26 04:52:35,408][123090] Updated weights for policy 1, policy_version 657871 (0.0008) [2023-12-26 04:52:35,459][123090] Updated weights for policy 1, policy_version 657881 (0.0009) [2023-12-26 04:52:35,877][123091] Updated weights for policy 0, policy_version 662457 (0.0006) [2023-12-26 04:52:35,922][123091] Updated weights for policy 0, policy_version 662467 (0.0005) [2023-12-26 04:52:35,980][123091] Updated weights for policy 0, policy_version 662477 (0.0005) [2023-12-26 04:52:36,278][123090] Updated weights for policy 1, policy_version 657891 (0.0009) [2023-12-26 04:52:36,342][123090] Updated weights for policy 1, policy_version 657901 (0.0007) [2023-12-26 04:52:36,424][123090] Updated weights for policy 1, policy_version 657911 (0.0006) [2023-12-26 04:52:36,716][123091] Updated weights for policy 0, policy_version 662487 (0.0009) [2023-12-26 04:52:36,778][123091] Updated weights for policy 0, policy_version 662497 (0.0010) [2023-12-26 04:52:36,837][123091] Updated weights for policy 0, policy_version 662507 (0.0011) [2023-12-26 04:52:37,145][123090] Updated weights for policy 1, policy_version 657921 (0.0006) [2023-12-26 04:52:37,212][123090] Updated weights for policy 1, policy_version 657931 (0.0009) [2023-12-26 04:52:37,276][123090] Updated weights for policy 1, policy_version 657941 (0.0008) [2023-12-26 04:52:37,344][123090] Updated weights for policy 1, policy_version 657951 (0.0009) [2023-12-26 04:52:37,663][123091] Updated weights for policy 0, policy_version 662517 (0.0008) [2023-12-26 04:52:37,718][123091] Updated weights for policy 0, policy_version 662527 (0.0006) [2023-12-26 04:52:37,767][123091] Updated weights for policy 0, policy_version 662537 (0.0008) [2023-12-26 04:52:38,112][123090] Updated weights for policy 1, policy_version 657961 (0.0006) [2023-12-26 04:52:38,173][123090] Updated weights for policy 1, policy_version 657971 (0.0005) [2023-12-26 04:52:38,247][123090] Updated weights for policy 1, policy_version 657981 (0.0005) [2023-12-26 04:52:38,532][123091] Updated weights for policy 0, policy_version 662547 (0.0007) [2023-12-26 04:52:38,600][123091] Updated weights for policy 0, policy_version 662557 (0.0005) [2023-12-26 04:52:38,663][123091] Updated weights for policy 0, policy_version 662567 (0.0006) [2023-12-26 04:52:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 338067456. Throughput: 0: 9006.9, 1: 8789.9. Samples: 338040800. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:38,785][121949] Avg episode reward: [(0, '6060.763'), (1, '4847.958')] [2023-12-26 04:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000662576_169623552.pth... [2023-12-26 04:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000657984_168443904.pth... [2023-12-26 04:52:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000661520_169353216.pth [2023-12-26 04:52:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000656960_168181760.pth [2023-12-26 04:52:39,028][123090] Updated weights for policy 1, policy_version 657991 (0.0007) [2023-12-26 04:52:39,098][123090] Updated weights for policy 1, policy_version 658001 (0.0008) [2023-12-26 04:52:39,169][123090] Updated weights for policy 1, policy_version 658011 (0.0006) [2023-12-26 04:52:39,304][123091] Updated weights for policy 0, policy_version 662577 (0.0008) [2023-12-26 04:52:39,372][123091] Updated weights for policy 0, policy_version 662587 (0.0008) [2023-12-26 04:52:39,443][123091] Updated weights for policy 0, policy_version 662597 (0.0008) [2023-12-26 04:52:39,512][123091] Updated weights for policy 0, policy_version 662607 (0.0006) [2023-12-26 04:52:39,929][123090] Updated weights for policy 1, policy_version 658021 (0.0008) [2023-12-26 04:52:40,001][123090] Updated weights for policy 1, policy_version 658031 (0.0008) [2023-12-26 04:52:40,071][123090] Updated weights for policy 1, policy_version 658041 (0.0007) [2023-12-26 04:52:40,289][123091] Updated weights for policy 0, policy_version 662617 (0.0007) [2023-12-26 04:52:40,362][123091] Updated weights for policy 0, policy_version 662627 (0.0007) [2023-12-26 04:52:40,429][123091] Updated weights for policy 0, policy_version 662637 (0.0006) [2023-12-26 04:52:40,763][123090] Updated weights for policy 1, policy_version 658051 (0.0009) [2023-12-26 04:52:40,840][123090] Updated weights for policy 1, policy_version 658061 (0.0006) [2023-12-26 04:52:40,915][123090] Updated weights for policy 1, policy_version 658071 (0.0006) [2023-12-26 04:52:41,221][123091] Updated weights for policy 0, policy_version 662647 (0.0006) [2023-12-26 04:52:41,287][123091] Updated weights for policy 0, policy_version 662657 (0.0008) [2023-12-26 04:52:41,349][123091] Updated weights for policy 0, policy_version 662667 (0.0007) [2023-12-26 04:52:41,744][123090] Updated weights for policy 1, policy_version 658081 (0.0009) [2023-12-26 04:52:41,816][123090] Updated weights for policy 1, policy_version 658091 (0.0011) [2023-12-26 04:52:41,882][123090] Updated weights for policy 1, policy_version 658101 (0.0011) [2023-12-26 04:52:41,954][123090] Updated weights for policy 1, policy_version 658111 (0.0006) [2023-12-26 04:52:42,122][123091] Updated weights for policy 0, policy_version 662677 (0.0010) [2023-12-26 04:52:42,184][123091] Updated weights for policy 0, policy_version 662687 (0.0010) [2023-12-26 04:52:42,250][123091] Updated weights for policy 0, policy_version 662697 (0.0009) [2023-12-26 04:52:42,775][123090] Updated weights for policy 1, policy_version 658122 (0.0008) [2023-12-26 04:52:42,829][123090] Updated weights for policy 1, policy_version 658132 (0.0009) [2023-12-26 04:52:42,900][123090] Updated weights for policy 1, policy_version 658142 (0.0010) [2023-12-26 04:52:43,075][123091] Updated weights for policy 0, policy_version 662707 (0.0010) [2023-12-26 04:52:43,136][123091] Updated weights for policy 0, policy_version 662717 (0.0009) [2023-12-26 04:52:43,193][123091] Updated weights for policy 0, policy_version 662727 (0.0009) [2023-12-26 04:52:43,755][123090] Updated weights for policy 1, policy_version 658152 (0.0009) [2023-12-26 04:52:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 338149376. Throughput: 0: 9002.2, 1: 8797.9. Samples: 338146952. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 04:52:43,785][121949] Avg episode reward: [(0, '6094.002'), (1, '4846.275')] [2023-12-26 04:52:43,804][123090] Updated weights for policy 1, policy_version 658162 (0.0008) [2023-12-26 04:52:43,859][123090] Updated weights for policy 1, policy_version 658172 (0.0005) [2023-12-26 04:52:43,908][123091] Updated weights for policy 0, policy_version 662737 (0.0008) [2023-12-26 04:52:43,955][123091] Updated weights for policy 0, policy_version 662747 (0.0005) [2023-12-26 04:52:44,007][123091] Updated weights for policy 0, policy_version 662757 (0.0005) [2023-12-26 04:52:44,058][123091] Updated weights for policy 0, policy_version 662767 (0.0005) [2023-12-26 04:52:44,663][123090] Updated weights for policy 1, policy_version 658182 (0.0008) [2023-12-26 04:52:44,713][123090] Updated weights for policy 1, policy_version 658192 (0.0009) [2023-12-26 04:52:44,733][123091] Updated weights for policy 0, policy_version 662777 (0.0006) [2023-12-26 04:52:44,772][123090] Updated weights for policy 1, policy_version 658202 (0.0009) [2023-12-26 04:52:44,805][123091] Updated weights for policy 0, policy_version 662787 (0.0008) [2023-12-26 04:52:44,872][123091] Updated weights for policy 0, policy_version 662797 (0.0011) [2023-12-26 04:52:45,601][123090] Updated weights for policy 1, policy_version 658212 (0.0007) [2023-12-26 04:52:45,663][123090] Updated weights for policy 1, policy_version 658222 (0.0006) [2023-12-26 04:52:45,671][123091] Updated weights for policy 0, policy_version 662807 (0.0010) [2023-12-26 04:52:45,721][123090] Updated weights for policy 1, policy_version 658232 (0.0006) [2023-12-26 04:52:45,732][123091] Updated weights for policy 0, policy_version 662817 (0.0009) [2023-12-26 04:52:45,787][123091] Updated weights for policy 0, policy_version 662827 (0.0009) [2023-12-26 04:52:46,447][123090] Updated weights for policy 1, policy_version 658242 (0.0007) [2023-12-26 04:52:46,519][123090] Updated weights for policy 1, policy_version 658252 (0.0011) [2023-12-26 04:52:46,582][123090] Updated weights for policy 1, policy_version 658262 (0.0011) [2023-12-26 04:52:46,633][123091] Updated weights for policy 0, policy_version 662837 (0.0008) [2023-12-26 04:52:46,649][123090] Updated weights for policy 1, policy_version 658272 (0.0009) [2023-12-26 04:52:46,684][123091] Updated weights for policy 0, policy_version 662847 (0.0009) [2023-12-26 04:52:46,742][123091] Updated weights for policy 0, policy_version 662857 (0.0008) [2023-12-26 04:52:47,436][123090] Updated weights for policy 1, policy_version 658282 (0.0010) [2023-12-26 04:52:47,490][123090] Updated weights for policy 1, policy_version 658292 (0.0010) [2023-12-26 04:52:47,545][123090] Updated weights for policy 1, policy_version 658302 (0.0010) [2023-12-26 04:52:47,587][123091] Updated weights for policy 0, policy_version 662867 (0.0009) [2023-12-26 04:52:47,647][123091] Updated weights for policy 0, policy_version 662877 (0.0009) [2023-12-26 04:52:47,695][123091] Updated weights for policy 0, policy_version 662887 (0.0009) [2023-12-26 04:52:48,393][123090] Updated weights for policy 1, policy_version 658312 (0.0010) [2023-12-26 04:52:48,456][123090] Updated weights for policy 1, policy_version 658322 (0.0011) [2023-12-26 04:52:48,514][123090] Updated weights for policy 1, policy_version 658332 (0.0010) [2023-12-26 04:52:48,541][123091] Updated weights for policy 0, policy_version 662897 (0.0009) [2023-12-26 04:52:48,599][123091] Updated weights for policy 0, policy_version 662907 (0.0005) [2023-12-26 04:52:48,672][123091] Updated weights for policy 0, policy_version 662917 (0.0005) [2023-12-26 04:52:48,751][123091] Updated weights for policy 0, policy_version 662927 (0.0006) [2023-12-26 04:52:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 338247680. Throughput: 0: 9035.3, 1: 8808.2. Samples: 338253168. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:52:48,785][121949] Avg episode reward: [(0, '6149.641'), (1, '4800.970')] [2023-12-26 04:52:49,353][123090] Updated weights for policy 1, policy_version 658342 (0.0011) [2023-12-26 04:52:49,427][123090] Updated weights for policy 1, policy_version 658352 (0.0009) [2023-12-26 04:52:49,452][123091] Updated weights for policy 0, policy_version 662937 (0.0008) [2023-12-26 04:52:49,488][123090] Updated weights for policy 1, policy_version 658362 (0.0011) [2023-12-26 04:52:49,521][123091] Updated weights for policy 0, policy_version 662947 (0.0009) [2023-12-26 04:52:49,589][123091] Updated weights for policy 0, policy_version 662957 (0.0008) [2023-12-26 04:52:50,247][123090] Updated weights for policy 1, policy_version 658372 (0.0009) [2023-12-26 04:52:50,316][123090] Updated weights for policy 1, policy_version 658382 (0.0005) [2023-12-26 04:52:50,387][123090] Updated weights for policy 1, policy_version 658392 (0.0007) [2023-12-26 04:52:50,421][123091] Updated weights for policy 0, policy_version 662967 (0.0008) [2023-12-26 04:52:50,482][123091] Updated weights for policy 0, policy_version 662977 (0.0008) [2023-12-26 04:52:50,544][123091] Updated weights for policy 0, policy_version 662987 (0.0009) [2023-12-26 04:52:51,083][123090] Updated weights for policy 1, policy_version 658402 (0.0010) [2023-12-26 04:52:51,139][123090] Updated weights for policy 1, policy_version 658412 (0.0008) [2023-12-26 04:52:51,205][123090] Updated weights for policy 1, policy_version 658422 (0.0008) [2023-12-26 04:52:51,268][123090] Updated weights for policy 1, policy_version 658432 (0.0008) [2023-12-26 04:52:51,476][123091] Updated weights for policy 0, policy_version 662997 (0.0010) [2023-12-26 04:52:51,527][123091] Updated weights for policy 0, policy_version 663007 (0.0009) [2023-12-26 04:52:51,576][123091] Updated weights for policy 0, policy_version 663017 (0.0009) [2023-12-26 04:52:52,094][123090] Updated weights for policy 1, policy_version 658442 (0.0005) [2023-12-26 04:52:52,158][123090] Updated weights for policy 1, policy_version 658452 (0.0008) [2023-12-26 04:52:52,219][123090] Updated weights for policy 1, policy_version 658462 (0.0007) [2023-12-26 04:52:52,498][123091] Updated weights for policy 0, policy_version 663027 (0.0010) [2023-12-26 04:52:52,561][123091] Updated weights for policy 0, policy_version 663037 (0.0009) [2023-12-26 04:52:52,630][123091] Updated weights for policy 0, policy_version 663047 (0.0010) [2023-12-26 04:52:52,959][123090] Updated weights for policy 1, policy_version 658472 (0.0010) [2023-12-26 04:52:53,025][123090] Updated weights for policy 1, policy_version 658482 (0.0010) [2023-12-26 04:52:53,101][123090] Updated weights for policy 1, policy_version 658492 (0.0010) [2023-12-26 04:52:53,452][123091] Updated weights for policy 0, policy_version 663057 (0.0009) [2023-12-26 04:52:53,500][123091] Updated weights for policy 0, policy_version 663067 (0.0009) [2023-12-26 04:52:53,551][123091] Updated weights for policy 0, policy_version 663077 (0.0009) [2023-12-26 04:52:53,607][123091] Updated weights for policy 0, policy_version 663087 (0.0009) [2023-12-26 04:52:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 338329600. Throughput: 0: 8954.5, 1: 8824.8. Samples: 338304940. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:52:53,785][121949] Avg episode reward: [(0, '6124.610'), (1, '4812.305')] [2023-12-26 04:52:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000663088_169754624.pth... [2023-12-26 04:52:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000658496_168574976.pth... [2023-12-26 04:52:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000657440_168304640.pth [2023-12-26 04:52:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000662032_169484288.pth [2023-12-26 04:52:53,897][123090] Updated weights for policy 1, policy_version 658502 (0.0007) [2023-12-26 04:52:53,973][123090] Updated weights for policy 1, policy_version 658512 (0.0005) [2023-12-26 04:52:54,047][123090] Updated weights for policy 1, policy_version 658522 (0.0005) [2023-12-26 04:52:54,514][123091] Updated weights for policy 0, policy_version 663097 (0.0009) [2023-12-26 04:52:54,579][123091] Updated weights for policy 0, policy_version 663107 (0.0010) [2023-12-26 04:52:54,637][123091] Updated weights for policy 0, policy_version 663117 (0.0009) [2023-12-26 04:52:54,669][123090] Updated weights for policy 1, policy_version 658532 (0.0006) [2023-12-26 04:52:54,743][123090] Updated weights for policy 1, policy_version 658542 (0.0008) [2023-12-26 04:52:54,800][123090] Updated weights for policy 1, policy_version 658552 (0.0009) [2023-12-26 04:52:55,497][123091] Updated weights for policy 0, policy_version 663127 (0.0010) [2023-12-26 04:52:55,549][123090] Updated weights for policy 1, policy_version 658562 (0.0009) [2023-12-26 04:52:55,556][123091] Updated weights for policy 0, policy_version 663137 (0.0009) [2023-12-26 04:52:55,599][123090] Updated weights for policy 1, policy_version 658572 (0.0005) [2023-12-26 04:52:55,621][123091] Updated weights for policy 0, policy_version 663147 (0.0008) [2023-12-26 04:52:55,647][123090] Updated weights for policy 1, policy_version 658582 (0.0005) [2023-12-26 04:52:55,697][123090] Updated weights for policy 1, policy_version 658592 (0.0005) [2023-12-26 04:52:56,412][123090] Updated weights for policy 1, policy_version 658603 (0.0007) [2023-12-26 04:52:56,469][123090] Updated weights for policy 1, policy_version 658613 (0.0009) [2023-12-26 04:52:56,511][123091] Updated weights for policy 0, policy_version 663157 (0.0009) [2023-12-26 04:52:56,522][123090] Updated weights for policy 1, policy_version 658623 (0.0005) [2023-12-26 04:52:56,565][123091] Updated weights for policy 0, policy_version 663167 (0.0009) [2023-12-26 04:52:56,620][123091] Updated weights for policy 0, policy_version 663177 (0.0010) [2023-12-26 04:52:57,253][123090] Updated weights for policy 1, policy_version 658633 (0.0008) [2023-12-26 04:52:57,307][123090] Updated weights for policy 1, policy_version 658643 (0.0008) [2023-12-26 04:52:57,361][123090] Updated weights for policy 1, policy_version 658653 (0.0009) [2023-12-26 04:52:57,507][123091] Updated weights for policy 0, policy_version 663187 (0.0009) [2023-12-26 04:52:57,560][123091] Updated weights for policy 0, policy_version 663197 (0.0009) [2023-12-26 04:52:57,614][123091] Updated weights for policy 0, policy_version 663208 (0.0010) [2023-12-26 04:52:58,039][123090] Updated weights for policy 1, policy_version 658663 (0.0008) [2023-12-26 04:52:58,109][123090] Updated weights for policy 1, policy_version 658673 (0.0007) [2023-12-26 04:52:58,174][123090] Updated weights for policy 1, policy_version 658683 (0.0008) [2023-12-26 04:52:58,582][123091] Updated weights for policy 0, policy_version 663218 (0.0010) [2023-12-26 04:52:58,659][123091] Updated weights for policy 0, policy_version 663228 (0.0010) [2023-12-26 04:52:58,731][123091] Updated weights for policy 0, policy_version 663238 (0.0010) [2023-12-26 04:52:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 338411520. Throughput: 0: 8878.2, 1: 8995.9. Samples: 338410840. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:52:58,785][121949] Avg episode reward: [(0, '6033.088'), (1, '4679.593')] [2023-12-26 04:52:58,807][123091] Updated weights for policy 0, policy_version 663248 (0.0010) [2023-12-26 04:52:58,934][123090] Updated weights for policy 1, policy_version 658693 (0.0007) [2023-12-26 04:52:59,000][123090] Updated weights for policy 1, policy_version 658703 (0.0005) [2023-12-26 04:52:59,049][123090] Updated weights for policy 1, policy_version 658713 (0.0005) [2023-12-26 04:52:59,634][123091] Updated weights for policy 0, policy_version 663258 (0.0009) [2023-12-26 04:52:59,686][123091] Updated weights for policy 0, policy_version 663268 (0.0006) [2023-12-26 04:52:59,745][123091] Updated weights for policy 0, policy_version 663278 (0.0006) [2023-12-26 04:52:59,761][123090] Updated weights for policy 1, policy_version 658723 (0.0006) [2023-12-26 04:52:59,814][123090] Updated weights for policy 1, policy_version 658733 (0.0009) [2023-12-26 04:52:59,881][123090] Updated weights for policy 1, policy_version 658743 (0.0010) [2023-12-26 04:53:00,552][123091] Updated weights for policy 0, policy_version 663288 (0.0010) [2023-12-26 04:53:00,605][123091] Updated weights for policy 0, policy_version 663300 (0.0010) [2023-12-26 04:53:00,662][123091] Updated weights for policy 0, policy_version 663310 (0.0008) [2023-12-26 04:53:00,763][123090] Updated weights for policy 1, policy_version 658753 (0.0009) [2023-12-26 04:53:00,818][123090] Updated weights for policy 1, policy_version 658763 (0.0005) [2023-12-26 04:53:00,865][123090] Updated weights for policy 1, policy_version 658773 (0.0005) [2023-12-26 04:53:00,919][123090] Updated weights for policy 1, policy_version 658783 (0.0006) [2023-12-26 04:53:01,530][123091] Updated weights for policy 0, policy_version 663320 (0.0009) [2023-12-26 04:53:01,590][123091] Updated weights for policy 0, policy_version 663330 (0.0010) [2023-12-26 04:53:01,655][123091] Updated weights for policy 0, policy_version 663340 (0.0010) [2023-12-26 04:53:01,691][123090] Updated weights for policy 1, policy_version 658793 (0.0006) [2023-12-26 04:53:01,753][123090] Updated weights for policy 1, policy_version 658803 (0.0007) [2023-12-26 04:53:01,807][123090] Updated weights for policy 1, policy_version 658813 (0.0006) [2023-12-26 04:53:02,518][123091] Updated weights for policy 0, policy_version 663350 (0.0009) [2023-12-26 04:53:02,526][123090] Updated weights for policy 1, policy_version 658823 (0.0005) [2023-12-26 04:53:02,591][123091] Updated weights for policy 0, policy_version 663360 (0.0008) [2023-12-26 04:53:02,592][123090] Updated weights for policy 1, policy_version 658833 (0.0005) [2023-12-26 04:53:02,646][123091] Updated weights for policy 0, policy_version 663370 (0.0008) [2023-12-26 04:53:02,656][123090] Updated weights for policy 1, policy_version 658843 (0.0007) [2023-12-26 04:53:03,365][123091] Updated weights for policy 0, policy_version 663380 (0.0007) [2023-12-26 04:53:03,433][123091] Updated weights for policy 0, policy_version 663390 (0.0005) [2023-12-26 04:53:03,469][123090] Updated weights for policy 1, policy_version 658853 (0.0009) [2023-12-26 04:53:03,485][123091] Updated weights for policy 0, policy_version 663400 (0.0007) [2023-12-26 04:53:03,534][123090] Updated weights for policy 1, policy_version 658863 (0.0010) [2023-12-26 04:53:03,601][123090] Updated weights for policy 1, policy_version 658873 (0.0010) [2023-12-26 04:53:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 338509824. Throughput: 0: 8800.5, 1: 9067.9. Samples: 338517240. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:03,785][121949] Avg episode reward: [(0, '6077.766'), (1, '4974.299')] [2023-12-26 04:53:04,158][123091] Updated weights for policy 0, policy_version 663410 (0.0007) [2023-12-26 04:53:04,219][123091] Updated weights for policy 0, policy_version 663420 (0.0005) [2023-12-26 04:53:04,285][123091] Updated weights for policy 0, policy_version 663430 (0.0010) [2023-12-26 04:53:04,310][123090] Updated weights for policy 1, policy_version 658883 (0.0009) [2023-12-26 04:53:04,352][123091] Updated weights for policy 0, policy_version 663440 (0.0010) [2023-12-26 04:53:04,377][123090] Updated weights for policy 1, policy_version 658893 (0.0008) [2023-12-26 04:53:04,444][123090] Updated weights for policy 1, policy_version 658903 (0.0011) [2023-12-26 04:53:05,056][123091] Updated weights for policy 0, policy_version 663450 (0.0006) [2023-12-26 04:53:05,112][123091] Updated weights for policy 0, policy_version 663460 (0.0005) [2023-12-26 04:53:05,149][123090] Updated weights for policy 1, policy_version 658913 (0.0010) [2023-12-26 04:53:05,169][123091] Updated weights for policy 0, policy_version 663470 (0.0005) [2023-12-26 04:53:05,199][123090] Updated weights for policy 1, policy_version 658923 (0.0005) [2023-12-26 04:53:05,256][123090] Updated weights for policy 1, policy_version 658933 (0.0006) [2023-12-26 04:53:05,313][123090] Updated weights for policy 1, policy_version 658943 (0.0008) [2023-12-26 04:53:05,946][123091] Updated weights for policy 0, policy_version 663480 (0.0007) [2023-12-26 04:53:06,000][123090] Updated weights for policy 1, policy_version 658953 (0.0008) [2023-12-26 04:53:06,011][123091] Updated weights for policy 0, policy_version 663490 (0.0010) [2023-12-26 04:53:06,058][123090] Updated weights for policy 1, policy_version 658963 (0.0008) [2023-12-26 04:53:06,073][123091] Updated weights for policy 0, policy_version 663500 (0.0010) [2023-12-26 04:53:06,129][123090] Updated weights for policy 1, policy_version 658973 (0.0008) [2023-12-26 04:53:06,871][123091] Updated weights for policy 0, policy_version 663510 (0.0010) [2023-12-26 04:53:06,923][123090] Updated weights for policy 1, policy_version 658983 (0.0009) [2023-12-26 04:53:06,938][123091] Updated weights for policy 0, policy_version 663520 (0.0007) [2023-12-26 04:53:06,988][123090] Updated weights for policy 1, policy_version 658993 (0.0007) [2023-12-26 04:53:07,005][123091] Updated weights for policy 0, policy_version 663530 (0.0009) [2023-12-26 04:53:07,051][123090] Updated weights for policy 1, policy_version 659003 (0.0005) [2023-12-26 04:53:07,704][123090] Updated weights for policy 1, policy_version 659013 (0.0007) [2023-12-26 04:53:07,758][123091] Updated weights for policy 0, policy_version 663540 (0.0007) [2023-12-26 04:53:07,759][123090] Updated weights for policy 1, policy_version 659023 (0.0009) [2023-12-26 04:53:07,813][123090] Updated weights for policy 1, policy_version 659033 (0.0009) [2023-12-26 04:53:07,813][123091] Updated weights for policy 0, policy_version 663550 (0.0005) [2023-12-26 04:53:07,878][123091] Updated weights for policy 0, policy_version 663560 (0.0008) [2023-12-26 04:53:08,612][123090] Updated weights for policy 1, policy_version 659043 (0.0008) [2023-12-26 04:53:08,667][123091] Updated weights for policy 0, policy_version 663570 (0.0006) [2023-12-26 04:53:08,682][123090] Updated weights for policy 1, policy_version 659053 (0.0009) [2023-12-26 04:53:08,727][123091] Updated weights for policy 0, policy_version 663580 (0.0007) [2023-12-26 04:53:08,749][123090] Updated weights for policy 1, policy_version 659063 (0.0009) [2023-12-26 04:53:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 338591744. Throughput: 0: 8871.5, 1: 9163.5. Samples: 338574440. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:08,784][121949] Avg episode reward: [(0, '6217.932'), (1, '5078.899')] [2023-12-26 04:53:08,790][123091] Updated weights for policy 0, policy_version 663590 (0.0010) [2023-12-26 04:53:08,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000659072_168722432.pth... [2023-12-26 04:53:08,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000657984_168443904.pth [2023-12-26 04:53:08,842][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000663600_169885696.pth... [2023-12-26 04:53:08,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000662576_169623552.pth [2023-12-26 04:53:08,845][123091] Updated weights for policy 0, policy_version 663600 (0.0010) [2023-12-26 04:53:09,492][123090] Updated weights for policy 1, policy_version 659073 (0.0008) [2023-12-26 04:53:09,566][123090] Updated weights for policy 1, policy_version 659083 (0.0008) [2023-12-26 04:53:09,636][123090] Updated weights for policy 1, policy_version 659093 (0.0008) [2023-12-26 04:53:09,705][123090] Updated weights for policy 1, policy_version 659103 (0.0010) [2023-12-26 04:53:09,743][123091] Updated weights for policy 0, policy_version 663610 (0.0009) [2023-12-26 04:53:09,799][123091] Updated weights for policy 0, policy_version 663620 (0.0009) [2023-12-26 04:53:09,871][123091] Updated weights for policy 0, policy_version 663630 (0.0009) [2023-12-26 04:53:10,521][123090] Updated weights for policy 1, policy_version 659113 (0.0011) [2023-12-26 04:53:10,579][123090] Updated weights for policy 1, policy_version 659123 (0.0010) [2023-12-26 04:53:10,650][123090] Updated weights for policy 1, policy_version 659133 (0.0010) [2023-12-26 04:53:10,721][123091] Updated weights for policy 0, policy_version 663640 (0.0009) [2023-12-26 04:53:10,782][123091] Updated weights for policy 0, policy_version 663650 (0.0009) [2023-12-26 04:53:10,847][123091] Updated weights for policy 0, policy_version 663660 (0.0009) [2023-12-26 04:53:11,518][123090] Updated weights for policy 1, policy_version 659143 (0.0011) [2023-12-26 04:53:11,574][123090] Updated weights for policy 1, policy_version 659153 (0.0010) [2023-12-26 04:53:11,644][123090] Updated weights for policy 1, policy_version 659163 (0.0010) [2023-12-26 04:53:11,731][123091] Updated weights for policy 0, policy_version 663670 (0.0009) [2023-12-26 04:53:11,800][123091] Updated weights for policy 0, policy_version 663680 (0.0006) [2023-12-26 04:53:11,872][123091] Updated weights for policy 0, policy_version 663690 (0.0007) [2023-12-26 04:53:12,561][123090] Updated weights for policy 1, policy_version 659173 (0.0009) [2023-12-26 04:53:12,565][123091] Updated weights for policy 0, policy_version 663700 (0.0008) [2023-12-26 04:53:12,610][123091] Updated weights for policy 0, policy_version 663710 (0.0010) [2023-12-26 04:53:12,617][123090] Updated weights for policy 1, policy_version 659183 (0.0009) [2023-12-26 04:53:12,666][123091] Updated weights for policy 0, policy_version 663720 (0.0007) [2023-12-26 04:53:12,676][123090] Updated weights for policy 1, policy_version 659193 (0.0009) [2023-12-26 04:53:13,413][123090] Updated weights for policy 1, policy_version 659203 (0.0008) [2023-12-26 04:53:13,464][123090] Updated weights for policy 1, policy_version 659213 (0.0005) [2023-12-26 04:53:13,505][123091] Updated weights for policy 0, policy_version 663730 (0.0007) [2023-12-26 04:53:13,520][123090] Updated weights for policy 1, policy_version 659223 (0.0006) [2023-12-26 04:53:13,563][123091] Updated weights for policy 0, policy_version 663740 (0.0009) [2023-12-26 04:53:13,616][123091] Updated weights for policy 0, policy_version 663750 (0.0009) [2023-12-26 04:53:13,688][123091] Updated weights for policy 0, policy_version 663760 (0.0010) [2023-12-26 04:53:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 338690048. Throughput: 0: 8752.2, 1: 9056.2. Samples: 338678912. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:13,785][121949] Avg episode reward: [(0, '6205.777'), (1, '4956.998')] [2023-12-26 04:53:14,230][123090] Updated weights for policy 1, policy_version 659233 (0.0006) [2023-12-26 04:53:14,301][123090] Updated weights for policy 1, policy_version 659243 (0.0009) [2023-12-26 04:53:14,368][123090] Updated weights for policy 1, policy_version 659253 (0.0005) [2023-12-26 04:53:14,422][123090] Updated weights for policy 1, policy_version 659263 (0.0005) [2023-12-26 04:53:14,581][123091] Updated weights for policy 0, policy_version 663770 (0.0010) [2023-12-26 04:53:14,651][123091] Updated weights for policy 0, policy_version 663780 (0.0010) [2023-12-26 04:53:14,713][123091] Updated weights for policy 0, policy_version 663790 (0.0010) [2023-12-26 04:53:15,105][123090] Updated weights for policy 1, policy_version 659273 (0.0010) [2023-12-26 04:53:15,169][123090] Updated weights for policy 1, policy_version 659283 (0.0010) [2023-12-26 04:53:15,238][123090] Updated weights for policy 1, policy_version 659293 (0.0010) [2023-12-26 04:53:15,482][123091] Updated weights for policy 0, policy_version 663800 (0.0006) [2023-12-26 04:53:15,543][123091] Updated weights for policy 0, policy_version 663810 (0.0005) [2023-12-26 04:53:15,605][123091] Updated weights for policy 0, policy_version 663820 (0.0005) [2023-12-26 04:53:16,073][123090] Updated weights for policy 1, policy_version 659303 (0.0010) [2023-12-26 04:53:16,128][123090] Updated weights for policy 1, policy_version 659313 (0.0010) [2023-12-26 04:53:16,199][123090] Updated weights for policy 1, policy_version 659323 (0.0010) [2023-12-26 04:53:16,269][123091] Updated weights for policy 0, policy_version 663830 (0.0006) [2023-12-26 04:53:16,329][123091] Updated weights for policy 0, policy_version 663840 (0.0006) [2023-12-26 04:53:16,394][123091] Updated weights for policy 0, policy_version 663850 (0.0006) [2023-12-26 04:53:17,009][123090] Updated weights for policy 1, policy_version 659333 (0.0008) [2023-12-26 04:53:17,067][123090] Updated weights for policy 1, policy_version 659343 (0.0008) [2023-12-26 04:53:17,117][123090] Updated weights for policy 1, policy_version 659353 (0.0009) [2023-12-26 04:53:17,166][123091] Updated weights for policy 0, policy_version 663860 (0.0008) [2023-12-26 04:53:17,225][123091] Updated weights for policy 0, policy_version 663870 (0.0007) [2023-12-26 04:53:17,296][123091] Updated weights for policy 0, policy_version 663880 (0.0006) [2023-12-26 04:53:17,843][123091] Updated weights for policy 0, policy_version 663890 (0.0006) [2023-12-26 04:53:17,895][123091] Updated weights for policy 0, policy_version 663900 (0.0009) [2023-12-26 04:53:17,943][123091] Updated weights for policy 0, policy_version 663910 (0.0009) [2023-12-26 04:53:17,970][123090] Updated weights for policy 1, policy_version 659363 (0.0006) [2023-12-26 04:53:18,003][123091] Updated weights for policy 0, policy_version 663920 (0.0009) [2023-12-26 04:53:18,023][123090] Updated weights for policy 1, policy_version 659373 (0.0005) [2023-12-26 04:53:18,080][123090] Updated weights for policy 1, policy_version 659383 (0.0006) [2023-12-26 04:53:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 338771968. Throughput: 0: 8796.9, 1: 9023.9. Samples: 338787384. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:18,785][121949] Avg episode reward: [(0, '6113.447'), (1, '4651.631')] [2023-12-26 04:53:18,841][123091] Updated weights for policy 0, policy_version 663930 (0.0006) [2023-12-26 04:53:18,899][123091] Updated weights for policy 0, policy_version 663940 (0.0006) [2023-12-26 04:53:18,929][123090] Updated weights for policy 1, policy_version 659393 (0.0010) [2023-12-26 04:53:18,960][123091] Updated weights for policy 0, policy_version 663950 (0.0006) [2023-12-26 04:53:18,995][123090] Updated weights for policy 1, policy_version 659403 (0.0009) [2023-12-26 04:53:19,065][123090] Updated weights for policy 1, policy_version 659413 (0.0009) [2023-12-26 04:53:19,131][123090] Updated weights for policy 1, policy_version 659423 (0.0009) [2023-12-26 04:53:19,780][123091] Updated weights for policy 0, policy_version 663960 (0.0006) [2023-12-26 04:53:19,852][123091] Updated weights for policy 0, policy_version 663970 (0.0009) [2023-12-26 04:53:19,917][123091] Updated weights for policy 0, policy_version 663980 (0.0009) [2023-12-26 04:53:19,977][123090] Updated weights for policy 1, policy_version 659433 (0.0010) [2023-12-26 04:53:20,044][123090] Updated weights for policy 1, policy_version 659443 (0.0009) [2023-12-26 04:53:20,127][123090] Updated weights for policy 1, policy_version 659453 (0.0006) [2023-12-26 04:53:20,815][123091] Updated weights for policy 0, policy_version 663990 (0.0010) [2023-12-26 04:53:20,879][123091] Updated weights for policy 0, policy_version 664000 (0.0009) [2023-12-26 04:53:20,894][123090] Updated weights for policy 1, policy_version 659463 (0.0006) [2023-12-26 04:53:20,955][123091] Updated weights for policy 0, policy_version 664010 (0.0010) [2023-12-26 04:53:20,956][123090] Updated weights for policy 1, policy_version 659473 (0.0006) [2023-12-26 04:53:21,024][123090] Updated weights for policy 1, policy_version 659483 (0.0007) [2023-12-26 04:53:21,828][123091] Updated weights for policy 0, policy_version 664020 (0.0008) [2023-12-26 04:53:21,832][123090] Updated weights for policy 1, policy_version 659493 (0.0009) [2023-12-26 04:53:21,889][123090] Updated weights for policy 1, policy_version 659503 (0.0008) [2023-12-26 04:53:21,919][123091] Updated weights for policy 0, policy_version 664030 (0.0009) [2023-12-26 04:53:21,951][123090] Updated weights for policy 1, policy_version 659513 (0.0010) [2023-12-26 04:53:21,984][123091] Updated weights for policy 0, policy_version 664040 (0.0008) [2023-12-26 04:53:22,785][123090] Updated weights for policy 1, policy_version 659523 (0.0007) [2023-12-26 04:53:22,809][123091] Updated weights for policy 0, policy_version 664050 (0.0008) [2023-12-26 04:53:22,845][123090] Updated weights for policy 1, policy_version 659533 (0.0009) [2023-12-26 04:53:22,863][123091] Updated weights for policy 0, policy_version 664060 (0.0008) [2023-12-26 04:53:22,905][123090] Updated weights for policy 1, policy_version 659543 (0.0009) [2023-12-26 04:53:22,913][123091] Updated weights for policy 0, policy_version 664070 (0.0007) [2023-12-26 04:53:22,963][123091] Updated weights for policy 0, policy_version 664080 (0.0009) [2023-12-26 04:53:23,736][123090] Updated weights for policy 1, policy_version 659553 (0.0008) [2023-12-26 04:53:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 338853888. Throughput: 0: 8713.2, 1: 8993.2. Samples: 338837588. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:23,785][121949] Avg episode reward: [(0, '6058.235'), (1, '4531.964')] [2023-12-26 04:53:23,800][123090] Updated weights for policy 1, policy_version 659564 (0.0010) [2023-12-26 04:53:23,843][123091] Updated weights for policy 0, policy_version 664090 (0.0008) [2023-12-26 04:53:23,850][123090] Updated weights for policy 1, policy_version 659574 (0.0008) [2023-12-26 04:53:23,899][123091] Updated weights for policy 0, policy_version 664100 (0.0010) [2023-12-26 04:53:23,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000659584_168853504.pth... [2023-12-26 04:53:23,916][123090] Updated weights for policy 1, policy_version 659584 (0.0008) [2023-12-26 04:53:23,918][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000658496_168574976.pth [2023-12-26 04:53:23,964][123091] Updated weights for policy 0, policy_version 664110 (0.0010) [2023-12-26 04:53:23,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000664112_170016768.pth... [2023-12-26 04:53:23,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000663088_169754624.pth [2023-12-26 04:53:24,733][123090] Updated weights for policy 1, policy_version 659594 (0.0010) [2023-12-26 04:53:24,784][123090] Updated weights for policy 1, policy_version 659604 (0.0010) [2023-12-26 04:53:24,816][123091] Updated weights for policy 0, policy_version 664120 (0.0008) [2023-12-26 04:53:24,839][123090] Updated weights for policy 1, policy_version 659614 (0.0010) [2023-12-26 04:53:24,874][123091] Updated weights for policy 0, policy_version 664130 (0.0007) [2023-12-26 04:53:24,935][123091] Updated weights for policy 0, policy_version 664140 (0.0009) [2023-12-26 04:53:25,675][123090] Updated weights for policy 1, policy_version 659624 (0.0006) [2023-12-26 04:53:25,748][123090] Updated weights for policy 1, policy_version 659634 (0.0007) [2023-12-26 04:53:25,788][123091] Updated weights for policy 0, policy_version 664150 (0.0008) [2023-12-26 04:53:25,806][123090] Updated weights for policy 1, policy_version 659644 (0.0007) [2023-12-26 04:53:25,855][123091] Updated weights for policy 0, policy_version 664160 (0.0008) [2023-12-26 04:53:25,913][123091] Updated weights for policy 0, policy_version 664171 (0.0010) [2023-12-26 04:53:26,498][123090] Updated weights for policy 1, policy_version 659654 (0.0006) [2023-12-26 04:53:26,550][123090] Updated weights for policy 1, policy_version 659664 (0.0005) [2023-12-26 04:53:26,620][123090] Updated weights for policy 1, policy_version 659674 (0.0005) [2023-12-26 04:53:26,682][123091] Updated weights for policy 0, policy_version 664181 (0.0008) [2023-12-26 04:53:26,736][123091] Updated weights for policy 0, policy_version 664191 (0.0010) [2023-12-26 04:53:26,792][123091] Updated weights for policy 0, policy_version 664201 (0.0010) [2023-12-26 04:53:27,283][123090] Updated weights for policy 1, policy_version 659684 (0.0005) [2023-12-26 04:53:27,333][123090] Updated weights for policy 1, policy_version 659694 (0.0006) [2023-12-26 04:53:27,388][123090] Updated weights for policy 1, policy_version 659704 (0.0010) [2023-12-26 04:53:27,389][123091] Updated weights for policy 0, policy_version 664211 (0.0005) [2023-12-26 04:53:27,455][123091] Updated weights for policy 0, policy_version 664221 (0.0006) [2023-12-26 04:53:27,511][123091] Updated weights for policy 0, policy_version 664231 (0.0007) [2023-12-26 04:53:28,147][123090] Updated weights for policy 1, policy_version 659714 (0.0009) [2023-12-26 04:53:28,185][123091] Updated weights for policy 0, policy_version 664241 (0.0007) [2023-12-26 04:53:28,205][123090] Updated weights for policy 1, policy_version 659724 (0.0005) [2023-12-26 04:53:28,237][123091] Updated weights for policy 0, policy_version 664251 (0.0009) [2023-12-26 04:53:28,261][123090] Updated weights for policy 1, policy_version 659734 (0.0005) [2023-12-26 04:53:28,297][123091] Updated weights for policy 0, policy_version 664261 (0.0009) [2023-12-26 04:53:28,314][123090] Updated weights for policy 1, policy_version 659744 (0.0006) [2023-12-26 04:53:28,354][123091] Updated weights for policy 0, policy_version 664271 (0.0011) [2023-12-26 04:53:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 338952192. Throughput: 0: 8693.8, 1: 9021.1. Samples: 338944120. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:28,785][121949] Avg episode reward: [(0, '6106.453'), (1, '4664.947')] [2023-12-26 04:53:29,083][123090] Updated weights for policy 1, policy_version 659754 (0.0005) [2023-12-26 04:53:29,128][123090] Updated weights for policy 1, policy_version 659764 (0.0005) [2023-12-26 04:53:29,174][123090] Updated weights for policy 1, policy_version 659774 (0.0005) [2023-12-26 04:53:29,195][123091] Updated weights for policy 0, policy_version 664282 (0.0010) [2023-12-26 04:53:29,257][123091] Updated weights for policy 0, policy_version 664292 (0.0010) [2023-12-26 04:53:29,325][123091] Updated weights for policy 0, policy_version 664302 (0.0008) [2023-12-26 04:53:30,001][123090] Updated weights for policy 1, policy_version 659784 (0.0006) [2023-12-26 04:53:30,059][123090] Updated weights for policy 1, policy_version 659794 (0.0008) [2023-12-26 04:53:30,117][123090] Updated weights for policy 1, policy_version 659805 (0.0010) [2023-12-26 04:53:30,220][123091] Updated weights for policy 0, policy_version 664312 (0.0009) [2023-12-26 04:53:30,274][123091] Updated weights for policy 0, policy_version 664322 (0.0009) [2023-12-26 04:53:30,334][123091] Updated weights for policy 0, policy_version 664332 (0.0009) [2023-12-26 04:53:30,850][123090] Updated weights for policy 1, policy_version 659815 (0.0010) [2023-12-26 04:53:30,902][123090] Updated weights for policy 1, policy_version 659825 (0.0010) [2023-12-26 04:53:30,965][123090] Updated weights for policy 1, policy_version 659835 (0.0010) [2023-12-26 04:53:31,202][123091] Updated weights for policy 0, policy_version 664342 (0.0010) [2023-12-26 04:53:31,260][123091] Updated weights for policy 0, policy_version 664352 (0.0010) [2023-12-26 04:53:31,335][123091] Updated weights for policy 0, policy_version 664362 (0.0010) [2023-12-26 04:53:31,783][123090] Updated weights for policy 1, policy_version 659845 (0.0008) [2023-12-26 04:53:31,844][123090] Updated weights for policy 1, policy_version 659855 (0.0006) [2023-12-26 04:53:31,914][123090] Updated weights for policy 1, policy_version 659865 (0.0006) [2023-12-26 04:53:32,189][123091] Updated weights for policy 0, policy_version 664372 (0.0008) [2023-12-26 04:53:32,242][123091] Updated weights for policy 0, policy_version 664382 (0.0005) [2023-12-26 04:53:32,298][123091] Updated weights for policy 0, policy_version 664392 (0.0008) [2023-12-26 04:53:32,691][123090] Updated weights for policy 1, policy_version 659875 (0.0008) [2023-12-26 04:53:32,752][123090] Updated weights for policy 1, policy_version 659885 (0.0009) [2023-12-26 04:53:32,803][123090] Updated weights for policy 1, policy_version 659895 (0.0009) [2023-12-26 04:53:33,114][123091] Updated weights for policy 0, policy_version 664403 (0.0010) [2023-12-26 04:53:33,171][123091] Updated weights for policy 0, policy_version 664413 (0.0009) [2023-12-26 04:53:33,228][123091] Updated weights for policy 0, policy_version 664423 (0.0009) [2023-12-26 04:53:33,506][123090] Updated weights for policy 1, policy_version 659906 (0.0010) [2023-12-26 04:53:33,553][123090] Updated weights for policy 1, policy_version 659916 (0.0005) [2023-12-26 04:53:33,603][123090] Updated weights for policy 1, policy_version 659926 (0.0005) [2023-12-26 04:53:33,654][123090] Updated weights for policy 1, policy_version 659936 (0.0010) [2023-12-26 04:53:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 339042304. Throughput: 0: 8644.9, 1: 9091.8. Samples: 339051320. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:33,785][121949] Avg episode reward: [(0, '6084.166'), (1, '4911.894')] [2023-12-26 04:53:34,114][123091] Updated weights for policy 0, policy_version 664433 (0.0011) [2023-12-26 04:53:34,179][123091] Updated weights for policy 0, policy_version 664444 (0.0008) [2023-12-26 04:53:34,230][123091] Updated weights for policy 0, policy_version 664454 (0.0009) [2023-12-26 04:53:34,281][123091] Updated weights for policy 0, policy_version 664464 (0.0010) [2023-12-26 04:53:34,483][123090] Updated weights for policy 1, policy_version 659946 (0.0009) [2023-12-26 04:53:34,553][123090] Updated weights for policy 1, policy_version 659956 (0.0010) [2023-12-26 04:53:34,608][123090] Updated weights for policy 1, policy_version 659966 (0.0008) [2023-12-26 04:53:35,163][123091] Updated weights for policy 0, policy_version 664474 (0.0009) [2023-12-26 04:53:35,216][123091] Updated weights for policy 0, policy_version 664484 (0.0008) [2023-12-26 04:53:35,271][123091] Updated weights for policy 0, policy_version 664494 (0.0010) [2023-12-26 04:53:35,375][123090] Updated weights for policy 1, policy_version 659976 (0.0006) [2023-12-26 04:53:35,431][123090] Updated weights for policy 1, policy_version 659986 (0.0008) [2023-12-26 04:53:35,498][123090] Updated weights for policy 1, policy_version 659997 (0.0009) [2023-12-26 04:53:36,158][123091] Updated weights for policy 0, policy_version 664505 (0.0010) [2023-12-26 04:53:36,227][123091] Updated weights for policy 0, policy_version 664515 (0.0008) [2023-12-26 04:53:36,269][123090] Updated weights for policy 1, policy_version 660007 (0.0009) [2023-12-26 04:53:36,295][123091] Updated weights for policy 0, policy_version 664525 (0.0006) [2023-12-26 04:53:36,335][123090] Updated weights for policy 1, policy_version 660017 (0.0008) [2023-12-26 04:53:36,412][123090] Updated weights for policy 1, policy_version 660027 (0.0009) [2023-12-26 04:53:36,992][123091] Updated weights for policy 0, policy_version 664535 (0.0006) [2023-12-26 04:53:37,057][123091] Updated weights for policy 0, policy_version 664545 (0.0008) [2023-12-26 04:53:37,119][123091] Updated weights for policy 0, policy_version 664555 (0.0009) [2023-12-26 04:53:37,303][123090] Updated weights for policy 1, policy_version 660037 (0.0009) [2023-12-26 04:53:37,374][123090] Updated weights for policy 1, policy_version 660047 (0.0009) [2023-12-26 04:53:37,426][123090] Updated weights for policy 1, policy_version 660057 (0.0010) [2023-12-26 04:53:37,834][123091] Updated weights for policy 0, policy_version 664565 (0.0008) [2023-12-26 04:53:37,883][123091] Updated weights for policy 0, policy_version 664575 (0.0009) [2023-12-26 04:53:37,935][123091] Updated weights for policy 0, policy_version 664585 (0.0010) [2023-12-26 04:53:38,319][123090] Updated weights for policy 1, policy_version 660067 (0.0010) [2023-12-26 04:53:38,378][123090] Updated weights for policy 1, policy_version 660077 (0.0009) [2023-12-26 04:53:38,439][123090] Updated weights for policy 1, policy_version 660087 (0.0008) [2023-12-26 04:53:38,711][123091] Updated weights for policy 0, policy_version 664595 (0.0007) [2023-12-26 04:53:38,760][123091] Updated weights for policy 0, policy_version 664605 (0.0010) [2023-12-26 04:53:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 339124224. Throughput: 0: 8656.6, 1: 9072.3. Samples: 339102736. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:38,785][121949] Avg episode reward: [(0, '6114.214'), (1, '5171.195')] [2023-12-26 04:53:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000660096_168984576.pth... [2023-12-26 04:53:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000659072_168722432.pth [2023-12-26 04:53:38,808][123091] Updated weights for policy 0, policy_version 664615 (0.0010) [2023-12-26 04:53:38,850][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000664624_170147840.pth... [2023-12-26 04:53:38,853][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000663600_169885696.pth [2023-12-26 04:53:39,264][123090] Updated weights for policy 1, policy_version 660097 (0.0006) [2023-12-26 04:53:39,320][123090] Updated weights for policy 1, policy_version 660107 (0.0011) [2023-12-26 04:53:39,387][123090] Updated weights for policy 1, policy_version 660117 (0.0010) [2023-12-26 04:53:39,456][123090] Updated weights for policy 1, policy_version 660127 (0.0014) [2023-12-26 04:53:39,542][123091] Updated weights for policy 0, policy_version 664625 (0.0009) [2023-12-26 04:53:39,603][123091] Updated weights for policy 0, policy_version 664635 (0.0009) [2023-12-26 04:53:39,660][123091] Updated weights for policy 0, policy_version 664645 (0.0008) [2023-12-26 04:53:39,735][123091] Updated weights for policy 0, policy_version 664655 (0.0009) [2023-12-26 04:53:40,300][123090] Updated weights for policy 1, policy_version 660137 (0.0007) [2023-12-26 04:53:40,354][123090] Updated weights for policy 1, policy_version 660148 (0.0007) [2023-12-26 04:53:40,414][123090] Updated weights for policy 1, policy_version 660158 (0.0006) [2023-12-26 04:53:40,545][123091] Updated weights for policy 0, policy_version 664665 (0.0009) [2023-12-26 04:53:40,618][123091] Updated weights for policy 0, policy_version 664675 (0.0009) [2023-12-26 04:53:40,690][123091] Updated weights for policy 0, policy_version 664685 (0.0009) [2023-12-26 04:53:41,208][123090] Updated weights for policy 1, policy_version 660168 (0.0008) [2023-12-26 04:53:41,267][123090] Updated weights for policy 1, policy_version 660178 (0.0010) [2023-12-26 04:53:41,324][123090] Updated weights for policy 1, policy_version 660188 (0.0010) [2023-12-26 04:53:41,515][123091] Updated weights for policy 0, policy_version 664695 (0.0010) [2023-12-26 04:53:41,588][123091] Updated weights for policy 0, policy_version 664705 (0.0009) [2023-12-26 04:53:41,652][123091] Updated weights for policy 0, policy_version 664715 (0.0009) [2023-12-26 04:53:42,099][123090] Updated weights for policy 1, policy_version 660198 (0.0009) [2023-12-26 04:53:42,170][123090] Updated weights for policy 1, policy_version 660208 (0.0007) [2023-12-26 04:53:42,239][123090] Updated weights for policy 1, policy_version 660218 (0.0008) [2023-12-26 04:53:42,503][123091] Updated weights for policy 0, policy_version 664725 (0.0009) [2023-12-26 04:53:42,576][123091] Updated weights for policy 0, policy_version 664735 (0.0009) [2023-12-26 04:53:42,649][123091] Updated weights for policy 0, policy_version 664745 (0.0006) [2023-12-26 04:53:43,057][123090] Updated weights for policy 1, policy_version 660228 (0.0011) [2023-12-26 04:53:43,112][123090] Updated weights for policy 1, policy_version 660238 (0.0010) [2023-12-26 04:53:43,179][123090] Updated weights for policy 1, policy_version 660248 (0.0011) [2023-12-26 04:53:43,354][123091] Updated weights for policy 0, policy_version 664755 (0.0007) [2023-12-26 04:53:43,413][123091] Updated weights for policy 0, policy_version 664765 (0.0010) [2023-12-26 04:53:43,461][123091] Updated weights for policy 0, policy_version 664775 (0.0010) [2023-12-26 04:53:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 339214336. Throughput: 0: 8763.6, 1: 8936.8. Samples: 339207360. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:43,785][121949] Avg episode reward: [(0, '6047.534'), (1, '5213.390')] [2023-12-26 04:53:44,015][123090] Updated weights for policy 1, policy_version 660258 (0.0011) [2023-12-26 04:53:44,075][123090] Updated weights for policy 1, policy_version 660268 (0.0010) [2023-12-26 04:53:44,135][123090] Updated weights for policy 1, policy_version 660278 (0.0010) [2023-12-26 04:53:44,198][123090] Updated weights for policy 1, policy_version 660288 (0.0011) [2023-12-26 04:53:44,240][123091] Updated weights for policy 0, policy_version 664785 (0.0010) [2023-12-26 04:53:44,295][123091] Updated weights for policy 0, policy_version 664795 (0.0008) [2023-12-26 04:53:44,362][123091] Updated weights for policy 0, policy_version 664805 (0.0007) [2023-12-26 04:53:44,409][123091] Updated weights for policy 0, policy_version 664815 (0.0006) [2023-12-26 04:53:44,982][123090] Updated weights for policy 1, policy_version 660298 (0.0011) [2023-12-26 04:53:45,051][123090] Updated weights for policy 1, policy_version 660308 (0.0011) [2023-12-26 04:53:45,130][123090] Updated weights for policy 1, policy_version 660318 (0.0011) [2023-12-26 04:53:45,194][123091] Updated weights for policy 0, policy_version 664825 (0.0009) [2023-12-26 04:53:45,264][123091] Updated weights for policy 0, policy_version 664835 (0.0009) [2023-12-26 04:53:45,328][123091] Updated weights for policy 0, policy_version 664845 (0.0009) [2023-12-26 04:53:45,914][123090] Updated weights for policy 1, policy_version 660328 (0.0006) [2023-12-26 04:53:45,991][123090] Updated weights for policy 1, policy_version 660338 (0.0006) [2023-12-26 04:53:46,051][123090] Updated weights for policy 1, policy_version 660348 (0.0011) [2023-12-26 04:53:46,157][123091] Updated weights for policy 0, policy_version 664855 (0.0007) [2023-12-26 04:53:46,205][123091] Updated weights for policy 0, policy_version 664865 (0.0006) [2023-12-26 04:53:46,249][123091] Updated weights for policy 0, policy_version 664875 (0.0006) [2023-12-26 04:53:46,810][123090] Updated weights for policy 1, policy_version 660358 (0.0007) [2023-12-26 04:53:46,883][123090] Updated weights for policy 1, policy_version 660368 (0.0005) [2023-12-26 04:53:46,907][123091] Updated weights for policy 0, policy_version 664885 (0.0007) [2023-12-26 04:53:46,941][123090] Updated weights for policy 1, policy_version 660378 (0.0005) [2023-12-26 04:53:46,963][123091] Updated weights for policy 0, policy_version 664895 (0.0009) [2023-12-26 04:53:47,027][123091] Updated weights for policy 0, policy_version 664905 (0.0009) [2023-12-26 04:53:47,596][123090] Updated weights for policy 1, policy_version 660388 (0.0005) [2023-12-26 04:53:47,653][123090] Updated weights for policy 1, policy_version 660398 (0.0005) [2023-12-26 04:53:47,714][123090] Updated weights for policy 1, policy_version 660408 (0.0009) [2023-12-26 04:53:47,963][123091] Updated weights for policy 0, policy_version 664915 (0.0010) [2023-12-26 04:53:48,017][123091] Updated weights for policy 0, policy_version 664925 (0.0010) [2023-12-26 04:53:48,069][123091] Updated weights for policy 0, policy_version 664935 (0.0009) [2023-12-26 04:53:48,415][123090] Updated weights for policy 1, policy_version 660418 (0.0007) [2023-12-26 04:53:48,467][123090] Updated weights for policy 1, policy_version 660428 (0.0008) [2023-12-26 04:53:48,526][123090] Updated weights for policy 1, policy_version 660438 (0.0009) [2023-12-26 04:53:48,576][123090] Updated weights for policy 1, policy_version 660448 (0.0009) [2023-12-26 04:53:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 339304448. Throughput: 0: 8812.4, 1: 8937.3. Samples: 339315972. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:48,784][121949] Avg episode reward: [(0, '6053.653'), (1, '4107.972')] [2023-12-26 04:53:48,982][123091] Updated weights for policy 0, policy_version 664945 (0.0009) [2023-12-26 04:53:49,046][123091] Updated weights for policy 0, policy_version 664955 (0.0010) [2023-12-26 04:53:49,113][123091] Updated weights for policy 0, policy_version 664966 (0.0008) [2023-12-26 04:53:49,166][123091] Updated weights for policy 0, policy_version 664976 (0.0010) [2023-12-26 04:53:49,407][123090] Updated weights for policy 1, policy_version 660458 (0.0009) [2023-12-26 04:53:49,473][123090] Updated weights for policy 1, policy_version 660468 (0.0010) [2023-12-26 04:53:49,540][123090] Updated weights for policy 1, policy_version 660478 (0.0010) [2023-12-26 04:53:50,024][123091] Updated weights for policy 0, policy_version 664986 (0.0010) [2023-12-26 04:53:50,075][123091] Updated weights for policy 0, policy_version 664996 (0.0009) [2023-12-26 04:53:50,125][123091] Updated weights for policy 0, policy_version 665006 (0.0009) [2023-12-26 04:53:50,316][123090] Updated weights for policy 1, policy_version 660488 (0.0009) [2023-12-26 04:53:50,372][123090] Updated weights for policy 1, policy_version 660498 (0.0010) [2023-12-26 04:53:50,430][123090] Updated weights for policy 1, policy_version 660508 (0.0007) [2023-12-26 04:53:51,019][123091] Updated weights for policy 0, policy_version 665016 (0.0009) [2023-12-26 04:53:51,094][123091] Updated weights for policy 0, policy_version 665026 (0.0009) [2023-12-26 04:53:51,162][123091] Updated weights for policy 0, policy_version 665036 (0.0010) [2023-12-26 04:53:51,223][123090] Updated weights for policy 1, policy_version 660518 (0.0009) [2023-12-26 04:53:51,296][123090] Updated weights for policy 1, policy_version 660528 (0.0011) [2023-12-26 04:53:51,363][123090] Updated weights for policy 1, policy_version 660538 (0.0010) [2023-12-26 04:53:52,035][123091] Updated weights for policy 0, policy_version 665046 (0.0010) [2023-12-26 04:53:52,089][123091] Updated weights for policy 0, policy_version 665056 (0.0010) [2023-12-26 04:53:52,141][123091] Updated weights for policy 0, policy_version 665066 (0.0010) [2023-12-26 04:53:52,179][123090] Updated weights for policy 1, policy_version 660548 (0.0008) [2023-12-26 04:53:52,251][123090] Updated weights for policy 1, policy_version 660558 (0.0009) [2023-12-26 04:53:52,312][123090] Updated weights for policy 1, policy_version 660568 (0.0009) [2023-12-26 04:53:53,012][123091] Updated weights for policy 0, policy_version 665076 (0.0010) [2023-12-26 04:53:53,045][123090] Updated weights for policy 1, policy_version 660578 (0.0007) [2023-12-26 04:53:53,068][123091] Updated weights for policy 0, policy_version 665086 (0.0010) [2023-12-26 04:53:53,097][123090] Updated weights for policy 1, policy_version 660588 (0.0007) [2023-12-26 04:53:53,121][123091] Updated weights for policy 0, policy_version 665096 (0.0009) [2023-12-26 04:53:53,154][123090] Updated weights for policy 1, policy_version 660598 (0.0006) [2023-12-26 04:53:53,217][123090] Updated weights for policy 1, policy_version 660608 (0.0008) [2023-12-26 04:53:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 339386368. Throughput: 0: 8729.3, 1: 8877.8. Samples: 339366764. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:53,785][121949] Avg episode reward: [(0, '6135.906'), (1, '4128.043')] [2023-12-26 04:53:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000660608_169115648.pth... [2023-12-26 04:53:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000665104_170270720.pth... [2023-12-26 04:53:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000659584_168853504.pth [2023-12-26 04:53:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000660608_169115648.pth [2023-12-26 04:53:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000664112_170016768.pth [2023-12-26 04:53:53,800][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000665104_170270720.pth [2023-12-26 04:53:53,956][123091] Updated weights for policy 0, policy_version 665106 (0.0009) [2023-12-26 04:53:54,024][123091] Updated weights for policy 0, policy_version 665116 (0.0006) [2023-12-26 04:53:54,061][123090] Updated weights for policy 1, policy_version 660618 (0.0008) [2023-12-26 04:53:54,083][123091] Updated weights for policy 0, policy_version 665126 (0.0007) [2023-12-26 04:53:54,125][123090] Updated weights for policy 1, policy_version 660628 (0.0009) [2023-12-26 04:53:54,144][123091] Updated weights for policy 0, policy_version 665136 (0.0008) [2023-12-26 04:53:54,174][123090] Updated weights for policy 1, policy_version 660638 (0.0008) [2023-12-26 04:53:54,935][123091] Updated weights for policy 0, policy_version 665146 (0.0009) [2023-12-26 04:53:54,949][123090] Updated weights for policy 1, policy_version 660648 (0.0009) [2023-12-26 04:53:55,003][123091] Updated weights for policy 0, policy_version 665156 (0.0006) [2023-12-26 04:53:55,008][123090] Updated weights for policy 1, policy_version 660658 (0.0006) [2023-12-26 04:53:55,065][123090] Updated weights for policy 1, policy_version 660668 (0.0005) [2023-12-26 04:53:55,068][123091] Updated weights for policy 0, policy_version 665166 (0.0005) [2023-12-26 04:53:55,728][123091] Updated weights for policy 0, policy_version 665176 (0.0008) [2023-12-26 04:53:55,782][123091] Updated weights for policy 0, policy_version 665186 (0.0009) [2023-12-26 04:53:55,831][123091] Updated weights for policy 0, policy_version 665196 (0.0008) [2023-12-26 04:53:55,837][123090] Updated weights for policy 1, policy_version 660678 (0.0008) [2023-12-26 04:53:55,902][123090] Updated weights for policy 1, policy_version 660688 (0.0010) [2023-12-26 04:53:55,961][123090] Updated weights for policy 1, policy_version 660698 (0.0010) [2023-12-26 04:53:56,608][123091] Updated weights for policy 0, policy_version 665206 (0.0009) [2023-12-26 04:53:56,670][123091] Updated weights for policy 0, policy_version 665216 (0.0011) [2023-12-26 04:53:56,725][123091] Updated weights for policy 0, policy_version 665226 (0.0010) [2023-12-26 04:53:56,808][123090] Updated weights for policy 1, policy_version 660708 (0.0010) [2023-12-26 04:53:56,855][123090] Updated weights for policy 1, policy_version 660718 (0.0010) [2023-12-26 04:53:56,898][123090] Updated weights for policy 1, policy_version 660728 (0.0010) [2023-12-26 04:53:57,554][123091] Updated weights for policy 0, policy_version 665236 (0.0010) [2023-12-26 04:53:57,605][123091] Updated weights for policy 0, policy_version 665246 (0.0010) [2023-12-26 04:53:57,662][123091] Updated weights for policy 0, policy_version 665256 (0.0010) [2023-12-26 04:53:57,684][123090] Updated weights for policy 1, policy_version 660738 (0.0010) [2023-12-26 04:53:57,746][123090] Updated weights for policy 1, policy_version 660748 (0.0010) [2023-12-26 04:53:57,800][123090] Updated weights for policy 1, policy_version 660758 (0.0010) [2023-12-26 04:53:57,861][123090] Updated weights for policy 1, policy_version 660768 (0.0010) [2023-12-26 04:53:58,518][123091] Updated weights for policy 0, policy_version 665266 (0.0009) [2023-12-26 04:53:58,590][123091] Updated weights for policy 0, policy_version 665276 (0.0009) [2023-12-26 04:53:58,652][123091] Updated weights for policy 0, policy_version 665286 (0.0007) [2023-12-26 04:53:58,704][123090] Updated weights for policy 1, policy_version 660778 (0.0009) [2023-12-26 04:53:58,728][123091] Updated weights for policy 0, policy_version 665296 (0.0008) [2023-12-26 04:53:58,772][123090] Updated weights for policy 1, policy_version 660788 (0.0009) [2023-12-26 04:53:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 339476480. Throughput: 0: 8743.3, 1: 8887.5. Samples: 339472296. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:53:58,784][121949] Avg episode reward: [(0, '6190.810'), (1, '4662.830')] [2023-12-26 04:53:58,837][123090] Updated weights for policy 1, policy_version 660798 (0.0009) [2023-12-26 04:53:59,525][123091] Updated weights for policy 0, policy_version 665306 (0.0010) [2023-12-26 04:53:59,583][123091] Updated weights for policy 0, policy_version 665316 (0.0009) [2023-12-26 04:53:59,648][123091] Updated weights for policy 0, policy_version 665326 (0.0009) [2023-12-26 04:53:59,653][123090] Updated weights for policy 1, policy_version 660808 (0.0008) [2023-12-26 04:53:59,705][123090] Updated weights for policy 1, policy_version 660818 (0.0009) [2023-12-26 04:53:59,760][123090] Updated weights for policy 1, policy_version 660828 (0.0010) [2023-12-26 04:54:00,419][123091] Updated weights for policy 0, policy_version 665336 (0.0006) [2023-12-26 04:54:00,478][123091] Updated weights for policy 0, policy_version 665346 (0.0006) [2023-12-26 04:54:00,529][123091] Updated weights for policy 0, policy_version 665356 (0.0009) [2023-12-26 04:54:00,645][123090] Updated weights for policy 1, policy_version 660838 (0.0010) [2023-12-26 04:54:00,714][123090] Updated weights for policy 1, policy_version 660848 (0.0009) [2023-12-26 04:54:00,766][123090] Updated weights for policy 1, policy_version 660858 (0.0010) [2023-12-26 04:54:01,293][123091] Updated weights for policy 0, policy_version 665366 (0.0009) [2023-12-26 04:54:01,359][123091] Updated weights for policy 0, policy_version 665376 (0.0010) [2023-12-26 04:54:01,422][123091] Updated weights for policy 0, policy_version 665386 (0.0009) [2023-12-26 04:54:01,533][123090] Updated weights for policy 1, policy_version 660869 (0.0007) [2023-12-26 04:54:01,608][123090] Updated weights for policy 1, policy_version 660879 (0.0010) [2023-12-26 04:54:01,665][123090] Updated weights for policy 1, policy_version 660889 (0.0009) [2023-12-26 04:54:02,272][123091] Updated weights for policy 0, policy_version 665397 (0.0010) [2023-12-26 04:54:02,324][123091] Updated weights for policy 0, policy_version 665407 (0.0010) [2023-12-26 04:54:02,388][123091] Updated weights for policy 0, policy_version 665417 (0.0008) [2023-12-26 04:54:02,434][123090] Updated weights for policy 1, policy_version 660899 (0.0009) [2023-12-26 04:54:02,493][123090] Updated weights for policy 1, policy_version 660909 (0.0009) [2023-12-26 04:54:02,561][123090] Updated weights for policy 1, policy_version 660919 (0.0006) [2023-12-26 04:54:03,230][123091] Updated weights for policy 0, policy_version 665427 (0.0007) [2023-12-26 04:54:03,284][123091] Updated weights for policy 0, policy_version 665437 (0.0009) [2023-12-26 04:54:03,309][123090] Updated weights for policy 1, policy_version 660929 (0.0006) [2023-12-26 04:54:03,337][123091] Updated weights for policy 0, policy_version 665447 (0.0007) [2023-12-26 04:54:03,379][123090] Updated weights for policy 1, policy_version 660939 (0.0005) [2023-12-26 04:54:03,427][123090] Updated weights for policy 1, policy_version 660949 (0.0005) [2023-12-26 04:54:03,472][123090] Updated weights for policy 1, policy_version 660959 (0.0005) [2023-12-26 04:54:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 339566592. Throughput: 0: 8694.7, 1: 8884.8. Samples: 339578460. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:54:03,784][121949] Avg episode reward: [(0, '6344.079'), (1, '4336.298')] [2023-12-26 04:54:03,987][123091] Updated weights for policy 0, policy_version 665457 (0.0006) [2023-12-26 04:54:04,045][123091] Updated weights for policy 0, policy_version 665467 (0.0007) [2023-12-26 04:54:04,103][123091] Updated weights for policy 0, policy_version 665477 (0.0006) [2023-12-26 04:54:04,168][123091] Updated weights for policy 0, policy_version 665487 (0.0008) [2023-12-26 04:54:04,184][123090] Updated weights for policy 1, policy_version 660969 (0.0008) [2023-12-26 04:54:04,244][123090] Updated weights for policy 1, policy_version 660979 (0.0009) [2023-12-26 04:54:04,303][123090] Updated weights for policy 1, policy_version 660989 (0.0008) [2023-12-26 04:54:04,891][123091] Updated weights for policy 0, policy_version 665497 (0.0006) [2023-12-26 04:54:04,942][123091] Updated weights for policy 0, policy_version 665507 (0.0008) [2023-12-26 04:54:04,992][123091] Updated weights for policy 0, policy_version 665517 (0.0009) [2023-12-26 04:54:05,180][123090] Updated weights for policy 1, policy_version 660999 (0.0009) [2023-12-26 04:54:05,233][123090] Updated weights for policy 1, policy_version 661009 (0.0007) [2023-12-26 04:54:05,300][123090] Updated weights for policy 1, policy_version 661019 (0.0006) [2023-12-26 04:54:05,795][123091] Updated weights for policy 0, policy_version 665527 (0.0006) [2023-12-26 04:54:05,843][123091] Updated weights for policy 0, policy_version 665537 (0.0006) [2023-12-26 04:54:05,892][123091] Updated weights for policy 0, policy_version 665547 (0.0009) [2023-12-26 04:54:06,148][123090] Updated weights for policy 1, policy_version 661029 (0.0010) [2023-12-26 04:54:06,211][123090] Updated weights for policy 1, policy_version 661039 (0.0010) [2023-12-26 04:54:06,270][123090] Updated weights for policy 1, policy_version 661049 (0.0009) [2023-12-26 04:54:06,722][123091] Updated weights for policy 0, policy_version 665557 (0.0009) [2023-12-26 04:54:06,776][123091] Updated weights for policy 0, policy_version 665567 (0.0010) [2023-12-26 04:54:06,836][123091] Updated weights for policy 0, policy_version 665577 (0.0009) [2023-12-26 04:54:07,058][123090] Updated weights for policy 1, policy_version 661059 (0.0007) [2023-12-26 04:54:07,139][123090] Updated weights for policy 1, policy_version 661069 (0.0005) [2023-12-26 04:54:07,205][123090] Updated weights for policy 1, policy_version 661079 (0.0006) [2023-12-26 04:54:07,755][123091] Updated weights for policy 0, policy_version 665587 (0.0010) [2023-12-26 04:54:07,815][123091] Updated weights for policy 0, policy_version 665597 (0.0009) [2023-12-26 04:54:07,863][123091] Updated weights for policy 0, policy_version 665607 (0.0009) [2023-12-26 04:54:07,880][123090] Updated weights for policy 1, policy_version 661089 (0.0009) [2023-12-26 04:54:07,929][123090] Updated weights for policy 1, policy_version 661099 (0.0007) [2023-12-26 04:54:07,978][123090] Updated weights for policy 1, policy_version 661109 (0.0008) [2023-12-26 04:54:08,035][123090] Updated weights for policy 1, policy_version 661120 (0.0009) [2023-12-26 04:54:08,737][123091] Updated weights for policy 0, policy_version 665617 (0.0008) [2023-12-26 04:54:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 339648512. Throughput: 0: 8758.6, 1: 8882.3. Samples: 339631428. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:54:08,785][121949] Avg episode reward: [(0, '6326.089'), (1, '4277.056')] [2023-12-26 04:54:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000661120_169246720.pth... [2023-12-26 04:54:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000660096_168984576.pth [2023-12-26 04:54:08,799][123091] Updated weights for policy 0, policy_version 665627 (0.0010) [2023-12-26 04:54:08,862][123091] Updated weights for policy 0, policy_version 665637 (0.0009) [2023-12-26 04:54:08,884][123090] Updated weights for policy 1, policy_version 661130 (0.0008) [2023-12-26 04:54:08,925][123091] Updated weights for policy 0, policy_version 665647 (0.0008) [2023-12-26 04:54:08,930][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000665648_170409984.pth... [2023-12-26 04:54:08,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000664624_170147840.pth [2023-12-26 04:54:08,941][123090] Updated weights for policy 1, policy_version 661140 (0.0007) [2023-12-26 04:54:08,992][123090] Updated weights for policy 1, policy_version 661150 (0.0009) [2023-12-26 04:54:09,791][123091] Updated weights for policy 0, policy_version 665657 (0.0006) [2023-12-26 04:54:09,833][123090] Updated weights for policy 1, policy_version 661160 (0.0009) [2023-12-26 04:54:09,859][123091] Updated weights for policy 0, policy_version 665667 (0.0007) [2023-12-26 04:54:09,897][123090] Updated weights for policy 1, policy_version 661170 (0.0008) [2023-12-26 04:54:09,921][123091] Updated weights for policy 0, policy_version 665677 (0.0008) [2023-12-26 04:54:09,962][123090] Updated weights for policy 1, policy_version 661180 (0.0009) [2023-12-26 04:54:10,743][123091] Updated weights for policy 0, policy_version 665687 (0.0010) [2023-12-26 04:54:10,789][123090] Updated weights for policy 1, policy_version 661190 (0.0008) [2023-12-26 04:54:10,799][123091] Updated weights for policy 0, policy_version 665697 (0.0009) [2023-12-26 04:54:10,841][123090] Updated weights for policy 1, policy_version 661200 (0.0007) [2023-12-26 04:54:10,861][123091] Updated weights for policy 0, policy_version 665707 (0.0010) [2023-12-26 04:54:10,905][123090] Updated weights for policy 1, policy_version 661210 (0.0007) [2023-12-26 04:54:11,648][123091] Updated weights for policy 0, policy_version 665717 (0.0009) [2023-12-26 04:54:11,712][123091] Updated weights for policy 0, policy_version 665727 (0.0008) [2023-12-26 04:54:11,787][123091] Updated weights for policy 0, policy_version 665737 (0.0009) [2023-12-26 04:54:11,797][123090] Updated weights for policy 1, policy_version 661220 (0.0010) [2023-12-26 04:54:11,859][123090] Updated weights for policy 1, policy_version 661230 (0.0008) [2023-12-26 04:54:11,918][123090] Updated weights for policy 1, policy_version 661240 (0.0010) [2023-12-26 04:54:12,582][123091] Updated weights for policy 0, policy_version 665747 (0.0009) [2023-12-26 04:54:12,653][123091] Updated weights for policy 0, policy_version 665757 (0.0009) [2023-12-26 04:54:12,716][123090] Updated weights for policy 1, policy_version 661250 (0.0007) [2023-12-26 04:54:12,720][123091] Updated weights for policy 0, policy_version 665767 (0.0009) [2023-12-26 04:54:12,779][123090] Updated weights for policy 1, policy_version 661260 (0.0008) [2023-12-26 04:54:12,844][123090] Updated weights for policy 1, policy_version 661270 (0.0008) [2023-12-26 04:54:12,912][123090] Updated weights for policy 1, policy_version 661280 (0.0008) [2023-12-26 04:54:13,539][123091] Updated weights for policy 0, policy_version 665777 (0.0008) [2023-12-26 04:54:13,594][123091] Updated weights for policy 0, policy_version 665787 (0.0010) [2023-12-26 04:54:13,638][123090] Updated weights for policy 1, policy_version 661290 (0.0006) [2023-12-26 04:54:13,642][123091] Updated weights for policy 0, policy_version 665797 (0.0010) [2023-12-26 04:54:13,694][123091] Updated weights for policy 0, policy_version 665807 (0.0010) [2023-12-26 04:54:13,709][123090] Updated weights for policy 1, policy_version 661300 (0.0006) [2023-12-26 04:54:13,780][123090] Updated weights for policy 1, policy_version 661310 (0.0005) [2023-12-26 04:54:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 339738624. Throughput: 0: 8707.1, 1: 8842.9. Samples: 339733868. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:54:13,785][121949] Avg episode reward: [(0, '6265.767'), (1, '3990.433')] [2023-12-26 04:54:14,439][123090] Updated weights for policy 1, policy_version 661320 (0.0008) [2023-12-26 04:54:14,450][123091] Updated weights for policy 0, policy_version 665817 (0.0009) [2023-12-26 04:54:14,499][123090] Updated weights for policy 1, policy_version 661330 (0.0008) [2023-12-26 04:54:14,501][123091] Updated weights for policy 0, policy_version 665827 (0.0009) [2023-12-26 04:54:14,561][123090] Updated weights for policy 1, policy_version 661340 (0.0007) [2023-12-26 04:54:14,563][123091] Updated weights for policy 0, policy_version 665837 (0.0009) [2023-12-26 04:54:15,262][123090] Updated weights for policy 1, policy_version 661350 (0.0009) [2023-12-26 04:54:15,327][123090] Updated weights for policy 1, policy_version 661360 (0.0009) [2023-12-26 04:54:15,398][123090] Updated weights for policy 1, policy_version 661370 (0.0009) [2023-12-26 04:54:15,465][123091] Updated weights for policy 0, policy_version 665847 (0.0006) [2023-12-26 04:54:15,527][123091] Updated weights for policy 0, policy_version 665857 (0.0009) [2023-12-26 04:54:15,584][123091] Updated weights for policy 0, policy_version 665867 (0.0010) [2023-12-26 04:54:16,254][123090] Updated weights for policy 1, policy_version 661380 (0.0010) [2023-12-26 04:54:16,316][123090] Updated weights for policy 1, policy_version 661390 (0.0010) [2023-12-26 04:54:16,368][123090] Updated weights for policy 1, policy_version 661400 (0.0009) [2023-12-26 04:54:16,371][123091] Updated weights for policy 0, policy_version 665877 (0.0008) [2023-12-26 04:54:16,434][123091] Updated weights for policy 0, policy_version 665887 (0.0007) [2023-12-26 04:54:16,505][123091] Updated weights for policy 0, policy_version 665897 (0.0009) [2023-12-26 04:54:17,236][123090] Updated weights for policy 1, policy_version 661410 (0.0008) [2023-12-26 04:54:17,286][123090] Updated weights for policy 1, policy_version 661420 (0.0009) [2023-12-26 04:54:17,305][123091] Updated weights for policy 0, policy_version 665907 (0.0008) [2023-12-26 04:54:17,341][123090] Updated weights for policy 1, policy_version 661430 (0.0009) [2023-12-26 04:54:17,358][123091] Updated weights for policy 0, policy_version 665917 (0.0007) [2023-12-26 04:54:17,395][123090] Updated weights for policy 1, policy_version 661440 (0.0009) [2023-12-26 04:54:17,425][123091] Updated weights for policy 0, policy_version 665927 (0.0006) [2023-12-26 04:54:18,211][123091] Updated weights for policy 0, policy_version 665937 (0.0006) [2023-12-26 04:54:18,264][123090] Updated weights for policy 1, policy_version 661450 (0.0009) [2023-12-26 04:54:18,281][123091] Updated weights for policy 0, policy_version 665947 (0.0008) [2023-12-26 04:54:18,314][123090] Updated weights for policy 1, policy_version 661460 (0.0008) [2023-12-26 04:54:18,346][123091] Updated weights for policy 0, policy_version 665957 (0.0010) [2023-12-26 04:54:18,374][123090] Updated weights for policy 1, policy_version 661470 (0.0009) [2023-12-26 04:54:18,410][123091] Updated weights for policy 0, policy_version 665967 (0.0009) [2023-12-26 04:54:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 339828736. Throughput: 0: 8710.9, 1: 8804.2. Samples: 339839496. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:54:18,785][121949] Avg episode reward: [(0, '6205.631'), (1, '3557.132')] [2023-12-26 04:54:19,061][123090] Updated weights for policy 1, policy_version 661480 (0.0006) [2023-12-26 04:54:19,129][123090] Updated weights for policy 1, policy_version 661490 (0.0005) [2023-12-26 04:54:19,180][123091] Updated weights for policy 0, policy_version 665977 (0.0006) [2023-12-26 04:54:19,186][123090] Updated weights for policy 1, policy_version 661500 (0.0005) [2023-12-26 04:54:19,259][123091] Updated weights for policy 0, policy_version 665987 (0.0008) [2023-12-26 04:54:19,333][123091] Updated weights for policy 0, policy_version 665997 (0.0007) [2023-12-26 04:54:19,982][123090] Updated weights for policy 1, policy_version 661510 (0.0007) [2023-12-26 04:54:20,055][123090] Updated weights for policy 1, policy_version 661520 (0.0007) [2023-12-26 04:54:20,097][123091] Updated weights for policy 0, policy_version 666007 (0.0011) [2023-12-26 04:54:20,122][123090] Updated weights for policy 1, policy_version 661530 (0.0008) [2023-12-26 04:54:20,157][123091] Updated weights for policy 0, policy_version 666017 (0.0011) [2023-12-26 04:54:20,229][123091] Updated weights for policy 0, policy_version 666027 (0.0011) [2023-12-26 04:54:20,850][123090] Updated weights for policy 1, policy_version 661540 (0.0009) [2023-12-26 04:54:20,912][123090] Updated weights for policy 1, policy_version 661550 (0.0009) [2023-12-26 04:54:20,976][123090] Updated weights for policy 1, policy_version 661560 (0.0009) [2023-12-26 04:54:21,042][123091] Updated weights for policy 0, policy_version 666037 (0.0010) [2023-12-26 04:54:21,108][123091] Updated weights for policy 0, policy_version 666047 (0.0009) [2023-12-26 04:54:21,168][123091] Updated weights for policy 0, policy_version 666057 (0.0009) [2023-12-26 04:54:21,815][123090] Updated weights for policy 1, policy_version 661570 (0.0008) [2023-12-26 04:54:21,867][123090] Updated weights for policy 1, policy_version 661580 (0.0005) [2023-12-26 04:54:21,928][123090] Updated weights for policy 1, policy_version 661590 (0.0005) [2023-12-26 04:54:21,983][123090] Updated weights for policy 1, policy_version 661600 (0.0005) [2023-12-26 04:54:22,079][123091] Updated weights for policy 0, policy_version 666067 (0.0009) [2023-12-26 04:54:22,150][123091] Updated weights for policy 0, policy_version 666077 (0.0010) [2023-12-26 04:54:22,213][123091] Updated weights for policy 0, policy_version 666087 (0.0010) [2023-12-26 04:54:22,782][123090] Updated weights for policy 1, policy_version 661610 (0.0007) [2023-12-26 04:54:22,851][123090] Updated weights for policy 1, policy_version 661620 (0.0005) [2023-12-26 04:54:22,911][123090] Updated weights for policy 1, policy_version 661630 (0.0005) [2023-12-26 04:54:23,066][123091] Updated weights for policy 0, policy_version 666097 (0.0010) [2023-12-26 04:54:23,127][123091] Updated weights for policy 0, policy_version 666107 (0.0005) [2023-12-26 04:54:23,182][123091] Updated weights for policy 0, policy_version 666117 (0.0005) [2023-12-26 04:54:23,249][123091] Updated weights for policy 0, policy_version 666127 (0.0005) [2023-12-26 04:54:23,580][123090] Updated weights for policy 1, policy_version 661640 (0.0005) [2023-12-26 04:54:23,631][123090] Updated weights for policy 1, policy_version 661650 (0.0005) [2023-12-26 04:54:23,685][123090] Updated weights for policy 1, policy_version 661660 (0.0005) [2023-12-26 04:54:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 339918848. Throughput: 0: 8726.9, 1: 8822.6. Samples: 339892464. Policy #0 lag: (min: 22.0, avg: 25.4, max: 54.0) [2023-12-26 04:54:23,785][121949] Avg episode reward: [(0, '6131.131'), (1, '3672.194')] [2023-12-26 04:54:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000661664_169385984.pth... [2023-12-26 04:54:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000666128_170532864.pth... [2023-12-26 04:54:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000660608_169115648.pth [2023-12-26 04:54:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000665104_170270720.pth [2023-12-26 04:54:23,873][123091] Updated weights for policy 0, policy_version 666137 (0.0005) [2023-12-26 04:54:23,932][123091] Updated weights for policy 0, policy_version 666147 (0.0005) [2023-12-26 04:54:23,987][123091] Updated weights for policy 0, policy_version 666157 (0.0005) [2023-12-26 04:54:24,381][123090] Updated weights for policy 1, policy_version 661670 (0.0005) [2023-12-26 04:54:24,449][123090] Updated weights for policy 1, policy_version 661680 (0.0006) [2023-12-26 04:54:24,522][123090] Updated weights for policy 1, policy_version 661690 (0.0005) [2023-12-26 04:54:24,585][123091] Updated weights for policy 0, policy_version 666167 (0.0005) [2023-12-26 04:54:24,638][123091] Updated weights for policy 0, policy_version 666177 (0.0009) [2023-12-26 04:54:24,700][123091] Updated weights for policy 0, policy_version 666187 (0.0009) [2023-12-26 04:54:25,243][123090] Updated weights for policy 1, policy_version 661700 (0.0007) [2023-12-26 04:54:25,293][123090] Updated weights for policy 1, policy_version 661710 (0.0009) [2023-12-26 04:54:25,346][123090] Updated weights for policy 1, policy_version 661720 (0.0009) [2023-12-26 04:54:25,517][123091] Updated weights for policy 0, policy_version 666197 (0.0010) [2023-12-26 04:54:25,566][123091] Updated weights for policy 0, policy_version 666207 (0.0009) [2023-12-26 04:54:25,618][123091] Updated weights for policy 0, policy_version 666218 (0.0010) [2023-12-26 04:54:26,181][123090] Updated weights for policy 1, policy_version 661730 (0.0008) [2023-12-26 04:54:26,237][123090] Updated weights for policy 1, policy_version 661740 (0.0007) [2023-12-26 04:54:26,302][123090] Updated weights for policy 1, policy_version 661750 (0.0009) [2023-12-26 04:54:26,374][123090] Updated weights for policy 1, policy_version 661760 (0.0007) [2023-12-26 04:54:26,436][123091] Updated weights for policy 0, policy_version 666228 (0.0009) [2023-12-26 04:54:26,494][123091] Updated weights for policy 0, policy_version 666238 (0.0007) [2023-12-26 04:54:26,554][123091] Updated weights for policy 0, policy_version 666248 (0.0005) [2023-12-26 04:54:27,124][123090] Updated weights for policy 1, policy_version 661770 (0.0010) [2023-12-26 04:54:27,171][123090] Updated weights for policy 1, policy_version 661780 (0.0010) [2023-12-26 04:54:27,221][123091] Updated weights for policy 0, policy_version 666258 (0.0006) [2023-12-26 04:54:27,220][123090] Updated weights for policy 1, policy_version 661790 (0.0010) [2023-12-26 04:54:27,268][123091] Updated weights for policy 0, policy_version 666268 (0.0005) [2023-12-26 04:54:27,324][123091] Updated weights for policy 0, policy_version 666278 (0.0008) [2023-12-26 04:54:27,380][123091] Updated weights for policy 0, policy_version 666288 (0.0010) [2023-12-26 04:54:27,952][123090] Updated weights for policy 1, policy_version 661800 (0.0006) [2023-12-26 04:54:28,014][123090] Updated weights for policy 1, policy_version 661810 (0.0005) [2023-12-26 04:54:28,050][123091] Updated weights for policy 0, policy_version 666298 (0.0005) [2023-12-26 04:54:28,079][123090] Updated weights for policy 1, policy_version 661820 (0.0005) [2023-12-26 04:54:28,094][123091] Updated weights for policy 0, policy_version 666308 (0.0005) [2023-12-26 04:54:28,151][123091] Updated weights for policy 0, policy_version 666318 (0.0005) [2023-12-26 04:54:28,721][123090] Updated weights for policy 1, policy_version 661830 (0.0005) [2023-12-26 04:54:28,769][123090] Updated weights for policy 1, policy_version 661840 (0.0005) [2023-12-26 04:54:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 340008960. Throughput: 0: 8792.1, 1: 8935.6. Samples: 340005104. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:28,785][121949] Avg episode reward: [(0, '6090.676'), (1, '3839.849')] [2023-12-26 04:54:28,834][123090] Updated weights for policy 1, policy_version 661850 (0.0006) [2023-12-26 04:54:28,861][123091] Updated weights for policy 0, policy_version 666328 (0.0007) [2023-12-26 04:54:28,924][123091] Updated weights for policy 0, policy_version 666338 (0.0009) [2023-12-26 04:54:28,992][123091] Updated weights for policy 0, policy_version 666348 (0.0008) [2023-12-26 04:54:29,570][123090] Updated weights for policy 1, policy_version 661860 (0.0008) [2023-12-26 04:54:29,627][123090] Updated weights for policy 1, policy_version 661870 (0.0005) [2023-12-26 04:54:29,687][123090] Updated weights for policy 1, policy_version 661880 (0.0005) [2023-12-26 04:54:29,740][123091] Updated weights for policy 0, policy_version 666359 (0.0009) [2023-12-26 04:54:29,797][123091] Updated weights for policy 0, policy_version 666369 (0.0010) [2023-12-26 04:54:29,859][123091] Updated weights for policy 0, policy_version 666379 (0.0008) [2023-12-26 04:54:30,465][123090] Updated weights for policy 1, policy_version 661890 (0.0007) [2023-12-26 04:54:30,535][123090] Updated weights for policy 1, policy_version 661900 (0.0010) [2023-12-26 04:54:30,592][123090] Updated weights for policy 1, policy_version 661910 (0.0009) [2023-12-26 04:54:30,650][123090] Updated weights for policy 1, policy_version 661920 (0.0009) [2023-12-26 04:54:30,655][123091] Updated weights for policy 0, policy_version 666389 (0.0008) [2023-12-26 04:54:30,706][123091] Updated weights for policy 0, policy_version 666399 (0.0008) [2023-12-26 04:54:30,761][123091] Updated weights for policy 0, policy_version 666409 (0.0010) [2023-12-26 04:54:31,465][123090] Updated weights for policy 1, policy_version 661930 (0.0009) [2023-12-26 04:54:31,538][123091] Updated weights for policy 0, policy_version 666419 (0.0007) [2023-12-26 04:54:31,539][123090] Updated weights for policy 1, policy_version 661940 (0.0009) [2023-12-26 04:54:31,590][123091] Updated weights for policy 0, policy_version 666429 (0.0006) [2023-12-26 04:54:31,598][123090] Updated weights for policy 1, policy_version 661950 (0.0009) [2023-12-26 04:54:31,657][123091] Updated weights for policy 0, policy_version 666439 (0.0009) [2023-12-26 04:54:32,420][123090] Updated weights for policy 1, policy_version 661960 (0.0010) [2023-12-26 04:54:32,479][123090] Updated weights for policy 1, policy_version 661970 (0.0009) [2023-12-26 04:54:32,511][123091] Updated weights for policy 0, policy_version 666449 (0.0008) [2023-12-26 04:54:32,536][123090] Updated weights for policy 1, policy_version 661980 (0.0009) [2023-12-26 04:54:32,569][123091] Updated weights for policy 0, policy_version 666459 (0.0008) [2023-12-26 04:54:32,617][123091] Updated weights for policy 0, policy_version 666469 (0.0009) [2023-12-26 04:54:32,663][123091] Updated weights for policy 0, policy_version 666479 (0.0009) [2023-12-26 04:54:33,316][123090] Updated weights for policy 1, policy_version 661990 (0.0008) [2023-12-26 04:54:33,381][123090] Updated weights for policy 1, policy_version 662000 (0.0009) [2023-12-26 04:54:33,448][123090] Updated weights for policy 1, policy_version 662010 (0.0009) [2023-12-26 04:54:33,519][123091] Updated weights for policy 0, policy_version 666489 (0.0008) [2023-12-26 04:54:33,569][123091] Updated weights for policy 0, policy_version 666500 (0.0009) [2023-12-26 04:54:33,620][123091] Updated weights for policy 0, policy_version 666511 (0.0009) [2023-12-26 04:54:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 340107264. Throughput: 0: 8808.5, 1: 8936.5. Samples: 340114500. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:33,785][121949] Avg episode reward: [(0, '6141.034'), (1, '4399.328')] [2023-12-26 04:54:34,258][123090] Updated weights for policy 1, policy_version 662020 (0.0009) [2023-12-26 04:54:34,323][123090] Updated weights for policy 1, policy_version 662030 (0.0009) [2023-12-26 04:54:34,388][123090] Updated weights for policy 1, policy_version 662040 (0.0009) [2023-12-26 04:54:34,478][123091] Updated weights for policy 0, policy_version 666521 (0.0009) [2023-12-26 04:54:34,544][123091] Updated weights for policy 0, policy_version 666531 (0.0010) [2023-12-26 04:54:34,596][123091] Updated weights for policy 0, policy_version 666541 (0.0010) [2023-12-26 04:54:35,113][123090] Updated weights for policy 1, policy_version 662050 (0.0009) [2023-12-26 04:54:35,180][123090] Updated weights for policy 1, policy_version 662060 (0.0005) [2023-12-26 04:54:35,243][123090] Updated weights for policy 1, policy_version 662070 (0.0007) [2023-12-26 04:54:35,311][123090] Updated weights for policy 1, policy_version 662080 (0.0009) [2023-12-26 04:54:35,463][123091] Updated weights for policy 0, policy_version 666551 (0.0010) [2023-12-26 04:54:35,515][123091] Updated weights for policy 0, policy_version 666561 (0.0008) [2023-12-26 04:54:35,565][123091] Updated weights for policy 0, policy_version 666571 (0.0009) [2023-12-26 04:54:36,069][123090] Updated weights for policy 1, policy_version 662090 (0.0009) [2023-12-26 04:54:36,137][123090] Updated weights for policy 1, policy_version 662100 (0.0009) [2023-12-26 04:54:36,200][123090] Updated weights for policy 1, policy_version 662110 (0.0009) [2023-12-26 04:54:36,426][123091] Updated weights for policy 0, policy_version 666581 (0.0008) [2023-12-26 04:54:36,481][123091] Updated weights for policy 0, policy_version 666591 (0.0010) [2023-12-26 04:54:36,538][123091] Updated weights for policy 0, policy_version 666601 (0.0011) [2023-12-26 04:54:37,046][123090] Updated weights for policy 1, policy_version 662120 (0.0009) [2023-12-26 04:54:37,094][123090] Updated weights for policy 1, policy_version 662130 (0.0009) [2023-12-26 04:54:37,150][123090] Updated weights for policy 1, policy_version 662140 (0.0009) [2023-12-26 04:54:37,396][123091] Updated weights for policy 0, policy_version 666611 (0.0011) [2023-12-26 04:54:37,466][123091] Updated weights for policy 0, policy_version 666621 (0.0011) [2023-12-26 04:54:37,528][123091] Updated weights for policy 0, policy_version 666631 (0.0011) [2023-12-26 04:54:37,958][123090] Updated weights for policy 1, policy_version 662150 (0.0009) [2023-12-26 04:54:38,018][123090] Updated weights for policy 1, policy_version 662160 (0.0009) [2023-12-26 04:54:38,079][123090] Updated weights for policy 1, policy_version 662170 (0.0007) [2023-12-26 04:54:38,332][123091] Updated weights for policy 0, policy_version 666641 (0.0011) [2023-12-26 04:54:38,389][123091] Updated weights for policy 0, policy_version 666651 (0.0011) [2023-12-26 04:54:38,445][123091] Updated weights for policy 0, policy_version 666661 (0.0011) [2023-12-26 04:54:38,507][123091] Updated weights for policy 0, policy_version 666671 (0.0011) [2023-12-26 04:54:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 340189184. Throughput: 0: 8818.1, 1: 8951.9. Samples: 340166412. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:38,785][121949] Avg episode reward: [(0, '6246.064'), (1, '4276.802')] [2023-12-26 04:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000666672_170672128.pth... [2023-12-26 04:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000662176_169517056.pth... [2023-12-26 04:54:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000665648_170409984.pth [2023-12-26 04:54:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000661120_169246720.pth [2023-12-26 04:54:38,874][123090] Updated weights for policy 1, policy_version 662180 (0.0007) [2023-12-26 04:54:38,936][123090] Updated weights for policy 1, policy_version 662190 (0.0010) [2023-12-26 04:54:39,001][123090] Updated weights for policy 1, policy_version 662200 (0.0009) [2023-12-26 04:54:39,288][123091] Updated weights for policy 0, policy_version 666681 (0.0010) [2023-12-26 04:54:39,357][123091] Updated weights for policy 0, policy_version 666691 (0.0011) [2023-12-26 04:54:39,425][123091] Updated weights for policy 0, policy_version 666701 (0.0011) [2023-12-26 04:54:39,898][123090] Updated weights for policy 1, policy_version 662210 (0.0010) [2023-12-26 04:54:39,968][123090] Updated weights for policy 1, policy_version 662220 (0.0008) [2023-12-26 04:54:40,035][123090] Updated weights for policy 1, policy_version 662230 (0.0008) [2023-12-26 04:54:40,113][123090] Updated weights for policy 1, policy_version 662240 (0.0008) [2023-12-26 04:54:40,253][123091] Updated weights for policy 0, policy_version 666711 (0.0007) [2023-12-26 04:54:40,330][123091] Updated weights for policy 0, policy_version 666721 (0.0007) [2023-12-26 04:54:40,390][123091] Updated weights for policy 0, policy_version 666731 (0.0010) [2023-12-26 04:54:40,923][123090] Updated weights for policy 1, policy_version 662250 (0.0010) [2023-12-26 04:54:40,977][123090] Updated weights for policy 1, policy_version 662260 (0.0010) [2023-12-26 04:54:41,043][123090] Updated weights for policy 1, policy_version 662270 (0.0009) [2023-12-26 04:54:41,065][123091] Updated weights for policy 0, policy_version 666741 (0.0008) [2023-12-26 04:54:41,153][123091] Updated weights for policy 0, policy_version 666751 (0.0010) [2023-12-26 04:54:41,214][123091] Updated weights for policy 0, policy_version 666761 (0.0009) [2023-12-26 04:54:41,930][123090] Updated weights for policy 1, policy_version 662280 (0.0010) [2023-12-26 04:54:41,992][123090] Updated weights for policy 1, policy_version 662290 (0.0009) [2023-12-26 04:54:42,037][123091] Updated weights for policy 0, policy_version 666771 (0.0009) [2023-12-26 04:54:42,059][123090] Updated weights for policy 1, policy_version 662300 (0.0009) [2023-12-26 04:54:42,089][123091] Updated weights for policy 0, policy_version 666781 (0.0009) [2023-12-26 04:54:42,155][123091] Updated weights for policy 0, policy_version 666791 (0.0009) [2023-12-26 04:54:42,873][123090] Updated weights for policy 1, policy_version 662310 (0.0005) [2023-12-26 04:54:42,935][123090] Updated weights for policy 1, policy_version 662320 (0.0005) [2023-12-26 04:54:42,989][123090] Updated weights for policy 1, policy_version 662330 (0.0006) [2023-12-26 04:54:42,995][123091] Updated weights for policy 0, policy_version 666801 (0.0010) [2023-12-26 04:54:43,046][123091] Updated weights for policy 0, policy_version 666811 (0.0008) [2023-12-26 04:54:43,095][123091] Updated weights for policy 0, policy_version 666821 (0.0009) [2023-12-26 04:54:43,156][123091] Updated weights for policy 0, policy_version 666831 (0.0009) [2023-12-26 04:54:43,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 340271104. Throughput: 0: 8812.1, 1: 8892.3. Samples: 340268992. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:43,784][121949] Avg episode reward: [(0, '6209.725'), (1, '4224.540')] [2023-12-26 04:54:43,802][123090] Updated weights for policy 1, policy_version 662340 (0.0011) [2023-12-26 04:54:43,853][123090] Updated weights for policy 1, policy_version 662350 (0.0010) [2023-12-26 04:54:43,912][123090] Updated weights for policy 1, policy_version 662360 (0.0010) [2023-12-26 04:54:43,926][123091] Updated weights for policy 0, policy_version 666841 (0.0006) [2023-12-26 04:54:43,973][123091] Updated weights for policy 0, policy_version 666851 (0.0005) [2023-12-26 04:54:44,023][123091] Updated weights for policy 0, policy_version 666861 (0.0005) [2023-12-26 04:54:44,750][123090] Updated weights for policy 1, policy_version 662370 (0.0010) [2023-12-26 04:54:44,793][123091] Updated weights for policy 0, policy_version 666871 (0.0008) [2023-12-26 04:54:44,811][123090] Updated weights for policy 1, policy_version 662380 (0.0011) [2023-12-26 04:54:44,855][123091] Updated weights for policy 0, policy_version 666881 (0.0008) [2023-12-26 04:54:44,868][123090] Updated weights for policy 1, policy_version 662390 (0.0009) [2023-12-26 04:54:44,918][123091] Updated weights for policy 0, policy_version 666891 (0.0007) [2023-12-26 04:54:44,924][123090] Updated weights for policy 1, policy_version 662400 (0.0010) [2023-12-26 04:54:45,699][123091] Updated weights for policy 0, policy_version 666901 (0.0007) [2023-12-26 04:54:45,752][123091] Updated weights for policy 0, policy_version 666911 (0.0005) [2023-12-26 04:54:45,760][123090] Updated weights for policy 1, policy_version 662410 (0.0011) [2023-12-26 04:54:45,805][123091] Updated weights for policy 0, policy_version 666921 (0.0006) [2023-12-26 04:54:45,824][123090] Updated weights for policy 1, policy_version 662420 (0.0011) [2023-12-26 04:54:45,891][123090] Updated weights for policy 1, policy_version 662430 (0.0011) [2023-12-26 04:54:46,551][123091] Updated weights for policy 0, policy_version 666931 (0.0006) [2023-12-26 04:54:46,622][123091] Updated weights for policy 0, policy_version 666941 (0.0006) [2023-12-26 04:54:46,692][123091] Updated weights for policy 0, policy_version 666951 (0.0006) [2023-12-26 04:54:46,715][123090] Updated weights for policy 1, policy_version 662440 (0.0010) [2023-12-26 04:54:46,783][123090] Updated weights for policy 1, policy_version 662450 (0.0011) [2023-12-26 04:54:46,854][123090] Updated weights for policy 1, policy_version 662460 (0.0011) [2023-12-26 04:54:47,354][123091] Updated weights for policy 0, policy_version 666961 (0.0006) [2023-12-26 04:54:47,417][123091] Updated weights for policy 0, policy_version 666971 (0.0007) [2023-12-26 04:54:47,481][123091] Updated weights for policy 0, policy_version 666981 (0.0005) [2023-12-26 04:54:47,548][123091] Updated weights for policy 0, policy_version 666991 (0.0008) [2023-12-26 04:54:47,659][123090] Updated weights for policy 1, policy_version 662470 (0.0011) [2023-12-26 04:54:47,711][123090] Updated weights for policy 1, policy_version 662480 (0.0010) [2023-12-26 04:54:47,763][123090] Updated weights for policy 1, policy_version 662490 (0.0010) [2023-12-26 04:54:48,310][123091] Updated weights for policy 0, policy_version 667001 (0.0011) [2023-12-26 04:54:48,384][123091] Updated weights for policy 0, policy_version 667011 (0.0010) [2023-12-26 04:54:48,457][123091] Updated weights for policy 0, policy_version 667021 (0.0007) [2023-12-26 04:54:48,500][123090] Updated weights for policy 1, policy_version 662500 (0.0008) [2023-12-26 04:54:48,571][123090] Updated weights for policy 1, policy_version 662510 (0.0005) [2023-12-26 04:54:48,638][123090] Updated weights for policy 1, policy_version 662520 (0.0005) [2023-12-26 04:54:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 340369408. Throughput: 0: 8874.2, 1: 8871.8. Samples: 340377032. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:48,785][121949] Avg episode reward: [(0, '6065.670'), (1, '4475.658')] [2023-12-26 04:54:49,236][123091] Updated weights for policy 0, policy_version 667031 (0.0009) [2023-12-26 04:54:49,300][123091] Updated weights for policy 0, policy_version 667041 (0.0009) [2023-12-26 04:54:49,312][123090] Updated weights for policy 1, policy_version 662530 (0.0009) [2023-12-26 04:54:49,371][123091] Updated weights for policy 0, policy_version 667051 (0.0008) [2023-12-26 04:54:49,382][123090] Updated weights for policy 1, policy_version 662540 (0.0011) [2023-12-26 04:54:49,453][123090] Updated weights for policy 1, policy_version 662550 (0.0010) [2023-12-26 04:54:49,522][123090] Updated weights for policy 1, policy_version 662560 (0.0010) [2023-12-26 04:54:50,185][123091] Updated weights for policy 0, policy_version 667061 (0.0009) [2023-12-26 04:54:50,239][123091] Updated weights for policy 0, policy_version 667071 (0.0009) [2023-12-26 04:54:50,271][123090] Updated weights for policy 1, policy_version 662570 (0.0009) [2023-12-26 04:54:50,306][123091] Updated weights for policy 0, policy_version 667081 (0.0008) [2023-12-26 04:54:50,325][123090] Updated weights for policy 1, policy_version 662580 (0.0009) [2023-12-26 04:54:50,388][123090] Updated weights for policy 1, policy_version 662590 (0.0010) [2023-12-26 04:54:51,072][123091] Updated weights for policy 0, policy_version 667091 (0.0008) [2023-12-26 04:54:51,134][123091] Updated weights for policy 0, policy_version 667101 (0.0009) [2023-12-26 04:54:51,202][123091] Updated weights for policy 0, policy_version 667111 (0.0010) [2023-12-26 04:54:51,261][123090] Updated weights for policy 1, policy_version 662600 (0.0008) [2023-12-26 04:54:51,328][123090] Updated weights for policy 1, policy_version 662610 (0.0008) [2023-12-26 04:54:51,397][123090] Updated weights for policy 1, policy_version 662620 (0.0008) [2023-12-26 04:54:52,009][123091] Updated weights for policy 0, policy_version 667121 (0.0009) [2023-12-26 04:54:52,077][123091] Updated weights for policy 0, policy_version 667131 (0.0005) [2023-12-26 04:54:52,148][123091] Updated weights for policy 0, policy_version 667141 (0.0007) [2023-12-26 04:54:52,160][123090] Updated weights for policy 1, policy_version 662630 (0.0010) [2023-12-26 04:54:52,218][123091] Updated weights for policy 0, policy_version 667151 (0.0007) [2023-12-26 04:54:52,223][123090] Updated weights for policy 1, policy_version 662640 (0.0010) [2023-12-26 04:54:52,289][123090] Updated weights for policy 1, policy_version 662650 (0.0011) [2023-12-26 04:54:52,904][123091] Updated weights for policy 0, policy_version 667161 (0.0005) [2023-12-26 04:54:52,949][123091] Updated weights for policy 0, policy_version 667171 (0.0005) [2023-12-26 04:54:53,007][123091] Updated weights for policy 0, policy_version 667181 (0.0006) [2023-12-26 04:54:53,097][123090] Updated weights for policy 1, policy_version 662660 (0.0009) [2023-12-26 04:54:53,145][123090] Updated weights for policy 1, policy_version 662670 (0.0005) [2023-12-26 04:54:53,205][123090] Updated weights for policy 1, policy_version 662680 (0.0006) [2023-12-26 04:54:53,686][123091] Updated weights for policy 0, policy_version 667191 (0.0005) [2023-12-26 04:54:53,745][123091] Updated weights for policy 0, policy_version 667201 (0.0009) [2023-12-26 04:54:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 340451328. Throughput: 0: 8835.8, 1: 8901.2. Samples: 340429596. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:53,785][121949] Avg episode reward: [(0, '6064.197'), (1, '4252.136')] [2023-12-26 04:54:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000662688_169648128.pth... [2023-12-26 04:54:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000661664_169385984.pth [2023-12-26 04:54:53,804][123091] Updated weights for policy 0, policy_version 667211 (0.0011) [2023-12-26 04:54:53,832][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000667216_170811392.pth... [2023-12-26 04:54:53,837][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000666128_170532864.pth [2023-12-26 04:54:53,969][123090] Updated weights for policy 1, policy_version 662690 (0.0006) [2023-12-26 04:54:54,018][123090] Updated weights for policy 1, policy_version 662700 (0.0005) [2023-12-26 04:54:54,079][123090] Updated weights for policy 1, policy_version 662710 (0.0005) [2023-12-26 04:54:54,139][123090] Updated weights for policy 1, policy_version 662720 (0.0005) [2023-12-26 04:54:54,631][123091] Updated weights for policy 0, policy_version 667221 (0.0008) [2023-12-26 04:54:54,702][123091] Updated weights for policy 0, policy_version 667231 (0.0005) [2023-12-26 04:54:54,772][123091] Updated weights for policy 0, policy_version 667241 (0.0005) [2023-12-26 04:54:54,796][123090] Updated weights for policy 1, policy_version 662730 (0.0009) [2023-12-26 04:54:54,850][123090] Updated weights for policy 1, policy_version 662740 (0.0010) [2023-12-26 04:54:54,904][123090] Updated weights for policy 1, policy_version 662750 (0.0010) [2023-12-26 04:54:55,430][123091] Updated weights for policy 0, policy_version 667251 (0.0006) [2023-12-26 04:54:55,479][123091] Updated weights for policy 0, policy_version 667261 (0.0005) [2023-12-26 04:54:55,526][123091] Updated weights for policy 0, policy_version 667271 (0.0005) [2023-12-26 04:54:55,728][123090] Updated weights for policy 1, policy_version 662760 (0.0010) [2023-12-26 04:54:55,782][123090] Updated weights for policy 1, policy_version 662770 (0.0010) [2023-12-26 04:54:55,852][123090] Updated weights for policy 1, policy_version 662780 (0.0010) [2023-12-26 04:54:56,200][123091] Updated weights for policy 0, policy_version 667281 (0.0005) [2023-12-26 04:54:56,261][123091] Updated weights for policy 0, policy_version 667291 (0.0006) [2023-12-26 04:54:56,320][123091] Updated weights for policy 0, policy_version 667301 (0.0010) [2023-12-26 04:54:56,380][123091] Updated weights for policy 0, policy_version 667311 (0.0011) [2023-12-26 04:54:56,627][123090] Updated weights for policy 1, policy_version 662790 (0.0009) [2023-12-26 04:54:56,683][123090] Updated weights for policy 1, policy_version 662800 (0.0008) [2023-12-26 04:54:56,732][123090] Updated weights for policy 1, policy_version 662810 (0.0007) [2023-12-26 04:54:57,208][123091] Updated weights for policy 0, policy_version 667321 (0.0010) [2023-12-26 04:54:57,258][123091] Updated weights for policy 0, policy_version 667331 (0.0010) [2023-12-26 04:54:57,316][123091] Updated weights for policy 0, policy_version 667341 (0.0008) [2023-12-26 04:54:57,468][123090] Updated weights for policy 1, policy_version 662820 (0.0005) [2023-12-26 04:54:57,535][123090] Updated weights for policy 1, policy_version 662830 (0.0010) [2023-12-26 04:54:57,601][123090] Updated weights for policy 1, policy_version 662840 (0.0010) [2023-12-26 04:54:58,138][123091] Updated weights for policy 0, policy_version 667351 (0.0009) [2023-12-26 04:54:58,206][123091] Updated weights for policy 0, policy_version 667361 (0.0010) [2023-12-26 04:54:58,278][123091] Updated weights for policy 0, policy_version 667371 (0.0011) [2023-12-26 04:54:58,334][123090] Updated weights for policy 1, policy_version 662850 (0.0009) [2023-12-26 04:54:58,406][123090] Updated weights for policy 1, policy_version 662860 (0.0009) [2023-12-26 04:54:58,477][123090] Updated weights for policy 1, policy_version 662870 (0.0009) [2023-12-26 04:54:58,558][123090] Updated weights for policy 1, policy_version 662880 (0.0009) [2023-12-26 04:54:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 340549632. Throughput: 0: 8997.0, 1: 8989.1. Samples: 340543240. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:54:58,784][121949] Avg episode reward: [(0, '6135.231'), (1, '4450.437')] [2023-12-26 04:54:59,053][123091] Updated weights for policy 0, policy_version 667381 (0.0008) [2023-12-26 04:54:59,116][123091] Updated weights for policy 0, policy_version 667391 (0.0006) [2023-12-26 04:54:59,163][123091] Updated weights for policy 0, policy_version 667401 (0.0005) [2023-12-26 04:54:59,298][123090] Updated weights for policy 1, policy_version 662890 (0.0006) [2023-12-26 04:54:59,372][123090] Updated weights for policy 1, policy_version 662900 (0.0007) [2023-12-26 04:54:59,436][123090] Updated weights for policy 1, policy_version 662910 (0.0008) [2023-12-26 04:54:59,932][123091] Updated weights for policy 0, policy_version 667411 (0.0007) [2023-12-26 04:54:59,994][123091] Updated weights for policy 0, policy_version 667421 (0.0010) [2023-12-26 04:55:00,054][123091] Updated weights for policy 0, policy_version 667431 (0.0009) [2023-12-26 04:55:00,258][123090] Updated weights for policy 1, policy_version 662920 (0.0006) [2023-12-26 04:55:00,328][123090] Updated weights for policy 1, policy_version 662930 (0.0005) [2023-12-26 04:55:00,382][123090] Updated weights for policy 1, policy_version 662940 (0.0005) [2023-12-26 04:55:00,709][123091] Updated weights for policy 0, policy_version 667441 (0.0006) [2023-12-26 04:55:00,765][123091] Updated weights for policy 0, policy_version 667451 (0.0010) [2023-12-26 04:55:00,818][123091] Updated weights for policy 0, policy_version 667461 (0.0010) [2023-12-26 04:55:00,871][123091] Updated weights for policy 0, policy_version 667472 (0.0010) [2023-12-26 04:55:00,956][123090] Updated weights for policy 1, policy_version 662950 (0.0006) [2023-12-26 04:55:01,019][123090] Updated weights for policy 1, policy_version 662960 (0.0009) [2023-12-26 04:55:01,086][123090] Updated weights for policy 1, policy_version 662970 (0.0008) [2023-12-26 04:55:01,790][123091] Updated weights for policy 0, policy_version 667482 (0.0010) [2023-12-26 04:55:01,856][123091] Updated weights for policy 0, policy_version 667492 (0.0008) [2023-12-26 04:55:01,901][123090] Updated weights for policy 1, policy_version 662980 (0.0009) [2023-12-26 04:55:01,914][123091] Updated weights for policy 0, policy_version 667502 (0.0006) [2023-12-26 04:55:01,952][123090] Updated weights for policy 1, policy_version 662990 (0.0009) [2023-12-26 04:55:02,002][123090] Updated weights for policy 1, policy_version 663001 (0.0009) [2023-12-26 04:55:02,727][123091] Updated weights for policy 0, policy_version 667512 (0.0010) [2023-12-26 04:55:02,773][123091] Updated weights for policy 0, policy_version 667522 (0.0012) [2023-12-26 04:55:02,840][123091] Updated weights for policy 0, policy_version 667532 (0.0011) [2023-12-26 04:55:02,884][123090] Updated weights for policy 1, policy_version 663011 (0.0009) [2023-12-26 04:55:02,952][123090] Updated weights for policy 1, policy_version 663021 (0.0009) [2023-12-26 04:55:03,023][123090] Updated weights for policy 1, policy_version 663031 (0.0009) [2023-12-26 04:55:03,652][123091] Updated weights for policy 0, policy_version 667542 (0.0010) [2023-12-26 04:55:03,703][123091] Updated weights for policy 0, policy_version 667552 (0.0009) [2023-12-26 04:55:03,759][123091] Updated weights for policy 0, policy_version 667562 (0.0005) [2023-12-26 04:55:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 340631552. Throughput: 0: 9033.4, 1: 8975.0. Samples: 340649876. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:03,784][121949] Avg episode reward: [(0, '6110.379'), (1, '4598.734')] [2023-12-26 04:55:03,839][123090] Updated weights for policy 1, policy_version 663041 (0.0008) [2023-12-26 04:55:03,902][123090] Updated weights for policy 1, policy_version 663051 (0.0009) [2023-12-26 04:55:03,963][123090] Updated weights for policy 1, policy_version 663061 (0.0008) [2023-12-26 04:55:04,029][123090] Updated weights for policy 1, policy_version 663071 (0.0009) [2023-12-26 04:55:04,555][123091] Updated weights for policy 0, policy_version 667572 (0.0007) [2023-12-26 04:55:04,607][123091] Updated weights for policy 0, policy_version 667582 (0.0010) [2023-12-26 04:55:04,666][123091] Updated weights for policy 0, policy_version 667592 (0.0009) [2023-12-26 04:55:04,785][123090] Updated weights for policy 1, policy_version 663081 (0.0006) [2023-12-26 04:55:04,861][123090] Updated weights for policy 1, policy_version 663091 (0.0006) [2023-12-26 04:55:04,937][123090] Updated weights for policy 1, policy_version 663101 (0.0006) [2023-12-26 04:55:05,402][123091] Updated weights for policy 0, policy_version 667602 (0.0006) [2023-12-26 04:55:05,464][123091] Updated weights for policy 0, policy_version 667612 (0.0005) [2023-12-26 04:55:05,497][123090] Updated weights for policy 1, policy_version 663111 (0.0005) [2023-12-26 04:55:05,519][123091] Updated weights for policy 0, policy_version 667622 (0.0007) [2023-12-26 04:55:05,558][123090] Updated weights for policy 1, policy_version 663121 (0.0005) [2023-12-26 04:55:05,572][123091] Updated weights for policy 0, policy_version 667632 (0.0009) [2023-12-26 04:55:05,616][123090] Updated weights for policy 1, policy_version 663131 (0.0005) [2023-12-26 04:55:06,277][123091] Updated weights for policy 0, policy_version 667642 (0.0005) [2023-12-26 04:55:06,351][123091] Updated weights for policy 0, policy_version 667652 (0.0006) [2023-12-26 04:55:06,417][123091] Updated weights for policy 0, policy_version 667662 (0.0005) [2023-12-26 04:55:06,435][123090] Updated weights for policy 1, policy_version 663141 (0.0007) [2023-12-26 04:55:06,504][123090] Updated weights for policy 1, policy_version 663151 (0.0008) [2023-12-26 04:55:06,575][123090] Updated weights for policy 1, policy_version 663161 (0.0009) [2023-12-26 04:55:07,177][123091] Updated weights for policy 0, policy_version 667672 (0.0007) [2023-12-26 04:55:07,243][123091] Updated weights for policy 0, policy_version 667682 (0.0010) [2023-12-26 04:55:07,310][123090] Updated weights for policy 1, policy_version 663171 (0.0008) [2023-12-26 04:55:07,311][123091] Updated weights for policy 0, policy_version 667692 (0.0010) [2023-12-26 04:55:07,365][123090] Updated weights for policy 1, policy_version 663181 (0.0005) [2023-12-26 04:55:07,412][123090] Updated weights for policy 1, policy_version 663191 (0.0005) [2023-12-26 04:55:08,034][123091] Updated weights for policy 0, policy_version 667702 (0.0009) [2023-12-26 04:55:08,083][123091] Updated weights for policy 0, policy_version 667712 (0.0009) [2023-12-26 04:55:08,136][123091] Updated weights for policy 0, policy_version 667722 (0.0006) [2023-12-26 04:55:08,145][123090] Updated weights for policy 1, policy_version 663201 (0.0006) [2023-12-26 04:55:08,204][123090] Updated weights for policy 1, policy_version 663211 (0.0010) [2023-12-26 04:55:08,266][123090] Updated weights for policy 1, policy_version 663221 (0.0009) [2023-12-26 04:55:08,342][123090] Updated weights for policy 1, policy_version 663231 (0.0010) [2023-12-26 04:55:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 340729856. Throughput: 0: 9074.1, 1: 8997.4. Samples: 340705684. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:08,784][121949] Avg episode reward: [(0, '6000.176'), (1, '4543.529')] [2023-12-26 04:55:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000667728_170942464.pth... [2023-12-26 04:55:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000663232_169787392.pth... [2023-12-26 04:55:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000662176_169517056.pth [2023-12-26 04:55:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000666672_170672128.pth [2023-12-26 04:55:08,910][123091] Updated weights for policy 0, policy_version 667732 (0.0007) [2023-12-26 04:55:08,975][123091] Updated weights for policy 0, policy_version 667742 (0.0009) [2023-12-26 04:55:09,043][123091] Updated weights for policy 0, policy_version 667752 (0.0008) [2023-12-26 04:55:09,219][123090] Updated weights for policy 1, policy_version 663241 (0.0010) [2023-12-26 04:55:09,290][123090] Updated weights for policy 1, policy_version 663251 (0.0009) [2023-12-26 04:55:09,364][123090] Updated weights for policy 1, policy_version 663261 (0.0008) [2023-12-26 04:55:09,903][123091] Updated weights for policy 0, policy_version 667762 (0.0010) [2023-12-26 04:55:09,970][123091] Updated weights for policy 0, policy_version 667772 (0.0009) [2023-12-26 04:55:10,021][123091] Updated weights for policy 0, policy_version 667782 (0.0008) [2023-12-26 04:55:10,082][123091] Updated weights for policy 0, policy_version 667792 (0.0008) [2023-12-26 04:55:10,196][123090] Updated weights for policy 1, policy_version 663271 (0.0010) [2023-12-26 04:55:10,253][123090] Updated weights for policy 1, policy_version 663281 (0.0009) [2023-12-26 04:55:10,314][123090] Updated weights for policy 1, policy_version 663291 (0.0008) [2023-12-26 04:55:10,920][123091] Updated weights for policy 0, policy_version 667802 (0.0010) [2023-12-26 04:55:10,982][123091] Updated weights for policy 0, policy_version 667812 (0.0009) [2023-12-26 04:55:11,051][123091] Updated weights for policy 0, policy_version 667822 (0.0009) [2023-12-26 04:55:11,067][123090] Updated weights for policy 1, policy_version 663301 (0.0007) [2023-12-26 04:55:11,136][123090] Updated weights for policy 1, policy_version 663311 (0.0010) [2023-12-26 04:55:11,184][123090] Updated weights for policy 1, policy_version 663321 (0.0009) [2023-12-26 04:55:11,943][123091] Updated weights for policy 0, policy_version 667832 (0.0009) [2023-12-26 04:55:11,999][123091] Updated weights for policy 0, policy_version 667842 (0.0009) [2023-12-26 04:55:12,038][123090] Updated weights for policy 1, policy_version 663331 (0.0010) [2023-12-26 04:55:12,055][123091] Updated weights for policy 0, policy_version 667852 (0.0008) [2023-12-26 04:55:12,096][123090] Updated weights for policy 1, policy_version 663341 (0.0010) [2023-12-26 04:55:12,155][123090] Updated weights for policy 1, policy_version 663351 (0.0010) [2023-12-26 04:55:12,831][123091] Updated weights for policy 0, policy_version 667862 (0.0006) [2023-12-26 04:55:12,901][123091] Updated weights for policy 0, policy_version 667872 (0.0010) [2023-12-26 04:55:12,969][123091] Updated weights for policy 0, policy_version 667882 (0.0006) [2023-12-26 04:55:13,061][123090] Updated weights for policy 1, policy_version 663361 (0.0010) [2023-12-26 04:55:13,124][123090] Updated weights for policy 1, policy_version 663371 (0.0010) [2023-12-26 04:55:13,187][123090] Updated weights for policy 1, policy_version 663381 (0.0010) [2023-12-26 04:55:13,246][123090] Updated weights for policy 1, policy_version 663391 (0.0010) [2023-12-26 04:55:13,698][123091] Updated weights for policy 0, policy_version 667892 (0.0007) [2023-12-26 04:55:13,756][123091] Updated weights for policy 0, policy_version 667902 (0.0010) [2023-12-26 04:55:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 340811776. Throughput: 0: 8973.1, 1: 8906.3. Samples: 340809672. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:13,784][121949] Avg episode reward: [(0, '5999.642'), (1, '4117.685')] [2023-12-26 04:55:13,810][123091] Updated weights for policy 0, policy_version 667912 (0.0010) [2023-12-26 04:55:14,000][123090] Updated weights for policy 1, policy_version 663401 (0.0010) [2023-12-26 04:55:14,071][123090] Updated weights for policy 1, policy_version 663411 (0.0006) [2023-12-26 04:55:14,135][123090] Updated weights for policy 1, policy_version 663421 (0.0008) [2023-12-26 04:55:14,719][123091] Updated weights for policy 0, policy_version 667922 (0.0010) [2023-12-26 04:55:14,779][123091] Updated weights for policy 0, policy_version 667932 (0.0008) [2023-12-26 04:55:14,834][123091] Updated weights for policy 0, policy_version 667942 (0.0009) [2023-12-26 04:55:14,888][123090] Updated weights for policy 1, policy_version 663431 (0.0006) [2023-12-26 04:55:14,890][123091] Updated weights for policy 0, policy_version 667952 (0.0009) [2023-12-26 04:55:14,946][123090] Updated weights for policy 1, policy_version 663441 (0.0006) [2023-12-26 04:55:15,013][123090] Updated weights for policy 1, policy_version 663451 (0.0006) [2023-12-26 04:55:15,582][123091] Updated weights for policy 0, policy_version 667962 (0.0008) [2023-12-26 04:55:15,647][123091] Updated weights for policy 0, policy_version 667972 (0.0009) [2023-12-26 04:55:15,716][123091] Updated weights for policy 0, policy_version 667982 (0.0008) [2023-12-26 04:55:15,719][123090] Updated weights for policy 1, policy_version 663461 (0.0008) [2023-12-26 04:55:15,786][123090] Updated weights for policy 1, policy_version 663471 (0.0010) [2023-12-26 04:55:15,856][123090] Updated weights for policy 1, policy_version 663481 (0.0010) [2023-12-26 04:55:16,467][123091] Updated weights for policy 0, policy_version 667992 (0.0006) [2023-12-26 04:55:16,537][123091] Updated weights for policy 0, policy_version 668002 (0.0008) [2023-12-26 04:55:16,594][123090] Updated weights for policy 1, policy_version 663491 (0.0010) [2023-12-26 04:55:16,596][123091] Updated weights for policy 0, policy_version 668012 (0.0009) [2023-12-26 04:55:16,656][123090] Updated weights for policy 1, policy_version 663501 (0.0010) [2023-12-26 04:55:16,710][123090] Updated weights for policy 1, policy_version 663511 (0.0009) [2023-12-26 04:55:17,379][123090] Updated weights for policy 1, policy_version 663521 (0.0008) [2023-12-26 04:55:17,407][123091] Updated weights for policy 0, policy_version 668022 (0.0008) [2023-12-26 04:55:17,443][123090] Updated weights for policy 1, policy_version 663531 (0.0006) [2023-12-26 04:55:17,461][123091] Updated weights for policy 0, policy_version 668032 (0.0009) [2023-12-26 04:55:17,505][123090] Updated weights for policy 1, policy_version 663541 (0.0008) [2023-12-26 04:55:17,526][123091] Updated weights for policy 0, policy_version 668042 (0.0010) [2023-12-26 04:55:17,575][123090] Updated weights for policy 1, policy_version 663551 (0.0010) [2023-12-26 04:55:18,392][123090] Updated weights for policy 1, policy_version 663561 (0.0007) [2023-12-26 04:55:18,404][123091] Updated weights for policy 0, policy_version 668052 (0.0010) [2023-12-26 04:55:18,461][123090] Updated weights for policy 1, policy_version 663571 (0.0008) [2023-12-26 04:55:18,469][123091] Updated weights for policy 0, policy_version 668062 (0.0008) [2023-12-26 04:55:18,530][123090] Updated weights for policy 1, policy_version 663581 (0.0008) [2023-12-26 04:55:18,530][123091] Updated weights for policy 0, policy_version 668072 (0.0009) [2023-12-26 04:55:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 340910080. Throughput: 0: 8940.5, 1: 8893.3. Samples: 340917016. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:18,785][121949] Avg episode reward: [(0, '6039.050'), (1, '3882.121')] [2023-12-26 04:55:19,270][123090] Updated weights for policy 1, policy_version 663591 (0.0008) [2023-12-26 04:55:19,336][123090] Updated weights for policy 1, policy_version 663601 (0.0006) [2023-12-26 04:55:19,407][123090] Updated weights for policy 1, policy_version 663611 (0.0009) [2023-12-26 04:55:19,421][123091] Updated weights for policy 0, policy_version 668082 (0.0010) [2023-12-26 04:55:19,492][123091] Updated weights for policy 0, policy_version 668092 (0.0008) [2023-12-26 04:55:19,562][123091] Updated weights for policy 0, policy_version 668102 (0.0008) [2023-12-26 04:55:19,625][123091] Updated weights for policy 0, policy_version 668112 (0.0008) [2023-12-26 04:55:20,246][123090] Updated weights for policy 1, policy_version 663621 (0.0007) [2023-12-26 04:55:20,307][123090] Updated weights for policy 1, policy_version 663631 (0.0009) [2023-12-26 04:55:20,359][123090] Updated weights for policy 1, policy_version 663641 (0.0009) [2023-12-26 04:55:20,424][123091] Updated weights for policy 0, policy_version 668122 (0.0009) [2023-12-26 04:55:20,487][123091] Updated weights for policy 0, policy_version 668132 (0.0009) [2023-12-26 04:55:20,554][123091] Updated weights for policy 0, policy_version 668142 (0.0010) [2023-12-26 04:55:21,226][123090] Updated weights for policy 1, policy_version 663651 (0.0008) [2023-12-26 04:55:21,298][123090] Updated weights for policy 1, policy_version 663661 (0.0009) [2023-12-26 04:55:21,370][123090] Updated weights for policy 1, policy_version 663671 (0.0009) [2023-12-26 04:55:21,464][123091] Updated weights for policy 0, policy_version 668152 (0.0009) [2023-12-26 04:55:21,523][123091] Updated weights for policy 0, policy_version 668162 (0.0010) [2023-12-26 04:55:21,575][123091] Updated weights for policy 0, policy_version 668172 (0.0010) [2023-12-26 04:55:22,210][123090] Updated weights for policy 1, policy_version 663681 (0.0008) [2023-12-26 04:55:22,266][123090] Updated weights for policy 1, policy_version 663691 (0.0009) [2023-12-26 04:55:22,326][123090] Updated weights for policy 1, policy_version 663701 (0.0009) [2023-12-26 04:55:22,391][123090] Updated weights for policy 1, policy_version 663711 (0.0010) [2023-12-26 04:55:22,483][123091] Updated weights for policy 0, policy_version 668182 (0.0009) [2023-12-26 04:55:22,546][123091] Updated weights for policy 0, policy_version 668192 (0.0009) [2023-12-26 04:55:22,608][123091] Updated weights for policy 0, policy_version 668202 (0.0009) [2023-12-26 04:55:23,240][123090] Updated weights for policy 1, policy_version 663721 (0.0010) [2023-12-26 04:55:23,306][123090] Updated weights for policy 1, policy_version 663731 (0.0010) [2023-12-26 04:55:23,366][123090] Updated weights for policy 1, policy_version 663741 (0.0009) [2023-12-26 04:55:23,451][123091] Updated weights for policy 0, policy_version 668212 (0.0010) [2023-12-26 04:55:23,508][123091] Updated weights for policy 0, policy_version 668222 (0.0009) [2023-12-26 04:55:23,570][123091] Updated weights for policy 0, policy_version 668232 (0.0009) [2023-12-26 04:55:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 340992000. Throughput: 0: 8926.2, 1: 8870.2. Samples: 340967252. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:23,785][121949] Avg episode reward: [(0, '6106.760'), (1, '4436.385')] [2023-12-26 04:55:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000668240_171073536.pth... [2023-12-26 04:55:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000663744_169918464.pth... [2023-12-26 04:55:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000662688_169648128.pth [2023-12-26 04:55:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000667216_170811392.pth [2023-12-26 04:55:24,195][123090] Updated weights for policy 1, policy_version 663751 (0.0008) [2023-12-26 04:55:24,253][123090] Updated weights for policy 1, policy_version 663761 (0.0009) [2023-12-26 04:55:24,310][123090] Updated weights for policy 1, policy_version 663772 (0.0009) [2023-12-26 04:55:24,419][123091] Updated weights for policy 0, policy_version 668242 (0.0009) [2023-12-26 04:55:24,482][123091] Updated weights for policy 0, policy_version 668252 (0.0010) [2023-12-26 04:55:24,540][123091] Updated weights for policy 0, policy_version 668262 (0.0009) [2023-12-26 04:55:24,602][123091] Updated weights for policy 0, policy_version 668272 (0.0010) [2023-12-26 04:55:25,142][123090] Updated weights for policy 1, policy_version 663782 (0.0010) [2023-12-26 04:55:25,208][123090] Updated weights for policy 1, policy_version 663792 (0.0009) [2023-12-26 04:55:25,272][123090] Updated weights for policy 1, policy_version 663802 (0.0009) [2023-12-26 04:55:25,399][123091] Updated weights for policy 0, policy_version 668282 (0.0006) [2023-12-26 04:55:25,473][123091] Updated weights for policy 0, policy_version 668292 (0.0006) [2023-12-26 04:55:25,520][123091] Updated weights for policy 0, policy_version 668302 (0.0009) [2023-12-26 04:55:26,120][123090] Updated weights for policy 1, policy_version 663812 (0.0010) [2023-12-26 04:55:26,183][123090] Updated weights for policy 1, policy_version 663822 (0.0009) [2023-12-26 04:55:26,242][123090] Updated weights for policy 1, policy_version 663832 (0.0009) [2023-12-26 04:55:26,257][123091] Updated weights for policy 0, policy_version 668312 (0.0010) [2023-12-26 04:55:26,306][123091] Updated weights for policy 0, policy_version 668322 (0.0008) [2023-12-26 04:55:26,354][123091] Updated weights for policy 0, policy_version 668332 (0.0009) [2023-12-26 04:55:27,074][123090] Updated weights for policy 1, policy_version 663842 (0.0008) [2023-12-26 04:55:27,131][123090] Updated weights for policy 1, policy_version 663852 (0.0005) [2023-12-26 04:55:27,194][123090] Updated weights for policy 1, policy_version 663862 (0.0005) [2023-12-26 04:55:27,227][123091] Updated weights for policy 0, policy_version 668342 (0.0007) [2023-12-26 04:55:27,251][123090] Updated weights for policy 1, policy_version 663872 (0.0005) [2023-12-26 04:55:27,290][123091] Updated weights for policy 0, policy_version 668352 (0.0008) [2023-12-26 04:55:27,359][123091] Updated weights for policy 0, policy_version 668362 (0.0009) [2023-12-26 04:55:27,977][123090] Updated weights for policy 1, policy_version 663882 (0.0005) [2023-12-26 04:55:28,035][123090] Updated weights for policy 1, policy_version 663892 (0.0007) [2023-12-26 04:55:28,038][123091] Updated weights for policy 0, policy_version 668372 (0.0006) [2023-12-26 04:55:28,090][123091] Updated weights for policy 0, policy_version 668382 (0.0005) [2023-12-26 04:55:28,097][123090] Updated weights for policy 1, policy_version 663902 (0.0009) [2023-12-26 04:55:28,139][123091] Updated weights for policy 0, policy_version 668392 (0.0005) [2023-12-26 04:55:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 341073920. Throughput: 0: 8927.7, 1: 8891.0. Samples: 341070836. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:28,785][121949] Avg episode reward: [(0, '6122.536'), (1, '4988.092')] [2023-12-26 04:55:28,942][123091] Updated weights for policy 0, policy_version 668402 (0.0007) [2023-12-26 04:55:28,942][123090] Updated weights for policy 1, policy_version 663912 (0.0010) [2023-12-26 04:55:28,995][123091] Updated weights for policy 0, policy_version 668412 (0.0009) [2023-12-26 04:55:29,003][123090] Updated weights for policy 1, policy_version 663922 (0.0008) [2023-12-26 04:55:29,046][123091] Updated weights for policy 0, policy_version 668422 (0.0005) [2023-12-26 04:55:29,059][123090] Updated weights for policy 1, policy_version 663932 (0.0008) [2023-12-26 04:55:29,105][123091] Updated weights for policy 0, policy_version 668432 (0.0006) [2023-12-26 04:55:29,725][123091] Updated weights for policy 0, policy_version 668442 (0.0005) [2023-12-26 04:55:29,791][123091] Updated weights for policy 0, policy_version 668452 (0.0005) [2023-12-26 04:55:29,861][123091] Updated weights for policy 0, policy_version 668462 (0.0007) [2023-12-26 04:55:29,970][123090] Updated weights for policy 1, policy_version 663942 (0.0009) [2023-12-26 04:55:30,034][123090] Updated weights for policy 1, policy_version 663952 (0.0009) [2023-12-26 04:55:30,090][123090] Updated weights for policy 1, policy_version 663962 (0.0009) [2023-12-26 04:55:30,602][123091] Updated weights for policy 0, policy_version 668472 (0.0010) [2023-12-26 04:55:30,660][123091] Updated weights for policy 0, policy_version 668482 (0.0010) [2023-12-26 04:55:30,714][123091] Updated weights for policy 0, policy_version 668492 (0.0010) [2023-12-26 04:55:30,966][123090] Updated weights for policy 1, policy_version 663972 (0.0009) [2023-12-26 04:55:31,023][123090] Updated weights for policy 1, policy_version 663982 (0.0009) [2023-12-26 04:55:31,087][123090] Updated weights for policy 1, policy_version 663992 (0.0009) [2023-12-26 04:55:31,513][123091] Updated weights for policy 0, policy_version 668502 (0.0007) [2023-12-26 04:55:31,575][123091] Updated weights for policy 0, policy_version 668512 (0.0005) [2023-12-26 04:55:31,648][123091] Updated weights for policy 0, policy_version 668522 (0.0007) [2023-12-26 04:55:31,937][123090] Updated weights for policy 1, policy_version 664002 (0.0009) [2023-12-26 04:55:32,010][123090] Updated weights for policy 1, policy_version 664012 (0.0009) [2023-12-26 04:55:32,083][123090] Updated weights for policy 1, policy_version 664022 (0.0009) [2023-12-26 04:55:32,151][123090] Updated weights for policy 1, policy_version 664032 (0.0009) [2023-12-26 04:55:32,429][123091] Updated weights for policy 0, policy_version 668532 (0.0008) [2023-12-26 04:55:32,489][123091] Updated weights for policy 0, policy_version 668542 (0.0008) [2023-12-26 04:55:32,544][123091] Updated weights for policy 0, policy_version 668552 (0.0007) [2023-12-26 04:55:33,003][123090] Updated weights for policy 1, policy_version 664042 (0.0009) [2023-12-26 04:55:33,071][123090] Updated weights for policy 1, policy_version 664052 (0.0009) [2023-12-26 04:55:33,131][123090] Updated weights for policy 1, policy_version 664062 (0.0009) [2023-12-26 04:55:33,318][123091] Updated weights for policy 0, policy_version 668562 (0.0006) [2023-12-26 04:55:33,375][123091] Updated weights for policy 0, policy_version 668572 (0.0010) [2023-12-26 04:55:33,435][123091] Updated weights for policy 0, policy_version 668582 (0.0009) [2023-12-26 04:55:33,501][123091] Updated weights for policy 0, policy_version 668592 (0.0009) [2023-12-26 04:55:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 341164032. Throughput: 0: 8934.0, 1: 8839.3. Samples: 341176832. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:33,785][121949] Avg episode reward: [(0, '6079.161'), (1, '4889.264')] [2023-12-26 04:55:33,865][123090] Updated weights for policy 1, policy_version 664072 (0.0006) [2023-12-26 04:55:33,933][123090] Updated weights for policy 1, policy_version 664082 (0.0005) [2023-12-26 04:55:33,989][123090] Updated weights for policy 1, policy_version 664092 (0.0005) [2023-12-26 04:55:34,221][123091] Updated weights for policy 0, policy_version 668602 (0.0006) [2023-12-26 04:55:34,275][123091] Updated weights for policy 0, policy_version 668612 (0.0005) [2023-12-26 04:55:34,343][123091] Updated weights for policy 0, policy_version 668622 (0.0006) [2023-12-26 04:55:34,693][123090] Updated weights for policy 1, policy_version 664102 (0.0008) [2023-12-26 04:55:34,749][123090] Updated weights for policy 1, policy_version 664112 (0.0007) [2023-12-26 04:55:34,814][123090] Updated weights for policy 1, policy_version 664122 (0.0008) [2023-12-26 04:55:34,957][123091] Updated weights for policy 0, policy_version 668632 (0.0007) [2023-12-26 04:55:35,033][123091] Updated weights for policy 0, policy_version 668642 (0.0005) [2023-12-26 04:55:35,090][123091] Updated weights for policy 0, policy_version 668652 (0.0006) [2023-12-26 04:55:35,401][123090] Updated weights for policy 1, policy_version 664132 (0.0006) [2023-12-26 04:55:35,460][123090] Updated weights for policy 1, policy_version 664142 (0.0005) [2023-12-26 04:55:35,525][123090] Updated weights for policy 1, policy_version 664152 (0.0006) [2023-12-26 04:55:35,800][123091] Updated weights for policy 0, policy_version 668662 (0.0008) [2023-12-26 04:55:35,863][123091] Updated weights for policy 0, policy_version 668672 (0.0010) [2023-12-26 04:55:35,917][123091] Updated weights for policy 0, policy_version 668682 (0.0010) [2023-12-26 04:55:36,235][123090] Updated weights for policy 1, policy_version 664162 (0.0006) [2023-12-26 04:55:36,301][123090] Updated weights for policy 1, policy_version 664172 (0.0010) [2023-12-26 04:55:36,370][123090] Updated weights for policy 1, policy_version 664182 (0.0008) [2023-12-26 04:55:36,440][123090] Updated weights for policy 1, policy_version 664192 (0.0006) [2023-12-26 04:55:36,777][123091] Updated weights for policy 0, policy_version 668692 (0.0011) [2023-12-26 04:55:36,848][123091] Updated weights for policy 0, policy_version 668702 (0.0011) [2023-12-26 04:55:36,918][123091] Updated weights for policy 0, policy_version 668712 (0.0011) [2023-12-26 04:55:37,150][123090] Updated weights for policy 1, policy_version 664202 (0.0011) [2023-12-26 04:55:37,205][123090] Updated weights for policy 1, policy_version 664212 (0.0010) [2023-12-26 04:55:37,260][123090] Updated weights for policy 1, policy_version 664222 (0.0010) [2023-12-26 04:55:37,715][123091] Updated weights for policy 0, policy_version 668722 (0.0010) [2023-12-26 04:55:37,768][123091] Updated weights for policy 0, policy_version 668732 (0.0009) [2023-12-26 04:55:37,829][123091] Updated weights for policy 0, policy_version 668742 (0.0009) [2023-12-26 04:55:37,882][123091] Updated weights for policy 0, policy_version 668752 (0.0009) [2023-12-26 04:55:38,083][123090] Updated weights for policy 1, policy_version 664232 (0.0010) [2023-12-26 04:55:38,141][123090] Updated weights for policy 1, policy_version 664242 (0.0010) [2023-12-26 04:55:38,207][123090] Updated weights for policy 1, policy_version 664252 (0.0010) [2023-12-26 04:55:38,766][123091] Updated weights for policy 0, policy_version 668762 (0.0010) [2023-12-26 04:55:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 341254144. Throughput: 0: 8986.2, 1: 8915.4. Samples: 341235172. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:38,785][121949] Avg episode reward: [(0, '6008.154'), (1, '4757.788')] [2023-12-26 04:55:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000664256_170049536.pth... [2023-12-26 04:55:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000663232_169787392.pth [2023-12-26 04:55:38,839][123091] Updated weights for policy 0, policy_version 668772 (0.0009) [2023-12-26 04:55:38,901][123091] Updated weights for policy 0, policy_version 668782 (0.0009) [2023-12-26 04:55:38,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000668784_171212800.pth... [2023-12-26 04:55:38,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000667728_170942464.pth [2023-12-26 04:55:39,026][123090] Updated weights for policy 1, policy_version 664262 (0.0010) [2023-12-26 04:55:39,091][123090] Updated weights for policy 1, policy_version 664272 (0.0010) [2023-12-26 04:55:39,153][123090] Updated weights for policy 1, policy_version 664282 (0.0010) [2023-12-26 04:55:39,677][123091] Updated weights for policy 0, policy_version 668792 (0.0009) [2023-12-26 04:55:39,741][123091] Updated weights for policy 0, policy_version 668802 (0.0009) [2023-12-26 04:55:39,806][123091] Updated weights for policy 0, policy_version 668812 (0.0009) [2023-12-26 04:55:40,008][123090] Updated weights for policy 1, policy_version 664292 (0.0010) [2023-12-26 04:55:40,070][123090] Updated weights for policy 1, policy_version 664302 (0.0010) [2023-12-26 04:55:40,138][123090] Updated weights for policy 1, policy_version 664312 (0.0009) [2023-12-26 04:55:40,704][123091] Updated weights for policy 0, policy_version 668822 (0.0010) [2023-12-26 04:55:40,763][123091] Updated weights for policy 0, policy_version 668832 (0.0010) [2023-12-26 04:55:40,820][123091] Updated weights for policy 0, policy_version 668843 (0.0010) [2023-12-26 04:55:40,935][123090] Updated weights for policy 1, policy_version 664322 (0.0009) [2023-12-26 04:55:41,001][123090] Updated weights for policy 1, policy_version 664332 (0.0005) [2023-12-26 04:55:41,075][123090] Updated weights for policy 1, policy_version 664342 (0.0007) [2023-12-26 04:55:41,148][123090] Updated weights for policy 1, policy_version 664352 (0.0007) [2023-12-26 04:55:41,771][123091] Updated weights for policy 0, policy_version 668853 (0.0010) [2023-12-26 04:55:41,843][123091] Updated weights for policy 0, policy_version 668863 (0.0009) [2023-12-26 04:55:41,886][123090] Updated weights for policy 1, policy_version 664362 (0.0009) [2023-12-26 04:55:41,905][123091] Updated weights for policy 0, policy_version 668873 (0.0008) [2023-12-26 04:55:41,952][123090] Updated weights for policy 1, policy_version 664372 (0.0007) [2023-12-26 04:55:42,026][123090] Updated weights for policy 1, policy_version 664382 (0.0010) [2023-12-26 04:55:42,701][123090] Updated weights for policy 1, policy_version 664392 (0.0006) [2023-12-26 04:55:42,752][123090] Updated weights for policy 1, policy_version 664402 (0.0005) [2023-12-26 04:55:42,782][123091] Updated weights for policy 0, policy_version 668883 (0.0009) [2023-12-26 04:55:42,819][123090] Updated weights for policy 1, policy_version 664412 (0.0006) [2023-12-26 04:55:42,845][123091] Updated weights for policy 0, policy_version 668893 (0.0009) [2023-12-26 04:55:42,909][123091] Updated weights for policy 0, policy_version 668903 (0.0009) [2023-12-26 04:55:43,612][123090] Updated weights for policy 1, policy_version 664422 (0.0006) [2023-12-26 04:55:43,665][123090] Updated weights for policy 1, policy_version 664432 (0.0005) [2023-12-26 04:55:43,680][123091] Updated weights for policy 0, policy_version 668913 (0.0009) [2023-12-26 04:55:43,718][123090] Updated weights for policy 1, policy_version 664442 (0.0005) [2023-12-26 04:55:43,737][123091] Updated weights for policy 0, policy_version 668923 (0.0009) [2023-12-26 04:55:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 341344256. Throughput: 0: 8801.4, 1: 8847.9. Samples: 341337460. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:43,785][121949] Avg episode reward: [(0, '6062.132'), (1, '4750.592')] [2023-12-26 04:55:43,795][123091] Updated weights for policy 0, policy_version 668933 (0.0009) [2023-12-26 04:55:43,851][123091] Updated weights for policy 0, policy_version 668944 (0.0011) [2023-12-26 04:55:44,396][123090] Updated weights for policy 1, policy_version 664452 (0.0007) [2023-12-26 04:55:44,464][123090] Updated weights for policy 1, policy_version 664462 (0.0010) [2023-12-26 04:55:44,526][123090] Updated weights for policy 1, policy_version 664472 (0.0009) [2023-12-26 04:55:44,738][123091] Updated weights for policy 0, policy_version 668954 (0.0009) [2023-12-26 04:55:44,798][123091] Updated weights for policy 0, policy_version 668964 (0.0010) [2023-12-26 04:55:44,869][123091] Updated weights for policy 0, policy_version 668974 (0.0009) [2023-12-26 04:55:45,332][123090] Updated weights for policy 1, policy_version 664482 (0.0008) [2023-12-26 04:55:45,383][123090] Updated weights for policy 1, policy_version 664492 (0.0006) [2023-12-26 04:55:45,437][123090] Updated weights for policy 1, policy_version 664502 (0.0005) [2023-12-26 04:55:45,488][123090] Updated weights for policy 1, policy_version 664512 (0.0005) [2023-12-26 04:55:45,648][123091] Updated weights for policy 0, policy_version 668984 (0.0006) [2023-12-26 04:55:45,712][123091] Updated weights for policy 0, policy_version 668994 (0.0005) [2023-12-26 04:55:45,781][123091] Updated weights for policy 0, policy_version 669004 (0.0005) [2023-12-26 04:55:46,171][123090] Updated weights for policy 1, policy_version 664522 (0.0005) [2023-12-26 04:55:46,223][123090] Updated weights for policy 1, policy_version 664532 (0.0005) [2023-12-26 04:55:46,291][123090] Updated weights for policy 1, policy_version 664542 (0.0006) [2023-12-26 04:55:46,430][123091] Updated weights for policy 0, policy_version 669014 (0.0008) [2023-12-26 04:55:46,502][123091] Updated weights for policy 0, policy_version 669024 (0.0010) [2023-12-26 04:55:46,564][123091] Updated weights for policy 0, policy_version 669034 (0.0010) [2023-12-26 04:55:46,971][123090] Updated weights for policy 1, policy_version 664552 (0.0006) [2023-12-26 04:55:47,042][123090] Updated weights for policy 1, policy_version 664562 (0.0005) [2023-12-26 04:55:47,098][123090] Updated weights for policy 1, policy_version 664572 (0.0005) [2023-12-26 04:55:47,395][123091] Updated weights for policy 0, policy_version 669044 (0.0009) [2023-12-26 04:55:47,456][123091] Updated weights for policy 0, policy_version 669054 (0.0010) [2023-12-26 04:55:47,506][123091] Updated weights for policy 0, policy_version 669064 (0.0009) [2023-12-26 04:55:47,817][123090] Updated weights for policy 1, policy_version 664583 (0.0006) [2023-12-26 04:55:47,884][123090] Updated weights for policy 1, policy_version 664593 (0.0005) [2023-12-26 04:55:47,953][123090] Updated weights for policy 1, policy_version 664603 (0.0005) [2023-12-26 04:55:48,367][123091] Updated weights for policy 0, policy_version 669074 (0.0009) [2023-12-26 04:55:48,428][123091] Updated weights for policy 0, policy_version 669084 (0.0010) [2023-12-26 04:55:48,479][123091] Updated weights for policy 0, policy_version 669094 (0.0009) [2023-12-26 04:55:48,549][123091] Updated weights for policy 0, policy_version 669104 (0.0010) [2023-12-26 04:55:48,685][123090] Updated weights for policy 1, policy_version 664613 (0.0008) [2023-12-26 04:55:48,765][123090] Updated weights for policy 1, policy_version 664623 (0.0006) [2023-12-26 04:55:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 341434368. Throughput: 0: 8766.0, 1: 8940.1. Samples: 341446652. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:48,785][121949] Avg episode reward: [(0, '6136.692'), (1, '4742.651')] [2023-12-26 04:55:48,828][123090] Updated weights for policy 1, policy_version 664633 (0.0009) [2023-12-26 04:55:49,473][123091] Updated weights for policy 0, policy_version 669114 (0.0007) [2023-12-26 04:55:49,534][123091] Updated weights for policy 0, policy_version 669124 (0.0010) [2023-12-26 04:55:49,601][123091] Updated weights for policy 0, policy_version 669134 (0.0006) [2023-12-26 04:55:49,686][123090] Updated weights for policy 1, policy_version 664643 (0.0010) [2023-12-26 04:55:49,752][123090] Updated weights for policy 1, policy_version 664653 (0.0010) [2023-12-26 04:55:49,817][123090] Updated weights for policy 1, policy_version 664663 (0.0009) [2023-12-26 04:55:50,357][123091] Updated weights for policy 0, policy_version 669144 (0.0008) [2023-12-26 04:55:50,425][123091] Updated weights for policy 0, policy_version 669154 (0.0010) [2023-12-26 04:55:50,490][123091] Updated weights for policy 0, policy_version 669164 (0.0009) [2023-12-26 04:55:50,636][123090] Updated weights for policy 1, policy_version 664673 (0.0008) [2023-12-26 04:55:50,703][123090] Updated weights for policy 1, policy_version 664683 (0.0009) [2023-12-26 04:55:50,777][123090] Updated weights for policy 1, policy_version 664693 (0.0010) [2023-12-26 04:55:50,848][123090] Updated weights for policy 1, policy_version 664703 (0.0007) [2023-12-26 04:55:51,319][123091] Updated weights for policy 0, policy_version 669174 (0.0010) [2023-12-26 04:55:51,396][123091] Updated weights for policy 0, policy_version 669184 (0.0010) [2023-12-26 04:55:51,448][123091] Updated weights for policy 0, policy_version 669194 (0.0011) [2023-12-26 04:55:51,662][123090] Updated weights for policy 1, policy_version 664713 (0.0008) [2023-12-26 04:55:51,732][123090] Updated weights for policy 1, policy_version 664723 (0.0009) [2023-12-26 04:55:51,796][123090] Updated weights for policy 1, policy_version 664733 (0.0009) [2023-12-26 04:55:52,268][123091] Updated weights for policy 0, policy_version 669204 (0.0009) [2023-12-26 04:55:52,331][123091] Updated weights for policy 0, policy_version 669214 (0.0009) [2023-12-26 04:55:52,401][123091] Updated weights for policy 0, policy_version 669224 (0.0011) [2023-12-26 04:55:52,623][123090] Updated weights for policy 1, policy_version 664743 (0.0010) [2023-12-26 04:55:52,682][123090] Updated weights for policy 1, policy_version 664753 (0.0010) [2023-12-26 04:55:52,747][123090] Updated weights for policy 1, policy_version 664763 (0.0009) [2023-12-26 04:55:53,171][123091] Updated weights for policy 0, policy_version 669234 (0.0011) [2023-12-26 04:55:53,231][123091] Updated weights for policy 0, policy_version 669244 (0.0011) [2023-12-26 04:55:53,278][123091] Updated weights for policy 0, policy_version 669254 (0.0010) [2023-12-26 04:55:53,333][123091] Updated weights for policy 0, policy_version 669264 (0.0008) [2023-12-26 04:55:53,639][123090] Updated weights for policy 1, policy_version 664773 (0.0010) [2023-12-26 04:55:53,697][123090] Updated weights for policy 1, policy_version 664783 (0.0010) [2023-12-26 04:55:53,756][123090] Updated weights for policy 1, policy_version 664794 (0.0010) [2023-12-26 04:55:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 341516288. Throughput: 0: 8718.8, 1: 8878.2. Samples: 341497556. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:53,786][121949] Avg episode reward: [(0, '6048.643'), (1, '4757.104')] [2023-12-26 04:55:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000669264_171335680.pth... [2023-12-26 04:55:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000664800_170188800.pth... [2023-12-26 04:55:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000668240_171073536.pth [2023-12-26 04:55:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000663744_169918464.pth [2023-12-26 04:55:53,983][123091] Updated weights for policy 0, policy_version 669274 (0.0006) [2023-12-26 04:55:54,044][123091] Updated weights for policy 0, policy_version 669284 (0.0006) [2023-12-26 04:55:54,106][123091] Updated weights for policy 0, policy_version 669294 (0.0011) [2023-12-26 04:55:54,669][123090] Updated weights for policy 1, policy_version 664804 (0.0010) [2023-12-26 04:55:54,729][123090] Updated weights for policy 1, policy_version 664814 (0.0010) [2023-12-26 04:55:54,781][123090] Updated weights for policy 1, policy_version 664824 (0.0009) [2023-12-26 04:55:54,834][123091] Updated weights for policy 0, policy_version 669304 (0.0006) [2023-12-26 04:55:54,895][123091] Updated weights for policy 0, policy_version 669314 (0.0005) [2023-12-26 04:55:54,969][123091] Updated weights for policy 0, policy_version 669324 (0.0010) [2023-12-26 04:55:55,603][123091] Updated weights for policy 0, policy_version 669334 (0.0006) [2023-12-26 04:55:55,650][123091] Updated weights for policy 0, policy_version 669344 (0.0005) [2023-12-26 04:55:55,715][123091] Updated weights for policy 0, policy_version 669354 (0.0005) [2023-12-26 04:55:55,739][123090] Updated weights for policy 1, policy_version 664834 (0.0010) [2023-12-26 04:55:55,797][123090] Updated weights for policy 1, policy_version 664844 (0.0010) [2023-12-26 04:55:55,853][123090] Updated weights for policy 1, policy_version 664854 (0.0010) [2023-12-26 04:55:55,908][123090] Updated weights for policy 1, policy_version 664864 (0.0010) [2023-12-26 04:55:56,367][123091] Updated weights for policy 0, policy_version 669364 (0.0007) [2023-12-26 04:55:56,429][123091] Updated weights for policy 0, policy_version 669374 (0.0010) [2023-12-26 04:55:56,492][123091] Updated weights for policy 0, policy_version 669384 (0.0010) [2023-12-26 04:55:56,806][123090] Updated weights for policy 1, policy_version 664874 (0.0010) [2023-12-26 04:55:56,860][123090] Updated weights for policy 1, policy_version 664884 (0.0009) [2023-12-26 04:55:56,913][123090] Updated weights for policy 1, policy_version 664894 (0.0009) [2023-12-26 04:55:57,322][123091] Updated weights for policy 0, policy_version 669394 (0.0009) [2023-12-26 04:55:57,380][123091] Updated weights for policy 0, policy_version 669404 (0.0010) [2023-12-26 04:55:57,449][123091] Updated weights for policy 0, policy_version 669414 (0.0009) [2023-12-26 04:55:57,510][123091] Updated weights for policy 0, policy_version 669424 (0.0009) [2023-12-26 04:55:57,786][123090] Updated weights for policy 1, policy_version 664904 (0.0009) [2023-12-26 04:55:57,844][123090] Updated weights for policy 1, policy_version 664914 (0.0010) [2023-12-26 04:55:57,911][123090] Updated weights for policy 1, policy_version 664924 (0.0009) [2023-12-26 04:55:58,300][123091] Updated weights for policy 0, policy_version 669434 (0.0006) [2023-12-26 04:55:58,371][123091] Updated weights for policy 0, policy_version 669444 (0.0009) [2023-12-26 04:55:58,432][123091] Updated weights for policy 0, policy_version 669454 (0.0011) [2023-12-26 04:55:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 341606400. Throughput: 0: 8822.1, 1: 8803.9. Samples: 341602844. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:55:58,785][121949] Avg episode reward: [(0, '6060.783'), (1, '4711.257')] [2023-12-26 04:55:58,846][123090] Updated weights for policy 1, policy_version 664934 (0.0008) [2023-12-26 04:55:58,914][123090] Updated weights for policy 1, policy_version 664944 (0.0009) [2023-12-26 04:55:58,984][123090] Updated weights for policy 1, policy_version 664954 (0.0009) [2023-12-26 04:55:59,255][123091] Updated weights for policy 0, policy_version 669464 (0.0008) [2023-12-26 04:55:59,323][123091] Updated weights for policy 0, policy_version 669474 (0.0008) [2023-12-26 04:55:59,397][123091] Updated weights for policy 0, policy_version 669484 (0.0008) [2023-12-26 04:55:59,813][123090] Updated weights for policy 1, policy_version 664964 (0.0009) [2023-12-26 04:55:59,881][123090] Updated weights for policy 1, policy_version 664974 (0.0008) [2023-12-26 04:55:59,943][123090] Updated weights for policy 1, policy_version 664984 (0.0010) [2023-12-26 04:56:00,174][123091] Updated weights for policy 0, policy_version 669494 (0.0009) [2023-12-26 04:56:00,241][123091] Updated weights for policy 0, policy_version 669504 (0.0010) [2023-12-26 04:56:00,304][123091] Updated weights for policy 0, policy_version 669514 (0.0008) [2023-12-26 04:56:00,676][123090] Updated weights for policy 1, policy_version 664994 (0.0010) [2023-12-26 04:56:00,732][123090] Updated weights for policy 1, policy_version 665004 (0.0009) [2023-12-26 04:56:00,786][123090] Updated weights for policy 1, policy_version 665014 (0.0009) [2023-12-26 04:56:00,849][123090] Updated weights for policy 1, policy_version 665024 (0.0010) [2023-12-26 04:56:01,162][123091] Updated weights for policy 0, policy_version 669524 (0.0010) [2023-12-26 04:56:01,220][123091] Updated weights for policy 0, policy_version 669534 (0.0010) [2023-12-26 04:56:01,282][123091] Updated weights for policy 0, policy_version 669544 (0.0010) [2023-12-26 04:56:01,703][123090] Updated weights for policy 1, policy_version 665034 (0.0008) [2023-12-26 04:56:01,771][123090] Updated weights for policy 1, policy_version 665044 (0.0009) [2023-12-26 04:56:01,819][123090] Updated weights for policy 1, policy_version 665054 (0.0009) [2023-12-26 04:56:02,128][123091] Updated weights for policy 0, policy_version 669554 (0.0009) [2023-12-26 04:56:02,182][123091] Updated weights for policy 0, policy_version 669564 (0.0009) [2023-12-26 04:56:02,229][123091] Updated weights for policy 0, policy_version 669574 (0.0009) [2023-12-26 04:56:02,284][123091] Updated weights for policy 0, policy_version 669584 (0.0010) [2023-12-26 04:56:02,673][123090] Updated weights for policy 1, policy_version 665064 (0.0009) [2023-12-26 04:56:02,732][123090] Updated weights for policy 1, policy_version 665074 (0.0010) [2023-12-26 04:56:02,793][123090] Updated weights for policy 1, policy_version 665084 (0.0009) [2023-12-26 04:56:03,133][123091] Updated weights for policy 0, policy_version 669594 (0.0006) [2023-12-26 04:56:03,185][123091] Updated weights for policy 0, policy_version 669604 (0.0006) [2023-12-26 04:56:03,235][123091] Updated weights for policy 0, policy_version 669614 (0.0006) [2023-12-26 04:56:03,675][123090] Updated weights for policy 1, policy_version 665094 (0.0010) [2023-12-26 04:56:03,736][123090] Updated weights for policy 1, policy_version 665104 (0.0009) [2023-12-26 04:56:03,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 341688320. Throughput: 0: 8810.1, 1: 8701.0. Samples: 341705012. Policy #0 lag: (min: 20.0, avg: 23.0, max: 49.0) [2023-12-26 04:56:03,784][121949] Avg episode reward: [(0, '6169.635'), (1, '4864.993')] [2023-12-26 04:56:03,786][123090] Updated weights for policy 1, policy_version 665114 (0.0009) [2023-12-26 04:56:04,008][123091] Updated weights for policy 0, policy_version 669624 (0.0009) [2023-12-26 04:56:04,072][123091] Updated weights for policy 0, policy_version 669634 (0.0009) [2023-12-26 04:56:04,124][123091] Updated weights for policy 0, policy_version 669644 (0.0009) [2023-12-26 04:56:04,634][123090] Updated weights for policy 1, policy_version 665124 (0.0009) [2023-12-26 04:56:04,683][123090] Updated weights for policy 1, policy_version 665134 (0.0009) [2023-12-26 04:56:04,750][123090] Updated weights for policy 1, policy_version 665144 (0.0010) [2023-12-26 04:56:04,988][123091] Updated weights for policy 0, policy_version 669654 (0.0010) [2023-12-26 04:56:05,041][123091] Updated weights for policy 0, policy_version 669664 (0.0009) [2023-12-26 04:56:05,102][123091] Updated weights for policy 0, policy_version 669674 (0.0009) [2023-12-26 04:56:05,640][123090] Updated weights for policy 1, policy_version 665154 (0.0010) [2023-12-26 04:56:05,703][123090] Updated weights for policy 1, policy_version 665164 (0.0008) [2023-12-26 04:56:05,774][123090] Updated weights for policy 1, policy_version 665174 (0.0009) [2023-12-26 04:56:05,826][123090] Updated weights for policy 1, policy_version 665184 (0.0009) [2023-12-26 04:56:05,915][123091] Updated weights for policy 0, policy_version 669684 (0.0009) [2023-12-26 04:56:05,963][123091] Updated weights for policy 0, policy_version 669694 (0.0009) [2023-12-26 04:56:06,027][123091] Updated weights for policy 0, policy_version 669704 (0.0009) [2023-12-26 04:56:06,583][123090] Updated weights for policy 1, policy_version 665194 (0.0010) [2023-12-26 04:56:06,648][123090] Updated weights for policy 1, policy_version 665204 (0.0008) [2023-12-26 04:56:06,715][123090] Updated weights for policy 1, policy_version 665214 (0.0011) [2023-12-26 04:56:06,934][123091] Updated weights for policy 0, policy_version 669715 (0.0010) [2023-12-26 04:56:06,987][123091] Updated weights for policy 0, policy_version 669725 (0.0010) [2023-12-26 04:56:07,049][123091] Updated weights for policy 0, policy_version 669735 (0.0009) [2023-12-26 04:56:07,386][123090] Updated weights for policy 1, policy_version 665224 (0.0010) [2023-12-26 04:56:07,454][123090] Updated weights for policy 1, policy_version 665234 (0.0011) [2023-12-26 04:56:07,518][123090] Updated weights for policy 1, policy_version 665244 (0.0011) [2023-12-26 04:56:07,902][123091] Updated weights for policy 0, policy_version 669745 (0.0009) [2023-12-26 04:56:07,966][123091] Updated weights for policy 0, policy_version 669755 (0.0007) [2023-12-26 04:56:08,033][123091] Updated weights for policy 0, policy_version 669765 (0.0008) [2023-12-26 04:56:08,094][123091] Updated weights for policy 0, policy_version 669775 (0.0008) [2023-12-26 04:56:08,323][123090] Updated weights for policy 1, policy_version 665254 (0.0011) [2023-12-26 04:56:08,402][123090] Updated weights for policy 1, policy_version 665264 (0.0008) [2023-12-26 04:56:08,466][123090] Updated weights for policy 1, policy_version 665274 (0.0008) [2023-12-26 04:56:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 341778432. Throughput: 0: 8833.8, 1: 8696.3. Samples: 341756104. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:08,785][121949] Avg episode reward: [(0, '6257.852'), (1, '4894.009')] [2023-12-26 04:56:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000665280_170311680.pth... [2023-12-26 04:56:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000664256_170049536.pth [2023-12-26 04:56:08,841][123091] Updated weights for policy 0, policy_version 669785 (0.0008) [2023-12-26 04:56:08,923][123091] Updated weights for policy 0, policy_version 669795 (0.0005) [2023-12-26 04:56:08,998][123091] Updated weights for policy 0, policy_version 669805 (0.0008) [2023-12-26 04:56:09,012][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000669808_171474944.pth... [2023-12-26 04:56:09,017][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000668784_171212800.pth [2023-12-26 04:56:09,251][123090] Updated weights for policy 1, policy_version 665284 (0.0008) [2023-12-26 04:56:09,309][123090] Updated weights for policy 1, policy_version 665294 (0.0006) [2023-12-26 04:56:09,380][123090] Updated weights for policy 1, policy_version 665304 (0.0007) [2023-12-26 04:56:09,747][123091] Updated weights for policy 0, policy_version 669815 (0.0010) [2023-12-26 04:56:09,813][123091] Updated weights for policy 0, policy_version 669825 (0.0009) [2023-12-26 04:56:09,878][123091] Updated weights for policy 0, policy_version 669835 (0.0011) [2023-12-26 04:56:10,203][123090] Updated weights for policy 1, policy_version 665314 (0.0009) [2023-12-26 04:56:10,267][123090] Updated weights for policy 1, policy_version 665324 (0.0009) [2023-12-26 04:56:10,331][123090] Updated weights for policy 1, policy_version 665334 (0.0009) [2023-12-26 04:56:10,404][123090] Updated weights for policy 1, policy_version 665344 (0.0006) [2023-12-26 04:56:10,749][123091] Updated weights for policy 0, policy_version 669845 (0.0008) [2023-12-26 04:56:10,810][123091] Updated weights for policy 0, policy_version 669855 (0.0005) [2023-12-26 04:56:10,867][123091] Updated weights for policy 0, policy_version 669865 (0.0005) [2023-12-26 04:56:11,149][123090] Updated weights for policy 1, policy_version 665354 (0.0008) [2023-12-26 04:56:11,224][123090] Updated weights for policy 1, policy_version 665364 (0.0008) [2023-12-26 04:56:11,292][123090] Updated weights for policy 1, policy_version 665374 (0.0008) [2023-12-26 04:56:11,639][123091] Updated weights for policy 0, policy_version 669875 (0.0006) [2023-12-26 04:56:11,703][123091] Updated weights for policy 0, policy_version 669885 (0.0010) [2023-12-26 04:56:11,771][123091] Updated weights for policy 0, policy_version 669895 (0.0009) [2023-12-26 04:56:12,077][123090] Updated weights for policy 1, policy_version 665384 (0.0008) [2023-12-26 04:56:12,146][123090] Updated weights for policy 1, policy_version 665394 (0.0010) [2023-12-26 04:56:12,211][123090] Updated weights for policy 1, policy_version 665404 (0.0010) [2023-12-26 04:56:12,552][123091] Updated weights for policy 0, policy_version 669905 (0.0006) [2023-12-26 04:56:12,622][123091] Updated weights for policy 0, policy_version 669915 (0.0010) [2023-12-26 04:56:12,687][123091] Updated weights for policy 0, policy_version 669925 (0.0010) [2023-12-26 04:56:12,753][123091] Updated weights for policy 0, policy_version 669935 (0.0007) [2023-12-26 04:56:12,979][123090] Updated weights for policy 1, policy_version 665414 (0.0007) [2023-12-26 04:56:13,041][123090] Updated weights for policy 1, policy_version 665424 (0.0005) [2023-12-26 04:56:13,100][123090] Updated weights for policy 1, policy_version 665434 (0.0005) [2023-12-26 04:56:13,468][123091] Updated weights for policy 0, policy_version 669945 (0.0005) [2023-12-26 04:56:13,529][123091] Updated weights for policy 0, policy_version 669955 (0.0006) [2023-12-26 04:56:13,584][123091] Updated weights for policy 0, policy_version 669965 (0.0009) [2023-12-26 04:56:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 341868544. Throughput: 0: 8827.3, 1: 8731.8. Samples: 341860996. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:13,785][121949] Avg episode reward: [(0, '6216.719'), (1, '4860.579')] [2023-12-26 04:56:13,849][123090] Updated weights for policy 1, policy_version 665444 (0.0007) [2023-12-26 04:56:13,911][123090] Updated weights for policy 1, policy_version 665454 (0.0005) [2023-12-26 04:56:13,965][123090] Updated weights for policy 1, policy_version 665464 (0.0005) [2023-12-26 04:56:14,378][123091] Updated weights for policy 0, policy_version 669975 (0.0009) [2023-12-26 04:56:14,430][123091] Updated weights for policy 0, policy_version 669985 (0.0007) [2023-12-26 04:56:14,479][123091] Updated weights for policy 0, policy_version 669995 (0.0005) [2023-12-26 04:56:14,698][123090] Updated weights for policy 1, policy_version 665474 (0.0008) [2023-12-26 04:56:14,770][123090] Updated weights for policy 1, policy_version 665484 (0.0009) [2023-12-26 04:56:14,838][123090] Updated weights for policy 1, policy_version 665494 (0.0011) [2023-12-26 04:56:14,904][123090] Updated weights for policy 1, policy_version 665504 (0.0010) [2023-12-26 04:56:15,271][123091] Updated weights for policy 0, policy_version 670005 (0.0008) [2023-12-26 04:56:15,364][123091] Updated weights for policy 0, policy_version 670015 (0.0011) [2023-12-26 04:56:15,419][123091] Updated weights for policy 0, policy_version 670025 (0.0010) [2023-12-26 04:56:15,663][123090] Updated weights for policy 1, policy_version 665514 (0.0006) [2023-12-26 04:56:15,719][123090] Updated weights for policy 1, policy_version 665524 (0.0005) [2023-12-26 04:56:15,777][123090] Updated weights for policy 1, policy_version 665534 (0.0005) [2023-12-26 04:56:16,238][123091] Updated weights for policy 0, policy_version 670035 (0.0011) [2023-12-26 04:56:16,300][123091] Updated weights for policy 0, policy_version 670045 (0.0010) [2023-12-26 04:56:16,358][123091] Updated weights for policy 0, policy_version 670055 (0.0010) [2023-12-26 04:56:16,509][123090] Updated weights for policy 1, policy_version 665544 (0.0005) [2023-12-26 04:56:16,575][123090] Updated weights for policy 1, policy_version 665554 (0.0006) [2023-12-26 04:56:16,639][123090] Updated weights for policy 1, policy_version 665564 (0.0010) [2023-12-26 04:56:17,158][123091] Updated weights for policy 0, policy_version 670065 (0.0010) [2023-12-26 04:56:17,221][123091] Updated weights for policy 0, policy_version 670075 (0.0005) [2023-12-26 04:56:17,273][123091] Updated weights for policy 0, policy_version 670085 (0.0005) [2023-12-26 04:56:17,325][123091] Updated weights for policy 0, policy_version 670095 (0.0005) [2023-12-26 04:56:17,450][123090] Updated weights for policy 1, policy_version 665574 (0.0007) [2023-12-26 04:56:17,503][123090] Updated weights for policy 1, policy_version 665584 (0.0005) [2023-12-26 04:56:17,558][123090] Updated weights for policy 1, policy_version 665594 (0.0005) [2023-12-26 04:56:17,948][123091] Updated weights for policy 0, policy_version 670105 (0.0005) [2023-12-26 04:56:18,009][123091] Updated weights for policy 0, policy_version 670115 (0.0005) [2023-12-26 04:56:18,070][123091] Updated weights for policy 0, policy_version 670125 (0.0006) [2023-12-26 04:56:18,256][123090] Updated weights for policy 1, policy_version 665604 (0.0007) [2023-12-26 04:56:18,309][123090] Updated weights for policy 1, policy_version 665614 (0.0010) [2023-12-26 04:56:18,376][123090] Updated weights for policy 1, policy_version 665624 (0.0009) [2023-12-26 04:56:18,735][123091] Updated weights for policy 0, policy_version 670135 (0.0006) [2023-12-26 04:56:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 341958656. Throughput: 0: 8828.8, 1: 8854.3. Samples: 341972572. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:18,785][121949] Avg episode reward: [(0, '6157.682'), (1, '4993.334')] [2023-12-26 04:56:18,796][123091] Updated weights for policy 0, policy_version 670145 (0.0006) [2023-12-26 04:56:18,871][123091] Updated weights for policy 0, policy_version 670155 (0.0010) [2023-12-26 04:56:19,114][123090] Updated weights for policy 1, policy_version 665634 (0.0009) [2023-12-26 04:56:19,171][123090] Updated weights for policy 1, policy_version 665644 (0.0006) [2023-12-26 04:56:19,237][123090] Updated weights for policy 1, policy_version 665654 (0.0006) [2023-12-26 04:56:19,303][123090] Updated weights for policy 1, policy_version 665664 (0.0007) [2023-12-26 04:56:19,564][123091] Updated weights for policy 0, policy_version 670165 (0.0007) [2023-12-26 04:56:19,615][123091] Updated weights for policy 0, policy_version 670175 (0.0006) [2023-12-26 04:56:19,680][123091] Updated weights for policy 0, policy_version 670185 (0.0009) [2023-12-26 04:56:20,086][123090] Updated weights for policy 1, policy_version 665674 (0.0011) [2023-12-26 04:56:20,150][123090] Updated weights for policy 1, policy_version 665684 (0.0011) [2023-12-26 04:56:20,217][123090] Updated weights for policy 1, policy_version 665694 (0.0009) [2023-12-26 04:56:20,581][123091] Updated weights for policy 0, policy_version 670195 (0.0009) [2023-12-26 04:56:20,657][123091] Updated weights for policy 0, policy_version 670205 (0.0010) [2023-12-26 04:56:20,733][123091] Updated weights for policy 0, policy_version 670215 (0.0010) [2023-12-26 04:56:21,022][123090] Updated weights for policy 1, policy_version 665704 (0.0010) [2023-12-26 04:56:21,093][123090] Updated weights for policy 1, policy_version 665714 (0.0009) [2023-12-26 04:56:21,168][123090] Updated weights for policy 1, policy_version 665724 (0.0009) [2023-12-26 04:56:21,569][123091] Updated weights for policy 0, policy_version 670225 (0.0010) [2023-12-26 04:56:21,626][123091] Updated weights for policy 0, policy_version 670235 (0.0009) [2023-12-26 04:56:21,690][123091] Updated weights for policy 0, policy_version 670245 (0.0009) [2023-12-26 04:56:21,759][123091] Updated weights for policy 0, policy_version 670255 (0.0010) [2023-12-26 04:56:22,034][123090] Updated weights for policy 1, policy_version 665734 (0.0008) [2023-12-26 04:56:22,106][123090] Updated weights for policy 1, policy_version 665744 (0.0010) [2023-12-26 04:56:22,174][123090] Updated weights for policy 1, policy_version 665754 (0.0010) [2023-12-26 04:56:22,510][123091] Updated weights for policy 0, policy_version 670265 (0.0010) [2023-12-26 04:56:22,577][123091] Updated weights for policy 0, policy_version 670275 (0.0006) [2023-12-26 04:56:22,652][123091] Updated weights for policy 0, policy_version 670285 (0.0008) [2023-12-26 04:56:23,058][123090] Updated weights for policy 1, policy_version 665764 (0.0010) [2023-12-26 04:56:23,122][123090] Updated weights for policy 1, policy_version 665774 (0.0008) [2023-12-26 04:56:23,186][123090] Updated weights for policy 1, policy_version 665784 (0.0009) [2023-12-26 04:56:23,426][123091] Updated weights for policy 0, policy_version 670295 (0.0010) [2023-12-26 04:56:23,494][123091] Updated weights for policy 0, policy_version 670305 (0.0011) [2023-12-26 04:56:23,557][123091] Updated weights for policy 0, policy_version 670315 (0.0011) [2023-12-26 04:56:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 342048768. Throughput: 0: 8765.2, 1: 8780.4. Samples: 342024724. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:23,785][121949] Avg episode reward: [(0, '6173.192'), (1, '5270.762')] [2023-12-26 04:56:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000670320_171606016.pth... [2023-12-26 04:56:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000665792_170442752.pth... [2023-12-26 04:56:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000669264_171335680.pth [2023-12-26 04:56:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000664800_170188800.pth [2023-12-26 04:56:24,008][123090] Updated weights for policy 1, policy_version 665794 (0.0008) [2023-12-26 04:56:24,077][123090] Updated weights for policy 1, policy_version 665804 (0.0010) [2023-12-26 04:56:24,148][123090] Updated weights for policy 1, policy_version 665814 (0.0010) [2023-12-26 04:56:24,212][123090] Updated weights for policy 1, policy_version 665824 (0.0010) [2023-12-26 04:56:24,261][123091] Updated weights for policy 0, policy_version 670325 (0.0008) [2023-12-26 04:56:24,333][123091] Updated weights for policy 0, policy_version 670335 (0.0005) [2023-12-26 04:56:24,404][123091] Updated weights for policy 0, policy_version 670345 (0.0005) [2023-12-26 04:56:24,931][123090] Updated weights for policy 1, policy_version 665834 (0.0005) [2023-12-26 04:56:24,991][123090] Updated weights for policy 1, policy_version 665844 (0.0005) [2023-12-26 04:56:25,049][123090] Updated weights for policy 1, policy_version 665854 (0.0009) [2023-12-26 04:56:25,164][123091] Updated weights for policy 0, policy_version 670355 (0.0008) [2023-12-26 04:56:25,215][123091] Updated weights for policy 0, policy_version 670365 (0.0010) [2023-12-26 04:56:25,269][123091] Updated weights for policy 0, policy_version 670375 (0.0010) [2023-12-26 04:56:25,715][123090] Updated weights for policy 1, policy_version 665864 (0.0005) [2023-12-26 04:56:25,777][123090] Updated weights for policy 1, policy_version 665874 (0.0005) [2023-12-26 04:56:25,836][123090] Updated weights for policy 1, policy_version 665884 (0.0005) [2023-12-26 04:56:26,051][123091] Updated weights for policy 0, policy_version 670385 (0.0010) [2023-12-26 04:56:26,108][123091] Updated weights for policy 0, policy_version 670395 (0.0009) [2023-12-26 04:56:26,157][123091] Updated weights for policy 0, policy_version 670405 (0.0011) [2023-12-26 04:56:26,213][123091] Updated weights for policy 0, policy_version 670415 (0.0011) [2023-12-26 04:56:26,473][123090] Updated weights for policy 1, policy_version 665894 (0.0005) [2023-12-26 04:56:26,539][123090] Updated weights for policy 1, policy_version 665904 (0.0006) [2023-12-26 04:56:26,612][123090] Updated weights for policy 1, policy_version 665914 (0.0007) [2023-12-26 04:56:27,044][123091] Updated weights for policy 0, policy_version 670425 (0.0011) [2023-12-26 04:56:27,102][123091] Updated weights for policy 0, policy_version 670435 (0.0010) [2023-12-26 04:56:27,165][123091] Updated weights for policy 0, policy_version 670445 (0.0011) [2023-12-26 04:56:27,180][123090] Updated weights for policy 1, policy_version 665924 (0.0006) [2023-12-26 04:56:27,242][123090] Updated weights for policy 1, policy_version 665934 (0.0007) [2023-12-26 04:56:27,313][123090] Updated weights for policy 1, policy_version 665944 (0.0006) [2023-12-26 04:56:28,006][123091] Updated weights for policy 0, policy_version 670455 (0.0011) [2023-12-26 04:56:28,018][123090] Updated weights for policy 1, policy_version 665954 (0.0006) [2023-12-26 04:56:28,057][123091] Updated weights for policy 0, policy_version 670465 (0.0010) [2023-12-26 04:56:28,080][123090] Updated weights for policy 1, policy_version 665964 (0.0005) [2023-12-26 04:56:28,111][123091] Updated weights for policy 0, policy_version 670475 (0.0010) [2023-12-26 04:56:28,143][123090] Updated weights for policy 1, policy_version 665974 (0.0006) [2023-12-26 04:56:28,207][123090] Updated weights for policy 1, policy_version 665984 (0.0010) [2023-12-26 04:56:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 342138880. Throughput: 0: 8877.1, 1: 8835.6. Samples: 342134532. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:28,785][121949] Avg episode reward: [(0, '6140.371'), (1, '5340.013')] [2023-12-26 04:56:28,965][123090] Updated weights for policy 1, policy_version 665994 (0.0010) [2023-12-26 04:56:28,977][123091] Updated weights for policy 0, policy_version 670485 (0.0008) [2023-12-26 04:56:29,028][123090] Updated weights for policy 1, policy_version 666004 (0.0010) [2023-12-26 04:56:29,033][123091] Updated weights for policy 0, policy_version 670495 (0.0009) [2023-12-26 04:56:29,096][123090] Updated weights for policy 1, policy_version 666014 (0.0008) [2023-12-26 04:56:29,101][123091] Updated weights for policy 0, policy_version 670505 (0.0008) [2023-12-26 04:56:29,768][123090] Updated weights for policy 1, policy_version 666024 (0.0005) [2023-12-26 04:56:29,821][123090] Updated weights for policy 1, policy_version 666034 (0.0006) [2023-12-26 04:56:29,885][123090] Updated weights for policy 1, policy_version 666044 (0.0010) [2023-12-26 04:56:29,955][123091] Updated weights for policy 0, policy_version 670516 (0.0008) [2023-12-26 04:56:30,011][123091] Updated weights for policy 0, policy_version 670526 (0.0008) [2023-12-26 04:56:30,065][123091] Updated weights for policy 0, policy_version 670536 (0.0006) [2023-12-26 04:56:30,693][123090] Updated weights for policy 1, policy_version 666054 (0.0010) [2023-12-26 04:56:30,748][123090] Updated weights for policy 1, policy_version 666064 (0.0010) [2023-12-26 04:56:30,779][123091] Updated weights for policy 0, policy_version 670546 (0.0005) [2023-12-26 04:56:30,799][123090] Updated weights for policy 1, policy_version 666074 (0.0010) [2023-12-26 04:56:30,828][123091] Updated weights for policy 0, policy_version 670556 (0.0005) [2023-12-26 04:56:30,883][123091] Updated weights for policy 0, policy_version 670566 (0.0005) [2023-12-26 04:56:30,934][123091] Updated weights for policy 0, policy_version 670576 (0.0007) [2023-12-26 04:56:31,595][123090] Updated weights for policy 1, policy_version 666084 (0.0009) [2023-12-26 04:56:31,665][123090] Updated weights for policy 1, policy_version 666094 (0.0008) [2023-12-26 04:56:31,732][123091] Updated weights for policy 0, policy_version 670586 (0.0010) [2023-12-26 04:56:31,737][123090] Updated weights for policy 1, policy_version 666104 (0.0008) [2023-12-26 04:56:31,798][123091] Updated weights for policy 0, policy_version 670596 (0.0006) [2023-12-26 04:56:31,876][123091] Updated weights for policy 0, policy_version 670606 (0.0006) [2023-12-26 04:56:32,451][123090] Updated weights for policy 1, policy_version 666114 (0.0009) [2023-12-26 04:56:32,513][123090] Updated weights for policy 1, policy_version 666124 (0.0009) [2023-12-26 04:56:32,576][123090] Updated weights for policy 1, policy_version 666134 (0.0009) [2023-12-26 04:56:32,603][123091] Updated weights for policy 0, policy_version 670616 (0.0009) [2023-12-26 04:56:32,639][123090] Updated weights for policy 1, policy_version 666144 (0.0008) [2023-12-26 04:56:32,667][123091] Updated weights for policy 0, policy_version 670626 (0.0007) [2023-12-26 04:56:32,731][123091] Updated weights for policy 0, policy_version 670636 (0.0008) [2023-12-26 04:56:33,426][123090] Updated weights for policy 1, policy_version 666154 (0.0005) [2023-12-26 04:56:33,488][123090] Updated weights for policy 1, policy_version 666164 (0.0005) [2023-12-26 04:56:33,517][123091] Updated weights for policy 0, policy_version 670646 (0.0009) [2023-12-26 04:56:33,539][123090] Updated weights for policy 1, policy_version 666174 (0.0005) [2023-12-26 04:56:33,576][123091] Updated weights for policy 0, policy_version 670656 (0.0007) [2023-12-26 04:56:33,643][123091] Updated weights for policy 0, policy_version 670666 (0.0005) [2023-12-26 04:56:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 342237184. Throughput: 0: 8925.8, 1: 8805.9. Samples: 342244580. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:33,785][121949] Avg episode reward: [(0, '6054.514'), (1, '5255.957')] [2023-12-26 04:56:34,158][123090] Updated weights for policy 1, policy_version 666184 (0.0009) [2023-12-26 04:56:34,226][123090] Updated weights for policy 1, policy_version 666194 (0.0011) [2023-12-26 04:56:34,294][123090] Updated weights for policy 1, policy_version 666204 (0.0011) [2023-12-26 04:56:34,371][123091] Updated weights for policy 0, policy_version 670676 (0.0007) [2023-12-26 04:56:34,439][123091] Updated weights for policy 0, policy_version 670686 (0.0010) [2023-12-26 04:56:34,502][123091] Updated weights for policy 0, policy_version 670696 (0.0010) [2023-12-26 04:56:34,964][123090] Updated weights for policy 1, policy_version 666214 (0.0006) [2023-12-26 04:56:35,028][123090] Updated weights for policy 1, policy_version 666224 (0.0008) [2023-12-26 04:56:35,077][123090] Updated weights for policy 1, policy_version 666234 (0.0005) [2023-12-26 04:56:35,382][123091] Updated weights for policy 0, policy_version 670706 (0.0011) [2023-12-26 04:56:35,431][123091] Updated weights for policy 0, policy_version 670716 (0.0009) [2023-12-26 04:56:35,481][123091] Updated weights for policy 0, policy_version 670726 (0.0009) [2023-12-26 04:56:35,532][123091] Updated weights for policy 0, policy_version 670736 (0.0009) [2023-12-26 04:56:35,820][123090] Updated weights for policy 1, policy_version 666244 (0.0006) [2023-12-26 04:56:35,879][123090] Updated weights for policy 1, policy_version 666254 (0.0009) [2023-12-26 04:56:35,941][123090] Updated weights for policy 1, policy_version 666264 (0.0009) [2023-12-26 04:56:36,451][123091] Updated weights for policy 0, policy_version 670746 (0.0010) [2023-12-26 04:56:36,516][123091] Updated weights for policy 0, policy_version 670756 (0.0010) [2023-12-26 04:56:36,583][123091] Updated weights for policy 0, policy_version 670766 (0.0010) [2023-12-26 04:56:36,768][123090] Updated weights for policy 1, policy_version 666274 (0.0010) [2023-12-26 04:56:36,826][123090] Updated weights for policy 1, policy_version 666284 (0.0010) [2023-12-26 04:56:36,885][123090] Updated weights for policy 1, policy_version 666294 (0.0009) [2023-12-26 04:56:36,944][123090] Updated weights for policy 1, policy_version 666304 (0.0009) [2023-12-26 04:56:37,414][123091] Updated weights for policy 0, policy_version 670776 (0.0010) [2023-12-26 04:56:37,472][123091] Updated weights for policy 0, policy_version 670786 (0.0009) [2023-12-26 04:56:37,535][123091] Updated weights for policy 0, policy_version 670796 (0.0009) [2023-12-26 04:56:37,761][123090] Updated weights for policy 1, policy_version 666314 (0.0011) [2023-12-26 04:56:37,835][123090] Updated weights for policy 1, policy_version 666324 (0.0011) [2023-12-26 04:56:37,914][123090] Updated weights for policy 1, policy_version 666334 (0.0011) [2023-12-26 04:56:38,236][123091] Updated weights for policy 0, policy_version 670806 (0.0007) [2023-12-26 04:56:38,299][123091] Updated weights for policy 0, policy_version 670816 (0.0005) [2023-12-26 04:56:38,370][123091] Updated weights for policy 0, policy_version 670826 (0.0007) [2023-12-26 04:56:38,645][123090] Updated weights for policy 1, policy_version 666344 (0.0010) [2023-12-26 04:56:38,706][123090] Updated weights for policy 1, policy_version 666354 (0.0009) [2023-12-26 04:56:38,768][123090] Updated weights for policy 1, policy_version 666364 (0.0010) [2023-12-26 04:56:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 342319104. Throughput: 0: 8909.7, 1: 8890.1. Samples: 342298544. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:38,785][121949] Avg episode reward: [(0, '6098.667'), (1, '5232.919')] [2023-12-26 04:56:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000670832_171737088.pth... [2023-12-26 04:56:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000666368_170590208.pth... [2023-12-26 04:56:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000669808_171474944.pth [2023-12-26 04:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000665280_170311680.pth [2023-12-26 04:56:39,084][123091] Updated weights for policy 0, policy_version 670837 (0.0007) [2023-12-26 04:56:39,150][123091] Updated weights for policy 0, policy_version 670847 (0.0011) [2023-12-26 04:56:39,215][123091] Updated weights for policy 0, policy_version 670857 (0.0011) [2023-12-26 04:56:39,673][123090] Updated weights for policy 1, policy_version 666374 (0.0009) [2023-12-26 04:56:39,749][123090] Updated weights for policy 1, policy_version 666384 (0.0009) [2023-12-26 04:56:39,808][123090] Updated weights for policy 1, policy_version 666394 (0.0009) [2023-12-26 04:56:40,042][123091] Updated weights for policy 0, policy_version 670867 (0.0009) [2023-12-26 04:56:40,093][123091] Updated weights for policy 0, policy_version 670877 (0.0006) [2023-12-26 04:56:40,153][123091] Updated weights for policy 0, policy_version 670887 (0.0011) [2023-12-26 04:56:40,691][123090] Updated weights for policy 1, policy_version 666404 (0.0008) [2023-12-26 04:56:40,749][123090] Updated weights for policy 1, policy_version 666414 (0.0009) [2023-12-26 04:56:40,804][123090] Updated weights for policy 1, policy_version 666424 (0.0010) [2023-12-26 04:56:40,874][123091] Updated weights for policy 0, policy_version 670897 (0.0010) [2023-12-26 04:56:40,931][123091] Updated weights for policy 0, policy_version 670907 (0.0006) [2023-12-26 04:56:41,003][123091] Updated weights for policy 0, policy_version 670917 (0.0006) [2023-12-26 04:56:41,081][123091] Updated weights for policy 0, policy_version 670927 (0.0007) [2023-12-26 04:56:41,701][123090] Updated weights for policy 1, policy_version 666434 (0.0010) [2023-12-26 04:56:41,761][123090] Updated weights for policy 1, policy_version 666444 (0.0009) [2023-12-26 04:56:41,819][123090] Updated weights for policy 1, policy_version 666454 (0.0008) [2023-12-26 04:56:41,830][123091] Updated weights for policy 0, policy_version 670937 (0.0007) [2023-12-26 04:56:41,884][123090] Updated weights for policy 1, policy_version 666464 (0.0008) [2023-12-26 04:56:41,893][123091] Updated weights for policy 0, policy_version 670947 (0.0011) [2023-12-26 04:56:41,960][123091] Updated weights for policy 0, policy_version 670957 (0.0011) [2023-12-26 04:56:42,766][123090] Updated weights for policy 1, policy_version 666474 (0.0009) [2023-12-26 04:56:42,784][123091] Updated weights for policy 0, policy_version 670967 (0.0011) [2023-12-26 04:56:42,834][123090] Updated weights for policy 1, policy_version 666484 (0.0007) [2023-12-26 04:56:42,844][123091] Updated weights for policy 0, policy_version 670977 (0.0011) [2023-12-26 04:56:42,895][123090] Updated weights for policy 1, policy_version 666494 (0.0006) [2023-12-26 04:56:42,897][123091] Updated weights for policy 0, policy_version 670987 (0.0011) [2023-12-26 04:56:43,728][123091] Updated weights for policy 0, policy_version 670997 (0.0010) [2023-12-26 04:56:43,736][123090] Updated weights for policy 1, policy_version 666504 (0.0007) [2023-12-26 04:56:43,778][123091] Updated weights for policy 0, policy_version 671007 (0.0010) [2023-12-26 04:56:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 342401024. Throughput: 0: 8854.2, 1: 8921.3. Samples: 342402740. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:43,784][121949] Avg episode reward: [(0, '6074.588'), (1, '5418.913')] [2023-12-26 04:56:43,794][123090] Updated weights for policy 1, policy_version 666514 (0.0008) [2023-12-26 04:56:43,822][123091] Updated weights for policy 0, policy_version 671017 (0.0010) [2023-12-26 04:56:43,846][123090] Updated weights for policy 1, policy_version 666524 (0.0005) [2023-12-26 04:56:44,676][123091] Updated weights for policy 0, policy_version 671027 (0.0010) [2023-12-26 04:56:44,682][123090] Updated weights for policy 1, policy_version 666534 (0.0008) [2023-12-26 04:56:44,727][123091] Updated weights for policy 0, policy_version 671037 (0.0010) [2023-12-26 04:56:44,730][123090] Updated weights for policy 1, policy_version 666544 (0.0007) [2023-12-26 04:56:44,784][123091] Updated weights for policy 0, policy_version 671047 (0.0010) [2023-12-26 04:56:44,796][123090] Updated weights for policy 1, policy_version 666554 (0.0008) [2023-12-26 04:56:45,506][123090] Updated weights for policy 1, policy_version 666564 (0.0009) [2023-12-26 04:56:45,571][123090] Updated weights for policy 1, policy_version 666574 (0.0010) [2023-12-26 04:56:45,630][123090] Updated weights for policy 1, policy_version 666584 (0.0010) [2023-12-26 04:56:45,637][123091] Updated weights for policy 0, policy_version 671057 (0.0011) [2023-12-26 04:56:45,706][123091] Updated weights for policy 0, policy_version 671067 (0.0010) [2023-12-26 04:56:45,764][123091] Updated weights for policy 0, policy_version 671077 (0.0010) [2023-12-26 04:56:45,822][123091] Updated weights for policy 0, policy_version 671087 (0.0010) [2023-12-26 04:56:46,383][123090] Updated weights for policy 1, policy_version 666594 (0.0010) [2023-12-26 04:56:46,445][123090] Updated weights for policy 1, policy_version 666604 (0.0010) [2023-12-26 04:56:46,506][123090] Updated weights for policy 1, policy_version 666614 (0.0009) [2023-12-26 04:56:46,565][123090] Updated weights for policy 1, policy_version 666624 (0.0008) [2023-12-26 04:56:46,641][123091] Updated weights for policy 0, policy_version 671097 (0.0010) [2023-12-26 04:56:46,695][123091] Updated weights for policy 0, policy_version 671107 (0.0010) [2023-12-26 04:56:46,746][123091] Updated weights for policy 0, policy_version 671117 (0.0010) [2023-12-26 04:56:47,342][123090] Updated weights for policy 1, policy_version 666634 (0.0009) [2023-12-26 04:56:47,395][123090] Updated weights for policy 1, policy_version 666644 (0.0009) [2023-12-26 04:56:47,444][123090] Updated weights for policy 1, policy_version 666654 (0.0009) [2023-12-26 04:56:47,580][123091] Updated weights for policy 0, policy_version 671127 (0.0010) [2023-12-26 04:56:47,639][123091] Updated weights for policy 0, policy_version 671138 (0.0009) [2023-12-26 04:56:47,698][123091] Updated weights for policy 0, policy_version 671149 (0.0010) [2023-12-26 04:56:48,304][123090] Updated weights for policy 1, policy_version 666664 (0.0009) [2023-12-26 04:56:48,362][123090] Updated weights for policy 1, policy_version 666674 (0.0009) [2023-12-26 04:56:48,429][123090] Updated weights for policy 1, policy_version 666684 (0.0009) [2023-12-26 04:56:48,452][123091] Updated weights for policy 0, policy_version 671159 (0.0007) [2023-12-26 04:56:48,514][123091] Updated weights for policy 0, policy_version 671169 (0.0007) [2023-12-26 04:56:48,584][123091] Updated weights for policy 0, policy_version 671179 (0.0011) [2023-12-26 04:56:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 342499328. Throughput: 0: 8861.4, 1: 8978.2. Samples: 342507796. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:48,784][121949] Avg episode reward: [(0, '6023.033'), (1, '5566.732')] [2023-12-26 04:56:49,286][123090] Updated weights for policy 1, policy_version 666694 (0.0009) [2023-12-26 04:56:49,334][123091] Updated weights for policy 0, policy_version 671189 (0.0011) [2023-12-26 04:56:49,357][123090] Updated weights for policy 1, policy_version 666704 (0.0008) [2023-12-26 04:56:49,399][123091] Updated weights for policy 0, policy_version 671199 (0.0011) [2023-12-26 04:56:49,422][123090] Updated weights for policy 1, policy_version 666714 (0.0009) [2023-12-26 04:56:49,454][123091] Updated weights for policy 0, policy_version 671209 (0.0010) [2023-12-26 04:56:50,202][123091] Updated weights for policy 0, policy_version 671219 (0.0009) [2023-12-26 04:56:50,260][123091] Updated weights for policy 0, policy_version 671229 (0.0006) [2023-12-26 04:56:50,264][123090] Updated weights for policy 1, policy_version 666724 (0.0007) [2023-12-26 04:56:50,325][123091] Updated weights for policy 0, policy_version 671239 (0.0009) [2023-12-26 04:56:50,328][123090] Updated weights for policy 1, policy_version 666734 (0.0008) [2023-12-26 04:56:50,380][123090] Updated weights for policy 1, policy_version 666744 (0.0007) [2023-12-26 04:56:51,066][123091] Updated weights for policy 0, policy_version 671249 (0.0010) [2023-12-26 04:56:51,130][123091] Updated weights for policy 0, policy_version 671259 (0.0010) [2023-12-26 04:56:51,200][123091] Updated weights for policy 0, policy_version 671269 (0.0008) [2023-12-26 04:56:51,273][123091] Updated weights for policy 0, policy_version 671279 (0.0007) [2023-12-26 04:56:51,289][123090] Updated weights for policy 1, policy_version 666754 (0.0009) [2023-12-26 04:56:51,359][123090] Updated weights for policy 1, policy_version 666764 (0.0010) [2023-12-26 04:56:51,424][123090] Updated weights for policy 1, policy_version 666774 (0.0010) [2023-12-26 04:56:51,481][123090] Updated weights for policy 1, policy_version 666784 (0.0008) [2023-12-26 04:56:52,088][123091] Updated weights for policy 0, policy_version 671289 (0.0010) [2023-12-26 04:56:52,146][123091] Updated weights for policy 0, policy_version 671299 (0.0010) [2023-12-26 04:56:52,206][123091] Updated weights for policy 0, policy_version 671309 (0.0010) [2023-12-26 04:56:52,273][123090] Updated weights for policy 1, policy_version 666794 (0.0008) [2023-12-26 04:56:52,342][123090] Updated weights for policy 1, policy_version 666804 (0.0010) [2023-12-26 04:56:52,409][123090] Updated weights for policy 1, policy_version 666814 (0.0008) [2023-12-26 04:56:53,065][123091] Updated weights for policy 0, policy_version 671319 (0.0006) [2023-12-26 04:56:53,133][123091] Updated weights for policy 0, policy_version 671329 (0.0005) [2023-12-26 04:56:53,198][123091] Updated weights for policy 0, policy_version 671339 (0.0006) [2023-12-26 04:56:53,217][123090] Updated weights for policy 1, policy_version 666824 (0.0007) [2023-12-26 04:56:53,272][123090] Updated weights for policy 1, policy_version 666834 (0.0009) [2023-12-26 04:56:53,320][123090] Updated weights for policy 1, policy_version 666844 (0.0009) [2023-12-26 04:56:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 342581248. Throughput: 0: 8909.5, 1: 8952.3. Samples: 342559888. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:53,785][121949] Avg episode reward: [(0, '6023.554'), (1, '5576.820')] [2023-12-26 04:56:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000666848_170713088.pth... [2023-12-26 04:56:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000665792_170442752.pth [2023-12-26 04:56:53,834][123091] Updated weights for policy 0, policy_version 671349 (0.0005) [2023-12-26 04:56:53,889][123091] Updated weights for policy 0, policy_version 671359 (0.0007) [2023-12-26 04:56:53,946][123091] Updated weights for policy 0, policy_version 671369 (0.0009) [2023-12-26 04:56:53,988][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000671376_171876352.pth... [2023-12-26 04:56:53,991][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000670320_171606016.pth [2023-12-26 04:56:54,216][123090] Updated weights for policy 1, policy_version 666854 (0.0010) [2023-12-26 04:56:54,277][123090] Updated weights for policy 1, policy_version 666864 (0.0009) [2023-12-26 04:56:54,334][123090] Updated weights for policy 1, policy_version 666875 (0.0010) [2023-12-26 04:56:54,650][123091] Updated weights for policy 0, policy_version 671379 (0.0007) [2023-12-26 04:56:54,721][123091] Updated weights for policy 0, policy_version 671389 (0.0006) [2023-12-26 04:56:54,785][123091] Updated weights for policy 0, policy_version 671399 (0.0005) [2023-12-26 04:56:55,270][123090] Updated weights for policy 1, policy_version 666885 (0.0010) [2023-12-26 04:56:55,335][123090] Updated weights for policy 1, policy_version 666895 (0.0010) [2023-12-26 04:56:55,409][123090] Updated weights for policy 1, policy_version 666905 (0.0010) [2023-12-26 04:56:55,422][123091] Updated weights for policy 0, policy_version 671409 (0.0006) [2023-12-26 04:56:55,482][123091] Updated weights for policy 0, policy_version 671419 (0.0008) [2023-12-26 04:56:55,536][123091] Updated weights for policy 0, policy_version 671429 (0.0009) [2023-12-26 04:56:55,585][123091] Updated weights for policy 0, policy_version 671439 (0.0009) [2023-12-26 04:56:56,252][123090] Updated weights for policy 1, policy_version 666915 (0.0010) [2023-12-26 04:56:56,301][123090] Updated weights for policy 1, policy_version 666925 (0.0009) [2023-12-26 04:56:56,362][123090] Updated weights for policy 1, policy_version 666935 (0.0008) [2023-12-26 04:56:56,369][123091] Updated weights for policy 0, policy_version 671449 (0.0008) [2023-12-26 04:56:56,426][123091] Updated weights for policy 0, policy_version 671459 (0.0009) [2023-12-26 04:56:56,480][123091] Updated weights for policy 0, policy_version 671469 (0.0009) [2023-12-26 04:56:57,197][123091] Updated weights for policy 0, policy_version 671479 (0.0007) [2023-12-26 04:56:57,252][123091] Updated weights for policy 0, policy_version 671489 (0.0005) [2023-12-26 04:56:57,262][123090] Updated weights for policy 1, policy_version 666945 (0.0009) [2023-12-26 04:56:57,309][123091] Updated weights for policy 0, policy_version 671499 (0.0006) [2023-12-26 04:56:57,322][123090] Updated weights for policy 1, policy_version 666955 (0.0009) [2023-12-26 04:56:57,373][123090] Updated weights for policy 1, policy_version 666965 (0.0010) [2023-12-26 04:56:57,426][123090] Updated weights for policy 1, policy_version 666975 (0.0009) [2023-12-26 04:56:58,105][123091] Updated weights for policy 0, policy_version 671509 (0.0008) [2023-12-26 04:56:58,174][123091] Updated weights for policy 0, policy_version 671519 (0.0009) [2023-12-26 04:56:58,242][123091] Updated weights for policy 0, policy_version 671529 (0.0009) [2023-12-26 04:56:58,311][123090] Updated weights for policy 1, policy_version 666985 (0.0009) [2023-12-26 04:56:58,390][123090] Updated weights for policy 1, policy_version 666995 (0.0008) [2023-12-26 04:56:58,462][123090] Updated weights for policy 1, policy_version 667005 (0.0007) [2023-12-26 04:56:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 342671360. Throughput: 0: 9011.5, 1: 8876.1. Samples: 342665936. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:56:58,785][121949] Avg episode reward: [(0, '6174.288'), (1, '5293.635')] [2023-12-26 04:56:59,187][123091] Updated weights for policy 0, policy_version 671539 (0.0010) [2023-12-26 04:56:59,260][123091] Updated weights for policy 0, policy_version 671549 (0.0010) [2023-12-26 04:56:59,298][123090] Updated weights for policy 1, policy_version 667015 (0.0007) [2023-12-26 04:56:59,324][123091] Updated weights for policy 0, policy_version 671559 (0.0010) [2023-12-26 04:56:59,366][123090] Updated weights for policy 1, policy_version 667025 (0.0008) [2023-12-26 04:56:59,433][123090] Updated weights for policy 1, policy_version 667035 (0.0007) [2023-12-26 04:57:00,145][123091] Updated weights for policy 0, policy_version 671569 (0.0009) [2023-12-26 04:57:00,209][123091] Updated weights for policy 0, policy_version 671579 (0.0009) [2023-12-26 04:57:00,245][123090] Updated weights for policy 1, policy_version 667045 (0.0009) [2023-12-26 04:57:00,261][123091] Updated weights for policy 0, policy_version 671589 (0.0007) [2023-12-26 04:57:00,307][123090] Updated weights for policy 1, policy_version 667055 (0.0009) [2023-12-26 04:57:00,324][123091] Updated weights for policy 0, policy_version 671599 (0.0005) [2023-12-26 04:57:00,374][123090] Updated weights for policy 1, policy_version 667065 (0.0009) [2023-12-26 04:57:01,153][123090] Updated weights for policy 1, policy_version 667075 (0.0009) [2023-12-26 04:57:01,177][123091] Updated weights for policy 0, policy_version 671609 (0.0008) [2023-12-26 04:57:01,214][123090] Updated weights for policy 1, policy_version 667085 (0.0008) [2023-12-26 04:57:01,238][123091] Updated weights for policy 0, policy_version 671619 (0.0009) [2023-12-26 04:57:01,273][123090] Updated weights for policy 1, policy_version 667095 (0.0008) [2023-12-26 04:57:01,302][123091] Updated weights for policy 0, policy_version 671629 (0.0009) [2023-12-26 04:57:02,063][123090] Updated weights for policy 1, policy_version 667105 (0.0008) [2023-12-26 04:57:02,128][123090] Updated weights for policy 1, policy_version 667115 (0.0008) [2023-12-26 04:57:02,157][123091] Updated weights for policy 0, policy_version 671639 (0.0008) [2023-12-26 04:57:02,197][123090] Updated weights for policy 1, policy_version 667125 (0.0008) [2023-12-26 04:57:02,204][123091] Updated weights for policy 0, policy_version 671649 (0.0008) [2023-12-26 04:57:02,265][123091] Updated weights for policy 0, policy_version 671659 (0.0009) [2023-12-26 04:57:02,265][123090] Updated weights for policy 1, policy_version 667135 (0.0008) [2023-12-26 04:57:02,943][123090] Updated weights for policy 1, policy_version 667145 (0.0005) [2023-12-26 04:57:02,999][123090] Updated weights for policy 1, policy_version 667155 (0.0005) [2023-12-26 04:57:03,056][123090] Updated weights for policy 1, policy_version 667165 (0.0010) [2023-12-26 04:57:03,174][123091] Updated weights for policy 0, policy_version 671669 (0.0009) [2023-12-26 04:57:03,237][123091] Updated weights for policy 0, policy_version 671679 (0.0010) [2023-12-26 04:57:03,289][123091] Updated weights for policy 0, policy_version 671689 (0.0009) [2023-12-26 04:57:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 342753280. Throughput: 0: 8843.0, 1: 8824.7. Samples: 342767616. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:03,784][121949] Avg episode reward: [(0, '6317.357'), (1, '5014.853')] [2023-12-26 04:57:03,805][123090] Updated weights for policy 1, policy_version 667175 (0.0007) [2023-12-26 04:57:03,881][123090] Updated weights for policy 1, policy_version 667185 (0.0009) [2023-12-26 04:57:03,953][123090] Updated weights for policy 1, policy_version 667195 (0.0009) [2023-12-26 04:57:04,151][123091] Updated weights for policy 0, policy_version 671699 (0.0010) [2023-12-26 04:57:04,217][123091] Updated weights for policy 0, policy_version 671709 (0.0010) [2023-12-26 04:57:04,286][123091] Updated weights for policy 0, policy_version 671719 (0.0010) [2023-12-26 04:57:04,784][123090] Updated weights for policy 1, policy_version 667205 (0.0010) [2023-12-26 04:57:04,839][123090] Updated weights for policy 1, policy_version 667215 (0.0009) [2023-12-26 04:57:04,899][123090] Updated weights for policy 1, policy_version 667225 (0.0008) [2023-12-26 04:57:05,084][123091] Updated weights for policy 0, policy_version 671729 (0.0010) [2023-12-26 04:57:05,160][123091] Updated weights for policy 0, policy_version 671739 (0.0009) [2023-12-26 04:57:05,226][123091] Updated weights for policy 0, policy_version 671749 (0.0010) [2023-12-26 04:57:05,294][123091] Updated weights for policy 0, policy_version 671759 (0.0009) [2023-12-26 04:57:05,669][123090] Updated weights for policy 1, policy_version 667235 (0.0010) [2023-12-26 04:57:05,720][123090] Updated weights for policy 1, policy_version 667245 (0.0010) [2023-12-26 04:57:05,775][123090] Updated weights for policy 1, policy_version 667255 (0.0010) [2023-12-26 04:57:06,120][123091] Updated weights for policy 0, policy_version 671769 (0.0009) [2023-12-26 04:57:06,177][123091] Updated weights for policy 0, policy_version 671779 (0.0009) [2023-12-26 04:57:06,233][123091] Updated weights for policy 0, policy_version 671789 (0.0009) [2023-12-26 04:57:06,627][123090] Updated weights for policy 1, policy_version 667265 (0.0010) [2023-12-26 04:57:06,687][123090] Updated weights for policy 1, policy_version 667275 (0.0010) [2023-12-26 04:57:06,754][123090] Updated weights for policy 1, policy_version 667285 (0.0010) [2023-12-26 04:57:06,825][123090] Updated weights for policy 1, policy_version 667295 (0.0011) [2023-12-26 04:57:07,015][123091] Updated weights for policy 0, policy_version 671799 (0.0009) [2023-12-26 04:57:07,068][123091] Updated weights for policy 0, policy_version 671809 (0.0009) [2023-12-26 04:57:07,118][123091] Updated weights for policy 0, policy_version 671819 (0.0009) [2023-12-26 04:57:07,575][123090] Updated weights for policy 1, policy_version 667305 (0.0006) [2023-12-26 04:57:07,643][123090] Updated weights for policy 1, policy_version 667315 (0.0009) [2023-12-26 04:57:07,695][123090] Updated weights for policy 1, policy_version 667325 (0.0008) [2023-12-26 04:57:08,036][123091] Updated weights for policy 0, policy_version 671829 (0.0009) [2023-12-26 04:57:08,097][123091] Updated weights for policy 0, policy_version 671839 (0.0009) [2023-12-26 04:57:08,160][123091] Updated weights for policy 0, policy_version 671849 (0.0009) [2023-12-26 04:57:08,297][123090] Updated weights for policy 1, policy_version 667335 (0.0005) [2023-12-26 04:57:08,384][123090] Updated weights for policy 1, policy_version 667345 (0.0009) [2023-12-26 04:57:08,441][123090] Updated weights for policy 1, policy_version 667355 (0.0010) [2023-12-26 04:57:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 342843392. Throughput: 0: 8835.4, 1: 8816.5. Samples: 342819056. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:08,785][121949] Avg episode reward: [(0, '6229.023'), (1, '5224.515')] [2023-12-26 04:57:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000671856_171999232.pth... [2023-12-26 04:57:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000667360_170844160.pth... [2023-12-26 04:57:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000670832_171737088.pth [2023-12-26 04:57:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000666368_170590208.pth [2023-12-26 04:57:09,006][123091] Updated weights for policy 0, policy_version 671859 (0.0010) [2023-12-26 04:57:09,076][123091] Updated weights for policy 0, policy_version 671869 (0.0010) [2023-12-26 04:57:09,131][123091] Updated weights for policy 0, policy_version 671879 (0.0009) [2023-12-26 04:57:09,272][123090] Updated weights for policy 1, policy_version 667365 (0.0009) [2023-12-26 04:57:09,331][123090] Updated weights for policy 1, policy_version 667375 (0.0010) [2023-12-26 04:57:09,404][123090] Updated weights for policy 1, policy_version 667385 (0.0009) [2023-12-26 04:57:09,899][123091] Updated weights for policy 0, policy_version 671889 (0.0009) [2023-12-26 04:57:09,975][123091] Updated weights for policy 0, policy_version 671899 (0.0008) [2023-12-26 04:57:10,040][123091] Updated weights for policy 0, policy_version 671909 (0.0010) [2023-12-26 04:57:10,103][123091] Updated weights for policy 0, policy_version 671919 (0.0009) [2023-12-26 04:57:10,162][123090] Updated weights for policy 1, policy_version 667395 (0.0009) [2023-12-26 04:57:10,235][123090] Updated weights for policy 1, policy_version 667405 (0.0009) [2023-12-26 04:57:10,303][123090] Updated weights for policy 1, policy_version 667415 (0.0010) [2023-12-26 04:57:10,909][123091] Updated weights for policy 0, policy_version 671929 (0.0010) [2023-12-26 04:57:10,966][123091] Updated weights for policy 0, policy_version 671939 (0.0009) [2023-12-26 04:57:11,020][123091] Updated weights for policy 0, policy_version 671950 (0.0010) [2023-12-26 04:57:11,077][123090] Updated weights for policy 1, policy_version 667425 (0.0009) [2023-12-26 04:57:11,155][123090] Updated weights for policy 1, policy_version 667435 (0.0008) [2023-12-26 04:57:11,221][123090] Updated weights for policy 1, policy_version 667445 (0.0008) [2023-12-26 04:57:11,291][123090] Updated weights for policy 1, policy_version 667455 (0.0007) [2023-12-26 04:57:11,850][123091] Updated weights for policy 0, policy_version 671960 (0.0010) [2023-12-26 04:57:11,916][123091] Updated weights for policy 0, policy_version 671970 (0.0010) [2023-12-26 04:57:11,979][123091] Updated weights for policy 0, policy_version 671980 (0.0009) [2023-12-26 04:57:12,041][123090] Updated weights for policy 1, policy_version 667465 (0.0006) [2023-12-26 04:57:12,103][123090] Updated weights for policy 1, policy_version 667475 (0.0006) [2023-12-26 04:57:12,166][123090] Updated weights for policy 1, policy_version 667485 (0.0006) [2023-12-26 04:57:12,799][123091] Updated weights for policy 0, policy_version 671990 (0.0008) [2023-12-26 04:57:12,865][123091] Updated weights for policy 0, policy_version 672000 (0.0006) [2023-12-26 04:57:12,937][123091] Updated weights for policy 0, policy_version 672010 (0.0006) [2023-12-26 04:57:12,968][123090] Updated weights for policy 1, policy_version 667495 (0.0009) [2023-12-26 04:57:13,027][123090] Updated weights for policy 1, policy_version 667505 (0.0005) [2023-12-26 04:57:13,096][123090] Updated weights for policy 1, policy_version 667515 (0.0008) [2023-12-26 04:57:13,703][123091] Updated weights for policy 0, policy_version 672020 (0.0007) [2023-12-26 04:57:13,780][123091] Updated weights for policy 0, policy_version 672030 (0.0005) [2023-12-26 04:57:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 342925312. Throughput: 0: 8774.9, 1: 8790.6. Samples: 342924980. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:13,785][121949] Avg episode reward: [(0, '6195.178'), (1, '5480.241')] [2023-12-26 04:57:13,800][123090] Updated weights for policy 1, policy_version 667525 (0.0008) [2023-12-26 04:57:13,842][123091] Updated weights for policy 0, policy_version 672040 (0.0006) [2023-12-26 04:57:13,861][123090] Updated weights for policy 1, policy_version 667535 (0.0010) [2023-12-26 04:57:13,926][123090] Updated weights for policy 1, policy_version 667545 (0.0010) [2023-12-26 04:57:14,552][123090] Updated weights for policy 1, policy_version 667555 (0.0007) [2023-12-26 04:57:14,606][123090] Updated weights for policy 1, policy_version 667565 (0.0010) [2023-12-26 04:57:14,616][123091] Updated weights for policy 0, policy_version 672050 (0.0006) [2023-12-26 04:57:14,662][123090] Updated weights for policy 1, policy_version 667575 (0.0010) [2023-12-26 04:57:14,676][123091] Updated weights for policy 0, policy_version 672060 (0.0008) [2023-12-26 04:57:14,741][123091] Updated weights for policy 0, policy_version 672070 (0.0010) [2023-12-26 04:57:14,802][123091] Updated weights for policy 0, policy_version 672080 (0.0010) [2023-12-26 04:57:15,428][123090] Updated weights for policy 1, policy_version 667585 (0.0007) [2023-12-26 04:57:15,487][123090] Updated weights for policy 1, policy_version 667595 (0.0011) [2023-12-26 04:57:15,543][123090] Updated weights for policy 1, policy_version 667605 (0.0008) [2023-12-26 04:57:15,602][123090] Updated weights for policy 1, policy_version 667615 (0.0005) [2023-12-26 04:57:15,631][123091] Updated weights for policy 0, policy_version 672091 (0.0009) [2023-12-26 04:57:15,688][123091] Updated weights for policy 0, policy_version 672101 (0.0009) [2023-12-26 04:57:15,738][123091] Updated weights for policy 0, policy_version 672111 (0.0009) [2023-12-26 04:57:16,288][123090] Updated weights for policy 1, policy_version 667625 (0.0010) [2023-12-26 04:57:16,335][123090] Updated weights for policy 1, policy_version 667635 (0.0010) [2023-12-26 04:57:16,378][123090] Updated weights for policy 1, policy_version 667645 (0.0009) [2023-12-26 04:57:16,536][123091] Updated weights for policy 0, policy_version 672121 (0.0009) [2023-12-26 04:57:16,597][123091] Updated weights for policy 0, policy_version 672131 (0.0009) [2023-12-26 04:57:16,646][123091] Updated weights for policy 0, policy_version 672141 (0.0009) [2023-12-26 04:57:17,101][123090] Updated weights for policy 1, policy_version 667655 (0.0005) [2023-12-26 04:57:17,172][123090] Updated weights for policy 1, policy_version 667665 (0.0005) [2023-12-26 04:57:17,226][123090] Updated weights for policy 1, policy_version 667675 (0.0005) [2023-12-26 04:57:17,570][123091] Updated weights for policy 0, policy_version 672151 (0.0009) [2023-12-26 04:57:17,623][123091] Updated weights for policy 0, policy_version 672161 (0.0010) [2023-12-26 04:57:17,676][123091] Updated weights for policy 0, policy_version 672172 (0.0010) [2023-12-26 04:57:17,883][123090] Updated weights for policy 1, policy_version 667685 (0.0005) [2023-12-26 04:57:17,937][123090] Updated weights for policy 1, policy_version 667695 (0.0006) [2023-12-26 04:57:17,985][123090] Updated weights for policy 1, policy_version 667705 (0.0005) [2023-12-26 04:57:18,488][123091] Updated weights for policy 0, policy_version 672183 (0.0007) [2023-12-26 04:57:18,557][123091] Updated weights for policy 0, policy_version 672193 (0.0005) [2023-12-26 04:57:18,621][123091] Updated weights for policy 0, policy_version 672203 (0.0009) [2023-12-26 04:57:18,700][123090] Updated weights for policy 1, policy_version 667715 (0.0006) [2023-12-26 04:57:18,766][123090] Updated weights for policy 1, policy_version 667725 (0.0008) [2023-12-26 04:57:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 343023616. Throughput: 0: 8738.4, 1: 8855.8. Samples: 343036316. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:18,784][121949] Avg episode reward: [(0, '6191.939'), (1, '5474.776')] [2023-12-26 04:57:18,816][123090] Updated weights for policy 1, policy_version 667735 (0.0009) [2023-12-26 04:57:19,450][123091] Updated weights for policy 0, policy_version 672213 (0.0010) [2023-12-26 04:57:19,526][123091] Updated weights for policy 0, policy_version 672223 (0.0010) [2023-12-26 04:57:19,592][123091] Updated weights for policy 0, policy_version 672233 (0.0010) [2023-12-26 04:57:19,643][123090] Updated weights for policy 1, policy_version 667745 (0.0008) [2023-12-26 04:57:19,709][123090] Updated weights for policy 1, policy_version 667755 (0.0009) [2023-12-26 04:57:19,775][123090] Updated weights for policy 1, policy_version 667765 (0.0010) [2023-12-26 04:57:19,841][123090] Updated weights for policy 1, policy_version 667775 (0.0009) [2023-12-26 04:57:20,448][123091] Updated weights for policy 0, policy_version 672243 (0.0009) [2023-12-26 04:57:20,508][123091] Updated weights for policy 0, policy_version 672253 (0.0009) [2023-12-26 04:57:20,559][123091] Updated weights for policy 0, policy_version 672263 (0.0009) [2023-12-26 04:57:20,657][123090] Updated weights for policy 1, policy_version 667785 (0.0008) [2023-12-26 04:57:20,723][123090] Updated weights for policy 1, policy_version 667795 (0.0009) [2023-12-26 04:57:20,790][123090] Updated weights for policy 1, policy_version 667805 (0.0009) [2023-12-26 04:57:21,425][123091] Updated weights for policy 0, policy_version 672273 (0.0008) [2023-12-26 04:57:21,493][123091] Updated weights for policy 0, policy_version 672283 (0.0008) [2023-12-26 04:57:21,564][123091] Updated weights for policy 0, policy_version 672293 (0.0006) [2023-12-26 04:57:21,632][123091] Updated weights for policy 0, policy_version 672303 (0.0010) [2023-12-26 04:57:21,671][123090] Updated weights for policy 1, policy_version 667815 (0.0009) [2023-12-26 04:57:21,747][123090] Updated weights for policy 1, policy_version 667825 (0.0010) [2023-12-26 04:57:21,822][123090] Updated weights for policy 1, policy_version 667835 (0.0010) [2023-12-26 04:57:22,428][123091] Updated weights for policy 0, policy_version 672313 (0.0010) [2023-12-26 04:57:22,497][123091] Updated weights for policy 0, policy_version 672323 (0.0009) [2023-12-26 04:57:22,570][123091] Updated weights for policy 0, policy_version 672333 (0.0009) [2023-12-26 04:57:22,655][123090] Updated weights for policy 1, policy_version 667845 (0.0010) [2023-12-26 04:57:22,717][123090] Updated weights for policy 1, policy_version 667855 (0.0010) [2023-12-26 04:57:22,787][123090] Updated weights for policy 1, policy_version 667865 (0.0010) [2023-12-26 04:57:23,336][123091] Updated weights for policy 0, policy_version 672343 (0.0007) [2023-12-26 04:57:23,400][123091] Updated weights for policy 0, policy_version 672353 (0.0005) [2023-12-26 04:57:23,455][123091] Updated weights for policy 0, policy_version 672363 (0.0005) [2023-12-26 04:57:23,688][123090] Updated weights for policy 1, policy_version 667875 (0.0010) [2023-12-26 04:57:23,737][123090] Updated weights for policy 1, policy_version 667885 (0.0009) [2023-12-26 04:57:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 343105536. Throughput: 0: 8739.3, 1: 8768.6. Samples: 343086396. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:23,785][121949] Avg episode reward: [(0, '6201.172'), (1, '5523.879')] [2023-12-26 04:57:23,785][123090] Updated weights for policy 1, policy_version 667895 (0.0009) [2023-12-26 04:57:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000672368_172130304.pth... [2023-12-26 04:57:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000671376_171876352.pth [2023-12-26 04:57:23,837][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000667904_170983424.pth... [2023-12-26 04:57:23,842][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000666848_170713088.pth [2023-12-26 04:57:24,133][123091] Updated weights for policy 0, policy_version 672373 (0.0007) [2023-12-26 04:57:24,200][123091] Updated weights for policy 0, policy_version 672383 (0.0009) [2023-12-26 04:57:24,261][123091] Updated weights for policy 0, policy_version 672393 (0.0010) [2023-12-26 04:57:24,527][123090] Updated weights for policy 1, policy_version 667905 (0.0008) [2023-12-26 04:57:24,595][123090] Updated weights for policy 1, policy_version 667915 (0.0005) [2023-12-26 04:57:24,657][123090] Updated weights for policy 1, policy_version 667925 (0.0005) [2023-12-26 04:57:24,723][123090] Updated weights for policy 1, policy_version 667935 (0.0006) [2023-12-26 04:57:25,180][123091] Updated weights for policy 0, policy_version 672404 (0.0011) [2023-12-26 04:57:25,247][123091] Updated weights for policy 0, policy_version 672414 (0.0010) [2023-12-26 04:57:25,312][123091] Updated weights for policy 0, policy_version 672424 (0.0010) [2023-12-26 04:57:25,387][123090] Updated weights for policy 1, policy_version 667945 (0.0010) [2023-12-26 04:57:25,449][123090] Updated weights for policy 1, policy_version 667955 (0.0010) [2023-12-26 04:57:25,516][123090] Updated weights for policy 1, policy_version 667965 (0.0010) [2023-12-26 04:57:26,192][123091] Updated weights for policy 0, policy_version 672434 (0.0007) [2023-12-26 04:57:26,250][123091] Updated weights for policy 0, policy_version 672444 (0.0009) [2023-12-26 04:57:26,257][123090] Updated weights for policy 1, policy_version 667975 (0.0007) [2023-12-26 04:57:26,307][123091] Updated weights for policy 0, policy_version 672454 (0.0009) [2023-12-26 04:57:26,322][123090] Updated weights for policy 1, policy_version 667985 (0.0007) [2023-12-26 04:57:26,370][123091] Updated weights for policy 0, policy_version 672464 (0.0008) [2023-12-26 04:57:26,384][123090] Updated weights for policy 1, policy_version 667995 (0.0008) [2023-12-26 04:57:27,062][123090] Updated weights for policy 1, policy_version 668005 (0.0009) [2023-12-26 04:57:27,080][123091] Updated weights for policy 0, policy_version 672474 (0.0006) [2023-12-26 04:57:27,108][123090] Updated weights for policy 1, policy_version 668015 (0.0006) [2023-12-26 04:57:27,137][123091] Updated weights for policy 0, policy_version 672484 (0.0005) [2023-12-26 04:57:27,155][123090] Updated weights for policy 1, policy_version 668025 (0.0006) [2023-12-26 04:57:27,201][123091] Updated weights for policy 0, policy_version 672494 (0.0009) [2023-12-26 04:57:27,803][123090] Updated weights for policy 1, policy_version 668035 (0.0005) [2023-12-26 04:57:27,868][123090] Updated weights for policy 1, policy_version 668045 (0.0008) [2023-12-26 04:57:27,887][123091] Updated weights for policy 0, policy_version 672504 (0.0006) [2023-12-26 04:57:27,925][123090] Updated weights for policy 1, policy_version 668055 (0.0010) [2023-12-26 04:57:27,944][123091] Updated weights for policy 0, policy_version 672514 (0.0009) [2023-12-26 04:57:28,007][123091] Updated weights for policy 0, policy_version 672524 (0.0008) [2023-12-26 04:57:28,693][123090] Updated weights for policy 1, policy_version 668065 (0.0010) [2023-12-26 04:57:28,772][123090] Updated weights for policy 1, policy_version 668075 (0.0011) [2023-12-26 04:57:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 343195648. Throughput: 0: 8712.4, 1: 8897.3. Samples: 343195176. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:28,784][121949] Avg episode reward: [(0, '6142.374'), (1, '5586.114')] [2023-12-26 04:57:28,836][123090] Updated weights for policy 1, policy_version 668085 (0.0010) [2023-12-26 04:57:28,847][123091] Updated weights for policy 0, policy_version 672534 (0.0010) [2023-12-26 04:57:28,891][123090] Updated weights for policy 1, policy_version 668095 (0.0010) [2023-12-26 04:57:28,894][123091] Updated weights for policy 0, policy_version 672544 (0.0010) [2023-12-26 04:57:28,946][123091] Updated weights for policy 0, policy_version 672554 (0.0010) [2023-12-26 04:57:29,630][123090] Updated weights for policy 1, policy_version 668105 (0.0011) [2023-12-26 04:57:29,693][123090] Updated weights for policy 1, policy_version 668115 (0.0010) [2023-12-26 04:57:29,757][123090] Updated weights for policy 1, policy_version 668125 (0.0008) [2023-12-26 04:57:29,784][123091] Updated weights for policy 0, policy_version 672564 (0.0011) [2023-12-26 04:57:29,856][123091] Updated weights for policy 0, policy_version 672574 (0.0008) [2023-12-26 04:57:29,934][123091] Updated weights for policy 0, policy_version 672584 (0.0008) [2023-12-26 04:57:30,520][123090] Updated weights for policy 1, policy_version 668135 (0.0009) [2023-12-26 04:57:30,581][123090] Updated weights for policy 1, policy_version 668145 (0.0010) [2023-12-26 04:57:30,589][123091] Updated weights for policy 0, policy_version 672594 (0.0008) [2023-12-26 04:57:30,645][123090] Updated weights for policy 1, policy_version 668155 (0.0010) [2023-12-26 04:57:30,648][123091] Updated weights for policy 0, policy_version 672604 (0.0005) [2023-12-26 04:57:30,698][123091] Updated weights for policy 0, policy_version 672614 (0.0005) [2023-12-26 04:57:30,750][123091] Updated weights for policy 0, policy_version 672624 (0.0005) [2023-12-26 04:57:31,418][123090] Updated weights for policy 1, policy_version 668165 (0.0008) [2023-12-26 04:57:31,432][123091] Updated weights for policy 0, policy_version 672634 (0.0009) [2023-12-26 04:57:31,487][123091] Updated weights for policy 0, policy_version 672644 (0.0005) [2023-12-26 04:57:31,490][123090] Updated weights for policy 1, policy_version 668175 (0.0006) [2023-12-26 04:57:31,545][123091] Updated weights for policy 0, policy_version 672654 (0.0005) [2023-12-26 04:57:31,552][123090] Updated weights for policy 1, policy_version 668185 (0.0005) [2023-12-26 04:57:32,228][123091] Updated weights for policy 0, policy_version 672664 (0.0009) [2023-12-26 04:57:32,280][123091] Updated weights for policy 0, policy_version 672674 (0.0010) [2023-12-26 04:57:32,308][123090] Updated weights for policy 1, policy_version 668195 (0.0006) [2023-12-26 04:57:32,361][123091] Updated weights for policy 0, policy_version 672684 (0.0010) [2023-12-26 04:57:32,366][123090] Updated weights for policy 1, policy_version 668205 (0.0012) [2023-12-26 04:57:32,425][123090] Updated weights for policy 1, policy_version 668215 (0.0008) [2023-12-26 04:57:33,012][123091] Updated weights for policy 0, policy_version 672694 (0.0010) [2023-12-26 04:57:33,055][123091] Updated weights for policy 0, policy_version 672704 (0.0010) [2023-12-26 04:57:33,099][123091] Updated weights for policy 0, policy_version 672714 (0.0010) [2023-12-26 04:57:33,209][123090] Updated weights for policy 1, policy_version 668225 (0.0010) [2023-12-26 04:57:33,260][123090] Updated weights for policy 1, policy_version 668235 (0.0010) [2023-12-26 04:57:33,307][123090] Updated weights for policy 1, policy_version 668245 (0.0010) [2023-12-26 04:57:33,350][123090] Updated weights for policy 1, policy_version 668255 (0.0010) [2023-12-26 04:57:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 343293952. Throughput: 0: 8822.4, 1: 8935.5. Samples: 343306908. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:33,785][121949] Avg episode reward: [(0, '6114.596'), (1, '5579.838')] [2023-12-26 04:57:33,816][123091] Updated weights for policy 0, policy_version 672724 (0.0008) [2023-12-26 04:57:33,877][123091] Updated weights for policy 0, policy_version 672734 (0.0005) [2023-12-26 04:57:33,924][123091] Updated weights for policy 0, policy_version 672744 (0.0005) [2023-12-26 04:57:34,133][123090] Updated weights for policy 1, policy_version 668265 (0.0010) [2023-12-26 04:57:34,201][123090] Updated weights for policy 1, policy_version 668275 (0.0010) [2023-12-26 04:57:34,272][123090] Updated weights for policy 1, policy_version 668285 (0.0011) [2023-12-26 04:57:34,717][123091] Updated weights for policy 0, policy_version 672754 (0.0006) [2023-12-26 04:57:34,779][123091] Updated weights for policy 0, policy_version 672764 (0.0009) [2023-12-26 04:57:34,844][123091] Updated weights for policy 0, policy_version 672774 (0.0007) [2023-12-26 04:57:34,908][123091] Updated weights for policy 0, policy_version 672784 (0.0006) [2023-12-26 04:57:35,090][123090] Updated weights for policy 1, policy_version 668295 (0.0009) [2023-12-26 04:57:35,156][123090] Updated weights for policy 1, policy_version 668305 (0.0006) [2023-12-26 04:57:35,224][123090] Updated weights for policy 1, policy_version 668315 (0.0006) [2023-12-26 04:57:35,570][123091] Updated weights for policy 0, policy_version 672794 (0.0005) [2023-12-26 04:57:35,644][123091] Updated weights for policy 0, policy_version 672804 (0.0006) [2023-12-26 04:57:35,711][123091] Updated weights for policy 0, policy_version 672814 (0.0007) [2023-12-26 04:57:36,000][123090] Updated weights for policy 1, policy_version 668325 (0.0006) [2023-12-26 04:57:36,056][123090] Updated weights for policy 1, policy_version 668335 (0.0006) [2023-12-26 04:57:36,118][123090] Updated weights for policy 1, policy_version 668345 (0.0006) [2023-12-26 04:57:36,416][123091] Updated weights for policy 0, policy_version 672824 (0.0008) [2023-12-26 04:57:36,483][123091] Updated weights for policy 0, policy_version 672834 (0.0009) [2023-12-26 04:57:36,538][123091] Updated weights for policy 0, policy_version 672844 (0.0009) [2023-12-26 04:57:36,942][123090] Updated weights for policy 1, policy_version 668355 (0.0009) [2023-12-26 04:57:37,011][123090] Updated weights for policy 1, policy_version 668365 (0.0007) [2023-12-26 04:57:37,084][123090] Updated weights for policy 1, policy_version 668375 (0.0006) [2023-12-26 04:57:37,308][123091] Updated weights for policy 0, policy_version 672854 (0.0009) [2023-12-26 04:57:37,369][123091] Updated weights for policy 0, policy_version 672864 (0.0009) [2023-12-26 04:57:37,431][123091] Updated weights for policy 0, policy_version 672874 (0.0007) [2023-12-26 04:57:37,802][123090] Updated weights for policy 1, policy_version 668385 (0.0007) [2023-12-26 04:57:37,862][123090] Updated weights for policy 1, policy_version 668395 (0.0011) [2023-12-26 04:57:37,918][123090] Updated weights for policy 1, policy_version 668405 (0.0010) [2023-12-26 04:57:37,970][123090] Updated weights for policy 1, policy_version 668415 (0.0011) [2023-12-26 04:57:38,192][123091] Updated weights for policy 0, policy_version 672884 (0.0008) [2023-12-26 04:57:38,236][123091] Updated weights for policy 0, policy_version 672894 (0.0010) [2023-12-26 04:57:38,284][123091] Updated weights for policy 0, policy_version 672904 (0.0011) [2023-12-26 04:57:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 343384064. Throughput: 0: 8831.6, 1: 9004.4. Samples: 343362504. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:38,784][121949] Avg episode reward: [(0, '6164.828'), (1, '5718.308')] [2023-12-26 04:57:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000672912_172269568.pth... [2023-12-26 04:57:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000671856_171999232.pth [2023-12-26 04:57:38,800][123090] Updated weights for policy 1, policy_version 668425 (0.0010) [2023-12-26 04:57:38,863][123090] Updated weights for policy 1, policy_version 668435 (0.0011) [2023-12-26 04:57:38,922][123090] Updated weights for policy 1, policy_version 668445 (0.0010) [2023-12-26 04:57:38,942][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000668448_171122688.pth... [2023-12-26 04:57:38,947][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000667360_170844160.pth [2023-12-26 04:57:39,152][123091] Updated weights for policy 0, policy_version 672914 (0.0010) [2023-12-26 04:57:39,207][123091] Updated weights for policy 0, policy_version 672924 (0.0011) [2023-12-26 04:57:39,272][123091] Updated weights for policy 0, policy_version 672934 (0.0009) [2023-12-26 04:57:39,334][123091] Updated weights for policy 0, policy_version 672944 (0.0011) [2023-12-26 04:57:39,703][123090] Updated weights for policy 1, policy_version 668455 (0.0008) [2023-12-26 04:57:39,776][123090] Updated weights for policy 1, policy_version 668465 (0.0005) [2023-12-26 04:57:39,860][123090] Updated weights for policy 1, policy_version 668475 (0.0007) [2023-12-26 04:57:40,194][123091] Updated weights for policy 0, policy_version 672954 (0.0009) [2023-12-26 04:57:40,245][123091] Updated weights for policy 0, policy_version 672964 (0.0009) [2023-12-26 04:57:40,298][123091] Updated weights for policy 0, policy_version 672974 (0.0008) [2023-12-26 04:57:40,573][123090] Updated weights for policy 1, policy_version 668485 (0.0008) [2023-12-26 04:57:40,636][123090] Updated weights for policy 1, policy_version 668495 (0.0005) [2023-12-26 04:57:40,703][123090] Updated weights for policy 1, policy_version 668505 (0.0006) [2023-12-26 04:57:41,092][123091] Updated weights for policy 0, policy_version 672984 (0.0009) [2023-12-26 04:57:41,164][123091] Updated weights for policy 0, policy_version 672994 (0.0008) [2023-12-26 04:57:41,234][123091] Updated weights for policy 0, policy_version 673004 (0.0008) [2023-12-26 04:57:41,379][123090] Updated weights for policy 1, policy_version 668515 (0.0009) [2023-12-26 04:57:41,450][123090] Updated weights for policy 1, policy_version 668525 (0.0009) [2023-12-26 04:57:41,509][123090] Updated weights for policy 1, policy_version 668535 (0.0009) [2023-12-26 04:57:42,026][123091] Updated weights for policy 0, policy_version 673014 (0.0007) [2023-12-26 04:57:42,096][123091] Updated weights for policy 0, policy_version 673024 (0.0005) [2023-12-26 04:57:42,156][123091] Updated weights for policy 0, policy_version 673034 (0.0005) [2023-12-26 04:57:42,353][123090] Updated weights for policy 1, policy_version 668545 (0.0009) [2023-12-26 04:57:42,407][123090] Updated weights for policy 1, policy_version 668555 (0.0009) [2023-12-26 04:57:42,459][123090] Updated weights for policy 1, policy_version 668565 (0.0009) [2023-12-26 04:57:42,508][123090] Updated weights for policy 1, policy_version 668575 (0.0009) [2023-12-26 04:57:42,945][123091] Updated weights for policy 0, policy_version 673044 (0.0007) [2023-12-26 04:57:43,006][123091] Updated weights for policy 0, policy_version 673054 (0.0010) [2023-12-26 04:57:43,074][123091] Updated weights for policy 0, policy_version 673064 (0.0009) [2023-12-26 04:57:43,400][123090] Updated weights for policy 1, policy_version 668585 (0.0009) [2023-12-26 04:57:43,460][123090] Updated weights for policy 1, policy_version 668595 (0.0009) [2023-12-26 04:57:43,524][123090] Updated weights for policy 1, policy_version 668605 (0.0009) [2023-12-26 04:57:43,734][123091] Updated weights for policy 0, policy_version 673074 (0.0008) [2023-12-26 04:57:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 343474176. Throughput: 0: 8763.3, 1: 9083.4. Samples: 343469044. Policy #0 lag: (min: 16.0, avg: 41.5, max: 48.0) [2023-12-26 04:57:43,785][121949] Avg episode reward: [(0, '6164.534'), (1, '5747.827')] [2023-12-26 04:57:43,801][123091] Updated weights for policy 0, policy_version 673084 (0.0005) [2023-12-26 04:57:43,850][123091] Updated weights for policy 0, policy_version 673094 (0.0005) [2023-12-26 04:57:43,910][123091] Updated weights for policy 0, policy_version 673104 (0.0005) [2023-12-26 04:57:44,395][123090] Updated weights for policy 1, policy_version 668615 (0.0009) [2023-12-26 04:57:44,449][123090] Updated weights for policy 1, policy_version 668625 (0.0009) [2023-12-26 04:57:44,503][123090] Updated weights for policy 1, policy_version 668635 (0.0010) [2023-12-26 04:57:44,633][123091] Updated weights for policy 0, policy_version 673114 (0.0007) [2023-12-26 04:57:44,694][123091] Updated weights for policy 0, policy_version 673124 (0.0006) [2023-12-26 04:57:44,757][123091] Updated weights for policy 0, policy_version 673134 (0.0006) [2023-12-26 04:57:45,379][123090] Updated weights for policy 1, policy_version 668645 (0.0008) [2023-12-26 04:57:45,447][123090] Updated weights for policy 1, policy_version 668655 (0.0007) [2023-12-26 04:57:45,505][123090] Updated weights for policy 1, policy_version 668665 (0.0009) [2023-12-26 04:57:45,540][123091] Updated weights for policy 0, policy_version 673144 (0.0009) [2023-12-26 04:57:45,596][123091] Updated weights for policy 0, policy_version 673154 (0.0007) [2023-12-26 04:57:45,657][123091] Updated weights for policy 0, policy_version 673164 (0.0009) [2023-12-26 04:57:46,345][123090] Updated weights for policy 1, policy_version 668675 (0.0007) [2023-12-26 04:57:46,400][123090] Updated weights for policy 1, policy_version 668685 (0.0008) [2023-12-26 04:57:46,405][123091] Updated weights for policy 0, policy_version 673174 (0.0008) [2023-12-26 04:57:46,461][123090] Updated weights for policy 1, policy_version 668695 (0.0009) [2023-12-26 04:57:46,471][123091] Updated weights for policy 0, policy_version 673184 (0.0008) [2023-12-26 04:57:46,535][123091] Updated weights for policy 0, policy_version 673194 (0.0010) [2023-12-26 04:57:47,278][123090] Updated weights for policy 1, policy_version 668705 (0.0006) [2023-12-26 04:57:47,341][123090] Updated weights for policy 1, policy_version 668715 (0.0005) [2023-12-26 04:57:47,343][123091] Updated weights for policy 0, policy_version 673204 (0.0010) [2023-12-26 04:57:47,417][123090] Updated weights for policy 1, policy_version 668725 (0.0005) [2023-12-26 04:57:47,418][123091] Updated weights for policy 0, policy_version 673214 (0.0010) [2023-12-26 04:57:47,488][123091] Updated weights for policy 0, policy_version 673224 (0.0008) [2023-12-26 04:57:47,488][123090] Updated weights for policy 1, policy_version 668735 (0.0006) [2023-12-26 04:57:48,145][123091] Updated weights for policy 0, policy_version 673234 (0.0009) [2023-12-26 04:57:48,200][123090] Updated weights for policy 1, policy_version 668745 (0.0009) [2023-12-26 04:57:48,204][123091] Updated weights for policy 0, policy_version 673244 (0.0006) [2023-12-26 04:57:48,253][123090] Updated weights for policy 1, policy_version 668755 (0.0010) [2023-12-26 04:57:48,254][123091] Updated weights for policy 0, policy_version 673254 (0.0005) [2023-12-26 04:57:48,307][123091] Updated weights for policy 0, policy_version 673264 (0.0005) [2023-12-26 04:57:48,317][123090] Updated weights for policy 1, policy_version 668765 (0.0008) [2023-12-26 04:57:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 343564288. Throughput: 0: 8941.8, 1: 9014.0. Samples: 343575628. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:57:48,785][121949] Avg episode reward: [(0, '6035.566'), (1, '5780.347')] [2023-12-26 04:57:49,033][123091] Updated weights for policy 0, policy_version 673274 (0.0009) [2023-12-26 04:57:49,091][123091] Updated weights for policy 0, policy_version 673284 (0.0008) [2023-12-26 04:57:49,152][123091] Updated weights for policy 0, policy_version 673294 (0.0009) [2023-12-26 04:57:49,190][123090] Updated weights for policy 1, policy_version 668775 (0.0010) [2023-12-26 04:57:49,250][123090] Updated weights for policy 1, policy_version 668785 (0.0009) [2023-12-26 04:57:49,313][123090] Updated weights for policy 1, policy_version 668795 (0.0009) [2023-12-26 04:57:49,989][123091] Updated weights for policy 0, policy_version 673304 (0.0008) [2023-12-26 04:57:50,047][123091] Updated weights for policy 0, policy_version 673314 (0.0009) [2023-12-26 04:57:50,116][123091] Updated weights for policy 0, policy_version 673324 (0.0008) [2023-12-26 04:57:50,118][123090] Updated weights for policy 1, policy_version 668805 (0.0009) [2023-12-26 04:57:50,173][123090] Updated weights for policy 1, policy_version 668815 (0.0009) [2023-12-26 04:57:50,227][123090] Updated weights for policy 1, policy_version 668825 (0.0009) [2023-12-26 04:57:50,959][123091] Updated weights for policy 0, policy_version 673334 (0.0006) [2023-12-26 04:57:51,020][123091] Updated weights for policy 0, policy_version 673344 (0.0007) [2023-12-26 04:57:51,052][123090] Updated weights for policy 1, policy_version 668835 (0.0009) [2023-12-26 04:57:51,091][123091] Updated weights for policy 0, policy_version 673354 (0.0008) [2023-12-26 04:57:51,124][123090] Updated weights for policy 1, policy_version 668845 (0.0007) [2023-12-26 04:57:51,190][123090] Updated weights for policy 1, policy_version 668855 (0.0008) [2023-12-26 04:57:51,936][123091] Updated weights for policy 0, policy_version 673364 (0.0008) [2023-12-26 04:57:51,998][123091] Updated weights for policy 0, policy_version 673374 (0.0009) [2023-12-26 04:57:52,074][123091] Updated weights for policy 0, policy_version 673384 (0.0006) [2023-12-26 04:57:52,083][123090] Updated weights for policy 1, policy_version 668865 (0.0006) [2023-12-26 04:57:52,144][123090] Updated weights for policy 1, policy_version 668875 (0.0009) [2023-12-26 04:57:52,207][123090] Updated weights for policy 1, policy_version 668885 (0.0010) [2023-12-26 04:57:52,275][123090] Updated weights for policy 1, policy_version 668895 (0.0010) [2023-12-26 04:57:52,881][123091] Updated weights for policy 0, policy_version 673394 (0.0006) [2023-12-26 04:57:52,929][123091] Updated weights for policy 0, policy_version 673404 (0.0005) [2023-12-26 04:57:52,979][123091] Updated weights for policy 0, policy_version 673414 (0.0005) [2023-12-26 04:57:53,030][123091] Updated weights for policy 0, policy_version 673424 (0.0005) [2023-12-26 04:57:53,094][123090] Updated weights for policy 1, policy_version 668905 (0.0009) [2023-12-26 04:57:53,156][123090] Updated weights for policy 1, policy_version 668915 (0.0009) [2023-12-26 04:57:53,221][123090] Updated weights for policy 1, policy_version 668925 (0.0009) [2023-12-26 04:57:53,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 343646208. Throughput: 0: 8939.1, 1: 9009.2. Samples: 343626732. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:57:53,785][121949] Avg episode reward: [(0, '6094.380'), (1, '5761.339')] [2023-12-26 04:57:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000668928_171245568.pth... [2023-12-26 04:57:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000667904_170983424.pth [2023-12-26 04:57:53,822][123091] Updated weights for policy 0, policy_version 673434 (0.0011) [2023-12-26 04:57:53,890][123091] Updated weights for policy 0, policy_version 673444 (0.0006) [2023-12-26 04:57:53,958][123091] Updated weights for policy 0, policy_version 673454 (0.0007) [2023-12-26 04:57:53,967][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000673456_172408832.pth... [2023-12-26 04:57:53,970][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000672368_172130304.pth [2023-12-26 04:57:54,054][123090] Updated weights for policy 1, policy_version 668935 (0.0010) [2023-12-26 04:57:54,110][123090] Updated weights for policy 1, policy_version 668945 (0.0010) [2023-12-26 04:57:54,158][123090] Updated weights for policy 1, policy_version 668955 (0.0010) [2023-12-26 04:57:54,751][123091] Updated weights for policy 0, policy_version 673464 (0.0008) [2023-12-26 04:57:54,816][123091] Updated weights for policy 0, policy_version 673474 (0.0006) [2023-12-26 04:57:54,871][123091] Updated weights for policy 0, policy_version 673484 (0.0007) [2023-12-26 04:57:55,007][123090] Updated weights for policy 1, policy_version 668965 (0.0008) [2023-12-26 04:57:55,065][123090] Updated weights for policy 1, policy_version 668975 (0.0005) [2023-12-26 04:57:55,118][123090] Updated weights for policy 1, policy_version 668985 (0.0005) [2023-12-26 04:57:55,632][123091] Updated weights for policy 0, policy_version 673494 (0.0008) [2023-12-26 04:57:55,698][123091] Updated weights for policy 0, policy_version 673504 (0.0010) [2023-12-26 04:57:55,754][123091] Updated weights for policy 0, policy_version 673514 (0.0011) [2023-12-26 04:57:55,761][123090] Updated weights for policy 1, policy_version 668995 (0.0007) [2023-12-26 04:57:55,820][123090] Updated weights for policy 1, policy_version 669005 (0.0007) [2023-12-26 04:57:55,884][123090] Updated weights for policy 1, policy_version 669015 (0.0008) [2023-12-26 04:57:56,563][123090] Updated weights for policy 1, policy_version 669025 (0.0008) [2023-12-26 04:57:56,573][123091] Updated weights for policy 0, policy_version 673524 (0.0010) [2023-12-26 04:57:56,630][123090] Updated weights for policy 1, policy_version 669035 (0.0006) [2023-12-26 04:57:56,636][123091] Updated weights for policy 0, policy_version 673534 (0.0011) [2023-12-26 04:57:56,691][123090] Updated weights for policy 1, policy_version 669045 (0.0006) [2023-12-26 04:57:56,696][123091] Updated weights for policy 0, policy_version 673544 (0.0011) [2023-12-26 04:57:56,754][123090] Updated weights for policy 1, policy_version 669055 (0.0006) [2023-12-26 04:57:57,476][123091] Updated weights for policy 0, policy_version 673554 (0.0009) [2023-12-26 04:57:57,492][123090] Updated weights for policy 1, policy_version 669065 (0.0007) [2023-12-26 04:57:57,529][123091] Updated weights for policy 0, policy_version 673564 (0.0006) [2023-12-26 04:57:57,546][123090] Updated weights for policy 1, policy_version 669075 (0.0009) [2023-12-26 04:57:57,586][123091] Updated weights for policy 0, policy_version 673574 (0.0008) [2023-12-26 04:57:57,612][123090] Updated weights for policy 1, policy_version 669085 (0.0006) [2023-12-26 04:57:57,648][123091] Updated weights for policy 0, policy_version 673584 (0.0008) [2023-12-26 04:57:58,419][123091] Updated weights for policy 0, policy_version 673594 (0.0010) [2023-12-26 04:57:58,488][123091] Updated weights for policy 0, policy_version 673604 (0.0009) [2023-12-26 04:57:58,498][123090] Updated weights for policy 1, policy_version 669095 (0.0008) [2023-12-26 04:57:58,555][123091] Updated weights for policy 0, policy_version 673614 (0.0008) [2023-12-26 04:57:58,565][123090] Updated weights for policy 1, policy_version 669105 (0.0008) [2023-12-26 04:57:58,635][123090] Updated weights for policy 1, policy_version 669115 (0.0008) [2023-12-26 04:57:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 343744512. Throughput: 0: 8974.4, 1: 9009.1. Samples: 343734236. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:57:58,784][121949] Avg episode reward: [(0, '6087.210'), (1, '5561.386')] [2023-12-26 04:57:59,335][123091] Updated weights for policy 0, policy_version 673624 (0.0008) [2023-12-26 04:57:59,360][123090] Updated weights for policy 1, policy_version 669125 (0.0009) [2023-12-26 04:57:59,401][123091] Updated weights for policy 0, policy_version 673634 (0.0010) [2023-12-26 04:57:59,426][123090] Updated weights for policy 1, policy_version 669135 (0.0008) [2023-12-26 04:57:59,458][123091] Updated weights for policy 0, policy_version 673644 (0.0009) [2023-12-26 04:57:59,485][123090] Updated weights for policy 1, policy_version 669145 (0.0006) [2023-12-26 04:58:00,291][123090] Updated weights for policy 1, policy_version 669155 (0.0009) [2023-12-26 04:58:00,325][123091] Updated weights for policy 0, policy_version 673654 (0.0006) [2023-12-26 04:58:00,354][123090] Updated weights for policy 1, policy_version 669165 (0.0008) [2023-12-26 04:58:00,385][123091] Updated weights for policy 0, policy_version 673664 (0.0005) [2023-12-26 04:58:00,414][123090] Updated weights for policy 1, policy_version 669175 (0.0007) [2023-12-26 04:58:00,448][123091] Updated weights for policy 0, policy_version 673674 (0.0005) [2023-12-26 04:58:01,213][123091] Updated weights for policy 0, policy_version 673684 (0.0008) [2023-12-26 04:58:01,264][123090] Updated weights for policy 1, policy_version 669185 (0.0009) [2023-12-26 04:58:01,282][123091] Updated weights for policy 0, policy_version 673694 (0.0009) [2023-12-26 04:58:01,335][123090] Updated weights for policy 1, policy_version 669195 (0.0006) [2023-12-26 04:58:01,349][123091] Updated weights for policy 0, policy_version 673704 (0.0009) [2023-12-26 04:58:01,408][123090] Updated weights for policy 1, policy_version 669205 (0.0012) [2023-12-26 04:58:01,465][123090] Updated weights for policy 1, policy_version 669215 (0.0012) [2023-12-26 04:58:02,168][123091] Updated weights for policy 0, policy_version 673714 (0.0008) [2023-12-26 04:58:02,175][123090] Updated weights for policy 1, policy_version 669225 (0.0006) [2023-12-26 04:58:02,231][123091] Updated weights for policy 0, policy_version 673724 (0.0008) [2023-12-26 04:58:02,233][123090] Updated weights for policy 1, policy_version 669235 (0.0009) [2023-12-26 04:58:02,299][123090] Updated weights for policy 1, policy_version 669245 (0.0011) [2023-12-26 04:58:02,301][123091] Updated weights for policy 0, policy_version 673734 (0.0008) [2023-12-26 04:58:02,365][123091] Updated weights for policy 0, policy_version 673744 (0.0009) [2023-12-26 04:58:02,964][123090] Updated weights for policy 1, policy_version 669255 (0.0007) [2023-12-26 04:58:03,031][123090] Updated weights for policy 1, policy_version 669265 (0.0005) [2023-12-26 04:58:03,060][123091] Updated weights for policy 0, policy_version 673754 (0.0009) [2023-12-26 04:58:03,096][123090] Updated weights for policy 1, policy_version 669275 (0.0005) [2023-12-26 04:58:03,108][123091] Updated weights for policy 0, policy_version 673764 (0.0009) [2023-12-26 04:58:03,156][123091] Updated weights for policy 0, policy_version 673774 (0.0010) [2023-12-26 04:58:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 343826432. Throughput: 0: 9002.3, 1: 8890.6. Samples: 343841496. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:03,785][121949] Avg episode reward: [(0, '6049.452'), (1, '5298.048')] [2023-12-26 04:58:03,828][123090] Updated weights for policy 1, policy_version 669285 (0.0006) [2023-12-26 04:58:03,894][123090] Updated weights for policy 1, policy_version 669295 (0.0007) [2023-12-26 04:58:03,930][123091] Updated weights for policy 0, policy_version 673784 (0.0008) [2023-12-26 04:58:03,968][123090] Updated weights for policy 1, policy_version 669305 (0.0009) [2023-12-26 04:58:03,980][123091] Updated weights for policy 0, policy_version 673794 (0.0008) [2023-12-26 04:58:04,029][123091] Updated weights for policy 0, policy_version 673804 (0.0007) [2023-12-26 04:58:04,761][123090] Updated weights for policy 1, policy_version 669315 (0.0010) [2023-12-26 04:58:04,809][123090] Updated weights for policy 1, policy_version 669325 (0.0010) [2023-12-26 04:58:04,864][123090] Updated weights for policy 1, policy_version 669335 (0.0010) [2023-12-26 04:58:04,891][123091] Updated weights for policy 0, policy_version 673814 (0.0007) [2023-12-26 04:58:04,942][123091] Updated weights for policy 0, policy_version 673824 (0.0008) [2023-12-26 04:58:04,989][123091] Updated weights for policy 0, policy_version 673834 (0.0009) [2023-12-26 04:58:05,693][123090] Updated weights for policy 1, policy_version 669345 (0.0010) [2023-12-26 04:58:05,740][123090] Updated weights for policy 1, policy_version 669355 (0.0005) [2023-12-26 04:58:05,790][123090] Updated weights for policy 1, policy_version 669365 (0.0005) [2023-12-26 04:58:05,808][123091] Updated weights for policy 0, policy_version 673844 (0.0009) [2023-12-26 04:58:05,841][123090] Updated weights for policy 1, policy_version 669375 (0.0005) [2023-12-26 04:58:05,855][123091] Updated weights for policy 0, policy_version 673854 (0.0010) [2023-12-26 04:58:05,914][123091] Updated weights for policy 0, policy_version 673864 (0.0011) [2023-12-26 04:58:06,599][123090] Updated weights for policy 1, policy_version 669385 (0.0006) [2023-12-26 04:58:06,655][123090] Updated weights for policy 1, policy_version 669395 (0.0006) [2023-12-26 04:58:06,721][123090] Updated weights for policy 1, policy_version 669405 (0.0008) [2023-12-26 04:58:06,722][123091] Updated weights for policy 0, policy_version 673874 (0.0010) [2023-12-26 04:58:06,779][123091] Updated weights for policy 0, policy_version 673884 (0.0010) [2023-12-26 04:58:06,827][123091] Updated weights for policy 0, policy_version 673894 (0.0011) [2023-12-26 04:58:06,890][123091] Updated weights for policy 0, policy_version 673904 (0.0011) [2023-12-26 04:58:07,459][123090] Updated weights for policy 1, policy_version 669415 (0.0007) [2023-12-26 04:58:07,507][123090] Updated weights for policy 1, policy_version 669425 (0.0005) [2023-12-26 04:58:07,557][123090] Updated weights for policy 1, policy_version 669435 (0.0005) [2023-12-26 04:58:07,728][123091] Updated weights for policy 0, policy_version 673914 (0.0011) [2023-12-26 04:58:07,793][123091] Updated weights for policy 0, policy_version 673924 (0.0011) [2023-12-26 04:58:07,860][123091] Updated weights for policy 0, policy_version 673934 (0.0011) [2023-12-26 04:58:08,338][123090] Updated weights for policy 1, policy_version 669445 (0.0007) [2023-12-26 04:58:08,395][123090] Updated weights for policy 1, policy_version 669455 (0.0007) [2023-12-26 04:58:08,450][123090] Updated weights for policy 1, policy_version 669465 (0.0005) [2023-12-26 04:58:08,584][123091] Updated weights for policy 0, policy_version 673944 (0.0011) [2023-12-26 04:58:08,636][123091] Updated weights for policy 0, policy_version 673954 (0.0010) [2023-12-26 04:58:08,703][123091] Updated weights for policy 0, policy_version 673964 (0.0011) [2023-12-26 04:58:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 343924736. Throughput: 0: 9037.7, 1: 8940.1. Samples: 343895396. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:08,784][121949] Avg episode reward: [(0, '6146.837'), (1, '5146.694')] [2023-12-26 04:58:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000673968_172539904.pth... [2023-12-26 04:58:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000669472_171384832.pth... [2023-12-26 04:58:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000672912_172269568.pth [2023-12-26 04:58:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000668448_171122688.pth [2023-12-26 04:58:09,238][123090] Updated weights for policy 1, policy_version 669475 (0.0007) [2023-12-26 04:58:09,308][123090] Updated weights for policy 1, policy_version 669485 (0.0006) [2023-12-26 04:58:09,384][123090] Updated weights for policy 1, policy_version 669495 (0.0008) [2023-12-26 04:58:09,565][123091] Updated weights for policy 0, policy_version 673974 (0.0011) [2023-12-26 04:58:09,627][123091] Updated weights for policy 0, policy_version 673984 (0.0006) [2023-12-26 04:58:09,690][123091] Updated weights for policy 0, policy_version 673994 (0.0009) [2023-12-26 04:58:10,223][123090] Updated weights for policy 1, policy_version 669505 (0.0009) [2023-12-26 04:58:10,282][123090] Updated weights for policy 1, policy_version 669515 (0.0010) [2023-12-26 04:58:10,334][123090] Updated weights for policy 1, policy_version 669525 (0.0010) [2023-12-26 04:58:10,394][123090] Updated weights for policy 1, policy_version 669535 (0.0011) [2023-12-26 04:58:10,440][123091] Updated weights for policy 0, policy_version 674004 (0.0010) [2023-12-26 04:58:10,496][123091] Updated weights for policy 0, policy_version 674014 (0.0009) [2023-12-26 04:58:10,554][123091] Updated weights for policy 0, policy_version 674024 (0.0010) [2023-12-26 04:58:11,160][123090] Updated weights for policy 1, policy_version 669545 (0.0009) [2023-12-26 04:58:11,214][123090] Updated weights for policy 1, policy_version 669555 (0.0009) [2023-12-26 04:58:11,280][123090] Updated weights for policy 1, policy_version 669565 (0.0009) [2023-12-26 04:58:11,416][123091] Updated weights for policy 0, policy_version 674034 (0.0010) [2023-12-26 04:58:11,487][123091] Updated weights for policy 0, policy_version 674044 (0.0011) [2023-12-26 04:58:11,558][123091] Updated weights for policy 0, policy_version 674054 (0.0011) [2023-12-26 04:58:11,626][123091] Updated weights for policy 0, policy_version 674064 (0.0008) [2023-12-26 04:58:12,087][123090] Updated weights for policy 1, policy_version 669575 (0.0009) [2023-12-26 04:58:12,156][123090] Updated weights for policy 1, policy_version 669585 (0.0010) [2023-12-26 04:58:12,230][123090] Updated weights for policy 1, policy_version 669595 (0.0009) [2023-12-26 04:58:12,366][123091] Updated weights for policy 0, policy_version 674074 (0.0009) [2023-12-26 04:58:12,438][123091] Updated weights for policy 0, policy_version 674084 (0.0007) [2023-12-26 04:58:12,506][123091] Updated weights for policy 0, policy_version 674094 (0.0005) [2023-12-26 04:58:13,075][123091] Updated weights for policy 0, policy_version 674104 (0.0005) [2023-12-26 04:58:13,111][123090] Updated weights for policy 1, policy_version 669605 (0.0009) [2023-12-26 04:58:13,132][123091] Updated weights for policy 0, policy_version 674114 (0.0005) [2023-12-26 04:58:13,173][123090] Updated weights for policy 1, policy_version 669615 (0.0009) [2023-12-26 04:58:13,190][123091] Updated weights for policy 0, policy_version 674124 (0.0005) [2023-12-26 04:58:13,231][123090] Updated weights for policy 1, policy_version 669625 (0.0009) [2023-12-26 04:58:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 344006656. Throughput: 0: 9041.8, 1: 8880.9. Samples: 344001696. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:13,785][121949] Avg episode reward: [(0, '6082.584'), (1, '5303.494')] [2023-12-26 04:58:13,862][123091] Updated weights for policy 0, policy_version 674134 (0.0008) [2023-12-26 04:58:13,915][123091] Updated weights for policy 0, policy_version 674144 (0.0009) [2023-12-26 04:58:13,974][123091] Updated weights for policy 0, policy_version 674154 (0.0009) [2023-12-26 04:58:14,070][123090] Updated weights for policy 1, policy_version 669635 (0.0009) [2023-12-26 04:58:14,123][123090] Updated weights for policy 1, policy_version 669645 (0.0008) [2023-12-26 04:58:14,174][123090] Updated weights for policy 1, policy_version 669655 (0.0009) [2023-12-26 04:58:14,736][123091] Updated weights for policy 0, policy_version 674164 (0.0010) [2023-12-26 04:58:14,797][123091] Updated weights for policy 0, policy_version 674174 (0.0010) [2023-12-26 04:58:14,861][123091] Updated weights for policy 0, policy_version 674184 (0.0010) [2023-12-26 04:58:15,038][123090] Updated weights for policy 1, policy_version 669665 (0.0008) [2023-12-26 04:58:15,109][123090] Updated weights for policy 1, policy_version 669675 (0.0008) [2023-12-26 04:58:15,184][123090] Updated weights for policy 1, policy_version 669685 (0.0006) [2023-12-26 04:58:15,243][123090] Updated weights for policy 1, policy_version 669695 (0.0007) [2023-12-26 04:58:15,682][123091] Updated weights for policy 0, policy_version 674194 (0.0010) [2023-12-26 04:58:15,745][123091] Updated weights for policy 0, policy_version 674204 (0.0009) [2023-12-26 04:58:15,796][123091] Updated weights for policy 0, policy_version 674214 (0.0009) [2023-12-26 04:58:15,853][123091] Updated weights for policy 0, policy_version 674224 (0.0009) [2023-12-26 04:58:16,023][123090] Updated weights for policy 1, policy_version 669705 (0.0010) [2023-12-26 04:58:16,078][123090] Updated weights for policy 1, policy_version 669715 (0.0008) [2023-12-26 04:58:16,136][123090] Updated weights for policy 1, policy_version 669725 (0.0009) [2023-12-26 04:58:16,693][123091] Updated weights for policy 0, policy_version 674235 (0.0010) [2023-12-26 04:58:16,750][123091] Updated weights for policy 0, policy_version 674245 (0.0010) [2023-12-26 04:58:16,808][123091] Updated weights for policy 0, policy_version 674255 (0.0010) [2023-12-26 04:58:16,857][123090] Updated weights for policy 1, policy_version 669735 (0.0006) [2023-12-26 04:58:16,905][123090] Updated weights for policy 1, policy_version 669745 (0.0005) [2023-12-26 04:58:16,965][123090] Updated weights for policy 1, policy_version 669755 (0.0008) [2023-12-26 04:58:17,642][123091] Updated weights for policy 0, policy_version 674265 (0.0006) [2023-12-26 04:58:17,695][123091] Updated weights for policy 0, policy_version 674275 (0.0008) [2023-12-26 04:58:17,744][123091] Updated weights for policy 0, policy_version 674285 (0.0009) [2023-12-26 04:58:17,795][123090] Updated weights for policy 1, policy_version 669765 (0.0007) [2023-12-26 04:58:17,849][123090] Updated weights for policy 1, policy_version 669775 (0.0005) [2023-12-26 04:58:17,906][123090] Updated weights for policy 1, policy_version 669785 (0.0005) [2023-12-26 04:58:18,617][123091] Updated weights for policy 0, policy_version 674296 (0.0009) [2023-12-26 04:58:18,634][123090] Updated weights for policy 1, policy_version 669795 (0.0006) [2023-12-26 04:58:18,680][123091] Updated weights for policy 0, policy_version 674306 (0.0009) [2023-12-26 04:58:18,692][123090] Updated weights for policy 1, policy_version 669805 (0.0007) [2023-12-26 04:58:18,739][123090] Updated weights for policy 1, policy_version 669815 (0.0009) [2023-12-26 04:58:18,745][123091] Updated weights for policy 0, policy_version 674316 (0.0008) [2023-12-26 04:58:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 344096768. Throughput: 0: 8957.4, 1: 8856.9. Samples: 344108552. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:18,785][121949] Avg episode reward: [(0, '6051.029'), (1, '5360.757')] [2023-12-26 04:58:19,600][123091] Updated weights for policy 0, policy_version 674326 (0.0009) [2023-12-26 04:58:19,619][123090] Updated weights for policy 1, policy_version 669825 (0.0008) [2023-12-26 04:58:19,666][123091] Updated weights for policy 0, policy_version 674336 (0.0010) [2023-12-26 04:58:19,677][123090] Updated weights for policy 1, policy_version 669835 (0.0005) [2023-12-26 04:58:19,730][123091] Updated weights for policy 0, policy_version 674346 (0.0008) [2023-12-26 04:58:19,741][123090] Updated weights for policy 1, policy_version 669845 (0.0007) [2023-12-26 04:58:19,796][123090] Updated weights for policy 1, policy_version 669855 (0.0007) [2023-12-26 04:58:20,534][123090] Updated weights for policy 1, policy_version 669865 (0.0010) [2023-12-26 04:58:20,619][123091] Updated weights for policy 0, policy_version 674356 (0.0009) [2023-12-26 04:58:20,620][123090] Updated weights for policy 1, policy_version 669875 (0.0010) [2023-12-26 04:58:20,668][123091] Updated weights for policy 0, policy_version 674366 (0.0008) [2023-12-26 04:58:20,673][123090] Updated weights for policy 1, policy_version 669885 (0.0010) [2023-12-26 04:58:20,722][123091] Updated weights for policy 0, policy_version 674376 (0.0008) [2023-12-26 04:58:21,533][123090] Updated weights for policy 1, policy_version 669895 (0.0007) [2023-12-26 04:58:21,594][123091] Updated weights for policy 0, policy_version 674386 (0.0009) [2023-12-26 04:58:21,601][123090] Updated weights for policy 1, policy_version 669905 (0.0009) [2023-12-26 04:58:21,661][123091] Updated weights for policy 0, policy_version 674396 (0.0010) [2023-12-26 04:58:21,674][123090] Updated weights for policy 1, policy_version 669915 (0.0006) [2023-12-26 04:58:21,734][123091] Updated weights for policy 0, policy_version 674406 (0.0010) [2023-12-26 04:58:21,811][123091] Updated weights for policy 0, policy_version 674416 (0.0009) [2023-12-26 04:58:22,392][123090] Updated weights for policy 1, policy_version 669925 (0.0007) [2023-12-26 04:58:22,469][123090] Updated weights for policy 1, policy_version 669935 (0.0010) [2023-12-26 04:58:22,539][123090] Updated weights for policy 1, policy_version 669945 (0.0011) [2023-12-26 04:58:22,641][123091] Updated weights for policy 0, policy_version 674426 (0.0008) [2023-12-26 04:58:22,713][123091] Updated weights for policy 0, policy_version 674436 (0.0010) [2023-12-26 04:58:22,789][123091] Updated weights for policy 0, policy_version 674446 (0.0008) [2023-12-26 04:58:23,335][123090] Updated weights for policy 1, policy_version 669955 (0.0010) [2023-12-26 04:58:23,391][123090] Updated weights for policy 1, policy_version 669965 (0.0008) [2023-12-26 04:58:23,456][123090] Updated weights for policy 1, policy_version 669975 (0.0010) [2023-12-26 04:58:23,583][123091] Updated weights for policy 0, policy_version 674456 (0.0009) [2023-12-26 04:58:23,632][123091] Updated weights for policy 0, policy_version 674466 (0.0005) [2023-12-26 04:58:23,684][123091] Updated weights for policy 0, policy_version 674476 (0.0010) [2023-12-26 04:58:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 344186880. Throughput: 0: 8879.1, 1: 8816.3. Samples: 344158796. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:23,785][121949] Avg episode reward: [(0, '6051.347'), (1, '5619.891')] [2023-12-26 04:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000674480_172670976.pth... [2023-12-26 04:58:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000669984_171515904.pth... [2023-12-26 04:58:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000668928_171245568.pth [2023-12-26 04:58:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000673456_172408832.pth [2023-12-26 04:58:24,239][123090] Updated weights for policy 1, policy_version 669985 (0.0009) [2023-12-26 04:58:24,306][123090] Updated weights for policy 1, policy_version 669995 (0.0006) [2023-12-26 04:58:24,377][123090] Updated weights for policy 1, policy_version 670005 (0.0009) [2023-12-26 04:58:24,448][123090] Updated weights for policy 1, policy_version 670015 (0.0008) [2023-12-26 04:58:24,525][123091] Updated weights for policy 0, policy_version 674486 (0.0010) [2023-12-26 04:58:24,590][123091] Updated weights for policy 0, policy_version 674496 (0.0009) [2023-12-26 04:58:24,650][123091] Updated weights for policy 0, policy_version 674506 (0.0010) [2023-12-26 04:58:25,164][123090] Updated weights for policy 1, policy_version 670025 (0.0010) [2023-12-26 04:58:25,234][123090] Updated weights for policy 1, policy_version 670035 (0.0008) [2023-12-26 04:58:25,301][123090] Updated weights for policy 1, policy_version 670045 (0.0008) [2023-12-26 04:58:25,461][123091] Updated weights for policy 0, policy_version 674516 (0.0008) [2023-12-26 04:58:25,528][123091] Updated weights for policy 0, policy_version 674526 (0.0006) [2023-12-26 04:58:25,584][123091] Updated weights for policy 0, policy_version 674536 (0.0007) [2023-12-26 04:58:26,186][123090] Updated weights for policy 1, policy_version 670055 (0.0008) [2023-12-26 04:58:26,239][123090] Updated weights for policy 1, policy_version 670065 (0.0009) [2023-12-26 04:58:26,249][123091] Updated weights for policy 0, policy_version 674546 (0.0006) [2023-12-26 04:58:26,286][123090] Updated weights for policy 1, policy_version 670075 (0.0008) [2023-12-26 04:58:26,299][123091] Updated weights for policy 0, policy_version 674556 (0.0007) [2023-12-26 04:58:26,350][123091] Updated weights for policy 0, policy_version 674566 (0.0010) [2023-12-26 04:58:26,393][123091] Updated weights for policy 0, policy_version 674576 (0.0010) [2023-12-26 04:58:27,012][123090] Updated weights for policy 1, policy_version 670085 (0.0007) [2023-12-26 04:58:27,069][123090] Updated weights for policy 1, policy_version 670095 (0.0005) [2023-12-26 04:58:27,115][123090] Updated weights for policy 1, policy_version 670105 (0.0005) [2023-12-26 04:58:27,154][123091] Updated weights for policy 0, policy_version 674586 (0.0005) [2023-12-26 04:58:27,215][123091] Updated weights for policy 0, policy_version 674596 (0.0005) [2023-12-26 04:58:27,283][123091] Updated weights for policy 0, policy_version 674606 (0.0005) [2023-12-26 04:58:27,872][123090] Updated weights for policy 1, policy_version 670115 (0.0008) [2023-12-26 04:58:27,936][123090] Updated weights for policy 1, policy_version 670125 (0.0009) [2023-12-26 04:58:28,000][123090] Updated weights for policy 1, policy_version 670135 (0.0009) [2023-12-26 04:58:28,067][123091] Updated weights for policy 0, policy_version 674616 (0.0007) [2023-12-26 04:58:28,137][123091] Updated weights for policy 0, policy_version 674626 (0.0005) [2023-12-26 04:58:28,196][123091] Updated weights for policy 0, policy_version 674636 (0.0005) [2023-12-26 04:58:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 344268800. Throughput: 0: 8888.4, 1: 8841.0. Samples: 344266864. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:28,785][121949] Avg episode reward: [(0, '6160.643'), (1, '5719.678')] [2023-12-26 04:58:28,801][123090] Updated weights for policy 1, policy_version 670145 (0.0008) [2023-12-26 04:58:28,869][123090] Updated weights for policy 1, policy_version 670155 (0.0007) [2023-12-26 04:58:28,930][123091] Updated weights for policy 0, policy_version 674646 (0.0005) [2023-12-26 04:58:28,940][123090] Updated weights for policy 1, policy_version 670165 (0.0009) [2023-12-26 04:58:28,994][123091] Updated weights for policy 0, policy_version 674656 (0.0005) [2023-12-26 04:58:29,003][123090] Updated weights for policy 1, policy_version 670175 (0.0010) [2023-12-26 04:58:29,054][123091] Updated weights for policy 0, policy_version 674666 (0.0008) [2023-12-26 04:58:29,802][123090] Updated weights for policy 1, policy_version 670185 (0.0007) [2023-12-26 04:58:29,874][123090] Updated weights for policy 1, policy_version 670195 (0.0010) [2023-12-26 04:58:29,886][123091] Updated weights for policy 0, policy_version 674676 (0.0010) [2023-12-26 04:58:29,938][123090] Updated weights for policy 1, policy_version 670205 (0.0011) [2023-12-26 04:58:29,943][123091] Updated weights for policy 0, policy_version 674686 (0.0008) [2023-12-26 04:58:30,003][123091] Updated weights for policy 0, policy_version 674696 (0.0009) [2023-12-26 04:58:30,733][123090] Updated weights for policy 1, policy_version 670215 (0.0010) [2023-12-26 04:58:30,797][123090] Updated weights for policy 1, policy_version 670225 (0.0011) [2023-12-26 04:58:30,825][123091] Updated weights for policy 0, policy_version 674706 (0.0008) [2023-12-26 04:58:30,860][123090] Updated weights for policy 1, policy_version 670235 (0.0010) [2023-12-26 04:58:30,877][123091] Updated weights for policy 0, policy_version 674716 (0.0005) [2023-12-26 04:58:30,930][123091] Updated weights for policy 0, policy_version 674726 (0.0005) [2023-12-26 04:58:30,985][123091] Updated weights for policy 0, policy_version 674736 (0.0005) [2023-12-26 04:58:31,689][123090] Updated weights for policy 1, policy_version 670245 (0.0011) [2023-12-26 04:58:31,765][123090] Updated weights for policy 1, policy_version 670255 (0.0010) [2023-12-26 04:58:31,769][123091] Updated weights for policy 0, policy_version 674746 (0.0007) [2023-12-26 04:58:31,832][123090] Updated weights for policy 1, policy_version 670265 (0.0010) [2023-12-26 04:58:31,839][123091] Updated weights for policy 0, policy_version 674756 (0.0009) [2023-12-26 04:58:31,895][123091] Updated weights for policy 0, policy_version 674766 (0.0011) [2023-12-26 04:58:32,626][123090] Updated weights for policy 1, policy_version 670275 (0.0008) [2023-12-26 04:58:32,662][123091] Updated weights for policy 0, policy_version 674776 (0.0008) [2023-12-26 04:58:32,687][123090] Updated weights for policy 1, policy_version 670285 (0.0007) [2023-12-26 04:58:32,727][123091] Updated weights for policy 0, policy_version 674786 (0.0006) [2023-12-26 04:58:32,747][123090] Updated weights for policy 1, policy_version 670295 (0.0007) [2023-12-26 04:58:32,777][123091] Updated weights for policy 0, policy_version 674796 (0.0005) [2023-12-26 04:58:33,507][123091] Updated weights for policy 0, policy_version 674806 (0.0008) [2023-12-26 04:58:33,526][123090] Updated weights for policy 1, policy_version 670305 (0.0006) [2023-12-26 04:58:33,553][123091] Updated weights for policy 0, policy_version 674816 (0.0010) [2023-12-26 04:58:33,569][123090] Updated weights for policy 1, policy_version 670315 (0.0005) [2023-12-26 04:58:33,605][123091] Updated weights for policy 0, policy_version 674826 (0.0010) [2023-12-26 04:58:33,622][123090] Updated weights for policy 1, policy_version 670326 (0.0009) [2023-12-26 04:58:33,670][123090] Updated weights for policy 1, policy_version 670336 (0.0009) [2023-12-26 04:58:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 344367104. Throughput: 0: 8837.5, 1: 8882.7. Samples: 344373040. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:33,785][121949] Avg episode reward: [(0, '6044.489'), (1, '5596.498')] [2023-12-26 04:58:34,348][123091] Updated weights for policy 0, policy_version 674836 (0.0010) [2023-12-26 04:58:34,410][123091] Updated weights for policy 0, policy_version 674846 (0.0010) [2023-12-26 04:58:34,471][123091] Updated weights for policy 0, policy_version 674856 (0.0010) [2023-12-26 04:58:34,552][123090] Updated weights for policy 1, policy_version 670346 (0.0010) [2023-12-26 04:58:34,619][123090] Updated weights for policy 1, policy_version 670357 (0.0010) [2023-12-26 04:58:34,685][123090] Updated weights for policy 1, policy_version 670367 (0.0010) [2023-12-26 04:58:35,371][123091] Updated weights for policy 0, policy_version 674866 (0.0009) [2023-12-26 04:58:35,403][123090] Updated weights for policy 1, policy_version 670377 (0.0005) [2023-12-26 04:58:35,421][123091] Updated weights for policy 0, policy_version 674876 (0.0009) [2023-12-26 04:58:35,455][123090] Updated weights for policy 1, policy_version 670387 (0.0005) [2023-12-26 04:58:35,486][123091] Updated weights for policy 0, policy_version 674886 (0.0010) [2023-12-26 04:58:35,511][123090] Updated weights for policy 1, policy_version 670397 (0.0005) [2023-12-26 04:58:35,548][123091] Updated weights for policy 0, policy_version 674896 (0.0009) [2023-12-26 04:58:36,316][123090] Updated weights for policy 1, policy_version 670407 (0.0009) [2023-12-26 04:58:36,380][123090] Updated weights for policy 1, policy_version 670417 (0.0011) [2023-12-26 04:58:36,412][123091] Updated weights for policy 0, policy_version 674906 (0.0006) [2023-12-26 04:58:36,443][123090] Updated weights for policy 1, policy_version 670427 (0.0011) [2023-12-26 04:58:36,465][123091] Updated weights for policy 0, policy_version 674916 (0.0009) [2023-12-26 04:58:36,529][123091] Updated weights for policy 0, policy_version 674926 (0.0009) [2023-12-26 04:58:37,193][123090] Updated weights for policy 1, policy_version 670437 (0.0008) [2023-12-26 04:58:37,262][123090] Updated weights for policy 1, policy_version 670447 (0.0008) [2023-12-26 04:58:37,332][123090] Updated weights for policy 1, policy_version 670457 (0.0011) [2023-12-26 04:58:37,394][123091] Updated weights for policy 0, policy_version 674936 (0.0007) [2023-12-26 04:58:37,459][123091] Updated weights for policy 0, policy_version 674946 (0.0007) [2023-12-26 04:58:37,530][123091] Updated weights for policy 0, policy_version 674956 (0.0006) [2023-12-26 04:58:38,070][123090] Updated weights for policy 1, policy_version 670467 (0.0009) [2023-12-26 04:58:38,140][123090] Updated weights for policy 1, policy_version 670477 (0.0005) [2023-12-26 04:58:38,210][123090] Updated weights for policy 1, policy_version 670487 (0.0006) [2023-12-26 04:58:38,359][123091] Updated weights for policy 0, policy_version 674966 (0.0009) [2023-12-26 04:58:38,416][123091] Updated weights for policy 0, policy_version 674976 (0.0006) [2023-12-26 04:58:38,485][123091] Updated weights for policy 0, policy_version 674986 (0.0009) [2023-12-26 04:58:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 344449024. Throughput: 0: 8843.5, 1: 8894.7. Samples: 344424952. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:38,785][121949] Avg episode reward: [(0, '5803.902'), (1, '5647.325')] [2023-12-26 04:58:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000674992_172802048.pth... [2023-12-26 04:58:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000670496_171646976.pth... [2023-12-26 04:58:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000673968_172539904.pth [2023-12-26 04:58:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000669472_171384832.pth [2023-12-26 04:58:39,023][123090] Updated weights for policy 1, policy_version 670497 (0.0009) [2023-12-26 04:58:39,079][123090] Updated weights for policy 1, policy_version 670507 (0.0010) [2023-12-26 04:58:39,138][123090] Updated weights for policy 1, policy_version 670517 (0.0010) [2023-12-26 04:58:39,194][123090] Updated weights for policy 1, policy_version 670527 (0.0010) [2023-12-26 04:58:39,290][123091] Updated weights for policy 0, policy_version 674996 (0.0009) [2023-12-26 04:58:39,347][123091] Updated weights for policy 0, policy_version 675006 (0.0009) [2023-12-26 04:58:39,419][123091] Updated weights for policy 0, policy_version 675016 (0.0009) [2023-12-26 04:58:40,072][123090] Updated weights for policy 1, policy_version 670537 (0.0010) [2023-12-26 04:58:40,138][123090] Updated weights for policy 1, policy_version 670547 (0.0009) [2023-12-26 04:58:40,213][123090] Updated weights for policy 1, policy_version 670557 (0.0009) [2023-12-26 04:58:40,307][123091] Updated weights for policy 0, policy_version 675026 (0.0009) [2023-12-26 04:58:40,378][123091] Updated weights for policy 0, policy_version 675036 (0.0009) [2023-12-26 04:58:40,443][123091] Updated weights for policy 0, policy_version 675046 (0.0009) [2023-12-26 04:58:40,513][123091] Updated weights for policy 0, policy_version 675056 (0.0010) [2023-12-26 04:58:41,013][123090] Updated weights for policy 1, policy_version 670567 (0.0009) [2023-12-26 04:58:41,083][123090] Updated weights for policy 1, policy_version 670577 (0.0008) [2023-12-26 04:58:41,157][123090] Updated weights for policy 1, policy_version 670587 (0.0009) [2023-12-26 04:58:41,334][123091] Updated weights for policy 0, policy_version 675066 (0.0011) [2023-12-26 04:58:41,403][123091] Updated weights for policy 0, policy_version 675076 (0.0008) [2023-12-26 04:58:41,452][123091] Updated weights for policy 0, policy_version 675086 (0.0005) [2023-12-26 04:58:42,012][123090] Updated weights for policy 1, policy_version 670597 (0.0007) [2023-12-26 04:58:42,073][123090] Updated weights for policy 1, policy_version 670607 (0.0009) [2023-12-26 04:58:42,121][123090] Updated weights for policy 1, policy_version 670617 (0.0008) [2023-12-26 04:58:42,212][123091] Updated weights for policy 0, policy_version 675096 (0.0005) [2023-12-26 04:58:42,280][123091] Updated weights for policy 0, policy_version 675106 (0.0008) [2023-12-26 04:58:42,333][123091] Updated weights for policy 0, policy_version 675116 (0.0011) [2023-12-26 04:58:43,039][123090] Updated weights for policy 1, policy_version 670627 (0.0009) [2023-12-26 04:58:43,062][123091] Updated weights for policy 0, policy_version 675126 (0.0011) [2023-12-26 04:58:43,088][123090] Updated weights for policy 1, policy_version 670637 (0.0008) [2023-12-26 04:58:43,117][123091] Updated weights for policy 0, policy_version 675136 (0.0010) [2023-12-26 04:58:43,146][123090] Updated weights for policy 1, policy_version 670647 (0.0007) [2023-12-26 04:58:43,180][123091] Updated weights for policy 0, policy_version 675146 (0.0011) [2023-12-26 04:58:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 344530944. Throughput: 0: 8811.1, 1: 8817.8. Samples: 344527536. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:43,785][121949] Avg episode reward: [(0, '5987.758'), (1, '5610.596')] [2023-12-26 04:58:43,912][123091] Updated weights for policy 0, policy_version 675156 (0.0009) [2023-12-26 04:58:43,975][123091] Updated weights for policy 0, policy_version 675166 (0.0006) [2023-12-26 04:58:43,988][123090] Updated weights for policy 1, policy_version 670657 (0.0005) [2023-12-26 04:58:44,036][123091] Updated weights for policy 0, policy_version 675176 (0.0005) [2023-12-26 04:58:44,053][123090] Updated weights for policy 1, policy_version 670667 (0.0009) [2023-12-26 04:58:44,108][123090] Updated weights for policy 1, policy_version 670677 (0.0006) [2023-12-26 04:58:44,180][123090] Updated weights for policy 1, policy_version 670687 (0.0006) [2023-12-26 04:58:44,764][123091] Updated weights for policy 0, policy_version 675186 (0.0009) [2023-12-26 04:58:44,828][123091] Updated weights for policy 0, policy_version 675196 (0.0011) [2023-12-26 04:58:44,841][123090] Updated weights for policy 1, policy_version 670697 (0.0010) [2023-12-26 04:58:44,892][123091] Updated weights for policy 0, policy_version 675206 (0.0011) [2023-12-26 04:58:44,905][123090] Updated weights for policy 1, policy_version 670707 (0.0011) [2023-12-26 04:58:44,952][123091] Updated weights for policy 0, policy_version 675216 (0.0011) [2023-12-26 04:58:44,958][123090] Updated weights for policy 1, policy_version 670717 (0.0010) [2023-12-26 04:58:45,716][123091] Updated weights for policy 0, policy_version 675226 (0.0005) [2023-12-26 04:58:45,729][123090] Updated weights for policy 1, policy_version 670727 (0.0010) [2023-12-26 04:58:45,773][123091] Updated weights for policy 0, policy_version 675236 (0.0005) [2023-12-26 04:58:45,788][123090] Updated weights for policy 1, policy_version 670737 (0.0010) [2023-12-26 04:58:45,832][123091] Updated weights for policy 0, policy_version 675246 (0.0005) [2023-12-26 04:58:45,844][123090] Updated weights for policy 1, policy_version 670747 (0.0010) [2023-12-26 04:58:46,532][123091] Updated weights for policy 0, policy_version 675256 (0.0005) [2023-12-26 04:58:46,578][123091] Updated weights for policy 0, policy_version 675266 (0.0005) [2023-12-26 04:58:46,633][123091] Updated weights for policy 0, policy_version 675276 (0.0005) [2023-12-26 04:58:46,661][123090] Updated weights for policy 1, policy_version 670757 (0.0008) [2023-12-26 04:58:46,724][123090] Updated weights for policy 1, policy_version 670767 (0.0007) [2023-12-26 04:58:46,795][123090] Updated weights for policy 1, policy_version 670777 (0.0007) [2023-12-26 04:58:47,404][123091] Updated weights for policy 0, policy_version 675286 (0.0005) [2023-12-26 04:58:47,460][123091] Updated weights for policy 0, policy_version 675296 (0.0005) [2023-12-26 04:58:47,476][123090] Updated weights for policy 1, policy_version 670787 (0.0007) [2023-12-26 04:58:47,518][123091] Updated weights for policy 0, policy_version 675306 (0.0005) [2023-12-26 04:58:47,534][123090] Updated weights for policy 1, policy_version 670797 (0.0005) [2023-12-26 04:58:47,584][123090] Updated weights for policy 1, policy_version 670807 (0.0005) [2023-12-26 04:58:48,220][123090] Updated weights for policy 1, policy_version 670817 (0.0005) [2023-12-26 04:58:48,227][123091] Updated weights for policy 0, policy_version 675316 (0.0007) [2023-12-26 04:58:48,274][123090] Updated weights for policy 1, policy_version 670827 (0.0005) [2023-12-26 04:58:48,288][123091] Updated weights for policy 0, policy_version 675326 (0.0008) [2023-12-26 04:58:48,334][123090] Updated weights for policy 1, policy_version 670838 (0.0008) [2023-12-26 04:58:48,358][123091] Updated weights for policy 0, policy_version 675336 (0.0007) [2023-12-26 04:58:48,399][123090] Updated weights for policy 1, policy_version 670848 (0.0010) [2023-12-26 04:58:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 344629248. Throughput: 0: 8892.7, 1: 8858.6. Samples: 344640304. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:48,785][121949] Avg episode reward: [(0, '6151.834'), (1, '5534.698')] [2023-12-26 04:58:49,151][123090] Updated weights for policy 1, policy_version 670858 (0.0009) [2023-12-26 04:58:49,156][123091] Updated weights for policy 0, policy_version 675346 (0.0007) [2023-12-26 04:58:49,212][123091] Updated weights for policy 0, policy_version 675356 (0.0010) [2023-12-26 04:58:49,215][123090] Updated weights for policy 1, policy_version 670868 (0.0008) [2023-12-26 04:58:49,274][123091] Updated weights for policy 0, policy_version 675366 (0.0011) [2023-12-26 04:58:49,278][123090] Updated weights for policy 1, policy_version 670878 (0.0008) [2023-12-26 04:58:49,335][123091] Updated weights for policy 0, policy_version 675376 (0.0011) [2023-12-26 04:58:50,072][123090] Updated weights for policy 1, policy_version 670888 (0.0009) [2023-12-26 04:58:50,143][123090] Updated weights for policy 1, policy_version 670898 (0.0009) [2023-12-26 04:58:50,208][123090] Updated weights for policy 1, policy_version 670908 (0.0009) [2023-12-26 04:58:50,210][123091] Updated weights for policy 0, policy_version 675386 (0.0006) [2023-12-26 04:58:50,281][123091] Updated weights for policy 0, policy_version 675396 (0.0006) [2023-12-26 04:58:50,356][123091] Updated weights for policy 0, policy_version 675406 (0.0006) [2023-12-26 04:58:50,960][123090] Updated weights for policy 1, policy_version 670918 (0.0007) [2023-12-26 04:58:51,017][123091] Updated weights for policy 0, policy_version 675416 (0.0008) [2023-12-26 04:58:51,018][123090] Updated weights for policy 1, policy_version 670928 (0.0010) [2023-12-26 04:58:51,080][123090] Updated weights for policy 1, policy_version 670938 (0.0010) [2023-12-26 04:58:51,085][123091] Updated weights for policy 0, policy_version 675426 (0.0009) [2023-12-26 04:58:51,149][123091] Updated weights for policy 0, policy_version 675436 (0.0008) [2023-12-26 04:58:51,936][123090] Updated weights for policy 1, policy_version 670948 (0.0010) [2023-12-26 04:58:51,995][123090] Updated weights for policy 1, policy_version 670958 (0.0010) [2023-12-26 04:58:51,998][123091] Updated weights for policy 0, policy_version 675446 (0.0007) [2023-12-26 04:58:52,063][123090] Updated weights for policy 1, policy_version 670968 (0.0009) [2023-12-26 04:58:52,070][123091] Updated weights for policy 0, policy_version 675456 (0.0006) [2023-12-26 04:58:52,128][123091] Updated weights for policy 0, policy_version 675466 (0.0008) [2023-12-26 04:58:52,867][123091] Updated weights for policy 0, policy_version 675476 (0.0006) [2023-12-26 04:58:52,939][123091] Updated weights for policy 0, policy_version 675486 (0.0005) [2023-12-26 04:58:52,983][123090] Updated weights for policy 1, policy_version 670978 (0.0008) [2023-12-26 04:58:52,990][123091] Updated weights for policy 0, policy_version 675496 (0.0005) [2023-12-26 04:58:53,053][123090] Updated weights for policy 1, policy_version 670988 (0.0009) [2023-12-26 04:58:53,116][123090] Updated weights for policy 1, policy_version 670998 (0.0009) [2023-12-26 04:58:53,183][123090] Updated weights for policy 1, policy_version 671008 (0.0009) [2023-12-26 04:58:53,725][123091] Updated weights for policy 0, policy_version 675506 (0.0007) [2023-12-26 04:58:53,779][123091] Updated weights for policy 0, policy_version 675516 (0.0006) [2023-12-26 04:58:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 344711168. Throughput: 0: 8886.8, 1: 8836.7. Samples: 344692956. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:53,785][121949] Avg episode reward: [(0, '6019.667'), (1, '5653.083')] [2023-12-26 04:58:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000671008_171778048.pth... [2023-12-26 04:58:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000669984_171515904.pth [2023-12-26 04:58:53,837][123091] Updated weights for policy 0, policy_version 675526 (0.0006) [2023-12-26 04:58:53,890][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000675536_172941312.pth... [2023-12-26 04:58:53,891][123091] Updated weights for policy 0, policy_version 675536 (0.0005) [2023-12-26 04:58:53,893][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000674480_172670976.pth [2023-12-26 04:58:54,045][123090] Updated weights for policy 1, policy_version 671018 (0.0010) [2023-12-26 04:58:54,106][123090] Updated weights for policy 1, policy_version 671028 (0.0006) [2023-12-26 04:58:54,168][123090] Updated weights for policy 1, policy_version 671038 (0.0006) [2023-12-26 04:58:54,561][123091] Updated weights for policy 0, policy_version 675546 (0.0007) [2023-12-26 04:58:54,626][123091] Updated weights for policy 0, policy_version 675556 (0.0008) [2023-12-26 04:58:54,694][123091] Updated weights for policy 0, policy_version 675566 (0.0005) [2023-12-26 04:58:54,843][123090] Updated weights for policy 1, policy_version 671048 (0.0005) [2023-12-26 04:58:54,906][123090] Updated weights for policy 1, policy_version 671058 (0.0005) [2023-12-26 04:58:54,966][123090] Updated weights for policy 1, policy_version 671068 (0.0009) [2023-12-26 04:58:55,416][123091] Updated weights for policy 0, policy_version 675576 (0.0010) [2023-12-26 04:58:55,471][123091] Updated weights for policy 0, policy_version 675586 (0.0010) [2023-12-26 04:58:55,518][123091] Updated weights for policy 0, policy_version 675596 (0.0010) [2023-12-26 04:58:55,669][123090] Updated weights for policy 1, policy_version 671078 (0.0007) [2023-12-26 04:58:55,726][123090] Updated weights for policy 1, policy_version 671088 (0.0006) [2023-12-26 04:58:55,785][123090] Updated weights for policy 1, policy_version 671098 (0.0006) [2023-12-26 04:58:56,279][123091] Updated weights for policy 0, policy_version 675606 (0.0007) [2023-12-26 04:58:56,337][123091] Updated weights for policy 0, policy_version 675616 (0.0005) [2023-12-26 04:58:56,396][123091] Updated weights for policy 0, policy_version 675626 (0.0005) [2023-12-26 04:58:56,542][123090] Updated weights for policy 1, policy_version 671108 (0.0007) [2023-12-26 04:58:56,593][123090] Updated weights for policy 1, policy_version 671118 (0.0008) [2023-12-26 04:58:56,646][123090] Updated weights for policy 1, policy_version 671128 (0.0009) [2023-12-26 04:58:57,168][123091] Updated weights for policy 0, policy_version 675636 (0.0009) [2023-12-26 04:58:57,225][123091] Updated weights for policy 0, policy_version 675646 (0.0010) [2023-12-26 04:58:57,286][123091] Updated weights for policy 0, policy_version 675656 (0.0010) [2023-12-26 04:58:57,499][123090] Updated weights for policy 1, policy_version 671138 (0.0009) [2023-12-26 04:58:57,558][123090] Updated weights for policy 1, policy_version 671148 (0.0009) [2023-12-26 04:58:57,617][123090] Updated weights for policy 1, policy_version 671158 (0.0009) [2023-12-26 04:58:57,681][123090] Updated weights for policy 1, policy_version 671168 (0.0009) [2023-12-26 04:58:58,135][123091] Updated weights for policy 0, policy_version 675666 (0.0009) [2023-12-26 04:58:58,201][123091] Updated weights for policy 0, policy_version 675676 (0.0007) [2023-12-26 04:58:58,275][123091] Updated weights for policy 0, policy_version 675686 (0.0007) [2023-12-26 04:58:58,351][123091] Updated weights for policy 0, policy_version 675696 (0.0008) [2023-12-26 04:58:58,515][123090] Updated weights for policy 1, policy_version 671178 (0.0008) [2023-12-26 04:58:58,577][123090] Updated weights for policy 1, policy_version 671188 (0.0010) [2023-12-26 04:58:58,655][123090] Updated weights for policy 1, policy_version 671198 (0.0009) [2023-12-26 04:58:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 344809472. Throughput: 0: 8950.0, 1: 8842.5. Samples: 344802356. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:58:58,785][121949] Avg episode reward: [(0, '6064.182'), (1, '5667.108')] [2023-12-26 04:58:59,178][123091] Updated weights for policy 0, policy_version 675706 (0.0007) [2023-12-26 04:58:59,240][123091] Updated weights for policy 0, policy_version 675716 (0.0007) [2023-12-26 04:58:59,309][123091] Updated weights for policy 0, policy_version 675726 (0.0009) [2023-12-26 04:58:59,545][123090] Updated weights for policy 1, policy_version 671208 (0.0010) [2023-12-26 04:58:59,596][123090] Updated weights for policy 1, policy_version 671218 (0.0010) [2023-12-26 04:58:59,648][123090] Updated weights for policy 1, policy_version 671228 (0.0010) [2023-12-26 04:59:00,126][123091] Updated weights for policy 0, policy_version 675736 (0.0009) [2023-12-26 04:59:00,177][123091] Updated weights for policy 0, policy_version 675746 (0.0009) [2023-12-26 04:59:00,229][123091] Updated weights for policy 0, policy_version 675756 (0.0009) [2023-12-26 04:59:00,499][123090] Updated weights for policy 1, policy_version 671238 (0.0010) [2023-12-26 04:59:00,547][123090] Updated weights for policy 1, policy_version 671248 (0.0010) [2023-12-26 04:59:00,596][123090] Updated weights for policy 1, policy_version 671258 (0.0010) [2023-12-26 04:59:01,093][123091] Updated weights for policy 0, policy_version 675766 (0.0009) [2023-12-26 04:59:01,163][123091] Updated weights for policy 0, policy_version 675776 (0.0009) [2023-12-26 04:59:01,212][123091] Updated weights for policy 0, policy_version 675786 (0.0009) [2023-12-26 04:59:01,450][123090] Updated weights for policy 1, policy_version 671268 (0.0009) [2023-12-26 04:59:01,508][123090] Updated weights for policy 1, policy_version 671279 (0.0009) [2023-12-26 04:59:01,564][123090] Updated weights for policy 1, policy_version 671289 (0.0009) [2023-12-26 04:59:02,061][123091] Updated weights for policy 0, policy_version 675796 (0.0009) [2023-12-26 04:59:02,129][123091] Updated weights for policy 0, policy_version 675806 (0.0008) [2023-12-26 04:59:02,201][123091] Updated weights for policy 0, policy_version 675816 (0.0007) [2023-12-26 04:59:02,436][123090] Updated weights for policy 1, policy_version 671299 (0.0007) [2023-12-26 04:59:02,500][123090] Updated weights for policy 1, policy_version 671309 (0.0006) [2023-12-26 04:59:02,552][123090] Updated weights for policy 1, policy_version 671319 (0.0007) [2023-12-26 04:59:02,912][123091] Updated weights for policy 0, policy_version 675826 (0.0007) [2023-12-26 04:59:02,965][123091] Updated weights for policy 0, policy_version 675836 (0.0005) [2023-12-26 04:59:03,024][123091] Updated weights for policy 0, policy_version 675846 (0.0005) [2023-12-26 04:59:03,087][123091] Updated weights for policy 0, policy_version 675856 (0.0005) [2023-12-26 04:59:03,343][123090] Updated weights for policy 1, policy_version 671329 (0.0007) [2023-12-26 04:59:03,396][123090] Updated weights for policy 1, policy_version 671339 (0.0010) [2023-12-26 04:59:03,442][123090] Updated weights for policy 1, policy_version 671349 (0.0009) [2023-12-26 04:59:03,498][123090] Updated weights for policy 1, policy_version 671359 (0.0009) [2023-12-26 04:59:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 344891392. Throughput: 0: 8917.9, 1: 8777.9. Samples: 344904860. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:59:03,785][121949] Avg episode reward: [(0, '6183.155'), (1, '5574.112')] [2023-12-26 04:59:03,822][123091] Updated weights for policy 0, policy_version 675866 (0.0009) [2023-12-26 04:59:03,878][123091] Updated weights for policy 0, policy_version 675876 (0.0010) [2023-12-26 04:59:03,937][123091] Updated weights for policy 0, policy_version 675886 (0.0010) [2023-12-26 04:59:04,392][123090] Updated weights for policy 1, policy_version 671369 (0.0009) [2023-12-26 04:59:04,445][123090] Updated weights for policy 1, policy_version 671379 (0.0009) [2023-12-26 04:59:04,495][123090] Updated weights for policy 1, policy_version 671389 (0.0009) [2023-12-26 04:59:04,716][123091] Updated weights for policy 0, policy_version 675896 (0.0009) [2023-12-26 04:59:04,790][123091] Updated weights for policy 0, policy_version 675906 (0.0011) [2023-12-26 04:59:04,838][123091] Updated weights for policy 0, policy_version 675916 (0.0009) [2023-12-26 04:59:05,354][123090] Updated weights for policy 1, policy_version 671399 (0.0010) [2023-12-26 04:59:05,405][123090] Updated weights for policy 1, policy_version 671409 (0.0009) [2023-12-26 04:59:05,458][123090] Updated weights for policy 1, policy_version 671419 (0.0009) [2023-12-26 04:59:05,631][123091] Updated weights for policy 0, policy_version 675926 (0.0007) [2023-12-26 04:59:05,688][123091] Updated weights for policy 0, policy_version 675936 (0.0005) [2023-12-26 04:59:05,749][123091] Updated weights for policy 0, policy_version 675946 (0.0005) [2023-12-26 04:59:06,201][123090] Updated weights for policy 1, policy_version 671429 (0.0010) [2023-12-26 04:59:06,269][123090] Updated weights for policy 1, policy_version 671439 (0.0011) [2023-12-26 04:59:06,341][123090] Updated weights for policy 1, policy_version 671449 (0.0011) [2023-12-26 04:59:06,453][123091] Updated weights for policy 0, policy_version 675956 (0.0007) [2023-12-26 04:59:06,526][123091] Updated weights for policy 0, policy_version 675966 (0.0009) [2023-12-26 04:59:06,594][123091] Updated weights for policy 0, policy_version 675976 (0.0009) [2023-12-26 04:59:07,171][123090] Updated weights for policy 1, policy_version 671459 (0.0011) [2023-12-26 04:59:07,227][123090] Updated weights for policy 1, policy_version 671469 (0.0011) [2023-12-26 04:59:07,287][123090] Updated weights for policy 1, policy_version 671479 (0.0010) [2023-12-26 04:59:07,436][123091] Updated weights for policy 0, policy_version 675987 (0.0009) [2023-12-26 04:59:07,501][123091] Updated weights for policy 0, policy_version 675997 (0.0009) [2023-12-26 04:59:07,608][123091] Updated weights for policy 0, policy_version 676007 (0.0009) [2023-12-26 04:59:08,079][123090] Updated weights for policy 1, policy_version 671489 (0.0010) [2023-12-26 04:59:08,149][123090] Updated weights for policy 1, policy_version 671499 (0.0005) [2023-12-26 04:59:08,219][123090] Updated weights for policy 1, policy_version 671509 (0.0008) [2023-12-26 04:59:08,285][123090] Updated weights for policy 1, policy_version 671519 (0.0007) [2023-12-26 04:59:08,423][123091] Updated weights for policy 0, policy_version 676017 (0.0008) [2023-12-26 04:59:08,477][123091] Updated weights for policy 0, policy_version 676027 (0.0008) [2023-12-26 04:59:08,541][123091] Updated weights for policy 0, policy_version 676037 (0.0010) [2023-12-26 04:59:08,604][123091] Updated weights for policy 0, policy_version 676047 (0.0009) [2023-12-26 04:59:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 344981504. Throughput: 0: 8965.3, 1: 8783.6. Samples: 344957504. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:59:08,786][121949] Avg episode reward: [(0, '6169.007'), (1, '5704.324')] [2023-12-26 04:59:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000676048_173072384.pth... [2023-12-26 04:59:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000671520_171909120.pth... [2023-12-26 04:59:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000674992_172802048.pth [2023-12-26 04:59:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000670496_171646976.pth [2023-12-26 04:59:08,975][123090] Updated weights for policy 1, policy_version 671529 (0.0009) [2023-12-26 04:59:09,028][123090] Updated weights for policy 1, policy_version 671539 (0.0009) [2023-12-26 04:59:09,088][123090] Updated weights for policy 1, policy_version 671549 (0.0010) [2023-12-26 04:59:09,450][123091] Updated weights for policy 0, policy_version 676057 (0.0008) [2023-12-26 04:59:09,517][123091] Updated weights for policy 0, policy_version 676067 (0.0008) [2023-12-26 04:59:09,583][123091] Updated weights for policy 0, policy_version 676077 (0.0010) [2023-12-26 04:59:09,948][123090] Updated weights for policy 1, policy_version 671559 (0.0009) [2023-12-26 04:59:10,015][123090] Updated weights for policy 1, policy_version 671569 (0.0009) [2023-12-26 04:59:10,082][123090] Updated weights for policy 1, policy_version 671579 (0.0010) [2023-12-26 04:59:10,410][123091] Updated weights for policy 0, policy_version 676087 (0.0009) [2023-12-26 04:59:10,468][123091] Updated weights for policy 0, policy_version 676097 (0.0008) [2023-12-26 04:59:10,532][123091] Updated weights for policy 0, policy_version 676107 (0.0010) [2023-12-26 04:59:10,920][123090] Updated weights for policy 1, policy_version 671589 (0.0009) [2023-12-26 04:59:10,986][123090] Updated weights for policy 1, policy_version 671599 (0.0009) [2023-12-26 04:59:11,053][123090] Updated weights for policy 1, policy_version 671609 (0.0009) [2023-12-26 04:59:11,453][123091] Updated weights for policy 0, policy_version 676117 (0.0009) [2023-12-26 04:59:11,520][123091] Updated weights for policy 0, policy_version 676127 (0.0009) [2023-12-26 04:59:11,576][123091] Updated weights for policy 0, policy_version 676137 (0.0009) [2023-12-26 04:59:11,937][123090] Updated weights for policy 1, policy_version 671619 (0.0010) [2023-12-26 04:59:12,007][123090] Updated weights for policy 1, policy_version 671629 (0.0009) [2023-12-26 04:59:12,069][123090] Updated weights for policy 1, policy_version 671639 (0.0009) [2023-12-26 04:59:12,449][123091] Updated weights for policy 0, policy_version 676147 (0.0009) [2023-12-26 04:59:12,500][123091] Updated weights for policy 0, policy_version 676157 (0.0009) [2023-12-26 04:59:12,552][123091] Updated weights for policy 0, policy_version 676167 (0.0010) [2023-12-26 04:59:12,846][123090] Updated weights for policy 1, policy_version 671649 (0.0009) [2023-12-26 04:59:12,899][123090] Updated weights for policy 1, policy_version 671659 (0.0005) [2023-12-26 04:59:12,965][123090] Updated weights for policy 1, policy_version 671669 (0.0005) [2023-12-26 04:59:13,013][123090] Updated weights for policy 1, policy_version 671679 (0.0005) [2023-12-26 04:59:13,491][123091] Updated weights for policy 0, policy_version 676177 (0.0009) [2023-12-26 04:59:13,542][123091] Updated weights for policy 0, policy_version 676187 (0.0005) [2023-12-26 04:59:13,592][123091] Updated weights for policy 0, policy_version 676197 (0.0005) [2023-12-26 04:59:13,642][123091] Updated weights for policy 0, policy_version 676207 (0.0005) [2023-12-26 04:59:13,699][123090] Updated weights for policy 1, policy_version 671689 (0.0005) [2023-12-26 04:59:13,767][123090] Updated weights for policy 1, policy_version 671699 (0.0007) [2023-12-26 04:59:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 345063424. Throughput: 0: 8863.8, 1: 8713.6. Samples: 345057848. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:59:13,785][121949] Avg episode reward: [(0, '6176.833'), (1, '5442.377')] [2023-12-26 04:59:13,826][123090] Updated weights for policy 1, policy_version 671709 (0.0006) [2023-12-26 04:59:14,463][123091] Updated weights for policy 0, policy_version 676217 (0.0008) [2023-12-26 04:59:14,523][123091] Updated weights for policy 0, policy_version 676227 (0.0009) [2023-12-26 04:59:14,583][123091] Updated weights for policy 0, policy_version 676237 (0.0009) [2023-12-26 04:59:14,593][123090] Updated weights for policy 1, policy_version 671719 (0.0006) [2023-12-26 04:59:14,661][123090] Updated weights for policy 1, policy_version 671729 (0.0005) [2023-12-26 04:59:14,725][123090] Updated weights for policy 1, policy_version 671739 (0.0006) [2023-12-26 04:59:15,449][123090] Updated weights for policy 1, policy_version 671749 (0.0007) [2023-12-26 04:59:15,452][123091] Updated weights for policy 0, policy_version 676247 (0.0008) [2023-12-26 04:59:15,507][123091] Updated weights for policy 0, policy_version 676257 (0.0008) [2023-12-26 04:59:15,512][123090] Updated weights for policy 1, policy_version 671759 (0.0007) [2023-12-26 04:59:15,565][123091] Updated weights for policy 0, policy_version 676267 (0.0008) [2023-12-26 04:59:15,572][123090] Updated weights for policy 1, policy_version 671769 (0.0007) [2023-12-26 04:59:16,268][123090] Updated weights for policy 1, policy_version 671779 (0.0007) [2023-12-26 04:59:16,334][123090] Updated weights for policy 1, policy_version 671789 (0.0010) [2023-12-26 04:59:16,386][123090] Updated weights for policy 1, policy_version 671799 (0.0010) [2023-12-26 04:59:16,444][123091] Updated weights for policy 0, policy_version 676277 (0.0007) [2023-12-26 04:59:16,497][123091] Updated weights for policy 0, policy_version 676287 (0.0009) [2023-12-26 04:59:16,550][123091] Updated weights for policy 0, policy_version 676297 (0.0009) [2023-12-26 04:59:17,199][123090] Updated weights for policy 1, policy_version 671809 (0.0010) [2023-12-26 04:59:17,255][123090] Updated weights for policy 1, policy_version 671819 (0.0010) [2023-12-26 04:59:17,307][123090] Updated weights for policy 1, policy_version 671829 (0.0010) [2023-12-26 04:59:17,357][123090] Updated weights for policy 1, policy_version 671839 (0.0009) [2023-12-26 04:59:17,411][123091] Updated weights for policy 0, policy_version 676307 (0.0009) [2023-12-26 04:59:17,460][123091] Updated weights for policy 0, policy_version 676317 (0.0009) [2023-12-26 04:59:17,517][123091] Updated weights for policy 0, policy_version 676327 (0.0009) [2023-12-26 04:59:18,191][123090] Updated weights for policy 1, policy_version 671849 (0.0009) [2023-12-26 04:59:18,248][123090] Updated weights for policy 1, policy_version 671859 (0.0010) [2023-12-26 04:59:18,298][123090] Updated weights for policy 1, policy_version 671869 (0.0009) [2023-12-26 04:59:18,359][123091] Updated weights for policy 0, policy_version 676337 (0.0009) [2023-12-26 04:59:18,430][123091] Updated weights for policy 0, policy_version 676347 (0.0008) [2023-12-26 04:59:18,494][123091] Updated weights for policy 0, policy_version 676357 (0.0011) [2023-12-26 04:59:18,561][123091] Updated weights for policy 0, policy_version 676367 (0.0011) [2023-12-26 04:59:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 345153536. Throughput: 0: 8774.2, 1: 8782.4. Samples: 345163088. Policy #0 lag: (min: 13.0, avg: 13.8, max: 36.0) [2023-12-26 04:59:18,785][121949] Avg episode reward: [(0, '6232.683'), (1, '5281.009')] [2023-12-26 04:59:19,199][123090] Updated weights for policy 1, policy_version 671879 (0.0008) [2023-12-26 04:59:19,208][123091] Updated weights for policy 0, policy_version 676377 (0.0006) [2023-12-26 04:59:19,265][123090] Updated weights for policy 1, policy_version 671889 (0.0008) [2023-12-26 04:59:19,281][123091] Updated weights for policy 0, policy_version 676387 (0.0008) [2023-12-26 04:59:19,329][123090] Updated weights for policy 1, policy_version 671899 (0.0008) [2023-12-26 04:59:19,340][123091] Updated weights for policy 0, policy_version 676397 (0.0010) [2023-12-26 04:59:20,072][123091] Updated weights for policy 0, policy_version 676407 (0.0009) [2023-12-26 04:59:20,141][123090] Updated weights for policy 1, policy_version 671909 (0.0009) [2023-12-26 04:59:20,143][123091] Updated weights for policy 0, policy_version 676417 (0.0006) [2023-12-26 04:59:20,201][123090] Updated weights for policy 1, policy_version 671919 (0.0011) [2023-12-26 04:59:20,204][123091] Updated weights for policy 0, policy_version 676427 (0.0006) [2023-12-26 04:59:20,257][123090] Updated weights for policy 1, policy_version 671929 (0.0011) [2023-12-26 04:59:20,964][123091] Updated weights for policy 0, policy_version 676437 (0.0009) [2023-12-26 04:59:21,040][123091] Updated weights for policy 0, policy_version 676447 (0.0011) [2023-12-26 04:59:21,102][123090] Updated weights for policy 1, policy_version 671939 (0.0010) [2023-12-26 04:59:21,108][123091] Updated weights for policy 0, policy_version 676457 (0.0007) [2023-12-26 04:59:21,176][123090] Updated weights for policy 1, policy_version 671949 (0.0009) [2023-12-26 04:59:21,236][123090] Updated weights for policy 1, policy_version 671959 (0.0010) [2023-12-26 04:59:21,939][123091] Updated weights for policy 0, policy_version 676467 (0.0008) [2023-12-26 04:59:22,012][123091] Updated weights for policy 0, policy_version 676477 (0.0009) [2023-12-26 04:59:22,087][123091] Updated weights for policy 0, policy_version 676487 (0.0007) [2023-12-26 04:59:22,140][123090] Updated weights for policy 1, policy_version 671969 (0.0009) [2023-12-26 04:59:22,211][123090] Updated weights for policy 1, policy_version 671979 (0.0009) [2023-12-26 04:59:22,282][123090] Updated weights for policy 1, policy_version 671989 (0.0010) [2023-12-26 04:59:22,346][123090] Updated weights for policy 1, policy_version 671999 (0.0010) [2023-12-26 04:59:22,747][123091] Updated weights for policy 0, policy_version 676497 (0.0006) [2023-12-26 04:59:22,816][123091] Updated weights for policy 0, policy_version 676507 (0.0005) [2023-12-26 04:59:22,889][123091] Updated weights for policy 0, policy_version 676517 (0.0006) [2023-12-26 04:59:22,952][123091] Updated weights for policy 0, policy_version 676527 (0.0006) [2023-12-26 04:59:23,219][123090] Updated weights for policy 1, policy_version 672009 (0.0007) [2023-12-26 04:59:23,275][123090] Updated weights for policy 1, policy_version 672019 (0.0008) [2023-12-26 04:59:23,331][123090] Updated weights for policy 1, policy_version 672029 (0.0009) [2023-12-26 04:59:23,572][123091] Updated weights for policy 0, policy_version 676537 (0.0007) [2023-12-26 04:59:23,642][123091] Updated weights for policy 0, policy_version 676547 (0.0008) [2023-12-26 04:59:23,691][123091] Updated weights for policy 0, policy_version 676558 (0.0009) [2023-12-26 04:59:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 345243648. Throughput: 0: 8834.8, 1: 8749.8. Samples: 345216264. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:23,785][121949] Avg episode reward: [(0, '6206.105'), (1, '5348.978')] [2023-12-26 04:59:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000676560_173203456.pth... [2023-12-26 04:59:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000672032_172040192.pth... [2023-12-26 04:59:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000675536_172941312.pth [2023-12-26 04:59:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000671008_171778048.pth [2023-12-26 04:59:24,231][123090] Updated weights for policy 1, policy_version 672039 (0.0009) [2023-12-26 04:59:24,280][123090] Updated weights for policy 1, policy_version 672049 (0.0008) [2023-12-26 04:59:24,335][123090] Updated weights for policy 1, policy_version 672059 (0.0010) [2023-12-26 04:59:24,416][123091] Updated weights for policy 0, policy_version 676568 (0.0006) [2023-12-26 04:59:24,475][123091] Updated weights for policy 0, policy_version 676578 (0.0005) [2023-12-26 04:59:24,529][123091] Updated weights for policy 0, policy_version 676588 (0.0006) [2023-12-26 04:59:25,202][123091] Updated weights for policy 0, policy_version 676598 (0.0005) [2023-12-26 04:59:25,258][123091] Updated weights for policy 0, policy_version 676608 (0.0005) [2023-12-26 04:59:25,312][123091] Updated weights for policy 0, policy_version 676618 (0.0005) [2023-12-26 04:59:25,315][123090] Updated weights for policy 1, policy_version 672069 (0.0010) [2023-12-26 04:59:25,390][123090] Updated weights for policy 1, policy_version 672079 (0.0009) [2023-12-26 04:59:25,463][123090] Updated weights for policy 1, policy_version 672089 (0.0009) [2023-12-26 04:59:26,045][123091] Updated weights for policy 0, policy_version 676628 (0.0007) [2023-12-26 04:59:26,093][123091] Updated weights for policy 0, policy_version 676638 (0.0010) [2023-12-26 04:59:26,149][123091] Updated weights for policy 0, policy_version 676648 (0.0010) [2023-12-26 04:59:26,261][123090] Updated weights for policy 1, policy_version 672099 (0.0009) [2023-12-26 04:59:26,311][123090] Updated weights for policy 1, policy_version 672109 (0.0009) [2023-12-26 04:59:26,367][123090] Updated weights for policy 1, policy_version 672119 (0.0008) [2023-12-26 04:59:26,968][123091] Updated weights for policy 0, policy_version 676658 (0.0010) [2023-12-26 04:59:27,019][123091] Updated weights for policy 0, policy_version 676668 (0.0010) [2023-12-26 04:59:27,092][123091] Updated weights for policy 0, policy_version 676678 (0.0010) [2023-12-26 04:59:27,154][123091] Updated weights for policy 0, policy_version 676688 (0.0007) [2023-12-26 04:59:27,196][123090] Updated weights for policy 1, policy_version 672129 (0.0009) [2023-12-26 04:59:27,251][123090] Updated weights for policy 1, policy_version 672139 (0.0005) [2023-12-26 04:59:27,306][123090] Updated weights for policy 1, policy_version 672149 (0.0005) [2023-12-26 04:59:27,358][123090] Updated weights for policy 1, policy_version 672159 (0.0008) [2023-12-26 04:59:27,897][123091] Updated weights for policy 0, policy_version 676698 (0.0010) [2023-12-26 04:59:27,955][123091] Updated weights for policy 0, policy_version 676708 (0.0010) [2023-12-26 04:59:27,998][123091] Updated weights for policy 0, policy_version 676718 (0.0010) [2023-12-26 04:59:28,172][123090] Updated weights for policy 1, policy_version 672169 (0.0008) [2023-12-26 04:59:28,221][123090] Updated weights for policy 1, policy_version 672179 (0.0005) [2023-12-26 04:59:28,270][123090] Updated weights for policy 1, policy_version 672189 (0.0005) [2023-12-26 04:59:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 345325568. Throughput: 0: 8978.7, 1: 8705.0. Samples: 345323300. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:28,785][121949] Avg episode reward: [(0, '6141.775'), (1, '5471.531')] [2023-12-26 04:59:28,847][123091] Updated weights for policy 0, policy_version 676728 (0.0010) [2023-12-26 04:59:28,907][123091] Updated weights for policy 0, policy_version 676739 (0.0008) [2023-12-26 04:59:28,957][123091] Updated weights for policy 0, policy_version 676749 (0.0005) [2023-12-26 04:59:29,057][123090] Updated weights for policy 1, policy_version 672199 (0.0008) [2023-12-26 04:59:29,120][123090] Updated weights for policy 1, policy_version 672209 (0.0010) [2023-12-26 04:59:29,176][123090] Updated weights for policy 1, policy_version 672219 (0.0007) [2023-12-26 04:59:29,808][123091] Updated weights for policy 0, policy_version 676759 (0.0010) [2023-12-26 04:59:29,880][123091] Updated weights for policy 0, policy_version 676769 (0.0009) [2023-12-26 04:59:29,955][123091] Updated weights for policy 0, policy_version 676779 (0.0008) [2023-12-26 04:59:30,025][123090] Updated weights for policy 1, policy_version 672229 (0.0007) [2023-12-26 04:59:30,079][123090] Updated weights for policy 1, policy_version 672239 (0.0008) [2023-12-26 04:59:30,138][123090] Updated weights for policy 1, policy_version 672249 (0.0008) [2023-12-26 04:59:30,748][123091] Updated weights for policy 0, policy_version 676789 (0.0011) [2023-12-26 04:59:30,813][123091] Updated weights for policy 0, policy_version 676799 (0.0010) [2023-12-26 04:59:30,852][123090] Updated weights for policy 1, policy_version 672259 (0.0007) [2023-12-26 04:59:30,875][123091] Updated weights for policy 0, policy_version 676809 (0.0010) [2023-12-26 04:59:30,915][123090] Updated weights for policy 1, policy_version 672269 (0.0005) [2023-12-26 04:59:30,971][123090] Updated weights for policy 1, policy_version 672279 (0.0010) [2023-12-26 04:59:31,645][123091] Updated weights for policy 0, policy_version 676819 (0.0010) [2023-12-26 04:59:31,715][123091] Updated weights for policy 0, policy_version 676829 (0.0010) [2023-12-26 04:59:31,781][123091] Updated weights for policy 0, policy_version 676839 (0.0010) [2023-12-26 04:59:31,823][123090] Updated weights for policy 1, policy_version 672289 (0.0009) [2023-12-26 04:59:31,879][123090] Updated weights for policy 1, policy_version 672299 (0.0009) [2023-12-26 04:59:31,933][123090] Updated weights for policy 1, policy_version 672309 (0.0009) [2023-12-26 04:59:31,991][123090] Updated weights for policy 1, policy_version 672319 (0.0010) [2023-12-26 04:59:32,443][123091] Updated weights for policy 0, policy_version 676849 (0.0009) [2023-12-26 04:59:32,497][123091] Updated weights for policy 0, policy_version 676859 (0.0005) [2023-12-26 04:59:32,566][123091] Updated weights for policy 0, policy_version 676869 (0.0008) [2023-12-26 04:59:32,624][123091] Updated weights for policy 0, policy_version 676879 (0.0009) [2023-12-26 04:59:32,910][123090] Updated weights for policy 1, policy_version 672329 (0.0010) [2023-12-26 04:59:32,969][123090] Updated weights for policy 1, policy_version 672339 (0.0010) [2023-12-26 04:59:33,023][123090] Updated weights for policy 1, policy_version 672349 (0.0009) [2023-12-26 04:59:33,451][123091] Updated weights for policy 0, policy_version 676889 (0.0009) [2023-12-26 04:59:33,503][123091] Updated weights for policy 0, policy_version 676899 (0.0009) [2023-12-26 04:59:33,573][123091] Updated weights for policy 0, policy_version 676909 (0.0010) [2023-12-26 04:59:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 345415680. Throughput: 0: 8867.1, 1: 8630.4. Samples: 345427692. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:33,785][121949] Avg episode reward: [(0, '6044.206'), (1, '5444.311')] [2023-12-26 04:59:33,799][123090] Updated weights for policy 1, policy_version 672359 (0.0006) [2023-12-26 04:59:33,870][123090] Updated weights for policy 1, policy_version 672369 (0.0005) [2023-12-26 04:59:33,931][123090] Updated weights for policy 1, policy_version 672379 (0.0005) [2023-12-26 04:59:34,477][123091] Updated weights for policy 0, policy_version 676919 (0.0009) [2023-12-26 04:59:34,529][123091] Updated weights for policy 0, policy_version 676929 (0.0009) [2023-12-26 04:59:34,585][123091] Updated weights for policy 0, policy_version 676939 (0.0009) [2023-12-26 04:59:34,697][123090] Updated weights for policy 1, policy_version 672389 (0.0008) [2023-12-26 04:59:34,750][123090] Updated weights for policy 1, policy_version 672399 (0.0010) [2023-12-26 04:59:34,799][123090] Updated weights for policy 1, policy_version 672409 (0.0010) [2023-12-26 04:59:35,404][123091] Updated weights for policy 0, policy_version 676949 (0.0007) [2023-12-26 04:59:35,458][123091] Updated weights for policy 0, policy_version 676959 (0.0005) [2023-12-26 04:59:35,516][123091] Updated weights for policy 0, policy_version 676969 (0.0005) [2023-12-26 04:59:35,525][123090] Updated weights for policy 1, policy_version 672419 (0.0010) [2023-12-26 04:59:35,577][123090] Updated weights for policy 1, policy_version 672429 (0.0010) [2023-12-26 04:59:35,629][123090] Updated weights for policy 1, policy_version 672439 (0.0010) [2023-12-26 04:59:36,286][123091] Updated weights for policy 0, policy_version 676979 (0.0006) [2023-12-26 04:59:36,355][123091] Updated weights for policy 0, policy_version 676989 (0.0006) [2023-12-26 04:59:36,426][123091] Updated weights for policy 0, policy_version 676999 (0.0006) [2023-12-26 04:59:36,447][123090] Updated weights for policy 1, policy_version 672449 (0.0010) [2023-12-26 04:59:36,520][123090] Updated weights for policy 1, policy_version 672459 (0.0011) [2023-12-26 04:59:36,581][123090] Updated weights for policy 1, policy_version 672469 (0.0011) [2023-12-26 04:59:36,654][123090] Updated weights for policy 1, policy_version 672479 (0.0011) [2023-12-26 04:59:37,206][123091] Updated weights for policy 0, policy_version 677009 (0.0006) [2023-12-26 04:59:37,269][123091] Updated weights for policy 0, policy_version 677019 (0.0006) [2023-12-26 04:59:37,310][123090] Updated weights for policy 1, policy_version 672489 (0.0008) [2023-12-26 04:59:37,333][123091] Updated weights for policy 0, policy_version 677029 (0.0005) [2023-12-26 04:59:37,361][123090] Updated weights for policy 1, policy_version 672499 (0.0007) [2023-12-26 04:59:37,397][123091] Updated weights for policy 0, policy_version 677039 (0.0005) [2023-12-26 04:59:37,421][123090] Updated weights for policy 1, policy_version 672509 (0.0010) [2023-12-26 04:59:38,009][123091] Updated weights for policy 0, policy_version 677049 (0.0006) [2023-12-26 04:59:38,080][123091] Updated weights for policy 0, policy_version 677059 (0.0006) [2023-12-26 04:59:38,154][123091] Updated weights for policy 0, policy_version 677069 (0.0006) [2023-12-26 04:59:38,359][123090] Updated weights for policy 1, policy_version 672520 (0.0011) [2023-12-26 04:59:38,419][123090] Updated weights for policy 1, policy_version 672530 (0.0010) [2023-12-26 04:59:38,479][123090] Updated weights for policy 1, policy_version 672540 (0.0010) [2023-12-26 04:59:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 345505792. Throughput: 0: 8872.2, 1: 8657.2. Samples: 345481784. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:38,785][121949] Avg episode reward: [(0, '5932.081'), (1, '5400.801')] [2023-12-26 04:59:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000677072_173334528.pth... [2023-12-26 04:59:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000672544_172171264.pth... [2023-12-26 04:59:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000676048_173072384.pth [2023-12-26 04:59:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000671520_171909120.pth [2023-12-26 04:59:38,913][123091] Updated weights for policy 0, policy_version 677079 (0.0007) [2023-12-26 04:59:38,974][123091] Updated weights for policy 0, policy_version 677089 (0.0008) [2023-12-26 04:59:39,030][123091] Updated weights for policy 0, policy_version 677099 (0.0005) [2023-12-26 04:59:39,260][123090] Updated weights for policy 1, policy_version 672550 (0.0010) [2023-12-26 04:59:39,336][123090] Updated weights for policy 1, policy_version 672560 (0.0011) [2023-12-26 04:59:39,403][123090] Updated weights for policy 1, policy_version 672570 (0.0011) [2023-12-26 04:59:39,885][123091] Updated weights for policy 0, policy_version 677109 (0.0009) [2023-12-26 04:59:39,953][123091] Updated weights for policy 0, policy_version 677119 (0.0011) [2023-12-26 04:59:40,021][123091] Updated weights for policy 0, policy_version 677129 (0.0011) [2023-12-26 04:59:40,152][123090] Updated weights for policy 1, policy_version 672580 (0.0007) [2023-12-26 04:59:40,206][123090] Updated weights for policy 1, policy_version 672590 (0.0006) [2023-12-26 04:59:40,264][123090] Updated weights for policy 1, policy_version 672600 (0.0005) [2023-12-26 04:59:40,826][123091] Updated weights for policy 0, policy_version 677139 (0.0010) [2023-12-26 04:59:40,882][123091] Updated weights for policy 0, policy_version 677149 (0.0010) [2023-12-26 04:59:40,930][123090] Updated weights for policy 1, policy_version 672610 (0.0006) [2023-12-26 04:59:40,932][123091] Updated weights for policy 0, policy_version 677159 (0.0009) [2023-12-26 04:59:41,001][123090] Updated weights for policy 1, policy_version 672620 (0.0011) [2023-12-26 04:59:41,069][123090] Updated weights for policy 1, policy_version 672630 (0.0011) [2023-12-26 04:59:41,131][123090] Updated weights for policy 1, policy_version 672640 (0.0008) [2023-12-26 04:59:41,792][123091] Updated weights for policy 0, policy_version 677169 (0.0007) [2023-12-26 04:59:41,852][123091] Updated weights for policy 0, policy_version 677179 (0.0010) [2023-12-26 04:59:41,913][123091] Updated weights for policy 0, policy_version 677189 (0.0009) [2023-12-26 04:59:41,968][123090] Updated weights for policy 1, policy_version 672650 (0.0009) [2023-12-26 04:59:41,977][123091] Updated weights for policy 0, policy_version 677199 (0.0009) [2023-12-26 04:59:42,037][123090] Updated weights for policy 1, policy_version 672660 (0.0009) [2023-12-26 04:59:42,103][123090] Updated weights for policy 1, policy_version 672670 (0.0009) [2023-12-26 04:59:42,816][123091] Updated weights for policy 0, policy_version 677209 (0.0006) [2023-12-26 04:59:42,871][123091] Updated weights for policy 0, policy_version 677219 (0.0006) [2023-12-26 04:59:42,877][123090] Updated weights for policy 1, policy_version 672680 (0.0009) [2023-12-26 04:59:42,933][123090] Updated weights for policy 1, policy_version 672690 (0.0006) [2023-12-26 04:59:42,938][123091] Updated weights for policy 0, policy_version 677229 (0.0010) [2023-12-26 04:59:43,006][123090] Updated weights for policy 1, policy_version 672700 (0.0008) [2023-12-26 04:59:43,659][123091] Updated weights for policy 0, policy_version 677239 (0.0007) [2023-12-26 04:59:43,729][123091] Updated weights for policy 0, policy_version 677249 (0.0005) [2023-12-26 04:59:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 345587712. Throughput: 0: 8785.1, 1: 8659.7. Samples: 345587368. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:43,784][121949] Avg episode reward: [(0, '5986.913'), (1, '5404.795')] [2023-12-26 04:59:43,791][123091] Updated weights for policy 0, policy_version 677259 (0.0006) [2023-12-26 04:59:43,803][123090] Updated weights for policy 1, policy_version 672710 (0.0009) [2023-12-26 04:59:43,861][123090] Updated weights for policy 1, policy_version 672721 (0.0010) [2023-12-26 04:59:43,914][123090] Updated weights for policy 1, policy_version 672731 (0.0010) [2023-12-26 04:59:44,524][123091] Updated weights for policy 0, policy_version 677269 (0.0008) [2023-12-26 04:59:44,599][123091] Updated weights for policy 0, policy_version 677279 (0.0010) [2023-12-26 04:59:44,657][123091] Updated weights for policy 0, policy_version 677289 (0.0010) [2023-12-26 04:59:44,722][123090] Updated weights for policy 1, policy_version 672741 (0.0008) [2023-12-26 04:59:44,794][123090] Updated weights for policy 1, policy_version 672751 (0.0007) [2023-12-26 04:59:44,854][123090] Updated weights for policy 1, policy_version 672761 (0.0006) [2023-12-26 04:59:45,524][123091] Updated weights for policy 0, policy_version 677299 (0.0010) [2023-12-26 04:59:45,580][123090] Updated weights for policy 1, policy_version 672771 (0.0006) [2023-12-26 04:59:45,583][123091] Updated weights for policy 0, policy_version 677309 (0.0009) [2023-12-26 04:59:45,643][123090] Updated weights for policy 1, policy_version 672781 (0.0008) [2023-12-26 04:59:45,652][123091] Updated weights for policy 0, policy_version 677319 (0.0008) [2023-12-26 04:59:45,705][123090] Updated weights for policy 1, policy_version 672791 (0.0006) [2023-12-26 04:59:46,344][123091] Updated weights for policy 0, policy_version 677329 (0.0008) [2023-12-26 04:59:46,392][123091] Updated weights for policy 0, policy_version 677339 (0.0006) [2023-12-26 04:59:46,409][123090] Updated weights for policy 1, policy_version 672801 (0.0006) [2023-12-26 04:59:46,456][123091] Updated weights for policy 0, policy_version 677349 (0.0006) [2023-12-26 04:59:46,470][123090] Updated weights for policy 1, policy_version 672812 (0.0009) [2023-12-26 04:59:46,506][123091] Updated weights for policy 0, policy_version 677359 (0.0005) [2023-12-26 04:59:46,531][123090] Updated weights for policy 1, policy_version 672822 (0.0010) [2023-12-26 04:59:46,590][123090] Updated weights for policy 1, policy_version 672832 (0.0010) [2023-12-26 04:59:47,139][123091] Updated weights for policy 0, policy_version 677369 (0.0006) [2023-12-26 04:59:47,201][123091] Updated weights for policy 0, policy_version 677379 (0.0006) [2023-12-26 04:59:47,252][123091] Updated weights for policy 0, policy_version 677389 (0.0005) [2023-12-26 04:59:47,412][123090] Updated weights for policy 1, policy_version 672842 (0.0010) [2023-12-26 04:59:47,478][123090] Updated weights for policy 1, policy_version 672852 (0.0010) [2023-12-26 04:59:47,544][123090] Updated weights for policy 1, policy_version 672862 (0.0010) [2023-12-26 04:59:47,961][123091] Updated weights for policy 0, policy_version 677399 (0.0005) [2023-12-26 04:59:48,025][123091] Updated weights for policy 0, policy_version 677409 (0.0007) [2023-12-26 04:59:48,081][123091] Updated weights for policy 0, policy_version 677419 (0.0006) [2023-12-26 04:59:48,293][123090] Updated weights for policy 1, policy_version 672872 (0.0010) [2023-12-26 04:59:48,359][123090] Updated weights for policy 1, policy_version 672882 (0.0011) [2023-12-26 04:59:48,425][123090] Updated weights for policy 1, policy_version 672892 (0.0010) [2023-12-26 04:59:48,745][123091] Updated weights for policy 0, policy_version 677429 (0.0006) [2023-12-26 04:59:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 345686016. Throughput: 0: 8905.2, 1: 8760.2. Samples: 345699804. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:48,784][121949] Avg episode reward: [(0, '6092.279'), (1, '5552.551')] [2023-12-26 04:59:48,804][123091] Updated weights for policy 0, policy_version 677439 (0.0011) [2023-12-26 04:59:48,856][123091] Updated weights for policy 0, policy_version 677449 (0.0010) [2023-12-26 04:59:49,233][123090] Updated weights for policy 1, policy_version 672902 (0.0008) [2023-12-26 04:59:49,289][123090] Updated weights for policy 1, policy_version 672912 (0.0008) [2023-12-26 04:59:49,348][123090] Updated weights for policy 1, policy_version 672922 (0.0008) [2023-12-26 04:59:49,655][123091] Updated weights for policy 0, policy_version 677459 (0.0009) [2023-12-26 04:59:49,726][123091] Updated weights for policy 0, policy_version 677469 (0.0006) [2023-12-26 04:59:49,793][123091] Updated weights for policy 0, policy_version 677479 (0.0006) [2023-12-26 04:59:50,213][123090] Updated weights for policy 1, policy_version 672932 (0.0008) [2023-12-26 04:59:50,287][123090] Updated weights for policy 1, policy_version 672942 (0.0005) [2023-12-26 04:59:50,363][123090] Updated weights for policy 1, policy_version 672952 (0.0008) [2023-12-26 04:59:50,477][123091] Updated weights for policy 0, policy_version 677489 (0.0007) [2023-12-26 04:59:50,548][123091] Updated weights for policy 0, policy_version 677499 (0.0006) [2023-12-26 04:59:50,617][123091] Updated weights for policy 0, policy_version 677509 (0.0008) [2023-12-26 04:59:50,689][123091] Updated weights for policy 0, policy_version 677519 (0.0008) [2023-12-26 04:59:51,058][123090] Updated weights for policy 1, policy_version 672962 (0.0006) [2023-12-26 04:59:51,139][123090] Updated weights for policy 1, policy_version 672972 (0.0006) [2023-12-26 04:59:51,203][123090] Updated weights for policy 1, policy_version 672982 (0.0011) [2023-12-26 04:59:51,261][123090] Updated weights for policy 1, policy_version 672992 (0.0009) [2023-12-26 04:59:51,427][123091] Updated weights for policy 0, policy_version 677529 (0.0007) [2023-12-26 04:59:51,489][123091] Updated weights for policy 0, policy_version 677539 (0.0006) [2023-12-26 04:59:51,554][123091] Updated weights for policy 0, policy_version 677549 (0.0005) [2023-12-26 04:59:52,131][123090] Updated weights for policy 1, policy_version 673002 (0.0010) [2023-12-26 04:59:52,200][123090] Updated weights for policy 1, policy_version 673012 (0.0009) [2023-12-26 04:59:52,246][123091] Updated weights for policy 0, policy_version 677559 (0.0006) [2023-12-26 04:59:52,266][123090] Updated weights for policy 1, policy_version 673022 (0.0009) [2023-12-26 04:59:52,311][123091] Updated weights for policy 0, policy_version 677569 (0.0007) [2023-12-26 04:59:52,381][123091] Updated weights for policy 0, policy_version 677579 (0.0006) [2023-12-26 04:59:53,091][123091] Updated weights for policy 0, policy_version 677589 (0.0008) [2023-12-26 04:59:53,096][123090] Updated weights for policy 1, policy_version 673032 (0.0009) [2023-12-26 04:59:53,159][123091] Updated weights for policy 0, policy_version 677599 (0.0006) [2023-12-26 04:59:53,162][123090] Updated weights for policy 1, policy_version 673042 (0.0008) [2023-12-26 04:59:53,216][123091] Updated weights for policy 0, policy_version 677609 (0.0006) [2023-12-26 04:59:53,225][123090] Updated weights for policy 1, policy_version 673052 (0.0008) [2023-12-26 04:59:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 345776128. Throughput: 0: 8931.6, 1: 8763.3. Samples: 345753768. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:53,785][121949] Avg episode reward: [(0, '6151.670'), (1, '5549.679')] [2023-12-26 04:59:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000673056_172302336.pth... [2023-12-26 04:59:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000677616_173473792.pth... [2023-12-26 04:59:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000672032_172040192.pth [2023-12-26 04:59:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000676560_173203456.pth [2023-12-26 04:59:53,936][123091] Updated weights for policy 0, policy_version 677619 (0.0008) [2023-12-26 04:59:53,982][123091] Updated weights for policy 0, policy_version 677629 (0.0005) [2023-12-26 04:59:54,035][123091] Updated weights for policy 0, policy_version 677639 (0.0006) [2023-12-26 04:59:54,075][123090] Updated weights for policy 1, policy_version 673062 (0.0009) [2023-12-26 04:59:54,140][123090] Updated weights for policy 1, policy_version 673072 (0.0010) [2023-12-26 04:59:54,205][123090] Updated weights for policy 1, policy_version 673082 (0.0009) [2023-12-26 04:59:54,821][123091] Updated weights for policy 0, policy_version 677649 (0.0005) [2023-12-26 04:59:54,876][123091] Updated weights for policy 0, policy_version 677659 (0.0005) [2023-12-26 04:59:54,940][123091] Updated weights for policy 0, policy_version 677669 (0.0006) [2023-12-26 04:59:54,997][123091] Updated weights for policy 0, policy_version 677679 (0.0007) [2023-12-26 04:59:55,076][123090] Updated weights for policy 1, policy_version 673092 (0.0010) [2023-12-26 04:59:55,132][123090] Updated weights for policy 1, policy_version 673103 (0.0010) [2023-12-26 04:59:55,186][123090] Updated weights for policy 1, policy_version 673113 (0.0009) [2023-12-26 04:59:55,763][123091] Updated weights for policy 0, policy_version 677689 (0.0010) [2023-12-26 04:59:55,812][123091] Updated weights for policy 0, policy_version 677700 (0.0009) [2023-12-26 04:59:55,865][123091] Updated weights for policy 0, policy_version 677711 (0.0009) [2023-12-26 04:59:56,044][123090] Updated weights for policy 1, policy_version 673123 (0.0010) [2023-12-26 04:59:56,102][123090] Updated weights for policy 1, policy_version 673134 (0.0010) [2023-12-26 04:59:56,160][123090] Updated weights for policy 1, policy_version 673144 (0.0009) [2023-12-26 04:59:56,577][123091] Updated weights for policy 0, policy_version 677721 (0.0006) [2023-12-26 04:59:56,654][123091] Updated weights for policy 0, policy_version 677731 (0.0005) [2023-12-26 04:59:56,715][123091] Updated weights for policy 0, policy_version 677741 (0.0007) [2023-12-26 04:59:57,083][123090] Updated weights for policy 1, policy_version 673154 (0.0009) [2023-12-26 04:59:57,134][123090] Updated weights for policy 1, policy_version 673164 (0.0010) [2023-12-26 04:59:57,196][123090] Updated weights for policy 1, policy_version 673174 (0.0011) [2023-12-26 04:59:57,248][123090] Updated weights for policy 1, policy_version 673184 (0.0009) [2023-12-26 04:59:57,430][123091] Updated weights for policy 0, policy_version 677751 (0.0010) [2023-12-26 04:59:57,490][123091] Updated weights for policy 0, policy_version 677761 (0.0011) [2023-12-26 04:59:57,552][123091] Updated weights for policy 0, policy_version 677771 (0.0010) [2023-12-26 04:59:58,063][123090] Updated weights for policy 1, policy_version 673194 (0.0009) [2023-12-26 04:59:58,128][123090] Updated weights for policy 1, policy_version 673204 (0.0009) [2023-12-26 04:59:58,181][123090] Updated weights for policy 1, policy_version 673214 (0.0009) [2023-12-26 04:59:58,415][123091] Updated weights for policy 0, policy_version 677781 (0.0011) [2023-12-26 04:59:58,479][123091] Updated weights for policy 0, policy_version 677791 (0.0009) [2023-12-26 04:59:58,551][123091] Updated weights for policy 0, policy_version 677801 (0.0007) [2023-12-26 04:59:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 345866240. Throughput: 0: 9115.9, 1: 8728.2. Samples: 345860832. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 04:59:58,785][121949] Avg episode reward: [(0, '6066.416'), (1, '5367.203')] [2023-12-26 04:59:59,070][123090] Updated weights for policy 1, policy_version 673224 (0.0008) [2023-12-26 04:59:59,133][123090] Updated weights for policy 1, policy_version 673234 (0.0007) [2023-12-26 04:59:59,213][123090] Updated weights for policy 1, policy_version 673244 (0.0008) [2023-12-26 04:59:59,424][123091] Updated weights for policy 0, policy_version 677811 (0.0008) [2023-12-26 04:59:59,477][123091] Updated weights for policy 0, policy_version 677821 (0.0009) [2023-12-26 04:59:59,531][123091] Updated weights for policy 0, policy_version 677831 (0.0009) [2023-12-26 04:59:59,951][123090] Updated weights for policy 1, policy_version 673254 (0.0007) [2023-12-26 05:00:00,014][123090] Updated weights for policy 1, policy_version 673264 (0.0007) [2023-12-26 05:00:00,078][123090] Updated weights for policy 1, policy_version 673274 (0.0010) [2023-12-26 05:00:00,391][123091] Updated weights for policy 0, policy_version 677841 (0.0007) [2023-12-26 05:00:00,443][123091] Updated weights for policy 0, policy_version 677851 (0.0009) [2023-12-26 05:00:00,499][123091] Updated weights for policy 0, policy_version 677861 (0.0009) [2023-12-26 05:00:00,550][123091] Updated weights for policy 0, policy_version 677871 (0.0009) [2023-12-26 05:00:00,899][123090] Updated weights for policy 1, policy_version 673284 (0.0010) [2023-12-26 05:00:00,948][123090] Updated weights for policy 1, policy_version 673294 (0.0010) [2023-12-26 05:00:01,005][123090] Updated weights for policy 1, policy_version 673304 (0.0009) [2023-12-26 05:00:01,379][123091] Updated weights for policy 0, policy_version 677881 (0.0010) [2023-12-26 05:00:01,438][123091] Updated weights for policy 0, policy_version 677891 (0.0009) [2023-12-26 05:00:01,499][123091] Updated weights for policy 0, policy_version 677901 (0.0010) [2023-12-26 05:00:01,824][123090] Updated weights for policy 1, policy_version 673314 (0.0008) [2023-12-26 05:00:01,869][123090] Updated weights for policy 1, policy_version 673324 (0.0005) [2023-12-26 05:00:01,925][123090] Updated weights for policy 1, policy_version 673334 (0.0005) [2023-12-26 05:00:01,981][123090] Updated weights for policy 1, policy_version 673344 (0.0006) [2023-12-26 05:00:02,392][123091] Updated weights for policy 0, policy_version 677911 (0.0009) [2023-12-26 05:00:02,443][123091] Updated weights for policy 0, policy_version 677921 (0.0009) [2023-12-26 05:00:02,495][123091] Updated weights for policy 0, policy_version 677931 (0.0009) [2023-12-26 05:00:02,693][123090] Updated weights for policy 1, policy_version 673354 (0.0010) [2023-12-26 05:00:02,748][123090] Updated weights for policy 1, policy_version 673364 (0.0010) [2023-12-26 05:00:02,802][123090] Updated weights for policy 1, policy_version 673374 (0.0010) [2023-12-26 05:00:03,273][123091] Updated weights for policy 0, policy_version 677941 (0.0010) [2023-12-26 05:00:03,320][123091] Updated weights for policy 0, policy_version 677951 (0.0010) [2023-12-26 05:00:03,371][123091] Updated weights for policy 0, policy_version 677961 (0.0010) [2023-12-26 05:00:03,669][123090] Updated weights for policy 1, policy_version 673384 (0.0009) [2023-12-26 05:00:03,728][123090] Updated weights for policy 1, policy_version 673394 (0.0009) [2023-12-26 05:00:03,777][123090] Updated weights for policy 1, policy_version 673404 (0.0009) [2023-12-26 05:00:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 345948160. Throughput: 0: 9117.0, 1: 8657.5. Samples: 345962936. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:03,784][121949] Avg episode reward: [(0, '5998.646'), (1, '5323.594')] [2023-12-26 05:00:04,231][123091] Updated weights for policy 0, policy_version 677971 (0.0011) [2023-12-26 05:00:04,280][123091] Updated weights for policy 0, policy_version 677981 (0.0011) [2023-12-26 05:00:04,344][123091] Updated weights for policy 0, policy_version 677991 (0.0011) [2023-12-26 05:00:04,659][123090] Updated weights for policy 1, policy_version 673414 (0.0009) [2023-12-26 05:00:04,715][123090] Updated weights for policy 1, policy_version 673424 (0.0009) [2023-12-26 05:00:04,781][123090] Updated weights for policy 1, policy_version 673434 (0.0009) [2023-12-26 05:00:05,175][123091] Updated weights for policy 0, policy_version 678001 (0.0011) [2023-12-26 05:00:05,231][123091] Updated weights for policy 0, policy_version 678011 (0.0006) [2023-12-26 05:00:05,294][123091] Updated weights for policy 0, policy_version 678021 (0.0005) [2023-12-26 05:00:05,363][123091] Updated weights for policy 0, policy_version 678031 (0.0006) [2023-12-26 05:00:05,673][123090] Updated weights for policy 1, policy_version 673444 (0.0009) [2023-12-26 05:00:05,738][123090] Updated weights for policy 1, policy_version 673454 (0.0009) [2023-12-26 05:00:05,796][123090] Updated weights for policy 1, policy_version 673464 (0.0010) [2023-12-26 05:00:05,885][123091] Updated weights for policy 0, policy_version 678041 (0.0006) [2023-12-26 05:00:05,946][123091] Updated weights for policy 0, policy_version 678051 (0.0005) [2023-12-26 05:00:06,014][123091] Updated weights for policy 0, policy_version 678061 (0.0005) [2023-12-26 05:00:06,658][123090] Updated weights for policy 1, policy_version 673474 (0.0010) [2023-12-26 05:00:06,711][123090] Updated weights for policy 1, policy_version 673484 (0.0010) [2023-12-26 05:00:06,714][123091] Updated weights for policy 0, policy_version 678071 (0.0006) [2023-12-26 05:00:06,762][123090] Updated weights for policy 1, policy_version 673494 (0.0008) [2023-12-26 05:00:06,773][123091] Updated weights for policy 0, policy_version 678081 (0.0009) [2023-12-26 05:00:06,815][123090] Updated weights for policy 1, policy_version 673504 (0.0009) [2023-12-26 05:00:06,830][123091] Updated weights for policy 0, policy_version 678091 (0.0007) [2023-12-26 05:00:07,615][123090] Updated weights for policy 1, policy_version 673514 (0.0010) [2023-12-26 05:00:07,671][123090] Updated weights for policy 1, policy_version 673524 (0.0010) [2023-12-26 05:00:07,684][123091] Updated weights for policy 0, policy_version 678101 (0.0008) [2023-12-26 05:00:07,738][123090] Updated weights for policy 1, policy_version 673534 (0.0008) [2023-12-26 05:00:07,756][123091] Updated weights for policy 0, policy_version 678111 (0.0005) [2023-12-26 05:00:07,817][123091] Updated weights for policy 0, policy_version 678121 (0.0005) [2023-12-26 05:00:08,469][123090] Updated weights for policy 1, policy_version 673544 (0.0010) [2023-12-26 05:00:08,533][123090] Updated weights for policy 1, policy_version 673554 (0.0011) [2023-12-26 05:00:08,536][123091] Updated weights for policy 0, policy_version 678131 (0.0006) [2023-12-26 05:00:08,596][123091] Updated weights for policy 0, policy_version 678141 (0.0008) [2023-12-26 05:00:08,596][123090] Updated weights for policy 1, policy_version 673564 (0.0010) [2023-12-26 05:00:08,658][123091] Updated weights for policy 0, policy_version 678151 (0.0009) [2023-12-26 05:00:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 346046464. Throughput: 0: 9131.7, 1: 8631.3. Samples: 346015596. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:08,785][121949] Avg episode reward: [(0, '6021.508'), (1, '5388.586')] [2023-12-26 05:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000673568_172433408.pth... [2023-12-26 05:00:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000678160_173613056.pth... [2023-12-26 05:00:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000672544_172171264.pth [2023-12-26 05:00:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000677072_173334528.pth [2023-12-26 05:00:09,380][123090] Updated weights for policy 1, policy_version 673574 (0.0008) [2023-12-26 05:00:09,425][123091] Updated weights for policy 0, policy_version 678161 (0.0010) [2023-12-26 05:00:09,454][123090] Updated weights for policy 1, policy_version 673584 (0.0008) [2023-12-26 05:00:09,491][123091] Updated weights for policy 0, policy_version 678171 (0.0006) [2023-12-26 05:00:09,524][123090] Updated weights for policy 1, policy_version 673594 (0.0007) [2023-12-26 05:00:09,560][123091] Updated weights for policy 0, policy_version 678181 (0.0006) [2023-12-26 05:00:09,629][123091] Updated weights for policy 0, policy_version 678191 (0.0006) [2023-12-26 05:00:10,298][123090] Updated weights for policy 1, policy_version 673604 (0.0007) [2023-12-26 05:00:10,362][123090] Updated weights for policy 1, policy_version 673614 (0.0009) [2023-12-26 05:00:10,399][123091] Updated weights for policy 0, policy_version 678201 (0.0005) [2023-12-26 05:00:10,431][123090] Updated weights for policy 1, policy_version 673624 (0.0010) [2023-12-26 05:00:10,457][123091] Updated weights for policy 0, policy_version 678211 (0.0006) [2023-12-26 05:00:10,516][123091] Updated weights for policy 0, policy_version 678221 (0.0006) [2023-12-26 05:00:11,288][123090] Updated weights for policy 1, policy_version 673634 (0.0008) [2023-12-26 05:00:11,309][123091] Updated weights for policy 0, policy_version 678231 (0.0008) [2023-12-26 05:00:11,354][123090] Updated weights for policy 1, policy_version 673644 (0.0008) [2023-12-26 05:00:11,377][123091] Updated weights for policy 0, policy_version 678241 (0.0008) [2023-12-26 05:00:11,420][123090] Updated weights for policy 1, policy_version 673654 (0.0009) [2023-12-26 05:00:11,449][123091] Updated weights for policy 0, policy_version 678251 (0.0008) [2023-12-26 05:00:11,476][123090] Updated weights for policy 1, policy_version 673664 (0.0009) [2023-12-26 05:00:12,228][123091] Updated weights for policy 0, policy_version 678261 (0.0008) [2023-12-26 05:00:12,307][123091] Updated weights for policy 0, policy_version 678271 (0.0007) [2023-12-26 05:00:12,336][123090] Updated weights for policy 1, policy_version 673674 (0.0008) [2023-12-26 05:00:12,373][123091] Updated weights for policy 0, policy_version 678281 (0.0010) [2023-12-26 05:00:12,408][123090] Updated weights for policy 1, policy_version 673684 (0.0008) [2023-12-26 05:00:12,457][123090] Updated weights for policy 1, policy_version 673694 (0.0009) [2023-12-26 05:00:13,218][123091] Updated weights for policy 0, policy_version 678291 (0.0010) [2023-12-26 05:00:13,243][123090] Updated weights for policy 1, policy_version 673704 (0.0007) [2023-12-26 05:00:13,286][123091] Updated weights for policy 0, policy_version 678301 (0.0009) [2023-12-26 05:00:13,298][123090] Updated weights for policy 1, policy_version 673714 (0.0008) [2023-12-26 05:00:13,351][123091] Updated weights for policy 0, policy_version 678311 (0.0007) [2023-12-26 05:00:13,352][123090] Updated weights for policy 1, policy_version 673724 (0.0009) [2023-12-26 05:00:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 346128384. Throughput: 0: 9027.0, 1: 8700.8. Samples: 346121048. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:13,784][121949] Avg episode reward: [(0, '6142.084'), (1, '5401.632')] [2023-12-26 05:00:14,123][123090] Updated weights for policy 1, policy_version 673734 (0.0007) [2023-12-26 05:00:14,189][123090] Updated weights for policy 1, policy_version 673744 (0.0008) [2023-12-26 05:00:14,201][123091] Updated weights for policy 0, policy_version 678321 (0.0008) [2023-12-26 05:00:14,253][123090] Updated weights for policy 1, policy_version 673754 (0.0009) [2023-12-26 05:00:14,264][123091] Updated weights for policy 0, policy_version 678331 (0.0006) [2023-12-26 05:00:14,334][123091] Updated weights for policy 0, policy_version 678341 (0.0009) [2023-12-26 05:00:14,389][123091] Updated weights for policy 0, policy_version 678351 (0.0009) [2023-12-26 05:00:15,051][123090] Updated weights for policy 1, policy_version 673764 (0.0010) [2023-12-26 05:00:15,110][123090] Updated weights for policy 1, policy_version 673774 (0.0009) [2023-12-26 05:00:15,173][123090] Updated weights for policy 1, policy_version 673784 (0.0009) [2023-12-26 05:00:15,262][123091] Updated weights for policy 0, policy_version 678361 (0.0006) [2023-12-26 05:00:15,328][123091] Updated weights for policy 0, policy_version 678371 (0.0010) [2023-12-26 05:00:15,381][123091] Updated weights for policy 0, policy_version 678381 (0.0009) [2023-12-26 05:00:16,032][123090] Updated weights for policy 1, policy_version 673794 (0.0009) [2023-12-26 05:00:16,089][123090] Updated weights for policy 1, policy_version 673804 (0.0008) [2023-12-26 05:00:16,102][123091] Updated weights for policy 0, policy_version 678391 (0.0010) [2023-12-26 05:00:16,145][123090] Updated weights for policy 1, policy_version 673814 (0.0009) [2023-12-26 05:00:16,158][123091] Updated weights for policy 0, policy_version 678401 (0.0007) [2023-12-26 05:00:16,206][123090] Updated weights for policy 1, policy_version 673824 (0.0008) [2023-12-26 05:00:16,220][123091] Updated weights for policy 0, policy_version 678411 (0.0008) [2023-12-26 05:00:16,910][123091] Updated weights for policy 0, policy_version 678421 (0.0009) [2023-12-26 05:00:16,973][123091] Updated weights for policy 0, policy_version 678431 (0.0005) [2023-12-26 05:00:17,040][123091] Updated weights for policy 0, policy_version 678441 (0.0006) [2023-12-26 05:00:17,104][123090] Updated weights for policy 1, policy_version 673834 (0.0010) [2023-12-26 05:00:17,170][123090] Updated weights for policy 1, policy_version 673844 (0.0010) [2023-12-26 05:00:17,225][123090] Updated weights for policy 1, policy_version 673854 (0.0010) [2023-12-26 05:00:17,688][123091] Updated weights for policy 0, policy_version 678451 (0.0006) [2023-12-26 05:00:17,735][123091] Updated weights for policy 0, policy_version 678461 (0.0007) [2023-12-26 05:00:17,794][123091] Updated weights for policy 0, policy_version 678471 (0.0005) [2023-12-26 05:00:18,131][123090] Updated weights for policy 1, policy_version 673864 (0.0010) [2023-12-26 05:00:18,179][123090] Updated weights for policy 1, policy_version 673874 (0.0008) [2023-12-26 05:00:18,238][123090] Updated weights for policy 1, policy_version 673884 (0.0010) [2023-12-26 05:00:18,493][123091] Updated weights for policy 0, policy_version 678481 (0.0008) [2023-12-26 05:00:18,556][123091] Updated weights for policy 0, policy_version 678491 (0.0009) [2023-12-26 05:00:18,619][123091] Updated weights for policy 0, policy_version 678501 (0.0009) [2023-12-26 05:00:18,675][123091] Updated weights for policy 0, policy_version 678511 (0.0009) [2023-12-26 05:00:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 346218496. Throughput: 0: 9086.7, 1: 8676.4. Samples: 346227028. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:18,785][121949] Avg episode reward: [(0, '6107.817'), (1, '5396.595')] [2023-12-26 05:00:18,985][123090] Updated weights for policy 1, policy_version 673894 (0.0009) [2023-12-26 05:00:19,044][123090] Updated weights for policy 1, policy_version 673904 (0.0008) [2023-12-26 05:00:19,106][123090] Updated weights for policy 1, policy_version 673914 (0.0008) [2023-12-26 05:00:19,549][123091] Updated weights for policy 0, policy_version 678521 (0.0010) [2023-12-26 05:00:19,611][123091] Updated weights for policy 0, policy_version 678531 (0.0010) [2023-12-26 05:00:19,671][123091] Updated weights for policy 0, policy_version 678541 (0.0010) [2023-12-26 05:00:20,005][123090] Updated weights for policy 1, policy_version 673924 (0.0010) [2023-12-26 05:00:20,075][123090] Updated weights for policy 1, policy_version 673934 (0.0010) [2023-12-26 05:00:20,134][123090] Updated weights for policy 1, policy_version 673944 (0.0010) [2023-12-26 05:00:20,446][123091] Updated weights for policy 0, policy_version 678551 (0.0009) [2023-12-26 05:00:20,517][123091] Updated weights for policy 0, policy_version 678561 (0.0007) [2023-12-26 05:00:20,588][123091] Updated weights for policy 0, policy_version 678571 (0.0008) [2023-12-26 05:00:21,070][123090] Updated weights for policy 1, policy_version 673954 (0.0010) [2023-12-26 05:00:21,136][123090] Updated weights for policy 1, policy_version 673964 (0.0009) [2023-12-26 05:00:21,205][123090] Updated weights for policy 1, policy_version 673974 (0.0009) [2023-12-26 05:00:21,229][123091] Updated weights for policy 0, policy_version 678581 (0.0007) [2023-12-26 05:00:21,265][123090] Updated weights for policy 1, policy_version 673984 (0.0008) [2023-12-26 05:00:21,300][123091] Updated weights for policy 0, policy_version 678591 (0.0007) [2023-12-26 05:00:21,386][123091] Updated weights for policy 0, policy_version 678601 (0.0007) [2023-12-26 05:00:22,139][123091] Updated weights for policy 0, policy_version 678611 (0.0008) [2023-12-26 05:00:22,142][123090] Updated weights for policy 1, policy_version 673994 (0.0008) [2023-12-26 05:00:22,196][123091] Updated weights for policy 0, policy_version 678621 (0.0009) [2023-12-26 05:00:22,198][123090] Updated weights for policy 1, policy_version 674004 (0.0007) [2023-12-26 05:00:22,254][123091] Updated weights for policy 0, policy_version 678631 (0.0008) [2023-12-26 05:00:22,262][123090] Updated weights for policy 1, policy_version 674014 (0.0007) [2023-12-26 05:00:23,095][123090] Updated weights for policy 1, policy_version 674024 (0.0009) [2023-12-26 05:00:23,105][123091] Updated weights for policy 0, policy_version 678641 (0.0009) [2023-12-26 05:00:23,159][123090] Updated weights for policy 1, policy_version 674034 (0.0010) [2023-12-26 05:00:23,165][123091] Updated weights for policy 0, policy_version 678651 (0.0007) [2023-12-26 05:00:23,213][123090] Updated weights for policy 1, policy_version 674044 (0.0007) [2023-12-26 05:00:23,229][123091] Updated weights for policy 0, policy_version 678661 (0.0009) [2023-12-26 05:00:23,297][123091] Updated weights for policy 0, policy_version 678671 (0.0009) [2023-12-26 05:00:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 346300416. Throughput: 0: 9092.4, 1: 8615.8. Samples: 346278648. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:23,785][121949] Avg episode reward: [(0, '5972.866'), (1, '5464.199')] [2023-12-26 05:00:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000674048_172556288.pth... [2023-12-26 05:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000678672_173744128.pth... [2023-12-26 05:00:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000673056_172302336.pth [2023-12-26 05:00:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000677616_173473792.pth [2023-12-26 05:00:24,060][123090] Updated weights for policy 1, policy_version 674054 (0.0010) [2023-12-26 05:00:24,122][123090] Updated weights for policy 1, policy_version 674064 (0.0008) [2023-12-26 05:00:24,131][123091] Updated weights for policy 0, policy_version 678681 (0.0007) [2023-12-26 05:00:24,184][123090] Updated weights for policy 1, policy_version 674074 (0.0009) [2023-12-26 05:00:24,186][123091] Updated weights for policy 0, policy_version 678691 (0.0008) [2023-12-26 05:00:24,233][123091] Updated weights for policy 0, policy_version 678701 (0.0005) [2023-12-26 05:00:24,949][123090] Updated weights for policy 1, policy_version 674084 (0.0010) [2023-12-26 05:00:24,956][123091] Updated weights for policy 0, policy_version 678711 (0.0007) [2023-12-26 05:00:24,997][123090] Updated weights for policy 1, policy_version 674094 (0.0010) [2023-12-26 05:00:25,003][123091] Updated weights for policy 0, policy_version 678721 (0.0006) [2023-12-26 05:00:25,051][123091] Updated weights for policy 0, policy_version 678731 (0.0010) [2023-12-26 05:00:25,053][123090] Updated weights for policy 1, policy_version 674104 (0.0010) [2023-12-26 05:00:25,802][123090] Updated weights for policy 1, policy_version 674114 (0.0009) [2023-12-26 05:00:25,874][123090] Updated weights for policy 1, policy_version 674124 (0.0005) [2023-12-26 05:00:25,934][123091] Updated weights for policy 0, policy_version 678741 (0.0010) [2023-12-26 05:00:25,948][123090] Updated weights for policy 1, policy_version 674134 (0.0005) [2023-12-26 05:00:25,993][123091] Updated weights for policy 0, policy_version 678751 (0.0007) [2023-12-26 05:00:26,009][123090] Updated weights for policy 1, policy_version 674144 (0.0005) [2023-12-26 05:00:26,052][123091] Updated weights for policy 0, policy_version 678761 (0.0005) [2023-12-26 05:00:26,564][123090] Updated weights for policy 1, policy_version 674154 (0.0005) [2023-12-26 05:00:26,630][123090] Updated weights for policy 1, policy_version 674164 (0.0005) [2023-12-26 05:00:26,697][123090] Updated weights for policy 1, policy_version 674174 (0.0005) [2023-12-26 05:00:26,740][123091] Updated weights for policy 0, policy_version 678771 (0.0005) [2023-12-26 05:00:26,812][123091] Updated weights for policy 0, policy_version 678781 (0.0005) [2023-12-26 05:00:26,877][123091] Updated weights for policy 0, policy_version 678791 (0.0005) [2023-12-26 05:00:27,337][123090] Updated weights for policy 1, policy_version 674184 (0.0006) [2023-12-26 05:00:27,394][123090] Updated weights for policy 1, policy_version 674194 (0.0005) [2023-12-26 05:00:27,466][123090] Updated weights for policy 1, policy_version 674204 (0.0005) [2023-12-26 05:00:27,599][123091] Updated weights for policy 0, policy_version 678801 (0.0009) [2023-12-26 05:00:27,655][123091] Updated weights for policy 0, policy_version 678811 (0.0009) [2023-12-26 05:00:27,705][123091] Updated weights for policy 0, policy_version 678822 (0.0009) [2023-12-26 05:00:27,753][123091] Updated weights for policy 0, policy_version 678832 (0.0009) [2023-12-26 05:00:28,250][123090] Updated weights for policy 1, policy_version 674214 (0.0008) [2023-12-26 05:00:28,304][123090] Updated weights for policy 1, policy_version 674224 (0.0010) [2023-12-26 05:00:28,365][123090] Updated weights for policy 1, policy_version 674234 (0.0009) [2023-12-26 05:00:28,558][123091] Updated weights for policy 0, policy_version 678842 (0.0008) [2023-12-26 05:00:28,624][123091] Updated weights for policy 0, policy_version 678852 (0.0008) [2023-12-26 05:00:28,691][123091] Updated weights for policy 0, policy_version 678862 (0.0008) [2023-12-26 05:00:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 346398720. Throughput: 0: 9126.5, 1: 8680.6. Samples: 346388688. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:28,785][121949] Avg episode reward: [(0, '6017.512'), (1, '5444.822')] [2023-12-26 05:00:29,143][123090] Updated weights for policy 1, policy_version 674244 (0.0006) [2023-12-26 05:00:29,204][123090] Updated weights for policy 1, policy_version 674254 (0.0005) [2023-12-26 05:00:29,276][123090] Updated weights for policy 1, policy_version 674264 (0.0008) [2023-12-26 05:00:29,497][123091] Updated weights for policy 0, policy_version 678872 (0.0009) [2023-12-26 05:00:29,564][123091] Updated weights for policy 0, policy_version 678882 (0.0010) [2023-12-26 05:00:29,625][123091] Updated weights for policy 0, policy_version 678892 (0.0010) [2023-12-26 05:00:30,078][123090] Updated weights for policy 1, policy_version 674274 (0.0006) [2023-12-26 05:00:30,132][123090] Updated weights for policy 1, policy_version 674284 (0.0008) [2023-12-26 05:00:30,187][123090] Updated weights for policy 1, policy_version 674294 (0.0008) [2023-12-26 05:00:30,252][123090] Updated weights for policy 1, policy_version 674304 (0.0008) [2023-12-26 05:00:30,410][123091] Updated weights for policy 0, policy_version 678902 (0.0010) [2023-12-26 05:00:30,473][123091] Updated weights for policy 0, policy_version 678912 (0.0008) [2023-12-26 05:00:30,537][123091] Updated weights for policy 0, policy_version 678922 (0.0005) [2023-12-26 05:00:31,073][123090] Updated weights for policy 1, policy_version 674314 (0.0009) [2023-12-26 05:00:31,130][123090] Updated weights for policy 1, policy_version 674324 (0.0010) [2023-12-26 05:00:31,197][123090] Updated weights for policy 1, policy_version 674334 (0.0008) [2023-12-26 05:00:31,371][123091] Updated weights for policy 0, policy_version 678932 (0.0009) [2023-12-26 05:00:31,440][123091] Updated weights for policy 0, policy_version 678942 (0.0009) [2023-12-26 05:00:31,506][123091] Updated weights for policy 0, policy_version 678952 (0.0010) [2023-12-26 05:00:31,975][123090] Updated weights for policy 1, policy_version 674344 (0.0009) [2023-12-26 05:00:32,036][123090] Updated weights for policy 1, policy_version 674354 (0.0010) [2023-12-26 05:00:32,093][123090] Updated weights for policy 1, policy_version 674364 (0.0009) [2023-12-26 05:00:32,222][123091] Updated weights for policy 0, policy_version 678962 (0.0009) [2023-12-26 05:00:32,295][123091] Updated weights for policy 0, policy_version 678972 (0.0008) [2023-12-26 05:00:32,365][123091] Updated weights for policy 0, policy_version 678982 (0.0008) [2023-12-26 05:00:32,425][123091] Updated weights for policy 0, policy_version 678992 (0.0009) [2023-12-26 05:00:32,930][123090] Updated weights for policy 1, policy_version 674374 (0.0009) [2023-12-26 05:00:32,996][123090] Updated weights for policy 1, policy_version 674384 (0.0009) [2023-12-26 05:00:33,048][123090] Updated weights for policy 1, policy_version 674394 (0.0010) [2023-12-26 05:00:33,208][123091] Updated weights for policy 0, policy_version 679002 (0.0007) [2023-12-26 05:00:33,259][123091] Updated weights for policy 0, policy_version 679012 (0.0009) [2023-12-26 05:00:33,307][123091] Updated weights for policy 0, policy_version 679022 (0.0009) [2023-12-26 05:00:33,739][123090] Updated weights for policy 1, policy_version 674404 (0.0007) [2023-12-26 05:00:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 346480640. Throughput: 0: 9044.8, 1: 8636.8. Samples: 346495476. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:33,784][121949] Avg episode reward: [(0, '6241.041'), (1, '5408.850')] [2023-12-26 05:00:33,796][123090] Updated weights for policy 1, policy_version 674414 (0.0008) [2023-12-26 05:00:33,857][123090] Updated weights for policy 1, policy_version 674424 (0.0010) [2023-12-26 05:00:34,049][123091] Updated weights for policy 0, policy_version 679032 (0.0005) [2023-12-26 05:00:34,107][123091] Updated weights for policy 0, policy_version 679042 (0.0010) [2023-12-26 05:00:34,164][123091] Updated weights for policy 0, policy_version 679052 (0.0007) [2023-12-26 05:00:34,553][123090] Updated weights for policy 1, policy_version 674434 (0.0009) [2023-12-26 05:00:34,615][123090] Updated weights for policy 1, policy_version 674444 (0.0006) [2023-12-26 05:00:34,674][123090] Updated weights for policy 1, policy_version 674454 (0.0010) [2023-12-26 05:00:34,731][123090] Updated weights for policy 1, policy_version 674464 (0.0010) [2023-12-26 05:00:34,907][123091] Updated weights for policy 0, policy_version 679062 (0.0007) [2023-12-26 05:00:34,957][123091] Updated weights for policy 0, policy_version 679072 (0.0006) [2023-12-26 05:00:35,005][123091] Updated weights for policy 0, policy_version 679082 (0.0005) [2023-12-26 05:00:35,461][123090] Updated weights for policy 1, policy_version 674474 (0.0006) [2023-12-26 05:00:35,510][123090] Updated weights for policy 1, policy_version 674484 (0.0005) [2023-12-26 05:00:35,561][123090] Updated weights for policy 1, policy_version 674494 (0.0005) [2023-12-26 05:00:35,777][123091] Updated weights for policy 0, policy_version 679092 (0.0006) [2023-12-26 05:00:35,842][123091] Updated weights for policy 0, policy_version 679102 (0.0006) [2023-12-26 05:00:35,900][123091] Updated weights for policy 0, policy_version 679112 (0.0006) [2023-12-26 05:00:36,354][123090] Updated weights for policy 1, policy_version 674504 (0.0009) [2023-12-26 05:00:36,422][123090] Updated weights for policy 1, policy_version 674514 (0.0011) [2023-12-26 05:00:36,490][123090] Updated weights for policy 1, policy_version 674524 (0.0010) [2023-12-26 05:00:36,719][123091] Updated weights for policy 0, policy_version 679122 (0.0008) [2023-12-26 05:00:36,784][123091] Updated weights for policy 0, policy_version 679132 (0.0011) [2023-12-26 05:00:36,842][123091] Updated weights for policy 0, policy_version 679142 (0.0009) [2023-12-26 05:00:36,917][123091] Updated weights for policy 0, policy_version 679152 (0.0011) [2023-12-26 05:00:37,286][123090] Updated weights for policy 1, policy_version 674534 (0.0010) [2023-12-26 05:00:37,337][123090] Updated weights for policy 1, policy_version 674544 (0.0010) [2023-12-26 05:00:37,393][123090] Updated weights for policy 1, policy_version 674554 (0.0010) [2023-12-26 05:00:37,732][123091] Updated weights for policy 0, policy_version 679162 (0.0010) [2023-12-26 05:00:37,791][123091] Updated weights for policy 0, policy_version 679172 (0.0010) [2023-12-26 05:00:37,853][123091] Updated weights for policy 0, policy_version 679182 (0.0011) [2023-12-26 05:00:38,215][123090] Updated weights for policy 1, policy_version 674564 (0.0008) [2023-12-26 05:00:38,270][123090] Updated weights for policy 1, policy_version 674574 (0.0005) [2023-12-26 05:00:38,335][123090] Updated weights for policy 1, policy_version 674584 (0.0006) [2023-12-26 05:00:38,693][123091] Updated weights for policy 0, policy_version 679192 (0.0009) [2023-12-26 05:00:38,755][123091] Updated weights for policy 0, policy_version 679202 (0.0008) [2023-12-26 05:00:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 346570752. Throughput: 0: 9034.6, 1: 8702.1. Samples: 346551916. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:38,785][121949] Avg episode reward: [(0, '6176.271'), (1, '5351.509')] [2023-12-26 05:00:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000674592_172695552.pth... [2023-12-26 05:00:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000673568_172433408.pth [2023-12-26 05:00:38,818][123091] Updated weights for policy 0, policy_version 679212 (0.0008) [2023-12-26 05:00:38,838][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000679216_173883392.pth... [2023-12-26 05:00:38,841][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000678160_173613056.pth [2023-12-26 05:00:38,999][123090] Updated weights for policy 1, policy_version 674594 (0.0007) [2023-12-26 05:00:39,066][123090] Updated weights for policy 1, policy_version 674604 (0.0005) [2023-12-26 05:00:39,129][123090] Updated weights for policy 1, policy_version 674614 (0.0005) [2023-12-26 05:00:39,208][123090] Updated weights for policy 1, policy_version 674624 (0.0008) [2023-12-26 05:00:39,584][123091] Updated weights for policy 0, policy_version 679222 (0.0007) [2023-12-26 05:00:39,655][123091] Updated weights for policy 0, policy_version 679232 (0.0008) [2023-12-26 05:00:39,724][123091] Updated weights for policy 0, policy_version 679242 (0.0006) [2023-12-26 05:00:39,908][123090] Updated weights for policy 1, policy_version 674634 (0.0008) [2023-12-26 05:00:39,982][123090] Updated weights for policy 1, policy_version 674644 (0.0008) [2023-12-26 05:00:40,050][123090] Updated weights for policy 1, policy_version 674654 (0.0008) [2023-12-26 05:00:40,501][123091] Updated weights for policy 0, policy_version 679252 (0.0008) [2023-12-26 05:00:40,557][123091] Updated weights for policy 0, policy_version 679262 (0.0011) [2023-12-26 05:00:40,613][123091] Updated weights for policy 0, policy_version 679272 (0.0011) [2023-12-26 05:00:40,767][123090] Updated weights for policy 1, policy_version 674664 (0.0007) [2023-12-26 05:00:40,826][123090] Updated weights for policy 1, policy_version 674674 (0.0010) [2023-12-26 05:00:40,886][123090] Updated weights for policy 1, policy_version 674684 (0.0011) [2023-12-26 05:00:41,426][123091] Updated weights for policy 0, policy_version 679282 (0.0009) [2023-12-26 05:00:41,479][123091] Updated weights for policy 0, policy_version 679292 (0.0010) [2023-12-26 05:00:41,539][123091] Updated weights for policy 0, policy_version 679302 (0.0009) [2023-12-26 05:00:41,605][123091] Updated weights for policy 0, policy_version 679312 (0.0009) [2023-12-26 05:00:41,740][123090] Updated weights for policy 1, policy_version 674694 (0.0010) [2023-12-26 05:00:41,800][123090] Updated weights for policy 1, policy_version 674704 (0.0009) [2023-12-26 05:00:41,861][123090] Updated weights for policy 1, policy_version 674714 (0.0008) [2023-12-26 05:00:42,537][123091] Updated weights for policy 0, policy_version 679322 (0.0009) [2023-12-26 05:00:42,581][123090] Updated weights for policy 1, policy_version 674724 (0.0007) [2023-12-26 05:00:42,598][123091] Updated weights for policy 0, policy_version 679332 (0.0008) [2023-12-26 05:00:42,644][123090] Updated weights for policy 1, policy_version 674734 (0.0006) [2023-12-26 05:00:42,656][123091] Updated weights for policy 0, policy_version 679342 (0.0009) [2023-12-26 05:00:42,695][123090] Updated weights for policy 1, policy_version 674744 (0.0006) [2023-12-26 05:00:43,424][123090] Updated weights for policy 1, policy_version 674754 (0.0006) [2023-12-26 05:00:43,488][123090] Updated weights for policy 1, policy_version 674764 (0.0005) [2023-12-26 05:00:43,531][123091] Updated weights for policy 0, policy_version 679352 (0.0006) [2023-12-26 05:00:43,550][123090] Updated weights for policy 1, policy_version 674774 (0.0005) [2023-12-26 05:00:43,584][123091] Updated weights for policy 0, policy_version 679362 (0.0006) [2023-12-26 05:00:43,607][123090] Updated weights for policy 1, policy_version 674784 (0.0005) [2023-12-26 05:00:43,642][123091] Updated weights for policy 0, policy_version 679372 (0.0010) [2023-12-26 05:00:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 346669056. Throughput: 0: 8886.0, 1: 8807.9. Samples: 346657060. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:43,785][121949] Avg episode reward: [(0, '6121.498'), (1, '5342.104')] [2023-12-26 05:00:44,303][123090] Updated weights for policy 1, policy_version 674794 (0.0007) [2023-12-26 05:00:44,361][123090] Updated weights for policy 1, policy_version 674804 (0.0006) [2023-12-26 05:00:44,425][123090] Updated weights for policy 1, policy_version 674814 (0.0006) [2023-12-26 05:00:44,459][123091] Updated weights for policy 0, policy_version 679382 (0.0011) [2023-12-26 05:00:44,514][123091] Updated weights for policy 0, policy_version 679392 (0.0011) [2023-12-26 05:00:44,574][123091] Updated weights for policy 0, policy_version 679402 (0.0010) [2023-12-26 05:00:45,192][123090] Updated weights for policy 1, policy_version 674824 (0.0006) [2023-12-26 05:00:45,270][123090] Updated weights for policy 1, policy_version 674834 (0.0006) [2023-12-26 05:00:45,331][123090] Updated weights for policy 1, policy_version 674844 (0.0009) [2023-12-26 05:00:45,343][123091] Updated weights for policy 0, policy_version 679412 (0.0007) [2023-12-26 05:00:45,420][123091] Updated weights for policy 0, policy_version 679422 (0.0006) [2023-12-26 05:00:45,471][123091] Updated weights for policy 0, policy_version 679432 (0.0007) [2023-12-26 05:00:46,005][123090] Updated weights for policy 1, policy_version 674854 (0.0007) [2023-12-26 05:00:46,068][123090] Updated weights for policy 1, policy_version 674864 (0.0007) [2023-12-26 05:00:46,133][123090] Updated weights for policy 1, policy_version 674874 (0.0008) [2023-12-26 05:00:46,245][123091] Updated weights for policy 0, policy_version 679442 (0.0010) [2023-12-26 05:00:46,292][123091] Updated weights for policy 0, policy_version 679452 (0.0010) [2023-12-26 05:00:46,336][123091] Updated weights for policy 0, policy_version 679462 (0.0010) [2023-12-26 05:00:46,383][123091] Updated weights for policy 0, policy_version 679472 (0.0010) [2023-12-26 05:00:46,864][123090] Updated weights for policy 1, policy_version 674884 (0.0008) [2023-12-26 05:00:46,926][123090] Updated weights for policy 1, policy_version 674894 (0.0010) [2023-12-26 05:00:47,000][123090] Updated weights for policy 1, policy_version 674904 (0.0010) [2023-12-26 05:00:47,144][123091] Updated weights for policy 0, policy_version 679482 (0.0010) [2023-12-26 05:00:47,202][123091] Updated weights for policy 0, policy_version 679492 (0.0010) [2023-12-26 05:00:47,257][123091] Updated weights for policy 0, policy_version 679502 (0.0007) [2023-12-26 05:00:47,781][123090] Updated weights for policy 1, policy_version 674914 (0.0010) [2023-12-26 05:00:47,840][123090] Updated weights for policy 1, policy_version 674924 (0.0010) [2023-12-26 05:00:47,903][123090] Updated weights for policy 1, policy_version 674934 (0.0010) [2023-12-26 05:00:47,963][123090] Updated weights for policy 1, policy_version 674944 (0.0011) [2023-12-26 05:00:48,038][123091] Updated weights for policy 0, policy_version 679512 (0.0008) [2023-12-26 05:00:48,087][123091] Updated weights for policy 0, policy_version 679522 (0.0009) [2023-12-26 05:00:48,138][123091] Updated weights for policy 0, policy_version 679532 (0.0009) [2023-12-26 05:00:48,729][123090] Updated weights for policy 1, policy_version 674954 (0.0005) [2023-12-26 05:00:48,781][123090] Updated weights for policy 1, policy_version 674964 (0.0009) [2023-12-26 05:00:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 346750976. Throughput: 0: 8944.4, 1: 8930.9. Samples: 346767328. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:48,785][121949] Avg episode reward: [(0, '6083.862'), (1, '5495.904')] [2023-12-26 05:00:48,845][123090] Updated weights for policy 1, policy_version 674974 (0.0010) [2023-12-26 05:00:49,050][123091] Updated weights for policy 0, policy_version 679542 (0.0010) [2023-12-26 05:00:49,126][123091] Updated weights for policy 0, policy_version 679552 (0.0009) [2023-12-26 05:00:49,198][123091] Updated weights for policy 0, policy_version 679562 (0.0010) [2023-12-26 05:00:49,536][123090] Updated weights for policy 1, policy_version 674984 (0.0010) [2023-12-26 05:00:49,593][123090] Updated weights for policy 1, policy_version 674994 (0.0009) [2023-12-26 05:00:49,647][123090] Updated weights for policy 1, policy_version 675004 (0.0009) [2023-12-26 05:00:50,041][123091] Updated weights for policy 0, policy_version 679572 (0.0010) [2023-12-26 05:00:50,108][123091] Updated weights for policy 0, policy_version 679582 (0.0011) [2023-12-26 05:00:50,171][123091] Updated weights for policy 0, policy_version 679592 (0.0011) [2023-12-26 05:00:50,459][123090] Updated weights for policy 1, policy_version 675014 (0.0007) [2023-12-26 05:00:50,524][123090] Updated weights for policy 1, policy_version 675024 (0.0008) [2023-12-26 05:00:50,594][123090] Updated weights for policy 1, policy_version 675034 (0.0007) [2023-12-26 05:00:50,996][123091] Updated weights for policy 0, policy_version 679602 (0.0010) [2023-12-26 05:00:51,063][123091] Updated weights for policy 0, policy_version 679612 (0.0011) [2023-12-26 05:00:51,131][123091] Updated weights for policy 0, policy_version 679622 (0.0011) [2023-12-26 05:00:51,202][123091] Updated weights for policy 0, policy_version 679632 (0.0011) [2023-12-26 05:00:51,420][123090] Updated weights for policy 1, policy_version 675044 (0.0008) [2023-12-26 05:00:51,473][123090] Updated weights for policy 1, policy_version 675054 (0.0009) [2023-12-26 05:00:51,526][123090] Updated weights for policy 1, policy_version 675064 (0.0009) [2023-12-26 05:00:52,024][123091] Updated weights for policy 0, policy_version 679642 (0.0006) [2023-12-26 05:00:52,078][123091] Updated weights for policy 0, policy_version 679652 (0.0007) [2023-12-26 05:00:52,139][123091] Updated weights for policy 0, policy_version 679662 (0.0009) [2023-12-26 05:00:52,405][123090] Updated weights for policy 1, policy_version 675074 (0.0009) [2023-12-26 05:00:52,466][123090] Updated weights for policy 1, policy_version 675084 (0.0009) [2023-12-26 05:00:52,525][123090] Updated weights for policy 1, policy_version 675094 (0.0010) [2023-12-26 05:00:52,583][123090] Updated weights for policy 1, policy_version 675104 (0.0010) [2023-12-26 05:00:52,946][123091] Updated weights for policy 0, policy_version 679672 (0.0009) [2023-12-26 05:00:53,012][123091] Updated weights for policy 0, policy_version 679682 (0.0009) [2023-12-26 05:00:53,069][123091] Updated weights for policy 0, policy_version 679692 (0.0005) [2023-12-26 05:00:53,433][123090] Updated weights for policy 1, policy_version 675114 (0.0010) [2023-12-26 05:00:53,485][123090] Updated weights for policy 1, policy_version 675124 (0.0010) [2023-12-26 05:00:53,532][123090] Updated weights for policy 1, policy_version 675134 (0.0010) [2023-12-26 05:00:53,732][123091] Updated weights for policy 0, policy_version 679702 (0.0008) [2023-12-26 05:00:53,782][123091] Updated weights for policy 0, policy_version 679712 (0.0010) [2023-12-26 05:00:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 346841088. Throughput: 0: 8866.7, 1: 8971.6. Samples: 346818316. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:53,785][121949] Avg episode reward: [(0, '6063.074'), (1, '5383.018')] [2023-12-26 05:00:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000675136_172834816.pth... [2023-12-26 05:00:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000674048_172556288.pth [2023-12-26 05:00:53,839][123091] Updated weights for policy 0, policy_version 679722 (0.0007) [2023-12-26 05:00:53,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000679728_174014464.pth... [2023-12-26 05:00:53,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000678672_173744128.pth [2023-12-26 05:00:54,402][123090] Updated weights for policy 1, policy_version 675144 (0.0006) [2023-12-26 05:00:54,470][123090] Updated weights for policy 1, policy_version 675154 (0.0005) [2023-12-26 05:00:54,543][123090] Updated weights for policy 1, policy_version 675164 (0.0006) [2023-12-26 05:00:54,571][123091] Updated weights for policy 0, policy_version 679732 (0.0005) [2023-12-26 05:00:54,629][123091] Updated weights for policy 0, policy_version 679742 (0.0009) [2023-12-26 05:00:54,685][123091] Updated weights for policy 0, policy_version 679752 (0.0012) [2023-12-26 05:00:55,182][123090] Updated weights for policy 1, policy_version 675174 (0.0005) [2023-12-26 05:00:55,250][123090] Updated weights for policy 1, policy_version 675184 (0.0005) [2023-12-26 05:00:55,305][123090] Updated weights for policy 1, policy_version 675194 (0.0005) [2023-12-26 05:00:55,403][123091] Updated weights for policy 0, policy_version 679762 (0.0007) [2023-12-26 05:00:55,453][123091] Updated weights for policy 0, policy_version 679772 (0.0009) [2023-12-26 05:00:55,511][123091] Updated weights for policy 0, policy_version 679782 (0.0010) [2023-12-26 05:00:55,572][123091] Updated weights for policy 0, policy_version 679792 (0.0010) [2023-12-26 05:00:56,010][123090] Updated weights for policy 1, policy_version 675204 (0.0007) [2023-12-26 05:00:56,065][123090] Updated weights for policy 1, policy_version 675214 (0.0010) [2023-12-26 05:00:56,120][123090] Updated weights for policy 1, policy_version 675224 (0.0010) [2023-12-26 05:00:56,390][123091] Updated weights for policy 0, policy_version 679802 (0.0010) [2023-12-26 05:00:56,440][123091] Updated weights for policy 0, policy_version 679812 (0.0010) [2023-12-26 05:00:56,496][123091] Updated weights for policy 0, policy_version 679822 (0.0011) [2023-12-26 05:00:56,887][123090] Updated weights for policy 1, policy_version 675234 (0.0009) [2023-12-26 05:00:56,948][123090] Updated weights for policy 1, policy_version 675244 (0.0005) [2023-12-26 05:00:57,008][123090] Updated weights for policy 1, policy_version 675254 (0.0005) [2023-12-26 05:00:57,063][123090] Updated weights for policy 1, policy_version 675264 (0.0005) [2023-12-26 05:00:57,328][123091] Updated weights for policy 0, policy_version 679832 (0.0010) [2023-12-26 05:00:57,386][123091] Updated weights for policy 0, policy_version 679842 (0.0010) [2023-12-26 05:00:57,443][123091] Updated weights for policy 0, policy_version 679852 (0.0006) [2023-12-26 05:00:57,772][123090] Updated weights for policy 1, policy_version 675274 (0.0010) [2023-12-26 05:00:57,823][123090] Updated weights for policy 1, policy_version 675284 (0.0010) [2023-12-26 05:00:57,878][123090] Updated weights for policy 1, policy_version 675294 (0.0010) [2023-12-26 05:00:58,117][123091] Updated weights for policy 0, policy_version 679862 (0.0006) [2023-12-26 05:00:58,188][123091] Updated weights for policy 0, policy_version 679872 (0.0005) [2023-12-26 05:00:58,254][123091] Updated weights for policy 0, policy_version 679882 (0.0008) [2023-12-26 05:00:58,675][123090] Updated weights for policy 1, policy_version 675304 (0.0010) [2023-12-26 05:00:58,746][123090] Updated weights for policy 1, policy_version 675314 (0.0008) [2023-12-26 05:00:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 346931200. Throughput: 0: 8927.4, 1: 9028.6. Samples: 346929068. Policy #0 lag: (min: 6.0, avg: 19.2, max: 38.0) [2023-12-26 05:00:58,785][121949] Avg episode reward: [(0, '6155.696'), (1, '5361.574')] [2023-12-26 05:00:58,818][123090] Updated weights for policy 1, policy_version 675324 (0.0012) [2023-12-26 05:00:59,159][123091] Updated weights for policy 0, policy_version 679892 (0.0010) [2023-12-26 05:00:59,225][123091] Updated weights for policy 0, policy_version 679902 (0.0009) [2023-12-26 05:00:59,298][123091] Updated weights for policy 0, policy_version 679912 (0.0009) [2023-12-26 05:00:59,738][123090] Updated weights for policy 1, policy_version 675334 (0.0010) [2023-12-26 05:00:59,805][123090] Updated weights for policy 1, policy_version 675344 (0.0008) [2023-12-26 05:00:59,873][123090] Updated weights for policy 1, policy_version 675354 (0.0010) [2023-12-26 05:01:00,106][123091] Updated weights for policy 0, policy_version 679922 (0.0010) [2023-12-26 05:01:00,163][123091] Updated weights for policy 0, policy_version 679932 (0.0008) [2023-12-26 05:01:00,222][123091] Updated weights for policy 0, policy_version 679942 (0.0008) [2023-12-26 05:01:00,287][123091] Updated weights for policy 0, policy_version 679952 (0.0010) [2023-12-26 05:01:00,733][123090] Updated weights for policy 1, policy_version 675364 (0.0010) [2023-12-26 05:01:00,788][123090] Updated weights for policy 1, policy_version 675374 (0.0008) [2023-12-26 05:01:00,855][123090] Updated weights for policy 1, policy_version 675384 (0.0005) [2023-12-26 05:01:01,073][123091] Updated weights for policy 0, policy_version 679962 (0.0008) [2023-12-26 05:01:01,140][123091] Updated weights for policy 0, policy_version 679972 (0.0008) [2023-12-26 05:01:01,208][123091] Updated weights for policy 0, policy_version 679982 (0.0010) [2023-12-26 05:01:01,543][123090] Updated weights for policy 1, policy_version 675394 (0.0005) [2023-12-26 05:01:01,609][123090] Updated weights for policy 1, policy_version 675404 (0.0005) [2023-12-26 05:01:01,675][123090] Updated weights for policy 1, policy_version 675414 (0.0010) [2023-12-26 05:01:01,743][123090] Updated weights for policy 1, policy_version 675424 (0.0011) [2023-12-26 05:01:01,971][123091] Updated weights for policy 0, policy_version 679992 (0.0009) [2023-12-26 05:01:02,034][123091] Updated weights for policy 0, policy_version 680002 (0.0009) [2023-12-26 05:01:02,088][123091] Updated weights for policy 0, policy_version 680012 (0.0009) [2023-12-26 05:01:02,547][123090] Updated weights for policy 1, policy_version 675434 (0.0006) [2023-12-26 05:01:02,614][123090] Updated weights for policy 1, policy_version 675444 (0.0006) [2023-12-26 05:01:02,667][123090] Updated weights for policy 1, policy_version 675454 (0.0010) [2023-12-26 05:01:02,868][123091] Updated weights for policy 0, policy_version 680022 (0.0008) [2023-12-26 05:01:02,937][123091] Updated weights for policy 0, policy_version 680032 (0.0009) [2023-12-26 05:01:03,001][123091] Updated weights for policy 0, policy_version 680042 (0.0006) [2023-12-26 05:01:03,405][123090] Updated weights for policy 1, policy_version 675464 (0.0010) [2023-12-26 05:01:03,465][123090] Updated weights for policy 1, policy_version 675474 (0.0010) [2023-12-26 05:01:03,536][123090] Updated weights for policy 1, policy_version 675484 (0.0008) [2023-12-26 05:01:03,727][123091] Updated weights for policy 0, policy_version 680052 (0.0007) [2023-12-26 05:01:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 347021312. Throughput: 0: 8884.9, 1: 9055.8. Samples: 347034360. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:03,785][121949] Avg episode reward: [(0, '6212.315'), (1, '5539.570')] [2023-12-26 05:01:03,791][123091] Updated weights for policy 0, policy_version 680062 (0.0010) [2023-12-26 05:01:03,853][123091] Updated weights for policy 0, policy_version 680072 (0.0009) [2023-12-26 05:01:04,304][123090] Updated weights for policy 1, policy_version 675494 (0.0006) [2023-12-26 05:01:04,375][123090] Updated weights for policy 1, policy_version 675504 (0.0011) [2023-12-26 05:01:04,443][123090] Updated weights for policy 1, policy_version 675514 (0.0010) [2023-12-26 05:01:04,754][123091] Updated weights for policy 0, policy_version 680082 (0.0010) [2023-12-26 05:01:04,804][123091] Updated weights for policy 0, policy_version 680092 (0.0009) [2023-12-26 05:01:04,853][123091] Updated weights for policy 0, policy_version 680102 (0.0009) [2023-12-26 05:01:04,901][123091] Updated weights for policy 0, policy_version 680112 (0.0008) [2023-12-26 05:01:05,172][123090] Updated weights for policy 1, policy_version 675524 (0.0008) [2023-12-26 05:01:05,243][123090] Updated weights for policy 1, policy_version 675534 (0.0005) [2023-12-26 05:01:05,321][123090] Updated weights for policy 1, policy_version 675544 (0.0005) [2023-12-26 05:01:05,836][123091] Updated weights for policy 0, policy_version 680122 (0.0010) [2023-12-26 05:01:05,893][123091] Updated weights for policy 0, policy_version 680132 (0.0009) [2023-12-26 05:01:05,942][123091] Updated weights for policy 0, policy_version 680142 (0.0009) [2023-12-26 05:01:05,993][123090] Updated weights for policy 1, policy_version 675554 (0.0006) [2023-12-26 05:01:06,054][123090] Updated weights for policy 1, policy_version 675564 (0.0010) [2023-12-26 05:01:06,128][123090] Updated weights for policy 1, policy_version 675574 (0.0009) [2023-12-26 05:01:06,197][123090] Updated weights for policy 1, policy_version 675584 (0.0010) [2023-12-26 05:01:06,887][123091] Updated weights for policy 0, policy_version 680152 (0.0009) [2023-12-26 05:01:06,955][123091] Updated weights for policy 0, policy_version 680162 (0.0009) [2023-12-26 05:01:07,020][123091] Updated weights for policy 0, policy_version 680172 (0.0008) [2023-12-26 05:01:07,025][123090] Updated weights for policy 1, policy_version 675594 (0.0009) [2023-12-26 05:01:07,096][123090] Updated weights for policy 1, policy_version 675604 (0.0009) [2023-12-26 05:01:07,163][123090] Updated weights for policy 1, policy_version 675614 (0.0009) [2023-12-26 05:01:07,856][123091] Updated weights for policy 0, policy_version 680182 (0.0009) [2023-12-26 05:01:07,910][123091] Updated weights for policy 0, policy_version 680192 (0.0010) [2023-12-26 05:01:07,958][123090] Updated weights for policy 1, policy_version 675624 (0.0006) [2023-12-26 05:01:07,973][123091] Updated weights for policy 0, policy_version 680202 (0.0010) [2023-12-26 05:01:08,011][123090] Updated weights for policy 1, policy_version 675634 (0.0007) [2023-12-26 05:01:08,080][123090] Updated weights for policy 1, policy_version 675644 (0.0008) [2023-12-26 05:01:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 347103232. Throughput: 0: 8811.1, 1: 9123.0. Samples: 347085684. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:08,785][121949] Avg episode reward: [(0, '6052.422'), (1, '5609.850')] [2023-12-26 05:01:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000680208_174137344.pth... [2023-12-26 05:01:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000675648_172965888.pth... [2023-12-26 05:01:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000679216_173883392.pth [2023-12-26 05:01:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000674592_172695552.pth [2023-12-26 05:01:08,858][123090] Updated weights for policy 1, policy_version 675654 (0.0008) [2023-12-26 05:01:08,870][123091] Updated weights for policy 0, policy_version 680212 (0.0009) [2023-12-26 05:01:08,928][123090] Updated weights for policy 1, policy_version 675664 (0.0007) [2023-12-26 05:01:08,937][123091] Updated weights for policy 0, policy_version 680222 (0.0008) [2023-12-26 05:01:08,999][123090] Updated weights for policy 1, policy_version 675674 (0.0006) [2023-12-26 05:01:09,005][123091] Updated weights for policy 0, policy_version 680232 (0.0008) [2023-12-26 05:01:09,795][123090] Updated weights for policy 1, policy_version 675684 (0.0008) [2023-12-26 05:01:09,819][123091] Updated weights for policy 0, policy_version 680242 (0.0007) [2023-12-26 05:01:09,868][123090] Updated weights for policy 1, policy_version 675694 (0.0008) [2023-12-26 05:01:09,893][123091] Updated weights for policy 0, policy_version 680253 (0.0011) [2023-12-26 05:01:09,935][123090] Updated weights for policy 1, policy_version 675704 (0.0008) [2023-12-26 05:01:09,962][123091] Updated weights for policy 0, policy_version 680263 (0.0011) [2023-12-26 05:01:10,751][123091] Updated weights for policy 0, policy_version 680273 (0.0011) [2023-12-26 05:01:10,806][123090] Updated weights for policy 1, policy_version 675714 (0.0007) [2023-12-26 05:01:10,821][123091] Updated weights for policy 0, policy_version 680283 (0.0008) [2023-12-26 05:01:10,866][123090] Updated weights for policy 1, policy_version 675724 (0.0009) [2023-12-26 05:01:10,885][123091] Updated weights for policy 0, policy_version 680293 (0.0008) [2023-12-26 05:01:10,935][123090] Updated weights for policy 1, policy_version 675734 (0.0008) [2023-12-26 05:01:10,962][123091] Updated weights for policy 0, policy_version 680303 (0.0006) [2023-12-26 05:01:11,006][123090] Updated weights for policy 1, policy_version 675744 (0.0009) [2023-12-26 05:01:11,761][123091] Updated weights for policy 0, policy_version 680313 (0.0009) [2023-12-26 05:01:11,821][123091] Updated weights for policy 0, policy_version 680323 (0.0008) [2023-12-26 05:01:11,896][123091] Updated weights for policy 0, policy_version 680333 (0.0008) [2023-12-26 05:01:11,961][123090] Updated weights for policy 1, policy_version 675754 (0.0010) [2023-12-26 05:01:12,032][123090] Updated weights for policy 1, policy_version 675764 (0.0010) [2023-12-26 05:01:12,117][123090] Updated weights for policy 1, policy_version 675774 (0.0011) [2023-12-26 05:01:12,713][123091] Updated weights for policy 0, policy_version 680343 (0.0006) [2023-12-26 05:01:12,782][123091] Updated weights for policy 0, policy_version 680353 (0.0006) [2023-12-26 05:01:12,838][123091] Updated weights for policy 0, policy_version 680363 (0.0011) [2023-12-26 05:01:12,959][123090] Updated weights for policy 1, policy_version 675784 (0.0009) [2023-12-26 05:01:13,020][123090] Updated weights for policy 1, policy_version 675794 (0.0005) [2023-12-26 05:01:13,080][123090] Updated weights for policy 1, policy_version 675804 (0.0008) [2023-12-26 05:01:13,626][123091] Updated weights for policy 0, policy_version 680373 (0.0008) [2023-12-26 05:01:13,679][123091] Updated weights for policy 0, policy_version 680383 (0.0009) [2023-12-26 05:01:13,734][123091] Updated weights for policy 0, policy_version 680394 (0.0010) [2023-12-26 05:01:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 347193344. Throughput: 0: 8742.0, 1: 8975.0. Samples: 347185952. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:13,785][121949] Avg episode reward: [(0, '5946.114'), (1, '5681.647')] [2023-12-26 05:01:13,798][123090] Updated weights for policy 1, policy_version 675814 (0.0006) [2023-12-26 05:01:13,869][123090] Updated weights for policy 1, policy_version 675824 (0.0008) [2023-12-26 05:01:13,935][123090] Updated weights for policy 1, policy_version 675834 (0.0010) [2023-12-26 05:01:14,534][123091] Updated weights for policy 0, policy_version 680404 (0.0009) [2023-12-26 05:01:14,594][123091] Updated weights for policy 0, policy_version 680414 (0.0009) [2023-12-26 05:01:14,646][123091] Updated weights for policy 0, policy_version 680424 (0.0009) [2023-12-26 05:01:14,748][123090] Updated weights for policy 1, policy_version 675844 (0.0009) [2023-12-26 05:01:14,822][123090] Updated weights for policy 1, policy_version 675854 (0.0010) [2023-12-26 05:01:14,883][123090] Updated weights for policy 1, policy_version 675864 (0.0010) [2023-12-26 05:01:15,475][123091] Updated weights for policy 0, policy_version 680434 (0.0009) [2023-12-26 05:01:15,538][123091] Updated weights for policy 0, policy_version 680444 (0.0008) [2023-12-26 05:01:15,600][123091] Updated weights for policy 0, policy_version 680454 (0.0009) [2023-12-26 05:01:15,662][123091] Updated weights for policy 0, policy_version 680464 (0.0010) [2023-12-26 05:01:15,784][123090] Updated weights for policy 1, policy_version 675874 (0.0008) [2023-12-26 05:01:15,841][123090] Updated weights for policy 1, policy_version 675884 (0.0005) [2023-12-26 05:01:15,894][123090] Updated weights for policy 1, policy_version 675894 (0.0005) [2023-12-26 05:01:15,949][123090] Updated weights for policy 1, policy_version 675904 (0.0005) [2023-12-26 05:01:16,519][123091] Updated weights for policy 0, policy_version 680474 (0.0007) [2023-12-26 05:01:16,579][123091] Updated weights for policy 0, policy_version 680484 (0.0008) [2023-12-26 05:01:16,628][123091] Updated weights for policy 0, policy_version 680494 (0.0009) [2023-12-26 05:01:16,667][123090] Updated weights for policy 1, policy_version 675914 (0.0009) [2023-12-26 05:01:16,722][123090] Updated weights for policy 1, policy_version 675925 (0.0009) [2023-12-26 05:01:16,770][123090] Updated weights for policy 1, policy_version 675935 (0.0009) [2023-12-26 05:01:17,410][123091] Updated weights for policy 0, policy_version 680504 (0.0009) [2023-12-26 05:01:17,457][123091] Updated weights for policy 0, policy_version 680514 (0.0009) [2023-12-26 05:01:17,505][123091] Updated weights for policy 0, policy_version 680524 (0.0009) [2023-12-26 05:01:17,616][123090] Updated weights for policy 1, policy_version 675945 (0.0009) [2023-12-26 05:01:17,665][123090] Updated weights for policy 1, policy_version 675955 (0.0009) [2023-12-26 05:01:17,716][123090] Updated weights for policy 1, policy_version 675965 (0.0009) [2023-12-26 05:01:18,329][123091] Updated weights for policy 0, policy_version 680534 (0.0008) [2023-12-26 05:01:18,396][123091] Updated weights for policy 0, policy_version 680544 (0.0008) [2023-12-26 05:01:18,447][123091] Updated weights for policy 0, policy_version 680554 (0.0008) [2023-12-26 05:01:18,575][123090] Updated weights for policy 1, policy_version 675975 (0.0007) [2023-12-26 05:01:18,644][123090] Updated weights for policy 1, policy_version 675985 (0.0005) [2023-12-26 05:01:18,709][123090] Updated weights for policy 1, policy_version 675995 (0.0005) [2023-12-26 05:01:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 347283456. Throughput: 0: 8701.5, 1: 8970.7. Samples: 347290724. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:18,785][121949] Avg episode reward: [(0, '5995.544'), (1, '5674.514')] [2023-12-26 05:01:19,254][123091] Updated weights for policy 0, policy_version 680564 (0.0008) [2023-12-26 05:01:19,323][123091] Updated weights for policy 0, policy_version 680574 (0.0009) [2023-12-26 05:01:19,388][123091] Updated weights for policy 0, policy_version 680584 (0.0009) [2023-12-26 05:01:19,500][123090] Updated weights for policy 1, policy_version 676005 (0.0009) [2023-12-26 05:01:19,567][123090] Updated weights for policy 1, policy_version 676015 (0.0010) [2023-12-26 05:01:19,624][123090] Updated weights for policy 1, policy_version 676025 (0.0010) [2023-12-26 05:01:20,223][123091] Updated weights for policy 0, policy_version 680594 (0.0009) [2023-12-26 05:01:20,285][123091] Updated weights for policy 0, policy_version 680604 (0.0010) [2023-12-26 05:01:20,344][123091] Updated weights for policy 0, policy_version 680614 (0.0009) [2023-12-26 05:01:20,410][123091] Updated weights for policy 0, policy_version 680624 (0.0010) [2023-12-26 05:01:20,455][123090] Updated weights for policy 1, policy_version 676035 (0.0008) [2023-12-26 05:01:20,525][123090] Updated weights for policy 1, policy_version 676045 (0.0005) [2023-12-26 05:01:20,591][123090] Updated weights for policy 1, policy_version 676055 (0.0006) [2023-12-26 05:01:21,326][123091] Updated weights for policy 0, policy_version 680634 (0.0007) [2023-12-26 05:01:21,390][123090] Updated weights for policy 1, policy_version 676065 (0.0010) [2023-12-26 05:01:21,398][123091] Updated weights for policy 0, policy_version 680644 (0.0008) [2023-12-26 05:01:21,452][123090] Updated weights for policy 1, policy_version 676075 (0.0011) [2023-12-26 05:01:21,459][123091] Updated weights for policy 0, policy_version 680654 (0.0006) [2023-12-26 05:01:21,500][123090] Updated weights for policy 1, policy_version 676085 (0.0010) [2023-12-26 05:01:21,548][123090] Updated weights for policy 1, policy_version 676095 (0.0010) [2023-12-26 05:01:22,261][123091] Updated weights for policy 0, policy_version 680664 (0.0008) [2023-12-26 05:01:22,322][123091] Updated weights for policy 0, policy_version 680674 (0.0009) [2023-12-26 05:01:22,391][123091] Updated weights for policy 0, policy_version 680684 (0.0009) [2023-12-26 05:01:22,411][123090] Updated weights for policy 1, policy_version 676105 (0.0009) [2023-12-26 05:01:22,479][123090] Updated weights for policy 1, policy_version 676115 (0.0008) [2023-12-26 05:01:22,543][123090] Updated weights for policy 1, policy_version 676125 (0.0008) [2023-12-26 05:01:23,229][123091] Updated weights for policy 0, policy_version 680694 (0.0009) [2023-12-26 05:01:23,296][123091] Updated weights for policy 0, policy_version 680704 (0.0011) [2023-12-26 05:01:23,354][123090] Updated weights for policy 1, policy_version 676135 (0.0007) [2023-12-26 05:01:23,355][123091] Updated weights for policy 0, policy_version 680714 (0.0011) [2023-12-26 05:01:23,418][123090] Updated weights for policy 1, policy_version 676145 (0.0007) [2023-12-26 05:01:23,488][123090] Updated weights for policy 1, policy_version 676155 (0.0005) [2023-12-26 05:01:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 347365376. Throughput: 0: 8651.3, 1: 8888.4. Samples: 347341208. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:23,785][121949] Avg episode reward: [(0, '6033.190'), (1, '5646.900')] [2023-12-26 05:01:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000680720_174268416.pth... [2023-12-26 05:01:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000676160_173096960.pth... [2023-12-26 05:01:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000675136_172834816.pth [2023-12-26 05:01:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000679728_174014464.pth [2023-12-26 05:01:24,161][123091] Updated weights for policy 0, policy_version 680724 (0.0010) [2023-12-26 05:01:24,218][123091] Updated weights for policy 0, policy_version 680734 (0.0009) [2023-12-26 05:01:24,275][123091] Updated weights for policy 0, policy_version 680744 (0.0010) [2023-12-26 05:01:24,285][123090] Updated weights for policy 1, policy_version 676165 (0.0007) [2023-12-26 05:01:24,344][123090] Updated weights for policy 1, policy_version 676175 (0.0007) [2023-12-26 05:01:24,394][123090] Updated weights for policy 1, policy_version 676185 (0.0009) [2023-12-26 05:01:25,003][123091] Updated weights for policy 0, policy_version 680754 (0.0008) [2023-12-26 05:01:25,066][123091] Updated weights for policy 0, policy_version 680764 (0.0005) [2023-12-26 05:01:25,122][123091] Updated weights for policy 0, policy_version 680774 (0.0007) [2023-12-26 05:01:25,169][123091] Updated weights for policy 0, policy_version 680784 (0.0010) [2023-12-26 05:01:25,316][123090] Updated weights for policy 1, policy_version 676195 (0.0010) [2023-12-26 05:01:25,366][123090] Updated weights for policy 1, policy_version 676205 (0.0009) [2023-12-26 05:01:25,424][123090] Updated weights for policy 1, policy_version 676215 (0.0009) [2023-12-26 05:01:25,937][123091] Updated weights for policy 0, policy_version 680794 (0.0009) [2023-12-26 05:01:25,985][123091] Updated weights for policy 0, policy_version 680804 (0.0008) [2023-12-26 05:01:26,039][123091] Updated weights for policy 0, policy_version 680814 (0.0005) [2023-12-26 05:01:26,215][123090] Updated weights for policy 1, policy_version 676225 (0.0009) [2023-12-26 05:01:26,287][123090] Updated weights for policy 1, policy_version 676235 (0.0005) [2023-12-26 05:01:26,348][123090] Updated weights for policy 1, policy_version 676245 (0.0010) [2023-12-26 05:01:26,407][123090] Updated weights for policy 1, policy_version 676255 (0.0005) [2023-12-26 05:01:26,867][123091] Updated weights for policy 0, policy_version 680824 (0.0008) [2023-12-26 05:01:26,923][123091] Updated weights for policy 0, policy_version 680834 (0.0010) [2023-12-26 05:01:26,984][123091] Updated weights for policy 0, policy_version 680845 (0.0010) [2023-12-26 05:01:27,048][123090] Updated weights for policy 1, policy_version 676265 (0.0005) [2023-12-26 05:01:27,100][123090] Updated weights for policy 1, policy_version 676275 (0.0005) [2023-12-26 05:01:27,150][123090] Updated weights for policy 1, policy_version 676285 (0.0005) [2023-12-26 05:01:27,817][123091] Updated weights for policy 0, policy_version 680855 (0.0009) [2023-12-26 05:01:27,873][123091] Updated weights for policy 0, policy_version 680865 (0.0006) [2023-12-26 05:01:27,881][123090] Updated weights for policy 1, policy_version 676295 (0.0008) [2023-12-26 05:01:27,923][123091] Updated weights for policy 0, policy_version 680875 (0.0009) [2023-12-26 05:01:27,949][123090] Updated weights for policy 1, policy_version 676305 (0.0007) [2023-12-26 05:01:28,008][123090] Updated weights for policy 1, policy_version 676315 (0.0009) [2023-12-26 05:01:28,707][123091] Updated weights for policy 0, policy_version 680885 (0.0010) [2023-12-26 05:01:28,760][123091] Updated weights for policy 0, policy_version 680895 (0.0009) [2023-12-26 05:01:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 347447296. Throughput: 0: 8699.6, 1: 8884.4. Samples: 347448336. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:28,784][121949] Avg episode reward: [(0, '5945.650'), (1, '5664.876')] [2023-12-26 05:01:28,812][123091] Updated weights for policy 0, policy_version 680906 (0.0010) [2023-12-26 05:01:28,839][123090] Updated weights for policy 1, policy_version 676325 (0.0008) [2023-12-26 05:01:28,900][123090] Updated weights for policy 1, policy_version 676335 (0.0007) [2023-12-26 05:01:28,964][123090] Updated weights for policy 1, policy_version 676345 (0.0007) [2023-12-26 05:01:29,671][123090] Updated weights for policy 1, policy_version 676355 (0.0006) [2023-12-26 05:01:29,729][123091] Updated weights for policy 0, policy_version 680916 (0.0007) [2023-12-26 05:01:29,730][123090] Updated weights for policy 1, policy_version 676365 (0.0010) [2023-12-26 05:01:29,785][123090] Updated weights for policy 1, policy_version 676375 (0.0010) [2023-12-26 05:01:29,792][123091] Updated weights for policy 0, policy_version 680926 (0.0005) [2023-12-26 05:01:29,862][123091] Updated weights for policy 0, policy_version 680936 (0.0007) [2023-12-26 05:01:30,568][123091] Updated weights for policy 0, policy_version 680946 (0.0008) [2023-12-26 05:01:30,616][123090] Updated weights for policy 1, policy_version 676385 (0.0011) [2023-12-26 05:01:30,631][123091] Updated weights for policy 0, policy_version 680956 (0.0005) [2023-12-26 05:01:30,664][123090] Updated weights for policy 1, policy_version 676395 (0.0011) [2023-12-26 05:01:30,680][123091] Updated weights for policy 0, policy_version 680966 (0.0005) [2023-12-26 05:01:30,712][123090] Updated weights for policy 1, policy_version 676405 (0.0010) [2023-12-26 05:01:30,730][123091] Updated weights for policy 0, policy_version 680976 (0.0005) [2023-12-26 05:01:30,761][123090] Updated weights for policy 1, policy_version 676415 (0.0010) [2023-12-26 05:01:31,550][123091] Updated weights for policy 0, policy_version 680986 (0.0010) [2023-12-26 05:01:31,569][123090] Updated weights for policy 1, policy_version 676425 (0.0008) [2023-12-26 05:01:31,615][123091] Updated weights for policy 0, policy_version 680996 (0.0008) [2023-12-26 05:01:31,627][123090] Updated weights for policy 1, policy_version 676435 (0.0006) [2023-12-26 05:01:31,682][123091] Updated weights for policy 0, policy_version 681006 (0.0010) [2023-12-26 05:01:31,699][123090] Updated weights for policy 1, policy_version 676445 (0.0006) [2023-12-26 05:01:32,409][123090] Updated weights for policy 1, policy_version 676455 (0.0010) [2023-12-26 05:01:32,468][123090] Updated weights for policy 1, policy_version 676465 (0.0010) [2023-12-26 05:01:32,534][123090] Updated weights for policy 1, policy_version 676475 (0.0010) [2023-12-26 05:01:32,550][123091] Updated weights for policy 0, policy_version 681016 (0.0006) [2023-12-26 05:01:32,608][123091] Updated weights for policy 0, policy_version 681026 (0.0008) [2023-12-26 05:01:32,667][123091] Updated weights for policy 0, policy_version 681036 (0.0009) [2023-12-26 05:01:33,338][123090] Updated weights for policy 1, policy_version 676485 (0.0010) [2023-12-26 05:01:33,407][123090] Updated weights for policy 1, policy_version 676495 (0.0010) [2023-12-26 05:01:33,472][123090] Updated weights for policy 1, policy_version 676505 (0.0006) [2023-12-26 05:01:33,497][123091] Updated weights for policy 0, policy_version 681046 (0.0007) [2023-12-26 05:01:33,550][123091] Updated weights for policy 0, policy_version 681056 (0.0008) [2023-12-26 05:01:33,597][123091] Updated weights for policy 0, policy_version 681066 (0.0009) [2023-12-26 05:01:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 347545600. Throughput: 0: 8669.5, 1: 8804.5. Samples: 347553660. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:33,785][121949] Avg episode reward: [(0, '6073.101'), (1, '5793.817')] [2023-12-26 05:01:34,170][123090] Updated weights for policy 1, policy_version 676515 (0.0010) [2023-12-26 05:01:34,236][123090] Updated weights for policy 1, policy_version 676525 (0.0006) [2023-12-26 05:01:34,285][123091] Updated weights for policy 0, policy_version 681077 (0.0008) [2023-12-26 05:01:34,303][123090] Updated weights for policy 1, policy_version 676535 (0.0005) [2023-12-26 05:01:34,345][123091] Updated weights for policy 0, policy_version 681087 (0.0009) [2023-12-26 05:01:34,410][123091] Updated weights for policy 0, policy_version 681097 (0.0009) [2023-12-26 05:01:35,041][123090] Updated weights for policy 1, policy_version 676545 (0.0007) [2023-12-26 05:01:35,107][123090] Updated weights for policy 1, policy_version 676555 (0.0008) [2023-12-26 05:01:35,174][123090] Updated weights for policy 1, policy_version 676565 (0.0005) [2023-12-26 05:01:35,226][123090] Updated weights for policy 1, policy_version 676575 (0.0005) [2023-12-26 05:01:35,289][123091] Updated weights for policy 0, policy_version 681107 (0.0010) [2023-12-26 05:01:35,344][123091] Updated weights for policy 0, policy_version 681117 (0.0010) [2023-12-26 05:01:35,396][123091] Updated weights for policy 0, policy_version 681128 (0.0009) [2023-12-26 05:01:35,843][123090] Updated weights for policy 1, policy_version 676585 (0.0005) [2023-12-26 05:01:35,909][123090] Updated weights for policy 1, policy_version 676595 (0.0008) [2023-12-26 05:01:35,974][123090] Updated weights for policy 1, policy_version 676605 (0.0009) [2023-12-26 05:01:36,334][123091] Updated weights for policy 0, policy_version 681138 (0.0010) [2023-12-26 05:01:36,393][123091] Updated weights for policy 0, policy_version 681148 (0.0010) [2023-12-26 05:01:36,455][123091] Updated weights for policy 0, policy_version 681158 (0.0010) [2023-12-26 05:01:36,512][123091] Updated weights for policy 0, policy_version 681168 (0.0009) [2023-12-26 05:01:36,647][123090] Updated weights for policy 1, policy_version 676615 (0.0009) [2023-12-26 05:01:36,715][123090] Updated weights for policy 1, policy_version 676625 (0.0008) [2023-12-26 05:01:36,782][123090] Updated weights for policy 1, policy_version 676635 (0.0007) [2023-12-26 05:01:37,418][123091] Updated weights for policy 0, policy_version 681178 (0.0009) [2023-12-26 05:01:37,483][123091] Updated weights for policy 0, policy_version 681188 (0.0009) [2023-12-26 05:01:37,498][123090] Updated weights for policy 1, policy_version 676645 (0.0009) [2023-12-26 05:01:37,544][123091] Updated weights for policy 0, policy_version 681198 (0.0006) [2023-12-26 05:01:37,559][123090] Updated weights for policy 1, policy_version 676655 (0.0010) [2023-12-26 05:01:37,623][123090] Updated weights for policy 1, policy_version 676665 (0.0010) [2023-12-26 05:01:38,421][123091] Updated weights for policy 0, policy_version 681208 (0.0009) [2023-12-26 05:01:38,437][123090] Updated weights for policy 1, policy_version 676675 (0.0011) [2023-12-26 05:01:38,485][123091] Updated weights for policy 0, policy_version 681218 (0.0008) [2023-12-26 05:01:38,495][123090] Updated weights for policy 1, policy_version 676685 (0.0009) [2023-12-26 05:01:38,534][123091] Updated weights for policy 0, policy_version 681228 (0.0006) [2023-12-26 05:01:38,543][123090] Updated weights for policy 1, policy_version 676695 (0.0010) [2023-12-26 05:01:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 347635712. Throughput: 0: 8678.8, 1: 8888.5. Samples: 347608848. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:38,785][121949] Avg episode reward: [(0, '6180.758'), (1, '5844.594')] [2023-12-26 05:01:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000676704_173236224.pth... [2023-12-26 05:01:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000681232_174399488.pth... [2023-12-26 05:01:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000675648_172965888.pth [2023-12-26 05:01:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000680208_174137344.pth [2023-12-26 05:01:39,387][123091] Updated weights for policy 0, policy_version 681238 (0.0007) [2023-12-26 05:01:39,425][123090] Updated weights for policy 1, policy_version 676705 (0.0010) [2023-12-26 05:01:39,459][123091] Updated weights for policy 0, policy_version 681248 (0.0007) [2023-12-26 05:01:39,500][123090] Updated weights for policy 1, policy_version 676715 (0.0009) [2023-12-26 05:01:39,525][123091] Updated weights for policy 0, policy_version 681258 (0.0008) [2023-12-26 05:01:39,571][123090] Updated weights for policy 1, policy_version 676725 (0.0008) [2023-12-26 05:01:39,633][123090] Updated weights for policy 1, policy_version 676735 (0.0009) [2023-12-26 05:01:40,384][123091] Updated weights for policy 0, policy_version 681268 (0.0009) [2023-12-26 05:01:40,439][123091] Updated weights for policy 0, policy_version 681279 (0.0011) [2023-12-26 05:01:40,454][123090] Updated weights for policy 1, policy_version 676745 (0.0005) [2023-12-26 05:01:40,502][123091] Updated weights for policy 0, policy_version 681289 (0.0010) [2023-12-26 05:01:40,510][123090] Updated weights for policy 1, policy_version 676755 (0.0006) [2023-12-26 05:01:40,566][123090] Updated weights for policy 1, policy_version 676765 (0.0006) [2023-12-26 05:01:41,189][123090] Updated weights for policy 1, policy_version 676775 (0.0008) [2023-12-26 05:01:41,250][123090] Updated weights for policy 1, policy_version 676785 (0.0010) [2023-12-26 05:01:41,313][123090] Updated weights for policy 1, policy_version 676795 (0.0008) [2023-12-26 05:01:41,344][123091] Updated weights for policy 0, policy_version 681299 (0.0009) [2023-12-26 05:01:41,415][123091] Updated weights for policy 0, policy_version 681309 (0.0013) [2023-12-26 05:01:41,472][123091] Updated weights for policy 0, policy_version 681319 (0.0010) [2023-12-26 05:01:42,105][123090] Updated weights for policy 1, policy_version 676805 (0.0008) [2023-12-26 05:01:42,163][123090] Updated weights for policy 1, policy_version 676815 (0.0008) [2023-12-26 05:01:42,236][123090] Updated weights for policy 1, policy_version 676825 (0.0006) [2023-12-26 05:01:42,320][123091] Updated weights for policy 0, policy_version 681329 (0.0011) [2023-12-26 05:01:42,384][123091] Updated weights for policy 0, policy_version 681339 (0.0011) [2023-12-26 05:01:42,456][123091] Updated weights for policy 0, policy_version 681349 (0.0007) [2023-12-26 05:01:42,520][123091] Updated weights for policy 0, policy_version 681359 (0.0006) [2023-12-26 05:01:43,064][123090] Updated weights for policy 1, policy_version 676835 (0.0009) [2023-12-26 05:01:43,130][123090] Updated weights for policy 1, policy_version 676845 (0.0008) [2023-12-26 05:01:43,153][123091] Updated weights for policy 0, policy_version 681369 (0.0005) [2023-12-26 05:01:43,218][123091] Updated weights for policy 0, policy_version 681379 (0.0005) [2023-12-26 05:01:43,228][123090] Updated weights for policy 1, policy_version 676855 (0.0005) [2023-12-26 05:01:43,287][123091] Updated weights for policy 0, policy_version 681389 (0.0009) [2023-12-26 05:01:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 347717632. Throughput: 0: 8547.1, 1: 8853.7. Samples: 347712104. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:43,784][121949] Avg episode reward: [(0, '6211.373'), (1, '5610.970')] [2023-12-26 05:01:43,918][123090] Updated weights for policy 1, policy_version 676865 (0.0005) [2023-12-26 05:01:43,948][123091] Updated weights for policy 0, policy_version 681399 (0.0005) [2023-12-26 05:01:43,976][123090] Updated weights for policy 1, policy_version 676875 (0.0005) [2023-12-26 05:01:44,010][123091] Updated weights for policy 0, policy_version 681409 (0.0005) [2023-12-26 05:01:44,030][123090] Updated weights for policy 1, policy_version 676885 (0.0005) [2023-12-26 05:01:44,072][123091] Updated weights for policy 0, policy_version 681419 (0.0006) [2023-12-26 05:01:44,085][123090] Updated weights for policy 1, policy_version 676895 (0.0005) [2023-12-26 05:01:44,852][123090] Updated weights for policy 1, policy_version 676905 (0.0010) [2023-12-26 05:01:44,859][123091] Updated weights for policy 0, policy_version 681429 (0.0008) [2023-12-26 05:01:44,919][123090] Updated weights for policy 1, policy_version 676915 (0.0009) [2023-12-26 05:01:44,929][123091] Updated weights for policy 0, policy_version 681439 (0.0006) [2023-12-26 05:01:44,988][123090] Updated weights for policy 1, policy_version 676925 (0.0010) [2023-12-26 05:01:44,997][123091] Updated weights for policy 0, policy_version 681449 (0.0006) [2023-12-26 05:01:45,799][123091] Updated weights for policy 0, policy_version 681459 (0.0009) [2023-12-26 05:01:45,803][123090] Updated weights for policy 1, policy_version 676935 (0.0011) [2023-12-26 05:01:45,856][123091] Updated weights for policy 0, policy_version 681469 (0.0008) [2023-12-26 05:01:45,865][123090] Updated weights for policy 1, policy_version 676945 (0.0010) [2023-12-26 05:01:45,925][123091] Updated weights for policy 0, policy_version 681479 (0.0005) [2023-12-26 05:01:45,932][123090] Updated weights for policy 1, policy_version 676955 (0.0010) [2023-12-26 05:01:46,626][123091] Updated weights for policy 0, policy_version 681489 (0.0010) [2023-12-26 05:01:46,640][123090] Updated weights for policy 1, policy_version 676965 (0.0010) [2023-12-26 05:01:46,691][123091] Updated weights for policy 0, policy_version 681499 (0.0005) [2023-12-26 05:01:46,707][123090] Updated weights for policy 1, policy_version 676975 (0.0010) [2023-12-26 05:01:46,750][123091] Updated weights for policy 0, policy_version 681509 (0.0007) [2023-12-26 05:01:46,770][123090] Updated weights for policy 1, policy_version 676985 (0.0007) [2023-12-26 05:01:46,805][123091] Updated weights for policy 0, policy_version 681519 (0.0011) [2023-12-26 05:01:47,479][123090] Updated weights for policy 1, policy_version 676995 (0.0007) [2023-12-26 05:01:47,528][123090] Updated weights for policy 1, policy_version 677005 (0.0007) [2023-12-26 05:01:47,540][123091] Updated weights for policy 0, policy_version 681529 (0.0006) [2023-12-26 05:01:47,582][123090] Updated weights for policy 1, policy_version 677015 (0.0008) [2023-12-26 05:01:47,599][123091] Updated weights for policy 0, policy_version 681539 (0.0011) [2023-12-26 05:01:47,654][123091] Updated weights for policy 0, policy_version 681549 (0.0011) [2023-12-26 05:01:48,235][123090] Updated weights for policy 1, policy_version 677025 (0.0005) [2023-12-26 05:01:48,297][123090] Updated weights for policy 1, policy_version 677035 (0.0005) [2023-12-26 05:01:48,367][123090] Updated weights for policy 1, policy_version 677045 (0.0007) [2023-12-26 05:01:48,435][123090] Updated weights for policy 1, policy_version 677055 (0.0008) [2023-12-26 05:01:48,445][123091] Updated weights for policy 0, policy_version 681559 (0.0008) [2023-12-26 05:01:48,512][123091] Updated weights for policy 0, policy_version 681569 (0.0011) [2023-12-26 05:01:48,569][123091] Updated weights for policy 0, policy_version 681579 (0.0011) [2023-12-26 05:01:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 347815936. Throughput: 0: 8612.2, 1: 8944.5. Samples: 347824412. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:48,784][121949] Avg episode reward: [(0, '6100.558'), (1, '5523.390')] [2023-12-26 05:01:49,263][123090] Updated weights for policy 1, policy_version 677065 (0.0007) [2023-12-26 05:01:49,297][123091] Updated weights for policy 0, policy_version 681589 (0.0008) [2023-12-26 05:01:49,325][123090] Updated weights for policy 1, policy_version 677075 (0.0009) [2023-12-26 05:01:49,360][123091] Updated weights for policy 0, policy_version 681599 (0.0009) [2023-12-26 05:01:49,392][123090] Updated weights for policy 1, policy_version 677085 (0.0008) [2023-12-26 05:01:49,426][123091] Updated weights for policy 0, policy_version 681609 (0.0008) [2023-12-26 05:01:50,195][123091] Updated weights for policy 0, policy_version 681619 (0.0008) [2023-12-26 05:01:50,237][123090] Updated weights for policy 1, policy_version 677095 (0.0010) [2023-12-26 05:01:50,271][123091] Updated weights for policy 0, policy_version 681629 (0.0006) [2023-12-26 05:01:50,305][123090] Updated weights for policy 1, policy_version 677105 (0.0011) [2023-12-26 05:01:50,337][123091] Updated weights for policy 0, policy_version 681639 (0.0006) [2023-12-26 05:01:50,368][123090] Updated weights for policy 1, policy_version 677115 (0.0011) [2023-12-26 05:01:51,075][123091] Updated weights for policy 0, policy_version 681649 (0.0007) [2023-12-26 05:01:51,135][123091] Updated weights for policy 0, policy_version 681659 (0.0011) [2023-12-26 05:01:51,205][123091] Updated weights for policy 0, policy_version 681669 (0.0006) [2023-12-26 05:01:51,218][123090] Updated weights for policy 1, policy_version 677125 (0.0010) [2023-12-26 05:01:51,266][123091] Updated weights for policy 0, policy_version 681679 (0.0008) [2023-12-26 05:01:51,286][123090] Updated weights for policy 1, policy_version 677135 (0.0010) [2023-12-26 05:01:51,357][123090] Updated weights for policy 1, policy_version 677145 (0.0010) [2023-12-26 05:01:52,091][123091] Updated weights for policy 0, policy_version 681689 (0.0011) [2023-12-26 05:01:52,154][123091] Updated weights for policy 0, policy_version 681699 (0.0011) [2023-12-26 05:01:52,217][123091] Updated weights for policy 0, policy_version 681709 (0.0011) [2023-12-26 05:01:52,232][123090] Updated weights for policy 1, policy_version 677155 (0.0009) [2023-12-26 05:01:52,301][123090] Updated weights for policy 1, policy_version 677165 (0.0009) [2023-12-26 05:01:52,358][123090] Updated weights for policy 1, policy_version 677175 (0.0009) [2023-12-26 05:01:52,960][123091] Updated weights for policy 0, policy_version 681719 (0.0008) [2023-12-26 05:01:53,011][123091] Updated weights for policy 0, policy_version 681729 (0.0009) [2023-12-26 05:01:53,059][123091] Updated weights for policy 0, policy_version 681739 (0.0009) [2023-12-26 05:01:53,176][123090] Updated weights for policy 1, policy_version 677185 (0.0007) [2023-12-26 05:01:53,236][123090] Updated weights for policy 1, policy_version 677195 (0.0009) [2023-12-26 05:01:53,287][123090] Updated weights for policy 1, policy_version 677205 (0.0008) [2023-12-26 05:01:53,335][123090] Updated weights for policy 1, policy_version 677215 (0.0008) [2023-12-26 05:01:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 347897856. Throughput: 0: 8705.0, 1: 8875.5. Samples: 347876808. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:53,785][121949] Avg episode reward: [(0, '5956.999'), (1, '5547.592')] [2023-12-26 05:01:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000681744_174530560.pth... [2023-12-26 05:01:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000677216_173367296.pth... [2023-12-26 05:01:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000680720_174268416.pth [2023-12-26 05:01:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000676160_173096960.pth [2023-12-26 05:01:53,877][123091] Updated weights for policy 0, policy_version 681749 (0.0009) [2023-12-26 05:01:53,932][123091] Updated weights for policy 0, policy_version 681759 (0.0009) [2023-12-26 05:01:53,983][123091] Updated weights for policy 0, policy_version 681769 (0.0009) [2023-12-26 05:01:54,185][123090] Updated weights for policy 1, policy_version 677225 (0.0010) [2023-12-26 05:01:54,243][123090] Updated weights for policy 1, policy_version 677235 (0.0009) [2023-12-26 05:01:54,296][123090] Updated weights for policy 1, policy_version 677245 (0.0009) [2023-12-26 05:01:54,730][123091] Updated weights for policy 0, policy_version 681779 (0.0009) [2023-12-26 05:01:54,777][123091] Updated weights for policy 0, policy_version 681789 (0.0005) [2023-12-26 05:01:54,831][123091] Updated weights for policy 0, policy_version 681799 (0.0005) [2023-12-26 05:01:55,070][123090] Updated weights for policy 1, policy_version 677255 (0.0008) [2023-12-26 05:01:55,132][123090] Updated weights for policy 1, policy_version 677265 (0.0008) [2023-12-26 05:01:55,206][123090] Updated weights for policy 1, policy_version 677275 (0.0009) [2023-12-26 05:01:55,576][123091] Updated weights for policy 0, policy_version 681809 (0.0006) [2023-12-26 05:01:55,637][123091] Updated weights for policy 0, policy_version 681819 (0.0010) [2023-12-26 05:01:55,694][123091] Updated weights for policy 0, policy_version 681829 (0.0009) [2023-12-26 05:01:55,762][123091] Updated weights for policy 0, policy_version 681839 (0.0008) [2023-12-26 05:01:55,923][123090] Updated weights for policy 1, policy_version 677285 (0.0007) [2023-12-26 05:01:55,971][123090] Updated weights for policy 1, policy_version 677295 (0.0005) [2023-12-26 05:01:56,022][123090] Updated weights for policy 1, policy_version 677305 (0.0005) [2023-12-26 05:01:56,491][123091] Updated weights for policy 0, policy_version 681849 (0.0010) [2023-12-26 05:01:56,538][123091] Updated weights for policy 0, policy_version 681859 (0.0010) [2023-12-26 05:01:56,590][123091] Updated weights for policy 0, policy_version 681869 (0.0010) [2023-12-26 05:01:56,848][123090] Updated weights for policy 1, policy_version 677315 (0.0007) [2023-12-26 05:01:56,895][123090] Updated weights for policy 1, policy_version 677325 (0.0008) [2023-12-26 05:01:56,944][123090] Updated weights for policy 1, policy_version 677335 (0.0009) [2023-12-26 05:01:57,417][123091] Updated weights for policy 0, policy_version 681879 (0.0010) [2023-12-26 05:01:57,463][123091] Updated weights for policy 0, policy_version 681889 (0.0010) [2023-12-26 05:01:57,510][123091] Updated weights for policy 0, policy_version 681899 (0.0010) [2023-12-26 05:01:57,775][123090] Updated weights for policy 1, policy_version 677345 (0.0008) [2023-12-26 05:01:57,834][123090] Updated weights for policy 1, policy_version 677355 (0.0008) [2023-12-26 05:01:57,882][123090] Updated weights for policy 1, policy_version 677365 (0.0009) [2023-12-26 05:01:57,930][123090] Updated weights for policy 1, policy_version 677375 (0.0009) [2023-12-26 05:01:58,369][123091] Updated weights for policy 0, policy_version 681909 (0.0009) [2023-12-26 05:01:58,440][123091] Updated weights for policy 0, policy_version 681920 (0.0010) [2023-12-26 05:01:58,507][123091] Updated weights for policy 0, policy_version 681930 (0.0008) [2023-12-26 05:01:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 347987968. Throughput: 0: 8779.6, 1: 8940.7. Samples: 347983368. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:01:58,785][121949] Avg episode reward: [(0, '5990.040'), (1, '5737.812')] [2023-12-26 05:01:58,889][123090] Updated weights for policy 1, policy_version 677385 (0.0010) [2023-12-26 05:01:58,957][123090] Updated weights for policy 1, policy_version 677395 (0.0010) [2023-12-26 05:01:59,019][123090] Updated weights for policy 1, policy_version 677405 (0.0009) [2023-12-26 05:01:59,330][123091] Updated weights for policy 0, policy_version 681940 (0.0009) [2023-12-26 05:01:59,399][123091] Updated weights for policy 0, policy_version 681950 (0.0009) [2023-12-26 05:01:59,454][123091] Updated weights for policy 0, policy_version 681960 (0.0005) [2023-12-26 05:01:59,926][123090] Updated weights for policy 1, policy_version 677415 (0.0010) [2023-12-26 05:01:59,994][123090] Updated weights for policy 1, policy_version 677425 (0.0008) [2023-12-26 05:02:00,066][123090] Updated weights for policy 1, policy_version 677435 (0.0009) [2023-12-26 05:02:00,183][123091] Updated weights for policy 0, policy_version 681970 (0.0006) [2023-12-26 05:02:00,247][123091] Updated weights for policy 0, policy_version 681980 (0.0010) [2023-12-26 05:02:00,327][123091] Updated weights for policy 0, policy_version 681990 (0.0010) [2023-12-26 05:02:00,381][123091] Updated weights for policy 0, policy_version 682000 (0.0010) [2023-12-26 05:02:00,899][123090] Updated weights for policy 1, policy_version 677445 (0.0008) [2023-12-26 05:02:00,955][123090] Updated weights for policy 1, policy_version 677455 (0.0010) [2023-12-26 05:02:01,016][123090] Updated weights for policy 1, policy_version 677465 (0.0009) [2023-12-26 05:02:01,082][123091] Updated weights for policy 0, policy_version 682010 (0.0008) [2023-12-26 05:02:01,155][123091] Updated weights for policy 0, policy_version 682020 (0.0010) [2023-12-26 05:02:01,215][123091] Updated weights for policy 0, policy_version 682030 (0.0010) [2023-12-26 05:02:01,793][123090] Updated weights for policy 1, policy_version 677475 (0.0008) [2023-12-26 05:02:01,861][123090] Updated weights for policy 1, policy_version 677485 (0.0006) [2023-12-26 05:02:01,924][123090] Updated weights for policy 1, policy_version 677495 (0.0006) [2023-12-26 05:02:02,114][123091] Updated weights for policy 0, policy_version 682040 (0.0010) [2023-12-26 05:02:02,179][123091] Updated weights for policy 0, policy_version 682050 (0.0009) [2023-12-26 05:02:02,235][123091] Updated weights for policy 0, policy_version 682060 (0.0009) [2023-12-26 05:02:02,642][123090] Updated weights for policy 1, policy_version 677505 (0.0006) [2023-12-26 05:02:02,711][123090] Updated weights for policy 1, policy_version 677515 (0.0006) [2023-12-26 05:02:02,772][123090] Updated weights for policy 1, policy_version 677525 (0.0006) [2023-12-26 05:02:02,845][123090] Updated weights for policy 1, policy_version 677535 (0.0007) [2023-12-26 05:02:02,968][123091] Updated weights for policy 0, policy_version 682070 (0.0007) [2023-12-26 05:02:03,022][123091] Updated weights for policy 0, policy_version 682080 (0.0006) [2023-12-26 05:02:03,072][123091] Updated weights for policy 0, policy_version 682090 (0.0009) [2023-12-26 05:02:03,635][123090] Updated weights for policy 1, policy_version 677545 (0.0009) [2023-12-26 05:02:03,688][123090] Updated weights for policy 1, policy_version 677555 (0.0010) [2023-12-26 05:02:03,740][123090] Updated weights for policy 1, policy_version 677565 (0.0009) [2023-12-26 05:02:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 348078080. Throughput: 0: 8799.3, 1: 8912.0. Samples: 348087736. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:03,785][121949] Avg episode reward: [(0, '6159.863'), (1, '5711.805')] [2023-12-26 05:02:03,861][123091] Updated weights for policy 0, policy_version 682100 (0.0009) [2023-12-26 05:02:03,925][123091] Updated weights for policy 0, policy_version 682110 (0.0010) [2023-12-26 05:02:03,982][123091] Updated weights for policy 0, policy_version 682120 (0.0010) [2023-12-26 05:02:04,502][123090] Updated weights for policy 1, policy_version 677575 (0.0010) [2023-12-26 05:02:04,572][123090] Updated weights for policy 1, policy_version 677585 (0.0009) [2023-12-26 05:02:04,640][123090] Updated weights for policy 1, policy_version 677595 (0.0010) [2023-12-26 05:02:04,817][123091] Updated weights for policy 0, policy_version 682130 (0.0010) [2023-12-26 05:02:04,864][123091] Updated weights for policy 0, policy_version 682140 (0.0010) [2023-12-26 05:02:04,908][123091] Updated weights for policy 0, policy_version 682150 (0.0010) [2023-12-26 05:02:04,956][123091] Updated weights for policy 0, policy_version 682160 (0.0010) [2023-12-26 05:02:05,510][123090] Updated weights for policy 1, policy_version 677605 (0.0008) [2023-12-26 05:02:05,563][123090] Updated weights for policy 1, policy_version 677615 (0.0010) [2023-12-26 05:02:05,616][123090] Updated weights for policy 1, policy_version 677625 (0.0010) [2023-12-26 05:02:05,683][123091] Updated weights for policy 0, policy_version 682170 (0.0006) [2023-12-26 05:02:05,755][123091] Updated weights for policy 0, policy_version 682180 (0.0006) [2023-12-26 05:02:05,822][123091] Updated weights for policy 0, policy_version 682190 (0.0007) [2023-12-26 05:02:06,465][123090] Updated weights for policy 1, policy_version 677635 (0.0007) [2023-12-26 05:02:06,535][123090] Updated weights for policy 1, policy_version 677645 (0.0005) [2023-12-26 05:02:06,542][123091] Updated weights for policy 0, policy_version 682200 (0.0011) [2023-12-26 05:02:06,599][123090] Updated weights for policy 1, policy_version 677655 (0.0007) [2023-12-26 05:02:06,609][123091] Updated weights for policy 0, policy_version 682210 (0.0011) [2023-12-26 05:02:06,666][123091] Updated weights for policy 0, policy_version 682220 (0.0011) [2023-12-26 05:02:07,429][123091] Updated weights for policy 0, policy_version 682230 (0.0007) [2023-12-26 05:02:07,443][123090] Updated weights for policy 1, policy_version 677665 (0.0006) [2023-12-26 05:02:07,492][123091] Updated weights for policy 0, policy_version 682240 (0.0005) [2023-12-26 05:02:07,501][123090] Updated weights for policy 1, policy_version 677675 (0.0007) [2023-12-26 05:02:07,559][123091] Updated weights for policy 0, policy_version 682250 (0.0005) [2023-12-26 05:02:07,566][123090] Updated weights for policy 1, policy_version 677685 (0.0005) [2023-12-26 05:02:07,621][123090] Updated weights for policy 1, policy_version 677695 (0.0005) [2023-12-26 05:02:08,221][123091] Updated weights for policy 0, policy_version 682260 (0.0005) [2023-12-26 05:02:08,277][123091] Updated weights for policy 0, policy_version 682270 (0.0006) [2023-12-26 05:02:08,311][123090] Updated weights for policy 1, policy_version 677705 (0.0006) [2023-12-26 05:02:08,333][123091] Updated weights for policy 0, policy_version 682280 (0.0007) [2023-12-26 05:02:08,379][123090] Updated weights for policy 1, policy_version 677715 (0.0008) [2023-12-26 05:02:08,441][123090] Updated weights for policy 1, policy_version 677725 (0.0009) [2023-12-26 05:02:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 348168192. Throughput: 0: 8856.3, 1: 8911.5. Samples: 348140756. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:08,785][121949] Avg episode reward: [(0, '6038.042'), (1, '5537.497')] [2023-12-26 05:02:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000682288_174669824.pth... [2023-12-26 05:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000677728_173498368.pth... [2023-12-26 05:02:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000681232_174399488.pth [2023-12-26 05:02:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000676704_173236224.pth [2023-12-26 05:02:09,193][123091] Updated weights for policy 0, policy_version 682290 (0.0008) [2023-12-26 05:02:09,241][123090] Updated weights for policy 1, policy_version 677735 (0.0010) [2023-12-26 05:02:09,266][123091] Updated weights for policy 0, policy_version 682300 (0.0008) [2023-12-26 05:02:09,310][123090] Updated weights for policy 1, policy_version 677745 (0.0011) [2023-12-26 05:02:09,342][123091] Updated weights for policy 0, policy_version 682310 (0.0009) [2023-12-26 05:02:09,378][123090] Updated weights for policy 1, policy_version 677755 (0.0010) [2023-12-26 05:02:09,412][123091] Updated weights for policy 0, policy_version 682320 (0.0007) [2023-12-26 05:02:10,192][123091] Updated weights for policy 0, policy_version 682330 (0.0006) [2023-12-26 05:02:10,193][123090] Updated weights for policy 1, policy_version 677765 (0.0010) [2023-12-26 05:02:10,242][123091] Updated weights for policy 0, policy_version 682340 (0.0006) [2023-12-26 05:02:10,248][123090] Updated weights for policy 1, policy_version 677775 (0.0009) [2023-12-26 05:02:10,292][123091] Updated weights for policy 0, policy_version 682350 (0.0006) [2023-12-26 05:02:10,305][123090] Updated weights for policy 1, policy_version 677785 (0.0010) [2023-12-26 05:02:11,062][123090] Updated weights for policy 1, policy_version 677795 (0.0010) [2023-12-26 05:02:11,127][123090] Updated weights for policy 1, policy_version 677805 (0.0009) [2023-12-26 05:02:11,195][123091] Updated weights for policy 0, policy_version 682360 (0.0009) [2023-12-26 05:02:11,199][123090] Updated weights for policy 1, policy_version 677815 (0.0007) [2023-12-26 05:02:11,257][123091] Updated weights for policy 0, policy_version 682370 (0.0009) [2023-12-26 05:02:11,326][123091] Updated weights for policy 0, policy_version 682381 (0.0008) [2023-12-26 05:02:12,011][123090] Updated weights for policy 1, policy_version 677825 (0.0006) [2023-12-26 05:02:12,080][123090] Updated weights for policy 1, policy_version 677835 (0.0009) [2023-12-26 05:02:12,152][123090] Updated weights for policy 1, policy_version 677845 (0.0010) [2023-12-26 05:02:12,218][123090] Updated weights for policy 1, policy_version 677855 (0.0006) [2023-12-26 05:02:12,227][123091] Updated weights for policy 0, policy_version 682391 (0.0009) [2023-12-26 05:02:12,298][123091] Updated weights for policy 0, policy_version 682401 (0.0009) [2023-12-26 05:02:12,364][123091] Updated weights for policy 0, policy_version 682411 (0.0009) [2023-12-26 05:02:12,863][123090] Updated weights for policy 1, policy_version 677865 (0.0005) [2023-12-26 05:02:12,938][123090] Updated weights for policy 1, policy_version 677875 (0.0005) [2023-12-26 05:02:13,001][123090] Updated weights for policy 1, policy_version 677885 (0.0005) [2023-12-26 05:02:13,253][123091] Updated weights for policy 0, policy_version 682421 (0.0010) [2023-12-26 05:02:13,318][123091] Updated weights for policy 0, policy_version 682431 (0.0009) [2023-12-26 05:02:13,390][123091] Updated weights for policy 0, policy_version 682441 (0.0011) [2023-12-26 05:02:13,588][123090] Updated weights for policy 1, policy_version 677895 (0.0005) [2023-12-26 05:02:13,649][123090] Updated weights for policy 1, policy_version 677905 (0.0005) [2023-12-26 05:02:13,709][123090] Updated weights for policy 1, policy_version 677915 (0.0007) [2023-12-26 05:02:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 348258304. Throughput: 0: 8818.7, 1: 8904.3. Samples: 348245868. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:13,785][121949] Avg episode reward: [(0, '5882.571'), (1, '5480.312')] [2023-12-26 05:02:14,273][123091] Updated weights for policy 0, policy_version 682451 (0.0009) [2023-12-26 05:02:14,336][123091] Updated weights for policy 0, policy_version 682461 (0.0010) [2023-12-26 05:02:14,398][123091] Updated weights for policy 0, policy_version 682471 (0.0010) [2023-12-26 05:02:14,441][123090] Updated weights for policy 1, policy_version 677925 (0.0009) [2023-12-26 05:02:14,503][123090] Updated weights for policy 1, policy_version 677935 (0.0009) [2023-12-26 05:02:14,562][123090] Updated weights for policy 1, policy_version 677945 (0.0009) [2023-12-26 05:02:15,263][123091] Updated weights for policy 0, policy_version 682481 (0.0009) [2023-12-26 05:02:15,331][123091] Updated weights for policy 0, policy_version 682491 (0.0009) [2023-12-26 05:02:15,349][123090] Updated weights for policy 1, policy_version 677955 (0.0006) [2023-12-26 05:02:15,394][123091] Updated weights for policy 0, policy_version 682501 (0.0007) [2023-12-26 05:02:15,415][123090] Updated weights for policy 1, policy_version 677965 (0.0008) [2023-12-26 05:02:15,461][123091] Updated weights for policy 0, policy_version 682511 (0.0007) [2023-12-26 05:02:15,467][123090] Updated weights for policy 1, policy_version 677975 (0.0008) [2023-12-26 05:02:16,198][123090] Updated weights for policy 1, policy_version 677985 (0.0008) [2023-12-26 05:02:16,268][123090] Updated weights for policy 1, policy_version 677995 (0.0009) [2023-12-26 05:02:16,323][123091] Updated weights for policy 0, policy_version 682521 (0.0007) [2023-12-26 05:02:16,332][123090] Updated weights for policy 1, policy_version 678005 (0.0011) [2023-12-26 05:02:16,385][123091] Updated weights for policy 0, policy_version 682531 (0.0006) [2023-12-26 05:02:16,391][123090] Updated weights for policy 1, policy_version 678015 (0.0010) [2023-12-26 05:02:16,451][123091] Updated weights for policy 0, policy_version 682541 (0.0008) [2023-12-26 05:02:17,155][123090] Updated weights for policy 1, policy_version 678025 (0.0009) [2023-12-26 05:02:17,215][123090] Updated weights for policy 1, policy_version 678035 (0.0009) [2023-12-26 05:02:17,263][123091] Updated weights for policy 0, policy_version 682551 (0.0009) [2023-12-26 05:02:17,276][123090] Updated weights for policy 1, policy_version 678045 (0.0008) [2023-12-26 05:02:17,323][123091] Updated weights for policy 0, policy_version 682561 (0.0009) [2023-12-26 05:02:17,382][123091] Updated weights for policy 0, policy_version 682571 (0.0009) [2023-12-26 05:02:18,090][123090] Updated weights for policy 1, policy_version 678055 (0.0010) [2023-12-26 05:02:18,147][123090] Updated weights for policy 1, policy_version 678065 (0.0009) [2023-12-26 05:02:18,202][123090] Updated weights for policy 1, policy_version 678075 (0.0009) [2023-12-26 05:02:18,225][123091] Updated weights for policy 0, policy_version 682581 (0.0009) [2023-12-26 05:02:18,280][123091] Updated weights for policy 0, policy_version 682591 (0.0010) [2023-12-26 05:02:18,350][123091] Updated weights for policy 0, policy_version 682601 (0.0008) [2023-12-26 05:02:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 348340224. Throughput: 0: 8788.5, 1: 8949.1. Samples: 348351852. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:18,785][121949] Avg episode reward: [(0, '5891.169'), (1, '5557.000')] [2023-12-26 05:02:19,018][123090] Updated weights for policy 1, policy_version 678085 (0.0008) [2023-12-26 05:02:19,090][123090] Updated weights for policy 1, policy_version 678095 (0.0010) [2023-12-26 05:02:19,153][123091] Updated weights for policy 0, policy_version 682611 (0.0009) [2023-12-26 05:02:19,160][123090] Updated weights for policy 1, policy_version 678105 (0.0009) [2023-12-26 05:02:19,206][123091] Updated weights for policy 0, policy_version 682621 (0.0006) [2023-12-26 05:02:19,277][123091] Updated weights for policy 0, policy_version 682631 (0.0010) [2023-12-26 05:02:19,939][123090] Updated weights for policy 1, policy_version 678115 (0.0010) [2023-12-26 05:02:20,006][123090] Updated weights for policy 1, policy_version 678125 (0.0010) [2023-12-26 05:02:20,059][123090] Updated weights for policy 1, policy_version 678135 (0.0009) [2023-12-26 05:02:20,168][123091] Updated weights for policy 0, policy_version 682641 (0.0010) [2023-12-26 05:02:20,229][123091] Updated weights for policy 0, policy_version 682651 (0.0009) [2023-12-26 05:02:20,297][123091] Updated weights for policy 0, policy_version 682661 (0.0010) [2023-12-26 05:02:20,365][123091] Updated weights for policy 0, policy_version 682671 (0.0010) [2023-12-26 05:02:20,957][123090] Updated weights for policy 1, policy_version 678145 (0.0009) [2023-12-26 05:02:21,023][123090] Updated weights for policy 1, policy_version 678155 (0.0009) [2023-12-26 05:02:21,100][123090] Updated weights for policy 1, policy_version 678165 (0.0009) [2023-12-26 05:02:21,134][123091] Updated weights for policy 0, policy_version 682681 (0.0007) [2023-12-26 05:02:21,169][123090] Updated weights for policy 1, policy_version 678175 (0.0008) [2023-12-26 05:02:21,201][123091] Updated weights for policy 0, policy_version 682691 (0.0009) [2023-12-26 05:02:21,262][123091] Updated weights for policy 0, policy_version 682701 (0.0009) [2023-12-26 05:02:22,023][123090] Updated weights for policy 1, policy_version 678185 (0.0010) [2023-12-26 05:02:22,092][123090] Updated weights for policy 1, policy_version 678195 (0.0009) [2023-12-26 05:02:22,149][123090] Updated weights for policy 1, policy_version 678205 (0.0009) [2023-12-26 05:02:22,173][123091] Updated weights for policy 0, policy_version 682711 (0.0009) [2023-12-26 05:02:22,243][123091] Updated weights for policy 0, policy_version 682721 (0.0010) [2023-12-26 05:02:22,315][123091] Updated weights for policy 0, policy_version 682731 (0.0010) [2023-12-26 05:02:22,973][123090] Updated weights for policy 1, policy_version 678215 (0.0009) [2023-12-26 05:02:23,030][123090] Updated weights for policy 1, policy_version 678226 (0.0010) [2023-12-26 05:02:23,088][123090] Updated weights for policy 1, policy_version 678236 (0.0010) [2023-12-26 05:02:23,132][123091] Updated weights for policy 0, policy_version 682741 (0.0009) [2023-12-26 05:02:23,192][123091] Updated weights for policy 0, policy_version 682752 (0.0010) [2023-12-26 05:02:23,250][123091] Updated weights for policy 0, policy_version 682762 (0.0009) [2023-12-26 05:02:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 348422144. Throughput: 0: 8781.7, 1: 8847.3. Samples: 348402152. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:23,784][121949] Avg episode reward: [(0, '5913.697'), (1, '5653.117')] [2023-12-26 05:02:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000678240_173629440.pth... [2023-12-26 05:02:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000682768_174792704.pth... [2023-12-26 05:02:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000677216_173367296.pth [2023-12-26 05:02:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000681744_174530560.pth [2023-12-26 05:02:23,905][123090] Updated weights for policy 1, policy_version 678246 (0.0007) [2023-12-26 05:02:23,972][123090] Updated weights for policy 1, policy_version 678256 (0.0008) [2023-12-26 05:02:24,042][123090] Updated weights for policy 1, policy_version 678266 (0.0009) [2023-12-26 05:02:24,141][123091] Updated weights for policy 0, policy_version 682772 (0.0009) [2023-12-26 05:02:24,193][123091] Updated weights for policy 0, policy_version 682782 (0.0008) [2023-12-26 05:02:24,244][123091] Updated weights for policy 0, policy_version 682793 (0.0010) [2023-12-26 05:02:24,786][123090] Updated weights for policy 1, policy_version 678276 (0.0009) [2023-12-26 05:02:24,839][123090] Updated weights for policy 1, policy_version 678286 (0.0009) [2023-12-26 05:02:24,901][123090] Updated weights for policy 1, policy_version 678296 (0.0009) [2023-12-26 05:02:25,109][123091] Updated weights for policy 0, policy_version 682803 (0.0009) [2023-12-26 05:02:25,166][123091] Updated weights for policy 0, policy_version 682813 (0.0010) [2023-12-26 05:02:25,215][123091] Updated weights for policy 0, policy_version 682823 (0.0009) [2023-12-26 05:02:25,753][123090] Updated weights for policy 1, policy_version 678306 (0.0009) [2023-12-26 05:02:25,809][123090] Updated weights for policy 1, policy_version 678316 (0.0009) [2023-12-26 05:02:25,863][123090] Updated weights for policy 1, policy_version 678326 (0.0009) [2023-12-26 05:02:25,923][123090] Updated weights for policy 1, policy_version 678336 (0.0008) [2023-12-26 05:02:26,073][123091] Updated weights for policy 0, policy_version 682834 (0.0011) [2023-12-26 05:02:26,133][123091] Updated weights for policy 0, policy_version 682844 (0.0009) [2023-12-26 05:02:26,180][123091] Updated weights for policy 0, policy_version 682854 (0.0009) [2023-12-26 05:02:26,230][123091] Updated weights for policy 0, policy_version 682864 (0.0009) [2023-12-26 05:02:26,706][123090] Updated weights for policy 1, policy_version 678346 (0.0005) [2023-12-26 05:02:26,781][123090] Updated weights for policy 1, policy_version 678356 (0.0005) [2023-12-26 05:02:26,846][123090] Updated weights for policy 1, policy_version 678366 (0.0005) [2023-12-26 05:02:27,151][123091] Updated weights for policy 0, policy_version 682874 (0.0010) [2023-12-26 05:02:27,205][123091] Updated weights for policy 0, policy_version 682884 (0.0010) [2023-12-26 05:02:27,259][123091] Updated weights for policy 0, policy_version 682894 (0.0010) [2023-12-26 05:02:27,500][123090] Updated weights for policy 1, policy_version 678376 (0.0005) [2023-12-26 05:02:27,563][123090] Updated weights for policy 1, policy_version 678386 (0.0005) [2023-12-26 05:02:27,612][123090] Updated weights for policy 1, policy_version 678396 (0.0005) [2023-12-26 05:02:28,153][123090] Updated weights for policy 1, policy_version 678406 (0.0008) [2023-12-26 05:02:28,186][123091] Updated weights for policy 0, policy_version 682904 (0.0006) [2023-12-26 05:02:28,204][123090] Updated weights for policy 1, policy_version 678416 (0.0010) [2023-12-26 05:02:28,237][123091] Updated weights for policy 0, policy_version 682914 (0.0005) [2023-12-26 05:02:28,246][123090] Updated weights for policy 1, policy_version 678426 (0.0009) [2023-12-26 05:02:28,288][123091] Updated weights for policy 0, policy_version 682924 (0.0009) [2023-12-26 05:02:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 348512256. Throughput: 0: 8763.8, 1: 8871.7. Samples: 348505704. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:28,785][121949] Avg episode reward: [(0, '5749.932'), (1, '5700.254')] [2023-12-26 05:02:29,039][123090] Updated weights for policy 1, policy_version 678436 (0.0007) [2023-12-26 05:02:29,094][123090] Updated weights for policy 1, policy_version 678446 (0.0010) [2023-12-26 05:02:29,153][123091] Updated weights for policy 0, policy_version 682934 (0.0009) [2023-12-26 05:02:29,153][123090] Updated weights for policy 1, policy_version 678456 (0.0009) [2023-12-26 05:02:29,216][123091] Updated weights for policy 0, policy_version 682944 (0.0009) [2023-12-26 05:02:29,283][123091] Updated weights for policy 0, policy_version 682954 (0.0009) [2023-12-26 05:02:29,935][123090] Updated weights for policy 1, policy_version 678466 (0.0006) [2023-12-26 05:02:29,995][123090] Updated weights for policy 1, policy_version 678476 (0.0005) [2023-12-26 05:02:30,061][123090] Updated weights for policy 1, policy_version 678486 (0.0007) [2023-12-26 05:02:30,119][123090] Updated weights for policy 1, policy_version 678496 (0.0009) [2023-12-26 05:02:30,158][123091] Updated weights for policy 0, policy_version 682964 (0.0009) [2023-12-26 05:02:30,209][123091] Updated weights for policy 0, policy_version 682974 (0.0009) [2023-12-26 05:02:30,266][123091] Updated weights for policy 0, policy_version 682986 (0.0010) [2023-12-26 05:02:30,859][123090] Updated weights for policy 1, policy_version 678506 (0.0007) [2023-12-26 05:02:30,916][123090] Updated weights for policy 1, policy_version 678516 (0.0006) [2023-12-26 05:02:30,969][123090] Updated weights for policy 1, policy_version 678526 (0.0008) [2023-12-26 05:02:31,028][123091] Updated weights for policy 0, policy_version 682996 (0.0008) [2023-12-26 05:02:31,099][123091] Updated weights for policy 0, policy_version 683006 (0.0008) [2023-12-26 05:02:31,165][123091] Updated weights for policy 0, policy_version 683016 (0.0009) [2023-12-26 05:02:31,696][123090] Updated weights for policy 1, policy_version 678536 (0.0010) [2023-12-26 05:02:31,762][123090] Updated weights for policy 1, policy_version 678546 (0.0011) [2023-12-26 05:02:31,831][123090] Updated weights for policy 1, policy_version 678556 (0.0009) [2023-12-26 05:02:32,015][123091] Updated weights for policy 0, policy_version 683027 (0.0009) [2023-12-26 05:02:32,072][123091] Updated weights for policy 0, policy_version 683037 (0.0005) [2023-12-26 05:02:32,120][123091] Updated weights for policy 0, policy_version 683047 (0.0005) [2023-12-26 05:02:32,594][123090] Updated weights for policy 1, policy_version 678566 (0.0008) [2023-12-26 05:02:32,655][123090] Updated weights for policy 1, policy_version 678576 (0.0009) [2023-12-26 05:02:32,714][123090] Updated weights for policy 1, policy_version 678586 (0.0009) [2023-12-26 05:02:32,883][123091] Updated weights for policy 0, policy_version 683057 (0.0006) [2023-12-26 05:02:32,936][123091] Updated weights for policy 0, policy_version 683067 (0.0009) [2023-12-26 05:02:32,993][123091] Updated weights for policy 0, policy_version 683077 (0.0009) [2023-12-26 05:02:33,058][123091] Updated weights for policy 0, policy_version 683087 (0.0009) [2023-12-26 05:02:33,430][123090] Updated weights for policy 1, policy_version 678596 (0.0008) [2023-12-26 05:02:33,483][123090] Updated weights for policy 1, policy_version 678606 (0.0005) [2023-12-26 05:02:33,542][123090] Updated weights for policy 1, policy_version 678616 (0.0006) [2023-12-26 05:02:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 348602368. Throughput: 0: 8645.4, 1: 8885.6. Samples: 348613312. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:33,785][121949] Avg episode reward: [(0, '5606.469'), (1, '5667.150')] [2023-12-26 05:02:33,927][123091] Updated weights for policy 0, policy_version 683097 (0.0009) [2023-12-26 05:02:33,982][123091] Updated weights for policy 0, policy_version 683107 (0.0009) [2023-12-26 05:02:34,037][123091] Updated weights for policy 0, policy_version 683117 (0.0009) [2023-12-26 05:02:34,311][123090] Updated weights for policy 1, policy_version 678626 (0.0006) [2023-12-26 05:02:34,373][123090] Updated weights for policy 1, policy_version 678636 (0.0009) [2023-12-26 05:02:34,439][123090] Updated weights for policy 1, policy_version 678646 (0.0009) [2023-12-26 05:02:34,504][123090] Updated weights for policy 1, policy_version 678656 (0.0009) [2023-12-26 05:02:34,897][123091] Updated weights for policy 0, policy_version 683127 (0.0010) [2023-12-26 05:02:34,950][123091] Updated weights for policy 0, policy_version 683137 (0.0009) [2023-12-26 05:02:35,006][123091] Updated weights for policy 0, policy_version 683147 (0.0008) [2023-12-26 05:02:35,342][123090] Updated weights for policy 1, policy_version 678666 (0.0006) [2023-12-26 05:02:35,391][123090] Updated weights for policy 1, policy_version 678676 (0.0005) [2023-12-26 05:02:35,438][123090] Updated weights for policy 1, policy_version 678686 (0.0005) [2023-12-26 05:02:35,859][123091] Updated weights for policy 0, policy_version 683157 (0.0010) [2023-12-26 05:02:35,918][123091] Updated weights for policy 0, policy_version 683167 (0.0010) [2023-12-26 05:02:35,982][123091] Updated weights for policy 0, policy_version 683177 (0.0010) [2023-12-26 05:02:36,150][123090] Updated weights for policy 1, policy_version 678696 (0.0007) [2023-12-26 05:02:36,199][123090] Updated weights for policy 1, policy_version 678706 (0.0005) [2023-12-26 05:02:36,253][123090] Updated weights for policy 1, policy_version 678716 (0.0008) [2023-12-26 05:02:36,882][123091] Updated weights for policy 0, policy_version 683187 (0.0010) [2023-12-26 05:02:36,945][123091] Updated weights for policy 0, policy_version 683197 (0.0009) [2023-12-26 05:02:37,006][123091] Updated weights for policy 0, policy_version 683207 (0.0009) [2023-12-26 05:02:37,077][123090] Updated weights for policy 1, policy_version 678726 (0.0011) [2023-12-26 05:02:37,149][123090] Updated weights for policy 1, policy_version 678736 (0.0011) [2023-12-26 05:02:37,213][123090] Updated weights for policy 1, policy_version 678746 (0.0011) [2023-12-26 05:02:37,871][123091] Updated weights for policy 0, policy_version 683217 (0.0009) [2023-12-26 05:02:37,937][123091] Updated weights for policy 0, policy_version 683227 (0.0008) [2023-12-26 05:02:37,986][123091] Updated weights for policy 0, policy_version 683237 (0.0009) [2023-12-26 05:02:38,009][123090] Updated weights for policy 1, policy_version 678756 (0.0009) [2023-12-26 05:02:38,045][123091] Updated weights for policy 0, policy_version 683247 (0.0010) [2023-12-26 05:02:38,066][123090] Updated weights for policy 1, policy_version 678766 (0.0009) [2023-12-26 05:02:38,124][123090] Updated weights for policy 1, policy_version 678776 (0.0010) [2023-12-26 05:02:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 348684288. Throughput: 0: 8576.8, 1: 8956.5. Samples: 348665804. Policy #0 lag: (min: 31.0, avg: 31.9, max: 58.0) [2023-12-26 05:02:38,785][121949] Avg episode reward: [(0, '5602.869'), (1, '5596.531')] [2023-12-26 05:02:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000678784_173768704.pth... [2023-12-26 05:02:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000677728_173498368.pth [2023-12-26 05:02:38,803][123091] Updated weights for policy 0, policy_version 683257 (0.0006) [2023-12-26 05:02:38,860][123091] Updated weights for policy 0, policy_version 683267 (0.0011) [2023-12-26 05:02:38,919][123091] Updated weights for policy 0, policy_version 683277 (0.0011) [2023-12-26 05:02:38,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000683280_174923776.pth... [2023-12-26 05:02:38,942][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000682288_174669824.pth [2023-12-26 05:02:39,007][123090] Updated weights for policy 1, policy_version 678786 (0.0010) [2023-12-26 05:02:39,067][123090] Updated weights for policy 1, policy_version 678796 (0.0009) [2023-12-26 05:02:39,134][123090] Updated weights for policy 1, policy_version 678806 (0.0009) [2023-12-26 05:02:39,200][123090] Updated weights for policy 1, policy_version 678816 (0.0010) [2023-12-26 05:02:39,755][123091] Updated weights for policy 0, policy_version 683287 (0.0007) [2023-12-26 05:02:39,824][123091] Updated weights for policy 0, policy_version 683297 (0.0007) [2023-12-26 05:02:39,896][123091] Updated weights for policy 0, policy_version 683307 (0.0010) [2023-12-26 05:02:40,131][123090] Updated weights for policy 1, policy_version 678826 (0.0011) [2023-12-26 05:02:40,204][123090] Updated weights for policy 1, policy_version 678836 (0.0011) [2023-12-26 05:02:40,275][123090] Updated weights for policy 1, policy_version 678846 (0.0010) [2023-12-26 05:02:40,610][123091] Updated weights for policy 0, policy_version 683317 (0.0008) [2023-12-26 05:02:40,664][123091] Updated weights for policy 0, policy_version 683327 (0.0006) [2023-12-26 05:02:40,712][123091] Updated weights for policy 0, policy_version 683337 (0.0005) [2023-12-26 05:02:41,099][123090] Updated weights for policy 1, policy_version 678856 (0.0007) [2023-12-26 05:02:41,175][123090] Updated weights for policy 1, policy_version 678866 (0.0009) [2023-12-26 05:02:41,239][123090] Updated weights for policy 1, policy_version 678876 (0.0008) [2023-12-26 05:02:41,425][123091] Updated weights for policy 0, policy_version 683347 (0.0007) [2023-12-26 05:02:41,482][123091] Updated weights for policy 0, policy_version 683357 (0.0010) [2023-12-26 05:02:41,554][123091] Updated weights for policy 0, policy_version 683367 (0.0011) [2023-12-26 05:02:42,021][123090] Updated weights for policy 1, policy_version 678886 (0.0009) [2023-12-26 05:02:42,084][123090] Updated weights for policy 1, policy_version 678896 (0.0010) [2023-12-26 05:02:42,146][123090] Updated weights for policy 1, policy_version 678906 (0.0010) [2023-12-26 05:02:42,350][123091] Updated weights for policy 0, policy_version 683377 (0.0011) [2023-12-26 05:02:42,419][123091] Updated weights for policy 0, policy_version 683387 (0.0010) [2023-12-26 05:02:42,467][123091] Updated weights for policy 0, policy_version 683397 (0.0010) [2023-12-26 05:02:42,514][123091] Updated weights for policy 0, policy_version 683407 (0.0011) [2023-12-26 05:02:43,003][123090] Updated weights for policy 1, policy_version 678916 (0.0008) [2023-12-26 05:02:43,072][123090] Updated weights for policy 1, policy_version 678926 (0.0007) [2023-12-26 05:02:43,139][123090] Updated weights for policy 1, policy_version 678936 (0.0005) [2023-12-26 05:02:43,363][123091] Updated weights for policy 0, policy_version 683417 (0.0011) [2023-12-26 05:02:43,436][123091] Updated weights for policy 0, policy_version 683427 (0.0011) [2023-12-26 05:02:43,499][123091] Updated weights for policy 0, policy_version 683437 (0.0011) [2023-12-26 05:02:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 348774400. Throughput: 0: 8559.2, 1: 8888.0. Samples: 348768496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:02:43,785][121949] Avg episode reward: [(0, '5700.203'), (1, '5646.298')] [2023-12-26 05:02:43,790][123090] Updated weights for policy 1, policy_version 678946 (0.0006) [2023-12-26 05:02:43,838][123090] Updated weights for policy 1, policy_version 678956 (0.0006) [2023-12-26 05:02:43,897][123090] Updated weights for policy 1, policy_version 678966 (0.0005) [2023-12-26 05:02:43,945][123090] Updated weights for policy 1, policy_version 678976 (0.0005) [2023-12-26 05:02:44,310][123091] Updated weights for policy 0, policy_version 683447 (0.0011) [2023-12-26 05:02:44,380][123091] Updated weights for policy 0, policy_version 683457 (0.0010) [2023-12-26 05:02:44,447][123091] Updated weights for policy 0, policy_version 683467 (0.0010) [2023-12-26 05:02:44,694][123090] Updated weights for policy 1, policy_version 678986 (0.0010) [2023-12-26 05:02:44,746][123090] Updated weights for policy 1, policy_version 678996 (0.0010) [2023-12-26 05:02:44,810][123090] Updated weights for policy 1, policy_version 679006 (0.0009) [2023-12-26 05:02:45,231][123091] Updated weights for policy 0, policy_version 683477 (0.0007) [2023-12-26 05:02:45,284][123091] Updated weights for policy 0, policy_version 683487 (0.0009) [2023-12-26 05:02:45,337][123091] Updated weights for policy 0, policy_version 683497 (0.0009) [2023-12-26 05:02:45,546][123090] Updated weights for policy 1, policy_version 679016 (0.0010) [2023-12-26 05:02:45,615][123090] Updated weights for policy 1, policy_version 679026 (0.0011) [2023-12-26 05:02:45,681][123090] Updated weights for policy 1, policy_version 679036 (0.0011) [2023-12-26 05:02:46,294][123091] Updated weights for policy 0, policy_version 683507 (0.0009) [2023-12-26 05:02:46,360][123091] Updated weights for policy 0, policy_version 683517 (0.0007) [2023-12-26 05:02:46,419][123090] Updated weights for policy 1, policy_version 679046 (0.0009) [2023-12-26 05:02:46,427][123091] Updated weights for policy 0, policy_version 683527 (0.0006) [2023-12-26 05:02:46,480][123090] Updated weights for policy 1, policy_version 679056 (0.0007) [2023-12-26 05:02:46,539][123090] Updated weights for policy 1, policy_version 679066 (0.0006) [2023-12-26 05:02:47,118][123091] Updated weights for policy 0, policy_version 683537 (0.0005) [2023-12-26 05:02:47,187][123091] Updated weights for policy 0, policy_version 683547 (0.0006) [2023-12-26 05:02:47,246][123091] Updated weights for policy 0, policy_version 683557 (0.0008) [2023-12-26 05:02:47,277][123090] Updated weights for policy 1, policy_version 679076 (0.0007) [2023-12-26 05:02:47,297][123091] Updated weights for policy 0, policy_version 683567 (0.0008) [2023-12-26 05:02:47,357][123090] Updated weights for policy 1, policy_version 679086 (0.0009) [2023-12-26 05:02:47,412][123090] Updated weights for policy 1, policy_version 679096 (0.0008) [2023-12-26 05:02:48,066][123091] Updated weights for policy 0, policy_version 683577 (0.0007) [2023-12-26 05:02:48,131][123091] Updated weights for policy 0, policy_version 683587 (0.0005) [2023-12-26 05:02:48,191][123091] Updated weights for policy 0, policy_version 683597 (0.0005) [2023-12-26 05:02:48,231][123090] Updated weights for policy 1, policy_version 679106 (0.0009) [2023-12-26 05:02:48,294][123090] Updated weights for policy 1, policy_version 679116 (0.0010) [2023-12-26 05:02:48,360][123090] Updated weights for policy 1, policy_version 679126 (0.0009) [2023-12-26 05:02:48,431][123090] Updated weights for policy 1, policy_version 679136 (0.0007) [2023-12-26 05:02:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 348864512. Throughput: 0: 8574.4, 1: 8991.1. Samples: 348878180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:02:48,785][121949] Avg episode reward: [(0, '5854.570'), (1, '5584.839')] [2023-12-26 05:02:48,925][123091] Updated weights for policy 0, policy_version 683607 (0.0006) [2023-12-26 05:02:48,976][123091] Updated weights for policy 0, policy_version 683617 (0.0008) [2023-12-26 05:02:49,023][123091] Updated weights for policy 0, policy_version 683627 (0.0005) [2023-12-26 05:02:49,221][123090] Updated weights for policy 1, policy_version 679146 (0.0008) [2023-12-26 05:02:49,283][123090] Updated weights for policy 1, policy_version 679156 (0.0009) [2023-12-26 05:02:49,348][123090] Updated weights for policy 1, policy_version 679166 (0.0006) [2023-12-26 05:02:49,807][123091] Updated weights for policy 0, policy_version 683637 (0.0006) [2023-12-26 05:02:49,867][123091] Updated weights for policy 0, policy_version 683647 (0.0011) [2023-12-26 05:02:49,920][123091] Updated weights for policy 0, policy_version 683657 (0.0011) [2023-12-26 05:02:50,094][123090] Updated weights for policy 1, policy_version 679176 (0.0010) [2023-12-26 05:02:50,169][123090] Updated weights for policy 1, policy_version 679186 (0.0010) [2023-12-26 05:02:50,240][123090] Updated weights for policy 1, policy_version 679196 (0.0011) [2023-12-26 05:02:50,581][123091] Updated weights for policy 0, policy_version 683667 (0.0009) [2023-12-26 05:02:50,643][123091] Updated weights for policy 0, policy_version 683677 (0.0007) [2023-12-26 05:02:50,704][123091] Updated weights for policy 0, policy_version 683687 (0.0006) [2023-12-26 05:02:51,066][123090] Updated weights for policy 1, policy_version 679206 (0.0011) [2023-12-26 05:02:51,139][123090] Updated weights for policy 1, policy_version 679216 (0.0011) [2023-12-26 05:02:51,187][123090] Updated weights for policy 1, policy_version 679226 (0.0010) [2023-12-26 05:02:51,403][123091] Updated weights for policy 0, policy_version 683697 (0.0007) [2023-12-26 05:02:51,459][123091] Updated weights for policy 0, policy_version 683707 (0.0011) [2023-12-26 05:02:51,511][123091] Updated weights for policy 0, policy_version 683717 (0.0011) [2023-12-26 05:02:51,570][123091] Updated weights for policy 0, policy_version 683727 (0.0011) [2023-12-26 05:02:52,055][123090] Updated weights for policy 1, policy_version 679236 (0.0010) [2023-12-26 05:02:52,117][123090] Updated weights for policy 1, policy_version 679246 (0.0008) [2023-12-26 05:02:52,175][123090] Updated weights for policy 1, policy_version 679256 (0.0008) [2023-12-26 05:02:52,341][123091] Updated weights for policy 0, policy_version 683737 (0.0006) [2023-12-26 05:02:52,408][123091] Updated weights for policy 0, policy_version 683747 (0.0008) [2023-12-26 05:02:52,469][123091] Updated weights for policy 0, policy_version 683757 (0.0006) [2023-12-26 05:02:52,998][123090] Updated weights for policy 1, policy_version 679266 (0.0008) [2023-12-26 05:02:53,054][123090] Updated weights for policy 1, policy_version 679276 (0.0010) [2023-12-26 05:02:53,102][123090] Updated weights for policy 1, policy_version 679286 (0.0010) [2023-12-26 05:02:53,154][123090] Updated weights for policy 1, policy_version 679296 (0.0010) [2023-12-26 05:02:53,229][123091] Updated weights for policy 0, policy_version 683767 (0.0008) [2023-12-26 05:02:53,288][123091] Updated weights for policy 0, policy_version 683777 (0.0009) [2023-12-26 05:02:53,348][123091] Updated weights for policy 0, policy_version 683787 (0.0009) [2023-12-26 05:02:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 348954624. Throughput: 0: 8578.7, 1: 9000.2. Samples: 348931812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:02:53,785][121949] Avg episode reward: [(0, '6024.321'), (1, '5781.297')] [2023-12-26 05:02:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000679296_173899776.pth... [2023-12-26 05:02:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000683792_175054848.pth... [2023-12-26 05:02:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000678240_173629440.pth [2023-12-26 05:02:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000682768_174792704.pth [2023-12-26 05:02:53,999][123090] Updated weights for policy 1, policy_version 679306 (0.0010) [2023-12-26 05:02:54,060][123090] Updated weights for policy 1, policy_version 679316 (0.0010) [2023-12-26 05:02:54,134][123090] Updated weights for policy 1, policy_version 679326 (0.0010) [2023-12-26 05:02:54,182][123091] Updated weights for policy 0, policy_version 683797 (0.0008) [2023-12-26 05:02:54,248][123091] Updated weights for policy 0, policy_version 683807 (0.0007) [2023-12-26 05:02:54,315][123091] Updated weights for policy 0, policy_version 683817 (0.0009) [2023-12-26 05:02:54,947][123090] Updated weights for policy 1, policy_version 679336 (0.0011) [2023-12-26 05:02:55,003][123090] Updated weights for policy 1, policy_version 679346 (0.0011) [2023-12-26 05:02:55,028][123091] Updated weights for policy 0, policy_version 683827 (0.0008) [2023-12-26 05:02:55,065][123090] Updated weights for policy 1, policy_version 679356 (0.0009) [2023-12-26 05:02:55,085][123091] Updated weights for policy 0, policy_version 683837 (0.0007) [2023-12-26 05:02:55,150][123091] Updated weights for policy 0, policy_version 683847 (0.0007) [2023-12-26 05:02:55,734][123090] Updated weights for policy 1, policy_version 679366 (0.0009) [2023-12-26 05:02:55,805][123090] Updated weights for policy 1, policy_version 679376 (0.0010) [2023-12-26 05:02:55,875][123090] Updated weights for policy 1, policy_version 679386 (0.0011) [2023-12-26 05:02:55,936][123091] Updated weights for policy 0, policy_version 683857 (0.0009) [2023-12-26 05:02:56,002][123091] Updated weights for policy 0, policy_version 683867 (0.0005) [2023-12-26 05:02:56,059][123091] Updated weights for policy 0, policy_version 683877 (0.0005) [2023-12-26 05:02:56,113][123091] Updated weights for policy 0, policy_version 683887 (0.0006) [2023-12-26 05:02:56,643][123090] Updated weights for policy 1, policy_version 679396 (0.0008) [2023-12-26 05:02:56,702][123090] Updated weights for policy 1, policy_version 679406 (0.0005) [2023-12-26 05:02:56,769][123090] Updated weights for policy 1, policy_version 679416 (0.0006) [2023-12-26 05:02:56,798][123091] Updated weights for policy 0, policy_version 683897 (0.0005) [2023-12-26 05:02:56,844][123091] Updated weights for policy 0, policy_version 683907 (0.0006) [2023-12-26 05:02:56,896][123091] Updated weights for policy 0, policy_version 683917 (0.0006) [2023-12-26 05:02:57,504][123090] Updated weights for policy 1, policy_version 679426 (0.0006) [2023-12-26 05:02:57,556][123090] Updated weights for policy 1, policy_version 679436 (0.0010) [2023-12-26 05:02:57,623][123090] Updated weights for policy 1, policy_version 679446 (0.0009) [2023-12-26 05:02:57,629][123091] Updated weights for policy 0, policy_version 683927 (0.0005) [2023-12-26 05:02:57,676][123090] Updated weights for policy 1, policy_version 679456 (0.0009) [2023-12-26 05:02:57,691][123091] Updated weights for policy 0, policy_version 683937 (0.0006) [2023-12-26 05:02:57,737][123091] Updated weights for policy 0, policy_version 683947 (0.0005) [2023-12-26 05:02:58,508][123091] Updated weights for policy 0, policy_version 683957 (0.0007) [2023-12-26 05:02:58,521][123090] Updated weights for policy 1, policy_version 679466 (0.0008) [2023-12-26 05:02:58,568][123091] Updated weights for policy 0, policy_version 683967 (0.0008) [2023-12-26 05:02:58,586][123090] Updated weights for policy 1, policy_version 679476 (0.0008) [2023-12-26 05:02:58,638][123091] Updated weights for policy 0, policy_version 683977 (0.0008) [2023-12-26 05:02:58,673][123090] Updated weights for policy 1, policy_version 679486 (0.0007) [2023-12-26 05:02:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 349052928. Throughput: 0: 8691.5, 1: 8998.1. Samples: 349041904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:02:58,785][121949] Avg episode reward: [(0, '5752.996'), (1, '5823.919')] [2023-12-26 05:02:59,412][123090] Updated weights for policy 1, policy_version 679496 (0.0008) [2023-12-26 05:02:59,471][123090] Updated weights for policy 1, policy_version 679506 (0.0009) [2023-12-26 05:02:59,531][123090] Updated weights for policy 1, policy_version 679516 (0.0009) [2023-12-26 05:02:59,568][123091] Updated weights for policy 0, policy_version 683987 (0.0009) [2023-12-26 05:02:59,628][123091] Updated weights for policy 0, policy_version 683997 (0.0009) [2023-12-26 05:02:59,689][123091] Updated weights for policy 0, policy_version 684007 (0.0010) [2023-12-26 05:03:00,334][123090] Updated weights for policy 1, policy_version 679526 (0.0008) [2023-12-26 05:03:00,395][123090] Updated weights for policy 1, policy_version 679536 (0.0005) [2023-12-26 05:03:00,448][123090] Updated weights for policy 1, policy_version 679546 (0.0006) [2023-12-26 05:03:00,528][123091] Updated weights for policy 0, policy_version 684017 (0.0008) [2023-12-26 05:03:00,578][123091] Updated weights for policy 0, policy_version 684027 (0.0008) [2023-12-26 05:03:00,643][123091] Updated weights for policy 0, policy_version 684037 (0.0008) [2023-12-26 05:03:00,711][123091] Updated weights for policy 0, policy_version 684047 (0.0009) [2023-12-26 05:03:01,203][123090] Updated weights for policy 1, policy_version 679556 (0.0008) [2023-12-26 05:03:01,263][123090] Updated weights for policy 1, policy_version 679566 (0.0009) [2023-12-26 05:03:01,330][123090] Updated weights for policy 1, policy_version 679576 (0.0009) [2023-12-26 05:03:01,547][123091] Updated weights for policy 0, policy_version 684057 (0.0007) [2023-12-26 05:03:01,594][123091] Updated weights for policy 0, policy_version 684067 (0.0008) [2023-12-26 05:03:01,662][123091] Updated weights for policy 0, policy_version 684077 (0.0009) [2023-12-26 05:03:02,088][123090] Updated weights for policy 1, policy_version 679586 (0.0010) [2023-12-26 05:03:02,151][123090] Updated weights for policy 1, policy_version 679596 (0.0010) [2023-12-26 05:03:02,207][123090] Updated weights for policy 1, policy_version 679606 (0.0009) [2023-12-26 05:03:02,266][123090] Updated weights for policy 1, policy_version 679616 (0.0008) [2023-12-26 05:03:02,553][123091] Updated weights for policy 0, policy_version 684087 (0.0010) [2023-12-26 05:03:02,612][123091] Updated weights for policy 0, policy_version 684097 (0.0010) [2023-12-26 05:03:02,668][123091] Updated weights for policy 0, policy_version 684107 (0.0009) [2023-12-26 05:03:03,098][123090] Updated weights for policy 1, policy_version 679626 (0.0006) [2023-12-26 05:03:03,153][123090] Updated weights for policy 1, policy_version 679636 (0.0006) [2023-12-26 05:03:03,212][123090] Updated weights for policy 1, policy_version 679646 (0.0005) [2023-12-26 05:03:03,413][123091] Updated weights for policy 0, policy_version 684117 (0.0007) [2023-12-26 05:03:03,464][123091] Updated weights for policy 0, policy_version 684127 (0.0005) [2023-12-26 05:03:03,516][123091] Updated weights for policy 0, policy_version 684137 (0.0005) [2023-12-26 05:03:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 349134848. Throughput: 0: 8715.6, 1: 8959.0. Samples: 349147212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:03,785][121949] Avg episode reward: [(0, '5724.738'), (1, '5703.847')] [2023-12-26 05:03:03,954][123090] Updated weights for policy 1, policy_version 679656 (0.0008) [2023-12-26 05:03:04,012][123090] Updated weights for policy 1, policy_version 679666 (0.0009) [2023-12-26 05:03:04,064][123090] Updated weights for policy 1, policy_version 679676 (0.0009) [2023-12-26 05:03:04,230][123091] Updated weights for policy 0, policy_version 684147 (0.0007) [2023-12-26 05:03:04,302][123091] Updated weights for policy 0, policy_version 684157 (0.0011) [2023-12-26 05:03:04,369][123091] Updated weights for policy 0, policy_version 684167 (0.0011) [2023-12-26 05:03:04,946][123090] Updated weights for policy 1, policy_version 679686 (0.0009) [2023-12-26 05:03:04,998][123090] Updated weights for policy 1, policy_version 679696 (0.0009) [2023-12-26 05:03:05,056][123090] Updated weights for policy 1, policy_version 679706 (0.0009) [2023-12-26 05:03:05,128][123091] Updated weights for policy 0, policy_version 684177 (0.0010) [2023-12-26 05:03:05,191][123091] Updated weights for policy 0, policy_version 684187 (0.0005) [2023-12-26 05:03:05,238][123091] Updated weights for policy 0, policy_version 684197 (0.0005) [2023-12-26 05:03:05,296][123091] Updated weights for policy 0, policy_version 684207 (0.0005) [2023-12-26 05:03:05,979][123091] Updated weights for policy 0, policy_version 684217 (0.0007) [2023-12-26 05:03:05,991][123090] Updated weights for policy 1, policy_version 679716 (0.0009) [2023-12-26 05:03:06,031][123091] Updated weights for policy 0, policy_version 684227 (0.0010) [2023-12-26 05:03:06,050][123090] Updated weights for policy 1, policy_version 679726 (0.0006) [2023-12-26 05:03:06,079][123091] Updated weights for policy 0, policy_version 684237 (0.0010) [2023-12-26 05:03:06,099][123090] Updated weights for policy 1, policy_version 679736 (0.0005) [2023-12-26 05:03:06,852][123091] Updated weights for policy 0, policy_version 684247 (0.0008) [2023-12-26 05:03:06,914][123091] Updated weights for policy 0, policy_version 684257 (0.0009) [2023-12-26 05:03:06,929][123090] Updated weights for policy 1, policy_version 679746 (0.0009) [2023-12-26 05:03:06,974][123091] Updated weights for policy 0, policy_version 684267 (0.0008) [2023-12-26 05:03:06,996][123090] Updated weights for policy 1, policy_version 679756 (0.0010) [2023-12-26 05:03:07,059][123090] Updated weights for policy 1, policy_version 679766 (0.0010) [2023-12-26 05:03:07,116][123090] Updated weights for policy 1, policy_version 679776 (0.0009) [2023-12-26 05:03:07,760][123091] Updated weights for policy 0, policy_version 684277 (0.0009) [2023-12-26 05:03:07,823][123091] Updated weights for policy 0, policy_version 684287 (0.0009) [2023-12-26 05:03:07,877][123091] Updated weights for policy 0, policy_version 684297 (0.0010) [2023-12-26 05:03:07,972][123090] Updated weights for policy 1, policy_version 679786 (0.0011) [2023-12-26 05:03:08,039][123090] Updated weights for policy 1, policy_version 679796 (0.0010) [2023-12-26 05:03:08,103][123090] Updated weights for policy 1, policy_version 679806 (0.0008) [2023-12-26 05:03:08,695][123091] Updated weights for policy 0, policy_version 684307 (0.0010) [2023-12-26 05:03:08,743][123091] Updated weights for policy 0, policy_version 684317 (0.0009) [2023-12-26 05:03:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 349216768. Throughput: 0: 8786.1, 1: 8947.4. Samples: 349200160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:08,784][121949] Avg episode reward: [(0, '5840.044'), (1, '5746.827')] [2023-12-26 05:03:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000679808_174030848.pth... [2023-12-26 05:03:08,791][123091] Updated weights for policy 0, policy_version 684327 (0.0009) [2023-12-26 05:03:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000678784_173768704.pth [2023-12-26 05:03:08,839][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000684336_175194112.pth... [2023-12-26 05:03:08,842][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000683280_174923776.pth [2023-12-26 05:03:08,914][123090] Updated weights for policy 1, policy_version 679816 (0.0010) [2023-12-26 05:03:08,970][123090] Updated weights for policy 1, policy_version 679826 (0.0010) [2023-12-26 05:03:09,032][123090] Updated weights for policy 1, policy_version 679836 (0.0010) [2023-12-26 05:03:09,624][123091] Updated weights for policy 0, policy_version 684337 (0.0010) [2023-12-26 05:03:09,695][123091] Updated weights for policy 0, policy_version 684347 (0.0009) [2023-12-26 05:03:09,756][123091] Updated weights for policy 0, policy_version 684357 (0.0009) [2023-12-26 05:03:09,822][123091] Updated weights for policy 0, policy_version 684367 (0.0009) [2023-12-26 05:03:09,915][123090] Updated weights for policy 1, policy_version 679846 (0.0009) [2023-12-26 05:03:09,988][123090] Updated weights for policy 1, policy_version 679856 (0.0009) [2023-12-26 05:03:10,052][123090] Updated weights for policy 1, policy_version 679866 (0.0008) [2023-12-26 05:03:10,609][123091] Updated weights for policy 0, policy_version 684377 (0.0009) [2023-12-26 05:03:10,662][123091] Updated weights for policy 0, policy_version 684387 (0.0010) [2023-12-26 05:03:10,717][123091] Updated weights for policy 0, policy_version 684397 (0.0010) [2023-12-26 05:03:10,805][123090] Updated weights for policy 1, policy_version 679876 (0.0007) [2023-12-26 05:03:10,872][123090] Updated weights for policy 1, policy_version 679886 (0.0008) [2023-12-26 05:03:10,938][123090] Updated weights for policy 1, policy_version 679896 (0.0009) [2023-12-26 05:03:11,573][123091] Updated weights for policy 0, policy_version 684407 (0.0008) [2023-12-26 05:03:11,650][123091] Updated weights for policy 0, policy_version 684417 (0.0009) [2023-12-26 05:03:11,714][123091] Updated weights for policy 0, policy_version 684427 (0.0011) [2023-12-26 05:03:11,813][123090] Updated weights for policy 1, policy_version 679906 (0.0009) [2023-12-26 05:03:11,869][123090] Updated weights for policy 1, policy_version 679916 (0.0009) [2023-12-26 05:03:11,925][123090] Updated weights for policy 1, policy_version 679926 (0.0008) [2023-12-26 05:03:11,994][123090] Updated weights for policy 1, policy_version 679936 (0.0007) [2023-12-26 05:03:12,475][123091] Updated weights for policy 0, policy_version 684437 (0.0007) [2023-12-26 05:03:12,547][123091] Updated weights for policy 0, policy_version 684447 (0.0005) [2023-12-26 05:03:12,627][123091] Updated weights for policy 0, policy_version 684457 (0.0005) [2023-12-26 05:03:12,778][123090] Updated weights for policy 1, policy_version 679946 (0.0006) [2023-12-26 05:03:12,830][123090] Updated weights for policy 1, policy_version 679956 (0.0010) [2023-12-26 05:03:12,886][123090] Updated weights for policy 1, policy_version 679966 (0.0010) [2023-12-26 05:03:13,298][123091] Updated weights for policy 0, policy_version 684467 (0.0007) [2023-12-26 05:03:13,352][123091] Updated weights for policy 0, policy_version 684478 (0.0010) [2023-12-26 05:03:13,417][123091] Updated weights for policy 0, policy_version 684488 (0.0009) [2023-12-26 05:03:13,667][123090] Updated weights for policy 1, policy_version 679976 (0.0011) [2023-12-26 05:03:13,735][123090] Updated weights for policy 1, policy_version 679986 (0.0011) [2023-12-26 05:03:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 349306880. Throughput: 0: 8858.0, 1: 8866.7. Samples: 349303312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:13,785][121949] Avg episode reward: [(0, '5967.576'), (1, '5842.190')] [2023-12-26 05:03:13,806][123090] Updated weights for policy 1, policy_version 679996 (0.0010) [2023-12-26 05:03:14,201][123091] Updated weights for policy 0, policy_version 684498 (0.0009) [2023-12-26 05:03:14,252][123091] Updated weights for policy 0, policy_version 684508 (0.0009) [2023-12-26 05:03:14,308][123091] Updated weights for policy 0, policy_version 684518 (0.0011) [2023-12-26 05:03:14,356][123091] Updated weights for policy 0, policy_version 684528 (0.0011) [2023-12-26 05:03:14,550][123090] Updated weights for policy 1, policy_version 680006 (0.0007) [2023-12-26 05:03:14,601][123090] Updated weights for policy 1, policy_version 680016 (0.0005) [2023-12-26 05:03:14,660][123090] Updated weights for policy 1, policy_version 680026 (0.0008) [2023-12-26 05:03:15,141][123091] Updated weights for policy 0, policy_version 684538 (0.0010) [2023-12-26 05:03:15,209][123091] Updated weights for policy 0, policy_version 684548 (0.0011) [2023-12-26 05:03:15,266][123091] Updated weights for policy 0, policy_version 684558 (0.0008) [2023-12-26 05:03:15,483][123090] Updated weights for policy 1, policy_version 680036 (0.0008) [2023-12-26 05:03:15,531][123090] Updated weights for policy 1, policy_version 680046 (0.0005) [2023-12-26 05:03:15,583][123090] Updated weights for policy 1, policy_version 680056 (0.0005) [2023-12-26 05:03:16,065][123091] Updated weights for policy 0, policy_version 684568 (0.0009) [2023-12-26 05:03:16,127][123091] Updated weights for policy 0, policy_version 684578 (0.0009) [2023-12-26 05:03:16,191][123091] Updated weights for policy 0, policy_version 684588 (0.0009) [2023-12-26 05:03:16,304][123090] Updated weights for policy 1, policy_version 680066 (0.0010) [2023-12-26 05:03:16,353][123090] Updated weights for policy 1, policy_version 680076 (0.0006) [2023-12-26 05:03:16,418][123090] Updated weights for policy 1, policy_version 680086 (0.0006) [2023-12-26 05:03:16,474][123090] Updated weights for policy 1, policy_version 680096 (0.0005) [2023-12-26 05:03:17,009][123091] Updated weights for policy 0, policy_version 684598 (0.0009) [2023-12-26 05:03:17,072][123091] Updated weights for policy 0, policy_version 684608 (0.0009) [2023-12-26 05:03:17,092][123090] Updated weights for policy 1, policy_version 680106 (0.0005) [2023-12-26 05:03:17,130][123091] Updated weights for policy 0, policy_version 684618 (0.0008) [2023-12-26 05:03:17,153][123090] Updated weights for policy 1, policy_version 680116 (0.0005) [2023-12-26 05:03:17,209][123090] Updated weights for policy 1, policy_version 680126 (0.0005) [2023-12-26 05:03:17,822][123090] Updated weights for policy 1, policy_version 680136 (0.0005) [2023-12-26 05:03:17,878][123090] Updated weights for policy 1, policy_version 680146 (0.0005) [2023-12-26 05:03:17,895][123091] Updated weights for policy 0, policy_version 684628 (0.0009) [2023-12-26 05:03:17,928][123090] Updated weights for policy 1, policy_version 680156 (0.0006) [2023-12-26 05:03:17,961][123091] Updated weights for policy 0, policy_version 684638 (0.0011) [2023-12-26 05:03:18,027][123091] Updated weights for policy 0, policy_version 684648 (0.0011) [2023-12-26 05:03:18,669][123090] Updated weights for policy 1, policy_version 680166 (0.0006) [2023-12-26 05:03:18,730][123090] Updated weights for policy 1, policy_version 680176 (0.0005) [2023-12-26 05:03:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 349396992. Throughput: 0: 8919.6, 1: 8878.7. Samples: 349414232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:18,785][121949] Avg episode reward: [(0, '5873.469'), (1, '5766.661')] [2023-12-26 05:03:18,797][123090] Updated weights for policy 1, policy_version 680186 (0.0006) [2023-12-26 05:03:18,847][123091] Updated weights for policy 0, policy_version 684658 (0.0011) [2023-12-26 05:03:18,907][123091] Updated weights for policy 0, policy_version 684668 (0.0011) [2023-12-26 05:03:18,956][123091] Updated weights for policy 0, policy_version 684678 (0.0011) [2023-12-26 05:03:19,003][123091] Updated weights for policy 0, policy_version 684688 (0.0011) [2023-12-26 05:03:19,505][123090] Updated weights for policy 1, policy_version 680196 (0.0010) [2023-12-26 05:03:19,579][123090] Updated weights for policy 1, policy_version 680206 (0.0008) [2023-12-26 05:03:19,628][123090] Updated weights for policy 1, policy_version 680216 (0.0010) [2023-12-26 05:03:19,887][123091] Updated weights for policy 0, policy_version 684698 (0.0010) [2023-12-26 05:03:19,954][123091] Updated weights for policy 0, policy_version 684708 (0.0010) [2023-12-26 05:03:20,020][123091] Updated weights for policy 0, policy_version 684718 (0.0010) [2023-12-26 05:03:20,488][123090] Updated weights for policy 1, policy_version 680226 (0.0010) [2023-12-26 05:03:20,536][123090] Updated weights for policy 1, policy_version 680236 (0.0009) [2023-12-26 05:03:20,601][123090] Updated weights for policy 1, policy_version 680246 (0.0009) [2023-12-26 05:03:20,667][123090] Updated weights for policy 1, policy_version 680256 (0.0009) [2023-12-26 05:03:20,832][123091] Updated weights for policy 0, policy_version 684728 (0.0011) [2023-12-26 05:03:20,889][123091] Updated weights for policy 0, policy_version 684738 (0.0011) [2023-12-26 05:03:20,947][123091] Updated weights for policy 0, policy_version 684748 (0.0010) [2023-12-26 05:03:21,516][123090] Updated weights for policy 1, policy_version 680266 (0.0009) [2023-12-26 05:03:21,581][123090] Updated weights for policy 1, policy_version 680276 (0.0009) [2023-12-26 05:03:21,651][123090] Updated weights for policy 1, policy_version 680286 (0.0008) [2023-12-26 05:03:21,813][123091] Updated weights for policy 0, policy_version 684758 (0.0009) [2023-12-26 05:03:21,885][123091] Updated weights for policy 0, policy_version 684768 (0.0011) [2023-12-26 05:03:21,955][123091] Updated weights for policy 0, policy_version 684778 (0.0011) [2023-12-26 05:03:22,487][123090] Updated weights for policy 1, policy_version 680296 (0.0009) [2023-12-26 05:03:22,545][123090] Updated weights for policy 1, policy_version 680306 (0.0010) [2023-12-26 05:03:22,603][123090] Updated weights for policy 1, policy_version 680316 (0.0010) [2023-12-26 05:03:22,741][123091] Updated weights for policy 0, policy_version 684788 (0.0009) [2023-12-26 05:03:22,802][123091] Updated weights for policy 0, policy_version 684798 (0.0006) [2023-12-26 05:03:22,859][123091] Updated weights for policy 0, policy_version 684808 (0.0006) [2023-12-26 05:03:23,508][123090] Updated weights for policy 1, policy_version 680326 (0.0007) [2023-12-26 05:03:23,577][123090] Updated weights for policy 1, policy_version 680336 (0.0005) [2023-12-26 05:03:23,621][123091] Updated weights for policy 0, policy_version 684818 (0.0007) [2023-12-26 05:03:23,642][123090] Updated weights for policy 1, policy_version 680346 (0.0006) [2023-12-26 05:03:23,689][123091] Updated weights for policy 0, policy_version 684828 (0.0008) [2023-12-26 05:03:23,753][123091] Updated weights for policy 0, policy_version 684838 (0.0008) [2023-12-26 05:03:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 349487104. Throughput: 0: 8928.4, 1: 8836.0. Samples: 349465200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:23,785][121949] Avg episode reward: [(0, '5748.691'), (1, '5671.688')] [2023-12-26 05:03:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000680352_174170112.pth... [2023-12-26 05:03:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000679296_173899776.pth [2023-12-26 05:03:23,819][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000684848_175325184.pth... [2023-12-26 05:03:23,822][123091] Updated weights for policy 0, policy_version 684848 (0.0007) [2023-12-26 05:03:23,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000683792_175054848.pth [2023-12-26 05:03:24,431][123090] Updated weights for policy 1, policy_version 680356 (0.0005) [2023-12-26 05:03:24,492][123090] Updated weights for policy 1, policy_version 680366 (0.0006) [2023-12-26 05:03:24,547][123091] Updated weights for policy 0, policy_version 684858 (0.0009) [2023-12-26 05:03:24,563][123090] Updated weights for policy 1, policy_version 680376 (0.0005) [2023-12-26 05:03:24,614][123091] Updated weights for policy 0, policy_version 684868 (0.0009) [2023-12-26 05:03:24,682][123091] Updated weights for policy 0, policy_version 684878 (0.0008) [2023-12-26 05:03:25,178][123090] Updated weights for policy 1, policy_version 680386 (0.0005) [2023-12-26 05:03:25,253][123090] Updated weights for policy 1, policy_version 680396 (0.0005) [2023-12-26 05:03:25,317][123090] Updated weights for policy 1, policy_version 680406 (0.0005) [2023-12-26 05:03:25,364][123091] Updated weights for policy 0, policy_version 684888 (0.0006) [2023-12-26 05:03:25,372][123090] Updated weights for policy 1, policy_version 680416 (0.0005) [2023-12-26 05:03:25,422][123091] Updated weights for policy 0, policy_version 684898 (0.0005) [2023-12-26 05:03:25,482][123091] Updated weights for policy 0, policy_version 684908 (0.0009) [2023-12-26 05:03:26,009][123090] Updated weights for policy 1, policy_version 680426 (0.0007) [2023-12-26 05:03:26,060][123090] Updated weights for policy 1, policy_version 680436 (0.0010) [2023-12-26 05:03:26,118][123090] Updated weights for policy 1, policy_version 680446 (0.0010) [2023-12-26 05:03:26,276][123091] Updated weights for policy 0, policy_version 684918 (0.0010) [2023-12-26 05:03:26,319][123091] Updated weights for policy 0, policy_version 684928 (0.0010) [2023-12-26 05:03:26,375][123091] Updated weights for policy 0, policy_version 684938 (0.0011) [2023-12-26 05:03:26,831][123090] Updated weights for policy 1, policy_version 680456 (0.0006) [2023-12-26 05:03:26,888][123090] Updated weights for policy 1, policy_version 680466 (0.0007) [2023-12-26 05:03:26,951][123090] Updated weights for policy 1, policy_version 680476 (0.0007) [2023-12-26 05:03:27,219][123091] Updated weights for policy 0, policy_version 684948 (0.0011) [2023-12-26 05:03:27,285][123091] Updated weights for policy 0, policy_version 684958 (0.0010) [2023-12-26 05:03:27,349][123091] Updated weights for policy 0, policy_version 684968 (0.0009) [2023-12-26 05:03:27,659][123090] Updated weights for policy 1, policy_version 680486 (0.0008) [2023-12-26 05:03:27,725][123090] Updated weights for policy 1, policy_version 680496 (0.0010) [2023-12-26 05:03:27,801][123090] Updated weights for policy 1, policy_version 680506 (0.0010) [2023-12-26 05:03:28,012][123091] Updated weights for policy 0, policy_version 684978 (0.0005) [2023-12-26 05:03:28,085][123091] Updated weights for policy 0, policy_version 684988 (0.0007) [2023-12-26 05:03:28,154][123091] Updated weights for policy 0, policy_version 684998 (0.0011) [2023-12-26 05:03:28,220][123091] Updated weights for policy 0, policy_version 685008 (0.0010) [2023-12-26 05:03:28,572][123090] Updated weights for policy 1, policy_version 680516 (0.0008) [2023-12-26 05:03:28,633][123090] Updated weights for policy 1, policy_version 680526 (0.0005) [2023-12-26 05:03:28,694][123090] Updated weights for policy 1, policy_version 680536 (0.0005) [2023-12-26 05:03:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 349585408. Throughput: 0: 8964.9, 1: 8986.3. Samples: 349576300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:28,785][121949] Avg episode reward: [(0, '6030.982'), (1, '5712.209')] [2023-12-26 05:03:29,007][123091] Updated weights for policy 0, policy_version 685018 (0.0010) [2023-12-26 05:03:29,055][123091] Updated weights for policy 0, policy_version 685028 (0.0010) [2023-12-26 05:03:29,106][123091] Updated weights for policy 0, policy_version 685038 (0.0010) [2023-12-26 05:03:29,361][123090] Updated weights for policy 1, policy_version 680546 (0.0010) [2023-12-26 05:03:29,436][123090] Updated weights for policy 1, policy_version 680556 (0.0010) [2023-12-26 05:03:29,516][123090] Updated weights for policy 1, policy_version 680566 (0.0010) [2023-12-26 05:03:29,943][123091] Updated weights for policy 0, policy_version 685048 (0.0011) [2023-12-26 05:03:30,006][123091] Updated weights for policy 0, policy_version 685058 (0.0010) [2023-12-26 05:03:30,065][123091] Updated weights for policy 0, policy_version 685068 (0.0010) [2023-12-26 05:03:30,345][123090] Updated weights for policy 1, policy_version 680577 (0.0007) [2023-12-26 05:03:30,404][123090] Updated weights for policy 1, policy_version 680587 (0.0010) [2023-12-26 05:03:30,456][123090] Updated weights for policy 1, policy_version 680597 (0.0009) [2023-12-26 05:03:30,515][123090] Updated weights for policy 1, policy_version 680608 (0.0011) [2023-12-26 05:03:30,737][123091] Updated weights for policy 0, policy_version 685078 (0.0007) [2023-12-26 05:03:30,785][123091] Updated weights for policy 0, policy_version 685088 (0.0005) [2023-12-26 05:03:30,845][123091] Updated weights for policy 0, policy_version 685098 (0.0006) [2023-12-26 05:03:31,459][123090] Updated weights for policy 1, policy_version 680618 (0.0010) [2023-12-26 05:03:31,514][123090] Updated weights for policy 1, policy_version 680628 (0.0010) [2023-12-26 05:03:31,570][123090] Updated weights for policy 1, policy_version 680638 (0.0010) [2023-12-26 05:03:31,581][123091] Updated weights for policy 0, policy_version 685108 (0.0005) [2023-12-26 05:03:31,652][123091] Updated weights for policy 0, policy_version 685118 (0.0006) [2023-12-26 05:03:31,701][123091] Updated weights for policy 0, policy_version 685128 (0.0005) [2023-12-26 05:03:32,449][123090] Updated weights for policy 1, policy_version 680648 (0.0011) [2023-12-26 05:03:32,512][123091] Updated weights for policy 0, policy_version 685139 (0.0008) [2023-12-26 05:03:32,514][123090] Updated weights for policy 1, policy_version 680658 (0.0009) [2023-12-26 05:03:32,570][123090] Updated weights for policy 1, policy_version 680668 (0.0005) [2023-12-26 05:03:32,571][123091] Updated weights for policy 0, policy_version 685149 (0.0010) [2023-12-26 05:03:32,629][123091] Updated weights for policy 0, policy_version 685159 (0.0010) [2023-12-26 05:03:33,343][123090] Updated weights for policy 1, policy_version 680678 (0.0009) [2023-12-26 05:03:33,345][123091] Updated weights for policy 0, policy_version 685169 (0.0010) [2023-12-26 05:03:33,395][123090] Updated weights for policy 1, policy_version 680688 (0.0009) [2023-12-26 05:03:33,400][123091] Updated weights for policy 0, policy_version 685179 (0.0005) [2023-12-26 05:03:33,444][123090] Updated weights for policy 1, policy_version 680698 (0.0009) [2023-12-26 05:03:33,454][123091] Updated weights for policy 0, policy_version 685189 (0.0005) [2023-12-26 05:03:33,502][123091] Updated weights for policy 0, policy_version 685199 (0.0005) [2023-12-26 05:03:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 349675520. Throughput: 0: 9049.8, 1: 8888.7. Samples: 349685412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:33,785][121949] Avg episode reward: [(0, '6064.259'), (1, '5763.695')] [2023-12-26 05:03:34,059][123091] Updated weights for policy 0, policy_version 685209 (0.0005) [2023-12-26 05:03:34,108][123091] Updated weights for policy 0, policy_version 685219 (0.0005) [2023-12-26 05:03:34,165][123091] Updated weights for policy 0, policy_version 685229 (0.0007) [2023-12-26 05:03:34,404][123090] Updated weights for policy 1, policy_version 680708 (0.0010) [2023-12-26 05:03:34,456][123090] Updated weights for policy 1, policy_version 680718 (0.0009) [2023-12-26 05:03:34,527][123090] Updated weights for policy 1, policy_version 680728 (0.0009) [2023-12-26 05:03:34,859][123091] Updated weights for policy 0, policy_version 685239 (0.0006) [2023-12-26 05:03:34,924][123091] Updated weights for policy 0, policy_version 685249 (0.0006) [2023-12-26 05:03:35,001][123091] Updated weights for policy 0, policy_version 685259 (0.0007) [2023-12-26 05:03:35,255][123090] Updated weights for policy 1, policy_version 680738 (0.0010) [2023-12-26 05:03:35,325][123090] Updated weights for policy 1, policy_version 680748 (0.0006) [2023-12-26 05:03:35,395][123090] Updated weights for policy 1, policy_version 680758 (0.0006) [2023-12-26 05:03:35,465][123090] Updated weights for policy 1, policy_version 680768 (0.0008) [2023-12-26 05:03:35,775][123091] Updated weights for policy 0, policy_version 685269 (0.0008) [2023-12-26 05:03:35,833][123091] Updated weights for policy 0, policy_version 685279 (0.0010) [2023-12-26 05:03:35,884][123091] Updated weights for policy 0, policy_version 685289 (0.0010) [2023-12-26 05:03:36,263][123090] Updated weights for policy 1, policy_version 680778 (0.0007) [2023-12-26 05:03:36,317][123090] Updated weights for policy 1, policy_version 680788 (0.0010) [2023-12-26 05:03:36,371][123090] Updated weights for policy 1, policy_version 680798 (0.0010) [2023-12-26 05:03:36,567][123091] Updated weights for policy 0, policy_version 685299 (0.0009) [2023-12-26 05:03:36,626][123091] Updated weights for policy 0, policy_version 685309 (0.0005) [2023-12-26 05:03:36,684][123091] Updated weights for policy 0, policy_version 685319 (0.0007) [2023-12-26 05:03:37,238][123090] Updated weights for policy 1, policy_version 680808 (0.0008) [2023-12-26 05:03:37,303][123090] Updated weights for policy 1, policy_version 680818 (0.0005) [2023-12-26 05:03:37,361][123090] Updated weights for policy 1, policy_version 680828 (0.0006) [2023-12-26 05:03:37,491][123091] Updated weights for policy 0, policy_version 685329 (0.0011) [2023-12-26 05:03:37,539][123091] Updated weights for policy 0, policy_version 685339 (0.0010) [2023-12-26 05:03:37,587][123091] Updated weights for policy 0, policy_version 685349 (0.0010) [2023-12-26 05:03:37,636][123091] Updated weights for policy 0, policy_version 685359 (0.0010) [2023-12-26 05:03:38,047][123090] Updated weights for policy 1, policy_version 680838 (0.0007) [2023-12-26 05:03:38,095][123090] Updated weights for policy 1, policy_version 680848 (0.0009) [2023-12-26 05:03:38,148][123090] Updated weights for policy 1, policy_version 680858 (0.0008) [2023-12-26 05:03:38,452][123091] Updated weights for policy 0, policy_version 685369 (0.0011) [2023-12-26 05:03:38,512][123091] Updated weights for policy 0, policy_version 685379 (0.0011) [2023-12-26 05:03:38,569][123091] Updated weights for policy 0, policy_version 685389 (0.0011) [2023-12-26 05:03:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 349765632. Throughput: 0: 9064.7, 1: 8882.6. Samples: 349739436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:38,785][121949] Avg episode reward: [(0, '5923.884'), (1, '5896.285')] [2023-12-26 05:03:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000685392_175464448.pth... [2023-12-26 05:03:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000680864_174301184.pth... [2023-12-26 05:03:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000679808_174030848.pth [2023-12-26 05:03:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000684336_175194112.pth [2023-12-26 05:03:39,013][123090] Updated weights for policy 1, policy_version 680868 (0.0010) [2023-12-26 05:03:39,076][123090] Updated weights for policy 1, policy_version 680878 (0.0010) [2023-12-26 05:03:39,135][123090] Updated weights for policy 1, policy_version 680888 (0.0010) [2023-12-26 05:03:39,416][123091] Updated weights for policy 0, policy_version 685399 (0.0011) [2023-12-26 05:03:39,477][123091] Updated weights for policy 0, policy_version 685409 (0.0007) [2023-12-26 05:03:39,541][123091] Updated weights for policy 0, policy_version 685419 (0.0011) [2023-12-26 05:03:40,010][123090] Updated weights for policy 1, policy_version 680898 (0.0010) [2023-12-26 05:03:40,083][123090] Updated weights for policy 1, policy_version 680908 (0.0011) [2023-12-26 05:03:40,151][123090] Updated weights for policy 1, policy_version 680918 (0.0010) [2023-12-26 05:03:40,226][123090] Updated weights for policy 1, policy_version 680928 (0.0011) [2023-12-26 05:03:40,340][123091] Updated weights for policy 0, policy_version 685429 (0.0010) [2023-12-26 05:03:40,400][123091] Updated weights for policy 0, policy_version 685439 (0.0009) [2023-12-26 05:03:40,461][123091] Updated weights for policy 0, policy_version 685449 (0.0009) [2023-12-26 05:03:41,055][123090] Updated weights for policy 1, policy_version 680938 (0.0009) [2023-12-26 05:03:41,125][123090] Updated weights for policy 1, policy_version 680948 (0.0009) [2023-12-26 05:03:41,185][123090] Updated weights for policy 1, policy_version 680958 (0.0010) [2023-12-26 05:03:41,295][123091] Updated weights for policy 0, policy_version 685459 (0.0008) [2023-12-26 05:03:41,359][123091] Updated weights for policy 0, policy_version 685469 (0.0006) [2023-12-26 05:03:41,426][123091] Updated weights for policy 0, policy_version 685479 (0.0007) [2023-12-26 05:03:42,096][123090] Updated weights for policy 1, policy_version 680968 (0.0010) [2023-12-26 05:03:42,162][123090] Updated weights for policy 1, policy_version 680978 (0.0008) [2023-12-26 05:03:42,179][123091] Updated weights for policy 0, policy_version 685489 (0.0007) [2023-12-26 05:03:42,225][123090] Updated weights for policy 1, policy_version 680988 (0.0008) [2023-12-26 05:03:42,239][123091] Updated weights for policy 0, policy_version 685499 (0.0011) [2023-12-26 05:03:42,312][123091] Updated weights for policy 0, policy_version 685509 (0.0007) [2023-12-26 05:03:42,384][123091] Updated weights for policy 0, policy_version 685519 (0.0010) [2023-12-26 05:03:42,988][123090] Updated weights for policy 1, policy_version 680998 (0.0006) [2023-12-26 05:03:43,058][123090] Updated weights for policy 1, policy_version 681008 (0.0007) [2023-12-26 05:03:43,113][123090] Updated weights for policy 1, policy_version 681018 (0.0007) [2023-12-26 05:03:43,216][123091] Updated weights for policy 0, policy_version 685529 (0.0009) [2023-12-26 05:03:43,286][123091] Updated weights for policy 0, policy_version 685539 (0.0010) [2023-12-26 05:03:43,347][123091] Updated weights for policy 0, policy_version 685549 (0.0010) [2023-12-26 05:03:43,693][123090] Updated weights for policy 1, policy_version 681028 (0.0005) [2023-12-26 05:03:43,755][123090] Updated weights for policy 1, policy_version 681038 (0.0005) [2023-12-26 05:03:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 349847552. Throughput: 0: 8958.8, 1: 8822.8. Samples: 349842072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:43,785][121949] Avg episode reward: [(0, '5890.902'), (1, '5898.309')] [2023-12-26 05:03:43,818][123090] Updated weights for policy 1, policy_version 681048 (0.0005) [2023-12-26 05:03:44,092][123091] Updated weights for policy 0, policy_version 685559 (0.0007) [2023-12-26 05:03:44,159][123091] Updated weights for policy 0, policy_version 685569 (0.0005) [2023-12-26 05:03:44,216][123091] Updated weights for policy 0, policy_version 685579 (0.0005) [2023-12-26 05:03:44,442][123090] Updated weights for policy 1, policy_version 681058 (0.0005) [2023-12-26 05:03:44,494][123090] Updated weights for policy 1, policy_version 681068 (0.0009) [2023-12-26 05:03:44,542][123090] Updated weights for policy 1, policy_version 681078 (0.0010) [2023-12-26 05:03:44,586][123090] Updated weights for policy 1, policy_version 681088 (0.0010) [2023-12-26 05:03:44,870][123091] Updated weights for policy 0, policy_version 685589 (0.0006) [2023-12-26 05:03:44,943][123091] Updated weights for policy 0, policy_version 685599 (0.0007) [2023-12-26 05:03:45,008][123091] Updated weights for policy 0, policy_version 685609 (0.0008) [2023-12-26 05:03:45,413][123090] Updated weights for policy 1, policy_version 681098 (0.0006) [2023-12-26 05:03:45,479][123090] Updated weights for policy 1, policy_version 681108 (0.0006) [2023-12-26 05:03:45,529][123090] Updated weights for policy 1, policy_version 681118 (0.0006) [2023-12-26 05:03:45,776][123091] Updated weights for policy 0, policy_version 685619 (0.0008) [2023-12-26 05:03:45,853][123091] Updated weights for policy 0, policy_version 685629 (0.0006) [2023-12-26 05:03:45,924][123091] Updated weights for policy 0, policy_version 685639 (0.0006) [2023-12-26 05:03:46,282][123090] Updated weights for policy 1, policy_version 681128 (0.0006) [2023-12-26 05:03:46,337][123090] Updated weights for policy 1, policy_version 681138 (0.0006) [2023-12-26 05:03:46,394][123090] Updated weights for policy 1, policy_version 681148 (0.0006) [2023-12-26 05:03:46,641][123091] Updated weights for policy 0, policy_version 685649 (0.0005) [2023-12-26 05:03:46,706][123091] Updated weights for policy 0, policy_version 685659 (0.0006) [2023-12-26 05:03:46,779][123091] Updated weights for policy 0, policy_version 685669 (0.0005) [2023-12-26 05:03:46,853][123091] Updated weights for policy 0, policy_version 685679 (0.0005) [2023-12-26 05:03:47,209][123090] Updated weights for policy 1, policy_version 681158 (0.0008) [2023-12-26 05:03:47,256][123090] Updated weights for policy 1, policy_version 681168 (0.0010) [2023-12-26 05:03:47,314][123090] Updated weights for policy 1, policy_version 681178 (0.0010) [2023-12-26 05:03:47,583][123091] Updated weights for policy 0, policy_version 685689 (0.0008) [2023-12-26 05:03:47,638][123091] Updated weights for policy 0, policy_version 685699 (0.0009) [2023-12-26 05:03:47,695][123091] Updated weights for policy 0, policy_version 685709 (0.0009) [2023-12-26 05:03:48,124][123090] Updated weights for policy 1, policy_version 681188 (0.0010) [2023-12-26 05:03:48,185][123090] Updated weights for policy 1, policy_version 681198 (0.0009) [2023-12-26 05:03:48,236][123090] Updated weights for policy 1, policy_version 681208 (0.0007) [2023-12-26 05:03:48,559][123091] Updated weights for policy 0, policy_version 685719 (0.0009) [2023-12-26 05:03:48,632][123091] Updated weights for policy 0, policy_version 685729 (0.0005) [2023-12-26 05:03:48,707][123091] Updated weights for policy 0, policy_version 685739 (0.0005) [2023-12-26 05:03:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 349945856. Throughput: 0: 9048.4, 1: 8889.3. Samples: 349954412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:48,785][121949] Avg episode reward: [(0, '5727.980'), (1, '5903.018')] [2023-12-26 05:03:49,011][123090] Updated weights for policy 1, policy_version 681218 (0.0006) [2023-12-26 05:03:49,062][123090] Updated weights for policy 1, policy_version 681228 (0.0009) [2023-12-26 05:03:49,127][123090] Updated weights for policy 1, policy_version 681238 (0.0010) [2023-12-26 05:03:49,183][123090] Updated weights for policy 1, policy_version 681248 (0.0009) [2023-12-26 05:03:49,497][123091] Updated weights for policy 0, policy_version 685749 (0.0008) [2023-12-26 05:03:49,547][123091] Updated weights for policy 0, policy_version 685759 (0.0009) [2023-12-26 05:03:49,613][123091] Updated weights for policy 0, policy_version 685769 (0.0009) [2023-12-26 05:03:50,080][123090] Updated weights for policy 1, policy_version 681258 (0.0010) [2023-12-26 05:03:50,143][123090] Updated weights for policy 1, policy_version 681268 (0.0010) [2023-12-26 05:03:50,209][123090] Updated weights for policy 1, policy_version 681278 (0.0009) [2023-12-26 05:03:50,500][123091] Updated weights for policy 0, policy_version 685779 (0.0009) [2023-12-26 05:03:50,565][123091] Updated weights for policy 0, policy_version 685789 (0.0010) [2023-12-26 05:03:50,633][123091] Updated weights for policy 0, policy_version 685799 (0.0010) [2023-12-26 05:03:51,080][123090] Updated weights for policy 1, policy_version 681288 (0.0009) [2023-12-26 05:03:51,150][123090] Updated weights for policy 1, policy_version 681298 (0.0009) [2023-12-26 05:03:51,214][123090] Updated weights for policy 1, policy_version 681308 (0.0009) [2023-12-26 05:03:51,470][123091] Updated weights for policy 0, policy_version 685809 (0.0010) [2023-12-26 05:03:51,529][123091] Updated weights for policy 0, policy_version 685819 (0.0010) [2023-12-26 05:03:51,584][123091] Updated weights for policy 0, policy_version 685829 (0.0010) [2023-12-26 05:03:51,651][123091] Updated weights for policy 0, policy_version 685839 (0.0010) [2023-12-26 05:03:52,052][123090] Updated weights for policy 1, policy_version 681318 (0.0009) [2023-12-26 05:03:52,106][123090] Updated weights for policy 1, policy_version 681328 (0.0010) [2023-12-26 05:03:52,161][123090] Updated weights for policy 1, policy_version 681338 (0.0010) [2023-12-26 05:03:52,417][123091] Updated weights for policy 0, policy_version 685849 (0.0007) [2023-12-26 05:03:52,480][123091] Updated weights for policy 0, policy_version 685859 (0.0006) [2023-12-26 05:03:52,552][123091] Updated weights for policy 0, policy_version 685869 (0.0007) [2023-12-26 05:03:53,067][123090] Updated weights for policy 1, policy_version 681348 (0.0010) [2023-12-26 05:03:53,127][123090] Updated weights for policy 1, policy_version 681358 (0.0009) [2023-12-26 05:03:53,200][123090] Updated weights for policy 1, policy_version 681368 (0.0010) [2023-12-26 05:03:53,336][123091] Updated weights for policy 0, policy_version 685879 (0.0010) [2023-12-26 05:03:53,385][123091] Updated weights for policy 0, policy_version 685889 (0.0009) [2023-12-26 05:03:53,428][123091] Updated weights for policy 0, policy_version 685899 (0.0007) [2023-12-26 05:03:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 350027776. Throughput: 0: 8979.3, 1: 8897.7. Samples: 350004624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:53,785][121949] Avg episode reward: [(0, '5831.203'), (1, '5902.284')] [2023-12-26 05:03:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000685904_175595520.pth... [2023-12-26 05:03:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000681376_174432256.pth... [2023-12-26 05:03:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000680352_174170112.pth [2023-12-26 05:03:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000684848_175325184.pth [2023-12-26 05:03:54,036][123090] Updated weights for policy 1, policy_version 681378 (0.0008) [2023-12-26 05:03:54,091][123090] Updated weights for policy 1, policy_version 681388 (0.0010) [2023-12-26 05:03:54,140][123090] Updated weights for policy 1, policy_version 681398 (0.0010) [2023-12-26 05:03:54,194][123091] Updated weights for policy 0, policy_version 685909 (0.0005) [2023-12-26 05:03:54,199][123090] Updated weights for policy 1, policy_version 681408 (0.0010) [2023-12-26 05:03:54,241][123091] Updated weights for policy 0, policy_version 685919 (0.0005) [2023-12-26 05:03:54,294][123091] Updated weights for policy 0, policy_version 685929 (0.0005) [2023-12-26 05:03:54,911][123090] Updated weights for policy 1, policy_version 681418 (0.0005) [2023-12-26 05:03:54,964][123091] Updated weights for policy 0, policy_version 685939 (0.0005) [2023-12-26 05:03:54,970][123090] Updated weights for policy 1, policy_version 681428 (0.0006) [2023-12-26 05:03:55,021][123091] Updated weights for policy 0, policy_version 685949 (0.0006) [2023-12-26 05:03:55,026][123090] Updated weights for policy 1, policy_version 681438 (0.0006) [2023-12-26 05:03:55,068][123091] Updated weights for policy 0, policy_version 685959 (0.0008) [2023-12-26 05:03:55,661][123090] Updated weights for policy 1, policy_version 681448 (0.0005) [2023-12-26 05:03:55,724][123090] Updated weights for policy 1, policy_version 681458 (0.0008) [2023-12-26 05:03:55,776][123090] Updated weights for policy 1, policy_version 681468 (0.0008) [2023-12-26 05:03:55,882][123091] Updated weights for policy 0, policy_version 685969 (0.0006) [2023-12-26 05:03:55,954][123091] Updated weights for policy 0, policy_version 685979 (0.0008) [2023-12-26 05:03:56,023][123091] Updated weights for policy 0, policy_version 685989 (0.0007) [2023-12-26 05:03:56,086][123091] Updated weights for policy 0, policy_version 685999 (0.0007) [2023-12-26 05:03:56,623][123090] Updated weights for policy 1, policy_version 681478 (0.0009) [2023-12-26 05:03:56,681][123090] Updated weights for policy 1, policy_version 681488 (0.0009) [2023-12-26 05:03:56,685][123091] Updated weights for policy 0, policy_version 686009 (0.0008) [2023-12-26 05:03:56,734][123090] Updated weights for policy 1, policy_version 681498 (0.0009) [2023-12-26 05:03:56,755][123091] Updated weights for policy 0, policy_version 686019 (0.0007) [2023-12-26 05:03:56,815][123091] Updated weights for policy 0, policy_version 686029 (0.0006) [2023-12-26 05:03:57,503][123090] Updated weights for policy 1, policy_version 681508 (0.0008) [2023-12-26 05:03:57,568][123090] Updated weights for policy 1, policy_version 681518 (0.0006) [2023-12-26 05:03:57,617][123091] Updated weights for policy 0, policy_version 686039 (0.0009) [2023-12-26 05:03:57,634][123090] Updated weights for policy 1, policy_version 681528 (0.0007) [2023-12-26 05:03:57,682][123091] Updated weights for policy 0, policy_version 686049 (0.0010) [2023-12-26 05:03:57,743][123091] Updated weights for policy 0, policy_version 686059 (0.0010) [2023-12-26 05:03:58,423][123090] Updated weights for policy 1, policy_version 681538 (0.0007) [2023-12-26 05:03:58,496][123090] Updated weights for policy 1, policy_version 681548 (0.0008) [2023-12-26 05:03:58,561][123090] Updated weights for policy 1, policy_version 681558 (0.0008) [2023-12-26 05:03:58,591][123091] Updated weights for policy 0, policy_version 686069 (0.0009) [2023-12-26 05:03:58,631][123090] Updated weights for policy 1, policy_version 681568 (0.0009) [2023-12-26 05:03:58,665][123091] Updated weights for policy 0, policy_version 686080 (0.0007) [2023-12-26 05:03:58,734][123091] Updated weights for policy 0, policy_version 686090 (0.0010) [2023-12-26 05:03:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 350126080. Throughput: 0: 9072.2, 1: 8951.2. Samples: 350114364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:03:58,785][121949] Avg episode reward: [(0, '5875.643'), (1, '5851.956')] [2023-12-26 05:03:59,504][123091] Updated weights for policy 0, policy_version 686100 (0.0008) [2023-12-26 05:03:59,531][123090] Updated weights for policy 1, policy_version 681578 (0.0006) [2023-12-26 05:03:59,569][123091] Updated weights for policy 0, policy_version 686110 (0.0011) [2023-12-26 05:03:59,593][123090] Updated weights for policy 1, policy_version 681588 (0.0006) [2023-12-26 05:03:59,626][123091] Updated weights for policy 0, policy_version 686120 (0.0007) [2023-12-26 05:03:59,654][123090] Updated weights for policy 1, policy_version 681598 (0.0009) [2023-12-26 05:04:00,390][123091] Updated weights for policy 0, policy_version 686130 (0.0006) [2023-12-26 05:04:00,453][123091] Updated weights for policy 0, policy_version 686140 (0.0010) [2023-12-26 05:04:00,469][123090] Updated weights for policy 1, policy_version 681608 (0.0007) [2023-12-26 05:04:00,515][123091] Updated weights for policy 0, policy_version 686150 (0.0011) [2023-12-26 05:04:00,522][123090] Updated weights for policy 1, policy_version 681618 (0.0008) [2023-12-26 05:04:00,571][123090] Updated weights for policy 1, policy_version 681628 (0.0008) [2023-12-26 05:04:00,577][123091] Updated weights for policy 0, policy_version 686160 (0.0010) [2023-12-26 05:04:01,406][123091] Updated weights for policy 0, policy_version 686170 (0.0009) [2023-12-26 05:04:01,432][123090] Updated weights for policy 1, policy_version 681638 (0.0006) [2023-12-26 05:04:01,455][123091] Updated weights for policy 0, policy_version 686180 (0.0008) [2023-12-26 05:04:01,481][123090] Updated weights for policy 1, policy_version 681648 (0.0005) [2023-12-26 05:04:01,507][123091] Updated weights for policy 0, policy_version 686190 (0.0009) [2023-12-26 05:04:01,539][123090] Updated weights for policy 1, policy_version 681658 (0.0007) [2023-12-26 05:04:02,309][123091] Updated weights for policy 0, policy_version 686200 (0.0006) [2023-12-26 05:04:02,374][123091] Updated weights for policy 0, policy_version 686210 (0.0007) [2023-12-26 05:04:02,403][123090] Updated weights for policy 1, policy_version 681668 (0.0008) [2023-12-26 05:04:02,430][123091] Updated weights for policy 0, policy_version 686220 (0.0006) [2023-12-26 05:04:02,460][123090] Updated weights for policy 1, policy_version 681678 (0.0009) [2023-12-26 05:04:02,517][123090] Updated weights for policy 1, policy_version 681688 (0.0009) [2023-12-26 05:04:03,016][123091] Updated weights for policy 0, policy_version 686230 (0.0006) [2023-12-26 05:04:03,076][123091] Updated weights for policy 0, policy_version 686240 (0.0005) [2023-12-26 05:04:03,127][123091] Updated weights for policy 0, policy_version 686250 (0.0009) [2023-12-26 05:04:03,427][123090] Updated weights for policy 1, policy_version 681699 (0.0010) [2023-12-26 05:04:03,482][123090] Updated weights for policy 1, policy_version 681709 (0.0009) [2023-12-26 05:04:03,530][123090] Updated weights for policy 1, policy_version 681719 (0.0009) [2023-12-26 05:04:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 350208000. Throughput: 0: 9092.7, 1: 8779.4. Samples: 350218476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:04:03,784][121949] Avg episode reward: [(0, '5739.008'), (1, '5803.759')] [2023-12-26 05:04:03,907][123091] Updated weights for policy 0, policy_version 686260 (0.0010) [2023-12-26 05:04:03,960][123091] Updated weights for policy 0, policy_version 686270 (0.0010) [2023-12-26 05:04:04,008][123091] Updated weights for policy 0, policy_version 686280 (0.0006) [2023-12-26 05:04:04,376][123090] Updated weights for policy 1, policy_version 681729 (0.0008) [2023-12-26 05:04:04,443][123090] Updated weights for policy 1, policy_version 681739 (0.0009) [2023-12-26 05:04:04,495][123090] Updated weights for policy 1, policy_version 681749 (0.0009) [2023-12-26 05:04:04,552][123090] Updated weights for policy 1, policy_version 681759 (0.0010) [2023-12-26 05:04:04,869][123091] Updated weights for policy 0, policy_version 686290 (0.0008) [2023-12-26 05:04:04,928][123091] Updated weights for policy 0, policy_version 686300 (0.0009) [2023-12-26 05:04:04,984][123091] Updated weights for policy 0, policy_version 686310 (0.0010) [2023-12-26 05:04:05,034][123091] Updated weights for policy 0, policy_version 686320 (0.0009) [2023-12-26 05:04:05,364][123090] Updated weights for policy 1, policy_version 681769 (0.0009) [2023-12-26 05:04:05,431][123090] Updated weights for policy 1, policy_version 681779 (0.0008) [2023-12-26 05:04:05,495][123090] Updated weights for policy 1, policy_version 681789 (0.0009) [2023-12-26 05:04:05,906][123091] Updated weights for policy 0, policy_version 686330 (0.0009) [2023-12-26 05:04:05,971][123091] Updated weights for policy 0, policy_version 686340 (0.0008) [2023-12-26 05:04:06,036][123091] Updated weights for policy 0, policy_version 686350 (0.0010) [2023-12-26 05:04:06,312][123090] Updated weights for policy 1, policy_version 681799 (0.0008) [2023-12-26 05:04:06,384][123090] Updated weights for policy 1, policy_version 681809 (0.0010) [2023-12-26 05:04:06,454][123090] Updated weights for policy 1, policy_version 681819 (0.0010) [2023-12-26 05:04:06,876][123091] Updated weights for policy 0, policy_version 686360 (0.0010) [2023-12-26 05:04:06,941][123091] Updated weights for policy 0, policy_version 686370 (0.0009) [2023-12-26 05:04:07,008][123091] Updated weights for policy 0, policy_version 686380 (0.0010) [2023-12-26 05:04:07,272][123090] Updated weights for policy 1, policy_version 681829 (0.0009) [2023-12-26 05:04:07,322][123090] Updated weights for policy 1, policy_version 681839 (0.0009) [2023-12-26 05:04:07,371][123090] Updated weights for policy 1, policy_version 681849 (0.0009) [2023-12-26 05:04:07,850][123091] Updated weights for policy 0, policy_version 686390 (0.0010) [2023-12-26 05:04:07,908][123091] Updated weights for policy 0, policy_version 686400 (0.0010) [2023-12-26 05:04:07,961][123091] Updated weights for policy 0, policy_version 686410 (0.0009) [2023-12-26 05:04:08,193][123090] Updated weights for policy 1, policy_version 681859 (0.0009) [2023-12-26 05:04:08,250][123090] Updated weights for policy 1, policy_version 681869 (0.0010) [2023-12-26 05:04:08,314][123090] Updated weights for policy 1, policy_version 681879 (0.0010) [2023-12-26 05:04:08,780][123091] Updated weights for policy 0, policy_version 686420 (0.0008) [2023-12-26 05:04:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 350289920. Throughput: 0: 9096.4, 1: 8775.5. Samples: 350269432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:04:08,785][121949] Avg episode reward: [(0, '5760.100'), (1, '5773.130')] [2023-12-26 05:04:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000681888_174563328.pth... [2023-12-26 05:04:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000680864_174301184.pth [2023-12-26 05:04:08,847][123091] Updated weights for policy 0, policy_version 686430 (0.0011) [2023-12-26 05:04:08,898][123091] Updated weights for policy 0, policy_version 686440 (0.0010) [2023-12-26 05:04:08,945][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000686448_175734784.pth... [2023-12-26 05:04:08,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000685392_175464448.pth [2023-12-26 05:04:09,133][123090] Updated weights for policy 1, policy_version 681889 (0.0010) [2023-12-26 05:04:09,188][123090] Updated weights for policy 1, policy_version 681899 (0.0005) [2023-12-26 05:04:09,255][123090] Updated weights for policy 1, policy_version 681909 (0.0007) [2023-12-26 05:04:09,332][123090] Updated weights for policy 1, policy_version 681919 (0.0008) [2023-12-26 05:04:09,702][123091] Updated weights for policy 0, policy_version 686450 (0.0010) [2023-12-26 05:04:09,765][123091] Updated weights for policy 0, policy_version 686460 (0.0008) [2023-12-26 05:04:09,835][123091] Updated weights for policy 0, policy_version 686470 (0.0008) [2023-12-26 05:04:09,909][123091] Updated weights for policy 0, policy_version 686480 (0.0007) [2023-12-26 05:04:10,095][123090] Updated weights for policy 1, policy_version 681929 (0.0008) [2023-12-26 05:04:10,161][123090] Updated weights for policy 1, policy_version 681939 (0.0008) [2023-12-26 05:04:10,231][123090] Updated weights for policy 1, policy_version 681949 (0.0009) [2023-12-26 05:04:10,703][123091] Updated weights for policy 0, policy_version 686490 (0.0005) [2023-12-26 05:04:10,763][123091] Updated weights for policy 0, policy_version 686500 (0.0005) [2023-12-26 05:04:10,812][123091] Updated weights for policy 0, policy_version 686510 (0.0005) [2023-12-26 05:04:11,036][123090] Updated weights for policy 1, policy_version 681959 (0.0007) [2023-12-26 05:04:11,110][123090] Updated weights for policy 1, policy_version 681969 (0.0007) [2023-12-26 05:04:11,176][123090] Updated weights for policy 1, policy_version 681979 (0.0008) [2023-12-26 05:04:11,581][123091] Updated weights for policy 0, policy_version 686520 (0.0009) [2023-12-26 05:04:11,653][123091] Updated weights for policy 0, policy_version 686530 (0.0009) [2023-12-26 05:04:11,721][123091] Updated weights for policy 0, policy_version 686540 (0.0009) [2023-12-26 05:04:11,970][123090] Updated weights for policy 1, policy_version 681989 (0.0009) [2023-12-26 05:04:12,025][123090] Updated weights for policy 1, policy_version 681999 (0.0009) [2023-12-26 05:04:12,077][123090] Updated weights for policy 1, policy_version 682009 (0.0009) [2023-12-26 05:04:12,546][123091] Updated weights for policy 0, policy_version 686550 (0.0008) [2023-12-26 05:04:12,610][123091] Updated weights for policy 0, policy_version 686560 (0.0008) [2023-12-26 05:04:12,669][123091] Updated weights for policy 0, policy_version 686570 (0.0008) [2023-12-26 05:04:12,998][123090] Updated weights for policy 1, policy_version 682019 (0.0009) [2023-12-26 05:04:13,059][123090] Updated weights for policy 1, policy_version 682029 (0.0009) [2023-12-26 05:04:13,116][123090] Updated weights for policy 1, policy_version 682039 (0.0010) [2023-12-26 05:04:13,485][123091] Updated weights for policy 0, policy_version 686580 (0.0009) [2023-12-26 05:04:13,556][123091] Updated weights for policy 0, policy_version 686590 (0.0009) [2023-12-26 05:04:13,619][123091] Updated weights for policy 0, policy_version 686600 (0.0009) [2023-12-26 05:04:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 350380032. Throughput: 0: 9046.7, 1: 8677.0. Samples: 350373864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:04:13,785][121949] Avg episode reward: [(0, '5818.541'), (1, '5779.781')] [2023-12-26 05:04:13,944][123090] Updated weights for policy 1, policy_version 682049 (0.0009) [2023-12-26 05:04:14,007][123090] Updated weights for policy 1, policy_version 682059 (0.0010) [2023-12-26 05:04:14,055][123090] Updated weights for policy 1, policy_version 682069 (0.0005) [2023-12-26 05:04:14,116][123090] Updated weights for policy 1, policy_version 682079 (0.0005) [2023-12-26 05:04:14,465][123091] Updated weights for policy 0, policy_version 686610 (0.0009) [2023-12-26 05:04:14,527][123091] Updated weights for policy 0, policy_version 686620 (0.0005) [2023-12-26 05:04:14,596][123091] Updated weights for policy 0, policy_version 686630 (0.0005) [2023-12-26 05:04:14,664][123091] Updated weights for policy 0, policy_version 686640 (0.0005) [2023-12-26 05:04:14,899][123090] Updated weights for policy 1, policy_version 682089 (0.0006) [2023-12-26 05:04:14,953][123090] Updated weights for policy 1, policy_version 682099 (0.0005) [2023-12-26 05:04:15,006][123090] Updated weights for policy 1, policy_version 682109 (0.0005) [2023-12-26 05:04:15,383][123091] Updated weights for policy 0, policy_version 686650 (0.0010) [2023-12-26 05:04:15,451][123091] Updated weights for policy 0, policy_version 686660 (0.0010) [2023-12-26 05:04:15,516][123091] Updated weights for policy 0, policy_version 686670 (0.0009) [2023-12-26 05:04:15,767][123090] Updated weights for policy 1, policy_version 682119 (0.0005) [2023-12-26 05:04:15,821][123090] Updated weights for policy 1, policy_version 682129 (0.0005) [2023-12-26 05:04:15,875][123090] Updated weights for policy 1, policy_version 682139 (0.0005) [2023-12-26 05:04:16,271][123091] Updated weights for policy 0, policy_version 686680 (0.0006) [2023-12-26 05:04:16,340][123091] Updated weights for policy 0, policy_version 686690 (0.0005) [2023-12-26 05:04:16,406][123091] Updated weights for policy 0, policy_version 686700 (0.0009) [2023-12-26 05:04:16,556][123090] Updated weights for policy 1, policy_version 682149 (0.0008) [2023-12-26 05:04:16,622][123090] Updated weights for policy 1, policy_version 682159 (0.0010) [2023-12-26 05:04:16,693][123090] Updated weights for policy 1, policy_version 682169 (0.0009) [2023-12-26 05:04:17,149][123091] Updated weights for policy 0, policy_version 686710 (0.0010) [2023-12-26 05:04:17,201][123091] Updated weights for policy 0, policy_version 686720 (0.0010) [2023-12-26 05:04:17,266][123091] Updated weights for policy 0, policy_version 686730 (0.0010) [2023-12-26 05:04:17,473][123090] Updated weights for policy 1, policy_version 682179 (0.0010) [2023-12-26 05:04:17,524][123090] Updated weights for policy 1, policy_version 682189 (0.0010) [2023-12-26 05:04:17,579][123090] Updated weights for policy 1, policy_version 682199 (0.0005) [2023-12-26 05:04:18,128][123091] Updated weights for policy 0, policy_version 686740 (0.0009) [2023-12-26 05:04:18,178][123091] Updated weights for policy 0, policy_version 686750 (0.0009) [2023-12-26 05:04:18,237][123091] Updated weights for policy 0, policy_version 686760 (0.0009) [2023-12-26 05:04:18,268][123090] Updated weights for policy 1, policy_version 682209 (0.0006) [2023-12-26 05:04:18,323][123090] Updated weights for policy 1, policy_version 682219 (0.0009) [2023-12-26 05:04:18,391][123090] Updated weights for policy 1, policy_version 682229 (0.0010) [2023-12-26 05:04:18,446][123090] Updated weights for policy 1, policy_version 682239 (0.0010) [2023-12-26 05:04:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 350470144. Throughput: 0: 8936.2, 1: 8736.3. Samples: 350480672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:04:18,784][121949] Avg episode reward: [(0, '6008.143'), (1, '5739.499')] [2023-12-26 05:04:19,056][123091] Updated weights for policy 0, policy_version 686770 (0.0009) [2023-12-26 05:04:19,120][123091] Updated weights for policy 0, policy_version 686780 (0.0009) [2023-12-26 05:04:19,185][123091] Updated weights for policy 0, policy_version 686790 (0.0009) [2023-12-26 05:04:19,257][123091] Updated weights for policy 0, policy_version 686800 (0.0010) [2023-12-26 05:04:19,331][123090] Updated weights for policy 1, policy_version 682249 (0.0009) [2023-12-26 05:04:19,399][123090] Updated weights for policy 1, policy_version 682259 (0.0009) [2023-12-26 05:04:19,465][123090] Updated weights for policy 1, policy_version 682269 (0.0009) [2023-12-26 05:04:20,173][123091] Updated weights for policy 0, policy_version 686810 (0.0009) [2023-12-26 05:04:20,239][123091] Updated weights for policy 0, policy_version 686820 (0.0009) [2023-12-26 05:04:20,254][123090] Updated weights for policy 1, policy_version 682279 (0.0009) [2023-12-26 05:04:20,306][123091] Updated weights for policy 0, policy_version 686830 (0.0008) [2023-12-26 05:04:20,316][123090] Updated weights for policy 1, policy_version 682289 (0.0007) [2023-12-26 05:04:20,386][123090] Updated weights for policy 1, policy_version 682299 (0.0009) [2023-12-26 05:04:21,159][123090] Updated weights for policy 1, policy_version 682309 (0.0009) [2023-12-26 05:04:21,195][123091] Updated weights for policy 0, policy_version 686840 (0.0010) [2023-12-26 05:04:21,223][123090] Updated weights for policy 1, policy_version 682319 (0.0007) [2023-12-26 05:04:21,262][123091] Updated weights for policy 0, policy_version 686850 (0.0008) [2023-12-26 05:04:21,290][123090] Updated weights for policy 1, policy_version 682329 (0.0008) [2023-12-26 05:04:21,323][123091] Updated weights for policy 0, policy_version 686860 (0.0009) [2023-12-26 05:04:22,148][123091] Updated weights for policy 0, policy_version 686870 (0.0009) [2023-12-26 05:04:22,177][123090] Updated weights for policy 1, policy_version 682339 (0.0007) [2023-12-26 05:04:22,202][123091] Updated weights for policy 0, policy_version 686880 (0.0008) [2023-12-26 05:04:22,245][123090] Updated weights for policy 1, policy_version 682349 (0.0008) [2023-12-26 05:04:22,276][123091] Updated weights for policy 0, policy_version 686890 (0.0009) [2023-12-26 05:04:22,317][123090] Updated weights for policy 1, policy_version 682359 (0.0007) [2023-12-26 05:04:23,002][123090] Updated weights for policy 1, policy_version 682369 (0.0007) [2023-12-26 05:04:23,073][123090] Updated weights for policy 1, policy_version 682379 (0.0007) [2023-12-26 05:04:23,135][123090] Updated weights for policy 1, policy_version 682389 (0.0010) [2023-12-26 05:04:23,160][123091] Updated weights for policy 0, policy_version 686900 (0.0009) [2023-12-26 05:04:23,202][123090] Updated weights for policy 1, policy_version 682399 (0.0008) [2023-12-26 05:04:23,227][123091] Updated weights for policy 0, policy_version 686910 (0.0010) [2023-12-26 05:04:23,277][123091] Updated weights for policy 0, policy_version 686920 (0.0009) [2023-12-26 05:04:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 350552064. Throughput: 0: 8852.2, 1: 8747.8. Samples: 350531440. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:23,786][121949] Avg episode reward: [(0, '6029.572'), (1, '5937.750')] [2023-12-26 05:04:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000686928_175857664.pth... [2023-12-26 05:04:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000682400_174694400.pth... [2023-12-26 05:04:23,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000685904_175595520.pth [2023-12-26 05:04:23,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000681376_174432256.pth [2023-12-26 05:04:23,986][123091] Updated weights for policy 0, policy_version 686930 (0.0009) [2023-12-26 05:04:24,015][123090] Updated weights for policy 1, policy_version 682409 (0.0007) [2023-12-26 05:04:24,039][123091] Updated weights for policy 0, policy_version 686940 (0.0009) [2023-12-26 05:04:24,076][123090] Updated weights for policy 1, policy_version 682419 (0.0008) [2023-12-26 05:04:24,099][123091] Updated weights for policy 0, policy_version 686950 (0.0009) [2023-12-26 05:04:24,139][123090] Updated weights for policy 1, policy_version 682429 (0.0008) [2023-12-26 05:04:24,163][123091] Updated weights for policy 0, policy_version 686960 (0.0009) [2023-12-26 05:04:24,866][123090] Updated weights for policy 1, policy_version 682439 (0.0010) [2023-12-26 05:04:24,923][123090] Updated weights for policy 1, policy_version 682449 (0.0009) [2023-12-26 05:04:24,980][123090] Updated weights for policy 1, policy_version 682459 (0.0008) [2023-12-26 05:04:24,982][123091] Updated weights for policy 0, policy_version 686970 (0.0009) [2023-12-26 05:04:25,039][123091] Updated weights for policy 0, policy_version 686980 (0.0010) [2023-12-26 05:04:25,097][123091] Updated weights for policy 0, policy_version 686990 (0.0010) [2023-12-26 05:04:25,838][123090] Updated weights for policy 1, policy_version 682469 (0.0007) [2023-12-26 05:04:25,896][123090] Updated weights for policy 1, policy_version 682479 (0.0005) [2023-12-26 05:04:25,904][123091] Updated weights for policy 0, policy_version 687000 (0.0009) [2023-12-26 05:04:25,949][123090] Updated weights for policy 1, policy_version 682489 (0.0006) [2023-12-26 05:04:25,955][123091] Updated weights for policy 0, policy_version 687010 (0.0009) [2023-12-26 05:04:26,004][123091] Updated weights for policy 0, policy_version 687020 (0.0009) [2023-12-26 05:04:26,599][123090] Updated weights for policy 1, policy_version 682499 (0.0008) [2023-12-26 05:04:26,654][123090] Updated weights for policy 1, policy_version 682509 (0.0010) [2023-12-26 05:04:26,717][123090] Updated weights for policy 1, policy_version 682519 (0.0010) [2023-12-26 05:04:26,884][123091] Updated weights for policy 0, policy_version 687030 (0.0009) [2023-12-26 05:04:26,938][123091] Updated weights for policy 0, policy_version 687040 (0.0009) [2023-12-26 05:04:26,990][123091] Updated weights for policy 0, policy_version 687050 (0.0009) [2023-12-26 05:04:27,476][123090] Updated weights for policy 1, policy_version 682529 (0.0010) [2023-12-26 05:04:27,523][123090] Updated weights for policy 1, policy_version 682539 (0.0010) [2023-12-26 05:04:27,585][123090] Updated weights for policy 1, policy_version 682549 (0.0010) [2023-12-26 05:04:27,641][123090] Updated weights for policy 1, policy_version 682559 (0.0010) [2023-12-26 05:04:27,895][123091] Updated weights for policy 0, policy_version 687060 (0.0010) [2023-12-26 05:04:27,949][123091] Updated weights for policy 0, policy_version 687072 (0.0011) [2023-12-26 05:04:28,006][123091] Updated weights for policy 0, policy_version 687082 (0.0010) [2023-12-26 05:04:28,341][123090] Updated weights for policy 1, policy_version 682569 (0.0007) [2023-12-26 05:04:28,411][123090] Updated weights for policy 1, policy_version 682579 (0.0009) [2023-12-26 05:04:28,470][123090] Updated weights for policy 1, policy_version 682589 (0.0011) [2023-12-26 05:04:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 350642176. Throughput: 0: 8821.3, 1: 8839.2. Samples: 350636792. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:28,785][121949] Avg episode reward: [(0, '6065.399'), (1, '5982.642')] [2023-12-26 05:04:28,915][123091] Updated weights for policy 0, policy_version 687092 (0.0010) [2023-12-26 05:04:28,976][123091] Updated weights for policy 0, policy_version 687102 (0.0010) [2023-12-26 05:04:29,045][123091] Updated weights for policy 0, policy_version 687112 (0.0010) [2023-12-26 05:04:29,150][123090] Updated weights for policy 1, policy_version 682599 (0.0008) [2023-12-26 05:04:29,224][123090] Updated weights for policy 1, policy_version 682609 (0.0010) [2023-12-26 05:04:29,285][123090] Updated weights for policy 1, policy_version 682619 (0.0010) [2023-12-26 05:04:29,902][123091] Updated weights for policy 0, policy_version 687122 (0.0010) [2023-12-26 05:04:29,965][123091] Updated weights for policy 0, policy_version 687132 (0.0009) [2023-12-26 05:04:30,035][123091] Updated weights for policy 0, policy_version 687142 (0.0008) [2023-12-26 05:04:30,103][123091] Updated weights for policy 0, policy_version 687152 (0.0008) [2023-12-26 05:04:30,146][123090] Updated weights for policy 1, policy_version 682629 (0.0010) [2023-12-26 05:04:30,201][123090] Updated weights for policy 1, policy_version 682640 (0.0011) [2023-12-26 05:04:30,258][123090] Updated weights for policy 1, policy_version 682651 (0.0009) [2023-12-26 05:04:30,849][123091] Updated weights for policy 0, policy_version 687162 (0.0009) [2023-12-26 05:04:30,905][123091] Updated weights for policy 0, policy_version 687172 (0.0009) [2023-12-26 05:04:30,967][123091] Updated weights for policy 0, policy_version 687182 (0.0010) [2023-12-26 05:04:31,128][123090] Updated weights for policy 1, policy_version 682661 (0.0009) [2023-12-26 05:04:31,197][123090] Updated weights for policy 1, policy_version 682671 (0.0009) [2023-12-26 05:04:31,245][123090] Updated weights for policy 1, policy_version 682681 (0.0009) [2023-12-26 05:04:31,808][123091] Updated weights for policy 0, policy_version 687192 (0.0009) [2023-12-26 05:04:31,870][123091] Updated weights for policy 0, policy_version 687202 (0.0010) [2023-12-26 05:04:31,936][123091] Updated weights for policy 0, policy_version 687212 (0.0009) [2023-12-26 05:04:32,129][123090] Updated weights for policy 1, policy_version 682691 (0.0010) [2023-12-26 05:04:32,179][123090] Updated weights for policy 1, policy_version 682701 (0.0009) [2023-12-26 05:04:32,226][123090] Updated weights for policy 1, policy_version 682711 (0.0008) [2023-12-26 05:04:32,662][123091] Updated weights for policy 0, policy_version 687223 (0.0010) [2023-12-26 05:04:32,725][123091] Updated weights for policy 0, policy_version 687234 (0.0008) [2023-12-26 05:04:32,776][123091] Updated weights for policy 0, policy_version 687244 (0.0009) [2023-12-26 05:04:33,122][123090] Updated weights for policy 1, policy_version 682721 (0.0009) [2023-12-26 05:04:33,187][123090] Updated weights for policy 1, policy_version 682731 (0.0009) [2023-12-26 05:04:33,240][123090] Updated weights for policy 1, policy_version 682742 (0.0010) [2023-12-26 05:04:33,462][123091] Updated weights for policy 0, policy_version 687254 (0.0007) [2023-12-26 05:04:33,532][123091] Updated weights for policy 0, policy_version 687264 (0.0005) [2023-12-26 05:04:33,578][123091] Updated weights for policy 0, policy_version 687274 (0.0005) [2023-12-26 05:04:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 350732288. Throughput: 0: 8761.9, 1: 8718.4. Samples: 350741024. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:33,785][121949] Avg episode reward: [(0, '5814.195'), (1, '5892.915')] [2023-12-26 05:04:34,196][123090] Updated weights for policy 1, policy_version 682753 (0.0009) [2023-12-26 05:04:34,207][123091] Updated weights for policy 0, policy_version 687284 (0.0006) [2023-12-26 05:04:34,253][123090] Updated weights for policy 1, policy_version 682763 (0.0007) [2023-12-26 05:04:34,271][123091] Updated weights for policy 0, policy_version 687294 (0.0011) [2023-12-26 05:04:34,311][123090] Updated weights for policy 1, policy_version 682773 (0.0008) [2023-12-26 05:04:34,330][123091] Updated weights for policy 0, policy_version 687304 (0.0011) [2023-12-26 05:04:34,375][123090] Updated weights for policy 1, policy_version 682783 (0.0005) [2023-12-26 05:04:35,158][123091] Updated weights for policy 0, policy_version 687314 (0.0011) [2023-12-26 05:04:35,160][123090] Updated weights for policy 1, policy_version 682793 (0.0007) [2023-12-26 05:04:35,218][123091] Updated weights for policy 0, policy_version 687324 (0.0009) [2023-12-26 05:04:35,225][123090] Updated weights for policy 1, policy_version 682803 (0.0007) [2023-12-26 05:04:35,280][123091] Updated weights for policy 0, policy_version 687334 (0.0010) [2023-12-26 05:04:35,288][123090] Updated weights for policy 1, policy_version 682813 (0.0008) [2023-12-26 05:04:35,346][123091] Updated weights for policy 0, policy_version 687344 (0.0006) [2023-12-26 05:04:36,013][123090] Updated weights for policy 1, policy_version 682823 (0.0009) [2023-12-26 05:04:36,080][123090] Updated weights for policy 1, policy_version 682833 (0.0009) [2023-12-26 05:04:36,139][123091] Updated weights for policy 0, policy_version 687354 (0.0011) [2023-12-26 05:04:36,175][123090] Updated weights for policy 1, policy_version 682843 (0.0008) [2023-12-26 05:04:36,190][123091] Updated weights for policy 0, policy_version 687364 (0.0010) [2023-12-26 05:04:36,262][123091] Updated weights for policy 0, policy_version 687374 (0.0011) [2023-12-26 05:04:36,811][123090] Updated weights for policy 1, policy_version 682853 (0.0005) [2023-12-26 05:04:36,875][123090] Updated weights for policy 1, policy_version 682863 (0.0006) [2023-12-26 05:04:36,940][123090] Updated weights for policy 1, policy_version 682873 (0.0011) [2023-12-26 05:04:37,048][123091] Updated weights for policy 0, policy_version 687384 (0.0011) [2023-12-26 05:04:37,111][123091] Updated weights for policy 0, policy_version 687394 (0.0011) [2023-12-26 05:04:37,178][123091] Updated weights for policy 0, policy_version 687404 (0.0010) [2023-12-26 05:04:37,770][123090] Updated weights for policy 1, policy_version 682883 (0.0011) [2023-12-26 05:04:37,835][123090] Updated weights for policy 1, policy_version 682893 (0.0011) [2023-12-26 05:04:37,901][123090] Updated weights for policy 1, policy_version 682903 (0.0011) [2023-12-26 05:04:37,910][123091] Updated weights for policy 0, policy_version 687414 (0.0011) [2023-12-26 05:04:37,959][123091] Updated weights for policy 0, policy_version 687424 (0.0006) [2023-12-26 05:04:38,009][123091] Updated weights for policy 0, policy_version 687434 (0.0005) [2023-12-26 05:04:38,646][123090] Updated weights for policy 1, policy_version 682913 (0.0011) [2023-12-26 05:04:38,709][123090] Updated weights for policy 1, policy_version 682923 (0.0011) [2023-12-26 05:04:38,768][123090] Updated weights for policy 1, policy_version 682933 (0.0010) [2023-12-26 05:04:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 350814208. Throughput: 0: 8802.3, 1: 8759.3. Samples: 350794896. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:38,785][121949] Avg episode reward: [(0, '5660.922'), (1, '5891.806')] [2023-12-26 05:04:38,809][123091] Updated weights for policy 0, policy_version 687444 (0.0007) [2023-12-26 05:04:38,821][123090] Updated weights for policy 1, policy_version 682943 (0.0010) [2023-12-26 05:04:38,826][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000682944_174833664.pth... [2023-12-26 05:04:38,831][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000681888_174563328.pth [2023-12-26 05:04:38,872][123091] Updated weights for policy 0, policy_version 687454 (0.0010) [2023-12-26 05:04:38,939][123091] Updated weights for policy 0, policy_version 687464 (0.0011) [2023-12-26 05:04:38,991][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000687472_175996928.pth... [2023-12-26 05:04:38,995][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000686448_175734784.pth [2023-12-26 05:04:39,688][123090] Updated weights for policy 1, policy_version 682953 (0.0011) [2023-12-26 05:04:39,711][123091] Updated weights for policy 0, policy_version 687474 (0.0009) [2023-12-26 05:04:39,753][123090] Updated weights for policy 1, policy_version 682963 (0.0008) [2023-12-26 05:04:39,767][123091] Updated weights for policy 0, policy_version 687484 (0.0010) [2023-12-26 05:04:39,821][123090] Updated weights for policy 1, policy_version 682973 (0.0010) [2023-12-26 05:04:39,832][123091] Updated weights for policy 0, policy_version 687494 (0.0010) [2023-12-26 05:04:39,895][123091] Updated weights for policy 0, policy_version 687504 (0.0011) [2023-12-26 05:04:40,584][123090] Updated weights for policy 1, policy_version 682983 (0.0007) [2023-12-26 05:04:40,637][123090] Updated weights for policy 1, policy_version 682993 (0.0006) [2023-12-26 05:04:40,692][123090] Updated weights for policy 1, policy_version 683003 (0.0008) [2023-12-26 05:04:40,715][123091] Updated weights for policy 0, policy_version 687514 (0.0005) [2023-12-26 05:04:40,773][123091] Updated weights for policy 0, policy_version 687524 (0.0005) [2023-12-26 05:04:40,831][123091] Updated weights for policy 0, policy_version 687534 (0.0005) [2023-12-26 05:04:41,470][123090] Updated weights for policy 1, policy_version 683013 (0.0005) [2023-12-26 05:04:41,546][123090] Updated weights for policy 1, policy_version 683023 (0.0006) [2023-12-26 05:04:41,603][123091] Updated weights for policy 0, policy_version 687544 (0.0008) [2023-12-26 05:04:41,618][123090] Updated weights for policy 1, policy_version 683033 (0.0008) [2023-12-26 05:04:41,676][123091] Updated weights for policy 0, policy_version 687554 (0.0008) [2023-12-26 05:04:41,749][123091] Updated weights for policy 0, policy_version 687564 (0.0009) [2023-12-26 05:04:42,456][123090] Updated weights for policy 1, policy_version 683043 (0.0008) [2023-12-26 05:04:42,521][123090] Updated weights for policy 1, policy_version 683053 (0.0005) [2023-12-26 05:04:42,584][123091] Updated weights for policy 0, policy_version 687574 (0.0009) [2023-12-26 05:04:42,590][123090] Updated weights for policy 1, policy_version 683063 (0.0005) [2023-12-26 05:04:42,642][123091] Updated weights for policy 0, policy_version 687584 (0.0009) [2023-12-26 05:04:42,710][123091] Updated weights for policy 0, policy_version 687594 (0.0009) [2023-12-26 05:04:43,268][123090] Updated weights for policy 1, policy_version 683073 (0.0006) [2023-12-26 05:04:43,328][123090] Updated weights for policy 1, policy_version 683083 (0.0009) [2023-12-26 05:04:43,389][123090] Updated weights for policy 1, policy_version 683093 (0.0008) [2023-12-26 05:04:43,463][123090] Updated weights for policy 1, policy_version 683103 (0.0007) [2023-12-26 05:04:43,551][123091] Updated weights for policy 0, policy_version 687604 (0.0010) [2023-12-26 05:04:43,608][123091] Updated weights for policy 0, policy_version 687614 (0.0009) [2023-12-26 05:04:43,667][123091] Updated weights for policy 0, policy_version 687624 (0.0010) [2023-12-26 05:04:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 350912512. Throughput: 0: 8739.2, 1: 8754.1. Samples: 350901564. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:43,785][121949] Avg episode reward: [(0, '5745.415'), (1, '5888.868')] [2023-12-26 05:04:44,164][123090] Updated weights for policy 1, policy_version 683113 (0.0006) [2023-12-26 05:04:44,217][123090] Updated weights for policy 1, policy_version 683123 (0.0006) [2023-12-26 05:04:44,270][123090] Updated weights for policy 1, policy_version 683133 (0.0006) [2023-12-26 05:04:44,633][123091] Updated weights for policy 0, policy_version 687634 (0.0009) [2023-12-26 05:04:44,699][123091] Updated weights for policy 0, policy_version 687644 (0.0005) [2023-12-26 05:04:44,769][123091] Updated weights for policy 0, policy_version 687654 (0.0006) [2023-12-26 05:04:44,837][123091] Updated weights for policy 0, policy_version 687664 (0.0011) [2023-12-26 05:04:45,072][123090] Updated weights for policy 1, policy_version 683143 (0.0009) [2023-12-26 05:04:45,132][123090] Updated weights for policy 1, policy_version 683153 (0.0011) [2023-12-26 05:04:45,200][123090] Updated weights for policy 1, policy_version 683163 (0.0011) [2023-12-26 05:04:45,581][123091] Updated weights for policy 0, policy_version 687674 (0.0005) [2023-12-26 05:04:45,640][123091] Updated weights for policy 0, policy_version 687684 (0.0006) [2023-12-26 05:04:45,697][123091] Updated weights for policy 0, policy_version 687694 (0.0008) [2023-12-26 05:04:46,021][123090] Updated weights for policy 1, policy_version 683173 (0.0010) [2023-12-26 05:04:46,085][123090] Updated weights for policy 1, policy_version 683183 (0.0010) [2023-12-26 05:04:46,140][123090] Updated weights for policy 1, policy_version 683193 (0.0010) [2023-12-26 05:04:46,351][123091] Updated weights for policy 0, policy_version 687704 (0.0011) [2023-12-26 05:04:46,413][123091] Updated weights for policy 0, policy_version 687714 (0.0011) [2023-12-26 05:04:46,475][123091] Updated weights for policy 0, policy_version 687724 (0.0010) [2023-12-26 05:04:46,983][123090] Updated weights for policy 1, policy_version 683203 (0.0010) [2023-12-26 05:04:47,047][123090] Updated weights for policy 1, policy_version 683213 (0.0009) [2023-12-26 05:04:47,112][123090] Updated weights for policy 1, policy_version 683223 (0.0009) [2023-12-26 05:04:47,278][123091] Updated weights for policy 0, policy_version 687734 (0.0010) [2023-12-26 05:04:47,331][123091] Updated weights for policy 0, policy_version 687744 (0.0009) [2023-12-26 05:04:47,388][123091] Updated weights for policy 0, policy_version 687754 (0.0009) [2023-12-26 05:04:47,865][123090] Updated weights for policy 1, policy_version 683233 (0.0009) [2023-12-26 05:04:47,921][123090] Updated weights for policy 1, policy_version 683243 (0.0007) [2023-12-26 05:04:47,981][123090] Updated weights for policy 1, policy_version 683253 (0.0006) [2023-12-26 05:04:48,036][123090] Updated weights for policy 1, policy_version 683263 (0.0008) [2023-12-26 05:04:48,269][123091] Updated weights for policy 0, policy_version 687764 (0.0008) [2023-12-26 05:04:48,343][123091] Updated weights for policy 0, policy_version 687774 (0.0008) [2023-12-26 05:04:48,412][123091] Updated weights for policy 0, policy_version 687784 (0.0010) [2023-12-26 05:04:48,735][123090] Updated weights for policy 1, policy_version 683273 (0.0007) [2023-12-26 05:04:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 350994432. Throughput: 0: 8681.0, 1: 8873.5. Samples: 351008428. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:48,785][121949] Avg episode reward: [(0, '5524.420'), (1, '5803.534')] [2023-12-26 05:04:48,801][123090] Updated weights for policy 1, policy_version 683283 (0.0008) [2023-12-26 05:04:48,863][123090] Updated weights for policy 1, policy_version 683293 (0.0010) [2023-12-26 05:04:49,247][123091] Updated weights for policy 0, policy_version 687794 (0.0009) [2023-12-26 05:04:49,319][123091] Updated weights for policy 0, policy_version 687804 (0.0010) [2023-12-26 05:04:49,390][123091] Updated weights for policy 0, policy_version 687814 (0.0010) [2023-12-26 05:04:49,459][123091] Updated weights for policy 0, policy_version 687824 (0.0009) [2023-12-26 05:04:49,647][123090] Updated weights for policy 1, policy_version 683303 (0.0010) [2023-12-26 05:04:49,710][123090] Updated weights for policy 1, policy_version 683313 (0.0009) [2023-12-26 05:04:49,773][123090] Updated weights for policy 1, policy_version 683323 (0.0009) [2023-12-26 05:04:50,278][123091] Updated weights for policy 0, policy_version 687834 (0.0008) [2023-12-26 05:04:50,339][123091] Updated weights for policy 0, policy_version 687844 (0.0008) [2023-12-26 05:04:50,402][123091] Updated weights for policy 0, policy_version 687854 (0.0010) [2023-12-26 05:04:50,655][123090] Updated weights for policy 1, policy_version 683333 (0.0010) [2023-12-26 05:04:50,717][123090] Updated weights for policy 1, policy_version 683343 (0.0008) [2023-12-26 05:04:50,775][123090] Updated weights for policy 1, policy_version 683353 (0.0009) [2023-12-26 05:04:51,215][123091] Updated weights for policy 0, policy_version 687864 (0.0010) [2023-12-26 05:04:51,278][123091] Updated weights for policy 0, policy_version 687874 (0.0009) [2023-12-26 05:04:51,334][123091] Updated weights for policy 0, policy_version 687884 (0.0009) [2023-12-26 05:04:51,604][123090] Updated weights for policy 1, policy_version 683363 (0.0008) [2023-12-26 05:04:51,676][123090] Updated weights for policy 1, policy_version 683373 (0.0007) [2023-12-26 05:04:51,753][123090] Updated weights for policy 1, policy_version 683383 (0.0007) [2023-12-26 05:04:52,232][123091] Updated weights for policy 0, policy_version 687894 (0.0010) [2023-12-26 05:04:52,294][123091] Updated weights for policy 0, policy_version 687904 (0.0009) [2023-12-26 05:04:52,360][123091] Updated weights for policy 0, policy_version 687914 (0.0009) [2023-12-26 05:04:52,554][123090] Updated weights for policy 1, policy_version 683393 (0.0010) [2023-12-26 05:04:52,607][123090] Updated weights for policy 1, policy_version 683403 (0.0009) [2023-12-26 05:04:52,660][123090] Updated weights for policy 1, policy_version 683413 (0.0006) [2023-12-26 05:04:52,722][123090] Updated weights for policy 1, policy_version 683423 (0.0006) [2023-12-26 05:04:53,248][123091] Updated weights for policy 0, policy_version 687924 (0.0010) [2023-12-26 05:04:53,300][123091] Updated weights for policy 0, policy_version 687934 (0.0010) [2023-12-26 05:04:53,353][123091] Updated weights for policy 0, policy_version 687944 (0.0009) [2023-12-26 05:04:53,404][123090] Updated weights for policy 1, policy_version 683433 (0.0008) [2023-12-26 05:04:53,464][123090] Updated weights for policy 1, policy_version 683443 (0.0009) [2023-12-26 05:04:53,533][123090] Updated weights for policy 1, policy_version 683453 (0.0009) [2023-12-26 05:04:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 351084544. Throughput: 0: 8673.6, 1: 8872.9. Samples: 351059032. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:53,785][121949] Avg episode reward: [(0, '5633.795'), (1, '5618.040')] [2023-12-26 05:04:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000687952_176119808.pth... [2023-12-26 05:04:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000683456_174964736.pth... [2023-12-26 05:04:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000686928_175857664.pth [2023-12-26 05:04:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000682400_174694400.pth [2023-12-26 05:04:54,221][123091] Updated weights for policy 0, policy_version 687954 (0.0010) [2023-12-26 05:04:54,280][123090] Updated weights for policy 1, policy_version 683463 (0.0010) [2023-12-26 05:04:54,287][123091] Updated weights for policy 0, policy_version 687964 (0.0007) [2023-12-26 05:04:54,339][123090] Updated weights for policy 1, policy_version 683473 (0.0010) [2023-12-26 05:04:54,378][123091] Updated weights for policy 0, policy_version 687974 (0.0006) [2023-12-26 05:04:54,399][123090] Updated weights for policy 1, policy_version 683483 (0.0010) [2023-12-26 05:04:54,445][123091] Updated weights for policy 0, policy_version 687984 (0.0008) [2023-12-26 05:04:55,068][123090] Updated weights for policy 1, policy_version 683493 (0.0006) [2023-12-26 05:04:55,129][123090] Updated weights for policy 1, policy_version 683503 (0.0005) [2023-12-26 05:04:55,191][123090] Updated weights for policy 1, policy_version 683513 (0.0007) [2023-12-26 05:04:55,204][123091] Updated weights for policy 0, policy_version 687994 (0.0009) [2023-12-26 05:04:55,266][123091] Updated weights for policy 0, policy_version 688004 (0.0008) [2023-12-26 05:04:55,325][123091] Updated weights for policy 0, policy_version 688014 (0.0009) [2023-12-26 05:04:55,870][123090] Updated weights for policy 1, policy_version 683523 (0.0008) [2023-12-26 05:04:55,921][123090] Updated weights for policy 1, policy_version 683533 (0.0010) [2023-12-26 05:04:55,976][123090] Updated weights for policy 1, policy_version 683543 (0.0010) [2023-12-26 05:04:56,190][123091] Updated weights for policy 0, policy_version 688024 (0.0009) [2023-12-26 05:04:56,245][123091] Updated weights for policy 0, policy_version 688034 (0.0009) [2023-12-26 05:04:56,297][123091] Updated weights for policy 0, policy_version 688044 (0.0009) [2023-12-26 05:04:56,710][123090] Updated weights for policy 1, policy_version 683553 (0.0010) [2023-12-26 05:04:56,761][123090] Updated weights for policy 1, policy_version 683563 (0.0005) [2023-12-26 05:04:56,826][123090] Updated weights for policy 1, policy_version 683573 (0.0006) [2023-12-26 05:04:56,900][123090] Updated weights for policy 1, policy_version 683583 (0.0005) [2023-12-26 05:04:57,199][123091] Updated weights for policy 0, policy_version 688054 (0.0009) [2023-12-26 05:04:57,246][123091] Updated weights for policy 0, policy_version 688064 (0.0005) [2023-12-26 05:04:57,304][123091] Updated weights for policy 0, policy_version 688074 (0.0005) [2023-12-26 05:04:57,648][123090] Updated weights for policy 1, policy_version 683593 (0.0005) [2023-12-26 05:04:57,715][123090] Updated weights for policy 1, policy_version 683603 (0.0005) [2023-12-26 05:04:57,782][123090] Updated weights for policy 1, policy_version 683613 (0.0005) [2023-12-26 05:04:58,028][123091] Updated weights for policy 0, policy_version 688084 (0.0010) [2023-12-26 05:04:58,088][123091] Updated weights for policy 0, policy_version 688094 (0.0009) [2023-12-26 05:04:58,145][123091] Updated weights for policy 0, policy_version 688104 (0.0008) [2023-12-26 05:04:58,563][123090] Updated weights for policy 1, policy_version 683623 (0.0009) [2023-12-26 05:04:58,634][123090] Updated weights for policy 1, policy_version 683633 (0.0009) [2023-12-26 05:04:58,704][123090] Updated weights for policy 1, policy_version 683643 (0.0009) [2023-12-26 05:04:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 351174656. Throughput: 0: 8623.6, 1: 8986.7. Samples: 351166324. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:04:58,785][121949] Avg episode reward: [(0, '5708.908'), (1, '5646.064')] [2023-12-26 05:04:59,013][123091] Updated weights for policy 0, policy_version 688114 (0.0009) [2023-12-26 05:04:59,072][123091] Updated weights for policy 0, policy_version 688124 (0.0006) [2023-12-26 05:04:59,122][123091] Updated weights for policy 0, policy_version 688134 (0.0009) [2023-12-26 05:04:59,526][123090] Updated weights for policy 1, policy_version 683653 (0.0011) [2023-12-26 05:04:59,590][123090] Updated weights for policy 1, policy_version 683663 (0.0011) [2023-12-26 05:04:59,644][123090] Updated weights for policy 1, policy_version 683673 (0.0011) [2023-12-26 05:04:59,916][123091] Updated weights for policy 0, policy_version 688145 (0.0010) [2023-12-26 05:04:59,982][123091] Updated weights for policy 0, policy_version 688155 (0.0009) [2023-12-26 05:05:00,046][123091] Updated weights for policy 0, policy_version 688165 (0.0007) [2023-12-26 05:05:00,100][123091] Updated weights for policy 0, policy_version 688175 (0.0006) [2023-12-26 05:05:00,457][123090] Updated weights for policy 1, policy_version 683683 (0.0009) [2023-12-26 05:05:00,507][123090] Updated weights for policy 1, policy_version 683693 (0.0008) [2023-12-26 05:05:00,567][123090] Updated weights for policy 1, policy_version 683703 (0.0010) [2023-12-26 05:05:00,882][123091] Updated weights for policy 0, policy_version 688185 (0.0006) [2023-12-26 05:05:00,956][123091] Updated weights for policy 0, policy_version 688195 (0.0005) [2023-12-26 05:05:01,018][123091] Updated weights for policy 0, policy_version 688205 (0.0007) [2023-12-26 05:05:01,296][123090] Updated weights for policy 1, policy_version 683713 (0.0006) [2023-12-26 05:05:01,350][123090] Updated weights for policy 1, policy_version 683723 (0.0009) [2023-12-26 05:05:01,417][123090] Updated weights for policy 1, policy_version 683733 (0.0009) [2023-12-26 05:05:01,484][123090] Updated weights for policy 1, policy_version 683744 (0.0010) [2023-12-26 05:05:01,793][123091] Updated weights for policy 0, policy_version 688215 (0.0010) [2023-12-26 05:05:01,858][123091] Updated weights for policy 0, policy_version 688225 (0.0010) [2023-12-26 05:05:01,916][123091] Updated weights for policy 0, policy_version 688235 (0.0009) [2023-12-26 05:05:02,352][123090] Updated weights for policy 1, policy_version 683754 (0.0009) [2023-12-26 05:05:02,409][123090] Updated weights for policy 1, policy_version 683764 (0.0009) [2023-12-26 05:05:02,462][123090] Updated weights for policy 1, policy_version 683774 (0.0010) [2023-12-26 05:05:02,720][123091] Updated weights for policy 0, policy_version 688245 (0.0010) [2023-12-26 05:05:02,775][123091] Updated weights for policy 0, policy_version 688255 (0.0010) [2023-12-26 05:05:02,818][123091] Updated weights for policy 0, policy_version 688265 (0.0010) [2023-12-26 05:05:03,267][123090] Updated weights for policy 1, policy_version 683784 (0.0009) [2023-12-26 05:05:03,322][123090] Updated weights for policy 1, policy_version 683794 (0.0008) [2023-12-26 05:05:03,377][123090] Updated weights for policy 1, policy_version 683804 (0.0008) [2023-12-26 05:05:03,631][123091] Updated weights for policy 0, policy_version 688275 (0.0007) [2023-12-26 05:05:03,687][123091] Updated weights for policy 0, policy_version 688285 (0.0009) [2023-12-26 05:05:03,748][123091] Updated weights for policy 0, policy_version 688295 (0.0010) [2023-12-26 05:05:03,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 351256576. Throughput: 0: 8649.0, 1: 8958.6. Samples: 351273012. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:03,785][121949] Avg episode reward: [(0, '5820.328'), (1, '5829.172')] [2023-12-26 05:05:04,203][123090] Updated weights for policy 1, policy_version 683814 (0.0008) [2023-12-26 05:05:04,269][123090] Updated weights for policy 1, policy_version 683824 (0.0007) [2023-12-26 05:05:04,333][123090] Updated weights for policy 1, policy_version 683834 (0.0008) [2023-12-26 05:05:04,617][123091] Updated weights for policy 0, policy_version 688305 (0.0009) [2023-12-26 05:05:04,680][123091] Updated weights for policy 0, policy_version 688315 (0.0010) [2023-12-26 05:05:04,736][123091] Updated weights for policy 0, policy_version 688325 (0.0010) [2023-12-26 05:05:04,786][123091] Updated weights for policy 0, policy_version 688335 (0.0010) [2023-12-26 05:05:05,116][123090] Updated weights for policy 1, policy_version 683844 (0.0010) [2023-12-26 05:05:05,179][123090] Updated weights for policy 1, policy_version 683854 (0.0010) [2023-12-26 05:05:05,235][123090] Updated weights for policy 1, policy_version 683864 (0.0008) [2023-12-26 05:05:05,554][123091] Updated weights for policy 0, policy_version 688345 (0.0006) [2023-12-26 05:05:05,602][123091] Updated weights for policy 0, policy_version 688355 (0.0008) [2023-12-26 05:05:05,649][123091] Updated weights for policy 0, policy_version 688365 (0.0008) [2023-12-26 05:05:06,042][123090] Updated weights for policy 1, policy_version 683874 (0.0009) [2023-12-26 05:05:06,098][123090] Updated weights for policy 1, policy_version 683884 (0.0009) [2023-12-26 05:05:06,164][123090] Updated weights for policy 1, policy_version 683894 (0.0009) [2023-12-26 05:05:06,224][123090] Updated weights for policy 1, policy_version 683904 (0.0009) [2023-12-26 05:05:06,516][123091] Updated weights for policy 0, policy_version 688375 (0.0009) [2023-12-26 05:05:06,585][123091] Updated weights for policy 0, policy_version 688385 (0.0010) [2023-12-26 05:05:06,652][123091] Updated weights for policy 0, policy_version 688395 (0.0010) [2023-12-26 05:05:06,957][123090] Updated weights for policy 1, policy_version 683914 (0.0007) [2023-12-26 05:05:07,024][123090] Updated weights for policy 1, policy_version 683924 (0.0006) [2023-12-26 05:05:07,092][123090] Updated weights for policy 1, policy_version 683934 (0.0006) [2023-12-26 05:05:07,354][123091] Updated weights for policy 0, policy_version 688405 (0.0008) [2023-12-26 05:05:07,412][123091] Updated weights for policy 0, policy_version 688415 (0.0005) [2023-12-26 05:05:07,475][123091] Updated weights for policy 0, policy_version 688425 (0.0006) [2023-12-26 05:05:07,677][123090] Updated weights for policy 1, policy_version 683944 (0.0009) [2023-12-26 05:05:07,729][123090] Updated weights for policy 1, policy_version 683954 (0.0009) [2023-12-26 05:05:07,790][123090] Updated weights for policy 1, policy_version 683964 (0.0010) [2023-12-26 05:05:08,208][123091] Updated weights for policy 0, policy_version 688435 (0.0007) [2023-12-26 05:05:08,265][123091] Updated weights for policy 0, policy_version 688445 (0.0011) [2023-12-26 05:05:08,326][123091] Updated weights for policy 0, policy_version 688455 (0.0011) [2023-12-26 05:05:08,691][123090] Updated weights for policy 1, policy_version 683974 (0.0009) [2023-12-26 05:05:08,753][123090] Updated weights for policy 1, policy_version 683984 (0.0009) [2023-12-26 05:05:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 351346688. Throughput: 0: 8656.6, 1: 8974.9. Samples: 351324852. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:08,785][121949] Avg episode reward: [(0, '5937.781'), (1, '5739.526')] [2023-12-26 05:05:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000688464_176250880.pth... [2023-12-26 05:05:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000687472_175996928.pth [2023-12-26 05:05:08,813][123090] Updated weights for policy 1, policy_version 683994 (0.0009) [2023-12-26 05:05:08,851][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000684000_175104000.pth... [2023-12-26 05:05:08,856][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000682944_174833664.pth [2023-12-26 05:05:09,179][123091] Updated weights for policy 0, policy_version 688465 (0.0011) [2023-12-26 05:05:09,246][123091] Updated weights for policy 0, policy_version 688475 (0.0011) [2023-12-26 05:05:09,301][123091] Updated weights for policy 0, policy_version 688485 (0.0009) [2023-12-26 05:05:09,368][123091] Updated weights for policy 0, policy_version 688495 (0.0010) [2023-12-26 05:05:09,624][123090] Updated weights for policy 1, policy_version 684004 (0.0008) [2023-12-26 05:05:09,689][123090] Updated weights for policy 1, policy_version 684014 (0.0005) [2023-12-26 05:05:09,748][123090] Updated weights for policy 1, policy_version 684024 (0.0007) [2023-12-26 05:05:10,251][123091] Updated weights for policy 0, policy_version 688505 (0.0009) [2023-12-26 05:05:10,312][123091] Updated weights for policy 0, policy_version 688515 (0.0010) [2023-12-26 05:05:10,372][123091] Updated weights for policy 0, policy_version 688525 (0.0009) [2023-12-26 05:05:10,545][123090] Updated weights for policy 1, policy_version 684034 (0.0009) [2023-12-26 05:05:10,605][123090] Updated weights for policy 1, policy_version 684044 (0.0005) [2023-12-26 05:05:10,670][123090] Updated weights for policy 1, policy_version 684054 (0.0006) [2023-12-26 05:05:10,730][123090] Updated weights for policy 1, policy_version 684064 (0.0009) [2023-12-26 05:05:11,233][123091] Updated weights for policy 0, policy_version 688535 (0.0009) [2023-12-26 05:05:11,299][123091] Updated weights for policy 0, policy_version 688545 (0.0010) [2023-12-26 05:05:11,367][123091] Updated weights for policy 0, policy_version 688555 (0.0010) [2023-12-26 05:05:11,562][123090] Updated weights for policy 1, policy_version 684074 (0.0009) [2023-12-26 05:05:11,609][123090] Updated weights for policy 1, policy_version 684084 (0.0011) [2023-12-26 05:05:11,673][123090] Updated weights for policy 1, policy_version 684094 (0.0010) [2023-12-26 05:05:12,180][123091] Updated weights for policy 0, policy_version 688565 (0.0009) [2023-12-26 05:05:12,246][123091] Updated weights for policy 0, policy_version 688575 (0.0009) [2023-12-26 05:05:12,316][123091] Updated weights for policy 0, policy_version 688585 (0.0009) [2023-12-26 05:05:12,569][123090] Updated weights for policy 1, policy_version 684104 (0.0009) [2023-12-26 05:05:12,637][123090] Updated weights for policy 1, policy_version 684114 (0.0007) [2023-12-26 05:05:12,705][123090] Updated weights for policy 1, policy_version 684124 (0.0007) [2023-12-26 05:05:13,085][123091] Updated weights for policy 0, policy_version 688595 (0.0009) [2023-12-26 05:05:13,138][123091] Updated weights for policy 0, policy_version 688605 (0.0008) [2023-12-26 05:05:13,190][123091] Updated weights for policy 0, policy_version 688615 (0.0009) [2023-12-26 05:05:13,400][123090] Updated weights for policy 1, policy_version 684134 (0.0007) [2023-12-26 05:05:13,476][123090] Updated weights for policy 1, policy_version 684144 (0.0009) [2023-12-26 05:05:13,520][123090] Updated weights for policy 1, policy_version 684154 (0.0006) [2023-12-26 05:05:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 351436800. Throughput: 0: 8688.6, 1: 8915.9. Samples: 351428996. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:13,785][121949] Avg episode reward: [(0, '6000.882'), (1, '5779.176')] [2023-12-26 05:05:13,966][123091] Updated weights for policy 0, policy_version 688626 (0.0009) [2023-12-26 05:05:14,015][123091] Updated weights for policy 0, policy_version 688636 (0.0005) [2023-12-26 05:05:14,053][123090] Updated weights for policy 1, policy_version 684164 (0.0006) [2023-12-26 05:05:14,070][123091] Updated weights for policy 0, policy_version 688646 (0.0005) [2023-12-26 05:05:14,124][123090] Updated weights for policy 1, policy_version 684174 (0.0006) [2023-12-26 05:05:14,131][123091] Updated weights for policy 0, policy_version 688656 (0.0007) [2023-12-26 05:05:14,191][123090] Updated weights for policy 1, policy_version 684184 (0.0007) [2023-12-26 05:05:14,825][123091] Updated weights for policy 0, policy_version 688666 (0.0008) [2023-12-26 05:05:14,888][123091] Updated weights for policy 0, policy_version 688676 (0.0007) [2023-12-26 05:05:14,953][123090] Updated weights for policy 1, policy_version 684194 (0.0007) [2023-12-26 05:05:14,963][123091] Updated weights for policy 0, policy_version 688686 (0.0006) [2023-12-26 05:05:15,027][123090] Updated weights for policy 1, policy_version 684204 (0.0009) [2023-12-26 05:05:15,096][123090] Updated weights for policy 1, policy_version 684214 (0.0009) [2023-12-26 05:05:15,166][123090] Updated weights for policy 1, policy_version 684224 (0.0009) [2023-12-26 05:05:15,761][123091] Updated weights for policy 0, policy_version 688696 (0.0010) [2023-12-26 05:05:15,818][123091] Updated weights for policy 0, policy_version 688706 (0.0010) [2023-12-26 05:05:15,866][123091] Updated weights for policy 0, policy_version 688716 (0.0010) [2023-12-26 05:05:15,956][123090] Updated weights for policy 1, policy_version 684234 (0.0008) [2023-12-26 05:05:16,022][123090] Updated weights for policy 1, policy_version 684244 (0.0008) [2023-12-26 05:05:16,088][123090] Updated weights for policy 1, policy_version 684254 (0.0006) [2023-12-26 05:05:16,721][123091] Updated weights for policy 0, policy_version 688726 (0.0010) [2023-12-26 05:05:16,736][123090] Updated weights for policy 1, policy_version 684264 (0.0006) [2023-12-26 05:05:16,783][123091] Updated weights for policy 0, policy_version 688736 (0.0010) [2023-12-26 05:05:16,785][123090] Updated weights for policy 1, policy_version 684274 (0.0009) [2023-12-26 05:05:16,835][123090] Updated weights for policy 1, policy_version 684284 (0.0008) [2023-12-26 05:05:16,845][123091] Updated weights for policy 0, policy_version 688746 (0.0010) [2023-12-26 05:05:17,662][123091] Updated weights for policy 0, policy_version 688756 (0.0011) [2023-12-26 05:05:17,681][123090] Updated weights for policy 1, policy_version 684294 (0.0006) [2023-12-26 05:05:17,725][123091] Updated weights for policy 0, policy_version 688766 (0.0010) [2023-12-26 05:05:17,740][123090] Updated weights for policy 1, policy_version 684304 (0.0006) [2023-12-26 05:05:17,790][123091] Updated weights for policy 0, policy_version 688776 (0.0010) [2023-12-26 05:05:17,801][123090] Updated weights for policy 1, policy_version 684314 (0.0009) [2023-12-26 05:05:18,606][123091] Updated weights for policy 0, policy_version 688786 (0.0010) [2023-12-26 05:05:18,613][123090] Updated weights for policy 1, policy_version 684324 (0.0006) [2023-12-26 05:05:18,672][123091] Updated weights for policy 0, policy_version 688796 (0.0010) [2023-12-26 05:05:18,675][123090] Updated weights for policy 1, policy_version 684334 (0.0006) [2023-12-26 05:05:18,731][123091] Updated weights for policy 0, policy_version 688806 (0.0010) [2023-12-26 05:05:18,733][123090] Updated weights for policy 1, policy_version 684344 (0.0009) [2023-12-26 05:05:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 351526912. Throughput: 0: 8717.3, 1: 9008.0. Samples: 351538656. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:18,785][121949] Avg episode reward: [(0, '6012.881'), (1, '5855.624')] [2023-12-26 05:05:18,787][123091] Updated weights for policy 0, policy_version 688816 (0.0008) [2023-12-26 05:05:19,600][123090] Updated weights for policy 1, policy_version 684354 (0.0008) [2023-12-26 05:05:19,619][123091] Updated weights for policy 0, policy_version 688826 (0.0011) [2023-12-26 05:05:19,666][123090] Updated weights for policy 1, policy_version 684364 (0.0006) [2023-12-26 05:05:19,683][123091] Updated weights for policy 0, policy_version 688836 (0.0011) [2023-12-26 05:05:19,724][123090] Updated weights for policy 1, policy_version 684374 (0.0006) [2023-12-26 05:05:19,746][123091] Updated weights for policy 0, policy_version 688846 (0.0011) [2023-12-26 05:05:19,790][123090] Updated weights for policy 1, policy_version 684384 (0.0007) [2023-12-26 05:05:20,469][123090] Updated weights for policy 1, policy_version 684394 (0.0008) [2023-12-26 05:05:20,536][123090] Updated weights for policy 1, policy_version 684404 (0.0008) [2023-12-26 05:05:20,571][123091] Updated weights for policy 0, policy_version 688856 (0.0010) [2023-12-26 05:05:20,605][123090] Updated weights for policy 1, policy_version 684414 (0.0009) [2023-12-26 05:05:20,647][123091] Updated weights for policy 0, policy_version 688866 (0.0009) [2023-12-26 05:05:20,708][123091] Updated weights for policy 0, policy_version 688876 (0.0009) [2023-12-26 05:05:21,496][123090] Updated weights for policy 1, policy_version 684424 (0.0008) [2023-12-26 05:05:21,560][123090] Updated weights for policy 1, policy_version 684434 (0.0009) [2023-12-26 05:05:21,585][123091] Updated weights for policy 0, policy_version 688886 (0.0009) [2023-12-26 05:05:21,622][123090] Updated weights for policy 1, policy_version 684444 (0.0008) [2023-12-26 05:05:21,646][123091] Updated weights for policy 0, policy_version 688896 (0.0007) [2023-12-26 05:05:21,706][123091] Updated weights for policy 0, policy_version 688906 (0.0010) [2023-12-26 05:05:22,494][123090] Updated weights for policy 1, policy_version 684454 (0.0008) [2023-12-26 05:05:22,509][123091] Updated weights for policy 0, policy_version 688916 (0.0010) [2023-12-26 05:05:22,560][123090] Updated weights for policy 1, policy_version 684464 (0.0006) [2023-12-26 05:05:22,562][123091] Updated weights for policy 0, policy_version 688926 (0.0009) [2023-12-26 05:05:22,616][123091] Updated weights for policy 0, policy_version 688936 (0.0008) [2023-12-26 05:05:22,627][123090] Updated weights for policy 1, policy_version 684474 (0.0007) [2023-12-26 05:05:23,433][123091] Updated weights for policy 0, policy_version 688946 (0.0007) [2023-12-26 05:05:23,444][123090] Updated weights for policy 1, policy_version 684484 (0.0009) [2023-12-26 05:05:23,493][123091] Updated weights for policy 0, policy_version 688956 (0.0007) [2023-12-26 05:05:23,503][123090] Updated weights for policy 1, policy_version 684494 (0.0010) [2023-12-26 05:05:23,555][123091] Updated weights for policy 0, policy_version 688966 (0.0008) [2023-12-26 05:05:23,558][123090] Updated weights for policy 1, policy_version 684504 (0.0006) [2023-12-26 05:05:23,612][123091] Updated weights for policy 0, policy_version 688976 (0.0008) [2023-12-26 05:05:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 351617024. Throughput: 0: 8662.7, 1: 8984.5. Samples: 351589020. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:23,785][121949] Avg episode reward: [(0, '6161.053'), (1, '5711.675')] [2023-12-26 05:05:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000688976_176381952.pth... [2023-12-26 05:05:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000684512_175235072.pth... [2023-12-26 05:05:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000683456_174964736.pth [2023-12-26 05:05:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000687952_176119808.pth [2023-12-26 05:05:24,280][123090] Updated weights for policy 1, policy_version 684514 (0.0008) [2023-12-26 05:05:24,335][123090] Updated weights for policy 1, policy_version 684524 (0.0009) [2023-12-26 05:05:24,391][123090] Updated weights for policy 1, policy_version 684534 (0.0011) [2023-12-26 05:05:24,450][123090] Updated weights for policy 1, policy_version 684544 (0.0010) [2023-12-26 05:05:24,485][123091] Updated weights for policy 0, policy_version 688986 (0.0005) [2023-12-26 05:05:24,543][123091] Updated weights for policy 0, policy_version 688996 (0.0005) [2023-12-26 05:05:24,604][123091] Updated weights for policy 0, policy_version 689006 (0.0005) [2023-12-26 05:05:25,179][123091] Updated weights for policy 0, policy_version 689016 (0.0005) [2023-12-26 05:05:25,225][123091] Updated weights for policy 0, policy_version 689026 (0.0005) [2023-12-26 05:05:25,275][123090] Updated weights for policy 1, policy_version 684554 (0.0011) [2023-12-26 05:05:25,277][123091] Updated weights for policy 0, policy_version 689036 (0.0005) [2023-12-26 05:05:25,329][123090] Updated weights for policy 1, policy_version 684564 (0.0010) [2023-12-26 05:05:25,384][123090] Updated weights for policy 1, policy_version 684574 (0.0010) [2023-12-26 05:05:25,935][123091] Updated weights for policy 0, policy_version 689046 (0.0008) [2023-12-26 05:05:25,994][123091] Updated weights for policy 0, policy_version 689056 (0.0010) [2023-12-26 05:05:26,064][123091] Updated weights for policy 0, policy_version 689066 (0.0011) [2023-12-26 05:05:26,140][123090] Updated weights for policy 1, policy_version 684584 (0.0009) [2023-12-26 05:05:26,208][123090] Updated weights for policy 1, policy_version 684594 (0.0009) [2023-12-26 05:05:26,260][123090] Updated weights for policy 1, policy_version 684604 (0.0008) [2023-12-26 05:05:26,865][123091] Updated weights for policy 0, policy_version 689076 (0.0010) [2023-12-26 05:05:26,916][123091] Updated weights for policy 0, policy_version 689086 (0.0010) [2023-12-26 05:05:26,963][123091] Updated weights for policy 0, policy_version 689096 (0.0010) [2023-12-26 05:05:27,089][123090] Updated weights for policy 1, policy_version 684614 (0.0009) [2023-12-26 05:05:27,137][123090] Updated weights for policy 1, policy_version 684624 (0.0009) [2023-12-26 05:05:27,185][123090] Updated weights for policy 1, policy_version 684634 (0.0009) [2023-12-26 05:05:27,802][123091] Updated weights for policy 0, policy_version 689106 (0.0010) [2023-12-26 05:05:27,858][123091] Updated weights for policy 0, policy_version 689116 (0.0009) [2023-12-26 05:05:27,921][123091] Updated weights for policy 0, policy_version 689126 (0.0009) [2023-12-26 05:05:27,981][123091] Updated weights for policy 0, policy_version 689136 (0.0006) [2023-12-26 05:05:28,042][123090] Updated weights for policy 1, policy_version 684644 (0.0009) [2023-12-26 05:05:28,090][123090] Updated weights for policy 1, policy_version 684654 (0.0009) [2023-12-26 05:05:28,146][123090] Updated weights for policy 1, policy_version 684664 (0.0009) [2023-12-26 05:05:28,748][123091] Updated weights for policy 0, policy_version 689146 (0.0010) [2023-12-26 05:05:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 351698944. Throughput: 0: 8696.9, 1: 9001.1. Samples: 351697972. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:28,785][121949] Avg episode reward: [(0, '6044.507'), (1, '5672.222')] [2023-12-26 05:05:28,795][123091] Updated weights for policy 0, policy_version 689156 (0.0009) [2023-12-26 05:05:28,843][123091] Updated weights for policy 0, policy_version 689166 (0.0009) [2023-12-26 05:05:29,002][123090] Updated weights for policy 1, policy_version 684674 (0.0008) [2023-12-26 05:05:29,051][123090] Updated weights for policy 1, policy_version 684684 (0.0005) [2023-12-26 05:05:29,098][123090] Updated weights for policy 1, policy_version 684694 (0.0005) [2023-12-26 05:05:29,151][123090] Updated weights for policy 1, policy_version 684704 (0.0005) [2023-12-26 05:05:29,750][123091] Updated weights for policy 0, policy_version 689176 (0.0010) [2023-12-26 05:05:29,810][123091] Updated weights for policy 0, policy_version 689186 (0.0005) [2023-12-26 05:05:29,878][123091] Updated weights for policy 0, policy_version 689196 (0.0007) [2023-12-26 05:05:29,982][123090] Updated weights for policy 1, policy_version 684714 (0.0009) [2023-12-26 05:05:30,041][123090] Updated weights for policy 1, policy_version 684724 (0.0009) [2023-12-26 05:05:30,108][123090] Updated weights for policy 1, policy_version 684735 (0.0010) [2023-12-26 05:05:30,651][123091] Updated weights for policy 0, policy_version 689207 (0.0008) [2023-12-26 05:05:30,702][123091] Updated weights for policy 0, policy_version 689217 (0.0009) [2023-12-26 05:05:30,751][123091] Updated weights for policy 0, policy_version 689227 (0.0005) [2023-12-26 05:05:30,797][123090] Updated weights for policy 1, policy_version 684745 (0.0009) [2023-12-26 05:05:30,849][123090] Updated weights for policy 1, policy_version 684755 (0.0009) [2023-12-26 05:05:30,905][123090] Updated weights for policy 1, policy_version 684765 (0.0009) [2023-12-26 05:05:31,549][123091] Updated weights for policy 0, policy_version 689237 (0.0009) [2023-12-26 05:05:31,597][123091] Updated weights for policy 0, policy_version 689247 (0.0009) [2023-12-26 05:05:31,665][123091] Updated weights for policy 0, policy_version 689257 (0.0011) [2023-12-26 05:05:31,796][123090] Updated weights for policy 1, policy_version 684775 (0.0010) [2023-12-26 05:05:31,862][123090] Updated weights for policy 1, policy_version 684785 (0.0009) [2023-12-26 05:05:31,930][123090] Updated weights for policy 1, policy_version 684795 (0.0009) [2023-12-26 05:05:32,571][123091] Updated weights for policy 0, policy_version 689267 (0.0008) [2023-12-26 05:05:32,645][123091] Updated weights for policy 0, policy_version 689277 (0.0005) [2023-12-26 05:05:32,701][123090] Updated weights for policy 1, policy_version 684805 (0.0009) [2023-12-26 05:05:32,708][123091] Updated weights for policy 0, policy_version 689287 (0.0006) [2023-12-26 05:05:32,764][123090] Updated weights for policy 1, policy_version 684815 (0.0008) [2023-12-26 05:05:32,830][123090] Updated weights for policy 1, policy_version 684825 (0.0009) [2023-12-26 05:05:33,398][123091] Updated weights for policy 0, policy_version 689297 (0.0006) [2023-12-26 05:05:33,447][123091] Updated weights for policy 0, policy_version 689307 (0.0009) [2023-12-26 05:05:33,501][123091] Updated weights for policy 0, policy_version 689317 (0.0007) [2023-12-26 05:05:33,575][123091] Updated weights for policy 0, policy_version 689327 (0.0005) [2023-12-26 05:05:33,675][123090] Updated weights for policy 1, policy_version 684835 (0.0010) [2023-12-26 05:05:33,738][123090] Updated weights for policy 1, policy_version 684845 (0.0009) [2023-12-26 05:05:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 351789056. Throughput: 0: 8729.1, 1: 8953.5. Samples: 351804144. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:33,785][121949] Avg episode reward: [(0, '5981.136'), (1, '5836.348')] [2023-12-26 05:05:33,796][123090] Updated weights for policy 1, policy_version 684855 (0.0009) [2023-12-26 05:05:34,306][123091] Updated weights for policy 0, policy_version 689337 (0.0009) [2023-12-26 05:05:34,375][123091] Updated weights for policy 0, policy_version 689347 (0.0009) [2023-12-26 05:05:34,442][123091] Updated weights for policy 0, policy_version 689357 (0.0008) [2023-12-26 05:05:34,650][123090] Updated weights for policy 1, policy_version 684865 (0.0009) [2023-12-26 05:05:34,716][123090] Updated weights for policy 1, policy_version 684875 (0.0010) [2023-12-26 05:05:34,783][123090] Updated weights for policy 1, policy_version 684885 (0.0010) [2023-12-26 05:05:34,854][123090] Updated weights for policy 1, policy_version 684895 (0.0009) [2023-12-26 05:05:35,202][123091] Updated weights for policy 0, policy_version 689367 (0.0009) [2023-12-26 05:05:35,259][123091] Updated weights for policy 0, policy_version 689377 (0.0009) [2023-12-26 05:05:35,321][123091] Updated weights for policy 0, policy_version 689387 (0.0009) [2023-12-26 05:05:35,671][123090] Updated weights for policy 1, policy_version 684905 (0.0008) [2023-12-26 05:05:35,729][123090] Updated weights for policy 1, policy_version 684915 (0.0010) [2023-12-26 05:05:35,787][123090] Updated weights for policy 1, policy_version 684925 (0.0010) [2023-12-26 05:05:36,091][123091] Updated weights for policy 0, policy_version 689397 (0.0007) [2023-12-26 05:05:36,166][123091] Updated weights for policy 0, policy_version 689407 (0.0011) [2023-12-26 05:05:36,238][123091] Updated weights for policy 0, policy_version 689417 (0.0011) [2023-12-26 05:05:36,513][123090] Updated weights for policy 1, policy_version 684935 (0.0009) [2023-12-26 05:05:36,581][123090] Updated weights for policy 1, policy_version 684945 (0.0008) [2023-12-26 05:05:36,653][123090] Updated weights for policy 1, policy_version 684955 (0.0011) [2023-12-26 05:05:36,970][123091] Updated weights for policy 0, policy_version 689427 (0.0009) [2023-12-26 05:05:37,025][123091] Updated weights for policy 0, policy_version 689437 (0.0010) [2023-12-26 05:05:37,080][123091] Updated weights for policy 0, policy_version 689447 (0.0005) [2023-12-26 05:05:37,468][123090] Updated weights for policy 1, policy_version 684965 (0.0011) [2023-12-26 05:05:37,527][123090] Updated weights for policy 1, policy_version 684975 (0.0010) [2023-12-26 05:05:37,592][123090] Updated weights for policy 1, policy_version 684985 (0.0005) [2023-12-26 05:05:37,765][123091] Updated weights for policy 0, policy_version 689457 (0.0005) [2023-12-26 05:05:37,830][123091] Updated weights for policy 0, policy_version 689467 (0.0006) [2023-12-26 05:05:37,894][123091] Updated weights for policy 0, policy_version 689477 (0.0006) [2023-12-26 05:05:37,949][123091] Updated weights for policy 0, policy_version 689487 (0.0007) [2023-12-26 05:05:38,355][123090] Updated weights for policy 1, policy_version 684995 (0.0007) [2023-12-26 05:05:38,417][123090] Updated weights for policy 1, policy_version 685005 (0.0008) [2023-12-26 05:05:38,481][123090] Updated weights for policy 1, policy_version 685015 (0.0008) [2023-12-26 05:05:38,635][123091] Updated weights for policy 0, policy_version 689497 (0.0006) [2023-12-26 05:05:38,700][123091] Updated weights for policy 0, policy_version 689507 (0.0005) [2023-12-26 05:05:38,761][123091] Updated weights for policy 0, policy_version 689517 (0.0010) [2023-12-26 05:05:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 351887360. Throughput: 0: 8785.7, 1: 8962.6. Samples: 351857696. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:38,784][121949] Avg episode reward: [(0, '6076.263'), (1, '5760.888')] [2023-12-26 05:05:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000689520_176521216.pth... [2023-12-26 05:05:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000685024_175366144.pth... [2023-12-26 05:05:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000688464_176250880.pth [2023-12-26 05:05:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000684000_175104000.pth [2023-12-26 05:05:39,222][123090] Updated weights for policy 1, policy_version 685025 (0.0008) [2023-12-26 05:05:39,287][123090] Updated weights for policy 1, policy_version 685035 (0.0011) [2023-12-26 05:05:39,360][123090] Updated weights for policy 1, policy_version 685045 (0.0010) [2023-12-26 05:05:39,441][123090] Updated weights for policy 1, policy_version 685055 (0.0011) [2023-12-26 05:05:39,583][123091] Updated weights for policy 0, policy_version 689527 (0.0010) [2023-12-26 05:05:39,649][123091] Updated weights for policy 0, policy_version 689537 (0.0008) [2023-12-26 05:05:39,715][123091] Updated weights for policy 0, policy_version 689547 (0.0010) [2023-12-26 05:05:40,271][123090] Updated weights for policy 1, policy_version 685065 (0.0011) [2023-12-26 05:05:40,336][123090] Updated weights for policy 1, policy_version 685075 (0.0011) [2023-12-26 05:05:40,397][123090] Updated weights for policy 1, policy_version 685085 (0.0010) [2023-12-26 05:05:40,581][123091] Updated weights for policy 0, policy_version 689557 (0.0010) [2023-12-26 05:05:40,646][123091] Updated weights for policy 0, policy_version 689567 (0.0011) [2023-12-26 05:05:40,712][123091] Updated weights for policy 0, policy_version 689577 (0.0010) [2023-12-26 05:05:41,108][123090] Updated weights for policy 1, policy_version 685095 (0.0009) [2023-12-26 05:05:41,184][123090] Updated weights for policy 1, policy_version 685105 (0.0011) [2023-12-26 05:05:41,257][123090] Updated weights for policy 1, policy_version 685115 (0.0011) [2023-12-26 05:05:41,523][123091] Updated weights for policy 0, policy_version 689587 (0.0010) [2023-12-26 05:05:41,591][123091] Updated weights for policy 0, policy_version 689597 (0.0008) [2023-12-26 05:05:41,663][123091] Updated weights for policy 0, policy_version 689607 (0.0010) [2023-12-26 05:05:42,044][123090] Updated weights for policy 1, policy_version 685125 (0.0009) [2023-12-26 05:05:42,104][123090] Updated weights for policy 1, policy_version 685135 (0.0011) [2023-12-26 05:05:42,168][123090] Updated weights for policy 1, policy_version 685145 (0.0011) [2023-12-26 05:05:42,457][123091] Updated weights for policy 0, policy_version 689617 (0.0010) [2023-12-26 05:05:42,520][123091] Updated weights for policy 0, policy_version 689627 (0.0010) [2023-12-26 05:05:42,580][123091] Updated weights for policy 0, policy_version 689637 (0.0010) [2023-12-26 05:05:42,656][123091] Updated weights for policy 0, policy_version 689647 (0.0010) [2023-12-26 05:05:42,969][123090] Updated weights for policy 1, policy_version 685155 (0.0009) [2023-12-26 05:05:43,043][123090] Updated weights for policy 1, policy_version 685165 (0.0006) [2023-12-26 05:05:43,121][123090] Updated weights for policy 1, policy_version 685175 (0.0005) [2023-12-26 05:05:43,498][123091] Updated weights for policy 0, policy_version 689657 (0.0008) [2023-12-26 05:05:43,572][123091] Updated weights for policy 0, policy_version 689667 (0.0008) [2023-12-26 05:05:43,641][123091] Updated weights for policy 0, policy_version 689677 (0.0007) [2023-12-26 05:05:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 351969280. Throughput: 0: 8866.8, 1: 8868.1. Samples: 351964396. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:43,785][121949] Avg episode reward: [(0, '6085.882'), (1, '5611.888')] [2023-12-26 05:05:43,873][123090] Updated weights for policy 1, policy_version 685185 (0.0006) [2023-12-26 05:05:43,930][123090] Updated weights for policy 1, policy_version 685195 (0.0009) [2023-12-26 05:05:43,983][123090] Updated weights for policy 1, policy_version 685205 (0.0010) [2023-12-26 05:05:44,035][123090] Updated weights for policy 1, policy_version 685215 (0.0009) [2023-12-26 05:05:44,288][123091] Updated weights for policy 0, policy_version 689687 (0.0006) [2023-12-26 05:05:44,358][123091] Updated weights for policy 0, policy_version 689697 (0.0009) [2023-12-26 05:05:44,423][123091] Updated weights for policy 0, policy_version 689707 (0.0010) [2023-12-26 05:05:44,836][123090] Updated weights for policy 1, policy_version 685225 (0.0010) [2023-12-26 05:05:44,897][123090] Updated weights for policy 1, policy_version 685235 (0.0008) [2023-12-26 05:05:44,965][123090] Updated weights for policy 1, policy_version 685245 (0.0006) [2023-12-26 05:05:45,105][123091] Updated weights for policy 0, policy_version 689717 (0.0008) [2023-12-26 05:05:45,160][123091] Updated weights for policy 0, policy_version 689727 (0.0006) [2023-12-26 05:05:45,225][123091] Updated weights for policy 0, policy_version 689737 (0.0006) [2023-12-26 05:05:45,745][123090] Updated weights for policy 1, policy_version 685255 (0.0008) [2023-12-26 05:05:45,816][123090] Updated weights for policy 1, policy_version 685265 (0.0009) [2023-12-26 05:05:45,880][123090] Updated weights for policy 1, policy_version 685275 (0.0009) [2023-12-26 05:05:45,932][123091] Updated weights for policy 0, policy_version 689747 (0.0006) [2023-12-26 05:05:45,987][123091] Updated weights for policy 0, policy_version 689757 (0.0009) [2023-12-26 05:05:46,046][123091] Updated weights for policy 0, policy_version 689767 (0.0009) [2023-12-26 05:05:46,733][123090] Updated weights for policy 1, policy_version 685285 (0.0010) [2023-12-26 05:05:46,782][123090] Updated weights for policy 1, policy_version 685295 (0.0009) [2023-12-26 05:05:46,836][123090] Updated weights for policy 1, policy_version 685305 (0.0010) [2023-12-26 05:05:46,894][123091] Updated weights for policy 0, policy_version 689777 (0.0009) [2023-12-26 05:05:46,949][123091] Updated weights for policy 0, policy_version 689787 (0.0010) [2023-12-26 05:05:46,998][123091] Updated weights for policy 0, policy_version 689797 (0.0009) [2023-12-26 05:05:47,055][123091] Updated weights for policy 0, policy_version 689807 (0.0010) [2023-12-26 05:05:47,706][123090] Updated weights for policy 1, policy_version 685315 (0.0008) [2023-12-26 05:05:47,770][123090] Updated weights for policy 1, policy_version 685325 (0.0006) [2023-12-26 05:05:47,824][123090] Updated weights for policy 1, policy_version 685335 (0.0009) [2023-12-26 05:05:47,875][123091] Updated weights for policy 0, policy_version 689817 (0.0008) [2023-12-26 05:05:47,927][123091] Updated weights for policy 0, policy_version 689827 (0.0009) [2023-12-26 05:05:47,981][123091] Updated weights for policy 0, policy_version 689837 (0.0009) [2023-12-26 05:05:48,592][123090] Updated weights for policy 1, policy_version 685345 (0.0008) [2023-12-26 05:05:48,658][123090] Updated weights for policy 1, policy_version 685355 (0.0006) [2023-12-26 05:05:48,731][123090] Updated weights for policy 1, policy_version 685365 (0.0006) [2023-12-26 05:05:48,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 352051200. Throughput: 0: 8890.0, 1: 8853.2. Samples: 352071460. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:48,785][121949] Avg episode reward: [(0, '6052.304'), (1, '5683.004')] [2023-12-26 05:05:48,794][123090] Updated weights for policy 1, policy_version 685375 (0.0006) [2023-12-26 05:05:48,858][123091] Updated weights for policy 0, policy_version 689847 (0.0009) [2023-12-26 05:05:48,919][123091] Updated weights for policy 0, policy_version 689857 (0.0009) [2023-12-26 05:05:48,979][123091] Updated weights for policy 0, policy_version 689867 (0.0009) [2023-12-26 05:05:49,381][123090] Updated weights for policy 1, policy_version 685385 (0.0007) [2023-12-26 05:05:49,443][123090] Updated weights for policy 1, policy_version 685395 (0.0006) [2023-12-26 05:05:49,507][123090] Updated weights for policy 1, policy_version 685405 (0.0005) [2023-12-26 05:05:49,922][123091] Updated weights for policy 0, policy_version 689877 (0.0009) [2023-12-26 05:05:49,987][123091] Updated weights for policy 0, policy_version 689887 (0.0006) [2023-12-26 05:05:50,057][123091] Updated weights for policy 0, policy_version 689897 (0.0007) [2023-12-26 05:05:50,195][123090] Updated weights for policy 1, policy_version 685415 (0.0007) [2023-12-26 05:05:50,263][123090] Updated weights for policy 1, policy_version 685425 (0.0006) [2023-12-26 05:05:50,331][123090] Updated weights for policy 1, policy_version 685435 (0.0006) [2023-12-26 05:05:50,898][123091] Updated weights for policy 0, policy_version 689907 (0.0008) [2023-12-26 05:05:50,962][123091] Updated weights for policy 0, policy_version 689917 (0.0008) [2023-12-26 05:05:50,976][123090] Updated weights for policy 1, policy_version 685445 (0.0008) [2023-12-26 05:05:51,030][123091] Updated weights for policy 0, policy_version 689927 (0.0006) [2023-12-26 05:05:51,045][123090] Updated weights for policy 1, policy_version 685455 (0.0010) [2023-12-26 05:05:51,105][123090] Updated weights for policy 1, policy_version 685465 (0.0010) [2023-12-26 05:05:51,764][123091] Updated weights for policy 0, policy_version 689937 (0.0007) [2023-12-26 05:05:51,813][123091] Updated weights for policy 0, policy_version 689947 (0.0009) [2023-12-26 05:05:51,875][123091] Updated weights for policy 0, policy_version 689957 (0.0010) [2023-12-26 05:05:51,926][123091] Updated weights for policy 0, policy_version 689967 (0.0009) [2023-12-26 05:05:51,953][123090] Updated weights for policy 1, policy_version 685475 (0.0011) [2023-12-26 05:05:52,013][123090] Updated weights for policy 1, policy_version 685485 (0.0009) [2023-12-26 05:05:52,075][123090] Updated weights for policy 1, policy_version 685495 (0.0010) [2023-12-26 05:05:52,805][123091] Updated weights for policy 0, policy_version 689977 (0.0008) [2023-12-26 05:05:52,863][123091] Updated weights for policy 0, policy_version 689987 (0.0008) [2023-12-26 05:05:52,889][123090] Updated weights for policy 1, policy_version 685505 (0.0009) [2023-12-26 05:05:52,931][123091] Updated weights for policy 0, policy_version 689997 (0.0008) [2023-12-26 05:05:52,944][123090] Updated weights for policy 1, policy_version 685515 (0.0006) [2023-12-26 05:05:53,004][123090] Updated weights for policy 1, policy_version 685525 (0.0005) [2023-12-26 05:05:53,070][123090] Updated weights for policy 1, policy_version 685535 (0.0006) [2023-12-26 05:05:53,644][123091] Updated weights for policy 0, policy_version 690007 (0.0006) [2023-12-26 05:05:53,707][123091] Updated weights for policy 0, policy_version 690017 (0.0005) [2023-12-26 05:05:53,772][123091] Updated weights for policy 0, policy_version 690027 (0.0006) [2023-12-26 05:05:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 352141312. Throughput: 0: 8879.4, 1: 8888.4. Samples: 352124400. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:53,785][121949] Avg episode reward: [(0, '6035.466'), (1, '5624.382')] [2023-12-26 05:05:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000690032_176652288.pth... [2023-12-26 05:05:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000688976_176381952.pth [2023-12-26 05:05:53,811][123090] Updated weights for policy 1, policy_version 685545 (0.0008) [2023-12-26 05:05:53,879][123090] Updated weights for policy 1, policy_version 685555 (0.0009) [2023-12-26 05:05:53,944][123090] Updated weights for policy 1, policy_version 685565 (0.0009) [2023-12-26 05:05:53,956][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000685568_175505408.pth... [2023-12-26 05:05:53,959][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000684512_175235072.pth [2023-12-26 05:05:54,522][123091] Updated weights for policy 0, policy_version 690037 (0.0010) [2023-12-26 05:05:54,579][123091] Updated weights for policy 0, policy_version 690047 (0.0010) [2023-12-26 05:05:54,629][123091] Updated weights for policy 0, policy_version 690057 (0.0010) [2023-12-26 05:05:54,766][123090] Updated weights for policy 1, policy_version 685575 (0.0007) [2023-12-26 05:05:54,815][123090] Updated weights for policy 1, policy_version 685585 (0.0009) [2023-12-26 05:05:54,880][123090] Updated weights for policy 1, policy_version 685595 (0.0007) [2023-12-26 05:05:55,344][123091] Updated weights for policy 0, policy_version 690067 (0.0005) [2023-12-26 05:05:55,405][123091] Updated weights for policy 0, policy_version 690077 (0.0005) [2023-12-26 05:05:55,464][123091] Updated weights for policy 0, policy_version 690087 (0.0006) [2023-12-26 05:05:55,609][123090] Updated weights for policy 1, policy_version 685605 (0.0008) [2023-12-26 05:05:55,676][123090] Updated weights for policy 1, policy_version 685615 (0.0010) [2023-12-26 05:05:55,731][123090] Updated weights for policy 1, policy_version 685625 (0.0010) [2023-12-26 05:05:56,133][123091] Updated weights for policy 0, policy_version 690097 (0.0006) [2023-12-26 05:05:56,201][123091] Updated weights for policy 0, policy_version 690107 (0.0009) [2023-12-26 05:05:56,266][123091] Updated weights for policy 0, policy_version 690117 (0.0009) [2023-12-26 05:05:56,328][123091] Updated weights for policy 0, policy_version 690127 (0.0009) [2023-12-26 05:05:56,501][123090] Updated weights for policy 1, policy_version 685635 (0.0010) [2023-12-26 05:05:56,549][123090] Updated weights for policy 1, policy_version 685645 (0.0009) [2023-12-26 05:05:56,600][123090] Updated weights for policy 1, policy_version 685656 (0.0009) [2023-12-26 05:05:57,069][123091] Updated weights for policy 0, policy_version 690137 (0.0006) [2023-12-26 05:05:57,137][123091] Updated weights for policy 0, policy_version 690147 (0.0005) [2023-12-26 05:05:57,196][123091] Updated weights for policy 0, policy_version 690157 (0.0005) [2023-12-26 05:05:57,364][123090] Updated weights for policy 1, policy_version 685666 (0.0006) [2023-12-26 05:05:57,415][123090] Updated weights for policy 1, policy_version 685676 (0.0005) [2023-12-26 05:05:57,462][123090] Updated weights for policy 1, policy_version 685686 (0.0005) [2023-12-26 05:05:57,518][123090] Updated weights for policy 1, policy_version 685696 (0.0006) [2023-12-26 05:05:57,827][123091] Updated weights for policy 0, policy_version 690167 (0.0005) [2023-12-26 05:05:57,874][123091] Updated weights for policy 0, policy_version 690177 (0.0007) [2023-12-26 05:05:57,921][123091] Updated weights for policy 0, policy_version 690187 (0.0010) [2023-12-26 05:05:58,227][123090] Updated weights for policy 1, policy_version 685706 (0.0006) [2023-12-26 05:05:58,290][123090] Updated weights for policy 1, policy_version 685716 (0.0006) [2023-12-26 05:05:58,364][123090] Updated weights for policy 1, policy_version 685726 (0.0007) [2023-12-26 05:05:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 352239616. Throughput: 0: 8984.7, 1: 8955.4. Samples: 352236300. Policy #0 lag: (min: 25.0, avg: 52.1, max: 57.0) [2023-12-26 05:05:58,785][121949] Avg episode reward: [(0, '6072.394'), (1, '5375.921')] [2023-12-26 05:05:58,864][123091] Updated weights for policy 0, policy_version 690197 (0.0011) [2023-12-26 05:05:58,930][123091] Updated weights for policy 0, policy_version 690207 (0.0006) [2023-12-26 05:05:59,003][123091] Updated weights for policy 0, policy_version 690217 (0.0006) [2023-12-26 05:05:59,208][123090] Updated weights for policy 1, policy_version 685736 (0.0009) [2023-12-26 05:05:59,279][123090] Updated weights for policy 1, policy_version 685746 (0.0009) [2023-12-26 05:05:59,348][123090] Updated weights for policy 1, policy_version 685756 (0.0006) [2023-12-26 05:05:59,675][123091] Updated weights for policy 0, policy_version 690227 (0.0007) [2023-12-26 05:05:59,741][123091] Updated weights for policy 0, policy_version 690237 (0.0007) [2023-12-26 05:05:59,794][123091] Updated weights for policy 0, policy_version 690247 (0.0006) [2023-12-26 05:06:00,125][123090] Updated weights for policy 1, policy_version 685766 (0.0010) [2023-12-26 05:06:00,174][123090] Updated weights for policy 1, policy_version 685776 (0.0010) [2023-12-26 05:06:00,222][123090] Updated weights for policy 1, policy_version 685786 (0.0010) [2023-12-26 05:06:00,422][123091] Updated weights for policy 0, policy_version 690257 (0.0009) [2023-12-26 05:06:00,482][123091] Updated weights for policy 0, policy_version 690267 (0.0009) [2023-12-26 05:06:00,551][123091] Updated weights for policy 0, policy_version 690277 (0.0007) [2023-12-26 05:06:00,615][123091] Updated weights for policy 0, policy_version 690287 (0.0007) [2023-12-26 05:06:01,107][123090] Updated weights for policy 1, policy_version 685796 (0.0009) [2023-12-26 05:06:01,178][123090] Updated weights for policy 1, policy_version 685806 (0.0008) [2023-12-26 05:06:01,241][123090] Updated weights for policy 1, policy_version 685816 (0.0008) [2023-12-26 05:06:01,421][123091] Updated weights for policy 0, policy_version 690297 (0.0010) [2023-12-26 05:06:01,480][123091] Updated weights for policy 0, policy_version 690307 (0.0008) [2023-12-26 05:06:01,544][123091] Updated weights for policy 0, policy_version 690317 (0.0009) [2023-12-26 05:06:02,019][123090] Updated weights for policy 1, policy_version 685826 (0.0009) [2023-12-26 05:06:02,072][123090] Updated weights for policy 1, policy_version 685836 (0.0006) [2023-12-26 05:06:02,125][123090] Updated weights for policy 1, policy_version 685846 (0.0009) [2023-12-26 05:06:02,176][123090] Updated weights for policy 1, policy_version 685856 (0.0008) [2023-12-26 05:06:02,406][123091] Updated weights for policy 0, policy_version 690327 (0.0010) [2023-12-26 05:06:02,460][123091] Updated weights for policy 0, policy_version 690337 (0.0010) [2023-12-26 05:06:02,515][123091] Updated weights for policy 0, policy_version 690347 (0.0009) [2023-12-26 05:06:03,021][123090] Updated weights for policy 1, policy_version 685866 (0.0006) [2023-12-26 05:06:03,074][123090] Updated weights for policy 1, policy_version 685876 (0.0006) [2023-12-26 05:06:03,129][123090] Updated weights for policy 1, policy_version 685886 (0.0007) [2023-12-26 05:06:03,307][123091] Updated weights for policy 0, policy_version 690357 (0.0007) [2023-12-26 05:06:03,354][123091] Updated weights for policy 0, policy_version 690367 (0.0006) [2023-12-26 05:06:03,399][123091] Updated weights for policy 0, policy_version 690377 (0.0006) [2023-12-26 05:06:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 352329728. Throughput: 0: 8993.6, 1: 8879.4. Samples: 352342940. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:03,785][121949] Avg episode reward: [(0, '6019.216'), (1, '5479.109')] [2023-12-26 05:06:03,901][123090] Updated weights for policy 1, policy_version 685896 (0.0009) [2023-12-26 05:06:03,966][123090] Updated weights for policy 1, policy_version 685906 (0.0008) [2023-12-26 05:06:04,021][123090] Updated weights for policy 1, policy_version 685916 (0.0010) [2023-12-26 05:06:04,112][123091] Updated weights for policy 0, policy_version 690387 (0.0006) [2023-12-26 05:06:04,163][123091] Updated weights for policy 0, policy_version 690397 (0.0005) [2023-12-26 05:06:04,222][123091] Updated weights for policy 0, policy_version 690407 (0.0006) [2023-12-26 05:06:04,906][123090] Updated weights for policy 1, policy_version 685926 (0.0010) [2023-12-26 05:06:04,928][123091] Updated weights for policy 0, policy_version 690417 (0.0006) [2023-12-26 05:06:04,958][123090] Updated weights for policy 1, policy_version 685936 (0.0009) [2023-12-26 05:06:04,981][123091] Updated weights for policy 0, policy_version 690427 (0.0010) [2023-12-26 05:06:05,012][123090] Updated weights for policy 1, policy_version 685946 (0.0007) [2023-12-26 05:06:05,032][123091] Updated weights for policy 0, policy_version 690437 (0.0010) [2023-12-26 05:06:05,084][123091] Updated weights for policy 0, policy_version 690447 (0.0008) [2023-12-26 05:06:05,856][123090] Updated weights for policy 1, policy_version 685956 (0.0008) [2023-12-26 05:06:05,898][123091] Updated weights for policy 0, policy_version 690457 (0.0007) [2023-12-26 05:06:05,920][123090] Updated weights for policy 1, policy_version 685966 (0.0009) [2023-12-26 05:06:05,955][123091] Updated weights for policy 0, policy_version 690467 (0.0007) [2023-12-26 05:06:05,983][123090] Updated weights for policy 1, policy_version 685976 (0.0009) [2023-12-26 05:06:06,017][123091] Updated weights for policy 0, policy_version 690477 (0.0007) [2023-12-26 05:06:06,813][123090] Updated weights for policy 1, policy_version 685986 (0.0010) [2023-12-26 05:06:06,857][123091] Updated weights for policy 0, policy_version 690487 (0.0007) [2023-12-26 05:06:06,877][123090] Updated weights for policy 1, policy_version 685996 (0.0010) [2023-12-26 05:06:06,910][123091] Updated weights for policy 0, policy_version 690497 (0.0007) [2023-12-26 05:06:06,941][123090] Updated weights for policy 1, policy_version 686006 (0.0009) [2023-12-26 05:06:06,967][123091] Updated weights for policy 0, policy_version 690507 (0.0009) [2023-12-26 05:06:06,994][123090] Updated weights for policy 1, policy_version 686016 (0.0007) [2023-12-26 05:06:07,781][123090] Updated weights for policy 1, policy_version 686026 (0.0006) [2023-12-26 05:06:07,834][123091] Updated weights for policy 0, policy_version 690517 (0.0009) [2023-12-26 05:06:07,834][123090] Updated weights for policy 1, policy_version 686036 (0.0005) [2023-12-26 05:06:07,892][123090] Updated weights for policy 1, policy_version 686046 (0.0006) [2023-12-26 05:06:07,895][123091] Updated weights for policy 0, policy_version 690527 (0.0009) [2023-12-26 05:06:07,956][123091] Updated weights for policy 0, policy_version 690537 (0.0009) [2023-12-26 05:06:08,727][123090] Updated weights for policy 1, policy_version 686056 (0.0010) [2023-12-26 05:06:08,759][123091] Updated weights for policy 0, policy_version 690547 (0.0009) [2023-12-26 05:06:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 352411648. Throughput: 0: 9060.1, 1: 8875.6. Samples: 352396124. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:08,785][121949] Avg episode reward: [(0, '6021.937'), (1, '5796.802')] [2023-12-26 05:06:08,789][123090] Updated weights for policy 1, policy_version 686066 (0.0008) [2023-12-26 05:06:08,814][123091] Updated weights for policy 0, policy_version 690557 (0.0009) [2023-12-26 05:06:08,847][123090] Updated weights for policy 1, policy_version 686076 (0.0007) [2023-12-26 05:06:08,870][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000686080_175636480.pth... [2023-12-26 05:06:08,872][123091] Updated weights for policy 0, policy_version 690567 (0.0009) [2023-12-26 05:06:08,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000685024_175366144.pth [2023-12-26 05:06:08,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000690576_176791552.pth... [2023-12-26 05:06:08,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000689520_176521216.pth [2023-12-26 05:06:09,663][123090] Updated weights for policy 1, policy_version 686086 (0.0006) [2023-12-26 05:06:09,722][123091] Updated weights for policy 0, policy_version 690577 (0.0009) [2023-12-26 05:06:09,735][123090] Updated weights for policy 1, policy_version 686096 (0.0009) [2023-12-26 05:06:09,795][123091] Updated weights for policy 0, policy_version 690587 (0.0005) [2023-12-26 05:06:09,805][123090] Updated weights for policy 1, policy_version 686106 (0.0009) [2023-12-26 05:06:09,864][123091] Updated weights for policy 0, policy_version 690597 (0.0007) [2023-12-26 05:06:09,931][123091] Updated weights for policy 0, policy_version 690607 (0.0008) [2023-12-26 05:06:10,548][123090] Updated weights for policy 1, policy_version 686116 (0.0010) [2023-12-26 05:06:10,616][123090] Updated weights for policy 1, policy_version 686126 (0.0011) [2023-12-26 05:06:10,627][123091] Updated weights for policy 0, policy_version 690617 (0.0009) [2023-12-26 05:06:10,678][123090] Updated weights for policy 1, policy_version 686136 (0.0010) [2023-12-26 05:06:10,692][123091] Updated weights for policy 0, policy_version 690627 (0.0008) [2023-12-26 05:06:10,751][123091] Updated weights for policy 0, policy_version 690637 (0.0009) [2023-12-26 05:06:11,555][123090] Updated weights for policy 1, policy_version 686146 (0.0009) [2023-12-26 05:06:11,569][123091] Updated weights for policy 0, policy_version 690647 (0.0009) [2023-12-26 05:06:11,615][123090] Updated weights for policy 1, policy_version 686156 (0.0010) [2023-12-26 05:06:11,638][123091] Updated weights for policy 0, policy_version 690657 (0.0009) [2023-12-26 05:06:11,685][123090] Updated weights for policy 1, policy_version 686166 (0.0008) [2023-12-26 05:06:11,700][123091] Updated weights for policy 0, policy_version 690667 (0.0008) [2023-12-26 05:06:11,755][123090] Updated weights for policy 1, policy_version 686176 (0.0009) [2023-12-26 05:06:12,504][123091] Updated weights for policy 0, policy_version 690677 (0.0009) [2023-12-26 05:06:12,568][123091] Updated weights for policy 0, policy_version 690687 (0.0008) [2023-12-26 05:06:12,615][123090] Updated weights for policy 1, policy_version 686186 (0.0006) [2023-12-26 05:06:12,627][123091] Updated weights for policy 0, policy_version 690697 (0.0009) [2023-12-26 05:06:12,686][123090] Updated weights for policy 1, policy_version 686196 (0.0008) [2023-12-26 05:06:12,755][123090] Updated weights for policy 1, policy_version 686206 (0.0009) [2023-12-26 05:06:13,414][123090] Updated weights for policy 1, policy_version 686216 (0.0006) [2023-12-26 05:06:13,439][123091] Updated weights for policy 0, policy_version 690707 (0.0007) [2023-12-26 05:06:13,467][123090] Updated weights for policy 1, policy_version 686226 (0.0005) [2023-12-26 05:06:13,498][123091] Updated weights for policy 0, policy_version 690717 (0.0008) [2023-12-26 05:06:13,531][123090] Updated weights for policy 1, policy_version 686236 (0.0007) [2023-12-26 05:06:13,556][123091] Updated weights for policy 0, policy_version 690727 (0.0009) [2023-12-26 05:06:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 352509952. Throughput: 0: 8966.6, 1: 8824.7. Samples: 352498580. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:13,784][121949] Avg episode reward: [(0, '5961.224'), (1, '5900.513')] [2023-12-26 05:06:14,271][123090] Updated weights for policy 1, policy_version 686246 (0.0006) [2023-12-26 05:06:14,337][123090] Updated weights for policy 1, policy_version 686256 (0.0007) [2023-12-26 05:06:14,398][123090] Updated weights for policy 1, policy_version 686266 (0.0009) [2023-12-26 05:06:14,428][123091] Updated weights for policy 0, policy_version 690738 (0.0010) [2023-12-26 05:06:14,489][123091] Updated weights for policy 0, policy_version 690748 (0.0010) [2023-12-26 05:06:14,541][123091] Updated weights for policy 0, policy_version 690758 (0.0009) [2023-12-26 05:06:14,590][123091] Updated weights for policy 0, policy_version 690768 (0.0009) [2023-12-26 05:06:15,212][123090] Updated weights for policy 1, policy_version 686276 (0.0009) [2023-12-26 05:06:15,279][123090] Updated weights for policy 1, policy_version 686286 (0.0010) [2023-12-26 05:06:15,344][123090] Updated weights for policy 1, policy_version 686296 (0.0010) [2023-12-26 05:06:15,396][123091] Updated weights for policy 0, policy_version 690778 (0.0007) [2023-12-26 05:06:15,456][123091] Updated weights for policy 0, policy_version 690788 (0.0009) [2023-12-26 05:06:15,516][123091] Updated weights for policy 0, policy_version 690798 (0.0010) [2023-12-26 05:06:16,084][123090] Updated weights for policy 1, policy_version 686306 (0.0008) [2023-12-26 05:06:16,147][123090] Updated weights for policy 1, policy_version 686316 (0.0010) [2023-12-26 05:06:16,198][123090] Updated weights for policy 1, policy_version 686326 (0.0008) [2023-12-26 05:06:16,263][123090] Updated weights for policy 1, policy_version 686336 (0.0005) [2023-12-26 05:06:16,269][123091] Updated weights for policy 0, policy_version 690808 (0.0006) [2023-12-26 05:06:16,326][123091] Updated weights for policy 0, policy_version 690818 (0.0005) [2023-12-26 05:06:16,382][123091] Updated weights for policy 0, policy_version 690828 (0.0005) [2023-12-26 05:06:17,026][123090] Updated weights for policy 1, policy_version 686346 (0.0010) [2023-12-26 05:06:17,090][123090] Updated weights for policy 1, policy_version 686356 (0.0010) [2023-12-26 05:06:17,111][123091] Updated weights for policy 0, policy_version 690838 (0.0006) [2023-12-26 05:06:17,148][123090] Updated weights for policy 1, policy_version 686366 (0.0010) [2023-12-26 05:06:17,169][123091] Updated weights for policy 0, policy_version 690848 (0.0007) [2023-12-26 05:06:17,242][123091] Updated weights for policy 0, policy_version 690858 (0.0009) [2023-12-26 05:06:17,980][123091] Updated weights for policy 0, policy_version 690868 (0.0009) [2023-12-26 05:06:18,008][123090] Updated weights for policy 1, policy_version 686376 (0.0011) [2023-12-26 05:06:18,037][123091] Updated weights for policy 0, policy_version 690878 (0.0006) [2023-12-26 05:06:18,084][123090] Updated weights for policy 1, policy_version 686386 (0.0011) [2023-12-26 05:06:18,114][123091] Updated weights for policy 0, policy_version 690888 (0.0006) [2023-12-26 05:06:18,156][123090] Updated weights for policy 1, policy_version 686396 (0.0010) [2023-12-26 05:06:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 352591872. Throughput: 0: 9005.6, 1: 8853.3. Samples: 352607796. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:18,785][121949] Avg episode reward: [(0, '6038.168'), (1, '5797.030')] [2023-12-26 05:06:18,810][123091] Updated weights for policy 0, policy_version 690898 (0.0006) [2023-12-26 05:06:18,884][123091] Updated weights for policy 0, policy_version 690908 (0.0010) [2023-12-26 05:06:18,890][123090] Updated weights for policy 1, policy_version 686406 (0.0010) [2023-12-26 05:06:18,952][123091] Updated weights for policy 0, policy_version 690918 (0.0006) [2023-12-26 05:06:18,955][123090] Updated weights for policy 1, policy_version 686416 (0.0009) [2023-12-26 05:06:19,015][123090] Updated weights for policy 1, policy_version 686426 (0.0009) [2023-12-26 05:06:19,023][123091] Updated weights for policy 0, policy_version 690928 (0.0006) [2023-12-26 05:06:19,737][123091] Updated weights for policy 0, policy_version 690938 (0.0010) [2023-12-26 05:06:19,790][123091] Updated weights for policy 0, policy_version 690948 (0.0006) [2023-12-26 05:06:19,831][123090] Updated weights for policy 1, policy_version 686436 (0.0009) [2023-12-26 05:06:19,864][123091] Updated weights for policy 0, policy_version 690958 (0.0008) [2023-12-26 05:06:19,902][123090] Updated weights for policy 1, policy_version 686446 (0.0008) [2023-12-26 05:06:19,963][123090] Updated weights for policy 1, policy_version 686456 (0.0007) [2023-12-26 05:06:20,613][123091] Updated weights for policy 0, policy_version 690968 (0.0011) [2023-12-26 05:06:20,670][123091] Updated weights for policy 0, policy_version 690978 (0.0011) [2023-12-26 05:06:20,670][123090] Updated weights for policy 1, policy_version 686466 (0.0007) [2023-12-26 05:06:20,733][123090] Updated weights for policy 1, policy_version 686476 (0.0008) [2023-12-26 05:06:20,738][123091] Updated weights for policy 0, policy_version 690988 (0.0011) [2023-12-26 05:06:20,797][123090] Updated weights for policy 1, policy_version 686486 (0.0006) [2023-12-26 05:06:20,865][123090] Updated weights for policy 1, policy_version 686496 (0.0006) [2023-12-26 05:06:21,606][123090] Updated weights for policy 1, policy_version 686506 (0.0009) [2023-12-26 05:06:21,631][123091] Updated weights for policy 0, policy_version 690998 (0.0011) [2023-12-26 05:06:21,673][123090] Updated weights for policy 1, policy_version 686516 (0.0009) [2023-12-26 05:06:21,692][123091] Updated weights for policy 0, policy_version 691008 (0.0011) [2023-12-26 05:06:21,743][123090] Updated weights for policy 1, policy_version 686526 (0.0006) [2023-12-26 05:06:21,758][123091] Updated weights for policy 0, policy_version 691018 (0.0011) [2023-12-26 05:06:22,589][123090] Updated weights for policy 1, policy_version 686536 (0.0008) [2023-12-26 05:06:22,612][123091] Updated weights for policy 0, policy_version 691028 (0.0011) [2023-12-26 05:06:22,649][123090] Updated weights for policy 1, policy_version 686546 (0.0006) [2023-12-26 05:06:22,675][123091] Updated weights for policy 0, policy_version 691038 (0.0011) [2023-12-26 05:06:22,714][123090] Updated weights for policy 1, policy_version 686556 (0.0010) [2023-12-26 05:06:22,739][123091] Updated weights for policy 0, policy_version 691048 (0.0011) [2023-12-26 05:06:23,519][123090] Updated weights for policy 1, policy_version 686566 (0.0007) [2023-12-26 05:06:23,549][123091] Updated weights for policy 0, policy_version 691058 (0.0010) [2023-12-26 05:06:23,565][123090] Updated weights for policy 1, policy_version 686576 (0.0005) [2023-12-26 05:06:23,611][123091] Updated weights for policy 0, policy_version 691068 (0.0006) [2023-12-26 05:06:23,625][123090] Updated weights for policy 1, policy_version 686586 (0.0005) [2023-12-26 05:06:23,678][123091] Updated weights for policy 0, policy_version 691078 (0.0006) [2023-12-26 05:06:23,744][123091] Updated weights for policy 0, policy_version 691088 (0.0005) [2023-12-26 05:06:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 352690176. Throughput: 0: 8993.9, 1: 8884.6. Samples: 352662232. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:23,785][121949] Avg episode reward: [(0, '6139.611'), (1, '5812.739')] [2023-12-26 05:06:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000691088_176922624.pth... [2023-12-26 05:06:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000686592_175767552.pth... [2023-12-26 05:06:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000690032_176652288.pth [2023-12-26 05:06:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000685568_175505408.pth [2023-12-26 05:06:24,316][123090] Updated weights for policy 1, policy_version 686596 (0.0005) [2023-12-26 05:06:24,322][123091] Updated weights for policy 0, policy_version 691098 (0.0009) [2023-12-26 05:06:24,386][123090] Updated weights for policy 1, policy_version 686606 (0.0006) [2023-12-26 05:06:24,391][123091] Updated weights for policy 0, policy_version 691108 (0.0006) [2023-12-26 05:06:24,454][123090] Updated weights for policy 1, policy_version 686616 (0.0005) [2023-12-26 05:06:24,463][123091] Updated weights for policy 0, policy_version 691118 (0.0005) [2023-12-26 05:06:25,270][123090] Updated weights for policy 1, policy_version 686626 (0.0008) [2023-12-26 05:06:25,271][123091] Updated weights for policy 0, policy_version 691128 (0.0011) [2023-12-26 05:06:25,327][123090] Updated weights for policy 1, policy_version 686636 (0.0010) [2023-12-26 05:06:25,330][123091] Updated weights for policy 0, policy_version 691138 (0.0010) [2023-12-26 05:06:25,373][123091] Updated weights for policy 0, policy_version 691148 (0.0010) [2023-12-26 05:06:25,388][123090] Updated weights for policy 1, policy_version 686646 (0.0008) [2023-12-26 05:06:25,451][123090] Updated weights for policy 1, policy_version 686656 (0.0008) [2023-12-26 05:06:26,203][123091] Updated weights for policy 0, policy_version 691158 (0.0007) [2023-12-26 05:06:26,258][123091] Updated weights for policy 0, policy_version 691168 (0.0005) [2023-12-26 05:06:26,288][123090] Updated weights for policy 1, policy_version 686666 (0.0009) [2023-12-26 05:06:26,317][123091] Updated weights for policy 0, policy_version 691178 (0.0007) [2023-12-26 05:06:26,349][123090] Updated weights for policy 1, policy_version 686676 (0.0009) [2023-12-26 05:06:26,422][123090] Updated weights for policy 1, policy_version 686686 (0.0010) [2023-12-26 05:06:27,083][123091] Updated weights for policy 0, policy_version 691188 (0.0008) [2023-12-26 05:06:27,107][123090] Updated weights for policy 1, policy_version 686696 (0.0008) [2023-12-26 05:06:27,149][123091] Updated weights for policy 0, policy_version 691198 (0.0010) [2023-12-26 05:06:27,160][123090] Updated weights for policy 1, policy_version 686706 (0.0008) [2023-12-26 05:06:27,199][123091] Updated weights for policy 0, policy_version 691208 (0.0010) [2023-12-26 05:06:27,211][123090] Updated weights for policy 1, policy_version 686716 (0.0007) [2023-12-26 05:06:27,887][123090] Updated weights for policy 1, policy_version 686726 (0.0007) [2023-12-26 05:06:27,939][123090] Updated weights for policy 1, policy_version 686736 (0.0005) [2023-12-26 05:06:27,989][123090] Updated weights for policy 1, policy_version 686746 (0.0006) [2023-12-26 05:06:28,018][123091] Updated weights for policy 0, policy_version 691218 (0.0010) [2023-12-26 05:06:28,073][123091] Updated weights for policy 0, policy_version 691228 (0.0007) [2023-12-26 05:06:28,138][123091] Updated weights for policy 0, policy_version 691238 (0.0005) [2023-12-26 05:06:28,208][123091] Updated weights for policy 0, policy_version 691248 (0.0005) [2023-12-26 05:06:28,718][123090] Updated weights for policy 1, policy_version 686756 (0.0008) [2023-12-26 05:06:28,773][123090] Updated weights for policy 1, policy_version 686766 (0.0010) [2023-12-26 05:06:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 352772096. Throughput: 0: 8973.7, 1: 8926.1. Samples: 352769884. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:28,785][121949] Avg episode reward: [(0, '6194.962'), (1, '5660.580')] [2023-12-26 05:06:28,829][123090] Updated weights for policy 1, policy_version 686776 (0.0010) [2023-12-26 05:06:28,876][123091] Updated weights for policy 0, policy_version 691258 (0.0007) [2023-12-26 05:06:28,927][123091] Updated weights for policy 0, policy_version 691268 (0.0009) [2023-12-26 05:06:28,985][123091] Updated weights for policy 0, policy_version 691278 (0.0009) [2023-12-26 05:06:29,651][123090] Updated weights for policy 1, policy_version 686786 (0.0010) [2023-12-26 05:06:29,709][123090] Updated weights for policy 1, policy_version 686796 (0.0010) [2023-12-26 05:06:29,777][123090] Updated weights for policy 1, policy_version 686806 (0.0010) [2023-12-26 05:06:29,797][123091] Updated weights for policy 0, policy_version 691288 (0.0008) [2023-12-26 05:06:29,842][123090] Updated weights for policy 1, policy_version 686816 (0.0007) [2023-12-26 05:06:29,861][123091] Updated weights for policy 0, policy_version 691298 (0.0009) [2023-12-26 05:06:29,930][123091] Updated weights for policy 0, policy_version 691308 (0.0008) [2023-12-26 05:06:30,641][123090] Updated weights for policy 1, policy_version 686826 (0.0010) [2023-12-26 05:06:30,694][123090] Updated weights for policy 1, policy_version 686836 (0.0009) [2023-12-26 05:06:30,734][123091] Updated weights for policy 0, policy_version 691318 (0.0009) [2023-12-26 05:06:30,750][123090] Updated weights for policy 1, policy_version 686846 (0.0008) [2023-12-26 05:06:30,794][123091] Updated weights for policy 0, policy_version 691328 (0.0008) [2023-12-26 05:06:30,847][123091] Updated weights for policy 0, policy_version 691338 (0.0009) [2023-12-26 05:06:31,539][123090] Updated weights for policy 1, policy_version 686856 (0.0006) [2023-12-26 05:06:31,609][123090] Updated weights for policy 1, policy_version 686866 (0.0006) [2023-12-26 05:06:31,675][123090] Updated weights for policy 1, policy_version 686876 (0.0009) [2023-12-26 05:06:31,746][123091] Updated weights for policy 0, policy_version 691348 (0.0009) [2023-12-26 05:06:31,809][123091] Updated weights for policy 0, policy_version 691358 (0.0011) [2023-12-26 05:06:31,857][123091] Updated weights for policy 0, policy_version 691368 (0.0009) [2023-12-26 05:06:32,402][123090] Updated weights for policy 1, policy_version 686886 (0.0008) [2023-12-26 05:06:32,461][123090] Updated weights for policy 1, policy_version 686896 (0.0006) [2023-12-26 05:06:32,522][123090] Updated weights for policy 1, policy_version 686906 (0.0007) [2023-12-26 05:06:32,658][123091] Updated weights for policy 0, policy_version 691378 (0.0009) [2023-12-26 05:06:32,727][123091] Updated weights for policy 0, policy_version 691388 (0.0010) [2023-12-26 05:06:32,778][123091] Updated weights for policy 0, policy_version 691398 (0.0010) [2023-12-26 05:06:32,829][123091] Updated weights for policy 0, policy_version 691408 (0.0010) [2023-12-26 05:06:33,296][123090] Updated weights for policy 1, policy_version 686916 (0.0010) [2023-12-26 05:06:33,355][123090] Updated weights for policy 1, policy_version 686926 (0.0008) [2023-12-26 05:06:33,419][123090] Updated weights for policy 1, policy_version 686936 (0.0008) [2023-12-26 05:06:33,594][123091] Updated weights for policy 0, policy_version 691418 (0.0007) [2023-12-26 05:06:33,659][123091] Updated weights for policy 0, policy_version 691428 (0.0005) [2023-12-26 05:06:33,710][123091] Updated weights for policy 0, policy_version 691438 (0.0005) [2023-12-26 05:06:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 352870400. Throughput: 0: 8949.5, 1: 8977.7. Samples: 352878184. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:33,785][121949] Avg episode reward: [(0, '6111.162'), (1, '5412.972')] [2023-12-26 05:06:34,324][123090] Updated weights for policy 1, policy_version 686946 (0.0009) [2023-12-26 05:06:34,377][123091] Updated weights for policy 0, policy_version 691448 (0.0006) [2023-12-26 05:06:34,385][123090] Updated weights for policy 1, policy_version 686956 (0.0008) [2023-12-26 05:06:34,442][123091] Updated weights for policy 0, policy_version 691458 (0.0007) [2023-12-26 05:06:34,448][123090] Updated weights for policy 1, policy_version 686966 (0.0009) [2023-12-26 05:06:34,500][123090] Updated weights for policy 1, policy_version 686976 (0.0009) [2023-12-26 05:06:34,505][123091] Updated weights for policy 0, policy_version 691468 (0.0008) [2023-12-26 05:06:35,287][123091] Updated weights for policy 0, policy_version 691478 (0.0008) [2023-12-26 05:06:35,364][123091] Updated weights for policy 0, policy_version 691488 (0.0005) [2023-12-26 05:06:35,366][123090] Updated weights for policy 1, policy_version 686986 (0.0009) [2023-12-26 05:06:35,418][123090] Updated weights for policy 1, policy_version 686996 (0.0008) [2023-12-26 05:06:35,430][123091] Updated weights for policy 0, policy_version 691498 (0.0005) [2023-12-26 05:06:35,467][123090] Updated weights for policy 1, policy_version 687006 (0.0009) [2023-12-26 05:06:36,060][123091] Updated weights for policy 0, policy_version 691508 (0.0005) [2023-12-26 05:06:36,122][123091] Updated weights for policy 0, policy_version 691518 (0.0007) [2023-12-26 05:06:36,178][123090] Updated weights for policy 1, policy_version 687016 (0.0009) [2023-12-26 05:06:36,188][123091] Updated weights for policy 0, policy_version 691528 (0.0006) [2023-12-26 05:06:36,244][123090] Updated weights for policy 1, policy_version 687026 (0.0010) [2023-12-26 05:06:36,301][123090] Updated weights for policy 1, policy_version 687036 (0.0010) [2023-12-26 05:06:36,988][123091] Updated weights for policy 0, policy_version 691538 (0.0006) [2023-12-26 05:06:37,035][123091] Updated weights for policy 0, policy_version 691548 (0.0005) [2023-12-26 05:06:37,083][123091] Updated weights for policy 0, policy_version 691558 (0.0005) [2023-12-26 05:06:37,144][123091] Updated weights for policy 0, policy_version 691568 (0.0006) [2023-12-26 05:06:37,158][123090] Updated weights for policy 1, policy_version 687046 (0.0007) [2023-12-26 05:06:37,206][123090] Updated weights for policy 1, policy_version 687056 (0.0005) [2023-12-26 05:06:37,259][123090] Updated weights for policy 1, policy_version 687066 (0.0008) [2023-12-26 05:06:37,820][123091] Updated weights for policy 0, policy_version 691578 (0.0011) [2023-12-26 05:06:37,876][123091] Updated weights for policy 0, policy_version 691588 (0.0011) [2023-12-26 05:06:37,939][123091] Updated weights for policy 0, policy_version 691598 (0.0011) [2023-12-26 05:06:37,965][123090] Updated weights for policy 1, policy_version 687077 (0.0010) [2023-12-26 05:06:38,022][123090] Updated weights for policy 1, policy_version 687087 (0.0006) [2023-12-26 05:06:38,074][123090] Updated weights for policy 1, policy_version 687097 (0.0005) [2023-12-26 05:06:38,777][123091] Updated weights for policy 0, policy_version 691608 (0.0010) [2023-12-26 05:06:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 352952320. Throughput: 0: 9055.6, 1: 8911.8. Samples: 352932932. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:38,785][121949] Avg episode reward: [(0, '5962.242'), (1, '5286.538')] [2023-12-26 05:06:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000687104_175898624.pth... [2023-12-26 05:06:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000686080_175636480.pth [2023-12-26 05:06:38,841][123091] Updated weights for policy 0, policy_version 691618 (0.0011) [2023-12-26 05:06:38,843][123090] Updated weights for policy 1, policy_version 687107 (0.0007) [2023-12-26 05:06:38,895][123091] Updated weights for policy 0, policy_version 691628 (0.0011) [2023-12-26 05:06:38,901][123090] Updated weights for policy 1, policy_version 687117 (0.0005) [2023-12-26 05:06:38,915][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000691632_177061888.pth... [2023-12-26 05:06:38,920][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000690576_176791552.pth [2023-12-26 05:06:38,960][123090] Updated weights for policy 1, policy_version 687127 (0.0006) [2023-12-26 05:06:39,716][123090] Updated weights for policy 1, policy_version 687137 (0.0006) [2023-12-26 05:06:39,777][123091] Updated weights for policy 0, policy_version 691638 (0.0011) [2023-12-26 05:06:39,782][123090] Updated weights for policy 1, policy_version 687147 (0.0006) [2023-12-26 05:06:39,841][123090] Updated weights for policy 1, policy_version 687157 (0.0010) [2023-12-26 05:06:39,842][123091] Updated weights for policy 0, policy_version 691648 (0.0011) [2023-12-26 05:06:39,906][123091] Updated weights for policy 0, policy_version 691658 (0.0009) [2023-12-26 05:06:39,910][123090] Updated weights for policy 1, policy_version 687167 (0.0011) [2023-12-26 05:06:40,719][123090] Updated weights for policy 1, policy_version 687177 (0.0006) [2023-12-26 05:06:40,753][123091] Updated weights for policy 0, policy_version 691668 (0.0013) [2023-12-26 05:06:40,781][123090] Updated weights for policy 1, policy_version 687187 (0.0010) [2023-12-26 05:06:40,805][123091] Updated weights for policy 0, policy_version 691678 (0.0005) [2023-12-26 05:06:40,836][123090] Updated weights for policy 1, policy_version 687197 (0.0010) [2023-12-26 05:06:40,879][123091] Updated weights for policy 0, policy_version 691688 (0.0005) [2023-12-26 05:06:41,700][123090] Updated weights for policy 1, policy_version 687207 (0.0009) [2023-12-26 05:06:41,701][123091] Updated weights for policy 0, policy_version 691698 (0.0008) [2023-12-26 05:06:41,774][123091] Updated weights for policy 0, policy_version 691708 (0.0009) [2023-12-26 05:06:41,778][123090] Updated weights for policy 1, policy_version 687217 (0.0008) [2023-12-26 05:06:41,842][123091] Updated weights for policy 0, policy_version 691718 (0.0009) [2023-12-26 05:06:41,843][123090] Updated weights for policy 1, policy_version 687227 (0.0008) [2023-12-26 05:06:41,902][123091] Updated weights for policy 0, policy_version 691728 (0.0008) [2023-12-26 05:06:42,639][123090] Updated weights for policy 1, policy_version 687237 (0.0009) [2023-12-26 05:06:42,703][123090] Updated weights for policy 1, policy_version 687247 (0.0009) [2023-12-26 05:06:42,758][123090] Updated weights for policy 1, policy_version 687257 (0.0007) [2023-12-26 05:06:42,778][123091] Updated weights for policy 0, policy_version 691738 (0.0009) [2023-12-26 05:06:42,835][123091] Updated weights for policy 0, policy_version 691748 (0.0009) [2023-12-26 05:06:42,895][123091] Updated weights for policy 0, policy_version 691758 (0.0009) [2023-12-26 05:06:43,592][123090] Updated weights for policy 1, policy_version 687267 (0.0010) [2023-12-26 05:06:43,648][123090] Updated weights for policy 1, policy_version 687277 (0.0009) [2023-12-26 05:06:43,707][123090] Updated weights for policy 1, policy_version 687287 (0.0009) [2023-12-26 05:06:43,731][123091] Updated weights for policy 0, policy_version 691768 (0.0008) [2023-12-26 05:06:43,784][123091] Updated weights for policy 0, policy_version 691778 (0.0009) [2023-12-26 05:06:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 353042432. Throughput: 0: 8934.0, 1: 8870.4. Samples: 353037500. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:43,785][121949] Avg episode reward: [(0, '5849.560'), (1, '5218.396')] [2023-12-26 05:06:43,842][123091] Updated weights for policy 0, policy_version 691788 (0.0009) [2023-12-26 05:06:44,546][123090] Updated weights for policy 1, policy_version 687297 (0.0009) [2023-12-26 05:06:44,609][123090] Updated weights for policy 1, policy_version 687307 (0.0009) [2023-12-26 05:06:44,667][123090] Updated weights for policy 1, policy_version 687317 (0.0009) [2023-12-26 05:06:44,686][123091] Updated weights for policy 0, policy_version 691798 (0.0009) [2023-12-26 05:06:44,728][123090] Updated weights for policy 1, policy_version 687327 (0.0008) [2023-12-26 05:06:44,745][123091] Updated weights for policy 0, policy_version 691808 (0.0008) [2023-12-26 05:06:44,811][123091] Updated weights for policy 0, policy_version 691818 (0.0009) [2023-12-26 05:06:45,561][123090] Updated weights for policy 1, policy_version 687337 (0.0010) [2023-12-26 05:06:45,632][123090] Updated weights for policy 1, policy_version 687347 (0.0008) [2023-12-26 05:06:45,640][123091] Updated weights for policy 0, policy_version 691828 (0.0009) [2023-12-26 05:06:45,693][123091] Updated weights for policy 0, policy_version 691838 (0.0006) [2023-12-26 05:06:45,702][123090] Updated weights for policy 1, policy_version 687357 (0.0009) [2023-12-26 05:06:45,750][123091] Updated weights for policy 0, policy_version 691848 (0.0006) [2023-12-26 05:06:46,421][123091] Updated weights for policy 0, policy_version 691858 (0.0006) [2023-12-26 05:06:46,462][123090] Updated weights for policy 1, policy_version 687367 (0.0008) [2023-12-26 05:06:46,487][123091] Updated weights for policy 0, policy_version 691868 (0.0005) [2023-12-26 05:06:46,523][123090] Updated weights for policy 1, policy_version 687377 (0.0008) [2023-12-26 05:06:46,559][123091] Updated weights for policy 0, policy_version 691878 (0.0006) [2023-12-26 05:06:46,573][123090] Updated weights for policy 1, policy_version 687387 (0.0006) [2023-12-26 05:06:46,622][123091] Updated weights for policy 0, policy_version 691888 (0.0010) [2023-12-26 05:06:47,279][123091] Updated weights for policy 0, policy_version 691898 (0.0009) [2023-12-26 05:06:47,343][123091] Updated weights for policy 0, policy_version 691908 (0.0009) [2023-12-26 05:06:47,389][123090] Updated weights for policy 1, policy_version 687397 (0.0008) [2023-12-26 05:06:47,404][123091] Updated weights for policy 0, policy_version 691918 (0.0008) [2023-12-26 05:06:47,454][123090] Updated weights for policy 1, policy_version 687407 (0.0008) [2023-12-26 05:06:47,514][123090] Updated weights for policy 1, policy_version 687417 (0.0009) [2023-12-26 05:06:48,140][123091] Updated weights for policy 0, policy_version 691928 (0.0009) [2023-12-26 05:06:48,200][123091] Updated weights for policy 0, policy_version 691938 (0.0010) [2023-12-26 05:06:48,264][123091] Updated weights for policy 0, policy_version 691948 (0.0009) [2023-12-26 05:06:48,300][123090] Updated weights for policy 1, policy_version 687427 (0.0008) [2023-12-26 05:06:48,371][123090] Updated weights for policy 1, policy_version 687437 (0.0009) [2023-12-26 05:06:48,437][123090] Updated weights for policy 1, policy_version 687447 (0.0010) [2023-12-26 05:06:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 353132544. Throughput: 0: 8926.1, 1: 8847.1. Samples: 353142736. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:48,785][121949] Avg episode reward: [(0, '5904.111'), (1, '5306.739')] [2023-12-26 05:06:49,065][123091] Updated weights for policy 0, policy_version 691958 (0.0007) [2023-12-26 05:06:49,119][123091] Updated weights for policy 0, policy_version 691968 (0.0005) [2023-12-26 05:06:49,183][123091] Updated weights for policy 0, policy_version 691978 (0.0005) [2023-12-26 05:06:49,300][123090] Updated weights for policy 1, policy_version 687457 (0.0007) [2023-12-26 05:06:49,370][123090] Updated weights for policy 1, policy_version 687467 (0.0008) [2023-12-26 05:06:49,437][123090] Updated weights for policy 1, policy_version 687477 (0.0009) [2023-12-26 05:06:49,488][123090] Updated weights for policy 1, policy_version 687487 (0.0008) [2023-12-26 05:06:50,005][123091] Updated weights for policy 0, policy_version 691988 (0.0007) [2023-12-26 05:06:50,062][123091] Updated weights for policy 0, policy_version 691998 (0.0009) [2023-12-26 05:06:50,133][123091] Updated weights for policy 0, policy_version 692008 (0.0009) [2023-12-26 05:06:50,382][123090] Updated weights for policy 1, policy_version 687497 (0.0009) [2023-12-26 05:06:50,449][123090] Updated weights for policy 1, policy_version 687507 (0.0010) [2023-12-26 05:06:50,514][123090] Updated weights for policy 1, policy_version 687517 (0.0008) [2023-12-26 05:06:50,956][123091] Updated weights for policy 0, policy_version 692018 (0.0010) [2023-12-26 05:06:51,012][123091] Updated weights for policy 0, policy_version 692028 (0.0010) [2023-12-26 05:06:51,079][123091] Updated weights for policy 0, policy_version 692038 (0.0011) [2023-12-26 05:06:51,139][123091] Updated weights for policy 0, policy_version 692048 (0.0011) [2023-12-26 05:06:51,383][123090] Updated weights for policy 1, policy_version 687527 (0.0009) [2023-12-26 05:06:51,451][123090] Updated weights for policy 1, policy_version 687537 (0.0009) [2023-12-26 05:06:51,513][123090] Updated weights for policy 1, policy_version 687547 (0.0009) [2023-12-26 05:06:51,971][123091] Updated weights for policy 0, policy_version 692058 (0.0009) [2023-12-26 05:06:52,019][123091] Updated weights for policy 0, policy_version 692068 (0.0010) [2023-12-26 05:06:52,067][123091] Updated weights for policy 0, policy_version 692078 (0.0010) [2023-12-26 05:06:52,404][123090] Updated weights for policy 1, policy_version 687557 (0.0009) [2023-12-26 05:06:52,465][123090] Updated weights for policy 1, policy_version 687567 (0.0010) [2023-12-26 05:06:52,524][123090] Updated weights for policy 1, policy_version 687577 (0.0009) [2023-12-26 05:06:52,894][123091] Updated weights for policy 0, policy_version 692088 (0.0008) [2023-12-26 05:06:52,963][123091] Updated weights for policy 0, policy_version 692098 (0.0010) [2023-12-26 05:06:53,030][123091] Updated weights for policy 0, policy_version 692108 (0.0008) [2023-12-26 05:06:53,389][123090] Updated weights for policy 1, policy_version 687587 (0.0010) [2023-12-26 05:06:53,452][123090] Updated weights for policy 1, policy_version 687597 (0.0008) [2023-12-26 05:06:53,514][123090] Updated weights for policy 1, policy_version 687607 (0.0009) [2023-12-26 05:06:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 353214464. Throughput: 0: 8889.7, 1: 8814.0. Samples: 353192796. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:53,785][121949] Avg episode reward: [(0, '5894.156'), (1, '5352.182')] [2023-12-26 05:06:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000687616_176029696.pth... [2023-12-26 05:06:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000686592_175767552.pth [2023-12-26 05:06:53,820][123091] Updated weights for policy 0, policy_version 692118 (0.0009) [2023-12-26 05:06:53,869][123091] Updated weights for policy 0, policy_version 692128 (0.0008) [2023-12-26 05:06:53,920][123091] Updated weights for policy 0, policy_version 692138 (0.0009) [2023-12-26 05:06:53,951][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000692144_177192960.pth... [2023-12-26 05:06:53,954][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000691088_176922624.pth [2023-12-26 05:06:54,355][123090] Updated weights for policy 1, policy_version 687617 (0.0009) [2023-12-26 05:06:54,426][123090] Updated weights for policy 1, policy_version 687627 (0.0009) [2023-12-26 05:06:54,483][123090] Updated weights for policy 1, policy_version 687637 (0.0010) [2023-12-26 05:06:54,533][123090] Updated weights for policy 1, policy_version 687647 (0.0009) [2023-12-26 05:06:54,728][123091] Updated weights for policy 0, policy_version 692148 (0.0009) [2023-12-26 05:06:54,778][123091] Updated weights for policy 0, policy_version 692158 (0.0009) [2023-12-26 05:06:54,832][123091] Updated weights for policy 0, policy_version 692169 (0.0009) [2023-12-26 05:06:55,397][123090] Updated weights for policy 1, policy_version 687657 (0.0010) [2023-12-26 05:06:55,455][123090] Updated weights for policy 1, policy_version 687667 (0.0009) [2023-12-26 05:06:55,506][123090] Updated weights for policy 1, policy_version 687677 (0.0009) [2023-12-26 05:06:55,597][123091] Updated weights for policy 0, policy_version 692179 (0.0008) [2023-12-26 05:06:55,655][123091] Updated weights for policy 0, policy_version 692189 (0.0006) [2023-12-26 05:06:55,713][123091] Updated weights for policy 0, policy_version 692199 (0.0010) [2023-12-26 05:06:56,379][123090] Updated weights for policy 1, policy_version 687688 (0.0010) [2023-12-26 05:06:56,440][123090] Updated weights for policy 1, policy_version 687698 (0.0009) [2023-12-26 05:06:56,458][123091] Updated weights for policy 0, policy_version 692209 (0.0009) [2023-12-26 05:06:56,491][123090] Updated weights for policy 1, policy_version 687708 (0.0009) [2023-12-26 05:06:56,516][123091] Updated weights for policy 0, policy_version 692219 (0.0008) [2023-12-26 05:06:56,578][123091] Updated weights for policy 0, policy_version 692229 (0.0009) [2023-12-26 05:06:56,646][123091] Updated weights for policy 0, policy_version 692239 (0.0009) [2023-12-26 05:06:57,331][123090] Updated weights for policy 1, policy_version 687718 (0.0010) [2023-12-26 05:06:57,386][123090] Updated weights for policy 1, policy_version 687728 (0.0009) [2023-12-26 05:06:57,449][123090] Updated weights for policy 1, policy_version 687738 (0.0008) [2023-12-26 05:06:57,453][123091] Updated weights for policy 0, policy_version 692249 (0.0008) [2023-12-26 05:06:57,515][123091] Updated weights for policy 0, policy_version 692259 (0.0009) [2023-12-26 05:06:57,578][123091] Updated weights for policy 0, policy_version 692269 (0.0010) [2023-12-26 05:06:58,315][123091] Updated weights for policy 0, policy_version 692279 (0.0008) [2023-12-26 05:06:58,366][123090] Updated weights for policy 1, policy_version 687748 (0.0009) [2023-12-26 05:06:58,399][123091] Updated weights for policy 0, policy_version 692289 (0.0009) [2023-12-26 05:06:58,449][123090] Updated weights for policy 1, policy_version 687759 (0.0007) [2023-12-26 05:06:58,479][123091] Updated weights for policy 0, policy_version 692299 (0.0009) [2023-12-26 05:06:58,519][123090] Updated weights for policy 1, policy_version 687769 (0.0008) [2023-12-26 05:06:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 353304576. Throughput: 0: 8929.8, 1: 8776.0. Samples: 353295340. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:06:58,785][121949] Avg episode reward: [(0, '5998.732'), (1, '5553.721')] [2023-12-26 05:06:59,316][123091] Updated weights for policy 0, policy_version 692309 (0.0008) [2023-12-26 05:06:59,381][123091] Updated weights for policy 0, policy_version 692319 (0.0010) [2023-12-26 05:06:59,422][123090] Updated weights for policy 1, policy_version 687779 (0.0010) [2023-12-26 05:06:59,437][123091] Updated weights for policy 0, policy_version 692329 (0.0009) [2023-12-26 05:06:59,481][123090] Updated weights for policy 1, policy_version 687789 (0.0010) [2023-12-26 05:06:59,540][123090] Updated weights for policy 1, policy_version 687799 (0.0009) [2023-12-26 05:07:00,298][123091] Updated weights for policy 0, policy_version 692339 (0.0007) [2023-12-26 05:07:00,346][123091] Updated weights for policy 0, policy_version 692349 (0.0009) [2023-12-26 05:07:00,371][123090] Updated weights for policy 1, policy_version 687809 (0.0010) [2023-12-26 05:07:00,394][123091] Updated weights for policy 0, policy_version 692359 (0.0009) [2023-12-26 05:07:00,430][123090] Updated weights for policy 1, policy_version 687819 (0.0010) [2023-12-26 05:07:00,489][123090] Updated weights for policy 1, policy_version 687829 (0.0010) [2023-12-26 05:07:00,547][123090] Updated weights for policy 1, policy_version 687839 (0.0010) [2023-12-26 05:07:01,273][123091] Updated weights for policy 0, policy_version 692369 (0.0007) [2023-12-26 05:07:01,339][123090] Updated weights for policy 1, policy_version 687849 (0.0007) [2023-12-26 05:07:01,340][123091] Updated weights for policy 0, policy_version 692379 (0.0006) [2023-12-26 05:07:01,408][123091] Updated weights for policy 0, policy_version 692389 (0.0007) [2023-12-26 05:07:01,410][123090] Updated weights for policy 1, policy_version 687859 (0.0009) [2023-12-26 05:07:01,459][123090] Updated weights for policy 1, policy_version 687869 (0.0007) [2023-12-26 05:07:01,461][123091] Updated weights for policy 0, policy_version 692399 (0.0007) [2023-12-26 05:07:02,241][123091] Updated weights for policy 0, policy_version 692409 (0.0010) [2023-12-26 05:07:02,278][123090] Updated weights for policy 1, policy_version 687879 (0.0008) [2023-12-26 05:07:02,308][123091] Updated weights for policy 0, policy_version 692419 (0.0008) [2023-12-26 05:07:02,340][123090] Updated weights for policy 1, policy_version 687889 (0.0006) [2023-12-26 05:07:02,377][123091] Updated weights for policy 0, policy_version 692429 (0.0008) [2023-12-26 05:07:02,409][123090] Updated weights for policy 1, policy_version 687899 (0.0007) [2023-12-26 05:07:03,023][123090] Updated weights for policy 1, policy_version 687909 (0.0008) [2023-12-26 05:07:03,086][123090] Updated weights for policy 1, policy_version 687919 (0.0010) [2023-12-26 05:07:03,160][123090] Updated weights for policy 1, policy_version 687929 (0.0009) [2023-12-26 05:07:03,210][123091] Updated weights for policy 0, policy_version 692439 (0.0006) [2023-12-26 05:07:03,263][123091] Updated weights for policy 0, policy_version 692449 (0.0005) [2023-12-26 05:07:03,312][123091] Updated weights for policy 0, policy_version 692459 (0.0007) [2023-12-26 05:07:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 353386496. Throughput: 0: 8863.1, 1: 8716.1. Samples: 353398860. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:03,785][121949] Avg episode reward: [(0, '6053.990'), (1, '5775.171')] [2023-12-26 05:07:03,988][123090] Updated weights for policy 1, policy_version 687939 (0.0010) [2023-12-26 05:07:04,046][123090] Updated weights for policy 1, policy_version 687949 (0.0010) [2023-12-26 05:07:04,111][123090] Updated weights for policy 1, policy_version 687959 (0.0009) [2023-12-26 05:07:04,131][123091] Updated weights for policy 0, policy_version 692469 (0.0009) [2023-12-26 05:07:04,194][123091] Updated weights for policy 0, policy_version 692479 (0.0009) [2023-12-26 05:07:04,258][123091] Updated weights for policy 0, policy_version 692489 (0.0010) [2023-12-26 05:07:04,951][123090] Updated weights for policy 1, policy_version 687969 (0.0007) [2023-12-26 05:07:05,001][123091] Updated weights for policy 0, policy_version 692499 (0.0008) [2023-12-26 05:07:05,020][123090] Updated weights for policy 1, policy_version 687979 (0.0005) [2023-12-26 05:07:05,056][123091] Updated weights for policy 0, policy_version 692509 (0.0011) [2023-12-26 05:07:05,090][123090] Updated weights for policy 1, policy_version 687989 (0.0006) [2023-12-26 05:07:05,118][123091] Updated weights for policy 0, policy_version 692519 (0.0010) [2023-12-26 05:07:05,165][123090] Updated weights for policy 1, policy_version 687999 (0.0005) [2023-12-26 05:07:05,717][123090] Updated weights for policy 1, policy_version 688009 (0.0005) [2023-12-26 05:07:05,778][123090] Updated weights for policy 1, policy_version 688019 (0.0005) [2023-12-26 05:07:05,827][123090] Updated weights for policy 1, policy_version 688029 (0.0005) [2023-12-26 05:07:05,919][123091] Updated weights for policy 0, policy_version 692529 (0.0006) [2023-12-26 05:07:05,982][123091] Updated weights for policy 0, policy_version 692539 (0.0010) [2023-12-26 05:07:06,030][123091] Updated weights for policy 0, policy_version 692549 (0.0010) [2023-12-26 05:07:06,088][123091] Updated weights for policy 0, policy_version 692559 (0.0011) [2023-12-26 05:07:06,490][123090] Updated weights for policy 1, policy_version 688039 (0.0005) [2023-12-26 05:07:06,550][123090] Updated weights for policy 1, policy_version 688049 (0.0006) [2023-12-26 05:07:06,604][123090] Updated weights for policy 1, policy_version 688059 (0.0008) [2023-12-26 05:07:06,944][123091] Updated weights for policy 0, policy_version 692569 (0.0011) [2023-12-26 05:07:07,008][123091] Updated weights for policy 0, policy_version 692579 (0.0011) [2023-12-26 05:07:07,079][123091] Updated weights for policy 0, policy_version 692589 (0.0011) [2023-12-26 05:07:07,419][123090] Updated weights for policy 1, policy_version 688069 (0.0007) [2023-12-26 05:07:07,468][123090] Updated weights for policy 1, policy_version 688079 (0.0009) [2023-12-26 05:07:07,528][123090] Updated weights for policy 1, policy_version 688089 (0.0009) [2023-12-26 05:07:07,897][123091] Updated weights for policy 0, policy_version 692599 (0.0011) [2023-12-26 05:07:07,957][123091] Updated weights for policy 0, policy_version 692609 (0.0010) [2023-12-26 05:07:08,021][123091] Updated weights for policy 0, policy_version 692619 (0.0011) [2023-12-26 05:07:08,310][123090] Updated weights for policy 1, policy_version 688099 (0.0009) [2023-12-26 05:07:08,384][123090] Updated weights for policy 1, policy_version 688109 (0.0008) [2023-12-26 05:07:08,455][123090] Updated weights for policy 1, policy_version 688119 (0.0006) [2023-12-26 05:07:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 353476608. Throughput: 0: 8855.8, 1: 8749.8. Samples: 353454484. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:08,785][121949] Avg episode reward: [(0, '5995.916'), (1, '5619.837')] [2023-12-26 05:07:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000688128_176160768.pth... [2023-12-26 05:07:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000692624_177315840.pth... [2023-12-26 05:07:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000687104_175898624.pth [2023-12-26 05:07:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000691632_177061888.pth [2023-12-26 05:07:08,846][123091] Updated weights for policy 0, policy_version 692629 (0.0010) [2023-12-26 05:07:08,900][123091] Updated weights for policy 0, policy_version 692639 (0.0010) [2023-12-26 05:07:08,965][123091] Updated weights for policy 0, policy_version 692649 (0.0007) [2023-12-26 05:07:09,154][123090] Updated weights for policy 1, policy_version 688129 (0.0005) [2023-12-26 05:07:09,206][123090] Updated weights for policy 1, policy_version 688139 (0.0007) [2023-12-26 05:07:09,277][123090] Updated weights for policy 1, policy_version 688149 (0.0011) [2023-12-26 05:07:09,349][123090] Updated weights for policy 1, policy_version 688159 (0.0010) [2023-12-26 05:07:09,730][123091] Updated weights for policy 0, policy_version 692659 (0.0007) [2023-12-26 05:07:09,785][123091] Updated weights for policy 0, policy_version 692669 (0.0011) [2023-12-26 05:07:09,846][123091] Updated weights for policy 0, policy_version 692679 (0.0011) [2023-12-26 05:07:10,090][123090] Updated weights for policy 1, policy_version 688169 (0.0008) [2023-12-26 05:07:10,157][123090] Updated weights for policy 1, policy_version 688179 (0.0008) [2023-12-26 05:07:10,219][123090] Updated weights for policy 1, policy_version 688189 (0.0008) [2023-12-26 05:07:10,610][123091] Updated weights for policy 0, policy_version 692689 (0.0010) [2023-12-26 05:07:10,674][123091] Updated weights for policy 0, policy_version 692699 (0.0011) [2023-12-26 05:07:10,734][123091] Updated weights for policy 0, policy_version 692709 (0.0011) [2023-12-26 05:07:10,797][123091] Updated weights for policy 0, policy_version 692719 (0.0011) [2023-12-26 05:07:10,906][123090] Updated weights for policy 1, policy_version 688199 (0.0006) [2023-12-26 05:07:10,962][123090] Updated weights for policy 1, policy_version 688209 (0.0005) [2023-12-26 05:07:11,010][123090] Updated weights for policy 1, policy_version 688219 (0.0005) [2023-12-26 05:07:11,585][123091] Updated weights for policy 0, policy_version 692729 (0.0008) [2023-12-26 05:07:11,654][123091] Updated weights for policy 0, policy_version 692739 (0.0009) [2023-12-26 05:07:11,726][123091] Updated weights for policy 0, policy_version 692749 (0.0006) [2023-12-26 05:07:11,791][123090] Updated weights for policy 1, policy_version 688229 (0.0009) [2023-12-26 05:07:11,863][123090] Updated weights for policy 1, policy_version 688239 (0.0011) [2023-12-26 05:07:11,931][123090] Updated weights for policy 1, policy_version 688249 (0.0011) [2023-12-26 05:07:12,462][123091] Updated weights for policy 0, policy_version 692759 (0.0012) [2023-12-26 05:07:12,526][123091] Updated weights for policy 0, policy_version 692769 (0.0009) [2023-12-26 05:07:12,589][123091] Updated weights for policy 0, policy_version 692779 (0.0007) [2023-12-26 05:07:12,740][123090] Updated weights for policy 1, policy_version 688259 (0.0009) [2023-12-26 05:07:12,812][123090] Updated weights for policy 1, policy_version 688269 (0.0005) [2023-12-26 05:07:12,872][123090] Updated weights for policy 1, policy_version 688279 (0.0006) [2023-12-26 05:07:13,355][123091] Updated weights for policy 0, policy_version 692789 (0.0011) [2023-12-26 05:07:13,419][123091] Updated weights for policy 0, policy_version 692799 (0.0009) [2023-12-26 05:07:13,494][123091] Updated weights for policy 0, policy_version 692809 (0.0005) [2023-12-26 05:07:13,580][123090] Updated weights for policy 1, policy_version 688289 (0.0006) [2023-12-26 05:07:13,633][123090] Updated weights for policy 1, policy_version 688299 (0.0005) [2023-12-26 05:07:13,683][123090] Updated weights for policy 1, policy_version 688309 (0.0005) [2023-12-26 05:07:13,739][123090] Updated weights for policy 1, policy_version 688319 (0.0005) [2023-12-26 05:07:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 353574912. Throughput: 0: 8851.3, 1: 8749.7. Samples: 353561932. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:13,785][121949] Avg episode reward: [(0, '6055.022'), (1, '5557.080')] [2023-12-26 05:07:14,341][123091] Updated weights for policy 0, policy_version 692819 (0.0006) [2023-12-26 05:07:14,400][123091] Updated weights for policy 0, policy_version 692830 (0.0010) [2023-12-26 05:07:14,416][123090] Updated weights for policy 1, policy_version 688329 (0.0005) [2023-12-26 05:07:14,464][123091] Updated weights for policy 0, policy_version 692840 (0.0010) [2023-12-26 05:07:14,477][123090] Updated weights for policy 1, policy_version 688339 (0.0007) [2023-12-26 05:07:14,544][123090] Updated weights for policy 1, policy_version 688349 (0.0011) [2023-12-26 05:07:15,242][123091] Updated weights for policy 0, policy_version 692850 (0.0008) [2023-12-26 05:07:15,307][123091] Updated weights for policy 0, policy_version 692860 (0.0009) [2023-12-26 05:07:15,350][123090] Updated weights for policy 1, policy_version 688359 (0.0011) [2023-12-26 05:07:15,369][123091] Updated weights for policy 0, policy_version 692870 (0.0008) [2023-12-26 05:07:15,407][123090] Updated weights for policy 1, policy_version 688369 (0.0011) [2023-12-26 05:07:15,431][123091] Updated weights for policy 0, policy_version 692880 (0.0006) [2023-12-26 05:07:15,463][123090] Updated weights for policy 1, policy_version 688379 (0.0010) [2023-12-26 05:07:16,248][123090] Updated weights for policy 1, policy_version 688389 (0.0011) [2023-12-26 05:07:16,298][123091] Updated weights for policy 0, policy_version 692890 (0.0009) [2023-12-26 05:07:16,305][123090] Updated weights for policy 1, policy_version 688399 (0.0011) [2023-12-26 05:07:16,359][123091] Updated weights for policy 0, policy_version 692900 (0.0006) [2023-12-26 05:07:16,369][123090] Updated weights for policy 1, policy_version 688409 (0.0011) [2023-12-26 05:07:16,425][123091] Updated weights for policy 0, policy_version 692910 (0.0006) [2023-12-26 05:07:17,144][123090] Updated weights for policy 1, policy_version 688419 (0.0008) [2023-12-26 05:07:17,202][123090] Updated weights for policy 1, policy_version 688429 (0.0008) [2023-12-26 05:07:17,257][123090] Updated weights for policy 1, policy_version 688439 (0.0007) [2023-12-26 05:07:17,282][123091] Updated weights for policy 0, policy_version 692920 (0.0009) [2023-12-26 05:07:17,334][123091] Updated weights for policy 0, policy_version 692930 (0.0009) [2023-12-26 05:07:17,383][123091] Updated weights for policy 0, policy_version 692940 (0.0009) [2023-12-26 05:07:17,996][123090] Updated weights for policy 1, policy_version 688449 (0.0009) [2023-12-26 05:07:18,066][123090] Updated weights for policy 1, policy_version 688459 (0.0009) [2023-12-26 05:07:18,141][123090] Updated weights for policy 1, policy_version 688469 (0.0010) [2023-12-26 05:07:18,203][123090] Updated weights for policy 1, policy_version 688479 (0.0009) [2023-12-26 05:07:18,246][123091] Updated weights for policy 0, policy_version 692951 (0.0010) [2023-12-26 05:07:18,297][123091] Updated weights for policy 0, policy_version 692961 (0.0010) [2023-12-26 05:07:18,355][123091] Updated weights for policy 0, policy_version 692971 (0.0010) [2023-12-26 05:07:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 353656832. Throughput: 0: 8779.4, 1: 8780.9. Samples: 353668396. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:18,785][121949] Avg episode reward: [(0, '5973.494'), (1, '5574.699')] [2023-12-26 05:07:19,014][123090] Updated weights for policy 1, policy_version 688489 (0.0009) [2023-12-26 05:07:19,082][123090] Updated weights for policy 1, policy_version 688499 (0.0010) [2023-12-26 05:07:19,148][123090] Updated weights for policy 1, policy_version 688509 (0.0010) [2023-12-26 05:07:19,231][123091] Updated weights for policy 0, policy_version 692981 (0.0010) [2023-12-26 05:07:19,302][123091] Updated weights for policy 0, policy_version 692991 (0.0010) [2023-12-26 05:07:19,375][123091] Updated weights for policy 0, policy_version 693001 (0.0010) [2023-12-26 05:07:20,059][123090] Updated weights for policy 1, policy_version 688519 (0.0006) [2023-12-26 05:07:20,131][123090] Updated weights for policy 1, policy_version 688529 (0.0007) [2023-12-26 05:07:20,206][123091] Updated weights for policy 0, policy_version 693011 (0.0008) [2023-12-26 05:07:20,206][123090] Updated weights for policy 1, policy_version 688539 (0.0009) [2023-12-26 05:07:20,267][123091] Updated weights for policy 0, policy_version 693021 (0.0009) [2023-12-26 05:07:20,334][123091] Updated weights for policy 0, policy_version 693031 (0.0009) [2023-12-26 05:07:20,996][123090] Updated weights for policy 1, policy_version 688549 (0.0007) [2023-12-26 05:07:21,072][123090] Updated weights for policy 1, policy_version 688559 (0.0006) [2023-12-26 05:07:21,103][123091] Updated weights for policy 0, policy_version 693041 (0.0008) [2023-12-26 05:07:21,138][123090] Updated weights for policy 1, policy_version 688569 (0.0006) [2023-12-26 05:07:21,171][123091] Updated weights for policy 0, policy_version 693051 (0.0007) [2023-12-26 05:07:21,238][123091] Updated weights for policy 0, policy_version 693061 (0.0006) [2023-12-26 05:07:21,306][123091] Updated weights for policy 0, policy_version 693071 (0.0008) [2023-12-26 05:07:21,971][123090] Updated weights for policy 1, policy_version 688579 (0.0009) [2023-12-26 05:07:22,038][123090] Updated weights for policy 1, policy_version 688589 (0.0008) [2023-12-26 05:07:22,064][123091] Updated weights for policy 0, policy_version 693082 (0.0009) [2023-12-26 05:07:22,103][123090] Updated weights for policy 1, policy_version 688599 (0.0006) [2023-12-26 05:07:22,127][123091] Updated weights for policy 0, policy_version 693092 (0.0011) [2023-12-26 05:07:22,195][123091] Updated weights for policy 0, policy_version 693102 (0.0011) [2023-12-26 05:07:22,984][123090] Updated weights for policy 1, policy_version 688609 (0.0007) [2023-12-26 05:07:23,013][123091] Updated weights for policy 0, policy_version 693112 (0.0007) [2023-12-26 05:07:23,050][123090] Updated weights for policy 1, policy_version 688619 (0.0007) [2023-12-26 05:07:23,074][123091] Updated weights for policy 0, policy_version 693122 (0.0007) [2023-12-26 05:07:23,126][123090] Updated weights for policy 1, policy_version 688629 (0.0005) [2023-12-26 05:07:23,142][123091] Updated weights for policy 0, policy_version 693132 (0.0008) [2023-12-26 05:07:23,198][123090] Updated weights for policy 1, policy_version 688639 (0.0006) [2023-12-26 05:07:23,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 353738752. Throughput: 0: 8715.0, 1: 8768.5. Samples: 353719692. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:23,785][121949] Avg episode reward: [(0, '5830.376'), (1, '5633.206')] [2023-12-26 05:07:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000693136_177446912.pth... [2023-12-26 05:07:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000688640_176291840.pth... [2023-12-26 05:07:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000687616_176029696.pth [2023-12-26 05:07:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000692144_177192960.pth [2023-12-26 05:07:23,928][123090] Updated weights for policy 1, policy_version 688649 (0.0007) [2023-12-26 05:07:23,963][123091] Updated weights for policy 0, policy_version 693142 (0.0009) [2023-12-26 05:07:23,995][123090] Updated weights for policy 1, policy_version 688659 (0.0007) [2023-12-26 05:07:24,026][123091] Updated weights for policy 0, policy_version 693152 (0.0008) [2023-12-26 05:07:24,066][123090] Updated weights for policy 1, policy_version 688669 (0.0006) [2023-12-26 05:07:24,095][123091] Updated weights for policy 0, policy_version 693162 (0.0008) [2023-12-26 05:07:24,855][123090] Updated weights for policy 1, policy_version 688679 (0.0009) [2023-12-26 05:07:24,904][123091] Updated weights for policy 0, policy_version 693172 (0.0008) [2023-12-26 05:07:24,920][123090] Updated weights for policy 1, policy_version 688689 (0.0008) [2023-12-26 05:07:24,961][123091] Updated weights for policy 0, policy_version 693183 (0.0010) [2023-12-26 05:07:24,982][123090] Updated weights for policy 1, policy_version 688699 (0.0008) [2023-12-26 05:07:25,019][123091] Updated weights for policy 0, policy_version 693193 (0.0009) [2023-12-26 05:07:25,670][123090] Updated weights for policy 1, policy_version 688709 (0.0007) [2023-12-26 05:07:25,741][123090] Updated weights for policy 1, policy_version 688719 (0.0005) [2023-12-26 05:07:25,803][123090] Updated weights for policy 1, policy_version 688729 (0.0005) [2023-12-26 05:07:25,931][123091] Updated weights for policy 0, policy_version 693203 (0.0009) [2023-12-26 05:07:25,984][123091] Updated weights for policy 0, policy_version 693213 (0.0010) [2023-12-26 05:07:26,037][123091] Updated weights for policy 0, policy_version 693223 (0.0009) [2023-12-26 05:07:26,494][123090] Updated weights for policy 1, policy_version 688739 (0.0005) [2023-12-26 05:07:26,553][123090] Updated weights for policy 1, policy_version 688749 (0.0005) [2023-12-26 05:07:26,624][123090] Updated weights for policy 1, policy_version 688759 (0.0007) [2023-12-26 05:07:26,792][123091] Updated weights for policy 0, policy_version 693233 (0.0009) [2023-12-26 05:07:26,861][123091] Updated weights for policy 0, policy_version 693243 (0.0005) [2023-12-26 05:07:26,927][123091] Updated weights for policy 0, policy_version 693253 (0.0008) [2023-12-26 05:07:26,987][123091] Updated weights for policy 0, policy_version 693263 (0.0010) [2023-12-26 05:07:27,409][123090] Updated weights for policy 1, policy_version 688769 (0.0009) [2023-12-26 05:07:27,463][123090] Updated weights for policy 1, policy_version 688779 (0.0009) [2023-12-26 05:07:27,516][123090] Updated weights for policy 1, policy_version 688790 (0.0009) [2023-12-26 05:07:27,566][123090] Updated weights for policy 1, policy_version 688800 (0.0009) [2023-12-26 05:07:27,781][123091] Updated weights for policy 0, policy_version 693273 (0.0009) [2023-12-26 05:07:27,844][123091] Updated weights for policy 0, policy_version 693283 (0.0009) [2023-12-26 05:07:27,904][123091] Updated weights for policy 0, policy_version 693293 (0.0010) [2023-12-26 05:07:28,430][123090] Updated weights for policy 1, policy_version 688810 (0.0010) [2023-12-26 05:07:28,513][123090] Updated weights for policy 1, policy_version 688820 (0.0009) [2023-12-26 05:07:28,573][123090] Updated weights for policy 1, policy_version 688830 (0.0009) [2023-12-26 05:07:28,695][123091] Updated weights for policy 0, policy_version 693303 (0.0009) [2023-12-26 05:07:28,758][123091] Updated weights for policy 0, policy_version 693313 (0.0010) [2023-12-26 05:07:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 353828864. Throughput: 0: 8732.2, 1: 8777.9. Samples: 353825452. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:28,784][121949] Avg episode reward: [(0, '5927.565'), (1, '5554.509')] [2023-12-26 05:07:28,820][123091] Updated weights for policy 0, policy_version 693323 (0.0010) [2023-12-26 05:07:29,359][123090] Updated weights for policy 1, policy_version 688840 (0.0008) [2023-12-26 05:07:29,427][123090] Updated weights for policy 1, policy_version 688850 (0.0006) [2023-12-26 05:07:29,500][123090] Updated weights for policy 1, policy_version 688860 (0.0005) [2023-12-26 05:07:29,654][123091] Updated weights for policy 0, policy_version 693333 (0.0008) [2023-12-26 05:07:29,721][123091] Updated weights for policy 0, policy_version 693343 (0.0006) [2023-12-26 05:07:29,777][123091] Updated weights for policy 0, policy_version 693353 (0.0010) [2023-12-26 05:07:30,174][123090] Updated weights for policy 1, policy_version 688870 (0.0008) [2023-12-26 05:07:30,224][123090] Updated weights for policy 1, policy_version 688880 (0.0008) [2023-12-26 05:07:30,280][123090] Updated weights for policy 1, policy_version 688890 (0.0009) [2023-12-26 05:07:30,572][123091] Updated weights for policy 0, policy_version 693363 (0.0009) [2023-12-26 05:07:30,634][123091] Updated weights for policy 0, policy_version 693373 (0.0010) [2023-12-26 05:07:30,691][123091] Updated weights for policy 0, policy_version 693383 (0.0010) [2023-12-26 05:07:30,992][123090] Updated weights for policy 1, policy_version 688900 (0.0008) [2023-12-26 05:07:31,051][123090] Updated weights for policy 1, policy_version 688910 (0.0008) [2023-12-26 05:07:31,123][123090] Updated weights for policy 1, policy_version 688920 (0.0006) [2023-12-26 05:07:31,502][123091] Updated weights for policy 0, policy_version 693393 (0.0009) [2023-12-26 05:07:31,562][123091] Updated weights for policy 0, policy_version 693403 (0.0005) [2023-12-26 05:07:31,625][123091] Updated weights for policy 0, policy_version 693413 (0.0007) [2023-12-26 05:07:31,692][123091] Updated weights for policy 0, policy_version 693423 (0.0008) [2023-12-26 05:07:31,919][123090] Updated weights for policy 1, policy_version 688930 (0.0008) [2023-12-26 05:07:31,979][123090] Updated weights for policy 1, policy_version 688940 (0.0009) [2023-12-26 05:07:32,039][123090] Updated weights for policy 1, policy_version 688950 (0.0009) [2023-12-26 05:07:32,100][123090] Updated weights for policy 1, policy_version 688960 (0.0009) [2023-12-26 05:07:32,475][123091] Updated weights for policy 0, policy_version 693433 (0.0010) [2023-12-26 05:07:32,527][123091] Updated weights for policy 0, policy_version 693443 (0.0008) [2023-12-26 05:07:32,592][123091] Updated weights for policy 0, policy_version 693453 (0.0006) [2023-12-26 05:07:32,934][123090] Updated weights for policy 1, policy_version 688970 (0.0009) [2023-12-26 05:07:33,000][123090] Updated weights for policy 1, policy_version 688980 (0.0008) [2023-12-26 05:07:33,065][123090] Updated weights for policy 1, policy_version 688990 (0.0009) [2023-12-26 05:07:33,440][123091] Updated weights for policy 0, policy_version 693463 (0.0010) [2023-12-26 05:07:33,496][123091] Updated weights for policy 0, policy_version 693473 (0.0009) [2023-12-26 05:07:33,543][123091] Updated weights for policy 0, policy_version 693483 (0.0009) [2023-12-26 05:07:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 353918976. Throughput: 0: 8673.2, 1: 8812.4. Samples: 353929584. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:33,784][121949] Avg episode reward: [(0, '6047.463'), (1, '5507.122')] [2023-12-26 05:07:33,882][123090] Updated weights for policy 1, policy_version 689000 (0.0008) [2023-12-26 05:07:33,938][123090] Updated weights for policy 1, policy_version 689010 (0.0009) [2023-12-26 05:07:34,000][123090] Updated weights for policy 1, policy_version 689020 (0.0009) [2023-12-26 05:07:34,434][123091] Updated weights for policy 0, policy_version 693494 (0.0009) [2023-12-26 05:07:34,500][123091] Updated weights for policy 0, policy_version 693504 (0.0009) [2023-12-26 05:07:34,555][123091] Updated weights for policy 0, policy_version 693515 (0.0009) [2023-12-26 05:07:34,867][123090] Updated weights for policy 1, policy_version 689030 (0.0009) [2023-12-26 05:07:34,931][123090] Updated weights for policy 1, policy_version 689040 (0.0010) [2023-12-26 05:07:34,993][123090] Updated weights for policy 1, policy_version 689050 (0.0009) [2023-12-26 05:07:35,373][123091] Updated weights for policy 0, policy_version 693525 (0.0009) [2023-12-26 05:07:35,427][123091] Updated weights for policy 0, policy_version 693535 (0.0010) [2023-12-26 05:07:35,491][123091] Updated weights for policy 0, policy_version 693545 (0.0009) [2023-12-26 05:07:35,772][123090] Updated weights for policy 1, policy_version 689060 (0.0009) [2023-12-26 05:07:35,824][123090] Updated weights for policy 1, policy_version 689070 (0.0009) [2023-12-26 05:07:35,885][123090] Updated weights for policy 1, policy_version 689080 (0.0009) [2023-12-26 05:07:36,352][123091] Updated weights for policy 0, policy_version 693555 (0.0010) [2023-12-26 05:07:36,412][123091] Updated weights for policy 0, policy_version 693565 (0.0010) [2023-12-26 05:07:36,472][123091] Updated weights for policy 0, policy_version 693575 (0.0010) [2023-12-26 05:07:36,721][123090] Updated weights for policy 1, policy_version 689090 (0.0010) [2023-12-26 05:07:36,775][123090] Updated weights for policy 1, policy_version 689100 (0.0007) [2023-12-26 05:07:36,842][123090] Updated weights for policy 1, policy_version 689110 (0.0010) [2023-12-26 05:07:36,900][123090] Updated weights for policy 1, policy_version 689120 (0.0009) [2023-12-26 05:07:37,334][123091] Updated weights for policy 0, policy_version 693585 (0.0010) [2023-12-26 05:07:37,388][123091] Updated weights for policy 0, policy_version 693595 (0.0009) [2023-12-26 05:07:37,441][123091] Updated weights for policy 0, policy_version 693605 (0.0009) [2023-12-26 05:07:37,500][123091] Updated weights for policy 0, policy_version 693615 (0.0009) [2023-12-26 05:07:37,758][123090] Updated weights for policy 1, policy_version 689130 (0.0009) [2023-12-26 05:07:37,812][123090] Updated weights for policy 1, policy_version 689140 (0.0008) [2023-12-26 05:07:37,879][123090] Updated weights for policy 1, policy_version 689150 (0.0009) [2023-12-26 05:07:38,361][123091] Updated weights for policy 0, policy_version 693625 (0.0010) [2023-12-26 05:07:38,418][123091] Updated weights for policy 0, policy_version 693635 (0.0010) [2023-12-26 05:07:38,478][123091] Updated weights for policy 0, policy_version 693645 (0.0009) [2023-12-26 05:07:38,715][123090] Updated weights for policy 1, policy_version 689160 (0.0009) [2023-12-26 05:07:38,774][123090] Updated weights for policy 1, policy_version 689170 (0.0010) [2023-12-26 05:07:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 354000896. Throughput: 0: 8660.5, 1: 8856.2. Samples: 353981044. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 05:07:38,785][121949] Avg episode reward: [(0, '5905.175'), (1, '5435.342')] [2023-12-26 05:07:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000693648_177577984.pth... [2023-12-26 05:07:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000692624_177315840.pth [2023-12-26 05:07:38,853][123090] Updated weights for policy 1, policy_version 689180 (0.0009) [2023-12-26 05:07:38,879][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000689184_176431104.pth... [2023-12-26 05:07:38,884][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000688128_176160768.pth [2023-12-26 05:07:39,149][123091] Updated weights for policy 0, policy_version 693655 (0.0009) [2023-12-26 05:07:39,205][123091] Updated weights for policy 0, policy_version 693665 (0.0009) [2023-12-26 05:07:39,270][123091] Updated weights for policy 0, policy_version 693675 (0.0010) [2023-12-26 05:07:39,767][123090] Updated weights for policy 1, policy_version 689190 (0.0010) [2023-12-26 05:07:39,823][123090] Updated weights for policy 1, policy_version 689200 (0.0010) [2023-12-26 05:07:39,892][123090] Updated weights for policy 1, policy_version 689210 (0.0010) [2023-12-26 05:07:40,146][123091] Updated weights for policy 0, policy_version 693685 (0.0010) [2023-12-26 05:07:40,212][123091] Updated weights for policy 0, policy_version 693695 (0.0010) [2023-12-26 05:07:40,275][123091] Updated weights for policy 0, policy_version 693705 (0.0009) [2023-12-26 05:07:40,732][123090] Updated weights for policy 1, policy_version 689220 (0.0009) [2023-12-26 05:07:40,786][123090] Updated weights for policy 1, policy_version 689230 (0.0009) [2023-12-26 05:07:40,852][123090] Updated weights for policy 1, policy_version 689240 (0.0009) [2023-12-26 05:07:41,105][123091] Updated weights for policy 0, policy_version 693715 (0.0009) [2023-12-26 05:07:41,176][123091] Updated weights for policy 0, policy_version 693725 (0.0009) [2023-12-26 05:07:41,227][123091] Updated weights for policy 0, policy_version 693735 (0.0009) [2023-12-26 05:07:41,750][123090] Updated weights for policy 1, policy_version 689250 (0.0009) [2023-12-26 05:07:41,821][123090] Updated weights for policy 1, policy_version 689260 (0.0007) [2023-12-26 05:07:41,887][123090] Updated weights for policy 1, policy_version 689270 (0.0007) [2023-12-26 05:07:41,952][123090] Updated weights for policy 1, policy_version 689280 (0.0006) [2023-12-26 05:07:42,054][123091] Updated weights for policy 0, policy_version 693745 (0.0009) [2023-12-26 05:07:42,110][123091] Updated weights for policy 0, policy_version 693755 (0.0008) [2023-12-26 05:07:42,168][123091] Updated weights for policy 0, policy_version 693765 (0.0006) [2023-12-26 05:07:42,231][123091] Updated weights for policy 0, policy_version 693775 (0.0008) [2023-12-26 05:07:42,756][123090] Updated weights for policy 1, policy_version 689290 (0.0009) [2023-12-26 05:07:42,823][123090] Updated weights for policy 1, policy_version 689300 (0.0007) [2023-12-26 05:07:42,886][123090] Updated weights for policy 1, policy_version 689310 (0.0005) [2023-12-26 05:07:43,034][123091] Updated weights for policy 0, policy_version 693785 (0.0010) [2023-12-26 05:07:43,097][123091] Updated weights for policy 0, policy_version 693795 (0.0009) [2023-12-26 05:07:43,155][123091] Updated weights for policy 0, policy_version 693805 (0.0008) [2023-12-26 05:07:43,568][123090] Updated weights for policy 1, policy_version 689320 (0.0008) [2023-12-26 05:07:43,630][123090] Updated weights for policy 1, policy_version 689330 (0.0009) [2023-12-26 05:07:43,691][123090] Updated weights for policy 1, policy_version 689340 (0.0010) [2023-12-26 05:07:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 354091008. Throughput: 0: 8648.2, 1: 8861.9. Samples: 354083292. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:07:43,785][121949] Avg episode reward: [(0, '5990.564'), (1, '5291.893')] [2023-12-26 05:07:43,986][123091] Updated weights for policy 0, policy_version 693815 (0.0010) [2023-12-26 05:07:44,048][123091] Updated weights for policy 0, policy_version 693825 (0.0009) [2023-12-26 05:07:44,114][123091] Updated weights for policy 0, policy_version 693835 (0.0007) [2023-12-26 05:07:44,550][123090] Updated weights for policy 1, policy_version 689350 (0.0009) [2023-12-26 05:07:44,598][123090] Updated weights for policy 1, policy_version 689360 (0.0008) [2023-12-26 05:07:44,656][123090] Updated weights for policy 1, policy_version 689370 (0.0009) [2023-12-26 05:07:44,895][123091] Updated weights for policy 0, policy_version 693845 (0.0006) [2023-12-26 05:07:44,952][123091] Updated weights for policy 0, policy_version 693855 (0.0007) [2023-12-26 05:07:45,009][123091] Updated weights for policy 0, policy_version 693865 (0.0010) [2023-12-26 05:07:45,555][123090] Updated weights for policy 1, policy_version 689380 (0.0009) [2023-12-26 05:07:45,625][123090] Updated weights for policy 1, policy_version 689390 (0.0009) [2023-12-26 05:07:45,682][123090] Updated weights for policy 1, policy_version 689400 (0.0009) [2023-12-26 05:07:45,822][123091] Updated weights for policy 0, policy_version 693875 (0.0011) [2023-12-26 05:07:45,877][123091] Updated weights for policy 0, policy_version 693885 (0.0010) [2023-12-26 05:07:45,924][123091] Updated weights for policy 0, policy_version 693895 (0.0010) [2023-12-26 05:07:46,521][123090] Updated weights for policy 1, policy_version 689410 (0.0009) [2023-12-26 05:07:46,570][123090] Updated weights for policy 1, policy_version 689420 (0.0009) [2023-12-26 05:07:46,625][123090] Updated weights for policy 1, policy_version 689430 (0.0008) [2023-12-26 05:07:46,677][123090] Updated weights for policy 1, policy_version 689440 (0.0010) [2023-12-26 05:07:46,728][123091] Updated weights for policy 0, policy_version 693905 (0.0010) [2023-12-26 05:07:46,797][123091] Updated weights for policy 0, policy_version 693915 (0.0009) [2023-12-26 05:07:46,852][123091] Updated weights for policy 0, policy_version 693926 (0.0009) [2023-12-26 05:07:46,907][123091] Updated weights for policy 0, policy_version 693936 (0.0010) [2023-12-26 05:07:47,424][123090] Updated weights for policy 1, policy_version 689450 (0.0007) [2023-12-26 05:07:47,480][123090] Updated weights for policy 1, policy_version 689460 (0.0010) [2023-12-26 05:07:47,537][123090] Updated weights for policy 1, policy_version 689470 (0.0006) [2023-12-26 05:07:47,763][123091] Updated weights for policy 0, policy_version 693946 (0.0010) [2023-12-26 05:07:47,833][123091] Updated weights for policy 0, policy_version 693956 (0.0010) [2023-12-26 05:07:47,923][123091] Updated weights for policy 0, policy_version 693966 (0.0011) [2023-12-26 05:07:48,351][123090] Updated weights for policy 1, policy_version 689480 (0.0009) [2023-12-26 05:07:48,414][123090] Updated weights for policy 1, policy_version 689490 (0.0010) [2023-12-26 05:07:48,488][123090] Updated weights for policy 1, policy_version 689500 (0.0011) [2023-12-26 05:07:48,630][123091] Updated weights for policy 0, policy_version 693976 (0.0006) [2023-12-26 05:07:48,700][123091] Updated weights for policy 0, policy_version 693986 (0.0006) [2023-12-26 05:07:48,766][123091] Updated weights for policy 0, policy_version 693996 (0.0006) [2023-12-26 05:07:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 354172928. Throughput: 0: 8685.1, 1: 8868.3. Samples: 354188760. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:07:48,785][121949] Avg episode reward: [(0, '6086.774'), (1, '5435.936')] [2023-12-26 05:07:49,269][123090] Updated weights for policy 1, policy_version 689510 (0.0008) [2023-12-26 05:07:49,339][123090] Updated weights for policy 1, policy_version 689520 (0.0007) [2023-12-26 05:07:49,403][123090] Updated weights for policy 1, policy_version 689530 (0.0006) [2023-12-26 05:07:49,505][123091] Updated weights for policy 0, policy_version 694006 (0.0006) [2023-12-26 05:07:49,576][123091] Updated weights for policy 0, policy_version 694016 (0.0007) [2023-12-26 05:07:49,650][123091] Updated weights for policy 0, policy_version 694026 (0.0006) [2023-12-26 05:07:50,195][123090] Updated weights for policy 1, policy_version 689540 (0.0009) [2023-12-26 05:07:50,271][123090] Updated weights for policy 1, policy_version 689550 (0.0007) [2023-12-26 05:07:50,350][123090] Updated weights for policy 1, policy_version 689560 (0.0006) [2023-12-26 05:07:50,370][123091] Updated weights for policy 0, policy_version 694036 (0.0005) [2023-12-26 05:07:50,445][123091] Updated weights for policy 0, policy_version 694046 (0.0005) [2023-12-26 05:07:50,521][123091] Updated weights for policy 0, policy_version 694056 (0.0005) [2023-12-26 05:07:51,126][123090] Updated weights for policy 1, policy_version 689570 (0.0009) [2023-12-26 05:07:51,188][123091] Updated weights for policy 0, policy_version 694066 (0.0007) [2023-12-26 05:07:51,191][123090] Updated weights for policy 1, policy_version 689580 (0.0009) [2023-12-26 05:07:51,245][123091] Updated weights for policy 0, policy_version 694076 (0.0009) [2023-12-26 05:07:51,257][123090] Updated weights for policy 1, policy_version 689590 (0.0007) [2023-12-26 05:07:51,317][123091] Updated weights for policy 0, policy_version 694086 (0.0010) [2023-12-26 05:07:51,327][123090] Updated weights for policy 1, policy_version 689600 (0.0007) [2023-12-26 05:07:51,375][123091] Updated weights for policy 0, policy_version 694096 (0.0009) [2023-12-26 05:07:52,159][123090] Updated weights for policy 1, policy_version 689610 (0.0010) [2023-12-26 05:07:52,221][123090] Updated weights for policy 1, policy_version 689620 (0.0009) [2023-12-26 05:07:52,250][123091] Updated weights for policy 0, policy_version 694106 (0.0008) [2023-12-26 05:07:52,284][123090] Updated weights for policy 1, policy_version 689630 (0.0008) [2023-12-26 05:07:52,311][123091] Updated weights for policy 0, policy_version 694116 (0.0009) [2023-12-26 05:07:52,374][123091] Updated weights for policy 0, policy_version 694126 (0.0010) [2023-12-26 05:07:52,951][123090] Updated weights for policy 1, policy_version 689640 (0.0005) [2023-12-26 05:07:53,025][123090] Updated weights for policy 1, policy_version 689650 (0.0006) [2023-12-26 05:07:53,086][123090] Updated weights for policy 1, policy_version 689660 (0.0010) [2023-12-26 05:07:53,264][123091] Updated weights for policy 0, policy_version 694137 (0.0010) [2023-12-26 05:07:53,312][123091] Updated weights for policy 0, policy_version 694147 (0.0008) [2023-12-26 05:07:53,363][123091] Updated weights for policy 0, policy_version 694157 (0.0005) [2023-12-26 05:07:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 354263040. Throughput: 0: 8700.1, 1: 8802.3. Samples: 354242096. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:07:53,785][121949] Avg episode reward: [(0, '6154.931'), (1, '5595.061')] [2023-12-26 05:07:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000694160_177709056.pth... [2023-12-26 05:07:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000693136_177446912.pth [2023-12-26 05:07:53,833][123090] Updated weights for policy 1, policy_version 689670 (0.0009) [2023-12-26 05:07:53,887][123090] Updated weights for policy 1, policy_version 689680 (0.0009) [2023-12-26 05:07:53,945][123090] Updated weights for policy 1, policy_version 689690 (0.0009) [2023-12-26 05:07:53,979][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000689696_176562176.pth... [2023-12-26 05:07:53,983][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000688640_176291840.pth [2023-12-26 05:07:54,109][123091] Updated weights for policy 0, policy_version 694167 (0.0009) [2023-12-26 05:07:54,170][123091] Updated weights for policy 0, policy_version 694177 (0.0009) [2023-12-26 05:07:54,235][123091] Updated weights for policy 0, policy_version 694187 (0.0010) [2023-12-26 05:07:54,750][123090] Updated weights for policy 1, policy_version 689700 (0.0009) [2023-12-26 05:07:54,803][123090] Updated weights for policy 1, policy_version 689710 (0.0009) [2023-12-26 05:07:54,855][123090] Updated weights for policy 1, policy_version 689720 (0.0009) [2023-12-26 05:07:55,115][123091] Updated weights for policy 0, policy_version 694197 (0.0010) [2023-12-26 05:07:55,178][123091] Updated weights for policy 0, policy_version 694207 (0.0009) [2023-12-26 05:07:55,237][123091] Updated weights for policy 0, policy_version 694217 (0.0009) [2023-12-26 05:07:55,649][123090] Updated weights for policy 1, policy_version 689731 (0.0008) [2023-12-26 05:07:55,701][123090] Updated weights for policy 1, policy_version 689741 (0.0006) [2023-12-26 05:07:55,762][123090] Updated weights for policy 1, policy_version 689751 (0.0006) [2023-12-26 05:07:56,100][123091] Updated weights for policy 0, policy_version 694227 (0.0010) [2023-12-26 05:07:56,153][123091] Updated weights for policy 0, policy_version 694237 (0.0005) [2023-12-26 05:07:56,208][123091] Updated weights for policy 0, policy_version 694247 (0.0009) [2023-12-26 05:07:56,444][123090] Updated weights for policy 1, policy_version 689761 (0.0005) [2023-12-26 05:07:56,519][123090] Updated weights for policy 1, policy_version 689771 (0.0005) [2023-12-26 05:07:56,588][123090] Updated weights for policy 1, policy_version 689781 (0.0005) [2023-12-26 05:07:56,633][123090] Updated weights for policy 1, policy_version 689791 (0.0005) [2023-12-26 05:07:56,913][123091] Updated weights for policy 0, policy_version 694257 (0.0010) [2023-12-26 05:07:56,986][123091] Updated weights for policy 0, policy_version 694267 (0.0005) [2023-12-26 05:07:57,054][123091] Updated weights for policy 0, policy_version 694277 (0.0006) [2023-12-26 05:07:57,103][123091] Updated weights for policy 0, policy_version 694287 (0.0006) [2023-12-26 05:07:57,228][123090] Updated weights for policy 1, policy_version 689801 (0.0009) [2023-12-26 05:07:57,284][123090] Updated weights for policy 1, policy_version 689811 (0.0009) [2023-12-26 05:07:57,341][123090] Updated weights for policy 1, policy_version 689821 (0.0008) [2023-12-26 05:07:57,793][123091] Updated weights for policy 0, policy_version 694297 (0.0010) [2023-12-26 05:07:57,850][123091] Updated weights for policy 0, policy_version 694307 (0.0010) [2023-12-26 05:07:57,918][123091] Updated weights for policy 0, policy_version 694317 (0.0007) [2023-12-26 05:07:58,146][123090] Updated weights for policy 1, policy_version 689831 (0.0008) [2023-12-26 05:07:58,199][123090] Updated weights for policy 1, policy_version 689841 (0.0010) [2023-12-26 05:07:58,260][123090] Updated weights for policy 1, policy_version 689851 (0.0007) [2023-12-26 05:07:58,647][123091] Updated weights for policy 0, policy_version 694327 (0.0008) [2023-12-26 05:07:58,723][123091] Updated weights for policy 0, policy_version 694337 (0.0007) [2023-12-26 05:07:58,786][121949] Fps is (10 sec: 18019.6, 60 sec: 17475.8, 300 sec: 17689.1). Total num frames: 354353152. Throughput: 0: 8703.6, 1: 8834.8. Samples: 354351188. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:07:58,786][121949] Avg episode reward: [(0, '6054.471'), (1, '5442.101')] [2023-12-26 05:07:58,798][123091] Updated weights for policy 0, policy_version 694347 (0.0007) [2023-12-26 05:07:59,149][123090] Updated weights for policy 1, policy_version 689861 (0.0007) [2023-12-26 05:07:59,224][123090] Updated weights for policy 1, policy_version 689871 (0.0008) [2023-12-26 05:07:59,302][123090] Updated weights for policy 1, policy_version 689881 (0.0008) [2023-12-26 05:07:59,541][123091] Updated weights for policy 0, policy_version 694357 (0.0007) [2023-12-26 05:07:59,611][123091] Updated weights for policy 0, policy_version 694367 (0.0005) [2023-12-26 05:07:59,688][123091] Updated weights for policy 0, policy_version 694377 (0.0006) [2023-12-26 05:08:00,165][123090] Updated weights for policy 1, policy_version 689891 (0.0007) [2023-12-26 05:08:00,212][123090] Updated weights for policy 1, policy_version 689901 (0.0005) [2023-12-26 05:08:00,267][123090] Updated weights for policy 1, policy_version 689911 (0.0005) [2023-12-26 05:08:00,425][123091] Updated weights for policy 0, policy_version 694387 (0.0007) [2023-12-26 05:08:00,477][123091] Updated weights for policy 0, policy_version 694397 (0.0010) [2023-12-26 05:08:00,531][123091] Updated weights for policy 0, policy_version 694407 (0.0009) [2023-12-26 05:08:01,031][123090] Updated weights for policy 1, policy_version 689921 (0.0006) [2023-12-26 05:08:01,100][123090] Updated weights for policy 1, policy_version 689931 (0.0008) [2023-12-26 05:08:01,166][123090] Updated weights for policy 1, policy_version 689941 (0.0008) [2023-12-26 05:08:01,226][123090] Updated weights for policy 1, policy_version 689951 (0.0008) [2023-12-26 05:08:01,410][123091] Updated weights for policy 0, policy_version 694417 (0.0010) [2023-12-26 05:08:01,465][123091] Updated weights for policy 0, policy_version 694427 (0.0009) [2023-12-26 05:08:01,515][123091] Updated weights for policy 0, policy_version 694437 (0.0009) [2023-12-26 05:08:01,564][123091] Updated weights for policy 0, policy_version 694447 (0.0009) [2023-12-26 05:08:01,988][123090] Updated weights for policy 1, policy_version 689961 (0.0008) [2023-12-26 05:08:02,048][123090] Updated weights for policy 1, policy_version 689971 (0.0007) [2023-12-26 05:08:02,105][123090] Updated weights for policy 1, policy_version 689981 (0.0008) [2023-12-26 05:08:02,457][123091] Updated weights for policy 0, policy_version 694457 (0.0009) [2023-12-26 05:08:02,520][123091] Updated weights for policy 0, policy_version 694467 (0.0010) [2023-12-26 05:08:02,586][123091] Updated weights for policy 0, policy_version 694477 (0.0009) [2023-12-26 05:08:02,870][123090] Updated weights for policy 1, policy_version 689991 (0.0007) [2023-12-26 05:08:02,945][123090] Updated weights for policy 1, policy_version 690001 (0.0006) [2023-12-26 05:08:03,006][123090] Updated weights for policy 1, policy_version 690011 (0.0005) [2023-12-26 05:08:03,264][123091] Updated weights for policy 0, policy_version 694487 (0.0008) [2023-12-26 05:08:03,332][123091] Updated weights for policy 0, policy_version 694497 (0.0009) [2023-12-26 05:08:03,393][123091] Updated weights for policy 0, policy_version 694507 (0.0010) [2023-12-26 05:08:03,779][123090] Updated weights for policy 1, policy_version 690021 (0.0008) [2023-12-26 05:08:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 354443264. Throughput: 0: 8759.3, 1: 8778.7. Samples: 354457608. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:03,785][121949] Avg episode reward: [(0, '6090.160'), (1, '5266.322')] [2023-12-26 05:08:03,841][123090] Updated weights for policy 1, policy_version 690031 (0.0008) [2023-12-26 05:08:03,907][123090] Updated weights for policy 1, policy_version 690041 (0.0010) [2023-12-26 05:08:04,171][123091] Updated weights for policy 0, policy_version 694517 (0.0010) [2023-12-26 05:08:04,234][123091] Updated weights for policy 0, policy_version 694527 (0.0009) [2023-12-26 05:08:04,288][123091] Updated weights for policy 0, policy_version 694537 (0.0006) [2023-12-26 05:08:04,722][123090] Updated weights for policy 1, policy_version 690051 (0.0010) [2023-12-26 05:08:04,784][123090] Updated weights for policy 1, policy_version 690061 (0.0009) [2023-12-26 05:08:04,853][123090] Updated weights for policy 1, policy_version 690071 (0.0008) [2023-12-26 05:08:05,133][123091] Updated weights for policy 0, policy_version 694547 (0.0010) [2023-12-26 05:08:05,182][123091] Updated weights for policy 0, policy_version 694557 (0.0009) [2023-12-26 05:08:05,231][123091] Updated weights for policy 0, policy_version 694567 (0.0009) [2023-12-26 05:08:05,545][123090] Updated weights for policy 1, policy_version 690081 (0.0006) [2023-12-26 05:08:05,615][123090] Updated weights for policy 1, policy_version 690091 (0.0008) [2023-12-26 05:08:05,681][123090] Updated weights for policy 1, policy_version 690101 (0.0009) [2023-12-26 05:08:05,747][123090] Updated weights for policy 1, policy_version 690111 (0.0010) [2023-12-26 05:08:06,067][123091] Updated weights for policy 0, policy_version 694577 (0.0010) [2023-12-26 05:08:06,126][123091] Updated weights for policy 0, policy_version 694587 (0.0010) [2023-12-26 05:08:06,197][123091] Updated weights for policy 0, policy_version 694597 (0.0010) [2023-12-26 05:08:06,262][123091] Updated weights for policy 0, policy_version 694607 (0.0009) [2023-12-26 05:08:06,550][123090] Updated weights for policy 1, policy_version 690121 (0.0010) [2023-12-26 05:08:06,612][123090] Updated weights for policy 1, policy_version 690131 (0.0009) [2023-12-26 05:08:06,677][123090] Updated weights for policy 1, policy_version 690141 (0.0010) [2023-12-26 05:08:07,108][123091] Updated weights for policy 0, policy_version 694617 (0.0010) [2023-12-26 05:08:07,166][123091] Updated weights for policy 0, policy_version 694627 (0.0009) [2023-12-26 05:08:07,221][123091] Updated weights for policy 0, policy_version 694637 (0.0009) [2023-12-26 05:08:07,512][123090] Updated weights for policy 1, policy_version 690151 (0.0009) [2023-12-26 05:08:07,573][123090] Updated weights for policy 1, policy_version 690161 (0.0009) [2023-12-26 05:08:07,628][123090] Updated weights for policy 1, policy_version 690171 (0.0009) [2023-12-26 05:08:08,050][123091] Updated weights for policy 0, policy_version 694647 (0.0009) [2023-12-26 05:08:08,103][123091] Updated weights for policy 0, policy_version 694657 (0.0010) [2023-12-26 05:08:08,161][123091] Updated weights for policy 0, policy_version 694667 (0.0010) [2023-12-26 05:08:08,444][123090] Updated weights for policy 1, policy_version 690181 (0.0010) [2023-12-26 05:08:08,508][123090] Updated weights for policy 1, policy_version 690191 (0.0007) [2023-12-26 05:08:08,562][123090] Updated weights for policy 1, policy_version 690201 (0.0007) [2023-12-26 05:08:08,784][121949] Fps is (10 sec: 18025.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 354533376. Throughput: 0: 8738.7, 1: 8809.6. Samples: 354509364. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:08,784][121949] Avg episode reward: [(0, '6163.931'), (1, '5397.731')] [2023-12-26 05:08:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000690208_176693248.pth... [2023-12-26 05:08:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000694672_177840128.pth... [2023-12-26 05:08:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000689184_176431104.pth [2023-12-26 05:08:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000693648_177577984.pth [2023-12-26 05:08:09,077][123091] Updated weights for policy 0, policy_version 694677 (0.0010) [2023-12-26 05:08:09,129][123091] Updated weights for policy 0, policy_version 694687 (0.0009) [2023-12-26 05:08:09,177][123091] Updated weights for policy 0, policy_version 694697 (0.0009) [2023-12-26 05:08:09,211][123090] Updated weights for policy 1, policy_version 690211 (0.0009) [2023-12-26 05:08:09,284][123090] Updated weights for policy 1, policy_version 690221 (0.0009) [2023-12-26 05:08:09,351][123090] Updated weights for policy 1, policy_version 690231 (0.0008) [2023-12-26 05:08:10,074][123091] Updated weights for policy 0, policy_version 694707 (0.0009) [2023-12-26 05:08:10,108][123090] Updated weights for policy 1, policy_version 690241 (0.0008) [2023-12-26 05:08:10,142][123091] Updated weights for policy 0, policy_version 694717 (0.0008) [2023-12-26 05:08:10,175][123090] Updated weights for policy 1, policy_version 690251 (0.0009) [2023-12-26 05:08:10,204][123091] Updated weights for policy 0, policy_version 694727 (0.0008) [2023-12-26 05:08:10,245][123090] Updated weights for policy 1, policy_version 690261 (0.0009) [2023-12-26 05:08:10,296][123090] Updated weights for policy 1, policy_version 690271 (0.0008) [2023-12-26 05:08:10,922][123091] Updated weights for policy 0, policy_version 694737 (0.0008) [2023-12-26 05:08:10,990][123091] Updated weights for policy 0, policy_version 694747 (0.0005) [2023-12-26 05:08:11,063][123091] Updated weights for policy 0, policy_version 694757 (0.0007) [2023-12-26 05:08:11,131][123091] Updated weights for policy 0, policy_version 694767 (0.0008) [2023-12-26 05:08:11,233][123090] Updated weights for policy 1, policy_version 690281 (0.0010) [2023-12-26 05:08:11,294][123090] Updated weights for policy 1, policy_version 690291 (0.0010) [2023-12-26 05:08:11,350][123090] Updated weights for policy 1, policy_version 690301 (0.0009) [2023-12-26 05:08:11,834][123091] Updated weights for policy 0, policy_version 694777 (0.0008) [2023-12-26 05:08:11,895][123091] Updated weights for policy 0, policy_version 694787 (0.0005) [2023-12-26 05:08:11,967][123091] Updated weights for policy 0, policy_version 694797 (0.0005) [2023-12-26 05:08:12,269][123090] Updated weights for policy 1, policy_version 690311 (0.0008) [2023-12-26 05:08:12,337][123090] Updated weights for policy 1, policy_version 690321 (0.0008) [2023-12-26 05:08:12,410][123090] Updated weights for policy 1, policy_version 690331 (0.0009) [2023-12-26 05:08:12,689][123091] Updated weights for policy 0, policy_version 694807 (0.0009) [2023-12-26 05:08:12,752][123091] Updated weights for policy 0, policy_version 694817 (0.0010) [2023-12-26 05:08:12,818][123091] Updated weights for policy 0, policy_version 694827 (0.0009) [2023-12-26 05:08:13,157][123090] Updated weights for policy 1, policy_version 690341 (0.0010) [2023-12-26 05:08:13,219][123090] Updated weights for policy 1, policy_version 690351 (0.0010) [2023-12-26 05:08:13,282][123090] Updated weights for policy 1, policy_version 690361 (0.0010) [2023-12-26 05:08:13,663][123091] Updated weights for policy 0, policy_version 694837 (0.0009) [2023-12-26 05:08:13,711][123091] Updated weights for policy 0, policy_version 694847 (0.0009) [2023-12-26 05:08:13,759][123091] Updated weights for policy 0, policy_version 694857 (0.0009) [2023-12-26 05:08:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 354615296. Throughput: 0: 8749.4, 1: 8753.3. Samples: 354613076. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:13,785][121949] Avg episode reward: [(0, '6239.891'), (1, '5614.159')] [2023-12-26 05:08:14,105][123090] Updated weights for policy 1, policy_version 690371 (0.0010) [2023-12-26 05:08:14,168][123090] Updated weights for policy 1, policy_version 690381 (0.0010) [2023-12-26 05:08:14,230][123090] Updated weights for policy 1, policy_version 690391 (0.0010) [2023-12-26 05:08:14,609][123091] Updated weights for policy 0, policy_version 694867 (0.0009) [2023-12-26 05:08:14,673][123091] Updated weights for policy 0, policy_version 694877 (0.0009) [2023-12-26 05:08:14,729][123091] Updated weights for policy 0, policy_version 694887 (0.0009) [2023-12-26 05:08:15,083][123090] Updated weights for policy 1, policy_version 690401 (0.0010) [2023-12-26 05:08:15,144][123090] Updated weights for policy 1, policy_version 690411 (0.0009) [2023-12-26 05:08:15,214][123090] Updated weights for policy 1, policy_version 690421 (0.0009) [2023-12-26 05:08:15,280][123090] Updated weights for policy 1, policy_version 690431 (0.0009) [2023-12-26 05:08:15,560][123091] Updated weights for policy 0, policy_version 694897 (0.0009) [2023-12-26 05:08:15,617][123091] Updated weights for policy 0, policy_version 694907 (0.0005) [2023-12-26 05:08:15,668][123091] Updated weights for policy 0, policy_version 694917 (0.0005) [2023-12-26 05:08:15,722][123091] Updated weights for policy 0, policy_version 694927 (0.0005) [2023-12-26 05:08:16,181][123090] Updated weights for policy 1, policy_version 690441 (0.0009) [2023-12-26 05:08:16,238][123090] Updated weights for policy 1, policy_version 690451 (0.0009) [2023-12-26 05:08:16,296][123090] Updated weights for policy 1, policy_version 690461 (0.0009) [2023-12-26 05:08:16,439][123091] Updated weights for policy 0, policy_version 694937 (0.0009) [2023-12-26 05:08:16,495][123091] Updated weights for policy 0, policy_version 694947 (0.0009) [2023-12-26 05:08:16,546][123091] Updated weights for policy 0, policy_version 694957 (0.0010) [2023-12-26 05:08:17,134][123090] Updated weights for policy 1, policy_version 690471 (0.0007) [2023-12-26 05:08:17,192][123090] Updated weights for policy 1, policy_version 690481 (0.0005) [2023-12-26 05:08:17,238][123091] Updated weights for policy 0, policy_version 694967 (0.0007) [2023-12-26 05:08:17,259][123090] Updated weights for policy 1, policy_version 690491 (0.0009) [2023-12-26 05:08:17,296][123091] Updated weights for policy 0, policy_version 694977 (0.0005) [2023-12-26 05:08:17,348][123091] Updated weights for policy 0, policy_version 694987 (0.0005) [2023-12-26 05:08:18,016][123090] Updated weights for policy 1, policy_version 690501 (0.0008) [2023-12-26 05:08:18,080][123091] Updated weights for policy 0, policy_version 694997 (0.0005) [2023-12-26 05:08:18,081][123090] Updated weights for policy 1, policy_version 690511 (0.0005) [2023-12-26 05:08:18,131][123090] Updated weights for policy 1, policy_version 690521 (0.0005) [2023-12-26 05:08:18,132][123091] Updated weights for policy 0, policy_version 695007 (0.0007) [2023-12-26 05:08:18,183][123091] Updated weights for policy 0, policy_version 695017 (0.0010) [2023-12-26 05:08:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 354705408. Throughput: 0: 8818.4, 1: 8728.5. Samples: 354719196. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:18,785][121949] Avg episode reward: [(0, '6226.433'), (1, '5665.179')] [2023-12-26 05:08:18,918][123090] Updated weights for policy 1, policy_version 690531 (0.0007) [2023-12-26 05:08:18,971][123090] Updated weights for policy 1, policy_version 690541 (0.0010) [2023-12-26 05:08:19,032][123090] Updated weights for policy 1, policy_version 690551 (0.0010) [2023-12-26 05:08:19,053][123091] Updated weights for policy 0, policy_version 695028 (0.0010) [2023-12-26 05:08:19,116][123091] Updated weights for policy 0, policy_version 695038 (0.0008) [2023-12-26 05:08:19,163][123091] Updated weights for policy 0, policy_version 695048 (0.0008) [2023-12-26 05:08:19,870][123090] Updated weights for policy 1, policy_version 690561 (0.0009) [2023-12-26 05:08:19,940][123090] Updated weights for policy 1, policy_version 690571 (0.0009) [2023-12-26 05:08:20,006][123090] Updated weights for policy 1, policy_version 690581 (0.0010) [2023-12-26 05:08:20,014][123091] Updated weights for policy 0, policy_version 695058 (0.0008) [2023-12-26 05:08:20,075][123090] Updated weights for policy 1, policy_version 690591 (0.0009) [2023-12-26 05:08:20,075][123091] Updated weights for policy 0, policy_version 695068 (0.0009) [2023-12-26 05:08:20,149][123091] Updated weights for policy 0, policy_version 695078 (0.0008) [2023-12-26 05:08:20,199][123091] Updated weights for policy 0, policy_version 695088 (0.0008) [2023-12-26 05:08:20,893][123090] Updated weights for policy 1, policy_version 690601 (0.0010) [2023-12-26 05:08:20,947][123090] Updated weights for policy 1, policy_version 690611 (0.0010) [2023-12-26 05:08:21,010][123090] Updated weights for policy 1, policy_version 690621 (0.0010) [2023-12-26 05:08:21,022][123091] Updated weights for policy 0, policy_version 695098 (0.0008) [2023-12-26 05:08:21,088][123091] Updated weights for policy 0, policy_version 695108 (0.0008) [2023-12-26 05:08:21,155][123091] Updated weights for policy 0, policy_version 695118 (0.0009) [2023-12-26 05:08:21,919][123090] Updated weights for policy 1, policy_version 690631 (0.0010) [2023-12-26 05:08:21,979][123090] Updated weights for policy 1, policy_version 690641 (0.0011) [2023-12-26 05:08:22,039][123090] Updated weights for policy 1, policy_version 690651 (0.0010) [2023-12-26 05:08:22,045][123091] Updated weights for policy 0, policy_version 695128 (0.0007) [2023-12-26 05:08:22,113][123091] Updated weights for policy 0, policy_version 695138 (0.0008) [2023-12-26 05:08:22,186][123091] Updated weights for policy 0, policy_version 695148 (0.0006) [2023-12-26 05:08:22,847][123090] Updated weights for policy 1, policy_version 690661 (0.0010) [2023-12-26 05:08:22,863][123091] Updated weights for policy 0, policy_version 695158 (0.0006) [2023-12-26 05:08:22,904][123090] Updated weights for policy 1, policy_version 690671 (0.0010) [2023-12-26 05:08:22,924][123091] Updated weights for policy 0, policy_version 695168 (0.0006) [2023-12-26 05:08:22,964][123090] Updated weights for policy 1, policy_version 690681 (0.0010) [2023-12-26 05:08:22,978][123091] Updated weights for policy 0, policy_version 695178 (0.0005) [2023-12-26 05:08:23,691][123091] Updated weights for policy 0, policy_version 695188 (0.0005) [2023-12-26 05:08:23,750][123091] Updated weights for policy 0, policy_version 695198 (0.0006) [2023-12-26 05:08:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 354787328. Throughput: 0: 8809.1, 1: 8702.3. Samples: 354769056. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:23,785][121949] Avg episode reward: [(0, '6163.812'), (1, '5632.069')] [2023-12-26 05:08:23,797][123091] Updated weights for policy 0, policy_version 695208 (0.0006) [2023-12-26 05:08:23,805][123090] Updated weights for policy 1, policy_version 690691 (0.0010) [2023-12-26 05:08:23,830][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000695216_177979392.pth... [2023-12-26 05:08:23,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000694160_177709056.pth [2023-12-26 05:08:23,857][123090] Updated weights for policy 1, policy_version 690701 (0.0010) [2023-12-26 05:08:23,912][123090] Updated weights for policy 1, policy_version 690711 (0.0010) [2023-12-26 05:08:23,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000690720_176824320.pth... [2023-12-26 05:08:23,976][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000689696_176562176.pth [2023-12-26 05:08:24,538][123091] Updated weights for policy 0, policy_version 695218 (0.0006) [2023-12-26 05:08:24,591][123091] Updated weights for policy 0, policy_version 695228 (0.0006) [2023-12-26 05:08:24,650][123091] Updated weights for policy 0, policy_version 695238 (0.0005) [2023-12-26 05:08:24,700][123091] Updated weights for policy 0, policy_version 695248 (0.0005) [2023-12-26 05:08:24,740][123090] Updated weights for policy 1, policy_version 690721 (0.0010) [2023-12-26 05:08:24,811][123090] Updated weights for policy 1, policy_version 690731 (0.0009) [2023-12-26 05:08:24,874][123090] Updated weights for policy 1, policy_version 690741 (0.0008) [2023-12-26 05:08:24,929][123090] Updated weights for policy 1, policy_version 690751 (0.0005) [2023-12-26 05:08:25,493][123091] Updated weights for policy 0, policy_version 695258 (0.0005) [2023-12-26 05:08:25,553][123091] Updated weights for policy 0, policy_version 695268 (0.0005) [2023-12-26 05:08:25,608][123091] Updated weights for policy 0, policy_version 695278 (0.0005) [2023-12-26 05:08:25,631][123090] Updated weights for policy 1, policy_version 690761 (0.0005) [2023-12-26 05:08:25,709][123090] Updated weights for policy 1, policy_version 690771 (0.0008) [2023-12-26 05:08:25,781][123090] Updated weights for policy 1, policy_version 690781 (0.0009) [2023-12-26 05:08:26,271][123091] Updated weights for policy 0, policy_version 695288 (0.0007) [2023-12-26 05:08:26,323][123091] Updated weights for policy 0, policy_version 695298 (0.0009) [2023-12-26 05:08:26,373][123091] Updated weights for policy 0, policy_version 695308 (0.0009) [2023-12-26 05:08:26,549][123090] Updated weights for policy 1, policy_version 690791 (0.0009) [2023-12-26 05:08:26,611][123090] Updated weights for policy 1, policy_version 690801 (0.0009) [2023-12-26 05:08:26,669][123090] Updated weights for policy 1, policy_version 690811 (0.0009) [2023-12-26 05:08:27,181][123091] Updated weights for policy 0, policy_version 695318 (0.0009) [2023-12-26 05:08:27,234][123091] Updated weights for policy 0, policy_version 695328 (0.0010) [2023-12-26 05:08:27,292][123091] Updated weights for policy 0, policy_version 695338 (0.0008) [2023-12-26 05:08:27,498][123090] Updated weights for policy 1, policy_version 690821 (0.0009) [2023-12-26 05:08:27,560][123090] Updated weights for policy 1, policy_version 690831 (0.0009) [2023-12-26 05:08:27,622][123090] Updated weights for policy 1, policy_version 690841 (0.0009) [2023-12-26 05:08:28,108][123091] Updated weights for policy 0, policy_version 695348 (0.0007) [2023-12-26 05:08:28,168][123091] Updated weights for policy 0, policy_version 695358 (0.0009) [2023-12-26 05:08:28,227][123091] Updated weights for policy 0, policy_version 695368 (0.0010) [2023-12-26 05:08:28,459][123090] Updated weights for policy 1, policy_version 690851 (0.0009) [2023-12-26 05:08:28,520][123090] Updated weights for policy 1, policy_version 690861 (0.0008) [2023-12-26 05:08:28,578][123090] Updated weights for policy 1, policy_version 690871 (0.0008) [2023-12-26 05:08:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 354885632. Throughput: 0: 8906.9, 1: 8772.4. Samples: 354878864. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:28,784][121949] Avg episode reward: [(0, '6196.137'), (1, '5583.910')] [2023-12-26 05:08:29,059][123091] Updated weights for policy 0, policy_version 695378 (0.0009) [2023-12-26 05:08:29,119][123091] Updated weights for policy 0, policy_version 695388 (0.0008) [2023-12-26 05:08:29,183][123091] Updated weights for policy 0, policy_version 695398 (0.0009) [2023-12-26 05:08:29,248][123091] Updated weights for policy 0, policy_version 695408 (0.0009) [2023-12-26 05:08:29,421][123090] Updated weights for policy 1, policy_version 690882 (0.0009) [2023-12-26 05:08:29,482][123090] Updated weights for policy 1, policy_version 690892 (0.0010) [2023-12-26 05:08:29,552][123090] Updated weights for policy 1, policy_version 690902 (0.0010) [2023-12-26 05:08:29,612][123090] Updated weights for policy 1, policy_version 690912 (0.0009) [2023-12-26 05:08:30,095][123091] Updated weights for policy 0, policy_version 695418 (0.0009) [2023-12-26 05:08:30,144][123091] Updated weights for policy 0, policy_version 695428 (0.0009) [2023-12-26 05:08:30,217][123091] Updated weights for policy 0, policy_version 695438 (0.0009) [2023-12-26 05:08:30,410][123090] Updated weights for policy 1, policy_version 690922 (0.0007) [2023-12-26 05:08:30,480][123090] Updated weights for policy 1, policy_version 690932 (0.0006) [2023-12-26 05:08:30,535][123090] Updated weights for policy 1, policy_version 690942 (0.0006) [2023-12-26 05:08:31,117][123091] Updated weights for policy 0, policy_version 695448 (0.0009) [2023-12-26 05:08:31,187][123091] Updated weights for policy 0, policy_version 695458 (0.0009) [2023-12-26 05:08:31,258][123091] Updated weights for policy 0, policy_version 695468 (0.0010) [2023-12-26 05:08:31,307][123090] Updated weights for policy 1, policy_version 690952 (0.0008) [2023-12-26 05:08:31,377][123090] Updated weights for policy 1, policy_version 690962 (0.0009) [2023-12-26 05:08:31,436][123090] Updated weights for policy 1, policy_version 690972 (0.0006) [2023-12-26 05:08:32,098][123091] Updated weights for policy 0, policy_version 695478 (0.0011) [2023-12-26 05:08:32,166][123091] Updated weights for policy 0, policy_version 695488 (0.0009) [2023-12-26 05:08:32,222][123091] Updated weights for policy 0, policy_version 695498 (0.0009) [2023-12-26 05:08:32,232][123090] Updated weights for policy 1, policy_version 690982 (0.0007) [2023-12-26 05:08:32,293][123090] Updated weights for policy 1, policy_version 690992 (0.0009) [2023-12-26 05:08:32,370][123090] Updated weights for policy 1, policy_version 691002 (0.0009) [2023-12-26 05:08:32,935][123091] Updated weights for policy 0, policy_version 695508 (0.0008) [2023-12-26 05:08:32,989][123091] Updated weights for policy 0, policy_version 695519 (0.0011) [2023-12-26 05:08:33,044][123091] Updated weights for policy 0, policy_version 695529 (0.0009) [2023-12-26 05:08:33,191][123090] Updated weights for policy 1, policy_version 691012 (0.0009) [2023-12-26 05:08:33,238][123090] Updated weights for policy 1, policy_version 691022 (0.0008) [2023-12-26 05:08:33,290][123090] Updated weights for policy 1, policy_version 691032 (0.0007) [2023-12-26 05:08:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 354967552. Throughput: 0: 8852.1, 1: 8780.0. Samples: 354982204. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:33,784][121949] Avg episode reward: [(0, '6315.077'), (1, '5596.704')] [2023-12-26 05:08:33,804][123091] Updated weights for policy 0, policy_version 695539 (0.0008) [2023-12-26 05:08:33,871][123091] Updated weights for policy 0, policy_version 695549 (0.0008) [2023-12-26 05:08:33,935][123091] Updated weights for policy 0, policy_version 695559 (0.0007) [2023-12-26 05:08:34,025][123090] Updated weights for policy 1, policy_version 691042 (0.0006) [2023-12-26 05:08:34,079][123090] Updated weights for policy 1, policy_version 691052 (0.0010) [2023-12-26 05:08:34,138][123090] Updated weights for policy 1, policy_version 691062 (0.0010) [2023-12-26 05:08:34,195][123090] Updated weights for policy 1, policy_version 691072 (0.0009) [2023-12-26 05:08:34,674][123091] Updated weights for policy 0, policy_version 695569 (0.0006) [2023-12-26 05:08:34,738][123091] Updated weights for policy 0, policy_version 695579 (0.0009) [2023-12-26 05:08:34,790][123091] Updated weights for policy 0, policy_version 695589 (0.0010) [2023-12-26 05:08:34,852][123091] Updated weights for policy 0, policy_version 695599 (0.0010) [2023-12-26 05:08:35,052][123090] Updated weights for policy 1, policy_version 691082 (0.0009) [2023-12-26 05:08:35,116][123090] Updated weights for policy 1, policy_version 691092 (0.0010) [2023-12-26 05:08:35,188][123090] Updated weights for policy 1, policy_version 691102 (0.0011) [2023-12-26 05:08:35,534][123091] Updated weights for policy 0, policy_version 695609 (0.0006) [2023-12-26 05:08:35,614][123091] Updated weights for policy 0, policy_version 695619 (0.0005) [2023-12-26 05:08:35,669][123091] Updated weights for policy 0, policy_version 695629 (0.0005) [2023-12-26 05:08:36,008][123090] Updated weights for policy 1, policy_version 691113 (0.0006) [2023-12-26 05:08:36,058][123090] Updated weights for policy 1, policy_version 691123 (0.0005) [2023-12-26 05:08:36,115][123090] Updated weights for policy 1, policy_version 691133 (0.0007) [2023-12-26 05:08:36,325][123091] Updated weights for policy 0, policy_version 695639 (0.0006) [2023-12-26 05:08:36,392][123091] Updated weights for policy 0, policy_version 695649 (0.0006) [2023-12-26 05:08:36,465][123091] Updated weights for policy 0, policy_version 695659 (0.0007) [2023-12-26 05:08:36,880][123090] Updated weights for policy 1, policy_version 691143 (0.0010) [2023-12-26 05:08:36,943][123090] Updated weights for policy 1, policy_version 691153 (0.0010) [2023-12-26 05:08:37,006][123090] Updated weights for policy 1, policy_version 691163 (0.0010) [2023-12-26 05:08:37,175][123091] Updated weights for policy 0, policy_version 695669 (0.0008) [2023-12-26 05:08:37,233][123091] Updated weights for policy 0, policy_version 695679 (0.0005) [2023-12-26 05:08:37,300][123091] Updated weights for policy 0, policy_version 695689 (0.0005) [2023-12-26 05:08:37,824][123090] Updated weights for policy 1, policy_version 691173 (0.0009) [2023-12-26 05:08:37,886][123090] Updated weights for policy 1, policy_version 691183 (0.0010) [2023-12-26 05:08:37,939][123090] Updated weights for policy 1, policy_version 691193 (0.0010) [2023-12-26 05:08:37,968][123091] Updated weights for policy 0, policy_version 695699 (0.0008) [2023-12-26 05:08:38,036][123091] Updated weights for policy 0, policy_version 695709 (0.0009) [2023-12-26 05:08:38,107][123091] Updated weights for policy 0, policy_version 695719 (0.0011) [2023-12-26 05:08:38,688][123090] Updated weights for policy 1, policy_version 691203 (0.0008) [2023-12-26 05:08:38,761][123090] Updated weights for policy 1, policy_version 691213 (0.0006) [2023-12-26 05:08:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 355057664. Throughput: 0: 8904.5, 1: 8779.1. Samples: 355037852. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:38,784][121949] Avg episode reward: [(0, '6287.145'), (1, '5565.851')] [2023-12-26 05:08:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000695728_178110464.pth... [2023-12-26 05:08:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000694672_177840128.pth [2023-12-26 05:08:38,824][123090] Updated weights for policy 1, policy_version 691223 (0.0005) [2023-12-26 05:08:38,888][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000691232_176955392.pth... [2023-12-26 05:08:38,892][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000690208_176693248.pth [2023-12-26 05:08:38,919][123091] Updated weights for policy 0, policy_version 695729 (0.0011) [2023-12-26 05:08:38,982][123091] Updated weights for policy 0, policy_version 695739 (0.0009) [2023-12-26 05:08:39,041][123091] Updated weights for policy 0, policy_version 695749 (0.0010) [2023-12-26 05:08:39,092][123091] Updated weights for policy 0, policy_version 695759 (0.0010) [2023-12-26 05:08:39,498][123090] Updated weights for policy 1, policy_version 691233 (0.0007) [2023-12-26 05:08:39,562][123090] Updated weights for policy 1, policy_version 691243 (0.0005) [2023-12-26 05:08:39,629][123090] Updated weights for policy 1, policy_version 691253 (0.0005) [2023-12-26 05:08:39,704][123090] Updated weights for policy 1, policy_version 691263 (0.0005) [2023-12-26 05:08:39,967][123091] Updated weights for policy 0, policy_version 695769 (0.0011) [2023-12-26 05:08:40,032][123091] Updated weights for policy 0, policy_version 695779 (0.0011) [2023-12-26 05:08:40,096][123091] Updated weights for policy 0, policy_version 695789 (0.0011) [2023-12-26 05:08:40,410][123090] Updated weights for policy 1, policy_version 691273 (0.0011) [2023-12-26 05:08:40,462][123090] Updated weights for policy 1, policy_version 691283 (0.0010) [2023-12-26 05:08:40,522][123090] Updated weights for policy 1, policy_version 691293 (0.0010) [2023-12-26 05:08:40,869][123091] Updated weights for policy 0, policy_version 695799 (0.0007) [2023-12-26 05:08:40,918][123091] Updated weights for policy 0, policy_version 695809 (0.0006) [2023-12-26 05:08:40,978][123091] Updated weights for policy 0, policy_version 695819 (0.0008) [2023-12-26 05:08:41,401][123090] Updated weights for policy 1, policy_version 691303 (0.0010) [2023-12-26 05:08:41,466][123090] Updated weights for policy 1, policy_version 691313 (0.0006) [2023-12-26 05:08:41,545][123090] Updated weights for policy 1, policy_version 691323 (0.0005) [2023-12-26 05:08:41,707][123091] Updated weights for policy 0, policy_version 695829 (0.0006) [2023-12-26 05:08:41,779][123091] Updated weights for policy 0, policy_version 695839 (0.0008) [2023-12-26 05:08:41,836][123091] Updated weights for policy 0, policy_version 695849 (0.0009) [2023-12-26 05:08:42,305][123090] Updated weights for policy 1, policy_version 691333 (0.0009) [2023-12-26 05:08:42,380][123090] Updated weights for policy 1, policy_version 691343 (0.0010) [2023-12-26 05:08:42,438][123090] Updated weights for policy 1, policy_version 691353 (0.0007) [2023-12-26 05:08:42,583][123091] Updated weights for policy 0, policy_version 695859 (0.0007) [2023-12-26 05:08:42,648][123091] Updated weights for policy 0, policy_version 695869 (0.0011) [2023-12-26 05:08:42,696][123091] Updated weights for policy 0, policy_version 695879 (0.0010) [2023-12-26 05:08:43,150][123090] Updated weights for policy 1, policy_version 691363 (0.0007) [2023-12-26 05:08:43,207][123090] Updated weights for policy 1, policy_version 691373 (0.0005) [2023-12-26 05:08:43,279][123090] Updated weights for policy 1, policy_version 691383 (0.0005) [2023-12-26 05:08:43,517][123091] Updated weights for policy 0, policy_version 695889 (0.0010) [2023-12-26 05:08:43,588][123091] Updated weights for policy 0, policy_version 695899 (0.0006) [2023-12-26 05:08:43,648][123091] Updated weights for policy 0, policy_version 695909 (0.0006) [2023-12-26 05:08:43,699][123091] Updated weights for policy 0, policy_version 695919 (0.0005) [2023-12-26 05:08:43,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 355155968. Throughput: 0: 8930.8, 1: 8736.4. Samples: 355146184. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:43,785][121949] Avg episode reward: [(0, '6224.779'), (1, '5358.066')] [2023-12-26 05:08:43,895][123090] Updated weights for policy 1, policy_version 691393 (0.0005) [2023-12-26 05:08:43,949][123090] Updated weights for policy 1, policy_version 691403 (0.0005) [2023-12-26 05:08:44,018][123090] Updated weights for policy 1, policy_version 691413 (0.0006) [2023-12-26 05:08:44,070][123090] Updated weights for policy 1, policy_version 691423 (0.0010) [2023-12-26 05:08:44,368][123091] Updated weights for policy 0, policy_version 695929 (0.0005) [2023-12-26 05:08:44,436][123091] Updated weights for policy 0, policy_version 695939 (0.0007) [2023-12-26 05:08:44,500][123091] Updated weights for policy 0, policy_version 695949 (0.0009) [2023-12-26 05:08:44,822][123090] Updated weights for policy 1, policy_version 691433 (0.0007) [2023-12-26 05:08:44,882][123090] Updated weights for policy 1, policy_version 691443 (0.0007) [2023-12-26 05:08:44,939][123090] Updated weights for policy 1, policy_version 691453 (0.0006) [2023-12-26 05:08:45,336][123091] Updated weights for policy 0, policy_version 695959 (0.0009) [2023-12-26 05:08:45,393][123091] Updated weights for policy 0, policy_version 695969 (0.0008) [2023-12-26 05:08:45,454][123091] Updated weights for policy 0, policy_version 695979 (0.0009) [2023-12-26 05:08:45,726][123090] Updated weights for policy 1, policy_version 691463 (0.0009) [2023-12-26 05:08:45,806][123090] Updated weights for policy 1, policy_version 691473 (0.0011) [2023-12-26 05:08:45,861][123090] Updated weights for policy 1, policy_version 691483 (0.0010) [2023-12-26 05:08:46,313][123091] Updated weights for policy 0, policy_version 695989 (0.0010) [2023-12-26 05:08:46,366][123091] Updated weights for policy 0, policy_version 695999 (0.0006) [2023-12-26 05:08:46,435][123091] Updated weights for policy 0, policy_version 696009 (0.0005) [2023-12-26 05:08:46,599][123090] Updated weights for policy 1, policy_version 691493 (0.0009) [2023-12-26 05:08:46,669][123090] Updated weights for policy 1, policy_version 691503 (0.0008) [2023-12-26 05:08:46,722][123090] Updated weights for policy 1, policy_version 691513 (0.0005) [2023-12-26 05:08:47,166][123091] Updated weights for policy 0, policy_version 696019 (0.0007) [2023-12-26 05:08:47,214][123091] Updated weights for policy 0, policy_version 696029 (0.0010) [2023-12-26 05:08:47,265][123091] Updated weights for policy 0, policy_version 696039 (0.0010) [2023-12-26 05:08:47,347][123090] Updated weights for policy 1, policy_version 691523 (0.0006) [2023-12-26 05:08:47,417][123090] Updated weights for policy 1, policy_version 691533 (0.0008) [2023-12-26 05:08:47,478][123090] Updated weights for policy 1, policy_version 691543 (0.0006) [2023-12-26 05:08:47,990][123091] Updated weights for policy 0, policy_version 696049 (0.0010) [2023-12-26 05:08:48,042][123091] Updated weights for policy 0, policy_version 696059 (0.0009) [2023-12-26 05:08:48,091][123091] Updated weights for policy 0, policy_version 696069 (0.0009) [2023-12-26 05:08:48,121][123090] Updated weights for policy 1, policy_version 691553 (0.0009) [2023-12-26 05:08:48,142][123091] Updated weights for policy 0, policy_version 696079 (0.0008) [2023-12-26 05:08:48,181][123090] Updated weights for policy 1, policy_version 691563 (0.0010) [2023-12-26 05:08:48,250][123090] Updated weights for policy 1, policy_version 691573 (0.0010) [2023-12-26 05:08:48,313][123090] Updated weights for policy 1, policy_version 691583 (0.0010) [2023-12-26 05:08:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 355246080. Throughput: 0: 8961.2, 1: 8845.4. Samples: 355258900. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:48,785][121949] Avg episode reward: [(0, '6229.719'), (1, '5310.315')] [2023-12-26 05:08:49,006][123091] Updated weights for policy 0, policy_version 696089 (0.0009) [2023-12-26 05:08:49,071][123091] Updated weights for policy 0, policy_version 696099 (0.0009) [2023-12-26 05:08:49,138][123091] Updated weights for policy 0, policy_version 696109 (0.0007) [2023-12-26 05:08:49,152][123090] Updated weights for policy 1, policy_version 691593 (0.0011) [2023-12-26 05:08:49,211][123090] Updated weights for policy 1, policy_version 691603 (0.0010) [2023-12-26 05:08:49,278][123090] Updated weights for policy 1, policy_version 691613 (0.0010) [2023-12-26 05:08:49,983][123091] Updated weights for policy 0, policy_version 696119 (0.0008) [2023-12-26 05:08:50,048][123091] Updated weights for policy 0, policy_version 696129 (0.0008) [2023-12-26 05:08:50,106][123091] Updated weights for policy 0, policy_version 696139 (0.0009) [2023-12-26 05:08:50,144][123090] Updated weights for policy 1, policy_version 691623 (0.0010) [2023-12-26 05:08:50,199][123090] Updated weights for policy 1, policy_version 691633 (0.0009) [2023-12-26 05:08:50,260][123090] Updated weights for policy 1, policy_version 691643 (0.0009) [2023-12-26 05:08:50,910][123091] Updated weights for policy 0, policy_version 696149 (0.0008) [2023-12-26 05:08:50,985][123091] Updated weights for policy 0, policy_version 696159 (0.0008) [2023-12-26 05:08:51,051][123091] Updated weights for policy 0, policy_version 696169 (0.0009) [2023-12-26 05:08:51,056][123090] Updated weights for policy 1, policy_version 691653 (0.0008) [2023-12-26 05:08:51,122][123090] Updated weights for policy 1, policy_version 691663 (0.0010) [2023-12-26 05:08:51,186][123090] Updated weights for policy 1, policy_version 691673 (0.0010) [2023-12-26 05:08:51,869][123091] Updated weights for policy 0, policy_version 696179 (0.0008) [2023-12-26 05:08:51,918][123091] Updated weights for policy 0, policy_version 696189 (0.0009) [2023-12-26 05:08:51,970][123091] Updated weights for policy 0, policy_version 696199 (0.0009) [2023-12-26 05:08:52,044][123090] Updated weights for policy 1, policy_version 691683 (0.0009) [2023-12-26 05:08:52,115][123090] Updated weights for policy 1, policy_version 691693 (0.0010) [2023-12-26 05:08:52,182][123090] Updated weights for policy 1, policy_version 691703 (0.0010) [2023-12-26 05:08:52,844][123091] Updated weights for policy 0, policy_version 696209 (0.0009) [2023-12-26 05:08:52,910][123091] Updated weights for policy 0, policy_version 696219 (0.0009) [2023-12-26 05:08:52,974][123091] Updated weights for policy 0, policy_version 696229 (0.0009) [2023-12-26 05:08:53,007][123090] Updated weights for policy 1, policy_version 691713 (0.0011) [2023-12-26 05:08:53,039][123091] Updated weights for policy 0, policy_version 696239 (0.0007) [2023-12-26 05:08:53,058][123090] Updated weights for policy 1, policy_version 691723 (0.0010) [2023-12-26 05:08:53,106][123090] Updated weights for policy 1, policy_version 691733 (0.0010) [2023-12-26 05:08:53,168][123090] Updated weights for policy 1, policy_version 691743 (0.0010) [2023-12-26 05:08:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 355328000. Throughput: 0: 8959.9, 1: 8829.1. Samples: 355309872. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:53,785][121949] Avg episode reward: [(0, '6258.315'), (1, '5554.554')] [2023-12-26 05:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000696240_178241536.pth... [2023-12-26 05:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000691744_177086464.pth... [2023-12-26 05:08:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000695216_177979392.pth [2023-12-26 05:08:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000690720_176824320.pth [2023-12-26 05:08:53,847][123091] Updated weights for policy 0, policy_version 696249 (0.0009) [2023-12-26 05:08:53,895][123091] Updated weights for policy 0, policy_version 696259 (0.0009) [2023-12-26 05:08:53,943][123091] Updated weights for policy 0, policy_version 696269 (0.0009) [2023-12-26 05:08:54,002][123090] Updated weights for policy 1, policy_version 691753 (0.0010) [2023-12-26 05:08:54,060][123090] Updated weights for policy 1, policy_version 691763 (0.0010) [2023-12-26 05:08:54,122][123090] Updated weights for policy 1, policy_version 691773 (0.0010) [2023-12-26 05:08:54,803][123091] Updated weights for policy 0, policy_version 696279 (0.0009) [2023-12-26 05:08:54,855][123091] Updated weights for policy 0, policy_version 696289 (0.0008) [2023-12-26 05:08:54,907][123091] Updated weights for policy 0, policy_version 696299 (0.0009) [2023-12-26 05:08:54,951][123090] Updated weights for policy 1, policy_version 691783 (0.0010) [2023-12-26 05:08:55,003][123090] Updated weights for policy 1, policy_version 691793 (0.0010) [2023-12-26 05:08:55,063][123090] Updated weights for policy 1, policy_version 691803 (0.0010) [2023-12-26 05:08:55,745][123091] Updated weights for policy 0, policy_version 696309 (0.0010) [2023-12-26 05:08:55,812][123091] Updated weights for policy 0, policy_version 696319 (0.0009) [2023-12-26 05:08:55,871][123091] Updated weights for policy 0, policy_version 696329 (0.0009) [2023-12-26 05:08:55,884][123090] Updated weights for policy 1, policy_version 691813 (0.0010) [2023-12-26 05:08:55,950][123090] Updated weights for policy 1, policy_version 691823 (0.0010) [2023-12-26 05:08:56,013][123090] Updated weights for policy 1, policy_version 691833 (0.0010) [2023-12-26 05:08:56,584][123091] Updated weights for policy 0, policy_version 696339 (0.0006) [2023-12-26 05:08:56,648][123091] Updated weights for policy 0, policy_version 696349 (0.0005) [2023-12-26 05:08:56,695][123091] Updated weights for policy 0, policy_version 696359 (0.0005) [2023-12-26 05:08:56,721][123090] Updated weights for policy 1, policy_version 691843 (0.0009) [2023-12-26 05:08:56,773][123090] Updated weights for policy 1, policy_version 691853 (0.0005) [2023-12-26 05:08:56,819][123090] Updated weights for policy 1, policy_version 691863 (0.0005) [2023-12-26 05:08:57,355][123091] Updated weights for policy 0, policy_version 696369 (0.0005) [2023-12-26 05:08:57,413][123091] Updated weights for policy 0, policy_version 696379 (0.0005) [2023-12-26 05:08:57,473][123091] Updated weights for policy 0, policy_version 696389 (0.0005) [2023-12-26 05:08:57,530][123091] Updated weights for policy 0, policy_version 696399 (0.0005) [2023-12-26 05:08:57,552][123090] Updated weights for policy 1, policy_version 691873 (0.0006) [2023-12-26 05:08:57,615][123090] Updated weights for policy 1, policy_version 691883 (0.0010) [2023-12-26 05:08:57,675][123090] Updated weights for policy 1, policy_version 691893 (0.0010) [2023-12-26 05:08:57,730][123090] Updated weights for policy 1, policy_version 691903 (0.0010) [2023-12-26 05:08:58,318][123091] Updated weights for policy 0, policy_version 696409 (0.0008) [2023-12-26 05:08:58,388][123091] Updated weights for policy 0, policy_version 696419 (0.0010) [2023-12-26 05:08:58,450][123091] Updated weights for policy 0, policy_version 696429 (0.0009) [2023-12-26 05:08:58,573][123090] Updated weights for policy 1, policy_version 691913 (0.0007) [2023-12-26 05:08:58,636][123090] Updated weights for policy 1, policy_version 691923 (0.0006) [2023-12-26 05:08:58,727][123090] Updated weights for policy 1, policy_version 691933 (0.0011) [2023-12-26 05:08:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.3, 300 sec: 17689.2). Total num frames: 355426304. Throughput: 0: 8987.7, 1: 8873.2. Samples: 355416812. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:08:58,785][121949] Avg episode reward: [(0, '6235.670'), (1, '5747.819')] [2023-12-26 05:08:59,313][123091] Updated weights for policy 0, policy_version 696439 (0.0008) [2023-12-26 05:08:59,379][123091] Updated weights for policy 0, policy_version 696449 (0.0009) [2023-12-26 05:08:59,439][123091] Updated weights for policy 0, policy_version 696459 (0.0009) [2023-12-26 05:08:59,576][123090] Updated weights for policy 1, policy_version 691943 (0.0010) [2023-12-26 05:08:59,633][123090] Updated weights for policy 1, policy_version 691954 (0.0010) [2023-12-26 05:08:59,694][123090] Updated weights for policy 1, policy_version 691964 (0.0010) [2023-12-26 05:09:00,265][123091] Updated weights for policy 0, policy_version 696469 (0.0010) [2023-12-26 05:09:00,326][123091] Updated weights for policy 0, policy_version 696479 (0.0010) [2023-12-26 05:09:00,382][123091] Updated weights for policy 0, policy_version 696489 (0.0009) [2023-12-26 05:09:00,527][123090] Updated weights for policy 1, policy_version 691974 (0.0009) [2023-12-26 05:09:00,594][123090] Updated weights for policy 1, policy_version 691984 (0.0009) [2023-12-26 05:09:00,651][123090] Updated weights for policy 1, policy_version 691994 (0.0009) [2023-12-26 05:09:01,185][123091] Updated weights for policy 0, policy_version 696499 (0.0009) [2023-12-26 05:09:01,234][123091] Updated weights for policy 0, policy_version 696509 (0.0009) [2023-12-26 05:09:01,295][123091] Updated weights for policy 0, policy_version 696519 (0.0009) [2023-12-26 05:09:01,502][123090] Updated weights for policy 1, policy_version 692004 (0.0009) [2023-12-26 05:09:01,555][123090] Updated weights for policy 1, policy_version 692014 (0.0010) [2023-12-26 05:09:01,614][123090] Updated weights for policy 1, policy_version 692024 (0.0009) [2023-12-26 05:09:02,103][123091] Updated weights for policy 0, policy_version 696529 (0.0010) [2023-12-26 05:09:02,165][123091] Updated weights for policy 0, policy_version 696539 (0.0009) [2023-12-26 05:09:02,234][123091] Updated weights for policy 0, policy_version 696549 (0.0009) [2023-12-26 05:09:02,296][123091] Updated weights for policy 0, policy_version 696559 (0.0009) [2023-12-26 05:09:02,475][123090] Updated weights for policy 1, policy_version 692034 (0.0009) [2023-12-26 05:09:02,545][123090] Updated weights for policy 1, policy_version 692044 (0.0009) [2023-12-26 05:09:02,618][123090] Updated weights for policy 1, policy_version 692054 (0.0010) [2023-12-26 05:09:02,678][123090] Updated weights for policy 1, policy_version 692064 (0.0011) [2023-12-26 05:09:03,103][123091] Updated weights for policy 0, policy_version 696569 (0.0006) [2023-12-26 05:09:03,178][123091] Updated weights for policy 0, policy_version 696579 (0.0005) [2023-12-26 05:09:03,240][123091] Updated weights for policy 0, policy_version 696589 (0.0008) [2023-12-26 05:09:03,427][123090] Updated weights for policy 1, policy_version 692074 (0.0005) [2023-12-26 05:09:03,481][123090] Updated weights for policy 1, policy_version 692084 (0.0005) [2023-12-26 05:09:03,527][123090] Updated weights for policy 1, policy_version 692094 (0.0005) [2023-12-26 05:09:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 355508224. Throughput: 0: 8923.8, 1: 8851.0. Samples: 355519064. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:09:03,784][121949] Avg episode reward: [(0, '6248.099'), (1, '5649.650')] [2023-12-26 05:09:04,047][123091] Updated weights for policy 0, policy_version 696599 (0.0009) [2023-12-26 05:09:04,098][123091] Updated weights for policy 0, policy_version 696609 (0.0009) [2023-12-26 05:09:04,164][123091] Updated weights for policy 0, policy_version 696619 (0.0009) [2023-12-26 05:09:04,292][123090] Updated weights for policy 1, policy_version 692104 (0.0005) [2023-12-26 05:09:04,362][123090] Updated weights for policy 1, policy_version 692114 (0.0005) [2023-12-26 05:09:04,432][123090] Updated weights for policy 1, policy_version 692124 (0.0006) [2023-12-26 05:09:05,075][123090] Updated weights for policy 1, policy_version 692134 (0.0009) [2023-12-26 05:09:05,081][123091] Updated weights for policy 0, policy_version 696629 (0.0009) [2023-12-26 05:09:05,127][123091] Updated weights for policy 0, policy_version 696639 (0.0008) [2023-12-26 05:09:05,141][123090] Updated weights for policy 1, policy_version 692144 (0.0010) [2023-12-26 05:09:05,171][123091] Updated weights for policy 0, policy_version 696649 (0.0007) [2023-12-26 05:09:05,196][123090] Updated weights for policy 1, policy_version 692154 (0.0010) [2023-12-26 05:09:05,866][123090] Updated weights for policy 1, policy_version 692164 (0.0008) [2023-12-26 05:09:05,917][123090] Updated weights for policy 1, policy_version 692174 (0.0005) [2023-12-26 05:09:05,974][123090] Updated weights for policy 1, policy_version 692184 (0.0005) [2023-12-26 05:09:06,100][123091] Updated weights for policy 0, policy_version 696659 (0.0010) [2023-12-26 05:09:06,171][123091] Updated weights for policy 0, policy_version 696669 (0.0009) [2023-12-26 05:09:06,241][123091] Updated weights for policy 0, policy_version 696679 (0.0009) [2023-12-26 05:09:06,701][123090] Updated weights for policy 1, policy_version 692194 (0.0005) [2023-12-26 05:09:06,761][123090] Updated weights for policy 1, policy_version 692204 (0.0005) [2023-12-26 05:09:06,819][123090] Updated weights for policy 1, policy_version 692214 (0.0005) [2023-12-26 05:09:06,875][123090] Updated weights for policy 1, policy_version 692224 (0.0005) [2023-12-26 05:09:07,137][123091] Updated weights for policy 0, policy_version 696689 (0.0009) [2023-12-26 05:09:07,206][123091] Updated weights for policy 0, policy_version 696699 (0.0009) [2023-12-26 05:09:07,279][123091] Updated weights for policy 0, policy_version 696709 (0.0010) [2023-12-26 05:09:07,350][123091] Updated weights for policy 0, policy_version 696719 (0.0010) [2023-12-26 05:09:07,486][123090] Updated weights for policy 1, policy_version 692234 (0.0006) [2023-12-26 05:09:07,548][123090] Updated weights for policy 1, policy_version 692244 (0.0006) [2023-12-26 05:09:07,608][123090] Updated weights for policy 1, policy_version 692254 (0.0005) [2023-12-26 05:09:08,239][123090] Updated weights for policy 1, policy_version 692264 (0.0005) [2023-12-26 05:09:08,241][123091] Updated weights for policy 0, policy_version 696729 (0.0009) [2023-12-26 05:09:08,288][123091] Updated weights for policy 0, policy_version 696739 (0.0009) [2023-12-26 05:09:08,302][123090] Updated weights for policy 1, policy_version 692274 (0.0008) [2023-12-26 05:09:08,350][123091] Updated weights for policy 0, policy_version 696749 (0.0010) [2023-12-26 05:09:08,371][123090] Updated weights for policy 1, policy_version 692284 (0.0007) [2023-12-26 05:09:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 355598336. Throughput: 0: 8897.2, 1: 8955.7. Samples: 355572432. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:09:08,784][121949] Avg episode reward: [(0, '6179.346'), (1, '5657.193')] [2023-12-26 05:09:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000692288_177225728.pth... [2023-12-26 05:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000696752_178372608.pth... [2023-12-26 05:09:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000691232_176955392.pth [2023-12-26 05:09:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000695728_178110464.pth [2023-12-26 05:09:09,104][123091] Updated weights for policy 0, policy_version 696759 (0.0007) [2023-12-26 05:09:09,158][123091] Updated weights for policy 0, policy_version 696769 (0.0005) [2023-12-26 05:09:09,214][123091] Updated weights for policy 0, policy_version 696779 (0.0007) [2023-12-26 05:09:09,241][123090] Updated weights for policy 1, policy_version 692294 (0.0009) [2023-12-26 05:09:09,305][123090] Updated weights for policy 1, policy_version 692304 (0.0010) [2023-12-26 05:09:09,375][123090] Updated weights for policy 1, policy_version 692314 (0.0010) [2023-12-26 05:09:10,056][123091] Updated weights for policy 0, policy_version 696789 (0.0009) [2023-12-26 05:09:10,109][123091] Updated weights for policy 0, policy_version 696799 (0.0009) [2023-12-26 05:09:10,172][123091] Updated weights for policy 0, policy_version 696809 (0.0009) [2023-12-26 05:09:10,205][123090] Updated weights for policy 1, policy_version 692324 (0.0010) [2023-12-26 05:09:10,276][123090] Updated weights for policy 1, policy_version 692334 (0.0008) [2023-12-26 05:09:10,342][123090] Updated weights for policy 1, policy_version 692344 (0.0010) [2023-12-26 05:09:11,023][123091] Updated weights for policy 0, policy_version 696819 (0.0010) [2023-12-26 05:09:11,097][123091] Updated weights for policy 0, policy_version 696829 (0.0008) [2023-12-26 05:09:11,170][123091] Updated weights for policy 0, policy_version 696839 (0.0008) [2023-12-26 05:09:11,182][123090] Updated weights for policy 1, policy_version 692354 (0.0010) [2023-12-26 05:09:11,252][123090] Updated weights for policy 1, policy_version 692364 (0.0009) [2023-12-26 05:09:11,329][123090] Updated weights for policy 1, policy_version 692374 (0.0009) [2023-12-26 05:09:11,395][123008] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000006 [2023-12-26 05:09:11,398][123090] Updated weights for policy 1, policy_version 692384 (0.0009) [2023-12-26 05:09:12,013][123091] Updated weights for policy 0, policy_version 696849 (0.0006) [2023-12-26 05:09:12,076][123091] Updated weights for policy 0, policy_version 696859 (0.0005) [2023-12-26 05:09:12,135][123091] Updated weights for policy 0, policy_version 696869 (0.0006) [2023-12-26 05:09:12,135][123090] Updated weights for policy 1, policy_version 692394 (0.0006) [2023-12-26 05:09:12,187][123090] Updated weights for policy 1, policy_version 692404 (0.0005) [2023-12-26 05:09:12,195][123091] Updated weights for policy 0, policy_version 696879 (0.0008) [2023-12-26 05:09:12,245][123090] Updated weights for policy 1, policy_version 692414 (0.0006) [2023-12-26 05:09:12,970][123090] Updated weights for policy 1, policy_version 692424 (0.0007) [2023-12-26 05:09:13,037][123090] Updated weights for policy 1, policy_version 692434 (0.0008) [2023-12-26 05:09:13,041][123091] Updated weights for policy 0, policy_version 696889 (0.0008) [2023-12-26 05:09:13,098][123091] Updated weights for policy 0, policy_version 696899 (0.0009) [2023-12-26 05:09:13,099][123090] Updated weights for policy 1, policy_version 692444 (0.0005) [2023-12-26 05:09:13,152][123091] Updated weights for policy 0, policy_version 696909 (0.0009) [2023-12-26 05:09:13,774][123090] Updated weights for policy 1, policy_version 692454 (0.0007) [2023-12-26 05:09:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 355680256. Throughput: 0: 8748.7, 1: 8990.1. Samples: 355677112. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:09:13,784][121949] Avg episode reward: [(0, '6121.288'), (1, '5643.059')] [2023-12-26 05:09:13,824][123090] Updated weights for policy 1, policy_version 692464 (0.0008) [2023-12-26 05:09:13,887][123090] Updated weights for policy 1, policy_version 692474 (0.0008) [2023-12-26 05:09:14,043][123091] Updated weights for policy 0, policy_version 696919 (0.0010) [2023-12-26 05:09:14,100][123091] Updated weights for policy 0, policy_version 696929 (0.0009) [2023-12-26 05:09:14,156][123091] Updated weights for policy 0, policy_version 696939 (0.0009) [2023-12-26 05:09:14,761][123090] Updated weights for policy 1, policy_version 692484 (0.0009) [2023-12-26 05:09:14,821][123090] Updated weights for policy 1, policy_version 692494 (0.0009) [2023-12-26 05:09:14,878][123090] Updated weights for policy 1, policy_version 692504 (0.0009) [2023-12-26 05:09:14,900][123091] Updated weights for policy 0, policy_version 696949 (0.0010) [2023-12-26 05:09:14,963][123091] Updated weights for policy 0, policy_version 696959 (0.0011) [2023-12-26 05:09:15,012][123091] Updated weights for policy 0, policy_version 696969 (0.0011) [2023-12-26 05:09:15,717][123090] Updated weights for policy 1, policy_version 692514 (0.0010) [2023-12-26 05:09:15,773][123090] Updated weights for policy 1, policy_version 692524 (0.0009) [2023-12-26 05:09:15,826][123090] Updated weights for policy 1, policy_version 692534 (0.0009) [2023-12-26 05:09:15,874][123090] Updated weights for policy 1, policy_version 692544 (0.0009) [2023-12-26 05:09:15,874][123091] Updated weights for policy 0, policy_version 696980 (0.0011) [2023-12-26 05:09:15,921][123091] Updated weights for policy 0, policy_version 696990 (0.0010) [2023-12-26 05:09:15,976][123091] Updated weights for policy 0, policy_version 697000 (0.0007) [2023-12-26 05:09:16,683][123091] Updated weights for policy 0, policy_version 697010 (0.0006) [2023-12-26 05:09:16,747][123091] Updated weights for policy 0, policy_version 697020 (0.0005) [2023-12-26 05:09:16,751][123090] Updated weights for policy 1, policy_version 692554 (0.0010) [2023-12-26 05:09:16,800][123091] Updated weights for policy 0, policy_version 697030 (0.0005) [2023-12-26 05:09:16,806][123090] Updated weights for policy 1, policy_version 692564 (0.0009) [2023-12-26 05:09:16,854][123091] Updated weights for policy 0, policy_version 697040 (0.0009) [2023-12-26 05:09:16,866][123090] Updated weights for policy 1, policy_version 692574 (0.0008) [2023-12-26 05:09:17,623][123091] Updated weights for policy 0, policy_version 697050 (0.0005) [2023-12-26 05:09:17,684][123091] Updated weights for policy 0, policy_version 697060 (0.0005) [2023-12-26 05:09:17,752][123091] Updated weights for policy 0, policy_version 697070 (0.0006) [2023-12-26 05:09:17,765][123090] Updated weights for policy 1, policy_version 692584 (0.0009) [2023-12-26 05:09:17,826][123090] Updated weights for policy 1, policy_version 692594 (0.0009) [2023-12-26 05:09:17,889][123090] Updated weights for policy 1, policy_version 692604 (0.0009) [2023-12-26 05:09:18,517][123091] Updated weights for policy 0, policy_version 697080 (0.0009) [2023-12-26 05:09:18,570][123091] Updated weights for policy 0, policy_version 697090 (0.0010) [2023-12-26 05:09:18,635][123091] Updated weights for policy 0, policy_version 697100 (0.0011) [2023-12-26 05:09:18,744][123090] Updated weights for policy 1, policy_version 692614 (0.0009) [2023-12-26 05:09:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 355770368. Throughput: 0: 8815.5, 1: 8975.4. Samples: 355782800. Policy #0 lag: (min: 15.0, avg: 22.6, max: 47.0) [2023-12-26 05:09:18,785][121949] Avg episode reward: [(0, '6150.062'), (1, '5745.766')] [2023-12-26 05:09:18,803][123090] Updated weights for policy 1, policy_version 692624 (0.0009) [2023-12-26 05:09:18,866][123090] Updated weights for policy 1, policy_version 692634 (0.0009) [2023-12-26 05:09:19,489][123091] Updated weights for policy 0, policy_version 697110 (0.0008) [2023-12-26 05:09:19,559][123091] Updated weights for policy 0, policy_version 697120 (0.0007) [2023-12-26 05:09:19,624][123091] Updated weights for policy 0, policy_version 697130 (0.0009) [2023-12-26 05:09:19,743][123090] Updated weights for policy 1, policy_version 692644 (0.0009) [2023-12-26 05:09:19,794][123090] Updated weights for policy 1, policy_version 692654 (0.0007) [2023-12-26 05:09:19,863][123090] Updated weights for policy 1, policy_version 692664 (0.0007) [2023-12-26 05:09:20,356][123091] Updated weights for policy 0, policy_version 697140 (0.0010) [2023-12-26 05:09:20,414][123091] Updated weights for policy 0, policy_version 697150 (0.0010) [2023-12-26 05:09:20,478][123091] Updated weights for policy 0, policy_version 697160 (0.0011) [2023-12-26 05:09:20,759][123090] Updated weights for policy 1, policy_version 692674 (0.0007) [2023-12-26 05:09:20,830][123090] Updated weights for policy 1, policy_version 692684 (0.0009) [2023-12-26 05:09:20,905][123090] Updated weights for policy 1, policy_version 692694 (0.0009) [2023-12-26 05:09:20,980][123090] Updated weights for policy 1, policy_version 692704 (0.0009) [2023-12-26 05:09:21,364][123091] Updated weights for policy 0, policy_version 697170 (0.0010) [2023-12-26 05:09:21,436][123091] Updated weights for policy 0, policy_version 697180 (0.0007) [2023-12-26 05:09:21,508][123091] Updated weights for policy 0, policy_version 697190 (0.0006) [2023-12-26 05:09:21,582][123091] Updated weights for policy 0, policy_version 697200 (0.0006) [2023-12-26 05:09:21,833][123090] Updated weights for policy 1, policy_version 692714 (0.0006) [2023-12-26 05:09:21,902][123090] Updated weights for policy 1, policy_version 692724 (0.0009) [2023-12-26 05:09:21,970][123090] Updated weights for policy 1, policy_version 692734 (0.0009) [2023-12-26 05:09:22,340][123091] Updated weights for policy 0, policy_version 697210 (0.0007) [2023-12-26 05:09:22,408][123091] Updated weights for policy 0, policy_version 697220 (0.0009) [2023-12-26 05:09:22,466][123091] Updated weights for policy 0, policy_version 697230 (0.0010) [2023-12-26 05:09:22,794][123090] Updated weights for policy 1, policy_version 692744 (0.0010) [2023-12-26 05:09:22,862][123090] Updated weights for policy 1, policy_version 692754 (0.0010) [2023-12-26 05:09:22,921][123090] Updated weights for policy 1, policy_version 692764 (0.0010) [2023-12-26 05:09:23,166][123091] Updated weights for policy 0, policy_version 697240 (0.0006) [2023-12-26 05:09:23,213][123091] Updated weights for policy 0, policy_version 697250 (0.0005) [2023-12-26 05:09:23,266][123091] Updated weights for policy 0, policy_version 697260 (0.0005) [2023-12-26 05:09:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 355852288. Throughput: 0: 8735.8, 1: 8946.8. Samples: 355833572. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:23,785][121949] Avg episode reward: [(0, '6132.017'), (1, '5688.666')] [2023-12-26 05:09:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000697264_178503680.pth... [2023-12-26 05:09:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000696240_178241536.pth [2023-12-26 05:09:23,839][123090] Updated weights for policy 1, policy_version 692774 (0.0009) [2023-12-26 05:09:23,902][123090] Updated weights for policy 1, policy_version 692784 (0.0009) [2023-12-26 05:09:23,961][123090] Updated weights for policy 1, policy_version 692794 (0.0009) [2023-12-26 05:09:23,994][123091] Updated weights for policy 0, policy_version 697270 (0.0006) [2023-12-26 05:09:24,000][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000692800_177356800.pth... [2023-12-26 05:09:24,004][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000691744_177086464.pth [2023-12-26 05:09:24,057][123091] Updated weights for policy 0, policy_version 697280 (0.0009) [2023-12-26 05:09:24,123][123091] Updated weights for policy 0, policy_version 697290 (0.0011) [2023-12-26 05:09:24,833][123091] Updated weights for policy 0, policy_version 697300 (0.0009) [2023-12-26 05:09:24,868][123090] Updated weights for policy 1, policy_version 692804 (0.0008) [2023-12-26 05:09:24,896][123091] Updated weights for policy 0, policy_version 697310 (0.0007) [2023-12-26 05:09:24,930][123090] Updated weights for policy 1, policy_version 692814 (0.0009) [2023-12-26 05:09:24,961][123091] Updated weights for policy 0, policy_version 697320 (0.0009) [2023-12-26 05:09:24,990][123090] Updated weights for policy 1, policy_version 692824 (0.0008) [2023-12-26 05:09:25,611][123091] Updated weights for policy 0, policy_version 697330 (0.0011) [2023-12-26 05:09:25,618][123090] Updated weights for policy 1, policy_version 692834 (0.0009) [2023-12-26 05:09:25,662][123091] Updated weights for policy 0, policy_version 697340 (0.0010) [2023-12-26 05:09:25,676][123090] Updated weights for policy 1, policy_version 692844 (0.0010) [2023-12-26 05:09:25,724][123091] Updated weights for policy 0, policy_version 697350 (0.0010) [2023-12-26 05:09:25,732][123090] Updated weights for policy 1, policy_version 692854 (0.0010) [2023-12-26 05:09:25,780][123090] Updated weights for policy 1, policy_version 692864 (0.0010) [2023-12-26 05:09:25,786][123091] Updated weights for policy 0, policy_version 697360 (0.0010) [2023-12-26 05:09:26,571][123090] Updated weights for policy 1, policy_version 692874 (0.0006) [2023-12-26 05:09:26,588][123091] Updated weights for policy 0, policy_version 697370 (0.0005) [2023-12-26 05:09:26,632][123090] Updated weights for policy 1, policy_version 692884 (0.0006) [2023-12-26 05:09:26,640][123091] Updated weights for policy 0, policy_version 697380 (0.0005) [2023-12-26 05:09:26,689][123091] Updated weights for policy 0, policy_version 697390 (0.0005) [2023-12-26 05:09:26,703][123090] Updated weights for policy 1, policy_version 692894 (0.0005) [2023-12-26 05:09:27,252][123091] Updated weights for policy 0, policy_version 697400 (0.0005) [2023-12-26 05:09:27,308][123091] Updated weights for policy 0, policy_version 697410 (0.0006) [2023-12-26 05:09:27,333][123090] Updated weights for policy 1, policy_version 692904 (0.0009) [2023-12-26 05:09:27,372][123091] Updated weights for policy 0, policy_version 697420 (0.0006) [2023-12-26 05:09:27,407][123090] Updated weights for policy 1, policy_version 692914 (0.0007) [2023-12-26 05:09:27,478][123090] Updated weights for policy 1, policy_version 692924 (0.0005) [2023-12-26 05:09:28,038][123091] Updated weights for policy 0, policy_version 697430 (0.0006) [2023-12-26 05:09:28,083][123091] Updated weights for policy 0, policy_version 697440 (0.0005) [2023-12-26 05:09:28,139][123091] Updated weights for policy 0, policy_version 697450 (0.0005) [2023-12-26 05:09:28,157][123090] Updated weights for policy 1, policy_version 692934 (0.0006) [2023-12-26 05:09:28,221][123090] Updated weights for policy 1, policy_version 692944 (0.0005) [2023-12-26 05:09:28,283][123090] Updated weights for policy 1, policy_version 692954 (0.0005) [2023-12-26 05:09:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 355950592. Throughput: 0: 8817.8, 1: 8919.8. Samples: 355944376. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:28,785][121949] Avg episode reward: [(0, '6115.212'), (1, '5656.392')] [2023-12-26 05:09:28,911][123091] Updated weights for policy 0, policy_version 697460 (0.0007) [2023-12-26 05:09:28,966][123090] Updated weights for policy 1, policy_version 692964 (0.0007) [2023-12-26 05:09:28,976][123091] Updated weights for policy 0, policy_version 697470 (0.0005) [2023-12-26 05:09:29,023][123090] Updated weights for policy 1, policy_version 692974 (0.0011) [2023-12-26 05:09:29,033][123091] Updated weights for policy 0, policy_version 697480 (0.0005) [2023-12-26 05:09:29,072][123090] Updated weights for policy 1, policy_version 692984 (0.0008) [2023-12-26 05:09:29,828][123091] Updated weights for policy 0, policy_version 697490 (0.0008) [2023-12-26 05:09:29,873][123090] Updated weights for policy 1, policy_version 692994 (0.0008) [2023-12-26 05:09:29,892][123091] Updated weights for policy 0, policy_version 697500 (0.0011) [2023-12-26 05:09:29,937][123090] Updated weights for policy 1, policy_version 693004 (0.0006) [2023-12-26 05:09:29,955][123091] Updated weights for policy 0, policy_version 697510 (0.0013) [2023-12-26 05:09:30,001][123090] Updated weights for policy 1, policy_version 693014 (0.0009) [2023-12-26 05:09:30,023][123091] Updated weights for policy 0, policy_version 697520 (0.0005) [2023-12-26 05:09:30,061][123090] Updated weights for policy 1, policy_version 693024 (0.0009) [2023-12-26 05:09:30,762][123091] Updated weights for policy 0, policy_version 697530 (0.0009) [2023-12-26 05:09:30,810][123091] Updated weights for policy 0, policy_version 697540 (0.0009) [2023-12-26 05:09:30,865][123090] Updated weights for policy 1, policy_version 693034 (0.0007) [2023-12-26 05:09:30,869][123091] Updated weights for policy 0, policy_version 697550 (0.0009) [2023-12-26 05:09:30,914][123090] Updated weights for policy 1, policy_version 693044 (0.0005) [2023-12-26 05:09:30,974][123090] Updated weights for policy 1, policy_version 693054 (0.0005) [2023-12-26 05:09:31,664][123091] Updated weights for policy 0, policy_version 697560 (0.0009) [2023-12-26 05:09:31,710][123090] Updated weights for policy 1, policy_version 693064 (0.0008) [2023-12-26 05:09:31,731][123091] Updated weights for policy 0, policy_version 697570 (0.0007) [2023-12-26 05:09:31,783][123090] Updated weights for policy 1, policy_version 693074 (0.0008) [2023-12-26 05:09:31,798][123091] Updated weights for policy 0, policy_version 697580 (0.0008) [2023-12-26 05:09:31,849][123090] Updated weights for policy 1, policy_version 693084 (0.0007) [2023-12-26 05:09:32,604][123090] Updated weights for policy 1, policy_version 693094 (0.0009) [2023-12-26 05:09:32,646][123091] Updated weights for policy 0, policy_version 697590 (0.0010) [2023-12-26 05:09:32,661][123090] Updated weights for policy 1, policy_version 693104 (0.0008) [2023-12-26 05:09:32,712][123091] Updated weights for policy 0, policy_version 697600 (0.0007) [2023-12-26 05:09:32,715][123090] Updated weights for policy 1, policy_version 693114 (0.0008) [2023-12-26 05:09:32,778][123091] Updated weights for policy 0, policy_version 697610 (0.0009) [2023-12-26 05:09:33,461][123090] Updated weights for policy 1, policy_version 693124 (0.0009) [2023-12-26 05:09:33,519][123090] Updated weights for policy 1, policy_version 693134 (0.0010) [2023-12-26 05:09:33,542][123091] Updated weights for policy 0, policy_version 697620 (0.0008) [2023-12-26 05:09:33,589][123090] Updated weights for policy 1, policy_version 693144 (0.0010) [2023-12-26 05:09:33,603][123091] Updated weights for policy 0, policy_version 697630 (0.0005) [2023-12-26 05:09:33,668][123091] Updated weights for policy 0, policy_version 697640 (0.0007) [2023-12-26 05:09:33,784][121949] Fps is (10 sec: 19661.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 356048896. Throughput: 0: 8833.1, 1: 8869.1. Samples: 356055496. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:33,785][121949] Avg episode reward: [(0, '6149.899'), (1, '5794.795')] [2023-12-26 05:09:34,400][123091] Updated weights for policy 0, policy_version 697650 (0.0009) [2023-12-26 05:09:34,405][123090] Updated weights for policy 1, policy_version 693154 (0.0011) [2023-12-26 05:09:34,464][123091] Updated weights for policy 0, policy_version 697660 (0.0010) [2023-12-26 05:09:34,473][123090] Updated weights for policy 1, policy_version 693164 (0.0011) [2023-12-26 05:09:34,531][123091] Updated weights for policy 0, policy_version 697670 (0.0008) [2023-12-26 05:09:34,537][123090] Updated weights for policy 1, policy_version 693174 (0.0011) [2023-12-26 05:09:34,592][123091] Updated weights for policy 0, policy_version 697680 (0.0006) [2023-12-26 05:09:34,603][123090] Updated weights for policy 1, policy_version 693184 (0.0011) [2023-12-26 05:09:35,413][123090] Updated weights for policy 1, policy_version 693194 (0.0009) [2023-12-26 05:09:35,428][123091] Updated weights for policy 0, policy_version 697690 (0.0007) [2023-12-26 05:09:35,480][123090] Updated weights for policy 1, policy_version 693204 (0.0010) [2023-12-26 05:09:35,487][123091] Updated weights for policy 0, policy_version 697700 (0.0006) [2023-12-26 05:09:35,542][123090] Updated weights for policy 1, policy_version 693214 (0.0005) [2023-12-26 05:09:35,551][123091] Updated weights for policy 0, policy_version 697710 (0.0009) [2023-12-26 05:09:36,301][123090] Updated weights for policy 1, policy_version 693224 (0.0009) [2023-12-26 05:09:36,344][123091] Updated weights for policy 0, policy_version 697720 (0.0007) [2023-12-26 05:09:36,367][123090] Updated weights for policy 1, policy_version 693234 (0.0009) [2023-12-26 05:09:36,409][123091] Updated weights for policy 0, policy_version 697730 (0.0007) [2023-12-26 05:09:36,424][123090] Updated weights for policy 1, policy_version 693244 (0.0008) [2023-12-26 05:09:36,466][123091] Updated weights for policy 0, policy_version 697740 (0.0009) [2023-12-26 05:09:37,265][123090] Updated weights for policy 1, policy_version 693254 (0.0009) [2023-12-26 05:09:37,286][123091] Updated weights for policy 0, policy_version 697750 (0.0008) [2023-12-26 05:09:37,328][123090] Updated weights for policy 1, policy_version 693264 (0.0009) [2023-12-26 05:09:37,335][123091] Updated weights for policy 0, policy_version 697760 (0.0007) [2023-12-26 05:09:37,390][123090] Updated weights for policy 1, policy_version 693274 (0.0008) [2023-12-26 05:09:37,393][123091] Updated weights for policy 0, policy_version 697770 (0.0007) [2023-12-26 05:09:38,208][123090] Updated weights for policy 1, policy_version 693284 (0.0008) [2023-12-26 05:09:38,228][123091] Updated weights for policy 0, policy_version 697780 (0.0009) [2023-12-26 05:09:38,269][123090] Updated weights for policy 1, policy_version 693294 (0.0006) [2023-12-26 05:09:38,281][123091] Updated weights for policy 0, policy_version 697790 (0.0010) [2023-12-26 05:09:38,350][123090] Updated weights for policy 1, policy_version 693304 (0.0008) [2023-12-26 05:09:38,351][123091] Updated weights for policy 0, policy_version 697800 (0.0009) [2023-12-26 05:09:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 356130816. Throughput: 0: 8847.3, 1: 8884.4. Samples: 356107796. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:38,785][121949] Avg episode reward: [(0, '6126.399'), (1, '5712.912')] [2023-12-26 05:09:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000697808_178642944.pth... [2023-12-26 05:09:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000693312_177487872.pth... [2023-12-26 05:09:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000692288_177225728.pth [2023-12-26 05:09:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000696752_178372608.pth [2023-12-26 05:09:39,051][123090] Updated weights for policy 1, policy_version 693314 (0.0006) [2023-12-26 05:09:39,106][123090] Updated weights for policy 1, policy_version 693324 (0.0006) [2023-12-26 05:09:39,168][123090] Updated weights for policy 1, policy_version 693334 (0.0006) [2023-12-26 05:09:39,234][123090] Updated weights for policy 1, policy_version 693344 (0.0006) [2023-12-26 05:09:39,235][123091] Updated weights for policy 0, policy_version 697810 (0.0008) [2023-12-26 05:09:39,294][123091] Updated weights for policy 0, policy_version 697820 (0.0005) [2023-12-26 05:09:39,355][123091] Updated weights for policy 0, policy_version 697830 (0.0009) [2023-12-26 05:09:39,423][123091] Updated weights for policy 0, policy_version 697840 (0.0009) [2023-12-26 05:09:39,922][123090] Updated weights for policy 1, policy_version 693354 (0.0011) [2023-12-26 05:09:39,986][123090] Updated weights for policy 1, policy_version 693364 (0.0008) [2023-12-26 05:09:40,058][123090] Updated weights for policy 1, policy_version 693374 (0.0008) [2023-12-26 05:09:40,305][123091] Updated weights for policy 0, policy_version 697850 (0.0009) [2023-12-26 05:09:40,372][123091] Updated weights for policy 0, policy_version 697860 (0.0009) [2023-12-26 05:09:40,432][123091] Updated weights for policy 0, policy_version 697870 (0.0010) [2023-12-26 05:09:40,843][123090] Updated weights for policy 1, policy_version 693384 (0.0009) [2023-12-26 05:09:40,900][123090] Updated weights for policy 1, policy_version 693394 (0.0005) [2023-12-26 05:09:40,962][123090] Updated weights for policy 1, policy_version 693404 (0.0006) [2023-12-26 05:09:41,316][123091] Updated weights for policy 0, policy_version 697880 (0.0009) [2023-12-26 05:09:41,382][123091] Updated weights for policy 0, policy_version 697890 (0.0010) [2023-12-26 05:09:41,443][123091] Updated weights for policy 0, policy_version 697900 (0.0009) [2023-12-26 05:09:41,753][123090] Updated weights for policy 1, policy_version 693414 (0.0008) [2023-12-26 05:09:41,824][123090] Updated weights for policy 1, policy_version 693424 (0.0008) [2023-12-26 05:09:41,894][123090] Updated weights for policy 1, policy_version 693434 (0.0008) [2023-12-26 05:09:42,271][123091] Updated weights for policy 0, policy_version 697910 (0.0010) [2023-12-26 05:09:42,328][123091] Updated weights for policy 0, policy_version 697920 (0.0010) [2023-12-26 05:09:42,394][123091] Updated weights for policy 0, policy_version 697930 (0.0009) [2023-12-26 05:09:42,665][123090] Updated weights for policy 1, policy_version 693444 (0.0008) [2023-12-26 05:09:42,723][123090] Updated weights for policy 1, policy_version 693454 (0.0010) [2023-12-26 05:09:42,785][123090] Updated weights for policy 1, policy_version 693464 (0.0009) [2023-12-26 05:09:43,172][123091] Updated weights for policy 0, policy_version 697940 (0.0009) [2023-12-26 05:09:43,235][123091] Updated weights for policy 0, policy_version 697950 (0.0010) [2023-12-26 05:09:43,298][123091] Updated weights for policy 0, policy_version 697960 (0.0010) [2023-12-26 05:09:43,597][123090] Updated weights for policy 1, policy_version 693474 (0.0010) [2023-12-26 05:09:43,659][123090] Updated weights for policy 1, policy_version 693484 (0.0008) [2023-12-26 05:09:43,737][123090] Updated weights for policy 1, policy_version 693494 (0.0005) [2023-12-26 05:09:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 356220928. Throughput: 0: 8759.0, 1: 8906.5. Samples: 356211756. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:43,785][121949] Avg episode reward: [(0, '6123.125'), (1, '5756.342')] [2023-12-26 05:09:43,785][123090] Updated weights for policy 1, policy_version 693504 (0.0008) [2023-12-26 05:09:44,164][123091] Updated weights for policy 0, policy_version 697970 (0.0009) [2023-12-26 05:09:44,222][123091] Updated weights for policy 0, policy_version 697980 (0.0006) [2023-12-26 05:09:44,275][123091] Updated weights for policy 0, policy_version 697991 (0.0007) [2023-12-26 05:09:44,502][123090] Updated weights for policy 1, policy_version 693514 (0.0006) [2023-12-26 05:09:44,579][123090] Updated weights for policy 1, policy_version 693524 (0.0009) [2023-12-26 05:09:44,655][123090] Updated weights for policy 1, policy_version 693534 (0.0008) [2023-12-26 05:09:45,067][123091] Updated weights for policy 0, policy_version 698001 (0.0006) [2023-12-26 05:09:45,143][123091] Updated weights for policy 0, policy_version 698011 (0.0006) [2023-12-26 05:09:45,213][123091] Updated weights for policy 0, policy_version 698021 (0.0008) [2023-12-26 05:09:45,275][123091] Updated weights for policy 0, policy_version 698031 (0.0010) [2023-12-26 05:09:45,341][123090] Updated weights for policy 1, policy_version 693544 (0.0006) [2023-12-26 05:09:45,418][123090] Updated weights for policy 1, policy_version 693554 (0.0006) [2023-12-26 05:09:45,494][123090] Updated weights for policy 1, policy_version 693564 (0.0006) [2023-12-26 05:09:46,061][123091] Updated weights for policy 0, policy_version 698041 (0.0011) [2023-12-26 05:09:46,108][123091] Updated weights for policy 0, policy_version 698051 (0.0010) [2023-12-26 05:09:46,159][123091] Updated weights for policy 0, policy_version 698061 (0.0010) [2023-12-26 05:09:46,184][123090] Updated weights for policy 1, policy_version 693574 (0.0007) [2023-12-26 05:09:46,231][123090] Updated weights for policy 1, policy_version 693584 (0.0008) [2023-12-26 05:09:46,279][123090] Updated weights for policy 1, policy_version 693594 (0.0009) [2023-12-26 05:09:47,001][123091] Updated weights for policy 0, policy_version 698071 (0.0010) [2023-12-26 05:09:47,060][123091] Updated weights for policy 0, policy_version 698081 (0.0010) [2023-12-26 05:09:47,111][123091] Updated weights for policy 0, policy_version 698091 (0.0010) [2023-12-26 05:09:47,146][123090] Updated weights for policy 1, policy_version 693604 (0.0008) [2023-12-26 05:09:47,198][123090] Updated weights for policy 1, policy_version 693614 (0.0008) [2023-12-26 05:09:47,259][123090] Updated weights for policy 1, policy_version 693624 (0.0008) [2023-12-26 05:09:47,940][123091] Updated weights for policy 0, policy_version 698101 (0.0010) [2023-12-26 05:09:47,999][123091] Updated weights for policy 0, policy_version 698111 (0.0011) [2023-12-26 05:09:48,066][123091] Updated weights for policy 0, policy_version 698121 (0.0011) [2023-12-26 05:09:48,116][123090] Updated weights for policy 1, policy_version 693634 (0.0008) [2023-12-26 05:09:48,178][123090] Updated weights for policy 1, policy_version 693644 (0.0009) [2023-12-26 05:09:48,248][123090] Updated weights for policy 1, policy_version 693654 (0.0009) [2023-12-26 05:09:48,313][123090] Updated weights for policy 1, policy_version 693664 (0.0009) [2023-12-26 05:09:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 356302848. Throughput: 0: 8777.0, 1: 8947.8. Samples: 356316680. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:48,785][121949] Avg episode reward: [(0, '6124.439'), (1, '5632.055')] [2023-12-26 05:09:48,896][123091] Updated weights for policy 0, policy_version 698131 (0.0011) [2023-12-26 05:09:48,962][123091] Updated weights for policy 0, policy_version 698141 (0.0011) [2023-12-26 05:09:49,024][123091] Updated weights for policy 0, policy_version 698151 (0.0010) [2023-12-26 05:09:49,155][123090] Updated weights for policy 1, policy_version 693674 (0.0009) [2023-12-26 05:09:49,204][123090] Updated weights for policy 1, policy_version 693684 (0.0009) [2023-12-26 05:09:49,266][123090] Updated weights for policy 1, policy_version 693694 (0.0008) [2023-12-26 05:09:49,847][123091] Updated weights for policy 0, policy_version 698161 (0.0010) [2023-12-26 05:09:49,915][123091] Updated weights for policy 0, policy_version 698171 (0.0011) [2023-12-26 05:09:49,986][123091] Updated weights for policy 0, policy_version 698181 (0.0011) [2023-12-26 05:09:50,045][123091] Updated weights for policy 0, policy_version 698191 (0.0011) [2023-12-26 05:09:50,155][123090] Updated weights for policy 1, policy_version 693704 (0.0009) [2023-12-26 05:09:50,216][123090] Updated weights for policy 1, policy_version 693714 (0.0009) [2023-12-26 05:09:50,280][123090] Updated weights for policy 1, policy_version 693724 (0.0009) [2023-12-26 05:09:50,865][123091] Updated weights for policy 0, policy_version 698201 (0.0010) [2023-12-26 05:09:50,926][123091] Updated weights for policy 0, policy_version 698211 (0.0009) [2023-12-26 05:09:50,990][123091] Updated weights for policy 0, policy_version 698221 (0.0007) [2023-12-26 05:09:51,114][123090] Updated weights for policy 1, policy_version 693734 (0.0009) [2023-12-26 05:09:51,177][123090] Updated weights for policy 1, policy_version 693744 (0.0010) [2023-12-26 05:09:51,243][123090] Updated weights for policy 1, policy_version 693754 (0.0010) [2023-12-26 05:09:51,803][123091] Updated weights for policy 0, policy_version 698231 (0.0008) [2023-12-26 05:09:51,870][123091] Updated weights for policy 0, policy_version 698241 (0.0011) [2023-12-26 05:09:51,930][123091] Updated weights for policy 0, policy_version 698251 (0.0011) [2023-12-26 05:09:52,143][123090] Updated weights for policy 1, policy_version 693764 (0.0010) [2023-12-26 05:09:52,219][123090] Updated weights for policy 1, policy_version 693774 (0.0008) [2023-12-26 05:09:52,296][123090] Updated weights for policy 1, policy_version 693784 (0.0009) [2023-12-26 05:09:52,715][123091] Updated weights for policy 0, policy_version 698261 (0.0008) [2023-12-26 05:09:52,766][123091] Updated weights for policy 0, policy_version 698271 (0.0010) [2023-12-26 05:09:52,829][123091] Updated weights for policy 0, policy_version 698281 (0.0011) [2023-12-26 05:09:53,179][123090] Updated weights for policy 1, policy_version 693794 (0.0009) [2023-12-26 05:09:53,242][123090] Updated weights for policy 1, policy_version 693804 (0.0010) [2023-12-26 05:09:53,306][123090] Updated weights for policy 1, policy_version 693814 (0.0010) [2023-12-26 05:09:53,371][123090] Updated weights for policy 1, policy_version 693824 (0.0010) [2023-12-26 05:09:53,514][123091] Updated weights for policy 0, policy_version 698291 (0.0009) [2023-12-26 05:09:53,561][123091] Updated weights for policy 0, policy_version 698301 (0.0005) [2023-12-26 05:09:53,618][123091] Updated weights for policy 0, policy_version 698311 (0.0005) [2023-12-26 05:09:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 356392960. Throughput: 0: 8815.3, 1: 8838.4. Samples: 356366848. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:53,785][121949] Avg episode reward: [(0, '6156.831'), (1, '5520.889')] [2023-12-26 05:09:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000693824_177618944.pth... [2023-12-26 05:09:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000698320_178774016.pth... [2023-12-26 05:09:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000692800_177356800.pth [2023-12-26 05:09:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000697264_178503680.pth [2023-12-26 05:09:54,215][123090] Updated weights for policy 1, policy_version 693834 (0.0008) [2023-12-26 05:09:54,270][123090] Updated weights for policy 1, policy_version 693844 (0.0008) [2023-12-26 05:09:54,334][123090] Updated weights for policy 1, policy_version 693854 (0.0008) [2023-12-26 05:09:54,364][123091] Updated weights for policy 0, policy_version 698321 (0.0009) [2023-12-26 05:09:54,430][123091] Updated weights for policy 0, policy_version 698331 (0.0008) [2023-12-26 05:09:54,500][123091] Updated weights for policy 0, policy_version 698341 (0.0006) [2023-12-26 05:09:54,548][123091] Updated weights for policy 0, policy_version 698351 (0.0006) [2023-12-26 05:09:55,155][123090] Updated weights for policy 1, policy_version 693864 (0.0009) [2023-12-26 05:09:55,220][123090] Updated weights for policy 1, policy_version 693874 (0.0009) [2023-12-26 05:09:55,283][123090] Updated weights for policy 1, policy_version 693884 (0.0007) [2023-12-26 05:09:55,309][123091] Updated weights for policy 0, policy_version 698361 (0.0010) [2023-12-26 05:09:55,363][123091] Updated weights for policy 0, policy_version 698371 (0.0010) [2023-12-26 05:09:55,430][123091] Updated weights for policy 0, policy_version 698381 (0.0006) [2023-12-26 05:09:56,129][123090] Updated weights for policy 1, policy_version 693894 (0.0009) [2023-12-26 05:09:56,191][123090] Updated weights for policy 1, policy_version 693904 (0.0008) [2023-12-26 05:09:56,210][123091] Updated weights for policy 0, policy_version 698391 (0.0009) [2023-12-26 05:09:56,249][123090] Updated weights for policy 1, policy_version 693914 (0.0009) [2023-12-26 05:09:56,265][123091] Updated weights for policy 0, policy_version 698401 (0.0006) [2023-12-26 05:09:56,318][123091] Updated weights for policy 0, policy_version 698411 (0.0005) [2023-12-26 05:09:57,086][123091] Updated weights for policy 0, policy_version 698421 (0.0007) [2023-12-26 05:09:57,090][123090] Updated weights for policy 1, policy_version 693924 (0.0008) [2023-12-26 05:09:57,145][123091] Updated weights for policy 0, policy_version 698431 (0.0007) [2023-12-26 05:09:57,149][123090] Updated weights for policy 1, policy_version 693934 (0.0008) [2023-12-26 05:09:57,190][123091] Updated weights for policy 0, policy_version 698441 (0.0005) [2023-12-26 05:09:57,200][123090] Updated weights for policy 1, policy_version 693944 (0.0009) [2023-12-26 05:09:57,885][123091] Updated weights for policy 0, policy_version 698451 (0.0005) [2023-12-26 05:09:57,909][123090] Updated weights for policy 1, policy_version 693954 (0.0007) [2023-12-26 05:09:57,946][123091] Updated weights for policy 0, policy_version 698461 (0.0005) [2023-12-26 05:09:57,966][123090] Updated weights for policy 1, policy_version 693964 (0.0009) [2023-12-26 05:09:57,997][123091] Updated weights for policy 0, policy_version 698471 (0.0005) [2023-12-26 05:09:58,026][123090] Updated weights for policy 1, policy_version 693974 (0.0009) [2023-12-26 05:09:58,083][123090] Updated weights for policy 1, policy_version 693984 (0.0008) [2023-12-26 05:09:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 356474880. Throughput: 0: 8931.7, 1: 8745.5. Samples: 356472588. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:09:58,785][121949] Avg episode reward: [(0, '6143.083'), (1, '5436.277')] [2023-12-26 05:09:58,873][123091] Updated weights for policy 0, policy_version 698481 (0.0010) [2023-12-26 05:09:58,944][123091] Updated weights for policy 0, policy_version 698491 (0.0010) [2023-12-26 05:09:59,012][123091] Updated weights for policy 0, policy_version 698501 (0.0010) [2023-12-26 05:09:59,028][123090] Updated weights for policy 1, policy_version 693994 (0.0009) [2023-12-26 05:09:59,075][123091] Updated weights for policy 0, policy_version 698511 (0.0010) [2023-12-26 05:09:59,097][123090] Updated weights for policy 1, policy_version 694004 (0.0008) [2023-12-26 05:09:59,156][123090] Updated weights for policy 1, policy_version 694014 (0.0009) [2023-12-26 05:09:59,900][123091] Updated weights for policy 0, policy_version 698521 (0.0009) [2023-12-26 05:09:59,969][123091] Updated weights for policy 0, policy_version 698531 (0.0009) [2023-12-26 05:09:59,972][123090] Updated weights for policy 1, policy_version 694024 (0.0007) [2023-12-26 05:10:00,033][123090] Updated weights for policy 1, policy_version 694034 (0.0009) [2023-12-26 05:10:00,033][123091] Updated weights for policy 0, policy_version 698541 (0.0008) [2023-12-26 05:10:00,099][123090] Updated weights for policy 1, policy_version 694044 (0.0009) [2023-12-26 05:10:00,851][123090] Updated weights for policy 1, policy_version 694054 (0.0008) [2023-12-26 05:10:00,881][123091] Updated weights for policy 0, policy_version 698551 (0.0007) [2023-12-26 05:10:00,922][123090] Updated weights for policy 1, policy_version 694064 (0.0010) [2023-12-26 05:10:00,926][123091] Updated weights for policy 0, policy_version 698561 (0.0005) [2023-12-26 05:10:00,971][123090] Updated weights for policy 1, policy_version 694074 (0.0008) [2023-12-26 05:10:00,972][123091] Updated weights for policy 0, policy_version 698571 (0.0005) [2023-12-26 05:10:01,769][123091] Updated weights for policy 0, policy_version 698581 (0.0007) [2023-12-26 05:10:01,823][123091] Updated weights for policy 0, policy_version 698591 (0.0009) [2023-12-26 05:10:01,879][123091] Updated weights for policy 0, policy_version 698601 (0.0010) [2023-12-26 05:10:01,881][123090] Updated weights for policy 1, policy_version 694084 (0.0008) [2023-12-26 05:10:01,930][123090] Updated weights for policy 1, policy_version 694094 (0.0009) [2023-12-26 05:10:01,986][123090] Updated weights for policy 1, policy_version 694104 (0.0009) [2023-12-26 05:10:02,680][123091] Updated weights for policy 0, policy_version 698611 (0.0009) [2023-12-26 05:10:02,733][123091] Updated weights for policy 0, policy_version 698621 (0.0009) [2023-12-26 05:10:02,792][123091] Updated weights for policy 0, policy_version 698632 (0.0009) [2023-12-26 05:10:02,871][123090] Updated weights for policy 1, policy_version 694114 (0.0010) [2023-12-26 05:10:02,922][123090] Updated weights for policy 1, policy_version 694124 (0.0010) [2023-12-26 05:10:02,977][123090] Updated weights for policy 1, policy_version 694134 (0.0008) [2023-12-26 05:10:03,038][123090] Updated weights for policy 1, policy_version 694144 (0.0009) [2023-12-26 05:10:03,640][123091] Updated weights for policy 0, policy_version 698642 (0.0009) [2023-12-26 05:10:03,693][123091] Updated weights for policy 0, policy_version 698652 (0.0010) [2023-12-26 05:10:03,746][123091] Updated weights for policy 0, policy_version 698663 (0.0010) [2023-12-26 05:10:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 356556800. Throughput: 0: 8887.3, 1: 8734.0. Samples: 356575756. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:03,785][121949] Avg episode reward: [(0, '6083.934'), (1, '5798.183')] [2023-12-26 05:10:03,815][123090] Updated weights for policy 1, policy_version 694154 (0.0008) [2023-12-26 05:10:03,883][123090] Updated weights for policy 1, policy_version 694164 (0.0010) [2023-12-26 05:10:03,947][123090] Updated weights for policy 1, policy_version 694174 (0.0010) [2023-12-26 05:10:04,654][123091] Updated weights for policy 0, policy_version 698673 (0.0009) [2023-12-26 05:10:04,710][123090] Updated weights for policy 1, policy_version 694184 (0.0007) [2023-12-26 05:10:04,717][123091] Updated weights for policy 0, policy_version 698683 (0.0010) [2023-12-26 05:10:04,775][123090] Updated weights for policy 1, policy_version 694194 (0.0005) [2023-12-26 05:10:04,781][123091] Updated weights for policy 0, policy_version 698693 (0.0008) [2023-12-26 05:10:04,826][123090] Updated weights for policy 1, policy_version 694204 (0.0005) [2023-12-26 05:10:04,836][123091] Updated weights for policy 0, policy_version 698703 (0.0009) [2023-12-26 05:10:05,466][123090] Updated weights for policy 1, policy_version 694214 (0.0005) [2023-12-26 05:10:05,527][123090] Updated weights for policy 1, policy_version 694224 (0.0005) [2023-12-26 05:10:05,567][123091] Updated weights for policy 0, policy_version 698713 (0.0009) [2023-12-26 05:10:05,586][123090] Updated weights for policy 1, policy_version 694234 (0.0005) [2023-12-26 05:10:05,622][123091] Updated weights for policy 0, policy_version 698723 (0.0009) [2023-12-26 05:10:05,674][123091] Updated weights for policy 0, policy_version 698733 (0.0009) [2023-12-26 05:10:06,370][123090] Updated weights for policy 1, policy_version 694244 (0.0008) [2023-12-26 05:10:06,442][123090] Updated weights for policy 1, policy_version 694254 (0.0009) [2023-12-26 05:10:06,507][123090] Updated weights for policy 1, policy_version 694264 (0.0008) [2023-12-26 05:10:06,560][123091] Updated weights for policy 0, policy_version 698744 (0.0011) [2023-12-26 05:10:06,614][123091] Updated weights for policy 0, policy_version 698754 (0.0011) [2023-12-26 05:10:06,680][123091] Updated weights for policy 0, policy_version 698764 (0.0010) [2023-12-26 05:10:07,321][123090] Updated weights for policy 1, policy_version 694274 (0.0007) [2023-12-26 05:10:07,382][123090] Updated weights for policy 1, policy_version 694284 (0.0010) [2023-12-26 05:10:07,449][123090] Updated weights for policy 1, policy_version 694294 (0.0009) [2023-12-26 05:10:07,518][123090] Updated weights for policy 1, policy_version 694304 (0.0008) [2023-12-26 05:10:07,533][123091] Updated weights for policy 0, policy_version 698774 (0.0010) [2023-12-26 05:10:07,602][123091] Updated weights for policy 0, policy_version 698784 (0.0010) [2023-12-26 05:10:07,665][123091] Updated weights for policy 0, policy_version 698794 (0.0010) [2023-12-26 05:10:08,357][123090] Updated weights for policy 1, policy_version 694314 (0.0007) [2023-12-26 05:10:08,426][123091] Updated weights for policy 0, policy_version 698804 (0.0010) [2023-12-26 05:10:08,426][123090] Updated weights for policy 1, policy_version 694324 (0.0007) [2023-12-26 05:10:08,478][123091] Updated weights for policy 0, policy_version 698815 (0.0008) [2023-12-26 05:10:08,491][123090] Updated weights for policy 1, policy_version 694334 (0.0005) [2023-12-26 05:10:08,530][123091] Updated weights for policy 0, policy_version 698825 (0.0009) [2023-12-26 05:10:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 356655104. Throughput: 0: 8870.6, 1: 8805.3. Samples: 356628984. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:08,785][121949] Avg episode reward: [(0, '6144.652'), (1, '5835.872')] [2023-12-26 05:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000698832_178905088.pth... [2023-12-26 05:10:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000694336_177750016.pth... [2023-12-26 05:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000697808_178642944.pth [2023-12-26 05:10:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000693312_177487872.pth [2023-12-26 05:10:09,287][123090] Updated weights for policy 1, policy_version 694344 (0.0009) [2023-12-26 05:10:09,339][123091] Updated weights for policy 0, policy_version 698835 (0.0009) [2023-12-26 05:10:09,360][123090] Updated weights for policy 1, policy_version 694354 (0.0009) [2023-12-26 05:10:09,415][123091] Updated weights for policy 0, policy_version 698845 (0.0009) [2023-12-26 05:10:09,434][123090] Updated weights for policy 1, policy_version 694364 (0.0008) [2023-12-26 05:10:09,484][123091] Updated weights for policy 0, policy_version 698855 (0.0008) [2023-12-26 05:10:10,271][123090] Updated weights for policy 1, policy_version 694374 (0.0010) [2023-12-26 05:10:10,312][123091] Updated weights for policy 0, policy_version 698865 (0.0008) [2023-12-26 05:10:10,335][123090] Updated weights for policy 1, policy_version 694384 (0.0010) [2023-12-26 05:10:10,376][123091] Updated weights for policy 0, policy_version 698875 (0.0007) [2023-12-26 05:10:10,399][123090] Updated weights for policy 1, policy_version 694394 (0.0009) [2023-12-26 05:10:10,438][123091] Updated weights for policy 0, policy_version 698885 (0.0009) [2023-12-26 05:10:10,508][123091] Updated weights for policy 0, policy_version 698895 (0.0010) [2023-12-26 05:10:11,288][123090] Updated weights for policy 1, policy_version 694404 (0.0010) [2023-12-26 05:10:11,299][123091] Updated weights for policy 0, policy_version 698905 (0.0007) [2023-12-26 05:10:11,359][123090] Updated weights for policy 1, policy_version 694414 (0.0012) [2023-12-26 05:10:11,367][123091] Updated weights for policy 0, policy_version 698915 (0.0007) [2023-12-26 05:10:11,433][123091] Updated weights for policy 0, policy_version 698925 (0.0008) [2023-12-26 05:10:11,434][123090] Updated weights for policy 1, policy_version 694424 (0.0008) [2023-12-26 05:10:12,262][123090] Updated weights for policy 1, policy_version 694434 (0.0008) [2023-12-26 05:10:12,331][123090] Updated weights for policy 1, policy_version 694444 (0.0009) [2023-12-26 05:10:12,366][123091] Updated weights for policy 0, policy_version 698935 (0.0007) [2023-12-26 05:10:12,406][123090] Updated weights for policy 1, policy_version 694454 (0.0008) [2023-12-26 05:10:12,427][123091] Updated weights for policy 0, policy_version 698945 (0.0006) [2023-12-26 05:10:12,474][123090] Updated weights for policy 1, policy_version 694464 (0.0008) [2023-12-26 05:10:12,490][123091] Updated weights for policy 0, policy_version 698955 (0.0006) [2023-12-26 05:10:13,233][123091] Updated weights for policy 0, policy_version 698965 (0.0008) [2023-12-26 05:10:13,285][123091] Updated weights for policy 0, policy_version 698975 (0.0009) [2023-12-26 05:10:13,335][123091] Updated weights for policy 0, policy_version 698985 (0.0007) [2023-12-26 05:10:13,342][123090] Updated weights for policy 1, policy_version 694474 (0.0007) [2023-12-26 05:10:13,396][123090] Updated weights for policy 1, policy_version 694484 (0.0010) [2023-12-26 05:10:13,455][123090] Updated weights for policy 1, policy_version 694494 (0.0009) [2023-12-26 05:10:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 356737024. Throughput: 0: 8732.6, 1: 8741.6. Samples: 356730712. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:13,785][121949] Avg episode reward: [(0, '6227.799'), (1, '5830.467')] [2023-12-26 05:10:13,988][123091] Updated weights for policy 0, policy_version 698995 (0.0007) [2023-12-26 05:10:14,041][123091] Updated weights for policy 0, policy_version 699005 (0.0005) [2023-12-26 05:10:14,088][123091] Updated weights for policy 0, policy_version 699015 (0.0005) [2023-12-26 05:10:14,352][123090] Updated weights for policy 1, policy_version 694504 (0.0010) [2023-12-26 05:10:14,411][123090] Updated weights for policy 1, policy_version 694514 (0.0010) [2023-12-26 05:10:14,474][123090] Updated weights for policy 1, policy_version 694524 (0.0009) [2023-12-26 05:10:14,682][123091] Updated weights for policy 0, policy_version 699025 (0.0006) [2023-12-26 05:10:14,738][123091] Updated weights for policy 0, policy_version 699035 (0.0009) [2023-12-26 05:10:14,800][123091] Updated weights for policy 0, policy_version 699045 (0.0009) [2023-12-26 05:10:14,846][123091] Updated weights for policy 0, policy_version 699055 (0.0005) [2023-12-26 05:10:15,339][123090] Updated weights for policy 1, policy_version 694534 (0.0010) [2023-12-26 05:10:15,403][123090] Updated weights for policy 1, policy_version 694544 (0.0010) [2023-12-26 05:10:15,472][123090] Updated weights for policy 1, policy_version 694554 (0.0009) [2023-12-26 05:10:15,673][123091] Updated weights for policy 0, policy_version 699065 (0.0009) [2023-12-26 05:10:15,737][123091] Updated weights for policy 0, policy_version 699075 (0.0009) [2023-12-26 05:10:15,788][123091] Updated weights for policy 0, policy_version 699085 (0.0008) [2023-12-26 05:10:16,301][123090] Updated weights for policy 1, policy_version 694564 (0.0009) [2023-12-26 05:10:16,359][123090] Updated weights for policy 1, policy_version 694574 (0.0009) [2023-12-26 05:10:16,411][123090] Updated weights for policy 1, policy_version 694584 (0.0009) [2023-12-26 05:10:16,626][123091] Updated weights for policy 0, policy_version 699095 (0.0009) [2023-12-26 05:10:16,690][123091] Updated weights for policy 0, policy_version 699105 (0.0009) [2023-12-26 05:10:16,746][123091] Updated weights for policy 0, policy_version 699116 (0.0010) [2023-12-26 05:10:17,255][123090] Updated weights for policy 1, policy_version 694594 (0.0010) [2023-12-26 05:10:17,315][123090] Updated weights for policy 1, policy_version 694604 (0.0010) [2023-12-26 05:10:17,378][123090] Updated weights for policy 1, policy_version 694614 (0.0010) [2023-12-26 05:10:17,444][123090] Updated weights for policy 1, policy_version 694624 (0.0011) [2023-12-26 05:10:17,582][123091] Updated weights for policy 0, policy_version 699126 (0.0009) [2023-12-26 05:10:17,649][123091] Updated weights for policy 0, policy_version 699136 (0.0009) [2023-12-26 05:10:17,718][123091] Updated weights for policy 0, policy_version 699146 (0.0009) [2023-12-26 05:10:18,196][123090] Updated weights for policy 1, policy_version 694634 (0.0009) [2023-12-26 05:10:18,259][123090] Updated weights for policy 1, policy_version 694644 (0.0009) [2023-12-26 05:10:18,322][123090] Updated weights for policy 1, policy_version 694654 (0.0010) [2023-12-26 05:10:18,534][123091] Updated weights for policy 0, policy_version 699156 (0.0009) [2023-12-26 05:10:18,593][123091] Updated weights for policy 0, policy_version 699166 (0.0009) [2023-12-26 05:10:18,650][123091] Updated weights for policy 0, policy_version 699176 (0.0009) [2023-12-26 05:10:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 356827136. Throughput: 0: 8716.2, 1: 8611.2. Samples: 356835228. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:18,785][121949] Avg episode reward: [(0, '6198.951'), (1, '5825.546')] [2023-12-26 05:10:19,150][123090] Updated weights for policy 1, policy_version 694664 (0.0010) [2023-12-26 05:10:19,222][123090] Updated weights for policy 1, policy_version 694674 (0.0010) [2023-12-26 05:10:19,289][123090] Updated weights for policy 1, policy_version 694684 (0.0009) [2023-12-26 05:10:19,545][123091] Updated weights for policy 0, policy_version 699186 (0.0008) [2023-12-26 05:10:19,620][123091] Updated weights for policy 0, policy_version 699196 (0.0008) [2023-12-26 05:10:19,687][123091] Updated weights for policy 0, policy_version 699206 (0.0009) [2023-12-26 05:10:19,753][123091] Updated weights for policy 0, policy_version 699216 (0.0009) [2023-12-26 05:10:20,122][123090] Updated weights for policy 1, policy_version 694694 (0.0007) [2023-12-26 05:10:20,189][123090] Updated weights for policy 1, policy_version 694704 (0.0005) [2023-12-26 05:10:20,261][123090] Updated weights for policy 1, policy_version 694714 (0.0006) [2023-12-26 05:10:20,457][123091] Updated weights for policy 0, policy_version 699226 (0.0006) [2023-12-26 05:10:20,536][123091] Updated weights for policy 0, policy_version 699236 (0.0006) [2023-12-26 05:10:20,607][123091] Updated weights for policy 0, policy_version 699246 (0.0009) [2023-12-26 05:10:20,956][123090] Updated weights for policy 1, policy_version 694724 (0.0005) [2023-12-26 05:10:21,011][123090] Updated weights for policy 1, policy_version 694734 (0.0006) [2023-12-26 05:10:21,080][123090] Updated weights for policy 1, policy_version 694744 (0.0008) [2023-12-26 05:10:21,435][123091] Updated weights for policy 0, policy_version 699256 (0.0010) [2023-12-26 05:10:21,499][123091] Updated weights for policy 0, policy_version 699266 (0.0010) [2023-12-26 05:10:21,557][123091] Updated weights for policy 0, policy_version 699276 (0.0009) [2023-12-26 05:10:21,887][123090] Updated weights for policy 1, policy_version 694754 (0.0008) [2023-12-26 05:10:21,952][123090] Updated weights for policy 1, policy_version 694764 (0.0009) [2023-12-26 05:10:22,020][123090] Updated weights for policy 1, policy_version 694774 (0.0009) [2023-12-26 05:10:22,079][123090] Updated weights for policy 1, policy_version 694784 (0.0010) [2023-12-26 05:10:22,385][123091] Updated weights for policy 0, policy_version 699286 (0.0009) [2023-12-26 05:10:22,449][123091] Updated weights for policy 0, policy_version 699296 (0.0011) [2023-12-26 05:10:22,504][123091] Updated weights for policy 0, policy_version 699306 (0.0010) [2023-12-26 05:10:22,947][123090] Updated weights for policy 1, policy_version 694794 (0.0009) [2023-12-26 05:10:23,051][123090] Updated weights for policy 1, policy_version 694804 (0.0009) [2023-12-26 05:10:23,121][123090] Updated weights for policy 1, policy_version 694814 (0.0009) [2023-12-26 05:10:23,362][123091] Updated weights for policy 0, policy_version 699316 (0.0011) [2023-12-26 05:10:23,422][123091] Updated weights for policy 0, policy_version 699326 (0.0010) [2023-12-26 05:10:23,474][123091] Updated weights for policy 0, policy_version 699336 (0.0009) [2023-12-26 05:10:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 356909056. Throughput: 0: 8692.9, 1: 8627.2. Samples: 356887200. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:23,785][121949] Avg episode reward: [(0, '6145.782'), (1, '5768.147')] [2023-12-26 05:10:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000699344_179036160.pth... [2023-12-26 05:10:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000694816_177872896.pth... [2023-12-26 05:10:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000698320_178774016.pth [2023-12-26 05:10:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000693824_177618944.pth [2023-12-26 05:10:23,944][123090] Updated weights for policy 1, policy_version 694824 (0.0007) [2023-12-26 05:10:24,008][123090] Updated weights for policy 1, policy_version 694834 (0.0009) [2023-12-26 05:10:24,061][123090] Updated weights for policy 1, policy_version 694844 (0.0010) [2023-12-26 05:10:24,276][123091] Updated weights for policy 0, policy_version 699346 (0.0009) [2023-12-26 05:10:24,342][123091] Updated weights for policy 0, policy_version 699356 (0.0007) [2023-12-26 05:10:24,393][123091] Updated weights for policy 0, policy_version 699366 (0.0009) [2023-12-26 05:10:24,447][123091] Updated weights for policy 0, policy_version 699376 (0.0009) [2023-12-26 05:10:24,914][123090] Updated weights for policy 1, policy_version 694854 (0.0009) [2023-12-26 05:10:24,974][123090] Updated weights for policy 1, policy_version 694864 (0.0009) [2023-12-26 05:10:25,044][123090] Updated weights for policy 1, policy_version 694874 (0.0010) [2023-12-26 05:10:25,129][123091] Updated weights for policy 0, policy_version 699386 (0.0005) [2023-12-26 05:10:25,177][123091] Updated weights for policy 0, policy_version 699396 (0.0005) [2023-12-26 05:10:25,221][123091] Updated weights for policy 0, policy_version 699406 (0.0005) [2023-12-26 05:10:25,827][123090] Updated weights for policy 1, policy_version 694884 (0.0010) [2023-12-26 05:10:25,895][123090] Updated weights for policy 1, policy_version 694894 (0.0010) [2023-12-26 05:10:25,960][123090] Updated weights for policy 1, policy_version 694904 (0.0009) [2023-12-26 05:10:26,014][123091] Updated weights for policy 0, policy_version 699416 (0.0007) [2023-12-26 05:10:26,071][123091] Updated weights for policy 0, policy_version 699426 (0.0009) [2023-12-26 05:10:26,126][123091] Updated weights for policy 0, policy_version 699436 (0.0009) [2023-12-26 05:10:26,810][123090] Updated weights for policy 1, policy_version 694914 (0.0009) [2023-12-26 05:10:26,862][123090] Updated weights for policy 1, policy_version 694924 (0.0009) [2023-12-26 05:10:26,886][123091] Updated weights for policy 0, policy_version 699446 (0.0008) [2023-12-26 05:10:26,910][123090] Updated weights for policy 1, policy_version 694934 (0.0008) [2023-12-26 05:10:26,940][123091] Updated weights for policy 0, policy_version 699456 (0.0007) [2023-12-26 05:10:26,960][123090] Updated weights for policy 1, policy_version 694944 (0.0009) [2023-12-26 05:10:26,994][123091] Updated weights for policy 0, policy_version 699466 (0.0007) [2023-12-26 05:10:27,620][123090] Updated weights for policy 1, policy_version 694954 (0.0005) [2023-12-26 05:10:27,688][123090] Updated weights for policy 1, policy_version 694964 (0.0007) [2023-12-26 05:10:27,747][123090] Updated weights for policy 1, policy_version 694974 (0.0010) [2023-12-26 05:10:27,861][123091] Updated weights for policy 0, policy_version 699476 (0.0009) [2023-12-26 05:10:27,909][123091] Updated weights for policy 0, policy_version 699486 (0.0008) [2023-12-26 05:10:27,958][123091] Updated weights for policy 0, policy_version 699496 (0.0009) [2023-12-26 05:10:28,432][123090] Updated weights for policy 1, policy_version 694984 (0.0008) [2023-12-26 05:10:28,496][123090] Updated weights for policy 1, policy_version 694994 (0.0008) [2023-12-26 05:10:28,557][123090] Updated weights for policy 1, policy_version 695004 (0.0008) [2023-12-26 05:10:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 356999168. Throughput: 0: 8801.7, 1: 8555.7. Samples: 356992840. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:28,784][121949] Avg episode reward: [(0, '6165.580'), (1, '5818.104')] [2023-12-26 05:10:28,861][123091] Updated weights for policy 0, policy_version 699506 (0.0010) [2023-12-26 05:10:28,922][123091] Updated weights for policy 0, policy_version 699516 (0.0009) [2023-12-26 05:10:28,979][123091] Updated weights for policy 0, policy_version 699526 (0.0006) [2023-12-26 05:10:29,037][123091] Updated weights for policy 0, policy_version 699536 (0.0005) [2023-12-26 05:10:29,399][123090] Updated weights for policy 1, policy_version 695014 (0.0009) [2023-12-26 05:10:29,456][123090] Updated weights for policy 1, policy_version 695024 (0.0010) [2023-12-26 05:10:29,518][123090] Updated weights for policy 1, policy_version 695034 (0.0009) [2023-12-26 05:10:29,821][123091] Updated weights for policy 0, policy_version 699546 (0.0010) [2023-12-26 05:10:29,876][123091] Updated weights for policy 0, policy_version 699556 (0.0009) [2023-12-26 05:10:29,938][123091] Updated weights for policy 0, policy_version 699566 (0.0010) [2023-12-26 05:10:30,227][123090] Updated weights for policy 1, policy_version 695044 (0.0007) [2023-12-26 05:10:30,282][123090] Updated weights for policy 1, policy_version 695054 (0.0010) [2023-12-26 05:10:30,330][123090] Updated weights for policy 1, policy_version 695064 (0.0010) [2023-12-26 05:10:30,795][123091] Updated weights for policy 0, policy_version 699576 (0.0009) [2023-12-26 05:10:30,843][123091] Updated weights for policy 0, policy_version 699587 (0.0009) [2023-12-26 05:10:30,893][123091] Updated weights for policy 0, policy_version 699597 (0.0008) [2023-12-26 05:10:31,177][123090] Updated weights for policy 1, policy_version 695074 (0.0010) [2023-12-26 05:10:31,229][123090] Updated weights for policy 1, policy_version 695084 (0.0008) [2023-12-26 05:10:31,282][123090] Updated weights for policy 1, policy_version 695094 (0.0007) [2023-12-26 05:10:31,333][123090] Updated weights for policy 1, policy_version 695104 (0.0008) [2023-12-26 05:10:31,775][123091] Updated weights for policy 0, policy_version 699607 (0.0007) [2023-12-26 05:10:31,823][123091] Updated weights for policy 0, policy_version 699617 (0.0005) [2023-12-26 05:10:31,885][123091] Updated weights for policy 0, policy_version 699627 (0.0005) [2023-12-26 05:10:32,178][123090] Updated weights for policy 1, policy_version 695114 (0.0010) [2023-12-26 05:10:32,253][123090] Updated weights for policy 1, policy_version 695124 (0.0010) [2023-12-26 05:10:32,314][123090] Updated weights for policy 1, policy_version 695134 (0.0009) [2023-12-26 05:10:32,685][123091] Updated weights for policy 0, policy_version 699637 (0.0009) [2023-12-26 05:10:32,746][123091] Updated weights for policy 0, policy_version 699647 (0.0008) [2023-12-26 05:10:32,812][123091] Updated weights for policy 0, policy_version 699657 (0.0009) [2023-12-26 05:10:33,114][123090] Updated weights for policy 1, policy_version 695144 (0.0005) [2023-12-26 05:10:33,177][123090] Updated weights for policy 1, policy_version 695154 (0.0005) [2023-12-26 05:10:33,233][123090] Updated weights for policy 1, policy_version 695164 (0.0005) [2023-12-26 05:10:33,657][123091] Updated weights for policy 0, policy_version 699667 (0.0009) [2023-12-26 05:10:33,711][123091] Updated weights for policy 0, policy_version 699677 (0.0010) [2023-12-26 05:10:33,769][123091] Updated weights for policy 0, policy_version 699687 (0.0010) [2023-12-26 05:10:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17203.1, 300 sec: 17605.8). Total num frames: 357081088. Throughput: 0: 8780.7, 1: 8592.1. Samples: 357098456. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:33,786][121949] Avg episode reward: [(0, '6230.489'), (1, '5929.003')] [2023-12-26 05:10:33,891][123090] Updated weights for policy 1, policy_version 695174 (0.0005) [2023-12-26 05:10:33,950][123090] Updated weights for policy 1, policy_version 695184 (0.0005) [2023-12-26 05:10:33,998][123090] Updated weights for policy 1, policy_version 695194 (0.0005) [2023-12-26 05:10:34,592][123091] Updated weights for policy 0, policy_version 699697 (0.0009) [2023-12-26 05:10:34,650][123091] Updated weights for policy 0, policy_version 699707 (0.0006) [2023-12-26 05:10:34,713][123091] Updated weights for policy 0, policy_version 699717 (0.0009) [2023-12-26 05:10:34,761][123090] Updated weights for policy 1, policy_version 695204 (0.0007) [2023-12-26 05:10:34,773][123091] Updated weights for policy 0, policy_version 699727 (0.0007) [2023-12-26 05:10:34,825][123090] Updated weights for policy 1, policy_version 695214 (0.0011) [2023-12-26 05:10:34,889][123090] Updated weights for policy 1, policy_version 695224 (0.0011) [2023-12-26 05:10:35,382][123091] Updated weights for policy 0, policy_version 699737 (0.0008) [2023-12-26 05:10:35,444][123091] Updated weights for policy 0, policy_version 699747 (0.0010) [2023-12-26 05:10:35,514][123091] Updated weights for policy 0, policy_version 699757 (0.0011) [2023-12-26 05:10:35,724][123090] Updated weights for policy 1, policy_version 695234 (0.0011) [2023-12-26 05:10:35,775][123090] Updated weights for policy 1, policy_version 695244 (0.0010) [2023-12-26 05:10:35,826][123090] Updated weights for policy 1, policy_version 695254 (0.0010) [2023-12-26 05:10:35,874][123090] Updated weights for policy 1, policy_version 695264 (0.0010) [2023-12-26 05:10:36,303][123091] Updated weights for policy 0, policy_version 699767 (0.0009) [2023-12-26 05:10:36,353][123091] Updated weights for policy 0, policy_version 699777 (0.0009) [2023-12-26 05:10:36,410][123091] Updated weights for policy 0, policy_version 699787 (0.0009) [2023-12-26 05:10:36,735][123090] Updated weights for policy 1, policy_version 695274 (0.0011) [2023-12-26 05:10:36,802][123090] Updated weights for policy 1, policy_version 695284 (0.0011) [2023-12-26 05:10:36,865][123090] Updated weights for policy 1, policy_version 695294 (0.0011) [2023-12-26 05:10:37,265][123091] Updated weights for policy 0, policy_version 699797 (0.0009) [2023-12-26 05:10:37,325][123091] Updated weights for policy 0, policy_version 699807 (0.0008) [2023-12-26 05:10:37,400][123091] Updated weights for policy 0, policy_version 699817 (0.0006) [2023-12-26 05:10:37,688][123090] Updated weights for policy 1, policy_version 695304 (0.0011) [2023-12-26 05:10:37,755][123090] Updated weights for policy 1, policy_version 695314 (0.0011) [2023-12-26 05:10:37,807][123090] Updated weights for policy 1, policy_version 695324 (0.0010) [2023-12-26 05:10:38,066][123091] Updated weights for policy 0, policy_version 699827 (0.0009) [2023-12-26 05:10:38,127][123091] Updated weights for policy 0, policy_version 699837 (0.0007) [2023-12-26 05:10:38,193][123091] Updated weights for policy 0, policy_version 699847 (0.0006) [2023-12-26 05:10:38,664][123090] Updated weights for policy 1, policy_version 695334 (0.0010) [2023-12-26 05:10:38,720][123090] Updated weights for policy 1, policy_version 695344 (0.0011) [2023-12-26 05:10:38,775][123090] Updated weights for policy 1, policy_version 695354 (0.0011) [2023-12-26 05:10:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 357171200. Throughput: 0: 8808.2, 1: 8650.8. Samples: 357152500. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:38,785][121949] Avg episode reward: [(0, '6244.916'), (1, '5882.206')] [2023-12-26 05:10:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000699856_179167232.pth... [2023-12-26 05:10:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000698832_178905088.pth [2023-12-26 05:10:38,806][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000695360_178012160.pth... [2023-12-26 05:10:38,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000694336_177750016.pth [2023-12-26 05:10:38,933][123091] Updated weights for policy 0, policy_version 699857 (0.0006) [2023-12-26 05:10:38,984][123091] Updated weights for policy 0, policy_version 699867 (0.0007) [2023-12-26 05:10:39,046][123091] Updated weights for policy 0, policy_version 699877 (0.0007) [2023-12-26 05:10:39,106][123091] Updated weights for policy 0, policy_version 699887 (0.0009) [2023-12-26 05:10:39,596][123090] Updated weights for policy 1, policy_version 695364 (0.0010) [2023-12-26 05:10:39,651][123090] Updated weights for policy 1, policy_version 695374 (0.0005) [2023-12-26 05:10:39,706][123090] Updated weights for policy 1, policy_version 695384 (0.0005) [2023-12-26 05:10:39,993][123091] Updated weights for policy 0, policy_version 699897 (0.0010) [2023-12-26 05:10:40,056][123091] Updated weights for policy 0, policy_version 699907 (0.0010) [2023-12-26 05:10:40,118][123091] Updated weights for policy 0, policy_version 699917 (0.0010) [2023-12-26 05:10:40,475][123090] Updated weights for policy 1, policy_version 695394 (0.0007) [2023-12-26 05:10:40,538][123090] Updated weights for policy 1, policy_version 695404 (0.0011) [2023-12-26 05:10:40,590][123090] Updated weights for policy 1, policy_version 695414 (0.0010) [2023-12-26 05:10:40,656][123090] Updated weights for policy 1, policy_version 695424 (0.0010) [2023-12-26 05:10:40,978][123091] Updated weights for policy 0, policy_version 699927 (0.0011) [2023-12-26 05:10:41,046][123091] Updated weights for policy 0, policy_version 699937 (0.0009) [2023-12-26 05:10:41,124][123091] Updated weights for policy 0, policy_version 699947 (0.0011) [2023-12-26 05:10:41,487][123090] Updated weights for policy 1, policy_version 695434 (0.0011) [2023-12-26 05:10:41,560][123090] Updated weights for policy 1, policy_version 695444 (0.0006) [2023-12-26 05:10:41,631][123090] Updated weights for policy 1, policy_version 695454 (0.0007) [2023-12-26 05:10:41,993][123091] Updated weights for policy 0, policy_version 699957 (0.0008) [2023-12-26 05:10:42,059][123091] Updated weights for policy 0, policy_version 699967 (0.0010) [2023-12-26 05:10:42,124][123091] Updated weights for policy 0, policy_version 699977 (0.0009) [2023-12-26 05:10:42,414][123090] Updated weights for policy 1, policy_version 695464 (0.0010) [2023-12-26 05:10:42,479][123090] Updated weights for policy 1, policy_version 695474 (0.0008) [2023-12-26 05:10:42,538][123090] Updated weights for policy 1, policy_version 695484 (0.0011) [2023-12-26 05:10:42,973][123091] Updated weights for policy 0, policy_version 699987 (0.0009) [2023-12-26 05:10:43,024][123091] Updated weights for policy 0, policy_version 699997 (0.0005) [2023-12-26 05:10:43,080][123091] Updated weights for policy 0, policy_version 700007 (0.0009) [2023-12-26 05:10:43,281][123090] Updated weights for policy 1, policy_version 695494 (0.0011) [2023-12-26 05:10:43,341][123090] Updated weights for policy 1, policy_version 695504 (0.0011) [2023-12-26 05:10:43,393][123090] Updated weights for policy 1, policy_version 695514 (0.0006) [2023-12-26 05:10:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 357261312. Throughput: 0: 8736.8, 1: 8679.2. Samples: 357256308. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:43,786][121949] Avg episode reward: [(0, '6208.792'), (1, '5883.309')] [2023-12-26 05:10:43,787][123091] Updated weights for policy 0, policy_version 700017 (0.0010) [2023-12-26 05:10:43,839][123091] Updated weights for policy 0, policy_version 700027 (0.0005) [2023-12-26 05:10:43,883][123091] Updated weights for policy 0, policy_version 700037 (0.0005) [2023-12-26 05:10:43,929][123091] Updated weights for policy 0, policy_version 700047 (0.0006) [2023-12-26 05:10:44,108][123090] Updated weights for policy 1, policy_version 695524 (0.0007) [2023-12-26 05:10:44,175][123090] Updated weights for policy 1, policy_version 695534 (0.0009) [2023-12-26 05:10:44,237][123090] Updated weights for policy 1, policy_version 695544 (0.0008) [2023-12-26 05:10:44,598][123091] Updated weights for policy 0, policy_version 700057 (0.0006) [2023-12-26 05:10:44,651][123091] Updated weights for policy 0, policy_version 700067 (0.0005) [2023-12-26 05:10:44,704][123091] Updated weights for policy 0, policy_version 700077 (0.0006) [2023-12-26 05:10:44,893][123090] Updated weights for policy 1, policy_version 695554 (0.0006) [2023-12-26 05:10:44,962][123090] Updated weights for policy 1, policy_version 695564 (0.0006) [2023-12-26 05:10:45,026][123090] Updated weights for policy 1, policy_version 695574 (0.0006) [2023-12-26 05:10:45,087][123090] Updated weights for policy 1, policy_version 695584 (0.0006) [2023-12-26 05:10:45,462][123091] Updated weights for policy 0, policy_version 700087 (0.0005) [2023-12-26 05:10:45,516][123091] Updated weights for policy 0, policy_version 700097 (0.0006) [2023-12-26 05:10:45,561][123091] Updated weights for policy 0, policy_version 700107 (0.0005) [2023-12-26 05:10:45,753][123090] Updated weights for policy 1, policy_version 695594 (0.0006) [2023-12-26 05:10:45,811][123090] Updated weights for policy 1, policy_version 695604 (0.0007) [2023-12-26 05:10:45,876][123090] Updated weights for policy 1, policy_version 695614 (0.0009) [2023-12-26 05:10:46,241][123091] Updated weights for policy 0, policy_version 700117 (0.0005) [2023-12-26 05:10:46,288][123091] Updated weights for policy 0, policy_version 700127 (0.0005) [2023-12-26 05:10:46,335][123091] Updated weights for policy 0, policy_version 700137 (0.0005) [2023-12-26 05:10:46,549][123090] Updated weights for policy 1, policy_version 695624 (0.0009) [2023-12-26 05:10:46,604][123090] Updated weights for policy 1, policy_version 695634 (0.0010) [2023-12-26 05:10:46,655][123090] Updated weights for policy 1, policy_version 695644 (0.0010) [2023-12-26 05:10:47,068][123091] Updated weights for policy 0, policy_version 700147 (0.0005) [2023-12-26 05:10:47,138][123091] Updated weights for policy 0, policy_version 700157 (0.0006) [2023-12-26 05:10:47,208][123091] Updated weights for policy 0, policy_version 700167 (0.0006) [2023-12-26 05:10:47,483][123090] Updated weights for policy 1, policy_version 695654 (0.0010) [2023-12-26 05:10:47,542][123090] Updated weights for policy 1, policy_version 695664 (0.0010) [2023-12-26 05:10:47,608][123090] Updated weights for policy 1, policy_version 695674 (0.0010) [2023-12-26 05:10:47,936][123091] Updated weights for policy 0, policy_version 700177 (0.0007) [2023-12-26 05:10:47,988][123091] Updated weights for policy 0, policy_version 700187 (0.0009) [2023-12-26 05:10:48,037][123091] Updated weights for policy 0, policy_version 700197 (0.0009) [2023-12-26 05:10:48,085][123091] Updated weights for policy 0, policy_version 700207 (0.0009) [2023-12-26 05:10:48,414][123090] Updated weights for policy 1, policy_version 695684 (0.0010) [2023-12-26 05:10:48,473][123090] Updated weights for policy 1, policy_version 695694 (0.0011) [2023-12-26 05:10:48,538][123090] Updated weights for policy 1, policy_version 695704 (0.0011) [2023-12-26 05:10:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 357359616. Throughput: 0: 8864.3, 1: 8808.3. Samples: 357371020. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:48,785][121949] Avg episode reward: [(0, '6193.517'), (1, '5852.854')] [2023-12-26 05:10:48,937][123091] Updated weights for policy 0, policy_version 700217 (0.0010) [2023-12-26 05:10:48,997][123091] Updated weights for policy 0, policy_version 700227 (0.0011) [2023-12-26 05:10:49,049][123091] Updated weights for policy 0, policy_version 700237 (0.0010) [2023-12-26 05:10:49,396][123090] Updated weights for policy 1, policy_version 695714 (0.0011) [2023-12-26 05:10:49,456][123090] Updated weights for policy 1, policy_version 695724 (0.0009) [2023-12-26 05:10:49,518][123090] Updated weights for policy 1, policy_version 695734 (0.0006) [2023-12-26 05:10:49,580][123090] Updated weights for policy 1, policy_version 695744 (0.0005) [2023-12-26 05:10:49,865][123091] Updated weights for policy 0, policy_version 700247 (0.0008) [2023-12-26 05:10:49,935][123091] Updated weights for policy 0, policy_version 700257 (0.0009) [2023-12-26 05:10:50,003][123091] Updated weights for policy 0, policy_version 700267 (0.0011) [2023-12-26 05:10:50,398][123090] Updated weights for policy 1, policy_version 695754 (0.0009) [2023-12-26 05:10:50,465][123090] Updated weights for policy 1, policy_version 695764 (0.0009) [2023-12-26 05:10:50,544][123090] Updated weights for policy 1, policy_version 695774 (0.0010) [2023-12-26 05:10:50,770][123091] Updated weights for policy 0, policy_version 700277 (0.0009) [2023-12-26 05:10:50,827][123091] Updated weights for policy 0, policy_version 700287 (0.0006) [2023-12-26 05:10:50,895][123091] Updated weights for policy 0, policy_version 700297 (0.0009) [2023-12-26 05:10:51,377][123090] Updated weights for policy 1, policy_version 695784 (0.0011) [2023-12-26 05:10:51,443][123090] Updated weights for policy 1, policy_version 695794 (0.0010) [2023-12-26 05:10:51,505][123090] Updated weights for policy 1, policy_version 695804 (0.0009) [2023-12-26 05:10:51,731][123091] Updated weights for policy 0, policy_version 700307 (0.0010) [2023-12-26 05:10:51,790][123091] Updated weights for policy 0, policy_version 700317 (0.0008) [2023-12-26 05:10:51,852][123091] Updated weights for policy 0, policy_version 700327 (0.0008) [2023-12-26 05:10:52,380][123090] Updated weights for policy 1, policy_version 695814 (0.0009) [2023-12-26 05:10:52,430][123090] Updated weights for policy 1, policy_version 695824 (0.0009) [2023-12-26 05:10:52,484][123090] Updated weights for policy 1, policy_version 695834 (0.0010) [2023-12-26 05:10:52,583][123091] Updated weights for policy 0, policy_version 700337 (0.0008) [2023-12-26 05:10:52,644][123091] Updated weights for policy 0, policy_version 700347 (0.0009) [2023-12-26 05:10:52,699][123091] Updated weights for policy 0, policy_version 700357 (0.0009) [2023-12-26 05:10:52,761][123091] Updated weights for policy 0, policy_version 700367 (0.0010) [2023-12-26 05:10:53,390][123090] Updated weights for policy 1, policy_version 695845 (0.0010) [2023-12-26 05:10:53,454][123090] Updated weights for policy 1, policy_version 695855 (0.0009) [2023-12-26 05:10:53,506][123090] Updated weights for policy 1, policy_version 695865 (0.0009) [2023-12-26 05:10:53,506][123091] Updated weights for policy 0, policy_version 700377 (0.0009) [2023-12-26 05:10:53,557][123091] Updated weights for policy 0, policy_version 700387 (0.0010) [2023-12-26 05:10:53,609][123091] Updated weights for policy 0, policy_version 700397 (0.0009) [2023-12-26 05:10:53,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 357449728. Throughput: 0: 8884.1, 1: 8751.9. Samples: 357422604. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:53,785][121949] Avg episode reward: [(0, '6138.140'), (1, '5727.676')] [2023-12-26 05:10:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000700400_179306496.pth... [2023-12-26 05:10:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000695872_178143232.pth... [2023-12-26 05:10:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000699344_179036160.pth [2023-12-26 05:10:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000694816_177872896.pth [2023-12-26 05:10:54,298][123090] Updated weights for policy 1, policy_version 695875 (0.0006) [2023-12-26 05:10:54,369][123090] Updated weights for policy 1, policy_version 695885 (0.0009) [2023-12-26 05:10:54,426][123090] Updated weights for policy 1, policy_version 695895 (0.0010) [2023-12-26 05:10:54,484][123091] Updated weights for policy 0, policy_version 700407 (0.0008) [2023-12-26 05:10:54,536][123091] Updated weights for policy 0, policy_version 700417 (0.0010) [2023-12-26 05:10:54,604][123091] Updated weights for policy 0, policy_version 700427 (0.0009) [2023-12-26 05:10:55,084][123090] Updated weights for policy 1, policy_version 695905 (0.0008) [2023-12-26 05:10:55,152][123090] Updated weights for policy 1, policy_version 695915 (0.0009) [2023-12-26 05:10:55,221][123090] Updated weights for policy 1, policy_version 695925 (0.0009) [2023-12-26 05:10:55,287][123090] Updated weights for policy 1, policy_version 695935 (0.0009) [2023-12-26 05:10:55,489][123091] Updated weights for policy 0, policy_version 700437 (0.0010) [2023-12-26 05:10:55,543][123091] Updated weights for policy 0, policy_version 700447 (0.0010) [2023-12-26 05:10:55,595][123091] Updated weights for policy 0, policy_version 700457 (0.0009) [2023-12-26 05:10:56,003][123090] Updated weights for policy 1, policy_version 695945 (0.0006) [2023-12-26 05:10:56,053][123090] Updated weights for policy 1, policy_version 695955 (0.0008) [2023-12-26 05:10:56,117][123090] Updated weights for policy 1, policy_version 695965 (0.0009) [2023-12-26 05:10:56,432][123091] Updated weights for policy 0, policy_version 700468 (0.0008) [2023-12-26 05:10:56,487][123091] Updated weights for policy 0, policy_version 700478 (0.0005) [2023-12-26 05:10:56,538][123091] Updated weights for policy 0, policy_version 700488 (0.0006) [2023-12-26 05:10:56,859][123090] Updated weights for policy 1, policy_version 695975 (0.0010) [2023-12-26 05:10:56,907][123090] Updated weights for policy 1, policy_version 695985 (0.0010) [2023-12-26 05:10:56,954][123090] Updated weights for policy 1, policy_version 695995 (0.0010) [2023-12-26 05:10:57,217][123091] Updated weights for policy 0, policy_version 700498 (0.0005) [2023-12-26 05:10:57,273][123091] Updated weights for policy 0, policy_version 700508 (0.0006) [2023-12-26 05:10:57,331][123091] Updated weights for policy 0, policy_version 700518 (0.0005) [2023-12-26 05:10:57,391][123091] Updated weights for policy 0, policy_version 700528 (0.0009) [2023-12-26 05:10:57,770][123090] Updated weights for policy 1, policy_version 696005 (0.0008) [2023-12-26 05:10:57,820][123090] Updated weights for policy 1, policy_version 696015 (0.0010) [2023-12-26 05:10:57,871][123090] Updated weights for policy 1, policy_version 696025 (0.0010) [2023-12-26 05:10:58,189][123091] Updated weights for policy 0, policy_version 700538 (0.0011) [2023-12-26 05:10:58,260][123091] Updated weights for policy 0, policy_version 700548 (0.0011) [2023-12-26 05:10:58,327][123091] Updated weights for policy 0, policy_version 700558 (0.0010) [2023-12-26 05:10:58,726][123090] Updated weights for policy 1, policy_version 696035 (0.0009) [2023-12-26 05:10:58,786][121949] Fps is (10 sec: 17200.1, 60 sec: 17612.3, 300 sec: 17633.5). Total num frames: 357531648. Throughput: 0: 8917.2, 1: 8821.4. Samples: 357528980. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:10:58,786][121949] Avg episode reward: [(0, '6208.951'), (1, '5668.046')] [2023-12-26 05:10:58,799][123090] Updated weights for policy 1, policy_version 696045 (0.0007) [2023-12-26 05:10:58,869][123090] Updated weights for policy 1, policy_version 696055 (0.0009) [2023-12-26 05:10:59,181][123091] Updated weights for policy 0, policy_version 700568 (0.0008) [2023-12-26 05:10:59,258][123091] Updated weights for policy 0, policy_version 700578 (0.0009) [2023-12-26 05:10:59,331][123091] Updated weights for policy 0, policy_version 700588 (0.0009) [2023-12-26 05:10:59,825][123090] Updated weights for policy 1, policy_version 696065 (0.0009) [2023-12-26 05:10:59,887][123090] Updated weights for policy 1, policy_version 696075 (0.0009) [2023-12-26 05:10:59,947][123090] Updated weights for policy 1, policy_version 696085 (0.0010) [2023-12-26 05:11:00,017][123090] Updated weights for policy 1, policy_version 696095 (0.0009) [2023-12-26 05:11:00,105][123091] Updated weights for policy 0, policy_version 700598 (0.0008) [2023-12-26 05:11:00,183][123091] Updated weights for policy 0, policy_version 700608 (0.0006) [2023-12-26 05:11:00,243][123091] Updated weights for policy 0, policy_version 700618 (0.0010) [2023-12-26 05:11:00,855][123090] Updated weights for policy 1, policy_version 696105 (0.0006) [2023-12-26 05:11:00,920][123090] Updated weights for policy 1, policy_version 696115 (0.0005) [2023-12-26 05:11:00,983][123090] Updated weights for policy 1, policy_version 696125 (0.0005) [2023-12-26 05:11:01,012][123091] Updated weights for policy 0, policy_version 700628 (0.0007) [2023-12-26 05:11:01,088][123091] Updated weights for policy 0, policy_version 700638 (0.0008) [2023-12-26 05:11:01,151][123091] Updated weights for policy 0, policy_version 700648 (0.0009) [2023-12-26 05:11:01,668][123090] Updated weights for policy 1, policy_version 696135 (0.0007) [2023-12-26 05:11:01,727][123090] Updated weights for policy 1, policy_version 696145 (0.0008) [2023-12-26 05:11:01,792][123090] Updated weights for policy 1, policy_version 696155 (0.0009) [2023-12-26 05:11:01,965][123091] Updated weights for policy 0, policy_version 700658 (0.0008) [2023-12-26 05:11:02,018][123091] Updated weights for policy 0, policy_version 700669 (0.0010) [2023-12-26 05:11:02,073][123091] Updated weights for policy 0, policy_version 700679 (0.0009) [2023-12-26 05:11:02,573][123090] Updated weights for policy 1, policy_version 696165 (0.0009) [2023-12-26 05:11:02,624][123090] Updated weights for policy 1, policy_version 696175 (0.0008) [2023-12-26 05:11:02,683][123090] Updated weights for policy 1, policy_version 696186 (0.0009) [2023-12-26 05:11:02,917][123091] Updated weights for policy 0, policy_version 700689 (0.0009) [2023-12-26 05:11:02,965][123091] Updated weights for policy 0, policy_version 700699 (0.0010) [2023-12-26 05:11:03,008][123091] Updated weights for policy 0, policy_version 700709 (0.0010) [2023-12-26 05:11:03,056][123091] Updated weights for policy 0, policy_version 700719 (0.0010) [2023-12-26 05:11:03,459][123090] Updated weights for policy 1, policy_version 696196 (0.0007) [2023-12-26 05:11:03,515][123090] Updated weights for policy 1, policy_version 696206 (0.0005) [2023-12-26 05:11:03,562][123090] Updated weights for policy 1, policy_version 696216 (0.0006) [2023-12-26 05:11:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 357621760. Throughput: 0: 8862.6, 1: 8871.2. Samples: 357633248. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 05:11:03,785][121949] Avg episode reward: [(0, '6232.710'), (1, '5688.640')] [2023-12-26 05:11:03,917][123091] Updated weights for policy 0, policy_version 700729 (0.0006) [2023-12-26 05:11:03,971][123091] Updated weights for policy 0, policy_version 700739 (0.0008) [2023-12-26 05:11:04,027][123091] Updated weights for policy 0, policy_version 700749 (0.0010) [2023-12-26 05:11:04,362][123090] Updated weights for policy 1, policy_version 696226 (0.0009) [2023-12-26 05:11:04,431][123090] Updated weights for policy 1, policy_version 696236 (0.0011) [2023-12-26 05:11:04,497][123090] Updated weights for policy 1, policy_version 696246 (0.0010) [2023-12-26 05:11:04,558][123090] Updated weights for policy 1, policy_version 696256 (0.0011) [2023-12-26 05:11:04,838][123091] Updated weights for policy 0, policy_version 700759 (0.0008) [2023-12-26 05:11:04,902][123091] Updated weights for policy 0, policy_version 700769 (0.0008) [2023-12-26 05:11:04,964][123091] Updated weights for policy 0, policy_version 700779 (0.0009) [2023-12-26 05:11:05,384][123090] Updated weights for policy 1, policy_version 696266 (0.0010) [2023-12-26 05:11:05,436][123090] Updated weights for policy 1, policy_version 696276 (0.0008) [2023-12-26 05:11:05,498][123090] Updated weights for policy 1, policy_version 696286 (0.0010) [2023-12-26 05:11:05,818][123091] Updated weights for policy 0, policy_version 700789 (0.0009) [2023-12-26 05:11:05,885][123091] Updated weights for policy 0, policy_version 700799 (0.0009) [2023-12-26 05:11:05,946][123091] Updated weights for policy 0, policy_version 700809 (0.0008) [2023-12-26 05:11:06,276][123090] Updated weights for policy 1, policy_version 696296 (0.0007) [2023-12-26 05:11:06,348][123090] Updated weights for policy 1, policy_version 696306 (0.0011) [2023-12-26 05:11:06,416][123090] Updated weights for policy 1, policy_version 696316 (0.0010) [2023-12-26 05:11:06,842][123091] Updated weights for policy 0, policy_version 700819 (0.0010) [2023-12-26 05:11:06,907][123091] Updated weights for policy 0, policy_version 700829 (0.0009) [2023-12-26 05:11:06,960][123091] Updated weights for policy 0, policy_version 700839 (0.0009) [2023-12-26 05:11:07,220][123090] Updated weights for policy 1, policy_version 696326 (0.0010) [2023-12-26 05:11:07,287][123090] Updated weights for policy 1, policy_version 696336 (0.0010) [2023-12-26 05:11:07,346][123090] Updated weights for policy 1, policy_version 696346 (0.0010) [2023-12-26 05:11:07,806][123091] Updated weights for policy 0, policy_version 700849 (0.0009) [2023-12-26 05:11:07,861][123091] Updated weights for policy 0, policy_version 700859 (0.0010) [2023-12-26 05:11:07,915][123091] Updated weights for policy 0, policy_version 700869 (0.0010) [2023-12-26 05:11:07,968][123091] Updated weights for policy 0, policy_version 700879 (0.0010) [2023-12-26 05:11:08,092][123090] Updated weights for policy 1, policy_version 696356 (0.0008) [2023-12-26 05:11:08,145][123090] Updated weights for policy 1, policy_version 696366 (0.0005) [2023-12-26 05:11:08,196][123090] Updated weights for policy 1, policy_version 696376 (0.0005) [2023-12-26 05:11:08,784][121949] Fps is (10 sec: 17206.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 357703680. Throughput: 0: 8856.1, 1: 8853.6. Samples: 357684132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:08,785][121949] Avg episode reward: [(0, '6235.482'), (1, '5734.884')] [2023-12-26 05:11:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000700880_179429376.pth... [2023-12-26 05:11:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000696384_178274304.pth... [2023-12-26 05:11:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000699856_179167232.pth [2023-12-26 05:11:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000695360_178012160.pth [2023-12-26 05:11:08,909][123091] Updated weights for policy 0, policy_version 700889 (0.0009) [2023-12-26 05:11:08,945][123090] Updated weights for policy 1, policy_version 696386 (0.0006) [2023-12-26 05:11:08,964][123091] Updated weights for policy 0, policy_version 700899 (0.0008) [2023-12-26 05:11:09,007][123090] Updated weights for policy 1, policy_version 696396 (0.0008) [2023-12-26 05:11:09,027][123091] Updated weights for policy 0, policy_version 700909 (0.0007) [2023-12-26 05:11:09,062][123090] Updated weights for policy 1, policy_version 696406 (0.0010) [2023-12-26 05:11:09,110][123090] Updated weights for policy 1, policy_version 696416 (0.0010) [2023-12-26 05:11:09,850][123091] Updated weights for policy 0, policy_version 700919 (0.0007) [2023-12-26 05:11:09,917][123091] Updated weights for policy 0, policy_version 700929 (0.0009) [2023-12-26 05:11:09,984][123091] Updated weights for policy 0, policy_version 700939 (0.0008) [2023-12-26 05:11:10,002][123090] Updated weights for policy 1, policy_version 696426 (0.0009) [2023-12-26 05:11:10,070][123090] Updated weights for policy 1, policy_version 696436 (0.0009) [2023-12-26 05:11:10,129][123090] Updated weights for policy 1, policy_version 696446 (0.0009) [2023-12-26 05:11:10,737][123091] Updated weights for policy 0, policy_version 700949 (0.0008) [2023-12-26 05:11:10,790][123091] Updated weights for policy 0, policy_version 700959 (0.0009) [2023-12-26 05:11:10,844][123091] Updated weights for policy 0, policy_version 700970 (0.0010) [2023-12-26 05:11:10,944][123090] Updated weights for policy 1, policy_version 696456 (0.0009) [2023-12-26 05:11:11,005][123090] Updated weights for policy 1, policy_version 696466 (0.0009) [2023-12-26 05:11:11,076][123090] Updated weights for policy 1, policy_version 696476 (0.0010) [2023-12-26 05:11:11,664][123091] Updated weights for policy 0, policy_version 700980 (0.0009) [2023-12-26 05:11:11,718][123091] Updated weights for policy 0, policy_version 700990 (0.0008) [2023-12-26 05:11:11,782][123091] Updated weights for policy 0, policy_version 701000 (0.0009) [2023-12-26 05:11:11,985][123090] Updated weights for policy 1, policy_version 696486 (0.0010) [2023-12-26 05:11:12,045][123090] Updated weights for policy 1, policy_version 696496 (0.0010) [2023-12-26 05:11:12,105][123090] Updated weights for policy 1, policy_version 696506 (0.0011) [2023-12-26 05:11:12,650][123091] Updated weights for policy 0, policy_version 701010 (0.0009) [2023-12-26 05:11:12,717][123091] Updated weights for policy 0, policy_version 701020 (0.0008) [2023-12-26 05:11:12,785][123091] Updated weights for policy 0, policy_version 701030 (0.0006) [2023-12-26 05:11:12,856][123091] Updated weights for policy 0, policy_version 701040 (0.0006) [2023-12-26 05:11:12,956][123090] Updated weights for policy 1, policy_version 696516 (0.0010) [2023-12-26 05:11:13,011][123090] Updated weights for policy 1, policy_version 696526 (0.0010) [2023-12-26 05:11:13,062][123090] Updated weights for policy 1, policy_version 696536 (0.0010) [2023-12-26 05:11:13,481][123091] Updated weights for policy 0, policy_version 701050 (0.0006) [2023-12-26 05:11:13,541][123091] Updated weights for policy 0, policy_version 701060 (0.0006) [2023-12-26 05:11:13,589][123091] Updated weights for policy 0, policy_version 701070 (0.0008) [2023-12-26 05:11:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 357793792. Throughput: 0: 8767.8, 1: 8868.2. Samples: 357786460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:13,785][121949] Avg episode reward: [(0, '6235.352'), (1, '5838.675')] [2023-12-26 05:11:13,895][123090] Updated weights for policy 1, policy_version 696546 (0.0010) [2023-12-26 05:11:13,958][123090] Updated weights for policy 1, policy_version 696556 (0.0010) [2023-12-26 05:11:14,017][123090] Updated weights for policy 1, policy_version 696566 (0.0010) [2023-12-26 05:11:14,076][123090] Updated weights for policy 1, policy_version 696576 (0.0010) [2023-12-26 05:11:14,378][123091] Updated weights for policy 0, policy_version 701081 (0.0010) [2023-12-26 05:11:14,440][123091] Updated weights for policy 0, policy_version 701091 (0.0009) [2023-12-26 05:11:14,503][123091] Updated weights for policy 0, policy_version 701101 (0.0009) [2023-12-26 05:11:14,843][123090] Updated weights for policy 1, policy_version 696586 (0.0010) [2023-12-26 05:11:14,907][123090] Updated weights for policy 1, policy_version 696596 (0.0011) [2023-12-26 05:11:14,968][123090] Updated weights for policy 1, policy_version 696606 (0.0009) [2023-12-26 05:11:15,393][123091] Updated weights for policy 0, policy_version 701111 (0.0010) [2023-12-26 05:11:15,445][123091] Updated weights for policy 0, policy_version 701121 (0.0010) [2023-12-26 05:11:15,493][123091] Updated weights for policy 0, policy_version 701131 (0.0009) [2023-12-26 05:11:15,694][123090] Updated weights for policy 1, policy_version 696616 (0.0007) [2023-12-26 05:11:15,759][123090] Updated weights for policy 1, policy_version 696626 (0.0006) [2023-12-26 05:11:15,818][123090] Updated weights for policy 1, policy_version 696636 (0.0005) [2023-12-26 05:11:16,421][123091] Updated weights for policy 0, policy_version 701141 (0.0008) [2023-12-26 05:11:16,430][123090] Updated weights for policy 1, policy_version 696646 (0.0008) [2023-12-26 05:11:16,476][123091] Updated weights for policy 0, policy_version 701151 (0.0009) [2023-12-26 05:11:16,492][123090] Updated weights for policy 1, policy_version 696656 (0.0008) [2023-12-26 05:11:16,539][123091] Updated weights for policy 0, policy_version 701161 (0.0010) [2023-12-26 05:11:16,562][123090] Updated weights for policy 1, policy_version 696666 (0.0009) [2023-12-26 05:11:17,329][123090] Updated weights for policy 1, policy_version 696676 (0.0007) [2023-12-26 05:11:17,373][123091] Updated weights for policy 0, policy_version 701171 (0.0008) [2023-12-26 05:11:17,392][123090] Updated weights for policy 1, policy_version 696686 (0.0005) [2023-12-26 05:11:17,424][123091] Updated weights for policy 0, policy_version 701181 (0.0008) [2023-12-26 05:11:17,456][123090] Updated weights for policy 1, policy_version 696696 (0.0006) [2023-12-26 05:11:17,475][123091] Updated weights for policy 0, policy_version 701192 (0.0009) [2023-12-26 05:11:18,017][123090] Updated weights for policy 1, policy_version 696706 (0.0007) [2023-12-26 05:11:18,075][123090] Updated weights for policy 1, policy_version 696716 (0.0010) [2023-12-26 05:11:18,138][123090] Updated weights for policy 1, policy_version 696726 (0.0010) [2023-12-26 05:11:18,316][123091] Updated weights for policy 0, policy_version 701202 (0.0009) [2023-12-26 05:11:18,376][123091] Updated weights for policy 0, policy_version 701212 (0.0010) [2023-12-26 05:11:18,442][123091] Updated weights for policy 0, policy_version 701222 (0.0010) [2023-12-26 05:11:18,503][123091] Updated weights for policy 0, policy_version 701232 (0.0009) [2023-12-26 05:11:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 357883904. Throughput: 0: 8781.8, 1: 8888.5. Samples: 357893616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:18,784][121949] Avg episode reward: [(0, '6219.119'), (1, '5877.020')] [2023-12-26 05:11:19,020][123090] Updated weights for policy 1, policy_version 696737 (0.0010) [2023-12-26 05:11:19,073][123090] Updated weights for policy 1, policy_version 696747 (0.0009) [2023-12-26 05:11:19,122][123090] Updated weights for policy 1, policy_version 696757 (0.0009) [2023-12-26 05:11:19,171][123090] Updated weights for policy 1, policy_version 696767 (0.0009) [2023-12-26 05:11:19,321][123091] Updated weights for policy 0, policy_version 701242 (0.0009) [2023-12-26 05:11:19,386][123091] Updated weights for policy 0, policy_version 701252 (0.0009) [2023-12-26 05:11:19,446][123091] Updated weights for policy 0, policy_version 701262 (0.0009) [2023-12-26 05:11:20,055][123090] Updated weights for policy 1, policy_version 696777 (0.0010) [2023-12-26 05:11:20,127][123090] Updated weights for policy 1, policy_version 696787 (0.0010) [2023-12-26 05:11:20,189][123090] Updated weights for policy 1, policy_version 696797 (0.0009) [2023-12-26 05:11:20,309][123091] Updated weights for policy 0, policy_version 701272 (0.0009) [2023-12-26 05:11:20,374][123091] Updated weights for policy 0, policy_version 701282 (0.0010) [2023-12-26 05:11:20,435][123091] Updated weights for policy 0, policy_version 701292 (0.0010) [2023-12-26 05:11:21,089][123090] Updated weights for policy 1, policy_version 696807 (0.0009) [2023-12-26 05:11:21,155][123090] Updated weights for policy 1, policy_version 696817 (0.0009) [2023-12-26 05:11:21,219][123090] Updated weights for policy 1, policy_version 696828 (0.0010) [2023-12-26 05:11:21,331][123091] Updated weights for policy 0, policy_version 701302 (0.0010) [2023-12-26 05:11:21,404][123091] Updated weights for policy 0, policy_version 701312 (0.0011) [2023-12-26 05:11:21,478][123091] Updated weights for policy 0, policy_version 701322 (0.0011) [2023-12-26 05:11:22,143][123090] Updated weights for policy 1, policy_version 696838 (0.0009) [2023-12-26 05:11:22,205][123090] Updated weights for policy 1, policy_version 696848 (0.0010) [2023-12-26 05:11:22,271][123090] Updated weights for policy 1, policy_version 696858 (0.0009) [2023-12-26 05:11:22,280][123091] Updated weights for policy 0, policy_version 701332 (0.0009) [2023-12-26 05:11:22,343][123091] Updated weights for policy 0, policy_version 701342 (0.0006) [2023-12-26 05:11:22,417][123091] Updated weights for policy 0, policy_version 701352 (0.0009) [2023-12-26 05:11:23,098][123090] Updated weights for policy 1, policy_version 696868 (0.0008) [2023-12-26 05:11:23,153][123090] Updated weights for policy 1, policy_version 696878 (0.0009) [2023-12-26 05:11:23,176][123091] Updated weights for policy 0, policy_version 701362 (0.0010) [2023-12-26 05:11:23,214][123090] Updated weights for policy 1, policy_version 696888 (0.0007) [2023-12-26 05:11:23,233][123091] Updated weights for policy 0, policy_version 701372 (0.0009) [2023-12-26 05:11:23,294][123091] Updated weights for policy 0, policy_version 701382 (0.0009) [2023-12-26 05:11:23,347][123091] Updated weights for policy 0, policy_version 701392 (0.0006) [2023-12-26 05:11:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 357965824. Throughput: 0: 8731.8, 1: 8826.9. Samples: 357942644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:23,785][121949] Avg episode reward: [(0, '6170.679'), (1, '5823.976')] [2023-12-26 05:11:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000696896_178405376.pth... [2023-12-26 05:11:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000701392_179560448.pth... [2023-12-26 05:11:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000695872_178143232.pth [2023-12-26 05:11:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000700400_179306496.pth [2023-12-26 05:11:24,071][123090] Updated weights for policy 1, policy_version 696898 (0.0006) [2023-12-26 05:11:24,120][123091] Updated weights for policy 0, policy_version 701402 (0.0007) [2023-12-26 05:11:24,132][123090] Updated weights for policy 1, policy_version 696908 (0.0007) [2023-12-26 05:11:24,181][123091] Updated weights for policy 0, policy_version 701412 (0.0008) [2023-12-26 05:11:24,184][123090] Updated weights for policy 1, policy_version 696918 (0.0007) [2023-12-26 05:11:24,234][123090] Updated weights for policy 1, policy_version 696928 (0.0006) [2023-12-26 05:11:24,237][123091] Updated weights for policy 0, policy_version 701422 (0.0008) [2023-12-26 05:11:24,910][123090] Updated weights for policy 1, policy_version 696938 (0.0011) [2023-12-26 05:11:24,978][123090] Updated weights for policy 1, policy_version 696948 (0.0011) [2023-12-26 05:11:25,013][123091] Updated weights for policy 0, policy_version 701432 (0.0009) [2023-12-26 05:11:25,047][123090] Updated weights for policy 1, policy_version 696958 (0.0011) [2023-12-26 05:11:25,068][123091] Updated weights for policy 0, policy_version 701442 (0.0007) [2023-12-26 05:11:25,124][123091] Updated weights for policy 0, policy_version 701452 (0.0011) [2023-12-26 05:11:25,785][123090] Updated weights for policy 1, policy_version 696968 (0.0007) [2023-12-26 05:11:25,844][123090] Updated weights for policy 1, policy_version 696978 (0.0006) [2023-12-26 05:11:25,916][123090] Updated weights for policy 1, policy_version 696988 (0.0005) [2023-12-26 05:11:25,934][123091] Updated weights for policy 0, policy_version 701462 (0.0009) [2023-12-26 05:11:25,977][123091] Updated weights for policy 0, policy_version 701472 (0.0006) [2023-12-26 05:11:26,029][123091] Updated weights for policy 0, policy_version 701482 (0.0005) [2023-12-26 05:11:26,592][123090] Updated weights for policy 1, policy_version 696998 (0.0006) [2023-12-26 05:11:26,647][123090] Updated weights for policy 1, policy_version 697008 (0.0005) [2023-12-26 05:11:26,691][123090] Updated weights for policy 1, policy_version 697018 (0.0005) [2023-12-26 05:11:26,738][123091] Updated weights for policy 0, policy_version 701492 (0.0005) [2023-12-26 05:11:26,799][123091] Updated weights for policy 0, policy_version 701502 (0.0005) [2023-12-26 05:11:26,871][123091] Updated weights for policy 0, policy_version 701512 (0.0005) [2023-12-26 05:11:27,327][123090] Updated weights for policy 1, policy_version 697028 (0.0005) [2023-12-26 05:11:27,389][123090] Updated weights for policy 1, policy_version 697038 (0.0005) [2023-12-26 05:11:27,442][123090] Updated weights for policy 1, policy_version 697048 (0.0005) [2023-12-26 05:11:27,729][123091] Updated weights for policy 0, policy_version 701522 (0.0009) [2023-12-26 05:11:27,781][123091] Updated weights for policy 0, policy_version 701532 (0.0009) [2023-12-26 05:11:27,842][123091] Updated weights for policy 0, policy_version 701542 (0.0009) [2023-12-26 05:11:27,902][123091] Updated weights for policy 0, policy_version 701552 (0.0009) [2023-12-26 05:11:28,201][123090] Updated weights for policy 1, policy_version 697058 (0.0006) [2023-12-26 05:11:28,252][123090] Updated weights for policy 1, policy_version 697068 (0.0010) [2023-12-26 05:11:28,299][123090] Updated weights for policy 1, policy_version 697078 (0.0010) [2023-12-26 05:11:28,360][123090] Updated weights for policy 1, policy_version 697088 (0.0010) [2023-12-26 05:11:28,747][123091] Updated weights for policy 0, policy_version 701562 (0.0009) [2023-12-26 05:11:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 358055936. Throughput: 0: 8786.6, 1: 8928.9. Samples: 358053504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:28,785][121949] Avg episode reward: [(0, '6134.136'), (1, '5743.924')] [2023-12-26 05:11:28,795][123091] Updated weights for policy 0, policy_version 701572 (0.0009) [2023-12-26 05:11:28,854][123091] Updated weights for policy 0, policy_version 701582 (0.0009) [2023-12-26 05:11:29,279][123090] Updated weights for policy 1, policy_version 697098 (0.0010) [2023-12-26 05:11:29,344][123090] Updated weights for policy 1, policy_version 697108 (0.0013) [2023-12-26 05:11:29,406][123090] Updated weights for policy 1, policy_version 697118 (0.0011) [2023-12-26 05:11:29,678][123091] Updated weights for policy 0, policy_version 701592 (0.0010) [2023-12-26 05:11:29,740][123091] Updated weights for policy 0, policy_version 701602 (0.0008) [2023-12-26 05:11:29,812][123091] Updated weights for policy 0, policy_version 701612 (0.0007) [2023-12-26 05:11:30,159][123090] Updated weights for policy 1, policy_version 697128 (0.0007) [2023-12-26 05:11:30,207][123090] Updated weights for policy 1, policy_version 697138 (0.0007) [2023-12-26 05:11:30,259][123090] Updated weights for policy 1, policy_version 697148 (0.0009) [2023-12-26 05:11:30,655][123091] Updated weights for policy 0, policy_version 701622 (0.0009) [2023-12-26 05:11:30,704][123091] Updated weights for policy 0, policy_version 701632 (0.0009) [2023-12-26 05:11:30,755][123091] Updated weights for policy 0, policy_version 701643 (0.0010) [2023-12-26 05:11:31,012][123090] Updated weights for policy 1, policy_version 697158 (0.0010) [2023-12-26 05:11:31,083][123090] Updated weights for policy 1, policy_version 697168 (0.0010) [2023-12-26 05:11:31,153][123090] Updated weights for policy 1, policy_version 697178 (0.0010) [2023-12-26 05:11:31,615][123091] Updated weights for policy 0, policy_version 701653 (0.0009) [2023-12-26 05:11:31,674][123091] Updated weights for policy 0, policy_version 701663 (0.0009) [2023-12-26 05:11:31,744][123091] Updated weights for policy 0, policy_version 701673 (0.0009) [2023-12-26 05:11:31,928][123090] Updated weights for policy 1, policy_version 697188 (0.0007) [2023-12-26 05:11:31,977][123090] Updated weights for policy 1, policy_version 697198 (0.0005) [2023-12-26 05:11:32,030][123090] Updated weights for policy 1, policy_version 697208 (0.0006) [2023-12-26 05:11:32,496][123091] Updated weights for policy 0, policy_version 701683 (0.0008) [2023-12-26 05:11:32,574][123091] Updated weights for policy 0, policy_version 701693 (0.0005) [2023-12-26 05:11:32,645][123091] Updated weights for policy 0, policy_version 701703 (0.0008) [2023-12-26 05:11:32,731][123090] Updated weights for policy 1, policy_version 697218 (0.0006) [2023-12-26 05:11:32,789][123090] Updated weights for policy 1, policy_version 697228 (0.0006) [2023-12-26 05:11:32,847][123090] Updated weights for policy 1, policy_version 697238 (0.0010) [2023-12-26 05:11:32,904][123090] Updated weights for policy 1, policy_version 697248 (0.0010) [2023-12-26 05:11:33,291][123091] Updated weights for policy 0, policy_version 701713 (0.0008) [2023-12-26 05:11:33,338][123091] Updated weights for policy 0, policy_version 701723 (0.0008) [2023-12-26 05:11:33,393][123091] Updated weights for policy 0, policy_version 701733 (0.0008) [2023-12-26 05:11:33,443][123091] Updated weights for policy 0, policy_version 701743 (0.0008) [2023-12-26 05:11:33,712][123090] Updated weights for policy 1, policy_version 697258 (0.0009) [2023-12-26 05:11:33,764][123090] Updated weights for policy 1, policy_version 697268 (0.0009) [2023-12-26 05:11:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 358146048. Throughput: 0: 8675.5, 1: 8862.3. Samples: 358160220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:33,785][121949] Avg episode reward: [(0, '6134.540'), (1, '5702.434')] [2023-12-26 05:11:33,811][123090] Updated weights for policy 1, policy_version 697278 (0.0010) [2023-12-26 05:11:34,303][123091] Updated weights for policy 0, policy_version 701753 (0.0009) [2023-12-26 05:11:34,373][123091] Updated weights for policy 0, policy_version 701763 (0.0006) [2023-12-26 05:11:34,438][123091] Updated weights for policy 0, policy_version 701773 (0.0010) [2023-12-26 05:11:34,619][123090] Updated weights for policy 1, policy_version 697288 (0.0008) [2023-12-26 05:11:34,685][123090] Updated weights for policy 1, policy_version 697298 (0.0010) [2023-12-26 05:11:34,752][123090] Updated weights for policy 1, policy_version 697308 (0.0009) [2023-12-26 05:11:35,239][123091] Updated weights for policy 0, policy_version 701783 (0.0009) [2023-12-26 05:11:35,302][123091] Updated weights for policy 0, policy_version 701793 (0.0011) [2023-12-26 05:11:35,365][123091] Updated weights for policy 0, policy_version 701803 (0.0009) [2023-12-26 05:11:35,519][123090] Updated weights for policy 1, policy_version 697318 (0.0008) [2023-12-26 05:11:35,590][123090] Updated weights for policy 1, policy_version 697328 (0.0010) [2023-12-26 05:11:35,653][123090] Updated weights for policy 1, policy_version 697338 (0.0010) [2023-12-26 05:11:36,196][123091] Updated weights for policy 0, policy_version 701813 (0.0011) [2023-12-26 05:11:36,260][123091] Updated weights for policy 0, policy_version 701823 (0.0011) [2023-12-26 05:11:36,328][123091] Updated weights for policy 0, policy_version 701833 (0.0011) [2023-12-26 05:11:36,460][123090] Updated weights for policy 1, policy_version 697348 (0.0009) [2023-12-26 05:11:36,537][123090] Updated weights for policy 1, policy_version 697358 (0.0010) [2023-12-26 05:11:36,610][123090] Updated weights for policy 1, policy_version 697368 (0.0008) [2023-12-26 05:11:37,142][123091] Updated weights for policy 0, policy_version 701843 (0.0010) [2023-12-26 05:11:37,208][123091] Updated weights for policy 0, policy_version 701853 (0.0010) [2023-12-26 05:11:37,270][123091] Updated weights for policy 0, policy_version 701863 (0.0009) [2023-12-26 05:11:37,420][123090] Updated weights for policy 1, policy_version 697378 (0.0009) [2023-12-26 05:11:37,477][123090] Updated weights for policy 1, policy_version 697388 (0.0009) [2023-12-26 05:11:37,536][123090] Updated weights for policy 1, policy_version 697398 (0.0009) [2023-12-26 05:11:37,591][123090] Updated weights for policy 1, policy_version 697408 (0.0008) [2023-12-26 05:11:38,025][123091] Updated weights for policy 0, policy_version 701873 (0.0010) [2023-12-26 05:11:38,080][123091] Updated weights for policy 0, policy_version 701883 (0.0007) [2023-12-26 05:11:38,132][123091] Updated weights for policy 0, policy_version 701893 (0.0005) [2023-12-26 05:11:38,185][123091] Updated weights for policy 0, policy_version 701903 (0.0009) [2023-12-26 05:11:38,473][123090] Updated weights for policy 1, policy_version 697418 (0.0006) [2023-12-26 05:11:38,541][123090] Updated weights for policy 1, policy_version 697428 (0.0006) [2023-12-26 05:11:38,614][123090] Updated weights for policy 1, policy_version 697438 (0.0005) [2023-12-26 05:11:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 358236160. Throughput: 0: 8669.7, 1: 8897.2. Samples: 358213116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:38,785][121949] Avg episode reward: [(0, '6076.430'), (1, '5754.694')] [2023-12-26 05:11:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000701904_179691520.pth... [2023-12-26 05:11:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000697440_178544640.pth... [2023-12-26 05:11:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000700880_179429376.pth [2023-12-26 05:11:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000696384_178274304.pth [2023-12-26 05:11:38,914][123091] Updated weights for policy 0, policy_version 701913 (0.0009) [2023-12-26 05:11:38,964][123091] Updated weights for policy 0, policy_version 701923 (0.0010) [2023-12-26 05:11:39,012][123091] Updated weights for policy 0, policy_version 701934 (0.0009) [2023-12-26 05:11:39,287][123090] Updated weights for policy 1, policy_version 697448 (0.0006) [2023-12-26 05:11:39,357][123090] Updated weights for policy 1, policy_version 697458 (0.0008) [2023-12-26 05:11:39,423][123090] Updated weights for policy 1, policy_version 697468 (0.0007) [2023-12-26 05:11:39,925][123091] Updated weights for policy 0, policy_version 701944 (0.0009) [2023-12-26 05:11:39,984][123091] Updated weights for policy 0, policy_version 701954 (0.0010) [2023-12-26 05:11:40,035][123091] Updated weights for policy 0, policy_version 701964 (0.0009) [2023-12-26 05:11:40,139][123090] Updated weights for policy 1, policy_version 697478 (0.0009) [2023-12-26 05:11:40,203][123090] Updated weights for policy 1, policy_version 697488 (0.0010) [2023-12-26 05:11:40,257][123090] Updated weights for policy 1, policy_version 697498 (0.0009) [2023-12-26 05:11:40,921][123091] Updated weights for policy 0, policy_version 701974 (0.0009) [2023-12-26 05:11:40,970][123091] Updated weights for policy 0, policy_version 701984 (0.0009) [2023-12-26 05:11:41,027][123091] Updated weights for policy 0, policy_version 701994 (0.0009) [2023-12-26 05:11:41,061][123090] Updated weights for policy 1, policy_version 697508 (0.0010) [2023-12-26 05:11:41,137][123090] Updated weights for policy 1, policy_version 697518 (0.0010) [2023-12-26 05:11:41,195][123090] Updated weights for policy 1, policy_version 697528 (0.0009) [2023-12-26 05:11:41,942][123091] Updated weights for policy 0, policy_version 702004 (0.0008) [2023-12-26 05:11:41,996][123090] Updated weights for policy 1, policy_version 697538 (0.0008) [2023-12-26 05:11:42,007][123091] Updated weights for policy 0, policy_version 702014 (0.0010) [2023-12-26 05:11:42,060][123090] Updated weights for policy 1, policy_version 697548 (0.0007) [2023-12-26 05:11:42,070][123091] Updated weights for policy 0, policy_version 702024 (0.0009) [2023-12-26 05:11:42,117][123090] Updated weights for policy 1, policy_version 697558 (0.0007) [2023-12-26 05:11:42,182][123090] Updated weights for policy 1, policy_version 697568 (0.0010) [2023-12-26 05:11:42,948][123091] Updated weights for policy 0, policy_version 702034 (0.0010) [2023-12-26 05:11:42,984][123090] Updated weights for policy 1, policy_version 697578 (0.0007) [2023-12-26 05:11:43,008][123091] Updated weights for policy 0, policy_version 702044 (0.0009) [2023-12-26 05:11:43,040][123090] Updated weights for policy 1, policy_version 697588 (0.0006) [2023-12-26 05:11:43,068][123091] Updated weights for policy 0, policy_version 702054 (0.0009) [2023-12-26 05:11:43,095][123090] Updated weights for policy 1, policy_version 697598 (0.0008) [2023-12-26 05:11:43,129][123091] Updated weights for policy 0, policy_version 702064 (0.0008) [2023-12-26 05:11:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 358318080. Throughput: 0: 8593.1, 1: 8873.2. Samples: 358314936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:43,785][121949] Avg episode reward: [(0, '6034.791'), (1, '5761.356')] [2023-12-26 05:11:43,844][123090] Updated weights for policy 1, policy_version 697608 (0.0006) [2023-12-26 05:11:43,902][123090] Updated weights for policy 1, policy_version 697618 (0.0005) [2023-12-26 05:11:43,964][123091] Updated weights for policy 0, policy_version 702074 (0.0009) [2023-12-26 05:11:43,965][123090] Updated weights for policy 1, policy_version 697628 (0.0005) [2023-12-26 05:11:44,039][123091] Updated weights for policy 0, policy_version 702084 (0.0008) [2023-12-26 05:11:44,097][123091] Updated weights for policy 0, policy_version 702094 (0.0005) [2023-12-26 05:11:44,614][123090] Updated weights for policy 1, policy_version 697638 (0.0005) [2023-12-26 05:11:44,670][123090] Updated weights for policy 1, policy_version 697648 (0.0009) [2023-12-26 05:11:44,719][123090] Updated weights for policy 1, policy_version 697658 (0.0009) [2023-12-26 05:11:44,830][123091] Updated weights for policy 0, policy_version 702104 (0.0009) [2023-12-26 05:11:44,888][123091] Updated weights for policy 0, policy_version 702114 (0.0010) [2023-12-26 05:11:44,955][123091] Updated weights for policy 0, policy_version 702124 (0.0010) [2023-12-26 05:11:45,527][123090] Updated weights for policy 1, policy_version 697668 (0.0009) [2023-12-26 05:11:45,583][123090] Updated weights for policy 1, policy_version 697678 (0.0006) [2023-12-26 05:11:45,642][123090] Updated weights for policy 1, policy_version 697688 (0.0007) [2023-12-26 05:11:45,837][123091] Updated weights for policy 0, policy_version 702134 (0.0010) [2023-12-26 05:11:45,891][123091] Updated weights for policy 0, policy_version 702144 (0.0010) [2023-12-26 05:11:45,951][123091] Updated weights for policy 0, policy_version 702154 (0.0008) [2023-12-26 05:11:46,318][123090] Updated weights for policy 1, policy_version 697698 (0.0008) [2023-12-26 05:11:46,391][123090] Updated weights for policy 1, policy_version 697708 (0.0008) [2023-12-26 05:11:46,465][123090] Updated weights for policy 1, policy_version 697718 (0.0009) [2023-12-26 05:11:46,531][123090] Updated weights for policy 1, policy_version 697728 (0.0007) [2023-12-26 05:11:46,648][123091] Updated weights for policy 0, policy_version 702164 (0.0006) [2023-12-26 05:11:46,712][123091] Updated weights for policy 0, policy_version 702174 (0.0009) [2023-12-26 05:11:46,775][123091] Updated weights for policy 0, policy_version 702184 (0.0009) [2023-12-26 05:11:47,282][123090] Updated weights for policy 1, policy_version 697738 (0.0007) [2023-12-26 05:11:47,355][123090] Updated weights for policy 1, policy_version 697748 (0.0006) [2023-12-26 05:11:47,416][123090] Updated weights for policy 1, policy_version 697758 (0.0005) [2023-12-26 05:11:47,544][123091] Updated weights for policy 0, policy_version 702194 (0.0008) [2023-12-26 05:11:47,608][123091] Updated weights for policy 0, policy_version 702204 (0.0005) [2023-12-26 05:11:47,673][123091] Updated weights for policy 0, policy_version 702214 (0.0005) [2023-12-26 05:11:47,740][123091] Updated weights for policy 0, policy_version 702224 (0.0006) [2023-12-26 05:11:48,043][123090] Updated weights for policy 1, policy_version 697768 (0.0007) [2023-12-26 05:11:48,099][123090] Updated weights for policy 1, policy_version 697778 (0.0009) [2023-12-26 05:11:48,160][123090] Updated weights for policy 1, policy_version 697788 (0.0010) [2023-12-26 05:11:48,526][123091] Updated weights for policy 0, policy_version 702234 (0.0009) [2023-12-26 05:11:48,593][123091] Updated weights for policy 0, policy_version 702244 (0.0009) [2023-12-26 05:11:48,659][123091] Updated weights for policy 0, policy_version 702254 (0.0009) [2023-12-26 05:11:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 358416384. Throughput: 0: 8634.2, 1: 8986.5. Samples: 358426176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:48,785][121949] Avg episode reward: [(0, '6072.833'), (1, '5499.881')] [2023-12-26 05:11:48,945][123090] Updated weights for policy 1, policy_version 697798 (0.0009) [2023-12-26 05:11:49,002][123090] Updated weights for policy 1, policy_version 697808 (0.0009) [2023-12-26 05:11:49,067][123090] Updated weights for policy 1, policy_version 697818 (0.0007) [2023-12-26 05:11:49,489][123091] Updated weights for policy 0, policy_version 702264 (0.0009) [2023-12-26 05:11:49,542][123091] Updated weights for policy 0, policy_version 702274 (0.0009) [2023-12-26 05:11:49,599][123091] Updated weights for policy 0, policy_version 702284 (0.0009) [2023-12-26 05:11:49,883][123090] Updated weights for policy 1, policy_version 697828 (0.0010) [2023-12-26 05:11:49,948][123090] Updated weights for policy 1, policy_version 697838 (0.0008) [2023-12-26 05:11:50,018][123090] Updated weights for policy 1, policy_version 697848 (0.0010) [2023-12-26 05:11:50,467][123091] Updated weights for policy 0, policy_version 702294 (0.0010) [2023-12-26 05:11:50,532][123091] Updated weights for policy 0, policy_version 702304 (0.0008) [2023-12-26 05:11:50,596][123091] Updated weights for policy 0, policy_version 702314 (0.0009) [2023-12-26 05:11:50,874][123090] Updated weights for policy 1, policy_version 697858 (0.0010) [2023-12-26 05:11:50,931][123090] Updated weights for policy 1, policy_version 697868 (0.0008) [2023-12-26 05:11:50,991][123090] Updated weights for policy 1, policy_version 697878 (0.0005) [2023-12-26 05:11:51,057][123090] Updated weights for policy 1, policy_version 697888 (0.0007) [2023-12-26 05:11:51,411][123091] Updated weights for policy 0, policy_version 702324 (0.0010) [2023-12-26 05:11:51,479][123091] Updated weights for policy 0, policy_version 702334 (0.0009) [2023-12-26 05:11:51,545][123091] Updated weights for policy 0, policy_version 702344 (0.0009) [2023-12-26 05:11:51,865][123090] Updated weights for policy 1, policy_version 697898 (0.0005) [2023-12-26 05:11:51,934][123090] Updated weights for policy 1, policy_version 697908 (0.0009) [2023-12-26 05:11:52,005][123090] Updated weights for policy 1, policy_version 697918 (0.0008) [2023-12-26 05:11:52,400][123091] Updated weights for policy 0, policy_version 702354 (0.0011) [2023-12-26 05:11:52,464][123091] Updated weights for policy 0, policy_version 702364 (0.0011) [2023-12-26 05:11:52,520][123091] Updated weights for policy 0, policy_version 702374 (0.0011) [2023-12-26 05:11:52,581][123091] Updated weights for policy 0, policy_version 702384 (0.0011) [2023-12-26 05:11:52,797][123090] Updated weights for policy 1, policy_version 697928 (0.0011) [2023-12-26 05:11:52,867][123090] Updated weights for policy 1, policy_version 697938 (0.0009) [2023-12-26 05:11:52,926][123090] Updated weights for policy 1, policy_version 697948 (0.0010) [2023-12-26 05:11:53,410][123091] Updated weights for policy 0, policy_version 702394 (0.0010) [2023-12-26 05:11:53,457][123091] Updated weights for policy 0, policy_version 702404 (0.0010) [2023-12-26 05:11:53,505][123091] Updated weights for policy 0, policy_version 702414 (0.0010) [2023-12-26 05:11:53,741][123090] Updated weights for policy 1, policy_version 697958 (0.0007) [2023-12-26 05:11:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 358498304. Throughput: 0: 8643.4, 1: 8983.5. Samples: 358477340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:53,785][121949] Avg episode reward: [(0, '6114.924'), (1, '5153.256')] [2023-12-26 05:11:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000702416_179822592.pth... [2023-12-26 05:11:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000701392_179560448.pth [2023-12-26 05:11:53,798][123090] Updated weights for policy 1, policy_version 697968 (0.0005) [2023-12-26 05:11:53,867][123090] Updated weights for policy 1, policy_version 697978 (0.0005) [2023-12-26 05:11:53,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000697984_178683904.pth... [2023-12-26 05:11:53,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000696896_178405376.pth [2023-12-26 05:11:54,287][123091] Updated weights for policy 0, policy_version 702424 (0.0006) [2023-12-26 05:11:54,345][123091] Updated weights for policy 0, policy_version 702434 (0.0006) [2023-12-26 05:11:54,410][123091] Updated weights for policy 0, policy_version 702444 (0.0006) [2023-12-26 05:11:54,500][123090] Updated weights for policy 1, policy_version 697988 (0.0005) [2023-12-26 05:11:54,570][123090] Updated weights for policy 1, policy_version 697998 (0.0005) [2023-12-26 05:11:54,618][123090] Updated weights for policy 1, policy_version 698008 (0.0005) [2023-12-26 05:11:55,176][123091] Updated weights for policy 0, policy_version 702454 (0.0009) [2023-12-26 05:11:55,230][123091] Updated weights for policy 0, policy_version 702464 (0.0010) [2023-12-26 05:11:55,293][123091] Updated weights for policy 0, policy_version 702474 (0.0010) [2023-12-26 05:11:55,358][123090] Updated weights for policy 1, policy_version 698018 (0.0006) [2023-12-26 05:11:55,416][123090] Updated weights for policy 1, policy_version 698028 (0.0008) [2023-12-26 05:11:55,480][123090] Updated weights for policy 1, policy_version 698038 (0.0009) [2023-12-26 05:11:55,536][123090] Updated weights for policy 1, policy_version 698048 (0.0009) [2023-12-26 05:11:56,107][123091] Updated weights for policy 0, policy_version 702484 (0.0011) [2023-12-26 05:11:56,163][123091] Updated weights for policy 0, policy_version 702494 (0.0011) [2023-12-26 05:11:56,221][123091] Updated weights for policy 0, policy_version 702504 (0.0011) [2023-12-26 05:11:56,372][123090] Updated weights for policy 1, policy_version 698058 (0.0006) [2023-12-26 05:11:56,434][123090] Updated weights for policy 1, policy_version 698068 (0.0005) [2023-12-26 05:11:56,489][123090] Updated weights for policy 1, policy_version 698078 (0.0006) [2023-12-26 05:11:56,908][123091] Updated weights for policy 0, policy_version 702514 (0.0010) [2023-12-26 05:11:56,954][123091] Updated weights for policy 0, policy_version 702524 (0.0005) [2023-12-26 05:11:57,006][123091] Updated weights for policy 0, policy_version 702534 (0.0005) [2023-12-26 05:11:57,055][123091] Updated weights for policy 0, policy_version 702544 (0.0010) [2023-12-26 05:11:57,138][123090] Updated weights for policy 1, policy_version 698088 (0.0005) [2023-12-26 05:11:57,191][123090] Updated weights for policy 1, policy_version 698098 (0.0005) [2023-12-26 05:11:57,251][123090] Updated weights for policy 1, policy_version 698108 (0.0006) [2023-12-26 05:11:57,845][123091] Updated weights for policy 0, policy_version 702554 (0.0005) [2023-12-26 05:11:57,897][123091] Updated weights for policy 0, policy_version 702564 (0.0005) [2023-12-26 05:11:57,924][123090] Updated weights for policy 1, policy_version 698118 (0.0005) [2023-12-26 05:11:57,947][123091] Updated weights for policy 0, policy_version 702574 (0.0005) [2023-12-26 05:11:57,985][123090] Updated weights for policy 1, policy_version 698128 (0.0012) [2023-12-26 05:11:58,045][123090] Updated weights for policy 1, policy_version 698138 (0.0011) [2023-12-26 05:11:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17613.3, 300 sec: 17633.6). Total num frames: 358588416. Throughput: 0: 8712.3, 1: 9072.3. Samples: 358586764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:11:58,785][121949] Avg episode reward: [(0, '6202.140'), (1, '5192.610')] [2023-12-26 05:11:58,870][123091] Updated weights for policy 0, policy_version 702584 (0.0009) [2023-12-26 05:11:58,936][123091] Updated weights for policy 0, policy_version 702594 (0.0010) [2023-12-26 05:11:58,942][123090] Updated weights for policy 1, policy_version 698148 (0.0009) [2023-12-26 05:11:58,994][123091] Updated weights for policy 0, policy_version 702604 (0.0008) [2023-12-26 05:11:59,007][123090] Updated weights for policy 1, policy_version 698158 (0.0008) [2023-12-26 05:11:59,078][123090] Updated weights for policy 1, policy_version 698168 (0.0008) [2023-12-26 05:11:59,807][123091] Updated weights for policy 0, policy_version 702614 (0.0010) [2023-12-26 05:11:59,874][123091] Updated weights for policy 0, policy_version 702624 (0.0009) [2023-12-26 05:11:59,881][123090] Updated weights for policy 1, policy_version 698178 (0.0008) [2023-12-26 05:11:59,938][123090] Updated weights for policy 1, policy_version 698188 (0.0009) [2023-12-26 05:11:59,942][123091] Updated weights for policy 0, policy_version 702634 (0.0009) [2023-12-26 05:11:59,995][123090] Updated weights for policy 1, policy_version 698198 (0.0008) [2023-12-26 05:12:00,060][123090] Updated weights for policy 1, policy_version 698208 (0.0009) [2023-12-26 05:12:00,773][123091] Updated weights for policy 0, policy_version 702644 (0.0008) [2023-12-26 05:12:00,823][123091] Updated weights for policy 0, policy_version 702654 (0.0009) [2023-12-26 05:12:00,874][123091] Updated weights for policy 0, policy_version 702664 (0.0009) [2023-12-26 05:12:00,895][123090] Updated weights for policy 1, policy_version 698218 (0.0007) [2023-12-26 05:12:00,952][123090] Updated weights for policy 1, policy_version 698228 (0.0009) [2023-12-26 05:12:01,005][123090] Updated weights for policy 1, policy_version 698238 (0.0009) [2023-12-26 05:12:01,709][123091] Updated weights for policy 0, policy_version 702674 (0.0008) [2023-12-26 05:12:01,779][123091] Updated weights for policy 0, policy_version 702684 (0.0006) [2023-12-26 05:12:01,848][123091] Updated weights for policy 0, policy_version 702694 (0.0007) [2023-12-26 05:12:01,886][123090] Updated weights for policy 1, policy_version 698248 (0.0009) [2023-12-26 05:12:01,911][123091] Updated weights for policy 0, policy_version 702704 (0.0007) [2023-12-26 05:12:01,935][123090] Updated weights for policy 1, policy_version 698258 (0.0009) [2023-12-26 05:12:01,988][123090] Updated weights for policy 1, policy_version 698268 (0.0009) [2023-12-26 05:12:02,676][123091] Updated weights for policy 0, policy_version 702714 (0.0009) [2023-12-26 05:12:02,741][123091] Updated weights for policy 0, policy_version 702724 (0.0008) [2023-12-26 05:12:02,808][123091] Updated weights for policy 0, policy_version 702734 (0.0007) [2023-12-26 05:12:02,859][123090] Updated weights for policy 1, policy_version 698278 (0.0009) [2023-12-26 05:12:02,906][123090] Updated weights for policy 1, policy_version 698288 (0.0008) [2023-12-26 05:12:02,952][123090] Updated weights for policy 1, policy_version 698298 (0.0008) [2023-12-26 05:12:03,559][123091] Updated weights for policy 0, policy_version 702744 (0.0008) [2023-12-26 05:12:03,615][123091] Updated weights for policy 0, policy_version 702754 (0.0008) [2023-12-26 05:12:03,680][123091] Updated weights for policy 0, policy_version 702764 (0.0010) [2023-12-26 05:12:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 358678528. Throughput: 0: 8703.4, 1: 8963.6. Samples: 358688628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:03,784][121949] Avg episode reward: [(0, '6216.033'), (1, '4973.580')] [2023-12-26 05:12:03,809][123090] Updated weights for policy 1, policy_version 698308 (0.0009) [2023-12-26 05:12:03,868][123090] Updated weights for policy 1, policy_version 698318 (0.0010) [2023-12-26 05:12:03,925][123090] Updated weights for policy 1, policy_version 698328 (0.0010) [2023-12-26 05:12:04,536][123091] Updated weights for policy 0, policy_version 702774 (0.0010) [2023-12-26 05:12:04,592][123091] Updated weights for policy 0, policy_version 702784 (0.0009) [2023-12-26 05:12:04,658][123091] Updated weights for policy 0, policy_version 702794 (0.0009) [2023-12-26 05:12:04,774][123090] Updated weights for policy 1, policy_version 698338 (0.0009) [2023-12-26 05:12:04,824][123090] Updated weights for policy 1, policy_version 698348 (0.0005) [2023-12-26 05:12:04,871][123090] Updated weights for policy 1, policy_version 698358 (0.0005) [2023-12-26 05:12:04,931][123090] Updated weights for policy 1, policy_version 698368 (0.0005) [2023-12-26 05:12:05,534][123091] Updated weights for policy 0, policy_version 702804 (0.0009) [2023-12-26 05:12:05,599][123091] Updated weights for policy 0, policy_version 702814 (0.0009) [2023-12-26 05:12:05,668][123091] Updated weights for policy 0, policy_version 702824 (0.0010) [2023-12-26 05:12:05,673][123090] Updated weights for policy 1, policy_version 698378 (0.0007) [2023-12-26 05:12:05,741][123090] Updated weights for policy 1, policy_version 698388 (0.0011) [2023-12-26 05:12:05,805][123090] Updated weights for policy 1, policy_version 698398 (0.0008) [2023-12-26 05:12:06,521][123091] Updated weights for policy 0, policy_version 702834 (0.0009) [2023-12-26 05:12:06,575][123091] Updated weights for policy 0, policy_version 702844 (0.0009) [2023-12-26 05:12:06,606][123090] Updated weights for policy 1, policy_version 698408 (0.0008) [2023-12-26 05:12:06,645][123091] Updated weights for policy 0, policy_version 702854 (0.0008) [2023-12-26 05:12:06,668][123090] Updated weights for policy 1, policy_version 698418 (0.0009) [2023-12-26 05:12:06,716][123091] Updated weights for policy 0, policy_version 702864 (0.0007) [2023-12-26 05:12:06,724][123090] Updated weights for policy 1, policy_version 698428 (0.0008) [2023-12-26 05:12:07,468][123091] Updated weights for policy 0, policy_version 702874 (0.0005) [2023-12-26 05:12:07,472][123090] Updated weights for policy 1, policy_version 698438 (0.0007) [2023-12-26 05:12:07,532][123090] Updated weights for policy 1, policy_version 698448 (0.0005) [2023-12-26 05:12:07,543][123091] Updated weights for policy 0, policy_version 702884 (0.0008) [2023-12-26 05:12:07,603][123090] Updated weights for policy 1, policy_version 698458 (0.0006) [2023-12-26 05:12:07,609][123091] Updated weights for policy 0, policy_version 702894 (0.0008) [2023-12-26 05:12:08,288][123090] Updated weights for policy 1, policy_version 698468 (0.0006) [2023-12-26 05:12:08,351][123090] Updated weights for policy 1, policy_version 698478 (0.0009) [2023-12-26 05:12:08,414][123090] Updated weights for policy 1, policy_version 698488 (0.0010) [2023-12-26 05:12:08,434][123091] Updated weights for policy 0, policy_version 702904 (0.0010) [2023-12-26 05:12:08,501][123091] Updated weights for policy 0, policy_version 702914 (0.0011) [2023-12-26 05:12:08,568][123091] Updated weights for policy 0, policy_version 702924 (0.0011) [2023-12-26 05:12:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 358768640. Throughput: 0: 8701.0, 1: 9026.1. Samples: 358740360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:08,784][121949] Avg episode reward: [(0, '6191.549'), (1, '4996.652')] [2023-12-26 05:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000698496_178814976.pth... [2023-12-26 05:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000702928_179953664.pth... [2023-12-26 05:12:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000697440_178544640.pth [2023-12-26 05:12:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000701904_179691520.pth [2023-12-26 05:12:09,172][123090] Updated weights for policy 1, policy_version 698498 (0.0007) [2023-12-26 05:12:09,247][123090] Updated weights for policy 1, policy_version 698508 (0.0013) [2023-12-26 05:12:09,308][123090] Updated weights for policy 1, policy_version 698518 (0.0010) [2023-12-26 05:12:09,372][123090] Updated weights for policy 1, policy_version 698528 (0.0009) [2023-12-26 05:12:09,375][123091] Updated weights for policy 0, policy_version 702934 (0.0009) [2023-12-26 05:12:09,432][123091] Updated weights for policy 0, policy_version 702944 (0.0009) [2023-12-26 05:12:09,486][123091] Updated weights for policy 0, policy_version 702954 (0.0009) [2023-12-26 05:12:10,221][123090] Updated weights for policy 1, policy_version 698538 (0.0011) [2023-12-26 05:12:10,287][123090] Updated weights for policy 1, policy_version 698548 (0.0008) [2023-12-26 05:12:10,294][123091] Updated weights for policy 0, policy_version 702964 (0.0009) [2023-12-26 05:12:10,352][123090] Updated weights for policy 1, policy_version 698558 (0.0006) [2023-12-26 05:12:10,368][123091] Updated weights for policy 0, policy_version 702974 (0.0009) [2023-12-26 05:12:10,435][123091] Updated weights for policy 0, policy_version 702984 (0.0009) [2023-12-26 05:12:11,085][123090] Updated weights for policy 1, policy_version 698568 (0.0009) [2023-12-26 05:12:11,157][123090] Updated weights for policy 1, policy_version 698578 (0.0010) [2023-12-26 05:12:11,211][123091] Updated weights for policy 0, policy_version 702994 (0.0009) [2023-12-26 05:12:11,221][123090] Updated weights for policy 1, policy_version 698588 (0.0006) [2023-12-26 05:12:11,270][123091] Updated weights for policy 0, policy_version 703004 (0.0010) [2023-12-26 05:12:11,331][123091] Updated weights for policy 0, policy_version 703014 (0.0009) [2023-12-26 05:12:11,405][123091] Updated weights for policy 0, policy_version 703024 (0.0009) [2023-12-26 05:12:12,053][123090] Updated weights for policy 1, policy_version 698598 (0.0007) [2023-12-26 05:12:12,122][123090] Updated weights for policy 1, policy_version 698608 (0.0005) [2023-12-26 05:12:12,200][123090] Updated weights for policy 1, policy_version 698618 (0.0008) [2023-12-26 05:12:12,244][123091] Updated weights for policy 0, policy_version 703034 (0.0011) [2023-12-26 05:12:12,314][123091] Updated weights for policy 0, policy_version 703044 (0.0011) [2023-12-26 05:12:12,380][123091] Updated weights for policy 0, policy_version 703054 (0.0011) [2023-12-26 05:12:13,003][123090] Updated weights for policy 1, policy_version 698628 (0.0008) [2023-12-26 05:12:13,061][123090] Updated weights for policy 1, policy_version 698638 (0.0006) [2023-12-26 05:12:13,126][123090] Updated weights for policy 1, policy_version 698648 (0.0006) [2023-12-26 05:12:13,168][123091] Updated weights for policy 0, policy_version 703064 (0.0011) [2023-12-26 05:12:13,231][123091] Updated weights for policy 0, policy_version 703074 (0.0011) [2023-12-26 05:12:13,297][123091] Updated weights for policy 0, policy_version 703084 (0.0011) [2023-12-26 05:12:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 358850560. Throughput: 0: 8622.4, 1: 8974.0. Samples: 358845340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:13,785][121949] Avg episode reward: [(0, '6052.075'), (1, '5249.468')] [2023-12-26 05:12:13,917][123090] Updated weights for policy 1, policy_version 698658 (0.0006) [2023-12-26 05:12:13,977][123090] Updated weights for policy 1, policy_version 698668 (0.0006) [2023-12-26 05:12:14,049][123090] Updated weights for policy 1, policy_version 698678 (0.0005) [2023-12-26 05:12:14,090][123091] Updated weights for policy 0, policy_version 703094 (0.0011) [2023-12-26 05:12:14,113][123090] Updated weights for policy 1, policy_version 698688 (0.0007) [2023-12-26 05:12:14,149][123091] Updated weights for policy 0, policy_version 703104 (0.0010) [2023-12-26 05:12:14,208][123091] Updated weights for policy 0, policy_version 703114 (0.0010) [2023-12-26 05:12:14,842][123090] Updated weights for policy 1, policy_version 698698 (0.0011) [2023-12-26 05:12:14,906][123090] Updated weights for policy 1, policy_version 698708 (0.0010) [2023-12-26 05:12:14,973][123090] Updated weights for policy 1, policy_version 698718 (0.0010) [2023-12-26 05:12:14,988][123091] Updated weights for policy 0, policy_version 703124 (0.0009) [2023-12-26 05:12:15,041][123091] Updated weights for policy 0, policy_version 703134 (0.0006) [2023-12-26 05:12:15,102][123091] Updated weights for policy 0, policy_version 703144 (0.0005) [2023-12-26 05:12:15,700][123090] Updated weights for policy 1, policy_version 698728 (0.0006) [2023-12-26 05:12:15,751][123090] Updated weights for policy 1, policy_version 698738 (0.0007) [2023-12-26 05:12:15,800][123090] Updated weights for policy 1, policy_version 698748 (0.0010) [2023-12-26 05:12:15,854][123091] Updated weights for policy 0, policy_version 703154 (0.0006) [2023-12-26 05:12:15,920][123091] Updated weights for policy 0, policy_version 703164 (0.0007) [2023-12-26 05:12:15,977][123091] Updated weights for policy 0, policy_version 703174 (0.0009) [2023-12-26 05:12:16,024][123091] Updated weights for policy 0, policy_version 703184 (0.0009) [2023-12-26 05:12:16,625][123090] Updated weights for policy 1, policy_version 698758 (0.0010) [2023-12-26 05:12:16,683][123090] Updated weights for policy 1, policy_version 698768 (0.0005) [2023-12-26 05:12:16,732][123090] Updated weights for policy 1, policy_version 698778 (0.0005) [2023-12-26 05:12:16,853][123091] Updated weights for policy 0, policy_version 703194 (0.0011) [2023-12-26 05:12:16,907][123091] Updated weights for policy 0, policy_version 703204 (0.0011) [2023-12-26 05:12:16,955][123091] Updated weights for policy 0, policy_version 703214 (0.0010) [2023-12-26 05:12:17,501][123090] Updated weights for policy 1, policy_version 698788 (0.0007) [2023-12-26 05:12:17,560][123090] Updated weights for policy 1, policy_version 698798 (0.0010) [2023-12-26 05:12:17,626][123090] Updated weights for policy 1, policy_version 698808 (0.0010) [2023-12-26 05:12:17,719][123091] Updated weights for policy 0, policy_version 703224 (0.0007) [2023-12-26 05:12:17,776][123091] Updated weights for policy 0, policy_version 703234 (0.0005) [2023-12-26 05:12:17,834][123091] Updated weights for policy 0, policy_version 703244 (0.0005) [2023-12-26 05:12:18,437][123091] Updated weights for policy 0, policy_version 703254 (0.0009) [2023-12-26 05:12:18,439][123090] Updated weights for policy 1, policy_version 698818 (0.0010) [2023-12-26 05:12:18,498][123091] Updated weights for policy 0, policy_version 703264 (0.0011) [2023-12-26 05:12:18,503][123090] Updated weights for policy 1, policy_version 698828 (0.0011) [2023-12-26 05:12:18,562][123091] Updated weights for policy 0, policy_version 703274 (0.0007) [2023-12-26 05:12:18,567][123090] Updated weights for policy 1, policy_version 698838 (0.0011) [2023-12-26 05:12:18,638][123090] Updated weights for policy 1, policy_version 698848 (0.0011) [2023-12-26 05:12:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 358948864. Throughput: 0: 8699.7, 1: 8955.9. Samples: 358954724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:18,785][121949] Avg episode reward: [(0, '6119.017'), (1, '5329.117')] [2023-12-26 05:12:19,264][123091] Updated weights for policy 0, policy_version 703284 (0.0007) [2023-12-26 05:12:19,319][123091] Updated weights for policy 0, policy_version 703294 (0.0008) [2023-12-26 05:12:19,385][123091] Updated weights for policy 0, policy_version 703304 (0.0008) [2023-12-26 05:12:19,448][123090] Updated weights for policy 1, policy_version 698858 (0.0011) [2023-12-26 05:12:19,513][123090] Updated weights for policy 1, policy_version 698868 (0.0011) [2023-12-26 05:12:19,565][123090] Updated weights for policy 1, policy_version 698878 (0.0010) [2023-12-26 05:12:20,228][123091] Updated weights for policy 0, policy_version 703314 (0.0009) [2023-12-26 05:12:20,277][123091] Updated weights for policy 0, policy_version 703324 (0.0008) [2023-12-26 05:12:20,349][123091] Updated weights for policy 0, policy_version 703334 (0.0007) [2023-12-26 05:12:20,378][123090] Updated weights for policy 1, policy_version 698888 (0.0007) [2023-12-26 05:12:20,413][123091] Updated weights for policy 0, policy_version 703344 (0.0011) [2023-12-26 05:12:20,443][123090] Updated weights for policy 1, policy_version 698898 (0.0008) [2023-12-26 05:12:20,508][123090] Updated weights for policy 1, policy_version 698908 (0.0007) [2023-12-26 05:12:21,221][123090] Updated weights for policy 1, policy_version 698918 (0.0008) [2023-12-26 05:12:21,294][123090] Updated weights for policy 1, policy_version 698928 (0.0009) [2023-12-26 05:12:21,302][123091] Updated weights for policy 0, policy_version 703354 (0.0008) [2023-12-26 05:12:21,364][123091] Updated weights for policy 0, policy_version 703364 (0.0010) [2023-12-26 05:12:21,366][123090] Updated weights for policy 1, policy_version 698938 (0.0009) [2023-12-26 05:12:21,432][123091] Updated weights for policy 0, policy_version 703374 (0.0009) [2023-12-26 05:12:22,212][123090] Updated weights for policy 1, policy_version 698948 (0.0010) [2023-12-26 05:12:22,272][123090] Updated weights for policy 1, policy_version 698958 (0.0011) [2023-12-26 05:12:22,275][123091] Updated weights for policy 0, policy_version 703384 (0.0008) [2023-12-26 05:12:22,341][123090] Updated weights for policy 1, policy_version 698968 (0.0011) [2023-12-26 05:12:22,344][123091] Updated weights for policy 0, policy_version 703394 (0.0007) [2023-12-26 05:12:22,407][123091] Updated weights for policy 0, policy_version 703404 (0.0008) [2023-12-26 05:12:23,193][123090] Updated weights for policy 1, policy_version 698978 (0.0011) [2023-12-26 05:12:23,248][123090] Updated weights for policy 1, policy_version 698988 (0.0010) [2023-12-26 05:12:23,259][123091] Updated weights for policy 0, policy_version 703414 (0.0007) [2023-12-26 05:12:23,304][123090] Updated weights for policy 1, policy_version 698998 (0.0010) [2023-12-26 05:12:23,328][123091] Updated weights for policy 0, policy_version 703424 (0.0006) [2023-12-26 05:12:23,368][123090] Updated weights for policy 1, policy_version 699008 (0.0010) [2023-12-26 05:12:23,393][123091] Updated weights for policy 0, policy_version 703434 (0.0006) [2023-12-26 05:12:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 359030784. Throughput: 0: 8698.6, 1: 8945.9. Samples: 359007116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:23,785][121949] Avg episode reward: [(0, '6271.873'), (1, '5403.447')] [2023-12-26 05:12:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000703440_180084736.pth... [2023-12-26 05:12:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000699008_178946048.pth... [2023-12-26 05:12:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000702416_179822592.pth [2023-12-26 05:12:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000697984_178683904.pth [2023-12-26 05:12:24,182][123090] Updated weights for policy 1, policy_version 699018 (0.0010) [2023-12-26 05:12:24,231][123090] Updated weights for policy 1, policy_version 699028 (0.0009) [2023-12-26 05:12:24,268][123091] Updated weights for policy 0, policy_version 703444 (0.0009) [2023-12-26 05:12:24,286][123090] Updated weights for policy 1, policy_version 699038 (0.0009) [2023-12-26 05:12:24,317][123091] Updated weights for policy 0, policy_version 703454 (0.0009) [2023-12-26 05:12:24,372][123091] Updated weights for policy 0, policy_version 703464 (0.0009) [2023-12-26 05:12:25,162][123090] Updated weights for policy 1, policy_version 699048 (0.0009) [2023-12-26 05:12:25,219][123091] Updated weights for policy 0, policy_version 703474 (0.0008) [2023-12-26 05:12:25,223][123090] Updated weights for policy 1, policy_version 699058 (0.0009) [2023-12-26 05:12:25,271][123090] Updated weights for policy 1, policy_version 699068 (0.0008) [2023-12-26 05:12:25,279][123091] Updated weights for policy 0, policy_version 703484 (0.0005) [2023-12-26 05:12:25,347][123091] Updated weights for policy 0, policy_version 703494 (0.0005) [2023-12-26 05:12:25,411][123091] Updated weights for policy 0, policy_version 703504 (0.0006) [2023-12-26 05:12:26,107][123090] Updated weights for policy 1, policy_version 699079 (0.0009) [2023-12-26 05:12:26,172][123090] Updated weights for policy 1, policy_version 699089 (0.0009) [2023-12-26 05:12:26,184][123091] Updated weights for policy 0, policy_version 703514 (0.0007) [2023-12-26 05:12:26,224][123090] Updated weights for policy 1, policy_version 699099 (0.0007) [2023-12-26 05:12:26,231][123091] Updated weights for policy 0, policy_version 703524 (0.0009) [2023-12-26 05:12:26,289][123091] Updated weights for policy 0, policy_version 703534 (0.0008) [2023-12-26 05:12:26,857][123090] Updated weights for policy 1, policy_version 699109 (0.0007) [2023-12-26 05:12:26,907][123090] Updated weights for policy 1, policy_version 699119 (0.0005) [2023-12-26 05:12:26,958][123090] Updated weights for policy 1, policy_version 699129 (0.0005) [2023-12-26 05:12:27,218][123091] Updated weights for policy 0, policy_version 703544 (0.0010) [2023-12-26 05:12:27,269][123091] Updated weights for policy 0, policy_version 703554 (0.0009) [2023-12-26 05:12:27,319][123091] Updated weights for policy 0, policy_version 703564 (0.0009) [2023-12-26 05:12:27,687][123090] Updated weights for policy 1, policy_version 699139 (0.0007) [2023-12-26 05:12:27,744][123090] Updated weights for policy 1, policy_version 699149 (0.0009) [2023-12-26 05:12:27,793][123090] Updated weights for policy 1, policy_version 699159 (0.0009) [2023-12-26 05:12:28,186][123091] Updated weights for policy 0, policy_version 703574 (0.0011) [2023-12-26 05:12:28,241][123091] Updated weights for policy 0, policy_version 703585 (0.0009) [2023-12-26 05:12:28,295][123091] Updated weights for policy 0, policy_version 703595 (0.0010) [2023-12-26 05:12:28,579][123090] Updated weights for policy 1, policy_version 699169 (0.0009) [2023-12-26 05:12:28,648][123090] Updated weights for policy 1, policy_version 699179 (0.0008) [2023-12-26 05:12:28,709][123090] Updated weights for policy 1, policy_version 699189 (0.0008) [2023-12-26 05:12:28,771][123090] Updated weights for policy 1, policy_version 699199 (0.0005) [2023-12-26 05:12:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 359120896. Throughput: 0: 8701.4, 1: 8989.4. Samples: 359111024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:28,785][121949] Avg episode reward: [(0, '6269.132'), (1, '5510.940')] [2023-12-26 05:12:29,225][123091] Updated weights for policy 0, policy_version 703605 (0.0009) [2023-12-26 05:12:29,285][123091] Updated weights for policy 0, policy_version 703615 (0.0010) [2023-12-26 05:12:29,342][123091] Updated weights for policy 0, policy_version 703625 (0.0009) [2023-12-26 05:12:29,512][123090] Updated weights for policy 1, policy_version 699209 (0.0009) [2023-12-26 05:12:29,577][123090] Updated weights for policy 1, policy_version 699219 (0.0010) [2023-12-26 05:12:29,646][123090] Updated weights for policy 1, policy_version 699229 (0.0009) [2023-12-26 05:12:30,177][123091] Updated weights for policy 0, policy_version 703635 (0.0009) [2023-12-26 05:12:30,229][123091] Updated weights for policy 0, policy_version 703645 (0.0009) [2023-12-26 05:12:30,279][123091] Updated weights for policy 0, policy_version 703655 (0.0009) [2023-12-26 05:12:30,463][123090] Updated weights for policy 1, policy_version 699239 (0.0009) [2023-12-26 05:12:30,523][123090] Updated weights for policy 1, policy_version 699249 (0.0006) [2023-12-26 05:12:30,578][123090] Updated weights for policy 1, policy_version 699259 (0.0006) [2023-12-26 05:12:31,155][123091] Updated weights for policy 0, policy_version 703665 (0.0009) [2023-12-26 05:12:31,213][123091] Updated weights for policy 0, policy_version 703675 (0.0010) [2023-12-26 05:12:31,274][123091] Updated weights for policy 0, policy_version 703685 (0.0010) [2023-12-26 05:12:31,295][123090] Updated weights for policy 1, policy_version 699269 (0.0007) [2023-12-26 05:12:31,337][123091] Updated weights for policy 0, policy_version 703695 (0.0008) [2023-12-26 05:12:31,361][123090] Updated weights for policy 1, policy_version 699279 (0.0007) [2023-12-26 05:12:31,429][123090] Updated weights for policy 1, policy_version 699289 (0.0010) [2023-12-26 05:12:32,168][123091] Updated weights for policy 0, policy_version 703705 (0.0009) [2023-12-26 05:12:32,220][123091] Updated weights for policy 0, policy_version 703715 (0.0009) [2023-12-26 05:12:32,247][123090] Updated weights for policy 1, policy_version 699299 (0.0009) [2023-12-26 05:12:32,276][123091] Updated weights for policy 0, policy_version 703725 (0.0007) [2023-12-26 05:12:32,308][123090] Updated weights for policy 1, policy_version 699309 (0.0009) [2023-12-26 05:12:32,373][123090] Updated weights for policy 1, policy_version 699319 (0.0008) [2023-12-26 05:12:33,154][123091] Updated weights for policy 0, policy_version 703735 (0.0010) [2023-12-26 05:12:33,199][123090] Updated weights for policy 1, policy_version 699329 (0.0009) [2023-12-26 05:12:33,201][123091] Updated weights for policy 0, policy_version 703745 (0.0010) [2023-12-26 05:12:33,250][123090] Updated weights for policy 1, policy_version 699339 (0.0005) [2023-12-26 05:12:33,252][123091] Updated weights for policy 0, policy_version 703755 (0.0010) [2023-12-26 05:12:33,299][123090] Updated weights for policy 1, policy_version 699349 (0.0007) [2023-12-26 05:12:33,346][123090] Updated weights for policy 1, policy_version 699359 (0.0008) [2023-12-26 05:12:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 359202816. Throughput: 0: 8629.9, 1: 8877.0. Samples: 359213992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:33,785][121949] Avg episode reward: [(0, '6274.929'), (1, '5604.581')] [2023-12-26 05:12:33,963][123091] Updated weights for policy 0, policy_version 703765 (0.0008) [2023-12-26 05:12:34,014][123091] Updated weights for policy 0, policy_version 703775 (0.0005) [2023-12-26 05:12:34,065][123091] Updated weights for policy 0, policy_version 703785 (0.0005) [2023-12-26 05:12:34,214][123090] Updated weights for policy 1, policy_version 699369 (0.0008) [2023-12-26 05:12:34,276][123090] Updated weights for policy 1, policy_version 699379 (0.0008) [2023-12-26 05:12:34,337][123090] Updated weights for policy 1, policy_version 699389 (0.0005) [2023-12-26 05:12:34,756][123091] Updated weights for policy 0, policy_version 703795 (0.0006) [2023-12-26 05:12:34,824][123091] Updated weights for policy 0, policy_version 703805 (0.0008) [2023-12-26 05:12:34,888][123091] Updated weights for policy 0, policy_version 703815 (0.0008) [2023-12-26 05:12:35,174][123090] Updated weights for policy 1, policy_version 699399 (0.0011) [2023-12-26 05:12:35,233][123090] Updated weights for policy 1, policy_version 699409 (0.0010) [2023-12-26 05:12:35,296][123090] Updated weights for policy 1, policy_version 699419 (0.0010) [2023-12-26 05:12:35,617][123091] Updated weights for policy 0, policy_version 703825 (0.0008) [2023-12-26 05:12:35,687][123091] Updated weights for policy 0, policy_version 703835 (0.0006) [2023-12-26 05:12:35,749][123091] Updated weights for policy 0, policy_version 703845 (0.0010) [2023-12-26 05:12:35,816][123091] Updated weights for policy 0, policy_version 703855 (0.0011) [2023-12-26 05:12:36,128][123090] Updated weights for policy 1, policy_version 699429 (0.0010) [2023-12-26 05:12:36,190][123090] Updated weights for policy 1, policy_version 699439 (0.0010) [2023-12-26 05:12:36,249][123090] Updated weights for policy 1, policy_version 699449 (0.0010) [2023-12-26 05:12:36,528][123091] Updated weights for policy 0, policy_version 703865 (0.0006) [2023-12-26 05:12:36,600][123091] Updated weights for policy 0, policy_version 703875 (0.0005) [2023-12-26 05:12:36,670][123091] Updated weights for policy 0, policy_version 703885 (0.0005) [2023-12-26 05:12:37,142][123090] Updated weights for policy 1, policy_version 699459 (0.0009) [2023-12-26 05:12:37,199][123090] Updated weights for policy 1, policy_version 699469 (0.0005) [2023-12-26 05:12:37,250][123090] Updated weights for policy 1, policy_version 699479 (0.0007) [2023-12-26 05:12:37,307][123091] Updated weights for policy 0, policy_version 703895 (0.0005) [2023-12-26 05:12:37,379][123091] Updated weights for policy 0, policy_version 703905 (0.0005) [2023-12-26 05:12:37,456][123091] Updated weights for policy 0, policy_version 703915 (0.0008) [2023-12-26 05:12:37,947][123090] Updated weights for policy 1, policy_version 699489 (0.0007) [2023-12-26 05:12:38,003][123090] Updated weights for policy 1, policy_version 699499 (0.0010) [2023-12-26 05:12:38,051][123090] Updated weights for policy 1, policy_version 699509 (0.0010) [2023-12-26 05:12:38,118][123090] Updated weights for policy 1, policy_version 699519 (0.0010) [2023-12-26 05:12:38,182][123091] Updated weights for policy 0, policy_version 703925 (0.0008) [2023-12-26 05:12:38,233][123091] Updated weights for policy 0, policy_version 703935 (0.0005) [2023-12-26 05:12:38,302][123091] Updated weights for policy 0, policy_version 703945 (0.0009) [2023-12-26 05:12:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 359292928. Throughput: 0: 8722.0, 1: 8865.3. Samples: 359268772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:38,785][121949] Avg episode reward: [(0, '6253.622'), (1, '5727.993')] [2023-12-26 05:12:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000703952_180215808.pth... [2023-12-26 05:12:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000699520_179077120.pth... [2023-12-26 05:12:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000702928_179953664.pth [2023-12-26 05:12:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000698496_178814976.pth [2023-12-26 05:12:38,924][123090] Updated weights for policy 1, policy_version 699529 (0.0010) [2023-12-26 05:12:38,946][123091] Updated weights for policy 0, policy_version 703955 (0.0007) [2023-12-26 05:12:38,985][123090] Updated weights for policy 1, policy_version 699539 (0.0010) [2023-12-26 05:12:39,006][123091] Updated weights for policy 0, policy_version 703965 (0.0005) [2023-12-26 05:12:39,044][123090] Updated weights for policy 1, policy_version 699549 (0.0007) [2023-12-26 05:12:39,060][123091] Updated weights for policy 0, policy_version 703975 (0.0005) [2023-12-26 05:12:39,768][123091] Updated weights for policy 0, policy_version 703985 (0.0006) [2023-12-26 05:12:39,836][123091] Updated weights for policy 0, policy_version 703995 (0.0010) [2023-12-26 05:12:39,860][123090] Updated weights for policy 1, policy_version 699559 (0.0009) [2023-12-26 05:12:39,909][123091] Updated weights for policy 0, policy_version 704005 (0.0007) [2023-12-26 05:12:39,931][123090] Updated weights for policy 1, policy_version 699569 (0.0011) [2023-12-26 05:12:39,977][123091] Updated weights for policy 0, policy_version 704015 (0.0007) [2023-12-26 05:12:39,996][123090] Updated weights for policy 1, policy_version 699579 (0.0011) [2023-12-26 05:12:40,654][123090] Updated weights for policy 1, policy_version 699589 (0.0007) [2023-12-26 05:12:40,691][123091] Updated weights for policy 0, policy_version 704025 (0.0008) [2023-12-26 05:12:40,701][123090] Updated weights for policy 1, policy_version 699599 (0.0006) [2023-12-26 05:12:40,755][123091] Updated weights for policy 0, policy_version 704035 (0.0007) [2023-12-26 05:12:40,761][123090] Updated weights for policy 1, policy_version 699609 (0.0006) [2023-12-26 05:12:40,811][123091] Updated weights for policy 0, policy_version 704045 (0.0006) [2023-12-26 05:12:41,558][123090] Updated weights for policy 1, policy_version 699619 (0.0008) [2023-12-26 05:12:41,621][123090] Updated weights for policy 1, policy_version 699629 (0.0007) [2023-12-26 05:12:41,650][123091] Updated weights for policy 0, policy_version 704055 (0.0008) [2023-12-26 05:12:41,692][123090] Updated weights for policy 1, policy_version 699639 (0.0011) [2023-12-26 05:12:41,721][123091] Updated weights for policy 0, policy_version 704065 (0.0008) [2023-12-26 05:12:41,798][123091] Updated weights for policy 0, policy_version 704076 (0.0008) [2023-12-26 05:12:42,527][123090] Updated weights for policy 1, policy_version 699649 (0.0010) [2023-12-26 05:12:42,553][123091] Updated weights for policy 0, policy_version 704086 (0.0009) [2023-12-26 05:12:42,592][123090] Updated weights for policy 1, policy_version 699659 (0.0011) [2023-12-26 05:12:42,610][123091] Updated weights for policy 0, policy_version 704096 (0.0011) [2023-12-26 05:12:42,660][123090] Updated weights for policy 1, policy_version 699669 (0.0011) [2023-12-26 05:12:42,671][123091] Updated weights for policy 0, policy_version 704106 (0.0006) [2023-12-26 05:12:42,723][123090] Updated weights for policy 1, policy_version 699679 (0.0011) [2023-12-26 05:12:43,413][123091] Updated weights for policy 0, policy_version 704116 (0.0007) [2023-12-26 05:12:43,449][123090] Updated weights for policy 1, policy_version 699689 (0.0007) [2023-12-26 05:12:43,465][123091] Updated weights for policy 0, policy_version 704126 (0.0006) [2023-12-26 05:12:43,514][123090] Updated weights for policy 1, policy_version 699699 (0.0008) [2023-12-26 05:12:43,520][123091] Updated weights for policy 0, policy_version 704136 (0.0009) [2023-12-26 05:12:43,574][123090] Updated weights for policy 1, policy_version 699709 (0.0008) [2023-12-26 05:12:43,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 359391232. Throughput: 0: 8790.1, 1: 8838.9. Samples: 359380064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:43,784][121949] Avg episode reward: [(0, '6227.900'), (1, '5830.855')] [2023-12-26 05:12:44,275][123091] Updated weights for policy 0, policy_version 704146 (0.0009) [2023-12-26 05:12:44,320][123091] Updated weights for policy 0, policy_version 704156 (0.0006) [2023-12-26 05:12:44,366][123091] Updated weights for policy 0, policy_version 704166 (0.0008) [2023-12-26 05:12:44,392][123090] Updated weights for policy 1, policy_version 699719 (0.0010) [2023-12-26 05:12:44,420][123091] Updated weights for policy 0, policy_version 704176 (0.0007) [2023-12-26 05:12:44,448][123090] Updated weights for policy 1, policy_version 699729 (0.0010) [2023-12-26 05:12:44,514][123090] Updated weights for policy 1, policy_version 699739 (0.0010) [2023-12-26 05:12:45,191][123091] Updated weights for policy 0, policy_version 704186 (0.0011) [2023-12-26 05:12:45,255][123091] Updated weights for policy 0, policy_version 704196 (0.0011) [2023-12-26 05:12:45,323][123091] Updated weights for policy 0, policy_version 704206 (0.0011) [2023-12-26 05:12:45,339][123090] Updated weights for policy 1, policy_version 699749 (0.0009) [2023-12-26 05:12:45,402][123090] Updated weights for policy 1, policy_version 699759 (0.0009) [2023-12-26 05:12:45,467][123090] Updated weights for policy 1, policy_version 699769 (0.0009) [2023-12-26 05:12:46,132][123091] Updated weights for policy 0, policy_version 704216 (0.0010) [2023-12-26 05:12:46,175][123091] Updated weights for policy 0, policy_version 704226 (0.0010) [2023-12-26 05:12:46,212][123090] Updated weights for policy 1, policy_version 699779 (0.0009) [2023-12-26 05:12:46,233][123091] Updated weights for policy 0, policy_version 704236 (0.0010) [2023-12-26 05:12:46,264][123090] Updated weights for policy 1, policy_version 699789 (0.0005) [2023-12-26 05:12:46,314][123090] Updated weights for policy 1, policy_version 699799 (0.0005) [2023-12-26 05:12:47,043][123091] Updated weights for policy 0, policy_version 704246 (0.0007) [2023-12-26 05:12:47,082][123090] Updated weights for policy 1, policy_version 699809 (0.0006) [2023-12-26 05:12:47,091][123091] Updated weights for policy 0, policy_version 704256 (0.0005) [2023-12-26 05:12:47,142][123090] Updated weights for policy 1, policy_version 699819 (0.0010) [2023-12-26 05:12:47,147][123091] Updated weights for policy 0, policy_version 704266 (0.0005) [2023-12-26 05:12:47,208][123090] Updated weights for policy 1, policy_version 699829 (0.0011) [2023-12-26 05:12:47,271][123090] Updated weights for policy 1, policy_version 699839 (0.0010) [2023-12-26 05:12:47,878][123091] Updated weights for policy 0, policy_version 704276 (0.0006) [2023-12-26 05:12:47,935][123091] Updated weights for policy 0, policy_version 704286 (0.0005) [2023-12-26 05:12:47,941][123090] Updated weights for policy 1, policy_version 699849 (0.0006) [2023-12-26 05:12:47,987][123091] Updated weights for policy 0, policy_version 704296 (0.0005) [2023-12-26 05:12:47,994][123090] Updated weights for policy 1, policy_version 699859 (0.0005) [2023-12-26 05:12:48,052][123090] Updated weights for policy 1, policy_version 699869 (0.0006) [2023-12-26 05:12:48,700][123091] Updated weights for policy 0, policy_version 704306 (0.0007) [2023-12-26 05:12:48,771][123091] Updated weights for policy 0, policy_version 704316 (0.0010) [2023-12-26 05:12:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 359473152. Throughput: 0: 8890.0, 1: 8934.5. Samples: 359490728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:48,785][121949] Avg episode reward: [(0, '6203.962'), (1, '5900.921')] [2023-12-26 05:12:48,804][123090] Updated weights for policy 1, policy_version 699879 (0.0007) [2023-12-26 05:12:48,833][123091] Updated weights for policy 0, policy_version 704326 (0.0009) [2023-12-26 05:12:48,858][123090] Updated weights for policy 1, policy_version 699889 (0.0006) [2023-12-26 05:12:48,894][123091] Updated weights for policy 0, policy_version 704336 (0.0008) [2023-12-26 05:12:48,928][123090] Updated weights for policy 1, policy_version 699899 (0.0009) [2023-12-26 05:12:49,673][123090] Updated weights for policy 1, policy_version 699909 (0.0008) [2023-12-26 05:12:49,738][123090] Updated weights for policy 1, policy_version 699919 (0.0006) [2023-12-26 05:12:49,760][123091] Updated weights for policy 0, policy_version 704346 (0.0007) [2023-12-26 05:12:49,787][123090] Updated weights for policy 1, policy_version 699929 (0.0010) [2023-12-26 05:12:49,814][123091] Updated weights for policy 0, policy_version 704356 (0.0008) [2023-12-26 05:12:49,882][123091] Updated weights for policy 0, policy_version 704366 (0.0011) [2023-12-26 05:12:50,510][123090] Updated weights for policy 1, policy_version 699939 (0.0009) [2023-12-26 05:12:50,559][123090] Updated weights for policy 1, policy_version 699949 (0.0006) [2023-12-26 05:12:50,627][123090] Updated weights for policy 1, policy_version 699959 (0.0010) [2023-12-26 05:12:50,641][123091] Updated weights for policy 0, policy_version 704376 (0.0008) [2023-12-26 05:12:50,694][123091] Updated weights for policy 0, policy_version 704386 (0.0011) [2023-12-26 05:12:50,756][123091] Updated weights for policy 0, policy_version 704396 (0.0006) [2023-12-26 05:12:51,324][123090] Updated weights for policy 1, policy_version 699969 (0.0011) [2023-12-26 05:12:51,401][123090] Updated weights for policy 1, policy_version 699980 (0.0011) [2023-12-26 05:12:51,476][123090] Updated weights for policy 1, policy_version 699990 (0.0010) [2023-12-26 05:12:51,546][123090] Updated weights for policy 1, policy_version 700000 (0.0011) [2023-12-26 05:12:51,618][123091] Updated weights for policy 0, policy_version 704406 (0.0009) [2023-12-26 05:12:51,681][123091] Updated weights for policy 0, policy_version 704416 (0.0009) [2023-12-26 05:12:51,748][123091] Updated weights for policy 0, policy_version 704426 (0.0008) [2023-12-26 05:12:52,391][123090] Updated weights for policy 1, policy_version 700010 (0.0010) [2023-12-26 05:12:52,451][123090] Updated weights for policy 1, policy_version 700020 (0.0011) [2023-12-26 05:12:52,503][123090] Updated weights for policy 1, policy_version 700030 (0.0010) [2023-12-26 05:12:52,598][123091] Updated weights for policy 0, policy_version 704436 (0.0009) [2023-12-26 05:12:52,663][123091] Updated weights for policy 0, policy_version 704446 (0.0009) [2023-12-26 05:12:52,711][123091] Updated weights for policy 0, policy_version 704456 (0.0009) [2023-12-26 05:12:53,331][123090] Updated weights for policy 1, policy_version 700040 (0.0006) [2023-12-26 05:12:53,385][123090] Updated weights for policy 1, policy_version 700050 (0.0005) [2023-12-26 05:12:53,458][123090] Updated weights for policy 1, policy_version 700060 (0.0009) [2023-12-26 05:12:53,554][123091] Updated weights for policy 0, policy_version 704466 (0.0009) [2023-12-26 05:12:53,607][123091] Updated weights for policy 0, policy_version 704476 (0.0009) [2023-12-26 05:12:53,656][123091] Updated weights for policy 0, policy_version 704486 (0.0009) [2023-12-26 05:12:53,707][123091] Updated weights for policy 0, policy_version 704496 (0.0009) [2023-12-26 05:12:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.3). Total num frames: 359571456. Throughput: 0: 8909.0, 1: 8958.5. Samples: 359544396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:53,784][121949] Avg episode reward: [(0, '6212.753'), (1, '5910.424')] [2023-12-26 05:12:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000700064_179216384.pth... [2023-12-26 05:12:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000704496_180355072.pth... [2023-12-26 05:12:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000699008_178946048.pth [2023-12-26 05:12:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000703440_180084736.pth [2023-12-26 05:12:54,238][123090] Updated weights for policy 1, policy_version 700070 (0.0007) [2023-12-26 05:12:54,304][123090] Updated weights for policy 1, policy_version 700080 (0.0009) [2023-12-26 05:12:54,373][123090] Updated weights for policy 1, policy_version 700090 (0.0009) [2023-12-26 05:12:54,506][123091] Updated weights for policy 0, policy_version 704506 (0.0009) [2023-12-26 05:12:54,566][123091] Updated weights for policy 0, policy_version 704516 (0.0009) [2023-12-26 05:12:54,621][123091] Updated weights for policy 0, policy_version 704526 (0.0009) [2023-12-26 05:12:55,166][123090] Updated weights for policy 1, policy_version 700100 (0.0009) [2023-12-26 05:12:55,245][123090] Updated weights for policy 1, policy_version 700110 (0.0005) [2023-12-26 05:12:55,303][123090] Updated weights for policy 1, policy_version 700120 (0.0006) [2023-12-26 05:12:55,434][123091] Updated weights for policy 0, policy_version 704536 (0.0006) [2023-12-26 05:12:55,491][123091] Updated weights for policy 0, policy_version 704546 (0.0006) [2023-12-26 05:12:55,543][123091] Updated weights for policy 0, policy_version 704556 (0.0006) [2023-12-26 05:12:56,034][123090] Updated weights for policy 1, policy_version 700130 (0.0005) [2023-12-26 05:12:56,091][123090] Updated weights for policy 1, policy_version 700140 (0.0005) [2023-12-26 05:12:56,148][123090] Updated weights for policy 1, policy_version 700150 (0.0007) [2023-12-26 05:12:56,207][123090] Updated weights for policy 1, policy_version 700160 (0.0005) [2023-12-26 05:12:56,284][123091] Updated weights for policy 0, policy_version 704566 (0.0006) [2023-12-26 05:12:56,338][123091] Updated weights for policy 0, policy_version 704576 (0.0007) [2023-12-26 05:12:56,393][123091] Updated weights for policy 0, policy_version 704586 (0.0009) [2023-12-26 05:12:56,988][123090] Updated weights for policy 1, policy_version 700170 (0.0005) [2023-12-26 05:12:57,052][123090] Updated weights for policy 1, policy_version 700180 (0.0005) [2023-12-26 05:12:57,115][123090] Updated weights for policy 1, policy_version 700190 (0.0005) [2023-12-26 05:12:57,116][123091] Updated weights for policy 0, policy_version 704596 (0.0010) [2023-12-26 05:12:57,169][123091] Updated weights for policy 0, policy_version 704606 (0.0009) [2023-12-26 05:12:57,226][123091] Updated weights for policy 0, policy_version 704616 (0.0010) [2023-12-26 05:12:57,701][123090] Updated weights for policy 1, policy_version 700200 (0.0005) [2023-12-26 05:12:57,769][123090] Updated weights for policy 1, policy_version 700210 (0.0005) [2023-12-26 05:12:57,836][123090] Updated weights for policy 1, policy_version 700220 (0.0005) [2023-12-26 05:12:58,150][123091] Updated weights for policy 0, policy_version 704626 (0.0010) [2023-12-26 05:12:58,222][123091] Updated weights for policy 0, policy_version 704636 (0.0010) [2023-12-26 05:12:58,285][123091] Updated weights for policy 0, policy_version 704646 (0.0010) [2023-12-26 05:12:58,355][123091] Updated weights for policy 0, policy_version 704656 (0.0009) [2023-12-26 05:12:58,571][123090] Updated weights for policy 1, policy_version 700230 (0.0007) [2023-12-26 05:12:58,644][123090] Updated weights for policy 1, policy_version 700240 (0.0008) [2023-12-26 05:12:58,712][123090] Updated weights for policy 1, policy_version 700250 (0.0007) [2023-12-26 05:12:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 359661568. Throughput: 0: 8945.3, 1: 8986.8. Samples: 359652288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:12:58,785][121949] Avg episode reward: [(0, '6250.361'), (1, '5962.956')] [2023-12-26 05:12:59,287][123091] Updated weights for policy 0, policy_version 704666 (0.0009) [2023-12-26 05:12:59,353][123091] Updated weights for policy 0, policy_version 704676 (0.0010) [2023-12-26 05:12:59,421][123091] Updated weights for policy 0, policy_version 704687 (0.0011) [2023-12-26 05:12:59,479][123090] Updated weights for policy 1, policy_version 700260 (0.0007) [2023-12-26 05:12:59,532][123090] Updated weights for policy 1, policy_version 700270 (0.0006) [2023-12-26 05:12:59,581][123090] Updated weights for policy 1, policy_version 700280 (0.0005) [2023-12-26 05:13:00,268][123091] Updated weights for policy 0, policy_version 704697 (0.0009) [2023-12-26 05:13:00,328][123091] Updated weights for policy 0, policy_version 704707 (0.0009) [2023-12-26 05:13:00,388][123091] Updated weights for policy 0, policy_version 704717 (0.0010) [2023-12-26 05:13:00,395][123090] Updated weights for policy 1, policy_version 700290 (0.0006) [2023-12-26 05:13:00,442][123090] Updated weights for policy 1, policy_version 700300 (0.0007) [2023-12-26 05:13:00,493][123090] Updated weights for policy 1, policy_version 700310 (0.0008) [2023-12-26 05:13:00,547][123090] Updated weights for policy 1, policy_version 700320 (0.0010) [2023-12-26 05:13:01,090][123091] Updated weights for policy 0, policy_version 704727 (0.0008) [2023-12-26 05:13:01,157][123091] Updated weights for policy 0, policy_version 704737 (0.0007) [2023-12-26 05:13:01,221][123091] Updated weights for policy 0, policy_version 704747 (0.0008) [2023-12-26 05:13:01,510][123090] Updated weights for policy 1, policy_version 700330 (0.0010) [2023-12-26 05:13:01,581][123090] Updated weights for policy 1, policy_version 700340 (0.0010) [2023-12-26 05:13:01,648][123090] Updated weights for policy 1, policy_version 700350 (0.0009) [2023-12-26 05:13:02,008][123091] Updated weights for policy 0, policy_version 704757 (0.0008) [2023-12-26 05:13:02,068][123091] Updated weights for policy 0, policy_version 704767 (0.0009) [2023-12-26 05:13:02,122][123091] Updated weights for policy 0, policy_version 704777 (0.0010) [2023-12-26 05:13:02,490][123090] Updated weights for policy 1, policy_version 700360 (0.0007) [2023-12-26 05:13:02,557][123090] Updated weights for policy 1, policy_version 700370 (0.0005) [2023-12-26 05:13:02,619][123090] Updated weights for policy 1, policy_version 700380 (0.0005) [2023-12-26 05:13:02,965][123091] Updated weights for policy 0, policy_version 704787 (0.0008) [2023-12-26 05:13:03,016][123091] Updated weights for policy 0, policy_version 704797 (0.0009) [2023-12-26 05:13:03,074][123091] Updated weights for policy 0, policy_version 704807 (0.0008) [2023-12-26 05:13:03,377][123090] Updated weights for policy 1, policy_version 700390 (0.0005) [2023-12-26 05:13:03,443][123090] Updated weights for policy 1, policy_version 700400 (0.0005) [2023-12-26 05:13:03,508][123090] Updated weights for policy 1, policy_version 700410 (0.0005) [2023-12-26 05:13:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 359743488. Throughput: 0: 8831.0, 1: 8969.4. Samples: 359755744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:03,785][121949] Avg episode reward: [(0, '6215.064'), (1, '5964.658')] [2023-12-26 05:13:03,947][123091] Updated weights for policy 0, policy_version 704817 (0.0009) [2023-12-26 05:13:04,013][123091] Updated weights for policy 0, policy_version 704827 (0.0011) [2023-12-26 05:13:04,076][123091] Updated weights for policy 0, policy_version 704837 (0.0011) [2023-12-26 05:13:04,139][123091] Updated weights for policy 0, policy_version 704847 (0.0011) [2023-12-26 05:13:04,278][123090] Updated weights for policy 1, policy_version 700420 (0.0007) [2023-12-26 05:13:04,349][123090] Updated weights for policy 1, policy_version 700430 (0.0010) [2023-12-26 05:13:04,423][123090] Updated weights for policy 1, policy_version 700440 (0.0010) [2023-12-26 05:13:04,968][123091] Updated weights for policy 0, policy_version 704857 (0.0011) [2023-12-26 05:13:05,037][123091] Updated weights for policy 0, policy_version 704867 (0.0011) [2023-12-26 05:13:05,088][123091] Updated weights for policy 0, policy_version 704877 (0.0010) [2023-12-26 05:13:05,147][123090] Updated weights for policy 1, policy_version 700450 (0.0009) [2023-12-26 05:13:05,203][123090] Updated weights for policy 1, policy_version 700460 (0.0009) [2023-12-26 05:13:05,246][123090] Updated weights for policy 1, policy_version 700470 (0.0010) [2023-12-26 05:13:05,296][123090] Updated weights for policy 1, policy_version 700480 (0.0006) [2023-12-26 05:13:05,808][123091] Updated weights for policy 0, policy_version 704887 (0.0011) [2023-12-26 05:13:05,879][123091] Updated weights for policy 0, policy_version 704897 (0.0011) [2023-12-26 05:13:05,942][123091] Updated weights for policy 0, policy_version 704907 (0.0011) [2023-12-26 05:13:05,957][123090] Updated weights for policy 1, policy_version 700490 (0.0008) [2023-12-26 05:13:06,030][123090] Updated weights for policy 1, policy_version 700500 (0.0008) [2023-12-26 05:13:06,099][123090] Updated weights for policy 1, policy_version 700510 (0.0010) [2023-12-26 05:13:06,706][123091] Updated weights for policy 0, policy_version 704917 (0.0008) [2023-12-26 05:13:06,776][123091] Updated weights for policy 0, policy_version 704927 (0.0006) [2023-12-26 05:13:06,840][123091] Updated weights for policy 0, policy_version 704937 (0.0007) [2023-12-26 05:13:06,841][123090] Updated weights for policy 1, policy_version 700520 (0.0010) [2023-12-26 05:13:06,901][123090] Updated weights for policy 1, policy_version 700530 (0.0010) [2023-12-26 05:13:06,961][123090] Updated weights for policy 1, policy_version 700540 (0.0010) [2023-12-26 05:13:07,573][123091] Updated weights for policy 0, policy_version 704947 (0.0009) [2023-12-26 05:13:07,638][123091] Updated weights for policy 0, policy_version 704957 (0.0011) [2023-12-26 05:13:07,693][123091] Updated weights for policy 0, policy_version 704967 (0.0010) [2023-12-26 05:13:07,780][123090] Updated weights for policy 1, policy_version 700550 (0.0010) [2023-12-26 05:13:07,846][123090] Updated weights for policy 1, policy_version 700560 (0.0010) [2023-12-26 05:13:07,897][123090] Updated weights for policy 1, policy_version 700570 (0.0010) [2023-12-26 05:13:08,433][123091] Updated weights for policy 0, policy_version 704977 (0.0010) [2023-12-26 05:13:08,485][123091] Updated weights for policy 0, policy_version 704987 (0.0008) [2023-12-26 05:13:08,536][123091] Updated weights for policy 0, policy_version 704997 (0.0008) [2023-12-26 05:13:08,598][123091] Updated weights for policy 0, policy_version 705007 (0.0008) [2023-12-26 05:13:08,686][123090] Updated weights for policy 1, policy_version 700580 (0.0010) [2023-12-26 05:13:08,751][123090] Updated weights for policy 1, policy_version 700590 (0.0011) [2023-12-26 05:13:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 359833600. Throughput: 0: 8834.1, 1: 9013.6. Samples: 359810264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:08,785][121949] Avg episode reward: [(0, '6192.627'), (1, '5958.426')] [2023-12-26 05:13:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000705008_180486144.pth... [2023-12-26 05:13:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000703952_180215808.pth [2023-12-26 05:13:08,814][123090] Updated weights for policy 1, policy_version 700600 (0.0011) [2023-12-26 05:13:08,864][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000700608_179355648.pth... [2023-12-26 05:13:08,869][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000699520_179077120.pth [2023-12-26 05:13:09,355][123091] Updated weights for policy 0, policy_version 705017 (0.0007) [2023-12-26 05:13:09,427][123091] Updated weights for policy 0, policy_version 705027 (0.0008) [2023-12-26 05:13:09,494][123091] Updated weights for policy 0, policy_version 705037 (0.0010) [2023-12-26 05:13:09,637][123090] Updated weights for policy 1, policy_version 700610 (0.0011) [2023-12-26 05:13:09,693][123090] Updated weights for policy 1, policy_version 700620 (0.0011) [2023-12-26 05:13:09,753][123090] Updated weights for policy 1, policy_version 700630 (0.0011) [2023-12-26 05:13:09,811][123090] Updated weights for policy 1, policy_version 700640 (0.0011) [2023-12-26 05:13:10,304][123091] Updated weights for policy 0, policy_version 705047 (0.0010) [2023-12-26 05:13:10,369][123091] Updated weights for policy 0, policy_version 705057 (0.0006) [2023-12-26 05:13:10,431][123091] Updated weights for policy 0, policy_version 705067 (0.0009) [2023-12-26 05:13:10,652][123090] Updated weights for policy 1, policy_version 700650 (0.0010) [2023-12-26 05:13:10,705][123090] Updated weights for policy 1, policy_version 700660 (0.0011) [2023-12-26 05:13:10,757][123090] Updated weights for policy 1, policy_version 700670 (0.0011) [2023-12-26 05:13:11,276][123091] Updated weights for policy 0, policy_version 705077 (0.0009) [2023-12-26 05:13:11,343][123091] Updated weights for policy 0, policy_version 705087 (0.0010) [2023-12-26 05:13:11,413][123091] Updated weights for policy 0, policy_version 705097 (0.0009) [2023-12-26 05:13:11,626][123090] Updated weights for policy 1, policy_version 700680 (0.0008) [2023-12-26 05:13:11,693][123090] Updated weights for policy 1, policy_version 700690 (0.0008) [2023-12-26 05:13:11,765][123090] Updated weights for policy 1, policy_version 700700 (0.0008) [2023-12-26 05:13:12,173][123091] Updated weights for policy 0, policy_version 705107 (0.0008) [2023-12-26 05:13:12,244][123091] Updated weights for policy 0, policy_version 705117 (0.0006) [2023-12-26 05:13:12,317][123091] Updated weights for policy 0, policy_version 705127 (0.0007) [2023-12-26 05:13:12,632][123090] Updated weights for policy 1, policy_version 700710 (0.0007) [2023-12-26 05:13:12,697][123090] Updated weights for policy 1, policy_version 700720 (0.0006) [2023-12-26 05:13:12,758][123090] Updated weights for policy 1, policy_version 700730 (0.0009) [2023-12-26 05:13:13,069][123091] Updated weights for policy 0, policy_version 705137 (0.0008) [2023-12-26 05:13:13,149][123091] Updated weights for policy 0, policy_version 705147 (0.0005) [2023-12-26 05:13:13,199][123091] Updated weights for policy 0, policy_version 705157 (0.0008) [2023-12-26 05:13:13,248][123091] Updated weights for policy 0, policy_version 705167 (0.0009) [2023-12-26 05:13:13,499][123090] Updated weights for policy 1, policy_version 700740 (0.0008) [2023-12-26 05:13:13,560][123090] Updated weights for policy 1, policy_version 700750 (0.0005) [2023-12-26 05:13:13,614][123090] Updated weights for policy 1, policy_version 700760 (0.0005) [2023-12-26 05:13:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 359923712. Throughput: 0: 8939.2, 1: 8948.0. Samples: 359915948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:13,785][121949] Avg episode reward: [(0, '6228.285'), (1, '5908.773')] [2023-12-26 05:13:13,984][123091] Updated weights for policy 0, policy_version 705177 (0.0010) [2023-12-26 05:13:14,035][123091] Updated weights for policy 0, policy_version 705187 (0.0010) [2023-12-26 05:13:14,086][123091] Updated weights for policy 0, policy_version 705197 (0.0010) [2023-12-26 05:13:14,280][123090] Updated weights for policy 1, policy_version 700770 (0.0006) [2023-12-26 05:13:14,329][123090] Updated weights for policy 1, policy_version 700780 (0.0009) [2023-12-26 05:13:14,398][123090] Updated weights for policy 1, policy_version 700790 (0.0008) [2023-12-26 05:13:14,450][123090] Updated weights for policy 1, policy_version 700800 (0.0005) [2023-12-26 05:13:14,918][123091] Updated weights for policy 0, policy_version 705207 (0.0011) [2023-12-26 05:13:14,990][123091] Updated weights for policy 0, policy_version 705217 (0.0008) [2023-12-26 05:13:15,049][123091] Updated weights for policy 0, policy_version 705227 (0.0006) [2023-12-26 05:13:15,233][123090] Updated weights for policy 1, policy_version 700810 (0.0009) [2023-12-26 05:13:15,303][123090] Updated weights for policy 1, policy_version 700820 (0.0009) [2023-12-26 05:13:15,359][123090] Updated weights for policy 1, policy_version 700830 (0.0010) [2023-12-26 05:13:15,758][123091] Updated weights for policy 0, policy_version 705237 (0.0007) [2023-12-26 05:13:15,826][123091] Updated weights for policy 0, policy_version 705247 (0.0006) [2023-12-26 05:13:15,898][123091] Updated weights for policy 0, policy_version 705257 (0.0005) [2023-12-26 05:13:16,287][123090] Updated weights for policy 1, policy_version 700840 (0.0010) [2023-12-26 05:13:16,349][123090] Updated weights for policy 1, policy_version 700850 (0.0009) [2023-12-26 05:13:16,419][123090] Updated weights for policy 1, policy_version 700860 (0.0009) [2023-12-26 05:13:16,455][123091] Updated weights for policy 0, policy_version 705267 (0.0006) [2023-12-26 05:13:16,526][123091] Updated weights for policy 0, policy_version 705277 (0.0009) [2023-12-26 05:13:16,599][123091] Updated weights for policy 0, policy_version 705287 (0.0009) [2023-12-26 05:13:17,169][123090] Updated weights for policy 1, policy_version 700870 (0.0007) [2023-12-26 05:13:17,244][123090] Updated weights for policy 1, policy_version 700880 (0.0006) [2023-12-26 05:13:17,255][123091] Updated weights for policy 0, policy_version 705297 (0.0009) [2023-12-26 05:13:17,296][123090] Updated weights for policy 1, policy_version 700890 (0.0010) [2023-12-26 05:13:17,302][123091] Updated weights for policy 0, policy_version 705307 (0.0005) [2023-12-26 05:13:17,350][123091] Updated weights for policy 0, policy_version 705317 (0.0005) [2023-12-26 05:13:17,398][123091] Updated weights for policy 0, policy_version 705327 (0.0005) [2023-12-26 05:13:18,016][123090] Updated weights for policy 1, policy_version 700900 (0.0009) [2023-12-26 05:13:18,067][123091] Updated weights for policy 0, policy_version 705337 (0.0006) [2023-12-26 05:13:18,090][123090] Updated weights for policy 1, policy_version 700910 (0.0006) [2023-12-26 05:13:18,129][123091] Updated weights for policy 0, policy_version 705347 (0.0011) [2023-12-26 05:13:18,163][123090] Updated weights for policy 1, policy_version 700920 (0.0006) [2023-12-26 05:13:18,185][123091] Updated weights for policy 0, policy_version 705357 (0.0010) [2023-12-26 05:13:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 360013824. Throughput: 0: 9119.3, 1: 8992.2. Samples: 360029008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:18,785][121949] Avg episode reward: [(0, '6210.518'), (1, '5870.451')] [2023-12-26 05:13:18,800][123090] Updated weights for policy 1, policy_version 700930 (0.0008) [2023-12-26 05:13:18,866][123090] Updated weights for policy 1, policy_version 700940 (0.0011) [2023-12-26 05:13:18,930][123090] Updated weights for policy 1, policy_version 700950 (0.0010) [2023-12-26 05:13:18,995][123091] Updated weights for policy 0, policy_version 705367 (0.0011) [2023-12-26 05:13:18,998][123090] Updated weights for policy 1, policy_version 700960 (0.0010) [2023-12-26 05:13:19,062][123091] Updated weights for policy 0, policy_version 705377 (0.0011) [2023-12-26 05:13:19,124][123091] Updated weights for policy 0, policy_version 705387 (0.0011) [2023-12-26 05:13:19,791][123090] Updated weights for policy 1, policy_version 700970 (0.0010) [2023-12-26 05:13:19,863][123090] Updated weights for policy 1, policy_version 700980 (0.0009) [2023-12-26 05:13:19,929][123090] Updated weights for policy 1, policy_version 700990 (0.0008) [2023-12-26 05:13:19,958][123091] Updated weights for policy 0, policy_version 705397 (0.0011) [2023-12-26 05:13:20,022][123091] Updated weights for policy 0, policy_version 705407 (0.0011) [2023-12-26 05:13:20,082][123091] Updated weights for policy 0, policy_version 705417 (0.0011) [2023-12-26 05:13:20,787][123090] Updated weights for policy 1, policy_version 701000 (0.0009) [2023-12-26 05:13:20,851][123090] Updated weights for policy 1, policy_version 701010 (0.0009) [2023-12-26 05:13:20,914][123091] Updated weights for policy 0, policy_version 705427 (0.0011) [2023-12-26 05:13:20,917][123090] Updated weights for policy 1, policy_version 701020 (0.0011) [2023-12-26 05:13:20,978][123091] Updated weights for policy 0, policy_version 705437 (0.0011) [2023-12-26 05:13:21,047][123091] Updated weights for policy 0, policy_version 705447 (0.0011) [2023-12-26 05:13:21,810][123090] Updated weights for policy 1, policy_version 701030 (0.0010) [2023-12-26 05:13:21,865][123090] Updated weights for policy 1, policy_version 701040 (0.0009) [2023-12-26 05:13:21,899][123091] Updated weights for policy 0, policy_version 705457 (0.0011) [2023-12-26 05:13:21,927][123090] Updated weights for policy 1, policy_version 701050 (0.0008) [2023-12-26 05:13:21,967][123091] Updated weights for policy 0, policy_version 705467 (0.0011) [2023-12-26 05:13:22,021][123091] Updated weights for policy 0, policy_version 705477 (0.0007) [2023-12-26 05:13:22,095][123091] Updated weights for policy 0, policy_version 705487 (0.0009) [2023-12-26 05:13:22,783][123091] Updated weights for policy 0, policy_version 705497 (0.0006) [2023-12-26 05:13:22,846][123091] Updated weights for policy 0, policy_version 705507 (0.0006) [2023-12-26 05:13:22,848][123090] Updated weights for policy 1, policy_version 701060 (0.0008) [2023-12-26 05:13:22,902][123091] Updated weights for policy 0, policy_version 705517 (0.0008) [2023-12-26 05:13:22,908][123090] Updated weights for policy 1, policy_version 701070 (0.0008) [2023-12-26 05:13:22,966][123090] Updated weights for policy 1, policy_version 701080 (0.0010) [2023-12-26 05:13:23,483][123091] Updated weights for policy 0, policy_version 705527 (0.0005) [2023-12-26 05:13:23,543][123091] Updated weights for policy 0, policy_version 705537 (0.0005) [2023-12-26 05:13:23,593][123091] Updated weights for policy 0, policy_version 705547 (0.0005) [2023-12-26 05:13:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 360103936. Throughput: 0: 9023.5, 1: 8988.0. Samples: 360079288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:23,785][121949] Avg episode reward: [(0, '6210.951'), (1, '5839.422')] [2023-12-26 05:13:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000705552_180625408.pth... [2023-12-26 05:13:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000701088_179478528.pth... [2023-12-26 05:13:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000704496_180355072.pth [2023-12-26 05:13:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000700064_179216384.pth [2023-12-26 05:13:23,911][123090] Updated weights for policy 1, policy_version 701090 (0.0010) [2023-12-26 05:13:23,963][123090] Updated weights for policy 1, policy_version 701100 (0.0007) [2023-12-26 05:13:24,016][123090] Updated weights for policy 1, policy_version 701110 (0.0005) [2023-12-26 05:13:24,067][123090] Updated weights for policy 1, policy_version 701120 (0.0008) [2023-12-26 05:13:24,291][123091] Updated weights for policy 0, policy_version 705557 (0.0008) [2023-12-26 05:13:24,351][123091] Updated weights for policy 0, policy_version 705567 (0.0009) [2023-12-26 05:13:24,410][123091] Updated weights for policy 0, policy_version 705577 (0.0011) [2023-12-26 05:13:24,811][123090] Updated weights for policy 1, policy_version 701130 (0.0006) [2023-12-26 05:13:24,879][123090] Updated weights for policy 1, policy_version 701140 (0.0008) [2023-12-26 05:13:24,943][123090] Updated weights for policy 1, policy_version 701150 (0.0009) [2023-12-26 05:13:25,243][123091] Updated weights for policy 0, policy_version 705587 (0.0011) [2023-12-26 05:13:25,292][123091] Updated weights for policy 0, policy_version 705597 (0.0011) [2023-12-26 05:13:25,344][123091] Updated weights for policy 0, policy_version 705607 (0.0011) [2023-12-26 05:13:25,749][123090] Updated weights for policy 1, policy_version 701160 (0.0009) [2023-12-26 05:13:25,815][123090] Updated weights for policy 1, policy_version 701170 (0.0009) [2023-12-26 05:13:25,888][123090] Updated weights for policy 1, policy_version 701180 (0.0009) [2023-12-26 05:13:26,186][123091] Updated weights for policy 0, policy_version 705617 (0.0011) [2023-12-26 05:13:26,237][123091] Updated weights for policy 0, policy_version 705627 (0.0010) [2023-12-26 05:13:26,289][123091] Updated weights for policy 0, policy_version 705637 (0.0010) [2023-12-26 05:13:26,340][123091] Updated weights for policy 0, policy_version 705647 (0.0010) [2023-12-26 05:13:26,709][123090] Updated weights for policy 1, policy_version 701190 (0.0009) [2023-12-26 05:13:26,757][123090] Updated weights for policy 1, policy_version 701200 (0.0008) [2023-12-26 05:13:26,806][123090] Updated weights for policy 1, policy_version 701210 (0.0009) [2023-12-26 05:13:27,183][123091] Updated weights for policy 0, policy_version 705657 (0.0010) [2023-12-26 05:13:27,230][123091] Updated weights for policy 0, policy_version 705667 (0.0010) [2023-12-26 05:13:27,277][123091] Updated weights for policy 0, policy_version 705677 (0.0010) [2023-12-26 05:13:27,592][123090] Updated weights for policy 1, policy_version 701220 (0.0009) [2023-12-26 05:13:27,647][123090] Updated weights for policy 1, policy_version 701230 (0.0009) [2023-12-26 05:13:27,694][123090] Updated weights for policy 1, policy_version 701240 (0.0008) [2023-12-26 05:13:28,132][123091] Updated weights for policy 0, policy_version 705687 (0.0010) [2023-12-26 05:13:28,182][123091] Updated weights for policy 0, policy_version 705697 (0.0010) [2023-12-26 05:13:28,230][123091] Updated weights for policy 0, policy_version 705707 (0.0010) [2023-12-26 05:13:28,399][123090] Updated weights for policy 1, policy_version 701250 (0.0009) [2023-12-26 05:13:28,458][123090] Updated weights for policy 1, policy_version 701260 (0.0008) [2023-12-26 05:13:28,516][123090] Updated weights for policy 1, policy_version 701270 (0.0008) [2023-12-26 05:13:28,586][123090] Updated weights for policy 1, policy_version 701280 (0.0006) [2023-12-26 05:13:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 360194048. Throughput: 0: 8984.1, 1: 8898.8. Samples: 360184792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:28,784][121949] Avg episode reward: [(0, '6235.507'), (1, '5669.764')] [2023-12-26 05:13:29,073][123091] Updated weights for policy 0, policy_version 705717 (0.0010) [2023-12-26 05:13:29,133][123091] Updated weights for policy 0, policy_version 705727 (0.0011) [2023-12-26 05:13:29,190][123091] Updated weights for policy 0, policy_version 705737 (0.0011) [2023-12-26 05:13:29,303][123090] Updated weights for policy 1, policy_version 701290 (0.0009) [2023-12-26 05:13:29,373][123090] Updated weights for policy 1, policy_version 701300 (0.0009) [2023-12-26 05:13:29,430][123090] Updated weights for policy 1, policy_version 701310 (0.0007) [2023-12-26 05:13:30,022][123091] Updated weights for policy 0, policy_version 705747 (0.0010) [2023-12-26 05:13:30,073][123091] Updated weights for policy 0, policy_version 705757 (0.0010) [2023-12-26 05:13:30,121][123091] Updated weights for policy 0, policy_version 705767 (0.0010) [2023-12-26 05:13:30,284][123090] Updated weights for policy 1, policy_version 701320 (0.0009) [2023-12-26 05:13:30,352][123090] Updated weights for policy 1, policy_version 701330 (0.0009) [2023-12-26 05:13:30,417][123090] Updated weights for policy 1, policy_version 701340 (0.0009) [2023-12-26 05:13:30,941][123091] Updated weights for policy 0, policy_version 705777 (0.0010) [2023-12-26 05:13:30,992][123091] Updated weights for policy 0, policy_version 705787 (0.0010) [2023-12-26 05:13:31,047][123091] Updated weights for policy 0, policy_version 705797 (0.0011) [2023-12-26 05:13:31,105][123090] Updated weights for policy 1, policy_version 701350 (0.0007) [2023-12-26 05:13:31,110][123091] Updated weights for policy 0, policy_version 705807 (0.0011) [2023-12-26 05:13:31,174][123090] Updated weights for policy 1, policy_version 701360 (0.0007) [2023-12-26 05:13:31,247][123090] Updated weights for policy 1, policy_version 701370 (0.0006) [2023-12-26 05:13:31,932][123091] Updated weights for policy 0, policy_version 705817 (0.0009) [2023-12-26 05:13:31,969][123090] Updated weights for policy 1, policy_version 701380 (0.0006) [2023-12-26 05:13:31,988][123091] Updated weights for policy 0, policy_version 705827 (0.0011) [2023-12-26 05:13:32,034][123090] Updated weights for policy 1, policy_version 701390 (0.0006) [2023-12-26 05:13:32,049][123091] Updated weights for policy 0, policy_version 705837 (0.0010) [2023-12-26 05:13:32,089][123090] Updated weights for policy 1, policy_version 701400 (0.0009) [2023-12-26 05:13:32,897][123091] Updated weights for policy 0, policy_version 705847 (0.0010) [2023-12-26 05:13:32,945][123091] Updated weights for policy 0, policy_version 705857 (0.0009) [2023-12-26 05:13:32,948][123090] Updated weights for policy 1, policy_version 701410 (0.0008) [2023-12-26 05:13:32,990][123091] Updated weights for policy 0, policy_version 705867 (0.0007) [2023-12-26 05:13:32,995][123090] Updated weights for policy 1, policy_version 701420 (0.0007) [2023-12-26 05:13:33,050][123090] Updated weights for policy 1, policy_version 701430 (0.0010) [2023-12-26 05:13:33,106][123090] Updated weights for policy 1, policy_version 701440 (0.0009) [2023-12-26 05:13:33,689][123091] Updated weights for policy 0, policy_version 705877 (0.0008) [2023-12-26 05:13:33,759][123091] Updated weights for policy 0, policy_version 705887 (0.0006) [2023-12-26 05:13:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 360275968. Throughput: 0: 8925.1, 1: 8876.4. Samples: 360291796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:33,785][121949] Avg episode reward: [(0, '6275.050'), (1, '5722.812')] [2023-12-26 05:13:33,826][123091] Updated weights for policy 0, policy_version 705897 (0.0008) [2023-12-26 05:13:34,002][123090] Updated weights for policy 1, policy_version 701451 (0.0010) [2023-12-26 05:13:34,055][123090] Updated weights for policy 1, policy_version 701461 (0.0009) [2023-12-26 05:13:34,113][123090] Updated weights for policy 1, policy_version 701471 (0.0010) [2023-12-26 05:13:34,538][123091] Updated weights for policy 0, policy_version 705907 (0.0009) [2023-12-26 05:13:34,600][123091] Updated weights for policy 0, policy_version 705917 (0.0010) [2023-12-26 05:13:34,664][123091] Updated weights for policy 0, policy_version 705927 (0.0010) [2023-12-26 05:13:34,944][123090] Updated weights for policy 1, policy_version 701481 (0.0008) [2023-12-26 05:13:35,004][123090] Updated weights for policy 1, policy_version 701491 (0.0009) [2023-12-26 05:13:35,066][123090] Updated weights for policy 1, policy_version 701501 (0.0008) [2023-12-26 05:13:35,488][123091] Updated weights for policy 0, policy_version 705937 (0.0009) [2023-12-26 05:13:35,534][123091] Updated weights for policy 0, policy_version 705947 (0.0005) [2023-12-26 05:13:35,581][123091] Updated weights for policy 0, policy_version 705957 (0.0005) [2023-12-26 05:13:35,628][123091] Updated weights for policy 0, policy_version 705967 (0.0005) [2023-12-26 05:13:35,977][123090] Updated weights for policy 1, policy_version 701511 (0.0008) [2023-12-26 05:13:36,037][123090] Updated weights for policy 1, policy_version 701521 (0.0009) [2023-12-26 05:13:36,118][123090] Updated weights for policy 1, policy_version 701531 (0.0008) [2023-12-26 05:13:36,419][123091] Updated weights for policy 0, policy_version 705977 (0.0010) [2023-12-26 05:13:36,475][123091] Updated weights for policy 0, policy_version 705987 (0.0007) [2023-12-26 05:13:36,531][123091] Updated weights for policy 0, policy_version 705997 (0.0007) [2023-12-26 05:13:36,937][123090] Updated weights for policy 1, policy_version 701541 (0.0009) [2023-12-26 05:13:36,995][123090] Updated weights for policy 1, policy_version 701551 (0.0010) [2023-12-26 05:13:37,058][123090] Updated weights for policy 1, policy_version 701561 (0.0010) [2023-12-26 05:13:37,341][123091] Updated weights for policy 0, policy_version 706007 (0.0010) [2023-12-26 05:13:37,395][123091] Updated weights for policy 0, policy_version 706017 (0.0009) [2023-12-26 05:13:37,445][123091] Updated weights for policy 0, policy_version 706027 (0.0009) [2023-12-26 05:13:37,885][123090] Updated weights for policy 1, policy_version 701571 (0.0010) [2023-12-26 05:13:37,950][123090] Updated weights for policy 1, policy_version 701581 (0.0010) [2023-12-26 05:13:38,016][123090] Updated weights for policy 1, policy_version 701591 (0.0010) [2023-12-26 05:13:38,313][123091] Updated weights for policy 0, policy_version 706037 (0.0008) [2023-12-26 05:13:38,379][123091] Updated weights for policy 0, policy_version 706047 (0.0009) [2023-12-26 05:13:38,436][123091] Updated weights for policy 0, policy_version 706057 (0.0009) [2023-12-26 05:13:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 360366080. Throughput: 0: 8976.5, 1: 8799.2. Samples: 360344304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:38,785][121949] Avg episode reward: [(0, '6297.518'), (1, '5739.240')] [2023-12-26 05:13:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000706064_180756480.pth... [2023-12-26 05:13:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000701600_179609600.pth... [2023-12-26 05:13:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000705008_180486144.pth [2023-12-26 05:13:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000700608_179355648.pth [2023-12-26 05:13:38,829][123090] Updated weights for policy 1, policy_version 701601 (0.0010) [2023-12-26 05:13:38,892][123090] Updated weights for policy 1, policy_version 701611 (0.0010) [2023-12-26 05:13:38,953][123090] Updated weights for policy 1, policy_version 701621 (0.0010) [2023-12-26 05:13:39,031][123090] Updated weights for policy 1, policy_version 701631 (0.0010) [2023-12-26 05:13:39,190][123091] Updated weights for policy 0, policy_version 706067 (0.0007) [2023-12-26 05:13:39,257][123091] Updated weights for policy 0, policy_version 706077 (0.0009) [2023-12-26 05:13:39,312][123091] Updated weights for policy 0, policy_version 706087 (0.0009) [2023-12-26 05:13:39,869][123090] Updated weights for policy 1, policy_version 701641 (0.0009) [2023-12-26 05:13:39,927][123090] Updated weights for policy 1, policy_version 701651 (0.0008) [2023-12-26 05:13:39,986][123090] Updated weights for policy 1, policy_version 701661 (0.0008) [2023-12-26 05:13:40,160][123091] Updated weights for policy 0, policy_version 706097 (0.0008) [2023-12-26 05:13:40,217][123091] Updated weights for policy 0, policy_version 706107 (0.0009) [2023-12-26 05:13:40,271][123091] Updated weights for policy 0, policy_version 706117 (0.0010) [2023-12-26 05:13:40,326][123091] Updated weights for policy 0, policy_version 706127 (0.0009) [2023-12-26 05:13:40,746][123090] Updated weights for policy 1, policy_version 701671 (0.0009) [2023-12-26 05:13:40,807][123090] Updated weights for policy 1, policy_version 701681 (0.0008) [2023-12-26 05:13:40,872][123090] Updated weights for policy 1, policy_version 701691 (0.0009) [2023-12-26 05:13:41,182][123091] Updated weights for policy 0, policy_version 706137 (0.0007) [2023-12-26 05:13:41,249][123091] Updated weights for policy 0, policy_version 706147 (0.0008) [2023-12-26 05:13:41,311][123091] Updated weights for policy 0, policy_version 706157 (0.0008) [2023-12-26 05:13:41,776][123090] Updated weights for policy 1, policy_version 701701 (0.0009) [2023-12-26 05:13:41,844][123090] Updated weights for policy 1, policy_version 701711 (0.0011) [2023-12-26 05:13:41,911][123090] Updated weights for policy 1, policy_version 701721 (0.0010) [2023-12-26 05:13:42,137][123091] Updated weights for policy 0, policy_version 706167 (0.0007) [2023-12-26 05:13:42,208][123091] Updated weights for policy 0, policy_version 706177 (0.0006) [2023-12-26 05:13:42,275][123091] Updated weights for policy 0, policy_version 706187 (0.0007) [2023-12-26 05:13:42,721][123090] Updated weights for policy 1, policy_version 701731 (0.0010) [2023-12-26 05:13:42,776][123090] Updated weights for policy 1, policy_version 701741 (0.0009) [2023-12-26 05:13:42,830][123090] Updated weights for policy 1, policy_version 701751 (0.0010) [2023-12-26 05:13:43,054][123091] Updated weights for policy 0, policy_version 706197 (0.0008) [2023-12-26 05:13:43,103][123091] Updated weights for policy 0, policy_version 706207 (0.0009) [2023-12-26 05:13:43,156][123091] Updated weights for policy 0, policy_version 706217 (0.0009) [2023-12-26 05:13:43,601][123090] Updated weights for policy 1, policy_version 701761 (0.0010) [2023-12-26 05:13:43,650][123090] Updated weights for policy 1, policy_version 701771 (0.0009) [2023-12-26 05:13:43,707][123090] Updated weights for policy 1, policy_version 701781 (0.0009) [2023-12-26 05:13:43,754][123090] Updated weights for policy 1, policy_version 701791 (0.0009) [2023-12-26 05:13:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 360456192. Throughput: 0: 8946.7, 1: 8711.5. Samples: 360446904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:43,784][121949] Avg episode reward: [(0, '6286.461'), (1, '5713.480')] [2023-12-26 05:13:44,000][123091] Updated weights for policy 0, policy_version 706227 (0.0009) [2023-12-26 05:13:44,050][123091] Updated weights for policy 0, policy_version 706237 (0.0010) [2023-12-26 05:13:44,106][123091] Updated weights for policy 0, policy_version 706248 (0.0009) [2023-12-26 05:13:44,599][123090] Updated weights for policy 1, policy_version 701801 (0.0010) [2023-12-26 05:13:44,670][123090] Updated weights for policy 1, policy_version 701811 (0.0009) [2023-12-26 05:13:44,746][123090] Updated weights for policy 1, policy_version 701821 (0.0009) [2023-12-26 05:13:44,835][123091] Updated weights for policy 0, policy_version 706258 (0.0006) [2023-12-26 05:13:44,889][123091] Updated weights for policy 0, policy_version 706268 (0.0010) [2023-12-26 05:13:44,955][123091] Updated weights for policy 0, policy_version 706278 (0.0009) [2023-12-26 05:13:45,009][123091] Updated weights for policy 0, policy_version 706288 (0.0009) [2023-12-26 05:13:45,566][123090] Updated weights for policy 1, policy_version 701832 (0.0009) [2023-12-26 05:13:45,617][123090] Updated weights for policy 1, policy_version 701842 (0.0009) [2023-12-26 05:13:45,664][123090] Updated weights for policy 1, policy_version 701852 (0.0009) [2023-12-26 05:13:45,862][123091] Updated weights for policy 0, policy_version 706298 (0.0009) [2023-12-26 05:13:45,916][123091] Updated weights for policy 0, policy_version 706308 (0.0010) [2023-12-26 05:13:45,964][123091] Updated weights for policy 0, policy_version 706318 (0.0009) [2023-12-26 05:13:46,478][123090] Updated weights for policy 1, policy_version 701862 (0.0008) [2023-12-26 05:13:46,529][123090] Updated weights for policy 1, policy_version 701872 (0.0005) [2023-12-26 05:13:46,587][123090] Updated weights for policy 1, policy_version 701882 (0.0005) [2023-12-26 05:13:46,841][123091] Updated weights for policy 0, policy_version 706328 (0.0006) [2023-12-26 05:13:46,907][123091] Updated weights for policy 0, policy_version 706338 (0.0009) [2023-12-26 05:13:46,958][123091] Updated weights for policy 0, policy_version 706348 (0.0010) [2023-12-26 05:13:47,250][123090] Updated weights for policy 1, policy_version 701892 (0.0005) [2023-12-26 05:13:47,303][123090] Updated weights for policy 1, policy_version 701902 (0.0005) [2023-12-26 05:13:47,360][123090] Updated weights for policy 1, policy_version 701912 (0.0005) [2023-12-26 05:13:47,766][123091] Updated weights for policy 0, policy_version 706358 (0.0010) [2023-12-26 05:13:47,833][123091] Updated weights for policy 0, policy_version 706368 (0.0010) [2023-12-26 05:13:47,896][123091] Updated weights for policy 0, policy_version 706378 (0.0009) [2023-12-26 05:13:48,055][123090] Updated weights for policy 1, policy_version 701922 (0.0006) [2023-12-26 05:13:48,115][123090] Updated weights for policy 1, policy_version 701932 (0.0005) [2023-12-26 05:13:48,179][123090] Updated weights for policy 1, policy_version 701942 (0.0005) [2023-12-26 05:13:48,230][123090] Updated weights for policy 1, policy_version 701952 (0.0005) [2023-12-26 05:13:48,704][123091] Updated weights for policy 0, policy_version 706388 (0.0009) [2023-12-26 05:13:48,759][123091] Updated weights for policy 0, policy_version 706398 (0.0006) [2023-12-26 05:13:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 360538112. Throughput: 0: 8964.7, 1: 8789.9. Samples: 360554700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:48,785][121949] Avg episode reward: [(0, '6161.409'), (1, '5723.181')] [2023-12-26 05:13:48,817][123091] Updated weights for policy 0, policy_version 706408 (0.0006) [2023-12-26 05:13:48,978][123090] Updated weights for policy 1, policy_version 701962 (0.0009) [2023-12-26 05:13:49,039][123090] Updated weights for policy 1, policy_version 701972 (0.0009) [2023-12-26 05:13:49,108][123090] Updated weights for policy 1, policy_version 701982 (0.0009) [2023-12-26 05:13:49,550][123091] Updated weights for policy 0, policy_version 706418 (0.0007) [2023-12-26 05:13:49,615][123091] Updated weights for policy 0, policy_version 706428 (0.0008) [2023-12-26 05:13:49,682][123091] Updated weights for policy 0, policy_version 706438 (0.0009) [2023-12-26 05:13:49,739][123091] Updated weights for policy 0, policy_version 706448 (0.0009) [2023-12-26 05:13:49,965][123090] Updated weights for policy 1, policy_version 701992 (0.0008) [2023-12-26 05:13:50,029][123090] Updated weights for policy 1, policy_version 702002 (0.0006) [2023-12-26 05:13:50,094][123090] Updated weights for policy 1, policy_version 702012 (0.0008) [2023-12-26 05:13:50,511][123091] Updated weights for policy 0, policy_version 706458 (0.0010) [2023-12-26 05:13:50,578][123091] Updated weights for policy 0, policy_version 706468 (0.0011) [2023-12-26 05:13:50,645][123091] Updated weights for policy 0, policy_version 706478 (0.0011) [2023-12-26 05:13:50,853][123090] Updated weights for policy 1, policy_version 702022 (0.0009) [2023-12-26 05:13:50,918][123090] Updated weights for policy 1, policy_version 702032 (0.0011) [2023-12-26 05:13:50,986][123090] Updated weights for policy 1, policy_version 702042 (0.0011) [2023-12-26 05:13:51,521][123091] Updated weights for policy 0, policy_version 706488 (0.0009) [2023-12-26 05:13:51,582][123091] Updated weights for policy 0, policy_version 706498 (0.0009) [2023-12-26 05:13:51,652][123091] Updated weights for policy 0, policy_version 706508 (0.0008) [2023-12-26 05:13:51,862][123090] Updated weights for policy 1, policy_version 702052 (0.0011) [2023-12-26 05:13:51,918][123090] Updated weights for policy 1, policy_version 702062 (0.0011) [2023-12-26 05:13:51,967][123090] Updated weights for policy 1, policy_version 702072 (0.0010) [2023-12-26 05:13:52,518][123091] Updated weights for policy 0, policy_version 706518 (0.0008) [2023-12-26 05:13:52,575][123091] Updated weights for policy 0, policy_version 706528 (0.0010) [2023-12-26 05:13:52,628][123091] Updated weights for policy 0, policy_version 706538 (0.0010) [2023-12-26 05:13:52,770][123090] Updated weights for policy 1, policy_version 702082 (0.0010) [2023-12-26 05:13:52,826][123090] Updated weights for policy 1, policy_version 702092 (0.0010) [2023-12-26 05:13:52,882][123090] Updated weights for policy 1, policy_version 702102 (0.0010) [2023-12-26 05:13:52,949][123090] Updated weights for policy 1, policy_version 702112 (0.0011) [2023-12-26 05:13:53,490][123091] Updated weights for policy 0, policy_version 706548 (0.0009) [2023-12-26 05:13:53,545][123091] Updated weights for policy 0, policy_version 706559 (0.0011) [2023-12-26 05:13:53,600][123091] Updated weights for policy 0, policy_version 706569 (0.0010) [2023-12-26 05:13:53,723][123090] Updated weights for policy 1, policy_version 702122 (0.0006) [2023-12-26 05:13:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 360628224. Throughput: 0: 8974.8, 1: 8722.7. Samples: 360606648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:53,784][121949] Avg episode reward: [(0, '6126.428'), (1, '5849.791')] [2023-12-26 05:13:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000706576_180887552.pth... [2023-12-26 05:13:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000705552_180625408.pth [2023-12-26 05:13:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000706576_180887552.pth [2023-12-26 05:13:53,796][123090] Updated weights for policy 1, policy_version 702132 (0.0005) [2023-12-26 05:13:53,846][123090] Updated weights for policy 1, policy_version 702142 (0.0005) [2023-12-26 05:13:53,856][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000702144_179748864.pth... [2023-12-26 05:13:53,859][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000701088_179478528.pth [2023-12-26 05:13:53,860][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000702144_179748864.pth [2023-12-26 05:13:54,465][123090] Updated weights for policy 1, policy_version 702152 (0.0005) [2023-12-26 05:13:54,517][123090] Updated weights for policy 1, policy_version 702162 (0.0005) [2023-12-26 05:13:54,563][123091] Updated weights for policy 0, policy_version 706579 (0.0009) [2023-12-26 05:13:54,571][123090] Updated weights for policy 1, policy_version 702172 (0.0005) [2023-12-26 05:13:54,617][123091] Updated weights for policy 0, policy_version 706589 (0.0010) [2023-12-26 05:13:54,671][123091] Updated weights for policy 0, policy_version 706600 (0.0010) [2023-12-26 05:13:55,346][123090] Updated weights for policy 1, policy_version 702182 (0.0005) [2023-12-26 05:13:55,403][123090] Updated weights for policy 1, policy_version 702192 (0.0006) [2023-12-26 05:13:55,413][123091] Updated weights for policy 0, policy_version 706611 (0.0009) [2023-12-26 05:13:55,465][123090] Updated weights for policy 1, policy_version 702202 (0.0010) [2023-12-26 05:13:55,468][123091] Updated weights for policy 0, policy_version 706621 (0.0006) [2023-12-26 05:13:55,517][123091] Updated weights for policy 0, policy_version 706631 (0.0008) [2023-12-26 05:13:56,100][123090] Updated weights for policy 1, policy_version 702212 (0.0010) [2023-12-26 05:13:56,159][123090] Updated weights for policy 1, policy_version 702222 (0.0010) [2023-12-26 05:13:56,225][123090] Updated weights for policy 1, policy_version 702232 (0.0010) [2023-12-26 05:13:56,385][123091] Updated weights for policy 0, policy_version 706641 (0.0009) [2023-12-26 05:13:56,462][123091] Updated weights for policy 0, policy_version 706651 (0.0010) [2023-12-26 05:13:56,533][123091] Updated weights for policy 0, policy_version 706661 (0.0010) [2023-12-26 05:13:56,604][123091] Updated weights for policy 0, policy_version 706671 (0.0010) [2023-12-26 05:13:56,864][123090] Updated weights for policy 1, policy_version 702242 (0.0006) [2023-12-26 05:13:56,937][123090] Updated weights for policy 1, policy_version 702252 (0.0005) [2023-12-26 05:13:57,007][123090] Updated weights for policy 1, policy_version 702262 (0.0009) [2023-12-26 05:13:57,061][123090] Updated weights for policy 1, policy_version 702272 (0.0010) [2023-12-26 05:13:57,434][123091] Updated weights for policy 0, policy_version 706681 (0.0007) [2023-12-26 05:13:57,498][123091] Updated weights for policy 0, policy_version 706691 (0.0009) [2023-12-26 05:13:57,567][123091] Updated weights for policy 0, policy_version 706701 (0.0009) [2023-12-26 05:13:57,766][123090] Updated weights for policy 1, policy_version 702282 (0.0007) [2023-12-26 05:13:57,823][123090] Updated weights for policy 1, policy_version 702292 (0.0005) [2023-12-26 05:13:57,875][123090] Updated weights for policy 1, policy_version 702302 (0.0006) [2023-12-26 05:13:58,443][123091] Updated weights for policy 0, policy_version 706711 (0.0009) [2023-12-26 05:13:58,501][123091] Updated weights for policy 0, policy_version 706721 (0.0009) [2023-12-26 05:13:58,557][123091] Updated weights for policy 0, policy_version 706731 (0.0010) [2023-12-26 05:13:58,625][123090] Updated weights for policy 1, policy_version 702312 (0.0007) [2023-12-26 05:13:58,703][123090] Updated weights for policy 1, policy_version 702322 (0.0008) [2023-12-26 05:13:58,784][123090] Updated weights for policy 1, policy_version 702332 (0.0008) [2023-12-26 05:13:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 360718336. Throughput: 0: 8873.3, 1: 8883.9. Samples: 360715024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:13:58,785][121949] Avg episode reward: [(0, '6162.077'), (1, '5823.838')] [2023-12-26 05:13:59,485][123091] Updated weights for policy 0, policy_version 706741 (0.0008) [2023-12-26 05:13:59,550][123091] Updated weights for policy 0, policy_version 706751 (0.0008) [2023-12-26 05:13:59,607][123091] Updated weights for policy 0, policy_version 706761 (0.0009) [2023-12-26 05:13:59,633][123090] Updated weights for policy 1, policy_version 702342 (0.0007) [2023-12-26 05:13:59,686][123090] Updated weights for policy 1, policy_version 702352 (0.0006) [2023-12-26 05:13:59,754][123090] Updated weights for policy 1, policy_version 702362 (0.0009) [2023-12-26 05:14:00,423][123091] Updated weights for policy 0, policy_version 706771 (0.0009) [2023-12-26 05:14:00,483][123091] Updated weights for policy 0, policy_version 706781 (0.0010) [2023-12-26 05:14:00,545][123091] Updated weights for policy 0, policy_version 706791 (0.0009) [2023-12-26 05:14:00,607][123090] Updated weights for policy 1, policy_version 702372 (0.0008) [2023-12-26 05:14:00,672][123090] Updated weights for policy 1, policy_version 702382 (0.0009) [2023-12-26 05:14:00,730][123090] Updated weights for policy 1, policy_version 702392 (0.0009) [2023-12-26 05:14:01,398][123091] Updated weights for policy 0, policy_version 706801 (0.0009) [2023-12-26 05:14:01,453][123091] Updated weights for policy 0, policy_version 706811 (0.0009) [2023-12-26 05:14:01,511][123091] Updated weights for policy 0, policy_version 706821 (0.0010) [2023-12-26 05:14:01,546][123090] Updated weights for policy 1, policy_version 702402 (0.0009) [2023-12-26 05:14:01,574][123091] Updated weights for policy 0, policy_version 706831 (0.0008) [2023-12-26 05:14:01,601][123090] Updated weights for policy 1, policy_version 702412 (0.0010) [2023-12-26 05:14:01,671][123090] Updated weights for policy 1, policy_version 702422 (0.0008) [2023-12-26 05:14:01,729][123090] Updated weights for policy 1, policy_version 702432 (0.0010) [2023-12-26 05:14:02,438][123091] Updated weights for policy 0, policy_version 706841 (0.0009) [2023-12-26 05:14:02,506][123091] Updated weights for policy 0, policy_version 706851 (0.0009) [2023-12-26 05:14:02,561][123090] Updated weights for policy 1, policy_version 702442 (0.0008) [2023-12-26 05:14:02,564][123091] Updated weights for policy 0, policy_version 706861 (0.0008) [2023-12-26 05:14:02,612][123090] Updated weights for policy 1, policy_version 702452 (0.0007) [2023-12-26 05:14:02,658][123090] Updated weights for policy 1, policy_version 702462 (0.0005) [2023-12-26 05:14:03,286][123091] Updated weights for policy 0, policy_version 706871 (0.0006) [2023-12-26 05:14:03,322][123090] Updated weights for policy 1, policy_version 702472 (0.0006) [2023-12-26 05:14:03,356][123091] Updated weights for policy 0, policy_version 706881 (0.0008) [2023-12-26 05:14:03,385][123090] Updated weights for policy 1, policy_version 702482 (0.0008) [2023-12-26 05:14:03,419][123091] Updated weights for policy 0, policy_version 706891 (0.0008) [2023-12-26 05:14:03,436][123090] Updated weights for policy 1, policy_version 702492 (0.0008) [2023-12-26 05:14:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 360808448. Throughput: 0: 8701.2, 1: 8855.3. Samples: 360819048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:14:03,785][121949] Avg episode reward: [(0, '6261.018'), (1, '5793.070')] [2023-12-26 05:14:04,124][123090] Updated weights for policy 1, policy_version 702502 (0.0008) [2023-12-26 05:14:04,183][123090] Updated weights for policy 1, policy_version 702512 (0.0009) [2023-12-26 05:14:04,244][123090] Updated weights for policy 1, policy_version 702522 (0.0009) [2023-12-26 05:14:04,274][123091] Updated weights for policy 0, policy_version 706901 (0.0008) [2023-12-26 05:14:04,338][123091] Updated weights for policy 0, policy_version 706911 (0.0006) [2023-12-26 05:14:04,402][123091] Updated weights for policy 0, policy_version 706921 (0.0009) [2023-12-26 05:14:05,029][123090] Updated weights for policy 1, policy_version 702532 (0.0009) [2023-12-26 05:14:05,087][123090] Updated weights for policy 1, policy_version 702542 (0.0010) [2023-12-26 05:14:05,103][123091] Updated weights for policy 0, policy_version 706931 (0.0009) [2023-12-26 05:14:05,142][123090] Updated weights for policy 1, policy_version 702552 (0.0009) [2023-12-26 05:14:05,150][123091] Updated weights for policy 0, policy_version 706941 (0.0005) [2023-12-26 05:14:05,196][123091] Updated weights for policy 0, policy_version 706951 (0.0005) [2023-12-26 05:14:05,815][123091] Updated weights for policy 0, policy_version 706961 (0.0005) [2023-12-26 05:14:05,885][123091] Updated weights for policy 0, policy_version 706971 (0.0005) [2023-12-26 05:14:05,950][123091] Updated weights for policy 0, policy_version 706981 (0.0009) [2023-12-26 05:14:05,951][123090] Updated weights for policy 1, policy_version 702562 (0.0009) [2023-12-26 05:14:05,998][123091] Updated weights for policy 0, policy_version 706991 (0.0005) [2023-12-26 05:14:06,007][123090] Updated weights for policy 1, policy_version 702572 (0.0008) [2023-12-26 05:14:06,060][123090] Updated weights for policy 1, policy_version 702582 (0.0010) [2023-12-26 05:14:06,136][123090] Updated weights for policy 1, policy_version 702592 (0.0011) [2023-12-26 05:14:06,691][123091] Updated weights for policy 0, policy_version 707001 (0.0010) [2023-12-26 05:14:06,767][123091] Updated weights for policy 0, policy_version 707011 (0.0011) [2023-12-26 05:14:06,834][123091] Updated weights for policy 0, policy_version 707021 (0.0011) [2023-12-26 05:14:06,955][123090] Updated weights for policy 1, policy_version 702602 (0.0005) [2023-12-26 05:14:07,002][123090] Updated weights for policy 1, policy_version 702612 (0.0005) [2023-12-26 05:14:07,057][123090] Updated weights for policy 1, policy_version 702622 (0.0005) [2023-12-26 05:14:07,566][123091] Updated weights for policy 0, policy_version 707031 (0.0008) [2023-12-26 05:14:07,629][123091] Updated weights for policy 0, policy_version 707041 (0.0005) [2023-12-26 05:14:07,694][123091] Updated weights for policy 0, policy_version 707051 (0.0006) [2023-12-26 05:14:07,881][123090] Updated weights for policy 1, policy_version 702632 (0.0007) [2023-12-26 05:14:07,942][123090] Updated weights for policy 1, policy_version 702642 (0.0005) [2023-12-26 05:14:08,005][123090] Updated weights for policy 1, policy_version 702652 (0.0006) [2023-12-26 05:14:08,416][123091] Updated weights for policy 0, policy_version 707061 (0.0007) [2023-12-26 05:14:08,470][123091] Updated weights for policy 0, policy_version 707071 (0.0009) [2023-12-26 05:14:08,526][123091] Updated weights for policy 0, policy_version 707081 (0.0009) [2023-12-26 05:14:08,779][123090] Updated weights for policy 1, policy_version 702662 (0.0008) [2023-12-26 05:14:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 360898560. Throughput: 0: 8775.5, 1: 8886.5. Samples: 360874076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:14:08,785][121949] Avg episode reward: [(0, '6274.847'), (1, '5681.189')] [2023-12-26 05:14:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000707088_181018624.pth... [2023-12-26 05:14:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000706064_180756480.pth [2023-12-26 05:14:08,838][123090] Updated weights for policy 1, policy_version 702672 (0.0010) [2023-12-26 05:14:08,894][123090] Updated weights for policy 1, policy_version 702682 (0.0007) [2023-12-26 05:14:08,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000702688_179888128.pth... [2023-12-26 05:14:08,931][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000701600_179609600.pth [2023-12-26 05:14:09,461][123091] Updated weights for policy 0, policy_version 707091 (0.0009) [2023-12-26 05:14:09,522][123091] Updated weights for policy 0, policy_version 707101 (0.0009) [2023-12-26 05:14:09,585][123091] Updated weights for policy 0, policy_version 707111 (0.0009) [2023-12-26 05:14:09,683][123090] Updated weights for policy 1, policy_version 702692 (0.0008) [2023-12-26 05:14:09,745][123090] Updated weights for policy 1, policy_version 702702 (0.0010) [2023-12-26 05:14:09,806][123090] Updated weights for policy 1, policy_version 702712 (0.0011) [2023-12-26 05:14:10,383][123091] Updated weights for policy 0, policy_version 707121 (0.0009) [2023-12-26 05:14:10,442][123091] Updated weights for policy 0, policy_version 707131 (0.0010) [2023-12-26 05:14:10,502][123091] Updated weights for policy 0, policy_version 707141 (0.0010) [2023-12-26 05:14:10,568][123091] Updated weights for policy 0, policy_version 707151 (0.0009) [2023-12-26 05:14:10,630][123090] Updated weights for policy 1, policy_version 702722 (0.0010) [2023-12-26 05:14:10,703][123090] Updated weights for policy 1, policy_version 702732 (0.0008) [2023-12-26 05:14:10,773][123090] Updated weights for policy 1, policy_version 702742 (0.0007) [2023-12-26 05:14:10,842][123090] Updated weights for policy 1, policy_version 702752 (0.0009) [2023-12-26 05:14:11,436][123091] Updated weights for policy 0, policy_version 707161 (0.0010) [2023-12-26 05:14:11,503][123091] Updated weights for policy 0, policy_version 707172 (0.0010) [2023-12-26 05:14:11,553][123091] Updated weights for policy 0, policy_version 707182 (0.0009) [2023-12-26 05:14:11,719][123090] Updated weights for policy 1, policy_version 702762 (0.0010) [2023-12-26 05:14:11,784][123090] Updated weights for policy 1, policy_version 702772 (0.0010) [2023-12-26 05:14:11,852][123090] Updated weights for policy 1, policy_version 702782 (0.0009) [2023-12-26 05:14:12,320][123091] Updated weights for policy 0, policy_version 707192 (0.0009) [2023-12-26 05:14:12,398][123091] Updated weights for policy 0, policy_version 707202 (0.0013) [2023-12-26 05:14:12,469][123091] Updated weights for policy 0, policy_version 707212 (0.0010) [2023-12-26 05:14:12,719][123090] Updated weights for policy 1, policy_version 702792 (0.0009) [2023-12-26 05:14:12,786][123090] Updated weights for policy 1, policy_version 702802 (0.0009) [2023-12-26 05:14:12,851][123090] Updated weights for policy 1, policy_version 702812 (0.0010) [2023-12-26 05:14:13,270][123091] Updated weights for policy 0, policy_version 707222 (0.0010) [2023-12-26 05:14:13,318][123091] Updated weights for policy 0, policy_version 707232 (0.0009) [2023-12-26 05:14:13,378][123091] Updated weights for policy 0, policy_version 707242 (0.0009) [2023-12-26 05:14:13,707][123090] Updated weights for policy 1, policy_version 702822 (0.0009) [2023-12-26 05:14:13,766][123090] Updated weights for policy 1, policy_version 702832 (0.0008) [2023-12-26 05:14:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 360980480. Throughput: 0: 8723.8, 1: 8918.5. Samples: 360978700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:14:13,785][121949] Avg episode reward: [(0, '6246.459'), (1, '5723.288')] [2023-12-26 05:14:13,829][123090] Updated weights for policy 1, policy_version 702842 (0.0009) [2023-12-26 05:14:14,122][123091] Updated weights for policy 0, policy_version 707252 (0.0009) [2023-12-26 05:14:14,175][123091] Updated weights for policy 0, policy_version 707262 (0.0009) [2023-12-26 05:14:14,238][123091] Updated weights for policy 0, policy_version 707272 (0.0010) [2023-12-26 05:14:14,716][123090] Updated weights for policy 1, policy_version 702852 (0.0009) [2023-12-26 05:14:14,783][123090] Updated weights for policy 1, policy_version 702862 (0.0008) [2023-12-26 05:14:14,843][123090] Updated weights for policy 1, policy_version 702872 (0.0009) [2023-12-26 05:14:15,086][123091] Updated weights for policy 0, policy_version 707282 (0.0009) [2023-12-26 05:14:15,149][123091] Updated weights for policy 0, policy_version 707292 (0.0011) [2023-12-26 05:14:15,216][123091] Updated weights for policy 0, policy_version 707302 (0.0011) [2023-12-26 05:14:15,292][123091] Updated weights for policy 0, policy_version 707312 (0.0011) [2023-12-26 05:14:15,728][123090] Updated weights for policy 1, policy_version 702882 (0.0009) [2023-12-26 05:14:15,801][123090] Updated weights for policy 1, policy_version 702892 (0.0009) [2023-12-26 05:14:15,866][123090] Updated weights for policy 1, policy_version 702902 (0.0009) [2023-12-26 05:14:15,931][123090] Updated weights for policy 1, policy_version 702912 (0.0005) [2023-12-26 05:14:16,045][123091] Updated weights for policy 0, policy_version 707322 (0.0006) [2023-12-26 05:14:16,097][123091] Updated weights for policy 0, policy_version 707332 (0.0005) [2023-12-26 05:14:16,157][123091] Updated weights for policy 0, policy_version 707342 (0.0008) [2023-12-26 05:14:16,597][123090] Updated weights for policy 1, policy_version 702922 (0.0005) [2023-12-26 05:14:16,669][123090] Updated weights for policy 1, policy_version 702932 (0.0005) [2023-12-26 05:14:16,737][123090] Updated weights for policy 1, policy_version 702942 (0.0005) [2023-12-26 05:14:17,023][123091] Updated weights for policy 0, policy_version 707352 (0.0010) [2023-12-26 05:14:17,077][123091] Updated weights for policy 0, policy_version 707362 (0.0010) [2023-12-26 05:14:17,131][123091] Updated weights for policy 0, policy_version 707372 (0.0010) [2023-12-26 05:14:17,307][123090] Updated weights for policy 1, policy_version 702952 (0.0006) [2023-12-26 05:14:17,379][123090] Updated weights for policy 1, policy_version 702962 (0.0005) [2023-12-26 05:14:17,443][123090] Updated weights for policy 1, policy_version 702972 (0.0006) [2023-12-26 05:14:17,962][123091] Updated weights for policy 0, policy_version 707382 (0.0007) [2023-12-26 05:14:18,013][123090] Updated weights for policy 1, policy_version 702982 (0.0008) [2023-12-26 05:14:18,026][123091] Updated weights for policy 0, policy_version 707392 (0.0005) [2023-12-26 05:14:18,068][123090] Updated weights for policy 1, policy_version 702992 (0.0010) [2023-12-26 05:14:18,083][123091] Updated weights for policy 0, policy_version 707402 (0.0005) [2023-12-26 05:14:18,131][123090] Updated weights for policy 1, policy_version 703002 (0.0010) [2023-12-26 05:14:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 361070592. Throughput: 0: 8716.3, 1: 8921.8. Samples: 361085516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:14:18,785][121949] Avg episode reward: [(0, '6246.633'), (1, '5791.484')] [2023-12-26 05:14:18,853][123091] Updated weights for policy 0, policy_version 707412 (0.0006) [2023-12-26 05:14:18,913][123091] Updated weights for policy 0, policy_version 707422 (0.0006) [2023-12-26 05:14:18,978][123091] Updated weights for policy 0, policy_version 707432 (0.0006) [2023-12-26 05:14:19,006][123090] Updated weights for policy 1, policy_version 703012 (0.0010) [2023-12-26 05:14:19,067][123090] Updated weights for policy 1, policy_version 703022 (0.0009) [2023-12-26 05:14:19,125][123090] Updated weights for policy 1, policy_version 703032 (0.0010) [2023-12-26 05:14:19,754][123091] Updated weights for policy 0, policy_version 707442 (0.0007) [2023-12-26 05:14:19,822][123091] Updated weights for policy 0, policy_version 707452 (0.0011) [2023-12-26 05:14:19,894][123091] Updated weights for policy 0, policy_version 707462 (0.0010) [2023-12-26 05:14:19,972][123091] Updated weights for policy 0, policy_version 707472 (0.0010) [2023-12-26 05:14:20,055][123090] Updated weights for policy 1, policy_version 703042 (0.0009) [2023-12-26 05:14:20,121][123090] Updated weights for policy 1, policy_version 703052 (0.0010) [2023-12-26 05:14:20,182][123090] Updated weights for policy 1, policy_version 703062 (0.0011) [2023-12-26 05:14:20,247][123090] Updated weights for policy 1, policy_version 703072 (0.0011) [2023-12-26 05:14:20,783][123091] Updated weights for policy 0, policy_version 707482 (0.0009) [2023-12-26 05:14:20,856][123091] Updated weights for policy 0, policy_version 707492 (0.0011) [2023-12-26 05:14:20,920][123091] Updated weights for policy 0, policy_version 707502 (0.0011) [2023-12-26 05:14:21,118][123090] Updated weights for policy 1, policy_version 703082 (0.0009) [2023-12-26 05:14:21,185][123090] Updated weights for policy 1, policy_version 703092 (0.0009) [2023-12-26 05:14:21,247][123090] Updated weights for policy 1, policy_version 703102 (0.0009) [2023-12-26 05:14:21,784][123091] Updated weights for policy 0, policy_version 707512 (0.0011) [2023-12-26 05:14:21,851][123091] Updated weights for policy 0, policy_version 707522 (0.0011) [2023-12-26 05:14:21,917][123091] Updated weights for policy 0, policy_version 707532 (0.0010) [2023-12-26 05:14:22,128][123090] Updated weights for policy 1, policy_version 703112 (0.0009) [2023-12-26 05:14:22,181][123090] Updated weights for policy 1, policy_version 703122 (0.0007) [2023-12-26 05:14:22,232][123090] Updated weights for policy 1, policy_version 703132 (0.0006) [2023-12-26 05:14:22,779][123091] Updated weights for policy 0, policy_version 707542 (0.0011) [2023-12-26 05:14:22,841][123091] Updated weights for policy 0, policy_version 707552 (0.0010) [2023-12-26 05:14:22,899][123091] Updated weights for policy 0, policy_version 707562 (0.0010) [2023-12-26 05:14:23,051][123090] Updated weights for policy 1, policy_version 703142 (0.0007) [2023-12-26 05:14:23,134][123090] Updated weights for policy 1, policy_version 703152 (0.0006) [2023-12-26 05:14:23,204][123090] Updated weights for policy 1, policy_version 703162 (0.0009) [2023-12-26 05:14:23,625][123091] Updated weights for policy 0, policy_version 707572 (0.0010) [2023-12-26 05:14:23,693][123091] Updated weights for policy 0, policy_version 707582 (0.0008) [2023-12-26 05:14:23,761][123091] Updated weights for policy 0, policy_version 707592 (0.0007) [2023-12-26 05:14:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 361152512. Throughput: 0: 8662.9, 1: 8903.2. Samples: 361134780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:14:23,785][121949] Avg episode reward: [(0, '6255.926'), (1, '5739.706')] [2023-12-26 05:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000703168_180011008.pth... [2023-12-26 05:14:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000702144_179748864.pth [2023-12-26 05:14:23,809][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000707600_181149696.pth... [2023-12-26 05:14:23,814][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000706576_180887552.pth [2023-12-26 05:14:23,944][123090] Updated weights for policy 1, policy_version 703172 (0.0008) [2023-12-26 05:14:24,014][123090] Updated weights for policy 1, policy_version 703182 (0.0005) [2023-12-26 05:14:24,075][123090] Updated weights for policy 1, policy_version 703192 (0.0007) [2023-12-26 05:14:24,394][123091] Updated weights for policy 0, policy_version 707602 (0.0006) [2023-12-26 05:14:24,454][123091] Updated weights for policy 0, policy_version 707612 (0.0006) [2023-12-26 05:14:24,519][123091] Updated weights for policy 0, policy_version 707622 (0.0006) [2023-12-26 05:14:24,581][123091] Updated weights for policy 0, policy_version 707632 (0.0006) [2023-12-26 05:14:24,855][123090] Updated weights for policy 1, policy_version 703202 (0.0010) [2023-12-26 05:14:24,925][123090] Updated weights for policy 1, policy_version 703212 (0.0007) [2023-12-26 05:14:24,998][123090] Updated weights for policy 1, policy_version 703222 (0.0011) [2023-12-26 05:14:25,072][123090] Updated weights for policy 1, policy_version 703232 (0.0011) [2023-12-26 05:14:25,228][123091] Updated weights for policy 0, policy_version 707642 (0.0005) [2023-12-26 05:14:25,299][123091] Updated weights for policy 0, policy_version 707652 (0.0007) [2023-12-26 05:14:25,368][123091] Updated weights for policy 0, policy_version 707662 (0.0007) [2023-12-26 05:14:25,852][123090] Updated weights for policy 1, policy_version 703242 (0.0010) [2023-12-26 05:14:25,900][123090] Updated weights for policy 1, policy_version 703252 (0.0010) [2023-12-26 05:14:25,952][123090] Updated weights for policy 1, policy_version 703262 (0.0010) [2023-12-26 05:14:25,979][123091] Updated weights for policy 0, policy_version 707672 (0.0010) [2023-12-26 05:14:26,030][123091] Updated weights for policy 0, policy_version 707682 (0.0010) [2023-12-26 05:14:26,099][123091] Updated weights for policy 0, policy_version 707692 (0.0011) [2023-12-26 05:14:26,726][123090] Updated weights for policy 1, policy_version 703272 (0.0010) [2023-12-26 05:14:26,801][123090] Updated weights for policy 1, policy_version 703282 (0.0011) [2023-12-26 05:14:26,847][123091] Updated weights for policy 0, policy_version 707702 (0.0009) [2023-12-26 05:14:26,857][123090] Updated weights for policy 1, policy_version 703292 (0.0010) [2023-12-26 05:14:26,898][123091] Updated weights for policy 0, policy_version 707712 (0.0010) [2023-12-26 05:14:26,953][123091] Updated weights for policy 0, policy_version 707722 (0.0010) [2023-12-26 05:14:27,681][123090] Updated weights for policy 1, policy_version 703302 (0.0010) [2023-12-26 05:14:27,730][123091] Updated weights for policy 0, policy_version 707732 (0.0009) [2023-12-26 05:14:27,748][123090] Updated weights for policy 1, policy_version 703312 (0.0011) [2023-12-26 05:14:27,787][123091] Updated weights for policy 0, policy_version 707742 (0.0009) [2023-12-26 05:14:27,814][123090] Updated weights for policy 1, policy_version 703322 (0.0010) [2023-12-26 05:14:27,835][123091] Updated weights for policy 0, policy_version 707752 (0.0006) [2023-12-26 05:14:28,633][123090] Updated weights for policy 1, policy_version 703332 (0.0010) [2023-12-26 05:14:28,687][123091] Updated weights for policy 0, policy_version 707762 (0.0009) [2023-12-26 05:14:28,691][123090] Updated weights for policy 1, policy_version 703342 (0.0010) [2023-12-26 05:14:28,750][123091] Updated weights for policy 0, policy_version 707772 (0.0009) [2023-12-26 05:14:28,751][123090] Updated weights for policy 1, policy_version 703352 (0.0010) [2023-12-26 05:14:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 361242624. Throughput: 0: 8789.9, 1: 8948.5. Samples: 361245136. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:28,785][121949] Avg episode reward: [(0, '6318.228'), (1, '5758.654')] [2023-12-26 05:14:28,813][123091] Updated weights for policy 0, policy_version 707782 (0.0007) [2023-12-26 05:14:28,869][123091] Updated weights for policy 0, policy_version 707792 (0.0008) [2023-12-26 05:14:29,591][123090] Updated weights for policy 1, policy_version 703362 (0.0011) [2023-12-26 05:14:29,643][123090] Updated weights for policy 1, policy_version 703372 (0.0010) [2023-12-26 05:14:29,695][123090] Updated weights for policy 1, policy_version 703382 (0.0010) [2023-12-26 05:14:29,723][123091] Updated weights for policy 0, policy_version 707802 (0.0005) [2023-12-26 05:14:29,750][123090] Updated weights for policy 1, policy_version 703392 (0.0010) [2023-12-26 05:14:29,777][123091] Updated weights for policy 0, policy_version 707812 (0.0006) [2023-12-26 05:14:29,824][123091] Updated weights for policy 0, policy_version 707822 (0.0009) [2023-12-26 05:14:30,541][123090] Updated weights for policy 1, policy_version 703402 (0.0011) [2023-12-26 05:14:30,591][123091] Updated weights for policy 0, policy_version 707832 (0.0009) [2023-12-26 05:14:30,599][123090] Updated weights for policy 1, policy_version 703412 (0.0011) [2023-12-26 05:14:30,648][123090] Updated weights for policy 1, policy_version 703422 (0.0010) [2023-12-26 05:14:30,648][123091] Updated weights for policy 0, policy_version 707842 (0.0009) [2023-12-26 05:14:30,704][123091] Updated weights for policy 0, policy_version 707852 (0.0009) [2023-12-26 05:14:31,497][123091] Updated weights for policy 0, policy_version 707862 (0.0008) [2023-12-26 05:14:31,514][123090] Updated weights for policy 1, policy_version 703432 (0.0007) [2023-12-26 05:14:31,553][123091] Updated weights for policy 0, policy_version 707872 (0.0008) [2023-12-26 05:14:31,574][123090] Updated weights for policy 1, policy_version 703442 (0.0008) [2023-12-26 05:14:31,628][123091] Updated weights for policy 0, policy_version 707882 (0.0007) [2023-12-26 05:14:31,647][123090] Updated weights for policy 1, policy_version 703452 (0.0009) [2023-12-26 05:14:32,451][123091] Updated weights for policy 0, policy_version 707892 (0.0008) [2023-12-26 05:14:32,509][123090] Updated weights for policy 1, policy_version 703462 (0.0009) [2023-12-26 05:14:32,520][123091] Updated weights for policy 0, policy_version 707902 (0.0009) [2023-12-26 05:14:32,567][123090] Updated weights for policy 1, policy_version 703472 (0.0008) [2023-12-26 05:14:32,592][123091] Updated weights for policy 0, policy_version 707912 (0.0008) [2023-12-26 05:14:32,629][123090] Updated weights for policy 1, policy_version 703482 (0.0009) [2023-12-26 05:14:33,286][123090] Updated weights for policy 1, policy_version 703492 (0.0007) [2023-12-26 05:14:33,338][123090] Updated weights for policy 1, policy_version 703503 (0.0009) [2023-12-26 05:14:33,388][123090] Updated weights for policy 1, policy_version 703513 (0.0009) [2023-12-26 05:14:33,443][123091] Updated weights for policy 0, policy_version 707922 (0.0010) [2023-12-26 05:14:33,490][123091] Updated weights for policy 0, policy_version 707932 (0.0009) [2023-12-26 05:14:33,542][123091] Updated weights for policy 0, policy_version 707942 (0.0009) [2023-12-26 05:14:33,595][123091] Updated weights for policy 0, policy_version 707952 (0.0009) [2023-12-26 05:14:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 361340928. Throughput: 0: 8782.6, 1: 8866.6. Samples: 361348912. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:33,784][121949] Avg episode reward: [(0, '6291.745'), (1, '5761.172')] [2023-12-26 05:14:34,246][123090] Updated weights for policy 1, policy_version 703523 (0.0009) [2023-12-26 05:14:34,314][123090] Updated weights for policy 1, policy_version 703533 (0.0010) [2023-12-26 05:14:34,388][123090] Updated weights for policy 1, policy_version 703543 (0.0010) [2023-12-26 05:14:34,488][123091] Updated weights for policy 0, policy_version 707962 (0.0009) [2023-12-26 05:14:34,558][123091] Updated weights for policy 0, policy_version 707972 (0.0010) [2023-12-26 05:14:34,620][123091] Updated weights for policy 0, policy_version 707982 (0.0010) [2023-12-26 05:14:35,125][123090] Updated weights for policy 1, policy_version 703553 (0.0008) [2023-12-26 05:14:35,175][123090] Updated weights for policy 1, policy_version 703563 (0.0009) [2023-12-26 05:14:35,222][123090] Updated weights for policy 1, policy_version 703573 (0.0008) [2023-12-26 05:14:35,300][123090] Updated weights for policy 1, policy_version 703583 (0.0005) [2023-12-26 05:14:35,499][123091] Updated weights for policy 0, policy_version 707992 (0.0009) [2023-12-26 05:14:35,557][123091] Updated weights for policy 0, policy_version 708002 (0.0009) [2023-12-26 05:14:35,610][123091] Updated weights for policy 0, policy_version 708013 (0.0010) [2023-12-26 05:14:36,039][123090] Updated weights for policy 1, policy_version 703593 (0.0009) [2023-12-26 05:14:36,086][123090] Updated weights for policy 1, policy_version 703603 (0.0008) [2023-12-26 05:14:36,146][123090] Updated weights for policy 1, policy_version 703613 (0.0010) [2023-12-26 05:14:36,478][123091] Updated weights for policy 0, policy_version 708023 (0.0009) [2023-12-26 05:14:36,539][123091] Updated weights for policy 0, policy_version 708033 (0.0008) [2023-12-26 05:14:36,597][123091] Updated weights for policy 0, policy_version 708043 (0.0009) [2023-12-26 05:14:37,058][123090] Updated weights for policy 1, policy_version 703623 (0.0009) [2023-12-26 05:14:37,121][123090] Updated weights for policy 1, policy_version 703633 (0.0009) [2023-12-26 05:14:37,180][123090] Updated weights for policy 1, policy_version 703643 (0.0009) [2023-12-26 05:14:37,359][123091] Updated weights for policy 0, policy_version 708053 (0.0010) [2023-12-26 05:14:37,419][123091] Updated weights for policy 0, policy_version 708063 (0.0009) [2023-12-26 05:14:37,488][123091] Updated weights for policy 0, policy_version 708073 (0.0009) [2023-12-26 05:14:38,023][123090] Updated weights for policy 1, policy_version 703653 (0.0008) [2023-12-26 05:14:38,079][123090] Updated weights for policy 1, policy_version 703663 (0.0005) [2023-12-26 05:14:38,143][123090] Updated weights for policy 1, policy_version 703673 (0.0005) [2023-12-26 05:14:38,304][123091] Updated weights for policy 0, policy_version 708083 (0.0009) [2023-12-26 05:14:38,373][123091] Updated weights for policy 0, policy_version 708093 (0.0009) [2023-12-26 05:14:38,427][123091] Updated weights for policy 0, policy_version 708103 (0.0009) [2023-12-26 05:14:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 361422848. Throughput: 0: 8741.0, 1: 8901.0. Samples: 361400544. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:38,785][121949] Avg episode reward: [(0, '6107.455'), (1, '5722.973')] [2023-12-26 05:14:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000703680_180142080.pth... [2023-12-26 05:14:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000708112_181280768.pth... [2023-12-26 05:14:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000702688_179888128.pth [2023-12-26 05:14:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000707088_181018624.pth [2023-12-26 05:14:38,839][123090] Updated weights for policy 1, policy_version 703683 (0.0005) [2023-12-26 05:14:38,907][123090] Updated weights for policy 1, policy_version 703693 (0.0010) [2023-12-26 05:14:38,966][123090] Updated weights for policy 1, policy_version 703703 (0.0010) [2023-12-26 05:14:39,297][123091] Updated weights for policy 0, policy_version 708113 (0.0010) [2023-12-26 05:14:39,365][123091] Updated weights for policy 0, policy_version 708123 (0.0009) [2023-12-26 05:14:39,434][123091] Updated weights for policy 0, policy_version 708133 (0.0009) [2023-12-26 05:14:39,496][123091] Updated weights for policy 0, policy_version 708143 (0.0010) [2023-12-26 05:14:39,736][123090] Updated weights for policy 1, policy_version 703713 (0.0010) [2023-12-26 05:14:39,802][123090] Updated weights for policy 1, policy_version 703723 (0.0009) [2023-12-26 05:14:39,869][123090] Updated weights for policy 1, policy_version 703733 (0.0009) [2023-12-26 05:14:39,935][123090] Updated weights for policy 1, policy_version 703743 (0.0010) [2023-12-26 05:14:40,333][123091] Updated weights for policy 0, policy_version 708153 (0.0010) [2023-12-26 05:14:40,382][123091] Updated weights for policy 0, policy_version 708163 (0.0009) [2023-12-26 05:14:40,447][123091] Updated weights for policy 0, policy_version 708173 (0.0009) [2023-12-26 05:14:40,758][123090] Updated weights for policy 1, policy_version 703753 (0.0009) [2023-12-26 05:14:40,812][123090] Updated weights for policy 1, policy_version 703763 (0.0009) [2023-12-26 05:14:40,861][123090] Updated weights for policy 1, policy_version 703773 (0.0009) [2023-12-26 05:14:41,339][123091] Updated weights for policy 0, policy_version 708183 (0.0010) [2023-12-26 05:14:41,409][123091] Updated weights for policy 0, policy_version 708193 (0.0010) [2023-12-26 05:14:41,475][123091] Updated weights for policy 0, policy_version 708203 (0.0010) [2023-12-26 05:14:41,760][123090] Updated weights for policy 1, policy_version 703783 (0.0010) [2023-12-26 05:14:41,824][123090] Updated weights for policy 1, policy_version 703793 (0.0009) [2023-12-26 05:14:41,893][123090] Updated weights for policy 1, policy_version 703803 (0.0010) [2023-12-26 05:14:42,355][123091] Updated weights for policy 0, policy_version 708213 (0.0009) [2023-12-26 05:14:42,418][123091] Updated weights for policy 0, policy_version 708223 (0.0009) [2023-12-26 05:14:42,482][123091] Updated weights for policy 0, policy_version 708233 (0.0009) [2023-12-26 05:14:42,712][123090] Updated weights for policy 1, policy_version 703813 (0.0010) [2023-12-26 05:14:42,769][123090] Updated weights for policy 1, policy_version 703823 (0.0008) [2023-12-26 05:14:42,817][123090] Updated weights for policy 1, policy_version 703833 (0.0009) [2023-12-26 05:14:43,316][123091] Updated weights for policy 0, policy_version 708243 (0.0009) [2023-12-26 05:14:43,368][123091] Updated weights for policy 0, policy_version 708253 (0.0010) [2023-12-26 05:14:43,426][123091] Updated weights for policy 0, policy_version 708263 (0.0010) [2023-12-26 05:14:43,670][123090] Updated weights for policy 1, policy_version 703843 (0.0009) [2023-12-26 05:14:43,727][123090] Updated weights for policy 1, policy_version 703853 (0.0009) [2023-12-26 05:14:43,776][123090] Updated weights for policy 1, policy_version 703863 (0.0009) [2023-12-26 05:14:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 361504768. Throughput: 0: 8742.8, 1: 8738.1. Samples: 361501664. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:43,785][121949] Avg episode reward: [(0, '6090.844'), (1, '5457.093')] [2023-12-26 05:14:44,234][123091] Updated weights for policy 0, policy_version 708273 (0.0010) [2023-12-26 05:14:44,297][123091] Updated weights for policy 0, policy_version 708283 (0.0010) [2023-12-26 05:14:44,355][123091] Updated weights for policy 0, policy_version 708293 (0.0010) [2023-12-26 05:14:44,419][123091] Updated weights for policy 0, policy_version 708303 (0.0010) [2023-12-26 05:14:44,642][123090] Updated weights for policy 1, policy_version 703873 (0.0009) [2023-12-26 05:14:44,701][123090] Updated weights for policy 1, policy_version 703883 (0.0010) [2023-12-26 05:14:44,762][123090] Updated weights for policy 1, policy_version 703893 (0.0010) [2023-12-26 05:14:44,826][123090] Updated weights for policy 1, policy_version 703903 (0.0009) [2023-12-26 05:14:45,147][123091] Updated weights for policy 0, policy_version 708313 (0.0011) [2023-12-26 05:14:45,205][123091] Updated weights for policy 0, policy_version 708323 (0.0010) [2023-12-26 05:14:45,266][123091] Updated weights for policy 0, policy_version 708333 (0.0010) [2023-12-26 05:14:45,702][123090] Updated weights for policy 1, policy_version 703913 (0.0010) [2023-12-26 05:14:45,767][123090] Updated weights for policy 1, policy_version 703923 (0.0009) [2023-12-26 05:14:45,831][123090] Updated weights for policy 1, policy_version 703933 (0.0009) [2023-12-26 05:14:46,105][123091] Updated weights for policy 0, policy_version 708343 (0.0008) [2023-12-26 05:14:46,169][123091] Updated weights for policy 0, policy_version 708353 (0.0006) [2023-12-26 05:14:46,237][123091] Updated weights for policy 0, policy_version 708363 (0.0006) [2023-12-26 05:14:46,613][123090] Updated weights for policy 1, policy_version 703943 (0.0009) [2023-12-26 05:14:46,681][123090] Updated weights for policy 1, policy_version 703953 (0.0009) [2023-12-26 05:14:46,742][123090] Updated weights for policy 1, policy_version 703963 (0.0009) [2023-12-26 05:14:46,946][123091] Updated weights for policy 0, policy_version 708373 (0.0007) [2023-12-26 05:14:47,007][123091] Updated weights for policy 0, policy_version 708383 (0.0005) [2023-12-26 05:14:47,060][123091] Updated weights for policy 0, policy_version 708393 (0.0005) [2023-12-26 05:14:47,606][123090] Updated weights for policy 1, policy_version 703973 (0.0007) [2023-12-26 05:14:47,682][123090] Updated weights for policy 1, policy_version 703983 (0.0005) [2023-12-26 05:14:47,743][123090] Updated weights for policy 1, policy_version 703993 (0.0007) [2023-12-26 05:14:47,810][123091] Updated weights for policy 0, policy_version 708403 (0.0007) [2023-12-26 05:14:47,872][123091] Updated weights for policy 0, policy_version 708413 (0.0011) [2023-12-26 05:14:47,923][123091] Updated weights for policy 0, policy_version 708423 (0.0010) [2023-12-26 05:14:48,426][123090] Updated weights for policy 1, policy_version 704003 (0.0007) [2023-12-26 05:14:48,483][123090] Updated weights for policy 1, policy_version 704013 (0.0005) [2023-12-26 05:14:48,547][123090] Updated weights for policy 1, policy_version 704023 (0.0006) [2023-12-26 05:14:48,752][123091] Updated weights for policy 0, policy_version 708433 (0.0010) [2023-12-26 05:14:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 361594880. Throughput: 0: 8822.8, 1: 8701.2. Samples: 361607628. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:48,785][121949] Avg episode reward: [(0, '6219.416'), (1, '5370.332')] [2023-12-26 05:14:48,818][123091] Updated weights for policy 0, policy_version 708443 (0.0010) [2023-12-26 05:14:48,874][123091] Updated weights for policy 0, policy_version 708453 (0.0011) [2023-12-26 05:14:48,940][123091] Updated weights for policy 0, policy_version 708463 (0.0011) [2023-12-26 05:14:49,293][123090] Updated weights for policy 1, policy_version 704033 (0.0005) [2023-12-26 05:14:49,352][123090] Updated weights for policy 1, policy_version 704043 (0.0007) [2023-12-26 05:14:49,425][123090] Updated weights for policy 1, policy_version 704053 (0.0007) [2023-12-26 05:14:49,493][123090] Updated weights for policy 1, policy_version 704063 (0.0005) [2023-12-26 05:14:49,733][123091] Updated weights for policy 0, policy_version 708473 (0.0008) [2023-12-26 05:14:49,792][123091] Updated weights for policy 0, policy_version 708483 (0.0008) [2023-12-26 05:14:49,855][123091] Updated weights for policy 0, policy_version 708493 (0.0009) [2023-12-26 05:14:50,208][123090] Updated weights for policy 1, policy_version 704073 (0.0009) [2023-12-26 05:14:50,291][123090] Updated weights for policy 1, policy_version 704083 (0.0009) [2023-12-26 05:14:50,369][123090] Updated weights for policy 1, policy_version 704093 (0.0009) [2023-12-26 05:14:50,657][123091] Updated weights for policy 0, policy_version 708503 (0.0008) [2023-12-26 05:14:50,722][123091] Updated weights for policy 0, policy_version 708513 (0.0010) [2023-12-26 05:14:50,775][123091] Updated weights for policy 0, policy_version 708523 (0.0009) [2023-12-26 05:14:51,166][123090] Updated weights for policy 1, policy_version 704103 (0.0009) [2023-12-26 05:14:51,221][123090] Updated weights for policy 1, policy_version 704113 (0.0010) [2023-12-26 05:14:51,283][123090] Updated weights for policy 1, policy_version 704123 (0.0009) [2023-12-26 05:14:51,575][123091] Updated weights for policy 0, policy_version 708533 (0.0010) [2023-12-26 05:14:51,641][123091] Updated weights for policy 0, policy_version 708543 (0.0011) [2023-12-26 05:14:51,708][123091] Updated weights for policy 0, policy_version 708553 (0.0011) [2023-12-26 05:14:52,177][123090] Updated weights for policy 1, policy_version 704133 (0.0009) [2023-12-26 05:14:52,226][123090] Updated weights for policy 1, policy_version 704143 (0.0009) [2023-12-26 05:14:52,285][123090] Updated weights for policy 1, policy_version 704153 (0.0009) [2023-12-26 05:14:52,554][123091] Updated weights for policy 0, policy_version 708563 (0.0012) [2023-12-26 05:14:52,614][123091] Updated weights for policy 0, policy_version 708573 (0.0009) [2023-12-26 05:14:52,664][123091] Updated weights for policy 0, policy_version 708583 (0.0009) [2023-12-26 05:14:53,192][123090] Updated weights for policy 1, policy_version 704163 (0.0009) [2023-12-26 05:14:53,253][123090] Updated weights for policy 1, policy_version 704173 (0.0009) [2023-12-26 05:14:53,318][123090] Updated weights for policy 1, policy_version 704183 (0.0009) [2023-12-26 05:14:53,418][123091] Updated weights for policy 0, policy_version 708593 (0.0009) [2023-12-26 05:14:53,482][123091] Updated weights for policy 0, policy_version 708603 (0.0009) [2023-12-26 05:14:53,553][123091] Updated weights for policy 0, policy_version 708613 (0.0009) [2023-12-26 05:14:53,606][123091] Updated weights for policy 0, policy_version 708623 (0.0009) [2023-12-26 05:14:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 361684992. Throughput: 0: 8772.8, 1: 8701.0. Samples: 361660400. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:53,786][121949] Avg episode reward: [(0, '6285.763'), (1, '5669.672')] [2023-12-26 05:14:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000704192_180273152.pth... [2023-12-26 05:14:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000708624_181411840.pth... [2023-12-26 05:14:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000703168_180011008.pth [2023-12-26 05:14:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000707600_181149696.pth [2023-12-26 05:14:54,103][123090] Updated weights for policy 1, policy_version 704193 (0.0009) [2023-12-26 05:14:54,151][123090] Updated weights for policy 1, policy_version 704203 (0.0009) [2023-12-26 05:14:54,206][123090] Updated weights for policy 1, policy_version 704213 (0.0009) [2023-12-26 05:14:54,270][123090] Updated weights for policy 1, policy_version 704223 (0.0009) [2023-12-26 05:14:54,330][123091] Updated weights for policy 0, policy_version 708633 (0.0009) [2023-12-26 05:14:54,400][123091] Updated weights for policy 0, policy_version 708643 (0.0009) [2023-12-26 05:14:54,466][123091] Updated weights for policy 0, policy_version 708653 (0.0010) [2023-12-26 05:14:54,894][123090] Updated weights for policy 1, policy_version 704233 (0.0010) [2023-12-26 05:14:54,952][123090] Updated weights for policy 1, policy_version 704243 (0.0011) [2023-12-26 05:14:55,004][123090] Updated weights for policy 1, policy_version 704253 (0.0010) [2023-12-26 05:14:55,306][123091] Updated weights for policy 0, policy_version 708663 (0.0009) [2023-12-26 05:14:55,354][123091] Updated weights for policy 0, policy_version 708673 (0.0009) [2023-12-26 05:14:55,402][123091] Updated weights for policy 0, policy_version 708683 (0.0009) [2023-12-26 05:14:55,863][123090] Updated weights for policy 1, policy_version 704263 (0.0008) [2023-12-26 05:14:55,926][123090] Updated weights for policy 1, policy_version 704273 (0.0008) [2023-12-26 05:14:56,001][123090] Updated weights for policy 1, policy_version 704283 (0.0008) [2023-12-26 05:14:56,235][123091] Updated weights for policy 0, policy_version 708694 (0.0010) [2023-12-26 05:14:56,286][123091] Updated weights for policy 0, policy_version 708704 (0.0006) [2023-12-26 05:14:56,332][123091] Updated weights for policy 0, policy_version 708714 (0.0005) [2023-12-26 05:14:56,699][123090] Updated weights for policy 1, policy_version 704293 (0.0006) [2023-12-26 05:14:56,745][123090] Updated weights for policy 1, policy_version 704303 (0.0005) [2023-12-26 05:14:56,803][123090] Updated weights for policy 1, policy_version 704313 (0.0005) [2023-12-26 05:14:57,069][123091] Updated weights for policy 0, policy_version 708724 (0.0007) [2023-12-26 05:14:57,139][123091] Updated weights for policy 0, policy_version 708734 (0.0011) [2023-12-26 05:14:57,209][123091] Updated weights for policy 0, policy_version 708744 (0.0011) [2023-12-26 05:14:57,483][123090] Updated weights for policy 1, policy_version 704323 (0.0005) [2023-12-26 05:14:57,531][123090] Updated weights for policy 1, policy_version 704333 (0.0005) [2023-12-26 05:14:57,600][123090] Updated weights for policy 1, policy_version 704343 (0.0005) [2023-12-26 05:14:57,841][123091] Updated weights for policy 0, policy_version 708754 (0.0010) [2023-12-26 05:14:57,890][123091] Updated weights for policy 0, policy_version 708764 (0.0005) [2023-12-26 05:14:57,948][123091] Updated weights for policy 0, policy_version 708774 (0.0005) [2023-12-26 05:14:57,994][123091] Updated weights for policy 0, policy_version 708784 (0.0005) [2023-12-26 05:14:58,293][123090] Updated weights for policy 1, policy_version 704353 (0.0009) [2023-12-26 05:14:58,366][123090] Updated weights for policy 1, policy_version 704363 (0.0008) [2023-12-26 05:14:58,436][123090] Updated weights for policy 1, policy_version 704373 (0.0008) [2023-12-26 05:14:58,505][123090] Updated weights for policy 1, policy_version 704383 (0.0008) [2023-12-26 05:14:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 361775104. Throughput: 0: 8802.6, 1: 8774.9. Samples: 361769684. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:14:58,785][121949] Avg episode reward: [(0, '6214.903'), (1, '5626.078')] [2023-12-26 05:14:58,863][123091] Updated weights for policy 0, policy_version 708794 (0.0008) [2023-12-26 05:14:58,926][123091] Updated weights for policy 0, policy_version 708804 (0.0008) [2023-12-26 05:14:58,997][123091] Updated weights for policy 0, policy_version 708814 (0.0008) [2023-12-26 05:14:59,423][123090] Updated weights for policy 1, policy_version 704393 (0.0010) [2023-12-26 05:14:59,479][123090] Updated weights for policy 1, policy_version 704403 (0.0011) [2023-12-26 05:14:59,547][123090] Updated weights for policy 1, policy_version 704413 (0.0011) [2023-12-26 05:14:59,820][123091] Updated weights for policy 0, policy_version 708824 (0.0009) [2023-12-26 05:14:59,876][123091] Updated weights for policy 0, policy_version 708834 (0.0008) [2023-12-26 05:14:59,946][123091] Updated weights for policy 0, policy_version 708844 (0.0008) [2023-12-26 05:15:00,393][123090] Updated weights for policy 1, policy_version 704423 (0.0008) [2023-12-26 05:15:00,465][123090] Updated weights for policy 1, policy_version 704433 (0.0005) [2023-12-26 05:15:00,525][123090] Updated weights for policy 1, policy_version 704443 (0.0005) [2023-12-26 05:15:00,751][123091] Updated weights for policy 0, policy_version 708854 (0.0009) [2023-12-26 05:15:00,801][123091] Updated weights for policy 0, policy_version 708864 (0.0005) [2023-12-26 05:15:00,846][123091] Updated weights for policy 0, policy_version 708874 (0.0005) [2023-12-26 05:15:01,167][123090] Updated weights for policy 1, policy_version 704453 (0.0007) [2023-12-26 05:15:01,237][123090] Updated weights for policy 1, policy_version 704463 (0.0005) [2023-12-26 05:15:01,306][123090] Updated weights for policy 1, policy_version 704473 (0.0006) [2023-12-26 05:15:01,574][123091] Updated weights for policy 0, policy_version 708884 (0.0006) [2023-12-26 05:15:01,639][123091] Updated weights for policy 0, policy_version 708894 (0.0008) [2023-12-26 05:15:01,712][123091] Updated weights for policy 0, policy_version 708904 (0.0006) [2023-12-26 05:15:02,114][123090] Updated weights for policy 1, policy_version 704483 (0.0009) [2023-12-26 05:15:02,162][123090] Updated weights for policy 1, policy_version 704493 (0.0010) [2023-12-26 05:15:02,210][123090] Updated weights for policy 1, policy_version 704503 (0.0010) [2023-12-26 05:15:02,400][123091] Updated weights for policy 0, policy_version 708914 (0.0007) [2023-12-26 05:15:02,464][123091] Updated weights for policy 0, policy_version 708924 (0.0008) [2023-12-26 05:15:02,527][123091] Updated weights for policy 0, policy_version 708934 (0.0008) [2023-12-26 05:15:02,594][123091] Updated weights for policy 0, policy_version 708944 (0.0008) [2023-12-26 05:15:03,062][123090] Updated weights for policy 1, policy_version 704513 (0.0010) [2023-12-26 05:15:03,108][123090] Updated weights for policy 1, policy_version 704523 (0.0005) [2023-12-26 05:15:03,155][123090] Updated weights for policy 1, policy_version 704533 (0.0005) [2023-12-26 05:15:03,201][123090] Updated weights for policy 1, policy_version 704543 (0.0005) [2023-12-26 05:15:03,393][123091] Updated weights for policy 0, policy_version 708954 (0.0009) [2023-12-26 05:15:03,467][123091] Updated weights for policy 0, policy_version 708964 (0.0009) [2023-12-26 05:15:03,534][123091] Updated weights for policy 0, policy_version 708974 (0.0009) [2023-12-26 05:15:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 361865216. Throughput: 0: 8822.6, 1: 8779.6. Samples: 361877616. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:03,785][121949] Avg episode reward: [(0, '6174.110'), (1, '5515.163')] [2023-12-26 05:15:03,983][123090] Updated weights for policy 1, policy_version 704553 (0.0008) [2023-12-26 05:15:04,037][123090] Updated weights for policy 1, policy_version 704563 (0.0010) [2023-12-26 05:15:04,099][123090] Updated weights for policy 1, policy_version 704573 (0.0009) [2023-12-26 05:15:04,317][123091] Updated weights for policy 0, policy_version 708984 (0.0009) [2023-12-26 05:15:04,386][123091] Updated weights for policy 0, policy_version 708994 (0.0010) [2023-12-26 05:15:04,442][123091] Updated weights for policy 0, policy_version 709004 (0.0010) [2023-12-26 05:15:04,936][123090] Updated weights for policy 1, policy_version 704583 (0.0010) [2023-12-26 05:15:05,002][123090] Updated weights for policy 1, policy_version 704593 (0.0010) [2023-12-26 05:15:05,061][123090] Updated weights for policy 1, policy_version 704603 (0.0010) [2023-12-26 05:15:05,233][123091] Updated weights for policy 0, policy_version 709014 (0.0010) [2023-12-26 05:15:05,298][123091] Updated weights for policy 0, policy_version 709024 (0.0009) [2023-12-26 05:15:05,360][123091] Updated weights for policy 0, policy_version 709034 (0.0009) [2023-12-26 05:15:05,914][123090] Updated weights for policy 1, policy_version 704613 (0.0010) [2023-12-26 05:15:05,978][123090] Updated weights for policy 1, policy_version 704623 (0.0006) [2023-12-26 05:15:06,039][123090] Updated weights for policy 1, policy_version 704633 (0.0006) [2023-12-26 05:15:06,108][123091] Updated weights for policy 0, policy_version 709044 (0.0009) [2023-12-26 05:15:06,167][123091] Updated weights for policy 0, policy_version 709054 (0.0008) [2023-12-26 05:15:06,223][123091] Updated weights for policy 0, policy_version 709064 (0.0009) [2023-12-26 05:15:06,830][123090] Updated weights for policy 1, policy_version 704643 (0.0011) [2023-12-26 05:15:06,894][123090] Updated weights for policy 1, policy_version 704653 (0.0011) [2023-12-26 05:15:06,966][123090] Updated weights for policy 1, policy_version 704663 (0.0011) [2023-12-26 05:15:07,062][123091] Updated weights for policy 0, policy_version 709074 (0.0009) [2023-12-26 05:15:07,127][123091] Updated weights for policy 0, policy_version 709084 (0.0009) [2023-12-26 05:15:07,197][123091] Updated weights for policy 0, policy_version 709094 (0.0010) [2023-12-26 05:15:07,263][123091] Updated weights for policy 0, policy_version 709104 (0.0010) [2023-12-26 05:15:07,609][123090] Updated weights for policy 1, policy_version 704673 (0.0010) [2023-12-26 05:15:07,667][123090] Updated weights for policy 1, policy_version 704683 (0.0006) [2023-12-26 05:15:07,728][123090] Updated weights for policy 1, policy_version 704693 (0.0010) [2023-12-26 05:15:07,776][123090] Updated weights for policy 1, policy_version 704703 (0.0010) [2023-12-26 05:15:08,070][123091] Updated weights for policy 0, policy_version 709114 (0.0006) [2023-12-26 05:15:08,130][123091] Updated weights for policy 0, policy_version 709124 (0.0006) [2023-12-26 05:15:08,193][123091] Updated weights for policy 0, policy_version 709134 (0.0005) [2023-12-26 05:15:08,410][123090] Updated weights for policy 1, policy_version 704713 (0.0010) [2023-12-26 05:15:08,478][123090] Updated weights for policy 1, policy_version 704723 (0.0010) [2023-12-26 05:15:08,551][123090] Updated weights for policy 1, policy_version 704733 (0.0010) [2023-12-26 05:15:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 361955328. Throughput: 0: 8853.1, 1: 8809.0. Samples: 361929576. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:08,785][121949] Avg episode reward: [(0, '6261.089'), (1, '5687.875')] [2023-12-26 05:15:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000709136_181542912.pth... [2023-12-26 05:15:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000704736_180412416.pth... [2023-12-26 05:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000708112_181280768.pth [2023-12-26 05:15:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000703680_180142080.pth [2023-12-26 05:15:08,868][123091] Updated weights for policy 0, policy_version 709144 (0.0010) [2023-12-26 05:15:08,919][123091] Updated weights for policy 0, policy_version 709154 (0.0010) [2023-12-26 05:15:08,963][123091] Updated weights for policy 0, policy_version 709164 (0.0010) [2023-12-26 05:15:09,315][123090] Updated weights for policy 1, policy_version 704743 (0.0011) [2023-12-26 05:15:09,389][123090] Updated weights for policy 1, policy_version 704753 (0.0012) [2023-12-26 05:15:09,453][123090] Updated weights for policy 1, policy_version 704763 (0.0010) [2023-12-26 05:15:09,783][123091] Updated weights for policy 0, policy_version 709174 (0.0010) [2023-12-26 05:15:09,851][123091] Updated weights for policy 0, policy_version 709184 (0.0009) [2023-12-26 05:15:09,912][123091] Updated weights for policy 0, policy_version 709194 (0.0010) [2023-12-26 05:15:10,286][123090] Updated weights for policy 1, policy_version 704773 (0.0008) [2023-12-26 05:15:10,360][123090] Updated weights for policy 1, policy_version 704783 (0.0006) [2023-12-26 05:15:10,430][123090] Updated weights for policy 1, policy_version 704793 (0.0005) [2023-12-26 05:15:10,702][123091] Updated weights for policy 0, policy_version 709204 (0.0008) [2023-12-26 05:15:10,769][123091] Updated weights for policy 0, policy_version 709214 (0.0010) [2023-12-26 05:15:10,832][123091] Updated weights for policy 0, policy_version 709224 (0.0011) [2023-12-26 05:15:11,027][123090] Updated weights for policy 1, policy_version 704803 (0.0007) [2023-12-26 05:15:11,095][123090] Updated weights for policy 1, policy_version 704813 (0.0010) [2023-12-26 05:15:11,170][123090] Updated weights for policy 1, policy_version 704823 (0.0010) [2023-12-26 05:15:11,591][123091] Updated weights for policy 0, policy_version 709234 (0.0009) [2023-12-26 05:15:11,666][123091] Updated weights for policy 0, policy_version 709244 (0.0010) [2023-12-26 05:15:11,727][123091] Updated weights for policy 0, policy_version 709254 (0.0011) [2023-12-26 05:15:11,790][123091] Updated weights for policy 0, policy_version 709264 (0.0011) [2023-12-26 05:15:11,976][123090] Updated weights for policy 1, policy_version 704833 (0.0010) [2023-12-26 05:15:12,043][123090] Updated weights for policy 1, policy_version 704843 (0.0006) [2023-12-26 05:15:12,100][123090] Updated weights for policy 1, policy_version 704853 (0.0006) [2023-12-26 05:15:12,167][123090] Updated weights for policy 1, policy_version 704863 (0.0006) [2023-12-26 05:15:12,560][123091] Updated weights for policy 0, policy_version 709274 (0.0011) [2023-12-26 05:15:12,628][123091] Updated weights for policy 0, policy_version 709284 (0.0011) [2023-12-26 05:15:12,694][123091] Updated weights for policy 0, policy_version 709294 (0.0011) [2023-12-26 05:15:12,977][123090] Updated weights for policy 1, policy_version 704873 (0.0011) [2023-12-26 05:15:13,041][123090] Updated weights for policy 1, policy_version 704883 (0.0011) [2023-12-26 05:15:13,104][123090] Updated weights for policy 1, policy_version 704893 (0.0011) [2023-12-26 05:15:13,451][123091] Updated weights for policy 0, policy_version 709304 (0.0006) [2023-12-26 05:15:13,499][123091] Updated weights for policy 0, policy_version 709314 (0.0005) [2023-12-26 05:15:13,555][123091] Updated weights for policy 0, policy_version 709324 (0.0006) [2023-12-26 05:15:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 362045440. Throughput: 0: 8798.2, 1: 8848.7. Samples: 362039244. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:13,784][121949] Avg episode reward: [(0, '6227.143'), (1, '5779.422')] [2023-12-26 05:15:13,937][123090] Updated weights for policy 1, policy_version 704903 (0.0010) [2023-12-26 05:15:13,999][123090] Updated weights for policy 1, policy_version 704913 (0.0010) [2023-12-26 05:15:14,065][123090] Updated weights for policy 1, policy_version 704923 (0.0010) [2023-12-26 05:15:14,280][123091] Updated weights for policy 0, policy_version 709334 (0.0009) [2023-12-26 05:15:14,332][123091] Updated weights for policy 0, policy_version 709344 (0.0011) [2023-12-26 05:15:14,387][123091] Updated weights for policy 0, policy_version 709354 (0.0011) [2023-12-26 05:15:14,866][123090] Updated weights for policy 1, policy_version 704933 (0.0010) [2023-12-26 05:15:14,931][123090] Updated weights for policy 1, policy_version 704943 (0.0007) [2023-12-26 05:15:14,997][123090] Updated weights for policy 1, policy_version 704953 (0.0006) [2023-12-26 05:15:15,175][123091] Updated weights for policy 0, policy_version 709364 (0.0010) [2023-12-26 05:15:15,239][123091] Updated weights for policy 0, policy_version 709374 (0.0008) [2023-12-26 05:15:15,305][123091] Updated weights for policy 0, policy_version 709384 (0.0007) [2023-12-26 05:15:15,812][123090] Updated weights for policy 1, policy_version 704963 (0.0009) [2023-12-26 05:15:15,866][123090] Updated weights for policy 1, policy_version 704973 (0.0005) [2023-12-26 05:15:15,915][123090] Updated weights for policy 1, policy_version 704983 (0.0009) [2023-12-26 05:15:16,046][123091] Updated weights for policy 0, policy_version 709394 (0.0008) [2023-12-26 05:15:16,111][123091] Updated weights for policy 0, policy_version 709404 (0.0005) [2023-12-26 05:15:16,182][123091] Updated weights for policy 0, policy_version 709414 (0.0005) [2023-12-26 05:15:16,248][123091] Updated weights for policy 0, policy_version 709424 (0.0006) [2023-12-26 05:15:16,703][123090] Updated weights for policy 1, policy_version 704993 (0.0010) [2023-12-26 05:15:16,770][123090] Updated weights for policy 1, policy_version 705003 (0.0009) [2023-12-26 05:15:16,837][123090] Updated weights for policy 1, policy_version 705013 (0.0008) [2023-12-26 05:15:16,898][123090] Updated weights for policy 1, policy_version 705023 (0.0009) [2023-12-26 05:15:16,930][123091] Updated weights for policy 0, policy_version 709434 (0.0006) [2023-12-26 05:15:16,984][123091] Updated weights for policy 0, policy_version 709444 (0.0007) [2023-12-26 05:15:17,042][123091] Updated weights for policy 0, policy_version 709454 (0.0006) [2023-12-26 05:15:17,696][123090] Updated weights for policy 1, policy_version 705033 (0.0006) [2023-12-26 05:15:17,714][123091] Updated weights for policy 0, policy_version 709464 (0.0005) [2023-12-26 05:15:17,746][123090] Updated weights for policy 1, policy_version 705043 (0.0006) [2023-12-26 05:15:17,785][123091] Updated weights for policy 0, policy_version 709474 (0.0006) [2023-12-26 05:15:17,791][123090] Updated weights for policy 1, policy_version 705053 (0.0006) [2023-12-26 05:15:17,853][123091] Updated weights for policy 0, policy_version 709484 (0.0005) [2023-12-26 05:15:18,564][123091] Updated weights for policy 0, policy_version 709494 (0.0009) [2023-12-26 05:15:18,605][123090] Updated weights for policy 1, policy_version 705063 (0.0009) [2023-12-26 05:15:18,627][123091] Updated weights for policy 0, policy_version 709504 (0.0010) [2023-12-26 05:15:18,657][123090] Updated weights for policy 1, policy_version 705073 (0.0010) [2023-12-26 05:15:18,683][123091] Updated weights for policy 0, policy_version 709514 (0.0010) [2023-12-26 05:15:18,717][123090] Updated weights for policy 1, policy_version 705083 (0.0010) [2023-12-26 05:15:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 362143744. Throughput: 0: 8910.7, 1: 8854.9. Samples: 362148368. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:18,785][121949] Avg episode reward: [(0, '6133.070'), (1, '5774.038')] [2023-12-26 05:15:19,511][123091] Updated weights for policy 0, policy_version 709524 (0.0009) [2023-12-26 05:15:19,567][123091] Updated weights for policy 0, policy_version 709534 (0.0007) [2023-12-26 05:15:19,606][123090] Updated weights for policy 1, policy_version 705093 (0.0008) [2023-12-26 05:15:19,634][123091] Updated weights for policy 0, policy_version 709544 (0.0011) [2023-12-26 05:15:19,668][123090] Updated weights for policy 1, policy_version 705103 (0.0005) [2023-12-26 05:15:19,730][123090] Updated weights for policy 1, policy_version 705113 (0.0006) [2023-12-26 05:15:20,462][123091] Updated weights for policy 0, policy_version 709554 (0.0011) [2023-12-26 05:15:20,492][123090] Updated weights for policy 1, policy_version 705123 (0.0009) [2023-12-26 05:15:20,537][123091] Updated weights for policy 0, policy_version 709564 (0.0011) [2023-12-26 05:15:20,550][123090] Updated weights for policy 1, policy_version 705133 (0.0008) [2023-12-26 05:15:20,607][123091] Updated weights for policy 0, policy_version 709574 (0.0011) [2023-12-26 05:15:20,619][123090] Updated weights for policy 1, policy_version 705143 (0.0007) [2023-12-26 05:15:20,674][123091] Updated weights for policy 0, policy_version 709584 (0.0010) [2023-12-26 05:15:21,427][123090] Updated weights for policy 1, policy_version 705153 (0.0009) [2023-12-26 05:15:21,484][123090] Updated weights for policy 1, policy_version 705163 (0.0007) [2023-12-26 05:15:21,488][123091] Updated weights for policy 0, policy_version 709594 (0.0010) [2023-12-26 05:15:21,538][123090] Updated weights for policy 1, policy_version 705173 (0.0007) [2023-12-26 05:15:21,551][123091] Updated weights for policy 0, policy_version 709604 (0.0010) [2023-12-26 05:15:21,603][123090] Updated weights for policy 1, policy_version 705183 (0.0009) [2023-12-26 05:15:21,604][123091] Updated weights for policy 0, policy_version 709614 (0.0010) [2023-12-26 05:15:22,480][123091] Updated weights for policy 0, policy_version 709624 (0.0011) [2023-12-26 05:15:22,551][123091] Updated weights for policy 0, policy_version 709634 (0.0011) [2023-12-26 05:15:22,580][123090] Updated weights for policy 1, policy_version 705193 (0.0007) [2023-12-26 05:15:22,616][123091] Updated weights for policy 0, policy_version 709644 (0.0011) [2023-12-26 05:15:22,649][123090] Updated weights for policy 1, policy_version 705203 (0.0006) [2023-12-26 05:15:22,719][123090] Updated weights for policy 1, policy_version 705213 (0.0009) [2023-12-26 05:15:23,438][123091] Updated weights for policy 0, policy_version 709654 (0.0011) [2023-12-26 05:15:23,489][123091] Updated weights for policy 0, policy_version 709664 (0.0010) [2023-12-26 05:15:23,541][123090] Updated weights for policy 1, policy_version 705223 (0.0009) [2023-12-26 05:15:23,545][123091] Updated weights for policy 0, policy_version 709674 (0.0010) [2023-12-26 05:15:23,599][123090] Updated weights for policy 1, policy_version 705233 (0.0009) [2023-12-26 05:15:23,664][123090] Updated weights for policy 1, policy_version 705243 (0.0009) [2023-12-26 05:15:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 362225664. Throughput: 0: 8926.1, 1: 8832.4. Samples: 362199672. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:23,785][121949] Avg episode reward: [(0, '6140.100'), (1, '5759.616')] [2023-12-26 05:15:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000709680_181682176.pth... [2023-12-26 05:15:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000705248_180543488.pth... [2023-12-26 05:15:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000708624_181411840.pth [2023-12-26 05:15:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000704192_180273152.pth [2023-12-26 05:15:24,277][123091] Updated weights for policy 0, policy_version 709684 (0.0009) [2023-12-26 05:15:24,323][123091] Updated weights for policy 0, policy_version 709694 (0.0005) [2023-12-26 05:15:24,375][123091] Updated weights for policy 0, policy_version 709704 (0.0005) [2023-12-26 05:15:24,510][123090] Updated weights for policy 1, policy_version 705253 (0.0010) [2023-12-26 05:15:24,561][123090] Updated weights for policy 1, policy_version 705263 (0.0010) [2023-12-26 05:15:24,610][123090] Updated weights for policy 1, policy_version 705273 (0.0010) [2023-12-26 05:15:25,139][123091] Updated weights for policy 0, policy_version 709714 (0.0006) [2023-12-26 05:15:25,190][123091] Updated weights for policy 0, policy_version 709724 (0.0010) [2023-12-26 05:15:25,241][123091] Updated weights for policy 0, policy_version 709734 (0.0010) [2023-12-26 05:15:25,284][123091] Updated weights for policy 0, policy_version 709744 (0.0010) [2023-12-26 05:15:25,422][123090] Updated weights for policy 1, policy_version 705283 (0.0009) [2023-12-26 05:15:25,472][123090] Updated weights for policy 1, policy_version 705293 (0.0005) [2023-12-26 05:15:25,522][123090] Updated weights for policy 1, policy_version 705303 (0.0005) [2023-12-26 05:15:26,128][123091] Updated weights for policy 0, policy_version 709754 (0.0010) [2023-12-26 05:15:26,182][123091] Updated weights for policy 0, policy_version 709764 (0.0010) [2023-12-26 05:15:26,232][123091] Updated weights for policy 0, policy_version 709774 (0.0010) [2023-12-26 05:15:26,269][123090] Updated weights for policy 1, policy_version 705313 (0.0005) [2023-12-26 05:15:26,335][123090] Updated weights for policy 1, policy_version 705323 (0.0010) [2023-12-26 05:15:26,402][123090] Updated weights for policy 1, policy_version 705333 (0.0010) [2023-12-26 05:15:26,465][123090] Updated weights for policy 1, policy_version 705343 (0.0008) [2023-12-26 05:15:26,953][123091] Updated weights for policy 0, policy_version 709784 (0.0006) [2023-12-26 05:15:27,003][123091] Updated weights for policy 0, policy_version 709794 (0.0005) [2023-12-26 05:15:27,053][123091] Updated weights for policy 0, policy_version 709804 (0.0005) [2023-12-26 05:15:27,260][123090] Updated weights for policy 1, policy_version 705353 (0.0008) [2023-12-26 05:15:27,308][123090] Updated weights for policy 1, policy_version 705363 (0.0005) [2023-12-26 05:15:27,364][123090] Updated weights for policy 1, policy_version 705373 (0.0009) [2023-12-26 05:15:27,767][123091] Updated weights for policy 0, policy_version 709814 (0.0008) [2023-12-26 05:15:27,818][123091] Updated weights for policy 0, policy_version 709824 (0.0010) [2023-12-26 05:15:27,865][123091] Updated weights for policy 0, policy_version 709834 (0.0010) [2023-12-26 05:15:28,073][123090] Updated weights for policy 1, policy_version 705383 (0.0009) [2023-12-26 05:15:28,131][123090] Updated weights for policy 1, policy_version 705393 (0.0008) [2023-12-26 05:15:28,178][123090] Updated weights for policy 1, policy_version 705403 (0.0009) [2023-12-26 05:15:28,661][123091] Updated weights for policy 0, policy_version 709844 (0.0010) [2023-12-26 05:15:28,719][123091] Updated weights for policy 0, policy_version 709854 (0.0011) [2023-12-26 05:15:28,779][123091] Updated weights for policy 0, policy_version 709864 (0.0011) [2023-12-26 05:15:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 362307584. Throughput: 0: 9041.5, 1: 8849.5. Samples: 362306760. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:28,785][121949] Avg episode reward: [(0, '6107.249'), (1, '5794.638')] [2023-12-26 05:15:29,048][123090] Updated weights for policy 1, policy_version 705413 (0.0008) [2023-12-26 05:15:29,108][123090] Updated weights for policy 1, policy_version 705423 (0.0009) [2023-12-26 05:15:29,169][123090] Updated weights for policy 1, policy_version 705433 (0.0009) [2023-12-26 05:15:29,632][123091] Updated weights for policy 0, policy_version 709874 (0.0011) [2023-12-26 05:15:29,688][123091] Updated weights for policy 0, policy_version 709884 (0.0011) [2023-12-26 05:15:29,743][123091] Updated weights for policy 0, policy_version 709894 (0.0011) [2023-12-26 05:15:29,795][123091] Updated weights for policy 0, policy_version 709904 (0.0010) [2023-12-26 05:15:30,046][123090] Updated weights for policy 1, policy_version 705443 (0.0009) [2023-12-26 05:15:30,117][123090] Updated weights for policy 1, policy_version 705453 (0.0008) [2023-12-26 05:15:30,178][123090] Updated weights for policy 1, policy_version 705463 (0.0009) [2023-12-26 05:15:30,590][123091] Updated weights for policy 0, policy_version 709914 (0.0006) [2023-12-26 05:15:30,654][123091] Updated weights for policy 0, policy_version 709924 (0.0007) [2023-12-26 05:15:30,733][123091] Updated weights for policy 0, policy_version 709934 (0.0006) [2023-12-26 05:15:30,986][123090] Updated weights for policy 1, policy_version 705473 (0.0010) [2023-12-26 05:15:31,044][123090] Updated weights for policy 1, policy_version 705483 (0.0007) [2023-12-26 05:15:31,116][123090] Updated weights for policy 1, policy_version 705493 (0.0006) [2023-12-26 05:15:31,188][123090] Updated weights for policy 1, policy_version 705503 (0.0010) [2023-12-26 05:15:31,425][123091] Updated weights for policy 0, policy_version 709944 (0.0010) [2023-12-26 05:15:31,477][123091] Updated weights for policy 0, policy_version 709954 (0.0010) [2023-12-26 05:15:31,535][123091] Updated weights for policy 0, policy_version 709964 (0.0006) [2023-12-26 05:15:32,047][123090] Updated weights for policy 1, policy_version 705513 (0.0009) [2023-12-26 05:15:32,109][123090] Updated weights for policy 1, policy_version 705523 (0.0008) [2023-12-26 05:15:32,175][123090] Updated weights for policy 1, policy_version 705533 (0.0008) [2023-12-26 05:15:32,266][123091] Updated weights for policy 0, policy_version 709974 (0.0008) [2023-12-26 05:15:32,332][123091] Updated weights for policy 0, policy_version 709984 (0.0009) [2023-12-26 05:15:32,394][123091] Updated weights for policy 0, policy_version 709994 (0.0009) [2023-12-26 05:15:33,032][123090] Updated weights for policy 1, policy_version 705543 (0.0010) [2023-12-26 05:15:33,093][123090] Updated weights for policy 1, policy_version 705553 (0.0010) [2023-12-26 05:15:33,163][123090] Updated weights for policy 1, policy_version 705563 (0.0010) [2023-12-26 05:15:33,192][123091] Updated weights for policy 0, policy_version 710004 (0.0009) [2023-12-26 05:15:33,259][123091] Updated weights for policy 0, policy_version 710014 (0.0009) [2023-12-26 05:15:33,312][123091] Updated weights for policy 0, policy_version 710024 (0.0010) [2023-12-26 05:15:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 362397696. Throughput: 0: 9039.1, 1: 8835.8. Samples: 362412000. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:33,785][121949] Avg episode reward: [(0, '6111.277'), (1, '5693.549')] [2023-12-26 05:15:33,980][123090] Updated weights for policy 1, policy_version 705573 (0.0010) [2023-12-26 05:15:34,046][123090] Updated weights for policy 1, policy_version 705583 (0.0010) [2023-12-26 05:15:34,068][123091] Updated weights for policy 0, policy_version 710034 (0.0008) [2023-12-26 05:15:34,102][123090] Updated weights for policy 1, policy_version 705593 (0.0010) [2023-12-26 05:15:34,124][123091] Updated weights for policy 0, policy_version 710044 (0.0007) [2023-12-26 05:15:34,188][123091] Updated weights for policy 0, policy_version 710054 (0.0009) [2023-12-26 05:15:34,249][123091] Updated weights for policy 0, policy_version 710064 (0.0009) [2023-12-26 05:15:34,823][123090] Updated weights for policy 1, policy_version 705603 (0.0009) [2023-12-26 05:15:34,888][123090] Updated weights for policy 1, policy_version 705613 (0.0005) [2023-12-26 05:15:34,955][123090] Updated weights for policy 1, policy_version 705623 (0.0005) [2023-12-26 05:15:35,134][123091] Updated weights for policy 0, policy_version 710074 (0.0005) [2023-12-26 05:15:35,187][123091] Updated weights for policy 0, policy_version 710084 (0.0005) [2023-12-26 05:15:35,241][123091] Updated weights for policy 0, policy_version 710094 (0.0005) [2023-12-26 05:15:35,608][123090] Updated weights for policy 1, policy_version 705633 (0.0005) [2023-12-26 05:15:35,654][123090] Updated weights for policy 1, policy_version 705643 (0.0005) [2023-12-26 05:15:35,712][123090] Updated weights for policy 1, policy_version 705653 (0.0010) [2023-12-26 05:15:35,760][123090] Updated weights for policy 1, policy_version 705663 (0.0008) [2023-12-26 05:15:36,061][123091] Updated weights for policy 0, policy_version 710104 (0.0009) [2023-12-26 05:15:36,128][123091] Updated weights for policy 0, policy_version 710114 (0.0010) [2023-12-26 05:15:36,194][123091] Updated weights for policy 0, policy_version 710124 (0.0009) [2023-12-26 05:15:36,469][123090] Updated weights for policy 1, policy_version 705673 (0.0007) [2023-12-26 05:15:36,529][123090] Updated weights for policy 1, policy_version 705683 (0.0010) [2023-12-26 05:15:36,586][123090] Updated weights for policy 1, policy_version 705693 (0.0011) [2023-12-26 05:15:37,060][123091] Updated weights for policy 0, policy_version 710134 (0.0010) [2023-12-26 05:15:37,114][123091] Updated weights for policy 0, policy_version 710144 (0.0010) [2023-12-26 05:15:37,180][123091] Updated weights for policy 0, policy_version 710154 (0.0010) [2023-12-26 05:15:37,293][123090] Updated weights for policy 1, policy_version 705703 (0.0007) [2023-12-26 05:15:37,370][123090] Updated weights for policy 1, policy_version 705713 (0.0008) [2023-12-26 05:15:37,434][123090] Updated weights for policy 1, policy_version 705723 (0.0011) [2023-12-26 05:15:38,092][123091] Updated weights for policy 0, policy_version 710164 (0.0009) [2023-12-26 05:15:38,135][123090] Updated weights for policy 1, policy_version 705733 (0.0010) [2023-12-26 05:15:38,159][123091] Updated weights for policy 0, policy_version 710174 (0.0009) [2023-12-26 05:15:38,194][123090] Updated weights for policy 1, policy_version 705743 (0.0010) [2023-12-26 05:15:38,213][123091] Updated weights for policy 0, policy_version 710184 (0.0008) [2023-12-26 05:15:38,251][123090] Updated weights for policy 1, policy_version 705753 (0.0007) [2023-12-26 05:15:38,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 362487808. Throughput: 0: 9019.7, 1: 8882.5. Samples: 362466000. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:38,786][121949] Avg episode reward: [(0, '6152.257'), (1, '5530.299')] [2023-12-26 05:15:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000710192_181813248.pth... [2023-12-26 05:15:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000705760_180674560.pth... [2023-12-26 05:15:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000704736_180412416.pth [2023-12-26 05:15:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000709136_181542912.pth [2023-12-26 05:15:38,925][123090] Updated weights for policy 1, policy_version 705763 (0.0006) [2023-12-26 05:15:38,977][123090] Updated weights for policy 1, policy_version 705773 (0.0005) [2023-12-26 05:15:39,024][123090] Updated weights for policy 1, policy_version 705783 (0.0005) [2023-12-26 05:15:39,156][123091] Updated weights for policy 0, policy_version 710194 (0.0008) [2023-12-26 05:15:39,223][123091] Updated weights for policy 0, policy_version 710204 (0.0009) [2023-12-26 05:15:39,290][123091] Updated weights for policy 0, policy_version 710214 (0.0010) [2023-12-26 05:15:39,361][123091] Updated weights for policy 0, policy_version 710224 (0.0008) [2023-12-26 05:15:39,831][123090] Updated weights for policy 1, policy_version 705793 (0.0005) [2023-12-26 05:15:39,893][123090] Updated weights for policy 1, policy_version 705803 (0.0010) [2023-12-26 05:15:39,958][123090] Updated weights for policy 1, policy_version 705813 (0.0011) [2023-12-26 05:15:40,026][123090] Updated weights for policy 1, policy_version 705823 (0.0010) [2023-12-26 05:15:40,218][123091] Updated weights for policy 0, policy_version 710234 (0.0009) [2023-12-26 05:15:40,278][123091] Updated weights for policy 0, policy_version 710244 (0.0009) [2023-12-26 05:15:40,344][123091] Updated weights for policy 0, policy_version 710254 (0.0009) [2023-12-26 05:15:40,848][123090] Updated weights for policy 1, policy_version 705833 (0.0010) [2023-12-26 05:15:40,904][123090] Updated weights for policy 1, policy_version 705843 (0.0010) [2023-12-26 05:15:40,960][123090] Updated weights for policy 1, policy_version 705853 (0.0010) [2023-12-26 05:15:41,184][123091] Updated weights for policy 0, policy_version 710264 (0.0009) [2023-12-26 05:15:41,254][123091] Updated weights for policy 0, policy_version 710274 (0.0007) [2023-12-26 05:15:41,316][123091] Updated weights for policy 0, policy_version 710284 (0.0009) [2023-12-26 05:15:41,880][123090] Updated weights for policy 1, policy_version 705863 (0.0010) [2023-12-26 05:15:41,952][123090] Updated weights for policy 1, policy_version 705873 (0.0009) [2023-12-26 05:15:42,015][123090] Updated weights for policy 1, policy_version 705883 (0.0009) [2023-12-26 05:15:42,074][123091] Updated weights for policy 0, policy_version 710294 (0.0008) [2023-12-26 05:15:42,126][123091] Updated weights for policy 0, policy_version 710304 (0.0005) [2023-12-26 05:15:42,188][123091] Updated weights for policy 0, policy_version 710314 (0.0005) [2023-12-26 05:15:42,881][123091] Updated weights for policy 0, policy_version 710324 (0.0005) [2023-12-26 05:15:42,883][123090] Updated weights for policy 1, policy_version 705893 (0.0009) [2023-12-26 05:15:42,938][123091] Updated weights for policy 0, policy_version 710334 (0.0005) [2023-12-26 05:15:42,946][123090] Updated weights for policy 1, policy_version 705903 (0.0006) [2023-12-26 05:15:42,987][123091] Updated weights for policy 0, policy_version 710344 (0.0008) [2023-12-26 05:15:43,016][123090] Updated weights for policy 1, policy_version 705913 (0.0007) [2023-12-26 05:15:43,766][123090] Updated weights for policy 1, policy_version 705923 (0.0008) [2023-12-26 05:15:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 362569728. Throughput: 0: 8933.8, 1: 8819.1. Samples: 362568564. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:43,784][121949] Avg episode reward: [(0, '6116.732'), (1, '5566.407')] [2023-12-26 05:15:43,823][123090] Updated weights for policy 1, policy_version 705933 (0.0009) [2023-12-26 05:15:43,830][123091] Updated weights for policy 0, policy_version 710354 (0.0009) [2023-12-26 05:15:43,874][123090] Updated weights for policy 1, policy_version 705943 (0.0009) [2023-12-26 05:15:43,895][123091] Updated weights for policy 0, policy_version 710364 (0.0008) [2023-12-26 05:15:43,959][123091] Updated weights for policy 0, policy_version 710374 (0.0009) [2023-12-26 05:15:44,022][123091] Updated weights for policy 0, policy_version 710384 (0.0008) [2023-12-26 05:15:44,726][123091] Updated weights for policy 0, policy_version 710394 (0.0006) [2023-12-26 05:15:44,803][123091] Updated weights for policy 0, policy_version 710404 (0.0007) [2023-12-26 05:15:44,805][123090] Updated weights for policy 1, policy_version 705953 (0.0008) [2023-12-26 05:15:44,860][123091] Updated weights for policy 0, policy_version 710414 (0.0008) [2023-12-26 05:15:44,872][123090] Updated weights for policy 1, policy_version 705963 (0.0008) [2023-12-26 05:15:44,943][123090] Updated weights for policy 1, policy_version 705973 (0.0010) [2023-12-26 05:15:45,011][123090] Updated weights for policy 1, policy_version 705983 (0.0009) [2023-12-26 05:15:45,646][123091] Updated weights for policy 0, policy_version 710424 (0.0006) [2023-12-26 05:15:45,706][123091] Updated weights for policy 0, policy_version 710434 (0.0005) [2023-12-26 05:15:45,776][123091] Updated weights for policy 0, policy_version 710444 (0.0008) [2023-12-26 05:15:45,792][123090] Updated weights for policy 1, policy_version 705993 (0.0009) [2023-12-26 05:15:45,849][123090] Updated weights for policy 1, policy_version 706003 (0.0009) [2023-12-26 05:15:45,907][123090] Updated weights for policy 1, policy_version 706013 (0.0009) [2023-12-26 05:15:46,331][123091] Updated weights for policy 0, policy_version 710454 (0.0006) [2023-12-26 05:15:46,379][123091] Updated weights for policy 0, policy_version 710464 (0.0010) [2023-12-26 05:15:46,439][123091] Updated weights for policy 0, policy_version 710474 (0.0010) [2023-12-26 05:15:46,809][123090] Updated weights for policy 1, policy_version 706023 (0.0009) [2023-12-26 05:15:46,862][123090] Updated weights for policy 1, policy_version 706033 (0.0009) [2023-12-26 05:15:46,910][123090] Updated weights for policy 1, policy_version 706043 (0.0009) [2023-12-26 05:15:47,179][123091] Updated weights for policy 0, policy_version 710484 (0.0008) [2023-12-26 05:15:47,228][123091] Updated weights for policy 0, policy_version 710494 (0.0005) [2023-12-26 05:15:47,286][123091] Updated weights for policy 0, policy_version 710504 (0.0005) [2023-12-26 05:15:47,716][123090] Updated weights for policy 1, policy_version 706053 (0.0007) [2023-12-26 05:15:47,766][123090] Updated weights for policy 1, policy_version 706063 (0.0005) [2023-12-26 05:15:47,814][123090] Updated weights for policy 1, policy_version 706073 (0.0005) [2023-12-26 05:15:47,963][123091] Updated weights for policy 0, policy_version 710514 (0.0005) [2023-12-26 05:15:48,037][123091] Updated weights for policy 0, policy_version 710524 (0.0009) [2023-12-26 05:15:48,086][123091] Updated weights for policy 0, policy_version 710534 (0.0009) [2023-12-26 05:15:48,134][123091] Updated weights for policy 0, policy_version 710544 (0.0009) [2023-12-26 05:15:48,554][123090] Updated weights for policy 1, policy_version 706083 (0.0007) [2023-12-26 05:15:48,608][123090] Updated weights for policy 1, policy_version 706093 (0.0008) [2023-12-26 05:15:48,662][123090] Updated weights for policy 1, policy_version 706103 (0.0009) [2023-12-26 05:15:48,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 362668032. Throughput: 0: 8983.9, 1: 8776.9. Samples: 362676848. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:48,785][121949] Avg episode reward: [(0, '6132.239'), (1, '5711.456')] [2023-12-26 05:15:48,994][123091] Updated weights for policy 0, policy_version 710554 (0.0009) [2023-12-26 05:15:49,050][123091] Updated weights for policy 0, policy_version 710564 (0.0009) [2023-12-26 05:15:49,115][123091] Updated weights for policy 0, policy_version 710574 (0.0007) [2023-12-26 05:15:49,479][123090] Updated weights for policy 1, policy_version 706113 (0.0008) [2023-12-26 05:15:49,551][123090] Updated weights for policy 1, policy_version 706123 (0.0005) [2023-12-26 05:15:49,623][123090] Updated weights for policy 1, policy_version 706133 (0.0006) [2023-12-26 05:15:49,691][123090] Updated weights for policy 1, policy_version 706143 (0.0005) [2023-12-26 05:15:49,961][123091] Updated weights for policy 0, policy_version 710584 (0.0008) [2023-12-26 05:15:50,019][123091] Updated weights for policy 0, policy_version 710594 (0.0009) [2023-12-26 05:15:50,077][123091] Updated weights for policy 0, policy_version 710604 (0.0009) [2023-12-26 05:15:50,466][123090] Updated weights for policy 1, policy_version 706153 (0.0008) [2023-12-26 05:15:50,528][123090] Updated weights for policy 1, policy_version 706163 (0.0008) [2023-12-26 05:15:50,586][123090] Updated weights for policy 1, policy_version 706173 (0.0010) [2023-12-26 05:15:50,916][123091] Updated weights for policy 0, policy_version 710614 (0.0009) [2023-12-26 05:15:50,976][123091] Updated weights for policy 0, policy_version 710624 (0.0009) [2023-12-26 05:15:51,033][123091] Updated weights for policy 0, policy_version 710634 (0.0010) [2023-12-26 05:15:51,411][123090] Updated weights for policy 1, policy_version 706183 (0.0010) [2023-12-26 05:15:51,463][123090] Updated weights for policy 1, policy_version 706193 (0.0009) [2023-12-26 05:15:51,516][123090] Updated weights for policy 1, policy_version 706203 (0.0009) [2023-12-26 05:15:51,902][123091] Updated weights for policy 0, policy_version 710644 (0.0009) [2023-12-26 05:15:51,956][123091] Updated weights for policy 0, policy_version 710654 (0.0009) [2023-12-26 05:15:52,013][123091] Updated weights for policy 0, policy_version 710664 (0.0010) [2023-12-26 05:15:52,411][123090] Updated weights for policy 1, policy_version 706213 (0.0009) [2023-12-26 05:15:52,470][123090] Updated weights for policy 1, policy_version 706223 (0.0008) [2023-12-26 05:15:52,520][123090] Updated weights for policy 1, policy_version 706233 (0.0005) [2023-12-26 05:15:52,902][123091] Updated weights for policy 0, policy_version 710674 (0.0009) [2023-12-26 05:15:52,959][123091] Updated weights for policy 0, policy_version 710685 (0.0010) [2023-12-26 05:15:53,015][123091] Updated weights for policy 0, policy_version 710695 (0.0010) [2023-12-26 05:15:53,295][123090] Updated weights for policy 1, policy_version 706243 (0.0005) [2023-12-26 05:15:53,366][123090] Updated weights for policy 1, policy_version 706253 (0.0005) [2023-12-26 05:15:53,421][123090] Updated weights for policy 1, policy_version 706263 (0.0010) [2023-12-26 05:15:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.3). Total num frames: 362749952. Throughput: 0: 8952.5, 1: 8785.9. Samples: 362727800. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:53,785][121949] Avg episode reward: [(0, '6070.499'), (1, '5599.194')] [2023-12-26 05:15:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000710704_181944320.pth... [2023-12-26 05:15:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000706272_180805632.pth... [2023-12-26 05:15:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000705248_180543488.pth [2023-12-26 05:15:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000709680_181682176.pth [2023-12-26 05:15:53,896][123091] Updated weights for policy 0, policy_version 710705 (0.0009) [2023-12-26 05:15:53,944][123091] Updated weights for policy 0, policy_version 710715 (0.0009) [2023-12-26 05:15:53,996][123091] Updated weights for policy 0, policy_version 710725 (0.0008) [2023-12-26 05:15:54,059][123091] Updated weights for policy 0, policy_version 710735 (0.0010) [2023-12-26 05:15:54,136][123090] Updated weights for policy 1, policy_version 706273 (0.0007) [2023-12-26 05:15:54,205][123090] Updated weights for policy 1, policy_version 706283 (0.0005) [2023-12-26 05:15:54,275][123090] Updated weights for policy 1, policy_version 706293 (0.0005) [2023-12-26 05:15:54,335][123090] Updated weights for policy 1, policy_version 706303 (0.0005) [2023-12-26 05:15:54,956][123090] Updated weights for policy 1, policy_version 706313 (0.0006) [2023-12-26 05:15:54,994][123091] Updated weights for policy 0, policy_version 710745 (0.0007) [2023-12-26 05:15:55,020][123090] Updated weights for policy 1, policy_version 706323 (0.0009) [2023-12-26 05:15:55,059][123091] Updated weights for policy 0, policy_version 710755 (0.0008) [2023-12-26 05:15:55,085][123090] Updated weights for policy 1, policy_version 706333 (0.0008) [2023-12-26 05:15:55,117][123091] Updated weights for policy 0, policy_version 710765 (0.0009) [2023-12-26 05:15:55,810][123090] Updated weights for policy 1, policy_version 706343 (0.0010) [2023-12-26 05:15:55,862][123090] Updated weights for policy 1, policy_version 706353 (0.0010) [2023-12-26 05:15:55,924][123090] Updated weights for policy 1, policy_version 706363 (0.0010) [2023-12-26 05:15:55,983][123091] Updated weights for policy 0, policy_version 710775 (0.0009) [2023-12-26 05:15:56,036][123091] Updated weights for policy 0, policy_version 710785 (0.0009) [2023-12-26 05:15:56,091][123091] Updated weights for policy 0, policy_version 710795 (0.0009) [2023-12-26 05:15:56,739][123090] Updated weights for policy 1, policy_version 706373 (0.0010) [2023-12-26 05:15:56,790][123090] Updated weights for policy 1, policy_version 706383 (0.0010) [2023-12-26 05:15:56,841][123090] Updated weights for policy 1, policy_version 706393 (0.0010) [2023-12-26 05:15:56,922][123091] Updated weights for policy 0, policy_version 710805 (0.0008) [2023-12-26 05:15:56,985][123091] Updated weights for policy 0, policy_version 710815 (0.0009) [2023-12-26 05:15:57,035][123091] Updated weights for policy 0, policy_version 710825 (0.0008) [2023-12-26 05:15:57,674][123090] Updated weights for policy 1, policy_version 706403 (0.0010) [2023-12-26 05:15:57,742][123090] Updated weights for policy 1, policy_version 706413 (0.0009) [2023-12-26 05:15:57,808][123090] Updated weights for policy 1, policy_version 706423 (0.0009) [2023-12-26 05:15:57,890][123091] Updated weights for policy 0, policy_version 710835 (0.0009) [2023-12-26 05:15:57,943][123091] Updated weights for policy 0, policy_version 710845 (0.0009) [2023-12-26 05:15:57,995][123091] Updated weights for policy 0, policy_version 710855 (0.0009) [2023-12-26 05:15:58,653][123090] Updated weights for policy 1, policy_version 706433 (0.0009) [2023-12-26 05:15:58,725][123090] Updated weights for policy 1, policy_version 706443 (0.0008) [2023-12-26 05:15:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 362831872. Throughput: 0: 8831.3, 1: 8793.4. Samples: 362832356. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:15:58,785][121949] Avg episode reward: [(0, '6060.363'), (1, '5456.492')] [2023-12-26 05:15:58,798][123090] Updated weights for policy 1, policy_version 706453 (0.0008) [2023-12-26 05:15:58,863][123090] Updated weights for policy 1, policy_version 706463 (0.0008) [2023-12-26 05:15:58,885][123091] Updated weights for policy 0, policy_version 710865 (0.0009) [2023-12-26 05:15:58,941][123091] Updated weights for policy 0, policy_version 710875 (0.0009) [2023-12-26 05:15:59,004][123091] Updated weights for policy 0, policy_version 710885 (0.0009) [2023-12-26 05:15:59,064][123091] Updated weights for policy 0, policy_version 710895 (0.0010) [2023-12-26 05:15:59,595][123090] Updated weights for policy 1, policy_version 706473 (0.0010) [2023-12-26 05:15:59,654][123090] Updated weights for policy 1, policy_version 706483 (0.0010) [2023-12-26 05:15:59,713][123090] Updated weights for policy 1, policy_version 706493 (0.0010) [2023-12-26 05:15:59,926][123091] Updated weights for policy 0, policy_version 710905 (0.0009) [2023-12-26 05:15:59,998][123091] Updated weights for policy 0, policy_version 710915 (0.0009) [2023-12-26 05:16:00,066][123091] Updated weights for policy 0, policy_version 710925 (0.0009) [2023-12-26 05:16:00,482][123090] Updated weights for policy 1, policy_version 706503 (0.0008) [2023-12-26 05:16:00,544][123090] Updated weights for policy 1, policy_version 706513 (0.0011) [2023-12-26 05:16:00,597][123090] Updated weights for policy 1, policy_version 706523 (0.0011) [2023-12-26 05:16:00,960][123091] Updated weights for policy 0, policy_version 710935 (0.0010) [2023-12-26 05:16:01,019][123091] Updated weights for policy 0, policy_version 710945 (0.0010) [2023-12-26 05:16:01,079][123091] Updated weights for policy 0, policy_version 710955 (0.0009) [2023-12-26 05:16:01,303][123090] Updated weights for policy 1, policy_version 706533 (0.0011) [2023-12-26 05:16:01,365][123090] Updated weights for policy 1, policy_version 706543 (0.0009) [2023-12-26 05:16:01,443][123090] Updated weights for policy 1, policy_version 706553 (0.0007) [2023-12-26 05:16:02,003][123091] Updated weights for policy 0, policy_version 710965 (0.0010) [2023-12-26 05:16:02,075][123091] Updated weights for policy 0, policy_version 710975 (0.0009) [2023-12-26 05:16:02,133][123091] Updated weights for policy 0, policy_version 710986 (0.0010) [2023-12-26 05:16:02,214][123090] Updated weights for policy 1, policy_version 706563 (0.0007) [2023-12-26 05:16:02,273][123090] Updated weights for policy 1, policy_version 706573 (0.0006) [2023-12-26 05:16:02,339][123090] Updated weights for policy 1, policy_version 706583 (0.0006) [2023-12-26 05:16:02,991][123091] Updated weights for policy 0, policy_version 710996 (0.0008) [2023-12-26 05:16:03,049][123091] Updated weights for policy 0, policy_version 711007 (0.0008) [2023-12-26 05:16:03,075][123090] Updated weights for policy 1, policy_version 706593 (0.0006) [2023-12-26 05:16:03,099][123091] Updated weights for policy 0, policy_version 711017 (0.0007) [2023-12-26 05:16:03,128][123090] Updated weights for policy 1, policy_version 706603 (0.0007) [2023-12-26 05:16:03,185][123090] Updated weights for policy 1, policy_version 706613 (0.0008) [2023-12-26 05:16:03,240][123090] Updated weights for policy 1, policy_version 706623 (0.0006) [2023-12-26 05:16:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 362921984. Throughput: 0: 8652.4, 1: 8853.6. Samples: 362936136. Policy #0 lag: (min: 5.0, avg: 27.8, max: 32.0) [2023-12-26 05:16:03,784][121949] Avg episode reward: [(0, '6027.022'), (1, '5482.017')] [2023-12-26 05:16:03,960][123091] Updated weights for policy 0, policy_version 711027 (0.0009) [2023-12-26 05:16:04,012][123091] Updated weights for policy 0, policy_version 711037 (0.0008) [2023-12-26 05:16:04,014][123090] Updated weights for policy 1, policy_version 706633 (0.0010) [2023-12-26 05:16:04,078][123090] Updated weights for policy 1, policy_version 706643 (0.0011) [2023-12-26 05:16:04,082][123091] Updated weights for policy 0, policy_version 711047 (0.0007) [2023-12-26 05:16:04,150][123090] Updated weights for policy 1, policy_version 706653 (0.0009) [2023-12-26 05:16:04,954][123091] Updated weights for policy 0, policy_version 711057 (0.0008) [2023-12-26 05:16:04,963][123090] Updated weights for policy 1, policy_version 706663 (0.0009) [2023-12-26 05:16:05,020][123091] Updated weights for policy 0, policy_version 711067 (0.0009) [2023-12-26 05:16:05,021][123090] Updated weights for policy 1, policy_version 706673 (0.0006) [2023-12-26 05:16:05,074][123091] Updated weights for policy 0, policy_version 711077 (0.0009) [2023-12-26 05:16:05,076][123090] Updated weights for policy 1, policy_version 706683 (0.0006) [2023-12-26 05:16:05,125][123091] Updated weights for policy 0, policy_version 711087 (0.0009) [2023-12-26 05:16:05,712][123090] Updated weights for policy 1, policy_version 706693 (0.0006) [2023-12-26 05:16:05,780][123090] Updated weights for policy 1, policy_version 706703 (0.0006) [2023-12-26 05:16:05,846][123090] Updated weights for policy 1, policy_version 706713 (0.0008) [2023-12-26 05:16:06,011][123091] Updated weights for policy 0, policy_version 711097 (0.0008) [2023-12-26 05:16:06,068][123091] Updated weights for policy 0, policy_version 711107 (0.0011) [2023-12-26 05:16:06,138][123091] Updated weights for policy 0, policy_version 711117 (0.0011) [2023-12-26 05:16:06,660][123090] Updated weights for policy 1, policy_version 706723 (0.0009) [2023-12-26 05:16:06,731][123090] Updated weights for policy 1, policy_version 706733 (0.0011) [2023-12-26 05:16:06,802][123090] Updated weights for policy 1, policy_version 706743 (0.0010) [2023-12-26 05:16:06,944][123091] Updated weights for policy 0, policy_version 711127 (0.0013) [2023-12-26 05:16:06,997][123091] Updated weights for policy 0, policy_version 711137 (0.0011) [2023-12-26 05:16:07,054][123091] Updated weights for policy 0, policy_version 711147 (0.0011) [2023-12-26 05:16:07,607][123090] Updated weights for policy 1, policy_version 706753 (0.0011) [2023-12-26 05:16:07,681][123090] Updated weights for policy 1, policy_version 706763 (0.0011) [2023-12-26 05:16:07,748][123090] Updated weights for policy 1, policy_version 706773 (0.0009) [2023-12-26 05:16:07,822][123090] Updated weights for policy 1, policy_version 706783 (0.0006) [2023-12-26 05:16:07,895][123091] Updated weights for policy 0, policy_version 711157 (0.0008) [2023-12-26 05:16:07,960][123091] Updated weights for policy 0, policy_version 711167 (0.0006) [2023-12-26 05:16:08,029][123091] Updated weights for policy 0, policy_version 711177 (0.0006) [2023-12-26 05:16:08,583][123090] Updated weights for policy 1, policy_version 706793 (0.0009) [2023-12-26 05:16:08,638][123090] Updated weights for policy 1, policy_version 706803 (0.0010) [2023-12-26 05:16:08,696][123090] Updated weights for policy 1, policy_version 706814 (0.0009) [2023-12-26 05:16:08,706][123091] Updated weights for policy 0, policy_version 711187 (0.0007) [2023-12-26 05:16:08,776][123091] Updated weights for policy 0, policy_version 711197 (0.0010) [2023-12-26 05:16:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 363012096. Throughput: 0: 8652.2, 1: 8876.1. Samples: 362988444. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:08,785][121949] Avg episode reward: [(0, '6064.352'), (1, '5583.462')] [2023-12-26 05:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000706816_180944896.pth... [2023-12-26 05:16:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000705760_180674560.pth [2023-12-26 05:16:08,838][123091] Updated weights for policy 0, policy_version 711207 (0.0010) [2023-12-26 05:16:08,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000711216_182075392.pth... [2023-12-26 05:16:08,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000710192_181813248.pth [2023-12-26 05:16:09,545][123090] Updated weights for policy 1, policy_version 706824 (0.0009) [2023-12-26 05:16:09,611][123090] Updated weights for policy 1, policy_version 706834 (0.0010) [2023-12-26 05:16:09,673][123090] Updated weights for policy 1, policy_version 706844 (0.0010) [2023-12-26 05:16:09,704][123091] Updated weights for policy 0, policy_version 711217 (0.0008) [2023-12-26 05:16:09,770][123091] Updated weights for policy 0, policy_version 711227 (0.0009) [2023-12-26 05:16:09,843][123091] Updated weights for policy 0, policy_version 711237 (0.0010) [2023-12-26 05:16:09,912][123091] Updated weights for policy 0, policy_version 711247 (0.0009) [2023-12-26 05:16:10,523][123090] Updated weights for policy 1, policy_version 706854 (0.0009) [2023-12-26 05:16:10,591][123090] Updated weights for policy 1, policy_version 706864 (0.0010) [2023-12-26 05:16:10,660][123090] Updated weights for policy 1, policy_version 706874 (0.0010) [2023-12-26 05:16:10,729][123091] Updated weights for policy 0, policy_version 711257 (0.0008) [2023-12-26 05:16:10,779][123091] Updated weights for policy 0, policy_version 711267 (0.0009) [2023-12-26 05:16:10,839][123091] Updated weights for policy 0, policy_version 711277 (0.0009) [2023-12-26 05:16:11,557][123090] Updated weights for policy 1, policy_version 706884 (0.0009) [2023-12-26 05:16:11,619][123090] Updated weights for policy 1, policy_version 706894 (0.0009) [2023-12-26 05:16:11,697][123090] Updated weights for policy 1, policy_version 706904 (0.0009) [2023-12-26 05:16:11,753][123091] Updated weights for policy 0, policy_version 711287 (0.0009) [2023-12-26 05:16:11,821][123091] Updated weights for policy 0, policy_version 711297 (0.0010) [2023-12-26 05:16:11,874][123091] Updated weights for policy 0, policy_version 711307 (0.0009) [2023-12-26 05:16:12,559][123090] Updated weights for policy 1, policy_version 706914 (0.0009) [2023-12-26 05:16:12,627][123090] Updated weights for policy 1, policy_version 706924 (0.0007) [2023-12-26 05:16:12,698][123090] Updated weights for policy 1, policy_version 706934 (0.0007) [2023-12-26 05:16:12,767][123091] Updated weights for policy 0, policy_version 711317 (0.0009) [2023-12-26 05:16:12,768][123090] Updated weights for policy 1, policy_version 706944 (0.0007) [2023-12-26 05:16:12,834][123091] Updated weights for policy 0, policy_version 711327 (0.0010) [2023-12-26 05:16:12,897][123091] Updated weights for policy 0, policy_version 711337 (0.0009) [2023-12-26 05:16:13,505][123090] Updated weights for policy 1, policy_version 706954 (0.0010) [2023-12-26 05:16:13,564][123090] Updated weights for policy 1, policy_version 706964 (0.0010) [2023-12-26 05:16:13,628][123090] Updated weights for policy 1, policy_version 706974 (0.0010) [2023-12-26 05:16:13,761][123091] Updated weights for policy 0, policy_version 711347 (0.0009) [2023-12-26 05:16:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 363094016. Throughput: 0: 8549.2, 1: 8837.4. Samples: 363089152. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:13,785][121949] Avg episode reward: [(0, '6063.729'), (1, '5698.802')] [2023-12-26 05:16:13,815][123091] Updated weights for policy 0, policy_version 711357 (0.0008) [2023-12-26 05:16:13,880][123091] Updated weights for policy 0, policy_version 711367 (0.0005) [2023-12-26 05:16:14,335][123090] Updated weights for policy 1, policy_version 706984 (0.0006) [2023-12-26 05:16:14,392][123090] Updated weights for policy 1, policy_version 706994 (0.0006) [2023-12-26 05:16:14,448][123090] Updated weights for policy 1, policy_version 707004 (0.0005) [2023-12-26 05:16:14,592][123091] Updated weights for policy 0, policy_version 711377 (0.0006) [2023-12-26 05:16:14,653][123091] Updated weights for policy 0, policy_version 711387 (0.0010) [2023-12-26 05:16:14,709][123091] Updated weights for policy 0, policy_version 711397 (0.0010) [2023-12-26 05:16:14,771][123091] Updated weights for policy 0, policy_version 711407 (0.0009) [2023-12-26 05:16:15,135][123090] Updated weights for policy 1, policy_version 707014 (0.0006) [2023-12-26 05:16:15,205][123090] Updated weights for policy 1, policy_version 707024 (0.0006) [2023-12-26 05:16:15,273][123090] Updated weights for policy 1, policy_version 707034 (0.0009) [2023-12-26 05:16:15,677][123091] Updated weights for policy 0, policy_version 711417 (0.0010) [2023-12-26 05:16:15,731][123091] Updated weights for policy 0, policy_version 711427 (0.0010) [2023-12-26 05:16:15,784][123091] Updated weights for policy 0, policy_version 711437 (0.0010) [2023-12-26 05:16:15,879][123090] Updated weights for policy 1, policy_version 707044 (0.0010) [2023-12-26 05:16:15,947][123090] Updated weights for policy 1, policy_version 707054 (0.0005) [2023-12-26 05:16:15,992][123090] Updated weights for policy 1, policy_version 707064 (0.0005) [2023-12-26 05:16:16,608][123091] Updated weights for policy 0, policy_version 711448 (0.0007) [2023-12-26 05:16:16,619][123090] Updated weights for policy 1, policy_version 707074 (0.0006) [2023-12-26 05:16:16,668][123091] Updated weights for policy 0, policy_version 711459 (0.0010) [2023-12-26 05:16:16,684][123090] Updated weights for policy 1, policy_version 707084 (0.0006) [2023-12-26 05:16:16,725][123091] Updated weights for policy 0, policy_version 711469 (0.0009) [2023-12-26 05:16:16,747][123090] Updated weights for policy 1, policy_version 707094 (0.0006) [2023-12-26 05:16:16,802][123090] Updated weights for policy 1, policy_version 707104 (0.0007) [2023-12-26 05:16:17,567][123091] Updated weights for policy 0, policy_version 711479 (0.0009) [2023-12-26 05:16:17,569][123090] Updated weights for policy 1, policy_version 707114 (0.0007) [2023-12-26 05:16:17,627][123091] Updated weights for policy 0, policy_version 711489 (0.0008) [2023-12-26 05:16:17,629][123090] Updated weights for policy 1, policy_version 707124 (0.0008) [2023-12-26 05:16:17,680][123091] Updated weights for policy 0, policy_version 711499 (0.0008) [2023-12-26 05:16:17,694][123090] Updated weights for policy 1, policy_version 707134 (0.0006) [2023-12-26 05:16:18,481][123090] Updated weights for policy 1, policy_version 707144 (0.0005) [2023-12-26 05:16:18,539][123090] Updated weights for policy 1, policy_version 707154 (0.0006) [2023-12-26 05:16:18,546][123091] Updated weights for policy 0, policy_version 711509 (0.0009) [2023-12-26 05:16:18,594][123090] Updated weights for policy 1, policy_version 707164 (0.0006) [2023-12-26 05:16:18,606][123091] Updated weights for policy 0, policy_version 711519 (0.0009) [2023-12-26 05:16:18,663][123091] Updated weights for policy 0, policy_version 711529 (0.0010) [2023-12-26 05:16:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 363192320. Throughput: 0: 8472.5, 1: 8996.7. Samples: 363198116. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:18,785][121949] Avg episode reward: [(0, '6007.939'), (1, '5752.439')] [2023-12-26 05:16:19,411][123090] Updated weights for policy 1, policy_version 707174 (0.0009) [2023-12-26 05:16:19,478][123090] Updated weights for policy 1, policy_version 707184 (0.0009) [2023-12-26 05:16:19,510][123091] Updated weights for policy 0, policy_version 711539 (0.0010) [2023-12-26 05:16:19,545][123090] Updated weights for policy 1, policy_version 707194 (0.0009) [2023-12-26 05:16:19,569][123091] Updated weights for policy 0, policy_version 711549 (0.0007) [2023-12-26 05:16:19,629][123091] Updated weights for policy 0, policy_version 711560 (0.0009) [2023-12-26 05:16:20,353][123090] Updated weights for policy 1, policy_version 707204 (0.0007) [2023-12-26 05:16:20,407][123090] Updated weights for policy 1, policy_version 707214 (0.0006) [2023-12-26 05:16:20,471][123090] Updated weights for policy 1, policy_version 707224 (0.0005) [2023-12-26 05:16:20,525][123091] Updated weights for policy 0, policy_version 711570 (0.0010) [2023-12-26 05:16:20,599][123091] Updated weights for policy 0, policy_version 711580 (0.0010) [2023-12-26 05:16:20,667][123091] Updated weights for policy 0, policy_version 711590 (0.0009) [2023-12-26 05:16:20,736][123091] Updated weights for policy 0, policy_version 711600 (0.0007) [2023-12-26 05:16:21,309][123090] Updated weights for policy 1, policy_version 707234 (0.0008) [2023-12-26 05:16:21,378][123090] Updated weights for policy 1, policy_version 707244 (0.0009) [2023-12-26 05:16:21,443][123090] Updated weights for policy 1, policy_version 707254 (0.0009) [2023-12-26 05:16:21,512][123090] Updated weights for policy 1, policy_version 707264 (0.0009) [2023-12-26 05:16:21,588][123091] Updated weights for policy 0, policy_version 711610 (0.0010) [2023-12-26 05:16:21,655][123091] Updated weights for policy 0, policy_version 711620 (0.0008) [2023-12-26 05:16:21,709][123091] Updated weights for policy 0, policy_version 711630 (0.0010) [2023-12-26 05:16:22,317][123090] Updated weights for policy 1, policy_version 707274 (0.0008) [2023-12-26 05:16:22,383][123090] Updated weights for policy 1, policy_version 707284 (0.0008) [2023-12-26 05:16:22,439][123090] Updated weights for policy 1, policy_version 707294 (0.0008) [2023-12-26 05:16:22,609][123091] Updated weights for policy 0, policy_version 711641 (0.0009) [2023-12-26 05:16:22,682][123091] Updated weights for policy 0, policy_version 711651 (0.0008) [2023-12-26 05:16:22,753][123091] Updated weights for policy 0, policy_version 711661 (0.0009) [2023-12-26 05:16:23,222][123090] Updated weights for policy 1, policy_version 707304 (0.0008) [2023-12-26 05:16:23,280][123090] Updated weights for policy 1, policy_version 707314 (0.0005) [2023-12-26 05:16:23,352][123090] Updated weights for policy 1, policy_version 707324 (0.0006) [2023-12-26 05:16:23,585][123091] Updated weights for policy 0, policy_version 711671 (0.0009) [2023-12-26 05:16:23,654][123091] Updated weights for policy 0, policy_version 711681 (0.0010) [2023-12-26 05:16:23,713][123091] Updated weights for policy 0, policy_version 711691 (0.0010) [2023-12-26 05:16:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 363274240. Throughput: 0: 8459.2, 1: 8927.3. Samples: 363248384. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:23,785][121949] Avg episode reward: [(0, '6159.295'), (1, '5761.739')] [2023-12-26 05:16:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000707328_181075968.pth... [2023-12-26 05:16:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000711696_182198272.pth... [2023-12-26 05:16:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000710704_181944320.pth [2023-12-26 05:16:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000706272_180805632.pth [2023-12-26 05:16:24,057][123090] Updated weights for policy 1, policy_version 707334 (0.0007) [2023-12-26 05:16:24,108][123090] Updated weights for policy 1, policy_version 707344 (0.0005) [2023-12-26 05:16:24,168][123090] Updated weights for policy 1, policy_version 707354 (0.0005) [2023-12-26 05:16:24,466][123091] Updated weights for policy 0, policy_version 711701 (0.0011) [2023-12-26 05:16:24,515][123091] Updated weights for policy 0, policy_version 711711 (0.0010) [2023-12-26 05:16:24,574][123091] Updated weights for policy 0, policy_version 711721 (0.0010) [2023-12-26 05:16:24,897][123090] Updated weights for policy 1, policy_version 707364 (0.0007) [2023-12-26 05:16:24,967][123090] Updated weights for policy 1, policy_version 707374 (0.0011) [2023-12-26 05:16:25,030][123090] Updated weights for policy 1, policy_version 707384 (0.0010) [2023-12-26 05:16:25,374][123091] Updated weights for policy 0, policy_version 711731 (0.0010) [2023-12-26 05:16:25,432][123091] Updated weights for policy 0, policy_version 711741 (0.0010) [2023-12-26 05:16:25,483][123091] Updated weights for policy 0, policy_version 711751 (0.0010) [2023-12-26 05:16:25,835][123090] Updated weights for policy 1, policy_version 707394 (0.0010) [2023-12-26 05:16:25,892][123090] Updated weights for policy 1, policy_version 707404 (0.0010) [2023-12-26 05:16:25,952][123090] Updated weights for policy 1, policy_version 707414 (0.0010) [2023-12-26 05:16:26,009][123090] Updated weights for policy 1, policy_version 707424 (0.0010) [2023-12-26 05:16:26,147][123091] Updated weights for policy 0, policy_version 711761 (0.0009) [2023-12-26 05:16:26,206][123091] Updated weights for policy 0, policy_version 711771 (0.0005) [2023-12-26 05:16:26,287][123091] Updated weights for policy 0, policy_version 711781 (0.0005) [2023-12-26 05:16:26,349][123091] Updated weights for policy 0, policy_version 711791 (0.0005) [2023-12-26 05:16:26,925][123090] Updated weights for policy 1, policy_version 707434 (0.0009) [2023-12-26 05:16:26,935][123091] Updated weights for policy 0, policy_version 711801 (0.0005) [2023-12-26 05:16:26,978][123090] Updated weights for policy 1, policy_version 707444 (0.0008) [2023-12-26 05:16:26,991][123091] Updated weights for policy 0, policy_version 711811 (0.0005) [2023-12-26 05:16:27,032][123090] Updated weights for policy 1, policy_version 707454 (0.0009) [2023-12-26 05:16:27,046][123091] Updated weights for policy 0, policy_version 711821 (0.0005) [2023-12-26 05:16:27,685][123091] Updated weights for policy 0, policy_version 711831 (0.0005) [2023-12-26 05:16:27,743][123091] Updated weights for policy 0, policy_version 711841 (0.0005) [2023-12-26 05:16:27,805][123091] Updated weights for policy 0, policy_version 711851 (0.0005) [2023-12-26 05:16:27,988][123090] Updated weights for policy 1, policy_version 707464 (0.0009) [2023-12-26 05:16:28,046][123090] Updated weights for policy 1, policy_version 707475 (0.0010) [2023-12-26 05:16:28,108][123090] Updated weights for policy 1, policy_version 707485 (0.0009) [2023-12-26 05:16:28,422][123091] Updated weights for policy 0, policy_version 711861 (0.0006) [2023-12-26 05:16:28,481][123091] Updated weights for policy 0, policy_version 711871 (0.0011) [2023-12-26 05:16:28,528][123091] Updated weights for policy 0, policy_version 711881 (0.0010) [2023-12-26 05:16:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 363364352. Throughput: 0: 8592.2, 1: 8934.3. Samples: 363357260. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:28,785][121949] Avg episode reward: [(0, '6235.763'), (1, '5715.902')] [2023-12-26 05:16:28,992][123090] Updated weights for policy 1, policy_version 707495 (0.0009) [2023-12-26 05:16:29,052][123090] Updated weights for policy 1, policy_version 707505 (0.0006) [2023-12-26 05:16:29,105][123090] Updated weights for policy 1, policy_version 707515 (0.0005) [2023-12-26 05:16:29,345][123091] Updated weights for policy 0, policy_version 711891 (0.0010) [2023-12-26 05:16:29,416][123091] Updated weights for policy 0, policy_version 711902 (0.0011) [2023-12-26 05:16:29,467][123091] Updated weights for policy 0, policy_version 711912 (0.0010) [2023-12-26 05:16:29,891][123090] Updated weights for policy 1, policy_version 707525 (0.0007) [2023-12-26 05:16:29,961][123090] Updated weights for policy 1, policy_version 707535 (0.0010) [2023-12-26 05:16:30,013][123090] Updated weights for policy 1, policy_version 707545 (0.0007) [2023-12-26 05:16:30,307][123091] Updated weights for policy 0, policy_version 711922 (0.0010) [2023-12-26 05:16:30,358][123091] Updated weights for policy 0, policy_version 711932 (0.0007) [2023-12-26 05:16:30,413][123091] Updated weights for policy 0, policy_version 711942 (0.0008) [2023-12-26 05:16:30,474][123091] Updated weights for policy 0, policy_version 711952 (0.0010) [2023-12-26 05:16:30,701][123090] Updated weights for policy 1, policy_version 707555 (0.0005) [2023-12-26 05:16:30,766][123090] Updated weights for policy 1, policy_version 707565 (0.0008) [2023-12-26 05:16:30,833][123090] Updated weights for policy 1, policy_version 707575 (0.0005) [2023-12-26 05:16:31,340][123091] Updated weights for policy 0, policy_version 711962 (0.0010) [2023-12-26 05:16:31,413][123091] Updated weights for policy 0, policy_version 711972 (0.0008) [2023-12-26 05:16:31,473][123091] Updated weights for policy 0, policy_version 711982 (0.0009) [2023-12-26 05:16:31,544][123090] Updated weights for policy 1, policy_version 707585 (0.0006) [2023-12-26 05:16:31,606][123090] Updated weights for policy 1, policy_version 707595 (0.0010) [2023-12-26 05:16:31,675][123090] Updated weights for policy 1, policy_version 707605 (0.0009) [2023-12-26 05:16:31,742][123090] Updated weights for policy 1, policy_version 707615 (0.0009) [2023-12-26 05:16:32,276][123091] Updated weights for policy 0, policy_version 711992 (0.0007) [2023-12-26 05:16:32,339][123091] Updated weights for policy 0, policy_version 712002 (0.0006) [2023-12-26 05:16:32,402][123091] Updated weights for policy 0, policy_version 712012 (0.0009) [2023-12-26 05:16:32,579][123090] Updated weights for policy 1, policy_version 707625 (0.0009) [2023-12-26 05:16:32,642][123090] Updated weights for policy 1, policy_version 707635 (0.0010) [2023-12-26 05:16:32,697][123090] Updated weights for policy 1, policy_version 707645 (0.0007) [2023-12-26 05:16:33,203][123091] Updated weights for policy 0, policy_version 712022 (0.0008) [2023-12-26 05:16:33,251][123091] Updated weights for policy 0, policy_version 712033 (0.0008) [2023-12-26 05:16:33,313][123091] Updated weights for policy 0, policy_version 712043 (0.0009) [2023-12-26 05:16:33,403][123090] Updated weights for policy 1, policy_version 707655 (0.0008) [2023-12-26 05:16:33,462][123090] Updated weights for policy 1, policy_version 707665 (0.0009) [2023-12-26 05:16:33,509][123090] Updated weights for policy 1, policy_version 707675 (0.0008) [2023-12-26 05:16:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 363454464. Throughput: 0: 8531.8, 1: 8967.0. Samples: 363464296. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:33,785][121949] Avg episode reward: [(0, '6160.212'), (1, '5755.292')] [2023-12-26 05:16:34,147][123091] Updated weights for policy 0, policy_version 712053 (0.0008) [2023-12-26 05:16:34,217][123091] Updated weights for policy 0, policy_version 712063 (0.0007) [2023-12-26 05:16:34,292][123091] Updated weights for policy 0, policy_version 712073 (0.0006) [2023-12-26 05:16:34,392][123090] Updated weights for policy 1, policy_version 707685 (0.0010) [2023-12-26 05:16:34,450][123090] Updated weights for policy 1, policy_version 707695 (0.0009) [2023-12-26 05:16:34,507][123090] Updated weights for policy 1, policy_version 707705 (0.0009) [2023-12-26 05:16:35,039][123091] Updated weights for policy 0, policy_version 712083 (0.0007) [2023-12-26 05:16:35,090][123091] Updated weights for policy 0, policy_version 712093 (0.0010) [2023-12-26 05:16:35,138][123091] Updated weights for policy 0, policy_version 712103 (0.0010) [2023-12-26 05:16:35,286][123090] Updated weights for policy 1, policy_version 707715 (0.0009) [2023-12-26 05:16:35,342][123090] Updated weights for policy 1, policy_version 707725 (0.0007) [2023-12-26 05:16:35,393][123090] Updated weights for policy 1, policy_version 707735 (0.0005) [2023-12-26 05:16:35,970][123091] Updated weights for policy 0, policy_version 712113 (0.0011) [2023-12-26 05:16:36,021][123091] Updated weights for policy 0, policy_version 712123 (0.0010) [2023-12-26 05:16:36,083][123091] Updated weights for policy 0, policy_version 712133 (0.0010) [2023-12-26 05:16:36,102][123090] Updated weights for policy 1, policy_version 707745 (0.0006) [2023-12-26 05:16:36,150][123091] Updated weights for policy 0, policy_version 712143 (0.0008) [2023-12-26 05:16:36,166][123090] Updated weights for policy 1, policy_version 707755 (0.0008) [2023-12-26 05:16:36,225][123090] Updated weights for policy 1, policy_version 707765 (0.0008) [2023-12-26 05:16:36,283][123090] Updated weights for policy 1, policy_version 707775 (0.0009) [2023-12-26 05:16:36,903][123091] Updated weights for policy 0, policy_version 712153 (0.0005) [2023-12-26 05:16:36,964][123091] Updated weights for policy 0, policy_version 712163 (0.0006) [2023-12-26 05:16:37,014][123091] Updated weights for policy 0, policy_version 712173 (0.0006) [2023-12-26 05:16:37,196][123090] Updated weights for policy 1, policy_version 707785 (0.0010) [2023-12-26 05:16:37,254][123090] Updated weights for policy 1, policy_version 707795 (0.0010) [2023-12-26 05:16:37,312][123090] Updated weights for policy 1, policy_version 707805 (0.0010) [2023-12-26 05:16:37,621][123091] Updated weights for policy 0, policy_version 712183 (0.0006) [2023-12-26 05:16:37,691][123091] Updated weights for policy 0, policy_version 712193 (0.0009) [2023-12-26 05:16:37,754][123091] Updated weights for policy 0, policy_version 712203 (0.0013) [2023-12-26 05:16:38,186][123090] Updated weights for policy 1, policy_version 707815 (0.0010) [2023-12-26 05:16:38,246][123090] Updated weights for policy 1, policy_version 707825 (0.0010) [2023-12-26 05:16:38,309][123090] Updated weights for policy 1, policy_version 707835 (0.0010) [2023-12-26 05:16:38,536][123091] Updated weights for policy 0, policy_version 712213 (0.0010) [2023-12-26 05:16:38,603][123091] Updated weights for policy 0, policy_version 712223 (0.0011) [2023-12-26 05:16:38,676][123091] Updated weights for policy 0, policy_version 712233 (0.0011) [2023-12-26 05:16:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 363544576. Throughput: 0: 8565.5, 1: 8986.9. Samples: 363517660. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:38,784][121949] Avg episode reward: [(0, '6145.370'), (1, '5566.237')] [2023-12-26 05:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000712240_182337536.pth... [2023-12-26 05:16:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000707840_181207040.pth... [2023-12-26 05:16:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000706816_180944896.pth [2023-12-26 05:16:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000711216_182075392.pth [2023-12-26 05:16:39,193][123090] Updated weights for policy 1, policy_version 707845 (0.0010) [2023-12-26 05:16:39,265][123090] Updated weights for policy 1, policy_version 707855 (0.0009) [2023-12-26 05:16:39,340][123090] Updated weights for policy 1, policy_version 707865 (0.0010) [2023-12-26 05:16:39,373][123091] Updated weights for policy 0, policy_version 712243 (0.0010) [2023-12-26 05:16:39,441][123091] Updated weights for policy 0, policy_version 712253 (0.0006) [2023-12-26 05:16:39,510][123091] Updated weights for policy 0, policy_version 712263 (0.0006) [2023-12-26 05:16:40,183][123090] Updated weights for policy 1, policy_version 707875 (0.0009) [2023-12-26 05:16:40,250][123090] Updated weights for policy 1, policy_version 707885 (0.0010) [2023-12-26 05:16:40,292][123091] Updated weights for policy 0, policy_version 712273 (0.0010) [2023-12-26 05:16:40,319][123090] Updated weights for policy 1, policy_version 707895 (0.0009) [2023-12-26 05:16:40,363][123091] Updated weights for policy 0, policy_version 712283 (0.0006) [2023-12-26 05:16:40,429][123091] Updated weights for policy 0, policy_version 712293 (0.0010) [2023-12-26 05:16:40,496][123091] Updated weights for policy 0, policy_version 712303 (0.0009) [2023-12-26 05:16:41,170][123090] Updated weights for policy 1, policy_version 707905 (0.0009) [2023-12-26 05:16:41,227][123091] Updated weights for policy 0, policy_version 712313 (0.0007) [2023-12-26 05:16:41,242][123090] Updated weights for policy 1, policy_version 707915 (0.0008) [2023-12-26 05:16:41,292][123091] Updated weights for policy 0, policy_version 712323 (0.0008) [2023-12-26 05:16:41,319][123090] Updated weights for policy 1, policy_version 707925 (0.0007) [2023-12-26 05:16:41,364][123091] Updated weights for policy 0, policy_version 712333 (0.0008) [2023-12-26 05:16:41,397][123090] Updated weights for policy 1, policy_version 707935 (0.0008) [2023-12-26 05:16:42,155][123090] Updated weights for policy 1, policy_version 707945 (0.0011) [2023-12-26 05:16:42,169][123091] Updated weights for policy 0, policy_version 712343 (0.0011) [2023-12-26 05:16:42,219][123090] Updated weights for policy 1, policy_version 707955 (0.0010) [2023-12-26 05:16:42,227][123091] Updated weights for policy 0, policy_version 712353 (0.0007) [2023-12-26 05:16:42,292][123090] Updated weights for policy 1, policy_version 707965 (0.0007) [2023-12-26 05:16:42,298][123091] Updated weights for policy 0, policy_version 712363 (0.0009) [2023-12-26 05:16:43,076][123091] Updated weights for policy 0, policy_version 712373 (0.0009) [2023-12-26 05:16:43,131][123090] Updated weights for policy 1, policy_version 707975 (0.0006) [2023-12-26 05:16:43,138][123091] Updated weights for policy 0, policy_version 712383 (0.0010) [2023-12-26 05:16:43,191][123090] Updated weights for policy 1, policy_version 707985 (0.0005) [2023-12-26 05:16:43,195][123091] Updated weights for policy 0, policy_version 712393 (0.0008) [2023-12-26 05:16:43,258][123090] Updated weights for policy 1, policy_version 707995 (0.0005) [2023-12-26 05:16:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 363626496. Throughput: 0: 8685.3, 1: 8847.4. Samples: 363621328. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:43,785][121949] Avg episode reward: [(0, '6057.078'), (1, '5583.586')] [2023-12-26 05:16:43,891][123090] Updated weights for policy 1, policy_version 708005 (0.0006) [2023-12-26 05:16:43,953][123090] Updated weights for policy 1, policy_version 708015 (0.0008) [2023-12-26 05:16:44,016][123090] Updated weights for policy 1, policy_version 708025 (0.0009) [2023-12-26 05:16:44,105][123091] Updated weights for policy 0, policy_version 712403 (0.0009) [2023-12-26 05:16:44,171][123091] Updated weights for policy 0, policy_version 712413 (0.0010) [2023-12-26 05:16:44,233][123091] Updated weights for policy 0, policy_version 712423 (0.0009) [2023-12-26 05:16:44,679][123090] Updated weights for policy 1, policy_version 708035 (0.0006) [2023-12-26 05:16:44,742][123090] Updated weights for policy 1, policy_version 708045 (0.0005) [2023-12-26 05:16:44,815][123090] Updated weights for policy 1, policy_version 708055 (0.0007) [2023-12-26 05:16:45,126][123091] Updated weights for policy 0, policy_version 712433 (0.0010) [2023-12-26 05:16:45,187][123091] Updated weights for policy 0, policy_version 712443 (0.0009) [2023-12-26 05:16:45,251][123091] Updated weights for policy 0, policy_version 712453 (0.0009) [2023-12-26 05:16:45,308][123091] Updated weights for policy 0, policy_version 712463 (0.0009) [2023-12-26 05:16:45,592][123090] Updated weights for policy 1, policy_version 708065 (0.0006) [2023-12-26 05:16:45,648][123090] Updated weights for policy 1, policy_version 708075 (0.0010) [2023-12-26 05:16:45,715][123090] Updated weights for policy 1, policy_version 708085 (0.0010) [2023-12-26 05:16:45,775][123090] Updated weights for policy 1, policy_version 708095 (0.0010) [2023-12-26 05:16:46,158][123091] Updated weights for policy 0, policy_version 712473 (0.0010) [2023-12-26 05:16:46,216][123091] Updated weights for policy 0, policy_version 712483 (0.0008) [2023-12-26 05:16:46,269][123091] Updated weights for policy 0, policy_version 712494 (0.0010) [2023-12-26 05:16:46,567][123090] Updated weights for policy 1, policy_version 708105 (0.0009) [2023-12-26 05:16:46,629][123090] Updated weights for policy 1, policy_version 708115 (0.0009) [2023-12-26 05:16:46,696][123090] Updated weights for policy 1, policy_version 708125 (0.0009) [2023-12-26 05:16:47,140][123091] Updated weights for policy 0, policy_version 712504 (0.0010) [2023-12-26 05:16:47,198][123091] Updated weights for policy 0, policy_version 712514 (0.0010) [2023-12-26 05:16:47,252][123091] Updated weights for policy 0, policy_version 712524 (0.0010) [2023-12-26 05:16:47,392][123090] Updated weights for policy 1, policy_version 708135 (0.0010) [2023-12-26 05:16:47,439][123090] Updated weights for policy 1, policy_version 708145 (0.0008) [2023-12-26 05:16:47,488][123090] Updated weights for policy 1, policy_version 708155 (0.0009) [2023-12-26 05:16:48,086][123091] Updated weights for policy 0, policy_version 712534 (0.0009) [2023-12-26 05:16:48,157][123091] Updated weights for policy 0, policy_version 712544 (0.0009) [2023-12-26 05:16:48,222][123091] Updated weights for policy 0, policy_version 712554 (0.0009) [2023-12-26 05:16:48,349][123090] Updated weights for policy 1, policy_version 708165 (0.0008) [2023-12-26 05:16:48,409][123090] Updated weights for policy 1, policy_version 708175 (0.0006) [2023-12-26 05:16:48,464][123090] Updated weights for policy 1, policy_version 708185 (0.0009) [2023-12-26 05:16:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 363716608. Throughput: 0: 8700.7, 1: 8854.1. Samples: 363726104. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:48,784][121949] Avg episode reward: [(0, '6037.430'), (1, '5726.655')] [2023-12-26 05:16:49,105][123091] Updated weights for policy 0, policy_version 712564 (0.0010) [2023-12-26 05:16:49,163][123091] Updated weights for policy 0, policy_version 712574 (0.0010) [2023-12-26 05:16:49,222][123091] Updated weights for policy 0, policy_version 712584 (0.0009) [2023-12-26 05:16:49,291][123090] Updated weights for policy 1, policy_version 708195 (0.0007) [2023-12-26 05:16:49,357][123090] Updated weights for policy 1, policy_version 708205 (0.0007) [2023-12-26 05:16:49,416][123090] Updated weights for policy 1, policy_version 708215 (0.0008) [2023-12-26 05:16:50,113][123091] Updated weights for policy 0, policy_version 712594 (0.0009) [2023-12-26 05:16:50,181][123091] Updated weights for policy 0, policy_version 712604 (0.0009) [2023-12-26 05:16:50,186][123090] Updated weights for policy 1, policy_version 708225 (0.0008) [2023-12-26 05:16:50,237][123091] Updated weights for policy 0, policy_version 712614 (0.0009) [2023-12-26 05:16:50,251][123090] Updated weights for policy 1, policy_version 708235 (0.0009) [2023-12-26 05:16:50,301][123090] Updated weights for policy 1, policy_version 708245 (0.0009) [2023-12-26 05:16:50,303][123091] Updated weights for policy 0, policy_version 712624 (0.0007) [2023-12-26 05:16:50,363][123090] Updated weights for policy 1, policy_version 708255 (0.0007) [2023-12-26 05:16:51,139][123090] Updated weights for policy 1, policy_version 708265 (0.0009) [2023-12-26 05:16:51,165][123091] Updated weights for policy 0, policy_version 712634 (0.0008) [2023-12-26 05:16:51,198][123090] Updated weights for policy 1, policy_version 708275 (0.0009) [2023-12-26 05:16:51,233][123091] Updated weights for policy 0, policy_version 712644 (0.0011) [2023-12-26 05:16:51,266][123090] Updated weights for policy 1, policy_version 708285 (0.0009) [2023-12-26 05:16:51,299][123091] Updated weights for policy 0, policy_version 712654 (0.0009) [2023-12-26 05:16:52,043][123090] Updated weights for policy 1, policy_version 708295 (0.0009) [2023-12-26 05:16:52,100][123090] Updated weights for policy 1, policy_version 708305 (0.0010) [2023-12-26 05:16:52,157][123091] Updated weights for policy 0, policy_version 712664 (0.0009) [2023-12-26 05:16:52,159][123090] Updated weights for policy 1, policy_version 708315 (0.0008) [2023-12-26 05:16:52,222][123091] Updated weights for policy 0, policy_version 712674 (0.0009) [2023-12-26 05:16:52,291][123091] Updated weights for policy 0, policy_version 712684 (0.0009) [2023-12-26 05:16:53,025][123090] Updated weights for policy 1, policy_version 708325 (0.0009) [2023-12-26 05:16:53,084][123090] Updated weights for policy 1, policy_version 708335 (0.0010) [2023-12-26 05:16:53,109][123091] Updated weights for policy 0, policy_version 712694 (0.0009) [2023-12-26 05:16:53,151][123090] Updated weights for policy 1, policy_version 708345 (0.0010) [2023-12-26 05:16:53,160][123091] Updated weights for policy 0, policy_version 712704 (0.0006) [2023-12-26 05:16:53,209][123091] Updated weights for policy 0, policy_version 712714 (0.0006) [2023-12-26 05:16:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 363798528. Throughput: 0: 8680.0, 1: 8847.8. Samples: 363777196. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:53,785][121949] Avg episode reward: [(0, '6070.759'), (1, '5390.354')] [2023-12-26 05:16:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000712720_182460416.pth... [2023-12-26 05:16:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000708352_181338112.pth... [2023-12-26 05:16:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000711696_182198272.pth [2023-12-26 05:16:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000707328_181075968.pth [2023-12-26 05:16:53,971][123090] Updated weights for policy 1, policy_version 708355 (0.0010) [2023-12-26 05:16:54,021][123091] Updated weights for policy 0, policy_version 712724 (0.0008) [2023-12-26 05:16:54,023][123090] Updated weights for policy 1, policy_version 708365 (0.0010) [2023-12-26 05:16:54,071][123091] Updated weights for policy 0, policy_version 712734 (0.0005) [2023-12-26 05:16:54,078][123090] Updated weights for policy 1, policy_version 708375 (0.0010) [2023-12-26 05:16:54,128][123091] Updated weights for policy 0, policy_version 712744 (0.0007) [2023-12-26 05:16:54,767][123090] Updated weights for policy 1, policy_version 708385 (0.0007) [2023-12-26 05:16:54,826][123090] Updated weights for policy 1, policy_version 708395 (0.0005) [2023-12-26 05:16:54,893][123090] Updated weights for policy 1, policy_version 708405 (0.0005) [2023-12-26 05:16:54,970][123090] Updated weights for policy 1, policy_version 708415 (0.0006) [2023-12-26 05:16:55,026][123091] Updated weights for policy 0, policy_version 712754 (0.0009) [2023-12-26 05:16:55,084][123091] Updated weights for policy 0, policy_version 712765 (0.0010) [2023-12-26 05:16:55,138][123091] Updated weights for policy 0, policy_version 712775 (0.0010) [2023-12-26 05:16:55,672][123090] Updated weights for policy 1, policy_version 708425 (0.0006) [2023-12-26 05:16:55,732][123090] Updated weights for policy 1, policy_version 708435 (0.0005) [2023-12-26 05:16:55,786][123090] Updated weights for policy 1, policy_version 708445 (0.0006) [2023-12-26 05:16:56,065][123091] Updated weights for policy 0, policy_version 712785 (0.0009) [2023-12-26 05:16:56,122][123091] Updated weights for policy 0, policy_version 712795 (0.0010) [2023-12-26 05:16:56,175][123091] Updated weights for policy 0, policy_version 712805 (0.0009) [2023-12-26 05:16:56,229][123091] Updated weights for policy 0, policy_version 712815 (0.0010) [2023-12-26 05:16:56,426][123090] Updated weights for policy 1, policy_version 708455 (0.0005) [2023-12-26 05:16:56,476][123090] Updated weights for policy 1, policy_version 708465 (0.0005) [2023-12-26 05:16:56,521][123090] Updated weights for policy 1, policy_version 708475 (0.0006) [2023-12-26 05:16:57,170][123091] Updated weights for policy 0, policy_version 712825 (0.0010) [2023-12-26 05:16:57,207][123090] Updated weights for policy 1, policy_version 708485 (0.0006) [2023-12-26 05:16:57,219][123091] Updated weights for policy 0, policy_version 712835 (0.0009) [2023-12-26 05:16:57,256][123090] Updated weights for policy 1, policy_version 708495 (0.0005) [2023-12-26 05:16:57,277][123091] Updated weights for policy 0, policy_version 712846 (0.0009) [2023-12-26 05:16:57,308][123090] Updated weights for policy 1, policy_version 708505 (0.0005) [2023-12-26 05:16:58,000][123090] Updated weights for policy 1, policy_version 708515 (0.0006) [2023-12-26 05:16:58,069][123090] Updated weights for policy 1, policy_version 708525 (0.0007) [2023-12-26 05:16:58,130][123090] Updated weights for policy 1, policy_version 708535 (0.0009) [2023-12-26 05:16:58,238][123091] Updated weights for policy 0, policy_version 712856 (0.0008) [2023-12-26 05:16:58,301][123091] Updated weights for policy 0, policy_version 712866 (0.0009) [2023-12-26 05:16:58,367][123091] Updated weights for policy 0, policy_version 712876 (0.0009) [2023-12-26 05:16:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 363888640. Throughput: 0: 8636.8, 1: 9021.7. Samples: 363883784. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:16:58,785][121949] Avg episode reward: [(0, '6034.901'), (1, '4980.037')] [2023-12-26 05:16:58,996][123090] Updated weights for policy 1, policy_version 708545 (0.0008) [2023-12-26 05:16:59,054][123090] Updated weights for policy 1, policy_version 708555 (0.0008) [2023-12-26 05:16:59,117][123090] Updated weights for policy 1, policy_version 708565 (0.0006) [2023-12-26 05:16:59,185][123090] Updated weights for policy 1, policy_version 708575 (0.0005) [2023-12-26 05:16:59,306][123091] Updated weights for policy 0, policy_version 712886 (0.0010) [2023-12-26 05:16:59,374][123091] Updated weights for policy 0, policy_version 712896 (0.0008) [2023-12-26 05:16:59,426][123091] Updated weights for policy 0, policy_version 712906 (0.0006) [2023-12-26 05:16:59,878][123090] Updated weights for policy 1, policy_version 708585 (0.0010) [2023-12-26 05:16:59,949][123090] Updated weights for policy 1, policy_version 708596 (0.0007) [2023-12-26 05:17:00,010][123090] Updated weights for policy 1, policy_version 708606 (0.0009) [2023-12-26 05:17:00,193][123091] Updated weights for policy 0, policy_version 712916 (0.0006) [2023-12-26 05:17:00,252][123091] Updated weights for policy 0, policy_version 712926 (0.0006) [2023-12-26 05:17:00,317][123091] Updated weights for policy 0, policy_version 712936 (0.0007) [2023-12-26 05:17:00,832][123090] Updated weights for policy 1, policy_version 708616 (0.0010) [2023-12-26 05:17:00,898][123090] Updated weights for policy 1, policy_version 708626 (0.0010) [2023-12-26 05:17:00,957][123090] Updated weights for policy 1, policy_version 708636 (0.0010) [2023-12-26 05:17:01,052][123091] Updated weights for policy 0, policy_version 712946 (0.0008) [2023-12-26 05:17:01,120][123091] Updated weights for policy 0, policy_version 712956 (0.0007) [2023-12-26 05:17:01,186][123091] Updated weights for policy 0, policy_version 712966 (0.0007) [2023-12-26 05:17:01,262][123091] Updated weights for policy 0, policy_version 712976 (0.0006) [2023-12-26 05:17:01,762][123090] Updated weights for policy 1, policy_version 708646 (0.0009) [2023-12-26 05:17:01,816][123090] Updated weights for policy 1, policy_version 708657 (0.0010) [2023-12-26 05:17:01,868][123090] Updated weights for policy 1, policy_version 708667 (0.0008) [2023-12-26 05:17:02,004][123091] Updated weights for policy 0, policy_version 712986 (0.0005) [2023-12-26 05:17:02,074][123091] Updated weights for policy 0, policy_version 712996 (0.0005) [2023-12-26 05:17:02,131][123091] Updated weights for policy 0, policy_version 713006 (0.0005) [2023-12-26 05:17:02,644][123090] Updated weights for policy 1, policy_version 708677 (0.0005) [2023-12-26 05:17:02,721][123090] Updated weights for policy 1, policy_version 708687 (0.0006) [2023-12-26 05:17:02,793][123090] Updated weights for policy 1, policy_version 708697 (0.0009) [2023-12-26 05:17:02,848][123091] Updated weights for policy 0, policy_version 713016 (0.0010) [2023-12-26 05:17:02,912][123091] Updated weights for policy 0, policy_version 713026 (0.0011) [2023-12-26 05:17:02,965][123091] Updated weights for policy 0, policy_version 713036 (0.0011) [2023-12-26 05:17:03,432][123090] Updated weights for policy 1, policy_version 708707 (0.0007) [2023-12-26 05:17:03,496][123090] Updated weights for policy 1, policy_version 708717 (0.0005) [2023-12-26 05:17:03,557][123090] Updated weights for policy 1, policy_version 708727 (0.0005) [2023-12-26 05:17:03,754][123091] Updated weights for policy 0, policy_version 713046 (0.0008) [2023-12-26 05:17:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 363978752. Throughput: 0: 8700.2, 1: 8944.2. Samples: 363992112. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:03,784][121949] Avg episode reward: [(0, '6077.453'), (1, '5248.219')] [2023-12-26 05:17:03,806][123091] Updated weights for policy 0, policy_version 713056 (0.0005) [2023-12-26 05:17:03,852][123091] Updated weights for policy 0, policy_version 713066 (0.0006) [2023-12-26 05:17:04,298][123090] Updated weights for policy 1, policy_version 708737 (0.0006) [2023-12-26 05:17:04,361][123090] Updated weights for policy 1, policy_version 708747 (0.0009) [2023-12-26 05:17:04,426][123090] Updated weights for policy 1, policy_version 708757 (0.0006) [2023-12-26 05:17:04,488][123090] Updated weights for policy 1, policy_version 708767 (0.0009) [2023-12-26 05:17:04,618][123091] Updated weights for policy 0, policy_version 713076 (0.0006) [2023-12-26 05:17:04,692][123091] Updated weights for policy 0, policy_version 713086 (0.0007) [2023-12-26 05:17:04,760][123091] Updated weights for policy 0, policy_version 713096 (0.0009) [2023-12-26 05:17:05,371][123090] Updated weights for policy 1, policy_version 708777 (0.0009) [2023-12-26 05:17:05,379][123091] Updated weights for policy 0, policy_version 713106 (0.0007) [2023-12-26 05:17:05,428][123090] Updated weights for policy 1, policy_version 708787 (0.0009) [2023-12-26 05:17:05,434][123091] Updated weights for policy 0, policy_version 713116 (0.0005) [2023-12-26 05:17:05,481][123090] Updated weights for policy 1, policy_version 708797 (0.0009) [2023-12-26 05:17:05,496][123091] Updated weights for policy 0, policy_version 713126 (0.0007) [2023-12-26 05:17:05,555][123091] Updated weights for policy 0, policy_version 713136 (0.0009) [2023-12-26 05:17:06,177][123090] Updated weights for policy 1, policy_version 708807 (0.0009) [2023-12-26 05:17:06,245][123090] Updated weights for policy 1, policy_version 708817 (0.0010) [2023-12-26 05:17:06,315][123090] Updated weights for policy 1, policy_version 708827 (0.0013) [2023-12-26 05:17:06,424][123091] Updated weights for policy 0, policy_version 713146 (0.0006) [2023-12-26 05:17:06,505][123091] Updated weights for policy 0, policy_version 713156 (0.0009) [2023-12-26 05:17:06,567][123091] Updated weights for policy 0, policy_version 713166 (0.0010) [2023-12-26 05:17:07,029][123090] Updated weights for policy 1, policy_version 708837 (0.0007) [2023-12-26 05:17:07,093][123090] Updated weights for policy 1, policy_version 708847 (0.0005) [2023-12-26 05:17:07,152][123090] Updated weights for policy 1, policy_version 708857 (0.0006) [2023-12-26 05:17:07,384][123091] Updated weights for policy 0, policy_version 713176 (0.0010) [2023-12-26 05:17:07,438][123091] Updated weights for policy 0, policy_version 713186 (0.0010) [2023-12-26 05:17:07,498][123091] Updated weights for policy 0, policy_version 713197 (0.0010) [2023-12-26 05:17:07,835][123090] Updated weights for policy 1, policy_version 708867 (0.0007) [2023-12-26 05:17:07,889][123090] Updated weights for policy 1, policy_version 708877 (0.0009) [2023-12-26 05:17:07,942][123090] Updated weights for policy 1, policy_version 708887 (0.0010) [2023-12-26 05:17:08,358][123091] Updated weights for policy 0, policy_version 713207 (0.0009) [2023-12-26 05:17:08,417][123091] Updated weights for policy 0, policy_version 713217 (0.0009) [2023-12-26 05:17:08,485][123091] Updated weights for policy 0, policy_version 713227 (0.0009) [2023-12-26 05:17:08,767][123090] Updated weights for policy 1, policy_version 708897 (0.0008) [2023-12-26 05:17:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 364068864. Throughput: 0: 8764.8, 1: 8971.6. Samples: 364046520. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:08,785][121949] Avg episode reward: [(0, '6054.936'), (1, '5123.428')] [2023-12-26 05:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000713232_182591488.pth... [2023-12-26 05:17:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000712240_182337536.pth [2023-12-26 05:17:08,831][123090] Updated weights for policy 1, policy_version 708907 (0.0011) [2023-12-26 05:17:08,898][123090] Updated weights for policy 1, policy_version 708917 (0.0010) [2023-12-26 05:17:08,957][123090] Updated weights for policy 1, policy_version 708927 (0.0010) [2023-12-26 05:17:08,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000708928_181485568.pth... [2023-12-26 05:17:08,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000707840_181207040.pth [2023-12-26 05:17:09,297][123091] Updated weights for policy 0, policy_version 713237 (0.0010) [2023-12-26 05:17:09,372][123091] Updated weights for policy 0, policy_version 713247 (0.0011) [2023-12-26 05:17:09,448][123091] Updated weights for policy 0, policy_version 713257 (0.0009) [2023-12-26 05:17:09,776][123090] Updated weights for policy 1, policy_version 708937 (0.0009) [2023-12-26 05:17:09,847][123090] Updated weights for policy 1, policy_version 708947 (0.0010) [2023-12-26 05:17:09,907][123090] Updated weights for policy 1, policy_version 708957 (0.0009) [2023-12-26 05:17:10,326][123091] Updated weights for policy 0, policy_version 713267 (0.0010) [2023-12-26 05:17:10,378][123091] Updated weights for policy 0, policy_version 713277 (0.0011) [2023-12-26 05:17:10,431][123091] Updated weights for policy 0, policy_version 713287 (0.0011) [2023-12-26 05:17:10,731][123090] Updated weights for policy 1, policy_version 708967 (0.0008) [2023-12-26 05:17:10,790][123090] Updated weights for policy 1, policy_version 708977 (0.0008) [2023-12-26 05:17:10,858][123090] Updated weights for policy 1, policy_version 708987 (0.0009) [2023-12-26 05:17:11,279][123091] Updated weights for policy 0, policy_version 713297 (0.0010) [2023-12-26 05:17:11,356][123091] Updated weights for policy 0, policy_version 713307 (0.0006) [2023-12-26 05:17:11,432][123091] Updated weights for policy 0, policy_version 713317 (0.0008) [2023-12-26 05:17:11,495][123091] Updated weights for policy 0, policy_version 713327 (0.0008) [2023-12-26 05:17:11,770][123090] Updated weights for policy 1, policy_version 708997 (0.0009) [2023-12-26 05:17:11,843][123090] Updated weights for policy 1, policy_version 709007 (0.0005) [2023-12-26 05:17:11,909][123090] Updated weights for policy 1, policy_version 709017 (0.0006) [2023-12-26 05:17:12,242][123091] Updated weights for policy 0, policy_version 713337 (0.0010) [2023-12-26 05:17:12,306][123091] Updated weights for policy 0, policy_version 713347 (0.0007) [2023-12-26 05:17:12,370][123091] Updated weights for policy 0, policy_version 713357 (0.0009) [2023-12-26 05:17:12,666][123090] Updated weights for policy 1, policy_version 709027 (0.0008) [2023-12-26 05:17:12,716][123090] Updated weights for policy 1, policy_version 709037 (0.0009) [2023-12-26 05:17:12,773][123090] Updated weights for policy 1, policy_version 709047 (0.0009) [2023-12-26 05:17:13,197][123091] Updated weights for policy 0, policy_version 713367 (0.0011) [2023-12-26 05:17:13,252][123091] Updated weights for policy 0, policy_version 713377 (0.0011) [2023-12-26 05:17:13,303][123091] Updated weights for policy 0, policy_version 713387 (0.0010) [2023-12-26 05:17:13,618][123090] Updated weights for policy 1, policy_version 709057 (0.0009) [2023-12-26 05:17:13,672][123090] Updated weights for policy 1, policy_version 709067 (0.0010) [2023-12-26 05:17:13,726][123090] Updated weights for policy 1, policy_version 709077 (0.0010) [2023-12-26 05:17:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 364150784. Throughput: 0: 8632.5, 1: 8977.0. Samples: 364149684. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:13,785][121949] Avg episode reward: [(0, '5940.781'), (1, '5190.291')] [2023-12-26 05:17:13,788][123090] Updated weights for policy 1, policy_version 709087 (0.0010) [2023-12-26 05:17:14,101][123091] Updated weights for policy 0, policy_version 713397 (0.0010) [2023-12-26 05:17:14,154][123091] Updated weights for policy 0, policy_version 713407 (0.0009) [2023-12-26 05:17:14,204][123091] Updated weights for policy 0, policy_version 713417 (0.0010) [2023-12-26 05:17:14,675][123090] Updated weights for policy 1, policy_version 709097 (0.0009) [2023-12-26 05:17:14,734][123090] Updated weights for policy 1, policy_version 709107 (0.0010) [2023-12-26 05:17:14,801][123090] Updated weights for policy 1, policy_version 709117 (0.0008) [2023-12-26 05:17:15,086][123091] Updated weights for policy 0, policy_version 713427 (0.0009) [2023-12-26 05:17:15,150][123091] Updated weights for policy 0, policy_version 713437 (0.0010) [2023-12-26 05:17:15,209][123091] Updated weights for policy 0, policy_version 713447 (0.0010) [2023-12-26 05:17:15,497][123090] Updated weights for policy 1, policy_version 709127 (0.0008) [2023-12-26 05:17:15,562][123090] Updated weights for policy 1, policy_version 709137 (0.0008) [2023-12-26 05:17:15,625][123090] Updated weights for policy 1, policy_version 709147 (0.0008) [2023-12-26 05:17:16,122][123091] Updated weights for policy 0, policy_version 713457 (0.0010) [2023-12-26 05:17:16,171][123091] Updated weights for policy 0, policy_version 713467 (0.0009) [2023-12-26 05:17:16,222][123091] Updated weights for policy 0, policy_version 713477 (0.0009) [2023-12-26 05:17:16,260][123090] Updated weights for policy 1, policy_version 709157 (0.0008) [2023-12-26 05:17:16,287][123091] Updated weights for policy 0, policy_version 713487 (0.0009) [2023-12-26 05:17:16,309][123090] Updated weights for policy 1, policy_version 709167 (0.0007) [2023-12-26 05:17:16,362][123090] Updated weights for policy 1, policy_version 709177 (0.0009) [2023-12-26 05:17:17,084][123091] Updated weights for policy 0, policy_version 713497 (0.0006) [2023-12-26 05:17:17,156][123091] Updated weights for policy 0, policy_version 713507 (0.0005) [2023-12-26 05:17:17,229][123091] Updated weights for policy 0, policy_version 713517 (0.0007) [2023-12-26 05:17:17,251][123090] Updated weights for policy 1, policy_version 709187 (0.0008) [2023-12-26 05:17:17,307][123090] Updated weights for policy 1, policy_version 709197 (0.0009) [2023-12-26 05:17:17,373][123090] Updated weights for policy 1, policy_version 709207 (0.0007) [2023-12-26 05:17:18,012][123091] Updated weights for policy 0, policy_version 713527 (0.0010) [2023-12-26 05:17:18,073][123091] Updated weights for policy 0, policy_version 713537 (0.0010) [2023-12-26 05:17:18,077][123090] Updated weights for policy 1, policy_version 709217 (0.0005) [2023-12-26 05:17:18,131][123091] Updated weights for policy 0, policy_version 713547 (0.0010) [2023-12-26 05:17:18,133][123090] Updated weights for policy 1, policy_version 709227 (0.0005) [2023-12-26 05:17:18,190][123090] Updated weights for policy 1, policy_version 709237 (0.0005) [2023-12-26 05:17:18,261][123090] Updated weights for policy 1, policy_version 709247 (0.0005) [2023-12-26 05:17:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 364240896. Throughput: 0: 8585.8, 1: 8997.0. Samples: 364255520. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:18,784][121949] Avg episode reward: [(0, '5913.309'), (1, '5171.933')] [2023-12-26 05:17:18,955][123090] Updated weights for policy 1, policy_version 709257 (0.0010) [2023-12-26 05:17:19,003][123090] Updated weights for policy 1, policy_version 709267 (0.0010) [2023-12-26 05:17:19,018][123091] Updated weights for policy 0, policy_version 713557 (0.0008) [2023-12-26 05:17:19,064][123091] Updated weights for policy 0, policy_version 713567 (0.0009) [2023-12-26 05:17:19,070][123090] Updated weights for policy 1, policy_version 709277 (0.0010) [2023-12-26 05:17:19,121][123091] Updated weights for policy 0, policy_version 713577 (0.0007) [2023-12-26 05:17:19,933][123090] Updated weights for policy 1, policy_version 709287 (0.0008) [2023-12-26 05:17:19,998][123090] Updated weights for policy 1, policy_version 709297 (0.0010) [2023-12-26 05:17:20,023][123091] Updated weights for policy 0, policy_version 713587 (0.0009) [2023-12-26 05:17:20,061][123090] Updated weights for policy 1, policy_version 709307 (0.0008) [2023-12-26 05:17:20,085][123091] Updated weights for policy 0, policy_version 713597 (0.0010) [2023-12-26 05:17:20,143][123091] Updated weights for policy 0, policy_version 713607 (0.0008) [2023-12-26 05:17:20,879][123090] Updated weights for policy 1, policy_version 709317 (0.0008) [2023-12-26 05:17:20,941][123090] Updated weights for policy 1, policy_version 709327 (0.0009) [2023-12-26 05:17:20,997][123090] Updated weights for policy 1, policy_version 709337 (0.0006) [2023-12-26 05:17:21,000][123091] Updated weights for policy 0, policy_version 713617 (0.0008) [2023-12-26 05:17:21,068][123091] Updated weights for policy 0, policy_version 713627 (0.0008) [2023-12-26 05:17:21,134][123091] Updated weights for policy 0, policy_version 713637 (0.0010) [2023-12-26 05:17:21,197][123091] Updated weights for policy 0, policy_version 713648 (0.0010) [2023-12-26 05:17:21,820][123090] Updated weights for policy 1, policy_version 709347 (0.0009) [2023-12-26 05:17:21,889][123090] Updated weights for policy 1, policy_version 709357 (0.0009) [2023-12-26 05:17:21,958][123090] Updated weights for policy 1, policy_version 709367 (0.0009) [2023-12-26 05:17:22,044][123091] Updated weights for policy 0, policy_version 713658 (0.0009) [2023-12-26 05:17:22,098][123091] Updated weights for policy 0, policy_version 713668 (0.0009) [2023-12-26 05:17:22,161][123091] Updated weights for policy 0, policy_version 713678 (0.0006) [2023-12-26 05:17:22,754][123090] Updated weights for policy 1, policy_version 709377 (0.0010) [2023-12-26 05:17:22,817][123090] Updated weights for policy 1, policy_version 709387 (0.0010) [2023-12-26 05:17:22,870][123090] Updated weights for policy 1, policy_version 709397 (0.0009) [2023-12-26 05:17:22,921][123090] Updated weights for policy 1, policy_version 709407 (0.0009) [2023-12-26 05:17:23,004][123091] Updated weights for policy 0, policy_version 713688 (0.0009) [2023-12-26 05:17:23,075][123091] Updated weights for policy 0, policy_version 713698 (0.0009) [2023-12-26 05:17:23,147][123091] Updated weights for policy 0, policy_version 713708 (0.0010) [2023-12-26 05:17:23,768][123090] Updated weights for policy 1, policy_version 709417 (0.0009) [2023-12-26 05:17:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 364322816. Throughput: 0: 8535.7, 1: 8971.8. Samples: 364305500. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:23,785][121949] Avg episode reward: [(0, '6071.659'), (1, '5063.000')] [2023-12-26 05:17:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000713712_182714368.pth... [2023-12-26 05:17:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000712720_182460416.pth [2023-12-26 05:17:23,830][123090] Updated weights for policy 1, policy_version 709428 (0.0009) [2023-12-26 05:17:23,889][123090] Updated weights for policy 1, policy_version 709438 (0.0010) [2023-12-26 05:17:23,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000709440_181616640.pth... [2023-12-26 05:17:23,900][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000708352_181338112.pth [2023-12-26 05:17:23,961][123091] Updated weights for policy 0, policy_version 713718 (0.0010) [2023-12-26 05:17:24,023][123091] Updated weights for policy 0, policy_version 713728 (0.0010) [2023-12-26 05:17:24,070][123091] Updated weights for policy 0, policy_version 713738 (0.0010) [2023-12-26 05:17:24,716][123090] Updated weights for policy 1, policy_version 709448 (0.0010) [2023-12-26 05:17:24,788][123090] Updated weights for policy 1, policy_version 709458 (0.0008) [2023-12-26 05:17:24,852][123090] Updated weights for policy 1, policy_version 709468 (0.0008) [2023-12-26 05:17:24,885][123091] Updated weights for policy 0, policy_version 713748 (0.0009) [2023-12-26 05:17:24,935][123091] Updated weights for policy 0, policy_version 713758 (0.0005) [2023-12-26 05:17:24,988][123091] Updated weights for policy 0, policy_version 713768 (0.0007) [2023-12-26 05:17:25,670][123090] Updated weights for policy 1, policy_version 709478 (0.0009) [2023-12-26 05:17:25,722][123090] Updated weights for policy 1, policy_version 709488 (0.0008) [2023-12-26 05:17:25,769][123090] Updated weights for policy 1, policy_version 709498 (0.0009) [2023-12-26 05:17:25,800][123091] Updated weights for policy 0, policy_version 713778 (0.0009) [2023-12-26 05:17:25,850][123091] Updated weights for policy 0, policy_version 713788 (0.0008) [2023-12-26 05:17:25,898][123091] Updated weights for policy 0, policy_version 713798 (0.0009) [2023-12-26 05:17:25,951][123091] Updated weights for policy 0, policy_version 713808 (0.0008) [2023-12-26 05:17:26,623][123090] Updated weights for policy 1, policy_version 709508 (0.0010) [2023-12-26 05:17:26,679][123090] Updated weights for policy 1, policy_version 709518 (0.0009) [2023-12-26 05:17:26,741][123090] Updated weights for policy 1, policy_version 709528 (0.0008) [2023-12-26 05:17:26,779][123091] Updated weights for policy 0, policy_version 713818 (0.0006) [2023-12-26 05:17:26,835][123091] Updated weights for policy 0, policy_version 713828 (0.0006) [2023-12-26 05:17:26,901][123091] Updated weights for policy 0, policy_version 713838 (0.0005) [2023-12-26 05:17:27,533][123091] Updated weights for policy 0, policy_version 713848 (0.0005) [2023-12-26 05:17:27,580][123091] Updated weights for policy 0, policy_version 713858 (0.0005) [2023-12-26 05:17:27,636][123091] Updated weights for policy 0, policy_version 713868 (0.0009) [2023-12-26 05:17:27,657][123090] Updated weights for policy 1, policy_version 709538 (0.0009) [2023-12-26 05:17:27,716][123090] Updated weights for policy 1, policy_version 709548 (0.0009) [2023-12-26 05:17:27,766][123090] Updated weights for policy 1, policy_version 709558 (0.0008) [2023-12-26 05:17:27,817][123090] Updated weights for policy 1, policy_version 709568 (0.0008) [2023-12-26 05:17:28,269][123091] Updated weights for policy 0, policy_version 713878 (0.0010) [2023-12-26 05:17:28,329][123091] Updated weights for policy 0, policy_version 713888 (0.0011) [2023-12-26 05:17:28,388][123091] Updated weights for policy 0, policy_version 713898 (0.0011) [2023-12-26 05:17:28,677][123090] Updated weights for policy 1, policy_version 709578 (0.0009) [2023-12-26 05:17:28,733][123090] Updated weights for policy 1, policy_version 709588 (0.0009) [2023-12-26 05:17:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 364412928. Throughput: 0: 8519.7, 1: 8992.3. Samples: 364409368. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:28,785][121949] Avg episode reward: [(0, '6060.805'), (1, '5258.553')] [2023-12-26 05:17:28,797][123090] Updated weights for policy 1, policy_version 709598 (0.0009) [2023-12-26 05:17:29,203][123091] Updated weights for policy 0, policy_version 713908 (0.0011) [2023-12-26 05:17:29,272][123091] Updated weights for policy 0, policy_version 713918 (0.0010) [2023-12-26 05:17:29,329][123091] Updated weights for policy 0, policy_version 713928 (0.0011) [2023-12-26 05:17:29,593][123090] Updated weights for policy 1, policy_version 709608 (0.0008) [2023-12-26 05:17:29,657][123090] Updated weights for policy 1, policy_version 709618 (0.0009) [2023-12-26 05:17:29,727][123090] Updated weights for policy 1, policy_version 709628 (0.0010) [2023-12-26 05:17:30,066][123091] Updated weights for policy 0, policy_version 713938 (0.0009) [2023-12-26 05:17:30,130][123091] Updated weights for policy 0, policy_version 713948 (0.0005) [2023-12-26 05:17:30,198][123091] Updated weights for policy 0, policy_version 713958 (0.0006) [2023-12-26 05:17:30,261][123091] Updated weights for policy 0, policy_version 713968 (0.0008) [2023-12-26 05:17:30,620][123090] Updated weights for policy 1, policy_version 709638 (0.0010) [2023-12-26 05:17:30,668][123090] Updated weights for policy 1, policy_version 709648 (0.0008) [2023-12-26 05:17:30,728][123090] Updated weights for policy 1, policy_version 709658 (0.0009) [2023-12-26 05:17:31,004][123091] Updated weights for policy 0, policy_version 713978 (0.0010) [2023-12-26 05:17:31,063][123091] Updated weights for policy 0, policy_version 713988 (0.0011) [2023-12-26 05:17:31,118][123091] Updated weights for policy 0, policy_version 713998 (0.0010) [2023-12-26 05:17:31,602][123090] Updated weights for policy 1, policy_version 709668 (0.0009) [2023-12-26 05:17:31,672][123090] Updated weights for policy 1, policy_version 709678 (0.0009) [2023-12-26 05:17:31,743][123090] Updated weights for policy 1, policy_version 709688 (0.0010) [2023-12-26 05:17:31,932][123091] Updated weights for policy 0, policy_version 714008 (0.0008) [2023-12-26 05:17:31,986][123091] Updated weights for policy 0, policy_version 714018 (0.0005) [2023-12-26 05:17:32,038][123091] Updated weights for policy 0, policy_version 714028 (0.0005) [2023-12-26 05:17:32,472][123090] Updated weights for policy 1, policy_version 709698 (0.0008) [2023-12-26 05:17:32,528][123090] Updated weights for policy 1, policy_version 709708 (0.0005) [2023-12-26 05:17:32,583][123090] Updated weights for policy 1, policy_version 709718 (0.0007) [2023-12-26 05:17:32,637][123090] Updated weights for policy 1, policy_version 709728 (0.0010) [2023-12-26 05:17:32,737][123091] Updated weights for policy 0, policy_version 714038 (0.0007) [2023-12-26 05:17:32,785][123091] Updated weights for policy 0, policy_version 714048 (0.0009) [2023-12-26 05:17:32,855][123091] Updated weights for policy 0, policy_version 714058 (0.0010) [2023-12-26 05:17:33,387][123090] Updated weights for policy 1, policy_version 709738 (0.0006) [2023-12-26 05:17:33,439][123090] Updated weights for policy 1, policy_version 709748 (0.0005) [2023-12-26 05:17:33,483][123090] Updated weights for policy 1, policy_version 709758 (0.0005) [2023-12-26 05:17:33,693][123091] Updated weights for policy 0, policy_version 714068 (0.0008) [2023-12-26 05:17:33,759][123091] Updated weights for policy 0, policy_version 714078 (0.0009) [2023-12-26 05:17:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 364503040. Throughput: 0: 8637.7, 1: 8918.5. Samples: 364516132. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:33,785][121949] Avg episode reward: [(0, '6213.832'), (1, '5144.324')] [2023-12-26 05:17:33,817][123091] Updated weights for policy 0, policy_version 714088 (0.0009) [2023-12-26 05:17:34,301][123090] Updated weights for policy 1, policy_version 709768 (0.0006) [2023-12-26 05:17:34,367][123090] Updated weights for policy 1, policy_version 709778 (0.0007) [2023-12-26 05:17:34,435][123090] Updated weights for policy 1, policy_version 709788 (0.0008) [2023-12-26 05:17:34,588][123091] Updated weights for policy 0, policy_version 714098 (0.0007) [2023-12-26 05:17:34,651][123091] Updated weights for policy 0, policy_version 714108 (0.0009) [2023-12-26 05:17:34,721][123091] Updated weights for policy 0, policy_version 714118 (0.0009) [2023-12-26 05:17:34,769][123091] Updated weights for policy 0, policy_version 714128 (0.0009) [2023-12-26 05:17:35,218][123090] Updated weights for policy 1, policy_version 709798 (0.0009) [2023-12-26 05:17:35,275][123090] Updated weights for policy 1, policy_version 709808 (0.0009) [2023-12-26 05:17:35,330][123090] Updated weights for policy 1, policy_version 709818 (0.0009) [2023-12-26 05:17:35,608][123091] Updated weights for policy 0, policy_version 714138 (0.0009) [2023-12-26 05:17:35,670][123091] Updated weights for policy 0, policy_version 714148 (0.0009) [2023-12-26 05:17:35,725][123091] Updated weights for policy 0, policy_version 714158 (0.0010) [2023-12-26 05:17:36,177][123090] Updated weights for policy 1, policy_version 709828 (0.0009) [2023-12-26 05:17:36,247][123090] Updated weights for policy 1, policy_version 709838 (0.0010) [2023-12-26 05:17:36,317][123090] Updated weights for policy 1, policy_version 709848 (0.0010) [2023-12-26 05:17:36,525][123091] Updated weights for policy 0, policy_version 714168 (0.0007) [2023-12-26 05:17:36,594][123091] Updated weights for policy 0, policy_version 714178 (0.0006) [2023-12-26 05:17:36,663][123091] Updated weights for policy 0, policy_version 714188 (0.0009) [2023-12-26 05:17:37,159][123090] Updated weights for policy 1, policy_version 709858 (0.0009) [2023-12-26 05:17:37,208][123090] Updated weights for policy 1, policy_version 709868 (0.0009) [2023-12-26 05:17:37,255][123090] Updated weights for policy 1, policy_version 709878 (0.0008) [2023-12-26 05:17:37,305][123090] Updated weights for policy 1, policy_version 709888 (0.0008) [2023-12-26 05:17:37,409][123091] Updated weights for policy 0, policy_version 714198 (0.0009) [2023-12-26 05:17:37,465][123091] Updated weights for policy 0, policy_version 714208 (0.0010) [2023-12-26 05:17:37,525][123091] Updated weights for policy 0, policy_version 714218 (0.0010) [2023-12-26 05:17:38,161][123090] Updated weights for policy 1, policy_version 709898 (0.0010) [2023-12-26 05:17:38,216][123090] Updated weights for policy 1, policy_version 709908 (0.0010) [2023-12-26 05:17:38,294][123090] Updated weights for policy 1, policy_version 709918 (0.0010) [2023-12-26 05:17:38,432][123091] Updated weights for policy 0, policy_version 714228 (0.0010) [2023-12-26 05:17:38,499][123091] Updated weights for policy 0, policy_version 714238 (0.0009) [2023-12-26 05:17:38,557][123091] Updated weights for policy 0, policy_version 714248 (0.0010) [2023-12-26 05:17:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 364593152. Throughput: 0: 8688.8, 1: 8883.4. Samples: 364567944. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:38,784][121949] Avg episode reward: [(0, '6148.094'), (1, '5091.890')] [2023-12-26 05:17:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000709920_181739520.pth... [2023-12-26 05:17:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000714256_182853632.pth... [2023-12-26 05:17:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000708928_181485568.pth [2023-12-26 05:17:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000713232_182591488.pth [2023-12-26 05:17:39,173][123090] Updated weights for policy 1, policy_version 709928 (0.0009) [2023-12-26 05:17:39,242][123090] Updated weights for policy 1, policy_version 709938 (0.0010) [2023-12-26 05:17:39,297][123090] Updated weights for policy 1, policy_version 709948 (0.0010) [2023-12-26 05:17:39,395][123091] Updated weights for policy 0, policy_version 714258 (0.0008) [2023-12-26 05:17:39,453][123091] Updated weights for policy 0, policy_version 714268 (0.0008) [2023-12-26 05:17:39,505][123091] Updated weights for policy 0, policy_version 714278 (0.0008) [2023-12-26 05:17:39,558][123091] Updated weights for policy 0, policy_version 714288 (0.0008) [2023-12-26 05:17:40,183][123090] Updated weights for policy 1, policy_version 709958 (0.0010) [2023-12-26 05:17:40,250][123090] Updated weights for policy 1, policy_version 709968 (0.0009) [2023-12-26 05:17:40,308][123090] Updated weights for policy 1, policy_version 709978 (0.0010) [2023-12-26 05:17:40,409][123091] Updated weights for policy 0, policy_version 714298 (0.0006) [2023-12-26 05:17:40,476][123091] Updated weights for policy 0, policy_version 714308 (0.0006) [2023-12-26 05:17:40,546][123091] Updated weights for policy 0, policy_version 714318 (0.0009) [2023-12-26 05:17:41,110][123090] Updated weights for policy 1, policy_version 709988 (0.0008) [2023-12-26 05:17:41,191][123090] Updated weights for policy 1, policy_version 709998 (0.0008) [2023-12-26 05:17:41,267][123090] Updated weights for policy 1, policy_version 710008 (0.0008) [2023-12-26 05:17:41,368][123091] Updated weights for policy 0, policy_version 714328 (0.0008) [2023-12-26 05:17:41,440][123091] Updated weights for policy 0, policy_version 714338 (0.0006) [2023-12-26 05:17:41,512][123091] Updated weights for policy 0, policy_version 714348 (0.0006) [2023-12-26 05:17:42,062][123090] Updated weights for policy 1, policy_version 710018 (0.0008) [2023-12-26 05:17:42,128][123090] Updated weights for policy 1, policy_version 710028 (0.0006) [2023-12-26 05:17:42,190][123090] Updated weights for policy 1, policy_version 710038 (0.0005) [2023-12-26 05:17:42,263][123090] Updated weights for policy 1, policy_version 710048 (0.0006) [2023-12-26 05:17:42,279][123091] Updated weights for policy 0, policy_version 714358 (0.0008) [2023-12-26 05:17:42,343][123091] Updated weights for policy 0, policy_version 714368 (0.0010) [2023-12-26 05:17:42,407][123091] Updated weights for policy 0, policy_version 714378 (0.0011) [2023-12-26 05:17:43,027][123090] Updated weights for policy 1, policy_version 710058 (0.0010) [2023-12-26 05:17:43,092][123090] Updated weights for policy 1, policy_version 710068 (0.0010) [2023-12-26 05:17:43,160][123090] Updated weights for policy 1, policy_version 710078 (0.0010) [2023-12-26 05:17:43,258][123091] Updated weights for policy 0, policy_version 714388 (0.0008) [2023-12-26 05:17:43,319][123091] Updated weights for policy 0, policy_version 714398 (0.0005) [2023-12-26 05:17:43,377][123091] Updated weights for policy 0, policy_version 714408 (0.0005) [2023-12-26 05:17:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 364675072. Throughput: 0: 8717.9, 1: 8730.1. Samples: 364668948. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:43,785][121949] Avg episode reward: [(0, '6006.589'), (1, '4740.514')] [2023-12-26 05:17:44,053][123090] Updated weights for policy 1, policy_version 710088 (0.0009) [2023-12-26 05:17:44,118][123090] Updated weights for policy 1, policy_version 710098 (0.0010) [2023-12-26 05:17:44,123][123091] Updated weights for policy 0, policy_version 714418 (0.0006) [2023-12-26 05:17:44,175][123090] Updated weights for policy 1, policy_version 710108 (0.0007) [2023-12-26 05:17:44,189][123091] Updated weights for policy 0, policy_version 714428 (0.0009) [2023-12-26 05:17:44,254][123091] Updated weights for policy 0, policy_version 714438 (0.0009) [2023-12-26 05:17:44,322][123091] Updated weights for policy 0, policy_version 714448 (0.0009) [2023-12-26 05:17:45,041][123090] Updated weights for policy 1, policy_version 710118 (0.0008) [2023-12-26 05:17:45,114][123090] Updated weights for policy 1, policy_version 710128 (0.0008) [2023-12-26 05:17:45,114][123091] Updated weights for policy 0, policy_version 714458 (0.0009) [2023-12-26 05:17:45,178][123091] Updated weights for policy 0, policy_version 714468 (0.0009) [2023-12-26 05:17:45,185][123090] Updated weights for policy 1, policy_version 710138 (0.0007) [2023-12-26 05:17:45,248][123091] Updated weights for policy 0, policy_version 714478 (0.0009) [2023-12-26 05:17:45,966][123090] Updated weights for policy 1, policy_version 710148 (0.0009) [2023-12-26 05:17:46,028][123090] Updated weights for policy 1, policy_version 710158 (0.0010) [2023-12-26 05:17:46,069][123091] Updated weights for policy 0, policy_version 714488 (0.0007) [2023-12-26 05:17:46,088][123090] Updated weights for policy 1, policy_version 710168 (0.0010) [2023-12-26 05:17:46,121][123091] Updated weights for policy 0, policy_version 714498 (0.0006) [2023-12-26 05:17:46,180][123091] Updated weights for policy 0, policy_version 714508 (0.0008) [2023-12-26 05:17:46,857][123090] Updated weights for policy 1, policy_version 710178 (0.0010) [2023-12-26 05:17:46,920][123090] Updated weights for policy 1, policy_version 710188 (0.0008) [2023-12-26 05:17:46,979][123090] Updated weights for policy 1, policy_version 710198 (0.0009) [2023-12-26 05:17:47,029][123090] Updated weights for policy 1, policy_version 710208 (0.0008) [2023-12-26 05:17:47,037][123091] Updated weights for policy 0, policy_version 714518 (0.0009) [2023-12-26 05:17:47,090][123091] Updated weights for policy 0, policy_version 714528 (0.0009) [2023-12-26 05:17:47,138][123091] Updated weights for policy 0, policy_version 714538 (0.0009) [2023-12-26 05:17:47,870][123090] Updated weights for policy 1, policy_version 710218 (0.0009) [2023-12-26 05:17:47,937][123090] Updated weights for policy 1, policy_version 710228 (0.0009) [2023-12-26 05:17:47,954][123091] Updated weights for policy 0, policy_version 714548 (0.0008) [2023-12-26 05:17:47,991][123090] Updated weights for policy 1, policy_version 710238 (0.0009) [2023-12-26 05:17:48,017][123091] Updated weights for policy 0, policy_version 714558 (0.0009) [2023-12-26 05:17:48,074][123091] Updated weights for policy 0, policy_version 714568 (0.0010) [2023-12-26 05:17:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 364756992. Throughput: 0: 8688.7, 1: 8654.0. Samples: 364772536. Policy #0 lag: (min: 25.0, avg: 50.5, max: 57.0) [2023-12-26 05:17:48,785][121949] Avg episode reward: [(0, '5933.479'), (1, '4715.996')] [2023-12-26 05:17:48,805][123090] Updated weights for policy 1, policy_version 710248 (0.0009) [2023-12-26 05:17:48,861][123090] Updated weights for policy 1, policy_version 710258 (0.0010) [2023-12-26 05:17:48,924][123090] Updated weights for policy 1, policy_version 710268 (0.0009) [2023-12-26 05:17:48,940][123091] Updated weights for policy 0, policy_version 714578 (0.0009) [2023-12-26 05:17:49,002][123091] Updated weights for policy 0, policy_version 714588 (0.0008) [2023-12-26 05:17:49,062][123091] Updated weights for policy 0, policy_version 714598 (0.0010) [2023-12-26 05:17:49,115][123091] Updated weights for policy 0, policy_version 714608 (0.0010) [2023-12-26 05:17:49,697][123090] Updated weights for policy 1, policy_version 710278 (0.0007) [2023-12-26 05:17:49,767][123090] Updated weights for policy 1, policy_version 710288 (0.0006) [2023-12-26 05:17:49,832][123090] Updated weights for policy 1, policy_version 710298 (0.0008) [2023-12-26 05:17:50,043][123091] Updated weights for policy 0, policy_version 714618 (0.0008) [2023-12-26 05:17:50,095][123091] Updated weights for policy 0, policy_version 714628 (0.0009) [2023-12-26 05:17:50,149][123091] Updated weights for policy 0, policy_version 714638 (0.0009) [2023-12-26 05:17:50,652][123090] Updated weights for policy 1, policy_version 710308 (0.0011) [2023-12-26 05:17:50,719][123090] Updated weights for policy 1, policy_version 710318 (0.0011) [2023-12-26 05:17:50,786][123090] Updated weights for policy 1, policy_version 710328 (0.0011) [2023-12-26 05:17:51,023][123091] Updated weights for policy 0, policy_version 714648 (0.0009) [2023-12-26 05:17:51,100][123091] Updated weights for policy 0, policy_version 714658 (0.0007) [2023-12-26 05:17:51,162][123091] Updated weights for policy 0, policy_version 714668 (0.0009) [2023-12-26 05:17:51,610][123090] Updated weights for policy 1, policy_version 710338 (0.0011) [2023-12-26 05:17:51,669][123090] Updated weights for policy 1, policy_version 710348 (0.0011) [2023-12-26 05:17:51,738][123090] Updated weights for policy 1, policy_version 710358 (0.0011) [2023-12-26 05:17:51,805][123090] Updated weights for policy 1, policy_version 710368 (0.0008) [2023-12-26 05:17:51,995][123091] Updated weights for policy 0, policy_version 714678 (0.0008) [2023-12-26 05:17:52,053][123091] Updated weights for policy 0, policy_version 714688 (0.0009) [2023-12-26 05:17:52,111][123091] Updated weights for policy 0, policy_version 714698 (0.0008) [2023-12-26 05:17:52,614][123090] Updated weights for policy 1, policy_version 710378 (0.0010) [2023-12-26 05:17:52,663][123090] Updated weights for policy 1, policy_version 710388 (0.0010) [2023-12-26 05:17:52,719][123090] Updated weights for policy 1, policy_version 710398 (0.0010) [2023-12-26 05:17:52,904][123091] Updated weights for policy 0, policy_version 714708 (0.0009) [2023-12-26 05:17:52,969][123091] Updated weights for policy 0, policy_version 714718 (0.0010) [2023-12-26 05:17:53,041][123091] Updated weights for policy 0, policy_version 714728 (0.0005) [2023-12-26 05:17:53,424][123090] Updated weights for policy 1, policy_version 710408 (0.0010) [2023-12-26 05:17:53,495][123090] Updated weights for policy 1, policy_version 710418 (0.0011) [2023-12-26 05:17:53,558][123090] Updated weights for policy 1, policy_version 710428 (0.0010) [2023-12-26 05:17:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 364847104. Throughput: 0: 8622.7, 1: 8644.7. Samples: 364823556. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:17:53,785][121949] Avg episode reward: [(0, '5855.636'), (1, '4970.927')] [2023-12-26 05:17:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000714736_182976512.pth... [2023-12-26 05:17:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000710432_181870592.pth... [2023-12-26 05:17:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000713712_182714368.pth [2023-12-26 05:17:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000709440_181616640.pth [2023-12-26 05:17:53,854][123091] Updated weights for policy 0, policy_version 714738 (0.0006) [2023-12-26 05:17:53,907][123091] Updated weights for policy 0, policy_version 714748 (0.0009) [2023-12-26 05:17:53,966][123091] Updated weights for policy 0, policy_version 714758 (0.0008) [2023-12-26 05:17:54,025][123091] Updated weights for policy 0, policy_version 714768 (0.0008) [2023-12-26 05:17:54,335][123090] Updated weights for policy 1, policy_version 710438 (0.0007) [2023-12-26 05:17:54,385][123090] Updated weights for policy 1, policy_version 710448 (0.0007) [2023-12-26 05:17:54,432][123090] Updated weights for policy 1, policy_version 710458 (0.0010) [2023-12-26 05:17:54,839][123091] Updated weights for policy 0, policy_version 714778 (0.0010) [2023-12-26 05:17:54,902][123091] Updated weights for policy 0, policy_version 714788 (0.0010) [2023-12-26 05:17:54,964][123091] Updated weights for policy 0, policy_version 714798 (0.0010) [2023-12-26 05:17:55,170][123090] Updated weights for policy 1, policy_version 710468 (0.0010) [2023-12-26 05:17:55,229][123090] Updated weights for policy 1, policy_version 710478 (0.0010) [2023-12-26 05:17:55,278][123090] Updated weights for policy 1, policy_version 710488 (0.0010) [2023-12-26 05:17:55,798][123091] Updated weights for policy 0, policy_version 714808 (0.0007) [2023-12-26 05:17:55,860][123091] Updated weights for policy 0, policy_version 714818 (0.0006) [2023-12-26 05:17:55,923][123091] Updated weights for policy 0, policy_version 714828 (0.0006) [2023-12-26 05:17:56,086][123090] Updated weights for policy 1, policy_version 710498 (0.0010) [2023-12-26 05:17:56,145][123090] Updated weights for policy 1, policy_version 710508 (0.0010) [2023-12-26 05:17:56,196][123090] Updated weights for policy 1, policy_version 710518 (0.0010) [2023-12-26 05:17:56,254][123090] Updated weights for policy 1, policy_version 710528 (0.0010) [2023-12-26 05:17:56,560][123091] Updated weights for policy 0, policy_version 714838 (0.0005) [2023-12-26 05:17:56,636][123091] Updated weights for policy 0, policy_version 714848 (0.0006) [2023-12-26 05:17:56,695][123091] Updated weights for policy 0, policy_version 714858 (0.0006) [2023-12-26 05:17:57,083][123090] Updated weights for policy 1, policy_version 710538 (0.0010) [2023-12-26 05:17:57,130][123090] Updated weights for policy 1, policy_version 710548 (0.0010) [2023-12-26 05:17:57,181][123090] Updated weights for policy 1, policy_version 710558 (0.0010) [2023-12-26 05:17:57,392][123091] Updated weights for policy 0, policy_version 714868 (0.0005) [2023-12-26 05:17:57,438][123091] Updated weights for policy 0, policy_version 714878 (0.0005) [2023-12-26 05:17:57,491][123091] Updated weights for policy 0, policy_version 714888 (0.0005) [2023-12-26 05:17:58,035][123090] Updated weights for policy 1, policy_version 710568 (0.0011) [2023-12-26 05:17:58,098][123090] Updated weights for policy 1, policy_version 710578 (0.0011) [2023-12-26 05:17:58,161][123090] Updated weights for policy 1, policy_version 710588 (0.0010) [2023-12-26 05:17:58,182][123091] Updated weights for policy 0, policy_version 714898 (0.0006) [2023-12-26 05:17:58,251][123091] Updated weights for policy 0, policy_version 714908 (0.0006) [2023-12-26 05:17:58,318][123091] Updated weights for policy 0, policy_version 714918 (0.0006) [2023-12-26 05:17:58,386][123091] Updated weights for policy 0, policy_version 714928 (0.0009) [2023-12-26 05:17:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 364937216. Throughput: 0: 8724.1, 1: 8665.7. Samples: 364932224. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:17:58,785][121949] Avg episode reward: [(0, '5888.801'), (1, '5145.905')] [2023-12-26 05:17:59,075][123090] Updated weights for policy 1, policy_version 710598 (0.0010) [2023-12-26 05:17:59,134][123090] Updated weights for policy 1, policy_version 710608 (0.0008) [2023-12-26 05:17:59,197][123090] Updated weights for policy 1, policy_version 710618 (0.0008) [2023-12-26 05:17:59,228][123091] Updated weights for policy 0, policy_version 714938 (0.0010) [2023-12-26 05:17:59,284][123091] Updated weights for policy 0, policy_version 714948 (0.0010) [2023-12-26 05:17:59,347][123091] Updated weights for policy 0, policy_version 714958 (0.0010) [2023-12-26 05:18:00,002][123090] Updated weights for policy 1, policy_version 710628 (0.0009) [2023-12-26 05:18:00,044][123091] Updated weights for policy 0, policy_version 714968 (0.0009) [2023-12-26 05:18:00,064][123090] Updated weights for policy 1, policy_version 710638 (0.0007) [2023-12-26 05:18:00,103][123091] Updated weights for policy 0, policy_version 714978 (0.0010) [2023-12-26 05:18:00,123][123090] Updated weights for policy 1, policy_version 710648 (0.0007) [2023-12-26 05:18:00,154][123091] Updated weights for policy 0, policy_version 714988 (0.0010) [2023-12-26 05:18:00,828][123090] Updated weights for policy 1, policy_version 710658 (0.0006) [2023-12-26 05:18:00,875][123091] Updated weights for policy 0, policy_version 714998 (0.0006) [2023-12-26 05:18:00,902][123090] Updated weights for policy 1, policy_version 710668 (0.0006) [2023-12-26 05:18:00,938][123091] Updated weights for policy 0, policy_version 715008 (0.0005) [2023-12-26 05:18:00,963][123090] Updated weights for policy 1, policy_version 710678 (0.0005) [2023-12-26 05:18:01,001][123091] Updated weights for policy 0, policy_version 715018 (0.0005) [2023-12-26 05:18:01,022][123090] Updated weights for policy 1, policy_version 710688 (0.0006) [2023-12-26 05:18:01,718][123091] Updated weights for policy 0, policy_version 715028 (0.0008) [2023-12-26 05:18:01,785][123091] Updated weights for policy 0, policy_version 715038 (0.0009) [2023-12-26 05:18:01,818][123090] Updated weights for policy 1, policy_version 710698 (0.0006) [2023-12-26 05:18:01,848][123091] Updated weights for policy 0, policy_version 715048 (0.0008) [2023-12-26 05:18:01,881][123090] Updated weights for policy 1, policy_version 710708 (0.0006) [2023-12-26 05:18:01,941][123090] Updated weights for policy 1, policy_version 710718 (0.0008) [2023-12-26 05:18:02,615][123091] Updated weights for policy 0, policy_version 715058 (0.0008) [2023-12-26 05:18:02,672][123091] Updated weights for policy 0, policy_version 715068 (0.0009) [2023-12-26 05:18:02,725][123091] Updated weights for policy 0, policy_version 715078 (0.0009) [2023-12-26 05:18:02,780][123091] Updated weights for policy 0, policy_version 715088 (0.0009) [2023-12-26 05:18:02,785][123090] Updated weights for policy 1, policy_version 710728 (0.0008) [2023-12-26 05:18:02,852][123090] Updated weights for policy 1, policy_version 710738 (0.0009) [2023-12-26 05:18:02,914][123090] Updated weights for policy 1, policy_version 710748 (0.0009) [2023-12-26 05:18:03,615][123091] Updated weights for policy 0, policy_version 715098 (0.0009) [2023-12-26 05:18:03,665][123091] Updated weights for policy 0, policy_version 715108 (0.0009) [2023-12-26 05:18:03,727][123091] Updated weights for policy 0, policy_version 715118 (0.0008) [2023-12-26 05:18:03,732][123090] Updated weights for policy 1, policy_version 710758 (0.0008) [2023-12-26 05:18:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 365027328. Throughput: 0: 8808.1, 1: 8593.9. Samples: 365038608. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:03,784][121949] Avg episode reward: [(0, '5942.632'), (1, '5258.013')] [2023-12-26 05:18:03,791][123090] Updated weights for policy 1, policy_version 710768 (0.0009) [2023-12-26 05:18:03,868][123090] Updated weights for policy 1, policy_version 710778 (0.0009) [2023-12-26 05:18:04,587][123091] Updated weights for policy 0, policy_version 715128 (0.0009) [2023-12-26 05:18:04,654][123091] Updated weights for policy 0, policy_version 715138 (0.0009) [2023-12-26 05:18:04,680][123090] Updated weights for policy 1, policy_version 710788 (0.0009) [2023-12-26 05:18:04,713][123091] Updated weights for policy 0, policy_version 715148 (0.0008) [2023-12-26 05:18:04,737][123090] Updated weights for policy 1, policy_version 710798 (0.0008) [2023-12-26 05:18:04,803][123090] Updated weights for policy 1, policy_version 710808 (0.0010) [2023-12-26 05:18:05,547][123091] Updated weights for policy 0, policy_version 715158 (0.0008) [2023-12-26 05:18:05,613][123091] Updated weights for policy 0, policy_version 715168 (0.0009) [2023-12-26 05:18:05,636][123090] Updated weights for policy 1, policy_version 710818 (0.0010) [2023-12-26 05:18:05,662][123091] Updated weights for policy 0, policy_version 715178 (0.0009) [2023-12-26 05:18:05,693][123090] Updated weights for policy 1, policy_version 710828 (0.0006) [2023-12-26 05:18:05,743][123090] Updated weights for policy 1, policy_version 710838 (0.0005) [2023-12-26 05:18:05,791][123090] Updated weights for policy 1, policy_version 710848 (0.0005) [2023-12-26 05:18:06,518][123090] Updated weights for policy 1, policy_version 710858 (0.0011) [2023-12-26 05:18:06,567][123091] Updated weights for policy 0, policy_version 715189 (0.0010) [2023-12-26 05:18:06,578][123090] Updated weights for policy 1, policy_version 710868 (0.0010) [2023-12-26 05:18:06,625][123091] Updated weights for policy 0, policy_version 715199 (0.0007) [2023-12-26 05:18:06,636][123090] Updated weights for policy 1, policy_version 710878 (0.0011) [2023-12-26 05:18:06,687][123091] Updated weights for policy 0, policy_version 715209 (0.0007) [2023-12-26 05:18:07,472][123090] Updated weights for policy 1, policy_version 710888 (0.0011) [2023-12-26 05:18:07,527][123090] Updated weights for policy 1, policy_version 710898 (0.0010) [2023-12-26 05:18:07,530][123091] Updated weights for policy 0, policy_version 715219 (0.0008) [2023-12-26 05:18:07,579][123090] Updated weights for policy 1, policy_version 710908 (0.0010) [2023-12-26 05:18:07,582][123091] Updated weights for policy 0, policy_version 715229 (0.0006) [2023-12-26 05:18:07,642][123091] Updated weights for policy 0, policy_version 715239 (0.0008) [2023-12-26 05:18:08,368][123090] Updated weights for policy 1, policy_version 710918 (0.0010) [2023-12-26 05:18:08,427][123091] Updated weights for policy 0, policy_version 715249 (0.0009) [2023-12-26 05:18:08,438][123090] Updated weights for policy 1, policy_version 710928 (0.0010) [2023-12-26 05:18:08,488][123091] Updated weights for policy 0, policy_version 715259 (0.0006) [2023-12-26 05:18:08,499][123090] Updated weights for policy 1, policy_version 710938 (0.0011) [2023-12-26 05:18:08,559][123091] Updated weights for policy 0, policy_version 715269 (0.0007) [2023-12-26 05:18:08,611][123091] Updated weights for policy 0, policy_version 715279 (0.0009) [2023-12-26 05:18:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 365117440. Throughput: 0: 8814.1, 1: 8613.7. Samples: 365089752. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:08,785][121949] Avg episode reward: [(0, '6022.983'), (1, '5255.330')] [2023-12-26 05:18:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000715280_183115776.pth... [2023-12-26 05:18:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000710944_182001664.pth... [2023-12-26 05:18:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000709920_181739520.pth [2023-12-26 05:18:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000714256_182853632.pth [2023-12-26 05:18:09,346][123090] Updated weights for policy 1, policy_version 710948 (0.0011) [2023-12-26 05:18:09,421][123090] Updated weights for policy 1, policy_version 710958 (0.0008) [2023-12-26 05:18:09,424][123091] Updated weights for policy 0, policy_version 715289 (0.0009) [2023-12-26 05:18:09,489][123090] Updated weights for policy 1, policy_version 710968 (0.0007) [2023-12-26 05:18:09,493][123091] Updated weights for policy 0, policy_version 715299 (0.0007) [2023-12-26 05:18:09,554][123091] Updated weights for policy 0, policy_version 715309 (0.0006) [2023-12-26 05:18:10,282][123090] Updated weights for policy 1, policy_version 710978 (0.0009) [2023-12-26 05:18:10,314][123091] Updated weights for policy 0, policy_version 715319 (0.0006) [2023-12-26 05:18:10,350][123090] Updated weights for policy 1, policy_version 710988 (0.0008) [2023-12-26 05:18:10,377][123091] Updated weights for policy 0, policy_version 715329 (0.0007) [2023-12-26 05:18:10,413][123090] Updated weights for policy 1, policy_version 710998 (0.0009) [2023-12-26 05:18:10,447][123091] Updated weights for policy 0, policy_version 715339 (0.0008) [2023-12-26 05:18:10,467][123090] Updated weights for policy 1, policy_version 711008 (0.0007) [2023-12-26 05:18:11,103][123091] Updated weights for policy 0, policy_version 715349 (0.0011) [2023-12-26 05:18:11,175][123091] Updated weights for policy 0, policy_version 715359 (0.0011) [2023-12-26 05:18:11,235][123091] Updated weights for policy 0, policy_version 715369 (0.0011) [2023-12-26 05:18:11,347][123090] Updated weights for policy 1, policy_version 711018 (0.0009) [2023-12-26 05:18:11,423][123090] Updated weights for policy 1, policy_version 711028 (0.0009) [2023-12-26 05:18:11,477][123090] Updated weights for policy 1, policy_version 711038 (0.0009) [2023-12-26 05:18:12,135][123091] Updated weights for policy 0, policy_version 715380 (0.0011) [2023-12-26 05:18:12,198][123091] Updated weights for policy 0, policy_version 715390 (0.0011) [2023-12-26 05:18:12,257][123091] Updated weights for policy 0, policy_version 715400 (0.0011) [2023-12-26 05:18:12,360][123090] Updated weights for policy 1, policy_version 711048 (0.0009) [2023-12-26 05:18:12,429][123090] Updated weights for policy 1, policy_version 711058 (0.0010) [2023-12-26 05:18:12,501][123090] Updated weights for policy 1, policy_version 711068 (0.0007) [2023-12-26 05:18:13,037][123091] Updated weights for policy 0, policy_version 715410 (0.0010) [2023-12-26 05:18:13,100][123091] Updated weights for policy 0, policy_version 715420 (0.0011) [2023-12-26 05:18:13,164][123091] Updated weights for policy 0, policy_version 715430 (0.0011) [2023-12-26 05:18:13,225][123090] Updated weights for policy 1, policy_version 711078 (0.0008) [2023-12-26 05:18:13,227][123091] Updated weights for policy 0, policy_version 715440 (0.0010) [2023-12-26 05:18:13,299][123090] Updated weights for policy 1, policy_version 711088 (0.0008) [2023-12-26 05:18:13,367][123090] Updated weights for policy 1, policy_version 711098 (0.0009) [2023-12-26 05:18:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 365199360. Throughput: 0: 8789.1, 1: 8620.7. Samples: 365192808. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:13,785][121949] Avg episode reward: [(0, '6076.297'), (1, '5309.445')] [2023-12-26 05:18:13,931][123091] Updated weights for policy 0, policy_version 715450 (0.0009) [2023-12-26 05:18:13,994][123091] Updated weights for policy 0, policy_version 715460 (0.0009) [2023-12-26 05:18:14,057][123091] Updated weights for policy 0, policy_version 715470 (0.0009) [2023-12-26 05:18:14,106][123090] Updated weights for policy 1, policy_version 711108 (0.0008) [2023-12-26 05:18:14,159][123090] Updated weights for policy 1, policy_version 711119 (0.0010) [2023-12-26 05:18:14,210][123090] Updated weights for policy 1, policy_version 711129 (0.0008) [2023-12-26 05:18:14,874][123091] Updated weights for policy 0, policy_version 715480 (0.0006) [2023-12-26 05:18:14,941][123091] Updated weights for policy 0, policy_version 715490 (0.0005) [2023-12-26 05:18:14,958][123090] Updated weights for policy 1, policy_version 711139 (0.0008) [2023-12-26 05:18:15,011][123091] Updated weights for policy 0, policy_version 715500 (0.0009) [2023-12-26 05:18:15,027][123090] Updated weights for policy 1, policy_version 711149 (0.0009) [2023-12-26 05:18:15,095][123090] Updated weights for policy 1, policy_version 711159 (0.0008) [2023-12-26 05:18:15,796][123090] Updated weights for policy 1, policy_version 711169 (0.0006) [2023-12-26 05:18:15,802][123091] Updated weights for policy 0, policy_version 715510 (0.0009) [2023-12-26 05:18:15,860][123090] Updated weights for policy 1, policy_version 711179 (0.0005) [2023-12-26 05:18:15,872][123091] Updated weights for policy 0, policy_version 715520 (0.0011) [2023-12-26 05:18:15,927][123091] Updated weights for policy 0, policy_version 715530 (0.0011) [2023-12-26 05:18:15,928][123090] Updated weights for policy 1, policy_version 711189 (0.0005) [2023-12-26 05:18:15,988][123090] Updated weights for policy 1, policy_version 711199 (0.0005) [2023-12-26 05:18:16,731][123090] Updated weights for policy 1, policy_version 711209 (0.0008) [2023-12-26 05:18:16,746][123091] Updated weights for policy 0, policy_version 715540 (0.0010) [2023-12-26 05:18:16,790][123090] Updated weights for policy 1, policy_version 711219 (0.0005) [2023-12-26 05:18:16,797][123091] Updated weights for policy 0, policy_version 715550 (0.0010) [2023-12-26 05:18:16,852][123091] Updated weights for policy 0, policy_version 715560 (0.0010) [2023-12-26 05:18:16,858][123090] Updated weights for policy 1, policy_version 711229 (0.0006) [2023-12-26 05:18:17,681][123090] Updated weights for policy 1, policy_version 711239 (0.0008) [2023-12-26 05:18:17,703][123091] Updated weights for policy 0, policy_version 715570 (0.0012) [2023-12-26 05:18:17,741][123090] Updated weights for policy 1, policy_version 711249 (0.0008) [2023-12-26 05:18:17,759][123091] Updated weights for policy 0, policy_version 715580 (0.0011) [2023-12-26 05:18:17,804][123090] Updated weights for policy 1, policy_version 711259 (0.0006) [2023-12-26 05:18:17,806][123091] Updated weights for policy 0, policy_version 715590 (0.0010) [2023-12-26 05:18:17,854][123091] Updated weights for policy 0, policy_version 715600 (0.0010) [2023-12-26 05:18:18,624][123090] Updated weights for policy 1, policy_version 711269 (0.0007) [2023-12-26 05:18:18,680][123090] Updated weights for policy 1, policy_version 711279 (0.0009) [2023-12-26 05:18:18,724][123091] Updated weights for policy 0, policy_version 715610 (0.0011) [2023-12-26 05:18:18,728][123090] Updated weights for policy 1, policy_version 711289 (0.0007) [2023-12-26 05:18:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 365289472. Throughput: 0: 8744.8, 1: 8689.4. Samples: 365300668. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:18,785][121949] Avg episode reward: [(0, '6083.274'), (1, '5311.183')] [2023-12-26 05:18:18,788][123091] Updated weights for policy 0, policy_version 715620 (0.0011) [2023-12-26 05:18:18,855][123091] Updated weights for policy 0, policy_version 715630 (0.0011) [2023-12-26 05:18:19,644][123090] Updated weights for policy 1, policy_version 711299 (0.0007) [2023-12-26 05:18:19,685][123091] Updated weights for policy 0, policy_version 715640 (0.0011) [2023-12-26 05:18:19,712][123090] Updated weights for policy 1, policy_version 711309 (0.0006) [2023-12-26 05:18:19,737][123091] Updated weights for policy 0, policy_version 715650 (0.0011) [2023-12-26 05:18:19,776][123090] Updated weights for policy 1, policy_version 711319 (0.0008) [2023-12-26 05:18:19,785][123091] Updated weights for policy 0, policy_version 715660 (0.0008) [2023-12-26 05:18:20,601][123090] Updated weights for policy 1, policy_version 711329 (0.0008) [2023-12-26 05:18:20,656][123091] Updated weights for policy 0, policy_version 715670 (0.0009) [2023-12-26 05:18:20,661][123090] Updated weights for policy 1, policy_version 711339 (0.0010) [2023-12-26 05:18:20,722][123091] Updated weights for policy 0, policy_version 715680 (0.0007) [2023-12-26 05:18:20,725][123090] Updated weights for policy 1, policy_version 711349 (0.0008) [2023-12-26 05:18:20,785][123091] Updated weights for policy 0, policy_version 715690 (0.0008) [2023-12-26 05:18:20,794][123090] Updated weights for policy 1, policy_version 711359 (0.0008) [2023-12-26 05:18:21,641][123090] Updated weights for policy 1, policy_version 711369 (0.0009) [2023-12-26 05:18:21,662][123091] Updated weights for policy 0, policy_version 715700 (0.0010) [2023-12-26 05:18:21,708][123090] Updated weights for policy 1, policy_version 711379 (0.0009) [2023-12-26 05:18:21,728][123091] Updated weights for policy 0, policy_version 715710 (0.0007) [2023-12-26 05:18:21,772][123090] Updated weights for policy 1, policy_version 711389 (0.0008) [2023-12-26 05:18:21,792][123091] Updated weights for policy 0, policy_version 715720 (0.0008) [2023-12-26 05:18:22,620][123090] Updated weights for policy 1, policy_version 711399 (0.0009) [2023-12-26 05:18:22,651][123091] Updated weights for policy 0, policy_version 715730 (0.0009) [2023-12-26 05:18:22,670][123090] Updated weights for policy 1, policy_version 711409 (0.0010) [2023-12-26 05:18:22,711][123091] Updated weights for policy 0, policy_version 715740 (0.0009) [2023-12-26 05:18:22,730][123090] Updated weights for policy 1, policy_version 711419 (0.0008) [2023-12-26 05:18:22,776][123091] Updated weights for policy 0, policy_version 715750 (0.0008) [2023-12-26 05:18:22,835][123091] Updated weights for policy 0, policy_version 715760 (0.0010) [2023-12-26 05:18:23,581][123090] Updated weights for policy 1, policy_version 711429 (0.0010) [2023-12-26 05:18:23,643][123090] Updated weights for policy 1, policy_version 711439 (0.0009) [2023-12-26 05:18:23,706][123091] Updated weights for policy 0, policy_version 715770 (0.0008) [2023-12-26 05:18:23,709][123090] Updated weights for policy 1, policy_version 711449 (0.0008) [2023-12-26 05:18:23,768][123091] Updated weights for policy 0, policy_version 715780 (0.0009) [2023-12-26 05:18:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 365371392. Throughput: 0: 8697.0, 1: 8683.3. Samples: 365350056. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:23,785][121949] Avg episode reward: [(0, '6044.071'), (1, '5293.446')] [2023-12-26 05:18:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000711456_182132736.pth... [2023-12-26 05:18:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000710432_181870592.pth [2023-12-26 05:18:23,835][123091] Updated weights for policy 0, policy_version 715790 (0.0010) [2023-12-26 05:18:23,847][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000715792_183246848.pth... [2023-12-26 05:18:23,852][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000714736_182976512.pth [2023-12-26 05:18:24,529][123090] Updated weights for policy 1, policy_version 711459 (0.0007) [2023-12-26 05:18:24,580][123090] Updated weights for policy 1, policy_version 711469 (0.0009) [2023-12-26 05:18:24,639][123090] Updated weights for policy 1, policy_version 711479 (0.0010) [2023-12-26 05:18:24,672][123091] Updated weights for policy 0, policy_version 715800 (0.0008) [2023-12-26 05:18:24,732][123091] Updated weights for policy 0, policy_version 715810 (0.0009) [2023-12-26 05:18:24,785][123091] Updated weights for policy 0, policy_version 715821 (0.0009) [2023-12-26 05:18:25,480][123090] Updated weights for policy 1, policy_version 711489 (0.0007) [2023-12-26 05:18:25,534][123090] Updated weights for policy 1, policy_version 711499 (0.0009) [2023-12-26 05:18:25,589][123090] Updated weights for policy 1, policy_version 711509 (0.0009) [2023-12-26 05:18:25,608][123091] Updated weights for policy 0, policy_version 715831 (0.0009) [2023-12-26 05:18:25,644][123090] Updated weights for policy 1, policy_version 711519 (0.0008) [2023-12-26 05:18:25,669][123091] Updated weights for policy 0, policy_version 715841 (0.0008) [2023-12-26 05:18:25,722][123091] Updated weights for policy 0, policy_version 715851 (0.0010) [2023-12-26 05:18:26,348][123091] Updated weights for policy 0, policy_version 715861 (0.0009) [2023-12-26 05:18:26,415][123091] Updated weights for policy 0, policy_version 715871 (0.0009) [2023-12-26 05:18:26,480][123091] Updated weights for policy 0, policy_version 715881 (0.0009) [2023-12-26 05:18:26,517][123090] Updated weights for policy 1, policy_version 711529 (0.0007) [2023-12-26 05:18:26,569][123090] Updated weights for policy 1, policy_version 711539 (0.0010) [2023-12-26 05:18:26,627][123090] Updated weights for policy 1, policy_version 711550 (0.0009) [2023-12-26 05:18:27,250][123091] Updated weights for policy 0, policy_version 715891 (0.0008) [2023-12-26 05:18:27,305][123091] Updated weights for policy 0, policy_version 715901 (0.0009) [2023-12-26 05:18:27,351][123091] Updated weights for policy 0, policy_version 715911 (0.0009) [2023-12-26 05:18:27,509][123090] Updated weights for policy 1, policy_version 711560 (0.0009) [2023-12-26 05:18:27,576][123090] Updated weights for policy 1, policy_version 711570 (0.0009) [2023-12-26 05:18:27,627][123090] Updated weights for policy 1, policy_version 711580 (0.0009) [2023-12-26 05:18:28,080][123091] Updated weights for policy 0, policy_version 715921 (0.0006) [2023-12-26 05:18:28,128][123091] Updated weights for policy 0, policy_version 715931 (0.0005) [2023-12-26 05:18:28,184][123091] Updated weights for policy 0, policy_version 715941 (0.0008) [2023-12-26 05:18:28,240][123091] Updated weights for policy 0, policy_version 715951 (0.0009) [2023-12-26 05:18:28,516][123090] Updated weights for policy 1, policy_version 711590 (0.0009) [2023-12-26 05:18:28,581][123090] Updated weights for policy 1, policy_version 711600 (0.0010) [2023-12-26 05:18:28,629][123090] Updated weights for policy 1, policy_version 711610 (0.0009) [2023-12-26 05:18:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 365461504. Throughput: 0: 8765.6, 1: 8656.0. Samples: 365452920. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:28,784][121949] Avg episode reward: [(0, '5994.440'), (1, '5356.269')] [2023-12-26 05:18:29,038][123091] Updated weights for policy 0, policy_version 715961 (0.0007) [2023-12-26 05:18:29,101][123091] Updated weights for policy 0, policy_version 715971 (0.0005) [2023-12-26 05:18:29,168][123091] Updated weights for policy 0, policy_version 715981 (0.0005) [2023-12-26 05:18:29,534][123090] Updated weights for policy 1, policy_version 711620 (0.0009) [2023-12-26 05:18:29,596][123090] Updated weights for policy 1, policy_version 711630 (0.0009) [2023-12-26 05:18:29,656][123090] Updated weights for policy 1, policy_version 711640 (0.0010) [2023-12-26 05:18:29,914][123091] Updated weights for policy 0, policy_version 715991 (0.0006) [2023-12-26 05:18:29,979][123091] Updated weights for policy 0, policy_version 716001 (0.0007) [2023-12-26 05:18:30,031][123091] Updated weights for policy 0, policy_version 716011 (0.0008) [2023-12-26 05:18:30,512][123090] Updated weights for policy 1, policy_version 711650 (0.0009) [2023-12-26 05:18:30,570][123090] Updated weights for policy 1, policy_version 711660 (0.0008) [2023-12-26 05:18:30,627][123090] Updated weights for policy 1, policy_version 711670 (0.0008) [2023-12-26 05:18:30,699][123090] Updated weights for policy 1, policy_version 711680 (0.0009) [2023-12-26 05:18:30,783][123091] Updated weights for policy 0, policy_version 716021 (0.0010) [2023-12-26 05:18:30,837][123091] Updated weights for policy 0, policy_version 716031 (0.0010) [2023-12-26 05:18:30,898][123091] Updated weights for policy 0, policy_version 716041 (0.0010) [2023-12-26 05:18:31,521][123090] Updated weights for policy 1, policy_version 711690 (0.0009) [2023-12-26 05:18:31,574][123090] Updated weights for policy 1, policy_version 711700 (0.0009) [2023-12-26 05:18:31,638][123090] Updated weights for policy 1, policy_version 711710 (0.0009) [2023-12-26 05:18:31,741][123091] Updated weights for policy 0, policy_version 716051 (0.0010) [2023-12-26 05:18:31,804][123091] Updated weights for policy 0, policy_version 716061 (0.0010) [2023-12-26 05:18:31,870][123091] Updated weights for policy 0, policy_version 716071 (0.0010) [2023-12-26 05:18:32,539][123090] Updated weights for policy 1, policy_version 711720 (0.0009) [2023-12-26 05:18:32,601][123090] Updated weights for policy 1, policy_version 711730 (0.0009) [2023-12-26 05:18:32,669][123090] Updated weights for policy 1, policy_version 711740 (0.0009) [2023-12-26 05:18:32,713][123091] Updated weights for policy 0, policy_version 716081 (0.0010) [2023-12-26 05:18:32,764][123091] Updated weights for policy 0, policy_version 716091 (0.0010) [2023-12-26 05:18:32,815][123091] Updated weights for policy 0, policy_version 716101 (0.0010) [2023-12-26 05:18:32,869][123091] Updated weights for policy 0, policy_version 716111 (0.0010) [2023-12-26 05:18:33,499][123090] Updated weights for policy 1, policy_version 711750 (0.0009) [2023-12-26 05:18:33,554][123090] Updated weights for policy 1, policy_version 711760 (0.0009) [2023-12-26 05:18:33,604][123090] Updated weights for policy 1, policy_version 711770 (0.0008) [2023-12-26 05:18:33,619][123091] Updated weights for policy 0, policy_version 716121 (0.0009) [2023-12-26 05:18:33,665][123091] Updated weights for policy 0, policy_version 716131 (0.0007) [2023-12-26 05:18:33,729][123091] Updated weights for policy 0, policy_version 716141 (0.0005) [2023-12-26 05:18:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 365551616. Throughput: 0: 8811.1, 1: 8602.9. Samples: 365556168. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:33,785][121949] Avg episode reward: [(0, '5912.283'), (1, '5087.685')] [2023-12-26 05:18:34,451][123091] Updated weights for policy 0, policy_version 716151 (0.0009) [2023-12-26 05:18:34,483][123090] Updated weights for policy 1, policy_version 711780 (0.0008) [2023-12-26 05:18:34,514][123091] Updated weights for policy 0, policy_version 716161 (0.0009) [2023-12-26 05:18:34,549][123090] Updated weights for policy 1, policy_version 711790 (0.0008) [2023-12-26 05:18:34,587][123091] Updated weights for policy 0, policy_version 716171 (0.0007) [2023-12-26 05:18:34,619][123090] Updated weights for policy 1, policy_version 711800 (0.0008) [2023-12-26 05:18:35,250][123091] Updated weights for policy 0, policy_version 716181 (0.0006) [2023-12-26 05:18:35,301][123091] Updated weights for policy 0, policy_version 716191 (0.0006) [2023-12-26 05:18:35,352][123091] Updated weights for policy 0, policy_version 716201 (0.0010) [2023-12-26 05:18:35,428][123090] Updated weights for policy 1, policy_version 711810 (0.0010) [2023-12-26 05:18:35,486][123090] Updated weights for policy 1, policy_version 711820 (0.0010) [2023-12-26 05:18:35,537][123090] Updated weights for policy 1, policy_version 711830 (0.0010) [2023-12-26 05:18:35,591][123090] Updated weights for policy 1, policy_version 711840 (0.0010) [2023-12-26 05:18:36,169][123091] Updated weights for policy 0, policy_version 716211 (0.0010) [2023-12-26 05:18:36,229][123091] Updated weights for policy 0, policy_version 716221 (0.0010) [2023-12-26 05:18:36,293][123091] Updated weights for policy 0, policy_version 716231 (0.0011) [2023-12-26 05:18:36,446][123090] Updated weights for policy 1, policy_version 711850 (0.0008) [2023-12-26 05:18:36,507][123090] Updated weights for policy 1, policy_version 711860 (0.0010) [2023-12-26 05:18:36,571][123090] Updated weights for policy 1, policy_version 711870 (0.0011) [2023-12-26 05:18:37,103][123091] Updated weights for policy 0, policy_version 716241 (0.0010) [2023-12-26 05:18:37,167][123091] Updated weights for policy 0, policy_version 716251 (0.0010) [2023-12-26 05:18:37,226][123091] Updated weights for policy 0, policy_version 716261 (0.0010) [2023-12-26 05:18:37,277][123091] Updated weights for policy 0, policy_version 716271 (0.0010) [2023-12-26 05:18:37,326][123090] Updated weights for policy 1, policy_version 711880 (0.0010) [2023-12-26 05:18:37,379][123090] Updated weights for policy 1, policy_version 711890 (0.0010) [2023-12-26 05:18:37,439][123090] Updated weights for policy 1, policy_version 711900 (0.0011) [2023-12-26 05:18:38,095][123091] Updated weights for policy 0, policy_version 716281 (0.0006) [2023-12-26 05:18:38,152][123091] Updated weights for policy 0, policy_version 716291 (0.0005) [2023-12-26 05:18:38,208][123090] Updated weights for policy 1, policy_version 711910 (0.0007) [2023-12-26 05:18:38,210][123091] Updated weights for policy 0, policy_version 716301 (0.0005) [2023-12-26 05:18:38,256][123090] Updated weights for policy 1, policy_version 711920 (0.0005) [2023-12-26 05:18:38,305][123090] Updated weights for policy 1, policy_version 711930 (0.0005) [2023-12-26 05:18:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 365633536. Throughput: 0: 8881.6, 1: 8583.7. Samples: 365609492. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:38,785][121949] Avg episode reward: [(0, '5879.714'), (1, '5137.778')] [2023-12-26 05:18:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000716304_183377920.pth... [2023-12-26 05:18:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000711936_182255616.pth... [2023-12-26 05:18:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000715280_183115776.pth [2023-12-26 05:18:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000710944_182001664.pth [2023-12-26 05:18:38,886][123091] Updated weights for policy 0, policy_version 716311 (0.0006) [2023-12-26 05:18:38,961][123091] Updated weights for policy 0, policy_version 716321 (0.0006) [2023-12-26 05:18:39,028][123091] Updated weights for policy 0, policy_version 716331 (0.0007) [2023-12-26 05:18:39,046][123090] Updated weights for policy 1, policy_version 711940 (0.0007) [2023-12-26 05:18:39,116][123090] Updated weights for policy 1, policy_version 711950 (0.0010) [2023-12-26 05:18:39,183][123090] Updated weights for policy 1, policy_version 711960 (0.0008) [2023-12-26 05:18:39,760][123091] Updated weights for policy 0, policy_version 716341 (0.0008) [2023-12-26 05:18:39,810][123091] Updated weights for policy 0, policy_version 716351 (0.0009) [2023-12-26 05:18:39,883][123091] Updated weights for policy 0, policy_version 716361 (0.0009) [2023-12-26 05:18:40,008][123090] Updated weights for policy 1, policy_version 711970 (0.0007) [2023-12-26 05:18:40,077][123090] Updated weights for policy 1, policy_version 711980 (0.0009) [2023-12-26 05:18:40,141][123090] Updated weights for policy 1, policy_version 711990 (0.0009) [2023-12-26 05:18:40,210][123090] Updated weights for policy 1, policy_version 712000 (0.0009) [2023-12-26 05:18:40,734][123091] Updated weights for policy 0, policy_version 716371 (0.0011) [2023-12-26 05:18:40,798][123091] Updated weights for policy 0, policy_version 716381 (0.0010) [2023-12-26 05:18:40,869][123091] Updated weights for policy 0, policy_version 716391 (0.0009) [2023-12-26 05:18:41,031][123090] Updated weights for policy 1, policy_version 712010 (0.0010) [2023-12-26 05:18:41,090][123090] Updated weights for policy 1, policy_version 712020 (0.0010) [2023-12-26 05:18:41,157][123090] Updated weights for policy 1, policy_version 712031 (0.0010) [2023-12-26 05:18:41,726][123091] Updated weights for policy 0, policy_version 716401 (0.0009) [2023-12-26 05:18:41,793][123091] Updated weights for policy 0, policy_version 716411 (0.0010) [2023-12-26 05:18:41,861][123091] Updated weights for policy 0, policy_version 716421 (0.0010) [2023-12-26 05:18:41,929][123091] Updated weights for policy 0, policy_version 716431 (0.0010) [2023-12-26 05:18:42,030][123090] Updated weights for policy 1, policy_version 712041 (0.0010) [2023-12-26 05:18:42,090][123090] Updated weights for policy 1, policy_version 712051 (0.0010) [2023-12-26 05:18:42,159][123090] Updated weights for policy 1, policy_version 712061 (0.0011) [2023-12-26 05:18:42,760][123091] Updated weights for policy 0, policy_version 716441 (0.0011) [2023-12-26 05:18:42,816][123091] Updated weights for policy 0, policy_version 716451 (0.0011) [2023-12-26 05:18:42,865][123091] Updated weights for policy 0, policy_version 716461 (0.0011) [2023-12-26 05:18:42,983][123090] Updated weights for policy 1, policy_version 712071 (0.0007) [2023-12-26 05:18:43,042][123090] Updated weights for policy 1, policy_version 712081 (0.0006) [2023-12-26 05:18:43,106][123090] Updated weights for policy 1, policy_version 712091 (0.0005) [2023-12-26 05:18:43,590][123091] Updated weights for policy 0, policy_version 716471 (0.0007) [2023-12-26 05:18:43,641][123091] Updated weights for policy 0, policy_version 716481 (0.0005) [2023-12-26 05:18:43,704][123091] Updated weights for policy 0, policy_version 716491 (0.0008) [2023-12-26 05:18:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 365723648. Throughput: 0: 8836.5, 1: 8545.2. Samples: 365714404. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:43,785][121949] Avg episode reward: [(0, '5984.992'), (1, '5189.621')] [2023-12-26 05:18:43,792][123090] Updated weights for policy 1, policy_version 712101 (0.0008) [2023-12-26 05:18:43,846][123090] Updated weights for policy 1, policy_version 712111 (0.0009) [2023-12-26 05:18:43,909][123090] Updated weights for policy 1, policy_version 712121 (0.0007) [2023-12-26 05:18:44,509][123091] Updated weights for policy 0, policy_version 716502 (0.0010) [2023-12-26 05:18:44,562][123091] Updated weights for policy 0, policy_version 716512 (0.0009) [2023-12-26 05:18:44,613][123091] Updated weights for policy 0, policy_version 716522 (0.0008) [2023-12-26 05:18:44,730][123090] Updated weights for policy 1, policy_version 712131 (0.0007) [2023-12-26 05:18:44,791][123090] Updated weights for policy 1, policy_version 712141 (0.0011) [2023-12-26 05:18:44,861][123090] Updated weights for policy 1, policy_version 712151 (0.0012) [2023-12-26 05:18:45,424][123091] Updated weights for policy 0, policy_version 716532 (0.0007) [2023-12-26 05:18:45,494][123091] Updated weights for policy 0, policy_version 716542 (0.0005) [2023-12-26 05:18:45,562][123091] Updated weights for policy 0, policy_version 716552 (0.0005) [2023-12-26 05:18:45,716][123090] Updated weights for policy 1, policy_version 712161 (0.0010) [2023-12-26 05:18:45,775][123090] Updated weights for policy 1, policy_version 712171 (0.0010) [2023-12-26 05:18:45,834][123090] Updated weights for policy 1, policy_version 712181 (0.0010) [2023-12-26 05:18:45,886][123090] Updated weights for policy 1, policy_version 712191 (0.0008) [2023-12-26 05:18:46,288][123091] Updated weights for policy 0, policy_version 716562 (0.0008) [2023-12-26 05:18:46,348][123091] Updated weights for policy 0, policy_version 716572 (0.0005) [2023-12-26 05:18:46,410][123091] Updated weights for policy 0, policy_version 716582 (0.0005) [2023-12-26 05:18:46,467][123091] Updated weights for policy 0, policy_version 716592 (0.0005) [2023-12-26 05:18:46,660][123090] Updated weights for policy 1, policy_version 712201 (0.0008) [2023-12-26 05:18:46,711][123090] Updated weights for policy 1, policy_version 712211 (0.0009) [2023-12-26 05:18:46,769][123090] Updated weights for policy 1, policy_version 712221 (0.0008) [2023-12-26 05:18:47,186][123091] Updated weights for policy 0, policy_version 716602 (0.0010) [2023-12-26 05:18:47,240][123091] Updated weights for policy 0, policy_version 716612 (0.0010) [2023-12-26 05:18:47,296][123091] Updated weights for policy 0, policy_version 716622 (0.0009) [2023-12-26 05:18:47,636][123090] Updated weights for policy 1, policy_version 712231 (0.0010) [2023-12-26 05:18:47,695][123090] Updated weights for policy 1, policy_version 712241 (0.0010) [2023-12-26 05:18:47,756][123090] Updated weights for policy 1, policy_version 712251 (0.0009) [2023-12-26 05:18:47,942][123091] Updated weights for policy 0, policy_version 716632 (0.0007) [2023-12-26 05:18:47,997][123091] Updated weights for policy 0, policy_version 716642 (0.0006) [2023-12-26 05:18:48,062][123091] Updated weights for policy 0, policy_version 716652 (0.0009) [2023-12-26 05:18:48,731][123090] Updated weights for policy 1, policy_version 712261 (0.0009) [2023-12-26 05:18:48,755][123091] Updated weights for policy 0, policy_version 716662 (0.0009) [2023-12-26 05:18:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 365805568. Throughput: 0: 8897.0, 1: 8553.1. Samples: 365823864. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:48,785][121949] Avg episode reward: [(0, '6111.403'), (1, '5373.149')] [2023-12-26 05:18:48,796][123090] Updated weights for policy 1, policy_version 712271 (0.0007) [2023-12-26 05:18:48,814][123091] Updated weights for policy 0, policy_version 716672 (0.0011) [2023-12-26 05:18:48,860][123090] Updated weights for policy 1, policy_version 712281 (0.0009) [2023-12-26 05:18:48,877][123091] Updated weights for policy 0, policy_version 716682 (0.0010) [2023-12-26 05:18:49,634][123090] Updated weights for policy 1, policy_version 712291 (0.0010) [2023-12-26 05:18:49,701][123090] Updated weights for policy 1, policy_version 712301 (0.0010) [2023-12-26 05:18:49,725][123091] Updated weights for policy 0, policy_version 716692 (0.0010) [2023-12-26 05:18:49,764][123090] Updated weights for policy 1, policy_version 712311 (0.0010) [2023-12-26 05:18:49,787][123091] Updated weights for policy 0, policy_version 716702 (0.0008) [2023-12-26 05:18:49,858][123091] Updated weights for policy 0, policy_version 716712 (0.0008) [2023-12-26 05:18:50,551][123091] Updated weights for policy 0, policy_version 716722 (0.0008) [2023-12-26 05:18:50,552][123090] Updated weights for policy 1, policy_version 712321 (0.0006) [2023-12-26 05:18:50,614][123091] Updated weights for policy 0, policy_version 716732 (0.0009) [2023-12-26 05:18:50,621][123090] Updated weights for policy 1, policy_version 712331 (0.0008) [2023-12-26 05:18:50,671][123091] Updated weights for policy 0, policy_version 716742 (0.0010) [2023-12-26 05:18:50,674][123090] Updated weights for policy 1, policy_version 712341 (0.0008) [2023-12-26 05:18:50,723][123090] Updated weights for policy 1, policy_version 712351 (0.0008) [2023-12-26 05:18:50,735][123091] Updated weights for policy 0, policy_version 716752 (0.0006) [2023-12-26 05:18:51,453][123091] Updated weights for policy 0, policy_version 716762 (0.0007) [2023-12-26 05:18:51,494][123090] Updated weights for policy 1, policy_version 712361 (0.0010) [2023-12-26 05:18:51,526][123091] Updated weights for policy 0, policy_version 716772 (0.0006) [2023-12-26 05:18:51,546][123090] Updated weights for policy 1, policy_version 712371 (0.0010) [2023-12-26 05:18:51,598][123091] Updated weights for policy 0, policy_version 716782 (0.0006) [2023-12-26 05:18:51,600][123090] Updated weights for policy 1, policy_version 712381 (0.0010) [2023-12-26 05:18:52,316][123091] Updated weights for policy 0, policy_version 716792 (0.0008) [2023-12-26 05:18:52,387][123091] Updated weights for policy 0, policy_version 716802 (0.0007) [2023-12-26 05:18:52,449][123091] Updated weights for policy 0, policy_version 716812 (0.0008) [2023-12-26 05:18:52,481][123090] Updated weights for policy 1, policy_version 712391 (0.0008) [2023-12-26 05:18:52,541][123090] Updated weights for policy 1, policy_version 712401 (0.0008) [2023-12-26 05:18:52,596][123090] Updated weights for policy 1, policy_version 712411 (0.0008) [2023-12-26 05:18:53,185][123091] Updated weights for policy 0, policy_version 716822 (0.0008) [2023-12-26 05:18:53,248][123091] Updated weights for policy 0, policy_version 716833 (0.0007) [2023-12-26 05:18:53,312][123091] Updated weights for policy 0, policy_version 716843 (0.0006) [2023-12-26 05:18:53,319][123090] Updated weights for policy 1, policy_version 712421 (0.0008) [2023-12-26 05:18:53,386][123090] Updated weights for policy 1, policy_version 712431 (0.0005) [2023-12-26 05:18:53,451][123090] Updated weights for policy 1, policy_version 712441 (0.0010) [2023-12-26 05:18:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 365903872. Throughput: 0: 8957.2, 1: 8561.6. Samples: 365878096. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:53,785][121949] Avg episode reward: [(0, '6065.696'), (1, '5765.472')] [2023-12-26 05:18:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000716848_183517184.pth... [2023-12-26 05:18:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000712448_182386688.pth... [2023-12-26 05:18:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000715792_183246848.pth [2023-12-26 05:18:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000711456_182132736.pth [2023-12-26 05:18:54,012][123091] Updated weights for policy 0, policy_version 716853 (0.0007) [2023-12-26 05:18:54,075][123091] Updated weights for policy 0, policy_version 716863 (0.0008) [2023-12-26 05:18:54,141][123091] Updated weights for policy 0, policy_version 716873 (0.0008) [2023-12-26 05:18:54,170][123090] Updated weights for policy 1, policy_version 712451 (0.0009) [2023-12-26 05:18:54,240][123090] Updated weights for policy 1, policy_version 712461 (0.0007) [2023-12-26 05:18:54,313][123090] Updated weights for policy 1, policy_version 712471 (0.0006) [2023-12-26 05:18:54,905][123091] Updated weights for policy 0, policy_version 716883 (0.0007) [2023-12-26 05:18:54,973][123091] Updated weights for policy 0, policy_version 716893 (0.0006) [2023-12-26 05:18:55,041][123091] Updated weights for policy 0, policy_version 716903 (0.0006) [2023-12-26 05:18:55,117][123090] Updated weights for policy 1, policy_version 712481 (0.0010) [2023-12-26 05:18:55,177][123090] Updated weights for policy 1, policy_version 712491 (0.0009) [2023-12-26 05:18:55,239][123090] Updated weights for policy 1, policy_version 712501 (0.0006) [2023-12-26 05:18:55,293][123090] Updated weights for policy 1, policy_version 712511 (0.0006) [2023-12-26 05:18:55,757][123091] Updated weights for policy 0, policy_version 716913 (0.0006) [2023-12-26 05:18:55,813][123091] Updated weights for policy 0, policy_version 716923 (0.0005) [2023-12-26 05:18:55,862][123091] Updated weights for policy 0, policy_version 716933 (0.0005) [2023-12-26 05:18:55,909][123091] Updated weights for policy 0, policy_version 716943 (0.0005) [2023-12-26 05:18:55,960][123090] Updated weights for policy 1, policy_version 712521 (0.0005) [2023-12-26 05:18:56,010][123090] Updated weights for policy 1, policy_version 712531 (0.0010) [2023-12-26 05:18:56,065][123090] Updated weights for policy 1, policy_version 712541 (0.0010) [2023-12-26 05:18:56,610][123091] Updated weights for policy 0, policy_version 716953 (0.0010) [2023-12-26 05:18:56,656][123091] Updated weights for policy 0, policy_version 716963 (0.0010) [2023-12-26 05:18:56,707][123091] Updated weights for policy 0, policy_version 716973 (0.0010) [2023-12-26 05:18:56,858][123090] Updated weights for policy 1, policy_version 712551 (0.0007) [2023-12-26 05:18:56,914][123090] Updated weights for policy 1, policy_version 712561 (0.0006) [2023-12-26 05:18:56,968][123090] Updated weights for policy 1, policy_version 712571 (0.0005) [2023-12-26 05:18:57,386][123091] Updated weights for policy 0, policy_version 716983 (0.0007) [2023-12-26 05:18:57,440][123091] Updated weights for policy 0, policy_version 716993 (0.0005) [2023-12-26 05:18:57,501][123091] Updated weights for policy 0, policy_version 717003 (0.0005) [2023-12-26 05:18:57,625][123090] Updated weights for policy 1, policy_version 712581 (0.0008) [2023-12-26 05:18:57,676][123090] Updated weights for policy 1, policy_version 712591 (0.0010) [2023-12-26 05:18:57,734][123090] Updated weights for policy 1, policy_version 712601 (0.0010) [2023-12-26 05:18:58,147][123091] Updated weights for policy 0, policy_version 717013 (0.0008) [2023-12-26 05:18:58,212][123091] Updated weights for policy 0, policy_version 717023 (0.0010) [2023-12-26 05:18:58,275][123091] Updated weights for policy 0, policy_version 717033 (0.0008) [2023-12-26 05:18:58,631][123090] Updated weights for policy 1, policy_version 712611 (0.0009) [2023-12-26 05:18:58,701][123090] Updated weights for policy 1, policy_version 712621 (0.0007) [2023-12-26 05:18:58,776][123090] Updated weights for policy 1, policy_version 712631 (0.0009) [2023-12-26 05:18:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 365993984. Throughput: 0: 9076.8, 1: 8688.3. Samples: 365992236. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:18:58,785][121949] Avg episode reward: [(0, '6012.219'), (1, '5609.985')] [2023-12-26 05:18:59,171][123091] Updated weights for policy 0, policy_version 717044 (0.0009) [2023-12-26 05:18:59,236][123091] Updated weights for policy 0, policy_version 717054 (0.0008) [2023-12-26 05:18:59,299][123091] Updated weights for policy 0, policy_version 717064 (0.0007) [2023-12-26 05:18:59,647][123090] Updated weights for policy 1, policy_version 712641 (0.0010) [2023-12-26 05:18:59,699][123090] Updated weights for policy 1, policy_version 712651 (0.0009) [2023-12-26 05:18:59,751][123090] Updated weights for policy 1, policy_version 712661 (0.0010) [2023-12-26 05:18:59,804][123090] Updated weights for policy 1, policy_version 712671 (0.0009) [2023-12-26 05:19:00,054][123091] Updated weights for policy 0, policy_version 717074 (0.0006) [2023-12-26 05:19:00,126][123091] Updated weights for policy 0, policy_version 717084 (0.0008) [2023-12-26 05:19:00,193][123091] Updated weights for policy 0, policy_version 717094 (0.0008) [2023-12-26 05:19:00,259][123091] Updated weights for policy 0, policy_version 717104 (0.0005) [2023-12-26 05:19:00,689][123090] Updated weights for policy 1, policy_version 712681 (0.0009) [2023-12-26 05:19:00,755][123090] Updated weights for policy 1, policy_version 712691 (0.0005) [2023-12-26 05:19:00,814][123090] Updated weights for policy 1, policy_version 712701 (0.0005) [2023-12-26 05:19:01,068][123091] Updated weights for policy 0, policy_version 717114 (0.0006) [2023-12-26 05:19:01,131][123091] Updated weights for policy 0, policy_version 717124 (0.0007) [2023-12-26 05:19:01,191][123091] Updated weights for policy 0, policy_version 717134 (0.0006) [2023-12-26 05:19:01,557][123090] Updated weights for policy 1, policy_version 712711 (0.0006) [2023-12-26 05:19:01,631][123090] Updated weights for policy 1, policy_version 712721 (0.0008) [2023-12-26 05:19:01,704][123090] Updated weights for policy 1, policy_version 712731 (0.0006) [2023-12-26 05:19:01,918][123091] Updated weights for policy 0, policy_version 717144 (0.0005) [2023-12-26 05:19:01,986][123091] Updated weights for policy 0, policy_version 717154 (0.0005) [2023-12-26 05:19:02,056][123091] Updated weights for policy 0, policy_version 717164 (0.0005) [2023-12-26 05:19:02,403][123090] Updated weights for policy 1, policy_version 712741 (0.0011) [2023-12-26 05:19:02,471][123090] Updated weights for policy 1, policy_version 712751 (0.0006) [2023-12-26 05:19:02,534][123090] Updated weights for policy 1, policy_version 712761 (0.0005) [2023-12-26 05:19:02,743][123091] Updated weights for policy 0, policy_version 717174 (0.0005) [2023-12-26 05:19:02,813][123091] Updated weights for policy 0, policy_version 717184 (0.0005) [2023-12-26 05:19:02,880][123091] Updated weights for policy 0, policy_version 717194 (0.0007) [2023-12-26 05:19:03,168][123090] Updated weights for policy 1, policy_version 712771 (0.0005) [2023-12-26 05:19:03,225][123090] Updated weights for policy 1, policy_version 712781 (0.0005) [2023-12-26 05:19:03,280][123090] Updated weights for policy 1, policy_version 712791 (0.0005) [2023-12-26 05:19:03,709][123091] Updated weights for policy 0, policy_version 717206 (0.0010) [2023-12-26 05:19:03,764][123091] Updated weights for policy 0, policy_version 717216 (0.0010) [2023-12-26 05:19:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 366084096. Throughput: 0: 9108.5, 1: 8655.1. Samples: 366100028. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:03,784][121949] Avg episode reward: [(0, '6055.601'), (1, '5441.564')] [2023-12-26 05:19:03,819][123091] Updated weights for policy 0, policy_version 717227 (0.0010) [2023-12-26 05:19:03,945][123090] Updated weights for policy 1, policy_version 712801 (0.0006) [2023-12-26 05:19:04,004][123090] Updated weights for policy 1, policy_version 712811 (0.0005) [2023-12-26 05:19:04,062][123090] Updated weights for policy 1, policy_version 712821 (0.0006) [2023-12-26 05:19:04,122][123090] Updated weights for policy 1, policy_version 712831 (0.0006) [2023-12-26 05:19:04,785][123091] Updated weights for policy 0, policy_version 717237 (0.0009) [2023-12-26 05:19:04,838][123090] Updated weights for policy 1, policy_version 712841 (0.0006) [2023-12-26 05:19:04,839][123091] Updated weights for policy 0, policy_version 717247 (0.0009) [2023-12-26 05:19:04,896][123091] Updated weights for policy 0, policy_version 717257 (0.0009) [2023-12-26 05:19:04,905][123090] Updated weights for policy 1, policy_version 712851 (0.0007) [2023-12-26 05:19:04,960][123090] Updated weights for policy 1, policy_version 712861 (0.0006) [2023-12-26 05:19:05,663][123090] Updated weights for policy 1, policy_version 712871 (0.0005) [2023-12-26 05:19:05,725][123090] Updated weights for policy 1, policy_version 712881 (0.0005) [2023-12-26 05:19:05,761][123091] Updated weights for policy 0, policy_version 717267 (0.0011) [2023-12-26 05:19:05,794][123090] Updated weights for policy 1, policy_version 712891 (0.0007) [2023-12-26 05:19:05,817][123091] Updated weights for policy 0, policy_version 717277 (0.0011) [2023-12-26 05:19:05,888][123091] Updated weights for policy 0, policy_version 717287 (0.0010) [2023-12-26 05:19:06,596][123090] Updated weights for policy 1, policy_version 712901 (0.0011) [2023-12-26 05:19:06,660][123090] Updated weights for policy 1, policy_version 712911 (0.0011) [2023-12-26 05:19:06,716][123091] Updated weights for policy 0, policy_version 717297 (0.0009) [2023-12-26 05:19:06,724][123090] Updated weights for policy 1, policy_version 712921 (0.0010) [2023-12-26 05:19:06,783][123091] Updated weights for policy 0, policy_version 717307 (0.0009) [2023-12-26 05:19:06,841][123091] Updated weights for policy 0, policy_version 717317 (0.0009) [2023-12-26 05:19:06,904][123091] Updated weights for policy 0, policy_version 717327 (0.0009) [2023-12-26 05:19:07,554][123090] Updated weights for policy 1, policy_version 712931 (0.0011) [2023-12-26 05:19:07,614][123090] Updated weights for policy 1, policy_version 712941 (0.0010) [2023-12-26 05:19:07,669][123090] Updated weights for policy 1, policy_version 712951 (0.0010) [2023-12-26 05:19:07,741][123091] Updated weights for policy 0, policy_version 717337 (0.0008) [2023-12-26 05:19:07,803][123091] Updated weights for policy 0, policy_version 717347 (0.0009) [2023-12-26 05:19:07,861][123091] Updated weights for policy 0, policy_version 717357 (0.0009) [2023-12-26 05:19:08,504][123090] Updated weights for policy 1, policy_version 712961 (0.0010) [2023-12-26 05:19:08,574][123090] Updated weights for policy 1, policy_version 712971 (0.0008) [2023-12-26 05:19:08,613][123091] Updated weights for policy 0, policy_version 717367 (0.0007) [2023-12-26 05:19:08,629][123090] Updated weights for policy 1, policy_version 712981 (0.0008) [2023-12-26 05:19:08,669][123091] Updated weights for policy 0, policy_version 717377 (0.0011) [2023-12-26 05:19:08,680][123090] Updated weights for policy 1, policy_version 712991 (0.0008) [2023-12-26 05:19:08,724][123091] Updated weights for policy 0, policy_version 717387 (0.0011) [2023-12-26 05:19:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 366182400. Throughput: 0: 9097.3, 1: 8748.2. Samples: 366153104. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:08,785][121949] Avg episode reward: [(0, '6113.440'), (1, '5452.462')] [2023-12-26 05:19:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000717392_183656448.pth... [2023-12-26 05:19:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000712992_182525952.pth... [2023-12-26 05:19:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000716304_183377920.pth [2023-12-26 05:19:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000711936_182255616.pth [2023-12-26 05:19:09,509][123091] Updated weights for policy 0, policy_version 717397 (0.0009) [2023-12-26 05:19:09,534][123090] Updated weights for policy 1, policy_version 713001 (0.0008) [2023-12-26 05:19:09,568][123091] Updated weights for policy 0, policy_version 717407 (0.0008) [2023-12-26 05:19:09,595][123090] Updated weights for policy 1, policy_version 713011 (0.0007) [2023-12-26 05:19:09,629][123091] Updated weights for policy 0, policy_version 717417 (0.0008) [2023-12-26 05:19:09,652][123090] Updated weights for policy 1, policy_version 713021 (0.0009) [2023-12-26 05:19:10,381][123091] Updated weights for policy 0, policy_version 717427 (0.0009) [2023-12-26 05:19:10,445][123091] Updated weights for policy 0, policy_version 717437 (0.0011) [2023-12-26 05:19:10,509][123091] Updated weights for policy 0, policy_version 717447 (0.0011) [2023-12-26 05:19:10,521][123090] Updated weights for policy 1, policy_version 713031 (0.0008) [2023-12-26 05:19:10,586][123090] Updated weights for policy 1, policy_version 713041 (0.0011) [2023-12-26 05:19:10,650][123090] Updated weights for policy 1, policy_version 713051 (0.0011) [2023-12-26 05:19:11,419][123091] Updated weights for policy 0, policy_version 717457 (0.0011) [2023-12-26 05:19:11,465][123090] Updated weights for policy 1, policy_version 713061 (0.0009) [2023-12-26 05:19:11,481][123091] Updated weights for policy 0, policy_version 717467 (0.0010) [2023-12-26 05:19:11,527][123090] Updated weights for policy 1, policy_version 713071 (0.0010) [2023-12-26 05:19:11,540][123091] Updated weights for policy 0, policy_version 717477 (0.0007) [2023-12-26 05:19:11,590][123090] Updated weights for policy 1, policy_version 713081 (0.0008) [2023-12-26 05:19:11,594][123091] Updated weights for policy 0, policy_version 717487 (0.0008) [2023-12-26 05:19:12,422][123091] Updated weights for policy 0, policy_version 717497 (0.0008) [2023-12-26 05:19:12,460][123090] Updated weights for policy 1, policy_version 713091 (0.0009) [2023-12-26 05:19:12,474][123091] Updated weights for policy 0, policy_version 717507 (0.0008) [2023-12-26 05:19:12,529][123090] Updated weights for policy 1, policy_version 713101 (0.0007) [2023-12-26 05:19:12,537][123091] Updated weights for policy 0, policy_version 717517 (0.0008) [2023-12-26 05:19:12,598][123090] Updated weights for policy 1, policy_version 713111 (0.0005) [2023-12-26 05:19:13,239][123091] Updated weights for policy 0, policy_version 717527 (0.0007) [2023-12-26 05:19:13,281][123090] Updated weights for policy 1, policy_version 713121 (0.0006) [2023-12-26 05:19:13,299][123091] Updated weights for policy 0, policy_version 717537 (0.0007) [2023-12-26 05:19:13,339][123090] Updated weights for policy 1, policy_version 713131 (0.0006) [2023-12-26 05:19:13,365][123091] Updated weights for policy 0, policy_version 717547 (0.0007) [2023-12-26 05:19:13,403][123090] Updated weights for policy 1, policy_version 713141 (0.0007) [2023-12-26 05:19:13,468][123090] Updated weights for policy 1, policy_version 713151 (0.0009) [2023-12-26 05:19:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 366264320. Throughput: 0: 9067.3, 1: 8750.5. Samples: 366254724. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:13,785][121949] Avg episode reward: [(0, '6094.310'), (1, '5493.835')] [2023-12-26 05:19:14,097][123091] Updated weights for policy 0, policy_version 717557 (0.0010) [2023-12-26 05:19:14,155][123091] Updated weights for policy 0, policy_version 717567 (0.0011) [2023-12-26 05:19:14,211][123091] Updated weights for policy 0, policy_version 717577 (0.0011) [2023-12-26 05:19:14,329][123090] Updated weights for policy 1, policy_version 713161 (0.0009) [2023-12-26 05:19:14,380][123090] Updated weights for policy 1, policy_version 713171 (0.0008) [2023-12-26 05:19:14,446][123090] Updated weights for policy 1, policy_version 713181 (0.0007) [2023-12-26 05:19:14,968][123091] Updated weights for policy 0, policy_version 717587 (0.0009) [2023-12-26 05:19:15,037][123091] Updated weights for policy 0, policy_version 717597 (0.0006) [2023-12-26 05:19:15,097][123091] Updated weights for policy 0, policy_version 717607 (0.0006) [2023-12-26 05:19:15,247][123090] Updated weights for policy 1, policy_version 713191 (0.0009) [2023-12-26 05:19:15,319][123090] Updated weights for policy 1, policy_version 713201 (0.0011) [2023-12-26 05:19:15,390][123090] Updated weights for policy 1, policy_version 713211 (0.0011) [2023-12-26 05:19:15,865][123091] Updated weights for policy 0, policy_version 717617 (0.0007) [2023-12-26 05:19:15,913][123091] Updated weights for policy 0, policy_version 717627 (0.0009) [2023-12-26 05:19:15,961][123091] Updated weights for policy 0, policy_version 717637 (0.0009) [2023-12-26 05:19:16,017][123091] Updated weights for policy 0, policy_version 717647 (0.0009) [2023-12-26 05:19:16,198][123090] Updated weights for policy 1, policy_version 713221 (0.0010) [2023-12-26 05:19:16,266][123090] Updated weights for policy 1, policy_version 713231 (0.0008) [2023-12-26 05:19:16,330][123090] Updated weights for policy 1, policy_version 713241 (0.0008) [2023-12-26 05:19:16,875][123091] Updated weights for policy 0, policy_version 717657 (0.0008) [2023-12-26 05:19:16,923][123091] Updated weights for policy 0, policy_version 717667 (0.0009) [2023-12-26 05:19:16,972][123091] Updated weights for policy 0, policy_version 717677 (0.0009) [2023-12-26 05:19:17,085][123090] Updated weights for policy 1, policy_version 713251 (0.0008) [2023-12-26 05:19:17,134][123090] Updated weights for policy 1, policy_version 713261 (0.0010) [2023-12-26 05:19:17,185][123090] Updated weights for policy 1, policy_version 713271 (0.0010) [2023-12-26 05:19:17,815][123091] Updated weights for policy 0, policy_version 717687 (0.0010) [2023-12-26 05:19:17,872][123091] Updated weights for policy 0, policy_version 717697 (0.0009) [2023-12-26 05:19:17,925][123091] Updated weights for policy 0, policy_version 717707 (0.0010) [2023-12-26 05:19:17,935][123090] Updated weights for policy 1, policy_version 713281 (0.0010) [2023-12-26 05:19:17,987][123090] Updated weights for policy 1, policy_version 713291 (0.0005) [2023-12-26 05:19:18,055][123090] Updated weights for policy 1, policy_version 713301 (0.0010) [2023-12-26 05:19:18,122][123090] Updated weights for policy 1, policy_version 713311 (0.0010) [2023-12-26 05:19:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 366346240. Throughput: 0: 9064.4, 1: 8868.1. Samples: 366363128. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:18,784][121949] Avg episode reward: [(0, '6145.478'), (1, '5333.135')] [2023-12-26 05:19:18,819][123091] Updated weights for policy 0, policy_version 717717 (0.0009) [2023-12-26 05:19:18,882][123091] Updated weights for policy 0, policy_version 717727 (0.0009) [2023-12-26 05:19:18,887][123090] Updated weights for policy 1, policy_version 713321 (0.0006) [2023-12-26 05:19:18,931][123091] Updated weights for policy 0, policy_version 717737 (0.0009) [2023-12-26 05:19:18,953][123090] Updated weights for policy 1, policy_version 713331 (0.0007) [2023-12-26 05:19:19,021][123090] Updated weights for policy 1, policy_version 713341 (0.0009) [2023-12-26 05:19:19,811][123091] Updated weights for policy 0, policy_version 717747 (0.0008) [2023-12-26 05:19:19,821][123090] Updated weights for policy 1, policy_version 713351 (0.0010) [2023-12-26 05:19:19,878][123091] Updated weights for policy 0, policy_version 717757 (0.0008) [2023-12-26 05:19:19,884][123090] Updated weights for policy 1, policy_version 713361 (0.0011) [2023-12-26 05:19:19,948][123091] Updated weights for policy 0, policy_version 717767 (0.0007) [2023-12-26 05:19:19,953][123090] Updated weights for policy 1, policy_version 713371 (0.0011) [2023-12-26 05:19:20,764][123090] Updated weights for policy 1, policy_version 713381 (0.0008) [2023-12-26 05:19:20,816][123091] Updated weights for policy 0, policy_version 717777 (0.0008) [2023-12-26 05:19:20,831][123090] Updated weights for policy 1, policy_version 713391 (0.0006) [2023-12-26 05:19:20,885][123091] Updated weights for policy 0, policy_version 717787 (0.0009) [2023-12-26 05:19:20,898][123090] Updated weights for policy 1, policy_version 713401 (0.0007) [2023-12-26 05:19:20,947][123091] Updated weights for policy 0, policy_version 717797 (0.0008) [2023-12-26 05:19:21,000][123091] Updated weights for policy 0, policy_version 717807 (0.0010) [2023-12-26 05:19:21,746][123090] Updated weights for policy 1, policy_version 713411 (0.0009) [2023-12-26 05:19:21,812][123090] Updated weights for policy 1, policy_version 713421 (0.0010) [2023-12-26 05:19:21,879][123090] Updated weights for policy 1, policy_version 713431 (0.0009) [2023-12-26 05:19:21,939][123091] Updated weights for policy 0, policy_version 717817 (0.0008) [2023-12-26 05:19:22,006][123091] Updated weights for policy 0, policy_version 717827 (0.0008) [2023-12-26 05:19:22,079][123091] Updated weights for policy 0, policy_version 717837 (0.0009) [2023-12-26 05:19:22,724][123090] Updated weights for policy 1, policy_version 713441 (0.0009) [2023-12-26 05:19:22,789][123090] Updated weights for policy 1, policy_version 713451 (0.0009) [2023-12-26 05:19:22,846][123090] Updated weights for policy 1, policy_version 713461 (0.0009) [2023-12-26 05:19:22,898][123091] Updated weights for policy 0, policy_version 717847 (0.0009) [2023-12-26 05:19:22,901][123090] Updated weights for policy 1, policy_version 713471 (0.0009) [2023-12-26 05:19:22,951][123091] Updated weights for policy 0, policy_version 717857 (0.0009) [2023-12-26 05:19:23,008][123091] Updated weights for policy 0, policy_version 717867 (0.0010) [2023-12-26 05:19:23,728][123090] Updated weights for policy 1, policy_version 713481 (0.0008) [2023-12-26 05:19:23,778][123090] Updated weights for policy 1, policy_version 713491 (0.0009) [2023-12-26 05:19:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 366428160. Throughput: 0: 8979.4, 1: 8874.8. Samples: 366412932. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:23,785][121949] Avg episode reward: [(0, '6133.277'), (1, '5285.085')] [2023-12-26 05:19:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000717872_183779328.pth... [2023-12-26 05:19:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000716848_183517184.pth [2023-12-26 05:19:23,834][123090] Updated weights for policy 1, policy_version 713501 (0.0009) [2023-12-26 05:19:23,845][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000713504_182657024.pth... [2023-12-26 05:19:23,850][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000712448_182386688.pth [2023-12-26 05:19:23,862][123091] Updated weights for policy 0, policy_version 717877 (0.0009) [2023-12-26 05:19:23,927][123091] Updated weights for policy 0, policy_version 717887 (0.0008) [2023-12-26 05:19:23,978][123091] Updated weights for policy 0, policy_version 717897 (0.0007) [2023-12-26 05:19:24,640][123090] Updated weights for policy 1, policy_version 713511 (0.0010) [2023-12-26 05:19:24,707][123090] Updated weights for policy 1, policy_version 713521 (0.0010) [2023-12-26 05:19:24,760][123090] Updated weights for policy 1, policy_version 713531 (0.0010) [2023-12-26 05:19:24,763][123091] Updated weights for policy 0, policy_version 717907 (0.0006) [2023-12-26 05:19:24,814][123091] Updated weights for policy 0, policy_version 717917 (0.0008) [2023-12-26 05:19:24,867][123091] Updated weights for policy 0, policy_version 717927 (0.0010) [2023-12-26 05:19:25,420][123090] Updated weights for policy 1, policy_version 713541 (0.0008) [2023-12-26 05:19:25,482][123090] Updated weights for policy 1, policy_version 713551 (0.0006) [2023-12-26 05:19:25,550][123090] Updated weights for policy 1, policy_version 713561 (0.0005) [2023-12-26 05:19:25,817][123091] Updated weights for policy 0, policy_version 717938 (0.0011) [2023-12-26 05:19:25,879][123091] Updated weights for policy 0, policy_version 717948 (0.0010) [2023-12-26 05:19:25,931][123091] Updated weights for policy 0, policy_version 717958 (0.0009) [2023-12-26 05:19:26,164][123090] Updated weights for policy 1, policy_version 713571 (0.0007) [2023-12-26 05:19:26,223][123090] Updated weights for policy 1, policy_version 713581 (0.0010) [2023-12-26 05:19:26,278][123090] Updated weights for policy 1, policy_version 713591 (0.0010) [2023-12-26 05:19:26,824][123091] Updated weights for policy 0, policy_version 717969 (0.0010) [2023-12-26 05:19:26,875][123091] Updated weights for policy 0, policy_version 717979 (0.0005) [2023-12-26 05:19:26,929][123091] Updated weights for policy 0, policy_version 717989 (0.0005) [2023-12-26 05:19:26,974][123091] Updated weights for policy 0, policy_version 717999 (0.0005) [2023-12-26 05:19:27,007][123090] Updated weights for policy 1, policy_version 713601 (0.0010) [2023-12-26 05:19:27,072][123090] Updated weights for policy 1, policy_version 713611 (0.0007) [2023-12-26 05:19:27,139][123090] Updated weights for policy 1, policy_version 713621 (0.0010) [2023-12-26 05:19:27,202][123090] Updated weights for policy 1, policy_version 713631 (0.0010) [2023-12-26 05:19:27,593][123091] Updated weights for policy 0, policy_version 718009 (0.0005) [2023-12-26 05:19:27,655][123091] Updated weights for policy 0, policy_version 718019 (0.0005) [2023-12-26 05:19:27,707][123091] Updated weights for policy 0, policy_version 718029 (0.0005) [2023-12-26 05:19:27,964][123090] Updated weights for policy 1, policy_version 713641 (0.0007) [2023-12-26 05:19:28,022][123090] Updated weights for policy 1, policy_version 713651 (0.0005) [2023-12-26 05:19:28,074][123090] Updated weights for policy 1, policy_version 713661 (0.0005) [2023-12-26 05:19:28,418][123091] Updated weights for policy 0, policy_version 718039 (0.0008) [2023-12-26 05:19:28,486][123091] Updated weights for policy 0, policy_version 718049 (0.0009) [2023-12-26 05:19:28,552][123091] Updated weights for policy 0, policy_version 718059 (0.0008) [2023-12-26 05:19:28,776][123090] Updated weights for policy 1, policy_version 713671 (0.0008) [2023-12-26 05:19:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17578.1). Total num frames: 366526464. Throughput: 0: 8961.2, 1: 8939.6. Samples: 366519944. Policy #0 lag: (min: 14.0, avg: 14.0, max: 14.0) [2023-12-26 05:19:28,785][121949] Avg episode reward: [(0, '6063.571'), (1, '5544.866')] [2023-12-26 05:19:28,841][123090] Updated weights for policy 1, policy_version 713681 (0.0009) [2023-12-26 05:19:28,908][123090] Updated weights for policy 1, policy_version 713691 (0.0009) [2023-12-26 05:19:29,409][123091] Updated weights for policy 0, policy_version 718069 (0.0010) [2023-12-26 05:19:29,476][123091] Updated weights for policy 0, policy_version 718079 (0.0010) [2023-12-26 05:19:29,545][123091] Updated weights for policy 0, policy_version 718089 (0.0009) [2023-12-26 05:19:29,563][123090] Updated weights for policy 1, policy_version 713701 (0.0008) [2023-12-26 05:19:29,629][123090] Updated weights for policy 1, policy_version 713711 (0.0006) [2023-12-26 05:19:29,696][123090] Updated weights for policy 1, policy_version 713721 (0.0007) [2023-12-26 05:19:30,406][123091] Updated weights for policy 0, policy_version 718099 (0.0009) [2023-12-26 05:19:30,437][123090] Updated weights for policy 1, policy_version 713731 (0.0007) [2023-12-26 05:19:30,456][123091] Updated weights for policy 0, policy_version 718109 (0.0009) [2023-12-26 05:19:30,490][123090] Updated weights for policy 1, policy_version 713741 (0.0005) [2023-12-26 05:19:30,508][123091] Updated weights for policy 0, policy_version 718119 (0.0008) [2023-12-26 05:19:30,540][123090] Updated weights for policy 1, policy_version 713751 (0.0005) [2023-12-26 05:19:31,257][123090] Updated weights for policy 1, policy_version 713761 (0.0006) [2023-12-26 05:19:31,326][123090] Updated weights for policy 1, policy_version 713771 (0.0008) [2023-12-26 05:19:31,330][123091] Updated weights for policy 0, policy_version 718129 (0.0008) [2023-12-26 05:19:31,396][123091] Updated weights for policy 0, policy_version 718139 (0.0009) [2023-12-26 05:19:31,400][123090] Updated weights for policy 1, policy_version 713781 (0.0010) [2023-12-26 05:19:31,450][123091] Updated weights for policy 0, policy_version 718149 (0.0008) [2023-12-26 05:19:31,452][123090] Updated weights for policy 1, policy_version 713791 (0.0011) [2023-12-26 05:19:31,512][123091] Updated weights for policy 0, policy_version 718159 (0.0005) [2023-12-26 05:19:32,174][123090] Updated weights for policy 1, policy_version 713801 (0.0006) [2023-12-26 05:19:32,226][123090] Updated weights for policy 1, policy_version 713811 (0.0005) [2023-12-26 05:19:32,284][123090] Updated weights for policy 1, policy_version 713821 (0.0006) [2023-12-26 05:19:32,369][123091] Updated weights for policy 0, policy_version 718169 (0.0010) [2023-12-26 05:19:32,428][123091] Updated weights for policy 0, policy_version 718179 (0.0009) [2023-12-26 05:19:32,479][123091] Updated weights for policy 0, policy_version 718189 (0.0009) [2023-12-26 05:19:33,095][123090] Updated weights for policy 1, policy_version 713831 (0.0009) [2023-12-26 05:19:33,142][123090] Updated weights for policy 1, policy_version 713841 (0.0010) [2023-12-26 05:19:33,193][123090] Updated weights for policy 1, policy_version 713851 (0.0010) [2023-12-26 05:19:33,331][123091] Updated weights for policy 0, policy_version 718199 (0.0006) [2023-12-26 05:19:33,397][123091] Updated weights for policy 0, policy_version 718209 (0.0009) [2023-12-26 05:19:33,451][123091] Updated weights for policy 0, policy_version 718221 (0.0011) [2023-12-26 05:19:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 366616576. Throughput: 0: 8829.4, 1: 9050.5. Samples: 366628460. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:33,785][121949] Avg episode reward: [(0, '5974.427'), (1, '5637.736')] [2023-12-26 05:19:33,933][123090] Updated weights for policy 1, policy_version 713861 (0.0008) [2023-12-26 05:19:33,981][123090] Updated weights for policy 1, policy_version 713871 (0.0005) [2023-12-26 05:19:34,037][123090] Updated weights for policy 1, policy_version 713881 (0.0005) [2023-12-26 05:19:34,142][123091] Updated weights for policy 0, policy_version 718231 (0.0007) [2023-12-26 05:19:34,211][123091] Updated weights for policy 0, policy_version 718241 (0.0008) [2023-12-26 05:19:34,272][123091] Updated weights for policy 0, policy_version 718251 (0.0008) [2023-12-26 05:19:34,780][123090] Updated weights for policy 1, policy_version 713891 (0.0007) [2023-12-26 05:19:34,847][123090] Updated weights for policy 1, policy_version 713901 (0.0011) [2023-12-26 05:19:34,912][123090] Updated weights for policy 1, policy_version 713911 (0.0011) [2023-12-26 05:19:34,978][123091] Updated weights for policy 0, policy_version 718261 (0.0007) [2023-12-26 05:19:35,042][123091] Updated weights for policy 0, policy_version 718271 (0.0005) [2023-12-26 05:19:35,109][123091] Updated weights for policy 0, policy_version 718281 (0.0005) [2023-12-26 05:19:35,662][123091] Updated weights for policy 0, policy_version 718291 (0.0007) [2023-12-26 05:19:35,728][123091] Updated weights for policy 0, policy_version 718301 (0.0010) [2023-12-26 05:19:35,745][123090] Updated weights for policy 1, policy_version 713921 (0.0011) [2023-12-26 05:19:35,784][123091] Updated weights for policy 0, policy_version 718311 (0.0010) [2023-12-26 05:19:35,800][123090] Updated weights for policy 1, policy_version 713931 (0.0010) [2023-12-26 05:19:35,852][123090] Updated weights for policy 1, policy_version 713941 (0.0010) [2023-12-26 05:19:35,904][123090] Updated weights for policy 1, policy_version 713951 (0.0010) [2023-12-26 05:19:36,606][123091] Updated weights for policy 0, policy_version 718321 (0.0010) [2023-12-26 05:19:36,671][123091] Updated weights for policy 0, policy_version 718331 (0.0009) [2023-12-26 05:19:36,732][123091] Updated weights for policy 0, policy_version 718341 (0.0009) [2023-12-26 05:19:36,774][123090] Updated weights for policy 1, policy_version 713961 (0.0011) [2023-12-26 05:19:36,793][123091] Updated weights for policy 0, policy_version 718351 (0.0006) [2023-12-26 05:19:36,825][123090] Updated weights for policy 1, policy_version 713971 (0.0010) [2023-12-26 05:19:36,889][123090] Updated weights for policy 1, policy_version 713981 (0.0011) [2023-12-26 05:19:37,600][123091] Updated weights for policy 0, policy_version 718361 (0.0005) [2023-12-26 05:19:37,663][123091] Updated weights for policy 0, policy_version 718371 (0.0009) [2023-12-26 05:19:37,702][123090] Updated weights for policy 1, policy_version 713991 (0.0011) [2023-12-26 05:19:37,718][123091] Updated weights for policy 0, policy_version 718381 (0.0008) [2023-12-26 05:19:37,749][123090] Updated weights for policy 1, policy_version 714001 (0.0011) [2023-12-26 05:19:37,802][123090] Updated weights for policy 1, policy_version 714011 (0.0011) [2023-12-26 05:19:38,553][123091] Updated weights for policy 0, policy_version 718391 (0.0007) [2023-12-26 05:19:38,601][123091] Updated weights for policy 0, policy_version 718401 (0.0008) [2023-12-26 05:19:38,645][123090] Updated weights for policy 1, policy_version 714021 (0.0007) [2023-12-26 05:19:38,655][123091] Updated weights for policy 0, policy_version 718411 (0.0008) [2023-12-26 05:19:38,705][123090] Updated weights for policy 1, policy_version 714031 (0.0010) [2023-12-26 05:19:38,766][123090] Updated weights for policy 1, policy_version 714041 (0.0009) [2023-12-26 05:19:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 366706688. Throughput: 0: 8861.3, 1: 9054.8. Samples: 366684324. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:38,785][121949] Avg episode reward: [(0, '6032.395'), (1, '5608.246')] [2023-12-26 05:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000718416_183918592.pth... [2023-12-26 05:19:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000717392_183656448.pth [2023-12-26 05:19:38,806][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000714048_182796288.pth... [2023-12-26 05:19:38,809][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000712992_182525952.pth [2023-12-26 05:19:39,571][123091] Updated weights for policy 0, policy_version 718421 (0.0009) [2023-12-26 05:19:39,596][123090] Updated weights for policy 1, policy_version 714051 (0.0008) [2023-12-26 05:19:39,631][123091] Updated weights for policy 0, policy_version 718431 (0.0009) [2023-12-26 05:19:39,663][123090] Updated weights for policy 1, policy_version 714061 (0.0009) [2023-12-26 05:19:39,699][123091] Updated weights for policy 0, policy_version 718441 (0.0008) [2023-12-26 05:19:39,729][123090] Updated weights for policy 1, policy_version 714071 (0.0006) [2023-12-26 05:19:40,504][123091] Updated weights for policy 0, policy_version 718451 (0.0009) [2023-12-26 05:19:40,562][123091] Updated weights for policy 0, policy_version 718461 (0.0010) [2023-12-26 05:19:40,567][123090] Updated weights for policy 1, policy_version 714081 (0.0009) [2023-12-26 05:19:40,616][123091] Updated weights for policy 0, policy_version 718471 (0.0008) [2023-12-26 05:19:40,631][123090] Updated weights for policy 1, policy_version 714091 (0.0009) [2023-12-26 05:19:40,698][123090] Updated weights for policy 1, policy_version 714101 (0.0009) [2023-12-26 05:19:40,755][123090] Updated weights for policy 1, policy_version 714111 (0.0010) [2023-12-26 05:19:41,474][123091] Updated weights for policy 0, policy_version 718481 (0.0009) [2023-12-26 05:19:41,549][123091] Updated weights for policy 0, policy_version 718491 (0.0006) [2023-12-26 05:19:41,570][123090] Updated weights for policy 1, policy_version 714121 (0.0009) [2023-12-26 05:19:41,613][123091] Updated weights for policy 0, policy_version 718501 (0.0008) [2023-12-26 05:19:41,634][123090] Updated weights for policy 1, policy_version 714131 (0.0009) [2023-12-26 05:19:41,674][123091] Updated weights for policy 0, policy_version 718511 (0.0008) [2023-12-26 05:19:41,711][123090] Updated weights for policy 1, policy_version 714141 (0.0009) [2023-12-26 05:19:42,530][123091] Updated weights for policy 0, policy_version 718521 (0.0009) [2023-12-26 05:19:42,540][123090] Updated weights for policy 1, policy_version 714151 (0.0009) [2023-12-26 05:19:42,583][123091] Updated weights for policy 0, policy_version 718531 (0.0008) [2023-12-26 05:19:42,591][123090] Updated weights for policy 1, policy_version 714161 (0.0007) [2023-12-26 05:19:42,633][123091] Updated weights for policy 0, policy_version 718541 (0.0010) [2023-12-26 05:19:42,658][123090] Updated weights for policy 1, policy_version 714172 (0.0008) [2023-12-26 05:19:43,451][123091] Updated weights for policy 0, policy_version 718551 (0.0008) [2023-12-26 05:19:43,506][123091] Updated weights for policy 0, policy_version 718561 (0.0009) [2023-12-26 05:19:43,523][123090] Updated weights for policy 1, policy_version 714182 (0.0008) [2023-12-26 05:19:43,557][123091] Updated weights for policy 0, policy_version 718571 (0.0005) [2023-12-26 05:19:43,578][123090] Updated weights for policy 1, policy_version 714192 (0.0007) [2023-12-26 05:19:43,641][123090] Updated weights for policy 1, policy_version 714202 (0.0005) [2023-12-26 05:19:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 366796800. Throughput: 0: 8694.7, 1: 8937.7. Samples: 366785692. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:43,785][121949] Avg episode reward: [(0, '6101.274'), (1, '5516.518')] [2023-12-26 05:19:44,250][123090] Updated weights for policy 1, policy_version 714212 (0.0006) [2023-12-26 05:19:44,263][123091] Updated weights for policy 0, policy_version 718581 (0.0006) [2023-12-26 05:19:44,323][123090] Updated weights for policy 1, policy_version 714222 (0.0006) [2023-12-26 05:19:44,338][123091] Updated weights for policy 0, policy_version 718591 (0.0006) [2023-12-26 05:19:44,395][123090] Updated weights for policy 1, policy_version 714232 (0.0011) [2023-12-26 05:19:44,396][123091] Updated weights for policy 0, policy_version 718601 (0.0006) [2023-12-26 05:19:45,177][123091] Updated weights for policy 0, policy_version 718611 (0.0010) [2023-12-26 05:19:45,186][123090] Updated weights for policy 1, policy_version 714242 (0.0010) [2023-12-26 05:19:45,241][123091] Updated weights for policy 0, policy_version 718621 (0.0011) [2023-12-26 05:19:45,251][123090] Updated weights for policy 1, policy_version 714252 (0.0011) [2023-12-26 05:19:45,301][123091] Updated weights for policy 0, policy_version 718631 (0.0011) [2023-12-26 05:19:45,320][123090] Updated weights for policy 1, policy_version 714262 (0.0011) [2023-12-26 05:19:45,376][123090] Updated weights for policy 1, policy_version 714272 (0.0011) [2023-12-26 05:19:46,067][123091] Updated weights for policy 0, policy_version 718641 (0.0006) [2023-12-26 05:19:46,123][123091] Updated weights for policy 0, policy_version 718651 (0.0006) [2023-12-26 05:19:46,188][123091] Updated weights for policy 0, policy_version 718661 (0.0006) [2023-12-26 05:19:46,205][123090] Updated weights for policy 1, policy_version 714282 (0.0008) [2023-12-26 05:19:46,258][123090] Updated weights for policy 1, policy_version 714293 (0.0009) [2023-12-26 05:19:46,264][123091] Updated weights for policy 0, policy_version 718671 (0.0006) [2023-12-26 05:19:46,311][123090] Updated weights for policy 1, policy_version 714303 (0.0010) [2023-12-26 05:19:47,029][123091] Updated weights for policy 0, policy_version 718681 (0.0008) [2023-12-26 05:19:47,088][123091] Updated weights for policy 0, policy_version 718691 (0.0009) [2023-12-26 05:19:47,147][123091] Updated weights for policy 0, policy_version 718701 (0.0009) [2023-12-26 05:19:47,173][123090] Updated weights for policy 1, policy_version 714313 (0.0008) [2023-12-26 05:19:47,227][123090] Updated weights for policy 1, policy_version 714323 (0.0009) [2023-12-26 05:19:47,275][123090] Updated weights for policy 1, policy_version 714333 (0.0009) [2023-12-26 05:19:47,888][123091] Updated weights for policy 0, policy_version 718711 (0.0010) [2023-12-26 05:19:47,937][123091] Updated weights for policy 0, policy_version 718721 (0.0010) [2023-12-26 05:19:47,991][123091] Updated weights for policy 0, policy_version 718731 (0.0012) [2023-12-26 05:19:48,145][123090] Updated weights for policy 1, policy_version 714343 (0.0010) [2023-12-26 05:19:48,194][123090] Updated weights for policy 1, policy_version 714353 (0.0009) [2023-12-26 05:19:48,243][123090] Updated weights for policy 1, policy_version 714363 (0.0009) [2023-12-26 05:19:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 366878720. Throughput: 0: 8707.2, 1: 8894.6. Samples: 366892108. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:48,785][121949] Avg episode reward: [(0, '6075.487'), (1, '5497.013')] [2023-12-26 05:19:48,870][123091] Updated weights for policy 0, policy_version 718741 (0.0010) [2023-12-26 05:19:48,939][123091] Updated weights for policy 0, policy_version 718751 (0.0011) [2023-12-26 05:19:49,009][123091] Updated weights for policy 0, policy_version 718761 (0.0011) [2023-12-26 05:19:49,107][123090] Updated weights for policy 1, policy_version 714373 (0.0009) [2023-12-26 05:19:49,166][123090] Updated weights for policy 1, policy_version 714383 (0.0009) [2023-12-26 05:19:49,230][123090] Updated weights for policy 1, policy_version 714393 (0.0009) [2023-12-26 05:19:49,758][123091] Updated weights for policy 0, policy_version 718771 (0.0009) [2023-12-26 05:19:49,821][123091] Updated weights for policy 0, policy_version 718781 (0.0006) [2023-12-26 05:19:49,883][123091] Updated weights for policy 0, policy_version 718791 (0.0010) [2023-12-26 05:19:50,167][123090] Updated weights for policy 1, policy_version 714403 (0.0009) [2023-12-26 05:19:50,230][123090] Updated weights for policy 1, policy_version 714413 (0.0009) [2023-12-26 05:19:50,297][123090] Updated weights for policy 1, policy_version 714423 (0.0009) [2023-12-26 05:19:50,591][123091] Updated weights for policy 0, policy_version 718801 (0.0008) [2023-12-26 05:19:50,650][123091] Updated weights for policy 0, policy_version 718811 (0.0009) [2023-12-26 05:19:50,717][123091] Updated weights for policy 0, policy_version 718821 (0.0009) [2023-12-26 05:19:50,783][123091] Updated weights for policy 0, policy_version 718831 (0.0009) [2023-12-26 05:19:51,061][123090] Updated weights for policy 1, policy_version 714433 (0.0010) [2023-12-26 05:19:51,129][123090] Updated weights for policy 1, policy_version 714443 (0.0008) [2023-12-26 05:19:51,190][123090] Updated weights for policy 1, policy_version 714453 (0.0010) [2023-12-26 05:19:51,261][123090] Updated weights for policy 1, policy_version 714463 (0.0009) [2023-12-26 05:19:51,685][123091] Updated weights for policy 0, policy_version 718841 (0.0010) [2023-12-26 05:19:51,756][123091] Updated weights for policy 0, policy_version 718851 (0.0011) [2023-12-26 05:19:51,823][123091] Updated weights for policy 0, policy_version 718861 (0.0006) [2023-12-26 05:19:52,146][123090] Updated weights for policy 1, policy_version 714473 (0.0009) [2023-12-26 05:19:52,201][123090] Updated weights for policy 1, policy_version 714483 (0.0009) [2023-12-26 05:19:52,260][123090] Updated weights for policy 1, policy_version 714493 (0.0009) [2023-12-26 05:19:52,552][123091] Updated weights for policy 0, policy_version 718871 (0.0009) [2023-12-26 05:19:52,612][123091] Updated weights for policy 0, policy_version 718881 (0.0009) [2023-12-26 05:19:52,670][123091] Updated weights for policy 0, policy_version 718891 (0.0010) [2023-12-26 05:19:53,176][123090] Updated weights for policy 1, policy_version 714503 (0.0010) [2023-12-26 05:19:53,228][123090] Updated weights for policy 1, policy_version 714513 (0.0009) [2023-12-26 05:19:53,279][123090] Updated weights for policy 1, policy_version 714523 (0.0009) [2023-12-26 05:19:53,478][123091] Updated weights for policy 0, policy_version 718901 (0.0010) [2023-12-26 05:19:53,527][123091] Updated weights for policy 0, policy_version 718911 (0.0009) [2023-12-26 05:19:53,595][123091] Updated weights for policy 0, policy_version 718921 (0.0009) [2023-12-26 05:19:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17605.8). Total num frames: 366968832. Throughput: 0: 8760.8, 1: 8798.6. Samples: 366943284. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:53,785][121949] Avg episode reward: [(0, '6055.389'), (1, '5660.175')] [2023-12-26 05:19:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000714528_182919168.pth... [2023-12-26 05:19:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000718928_184049664.pth... [2023-12-26 05:19:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000713504_182657024.pth [2023-12-26 05:19:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000717872_183779328.pth [2023-12-26 05:19:54,159][123090] Updated weights for policy 1, policy_version 714533 (0.0009) [2023-12-26 05:19:54,218][123090] Updated weights for policy 1, policy_version 714544 (0.0010) [2023-12-26 05:19:54,283][123090] Updated weights for policy 1, policy_version 714554 (0.0010) [2023-12-26 05:19:54,429][123091] Updated weights for policy 0, policy_version 718931 (0.0009) [2023-12-26 05:19:54,490][123091] Updated weights for policy 0, policy_version 718941 (0.0010) [2023-12-26 05:19:54,551][123091] Updated weights for policy 0, policy_version 718951 (0.0009) [2023-12-26 05:19:55,123][123090] Updated weights for policy 1, policy_version 714564 (0.0009) [2023-12-26 05:19:55,182][123090] Updated weights for policy 1, policy_version 714574 (0.0010) [2023-12-26 05:19:55,238][123090] Updated weights for policy 1, policy_version 714584 (0.0009) [2023-12-26 05:19:55,413][123091] Updated weights for policy 0, policy_version 718961 (0.0009) [2023-12-26 05:19:55,470][123091] Updated weights for policy 0, policy_version 718971 (0.0009) [2023-12-26 05:19:55,534][123091] Updated weights for policy 0, policy_version 718981 (0.0009) [2023-12-26 05:19:55,599][123091] Updated weights for policy 0, policy_version 718991 (0.0009) [2023-12-26 05:19:56,075][123090] Updated weights for policy 1, policy_version 714594 (0.0009) [2023-12-26 05:19:56,122][123090] Updated weights for policy 1, policy_version 714604 (0.0005) [2023-12-26 05:19:56,174][123090] Updated weights for policy 1, policy_version 714614 (0.0005) [2023-12-26 05:19:56,240][123090] Updated weights for policy 1, policy_version 714624 (0.0006) [2023-12-26 05:19:56,459][123091] Updated weights for policy 0, policy_version 719001 (0.0009) [2023-12-26 05:19:56,526][123091] Updated weights for policy 0, policy_version 719011 (0.0009) [2023-12-26 05:19:56,590][123091] Updated weights for policy 0, policy_version 719021 (0.0008) [2023-12-26 05:19:56,970][123090] Updated weights for policy 1, policy_version 714634 (0.0007) [2023-12-26 05:19:57,028][123090] Updated weights for policy 1, policy_version 714644 (0.0010) [2023-12-26 05:19:57,079][123090] Updated weights for policy 1, policy_version 714654 (0.0010) [2023-12-26 05:19:57,434][123091] Updated weights for policy 0, policy_version 719031 (0.0010) [2023-12-26 05:19:57,486][123091] Updated weights for policy 0, policy_version 719041 (0.0009) [2023-12-26 05:19:57,538][123091] Updated weights for policy 0, policy_version 719051 (0.0010) [2023-12-26 05:19:57,805][123090] Updated weights for policy 1, policy_version 714664 (0.0006) [2023-12-26 05:19:57,866][123090] Updated weights for policy 1, policy_version 714674 (0.0008) [2023-12-26 05:19:57,919][123090] Updated weights for policy 1, policy_version 714684 (0.0009) [2023-12-26 05:19:58,428][123091] Updated weights for policy 0, policy_version 719061 (0.0007) [2023-12-26 05:19:58,496][123091] Updated weights for policy 0, policy_version 719071 (0.0008) [2023-12-26 05:19:58,559][123091] Updated weights for policy 0, policy_version 719081 (0.0008) [2023-12-26 05:19:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 367050752. Throughput: 0: 8738.2, 1: 8846.2. Samples: 367046024. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:19:58,785][121949] Avg episode reward: [(0, '6137.750'), (1, '5547.119')] [2023-12-26 05:19:58,798][123090] Updated weights for policy 1, policy_version 714694 (0.0009) [2023-12-26 05:19:58,878][123090] Updated weights for policy 1, policy_version 714704 (0.0010) [2023-12-26 05:19:58,941][123090] Updated weights for policy 1, policy_version 714714 (0.0009) [2023-12-26 05:19:59,392][123091] Updated weights for policy 0, policy_version 719091 (0.0008) [2023-12-26 05:19:59,447][123091] Updated weights for policy 0, policy_version 719101 (0.0005) [2023-12-26 05:19:59,514][123091] Updated weights for policy 0, policy_version 719111 (0.0006) [2023-12-26 05:19:59,847][123090] Updated weights for policy 1, policy_version 714724 (0.0010) [2023-12-26 05:19:59,906][123090] Updated weights for policy 1, policy_version 714734 (0.0010) [2023-12-26 05:19:59,971][123090] Updated weights for policy 1, policy_version 714744 (0.0008) [2023-12-26 05:20:00,197][123091] Updated weights for policy 0, policy_version 719121 (0.0007) [2023-12-26 05:20:00,257][123091] Updated weights for policy 0, policy_version 719131 (0.0009) [2023-12-26 05:20:00,321][123091] Updated weights for policy 0, policy_version 719141 (0.0009) [2023-12-26 05:20:00,376][123091] Updated weights for policy 0, policy_version 719151 (0.0009) [2023-12-26 05:20:00,718][123090] Updated weights for policy 1, policy_version 714754 (0.0008) [2023-12-26 05:20:00,778][123090] Updated weights for policy 1, policy_version 714764 (0.0005) [2023-12-26 05:20:00,845][123090] Updated weights for policy 1, policy_version 714774 (0.0005) [2023-12-26 05:20:00,891][123090] Updated weights for policy 1, policy_version 714784 (0.0006) [2023-12-26 05:20:01,185][123091] Updated weights for policy 0, policy_version 719161 (0.0007) [2023-12-26 05:20:01,245][123091] Updated weights for policy 0, policy_version 719171 (0.0007) [2023-12-26 05:20:01,308][123091] Updated weights for policy 0, policy_version 719181 (0.0011) [2023-12-26 05:20:01,689][123090] Updated weights for policy 1, policy_version 714794 (0.0010) [2023-12-26 05:20:01,760][123090] Updated weights for policy 1, policy_version 714804 (0.0011) [2023-12-26 05:20:01,819][123090] Updated weights for policy 1, policy_version 714814 (0.0010) [2023-12-26 05:20:02,083][123091] Updated weights for policy 0, policy_version 719191 (0.0007) [2023-12-26 05:20:02,141][123091] Updated weights for policy 0, policy_version 719201 (0.0006) [2023-12-26 05:20:02,206][123091] Updated weights for policy 0, policy_version 719211 (0.0005) [2023-12-26 05:20:02,662][123090] Updated weights for policy 1, policy_version 714824 (0.0009) [2023-12-26 05:20:02,714][123090] Updated weights for policy 1, policy_version 714834 (0.0009) [2023-12-26 05:20:02,768][123090] Updated weights for policy 1, policy_version 714844 (0.0008) [2023-12-26 05:20:02,975][123091] Updated weights for policy 0, policy_version 719221 (0.0008) [2023-12-26 05:20:03,031][123091] Updated weights for policy 0, policy_version 719231 (0.0007) [2023-12-26 05:20:03,087][123091] Updated weights for policy 0, policy_version 719241 (0.0005) [2023-12-26 05:20:03,643][123090] Updated weights for policy 1, policy_version 714854 (0.0009) [2023-12-26 05:20:03,691][123090] Updated weights for policy 1, policy_version 714864 (0.0007) [2023-12-26 05:20:03,744][123091] Updated weights for policy 0, policy_version 719251 (0.0005) [2023-12-26 05:20:03,744][123090] Updated weights for policy 1, policy_version 714874 (0.0009) [2023-12-26 05:20:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 367140864. Throughput: 0: 8743.4, 1: 8767.5. Samples: 367151120. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:03,785][121949] Avg episode reward: [(0, '6033.165'), (1, '5583.634')] [2023-12-26 05:20:03,807][123091] Updated weights for policy 0, policy_version 719261 (0.0005) [2023-12-26 05:20:03,875][123091] Updated weights for policy 0, policy_version 719271 (0.0005) [2023-12-26 05:20:04,487][123090] Updated weights for policy 1, policy_version 714884 (0.0008) [2023-12-26 05:20:04,523][123091] Updated weights for policy 0, policy_version 719281 (0.0005) [2023-12-26 05:20:04,557][123090] Updated weights for policy 1, policy_version 714894 (0.0007) [2023-12-26 05:20:04,581][123091] Updated weights for policy 0, policy_version 719291 (0.0006) [2023-12-26 05:20:04,628][123090] Updated weights for policy 1, policy_version 714904 (0.0007) [2023-12-26 05:20:04,629][123091] Updated weights for policy 0, policy_version 719301 (0.0007) [2023-12-26 05:20:04,682][123091] Updated weights for policy 0, policy_version 719311 (0.0006) [2023-12-26 05:20:05,302][123090] Updated weights for policy 1, policy_version 714914 (0.0006) [2023-12-26 05:20:05,360][123090] Updated weights for policy 1, policy_version 714924 (0.0008) [2023-12-26 05:20:05,364][123091] Updated weights for policy 0, policy_version 719321 (0.0007) [2023-12-26 05:20:05,408][123091] Updated weights for policy 0, policy_version 719331 (0.0007) [2023-12-26 05:20:05,423][123090] Updated weights for policy 1, policy_version 714934 (0.0008) [2023-12-26 05:20:05,455][123091] Updated weights for policy 0, policy_version 719341 (0.0008) [2023-12-26 05:20:05,486][123090] Updated weights for policy 1, policy_version 714944 (0.0007) [2023-12-26 05:20:06,199][123090] Updated weights for policy 1, policy_version 714954 (0.0010) [2023-12-26 05:20:06,267][123090] Updated weights for policy 1, policy_version 714964 (0.0010) [2023-12-26 05:20:06,296][123091] Updated weights for policy 0, policy_version 719351 (0.0008) [2023-12-26 05:20:06,325][123090] Updated weights for policy 1, policy_version 714974 (0.0008) [2023-12-26 05:20:06,360][123091] Updated weights for policy 0, policy_version 719361 (0.0009) [2023-12-26 05:20:06,430][123091] Updated weights for policy 0, policy_version 719371 (0.0008) [2023-12-26 05:20:07,127][123090] Updated weights for policy 1, policy_version 714984 (0.0006) [2023-12-26 05:20:07,193][123090] Updated weights for policy 1, policy_version 714994 (0.0005) [2023-12-26 05:20:07,260][123090] Updated weights for policy 1, policy_version 715004 (0.0008) [2023-12-26 05:20:07,288][123091] Updated weights for policy 0, policy_version 719381 (0.0009) [2023-12-26 05:20:07,342][123091] Updated weights for policy 0, policy_version 719391 (0.0010) [2023-12-26 05:20:07,394][123091] Updated weights for policy 0, policy_version 719401 (0.0009) [2023-12-26 05:20:08,009][123090] Updated weights for policy 1, policy_version 715014 (0.0005) [2023-12-26 05:20:08,059][123090] Updated weights for policy 1, policy_version 715024 (0.0005) [2023-12-26 05:20:08,114][123090] Updated weights for policy 1, policy_version 715034 (0.0005) [2023-12-26 05:20:08,305][123091] Updated weights for policy 0, policy_version 719411 (0.0010) [2023-12-26 05:20:08,366][123091] Updated weights for policy 0, policy_version 719421 (0.0010) [2023-12-26 05:20:08,425][123091] Updated weights for policy 0, policy_version 719431 (0.0010) [2023-12-26 05:20:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 367230976. Throughput: 0: 8851.1, 1: 8834.0. Samples: 367208760. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:08,785][121949] Avg episode reward: [(0, '5997.706'), (1, '5629.244')] [2023-12-26 05:20:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000719440_184180736.pth... [2023-12-26 05:20:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000715040_183050240.pth... [2023-12-26 05:20:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000718416_183918592.pth [2023-12-26 05:20:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000714048_182796288.pth [2023-12-26 05:20:08,855][123090] Updated weights for policy 1, policy_version 715044 (0.0007) [2023-12-26 05:20:08,920][123090] Updated weights for policy 1, policy_version 715054 (0.0007) [2023-12-26 05:20:08,995][123090] Updated weights for policy 1, policy_version 715064 (0.0006) [2023-12-26 05:20:09,296][123091] Updated weights for policy 0, policy_version 719441 (0.0009) [2023-12-26 05:20:09,363][123091] Updated weights for policy 0, policy_version 719451 (0.0010) [2023-12-26 05:20:09,436][123091] Updated weights for policy 0, policy_version 719461 (0.0010) [2023-12-26 05:20:09,510][123091] Updated weights for policy 0, policy_version 719471 (0.0009) [2023-12-26 05:20:09,766][123090] Updated weights for policy 1, policy_version 715074 (0.0008) [2023-12-26 05:20:09,829][123090] Updated weights for policy 1, policy_version 715084 (0.0009) [2023-12-26 05:20:09,906][123090] Updated weights for policy 1, policy_version 715094 (0.0006) [2023-12-26 05:20:09,976][123090] Updated weights for policy 1, policy_version 715104 (0.0008) [2023-12-26 05:20:10,348][123091] Updated weights for policy 0, policy_version 719481 (0.0009) [2023-12-26 05:20:10,413][123091] Updated weights for policy 0, policy_version 719491 (0.0008) [2023-12-26 05:20:10,480][123091] Updated weights for policy 0, policy_version 719501 (0.0009) [2023-12-26 05:20:10,789][123090] Updated weights for policy 1, policy_version 715114 (0.0010) [2023-12-26 05:20:10,856][123090] Updated weights for policy 1, policy_version 715124 (0.0010) [2023-12-26 05:20:10,912][123090] Updated weights for policy 1, policy_version 715134 (0.0010) [2023-12-26 05:20:11,318][123091] Updated weights for policy 0, policy_version 719511 (0.0010) [2023-12-26 05:20:11,388][123091] Updated weights for policy 0, policy_version 719521 (0.0009) [2023-12-26 05:20:11,457][123091] Updated weights for policy 0, policy_version 719531 (0.0009) [2023-12-26 05:20:11,737][123090] Updated weights for policy 1, policy_version 715144 (0.0009) [2023-12-26 05:20:11,802][123090] Updated weights for policy 1, policy_version 715154 (0.0009) [2023-12-26 05:20:11,872][123090] Updated weights for policy 1, policy_version 715164 (0.0008) [2023-12-26 05:20:12,297][123091] Updated weights for policy 0, policy_version 719541 (0.0009) [2023-12-26 05:20:12,369][123091] Updated weights for policy 0, policy_version 719551 (0.0010) [2023-12-26 05:20:12,441][123091] Updated weights for policy 0, policy_version 719561 (0.0011) [2023-12-26 05:20:12,739][123090] Updated weights for policy 1, policy_version 715174 (0.0007) [2023-12-26 05:20:12,817][123090] Updated weights for policy 1, policy_version 715184 (0.0009) [2023-12-26 05:20:12,880][123090] Updated weights for policy 1, policy_version 715194 (0.0009) [2023-12-26 05:20:13,166][123091] Updated weights for policy 0, policy_version 719571 (0.0009) [2023-12-26 05:20:13,224][123091] Updated weights for policy 0, policy_version 719581 (0.0009) [2023-12-26 05:20:13,277][123091] Updated weights for policy 0, policy_version 719591 (0.0009) [2023-12-26 05:20:13,692][123090] Updated weights for policy 1, policy_version 715204 (0.0010) [2023-12-26 05:20:13,756][123090] Updated weights for policy 1, policy_version 715214 (0.0009) [2023-12-26 05:20:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 367312896. Throughput: 0: 8792.0, 1: 8779.2. Samples: 367310648. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:13,785][121949] Avg episode reward: [(0, '6102.533'), (1, '5575.904')] [2023-12-26 05:20:13,817][123090] Updated weights for policy 1, policy_version 715224 (0.0009) [2023-12-26 05:20:14,124][123091] Updated weights for policy 0, policy_version 719601 (0.0010) [2023-12-26 05:20:14,190][123091] Updated weights for policy 0, policy_version 719611 (0.0009) [2023-12-26 05:20:14,246][123091] Updated weights for policy 0, policy_version 719621 (0.0009) [2023-12-26 05:20:14,306][123091] Updated weights for policy 0, policy_version 719631 (0.0009) [2023-12-26 05:20:14,611][123090] Updated weights for policy 1, policy_version 715234 (0.0008) [2023-12-26 05:20:14,662][123090] Updated weights for policy 1, policy_version 715244 (0.0010) [2023-12-26 05:20:14,726][123090] Updated weights for policy 1, policy_version 715254 (0.0009) [2023-12-26 05:20:14,797][123090] Updated weights for policy 1, policy_version 715264 (0.0008) [2023-12-26 05:20:15,132][123091] Updated weights for policy 0, policy_version 719641 (0.0010) [2023-12-26 05:20:15,185][123091] Updated weights for policy 0, policy_version 719651 (0.0009) [2023-12-26 05:20:15,241][123091] Updated weights for policy 0, policy_version 719661 (0.0010) [2023-12-26 05:20:15,592][123090] Updated weights for policy 1, policy_version 715274 (0.0009) [2023-12-26 05:20:15,660][123090] Updated weights for policy 1, policy_version 715284 (0.0008) [2023-12-26 05:20:15,731][123090] Updated weights for policy 1, policy_version 715294 (0.0005) [2023-12-26 05:20:16,141][123091] Updated weights for policy 0, policy_version 719671 (0.0010) [2023-12-26 05:20:16,203][123091] Updated weights for policy 0, policy_version 719681 (0.0010) [2023-12-26 05:20:16,271][123091] Updated weights for policy 0, policy_version 719691 (0.0009) [2023-12-26 05:20:16,481][123090] Updated weights for policy 1, policy_version 715304 (0.0009) [2023-12-26 05:20:16,548][123090] Updated weights for policy 1, policy_version 715314 (0.0009) [2023-12-26 05:20:16,600][123090] Updated weights for policy 1, policy_version 715324 (0.0009) [2023-12-26 05:20:17,119][123091] Updated weights for policy 0, policy_version 719701 (0.0010) [2023-12-26 05:20:17,171][123091] Updated weights for policy 0, policy_version 719711 (0.0009) [2023-12-26 05:20:17,220][123091] Updated weights for policy 0, policy_version 719721 (0.0009) [2023-12-26 05:20:17,416][123090] Updated weights for policy 1, policy_version 715334 (0.0007) [2023-12-26 05:20:17,475][123090] Updated weights for policy 1, policy_version 715344 (0.0006) [2023-12-26 05:20:17,533][123090] Updated weights for policy 1, policy_version 715354 (0.0006) [2023-12-26 05:20:18,106][123091] Updated weights for policy 0, policy_version 719731 (0.0009) [2023-12-26 05:20:18,148][123090] Updated weights for policy 1, policy_version 715364 (0.0006) [2023-12-26 05:20:18,166][123091] Updated weights for policy 0, policy_version 719741 (0.0010) [2023-12-26 05:20:18,211][123090] Updated weights for policy 1, policy_version 715374 (0.0006) [2023-12-26 05:20:18,221][123091] Updated weights for policy 0, policy_version 719751 (0.0010) [2023-12-26 05:20:18,275][123090] Updated weights for policy 1, policy_version 715384 (0.0007) [2023-12-26 05:20:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 367403008. Throughput: 0: 8760.7, 1: 8715.5. Samples: 367414884. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:18,784][121949] Avg episode reward: [(0, '6079.472'), (1, '5602.217')] [2023-12-26 05:20:19,023][123091] Updated weights for policy 0, policy_version 719761 (0.0010) [2023-12-26 05:20:19,078][123091] Updated weights for policy 0, policy_version 719771 (0.0005) [2023-12-26 05:20:19,130][123091] Updated weights for policy 0, policy_version 719781 (0.0005) [2023-12-26 05:20:19,146][123090] Updated weights for policy 1, policy_version 715394 (0.0009) [2023-12-26 05:20:19,185][123091] Updated weights for policy 0, policy_version 719791 (0.0005) [2023-12-26 05:20:19,205][123090] Updated weights for policy 1, policy_version 715404 (0.0009) [2023-12-26 05:20:19,268][123090] Updated weights for policy 1, policy_version 715414 (0.0009) [2023-12-26 05:20:19,323][123090] Updated weights for policy 1, policy_version 715424 (0.0009) [2023-12-26 05:20:19,978][123091] Updated weights for policy 0, policy_version 719801 (0.0010) [2023-12-26 05:20:20,040][123091] Updated weights for policy 0, policy_version 719811 (0.0011) [2023-12-26 05:20:20,087][123091] Updated weights for policy 0, policy_version 719821 (0.0009) [2023-12-26 05:20:20,165][123090] Updated weights for policy 1, policy_version 715434 (0.0010) [2023-12-26 05:20:20,230][123090] Updated weights for policy 1, policy_version 715444 (0.0010) [2023-12-26 05:20:20,293][123090] Updated weights for policy 1, policy_version 715454 (0.0011) [2023-12-26 05:20:20,913][123091] Updated weights for policy 0, policy_version 719831 (0.0010) [2023-12-26 05:20:20,969][123091] Updated weights for policy 0, policy_version 719841 (0.0011) [2023-12-26 05:20:21,037][123091] Updated weights for policy 0, policy_version 719851 (0.0011) [2023-12-26 05:20:21,111][123090] Updated weights for policy 1, policy_version 715464 (0.0008) [2023-12-26 05:20:21,177][123090] Updated weights for policy 1, policy_version 715474 (0.0009) [2023-12-26 05:20:21,244][123090] Updated weights for policy 1, policy_version 715484 (0.0009) [2023-12-26 05:20:21,882][123091] Updated weights for policy 0, policy_version 719861 (0.0009) [2023-12-26 05:20:21,952][123091] Updated weights for policy 0, policy_version 719871 (0.0007) [2023-12-26 05:20:22,003][123090] Updated weights for policy 1, policy_version 715494 (0.0010) [2023-12-26 05:20:22,023][123091] Updated weights for policy 0, policy_version 719881 (0.0006) [2023-12-26 05:20:22,071][123090] Updated weights for policy 1, policy_version 715504 (0.0011) [2023-12-26 05:20:22,139][123090] Updated weights for policy 1, policy_version 715514 (0.0011) [2023-12-26 05:20:22,846][123091] Updated weights for policy 0, policy_version 719891 (0.0007) [2023-12-26 05:20:22,909][123090] Updated weights for policy 1, policy_version 715524 (0.0010) [2023-12-26 05:20:22,911][123091] Updated weights for policy 0, policy_version 719901 (0.0009) [2023-12-26 05:20:22,973][123090] Updated weights for policy 1, policy_version 715534 (0.0011) [2023-12-26 05:20:22,973][123091] Updated weights for policy 0, policy_version 719911 (0.0009) [2023-12-26 05:20:23,036][123090] Updated weights for policy 1, policy_version 715544 (0.0011) [2023-12-26 05:20:23,679][123091] Updated weights for policy 0, policy_version 719921 (0.0007) [2023-12-26 05:20:23,749][123091] Updated weights for policy 0, policy_version 719931 (0.0006) [2023-12-26 05:20:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 367484928. Throughput: 0: 8709.2, 1: 8682.6. Samples: 367466956. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:23,785][121949] Avg episode reward: [(0, '6093.773'), (1, '5628.546')] [2023-12-26 05:20:23,810][123090] Updated weights for policy 1, policy_version 715554 (0.0010) [2023-12-26 05:20:23,812][123091] Updated weights for policy 0, policy_version 719941 (0.0008) [2023-12-26 05:20:23,874][123091] Updated weights for policy 0, policy_version 719951 (0.0008) [2023-12-26 05:20:23,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000719952_184311808.pth... [2023-12-26 05:20:23,880][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000718928_184049664.pth [2023-12-26 05:20:23,881][123090] Updated weights for policy 1, policy_version 715564 (0.0006) [2023-12-26 05:20:23,944][123090] Updated weights for policy 1, policy_version 715574 (0.0009) [2023-12-26 05:20:24,010][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000715584_183189504.pth... [2023-12-26 05:20:24,013][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000714528_182919168.pth [2023-12-26 05:20:24,014][123090] Updated weights for policy 1, policy_version 715584 (0.0010) [2023-12-26 05:20:24,661][123091] Updated weights for policy 0, policy_version 719961 (0.0010) [2023-12-26 05:20:24,739][123091] Updated weights for policy 0, policy_version 719971 (0.0008) [2023-12-26 05:20:24,800][123090] Updated weights for policy 1, policy_version 715594 (0.0008) [2023-12-26 05:20:24,802][123091] Updated weights for policy 0, policy_version 719981 (0.0008) [2023-12-26 05:20:24,865][123090] Updated weights for policy 1, policy_version 715604 (0.0009) [2023-12-26 05:20:24,932][123090] Updated weights for policy 1, policy_version 715614 (0.0010) [2023-12-26 05:20:25,607][123091] Updated weights for policy 0, policy_version 719991 (0.0010) [2023-12-26 05:20:25,667][123091] Updated weights for policy 0, policy_version 720001 (0.0010) [2023-12-26 05:20:25,722][123091] Updated weights for policy 0, policy_version 720011 (0.0007) [2023-12-26 05:20:25,758][123090] Updated weights for policy 1, policy_version 715624 (0.0008) [2023-12-26 05:20:25,807][123090] Updated weights for policy 1, policy_version 715634 (0.0009) [2023-12-26 05:20:25,871][123090] Updated weights for policy 1, policy_version 715644 (0.0009) [2023-12-26 05:20:26,421][123091] Updated weights for policy 0, policy_version 720021 (0.0007) [2023-12-26 05:20:26,482][123091] Updated weights for policy 0, policy_version 720031 (0.0005) [2023-12-26 05:20:26,541][123091] Updated weights for policy 0, policy_version 720041 (0.0005) [2023-12-26 05:20:26,798][123090] Updated weights for policy 1, policy_version 715654 (0.0010) [2023-12-26 05:20:26,851][123090] Updated weights for policy 1, policy_version 715664 (0.0008) [2023-12-26 05:20:26,908][123090] Updated weights for policy 1, policy_version 715674 (0.0009) [2023-12-26 05:20:27,192][123091] Updated weights for policy 0, policy_version 720051 (0.0006) [2023-12-26 05:20:27,242][123091] Updated weights for policy 0, policy_version 720061 (0.0010) [2023-12-26 05:20:27,289][123091] Updated weights for policy 0, policy_version 720071 (0.0010) [2023-12-26 05:20:27,721][123090] Updated weights for policy 1, policy_version 715684 (0.0008) [2023-12-26 05:20:27,782][123090] Updated weights for policy 1, policy_version 715694 (0.0006) [2023-12-26 05:20:27,838][123090] Updated weights for policy 1, policy_version 715704 (0.0007) [2023-12-26 05:20:28,082][123091] Updated weights for policy 0, policy_version 720081 (0.0010) [2023-12-26 05:20:28,128][123091] Updated weights for policy 0, policy_version 720091 (0.0005) [2023-12-26 05:20:28,174][123091] Updated weights for policy 0, policy_version 720101 (0.0005) [2023-12-26 05:20:28,226][123091] Updated weights for policy 0, policy_version 720111 (0.0005) [2023-12-26 05:20:28,511][123090] Updated weights for policy 1, policy_version 715714 (0.0006) [2023-12-26 05:20:28,578][123090] Updated weights for policy 1, policy_version 715724 (0.0005) [2023-12-26 05:20:28,642][123090] Updated weights for policy 1, policy_version 715734 (0.0005) [2023-12-26 05:20:28,710][123090] Updated weights for policy 1, policy_version 715744 (0.0005) [2023-12-26 05:20:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 367583232. Throughput: 0: 8793.0, 1: 8702.0. Samples: 367572968. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:28,785][121949] Avg episode reward: [(0, '6177.291'), (1, '5219.691')] [2023-12-26 05:20:29,014][123091] Updated weights for policy 0, policy_version 720121 (0.0010) [2023-12-26 05:20:29,076][123091] Updated weights for policy 0, policy_version 720131 (0.0010) [2023-12-26 05:20:29,137][123091] Updated weights for policy 0, policy_version 720141 (0.0010) [2023-12-26 05:20:29,376][123090] Updated weights for policy 1, policy_version 715754 (0.0007) [2023-12-26 05:20:29,447][123090] Updated weights for policy 1, policy_version 715764 (0.0005) [2023-12-26 05:20:29,519][123090] Updated weights for policy 1, policy_version 715774 (0.0005) [2023-12-26 05:20:29,919][123091] Updated weights for policy 0, policy_version 720151 (0.0011) [2023-12-26 05:20:29,982][123091] Updated weights for policy 0, policy_version 720161 (0.0010) [2023-12-26 05:20:30,034][123091] Updated weights for policy 0, policy_version 720171 (0.0011) [2023-12-26 05:20:30,230][123090] Updated weights for policy 1, policy_version 715784 (0.0010) [2023-12-26 05:20:30,281][123090] Updated weights for policy 1, policy_version 715794 (0.0010) [2023-12-26 05:20:30,338][123090] Updated weights for policy 1, policy_version 715804 (0.0008) [2023-12-26 05:20:30,863][123091] Updated weights for policy 0, policy_version 720181 (0.0008) [2023-12-26 05:20:30,917][123091] Updated weights for policy 0, policy_version 720191 (0.0010) [2023-12-26 05:20:30,973][123091] Updated weights for policy 0, policy_version 720201 (0.0007) [2023-12-26 05:20:31,016][123090] Updated weights for policy 1, policy_version 715814 (0.0008) [2023-12-26 05:20:31,088][123090] Updated weights for policy 1, policy_version 715824 (0.0010) [2023-12-26 05:20:31,157][123090] Updated weights for policy 1, policy_version 715834 (0.0010) [2023-12-26 05:20:31,720][123091] Updated weights for policy 0, policy_version 720211 (0.0007) [2023-12-26 05:20:31,773][123091] Updated weights for policy 0, policy_version 720221 (0.0010) [2023-12-26 05:20:31,829][123091] Updated weights for policy 0, policy_version 720231 (0.0011) [2023-12-26 05:20:31,892][123090] Updated weights for policy 1, policy_version 715844 (0.0006) [2023-12-26 05:20:31,962][123090] Updated weights for policy 1, policy_version 715854 (0.0006) [2023-12-26 05:20:32,033][123090] Updated weights for policy 1, policy_version 715864 (0.0006) [2023-12-26 05:20:32,640][123091] Updated weights for policy 0, policy_version 720241 (0.0010) [2023-12-26 05:20:32,687][123090] Updated weights for policy 1, policy_version 715874 (0.0006) [2023-12-26 05:20:32,706][123091] Updated weights for policy 0, policy_version 720251 (0.0006) [2023-12-26 05:20:32,754][123090] Updated weights for policy 1, policy_version 715884 (0.0009) [2023-12-26 05:20:32,757][123091] Updated weights for policy 0, policy_version 720261 (0.0005) [2023-12-26 05:20:32,817][123090] Updated weights for policy 1, policy_version 715894 (0.0009) [2023-12-26 05:20:32,824][123091] Updated weights for policy 0, policy_version 720271 (0.0008) [2023-12-26 05:20:32,876][123090] Updated weights for policy 1, policy_version 715904 (0.0008) [2023-12-26 05:20:33,547][123090] Updated weights for policy 1, policy_version 715914 (0.0005) [2023-12-26 05:20:33,579][123091] Updated weights for policy 0, policy_version 720281 (0.0010) [2023-12-26 05:20:33,591][123090] Updated weights for policy 1, policy_version 715924 (0.0005) [2023-12-26 05:20:33,635][123091] Updated weights for policy 0, policy_version 720291 (0.0010) [2023-12-26 05:20:33,636][123090] Updated weights for policy 1, policy_version 715934 (0.0005) [2023-12-26 05:20:33,696][123091] Updated weights for policy 0, policy_version 720301 (0.0010) [2023-12-26 05:20:33,784][121949] Fps is (10 sec: 19660.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 367681536. Throughput: 0: 8787.4, 1: 8873.6. Samples: 367686856. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:33,785][121949] Avg episode reward: [(0, '6189.483'), (1, '4999.340')] [2023-12-26 05:20:34,356][123090] Updated weights for policy 1, policy_version 715944 (0.0005) [2023-12-26 05:20:34,426][123090] Updated weights for policy 1, policy_version 715954 (0.0007) [2023-12-26 05:20:34,465][123091] Updated weights for policy 0, policy_version 720311 (0.0007) [2023-12-26 05:20:34,483][123090] Updated weights for policy 1, policy_version 715964 (0.0008) [2023-12-26 05:20:34,522][123091] Updated weights for policy 0, policy_version 720321 (0.0006) [2023-12-26 05:20:34,589][123091] Updated weights for policy 0, policy_version 720331 (0.0011) [2023-12-26 05:20:35,191][123090] Updated weights for policy 1, policy_version 715974 (0.0009) [2023-12-26 05:20:35,243][123090] Updated weights for policy 1, policy_version 715984 (0.0009) [2023-12-26 05:20:35,291][123090] Updated weights for policy 1, policy_version 715994 (0.0008) [2023-12-26 05:20:35,404][123091] Updated weights for policy 0, policy_version 720341 (0.0011) [2023-12-26 05:20:35,458][123091] Updated weights for policy 0, policy_version 720351 (0.0010) [2023-12-26 05:20:35,517][123091] Updated weights for policy 0, policy_version 720361 (0.0010) [2023-12-26 05:20:36,009][123090] Updated weights for policy 1, policy_version 716004 (0.0006) [2023-12-26 05:20:36,068][123090] Updated weights for policy 1, policy_version 716014 (0.0006) [2023-12-26 05:20:36,142][123090] Updated weights for policy 1, policy_version 716024 (0.0007) [2023-12-26 05:20:36,336][123091] Updated weights for policy 0, policy_version 720371 (0.0010) [2023-12-26 05:20:36,384][123091] Updated weights for policy 0, policy_version 720381 (0.0010) [2023-12-26 05:20:36,440][123091] Updated weights for policy 0, policy_version 720391 (0.0011) [2023-12-26 05:20:36,940][123090] Updated weights for policy 1, policy_version 716034 (0.0007) [2023-12-26 05:20:36,989][123090] Updated weights for policy 1, policy_version 716044 (0.0009) [2023-12-26 05:20:37,042][123090] Updated weights for policy 1, policy_version 716054 (0.0009) [2023-12-26 05:20:37,095][123090] Updated weights for policy 1, policy_version 716064 (0.0009) [2023-12-26 05:20:37,287][123091] Updated weights for policy 0, policy_version 720401 (0.0010) [2023-12-26 05:20:37,350][123091] Updated weights for policy 0, policy_version 720411 (0.0011) [2023-12-26 05:20:37,419][123091] Updated weights for policy 0, policy_version 720421 (0.0010) [2023-12-26 05:20:37,485][123091] Updated weights for policy 0, policy_version 720431 (0.0010) [2023-12-26 05:20:37,940][123090] Updated weights for policy 1, policy_version 716074 (0.0011) [2023-12-26 05:20:38,003][123090] Updated weights for policy 1, policy_version 716084 (0.0010) [2023-12-26 05:20:38,058][123090] Updated weights for policy 1, policy_version 716094 (0.0010) [2023-12-26 05:20:38,238][123091] Updated weights for policy 0, policy_version 720441 (0.0009) [2023-12-26 05:20:38,286][123091] Updated weights for policy 0, policy_version 720451 (0.0009) [2023-12-26 05:20:38,358][123091] Updated weights for policy 0, policy_version 720461 (0.0009) [2023-12-26 05:20:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 367763456. Throughput: 0: 8785.1, 1: 8977.9. Samples: 367742616. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:38,785][121949] Avg episode reward: [(0, '6124.067'), (1, '5387.162')] [2023-12-26 05:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000720464_184442880.pth... [2023-12-26 05:20:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000716096_183320576.pth... [2023-12-26 05:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000719440_184180736.pth [2023-12-26 05:20:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000715040_183050240.pth [2023-12-26 05:20:38,889][123090] Updated weights for policy 1, policy_version 716104 (0.0011) [2023-12-26 05:20:38,957][123090] Updated weights for policy 1, policy_version 716114 (0.0011) [2023-12-26 05:20:39,029][123090] Updated weights for policy 1, policy_version 716124 (0.0011) [2023-12-26 05:20:39,226][123091] Updated weights for policy 0, policy_version 720471 (0.0010) [2023-12-26 05:20:39,290][123091] Updated weights for policy 0, policy_version 720481 (0.0011) [2023-12-26 05:20:39,356][123091] Updated weights for policy 0, policy_version 720491 (0.0010) [2023-12-26 05:20:39,848][123090] Updated weights for policy 1, policy_version 716134 (0.0010) [2023-12-26 05:20:39,921][123090] Updated weights for policy 1, policy_version 716144 (0.0008) [2023-12-26 05:20:39,987][123090] Updated weights for policy 1, policy_version 716154 (0.0008) [2023-12-26 05:20:40,260][123091] Updated weights for policy 0, policy_version 720501 (0.0009) [2023-12-26 05:20:40,325][123091] Updated weights for policy 0, policy_version 720511 (0.0010) [2023-12-26 05:20:40,396][123091] Updated weights for policy 0, policy_version 720521 (0.0010) [2023-12-26 05:20:40,771][123090] Updated weights for policy 1, policy_version 716164 (0.0007) [2023-12-26 05:20:40,843][123090] Updated weights for policy 1, policy_version 716174 (0.0010) [2023-12-26 05:20:40,916][123090] Updated weights for policy 1, policy_version 716184 (0.0010) [2023-12-26 05:20:41,318][123091] Updated weights for policy 0, policy_version 720531 (0.0009) [2023-12-26 05:20:41,389][123091] Updated weights for policy 0, policy_version 720541 (0.0009) [2023-12-26 05:20:41,455][123091] Updated weights for policy 0, policy_version 720551 (0.0009) [2023-12-26 05:20:41,732][123090] Updated weights for policy 1, policy_version 716194 (0.0010) [2023-12-26 05:20:41,797][123090] Updated weights for policy 1, policy_version 716204 (0.0010) [2023-12-26 05:20:41,861][123090] Updated weights for policy 1, policy_version 716214 (0.0011) [2023-12-26 05:20:41,932][123090] Updated weights for policy 1, policy_version 716224 (0.0011) [2023-12-26 05:20:42,351][123091] Updated weights for policy 0, policy_version 720561 (0.0009) [2023-12-26 05:20:42,419][123091] Updated weights for policy 0, policy_version 720571 (0.0007) [2023-12-26 05:20:42,484][123091] Updated weights for policy 0, policy_version 720581 (0.0009) [2023-12-26 05:20:42,543][123091] Updated weights for policy 0, policy_version 720591 (0.0009) [2023-12-26 05:20:42,676][123090] Updated weights for policy 1, policy_version 716234 (0.0005) [2023-12-26 05:20:42,754][123090] Updated weights for policy 1, policy_version 716244 (0.0006) [2023-12-26 05:20:42,820][123090] Updated weights for policy 1, policy_version 716254 (0.0006) [2023-12-26 05:20:43,324][123090] Updated weights for policy 1, policy_version 716264 (0.0005) [2023-12-26 05:20:43,375][123091] Updated weights for policy 0, policy_version 720601 (0.0005) [2023-12-26 05:20:43,377][123090] Updated weights for policy 1, policy_version 716274 (0.0005) [2023-12-26 05:20:43,422][123091] Updated weights for policy 0, policy_version 720611 (0.0006) [2023-12-26 05:20:43,429][123090] Updated weights for policy 1, policy_version 716284 (0.0006) [2023-12-26 05:20:43,470][123091] Updated weights for policy 0, policy_version 720621 (0.0008) [2023-12-26 05:20:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 367853568. Throughput: 0: 8745.9, 1: 8973.2. Samples: 367843380. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:43,785][121949] Avg episode reward: [(0, '6119.103'), (1, '5378.712')] [2023-12-26 05:20:44,267][123090] Updated weights for policy 1, policy_version 716294 (0.0010) [2023-12-26 05:20:44,296][123091] Updated weights for policy 0, policy_version 720631 (0.0006) [2023-12-26 05:20:44,334][123090] Updated weights for policy 1, policy_version 716304 (0.0011) [2023-12-26 05:20:44,352][123091] Updated weights for policy 0, policy_version 720641 (0.0007) [2023-12-26 05:20:44,398][123090] Updated weights for policy 1, policy_version 716314 (0.0011) [2023-12-26 05:20:44,406][123091] Updated weights for policy 0, policy_version 720651 (0.0006) [2023-12-26 05:20:45,126][123090] Updated weights for policy 1, policy_version 716324 (0.0011) [2023-12-26 05:20:45,187][123090] Updated weights for policy 1, policy_version 716334 (0.0010) [2023-12-26 05:20:45,251][123090] Updated weights for policy 1, policy_version 716344 (0.0010) [2023-12-26 05:20:45,266][123091] Updated weights for policy 0, policy_version 720661 (0.0006) [2023-12-26 05:20:45,338][123091] Updated weights for policy 0, policy_version 720671 (0.0006) [2023-12-26 05:20:45,415][123091] Updated weights for policy 0, policy_version 720681 (0.0007) [2023-12-26 05:20:46,057][123091] Updated weights for policy 0, policy_version 720691 (0.0007) [2023-12-26 05:20:46,073][123090] Updated weights for policy 1, policy_version 716354 (0.0009) [2023-12-26 05:20:46,109][123091] Updated weights for policy 0, policy_version 720701 (0.0011) [2023-12-26 05:20:46,133][123090] Updated weights for policy 1, policy_version 716364 (0.0006) [2023-12-26 05:20:46,173][123091] Updated weights for policy 0, policy_version 720711 (0.0011) [2023-12-26 05:20:46,182][123090] Updated weights for policy 1, policy_version 716374 (0.0009) [2023-12-26 05:20:46,242][123090] Updated weights for policy 1, policy_version 716384 (0.0008) [2023-12-26 05:20:46,939][123091] Updated weights for policy 0, policy_version 720721 (0.0010) [2023-12-26 05:20:46,994][123091] Updated weights for policy 0, policy_version 720731 (0.0008) [2023-12-26 05:20:47,053][123090] Updated weights for policy 1, policy_version 716394 (0.0008) [2023-12-26 05:20:47,056][123091] Updated weights for policy 0, policy_version 720741 (0.0007) [2023-12-26 05:20:47,111][123090] Updated weights for policy 1, policy_version 716404 (0.0009) [2023-12-26 05:20:47,120][123091] Updated weights for policy 0, policy_version 720751 (0.0007) [2023-12-26 05:20:47,171][123090] Updated weights for policy 1, policy_version 716414 (0.0009) [2023-12-26 05:20:47,769][123091] Updated weights for policy 0, policy_version 720761 (0.0006) [2023-12-26 05:20:47,830][123091] Updated weights for policy 0, policy_version 720771 (0.0005) [2023-12-26 05:20:47,892][123091] Updated weights for policy 0, policy_version 720781 (0.0005) [2023-12-26 05:20:47,970][123090] Updated weights for policy 1, policy_version 716424 (0.0007) [2023-12-26 05:20:48,029][123090] Updated weights for policy 1, policy_version 716434 (0.0005) [2023-12-26 05:20:48,091][123090] Updated weights for policy 1, policy_version 716444 (0.0006) [2023-12-26 05:20:48,533][123091] Updated weights for policy 0, policy_version 720791 (0.0006) [2023-12-26 05:20:48,591][123091] Updated weights for policy 0, policy_version 720801 (0.0006) [2023-12-26 05:20:48,647][123091] Updated weights for policy 0, policy_version 720811 (0.0005) [2023-12-26 05:20:48,773][123090] Updated weights for policy 1, policy_version 716454 (0.0009) [2023-12-26 05:20:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 367943680. Throughput: 0: 8795.5, 1: 9072.1. Samples: 367955160. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:48,784][121949] Avg episode reward: [(0, '6122.329'), (1, '5376.569')] [2023-12-26 05:20:48,841][123090] Updated weights for policy 1, policy_version 716464 (0.0011) [2023-12-26 05:20:48,912][123090] Updated weights for policy 1, policy_version 716474 (0.0011) [2023-12-26 05:20:49,453][123091] Updated weights for policy 0, policy_version 720821 (0.0008) [2023-12-26 05:20:49,523][123091] Updated weights for policy 0, policy_version 720831 (0.0011) [2023-12-26 05:20:49,590][123091] Updated weights for policy 0, policy_version 720841 (0.0011) [2023-12-26 05:20:49,664][123090] Updated weights for policy 1, policy_version 716484 (0.0008) [2023-12-26 05:20:49,712][123090] Updated weights for policy 1, policy_version 716494 (0.0005) [2023-12-26 05:20:49,768][123090] Updated weights for policy 1, policy_version 716504 (0.0005) [2023-12-26 05:20:50,368][123091] Updated weights for policy 0, policy_version 720851 (0.0009) [2023-12-26 05:20:50,437][123091] Updated weights for policy 0, policy_version 720861 (0.0006) [2023-12-26 05:20:50,502][123091] Updated weights for policy 0, policy_version 720871 (0.0009) [2023-12-26 05:20:50,593][123090] Updated weights for policy 1, policy_version 716514 (0.0007) [2023-12-26 05:20:50,665][123090] Updated weights for policy 1, policy_version 716524 (0.0009) [2023-12-26 05:20:50,733][123090] Updated weights for policy 1, policy_version 716534 (0.0009) [2023-12-26 05:20:50,785][123090] Updated weights for policy 1, policy_version 716544 (0.0009) [2023-12-26 05:20:51,267][123091] Updated weights for policy 0, policy_version 720881 (0.0010) [2023-12-26 05:20:51,335][123091] Updated weights for policy 0, policy_version 720891 (0.0009) [2023-12-26 05:20:51,408][123091] Updated weights for policy 0, policy_version 720901 (0.0009) [2023-12-26 05:20:51,470][123091] Updated weights for policy 0, policy_version 720911 (0.0008) [2023-12-26 05:20:51,667][123090] Updated weights for policy 1, policy_version 716554 (0.0009) [2023-12-26 05:20:51,739][123090] Updated weights for policy 1, policy_version 716564 (0.0009) [2023-12-26 05:20:51,811][123090] Updated weights for policy 1, policy_version 716574 (0.0010) [2023-12-26 05:20:52,167][123091] Updated weights for policy 0, policy_version 720921 (0.0007) [2023-12-26 05:20:52,230][123091] Updated weights for policy 0, policy_version 720931 (0.0011) [2023-12-26 05:20:52,297][123091] Updated weights for policy 0, policy_version 720941 (0.0011) [2023-12-26 05:20:52,635][123090] Updated weights for policy 1, policy_version 716584 (0.0008) [2023-12-26 05:20:52,696][123090] Updated weights for policy 1, policy_version 716594 (0.0009) [2023-12-26 05:20:52,760][123090] Updated weights for policy 1, policy_version 716604 (0.0009) [2023-12-26 05:20:53,083][123091] Updated weights for policy 0, policy_version 720951 (0.0011) [2023-12-26 05:20:53,145][123091] Updated weights for policy 0, policy_version 720961 (0.0011) [2023-12-26 05:20:53,219][123091] Updated weights for policy 0, policy_version 720971 (0.0011) [2023-12-26 05:20:53,500][123090] Updated weights for policy 1, policy_version 716614 (0.0008) [2023-12-26 05:20:53,551][123090] Updated weights for policy 1, policy_version 716624 (0.0010) [2023-12-26 05:20:53,610][123090] Updated weights for policy 1, policy_version 716634 (0.0010) [2023-12-26 05:20:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 368033792. Throughput: 0: 8738.8, 1: 9006.7. Samples: 368007308. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:53,785][121949] Avg episode reward: [(0, '6144.319'), (1, '5170.430')] [2023-12-26 05:20:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000716640_183459840.pth... [2023-12-26 05:20:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000720976_184573952.pth... [2023-12-26 05:20:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000715584_183189504.pth [2023-12-26 05:20:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000719952_184311808.pth [2023-12-26 05:20:54,008][123091] Updated weights for policy 0, policy_version 720981 (0.0010) [2023-12-26 05:20:54,067][123091] Updated weights for policy 0, policy_version 720991 (0.0010) [2023-12-26 05:20:54,125][123091] Updated weights for policy 0, policy_version 721001 (0.0010) [2023-12-26 05:20:54,334][123090] Updated weights for policy 1, policy_version 716644 (0.0007) [2023-12-26 05:20:54,394][123090] Updated weights for policy 1, policy_version 716654 (0.0011) [2023-12-26 05:20:54,460][123090] Updated weights for policy 1, policy_version 716664 (0.0010) [2023-12-26 05:20:54,902][123091] Updated weights for policy 0, policy_version 721011 (0.0009) [2023-12-26 05:20:54,954][123091] Updated weights for policy 0, policy_version 721021 (0.0006) [2023-12-26 05:20:55,018][123091] Updated weights for policy 0, policy_version 721031 (0.0007) [2023-12-26 05:20:55,297][123090] Updated weights for policy 1, policy_version 716674 (0.0011) [2023-12-26 05:20:55,344][123090] Updated weights for policy 1, policy_version 716684 (0.0010) [2023-12-26 05:20:55,395][123090] Updated weights for policy 1, policy_version 716694 (0.0010) [2023-12-26 05:20:55,447][123090] Updated weights for policy 1, policy_version 716704 (0.0010) [2023-12-26 05:20:55,807][123091] Updated weights for policy 0, policy_version 721041 (0.0010) [2023-12-26 05:20:55,859][123091] Updated weights for policy 0, policy_version 721051 (0.0005) [2023-12-26 05:20:55,910][123091] Updated weights for policy 0, policy_version 721061 (0.0005) [2023-12-26 05:20:55,979][123091] Updated weights for policy 0, policy_version 721071 (0.0005) [2023-12-26 05:20:56,246][123090] Updated weights for policy 1, policy_version 716714 (0.0008) [2023-12-26 05:20:56,299][123090] Updated weights for policy 1, policy_version 716724 (0.0010) [2023-12-26 05:20:56,352][123090] Updated weights for policy 1, policy_version 716735 (0.0010) [2023-12-26 05:20:56,572][123091] Updated weights for policy 0, policy_version 721081 (0.0005) [2023-12-26 05:20:56,631][123091] Updated weights for policy 0, policy_version 721091 (0.0005) [2023-12-26 05:20:56,695][123091] Updated weights for policy 0, policy_version 721101 (0.0005) [2023-12-26 05:20:57,230][123090] Updated weights for policy 1, policy_version 716745 (0.0010) [2023-12-26 05:20:57,284][123090] Updated weights for policy 1, policy_version 716755 (0.0010) [2023-12-26 05:20:57,333][123090] Updated weights for policy 1, policy_version 716765 (0.0010) [2023-12-26 05:20:57,379][123091] Updated weights for policy 0, policy_version 721111 (0.0007) [2023-12-26 05:20:57,433][123091] Updated weights for policy 0, policy_version 721121 (0.0008) [2023-12-26 05:20:57,481][123091] Updated weights for policy 0, policy_version 721131 (0.0009) [2023-12-26 05:20:58,177][123090] Updated weights for policy 1, policy_version 716775 (0.0010) [2023-12-26 05:20:58,234][123090] Updated weights for policy 1, policy_version 716785 (0.0010) [2023-12-26 05:20:58,298][123090] Updated weights for policy 1, policy_version 716795 (0.0010) [2023-12-26 05:20:58,344][123091] Updated weights for policy 0, policy_version 721141 (0.0009) [2023-12-26 05:20:58,412][123091] Updated weights for policy 0, policy_version 721151 (0.0009) [2023-12-26 05:20:58,469][123091] Updated weights for policy 0, policy_version 721161 (0.0010) [2023-12-26 05:20:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 368123904. Throughput: 0: 8898.8, 1: 9008.7. Samples: 368116484. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:20:58,785][121949] Avg episode reward: [(0, '6156.078'), (1, '5066.362')] [2023-12-26 05:20:59,202][123090] Updated weights for policy 1, policy_version 716805 (0.0010) [2023-12-26 05:20:59,266][123090] Updated weights for policy 1, policy_version 716815 (0.0010) [2023-12-26 05:20:59,332][123090] Updated weights for policy 1, policy_version 716825 (0.0008) [2023-12-26 05:20:59,371][123091] Updated weights for policy 0, policy_version 721171 (0.0009) [2023-12-26 05:20:59,437][123091] Updated weights for policy 0, policy_version 721181 (0.0006) [2023-12-26 05:20:59,501][123091] Updated weights for policy 0, policy_version 721191 (0.0009) [2023-12-26 05:21:00,133][123090] Updated weights for policy 1, policy_version 716835 (0.0010) [2023-12-26 05:21:00,189][123090] Updated weights for policy 1, policy_version 716845 (0.0010) [2023-12-26 05:21:00,244][123090] Updated weights for policy 1, policy_version 716855 (0.0010) [2023-12-26 05:21:00,325][123091] Updated weights for policy 0, policy_version 721201 (0.0009) [2023-12-26 05:21:00,392][123091] Updated weights for policy 0, policy_version 721211 (0.0009) [2023-12-26 05:21:00,440][123091] Updated weights for policy 0, policy_version 721221 (0.0009) [2023-12-26 05:21:00,491][123091] Updated weights for policy 0, policy_version 721231 (0.0008) [2023-12-26 05:21:01,105][123090] Updated weights for policy 1, policy_version 716865 (0.0010) [2023-12-26 05:21:01,170][123090] Updated weights for policy 1, policy_version 716875 (0.0009) [2023-12-26 05:21:01,210][123091] Updated weights for policy 0, policy_version 721241 (0.0006) [2023-12-26 05:21:01,229][123090] Updated weights for policy 1, policy_version 716885 (0.0010) [2023-12-26 05:21:01,274][123091] Updated weights for policy 0, policy_version 721251 (0.0007) [2023-12-26 05:21:01,292][123090] Updated weights for policy 1, policy_version 716895 (0.0011) [2023-12-26 05:21:01,328][123091] Updated weights for policy 0, policy_version 721261 (0.0006) [2023-12-26 05:21:02,010][123090] Updated weights for policy 1, policy_version 716905 (0.0010) [2023-12-26 05:21:02,064][123091] Updated weights for policy 0, policy_version 721271 (0.0006) [2023-12-26 05:21:02,077][123090] Updated weights for policy 1, policy_version 716915 (0.0007) [2023-12-26 05:21:02,136][123091] Updated weights for policy 0, policy_version 721281 (0.0005) [2023-12-26 05:21:02,148][123090] Updated weights for policy 1, policy_version 716925 (0.0006) [2023-12-26 05:21:02,204][123091] Updated weights for policy 0, policy_version 721291 (0.0005) [2023-12-26 05:21:02,849][123091] Updated weights for policy 0, policy_version 721301 (0.0007) [2023-12-26 05:21:02,875][123090] Updated weights for policy 1, policy_version 716935 (0.0007) [2023-12-26 05:21:02,896][123091] Updated weights for policy 0, policy_version 721311 (0.0005) [2023-12-26 05:21:02,923][123090] Updated weights for policy 1, policy_version 716945 (0.0008) [2023-12-26 05:21:02,953][123091] Updated weights for policy 0, policy_version 721321 (0.0006) [2023-12-26 05:21:02,982][123090] Updated weights for policy 1, policy_version 716955 (0.0008) [2023-12-26 05:21:03,638][123091] Updated weights for policy 0, policy_version 721331 (0.0006) [2023-12-26 05:21:03,658][123090] Updated weights for policy 1, policy_version 716965 (0.0005) [2023-12-26 05:21:03,704][123091] Updated weights for policy 0, policy_version 721341 (0.0008) [2023-12-26 05:21:03,711][123090] Updated weights for policy 1, policy_version 716975 (0.0005) [2023-12-26 05:21:03,760][123090] Updated weights for policy 1, policy_version 716985 (0.0006) [2023-12-26 05:21:03,768][123091] Updated weights for policy 0, policy_version 721351 (0.0008) [2023-12-26 05:21:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 368205824. Throughput: 0: 8993.8, 1: 9007.7. Samples: 368224952. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:21:03,785][121949] Avg episode reward: [(0, '6180.419'), (1, '5196.054')] [2023-12-26 05:21:04,529][123091] Updated weights for policy 0, policy_version 721361 (0.0009) [2023-12-26 05:21:04,570][123090] Updated weights for policy 1, policy_version 716995 (0.0006) [2023-12-26 05:21:04,590][123091] Updated weights for policy 0, policy_version 721371 (0.0010) [2023-12-26 05:21:04,636][123090] Updated weights for policy 1, policy_version 717005 (0.0008) [2023-12-26 05:21:04,658][123091] Updated weights for policy 0, policy_version 721381 (0.0010) [2023-12-26 05:21:04,690][123090] Updated weights for policy 1, policy_version 717015 (0.0009) [2023-12-26 05:21:04,722][123091] Updated weights for policy 0, policy_version 721391 (0.0011) [2023-12-26 05:21:05,419][123090] Updated weights for policy 1, policy_version 717025 (0.0010) [2023-12-26 05:21:05,441][123091] Updated weights for policy 0, policy_version 721401 (0.0010) [2023-12-26 05:21:05,474][123090] Updated weights for policy 1, policy_version 717035 (0.0007) [2023-12-26 05:21:05,500][123091] Updated weights for policy 0, policy_version 721411 (0.0010) [2023-12-26 05:21:05,533][123090] Updated weights for policy 1, policy_version 717045 (0.0006) [2023-12-26 05:21:05,563][123091] Updated weights for policy 0, policy_version 721421 (0.0010) [2023-12-26 05:21:05,591][123090] Updated weights for policy 1, policy_version 717055 (0.0008) [2023-12-26 05:21:06,381][123090] Updated weights for policy 1, policy_version 717065 (0.0007) [2023-12-26 05:21:06,400][123091] Updated weights for policy 0, policy_version 721431 (0.0008) [2023-12-26 05:21:06,449][123090] Updated weights for policy 1, policy_version 717075 (0.0007) [2023-12-26 05:21:06,466][123091] Updated weights for policy 0, policy_version 721441 (0.0008) [2023-12-26 05:21:06,512][123090] Updated weights for policy 1, policy_version 717085 (0.0007) [2023-12-26 05:21:06,534][123091] Updated weights for policy 0, policy_version 721451 (0.0011) [2023-12-26 05:21:07,318][123090] Updated weights for policy 1, policy_version 717095 (0.0009) [2023-12-26 05:21:07,365][123091] Updated weights for policy 0, policy_version 721461 (0.0011) [2023-12-26 05:21:07,381][123090] Updated weights for policy 1, policy_version 717105 (0.0009) [2023-12-26 05:21:07,428][123091] Updated weights for policy 0, policy_version 721471 (0.0010) [2023-12-26 05:21:07,430][123090] Updated weights for policy 1, policy_version 717115 (0.0009) [2023-12-26 05:21:07,486][123091] Updated weights for policy 0, policy_version 721481 (0.0008) [2023-12-26 05:21:08,201][123091] Updated weights for policy 0, policy_version 721491 (0.0007) [2023-12-26 05:21:08,261][123091] Updated weights for policy 0, policy_version 721501 (0.0010) [2023-12-26 05:21:08,312][123091] Updated weights for policy 0, policy_version 721511 (0.0008) [2023-12-26 05:21:08,313][123090] Updated weights for policy 1, policy_version 717125 (0.0008) [2023-12-26 05:21:08,375][123090] Updated weights for policy 1, policy_version 717135 (0.0009) [2023-12-26 05:21:08,438][123090] Updated weights for policy 1, policy_version 717145 (0.0006) [2023-12-26 05:21:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 368304128. Throughput: 0: 8993.7, 1: 9045.6. Samples: 368278724. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 05:21:08,785][121949] Avg episode reward: [(0, '6221.577'), (1, '5390.156')] [2023-12-26 05:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000717152_183590912.pth... [2023-12-26 05:21:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000721520_184713216.pth... [2023-12-26 05:21:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000716096_183320576.pth [2023-12-26 05:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000720464_184442880.pth [2023-12-26 05:21:09,050][123090] Updated weights for policy 1, policy_version 717155 (0.0006) [2023-12-26 05:21:09,111][123090] Updated weights for policy 1, policy_version 717165 (0.0008) [2023-12-26 05:21:09,177][123090] Updated weights for policy 1, policy_version 717175 (0.0009) [2023-12-26 05:21:09,184][123091] Updated weights for policy 0, policy_version 721521 (0.0009) [2023-12-26 05:21:09,239][123091] Updated weights for policy 0, policy_version 721531 (0.0008) [2023-12-26 05:21:09,301][123091] Updated weights for policy 0, policy_version 721541 (0.0008) [2023-12-26 05:21:09,366][123091] Updated weights for policy 0, policy_version 721551 (0.0007) [2023-12-26 05:21:10,011][123090] Updated weights for policy 1, policy_version 717185 (0.0010) [2023-12-26 05:21:10,077][123090] Updated weights for policy 1, policy_version 717195 (0.0008) [2023-12-26 05:21:10,138][123090] Updated weights for policy 1, policy_version 717205 (0.0010) [2023-12-26 05:21:10,204][123090] Updated weights for policy 1, policy_version 717215 (0.0010) [2023-12-26 05:21:10,216][123091] Updated weights for policy 0, policy_version 721561 (0.0009) [2023-12-26 05:21:10,279][123091] Updated weights for policy 0, policy_version 721571 (0.0010) [2023-12-26 05:21:10,347][123091] Updated weights for policy 0, policy_version 721581 (0.0009) [2023-12-26 05:21:11,085][123091] Updated weights for policy 0, policy_version 721591 (0.0009) [2023-12-26 05:21:11,096][123090] Updated weights for policy 1, policy_version 717225 (0.0008) [2023-12-26 05:21:11,153][123091] Updated weights for policy 0, policy_version 721601 (0.0010) [2023-12-26 05:21:11,162][123090] Updated weights for policy 1, policy_version 717235 (0.0007) [2023-12-26 05:21:11,223][123091] Updated weights for policy 0, policy_version 721611 (0.0011) [2023-12-26 05:21:11,230][123090] Updated weights for policy 1, policy_version 717245 (0.0008) [2023-12-26 05:21:12,121][123091] Updated weights for policy 0, policy_version 721621 (0.0011) [2023-12-26 05:21:12,137][123090] Updated weights for policy 1, policy_version 717255 (0.0006) [2023-12-26 05:21:12,180][123091] Updated weights for policy 0, policy_version 721631 (0.0011) [2023-12-26 05:21:12,201][123090] Updated weights for policy 1, policy_version 717265 (0.0008) [2023-12-26 05:21:12,244][123091] Updated weights for policy 0, policy_version 721641 (0.0011) [2023-12-26 05:21:12,268][123090] Updated weights for policy 1, policy_version 717275 (0.0008) [2023-12-26 05:21:13,077][123091] Updated weights for policy 0, policy_version 721651 (0.0011) [2023-12-26 05:21:13,101][123090] Updated weights for policy 1, policy_version 717285 (0.0007) [2023-12-26 05:21:13,147][123091] Updated weights for policy 0, policy_version 721661 (0.0010) [2023-12-26 05:21:13,160][123090] Updated weights for policy 1, policy_version 717295 (0.0008) [2023-12-26 05:21:13,206][123091] Updated weights for policy 0, policy_version 721671 (0.0010) [2023-12-26 05:21:13,218][123090] Updated weights for policy 1, policy_version 717305 (0.0009) [2023-12-26 05:21:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 368386048. Throughput: 0: 8936.0, 1: 9027.6. Samples: 368381328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:13,785][121949] Avg episode reward: [(0, '6269.609'), (1, '5474.451')] [2023-12-26 05:21:14,013][123090] Updated weights for policy 1, policy_version 717315 (0.0006) [2023-12-26 05:21:14,016][123091] Updated weights for policy 0, policy_version 721681 (0.0010) [2023-12-26 05:21:14,075][123091] Updated weights for policy 0, policy_version 721691 (0.0010) [2023-12-26 05:21:14,081][123090] Updated weights for policy 1, policy_version 717325 (0.0005) [2023-12-26 05:21:14,134][123091] Updated weights for policy 0, policy_version 721701 (0.0010) [2023-12-26 05:21:14,151][123090] Updated weights for policy 1, policy_version 717335 (0.0005) [2023-12-26 05:21:14,193][123091] Updated weights for policy 0, policy_version 721711 (0.0010) [2023-12-26 05:21:14,782][123090] Updated weights for policy 1, policy_version 717345 (0.0006) [2023-12-26 05:21:14,850][123090] Updated weights for policy 1, policy_version 717355 (0.0011) [2023-12-26 05:21:14,914][123090] Updated weights for policy 1, policy_version 717365 (0.0011) [2023-12-26 05:21:14,978][123090] Updated weights for policy 1, policy_version 717375 (0.0011) [2023-12-26 05:21:15,012][123091] Updated weights for policy 0, policy_version 721721 (0.0009) [2023-12-26 05:21:15,066][123091] Updated weights for policy 0, policy_version 721731 (0.0008) [2023-12-26 05:21:15,126][123091] Updated weights for policy 0, policy_version 721741 (0.0008) [2023-12-26 05:21:15,823][123090] Updated weights for policy 1, policy_version 717385 (0.0010) [2023-12-26 05:21:15,884][123091] Updated weights for policy 0, policy_version 721751 (0.0006) [2023-12-26 05:21:15,889][123090] Updated weights for policy 1, policy_version 717395 (0.0010) [2023-12-26 05:21:15,941][123090] Updated weights for policy 1, policy_version 717405 (0.0008) [2023-12-26 05:21:15,946][123091] Updated weights for policy 0, policy_version 721761 (0.0005) [2023-12-26 05:21:16,004][123091] Updated weights for policy 0, policy_version 721771 (0.0005) [2023-12-26 05:21:16,610][123091] Updated weights for policy 0, policy_version 721781 (0.0008) [2023-12-26 05:21:16,672][123091] Updated weights for policy 0, policy_version 721791 (0.0011) [2023-12-26 05:21:16,676][123090] Updated weights for policy 1, policy_version 717415 (0.0009) [2023-12-26 05:21:16,724][123091] Updated weights for policy 0, policy_version 721801 (0.0010) [2023-12-26 05:21:16,728][123090] Updated weights for policy 1, policy_version 717425 (0.0010) [2023-12-26 05:21:16,779][123090] Updated weights for policy 1, policy_version 717435 (0.0010) [2023-12-26 05:21:17,439][123091] Updated weights for policy 0, policy_version 721811 (0.0009) [2023-12-26 05:21:17,503][123091] Updated weights for policy 0, policy_version 721821 (0.0005) [2023-12-26 05:21:17,573][123091] Updated weights for policy 0, policy_version 721831 (0.0005) [2023-12-26 05:21:17,612][123090] Updated weights for policy 1, policy_version 717445 (0.0010) [2023-12-26 05:21:17,683][123090] Updated weights for policy 1, policy_version 717455 (0.0011) [2023-12-26 05:21:17,754][123090] Updated weights for policy 1, policy_version 717465 (0.0011) [2023-12-26 05:21:18,333][123091] Updated weights for policy 0, policy_version 721841 (0.0006) [2023-12-26 05:21:18,406][123091] Updated weights for policy 0, policy_version 721851 (0.0009) [2023-12-26 05:21:18,470][123091] Updated weights for policy 0, policy_version 721861 (0.0011) [2023-12-26 05:21:18,540][123091] Updated weights for policy 0, policy_version 721871 (0.0009) [2023-12-26 05:21:18,554][123090] Updated weights for policy 1, policy_version 717475 (0.0010) [2023-12-26 05:21:18,618][123090] Updated weights for policy 1, policy_version 717485 (0.0011) [2023-12-26 05:21:18,681][123090] Updated weights for policy 1, policy_version 717495 (0.0010) [2023-12-26 05:21:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 368484352. Throughput: 0: 8960.7, 1: 8894.6. Samples: 368490344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:18,785][121949] Avg episode reward: [(0, '6222.549'), (1, '5681.341')] [2023-12-26 05:21:19,244][123091] Updated weights for policy 0, policy_version 721881 (0.0010) [2023-12-26 05:21:19,296][123091] Updated weights for policy 0, policy_version 721891 (0.0011) [2023-12-26 05:21:19,361][123091] Updated weights for policy 0, policy_version 721901 (0.0008) [2023-12-26 05:21:19,493][123090] Updated weights for policy 1, policy_version 717505 (0.0010) [2023-12-26 05:21:19,554][123090] Updated weights for policy 1, policy_version 717515 (0.0008) [2023-12-26 05:21:19,615][123090] Updated weights for policy 1, policy_version 717525 (0.0009) [2023-12-26 05:21:19,678][123090] Updated weights for policy 1, policy_version 717535 (0.0009) [2023-12-26 05:21:20,202][123091] Updated weights for policy 0, policy_version 721911 (0.0010) [2023-12-26 05:21:20,258][123091] Updated weights for policy 0, policy_version 721921 (0.0011) [2023-12-26 05:21:20,318][123091] Updated weights for policy 0, policy_version 721931 (0.0010) [2023-12-26 05:21:20,498][123090] Updated weights for policy 1, policy_version 717545 (0.0006) [2023-12-26 05:21:20,562][123090] Updated weights for policy 1, policy_version 717555 (0.0009) [2023-12-26 05:21:20,622][123090] Updated weights for policy 1, policy_version 717565 (0.0009) [2023-12-26 05:21:21,177][123091] Updated weights for policy 0, policy_version 721941 (0.0011) [2023-12-26 05:21:21,230][123091] Updated weights for policy 0, policy_version 721951 (0.0011) [2023-12-26 05:21:21,283][123091] Updated weights for policy 0, policy_version 721961 (0.0011) [2023-12-26 05:21:21,452][123090] Updated weights for policy 1, policy_version 717575 (0.0006) [2023-12-26 05:21:21,526][123090] Updated weights for policy 1, policy_version 717585 (0.0007) [2023-12-26 05:21:21,587][123090] Updated weights for policy 1, policy_version 717595 (0.0009) [2023-12-26 05:21:22,139][123091] Updated weights for policy 0, policy_version 721971 (0.0011) [2023-12-26 05:21:22,201][123091] Updated weights for policy 0, policy_version 721981 (0.0010) [2023-12-26 05:21:22,267][123091] Updated weights for policy 0, policy_version 721991 (0.0011) [2023-12-26 05:21:22,324][123090] Updated weights for policy 1, policy_version 717605 (0.0007) [2023-12-26 05:21:22,392][123090] Updated weights for policy 1, policy_version 717615 (0.0010) [2023-12-26 05:21:22,442][123090] Updated weights for policy 1, policy_version 717625 (0.0006) [2023-12-26 05:21:23,087][123091] Updated weights for policy 0, policy_version 722001 (0.0010) [2023-12-26 05:21:23,139][123091] Updated weights for policy 0, policy_version 722011 (0.0010) [2023-12-26 05:21:23,157][123090] Updated weights for policy 1, policy_version 717635 (0.0005) [2023-12-26 05:21:23,198][123091] Updated weights for policy 0, policy_version 722021 (0.0010) [2023-12-26 05:21:23,216][123090] Updated weights for policy 1, policy_version 717645 (0.0005) [2023-12-26 05:21:23,245][123091] Updated weights for policy 0, policy_version 722031 (0.0010) [2023-12-26 05:21:23,272][123090] Updated weights for policy 1, policy_version 717655 (0.0010) [2023-12-26 05:21:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 368566272. Throughput: 0: 8943.7, 1: 8812.1. Samples: 368541628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:23,785][121949] Avg episode reward: [(0, '6155.370'), (1, '5628.103')] [2023-12-26 05:21:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000717664_183721984.pth... [2023-12-26 05:21:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000722032_184844288.pth... [2023-12-26 05:21:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000716640_183459840.pth [2023-12-26 05:21:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000720976_184573952.pth [2023-12-26 05:21:24,059][123090] Updated weights for policy 1, policy_version 717665 (0.0009) [2023-12-26 05:21:24,084][123091] Updated weights for policy 0, policy_version 722041 (0.0010) [2023-12-26 05:21:24,122][123090] Updated weights for policy 1, policy_version 717675 (0.0010) [2023-12-26 05:21:24,139][123091] Updated weights for policy 0, policy_version 722051 (0.0010) [2023-12-26 05:21:24,174][123090] Updated weights for policy 1, policy_version 717685 (0.0010) [2023-12-26 05:21:24,197][123091] Updated weights for policy 0, policy_version 722061 (0.0010) [2023-12-26 05:21:24,237][123090] Updated weights for policy 1, policy_version 717695 (0.0010) [2023-12-26 05:21:24,960][123091] Updated weights for policy 0, policy_version 722071 (0.0007) [2023-12-26 05:21:25,031][123091] Updated weights for policy 0, policy_version 722081 (0.0009) [2023-12-26 05:21:25,073][123090] Updated weights for policy 1, policy_version 717705 (0.0010) [2023-12-26 05:21:25,100][123091] Updated weights for policy 0, policy_version 722091 (0.0006) [2023-12-26 05:21:25,139][123090] Updated weights for policy 1, policy_version 717715 (0.0010) [2023-12-26 05:21:25,190][123090] Updated weights for policy 1, policy_version 717725 (0.0010) [2023-12-26 05:21:25,815][123091] Updated weights for policy 0, policy_version 722101 (0.0007) [2023-12-26 05:21:25,866][123091] Updated weights for policy 0, policy_version 722111 (0.0009) [2023-12-26 05:21:25,923][123091] Updated weights for policy 0, policy_version 722121 (0.0009) [2023-12-26 05:21:26,048][123090] Updated weights for policy 1, policy_version 717735 (0.0010) [2023-12-26 05:21:26,123][123090] Updated weights for policy 1, policy_version 717745 (0.0011) [2023-12-26 05:21:26,194][123090] Updated weights for policy 1, policy_version 717755 (0.0011) [2023-12-26 05:21:26,690][123091] Updated weights for policy 0, policy_version 722131 (0.0008) [2023-12-26 05:21:26,734][123091] Updated weights for policy 0, policy_version 722141 (0.0005) [2023-12-26 05:21:26,781][123091] Updated weights for policy 0, policy_version 722151 (0.0005) [2023-12-26 05:21:27,001][123090] Updated weights for policy 1, policy_version 717765 (0.0010) [2023-12-26 05:21:27,049][123090] Updated weights for policy 1, policy_version 717775 (0.0010) [2023-12-26 05:21:27,096][123090] Updated weights for policy 1, policy_version 717785 (0.0010) [2023-12-26 05:21:27,450][123091] Updated weights for policy 0, policy_version 722161 (0.0005) [2023-12-26 05:21:27,512][123091] Updated weights for policy 0, policy_version 722171 (0.0005) [2023-12-26 05:21:27,583][123091] Updated weights for policy 0, policy_version 722181 (0.0005) [2023-12-26 05:21:27,646][123091] Updated weights for policy 0, policy_version 722191 (0.0005) [2023-12-26 05:21:27,952][123090] Updated weights for policy 1, policy_version 717795 (0.0010) [2023-12-26 05:21:28,011][123090] Updated weights for policy 1, policy_version 717805 (0.0010) [2023-12-26 05:21:28,078][123090] Updated weights for policy 1, policy_version 717815 (0.0010) [2023-12-26 05:21:28,361][123091] Updated weights for policy 0, policy_version 722201 (0.0009) [2023-12-26 05:21:28,417][123091] Updated weights for policy 0, policy_version 722211 (0.0009) [2023-12-26 05:21:28,486][123091] Updated weights for policy 0, policy_version 722221 (0.0010) [2023-12-26 05:21:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 368656384. Throughput: 0: 9097.3, 1: 8841.0. Samples: 368650604. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:28,785][121949] Avg episode reward: [(0, '6199.913'), (1, '5627.943')] [2023-12-26 05:21:28,794][123090] Updated weights for policy 1, policy_version 717825 (0.0010) [2023-12-26 05:21:28,859][123090] Updated weights for policy 1, policy_version 717835 (0.0006) [2023-12-26 05:21:28,915][123090] Updated weights for policy 1, policy_version 717845 (0.0005) [2023-12-26 05:21:28,981][123090] Updated weights for policy 1, policy_version 717855 (0.0005) [2023-12-26 05:21:29,353][123091] Updated weights for policy 0, policy_version 722231 (0.0010) [2023-12-26 05:21:29,422][123091] Updated weights for policy 0, policy_version 722241 (0.0010) [2023-12-26 05:21:29,482][123091] Updated weights for policy 0, policy_version 722251 (0.0009) [2023-12-26 05:21:29,697][123090] Updated weights for policy 1, policy_version 717865 (0.0009) [2023-12-26 05:21:29,756][123090] Updated weights for policy 1, policy_version 717875 (0.0009) [2023-12-26 05:21:29,804][123090] Updated weights for policy 1, policy_version 717885 (0.0009) [2023-12-26 05:21:30,329][123091] Updated weights for policy 0, policy_version 722261 (0.0010) [2023-12-26 05:21:30,388][123091] Updated weights for policy 0, policy_version 722271 (0.0009) [2023-12-26 05:21:30,454][123091] Updated weights for policy 0, policy_version 722281 (0.0009) [2023-12-26 05:21:30,635][123090] Updated weights for policy 1, policy_version 717895 (0.0007) [2023-12-26 05:21:30,702][123090] Updated weights for policy 1, policy_version 717905 (0.0008) [2023-12-26 05:21:30,762][123090] Updated weights for policy 1, policy_version 717915 (0.0009) [2023-12-26 05:21:31,281][123091] Updated weights for policy 0, policy_version 722291 (0.0008) [2023-12-26 05:21:31,359][123091] Updated weights for policy 0, policy_version 722301 (0.0008) [2023-12-26 05:21:31,422][123091] Updated weights for policy 0, policy_version 722311 (0.0006) [2023-12-26 05:21:31,568][123090] Updated weights for policy 1, policy_version 717925 (0.0006) [2023-12-26 05:21:31,624][123090] Updated weights for policy 1, policy_version 717935 (0.0008) [2023-12-26 05:21:31,688][123090] Updated weights for policy 1, policy_version 717945 (0.0010) [2023-12-26 05:21:32,085][123091] Updated weights for policy 0, policy_version 722321 (0.0006) [2023-12-26 05:21:32,142][123091] Updated weights for policy 0, policy_version 722331 (0.0010) [2023-12-26 05:21:32,205][123091] Updated weights for policy 0, policy_version 722341 (0.0007) [2023-12-26 05:21:32,276][123091] Updated weights for policy 0, policy_version 722351 (0.0007) [2023-12-26 05:21:32,404][123090] Updated weights for policy 1, policy_version 717955 (0.0008) [2023-12-26 05:21:32,475][123090] Updated weights for policy 1, policy_version 717965 (0.0005) [2023-12-26 05:21:32,540][123090] Updated weights for policy 1, policy_version 717975 (0.0009) [2023-12-26 05:21:33,034][123091] Updated weights for policy 0, policy_version 722361 (0.0009) [2023-12-26 05:21:33,093][123091] Updated weights for policy 0, policy_version 722371 (0.0009) [2023-12-26 05:21:33,146][123091] Updated weights for policy 0, policy_version 722381 (0.0009) [2023-12-26 05:21:33,341][123090] Updated weights for policy 1, policy_version 717985 (0.0009) [2023-12-26 05:21:33,410][123090] Updated weights for policy 1, policy_version 717995 (0.0010) [2023-12-26 05:21:33,471][123090] Updated weights for policy 1, policy_version 718005 (0.0010) [2023-12-26 05:21:33,528][123090] Updated weights for policy 1, policy_version 718015 (0.0010) [2023-12-26 05:21:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 368746496. Throughput: 0: 8997.4, 1: 8827.4. Samples: 368757276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:33,785][121949] Avg episode reward: [(0, '6201.867'), (1, '5582.449')] [2023-12-26 05:21:34,009][123091] Updated weights for policy 0, policy_version 722391 (0.0009) [2023-12-26 05:21:34,061][123091] Updated weights for policy 0, policy_version 722401 (0.0009) [2023-12-26 05:21:34,117][123091] Updated weights for policy 0, policy_version 722411 (0.0009) [2023-12-26 05:21:34,178][123090] Updated weights for policy 1, policy_version 718025 (0.0011) [2023-12-26 05:21:34,235][123090] Updated weights for policy 1, policy_version 718035 (0.0011) [2023-12-26 05:21:34,303][123090] Updated weights for policy 1, policy_version 718045 (0.0011) [2023-12-26 05:21:35,015][123090] Updated weights for policy 1, policy_version 718055 (0.0007) [2023-12-26 05:21:35,018][123091] Updated weights for policy 0, policy_version 722421 (0.0010) [2023-12-26 05:21:35,071][123091] Updated weights for policy 0, policy_version 722431 (0.0008) [2023-12-26 05:21:35,075][123090] Updated weights for policy 1, policy_version 718065 (0.0005) [2023-12-26 05:21:35,120][123091] Updated weights for policy 0, policy_version 722441 (0.0009) [2023-12-26 05:21:35,139][123090] Updated weights for policy 1, policy_version 718075 (0.0007) [2023-12-26 05:21:35,879][123090] Updated weights for policy 1, policy_version 718085 (0.0010) [2023-12-26 05:21:35,922][123090] Updated weights for policy 1, policy_version 718095 (0.0010) [2023-12-26 05:21:35,968][123091] Updated weights for policy 0, policy_version 722451 (0.0006) [2023-12-26 05:21:35,969][123090] Updated weights for policy 1, policy_version 718105 (0.0010) [2023-12-26 05:21:36,028][123091] Updated weights for policy 0, policy_version 722461 (0.0009) [2023-12-26 05:21:36,099][123091] Updated weights for policy 0, policy_version 722471 (0.0009) [2023-12-26 05:21:36,840][123090] Updated weights for policy 1, policy_version 718115 (0.0010) [2023-12-26 05:21:36,892][123090] Updated weights for policy 1, policy_version 718125 (0.0010) [2023-12-26 05:21:36,943][123090] Updated weights for policy 1, policy_version 718135 (0.0010) [2023-12-26 05:21:36,950][123091] Updated weights for policy 0, policy_version 722481 (0.0008) [2023-12-26 05:21:37,015][123091] Updated weights for policy 0, policy_version 722491 (0.0007) [2023-12-26 05:21:37,062][123091] Updated weights for policy 0, policy_version 722501 (0.0008) [2023-12-26 05:21:37,117][123091] Updated weights for policy 0, policy_version 722511 (0.0009) [2023-12-26 05:21:37,741][123090] Updated weights for policy 1, policy_version 718145 (0.0011) [2023-12-26 05:21:37,804][123090] Updated weights for policy 1, policy_version 718155 (0.0011) [2023-12-26 05:21:37,868][123090] Updated weights for policy 1, policy_version 718165 (0.0011) [2023-12-26 05:21:37,936][123090] Updated weights for policy 1, policy_version 718175 (0.0011) [2023-12-26 05:21:37,978][123091] Updated weights for policy 0, policy_version 722521 (0.0008) [2023-12-26 05:21:38,043][123091] Updated weights for policy 0, policy_version 722531 (0.0009) [2023-12-26 05:21:38,096][123091] Updated weights for policy 0, policy_version 722541 (0.0009) [2023-12-26 05:21:38,642][123090] Updated weights for policy 1, policy_version 718185 (0.0008) [2023-12-26 05:21:38,705][123090] Updated weights for policy 1, policy_version 718195 (0.0007) [2023-12-26 05:21:38,776][123090] Updated weights for policy 1, policy_version 718205 (0.0006) [2023-12-26 05:21:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 368828416. Throughput: 0: 8962.6, 1: 8869.4. Samples: 368809748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:38,785][121949] Avg episode reward: [(0, '6174.067'), (1, '5671.312')] [2023-12-26 05:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000722544_184975360.pth... [2023-12-26 05:21:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000721520_184713216.pth [2023-12-26 05:21:38,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000718208_183861248.pth... [2023-12-26 05:21:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000717152_183590912.pth [2023-12-26 05:21:38,981][123091] Updated weights for policy 0, policy_version 722551 (0.0009) [2023-12-26 05:21:39,038][123091] Updated weights for policy 0, policy_version 722561 (0.0009) [2023-12-26 05:21:39,097][123091] Updated weights for policy 0, policy_version 722571 (0.0009) [2023-12-26 05:21:39,540][123090] Updated weights for policy 1, policy_version 718215 (0.0008) [2023-12-26 05:21:39,608][123090] Updated weights for policy 1, policy_version 718225 (0.0008) [2023-12-26 05:21:39,675][123090] Updated weights for policy 1, policy_version 718235 (0.0010) [2023-12-26 05:21:40,022][123091] Updated weights for policy 0, policy_version 722581 (0.0010) [2023-12-26 05:21:40,084][123091] Updated weights for policy 0, policy_version 722591 (0.0009) [2023-12-26 05:21:40,146][123091] Updated weights for policy 0, policy_version 722601 (0.0010) [2023-12-26 05:21:40,546][123090] Updated weights for policy 1, policy_version 718245 (0.0009) [2023-12-26 05:21:40,603][123090] Updated weights for policy 1, policy_version 718255 (0.0005) [2023-12-26 05:21:40,671][123090] Updated weights for policy 1, policy_version 718265 (0.0006) [2023-12-26 05:21:40,978][123091] Updated weights for policy 0, policy_version 722611 (0.0009) [2023-12-26 05:21:41,049][123091] Updated weights for policy 0, policy_version 722621 (0.0010) [2023-12-26 05:21:41,104][123091] Updated weights for policy 0, policy_version 722631 (0.0010) [2023-12-26 05:21:41,516][123090] Updated weights for policy 1, policy_version 718275 (0.0009) [2023-12-26 05:21:41,582][123090] Updated weights for policy 1, policy_version 718285 (0.0010) [2023-12-26 05:21:41,656][123090] Updated weights for policy 1, policy_version 718295 (0.0009) [2023-12-26 05:21:41,990][123091] Updated weights for policy 0, policy_version 722641 (0.0009) [2023-12-26 05:21:42,045][123091] Updated weights for policy 0, policy_version 722652 (0.0010) [2023-12-26 05:21:42,099][123091] Updated weights for policy 0, policy_version 722662 (0.0010) [2023-12-26 05:21:42,447][123090] Updated weights for policy 1, policy_version 718305 (0.0010) [2023-12-26 05:21:42,514][123090] Updated weights for policy 1, policy_version 718315 (0.0006) [2023-12-26 05:21:42,571][123090] Updated weights for policy 1, policy_version 718325 (0.0006) [2023-12-26 05:21:42,637][123090] Updated weights for policy 1, policy_version 718335 (0.0006) [2023-12-26 05:21:43,052][123091] Updated weights for policy 0, policy_version 722673 (0.0011) [2023-12-26 05:21:43,107][123091] Updated weights for policy 0, policy_version 722683 (0.0010) [2023-12-26 05:21:43,161][123091] Updated weights for policy 0, policy_version 722693 (0.0009) [2023-12-26 05:21:43,212][123091] Updated weights for policy 0, policy_version 722703 (0.0009) [2023-12-26 05:21:43,344][123090] Updated weights for policy 1, policy_version 718345 (0.0008) [2023-12-26 05:21:43,392][123090] Updated weights for policy 1, policy_version 718355 (0.0009) [2023-12-26 05:21:43,441][123090] Updated weights for policy 1, policy_version 718365 (0.0009) [2023-12-26 05:21:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 368918528. Throughput: 0: 8785.9, 1: 8878.9. Samples: 368911400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:43,785][121949] Avg episode reward: [(0, '6207.866'), (1, '5647.357')] [2023-12-26 05:21:44,061][123091] Updated weights for policy 0, policy_version 722713 (0.0010) [2023-12-26 05:21:44,108][123091] Updated weights for policy 0, policy_version 722723 (0.0008) [2023-12-26 05:21:44,157][123091] Updated weights for policy 0, policy_version 722733 (0.0009) [2023-12-26 05:21:44,315][123090] Updated weights for policy 1, policy_version 718375 (0.0010) [2023-12-26 05:21:44,374][123090] Updated weights for policy 1, policy_version 718385 (0.0008) [2023-12-26 05:21:44,435][123090] Updated weights for policy 1, policy_version 718395 (0.0009) [2023-12-26 05:21:44,988][123091] Updated weights for policy 0, policy_version 722743 (0.0006) [2023-12-26 05:21:45,061][123091] Updated weights for policy 0, policy_version 722753 (0.0006) [2023-12-26 05:21:45,131][123091] Updated weights for policy 0, policy_version 722763 (0.0005) [2023-12-26 05:21:45,195][123090] Updated weights for policy 1, policy_version 718405 (0.0009) [2023-12-26 05:21:45,259][123090] Updated weights for policy 1, policy_version 718415 (0.0008) [2023-12-26 05:21:45,329][123090] Updated weights for policy 1, policy_version 718425 (0.0008) [2023-12-26 05:21:45,881][123091] Updated weights for policy 0, policy_version 722773 (0.0008) [2023-12-26 05:21:45,942][123091] Updated weights for policy 0, policy_version 722783 (0.0010) [2023-12-26 05:21:46,005][123091] Updated weights for policy 0, policy_version 722793 (0.0010) [2023-12-26 05:21:46,145][123090] Updated weights for policy 1, policy_version 718435 (0.0007) [2023-12-26 05:21:46,198][123090] Updated weights for policy 1, policy_version 718445 (0.0009) [2023-12-26 05:21:46,268][123090] Updated weights for policy 1, policy_version 718455 (0.0009) [2023-12-26 05:21:46,822][123091] Updated weights for policy 0, policy_version 722803 (0.0009) [2023-12-26 05:21:46,895][123091] Updated weights for policy 0, policy_version 722813 (0.0009) [2023-12-26 05:21:46,952][123091] Updated weights for policy 0, policy_version 722823 (0.0010) [2023-12-26 05:21:47,102][123090] Updated weights for policy 1, policy_version 718465 (0.0009) [2023-12-26 05:21:47,168][123090] Updated weights for policy 1, policy_version 718475 (0.0009) [2023-12-26 05:21:47,234][123090] Updated weights for policy 1, policy_version 718485 (0.0010) [2023-12-26 05:21:47,298][123090] Updated weights for policy 1, policy_version 718495 (0.0009) [2023-12-26 05:21:47,731][123091] Updated weights for policy 0, policy_version 722833 (0.0009) [2023-12-26 05:21:47,790][123091] Updated weights for policy 0, policy_version 722843 (0.0006) [2023-12-26 05:21:47,835][123091] Updated weights for policy 0, policy_version 722853 (0.0008) [2023-12-26 05:21:47,884][123091] Updated weights for policy 0, policy_version 722863 (0.0009) [2023-12-26 05:21:48,171][123090] Updated weights for policy 1, policy_version 718505 (0.0006) [2023-12-26 05:21:48,244][123090] Updated weights for policy 1, policy_version 718515 (0.0005) [2023-12-26 05:21:48,309][123090] Updated weights for policy 1, policy_version 718525 (0.0009) [2023-12-26 05:21:48,613][123091] Updated weights for policy 0, policy_version 722873 (0.0007) [2023-12-26 05:21:48,680][123091] Updated weights for policy 0, policy_version 722883 (0.0011) [2023-12-26 05:21:48,745][123091] Updated weights for policy 0, policy_version 722893 (0.0011) [2023-12-26 05:21:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 369008640. Throughput: 0: 8762.3, 1: 8829.5. Samples: 369016584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:48,785][121949] Avg episode reward: [(0, '6196.941'), (1, '5528.618')] [2023-12-26 05:21:49,098][123090] Updated weights for policy 1, policy_version 718535 (0.0006) [2023-12-26 05:21:49,146][123090] Updated weights for policy 1, policy_version 718545 (0.0005) [2023-12-26 05:21:49,196][123090] Updated weights for policy 1, policy_version 718555 (0.0005) [2023-12-26 05:21:49,573][123091] Updated weights for policy 0, policy_version 722903 (0.0008) [2023-12-26 05:21:49,650][123091] Updated weights for policy 0, policy_version 722913 (0.0009) [2023-12-26 05:21:49,725][123091] Updated weights for policy 0, policy_version 722923 (0.0011) [2023-12-26 05:21:49,990][123090] Updated weights for policy 1, policy_version 718565 (0.0009) [2023-12-26 05:21:50,052][123090] Updated weights for policy 1, policy_version 718575 (0.0009) [2023-12-26 05:21:50,121][123090] Updated weights for policy 1, policy_version 718585 (0.0009) [2023-12-26 05:21:50,529][123091] Updated weights for policy 0, policy_version 722933 (0.0011) [2023-12-26 05:21:50,593][123091] Updated weights for policy 0, policy_version 722943 (0.0010) [2023-12-26 05:21:50,659][123091] Updated weights for policy 0, policy_version 722953 (0.0010) [2023-12-26 05:21:50,959][123090] Updated weights for policy 1, policy_version 718595 (0.0009) [2023-12-26 05:21:51,026][123090] Updated weights for policy 1, policy_version 718605 (0.0009) [2023-12-26 05:21:51,089][123090] Updated weights for policy 1, policy_version 718615 (0.0008) [2023-12-26 05:21:51,491][123091] Updated weights for policy 0, policy_version 722963 (0.0008) [2023-12-26 05:21:51,553][123091] Updated weights for policy 0, policy_version 722973 (0.0008) [2023-12-26 05:21:51,616][123091] Updated weights for policy 0, policy_version 722983 (0.0008) [2023-12-26 05:21:51,943][123090] Updated weights for policy 1, policy_version 718625 (0.0008) [2023-12-26 05:21:52,002][123090] Updated weights for policy 1, policy_version 718635 (0.0010) [2023-12-26 05:21:52,066][123090] Updated weights for policy 1, policy_version 718645 (0.0010) [2023-12-26 05:21:52,136][123090] Updated weights for policy 1, policy_version 718655 (0.0010) [2023-12-26 05:21:52,335][123091] Updated weights for policy 0, policy_version 722993 (0.0006) [2023-12-26 05:21:52,406][123091] Updated weights for policy 0, policy_version 723003 (0.0007) [2023-12-26 05:21:52,475][123091] Updated weights for policy 0, policy_version 723013 (0.0010) [2023-12-26 05:21:52,535][123091] Updated weights for policy 0, policy_version 723023 (0.0011) [2023-12-26 05:21:53,014][123090] Updated weights for policy 1, policy_version 718665 (0.0009) [2023-12-26 05:21:53,074][123090] Updated weights for policy 1, policy_version 718675 (0.0009) [2023-12-26 05:21:53,134][123090] Updated weights for policy 1, policy_version 718685 (0.0009) [2023-12-26 05:21:53,304][123091] Updated weights for policy 0, policy_version 723033 (0.0010) [2023-12-26 05:21:53,352][123091] Updated weights for policy 0, policy_version 723043 (0.0010) [2023-12-26 05:21:53,410][123091] Updated weights for policy 0, policy_version 723053 (0.0010) [2023-12-26 05:21:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 369090560. Throughput: 0: 8733.3, 1: 8808.1. Samples: 369068088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:53,785][121949] Avg episode reward: [(0, '6195.924'), (1, '5520.688')] [2023-12-26 05:21:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000723056_185106432.pth... [2023-12-26 05:21:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000718688_183984128.pth... [2023-12-26 05:21:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000722032_184844288.pth [2023-12-26 05:21:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000717664_183721984.pth [2023-12-26 05:21:53,978][123090] Updated weights for policy 1, policy_version 718695 (0.0009) [2023-12-26 05:21:54,030][123090] Updated weights for policy 1, policy_version 718705 (0.0009) [2023-12-26 05:21:54,078][123090] Updated weights for policy 1, policy_version 718715 (0.0009) [2023-12-26 05:21:54,245][123091] Updated weights for policy 0, policy_version 723063 (0.0010) [2023-12-26 05:21:54,293][123091] Updated weights for policy 0, policy_version 723073 (0.0010) [2023-12-26 05:21:54,344][123091] Updated weights for policy 0, policy_version 723083 (0.0011) [2023-12-26 05:21:54,933][123090] Updated weights for policy 1, policy_version 718725 (0.0009) [2023-12-26 05:21:54,994][123090] Updated weights for policy 1, policy_version 718735 (0.0009) [2023-12-26 05:21:55,067][123090] Updated weights for policy 1, policy_version 718745 (0.0010) [2023-12-26 05:21:55,111][123091] Updated weights for policy 0, policy_version 723093 (0.0009) [2023-12-26 05:21:55,173][123091] Updated weights for policy 0, policy_version 723103 (0.0009) [2023-12-26 05:21:55,239][123091] Updated weights for policy 0, policy_version 723113 (0.0009) [2023-12-26 05:21:55,885][123090] Updated weights for policy 1, policy_version 718755 (0.0009) [2023-12-26 05:21:55,938][123090] Updated weights for policy 1, policy_version 718765 (0.0009) [2023-12-26 05:21:56,002][123090] Updated weights for policy 1, policy_version 718775 (0.0009) [2023-12-26 05:21:56,056][123091] Updated weights for policy 0, policy_version 723123 (0.0010) [2023-12-26 05:21:56,114][123091] Updated weights for policy 0, policy_version 723133 (0.0009) [2023-12-26 05:21:56,182][123091] Updated weights for policy 0, policy_version 723143 (0.0009) [2023-12-26 05:21:56,886][123091] Updated weights for policy 0, policy_version 723153 (0.0008) [2023-12-26 05:21:56,896][123090] Updated weights for policy 1, policy_version 718785 (0.0010) [2023-12-26 05:21:56,946][123090] Updated weights for policy 1, policy_version 718795 (0.0009) [2023-12-26 05:21:56,948][123091] Updated weights for policy 0, policy_version 723163 (0.0007) [2023-12-26 05:21:56,991][123090] Updated weights for policy 1, policy_version 718805 (0.0007) [2023-12-26 05:21:57,009][123091] Updated weights for policy 0, policy_version 723173 (0.0008) [2023-12-26 05:21:57,048][123090] Updated weights for policy 1, policy_version 718815 (0.0009) [2023-12-26 05:21:57,076][123091] Updated weights for policy 0, policy_version 723183 (0.0008) [2023-12-26 05:21:57,853][123090] Updated weights for policy 1, policy_version 718825 (0.0008) [2023-12-26 05:21:57,861][123091] Updated weights for policy 0, policy_version 723193 (0.0006) [2023-12-26 05:21:57,909][123091] Updated weights for policy 0, policy_version 723203 (0.0007) [2023-12-26 05:21:57,912][123090] Updated weights for policy 1, policy_version 718835 (0.0007) [2023-12-26 05:21:57,965][123091] Updated weights for policy 0, policy_version 723213 (0.0009) [2023-12-26 05:21:57,981][123090] Updated weights for policy 1, policy_version 718845 (0.0005) [2023-12-26 05:21:58,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 369172480. Throughput: 0: 8794.7, 1: 8785.9. Samples: 369172456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:21:58,785][121949] Avg episode reward: [(0, '6231.335'), (1, '5717.850')] [2023-12-26 05:21:58,850][123090] Updated weights for policy 1, policy_version 718855 (0.0007) [2023-12-26 05:21:58,882][123091] Updated weights for policy 0, policy_version 723223 (0.0008) [2023-12-26 05:21:58,921][123090] Updated weights for policy 1, policy_version 718865 (0.0009) [2023-12-26 05:21:58,946][123091] Updated weights for policy 0, policy_version 723233 (0.0008) [2023-12-26 05:21:58,988][123090] Updated weights for policy 1, policy_version 718875 (0.0007) [2023-12-26 05:21:59,008][123091] Updated weights for policy 0, policy_version 723243 (0.0009) [2023-12-26 05:21:59,760][123090] Updated weights for policy 1, policy_version 718885 (0.0009) [2023-12-26 05:21:59,814][123090] Updated weights for policy 1, policy_version 718895 (0.0009) [2023-12-26 05:21:59,857][123091] Updated weights for policy 0, policy_version 723253 (0.0008) [2023-12-26 05:21:59,877][123090] Updated weights for policy 1, policy_version 718905 (0.0008) [2023-12-26 05:21:59,911][123091] Updated weights for policy 0, policy_version 723263 (0.0008) [2023-12-26 05:21:59,978][123091] Updated weights for policy 0, policy_version 723273 (0.0007) [2023-12-26 05:22:00,610][123091] Updated weights for policy 0, policy_version 723283 (0.0005) [2023-12-26 05:22:00,658][123091] Updated weights for policy 0, policy_version 723293 (0.0005) [2023-12-26 05:22:00,713][123091] Updated weights for policy 0, policy_version 723303 (0.0005) [2023-12-26 05:22:00,798][123090] Updated weights for policy 1, policy_version 718915 (0.0009) [2023-12-26 05:22:00,849][123090] Updated weights for policy 1, policy_version 718925 (0.0010) [2023-12-26 05:22:00,908][123090] Updated weights for policy 1, policy_version 718935 (0.0007) [2023-12-26 05:22:01,380][123091] Updated weights for policy 0, policy_version 723313 (0.0006) [2023-12-26 05:22:01,440][123091] Updated weights for policy 0, policy_version 723323 (0.0011) [2023-12-26 05:22:01,503][123091] Updated weights for policy 0, policy_version 723333 (0.0011) [2023-12-26 05:22:01,562][123091] Updated weights for policy 0, policy_version 723343 (0.0010) [2023-12-26 05:22:01,683][123090] Updated weights for policy 1, policy_version 718945 (0.0005) [2023-12-26 05:22:01,753][123090] Updated weights for policy 1, policy_version 718955 (0.0008) [2023-12-26 05:22:01,808][123090] Updated weights for policy 1, policy_version 718965 (0.0005) [2023-12-26 05:22:01,857][123090] Updated weights for policy 1, policy_version 718975 (0.0005) [2023-12-26 05:22:02,364][123091] Updated weights for policy 0, policy_version 723353 (0.0011) [2023-12-26 05:22:02,432][123091] Updated weights for policy 0, policy_version 723363 (0.0010) [2023-12-26 05:22:02,495][123091] Updated weights for policy 0, policy_version 723373 (0.0011) [2023-12-26 05:22:02,607][123090] Updated weights for policy 1, policy_version 718985 (0.0008) [2023-12-26 05:22:02,658][123090] Updated weights for policy 1, policy_version 718995 (0.0008) [2023-12-26 05:22:02,704][123090] Updated weights for policy 1, policy_version 719005 (0.0007) [2023-12-26 05:22:03,194][123091] Updated weights for policy 0, policy_version 723383 (0.0010) [2023-12-26 05:22:03,253][123091] Updated weights for policy 0, policy_version 723393 (0.0010) [2023-12-26 05:22:03,312][123091] Updated weights for policy 0, policy_version 723403 (0.0010) [2023-12-26 05:22:03,397][123090] Updated weights for policy 1, policy_version 719015 (0.0009) [2023-12-26 05:22:03,463][123090] Updated weights for policy 1, policy_version 719025 (0.0010) [2023-12-26 05:22:03,521][123090] Updated weights for policy 1, policy_version 719035 (0.0010) [2023-12-26 05:22:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 369270784. Throughput: 0: 8772.3, 1: 8784.4. Samples: 369280396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:03,785][121949] Avg episode reward: [(0, '6230.240'), (1, '5698.759')] [2023-12-26 05:22:04,081][123091] Updated weights for policy 0, policy_version 723413 (0.0008) [2023-12-26 05:22:04,148][123091] Updated weights for policy 0, policy_version 723423 (0.0010) [2023-12-26 05:22:04,200][123091] Updated weights for policy 0, policy_version 723433 (0.0010) [2023-12-26 05:22:04,337][123090] Updated weights for policy 1, policy_version 719045 (0.0010) [2023-12-26 05:22:04,409][123090] Updated weights for policy 1, policy_version 719055 (0.0011) [2023-12-26 05:22:04,472][123090] Updated weights for policy 1, policy_version 719065 (0.0010) [2023-12-26 05:22:05,018][123091] Updated weights for policy 0, policy_version 723443 (0.0011) [2023-12-26 05:22:05,073][123091] Updated weights for policy 0, policy_version 723453 (0.0010) [2023-12-26 05:22:05,139][123091] Updated weights for policy 0, policy_version 723463 (0.0011) [2023-12-26 05:22:05,255][123090] Updated weights for policy 1, policy_version 719075 (0.0011) [2023-12-26 05:22:05,314][123090] Updated weights for policy 1, policy_version 719085 (0.0010) [2023-12-26 05:22:05,364][123090] Updated weights for policy 1, policy_version 719095 (0.0010) [2023-12-26 05:22:05,929][123091] Updated weights for policy 0, policy_version 723473 (0.0010) [2023-12-26 05:22:05,992][123091] Updated weights for policy 0, policy_version 723483 (0.0009) [2023-12-26 05:22:06,052][123091] Updated weights for policy 0, policy_version 723493 (0.0009) [2023-12-26 05:22:06,122][123091] Updated weights for policy 0, policy_version 723503 (0.0009) [2023-12-26 05:22:06,194][123090] Updated weights for policy 1, policy_version 719105 (0.0010) [2023-12-26 05:22:06,257][123090] Updated weights for policy 1, policy_version 719115 (0.0011) [2023-12-26 05:22:06,321][123090] Updated weights for policy 1, policy_version 719125 (0.0011) [2023-12-26 05:22:06,389][123090] Updated weights for policy 1, policy_version 719135 (0.0011) [2023-12-26 05:22:06,955][123091] Updated weights for policy 0, policy_version 723513 (0.0007) [2023-12-26 05:22:07,015][123091] Updated weights for policy 0, policy_version 723523 (0.0010) [2023-12-26 05:22:07,082][123091] Updated weights for policy 0, policy_version 723533 (0.0010) [2023-12-26 05:22:07,222][123090] Updated weights for policy 1, policy_version 719145 (0.0010) [2023-12-26 05:22:07,287][123090] Updated weights for policy 1, policy_version 719155 (0.0010) [2023-12-26 05:22:07,339][123090] Updated weights for policy 1, policy_version 719165 (0.0010) [2023-12-26 05:22:07,885][123091] Updated weights for policy 0, policy_version 723543 (0.0009) [2023-12-26 05:22:07,940][123091] Updated weights for policy 0, policy_version 723553 (0.0008) [2023-12-26 05:22:07,988][123091] Updated weights for policy 0, policy_version 723563 (0.0009) [2023-12-26 05:22:08,164][123090] Updated weights for policy 1, policy_version 719175 (0.0010) [2023-12-26 05:22:08,215][123090] Updated weights for policy 1, policy_version 719185 (0.0010) [2023-12-26 05:22:08,262][123090] Updated weights for policy 1, policy_version 719195 (0.0010) [2023-12-26 05:22:08,764][123091] Updated weights for policy 0, policy_version 723573 (0.0009) [2023-12-26 05:22:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 369352704. Throughput: 0: 8801.3, 1: 8790.5. Samples: 369333260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:08,785][121949] Avg episode reward: [(0, '6192.986'), (1, '5553.488')] [2023-12-26 05:22:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000719200_184115200.pth... [2023-12-26 05:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000718208_183861248.pth [2023-12-26 05:22:08,824][123091] Updated weights for policy 0, policy_version 723583 (0.0009) [2023-12-26 05:22:08,888][123091] Updated weights for policy 0, policy_version 723593 (0.0009) [2023-12-26 05:22:08,929][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000723600_185245696.pth... [2023-12-26 05:22:08,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000722544_184975360.pth [2023-12-26 05:22:09,112][123090] Updated weights for policy 1, policy_version 719205 (0.0010) [2023-12-26 05:22:09,171][123090] Updated weights for policy 1, policy_version 719215 (0.0010) [2023-12-26 05:22:09,232][123090] Updated weights for policy 1, policy_version 719225 (0.0011) [2023-12-26 05:22:09,773][123091] Updated weights for policy 0, policy_version 723603 (0.0008) [2023-12-26 05:22:09,847][123091] Updated weights for policy 0, policy_version 723613 (0.0007) [2023-12-26 05:22:09,902][123091] Updated weights for policy 0, policy_version 723623 (0.0009) [2023-12-26 05:22:10,068][123090] Updated weights for policy 1, policy_version 719235 (0.0010) [2023-12-26 05:22:10,136][123090] Updated weights for policy 1, policy_version 719245 (0.0008) [2023-12-26 05:22:10,206][123090] Updated weights for policy 1, policy_version 719255 (0.0007) [2023-12-26 05:22:10,739][123091] Updated weights for policy 0, policy_version 723633 (0.0010) [2023-12-26 05:22:10,810][123091] Updated weights for policy 0, policy_version 723643 (0.0007) [2023-12-26 05:22:10,883][123091] Updated weights for policy 0, policy_version 723653 (0.0008) [2023-12-26 05:22:10,951][123091] Updated weights for policy 0, policy_version 723663 (0.0010) [2023-12-26 05:22:11,007][123090] Updated weights for policy 1, policy_version 719265 (0.0010) [2023-12-26 05:22:11,082][123090] Updated weights for policy 1, policy_version 719275 (0.0010) [2023-12-26 05:22:11,154][123090] Updated weights for policy 1, policy_version 719285 (0.0010) [2023-12-26 05:22:11,214][123090] Updated weights for policy 1, policy_version 719295 (0.0009) [2023-12-26 05:22:11,789][123091] Updated weights for policy 0, policy_version 723673 (0.0007) [2023-12-26 05:22:11,843][123091] Updated weights for policy 0, policy_version 723683 (0.0005) [2023-12-26 05:22:11,911][123091] Updated weights for policy 0, policy_version 723693 (0.0008) [2023-12-26 05:22:12,020][123090] Updated weights for policy 1, policy_version 719305 (0.0008) [2023-12-26 05:22:12,080][123090] Updated weights for policy 1, policy_version 719315 (0.0008) [2023-12-26 05:22:12,139][123090] Updated weights for policy 1, policy_version 719325 (0.0008) [2023-12-26 05:22:12,612][123091] Updated weights for policy 0, policy_version 723703 (0.0006) [2023-12-26 05:22:12,675][123091] Updated weights for policy 0, policy_version 723713 (0.0006) [2023-12-26 05:22:12,747][123091] Updated weights for policy 0, policy_version 723723 (0.0005) [2023-12-26 05:22:12,997][123090] Updated weights for policy 1, policy_version 719335 (0.0006) [2023-12-26 05:22:13,071][123090] Updated weights for policy 1, policy_version 719345 (0.0006) [2023-12-26 05:22:13,139][123090] Updated weights for policy 1, policy_version 719355 (0.0009) [2023-12-26 05:22:13,467][123091] Updated weights for policy 0, policy_version 723733 (0.0006) [2023-12-26 05:22:13,527][123091] Updated weights for policy 0, policy_version 723743 (0.0005) [2023-12-26 05:22:13,582][123091] Updated weights for policy 0, policy_version 723753 (0.0005) [2023-12-26 05:22:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 369442816. Throughput: 0: 8714.7, 1: 8743.6. Samples: 369436228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:13,785][121949] Avg episode reward: [(0, '6191.358'), (1, '5687.757')] [2023-12-26 05:22:13,920][123090] Updated weights for policy 1, policy_version 719365 (0.0009) [2023-12-26 05:22:13,980][123090] Updated weights for policy 1, policy_version 719376 (0.0011) [2023-12-26 05:22:14,036][123090] Updated weights for policy 1, policy_version 719387 (0.0010) [2023-12-26 05:22:14,259][123091] Updated weights for policy 0, policy_version 723763 (0.0007) [2023-12-26 05:22:14,321][123091] Updated weights for policy 0, policy_version 723773 (0.0006) [2023-12-26 05:22:14,385][123091] Updated weights for policy 0, policy_version 723783 (0.0007) [2023-12-26 05:22:14,759][123090] Updated weights for policy 1, policy_version 719397 (0.0009) [2023-12-26 05:22:14,831][123090] Updated weights for policy 1, policy_version 719407 (0.0008) [2023-12-26 05:22:14,901][123090] Updated weights for policy 1, policy_version 719417 (0.0009) [2023-12-26 05:22:15,166][123091] Updated weights for policy 0, policy_version 723793 (0.0010) [2023-12-26 05:22:15,234][123091] Updated weights for policy 0, policy_version 723803 (0.0006) [2023-12-26 05:22:15,287][123091] Updated weights for policy 0, policy_version 723813 (0.0010) [2023-12-26 05:22:15,342][123091] Updated weights for policy 0, policy_version 723823 (0.0010) [2023-12-26 05:22:15,733][123090] Updated weights for policy 1, policy_version 719427 (0.0009) [2023-12-26 05:22:15,791][123090] Updated weights for policy 1, policy_version 719437 (0.0009) [2023-12-26 05:22:15,846][123090] Updated weights for policy 1, policy_version 719447 (0.0010) [2023-12-26 05:22:16,092][123091] Updated weights for policy 0, policy_version 723833 (0.0006) [2023-12-26 05:22:16,152][123091] Updated weights for policy 0, policy_version 723843 (0.0005) [2023-12-26 05:22:16,216][123091] Updated weights for policy 0, policy_version 723853 (0.0010) [2023-12-26 05:22:16,565][123090] Updated weights for policy 1, policy_version 719457 (0.0010) [2023-12-26 05:22:16,620][123090] Updated weights for policy 1, policy_version 719467 (0.0007) [2023-12-26 05:22:16,667][123090] Updated weights for policy 1, policy_version 719477 (0.0010) [2023-12-26 05:22:16,710][123090] Updated weights for policy 1, policy_version 719487 (0.0010) [2023-12-26 05:22:16,962][123091] Updated weights for policy 0, policy_version 723863 (0.0009) [2023-12-26 05:22:17,027][123091] Updated weights for policy 0, policy_version 723873 (0.0009) [2023-12-26 05:22:17,094][123091] Updated weights for policy 0, policy_version 723883 (0.0007) [2023-12-26 05:22:17,467][123090] Updated weights for policy 1, policy_version 719497 (0.0009) [2023-12-26 05:22:17,516][123090] Updated weights for policy 1, policy_version 719507 (0.0005) [2023-12-26 05:22:17,581][123090] Updated weights for policy 1, policy_version 719517 (0.0007) [2023-12-26 05:22:17,775][123091] Updated weights for policy 0, policy_version 723893 (0.0008) [2023-12-26 05:22:17,830][123091] Updated weights for policy 0, policy_version 723903 (0.0010) [2023-12-26 05:22:17,877][123091] Updated weights for policy 0, policy_version 723913 (0.0010) [2023-12-26 05:22:18,382][123090] Updated weights for policy 1, policy_version 719527 (0.0008) [2023-12-26 05:22:18,447][123090] Updated weights for policy 1, policy_version 719537 (0.0005) [2023-12-26 05:22:18,515][123090] Updated weights for policy 1, policy_version 719547 (0.0007) [2023-12-26 05:22:18,663][123091] Updated weights for policy 0, policy_version 723923 (0.0008) [2023-12-26 05:22:18,726][123091] Updated weights for policy 0, policy_version 723933 (0.0011) [2023-12-26 05:22:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 369532928. Throughput: 0: 8812.8, 1: 8727.3. Samples: 369546580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:18,785][121949] Avg episode reward: [(0, '6200.261'), (1, '5665.062')] [2023-12-26 05:22:18,788][123091] Updated weights for policy 0, policy_version 723943 (0.0010) [2023-12-26 05:22:19,362][123090] Updated weights for policy 1, policy_version 719557 (0.0009) [2023-12-26 05:22:19,426][123090] Updated weights for policy 1, policy_version 719567 (0.0009) [2023-12-26 05:22:19,484][123091] Updated weights for policy 0, policy_version 723953 (0.0010) [2023-12-26 05:22:19,487][123090] Updated weights for policy 1, policy_version 719577 (0.0009) [2023-12-26 05:22:19,547][123091] Updated weights for policy 0, policy_version 723963 (0.0009) [2023-12-26 05:22:19,599][123091] Updated weights for policy 0, policy_version 723973 (0.0008) [2023-12-26 05:22:19,655][123091] Updated weights for policy 0, policy_version 723983 (0.0008) [2023-12-26 05:22:20,359][123090] Updated weights for policy 1, policy_version 719587 (0.0007) [2023-12-26 05:22:20,424][123090] Updated weights for policy 1, policy_version 719597 (0.0009) [2023-12-26 05:22:20,488][123090] Updated weights for policy 1, policy_version 719607 (0.0009) [2023-12-26 05:22:20,521][123091] Updated weights for policy 0, policy_version 723993 (0.0010) [2023-12-26 05:22:20,593][123091] Updated weights for policy 0, policy_version 724003 (0.0011) [2023-12-26 05:22:20,652][123091] Updated weights for policy 0, policy_version 724013 (0.0011) [2023-12-26 05:22:21,337][123090] Updated weights for policy 1, policy_version 719617 (0.0006) [2023-12-26 05:22:21,415][123090] Updated weights for policy 1, policy_version 719627 (0.0008) [2023-12-26 05:22:21,484][123090] Updated weights for policy 1, policy_version 719637 (0.0009) [2023-12-26 05:22:21,495][123091] Updated weights for policy 0, policy_version 724023 (0.0007) [2023-12-26 05:22:21,550][123090] Updated weights for policy 1, policy_version 719647 (0.0009) [2023-12-26 05:22:21,552][123091] Updated weights for policy 0, policy_version 724033 (0.0006) [2023-12-26 05:22:21,610][123091] Updated weights for policy 0, policy_version 724043 (0.0009) [2023-12-26 05:22:22,280][123090] Updated weights for policy 1, policy_version 719657 (0.0009) [2023-12-26 05:22:22,347][123090] Updated weights for policy 1, policy_version 719667 (0.0009) [2023-12-26 05:22:22,418][123090] Updated weights for policy 1, policy_version 719677 (0.0006) [2023-12-26 05:22:22,465][123091] Updated weights for policy 0, policy_version 724053 (0.0008) [2023-12-26 05:22:22,537][123091] Updated weights for policy 0, policy_version 724063 (0.0010) [2023-12-26 05:22:22,608][123091] Updated weights for policy 0, policy_version 724073 (0.0010) [2023-12-26 05:22:23,169][123090] Updated weights for policy 1, policy_version 719687 (0.0006) [2023-12-26 05:22:23,218][123090] Updated weights for policy 1, policy_version 719697 (0.0005) [2023-12-26 05:22:23,274][123090] Updated weights for policy 1, policy_version 719707 (0.0005) [2023-12-26 05:22:23,469][123091] Updated weights for policy 0, policy_version 724083 (0.0009) [2023-12-26 05:22:23,526][123091] Updated weights for policy 0, policy_version 724093 (0.0010) [2023-12-26 05:22:23,580][123091] Updated weights for policy 0, policy_version 724104 (0.0010) [2023-12-26 05:22:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 369623040. Throughput: 0: 8843.0, 1: 8650.2. Samples: 369596940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:23,785][121949] Avg episode reward: [(0, '6179.598'), (1, '5474.919')] [2023-12-26 05:22:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000724112_185376768.pth... [2023-12-26 05:22:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000719712_184246272.pth... [2023-12-26 05:22:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000723056_185106432.pth [2023-12-26 05:22:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000718688_183984128.pth [2023-12-26 05:22:24,024][123090] Updated weights for policy 1, policy_version 719717 (0.0007) [2023-12-26 05:22:24,086][123090] Updated weights for policy 1, policy_version 719727 (0.0011) [2023-12-26 05:22:24,146][123090] Updated weights for policy 1, policy_version 719737 (0.0010) [2023-12-26 05:22:24,380][123091] Updated weights for policy 0, policy_version 724114 (0.0009) [2023-12-26 05:22:24,435][123091] Updated weights for policy 0, policy_version 724124 (0.0005) [2023-12-26 05:22:24,490][123091] Updated weights for policy 0, policy_version 724134 (0.0005) [2023-12-26 05:22:24,557][123091] Updated weights for policy 0, policy_version 724144 (0.0005) [2023-12-26 05:22:24,865][123090] Updated weights for policy 1, policy_version 719747 (0.0009) [2023-12-26 05:22:24,916][123090] Updated weights for policy 1, policy_version 719757 (0.0005) [2023-12-26 05:22:24,965][123090] Updated weights for policy 1, policy_version 719767 (0.0010) [2023-12-26 05:22:25,189][123091] Updated weights for policy 0, policy_version 724154 (0.0005) [2023-12-26 05:22:25,233][123091] Updated weights for policy 0, policy_version 724164 (0.0005) [2023-12-26 05:22:25,288][123091] Updated weights for policy 0, policy_version 724174 (0.0007) [2023-12-26 05:22:25,791][123090] Updated weights for policy 1, policy_version 719777 (0.0010) [2023-12-26 05:22:25,850][123090] Updated weights for policy 1, policy_version 719787 (0.0010) [2023-12-26 05:22:25,907][123090] Updated weights for policy 1, policy_version 719797 (0.0010) [2023-12-26 05:22:25,956][123091] Updated weights for policy 0, policy_version 724184 (0.0010) [2023-12-26 05:22:25,963][123090] Updated weights for policy 1, policy_version 719807 (0.0010) [2023-12-26 05:22:26,015][123091] Updated weights for policy 0, policy_version 724194 (0.0011) [2023-12-26 05:22:26,075][123091] Updated weights for policy 0, policy_version 724204 (0.0011) [2023-12-26 05:22:26,806][123090] Updated weights for policy 1, policy_version 719817 (0.0007) [2023-12-26 05:22:26,858][123090] Updated weights for policy 1, policy_version 719827 (0.0005) [2023-12-26 05:22:26,895][123091] Updated weights for policy 0, policy_version 724214 (0.0011) [2023-12-26 05:22:26,914][123090] Updated weights for policy 1, policy_version 719837 (0.0005) [2023-12-26 05:22:26,943][123091] Updated weights for policy 0, policy_version 724224 (0.0011) [2023-12-26 05:22:26,995][123091] Updated weights for policy 0, policy_version 724234 (0.0011) [2023-12-26 05:22:27,666][123091] Updated weights for policy 0, policy_version 724244 (0.0009) [2023-12-26 05:22:27,734][123091] Updated weights for policy 0, policy_version 724254 (0.0005) [2023-12-26 05:22:27,779][123090] Updated weights for policy 1, policy_version 719847 (0.0008) [2023-12-26 05:22:27,795][123091] Updated weights for policy 0, policy_version 724264 (0.0005) [2023-12-26 05:22:27,828][123090] Updated weights for policy 1, policy_version 719857 (0.0008) [2023-12-26 05:22:27,879][123090] Updated weights for policy 1, policy_version 719867 (0.0009) [2023-12-26 05:22:28,534][123091] Updated weights for policy 0, policy_version 724274 (0.0006) [2023-12-26 05:22:28,608][123091] Updated weights for policy 0, policy_version 724284 (0.0011) [2023-12-26 05:22:28,671][123091] Updated weights for policy 0, policy_version 724294 (0.0011) [2023-12-26 05:22:28,737][123091] Updated weights for policy 0, policy_version 724304 (0.0010) [2023-12-26 05:22:28,745][123090] Updated weights for policy 1, policy_version 719877 (0.0008) [2023-12-26 05:22:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 369713152. Throughput: 0: 8991.3, 1: 8676.7. Samples: 369706460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:28,784][121949] Avg episode reward: [(0, '6168.000'), (1, '5187.872')] [2023-12-26 05:22:28,810][123090] Updated weights for policy 1, policy_version 719887 (0.0008) [2023-12-26 05:22:28,869][123090] Updated weights for policy 1, policy_version 719897 (0.0008) [2023-12-26 05:22:29,515][123091] Updated weights for policy 0, policy_version 724314 (0.0005) [2023-12-26 05:22:29,579][123091] Updated weights for policy 0, policy_version 724324 (0.0005) [2023-12-26 05:22:29,642][123091] Updated weights for policy 0, policy_version 724334 (0.0005) [2023-12-26 05:22:29,756][123090] Updated weights for policy 1, policy_version 719907 (0.0009) [2023-12-26 05:22:29,810][123090] Updated weights for policy 1, policy_version 719918 (0.0010) [2023-12-26 05:22:29,871][123090] Updated weights for policy 1, policy_version 719928 (0.0009) [2023-12-26 05:22:30,358][123091] Updated weights for policy 0, policy_version 724344 (0.0008) [2023-12-26 05:22:30,412][123091] Updated weights for policy 0, policy_version 724354 (0.0010) [2023-12-26 05:22:30,465][123091] Updated weights for policy 0, policy_version 724364 (0.0009) [2023-12-26 05:22:30,762][123090] Updated weights for policy 1, policy_version 719938 (0.0009) [2023-12-26 05:22:30,817][123090] Updated weights for policy 1, policy_version 719948 (0.0009) [2023-12-26 05:22:30,866][123090] Updated weights for policy 1, policy_version 719958 (0.0009) [2023-12-26 05:22:31,331][123091] Updated weights for policy 0, policy_version 724374 (0.0010) [2023-12-26 05:22:31,390][123091] Updated weights for policy 0, policy_version 724384 (0.0010) [2023-12-26 05:22:31,445][123091] Updated weights for policy 0, policy_version 724394 (0.0008) [2023-12-26 05:22:31,659][123090] Updated weights for policy 1, policy_version 719969 (0.0010) [2023-12-26 05:22:31,719][123090] Updated weights for policy 1, policy_version 719979 (0.0009) [2023-12-26 05:22:31,791][123090] Updated weights for policy 1, policy_version 719989 (0.0006) [2023-12-26 05:22:31,860][123090] Updated weights for policy 1, policy_version 719999 (0.0005) [2023-12-26 05:22:32,296][123091] Updated weights for policy 0, policy_version 724404 (0.0009) [2023-12-26 05:22:32,361][123091] Updated weights for policy 0, policy_version 724414 (0.0009) [2023-12-26 05:22:32,428][123091] Updated weights for policy 0, policy_version 724424 (0.0010) [2023-12-26 05:22:32,525][123090] Updated weights for policy 1, policy_version 720009 (0.0009) [2023-12-26 05:22:32,576][123090] Updated weights for policy 1, policy_version 720019 (0.0009) [2023-12-26 05:22:32,628][123090] Updated weights for policy 1, policy_version 720029 (0.0009) [2023-12-26 05:22:33,299][123091] Updated weights for policy 0, policy_version 724434 (0.0010) [2023-12-26 05:22:33,360][123091] Updated weights for policy 0, policy_version 724444 (0.0009) [2023-12-26 05:22:33,425][123091] Updated weights for policy 0, policy_version 724454 (0.0009) [2023-12-26 05:22:33,465][123090] Updated weights for policy 1, policy_version 720039 (0.0009) [2023-12-26 05:22:33,482][123091] Updated weights for policy 0, policy_version 724464 (0.0010) [2023-12-26 05:22:33,510][123090] Updated weights for policy 1, policy_version 720049 (0.0009) [2023-12-26 05:22:33,561][123090] Updated weights for policy 1, policy_version 720060 (0.0009) [2023-12-26 05:22:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 369803264. Throughput: 0: 8962.6, 1: 8666.2. Samples: 369809884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:33,785][121949] Avg episode reward: [(0, '6152.448'), (1, '5081.811')] [2023-12-26 05:22:34,150][123091] Updated weights for policy 0, policy_version 724474 (0.0009) [2023-12-26 05:22:34,205][123091] Updated weights for policy 0, policy_version 724484 (0.0009) [2023-12-26 05:22:34,265][123091] Updated weights for policy 0, policy_version 724494 (0.0010) [2023-12-26 05:22:34,409][123090] Updated weights for policy 1, policy_version 720070 (0.0010) [2023-12-26 05:22:34,462][123090] Updated weights for policy 1, policy_version 720080 (0.0009) [2023-12-26 05:22:34,522][123090] Updated weights for policy 1, policy_version 720090 (0.0009) [2023-12-26 05:22:35,134][123091] Updated weights for policy 0, policy_version 724504 (0.0010) [2023-12-26 05:22:35,187][123091] Updated weights for policy 0, policy_version 724514 (0.0010) [2023-12-26 05:22:35,246][123091] Updated weights for policy 0, policy_version 724524 (0.0005) [2023-12-26 05:22:35,273][123090] Updated weights for policy 1, policy_version 720100 (0.0008) [2023-12-26 05:22:35,328][123090] Updated weights for policy 1, policy_version 720110 (0.0009) [2023-12-26 05:22:35,387][123090] Updated weights for policy 1, policy_version 720120 (0.0009) [2023-12-26 05:22:36,044][123091] Updated weights for policy 0, policy_version 724534 (0.0008) [2023-12-26 05:22:36,112][123091] Updated weights for policy 0, policy_version 724544 (0.0006) [2023-12-26 05:22:36,167][123090] Updated weights for policy 1, policy_version 720130 (0.0009) [2023-12-26 05:22:36,173][123091] Updated weights for policy 0, policy_version 724554 (0.0010) [2023-12-26 05:22:36,233][123090] Updated weights for policy 1, policy_version 720140 (0.0007) [2023-12-26 05:22:36,309][123090] Updated weights for policy 1, policy_version 720150 (0.0006) [2023-12-26 05:22:36,380][123090] Updated weights for policy 1, policy_version 720160 (0.0005) [2023-12-26 05:22:36,942][123091] Updated weights for policy 0, policy_version 724564 (0.0009) [2023-12-26 05:22:37,001][123091] Updated weights for policy 0, policy_version 724574 (0.0010) [2023-12-26 05:22:37,053][123091] Updated weights for policy 0, policy_version 724584 (0.0010) [2023-12-26 05:22:37,123][123090] Updated weights for policy 1, policy_version 720170 (0.0007) [2023-12-26 05:22:37,188][123090] Updated weights for policy 1, policy_version 720180 (0.0009) [2023-12-26 05:22:37,251][123090] Updated weights for policy 1, policy_version 720190 (0.0009) [2023-12-26 05:22:37,907][123091] Updated weights for policy 0, policy_version 724594 (0.0009) [2023-12-26 05:22:37,981][123090] Updated weights for policy 1, policy_version 720200 (0.0006) [2023-12-26 05:22:37,985][123091] Updated weights for policy 0, policy_version 724604 (0.0006) [2023-12-26 05:22:38,044][123090] Updated weights for policy 1, policy_version 720210 (0.0008) [2023-12-26 05:22:38,045][123091] Updated weights for policy 0, policy_version 724614 (0.0009) [2023-12-26 05:22:38,102][123091] Updated weights for policy 0, policy_version 724624 (0.0011) [2023-12-26 05:22:38,112][123090] Updated weights for policy 1, policy_version 720220 (0.0008) [2023-12-26 05:22:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 369885184. Throughput: 0: 9007.6, 1: 8707.1. Samples: 369865252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:38,785][121949] Avg episode reward: [(0, '6144.477'), (1, '5363.422')] [2023-12-26 05:22:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000724624_185507840.pth... [2023-12-26 05:22:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000720224_184377344.pth... [2023-12-26 05:22:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000719200_184115200.pth [2023-12-26 05:22:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000723600_185245696.pth [2023-12-26 05:22:38,865][123090] Updated weights for policy 1, policy_version 720230 (0.0010) [2023-12-26 05:22:38,896][123091] Updated weights for policy 0, policy_version 724634 (0.0011) [2023-12-26 05:22:38,925][123090] Updated weights for policy 1, policy_version 720240 (0.0010) [2023-12-26 05:22:38,954][123091] Updated weights for policy 0, policy_version 724644 (0.0010) [2023-12-26 05:22:38,985][123090] Updated weights for policy 1, policy_version 720250 (0.0010) [2023-12-26 05:22:39,027][123091] Updated weights for policy 0, policy_version 724654 (0.0006) [2023-12-26 05:22:39,750][123090] Updated weights for policy 1, policy_version 720260 (0.0008) [2023-12-26 05:22:39,762][123091] Updated weights for policy 0, policy_version 724664 (0.0006) [2023-12-26 05:22:39,801][123090] Updated weights for policy 1, policy_version 720270 (0.0010) [2023-12-26 05:22:39,821][123091] Updated weights for policy 0, policy_version 724674 (0.0006) [2023-12-26 05:22:39,865][123090] Updated weights for policy 1, policy_version 720280 (0.0009) [2023-12-26 05:22:39,891][123091] Updated weights for policy 0, policy_version 724684 (0.0007) [2023-12-26 05:22:40,587][123091] Updated weights for policy 0, policy_version 724694 (0.0007) [2023-12-26 05:22:40,646][123091] Updated weights for policy 0, policy_version 724704 (0.0005) [2023-12-26 05:22:40,701][123091] Updated weights for policy 0, policy_version 724714 (0.0005) [2023-12-26 05:22:40,764][123090] Updated weights for policy 1, policy_version 720290 (0.0007) [2023-12-26 05:22:40,834][123090] Updated weights for policy 1, policy_version 720300 (0.0005) [2023-12-26 05:22:40,903][123090] Updated weights for policy 1, policy_version 720310 (0.0010) [2023-12-26 05:22:40,967][123090] Updated weights for policy 1, policy_version 720320 (0.0009) [2023-12-26 05:22:41,499][123091] Updated weights for policy 0, policy_version 724724 (0.0007) [2023-12-26 05:22:41,562][123091] Updated weights for policy 0, policy_version 724734 (0.0009) [2023-12-26 05:22:41,628][123091] Updated weights for policy 0, policy_version 724744 (0.0009) [2023-12-26 05:22:41,790][123090] Updated weights for policy 1, policy_version 720330 (0.0009) [2023-12-26 05:22:41,845][123090] Updated weights for policy 1, policy_version 720340 (0.0010) [2023-12-26 05:22:41,907][123090] Updated weights for policy 1, policy_version 720350 (0.0009) [2023-12-26 05:22:42,474][123091] Updated weights for policy 0, policy_version 724754 (0.0008) [2023-12-26 05:22:42,534][123091] Updated weights for policy 0, policy_version 724764 (0.0009) [2023-12-26 05:22:42,596][123091] Updated weights for policy 0, policy_version 724774 (0.0009) [2023-12-26 05:22:42,658][123091] Updated weights for policy 0, policy_version 724784 (0.0010) [2023-12-26 05:22:42,782][123090] Updated weights for policy 1, policy_version 720360 (0.0010) [2023-12-26 05:22:42,844][123090] Updated weights for policy 1, policy_version 720370 (0.0009) [2023-12-26 05:22:42,895][123090] Updated weights for policy 1, policy_version 720380 (0.0009) [2023-12-26 05:22:43,505][123091] Updated weights for policy 0, policy_version 724794 (0.0008) [2023-12-26 05:22:43,554][123091] Updated weights for policy 0, policy_version 724804 (0.0009) [2023-12-26 05:22:43,605][123091] Updated weights for policy 0, policy_version 724814 (0.0009) [2023-12-26 05:22:43,688][123090] Updated weights for policy 1, policy_version 720390 (0.0006) [2023-12-26 05:22:43,751][123090] Updated weights for policy 1, policy_version 720400 (0.0005) [2023-12-26 05:22:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 369975296. Throughput: 0: 8974.6, 1: 8758.4. Samples: 369970444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:43,785][121949] Avg episode reward: [(0, '6168.554'), (1, '5385.964')] [2023-12-26 05:22:43,817][123090] Updated weights for policy 1, policy_version 720410 (0.0005) [2023-12-26 05:22:44,456][123090] Updated weights for policy 1, policy_version 720420 (0.0005) [2023-12-26 05:22:44,469][123091] Updated weights for policy 0, policy_version 724824 (0.0010) [2023-12-26 05:22:44,523][123090] Updated weights for policy 1, policy_version 720430 (0.0008) [2023-12-26 05:22:44,536][123091] Updated weights for policy 0, policy_version 724834 (0.0011) [2023-12-26 05:22:44,591][123090] Updated weights for policy 1, policy_version 720440 (0.0008) [2023-12-26 05:22:44,607][123091] Updated weights for policy 0, policy_version 724844 (0.0011) [2023-12-26 05:22:45,433][123090] Updated weights for policy 1, policy_version 720450 (0.0010) [2023-12-26 05:22:45,435][123091] Updated weights for policy 0, policy_version 724854 (0.0010) [2023-12-26 05:22:45,493][123091] Updated weights for policy 0, policy_version 724864 (0.0006) [2023-12-26 05:22:45,494][123090] Updated weights for policy 1, policy_version 720460 (0.0011) [2023-12-26 05:22:45,558][123091] Updated weights for policy 0, policy_version 724874 (0.0007) [2023-12-26 05:22:45,563][123090] Updated weights for policy 1, policy_version 720470 (0.0011) [2023-12-26 05:22:45,615][123090] Updated weights for policy 1, policy_version 720480 (0.0010) [2023-12-26 05:22:46,381][123091] Updated weights for policy 0, policy_version 724884 (0.0009) [2023-12-26 05:22:46,429][123091] Updated weights for policy 0, policy_version 724894 (0.0010) [2023-12-26 05:22:46,445][123090] Updated weights for policy 1, policy_version 720490 (0.0010) [2023-12-26 05:22:46,483][123091] Updated weights for policy 0, policy_version 724904 (0.0010) [2023-12-26 05:22:46,496][123090] Updated weights for policy 1, policy_version 720500 (0.0010) [2023-12-26 05:22:46,554][123090] Updated weights for policy 1, policy_version 720510 (0.0010) [2023-12-26 05:22:47,200][123091] Updated weights for policy 0, policy_version 724914 (0.0009) [2023-12-26 05:22:47,260][123091] Updated weights for policy 0, policy_version 724924 (0.0006) [2023-12-26 05:22:47,321][123091] Updated weights for policy 0, policy_version 724934 (0.0008) [2023-12-26 05:22:47,361][123090] Updated weights for policy 1, policy_version 720520 (0.0010) [2023-12-26 05:22:47,374][123091] Updated weights for policy 0, policy_version 724944 (0.0008) [2023-12-26 05:22:47,427][123090] Updated weights for policy 1, policy_version 720530 (0.0010) [2023-12-26 05:22:47,493][123090] Updated weights for policy 1, policy_version 720540 (0.0010) [2023-12-26 05:22:48,158][123091] Updated weights for policy 0, policy_version 724954 (0.0011) [2023-12-26 05:22:48,216][123091] Updated weights for policy 0, policy_version 724964 (0.0011) [2023-12-26 05:22:48,278][123091] Updated weights for policy 0, policy_version 724974 (0.0011) [2023-12-26 05:22:48,313][123090] Updated weights for policy 1, policy_version 720550 (0.0008) [2023-12-26 05:22:48,383][123090] Updated weights for policy 1, policy_version 720560 (0.0009) [2023-12-26 05:22:48,457][123090] Updated weights for policy 1, policy_version 720570 (0.0007) [2023-12-26 05:22:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 370065408. Throughput: 0: 8925.0, 1: 8747.7. Samples: 370075668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:48,785][121949] Avg episode reward: [(0, '6234.181'), (1, '5492.013')] [2023-12-26 05:22:49,133][123091] Updated weights for policy 0, policy_version 724984 (0.0009) [2023-12-26 05:22:49,198][123091] Updated weights for policy 0, policy_version 724994 (0.0007) [2023-12-26 05:22:49,247][123090] Updated weights for policy 1, policy_version 720580 (0.0009) [2023-12-26 05:22:49,271][123091] Updated weights for policy 0, policy_version 725004 (0.0009) [2023-12-26 05:22:49,316][123090] Updated weights for policy 1, policy_version 720590 (0.0008) [2023-12-26 05:22:49,391][123090] Updated weights for policy 1, policy_version 720600 (0.0008) [2023-12-26 05:22:50,000][123091] Updated weights for policy 0, policy_version 725014 (0.0008) [2023-12-26 05:22:50,061][123091] Updated weights for policy 0, policy_version 725024 (0.0009) [2023-12-26 05:22:50,127][123091] Updated weights for policy 0, policy_version 725034 (0.0008) [2023-12-26 05:22:50,210][123090] Updated weights for policy 1, policy_version 720610 (0.0008) [2023-12-26 05:22:50,267][123090] Updated weights for policy 1, policy_version 720620 (0.0005) [2023-12-26 05:22:50,328][123090] Updated weights for policy 1, policy_version 720630 (0.0010) [2023-12-26 05:22:50,380][123090] Updated weights for policy 1, policy_version 720640 (0.0010) [2023-12-26 05:22:50,904][123091] Updated weights for policy 0, policy_version 725044 (0.0007) [2023-12-26 05:22:50,979][123091] Updated weights for policy 0, policy_version 725054 (0.0006) [2023-12-26 05:22:51,056][123091] Updated weights for policy 0, policy_version 725064 (0.0008) [2023-12-26 05:22:51,241][123090] Updated weights for policy 1, policy_version 720650 (0.0010) [2023-12-26 05:22:51,315][123090] Updated weights for policy 1, policy_version 720660 (0.0010) [2023-12-26 05:22:51,393][123090] Updated weights for policy 1, policy_version 720670 (0.0009) [2023-12-26 05:22:51,874][123091] Updated weights for policy 0, policy_version 725075 (0.0010) [2023-12-26 05:22:51,937][123091] Updated weights for policy 0, policy_version 725085 (0.0009) [2023-12-26 05:22:51,995][123091] Updated weights for policy 0, policy_version 725095 (0.0009) [2023-12-26 05:22:52,205][123090] Updated weights for policy 1, policy_version 720680 (0.0007) [2023-12-26 05:22:52,265][123090] Updated weights for policy 1, policy_version 720690 (0.0009) [2023-12-26 05:22:52,329][123090] Updated weights for policy 1, policy_version 720700 (0.0007) [2023-12-26 05:22:52,845][123091] Updated weights for policy 0, policy_version 725105 (0.0010) [2023-12-26 05:22:52,899][123091] Updated weights for policy 0, policy_version 725115 (0.0010) [2023-12-26 05:22:52,952][123091] Updated weights for policy 0, policy_version 725125 (0.0010) [2023-12-26 05:22:52,999][123090] Updated weights for policy 1, policy_version 720710 (0.0006) [2023-12-26 05:22:53,012][123091] Updated weights for policy 0, policy_version 725136 (0.0010) [2023-12-26 05:22:53,052][123090] Updated weights for policy 1, policy_version 720720 (0.0005) [2023-12-26 05:22:53,106][123090] Updated weights for policy 1, policy_version 720730 (0.0006) [2023-12-26 05:22:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 370147328. Throughput: 0: 8915.0, 1: 8730.2. Samples: 370127296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:53,785][121949] Avg episode reward: [(0, '6205.016'), (1, '5565.481')] [2023-12-26 05:22:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000720736_184508416.pth... [2023-12-26 05:22:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000719712_184246272.pth [2023-12-26 05:22:53,821][123091] Updated weights for policy 0, policy_version 725146 (0.0006) [2023-12-26 05:22:53,885][123091] Updated weights for policy 0, policy_version 725156 (0.0005) [2023-12-26 05:22:53,911][123090] Updated weights for policy 1, policy_version 720740 (0.0006) [2023-12-26 05:22:53,940][123091] Updated weights for policy 0, policy_version 725166 (0.0006) [2023-12-26 05:22:53,949][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000725168_185647104.pth... [2023-12-26 05:22:53,952][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000724112_185376768.pth [2023-12-26 05:22:53,967][123090] Updated weights for policy 1, policy_version 720750 (0.0007) [2023-12-26 05:22:54,014][123090] Updated weights for policy 1, policy_version 720760 (0.0008) [2023-12-26 05:22:54,685][123091] Updated weights for policy 0, policy_version 725176 (0.0006) [2023-12-26 05:22:54,736][123091] Updated weights for policy 0, policy_version 725186 (0.0005) [2023-12-26 05:22:54,795][123091] Updated weights for policy 0, policy_version 725196 (0.0006) [2023-12-26 05:22:54,826][123090] Updated weights for policy 1, policy_version 720770 (0.0008) [2023-12-26 05:22:54,879][123090] Updated weights for policy 1, policy_version 720780 (0.0005) [2023-12-26 05:22:54,942][123090] Updated weights for policy 1, policy_version 720790 (0.0006) [2023-12-26 05:22:55,004][123090] Updated weights for policy 1, policy_version 720800 (0.0006) [2023-12-26 05:22:55,521][123091] Updated weights for policy 0, policy_version 725206 (0.0006) [2023-12-26 05:22:55,575][123091] Updated weights for policy 0, policy_version 725216 (0.0005) [2023-12-26 05:22:55,625][123091] Updated weights for policy 0, policy_version 725226 (0.0005) [2023-12-26 05:22:55,642][123090] Updated weights for policy 1, policy_version 720810 (0.0005) [2023-12-26 05:22:55,715][123090] Updated weights for policy 1, policy_version 720820 (0.0005) [2023-12-26 05:22:55,764][123090] Updated weights for policy 1, policy_version 720830 (0.0005) [2023-12-26 05:22:56,317][123091] Updated weights for policy 0, policy_version 725236 (0.0005) [2023-12-26 05:22:56,387][123091] Updated weights for policy 0, policy_version 725246 (0.0006) [2023-12-26 05:22:56,443][123090] Updated weights for policy 1, policy_version 720840 (0.0008) [2023-12-26 05:22:56,451][123091] Updated weights for policy 0, policy_version 725256 (0.0007) [2023-12-26 05:22:56,515][123090] Updated weights for policy 1, policy_version 720850 (0.0009) [2023-12-26 05:22:56,582][123090] Updated weights for policy 1, policy_version 720860 (0.0010) [2023-12-26 05:22:57,247][123091] Updated weights for policy 0, policy_version 725266 (0.0006) [2023-12-26 05:22:57,298][123091] Updated weights for policy 0, policy_version 725276 (0.0009) [2023-12-26 05:22:57,339][123090] Updated weights for policy 1, policy_version 720870 (0.0010) [2023-12-26 05:22:57,351][123091] Updated weights for policy 0, policy_version 725286 (0.0008) [2023-12-26 05:22:57,391][123090] Updated weights for policy 1, policy_version 720880 (0.0010) [2023-12-26 05:22:57,398][123091] Updated weights for policy 0, policy_version 725296 (0.0005) [2023-12-26 05:22:57,442][123090] Updated weights for policy 1, policy_version 720890 (0.0010) [2023-12-26 05:22:58,248][123091] Updated weights for policy 0, policy_version 725306 (0.0009) [2023-12-26 05:22:58,272][123090] Updated weights for policy 1, policy_version 720900 (0.0009) [2023-12-26 05:22:58,314][123091] Updated weights for policy 0, policy_version 725316 (0.0009) [2023-12-26 05:22:58,337][123090] Updated weights for policy 1, policy_version 720910 (0.0008) [2023-12-26 05:22:58,378][123091] Updated weights for policy 0, policy_version 725326 (0.0010) [2023-12-26 05:22:58,404][123090] Updated weights for policy 1, policy_version 720920 (0.0009) [2023-12-26 05:22:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 370245632. Throughput: 0: 8981.7, 1: 8852.7. Samples: 370238780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:22:58,785][121949] Avg episode reward: [(0, '6052.565'), (1, '5057.778')] [2023-12-26 05:22:59,273][123091] Updated weights for policy 0, policy_version 725336 (0.0010) [2023-12-26 05:22:59,327][123091] Updated weights for policy 0, policy_version 725346 (0.0010) [2023-12-26 05:22:59,334][123090] Updated weights for policy 1, policy_version 720930 (0.0009) [2023-12-26 05:22:59,388][123090] Updated weights for policy 1, policy_version 720940 (0.0008) [2023-12-26 05:22:59,390][123091] Updated weights for policy 0, policy_version 725356 (0.0008) [2023-12-26 05:22:59,439][123090] Updated weights for policy 1, policy_version 720950 (0.0007) [2023-12-26 05:22:59,502][123090] Updated weights for policy 1, policy_version 720960 (0.0009) [2023-12-26 05:23:00,147][123091] Updated weights for policy 0, policy_version 725366 (0.0007) [2023-12-26 05:23:00,204][123091] Updated weights for policy 0, policy_version 725376 (0.0007) [2023-12-26 05:23:00,217][123090] Updated weights for policy 1, policy_version 720970 (0.0006) [2023-12-26 05:23:00,256][123091] Updated weights for policy 0, policy_version 725386 (0.0010) [2023-12-26 05:23:00,268][123090] Updated weights for policy 1, policy_version 720980 (0.0005) [2023-12-26 05:23:00,318][123090] Updated weights for policy 1, policy_version 720990 (0.0005) [2023-12-26 05:23:01,046][123090] Updated weights for policy 1, policy_version 721000 (0.0008) [2023-12-26 05:23:01,052][123091] Updated weights for policy 0, policy_version 725396 (0.0010) [2023-12-26 05:23:01,109][123090] Updated weights for policy 1, policy_version 721010 (0.0007) [2023-12-26 05:23:01,110][123091] Updated weights for policy 0, policy_version 725406 (0.0008) [2023-12-26 05:23:01,177][123090] Updated weights for policy 1, policy_version 721020 (0.0009) [2023-12-26 05:23:01,180][123091] Updated weights for policy 0, policy_version 725416 (0.0008) [2023-12-26 05:23:01,941][123091] Updated weights for policy 0, policy_version 725426 (0.0009) [2023-12-26 05:23:01,988][123091] Updated weights for policy 0, policy_version 725436 (0.0010) [2023-12-26 05:23:02,044][123091] Updated weights for policy 0, policy_version 725446 (0.0009) [2023-12-26 05:23:02,073][123090] Updated weights for policy 1, policy_version 721030 (0.0007) [2023-12-26 05:23:02,099][123091] Updated weights for policy 0, policy_version 725456 (0.0011) [2023-12-26 05:23:02,126][123090] Updated weights for policy 1, policy_version 721040 (0.0006) [2023-12-26 05:23:02,179][123090] Updated weights for policy 1, policy_version 721050 (0.0009) [2023-12-26 05:23:02,940][123091] Updated weights for policy 0, policy_version 725466 (0.0010) [2023-12-26 05:23:02,972][123090] Updated weights for policy 1, policy_version 721060 (0.0005) [2023-12-26 05:23:02,983][123091] Updated weights for policy 0, policy_version 725476 (0.0010) [2023-12-26 05:23:03,024][123090] Updated weights for policy 1, policy_version 721070 (0.0005) [2023-12-26 05:23:03,031][123091] Updated weights for policy 0, policy_version 725486 (0.0010) [2023-12-26 05:23:03,078][123090] Updated weights for policy 1, policy_version 721080 (0.0007) [2023-12-26 05:23:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 370327552. Throughput: 0: 8891.6, 1: 8812.6. Samples: 370343264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:03,785][121949] Avg episode reward: [(0, '6066.564'), (1, '4998.964')] [2023-12-26 05:23:03,888][123091] Updated weights for policy 0, policy_version 725496 (0.0011) [2023-12-26 05:23:03,901][123090] Updated weights for policy 1, policy_version 721090 (0.0009) [2023-12-26 05:23:03,950][123091] Updated weights for policy 0, policy_version 725506 (0.0009) [2023-12-26 05:23:03,961][123090] Updated weights for policy 1, policy_version 721100 (0.0007) [2023-12-26 05:23:04,005][123091] Updated weights for policy 0, policy_version 725516 (0.0005) [2023-12-26 05:23:04,027][123090] Updated weights for policy 1, policy_version 721110 (0.0010) [2023-12-26 05:23:04,092][123090] Updated weights for policy 1, policy_version 721120 (0.0010) [2023-12-26 05:23:04,773][123091] Updated weights for policy 0, policy_version 725526 (0.0009) [2023-12-26 05:23:04,831][123091] Updated weights for policy 0, policy_version 725536 (0.0010) [2023-12-26 05:23:04,893][123091] Updated weights for policy 0, policy_version 725546 (0.0010) [2023-12-26 05:23:04,909][123090] Updated weights for policy 1, policy_version 721130 (0.0005) [2023-12-26 05:23:04,981][123090] Updated weights for policy 1, policy_version 721140 (0.0007) [2023-12-26 05:23:05,055][123090] Updated weights for policy 1, policy_version 721150 (0.0009) [2023-12-26 05:23:05,593][123091] Updated weights for policy 0, policy_version 725556 (0.0008) [2023-12-26 05:23:05,645][123091] Updated weights for policy 0, policy_version 725566 (0.0005) [2023-12-26 05:23:05,701][123091] Updated weights for policy 0, policy_version 725576 (0.0007) [2023-12-26 05:23:05,820][123090] Updated weights for policy 1, policy_version 721160 (0.0006) [2023-12-26 05:23:05,890][123090] Updated weights for policy 1, policy_version 721170 (0.0007) [2023-12-26 05:23:05,942][123090] Updated weights for policy 1, policy_version 721180 (0.0009) [2023-12-26 05:23:06,459][123091] Updated weights for policy 0, policy_version 725586 (0.0008) [2023-12-26 05:23:06,528][123091] Updated weights for policy 0, policy_version 725596 (0.0005) [2023-12-26 05:23:06,596][123091] Updated weights for policy 0, policy_version 725606 (0.0006) [2023-12-26 05:23:06,663][123091] Updated weights for policy 0, policy_version 725616 (0.0005) [2023-12-26 05:23:06,709][123090] Updated weights for policy 1, policy_version 721190 (0.0010) [2023-12-26 05:23:06,765][123090] Updated weights for policy 1, policy_version 721202 (0.0011) [2023-12-26 05:23:06,822][123090] Updated weights for policy 1, policy_version 721212 (0.0010) [2023-12-26 05:23:07,316][123091] Updated weights for policy 0, policy_version 725626 (0.0009) [2023-12-26 05:23:07,377][123091] Updated weights for policy 0, policy_version 725636 (0.0008) [2023-12-26 05:23:07,440][123091] Updated weights for policy 0, policy_version 725646 (0.0009) [2023-12-26 05:23:07,747][123090] Updated weights for policy 1, policy_version 721222 (0.0010) [2023-12-26 05:23:07,810][123090] Updated weights for policy 1, policy_version 721232 (0.0009) [2023-12-26 05:23:07,883][123090] Updated weights for policy 1, policy_version 721242 (0.0010) [2023-12-26 05:23:08,276][123091] Updated weights for policy 0, policy_version 725656 (0.0008) [2023-12-26 05:23:08,343][123091] Updated weights for policy 0, policy_version 725666 (0.0009) [2023-12-26 05:23:08,416][123091] Updated weights for policy 0, policy_version 725676 (0.0010) [2023-12-26 05:23:08,712][123090] Updated weights for policy 1, policy_version 721252 (0.0009) [2023-12-26 05:23:08,775][123090] Updated weights for policy 1, policy_version 721262 (0.0010) [2023-12-26 05:23:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 370417664. Throughput: 0: 8921.0, 1: 8861.3. Samples: 370397144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:08,785][121949] Avg episode reward: [(0, '6229.369'), (1, '5101.587')] [2023-12-26 05:23:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000725680_185778176.pth... [2023-12-26 05:23:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000724624_185507840.pth [2023-12-26 05:23:08,842][123090] Updated weights for policy 1, policy_version 721272 (0.0010) [2023-12-26 05:23:08,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000721280_184647680.pth... [2023-12-26 05:23:08,901][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000720224_184377344.pth [2023-12-26 05:23:09,259][123091] Updated weights for policy 0, policy_version 725686 (0.0010) [2023-12-26 05:23:09,318][123091] Updated weights for policy 0, policy_version 725697 (0.0010) [2023-12-26 05:23:09,388][123091] Updated weights for policy 0, policy_version 725707 (0.0009) [2023-12-26 05:23:09,705][123090] Updated weights for policy 1, policy_version 721282 (0.0009) [2023-12-26 05:23:09,759][123090] Updated weights for policy 1, policy_version 721292 (0.0009) [2023-12-26 05:23:09,815][123090] Updated weights for policy 1, policy_version 721302 (0.0010) [2023-12-26 05:23:09,886][123090] Updated weights for policy 1, policy_version 721312 (0.0010) [2023-12-26 05:23:10,256][123091] Updated weights for policy 0, policy_version 725717 (0.0010) [2023-12-26 05:23:10,317][123091] Updated weights for policy 0, policy_version 725727 (0.0009) [2023-12-26 05:23:10,383][123091] Updated weights for policy 0, policy_version 725737 (0.0008) [2023-12-26 05:23:10,798][123090] Updated weights for policy 1, policy_version 721322 (0.0007) [2023-12-26 05:23:10,861][123090] Updated weights for policy 1, policy_version 721332 (0.0006) [2023-12-26 05:23:10,921][123090] Updated weights for policy 1, policy_version 721342 (0.0006) [2023-12-26 05:23:11,082][123091] Updated weights for policy 0, policy_version 725747 (0.0006) [2023-12-26 05:23:11,145][123091] Updated weights for policy 0, policy_version 725757 (0.0009) [2023-12-26 05:23:11,219][123091] Updated weights for policy 0, policy_version 725767 (0.0008) [2023-12-26 05:23:11,779][123090] Updated weights for policy 1, policy_version 721352 (0.0008) [2023-12-26 05:23:11,847][123090] Updated weights for policy 1, policy_version 721362 (0.0009) [2023-12-26 05:23:11,912][123090] Updated weights for policy 1, policy_version 721372 (0.0010) [2023-12-26 05:23:12,026][123091] Updated weights for policy 0, policy_version 725777 (0.0007) [2023-12-26 05:23:12,085][123091] Updated weights for policy 0, policy_version 725787 (0.0010) [2023-12-26 05:23:12,141][123091] Updated weights for policy 0, policy_version 725797 (0.0009) [2023-12-26 05:23:12,197][123091] Updated weights for policy 0, policy_version 725807 (0.0010) [2023-12-26 05:23:12,766][123090] Updated weights for policy 1, policy_version 721382 (0.0010) [2023-12-26 05:23:12,834][123090] Updated weights for policy 1, policy_version 721392 (0.0008) [2023-12-26 05:23:12,894][123090] Updated weights for policy 1, policy_version 721402 (0.0009) [2023-12-26 05:23:13,020][123091] Updated weights for policy 0, policy_version 725817 (0.0010) [2023-12-26 05:23:13,078][123091] Updated weights for policy 0, policy_version 725827 (0.0010) [2023-12-26 05:23:13,129][123091] Updated weights for policy 0, policy_version 725837 (0.0010) [2023-12-26 05:23:13,668][123090] Updated weights for policy 1, policy_version 721412 (0.0007) [2023-12-26 05:23:13,740][123090] Updated weights for policy 1, policy_version 721422 (0.0005) [2023-12-26 05:23:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 370499584. Throughput: 0: 8871.6, 1: 8753.6. Samples: 370499592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:13,785][121949] Avg episode reward: [(0, '6150.243'), (1, '5051.407')] [2023-12-26 05:23:13,812][123090] Updated weights for policy 1, policy_version 721432 (0.0005) [2023-12-26 05:23:13,885][123091] Updated weights for policy 0, policy_version 725847 (0.0007) [2023-12-26 05:23:13,948][123091] Updated weights for policy 0, policy_version 725857 (0.0005) [2023-12-26 05:23:13,994][123091] Updated weights for policy 0, policy_version 725867 (0.0005) [2023-12-26 05:23:14,464][123090] Updated weights for policy 1, policy_version 721442 (0.0006) [2023-12-26 05:23:14,518][123090] Updated weights for policy 1, policy_version 721452 (0.0010) [2023-12-26 05:23:14,576][123090] Updated weights for policy 1, policy_version 721462 (0.0010) [2023-12-26 05:23:14,642][123090] Updated weights for policy 1, policy_version 721472 (0.0010) [2023-12-26 05:23:14,705][123091] Updated weights for policy 0, policy_version 725877 (0.0008) [2023-12-26 05:23:14,771][123091] Updated weights for policy 0, policy_version 725887 (0.0010) [2023-12-26 05:23:14,842][123091] Updated weights for policy 0, policy_version 725897 (0.0006) [2023-12-26 05:23:15,462][123090] Updated weights for policy 1, policy_version 721482 (0.0009) [2023-12-26 05:23:15,524][123090] Updated weights for policy 1, policy_version 721492 (0.0009) [2023-12-26 05:23:15,595][123090] Updated weights for policy 1, policy_version 721502 (0.0009) [2023-12-26 05:23:15,650][123091] Updated weights for policy 0, policy_version 725907 (0.0010) [2023-12-26 05:23:15,717][123091] Updated weights for policy 0, policy_version 725917 (0.0011) [2023-12-26 05:23:15,788][123091] Updated weights for policy 0, policy_version 725927 (0.0011) [2023-12-26 05:23:16,455][123090] Updated weights for policy 1, policy_version 721512 (0.0008) [2023-12-26 05:23:16,522][123090] Updated weights for policy 1, policy_version 721522 (0.0008) [2023-12-26 05:23:16,575][123090] Updated weights for policy 1, policy_version 721532 (0.0009) [2023-12-26 05:23:16,576][123091] Updated weights for policy 0, policy_version 725937 (0.0011) [2023-12-26 05:23:16,636][123091] Updated weights for policy 0, policy_version 725947 (0.0008) [2023-12-26 05:23:16,702][123091] Updated weights for policy 0, policy_version 725957 (0.0006) [2023-12-26 05:23:16,775][123091] Updated weights for policy 0, policy_version 725967 (0.0005) [2023-12-26 05:23:17,401][123091] Updated weights for policy 0, policy_version 725977 (0.0006) [2023-12-26 05:23:17,455][123091] Updated weights for policy 0, policy_version 725987 (0.0006) [2023-12-26 05:23:17,472][123090] Updated weights for policy 1, policy_version 721542 (0.0009) [2023-12-26 05:23:17,512][123091] Updated weights for policy 0, policy_version 725997 (0.0006) [2023-12-26 05:23:17,533][123090] Updated weights for policy 1, policy_version 721552 (0.0008) [2023-12-26 05:23:17,592][123090] Updated weights for policy 1, policy_version 721562 (0.0009) [2023-12-26 05:23:18,116][123091] Updated weights for policy 0, policy_version 726007 (0.0008) [2023-12-26 05:23:18,179][123091] Updated weights for policy 0, policy_version 726017 (0.0010) [2023-12-26 05:23:18,239][123091] Updated weights for policy 0, policy_version 726027 (0.0010) [2023-12-26 05:23:18,458][123090] Updated weights for policy 1, policy_version 721572 (0.0010) [2023-12-26 05:23:18,511][123090] Updated weights for policy 1, policy_version 721582 (0.0010) [2023-12-26 05:23:18,563][123090] Updated weights for policy 1, policy_version 721592 (0.0010) [2023-12-26 05:23:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 370597888. Throughput: 0: 8958.4, 1: 8747.3. Samples: 370606640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:18,784][121949] Avg episode reward: [(0, '6113.564'), (1, '5105.983')] [2023-12-26 05:23:19,007][123091] Updated weights for policy 0, policy_version 726037 (0.0010) [2023-12-26 05:23:19,071][123091] Updated weights for policy 0, policy_version 726047 (0.0009) [2023-12-26 05:23:19,139][123091] Updated weights for policy 0, policy_version 726057 (0.0010) [2023-12-26 05:23:19,463][123090] Updated weights for policy 1, policy_version 721603 (0.0008) [2023-12-26 05:23:19,539][123090] Updated weights for policy 1, policy_version 721613 (0.0009) [2023-12-26 05:23:19,613][123090] Updated weights for policy 1, policy_version 721623 (0.0009) [2023-12-26 05:23:20,002][123091] Updated weights for policy 0, policy_version 726067 (0.0009) [2023-12-26 05:23:20,055][123091] Updated weights for policy 0, policy_version 726077 (0.0008) [2023-12-26 05:23:20,108][123091] Updated weights for policy 0, policy_version 726087 (0.0008) [2023-12-26 05:23:20,476][123090] Updated weights for policy 1, policy_version 721633 (0.0010) [2023-12-26 05:23:20,531][123090] Updated weights for policy 1, policy_version 721643 (0.0009) [2023-12-26 05:23:20,609][123090] Updated weights for policy 1, policy_version 721653 (0.0010) [2023-12-26 05:23:20,663][123090] Updated weights for policy 1, policy_version 721663 (0.0010) [2023-12-26 05:23:20,915][123091] Updated weights for policy 0, policy_version 726097 (0.0007) [2023-12-26 05:23:20,979][123091] Updated weights for policy 0, policy_version 726107 (0.0009) [2023-12-26 05:23:21,044][123091] Updated weights for policy 0, policy_version 726117 (0.0010) [2023-12-26 05:23:21,109][123091] Updated weights for policy 0, policy_version 726127 (0.0011) [2023-12-26 05:23:21,520][123090] Updated weights for policy 1, policy_version 721673 (0.0006) [2023-12-26 05:23:21,589][123090] Updated weights for policy 1, policy_version 721683 (0.0006) [2023-12-26 05:23:21,662][123090] Updated weights for policy 1, policy_version 721693 (0.0008) [2023-12-26 05:23:21,970][123091] Updated weights for policy 0, policy_version 726137 (0.0009) [2023-12-26 05:23:22,026][123091] Updated weights for policy 0, policy_version 726147 (0.0010) [2023-12-26 05:23:22,082][123091] Updated weights for policy 0, policy_version 726157 (0.0010) [2023-12-26 05:23:22,493][123090] Updated weights for policy 1, policy_version 721703 (0.0010) [2023-12-26 05:23:22,552][123090] Updated weights for policy 1, policy_version 721713 (0.0006) [2023-12-26 05:23:22,626][123090] Updated weights for policy 1, policy_version 721723 (0.0006) [2023-12-26 05:23:22,978][123091] Updated weights for policy 0, policy_version 726167 (0.0010) [2023-12-26 05:23:23,044][123091] Updated weights for policy 0, policy_version 726177 (0.0008) [2023-12-26 05:23:23,109][123091] Updated weights for policy 0, policy_version 726187 (0.0009) [2023-12-26 05:23:23,431][123090] Updated weights for policy 1, policy_version 721733 (0.0008) [2023-12-26 05:23:23,483][123090] Updated weights for policy 1, policy_version 721743 (0.0009) [2023-12-26 05:23:23,536][123090] Updated weights for policy 1, policy_version 721753 (0.0010) [2023-12-26 05:23:23,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17612.6, 300 sec: 17689.1). Total num frames: 370679808. Throughput: 0: 8920.9, 1: 8668.8. Samples: 370656796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:23,786][121949] Avg episode reward: [(0, '6216.824'), (1, '5219.942')] [2023-12-26 05:23:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000726192_185909248.pth... [2023-12-26 05:23:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000721760_184770560.pth... [2023-12-26 05:23:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000720736_184508416.pth [2023-12-26 05:23:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000725168_185647104.pth [2023-12-26 05:23:23,901][123091] Updated weights for policy 0, policy_version 726197 (0.0009) [2023-12-26 05:23:23,958][123091] Updated weights for policy 0, policy_version 726207 (0.0009) [2023-12-26 05:23:24,017][123091] Updated weights for policy 0, policy_version 726217 (0.0009) [2023-12-26 05:23:24,374][123090] Updated weights for policy 1, policy_version 721763 (0.0010) [2023-12-26 05:23:24,417][123090] Updated weights for policy 1, policy_version 721773 (0.0006) [2023-12-26 05:23:24,474][123090] Updated weights for policy 1, policy_version 721783 (0.0006) [2023-12-26 05:23:24,924][123091] Updated weights for policy 0, policy_version 726227 (0.0009) [2023-12-26 05:23:24,982][123091] Updated weights for policy 0, policy_version 726239 (0.0012) [2023-12-26 05:23:25,028][123091] Updated weights for policy 0, policy_version 726249 (0.0012) [2023-12-26 05:23:25,241][123090] Updated weights for policy 1, policy_version 721793 (0.0005) [2023-12-26 05:23:25,307][123090] Updated weights for policy 1, policy_version 721803 (0.0009) [2023-12-26 05:23:25,378][123090] Updated weights for policy 1, policy_version 721813 (0.0009) [2023-12-26 05:23:25,448][123090] Updated weights for policy 1, policy_version 721823 (0.0009) [2023-12-26 05:23:25,817][123091] Updated weights for policy 0, policy_version 726260 (0.0008) [2023-12-26 05:23:25,871][123091] Updated weights for policy 0, policy_version 726270 (0.0006) [2023-12-26 05:23:25,930][123091] Updated weights for policy 0, policy_version 726280 (0.0005) [2023-12-26 05:23:26,251][123090] Updated weights for policy 1, policy_version 721833 (0.0010) [2023-12-26 05:23:26,319][123090] Updated weights for policy 1, policy_version 721843 (0.0008) [2023-12-26 05:23:26,388][123090] Updated weights for policy 1, policy_version 721853 (0.0008) [2023-12-26 05:23:26,673][123091] Updated weights for policy 0, policy_version 726290 (0.0006) [2023-12-26 05:23:26,737][123091] Updated weights for policy 0, policy_version 726300 (0.0009) [2023-12-26 05:23:26,800][123091] Updated weights for policy 0, policy_version 726310 (0.0008) [2023-12-26 05:23:26,862][123091] Updated weights for policy 0, policy_version 726320 (0.0011) [2023-12-26 05:23:27,194][123090] Updated weights for policy 1, policy_version 721863 (0.0010) [2023-12-26 05:23:27,256][123090] Updated weights for policy 1, policy_version 721874 (0.0010) [2023-12-26 05:23:27,315][123090] Updated weights for policy 1, policy_version 721884 (0.0010) [2023-12-26 05:23:27,572][123091] Updated weights for policy 0, policy_version 726330 (0.0009) [2023-12-26 05:23:27,625][123091] Updated weights for policy 0, policy_version 726340 (0.0009) [2023-12-26 05:23:27,677][123091] Updated weights for policy 0, policy_version 726350 (0.0009) [2023-12-26 05:23:28,185][123090] Updated weights for policy 1, policy_version 721894 (0.0007) [2023-12-26 05:23:28,233][123090] Updated weights for policy 1, policy_version 721904 (0.0005) [2023-12-26 05:23:28,278][123090] Updated weights for policy 1, policy_version 721914 (0.0005) [2023-12-26 05:23:28,469][123091] Updated weights for policy 0, policy_version 726360 (0.0008) [2023-12-26 05:23:28,519][123091] Updated weights for policy 0, policy_version 726370 (0.0009) [2023-12-26 05:23:28,576][123091] Updated weights for policy 0, policy_version 726380 (0.0009) [2023-12-26 05:23:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 370769920. Throughput: 0: 8914.6, 1: 8661.5. Samples: 370761364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:28,784][121949] Avg episode reward: [(0, '6218.549'), (1, '5425.542')] [2023-12-26 05:23:29,023][123090] Updated weights for policy 1, policy_version 721924 (0.0005) [2023-12-26 05:23:29,091][123090] Updated weights for policy 1, policy_version 721934 (0.0005) [2023-12-26 05:23:29,151][123090] Updated weights for policy 1, policy_version 721944 (0.0005) [2023-12-26 05:23:29,366][123091] Updated weights for policy 0, policy_version 726390 (0.0008) [2023-12-26 05:23:29,429][123091] Updated weights for policy 0, policy_version 726400 (0.0006) [2023-12-26 05:23:29,499][123091] Updated weights for policy 0, policy_version 726410 (0.0006) [2023-12-26 05:23:29,900][123090] Updated weights for policy 1, policy_version 721954 (0.0008) [2023-12-26 05:23:29,967][123090] Updated weights for policy 1, policy_version 721964 (0.0007) [2023-12-26 05:23:30,035][123090] Updated weights for policy 1, policy_version 721974 (0.0006) [2023-12-26 05:23:30,083][123090] Updated weights for policy 1, policy_version 721984 (0.0005) [2023-12-26 05:23:30,300][123091] Updated weights for policy 0, policy_version 726420 (0.0009) [2023-12-26 05:23:30,372][123091] Updated weights for policy 0, policy_version 726430 (0.0011) [2023-12-26 05:23:30,427][123091] Updated weights for policy 0, policy_version 726440 (0.0010) [2023-12-26 05:23:30,732][123090] Updated weights for policy 1, policy_version 721994 (0.0009) [2023-12-26 05:23:30,795][123090] Updated weights for policy 1, policy_version 722004 (0.0009) [2023-12-26 05:23:30,842][123090] Updated weights for policy 1, policy_version 722014 (0.0008) [2023-12-26 05:23:31,277][123091] Updated weights for policy 0, policy_version 726450 (0.0009) [2023-12-26 05:23:31,345][123091] Updated weights for policy 0, policy_version 726460 (0.0007) [2023-12-26 05:23:31,410][123091] Updated weights for policy 0, policy_version 726471 (0.0010) [2023-12-26 05:23:31,697][123090] Updated weights for policy 1, policy_version 722024 (0.0009) [2023-12-26 05:23:31,766][123090] Updated weights for policy 1, policy_version 722034 (0.0009) [2023-12-26 05:23:31,818][123090] Updated weights for policy 1, policy_version 722044 (0.0009) [2023-12-26 05:23:32,157][123091] Updated weights for policy 0, policy_version 726481 (0.0009) [2023-12-26 05:23:32,225][123091] Updated weights for policy 0, policy_version 726491 (0.0006) [2023-12-26 05:23:32,302][123091] Updated weights for policy 0, policy_version 726501 (0.0007) [2023-12-26 05:23:32,377][123091] Updated weights for policy 0, policy_version 726511 (0.0007) [2023-12-26 05:23:32,688][123090] Updated weights for policy 1, policy_version 722054 (0.0007) [2023-12-26 05:23:32,762][123090] Updated weights for policy 1, policy_version 722064 (0.0006) [2023-12-26 05:23:32,835][123090] Updated weights for policy 1, policy_version 722074 (0.0006) [2023-12-26 05:23:33,067][123091] Updated weights for policy 0, policy_version 726521 (0.0006) [2023-12-26 05:23:33,130][123091] Updated weights for policy 0, policy_version 726531 (0.0005) [2023-12-26 05:23:33,192][123091] Updated weights for policy 0, policy_version 726541 (0.0005) [2023-12-26 05:23:33,490][123090] Updated weights for policy 1, policy_version 722084 (0.0008) [2023-12-26 05:23:33,552][123090] Updated weights for policy 1, policy_version 722094 (0.0008) [2023-12-26 05:23:33,617][123090] Updated weights for policy 1, policy_version 722104 (0.0008) [2023-12-26 05:23:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 370860032. Throughput: 0: 8948.8, 1: 8700.3. Samples: 370869880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:33,785][121949] Avg episode reward: [(0, '6211.292'), (1, '5301.685')] [2023-12-26 05:23:33,873][123091] Updated weights for policy 0, policy_version 726551 (0.0005) [2023-12-26 05:23:33,931][123091] Updated weights for policy 0, policy_version 726561 (0.0009) [2023-12-26 05:23:33,982][123091] Updated weights for policy 0, policy_version 726571 (0.0010) [2023-12-26 05:23:34,343][123090] Updated weights for policy 1, policy_version 722114 (0.0006) [2023-12-26 05:23:34,393][123090] Updated weights for policy 1, policy_version 722124 (0.0009) [2023-12-26 05:23:34,446][123090] Updated weights for policy 1, policy_version 722134 (0.0009) [2023-12-26 05:23:34,507][123090] Updated weights for policy 1, policy_version 722144 (0.0008) [2023-12-26 05:23:34,851][123091] Updated weights for policy 0, policy_version 726582 (0.0008) [2023-12-26 05:23:34,901][123091] Updated weights for policy 0, policy_version 726592 (0.0006) [2023-12-26 05:23:34,956][123091] Updated weights for policy 0, policy_version 726602 (0.0006) [2023-12-26 05:23:35,383][123090] Updated weights for policy 1, policy_version 722154 (0.0009) [2023-12-26 05:23:35,431][123090] Updated weights for policy 1, policy_version 722164 (0.0009) [2023-12-26 05:23:35,482][123090] Updated weights for policy 1, policy_version 722174 (0.0009) [2023-12-26 05:23:35,681][123091] Updated weights for policy 0, policy_version 726612 (0.0008) [2023-12-26 05:23:35,745][123091] Updated weights for policy 0, policy_version 726622 (0.0010) [2023-12-26 05:23:35,804][123091] Updated weights for policy 0, policy_version 726632 (0.0010) [2023-12-26 05:23:36,245][123090] Updated weights for policy 1, policy_version 722184 (0.0006) [2023-12-26 05:23:36,317][123090] Updated weights for policy 1, policy_version 722194 (0.0006) [2023-12-26 05:23:36,395][123090] Updated weights for policy 1, policy_version 722204 (0.0010) [2023-12-26 05:23:36,621][123091] Updated weights for policy 0, policy_version 726642 (0.0009) [2023-12-26 05:23:36,699][123091] Updated weights for policy 0, policy_version 726652 (0.0007) [2023-12-26 05:23:36,762][123091] Updated weights for policy 0, policy_version 726662 (0.0011) [2023-12-26 05:23:36,837][123091] Updated weights for policy 0, policy_version 726672 (0.0011) [2023-12-26 05:23:37,210][123090] Updated weights for policy 1, policy_version 722214 (0.0008) [2023-12-26 05:23:37,269][123090] Updated weights for policy 1, policy_version 722224 (0.0008) [2023-12-26 05:23:37,337][123090] Updated weights for policy 1, policy_version 722234 (0.0009) [2023-12-26 05:23:37,621][123091] Updated weights for policy 0, policy_version 726682 (0.0011) [2023-12-26 05:23:37,692][123091] Updated weights for policy 0, policy_version 726692 (0.0011) [2023-12-26 05:23:37,760][123091] Updated weights for policy 0, policy_version 726702 (0.0011) [2023-12-26 05:23:38,133][123090] Updated weights for policy 1, policy_version 722244 (0.0010) [2023-12-26 05:23:38,199][123090] Updated weights for policy 1, policy_version 722254 (0.0010) [2023-12-26 05:23:38,258][123090] Updated weights for policy 1, policy_version 722264 (0.0010) [2023-12-26 05:23:38,438][123091] Updated weights for policy 0, policy_version 726712 (0.0007) [2023-12-26 05:23:38,499][123091] Updated weights for policy 0, policy_version 726722 (0.0010) [2023-12-26 05:23:38,562][123091] Updated weights for policy 0, policy_version 726732 (0.0011) [2023-12-26 05:23:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 370950144. Throughput: 0: 8983.3, 1: 8730.6. Samples: 370924416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:38,785][121949] Avg episode reward: [(0, '6098.525'), (1, '5031.992')] [2023-12-26 05:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000726736_186048512.pth... [2023-12-26 05:23:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000722272_184901632.pth... [2023-12-26 05:23:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000725680_185778176.pth [2023-12-26 05:23:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000721280_184647680.pth [2023-12-26 05:23:39,096][123090] Updated weights for policy 1, policy_version 722274 (0.0010) [2023-12-26 05:23:39,144][123090] Updated weights for policy 1, policy_version 722284 (0.0008) [2023-12-26 05:23:39,202][123090] Updated weights for policy 1, policy_version 722294 (0.0007) [2023-12-26 05:23:39,278][123090] Updated weights for policy 1, policy_version 722304 (0.0010) [2023-12-26 05:23:39,356][123091] Updated weights for policy 0, policy_version 726742 (0.0011) [2023-12-26 05:23:39,427][123091] Updated weights for policy 0, policy_version 726752 (0.0010) [2023-12-26 05:23:39,494][123091] Updated weights for policy 0, policy_version 726762 (0.0007) [2023-12-26 05:23:40,095][123090] Updated weights for policy 1, policy_version 722314 (0.0008) [2023-12-26 05:23:40,148][123090] Updated weights for policy 1, policy_version 722324 (0.0010) [2023-12-26 05:23:40,201][123090] Updated weights for policy 1, policy_version 722334 (0.0006) [2023-12-26 05:23:40,286][123091] Updated weights for policy 0, policy_version 726772 (0.0005) [2023-12-26 05:23:40,342][123091] Updated weights for policy 0, policy_version 726782 (0.0007) [2023-12-26 05:23:40,412][123091] Updated weights for policy 0, policy_version 726792 (0.0008) [2023-12-26 05:23:40,924][123090] Updated weights for policy 1, policy_version 722344 (0.0005) [2023-12-26 05:23:40,985][123090] Updated weights for policy 1, policy_version 722354 (0.0005) [2023-12-26 05:23:41,054][123090] Updated weights for policy 1, policy_version 722364 (0.0006) [2023-12-26 05:23:41,079][123091] Updated weights for policy 0, policy_version 726802 (0.0006) [2023-12-26 05:23:41,152][123091] Updated weights for policy 0, policy_version 726812 (0.0009) [2023-12-26 05:23:41,223][123091] Updated weights for policy 0, policy_version 726822 (0.0010) [2023-12-26 05:23:41,289][123091] Updated weights for policy 0, policy_version 726832 (0.0009) [2023-12-26 05:23:41,847][123090] Updated weights for policy 1, policy_version 722374 (0.0009) [2023-12-26 05:23:41,913][123090] Updated weights for policy 1, policy_version 722384 (0.0009) [2023-12-26 05:23:41,979][123090] Updated weights for policy 1, policy_version 722394 (0.0010) [2023-12-26 05:23:42,057][123091] Updated weights for policy 0, policy_version 726842 (0.0006) [2023-12-26 05:23:42,115][123091] Updated weights for policy 0, policy_version 726852 (0.0010) [2023-12-26 05:23:42,173][123091] Updated weights for policy 0, policy_version 726862 (0.0010) [2023-12-26 05:23:42,775][123090] Updated weights for policy 1, policy_version 722404 (0.0009) [2023-12-26 05:23:42,827][123090] Updated weights for policy 1, policy_version 722414 (0.0010) [2023-12-26 05:23:42,882][123090] Updated weights for policy 1, policy_version 722424 (0.0010) [2023-12-26 05:23:43,000][123091] Updated weights for policy 0, policy_version 726872 (0.0008) [2023-12-26 05:23:43,048][123091] Updated weights for policy 0, policy_version 726882 (0.0009) [2023-12-26 05:23:43,100][123091] Updated weights for policy 0, policy_version 726892 (0.0009) [2023-12-26 05:23:43,690][123090] Updated weights for policy 1, policy_version 722434 (0.0009) [2023-12-26 05:23:43,742][123090] Updated weights for policy 1, policy_version 722444 (0.0005) [2023-12-26 05:23:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 371032064. Throughput: 0: 8950.1, 1: 8644.0. Samples: 371030512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:43,785][121949] Avg episode reward: [(0, '6068.397'), (1, '4889.840')] [2023-12-26 05:23:43,813][123090] Updated weights for policy 1, policy_version 722454 (0.0005) [2023-12-26 05:23:43,876][123090] Updated weights for policy 1, policy_version 722464 (0.0005) [2023-12-26 05:23:43,899][123091] Updated weights for policy 0, policy_version 726902 (0.0007) [2023-12-26 05:23:43,953][123091] Updated weights for policy 0, policy_version 726912 (0.0010) [2023-12-26 05:23:44,004][123091] Updated weights for policy 0, policy_version 726922 (0.0010) [2023-12-26 05:23:44,597][123090] Updated weights for policy 1, policy_version 722474 (0.0005) [2023-12-26 05:23:44,664][123090] Updated weights for policy 1, policy_version 722484 (0.0005) [2023-12-26 05:23:44,728][123090] Updated weights for policy 1, policy_version 722494 (0.0009) [2023-12-26 05:23:44,827][123091] Updated weights for policy 0, policy_version 726932 (0.0008) [2023-12-26 05:23:44,889][123091] Updated weights for policy 0, policy_version 726942 (0.0005) [2023-12-26 05:23:44,952][123091] Updated weights for policy 0, policy_version 726952 (0.0005) [2023-12-26 05:23:45,537][123090] Updated weights for policy 1, policy_version 722504 (0.0010) [2023-12-26 05:23:45,604][123090] Updated weights for policy 1, policy_version 722514 (0.0011) [2023-12-26 05:23:45,662][123090] Updated weights for policy 1, policy_version 722524 (0.0010) [2023-12-26 05:23:45,662][123091] Updated weights for policy 0, policy_version 726962 (0.0006) [2023-12-26 05:23:45,727][123091] Updated weights for policy 0, policy_version 726972 (0.0009) [2023-12-26 05:23:45,780][123091] Updated weights for policy 0, policy_version 726982 (0.0009) [2023-12-26 05:23:45,840][123091] Updated weights for policy 0, policy_version 726992 (0.0005) [2023-12-26 05:23:46,470][123090] Updated weights for policy 1, policy_version 722534 (0.0009) [2023-12-26 05:23:46,535][123090] Updated weights for policy 1, policy_version 722544 (0.0011) [2023-12-26 05:23:46,599][123090] Updated weights for policy 1, policy_version 722554 (0.0011) [2023-12-26 05:23:46,668][123091] Updated weights for policy 0, policy_version 727002 (0.0007) [2023-12-26 05:23:46,727][123091] Updated weights for policy 0, policy_version 727012 (0.0006) [2023-12-26 05:23:46,793][123091] Updated weights for policy 0, policy_version 727022 (0.0006) [2023-12-26 05:23:47,424][123090] Updated weights for policy 1, policy_version 722564 (0.0011) [2023-12-26 05:23:47,476][123090] Updated weights for policy 1, policy_version 722574 (0.0010) [2023-12-26 05:23:47,539][123090] Updated weights for policy 1, policy_version 722584 (0.0010) [2023-12-26 05:23:47,558][123091] Updated weights for policy 0, policy_version 727032 (0.0006) [2023-12-26 05:23:47,608][123091] Updated weights for policy 0, policy_version 727042 (0.0005) [2023-12-26 05:23:47,670][123091] Updated weights for policy 0, policy_version 727052 (0.0007) [2023-12-26 05:23:48,357][123091] Updated weights for policy 0, policy_version 727062 (0.0009) [2023-12-26 05:23:48,381][123090] Updated weights for policy 1, policy_version 722594 (0.0009) [2023-12-26 05:23:48,420][123091] Updated weights for policy 0, policy_version 727072 (0.0011) [2023-12-26 05:23:48,446][123090] Updated weights for policy 1, policy_version 722604 (0.0011) [2023-12-26 05:23:48,483][123091] Updated weights for policy 0, policy_version 727082 (0.0008) [2023-12-26 05:23:48,510][123090] Updated weights for policy 1, policy_version 722614 (0.0011) [2023-12-26 05:23:48,570][123090] Updated weights for policy 1, policy_version 722624 (0.0011) [2023-12-26 05:23:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 371130368. Throughput: 0: 8993.0, 1: 8660.9. Samples: 371137688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:48,785][121949] Avg episode reward: [(0, '6088.178'), (1, '4894.254')] [2023-12-26 05:23:49,162][123091] Updated weights for policy 0, policy_version 727092 (0.0006) [2023-12-26 05:23:49,217][123091] Updated weights for policy 0, policy_version 727103 (0.0009) [2023-12-26 05:23:49,286][123091] Updated weights for policy 0, policy_version 727113 (0.0008) [2023-12-26 05:23:49,299][123090] Updated weights for policy 1, policy_version 722634 (0.0011) [2023-12-26 05:23:49,360][123090] Updated weights for policy 1, policy_version 722644 (0.0010) [2023-12-26 05:23:49,432][123090] Updated weights for policy 1, policy_version 722654 (0.0011) [2023-12-26 05:23:50,122][123091] Updated weights for policy 0, policy_version 727123 (0.0007) [2023-12-26 05:23:50,184][123091] Updated weights for policy 0, policy_version 727133 (0.0009) [2023-12-26 05:23:50,238][123091] Updated weights for policy 0, policy_version 727143 (0.0009) [2023-12-26 05:23:50,283][123090] Updated weights for policy 1, policy_version 722664 (0.0011) [2023-12-26 05:23:50,350][123090] Updated weights for policy 1, policy_version 722674 (0.0011) [2023-12-26 05:23:50,411][123090] Updated weights for policy 1, policy_version 722684 (0.0011) [2023-12-26 05:23:51,096][123091] Updated weights for policy 0, policy_version 727153 (0.0007) [2023-12-26 05:23:51,169][123091] Updated weights for policy 0, policy_version 727163 (0.0009) [2023-12-26 05:23:51,227][123091] Updated weights for policy 0, policy_version 727173 (0.0010) [2023-12-26 05:23:51,267][123090] Updated weights for policy 1, policy_version 722694 (0.0010) [2023-12-26 05:23:51,289][123091] Updated weights for policy 0, policy_version 727183 (0.0009) [2023-12-26 05:23:51,334][123090] Updated weights for policy 1, policy_version 722704 (0.0010) [2023-12-26 05:23:51,411][123090] Updated weights for policy 1, policy_version 722714 (0.0009) [2023-12-26 05:23:52,088][123091] Updated weights for policy 0, policy_version 727193 (0.0010) [2023-12-26 05:23:52,159][123091] Updated weights for policy 0, policy_version 727203 (0.0009) [2023-12-26 05:23:52,227][123091] Updated weights for policy 0, policy_version 727213 (0.0009) [2023-12-26 05:23:52,284][123090] Updated weights for policy 1, policy_version 722724 (0.0008) [2023-12-26 05:23:52,351][123090] Updated weights for policy 1, policy_version 722734 (0.0009) [2023-12-26 05:23:52,424][123090] Updated weights for policy 1, policy_version 722744 (0.0011) [2023-12-26 05:23:52,988][123091] Updated weights for policy 0, policy_version 727223 (0.0010) [2023-12-26 05:23:53,047][123091] Updated weights for policy 0, policy_version 727233 (0.0010) [2023-12-26 05:23:53,109][123091] Updated weights for policy 0, policy_version 727243 (0.0010) [2023-12-26 05:23:53,213][123090] Updated weights for policy 1, policy_version 722754 (0.0010) [2023-12-26 05:23:53,266][123090] Updated weights for policy 1, policy_version 722764 (0.0010) [2023-12-26 05:23:53,314][123090] Updated weights for policy 1, policy_version 722774 (0.0008) [2023-12-26 05:23:53,374][123090] Updated weights for policy 1, policy_version 722784 (0.0007) [2023-12-26 05:23:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 371212288. Throughput: 0: 8968.5, 1: 8640.0. Samples: 371189524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:53,785][121949] Avg episode reward: [(0, '6175.861'), (1, '4920.556')] [2023-12-26 05:23:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000727248_186179584.pth... [2023-12-26 05:23:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000722784_185032704.pth... [2023-12-26 05:23:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000726192_185909248.pth [2023-12-26 05:23:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000721760_184770560.pth [2023-12-26 05:23:53,982][123091] Updated weights for policy 0, policy_version 727253 (0.0010) [2023-12-26 05:23:54,039][123091] Updated weights for policy 0, policy_version 727264 (0.0009) [2023-12-26 05:23:54,094][123091] Updated weights for policy 0, policy_version 727274 (0.0009) [2023-12-26 05:23:54,137][123090] Updated weights for policy 1, policy_version 722794 (0.0005) [2023-12-26 05:23:54,205][123090] Updated weights for policy 1, policy_version 722804 (0.0008) [2023-12-26 05:23:54,273][123090] Updated weights for policy 1, policy_version 722814 (0.0006) [2023-12-26 05:23:54,838][123091] Updated weights for policy 0, policy_version 727284 (0.0006) [2023-12-26 05:23:54,893][123091] Updated weights for policy 0, policy_version 727294 (0.0005) [2023-12-26 05:23:54,947][123091] Updated weights for policy 0, policy_version 727304 (0.0006) [2023-12-26 05:23:55,137][123090] Updated weights for policy 1, policy_version 722824 (0.0010) [2023-12-26 05:23:55,195][123090] Updated weights for policy 1, policy_version 722834 (0.0010) [2023-12-26 05:23:55,250][123090] Updated weights for policy 1, policy_version 722844 (0.0010) [2023-12-26 05:23:55,643][123091] Updated weights for policy 0, policy_version 727314 (0.0007) [2023-12-26 05:23:55,691][123091] Updated weights for policy 0, policy_version 727324 (0.0009) [2023-12-26 05:23:55,752][123091] Updated weights for policy 0, policy_version 727334 (0.0009) [2023-12-26 05:23:55,804][123091] Updated weights for policy 0, policy_version 727344 (0.0010) [2023-12-26 05:23:56,068][123090] Updated weights for policy 1, policy_version 722854 (0.0009) [2023-12-26 05:23:56,129][123090] Updated weights for policy 1, policy_version 722864 (0.0009) [2023-12-26 05:23:56,183][123090] Updated weights for policy 1, policy_version 722874 (0.0009) [2023-12-26 05:23:56,662][123091] Updated weights for policy 0, policy_version 727354 (0.0010) [2023-12-26 05:23:56,725][123091] Updated weights for policy 0, policy_version 727364 (0.0006) [2023-12-26 05:23:56,780][123091] Updated weights for policy 0, policy_version 727374 (0.0006) [2023-12-26 05:23:57,003][123090] Updated weights for policy 1, policy_version 722884 (0.0009) [2023-12-26 05:23:57,060][123090] Updated weights for policy 1, policy_version 722895 (0.0009) [2023-12-26 05:23:57,120][123090] Updated weights for policy 1, policy_version 722905 (0.0009) [2023-12-26 05:23:57,547][123091] Updated weights for policy 0, policy_version 727384 (0.0009) [2023-12-26 05:23:57,610][123091] Updated weights for policy 0, policy_version 727394 (0.0009) [2023-12-26 05:23:57,672][123091] Updated weights for policy 0, policy_version 727404 (0.0009) [2023-12-26 05:23:58,028][123090] Updated weights for policy 1, policy_version 722915 (0.0008) [2023-12-26 05:23:58,088][123090] Updated weights for policy 1, policy_version 722925 (0.0010) [2023-12-26 05:23:58,147][123090] Updated weights for policy 1, policy_version 722935 (0.0010) [2023-12-26 05:23:58,424][123091] Updated weights for policy 0, policy_version 727414 (0.0005) [2023-12-26 05:23:58,496][123091] Updated weights for policy 0, policy_version 727424 (0.0007) [2023-12-26 05:23:58,565][123091] Updated weights for policy 0, policy_version 727434 (0.0008) [2023-12-26 05:23:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 371302400. Throughput: 0: 8998.8, 1: 8688.4. Samples: 371295520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:23:58,785][121949] Avg episode reward: [(0, '6186.913'), (1, '5017.181')] [2023-12-26 05:23:59,120][123090] Updated weights for policy 1, policy_version 722945 (0.0010) [2023-12-26 05:23:59,179][123090] Updated weights for policy 1, policy_version 722955 (0.0009) [2023-12-26 05:23:59,244][123090] Updated weights for policy 1, policy_version 722965 (0.0009) [2023-12-26 05:23:59,308][123090] Updated weights for policy 1, policy_version 722975 (0.0009) [2023-12-26 05:23:59,314][123091] Updated weights for policy 0, policy_version 727444 (0.0010) [2023-12-26 05:23:59,384][123091] Updated weights for policy 0, policy_version 727454 (0.0007) [2023-12-26 05:23:59,444][123091] Updated weights for policy 0, policy_version 727464 (0.0005) [2023-12-26 05:24:00,180][123090] Updated weights for policy 1, policy_version 722985 (0.0009) [2023-12-26 05:24:00,242][123090] Updated weights for policy 1, policy_version 722995 (0.0009) [2023-12-26 05:24:00,250][123091] Updated weights for policy 0, policy_version 727474 (0.0008) [2023-12-26 05:24:00,296][123090] Updated weights for policy 1, policy_version 723005 (0.0008) [2023-12-26 05:24:00,304][123091] Updated weights for policy 0, policy_version 727484 (0.0008) [2023-12-26 05:24:00,353][123091] Updated weights for policy 0, policy_version 727494 (0.0008) [2023-12-26 05:24:01,153][123090] Updated weights for policy 1, policy_version 723015 (0.0009) [2023-12-26 05:24:01,191][123091] Updated weights for policy 0, policy_version 727505 (0.0011) [2023-12-26 05:24:01,215][123090] Updated weights for policy 1, policy_version 723025 (0.0007) [2023-12-26 05:24:01,241][123091] Updated weights for policy 0, policy_version 727515 (0.0009) [2023-12-26 05:24:01,284][123090] Updated weights for policy 1, policy_version 723035 (0.0011) [2023-12-26 05:24:01,307][123091] Updated weights for policy 0, policy_version 727525 (0.0009) [2023-12-26 05:24:01,385][123091] Updated weights for policy 0, policy_version 727535 (0.0009) [2023-12-26 05:24:02,074][123090] Updated weights for policy 1, policy_version 723045 (0.0010) [2023-12-26 05:24:02,129][123090] Updated weights for policy 1, policy_version 723055 (0.0009) [2023-12-26 05:24:02,181][123090] Updated weights for policy 1, policy_version 723065 (0.0007) [2023-12-26 05:24:02,244][123091] Updated weights for policy 0, policy_version 727545 (0.0009) [2023-12-26 05:24:02,311][123091] Updated weights for policy 0, policy_version 727555 (0.0010) [2023-12-26 05:24:02,380][123091] Updated weights for policy 0, policy_version 727565 (0.0010) [2023-12-26 05:24:02,914][123090] Updated weights for policy 1, policy_version 723075 (0.0006) [2023-12-26 05:24:02,989][123090] Updated weights for policy 1, policy_version 723085 (0.0005) [2023-12-26 05:24:03,058][123090] Updated weights for policy 1, policy_version 723095 (0.0009) [2023-12-26 05:24:03,230][123091] Updated weights for policy 0, policy_version 727575 (0.0009) [2023-12-26 05:24:03,283][123091] Updated weights for policy 0, policy_version 727585 (0.0009) [2023-12-26 05:24:03,335][123091] Updated weights for policy 0, policy_version 727595 (0.0009) [2023-12-26 05:24:03,743][123090] Updated weights for policy 1, policy_version 723105 (0.0010) [2023-12-26 05:24:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 371384320. Throughput: 0: 8889.6, 1: 8707.8. Samples: 371398524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:03,785][121949] Avg episode reward: [(0, '6184.458'), (1, '5091.584')] [2023-12-26 05:24:03,818][123090] Updated weights for policy 1, policy_version 723115 (0.0006) [2023-12-26 05:24:03,882][123090] Updated weights for policy 1, policy_version 723125 (0.0008) [2023-12-26 05:24:03,935][123090] Updated weights for policy 1, policy_version 723135 (0.0009) [2023-12-26 05:24:04,288][123091] Updated weights for policy 0, policy_version 727605 (0.0009) [2023-12-26 05:24:04,352][123091] Updated weights for policy 0, policy_version 727615 (0.0009) [2023-12-26 05:24:04,417][123091] Updated weights for policy 0, policy_version 727625 (0.0009) [2023-12-26 05:24:04,751][123090] Updated weights for policy 1, policy_version 723145 (0.0010) [2023-12-26 05:24:04,821][123090] Updated weights for policy 1, policy_version 723155 (0.0010) [2023-12-26 05:24:04,890][123090] Updated weights for policy 1, policy_version 723165 (0.0009) [2023-12-26 05:24:05,262][123091] Updated weights for policy 0, policy_version 727635 (0.0009) [2023-12-26 05:24:05,319][123091] Updated weights for policy 0, policy_version 727646 (0.0009) [2023-12-26 05:24:05,368][123091] Updated weights for policy 0, policy_version 727656 (0.0009) [2023-12-26 05:24:05,432][123090] Updated weights for policy 1, policy_version 723175 (0.0005) [2023-12-26 05:24:05,490][123090] Updated weights for policy 1, policy_version 723185 (0.0005) [2023-12-26 05:24:05,543][123090] Updated weights for policy 1, policy_version 723195 (0.0005) [2023-12-26 05:24:06,176][123090] Updated weights for policy 1, policy_version 723205 (0.0005) [2023-12-26 05:24:06,229][123090] Updated weights for policy 1, policy_version 723215 (0.0005) [2023-12-26 05:24:06,272][123091] Updated weights for policy 0, policy_version 727667 (0.0009) [2023-12-26 05:24:06,297][123090] Updated weights for policy 1, policy_version 723225 (0.0007) [2023-12-26 05:24:06,330][123091] Updated weights for policy 0, policy_version 727677 (0.0009) [2023-12-26 05:24:06,401][123091] Updated weights for policy 0, policy_version 727687 (0.0009) [2023-12-26 05:24:07,057][123090] Updated weights for policy 1, policy_version 723235 (0.0006) [2023-12-26 05:24:07,111][123090] Updated weights for policy 1, policy_version 723245 (0.0005) [2023-12-26 05:24:07,173][123090] Updated weights for policy 1, policy_version 723255 (0.0005) [2023-12-26 05:24:07,287][123091] Updated weights for policy 0, policy_version 727697 (0.0009) [2023-12-26 05:24:07,336][123091] Updated weights for policy 0, policy_version 727707 (0.0009) [2023-12-26 05:24:07,390][123091] Updated weights for policy 0, policy_version 727717 (0.0009) [2023-12-26 05:24:07,445][123091] Updated weights for policy 0, policy_version 727727 (0.0008) [2023-12-26 05:24:07,957][123090] Updated weights for policy 1, policy_version 723265 (0.0006) [2023-12-26 05:24:08,022][123090] Updated weights for policy 1, policy_version 723275 (0.0010) [2023-12-26 05:24:08,082][123090] Updated weights for policy 1, policy_version 723285 (0.0009) [2023-12-26 05:24:08,135][123090] Updated weights for policy 1, policy_version 723295 (0.0010) [2023-12-26 05:24:08,270][123091] Updated weights for policy 0, policy_version 727737 (0.0008) [2023-12-26 05:24:08,336][123091] Updated weights for policy 0, policy_version 727747 (0.0010) [2023-12-26 05:24:08,407][123091] Updated weights for policy 0, policy_version 727757 (0.0010) [2023-12-26 05:24:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 371474432. Throughput: 0: 8863.9, 1: 8790.7. Samples: 371451248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:08,785][121949] Avg episode reward: [(0, '6162.719'), (1, '5016.682')] [2023-12-26 05:24:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000723296_185163776.pth... [2023-12-26 05:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000727760_186310656.pth... [2023-12-26 05:24:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000722272_184901632.pth [2023-12-26 05:24:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000726736_186048512.pth [2023-12-26 05:24:08,908][123090] Updated weights for policy 1, policy_version 723305 (0.0006) [2023-12-26 05:24:08,966][123090] Updated weights for policy 1, policy_version 723315 (0.0005) [2023-12-26 05:24:09,019][123090] Updated weights for policy 1, policy_version 723325 (0.0005) [2023-12-26 05:24:09,164][123091] Updated weights for policy 0, policy_version 727767 (0.0006) [2023-12-26 05:24:09,237][123091] Updated weights for policy 0, policy_version 727777 (0.0007) [2023-12-26 05:24:09,300][123091] Updated weights for policy 0, policy_version 727787 (0.0009) [2023-12-26 05:24:09,812][123090] Updated weights for policy 1, policy_version 723335 (0.0008) [2023-12-26 05:24:09,878][123090] Updated weights for policy 1, policy_version 723345 (0.0009) [2023-12-26 05:24:09,949][123090] Updated weights for policy 1, policy_version 723355 (0.0008) [2023-12-26 05:24:10,111][123091] Updated weights for policy 0, policy_version 727797 (0.0009) [2023-12-26 05:24:10,160][123091] Updated weights for policy 0, policy_version 727807 (0.0009) [2023-12-26 05:24:10,217][123091] Updated weights for policy 0, policy_version 727817 (0.0009) [2023-12-26 05:24:10,781][123090] Updated weights for policy 1, policy_version 723365 (0.0007) [2023-12-26 05:24:10,831][123090] Updated weights for policy 1, policy_version 723375 (0.0009) [2023-12-26 05:24:10,892][123090] Updated weights for policy 1, policy_version 723385 (0.0009) [2023-12-26 05:24:11,081][123091] Updated weights for policy 0, policy_version 727827 (0.0007) [2023-12-26 05:24:11,157][123091] Updated weights for policy 0, policy_version 727837 (0.0010) [2023-12-26 05:24:11,229][123091] Updated weights for policy 0, policy_version 727847 (0.0011) [2023-12-26 05:24:11,737][123090] Updated weights for policy 1, policy_version 723395 (0.0009) [2023-12-26 05:24:11,806][123090] Updated weights for policy 1, policy_version 723405 (0.0009) [2023-12-26 05:24:11,877][123090] Updated weights for policy 1, policy_version 723415 (0.0009) [2023-12-26 05:24:12,021][123091] Updated weights for policy 0, policy_version 727857 (0.0012) [2023-12-26 05:24:12,099][123091] Updated weights for policy 0, policy_version 727867 (0.0006) [2023-12-26 05:24:12,175][123091] Updated weights for policy 0, policy_version 727877 (0.0006) [2023-12-26 05:24:12,256][123091] Updated weights for policy 0, policy_version 727887 (0.0006) [2023-12-26 05:24:12,760][123090] Updated weights for policy 1, policy_version 723425 (0.0009) [2023-12-26 05:24:12,812][123090] Updated weights for policy 1, policy_version 723435 (0.0010) [2023-12-26 05:24:12,860][123090] Updated weights for policy 1, policy_version 723445 (0.0010) [2023-12-26 05:24:12,916][123090] Updated weights for policy 1, policy_version 723455 (0.0011) [2023-12-26 05:24:12,956][123091] Updated weights for policy 0, policy_version 727897 (0.0007) [2023-12-26 05:24:13,017][123091] Updated weights for policy 0, policy_version 727907 (0.0008) [2023-12-26 05:24:13,082][123091] Updated weights for policy 0, policy_version 727917 (0.0009) [2023-12-26 05:24:13,769][123090] Updated weights for policy 1, policy_version 723465 (0.0010) [2023-12-26 05:24:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 371556352. Throughput: 0: 8847.3, 1: 8808.9. Samples: 371555892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:13,785][121949] Avg episode reward: [(0, '6149.897'), (1, '5195.344')] [2023-12-26 05:24:13,831][123090] Updated weights for policy 1, policy_version 723475 (0.0010) [2023-12-26 05:24:13,898][123090] Updated weights for policy 1, policy_version 723485 (0.0010) [2023-12-26 05:24:13,915][123091] Updated weights for policy 0, policy_version 727927 (0.0006) [2023-12-26 05:24:13,972][123091] Updated weights for policy 0, policy_version 727937 (0.0005) [2023-12-26 05:24:14,031][123091] Updated weights for policy 0, policy_version 727947 (0.0005) [2023-12-26 05:24:14,713][123090] Updated weights for policy 1, policy_version 723495 (0.0010) [2023-12-26 05:24:14,783][123090] Updated weights for policy 1, policy_version 723505 (0.0011) [2023-12-26 05:24:14,790][123091] Updated weights for policy 0, policy_version 727957 (0.0009) [2023-12-26 05:24:14,847][123090] Updated weights for policy 1, policy_version 723515 (0.0011) [2023-12-26 05:24:14,857][123091] Updated weights for policy 0, policy_version 727967 (0.0008) [2023-12-26 05:24:14,924][123091] Updated weights for policy 0, policy_version 727977 (0.0008) [2023-12-26 05:24:15,660][123090] Updated weights for policy 1, policy_version 723525 (0.0010) [2023-12-26 05:24:15,708][123090] Updated weights for policy 1, policy_version 723535 (0.0010) [2023-12-26 05:24:15,760][123090] Updated weights for policy 1, policy_version 723545 (0.0010) [2023-12-26 05:24:15,770][123091] Updated weights for policy 0, policy_version 727987 (0.0009) [2023-12-26 05:24:15,823][123091] Updated weights for policy 0, policy_version 727997 (0.0008) [2023-12-26 05:24:15,871][123091] Updated weights for policy 0, policy_version 728007 (0.0009) [2023-12-26 05:24:16,611][123090] Updated weights for policy 1, policy_version 723555 (0.0010) [2023-12-26 05:24:16,654][123090] Updated weights for policy 1, policy_version 723565 (0.0010) [2023-12-26 05:24:16,711][123091] Updated weights for policy 0, policy_version 728017 (0.0008) [2023-12-26 05:24:16,717][123090] Updated weights for policy 1, policy_version 723575 (0.0011) [2023-12-26 05:24:16,778][123091] Updated weights for policy 0, policy_version 728027 (0.0007) [2023-12-26 05:24:16,842][123091] Updated weights for policy 0, policy_version 728037 (0.0009) [2023-12-26 05:24:16,909][123091] Updated weights for policy 0, policy_version 728047 (0.0009) [2023-12-26 05:24:17,542][123090] Updated weights for policy 1, policy_version 723585 (0.0010) [2023-12-26 05:24:17,601][123090] Updated weights for policy 1, policy_version 723595 (0.0008) [2023-12-26 05:24:17,613][123091] Updated weights for policy 0, policy_version 728057 (0.0009) [2023-12-26 05:24:17,655][123090] Updated weights for policy 1, policy_version 723605 (0.0008) [2023-12-26 05:24:17,675][123091] Updated weights for policy 0, policy_version 728067 (0.0009) [2023-12-26 05:24:17,706][123090] Updated weights for policy 1, policy_version 723615 (0.0009) [2023-12-26 05:24:17,731][123091] Updated weights for policy 0, policy_version 728077 (0.0008) [2023-12-26 05:24:18,479][123091] Updated weights for policy 0, policy_version 728087 (0.0007) [2023-12-26 05:24:18,539][123090] Updated weights for policy 1, policy_version 723625 (0.0010) [2023-12-26 05:24:18,541][123091] Updated weights for policy 0, policy_version 728097 (0.0005) [2023-12-26 05:24:18,591][123090] Updated weights for policy 1, policy_version 723635 (0.0007) [2023-12-26 05:24:18,608][123091] Updated weights for policy 0, policy_version 728107 (0.0008) [2023-12-26 05:24:18,652][123090] Updated weights for policy 1, policy_version 723645 (0.0006) [2023-12-26 05:24:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 371654656. Throughput: 0: 8832.2, 1: 8733.5. Samples: 371660332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:18,785][121949] Avg episode reward: [(0, '6135.538'), (1, '5375.132')] [2023-12-26 05:24:19,422][123091] Updated weights for policy 0, policy_version 728117 (0.0009) [2023-12-26 05:24:19,492][123090] Updated weights for policy 1, policy_version 723655 (0.0007) [2023-12-26 05:24:19,494][123091] Updated weights for policy 0, policy_version 728127 (0.0010) [2023-12-26 05:24:19,554][123090] Updated weights for policy 1, policy_version 723665 (0.0009) [2023-12-26 05:24:19,556][123091] Updated weights for policy 0, policy_version 728137 (0.0007) [2023-12-26 05:24:19,622][123090] Updated weights for policy 1, policy_version 723675 (0.0007) [2023-12-26 05:24:20,427][123091] Updated weights for policy 0, policy_version 728147 (0.0009) [2023-12-26 05:24:20,500][123091] Updated weights for policy 0, policy_version 728157 (0.0009) [2023-12-26 05:24:20,547][123090] Updated weights for policy 1, policy_version 723685 (0.0009) [2023-12-26 05:24:20,559][123091] Updated weights for policy 0, policy_version 728167 (0.0009) [2023-12-26 05:24:20,639][123090] Updated weights for policy 1, policy_version 723695 (0.0008) [2023-12-26 05:24:20,703][123090] Updated weights for policy 1, policy_version 723705 (0.0010) [2023-12-26 05:24:21,439][123091] Updated weights for policy 0, policy_version 728177 (0.0010) [2023-12-26 05:24:21,504][123091] Updated weights for policy 0, policy_version 728187 (0.0009) [2023-12-26 05:24:21,549][123090] Updated weights for policy 1, policy_version 723715 (0.0010) [2023-12-26 05:24:21,569][123091] Updated weights for policy 0, policy_version 728197 (0.0009) [2023-12-26 05:24:21,621][123090] Updated weights for policy 1, policy_version 723725 (0.0008) [2023-12-26 05:24:21,643][123091] Updated weights for policy 0, policy_version 728207 (0.0007) [2023-12-26 05:24:21,702][123090] Updated weights for policy 1, policy_version 723735 (0.0010) [2023-12-26 05:24:22,469][123091] Updated weights for policy 0, policy_version 728217 (0.0008) [2023-12-26 05:24:22,531][123091] Updated weights for policy 0, policy_version 728227 (0.0008) [2023-12-26 05:24:22,539][123090] Updated weights for policy 1, policy_version 723745 (0.0009) [2023-12-26 05:24:22,598][123091] Updated weights for policy 0, policy_version 728237 (0.0008) [2023-12-26 05:24:22,601][123090] Updated weights for policy 1, policy_version 723755 (0.0008) [2023-12-26 05:24:22,659][123090] Updated weights for policy 1, policy_version 723765 (0.0009) [2023-12-26 05:24:22,727][123090] Updated weights for policy 1, policy_version 723775 (0.0009) [2023-12-26 05:24:23,371][123091] Updated weights for policy 0, policy_version 728247 (0.0010) [2023-12-26 05:24:23,427][123091] Updated weights for policy 0, policy_version 728257 (0.0009) [2023-12-26 05:24:23,483][123091] Updated weights for policy 0, policy_version 728267 (0.0010) [2023-12-26 05:24:23,581][123090] Updated weights for policy 1, policy_version 723785 (0.0010) [2023-12-26 05:24:23,633][123090] Updated weights for policy 1, policy_version 723795 (0.0009) [2023-12-26 05:24:23,681][123090] Updated weights for policy 1, policy_version 723805 (0.0009) [2023-12-26 05:24:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17661.4). Total num frames: 371736576. Throughput: 0: 8756.0, 1: 8691.7. Samples: 371709560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:23,784][121949] Avg episode reward: [(0, '6058.911'), (1, '4926.524')] [2023-12-26 05:24:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000728272_186441728.pth... [2023-12-26 05:24:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000723808_185294848.pth... [2023-12-26 05:24:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000727248_186179584.pth [2023-12-26 05:24:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000722784_185032704.pth [2023-12-26 05:24:24,333][123091] Updated weights for policy 0, policy_version 728277 (0.0010) [2023-12-26 05:24:24,394][123091] Updated weights for policy 0, policy_version 728287 (0.0010) [2023-12-26 05:24:24,454][123091] Updated weights for policy 0, policy_version 728298 (0.0010) [2023-12-26 05:24:24,559][123090] Updated weights for policy 1, policy_version 723815 (0.0009) [2023-12-26 05:24:24,614][123090] Updated weights for policy 1, policy_version 723825 (0.0010) [2023-12-26 05:24:24,687][123090] Updated weights for policy 1, policy_version 723835 (0.0007) [2023-12-26 05:24:25,300][123091] Updated weights for policy 0, policy_version 728308 (0.0009) [2023-12-26 05:24:25,352][123091] Updated weights for policy 0, policy_version 728318 (0.0009) [2023-12-26 05:24:25,404][123091] Updated weights for policy 0, policy_version 728328 (0.0010) [2023-12-26 05:24:25,410][123090] Updated weights for policy 1, policy_version 723845 (0.0007) [2023-12-26 05:24:25,470][123090] Updated weights for policy 1, policy_version 723855 (0.0005) [2023-12-26 05:24:25,540][123090] Updated weights for policy 1, policy_version 723865 (0.0007) [2023-12-26 05:24:26,128][123090] Updated weights for policy 1, policy_version 723875 (0.0007) [2023-12-26 05:24:26,185][123090] Updated weights for policy 1, policy_version 723885 (0.0005) [2023-12-26 05:24:26,258][123090] Updated weights for policy 1, policy_version 723895 (0.0005) [2023-12-26 05:24:26,321][123091] Updated weights for policy 0, policy_version 728338 (0.0008) [2023-12-26 05:24:26,372][123091] Updated weights for policy 0, policy_version 728348 (0.0009) [2023-12-26 05:24:26,436][123091] Updated weights for policy 0, policy_version 728358 (0.0009) [2023-12-26 05:24:26,499][123091] Updated weights for policy 0, policy_version 728368 (0.0009) [2023-12-26 05:24:27,008][123090] Updated weights for policy 1, policy_version 723905 (0.0007) [2023-12-26 05:24:27,056][123090] Updated weights for policy 1, policy_version 723915 (0.0010) [2023-12-26 05:24:27,103][123090] Updated weights for policy 1, policy_version 723925 (0.0010) [2023-12-26 05:24:27,162][123090] Updated weights for policy 1, policy_version 723935 (0.0010) [2023-12-26 05:24:27,307][123091] Updated weights for policy 0, policy_version 728378 (0.0009) [2023-12-26 05:24:27,367][123091] Updated weights for policy 0, policy_version 728388 (0.0009) [2023-12-26 05:24:27,421][123091] Updated weights for policy 0, policy_version 728398 (0.0010) [2023-12-26 05:24:27,914][123090] Updated weights for policy 1, policy_version 723945 (0.0006) [2023-12-26 05:24:27,977][123090] Updated weights for policy 1, policy_version 723955 (0.0007) [2023-12-26 05:24:28,041][123090] Updated weights for policy 1, policy_version 723965 (0.0010) [2023-12-26 05:24:28,271][123091] Updated weights for policy 0, policy_version 728408 (0.0009) [2023-12-26 05:24:28,319][123091] Updated weights for policy 0, policy_version 728418 (0.0009) [2023-12-26 05:24:28,379][123091] Updated weights for policy 0, policy_version 728428 (0.0009) [2023-12-26 05:24:28,736][123090] Updated weights for policy 1, policy_version 723975 (0.0010) [2023-12-26 05:24:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 371818496. Throughput: 0: 8692.6, 1: 8710.1. Samples: 371813632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:28,785][121949] Avg episode reward: [(0, '6117.933'), (1, '4999.438')] [2023-12-26 05:24:28,802][123090] Updated weights for policy 1, policy_version 723985 (0.0009) [2023-12-26 05:24:28,867][123090] Updated weights for policy 1, policy_version 723995 (0.0009) [2023-12-26 05:24:29,201][123091] Updated weights for policy 0, policy_version 728438 (0.0009) [2023-12-26 05:24:29,263][123091] Updated weights for policy 0, policy_version 728448 (0.0009) [2023-12-26 05:24:29,312][123091] Updated weights for policy 0, policy_version 728458 (0.0009) [2023-12-26 05:24:29,705][123090] Updated weights for policy 1, policy_version 724005 (0.0010) [2023-12-26 05:24:29,764][123090] Updated weights for policy 1, policy_version 724016 (0.0010) [2023-12-26 05:24:29,834][123090] Updated weights for policy 1, policy_version 724026 (0.0009) [2023-12-26 05:24:30,131][123091] Updated weights for policy 0, policy_version 728468 (0.0010) [2023-12-26 05:24:30,184][123091] Updated weights for policy 0, policy_version 728478 (0.0008) [2023-12-26 05:24:30,239][123091] Updated weights for policy 0, policy_version 728488 (0.0010) [2023-12-26 05:24:30,670][123090] Updated weights for policy 1, policy_version 724036 (0.0009) [2023-12-26 05:24:30,737][123090] Updated weights for policy 1, policy_version 724046 (0.0007) [2023-12-26 05:24:30,807][123090] Updated weights for policy 1, policy_version 724056 (0.0005) [2023-12-26 05:24:31,091][123091] Updated weights for policy 0, policy_version 728498 (0.0009) [2023-12-26 05:24:31,153][123091] Updated weights for policy 0, policy_version 728508 (0.0008) [2023-12-26 05:24:31,202][123091] Updated weights for policy 0, policy_version 728518 (0.0008) [2023-12-26 05:24:31,264][123091] Updated weights for policy 0, policy_version 728528 (0.0006) [2023-12-26 05:24:31,581][123090] Updated weights for policy 1, policy_version 724066 (0.0006) [2023-12-26 05:24:31,651][123090] Updated weights for policy 1, policy_version 724076 (0.0010) [2023-12-26 05:24:31,716][123090] Updated weights for policy 1, policy_version 724086 (0.0009) [2023-12-26 05:24:31,782][123090] Updated weights for policy 1, policy_version 724096 (0.0009) [2023-12-26 05:24:32,079][123091] Updated weights for policy 0, policy_version 728538 (0.0010) [2023-12-26 05:24:32,130][123091] Updated weights for policy 0, policy_version 728548 (0.0009) [2023-12-26 05:24:32,185][123091] Updated weights for policy 0, policy_version 728558 (0.0009) [2023-12-26 05:24:32,599][123090] Updated weights for policy 1, policy_version 724106 (0.0006) [2023-12-26 05:24:32,671][123090] Updated weights for policy 1, policy_version 724116 (0.0005) [2023-12-26 05:24:32,732][123090] Updated weights for policy 1, policy_version 724126 (0.0005) [2023-12-26 05:24:32,952][123091] Updated weights for policy 0, policy_version 728568 (0.0006) [2023-12-26 05:24:33,000][123091] Updated weights for policy 0, policy_version 728578 (0.0005) [2023-12-26 05:24:33,060][123091] Updated weights for policy 0, policy_version 728588 (0.0006) [2023-12-26 05:24:33,461][123090] Updated weights for policy 1, policy_version 724136 (0.0005) [2023-12-26 05:24:33,521][123090] Updated weights for policy 1, policy_version 724146 (0.0005) [2023-12-26 05:24:33,571][123090] Updated weights for policy 1, policy_version 724156 (0.0005) [2023-12-26 05:24:33,720][123091] Updated weights for policy 0, policy_version 728598 (0.0009) [2023-12-26 05:24:33,763][123091] Updated weights for policy 0, policy_version 728608 (0.0010) [2023-12-26 05:24:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 371908608. Throughput: 0: 8675.5, 1: 8737.6. Samples: 371921280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:24:33,785][121949] Avg episode reward: [(0, '6065.232'), (1, '5272.705')] [2023-12-26 05:24:33,810][123091] Updated weights for policy 0, policy_version 728618 (0.0010) [2023-12-26 05:24:34,278][123090] Updated weights for policy 1, policy_version 724166 (0.0008) [2023-12-26 05:24:34,334][123090] Updated weights for policy 1, policy_version 724176 (0.0009) [2023-12-26 05:24:34,384][123090] Updated weights for policy 1, policy_version 724186 (0.0009) [2023-12-26 05:24:34,597][123091] Updated weights for policy 0, policy_version 728628 (0.0008) [2023-12-26 05:24:34,660][123091] Updated weights for policy 0, policy_version 728638 (0.0005) [2023-12-26 05:24:34,722][123091] Updated weights for policy 0, policy_version 728648 (0.0006) [2023-12-26 05:24:35,295][123090] Updated weights for policy 1, policy_version 724196 (0.0009) [2023-12-26 05:24:35,347][123090] Updated weights for policy 1, policy_version 724206 (0.0009) [2023-12-26 05:24:35,398][123090] Updated weights for policy 1, policy_version 724216 (0.0006) [2023-12-26 05:24:35,525][123091] Updated weights for policy 0, policy_version 728658 (0.0010) [2023-12-26 05:24:35,572][123091] Updated weights for policy 0, policy_version 728668 (0.0010) [2023-12-26 05:24:35,620][123091] Updated weights for policy 0, policy_version 728678 (0.0010) [2023-12-26 05:24:35,664][123091] Updated weights for policy 0, policy_version 728688 (0.0010) [2023-12-26 05:24:36,245][123090] Updated weights for policy 1, policy_version 724226 (0.0009) [2023-12-26 05:24:36,308][123090] Updated weights for policy 1, policy_version 724236 (0.0009) [2023-12-26 05:24:36,377][123090] Updated weights for policy 1, policy_version 724246 (0.0009) [2023-12-26 05:24:36,443][123090] Updated weights for policy 1, policy_version 724256 (0.0010) [2023-12-26 05:24:36,507][123091] Updated weights for policy 0, policy_version 728698 (0.0007) [2023-12-26 05:24:36,569][123091] Updated weights for policy 0, policy_version 728708 (0.0010) [2023-12-26 05:24:36,643][123091] Updated weights for policy 0, policy_version 728718 (0.0010) [2023-12-26 05:24:37,240][123090] Updated weights for policy 1, policy_version 724266 (0.0009) [2023-12-26 05:24:37,293][123090] Updated weights for policy 1, policy_version 724276 (0.0008) [2023-12-26 05:24:37,342][123090] Updated weights for policy 1, policy_version 724286 (0.0009) [2023-12-26 05:24:37,478][123091] Updated weights for policy 0, policy_version 728728 (0.0011) [2023-12-26 05:24:37,541][123091] Updated weights for policy 0, policy_version 728738 (0.0010) [2023-12-26 05:24:37,607][123091] Updated weights for policy 0, policy_version 728748 (0.0011) [2023-12-26 05:24:38,191][123090] Updated weights for policy 1, policy_version 724296 (0.0006) [2023-12-26 05:24:38,264][123090] Updated weights for policy 1, policy_version 724306 (0.0005) [2023-12-26 05:24:38,333][123090] Updated weights for policy 1, policy_version 724316 (0.0006) [2023-12-26 05:24:38,453][123091] Updated weights for policy 0, policy_version 728758 (0.0009) [2023-12-26 05:24:38,525][123091] Updated weights for policy 0, policy_version 728768 (0.0008) [2023-12-26 05:24:38,586][123091] Updated weights for policy 0, policy_version 728778 (0.0008) [2023-12-26 05:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 371998720. Throughput: 0: 8685.9, 1: 8734.2. Samples: 371973428. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:24:38,785][121949] Avg episode reward: [(0, '6144.493'), (1, '5328.382')] [2023-12-26 05:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000728784_186572800.pth... [2023-12-26 05:24:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000724320_185425920.pth... [2023-12-26 05:24:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000723296_185163776.pth [2023-12-26 05:24:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000727760_186310656.pth [2023-12-26 05:24:39,079][123090] Updated weights for policy 1, policy_version 724326 (0.0007) [2023-12-26 05:24:39,142][123090] Updated weights for policy 1, policy_version 724336 (0.0005) [2023-12-26 05:24:39,193][123090] Updated weights for policy 1, policy_version 724346 (0.0005) [2023-12-26 05:24:39,318][123091] Updated weights for policy 0, policy_version 728788 (0.0008) [2023-12-26 05:24:39,388][123091] Updated weights for policy 0, policy_version 728798 (0.0011) [2023-12-26 05:24:39,458][123091] Updated weights for policy 0, policy_version 728808 (0.0011) [2023-12-26 05:24:39,986][123090] Updated weights for policy 1, policy_version 724356 (0.0008) [2023-12-26 05:24:40,044][123090] Updated weights for policy 1, policy_version 724366 (0.0009) [2023-12-26 05:24:40,111][123090] Updated weights for policy 1, policy_version 724376 (0.0009) [2023-12-26 05:24:40,255][123091] Updated weights for policy 0, policy_version 728818 (0.0011) [2023-12-26 05:24:40,330][123091] Updated weights for policy 0, policy_version 728828 (0.0006) [2023-12-26 05:24:40,401][123091] Updated weights for policy 0, policy_version 728838 (0.0008) [2023-12-26 05:24:40,469][123091] Updated weights for policy 0, policy_version 728848 (0.0010) [2023-12-26 05:24:40,932][123090] Updated weights for policy 1, policy_version 724386 (0.0008) [2023-12-26 05:24:40,991][123090] Updated weights for policy 1, policy_version 724396 (0.0010) [2023-12-26 05:24:41,068][123090] Updated weights for policy 1, policy_version 724406 (0.0010) [2023-12-26 05:24:41,142][123090] Updated weights for policy 1, policy_version 724416 (0.0009) [2023-12-26 05:24:41,229][123091] Updated weights for policy 0, policy_version 728858 (0.0008) [2023-12-26 05:24:41,294][123091] Updated weights for policy 0, policy_version 728868 (0.0007) [2023-12-26 05:24:41,369][123091] Updated weights for policy 0, policy_version 728878 (0.0007) [2023-12-26 05:24:41,935][123090] Updated weights for policy 1, policy_version 724426 (0.0006) [2023-12-26 05:24:42,000][123090] Updated weights for policy 1, policy_version 724436 (0.0010) [2023-12-26 05:24:42,054][123090] Updated weights for policy 1, policy_version 724446 (0.0010) [2023-12-26 05:24:42,173][123091] Updated weights for policy 0, policy_version 728888 (0.0006) [2023-12-26 05:24:42,245][123091] Updated weights for policy 0, policy_version 728898 (0.0006) [2023-12-26 05:24:42,320][123091] Updated weights for policy 0, policy_version 728908 (0.0008) [2023-12-26 05:24:42,926][123090] Updated weights for policy 1, policy_version 724456 (0.0006) [2023-12-26 05:24:42,986][123090] Updated weights for policy 1, policy_version 724466 (0.0005) [2023-12-26 05:24:43,047][123090] Updated weights for policy 1, policy_version 724476 (0.0005) [2023-12-26 05:24:43,054][123091] Updated weights for policy 0, policy_version 728919 (0.0007) [2023-12-26 05:24:43,105][123091] Updated weights for policy 0, policy_version 728929 (0.0009) [2023-12-26 05:24:43,152][123091] Updated weights for policy 0, policy_version 728939 (0.0010) [2023-12-26 05:24:43,732][123090] Updated weights for policy 1, policy_version 724486 (0.0005) [2023-12-26 05:24:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 372080640. Throughput: 0: 8637.7, 1: 8748.8. Samples: 372077912. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:24:43,785][121949] Avg episode reward: [(0, '6196.187'), (1, '5365.896')] [2023-12-26 05:24:43,799][123090] Updated weights for policy 1, policy_version 724496 (0.0005) [2023-12-26 05:24:43,856][123090] Updated weights for policy 1, policy_version 724506 (0.0005) [2023-12-26 05:24:43,915][123091] Updated weights for policy 0, policy_version 728949 (0.0008) [2023-12-26 05:24:43,988][123091] Updated weights for policy 0, policy_version 728959 (0.0005) [2023-12-26 05:24:44,055][123091] Updated weights for policy 0, policy_version 728969 (0.0005) [2023-12-26 05:24:44,568][123090] Updated weights for policy 1, policy_version 724516 (0.0005) [2023-12-26 05:24:44,633][123090] Updated weights for policy 1, policy_version 724526 (0.0006) [2023-12-26 05:24:44,703][123090] Updated weights for policy 1, policy_version 724536 (0.0005) [2023-12-26 05:24:44,826][123091] Updated weights for policy 0, policy_version 728979 (0.0010) [2023-12-26 05:24:44,893][123091] Updated weights for policy 0, policy_version 728989 (0.0008) [2023-12-26 05:24:44,962][123091] Updated weights for policy 0, policy_version 728999 (0.0008) [2023-12-26 05:24:45,409][123090] Updated weights for policy 1, policy_version 724546 (0.0009) [2023-12-26 05:24:45,469][123090] Updated weights for policy 1, policy_version 724556 (0.0010) [2023-12-26 05:24:45,531][123090] Updated weights for policy 1, policy_version 724566 (0.0010) [2023-12-26 05:24:45,598][123090] Updated weights for policy 1, policy_version 724576 (0.0010) [2023-12-26 05:24:45,769][123091] Updated weights for policy 0, policy_version 729009 (0.0008) [2023-12-26 05:24:45,821][123091] Updated weights for policy 0, policy_version 729019 (0.0008) [2023-12-26 05:24:45,884][123091] Updated weights for policy 0, policy_version 729029 (0.0009) [2023-12-26 05:24:45,947][123091] Updated weights for policy 0, policy_version 729039 (0.0009) [2023-12-26 05:24:46,422][123090] Updated weights for policy 1, policy_version 724586 (0.0009) [2023-12-26 05:24:46,488][123090] Updated weights for policy 1, policy_version 724596 (0.0009) [2023-12-26 05:24:46,542][123090] Updated weights for policy 1, policy_version 724606 (0.0009) [2023-12-26 05:24:46,752][123091] Updated weights for policy 0, policy_version 729049 (0.0010) [2023-12-26 05:24:46,804][123091] Updated weights for policy 0, policy_version 729059 (0.0009) [2023-12-26 05:24:46,851][123091] Updated weights for policy 0, policy_version 729069 (0.0009) [2023-12-26 05:24:47,415][123090] Updated weights for policy 1, policy_version 724616 (0.0008) [2023-12-26 05:24:47,475][123090] Updated weights for policy 1, policy_version 724626 (0.0008) [2023-12-26 05:24:47,523][123090] Updated weights for policy 1, policy_version 724636 (0.0009) [2023-12-26 05:24:47,607][123091] Updated weights for policy 0, policy_version 729079 (0.0010) [2023-12-26 05:24:47,659][123091] Updated weights for policy 0, policy_version 729089 (0.0005) [2023-12-26 05:24:47,705][123091] Updated weights for policy 0, policy_version 729099 (0.0005) [2023-12-26 05:24:48,274][123090] Updated weights for policy 1, policy_version 724646 (0.0007) [2023-12-26 05:24:48,354][123090] Updated weights for policy 1, policy_version 724656 (0.0007) [2023-12-26 05:24:48,419][123090] Updated weights for policy 1, policy_version 724666 (0.0011) [2023-12-26 05:24:48,462][123091] Updated weights for policy 0, policy_version 729109 (0.0009) [2023-12-26 05:24:48,555][123091] Updated weights for policy 0, policy_version 729119 (0.0008) [2023-12-26 05:24:48,611][123091] Updated weights for policy 0, policy_version 729129 (0.0008) [2023-12-26 05:24:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 372178944. Throughput: 0: 8712.5, 1: 8818.4. Samples: 372187416. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:24:48,785][121949] Avg episode reward: [(0, '6157.409'), (1, '5328.158')] [2023-12-26 05:24:49,230][123090] Updated weights for policy 1, policy_version 724676 (0.0007) [2023-12-26 05:24:49,286][123090] Updated weights for policy 1, policy_version 724686 (0.0010) [2023-12-26 05:24:49,330][123091] Updated weights for policy 0, policy_version 729139 (0.0009) [2023-12-26 05:24:49,351][123090] Updated weights for policy 1, policy_version 724696 (0.0011) [2023-12-26 05:24:49,389][123091] Updated weights for policy 0, policy_version 729149 (0.0010) [2023-12-26 05:24:49,447][123091] Updated weights for policy 0, policy_version 729159 (0.0010) [2023-12-26 05:24:50,103][123090] Updated weights for policy 1, policy_version 724706 (0.0011) [2023-12-26 05:24:50,158][123090] Updated weights for policy 1, policy_version 724716 (0.0009) [2023-12-26 05:24:50,216][123090] Updated weights for policy 1, policy_version 724726 (0.0010) [2023-12-26 05:24:50,280][123090] Updated weights for policy 1, policy_version 724736 (0.0010) [2023-12-26 05:24:50,318][123091] Updated weights for policy 0, policy_version 729169 (0.0010) [2023-12-26 05:24:50,390][123091] Updated weights for policy 0, policy_version 729179 (0.0006) [2023-12-26 05:24:50,460][123091] Updated weights for policy 0, policy_version 729189 (0.0005) [2023-12-26 05:24:50,534][123091] Updated weights for policy 0, policy_version 729199 (0.0005) [2023-12-26 05:24:51,176][123091] Updated weights for policy 0, policy_version 729209 (0.0007) [2023-12-26 05:24:51,212][123090] Updated weights for policy 1, policy_version 724746 (0.0010) [2023-12-26 05:24:51,242][123091] Updated weights for policy 0, policy_version 729219 (0.0006) [2023-12-26 05:24:51,271][123090] Updated weights for policy 1, policy_version 724756 (0.0010) [2023-12-26 05:24:51,303][123091] Updated weights for policy 0, policy_version 729229 (0.0008) [2023-12-26 05:24:51,336][123090] Updated weights for policy 1, policy_version 724766 (0.0009) [2023-12-26 05:24:52,158][123091] Updated weights for policy 0, policy_version 729239 (0.0006) [2023-12-26 05:24:52,222][123091] Updated weights for policy 0, policy_version 729249 (0.0005) [2023-12-26 05:24:52,228][123090] Updated weights for policy 1, policy_version 724776 (0.0015) [2023-12-26 05:24:52,282][123091] Updated weights for policy 0, policy_version 729259 (0.0007) [2023-12-26 05:24:52,300][123090] Updated weights for policy 1, policy_version 724786 (0.0008) [2023-12-26 05:24:52,367][123090] Updated weights for policy 1, policy_version 724796 (0.0009) [2023-12-26 05:24:53,106][123091] Updated weights for policy 0, policy_version 729269 (0.0008) [2023-12-26 05:24:53,169][123091] Updated weights for policy 0, policy_version 729279 (0.0011) [2023-12-26 05:24:53,218][123091] Updated weights for policy 0, policy_version 729289 (0.0011) [2023-12-26 05:24:53,241][123090] Updated weights for policy 1, policy_version 724806 (0.0010) [2023-12-26 05:24:53,300][123090] Updated weights for policy 1, policy_version 724816 (0.0009) [2023-12-26 05:24:53,364][123090] Updated weights for policy 1, policy_version 724826 (0.0009) [2023-12-26 05:24:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 372260864. Throughput: 0: 8764.3, 1: 8750.9. Samples: 372239428. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:24:53,785][121949] Avg episode reward: [(0, '6119.901'), (1, '5313.346')] [2023-12-26 05:24:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000729296_186703872.pth... [2023-12-26 05:24:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000724832_185556992.pth... [2023-12-26 05:24:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000728272_186441728.pth [2023-12-26 05:24:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000723808_185294848.pth [2023-12-26 05:24:53,964][123091] Updated weights for policy 0, policy_version 729299 (0.0011) [2023-12-26 05:24:54,015][123091] Updated weights for policy 0, policy_version 729309 (0.0010) [2023-12-26 05:24:54,063][123091] Updated weights for policy 0, policy_version 729319 (0.0010) [2023-12-26 05:24:54,191][123090] Updated weights for policy 1, policy_version 724836 (0.0007) [2023-12-26 05:24:54,243][123090] Updated weights for policy 1, policy_version 724846 (0.0005) [2023-12-26 05:24:54,302][123090] Updated weights for policy 1, policy_version 724856 (0.0005) [2023-12-26 05:24:54,906][123091] Updated weights for policy 0, policy_version 729329 (0.0010) [2023-12-26 05:24:54,972][123091] Updated weights for policy 0, policy_version 729339 (0.0010) [2023-12-26 05:24:55,030][123091] Updated weights for policy 0, policy_version 729349 (0.0009) [2023-12-26 05:24:55,030][123090] Updated weights for policy 1, policy_version 724866 (0.0006) [2023-12-26 05:24:55,084][123090] Updated weights for policy 1, policy_version 724876 (0.0007) [2023-12-26 05:24:55,091][123091] Updated weights for policy 0, policy_version 729359 (0.0008) [2023-12-26 05:24:55,143][123090] Updated weights for policy 1, policy_version 724886 (0.0009) [2023-12-26 05:24:55,209][123090] Updated weights for policy 1, policy_version 724896 (0.0009) [2023-12-26 05:24:55,964][123091] Updated weights for policy 0, policy_version 729369 (0.0009) [2023-12-26 05:24:55,977][123090] Updated weights for policy 1, policy_version 724906 (0.0005) [2023-12-26 05:24:56,029][123091] Updated weights for policy 0, policy_version 729379 (0.0009) [2023-12-26 05:24:56,039][123090] Updated weights for policy 1, policy_version 724916 (0.0006) [2023-12-26 05:24:56,098][123090] Updated weights for policy 1, policy_version 724926 (0.0007) [2023-12-26 05:24:56,099][123091] Updated weights for policy 0, policy_version 729389 (0.0006) [2023-12-26 05:24:56,632][123091] Updated weights for policy 0, policy_version 729399 (0.0005) [2023-12-26 05:24:56,678][123091] Updated weights for policy 0, policy_version 729409 (0.0005) [2023-12-26 05:24:56,726][123091] Updated weights for policy 0, policy_version 729419 (0.0006) [2023-12-26 05:24:56,804][123090] Updated weights for policy 1, policy_version 724936 (0.0006) [2023-12-26 05:24:56,859][123090] Updated weights for policy 1, policy_version 724946 (0.0005) [2023-12-26 05:24:56,918][123090] Updated weights for policy 1, policy_version 724956 (0.0005) [2023-12-26 05:24:57,504][123090] Updated weights for policy 1, policy_version 724966 (0.0006) [2023-12-26 05:24:57,506][123091] Updated weights for policy 0, policy_version 729429 (0.0009) [2023-12-26 05:24:57,558][123091] Updated weights for policy 0, policy_version 729439 (0.0010) [2023-12-26 05:24:57,575][123090] Updated weights for policy 1, policy_version 724976 (0.0007) [2023-12-26 05:24:57,608][123091] Updated weights for policy 0, policy_version 729449 (0.0010) [2023-12-26 05:24:57,640][123090] Updated weights for policy 1, policy_version 724986 (0.0011) [2023-12-26 05:24:58,437][123090] Updated weights for policy 1, policy_version 724996 (0.0010) [2023-12-26 05:24:58,497][123090] Updated weights for policy 1, policy_version 725006 (0.0010) [2023-12-26 05:24:58,511][123091] Updated weights for policy 0, policy_version 729459 (0.0008) [2023-12-26 05:24:58,567][123090] Updated weights for policy 1, policy_version 725016 (0.0011) [2023-12-26 05:24:58,583][123091] Updated weights for policy 0, policy_version 729469 (0.0008) [2023-12-26 05:24:58,655][123091] Updated weights for policy 0, policy_version 729479 (0.0007) [2023-12-26 05:24:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 372359168. Throughput: 0: 8813.5, 1: 8798.4. Samples: 372348428. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:24:58,785][121949] Avg episode reward: [(0, '6233.862'), (1, '5367.601')] [2023-12-26 05:24:59,386][123090] Updated weights for policy 1, policy_version 725026 (0.0009) [2023-12-26 05:24:59,441][123090] Updated weights for policy 1, policy_version 725036 (0.0006) [2023-12-26 05:24:59,475][123091] Updated weights for policy 0, policy_version 729489 (0.0007) [2023-12-26 05:24:59,499][123090] Updated weights for policy 1, policy_version 725046 (0.0005) [2023-12-26 05:24:59,545][123091] Updated weights for policy 0, policy_version 729499 (0.0006) [2023-12-26 05:24:59,571][123090] Updated weights for policy 1, policy_version 725056 (0.0007) [2023-12-26 05:24:59,605][123091] Updated weights for policy 0, policy_version 729509 (0.0006) [2023-12-26 05:24:59,666][123091] Updated weights for policy 0, policy_version 729519 (0.0008) [2023-12-26 05:25:00,298][123090] Updated weights for policy 1, policy_version 725066 (0.0008) [2023-12-26 05:25:00,368][123090] Updated weights for policy 1, policy_version 725076 (0.0010) [2023-12-26 05:25:00,438][123091] Updated weights for policy 0, policy_version 729529 (0.0006) [2023-12-26 05:25:00,439][123090] Updated weights for policy 1, policy_version 725086 (0.0011) [2023-12-26 05:25:00,496][123091] Updated weights for policy 0, policy_version 729539 (0.0006) [2023-12-26 05:25:00,557][123091] Updated weights for policy 0, policy_version 729549 (0.0006) [2023-12-26 05:25:01,130][123090] Updated weights for policy 1, policy_version 725096 (0.0010) [2023-12-26 05:25:01,194][123090] Updated weights for policy 1, policy_version 725106 (0.0009) [2023-12-26 05:25:01,251][123090] Updated weights for policy 1, policy_version 725116 (0.0009) [2023-12-26 05:25:01,410][123091] Updated weights for policy 0, policy_version 729559 (0.0009) [2023-12-26 05:25:01,469][123091] Updated weights for policy 0, policy_version 729569 (0.0009) [2023-12-26 05:25:01,519][123091] Updated weights for policy 0, policy_version 729579 (0.0009) [2023-12-26 05:25:02,087][123090] Updated weights for policy 1, policy_version 725126 (0.0009) [2023-12-26 05:25:02,144][123090] Updated weights for policy 1, policy_version 725136 (0.0009) [2023-12-26 05:25:02,201][123090] Updated weights for policy 1, policy_version 725146 (0.0009) [2023-12-26 05:25:02,284][123091] Updated weights for policy 0, policy_version 729589 (0.0010) [2023-12-26 05:25:02,351][123091] Updated weights for policy 0, policy_version 729599 (0.0011) [2023-12-26 05:25:02,416][123091] Updated weights for policy 0, policy_version 729609 (0.0011) [2023-12-26 05:25:03,113][123090] Updated weights for policy 1, policy_version 725156 (0.0009) [2023-12-26 05:25:03,187][123090] Updated weights for policy 1, policy_version 725166 (0.0009) [2023-12-26 05:25:03,228][123091] Updated weights for policy 0, policy_version 729619 (0.0010) [2023-12-26 05:25:03,251][123090] Updated weights for policy 1, policy_version 725176 (0.0007) [2023-12-26 05:25:03,277][123091] Updated weights for policy 0, policy_version 729629 (0.0010) [2023-12-26 05:25:03,324][123091] Updated weights for policy 0, policy_version 729639 (0.0010) [2023-12-26 05:25:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 372441088. Throughput: 0: 8781.6, 1: 8828.8. Samples: 372452800. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:03,785][121949] Avg episode reward: [(0, '6164.967'), (1, '5419.177')] [2023-12-26 05:25:04,060][123090] Updated weights for policy 1, policy_version 725186 (0.0007) [2023-12-26 05:25:04,123][123090] Updated weights for policy 1, policy_version 725196 (0.0007) [2023-12-26 05:25:04,142][123091] Updated weights for policy 0, policy_version 729649 (0.0010) [2023-12-26 05:25:04,186][123090] Updated weights for policy 1, policy_version 725206 (0.0009) [2023-12-26 05:25:04,206][123091] Updated weights for policy 0, policy_version 729659 (0.0009) [2023-12-26 05:25:04,238][123090] Updated weights for policy 1, policy_version 725216 (0.0006) [2023-12-26 05:25:04,265][123091] Updated weights for policy 0, policy_version 729669 (0.0011) [2023-12-26 05:25:04,317][123091] Updated weights for policy 0, policy_version 729679 (0.0011) [2023-12-26 05:25:05,103][123090] Updated weights for policy 1, policy_version 725226 (0.0008) [2023-12-26 05:25:05,146][123091] Updated weights for policy 0, policy_version 729689 (0.0011) [2023-12-26 05:25:05,162][123090] Updated weights for policy 1, policy_version 725236 (0.0008) [2023-12-26 05:25:05,197][123091] Updated weights for policy 0, policy_version 729699 (0.0010) [2023-12-26 05:25:05,221][123090] Updated weights for policy 1, policy_version 725246 (0.0005) [2023-12-26 05:25:05,252][123091] Updated weights for policy 0, policy_version 729709 (0.0010) [2023-12-26 05:25:06,061][123090] Updated weights for policy 1, policy_version 725256 (0.0009) [2023-12-26 05:25:06,091][123091] Updated weights for policy 0, policy_version 729719 (0.0010) [2023-12-26 05:25:06,121][123090] Updated weights for policy 1, policy_version 725266 (0.0008) [2023-12-26 05:25:06,158][123091] Updated weights for policy 0, policy_version 729729 (0.0011) [2023-12-26 05:25:06,183][123090] Updated weights for policy 1, policy_version 725276 (0.0007) [2023-12-26 05:25:06,218][123091] Updated weights for policy 0, policy_version 729739 (0.0011) [2023-12-26 05:25:07,028][123090] Updated weights for policy 1, policy_version 725286 (0.0010) [2023-12-26 05:25:07,075][123090] Updated weights for policy 1, policy_version 725296 (0.0007) [2023-12-26 05:25:07,076][123091] Updated weights for policy 0, policy_version 729749 (0.0011) [2023-12-26 05:25:07,124][123091] Updated weights for policy 0, policy_version 729759 (0.0010) [2023-12-26 05:25:07,130][123090] Updated weights for policy 1, policy_version 725306 (0.0007) [2023-12-26 05:25:07,175][123091] Updated weights for policy 0, policy_version 729769 (0.0010) [2023-12-26 05:25:07,999][123090] Updated weights for policy 1, policy_version 725316 (0.0007) [2023-12-26 05:25:08,005][123091] Updated weights for policy 0, policy_version 729779 (0.0009) [2023-12-26 05:25:08,058][123090] Updated weights for policy 1, policy_version 725326 (0.0008) [2023-12-26 05:25:08,072][123091] Updated weights for policy 0, policy_version 729789 (0.0007) [2023-12-26 05:25:08,109][123090] Updated weights for policy 1, policy_version 725336 (0.0009) [2023-12-26 05:25:08,131][123091] Updated weights for policy 0, policy_version 729799 (0.0007) [2023-12-26 05:25:08,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 372523008. Throughput: 0: 8811.3, 1: 8842.0. Samples: 372503960. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:08,785][121949] Avg episode reward: [(0, '5999.382'), (1, '5257.850')] [2023-12-26 05:25:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000729808_186834944.pth... [2023-12-26 05:25:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000725344_185688064.pth... [2023-12-26 05:25:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000724320_185425920.pth [2023-12-26 05:25:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000728784_186572800.pth [2023-12-26 05:25:08,870][123090] Updated weights for policy 1, policy_version 725346 (0.0009) [2023-12-26 05:25:08,915][123091] Updated weights for policy 0, policy_version 729809 (0.0007) [2023-12-26 05:25:08,926][123090] Updated weights for policy 1, policy_version 725356 (0.0010) [2023-12-26 05:25:08,975][123091] Updated weights for policy 0, policy_version 729819 (0.0010) [2023-12-26 05:25:08,980][123090] Updated weights for policy 1, policy_version 725366 (0.0008) [2023-12-26 05:25:09,040][123091] Updated weights for policy 0, policy_version 729829 (0.0006) [2023-12-26 05:25:09,041][123090] Updated weights for policy 1, policy_version 725376 (0.0010) [2023-12-26 05:25:09,089][123091] Updated weights for policy 0, policy_version 729839 (0.0009) [2023-12-26 05:25:09,864][123090] Updated weights for policy 1, policy_version 725386 (0.0010) [2023-12-26 05:25:09,932][123090] Updated weights for policy 1, policy_version 725396 (0.0007) [2023-12-26 05:25:09,967][123091] Updated weights for policy 0, policy_version 729849 (0.0008) [2023-12-26 05:25:09,996][123090] Updated weights for policy 1, policy_version 725406 (0.0006) [2023-12-26 05:25:10,029][123091] Updated weights for policy 0, policy_version 729859 (0.0008) [2023-12-26 05:25:10,088][123091] Updated weights for policy 0, policy_version 729869 (0.0008) [2023-12-26 05:25:10,741][123090] Updated weights for policy 1, policy_version 725416 (0.0006) [2023-12-26 05:25:10,789][123090] Updated weights for policy 1, policy_version 725426 (0.0005) [2023-12-26 05:25:10,836][123090] Updated weights for policy 1, policy_version 725436 (0.0005) [2023-12-26 05:25:10,924][123091] Updated weights for policy 0, policy_version 729879 (0.0010) [2023-12-26 05:25:10,994][123091] Updated weights for policy 0, policy_version 729889 (0.0011) [2023-12-26 05:25:11,064][123091] Updated weights for policy 0, policy_version 729899 (0.0010) [2023-12-26 05:25:11,663][123090] Updated weights for policy 1, policy_version 725446 (0.0008) [2023-12-26 05:25:11,740][123090] Updated weights for policy 1, policy_version 725456 (0.0009) [2023-12-26 05:25:11,800][123090] Updated weights for policy 1, policy_version 725466 (0.0009) [2023-12-26 05:25:11,902][123091] Updated weights for policy 0, policy_version 729909 (0.0013) [2023-12-26 05:25:11,966][123091] Updated weights for policy 0, policy_version 729919 (0.0009) [2023-12-26 05:25:12,029][123091] Updated weights for policy 0, policy_version 729929 (0.0007) [2023-12-26 05:25:12,676][123090] Updated weights for policy 1, policy_version 725476 (0.0009) [2023-12-26 05:25:12,733][123090] Updated weights for policy 1, policy_version 725486 (0.0009) [2023-12-26 05:25:12,781][123090] Updated weights for policy 1, policy_version 725496 (0.0009) [2023-12-26 05:25:12,808][123091] Updated weights for policy 0, policy_version 729939 (0.0011) [2023-12-26 05:25:12,856][123091] Updated weights for policy 0, policy_version 729949 (0.0010) [2023-12-26 05:25:12,911][123091] Updated weights for policy 0, policy_version 729959 (0.0010) [2023-12-26 05:25:13,651][123090] Updated weights for policy 1, policy_version 725506 (0.0006) [2023-12-26 05:25:13,698][123090] Updated weights for policy 1, policy_version 725516 (0.0008) [2023-12-26 05:25:13,721][123091] Updated weights for policy 0, policy_version 729969 (0.0010) [2023-12-26 05:25:13,745][123090] Updated weights for policy 1, policy_version 725526 (0.0008) [2023-12-26 05:25:13,782][123091] Updated weights for policy 0, policy_version 729979 (0.0009) [2023-12-26 05:25:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 372604928. Throughput: 0: 8829.0, 1: 8807.0. Samples: 372607252. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:13,784][121949] Avg episode reward: [(0, '6028.328'), (1, '5215.271')] [2023-12-26 05:25:13,804][123090] Updated weights for policy 1, policy_version 725536 (0.0008) [2023-12-26 05:25:13,841][123091] Updated weights for policy 0, policy_version 729989 (0.0010) [2023-12-26 05:25:13,907][123091] Updated weights for policy 0, policy_version 729999 (0.0011) [2023-12-26 05:25:14,651][123090] Updated weights for policy 1, policy_version 725546 (0.0009) [2023-12-26 05:25:14,716][123090] Updated weights for policy 1, policy_version 725556 (0.0008) [2023-12-26 05:25:14,724][123091] Updated weights for policy 0, policy_version 730009 (0.0010) [2023-12-26 05:25:14,772][123090] Updated weights for policy 1, policy_version 725566 (0.0008) [2023-12-26 05:25:14,789][123091] Updated weights for policy 0, policy_version 730019 (0.0010) [2023-12-26 05:25:14,852][123091] Updated weights for policy 0, policy_version 730029 (0.0011) [2023-12-26 05:25:15,608][123090] Updated weights for policy 1, policy_version 725576 (0.0009) [2023-12-26 05:25:15,638][123091] Updated weights for policy 0, policy_version 730039 (0.0010) [2023-12-26 05:25:15,666][123090] Updated weights for policy 1, policy_version 725586 (0.0009) [2023-12-26 05:25:15,694][123091] Updated weights for policy 0, policy_version 730049 (0.0011) [2023-12-26 05:25:15,718][123090] Updated weights for policy 1, policy_version 725596 (0.0005) [2023-12-26 05:25:15,746][123091] Updated weights for policy 0, policy_version 730059 (0.0011) [2023-12-26 05:25:16,424][123090] Updated weights for policy 1, policy_version 725606 (0.0007) [2023-12-26 05:25:16,438][123091] Updated weights for policy 0, policy_version 730069 (0.0009) [2023-12-26 05:25:16,486][123090] Updated weights for policy 1, policy_version 725616 (0.0007) [2023-12-26 05:25:16,507][123091] Updated weights for policy 0, policy_version 730079 (0.0006) [2023-12-26 05:25:16,546][123090] Updated weights for policy 1, policy_version 725626 (0.0008) [2023-12-26 05:25:16,568][123091] Updated weights for policy 0, policy_version 730089 (0.0009) [2023-12-26 05:25:17,334][123090] Updated weights for policy 1, policy_version 725636 (0.0007) [2023-12-26 05:25:17,363][123091] Updated weights for policy 0, policy_version 730099 (0.0009) [2023-12-26 05:25:17,390][123090] Updated weights for policy 1, policy_version 725646 (0.0006) [2023-12-26 05:25:17,415][123091] Updated weights for policy 0, policy_version 730109 (0.0010) [2023-12-26 05:25:17,449][123090] Updated weights for policy 1, policy_version 725656 (0.0005) [2023-12-26 05:25:17,473][123091] Updated weights for policy 0, policy_version 730119 (0.0010) [2023-12-26 05:25:18,128][123090] Updated weights for policy 1, policy_version 725666 (0.0006) [2023-12-26 05:25:18,156][123091] Updated weights for policy 0, policy_version 730129 (0.0010) [2023-12-26 05:25:18,189][123090] Updated weights for policy 1, policy_version 725676 (0.0005) [2023-12-26 05:25:18,231][123091] Updated weights for policy 0, policy_version 730139 (0.0005) [2023-12-26 05:25:18,239][123090] Updated weights for policy 1, policy_version 725686 (0.0005) [2023-12-26 05:25:18,286][123090] Updated weights for policy 1, policy_version 725696 (0.0005) [2023-12-26 05:25:18,303][123091] Updated weights for policy 0, policy_version 730149 (0.0006) [2023-12-26 05:25:18,372][123091] Updated weights for policy 0, policy_version 730159 (0.0009) [2023-12-26 05:25:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 372703232. Throughput: 0: 8851.8, 1: 8820.3. Samples: 372716520. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:18,785][121949] Avg episode reward: [(0, '6132.183'), (1, '5423.006')] [2023-12-26 05:25:19,047][123090] Updated weights for policy 1, policy_version 725706 (0.0010) [2023-12-26 05:25:19,079][123091] Updated weights for policy 0, policy_version 730169 (0.0010) [2023-12-26 05:25:19,107][123090] Updated weights for policy 1, policy_version 725716 (0.0010) [2023-12-26 05:25:19,130][123091] Updated weights for policy 0, policy_version 730179 (0.0010) [2023-12-26 05:25:19,162][123090] Updated weights for policy 1, policy_version 725726 (0.0010) [2023-12-26 05:25:19,180][123091] Updated weights for policy 0, policy_version 730189 (0.0010) [2023-12-26 05:25:19,967][123090] Updated weights for policy 1, policy_version 725736 (0.0010) [2023-12-26 05:25:20,011][123091] Updated weights for policy 0, policy_version 730199 (0.0009) [2023-12-26 05:25:20,037][123090] Updated weights for policy 1, policy_version 725746 (0.0010) [2023-12-26 05:25:20,077][123091] Updated weights for policy 0, policy_version 730209 (0.0008) [2023-12-26 05:25:20,109][123090] Updated weights for policy 1, policy_version 725756 (0.0011) [2023-12-26 05:25:20,137][123091] Updated weights for policy 0, policy_version 730219 (0.0007) [2023-12-26 05:25:20,806][123091] Updated weights for policy 0, policy_version 730229 (0.0009) [2023-12-26 05:25:20,862][123090] Updated weights for policy 1, policy_version 725766 (0.0008) [2023-12-26 05:25:20,870][123091] Updated weights for policy 0, policy_version 730239 (0.0011) [2023-12-26 05:25:20,927][123090] Updated weights for policy 1, policy_version 725776 (0.0007) [2023-12-26 05:25:20,942][123091] Updated weights for policy 0, policy_version 730249 (0.0011) [2023-12-26 05:25:20,995][123090] Updated weights for policy 1, policy_version 725786 (0.0006) [2023-12-26 05:25:21,797][123091] Updated weights for policy 0, policy_version 730259 (0.0010) [2023-12-26 05:25:21,845][123090] Updated weights for policy 1, policy_version 725796 (0.0009) [2023-12-26 05:25:21,864][123091] Updated weights for policy 0, policy_version 730269 (0.0008) [2023-12-26 05:25:21,915][123090] Updated weights for policy 1, policy_version 725806 (0.0008) [2023-12-26 05:25:21,926][123091] Updated weights for policy 0, policy_version 730279 (0.0009) [2023-12-26 05:25:21,980][123090] Updated weights for policy 1, policy_version 725816 (0.0009) [2023-12-26 05:25:22,700][123091] Updated weights for policy 0, policy_version 730289 (0.0007) [2023-12-26 05:25:22,757][123091] Updated weights for policy 0, policy_version 730299 (0.0008) [2023-12-26 05:25:22,817][123091] Updated weights for policy 0, policy_version 730309 (0.0009) [2023-12-26 05:25:22,850][123090] Updated weights for policy 1, policy_version 725826 (0.0010) [2023-12-26 05:25:22,871][123091] Updated weights for policy 0, policy_version 730319 (0.0007) [2023-12-26 05:25:22,903][123090] Updated weights for policy 1, policy_version 725836 (0.0010) [2023-12-26 05:25:22,953][123090] Updated weights for policy 1, policy_version 725846 (0.0007) [2023-12-26 05:25:23,014][123090] Updated weights for policy 1, policy_version 725856 (0.0009) [2023-12-26 05:25:23,659][123091] Updated weights for policy 0, policy_version 730329 (0.0006) [2023-12-26 05:25:23,724][123091] Updated weights for policy 0, policy_version 730339 (0.0006) [2023-12-26 05:25:23,783][123091] Updated weights for policy 0, policy_version 730349 (0.0006) [2023-12-26 05:25:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 372785152. Throughput: 0: 8846.2, 1: 8839.0. Samples: 372769264. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:23,785][121949] Avg episode reward: [(0, '6089.068'), (1, '5259.295')] [2023-12-26 05:25:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000725856_185819136.pth... [2023-12-26 05:25:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000724832_185556992.pth [2023-12-26 05:25:23,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000730352_186974208.pth... [2023-12-26 05:25:23,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000729296_186703872.pth [2023-12-26 05:25:23,888][123090] Updated weights for policy 1, policy_version 725866 (0.0010) [2023-12-26 05:25:23,951][123090] Updated weights for policy 1, policy_version 725876 (0.0006) [2023-12-26 05:25:24,035][123090] Updated weights for policy 1, policy_version 725886 (0.0005) [2023-12-26 05:25:24,476][123091] Updated weights for policy 0, policy_version 730359 (0.0006) [2023-12-26 05:25:24,549][123091] Updated weights for policy 0, policy_version 730369 (0.0005) [2023-12-26 05:25:24,624][123091] Updated weights for policy 0, policy_version 730379 (0.0005) [2023-12-26 05:25:24,738][123090] Updated weights for policy 1, policy_version 725896 (0.0009) [2023-12-26 05:25:24,786][123090] Updated weights for policy 1, policy_version 725906 (0.0005) [2023-12-26 05:25:24,839][123090] Updated weights for policy 1, policy_version 725916 (0.0005) [2023-12-26 05:25:25,363][123091] Updated weights for policy 0, policy_version 730389 (0.0008) [2023-12-26 05:25:25,421][123091] Updated weights for policy 0, policy_version 730399 (0.0008) [2023-12-26 05:25:25,486][123091] Updated weights for policy 0, policy_version 730409 (0.0010) [2023-12-26 05:25:25,554][123090] Updated weights for policy 1, policy_version 725926 (0.0005) [2023-12-26 05:25:25,617][123090] Updated weights for policy 1, policy_version 725936 (0.0005) [2023-12-26 05:25:25,661][123090] Updated weights for policy 1, policy_version 725946 (0.0005) [2023-12-26 05:25:26,348][123091] Updated weights for policy 0, policy_version 730420 (0.0009) [2023-12-26 05:25:26,400][123091] Updated weights for policy 0, policy_version 730431 (0.0009) [2023-12-26 05:25:26,420][123090] Updated weights for policy 1, policy_version 725956 (0.0007) [2023-12-26 05:25:26,454][123091] Updated weights for policy 0, policy_version 730441 (0.0007) [2023-12-26 05:25:26,474][123090] Updated weights for policy 1, policy_version 725966 (0.0010) [2023-12-26 05:25:26,535][123090] Updated weights for policy 1, policy_version 725976 (0.0009) [2023-12-26 05:25:27,202][123091] Updated weights for policy 0, policy_version 730451 (0.0008) [2023-12-26 05:25:27,250][123091] Updated weights for policy 0, policy_version 730461 (0.0005) [2023-12-26 05:25:27,303][123091] Updated weights for policy 0, policy_version 730471 (0.0006) [2023-12-26 05:25:27,438][123090] Updated weights for policy 1, policy_version 725986 (0.0010) [2023-12-26 05:25:27,501][123090] Updated weights for policy 1, policy_version 725996 (0.0010) [2023-12-26 05:25:27,569][123090] Updated weights for policy 1, policy_version 726006 (0.0009) [2023-12-26 05:25:27,636][123090] Updated weights for policy 1, policy_version 726016 (0.0009) [2023-12-26 05:25:27,995][123091] Updated weights for policy 0, policy_version 730481 (0.0007) [2023-12-26 05:25:28,058][123091] Updated weights for policy 0, policy_version 730491 (0.0009) [2023-12-26 05:25:28,113][123091] Updated weights for policy 0, policy_version 730501 (0.0009) [2023-12-26 05:25:28,168][123091] Updated weights for policy 0, policy_version 730511 (0.0009) [2023-12-26 05:25:28,455][123090] Updated weights for policy 1, policy_version 726026 (0.0010) [2023-12-26 05:25:28,508][123090] Updated weights for policy 1, policy_version 726036 (0.0009) [2023-12-26 05:25:28,562][123090] Updated weights for policy 1, policy_version 726046 (0.0010) [2023-12-26 05:25:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 372883456. Throughput: 0: 8912.8, 1: 8825.3. Samples: 372876128. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:28,784][121949] Avg episode reward: [(0, '6072.000'), (1, '5314.617')] [2023-12-26 05:25:28,940][123091] Updated weights for policy 0, policy_version 730521 (0.0010) [2023-12-26 05:25:29,002][123091] Updated weights for policy 0, policy_version 730531 (0.0010) [2023-12-26 05:25:29,065][123091] Updated weights for policy 0, policy_version 730541 (0.0010) [2023-12-26 05:25:29,420][123090] Updated weights for policy 1, policy_version 726056 (0.0006) [2023-12-26 05:25:29,476][123090] Updated weights for policy 1, policy_version 726066 (0.0005) [2023-12-26 05:25:29,531][123090] Updated weights for policy 1, policy_version 726076 (0.0005) [2023-12-26 05:25:29,975][123091] Updated weights for policy 0, policy_version 730551 (0.0007) [2023-12-26 05:25:30,024][123091] Updated weights for policy 0, policy_version 730561 (0.0007) [2023-12-26 05:25:30,076][123091] Updated weights for policy 0, policy_version 730571 (0.0005) [2023-12-26 05:25:30,290][123090] Updated weights for policy 1, policy_version 726086 (0.0007) [2023-12-26 05:25:30,348][123090] Updated weights for policy 1, policy_version 726096 (0.0009) [2023-12-26 05:25:30,402][123090] Updated weights for policy 1, policy_version 726106 (0.0009) [2023-12-26 05:25:30,742][123091] Updated weights for policy 0, policy_version 730581 (0.0006) [2023-12-26 05:25:30,794][123091] Updated weights for policy 0, policy_version 730591 (0.0009) [2023-12-26 05:25:30,843][123091] Updated weights for policy 0, policy_version 730601 (0.0009) [2023-12-26 05:25:31,275][123090] Updated weights for policy 1, policy_version 726116 (0.0009) [2023-12-26 05:25:31,342][123090] Updated weights for policy 1, policy_version 726126 (0.0007) [2023-12-26 05:25:31,411][123090] Updated weights for policy 1, policy_version 726136 (0.0007) [2023-12-26 05:25:31,648][123091] Updated weights for policy 0, policy_version 730612 (0.0010) [2023-12-26 05:25:31,702][123091] Updated weights for policy 0, policy_version 730622 (0.0009) [2023-12-26 05:25:31,779][123091] Updated weights for policy 0, policy_version 730632 (0.0008) [2023-12-26 05:25:32,103][123090] Updated weights for policy 1, policy_version 726146 (0.0006) [2023-12-26 05:25:32,157][123090] Updated weights for policy 1, policy_version 726157 (0.0010) [2023-12-26 05:25:32,209][123090] Updated weights for policy 1, policy_version 726167 (0.0010) [2023-12-26 05:25:32,531][123091] Updated weights for policy 0, policy_version 730642 (0.0007) [2023-12-26 05:25:32,593][123091] Updated weights for policy 0, policy_version 730652 (0.0006) [2023-12-26 05:25:32,653][123091] Updated weights for policy 0, policy_version 730662 (0.0006) [2023-12-26 05:25:32,707][123091] Updated weights for policy 0, policy_version 730672 (0.0010) [2023-12-26 05:25:33,050][123090] Updated weights for policy 1, policy_version 726177 (0.0008) [2023-12-26 05:25:33,110][123090] Updated weights for policy 1, policy_version 726187 (0.0005) [2023-12-26 05:25:33,174][123090] Updated weights for policy 1, policy_version 726197 (0.0005) [2023-12-26 05:25:33,220][123090] Updated weights for policy 1, policy_version 726207 (0.0005) [2023-12-26 05:25:33,493][123091] Updated weights for policy 0, policy_version 730682 (0.0005) [2023-12-26 05:25:33,548][123091] Updated weights for policy 0, policy_version 730692 (0.0005) [2023-12-26 05:25:33,600][123091] Updated weights for policy 0, policy_version 730702 (0.0005) [2023-12-26 05:25:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 372973568. Throughput: 0: 8909.5, 1: 8784.1. Samples: 372983632. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:33,785][121949] Avg episode reward: [(0, '6113.634'), (1, '5575.938')] [2023-12-26 05:25:33,933][123090] Updated weights for policy 1, policy_version 726217 (0.0009) [2023-12-26 05:25:33,998][123090] Updated weights for policy 1, policy_version 726227 (0.0009) [2023-12-26 05:25:34,053][123090] Updated weights for policy 1, policy_version 726237 (0.0010) [2023-12-26 05:25:34,395][123091] Updated weights for policy 0, policy_version 730712 (0.0009) [2023-12-26 05:25:34,460][123091] Updated weights for policy 0, policy_version 730722 (0.0010) [2023-12-26 05:25:34,529][123091] Updated weights for policy 0, policy_version 730732 (0.0010) [2023-12-26 05:25:34,833][123090] Updated weights for policy 1, policy_version 726247 (0.0007) [2023-12-26 05:25:34,887][123090] Updated weights for policy 1, policy_version 726257 (0.0010) [2023-12-26 05:25:34,943][123090] Updated weights for policy 1, policy_version 726267 (0.0005) [2023-12-26 05:25:35,348][123091] Updated weights for policy 0, policy_version 730742 (0.0009) [2023-12-26 05:25:35,422][123091] Updated weights for policy 0, policy_version 730752 (0.0005) [2023-12-26 05:25:35,501][123091] Updated weights for policy 0, policy_version 730762 (0.0005) [2023-12-26 05:25:35,565][123090] Updated weights for policy 1, policy_version 726277 (0.0005) [2023-12-26 05:25:35,628][123090] Updated weights for policy 1, policy_version 726287 (0.0007) [2023-12-26 05:25:35,692][123090] Updated weights for policy 1, policy_version 726297 (0.0010) [2023-12-26 05:25:36,169][123091] Updated weights for policy 0, policy_version 730772 (0.0008) [2023-12-26 05:25:36,240][123091] Updated weights for policy 0, policy_version 730782 (0.0011) [2023-12-26 05:25:36,308][123091] Updated weights for policy 0, policy_version 730792 (0.0011) [2023-12-26 05:25:36,549][123090] Updated weights for policy 1, policy_version 726307 (0.0008) [2023-12-26 05:25:36,625][123090] Updated weights for policy 1, policy_version 726317 (0.0005) [2023-12-26 05:25:36,701][123090] Updated weights for policy 1, policy_version 726327 (0.0006) [2023-12-26 05:25:37,157][123091] Updated weights for policy 0, policy_version 730802 (0.0011) [2023-12-26 05:25:37,210][123091] Updated weights for policy 0, policy_version 730812 (0.0010) [2023-12-26 05:25:37,262][123091] Updated weights for policy 0, policy_version 730822 (0.0009) [2023-12-26 05:25:37,314][123091] Updated weights for policy 0, policy_version 730832 (0.0010) [2023-12-26 05:25:37,322][123090] Updated weights for policy 1, policy_version 726337 (0.0006) [2023-12-26 05:25:37,375][123090] Updated weights for policy 1, policy_version 726347 (0.0009) [2023-12-26 05:25:37,438][123090] Updated weights for policy 1, policy_version 726357 (0.0009) [2023-12-26 05:25:37,502][123090] Updated weights for policy 1, policy_version 726367 (0.0010) [2023-12-26 05:25:38,138][123091] Updated weights for policy 0, policy_version 730842 (0.0005) [2023-12-26 05:25:38,207][123091] Updated weights for policy 0, policy_version 730852 (0.0009) [2023-12-26 05:25:38,252][123090] Updated weights for policy 1, policy_version 726377 (0.0005) [2023-12-26 05:25:38,274][123091] Updated weights for policy 0, policy_version 730862 (0.0011) [2023-12-26 05:25:38,319][123090] Updated weights for policy 1, policy_version 726387 (0.0006) [2023-12-26 05:25:38,389][123090] Updated weights for policy 1, policy_version 726397 (0.0009) [2023-12-26 05:25:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 373063680. Throughput: 0: 8908.3, 1: 8858.0. Samples: 373038912. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:38,785][121949] Avg episode reward: [(0, '6006.316'), (1, '5875.312')] [2023-12-26 05:25:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000730864_187105280.pth... [2023-12-26 05:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000726400_185958400.pth... [2023-12-26 05:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000729808_186834944.pth [2023-12-26 05:25:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000725344_185688064.pth [2023-12-26 05:25:39,107][123090] Updated weights for policy 1, policy_version 726407 (0.0007) [2023-12-26 05:25:39,116][123091] Updated weights for policy 0, policy_version 730872 (0.0010) [2023-12-26 05:25:39,164][123090] Updated weights for policy 1, policy_version 726417 (0.0006) [2023-12-26 05:25:39,172][123091] Updated weights for policy 0, policy_version 730882 (0.0009) [2023-12-26 05:25:39,216][123090] Updated weights for policy 1, policy_version 726427 (0.0007) [2023-12-26 05:25:39,236][123091] Updated weights for policy 0, policy_version 730892 (0.0009) [2023-12-26 05:25:40,040][123090] Updated weights for policy 1, policy_version 726437 (0.0007) [2023-12-26 05:25:40,077][123091] Updated weights for policy 0, policy_version 730902 (0.0008) [2023-12-26 05:25:40,108][123090] Updated weights for policy 1, policy_version 726447 (0.0009) [2023-12-26 05:25:40,145][123091] Updated weights for policy 0, policy_version 730912 (0.0008) [2023-12-26 05:25:40,173][123090] Updated weights for policy 1, policy_version 726457 (0.0007) [2023-12-26 05:25:40,212][123091] Updated weights for policy 0, policy_version 730922 (0.0009) [2023-12-26 05:25:40,874][123090] Updated weights for policy 1, policy_version 726467 (0.0007) [2023-12-26 05:25:40,943][123090] Updated weights for policy 1, policy_version 726477 (0.0006) [2023-12-26 05:25:40,950][123091] Updated weights for policy 0, policy_version 730932 (0.0010) [2023-12-26 05:25:41,011][123090] Updated weights for policy 1, policy_version 726487 (0.0006) [2023-12-26 05:25:41,020][123091] Updated weights for policy 0, policy_version 730942 (0.0008) [2023-12-26 05:25:41,089][123091] Updated weights for policy 0, policy_version 730952 (0.0008) [2023-12-26 05:25:41,812][123090] Updated weights for policy 1, policy_version 726497 (0.0008) [2023-12-26 05:25:41,882][123090] Updated weights for policy 1, policy_version 726507 (0.0009) [2023-12-26 05:25:41,894][123091] Updated weights for policy 0, policy_version 730962 (0.0008) [2023-12-26 05:25:41,954][123090] Updated weights for policy 1, policy_version 726517 (0.0006) [2023-12-26 05:25:41,959][123091] Updated weights for policy 0, policy_version 730972 (0.0007) [2023-12-26 05:25:42,021][123090] Updated weights for policy 1, policy_version 726527 (0.0008) [2023-12-26 05:25:42,029][123091] Updated weights for policy 0, policy_version 730982 (0.0006) [2023-12-26 05:25:42,094][123091] Updated weights for policy 0, policy_version 730992 (0.0008) [2023-12-26 05:25:42,819][123090] Updated weights for policy 1, policy_version 726537 (0.0007) [2023-12-26 05:25:42,864][123091] Updated weights for policy 0, policy_version 731002 (0.0009) [2023-12-26 05:25:42,889][123090] Updated weights for policy 1, policy_version 726547 (0.0006) [2023-12-26 05:25:42,931][123091] Updated weights for policy 0, policy_version 731012 (0.0009) [2023-12-26 05:25:42,954][123090] Updated weights for policy 1, policy_version 726557 (0.0007) [2023-12-26 05:25:42,992][123091] Updated weights for policy 0, policy_version 731022 (0.0009) [2023-12-26 05:25:43,684][123090] Updated weights for policy 1, policy_version 726567 (0.0005) [2023-12-26 05:25:43,755][123090] Updated weights for policy 1, policy_version 726577 (0.0005) [2023-12-26 05:25:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 373145600. Throughput: 0: 8844.3, 1: 8863.8. Samples: 373145296. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:43,785][121949] Avg episode reward: [(0, '6093.504'), (1, '5695.072')] [2023-12-26 05:25:43,818][123090] Updated weights for policy 1, policy_version 726587 (0.0007) [2023-12-26 05:25:43,835][123091] Updated weights for policy 0, policy_version 731032 (0.0008) [2023-12-26 05:25:43,905][123091] Updated weights for policy 0, policy_version 731042 (0.0008) [2023-12-26 05:25:43,967][123091] Updated weights for policy 0, policy_version 731052 (0.0008) [2023-12-26 05:25:44,519][123090] Updated weights for policy 1, policy_version 726597 (0.0006) [2023-12-26 05:25:44,595][123090] Updated weights for policy 1, policy_version 726607 (0.0006) [2023-12-26 05:25:44,649][123090] Updated weights for policy 1, policy_version 726617 (0.0007) [2023-12-26 05:25:44,751][123091] Updated weights for policy 0, policy_version 731062 (0.0007) [2023-12-26 05:25:44,823][123091] Updated weights for policy 0, policy_version 731072 (0.0007) [2023-12-26 05:25:44,884][123091] Updated weights for policy 0, policy_version 731082 (0.0006) [2023-12-26 05:25:45,478][123090] Updated weights for policy 1, policy_version 726627 (0.0009) [2023-12-26 05:25:45,534][123090] Updated weights for policy 1, policy_version 726637 (0.0010) [2023-12-26 05:25:45,550][123091] Updated weights for policy 0, policy_version 731092 (0.0006) [2023-12-26 05:25:45,592][123090] Updated weights for policy 1, policy_version 726647 (0.0010) [2023-12-26 05:25:45,612][123091] Updated weights for policy 0, policy_version 731102 (0.0007) [2023-12-26 05:25:45,669][123091] Updated weights for policy 0, policy_version 731112 (0.0006) [2023-12-26 05:25:46,397][123090] Updated weights for policy 1, policy_version 726657 (0.0010) [2023-12-26 05:25:46,448][123091] Updated weights for policy 0, policy_version 731122 (0.0009) [2023-12-26 05:25:46,459][123090] Updated weights for policy 1, policy_version 726667 (0.0005) [2023-12-26 05:25:46,507][123091] Updated weights for policy 0, policy_version 731132 (0.0010) [2023-12-26 05:25:46,520][123090] Updated weights for policy 1, policy_version 726677 (0.0006) [2023-12-26 05:25:46,563][123091] Updated weights for policy 0, policy_version 731142 (0.0011) [2023-12-26 05:25:46,569][123090] Updated weights for policy 1, policy_version 726687 (0.0007) [2023-12-26 05:25:46,621][123091] Updated weights for policy 0, policy_version 731152 (0.0010) [2023-12-26 05:25:47,278][123090] Updated weights for policy 1, policy_version 726697 (0.0008) [2023-12-26 05:25:47,326][123090] Updated weights for policy 1, policy_version 726707 (0.0009) [2023-12-26 05:25:47,376][123090] Updated weights for policy 1, policy_version 726717 (0.0007) [2023-12-26 05:25:47,390][123091] Updated weights for policy 0, policy_version 731162 (0.0011) [2023-12-26 05:25:47,455][123091] Updated weights for policy 0, policy_version 731172 (0.0006) [2023-12-26 05:25:47,510][123091] Updated weights for policy 0, policy_version 731182 (0.0005) [2023-12-26 05:25:48,170][123091] Updated weights for policy 0, policy_version 731192 (0.0006) [2023-12-26 05:25:48,226][123090] Updated weights for policy 1, policy_version 726727 (0.0009) [2023-12-26 05:25:48,244][123091] Updated weights for policy 0, policy_version 731202 (0.0006) [2023-12-26 05:25:48,291][123090] Updated weights for policy 1, policy_version 726737 (0.0010) [2023-12-26 05:25:48,300][123091] Updated weights for policy 0, policy_version 731212 (0.0005) [2023-12-26 05:25:48,360][123090] Updated weights for policy 1, policy_version 726747 (0.0011) [2023-12-26 05:25:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 373243904. Throughput: 0: 8933.3, 1: 8893.5. Samples: 373255004. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:48,784][121949] Avg episode reward: [(0, '6111.346'), (1, '5536.381')] [2023-12-26 05:25:49,118][123091] Updated weights for policy 0, policy_version 731222 (0.0008) [2023-12-26 05:25:49,139][123090] Updated weights for policy 1, policy_version 726757 (0.0008) [2023-12-26 05:25:49,165][123091] Updated weights for policy 0, policy_version 731232 (0.0007) [2023-12-26 05:25:49,201][123090] Updated weights for policy 1, policy_version 726767 (0.0006) [2023-12-26 05:25:49,221][123091] Updated weights for policy 0, policy_version 731242 (0.0007) [2023-12-26 05:25:49,276][123090] Updated weights for policy 1, policy_version 726777 (0.0010) [2023-12-26 05:25:50,006][123091] Updated weights for policy 0, policy_version 731252 (0.0009) [2023-12-26 05:25:50,073][123091] Updated weights for policy 0, policy_version 731262 (0.0009) [2023-12-26 05:25:50,100][123090] Updated weights for policy 1, policy_version 726787 (0.0009) [2023-12-26 05:25:50,138][123091] Updated weights for policy 0, policy_version 731272 (0.0009) [2023-12-26 05:25:50,167][123090] Updated weights for policy 1, policy_version 726797 (0.0006) [2023-12-26 05:25:50,230][123090] Updated weights for policy 1, policy_version 726807 (0.0010) [2023-12-26 05:25:50,855][123091] Updated weights for policy 0, policy_version 731282 (0.0010) [2023-12-26 05:25:50,931][123091] Updated weights for policy 0, policy_version 731292 (0.0011) [2023-12-26 05:25:50,999][123091] Updated weights for policy 0, policy_version 731302 (0.0011) [2023-12-26 05:25:51,011][123090] Updated weights for policy 1, policy_version 726817 (0.0010) [2023-12-26 05:25:51,077][123090] Updated weights for policy 1, policy_version 726827 (0.0009) [2023-12-26 05:25:51,078][123091] Updated weights for policy 0, policy_version 731312 (0.0011) [2023-12-26 05:25:51,151][123090] Updated weights for policy 1, policy_version 726837 (0.0008) [2023-12-26 05:25:51,211][123090] Updated weights for policy 1, policy_version 726847 (0.0008) [2023-12-26 05:25:51,835][123091] Updated weights for policy 0, policy_version 731322 (0.0008) [2023-12-26 05:25:51,883][123091] Updated weights for policy 0, policy_version 731332 (0.0008) [2023-12-26 05:25:51,927][123091] Updated weights for policy 0, policy_version 731342 (0.0008) [2023-12-26 05:25:51,950][123090] Updated weights for policy 1, policy_version 726857 (0.0006) [2023-12-26 05:25:52,011][123090] Updated weights for policy 1, policy_version 726867 (0.0008) [2023-12-26 05:25:52,081][123090] Updated weights for policy 1, policy_version 726877 (0.0007) [2023-12-26 05:25:52,722][123091] Updated weights for policy 0, policy_version 731352 (0.0010) [2023-12-26 05:25:52,777][123091] Updated weights for policy 0, policy_version 731362 (0.0010) [2023-12-26 05:25:52,836][123091] Updated weights for policy 0, policy_version 731372 (0.0010) [2023-12-26 05:25:52,870][123090] Updated weights for policy 1, policy_version 726887 (0.0010) [2023-12-26 05:25:52,930][123090] Updated weights for policy 1, policy_version 726897 (0.0011) [2023-12-26 05:25:52,987][123090] Updated weights for policy 1, policy_version 726907 (0.0010) [2023-12-26 05:25:53,521][123091] Updated weights for policy 0, policy_version 731382 (0.0010) [2023-12-26 05:25:53,591][123091] Updated weights for policy 0, policy_version 731392 (0.0010) [2023-12-26 05:25:53,646][123091] Updated weights for policy 0, policy_version 731402 (0.0007) [2023-12-26 05:25:53,681][123090] Updated weights for policy 1, policy_version 726917 (0.0008) [2023-12-26 05:25:53,753][123090] Updated weights for policy 1, policy_version 726927 (0.0005) [2023-12-26 05:25:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 373334016. Throughput: 0: 8958.2, 1: 8923.8. Samples: 373308648. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:53,785][121949] Avg episode reward: [(0, '6135.215'), (1, '5660.015')] [2023-12-26 05:25:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000731408_187244544.pth... [2023-12-26 05:25:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000730352_186974208.pth [2023-12-26 05:25:53,819][123090] Updated weights for policy 1, policy_version 726937 (0.0007) [2023-12-26 05:25:53,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000726944_186097664.pth... [2023-12-26 05:25:53,864][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000725856_185819136.pth [2023-12-26 05:25:54,306][123091] Updated weights for policy 0, policy_version 731412 (0.0005) [2023-12-26 05:25:54,363][123091] Updated weights for policy 0, policy_version 731422 (0.0006) [2023-12-26 05:25:54,414][123091] Updated weights for policy 0, policy_version 731432 (0.0006) [2023-12-26 05:25:54,519][123090] Updated weights for policy 1, policy_version 726947 (0.0007) [2023-12-26 05:25:54,570][123090] Updated weights for policy 1, policy_version 726957 (0.0009) [2023-12-26 05:25:54,627][123090] Updated weights for policy 1, policy_version 726967 (0.0008) [2023-12-26 05:25:55,175][123091] Updated weights for policy 0, policy_version 731442 (0.0006) [2023-12-26 05:25:55,222][123091] Updated weights for policy 0, policy_version 731452 (0.0010) [2023-12-26 05:25:55,277][123091] Updated weights for policy 0, policy_version 731462 (0.0010) [2023-12-26 05:25:55,336][123091] Updated weights for policy 0, policy_version 731472 (0.0010) [2023-12-26 05:25:55,488][123090] Updated weights for policy 1, policy_version 726977 (0.0009) [2023-12-26 05:25:55,542][123090] Updated weights for policy 1, policy_version 726987 (0.0006) [2023-12-26 05:25:55,599][123090] Updated weights for policy 1, policy_version 726997 (0.0006) [2023-12-26 05:25:55,662][123090] Updated weights for policy 1, policy_version 727007 (0.0006) [2023-12-26 05:25:56,138][123091] Updated weights for policy 0, policy_version 731482 (0.0011) [2023-12-26 05:25:56,198][123091] Updated weights for policy 0, policy_version 731492 (0.0011) [2023-12-26 05:25:56,246][123091] Updated weights for policy 0, policy_version 731502 (0.0010) [2023-12-26 05:25:56,443][123090] Updated weights for policy 1, policy_version 727017 (0.0009) [2023-12-26 05:25:56,490][123090] Updated weights for policy 1, policy_version 727027 (0.0008) [2023-12-26 05:25:56,541][123090] Updated weights for policy 1, policy_version 727037 (0.0008) [2023-12-26 05:25:57,069][123091] Updated weights for policy 0, policy_version 731512 (0.0010) [2023-12-26 05:25:57,121][123091] Updated weights for policy 0, policy_version 731522 (0.0010) [2023-12-26 05:25:57,178][123091] Updated weights for policy 0, policy_version 731532 (0.0011) [2023-12-26 05:25:57,363][123090] Updated weights for policy 1, policy_version 727047 (0.0006) [2023-12-26 05:25:57,410][123090] Updated weights for policy 1, policy_version 727057 (0.0005) [2023-12-26 05:25:57,459][123090] Updated weights for policy 1, policy_version 727067 (0.0005) [2023-12-26 05:25:58,039][123091] Updated weights for policy 0, policy_version 731542 (0.0010) [2023-12-26 05:25:58,108][123091] Updated weights for policy 0, policy_version 731552 (0.0009) [2023-12-26 05:25:58,180][123091] Updated weights for policy 0, policy_version 731562 (0.0006) [2023-12-26 05:25:58,260][123090] Updated weights for policy 1, policy_version 727077 (0.0007) [2023-12-26 05:25:58,327][123090] Updated weights for policy 1, policy_version 727087 (0.0008) [2023-12-26 05:25:58,399][123090] Updated weights for policy 1, policy_version 727097 (0.0008) [2023-12-26 05:25:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 373424128. Throughput: 0: 9048.4, 1: 8981.8. Samples: 373418612. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:25:58,785][121949] Avg episode reward: [(0, '6129.985'), (1, '5548.768')] [2023-12-26 05:25:59,033][123091] Updated weights for policy 0, policy_version 731572 (0.0009) [2023-12-26 05:25:59,085][123091] Updated weights for policy 0, policy_version 731582 (0.0011) [2023-12-26 05:25:59,141][123091] Updated weights for policy 0, policy_version 731592 (0.0010) [2023-12-26 05:25:59,247][123090] Updated weights for policy 1, policy_version 727108 (0.0008) [2023-12-26 05:25:59,302][123090] Updated weights for policy 1, policy_version 727118 (0.0009) [2023-12-26 05:25:59,371][123090] Updated weights for policy 1, policy_version 727128 (0.0009) [2023-12-26 05:25:59,963][123091] Updated weights for policy 0, policy_version 731602 (0.0011) [2023-12-26 05:26:00,019][123091] Updated weights for policy 0, policy_version 731612 (0.0011) [2023-12-26 05:26:00,072][123091] Updated weights for policy 0, policy_version 731622 (0.0005) [2023-12-26 05:26:00,122][123091] Updated weights for policy 0, policy_version 731632 (0.0005) [2023-12-26 05:26:00,254][123090] Updated weights for policy 1, policy_version 727138 (0.0009) [2023-12-26 05:26:00,314][123090] Updated weights for policy 1, policy_version 727148 (0.0009) [2023-12-26 05:26:00,372][123090] Updated weights for policy 1, policy_version 727158 (0.0010) [2023-12-26 05:26:00,427][123090] Updated weights for policy 1, policy_version 727168 (0.0010) [2023-12-26 05:26:00,852][123091] Updated weights for policy 0, policy_version 731642 (0.0006) [2023-12-26 05:26:00,913][123091] Updated weights for policy 0, policy_version 731652 (0.0010) [2023-12-26 05:26:00,965][123091] Updated weights for policy 0, policy_version 731662 (0.0010) [2023-12-26 05:26:01,266][123090] Updated weights for policy 1, policy_version 727178 (0.0010) [2023-12-26 05:26:01,325][123090] Updated weights for policy 1, policy_version 727188 (0.0008) [2023-12-26 05:26:01,401][123090] Updated weights for policy 1, policy_version 727198 (0.0008) [2023-12-26 05:26:01,774][123091] Updated weights for policy 0, policy_version 731672 (0.0007) [2023-12-26 05:26:01,848][123091] Updated weights for policy 0, policy_version 731682 (0.0005) [2023-12-26 05:26:01,910][123091] Updated weights for policy 0, policy_version 731692 (0.0005) [2023-12-26 05:26:02,168][123090] Updated weights for policy 1, policy_version 727208 (0.0006) [2023-12-26 05:26:02,219][123090] Updated weights for policy 1, policy_version 727218 (0.0010) [2023-12-26 05:26:02,287][123090] Updated weights for policy 1, policy_version 727228 (0.0011) [2023-12-26 05:26:02,634][123091] Updated weights for policy 0, policy_version 731702 (0.0008) [2023-12-26 05:26:02,690][123091] Updated weights for policy 0, policy_version 731712 (0.0010) [2023-12-26 05:26:02,745][123091] Updated weights for policy 0, policy_version 731722 (0.0009) [2023-12-26 05:26:03,082][123090] Updated weights for policy 1, policy_version 727238 (0.0010) [2023-12-26 05:26:03,136][123090] Updated weights for policy 1, policy_version 727249 (0.0010) [2023-12-26 05:26:03,191][123090] Updated weights for policy 1, policy_version 727259 (0.0010) [2023-12-26 05:26:03,500][123091] Updated weights for policy 0, policy_version 731732 (0.0008) [2023-12-26 05:26:03,552][123091] Updated weights for policy 0, policy_version 731742 (0.0005) [2023-12-26 05:26:03,600][123091] Updated weights for policy 0, policy_version 731752 (0.0005) [2023-12-26 05:26:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 373514240. Throughput: 0: 9027.9, 1: 8895.4. Samples: 373523068. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:26:03,785][121949] Avg episode reward: [(0, '6134.373'), (1, '5562.447')] [2023-12-26 05:26:04,150][123090] Updated weights for policy 1, policy_version 727269 (0.0010) [2023-12-26 05:26:04,216][123090] Updated weights for policy 1, policy_version 727279 (0.0009) [2023-12-26 05:26:04,286][123090] Updated weights for policy 1, policy_version 727289 (0.0009) [2023-12-26 05:26:04,343][123091] Updated weights for policy 0, policy_version 731762 (0.0006) [2023-12-26 05:26:04,411][123091] Updated weights for policy 0, policy_version 731772 (0.0011) [2023-12-26 05:26:04,475][123091] Updated weights for policy 0, policy_version 731782 (0.0010) [2023-12-26 05:26:04,535][123091] Updated weights for policy 0, policy_version 731792 (0.0011) [2023-12-26 05:26:05,164][123090] Updated weights for policy 1, policy_version 727299 (0.0009) [2023-12-26 05:26:05,213][123090] Updated weights for policy 1, policy_version 727309 (0.0008) [2023-12-26 05:26:05,266][123090] Updated weights for policy 1, policy_version 727319 (0.0006) [2023-12-26 05:26:05,276][123091] Updated weights for policy 0, policy_version 731802 (0.0011) [2023-12-26 05:26:05,335][123091] Updated weights for policy 0, policy_version 731812 (0.0011) [2023-12-26 05:26:05,387][123091] Updated weights for policy 0, policy_version 731822 (0.0006) [2023-12-26 05:26:06,010][123091] Updated weights for policy 0, policy_version 731832 (0.0005) [2023-12-26 05:26:06,071][123091] Updated weights for policy 0, policy_version 731842 (0.0006) [2023-12-26 05:26:06,143][123091] Updated weights for policy 0, policy_version 731852 (0.0009) [2023-12-26 05:26:06,195][123090] Updated weights for policy 1, policy_version 727329 (0.0007) [2023-12-26 05:26:06,268][123090] Updated weights for policy 1, policy_version 727339 (0.0009) [2023-12-26 05:26:06,341][123090] Updated weights for policy 1, policy_version 727349 (0.0009) [2023-12-26 05:26:06,404][123090] Updated weights for policy 1, policy_version 727359 (0.0009) [2023-12-26 05:26:06,921][123091] Updated weights for policy 0, policy_version 731862 (0.0007) [2023-12-26 05:26:06,978][123091] Updated weights for policy 0, policy_version 731872 (0.0005) [2023-12-26 05:26:07,038][123091] Updated weights for policy 0, policy_version 731882 (0.0005) [2023-12-26 05:26:07,277][123090] Updated weights for policy 1, policy_version 727369 (0.0010) [2023-12-26 05:26:07,333][123090] Updated weights for policy 1, policy_version 727379 (0.0010) [2023-12-26 05:26:07,395][123090] Updated weights for policy 1, policy_version 727389 (0.0009) [2023-12-26 05:26:07,695][123091] Updated weights for policy 0, policy_version 731892 (0.0006) [2023-12-26 05:26:07,752][123091] Updated weights for policy 0, policy_version 731902 (0.0005) [2023-12-26 05:26:07,816][123091] Updated weights for policy 0, policy_version 731912 (0.0005) [2023-12-26 05:26:08,350][123090] Updated weights for policy 1, policy_version 727399 (0.0009) [2023-12-26 05:26:08,415][123090] Updated weights for policy 1, policy_version 727409 (0.0006) [2023-12-26 05:26:08,486][123090] Updated weights for policy 1, policy_version 727419 (0.0005) [2023-12-26 05:26:08,549][123091] Updated weights for policy 0, policy_version 731922 (0.0006) [2023-12-26 05:26:08,615][123091] Updated weights for policy 0, policy_version 731932 (0.0011) [2023-12-26 05:26:08,682][123091] Updated weights for policy 0, policy_version 731942 (0.0011) [2023-12-26 05:26:08,747][123091] Updated weights for policy 0, policy_version 731952 (0.0011) [2023-12-26 05:26:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17689.2). Total num frames: 373604352. Throughput: 0: 9085.3, 1: 8836.9. Samples: 373575760. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:26:08,785][121949] Avg episode reward: [(0, '6128.270'), (1, '5618.197')] [2023-12-26 05:26:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000727424_186220544.pth... [2023-12-26 05:26:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000731952_187383808.pth... [2023-12-26 05:26:08,791][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000726400_185958400.pth [2023-12-26 05:26:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000730864_187105280.pth [2023-12-26 05:26:09,272][123090] Updated weights for policy 1, policy_version 727429 (0.0008) [2023-12-26 05:26:09,340][123090] Updated weights for policy 1, policy_version 727439 (0.0011) [2023-12-26 05:26:09,416][123090] Updated weights for policy 1, policy_version 727449 (0.0010) [2023-12-26 05:26:09,507][123091] Updated weights for policy 0, policy_version 731962 (0.0011) [2023-12-26 05:26:09,576][123091] Updated weights for policy 0, policy_version 731972 (0.0011) [2023-12-26 05:26:09,646][123091] Updated weights for policy 0, policy_version 731982 (0.0007) [2023-12-26 05:26:10,240][123090] Updated weights for policy 1, policy_version 727459 (0.0007) [2023-12-26 05:26:10,308][123090] Updated weights for policy 1, policy_version 727469 (0.0008) [2023-12-26 05:26:10,380][123090] Updated weights for policy 1, policy_version 727479 (0.0006) [2023-12-26 05:26:10,425][123091] Updated weights for policy 0, policy_version 731992 (0.0010) [2023-12-26 05:26:10,489][123091] Updated weights for policy 0, policy_version 732002 (0.0010) [2023-12-26 05:26:10,549][123091] Updated weights for policy 0, policy_version 732012 (0.0011) [2023-12-26 05:26:11,170][123090] Updated weights for policy 1, policy_version 727489 (0.0006) [2023-12-26 05:26:11,238][123090] Updated weights for policy 1, policy_version 727499 (0.0011) [2023-12-26 05:26:11,307][123090] Updated weights for policy 1, policy_version 727509 (0.0010) [2023-12-26 05:26:11,340][123091] Updated weights for policy 0, policy_version 732022 (0.0009) [2023-12-26 05:26:11,376][123090] Updated weights for policy 1, policy_version 727519 (0.0011) [2023-12-26 05:26:11,413][123091] Updated weights for policy 0, policy_version 732032 (0.0009) [2023-12-26 05:26:11,482][123091] Updated weights for policy 0, policy_version 732042 (0.0010) [2023-12-26 05:26:12,163][123090] Updated weights for policy 1, policy_version 727529 (0.0006) [2023-12-26 05:26:12,231][123090] Updated weights for policy 1, policy_version 727539 (0.0006) [2023-12-26 05:26:12,300][123090] Updated weights for policy 1, policy_version 727549 (0.0008) [2023-12-26 05:26:12,326][123091] Updated weights for policy 0, policy_version 732052 (0.0007) [2023-12-26 05:26:12,396][123091] Updated weights for policy 0, policy_version 732062 (0.0011) [2023-12-26 05:26:12,465][123091] Updated weights for policy 0, policy_version 732072 (0.0010) [2023-12-26 05:26:13,053][123090] Updated weights for policy 1, policy_version 727559 (0.0009) [2023-12-26 05:26:13,128][123090] Updated weights for policy 1, policy_version 727569 (0.0009) [2023-12-26 05:26:13,206][123090] Updated weights for policy 1, policy_version 727579 (0.0010) [2023-12-26 05:26:13,228][123091] Updated weights for policy 0, policy_version 732082 (0.0008) [2023-12-26 05:26:13,293][123091] Updated weights for policy 0, policy_version 732092 (0.0006) [2023-12-26 05:26:13,359][123091] Updated weights for policy 0, policy_version 732102 (0.0010) [2023-12-26 05:26:13,427][123091] Updated weights for policy 0, policy_version 732112 (0.0009) [2023-12-26 05:26:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 373686272. Throughput: 0: 9068.6, 1: 8812.6. Samples: 373680784. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:26:13,785][121949] Avg episode reward: [(0, '6097.147'), (1, '5518.556')] [2023-12-26 05:26:13,936][123090] Updated weights for policy 1, policy_version 727589 (0.0009) [2023-12-26 05:26:13,983][123090] Updated weights for policy 1, policy_version 727599 (0.0010) [2023-12-26 05:26:14,043][123090] Updated weights for policy 1, policy_version 727609 (0.0010) [2023-12-26 05:26:14,210][123091] Updated weights for policy 0, policy_version 732122 (0.0010) [2023-12-26 05:26:14,265][123091] Updated weights for policy 0, policy_version 732132 (0.0010) [2023-12-26 05:26:14,312][123091] Updated weights for policy 0, policy_version 732142 (0.0007) [2023-12-26 05:26:14,734][123090] Updated weights for policy 1, policy_version 727619 (0.0009) [2023-12-26 05:26:14,806][123090] Updated weights for policy 1, policy_version 727629 (0.0009) [2023-12-26 05:26:14,875][123090] Updated weights for policy 1, policy_version 727639 (0.0010) [2023-12-26 05:26:15,052][123091] Updated weights for policy 0, policy_version 732152 (0.0006) [2023-12-26 05:26:15,100][123091] Updated weights for policy 0, policy_version 732162 (0.0006) [2023-12-26 05:26:15,152][123091] Updated weights for policy 0, policy_version 732172 (0.0005) [2023-12-26 05:26:15,713][123090] Updated weights for policy 1, policy_version 727649 (0.0010) [2023-12-26 05:26:15,769][123090] Updated weights for policy 1, policy_version 727659 (0.0010) [2023-12-26 05:26:15,821][123090] Updated weights for policy 1, policy_version 727669 (0.0010) [2023-12-26 05:26:15,848][123091] Updated weights for policy 0, policy_version 732182 (0.0006) [2023-12-26 05:26:15,876][123090] Updated weights for policy 1, policy_version 727679 (0.0009) [2023-12-26 05:26:15,912][123091] Updated weights for policy 0, policy_version 732192 (0.0009) [2023-12-26 05:26:15,976][123091] Updated weights for policy 0, policy_version 732202 (0.0007) [2023-12-26 05:26:16,608][123090] Updated weights for policy 1, policy_version 727689 (0.0006) [2023-12-26 05:26:16,625][123091] Updated weights for policy 0, policy_version 732212 (0.0006) [2023-12-26 05:26:16,672][123090] Updated weights for policy 1, policy_version 727699 (0.0005) [2023-12-26 05:26:16,691][123091] Updated weights for policy 0, policy_version 732222 (0.0007) [2023-12-26 05:26:16,744][123090] Updated weights for policy 1, policy_version 727709 (0.0005) [2023-12-26 05:26:16,763][123091] Updated weights for policy 0, policy_version 732232 (0.0008) [2023-12-26 05:26:17,402][123091] Updated weights for policy 0, policy_version 732242 (0.0008) [2023-12-26 05:26:17,443][123090] Updated weights for policy 1, policy_version 727719 (0.0005) [2023-12-26 05:26:17,460][123091] Updated weights for policy 0, policy_version 732252 (0.0008) [2023-12-26 05:26:17,501][123090] Updated weights for policy 1, policy_version 727729 (0.0008) [2023-12-26 05:26:17,515][123091] Updated weights for policy 0, policy_version 732262 (0.0009) [2023-12-26 05:26:17,548][123090] Updated weights for policy 1, policy_version 727739 (0.0005) [2023-12-26 05:26:17,566][123091] Updated weights for policy 0, policy_version 732272 (0.0010) [2023-12-26 05:26:18,334][123091] Updated weights for policy 0, policy_version 732282 (0.0007) [2023-12-26 05:26:18,374][123090] Updated weights for policy 1, policy_version 727749 (0.0007) [2023-12-26 05:26:18,403][123091] Updated weights for policy 0, policy_version 732292 (0.0008) [2023-12-26 05:26:18,435][123090] Updated weights for policy 1, policy_version 727759 (0.0005) [2023-12-26 05:26:18,469][123091] Updated weights for policy 0, policy_version 732302 (0.0009) [2023-12-26 05:26:18,502][123090] Updated weights for policy 1, policy_version 727769 (0.0005) [2023-12-26 05:26:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 373784576. Throughput: 0: 9132.3, 1: 8877.2. Samples: 373794056. Policy #0 lag: (min: 7.0, avg: 20.0, max: 39.0) [2023-12-26 05:26:18,785][121949] Avg episode reward: [(0, '6072.893'), (1, '5588.068')] [2023-12-26 05:26:19,059][123090] Updated weights for policy 1, policy_version 727779 (0.0005) [2023-12-26 05:26:19,114][123090] Updated weights for policy 1, policy_version 727789 (0.0005) [2023-12-26 05:26:19,158][123090] Updated weights for policy 1, policy_version 727799 (0.0005) [2023-12-26 05:26:19,324][123091] Updated weights for policy 0, policy_version 732312 (0.0009) [2023-12-26 05:26:19,391][123091] Updated weights for policy 0, policy_version 732322 (0.0008) [2023-12-26 05:26:19,445][123091] Updated weights for policy 0, policy_version 732332 (0.0009) [2023-12-26 05:26:20,032][123090] Updated weights for policy 1, policy_version 727809 (0.0006) [2023-12-26 05:26:20,092][123090] Updated weights for policy 1, policy_version 727819 (0.0009) [2023-12-26 05:26:20,157][123090] Updated weights for policy 1, policy_version 727829 (0.0009) [2023-12-26 05:26:20,224][123090] Updated weights for policy 1, policy_version 727839 (0.0009) [2023-12-26 05:26:20,301][123091] Updated weights for policy 0, policy_version 732342 (0.0008) [2023-12-26 05:26:20,364][123091] Updated weights for policy 0, policy_version 732352 (0.0008) [2023-12-26 05:26:20,430][123091] Updated weights for policy 0, policy_version 732362 (0.0008) [2023-12-26 05:26:21,096][123090] Updated weights for policy 1, policy_version 727849 (0.0010) [2023-12-26 05:26:21,165][123090] Updated weights for policy 1, policy_version 727859 (0.0009) [2023-12-26 05:26:21,240][123090] Updated weights for policy 1, policy_version 727869 (0.0007) [2023-12-26 05:26:21,244][123091] Updated weights for policy 0, policy_version 732372 (0.0007) [2023-12-26 05:26:21,315][123091] Updated weights for policy 0, policy_version 732382 (0.0006) [2023-12-26 05:26:21,389][123091] Updated weights for policy 0, policy_version 732392 (0.0008) [2023-12-26 05:26:22,084][123090] Updated weights for policy 1, policy_version 727879 (0.0009) [2023-12-26 05:26:22,149][123090] Updated weights for policy 1, policy_version 727889 (0.0010) [2023-12-26 05:26:22,201][123091] Updated weights for policy 0, policy_version 732402 (0.0008) [2023-12-26 05:26:22,219][123090] Updated weights for policy 1, policy_version 727899 (0.0009) [2023-12-26 05:26:22,255][123091] Updated weights for policy 0, policy_version 732412 (0.0006) [2023-12-26 05:26:22,315][123091] Updated weights for policy 0, policy_version 732422 (0.0009) [2023-12-26 05:26:22,389][123091] Updated weights for policy 0, policy_version 732432 (0.0007) [2023-12-26 05:26:23,062][123090] Updated weights for policy 1, policy_version 727909 (0.0009) [2023-12-26 05:26:23,115][123090] Updated weights for policy 1, policy_version 727919 (0.0010) [2023-12-26 05:26:23,169][123090] Updated weights for policy 1, policy_version 727929 (0.0008) [2023-12-26 05:26:23,193][123091] Updated weights for policy 0, policy_version 732442 (0.0009) [2023-12-26 05:26:23,251][123091] Updated weights for policy 0, policy_version 732453 (0.0009) [2023-12-26 05:26:23,301][123091] Updated weights for policy 0, policy_version 732463 (0.0009) [2023-12-26 05:26:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 373866496. Throughput: 0: 9099.6, 1: 8818.5. Samples: 373845228. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:23,785][121949] Avg episode reward: [(0, '6023.646'), (1, '5584.125')] [2023-12-26 05:26:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000727936_186351616.pth... [2023-12-26 05:26:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000732464_187514880.pth... [2023-12-26 05:26:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000726944_186097664.pth [2023-12-26 05:26:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000731408_187244544.pth [2023-12-26 05:26:23,908][123090] Updated weights for policy 1, policy_version 727939 (0.0006) [2023-12-26 05:26:23,958][123090] Updated weights for policy 1, policy_version 727949 (0.0005) [2023-12-26 05:26:24,025][123090] Updated weights for policy 1, policy_version 727959 (0.0005) [2023-12-26 05:26:24,180][123091] Updated weights for policy 0, policy_version 732473 (0.0005) [2023-12-26 05:26:24,231][123091] Updated weights for policy 0, policy_version 732483 (0.0006) [2023-12-26 05:26:24,277][123091] Updated weights for policy 0, policy_version 732493 (0.0005) [2023-12-26 05:26:24,840][123090] Updated weights for policy 1, policy_version 727969 (0.0006) [2023-12-26 05:26:24,904][123090] Updated weights for policy 1, policy_version 727979 (0.0009) [2023-12-26 05:26:24,970][123090] Updated weights for policy 1, policy_version 727989 (0.0008) [2023-12-26 05:26:24,980][123091] Updated weights for policy 0, policy_version 732503 (0.0005) [2023-12-26 05:26:25,036][123090] Updated weights for policy 1, policy_version 727999 (0.0010) [2023-12-26 05:26:25,043][123091] Updated weights for policy 0, policy_version 732513 (0.0005) [2023-12-26 05:26:25,094][123091] Updated weights for policy 0, policy_version 732523 (0.0005) [2023-12-26 05:26:25,846][123090] Updated weights for policy 1, policy_version 728010 (0.0007) [2023-12-26 05:26:25,869][123091] Updated weights for policy 0, policy_version 732533 (0.0007) [2023-12-26 05:26:25,914][123090] Updated weights for policy 1, policy_version 728020 (0.0011) [2023-12-26 05:26:25,930][123091] Updated weights for policy 0, policy_version 732543 (0.0006) [2023-12-26 05:26:25,974][123090] Updated weights for policy 1, policy_version 728030 (0.0010) [2023-12-26 05:26:25,979][123091] Updated weights for policy 0, policy_version 732553 (0.0008) [2023-12-26 05:26:26,691][123090] Updated weights for policy 1, policy_version 728040 (0.0008) [2023-12-26 05:26:26,761][123090] Updated weights for policy 1, policy_version 728050 (0.0010) [2023-12-26 05:26:26,821][123090] Updated weights for policy 1, policy_version 728060 (0.0011) [2023-12-26 05:26:26,875][123091] Updated weights for policy 0, policy_version 732563 (0.0009) [2023-12-26 05:26:26,939][123091] Updated weights for policy 0, policy_version 732573 (0.0009) [2023-12-26 05:26:26,996][123091] Updated weights for policy 0, policy_version 732583 (0.0009) [2023-12-26 05:26:27,614][123090] Updated weights for policy 1, policy_version 728070 (0.0010) [2023-12-26 05:26:27,671][123090] Updated weights for policy 1, policy_version 728080 (0.0009) [2023-12-26 05:26:27,727][123090] Updated weights for policy 1, policy_version 728090 (0.0006) [2023-12-26 05:26:27,851][123091] Updated weights for policy 0, policy_version 732593 (0.0009) [2023-12-26 05:26:27,925][123091] Updated weights for policy 0, policy_version 732603 (0.0007) [2023-12-26 05:26:27,985][123091] Updated weights for policy 0, policy_version 732613 (0.0008) [2023-12-26 05:26:28,037][123091] Updated weights for policy 0, policy_version 732623 (0.0008) [2023-12-26 05:26:28,540][123090] Updated weights for policy 1, policy_version 728100 (0.0008) [2023-12-26 05:26:28,602][123090] Updated weights for policy 1, policy_version 728110 (0.0006) [2023-12-26 05:26:28,667][123090] Updated weights for policy 1, policy_version 728120 (0.0007) [2023-12-26 05:26:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 373956608. Throughput: 0: 9126.5, 1: 8774.3. Samples: 373950832. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:28,785][121949] Avg episode reward: [(0, '6142.826'), (1, '5670.602')] [2023-12-26 05:26:28,879][123091] Updated weights for policy 0, policy_version 732633 (0.0009) [2023-12-26 05:26:28,937][123091] Updated weights for policy 0, policy_version 732643 (0.0010) [2023-12-26 05:26:29,005][123091] Updated weights for policy 0, policy_version 732653 (0.0011) [2023-12-26 05:26:29,469][123090] Updated weights for policy 1, policy_version 728130 (0.0009) [2023-12-26 05:26:29,530][123090] Updated weights for policy 1, policy_version 728140 (0.0009) [2023-12-26 05:26:29,582][123090] Updated weights for policy 1, policy_version 728150 (0.0009) [2023-12-26 05:26:29,632][123090] Updated weights for policy 1, policy_version 728160 (0.0008) [2023-12-26 05:26:29,880][123091] Updated weights for policy 0, policy_version 732663 (0.0008) [2023-12-26 05:26:29,946][123091] Updated weights for policy 0, policy_version 732673 (0.0009) [2023-12-26 05:26:30,004][123091] Updated weights for policy 0, policy_version 732683 (0.0010) [2023-12-26 05:26:30,495][123090] Updated weights for policy 1, policy_version 728170 (0.0005) [2023-12-26 05:26:30,563][123090] Updated weights for policy 1, policy_version 728180 (0.0008) [2023-12-26 05:26:30,617][123090] Updated weights for policy 1, policy_version 728190 (0.0008) [2023-12-26 05:26:30,855][123091] Updated weights for policy 0, policy_version 732693 (0.0009) [2023-12-26 05:26:30,905][123091] Updated weights for policy 0, policy_version 732703 (0.0009) [2023-12-26 05:26:30,966][123091] Updated weights for policy 0, policy_version 732713 (0.0009) [2023-12-26 05:26:31,407][123090] Updated weights for policy 1, policy_version 728200 (0.0010) [2023-12-26 05:26:31,467][123090] Updated weights for policy 1, policy_version 728210 (0.0009) [2023-12-26 05:26:31,527][123090] Updated weights for policy 1, policy_version 728220 (0.0009) [2023-12-26 05:26:31,861][123091] Updated weights for policy 0, policy_version 732723 (0.0010) [2023-12-26 05:26:31,925][123091] Updated weights for policy 0, policy_version 732733 (0.0009) [2023-12-26 05:26:31,982][123091] Updated weights for policy 0, policy_version 732743 (0.0009) [2023-12-26 05:26:32,410][123090] Updated weights for policy 1, policy_version 728230 (0.0009) [2023-12-26 05:26:32,465][123090] Updated weights for policy 1, policy_version 728240 (0.0009) [2023-12-26 05:26:32,517][123090] Updated weights for policy 1, policy_version 728250 (0.0010) [2023-12-26 05:26:32,726][123091] Updated weights for policy 0, policy_version 732753 (0.0009) [2023-12-26 05:26:32,778][123091] Updated weights for policy 0, policy_version 732763 (0.0005) [2023-12-26 05:26:32,833][123091] Updated weights for policy 0, policy_version 732773 (0.0009) [2023-12-26 05:26:32,881][123091] Updated weights for policy 0, policy_version 732783 (0.0009) [2023-12-26 05:26:33,343][123090] Updated weights for policy 1, policy_version 728260 (0.0007) [2023-12-26 05:26:33,405][123090] Updated weights for policy 1, policy_version 728270 (0.0005) [2023-12-26 05:26:33,461][123090] Updated weights for policy 1, policy_version 728280 (0.0005) [2023-12-26 05:26:33,716][123091] Updated weights for policy 0, policy_version 732793 (0.0009) [2023-12-26 05:26:33,776][123091] Updated weights for policy 0, policy_version 732803 (0.0009) [2023-12-26 05:26:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 374038528. Throughput: 0: 9017.9, 1: 8727.8. Samples: 374053560. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:33,784][121949] Avg episode reward: [(0, '6191.911'), (1, '5723.507')] [2023-12-26 05:26:33,829][123091] Updated weights for policy 0, policy_version 732813 (0.0010) [2023-12-26 05:26:34,003][123090] Updated weights for policy 1, policy_version 728290 (0.0005) [2023-12-26 05:26:34,051][123090] Updated weights for policy 1, policy_version 728300 (0.0005) [2023-12-26 05:26:34,103][123090] Updated weights for policy 1, policy_version 728310 (0.0005) [2023-12-26 05:26:34,165][123090] Updated weights for policy 1, policy_version 728320 (0.0007) [2023-12-26 05:26:34,746][123091] Updated weights for policy 0, policy_version 732823 (0.0010) [2023-12-26 05:26:34,805][123091] Updated weights for policy 0, policy_version 732833 (0.0007) [2023-12-26 05:26:34,877][123091] Updated weights for policy 0, policy_version 732843 (0.0008) [2023-12-26 05:26:34,920][123090] Updated weights for policy 1, policy_version 728330 (0.0008) [2023-12-26 05:26:34,970][123090] Updated weights for policy 1, policy_version 728340 (0.0009) [2023-12-26 05:26:35,028][123090] Updated weights for policy 1, policy_version 728350 (0.0009) [2023-12-26 05:26:35,616][123091] Updated weights for policy 0, policy_version 732854 (0.0009) [2023-12-26 05:26:35,676][123091] Updated weights for policy 0, policy_version 732865 (0.0010) [2023-12-26 05:26:35,728][123091] Updated weights for policy 0, policy_version 732876 (0.0010) [2023-12-26 05:26:35,761][123090] Updated weights for policy 1, policy_version 728360 (0.0009) [2023-12-26 05:26:35,821][123090] Updated weights for policy 1, policy_version 728370 (0.0009) [2023-12-26 05:26:35,878][123090] Updated weights for policy 1, policy_version 728380 (0.0010) [2023-12-26 05:26:36,606][123091] Updated weights for policy 0, policy_version 732886 (0.0008) [2023-12-26 05:26:36,671][123091] Updated weights for policy 0, policy_version 732896 (0.0010) [2023-12-26 05:26:36,742][123091] Updated weights for policy 0, policy_version 732906 (0.0011) [2023-12-26 05:26:36,749][123090] Updated weights for policy 1, policy_version 728390 (0.0010) [2023-12-26 05:26:36,805][123090] Updated weights for policy 1, policy_version 728400 (0.0010) [2023-12-26 05:26:36,864][123090] Updated weights for policy 1, policy_version 728410 (0.0005) [2023-12-26 05:26:37,525][123091] Updated weights for policy 0, policy_version 732916 (0.0009) [2023-12-26 05:26:37,574][123090] Updated weights for policy 1, policy_version 728420 (0.0006) [2023-12-26 05:26:37,582][123091] Updated weights for policy 0, policy_version 732926 (0.0006) [2023-12-26 05:26:37,631][123090] Updated weights for policy 1, policy_version 728430 (0.0005) [2023-12-26 05:26:37,639][123091] Updated weights for policy 0, policy_version 732936 (0.0006) [2023-12-26 05:26:37,688][123090] Updated weights for policy 1, policy_version 728440 (0.0005) [2023-12-26 05:26:38,429][123091] Updated weights for policy 0, policy_version 732946 (0.0009) [2023-12-26 05:26:38,492][123091] Updated weights for policy 0, policy_version 732956 (0.0009) [2023-12-26 05:26:38,499][123090] Updated weights for policy 1, policy_version 728450 (0.0009) [2023-12-26 05:26:38,547][123090] Updated weights for policy 1, policy_version 728460 (0.0010) [2023-12-26 05:26:38,553][123091] Updated weights for policy 0, policy_version 732966 (0.0006) [2023-12-26 05:26:38,608][123090] Updated weights for policy 1, policy_version 728470 (0.0009) [2023-12-26 05:26:38,618][123091] Updated weights for policy 0, policy_version 732976 (0.0008) [2023-12-26 05:26:38,668][123090] Updated weights for policy 1, policy_version 728480 (0.0009) [2023-12-26 05:26:38,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.7, 300 sec: 17689.1). Total num frames: 374136832. Throughput: 0: 8977.2, 1: 8775.1. Samples: 374107512. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:38,786][121949] Avg episode reward: [(0, '6168.692'), (1, '5521.803')] [2023-12-26 05:26:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000728480_186490880.pth... [2023-12-26 05:26:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000732976_187645952.pth... [2023-12-26 05:26:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000727424_186220544.pth [2023-12-26 05:26:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000731952_187383808.pth [2023-12-26 05:26:39,503][123091] Updated weights for policy 0, policy_version 732986 (0.0009) [2023-12-26 05:26:39,546][123090] Updated weights for policy 1, policy_version 728490 (0.0011) [2023-12-26 05:26:39,570][123091] Updated weights for policy 0, policy_version 732996 (0.0008) [2023-12-26 05:26:39,611][123090] Updated weights for policy 1, policy_version 728500 (0.0011) [2023-12-26 05:26:39,631][123091] Updated weights for policy 0, policy_version 733006 (0.0009) [2023-12-26 05:26:39,678][123090] Updated weights for policy 1, policy_version 728510 (0.0011) [2023-12-26 05:26:40,454][123091] Updated weights for policy 0, policy_version 733016 (0.0007) [2023-12-26 05:26:40,496][123090] Updated weights for policy 1, policy_version 728520 (0.0009) [2023-12-26 05:26:40,513][123091] Updated weights for policy 0, policy_version 733026 (0.0006) [2023-12-26 05:26:40,550][123090] Updated weights for policy 1, policy_version 728530 (0.0009) [2023-12-26 05:26:40,574][123091] Updated weights for policy 0, policy_version 733036 (0.0008) [2023-12-26 05:26:40,604][123090] Updated weights for policy 1, policy_version 728540 (0.0008) [2023-12-26 05:26:41,395][123091] Updated weights for policy 0, policy_version 733046 (0.0007) [2023-12-26 05:26:41,459][123091] Updated weights for policy 0, policy_version 733056 (0.0011) [2023-12-26 05:26:41,510][123090] Updated weights for policy 1, policy_version 728550 (0.0008) [2023-12-26 05:26:41,524][123091] Updated weights for policy 0, policy_version 733066 (0.0010) [2023-12-26 05:26:41,577][123090] Updated weights for policy 1, policy_version 728560 (0.0007) [2023-12-26 05:26:41,654][123090] Updated weights for policy 1, policy_version 728570 (0.0010) [2023-12-26 05:26:42,290][123091] Updated weights for policy 0, policy_version 733076 (0.0009) [2023-12-26 05:26:42,346][123091] Updated weights for policy 0, policy_version 733086 (0.0009) [2023-12-26 05:26:42,411][123091] Updated weights for policy 0, policy_version 733096 (0.0006) [2023-12-26 05:26:42,422][123090] Updated weights for policy 1, policy_version 728580 (0.0008) [2023-12-26 05:26:42,494][123090] Updated weights for policy 1, policy_version 728590 (0.0005) [2023-12-26 05:26:42,573][123090] Updated weights for policy 1, policy_version 728600 (0.0005) [2023-12-26 05:26:43,136][123091] Updated weights for policy 0, policy_version 733106 (0.0010) [2023-12-26 05:26:43,182][123091] Updated weights for policy 0, policy_version 733116 (0.0010) [2023-12-26 05:26:43,233][123090] Updated weights for policy 1, policy_version 728610 (0.0006) [2023-12-26 05:26:43,241][123091] Updated weights for policy 0, policy_version 733126 (0.0006) [2023-12-26 05:26:43,293][123090] Updated weights for policy 1, policy_version 728620 (0.0009) [2023-12-26 05:26:43,303][123091] Updated weights for policy 0, policy_version 733136 (0.0005) [2023-12-26 05:26:43,363][123090] Updated weights for policy 1, policy_version 728630 (0.0009) [2023-12-26 05:26:43,431][123090] Updated weights for policy 1, policy_version 728640 (0.0009) [2023-12-26 05:26:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 374218752. Throughput: 0: 8890.0, 1: 8721.1. Samples: 374211116. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:43,785][121949] Avg episode reward: [(0, '6128.383'), (1, '5516.083')] [2023-12-26 05:26:44,105][123091] Updated weights for policy 0, policy_version 733146 (0.0010) [2023-12-26 05:26:44,160][123091] Updated weights for policy 0, policy_version 733156 (0.0009) [2023-12-26 05:26:44,214][123091] Updated weights for policy 0, policy_version 733166 (0.0009) [2023-12-26 05:26:44,248][123090] Updated weights for policy 1, policy_version 728650 (0.0009) [2023-12-26 05:26:44,316][123090] Updated weights for policy 1, policy_version 728660 (0.0009) [2023-12-26 05:26:44,380][123090] Updated weights for policy 1, policy_version 728670 (0.0008) [2023-12-26 05:26:45,032][123091] Updated weights for policy 0, policy_version 733176 (0.0007) [2023-12-26 05:26:45,106][123091] Updated weights for policy 0, policy_version 733186 (0.0006) [2023-12-26 05:26:45,178][123091] Updated weights for policy 0, policy_version 733196 (0.0007) [2023-12-26 05:26:45,197][123090] Updated weights for policy 1, policy_version 728680 (0.0009) [2023-12-26 05:26:45,259][123090] Updated weights for policy 1, policy_version 728690 (0.0010) [2023-12-26 05:26:45,319][123090] Updated weights for policy 1, policy_version 728700 (0.0010) [2023-12-26 05:26:45,861][123091] Updated weights for policy 0, policy_version 733206 (0.0008) [2023-12-26 05:26:45,921][123091] Updated weights for policy 0, policy_version 733216 (0.0010) [2023-12-26 05:26:45,982][123091] Updated weights for policy 0, policy_version 733226 (0.0009) [2023-12-26 05:26:46,131][123090] Updated weights for policy 1, policy_version 728710 (0.0007) [2023-12-26 05:26:46,186][123090] Updated weights for policy 1, policy_version 728720 (0.0007) [2023-12-26 05:26:46,234][123090] Updated weights for policy 1, policy_version 728730 (0.0009) [2023-12-26 05:26:46,760][123091] Updated weights for policy 0, policy_version 733236 (0.0008) [2023-12-26 05:26:46,822][123091] Updated weights for policy 0, policy_version 733246 (0.0005) [2023-12-26 05:26:46,872][123091] Updated weights for policy 0, policy_version 733256 (0.0008) [2023-12-26 05:26:47,116][123090] Updated weights for policy 1, policy_version 728740 (0.0009) [2023-12-26 05:26:47,179][123090] Updated weights for policy 1, policy_version 728750 (0.0008) [2023-12-26 05:26:47,246][123090] Updated weights for policy 1, policy_version 728760 (0.0009) [2023-12-26 05:26:47,663][123091] Updated weights for policy 0, policy_version 733266 (0.0010) [2023-12-26 05:26:47,735][123091] Updated weights for policy 0, policy_version 733276 (0.0010) [2023-12-26 05:26:47,792][123091] Updated weights for policy 0, policy_version 733286 (0.0010) [2023-12-26 05:26:47,840][123091] Updated weights for policy 0, policy_version 733296 (0.0009) [2023-12-26 05:26:48,046][123090] Updated weights for policy 1, policy_version 728770 (0.0009) [2023-12-26 05:26:48,115][123090] Updated weights for policy 1, policy_version 728780 (0.0009) [2023-12-26 05:26:48,177][123090] Updated weights for policy 1, policy_version 728790 (0.0009) [2023-12-26 05:26:48,244][123090] Updated weights for policy 1, policy_version 728800 (0.0009) [2023-12-26 05:26:48,688][123091] Updated weights for policy 0, policy_version 733306 (0.0011) [2023-12-26 05:26:48,743][123091] Updated weights for policy 0, policy_version 733316 (0.0011) [2023-12-26 05:26:48,784][121949] Fps is (10 sec: 16384.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 374300672. Throughput: 0: 8892.4, 1: 8749.3. Samples: 374316948. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:48,785][121949] Avg episode reward: [(0, '6083.271'), (1, '5592.062')] [2023-12-26 05:26:48,806][123091] Updated weights for policy 0, policy_version 733326 (0.0011) [2023-12-26 05:26:49,076][123090] Updated weights for policy 1, policy_version 728810 (0.0006) [2023-12-26 05:26:49,125][123090] Updated weights for policy 1, policy_version 728820 (0.0005) [2023-12-26 05:26:49,198][123090] Updated weights for policy 1, policy_version 728830 (0.0005) [2023-12-26 05:26:49,625][123091] Updated weights for policy 0, policy_version 733336 (0.0011) [2023-12-26 05:26:49,681][123091] Updated weights for policy 0, policy_version 733346 (0.0011) [2023-12-26 05:26:49,743][123091] Updated weights for policy 0, policy_version 733356 (0.0011) [2023-12-26 05:26:50,001][123090] Updated weights for policy 1, policy_version 728840 (0.0008) [2023-12-26 05:26:50,071][123090] Updated weights for policy 1, policy_version 728850 (0.0009) [2023-12-26 05:26:50,142][123090] Updated weights for policy 1, policy_version 728860 (0.0010) [2023-12-26 05:26:50,585][123091] Updated weights for policy 0, policy_version 733366 (0.0011) [2023-12-26 05:26:50,654][123091] Updated weights for policy 0, policy_version 733376 (0.0011) [2023-12-26 05:26:50,723][123091] Updated weights for policy 0, policy_version 733386 (0.0009) [2023-12-26 05:26:50,977][123090] Updated weights for policy 1, policy_version 728870 (0.0009) [2023-12-26 05:26:51,032][123090] Updated weights for policy 1, policy_version 728880 (0.0009) [2023-12-26 05:26:51,097][123090] Updated weights for policy 1, policy_version 728890 (0.0008) [2023-12-26 05:26:51,556][123091] Updated weights for policy 0, policy_version 733396 (0.0011) [2023-12-26 05:26:51,626][123091] Updated weights for policy 0, policy_version 733406 (0.0010) [2023-12-26 05:26:51,693][123091] Updated weights for policy 0, policy_version 733416 (0.0011) [2023-12-26 05:26:51,877][123090] Updated weights for policy 1, policy_version 728900 (0.0009) [2023-12-26 05:26:51,940][123090] Updated weights for policy 1, policy_version 728910 (0.0009) [2023-12-26 05:26:52,001][123090] Updated weights for policy 1, policy_version 728920 (0.0009) [2023-12-26 05:26:52,507][123091] Updated weights for policy 0, policy_version 733426 (0.0009) [2023-12-26 05:26:52,578][123091] Updated weights for policy 0, policy_version 733436 (0.0011) [2023-12-26 05:26:52,647][123091] Updated weights for policy 0, policy_version 733446 (0.0011) [2023-12-26 05:26:52,711][123091] Updated weights for policy 0, policy_version 733456 (0.0011) [2023-12-26 05:26:52,847][123090] Updated weights for policy 1, policy_version 728930 (0.0008) [2023-12-26 05:26:52,918][123090] Updated weights for policy 1, policy_version 728940 (0.0006) [2023-12-26 05:26:52,986][123090] Updated weights for policy 1, policy_version 728950 (0.0007) [2023-12-26 05:26:53,050][123090] Updated weights for policy 1, policy_version 728960 (0.0007) [2023-12-26 05:26:53,427][123091] Updated weights for policy 0, policy_version 733466 (0.0005) [2023-12-26 05:26:53,476][123091] Updated weights for policy 0, policy_version 733476 (0.0005) [2023-12-26 05:26:53,525][123091] Updated weights for policy 0, policy_version 733486 (0.0005) [2023-12-26 05:26:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 374390784. Throughput: 0: 8807.2, 1: 8800.9. Samples: 374368124. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:53,785][121949] Avg episode reward: [(0, '6100.471'), (1, '5485.947')] [2023-12-26 05:26:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000733488_187777024.pth... [2023-12-26 05:26:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000732464_187514880.pth [2023-12-26 05:26:53,829][123090] Updated weights for policy 1, policy_version 728970 (0.0005) [2023-12-26 05:26:53,904][123090] Updated weights for policy 1, policy_version 728980 (0.0005) [2023-12-26 05:26:53,965][123090] Updated weights for policy 1, policy_version 728990 (0.0006) [2023-12-26 05:26:53,974][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000728992_186621952.pth... [2023-12-26 05:26:53,978][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000727936_186351616.pth [2023-12-26 05:26:54,213][123091] Updated weights for policy 0, policy_version 733496 (0.0009) [2023-12-26 05:26:54,267][123091] Updated weights for policy 0, policy_version 733506 (0.0010) [2023-12-26 05:26:54,319][123091] Updated weights for policy 0, policy_version 733516 (0.0007) [2023-12-26 05:26:54,604][123090] Updated weights for policy 1, policy_version 729000 (0.0009) [2023-12-26 05:26:54,676][123090] Updated weights for policy 1, policy_version 729010 (0.0010) [2023-12-26 05:26:54,743][123090] Updated weights for policy 1, policy_version 729020 (0.0011) [2023-12-26 05:26:55,004][123091] Updated weights for policy 0, policy_version 733526 (0.0008) [2023-12-26 05:26:55,067][123091] Updated weights for policy 0, policy_version 733536 (0.0010) [2023-12-26 05:26:55,133][123091] Updated weights for policy 0, policy_version 733546 (0.0010) [2023-12-26 05:26:55,568][123090] Updated weights for policy 1, policy_version 729030 (0.0009) [2023-12-26 05:26:55,633][123090] Updated weights for policy 1, policy_version 729040 (0.0005) [2023-12-26 05:26:55,717][123090] Updated weights for policy 1, policy_version 729050 (0.0005) [2023-12-26 05:26:55,878][123091] Updated weights for policy 0, policy_version 733556 (0.0008) [2023-12-26 05:26:55,935][123091] Updated weights for policy 0, policy_version 733566 (0.0005) [2023-12-26 05:26:55,997][123091] Updated weights for policy 0, policy_version 733576 (0.0005) [2023-12-26 05:26:56,483][123090] Updated weights for policy 1, policy_version 729060 (0.0007) [2023-12-26 05:26:56,550][123090] Updated weights for policy 1, policy_version 729070 (0.0011) [2023-12-26 05:26:56,600][123091] Updated weights for policy 0, policy_version 733586 (0.0006) [2023-12-26 05:26:56,614][123090] Updated weights for policy 1, policy_version 729080 (0.0011) [2023-12-26 05:26:56,671][123091] Updated weights for policy 0, policy_version 733596 (0.0006) [2023-12-26 05:26:56,737][123091] Updated weights for policy 0, policy_version 733606 (0.0006) [2023-12-26 05:26:56,792][123091] Updated weights for policy 0, policy_version 733616 (0.0007) [2023-12-26 05:26:57,350][123090] Updated weights for policy 1, policy_version 729090 (0.0010) [2023-12-26 05:26:57,409][123090] Updated weights for policy 1, policy_version 729100 (0.0008) [2023-12-26 05:26:57,432][123091] Updated weights for policy 0, policy_version 733626 (0.0006) [2023-12-26 05:26:57,456][123090] Updated weights for policy 1, policy_version 729110 (0.0010) [2023-12-26 05:26:57,486][123091] Updated weights for policy 0, policy_version 733636 (0.0010) [2023-12-26 05:26:57,507][123090] Updated weights for policy 1, policy_version 729120 (0.0010) [2023-12-26 05:26:57,544][123091] Updated weights for policy 0, policy_version 733646 (0.0010) [2023-12-26 05:26:58,344][123091] Updated weights for policy 0, policy_version 733656 (0.0010) [2023-12-26 05:26:58,389][123090] Updated weights for policy 1, policy_version 729130 (0.0011) [2023-12-26 05:26:58,411][123091] Updated weights for policy 0, policy_version 733666 (0.0009) [2023-12-26 05:26:58,456][123090] Updated weights for policy 1, policy_version 729140 (0.0010) [2023-12-26 05:26:58,479][123091] Updated weights for policy 0, policy_version 733676 (0.0010) [2023-12-26 05:26:58,528][123090] Updated weights for policy 1, policy_version 729150 (0.0010) [2023-12-26 05:26:58,787][121949] Fps is (10 sec: 18836.9, 60 sec: 17748.6, 300 sec: 17689.0). Total num frames: 374489088. Throughput: 0: 8900.7, 1: 8859.4. Samples: 374480032. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:26:58,787][121949] Avg episode reward: [(0, '6104.601'), (1, '5516.138')] [2023-12-26 05:26:59,336][123091] Updated weights for policy 0, policy_version 733686 (0.0008) [2023-12-26 05:26:59,422][123091] Updated weights for policy 0, policy_version 733696 (0.0008) [2023-12-26 05:26:59,482][123090] Updated weights for policy 1, policy_version 729160 (0.0010) [2023-12-26 05:26:59,486][123091] Updated weights for policy 0, policy_version 733706 (0.0008) [2023-12-26 05:26:59,553][123090] Updated weights for policy 1, policy_version 729170 (0.0009) [2023-12-26 05:26:59,624][123090] Updated weights for policy 1, policy_version 729180 (0.0010) [2023-12-26 05:27:00,246][123091] Updated weights for policy 0, policy_version 733716 (0.0009) [2023-12-26 05:27:00,290][123091] Updated weights for policy 0, policy_version 733726 (0.0010) [2023-12-26 05:27:00,347][123091] Updated weights for policy 0, policy_version 733736 (0.0010) [2023-12-26 05:27:00,367][123090] Updated weights for policy 1, policy_version 729190 (0.0006) [2023-12-26 05:27:00,429][123090] Updated weights for policy 1, policy_version 729200 (0.0008) [2023-12-26 05:27:00,489][123090] Updated weights for policy 1, policy_version 729210 (0.0009) [2023-12-26 05:27:01,197][123091] Updated weights for policy 0, policy_version 733746 (0.0010) [2023-12-26 05:27:01,260][123091] Updated weights for policy 0, policy_version 733756 (0.0008) [2023-12-26 05:27:01,294][123090] Updated weights for policy 1, policy_version 729220 (0.0008) [2023-12-26 05:27:01,320][123091] Updated weights for policy 0, policy_version 733766 (0.0008) [2023-12-26 05:27:01,352][123090] Updated weights for policy 1, policy_version 729230 (0.0006) [2023-12-26 05:27:01,399][123091] Updated weights for policy 0, policy_version 733776 (0.0008) [2023-12-26 05:27:01,425][123090] Updated weights for policy 1, policy_version 729240 (0.0009) [2023-12-26 05:27:02,101][123091] Updated weights for policy 0, policy_version 733786 (0.0009) [2023-12-26 05:27:02,157][123091] Updated weights for policy 0, policy_version 733796 (0.0009) [2023-12-26 05:27:02,213][123091] Updated weights for policy 0, policy_version 733806 (0.0007) [2023-12-26 05:27:02,310][123090] Updated weights for policy 1, policy_version 729250 (0.0010) [2023-12-26 05:27:02,385][123090] Updated weights for policy 1, policy_version 729260 (0.0009) [2023-12-26 05:27:02,457][123090] Updated weights for policy 1, policy_version 729270 (0.0006) [2023-12-26 05:27:02,528][123090] Updated weights for policy 1, policy_version 729280 (0.0005) [2023-12-26 05:27:03,014][123091] Updated weights for policy 0, policy_version 733816 (0.0009) [2023-12-26 05:27:03,066][123091] Updated weights for policy 0, policy_version 733828 (0.0010) [2023-12-26 05:27:03,117][123091] Updated weights for policy 0, policy_version 733838 (0.0010) [2023-12-26 05:27:03,249][123090] Updated weights for policy 1, policy_version 729290 (0.0005) [2023-12-26 05:27:03,294][123090] Updated weights for policy 1, policy_version 729300 (0.0005) [2023-12-26 05:27:03,346][123090] Updated weights for policy 1, policy_version 729310 (0.0005) [2023-12-26 05:27:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 374571008. Throughput: 0: 8815.0, 1: 8758.6. Samples: 374584868. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:03,785][121949] Avg episode reward: [(0, '6075.161'), (1, '5602.917')] [2023-12-26 05:27:03,931][123091] Updated weights for policy 0, policy_version 733848 (0.0009) [2023-12-26 05:27:03,993][123091] Updated weights for policy 0, policy_version 733858 (0.0009) [2023-12-26 05:27:04,058][123091] Updated weights for policy 0, policy_version 733868 (0.0009) [2023-12-26 05:27:04,151][123090] Updated weights for policy 1, policy_version 729320 (0.0008) [2023-12-26 05:27:04,208][123090] Updated weights for policy 1, policy_version 729330 (0.0010) [2023-12-26 05:27:04,270][123090] Updated weights for policy 1, policy_version 729340 (0.0007) [2023-12-26 05:27:04,900][123091] Updated weights for policy 0, policy_version 733878 (0.0009) [2023-12-26 05:27:04,925][123090] Updated weights for policy 1, policy_version 729350 (0.0008) [2023-12-26 05:27:04,962][123091] Updated weights for policy 0, policy_version 733888 (0.0009) [2023-12-26 05:27:04,990][123090] Updated weights for policy 1, policy_version 729360 (0.0008) [2023-12-26 05:27:05,019][123091] Updated weights for policy 0, policy_version 733898 (0.0007) [2023-12-26 05:27:05,050][123090] Updated weights for policy 1, policy_version 729370 (0.0008) [2023-12-26 05:27:05,773][123091] Updated weights for policy 0, policy_version 733908 (0.0007) [2023-12-26 05:27:05,831][123090] Updated weights for policy 1, policy_version 729380 (0.0009) [2023-12-26 05:27:05,837][123091] Updated weights for policy 0, policy_version 733918 (0.0008) [2023-12-26 05:27:05,886][123091] Updated weights for policy 0, policy_version 733928 (0.0009) [2023-12-26 05:27:05,886][123090] Updated weights for policy 1, policy_version 729390 (0.0008) [2023-12-26 05:27:05,937][123090] Updated weights for policy 1, policy_version 729400 (0.0008) [2023-12-26 05:27:06,627][123091] Updated weights for policy 0, policy_version 733938 (0.0007) [2023-12-26 05:27:06,686][123091] Updated weights for policy 0, policy_version 733948 (0.0006) [2023-12-26 05:27:06,692][123090] Updated weights for policy 1, policy_version 729410 (0.0006) [2023-12-26 05:27:06,748][123091] Updated weights for policy 0, policy_version 733958 (0.0007) [2023-12-26 05:27:06,761][123090] Updated weights for policy 1, policy_version 729420 (0.0006) [2023-12-26 05:27:06,810][123091] Updated weights for policy 0, policy_version 733968 (0.0006) [2023-12-26 05:27:06,821][123090] Updated weights for policy 1, policy_version 729430 (0.0005) [2023-12-26 05:27:06,881][123090] Updated weights for policy 1, policy_version 729440 (0.0006) [2023-12-26 05:27:07,583][123090] Updated weights for policy 1, policy_version 729450 (0.0006) [2023-12-26 05:27:07,645][123090] Updated weights for policy 1, policy_version 729460 (0.0006) [2023-12-26 05:27:07,651][123091] Updated weights for policy 0, policy_version 733978 (0.0009) [2023-12-26 05:27:07,711][123090] Updated weights for policy 1, policy_version 729470 (0.0006) [2023-12-26 05:27:07,718][123091] Updated weights for policy 0, policy_version 733988 (0.0008) [2023-12-26 05:27:07,797][123091] Updated weights for policy 0, policy_version 733998 (0.0009) [2023-12-26 05:27:08,455][123090] Updated weights for policy 1, policy_version 729480 (0.0007) [2023-12-26 05:27:08,519][123090] Updated weights for policy 1, policy_version 729490 (0.0010) [2023-12-26 05:27:08,582][123090] Updated weights for policy 1, policy_version 729500 (0.0009) [2023-12-26 05:27:08,587][123091] Updated weights for policy 0, policy_version 734008 (0.0007) [2023-12-26 05:27:08,651][123091] Updated weights for policy 0, policy_version 734018 (0.0005) [2023-12-26 05:27:08,714][123091] Updated weights for policy 0, policy_version 734028 (0.0005) [2023-12-26 05:27:08,784][121949] Fps is (10 sec: 18026.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 374669312. Throughput: 0: 8855.6, 1: 8799.1. Samples: 374639688. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:08,785][121949] Avg episode reward: [(0, '6178.686'), (1, '5381.811')] [2023-12-26 05:27:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000734032_187916288.pth... [2023-12-26 05:27:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000729504_186753024.pth... [2023-12-26 05:27:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000732976_187645952.pth [2023-12-26 05:27:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000728480_186490880.pth [2023-12-26 05:27:09,349][123090] Updated weights for policy 1, policy_version 729510 (0.0009) [2023-12-26 05:27:09,423][123090] Updated weights for policy 1, policy_version 729520 (0.0010) [2023-12-26 05:27:09,491][123090] Updated weights for policy 1, policy_version 729530 (0.0011) [2023-12-26 05:27:09,522][123091] Updated weights for policy 0, policy_version 734038 (0.0009) [2023-12-26 05:27:09,574][123091] Updated weights for policy 0, policy_version 734048 (0.0011) [2023-12-26 05:27:09,627][123091] Updated weights for policy 0, policy_version 734058 (0.0011) [2023-12-26 05:27:10,335][123090] Updated weights for policy 1, policy_version 729540 (0.0011) [2023-12-26 05:27:10,403][123091] Updated weights for policy 0, policy_version 734068 (0.0009) [2023-12-26 05:27:10,407][123090] Updated weights for policy 1, policy_version 729550 (0.0011) [2023-12-26 05:27:10,473][123091] Updated weights for policy 0, policy_version 734078 (0.0006) [2023-12-26 05:27:10,479][123090] Updated weights for policy 1, policy_version 729560 (0.0011) [2023-12-26 05:27:10,536][123091] Updated weights for policy 0, policy_version 734088 (0.0005) [2023-12-26 05:27:11,251][123090] Updated weights for policy 1, policy_version 729570 (0.0010) [2023-12-26 05:27:11,322][123090] Updated weights for policy 1, policy_version 729580 (0.0009) [2023-12-26 05:27:11,330][123091] Updated weights for policy 0, policy_version 734098 (0.0010) [2023-12-26 05:27:11,398][123090] Updated weights for policy 1, policy_version 729590 (0.0011) [2023-12-26 05:27:11,406][123091] Updated weights for policy 0, policy_version 734108 (0.0008) [2023-12-26 05:27:11,457][123090] Updated weights for policy 1, policy_version 729600 (0.0011) [2023-12-26 05:27:11,462][123091] Updated weights for policy 0, policy_version 734118 (0.0006) [2023-12-26 05:27:11,529][123091] Updated weights for policy 0, policy_version 734128 (0.0009) [2023-12-26 05:27:12,260][123090] Updated weights for policy 1, policy_version 729610 (0.0007) [2023-12-26 05:27:12,328][123090] Updated weights for policy 1, policy_version 729620 (0.0007) [2023-12-26 05:27:12,399][123090] Updated weights for policy 1, policy_version 729630 (0.0007) [2023-12-26 05:27:12,407][123091] Updated weights for policy 0, policy_version 734138 (0.0013) [2023-12-26 05:27:12,459][123091] Updated weights for policy 0, policy_version 734148 (0.0008) [2023-12-26 05:27:12,521][123091] Updated weights for policy 0, policy_version 734158 (0.0006) [2023-12-26 05:27:13,208][123091] Updated weights for policy 0, policy_version 734168 (0.0005) [2023-12-26 05:27:13,218][123090] Updated weights for policy 1, policy_version 729640 (0.0006) [2023-12-26 05:27:13,265][123091] Updated weights for policy 0, policy_version 734178 (0.0005) [2023-12-26 05:27:13,268][123090] Updated weights for policy 1, policy_version 729650 (0.0006) [2023-12-26 05:27:13,334][123091] Updated weights for policy 0, policy_version 734188 (0.0008) [2023-12-26 05:27:13,337][123090] Updated weights for policy 1, policy_version 729660 (0.0007) [2023-12-26 05:27:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 374751232. Throughput: 0: 8837.2, 1: 8809.3. Samples: 374744928. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:13,785][121949] Avg episode reward: [(0, '6089.390'), (1, '5544.302')] [2023-12-26 05:27:14,084][123091] Updated weights for policy 0, policy_version 734198 (0.0008) [2023-12-26 05:27:14,121][123090] Updated weights for policy 1, policy_version 729670 (0.0007) [2023-12-26 05:27:14,136][123091] Updated weights for policy 0, policy_version 734208 (0.0005) [2023-12-26 05:27:14,176][123090] Updated weights for policy 1, policy_version 729680 (0.0009) [2023-12-26 05:27:14,197][123091] Updated weights for policy 0, policy_version 734218 (0.0005) [2023-12-26 05:27:14,228][123090] Updated weights for policy 1, policy_version 729690 (0.0009) [2023-12-26 05:27:14,828][123091] Updated weights for policy 0, policy_version 734228 (0.0005) [2023-12-26 05:27:14,888][123091] Updated weights for policy 0, policy_version 734238 (0.0005) [2023-12-26 05:27:14,943][123091] Updated weights for policy 0, policy_version 734248 (0.0005) [2023-12-26 05:27:15,159][123090] Updated weights for policy 1, policy_version 729700 (0.0009) [2023-12-26 05:27:15,224][123090] Updated weights for policy 1, policy_version 729710 (0.0009) [2023-12-26 05:27:15,291][123090] Updated weights for policy 1, policy_version 729720 (0.0006) [2023-12-26 05:27:15,760][123091] Updated weights for policy 0, policy_version 734258 (0.0010) [2023-12-26 05:27:15,819][123091] Updated weights for policy 0, policy_version 734268 (0.0011) [2023-12-26 05:27:15,889][123091] Updated weights for policy 0, policy_version 734278 (0.0011) [2023-12-26 05:27:15,955][123091] Updated weights for policy 0, policy_version 734288 (0.0011) [2023-12-26 05:27:16,110][123090] Updated weights for policy 1, policy_version 729730 (0.0006) [2023-12-26 05:27:16,163][123090] Updated weights for policy 1, policy_version 729740 (0.0010) [2023-12-26 05:27:16,218][123090] Updated weights for policy 1, policy_version 729751 (0.0010) [2023-12-26 05:27:16,658][123091] Updated weights for policy 0, policy_version 734298 (0.0005) [2023-12-26 05:27:16,713][123091] Updated weights for policy 0, policy_version 734308 (0.0005) [2023-12-26 05:27:16,779][123091] Updated weights for policy 0, policy_version 734318 (0.0010) [2023-12-26 05:27:17,155][123090] Updated weights for policy 1, policy_version 729761 (0.0010) [2023-12-26 05:27:17,209][123090] Updated weights for policy 1, policy_version 729771 (0.0010) [2023-12-26 05:27:17,266][123090] Updated weights for policy 1, policy_version 729781 (0.0009) [2023-12-26 05:27:17,332][123090] Updated weights for policy 1, policy_version 729791 (0.0010) [2023-12-26 05:27:17,378][123091] Updated weights for policy 0, policy_version 734328 (0.0006) [2023-12-26 05:27:17,438][123091] Updated weights for policy 0, policy_version 734338 (0.0006) [2023-12-26 05:27:17,497][123091] Updated weights for policy 0, policy_version 734348 (0.0006) [2023-12-26 05:27:18,062][123091] Updated weights for policy 0, policy_version 734358 (0.0005) [2023-12-26 05:27:18,109][123091] Updated weights for policy 0, policy_version 734368 (0.0005) [2023-12-26 05:27:18,155][123091] Updated weights for policy 0, policy_version 734378 (0.0005) [2023-12-26 05:27:18,279][123090] Updated weights for policy 1, policy_version 729801 (0.0009) [2023-12-26 05:27:18,344][123090] Updated weights for policy 1, policy_version 729811 (0.0008) [2023-12-26 05:27:18,408][123090] Updated weights for policy 1, policy_version 729821 (0.0010) [2023-12-26 05:27:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 374841344. Throughput: 0: 9032.2, 1: 8729.1. Samples: 374852824. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:18,785][121949] Avg episode reward: [(0, '6058.842'), (1, '5639.717')] [2023-12-26 05:27:18,942][123091] Updated weights for policy 0, policy_version 734388 (0.0005) [2023-12-26 05:27:19,003][123091] Updated weights for policy 0, policy_version 734398 (0.0005) [2023-12-26 05:27:19,049][123091] Updated weights for policy 0, policy_version 734408 (0.0005) [2023-12-26 05:27:19,312][123090] Updated weights for policy 1, policy_version 729831 (0.0010) [2023-12-26 05:27:19,388][123090] Updated weights for policy 1, policy_version 729841 (0.0008) [2023-12-26 05:27:19,463][123090] Updated weights for policy 1, policy_version 729851 (0.0005) [2023-12-26 05:27:19,838][123091] Updated weights for policy 0, policy_version 734418 (0.0006) [2023-12-26 05:27:19,904][123091] Updated weights for policy 0, policy_version 734428 (0.0006) [2023-12-26 05:27:19,973][123091] Updated weights for policy 0, policy_version 734438 (0.0009) [2023-12-26 05:27:20,034][123091] Updated weights for policy 0, policy_version 734448 (0.0009) [2023-12-26 05:27:20,147][123090] Updated weights for policy 1, policy_version 729861 (0.0008) [2023-12-26 05:27:20,209][123090] Updated weights for policy 1, policy_version 729871 (0.0009) [2023-12-26 05:27:20,269][123090] Updated weights for policy 1, policy_version 729881 (0.0009) [2023-12-26 05:27:20,851][123091] Updated weights for policy 0, policy_version 734458 (0.0009) [2023-12-26 05:27:20,913][123091] Updated weights for policy 0, policy_version 734468 (0.0009) [2023-12-26 05:27:20,982][123091] Updated weights for policy 0, policy_version 734478 (0.0009) [2023-12-26 05:27:21,113][123090] Updated weights for policy 1, policy_version 729891 (0.0009) [2023-12-26 05:27:21,186][123090] Updated weights for policy 1, policy_version 729901 (0.0008) [2023-12-26 05:27:21,255][123090] Updated weights for policy 1, policy_version 729911 (0.0007) [2023-12-26 05:27:21,931][123091] Updated weights for policy 0, policy_version 734488 (0.0009) [2023-12-26 05:27:21,971][123090] Updated weights for policy 1, policy_version 729921 (0.0010) [2023-12-26 05:27:21,997][123091] Updated weights for policy 0, policy_version 734498 (0.0009) [2023-12-26 05:27:22,031][123090] Updated weights for policy 1, policy_version 729931 (0.0010) [2023-12-26 05:27:22,064][123091] Updated weights for policy 0, policy_version 734508 (0.0008) [2023-12-26 05:27:22,107][123090] Updated weights for policy 1, policy_version 729941 (0.0007) [2023-12-26 05:27:22,174][123090] Updated weights for policy 1, policy_version 729951 (0.0011) [2023-12-26 05:27:22,913][123090] Updated weights for policy 1, policy_version 729961 (0.0010) [2023-12-26 05:27:22,930][123091] Updated weights for policy 0, policy_version 734518 (0.0007) [2023-12-26 05:27:22,963][123090] Updated weights for policy 1, policy_version 729971 (0.0009) [2023-12-26 05:27:22,983][123091] Updated weights for policy 0, policy_version 734528 (0.0005) [2023-12-26 05:27:23,039][123090] Updated weights for policy 1, policy_version 729981 (0.0008) [2023-12-26 05:27:23,042][123091] Updated weights for policy 0, policy_version 734538 (0.0006) [2023-12-26 05:27:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 374923264. Throughput: 0: 9047.6, 1: 8674.1. Samples: 374904984. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:23,784][121949] Avg episode reward: [(0, '6063.911'), (1, '5544.897')] [2023-12-26 05:27:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000729984_186875904.pth... [2023-12-26 05:27:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000734544_188047360.pth... [2023-12-26 05:27:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000728992_186621952.pth [2023-12-26 05:27:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000733488_187777024.pth [2023-12-26 05:27:23,838][123091] Updated weights for policy 0, policy_version 734548 (0.0008) [2023-12-26 05:27:23,900][123091] Updated weights for policy 0, policy_version 734558 (0.0005) [2023-12-26 05:27:23,908][123090] Updated weights for policy 1, policy_version 729991 (0.0009) [2023-12-26 05:27:23,957][123090] Updated weights for policy 1, policy_version 730001 (0.0009) [2023-12-26 05:27:23,967][123091] Updated weights for policy 0, policy_version 734568 (0.0006) [2023-12-26 05:27:24,015][123090] Updated weights for policy 1, policy_version 730011 (0.0009) [2023-12-26 05:27:24,729][123091] Updated weights for policy 0, policy_version 734578 (0.0006) [2023-12-26 05:27:24,787][123091] Updated weights for policy 0, policy_version 734588 (0.0009) [2023-12-26 05:27:24,847][123091] Updated weights for policy 0, policy_version 734598 (0.0009) [2023-12-26 05:27:24,863][123090] Updated weights for policy 1, policy_version 730021 (0.0008) [2023-12-26 05:27:24,913][123091] Updated weights for policy 0, policy_version 734608 (0.0009) [2023-12-26 05:27:24,916][123090] Updated weights for policy 1, policy_version 730031 (0.0007) [2023-12-26 05:27:24,964][123090] Updated weights for policy 1, policy_version 730041 (0.0009) [2023-12-26 05:27:25,755][123091] Updated weights for policy 0, policy_version 734618 (0.0011) [2023-12-26 05:27:25,788][123090] Updated weights for policy 1, policy_version 730052 (0.0008) [2023-12-26 05:27:25,811][123091] Updated weights for policy 0, policy_version 734628 (0.0011) [2023-12-26 05:27:25,843][123090] Updated weights for policy 1, policy_version 730062 (0.0007) [2023-12-26 05:27:25,877][123091] Updated weights for policy 0, policy_version 734638 (0.0010) [2023-12-26 05:27:25,897][123090] Updated weights for policy 1, policy_version 730072 (0.0008) [2023-12-26 05:27:26,604][123091] Updated weights for policy 0, policy_version 734648 (0.0006) [2023-12-26 05:27:26,658][123091] Updated weights for policy 0, policy_version 734658 (0.0005) [2023-12-26 05:27:26,712][123091] Updated weights for policy 0, policy_version 734668 (0.0005) [2023-12-26 05:27:26,752][123090] Updated weights for policy 1, policy_version 730082 (0.0009) [2023-12-26 05:27:26,807][123090] Updated weights for policy 1, policy_version 730092 (0.0010) [2023-12-26 05:27:26,855][123090] Updated weights for policy 1, policy_version 730102 (0.0010) [2023-12-26 05:27:26,910][123090] Updated weights for policy 1, policy_version 730112 (0.0010) [2023-12-26 05:27:27,353][123091] Updated weights for policy 0, policy_version 734678 (0.0009) [2023-12-26 05:27:27,413][123091] Updated weights for policy 0, policy_version 734688 (0.0011) [2023-12-26 05:27:27,484][123091] Updated weights for policy 0, policy_version 734698 (0.0011) [2023-12-26 05:27:27,695][123090] Updated weights for policy 1, policy_version 730122 (0.0005) [2023-12-26 05:27:27,747][123090] Updated weights for policy 1, policy_version 730132 (0.0005) [2023-12-26 05:27:27,802][123090] Updated weights for policy 1, policy_version 730142 (0.0005) [2023-12-26 05:27:28,241][123091] Updated weights for policy 0, policy_version 734708 (0.0008) [2023-12-26 05:27:28,293][123091] Updated weights for policy 0, policy_version 734718 (0.0005) [2023-12-26 05:27:28,349][123091] Updated weights for policy 0, policy_version 734728 (0.0009) [2023-12-26 05:27:28,496][123090] Updated weights for policy 1, policy_version 730152 (0.0010) [2023-12-26 05:27:28,566][123090] Updated weights for policy 1, policy_version 730162 (0.0011) [2023-12-26 05:27:28,635][123090] Updated weights for policy 1, policy_version 730172 (0.0010) [2023-12-26 05:27:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 375021568. Throughput: 0: 9083.5, 1: 8681.6. Samples: 375010544. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:28,784][121949] Avg episode reward: [(0, '6145.445'), (1, '5509.665')] [2023-12-26 05:27:29,172][123091] Updated weights for policy 0, policy_version 734738 (0.0010) [2023-12-26 05:27:29,226][123091] Updated weights for policy 0, policy_version 734748 (0.0010) [2023-12-26 05:27:29,285][123091] Updated weights for policy 0, policy_version 734758 (0.0011) [2023-12-26 05:27:29,352][123091] Updated weights for policy 0, policy_version 734768 (0.0011) [2023-12-26 05:27:29,438][123090] Updated weights for policy 1, policy_version 730182 (0.0010) [2023-12-26 05:27:29,504][123090] Updated weights for policy 1, policy_version 730192 (0.0010) [2023-12-26 05:27:29,567][123090] Updated weights for policy 1, policy_version 730202 (0.0010) [2023-12-26 05:27:30,199][123091] Updated weights for policy 0, policy_version 734778 (0.0011) [2023-12-26 05:27:30,251][123091] Updated weights for policy 0, policy_version 734788 (0.0011) [2023-12-26 05:27:30,311][123091] Updated weights for policy 0, policy_version 734798 (0.0011) [2023-12-26 05:27:30,398][123090] Updated weights for policy 1, policy_version 730212 (0.0010) [2023-12-26 05:27:30,450][123090] Updated weights for policy 1, policy_version 730222 (0.0010) [2023-12-26 05:27:30,505][123090] Updated weights for policy 1, policy_version 730232 (0.0010) [2023-12-26 05:27:31,069][123091] Updated weights for policy 0, policy_version 734808 (0.0009) [2023-12-26 05:27:31,127][123091] Updated weights for policy 0, policy_version 734818 (0.0008) [2023-12-26 05:27:31,192][123091] Updated weights for policy 0, policy_version 734828 (0.0008) [2023-12-26 05:27:31,352][123090] Updated weights for policy 1, policy_version 730242 (0.0010) [2023-12-26 05:27:31,422][123090] Updated weights for policy 1, policy_version 730252 (0.0009) [2023-12-26 05:27:31,470][123090] Updated weights for policy 1, policy_version 730262 (0.0010) [2023-12-26 05:27:31,525][123090] Updated weights for policy 1, policy_version 730272 (0.0010) [2023-12-26 05:27:31,961][123091] Updated weights for policy 0, policy_version 734838 (0.0009) [2023-12-26 05:27:32,018][123091] Updated weights for policy 0, policy_version 734848 (0.0009) [2023-12-26 05:27:32,079][123091] Updated weights for policy 0, policy_version 734858 (0.0010) [2023-12-26 05:27:32,335][123090] Updated weights for policy 1, policy_version 730282 (0.0009) [2023-12-26 05:27:32,404][123090] Updated weights for policy 1, policy_version 730292 (0.0009) [2023-12-26 05:27:32,467][123090] Updated weights for policy 1, policy_version 730302 (0.0010) [2023-12-26 05:27:32,930][123091] Updated weights for policy 0, policy_version 734868 (0.0009) [2023-12-26 05:27:32,984][123091] Updated weights for policy 0, policy_version 734878 (0.0010) [2023-12-26 05:27:33,035][123091] Updated weights for policy 0, policy_version 734888 (0.0009) [2023-12-26 05:27:33,305][123090] Updated weights for policy 1, policy_version 730312 (0.0009) [2023-12-26 05:27:33,353][123090] Updated weights for policy 1, policy_version 730322 (0.0005) [2023-12-26 05:27:33,408][123090] Updated weights for policy 1, policy_version 730332 (0.0005) [2023-12-26 05:27:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 375103488. Throughput: 0: 9075.6, 1: 8702.3. Samples: 375116956. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:33,785][121949] Avg episode reward: [(0, '6144.860'), (1, '5458.987')] [2023-12-26 05:27:33,886][123091] Updated weights for policy 0, policy_version 734898 (0.0009) [2023-12-26 05:27:33,948][123091] Updated weights for policy 0, policy_version 734908 (0.0010) [2023-12-26 05:27:34,014][123091] Updated weights for policy 0, policy_version 734918 (0.0010) [2023-12-26 05:27:34,071][123091] Updated weights for policy 0, policy_version 734928 (0.0010) [2023-12-26 05:27:34,144][123090] Updated weights for policy 1, policy_version 730342 (0.0008) [2023-12-26 05:27:34,212][123090] Updated weights for policy 1, policy_version 730352 (0.0009) [2023-12-26 05:27:34,278][123090] Updated weights for policy 1, policy_version 730362 (0.0010) [2023-12-26 05:27:34,896][123091] Updated weights for policy 0, policy_version 734938 (0.0005) [2023-12-26 05:27:34,953][123091] Updated weights for policy 0, policy_version 734948 (0.0005) [2023-12-26 05:27:35,017][123091] Updated weights for policy 0, policy_version 734958 (0.0005) [2023-12-26 05:27:35,114][123090] Updated weights for policy 1, policy_version 730372 (0.0009) [2023-12-26 05:27:35,162][123090] Updated weights for policy 1, policy_version 730382 (0.0009) [2023-12-26 05:27:35,216][123090] Updated weights for policy 1, policy_version 730393 (0.0010) [2023-12-26 05:27:35,736][123091] Updated weights for policy 0, policy_version 734968 (0.0005) [2023-12-26 05:27:35,782][123091] Updated weights for policy 0, policy_version 734978 (0.0005) [2023-12-26 05:27:35,852][123091] Updated weights for policy 0, policy_version 734988 (0.0008) [2023-12-26 05:27:35,916][123090] Updated weights for policy 1, policy_version 730404 (0.0010) [2023-12-26 05:27:35,975][123090] Updated weights for policy 1, policy_version 730414 (0.0010) [2023-12-26 05:27:36,036][123090] Updated weights for policy 1, policy_version 730424 (0.0010) [2023-12-26 05:27:36,625][123091] Updated weights for policy 0, policy_version 734998 (0.0009) [2023-12-26 05:27:36,690][123091] Updated weights for policy 0, policy_version 735008 (0.0009) [2023-12-26 05:27:36,751][123091] Updated weights for policy 0, policy_version 735018 (0.0009) [2023-12-26 05:27:36,928][123090] Updated weights for policy 1, policy_version 730434 (0.0010) [2023-12-26 05:27:36,976][123090] Updated weights for policy 1, policy_version 730444 (0.0010) [2023-12-26 05:27:37,032][123090] Updated weights for policy 1, policy_version 730454 (0.0010) [2023-12-26 05:27:37,084][123090] Updated weights for policy 1, policy_version 730464 (0.0010) [2023-12-26 05:27:37,582][123091] Updated weights for policy 0, policy_version 735028 (0.0010) [2023-12-26 05:27:37,653][123091] Updated weights for policy 0, policy_version 735038 (0.0011) [2023-12-26 05:27:37,717][123091] Updated weights for policy 0, policy_version 735048 (0.0010) [2023-12-26 05:27:37,899][123090] Updated weights for policy 1, policy_version 730474 (0.0010) [2023-12-26 05:27:37,951][123090] Updated weights for policy 1, policy_version 730484 (0.0007) [2023-12-26 05:27:38,012][123090] Updated weights for policy 1, policy_version 730494 (0.0011) [2023-12-26 05:27:38,446][123091] Updated weights for policy 0, policy_version 735058 (0.0008) [2023-12-26 05:27:38,514][123091] Updated weights for policy 0, policy_version 735068 (0.0005) [2023-12-26 05:27:38,582][123091] Updated weights for policy 0, policy_version 735078 (0.0007) [2023-12-26 05:27:38,645][123091] Updated weights for policy 0, policy_version 735088 (0.0005) [2023-12-26 05:27:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 375193600. Throughput: 0: 9112.7, 1: 8719.8. Samples: 375170588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:38,785][121949] Avg episode reward: [(0, '6189.070'), (1, '5201.838')] [2023-12-26 05:27:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000735088_188186624.pth... [2023-12-26 05:27:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000730496_187006976.pth... [2023-12-26 05:27:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000729504_186753024.pth [2023-12-26 05:27:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000734032_187916288.pth [2023-12-26 05:27:38,894][123090] Updated weights for policy 1, policy_version 730504 (0.0010) [2023-12-26 05:27:38,951][123090] Updated weights for policy 1, policy_version 730514 (0.0011) [2023-12-26 05:27:39,017][123090] Updated weights for policy 1, policy_version 730524 (0.0010) [2023-12-26 05:27:39,313][123091] Updated weights for policy 0, policy_version 735098 (0.0009) [2023-12-26 05:27:39,390][123091] Updated weights for policy 0, policy_version 735108 (0.0010) [2023-12-26 05:27:39,454][123091] Updated weights for policy 0, policy_version 735118 (0.0010) [2023-12-26 05:27:39,834][123090] Updated weights for policy 1, policy_version 730534 (0.0008) [2023-12-26 05:27:39,906][123090] Updated weights for policy 1, policy_version 730544 (0.0008) [2023-12-26 05:27:39,975][123090] Updated weights for policy 1, policy_version 730554 (0.0011) [2023-12-26 05:27:40,303][123091] Updated weights for policy 0, policy_version 735128 (0.0009) [2023-12-26 05:27:40,372][123091] Updated weights for policy 0, policy_version 735138 (0.0009) [2023-12-26 05:27:40,432][123091] Updated weights for policy 0, policy_version 735148 (0.0009) [2023-12-26 05:27:40,749][123090] Updated weights for policy 1, policy_version 730564 (0.0011) [2023-12-26 05:27:40,801][123090] Updated weights for policy 1, policy_version 730574 (0.0010) [2023-12-26 05:27:40,866][123090] Updated weights for policy 1, policy_version 730584 (0.0009) [2023-12-26 05:27:41,180][123091] Updated weights for policy 0, policy_version 735158 (0.0009) [2023-12-26 05:27:41,264][123091] Updated weights for policy 0, policy_version 735168 (0.0009) [2023-12-26 05:27:41,332][123091] Updated weights for policy 0, policy_version 735178 (0.0008) [2023-12-26 05:27:41,690][123090] Updated weights for policy 1, policy_version 730594 (0.0008) [2023-12-26 05:27:41,766][123090] Updated weights for policy 1, policy_version 730604 (0.0007) [2023-12-26 05:27:41,840][123090] Updated weights for policy 1, policy_version 730614 (0.0006) [2023-12-26 05:27:41,912][123090] Updated weights for policy 1, policy_version 730624 (0.0006) [2023-12-26 05:27:42,217][123091] Updated weights for policy 0, policy_version 735188 (0.0010) [2023-12-26 05:27:42,287][123091] Updated weights for policy 0, policy_version 735198 (0.0009) [2023-12-26 05:27:42,351][123091] Updated weights for policy 0, policy_version 735208 (0.0007) [2023-12-26 05:27:42,611][123090] Updated weights for policy 1, policy_version 730634 (0.0006) [2023-12-26 05:27:42,674][123090] Updated weights for policy 1, policy_version 730644 (0.0007) [2023-12-26 05:27:42,740][123090] Updated weights for policy 1, policy_version 730654 (0.0007) [2023-12-26 05:27:43,155][123091] Updated weights for policy 0, policy_version 735218 (0.0008) [2023-12-26 05:27:43,218][123091] Updated weights for policy 0, policy_version 735229 (0.0007) [2023-12-26 05:27:43,276][123091] Updated weights for policy 0, policy_version 735239 (0.0009) [2023-12-26 05:27:43,557][123090] Updated weights for policy 1, policy_version 730664 (0.0010) [2023-12-26 05:27:43,616][123090] Updated weights for policy 1, policy_version 730675 (0.0009) [2023-12-26 05:27:43,670][123090] Updated weights for policy 1, policy_version 730685 (0.0008) [2023-12-26 05:27:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 375283712. Throughput: 0: 8966.4, 1: 8696.7. Samples: 375274824. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:43,785][121949] Avg episode reward: [(0, '6099.013'), (1, '5244.734')] [2023-12-26 05:27:44,033][123091] Updated weights for policy 0, policy_version 735249 (0.0008) [2023-12-26 05:27:44,098][123091] Updated weights for policy 0, policy_version 735259 (0.0005) [2023-12-26 05:27:44,154][123091] Updated weights for policy 0, policy_version 735269 (0.0005) [2023-12-26 05:27:44,214][123091] Updated weights for policy 0, policy_version 735279 (0.0005) [2023-12-26 05:27:44,595][123090] Updated weights for policy 1, policy_version 730695 (0.0006) [2023-12-26 05:27:44,647][123090] Updated weights for policy 1, policy_version 730705 (0.0007) [2023-12-26 05:27:44,701][123090] Updated weights for policy 1, policy_version 730715 (0.0010) [2023-12-26 05:27:44,865][123091] Updated weights for policy 0, policy_version 735289 (0.0008) [2023-12-26 05:27:44,930][123091] Updated weights for policy 0, policy_version 735299 (0.0009) [2023-12-26 05:27:44,983][123091] Updated weights for policy 0, policy_version 735309 (0.0009) [2023-12-26 05:27:45,561][123090] Updated weights for policy 1, policy_version 730725 (0.0009) [2023-12-26 05:27:45,623][123090] Updated weights for policy 1, policy_version 730735 (0.0010) [2023-12-26 05:27:45,679][123090] Updated weights for policy 1, policy_version 730745 (0.0008) [2023-12-26 05:27:45,788][123091] Updated weights for policy 0, policy_version 735319 (0.0009) [2023-12-26 05:27:45,837][123091] Updated weights for policy 0, policy_version 735329 (0.0008) [2023-12-26 05:27:45,892][123091] Updated weights for policy 0, policy_version 735339 (0.0010) [2023-12-26 05:27:46,446][123090] Updated weights for policy 1, policy_version 730755 (0.0010) [2023-12-26 05:27:46,499][123090] Updated weights for policy 1, policy_version 730765 (0.0008) [2023-12-26 05:27:46,555][123090] Updated weights for policy 1, policy_version 730775 (0.0009) [2023-12-26 05:27:46,732][123091] Updated weights for policy 0, policy_version 735349 (0.0011) [2023-12-26 05:27:46,798][123091] Updated weights for policy 0, policy_version 735359 (0.0011) [2023-12-26 05:27:46,856][123091] Updated weights for policy 0, policy_version 735369 (0.0010) [2023-12-26 05:27:47,390][123090] Updated weights for policy 1, policy_version 730785 (0.0009) [2023-12-26 05:27:47,449][123090] Updated weights for policy 1, policy_version 730795 (0.0009) [2023-12-26 05:27:47,508][123090] Updated weights for policy 1, policy_version 730805 (0.0008) [2023-12-26 05:27:47,569][123091] Updated weights for policy 0, policy_version 735379 (0.0011) [2023-12-26 05:27:47,571][123090] Updated weights for policy 1, policy_version 730815 (0.0009) [2023-12-26 05:27:47,629][123091] Updated weights for policy 0, policy_version 735389 (0.0010) [2023-12-26 05:27:47,691][123091] Updated weights for policy 0, policy_version 735399 (0.0010) [2023-12-26 05:27:48,304][123091] Updated weights for policy 0, policy_version 735409 (0.0006) [2023-12-26 05:27:48,383][123091] Updated weights for policy 0, policy_version 735420 (0.0007) [2023-12-26 05:27:48,441][123091] Updated weights for policy 0, policy_version 735430 (0.0009) [2023-12-26 05:27:48,457][123090] Updated weights for policy 1, policy_version 730825 (0.0008) [2023-12-26 05:27:48,499][123091] Updated weights for policy 0, policy_version 735440 (0.0008) [2023-12-26 05:27:48,520][123090] Updated weights for policy 1, policy_version 730835 (0.0008) [2023-12-26 05:27:48,583][123090] Updated weights for policy 1, policy_version 730845 (0.0009) [2023-12-26 05:27:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 375373824. Throughput: 0: 9032.4, 1: 8673.6. Samples: 375381640. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:48,785][121949] Avg episode reward: [(0, '6081.233'), (1, '5364.091')] [2023-12-26 05:27:49,296][123091] Updated weights for policy 0, policy_version 735450 (0.0009) [2023-12-26 05:27:49,358][123091] Updated weights for policy 0, policy_version 735460 (0.0009) [2023-12-26 05:27:49,424][123090] Updated weights for policy 1, policy_version 730855 (0.0008) [2023-12-26 05:27:49,428][123091] Updated weights for policy 0, policy_version 735470 (0.0008) [2023-12-26 05:27:49,487][123090] Updated weights for policy 1, policy_version 730865 (0.0005) [2023-12-26 05:27:49,545][123090] Updated weights for policy 1, policy_version 730876 (0.0008) [2023-12-26 05:27:50,279][123091] Updated weights for policy 0, policy_version 735480 (0.0009) [2023-12-26 05:27:50,341][123091] Updated weights for policy 0, policy_version 735490 (0.0009) [2023-12-26 05:27:50,359][123090] Updated weights for policy 1, policy_version 730886 (0.0007) [2023-12-26 05:27:50,396][123091] Updated weights for policy 0, policy_version 735500 (0.0009) [2023-12-26 05:27:50,424][123090] Updated weights for policy 1, policy_version 730896 (0.0007) [2023-12-26 05:27:50,484][123090] Updated weights for policy 1, policy_version 730906 (0.0009) [2023-12-26 05:27:51,203][123091] Updated weights for policy 0, policy_version 735510 (0.0008) [2023-12-26 05:27:51,261][123091] Updated weights for policy 0, policy_version 735520 (0.0009) [2023-12-26 05:27:51,281][123090] Updated weights for policy 1, policy_version 730916 (0.0009) [2023-12-26 05:27:51,330][123091] Updated weights for policy 0, policy_version 735530 (0.0006) [2023-12-26 05:27:51,353][123090] Updated weights for policy 1, policy_version 730926 (0.0010) [2023-12-26 05:27:51,420][123090] Updated weights for policy 1, policy_version 730936 (0.0010) [2023-12-26 05:27:52,146][123091] Updated weights for policy 0, policy_version 735540 (0.0008) [2023-12-26 05:27:52,205][123091] Updated weights for policy 0, policy_version 735550 (0.0006) [2023-12-26 05:27:52,256][123091] Updated weights for policy 0, policy_version 735560 (0.0006) [2023-12-26 05:27:52,258][123090] Updated weights for policy 1, policy_version 730946 (0.0010) [2023-12-26 05:27:52,317][123090] Updated weights for policy 1, policy_version 730956 (0.0010) [2023-12-26 05:27:52,382][123090] Updated weights for policy 1, policy_version 730966 (0.0010) [2023-12-26 05:27:52,446][123090] Updated weights for policy 1, policy_version 730976 (0.0010) [2023-12-26 05:27:52,932][123091] Updated weights for policy 0, policy_version 735570 (0.0006) [2023-12-26 05:27:52,981][123091] Updated weights for policy 0, policy_version 735580 (0.0005) [2023-12-26 05:27:53,036][123091] Updated weights for policy 0, policy_version 735590 (0.0005) [2023-12-26 05:27:53,107][123091] Updated weights for policy 0, policy_version 735600 (0.0005) [2023-12-26 05:27:53,277][123090] Updated weights for policy 1, policy_version 730986 (0.0010) [2023-12-26 05:27:53,342][123090] Updated weights for policy 1, policy_version 730996 (0.0010) [2023-12-26 05:27:53,405][123090] Updated weights for policy 1, policy_version 731006 (0.0010) [2023-12-26 05:27:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 375455744. Throughput: 0: 8987.5, 1: 8628.2. Samples: 375432392. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:53,785][121949] Avg episode reward: [(0, '6099.375'), (1, '5432.836')] [2023-12-26 05:27:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000735600_188317696.pth... [2023-12-26 05:27:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000731008_187138048.pth... [2023-12-26 05:27:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000734544_188047360.pth [2023-12-26 05:27:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000729984_186875904.pth [2023-12-26 05:27:53,899][123091] Updated weights for policy 0, policy_version 735610 (0.0009) [2023-12-26 05:27:53,967][123091] Updated weights for policy 0, policy_version 735620 (0.0006) [2023-12-26 05:27:54,025][123091] Updated weights for policy 0, policy_version 735630 (0.0005) [2023-12-26 05:27:54,110][123090] Updated weights for policy 1, policy_version 731016 (0.0010) [2023-12-26 05:27:54,169][123090] Updated weights for policy 1, policy_version 731026 (0.0010) [2023-12-26 05:27:54,226][123090] Updated weights for policy 1, policy_version 731036 (0.0010) [2023-12-26 05:27:54,820][123091] Updated weights for policy 0, policy_version 735640 (0.0010) [2023-12-26 05:27:54,864][123091] Updated weights for policy 0, policy_version 735650 (0.0010) [2023-12-26 05:27:54,920][123091] Updated weights for policy 0, policy_version 735660 (0.0010) [2023-12-26 05:27:55,050][123090] Updated weights for policy 1, policy_version 731046 (0.0007) [2023-12-26 05:27:55,120][123090] Updated weights for policy 1, policy_version 731056 (0.0006) [2023-12-26 05:27:55,190][123090] Updated weights for policy 1, policy_version 731066 (0.0007) [2023-12-26 05:27:55,759][123091] Updated weights for policy 0, policy_version 735670 (0.0007) [2023-12-26 05:27:55,826][123091] Updated weights for policy 0, policy_version 735680 (0.0006) [2023-12-26 05:27:55,856][123090] Updated weights for policy 1, policy_version 731076 (0.0010) [2023-12-26 05:27:55,888][123091] Updated weights for policy 0, policy_version 735690 (0.0005) [2023-12-26 05:27:55,904][123090] Updated weights for policy 1, policy_version 731086 (0.0010) [2023-12-26 05:27:55,963][123090] Updated weights for policy 1, policy_version 731096 (0.0010) [2023-12-26 05:27:56,515][123091] Updated weights for policy 0, policy_version 735700 (0.0005) [2023-12-26 05:27:56,588][123091] Updated weights for policy 0, policy_version 735710 (0.0009) [2023-12-26 05:27:56,654][123091] Updated weights for policy 0, policy_version 735720 (0.0009) [2023-12-26 05:27:56,762][123090] Updated weights for policy 1, policy_version 731106 (0.0009) [2023-12-26 05:27:56,831][123090] Updated weights for policy 1, policy_version 731116 (0.0005) [2023-12-26 05:27:56,887][123090] Updated weights for policy 1, policy_version 731126 (0.0005) [2023-12-26 05:27:56,944][123090] Updated weights for policy 1, policy_version 731136 (0.0006) [2023-12-26 05:27:57,348][123091] Updated weights for policy 0, policy_version 735730 (0.0007) [2023-12-26 05:27:57,398][123091] Updated weights for policy 0, policy_version 735740 (0.0010) [2023-12-26 05:27:57,456][123091] Updated weights for policy 0, policy_version 735750 (0.0010) [2023-12-26 05:27:57,499][123091] Updated weights for policy 0, policy_version 735760 (0.0010) [2023-12-26 05:27:57,574][123090] Updated weights for policy 1, policy_version 731146 (0.0005) [2023-12-26 05:27:57,625][123090] Updated weights for policy 1, policy_version 731156 (0.0005) [2023-12-26 05:27:57,687][123090] Updated weights for policy 1, policy_version 731166 (0.0005) [2023-12-26 05:27:58,323][123091] Updated weights for policy 0, policy_version 735770 (0.0008) [2023-12-26 05:27:58,395][123091] Updated weights for policy 0, policy_version 735780 (0.0009) [2023-12-26 05:27:58,400][123090] Updated weights for policy 1, policy_version 731176 (0.0008) [2023-12-26 05:27:58,463][123091] Updated weights for policy 0, policy_version 735790 (0.0011) [2023-12-26 05:27:58,473][123090] Updated weights for policy 1, policy_version 731186 (0.0009) [2023-12-26 05:27:58,531][123090] Updated weights for policy 1, policy_version 731196 (0.0008) [2023-12-26 05:27:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17750.1, 300 sec: 17716.9). Total num frames: 375554048. Throughput: 0: 9087.8, 1: 8676.1. Samples: 375544304. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:27:58,785][121949] Avg episode reward: [(0, '6090.007'), (1, '5533.705')] [2023-12-26 05:27:59,421][123090] Updated weights for policy 1, policy_version 731206 (0.0008) [2023-12-26 05:27:59,423][123091] Updated weights for policy 0, policy_version 735800 (0.0008) [2023-12-26 05:27:59,475][123090] Updated weights for policy 1, policy_version 731216 (0.0010) [2023-12-26 05:27:59,486][123091] Updated weights for policy 0, policy_version 735810 (0.0005) [2023-12-26 05:27:59,549][123091] Updated weights for policy 0, policy_version 735820 (0.0006) [2023-12-26 05:27:59,550][123090] Updated weights for policy 1, policy_version 731226 (0.0010) [2023-12-26 05:28:00,239][123091] Updated weights for policy 0, policy_version 735830 (0.0005) [2023-12-26 05:28:00,292][123091] Updated weights for policy 0, policy_version 735840 (0.0005) [2023-12-26 05:28:00,323][123090] Updated weights for policy 1, policy_version 731236 (0.0008) [2023-12-26 05:28:00,353][123091] Updated weights for policy 0, policy_version 735850 (0.0006) [2023-12-26 05:28:00,382][123090] Updated weights for policy 1, policy_version 731246 (0.0006) [2023-12-26 05:28:00,452][123090] Updated weights for policy 1, policy_version 731256 (0.0009) [2023-12-26 05:28:01,110][123090] Updated weights for policy 1, policy_version 731266 (0.0009) [2023-12-26 05:28:01,187][123090] Updated weights for policy 1, policy_version 731276 (0.0010) [2023-12-26 05:28:01,199][123091] Updated weights for policy 0, policy_version 735860 (0.0008) [2023-12-26 05:28:01,256][123090] Updated weights for policy 1, policy_version 731286 (0.0010) [2023-12-26 05:28:01,275][123091] Updated weights for policy 0, policy_version 735870 (0.0008) [2023-12-26 05:28:01,328][123090] Updated weights for policy 1, policy_version 731296 (0.0009) [2023-12-26 05:28:01,352][123091] Updated weights for policy 0, policy_version 735880 (0.0008) [2023-12-26 05:28:02,167][123090] Updated weights for policy 1, policy_version 731306 (0.0010) [2023-12-26 05:28:02,200][123091] Updated weights for policy 0, policy_version 735890 (0.0009) [2023-12-26 05:28:02,220][123090] Updated weights for policy 1, policy_version 731316 (0.0006) [2023-12-26 05:28:02,260][123091] Updated weights for policy 0, policy_version 735900 (0.0007) [2023-12-26 05:28:02,279][123090] Updated weights for policy 1, policy_version 731326 (0.0008) [2023-12-26 05:28:02,326][123091] Updated weights for policy 0, policy_version 735910 (0.0007) [2023-12-26 05:28:02,393][123091] Updated weights for policy 0, policy_version 735920 (0.0010) [2023-12-26 05:28:03,078][123090] Updated weights for policy 1, policy_version 731336 (0.0010) [2023-12-26 05:28:03,143][123090] Updated weights for policy 1, policy_version 731346 (0.0010) [2023-12-26 05:28:03,199][123091] Updated weights for policy 0, policy_version 735930 (0.0006) [2023-12-26 05:28:03,200][123090] Updated weights for policy 1, policy_version 731356 (0.0006) [2023-12-26 05:28:03,253][123091] Updated weights for policy 0, policy_version 735940 (0.0005) [2023-12-26 05:28:03,315][123091] Updated weights for policy 0, policy_version 735950 (0.0005) [2023-12-26 05:28:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 375635968. Throughput: 0: 8914.6, 1: 8801.3. Samples: 375650040. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:03,785][121949] Avg episode reward: [(0, '6125.940'), (1, '5414.861')] [2023-12-26 05:28:03,906][123090] Updated weights for policy 1, policy_version 731366 (0.0008) [2023-12-26 05:28:03,964][123091] Updated weights for policy 0, policy_version 735960 (0.0008) [2023-12-26 05:28:03,968][123090] Updated weights for policy 1, policy_version 731376 (0.0009) [2023-12-26 05:28:04,013][123091] Updated weights for policy 0, policy_version 735970 (0.0009) [2023-12-26 05:28:04,021][123090] Updated weights for policy 1, policy_version 731386 (0.0009) [2023-12-26 05:28:04,072][123091] Updated weights for policy 0, policy_version 735980 (0.0008) [2023-12-26 05:28:04,808][123090] Updated weights for policy 1, policy_version 731396 (0.0008) [2023-12-26 05:28:04,862][123091] Updated weights for policy 0, policy_version 735990 (0.0008) [2023-12-26 05:28:04,867][123090] Updated weights for policy 1, policy_version 731406 (0.0010) [2023-12-26 05:28:04,911][123091] Updated weights for policy 0, policy_version 736000 (0.0010) [2023-12-26 05:28:04,926][123090] Updated weights for policy 1, policy_version 731416 (0.0010) [2023-12-26 05:28:04,959][123091] Updated weights for policy 0, policy_version 736010 (0.0007) [2023-12-26 05:28:05,750][123090] Updated weights for policy 1, policy_version 731426 (0.0010) [2023-12-26 05:28:05,777][123091] Updated weights for policy 0, policy_version 736020 (0.0008) [2023-12-26 05:28:05,821][123090] Updated weights for policy 1, policy_version 731436 (0.0010) [2023-12-26 05:28:05,834][123091] Updated weights for policy 0, policy_version 736030 (0.0008) [2023-12-26 05:28:05,888][123090] Updated weights for policy 1, policy_version 731446 (0.0010) [2023-12-26 05:28:05,898][123091] Updated weights for policy 0, policy_version 736040 (0.0007) [2023-12-26 05:28:05,954][123090] Updated weights for policy 1, policy_version 731456 (0.0010) [2023-12-26 05:28:06,669][123091] Updated weights for policy 0, policy_version 736050 (0.0008) [2023-12-26 05:28:06,681][123090] Updated weights for policy 1, policy_version 731466 (0.0006) [2023-12-26 05:28:06,727][123091] Updated weights for policy 0, policy_version 736060 (0.0006) [2023-12-26 05:28:06,746][123090] Updated weights for policy 1, policy_version 731476 (0.0010) [2023-12-26 05:28:06,785][123091] Updated weights for policy 0, policy_version 736070 (0.0005) [2023-12-26 05:28:06,798][123090] Updated weights for policy 1, policy_version 731486 (0.0010) [2023-12-26 05:28:06,841][123091] Updated weights for policy 0, policy_version 736080 (0.0005) [2023-12-26 05:28:07,579][123091] Updated weights for policy 0, policy_version 736090 (0.0009) [2023-12-26 05:28:07,607][123090] Updated weights for policy 1, policy_version 731496 (0.0010) [2023-12-26 05:28:07,628][123091] Updated weights for policy 0, policy_version 736100 (0.0006) [2023-12-26 05:28:07,664][123090] Updated weights for policy 1, policy_version 731506 (0.0010) [2023-12-26 05:28:07,679][123091] Updated weights for policy 0, policy_version 736110 (0.0007) [2023-12-26 05:28:07,707][123090] Updated weights for policy 1, policy_version 731516 (0.0010) [2023-12-26 05:28:08,435][123091] Updated weights for policy 0, policy_version 736120 (0.0006) [2023-12-26 05:28:08,485][123091] Updated weights for policy 0, policy_version 736130 (0.0010) [2023-12-26 05:28:08,512][123090] Updated weights for policy 1, policy_version 731526 (0.0008) [2023-12-26 05:28:08,531][123091] Updated weights for policy 0, policy_version 736140 (0.0009) [2023-12-26 05:28:08,566][123090] Updated weights for policy 1, policy_version 731536 (0.0009) [2023-12-26 05:28:08,621][123090] Updated weights for policy 1, policy_version 731546 (0.0008) [2023-12-26 05:28:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 375734272. Throughput: 0: 8940.4, 1: 8817.9. Samples: 375704112. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:08,785][121949] Avg episode reward: [(0, '6216.603'), (1, '5334.476')] [2023-12-26 05:28:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000736144_188456960.pth... [2023-12-26 05:28:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000731552_187277312.pth... [2023-12-26 05:28:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000730496_187006976.pth [2023-12-26 05:28:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000735088_188186624.pth [2023-12-26 05:28:09,398][123091] Updated weights for policy 0, policy_version 736150 (0.0008) [2023-12-26 05:28:09,462][123091] Updated weights for policy 0, policy_version 736160 (0.0009) [2023-12-26 05:28:09,514][123091] Updated weights for policy 0, policy_version 736170 (0.0008) [2023-12-26 05:28:09,520][123090] Updated weights for policy 1, policy_version 731556 (0.0010) [2023-12-26 05:28:09,580][123090] Updated weights for policy 1, policy_version 731566 (0.0011) [2023-12-26 05:28:09,641][123090] Updated weights for policy 1, policy_version 731576 (0.0010) [2023-12-26 05:28:10,377][123091] Updated weights for policy 0, policy_version 736180 (0.0010) [2023-12-26 05:28:10,426][123091] Updated weights for policy 0, policy_version 736190 (0.0009) [2023-12-26 05:28:10,482][123091] Updated weights for policy 0, policy_version 736200 (0.0009) [2023-12-26 05:28:10,489][123090] Updated weights for policy 1, policy_version 731586 (0.0010) [2023-12-26 05:28:10,552][123090] Updated weights for policy 1, policy_version 731596 (0.0011) [2023-12-26 05:28:10,622][123090] Updated weights for policy 1, policy_version 731606 (0.0010) [2023-12-26 05:28:10,685][123090] Updated weights for policy 1, policy_version 731616 (0.0006) [2023-12-26 05:28:11,253][123091] Updated weights for policy 0, policy_version 736210 (0.0007) [2023-12-26 05:28:11,321][123091] Updated weights for policy 0, policy_version 736220 (0.0011) [2023-12-26 05:28:11,390][123091] Updated weights for policy 0, policy_version 736230 (0.0011) [2023-12-26 05:28:11,415][123090] Updated weights for policy 1, policy_version 731626 (0.0011) [2023-12-26 05:28:11,455][123091] Updated weights for policy 0, policy_version 736240 (0.0011) [2023-12-26 05:28:11,479][123090] Updated weights for policy 1, policy_version 731636 (0.0011) [2023-12-26 05:28:11,542][123090] Updated weights for policy 1, policy_version 731646 (0.0010) [2023-12-26 05:28:12,180][123091] Updated weights for policy 0, policy_version 736250 (0.0006) [2023-12-26 05:28:12,243][123091] Updated weights for policy 0, policy_version 736260 (0.0009) [2023-12-26 05:28:12,320][123091] Updated weights for policy 0, policy_version 736270 (0.0006) [2023-12-26 05:28:12,408][123090] Updated weights for policy 1, policy_version 731656 (0.0011) [2023-12-26 05:28:12,483][123090] Updated weights for policy 1, policy_version 731666 (0.0011) [2023-12-26 05:28:12,539][123090] Updated weights for policy 1, policy_version 731676 (0.0010) [2023-12-26 05:28:13,052][123091] Updated weights for policy 0, policy_version 736280 (0.0006) [2023-12-26 05:28:13,128][123091] Updated weights for policy 0, policy_version 736290 (0.0006) [2023-12-26 05:28:13,206][123091] Updated weights for policy 0, policy_version 736300 (0.0006) [2023-12-26 05:28:13,257][123090] Updated weights for policy 1, policy_version 731686 (0.0007) [2023-12-26 05:28:13,327][123090] Updated weights for policy 1, policy_version 731696 (0.0005) [2023-12-26 05:28:13,392][123090] Updated weights for policy 1, policy_version 731706 (0.0005) [2023-12-26 05:28:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 375816192. Throughput: 0: 8957.1, 1: 8795.3. Samples: 375809404. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:13,785][121949] Avg episode reward: [(0, '6181.457'), (1, '5604.543')] [2023-12-26 05:28:13,817][123091] Updated weights for policy 0, policy_version 736310 (0.0005) [2023-12-26 05:28:13,884][123091] Updated weights for policy 0, policy_version 736320 (0.0006) [2023-12-26 05:28:13,952][123091] Updated weights for policy 0, policy_version 736330 (0.0007) [2023-12-26 05:28:14,070][123090] Updated weights for policy 1, policy_version 731716 (0.0005) [2023-12-26 05:28:14,136][123090] Updated weights for policy 1, policy_version 731726 (0.0006) [2023-12-26 05:28:14,200][123090] Updated weights for policy 1, policy_version 731736 (0.0006) [2023-12-26 05:28:14,662][123091] Updated weights for policy 0, policy_version 736340 (0.0006) [2023-12-26 05:28:14,717][123091] Updated weights for policy 0, policy_version 736350 (0.0006) [2023-12-26 05:28:14,788][123091] Updated weights for policy 0, policy_version 736360 (0.0008) [2023-12-26 05:28:14,985][123090] Updated weights for policy 1, policy_version 731746 (0.0007) [2023-12-26 05:28:15,046][123090] Updated weights for policy 1, policy_version 731756 (0.0011) [2023-12-26 05:28:15,114][123090] Updated weights for policy 1, policy_version 731766 (0.0011) [2023-12-26 05:28:15,178][123090] Updated weights for policy 1, policy_version 731776 (0.0011) [2023-12-26 05:28:15,526][123091] Updated weights for policy 0, policy_version 736370 (0.0009) [2023-12-26 05:28:15,575][123091] Updated weights for policy 0, policy_version 736380 (0.0009) [2023-12-26 05:28:15,624][123091] Updated weights for policy 0, policy_version 736391 (0.0010) [2023-12-26 05:28:15,935][123090] Updated weights for policy 1, policy_version 731786 (0.0006) [2023-12-26 05:28:15,987][123090] Updated weights for policy 1, policy_version 731796 (0.0006) [2023-12-26 05:28:16,041][123090] Updated weights for policy 1, policy_version 731806 (0.0005) [2023-12-26 05:28:16,347][123091] Updated weights for policy 0, policy_version 736401 (0.0010) [2023-12-26 05:28:16,397][123091] Updated weights for policy 0, policy_version 736411 (0.0005) [2023-12-26 05:28:16,447][123091] Updated weights for policy 0, policy_version 736421 (0.0009) [2023-12-26 05:28:16,494][123091] Updated weights for policy 0, policy_version 736431 (0.0008) [2023-12-26 05:28:16,731][123090] Updated weights for policy 1, policy_version 731816 (0.0009) [2023-12-26 05:28:16,782][123090] Updated weights for policy 1, policy_version 731826 (0.0010) [2023-12-26 05:28:16,833][123090] Updated weights for policy 1, policy_version 731836 (0.0010) [2023-12-26 05:28:17,268][123091] Updated weights for policy 0, policy_version 736441 (0.0006) [2023-12-26 05:28:17,335][123091] Updated weights for policy 0, policy_version 736451 (0.0006) [2023-12-26 05:28:17,392][123091] Updated weights for policy 0, policy_version 736461 (0.0005) [2023-12-26 05:28:17,592][123090] Updated weights for policy 1, policy_version 731846 (0.0007) [2023-12-26 05:28:17,648][123090] Updated weights for policy 1, policy_version 731856 (0.0006) [2023-12-26 05:28:17,704][123090] Updated weights for policy 1, policy_version 731866 (0.0007) [2023-12-26 05:28:18,028][123091] Updated weights for policy 0, policy_version 736471 (0.0005) [2023-12-26 05:28:18,078][123091] Updated weights for policy 0, policy_version 736481 (0.0005) [2023-12-26 05:28:18,138][123091] Updated weights for policy 0, policy_version 736491 (0.0005) [2023-12-26 05:28:18,370][123090] Updated weights for policy 1, policy_version 731876 (0.0006) [2023-12-26 05:28:18,433][123090] Updated weights for policy 1, policy_version 731886 (0.0008) [2023-12-26 05:28:18,489][123090] Updated weights for policy 1, policy_version 731896 (0.0006) [2023-12-26 05:28:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 375914496. Throughput: 0: 9093.8, 1: 8914.3. Samples: 375927320. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:18,785][121949] Avg episode reward: [(0, '6223.369'), (1, '5651.219')] [2023-12-26 05:28:18,801][123091] Updated weights for policy 0, policy_version 736501 (0.0005) [2023-12-26 05:28:18,866][123091] Updated weights for policy 0, policy_version 736511 (0.0005) [2023-12-26 05:28:18,933][123091] Updated weights for policy 0, policy_version 736521 (0.0005) [2023-12-26 05:28:19,211][123090] Updated weights for policy 1, policy_version 731906 (0.0009) [2023-12-26 05:28:19,279][123090] Updated weights for policy 1, policy_version 731916 (0.0008) [2023-12-26 05:28:19,348][123090] Updated weights for policy 1, policy_version 731926 (0.0008) [2023-12-26 05:28:19,405][123090] Updated weights for policy 1, policy_version 731936 (0.0008) [2023-12-26 05:28:19,662][123091] Updated weights for policy 0, policy_version 736531 (0.0007) [2023-12-26 05:28:19,729][123091] Updated weights for policy 0, policy_version 736541 (0.0011) [2023-12-26 05:28:19,793][123091] Updated weights for policy 0, policy_version 736551 (0.0011) [2023-12-26 05:28:20,203][123090] Updated weights for policy 1, policy_version 731946 (0.0008) [2023-12-26 05:28:20,277][123090] Updated weights for policy 1, policy_version 731956 (0.0008) [2023-12-26 05:28:20,332][123090] Updated weights for policy 1, policy_version 731966 (0.0008) [2023-12-26 05:28:20,574][123091] Updated weights for policy 0, policy_version 736561 (0.0011) [2023-12-26 05:28:20,645][123091] Updated weights for policy 0, policy_version 736571 (0.0008) [2023-12-26 05:28:20,705][123091] Updated weights for policy 0, policy_version 736581 (0.0006) [2023-12-26 05:28:20,773][123091] Updated weights for policy 0, policy_version 736591 (0.0008) [2023-12-26 05:28:21,128][123090] Updated weights for policy 1, policy_version 731976 (0.0009) [2023-12-26 05:28:21,192][123090] Updated weights for policy 1, policy_version 731986 (0.0007) [2023-12-26 05:28:21,259][123090] Updated weights for policy 1, policy_version 731996 (0.0008) [2023-12-26 05:28:21,538][123091] Updated weights for policy 0, policy_version 736601 (0.0009) [2023-12-26 05:28:21,609][123091] Updated weights for policy 0, policy_version 736611 (0.0009) [2023-12-26 05:28:21,676][123091] Updated weights for policy 0, policy_version 736621 (0.0009) [2023-12-26 05:28:22,086][123090] Updated weights for policy 1, policy_version 732006 (0.0011) [2023-12-26 05:28:22,138][123090] Updated weights for policy 1, policy_version 732016 (0.0010) [2023-12-26 05:28:22,202][123090] Updated weights for policy 1, policy_version 732026 (0.0010) [2023-12-26 05:28:22,534][123091] Updated weights for policy 0, policy_version 736631 (0.0006) [2023-12-26 05:28:22,610][123091] Updated weights for policy 0, policy_version 736641 (0.0007) [2023-12-26 05:28:22,662][123091] Updated weights for policy 0, policy_version 736651 (0.0009) [2023-12-26 05:28:23,054][123090] Updated weights for policy 1, policy_version 732036 (0.0010) [2023-12-26 05:28:23,102][123090] Updated weights for policy 1, policy_version 732046 (0.0010) [2023-12-26 05:28:23,150][123090] Updated weights for policy 1, policy_version 732056 (0.0010) [2023-12-26 05:28:23,444][123091] Updated weights for policy 0, policy_version 736661 (0.0009) [2023-12-26 05:28:23,496][123091] Updated weights for policy 0, policy_version 736671 (0.0009) [2023-12-26 05:28:23,558][123091] Updated weights for policy 0, policy_version 736681 (0.0010) [2023-12-26 05:28:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 376004608. Throughput: 0: 9097.2, 1: 8908.1. Samples: 375980828. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:23,785][121949] Avg episode reward: [(0, '6088.300'), (1, '5541.759')] [2023-12-26 05:28:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000732064_187408384.pth... [2023-12-26 05:28:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000736688_188596224.pth... [2023-12-26 05:28:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000731008_187138048.pth [2023-12-26 05:28:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000735600_188317696.pth [2023-12-26 05:28:23,917][123090] Updated weights for policy 1, policy_version 732066 (0.0010) [2023-12-26 05:28:23,967][123090] Updated weights for policy 1, policy_version 732076 (0.0006) [2023-12-26 05:28:24,024][123090] Updated weights for policy 1, policy_version 732086 (0.0005) [2023-12-26 05:28:24,084][123090] Updated weights for policy 1, policy_version 732096 (0.0005) [2023-12-26 05:28:24,450][123091] Updated weights for policy 0, policy_version 736691 (0.0009) [2023-12-26 05:28:24,510][123091] Updated weights for policy 0, policy_version 736701 (0.0010) [2023-12-26 05:28:24,571][123091] Updated weights for policy 0, policy_version 736711 (0.0008) [2023-12-26 05:28:24,835][123090] Updated weights for policy 1, policy_version 732106 (0.0007) [2023-12-26 05:28:24,883][123090] Updated weights for policy 1, policy_version 732116 (0.0009) [2023-12-26 05:28:24,936][123090] Updated weights for policy 1, policy_version 732126 (0.0009) [2023-12-26 05:28:25,338][123091] Updated weights for policy 0, policy_version 736721 (0.0009) [2023-12-26 05:28:25,394][123091] Updated weights for policy 0, policy_version 736731 (0.0006) [2023-12-26 05:28:25,449][123091] Updated weights for policy 0, policy_version 736741 (0.0010) [2023-12-26 05:28:25,510][123091] Updated weights for policy 0, policy_version 736751 (0.0009) [2023-12-26 05:28:25,811][123090] Updated weights for policy 1, policy_version 732136 (0.0009) [2023-12-26 05:28:25,877][123090] Updated weights for policy 1, policy_version 732146 (0.0009) [2023-12-26 05:28:25,944][123090] Updated weights for policy 1, policy_version 732156 (0.0010) [2023-12-26 05:28:26,339][123091] Updated weights for policy 0, policy_version 736761 (0.0010) [2023-12-26 05:28:26,400][123091] Updated weights for policy 0, policy_version 736771 (0.0010) [2023-12-26 05:28:26,455][123091] Updated weights for policy 0, policy_version 736781 (0.0010) [2023-12-26 05:28:26,649][123090] Updated weights for policy 1, policy_version 732166 (0.0009) [2023-12-26 05:28:26,704][123090] Updated weights for policy 1, policy_version 732176 (0.0008) [2023-12-26 05:28:26,753][123090] Updated weights for policy 1, policy_version 732186 (0.0009) [2023-12-26 05:28:27,233][123091] Updated weights for policy 0, policy_version 736791 (0.0007) [2023-12-26 05:28:27,279][123091] Updated weights for policy 0, policy_version 736801 (0.0005) [2023-12-26 05:28:27,332][123091] Updated weights for policy 0, policy_version 736811 (0.0005) [2023-12-26 05:28:27,699][123090] Updated weights for policy 1, policy_version 732196 (0.0009) [2023-12-26 05:28:27,767][123090] Updated weights for policy 1, policy_version 732206 (0.0010) [2023-12-26 05:28:27,840][123090] Updated weights for policy 1, policy_version 732216 (0.0010) [2023-12-26 05:28:27,962][123091] Updated weights for policy 0, policy_version 736821 (0.0007) [2023-12-26 05:28:28,034][123091] Updated weights for policy 0, policy_version 736831 (0.0009) [2023-12-26 05:28:28,089][123091] Updated weights for policy 0, policy_version 736841 (0.0010) [2023-12-26 05:28:28,701][123090] Updated weights for policy 1, policy_version 732226 (0.0010) [2023-12-26 05:28:28,763][123090] Updated weights for policy 1, policy_version 732236 (0.0010) [2023-12-26 05:28:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 376086528. Throughput: 0: 9123.7, 1: 8909.3. Samples: 376086308. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:28,785][121949] Avg episode reward: [(0, '6025.125'), (1, '5613.207')] [2023-12-26 05:28:28,833][123090] Updated weights for policy 1, policy_version 732246 (0.0010) [2023-12-26 05:28:28,854][123091] Updated weights for policy 0, policy_version 736851 (0.0009) [2023-12-26 05:28:28,895][123090] Updated weights for policy 1, policy_version 732256 (0.0009) [2023-12-26 05:28:28,912][123091] Updated weights for policy 0, policy_version 736861 (0.0008) [2023-12-26 05:28:28,968][123091] Updated weights for policy 0, policy_version 736871 (0.0005) [2023-12-26 05:28:29,703][123091] Updated weights for policy 0, policy_version 736881 (0.0007) [2023-12-26 05:28:29,764][123091] Updated weights for policy 0, policy_version 736891 (0.0007) [2023-12-26 05:28:29,766][123090] Updated weights for policy 1, policy_version 732266 (0.0007) [2023-12-26 05:28:29,816][123090] Updated weights for policy 1, policy_version 732276 (0.0008) [2023-12-26 05:28:29,827][123091] Updated weights for policy 0, policy_version 736901 (0.0010) [2023-12-26 05:28:29,879][123090] Updated weights for policy 1, policy_version 732286 (0.0008) [2023-12-26 05:28:29,885][123091] Updated weights for policy 0, policy_version 736911 (0.0011) [2023-12-26 05:28:30,683][123090] Updated weights for policy 1, policy_version 732296 (0.0008) [2023-12-26 05:28:30,689][123091] Updated weights for policy 0, policy_version 736921 (0.0008) [2023-12-26 05:28:30,732][123090] Updated weights for policy 1, policy_version 732306 (0.0006) [2023-12-26 05:28:30,737][123091] Updated weights for policy 0, policy_version 736931 (0.0009) [2023-12-26 05:28:30,779][123090] Updated weights for policy 1, policy_version 732316 (0.0005) [2023-12-26 05:28:30,781][123091] Updated weights for policy 0, policy_version 736941 (0.0010) [2023-12-26 05:28:31,632][123090] Updated weights for policy 1, policy_version 732326 (0.0007) [2023-12-26 05:28:31,640][123091] Updated weights for policy 0, policy_version 736951 (0.0011) [2023-12-26 05:28:31,688][123090] Updated weights for policy 1, policy_version 732336 (0.0006) [2023-12-26 05:28:31,707][123091] Updated weights for policy 0, policy_version 736961 (0.0011) [2023-12-26 05:28:31,755][123090] Updated weights for policy 1, policy_version 732346 (0.0007) [2023-12-26 05:28:31,771][123091] Updated weights for policy 0, policy_version 736971 (0.0008) [2023-12-26 05:28:32,565][123090] Updated weights for policy 1, policy_version 732356 (0.0008) [2023-12-26 05:28:32,569][123091] Updated weights for policy 0, policy_version 736981 (0.0008) [2023-12-26 05:28:32,627][123090] Updated weights for policy 1, policy_version 732366 (0.0008) [2023-12-26 05:28:32,637][123091] Updated weights for policy 0, policy_version 736991 (0.0011) [2023-12-26 05:28:32,683][123090] Updated weights for policy 1, policy_version 732376 (0.0007) [2023-12-26 05:28:32,700][123091] Updated weights for policy 0, policy_version 737001 (0.0011) [2023-12-26 05:28:33,394][123091] Updated weights for policy 0, policy_version 737011 (0.0011) [2023-12-26 05:28:33,464][123091] Updated weights for policy 0, policy_version 737021 (0.0010) [2023-12-26 05:28:33,534][123091] Updated weights for policy 0, policy_version 737031 (0.0011) [2023-12-26 05:28:33,541][123090] Updated weights for policy 1, policy_version 732386 (0.0008) [2023-12-26 05:28:33,603][123090] Updated weights for policy 1, policy_version 732396 (0.0007) [2023-12-26 05:28:33,660][123090] Updated weights for policy 1, policy_version 732406 (0.0008) [2023-12-26 05:28:33,720][123090] Updated weights for policy 1, policy_version 732416 (0.0008) [2023-12-26 05:28:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 376184832. Throughput: 0: 9084.5, 1: 8908.2. Samples: 376191308. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:33,785][121949] Avg episode reward: [(0, '6023.592'), (1, '5735.929')] [2023-12-26 05:28:34,328][123091] Updated weights for policy 0, policy_version 737041 (0.0011) [2023-12-26 05:28:34,399][123091] Updated weights for policy 0, policy_version 737051 (0.0011) [2023-12-26 05:28:34,462][123091] Updated weights for policy 0, policy_version 737061 (0.0009) [2023-12-26 05:28:34,527][123091] Updated weights for policy 0, policy_version 737071 (0.0007) [2023-12-26 05:28:34,569][123090] Updated weights for policy 1, policy_version 732426 (0.0009) [2023-12-26 05:28:34,627][123090] Updated weights for policy 1, policy_version 732436 (0.0010) [2023-12-26 05:28:34,681][123090] Updated weights for policy 1, policy_version 732446 (0.0010) [2023-12-26 05:28:35,202][123091] Updated weights for policy 0, policy_version 737081 (0.0007) [2023-12-26 05:28:35,261][123091] Updated weights for policy 0, policy_version 737091 (0.0010) [2023-12-26 05:28:35,328][123091] Updated weights for policy 0, policy_version 737101 (0.0011) [2023-12-26 05:28:35,556][123090] Updated weights for policy 1, policy_version 732456 (0.0009) [2023-12-26 05:28:35,619][123090] Updated weights for policy 1, policy_version 732466 (0.0009) [2023-12-26 05:28:35,671][123090] Updated weights for policy 1, policy_version 732476 (0.0009) [2023-12-26 05:28:36,114][123091] Updated weights for policy 0, policy_version 737111 (0.0009) [2023-12-26 05:28:36,180][123091] Updated weights for policy 0, policy_version 737121 (0.0008) [2023-12-26 05:28:36,231][123091] Updated weights for policy 0, policy_version 737131 (0.0009) [2023-12-26 05:28:36,509][123090] Updated weights for policy 1, policy_version 732486 (0.0010) [2023-12-26 05:28:36,573][123090] Updated weights for policy 1, policy_version 732496 (0.0010) [2023-12-26 05:28:36,628][123090] Updated weights for policy 1, policy_version 732506 (0.0008) [2023-12-26 05:28:37,072][123091] Updated weights for policy 0, policy_version 737141 (0.0010) [2023-12-26 05:28:37,132][123091] Updated weights for policy 0, policy_version 737151 (0.0010) [2023-12-26 05:28:37,202][123091] Updated weights for policy 0, policy_version 737161 (0.0009) [2023-12-26 05:28:37,490][123090] Updated weights for policy 1, policy_version 732516 (0.0009) [2023-12-26 05:28:37,560][123090] Updated weights for policy 1, policy_version 732526 (0.0010) [2023-12-26 05:28:37,623][123090] Updated weights for policy 1, policy_version 732536 (0.0010) [2023-12-26 05:28:37,938][123091] Updated weights for policy 0, policy_version 737171 (0.0008) [2023-12-26 05:28:37,995][123091] Updated weights for policy 0, policy_version 737181 (0.0005) [2023-12-26 05:28:38,067][123091] Updated weights for policy 0, policy_version 737191 (0.0005) [2023-12-26 05:28:38,508][123090] Updated weights for policy 1, policy_version 732546 (0.0009) [2023-12-26 05:28:38,575][123090] Updated weights for policy 1, policy_version 732556 (0.0009) [2023-12-26 05:28:38,639][123090] Updated weights for policy 1, policy_version 732566 (0.0008) [2023-12-26 05:28:38,707][123090] Updated weights for policy 1, policy_version 732576 (0.0009) [2023-12-26 05:28:38,778][123091] Updated weights for policy 0, policy_version 737201 (0.0006) [2023-12-26 05:28:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 376266752. Throughput: 0: 9132.2, 1: 8887.8. Samples: 376243292. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:38,785][121949] Avg episode reward: [(0, '6052.375'), (1, '5582.247')] [2023-12-26 05:28:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000732576_187539456.pth... [2023-12-26 05:28:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000731552_187277312.pth [2023-12-26 05:28:38,841][123091] Updated weights for policy 0, policy_version 737211 (0.0011) [2023-12-26 05:28:38,900][123091] Updated weights for policy 0, policy_version 737221 (0.0010) [2023-12-26 05:28:38,956][123091] Updated weights for policy 0, policy_version 737231 (0.0010) [2023-12-26 05:28:38,961][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000737232_188735488.pth... [2023-12-26 05:28:38,966][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000736144_188456960.pth [2023-12-26 05:28:39,580][123090] Updated weights for policy 1, policy_version 732586 (0.0010) [2023-12-26 05:28:39,640][123090] Updated weights for policy 1, policy_version 732596 (0.0010) [2023-12-26 05:28:39,707][123090] Updated weights for policy 1, policy_version 732606 (0.0009) [2023-12-26 05:28:39,770][123091] Updated weights for policy 0, policy_version 737241 (0.0009) [2023-12-26 05:28:39,842][123091] Updated weights for policy 0, policy_version 737251 (0.0007) [2023-12-26 05:28:39,901][123091] Updated weights for policy 0, policy_version 737261 (0.0009) [2023-12-26 05:28:40,600][123090] Updated weights for policy 1, policy_version 732616 (0.0009) [2023-12-26 05:28:40,660][123090] Updated weights for policy 1, policy_version 732626 (0.0010) [2023-12-26 05:28:40,711][123090] Updated weights for policy 1, policy_version 732636 (0.0010) [2023-12-26 05:28:40,759][123091] Updated weights for policy 0, policy_version 737271 (0.0008) [2023-12-26 05:28:40,812][123091] Updated weights for policy 0, policy_version 737281 (0.0009) [2023-12-26 05:28:40,861][123091] Updated weights for policy 0, policy_version 737291 (0.0009) [2023-12-26 05:28:41,603][123090] Updated weights for policy 1, policy_version 732646 (0.0011) [2023-12-26 05:28:41,674][123090] Updated weights for policy 1, policy_version 732656 (0.0010) [2023-12-26 05:28:41,748][123090] Updated weights for policy 1, policy_version 732666 (0.0010) [2023-12-26 05:28:41,791][123091] Updated weights for policy 0, policy_version 737301 (0.0010) [2023-12-26 05:28:41,852][123091] Updated weights for policy 0, policy_version 737311 (0.0009) [2023-12-26 05:28:41,905][123091] Updated weights for policy 0, policy_version 737321 (0.0009) [2023-12-26 05:28:42,585][123090] Updated weights for policy 1, policy_version 732676 (0.0011) [2023-12-26 05:28:42,642][123090] Updated weights for policy 1, policy_version 732687 (0.0011) [2023-12-26 05:28:42,707][123090] Updated weights for policy 1, policy_version 732697 (0.0011) [2023-12-26 05:28:42,765][123091] Updated weights for policy 0, policy_version 737331 (0.0009) [2023-12-26 05:28:42,823][123091] Updated weights for policy 0, policy_version 737341 (0.0010) [2023-12-26 05:28:42,891][123091] Updated weights for policy 0, policy_version 737351 (0.0009) [2023-12-26 05:28:43,553][123090] Updated weights for policy 1, policy_version 732707 (0.0011) [2023-12-26 05:28:43,616][123090] Updated weights for policy 1, policy_version 732717 (0.0011) [2023-12-26 05:28:43,679][123090] Updated weights for policy 1, policy_version 732727 (0.0011) [2023-12-26 05:28:43,716][123091] Updated weights for policy 0, policy_version 737361 (0.0009) [2023-12-26 05:28:43,782][123091] Updated weights for policy 0, policy_version 737371 (0.0008) [2023-12-26 05:28:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 376348672. Throughput: 0: 9035.2, 1: 8739.7. Samples: 376344176. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:43,784][121949] Avg episode reward: [(0, '6089.108'), (1, '5525.023')] [2023-12-26 05:28:43,845][123091] Updated weights for policy 0, policy_version 737381 (0.0009) [2023-12-26 05:28:43,905][123091] Updated weights for policy 0, policy_version 737391 (0.0009) [2023-12-26 05:28:44,516][123090] Updated weights for policy 1, policy_version 732737 (0.0011) [2023-12-26 05:28:44,576][123090] Updated weights for policy 1, policy_version 732747 (0.0011) [2023-12-26 05:28:44,633][123090] Updated weights for policy 1, policy_version 732757 (0.0010) [2023-12-26 05:28:44,691][123090] Updated weights for policy 1, policy_version 732767 (0.0010) [2023-12-26 05:28:44,751][123091] Updated weights for policy 0, policy_version 737401 (0.0009) [2023-12-26 05:28:44,817][123091] Updated weights for policy 0, policy_version 737411 (0.0009) [2023-12-26 05:28:44,873][123091] Updated weights for policy 0, policy_version 737421 (0.0009) [2023-12-26 05:28:45,544][123090] Updated weights for policy 1, policy_version 732777 (0.0006) [2023-12-26 05:28:45,614][123090] Updated weights for policy 1, policy_version 732787 (0.0006) [2023-12-26 05:28:45,670][123090] Updated weights for policy 1, policy_version 732798 (0.0009) [2023-12-26 05:28:45,731][123091] Updated weights for policy 0, policy_version 737431 (0.0009) [2023-12-26 05:28:45,783][123091] Updated weights for policy 0, policy_version 737441 (0.0009) [2023-12-26 05:28:45,844][123091] Updated weights for policy 0, policy_version 737451 (0.0009) [2023-12-26 05:28:46,464][123090] Updated weights for policy 1, policy_version 732808 (0.0010) [2023-12-26 05:28:46,520][123090] Updated weights for policy 1, policy_version 732818 (0.0009) [2023-12-26 05:28:46,570][123090] Updated weights for policy 1, policy_version 732828 (0.0009) [2023-12-26 05:28:46,649][123091] Updated weights for policy 0, policy_version 737461 (0.0009) [2023-12-26 05:28:46,700][123091] Updated weights for policy 0, policy_version 737472 (0.0009) [2023-12-26 05:28:46,764][123091] Updated weights for policy 0, policy_version 737482 (0.0006) [2023-12-26 05:28:47,413][123091] Updated weights for policy 0, policy_version 737492 (0.0006) [2023-12-26 05:28:47,433][123090] Updated weights for policy 1, policy_version 732838 (0.0009) [2023-12-26 05:28:47,464][123091] Updated weights for policy 0, policy_version 737502 (0.0005) [2023-12-26 05:28:47,502][123090] Updated weights for policy 1, policy_version 732848 (0.0009) [2023-12-26 05:28:47,520][123091] Updated weights for policy 0, policy_version 737512 (0.0008) [2023-12-26 05:28:47,563][123090] Updated weights for policy 1, policy_version 732858 (0.0008) [2023-12-26 05:28:48,251][123091] Updated weights for policy 0, policy_version 737522 (0.0008) [2023-12-26 05:28:48,316][123091] Updated weights for policy 0, policy_version 737532 (0.0006) [2023-12-26 05:28:48,382][123091] Updated weights for policy 0, policy_version 737542 (0.0008) [2023-12-26 05:28:48,440][123090] Updated weights for policy 1, policy_version 732868 (0.0009) [2023-12-26 05:28:48,448][123091] Updated weights for policy 0, policy_version 737552 (0.0011) [2023-12-26 05:28:48,509][123090] Updated weights for policy 1, policy_version 732878 (0.0009) [2023-12-26 05:28:48,586][123090] Updated weights for policy 1, policy_version 732888 (0.0009) [2023-12-26 05:28:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 376438784. Throughput: 0: 9072.8, 1: 8657.0. Samples: 376447880. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:48,785][121949] Avg episode reward: [(0, '6045.015'), (1, '5481.711')] [2023-12-26 05:28:49,082][123091] Updated weights for policy 0, policy_version 737562 (0.0005) [2023-12-26 05:28:49,140][123091] Updated weights for policy 0, policy_version 737572 (0.0005) [2023-12-26 05:28:49,197][123091] Updated weights for policy 0, policy_version 737582 (0.0005) [2023-12-26 05:28:49,474][123090] Updated weights for policy 1, policy_version 732898 (0.0009) [2023-12-26 05:28:49,526][123090] Updated weights for policy 1, policy_version 732908 (0.0008) [2023-12-26 05:28:49,574][123090] Updated weights for policy 1, policy_version 732918 (0.0009) [2023-12-26 05:28:49,622][123090] Updated weights for policy 1, policy_version 732928 (0.0009) [2023-12-26 05:28:49,964][123091] Updated weights for policy 0, policy_version 737592 (0.0008) [2023-12-26 05:28:50,021][123091] Updated weights for policy 0, policy_version 737602 (0.0010) [2023-12-26 05:28:50,085][123091] Updated weights for policy 0, policy_version 737612 (0.0010) [2023-12-26 05:28:50,499][123090] Updated weights for policy 1, policy_version 732938 (0.0009) [2023-12-26 05:28:50,550][123090] Updated weights for policy 1, policy_version 732949 (0.0009) [2023-12-26 05:28:50,615][123090] Updated weights for policy 1, policy_version 732959 (0.0008) [2023-12-26 05:28:50,905][123091] Updated weights for policy 0, policy_version 737622 (0.0008) [2023-12-26 05:28:50,972][123091] Updated weights for policy 0, policy_version 737632 (0.0009) [2023-12-26 05:28:51,047][123091] Updated weights for policy 0, policy_version 737642 (0.0009) [2023-12-26 05:28:51,482][123090] Updated weights for policy 1, policy_version 732969 (0.0010) [2023-12-26 05:28:51,557][123090] Updated weights for policy 1, policy_version 732979 (0.0010) [2023-12-26 05:28:51,623][123090] Updated weights for policy 1, policy_version 732989 (0.0010) [2023-12-26 05:28:51,820][123091] Updated weights for policy 0, policy_version 737652 (0.0009) [2023-12-26 05:28:51,881][123091] Updated weights for policy 0, policy_version 737662 (0.0010) [2023-12-26 05:28:51,932][123091] Updated weights for policy 0, policy_version 737672 (0.0010) [2023-12-26 05:28:52,495][123090] Updated weights for policy 1, policy_version 732999 (0.0010) [2023-12-26 05:28:52,561][123090] Updated weights for policy 1, policy_version 733009 (0.0009) [2023-12-26 05:28:52,626][123090] Updated weights for policy 1, policy_version 733019 (0.0009) [2023-12-26 05:28:52,786][123091] Updated weights for policy 0, policy_version 737682 (0.0009) [2023-12-26 05:28:52,855][123091] Updated weights for policy 0, policy_version 737692 (0.0009) [2023-12-26 05:28:52,906][123091] Updated weights for policy 0, policy_version 737702 (0.0010) [2023-12-26 05:28:52,957][123091] Updated weights for policy 0, policy_version 737712 (0.0010) [2023-12-26 05:28:53,391][123090] Updated weights for policy 1, policy_version 733029 (0.0009) [2023-12-26 05:28:53,450][123090] Updated weights for policy 1, policy_version 733039 (0.0009) [2023-12-26 05:28:53,515][123090] Updated weights for policy 1, policy_version 733049 (0.0010) [2023-12-26 05:28:53,783][123091] Updated weights for policy 0, policy_version 737722 (0.0010) [2023-12-26 05:28:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 376520704. Throughput: 0: 9071.1, 1: 8592.5. Samples: 376498968. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:53,785][121949] Avg episode reward: [(0, '6092.067'), (1, '5618.270')] [2023-12-26 05:28:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000733056_187662336.pth... [2023-12-26 05:28:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000732064_187408384.pth [2023-12-26 05:28:53,844][123091] Updated weights for policy 0, policy_version 737732 (0.0009) [2023-12-26 05:28:53,902][123091] Updated weights for policy 0, policy_version 737742 (0.0010) [2023-12-26 05:28:53,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000737744_188866560.pth... [2023-12-26 05:28:53,915][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000736688_188596224.pth [2023-12-26 05:28:54,288][123090] Updated weights for policy 1, policy_version 733059 (0.0009) [2023-12-26 05:28:54,344][123090] Updated weights for policy 1, policy_version 733069 (0.0005) [2023-12-26 05:28:54,408][123090] Updated weights for policy 1, policy_version 733079 (0.0005) [2023-12-26 05:28:54,721][123091] Updated weights for policy 0, policy_version 737752 (0.0011) [2023-12-26 05:28:54,768][123091] Updated weights for policy 0, policy_version 737762 (0.0010) [2023-12-26 05:28:54,823][123091] Updated weights for policy 0, policy_version 737772 (0.0010) [2023-12-26 05:28:55,181][123090] Updated weights for policy 1, policy_version 733089 (0.0006) [2023-12-26 05:28:55,239][123090] Updated weights for policy 1, policy_version 733099 (0.0010) [2023-12-26 05:28:55,286][123090] Updated weights for policy 1, policy_version 733109 (0.0010) [2023-12-26 05:28:55,329][123090] Updated weights for policy 1, policy_version 733119 (0.0010) [2023-12-26 05:28:55,664][123091] Updated weights for policy 0, policy_version 737782 (0.0010) [2023-12-26 05:28:55,721][123091] Updated weights for policy 0, policy_version 737792 (0.0010) [2023-12-26 05:28:55,783][123091] Updated weights for policy 0, policy_version 737802 (0.0010) [2023-12-26 05:28:56,166][123090] Updated weights for policy 1, policy_version 733129 (0.0010) [2023-12-26 05:28:56,217][123090] Updated weights for policy 1, policy_version 733139 (0.0010) [2023-12-26 05:28:56,268][123090] Updated weights for policy 1, policy_version 733149 (0.0010) [2023-12-26 05:28:56,514][123091] Updated weights for policy 0, policy_version 737812 (0.0010) [2023-12-26 05:28:56,565][123091] Updated weights for policy 0, policy_version 737822 (0.0011) [2023-12-26 05:28:56,624][123091] Updated weights for policy 0, policy_version 737832 (0.0011) [2023-12-26 05:28:57,115][123090] Updated weights for policy 1, policy_version 733159 (0.0010) [2023-12-26 05:28:57,183][123090] Updated weights for policy 1, policy_version 733169 (0.0009) [2023-12-26 05:28:57,233][123090] Updated weights for policy 1, policy_version 733179 (0.0009) [2023-12-26 05:28:57,447][123091] Updated weights for policy 0, policy_version 737842 (0.0010) [2023-12-26 05:28:57,500][123091] Updated weights for policy 0, policy_version 737852 (0.0009) [2023-12-26 05:28:57,554][123091] Updated weights for policy 0, policy_version 737862 (0.0009) [2023-12-26 05:28:57,605][123091] Updated weights for policy 0, policy_version 737872 (0.0009) [2023-12-26 05:28:58,051][123090] Updated weights for policy 1, policy_version 733190 (0.0009) [2023-12-26 05:28:58,111][123090] Updated weights for policy 1, policy_version 733200 (0.0009) [2023-12-26 05:28:58,168][123090] Updated weights for policy 1, policy_version 733210 (0.0009) [2023-12-26 05:28:58,479][123091] Updated weights for policy 0, policy_version 737882 (0.0010) [2023-12-26 05:28:58,546][123091] Updated weights for policy 0, policy_version 737892 (0.0010) [2023-12-26 05:28:58,604][123091] Updated weights for policy 0, policy_version 737902 (0.0011) [2023-12-26 05:28:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 376610816. Throughput: 0: 9037.0, 1: 8619.9. Samples: 376603964. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:28:58,785][121949] Avg episode reward: [(0, '6185.788'), (1, '5749.044')] [2023-12-26 05:28:59,104][123090] Updated weights for policy 1, policy_version 733220 (0.0009) [2023-12-26 05:28:59,156][123090] Updated weights for policy 1, policy_version 733230 (0.0009) [2023-12-26 05:28:59,205][123090] Updated weights for policy 1, policy_version 733240 (0.0009) [2023-12-26 05:28:59,442][123091] Updated weights for policy 0, policy_version 737912 (0.0009) [2023-12-26 05:28:59,496][123091] Updated weights for policy 0, policy_version 737922 (0.0009) [2023-12-26 05:28:59,549][123091] Updated weights for policy 0, policy_version 737932 (0.0009) [2023-12-26 05:29:00,053][123090] Updated weights for policy 1, policy_version 733250 (0.0010) [2023-12-26 05:29:00,122][123090] Updated weights for policy 1, policy_version 733260 (0.0010) [2023-12-26 05:29:00,182][123090] Updated weights for policy 1, policy_version 733270 (0.0010) [2023-12-26 05:29:00,248][123090] Updated weights for policy 1, policy_version 733280 (0.0009) [2023-12-26 05:29:00,366][123091] Updated weights for policy 0, policy_version 737942 (0.0009) [2023-12-26 05:29:00,419][123091] Updated weights for policy 0, policy_version 737952 (0.0010) [2023-12-26 05:29:00,483][123091] Updated weights for policy 0, policy_version 737962 (0.0011) [2023-12-26 05:29:00,958][123090] Updated weights for policy 1, policy_version 733290 (0.0006) [2023-12-26 05:29:01,027][123090] Updated weights for policy 1, policy_version 733300 (0.0006) [2023-12-26 05:29:01,084][123090] Updated weights for policy 1, policy_version 733310 (0.0008) [2023-12-26 05:29:01,357][123091] Updated weights for policy 0, policy_version 737972 (0.0010) [2023-12-26 05:29:01,425][123091] Updated weights for policy 0, policy_version 737982 (0.0009) [2023-12-26 05:29:01,488][123091] Updated weights for policy 0, policy_version 737992 (0.0010) [2023-12-26 05:29:01,824][123090] Updated weights for policy 1, policy_version 733320 (0.0005) [2023-12-26 05:29:01,887][123090] Updated weights for policy 1, policy_version 733330 (0.0008) [2023-12-26 05:29:01,945][123090] Updated weights for policy 1, policy_version 733340 (0.0008) [2023-12-26 05:29:02,381][123091] Updated weights for policy 0, policy_version 738002 (0.0009) [2023-12-26 05:29:02,443][123091] Updated weights for policy 0, policy_version 738012 (0.0007) [2023-12-26 05:29:02,498][123091] Updated weights for policy 0, policy_version 738022 (0.0008) [2023-12-26 05:29:02,549][123091] Updated weights for policy 0, policy_version 738032 (0.0005) [2023-12-26 05:29:02,769][123090] Updated weights for policy 1, policy_version 733350 (0.0010) [2023-12-26 05:29:02,839][123090] Updated weights for policy 1, policy_version 733360 (0.0010) [2023-12-26 05:29:02,906][123090] Updated weights for policy 1, policy_version 733370 (0.0010) [2023-12-26 05:29:03,263][123091] Updated weights for policy 0, policy_version 738042 (0.0009) [2023-12-26 05:29:03,327][123091] Updated weights for policy 0, policy_version 738052 (0.0008) [2023-12-26 05:29:03,377][123091] Updated weights for policy 0, policy_version 738062 (0.0005) [2023-12-26 05:29:03,718][123090] Updated weights for policy 1, policy_version 733380 (0.0010) [2023-12-26 05:29:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 376692736. Throughput: 0: 8862.7, 1: 8491.8. Samples: 376708272. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:03,784][121949] Avg episode reward: [(0, '6215.703'), (1, '5822.661')] [2023-12-26 05:29:03,787][123090] Updated weights for policy 1, policy_version 733390 (0.0009) [2023-12-26 05:29:03,857][123090] Updated weights for policy 1, policy_version 733400 (0.0009) [2023-12-26 05:29:04,137][123091] Updated weights for policy 0, policy_version 738072 (0.0008) [2023-12-26 05:29:04,200][123091] Updated weights for policy 0, policy_version 738082 (0.0009) [2023-12-26 05:29:04,268][123091] Updated weights for policy 0, policy_version 738092 (0.0010) [2023-12-26 05:29:04,622][123090] Updated weights for policy 1, policy_version 733410 (0.0008) [2023-12-26 05:29:04,693][123090] Updated weights for policy 1, policy_version 733420 (0.0009) [2023-12-26 05:29:04,755][123090] Updated weights for policy 1, policy_version 733430 (0.0010) [2023-12-26 05:29:04,821][123090] Updated weights for policy 1, policy_version 733440 (0.0010) [2023-12-26 05:29:05,143][123091] Updated weights for policy 0, policy_version 738102 (0.0010) [2023-12-26 05:29:05,206][123091] Updated weights for policy 0, policy_version 738112 (0.0009) [2023-12-26 05:29:05,259][123091] Updated weights for policy 0, policy_version 738122 (0.0009) [2023-12-26 05:29:05,604][123090] Updated weights for policy 1, policy_version 733450 (0.0010) [2023-12-26 05:29:05,672][123090] Updated weights for policy 1, policy_version 733460 (0.0007) [2023-12-26 05:29:05,738][123090] Updated weights for policy 1, policy_version 733470 (0.0006) [2023-12-26 05:29:06,142][123091] Updated weights for policy 0, policy_version 738132 (0.0008) [2023-12-26 05:29:06,209][123091] Updated weights for policy 0, policy_version 738142 (0.0010) [2023-12-26 05:29:06,284][123091] Updated weights for policy 0, policy_version 738152 (0.0010) [2023-12-26 05:29:06,343][123090] Updated weights for policy 1, policy_version 733480 (0.0006) [2023-12-26 05:29:06,416][123090] Updated weights for policy 1, policy_version 733490 (0.0008) [2023-12-26 05:29:06,484][123090] Updated weights for policy 1, policy_version 733500 (0.0011) [2023-12-26 05:29:07,100][123090] Updated weights for policy 1, policy_version 733510 (0.0007) [2023-12-26 05:29:07,147][123090] Updated weights for policy 1, policy_version 733520 (0.0005) [2023-12-26 05:29:07,200][123091] Updated weights for policy 0, policy_version 738162 (0.0010) [2023-12-26 05:29:07,216][123090] Updated weights for policy 1, policy_version 733530 (0.0006) [2023-12-26 05:29:07,255][123091] Updated weights for policy 0, policy_version 738172 (0.0008) [2023-12-26 05:29:07,307][123091] Updated weights for policy 0, policy_version 738182 (0.0009) [2023-12-26 05:29:07,915][123090] Updated weights for policy 1, policy_version 733540 (0.0005) [2023-12-26 05:29:07,972][123090] Updated weights for policy 1, policy_version 733550 (0.0005) [2023-12-26 05:29:08,031][123090] Updated weights for policy 1, policy_version 733560 (0.0008) [2023-12-26 05:29:08,184][123091] Updated weights for policy 0, policy_version 738193 (0.0009) [2023-12-26 05:29:08,238][123091] Updated weights for policy 0, policy_version 738203 (0.0005) [2023-12-26 05:29:08,293][123091] Updated weights for policy 0, policy_version 738213 (0.0006) [2023-12-26 05:29:08,362][123091] Updated weights for policy 0, policy_version 738223 (0.0007) [2023-12-26 05:29:08,770][123090] Updated weights for policy 1, policy_version 733570 (0.0009) [2023-12-26 05:29:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 376782848. Throughput: 0: 8802.1, 1: 8509.8. Samples: 376759864. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:08,785][121949] Avg episode reward: [(0, '6234.999'), (1, '5725.417')] [2023-12-26 05:29:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000738224_188989440.pth... [2023-12-26 05:29:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000737232_188735488.pth [2023-12-26 05:29:08,843][123090] Updated weights for policy 1, policy_version 733580 (0.0006) [2023-12-26 05:29:08,902][123090] Updated weights for policy 1, policy_version 733590 (0.0006) [2023-12-26 05:29:08,954][123090] Updated weights for policy 1, policy_version 733600 (0.0006) [2023-12-26 05:29:08,954][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000733600_187801600.pth... [2023-12-26 05:29:08,957][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000732576_187539456.pth [2023-12-26 05:29:09,022][123091] Updated weights for policy 0, policy_version 738233 (0.0006) [2023-12-26 05:29:09,085][123091] Updated weights for policy 0, policy_version 738243 (0.0006) [2023-12-26 05:29:09,159][123091] Updated weights for policy 0, policy_version 738253 (0.0006) [2023-12-26 05:29:09,724][123090] Updated weights for policy 1, policy_version 733610 (0.0009) [2023-12-26 05:29:09,785][123090] Updated weights for policy 1, policy_version 733620 (0.0009) [2023-12-26 05:29:09,856][123090] Updated weights for policy 1, policy_version 733630 (0.0009) [2023-12-26 05:29:09,862][123091] Updated weights for policy 0, policy_version 738263 (0.0008) [2023-12-26 05:29:09,933][123091] Updated weights for policy 0, policy_version 738273 (0.0009) [2023-12-26 05:29:09,993][123091] Updated weights for policy 0, policy_version 738283 (0.0010) [2023-12-26 05:29:10,690][123090] Updated weights for policy 1, policy_version 733640 (0.0006) [2023-12-26 05:29:10,723][123091] Updated weights for policy 0, policy_version 738293 (0.0008) [2023-12-26 05:29:10,739][123090] Updated weights for policy 1, policy_version 733650 (0.0009) [2023-12-26 05:29:10,773][123091] Updated weights for policy 0, policy_version 738303 (0.0009) [2023-12-26 05:29:10,790][123090] Updated weights for policy 1, policy_version 733660 (0.0005) [2023-12-26 05:29:10,834][123091] Updated weights for policy 0, policy_version 738313 (0.0008) [2023-12-26 05:29:11,634][123090] Updated weights for policy 1, policy_version 733670 (0.0008) [2023-12-26 05:29:11,699][123090] Updated weights for policy 1, policy_version 733680 (0.0010) [2023-12-26 05:29:11,724][123091] Updated weights for policy 0, policy_version 738323 (0.0009) [2023-12-26 05:29:11,771][123090] Updated weights for policy 1, policy_version 733690 (0.0010) [2023-12-26 05:29:11,795][123091] Updated weights for policy 0, policy_version 738333 (0.0008) [2023-12-26 05:29:11,863][123091] Updated weights for policy 0, policy_version 738343 (0.0007) [2023-12-26 05:29:12,601][123090] Updated weights for policy 1, policy_version 733700 (0.0008) [2023-12-26 05:29:12,661][123090] Updated weights for policy 1, policy_version 733710 (0.0009) [2023-12-26 05:29:12,696][123091] Updated weights for policy 0, policy_version 738353 (0.0009) [2023-12-26 05:29:12,715][123090] Updated weights for policy 1, policy_version 733720 (0.0007) [2023-12-26 05:29:12,749][123091] Updated weights for policy 0, policy_version 738363 (0.0008) [2023-12-26 05:29:12,812][123091] Updated weights for policy 0, policy_version 738373 (0.0009) [2023-12-26 05:29:12,873][123091] Updated weights for policy 0, policy_version 738383 (0.0009) [2023-12-26 05:29:13,468][123090] Updated weights for policy 1, policy_version 733730 (0.0009) [2023-12-26 05:29:13,523][123090] Updated weights for policy 1, policy_version 733740 (0.0005) [2023-12-26 05:29:13,573][123090] Updated weights for policy 1, policy_version 733750 (0.0005) [2023-12-26 05:29:13,635][123090] Updated weights for policy 1, policy_version 733760 (0.0006) [2023-12-26 05:29:13,752][123091] Updated weights for policy 0, policy_version 738393 (0.0009) [2023-12-26 05:29:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 376872960. Throughput: 0: 8805.2, 1: 8552.9. Samples: 376867424. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:13,785][121949] Avg episode reward: [(0, '6264.345'), (1, '5661.941')] [2023-12-26 05:29:13,811][123091] Updated weights for policy 0, policy_version 738404 (0.0010) [2023-12-26 05:29:13,873][123091] Updated weights for policy 0, policy_version 738414 (0.0010) [2023-12-26 05:29:14,331][123090] Updated weights for policy 1, policy_version 733770 (0.0005) [2023-12-26 05:29:14,396][123090] Updated weights for policy 1, policy_version 733780 (0.0008) [2023-12-26 05:29:14,457][123090] Updated weights for policy 1, policy_version 733790 (0.0011) [2023-12-26 05:29:14,833][123091] Updated weights for policy 0, policy_version 738424 (0.0009) [2023-12-26 05:29:14,892][123091] Updated weights for policy 0, policy_version 738434 (0.0010) [2023-12-26 05:29:14,954][123091] Updated weights for policy 0, policy_version 738444 (0.0010) [2023-12-26 05:29:15,180][123090] Updated weights for policy 1, policy_version 733800 (0.0008) [2023-12-26 05:29:15,237][123090] Updated weights for policy 1, policy_version 733810 (0.0006) [2023-12-26 05:29:15,298][123090] Updated weights for policy 1, policy_version 733820 (0.0007) [2023-12-26 05:29:15,708][123091] Updated weights for policy 0, policy_version 738454 (0.0007) [2023-12-26 05:29:15,754][123091] Updated weights for policy 0, policy_version 738464 (0.0005) [2023-12-26 05:29:15,801][123091] Updated weights for policy 0, policy_version 738474 (0.0005) [2023-12-26 05:29:15,950][123090] Updated weights for policy 1, policy_version 733830 (0.0006) [2023-12-26 05:29:16,006][123090] Updated weights for policy 1, policy_version 733840 (0.0005) [2023-12-26 05:29:16,073][123090] Updated weights for policy 1, policy_version 733850 (0.0005) [2023-12-26 05:29:16,395][123091] Updated weights for policy 0, policy_version 738484 (0.0005) [2023-12-26 05:29:16,465][123091] Updated weights for policy 0, policy_version 738494 (0.0006) [2023-12-26 05:29:16,520][123091] Updated weights for policy 0, policy_version 738504 (0.0009) [2023-12-26 05:29:16,844][123090] Updated weights for policy 1, policy_version 733860 (0.0007) [2023-12-26 05:29:16,895][123090] Updated weights for policy 1, policy_version 733870 (0.0010) [2023-12-26 05:29:16,951][123090] Updated weights for policy 1, policy_version 733880 (0.0010) [2023-12-26 05:29:17,314][123091] Updated weights for policy 0, policy_version 738514 (0.0009) [2023-12-26 05:29:17,370][123091] Updated weights for policy 0, policy_version 738524 (0.0010) [2023-12-26 05:29:17,418][123091] Updated weights for policy 0, policy_version 738534 (0.0009) [2023-12-26 05:29:17,467][123091] Updated weights for policy 0, policy_version 738544 (0.0010) [2023-12-26 05:29:17,762][123090] Updated weights for policy 1, policy_version 733890 (0.0009) [2023-12-26 05:29:17,838][123090] Updated weights for policy 1, policy_version 733900 (0.0008) [2023-12-26 05:29:17,900][123090] Updated weights for policy 1, policy_version 733910 (0.0009) [2023-12-26 05:29:17,948][123090] Updated weights for policy 1, policy_version 733920 (0.0010) [2023-12-26 05:29:18,297][123091] Updated weights for policy 0, policy_version 738554 (0.0005) [2023-12-26 05:29:18,359][123091] Updated weights for policy 0, policy_version 738564 (0.0006) [2023-12-26 05:29:18,426][123091] Updated weights for policy 0, policy_version 738574 (0.0006) [2023-12-26 05:29:18,701][123090] Updated weights for policy 1, policy_version 733930 (0.0005) [2023-12-26 05:29:18,765][123090] Updated weights for policy 1, policy_version 733940 (0.0007) [2023-12-26 05:29:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 376963072. Throughput: 0: 8762.6, 1: 8709.6. Samples: 376977556. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:18,785][121949] Avg episode reward: [(0, '6240.445'), (1, '5780.330')] [2023-12-26 05:29:18,831][123090] Updated weights for policy 1, policy_version 733950 (0.0009) [2023-12-26 05:29:19,175][123091] Updated weights for policy 0, policy_version 738584 (0.0009) [2023-12-26 05:29:19,250][123091] Updated weights for policy 0, policy_version 738594 (0.0009) [2023-12-26 05:29:19,307][123091] Updated weights for policy 0, policy_version 738604 (0.0009) [2023-12-26 05:29:19,599][123090] Updated weights for policy 1, policy_version 733960 (0.0006) [2023-12-26 05:29:19,648][123090] Updated weights for policy 1, policy_version 733970 (0.0006) [2023-12-26 05:29:19,707][123090] Updated weights for policy 1, policy_version 733980 (0.0009) [2023-12-26 05:29:20,205][123091] Updated weights for policy 0, policy_version 738614 (0.0008) [2023-12-26 05:29:20,284][123091] Updated weights for policy 0, policy_version 738624 (0.0009) [2023-12-26 05:29:20,349][123091] Updated weights for policy 0, policy_version 738634 (0.0006) [2023-12-26 05:29:20,396][123090] Updated weights for policy 1, policy_version 733990 (0.0009) [2023-12-26 05:29:20,465][123090] Updated weights for policy 1, policy_version 734000 (0.0009) [2023-12-26 05:29:20,545][123090] Updated weights for policy 1, policy_version 734010 (0.0009) [2023-12-26 05:29:21,056][123091] Updated weights for policy 0, policy_version 738644 (0.0008) [2023-12-26 05:29:21,119][123091] Updated weights for policy 0, policy_version 738654 (0.0011) [2023-12-26 05:29:21,191][123091] Updated weights for policy 0, policy_version 738664 (0.0011) [2023-12-26 05:29:21,328][123090] Updated weights for policy 1, policy_version 734020 (0.0009) [2023-12-26 05:29:21,396][123090] Updated weights for policy 1, policy_version 734030 (0.0010) [2023-12-26 05:29:21,462][123090] Updated weights for policy 1, policy_version 734040 (0.0009) [2023-12-26 05:29:22,016][123091] Updated weights for policy 0, policy_version 738674 (0.0007) [2023-12-26 05:29:22,085][123091] Updated weights for policy 0, policy_version 738684 (0.0009) [2023-12-26 05:29:22,154][123091] Updated weights for policy 0, policy_version 738694 (0.0008) [2023-12-26 05:29:22,224][123091] Updated weights for policy 0, policy_version 738704 (0.0008) [2023-12-26 05:29:22,342][123090] Updated weights for policy 1, policy_version 734050 (0.0009) [2023-12-26 05:29:22,417][123090] Updated weights for policy 1, policy_version 734060 (0.0009) [2023-12-26 05:29:22,490][123090] Updated weights for policy 1, policy_version 734070 (0.0009) [2023-12-26 05:29:22,555][123090] Updated weights for policy 1, policy_version 734080 (0.0009) [2023-12-26 05:29:23,003][123091] Updated weights for policy 0, policy_version 738714 (0.0011) [2023-12-26 05:29:23,074][123091] Updated weights for policy 0, policy_version 738724 (0.0011) [2023-12-26 05:29:23,144][123091] Updated weights for policy 0, policy_version 738734 (0.0011) [2023-12-26 05:29:23,371][123090] Updated weights for policy 1, policy_version 734090 (0.0009) [2023-12-26 05:29:23,427][123090] Updated weights for policy 1, policy_version 734100 (0.0010) [2023-12-26 05:29:23,482][123090] Updated weights for policy 1, policy_version 734110 (0.0010) [2023-12-26 05:29:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 377053184. Throughput: 0: 8734.3, 1: 8755.8. Samples: 377030348. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:23,785][121949] Avg episode reward: [(0, '6104.326'), (1, '5791.791')] [2023-12-26 05:29:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000738736_189120512.pth... [2023-12-26 05:29:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000734112_187932672.pth... [2023-12-26 05:29:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000737744_188866560.pth [2023-12-26 05:29:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000733056_187662336.pth [2023-12-26 05:29:23,948][123091] Updated weights for policy 0, policy_version 738744 (0.0006) [2023-12-26 05:29:24,008][123091] Updated weights for policy 0, policy_version 738754 (0.0005) [2023-12-26 05:29:24,065][123091] Updated weights for policy 0, policy_version 738764 (0.0010) [2023-12-26 05:29:24,293][123090] Updated weights for policy 1, policy_version 734120 (0.0006) [2023-12-26 05:29:24,353][123090] Updated weights for policy 1, policy_version 734130 (0.0006) [2023-12-26 05:29:24,416][123090] Updated weights for policy 1, policy_version 734140 (0.0010) [2023-12-26 05:29:24,850][123091] Updated weights for policy 0, policy_version 738774 (0.0010) [2023-12-26 05:29:24,904][123091] Updated weights for policy 0, policy_version 738784 (0.0010) [2023-12-26 05:29:24,964][123091] Updated weights for policy 0, policy_version 738794 (0.0009) [2023-12-26 05:29:25,148][123090] Updated weights for policy 1, policy_version 734150 (0.0009) [2023-12-26 05:29:25,192][123090] Updated weights for policy 1, policy_version 734160 (0.0010) [2023-12-26 05:29:25,243][123090] Updated weights for policy 1, policy_version 734170 (0.0010) [2023-12-26 05:29:25,683][123091] Updated weights for policy 0, policy_version 738804 (0.0007) [2023-12-26 05:29:25,733][123091] Updated weights for policy 0, policy_version 738814 (0.0005) [2023-12-26 05:29:25,781][123091] Updated weights for policy 0, policy_version 738824 (0.0005) [2023-12-26 05:29:26,016][123090] Updated weights for policy 1, policy_version 734180 (0.0008) [2023-12-26 05:29:26,085][123090] Updated weights for policy 1, policy_version 734190 (0.0005) [2023-12-26 05:29:26,143][123090] Updated weights for policy 1, policy_version 734200 (0.0005) [2023-12-26 05:29:26,634][123091] Updated weights for policy 0, policy_version 738834 (0.0006) [2023-12-26 05:29:26,689][123091] Updated weights for policy 0, policy_version 738844 (0.0009) [2023-12-26 05:29:26,739][123091] Updated weights for policy 0, policy_version 738855 (0.0010) [2023-12-26 05:29:26,835][123090] Updated weights for policy 1, policy_version 734210 (0.0006) [2023-12-26 05:29:26,904][123090] Updated weights for policy 1, policy_version 734220 (0.0010) [2023-12-26 05:29:26,965][123090] Updated weights for policy 1, policy_version 734230 (0.0010) [2023-12-26 05:29:27,027][123090] Updated weights for policy 1, policy_version 734240 (0.0010) [2023-12-26 05:29:27,598][123091] Updated weights for policy 0, policy_version 738866 (0.0009) [2023-12-26 05:29:27,648][123091] Updated weights for policy 0, policy_version 738876 (0.0009) [2023-12-26 05:29:27,697][123091] Updated weights for policy 0, policy_version 738886 (0.0009) [2023-12-26 05:29:27,746][123091] Updated weights for policy 0, policy_version 738896 (0.0008) [2023-12-26 05:29:27,835][123090] Updated weights for policy 1, policy_version 734250 (0.0010) [2023-12-26 05:29:27,893][123090] Updated weights for policy 1, policy_version 734260 (0.0010) [2023-12-26 05:29:27,952][123090] Updated weights for policy 1, policy_version 734270 (0.0010) [2023-12-26 05:29:28,529][123091] Updated weights for policy 0, policy_version 738906 (0.0005) [2023-12-26 05:29:28,585][123091] Updated weights for policy 0, policy_version 738916 (0.0005) [2023-12-26 05:29:28,646][123091] Updated weights for policy 0, policy_version 738926 (0.0008) [2023-12-26 05:29:28,663][123090] Updated weights for policy 1, policy_version 734280 (0.0007) [2023-12-26 05:29:28,725][123090] Updated weights for policy 1, policy_version 734290 (0.0005) [2023-12-26 05:29:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 377143296. Throughput: 0: 8761.6, 1: 8883.3. Samples: 377138196. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:28,784][121949] Avg episode reward: [(0, '6104.193'), (1, '5773.346')] [2023-12-26 05:29:28,792][123090] Updated weights for policy 1, policy_version 734300 (0.0005) [2023-12-26 05:29:29,325][123091] Updated weights for policy 0, policy_version 738936 (0.0010) [2023-12-26 05:29:29,397][123091] Updated weights for policy 0, policy_version 738946 (0.0011) [2023-12-26 05:29:29,452][123091] Updated weights for policy 0, policy_version 738956 (0.0010) [2023-12-26 05:29:29,525][123090] Updated weights for policy 1, policy_version 734310 (0.0009) [2023-12-26 05:29:29,592][123090] Updated weights for policy 1, policy_version 734320 (0.0009) [2023-12-26 05:29:29,658][123090] Updated weights for policy 1, policy_version 734330 (0.0010) [2023-12-26 05:29:30,245][123091] Updated weights for policy 0, policy_version 738966 (0.0011) [2023-12-26 05:29:30,314][123091] Updated weights for policy 0, policy_version 738976 (0.0010) [2023-12-26 05:29:30,373][123091] Updated weights for policy 0, policy_version 738986 (0.0011) [2023-12-26 05:29:30,418][123090] Updated weights for policy 1, policy_version 734340 (0.0010) [2023-12-26 05:29:30,485][123090] Updated weights for policy 1, policy_version 734350 (0.0010) [2023-12-26 05:29:30,536][123090] Updated weights for policy 1, policy_version 734360 (0.0010) [2023-12-26 05:29:31,174][123091] Updated weights for policy 0, policy_version 738996 (0.0010) [2023-12-26 05:29:31,240][123091] Updated weights for policy 0, policy_version 739006 (0.0011) [2023-12-26 05:29:31,309][123091] Updated weights for policy 0, policy_version 739016 (0.0011) [2023-12-26 05:29:31,358][123090] Updated weights for policy 1, policy_version 734370 (0.0014) [2023-12-26 05:29:31,424][123090] Updated weights for policy 1, policy_version 734380 (0.0009) [2023-12-26 05:29:31,492][123090] Updated weights for policy 1, policy_version 734390 (0.0011) [2023-12-26 05:29:31,568][123090] Updated weights for policy 1, policy_version 734400 (0.0011) [2023-12-26 05:29:32,085][123091] Updated weights for policy 0, policy_version 739026 (0.0009) [2023-12-26 05:29:32,145][123091] Updated weights for policy 0, policy_version 739036 (0.0008) [2023-12-26 05:29:32,201][123091] Updated weights for policy 0, policy_version 739046 (0.0009) [2023-12-26 05:29:32,251][123091] Updated weights for policy 0, policy_version 739056 (0.0009) [2023-12-26 05:29:32,407][123090] Updated weights for policy 1, policy_version 734410 (0.0010) [2023-12-26 05:29:32,473][123090] Updated weights for policy 1, policy_version 734420 (0.0010) [2023-12-26 05:29:32,532][123090] Updated weights for policy 1, policy_version 734430 (0.0010) [2023-12-26 05:29:33,091][123091] Updated weights for policy 0, policy_version 739066 (0.0009) [2023-12-26 05:29:33,145][123091] Updated weights for policy 0, policy_version 739076 (0.0006) [2023-12-26 05:29:33,192][123091] Updated weights for policy 0, policy_version 739086 (0.0007) [2023-12-26 05:29:33,335][123090] Updated weights for policy 1, policy_version 734440 (0.0010) [2023-12-26 05:29:33,381][123090] Updated weights for policy 1, policy_version 734450 (0.0010) [2023-12-26 05:29:33,428][123090] Updated weights for policy 1, policy_version 734460 (0.0010) [2023-12-26 05:29:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 377233408. Throughput: 0: 8775.0, 1: 8942.2. Samples: 377245152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:33,785][121949] Avg episode reward: [(0, '6189.623'), (1, '5712.871')] [2023-12-26 05:29:34,070][123091] Updated weights for policy 0, policy_version 739096 (0.0008) [2023-12-26 05:29:34,140][123091] Updated weights for policy 0, policy_version 739106 (0.0008) [2023-12-26 05:29:34,181][123090] Updated weights for policy 1, policy_version 734470 (0.0009) [2023-12-26 05:29:34,206][123091] Updated weights for policy 0, policy_version 739116 (0.0007) [2023-12-26 05:29:34,249][123090] Updated weights for policy 1, policy_version 734480 (0.0008) [2023-12-26 05:29:34,316][123090] Updated weights for policy 1, policy_version 734490 (0.0008) [2023-12-26 05:29:34,944][123091] Updated weights for policy 0, policy_version 739126 (0.0007) [2023-12-26 05:29:35,010][123091] Updated weights for policy 0, policy_version 739136 (0.0008) [2023-12-26 05:29:35,060][123090] Updated weights for policy 1, policy_version 734500 (0.0009) [2023-12-26 05:29:35,078][123091] Updated weights for policy 0, policy_version 739146 (0.0007) [2023-12-26 05:29:35,112][123090] Updated weights for policy 1, policy_version 734510 (0.0010) [2023-12-26 05:29:35,164][123090] Updated weights for policy 1, policy_version 734520 (0.0010) [2023-12-26 05:29:35,792][123091] Updated weights for policy 0, policy_version 739156 (0.0007) [2023-12-26 05:29:35,859][123091] Updated weights for policy 0, policy_version 739166 (0.0008) [2023-12-26 05:29:35,926][123091] Updated weights for policy 0, policy_version 739176 (0.0011) [2023-12-26 05:29:36,001][123090] Updated weights for policy 1, policy_version 734530 (0.0010) [2023-12-26 05:29:36,064][123090] Updated weights for policy 1, policy_version 734540 (0.0010) [2023-12-26 05:29:36,140][123090] Updated weights for policy 1, policy_version 734550 (0.0011) [2023-12-26 05:29:36,211][123090] Updated weights for policy 1, policy_version 734560 (0.0011) [2023-12-26 05:29:36,691][123091] Updated weights for policy 0, policy_version 739186 (0.0011) [2023-12-26 05:29:36,756][123091] Updated weights for policy 0, policy_version 739196 (0.0011) [2023-12-26 05:29:36,822][123091] Updated weights for policy 0, policy_version 739206 (0.0009) [2023-12-26 05:29:36,895][123091] Updated weights for policy 0, policy_version 739216 (0.0006) [2023-12-26 05:29:37,035][123090] Updated weights for policy 1, policy_version 734570 (0.0011) [2023-12-26 05:29:37,087][123090] Updated weights for policy 1, policy_version 734580 (0.0010) [2023-12-26 05:29:37,139][123090] Updated weights for policy 1, policy_version 734590 (0.0010) [2023-12-26 05:29:37,528][123091] Updated weights for policy 0, policy_version 739226 (0.0005) [2023-12-26 05:29:37,589][123091] Updated weights for policy 0, policy_version 739236 (0.0006) [2023-12-26 05:29:37,663][123091] Updated weights for policy 0, policy_version 739246 (0.0006) [2023-12-26 05:29:38,001][123090] Updated weights for policy 1, policy_version 734600 (0.0011) [2023-12-26 05:29:38,071][123090] Updated weights for policy 1, policy_version 734610 (0.0011) [2023-12-26 05:29:38,137][123090] Updated weights for policy 1, policy_version 734620 (0.0009) [2023-12-26 05:29:38,423][123091] Updated weights for policy 0, policy_version 739256 (0.0008) [2023-12-26 05:29:38,483][123091] Updated weights for policy 0, policy_version 739266 (0.0009) [2023-12-26 05:29:38,551][123091] Updated weights for policy 0, policy_version 739276 (0.0009) [2023-12-26 05:29:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 377323520. Throughput: 0: 8770.8, 1: 9008.3. Samples: 377299024. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:38,785][121949] Avg episode reward: [(0, '6179.179'), (1, '5634.808')] [2023-12-26 05:29:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000739280_189259776.pth... [2023-12-26 05:29:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000734624_188063744.pth... [2023-12-26 05:29:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000733600_187801600.pth [2023-12-26 05:29:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000738224_188989440.pth [2023-12-26 05:29:38,945][123090] Updated weights for policy 1, policy_version 734630 (0.0007) [2023-12-26 05:29:39,012][123090] Updated weights for policy 1, policy_version 734640 (0.0005) [2023-12-26 05:29:39,086][123090] Updated weights for policy 1, policy_version 734650 (0.0005) [2023-12-26 05:29:39,389][123091] Updated weights for policy 0, policy_version 739286 (0.0008) [2023-12-26 05:29:39,452][123091] Updated weights for policy 0, policy_version 739296 (0.0008) [2023-12-26 05:29:39,508][123091] Updated weights for policy 0, policy_version 739306 (0.0008) [2023-12-26 05:29:39,829][123090] Updated weights for policy 1, policy_version 734660 (0.0006) [2023-12-26 05:29:39,903][123090] Updated weights for policy 1, policy_version 734670 (0.0008) [2023-12-26 05:29:39,973][123090] Updated weights for policy 1, policy_version 734680 (0.0007) [2023-12-26 05:29:40,355][123091] Updated weights for policy 0, policy_version 739316 (0.0009) [2023-12-26 05:29:40,417][123091] Updated weights for policy 0, policy_version 739326 (0.0010) [2023-12-26 05:29:40,490][123091] Updated weights for policy 0, policy_version 739336 (0.0010) [2023-12-26 05:29:40,663][123090] Updated weights for policy 1, policy_version 734690 (0.0005) [2023-12-26 05:29:40,718][123090] Updated weights for policy 1, policy_version 734700 (0.0005) [2023-12-26 05:29:40,779][123090] Updated weights for policy 1, policy_version 734710 (0.0009) [2023-12-26 05:29:40,827][123090] Updated weights for policy 1, policy_version 734720 (0.0008) [2023-12-26 05:29:41,326][123091] Updated weights for policy 0, policy_version 739346 (0.0010) [2023-12-26 05:29:41,400][123091] Updated weights for policy 0, policy_version 739356 (0.0008) [2023-12-26 05:29:41,452][123091] Updated weights for policy 0, policy_version 739366 (0.0009) [2023-12-26 05:29:41,504][123091] Updated weights for policy 0, policy_version 739376 (0.0010) [2023-12-26 05:29:41,722][123090] Updated weights for policy 1, policy_version 734730 (0.0009) [2023-12-26 05:29:41,798][123090] Updated weights for policy 1, policy_version 734740 (0.0010) [2023-12-26 05:29:41,857][123090] Updated weights for policy 1, policy_version 734750 (0.0010) [2023-12-26 05:29:42,351][123091] Updated weights for policy 0, policy_version 739386 (0.0009) [2023-12-26 05:29:42,420][123091] Updated weights for policy 0, policy_version 739396 (0.0015) [2023-12-26 05:29:42,468][123091] Updated weights for policy 0, policy_version 739406 (0.0008) [2023-12-26 05:29:42,722][123090] Updated weights for policy 1, policy_version 734760 (0.0010) [2023-12-26 05:29:42,781][123090] Updated weights for policy 1, policy_version 734770 (0.0010) [2023-12-26 05:29:42,849][123090] Updated weights for policy 1, policy_version 734780 (0.0010) [2023-12-26 05:29:43,213][123091] Updated weights for policy 0, policy_version 739416 (0.0007) [2023-12-26 05:29:43,269][123091] Updated weights for policy 0, policy_version 739426 (0.0005) [2023-12-26 05:29:43,342][123091] Updated weights for policy 0, policy_version 739436 (0.0007) [2023-12-26 05:29:43,731][123090] Updated weights for policy 1, policy_version 734790 (0.0010) [2023-12-26 05:29:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 377405440. Throughput: 0: 8764.4, 1: 8999.1. Samples: 377403324. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:29:43,785][121949] Avg episode reward: [(0, '6055.107'), (1, '5571.679')] [2023-12-26 05:29:43,824][123090] Updated weights for policy 1, policy_version 734800 (0.0010) [2023-12-26 05:29:43,877][123090] Updated weights for policy 1, policy_version 734810 (0.0010) [2023-12-26 05:29:43,959][123091] Updated weights for policy 0, policy_version 739446 (0.0008) [2023-12-26 05:29:44,002][123091] Updated weights for policy 0, policy_version 739456 (0.0010) [2023-12-26 05:29:44,061][123091] Updated weights for policy 0, policy_version 739466 (0.0010) [2023-12-26 05:29:44,558][123090] Updated weights for policy 1, policy_version 734820 (0.0008) [2023-12-26 05:29:44,621][123090] Updated weights for policy 1, policy_version 734830 (0.0006) [2023-12-26 05:29:44,692][123090] Updated weights for policy 1, policy_version 734840 (0.0010) [2023-12-26 05:29:44,795][123091] Updated weights for policy 0, policy_version 739476 (0.0008) [2023-12-26 05:29:44,866][123091] Updated weights for policy 0, policy_version 739486 (0.0011) [2023-12-26 05:29:44,934][123091] Updated weights for policy 0, policy_version 739496 (0.0011) [2023-12-26 05:29:45,578][123090] Updated weights for policy 1, policy_version 734850 (0.0010) [2023-12-26 05:29:45,609][123091] Updated weights for policy 0, policy_version 739506 (0.0010) [2023-12-26 05:29:45,641][123090] Updated weights for policy 1, policy_version 734860 (0.0009) [2023-12-26 05:29:45,681][123091] Updated weights for policy 0, policy_version 739516 (0.0009) [2023-12-26 05:29:45,718][123090] Updated weights for policy 1, policy_version 734870 (0.0008) [2023-12-26 05:29:45,754][123091] Updated weights for policy 0, policy_version 739526 (0.0008) [2023-12-26 05:29:45,775][123090] Updated weights for policy 1, policy_version 734880 (0.0009) [2023-12-26 05:29:45,820][123091] Updated weights for policy 0, policy_version 739536 (0.0008) [2023-12-26 05:29:46,465][123091] Updated weights for policy 0, policy_version 739546 (0.0005) [2023-12-26 05:29:46,514][123091] Updated weights for policy 0, policy_version 739556 (0.0005) [2023-12-26 05:29:46,558][123091] Updated weights for policy 0, policy_version 739566 (0.0005) [2023-12-26 05:29:46,559][123090] Updated weights for policy 1, policy_version 734890 (0.0009) [2023-12-26 05:29:46,628][123090] Updated weights for policy 1, policy_version 734900 (0.0010) [2023-12-26 05:29:46,705][123090] Updated weights for policy 1, policy_version 734910 (0.0010) [2023-12-26 05:29:47,207][123091] Updated weights for policy 0, policy_version 739576 (0.0010) [2023-12-26 05:29:47,272][123091] Updated weights for policy 0, policy_version 739586 (0.0010) [2023-12-26 05:29:47,329][123091] Updated weights for policy 0, policy_version 739596 (0.0010) [2023-12-26 05:29:47,500][123090] Updated weights for policy 1, policy_version 734920 (0.0009) [2023-12-26 05:29:47,559][123090] Updated weights for policy 1, policy_version 734930 (0.0009) [2023-12-26 05:29:47,623][123090] Updated weights for policy 1, policy_version 734940 (0.0009) [2023-12-26 05:29:48,149][123091] Updated weights for policy 0, policy_version 739606 (0.0010) [2023-12-26 05:29:48,203][123091] Updated weights for policy 0, policy_version 739616 (0.0010) [2023-12-26 05:29:48,257][123091] Updated weights for policy 0, policy_version 739626 (0.0010) [2023-12-26 05:29:48,449][123090] Updated weights for policy 1, policy_version 734950 (0.0009) [2023-12-26 05:29:48,515][123090] Updated weights for policy 1, policy_version 734960 (0.0009) [2023-12-26 05:29:48,573][123090] Updated weights for policy 1, policy_version 734970 (0.0009) [2023-12-26 05:29:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 377503744. Throughput: 0: 8945.7, 1: 8950.7. Samples: 377513612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:29:48,785][121949] Avg episode reward: [(0, '6042.197'), (1, '5715.940')] [2023-12-26 05:29:49,079][123091] Updated weights for policy 0, policy_version 739636 (0.0009) [2023-12-26 05:29:49,147][123091] Updated weights for policy 0, policy_version 739646 (0.0006) [2023-12-26 05:29:49,213][123091] Updated weights for policy 0, policy_version 739656 (0.0006) [2023-12-26 05:29:49,417][123090] Updated weights for policy 1, policy_version 734980 (0.0007) [2023-12-26 05:29:49,483][123090] Updated weights for policy 1, policy_version 734990 (0.0006) [2023-12-26 05:29:49,556][123090] Updated weights for policy 1, policy_version 735000 (0.0006) [2023-12-26 05:29:49,925][123091] Updated weights for policy 0, policy_version 739666 (0.0008) [2023-12-26 05:29:49,986][123091] Updated weights for policy 0, policy_version 739676 (0.0007) [2023-12-26 05:29:50,049][123091] Updated weights for policy 0, policy_version 739686 (0.0010) [2023-12-26 05:29:50,107][123091] Updated weights for policy 0, policy_version 739696 (0.0010) [2023-12-26 05:29:50,299][123090] Updated weights for policy 1, policy_version 735010 (0.0009) [2023-12-26 05:29:50,364][123090] Updated weights for policy 1, policy_version 735020 (0.0005) [2023-12-26 05:29:50,435][123090] Updated weights for policy 1, policy_version 735030 (0.0005) [2023-12-26 05:29:50,491][123090] Updated weights for policy 1, policy_version 735040 (0.0005) [2023-12-26 05:29:50,964][123091] Updated weights for policy 0, policy_version 739706 (0.0008) [2023-12-26 05:29:51,044][123091] Updated weights for policy 0, policy_version 739716 (0.0007) [2023-12-26 05:29:51,110][123091] Updated weights for policy 0, policy_version 739726 (0.0006) [2023-12-26 05:29:51,236][123090] Updated weights for policy 1, policy_version 735050 (0.0010) [2023-12-26 05:29:51,292][123090] Updated weights for policy 1, policy_version 735060 (0.0009) [2023-12-26 05:29:51,349][123090] Updated weights for policy 1, policy_version 735070 (0.0005) [2023-12-26 05:29:51,903][123091] Updated weights for policy 0, policy_version 739736 (0.0009) [2023-12-26 05:29:51,969][123091] Updated weights for policy 0, policy_version 739746 (0.0010) [2023-12-26 05:29:52,024][123091] Updated weights for policy 0, policy_version 739756 (0.0009) [2023-12-26 05:29:52,126][123090] Updated weights for policy 1, policy_version 735080 (0.0006) [2023-12-26 05:29:52,196][123090] Updated weights for policy 1, policy_version 735090 (0.0006) [2023-12-26 05:29:52,268][123090] Updated weights for policy 1, policy_version 735100 (0.0007) [2023-12-26 05:29:52,891][123091] Updated weights for policy 0, policy_version 739766 (0.0009) [2023-12-26 05:29:52,955][123091] Updated weights for policy 0, policy_version 739776 (0.0009) [2023-12-26 05:29:52,994][123090] Updated weights for policy 1, policy_version 735110 (0.0009) [2023-12-26 05:29:53,019][123091] Updated weights for policy 0, policy_version 739786 (0.0007) [2023-12-26 05:29:53,054][123090] Updated weights for policy 1, policy_version 735120 (0.0010) [2023-12-26 05:29:53,120][123090] Updated weights for policy 1, policy_version 735130 (0.0010) [2023-12-26 05:29:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 377585664. Throughput: 0: 8986.2, 1: 8936.5. Samples: 377566384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:29:53,785][121949] Avg episode reward: [(0, '6126.717'), (1, '5733.734')] [2023-12-26 05:29:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000735136_188194816.pth... [2023-12-26 05:29:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000734112_187932672.pth [2023-12-26 05:29:53,808][123091] Updated weights for policy 0, policy_version 739796 (0.0008) [2023-12-26 05:29:53,871][123091] Updated weights for policy 0, policy_version 739806 (0.0009) [2023-12-26 05:29:53,925][123091] Updated weights for policy 0, policy_version 739816 (0.0009) [2023-12-26 05:29:53,931][123090] Updated weights for policy 1, policy_version 735140 (0.0011) [2023-12-26 05:29:53,966][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000739824_189399040.pth... [2023-12-26 05:29:53,970][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000738736_189120512.pth [2023-12-26 05:29:53,990][123090] Updated weights for policy 1, policy_version 735150 (0.0010) [2023-12-26 05:29:54,052][123090] Updated weights for policy 1, policy_version 735160 (0.0010) [2023-12-26 05:29:54,749][123091] Updated weights for policy 0, policy_version 739826 (0.0006) [2023-12-26 05:29:54,762][123090] Updated weights for policy 1, policy_version 735170 (0.0010) [2023-12-26 05:29:54,797][123091] Updated weights for policy 0, policy_version 739836 (0.0005) [2023-12-26 05:29:54,825][123090] Updated weights for policy 1, policy_version 735180 (0.0010) [2023-12-26 05:29:54,849][123091] Updated weights for policy 0, policy_version 739846 (0.0007) [2023-12-26 05:29:54,873][123090] Updated weights for policy 1, policy_version 735190 (0.0009) [2023-12-26 05:29:54,898][123091] Updated weights for policy 0, policy_version 739856 (0.0008) [2023-12-26 05:29:54,940][123090] Updated weights for policy 1, policy_version 735200 (0.0008) [2023-12-26 05:29:55,716][123090] Updated weights for policy 1, policy_version 735210 (0.0010) [2023-12-26 05:29:55,741][123091] Updated weights for policy 0, policy_version 739866 (0.0005) [2023-12-26 05:29:55,776][123090] Updated weights for policy 1, policy_version 735220 (0.0010) [2023-12-26 05:29:55,790][123091] Updated weights for policy 0, policy_version 739876 (0.0006) [2023-12-26 05:29:55,824][123090] Updated weights for policy 1, policy_version 735230 (0.0010) [2023-12-26 05:29:55,839][123091] Updated weights for policy 0, policy_version 739886 (0.0006) [2023-12-26 05:29:56,577][123090] Updated weights for policy 1, policy_version 735240 (0.0006) [2023-12-26 05:29:56,601][123091] Updated weights for policy 0, policy_version 739896 (0.0010) [2023-12-26 05:29:56,625][123090] Updated weights for policy 1, policy_version 735250 (0.0006) [2023-12-26 05:29:56,648][123091] Updated weights for policy 0, policy_version 739906 (0.0010) [2023-12-26 05:29:56,676][123090] Updated weights for policy 1, policy_version 735260 (0.0005) [2023-12-26 05:29:56,692][123091] Updated weights for policy 0, policy_version 739916 (0.0010) [2023-12-26 05:29:57,355][123090] Updated weights for policy 1, policy_version 735270 (0.0008) [2023-12-26 05:29:57,410][123090] Updated weights for policy 1, policy_version 735280 (0.0010) [2023-12-26 05:29:57,454][123091] Updated weights for policy 0, policy_version 739926 (0.0007) [2023-12-26 05:29:57,465][123090] Updated weights for policy 1, policy_version 735290 (0.0010) [2023-12-26 05:29:57,506][123091] Updated weights for policy 0, policy_version 739936 (0.0005) [2023-12-26 05:29:57,567][123091] Updated weights for policy 0, policy_version 739946 (0.0010) [2023-12-26 05:29:58,166][123090] Updated weights for policy 1, policy_version 735300 (0.0010) [2023-12-26 05:29:58,230][123090] Updated weights for policy 1, policy_version 735310 (0.0010) [2023-12-26 05:29:58,293][123090] Updated weights for policy 1, policy_version 735320 (0.0008) [2023-12-26 05:29:58,340][123091] Updated weights for policy 0, policy_version 739956 (0.0010) [2023-12-26 05:29:58,408][123091] Updated weights for policy 0, policy_version 739966 (0.0011) [2023-12-26 05:29:58,480][123091] Updated weights for policy 0, policy_version 739977 (0.0009) [2023-12-26 05:29:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 377683968. Throughput: 0: 8990.2, 1: 8983.3. Samples: 377676232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:29:58,785][121949] Avg episode reward: [(0, '6146.712'), (1, '5725.431')] [2023-12-26 05:29:59,324][123090] Updated weights for policy 1, policy_version 735330 (0.0009) [2023-12-26 05:29:59,394][123090] Updated weights for policy 1, policy_version 735340 (0.0010) [2023-12-26 05:29:59,403][123091] Updated weights for policy 0, policy_version 739987 (0.0012) [2023-12-26 05:29:59,454][123090] Updated weights for policy 1, policy_version 735350 (0.0010) [2023-12-26 05:29:59,469][123091] Updated weights for policy 0, policy_version 739997 (0.0010) [2023-12-26 05:29:59,521][123090] Updated weights for policy 1, policy_version 735360 (0.0010) [2023-12-26 05:29:59,527][123091] Updated weights for policy 0, policy_version 740007 (0.0008) [2023-12-26 05:30:00,229][123091] Updated weights for policy 0, policy_version 740017 (0.0006) [2023-12-26 05:30:00,291][123091] Updated weights for policy 0, policy_version 740027 (0.0008) [2023-12-26 05:30:00,307][123090] Updated weights for policy 1, policy_version 735370 (0.0005) [2023-12-26 05:30:00,354][123091] Updated weights for policy 0, policy_version 740037 (0.0006) [2023-12-26 05:30:00,372][123090] Updated weights for policy 1, policy_version 735380 (0.0008) [2023-12-26 05:30:00,413][123091] Updated weights for policy 0, policy_version 740047 (0.0006) [2023-12-26 05:30:00,435][123090] Updated weights for policy 1, policy_version 735390 (0.0010) [2023-12-26 05:30:01,102][123090] Updated weights for policy 1, policy_version 735400 (0.0011) [2023-12-26 05:30:01,175][123090] Updated weights for policy 1, policy_version 735410 (0.0011) [2023-12-26 05:30:01,194][123091] Updated weights for policy 0, policy_version 740057 (0.0010) [2023-12-26 05:30:01,239][123090] Updated weights for policy 1, policy_version 735420 (0.0010) [2023-12-26 05:30:01,242][123091] Updated weights for policy 0, policy_version 740067 (0.0010) [2023-12-26 05:30:01,313][123091] Updated weights for policy 0, policy_version 740077 (0.0006) [2023-12-26 05:30:02,038][123091] Updated weights for policy 0, policy_version 740087 (0.0007) [2023-12-26 05:30:02,047][123090] Updated weights for policy 1, policy_version 735430 (0.0009) [2023-12-26 05:30:02,091][123091] Updated weights for policy 0, policy_version 740097 (0.0006) [2023-12-26 05:30:02,111][123090] Updated weights for policy 1, policy_version 735440 (0.0008) [2023-12-26 05:30:02,153][123091] Updated weights for policy 0, policy_version 740107 (0.0010) [2023-12-26 05:30:02,178][123090] Updated weights for policy 1, policy_version 735450 (0.0008) [2023-12-26 05:30:02,982][123091] Updated weights for policy 0, policy_version 740117 (0.0008) [2023-12-26 05:30:03,015][123090] Updated weights for policy 1, policy_version 735460 (0.0009) [2023-12-26 05:30:03,047][123091] Updated weights for policy 0, policy_version 740127 (0.0009) [2023-12-26 05:30:03,072][123090] Updated weights for policy 1, policy_version 735470 (0.0007) [2023-12-26 05:30:03,101][123091] Updated weights for policy 0, policy_version 740137 (0.0009) [2023-12-26 05:30:03,131][123090] Updated weights for policy 1, policy_version 735480 (0.0007) [2023-12-26 05:30:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 377765888. Throughput: 0: 8991.9, 1: 8869.0. Samples: 377781296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:03,785][121949] Avg episode reward: [(0, '6050.105'), (1, '5621.295')] [2023-12-26 05:30:03,871][123091] Updated weights for policy 0, policy_version 740147 (0.0010) [2023-12-26 05:30:03,882][123090] Updated weights for policy 1, policy_version 735490 (0.0010) [2023-12-26 05:30:03,942][123090] Updated weights for policy 1, policy_version 735500 (0.0009) [2023-12-26 05:30:03,944][123091] Updated weights for policy 0, policy_version 740157 (0.0006) [2023-12-26 05:30:04,004][123090] Updated weights for policy 1, policy_version 735510 (0.0007) [2023-12-26 05:30:04,010][123091] Updated weights for policy 0, policy_version 740167 (0.0009) [2023-12-26 05:30:04,070][123090] Updated weights for policy 1, policy_version 735520 (0.0007) [2023-12-26 05:30:04,746][123091] Updated weights for policy 0, policy_version 740177 (0.0008) [2023-12-26 05:30:04,799][123091] Updated weights for policy 0, policy_version 740187 (0.0009) [2023-12-26 05:30:04,818][123090] Updated weights for policy 1, policy_version 735530 (0.0006) [2023-12-26 05:30:04,858][123091] Updated weights for policy 0, policy_version 740197 (0.0008) [2023-12-26 05:30:04,873][123090] Updated weights for policy 1, policy_version 735540 (0.0007) [2023-12-26 05:30:04,910][123091] Updated weights for policy 0, policy_version 740207 (0.0006) [2023-12-26 05:30:04,937][123090] Updated weights for policy 1, policy_version 735550 (0.0010) [2023-12-26 05:30:05,723][123090] Updated weights for policy 1, policy_version 735560 (0.0007) [2023-12-26 05:30:05,744][123091] Updated weights for policy 0, policy_version 740217 (0.0009) [2023-12-26 05:30:05,780][123090] Updated weights for policy 1, policy_version 735570 (0.0007) [2023-12-26 05:30:05,799][123091] Updated weights for policy 0, policy_version 740227 (0.0009) [2023-12-26 05:30:05,837][123090] Updated weights for policy 1, policy_version 735580 (0.0007) [2023-12-26 05:30:05,864][123091] Updated weights for policy 0, policy_version 740237 (0.0011) [2023-12-26 05:30:06,650][123091] Updated weights for policy 0, policy_version 740247 (0.0009) [2023-12-26 05:30:06,691][123090] Updated weights for policy 1, policy_version 735590 (0.0007) [2023-12-26 05:30:06,709][123091] Updated weights for policy 0, policy_version 740257 (0.0009) [2023-12-26 05:30:06,753][123090] Updated weights for policy 1, policy_version 735600 (0.0006) [2023-12-26 05:30:06,781][123091] Updated weights for policy 0, policy_version 740267 (0.0010) [2023-12-26 05:30:06,816][123090] Updated weights for policy 1, policy_version 735610 (0.0006) [2023-12-26 05:30:07,502][123090] Updated weights for policy 1, policy_version 735620 (0.0006) [2023-12-26 05:30:07,569][123090] Updated weights for policy 1, policy_version 735630 (0.0011) [2023-12-26 05:30:07,619][123090] Updated weights for policy 1, policy_version 735640 (0.0011) [2023-12-26 05:30:07,626][123091] Updated weights for policy 0, policy_version 740277 (0.0009) [2023-12-26 05:30:07,688][123091] Updated weights for policy 0, policy_version 740287 (0.0006) [2023-12-26 05:30:07,747][123091] Updated weights for policy 0, policy_version 740297 (0.0006) [2023-12-26 05:30:08,380][123090] Updated weights for policy 1, policy_version 735650 (0.0010) [2023-12-26 05:30:08,444][123090] Updated weights for policy 1, policy_version 735660 (0.0009) [2023-12-26 05:30:08,500][123091] Updated weights for policy 0, policy_version 740307 (0.0007) [2023-12-26 05:30:08,509][123090] Updated weights for policy 1, policy_version 735670 (0.0011) [2023-12-26 05:30:08,560][123091] Updated weights for policy 0, policy_version 740317 (0.0007) [2023-12-26 05:30:08,571][123090] Updated weights for policy 1, policy_version 735680 (0.0011) [2023-12-26 05:30:08,620][123091] Updated weights for policy 0, policy_version 740327 (0.0008) [2023-12-26 05:30:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 377864192. Throughput: 0: 9022.9, 1: 8856.1. Samples: 377834900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:08,785][121949] Avg episode reward: [(0, '6081.513'), (1, '5530.344')] [2023-12-26 05:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000735680_188334080.pth... [2023-12-26 05:30:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000740336_189530112.pth... [2023-12-26 05:30:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000734624_188063744.pth [2023-12-26 05:30:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000739280_189259776.pth [2023-12-26 05:30:09,419][123090] Updated weights for policy 1, policy_version 735690 (0.0010) [2023-12-26 05:30:09,483][123090] Updated weights for policy 1, policy_version 735700 (0.0011) [2023-12-26 05:30:09,485][123091] Updated weights for policy 0, policy_version 740337 (0.0009) [2023-12-26 05:30:09,536][123090] Updated weights for policy 1, policy_version 735710 (0.0010) [2023-12-26 05:30:09,546][123091] Updated weights for policy 0, policy_version 740347 (0.0009) [2023-12-26 05:30:09,614][123091] Updated weights for policy 0, policy_version 740357 (0.0009) [2023-12-26 05:30:09,679][123091] Updated weights for policy 0, policy_version 740367 (0.0009) [2023-12-26 05:30:10,386][123090] Updated weights for policy 1, policy_version 735720 (0.0011) [2023-12-26 05:30:10,430][123090] Updated weights for policy 1, policy_version 735730 (0.0010) [2023-12-26 05:30:10,493][123090] Updated weights for policy 1, policy_version 735740 (0.0010) [2023-12-26 05:30:10,526][123091] Updated weights for policy 0, policy_version 740377 (0.0008) [2023-12-26 05:30:10,582][123091] Updated weights for policy 0, policy_version 740387 (0.0009) [2023-12-26 05:30:10,645][123091] Updated weights for policy 0, policy_version 740397 (0.0008) [2023-12-26 05:30:11,375][123090] Updated weights for policy 1, policy_version 735750 (0.0011) [2023-12-26 05:30:11,440][123090] Updated weights for policy 1, policy_version 735760 (0.0010) [2023-12-26 05:30:11,508][123090] Updated weights for policy 1, policy_version 735770 (0.0011) [2023-12-26 05:30:11,558][123091] Updated weights for policy 0, policy_version 740407 (0.0008) [2023-12-26 05:30:11,619][123091] Updated weights for policy 0, policy_version 740417 (0.0009) [2023-12-26 05:30:11,689][123091] Updated weights for policy 0, policy_version 740427 (0.0009) [2023-12-26 05:30:12,351][123090] Updated weights for policy 1, policy_version 735780 (0.0010) [2023-12-26 05:30:12,420][123090] Updated weights for policy 1, policy_version 735790 (0.0009) [2023-12-26 05:30:12,484][123090] Updated weights for policy 1, policy_version 735800 (0.0011) [2023-12-26 05:30:12,546][123091] Updated weights for policy 0, policy_version 740437 (0.0008) [2023-12-26 05:30:12,619][123091] Updated weights for policy 0, policy_version 740447 (0.0009) [2023-12-26 05:30:12,686][123091] Updated weights for policy 0, policy_version 740457 (0.0006) [2023-12-26 05:30:13,291][123090] Updated weights for policy 1, policy_version 735810 (0.0008) [2023-12-26 05:30:13,354][123090] Updated weights for policy 1, policy_version 735820 (0.0006) [2023-12-26 05:30:13,428][123090] Updated weights for policy 1, policy_version 735830 (0.0006) [2023-12-26 05:30:13,488][123090] Updated weights for policy 1, policy_version 735840 (0.0006) [2023-12-26 05:30:13,489][123091] Updated weights for policy 0, policy_version 740467 (0.0009) [2023-12-26 05:30:13,544][123091] Updated weights for policy 0, policy_version 740477 (0.0009) [2023-12-26 05:30:13,606][123091] Updated weights for policy 0, policy_version 740487 (0.0010) [2023-12-26 05:30:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 377946112. Throughput: 0: 8953.6, 1: 8808.7. Samples: 377937504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:13,785][121949] Avg episode reward: [(0, '6113.955'), (1, '5462.389')] [2023-12-26 05:30:14,153][123090] Updated weights for policy 1, policy_version 735850 (0.0005) [2023-12-26 05:30:14,222][123090] Updated weights for policy 1, policy_version 735860 (0.0006) [2023-12-26 05:30:14,282][123090] Updated weights for policy 1, policy_version 735870 (0.0006) [2023-12-26 05:30:14,475][123091] Updated weights for policy 0, policy_version 740497 (0.0009) [2023-12-26 05:30:14,545][123091] Updated weights for policy 0, policy_version 740507 (0.0010) [2023-12-26 05:30:14,614][123091] Updated weights for policy 0, policy_version 740517 (0.0009) [2023-12-26 05:30:14,679][123091] Updated weights for policy 0, policy_version 740527 (0.0009) [2023-12-26 05:30:14,944][123090] Updated weights for policy 1, policy_version 735880 (0.0010) [2023-12-26 05:30:15,019][123090] Updated weights for policy 1, policy_version 735890 (0.0010) [2023-12-26 05:30:15,085][123090] Updated weights for policy 1, policy_version 735900 (0.0006) [2023-12-26 05:30:15,563][123091] Updated weights for policy 0, policy_version 740537 (0.0009) [2023-12-26 05:30:15,621][123091] Updated weights for policy 0, policy_version 740547 (0.0010) [2023-12-26 05:30:15,679][123091] Updated weights for policy 0, policy_version 740557 (0.0009) [2023-12-26 05:30:15,771][123090] Updated weights for policy 1, policy_version 735910 (0.0006) [2023-12-26 05:30:15,829][123090] Updated weights for policy 1, policy_version 735920 (0.0006) [2023-12-26 05:30:15,890][123090] Updated weights for policy 1, policy_version 735930 (0.0007) [2023-12-26 05:30:16,593][123091] Updated weights for policy 0, policy_version 740567 (0.0010) [2023-12-26 05:30:16,604][123090] Updated weights for policy 1, policy_version 735940 (0.0006) [2023-12-26 05:30:16,652][123091] Updated weights for policy 0, policy_version 740577 (0.0009) [2023-12-26 05:30:16,666][123090] Updated weights for policy 1, policy_version 735950 (0.0006) [2023-12-26 05:30:16,707][123091] Updated weights for policy 0, policy_version 740587 (0.0008) [2023-12-26 05:30:16,718][123090] Updated weights for policy 1, policy_version 735960 (0.0008) [2023-12-26 05:30:17,521][123090] Updated weights for policy 1, policy_version 735970 (0.0010) [2023-12-26 05:30:17,549][123091] Updated weights for policy 0, policy_version 740597 (0.0008) [2023-12-26 05:30:17,565][123090] Updated weights for policy 1, policy_version 735980 (0.0010) [2023-12-26 05:30:17,594][123091] Updated weights for policy 0, policy_version 740607 (0.0005) [2023-12-26 05:30:17,613][123090] Updated weights for policy 1, policy_version 735990 (0.0010) [2023-12-26 05:30:17,659][123091] Updated weights for policy 0, policy_version 740617 (0.0007) [2023-12-26 05:30:17,674][123090] Updated weights for policy 1, policy_version 736000 (0.0008) [2023-12-26 05:30:18,487][123090] Updated weights for policy 1, policy_version 736010 (0.0011) [2023-12-26 05:30:18,545][123091] Updated weights for policy 0, policy_version 740627 (0.0008) [2023-12-26 05:30:18,547][123090] Updated weights for policy 1, policy_version 736020 (0.0011) [2023-12-26 05:30:18,608][123090] Updated weights for policy 1, policy_version 736030 (0.0010) [2023-12-26 05:30:18,610][123091] Updated weights for policy 0, policy_version 740637 (0.0006) [2023-12-26 05:30:18,673][123091] Updated weights for policy 0, policy_version 740647 (0.0009) [2023-12-26 05:30:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 378036224. Throughput: 0: 8835.6, 1: 8903.3. Samples: 378043404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:18,785][121949] Avg episode reward: [(0, '6150.269'), (1, '5451.907')] [2023-12-26 05:30:19,312][123090] Updated weights for policy 1, policy_version 736040 (0.0011) [2023-12-26 05:30:19,386][123090] Updated weights for policy 1, policy_version 736050 (0.0011) [2023-12-26 05:30:19,439][123090] Updated weights for policy 1, policy_version 736060 (0.0010) [2023-12-26 05:30:19,510][123091] Updated weights for policy 0, policy_version 740657 (0.0009) [2023-12-26 05:30:19,577][123091] Updated weights for policy 0, policy_version 740667 (0.0007) [2023-12-26 05:30:19,642][123091] Updated weights for policy 0, policy_version 740677 (0.0009) [2023-12-26 05:30:19,702][123091] Updated weights for policy 0, policy_version 740687 (0.0009) [2023-12-26 05:30:20,281][123090] Updated weights for policy 1, policy_version 736070 (0.0010) [2023-12-26 05:30:20,347][123090] Updated weights for policy 1, policy_version 736080 (0.0011) [2023-12-26 05:30:20,395][123090] Updated weights for policy 1, policy_version 736090 (0.0010) [2023-12-26 05:30:20,487][123091] Updated weights for policy 0, policy_version 740697 (0.0009) [2023-12-26 05:30:20,541][123091] Updated weights for policy 0, policy_version 740707 (0.0008) [2023-12-26 05:30:20,614][123091] Updated weights for policy 0, policy_version 740717 (0.0008) [2023-12-26 05:30:21,200][123090] Updated weights for policy 1, policy_version 736100 (0.0010) [2023-12-26 05:30:21,266][123090] Updated weights for policy 1, policy_version 736110 (0.0008) [2023-12-26 05:30:21,337][123090] Updated weights for policy 1, policy_version 736120 (0.0007) [2023-12-26 05:30:21,427][123091] Updated weights for policy 0, policy_version 740727 (0.0008) [2023-12-26 05:30:21,482][123091] Updated weights for policy 0, policy_version 740737 (0.0008) [2023-12-26 05:30:21,554][123091] Updated weights for policy 0, policy_version 740747 (0.0007) [2023-12-26 05:30:22,189][123090] Updated weights for policy 1, policy_version 736130 (0.0010) [2023-12-26 05:30:22,253][123090] Updated weights for policy 1, policy_version 736140 (0.0009) [2023-12-26 05:30:22,321][123090] Updated weights for policy 1, policy_version 736150 (0.0010) [2023-12-26 05:30:22,382][123091] Updated weights for policy 0, policy_version 740757 (0.0006) [2023-12-26 05:30:22,449][123091] Updated weights for policy 0, policy_version 740767 (0.0006) [2023-12-26 05:30:22,517][123091] Updated weights for policy 0, policy_version 740777 (0.0006) [2023-12-26 05:30:23,041][123090] Updated weights for policy 1, policy_version 736161 (0.0008) [2023-12-26 05:30:23,099][123090] Updated weights for policy 1, policy_version 736171 (0.0005) [2023-12-26 05:30:23,159][123091] Updated weights for policy 0, policy_version 740787 (0.0006) [2023-12-26 05:30:23,171][123090] Updated weights for policy 1, policy_version 736181 (0.0008) [2023-12-26 05:30:23,225][123091] Updated weights for policy 0, policy_version 740797 (0.0005) [2023-12-26 05:30:23,248][123090] Updated weights for policy 1, policy_version 736191 (0.0005) [2023-12-26 05:30:23,286][123091] Updated weights for policy 0, policy_version 740807 (0.0007) [2023-12-26 05:30:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 378118144. Throughput: 0: 8804.0, 1: 8878.5. Samples: 378094736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:23,785][121949] Avg episode reward: [(0, '6143.585'), (1, '5419.047')] [2023-12-26 05:30:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000740816_189652992.pth... [2023-12-26 05:30:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000736192_188465152.pth... [2023-12-26 05:30:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000739824_189399040.pth [2023-12-26 05:30:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000735136_188194816.pth [2023-12-26 05:30:23,877][123091] Updated weights for policy 0, policy_version 740817 (0.0006) [2023-12-26 05:30:23,881][123090] Updated weights for policy 1, policy_version 736201 (0.0006) [2023-12-26 05:30:23,932][123090] Updated weights for policy 1, policy_version 736211 (0.0010) [2023-12-26 05:30:23,933][123091] Updated weights for policy 0, policy_version 740827 (0.0005) [2023-12-26 05:30:23,993][123091] Updated weights for policy 0, policy_version 740837 (0.0006) [2023-12-26 05:30:23,997][123090] Updated weights for policy 1, policy_version 736221 (0.0009) [2023-12-26 05:30:24,058][123091] Updated weights for policy 0, policy_version 740847 (0.0008) [2023-12-26 05:30:24,711][123090] Updated weights for policy 1, policy_version 736231 (0.0006) [2023-12-26 05:30:24,769][123090] Updated weights for policy 1, policy_version 736241 (0.0005) [2023-12-26 05:30:24,827][123090] Updated weights for policy 1, policy_version 736251 (0.0005) [2023-12-26 05:30:24,937][123091] Updated weights for policy 0, policy_version 740857 (0.0010) [2023-12-26 05:30:24,990][123091] Updated weights for policy 0, policy_version 740867 (0.0010) [2023-12-26 05:30:25,049][123091] Updated weights for policy 0, policy_version 740878 (0.0011) [2023-12-26 05:30:25,453][123090] Updated weights for policy 1, policy_version 736261 (0.0005) [2023-12-26 05:30:25,504][123090] Updated weights for policy 1, policy_version 736271 (0.0005) [2023-12-26 05:30:25,557][123090] Updated weights for policy 1, policy_version 736281 (0.0005) [2023-12-26 05:30:25,959][123091] Updated weights for policy 0, policy_version 740888 (0.0006) [2023-12-26 05:30:26,005][123091] Updated weights for policy 0, policy_version 740898 (0.0005) [2023-12-26 05:30:26,054][123091] Updated weights for policy 0, policy_version 740908 (0.0005) [2023-12-26 05:30:26,202][123090] Updated weights for policy 1, policy_version 736291 (0.0005) [2023-12-26 05:30:26,264][123090] Updated weights for policy 1, policy_version 736301 (0.0005) [2023-12-26 05:30:26,326][123090] Updated weights for policy 1, policy_version 736311 (0.0006) [2023-12-26 05:30:26,823][123091] Updated weights for policy 0, policy_version 740918 (0.0009) [2023-12-26 05:30:26,873][123091] Updated weights for policy 0, policy_version 740928 (0.0010) [2023-12-26 05:30:26,927][123091] Updated weights for policy 0, policy_version 740938 (0.0010) [2023-12-26 05:30:26,977][123090] Updated weights for policy 1, policy_version 736321 (0.0006) [2023-12-26 05:30:27,027][123090] Updated weights for policy 1, policy_version 736331 (0.0009) [2023-12-26 05:30:27,095][123090] Updated weights for policy 1, policy_version 736341 (0.0009) [2023-12-26 05:30:27,151][123090] Updated weights for policy 1, policy_version 736351 (0.0008) [2023-12-26 05:30:27,761][123091] Updated weights for policy 0, policy_version 740948 (0.0009) [2023-12-26 05:30:27,822][123091] Updated weights for policy 0, policy_version 740958 (0.0009) [2023-12-26 05:30:27,869][123091] Updated weights for policy 0, policy_version 740968 (0.0008) [2023-12-26 05:30:27,970][123090] Updated weights for policy 1, policy_version 736361 (0.0009) [2023-12-26 05:30:28,019][123090] Updated weights for policy 1, policy_version 736371 (0.0008) [2023-12-26 05:30:28,070][123090] Updated weights for policy 1, policy_version 736381 (0.0010) [2023-12-26 05:30:28,723][123091] Updated weights for policy 0, policy_version 740979 (0.0010) [2023-12-26 05:30:28,778][123091] Updated weights for policy 0, policy_version 740990 (0.0011) [2023-12-26 05:30:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 378208256. Throughput: 0: 8861.0, 1: 9021.0. Samples: 378208012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:28,785][121949] Avg episode reward: [(0, '6183.613'), (1, '5414.476')] [2023-12-26 05:30:28,831][123091] Updated weights for policy 0, policy_version 741001 (0.0010) [2023-12-26 05:30:28,894][123090] Updated weights for policy 1, policy_version 736391 (0.0007) [2023-12-26 05:30:28,963][123090] Updated weights for policy 1, policy_version 736401 (0.0005) [2023-12-26 05:30:29,024][123090] Updated weights for policy 1, policy_version 736411 (0.0005) [2023-12-26 05:30:29,715][123091] Updated weights for policy 0, policy_version 741011 (0.0009) [2023-12-26 05:30:29,754][123090] Updated weights for policy 1, policy_version 736421 (0.0006) [2023-12-26 05:30:29,777][123091] Updated weights for policy 0, policy_version 741021 (0.0009) [2023-12-26 05:30:29,815][123090] Updated weights for policy 1, policy_version 736432 (0.0009) [2023-12-26 05:30:29,845][123091] Updated weights for policy 0, policy_version 741031 (0.0007) [2023-12-26 05:30:29,893][123090] Updated weights for policy 1, policy_version 736442 (0.0009) [2023-12-26 05:30:30,594][123091] Updated weights for policy 0, policy_version 741041 (0.0006) [2023-12-26 05:30:30,654][123091] Updated weights for policy 0, policy_version 741051 (0.0010) [2023-12-26 05:30:30,718][123091] Updated weights for policy 0, policy_version 741061 (0.0009) [2023-12-26 05:30:30,758][123090] Updated weights for policy 1, policy_version 736452 (0.0009) [2023-12-26 05:30:30,778][123091] Updated weights for policy 0, policy_version 741071 (0.0007) [2023-12-26 05:30:30,822][123090] Updated weights for policy 1, policy_version 736462 (0.0009) [2023-12-26 05:30:30,884][123090] Updated weights for policy 1, policy_version 736472 (0.0007) [2023-12-26 05:30:31,520][123091] Updated weights for policy 0, policy_version 741081 (0.0009) [2023-12-26 05:30:31,570][123091] Updated weights for policy 0, policy_version 741091 (0.0010) [2023-12-26 05:30:31,619][123091] Updated weights for policy 0, policy_version 741101 (0.0009) [2023-12-26 05:30:31,743][123090] Updated weights for policy 1, policy_version 736482 (0.0008) [2023-12-26 05:30:31,800][123090] Updated weights for policy 1, policy_version 736492 (0.0008) [2023-12-26 05:30:31,852][123090] Updated weights for policy 1, policy_version 736502 (0.0009) [2023-12-26 05:30:31,917][123090] Updated weights for policy 1, policy_version 736512 (0.0009) [2023-12-26 05:30:32,374][123091] Updated weights for policy 0, policy_version 741111 (0.0008) [2023-12-26 05:30:32,447][123091] Updated weights for policy 0, policy_version 741121 (0.0008) [2023-12-26 05:30:32,506][123091] Updated weights for policy 0, policy_version 741131 (0.0008) [2023-12-26 05:30:32,758][123090] Updated weights for policy 1, policy_version 736522 (0.0009) [2023-12-26 05:30:32,814][123090] Updated weights for policy 1, policy_version 736532 (0.0009) [2023-12-26 05:30:32,865][123090] Updated weights for policy 1, policy_version 736543 (0.0010) [2023-12-26 05:30:33,300][123091] Updated weights for policy 0, policy_version 741141 (0.0009) [2023-12-26 05:30:33,356][123091] Updated weights for policy 0, policy_version 741151 (0.0009) [2023-12-26 05:30:33,410][123091] Updated weights for policy 0, policy_version 741161 (0.0010) [2023-12-26 05:30:33,661][123090] Updated weights for policy 1, policy_version 736553 (0.0009) [2023-12-26 05:30:33,723][123090] Updated weights for policy 1, policy_version 736563 (0.0009) [2023-12-26 05:30:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 378298368. Throughput: 0: 8695.1, 1: 9052.7. Samples: 378312264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:33,785][121949] Avg episode reward: [(0, '6171.424'), (1, '5333.805')] [2023-12-26 05:30:33,788][123090] Updated weights for policy 1, policy_version 736573 (0.0008) [2023-12-26 05:30:34,249][123091] Updated weights for policy 0, policy_version 741171 (0.0010) [2023-12-26 05:30:34,303][123091] Updated weights for policy 0, policy_version 741181 (0.0009) [2023-12-26 05:30:34,363][123091] Updated weights for policy 0, policy_version 741192 (0.0010) [2023-12-26 05:30:34,586][123090] Updated weights for policy 1, policy_version 736583 (0.0009) [2023-12-26 05:30:34,646][123090] Updated weights for policy 1, policy_version 736593 (0.0009) [2023-12-26 05:30:34,707][123090] Updated weights for policy 1, policy_version 736603 (0.0009) [2023-12-26 05:30:35,231][123091] Updated weights for policy 0, policy_version 741202 (0.0010) [2023-12-26 05:30:35,284][123091] Updated weights for policy 0, policy_version 741212 (0.0009) [2023-12-26 05:30:35,344][123091] Updated weights for policy 0, policy_version 741222 (0.0010) [2023-12-26 05:30:35,410][123091] Updated weights for policy 0, policy_version 741232 (0.0010) [2023-12-26 05:30:35,493][123090] Updated weights for policy 1, policy_version 736613 (0.0007) [2023-12-26 05:30:35,541][123090] Updated weights for policy 1, policy_version 736623 (0.0005) [2023-12-26 05:30:35,596][123090] Updated weights for policy 1, policy_version 736633 (0.0005) [2023-12-26 05:30:36,301][123090] Updated weights for policy 1, policy_version 736643 (0.0005) [2023-12-26 05:30:36,348][123091] Updated weights for policy 0, policy_version 741242 (0.0009) [2023-12-26 05:30:36,369][123090] Updated weights for policy 1, policy_version 736653 (0.0009) [2023-12-26 05:30:36,415][123091] Updated weights for policy 0, policy_version 741252 (0.0009) [2023-12-26 05:30:36,433][123090] Updated weights for policy 1, policy_version 736663 (0.0009) [2023-12-26 05:30:36,484][123091] Updated weights for policy 0, policy_version 741262 (0.0010) [2023-12-26 05:30:37,271][123090] Updated weights for policy 1, policy_version 736673 (0.0010) [2023-12-26 05:30:37,304][123091] Updated weights for policy 0, policy_version 741272 (0.0010) [2023-12-26 05:30:37,317][123090] Updated weights for policy 1, policy_version 736683 (0.0009) [2023-12-26 05:30:37,360][123091] Updated weights for policy 0, policy_version 741282 (0.0010) [2023-12-26 05:30:37,365][123090] Updated weights for policy 1, policy_version 736693 (0.0010) [2023-12-26 05:30:37,414][123090] Updated weights for policy 1, policy_version 736703 (0.0009) [2023-12-26 05:30:37,420][123091] Updated weights for policy 0, policy_version 741292 (0.0011) [2023-12-26 05:30:38,169][123090] Updated weights for policy 1, policy_version 736713 (0.0009) [2023-12-26 05:30:38,195][123091] Updated weights for policy 0, policy_version 741302 (0.0009) [2023-12-26 05:30:38,226][123090] Updated weights for policy 1, policy_version 736723 (0.0009) [2023-12-26 05:30:38,249][123091] Updated weights for policy 0, policy_version 741312 (0.0007) [2023-12-26 05:30:38,283][123090] Updated weights for policy 1, policy_version 736733 (0.0009) [2023-12-26 05:30:38,301][123091] Updated weights for policy 0, policy_version 741322 (0.0006) [2023-12-26 05:30:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 378388480. Throughput: 0: 8654.6, 1: 9081.6. Samples: 378364512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:38,785][121949] Avg episode reward: [(0, '6226.240'), (1, '5199.034')] [2023-12-26 05:30:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000741328_189784064.pth... [2023-12-26 05:30:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000736736_188604416.pth... [2023-12-26 05:30:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000740336_189530112.pth [2023-12-26 05:30:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000735680_188334080.pth [2023-12-26 05:30:39,016][123091] Updated weights for policy 0, policy_version 741332 (0.0008) [2023-12-26 05:30:39,046][123090] Updated weights for policy 1, policy_version 736743 (0.0007) [2023-12-26 05:30:39,079][123091] Updated weights for policy 0, policy_version 741342 (0.0010) [2023-12-26 05:30:39,110][123090] Updated weights for policy 1, policy_version 736753 (0.0009) [2023-12-26 05:30:39,138][123091] Updated weights for policy 0, policy_version 741352 (0.0009) [2023-12-26 05:30:39,171][123090] Updated weights for policy 1, policy_version 736763 (0.0011) [2023-12-26 05:30:39,947][123091] Updated weights for policy 0, policy_version 741362 (0.0007) [2023-12-26 05:30:39,998][123090] Updated weights for policy 1, policy_version 736773 (0.0010) [2023-12-26 05:30:40,006][123091] Updated weights for policy 0, policy_version 741372 (0.0007) [2023-12-26 05:30:40,069][123090] Updated weights for policy 1, policy_version 736783 (0.0006) [2023-12-26 05:30:40,071][123091] Updated weights for policy 0, policy_version 741382 (0.0008) [2023-12-26 05:30:40,136][123091] Updated weights for policy 0, policy_version 741392 (0.0009) [2023-12-26 05:30:40,142][123090] Updated weights for policy 1, policy_version 736793 (0.0006) [2023-12-26 05:30:40,917][123091] Updated weights for policy 0, policy_version 741402 (0.0007) [2023-12-26 05:30:40,940][123090] Updated weights for policy 1, policy_version 736803 (0.0011) [2023-12-26 05:30:40,983][123091] Updated weights for policy 0, policy_version 741412 (0.0005) [2023-12-26 05:30:41,003][123090] Updated weights for policy 1, policy_version 736813 (0.0011) [2023-12-26 05:30:41,046][123091] Updated weights for policy 0, policy_version 741422 (0.0007) [2023-12-26 05:30:41,074][123090] Updated weights for policy 1, policy_version 736823 (0.0011) [2023-12-26 05:30:41,850][123091] Updated weights for policy 0, policy_version 741432 (0.0009) [2023-12-26 05:30:41,860][123090] Updated weights for policy 1, policy_version 736833 (0.0013) [2023-12-26 05:30:41,910][123091] Updated weights for policy 0, policy_version 741442 (0.0009) [2023-12-26 05:30:41,915][123090] Updated weights for policy 1, policy_version 736843 (0.0008) [2023-12-26 05:30:41,967][123090] Updated weights for policy 1, policy_version 736853 (0.0008) [2023-12-26 05:30:41,970][123091] Updated weights for policy 0, policy_version 741452 (0.0006) [2023-12-26 05:30:42,031][123090] Updated weights for policy 1, policy_version 736863 (0.0008) [2023-12-26 05:30:42,852][123090] Updated weights for policy 1, policy_version 736873 (0.0009) [2023-12-26 05:30:42,880][123091] Updated weights for policy 0, policy_version 741462 (0.0007) [2023-12-26 05:30:42,913][123090] Updated weights for policy 1, policy_version 736883 (0.0007) [2023-12-26 05:30:42,937][123091] Updated weights for policy 0, policy_version 741472 (0.0008) [2023-12-26 05:30:42,969][123090] Updated weights for policy 1, policy_version 736893 (0.0006) [2023-12-26 05:30:42,994][123091] Updated weights for policy 0, policy_version 741482 (0.0008) [2023-12-26 05:30:43,616][123091] Updated weights for policy 0, policy_version 741492 (0.0008) [2023-12-26 05:30:43,632][123090] Updated weights for policy 1, policy_version 736903 (0.0005) [2023-12-26 05:30:43,667][123091] Updated weights for policy 0, policy_version 741502 (0.0005) [2023-12-26 05:30:43,689][123090] Updated weights for policy 1, policy_version 736913 (0.0006) [2023-12-26 05:30:43,724][123091] Updated weights for policy 0, policy_version 741512 (0.0005) [2023-12-26 05:30:43,749][123090] Updated weights for policy 1, policy_version 736923 (0.0006) [2023-12-26 05:30:43,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 378486784. Throughput: 0: 8657.3, 1: 9007.5. Samples: 378471144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:43,784][121949] Avg episode reward: [(0, '6220.703'), (1, '5243.625')] [2023-12-26 05:30:44,343][123091] Updated weights for policy 0, policy_version 741522 (0.0005) [2023-12-26 05:30:44,407][123091] Updated weights for policy 0, policy_version 741532 (0.0006) [2023-12-26 05:30:44,409][123090] Updated weights for policy 1, policy_version 736933 (0.0006) [2023-12-26 05:30:44,467][123090] Updated weights for policy 1, policy_version 736943 (0.0010) [2023-12-26 05:30:44,472][123091] Updated weights for policy 0, policy_version 741542 (0.0006) [2023-12-26 05:30:44,522][123091] Updated weights for policy 0, policy_version 741552 (0.0010) [2023-12-26 05:30:44,523][123090] Updated weights for policy 1, policy_version 736953 (0.0010) [2023-12-26 05:30:45,293][123091] Updated weights for policy 0, policy_version 741562 (0.0007) [2023-12-26 05:30:45,355][123090] Updated weights for policy 1, policy_version 736963 (0.0010) [2023-12-26 05:30:45,363][123091] Updated weights for policy 0, policy_version 741572 (0.0007) [2023-12-26 05:30:45,412][123090] Updated weights for policy 1, policy_version 736973 (0.0011) [2023-12-26 05:30:45,425][123091] Updated weights for policy 0, policy_version 741582 (0.0010) [2023-12-26 05:30:45,475][123090] Updated weights for policy 1, policy_version 736983 (0.0006) [2023-12-26 05:30:46,089][123091] Updated weights for policy 0, policy_version 741592 (0.0006) [2023-12-26 05:30:46,149][123091] Updated weights for policy 0, policy_version 741602 (0.0006) [2023-12-26 05:30:46,168][123090] Updated weights for policy 1, policy_version 736993 (0.0005) [2023-12-26 05:30:46,218][123091] Updated weights for policy 0, policy_version 741612 (0.0006) [2023-12-26 05:30:46,227][123090] Updated weights for policy 1, policy_version 737003 (0.0008) [2023-12-26 05:30:46,282][123090] Updated weights for policy 1, policy_version 737013 (0.0008) [2023-12-26 05:30:46,330][123090] Updated weights for policy 1, policy_version 737023 (0.0009) [2023-12-26 05:30:46,972][123091] Updated weights for policy 0, policy_version 741622 (0.0008) [2023-12-26 05:30:47,029][123091] Updated weights for policy 0, policy_version 741632 (0.0005) [2023-12-26 05:30:47,042][123090] Updated weights for policy 1, policy_version 737033 (0.0009) [2023-12-26 05:30:47,082][123091] Updated weights for policy 0, policy_version 741642 (0.0007) [2023-12-26 05:30:47,097][123090] Updated weights for policy 1, policy_version 737043 (0.0008) [2023-12-26 05:30:47,143][123090] Updated weights for policy 1, policy_version 737053 (0.0008) [2023-12-26 05:30:47,845][123091] Updated weights for policy 0, policy_version 741652 (0.0010) [2023-12-26 05:30:47,894][123091] Updated weights for policy 0, policy_version 741662 (0.0009) [2023-12-26 05:30:47,954][123091] Updated weights for policy 0, policy_version 741672 (0.0010) [2023-12-26 05:30:48,011][123090] Updated weights for policy 1, policy_version 737063 (0.0009) [2023-12-26 05:30:48,092][123090] Updated weights for policy 1, policy_version 737073 (0.0009) [2023-12-26 05:30:48,154][123090] Updated weights for policy 1, policy_version 737083 (0.0009) [2023-12-26 05:30:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 378568704. Throughput: 0: 8742.9, 1: 9097.7. Samples: 378584128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:48,785][121949] Avg episode reward: [(0, '6204.510'), (1, '5239.999')] [2023-12-26 05:30:48,794][123091] Updated weights for policy 0, policy_version 741682 (0.0010) [2023-12-26 05:30:48,858][123091] Updated weights for policy 0, policy_version 741692 (0.0009) [2023-12-26 05:30:48,910][123090] Updated weights for policy 1, policy_version 737093 (0.0010) [2023-12-26 05:30:48,916][123091] Updated weights for policy 0, policy_version 741702 (0.0009) [2023-12-26 05:30:48,961][123090] Updated weights for policy 1, policy_version 737103 (0.0010) [2023-12-26 05:30:48,976][123091] Updated weights for policy 0, policy_version 741712 (0.0008) [2023-12-26 05:30:49,025][123090] Updated weights for policy 1, policy_version 737113 (0.0010) [2023-12-26 05:30:49,796][123091] Updated weights for policy 0, policy_version 741722 (0.0009) [2023-12-26 05:30:49,799][123090] Updated weights for policy 1, policy_version 737123 (0.0011) [2023-12-26 05:30:49,862][123091] Updated weights for policy 0, policy_version 741732 (0.0007) [2023-12-26 05:30:49,880][123090] Updated weights for policy 1, policy_version 737133 (0.0011) [2023-12-26 05:30:49,933][123091] Updated weights for policy 0, policy_version 741742 (0.0008) [2023-12-26 05:30:49,948][123090] Updated weights for policy 1, policy_version 737143 (0.0011) [2023-12-26 05:30:50,743][123090] Updated weights for policy 1, policy_version 737153 (0.0011) [2023-12-26 05:30:50,808][123090] Updated weights for policy 1, policy_version 737163 (0.0011) [2023-12-26 05:30:50,810][123091] Updated weights for policy 0, policy_version 741752 (0.0009) [2023-12-26 05:30:50,872][123090] Updated weights for policy 1, policy_version 737173 (0.0011) [2023-12-26 05:30:50,879][123091] Updated weights for policy 0, policy_version 741762 (0.0006) [2023-12-26 05:30:50,937][123091] Updated weights for policy 0, policy_version 741772 (0.0008) [2023-12-26 05:30:50,937][123090] Updated weights for policy 1, policy_version 737183 (0.0007) [2023-12-26 05:30:51,768][123090] Updated weights for policy 1, policy_version 737193 (0.0009) [2023-12-26 05:30:51,815][123091] Updated weights for policy 0, policy_version 741782 (0.0007) [2023-12-26 05:30:51,827][123090] Updated weights for policy 1, policy_version 737203 (0.0010) [2023-12-26 05:30:51,870][123091] Updated weights for policy 0, policy_version 741792 (0.0006) [2023-12-26 05:30:51,881][123090] Updated weights for policy 1, policy_version 737213 (0.0010) [2023-12-26 05:30:51,936][123091] Updated weights for policy 0, policy_version 741802 (0.0009) [2023-12-26 05:30:52,684][123090] Updated weights for policy 1, policy_version 737223 (0.0010) [2023-12-26 05:30:52,754][123090] Updated weights for policy 1, policy_version 737233 (0.0009) [2023-12-26 05:30:52,773][123091] Updated weights for policy 0, policy_version 741812 (0.0008) [2023-12-26 05:30:52,815][123090] Updated weights for policy 1, policy_version 737243 (0.0008) [2023-12-26 05:30:52,837][123091] Updated weights for policy 0, policy_version 741822 (0.0008) [2023-12-26 05:30:52,901][123091] Updated weights for policy 0, policy_version 741832 (0.0010) [2023-12-26 05:30:53,573][123090] Updated weights for policy 1, policy_version 737253 (0.0009) [2023-12-26 05:30:53,622][123090] Updated weights for policy 1, policy_version 737263 (0.0009) [2023-12-26 05:30:53,673][123090] Updated weights for policy 1, policy_version 737273 (0.0008) [2023-12-26 05:30:53,744][123091] Updated weights for policy 0, policy_version 741842 (0.0010) [2023-12-26 05:30:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 378658816. Throughput: 0: 8694.6, 1: 9104.2. Samples: 378635844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:53,784][121949] Avg episode reward: [(0, '6236.994'), (1, '5096.340')] [2023-12-26 05:30:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000737280_188743680.pth... [2023-12-26 05:30:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000736192_188465152.pth [2023-12-26 05:30:53,809][123091] Updated weights for policy 0, policy_version 741852 (0.0009) [2023-12-26 05:30:53,880][123091] Updated weights for policy 0, policy_version 741862 (0.0008) [2023-12-26 05:30:53,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000741872_189923328.pth... [2023-12-26 05:30:53,936][123091] Updated weights for policy 0, policy_version 741872 (0.0008) [2023-12-26 05:30:53,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000740816_189652992.pth [2023-12-26 05:30:54,509][123090] Updated weights for policy 1, policy_version 737283 (0.0009) [2023-12-26 05:30:54,558][123090] Updated weights for policy 1, policy_version 737294 (0.0010) [2023-12-26 05:30:54,610][123090] Updated weights for policy 1, policy_version 737304 (0.0010) [2023-12-26 05:30:54,732][123091] Updated weights for policy 0, policy_version 741882 (0.0010) [2023-12-26 05:30:54,794][123091] Updated weights for policy 0, policy_version 741892 (0.0009) [2023-12-26 05:30:54,853][123091] Updated weights for policy 0, policy_version 741902 (0.0010) [2023-12-26 05:30:55,502][123090] Updated weights for policy 1, policy_version 737315 (0.0010) [2023-12-26 05:30:55,564][123090] Updated weights for policy 1, policy_version 737325 (0.0010) [2023-12-26 05:30:55,622][123090] Updated weights for policy 1, policy_version 737335 (0.0009) [2023-12-26 05:30:55,689][123091] Updated weights for policy 0, policy_version 741912 (0.0010) [2023-12-26 05:30:55,760][123091] Updated weights for policy 0, policy_version 741923 (0.0010) [2023-12-26 05:30:55,828][123091] Updated weights for policy 0, policy_version 741933 (0.0009) [2023-12-26 05:30:56,463][123090] Updated weights for policy 1, policy_version 737345 (0.0008) [2023-12-26 05:30:56,517][123090] Updated weights for policy 1, policy_version 737356 (0.0008) [2023-12-26 05:30:56,571][123090] Updated weights for policy 1, policy_version 737366 (0.0010) [2023-12-26 05:30:56,622][123090] Updated weights for policy 1, policy_version 737376 (0.0009) [2023-12-26 05:30:56,640][123091] Updated weights for policy 0, policy_version 741943 (0.0009) [2023-12-26 05:30:56,705][123091] Updated weights for policy 0, policy_version 741953 (0.0010) [2023-12-26 05:30:56,765][123091] Updated weights for policy 0, policy_version 741963 (0.0010) [2023-12-26 05:30:57,457][123090] Updated weights for policy 1, policy_version 737386 (0.0008) [2023-12-26 05:30:57,506][123090] Updated weights for policy 1, policy_version 737396 (0.0009) [2023-12-26 05:30:57,537][123091] Updated weights for policy 0, policy_version 741973 (0.0009) [2023-12-26 05:30:57,553][123090] Updated weights for policy 1, policy_version 737406 (0.0007) [2023-12-26 05:30:57,585][123091] Updated weights for policy 0, policy_version 741983 (0.0009) [2023-12-26 05:30:57,644][123091] Updated weights for policy 0, policy_version 741993 (0.0010) [2023-12-26 05:30:58,437][123091] Updated weights for policy 0, policy_version 742003 (0.0008) [2023-12-26 05:30:58,497][123091] Updated weights for policy 0, policy_version 742013 (0.0007) [2023-12-26 05:30:58,515][123090] Updated weights for policy 1, policy_version 737416 (0.0008) [2023-12-26 05:30:58,564][123091] Updated weights for policy 0, policy_version 742023 (0.0008) [2023-12-26 05:30:58,578][123090] Updated weights for policy 1, policy_version 737426 (0.0008) [2023-12-26 05:30:58,638][123090] Updated weights for policy 1, policy_version 737436 (0.0009) [2023-12-26 05:30:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 378748928. Throughput: 0: 8721.8, 1: 9075.4. Samples: 378738376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:30:58,785][121949] Avg episode reward: [(0, '6204.864'), (1, '5225.420')] [2023-12-26 05:30:59,390][123091] Updated weights for policy 0, policy_version 742033 (0.0009) [2023-12-26 05:30:59,457][123091] Updated weights for policy 0, policy_version 742043 (0.0006) [2023-12-26 05:30:59,519][123091] Updated weights for policy 0, policy_version 742053 (0.0006) [2023-12-26 05:30:59,572][123090] Updated weights for policy 1, policy_version 737446 (0.0008) [2023-12-26 05:30:59,581][123091] Updated weights for policy 0, policy_version 742063 (0.0010) [2023-12-26 05:30:59,631][123090] Updated weights for policy 1, policy_version 737456 (0.0009) [2023-12-26 05:30:59,696][123090] Updated weights for policy 1, policy_version 737466 (0.0009) [2023-12-26 05:31:00,420][123091] Updated weights for policy 0, policy_version 742073 (0.0007) [2023-12-26 05:31:00,486][123091] Updated weights for policy 0, policy_version 742083 (0.0009) [2023-12-26 05:31:00,493][123090] Updated weights for policy 1, policy_version 737476 (0.0009) [2023-12-26 05:31:00,554][123090] Updated weights for policy 1, policy_version 737486 (0.0006) [2023-12-26 05:31:00,555][123091] Updated weights for policy 0, policy_version 742093 (0.0009) [2023-12-26 05:31:00,616][123090] Updated weights for policy 1, policy_version 737496 (0.0006) [2023-12-26 05:31:01,324][123091] Updated weights for policy 0, policy_version 742103 (0.0007) [2023-12-26 05:31:01,356][123090] Updated weights for policy 1, policy_version 737506 (0.0006) [2023-12-26 05:31:01,395][123091] Updated weights for policy 0, policy_version 742113 (0.0008) [2023-12-26 05:31:01,427][123090] Updated weights for policy 1, policy_version 737516 (0.0008) [2023-12-26 05:31:01,441][123091] Updated weights for policy 0, policy_version 742123 (0.0006) [2023-12-26 05:31:01,482][123090] Updated weights for policy 1, policy_version 737526 (0.0010) [2023-12-26 05:31:01,534][123090] Updated weights for policy 1, policy_version 737536 (0.0010) [2023-12-26 05:31:02,205][123091] Updated weights for policy 0, policy_version 742133 (0.0008) [2023-12-26 05:31:02,259][123091] Updated weights for policy 0, policy_version 742143 (0.0008) [2023-12-26 05:31:02,322][123091] Updated weights for policy 0, policy_version 742153 (0.0009) [2023-12-26 05:31:02,342][123090] Updated weights for policy 1, policy_version 737546 (0.0007) [2023-12-26 05:31:02,412][123090] Updated weights for policy 1, policy_version 737556 (0.0006) [2023-12-26 05:31:02,474][123090] Updated weights for policy 1, policy_version 737566 (0.0005) [2023-12-26 05:31:03,174][123090] Updated weights for policy 1, policy_version 737576 (0.0007) [2023-12-26 05:31:03,200][123091] Updated weights for policy 0, policy_version 742163 (0.0009) [2023-12-26 05:31:03,234][123090] Updated weights for policy 1, policy_version 737586 (0.0006) [2023-12-26 05:31:03,256][123091] Updated weights for policy 0, policy_version 742173 (0.0010) [2023-12-26 05:31:03,297][123090] Updated weights for policy 1, policy_version 737596 (0.0007) [2023-12-26 05:31:03,312][123091] Updated weights for policy 0, policy_version 742183 (0.0009) [2023-12-26 05:31:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 378830848. Throughput: 0: 8787.2, 1: 8967.0. Samples: 378842344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:03,784][121949] Avg episode reward: [(0, '6165.522'), (1, '5148.270')] [2023-12-26 05:31:04,096][123090] Updated weights for policy 1, policy_version 737606 (0.0008) [2023-12-26 05:31:04,159][123090] Updated weights for policy 1, policy_version 737616 (0.0010) [2023-12-26 05:31:04,189][123091] Updated weights for policy 0, policy_version 742193 (0.0009) [2023-12-26 05:31:04,233][123090] Updated weights for policy 1, policy_version 737626 (0.0009) [2023-12-26 05:31:04,258][123091] Updated weights for policy 0, policy_version 742203 (0.0007) [2023-12-26 05:31:04,326][123091] Updated weights for policy 0, policy_version 742213 (0.0006) [2023-12-26 05:31:04,399][123091] Updated weights for policy 0, policy_version 742223 (0.0009) [2023-12-26 05:31:05,062][123090] Updated weights for policy 1, policy_version 737636 (0.0008) [2023-12-26 05:31:05,108][123090] Updated weights for policy 1, policy_version 737646 (0.0005) [2023-12-26 05:31:05,161][123090] Updated weights for policy 1, policy_version 737656 (0.0007) [2023-12-26 05:31:05,218][123091] Updated weights for policy 0, policy_version 742233 (0.0007) [2023-12-26 05:31:05,281][123091] Updated weights for policy 0, policy_version 742243 (0.0009) [2023-12-26 05:31:05,332][123091] Updated weights for policy 0, policy_version 742253 (0.0008) [2023-12-26 05:31:05,959][123090] Updated weights for policy 1, policy_version 737666 (0.0009) [2023-12-26 05:31:06,017][123090] Updated weights for policy 1, policy_version 737676 (0.0006) [2023-12-26 05:31:06,075][123090] Updated weights for policy 1, policy_version 737686 (0.0005) [2023-12-26 05:31:06,128][123091] Updated weights for policy 0, policy_version 742263 (0.0010) [2023-12-26 05:31:06,144][123090] Updated weights for policy 1, policy_version 737696 (0.0007) [2023-12-26 05:31:06,204][123091] Updated weights for policy 0, policy_version 742273 (0.0009) [2023-12-26 05:31:06,261][123091] Updated weights for policy 0, policy_version 742283 (0.0009) [2023-12-26 05:31:06,906][123090] Updated weights for policy 1, policy_version 737706 (0.0008) [2023-12-26 05:31:06,966][123090] Updated weights for policy 1, policy_version 737716 (0.0008) [2023-12-26 05:31:07,033][123090] Updated weights for policy 1, policy_version 737726 (0.0008) [2023-12-26 05:31:07,147][123091] Updated weights for policy 0, policy_version 742293 (0.0009) [2023-12-26 05:31:07,213][123091] Updated weights for policy 0, policy_version 742303 (0.0009) [2023-12-26 05:31:07,282][123091] Updated weights for policy 0, policy_version 742313 (0.0010) [2023-12-26 05:31:07,838][123090] Updated weights for policy 1, policy_version 737736 (0.0007) [2023-12-26 05:31:07,904][123090] Updated weights for policy 1, policy_version 737746 (0.0006) [2023-12-26 05:31:07,967][123090] Updated weights for policy 1, policy_version 737756 (0.0006) [2023-12-26 05:31:08,162][123091] Updated weights for policy 0, policy_version 742323 (0.0010) [2023-12-26 05:31:08,220][123091] Updated weights for policy 0, policy_version 742333 (0.0009) [2023-12-26 05:31:08,273][123091] Updated weights for policy 0, policy_version 742343 (0.0010) [2023-12-26 05:31:08,626][123090] Updated weights for policy 1, policy_version 737766 (0.0008) [2023-12-26 05:31:08,680][123090] Updated weights for policy 1, policy_version 737776 (0.0009) [2023-12-26 05:31:08,752][123090] Updated weights for policy 1, policy_version 737786 (0.0010) [2023-12-26 05:31:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 378920960. Throughput: 0: 8782.7, 1: 8973.5. Samples: 378893764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:08,785][121949] Avg episode reward: [(0, '6086.618'), (1, '5026.154')] [2023-12-26 05:31:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000742352_190046208.pth... [2023-12-26 05:31:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000737792_188874752.pth... [2023-12-26 05:31:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000741328_189784064.pth [2023-12-26 05:31:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000736736_188604416.pth [2023-12-26 05:31:09,147][123091] Updated weights for policy 0, policy_version 742353 (0.0009) [2023-12-26 05:31:09,218][123091] Updated weights for policy 0, policy_version 742363 (0.0010) [2023-12-26 05:31:09,283][123091] Updated weights for policy 0, policy_version 742373 (0.0009) [2023-12-26 05:31:09,359][123091] Updated weights for policy 0, policy_version 742383 (0.0010) [2023-12-26 05:31:09,584][123090] Updated weights for policy 1, policy_version 737796 (0.0007) [2023-12-26 05:31:09,640][123090] Updated weights for policy 1, policy_version 737806 (0.0008) [2023-12-26 05:31:09,701][123090] Updated weights for policy 1, policy_version 737816 (0.0010) [2023-12-26 05:31:10,161][123091] Updated weights for policy 0, policy_version 742393 (0.0009) [2023-12-26 05:31:10,234][123091] Updated weights for policy 0, policy_version 742403 (0.0009) [2023-12-26 05:31:10,310][123091] Updated weights for policy 0, policy_version 742413 (0.0009) [2023-12-26 05:31:10,542][123090] Updated weights for policy 1, policy_version 737826 (0.0007) [2023-12-26 05:31:10,615][123090] Updated weights for policy 1, policy_version 737836 (0.0007) [2023-12-26 05:31:10,687][123090] Updated weights for policy 1, policy_version 737846 (0.0007) [2023-12-26 05:31:10,740][123090] Updated weights for policy 1, policy_version 737856 (0.0008) [2023-12-26 05:31:11,158][123091] Updated weights for policy 0, policy_version 742423 (0.0008) [2023-12-26 05:31:11,231][123091] Updated weights for policy 0, policy_version 742433 (0.0007) [2023-12-26 05:31:11,303][123091] Updated weights for policy 0, policy_version 742443 (0.0010) [2023-12-26 05:31:11,556][123090] Updated weights for policy 1, policy_version 737866 (0.0008) [2023-12-26 05:31:11,627][123090] Updated weights for policy 1, policy_version 737876 (0.0008) [2023-12-26 05:31:11,699][123090] Updated weights for policy 1, policy_version 737886 (0.0008) [2023-12-26 05:31:12,177][123091] Updated weights for policy 0, policy_version 742453 (0.0010) [2023-12-26 05:31:12,249][123091] Updated weights for policy 0, policy_version 742463 (0.0010) [2023-12-26 05:31:12,334][123091] Updated weights for policy 0, policy_version 742473 (0.0010) [2023-12-26 05:31:12,496][123090] Updated weights for policy 1, policy_version 737896 (0.0008) [2023-12-26 05:31:12,555][123090] Updated weights for policy 1, policy_version 737906 (0.0008) [2023-12-26 05:31:12,617][123090] Updated weights for policy 1, policy_version 737916 (0.0008) [2023-12-26 05:31:13,149][123091] Updated weights for policy 0, policy_version 742483 (0.0009) [2023-12-26 05:31:13,219][123091] Updated weights for policy 0, policy_version 742493 (0.0005) [2023-12-26 05:31:13,292][123091] Updated weights for policy 0, policy_version 742503 (0.0006) [2023-12-26 05:31:13,393][123090] Updated weights for policy 1, policy_version 737926 (0.0006) [2023-12-26 05:31:13,454][123090] Updated weights for policy 1, policy_version 737936 (0.0005) [2023-12-26 05:31:13,513][123090] Updated weights for policy 1, policy_version 737946 (0.0006) [2023-12-26 05:31:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 379002880. Throughput: 0: 8634.8, 1: 8832.5. Samples: 378994036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:13,785][121949] Avg episode reward: [(0, '6024.229'), (1, '5089.302')] [2023-12-26 05:31:14,031][123091] Updated weights for policy 0, policy_version 742513 (0.0007) [2023-12-26 05:31:14,092][123091] Updated weights for policy 0, policy_version 742523 (0.0006) [2023-12-26 05:31:14,147][123091] Updated weights for policy 0, policy_version 742533 (0.0007) [2023-12-26 05:31:14,210][123091] Updated weights for policy 0, policy_version 742543 (0.0005) [2023-12-26 05:31:14,237][123090] Updated weights for policy 1, policy_version 737956 (0.0007) [2023-12-26 05:31:14,302][123090] Updated weights for policy 1, policy_version 737966 (0.0010) [2023-12-26 05:31:14,360][123090] Updated weights for policy 1, policy_version 737976 (0.0010) [2023-12-26 05:31:15,004][123091] Updated weights for policy 0, policy_version 742553 (0.0009) [2023-12-26 05:31:15,065][123091] Updated weights for policy 0, policy_version 742563 (0.0009) [2023-12-26 05:31:15,125][123091] Updated weights for policy 0, policy_version 742573 (0.0009) [2023-12-26 05:31:15,231][123090] Updated weights for policy 1, policy_version 737986 (0.0010) [2023-12-26 05:31:15,302][123090] Updated weights for policy 1, policy_version 737996 (0.0011) [2023-12-26 05:31:15,370][123090] Updated weights for policy 1, policy_version 738006 (0.0011) [2023-12-26 05:31:15,430][123090] Updated weights for policy 1, policy_version 738016 (0.0011) [2023-12-26 05:31:15,993][123091] Updated weights for policy 0, policy_version 742583 (0.0009) [2023-12-26 05:31:16,055][123091] Updated weights for policy 0, policy_version 742593 (0.0009) [2023-12-26 05:31:16,111][123091] Updated weights for policy 0, policy_version 742603 (0.0009) [2023-12-26 05:31:16,246][123090] Updated weights for policy 1, policy_version 738026 (0.0010) [2023-12-26 05:31:16,301][123090] Updated weights for policy 1, policy_version 738036 (0.0010) [2023-12-26 05:31:16,356][123090] Updated weights for policy 1, policy_version 738046 (0.0010) [2023-12-26 05:31:16,962][123091] Updated weights for policy 0, policy_version 742613 (0.0009) [2023-12-26 05:31:17,018][123091] Updated weights for policy 0, policy_version 742623 (0.0010) [2023-12-26 05:31:17,070][123091] Updated weights for policy 0, policy_version 742633 (0.0010) [2023-12-26 05:31:17,127][123090] Updated weights for policy 1, policy_version 738056 (0.0010) [2023-12-26 05:31:17,189][123090] Updated weights for policy 1, policy_version 738066 (0.0010) [2023-12-26 05:31:17,252][123090] Updated weights for policy 1, policy_version 738076 (0.0010) [2023-12-26 05:31:17,759][123091] Updated weights for policy 0, policy_version 742643 (0.0007) [2023-12-26 05:31:17,810][123091] Updated weights for policy 0, policy_version 742653 (0.0005) [2023-12-26 05:31:17,868][123091] Updated weights for policy 0, policy_version 742663 (0.0005) [2023-12-26 05:31:17,984][123090] Updated weights for policy 1, policy_version 738086 (0.0010) [2023-12-26 05:31:18,036][123090] Updated weights for policy 1, policy_version 738096 (0.0010) [2023-12-26 05:31:18,088][123090] Updated weights for policy 1, policy_version 738106 (0.0010) [2023-12-26 05:31:18,663][123091] Updated weights for policy 0, policy_version 742673 (0.0008) [2023-12-26 05:31:18,716][123091] Updated weights for policy 0, policy_version 742683 (0.0010) [2023-12-26 05:31:18,770][123091] Updated weights for policy 0, policy_version 742693 (0.0009) [2023-12-26 05:31:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 379084800. Throughput: 0: 8661.6, 1: 8877.2. Samples: 379101512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:18,785][121949] Avg episode reward: [(0, '5989.156'), (1, '5146.086')] [2023-12-26 05:31:18,832][123091] Updated weights for policy 0, policy_version 742703 (0.0009) [2023-12-26 05:31:18,913][123090] Updated weights for policy 1, policy_version 738116 (0.0010) [2023-12-26 05:31:18,984][123090] Updated weights for policy 1, policy_version 738126 (0.0011) [2023-12-26 05:31:19,061][123090] Updated weights for policy 1, policy_version 738136 (0.0008) [2023-12-26 05:31:19,681][123091] Updated weights for policy 0, policy_version 742713 (0.0009) [2023-12-26 05:31:19,751][123091] Updated weights for policy 0, policy_version 742723 (0.0008) [2023-12-26 05:31:19,829][123091] Updated weights for policy 0, policy_version 742733 (0.0007) [2023-12-26 05:31:19,896][123090] Updated weights for policy 1, policy_version 738146 (0.0007) [2023-12-26 05:31:19,973][123090] Updated weights for policy 1, policy_version 738156 (0.0010) [2023-12-26 05:31:20,033][123090] Updated weights for policy 1, policy_version 738166 (0.0010) [2023-12-26 05:31:20,097][123090] Updated weights for policy 1, policy_version 738176 (0.0009) [2023-12-26 05:31:20,637][123091] Updated weights for policy 0, policy_version 742743 (0.0009) [2023-12-26 05:31:20,699][123091] Updated weights for policy 0, policy_version 742753 (0.0008) [2023-12-26 05:31:20,769][123091] Updated weights for policy 0, policy_version 742763 (0.0008) [2023-12-26 05:31:20,879][123090] Updated weights for policy 1, policy_version 738186 (0.0005) [2023-12-26 05:31:20,937][123090] Updated weights for policy 1, policy_version 738196 (0.0006) [2023-12-26 05:31:20,998][123090] Updated weights for policy 1, policy_version 738206 (0.0006) [2023-12-26 05:31:21,620][123091] Updated weights for policy 0, policy_version 742773 (0.0009) [2023-12-26 05:31:21,687][123091] Updated weights for policy 0, policy_version 742783 (0.0009) [2023-12-26 05:31:21,753][123091] Updated weights for policy 0, policy_version 742793 (0.0008) [2023-12-26 05:31:21,852][123090] Updated weights for policy 1, policy_version 738216 (0.0010) [2023-12-26 05:31:21,915][123090] Updated weights for policy 1, policy_version 738226 (0.0010) [2023-12-26 05:31:21,971][123090] Updated weights for policy 1, policy_version 738236 (0.0011) [2023-12-26 05:31:22,492][123091] Updated weights for policy 0, policy_version 742803 (0.0006) [2023-12-26 05:31:22,561][123091] Updated weights for policy 0, policy_version 742813 (0.0007) [2023-12-26 05:31:22,634][123091] Updated weights for policy 0, policy_version 742823 (0.0006) [2023-12-26 05:31:22,753][123090] Updated weights for policy 1, policy_version 738246 (0.0008) [2023-12-26 05:31:22,814][123090] Updated weights for policy 1, policy_version 738256 (0.0006) [2023-12-26 05:31:22,869][123090] Updated weights for policy 1, policy_version 738266 (0.0007) [2023-12-26 05:31:23,405][123091] Updated weights for policy 0, policy_version 742833 (0.0006) [2023-12-26 05:31:23,458][123091] Updated weights for policy 0, policy_version 742843 (0.0009) [2023-12-26 05:31:23,515][123091] Updated weights for policy 0, policy_version 742854 (0.0010) [2023-12-26 05:31:23,593][123091] Updated weights for policy 0, policy_version 742864 (0.0007) [2023-12-26 05:31:23,600][123090] Updated weights for policy 1, policy_version 738276 (0.0008) [2023-12-26 05:31:23,655][123090] Updated weights for policy 1, policy_version 738286 (0.0009) [2023-12-26 05:31:23,716][123090] Updated weights for policy 1, policy_version 738296 (0.0009) [2023-12-26 05:31:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 379183104. Throughput: 0: 8680.1, 1: 8838.4. Samples: 379152844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:23,785][121949] Avg episode reward: [(0, '6015.308'), (1, '5184.540')] [2023-12-26 05:31:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000742864_190177280.pth... [2023-12-26 05:31:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000738304_189005824.pth... [2023-12-26 05:31:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000741872_189923328.pth [2023-12-26 05:31:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000737280_188743680.pth [2023-12-26 05:31:24,391][123091] Updated weights for policy 0, policy_version 742874 (0.0010) [2023-12-26 05:31:24,445][123090] Updated weights for policy 1, policy_version 738306 (0.0009) [2023-12-26 05:31:24,455][123091] Updated weights for policy 0, policy_version 742884 (0.0009) [2023-12-26 05:31:24,510][123090] Updated weights for policy 1, policy_version 738316 (0.0008) [2023-12-26 05:31:24,520][123091] Updated weights for policy 0, policy_version 742894 (0.0008) [2023-12-26 05:31:24,566][123090] Updated weights for policy 1, policy_version 738326 (0.0008) [2023-12-26 05:31:24,623][123090] Updated weights for policy 1, policy_version 738336 (0.0009) [2023-12-26 05:31:25,304][123091] Updated weights for policy 0, policy_version 742904 (0.0010) [2023-12-26 05:31:25,348][123091] Updated weights for policy 0, policy_version 742914 (0.0010) [2023-12-26 05:31:25,357][123090] Updated weights for policy 1, policy_version 738346 (0.0007) [2023-12-26 05:31:25,406][123091] Updated weights for policy 0, policy_version 742924 (0.0010) [2023-12-26 05:31:25,421][123090] Updated weights for policy 1, policy_version 738356 (0.0008) [2023-12-26 05:31:25,487][123090] Updated weights for policy 1, policy_version 738366 (0.0008) [2023-12-26 05:31:26,215][123091] Updated weights for policy 0, policy_version 742934 (0.0009) [2023-12-26 05:31:26,230][123090] Updated weights for policy 1, policy_version 738376 (0.0006) [2023-12-26 05:31:26,269][123091] Updated weights for policy 0, policy_version 742944 (0.0009) [2023-12-26 05:31:26,287][123090] Updated weights for policy 1, policy_version 738386 (0.0005) [2023-12-26 05:31:26,338][123091] Updated weights for policy 0, policy_version 742954 (0.0006) [2023-12-26 05:31:26,350][123090] Updated weights for policy 1, policy_version 738396 (0.0006) [2023-12-26 05:31:27,013][123091] Updated weights for policy 0, policy_version 742964 (0.0009) [2023-12-26 05:31:27,078][123091] Updated weights for policy 0, policy_version 742974 (0.0010) [2023-12-26 05:31:27,140][123091] Updated weights for policy 0, policy_version 742984 (0.0011) [2023-12-26 05:31:27,187][123090] Updated weights for policy 1, policy_version 738406 (0.0007) [2023-12-26 05:31:27,246][123090] Updated weights for policy 1, policy_version 738416 (0.0005) [2023-12-26 05:31:27,298][123090] Updated weights for policy 1, policy_version 738426 (0.0005) [2023-12-26 05:31:27,949][123091] Updated weights for policy 0, policy_version 742994 (0.0010) [2023-12-26 05:31:28,004][123091] Updated weights for policy 0, policy_version 743004 (0.0008) [2023-12-26 05:31:28,053][123091] Updated weights for policy 0, policy_version 743014 (0.0010) [2023-12-26 05:31:28,091][123090] Updated weights for policy 1, policy_version 738436 (0.0006) [2023-12-26 05:31:28,148][123090] Updated weights for policy 1, policy_version 738447 (0.0009) [2023-12-26 05:31:28,216][123090] Updated weights for policy 1, policy_version 738457 (0.0009) [2023-12-26 05:31:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 379265024. Throughput: 0: 8696.7, 1: 8877.0. Samples: 379261960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:31:28,785][121949] Avg episode reward: [(0, '5985.182'), (1, '5259.641')] [2023-12-26 05:31:28,881][123090] Updated weights for policy 1, policy_version 738467 (0.0009) [2023-12-26 05:31:28,903][123091] Updated weights for policy 0, policy_version 743025 (0.0009) [2023-12-26 05:31:28,948][123090] Updated weights for policy 1, policy_version 738477 (0.0008) [2023-12-26 05:31:28,965][123091] Updated weights for policy 0, policy_version 743035 (0.0008) [2023-12-26 05:31:29,009][123090] Updated weights for policy 1, policy_version 738487 (0.0009) [2023-12-26 05:31:29,031][123091] Updated weights for policy 0, policy_version 743045 (0.0006) [2023-12-26 05:31:29,094][123091] Updated weights for policy 0, policy_version 743055 (0.0008) [2023-12-26 05:31:29,872][123091] Updated weights for policy 0, policy_version 743065 (0.0008) [2023-12-26 05:31:29,887][123090] Updated weights for policy 1, policy_version 738497 (0.0009) [2023-12-26 05:31:29,943][123091] Updated weights for policy 0, policy_version 743075 (0.0008) [2023-12-26 05:31:29,952][123090] Updated weights for policy 1, policy_version 738507 (0.0008) [2023-12-26 05:31:30,008][123091] Updated weights for policy 0, policy_version 743085 (0.0008) [2023-12-26 05:31:30,017][123090] Updated weights for policy 1, policy_version 738517 (0.0008) [2023-12-26 05:31:30,075][123090] Updated weights for policy 1, policy_version 738527 (0.0009) [2023-12-26 05:31:30,707][123091] Updated weights for policy 0, policy_version 743095 (0.0007) [2023-12-26 05:31:30,772][123091] Updated weights for policy 0, policy_version 743105 (0.0010) [2023-12-26 05:31:30,820][123091] Updated weights for policy 0, policy_version 743115 (0.0011) [2023-12-26 05:31:30,952][123090] Updated weights for policy 1, policy_version 738537 (0.0006) [2023-12-26 05:31:31,019][123090] Updated weights for policy 1, policy_version 738547 (0.0005) [2023-12-26 05:31:31,081][123090] Updated weights for policy 1, policy_version 738557 (0.0007) [2023-12-26 05:31:31,671][123091] Updated weights for policy 0, policy_version 743125 (0.0010) [2023-12-26 05:31:31,741][123091] Updated weights for policy 0, policy_version 743135 (0.0008) [2023-12-26 05:31:31,807][123091] Updated weights for policy 0, policy_version 743145 (0.0006) [2023-12-26 05:31:31,811][123090] Updated weights for policy 1, policy_version 738567 (0.0009) [2023-12-26 05:31:31,879][123090] Updated weights for policy 1, policy_version 738577 (0.0011) [2023-12-26 05:31:31,944][123090] Updated weights for policy 1, policy_version 738587 (0.0010) [2023-12-26 05:31:32,606][123091] Updated weights for policy 0, policy_version 743155 (0.0009) [2023-12-26 05:31:32,663][123091] Updated weights for policy 0, policy_version 743165 (0.0009) [2023-12-26 05:31:32,720][123091] Updated weights for policy 0, policy_version 743175 (0.0009) [2023-12-26 05:31:32,757][123090] Updated weights for policy 1, policy_version 738597 (0.0008) [2023-12-26 05:31:32,823][123090] Updated weights for policy 1, policy_version 738607 (0.0005) [2023-12-26 05:31:32,870][123090] Updated weights for policy 1, policy_version 738617 (0.0005) [2023-12-26 05:31:33,516][123091] Updated weights for policy 0, policy_version 743185 (0.0008) [2023-12-26 05:31:33,540][123090] Updated weights for policy 1, policy_version 738627 (0.0005) [2023-12-26 05:31:33,565][123091] Updated weights for policy 0, policy_version 743195 (0.0005) [2023-12-26 05:31:33,593][123090] Updated weights for policy 1, policy_version 738637 (0.0005) [2023-12-26 05:31:33,617][123091] Updated weights for policy 0, policy_version 743205 (0.0005) [2023-12-26 05:31:33,647][123090] Updated weights for policy 1, policy_version 738647 (0.0005) [2023-12-26 05:31:33,675][123091] Updated weights for policy 0, policy_version 743215 (0.0005) [2023-12-26 05:31:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 379363328. Throughput: 0: 8625.6, 1: 8832.8. Samples: 379369752. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:33,784][121949] Avg episode reward: [(0, '5992.976'), (1, '5242.850')] [2023-12-26 05:31:34,310][123091] Updated weights for policy 0, policy_version 743225 (0.0010) [2023-12-26 05:31:34,386][123091] Updated weights for policy 0, policy_version 743235 (0.0011) [2023-12-26 05:31:34,389][123090] Updated weights for policy 1, policy_version 738657 (0.0005) [2023-12-26 05:31:34,450][123091] Updated weights for policy 0, policy_version 743245 (0.0011) [2023-12-26 05:31:34,455][123090] Updated weights for policy 1, policy_version 738667 (0.0008) [2023-12-26 05:31:34,527][123090] Updated weights for policy 1, policy_version 738677 (0.0010) [2023-12-26 05:31:34,585][123090] Updated weights for policy 1, policy_version 738687 (0.0010) [2023-12-26 05:31:35,259][123091] Updated weights for policy 0, policy_version 743255 (0.0011) [2023-12-26 05:31:35,282][123090] Updated weights for policy 1, policy_version 738697 (0.0010) [2023-12-26 05:31:35,319][123091] Updated weights for policy 0, policy_version 743265 (0.0011) [2023-12-26 05:31:35,341][123090] Updated weights for policy 1, policy_version 738707 (0.0010) [2023-12-26 05:31:35,370][123091] Updated weights for policy 0, policy_version 743275 (0.0010) [2023-12-26 05:31:35,396][123090] Updated weights for policy 1, policy_version 738717 (0.0010) [2023-12-26 05:31:36,152][123090] Updated weights for policy 1, policy_version 738727 (0.0008) [2023-12-26 05:31:36,210][123090] Updated weights for policy 1, policy_version 738737 (0.0008) [2023-12-26 05:31:36,221][123091] Updated weights for policy 0, policy_version 743285 (0.0011) [2023-12-26 05:31:36,263][123090] Updated weights for policy 1, policy_version 738747 (0.0010) [2023-12-26 05:31:36,284][123091] Updated weights for policy 0, policy_version 743295 (0.0011) [2023-12-26 05:31:36,348][123091] Updated weights for policy 0, policy_version 743305 (0.0011) [2023-12-26 05:31:36,998][123090] Updated weights for policy 1, policy_version 738757 (0.0008) [2023-12-26 05:31:37,045][123090] Updated weights for policy 1, policy_version 738767 (0.0005) [2023-12-26 05:31:37,098][123090] Updated weights for policy 1, policy_version 738777 (0.0008) [2023-12-26 05:31:37,145][123091] Updated weights for policy 0, policy_version 743315 (0.0010) [2023-12-26 05:31:37,204][123091] Updated weights for policy 0, policy_version 743325 (0.0010) [2023-12-26 05:31:37,261][123091] Updated weights for policy 0, policy_version 743335 (0.0009) [2023-12-26 05:31:37,936][123090] Updated weights for policy 1, policy_version 738787 (0.0010) [2023-12-26 05:31:37,996][123090] Updated weights for policy 1, policy_version 738797 (0.0008) [2023-12-26 05:31:38,050][123090] Updated weights for policy 1, policy_version 738807 (0.0009) [2023-12-26 05:31:38,093][123091] Updated weights for policy 0, policy_version 743345 (0.0008) [2023-12-26 05:31:38,151][123091] Updated weights for policy 0, policy_version 743355 (0.0007) [2023-12-26 05:31:38,207][123091] Updated weights for policy 0, policy_version 743365 (0.0005) [2023-12-26 05:31:38,270][123091] Updated weights for policy 0, policy_version 743375 (0.0005) [2023-12-26 05:31:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 379445248. Throughput: 0: 8669.4, 1: 8874.1. Samples: 379425304. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:38,785][121949] Avg episode reward: [(0, '5941.064'), (1, '5137.649')] [2023-12-26 05:31:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000743376_190308352.pth... [2023-12-26 05:31:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000738816_189136896.pth... [2023-12-26 05:31:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000742352_190046208.pth [2023-12-26 05:31:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000737792_188874752.pth [2023-12-26 05:31:38,941][123091] Updated weights for policy 0, policy_version 743385 (0.0010) [2023-12-26 05:31:38,965][123090] Updated weights for policy 1, policy_version 738817 (0.0008) [2023-12-26 05:31:38,995][123091] Updated weights for policy 0, policy_version 743395 (0.0006) [2023-12-26 05:31:39,017][123090] Updated weights for policy 1, policy_version 738827 (0.0009) [2023-12-26 05:31:39,040][123091] Updated weights for policy 0, policy_version 743405 (0.0005) [2023-12-26 05:31:39,067][123090] Updated weights for policy 1, policy_version 738837 (0.0009) [2023-12-26 05:31:39,125][123090] Updated weights for policy 1, policy_version 738848 (0.0010) [2023-12-26 05:31:39,895][123091] Updated weights for policy 0, policy_version 743415 (0.0006) [2023-12-26 05:31:39,959][123090] Updated weights for policy 1, policy_version 738858 (0.0007) [2023-12-26 05:31:39,974][123091] Updated weights for policy 0, policy_version 743425 (0.0007) [2023-12-26 05:31:40,034][123090] Updated weights for policy 1, policy_version 738868 (0.0008) [2023-12-26 05:31:40,038][123091] Updated weights for policy 0, policy_version 743435 (0.0007) [2023-12-26 05:31:40,107][123090] Updated weights for policy 1, policy_version 738878 (0.0008) [2023-12-26 05:31:40,737][123091] Updated weights for policy 0, policy_version 743445 (0.0006) [2023-12-26 05:31:40,790][123091] Updated weights for policy 0, policy_version 743455 (0.0005) [2023-12-26 05:31:40,841][123091] Updated weights for policy 0, policy_version 743465 (0.0008) [2023-12-26 05:31:40,980][123090] Updated weights for policy 1, policy_version 738888 (0.0010) [2023-12-26 05:31:41,057][123090] Updated weights for policy 1, policy_version 738898 (0.0010) [2023-12-26 05:31:41,116][123090] Updated weights for policy 1, policy_version 738908 (0.0010) [2023-12-26 05:31:41,537][123091] Updated weights for policy 0, policy_version 743475 (0.0009) [2023-12-26 05:31:41,599][123091] Updated weights for policy 0, policy_version 743485 (0.0008) [2023-12-26 05:31:41,670][123091] Updated weights for policy 0, policy_version 743495 (0.0008) [2023-12-26 05:31:42,024][123090] Updated weights for policy 1, policy_version 738918 (0.0009) [2023-12-26 05:31:42,095][123090] Updated weights for policy 1, policy_version 738928 (0.0009) [2023-12-26 05:31:42,168][123090] Updated weights for policy 1, policy_version 738938 (0.0009) [2023-12-26 05:31:42,526][123091] Updated weights for policy 0, policy_version 743505 (0.0008) [2023-12-26 05:31:42,592][123091] Updated weights for policy 0, policy_version 743515 (0.0010) [2023-12-26 05:31:42,656][123091] Updated weights for policy 0, policy_version 743525 (0.0009) [2023-12-26 05:31:42,721][123091] Updated weights for policy 0, policy_version 743535 (0.0010) [2023-12-26 05:31:42,999][123090] Updated weights for policy 1, policy_version 738948 (0.0009) [2023-12-26 05:31:43,057][123090] Updated weights for policy 1, policy_version 738958 (0.0009) [2023-12-26 05:31:43,105][123090] Updated weights for policy 1, policy_version 738968 (0.0009) [2023-12-26 05:31:43,575][123091] Updated weights for policy 0, policy_version 743545 (0.0008) [2023-12-26 05:31:43,641][123091] Updated weights for policy 0, policy_version 743555 (0.0005) [2023-12-26 05:31:43,712][123091] Updated weights for policy 0, policy_version 743565 (0.0005) [2023-12-26 05:31:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 379535360. Throughput: 0: 8725.4, 1: 8845.4. Samples: 379529064. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:43,785][121949] Avg episode reward: [(0, '6075.089'), (1, '5162.847')] [2023-12-26 05:31:43,896][123090] Updated weights for policy 1, policy_version 738978 (0.0008) [2023-12-26 05:31:43,954][123090] Updated weights for policy 1, policy_version 738988 (0.0006) [2023-12-26 05:31:44,007][123090] Updated weights for policy 1, policy_version 738998 (0.0005) [2023-12-26 05:31:44,067][123090] Updated weights for policy 1, policy_version 739008 (0.0005) [2023-12-26 05:31:44,341][123091] Updated weights for policy 0, policy_version 743575 (0.0009) [2023-12-26 05:31:44,385][123091] Updated weights for policy 0, policy_version 743585 (0.0009) [2023-12-26 05:31:44,428][123091] Updated weights for policy 0, policy_version 743595 (0.0005) [2023-12-26 05:31:44,630][123090] Updated weights for policy 1, policy_version 739018 (0.0007) [2023-12-26 05:31:44,693][123090] Updated weights for policy 1, policy_version 739028 (0.0006) [2023-12-26 05:31:44,752][123090] Updated weights for policy 1, policy_version 739038 (0.0009) [2023-12-26 05:31:45,258][123091] Updated weights for policy 0, policy_version 743605 (0.0008) [2023-12-26 05:31:45,327][123091] Updated weights for policy 0, policy_version 743615 (0.0010) [2023-12-26 05:31:45,397][123091] Updated weights for policy 0, policy_version 743625 (0.0006) [2023-12-26 05:31:45,574][123090] Updated weights for policy 1, policy_version 739048 (0.0008) [2023-12-26 05:31:45,633][123090] Updated weights for policy 1, policy_version 739058 (0.0009) [2023-12-26 05:31:45,679][123090] Updated weights for policy 1, policy_version 739068 (0.0008) [2023-12-26 05:31:46,115][123091] Updated weights for policy 0, policy_version 743635 (0.0007) [2023-12-26 05:31:46,168][123091] Updated weights for policy 0, policy_version 743645 (0.0011) [2023-12-26 05:31:46,224][123091] Updated weights for policy 0, policy_version 743655 (0.0011) [2023-12-26 05:31:46,575][123090] Updated weights for policy 1, policy_version 739078 (0.0007) [2023-12-26 05:31:46,643][123090] Updated weights for policy 1, policy_version 739088 (0.0008) [2023-12-26 05:31:46,707][123090] Updated weights for policy 1, policy_version 739098 (0.0009) [2023-12-26 05:31:46,997][123091] Updated weights for policy 0, policy_version 743665 (0.0011) [2023-12-26 05:31:47,063][123091] Updated weights for policy 0, policy_version 743675 (0.0010) [2023-12-26 05:31:47,119][123091] Updated weights for policy 0, policy_version 743685 (0.0005) [2023-12-26 05:31:47,167][123091] Updated weights for policy 0, policy_version 743695 (0.0005) [2023-12-26 05:31:47,423][123090] Updated weights for policy 1, policy_version 739108 (0.0007) [2023-12-26 05:31:47,468][123090] Updated weights for policy 1, policy_version 739118 (0.0005) [2023-12-26 05:31:47,525][123090] Updated weights for policy 1, policy_version 739128 (0.0005) [2023-12-26 05:31:47,879][123091] Updated weights for policy 0, policy_version 743705 (0.0008) [2023-12-26 05:31:47,933][123091] Updated weights for policy 0, policy_version 743715 (0.0007) [2023-12-26 05:31:47,989][123091] Updated weights for policy 0, policy_version 743725 (0.0008) [2023-12-26 05:31:48,371][123090] Updated weights for policy 1, policy_version 739138 (0.0009) [2023-12-26 05:31:48,430][123090] Updated weights for policy 1, policy_version 739148 (0.0009) [2023-12-26 05:31:48,496][123090] Updated weights for policy 1, policy_version 739158 (0.0010) [2023-12-26 05:31:48,563][123090] Updated weights for policy 1, policy_version 739168 (0.0010) [2023-12-26 05:31:48,759][123091] Updated weights for policy 0, policy_version 743735 (0.0008) [2023-12-26 05:31:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 379625472. Throughput: 0: 8817.7, 1: 8866.1. Samples: 379638116. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:48,785][121949] Avg episode reward: [(0, '6116.889'), (1, '5321.593')] [2023-12-26 05:31:48,814][123091] Updated weights for policy 0, policy_version 743745 (0.0009) [2023-12-26 05:31:48,876][123091] Updated weights for policy 0, policy_version 743755 (0.0009) [2023-12-26 05:31:49,231][123090] Updated weights for policy 1, policy_version 739178 (0.0010) [2023-12-26 05:31:49,296][123090] Updated weights for policy 1, policy_version 739188 (0.0009) [2023-12-26 05:31:49,364][123090] Updated weights for policy 1, policy_version 739198 (0.0010) [2023-12-26 05:31:49,713][123091] Updated weights for policy 0, policy_version 743765 (0.0007) [2023-12-26 05:31:49,782][123091] Updated weights for policy 0, policy_version 743775 (0.0006) [2023-12-26 05:31:49,856][123091] Updated weights for policy 0, policy_version 743785 (0.0007) [2023-12-26 05:31:50,253][123090] Updated weights for policy 1, policy_version 739208 (0.0009) [2023-12-26 05:31:50,323][123090] Updated weights for policy 1, policy_version 739218 (0.0010) [2023-12-26 05:31:50,376][123090] Updated weights for policy 1, policy_version 739228 (0.0010) [2023-12-26 05:31:50,482][123091] Updated weights for policy 0, policy_version 743795 (0.0008) [2023-12-26 05:31:50,555][123091] Updated weights for policy 0, policy_version 743805 (0.0009) [2023-12-26 05:31:50,624][123091] Updated weights for policy 0, policy_version 743815 (0.0007) [2023-12-26 05:31:51,284][123090] Updated weights for policy 1, policy_version 739238 (0.0009) [2023-12-26 05:31:51,351][123090] Updated weights for policy 1, policy_version 739248 (0.0010) [2023-12-26 05:31:51,370][123091] Updated weights for policy 0, policy_version 743825 (0.0006) [2023-12-26 05:31:51,405][123090] Updated weights for policy 1, policy_version 739258 (0.0010) [2023-12-26 05:31:51,430][123091] Updated weights for policy 0, policy_version 743835 (0.0008) [2023-12-26 05:31:51,486][123091] Updated weights for policy 0, policy_version 743845 (0.0006) [2023-12-26 05:31:51,549][123091] Updated weights for policy 0, policy_version 743855 (0.0009) [2023-12-26 05:31:52,257][123090] Updated weights for policy 1, policy_version 739268 (0.0010) [2023-12-26 05:31:52,313][123090] Updated weights for policy 1, policy_version 739278 (0.0009) [2023-12-26 05:31:52,381][123090] Updated weights for policy 1, policy_version 739288 (0.0009) [2023-12-26 05:31:52,398][123091] Updated weights for policy 0, policy_version 743865 (0.0007) [2023-12-26 05:31:52,469][123091] Updated weights for policy 0, policy_version 743875 (0.0006) [2023-12-26 05:31:52,535][123091] Updated weights for policy 0, policy_version 743885 (0.0007) [2023-12-26 05:31:53,229][123091] Updated weights for policy 0, policy_version 743895 (0.0006) [2023-12-26 05:31:53,293][123090] Updated weights for policy 1, policy_version 739298 (0.0008) [2023-12-26 05:31:53,298][123091] Updated weights for policy 0, policy_version 743905 (0.0006) [2023-12-26 05:31:53,343][123090] Updated weights for policy 1, policy_version 739308 (0.0008) [2023-12-26 05:31:53,358][123091] Updated weights for policy 0, policy_version 743915 (0.0009) [2023-12-26 05:31:53,406][123090] Updated weights for policy 1, policy_version 739318 (0.0010) [2023-12-26 05:31:53,475][123090] Updated weights for policy 1, policy_version 739328 (0.0010) [2023-12-26 05:31:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17717.1). Total num frames: 379715584. Throughput: 0: 8861.9, 1: 8837.3. Samples: 379690224. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:53,785][121949] Avg episode reward: [(0, '6170.150'), (1, '5264.521')] [2023-12-26 05:31:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000739328_189267968.pth... [2023-12-26 05:31:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000743920_190447616.pth... [2023-12-26 05:31:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000738304_189005824.pth [2023-12-26 05:31:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000742864_190177280.pth [2023-12-26 05:31:54,100][123091] Updated weights for policy 0, policy_version 743925 (0.0007) [2023-12-26 05:31:54,156][123091] Updated weights for policy 0, policy_version 743935 (0.0009) [2023-12-26 05:31:54,212][123091] Updated weights for policy 0, policy_version 743945 (0.0009) [2023-12-26 05:31:54,280][123090] Updated weights for policy 1, policy_version 739338 (0.0010) [2023-12-26 05:31:54,338][123090] Updated weights for policy 1, policy_version 739348 (0.0010) [2023-12-26 05:31:54,407][123090] Updated weights for policy 1, policy_version 739358 (0.0010) [2023-12-26 05:31:55,040][123091] Updated weights for policy 0, policy_version 743955 (0.0008) [2023-12-26 05:31:55,103][123091] Updated weights for policy 0, policy_version 743965 (0.0009) [2023-12-26 05:31:55,154][123091] Updated weights for policy 0, policy_version 743975 (0.0008) [2023-12-26 05:31:55,235][123090] Updated weights for policy 1, policy_version 739368 (0.0010) [2023-12-26 05:31:55,289][123090] Updated weights for policy 1, policy_version 739378 (0.0010) [2023-12-26 05:31:55,351][123090] Updated weights for policy 1, policy_version 739388 (0.0010) [2023-12-26 05:31:55,990][123091] Updated weights for policy 0, policy_version 743986 (0.0009) [2023-12-26 05:31:56,041][123091] Updated weights for policy 0, policy_version 743996 (0.0009) [2023-12-26 05:31:56,089][123091] Updated weights for policy 0, policy_version 744006 (0.0008) [2023-12-26 05:31:56,137][123091] Updated weights for policy 0, policy_version 744016 (0.0009) [2023-12-26 05:31:56,171][123090] Updated weights for policy 1, policy_version 739398 (0.0010) [2023-12-26 05:31:56,229][123090] Updated weights for policy 1, policy_version 739408 (0.0010) [2023-12-26 05:31:56,299][123090] Updated weights for policy 1, policy_version 739418 (0.0011) [2023-12-26 05:31:56,937][123091] Updated weights for policy 0, policy_version 744026 (0.0005) [2023-12-26 05:31:57,006][123091] Updated weights for policy 0, policy_version 744036 (0.0005) [2023-12-26 05:31:57,069][123091] Updated weights for policy 0, policy_version 744046 (0.0005) [2023-12-26 05:31:57,098][123090] Updated weights for policy 1, policy_version 739428 (0.0008) [2023-12-26 05:31:57,144][123090] Updated weights for policy 1, policy_version 739438 (0.0005) [2023-12-26 05:31:57,192][123090] Updated weights for policy 1, policy_version 739448 (0.0008) [2023-12-26 05:31:57,738][123091] Updated weights for policy 0, policy_version 744056 (0.0009) [2023-12-26 05:31:57,795][123091] Updated weights for policy 0, policy_version 744067 (0.0009) [2023-12-26 05:31:57,847][123091] Updated weights for policy 0, policy_version 744078 (0.0010) [2023-12-26 05:31:57,916][123090] Updated weights for policy 1, policy_version 739458 (0.0010) [2023-12-26 05:31:57,964][123090] Updated weights for policy 1, policy_version 739468 (0.0009) [2023-12-26 05:31:58,026][123090] Updated weights for policy 1, policy_version 739478 (0.0009) [2023-12-26 05:31:58,091][123090] Updated weights for policy 1, policy_version 739488 (0.0009) [2023-12-26 05:31:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 379797504. Throughput: 0: 9021.5, 1: 8818.6. Samples: 379796844. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:31:58,785][121949] Avg episode reward: [(0, '6016.355'), (1, '5083.991')] [2023-12-26 05:31:58,819][123091] Updated weights for policy 0, policy_version 744088 (0.0010) [2023-12-26 05:31:58,886][123091] Updated weights for policy 0, policy_version 744098 (0.0011) [2023-12-26 05:31:58,960][123091] Updated weights for policy 0, policy_version 744108 (0.0011) [2023-12-26 05:31:59,075][123090] Updated weights for policy 1, policy_version 739498 (0.0010) [2023-12-26 05:31:59,137][123090] Updated weights for policy 1, policy_version 739508 (0.0010) [2023-12-26 05:31:59,202][123090] Updated weights for policy 1, policy_version 739518 (0.0010) [2023-12-26 05:31:59,677][123091] Updated weights for policy 0, policy_version 744118 (0.0007) [2023-12-26 05:31:59,745][123091] Updated weights for policy 0, policy_version 744128 (0.0005) [2023-12-26 05:31:59,796][123091] Updated weights for policy 0, policy_version 744138 (0.0005) [2023-12-26 05:32:00,027][123090] Updated weights for policy 1, policy_version 739528 (0.0009) [2023-12-26 05:32:00,091][123090] Updated weights for policy 1, policy_version 739538 (0.0009) [2023-12-26 05:32:00,153][123090] Updated weights for policy 1, policy_version 739548 (0.0010) [2023-12-26 05:32:00,508][123091] Updated weights for policy 0, policy_version 744148 (0.0008) [2023-12-26 05:32:00,561][123091] Updated weights for policy 0, policy_version 744158 (0.0005) [2023-12-26 05:32:00,605][123091] Updated weights for policy 0, policy_version 744168 (0.0005) [2023-12-26 05:32:00,936][123090] Updated weights for policy 1, policy_version 739558 (0.0010) [2023-12-26 05:32:01,010][123090] Updated weights for policy 1, policy_version 739568 (0.0011) [2023-12-26 05:32:01,077][123090] Updated weights for policy 1, policy_version 739578 (0.0010) [2023-12-26 05:32:01,401][123091] Updated weights for policy 0, policy_version 744178 (0.0010) [2023-12-26 05:32:01,464][123091] Updated weights for policy 0, policy_version 744188 (0.0011) [2023-12-26 05:32:01,529][123091] Updated weights for policy 0, policy_version 744198 (0.0010) [2023-12-26 05:32:01,588][123091] Updated weights for policy 0, policy_version 744208 (0.0007) [2023-12-26 05:32:01,826][123090] Updated weights for policy 1, policy_version 739588 (0.0009) [2023-12-26 05:32:01,881][123090] Updated weights for policy 1, policy_version 739598 (0.0008) [2023-12-26 05:32:01,946][123090] Updated weights for policy 1, policy_version 739608 (0.0009) [2023-12-26 05:32:02,305][123091] Updated weights for policy 0, policy_version 744218 (0.0005) [2023-12-26 05:32:02,370][123091] Updated weights for policy 0, policy_version 744228 (0.0006) [2023-12-26 05:32:02,433][123091] Updated weights for policy 0, policy_version 744238 (0.0011) [2023-12-26 05:32:02,828][123090] Updated weights for policy 1, policy_version 739618 (0.0007) [2023-12-26 05:32:02,889][123090] Updated weights for policy 1, policy_version 739628 (0.0010) [2023-12-26 05:32:02,960][123090] Updated weights for policy 1, policy_version 739638 (0.0007) [2023-12-26 05:32:03,025][123090] Updated weights for policy 1, policy_version 739648 (0.0010) [2023-12-26 05:32:03,172][123091] Updated weights for policy 0, policy_version 744248 (0.0006) [2023-12-26 05:32:03,220][123091] Updated weights for policy 0, policy_version 744258 (0.0007) [2023-12-26 05:32:03,265][123091] Updated weights for policy 0, policy_version 744268 (0.0005) [2023-12-26 05:32:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 379887616. Throughput: 0: 9031.8, 1: 8758.4. Samples: 379902072. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:03,785][121949] Avg episode reward: [(0, '6038.879'), (1, '5158.569')] [2023-12-26 05:32:03,846][123090] Updated weights for policy 1, policy_version 739658 (0.0008) [2023-12-26 05:32:03,918][123090] Updated weights for policy 1, policy_version 739668 (0.0007) [2023-12-26 05:32:03,978][123090] Updated weights for policy 1, policy_version 739678 (0.0010) [2023-12-26 05:32:04,038][123091] Updated weights for policy 0, policy_version 744278 (0.0007) [2023-12-26 05:32:04,101][123091] Updated weights for policy 0, policy_version 744288 (0.0005) [2023-12-26 05:32:04,158][123091] Updated weights for policy 0, policy_version 744298 (0.0011) [2023-12-26 05:32:04,745][123090] Updated weights for policy 1, policy_version 739688 (0.0005) [2023-12-26 05:32:04,794][123090] Updated weights for policy 1, policy_version 739698 (0.0007) [2023-12-26 05:32:04,856][123090] Updated weights for policy 1, policy_version 739708 (0.0009) [2023-12-26 05:32:04,933][123091] Updated weights for policy 0, policy_version 744308 (0.0011) [2023-12-26 05:32:04,995][123091] Updated weights for policy 0, policy_version 744318 (0.0010) [2023-12-26 05:32:05,058][123091] Updated weights for policy 0, policy_version 744328 (0.0010) [2023-12-26 05:32:05,595][123090] Updated weights for policy 1, policy_version 739718 (0.0009) [2023-12-26 05:32:05,654][123090] Updated weights for policy 1, policy_version 739728 (0.0009) [2023-12-26 05:32:05,679][123091] Updated weights for policy 0, policy_version 744338 (0.0009) [2023-12-26 05:32:05,711][123090] Updated weights for policy 1, policy_version 739738 (0.0008) [2023-12-26 05:32:05,740][123091] Updated weights for policy 0, policy_version 744348 (0.0005) [2023-12-26 05:32:05,800][123091] Updated weights for policy 0, policy_version 744358 (0.0006) [2023-12-26 05:32:05,862][123091] Updated weights for policy 0, policy_version 744368 (0.0010) [2023-12-26 05:32:06,528][123090] Updated weights for policy 1, policy_version 739748 (0.0010) [2023-12-26 05:32:06,591][123090] Updated weights for policy 1, policy_version 739758 (0.0008) [2023-12-26 05:32:06,612][123091] Updated weights for policy 0, policy_version 744378 (0.0009) [2023-12-26 05:32:06,655][123090] Updated weights for policy 1, policy_version 739768 (0.0008) [2023-12-26 05:32:06,673][123091] Updated weights for policy 0, policy_version 744388 (0.0009) [2023-12-26 05:32:06,743][123091] Updated weights for policy 0, policy_version 744398 (0.0010) [2023-12-26 05:32:07,468][123090] Updated weights for policy 1, policy_version 739778 (0.0007) [2023-12-26 05:32:07,536][123090] Updated weights for policy 1, policy_version 739788 (0.0010) [2023-12-26 05:32:07,561][123091] Updated weights for policy 0, policy_version 744408 (0.0006) [2023-12-26 05:32:07,602][123090] Updated weights for policy 1, policy_version 739798 (0.0009) [2023-12-26 05:32:07,617][123091] Updated weights for policy 0, policy_version 744418 (0.0006) [2023-12-26 05:32:07,659][123090] Updated weights for policy 1, policy_version 739808 (0.0009) [2023-12-26 05:32:07,664][123091] Updated weights for policy 0, policy_version 744428 (0.0005) [2023-12-26 05:32:08,389][123091] Updated weights for policy 0, policy_version 744438 (0.0007) [2023-12-26 05:32:08,446][123091] Updated weights for policy 0, policy_version 744448 (0.0010) [2023-12-26 05:32:08,468][123090] Updated weights for policy 1, policy_version 739818 (0.0007) [2023-12-26 05:32:08,498][123091] Updated weights for policy 0, policy_version 744458 (0.0010) [2023-12-26 05:32:08,544][123090] Updated weights for policy 1, policy_version 739828 (0.0005) [2023-12-26 05:32:08,614][123090] Updated weights for policy 1, policy_version 739838 (0.0008) [2023-12-26 05:32:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 379985920. Throughput: 0: 9112.0, 1: 8772.5. Samples: 379957644. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:08,785][121949] Avg episode reward: [(0, '6114.035'), (1, '5143.123')] [2023-12-26 05:32:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000744464_190586880.pth... [2023-12-26 05:32:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000739840_189399040.pth... [2023-12-26 05:32:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000743376_190308352.pth [2023-12-26 05:32:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000738816_189136896.pth [2023-12-26 05:32:09,293][123091] Updated weights for policy 0, policy_version 744468 (0.0007) [2023-12-26 05:32:09,361][123091] Updated weights for policy 0, policy_version 744478 (0.0009) [2023-12-26 05:32:09,439][123091] Updated weights for policy 0, policy_version 744488 (0.0009) [2023-12-26 05:32:09,462][123090] Updated weights for policy 1, policy_version 739848 (0.0007) [2023-12-26 05:32:09,538][123090] Updated weights for policy 1, policy_version 739858 (0.0006) [2023-12-26 05:32:09,608][123090] Updated weights for policy 1, policy_version 739868 (0.0006) [2023-12-26 05:32:10,216][123091] Updated weights for policy 0, policy_version 744498 (0.0008) [2023-12-26 05:32:10,287][123091] Updated weights for policy 0, policy_version 744508 (0.0010) [2023-12-26 05:32:10,352][123091] Updated weights for policy 0, policy_version 744518 (0.0007) [2023-12-26 05:32:10,419][123091] Updated weights for policy 0, policy_version 744528 (0.0007) [2023-12-26 05:32:10,456][123090] Updated weights for policy 1, policy_version 739878 (0.0007) [2023-12-26 05:32:10,518][123090] Updated weights for policy 1, policy_version 739888 (0.0009) [2023-12-26 05:32:10,573][123090] Updated weights for policy 1, policy_version 739898 (0.0006) [2023-12-26 05:32:11,158][123091] Updated weights for policy 0, policy_version 744538 (0.0010) [2023-12-26 05:32:11,219][123091] Updated weights for policy 0, policy_version 744548 (0.0008) [2023-12-26 05:32:11,286][123091] Updated weights for policy 0, policy_version 744558 (0.0010) [2023-12-26 05:32:11,354][123090] Updated weights for policy 1, policy_version 739908 (0.0009) [2023-12-26 05:32:11,423][123090] Updated weights for policy 1, policy_version 739918 (0.0010) [2023-12-26 05:32:11,486][123090] Updated weights for policy 1, policy_version 739928 (0.0010) [2023-12-26 05:32:12,130][123091] Updated weights for policy 0, policy_version 744568 (0.0006) [2023-12-26 05:32:12,205][123091] Updated weights for policy 0, policy_version 744578 (0.0008) [2023-12-26 05:32:12,274][123091] Updated weights for policy 0, policy_version 744588 (0.0009) [2023-12-26 05:32:12,358][123090] Updated weights for policy 1, policy_version 739938 (0.0009) [2023-12-26 05:32:12,431][123090] Updated weights for policy 1, policy_version 739948 (0.0010) [2023-12-26 05:32:12,503][123090] Updated weights for policy 1, policy_version 739958 (0.0009) [2023-12-26 05:32:12,566][123090] Updated weights for policy 1, policy_version 739968 (0.0010) [2023-12-26 05:32:12,980][123091] Updated weights for policy 0, policy_version 744598 (0.0006) [2023-12-26 05:32:13,038][123091] Updated weights for policy 0, policy_version 744608 (0.0006) [2023-12-26 05:32:13,091][123091] Updated weights for policy 0, policy_version 744618 (0.0006) [2023-12-26 05:32:13,404][123090] Updated weights for policy 1, policy_version 739979 (0.0010) [2023-12-26 05:32:13,466][123090] Updated weights for policy 1, policy_version 739989 (0.0010) [2023-12-26 05:32:13,519][123090] Updated weights for policy 1, policy_version 739999 (0.0009) [2023-12-26 05:32:13,717][123091] Updated weights for policy 0, policy_version 744628 (0.0006) [2023-12-26 05:32:13,775][123091] Updated weights for policy 0, policy_version 744638 (0.0008) [2023-12-26 05:32:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 380067840. Throughput: 0: 9097.3, 1: 8670.7. Samples: 380061524. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:13,785][121949] Avg episode reward: [(0, '6097.975'), (1, '5209.715')] [2023-12-26 05:32:13,832][123091] Updated weights for policy 0, policy_version 744648 (0.0007) [2023-12-26 05:32:14,416][123090] Updated weights for policy 1, policy_version 740009 (0.0006) [2023-12-26 05:32:14,487][123090] Updated weights for policy 1, policy_version 740019 (0.0005) [2023-12-26 05:32:14,545][123091] Updated weights for policy 0, policy_version 744658 (0.0006) [2023-12-26 05:32:14,555][123090] Updated weights for policy 1, policy_version 740029 (0.0006) [2023-12-26 05:32:14,609][123091] Updated weights for policy 0, policy_version 744668 (0.0008) [2023-12-26 05:32:14,665][123091] Updated weights for policy 0, policy_version 744679 (0.0010) [2023-12-26 05:32:15,223][123090] Updated weights for policy 1, policy_version 740039 (0.0006) [2023-12-26 05:32:15,284][123090] Updated weights for policy 1, policy_version 740049 (0.0009) [2023-12-26 05:32:15,344][123090] Updated weights for policy 1, policy_version 740059 (0.0010) [2023-12-26 05:32:15,602][123091] Updated weights for policy 0, policy_version 744689 (0.0010) [2023-12-26 05:32:15,667][123091] Updated weights for policy 0, policy_version 744699 (0.0009) [2023-12-26 05:32:15,729][123091] Updated weights for policy 0, policy_version 744709 (0.0008) [2023-12-26 05:32:15,779][123091] Updated weights for policy 0, policy_version 744719 (0.0010) [2023-12-26 05:32:16,160][123090] Updated weights for policy 1, policy_version 740069 (0.0010) [2023-12-26 05:32:16,225][123090] Updated weights for policy 1, policy_version 740079 (0.0010) [2023-12-26 05:32:16,292][123090] Updated weights for policy 1, policy_version 740089 (0.0009) [2023-12-26 05:32:16,611][123091] Updated weights for policy 0, policy_version 744729 (0.0010) [2023-12-26 05:32:16,665][123091] Updated weights for policy 0, policy_version 744739 (0.0009) [2023-12-26 05:32:16,728][123091] Updated weights for policy 0, policy_version 744749 (0.0010) [2023-12-26 05:32:17,121][123090] Updated weights for policy 1, policy_version 740099 (0.0009) [2023-12-26 05:32:17,186][123090] Updated weights for policy 1, policy_version 740109 (0.0009) [2023-12-26 05:32:17,238][123090] Updated weights for policy 1, policy_version 740119 (0.0009) [2023-12-26 05:32:17,570][123091] Updated weights for policy 0, policy_version 744759 (0.0009) [2023-12-26 05:32:17,619][123091] Updated weights for policy 0, policy_version 744769 (0.0009) [2023-12-26 05:32:17,677][123091] Updated weights for policy 0, policy_version 744779 (0.0012) [2023-12-26 05:32:18,090][123090] Updated weights for policy 1, policy_version 740129 (0.0009) [2023-12-26 05:32:18,148][123090] Updated weights for policy 1, policy_version 740139 (0.0010) [2023-12-26 05:32:18,202][123090] Updated weights for policy 1, policy_version 740149 (0.0009) [2023-12-26 05:32:18,254][123090] Updated weights for policy 1, policy_version 740159 (0.0009) [2023-12-26 05:32:18,522][123091] Updated weights for policy 0, policy_version 744789 (0.0009) [2023-12-26 05:32:18,575][123091] Updated weights for policy 0, policy_version 744799 (0.0009) [2023-12-26 05:32:18,626][123091] Updated weights for policy 0, policy_version 744809 (0.0009) [2023-12-26 05:32:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 380157952. Throughput: 0: 9092.3, 1: 8616.4. Samples: 380166640. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:18,784][121949] Avg episode reward: [(0, '6039.538'), (1, '5360.888')] [2023-12-26 05:32:19,114][123090] Updated weights for policy 1, policy_version 740169 (0.0009) [2023-12-26 05:32:19,171][123090] Updated weights for policy 1, policy_version 740179 (0.0009) [2023-12-26 05:32:19,236][123090] Updated weights for policy 1, policy_version 740189 (0.0010) [2023-12-26 05:32:19,540][123091] Updated weights for policy 0, policy_version 744819 (0.0008) [2023-12-26 05:32:19,604][123091] Updated weights for policy 0, policy_version 744829 (0.0006) [2023-12-26 05:32:19,659][123091] Updated weights for policy 0, policy_version 744839 (0.0006) [2023-12-26 05:32:20,119][123090] Updated weights for policy 1, policy_version 740199 (0.0010) [2023-12-26 05:32:20,175][123090] Updated weights for policy 1, policy_version 740209 (0.0009) [2023-12-26 05:32:20,245][123090] Updated weights for policy 1, policy_version 740219 (0.0010) [2023-12-26 05:32:20,409][123091] Updated weights for policy 0, policy_version 744849 (0.0006) [2023-12-26 05:32:20,467][123091] Updated weights for policy 0, policy_version 744859 (0.0009) [2023-12-26 05:32:20,531][123091] Updated weights for policy 0, policy_version 744869 (0.0009) [2023-12-26 05:32:20,591][123091] Updated weights for policy 0, policy_version 744879 (0.0010) [2023-12-26 05:32:21,120][123090] Updated weights for policy 1, policy_version 740229 (0.0009) [2023-12-26 05:32:21,189][123090] Updated weights for policy 1, policy_version 740239 (0.0008) [2023-12-26 05:32:21,264][123090] Updated weights for policy 1, policy_version 740249 (0.0008) [2023-12-26 05:32:21,434][123091] Updated weights for policy 0, policy_version 744889 (0.0009) [2023-12-26 05:32:21,486][123091] Updated weights for policy 0, policy_version 744899 (0.0009) [2023-12-26 05:32:21,542][123091] Updated weights for policy 0, policy_version 744909 (0.0009) [2023-12-26 05:32:22,131][123090] Updated weights for policy 1, policy_version 740259 (0.0009) [2023-12-26 05:32:22,189][123090] Updated weights for policy 1, policy_version 740269 (0.0010) [2023-12-26 05:32:22,251][123090] Updated weights for policy 1, policy_version 740279 (0.0010) [2023-12-26 05:32:22,412][123091] Updated weights for policy 0, policy_version 744919 (0.0009) [2023-12-26 05:32:22,482][123091] Updated weights for policy 0, policy_version 744929 (0.0008) [2023-12-26 05:32:22,541][123091] Updated weights for policy 0, policy_version 744939 (0.0009) [2023-12-26 05:32:23,099][123090] Updated weights for policy 1, policy_version 740289 (0.0008) [2023-12-26 05:32:23,162][123090] Updated weights for policy 1, policy_version 740299 (0.0010) [2023-12-26 05:32:23,225][123090] Updated weights for policy 1, policy_version 740309 (0.0009) [2023-12-26 05:32:23,300][123090] Updated weights for policy 1, policy_version 740319 (0.0010) [2023-12-26 05:32:23,367][123091] Updated weights for policy 0, policy_version 744949 (0.0009) [2023-12-26 05:32:23,417][123091] Updated weights for policy 0, policy_version 744959 (0.0010) [2023-12-26 05:32:23,469][123091] Updated weights for policy 0, policy_version 744970 (0.0011) [2023-12-26 05:32:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 380239872. Throughput: 0: 9049.8, 1: 8529.6. Samples: 380216376. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:23,785][121949] Avg episode reward: [(0, '6040.475'), (1, '5516.724')] [2023-12-26 05:32:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000744976_190717952.pth... [2023-12-26 05:32:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000740320_189521920.pth... [2023-12-26 05:32:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000743920_190447616.pth [2023-12-26 05:32:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000739328_189267968.pth [2023-12-26 05:32:24,090][123090] Updated weights for policy 1, policy_version 740329 (0.0006) [2023-12-26 05:32:24,162][123090] Updated weights for policy 1, policy_version 740339 (0.0009) [2023-12-26 05:32:24,229][123090] Updated weights for policy 1, policy_version 740349 (0.0009) [2023-12-26 05:32:24,310][123091] Updated weights for policy 0, policy_version 744980 (0.0010) [2023-12-26 05:32:24,375][123091] Updated weights for policy 0, policy_version 744990 (0.0009) [2023-12-26 05:32:24,434][123091] Updated weights for policy 0, policy_version 745000 (0.0009) [2023-12-26 05:32:24,995][123090] Updated weights for policy 1, policy_version 740359 (0.0009) [2023-12-26 05:32:25,067][123090] Updated weights for policy 1, policy_version 740369 (0.0007) [2023-12-26 05:32:25,121][123090] Updated weights for policy 1, policy_version 740379 (0.0005) [2023-12-26 05:32:25,250][123091] Updated weights for policy 0, policy_version 745010 (0.0008) [2023-12-26 05:32:25,311][123091] Updated weights for policy 0, policy_version 745020 (0.0009) [2023-12-26 05:32:25,366][123091] Updated weights for policy 0, policy_version 745030 (0.0009) [2023-12-26 05:32:25,420][123091] Updated weights for policy 0, policy_version 745040 (0.0010) [2023-12-26 05:32:25,920][123090] Updated weights for policy 1, policy_version 740389 (0.0008) [2023-12-26 05:32:25,975][123090] Updated weights for policy 1, policy_version 740399 (0.0009) [2023-12-26 05:32:26,030][123090] Updated weights for policy 1, policy_version 740409 (0.0008) [2023-12-26 05:32:26,226][123091] Updated weights for policy 0, policy_version 745050 (0.0010) [2023-12-26 05:32:26,280][123091] Updated weights for policy 0, policy_version 745060 (0.0009) [2023-12-26 05:32:26,329][123091] Updated weights for policy 0, policy_version 745070 (0.0009) [2023-12-26 05:32:26,852][123090] Updated weights for policy 1, policy_version 740419 (0.0010) [2023-12-26 05:32:26,908][123090] Updated weights for policy 1, policy_version 740429 (0.0009) [2023-12-26 05:32:26,968][123090] Updated weights for policy 1, policy_version 740439 (0.0009) [2023-12-26 05:32:27,138][123091] Updated weights for policy 0, policy_version 745080 (0.0010) [2023-12-26 05:32:27,191][123091] Updated weights for policy 0, policy_version 745091 (0.0010) [2023-12-26 05:32:27,254][123091] Updated weights for policy 0, policy_version 745102 (0.0009) [2023-12-26 05:32:27,808][123090] Updated weights for policy 1, policy_version 740449 (0.0009) [2023-12-26 05:32:27,863][123090] Updated weights for policy 1, policy_version 740459 (0.0009) [2023-12-26 05:32:27,908][123090] Updated weights for policy 1, policy_version 740469 (0.0008) [2023-12-26 05:32:27,963][123090] Updated weights for policy 1, policy_version 740479 (0.0009) [2023-12-26 05:32:28,090][123091] Updated weights for policy 0, policy_version 745112 (0.0006) [2023-12-26 05:32:28,155][123091] Updated weights for policy 0, policy_version 745122 (0.0005) [2023-12-26 05:32:28,226][123091] Updated weights for policy 0, policy_version 745132 (0.0005) [2023-12-26 05:32:28,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 380321792. Throughput: 0: 9002.1, 1: 8568.8. Samples: 380319752. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:28,785][121949] Avg episode reward: [(0, '6116.331'), (1, '5610.537')] [2023-12-26 05:32:28,898][123090] Updated weights for policy 1, policy_version 740489 (0.0009) [2023-12-26 05:32:28,900][123091] Updated weights for policy 0, policy_version 745142 (0.0005) [2023-12-26 05:32:28,953][123091] Updated weights for policy 0, policy_version 745152 (0.0005) [2023-12-26 05:32:28,953][123090] Updated weights for policy 1, policy_version 740499 (0.0009) [2023-12-26 05:32:29,007][123091] Updated weights for policy 0, policy_version 745162 (0.0005) [2023-12-26 05:32:29,018][123090] Updated weights for policy 1, policy_version 740509 (0.0009) [2023-12-26 05:32:29,738][123091] Updated weights for policy 0, policy_version 745172 (0.0009) [2023-12-26 05:32:29,797][123091] Updated weights for policy 0, policy_version 745182 (0.0009) [2023-12-26 05:32:29,867][123091] Updated weights for policy 0, policy_version 745192 (0.0008) [2023-12-26 05:32:29,952][123090] Updated weights for policy 1, policy_version 740519 (0.0009) [2023-12-26 05:32:30,011][123090] Updated weights for policy 1, policy_version 740529 (0.0009) [2023-12-26 05:32:30,066][123090] Updated weights for policy 1, policy_version 740539 (0.0009) [2023-12-26 05:32:30,675][123091] Updated weights for policy 0, policy_version 745202 (0.0006) [2023-12-26 05:32:30,732][123091] Updated weights for policy 0, policy_version 745212 (0.0006) [2023-12-26 05:32:30,790][123091] Updated weights for policy 0, policy_version 745222 (0.0007) [2023-12-26 05:32:30,840][123091] Updated weights for policy 0, policy_version 745232 (0.0010) [2023-12-26 05:32:30,863][123090] Updated weights for policy 1, policy_version 740549 (0.0010) [2023-12-26 05:32:30,933][123090] Updated weights for policy 1, policy_version 740559 (0.0007) [2023-12-26 05:32:30,987][123090] Updated weights for policy 1, policy_version 740569 (0.0010) [2023-12-26 05:32:31,586][123091] Updated weights for policy 0, policy_version 745242 (0.0006) [2023-12-26 05:32:31,660][123091] Updated weights for policy 0, policy_version 745252 (0.0008) [2023-12-26 05:32:31,732][123091] Updated weights for policy 0, policy_version 745262 (0.0007) [2023-12-26 05:32:31,747][123090] Updated weights for policy 1, policy_version 740579 (0.0010) [2023-12-26 05:32:31,807][123090] Updated weights for policy 1, policy_version 740589 (0.0010) [2023-12-26 05:32:31,866][123090] Updated weights for policy 1, policy_version 740599 (0.0010) [2023-12-26 05:32:32,443][123091] Updated weights for policy 0, policy_version 745272 (0.0009) [2023-12-26 05:32:32,498][123091] Updated weights for policy 0, policy_version 745282 (0.0008) [2023-12-26 05:32:32,548][123091] Updated weights for policy 0, policy_version 745292 (0.0009) [2023-12-26 05:32:32,591][123090] Updated weights for policy 1, policy_version 740609 (0.0007) [2023-12-26 05:32:32,647][123090] Updated weights for policy 1, policy_version 740619 (0.0008) [2023-12-26 05:32:32,709][123090] Updated weights for policy 1, policy_version 740629 (0.0009) [2023-12-26 05:32:32,768][123090] Updated weights for policy 1, policy_version 740639 (0.0010) [2023-12-26 05:32:33,205][123091] Updated weights for policy 0, policy_version 745302 (0.0007) [2023-12-26 05:32:33,264][123091] Updated weights for policy 0, policy_version 745312 (0.0005) [2023-12-26 05:32:33,324][123091] Updated weights for policy 0, policy_version 745322 (0.0005) [2023-12-26 05:32:33,652][123090] Updated weights for policy 1, policy_version 740649 (0.0008) [2023-12-26 05:32:33,704][123090] Updated weights for policy 1, policy_version 740659 (0.0010) [2023-12-26 05:32:33,760][123090] Updated weights for policy 1, policy_version 740669 (0.0009) [2023-12-26 05:32:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 380420096. Throughput: 0: 9049.5, 1: 8523.4. Samples: 380428896. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:33,785][121949] Avg episode reward: [(0, '6170.459'), (1, '5661.989')] [2023-12-26 05:32:33,998][123091] Updated weights for policy 0, policy_version 745332 (0.0007) [2023-12-26 05:32:34,051][123091] Updated weights for policy 0, policy_version 745342 (0.0009) [2023-12-26 05:32:34,103][123091] Updated weights for policy 0, policy_version 745352 (0.0009) [2023-12-26 05:32:34,447][123090] Updated weights for policy 1, policy_version 740679 (0.0010) [2023-12-26 05:32:34,514][123090] Updated weights for policy 1, policy_version 740689 (0.0009) [2023-12-26 05:32:34,578][123090] Updated weights for policy 1, policy_version 740699 (0.0006) [2023-12-26 05:32:34,944][123091] Updated weights for policy 0, policy_version 745362 (0.0010) [2023-12-26 05:32:35,003][123091] Updated weights for policy 0, policy_version 745372 (0.0010) [2023-12-26 05:32:35,070][123091] Updated weights for policy 0, policy_version 745382 (0.0010) [2023-12-26 05:32:35,136][123091] Updated weights for policy 0, policy_version 745392 (0.0009) [2023-12-26 05:32:35,265][123090] Updated weights for policy 1, policy_version 740709 (0.0008) [2023-12-26 05:32:35,313][123090] Updated weights for policy 1, policy_version 740719 (0.0010) [2023-12-26 05:32:35,377][123090] Updated weights for policy 1, policy_version 740729 (0.0011) [2023-12-26 05:32:35,936][123091] Updated weights for policy 0, policy_version 745402 (0.0009) [2023-12-26 05:32:35,993][123091] Updated weights for policy 0, policy_version 745412 (0.0009) [2023-12-26 05:32:36,054][123091] Updated weights for policy 0, policy_version 745422 (0.0009) [2023-12-26 05:32:36,181][123090] Updated weights for policy 1, policy_version 740739 (0.0011) [2023-12-26 05:32:36,252][123090] Updated weights for policy 1, policy_version 740749 (0.0011) [2023-12-26 05:32:36,325][123090] Updated weights for policy 1, policy_version 740759 (0.0011) [2023-12-26 05:32:36,896][123091] Updated weights for policy 0, policy_version 745432 (0.0009) [2023-12-26 05:32:36,953][123091] Updated weights for policy 0, policy_version 745442 (0.0009) [2023-12-26 05:32:37,008][123091] Updated weights for policy 0, policy_version 745452 (0.0009) [2023-12-26 05:32:37,148][123090] Updated weights for policy 1, policy_version 740769 (0.0011) [2023-12-26 05:32:37,218][123090] Updated weights for policy 1, policy_version 740779 (0.0010) [2023-12-26 05:32:37,262][123090] Updated weights for policy 1, policy_version 740789 (0.0010) [2023-12-26 05:32:37,326][123090] Updated weights for policy 1, policy_version 740799 (0.0010) [2023-12-26 05:32:37,898][123091] Updated weights for policy 0, policy_version 745462 (0.0010) [2023-12-26 05:32:37,960][123091] Updated weights for policy 0, policy_version 745472 (0.0009) [2023-12-26 05:32:38,025][123091] Updated weights for policy 0, policy_version 745482 (0.0006) [2023-12-26 05:32:38,158][123090] Updated weights for policy 1, policy_version 740809 (0.0010) [2023-12-26 05:32:38,221][123090] Updated weights for policy 1, policy_version 740819 (0.0009) [2023-12-26 05:32:38,291][123090] Updated weights for policy 1, policy_version 740829 (0.0009) [2023-12-26 05:32:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 380502016. Throughput: 0: 9014.5, 1: 8577.0. Samples: 380481840. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:38,785][121949] Avg episode reward: [(0, '6112.147'), (1, '5576.730')] [2023-12-26 05:32:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000740832_189652992.pth... [2023-12-26 05:32:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000739840_189399040.pth [2023-12-26 05:32:38,815][123091] Updated weights for policy 0, policy_version 745492 (0.0007) [2023-12-26 05:32:38,873][123091] Updated weights for policy 0, policy_version 745503 (0.0009) [2023-12-26 05:32:38,922][123091] Updated weights for policy 0, policy_version 745513 (0.0009) [2023-12-26 05:32:38,960][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000745520_190857216.pth... [2023-12-26 05:32:38,965][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000744464_190586880.pth [2023-12-26 05:32:39,111][123090] Updated weights for policy 1, policy_version 740839 (0.0008) [2023-12-26 05:32:39,172][123090] Updated weights for policy 1, policy_version 740849 (0.0008) [2023-12-26 05:32:39,234][123090] Updated weights for policy 1, policy_version 740859 (0.0008) [2023-12-26 05:32:39,788][123091] Updated weights for policy 0, policy_version 745523 (0.0009) [2023-12-26 05:32:39,861][123091] Updated weights for policy 0, policy_version 745533 (0.0009) [2023-12-26 05:32:39,922][123091] Updated weights for policy 0, policy_version 745543 (0.0010) [2023-12-26 05:32:40,051][123090] Updated weights for policy 1, policy_version 740869 (0.0008) [2023-12-26 05:32:40,111][123090] Updated weights for policy 1, policy_version 740879 (0.0006) [2023-12-26 05:32:40,168][123090] Updated weights for policy 1, policy_version 740889 (0.0006) [2023-12-26 05:32:40,837][123091] Updated weights for policy 0, policy_version 745553 (0.0009) [2023-12-26 05:32:40,884][123090] Updated weights for policy 1, policy_version 740899 (0.0006) [2023-12-26 05:32:40,903][123091] Updated weights for policy 0, policy_version 745563 (0.0009) [2023-12-26 05:32:40,938][123090] Updated weights for policy 1, policy_version 740909 (0.0009) [2023-12-26 05:32:40,966][123091] Updated weights for policy 0, policy_version 745573 (0.0007) [2023-12-26 05:32:40,992][123090] Updated weights for policy 1, policy_version 740919 (0.0008) [2023-12-26 05:32:41,042][123091] Updated weights for policy 0, policy_version 745583 (0.0010) [2023-12-26 05:32:41,902][123091] Updated weights for policy 0, policy_version 745593 (0.0007) [2023-12-26 05:32:41,969][123090] Updated weights for policy 1, policy_version 740929 (0.0008) [2023-12-26 05:32:41,971][123091] Updated weights for policy 0, policy_version 745603 (0.0009) [2023-12-26 05:32:42,032][123091] Updated weights for policy 0, policy_version 745613 (0.0009) [2023-12-26 05:32:42,034][123090] Updated weights for policy 1, policy_version 740939 (0.0008) [2023-12-26 05:32:42,096][123090] Updated weights for policy 1, policy_version 740949 (0.0009) [2023-12-26 05:32:42,172][123090] Updated weights for policy 1, policy_version 740959 (0.0011) [2023-12-26 05:32:42,822][123091] Updated weights for policy 0, policy_version 745623 (0.0008) [2023-12-26 05:32:42,893][123091] Updated weights for policy 0, policy_version 745633 (0.0007) [2023-12-26 05:32:42,964][123091] Updated weights for policy 0, policy_version 745643 (0.0008) [2023-12-26 05:32:43,023][123090] Updated weights for policy 1, policy_version 740969 (0.0009) [2023-12-26 05:32:43,092][123090] Updated weights for policy 1, policy_version 740979 (0.0010) [2023-12-26 05:32:43,163][123090] Updated weights for policy 1, policy_version 740989 (0.0010) [2023-12-26 05:32:43,645][123091] Updated weights for policy 0, policy_version 745653 (0.0008) [2023-12-26 05:32:43,705][123091] Updated weights for policy 0, policy_version 745663 (0.0010) [2023-12-26 05:32:43,766][123091] Updated weights for policy 0, policy_version 745673 (0.0009) [2023-12-26 05:32:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 380583936. Throughput: 0: 8899.8, 1: 8564.1. Samples: 380582720. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:43,785][121949] Avg episode reward: [(0, '6004.110'), (1, '5521.890')] [2023-12-26 05:32:43,976][123090] Updated weights for policy 1, policy_version 740999 (0.0010) [2023-12-26 05:32:44,033][123090] Updated weights for policy 1, policy_version 741009 (0.0009) [2023-12-26 05:32:44,086][123090] Updated weights for policy 1, policy_version 741019 (0.0009) [2023-12-26 05:32:44,583][123091] Updated weights for policy 0, policy_version 745683 (0.0009) [2023-12-26 05:32:44,656][123091] Updated weights for policy 0, policy_version 745693 (0.0009) [2023-12-26 05:32:44,726][123091] Updated weights for policy 0, policy_version 745703 (0.0007) [2023-12-26 05:32:44,875][123090] Updated weights for policy 1, policy_version 741029 (0.0008) [2023-12-26 05:32:44,923][123090] Updated weights for policy 1, policy_version 741039 (0.0005) [2023-12-26 05:32:44,970][123090] Updated weights for policy 1, policy_version 741049 (0.0005) [2023-12-26 05:32:45,508][123091] Updated weights for policy 0, policy_version 745713 (0.0008) [2023-12-26 05:32:45,578][123091] Updated weights for policy 0, policy_version 745723 (0.0009) [2023-12-26 05:32:45,642][123091] Updated weights for policy 0, policy_version 745733 (0.0011) [2023-12-26 05:32:45,703][123090] Updated weights for policy 1, policy_version 741059 (0.0006) [2023-12-26 05:32:45,713][123091] Updated weights for policy 0, policy_version 745743 (0.0011) [2023-12-26 05:32:45,762][123090] Updated weights for policy 1, policy_version 741069 (0.0006) [2023-12-26 05:32:45,820][123090] Updated weights for policy 1, policy_version 741079 (0.0006) [2023-12-26 05:32:46,491][123091] Updated weights for policy 0, policy_version 745753 (0.0009) [2023-12-26 05:32:46,553][123091] Updated weights for policy 0, policy_version 745763 (0.0009) [2023-12-26 05:32:46,618][123091] Updated weights for policy 0, policy_version 745773 (0.0009) [2023-12-26 05:32:46,622][123090] Updated weights for policy 1, policy_version 741089 (0.0007) [2023-12-26 05:32:46,671][123090] Updated weights for policy 1, policy_version 741099 (0.0011) [2023-12-26 05:32:46,730][123090] Updated weights for policy 1, policy_version 741109 (0.0010) [2023-12-26 05:32:46,802][123090] Updated weights for policy 1, policy_version 741119 (0.0011) [2023-12-26 05:32:47,420][123091] Updated weights for policy 0, policy_version 745783 (0.0008) [2023-12-26 05:32:47,481][123091] Updated weights for policy 0, policy_version 745793 (0.0006) [2023-12-26 05:32:47,531][123091] Updated weights for policy 0, policy_version 745803 (0.0005) [2023-12-26 05:32:47,651][123090] Updated weights for policy 1, policy_version 741129 (0.0010) [2023-12-26 05:32:47,704][123090] Updated weights for policy 1, policy_version 741139 (0.0010) [2023-12-26 05:32:47,765][123090] Updated weights for policy 1, policy_version 741149 (0.0005) [2023-12-26 05:32:48,260][123091] Updated weights for policy 0, policy_version 745813 (0.0008) [2023-12-26 05:32:48,309][123091] Updated weights for policy 0, policy_version 745823 (0.0011) [2023-12-26 05:32:48,388][123091] Updated weights for policy 0, policy_version 745833 (0.0011) [2023-12-26 05:32:48,514][123090] Updated weights for policy 1, policy_version 741159 (0.0008) [2023-12-26 05:32:48,579][123090] Updated weights for policy 1, policy_version 741169 (0.0009) [2023-12-26 05:32:48,644][123090] Updated weights for policy 1, policy_version 741179 (0.0008) [2023-12-26 05:32:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 380682240. Throughput: 0: 8884.9, 1: 8618.7. Samples: 380689732. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:48,785][121949] Avg episode reward: [(0, '5946.132'), (1, '5481.784')] [2023-12-26 05:32:49,207][123091] Updated weights for policy 0, policy_version 745843 (0.0010) [2023-12-26 05:32:49,277][123091] Updated weights for policy 0, policy_version 745853 (0.0009) [2023-12-26 05:32:49,346][123091] Updated weights for policy 0, policy_version 745863 (0.0007) [2023-12-26 05:32:49,496][123090] Updated weights for policy 1, policy_version 741189 (0.0008) [2023-12-26 05:32:49,555][123090] Updated weights for policy 1, policy_version 741199 (0.0008) [2023-12-26 05:32:49,613][123090] Updated weights for policy 1, policy_version 741209 (0.0007) [2023-12-26 05:32:50,070][123091] Updated weights for policy 0, policy_version 745873 (0.0007) [2023-12-26 05:32:50,134][123091] Updated weights for policy 0, policy_version 745883 (0.0006) [2023-12-26 05:32:50,189][123091] Updated weights for policy 0, policy_version 745893 (0.0008) [2023-12-26 05:32:50,247][123091] Updated weights for policy 0, policy_version 745903 (0.0009) [2023-12-26 05:32:50,425][123090] Updated weights for policy 1, policy_version 741219 (0.0007) [2023-12-26 05:32:50,494][123090] Updated weights for policy 1, policy_version 741229 (0.0009) [2023-12-26 05:32:50,579][123090] Updated weights for policy 1, policy_version 741239 (0.0009) [2023-12-26 05:32:50,967][123091] Updated weights for policy 0, policy_version 745913 (0.0008) [2023-12-26 05:32:51,036][123091] Updated weights for policy 0, policy_version 745923 (0.0007) [2023-12-26 05:32:51,096][123091] Updated weights for policy 0, policy_version 745933 (0.0007) [2023-12-26 05:32:51,287][123090] Updated weights for policy 1, policy_version 741249 (0.0007) [2023-12-26 05:32:51,357][123090] Updated weights for policy 1, policy_version 741259 (0.0009) [2023-12-26 05:32:51,426][123090] Updated weights for policy 1, policy_version 741269 (0.0009) [2023-12-26 05:32:51,490][123090] Updated weights for policy 1, policy_version 741279 (0.0009) [2023-12-26 05:32:51,906][123091] Updated weights for policy 0, policy_version 745943 (0.0009) [2023-12-26 05:32:51,976][123091] Updated weights for policy 0, policy_version 745953 (0.0006) [2023-12-26 05:32:52,047][123091] Updated weights for policy 0, policy_version 745963 (0.0010) [2023-12-26 05:32:52,312][123090] Updated weights for policy 1, policy_version 741289 (0.0006) [2023-12-26 05:32:52,381][123090] Updated weights for policy 1, policy_version 741299 (0.0009) [2023-12-26 05:32:52,453][123090] Updated weights for policy 1, policy_version 741309 (0.0009) [2023-12-26 05:32:52,847][123091] Updated weights for policy 0, policy_version 745973 (0.0011) [2023-12-26 05:32:52,908][123091] Updated weights for policy 0, policy_version 745983 (0.0011) [2023-12-26 05:32:52,956][123091] Updated weights for policy 0, policy_version 745993 (0.0011) [2023-12-26 05:32:53,250][123090] Updated weights for policy 1, policy_version 741319 (0.0010) [2023-12-26 05:32:53,302][123090] Updated weights for policy 1, policy_version 741329 (0.0010) [2023-12-26 05:32:53,353][123090] Updated weights for policy 1, policy_version 741339 (0.0010) [2023-12-26 05:32:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 380764160. Throughput: 0: 8859.4, 1: 8590.5. Samples: 380742896. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:53,785][121949] Avg episode reward: [(0, '5993.116'), (1, '5315.143')] [2023-12-26 05:32:53,785][123091] Updated weights for policy 0, policy_version 746004 (0.0011) [2023-12-26 05:32:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000741344_189784064.pth... [2023-12-26 05:32:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000740320_189521920.pth [2023-12-26 05:32:53,843][123091] Updated weights for policy 0, policy_version 746015 (0.0010) [2023-12-26 05:32:53,905][123091] Updated weights for policy 0, policy_version 746025 (0.0010) [2023-12-26 05:32:53,945][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000746032_190988288.pth... [2023-12-26 05:32:53,949][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000744976_190717952.pth [2023-12-26 05:32:54,107][123090] Updated weights for policy 1, policy_version 741349 (0.0008) [2023-12-26 05:32:54,162][123090] Updated weights for policy 1, policy_version 741359 (0.0005) [2023-12-26 05:32:54,208][123090] Updated weights for policy 1, policy_version 741369 (0.0005) [2023-12-26 05:32:54,848][123091] Updated weights for policy 0, policy_version 746035 (0.0010) [2023-12-26 05:32:54,920][123091] Updated weights for policy 0, policy_version 746045 (0.0010) [2023-12-26 05:32:54,936][123090] Updated weights for policy 1, policy_version 741379 (0.0006) [2023-12-26 05:32:54,988][123091] Updated weights for policy 0, policy_version 746055 (0.0009) [2023-12-26 05:32:55,005][123090] Updated weights for policy 1, policy_version 741389 (0.0008) [2023-12-26 05:32:55,072][123090] Updated weights for policy 1, policy_version 741399 (0.0007) [2023-12-26 05:32:55,659][123090] Updated weights for policy 1, policy_version 741409 (0.0006) [2023-12-26 05:32:55,727][123090] Updated weights for policy 1, policy_version 741419 (0.0006) [2023-12-26 05:32:55,783][123090] Updated weights for policy 1, policy_version 741429 (0.0009) [2023-12-26 05:32:55,843][123090] Updated weights for policy 1, policy_version 741439 (0.0009) [2023-12-26 05:32:55,844][123091] Updated weights for policy 0, policy_version 746065 (0.0009) [2023-12-26 05:32:55,899][123091] Updated weights for policy 0, policy_version 746075 (0.0010) [2023-12-26 05:32:55,955][123091] Updated weights for policy 0, policy_version 746085 (0.0009) [2023-12-26 05:32:56,004][123091] Updated weights for policy 0, policy_version 746096 (0.0009) [2023-12-26 05:32:56,665][123090] Updated weights for policy 1, policy_version 741449 (0.0009) [2023-12-26 05:32:56,724][123090] Updated weights for policy 1, policy_version 741459 (0.0009) [2023-12-26 05:32:56,776][123090] Updated weights for policy 1, policy_version 741469 (0.0005) [2023-12-26 05:32:56,849][123091] Updated weights for policy 0, policy_version 746106 (0.0009) [2023-12-26 05:32:56,902][123091] Updated weights for policy 0, policy_version 746116 (0.0009) [2023-12-26 05:32:56,966][123091] Updated weights for policy 0, policy_version 746126 (0.0009) [2023-12-26 05:32:57,506][123090] Updated weights for policy 1, policy_version 741479 (0.0008) [2023-12-26 05:32:57,553][123090] Updated weights for policy 1, policy_version 741489 (0.0008) [2023-12-26 05:32:57,615][123090] Updated weights for policy 1, policy_version 741500 (0.0009) [2023-12-26 05:32:57,831][123091] Updated weights for policy 0, policy_version 746136 (0.0009) [2023-12-26 05:32:57,893][123091] Updated weights for policy 0, policy_version 746146 (0.0010) [2023-12-26 05:32:57,942][123091] Updated weights for policy 0, policy_version 746156 (0.0009) [2023-12-26 05:32:58,409][123090] Updated weights for policy 1, policy_version 741510 (0.0008) [2023-12-26 05:32:58,476][123090] Updated weights for policy 1, policy_version 741520 (0.0009) [2023-12-26 05:32:58,539][123090] Updated weights for policy 1, policy_version 741530 (0.0009) [2023-12-26 05:32:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 380854272. Throughput: 0: 8774.9, 1: 8729.3. Samples: 380849208. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:32:58,785][121949] Avg episode reward: [(0, '6067.116'), (1, '5139.799')] [2023-12-26 05:32:58,812][123091] Updated weights for policy 0, policy_version 746166 (0.0008) [2023-12-26 05:32:58,887][123091] Updated weights for policy 0, policy_version 746176 (0.0008) [2023-12-26 05:32:58,942][123091] Updated weights for policy 0, policy_version 746186 (0.0008) [2023-12-26 05:32:59,419][123090] Updated weights for policy 1, policy_version 741540 (0.0009) [2023-12-26 05:32:59,474][123090] Updated weights for policy 1, policy_version 741550 (0.0008) [2023-12-26 05:32:59,525][123090] Updated weights for policy 1, policy_version 741560 (0.0008) [2023-12-26 05:32:59,726][123091] Updated weights for policy 0, policy_version 746196 (0.0008) [2023-12-26 05:32:59,781][123091] Updated weights for policy 0, policy_version 746206 (0.0006) [2023-12-26 05:32:59,847][123091] Updated weights for policy 0, policy_version 746216 (0.0008) [2023-12-26 05:33:00,319][123090] Updated weights for policy 1, policy_version 741570 (0.0008) [2023-12-26 05:33:00,380][123090] Updated weights for policy 1, policy_version 741580 (0.0006) [2023-12-26 05:33:00,431][123090] Updated weights for policy 1, policy_version 741590 (0.0009) [2023-12-26 05:33:00,493][123090] Updated weights for policy 1, policy_version 741600 (0.0009) [2023-12-26 05:33:00,696][123091] Updated weights for policy 0, policy_version 746226 (0.0010) [2023-12-26 05:33:00,767][123091] Updated weights for policy 0, policy_version 746236 (0.0010) [2023-12-26 05:33:00,838][123091] Updated weights for policy 0, policy_version 746246 (0.0010) [2023-12-26 05:33:00,904][123091] Updated weights for policy 0, policy_version 746256 (0.0009) [2023-12-26 05:33:01,231][123090] Updated weights for policy 1, policy_version 741610 (0.0005) [2023-12-26 05:33:01,293][123090] Updated weights for policy 1, policy_version 741621 (0.0009) [2023-12-26 05:33:01,344][123090] Updated weights for policy 1, policy_version 741631 (0.0008) [2023-12-26 05:33:01,679][123091] Updated weights for policy 0, policy_version 746266 (0.0009) [2023-12-26 05:33:01,749][123091] Updated weights for policy 0, policy_version 746276 (0.0009) [2023-12-26 05:33:01,822][123091] Updated weights for policy 0, policy_version 746286 (0.0009) [2023-12-26 05:33:02,193][123090] Updated weights for policy 1, policy_version 741641 (0.0009) [2023-12-26 05:33:02,245][123090] Updated weights for policy 1, policy_version 741651 (0.0005) [2023-12-26 05:33:02,312][123090] Updated weights for policy 1, policy_version 741661 (0.0006) [2023-12-26 05:33:02,504][123091] Updated weights for policy 0, policy_version 746296 (0.0006) [2023-12-26 05:33:02,567][123091] Updated weights for policy 0, policy_version 746306 (0.0006) [2023-12-26 05:33:02,614][123091] Updated weights for policy 0, policy_version 746316 (0.0010) [2023-12-26 05:33:03,021][123090] Updated weights for policy 1, policy_version 741671 (0.0008) [2023-12-26 05:33:03,073][123090] Updated weights for policy 1, policy_version 741681 (0.0005) [2023-12-26 05:33:03,118][123090] Updated weights for policy 1, policy_version 741691 (0.0005) [2023-12-26 05:33:03,396][123091] Updated weights for policy 0, policy_version 746326 (0.0010) [2023-12-26 05:33:03,439][123091] Updated weights for policy 0, policy_version 746336 (0.0010) [2023-12-26 05:33:03,490][123091] Updated weights for policy 0, policy_version 746346 (0.0010) [2023-12-26 05:33:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 380944384. Throughput: 0: 8763.5, 1: 8807.0. Samples: 380957312. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:33:03,785][121949] Avg episode reward: [(0, '6074.722'), (1, '5246.713')] [2023-12-26 05:33:03,825][123090] Updated weights for policy 1, policy_version 741701 (0.0007) [2023-12-26 05:33:03,895][123090] Updated weights for policy 1, policy_version 741711 (0.0007) [2023-12-26 05:33:03,961][123090] Updated weights for policy 1, policy_version 741721 (0.0008) [2023-12-26 05:33:04,337][123091] Updated weights for policy 0, policy_version 746356 (0.0010) [2023-12-26 05:33:04,400][123091] Updated weights for policy 0, policy_version 746366 (0.0010) [2023-12-26 05:33:04,462][123091] Updated weights for policy 0, policy_version 746376 (0.0011) [2023-12-26 05:33:04,797][123090] Updated weights for policy 1, policy_version 741731 (0.0009) [2023-12-26 05:33:04,852][123090] Updated weights for policy 1, policy_version 741742 (0.0010) [2023-12-26 05:33:04,916][123090] Updated weights for policy 1, policy_version 741754 (0.0011) [2023-12-26 05:33:05,191][123091] Updated weights for policy 0, policy_version 746386 (0.0010) [2023-12-26 05:33:05,251][123091] Updated weights for policy 0, policy_version 746396 (0.0010) [2023-12-26 05:33:05,303][123091] Updated weights for policy 0, policy_version 746406 (0.0011) [2023-12-26 05:33:05,359][123091] Updated weights for policy 0, policy_version 746416 (0.0010) [2023-12-26 05:33:05,831][123090] Updated weights for policy 1, policy_version 741764 (0.0010) [2023-12-26 05:33:05,901][123090] Updated weights for policy 1, policy_version 741774 (0.0006) [2023-12-26 05:33:05,963][123090] Updated weights for policy 1, policy_version 741784 (0.0008) [2023-12-26 05:33:06,218][123091] Updated weights for policy 0, policy_version 746426 (0.0011) [2023-12-26 05:33:06,292][123091] Updated weights for policy 0, policy_version 746436 (0.0011) [2023-12-26 05:33:06,362][123091] Updated weights for policy 0, policy_version 746446 (0.0011) [2023-12-26 05:33:06,705][123090] Updated weights for policy 1, policy_version 741794 (0.0007) [2023-12-26 05:33:06,774][123090] Updated weights for policy 1, policy_version 741804 (0.0005) [2023-12-26 05:33:06,848][123090] Updated weights for policy 1, policy_version 741814 (0.0008) [2023-12-26 05:33:06,912][123090] Updated weights for policy 1, policy_version 741824 (0.0009) [2023-12-26 05:33:07,139][123091] Updated weights for policy 0, policy_version 746456 (0.0008) [2023-12-26 05:33:07,190][123091] Updated weights for policy 0, policy_version 746466 (0.0006) [2023-12-26 05:33:07,246][123091] Updated weights for policy 0, policy_version 746476 (0.0007) [2023-12-26 05:33:07,506][123090] Updated weights for policy 1, policy_version 741834 (0.0005) [2023-12-26 05:33:07,554][123090] Updated weights for policy 1, policy_version 741844 (0.0005) [2023-12-26 05:33:07,608][123090] Updated weights for policy 1, policy_version 741854 (0.0005) [2023-12-26 05:33:08,015][123091] Updated weights for policy 0, policy_version 746486 (0.0008) [2023-12-26 05:33:08,080][123091] Updated weights for policy 0, policy_version 746496 (0.0010) [2023-12-26 05:33:08,146][123091] Updated weights for policy 0, policy_version 746506 (0.0010) [2023-12-26 05:33:08,370][123090] Updated weights for policy 1, policy_version 741864 (0.0007) [2023-12-26 05:33:08,427][123090] Updated weights for policy 1, policy_version 741874 (0.0006) [2023-12-26 05:33:08,482][123090] Updated weights for policy 1, policy_version 741884 (0.0010) [2023-12-26 05:33:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 381034496. Throughput: 0: 8787.3, 1: 8829.8. Samples: 381009144. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:33:08,785][121949] Avg episode reward: [(0, '6094.418'), (1, '5467.511')] [2023-12-26 05:33:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000746512_191111168.pth... [2023-12-26 05:33:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000741888_189923328.pth... [2023-12-26 05:33:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000745520_190857216.pth [2023-12-26 05:33:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000740832_189652992.pth [2023-12-26 05:33:09,019][123091] Updated weights for policy 0, policy_version 746516 (0.0009) [2023-12-26 05:33:09,072][123091] Updated weights for policy 0, policy_version 746526 (0.0009) [2023-12-26 05:33:09,121][123091] Updated weights for policy 0, policy_version 746536 (0.0009) [2023-12-26 05:33:09,246][123090] Updated weights for policy 1, policy_version 741894 (0.0009) [2023-12-26 05:33:09,320][123090] Updated weights for policy 1, policy_version 741904 (0.0009) [2023-12-26 05:33:09,396][123090] Updated weights for policy 1, policy_version 741914 (0.0009) [2023-12-26 05:33:09,896][123091] Updated weights for policy 0, policy_version 746547 (0.0007) [2023-12-26 05:33:09,963][123091] Updated weights for policy 0, policy_version 746557 (0.0009) [2023-12-26 05:33:10,032][123091] Updated weights for policy 0, policy_version 746567 (0.0010) [2023-12-26 05:33:10,277][123090] Updated weights for policy 1, policy_version 741924 (0.0009) [2023-12-26 05:33:10,345][123090] Updated weights for policy 1, policy_version 741934 (0.0009) [2023-12-26 05:33:10,402][123090] Updated weights for policy 1, policy_version 741944 (0.0009) [2023-12-26 05:33:10,822][123091] Updated weights for policy 0, policy_version 746577 (0.0010) [2023-12-26 05:33:10,884][123091] Updated weights for policy 0, policy_version 746587 (0.0008) [2023-12-26 05:33:10,930][123091] Updated weights for policy 0, policy_version 746597 (0.0005) [2023-12-26 05:33:10,989][123091] Updated weights for policy 0, policy_version 746607 (0.0005) [2023-12-26 05:33:11,256][123090] Updated weights for policy 1, policy_version 741954 (0.0010) [2023-12-26 05:33:11,321][123090] Updated weights for policy 1, policy_version 741964 (0.0009) [2023-12-26 05:33:11,395][123090] Updated weights for policy 1, policy_version 741974 (0.0007) [2023-12-26 05:33:11,452][123090] Updated weights for policy 1, policy_version 741984 (0.0008) [2023-12-26 05:33:11,825][123091] Updated weights for policy 0, policy_version 746617 (0.0010) [2023-12-26 05:33:11,891][123091] Updated weights for policy 0, policy_version 746627 (0.0010) [2023-12-26 05:33:11,960][123091] Updated weights for policy 0, policy_version 746637 (0.0009) [2023-12-26 05:33:12,307][123090] Updated weights for policy 1, policy_version 741994 (0.0009) [2023-12-26 05:33:12,385][123090] Updated weights for policy 1, policy_version 742004 (0.0009) [2023-12-26 05:33:12,442][123090] Updated weights for policy 1, policy_version 742014 (0.0009) [2023-12-26 05:33:12,803][123091] Updated weights for policy 0, policy_version 746647 (0.0007) [2023-12-26 05:33:12,871][123091] Updated weights for policy 0, policy_version 746657 (0.0006) [2023-12-26 05:33:12,933][123091] Updated weights for policy 0, policy_version 746667 (0.0010) [2023-12-26 05:33:13,170][123090] Updated weights for policy 1, policy_version 742024 (0.0010) [2023-12-26 05:33:13,233][123090] Updated weights for policy 1, policy_version 742034 (0.0008) [2023-12-26 05:33:13,296][123090] Updated weights for policy 1, policy_version 742044 (0.0009) [2023-12-26 05:33:13,662][123091] Updated weights for policy 0, policy_version 746677 (0.0008) [2023-12-26 05:33:13,718][123091] Updated weights for policy 0, policy_version 746687 (0.0006) [2023-12-26 05:33:13,772][123091] Updated weights for policy 0, policy_version 746697 (0.0006) [2023-12-26 05:33:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17633.6). Total num frames: 381116416. Throughput: 0: 8796.8, 1: 8844.6. Samples: 381113612. Policy #0 lag: (min: 8.0, avg: 33.4, max: 40.0) [2023-12-26 05:33:13,784][121949] Avg episode reward: [(0, '5876.064'), (1, '5480.362')] [2023-12-26 05:33:14,106][123090] Updated weights for policy 1, policy_version 742054 (0.0007) [2023-12-26 05:33:14,175][123090] Updated weights for policy 1, policy_version 742064 (0.0006) [2023-12-26 05:33:14,249][123090] Updated weights for policy 1, policy_version 742074 (0.0006) [2023-12-26 05:33:14,388][123091] Updated weights for policy 0, policy_version 746707 (0.0006) [2023-12-26 05:33:14,460][123091] Updated weights for policy 0, policy_version 746717 (0.0005) [2023-12-26 05:33:14,529][123091] Updated weights for policy 0, policy_version 746727 (0.0005) [2023-12-26 05:33:15,006][123090] Updated weights for policy 1, policy_version 742084 (0.0007) [2023-12-26 05:33:15,064][123090] Updated weights for policy 1, policy_version 742094 (0.0011) [2023-12-26 05:33:15,136][123090] Updated weights for policy 1, policy_version 742104 (0.0011) [2023-12-26 05:33:15,218][123091] Updated weights for policy 0, policy_version 746737 (0.0006) [2023-12-26 05:33:15,281][123091] Updated weights for policy 0, policy_version 746747 (0.0011) [2023-12-26 05:33:15,350][123091] Updated weights for policy 0, policy_version 746757 (0.0006) [2023-12-26 05:33:15,413][123091] Updated weights for policy 0, policy_version 746767 (0.0005) [2023-12-26 05:33:15,960][123090] Updated weights for policy 1, policy_version 742114 (0.0011) [2023-12-26 05:33:16,037][123090] Updated weights for policy 1, policy_version 742124 (0.0011) [2023-12-26 05:33:16,088][123090] Updated weights for policy 1, policy_version 742134 (0.0010) [2023-12-26 05:33:16,093][123091] Updated weights for policy 0, policy_version 746777 (0.0010) [2023-12-26 05:33:16,152][123090] Updated weights for policy 1, policy_version 742144 (0.0010) [2023-12-26 05:33:16,158][123091] Updated weights for policy 0, policy_version 746787 (0.0011) [2023-12-26 05:33:16,216][123091] Updated weights for policy 0, policy_version 746797 (0.0010) [2023-12-26 05:33:16,938][123091] Updated weights for policy 0, policy_version 746807 (0.0007) [2023-12-26 05:33:16,976][123090] Updated weights for policy 1, policy_version 742154 (0.0009) [2023-12-26 05:33:16,995][123091] Updated weights for policy 0, policy_version 746817 (0.0006) [2023-12-26 05:33:17,034][123090] Updated weights for policy 1, policy_version 742164 (0.0008) [2023-12-26 05:33:17,060][123091] Updated weights for policy 0, policy_version 746827 (0.0008) [2023-12-26 05:33:17,096][123090] Updated weights for policy 1, policy_version 742174 (0.0009) [2023-12-26 05:33:17,820][123091] Updated weights for policy 0, policy_version 746837 (0.0010) [2023-12-26 05:33:17,869][123091] Updated weights for policy 0, policy_version 746847 (0.0009) [2023-12-26 05:33:17,921][123091] Updated weights for policy 0, policy_version 746857 (0.0010) [2023-12-26 05:33:17,979][123090] Updated weights for policy 1, policy_version 742184 (0.0009) [2023-12-26 05:33:18,048][123090] Updated weights for policy 1, policy_version 742194 (0.0009) [2023-12-26 05:33:18,110][123090] Updated weights for policy 1, policy_version 742204 (0.0008) [2023-12-26 05:33:18,676][123091] Updated weights for policy 0, policy_version 746867 (0.0008) [2023-12-26 05:33:18,744][123091] Updated weights for policy 0, policy_version 746877 (0.0009) [2023-12-26 05:33:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 381206528. Throughput: 0: 8813.7, 1: 8854.6. Samples: 381223968. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:18,785][121949] Avg episode reward: [(0, '5779.179'), (1, '5426.201')] [2023-12-26 05:33:18,794][123091] Updated weights for policy 0, policy_version 746887 (0.0009) [2023-12-26 05:33:18,971][123090] Updated weights for policy 1, policy_version 742214 (0.0009) [2023-12-26 05:33:19,035][123090] Updated weights for policy 1, policy_version 742224 (0.0010) [2023-12-26 05:33:19,104][123090] Updated weights for policy 1, policy_version 742235 (0.0009) [2023-12-26 05:33:19,626][123091] Updated weights for policy 0, policy_version 746897 (0.0009) [2023-12-26 05:33:19,694][123091] Updated weights for policy 0, policy_version 746907 (0.0010) [2023-12-26 05:33:19,758][123091] Updated weights for policy 0, policy_version 746917 (0.0010) [2023-12-26 05:33:19,831][123091] Updated weights for policy 0, policy_version 746927 (0.0011) [2023-12-26 05:33:19,924][123090] Updated weights for policy 1, policy_version 742245 (0.0010) [2023-12-26 05:33:19,993][123090] Updated weights for policy 1, policy_version 742255 (0.0009) [2023-12-26 05:33:20,057][123090] Updated weights for policy 1, policy_version 742265 (0.0009) [2023-12-26 05:33:20,671][123091] Updated weights for policy 0, policy_version 746937 (0.0011) [2023-12-26 05:33:20,739][123091] Updated weights for policy 0, policy_version 746947 (0.0011) [2023-12-26 05:33:20,807][123091] Updated weights for policy 0, policy_version 746957 (0.0011) [2023-12-26 05:33:20,882][123090] Updated weights for policy 1, policy_version 742275 (0.0009) [2023-12-26 05:33:20,936][123090] Updated weights for policy 1, policy_version 742285 (0.0009) [2023-12-26 05:33:20,989][123090] Updated weights for policy 1, policy_version 742295 (0.0009) [2023-12-26 05:33:21,660][123091] Updated weights for policy 0, policy_version 746967 (0.0010) [2023-12-26 05:33:21,729][123091] Updated weights for policy 0, policy_version 746977 (0.0011) [2023-12-26 05:33:21,794][123091] Updated weights for policy 0, policy_version 746987 (0.0011) [2023-12-26 05:33:21,906][123090] Updated weights for policy 1, policy_version 742305 (0.0009) [2023-12-26 05:33:21,966][123090] Updated weights for policy 1, policy_version 742315 (0.0009) [2023-12-26 05:33:22,019][123090] Updated weights for policy 1, policy_version 742325 (0.0009) [2023-12-26 05:33:22,076][123090] Updated weights for policy 1, policy_version 742335 (0.0009) [2023-12-26 05:33:22,628][123091] Updated weights for policy 0, policy_version 746997 (0.0011) [2023-12-26 05:33:22,681][123091] Updated weights for policy 0, policy_version 747007 (0.0011) [2023-12-26 05:33:22,737][123091] Updated weights for policy 0, policy_version 747017 (0.0011) [2023-12-26 05:33:22,940][123090] Updated weights for policy 1, policy_version 742345 (0.0009) [2023-12-26 05:33:22,996][123090] Updated weights for policy 1, policy_version 742355 (0.0009) [2023-12-26 05:33:23,050][123090] Updated weights for policy 1, policy_version 742365 (0.0009) [2023-12-26 05:33:23,591][123091] Updated weights for policy 0, policy_version 747027 (0.0011) [2023-12-26 05:33:23,647][123091] Updated weights for policy 0, policy_version 747037 (0.0010) [2023-12-26 05:33:23,691][123091] Updated weights for policy 0, policy_version 747047 (0.0010) [2023-12-26 05:33:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 381296640. Throughput: 0: 8803.7, 1: 8791.6. Samples: 381273628. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:23,785][121949] Avg episode reward: [(0, '5958.442'), (1, '5481.399')] [2023-12-26 05:33:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000742368_190046208.pth... [2023-12-26 05:33:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000747056_191250432.pth... [2023-12-26 05:33:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000741344_189784064.pth [2023-12-26 05:33:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000746032_190988288.pth [2023-12-26 05:33:23,874][123090] Updated weights for policy 1, policy_version 742375 (0.0009) [2023-12-26 05:33:23,934][123090] Updated weights for policy 1, policy_version 742385 (0.0009) [2023-12-26 05:33:23,980][123090] Updated weights for policy 1, policy_version 742395 (0.0008) [2023-12-26 05:33:24,523][123091] Updated weights for policy 0, policy_version 747057 (0.0010) [2023-12-26 05:33:24,578][123091] Updated weights for policy 0, policy_version 747067 (0.0010) [2023-12-26 05:33:24,629][123091] Updated weights for policy 0, policy_version 747077 (0.0010) [2023-12-26 05:33:24,681][123091] Updated weights for policy 0, policy_version 747087 (0.0011) [2023-12-26 05:33:24,832][123090] Updated weights for policy 1, policy_version 742405 (0.0009) [2023-12-26 05:33:24,888][123090] Updated weights for policy 1, policy_version 742415 (0.0009) [2023-12-26 05:33:24,937][123090] Updated weights for policy 1, policy_version 742425 (0.0008) [2023-12-26 05:33:25,503][123091] Updated weights for policy 0, policy_version 747097 (0.0010) [2023-12-26 05:33:25,564][123091] Updated weights for policy 0, policy_version 747107 (0.0010) [2023-12-26 05:33:25,618][123091] Updated weights for policy 0, policy_version 747117 (0.0010) [2023-12-26 05:33:25,791][123090] Updated weights for policy 1, policy_version 742435 (0.0009) [2023-12-26 05:33:25,838][123090] Updated weights for policy 1, policy_version 742445 (0.0009) [2023-12-26 05:33:25,901][123090] Updated weights for policy 1, policy_version 742456 (0.0009) [2023-12-26 05:33:26,440][123091] Updated weights for policy 0, policy_version 747127 (0.0011) [2023-12-26 05:33:26,492][123091] Updated weights for policy 0, policy_version 747137 (0.0006) [2023-12-26 05:33:26,542][123091] Updated weights for policy 0, policy_version 747147 (0.0010) [2023-12-26 05:33:26,740][123090] Updated weights for policy 1, policy_version 742466 (0.0009) [2023-12-26 05:33:26,789][123090] Updated weights for policy 1, policy_version 742476 (0.0007) [2023-12-26 05:33:26,837][123090] Updated weights for policy 1, policy_version 742486 (0.0008) [2023-12-26 05:33:26,885][123090] Updated weights for policy 1, policy_version 742496 (0.0009) [2023-12-26 05:33:27,308][123091] Updated weights for policy 0, policy_version 747157 (0.0008) [2023-12-26 05:33:27,364][123091] Updated weights for policy 0, policy_version 747167 (0.0005) [2023-12-26 05:33:27,408][123091] Updated weights for policy 0, policy_version 747177 (0.0005) [2023-12-26 05:33:27,711][123090] Updated weights for policy 1, policy_version 742506 (0.0005) [2023-12-26 05:33:27,761][123090] Updated weights for policy 1, policy_version 742516 (0.0006) [2023-12-26 05:33:27,815][123090] Updated weights for policy 1, policy_version 742526 (0.0005) [2023-12-26 05:33:28,070][123091] Updated weights for policy 0, policy_version 747187 (0.0007) [2023-12-26 05:33:28,125][123091] Updated weights for policy 0, policy_version 747197 (0.0010) [2023-12-26 05:33:28,176][123091] Updated weights for policy 0, policy_version 747207 (0.0010) [2023-12-26 05:33:28,483][123090] Updated weights for policy 1, policy_version 742536 (0.0008) [2023-12-26 05:33:28,544][123090] Updated weights for policy 1, policy_version 742546 (0.0008) [2023-12-26 05:33:28,608][123090] Updated weights for policy 1, policy_version 742556 (0.0008) [2023-12-26 05:33:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 381386752. Throughput: 0: 8854.5, 1: 8800.4. Samples: 381377192. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:28,785][121949] Avg episode reward: [(0, '6076.243'), (1, '5370.118')] [2023-12-26 05:33:28,865][123091] Updated weights for policy 0, policy_version 747217 (0.0006) [2023-12-26 05:33:28,914][123091] Updated weights for policy 0, policy_version 747227 (0.0005) [2023-12-26 05:33:28,964][123091] Updated weights for policy 0, policy_version 747237 (0.0005) [2023-12-26 05:33:29,009][123091] Updated weights for policy 0, policy_version 747247 (0.0005) [2023-12-26 05:33:29,379][123090] Updated weights for policy 1, policy_version 742566 (0.0008) [2023-12-26 05:33:29,432][123090] Updated weights for policy 1, policy_version 742577 (0.0010) [2023-12-26 05:33:29,492][123090] Updated weights for policy 1, policy_version 742587 (0.0008) [2023-12-26 05:33:29,666][123091] Updated weights for policy 0, policy_version 747257 (0.0009) [2023-12-26 05:33:29,730][123091] Updated weights for policy 0, policy_version 747267 (0.0009) [2023-12-26 05:33:29,799][123091] Updated weights for policy 0, policy_version 747277 (0.0009) [2023-12-26 05:33:30,373][123090] Updated weights for policy 1, policy_version 742597 (0.0009) [2023-12-26 05:33:30,426][123090] Updated weights for policy 1, policy_version 742607 (0.0009) [2023-12-26 05:33:30,476][123090] Updated weights for policy 1, policy_version 742617 (0.0010) [2023-12-26 05:33:30,546][123091] Updated weights for policy 0, policy_version 747287 (0.0009) [2023-12-26 05:33:30,604][123091] Updated weights for policy 0, policy_version 747298 (0.0009) [2023-12-26 05:33:30,658][123091] Updated weights for policy 0, policy_version 747308 (0.0008) [2023-12-26 05:33:31,369][123090] Updated weights for policy 1, policy_version 742627 (0.0009) [2023-12-26 05:33:31,414][123091] Updated weights for policy 0, policy_version 747318 (0.0010) [2023-12-26 05:33:31,426][123090] Updated weights for policy 1, policy_version 742637 (0.0006) [2023-12-26 05:33:31,462][123091] Updated weights for policy 0, policy_version 747328 (0.0009) [2023-12-26 05:33:31,494][123090] Updated weights for policy 1, policy_version 742647 (0.0006) [2023-12-26 05:33:31,524][123091] Updated weights for policy 0, policy_version 747338 (0.0010) [2023-12-26 05:33:32,250][123090] Updated weights for policy 1, policy_version 742657 (0.0007) [2023-12-26 05:33:32,300][123090] Updated weights for policy 1, policy_version 742667 (0.0007) [2023-12-26 05:33:32,357][123090] Updated weights for policy 1, policy_version 742677 (0.0006) [2023-12-26 05:33:32,383][123091] Updated weights for policy 0, policy_version 747348 (0.0011) [2023-12-26 05:33:32,412][123090] Updated weights for policy 1, policy_version 742687 (0.0008) [2023-12-26 05:33:32,446][123091] Updated weights for policy 0, policy_version 747358 (0.0011) [2023-12-26 05:33:32,516][123091] Updated weights for policy 0, policy_version 747368 (0.0011) [2023-12-26 05:33:33,166][123090] Updated weights for policy 1, policy_version 742697 (0.0006) [2023-12-26 05:33:33,233][123090] Updated weights for policy 1, policy_version 742707 (0.0007) [2023-12-26 05:33:33,289][123091] Updated weights for policy 0, policy_version 747378 (0.0009) [2023-12-26 05:33:33,304][123090] Updated weights for policy 1, policy_version 742717 (0.0011) [2023-12-26 05:33:33,351][123091] Updated weights for policy 0, policy_version 747388 (0.0008) [2023-12-26 05:33:33,422][123091] Updated weights for policy 0, policy_version 747398 (0.0009) [2023-12-26 05:33:33,485][123091] Updated weights for policy 0, policy_version 747408 (0.0009) [2023-12-26 05:33:33,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 381476864. Throughput: 0: 8917.0, 1: 8800.7. Samples: 381487036. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:33,786][121949] Avg episode reward: [(0, '6045.475'), (1, '5125.086')] [2023-12-26 05:33:34,043][123090] Updated weights for policy 1, policy_version 742727 (0.0009) [2023-12-26 05:33:34,101][123090] Updated weights for policy 1, policy_version 742737 (0.0009) [2023-12-26 05:33:34,166][123090] Updated weights for policy 1, policy_version 742747 (0.0009) [2023-12-26 05:33:34,351][123091] Updated weights for policy 0, policy_version 747418 (0.0009) [2023-12-26 05:33:34,407][123091] Updated weights for policy 0, policy_version 747428 (0.0009) [2023-12-26 05:33:34,465][123091] Updated weights for policy 0, policy_version 747438 (0.0008) [2023-12-26 05:33:34,946][123090] Updated weights for policy 1, policy_version 742757 (0.0007) [2023-12-26 05:33:35,017][123090] Updated weights for policy 1, policy_version 742767 (0.0006) [2023-12-26 05:33:35,076][123090] Updated weights for policy 1, policy_version 742777 (0.0007) [2023-12-26 05:33:35,335][123091] Updated weights for policy 0, policy_version 747448 (0.0009) [2023-12-26 05:33:35,388][123091] Updated weights for policy 0, policy_version 747459 (0.0010) [2023-12-26 05:33:35,441][123091] Updated weights for policy 0, policy_version 747470 (0.0010) [2023-12-26 05:33:35,742][123090] Updated weights for policy 1, policy_version 742787 (0.0005) [2023-12-26 05:33:35,808][123090] Updated weights for policy 1, policy_version 742797 (0.0008) [2023-12-26 05:33:35,871][123090] Updated weights for policy 1, policy_version 742807 (0.0009) [2023-12-26 05:33:36,312][123091] Updated weights for policy 0, policy_version 747480 (0.0009) [2023-12-26 05:33:36,383][123091] Updated weights for policy 0, policy_version 747490 (0.0009) [2023-12-26 05:33:36,451][123091] Updated weights for policy 0, policy_version 747500 (0.0010) [2023-12-26 05:33:36,669][123090] Updated weights for policy 1, policy_version 742817 (0.0010) [2023-12-26 05:33:36,730][123090] Updated weights for policy 1, policy_version 742827 (0.0010) [2023-12-26 05:33:36,782][123090] Updated weights for policy 1, policy_version 742837 (0.0010) [2023-12-26 05:33:36,851][123090] Updated weights for policy 1, policy_version 742847 (0.0010) [2023-12-26 05:33:37,277][123091] Updated weights for policy 0, policy_version 747510 (0.0010) [2023-12-26 05:33:37,324][123091] Updated weights for policy 0, policy_version 747520 (0.0007) [2023-12-26 05:33:37,382][123091] Updated weights for policy 0, policy_version 747530 (0.0009) [2023-12-26 05:33:37,704][123090] Updated weights for policy 1, policy_version 742857 (0.0006) [2023-12-26 05:33:37,764][123090] Updated weights for policy 1, policy_version 742867 (0.0005) [2023-12-26 05:33:37,836][123090] Updated weights for policy 1, policy_version 742877 (0.0005) [2023-12-26 05:33:38,221][123091] Updated weights for policy 0, policy_version 747540 (0.0010) [2023-12-26 05:33:38,281][123091] Updated weights for policy 0, policy_version 747550 (0.0010) [2023-12-26 05:33:38,331][123091] Updated weights for policy 0, policy_version 747560 (0.0010) [2023-12-26 05:33:38,535][123090] Updated weights for policy 1, policy_version 742887 (0.0008) [2023-12-26 05:33:38,604][123090] Updated weights for policy 1, policy_version 742897 (0.0007) [2023-12-26 05:33:38,662][123090] Updated weights for policy 1, policy_version 742907 (0.0009) [2023-12-26 05:33:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 381566976. Throughput: 0: 8849.1, 1: 8866.0. Samples: 381540076. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:38,785][121949] Avg episode reward: [(0, '5907.409'), (1, '4961.247')] [2023-12-26 05:33:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000747568_191381504.pth... [2023-12-26 05:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000742912_190185472.pth... [2023-12-26 05:33:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000746512_191111168.pth [2023-12-26 05:33:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000741888_189923328.pth [2023-12-26 05:33:39,172][123091] Updated weights for policy 0, policy_version 747570 (0.0011) [2023-12-26 05:33:39,236][123091] Updated weights for policy 0, policy_version 747580 (0.0011) [2023-12-26 05:33:39,303][123091] Updated weights for policy 0, policy_version 747590 (0.0007) [2023-12-26 05:33:39,368][123091] Updated weights for policy 0, policy_version 747600 (0.0010) [2023-12-26 05:33:39,513][123090] Updated weights for policy 1, policy_version 742917 (0.0010) [2023-12-26 05:33:39,575][123090] Updated weights for policy 1, policy_version 742927 (0.0009) [2023-12-26 05:33:39,638][123090] Updated weights for policy 1, policy_version 742937 (0.0010) [2023-12-26 05:33:40,194][123091] Updated weights for policy 0, policy_version 747610 (0.0011) [2023-12-26 05:33:40,259][123091] Updated weights for policy 0, policy_version 747620 (0.0010) [2023-12-26 05:33:40,328][123091] Updated weights for policy 0, policy_version 747630 (0.0010) [2023-12-26 05:33:40,479][123090] Updated weights for policy 1, policy_version 742947 (0.0010) [2023-12-26 05:33:40,526][123090] Updated weights for policy 1, policy_version 742957 (0.0008) [2023-12-26 05:33:40,574][123090] Updated weights for policy 1, policy_version 742967 (0.0009) [2023-12-26 05:33:41,124][123091] Updated weights for policy 0, policy_version 747640 (0.0007) [2023-12-26 05:33:41,194][123091] Updated weights for policy 0, policy_version 747650 (0.0011) [2023-12-26 05:33:41,252][123091] Updated weights for policy 0, policy_version 747660 (0.0010) [2023-12-26 05:33:41,353][123090] Updated weights for policy 1, policy_version 742977 (0.0007) [2023-12-26 05:33:41,429][123090] Updated weights for policy 1, policy_version 742987 (0.0009) [2023-12-26 05:33:41,493][123090] Updated weights for policy 1, policy_version 742997 (0.0010) [2023-12-26 05:33:41,552][123090] Updated weights for policy 1, policy_version 743007 (0.0010) [2023-12-26 05:33:42,001][123091] Updated weights for policy 0, policy_version 747670 (0.0009) [2023-12-26 05:33:42,065][123091] Updated weights for policy 0, policy_version 747680 (0.0011) [2023-12-26 05:33:42,128][123091] Updated weights for policy 0, policy_version 747690 (0.0010) [2023-12-26 05:33:42,363][123090] Updated weights for policy 1, policy_version 743017 (0.0010) [2023-12-26 05:33:42,431][123090] Updated weights for policy 1, policy_version 743027 (0.0010) [2023-12-26 05:33:42,494][123090] Updated weights for policy 1, policy_version 743037 (0.0010) [2023-12-26 05:33:42,902][123091] Updated weights for policy 0, policy_version 747700 (0.0007) [2023-12-26 05:33:42,969][123091] Updated weights for policy 0, policy_version 747710 (0.0009) [2023-12-26 05:33:43,035][123091] Updated weights for policy 0, policy_version 747720 (0.0009) [2023-12-26 05:33:43,373][123090] Updated weights for policy 1, policy_version 743047 (0.0011) [2023-12-26 05:33:43,440][123090] Updated weights for policy 1, policy_version 743057 (0.0011) [2023-12-26 05:33:43,495][123090] Updated weights for policy 1, policy_version 743067 (0.0010) [2023-12-26 05:33:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 381648896. Throughput: 0: 8908.1, 1: 8766.6. Samples: 381644572. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:43,785][121949] Avg episode reward: [(0, '5986.360'), (1, '5231.268')] [2023-12-26 05:33:43,860][123091] Updated weights for policy 0, policy_version 747730 (0.0009) [2023-12-26 05:33:43,921][123091] Updated weights for policy 0, policy_version 747740 (0.0010) [2023-12-26 05:33:43,995][123091] Updated weights for policy 0, policy_version 747750 (0.0005) [2023-12-26 05:33:44,066][123091] Updated weights for policy 0, policy_version 747760 (0.0005) [2023-12-26 05:33:44,333][123090] Updated weights for policy 1, policy_version 743077 (0.0010) [2023-12-26 05:33:44,392][123090] Updated weights for policy 1, policy_version 743087 (0.0010) [2023-12-26 05:33:44,452][123090] Updated weights for policy 1, policy_version 743097 (0.0010) [2023-12-26 05:33:44,682][123091] Updated weights for policy 0, policy_version 747770 (0.0010) [2023-12-26 05:33:44,729][123091] Updated weights for policy 0, policy_version 747780 (0.0010) [2023-12-26 05:33:44,800][123091] Updated weights for policy 0, policy_version 747790 (0.0010) [2023-12-26 05:33:45,264][123090] Updated weights for policy 1, policy_version 743107 (0.0010) [2023-12-26 05:33:45,320][123090] Updated weights for policy 1, policy_version 743117 (0.0010) [2023-12-26 05:33:45,385][123090] Updated weights for policy 1, policy_version 743127 (0.0006) [2023-12-26 05:33:45,573][123091] Updated weights for policy 0, policy_version 747800 (0.0011) [2023-12-26 05:33:45,644][123091] Updated weights for policy 0, policy_version 747810 (0.0011) [2023-12-26 05:33:45,719][123091] Updated weights for policy 0, policy_version 747820 (0.0011) [2023-12-26 05:33:46,231][123090] Updated weights for policy 1, policy_version 743137 (0.0010) [2023-12-26 05:33:46,279][123090] Updated weights for policy 1, policy_version 743147 (0.0010) [2023-12-26 05:33:46,338][123090] Updated weights for policy 1, policy_version 743157 (0.0010) [2023-12-26 05:33:46,410][123090] Updated weights for policy 1, policy_version 743167 (0.0010) [2023-12-26 05:33:46,447][123091] Updated weights for policy 0, policy_version 747830 (0.0006) [2023-12-26 05:33:46,494][123091] Updated weights for policy 0, policy_version 747840 (0.0005) [2023-12-26 05:33:46,539][123091] Updated weights for policy 0, policy_version 747850 (0.0005) [2023-12-26 05:33:47,133][123090] Updated weights for policy 1, policy_version 743177 (0.0006) [2023-12-26 05:33:47,197][123090] Updated weights for policy 1, policy_version 743187 (0.0006) [2023-12-26 05:33:47,261][123091] Updated weights for policy 0, policy_version 747860 (0.0008) [2023-12-26 05:33:47,272][123090] Updated weights for policy 1, policy_version 743197 (0.0006) [2023-12-26 05:33:47,328][123091] Updated weights for policy 0, policy_version 747870 (0.0010) [2023-12-26 05:33:47,392][123091] Updated weights for policy 0, policy_version 747880 (0.0011) [2023-12-26 05:33:47,896][123090] Updated weights for policy 1, policy_version 743207 (0.0006) [2023-12-26 05:33:47,949][123090] Updated weights for policy 1, policy_version 743217 (0.0005) [2023-12-26 05:33:48,003][123090] Updated weights for policy 1, policy_version 743227 (0.0006) [2023-12-26 05:33:48,105][123091] Updated weights for policy 0, policy_version 747890 (0.0010) [2023-12-26 05:33:48,163][123091] Updated weights for policy 0, policy_version 747900 (0.0007) [2023-12-26 05:33:48,218][123091] Updated weights for policy 0, policy_version 747910 (0.0006) [2023-12-26 05:33:48,273][123091] Updated weights for policy 0, policy_version 747920 (0.0006) [2023-12-26 05:33:48,769][123090] Updated weights for policy 1, policy_version 743237 (0.0008) [2023-12-26 05:33:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 381739008. Throughput: 0: 8995.0, 1: 8734.0. Samples: 381755116. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:48,785][121949] Avg episode reward: [(0, '6085.107'), (1, '5248.658')] [2023-12-26 05:33:48,827][123090] Updated weights for policy 1, policy_version 743247 (0.0010) [2023-12-26 05:33:48,883][123090] Updated weights for policy 1, policy_version 743257 (0.0008) [2023-12-26 05:33:48,901][123091] Updated weights for policy 0, policy_version 747930 (0.0008) [2023-12-26 05:33:48,972][123091] Updated weights for policy 0, policy_version 747940 (0.0011) [2023-12-26 05:33:49,035][123091] Updated weights for policy 0, policy_version 747950 (0.0011) [2023-12-26 05:33:49,772][123090] Updated weights for policy 1, policy_version 743267 (0.0010) [2023-12-26 05:33:49,833][123090] Updated weights for policy 1, policy_version 743277 (0.0010) [2023-12-26 05:33:49,867][123091] Updated weights for policy 0, policy_version 747960 (0.0009) [2023-12-26 05:33:49,900][123090] Updated weights for policy 1, policy_version 743287 (0.0009) [2023-12-26 05:33:49,935][123091] Updated weights for policy 0, policy_version 747970 (0.0008) [2023-12-26 05:33:50,009][123091] Updated weights for policy 0, policy_version 747980 (0.0009) [2023-12-26 05:33:50,766][123091] Updated weights for policy 0, policy_version 747990 (0.0008) [2023-12-26 05:33:50,771][123090] Updated weights for policy 1, policy_version 743297 (0.0009) [2023-12-26 05:33:50,836][123091] Updated weights for policy 0, policy_version 748000 (0.0009) [2023-12-26 05:33:50,838][123090] Updated weights for policy 1, policy_version 743307 (0.0008) [2023-12-26 05:33:50,899][123091] Updated weights for policy 0, policy_version 748010 (0.0009) [2023-12-26 05:33:50,904][123090] Updated weights for policy 1, policy_version 743317 (0.0007) [2023-12-26 05:33:50,972][123090] Updated weights for policy 1, policy_version 743327 (0.0006) [2023-12-26 05:33:51,737][123091] Updated weights for policy 0, policy_version 748020 (0.0008) [2023-12-26 05:33:51,789][123090] Updated weights for policy 1, policy_version 743337 (0.0006) [2023-12-26 05:33:51,805][123091] Updated weights for policy 0, policy_version 748030 (0.0008) [2023-12-26 05:33:51,858][123090] Updated weights for policy 1, policy_version 743347 (0.0008) [2023-12-26 05:33:51,873][123091] Updated weights for policy 0, policy_version 748040 (0.0008) [2023-12-26 05:33:51,924][123090] Updated weights for policy 1, policy_version 743357 (0.0009) [2023-12-26 05:33:52,622][123091] Updated weights for policy 0, policy_version 748050 (0.0008) [2023-12-26 05:33:52,684][123091] Updated weights for policy 0, policy_version 748060 (0.0009) [2023-12-26 05:33:52,740][123091] Updated weights for policy 0, policy_version 748070 (0.0009) [2023-12-26 05:33:52,789][123090] Updated weights for policy 1, policy_version 743367 (0.0008) [2023-12-26 05:33:52,791][123091] Updated weights for policy 0, policy_version 748080 (0.0009) [2023-12-26 05:33:52,855][123090] Updated weights for policy 1, policy_version 743377 (0.0009) [2023-12-26 05:33:52,913][123090] Updated weights for policy 1, policy_version 743387 (0.0009) [2023-12-26 05:33:53,506][123091] Updated weights for policy 0, policy_version 748090 (0.0005) [2023-12-26 05:33:53,575][123091] Updated weights for policy 0, policy_version 748100 (0.0005) [2023-12-26 05:33:53,614][123090] Updated weights for policy 1, policy_version 743397 (0.0006) [2023-12-26 05:33:53,641][123091] Updated weights for policy 0, policy_version 748110 (0.0005) [2023-12-26 05:33:53,681][123090] Updated weights for policy 1, policy_version 743407 (0.0007) [2023-12-26 05:33:53,742][123090] Updated weights for policy 1, policy_version 743417 (0.0005) [2023-12-26 05:33:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 381829120. Throughput: 0: 8993.3, 1: 8715.2. Samples: 381806028. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:53,786][121949] Avg episode reward: [(0, '6088.239'), (1, '5153.192')] [2023-12-26 05:33:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000748112_191520768.pth... [2023-12-26 05:33:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000743424_190316544.pth... [2023-12-26 05:33:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000742368_190046208.pth [2023-12-26 05:33:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000747056_191250432.pth [2023-12-26 05:33:53,801][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000743424_190316544.pth [2023-12-26 05:33:53,801][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000748112_191520768.pth [2023-12-26 05:33:54,404][123091] Updated weights for policy 0, policy_version 748120 (0.0008) [2023-12-26 05:33:54,472][123091] Updated weights for policy 0, policy_version 748130 (0.0010) [2023-12-26 05:33:54,503][123090] Updated weights for policy 1, policy_version 743427 (0.0007) [2023-12-26 05:33:54,541][123091] Updated weights for policy 0, policy_version 748140 (0.0008) [2023-12-26 05:33:54,565][123090] Updated weights for policy 1, policy_version 743437 (0.0008) [2023-12-26 05:33:54,630][123090] Updated weights for policy 1, policy_version 743447 (0.0009) [2023-12-26 05:33:55,286][123091] Updated weights for policy 0, policy_version 748150 (0.0007) [2023-12-26 05:33:55,352][123091] Updated weights for policy 0, policy_version 748160 (0.0005) [2023-12-26 05:33:55,398][123091] Updated weights for policy 0, policy_version 748170 (0.0005) [2023-12-26 05:33:55,513][123090] Updated weights for policy 1, policy_version 743457 (0.0009) [2023-12-26 05:33:55,573][123090] Updated weights for policy 1, policy_version 743467 (0.0010) [2023-12-26 05:33:55,635][123090] Updated weights for policy 1, policy_version 743477 (0.0010) [2023-12-26 05:33:55,692][123090] Updated weights for policy 1, policy_version 743487 (0.0009) [2023-12-26 05:33:56,084][123091] Updated weights for policy 0, policy_version 748180 (0.0005) [2023-12-26 05:33:56,163][123091] Updated weights for policy 0, policy_version 748190 (0.0005) [2023-12-26 05:33:56,235][123091] Updated weights for policy 0, policy_version 748200 (0.0005) [2023-12-26 05:33:56,505][123090] Updated weights for policy 1, policy_version 743497 (0.0006) [2023-12-26 05:33:56,549][123090] Updated weights for policy 1, policy_version 743507 (0.0006) [2023-12-26 05:33:56,595][123090] Updated weights for policy 1, policy_version 743517 (0.0005) [2023-12-26 05:33:56,874][123091] Updated weights for policy 0, policy_version 748210 (0.0006) [2023-12-26 05:33:56,928][123091] Updated weights for policy 0, policy_version 748220 (0.0009) [2023-12-26 05:33:56,979][123091] Updated weights for policy 0, policy_version 748230 (0.0009) [2023-12-26 05:33:57,308][123090] Updated weights for policy 1, policy_version 743527 (0.0005) [2023-12-26 05:33:57,372][123090] Updated weights for policy 1, policy_version 743537 (0.0008) [2023-12-26 05:33:57,436][123090] Updated weights for policy 1, policy_version 743547 (0.0008) [2023-12-26 05:33:57,890][123091] Updated weights for policy 0, policy_version 748241 (0.0010) [2023-12-26 05:33:57,961][123091] Updated weights for policy 0, policy_version 748251 (0.0009) [2023-12-26 05:33:58,018][123091] Updated weights for policy 0, policy_version 748262 (0.0010) [2023-12-26 05:33:58,070][123090] Updated weights for policy 1, policy_version 743557 (0.0006) [2023-12-26 05:33:58,084][123091] Updated weights for policy 0, policy_version 748272 (0.0009) [2023-12-26 05:33:58,128][123090] Updated weights for policy 1, policy_version 743567 (0.0008) [2023-12-26 05:33:58,196][123090] Updated weights for policy 1, policy_version 743577 (0.0009) [2023-12-26 05:33:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 381919232. Throughput: 0: 9084.4, 1: 8759.4. Samples: 381916588. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:33:58,785][121949] Avg episode reward: [(0, '6083.574'), (1, '5212.416')] [2023-12-26 05:33:58,955][123091] Updated weights for policy 0, policy_version 748282 (0.0010) [2023-12-26 05:33:59,019][123091] Updated weights for policy 0, policy_version 748292 (0.0010) [2023-12-26 05:33:59,021][123090] Updated weights for policy 1, policy_version 743587 (0.0008) [2023-12-26 05:33:59,087][123090] Updated weights for policy 1, policy_version 743597 (0.0009) [2023-12-26 05:33:59,088][123091] Updated weights for policy 0, policy_version 748302 (0.0008) [2023-12-26 05:33:59,154][123090] Updated weights for policy 1, policy_version 743607 (0.0007) [2023-12-26 05:33:59,826][123090] Updated weights for policy 1, policy_version 743617 (0.0008) [2023-12-26 05:33:59,880][123091] Updated weights for policy 0, policy_version 748312 (0.0007) [2023-12-26 05:33:59,891][123090] Updated weights for policy 1, policy_version 743627 (0.0007) [2023-12-26 05:33:59,947][123091] Updated weights for policy 0, policy_version 748322 (0.0007) [2023-12-26 05:33:59,960][123090] Updated weights for policy 1, policy_version 743637 (0.0007) [2023-12-26 05:34:00,008][123091] Updated weights for policy 0, policy_version 748332 (0.0006) [2023-12-26 05:34:00,028][123090] Updated weights for policy 1, policy_version 743647 (0.0006) [2023-12-26 05:34:00,730][123091] Updated weights for policy 0, policy_version 748342 (0.0006) [2023-12-26 05:34:00,735][123090] Updated weights for policy 1, policy_version 743657 (0.0006) [2023-12-26 05:34:00,795][123091] Updated weights for policy 0, policy_version 748352 (0.0008) [2023-12-26 05:34:00,804][123090] Updated weights for policy 1, policy_version 743667 (0.0006) [2023-12-26 05:34:00,840][123091] Updated weights for policy 0, policy_version 748362 (0.0005) [2023-12-26 05:34:00,876][123090] Updated weights for policy 1, policy_version 743677 (0.0005) [2023-12-26 05:34:01,482][123090] Updated weights for policy 1, policy_version 743687 (0.0005) [2023-12-26 05:34:01,541][123090] Updated weights for policy 1, policy_version 743697 (0.0005) [2023-12-26 05:34:01,603][123090] Updated weights for policy 1, policy_version 743707 (0.0006) [2023-12-26 05:34:01,617][123091] Updated weights for policy 0, policy_version 748372 (0.0007) [2023-12-26 05:34:01,680][123091] Updated weights for policy 0, policy_version 748382 (0.0009) [2023-12-26 05:34:01,754][123091] Updated weights for policy 0, policy_version 748392 (0.0007) [2023-12-26 05:34:02,364][123090] Updated weights for policy 1, policy_version 743717 (0.0008) [2023-12-26 05:34:02,411][123090] Updated weights for policy 1, policy_version 743727 (0.0006) [2023-12-26 05:34:02,473][123090] Updated weights for policy 1, policy_version 743737 (0.0005) [2023-12-26 05:34:02,565][123091] Updated weights for policy 0, policy_version 748402 (0.0008) [2023-12-26 05:34:02,618][123091] Updated weights for policy 0, policy_version 748412 (0.0005) [2023-12-26 05:34:02,672][123091] Updated weights for policy 0, policy_version 748422 (0.0005) [2023-12-26 05:34:02,723][123091] Updated weights for policy 0, policy_version 748432 (0.0005) [2023-12-26 05:34:03,141][123090] Updated weights for policy 1, policy_version 743747 (0.0006) [2023-12-26 05:34:03,187][123090] Updated weights for policy 1, policy_version 743757 (0.0007) [2023-12-26 05:34:03,239][123090] Updated weights for policy 1, policy_version 743767 (0.0010) [2023-12-26 05:34:03,339][123091] Updated weights for policy 0, policy_version 748442 (0.0006) [2023-12-26 05:34:03,399][123091] Updated weights for policy 0, policy_version 748452 (0.0008) [2023-12-26 05:34:03,449][123091] Updated weights for policy 0, policy_version 748462 (0.0008) [2023-12-26 05:34:03,784][121949] Fps is (10 sec: 18842.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 382017536. Throughput: 0: 8985.2, 1: 8883.8. Samples: 382028076. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:03,784][121949] Avg episode reward: [(0, '6049.669'), (1, '5231.165')] [2023-12-26 05:34:04,022][123090] Updated weights for policy 1, policy_version 743777 (0.0010) [2023-12-26 05:34:04,089][123090] Updated weights for policy 1, policy_version 743787 (0.0006) [2023-12-26 05:34:04,128][123091] Updated weights for policy 0, policy_version 748472 (0.0006) [2023-12-26 05:34:04,156][123090] Updated weights for policy 1, policy_version 743797 (0.0005) [2023-12-26 05:34:04,188][123091] Updated weights for policy 0, policy_version 748482 (0.0006) [2023-12-26 05:34:04,220][123090] Updated weights for policy 1, policy_version 743807 (0.0005) [2023-12-26 05:34:04,245][123091] Updated weights for policy 0, policy_version 748492 (0.0006) [2023-12-26 05:34:04,897][123090] Updated weights for policy 1, policy_version 743817 (0.0006) [2023-12-26 05:34:04,935][123091] Updated weights for policy 0, policy_version 748502 (0.0007) [2023-12-26 05:34:04,956][123090] Updated weights for policy 1, policy_version 743827 (0.0010) [2023-12-26 05:34:04,999][123091] Updated weights for policy 0, policy_version 748512 (0.0008) [2023-12-26 05:34:05,013][123090] Updated weights for policy 1, policy_version 743837 (0.0011) [2023-12-26 05:34:05,065][123091] Updated weights for policy 0, policy_version 748522 (0.0008) [2023-12-26 05:34:05,719][123091] Updated weights for policy 0, policy_version 748532 (0.0009) [2023-12-26 05:34:05,736][123090] Updated weights for policy 1, policy_version 743847 (0.0007) [2023-12-26 05:34:05,777][123091] Updated weights for policy 0, policy_version 748542 (0.0008) [2023-12-26 05:34:05,807][123090] Updated weights for policy 1, policy_version 743857 (0.0005) [2023-12-26 05:34:05,836][123091] Updated weights for policy 0, policy_version 748552 (0.0010) [2023-12-26 05:34:05,873][123090] Updated weights for policy 1, policy_version 743867 (0.0005) [2023-12-26 05:34:06,552][123090] Updated weights for policy 1, policy_version 743877 (0.0009) [2023-12-26 05:34:06,552][123091] Updated weights for policy 0, policy_version 748562 (0.0007) [2023-12-26 05:34:06,618][123090] Updated weights for policy 1, policy_version 743887 (0.0006) [2023-12-26 05:34:06,620][123091] Updated weights for policy 0, policy_version 748572 (0.0006) [2023-12-26 05:34:06,686][123090] Updated weights for policy 1, policy_version 743897 (0.0006) [2023-12-26 05:34:06,689][123091] Updated weights for policy 0, policy_version 748582 (0.0007) [2023-12-26 05:34:06,751][123091] Updated weights for policy 0, policy_version 748592 (0.0008) [2023-12-26 05:34:07,388][123090] Updated weights for policy 1, policy_version 743907 (0.0007) [2023-12-26 05:34:07,454][123090] Updated weights for policy 1, policy_version 743917 (0.0009) [2023-12-26 05:34:07,493][123091] Updated weights for policy 0, policy_version 748602 (0.0005) [2023-12-26 05:34:07,521][123090] Updated weights for policy 1, policy_version 743927 (0.0008) [2023-12-26 05:34:07,562][123091] Updated weights for policy 0, policy_version 748612 (0.0008) [2023-12-26 05:34:07,633][123091] Updated weights for policy 0, policy_version 748622 (0.0010) [2023-12-26 05:34:08,341][123090] Updated weights for policy 1, policy_version 743937 (0.0007) [2023-12-26 05:34:08,409][123090] Updated weights for policy 1, policy_version 743947 (0.0008) [2023-12-26 05:34:08,413][123091] Updated weights for policy 0, policy_version 748632 (0.0010) [2023-12-26 05:34:08,468][123090] Updated weights for policy 1, policy_version 743957 (0.0010) [2023-12-26 05:34:08,475][123091] Updated weights for policy 0, policy_version 748642 (0.0008) [2023-12-26 05:34:08,529][123090] Updated weights for policy 1, policy_version 743967 (0.0009) [2023-12-26 05:34:08,531][123091] Updated weights for policy 0, policy_version 748652 (0.0007) [2023-12-26 05:34:08,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 382115840. Throughput: 0: 9112.3, 1: 8988.7. Samples: 382088172. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:08,785][121949] Avg episode reward: [(0, '6061.824'), (1, '5200.529')] [2023-12-26 05:34:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000748656_191660032.pth... [2023-12-26 05:34:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000743968_190455808.pth... [2023-12-26 05:34:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000742912_190185472.pth [2023-12-26 05:34:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000747568_191381504.pth [2023-12-26 05:34:09,322][123090] Updated weights for policy 1, policy_version 743977 (0.0010) [2023-12-26 05:34:09,390][123090] Updated weights for policy 1, policy_version 743987 (0.0010) [2023-12-26 05:34:09,394][123091] Updated weights for policy 0, policy_version 748662 (0.0009) [2023-12-26 05:34:09,452][123090] Updated weights for policy 1, policy_version 743997 (0.0008) [2023-12-26 05:34:09,462][123091] Updated weights for policy 0, policy_version 748672 (0.0008) [2023-12-26 05:34:09,515][123091] Updated weights for policy 0, policy_version 748682 (0.0006) [2023-12-26 05:34:10,229][123090] Updated weights for policy 1, policy_version 744007 (0.0010) [2023-12-26 05:34:10,300][123090] Updated weights for policy 1, policy_version 744017 (0.0011) [2023-12-26 05:34:10,357][123091] Updated weights for policy 0, policy_version 748692 (0.0007) [2023-12-26 05:34:10,365][123090] Updated weights for policy 1, policy_version 744027 (0.0011) [2023-12-26 05:34:10,416][123091] Updated weights for policy 0, policy_version 748702 (0.0008) [2023-12-26 05:34:10,469][123091] Updated weights for policy 0, policy_version 748712 (0.0009) [2023-12-26 05:34:11,107][123090] Updated weights for policy 1, policy_version 744037 (0.0010) [2023-12-26 05:34:11,187][123090] Updated weights for policy 1, policy_version 744047 (0.0010) [2023-12-26 05:34:11,246][123091] Updated weights for policy 0, policy_version 748722 (0.0007) [2023-12-26 05:34:11,262][123090] Updated weights for policy 1, policy_version 744057 (0.0010) [2023-12-26 05:34:11,316][123091] Updated weights for policy 0, policy_version 748732 (0.0009) [2023-12-26 05:34:11,394][123091] Updated weights for policy 0, policy_version 748742 (0.0008) [2023-12-26 05:34:11,461][123091] Updated weights for policy 0, policy_version 748752 (0.0007) [2023-12-26 05:34:12,102][123090] Updated weights for policy 1, policy_version 744067 (0.0011) [2023-12-26 05:34:12,173][123090] Updated weights for policy 1, policy_version 744077 (0.0010) [2023-12-26 05:34:12,206][123091] Updated weights for policy 0, policy_version 748762 (0.0007) [2023-12-26 05:34:12,233][123090] Updated weights for policy 1, policy_version 744087 (0.0010) [2023-12-26 05:34:12,272][123091] Updated weights for policy 0, policy_version 748772 (0.0007) [2023-12-26 05:34:12,346][123091] Updated weights for policy 0, policy_version 748782 (0.0008) [2023-12-26 05:34:12,953][123090] Updated weights for policy 1, policy_version 744097 (0.0012) [2023-12-26 05:34:13,028][123090] Updated weights for policy 1, policy_version 744107 (0.0007) [2023-12-26 05:34:13,093][123090] Updated weights for policy 1, policy_version 744117 (0.0009) [2023-12-26 05:34:13,134][123091] Updated weights for policy 0, policy_version 748792 (0.0010) [2023-12-26 05:34:13,154][123090] Updated weights for policy 1, policy_version 744127 (0.0006) [2023-12-26 05:34:13,185][123091] Updated weights for policy 0, policy_version 748802 (0.0010) [2023-12-26 05:34:13,229][123091] Updated weights for policy 0, policy_version 748812 (0.0010) [2023-12-26 05:34:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 382197760. Throughput: 0: 9105.2, 1: 9034.2. Samples: 382193464. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:13,784][121949] Avg episode reward: [(0, '6111.804'), (1, '5202.457')] [2023-12-26 05:34:13,953][123091] Updated weights for policy 0, policy_version 748822 (0.0007) [2023-12-26 05:34:14,004][123091] Updated weights for policy 0, policy_version 748832 (0.0006) [2023-12-26 05:34:14,017][123090] Updated weights for policy 1, policy_version 744137 (0.0008) [2023-12-26 05:34:14,060][123091] Updated weights for policy 0, policy_version 748842 (0.0006) [2023-12-26 05:34:14,077][123090] Updated weights for policy 1, policy_version 744147 (0.0008) [2023-12-26 05:34:14,133][123090] Updated weights for policy 1, policy_version 744157 (0.0007) [2023-12-26 05:34:14,813][123091] Updated weights for policy 0, policy_version 748852 (0.0006) [2023-12-26 05:34:14,852][123090] Updated weights for policy 1, policy_version 744167 (0.0008) [2023-12-26 05:34:14,873][123091] Updated weights for policy 0, policy_version 748862 (0.0010) [2023-12-26 05:34:14,923][123090] Updated weights for policy 1, policy_version 744177 (0.0008) [2023-12-26 05:34:14,934][123091] Updated weights for policy 0, policy_version 748872 (0.0011) [2023-12-26 05:34:14,993][123090] Updated weights for policy 1, policy_version 744187 (0.0008) [2023-12-26 05:34:15,636][123091] Updated weights for policy 0, policy_version 748882 (0.0007) [2023-12-26 05:34:15,701][123091] Updated weights for policy 0, policy_version 748892 (0.0005) [2023-12-26 05:34:15,705][123090] Updated weights for policy 1, policy_version 744197 (0.0009) [2023-12-26 05:34:15,754][123090] Updated weights for policy 1, policy_version 744207 (0.0007) [2023-12-26 05:34:15,757][123091] Updated weights for policy 0, policy_version 748902 (0.0009) [2023-12-26 05:34:15,803][123091] Updated weights for policy 0, policy_version 748912 (0.0008) [2023-12-26 05:34:15,821][123090] Updated weights for policy 1, policy_version 744217 (0.0006) [2023-12-26 05:34:16,579][123090] Updated weights for policy 1, policy_version 744227 (0.0007) [2023-12-26 05:34:16,642][123090] Updated weights for policy 1, policy_version 744237 (0.0009) [2023-12-26 05:34:16,654][123091] Updated weights for policy 0, policy_version 748922 (0.0008) [2023-12-26 05:34:16,700][123091] Updated weights for policy 0, policy_version 748932 (0.0008) [2023-12-26 05:34:16,701][123090] Updated weights for policy 1, policy_version 744247 (0.0009) [2023-12-26 05:34:16,751][123091] Updated weights for policy 0, policy_version 748942 (0.0006) [2023-12-26 05:34:17,550][123090] Updated weights for policy 1, policy_version 744257 (0.0010) [2023-12-26 05:34:17,598][123090] Updated weights for policy 1, policy_version 744267 (0.0010) [2023-12-26 05:34:17,615][123091] Updated weights for policy 0, policy_version 748952 (0.0008) [2023-12-26 05:34:17,649][123090] Updated weights for policy 1, policy_version 744277 (0.0007) [2023-12-26 05:34:17,671][123091] Updated weights for policy 0, policy_version 748962 (0.0009) [2023-12-26 05:34:17,713][123090] Updated weights for policy 1, policy_version 744287 (0.0005) [2023-12-26 05:34:17,734][123091] Updated weights for policy 0, policy_version 748972 (0.0009) [2023-12-26 05:34:18,445][123090] Updated weights for policy 1, policy_version 744297 (0.0008) [2023-12-26 05:34:18,491][123090] Updated weights for policy 1, policy_version 744307 (0.0006) [2023-12-26 05:34:18,538][123090] Updated weights for policy 1, policy_version 744317 (0.0005) [2023-12-26 05:34:18,632][123091] Updated weights for policy 0, policy_version 748982 (0.0010) [2023-12-26 05:34:18,698][123091] Updated weights for policy 0, policy_version 748992 (0.0010) [2023-12-26 05:34:18,762][123091] Updated weights for policy 0, policy_version 749002 (0.0009) [2023-12-26 05:34:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 382287872. Throughput: 0: 9047.6, 1: 9066.7. Samples: 382302176. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:18,785][121949] Avg episode reward: [(0, '6047.616'), (1, '5188.965')] [2023-12-26 05:34:19,374][123090] Updated weights for policy 1, policy_version 744327 (0.0008) [2023-12-26 05:34:19,435][123090] Updated weights for policy 1, policy_version 744337 (0.0010) [2023-12-26 05:34:19,499][123090] Updated weights for policy 1, policy_version 744347 (0.0010) [2023-12-26 05:34:19,617][123091] Updated weights for policy 0, policy_version 749012 (0.0007) [2023-12-26 05:34:19,683][123091] Updated weights for policy 0, policy_version 749022 (0.0006) [2023-12-26 05:34:19,747][123091] Updated weights for policy 0, policy_version 749032 (0.0008) [2023-12-26 05:34:20,344][123090] Updated weights for policy 1, policy_version 744357 (0.0009) [2023-12-26 05:34:20,410][123090] Updated weights for policy 1, policy_version 744367 (0.0009) [2023-12-26 05:34:20,477][123090] Updated weights for policy 1, policy_version 744377 (0.0009) [2023-12-26 05:34:20,531][123091] Updated weights for policy 0, policy_version 749042 (0.0010) [2023-12-26 05:34:20,606][123091] Updated weights for policy 0, policy_version 749053 (0.0010) [2023-12-26 05:34:20,678][123091] Updated weights for policy 0, policy_version 749063 (0.0010) [2023-12-26 05:34:21,273][123090] Updated weights for policy 1, policy_version 744387 (0.0009) [2023-12-26 05:34:21,336][123090] Updated weights for policy 1, policy_version 744397 (0.0008) [2023-12-26 05:34:21,411][123090] Updated weights for policy 1, policy_version 744407 (0.0008) [2023-12-26 05:34:21,577][123091] Updated weights for policy 0, policy_version 749073 (0.0010) [2023-12-26 05:34:21,652][123091] Updated weights for policy 0, policy_version 749083 (0.0010) [2023-12-26 05:34:21,721][123091] Updated weights for policy 0, policy_version 749093 (0.0010) [2023-12-26 05:34:21,796][123091] Updated weights for policy 0, policy_version 749103 (0.0009) [2023-12-26 05:34:22,184][123090] Updated weights for policy 1, policy_version 744417 (0.0008) [2023-12-26 05:34:22,251][123090] Updated weights for policy 1, policy_version 744427 (0.0006) [2023-12-26 05:34:22,314][123090] Updated weights for policy 1, policy_version 744438 (0.0009) [2023-12-26 05:34:22,388][123090] Updated weights for policy 1, policy_version 744448 (0.0010) [2023-12-26 05:34:22,697][123091] Updated weights for policy 0, policy_version 749113 (0.0009) [2023-12-26 05:34:22,748][123091] Updated weights for policy 0, policy_version 749123 (0.0009) [2023-12-26 05:34:22,818][123091] Updated weights for policy 0, policy_version 749133 (0.0010) [2023-12-26 05:34:23,159][123090] Updated weights for policy 1, policy_version 744458 (0.0010) [2023-12-26 05:34:23,212][123090] Updated weights for policy 1, policy_version 744468 (0.0009) [2023-12-26 05:34:23,264][123090] Updated weights for policy 1, policy_version 744478 (0.0009) [2023-12-26 05:34:23,659][123091] Updated weights for policy 0, policy_version 749143 (0.0010) [2023-12-26 05:34:23,727][123091] Updated weights for policy 0, policy_version 749153 (0.0008) [2023-12-26 05:34:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 382369792. Throughput: 0: 9047.7, 1: 8998.2. Samples: 382352140. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:23,785][121949] Avg episode reward: [(0, '5975.091'), (1, '5057.847')] [2023-12-26 05:34:23,788][123091] Updated weights for policy 0, policy_version 749163 (0.0010) [2023-12-26 05:34:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000744480_190586880.pth... [2023-12-26 05:34:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000743424_190316544.pth [2023-12-26 05:34:23,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000749168_191791104.pth... [2023-12-26 05:34:23,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000748112_191520768.pth [2023-12-26 05:34:24,049][123090] Updated weights for policy 1, policy_version 744488 (0.0006) [2023-12-26 05:34:24,102][123090] Updated weights for policy 1, policy_version 744498 (0.0005) [2023-12-26 05:34:24,151][123090] Updated weights for policy 1, policy_version 744508 (0.0005) [2023-12-26 05:34:24,662][123091] Updated weights for policy 0, policy_version 749173 (0.0010) [2023-12-26 05:34:24,711][123091] Updated weights for policy 0, policy_version 749183 (0.0009) [2023-12-26 05:34:24,774][123091] Updated weights for policy 0, policy_version 749193 (0.0005) [2023-12-26 05:34:24,877][123090] Updated weights for policy 1, policy_version 744518 (0.0008) [2023-12-26 05:34:24,931][123090] Updated weights for policy 1, policy_version 744528 (0.0010) [2023-12-26 05:34:24,981][123090] Updated weights for policy 1, policy_version 744538 (0.0009) [2023-12-26 05:34:25,548][123091] Updated weights for policy 0, policy_version 749203 (0.0007) [2023-12-26 05:34:25,602][123091] Updated weights for policy 0, policy_version 749213 (0.0010) [2023-12-26 05:34:25,656][123091] Updated weights for policy 0, policy_version 749223 (0.0010) [2023-12-26 05:34:25,813][123090] Updated weights for policy 1, policy_version 744548 (0.0010) [2023-12-26 05:34:25,879][123090] Updated weights for policy 1, policy_version 744558 (0.0009) [2023-12-26 05:34:25,936][123090] Updated weights for policy 1, policy_version 744568 (0.0008) [2023-12-26 05:34:26,495][123091] Updated weights for policy 0, policy_version 749233 (0.0011) [2023-12-26 05:34:26,544][123091] Updated weights for policy 0, policy_version 749243 (0.0005) [2023-12-26 05:34:26,607][123091] Updated weights for policy 0, policy_version 749253 (0.0006) [2023-12-26 05:34:26,662][123091] Updated weights for policy 0, policy_version 749263 (0.0010) [2023-12-26 05:34:26,730][123090] Updated weights for policy 1, policy_version 744578 (0.0009) [2023-12-26 05:34:26,787][123090] Updated weights for policy 1, policy_version 744588 (0.0008) [2023-12-26 05:34:26,838][123090] Updated weights for policy 1, policy_version 744598 (0.0009) [2023-12-26 05:34:26,890][123090] Updated weights for policy 1, policy_version 744608 (0.0009) [2023-12-26 05:34:27,299][123091] Updated weights for policy 0, policy_version 749273 (0.0010) [2023-12-26 05:34:27,358][123091] Updated weights for policy 0, policy_version 749283 (0.0010) [2023-12-26 05:34:27,412][123091] Updated weights for policy 0, policy_version 749293 (0.0010) [2023-12-26 05:34:27,731][123090] Updated weights for policy 1, policy_version 744618 (0.0010) [2023-12-26 05:34:27,795][123090] Updated weights for policy 1, policy_version 744628 (0.0009) [2023-12-26 05:34:27,862][123090] Updated weights for policy 1, policy_version 744638 (0.0010) [2023-12-26 05:34:28,243][123091] Updated weights for policy 0, policy_version 749303 (0.0009) [2023-12-26 05:34:28,293][123091] Updated weights for policy 0, policy_version 749313 (0.0009) [2023-12-26 05:34:28,351][123091] Updated weights for policy 0, policy_version 749323 (0.0009) [2023-12-26 05:34:28,622][123090] Updated weights for policy 1, policy_version 744648 (0.0006) [2023-12-26 05:34:28,687][123090] Updated weights for policy 1, policy_version 744658 (0.0009) [2023-12-26 05:34:28,758][123090] Updated weights for policy 1, policy_version 744668 (0.0009) [2023-12-26 05:34:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 382468096. Throughput: 0: 9022.8, 1: 9035.3. Samples: 382457184. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:28,785][121949] Avg episode reward: [(0, '5915.388'), (1, '5159.286')] [2023-12-26 05:34:29,237][123091] Updated weights for policy 0, policy_version 749333 (0.0009) [2023-12-26 05:34:29,301][123091] Updated weights for policy 0, policy_version 749343 (0.0009) [2023-12-26 05:34:29,361][123091] Updated weights for policy 0, policy_version 749353 (0.0010) [2023-12-26 05:34:29,548][123090] Updated weights for policy 1, policy_version 744678 (0.0009) [2023-12-26 05:34:29,608][123090] Updated weights for policy 1, policy_version 744688 (0.0009) [2023-12-26 05:34:29,661][123090] Updated weights for policy 1, policy_version 744698 (0.0009) [2023-12-26 05:34:30,129][123091] Updated weights for policy 0, policy_version 749363 (0.0009) [2023-12-26 05:34:30,190][123091] Updated weights for policy 0, policy_version 749373 (0.0010) [2023-12-26 05:34:30,255][123091] Updated weights for policy 0, policy_version 749383 (0.0009) [2023-12-26 05:34:30,511][123090] Updated weights for policy 1, policy_version 744708 (0.0010) [2023-12-26 05:34:30,563][123090] Updated weights for policy 1, policy_version 744718 (0.0009) [2023-12-26 05:34:30,619][123090] Updated weights for policy 1, policy_version 744728 (0.0008) [2023-12-26 05:34:31,056][123091] Updated weights for policy 0, policy_version 749393 (0.0009) [2023-12-26 05:34:31,116][123091] Updated weights for policy 0, policy_version 749403 (0.0009) [2023-12-26 05:34:31,178][123091] Updated weights for policy 0, policy_version 749413 (0.0010) [2023-12-26 05:34:31,240][123091] Updated weights for policy 0, policy_version 749423 (0.0010) [2023-12-26 05:34:31,481][123090] Updated weights for policy 1, policy_version 744738 (0.0009) [2023-12-26 05:34:31,542][123090] Updated weights for policy 1, policy_version 744748 (0.0008) [2023-12-26 05:34:31,599][123090] Updated weights for policy 1, policy_version 744758 (0.0009) [2023-12-26 05:34:31,666][123090] Updated weights for policy 1, policy_version 744768 (0.0010) [2023-12-26 05:34:32,035][123091] Updated weights for policy 0, policy_version 749433 (0.0011) [2023-12-26 05:34:32,093][123091] Updated weights for policy 0, policy_version 749443 (0.0011) [2023-12-26 05:34:32,162][123091] Updated weights for policy 0, policy_version 749453 (0.0006) [2023-12-26 05:34:32,537][123090] Updated weights for policy 1, policy_version 744778 (0.0010) [2023-12-26 05:34:32,591][123090] Updated weights for policy 1, policy_version 744788 (0.0010) [2023-12-26 05:34:32,643][123090] Updated weights for policy 1, policy_version 744798 (0.0009) [2023-12-26 05:34:32,953][123091] Updated weights for policy 0, policy_version 749463 (0.0009) [2023-12-26 05:34:33,019][123091] Updated weights for policy 0, policy_version 749473 (0.0011) [2023-12-26 05:34:33,085][123091] Updated weights for policy 0, policy_version 749483 (0.0010) [2023-12-26 05:34:33,545][123090] Updated weights for policy 1, policy_version 744808 (0.0009) [2023-12-26 05:34:33,603][123090] Updated weights for policy 1, policy_version 744818 (0.0010) [2023-12-26 05:34:33,657][123090] Updated weights for policy 1, policy_version 744828 (0.0011) [2023-12-26 05:34:33,766][123091] Updated weights for policy 0, policy_version 749493 (0.0008) [2023-12-26 05:34:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 382550016. Throughput: 0: 8945.1, 1: 8959.6. Samples: 382560832. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:33,785][121949] Avg episode reward: [(0, '6025.040'), (1, '5101.900')] [2023-12-26 05:34:33,832][123091] Updated weights for policy 0, policy_version 749503 (0.0005) [2023-12-26 05:34:33,882][123091] Updated weights for policy 0, policy_version 749513 (0.0007) [2023-12-26 05:34:34,577][123091] Updated weights for policy 0, policy_version 749523 (0.0009) [2023-12-26 05:34:34,585][123090] Updated weights for policy 1, policy_version 744838 (0.0010) [2023-12-26 05:34:34,638][123090] Updated weights for policy 1, policy_version 744848 (0.0009) [2023-12-26 05:34:34,642][123091] Updated weights for policy 0, policy_version 749533 (0.0006) [2023-12-26 05:34:34,696][123090] Updated weights for policy 1, policy_version 744858 (0.0010) [2023-12-26 05:34:34,700][123091] Updated weights for policy 0, policy_version 749543 (0.0005) [2023-12-26 05:34:35,460][123091] Updated weights for policy 0, policy_version 749553 (0.0007) [2023-12-26 05:34:35,507][123091] Updated weights for policy 0, policy_version 749563 (0.0009) [2023-12-26 05:34:35,546][123090] Updated weights for policy 1, policy_version 744868 (0.0008) [2023-12-26 05:34:35,556][123091] Updated weights for policy 0, policy_version 749573 (0.0009) [2023-12-26 05:34:35,598][123090] Updated weights for policy 1, policy_version 744878 (0.0008) [2023-12-26 05:34:35,608][123091] Updated weights for policy 0, policy_version 749583 (0.0007) [2023-12-26 05:34:35,661][123090] Updated weights for policy 1, policy_version 744888 (0.0009) [2023-12-26 05:34:36,493][123091] Updated weights for policy 0, policy_version 749593 (0.0009) [2023-12-26 05:34:36,506][123090] Updated weights for policy 1, policy_version 744898 (0.0008) [2023-12-26 05:34:36,544][123091] Updated weights for policy 0, policy_version 749603 (0.0009) [2023-12-26 05:34:36,572][123090] Updated weights for policy 1, policy_version 744908 (0.0009) [2023-12-26 05:34:36,598][123091] Updated weights for policy 0, policy_version 749613 (0.0009) [2023-12-26 05:34:36,640][123090] Updated weights for policy 1, policy_version 744918 (0.0009) [2023-12-26 05:34:36,698][123090] Updated weights for policy 1, policy_version 744928 (0.0009) [2023-12-26 05:34:37,393][123091] Updated weights for policy 0, policy_version 749623 (0.0009) [2023-12-26 05:34:37,456][123091] Updated weights for policy 0, policy_version 749633 (0.0007) [2023-12-26 05:34:37,524][123091] Updated weights for policy 0, policy_version 749643 (0.0006) [2023-12-26 05:34:37,557][123090] Updated weights for policy 1, policy_version 744938 (0.0009) [2023-12-26 05:34:37,619][123090] Updated weights for policy 1, policy_version 744948 (0.0010) [2023-12-26 05:34:37,682][123090] Updated weights for policy 1, policy_version 744958 (0.0009) [2023-12-26 05:34:38,178][123091] Updated weights for policy 0, policy_version 749653 (0.0005) [2023-12-26 05:34:38,234][123091] Updated weights for policy 0, policy_version 749663 (0.0010) [2023-12-26 05:34:38,286][123091] Updated weights for policy 0, policy_version 749673 (0.0010) [2023-12-26 05:34:38,626][123090] Updated weights for policy 1, policy_version 744968 (0.0009) [2023-12-26 05:34:38,693][123090] Updated weights for policy 1, policy_version 744978 (0.0009) [2023-12-26 05:34:38,758][123090] Updated weights for policy 1, policy_version 744988 (0.0009) [2023-12-26 05:34:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 382640128. Throughput: 0: 8970.2, 1: 8962.2. Samples: 382612980. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:38,784][121949] Avg episode reward: [(0, '6118.307'), (1, '4959.741')] [2023-12-26 05:34:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000749680_191922176.pth... [2023-12-26 05:34:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000744992_190717952.pth... [2023-12-26 05:34:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000748656_191660032.pth [2023-12-26 05:34:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000743968_190455808.pth [2023-12-26 05:34:39,150][123091] Updated weights for policy 0, policy_version 749683 (0.0011) [2023-12-26 05:34:39,212][123091] Updated weights for policy 0, policy_version 749693 (0.0010) [2023-12-26 05:34:39,281][123091] Updated weights for policy 0, policy_version 749703 (0.0011) [2023-12-26 05:34:39,637][123090] Updated weights for policy 1, policy_version 744998 (0.0008) [2023-12-26 05:34:39,685][123090] Updated weights for policy 1, policy_version 745008 (0.0008) [2023-12-26 05:34:39,739][123090] Updated weights for policy 1, policy_version 745018 (0.0009) [2023-12-26 05:34:40,119][123091] Updated weights for policy 0, policy_version 749713 (0.0011) [2023-12-26 05:34:40,178][123091] Updated weights for policy 0, policy_version 749723 (0.0011) [2023-12-26 05:34:40,234][123091] Updated weights for policy 0, policy_version 749733 (0.0010) [2023-12-26 05:34:40,301][123091] Updated weights for policy 0, policy_version 749743 (0.0011) [2023-12-26 05:34:40,616][123090] Updated weights for policy 1, policy_version 745028 (0.0009) [2023-12-26 05:34:40,666][123090] Updated weights for policy 1, policy_version 745038 (0.0009) [2023-12-26 05:34:40,724][123090] Updated weights for policy 1, policy_version 745048 (0.0008) [2023-12-26 05:34:41,099][123091] Updated weights for policy 0, policy_version 749753 (0.0009) [2023-12-26 05:34:41,180][123091] Updated weights for policy 0, policy_version 749763 (0.0009) [2023-12-26 05:34:41,240][123091] Updated weights for policy 0, policy_version 749773 (0.0010) [2023-12-26 05:34:41,568][123090] Updated weights for policy 1, policy_version 745058 (0.0008) [2023-12-26 05:34:41,626][123090] Updated weights for policy 1, policy_version 745068 (0.0007) [2023-12-26 05:34:41,696][123090] Updated weights for policy 1, policy_version 745078 (0.0010) [2023-12-26 05:34:41,768][123090] Updated weights for policy 1, policy_version 745088 (0.0010) [2023-12-26 05:34:42,134][123091] Updated weights for policy 0, policy_version 749783 (0.0010) [2023-12-26 05:34:42,196][123091] Updated weights for policy 0, policy_version 749793 (0.0009) [2023-12-26 05:34:42,264][123091] Updated weights for policy 0, policy_version 749803 (0.0010) [2023-12-26 05:34:42,609][123090] Updated weights for policy 1, policy_version 745098 (0.0010) [2023-12-26 05:34:42,674][123090] Updated weights for policy 1, policy_version 745108 (0.0010) [2023-12-26 05:34:42,735][123090] Updated weights for policy 1, policy_version 745118 (0.0009) [2023-12-26 05:34:43,106][123091] Updated weights for policy 0, policy_version 749813 (0.0009) [2023-12-26 05:34:43,168][123091] Updated weights for policy 0, policy_version 749823 (0.0009) [2023-12-26 05:34:43,234][123091] Updated weights for policy 0, policy_version 749833 (0.0010) [2023-12-26 05:34:43,602][123090] Updated weights for policy 1, policy_version 745128 (0.0007) [2023-12-26 05:34:43,662][123090] Updated weights for policy 1, policy_version 745138 (0.0006) [2023-12-26 05:34:43,719][123090] Updated weights for policy 1, policy_version 745148 (0.0009) [2023-12-26 05:34:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 382722048. Throughput: 0: 8883.4, 1: 8837.6. Samples: 382714032. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:43,785][121949] Avg episode reward: [(0, '6085.086'), (1, '4985.447')] [2023-12-26 05:34:44,015][123091] Updated weights for policy 0, policy_version 749843 (0.0009) [2023-12-26 05:34:44,074][123091] Updated weights for policy 0, policy_version 749853 (0.0010) [2023-12-26 05:34:44,135][123091] Updated weights for policy 0, policy_version 749863 (0.0008) [2023-12-26 05:34:44,526][123090] Updated weights for policy 1, policy_version 745158 (0.0007) [2023-12-26 05:34:44,586][123090] Updated weights for policy 1, policy_version 745168 (0.0006) [2023-12-26 05:34:44,649][123090] Updated weights for policy 1, policy_version 745178 (0.0005) [2023-12-26 05:34:44,870][123091] Updated weights for policy 0, policy_version 749873 (0.0009) [2023-12-26 05:34:44,936][123091] Updated weights for policy 0, policy_version 749883 (0.0006) [2023-12-26 05:34:45,008][123091] Updated weights for policy 0, policy_version 749893 (0.0008) [2023-12-26 05:34:45,075][123091] Updated weights for policy 0, policy_version 749903 (0.0007) [2023-12-26 05:34:45,336][123090] Updated weights for policy 1, policy_version 745188 (0.0006) [2023-12-26 05:34:45,403][123090] Updated weights for policy 1, policy_version 745198 (0.0010) [2023-12-26 05:34:45,469][123090] Updated weights for policy 1, policy_version 745208 (0.0008) [2023-12-26 05:34:45,883][123091] Updated weights for policy 0, policy_version 749913 (0.0010) [2023-12-26 05:34:45,932][123091] Updated weights for policy 0, policy_version 749923 (0.0011) [2023-12-26 05:34:45,980][123091] Updated weights for policy 0, policy_version 749933 (0.0010) [2023-12-26 05:34:46,235][123090] Updated weights for policy 1, policy_version 745218 (0.0006) [2023-12-26 05:34:46,299][123090] Updated weights for policy 1, policy_version 745228 (0.0009) [2023-12-26 05:34:46,346][123090] Updated weights for policy 1, policy_version 745238 (0.0008) [2023-12-26 05:34:46,408][123090] Updated weights for policy 1, policy_version 745248 (0.0008) [2023-12-26 05:34:46,830][123091] Updated weights for policy 0, policy_version 749943 (0.0007) [2023-12-26 05:34:46,879][123091] Updated weights for policy 0, policy_version 749953 (0.0005) [2023-12-26 05:34:46,939][123091] Updated weights for policy 0, policy_version 749963 (0.0005) [2023-12-26 05:34:47,239][123090] Updated weights for policy 1, policy_version 745258 (0.0010) [2023-12-26 05:34:47,306][123090] Updated weights for policy 1, policy_version 745268 (0.0011) [2023-12-26 05:34:47,370][123090] Updated weights for policy 1, policy_version 745278 (0.0011) [2023-12-26 05:34:47,701][123091] Updated weights for policy 0, policy_version 749973 (0.0008) [2023-12-26 05:34:47,750][123091] Updated weights for policy 0, policy_version 749983 (0.0010) [2023-12-26 05:34:47,797][123091] Updated weights for policy 0, policy_version 749993 (0.0010) [2023-12-26 05:34:48,208][123090] Updated weights for policy 1, policy_version 745288 (0.0007) [2023-12-26 05:34:48,273][123090] Updated weights for policy 1, policy_version 745298 (0.0005) [2023-12-26 05:34:48,350][123090] Updated weights for policy 1, policy_version 745308 (0.0006) [2023-12-26 05:34:48,663][123091] Updated weights for policy 0, policy_version 750003 (0.0009) [2023-12-26 05:34:48,730][123091] Updated weights for policy 0, policy_version 750013 (0.0005) [2023-12-26 05:34:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 382803968. Throughput: 0: 8857.4, 1: 8745.6. Samples: 382820212. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:48,785][121949] Avg episode reward: [(0, '5861.544'), (1, '5142.187')] [2023-12-26 05:34:48,801][123091] Updated weights for policy 0, policy_version 750023 (0.0006) [2023-12-26 05:34:49,032][123090] Updated weights for policy 1, policy_version 745318 (0.0006) [2023-12-26 05:34:49,099][123090] Updated weights for policy 1, policy_version 745328 (0.0005) [2023-12-26 05:34:49,165][123090] Updated weights for policy 1, policy_version 745338 (0.0005) [2023-12-26 05:34:49,397][123091] Updated weights for policy 0, policy_version 750033 (0.0006) [2023-12-26 05:34:49,461][123091] Updated weights for policy 0, policy_version 750043 (0.0008) [2023-12-26 05:34:49,519][123091] Updated weights for policy 0, policy_version 750053 (0.0008) [2023-12-26 05:34:49,570][123091] Updated weights for policy 0, policy_version 750063 (0.0008) [2023-12-26 05:34:49,944][123090] Updated weights for policy 1, policy_version 745348 (0.0007) [2023-12-26 05:34:50,008][123090] Updated weights for policy 1, policy_version 745358 (0.0011) [2023-12-26 05:34:50,060][123090] Updated weights for policy 1, policy_version 745368 (0.0010) [2023-12-26 05:34:50,418][123091] Updated weights for policy 0, policy_version 750073 (0.0009) [2023-12-26 05:34:50,483][123091] Updated weights for policy 0, policy_version 750083 (0.0009) [2023-12-26 05:34:50,543][123091] Updated weights for policy 0, policy_version 750093 (0.0009) [2023-12-26 05:34:50,899][123090] Updated weights for policy 1, policy_version 745378 (0.0010) [2023-12-26 05:34:50,956][123090] Updated weights for policy 1, policy_version 745388 (0.0011) [2023-12-26 05:34:51,004][123090] Updated weights for policy 1, policy_version 745398 (0.0010) [2023-12-26 05:34:51,073][123090] Updated weights for policy 1, policy_version 745408 (0.0011) [2023-12-26 05:34:51,409][123091] Updated weights for policy 0, policy_version 750103 (0.0007) [2023-12-26 05:34:51,484][123091] Updated weights for policy 0, policy_version 750113 (0.0006) [2023-12-26 05:34:51,553][123091] Updated weights for policy 0, policy_version 750123 (0.0006) [2023-12-26 05:34:51,880][123090] Updated weights for policy 1, policy_version 745418 (0.0010) [2023-12-26 05:34:51,945][123090] Updated weights for policy 1, policy_version 745428 (0.0009) [2023-12-26 05:34:51,998][123090] Updated weights for policy 1, policy_version 745438 (0.0009) [2023-12-26 05:34:52,209][123091] Updated weights for policy 0, policy_version 750133 (0.0006) [2023-12-26 05:34:52,279][123091] Updated weights for policy 0, policy_version 750143 (0.0008) [2023-12-26 05:34:52,346][123091] Updated weights for policy 0, policy_version 750153 (0.0006) [2023-12-26 05:34:52,925][123090] Updated weights for policy 1, policy_version 745448 (0.0010) [2023-12-26 05:34:52,985][123090] Updated weights for policy 1, policy_version 745458 (0.0006) [2023-12-26 05:34:53,046][123090] Updated weights for policy 1, policy_version 745468 (0.0006) [2023-12-26 05:34:53,126][123091] Updated weights for policy 0, policy_version 750163 (0.0008) [2023-12-26 05:34:53,180][123091] Updated weights for policy 0, policy_version 750173 (0.0010) [2023-12-26 05:34:53,238][123091] Updated weights for policy 0, policy_version 750183 (0.0010) [2023-12-26 05:34:53,740][123090] Updated weights for policy 1, policy_version 745478 (0.0008) [2023-12-26 05:34:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.5, 300 sec: 17661.4). Total num frames: 382894080. Throughput: 0: 8771.8, 1: 8674.3. Samples: 382873244. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 05:34:53,785][121949] Avg episode reward: [(0, '5884.513'), (1, '5149.275')] [2023-12-26 05:34:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000750192_192053248.pth... [2023-12-26 05:34:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000749168_191791104.pth [2023-12-26 05:34:53,804][123090] Updated weights for policy 1, policy_version 745488 (0.0010) [2023-12-26 05:34:53,853][123090] Updated weights for policy 1, policy_version 745498 (0.0009) [2023-12-26 05:34:53,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000745504_190849024.pth... [2023-12-26 05:34:53,880][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000744480_190586880.pth [2023-12-26 05:34:54,131][123091] Updated weights for policy 0, policy_version 750193 (0.0010) [2023-12-26 05:34:54,192][123091] Updated weights for policy 0, policy_version 750203 (0.0009) [2023-12-26 05:34:54,239][123091] Updated weights for policy 0, policy_version 750213 (0.0009) [2023-12-26 05:34:54,292][123091] Updated weights for policy 0, policy_version 750223 (0.0009) [2023-12-26 05:34:54,629][123090] Updated weights for policy 1, policy_version 745508 (0.0007) [2023-12-26 05:34:54,688][123090] Updated weights for policy 1, policy_version 745518 (0.0010) [2023-12-26 05:34:54,753][123090] Updated weights for policy 1, policy_version 745528 (0.0009) [2023-12-26 05:34:55,211][123091] Updated weights for policy 0, policy_version 750233 (0.0010) [2023-12-26 05:34:55,277][123091] Updated weights for policy 0, policy_version 750243 (0.0010) [2023-12-26 05:34:55,348][123091] Updated weights for policy 0, policy_version 750253 (0.0010) [2023-12-26 05:34:55,477][123090] Updated weights for policy 1, policy_version 745538 (0.0009) [2023-12-26 05:34:55,528][123090] Updated weights for policy 1, policy_version 745548 (0.0005) [2023-12-26 05:34:55,582][123090] Updated weights for policy 1, policy_version 745558 (0.0005) [2023-12-26 05:34:55,632][123090] Updated weights for policy 1, policy_version 745568 (0.0005) [2023-12-26 05:34:56,277][123091] Updated weights for policy 0, policy_version 750263 (0.0009) [2023-12-26 05:34:56,308][123090] Updated weights for policy 1, policy_version 745578 (0.0005) [2023-12-26 05:34:56,342][123091] Updated weights for policy 0, policy_version 750273 (0.0009) [2023-12-26 05:34:56,355][123090] Updated weights for policy 1, policy_version 745588 (0.0005) [2023-12-26 05:34:56,403][123091] Updated weights for policy 0, policy_version 750283 (0.0009) [2023-12-26 05:34:56,405][123090] Updated weights for policy 1, policy_version 745598 (0.0005) [2023-12-26 05:34:57,081][123090] Updated weights for policy 1, policy_version 745608 (0.0009) [2023-12-26 05:34:57,136][123090] Updated weights for policy 1, policy_version 745618 (0.0010) [2023-12-26 05:34:57,180][123090] Updated weights for policy 1, policy_version 745628 (0.0010) [2023-12-26 05:34:57,292][123091] Updated weights for policy 0, policy_version 750293 (0.0009) [2023-12-26 05:34:57,363][123091] Updated weights for policy 0, policy_version 750303 (0.0009) [2023-12-26 05:34:57,425][123091] Updated weights for policy 0, policy_version 750313 (0.0010) [2023-12-26 05:34:57,894][123090] Updated weights for policy 1, policy_version 745638 (0.0007) [2023-12-26 05:34:57,944][123090] Updated weights for policy 1, policy_version 745648 (0.0005) [2023-12-26 05:34:58,000][123090] Updated weights for policy 1, policy_version 745658 (0.0005) [2023-12-26 05:34:58,192][123091] Updated weights for policy 0, policy_version 750324 (0.0009) [2023-12-26 05:34:58,257][123091] Updated weights for policy 0, policy_version 750334 (0.0008) [2023-12-26 05:34:58,328][123091] Updated weights for policy 0, policy_version 750344 (0.0008) [2023-12-26 05:34:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 382984192. Throughput: 0: 8713.3, 1: 8757.8. Samples: 382979668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:34:58,785][121949] Avg episode reward: [(0, '6024.232'), (1, '5142.380')] [2023-12-26 05:34:58,859][123090] Updated weights for policy 1, policy_version 745668 (0.0009) [2023-12-26 05:34:58,927][123090] Updated weights for policy 1, policy_version 745678 (0.0011) [2023-12-26 05:34:58,994][123090] Updated weights for policy 1, policy_version 745688 (0.0010) [2023-12-26 05:34:59,137][123091] Updated weights for policy 0, policy_version 750354 (0.0008) [2023-12-26 05:34:59,204][123091] Updated weights for policy 0, policy_version 750364 (0.0011) [2023-12-26 05:34:59,276][123091] Updated weights for policy 0, policy_version 750374 (0.0009) [2023-12-26 05:34:59,345][123091] Updated weights for policy 0, policy_version 750384 (0.0009) [2023-12-26 05:34:59,806][123090] Updated weights for policy 1, policy_version 745698 (0.0010) [2023-12-26 05:34:59,874][123090] Updated weights for policy 1, policy_version 745708 (0.0010) [2023-12-26 05:34:59,938][123090] Updated weights for policy 1, policy_version 745718 (0.0009) [2023-12-26 05:35:00,001][123090] Updated weights for policy 1, policy_version 745728 (0.0009) [2023-12-26 05:35:00,147][123091] Updated weights for policy 0, policy_version 750394 (0.0008) [2023-12-26 05:35:00,191][123091] Updated weights for policy 0, policy_version 750404 (0.0008) [2023-12-26 05:35:00,249][123091] Updated weights for policy 0, policy_version 750414 (0.0008) [2023-12-26 05:35:00,814][123090] Updated weights for policy 1, policy_version 745738 (0.0008) [2023-12-26 05:35:00,877][123090] Updated weights for policy 1, policy_version 745748 (0.0007) [2023-12-26 05:35:00,946][123090] Updated weights for policy 1, policy_version 745758 (0.0008) [2023-12-26 05:35:01,012][123091] Updated weights for policy 0, policy_version 750424 (0.0010) [2023-12-26 05:35:01,077][123091] Updated weights for policy 0, policy_version 750434 (0.0011) [2023-12-26 05:35:01,136][123091] Updated weights for policy 0, policy_version 750444 (0.0011) [2023-12-26 05:35:01,690][123090] Updated weights for policy 1, policy_version 745768 (0.0007) [2023-12-26 05:35:01,766][123090] Updated weights for policy 1, policy_version 745778 (0.0007) [2023-12-26 05:35:01,835][123090] Updated weights for policy 1, policy_version 745788 (0.0005) [2023-12-26 05:35:01,974][123091] Updated weights for policy 0, policy_version 750454 (0.0006) [2023-12-26 05:35:02,045][123091] Updated weights for policy 0, policy_version 750464 (0.0005) [2023-12-26 05:35:02,119][123091] Updated weights for policy 0, policy_version 750474 (0.0006) [2023-12-26 05:35:02,521][123090] Updated weights for policy 1, policy_version 745798 (0.0007) [2023-12-26 05:35:02,587][123090] Updated weights for policy 1, policy_version 745808 (0.0008) [2023-12-26 05:35:02,646][123090] Updated weights for policy 1, policy_version 745818 (0.0008) [2023-12-26 05:35:02,815][123091] Updated weights for policy 0, policy_version 750484 (0.0010) [2023-12-26 05:35:02,866][123091] Updated weights for policy 0, policy_version 750494 (0.0010) [2023-12-26 05:35:02,913][123091] Updated weights for policy 0, policy_version 750504 (0.0010) [2023-12-26 05:35:03,390][123090] Updated weights for policy 1, policy_version 745828 (0.0006) [2023-12-26 05:35:03,448][123090] Updated weights for policy 1, policy_version 745838 (0.0005) [2023-12-26 05:35:03,513][123090] Updated weights for policy 1, policy_version 745848 (0.0005) [2023-12-26 05:35:03,776][123091] Updated weights for policy 0, policy_version 750514 (0.0010) [2023-12-26 05:35:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 383074304. Throughput: 0: 8692.2, 1: 8747.8. Samples: 383086980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:03,785][121949] Avg episode reward: [(0, '5950.763'), (1, '5014.717')] [2023-12-26 05:35:03,835][123091] Updated weights for policy 0, policy_version 750524 (0.0010) [2023-12-26 05:35:03,905][123091] Updated weights for policy 0, policy_version 750534 (0.0011) [2023-12-26 05:35:03,964][123091] Updated weights for policy 0, policy_version 750544 (0.0011) [2023-12-26 05:35:04,179][123090] Updated weights for policy 1, policy_version 745858 (0.0006) [2023-12-26 05:35:04,237][123090] Updated weights for policy 1, policy_version 745868 (0.0009) [2023-12-26 05:35:04,285][123090] Updated weights for policy 1, policy_version 745878 (0.0007) [2023-12-26 05:35:04,331][123090] Updated weights for policy 1, policy_version 745888 (0.0005) [2023-12-26 05:35:04,748][123091] Updated weights for policy 0, policy_version 750554 (0.0005) [2023-12-26 05:35:04,809][123091] Updated weights for policy 0, policy_version 750564 (0.0006) [2023-12-26 05:35:04,857][123091] Updated weights for policy 0, policy_version 750574 (0.0006) [2023-12-26 05:35:05,050][123090] Updated weights for policy 1, policy_version 745898 (0.0007) [2023-12-26 05:35:05,114][123090] Updated weights for policy 1, policy_version 745908 (0.0009) [2023-12-26 05:35:05,170][123090] Updated weights for policy 1, policy_version 745918 (0.0009) [2023-12-26 05:35:05,596][123091] Updated weights for policy 0, policy_version 750584 (0.0009) [2023-12-26 05:35:05,663][123091] Updated weights for policy 0, policy_version 750594 (0.0008) [2023-12-26 05:35:05,724][123091] Updated weights for policy 0, policy_version 750604 (0.0009) [2023-12-26 05:35:05,998][123090] Updated weights for policy 1, policy_version 745928 (0.0009) [2023-12-26 05:35:06,067][123090] Updated weights for policy 1, policy_version 745938 (0.0010) [2023-12-26 05:35:06,134][123090] Updated weights for policy 1, policy_version 745948 (0.0010) [2023-12-26 05:35:06,565][123091] Updated weights for policy 0, policy_version 750614 (0.0009) [2023-12-26 05:35:06,635][123091] Updated weights for policy 0, policy_version 750624 (0.0008) [2023-12-26 05:35:06,698][123091] Updated weights for policy 0, policy_version 750634 (0.0009) [2023-12-26 05:35:06,854][123090] Updated weights for policy 1, policy_version 745958 (0.0010) [2023-12-26 05:35:06,908][123090] Updated weights for policy 1, policy_version 745970 (0.0010) [2023-12-26 05:35:06,971][123090] Updated weights for policy 1, policy_version 745980 (0.0010) [2023-12-26 05:35:07,377][123091] Updated weights for policy 0, policy_version 750644 (0.0006) [2023-12-26 05:35:07,441][123091] Updated weights for policy 0, policy_version 750654 (0.0006) [2023-12-26 05:35:07,501][123091] Updated weights for policy 0, policy_version 750664 (0.0006) [2023-12-26 05:35:07,899][123090] Updated weights for policy 1, policy_version 745990 (0.0009) [2023-12-26 05:35:07,963][123090] Updated weights for policy 1, policy_version 746000 (0.0009) [2023-12-26 05:35:08,021][123090] Updated weights for policy 1, policy_version 746010 (0.0009) [2023-12-26 05:35:08,147][123091] Updated weights for policy 0, policy_version 750674 (0.0006) [2023-12-26 05:35:08,210][123091] Updated weights for policy 0, policy_version 750684 (0.0006) [2023-12-26 05:35:08,263][123091] Updated weights for policy 0, policy_version 750694 (0.0006) [2023-12-26 05:35:08,307][123091] Updated weights for policy 0, policy_version 750704 (0.0005) [2023-12-26 05:35:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 383164416. Throughput: 0: 8730.8, 1: 8812.5. Samples: 383141592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:08,785][121949] Avg episode reward: [(0, '6059.784'), (1, '4750.003')] [2023-12-26 05:35:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000750704_192184320.pth... [2023-12-26 05:35:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000746016_190980096.pth... [2023-12-26 05:35:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000749680_191922176.pth [2023-12-26 05:35:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000744992_190717952.pth [2023-12-26 05:35:08,952][123090] Updated weights for policy 1, policy_version 746020 (0.0010) [2023-12-26 05:35:09,007][123090] Updated weights for policy 1, policy_version 746030 (0.0010) [2023-12-26 05:35:09,018][123091] Updated weights for policy 0, policy_version 750714 (0.0010) [2023-12-26 05:35:09,064][123090] Updated weights for policy 1, policy_version 746040 (0.0006) [2023-12-26 05:35:09,083][123091] Updated weights for policy 0, policy_version 750724 (0.0011) [2023-12-26 05:35:09,143][123091] Updated weights for policy 0, policy_version 750734 (0.0011) [2023-12-26 05:35:09,873][123090] Updated weights for policy 1, policy_version 746050 (0.0007) [2023-12-26 05:35:09,928][123091] Updated weights for policy 0, policy_version 750744 (0.0011) [2023-12-26 05:35:09,944][123090] Updated weights for policy 1, policy_version 746060 (0.0009) [2023-12-26 05:35:09,985][123091] Updated weights for policy 0, policy_version 750754 (0.0007) [2023-12-26 05:35:10,020][123090] Updated weights for policy 1, policy_version 746070 (0.0009) [2023-12-26 05:35:10,046][123091] Updated weights for policy 0, policy_version 750764 (0.0009) [2023-12-26 05:35:10,083][123090] Updated weights for policy 1, policy_version 746080 (0.0008) [2023-12-26 05:35:10,881][123091] Updated weights for policy 0, policy_version 750774 (0.0011) [2023-12-26 05:35:10,897][123090] Updated weights for policy 1, policy_version 746090 (0.0007) [2023-12-26 05:35:10,941][123091] Updated weights for policy 0, policy_version 750784 (0.0011) [2023-12-26 05:35:10,952][123090] Updated weights for policy 1, policy_version 746100 (0.0008) [2023-12-26 05:35:11,003][123091] Updated weights for policy 0, policy_version 750794 (0.0011) [2023-12-26 05:35:11,012][123090] Updated weights for policy 1, policy_version 746110 (0.0007) [2023-12-26 05:35:11,833][123091] Updated weights for policy 0, policy_version 750804 (0.0011) [2023-12-26 05:35:11,892][123091] Updated weights for policy 0, policy_version 750814 (0.0008) [2023-12-26 05:35:11,892][123090] Updated weights for policy 1, policy_version 746120 (0.0010) [2023-12-26 05:35:11,956][123090] Updated weights for policy 1, policy_version 746130 (0.0010) [2023-12-26 05:35:11,956][123091] Updated weights for policy 0, policy_version 750824 (0.0010) [2023-12-26 05:35:12,021][123090] Updated weights for policy 1, policy_version 746140 (0.0009) [2023-12-26 05:35:12,804][123091] Updated weights for policy 0, policy_version 750834 (0.0010) [2023-12-26 05:35:12,865][123090] Updated weights for policy 1, policy_version 746150 (0.0008) [2023-12-26 05:35:12,865][123091] Updated weights for policy 0, policy_version 750844 (0.0010) [2023-12-26 05:35:12,920][123091] Updated weights for policy 0, policy_version 750854 (0.0008) [2023-12-26 05:35:12,924][123090] Updated weights for policy 1, policy_version 746160 (0.0008) [2023-12-26 05:35:12,972][123091] Updated weights for policy 0, policy_version 750864 (0.0009) [2023-12-26 05:35:12,980][123090] Updated weights for policy 1, policy_version 746170 (0.0009) [2023-12-26 05:35:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 383246336. Throughput: 0: 8808.7, 1: 8712.6. Samples: 383245640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:13,784][121949] Avg episode reward: [(0, '6018.031'), (1, '4886.649')] [2023-12-26 05:35:13,829][123090] Updated weights for policy 1, policy_version 746180 (0.0009) [2023-12-26 05:35:13,848][123091] Updated weights for policy 0, policy_version 750874 (0.0009) [2023-12-26 05:35:13,894][123090] Updated weights for policy 1, policy_version 746190 (0.0008) [2023-12-26 05:35:13,910][123091] Updated weights for policy 0, policy_version 750884 (0.0006) [2023-12-26 05:35:13,962][123090] Updated weights for policy 1, policy_version 746200 (0.0010) [2023-12-26 05:35:13,974][123091] Updated weights for policy 0, policy_version 750894 (0.0008) [2023-12-26 05:35:14,728][123091] Updated weights for policy 0, policy_version 750904 (0.0005) [2023-12-26 05:35:14,798][123091] Updated weights for policy 0, policy_version 750914 (0.0008) [2023-12-26 05:35:14,825][123090] Updated weights for policy 1, policy_version 746210 (0.0010) [2023-12-26 05:35:14,869][123091] Updated weights for policy 0, policy_version 750924 (0.0010) [2023-12-26 05:35:14,897][123090] Updated weights for policy 1, policy_version 746220 (0.0007) [2023-12-26 05:35:14,967][123090] Updated weights for policy 1, policy_version 746230 (0.0008) [2023-12-26 05:35:15,040][123090] Updated weights for policy 1, policy_version 746240 (0.0006) [2023-12-26 05:35:15,696][123091] Updated weights for policy 0, policy_version 750934 (0.0007) [2023-12-26 05:35:15,752][123091] Updated weights for policy 0, policy_version 750944 (0.0005) [2023-12-26 05:35:15,815][123091] Updated weights for policy 0, policy_version 750954 (0.0006) [2023-12-26 05:35:15,829][123090] Updated weights for policy 1, policy_version 746250 (0.0009) [2023-12-26 05:35:15,898][123090] Updated weights for policy 1, policy_version 746260 (0.0010) [2023-12-26 05:35:15,961][123090] Updated weights for policy 1, policy_version 746271 (0.0010) [2023-12-26 05:35:16,496][123091] Updated weights for policy 0, policy_version 750964 (0.0006) [2023-12-26 05:35:16,556][123091] Updated weights for policy 0, policy_version 750974 (0.0005) [2023-12-26 05:35:16,616][123091] Updated weights for policy 0, policy_version 750984 (0.0005) [2023-12-26 05:35:16,843][123090] Updated weights for policy 1, policy_version 746281 (0.0009) [2023-12-26 05:35:16,895][123090] Updated weights for policy 1, policy_version 746291 (0.0009) [2023-12-26 05:35:16,947][123090] Updated weights for policy 1, policy_version 746301 (0.0009) [2023-12-26 05:35:17,232][123091] Updated weights for policy 0, policy_version 750994 (0.0006) [2023-12-26 05:35:17,290][123091] Updated weights for policy 0, policy_version 751004 (0.0006) [2023-12-26 05:35:17,342][123091] Updated weights for policy 0, policy_version 751015 (0.0010) [2023-12-26 05:35:17,847][123090] Updated weights for policy 1, policy_version 746311 (0.0010) [2023-12-26 05:35:17,901][123090] Updated weights for policy 1, policy_version 746321 (0.0009) [2023-12-26 05:35:17,953][123090] Updated weights for policy 1, policy_version 746331 (0.0009) [2023-12-26 05:35:18,170][123091] Updated weights for policy 0, policy_version 751025 (0.0009) [2023-12-26 05:35:18,233][123091] Updated weights for policy 0, policy_version 751035 (0.0009) [2023-12-26 05:35:18,295][123091] Updated weights for policy 0, policy_version 751045 (0.0010) [2023-12-26 05:35:18,359][123091] Updated weights for policy 0, policy_version 751055 (0.0009) [2023-12-26 05:35:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 383336448. Throughput: 0: 8854.6, 1: 8696.2. Samples: 383350624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:18,786][121949] Avg episode reward: [(0, '5900.094'), (1, '5116.762')] [2023-12-26 05:35:18,818][123090] Updated weights for policy 1, policy_version 746341 (0.0009) [2023-12-26 05:35:18,888][123090] Updated weights for policy 1, policy_version 746351 (0.0009) [2023-12-26 05:35:18,963][123090] Updated weights for policy 1, policy_version 746361 (0.0009) [2023-12-26 05:35:19,111][123091] Updated weights for policy 0, policy_version 751065 (0.0010) [2023-12-26 05:35:19,170][123091] Updated weights for policy 0, policy_version 751075 (0.0006) [2023-12-26 05:35:19,236][123091] Updated weights for policy 0, policy_version 751085 (0.0007) [2023-12-26 05:35:19,749][123090] Updated weights for policy 1, policy_version 746371 (0.0010) [2023-12-26 05:35:19,802][123090] Updated weights for policy 1, policy_version 746381 (0.0009) [2023-12-26 05:35:19,871][123090] Updated weights for policy 1, policy_version 746391 (0.0008) [2023-12-26 05:35:20,063][123091] Updated weights for policy 0, policy_version 751095 (0.0009) [2023-12-26 05:35:20,121][123091] Updated weights for policy 0, policy_version 751105 (0.0009) [2023-12-26 05:35:20,173][123091] Updated weights for policy 0, policy_version 751115 (0.0009) [2023-12-26 05:35:20,724][123090] Updated weights for policy 1, policy_version 746401 (0.0009) [2023-12-26 05:35:20,793][123090] Updated weights for policy 1, policy_version 746411 (0.0010) [2023-12-26 05:35:20,865][123090] Updated weights for policy 1, policy_version 746421 (0.0009) [2023-12-26 05:35:20,943][123090] Updated weights for policy 1, policy_version 746431 (0.0010) [2023-12-26 05:35:21,034][123091] Updated weights for policy 0, policy_version 751125 (0.0009) [2023-12-26 05:35:21,109][123091] Updated weights for policy 0, policy_version 751135 (0.0009) [2023-12-26 05:35:21,181][123091] Updated weights for policy 0, policy_version 751145 (0.0009) [2023-12-26 05:35:21,785][123090] Updated weights for policy 1, policy_version 746441 (0.0010) [2023-12-26 05:35:21,854][123090] Updated weights for policy 1, policy_version 746452 (0.0010) [2023-12-26 05:35:21,915][123090] Updated weights for policy 1, policy_version 746462 (0.0011) [2023-12-26 05:35:22,038][123091] Updated weights for policy 0, policy_version 751155 (0.0010) [2023-12-26 05:35:22,099][123091] Updated weights for policy 0, policy_version 751165 (0.0005) [2023-12-26 05:35:22,172][123091] Updated weights for policy 0, policy_version 751175 (0.0006) [2023-12-26 05:35:22,793][123090] Updated weights for policy 1, policy_version 746472 (0.0007) [2023-12-26 05:35:22,866][123090] Updated weights for policy 1, policy_version 746482 (0.0006) [2023-12-26 05:35:22,909][123091] Updated weights for policy 0, policy_version 751185 (0.0008) [2023-12-26 05:35:22,933][123090] Updated weights for policy 1, policy_version 746492 (0.0006) [2023-12-26 05:35:22,978][123091] Updated weights for policy 0, policy_version 751195 (0.0008) [2023-12-26 05:35:23,051][123091] Updated weights for policy 0, policy_version 751205 (0.0010) [2023-12-26 05:35:23,111][123091] Updated weights for policy 0, policy_version 751215 (0.0007) [2023-12-26 05:35:23,691][123090] Updated weights for policy 1, policy_version 746502 (0.0009) [2023-12-26 05:35:23,741][123090] Updated weights for policy 1, policy_version 746512 (0.0009) [2023-12-26 05:35:23,771][123091] Updated weights for policy 0, policy_version 751225 (0.0006) [2023-12-26 05:35:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 383418368. Throughput: 0: 8822.3, 1: 8693.6. Samples: 383401196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:23,785][121949] Avg episode reward: [(0, '5854.186'), (1, '4890.115')] [2023-12-26 05:35:23,801][123090] Updated weights for policy 1, policy_version 746522 (0.0008) [2023-12-26 05:35:23,827][123091] Updated weights for policy 0, policy_version 751235 (0.0005) [2023-12-26 05:35:23,831][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000746528_191111168.pth... [2023-12-26 05:35:23,834][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000745504_190849024.pth [2023-12-26 05:35:23,883][123091] Updated weights for policy 0, policy_version 751245 (0.0006) [2023-12-26 05:35:23,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000751248_192323584.pth... [2023-12-26 05:35:23,903][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000750192_192053248.pth [2023-12-26 05:35:24,668][123091] Updated weights for policy 0, policy_version 751255 (0.0006) [2023-12-26 05:35:24,673][123090] Updated weights for policy 1, policy_version 746532 (0.0009) [2023-12-26 05:35:24,729][123091] Updated weights for policy 0, policy_version 751265 (0.0006) [2023-12-26 05:35:24,730][123090] Updated weights for policy 1, policy_version 746542 (0.0009) [2023-12-26 05:35:24,782][123091] Updated weights for policy 0, policy_version 751275 (0.0008) [2023-12-26 05:35:24,794][123090] Updated weights for policy 1, policy_version 746552 (0.0007) [2023-12-26 05:35:25,600][123090] Updated weights for policy 1, policy_version 746562 (0.0008) [2023-12-26 05:35:25,603][123091] Updated weights for policy 0, policy_version 751285 (0.0010) [2023-12-26 05:35:25,666][123091] Updated weights for policy 0, policy_version 751295 (0.0009) [2023-12-26 05:35:25,668][123090] Updated weights for policy 1, policy_version 746572 (0.0005) [2023-12-26 05:35:25,726][123091] Updated weights for policy 0, policy_version 751305 (0.0009) [2023-12-26 05:35:25,730][123090] Updated weights for policy 1, policy_version 746582 (0.0005) [2023-12-26 05:35:25,794][123090] Updated weights for policy 1, policy_version 746592 (0.0005) [2023-12-26 05:35:26,471][123091] Updated weights for policy 0, policy_version 751315 (0.0008) [2023-12-26 05:35:26,487][123090] Updated weights for policy 1, policy_version 746602 (0.0005) [2023-12-26 05:35:26,522][123091] Updated weights for policy 0, policy_version 751325 (0.0005) [2023-12-26 05:35:26,548][123090] Updated weights for policy 1, policy_version 746612 (0.0005) [2023-12-26 05:35:26,578][123091] Updated weights for policy 0, policy_version 751335 (0.0008) [2023-12-26 05:35:26,602][123090] Updated weights for policy 1, policy_version 746622 (0.0005) [2023-12-26 05:35:27,286][123091] Updated weights for policy 0, policy_version 751345 (0.0009) [2023-12-26 05:35:27,343][123090] Updated weights for policy 1, policy_version 746632 (0.0008) [2023-12-26 05:35:27,350][123091] Updated weights for policy 0, policy_version 751355 (0.0006) [2023-12-26 05:35:27,390][123090] Updated weights for policy 1, policy_version 746642 (0.0008) [2023-12-26 05:35:27,408][123091] Updated weights for policy 0, policy_version 751365 (0.0006) [2023-12-26 05:35:27,441][123090] Updated weights for policy 1, policy_version 746652 (0.0006) [2023-12-26 05:35:27,472][123091] Updated weights for policy 0, policy_version 751375 (0.0005) [2023-12-26 05:35:28,074][123091] Updated weights for policy 0, policy_version 751385 (0.0005) [2023-12-26 05:35:28,120][123091] Updated weights for policy 0, policy_version 751395 (0.0005) [2023-12-26 05:35:28,164][123091] Updated weights for policy 0, policy_version 751405 (0.0005) [2023-12-26 05:35:28,314][123090] Updated weights for policy 1, policy_version 746662 (0.0008) [2023-12-26 05:35:28,378][123090] Updated weights for policy 1, policy_version 746672 (0.0009) [2023-12-26 05:35:28,429][123090] Updated weights for policy 1, policy_version 746682 (0.0009) [2023-12-26 05:35:28,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 383516672. Throughput: 0: 8911.3, 1: 8787.6. Samples: 383510476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:28,784][121949] Avg episode reward: [(0, '5980.440'), (1, '4710.843')] [2023-12-26 05:35:28,869][123091] Updated weights for policy 0, policy_version 751415 (0.0005) [2023-12-26 05:35:28,919][123091] Updated weights for policy 0, policy_version 751425 (0.0006) [2023-12-26 05:35:28,977][123091] Updated weights for policy 0, policy_version 751435 (0.0009) [2023-12-26 05:35:29,334][123090] Updated weights for policy 1, policy_version 746692 (0.0009) [2023-12-26 05:35:29,397][123090] Updated weights for policy 1, policy_version 746702 (0.0009) [2023-12-26 05:35:29,464][123090] Updated weights for policy 1, policy_version 746712 (0.0010) [2023-12-26 05:35:29,714][123091] Updated weights for policy 0, policy_version 751445 (0.0009) [2023-12-26 05:35:29,764][123091] Updated weights for policy 0, policy_version 751455 (0.0009) [2023-12-26 05:35:29,834][123091] Updated weights for policy 0, policy_version 751465 (0.0009) [2023-12-26 05:35:30,319][123090] Updated weights for policy 1, policy_version 746722 (0.0010) [2023-12-26 05:35:30,385][123090] Updated weights for policy 1, policy_version 746732 (0.0010) [2023-12-26 05:35:30,441][123090] Updated weights for policy 1, policy_version 746742 (0.0005) [2023-12-26 05:35:30,489][123090] Updated weights for policy 1, policy_version 746752 (0.0005) [2023-12-26 05:35:30,707][123091] Updated weights for policy 0, policy_version 751475 (0.0007) [2023-12-26 05:35:30,762][123091] Updated weights for policy 0, policy_version 751485 (0.0005) [2023-12-26 05:35:30,828][123091] Updated weights for policy 0, policy_version 751495 (0.0008) [2023-12-26 05:35:31,147][123090] Updated weights for policy 1, policy_version 746762 (0.0010) [2023-12-26 05:35:31,229][123090] Updated weights for policy 1, policy_version 746772 (0.0010) [2023-12-26 05:35:31,292][123090] Updated weights for policy 1, policy_version 746782 (0.0010) [2023-12-26 05:35:31,622][123091] Updated weights for policy 0, policy_version 751505 (0.0009) [2023-12-26 05:35:31,691][123091] Updated weights for policy 0, policy_version 751515 (0.0007) [2023-12-26 05:35:31,762][123091] Updated weights for policy 0, policy_version 751525 (0.0010) [2023-12-26 05:35:31,828][123091] Updated weights for policy 0, policy_version 751535 (0.0007) [2023-12-26 05:35:32,067][123090] Updated weights for policy 1, policy_version 746792 (0.0006) [2023-12-26 05:35:32,133][123090] Updated weights for policy 1, policy_version 746802 (0.0005) [2023-12-26 05:35:32,200][123090] Updated weights for policy 1, policy_version 746812 (0.0005) [2023-12-26 05:35:32,636][123091] Updated weights for policy 0, policy_version 751545 (0.0008) [2023-12-26 05:35:32,693][123091] Updated weights for policy 0, policy_version 751555 (0.0008) [2023-12-26 05:35:32,746][123091] Updated weights for policy 0, policy_version 751565 (0.0005) [2023-12-26 05:35:32,954][123090] Updated weights for policy 1, policy_version 746822 (0.0007) [2023-12-26 05:35:33,024][123090] Updated weights for policy 1, policy_version 746832 (0.0006) [2023-12-26 05:35:33,083][123090] Updated weights for policy 1, policy_version 746842 (0.0009) [2023-12-26 05:35:33,482][123091] Updated weights for policy 0, policy_version 751575 (0.0005) [2023-12-26 05:35:33,550][123091] Updated weights for policy 0, policy_version 751585 (0.0005) [2023-12-26 05:35:33,605][123091] Updated weights for policy 0, policy_version 751595 (0.0005) [2023-12-26 05:35:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 383606784. Throughput: 0: 8956.8, 1: 8772.6. Samples: 383618036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:33,785][121949] Avg episode reward: [(0, '5830.864'), (1, '4953.160')] [2023-12-26 05:35:33,817][123090] Updated weights for policy 1, policy_version 746852 (0.0008) [2023-12-26 05:35:33,888][123090] Updated weights for policy 1, policy_version 746862 (0.0005) [2023-12-26 05:35:33,948][123090] Updated weights for policy 1, policy_version 746872 (0.0007) [2023-12-26 05:35:34,285][123091] Updated weights for policy 0, policy_version 751605 (0.0007) [2023-12-26 05:35:34,359][123091] Updated weights for policy 0, policy_version 751615 (0.0010) [2023-12-26 05:35:34,424][123091] Updated weights for policy 0, policy_version 751625 (0.0010) [2023-12-26 05:35:34,652][123090] Updated weights for policy 1, policy_version 746882 (0.0007) [2023-12-26 05:35:34,720][123090] Updated weights for policy 1, policy_version 746892 (0.0007) [2023-12-26 05:35:34,796][123090] Updated weights for policy 1, policy_version 746902 (0.0006) [2023-12-26 05:35:34,866][123090] Updated weights for policy 1, policy_version 746912 (0.0005) [2023-12-26 05:35:35,269][123091] Updated weights for policy 0, policy_version 751635 (0.0010) [2023-12-26 05:35:35,334][123091] Updated weights for policy 0, policy_version 751645 (0.0010) [2023-12-26 05:35:35,400][123091] Updated weights for policy 0, policy_version 751655 (0.0010) [2023-12-26 05:35:35,528][123090] Updated weights for policy 1, policy_version 746922 (0.0006) [2023-12-26 05:35:35,574][123090] Updated weights for policy 1, policy_version 746932 (0.0005) [2023-12-26 05:35:35,621][123090] Updated weights for policy 1, policy_version 746942 (0.0005) [2023-12-26 05:35:36,299][123091] Updated weights for policy 0, policy_version 751665 (0.0010) [2023-12-26 05:35:36,364][123090] Updated weights for policy 1, policy_version 746952 (0.0006) [2023-12-26 05:35:36,369][123091] Updated weights for policy 0, policy_version 751675 (0.0011) [2023-12-26 05:35:36,419][123090] Updated weights for policy 1, policy_version 746962 (0.0010) [2023-12-26 05:35:36,430][123091] Updated weights for policy 0, policy_version 751685 (0.0011) [2023-12-26 05:35:36,468][123090] Updated weights for policy 1, policy_version 746972 (0.0007) [2023-12-26 05:35:36,490][123091] Updated weights for policy 0, policy_version 751695 (0.0011) [2023-12-26 05:35:37,315][123091] Updated weights for policy 0, policy_version 751705 (0.0008) [2023-12-26 05:35:37,331][123090] Updated weights for policy 1, policy_version 746982 (0.0007) [2023-12-26 05:35:37,375][123091] Updated weights for policy 0, policy_version 751715 (0.0010) [2023-12-26 05:35:37,393][123090] Updated weights for policy 1, policy_version 746992 (0.0006) [2023-12-26 05:35:37,438][123091] Updated weights for policy 0, policy_version 751725 (0.0011) [2023-12-26 05:35:37,448][123090] Updated weights for policy 1, policy_version 747002 (0.0005) [2023-12-26 05:35:38,152][123090] Updated weights for policy 1, policy_version 747012 (0.0005) [2023-12-26 05:35:38,199][123091] Updated weights for policy 0, policy_version 751735 (0.0007) [2023-12-26 05:35:38,228][123090] Updated weights for policy 1, policy_version 747022 (0.0005) [2023-12-26 05:35:38,274][123091] Updated weights for policy 0, policy_version 751745 (0.0007) [2023-12-26 05:35:38,300][123090] Updated weights for policy 1, policy_version 747032 (0.0008) [2023-12-26 05:35:38,337][123091] Updated weights for policy 0, policy_version 751755 (0.0007) [2023-12-26 05:35:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 383696896. Throughput: 0: 8907.2, 1: 8849.4. Samples: 383672296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:38,785][121949] Avg episode reward: [(0, '5738.752'), (1, '4912.270')] [2023-12-26 05:35:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000751760_192454656.pth... [2023-12-26 05:35:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000747040_191242240.pth... [2023-12-26 05:35:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000746016_190980096.pth [2023-12-26 05:35:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000750704_192184320.pth [2023-12-26 05:35:38,945][123090] Updated weights for policy 1, policy_version 747042 (0.0010) [2023-12-26 05:35:38,995][123090] Updated weights for policy 1, policy_version 747052 (0.0008) [2023-12-26 05:35:39,049][123090] Updated weights for policy 1, policy_version 747062 (0.0008) [2023-12-26 05:35:39,091][123091] Updated weights for policy 0, policy_version 751765 (0.0009) [2023-12-26 05:35:39,104][123090] Updated weights for policy 1, policy_version 747072 (0.0010) [2023-12-26 05:35:39,138][123091] Updated weights for policy 0, policy_version 751775 (0.0006) [2023-12-26 05:35:39,195][123091] Updated weights for policy 0, policy_version 751785 (0.0009) [2023-12-26 05:35:39,958][123090] Updated weights for policy 1, policy_version 747082 (0.0009) [2023-12-26 05:35:39,971][123091] Updated weights for policy 0, policy_version 751795 (0.0009) [2023-12-26 05:35:40,023][123090] Updated weights for policy 1, policy_version 747092 (0.0009) [2023-12-26 05:35:40,034][123091] Updated weights for policy 0, policy_version 751805 (0.0007) [2023-12-26 05:35:40,084][123090] Updated weights for policy 1, policy_version 747102 (0.0009) [2023-12-26 05:35:40,104][123091] Updated weights for policy 0, policy_version 751815 (0.0006) [2023-12-26 05:35:40,850][123091] Updated weights for policy 0, policy_version 751825 (0.0006) [2023-12-26 05:35:40,911][123091] Updated weights for policy 0, policy_version 751835 (0.0009) [2023-12-26 05:35:40,959][123090] Updated weights for policy 1, policy_version 747112 (0.0010) [2023-12-26 05:35:40,979][123091] Updated weights for policy 0, policy_version 751845 (0.0008) [2023-12-26 05:35:41,014][123090] Updated weights for policy 1, policy_version 747122 (0.0009) [2023-12-26 05:35:41,058][123091] Updated weights for policy 0, policy_version 751855 (0.0008) [2023-12-26 05:35:41,081][123090] Updated weights for policy 1, policy_version 747132 (0.0008) [2023-12-26 05:35:41,851][123091] Updated weights for policy 0, policy_version 751865 (0.0006) [2023-12-26 05:35:41,908][123091] Updated weights for policy 0, policy_version 751875 (0.0005) [2023-12-26 05:35:41,960][123090] Updated weights for policy 1, policy_version 747142 (0.0010) [2023-12-26 05:35:41,964][123091] Updated weights for policy 0, policy_version 751885 (0.0006) [2023-12-26 05:35:42,020][123090] Updated weights for policy 1, policy_version 747152 (0.0009) [2023-12-26 05:35:42,075][123090] Updated weights for policy 1, policy_version 747162 (0.0008) [2023-12-26 05:35:42,743][123091] Updated weights for policy 0, policy_version 751895 (0.0008) [2023-12-26 05:35:42,804][123091] Updated weights for policy 0, policy_version 751905 (0.0009) [2023-12-26 05:35:42,856][123091] Updated weights for policy 0, policy_version 751915 (0.0009) [2023-12-26 05:35:42,957][123090] Updated weights for policy 1, policy_version 747172 (0.0008) [2023-12-26 05:35:43,014][123090] Updated weights for policy 1, policy_version 747182 (0.0006) [2023-12-26 05:35:43,079][123090] Updated weights for policy 1, policy_version 747192 (0.0005) [2023-12-26 05:35:43,710][123091] Updated weights for policy 0, policy_version 751925 (0.0007) [2023-12-26 05:35:43,732][123090] Updated weights for policy 1, policy_version 747202 (0.0005) [2023-12-26 05:35:43,757][123091] Updated weights for policy 0, policy_version 751935 (0.0005) [2023-12-26 05:35:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 383778816. Throughput: 0: 9022.1, 1: 8729.7. Samples: 383778496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:43,785][121949] Avg episode reward: [(0, '5843.644'), (1, '4881.363')] [2023-12-26 05:35:43,798][123090] Updated weights for policy 1, policy_version 747212 (0.0006) [2023-12-26 05:35:43,805][123091] Updated weights for policy 0, policy_version 751945 (0.0005) [2023-12-26 05:35:43,861][123090] Updated weights for policy 1, policy_version 747222 (0.0009) [2023-12-26 05:35:43,926][123090] Updated weights for policy 1, policy_version 747232 (0.0005) [2023-12-26 05:35:44,499][123091] Updated weights for policy 0, policy_version 751955 (0.0006) [2023-12-26 05:35:44,553][123091] Updated weights for policy 0, policy_version 751965 (0.0008) [2023-12-26 05:35:44,600][123091] Updated weights for policy 0, policy_version 751975 (0.0008) [2023-12-26 05:35:44,680][123090] Updated weights for policy 1, policy_version 747242 (0.0008) [2023-12-26 05:35:44,747][123090] Updated weights for policy 1, policy_version 747252 (0.0010) [2023-12-26 05:35:44,818][123090] Updated weights for policy 1, policy_version 747262 (0.0009) [2023-12-26 05:35:45,343][123091] Updated weights for policy 0, policy_version 751985 (0.0009) [2023-12-26 05:35:45,407][123091] Updated weights for policy 0, policy_version 751995 (0.0011) [2023-12-26 05:35:45,472][123091] Updated weights for policy 0, policy_version 752005 (0.0011) [2023-12-26 05:35:45,531][123091] Updated weights for policy 0, policy_version 752015 (0.0011) [2023-12-26 05:35:45,657][123090] Updated weights for policy 1, policy_version 747272 (0.0009) [2023-12-26 05:35:45,713][123090] Updated weights for policy 1, policy_version 747282 (0.0005) [2023-12-26 05:35:45,764][123090] Updated weights for policy 1, policy_version 747292 (0.0005) [2023-12-26 05:35:46,342][123091] Updated weights for policy 0, policy_version 752025 (0.0010) [2023-12-26 05:35:46,393][123091] Updated weights for policy 0, policy_version 752035 (0.0010) [2023-12-26 05:35:46,431][123090] Updated weights for policy 1, policy_version 747302 (0.0006) [2023-12-26 05:35:46,452][123091] Updated weights for policy 0, policy_version 752045 (0.0010) [2023-12-26 05:35:46,485][123090] Updated weights for policy 1, policy_version 747312 (0.0005) [2023-12-26 05:35:46,532][123090] Updated weights for policy 1, policy_version 747322 (0.0005) [2023-12-26 05:35:47,192][123091] Updated weights for policy 0, policy_version 752055 (0.0007) [2023-12-26 05:35:47,261][123091] Updated weights for policy 0, policy_version 752065 (0.0008) [2023-12-26 05:35:47,270][123090] Updated weights for policy 1, policy_version 747332 (0.0008) [2023-12-26 05:35:47,330][123091] Updated weights for policy 0, policy_version 752075 (0.0007) [2023-12-26 05:35:47,335][123090] Updated weights for policy 1, policy_version 747342 (0.0011) [2023-12-26 05:35:47,392][123090] Updated weights for policy 1, policy_version 747352 (0.0010) [2023-12-26 05:35:47,972][123091] Updated weights for policy 0, policy_version 752085 (0.0009) [2023-12-26 05:35:48,037][123091] Updated weights for policy 0, policy_version 752095 (0.0011) [2023-12-26 05:35:48,096][123091] Updated weights for policy 0, policy_version 752105 (0.0011) [2023-12-26 05:35:48,232][123090] Updated weights for policy 1, policy_version 747362 (0.0010) [2023-12-26 05:35:48,284][123090] Updated weights for policy 1, policy_version 747372 (0.0010) [2023-12-26 05:35:48,347][123090] Updated weights for policy 1, policy_version 747382 (0.0009) [2023-12-26 05:35:48,405][123090] Updated weights for policy 1, policy_version 747392 (0.0009) [2023-12-26 05:35:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 383877120. Throughput: 0: 9073.3, 1: 8745.8. Samples: 383888836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:48,784][121949] Avg episode reward: [(0, '5905.321'), (1, '5192.556')] [2023-12-26 05:35:48,930][123091] Updated weights for policy 0, policy_version 752115 (0.0011) [2023-12-26 05:35:48,995][123091] Updated weights for policy 0, policy_version 752125 (0.0006) [2023-12-26 05:35:49,065][123091] Updated weights for policy 0, policy_version 752135 (0.0006) [2023-12-26 05:35:49,272][123090] Updated weights for policy 1, policy_version 747402 (0.0007) [2023-12-26 05:35:49,337][123090] Updated weights for policy 1, policy_version 747412 (0.0008) [2023-12-26 05:35:49,406][123090] Updated weights for policy 1, policy_version 747422 (0.0009) [2023-12-26 05:35:49,804][123091] Updated weights for policy 0, policy_version 752145 (0.0006) [2023-12-26 05:35:49,876][123091] Updated weights for policy 0, policy_version 752155 (0.0007) [2023-12-26 05:35:49,940][123091] Updated weights for policy 0, policy_version 752165 (0.0007) [2023-12-26 05:35:49,998][123091] Updated weights for policy 0, policy_version 752175 (0.0008) [2023-12-26 05:35:50,198][123090] Updated weights for policy 1, policy_version 747432 (0.0007) [2023-12-26 05:35:50,262][123090] Updated weights for policy 1, policy_version 747442 (0.0005) [2023-12-26 05:35:50,325][123090] Updated weights for policy 1, policy_version 747452 (0.0011) [2023-12-26 05:35:50,718][123091] Updated weights for policy 0, policy_version 752185 (0.0010) [2023-12-26 05:35:50,778][123091] Updated weights for policy 0, policy_version 752195 (0.0010) [2023-12-26 05:35:50,833][123091] Updated weights for policy 0, policy_version 752205 (0.0010) [2023-12-26 05:35:51,088][123090] Updated weights for policy 1, policy_version 747462 (0.0009) [2023-12-26 05:35:51,153][123090] Updated weights for policy 1, policy_version 747472 (0.0008) [2023-12-26 05:35:51,205][123090] Updated weights for policy 1, policy_version 747482 (0.0005) [2023-12-26 05:35:51,771][123091] Updated weights for policy 0, policy_version 752215 (0.0009) [2023-12-26 05:35:51,825][123091] Updated weights for policy 0, policy_version 752226 (0.0010) [2023-12-26 05:35:51,882][123091] Updated weights for policy 0, policy_version 752236 (0.0010) [2023-12-26 05:35:51,965][123090] Updated weights for policy 1, policy_version 747492 (0.0008) [2023-12-26 05:35:52,017][123090] Updated weights for policy 1, policy_version 747502 (0.0010) [2023-12-26 05:35:52,076][123090] Updated weights for policy 1, policy_version 747512 (0.0006) [2023-12-26 05:35:52,754][123091] Updated weights for policy 0, policy_version 752246 (0.0009) [2023-12-26 05:35:52,814][123091] Updated weights for policy 0, policy_version 752256 (0.0010) [2023-12-26 05:35:52,876][123091] Updated weights for policy 0, policy_version 752266 (0.0010) [2023-12-26 05:35:52,900][123090] Updated weights for policy 1, policy_version 747522 (0.0010) [2023-12-26 05:35:52,966][123090] Updated weights for policy 1, policy_version 747532 (0.0009) [2023-12-26 05:35:53,033][123090] Updated weights for policy 1, policy_version 747542 (0.0009) [2023-12-26 05:35:53,100][123090] Updated weights for policy 1, policy_version 747552 (0.0008) [2023-12-26 05:35:53,692][123091] Updated weights for policy 0, policy_version 752276 (0.0010) [2023-12-26 05:35:53,739][123091] Updated weights for policy 0, policy_version 752286 (0.0008) [2023-12-26 05:35:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 383959040. Throughput: 0: 9071.5, 1: 8713.5. Samples: 383941916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:53,785][121949] Avg episode reward: [(0, '5860.737'), (1, '5345.451')] [2023-12-26 05:35:53,787][123091] Updated weights for policy 0, policy_version 752296 (0.0008) [2023-12-26 05:35:53,823][123090] Updated weights for policy 1, policy_version 747562 (0.0009) [2023-12-26 05:35:53,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000752304_192593920.pth... [2023-12-26 05:35:53,836][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000751248_192323584.pth [2023-12-26 05:35:53,887][123090] Updated weights for policy 1, policy_version 747572 (0.0008) [2023-12-26 05:35:53,958][123090] Updated weights for policy 1, policy_version 747583 (0.0007) [2023-12-26 05:35:53,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000747584_191381504.pth... [2023-12-26 05:35:53,966][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000746528_191111168.pth [2023-12-26 05:35:54,573][123091] Updated weights for policy 0, policy_version 752306 (0.0009) [2023-12-26 05:35:54,618][123090] Updated weights for policy 1, policy_version 747593 (0.0007) [2023-12-26 05:35:54,624][123091] Updated weights for policy 0, policy_version 752316 (0.0006) [2023-12-26 05:35:54,675][123090] Updated weights for policy 1, policy_version 747603 (0.0006) [2023-12-26 05:35:54,691][123091] Updated weights for policy 0, policy_version 752326 (0.0005) [2023-12-26 05:35:54,721][123090] Updated weights for policy 1, policy_version 747613 (0.0005) [2023-12-26 05:35:54,752][123091] Updated weights for policy 0, policy_version 752336 (0.0005) [2023-12-26 05:35:55,476][123090] Updated weights for policy 1, policy_version 747623 (0.0009) [2023-12-26 05:35:55,489][123091] Updated weights for policy 0, policy_version 752346 (0.0009) [2023-12-26 05:35:55,543][123090] Updated weights for policy 1, policy_version 747633 (0.0011) [2023-12-26 05:35:55,548][123091] Updated weights for policy 0, policy_version 752356 (0.0008) [2023-12-26 05:35:55,594][123091] Updated weights for policy 0, policy_version 752366 (0.0007) [2023-12-26 05:35:55,614][123090] Updated weights for policy 1, policy_version 747643 (0.0010) [2023-12-26 05:35:56,303][123091] Updated weights for policy 0, policy_version 752376 (0.0006) [2023-12-26 05:35:56,369][123091] Updated weights for policy 0, policy_version 752386 (0.0007) [2023-12-26 05:35:56,429][123090] Updated weights for policy 1, policy_version 747653 (0.0010) [2023-12-26 05:35:56,430][123091] Updated weights for policy 0, policy_version 752396 (0.0005) [2023-12-26 05:35:56,478][123090] Updated weights for policy 1, policy_version 747663 (0.0010) [2023-12-26 05:35:56,533][123090] Updated weights for policy 1, policy_version 747673 (0.0010) [2023-12-26 05:35:57,032][123091] Updated weights for policy 0, policy_version 752406 (0.0006) [2023-12-26 05:35:57,097][123091] Updated weights for policy 0, policy_version 752416 (0.0005) [2023-12-26 05:35:57,156][123091] Updated weights for policy 0, policy_version 752426 (0.0005) [2023-12-26 05:35:57,254][123090] Updated weights for policy 1, policy_version 747683 (0.0007) [2023-12-26 05:35:57,315][123090] Updated weights for policy 1, policy_version 747693 (0.0005) [2023-12-26 05:35:57,382][123090] Updated weights for policy 1, policy_version 747703 (0.0007) [2023-12-26 05:35:57,854][123091] Updated weights for policy 0, policy_version 752436 (0.0005) [2023-12-26 05:35:57,923][123091] Updated weights for policy 0, policy_version 752446 (0.0005) [2023-12-26 05:35:57,993][123091] Updated weights for policy 0, policy_version 752456 (0.0005) [2023-12-26 05:35:58,115][123090] Updated weights for policy 1, policy_version 747713 (0.0006) [2023-12-26 05:35:58,185][123090] Updated weights for policy 1, policy_version 747723 (0.0010) [2023-12-26 05:35:58,254][123090] Updated weights for policy 1, policy_version 747733 (0.0009) [2023-12-26 05:35:58,323][123090] Updated weights for policy 1, policy_version 747743 (0.0009) [2023-12-26 05:35:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 384057344. Throughput: 0: 9111.0, 1: 8863.1. Samples: 384054476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:35:58,785][121949] Avg episode reward: [(0, '5868.504'), (1, '5165.149')] [2023-12-26 05:35:58,814][123091] Updated weights for policy 0, policy_version 752466 (0.0008) [2023-12-26 05:35:58,868][123091] Updated weights for policy 0, policy_version 752476 (0.0010) [2023-12-26 05:35:58,933][123091] Updated weights for policy 0, policy_version 752486 (0.0009) [2023-12-26 05:35:59,001][123091] Updated weights for policy 0, policy_version 752496 (0.0011) [2023-12-26 05:35:59,205][123090] Updated weights for policy 1, policy_version 747753 (0.0009) [2023-12-26 05:35:59,271][123090] Updated weights for policy 1, policy_version 747763 (0.0008) [2023-12-26 05:35:59,337][123090] Updated weights for policy 1, policy_version 747773 (0.0006) [2023-12-26 05:35:59,834][123091] Updated weights for policy 0, policy_version 752506 (0.0011) [2023-12-26 05:35:59,904][123091] Updated weights for policy 0, policy_version 752516 (0.0011) [2023-12-26 05:35:59,971][123091] Updated weights for policy 0, policy_version 752526 (0.0010) [2023-12-26 05:36:00,165][123090] Updated weights for policy 1, policy_version 747783 (0.0008) [2023-12-26 05:36:00,221][123090] Updated weights for policy 1, policy_version 747793 (0.0009) [2023-12-26 05:36:00,274][123090] Updated weights for policy 1, policy_version 747803 (0.0009) [2023-12-26 05:36:00,773][123091] Updated weights for policy 0, policy_version 752536 (0.0010) [2023-12-26 05:36:00,820][123091] Updated weights for policy 0, policy_version 752546 (0.0010) [2023-12-26 05:36:00,862][123091] Updated weights for policy 0, policy_version 752556 (0.0010) [2023-12-26 05:36:01,133][123090] Updated weights for policy 1, policy_version 747813 (0.0008) [2023-12-26 05:36:01,201][123090] Updated weights for policy 1, policy_version 747823 (0.0009) [2023-12-26 05:36:01,267][123090] Updated weights for policy 1, policy_version 747833 (0.0009) [2023-12-26 05:36:01,721][123091] Updated weights for policy 0, policy_version 752566 (0.0010) [2023-12-26 05:36:01,777][123091] Updated weights for policy 0, policy_version 752576 (0.0010) [2023-12-26 05:36:01,838][123091] Updated weights for policy 0, policy_version 752586 (0.0007) [2023-12-26 05:36:02,155][123090] Updated weights for policy 1, policy_version 747843 (0.0009) [2023-12-26 05:36:02,217][123090] Updated weights for policy 1, policy_version 747853 (0.0009) [2023-12-26 05:36:02,279][123090] Updated weights for policy 1, policy_version 747863 (0.0010) [2023-12-26 05:36:02,547][123091] Updated weights for policy 0, policy_version 752596 (0.0005) [2023-12-26 05:36:02,622][123091] Updated weights for policy 0, policy_version 752606 (0.0005) [2023-12-26 05:36:02,693][123091] Updated weights for policy 0, policy_version 752616 (0.0005) [2023-12-26 05:36:03,036][123090] Updated weights for policy 1, policy_version 747873 (0.0009) [2023-12-26 05:36:03,110][123090] Updated weights for policy 1, policy_version 747883 (0.0006) [2023-12-26 05:36:03,183][123090] Updated weights for policy 1, policy_version 747893 (0.0006) [2023-12-26 05:36:03,251][123090] Updated weights for policy 1, policy_version 747903 (0.0007) [2023-12-26 05:36:03,331][123091] Updated weights for policy 0, policy_version 752626 (0.0007) [2023-12-26 05:36:03,383][123091] Updated weights for policy 0, policy_version 752636 (0.0011) [2023-12-26 05:36:03,431][123091] Updated weights for policy 0, policy_version 752646 (0.0010) [2023-12-26 05:36:03,478][123091] Updated weights for policy 0, policy_version 752656 (0.0010) [2023-12-26 05:36:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 384147456. Throughput: 0: 9057.6, 1: 8888.7. Samples: 384158200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:03,784][121949] Avg episode reward: [(0, '5916.449'), (1, '5144.701')] [2023-12-26 05:36:03,991][123090] Updated weights for policy 1, policy_version 747913 (0.0007) [2023-12-26 05:36:04,063][123090] Updated weights for policy 1, policy_version 747923 (0.0006) [2023-12-26 05:36:04,135][123090] Updated weights for policy 1, policy_version 747933 (0.0006) [2023-12-26 05:36:04,336][123091] Updated weights for policy 0, policy_version 752666 (0.0007) [2023-12-26 05:36:04,404][123091] Updated weights for policy 0, policy_version 752676 (0.0009) [2023-12-26 05:36:04,466][123091] Updated weights for policy 0, policy_version 752686 (0.0009) [2023-12-26 05:36:04,868][123090] Updated weights for policy 1, policy_version 747943 (0.0006) [2023-12-26 05:36:04,938][123090] Updated weights for policy 1, policy_version 747953 (0.0008) [2023-12-26 05:36:04,988][123090] Updated weights for policy 1, policy_version 747963 (0.0010) [2023-12-26 05:36:05,141][123091] Updated weights for policy 0, policy_version 752696 (0.0009) [2023-12-26 05:36:05,197][123091] Updated weights for policy 0, policy_version 752706 (0.0009) [2023-12-26 05:36:05,260][123091] Updated weights for policy 0, policy_version 752716 (0.0010) [2023-12-26 05:36:05,779][123090] Updated weights for policy 1, policy_version 747973 (0.0010) [2023-12-26 05:36:05,842][123090] Updated weights for policy 1, policy_version 747983 (0.0010) [2023-12-26 05:36:05,899][123090] Updated weights for policy 1, policy_version 747993 (0.0010) [2023-12-26 05:36:06,081][123091] Updated weights for policy 0, policy_version 752726 (0.0009) [2023-12-26 05:36:06,154][123091] Updated weights for policy 0, policy_version 752736 (0.0010) [2023-12-26 05:36:06,219][123091] Updated weights for policy 0, policy_version 752746 (0.0009) [2023-12-26 05:36:06,700][123090] Updated weights for policy 1, policy_version 748003 (0.0010) [2023-12-26 05:36:06,768][123090] Updated weights for policy 1, policy_version 748013 (0.0006) [2023-12-26 05:36:06,832][123090] Updated weights for policy 1, policy_version 748023 (0.0005) [2023-12-26 05:36:07,072][123091] Updated weights for policy 0, policy_version 752756 (0.0010) [2023-12-26 05:36:07,140][123091] Updated weights for policy 0, policy_version 752766 (0.0010) [2023-12-26 05:36:07,198][123091] Updated weights for policy 0, policy_version 752776 (0.0009) [2023-12-26 05:36:07,587][123090] Updated weights for policy 1, policy_version 748033 (0.0006) [2023-12-26 05:36:07,647][123090] Updated weights for policy 1, policy_version 748043 (0.0011) [2023-12-26 05:36:07,698][123090] Updated weights for policy 1, policy_version 748053 (0.0010) [2023-12-26 05:36:07,751][123090] Updated weights for policy 1, policy_version 748063 (0.0010) [2023-12-26 05:36:08,006][123091] Updated weights for policy 0, policy_version 752786 (0.0008) [2023-12-26 05:36:08,070][123091] Updated weights for policy 0, policy_version 752796 (0.0006) [2023-12-26 05:36:08,128][123091] Updated weights for policy 0, policy_version 752806 (0.0008) [2023-12-26 05:36:08,174][123091] Updated weights for policy 0, policy_version 752816 (0.0010) [2023-12-26 05:36:08,574][123090] Updated weights for policy 1, policy_version 748073 (0.0006) [2023-12-26 05:36:08,644][123090] Updated weights for policy 1, policy_version 748083 (0.0007) [2023-12-26 05:36:08,709][123090] Updated weights for policy 1, policy_version 748093 (0.0009) [2023-12-26 05:36:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 384237568. Throughput: 0: 9074.3, 1: 8927.3. Samples: 384211276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:08,785][121949] Avg episode reward: [(0, '5984.291'), (1, '5291.812')] [2023-12-26 05:36:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000752816_192724992.pth... [2023-12-26 05:36:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000748096_191512576.pth... [2023-12-26 05:36:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000747040_191242240.pth [2023-12-26 05:36:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000751760_192454656.pth [2023-12-26 05:36:09,010][123091] Updated weights for policy 0, policy_version 752826 (0.0010) [2023-12-26 05:36:09,062][123091] Updated weights for policy 0, policy_version 752836 (0.0009) [2023-12-26 05:36:09,115][123091] Updated weights for policy 0, policy_version 752846 (0.0009) [2023-12-26 05:36:09,519][123090] Updated weights for policy 1, policy_version 748103 (0.0009) [2023-12-26 05:36:09,584][123090] Updated weights for policy 1, policy_version 748113 (0.0009) [2023-12-26 05:36:09,648][123090] Updated weights for policy 1, policy_version 748123 (0.0009) [2023-12-26 05:36:09,960][123091] Updated weights for policy 0, policy_version 752856 (0.0008) [2023-12-26 05:36:10,026][123091] Updated weights for policy 0, policy_version 752866 (0.0009) [2023-12-26 05:36:10,080][123091] Updated weights for policy 0, policy_version 752876 (0.0010) [2023-12-26 05:36:10,501][123090] Updated weights for policy 1, policy_version 748133 (0.0010) [2023-12-26 05:36:10,556][123090] Updated weights for policy 1, policy_version 748143 (0.0010) [2023-12-26 05:36:10,624][123090] Updated weights for policy 1, policy_version 748153 (0.0009) [2023-12-26 05:36:10,909][123091] Updated weights for policy 0, policy_version 752886 (0.0010) [2023-12-26 05:36:10,967][123091] Updated weights for policy 0, policy_version 752896 (0.0009) [2023-12-26 05:36:11,022][123091] Updated weights for policy 0, policy_version 752906 (0.0009) [2023-12-26 05:36:11,446][123090] Updated weights for policy 1, policy_version 748163 (0.0010) [2023-12-26 05:36:11,501][123090] Updated weights for policy 1, policy_version 748173 (0.0010) [2023-12-26 05:36:11,566][123090] Updated weights for policy 1, policy_version 748183 (0.0011) [2023-12-26 05:36:11,913][123091] Updated weights for policy 0, policy_version 752916 (0.0010) [2023-12-26 05:36:11,970][123091] Updated weights for policy 0, policy_version 752926 (0.0010) [2023-12-26 05:36:12,030][123091] Updated weights for policy 0, policy_version 752936 (0.0010) [2023-12-26 05:36:12,496][123090] Updated weights for policy 1, policy_version 748193 (0.0009) [2023-12-26 05:36:12,555][123090] Updated weights for policy 1, policy_version 748203 (0.0009) [2023-12-26 05:36:12,608][123090] Updated weights for policy 1, policy_version 748213 (0.0008) [2023-12-26 05:36:12,673][123090] Updated weights for policy 1, policy_version 748223 (0.0009) [2023-12-26 05:36:12,922][123091] Updated weights for policy 0, policy_version 752946 (0.0009) [2023-12-26 05:36:12,983][123091] Updated weights for policy 0, policy_version 752956 (0.0006) [2023-12-26 05:36:13,046][123091] Updated weights for policy 0, policy_version 752966 (0.0006) [2023-12-26 05:36:13,105][123091] Updated weights for policy 0, policy_version 752976 (0.0010) [2023-12-26 05:36:13,389][123090] Updated weights for policy 1, policy_version 748233 (0.0006) [2023-12-26 05:36:13,440][123090] Updated weights for policy 1, policy_version 748243 (0.0005) [2023-12-26 05:36:13,500][123090] Updated weights for policy 1, policy_version 748253 (0.0009) [2023-12-26 05:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 384319488. Throughput: 0: 8950.2, 1: 8875.8. Samples: 384312648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:13,785][121949] Avg episode reward: [(0, '5969.797'), (1, '5377.904')] [2023-12-26 05:36:13,863][123091] Updated weights for policy 0, policy_version 752986 (0.0010) [2023-12-26 05:36:13,918][123091] Updated weights for policy 0, policy_version 752996 (0.0009) [2023-12-26 05:36:13,969][123091] Updated weights for policy 0, policy_version 753006 (0.0010) [2023-12-26 05:36:14,303][123090] Updated weights for policy 1, policy_version 748263 (0.0009) [2023-12-26 05:36:14,356][123090] Updated weights for policy 1, policy_version 748273 (0.0009) [2023-12-26 05:36:14,424][123090] Updated weights for policy 1, policy_version 748283 (0.0009) [2023-12-26 05:36:14,823][123091] Updated weights for policy 0, policy_version 753016 (0.0010) [2023-12-26 05:36:14,885][123091] Updated weights for policy 0, policy_version 753027 (0.0009) [2023-12-26 05:36:14,944][123091] Updated weights for policy 0, policy_version 753037 (0.0010) [2023-12-26 05:36:15,286][123090] Updated weights for policy 1, policy_version 748293 (0.0009) [2023-12-26 05:36:15,340][123090] Updated weights for policy 1, policy_version 748303 (0.0009) [2023-12-26 05:36:15,396][123090] Updated weights for policy 1, policy_version 748313 (0.0008) [2023-12-26 05:36:15,804][123091] Updated weights for policy 0, policy_version 753047 (0.0010) [2023-12-26 05:36:15,869][123091] Updated weights for policy 0, policy_version 753057 (0.0010) [2023-12-26 05:36:15,930][123091] Updated weights for policy 0, policy_version 753067 (0.0010) [2023-12-26 05:36:16,259][123090] Updated weights for policy 1, policy_version 748323 (0.0009) [2023-12-26 05:36:16,321][123090] Updated weights for policy 1, policy_version 748333 (0.0009) [2023-12-26 05:36:16,370][123090] Updated weights for policy 1, policy_version 748343 (0.0009) [2023-12-26 05:36:16,768][123091] Updated weights for policy 0, policy_version 753077 (0.0009) [2023-12-26 05:36:16,822][123091] Updated weights for policy 0, policy_version 753087 (0.0010) [2023-12-26 05:36:16,885][123091] Updated weights for policy 0, policy_version 753097 (0.0009) [2023-12-26 05:36:17,229][123090] Updated weights for policy 1, policy_version 748353 (0.0009) [2023-12-26 05:36:17,286][123090] Updated weights for policy 1, policy_version 748363 (0.0009) [2023-12-26 05:36:17,352][123090] Updated weights for policy 1, policy_version 748373 (0.0009) [2023-12-26 05:36:17,420][123090] Updated weights for policy 1, policy_version 748383 (0.0009) [2023-12-26 05:36:17,759][123091] Updated weights for policy 0, policy_version 753107 (0.0009) [2023-12-26 05:36:17,821][123091] Updated weights for policy 0, policy_version 753117 (0.0007) [2023-12-26 05:36:17,865][123091] Updated weights for policy 0, policy_version 753127 (0.0005) [2023-12-26 05:36:18,269][123090] Updated weights for policy 1, policy_version 748393 (0.0010) [2023-12-26 05:36:18,339][123090] Updated weights for policy 1, policy_version 748403 (0.0009) [2023-12-26 05:36:18,416][123090] Updated weights for policy 1, policy_version 748413 (0.0010) [2023-12-26 05:36:18,513][123091] Updated weights for policy 0, policy_version 753137 (0.0005) [2023-12-26 05:36:18,585][123091] Updated weights for policy 0, policy_version 753147 (0.0007) [2023-12-26 05:36:18,645][123091] Updated weights for policy 0, policy_version 753157 (0.0010) [2023-12-26 05:36:18,711][123091] Updated weights for policy 0, policy_version 753167 (0.0011) [2023-12-26 05:36:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 384409600. Throughput: 0: 8886.8, 1: 8857.2. Samples: 384416512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:18,785][121949] Avg episode reward: [(0, '6122.041'), (1, '5344.458')] [2023-12-26 05:36:19,255][123090] Updated weights for policy 1, policy_version 748423 (0.0009) [2023-12-26 05:36:19,321][123090] Updated weights for policy 1, policy_version 748433 (0.0009) [2023-12-26 05:36:19,396][123090] Updated weights for policy 1, policy_version 748444 (0.0009) [2023-12-26 05:36:19,556][123091] Updated weights for policy 0, policy_version 753177 (0.0011) [2023-12-26 05:36:19,621][123091] Updated weights for policy 0, policy_version 753187 (0.0011) [2023-12-26 05:36:19,691][123091] Updated weights for policy 0, policy_version 753197 (0.0010) [2023-12-26 05:36:20,276][123090] Updated weights for policy 1, policy_version 748454 (0.0008) [2023-12-26 05:36:20,338][123090] Updated weights for policy 1, policy_version 748464 (0.0010) [2023-12-26 05:36:20,403][123090] Updated weights for policy 1, policy_version 748474 (0.0010) [2023-12-26 05:36:20,520][123091] Updated weights for policy 0, policy_version 753207 (0.0007) [2023-12-26 05:36:20,596][123091] Updated weights for policy 0, policy_version 753217 (0.0007) [2023-12-26 05:36:20,658][123091] Updated weights for policy 0, policy_version 753227 (0.0008) [2023-12-26 05:36:21,275][123090] Updated weights for policy 1, policy_version 748484 (0.0009) [2023-12-26 05:36:21,344][123090] Updated weights for policy 1, policy_version 748494 (0.0010) [2023-12-26 05:36:21,412][123090] Updated weights for policy 1, policy_version 748504 (0.0009) [2023-12-26 05:36:21,452][123091] Updated weights for policy 0, policy_version 753237 (0.0009) [2023-12-26 05:36:21,520][123091] Updated weights for policy 0, policy_version 753247 (0.0009) [2023-12-26 05:36:21,586][123091] Updated weights for policy 0, policy_version 753257 (0.0010) [2023-12-26 05:36:22,280][123090] Updated weights for policy 1, policy_version 748514 (0.0008) [2023-12-26 05:36:22,355][123090] Updated weights for policy 1, policy_version 748524 (0.0010) [2023-12-26 05:36:22,384][123091] Updated weights for policy 0, policy_version 753267 (0.0009) [2023-12-26 05:36:22,425][123090] Updated weights for policy 1, policy_version 748534 (0.0008) [2023-12-26 05:36:22,447][123091] Updated weights for policy 0, policy_version 753277 (0.0008) [2023-12-26 05:36:22,504][123090] Updated weights for policy 1, policy_version 748544 (0.0008) [2023-12-26 05:36:22,518][123091] Updated weights for policy 0, policy_version 753287 (0.0008) [2023-12-26 05:36:23,224][123090] Updated weights for policy 1, policy_version 748554 (0.0009) [2023-12-26 05:36:23,276][123090] Updated weights for policy 1, policy_version 748564 (0.0009) [2023-12-26 05:36:23,320][123091] Updated weights for policy 0, policy_version 753297 (0.0009) [2023-12-26 05:36:23,332][123090] Updated weights for policy 1, policy_version 748575 (0.0010) [2023-12-26 05:36:23,373][123091] Updated weights for policy 0, policy_version 753307 (0.0010) [2023-12-26 05:36:23,429][123091] Updated weights for policy 0, policy_version 753317 (0.0009) [2023-12-26 05:36:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 384491520. Throughput: 0: 8908.0, 1: 8740.9. Samples: 384466496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:23,785][121949] Avg episode reward: [(0, '6077.917'), (1, '5377.975')] [2023-12-26 05:36:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000748576_191635456.pth... [2023-12-26 05:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000753328_192856064.pth... [2023-12-26 05:36:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000747584_191381504.pth [2023-12-26 05:36:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000752304_192593920.pth [2023-12-26 05:36:24,105][123090] Updated weights for policy 1, policy_version 748585 (0.0006) [2023-12-26 05:36:24,154][123090] Updated weights for policy 1, policy_version 748595 (0.0005) [2023-12-26 05:36:24,198][123090] Updated weights for policy 1, policy_version 748605 (0.0005) [2023-12-26 05:36:24,311][123091] Updated weights for policy 0, policy_version 753329 (0.0012) [2023-12-26 05:36:24,365][123091] Updated weights for policy 0, policy_version 753339 (0.0010) [2023-12-26 05:36:24,423][123091] Updated weights for policy 0, policy_version 753349 (0.0010) [2023-12-26 05:36:24,483][123091] Updated weights for policy 0, policy_version 753359 (0.0009) [2023-12-26 05:36:24,881][123090] Updated weights for policy 1, policy_version 748615 (0.0005) [2023-12-26 05:36:24,939][123090] Updated weights for policy 1, policy_version 748625 (0.0006) [2023-12-26 05:36:24,998][123090] Updated weights for policy 1, policy_version 748635 (0.0006) [2023-12-26 05:36:25,367][123091] Updated weights for policy 0, policy_version 753369 (0.0010) [2023-12-26 05:36:25,424][123091] Updated weights for policy 0, policy_version 753379 (0.0009) [2023-12-26 05:36:25,485][123091] Updated weights for policy 0, policy_version 753389 (0.0009) [2023-12-26 05:36:25,770][123090] Updated weights for policy 1, policy_version 748645 (0.0007) [2023-12-26 05:36:25,823][123090] Updated weights for policy 1, policy_version 748655 (0.0009) [2023-12-26 05:36:25,875][123090] Updated weights for policy 1, policy_version 748665 (0.0009) [2023-12-26 05:36:26,360][123091] Updated weights for policy 0, policy_version 753400 (0.0010) [2023-12-26 05:36:26,420][123091] Updated weights for policy 0, policy_version 753410 (0.0010) [2023-12-26 05:36:26,471][123091] Updated weights for policy 0, policy_version 753421 (0.0009) [2023-12-26 05:36:26,632][123090] Updated weights for policy 1, policy_version 748675 (0.0008) [2023-12-26 05:36:26,683][123090] Updated weights for policy 1, policy_version 748685 (0.0005) [2023-12-26 05:36:26,729][123090] Updated weights for policy 1, policy_version 748695 (0.0005) [2023-12-26 05:36:27,171][123091] Updated weights for policy 0, policy_version 753431 (0.0005) [2023-12-26 05:36:27,215][123091] Updated weights for policy 0, policy_version 753441 (0.0005) [2023-12-26 05:36:27,261][123091] Updated weights for policy 0, policy_version 753451 (0.0005) [2023-12-26 05:36:27,353][123090] Updated weights for policy 1, policy_version 748705 (0.0006) [2023-12-26 05:36:27,417][123090] Updated weights for policy 1, policy_version 748715 (0.0007) [2023-12-26 05:36:27,489][123090] Updated weights for policy 1, policy_version 748725 (0.0009) [2023-12-26 05:36:27,547][123090] Updated weights for policy 1, policy_version 748735 (0.0008) [2023-12-26 05:36:27,973][123091] Updated weights for policy 0, policy_version 753461 (0.0007) [2023-12-26 05:36:28,026][123091] Updated weights for policy 0, policy_version 753472 (0.0010) [2023-12-26 05:36:28,078][123091] Updated weights for policy 0, policy_version 753483 (0.0010) [2023-12-26 05:36:28,321][123090] Updated weights for policy 1, policy_version 748745 (0.0006) [2023-12-26 05:36:28,386][123090] Updated weights for policy 1, policy_version 748755 (0.0008) [2023-12-26 05:36:28,447][123090] Updated weights for policy 1, policy_version 748765 (0.0006) [2023-12-26 05:36:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 384581632. Throughput: 0: 8882.9, 1: 8837.9. Samples: 384575936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:28,786][121949] Avg episode reward: [(0, '6028.201'), (1, '5029.461')] [2023-12-26 05:36:28,983][123091] Updated weights for policy 0, policy_version 753493 (0.0009) [2023-12-26 05:36:29,036][123091] Updated weights for policy 0, policy_version 753503 (0.0009) [2023-12-26 05:36:29,082][123091] Updated weights for policy 0, policy_version 753513 (0.0008) [2023-12-26 05:36:29,215][123090] Updated weights for policy 1, policy_version 748775 (0.0008) [2023-12-26 05:36:29,290][123090] Updated weights for policy 1, policy_version 748785 (0.0009) [2023-12-26 05:36:29,361][123090] Updated weights for policy 1, policy_version 748795 (0.0009) [2023-12-26 05:36:29,962][123091] Updated weights for policy 0, policy_version 753523 (0.0009) [2023-12-26 05:36:30,024][123091] Updated weights for policy 0, policy_version 753533 (0.0009) [2023-12-26 05:36:30,081][123091] Updated weights for policy 0, policy_version 753543 (0.0009) [2023-12-26 05:36:30,189][123090] Updated weights for policy 1, policy_version 748805 (0.0009) [2023-12-26 05:36:30,248][123090] Updated weights for policy 1, policy_version 748815 (0.0009) [2023-12-26 05:36:30,304][123090] Updated weights for policy 1, policy_version 748825 (0.0009) [2023-12-26 05:36:30,820][123091] Updated weights for policy 0, policy_version 753553 (0.0009) [2023-12-26 05:36:30,884][123091] Updated weights for policy 0, policy_version 753563 (0.0005) [2023-12-26 05:36:30,950][123091] Updated weights for policy 0, policy_version 753573 (0.0008) [2023-12-26 05:36:31,003][123091] Updated weights for policy 0, policy_version 753583 (0.0009) [2023-12-26 05:36:31,178][123090] Updated weights for policy 1, policy_version 748835 (0.0010) [2023-12-26 05:36:31,226][123090] Updated weights for policy 1, policy_version 748845 (0.0009) [2023-12-26 05:36:31,292][123090] Updated weights for policy 1, policy_version 748855 (0.0009) [2023-12-26 05:36:31,830][123091] Updated weights for policy 0, policy_version 753593 (0.0010) [2023-12-26 05:36:31,881][123091] Updated weights for policy 0, policy_version 753603 (0.0010) [2023-12-26 05:36:31,925][123091] Updated weights for policy 0, policy_version 753613 (0.0010) [2023-12-26 05:36:32,134][123090] Updated weights for policy 1, policy_version 748865 (0.0009) [2023-12-26 05:36:32,189][123090] Updated weights for policy 1, policy_version 748875 (0.0010) [2023-12-26 05:36:32,251][123090] Updated weights for policy 1, policy_version 748885 (0.0010) [2023-12-26 05:36:32,318][123090] Updated weights for policy 1, policy_version 748895 (0.0011) [2023-12-26 05:36:32,691][123091] Updated weights for policy 0, policy_version 753623 (0.0007) [2023-12-26 05:36:32,737][123091] Updated weights for policy 0, policy_version 753633 (0.0005) [2023-12-26 05:36:32,784][123091] Updated weights for policy 0, policy_version 753643 (0.0005) [2023-12-26 05:36:33,148][123090] Updated weights for policy 1, policy_version 748905 (0.0010) [2023-12-26 05:36:33,218][123090] Updated weights for policy 1, policy_version 748915 (0.0010) [2023-12-26 05:36:33,286][123090] Updated weights for policy 1, policy_version 748925 (0.0006) [2023-12-26 05:36:33,486][123091] Updated weights for policy 0, policy_version 753653 (0.0007) [2023-12-26 05:36:33,536][123091] Updated weights for policy 0, policy_version 753663 (0.0009) [2023-12-26 05:36:33,588][123091] Updated weights for policy 0, policy_version 753673 (0.0008) [2023-12-26 05:36:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 384671744. Throughput: 0: 8843.7, 1: 8778.1. Samples: 384681820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:33,785][121949] Avg episode reward: [(0, '6145.545'), (1, '5129.348')] [2023-12-26 05:36:34,015][123090] Updated weights for policy 1, policy_version 748935 (0.0005) [2023-12-26 05:36:34,075][123090] Updated weights for policy 1, policy_version 748945 (0.0008) [2023-12-26 05:36:34,132][123090] Updated weights for policy 1, policy_version 748955 (0.0010) [2023-12-26 05:36:34,248][123091] Updated weights for policy 0, policy_version 753683 (0.0006) [2023-12-26 05:36:34,307][123091] Updated weights for policy 0, policy_version 753693 (0.0009) [2023-12-26 05:36:34,368][123091] Updated weights for policy 0, policy_version 753703 (0.0008) [2023-12-26 05:36:34,889][123090] Updated weights for policy 1, policy_version 748965 (0.0008) [2023-12-26 05:36:34,944][123090] Updated weights for policy 1, policy_version 748975 (0.0006) [2023-12-26 05:36:35,006][123090] Updated weights for policy 1, policy_version 748985 (0.0005) [2023-12-26 05:36:35,208][123091] Updated weights for policy 0, policy_version 753713 (0.0009) [2023-12-26 05:36:35,268][123091] Updated weights for policy 0, policy_version 753723 (0.0009) [2023-12-26 05:36:35,316][123091] Updated weights for policy 0, policy_version 753733 (0.0009) [2023-12-26 05:36:35,369][123091] Updated weights for policy 0, policy_version 753743 (0.0010) [2023-12-26 05:36:35,712][123090] Updated weights for policy 1, policy_version 748995 (0.0005) [2023-12-26 05:36:35,769][123090] Updated weights for policy 1, policy_version 749005 (0.0008) [2023-12-26 05:36:35,830][123090] Updated weights for policy 1, policy_version 749015 (0.0009) [2023-12-26 05:36:36,182][123091] Updated weights for policy 0, policy_version 753753 (0.0010) [2023-12-26 05:36:36,230][123091] Updated weights for policy 0, policy_version 753763 (0.0010) [2023-12-26 05:36:36,282][123091] Updated weights for policy 0, policy_version 753773 (0.0010) [2023-12-26 05:36:36,458][123090] Updated weights for policy 1, policy_version 749025 (0.0008) [2023-12-26 05:36:36,526][123090] Updated weights for policy 1, policy_version 749035 (0.0009) [2023-12-26 05:36:36,592][123090] Updated weights for policy 1, policy_version 749045 (0.0006) [2023-12-26 05:36:36,656][123090] Updated weights for policy 1, policy_version 749055 (0.0006) [2023-12-26 05:36:37,151][123091] Updated weights for policy 0, policy_version 753783 (0.0010) [2023-12-26 05:36:37,214][123091] Updated weights for policy 0, policy_version 753793 (0.0010) [2023-12-26 05:36:37,277][123091] Updated weights for policy 0, policy_version 753803 (0.0011) [2023-12-26 05:36:37,421][123090] Updated weights for policy 1, policy_version 749065 (0.0009) [2023-12-26 05:36:37,486][123090] Updated weights for policy 1, policy_version 749075 (0.0009) [2023-12-26 05:36:37,549][123090] Updated weights for policy 1, policy_version 749085 (0.0007) [2023-12-26 05:36:38,101][123091] Updated weights for policy 0, policy_version 753813 (0.0010) [2023-12-26 05:36:38,157][123091] Updated weights for policy 0, policy_version 753823 (0.0010) [2023-12-26 05:36:38,218][123091] Updated weights for policy 0, policy_version 753833 (0.0011) [2023-12-26 05:36:38,360][123090] Updated weights for policy 1, policy_version 749095 (0.0008) [2023-12-26 05:36:38,424][123090] Updated weights for policy 1, policy_version 749105 (0.0006) [2023-12-26 05:36:38,471][123090] Updated weights for policy 1, policy_version 749115 (0.0008) [2023-12-26 05:36:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 384761856. Throughput: 0: 8860.9, 1: 8828.5. Samples: 384737936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:36:38,785][121949] Avg episode reward: [(0, '6210.906'), (1, '5568.905')] [2023-12-26 05:36:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000749120_191774720.pth... [2023-12-26 05:36:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000753840_192987136.pth... [2023-12-26 05:36:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000748096_191512576.pth [2023-12-26 05:36:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000752816_192724992.pth [2023-12-26 05:36:39,014][123091] Updated weights for policy 0, policy_version 753843 (0.0010) [2023-12-26 05:36:39,083][123091] Updated weights for policy 0, policy_version 753853 (0.0007) [2023-12-26 05:36:39,159][123091] Updated weights for policy 0, policy_version 753863 (0.0007) [2023-12-26 05:36:39,327][123090] Updated weights for policy 1, policy_version 749125 (0.0007) [2023-12-26 05:36:39,397][123090] Updated weights for policy 1, policy_version 749135 (0.0009) [2023-12-26 05:36:39,461][123090] Updated weights for policy 1, policy_version 749145 (0.0009) [2023-12-26 05:36:39,955][123091] Updated weights for policy 0, policy_version 753873 (0.0008) [2023-12-26 05:36:40,020][123091] Updated weights for policy 0, policy_version 753883 (0.0011) [2023-12-26 05:36:40,076][123091] Updated weights for policy 0, policy_version 753893 (0.0008) [2023-12-26 05:36:40,133][123091] Updated weights for policy 0, policy_version 753903 (0.0005) [2023-12-26 05:36:40,314][123090] Updated weights for policy 1, policy_version 749155 (0.0009) [2023-12-26 05:36:40,378][123090] Updated weights for policy 1, policy_version 749165 (0.0009) [2023-12-26 05:36:40,433][123090] Updated weights for policy 1, policy_version 749175 (0.0010) [2023-12-26 05:36:40,860][123091] Updated weights for policy 0, policy_version 753913 (0.0010) [2023-12-26 05:36:40,919][123091] Updated weights for policy 0, policy_version 753923 (0.0011) [2023-12-26 05:36:40,970][123091] Updated weights for policy 0, policy_version 753933 (0.0010) [2023-12-26 05:36:41,135][123090] Updated weights for policy 1, policy_version 749186 (0.0010) [2023-12-26 05:36:41,204][123090] Updated weights for policy 1, policy_version 749196 (0.0008) [2023-12-26 05:36:41,273][123090] Updated weights for policy 1, policy_version 749206 (0.0009) [2023-12-26 05:36:41,342][123090] Updated weights for policy 1, policy_version 749216 (0.0007) [2023-12-26 05:36:41,874][123091] Updated weights for policy 0, policy_version 753943 (0.0007) [2023-12-26 05:36:41,937][123091] Updated weights for policy 0, policy_version 753953 (0.0007) [2023-12-26 05:36:42,002][123091] Updated weights for policy 0, policy_version 753963 (0.0006) [2023-12-26 05:36:42,133][123090] Updated weights for policy 1, policy_version 749226 (0.0006) [2023-12-26 05:36:42,207][123090] Updated weights for policy 1, policy_version 749236 (0.0006) [2023-12-26 05:36:42,273][123090] Updated weights for policy 1, policy_version 749246 (0.0010) [2023-12-26 05:36:42,721][123091] Updated weights for policy 0, policy_version 753973 (0.0006) [2023-12-26 05:36:42,785][123091] Updated weights for policy 0, policy_version 753983 (0.0006) [2023-12-26 05:36:42,855][123091] Updated weights for policy 0, policy_version 753993 (0.0005) [2023-12-26 05:36:43,042][123090] Updated weights for policy 1, policy_version 749256 (0.0007) [2023-12-26 05:36:43,090][123090] Updated weights for policy 1, policy_version 749266 (0.0006) [2023-12-26 05:36:43,152][123090] Updated weights for policy 1, policy_version 749276 (0.0008) [2023-12-26 05:36:43,548][123091] Updated weights for policy 0, policy_version 754003 (0.0006) [2023-12-26 05:36:43,599][123091] Updated weights for policy 0, policy_version 754013 (0.0005) [2023-12-26 05:36:43,653][123091] Updated weights for policy 0, policy_version 754023 (0.0005) [2023-12-26 05:36:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 384851968. Throughput: 0: 8769.3, 1: 8750.4. Samples: 384842864. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:36:43,785][121949] Avg episode reward: [(0, '6162.065'), (1, '5270.035')] [2023-12-26 05:36:43,999][123090] Updated weights for policy 1, policy_version 749286 (0.0007) [2023-12-26 05:36:44,067][123090] Updated weights for policy 1, policy_version 749296 (0.0005) [2023-12-26 05:36:44,133][123090] Updated weights for policy 1, policy_version 749306 (0.0005) [2023-12-26 05:36:44,466][123091] Updated weights for policy 0, policy_version 754033 (0.0008) [2023-12-26 05:36:44,531][123091] Updated weights for policy 0, policy_version 754043 (0.0009) [2023-12-26 05:36:44,600][123091] Updated weights for policy 0, policy_version 754053 (0.0005) [2023-12-26 05:36:44,661][123091] Updated weights for policy 0, policy_version 754063 (0.0009) [2023-12-26 05:36:44,866][123090] Updated weights for policy 1, policy_version 749316 (0.0006) [2023-12-26 05:36:44,937][123090] Updated weights for policy 1, policy_version 749326 (0.0006) [2023-12-26 05:36:45,012][123090] Updated weights for policy 1, policy_version 749336 (0.0006) [2023-12-26 05:36:45,418][123091] Updated weights for policy 0, policy_version 754073 (0.0010) [2023-12-26 05:36:45,485][123091] Updated weights for policy 0, policy_version 754083 (0.0010) [2023-12-26 05:36:45,552][123091] Updated weights for policy 0, policy_version 754093 (0.0009) [2023-12-26 05:36:45,798][123090] Updated weights for policy 1, policy_version 749346 (0.0006) [2023-12-26 05:36:45,862][123090] Updated weights for policy 1, policy_version 749356 (0.0009) [2023-12-26 05:36:45,925][123090] Updated weights for policy 1, policy_version 749366 (0.0008) [2023-12-26 05:36:45,999][123090] Updated weights for policy 1, policy_version 749376 (0.0010) [2023-12-26 05:36:46,279][123091] Updated weights for policy 0, policy_version 754103 (0.0005) [2023-12-26 05:36:46,329][123091] Updated weights for policy 0, policy_version 754113 (0.0005) [2023-12-26 05:36:46,401][123091] Updated weights for policy 0, policy_version 754123 (0.0006) [2023-12-26 05:36:46,835][123090] Updated weights for policy 1, policy_version 749386 (0.0005) [2023-12-26 05:36:46,916][123090] Updated weights for policy 1, policy_version 749396 (0.0005) [2023-12-26 05:36:46,983][123090] Updated weights for policy 1, policy_version 749406 (0.0009) [2023-12-26 05:36:47,011][123091] Updated weights for policy 0, policy_version 754133 (0.0008) [2023-12-26 05:36:47,074][123091] Updated weights for policy 0, policy_version 754143 (0.0006) [2023-12-26 05:36:47,132][123091] Updated weights for policy 0, policy_version 754153 (0.0006) [2023-12-26 05:36:47,661][123090] Updated weights for policy 1, policy_version 749416 (0.0010) [2023-12-26 05:36:47,708][123090] Updated weights for policy 1, policy_version 749426 (0.0009) [2023-12-26 05:36:47,763][123090] Updated weights for policy 1, policy_version 749436 (0.0009) [2023-12-26 05:36:47,936][123091] Updated weights for policy 0, policy_version 754163 (0.0008) [2023-12-26 05:36:47,988][123091] Updated weights for policy 0, policy_version 754173 (0.0006) [2023-12-26 05:36:48,036][123091] Updated weights for policy 0, policy_version 754183 (0.0005) [2023-12-26 05:36:48,579][123090] Updated weights for policy 1, policy_version 749446 (0.0008) [2023-12-26 05:36:48,647][123090] Updated weights for policy 1, policy_version 749456 (0.0008) [2023-12-26 05:36:48,718][123090] Updated weights for policy 1, policy_version 749466 (0.0008) [2023-12-26 05:36:48,770][123091] Updated weights for policy 0, policy_version 754193 (0.0009) [2023-12-26 05:36:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 384942080. Throughput: 0: 8846.1, 1: 8806.4. Samples: 384952564. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:36:48,785][121949] Avg episode reward: [(0, '6057.105'), (1, '5066.496')] [2023-12-26 05:36:48,834][123091] Updated weights for policy 0, policy_version 754203 (0.0009) [2023-12-26 05:36:48,898][123091] Updated weights for policy 0, policy_version 754213 (0.0009) [2023-12-26 05:36:48,962][123091] Updated weights for policy 0, policy_version 754223 (0.0010) [2023-12-26 05:36:49,508][123090] Updated weights for policy 1, policy_version 749476 (0.0007) [2023-12-26 05:36:49,564][123090] Updated weights for policy 1, policy_version 749486 (0.0006) [2023-12-26 05:36:49,621][123090] Updated weights for policy 1, policy_version 749496 (0.0010) [2023-12-26 05:36:49,842][123091] Updated weights for policy 0, policy_version 754233 (0.0009) [2023-12-26 05:36:49,939][123091] Updated weights for policy 0, policy_version 754243 (0.0007) [2023-12-26 05:36:50,001][123091] Updated weights for policy 0, policy_version 754253 (0.0006) [2023-12-26 05:36:50,444][123090] Updated weights for policy 1, policy_version 749506 (0.0009) [2023-12-26 05:36:50,509][123090] Updated weights for policy 1, policy_version 749516 (0.0006) [2023-12-26 05:36:50,566][123090] Updated weights for policy 1, policy_version 749526 (0.0010) [2023-12-26 05:36:50,640][123090] Updated weights for policy 1, policy_version 749536 (0.0008) [2023-12-26 05:36:50,760][123091] Updated weights for policy 0, policy_version 754264 (0.0007) [2023-12-26 05:36:50,820][123091] Updated weights for policy 0, policy_version 754274 (0.0010) [2023-12-26 05:36:50,883][123091] Updated weights for policy 0, policy_version 754284 (0.0009) [2023-12-26 05:36:51,416][123090] Updated weights for policy 1, policy_version 749546 (0.0010) [2023-12-26 05:36:51,467][123090] Updated weights for policy 1, policy_version 749556 (0.0009) [2023-12-26 05:36:51,517][123090] Updated weights for policy 1, policy_version 749566 (0.0009) [2023-12-26 05:36:51,737][123091] Updated weights for policy 0, policy_version 754294 (0.0010) [2023-12-26 05:36:51,803][123091] Updated weights for policy 0, policy_version 754304 (0.0008) [2023-12-26 05:36:51,859][123091] Updated weights for policy 0, policy_version 754314 (0.0009) [2023-12-26 05:36:52,368][123090] Updated weights for policy 1, policy_version 749576 (0.0009) [2023-12-26 05:36:52,433][123090] Updated weights for policy 1, policy_version 749586 (0.0010) [2023-12-26 05:36:52,500][123090] Updated weights for policy 1, policy_version 749596 (0.0010) [2023-12-26 05:36:52,659][123091] Updated weights for policy 0, policy_version 754324 (0.0008) [2023-12-26 05:36:52,726][123091] Updated weights for policy 0, policy_version 754334 (0.0006) [2023-12-26 05:36:52,798][123091] Updated weights for policy 0, policy_version 754344 (0.0006) [2023-12-26 05:36:53,352][123090] Updated weights for policy 1, policy_version 749606 (0.0009) [2023-12-26 05:36:53,408][123090] Updated weights for policy 1, policy_version 749616 (0.0009) [2023-12-26 05:36:53,464][123090] Updated weights for policy 1, policy_version 749626 (0.0008) [2023-12-26 05:36:53,566][123091] Updated weights for policy 0, policy_version 754354 (0.0008) [2023-12-26 05:36:53,625][123091] Updated weights for policy 0, policy_version 754364 (0.0009) [2023-12-26 05:36:53,680][123091] Updated weights for policy 0, policy_version 754374 (0.0009) [2023-12-26 05:36:53,727][123091] Updated weights for policy 0, policy_version 754384 (0.0009) [2023-12-26 05:36:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 385032192. Throughput: 0: 8820.0, 1: 8797.4. Samples: 385004052. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:36:53,785][121949] Avg episode reward: [(0, '5965.649'), (1, '5288.928')] [2023-12-26 05:36:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000754384_193126400.pth... [2023-12-26 05:36:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000749632_191905792.pth... [2023-12-26 05:36:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000753328_192856064.pth [2023-12-26 05:36:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000748576_191635456.pth [2023-12-26 05:36:54,339][123090] Updated weights for policy 1, policy_version 749636 (0.0009) [2023-12-26 05:36:54,397][123090] Updated weights for policy 1, policy_version 749646 (0.0009) [2023-12-26 05:36:54,458][123090] Updated weights for policy 1, policy_version 749656 (0.0010) [2023-12-26 05:36:54,536][123091] Updated weights for policy 0, policy_version 754394 (0.0009) [2023-12-26 05:36:54,602][123091] Updated weights for policy 0, policy_version 754404 (0.0008) [2023-12-26 05:36:54,671][123091] Updated weights for policy 0, policy_version 754414 (0.0007) [2023-12-26 05:36:55,282][123090] Updated weights for policy 1, policy_version 749666 (0.0008) [2023-12-26 05:36:55,314][123091] Updated weights for policy 0, policy_version 754424 (0.0008) [2023-12-26 05:36:55,330][123090] Updated weights for policy 1, policy_version 749676 (0.0007) [2023-12-26 05:36:55,358][123091] Updated weights for policy 0, policy_version 754434 (0.0008) [2023-12-26 05:36:55,383][123090] Updated weights for policy 1, policy_version 749686 (0.0007) [2023-12-26 05:36:55,415][123091] Updated weights for policy 0, policy_version 754444 (0.0010) [2023-12-26 05:36:55,441][123090] Updated weights for policy 1, policy_version 749696 (0.0007) [2023-12-26 05:36:56,078][123091] Updated weights for policy 0, policy_version 754454 (0.0010) [2023-12-26 05:36:56,145][123091] Updated weights for policy 0, policy_version 754464 (0.0010) [2023-12-26 05:36:56,207][123091] Updated weights for policy 0, policy_version 754474 (0.0009) [2023-12-26 05:36:56,331][123090] Updated weights for policy 1, policy_version 749706 (0.0005) [2023-12-26 05:36:56,392][123090] Updated weights for policy 1, policy_version 749716 (0.0005) [2023-12-26 05:36:56,446][123090] Updated weights for policy 1, policy_version 749726 (0.0007) [2023-12-26 05:36:56,987][123091] Updated weights for policy 0, policy_version 754484 (0.0009) [2023-12-26 05:36:57,047][123091] Updated weights for policy 0, policy_version 754494 (0.0010) [2023-12-26 05:36:57,108][123091] Updated weights for policy 0, policy_version 754504 (0.0009) [2023-12-26 05:36:57,261][123090] Updated weights for policy 1, policy_version 749736 (0.0010) [2023-12-26 05:36:57,320][123090] Updated weights for policy 1, policy_version 749746 (0.0010) [2023-12-26 05:36:57,372][123090] Updated weights for policy 1, policy_version 749756 (0.0009) [2023-12-26 05:36:57,917][123091] Updated weights for policy 0, policy_version 754514 (0.0009) [2023-12-26 05:36:57,979][123091] Updated weights for policy 0, policy_version 754525 (0.0009) [2023-12-26 05:36:58,044][123091] Updated weights for policy 0, policy_version 754535 (0.0007) [2023-12-26 05:36:58,181][123090] Updated weights for policy 1, policy_version 749766 (0.0007) [2023-12-26 05:36:58,240][123090] Updated weights for policy 1, policy_version 749776 (0.0006) [2023-12-26 05:36:58,300][123090] Updated weights for policy 1, policy_version 749786 (0.0007) [2023-12-26 05:36:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 385114112. Throughput: 0: 8911.2, 1: 8817.8. Samples: 385110452. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:36:58,785][121949] Avg episode reward: [(0, '5836.574'), (1, '5459.516')] [2023-12-26 05:36:58,955][123091] Updated weights for policy 0, policy_version 754545 (0.0008) [2023-12-26 05:36:59,010][123091] Updated weights for policy 0, policy_version 754555 (0.0010) [2023-12-26 05:36:59,063][123091] Updated weights for policy 0, policy_version 754565 (0.0009) [2023-12-26 05:36:59,087][123090] Updated weights for policy 1, policy_version 749796 (0.0009) [2023-12-26 05:36:59,124][123091] Updated weights for policy 0, policy_version 754575 (0.0008) [2023-12-26 05:36:59,135][123090] Updated weights for policy 1, policy_version 749806 (0.0009) [2023-12-26 05:36:59,186][123090] Updated weights for policy 1, policy_version 749816 (0.0009) [2023-12-26 05:37:00,007][123091] Updated weights for policy 0, policy_version 754585 (0.0009) [2023-12-26 05:37:00,067][123091] Updated weights for policy 0, policy_version 754595 (0.0009) [2023-12-26 05:37:00,096][123090] Updated weights for policy 1, policy_version 749826 (0.0009) [2023-12-26 05:37:00,129][123091] Updated weights for policy 0, policy_version 754605 (0.0007) [2023-12-26 05:37:00,153][123090] Updated weights for policy 1, policy_version 749836 (0.0010) [2023-12-26 05:37:00,201][123090] Updated weights for policy 1, policy_version 749846 (0.0010) [2023-12-26 05:37:00,256][123090] Updated weights for policy 1, policy_version 749856 (0.0010) [2023-12-26 05:37:00,970][123091] Updated weights for policy 0, policy_version 754615 (0.0008) [2023-12-26 05:37:01,021][123091] Updated weights for policy 0, policy_version 754625 (0.0008) [2023-12-26 05:37:01,096][123091] Updated weights for policy 0, policy_version 754635 (0.0008) [2023-12-26 05:37:01,104][123090] Updated weights for policy 1, policy_version 749866 (0.0008) [2023-12-26 05:37:01,173][123090] Updated weights for policy 1, policy_version 749876 (0.0009) [2023-12-26 05:37:01,234][123090] Updated weights for policy 1, policy_version 749886 (0.0008) [2023-12-26 05:37:01,929][123091] Updated weights for policy 0, policy_version 754645 (0.0009) [2023-12-26 05:37:01,980][123091] Updated weights for policy 0, policy_version 754655 (0.0010) [2023-12-26 05:37:02,038][123091] Updated weights for policy 0, policy_version 754667 (0.0009) [2023-12-26 05:37:02,082][123090] Updated weights for policy 1, policy_version 749896 (0.0008) [2023-12-26 05:37:02,150][123090] Updated weights for policy 1, policy_version 749906 (0.0010) [2023-12-26 05:37:02,206][123090] Updated weights for policy 1, policy_version 749916 (0.0005) [2023-12-26 05:37:02,841][123091] Updated weights for policy 0, policy_version 754677 (0.0007) [2023-12-26 05:37:02,893][123091] Updated weights for policy 0, policy_version 754687 (0.0005) [2023-12-26 05:37:02,952][123091] Updated weights for policy 0, policy_version 754697 (0.0005) [2023-12-26 05:37:03,037][123090] Updated weights for policy 1, policy_version 749926 (0.0008) [2023-12-26 05:37:03,106][123090] Updated weights for policy 1, policy_version 749936 (0.0008) [2023-12-26 05:37:03,164][123090] Updated weights for policy 1, policy_version 749946 (0.0010) [2023-12-26 05:37:03,605][123091] Updated weights for policy 0, policy_version 754707 (0.0006) [2023-12-26 05:37:03,661][123091] Updated weights for policy 0, policy_version 754717 (0.0005) [2023-12-26 05:37:03,726][123091] Updated weights for policy 0, policy_version 754727 (0.0007) [2023-12-26 05:37:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 385204224. Throughput: 0: 8925.0, 1: 8822.8. Samples: 385215160. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:03,785][121949] Avg episode reward: [(0, '5918.496'), (1, '5245.803')] [2023-12-26 05:37:03,908][123090] Updated weights for policy 1, policy_version 749957 (0.0009) [2023-12-26 05:37:03,970][123090] Updated weights for policy 1, policy_version 749967 (0.0008) [2023-12-26 05:37:04,036][123090] Updated weights for policy 1, policy_version 749977 (0.0008) [2023-12-26 05:37:04,421][123091] Updated weights for policy 0, policy_version 754737 (0.0008) [2023-12-26 05:37:04,469][123091] Updated weights for policy 0, policy_version 754747 (0.0010) [2023-12-26 05:37:04,528][123091] Updated weights for policy 0, policy_version 754757 (0.0011) [2023-12-26 05:37:04,588][123091] Updated weights for policy 0, policy_version 754767 (0.0011) [2023-12-26 05:37:04,662][123090] Updated weights for policy 1, policy_version 749987 (0.0007) [2023-12-26 05:37:04,734][123090] Updated weights for policy 1, policy_version 749997 (0.0006) [2023-12-26 05:37:04,812][123090] Updated weights for policy 1, policy_version 750007 (0.0005) [2023-12-26 05:37:05,402][123091] Updated weights for policy 0, policy_version 754777 (0.0009) [2023-12-26 05:37:05,449][123091] Updated weights for policy 0, policy_version 754787 (0.0010) [2023-12-26 05:37:05,513][123091] Updated weights for policy 0, policy_version 754797 (0.0009) [2023-12-26 05:37:05,526][123090] Updated weights for policy 1, policy_version 750017 (0.0006) [2023-12-26 05:37:05,589][123090] Updated weights for policy 1, policy_version 750027 (0.0010) [2023-12-26 05:37:05,644][123090] Updated weights for policy 1, policy_version 750037 (0.0010) [2023-12-26 05:37:05,701][123090] Updated weights for policy 1, policy_version 750047 (0.0006) [2023-12-26 05:37:06,297][123091] Updated weights for policy 0, policy_version 754807 (0.0007) [2023-12-26 05:37:06,358][123091] Updated weights for policy 0, policy_version 754817 (0.0006) [2023-12-26 05:37:06,380][123090] Updated weights for policy 1, policy_version 750057 (0.0010) [2023-12-26 05:37:06,419][123091] Updated weights for policy 0, policy_version 754827 (0.0005) [2023-12-26 05:37:06,451][123090] Updated weights for policy 1, policy_version 750067 (0.0011) [2023-12-26 05:37:06,523][123090] Updated weights for policy 1, policy_version 750077 (0.0011) [2023-12-26 05:37:07,195][123091] Updated weights for policy 0, policy_version 754837 (0.0006) [2023-12-26 05:37:07,251][123091] Updated weights for policy 0, policy_version 754847 (0.0005) [2023-12-26 05:37:07,264][123090] Updated weights for policy 1, policy_version 750087 (0.0007) [2023-12-26 05:37:07,324][123091] Updated weights for policy 0, policy_version 754857 (0.0005) [2023-12-26 05:37:07,327][123090] Updated weights for policy 1, policy_version 750097 (0.0005) [2023-12-26 05:37:07,390][123090] Updated weights for policy 1, policy_version 750107 (0.0006) [2023-12-26 05:37:07,925][123091] Updated weights for policy 0, policy_version 754867 (0.0006) [2023-12-26 05:37:07,972][123091] Updated weights for policy 0, policy_version 754877 (0.0005) [2023-12-26 05:37:08,034][123091] Updated weights for policy 0, policy_version 754887 (0.0006) [2023-12-26 05:37:08,053][123090] Updated weights for policy 1, policy_version 750117 (0.0005) [2023-12-26 05:37:08,109][123090] Updated weights for policy 1, policy_version 750127 (0.0005) [2023-12-26 05:37:08,160][123090] Updated weights for policy 1, policy_version 750137 (0.0008) [2023-12-26 05:37:08,760][123091] Updated weights for policy 0, policy_version 754897 (0.0006) [2023-12-26 05:37:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 385294336. Throughput: 0: 8968.5, 1: 8921.4. Samples: 385271536. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:08,785][121949] Avg episode reward: [(0, '6087.083'), (1, '5080.412')] [2023-12-26 05:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000750144_192036864.pth... [2023-12-26 05:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000749120_191774720.pth [2023-12-26 05:37:08,822][123091] Updated weights for policy 0, policy_version 754907 (0.0008) [2023-12-26 05:37:08,885][123091] Updated weights for policy 0, policy_version 754917 (0.0006) [2023-12-26 05:37:08,958][123091] Updated weights for policy 0, policy_version 754927 (0.0007) [2023-12-26 05:37:08,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000754928_193265664.pth... [2023-12-26 05:37:08,962][123090] Updated weights for policy 1, policy_version 750147 (0.0010) [2023-12-26 05:37:08,965][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000753840_192987136.pth [2023-12-26 05:37:09,021][123090] Updated weights for policy 1, policy_version 750157 (0.0010) [2023-12-26 05:37:09,091][123090] Updated weights for policy 1, policy_version 750167 (0.0010) [2023-12-26 05:37:09,760][123091] Updated weights for policy 0, policy_version 754937 (0.0010) [2023-12-26 05:37:09,821][123091] Updated weights for policy 0, policy_version 754947 (0.0009) [2023-12-26 05:37:09,891][123091] Updated weights for policy 0, policy_version 754957 (0.0010) [2023-12-26 05:37:09,912][123090] Updated weights for policy 1, policy_version 750177 (0.0010) [2023-12-26 05:37:09,982][123090] Updated weights for policy 1, policy_version 750187 (0.0009) [2023-12-26 05:37:10,049][123090] Updated weights for policy 1, policy_version 750197 (0.0009) [2023-12-26 05:37:10,105][123090] Updated weights for policy 1, policy_version 750207 (0.0009) [2023-12-26 05:37:10,730][123091] Updated weights for policy 0, policy_version 754967 (0.0010) [2023-12-26 05:37:10,802][123091] Updated weights for policy 0, policy_version 754977 (0.0010) [2023-12-26 05:37:10,866][123091] Updated weights for policy 0, policy_version 754987 (0.0011) [2023-12-26 05:37:10,981][123090] Updated weights for policy 1, policy_version 750217 (0.0010) [2023-12-26 05:37:11,048][123090] Updated weights for policy 1, policy_version 750227 (0.0010) [2023-12-26 05:37:11,115][123090] Updated weights for policy 1, policy_version 750237 (0.0008) [2023-12-26 05:37:11,750][123091] Updated weights for policy 0, policy_version 754997 (0.0008) [2023-12-26 05:37:11,815][123091] Updated weights for policy 0, policy_version 755007 (0.0009) [2023-12-26 05:37:11,869][123091] Updated weights for policy 0, policy_version 755017 (0.0009) [2023-12-26 05:37:11,925][123090] Updated weights for policy 1, policy_version 750247 (0.0009) [2023-12-26 05:37:11,980][123090] Updated weights for policy 1, policy_version 750257 (0.0008) [2023-12-26 05:37:12,037][123090] Updated weights for policy 1, policy_version 750267 (0.0008) [2023-12-26 05:37:12,682][123091] Updated weights for policy 0, policy_version 755027 (0.0008) [2023-12-26 05:37:12,730][123091] Updated weights for policy 0, policy_version 755037 (0.0010) [2023-12-26 05:37:12,786][123091] Updated weights for policy 0, policy_version 755047 (0.0011) [2023-12-26 05:37:12,917][123090] Updated weights for policy 1, policy_version 750277 (0.0008) [2023-12-26 05:37:12,978][123090] Updated weights for policy 1, policy_version 750287 (0.0009) [2023-12-26 05:37:13,027][123090] Updated weights for policy 1, policy_version 750297 (0.0009) [2023-12-26 05:37:13,522][123091] Updated weights for policy 0, policy_version 755057 (0.0010) [2023-12-26 05:37:13,597][123091] Updated weights for policy 0, policy_version 755067 (0.0006) [2023-12-26 05:37:13,670][123091] Updated weights for policy 0, policy_version 755077 (0.0006) [2023-12-26 05:37:13,742][123091] Updated weights for policy 0, policy_version 755087 (0.0005) [2023-12-26 05:37:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 385384448. Throughput: 0: 8964.8, 1: 8854.0. Samples: 385377776. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:13,784][121949] Avg episode reward: [(0, '5891.272'), (1, '5089.639')] [2023-12-26 05:37:13,857][123090] Updated weights for policy 1, policy_version 750307 (0.0008) [2023-12-26 05:37:13,928][123090] Updated weights for policy 1, policy_version 750317 (0.0009) [2023-12-26 05:37:13,992][123090] Updated weights for policy 1, policy_version 750327 (0.0010) [2023-12-26 05:37:14,349][123091] Updated weights for policy 0, policy_version 755097 (0.0005) [2023-12-26 05:37:14,401][123091] Updated weights for policy 0, policy_version 755107 (0.0006) [2023-12-26 05:37:14,450][123091] Updated weights for policy 0, policy_version 755117 (0.0005) [2023-12-26 05:37:14,885][123090] Updated weights for policy 1, policy_version 750337 (0.0010) [2023-12-26 05:37:14,955][123090] Updated weights for policy 1, policy_version 750347 (0.0009) [2023-12-26 05:37:15,026][123090] Updated weights for policy 1, policy_version 750357 (0.0010) [2023-12-26 05:37:15,093][123090] Updated weights for policy 1, policy_version 750367 (0.0009) [2023-12-26 05:37:15,139][123091] Updated weights for policy 0, policy_version 755127 (0.0007) [2023-12-26 05:37:15,189][123091] Updated weights for policy 0, policy_version 755137 (0.0009) [2023-12-26 05:37:15,253][123091] Updated weights for policy 0, policy_version 755147 (0.0007) [2023-12-26 05:37:15,873][123090] Updated weights for policy 1, policy_version 750377 (0.0008) [2023-12-26 05:37:15,922][123090] Updated weights for policy 1, policy_version 750387 (0.0005) [2023-12-26 05:37:15,978][123090] Updated weights for policy 1, policy_version 750397 (0.0006) [2023-12-26 05:37:15,979][123091] Updated weights for policy 0, policy_version 755157 (0.0009) [2023-12-26 05:37:16,029][123091] Updated weights for policy 0, policy_version 755167 (0.0009) [2023-12-26 05:37:16,082][123091] Updated weights for policy 0, policy_version 755177 (0.0005) [2023-12-26 05:37:16,662][123090] Updated weights for policy 1, policy_version 750407 (0.0005) [2023-12-26 05:37:16,726][123090] Updated weights for policy 1, policy_version 750417 (0.0006) [2023-12-26 05:37:16,777][123091] Updated weights for policy 0, policy_version 755187 (0.0006) [2023-12-26 05:37:16,793][123090] Updated weights for policy 1, policy_version 750427 (0.0006) [2023-12-26 05:37:16,826][123091] Updated weights for policy 0, policy_version 755197 (0.0007) [2023-12-26 05:37:16,882][123091] Updated weights for policy 0, policy_version 755207 (0.0009) [2023-12-26 05:37:17,475][123090] Updated weights for policy 1, policy_version 750437 (0.0009) [2023-12-26 05:37:17,540][123090] Updated weights for policy 1, policy_version 750447 (0.0009) [2023-12-26 05:37:17,610][123090] Updated weights for policy 1, policy_version 750457 (0.0010) [2023-12-26 05:37:17,756][123091] Updated weights for policy 0, policy_version 755217 (0.0009) [2023-12-26 05:37:17,827][123091] Updated weights for policy 0, policy_version 755227 (0.0006) [2023-12-26 05:37:17,895][123091] Updated weights for policy 0, policy_version 755237 (0.0005) [2023-12-26 05:37:17,955][123091] Updated weights for policy 0, policy_version 755247 (0.0005) [2023-12-26 05:37:18,467][123090] Updated weights for policy 1, policy_version 750467 (0.0009) [2023-12-26 05:37:18,524][123090] Updated weights for policy 1, policy_version 750477 (0.0009) [2023-12-26 05:37:18,574][123090] Updated weights for policy 1, policy_version 750487 (0.0009) [2023-12-26 05:37:18,639][123091] Updated weights for policy 0, policy_version 755257 (0.0008) [2023-12-26 05:37:18,692][123091] Updated weights for policy 0, policy_version 755267 (0.0009) [2023-12-26 05:37:18,755][123091] Updated weights for policy 0, policy_version 755277 (0.0009) [2023-12-26 05:37:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 385482752. Throughput: 0: 9066.1, 1: 8843.0. Samples: 385487732. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:18,785][121949] Avg episode reward: [(0, '5995.721'), (1, '5270.386')] [2023-12-26 05:37:19,459][123090] Updated weights for policy 1, policy_version 750497 (0.0009) [2023-12-26 05:37:19,525][123090] Updated weights for policy 1, policy_version 750507 (0.0009) [2023-12-26 05:37:19,589][123090] Updated weights for policy 1, policy_version 750517 (0.0009) [2023-12-26 05:37:19,622][123091] Updated weights for policy 0, policy_version 755287 (0.0009) [2023-12-26 05:37:19,654][123090] Updated weights for policy 1, policy_version 750527 (0.0009) [2023-12-26 05:37:19,687][123091] Updated weights for policy 0, policy_version 755297 (0.0007) [2023-12-26 05:37:19,746][123091] Updated weights for policy 0, policy_version 755307 (0.0010) [2023-12-26 05:37:20,417][123090] Updated weights for policy 1, policy_version 750537 (0.0005) [2023-12-26 05:37:20,494][123090] Updated weights for policy 1, policy_version 750547 (0.0006) [2023-12-26 05:37:20,561][123090] Updated weights for policy 1, policy_version 750557 (0.0006) [2023-12-26 05:37:20,661][123091] Updated weights for policy 0, policy_version 755317 (0.0009) [2023-12-26 05:37:20,736][123091] Updated weights for policy 0, policy_version 755327 (0.0006) [2023-12-26 05:37:20,802][123091] Updated weights for policy 0, policy_version 755337 (0.0008) [2023-12-26 05:37:21,412][123090] Updated weights for policy 1, policy_version 750567 (0.0010) [2023-12-26 05:37:21,466][123090] Updated weights for policy 1, policy_version 750577 (0.0009) [2023-12-26 05:37:21,515][123090] Updated weights for policy 1, policy_version 750587 (0.0010) [2023-12-26 05:37:21,638][123091] Updated weights for policy 0, policy_version 755347 (0.0009) [2023-12-26 05:37:21,708][123091] Updated weights for policy 0, policy_version 755357 (0.0009) [2023-12-26 05:37:21,774][123091] Updated weights for policy 0, policy_version 755367 (0.0011) [2023-12-26 05:37:22,305][123090] Updated weights for policy 1, policy_version 750597 (0.0011) [2023-12-26 05:37:22,374][123090] Updated weights for policy 1, policy_version 750607 (0.0010) [2023-12-26 05:37:22,433][123090] Updated weights for policy 1, policy_version 750617 (0.0010) [2023-12-26 05:37:22,663][123091] Updated weights for policy 0, policy_version 755377 (0.0010) [2023-12-26 05:37:22,720][123091] Updated weights for policy 0, policy_version 755387 (0.0010) [2023-12-26 05:37:22,778][123091] Updated weights for policy 0, policy_version 755397 (0.0010) [2023-12-26 05:37:22,834][123091] Updated weights for policy 0, policy_version 755407 (0.0010) [2023-12-26 05:37:23,045][123090] Updated weights for policy 1, policy_version 750627 (0.0009) [2023-12-26 05:37:23,121][123090] Updated weights for policy 1, policy_version 750637 (0.0005) [2023-12-26 05:37:23,185][123090] Updated weights for policy 1, policy_version 750647 (0.0006) [2023-12-26 05:37:23,708][123091] Updated weights for policy 0, policy_version 755417 (0.0009) [2023-12-26 05:37:23,779][123091] Updated weights for policy 0, policy_version 755427 (0.0008) [2023-12-26 05:37:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 385556480. Throughput: 0: 9006.7, 1: 8761.9. Samples: 385537528. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:23,785][121949] Avg episode reward: [(0, '6201.594'), (1, '5430.701')] [2023-12-26 05:37:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000750656_192167936.pth... [2023-12-26 05:37:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000749632_191905792.pth [2023-12-26 05:37:23,841][123091] Updated weights for policy 0, policy_version 755437 (0.0009) [2023-12-26 05:37:23,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000755440_193396736.pth... [2023-12-26 05:37:23,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000754384_193126400.pth [2023-12-26 05:37:23,939][123090] Updated weights for policy 1, policy_version 750657 (0.0007) [2023-12-26 05:37:23,990][123090] Updated weights for policy 1, policy_version 750667 (0.0007) [2023-12-26 05:37:24,043][123090] Updated weights for policy 1, policy_version 750678 (0.0010) [2023-12-26 05:37:24,091][123090] Updated weights for policy 1, policy_version 750688 (0.0008) [2023-12-26 05:37:24,727][123091] Updated weights for policy 0, policy_version 755447 (0.0009) [2023-12-26 05:37:24,779][123091] Updated weights for policy 0, policy_version 755457 (0.0009) [2023-12-26 05:37:24,832][123090] Updated weights for policy 1, policy_version 750698 (0.0006) [2023-12-26 05:37:24,836][123091] Updated weights for policy 0, policy_version 755467 (0.0009) [2023-12-26 05:37:24,886][123090] Updated weights for policy 1, policy_version 750708 (0.0007) [2023-12-26 05:37:24,943][123090] Updated weights for policy 1, policy_version 750718 (0.0005) [2023-12-26 05:37:25,588][123090] Updated weights for policy 1, policy_version 750728 (0.0009) [2023-12-26 05:37:25,619][123091] Updated weights for policy 0, policy_version 755477 (0.0006) [2023-12-26 05:37:25,636][123090] Updated weights for policy 1, policy_version 750738 (0.0010) [2023-12-26 05:37:25,673][123091] Updated weights for policy 0, policy_version 755487 (0.0006) [2023-12-26 05:37:25,688][123090] Updated weights for policy 1, policy_version 750748 (0.0010) [2023-12-26 05:37:25,729][123091] Updated weights for policy 0, policy_version 755497 (0.0007) [2023-12-26 05:37:26,413][123091] Updated weights for policy 0, policy_version 755507 (0.0006) [2023-12-26 05:37:26,463][123091] Updated weights for policy 0, policy_version 755517 (0.0005) [2023-12-26 05:37:26,514][123091] Updated weights for policy 0, policy_version 755527 (0.0008) [2023-12-26 05:37:26,539][123090] Updated weights for policy 1, policy_version 750758 (0.0010) [2023-12-26 05:37:26,604][123090] Updated weights for policy 1, policy_version 750768 (0.0009) [2023-12-26 05:37:26,662][123090] Updated weights for policy 1, policy_version 750778 (0.0010) [2023-12-26 05:37:27,186][123091] Updated weights for policy 0, policy_version 755537 (0.0007) [2023-12-26 05:37:27,263][123091] Updated weights for policy 0, policy_version 755547 (0.0005) [2023-12-26 05:37:27,325][123091] Updated weights for policy 0, policy_version 755557 (0.0007) [2023-12-26 05:37:27,344][123090] Updated weights for policy 1, policy_version 750788 (0.0008) [2023-12-26 05:37:27,373][123091] Updated weights for policy 0, policy_version 755567 (0.0008) [2023-12-26 05:37:27,399][123090] Updated weights for policy 1, policy_version 750798 (0.0006) [2023-12-26 05:37:27,458][123090] Updated weights for policy 1, policy_version 750808 (0.0006) [2023-12-26 05:37:27,961][123091] Updated weights for policy 0, policy_version 755577 (0.0005) [2023-12-26 05:37:28,011][123091] Updated weights for policy 0, policy_version 755587 (0.0005) [2023-12-26 05:37:28,066][123091] Updated weights for policy 0, policy_version 755597 (0.0005) [2023-12-26 05:37:28,268][123090] Updated weights for policy 1, policy_version 750818 (0.0008) [2023-12-26 05:37:28,323][123090] Updated weights for policy 1, policy_version 750828 (0.0010) [2023-12-26 05:37:28,382][123090] Updated weights for policy 1, policy_version 750838 (0.0011) [2023-12-26 05:37:28,445][123090] Updated weights for policy 1, policy_version 750848 (0.0010) [2023-12-26 05:37:28,718][123091] Updated weights for policy 0, policy_version 755607 (0.0005) [2023-12-26 05:37:28,783][123091] Updated weights for policy 0, policy_version 755617 (0.0005) [2023-12-26 05:37:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 385654784. Throughput: 0: 9035.9, 1: 8874.1. Samples: 385648816. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:28,785][121949] Avg episode reward: [(0, '6034.989'), (1, '5463.712')] [2023-12-26 05:37:28,853][123091] Updated weights for policy 0, policy_version 755627 (0.0007) [2023-12-26 05:37:29,261][123090] Updated weights for policy 1, policy_version 750858 (0.0007) [2023-12-26 05:37:29,315][123090] Updated weights for policy 1, policy_version 750868 (0.0008) [2023-12-26 05:37:29,387][123090] Updated weights for policy 1, policy_version 750878 (0.0007) [2023-12-26 05:37:29,667][123091] Updated weights for policy 0, policy_version 755637 (0.0010) [2023-12-26 05:37:29,737][123091] Updated weights for policy 0, policy_version 755647 (0.0010) [2023-12-26 05:37:29,799][123091] Updated weights for policy 0, policy_version 755657 (0.0010) [2023-12-26 05:37:30,166][123090] Updated weights for policy 1, policy_version 750888 (0.0010) [2023-12-26 05:37:30,221][123090] Updated weights for policy 1, policy_version 750898 (0.0010) [2023-12-26 05:37:30,272][123090] Updated weights for policy 1, policy_version 750908 (0.0010) [2023-12-26 05:37:30,614][123091] Updated weights for policy 0, policy_version 755667 (0.0010) [2023-12-26 05:37:30,680][123091] Updated weights for policy 0, policy_version 755677 (0.0011) [2023-12-26 05:37:30,746][123091] Updated weights for policy 0, policy_version 755687 (0.0011) [2023-12-26 05:37:31,020][123090] Updated weights for policy 1, policy_version 750918 (0.0008) [2023-12-26 05:37:31,090][123090] Updated weights for policy 1, policy_version 750928 (0.0007) [2023-12-26 05:37:31,165][123090] Updated weights for policy 1, policy_version 750938 (0.0008) [2023-12-26 05:37:31,538][123091] Updated weights for policy 0, policy_version 755697 (0.0011) [2023-12-26 05:37:31,594][123091] Updated weights for policy 0, policy_version 755707 (0.0009) [2023-12-26 05:37:31,662][123091] Updated weights for policy 0, policy_version 755717 (0.0008) [2023-12-26 05:37:31,734][123091] Updated weights for policy 0, policy_version 755727 (0.0008) [2023-12-26 05:37:31,949][123090] Updated weights for policy 1, policy_version 750948 (0.0009) [2023-12-26 05:37:32,000][123090] Updated weights for policy 1, policy_version 750958 (0.0006) [2023-12-26 05:37:32,057][123090] Updated weights for policy 1, policy_version 750968 (0.0007) [2023-12-26 05:37:32,484][123091] Updated weights for policy 0, policy_version 755737 (0.0010) [2023-12-26 05:37:32,537][123091] Updated weights for policy 0, policy_version 755747 (0.0009) [2023-12-26 05:37:32,599][123091] Updated weights for policy 0, policy_version 755757 (0.0009) [2023-12-26 05:37:32,775][123090] Updated weights for policy 1, policy_version 750978 (0.0009) [2023-12-26 05:37:32,841][123090] Updated weights for policy 1, policy_version 750988 (0.0009) [2023-12-26 05:37:32,892][123090] Updated weights for policy 1, policy_version 750998 (0.0009) [2023-12-26 05:37:32,945][123090] Updated weights for policy 1, policy_version 751008 (0.0009) [2023-12-26 05:37:33,395][123091] Updated weights for policy 0, policy_version 755767 (0.0010) [2023-12-26 05:37:33,462][123091] Updated weights for policy 0, policy_version 755778 (0.0011) [2023-12-26 05:37:33,514][123091] Updated weights for policy 0, policy_version 755788 (0.0010) [2023-12-26 05:37:33,762][123090] Updated weights for policy 1, policy_version 751018 (0.0008) [2023-12-26 05:37:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 385744896. Throughput: 0: 8991.2, 1: 8901.7. Samples: 385757748. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:33,785][121949] Avg episode reward: [(0, '5884.828'), (1, '5567.065')] [2023-12-26 05:37:33,822][123090] Updated weights for policy 1, policy_version 751028 (0.0008) [2023-12-26 05:37:33,885][123090] Updated weights for policy 1, policy_version 751038 (0.0009) [2023-12-26 05:37:34,327][123091] Updated weights for policy 0, policy_version 755798 (0.0011) [2023-12-26 05:37:34,386][123091] Updated weights for policy 0, policy_version 755808 (0.0011) [2023-12-26 05:37:34,438][123091] Updated weights for policy 0, policy_version 755818 (0.0011) [2023-12-26 05:37:34,683][123090] Updated weights for policy 1, policy_version 751048 (0.0009) [2023-12-26 05:37:34,734][123090] Updated weights for policy 1, policy_version 751058 (0.0010) [2023-12-26 05:37:34,790][123090] Updated weights for policy 1, policy_version 751068 (0.0009) [2023-12-26 05:37:35,233][123091] Updated weights for policy 0, policy_version 755828 (0.0008) [2023-12-26 05:37:35,292][123091] Updated weights for policy 0, policy_version 755838 (0.0005) [2023-12-26 05:37:35,345][123091] Updated weights for policy 0, policy_version 755848 (0.0005) [2023-12-26 05:37:35,507][123090] Updated weights for policy 1, policy_version 751078 (0.0007) [2023-12-26 05:37:35,562][123090] Updated weights for policy 1, policy_version 751088 (0.0005) [2023-12-26 05:37:35,609][123090] Updated weights for policy 1, policy_version 751098 (0.0006) [2023-12-26 05:37:36,098][123091] Updated weights for policy 0, policy_version 755858 (0.0005) [2023-12-26 05:37:36,166][123091] Updated weights for policy 0, policy_version 755868 (0.0007) [2023-12-26 05:37:36,231][123091] Updated weights for policy 0, policy_version 755878 (0.0008) [2023-12-26 05:37:36,291][123091] Updated weights for policy 0, policy_version 755888 (0.0009) [2023-12-26 05:37:36,306][123090] Updated weights for policy 1, policy_version 751108 (0.0006) [2023-12-26 05:37:36,360][123090] Updated weights for policy 1, policy_version 751118 (0.0009) [2023-12-26 05:37:36,420][123090] Updated weights for policy 1, policy_version 751128 (0.0009) [2023-12-26 05:37:37,096][123091] Updated weights for policy 0, policy_version 755898 (0.0010) [2023-12-26 05:37:37,161][123091] Updated weights for policy 0, policy_version 755908 (0.0010) [2023-12-26 05:37:37,217][123091] Updated weights for policy 0, policy_version 755918 (0.0009) [2023-12-26 05:37:37,282][123090] Updated weights for policy 1, policy_version 751138 (0.0010) [2023-12-26 05:37:37,347][123090] Updated weights for policy 1, policy_version 751148 (0.0008) [2023-12-26 05:37:37,410][123090] Updated weights for policy 1, policy_version 751158 (0.0010) [2023-12-26 05:37:37,469][123090] Updated weights for policy 1, policy_version 751168 (0.0010) [2023-12-26 05:37:37,946][123091] Updated weights for policy 0, policy_version 755928 (0.0010) [2023-12-26 05:37:37,992][123091] Updated weights for policy 0, policy_version 755938 (0.0007) [2023-12-26 05:37:38,047][123091] Updated weights for policy 0, policy_version 755948 (0.0005) [2023-12-26 05:37:38,202][123090] Updated weights for policy 1, policy_version 751178 (0.0006) [2023-12-26 05:37:38,254][123090] Updated weights for policy 1, policy_version 751188 (0.0006) [2023-12-26 05:37:38,312][123090] Updated weights for policy 1, policy_version 751198 (0.0010) [2023-12-26 05:37:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 385835008. Throughput: 0: 9035.4, 1: 8949.1. Samples: 385813356. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:38,785][121949] Avg episode reward: [(0, '6018.956'), (1, '5611.143')] [2023-12-26 05:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000751200_192307200.pth... [2023-12-26 05:37:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000750144_192036864.pth [2023-12-26 05:37:38,803][123091] Updated weights for policy 0, policy_version 755958 (0.0009) [2023-12-26 05:37:38,871][123091] Updated weights for policy 0, policy_version 755968 (0.0011) [2023-12-26 05:37:38,941][123091] Updated weights for policy 0, policy_version 755978 (0.0010) [2023-12-26 05:37:38,981][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000755984_193536000.pth... [2023-12-26 05:37:38,986][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000754928_193265664.pth [2023-12-26 05:37:39,089][123090] Updated weights for policy 1, policy_version 751208 (0.0009) [2023-12-26 05:37:39,151][123090] Updated weights for policy 1, policy_version 751218 (0.0009) [2023-12-26 05:37:39,216][123090] Updated weights for policy 1, policy_version 751228 (0.0010) [2023-12-26 05:37:39,724][123091] Updated weights for policy 0, policy_version 755988 (0.0010) [2023-12-26 05:37:39,786][123091] Updated weights for policy 0, policy_version 755998 (0.0008) [2023-12-26 05:37:39,859][123091] Updated weights for policy 0, policy_version 756008 (0.0008) [2023-12-26 05:37:39,979][123090] Updated weights for policy 1, policy_version 751238 (0.0011) [2023-12-26 05:37:40,043][123090] Updated weights for policy 1, policy_version 751248 (0.0011) [2023-12-26 05:37:40,110][123090] Updated weights for policy 1, policy_version 751258 (0.0009) [2023-12-26 05:37:40,643][123091] Updated weights for policy 0, policy_version 756018 (0.0009) [2023-12-26 05:37:40,695][123091] Updated weights for policy 0, policy_version 756028 (0.0006) [2023-12-26 05:37:40,758][123091] Updated weights for policy 0, policy_version 756038 (0.0005) [2023-12-26 05:37:40,824][123091] Updated weights for policy 0, policy_version 756048 (0.0005) [2023-12-26 05:37:40,887][123090] Updated weights for policy 1, policy_version 751268 (0.0007) [2023-12-26 05:37:40,941][123090] Updated weights for policy 1, policy_version 751278 (0.0010) [2023-12-26 05:37:40,995][123090] Updated weights for policy 1, policy_version 751289 (0.0010) [2023-12-26 05:37:41,608][123091] Updated weights for policy 0, policy_version 756058 (0.0010) [2023-12-26 05:37:41,683][123091] Updated weights for policy 0, policy_version 756068 (0.0010) [2023-12-26 05:37:41,750][123091] Updated weights for policy 0, policy_version 756078 (0.0010) [2023-12-26 05:37:41,869][123090] Updated weights for policy 1, policy_version 751299 (0.0010) [2023-12-26 05:37:41,929][123090] Updated weights for policy 1, policy_version 751309 (0.0010) [2023-12-26 05:37:41,985][123090] Updated weights for policy 1, policy_version 751319 (0.0009) [2023-12-26 05:37:42,589][123091] Updated weights for policy 0, policy_version 756088 (0.0009) [2023-12-26 05:37:42,639][123091] Updated weights for policy 0, policy_version 756098 (0.0006) [2023-12-26 05:37:42,698][123091] Updated weights for policy 0, policy_version 756108 (0.0007) [2023-12-26 05:37:42,854][123090] Updated weights for policy 1, policy_version 751329 (0.0009) [2023-12-26 05:37:42,904][123090] Updated weights for policy 1, policy_version 751339 (0.0005) [2023-12-26 05:37:42,979][123090] Updated weights for policy 1, policy_version 751349 (0.0005) [2023-12-26 05:37:43,039][123090] Updated weights for policy 1, policy_version 751359 (0.0006) [2023-12-26 05:37:43,377][123091] Updated weights for policy 0, policy_version 756118 (0.0005) [2023-12-26 05:37:43,423][123091] Updated weights for policy 0, policy_version 756128 (0.0005) [2023-12-26 05:37:43,473][123091] Updated weights for policy 0, policy_version 756138 (0.0005) [2023-12-26 05:37:43,657][123090] Updated weights for policy 1, policy_version 751369 (0.0005) [2023-12-26 05:37:43,707][123090] Updated weights for policy 1, policy_version 751379 (0.0006) [2023-12-26 05:37:43,772][123090] Updated weights for policy 1, policy_version 751389 (0.0008) [2023-12-26 05:37:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 385925120. Throughput: 0: 9008.2, 1: 8960.4. Samples: 385919044. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:43,785][121949] Avg episode reward: [(0, '5996.529'), (1, '5629.332')] [2023-12-26 05:37:44,207][123091] Updated weights for policy 0, policy_version 756148 (0.0006) [2023-12-26 05:37:44,260][123091] Updated weights for policy 0, policy_version 756158 (0.0008) [2023-12-26 05:37:44,308][123091] Updated weights for policy 0, policy_version 756168 (0.0009) [2023-12-26 05:37:44,570][123090] Updated weights for policy 1, policy_version 751399 (0.0008) [2023-12-26 05:37:44,650][123090] Updated weights for policy 1, policy_version 751409 (0.0011) [2023-12-26 05:37:44,726][123090] Updated weights for policy 1, policy_version 751419 (0.0009) [2023-12-26 05:37:45,050][123091] Updated weights for policy 0, policy_version 756178 (0.0006) [2023-12-26 05:37:45,111][123091] Updated weights for policy 0, policy_version 756188 (0.0011) [2023-12-26 05:37:45,180][123091] Updated weights for policy 0, policy_version 756198 (0.0011) [2023-12-26 05:37:45,251][123091] Updated weights for policy 0, policy_version 756208 (0.0007) [2023-12-26 05:37:45,517][123090] Updated weights for policy 1, policy_version 751429 (0.0010) [2023-12-26 05:37:45,573][123090] Updated weights for policy 1, policy_version 751439 (0.0010) [2023-12-26 05:37:45,621][123090] Updated weights for policy 1, policy_version 751449 (0.0010) [2023-12-26 05:37:45,941][123091] Updated weights for policy 0, policy_version 756218 (0.0005) [2023-12-26 05:37:45,987][123091] Updated weights for policy 0, policy_version 756228 (0.0005) [2023-12-26 05:37:46,035][123091] Updated weights for policy 0, policy_version 756238 (0.0005) [2023-12-26 05:37:46,455][123090] Updated weights for policy 1, policy_version 751459 (0.0010) [2023-12-26 05:37:46,506][123090] Updated weights for policy 1, policy_version 751469 (0.0010) [2023-12-26 05:37:46,556][123090] Updated weights for policy 1, policy_version 751479 (0.0010) [2023-12-26 05:37:46,726][123091] Updated weights for policy 0, policy_version 756248 (0.0006) [2023-12-26 05:37:46,789][123091] Updated weights for policy 0, policy_version 756258 (0.0007) [2023-12-26 05:37:46,840][123091] Updated weights for policy 0, policy_version 756268 (0.0005) [2023-12-26 05:37:47,357][123090] Updated weights for policy 1, policy_version 751489 (0.0010) [2023-12-26 05:37:47,408][123090] Updated weights for policy 1, policy_version 751499 (0.0010) [2023-12-26 05:37:47,463][123090] Updated weights for policy 1, policy_version 751509 (0.0010) [2023-12-26 05:37:47,520][123090] Updated weights for policy 1, policy_version 751519 (0.0010) [2023-12-26 05:37:47,567][123091] Updated weights for policy 0, policy_version 756278 (0.0008) [2023-12-26 05:37:47,622][123091] Updated weights for policy 0, policy_version 756288 (0.0010) [2023-12-26 05:37:47,677][123091] Updated weights for policy 0, policy_version 756298 (0.0010) [2023-12-26 05:37:48,343][123090] Updated weights for policy 1, policy_version 751529 (0.0007) [2023-12-26 05:37:48,388][123091] Updated weights for policy 0, policy_version 756308 (0.0007) [2023-12-26 05:37:48,415][123090] Updated weights for policy 1, policy_version 751539 (0.0008) [2023-12-26 05:37:48,455][123091] Updated weights for policy 0, policy_version 756318 (0.0010) [2023-12-26 05:37:48,481][123090] Updated weights for policy 1, policy_version 751549 (0.0006) [2023-12-26 05:37:48,524][123091] Updated weights for policy 0, policy_version 756328 (0.0011) [2023-12-26 05:37:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 386023424. Throughput: 0: 9158.5, 1: 9010.0. Samples: 386032744. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:48,785][121949] Avg episode reward: [(0, '5947.103'), (1, '5530.856')] [2023-12-26 05:37:49,211][123090] Updated weights for policy 1, policy_version 751559 (0.0010) [2023-12-26 05:37:49,275][123090] Updated weights for policy 1, policy_version 751569 (0.0011) [2023-12-26 05:37:49,331][123090] Updated weights for policy 1, policy_version 751579 (0.0010) [2023-12-26 05:37:49,366][123091] Updated weights for policy 0, policy_version 756338 (0.0011) [2023-12-26 05:37:49,431][123091] Updated weights for policy 0, policy_version 756348 (0.0011) [2023-12-26 05:37:49,479][123091] Updated weights for policy 0, policy_version 756358 (0.0010) [2023-12-26 05:37:49,545][123091] Updated weights for policy 0, policy_version 756368 (0.0011) [2023-12-26 05:37:50,160][123090] Updated weights for policy 1, policy_version 751589 (0.0010) [2023-12-26 05:37:50,227][123090] Updated weights for policy 1, policy_version 751599 (0.0011) [2023-12-26 05:37:50,293][123090] Updated weights for policy 1, policy_version 751609 (0.0010) [2023-12-26 05:37:50,343][123091] Updated weights for policy 0, policy_version 756378 (0.0008) [2023-12-26 05:37:50,404][123091] Updated weights for policy 0, policy_version 756388 (0.0009) [2023-12-26 05:37:50,464][123091] Updated weights for policy 0, policy_version 756398 (0.0009) [2023-12-26 05:37:51,060][123090] Updated weights for policy 1, policy_version 751619 (0.0010) [2023-12-26 05:37:51,127][123090] Updated weights for policy 1, policy_version 751629 (0.0008) [2023-12-26 05:37:51,197][123090] Updated weights for policy 1, policy_version 751639 (0.0010) [2023-12-26 05:37:51,365][123091] Updated weights for policy 0, policy_version 756408 (0.0008) [2023-12-26 05:37:51,429][123091] Updated weights for policy 0, policy_version 756418 (0.0010) [2023-12-26 05:37:51,490][123091] Updated weights for policy 0, policy_version 756428 (0.0009) [2023-12-26 05:37:52,057][123090] Updated weights for policy 1, policy_version 751649 (0.0010) [2023-12-26 05:37:52,112][123090] Updated weights for policy 1, policy_version 751659 (0.0009) [2023-12-26 05:37:52,165][123090] Updated weights for policy 1, policy_version 751669 (0.0009) [2023-12-26 05:37:52,219][123090] Updated weights for policy 1, policy_version 751679 (0.0009) [2023-12-26 05:37:52,310][123091] Updated weights for policy 0, policy_version 756438 (0.0009) [2023-12-26 05:37:52,378][123091] Updated weights for policy 0, policy_version 756448 (0.0010) [2023-12-26 05:37:52,430][123091] Updated weights for policy 0, policy_version 756458 (0.0009) [2023-12-26 05:37:53,047][123090] Updated weights for policy 1, policy_version 751689 (0.0010) [2023-12-26 05:37:53,091][123090] Updated weights for policy 1, policy_version 751699 (0.0010) [2023-12-26 05:37:53,146][123090] Updated weights for policy 1, policy_version 751709 (0.0010) [2023-12-26 05:37:53,185][123091] Updated weights for policy 0, policy_version 756468 (0.0009) [2023-12-26 05:37:53,241][123091] Updated weights for policy 0, policy_version 756478 (0.0008) [2023-12-26 05:37:53,307][123091] Updated weights for policy 0, policy_version 756488 (0.0005) [2023-12-26 05:37:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 386105344. Throughput: 0: 9094.0, 1: 8952.7. Samples: 386083636. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:53,785][121949] Avg episode reward: [(0, '6064.399'), (1, '5367.054')] [2023-12-26 05:37:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000756496_193667072.pth... [2023-12-26 05:37:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000751712_192438272.pth... [2023-12-26 05:37:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000755440_193396736.pth [2023-12-26 05:37:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000750656_192167936.pth [2023-12-26 05:37:53,993][123090] Updated weights for policy 1, policy_version 751719 (0.0010) [2023-12-26 05:37:54,030][123091] Updated weights for policy 0, policy_version 756498 (0.0006) [2023-12-26 05:37:54,067][123090] Updated weights for policy 1, policy_version 751729 (0.0010) [2023-12-26 05:37:54,081][123091] Updated weights for policy 0, policy_version 756508 (0.0010) [2023-12-26 05:37:54,126][123090] Updated weights for policy 1, policy_version 751739 (0.0010) [2023-12-26 05:37:54,143][123091] Updated weights for policy 0, policy_version 756518 (0.0010) [2023-12-26 05:37:54,213][123091] Updated weights for policy 0, policy_version 756528 (0.0011) [2023-12-26 05:37:54,825][123090] Updated weights for policy 1, policy_version 751749 (0.0010) [2023-12-26 05:37:54,887][123090] Updated weights for policy 1, policy_version 751759 (0.0010) [2023-12-26 05:37:54,951][123090] Updated weights for policy 1, policy_version 751769 (0.0008) [2023-12-26 05:37:54,985][123091] Updated weights for policy 0, policy_version 756538 (0.0011) [2023-12-26 05:37:55,053][123091] Updated weights for policy 0, policy_version 756548 (0.0010) [2023-12-26 05:37:55,122][123091] Updated weights for policy 0, policy_version 756558 (0.0010) [2023-12-26 05:37:55,690][123090] Updated weights for policy 1, policy_version 751779 (0.0008) [2023-12-26 05:37:55,751][123090] Updated weights for policy 1, policy_version 751790 (0.0009) [2023-12-26 05:37:55,812][123090] Updated weights for policy 1, policy_version 751800 (0.0008) [2023-12-26 05:37:55,898][123091] Updated weights for policy 0, policy_version 756568 (0.0006) [2023-12-26 05:37:55,976][123091] Updated weights for policy 0, policy_version 756578 (0.0005) [2023-12-26 05:37:56,039][123091] Updated weights for policy 0, policy_version 756588 (0.0005) [2023-12-26 05:37:56,475][123090] Updated weights for policy 1, policy_version 751810 (0.0005) [2023-12-26 05:37:56,530][123090] Updated weights for policy 1, policy_version 751820 (0.0005) [2023-12-26 05:37:56,576][123090] Updated weights for policy 1, policy_version 751830 (0.0005) [2023-12-26 05:37:56,624][123090] Updated weights for policy 1, policy_version 751840 (0.0005) [2023-12-26 05:37:56,823][123091] Updated weights for policy 0, policy_version 756598 (0.0006) [2023-12-26 05:37:56,899][123091] Updated weights for policy 0, policy_version 756608 (0.0006) [2023-12-26 05:37:56,946][123091] Updated weights for policy 0, policy_version 756618 (0.0009) [2023-12-26 05:37:57,411][123090] Updated weights for policy 1, policy_version 751850 (0.0010) [2023-12-26 05:37:57,464][123090] Updated weights for policy 1, policy_version 751860 (0.0010) [2023-12-26 05:37:57,521][123090] Updated weights for policy 1, policy_version 751870 (0.0010) [2023-12-26 05:37:57,606][123091] Updated weights for policy 0, policy_version 756628 (0.0009) [2023-12-26 05:37:57,662][123091] Updated weights for policy 0, policy_version 756638 (0.0009) [2023-12-26 05:37:57,723][123091] Updated weights for policy 0, policy_version 756648 (0.0009) [2023-12-26 05:37:58,400][123090] Updated weights for policy 1, policy_version 751880 (0.0009) [2023-12-26 05:37:58,470][123090] Updated weights for policy 1, policy_version 751890 (0.0009) [2023-12-26 05:37:58,533][123090] Updated weights for policy 1, policy_version 751900 (0.0009) [2023-12-26 05:37:58,541][123091] Updated weights for policy 0, policy_version 756658 (0.0009) [2023-12-26 05:37:58,597][123091] Updated weights for policy 0, policy_version 756668 (0.0008) [2023-12-26 05:37:58,649][123091] Updated weights for policy 0, policy_version 756678 (0.0008) [2023-12-26 05:37:58,712][123091] Updated weights for policy 0, policy_version 756688 (0.0010) [2023-12-26 05:37:58,787][121949] Fps is (10 sec: 18017.4, 60 sec: 18158.1, 300 sec: 17827.8). Total num frames: 386203648. Throughput: 0: 9131.4, 1: 8994.4. Samples: 386193488. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:37:58,787][121949] Avg episode reward: [(0, '6156.542'), (1, '5251.114')] [2023-12-26 05:37:59,511][123090] Updated weights for policy 1, policy_version 751910 (0.0007) [2023-12-26 05:37:59,579][123090] Updated weights for policy 1, policy_version 751920 (0.0006) [2023-12-26 05:37:59,613][123091] Updated weights for policy 0, policy_version 756698 (0.0009) [2023-12-26 05:37:59,636][123090] Updated weights for policy 1, policy_version 751930 (0.0006) [2023-12-26 05:37:59,667][123091] Updated weights for policy 0, policy_version 756708 (0.0009) [2023-12-26 05:37:59,727][123091] Updated weights for policy 0, policy_version 756718 (0.0009) [2023-12-26 05:38:00,443][123090] Updated weights for policy 1, policy_version 751940 (0.0008) [2023-12-26 05:38:00,511][123090] Updated weights for policy 1, policy_version 751950 (0.0009) [2023-12-26 05:38:00,550][123091] Updated weights for policy 0, policy_version 756728 (0.0008) [2023-12-26 05:38:00,570][123090] Updated weights for policy 1, policy_version 751960 (0.0006) [2023-12-26 05:38:00,607][123091] Updated weights for policy 0, policy_version 756738 (0.0008) [2023-12-26 05:38:00,655][123091] Updated weights for policy 0, policy_version 756748 (0.0009) [2023-12-26 05:38:01,361][123090] Updated weights for policy 1, policy_version 751971 (0.0009) [2023-12-26 05:38:01,431][123090] Updated weights for policy 1, policy_version 751981 (0.0009) [2023-12-26 05:38:01,488][123090] Updated weights for policy 1, policy_version 751991 (0.0010) [2023-12-26 05:38:01,510][123091] Updated weights for policy 0, policy_version 756758 (0.0008) [2023-12-26 05:38:01,562][123091] Updated weights for policy 0, policy_version 756768 (0.0005) [2023-12-26 05:38:01,619][123091] Updated weights for policy 0, policy_version 756778 (0.0006) [2023-12-26 05:38:02,266][123090] Updated weights for policy 1, policy_version 752001 (0.0008) [2023-12-26 05:38:02,331][123090] Updated weights for policy 1, policy_version 752011 (0.0010) [2023-12-26 05:38:02,392][123090] Updated weights for policy 1, policy_version 752021 (0.0008) [2023-12-26 05:38:02,453][123090] Updated weights for policy 1, policy_version 752031 (0.0009) [2023-12-26 05:38:02,489][123091] Updated weights for policy 0, policy_version 756788 (0.0009) [2023-12-26 05:38:02,542][123091] Updated weights for policy 0, policy_version 756798 (0.0009) [2023-12-26 05:38:02,600][123091] Updated weights for policy 0, policy_version 756808 (0.0009) [2023-12-26 05:38:03,284][123090] Updated weights for policy 1, policy_version 752041 (0.0009) [2023-12-26 05:38:03,340][123090] Updated weights for policy 1, policy_version 752052 (0.0009) [2023-12-26 05:38:03,389][123090] Updated weights for policy 1, policy_version 752062 (0.0009) [2023-12-26 05:38:03,445][123091] Updated weights for policy 0, policy_version 756818 (0.0010) [2023-12-26 05:38:03,501][123091] Updated weights for policy 0, policy_version 756828 (0.0009) [2023-12-26 05:38:03,550][123091] Updated weights for policy 0, policy_version 756838 (0.0009) [2023-12-26 05:38:03,599][123091] Updated weights for policy 0, policy_version 756848 (0.0009) [2023-12-26 05:38:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 386285568. Throughput: 0: 8967.1, 1: 8953.1. Samples: 386294140. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:38:03,784][121949] Avg episode reward: [(0, '6090.291'), (1, '5325.590')] [2023-12-26 05:38:04,231][123090] Updated weights for policy 1, policy_version 752072 (0.0007) [2023-12-26 05:38:04,300][123090] Updated weights for policy 1, policy_version 752082 (0.0007) [2023-12-26 05:38:04,368][123090] Updated weights for policy 1, policy_version 752092 (0.0008) [2023-12-26 05:38:04,489][123091] Updated weights for policy 0, policy_version 756858 (0.0010) [2023-12-26 05:38:04,556][123091] Updated weights for policy 0, policy_version 756868 (0.0009) [2023-12-26 05:38:04,623][123091] Updated weights for policy 0, policy_version 756878 (0.0007) [2023-12-26 05:38:05,060][123090] Updated weights for policy 1, policy_version 752102 (0.0009) [2023-12-26 05:38:05,123][123090] Updated weights for policy 1, policy_version 752112 (0.0008) [2023-12-26 05:38:05,174][123090] Updated weights for policy 1, policy_version 752122 (0.0009) [2023-12-26 05:38:05,310][123091] Updated weights for policy 0, policy_version 756888 (0.0009) [2023-12-26 05:38:05,364][123091] Updated weights for policy 0, policy_version 756898 (0.0010) [2023-12-26 05:38:05,422][123091] Updated weights for policy 0, policy_version 756908 (0.0009) [2023-12-26 05:38:05,986][123090] Updated weights for policy 1, policy_version 752132 (0.0009) [2023-12-26 05:38:06,037][123090] Updated weights for policy 1, policy_version 752142 (0.0010) [2023-12-26 05:38:06,089][123090] Updated weights for policy 1, policy_version 752152 (0.0010) [2023-12-26 05:38:06,275][123091] Updated weights for policy 0, policy_version 756918 (0.0007) [2023-12-26 05:38:06,348][123091] Updated weights for policy 0, policy_version 756928 (0.0007) [2023-12-26 05:38:06,408][123091] Updated weights for policy 0, policy_version 756938 (0.0009) [2023-12-26 05:38:06,869][123090] Updated weights for policy 1, policy_version 752162 (0.0007) [2023-12-26 05:38:06,920][123090] Updated weights for policy 1, policy_version 752172 (0.0005) [2023-12-26 05:38:06,985][123090] Updated weights for policy 1, policy_version 752182 (0.0005) [2023-12-26 05:38:07,060][123090] Updated weights for policy 1, policy_version 752192 (0.0005) [2023-12-26 05:38:07,231][123091] Updated weights for policy 0, policy_version 756948 (0.0009) [2023-12-26 05:38:07,286][123091] Updated weights for policy 0, policy_version 756958 (0.0009) [2023-12-26 05:38:07,340][123091] Updated weights for policy 0, policy_version 756968 (0.0009) [2023-12-26 05:38:07,851][123090] Updated weights for policy 1, policy_version 752202 (0.0006) [2023-12-26 05:38:07,925][123090] Updated weights for policy 1, policy_version 752212 (0.0008) [2023-12-26 05:38:07,988][123090] Updated weights for policy 1, policy_version 752222 (0.0008) [2023-12-26 05:38:08,090][123091] Updated weights for policy 0, policy_version 756979 (0.0011) [2023-12-26 05:38:08,150][123091] Updated weights for policy 0, policy_version 756989 (0.0011) [2023-12-26 05:38:08,209][123091] Updated weights for policy 0, policy_version 756999 (0.0010) [2023-12-26 05:38:08,779][123090] Updated weights for policy 1, policy_version 752232 (0.0009) [2023-12-26 05:38:08,784][121949] Fps is (10 sec: 16388.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 386367488. Throughput: 0: 9010.5, 1: 9010.6. Samples: 386348476. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:38:08,785][121949] Avg episode reward: [(0, '6096.928'), (1, '5492.671')] [2023-12-26 05:38:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000757008_193798144.pth... [2023-12-26 05:38:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000755984_193536000.pth [2023-12-26 05:38:08,847][123090] Updated weights for policy 1, policy_version 752242 (0.0009) [2023-12-26 05:38:08,914][123090] Updated weights for policy 1, policy_version 752252 (0.0009) [2023-12-26 05:38:08,942][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000752256_192577536.pth... [2023-12-26 05:38:08,947][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000751200_192307200.pth [2023-12-26 05:38:09,022][123091] Updated weights for policy 0, policy_version 757009 (0.0011) [2023-12-26 05:38:09,076][123091] Updated weights for policy 0, policy_version 757019 (0.0010) [2023-12-26 05:38:09,127][123091] Updated weights for policy 0, policy_version 757029 (0.0010) [2023-12-26 05:38:09,182][123091] Updated weights for policy 0, policy_version 757039 (0.0010) [2023-12-26 05:38:09,686][123090] Updated weights for policy 1, policy_version 752262 (0.0010) [2023-12-26 05:38:09,759][123090] Updated weights for policy 1, policy_version 752272 (0.0011) [2023-12-26 05:38:09,828][123090] Updated weights for policy 1, policy_version 752282 (0.0010) [2023-12-26 05:38:10,018][123091] Updated weights for policy 0, policy_version 757049 (0.0011) [2023-12-26 05:38:10,070][123091] Updated weights for policy 0, policy_version 757059 (0.0011) [2023-12-26 05:38:10,122][123091] Updated weights for policy 0, policy_version 757069 (0.0010) [2023-12-26 05:38:10,672][123090] Updated weights for policy 1, policy_version 752292 (0.0008) [2023-12-26 05:38:10,735][123090] Updated weights for policy 1, policy_version 752302 (0.0005) [2023-12-26 05:38:10,796][123090] Updated weights for policy 1, policy_version 752312 (0.0006) [2023-12-26 05:38:10,935][123091] Updated weights for policy 0, policy_version 757079 (0.0011) [2023-12-26 05:38:10,979][123091] Updated weights for policy 0, policy_version 757089 (0.0010) [2023-12-26 05:38:11,040][123091] Updated weights for policy 0, policy_version 757099 (0.0011) [2023-12-26 05:38:11,587][123090] Updated weights for policy 1, policy_version 752322 (0.0006) [2023-12-26 05:38:11,660][123090] Updated weights for policy 1, policy_version 752332 (0.0011) [2023-12-26 05:38:11,729][123090] Updated weights for policy 1, policy_version 752342 (0.0010) [2023-12-26 05:38:11,801][123090] Updated weights for policy 1, policy_version 752352 (0.0009) [2023-12-26 05:38:11,862][123091] Updated weights for policy 0, policy_version 757109 (0.0010) [2023-12-26 05:38:11,920][123091] Updated weights for policy 0, policy_version 757119 (0.0009) [2023-12-26 05:38:11,970][123091] Updated weights for policy 0, policy_version 757129 (0.0009) [2023-12-26 05:38:12,653][123090] Updated weights for policy 1, policy_version 752362 (0.0008) [2023-12-26 05:38:12,715][123090] Updated weights for policy 1, policy_version 752372 (0.0010) [2023-12-26 05:38:12,782][123090] Updated weights for policy 1, policy_version 752382 (0.0010) [2023-12-26 05:38:12,799][123091] Updated weights for policy 0, policy_version 757139 (0.0009) [2023-12-26 05:38:12,862][123091] Updated weights for policy 0, policy_version 757149 (0.0009) [2023-12-26 05:38:12,930][123091] Updated weights for policy 0, policy_version 757159 (0.0009) [2023-12-26 05:38:13,567][123090] Updated weights for policy 1, policy_version 752392 (0.0006) [2023-12-26 05:38:13,601][123091] Updated weights for policy 0, policy_version 757169 (0.0009) [2023-12-26 05:38:13,635][123090] Updated weights for policy 1, policy_version 752402 (0.0006) [2023-12-26 05:38:13,664][123091] Updated weights for policy 0, policy_version 757179 (0.0008) [2023-12-26 05:38:13,702][123090] Updated weights for policy 1, policy_version 752412 (0.0008) [2023-12-26 05:38:13,711][123091] Updated weights for policy 0, policy_version 757189 (0.0007) [2023-12-26 05:38:13,760][123091] Updated weights for policy 0, policy_version 757199 (0.0006) [2023-12-26 05:38:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 386465792. Throughput: 0: 8968.5, 1: 8879.4. Samples: 386451972. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:38:13,785][121949] Avg episode reward: [(0, '6141.373'), (1, '5546.493')] [2023-12-26 05:38:14,452][123091] Updated weights for policy 0, policy_version 757209 (0.0005) [2023-12-26 05:38:14,504][123090] Updated weights for policy 1, policy_version 752422 (0.0007) [2023-12-26 05:38:14,512][123091] Updated weights for policy 0, policy_version 757219 (0.0008) [2023-12-26 05:38:14,560][123090] Updated weights for policy 1, policy_version 752432 (0.0006) [2023-12-26 05:38:14,573][123091] Updated weights for policy 0, policy_version 757229 (0.0008) [2023-12-26 05:38:14,618][123090] Updated weights for policy 1, policy_version 752442 (0.0008) [2023-12-26 05:38:15,326][123091] Updated weights for policy 0, policy_version 757239 (0.0009) [2023-12-26 05:38:15,385][123091] Updated weights for policy 0, policy_version 757249 (0.0009) [2023-12-26 05:38:15,434][123091] Updated weights for policy 0, policy_version 757259 (0.0009) [2023-12-26 05:38:15,521][123090] Updated weights for policy 1, policy_version 752452 (0.0009) [2023-12-26 05:38:15,583][123090] Updated weights for policy 1, policy_version 752462 (0.0010) [2023-12-26 05:38:15,647][123090] Updated weights for policy 1, policy_version 752472 (0.0010) [2023-12-26 05:38:16,249][123091] Updated weights for policy 0, policy_version 757269 (0.0008) [2023-12-26 05:38:16,314][123091] Updated weights for policy 0, policy_version 757279 (0.0010) [2023-12-26 05:38:16,381][123091] Updated weights for policy 0, policy_version 757289 (0.0008) [2023-12-26 05:38:16,503][123090] Updated weights for policy 1, policy_version 752482 (0.0009) [2023-12-26 05:38:16,562][123090] Updated weights for policy 1, policy_version 752492 (0.0009) [2023-12-26 05:38:16,617][123090] Updated weights for policy 1, policy_version 752502 (0.0009) [2023-12-26 05:38:16,675][123090] Updated weights for policy 1, policy_version 752512 (0.0010) [2023-12-26 05:38:17,013][123091] Updated weights for policy 0, policy_version 757299 (0.0006) [2023-12-26 05:38:17,067][123091] Updated weights for policy 0, policy_version 757309 (0.0006) [2023-12-26 05:38:17,119][123091] Updated weights for policy 0, policy_version 757319 (0.0006) [2023-12-26 05:38:17,539][123090] Updated weights for policy 1, policy_version 752522 (0.0005) [2023-12-26 05:38:17,612][123090] Updated weights for policy 1, policy_version 752532 (0.0005) [2023-12-26 05:38:17,680][123090] Updated weights for policy 1, policy_version 752542 (0.0005) [2023-12-26 05:38:17,775][123091] Updated weights for policy 0, policy_version 757329 (0.0010) [2023-12-26 05:38:17,835][123091] Updated weights for policy 0, policy_version 757339 (0.0005) [2023-12-26 05:38:17,895][123091] Updated weights for policy 0, policy_version 757349 (0.0007) [2023-12-26 05:38:17,959][123091] Updated weights for policy 0, policy_version 757359 (0.0008) [2023-12-26 05:38:18,345][123090] Updated weights for policy 1, policy_version 752552 (0.0008) [2023-12-26 05:38:18,415][123090] Updated weights for policy 1, policy_version 752562 (0.0009) [2023-12-26 05:38:18,477][123090] Updated weights for policy 1, policy_version 752572 (0.0009) [2023-12-26 05:38:18,731][123091] Updated weights for policy 0, policy_version 757369 (0.0011) [2023-12-26 05:38:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 386547712. Throughput: 0: 9055.6, 1: 8806.5. Samples: 386561540. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:38:18,784][121949] Avg episode reward: [(0, '6012.495'), (1, '5411.805')] [2023-12-26 05:38:18,788][123091] Updated weights for policy 0, policy_version 757379 (0.0011) [2023-12-26 05:38:18,852][123091] Updated weights for policy 0, policy_version 757389 (0.0011) [2023-12-26 05:38:19,330][123090] Updated weights for policy 1, policy_version 752582 (0.0009) [2023-12-26 05:38:19,408][123090] Updated weights for policy 1, policy_version 752592 (0.0010) [2023-12-26 05:38:19,472][123090] Updated weights for policy 1, policy_version 752602 (0.0006) [2023-12-26 05:38:19,733][123091] Updated weights for policy 0, policy_version 757399 (0.0011) [2023-12-26 05:38:19,782][123091] Updated weights for policy 0, policy_version 757409 (0.0011) [2023-12-26 05:38:19,851][123091] Updated weights for policy 0, policy_version 757419 (0.0011) [2023-12-26 05:38:20,365][123090] Updated weights for policy 1, policy_version 752612 (0.0009) [2023-12-26 05:38:20,423][123090] Updated weights for policy 1, policy_version 752622 (0.0006) [2023-12-26 05:38:20,479][123090] Updated weights for policy 1, policy_version 752632 (0.0008) [2023-12-26 05:38:20,698][123091] Updated weights for policy 0, policy_version 757429 (0.0011) [2023-12-26 05:38:20,770][123091] Updated weights for policy 0, policy_version 757439 (0.0011) [2023-12-26 05:38:20,826][123091] Updated weights for policy 0, policy_version 757449 (0.0011) [2023-12-26 05:38:21,346][123090] Updated weights for policy 1, policy_version 752642 (0.0009) [2023-12-26 05:38:21,416][123090] Updated weights for policy 1, policy_version 752652 (0.0008) [2023-12-26 05:38:21,478][123090] Updated weights for policy 1, policy_version 752662 (0.0006) [2023-12-26 05:38:21,536][123090] Updated weights for policy 1, policy_version 752672 (0.0009) [2023-12-26 05:38:21,667][123091] Updated weights for policy 0, policy_version 757459 (0.0011) [2023-12-26 05:38:21,731][123091] Updated weights for policy 0, policy_version 757469 (0.0010) [2023-12-26 05:38:21,794][123091] Updated weights for policy 0, policy_version 757479 (0.0008) [2023-12-26 05:38:22,436][123090] Updated weights for policy 1, policy_version 752682 (0.0009) [2023-12-26 05:38:22,493][123090] Updated weights for policy 1, policy_version 752692 (0.0008) [2023-12-26 05:38:22,554][123090] Updated weights for policy 1, policy_version 752702 (0.0008) [2023-12-26 05:38:22,574][123091] Updated weights for policy 0, policy_version 757489 (0.0008) [2023-12-26 05:38:22,640][123091] Updated weights for policy 0, policy_version 757499 (0.0011) [2023-12-26 05:38:22,708][123091] Updated weights for policy 0, policy_version 757509 (0.0011) [2023-12-26 05:38:22,776][123091] Updated weights for policy 0, policy_version 757519 (0.0011) [2023-12-26 05:38:23,377][123090] Updated weights for policy 1, policy_version 752712 (0.0006) [2023-12-26 05:38:23,433][123090] Updated weights for policy 1, policy_version 752722 (0.0008) [2023-12-26 05:38:23,494][123090] Updated weights for policy 1, policy_version 752732 (0.0009) [2023-12-26 05:38:23,595][123091] Updated weights for policy 0, policy_version 757529 (0.0011) [2023-12-26 05:38:23,667][123091] Updated weights for policy 0, policy_version 757539 (0.0005) [2023-12-26 05:38:23,728][123091] Updated weights for policy 0, policy_version 757549 (0.0008) [2023-12-26 05:38:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 386637824. Throughput: 0: 9000.8, 1: 8728.4. Samples: 386611168. Policy #0 lag: (min: 31.0, avg: 31.5, max: 49.0) [2023-12-26 05:38:23,785][121949] Avg episode reward: [(0, '5907.327'), (1, '5302.440')] [2023-12-26 05:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000752736_192700416.pth... [2023-12-26 05:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000757552_193937408.pth... [2023-12-26 05:38:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000751712_192438272.pth [2023-12-26 05:38:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000756496_193667072.pth [2023-12-26 05:38:24,208][123090] Updated weights for policy 1, policy_version 752742 (0.0008) [2023-12-26 05:38:24,287][123090] Updated weights for policy 1, policy_version 752752 (0.0009) [2023-12-26 05:38:24,341][123090] Updated weights for policy 1, policy_version 752762 (0.0010) [2023-12-26 05:38:24,457][123091] Updated weights for policy 0, policy_version 757559 (0.0010) [2023-12-26 05:38:24,512][123091] Updated weights for policy 0, policy_version 757569 (0.0009) [2023-12-26 05:38:24,566][123091] Updated weights for policy 0, policy_version 757579 (0.0010) [2023-12-26 05:38:25,127][123090] Updated weights for policy 1, policy_version 752773 (0.0009) [2023-12-26 05:38:25,187][123090] Updated weights for policy 1, policy_version 752784 (0.0010) [2023-12-26 05:38:25,250][123090] Updated weights for policy 1, policy_version 752794 (0.0010) [2023-12-26 05:38:25,414][123091] Updated weights for policy 0, policy_version 757589 (0.0010) [2023-12-26 05:38:25,474][123091] Updated weights for policy 0, policy_version 757599 (0.0009) [2023-12-26 05:38:25,535][123091] Updated weights for policy 0, policy_version 757609 (0.0009) [2023-12-26 05:38:26,170][123090] Updated weights for policy 1, policy_version 752805 (0.0010) [2023-12-26 05:38:26,219][123091] Updated weights for policy 0, policy_version 757619 (0.0009) [2023-12-26 05:38:26,226][123090] Updated weights for policy 1, policy_version 752815 (0.0009) [2023-12-26 05:38:26,267][123091] Updated weights for policy 0, policy_version 757629 (0.0006) [2023-12-26 05:38:26,286][123090] Updated weights for policy 1, policy_version 752825 (0.0009) [2023-12-26 05:38:26,320][123091] Updated weights for policy 0, policy_version 757639 (0.0007) [2023-12-26 05:38:27,037][123091] Updated weights for policy 0, policy_version 757649 (0.0008) [2023-12-26 05:38:27,086][123091] Updated weights for policy 0, policy_version 757659 (0.0005) [2023-12-26 05:38:27,130][123091] Updated weights for policy 0, policy_version 757669 (0.0005) [2023-12-26 05:38:27,176][123091] Updated weights for policy 0, policy_version 757679 (0.0005) [2023-12-26 05:38:27,205][123090] Updated weights for policy 1, policy_version 752835 (0.0009) [2023-12-26 05:38:27,252][123090] Updated weights for policy 1, policy_version 752845 (0.0008) [2023-12-26 05:38:27,314][123090] Updated weights for policy 1, policy_version 752855 (0.0009) [2023-12-26 05:38:27,927][123091] Updated weights for policy 0, policy_version 757689 (0.0006) [2023-12-26 05:38:27,980][123091] Updated weights for policy 0, policy_version 757699 (0.0008) [2023-12-26 05:38:28,032][123091] Updated weights for policy 0, policy_version 757709 (0.0009) [2023-12-26 05:38:28,203][123090] Updated weights for policy 1, policy_version 752865 (0.0010) [2023-12-26 05:38:28,269][123090] Updated weights for policy 1, policy_version 752875 (0.0008) [2023-12-26 05:38:28,333][123090] Updated weights for policy 1, policy_version 752885 (0.0009) [2023-12-26 05:38:28,391][123090] Updated weights for policy 1, policy_version 752895 (0.0009) [2023-12-26 05:38:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 386719744. Throughput: 0: 9031.2, 1: 8684.8. Samples: 386716260. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:28,785][121949] Avg episode reward: [(0, '6088.290'), (1, '5331.642')] [2023-12-26 05:38:28,836][123091] Updated weights for policy 0, policy_version 757719 (0.0007) [2023-12-26 05:38:28,891][123091] Updated weights for policy 0, policy_version 757729 (0.0005) [2023-12-26 05:38:28,957][123091] Updated weights for policy 0, policy_version 757739 (0.0006) [2023-12-26 05:38:29,292][123090] Updated weights for policy 1, policy_version 752905 (0.0009) [2023-12-26 05:38:29,346][123090] Updated weights for policy 1, policy_version 752915 (0.0009) [2023-12-26 05:38:29,410][123090] Updated weights for policy 1, policy_version 752925 (0.0009) [2023-12-26 05:38:29,681][123091] Updated weights for policy 0, policy_version 757749 (0.0008) [2023-12-26 05:38:29,745][123091] Updated weights for policy 0, policy_version 757759 (0.0011) [2023-12-26 05:38:29,804][123091] Updated weights for policy 0, policy_version 757769 (0.0011) [2023-12-26 05:38:30,259][123090] Updated weights for policy 1, policy_version 752935 (0.0007) [2023-12-26 05:38:30,322][123090] Updated weights for policy 1, policy_version 752945 (0.0010) [2023-12-26 05:38:30,382][123090] Updated weights for policy 1, policy_version 752955 (0.0009) [2023-12-26 05:38:30,517][123091] Updated weights for policy 0, policy_version 757779 (0.0009) [2023-12-26 05:38:30,568][123091] Updated weights for policy 0, policy_version 757789 (0.0005) [2023-12-26 05:38:30,616][123091] Updated weights for policy 0, policy_version 757799 (0.0005) [2023-12-26 05:38:31,141][123090] Updated weights for policy 1, policy_version 752965 (0.0009) [2023-12-26 05:38:31,195][123090] Updated weights for policy 1, policy_version 752975 (0.0008) [2023-12-26 05:38:31,249][123090] Updated weights for policy 1, policy_version 752985 (0.0008) [2023-12-26 05:38:31,339][123091] Updated weights for policy 0, policy_version 757809 (0.0006) [2023-12-26 05:38:31,399][123091] Updated weights for policy 0, policy_version 757819 (0.0011) [2023-12-26 05:38:31,455][123091] Updated weights for policy 0, policy_version 757829 (0.0011) [2023-12-26 05:38:31,514][123091] Updated weights for policy 0, policy_version 757839 (0.0011) [2023-12-26 05:38:32,035][123090] Updated weights for policy 1, policy_version 752995 (0.0010) [2023-12-26 05:38:32,102][123090] Updated weights for policy 1, policy_version 753005 (0.0011) [2023-12-26 05:38:32,169][123090] Updated weights for policy 1, policy_version 753015 (0.0010) [2023-12-26 05:38:32,330][123091] Updated weights for policy 0, policy_version 757849 (0.0009) [2023-12-26 05:38:32,405][123091] Updated weights for policy 0, policy_version 757859 (0.0008) [2023-12-26 05:38:32,471][123091] Updated weights for policy 0, policy_version 757869 (0.0007) [2023-12-26 05:38:32,915][123090] Updated weights for policy 1, policy_version 753025 (0.0010) [2023-12-26 05:38:32,982][123090] Updated weights for policy 1, policy_version 753035 (0.0005) [2023-12-26 05:38:33,041][123090] Updated weights for policy 1, policy_version 753045 (0.0005) [2023-12-26 05:38:33,099][123090] Updated weights for policy 1, policy_version 753055 (0.0005) [2023-12-26 05:38:33,323][123091] Updated weights for policy 0, policy_version 757879 (0.0008) [2023-12-26 05:38:33,379][123091] Updated weights for policy 0, policy_version 757889 (0.0005) [2023-12-26 05:38:33,424][123091] Updated weights for policy 0, policy_version 757899 (0.0005) [2023-12-26 05:38:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 386809856. Throughput: 0: 8928.3, 1: 8653.0. Samples: 386823908. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:33,785][121949] Avg episode reward: [(0, '6251.191'), (1, '5319.013')] [2023-12-26 05:38:33,858][123090] Updated weights for policy 1, policy_version 753065 (0.0008) [2023-12-26 05:38:33,917][123090] Updated weights for policy 1, policy_version 753075 (0.0009) [2023-12-26 05:38:33,984][123090] Updated weights for policy 1, policy_version 753085 (0.0009) [2023-12-26 05:38:34,194][123091] Updated weights for policy 0, policy_version 757909 (0.0008) [2023-12-26 05:38:34,255][123091] Updated weights for policy 0, policy_version 757919 (0.0010) [2023-12-26 05:38:34,326][123091] Updated weights for policy 0, policy_version 757929 (0.0009) [2023-12-26 05:38:34,821][123090] Updated weights for policy 1, policy_version 753095 (0.0009) [2023-12-26 05:38:34,883][123090] Updated weights for policy 1, policy_version 753105 (0.0010) [2023-12-26 05:38:34,947][123090] Updated weights for policy 1, policy_version 753115 (0.0010) [2023-12-26 05:38:35,150][123091] Updated weights for policy 0, policy_version 757939 (0.0010) [2023-12-26 05:38:35,210][123091] Updated weights for policy 0, policy_version 757949 (0.0010) [2023-12-26 05:38:35,273][123091] Updated weights for policy 0, policy_version 757959 (0.0011) [2023-12-26 05:38:35,821][123090] Updated weights for policy 1, policy_version 753125 (0.0009) [2023-12-26 05:38:35,876][123090] Updated weights for policy 1, policy_version 753135 (0.0010) [2023-12-26 05:38:35,931][123090] Updated weights for policy 1, policy_version 753145 (0.0010) [2023-12-26 05:38:35,999][123091] Updated weights for policy 0, policy_version 757969 (0.0011) [2023-12-26 05:38:36,065][123091] Updated weights for policy 0, policy_version 757979 (0.0011) [2023-12-26 05:38:36,130][123091] Updated weights for policy 0, policy_version 757989 (0.0010) [2023-12-26 05:38:36,201][123091] Updated weights for policy 0, policy_version 757999 (0.0011) [2023-12-26 05:38:36,755][123090] Updated weights for policy 1, policy_version 753155 (0.0008) [2023-12-26 05:38:36,833][123090] Updated weights for policy 1, policy_version 753165 (0.0006) [2023-12-26 05:38:36,906][123090] Updated weights for policy 1, policy_version 753175 (0.0008) [2023-12-26 05:38:36,912][123091] Updated weights for policy 0, policy_version 758009 (0.0010) [2023-12-26 05:38:36,976][123091] Updated weights for policy 0, policy_version 758019 (0.0011) [2023-12-26 05:38:37,028][123091] Updated weights for policy 0, policy_version 758029 (0.0011) [2023-12-26 05:38:37,512][123090] Updated weights for policy 1, policy_version 753185 (0.0008) [2023-12-26 05:38:37,567][123090] Updated weights for policy 1, policy_version 753195 (0.0005) [2023-12-26 05:38:37,619][123090] Updated weights for policy 1, policy_version 753205 (0.0005) [2023-12-26 05:38:37,680][123090] Updated weights for policy 1, policy_version 753215 (0.0006) [2023-12-26 05:38:37,769][123091] Updated weights for policy 0, policy_version 758039 (0.0007) [2023-12-26 05:38:37,831][123091] Updated weights for policy 0, policy_version 758049 (0.0006) [2023-12-26 05:38:37,898][123091] Updated weights for policy 0, policy_version 758059 (0.0006) [2023-12-26 05:38:38,433][123090] Updated weights for policy 1, policy_version 753225 (0.0010) [2023-12-26 05:38:38,497][123090] Updated weights for policy 1, policy_version 753235 (0.0010) [2023-12-26 05:38:38,559][123090] Updated weights for policy 1, policy_version 753245 (0.0010) [2023-12-26 05:38:38,623][123091] Updated weights for policy 0, policy_version 758069 (0.0009) [2023-12-26 05:38:38,685][123091] Updated weights for policy 0, policy_version 758079 (0.0010) [2023-12-26 05:38:38,737][123091] Updated weights for policy 0, policy_version 758089 (0.0010) [2023-12-26 05:38:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 386908160. Throughput: 0: 8985.0, 1: 8631.6. Samples: 386876388. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:38,785][121949] Avg episode reward: [(0, '6218.547'), (1, '5262.378')] [2023-12-26 05:38:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000758096_194076672.pth... [2023-12-26 05:38:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000753248_192831488.pth... [2023-12-26 05:38:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000752256_192577536.pth [2023-12-26 05:38:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000757008_193798144.pth [2023-12-26 05:38:39,398][123090] Updated weights for policy 1, policy_version 753255 (0.0010) [2023-12-26 05:38:39,458][123090] Updated weights for policy 1, policy_version 753265 (0.0009) [2023-12-26 05:38:39,509][123090] Updated weights for policy 1, policy_version 753275 (0.0009) [2023-12-26 05:38:39,612][123091] Updated weights for policy 0, policy_version 758099 (0.0010) [2023-12-26 05:38:39,674][123091] Updated weights for policy 0, policy_version 758109 (0.0009) [2023-12-26 05:38:39,735][123091] Updated weights for policy 0, policy_version 758119 (0.0009) [2023-12-26 05:38:40,404][123090] Updated weights for policy 1, policy_version 753285 (0.0010) [2023-12-26 05:38:40,467][123090] Updated weights for policy 1, policy_version 753295 (0.0010) [2023-12-26 05:38:40,526][123090] Updated weights for policy 1, policy_version 753305 (0.0009) [2023-12-26 05:38:40,605][123091] Updated weights for policy 0, policy_version 758129 (0.0009) [2023-12-26 05:38:40,677][123091] Updated weights for policy 0, policy_version 758139 (0.0009) [2023-12-26 05:38:40,746][123091] Updated weights for policy 0, policy_version 758149 (0.0007) [2023-12-26 05:38:40,797][123091] Updated weights for policy 0, policy_version 758159 (0.0005) [2023-12-26 05:38:41,344][123090] Updated weights for policy 1, policy_version 753315 (0.0008) [2023-12-26 05:38:41,414][123090] Updated weights for policy 1, policy_version 753325 (0.0009) [2023-12-26 05:38:41,477][123090] Updated weights for policy 1, policy_version 753335 (0.0009) [2023-12-26 05:38:41,560][123091] Updated weights for policy 0, policy_version 758169 (0.0008) [2023-12-26 05:38:41,625][123091] Updated weights for policy 0, policy_version 758179 (0.0009) [2023-12-26 05:38:41,683][123091] Updated weights for policy 0, policy_version 758189 (0.0007) [2023-12-26 05:38:42,293][123090] Updated weights for policy 1, policy_version 753345 (0.0009) [2023-12-26 05:38:42,361][123090] Updated weights for policy 1, policy_version 753355 (0.0009) [2023-12-26 05:38:42,422][123090] Updated weights for policy 1, policy_version 753365 (0.0010) [2023-12-26 05:38:42,477][123090] Updated weights for policy 1, policy_version 753375 (0.0009) [2023-12-26 05:38:42,491][123091] Updated weights for policy 0, policy_version 758199 (0.0007) [2023-12-26 05:38:42,550][123091] Updated weights for policy 0, policy_version 758209 (0.0010) [2023-12-26 05:38:42,603][123091] Updated weights for policy 0, policy_version 758219 (0.0010) [2023-12-26 05:38:43,299][123091] Updated weights for policy 0, policy_version 758229 (0.0008) [2023-12-26 05:38:43,348][123091] Updated weights for policy 0, policy_version 758239 (0.0005) [2023-12-26 05:38:43,382][123090] Updated weights for policy 1, policy_version 753385 (0.0009) [2023-12-26 05:38:43,395][123091] Updated weights for policy 0, policy_version 758249 (0.0005) [2023-12-26 05:38:43,441][123090] Updated weights for policy 1, policy_version 753395 (0.0008) [2023-12-26 05:38:43,496][123090] Updated weights for policy 1, policy_version 753405 (0.0009) [2023-12-26 05:38:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 386990080. Throughput: 0: 8940.6, 1: 8592.4. Samples: 386982428. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:43,785][121949] Avg episode reward: [(0, '6044.902'), (1, '5276.621')] [2023-12-26 05:38:44,156][123091] Updated weights for policy 0, policy_version 758259 (0.0008) [2023-12-26 05:38:44,206][123091] Updated weights for policy 0, policy_version 758269 (0.0005) [2023-12-26 05:38:44,272][123091] Updated weights for policy 0, policy_version 758279 (0.0005) [2023-12-26 05:38:44,373][123090] Updated weights for policy 1, policy_version 753415 (0.0008) [2023-12-26 05:38:44,437][123090] Updated weights for policy 1, policy_version 753425 (0.0008) [2023-12-26 05:38:44,493][123090] Updated weights for policy 1, policy_version 753435 (0.0009) [2023-12-26 05:38:45,011][123091] Updated weights for policy 0, policy_version 758289 (0.0010) [2023-12-26 05:38:45,074][123091] Updated weights for policy 0, policy_version 758299 (0.0011) [2023-12-26 05:38:45,141][123091] Updated weights for policy 0, policy_version 758309 (0.0011) [2023-12-26 05:38:45,206][123091] Updated weights for policy 0, policy_version 758319 (0.0011) [2023-12-26 05:38:45,345][123090] Updated weights for policy 1, policy_version 753445 (0.0009) [2023-12-26 05:38:45,410][123090] Updated weights for policy 1, policy_version 753455 (0.0009) [2023-12-26 05:38:45,471][123090] Updated weights for policy 1, policy_version 753465 (0.0009) [2023-12-26 05:38:46,011][123091] Updated weights for policy 0, policy_version 758329 (0.0006) [2023-12-26 05:38:46,057][123091] Updated weights for policy 0, policy_version 758339 (0.0005) [2023-12-26 05:38:46,110][123091] Updated weights for policy 0, policy_version 758349 (0.0005) [2023-12-26 05:38:46,320][123090] Updated weights for policy 1, policy_version 753475 (0.0009) [2023-12-26 05:38:46,381][123090] Updated weights for policy 1, policy_version 753485 (0.0007) [2023-12-26 05:38:46,444][123090] Updated weights for policy 1, policy_version 753495 (0.0005) [2023-12-26 05:38:46,923][123091] Updated weights for policy 0, policy_version 758359 (0.0010) [2023-12-26 05:38:46,983][123091] Updated weights for policy 0, policy_version 758369 (0.0011) [2023-12-26 05:38:47,047][123091] Updated weights for policy 0, policy_version 758379 (0.0011) [2023-12-26 05:38:47,129][123090] Updated weights for policy 1, policy_version 753505 (0.0005) [2023-12-26 05:38:47,189][123090] Updated weights for policy 1, policy_version 753515 (0.0005) [2023-12-26 05:38:47,246][123090] Updated weights for policy 1, policy_version 753525 (0.0009) [2023-12-26 05:38:47,313][123090] Updated weights for policy 1, policy_version 753535 (0.0010) [2023-12-26 05:38:47,872][123091] Updated weights for policy 0, policy_version 758389 (0.0010) [2023-12-26 05:38:47,923][123091] Updated weights for policy 0, policy_version 758399 (0.0010) [2023-12-26 05:38:47,962][123090] Updated weights for policy 1, policy_version 753545 (0.0006) [2023-12-26 05:38:47,973][123091] Updated weights for policy 0, policy_version 758409 (0.0009) [2023-12-26 05:38:48,019][123090] Updated weights for policy 1, policy_version 753555 (0.0006) [2023-12-26 05:38:48,075][123090] Updated weights for policy 1, policy_version 753565 (0.0005) [2023-12-26 05:38:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 387072000. Throughput: 0: 9012.1, 1: 8653.7. Samples: 387089100. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:48,784][121949] Avg episode reward: [(0, '6067.822'), (1, '5283.361')] [2023-12-26 05:38:48,790][123090] Updated weights for policy 1, policy_version 753575 (0.0006) [2023-12-26 05:38:48,860][123090] Updated weights for policy 1, policy_version 753585 (0.0010) [2023-12-26 05:38:48,912][123091] Updated weights for policy 0, policy_version 758419 (0.0008) [2023-12-26 05:38:48,926][123090] Updated weights for policy 1, policy_version 753595 (0.0010) [2023-12-26 05:38:48,966][123091] Updated weights for policy 0, policy_version 758429 (0.0009) [2023-12-26 05:38:49,037][123091] Updated weights for policy 0, policy_version 758439 (0.0009) [2023-12-26 05:38:49,618][123090] Updated weights for policy 1, policy_version 753605 (0.0010) [2023-12-26 05:38:49,683][123090] Updated weights for policy 1, policy_version 753615 (0.0009) [2023-12-26 05:38:49,740][123090] Updated weights for policy 1, policy_version 753625 (0.0010) [2023-12-26 05:38:49,889][123091] Updated weights for policy 0, policy_version 758449 (0.0010) [2023-12-26 05:38:49,957][123091] Updated weights for policy 0, policy_version 758459 (0.0009) [2023-12-26 05:38:50,018][123091] Updated weights for policy 0, policy_version 758469 (0.0010) [2023-12-26 05:38:50,084][123091] Updated weights for policy 0, policy_version 758479 (0.0010) [2023-12-26 05:38:50,612][123090] Updated weights for policy 1, policy_version 753635 (0.0009) [2023-12-26 05:38:50,671][123090] Updated weights for policy 1, policy_version 753645 (0.0010) [2023-12-26 05:38:50,732][123090] Updated weights for policy 1, policy_version 753655 (0.0010) [2023-12-26 05:38:50,929][123091] Updated weights for policy 0, policy_version 758489 (0.0010) [2023-12-26 05:38:50,984][123091] Updated weights for policy 0, policy_version 758499 (0.0009) [2023-12-26 05:38:51,050][123091] Updated weights for policy 0, policy_version 758509 (0.0008) [2023-12-26 05:38:51,568][123090] Updated weights for policy 1, policy_version 753665 (0.0008) [2023-12-26 05:38:51,628][123090] Updated weights for policy 1, policy_version 753675 (0.0006) [2023-12-26 05:38:51,697][123090] Updated weights for policy 1, policy_version 753685 (0.0008) [2023-12-26 05:38:51,769][123090] Updated weights for policy 1, policy_version 753695 (0.0006) [2023-12-26 05:38:51,970][123091] Updated weights for policy 0, policy_version 758519 (0.0007) [2023-12-26 05:38:52,052][123091] Updated weights for policy 0, policy_version 758529 (0.0006) [2023-12-26 05:38:52,128][123091] Updated weights for policy 0, policy_version 758539 (0.0006) [2023-12-26 05:38:52,462][123090] Updated weights for policy 1, policy_version 753705 (0.0008) [2023-12-26 05:38:52,527][123090] Updated weights for policy 1, policy_version 753715 (0.0008) [2023-12-26 05:38:52,596][123090] Updated weights for policy 1, policy_version 753725 (0.0008) [2023-12-26 05:38:52,810][123091] Updated weights for policy 0, policy_version 758549 (0.0008) [2023-12-26 05:38:52,870][123091] Updated weights for policy 0, policy_version 758559 (0.0010) [2023-12-26 05:38:52,924][123091] Updated weights for policy 0, policy_version 758569 (0.0010) [2023-12-26 05:38:53,319][123090] Updated weights for policy 1, policy_version 753735 (0.0007) [2023-12-26 05:38:53,384][123090] Updated weights for policy 1, policy_version 753745 (0.0006) [2023-12-26 05:38:53,445][123090] Updated weights for policy 1, policy_version 753755 (0.0006) [2023-12-26 05:38:53,719][123091] Updated weights for policy 0, policy_version 758579 (0.0008) [2023-12-26 05:38:53,766][123091] Updated weights for policy 0, policy_version 758589 (0.0005) [2023-12-26 05:38:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 387162112. Throughput: 0: 8968.7, 1: 8611.2. Samples: 387139572. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:53,785][121949] Avg episode reward: [(0, '6147.524'), (1, '5149.439')] [2023-12-26 05:38:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000753760_192962560.pth... [2023-12-26 05:38:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000752736_192700416.pth [2023-12-26 05:38:53,826][123091] Updated weights for policy 0, policy_version 758599 (0.0008) [2023-12-26 05:38:53,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000758608_194207744.pth... [2023-12-26 05:38:53,880][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000757552_193937408.pth [2023-12-26 05:38:54,231][123090] Updated weights for policy 1, policy_version 753765 (0.0008) [2023-12-26 05:38:54,286][123090] Updated weights for policy 1, policy_version 753775 (0.0005) [2023-12-26 05:38:54,350][123090] Updated weights for policy 1, policy_version 753785 (0.0008) [2023-12-26 05:38:54,698][123091] Updated weights for policy 0, policy_version 758609 (0.0009) [2023-12-26 05:38:54,748][123091] Updated weights for policy 0, policy_version 758620 (0.0007) [2023-12-26 05:38:54,804][123091] Updated weights for policy 0, policy_version 758630 (0.0005) [2023-12-26 05:38:54,852][123091] Updated weights for policy 0, policy_version 758640 (0.0006) [2023-12-26 05:38:54,999][123090] Updated weights for policy 1, policy_version 753795 (0.0008) [2023-12-26 05:38:55,072][123090] Updated weights for policy 1, policy_version 753805 (0.0006) [2023-12-26 05:38:55,150][123090] Updated weights for policy 1, policy_version 753815 (0.0006) [2023-12-26 05:38:55,641][123091] Updated weights for policy 0, policy_version 758650 (0.0005) [2023-12-26 05:38:55,706][123091] Updated weights for policy 0, policy_version 758660 (0.0008) [2023-12-26 05:38:55,772][123091] Updated weights for policy 0, policy_version 758670 (0.0010) [2023-12-26 05:38:55,895][123090] Updated weights for policy 1, policy_version 753825 (0.0007) [2023-12-26 05:38:55,959][123090] Updated weights for policy 1, policy_version 753835 (0.0009) [2023-12-26 05:38:56,027][123090] Updated weights for policy 1, policy_version 753845 (0.0010) [2023-12-26 05:38:56,087][123090] Updated weights for policy 1, policy_version 753855 (0.0009) [2023-12-26 05:38:56,480][123091] Updated weights for policy 0, policy_version 758680 (0.0006) [2023-12-26 05:38:56,549][123091] Updated weights for policy 0, policy_version 758690 (0.0005) [2023-12-26 05:38:56,607][123091] Updated weights for policy 0, policy_version 758700 (0.0005) [2023-12-26 05:38:56,927][123090] Updated weights for policy 1, policy_version 753865 (0.0010) [2023-12-26 05:38:56,988][123090] Updated weights for policy 1, policy_version 753875 (0.0009) [2023-12-26 05:38:57,055][123090] Updated weights for policy 1, policy_version 753885 (0.0009) [2023-12-26 05:38:57,302][123091] Updated weights for policy 0, policy_version 758710 (0.0008) [2023-12-26 05:38:57,358][123091] Updated weights for policy 0, policy_version 758720 (0.0010) [2023-12-26 05:38:57,409][123091] Updated weights for policy 0, policy_version 758730 (0.0009) [2023-12-26 05:38:57,913][123090] Updated weights for policy 1, policy_version 753895 (0.0009) [2023-12-26 05:38:57,963][123090] Updated weights for policy 1, policy_version 753906 (0.0008) [2023-12-26 05:38:58,038][123090] Updated weights for policy 1, policy_version 753916 (0.0006) [2023-12-26 05:38:58,172][123091] Updated weights for policy 0, policy_version 758740 (0.0008) [2023-12-26 05:38:58,236][123091] Updated weights for policy 0, policy_version 758750 (0.0009) [2023-12-26 05:38:58,307][123091] Updated weights for policy 0, policy_version 758761 (0.0010) [2023-12-26 05:38:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17477.1, 300 sec: 17744.7). Total num frames: 387252224. Throughput: 0: 9003.4, 1: 8673.8. Samples: 387247444. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:38:58,785][121949] Avg episode reward: [(0, '6025.068'), (1, '5151.798')] [2023-12-26 05:38:58,911][123090] Updated weights for policy 1, policy_version 753926 (0.0010) [2023-12-26 05:38:58,979][123090] Updated weights for policy 1, policy_version 753936 (0.0011) [2023-12-26 05:38:59,040][123090] Updated weights for policy 1, policy_version 753946 (0.0011) [2023-12-26 05:38:59,129][123091] Updated weights for policy 0, policy_version 758771 (0.0009) [2023-12-26 05:38:59,185][123091] Updated weights for policy 0, policy_version 758781 (0.0009) [2023-12-26 05:38:59,257][123091] Updated weights for policy 0, policy_version 758791 (0.0009) [2023-12-26 05:38:59,893][123090] Updated weights for policy 1, policy_version 753956 (0.0009) [2023-12-26 05:38:59,964][123090] Updated weights for policy 1, policy_version 753966 (0.0007) [2023-12-26 05:39:00,036][123090] Updated weights for policy 1, policy_version 753976 (0.0008) [2023-12-26 05:39:00,145][123091] Updated weights for policy 0, policy_version 758801 (0.0009) [2023-12-26 05:39:00,204][123091] Updated weights for policy 0, policy_version 758811 (0.0009) [2023-12-26 05:39:00,273][123091] Updated weights for policy 0, policy_version 758821 (0.0009) [2023-12-26 05:39:00,341][123091] Updated weights for policy 0, policy_version 758831 (0.0009) [2023-12-26 05:39:00,795][123090] Updated weights for policy 1, policy_version 753986 (0.0009) [2023-12-26 05:39:00,847][123090] Updated weights for policy 1, policy_version 753996 (0.0009) [2023-12-26 05:39:00,901][123090] Updated weights for policy 1, policy_version 754006 (0.0009) [2023-12-26 05:39:00,967][123090] Updated weights for policy 1, policy_version 754016 (0.0009) [2023-12-26 05:39:01,181][123091] Updated weights for policy 0, policy_version 758841 (0.0010) [2023-12-26 05:39:01,235][123091] Updated weights for policy 0, policy_version 758851 (0.0010) [2023-12-26 05:39:01,304][123091] Updated weights for policy 0, policy_version 758861 (0.0010) [2023-12-26 05:39:01,865][123090] Updated weights for policy 1, policy_version 754026 (0.0009) [2023-12-26 05:39:01,922][123090] Updated weights for policy 1, policy_version 754036 (0.0008) [2023-12-26 05:39:01,971][123090] Updated weights for policy 1, policy_version 754046 (0.0009) [2023-12-26 05:39:02,179][123091] Updated weights for policy 0, policy_version 758871 (0.0010) [2023-12-26 05:39:02,232][123091] Updated weights for policy 0, policy_version 758881 (0.0009) [2023-12-26 05:39:02,292][123091] Updated weights for policy 0, policy_version 758891 (0.0009) [2023-12-26 05:39:02,824][123090] Updated weights for policy 1, policy_version 754056 (0.0009) [2023-12-26 05:39:02,873][123090] Updated weights for policy 1, policy_version 754066 (0.0009) [2023-12-26 05:39:02,924][123090] Updated weights for policy 1, policy_version 754077 (0.0009) [2023-12-26 05:39:03,130][123091] Updated weights for policy 0, policy_version 758901 (0.0009) [2023-12-26 05:39:03,185][123091] Updated weights for policy 0, policy_version 758911 (0.0010) [2023-12-26 05:39:03,238][123091] Updated weights for policy 0, policy_version 758922 (0.0010) [2023-12-26 05:39:03,769][123090] Updated weights for policy 1, policy_version 754087 (0.0007) [2023-12-26 05:39:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 387334144. Throughput: 0: 8837.9, 1: 8667.5. Samples: 387349280. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:03,784][121949] Avg episode reward: [(0, '5939.932'), (1, '4902.113')] [2023-12-26 05:39:03,842][123090] Updated weights for policy 1, policy_version 754097 (0.0006) [2023-12-26 05:39:03,911][123090] Updated weights for policy 1, policy_version 754107 (0.0005) [2023-12-26 05:39:04,058][123091] Updated weights for policy 0, policy_version 758933 (0.0010) [2023-12-26 05:39:04,121][123091] Updated weights for policy 0, policy_version 758943 (0.0011) [2023-12-26 05:39:04,183][123091] Updated weights for policy 0, policy_version 758953 (0.0011) [2023-12-26 05:39:04,598][123090] Updated weights for policy 1, policy_version 754117 (0.0008) [2023-12-26 05:39:04,650][123090] Updated weights for policy 1, policy_version 754127 (0.0010) [2023-12-26 05:39:04,718][123090] Updated weights for policy 1, policy_version 754137 (0.0009) [2023-12-26 05:39:04,986][123091] Updated weights for policy 0, policy_version 758963 (0.0011) [2023-12-26 05:39:05,042][123091] Updated weights for policy 0, policy_version 758973 (0.0009) [2023-12-26 05:39:05,095][123091] Updated weights for policy 0, policy_version 758983 (0.0009) [2023-12-26 05:39:05,598][123090] Updated weights for policy 1, policy_version 754147 (0.0008) [2023-12-26 05:39:05,668][123090] Updated weights for policy 1, policy_version 754157 (0.0009) [2023-12-26 05:39:05,731][123090] Updated weights for policy 1, policy_version 754167 (0.0009) [2023-12-26 05:39:05,916][123091] Updated weights for policy 0, policy_version 758993 (0.0009) [2023-12-26 05:39:05,982][123091] Updated weights for policy 0, policy_version 759003 (0.0005) [2023-12-26 05:39:06,051][123091] Updated weights for policy 0, policy_version 759013 (0.0005) [2023-12-26 05:39:06,106][123091] Updated weights for policy 0, policy_version 759023 (0.0008) [2023-12-26 05:39:06,578][123090] Updated weights for policy 1, policy_version 754177 (0.0009) [2023-12-26 05:39:06,633][123090] Updated weights for policy 1, policy_version 754187 (0.0008) [2023-12-26 05:39:06,693][123090] Updated weights for policy 1, policy_version 754197 (0.0009) [2023-12-26 05:39:06,751][123090] Updated weights for policy 1, policy_version 754207 (0.0009) [2023-12-26 05:39:06,905][123091] Updated weights for policy 0, policy_version 759033 (0.0007) [2023-12-26 05:39:06,967][123091] Updated weights for policy 0, policy_version 759043 (0.0005) [2023-12-26 05:39:07,036][123091] Updated weights for policy 0, policy_version 759053 (0.0005) [2023-12-26 05:39:07,618][123090] Updated weights for policy 1, policy_version 754217 (0.0009) [2023-12-26 05:39:07,675][123090] Updated weights for policy 1, policy_version 754227 (0.0009) [2023-12-26 05:39:07,706][123091] Updated weights for policy 0, policy_version 759063 (0.0008) [2023-12-26 05:39:07,726][123090] Updated weights for policy 1, policy_version 754237 (0.0008) [2023-12-26 05:39:07,761][123091] Updated weights for policy 0, policy_version 759073 (0.0009) [2023-12-26 05:39:07,812][123091] Updated weights for policy 0, policy_version 759083 (0.0010) [2023-12-26 05:39:08,576][123090] Updated weights for policy 1, policy_version 754247 (0.0010) [2023-12-26 05:39:08,627][123091] Updated weights for policy 0, policy_version 759093 (0.0007) [2023-12-26 05:39:08,635][123090] Updated weights for policy 1, policy_version 754257 (0.0008) [2023-12-26 05:39:08,692][123091] Updated weights for policy 0, policy_version 759103 (0.0009) [2023-12-26 05:39:08,694][123090] Updated weights for policy 1, policy_version 754267 (0.0008) [2023-12-26 05:39:08,748][123091] Updated weights for policy 0, policy_version 759113 (0.0010) [2023-12-26 05:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 387432448. Throughput: 0: 8871.1, 1: 8696.1. Samples: 387401692. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:08,785][121949] Avg episode reward: [(0, '5936.828'), (1, '5022.032')] [2023-12-26 05:39:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000754272_193093632.pth... [2023-12-26 05:39:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000759120_194338816.pth... [2023-12-26 05:39:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000753248_192831488.pth [2023-12-26 05:39:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000758096_194076672.pth [2023-12-26 05:39:09,572][123090] Updated weights for policy 1, policy_version 754277 (0.0008) [2023-12-26 05:39:09,597][123091] Updated weights for policy 0, policy_version 759123 (0.0009) [2023-12-26 05:39:09,638][123090] Updated weights for policy 1, policy_version 754287 (0.0008) [2023-12-26 05:39:09,657][123091] Updated weights for policy 0, policy_version 759133 (0.0008) [2023-12-26 05:39:09,700][123090] Updated weights for policy 1, policy_version 754297 (0.0008) [2023-12-26 05:39:09,721][123091] Updated weights for policy 0, policy_version 759143 (0.0008) [2023-12-26 05:39:10,466][123091] Updated weights for policy 0, policy_version 759153 (0.0008) [2023-12-26 05:39:10,523][123091] Updated weights for policy 0, policy_version 759163 (0.0005) [2023-12-26 05:39:10,582][123091] Updated weights for policy 0, policy_version 759173 (0.0006) [2023-12-26 05:39:10,619][123090] Updated weights for policy 1, policy_version 754307 (0.0009) [2023-12-26 05:39:10,649][123091] Updated weights for policy 0, policy_version 759183 (0.0009) [2023-12-26 05:39:10,674][123090] Updated weights for policy 1, policy_version 754317 (0.0010) [2023-12-26 05:39:10,731][123090] Updated weights for policy 1, policy_version 754327 (0.0009) [2023-12-26 05:39:11,433][123091] Updated weights for policy 0, policy_version 759193 (0.0008) [2023-12-26 05:39:11,493][123091] Updated weights for policy 0, policy_version 759203 (0.0006) [2023-12-26 05:39:11,548][123091] Updated weights for policy 0, policy_version 759213 (0.0007) [2023-12-26 05:39:11,659][123090] Updated weights for policy 1, policy_version 754337 (0.0009) [2023-12-26 05:39:11,719][123090] Updated weights for policy 1, policy_version 754347 (0.0009) [2023-12-26 05:39:11,783][123090] Updated weights for policy 1, policy_version 754357 (0.0010) [2023-12-26 05:39:11,843][123090] Updated weights for policy 1, policy_version 754367 (0.0010) [2023-12-26 05:39:12,263][123091] Updated weights for policy 0, policy_version 759223 (0.0011) [2023-12-26 05:39:12,337][123091] Updated weights for policy 0, policy_version 759233 (0.0011) [2023-12-26 05:39:12,400][123091] Updated weights for policy 0, policy_version 759243 (0.0011) [2023-12-26 05:39:12,732][123090] Updated weights for policy 1, policy_version 754377 (0.0008) [2023-12-26 05:39:12,806][123090] Updated weights for policy 1, policy_version 754387 (0.0007) [2023-12-26 05:39:12,866][123090] Updated weights for policy 1, policy_version 754397 (0.0008) [2023-12-26 05:39:13,218][123091] Updated weights for policy 0, policy_version 759253 (0.0011) [2023-12-26 05:39:13,261][123091] Updated weights for policy 0, policy_version 759263 (0.0010) [2023-12-26 05:39:13,316][123091] Updated weights for policy 0, policy_version 759273 (0.0010) [2023-12-26 05:39:13,593][123090] Updated weights for policy 1, policy_version 754407 (0.0006) [2023-12-26 05:39:13,641][123090] Updated weights for policy 1, policy_version 754417 (0.0005) [2023-12-26 05:39:13,696][123090] Updated weights for policy 1, policy_version 754427 (0.0005) [2023-12-26 05:39:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 387514368. Throughput: 0: 8850.0, 1: 8650.7. Samples: 387503788. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:13,785][121949] Avg episode reward: [(0, '6106.580'), (1, '4993.246')] [2023-12-26 05:39:14,163][123091] Updated weights for policy 0, policy_version 759283 (0.0010) [2023-12-26 05:39:14,220][123091] Updated weights for policy 0, policy_version 759293 (0.0010) [2023-12-26 05:39:14,283][123091] Updated weights for policy 0, policy_version 759303 (0.0011) [2023-12-26 05:39:14,407][123090] Updated weights for policy 1, policy_version 754437 (0.0006) [2023-12-26 05:39:14,464][123090] Updated weights for policy 1, policy_version 754447 (0.0005) [2023-12-26 05:39:14,527][123090] Updated weights for policy 1, policy_version 754457 (0.0008) [2023-12-26 05:39:15,056][123091] Updated weights for policy 0, policy_version 759313 (0.0010) [2023-12-26 05:39:15,118][123091] Updated weights for policy 0, policy_version 759323 (0.0006) [2023-12-26 05:39:15,180][123091] Updated weights for policy 0, policy_version 759333 (0.0007) [2023-12-26 05:39:15,246][123091] Updated weights for policy 0, policy_version 759343 (0.0006) [2023-12-26 05:39:15,347][123090] Updated weights for policy 1, policy_version 754467 (0.0010) [2023-12-26 05:39:15,411][123090] Updated weights for policy 1, policy_version 754477 (0.0009) [2023-12-26 05:39:15,476][123090] Updated weights for policy 1, policy_version 754487 (0.0009) [2023-12-26 05:39:16,036][123091] Updated weights for policy 0, policy_version 759353 (0.0010) [2023-12-26 05:39:16,087][123091] Updated weights for policy 0, policy_version 759363 (0.0010) [2023-12-26 05:39:16,149][123091] Updated weights for policy 0, policy_version 759373 (0.0010) [2023-12-26 05:39:16,304][123090] Updated weights for policy 1, policy_version 754497 (0.0009) [2023-12-26 05:39:16,369][123090] Updated weights for policy 1, policy_version 754507 (0.0009) [2023-12-26 05:39:16,425][123090] Updated weights for policy 1, policy_version 754517 (0.0009) [2023-12-26 05:39:16,482][123090] Updated weights for policy 1, policy_version 754527 (0.0009) [2023-12-26 05:39:16,960][123091] Updated weights for policy 0, policy_version 759383 (0.0011) [2023-12-26 05:39:17,020][123091] Updated weights for policy 0, policy_version 759393 (0.0011) [2023-12-26 05:39:17,083][123091] Updated weights for policy 0, policy_version 759403 (0.0011) [2023-12-26 05:39:17,329][123090] Updated weights for policy 1, policy_version 754537 (0.0008) [2023-12-26 05:39:17,385][123090] Updated weights for policy 1, policy_version 754547 (0.0009) [2023-12-26 05:39:17,436][123090] Updated weights for policy 1, policy_version 754557 (0.0009) [2023-12-26 05:39:17,909][123091] Updated weights for policy 0, policy_version 759413 (0.0011) [2023-12-26 05:39:17,977][123091] Updated weights for policy 0, policy_version 759423 (0.0011) [2023-12-26 05:39:18,037][123091] Updated weights for policy 0, policy_version 759433 (0.0011) [2023-12-26 05:39:18,292][123090] Updated weights for policy 1, policy_version 754567 (0.0009) [2023-12-26 05:39:18,362][123090] Updated weights for policy 1, policy_version 754577 (0.0009) [2023-12-26 05:39:18,434][123090] Updated weights for policy 1, policy_version 754587 (0.0008) [2023-12-26 05:39:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 387596288. Throughput: 0: 8797.4, 1: 8645.6. Samples: 387608844. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:18,785][121949] Avg episode reward: [(0, '6198.089'), (1, '5131.020')] [2023-12-26 05:39:18,859][123091] Updated weights for policy 0, policy_version 759443 (0.0009) [2023-12-26 05:39:18,927][123091] Updated weights for policy 0, policy_version 759453 (0.0006) [2023-12-26 05:39:18,986][123091] Updated weights for policy 0, policy_version 759463 (0.0011) [2023-12-26 05:39:19,237][123090] Updated weights for policy 1, policy_version 754597 (0.0008) [2023-12-26 05:39:19,297][123090] Updated weights for policy 1, policy_version 754607 (0.0006) [2023-12-26 05:39:19,369][123090] Updated weights for policy 1, policy_version 754617 (0.0007) [2023-12-26 05:39:19,774][123091] Updated weights for policy 0, policy_version 759473 (0.0010) [2023-12-26 05:39:19,850][123091] Updated weights for policy 0, policy_version 759483 (0.0009) [2023-12-26 05:39:19,920][123091] Updated weights for policy 0, policy_version 759493 (0.0010) [2023-12-26 05:39:19,993][123091] Updated weights for policy 0, policy_version 759503 (0.0008) [2023-12-26 05:39:20,153][123090] Updated weights for policy 1, policy_version 754627 (0.0006) [2023-12-26 05:39:20,213][123090] Updated weights for policy 1, policy_version 754637 (0.0009) [2023-12-26 05:39:20,278][123090] Updated weights for policy 1, policy_version 754647 (0.0006) [2023-12-26 05:39:20,741][123091] Updated weights for policy 0, policy_version 759513 (0.0009) [2023-12-26 05:39:20,798][123091] Updated weights for policy 0, policy_version 759523 (0.0010) [2023-12-26 05:39:20,858][123091] Updated weights for policy 0, policy_version 759533 (0.0009) [2023-12-26 05:39:21,144][123090] Updated weights for policy 1, policy_version 754657 (0.0009) [2023-12-26 05:39:21,211][123090] Updated weights for policy 1, policy_version 754667 (0.0010) [2023-12-26 05:39:21,275][123090] Updated weights for policy 1, policy_version 754677 (0.0009) [2023-12-26 05:39:21,343][123090] Updated weights for policy 1, policy_version 754687 (0.0009) [2023-12-26 05:39:21,649][123091] Updated weights for policy 0, policy_version 759543 (0.0009) [2023-12-26 05:39:21,719][123091] Updated weights for policy 0, policy_version 759553 (0.0009) [2023-12-26 05:39:21,795][123091] Updated weights for policy 0, policy_version 759563 (0.0009) [2023-12-26 05:39:22,145][123090] Updated weights for policy 1, policy_version 754697 (0.0008) [2023-12-26 05:39:22,200][123090] Updated weights for policy 1, policy_version 754707 (0.0008) [2023-12-26 05:39:22,269][123090] Updated weights for policy 1, policy_version 754717 (0.0008) [2023-12-26 05:39:22,692][123091] Updated weights for policy 0, policy_version 759573 (0.0010) [2023-12-26 05:39:22,760][123091] Updated weights for policy 0, policy_version 759583 (0.0010) [2023-12-26 05:39:22,826][123091] Updated weights for policy 0, policy_version 759593 (0.0009) [2023-12-26 05:39:23,072][123090] Updated weights for policy 1, policy_version 754727 (0.0008) [2023-12-26 05:39:23,136][123090] Updated weights for policy 1, policy_version 754737 (0.0008) [2023-12-26 05:39:23,207][123090] Updated weights for policy 1, policy_version 754747 (0.0009) [2023-12-26 05:39:23,719][123091] Updated weights for policy 0, policy_version 759603 (0.0010) [2023-12-26 05:39:23,767][123091] Updated weights for policy 0, policy_version 759613 (0.0009) [2023-12-26 05:39:23,784][121949] Fps is (10 sec: 16383.4, 60 sec: 17339.6, 300 sec: 17661.4). Total num frames: 387678208. Throughput: 0: 8776.9, 1: 8662.8. Samples: 387661180. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:23,785][121949] Avg episode reward: [(0, '6027.547'), (1, '5259.561')] [2023-12-26 05:39:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000754752_193216512.pth... [2023-12-26 05:39:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000753760_192962560.pth [2023-12-26 05:39:23,820][123091] Updated weights for policy 0, policy_version 759623 (0.0010) [2023-12-26 05:39:23,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000759632_194469888.pth... [2023-12-26 05:39:23,865][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000758608_194207744.pth [2023-12-26 05:39:23,892][123090] Updated weights for policy 1, policy_version 754757 (0.0009) [2023-12-26 05:39:23,960][123090] Updated weights for policy 1, policy_version 754767 (0.0009) [2023-12-26 05:39:24,028][123090] Updated weights for policy 1, policy_version 754777 (0.0009) [2023-12-26 05:39:24,690][123091] Updated weights for policy 0, policy_version 759633 (0.0009) [2023-12-26 05:39:24,761][123091] Updated weights for policy 0, policy_version 759643 (0.0007) [2023-12-26 05:39:24,825][123091] Updated weights for policy 0, policy_version 759653 (0.0010) [2023-12-26 05:39:24,848][123090] Updated weights for policy 1, policy_version 754787 (0.0009) [2023-12-26 05:39:24,886][123091] Updated weights for policy 0, policy_version 759663 (0.0007) [2023-12-26 05:39:24,915][123090] Updated weights for policy 1, policy_version 754797 (0.0009) [2023-12-26 05:39:24,987][123090] Updated weights for policy 1, policy_version 754807 (0.0010) [2023-12-26 05:39:25,683][123091] Updated weights for policy 0, policy_version 759673 (0.0009) [2023-12-26 05:39:25,738][123091] Updated weights for policy 0, policy_version 759683 (0.0009) [2023-12-26 05:39:25,786][123090] Updated weights for policy 1, policy_version 754817 (0.0010) [2023-12-26 05:39:25,794][123091] Updated weights for policy 0, policy_version 759693 (0.0008) [2023-12-26 05:39:25,843][123090] Updated weights for policy 1, policy_version 754827 (0.0009) [2023-12-26 05:39:25,891][123090] Updated weights for policy 1, policy_version 754837 (0.0009) [2023-12-26 05:39:25,944][123090] Updated weights for policy 1, policy_version 754847 (0.0010) [2023-12-26 05:39:26,626][123091] Updated weights for policy 0, policy_version 759703 (0.0007) [2023-12-26 05:39:26,687][123091] Updated weights for policy 0, policy_version 759713 (0.0009) [2023-12-26 05:39:26,743][123091] Updated weights for policy 0, policy_version 759723 (0.0007) [2023-12-26 05:39:26,804][123090] Updated weights for policy 1, policy_version 754857 (0.0006) [2023-12-26 05:39:26,850][123090] Updated weights for policy 1, policy_version 754867 (0.0005) [2023-12-26 05:39:26,908][123090] Updated weights for policy 1, policy_version 754877 (0.0005) [2023-12-26 05:39:27,486][123091] Updated weights for policy 0, policy_version 759733 (0.0007) [2023-12-26 05:39:27,540][123091] Updated weights for policy 0, policy_version 759743 (0.0009) [2023-12-26 05:39:27,591][123091] Updated weights for policy 0, policy_version 759753 (0.0008) [2023-12-26 05:39:27,607][123090] Updated weights for policy 1, policy_version 754887 (0.0008) [2023-12-26 05:39:27,668][123090] Updated weights for policy 1, policy_version 754897 (0.0010) [2023-12-26 05:39:27,720][123090] Updated weights for policy 1, policy_version 754907 (0.0009) [2023-12-26 05:39:28,372][123091] Updated weights for policy 0, policy_version 759763 (0.0008) [2023-12-26 05:39:28,425][123091] Updated weights for policy 0, policy_version 759773 (0.0010) [2023-12-26 05:39:28,484][123091] Updated weights for policy 0, policy_version 759783 (0.0009) [2023-12-26 05:39:28,582][123090] Updated weights for policy 1, policy_version 754917 (0.0010) [2023-12-26 05:39:28,636][123090] Updated weights for policy 1, policy_version 754927 (0.0009) [2023-12-26 05:39:28,696][123090] Updated weights for policy 1, policy_version 754937 (0.0009) [2023-12-26 05:39:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 387776512. Throughput: 0: 8718.9, 1: 8658.7. Samples: 387764420. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:28,785][121949] Avg episode reward: [(0, '6023.502'), (1, '5403.576')] [2023-12-26 05:39:29,313][123091] Updated weights for policy 0, policy_version 759793 (0.0009) [2023-12-26 05:39:29,381][123091] Updated weights for policy 0, policy_version 759803 (0.0009) [2023-12-26 05:39:29,440][123091] Updated weights for policy 0, policy_version 759813 (0.0009) [2023-12-26 05:39:29,500][123091] Updated weights for policy 0, policy_version 759823 (0.0008) [2023-12-26 05:39:29,536][123090] Updated weights for policy 1, policy_version 754947 (0.0009) [2023-12-26 05:39:29,587][123090] Updated weights for policy 1, policy_version 754957 (0.0009) [2023-12-26 05:39:29,639][123090] Updated weights for policy 1, policy_version 754967 (0.0010) [2023-12-26 05:39:30,344][123091] Updated weights for policy 0, policy_version 759833 (0.0010) [2023-12-26 05:39:30,409][123091] Updated weights for policy 0, policy_version 759843 (0.0010) [2023-12-26 05:39:30,471][123091] Updated weights for policy 0, policy_version 759853 (0.0008) [2023-12-26 05:39:30,513][123090] Updated weights for policy 1, policy_version 754977 (0.0010) [2023-12-26 05:39:30,564][123090] Updated weights for policy 1, policy_version 754987 (0.0009) [2023-12-26 05:39:30,619][123090] Updated weights for policy 1, policy_version 754999 (0.0010) [2023-12-26 05:39:31,280][123091] Updated weights for policy 0, policy_version 759863 (0.0010) [2023-12-26 05:39:31,339][123091] Updated weights for policy 0, policy_version 759873 (0.0010) [2023-12-26 05:39:31,411][123091] Updated weights for policy 0, policy_version 759883 (0.0008) [2023-12-26 05:39:31,483][123090] Updated weights for policy 1, policy_version 755009 (0.0009) [2023-12-26 05:39:31,537][123090] Updated weights for policy 1, policy_version 755019 (0.0010) [2023-12-26 05:39:31,590][123090] Updated weights for policy 1, policy_version 755030 (0.0010) [2023-12-26 05:39:31,658][123090] Updated weights for policy 1, policy_version 755040 (0.0010) [2023-12-26 05:39:32,137][123091] Updated weights for policy 0, policy_version 759893 (0.0007) [2023-12-26 05:39:32,196][123091] Updated weights for policy 0, policy_version 759903 (0.0005) [2023-12-26 05:39:32,262][123091] Updated weights for policy 0, policy_version 759913 (0.0006) [2023-12-26 05:39:32,498][123090] Updated weights for policy 1, policy_version 755050 (0.0009) [2023-12-26 05:39:32,567][123090] Updated weights for policy 1, policy_version 755060 (0.0010) [2023-12-26 05:39:32,639][123090] Updated weights for policy 1, policy_version 755070 (0.0009) [2023-12-26 05:39:33,006][123091] Updated weights for policy 0, policy_version 759923 (0.0008) [2023-12-26 05:39:33,058][123091] Updated weights for policy 0, policy_version 759933 (0.0009) [2023-12-26 05:39:33,105][123091] Updated weights for policy 0, policy_version 759943 (0.0008) [2023-12-26 05:39:33,490][123090] Updated weights for policy 1, policy_version 755080 (0.0009) [2023-12-26 05:39:33,549][123090] Updated weights for policy 1, policy_version 755091 (0.0009) [2023-12-26 05:39:33,598][123090] Updated weights for policy 1, policy_version 755101 (0.0009) [2023-12-26 05:39:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 387858432. Throughput: 0: 8731.3, 1: 8599.0. Samples: 387868968. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:33,785][121949] Avg episode reward: [(0, '6075.701'), (1, '5356.411')] [2023-12-26 05:39:33,877][123091] Updated weights for policy 0, policy_version 759953 (0.0006) [2023-12-26 05:39:33,939][123091] Updated weights for policy 0, policy_version 759963 (0.0009) [2023-12-26 05:39:33,987][123091] Updated weights for policy 0, policy_version 759973 (0.0009) [2023-12-26 05:39:34,034][123091] Updated weights for policy 0, policy_version 759983 (0.0009) [2023-12-26 05:39:34,442][123090] Updated weights for policy 1, policy_version 755111 (0.0009) [2023-12-26 05:39:34,506][123090] Updated weights for policy 1, policy_version 755121 (0.0010) [2023-12-26 05:39:34,572][123090] Updated weights for policy 1, policy_version 755131 (0.0009) [2023-12-26 05:39:34,819][123091] Updated weights for policy 0, policy_version 759993 (0.0010) [2023-12-26 05:39:34,889][123091] Updated weights for policy 0, policy_version 760003 (0.0010) [2023-12-26 05:39:34,954][123091] Updated weights for policy 0, policy_version 760013 (0.0009) [2023-12-26 05:39:35,459][123090] Updated weights for policy 1, policy_version 755141 (0.0010) [2023-12-26 05:39:35,512][123090] Updated weights for policy 1, policy_version 755151 (0.0009) [2023-12-26 05:39:35,570][123090] Updated weights for policy 1, policy_version 755161 (0.0009) [2023-12-26 05:39:35,746][123091] Updated weights for policy 0, policy_version 760023 (0.0009) [2023-12-26 05:39:35,806][123091] Updated weights for policy 0, policy_version 760033 (0.0010) [2023-12-26 05:39:35,864][123091] Updated weights for policy 0, policy_version 760043 (0.0009) [2023-12-26 05:39:36,464][123090] Updated weights for policy 1, policy_version 755171 (0.0010) [2023-12-26 05:39:36,530][123090] Updated weights for policy 1, policy_version 755181 (0.0009) [2023-12-26 05:39:36,596][123090] Updated weights for policy 1, policy_version 755191 (0.0009) [2023-12-26 05:39:36,662][123091] Updated weights for policy 0, policy_version 760053 (0.0007) [2023-12-26 05:39:36,716][123091] Updated weights for policy 0, policy_version 760063 (0.0005) [2023-12-26 05:39:36,764][123091] Updated weights for policy 0, policy_version 760073 (0.0005) [2023-12-26 05:39:37,477][123090] Updated weights for policy 1, policy_version 755201 (0.0009) [2023-12-26 05:39:37,534][123090] Updated weights for policy 1, policy_version 755211 (0.0009) [2023-12-26 05:39:37,539][123091] Updated weights for policy 0, policy_version 760083 (0.0007) [2023-12-26 05:39:37,583][123090] Updated weights for policy 1, policy_version 755221 (0.0008) [2023-12-26 05:39:37,585][123091] Updated weights for policy 0, policy_version 760093 (0.0008) [2023-12-26 05:39:37,631][123091] Updated weights for policy 0, policy_version 760103 (0.0006) [2023-12-26 05:39:37,632][123090] Updated weights for policy 1, policy_version 755231 (0.0007) [2023-12-26 05:39:38,459][123090] Updated weights for policy 1, policy_version 755241 (0.0009) [2023-12-26 05:39:38,518][123090] Updated weights for policy 1, policy_version 755251 (0.0010) [2023-12-26 05:39:38,530][123091] Updated weights for policy 0, policy_version 760113 (0.0008) [2023-12-26 05:39:38,578][123090] Updated weights for policy 1, policy_version 755261 (0.0009) [2023-12-26 05:39:38,589][123091] Updated weights for policy 0, policy_version 760123 (0.0008) [2023-12-26 05:39:38,651][123091] Updated weights for policy 0, policy_version 760133 (0.0009) [2023-12-26 05:39:38,708][123091] Updated weights for policy 0, policy_version 760143 (0.0009) [2023-12-26 05:39:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17716.9). Total num frames: 387948544. Throughput: 0: 8785.2, 1: 8569.2. Samples: 387920520. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:38,785][121949] Avg episode reward: [(0, '6092.283'), (1, '5315.130')] [2023-12-26 05:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000760144_194600960.pth... [2023-12-26 05:39:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000755264_193347584.pth... [2023-12-26 05:39:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000759120_194338816.pth [2023-12-26 05:39:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000754272_193093632.pth [2023-12-26 05:39:39,435][123090] Updated weights for policy 1, policy_version 755271 (0.0009) [2023-12-26 05:39:39,488][123090] Updated weights for policy 1, policy_version 755281 (0.0008) [2023-12-26 05:39:39,546][123090] Updated weights for policy 1, policy_version 755291 (0.0008) [2023-12-26 05:39:39,605][123091] Updated weights for policy 0, policy_version 760153 (0.0008) [2023-12-26 05:39:39,658][123091] Updated weights for policy 0, policy_version 760163 (0.0009) [2023-12-26 05:39:39,721][123091] Updated weights for policy 0, policy_version 760173 (0.0008) [2023-12-26 05:39:40,412][123090] Updated weights for policy 1, policy_version 755301 (0.0008) [2023-12-26 05:39:40,468][123090] Updated weights for policy 1, policy_version 755311 (0.0009) [2023-12-26 05:39:40,531][123090] Updated weights for policy 1, policy_version 755321 (0.0011) [2023-12-26 05:39:40,567][123091] Updated weights for policy 0, policy_version 760183 (0.0009) [2023-12-26 05:39:40,627][123091] Updated weights for policy 0, policy_version 760193 (0.0009) [2023-12-26 05:39:40,679][123091] Updated weights for policy 0, policy_version 760203 (0.0009) [2023-12-26 05:39:41,354][123090] Updated weights for policy 1, policy_version 755331 (0.0010) [2023-12-26 05:39:41,424][123090] Updated weights for policy 1, policy_version 755341 (0.0008) [2023-12-26 05:39:41,480][123090] Updated weights for policy 1, policy_version 755351 (0.0008) [2023-12-26 05:39:41,489][123091] Updated weights for policy 0, policy_version 760213 (0.0009) [2023-12-26 05:39:41,560][123091] Updated weights for policy 0, policy_version 760223 (0.0007) [2023-12-26 05:39:41,659][123091] Updated weights for policy 0, policy_version 760233 (0.0010) [2023-12-26 05:39:42,263][123090] Updated weights for policy 1, policy_version 755361 (0.0008) [2023-12-26 05:39:42,326][123090] Updated weights for policy 1, policy_version 755371 (0.0010) [2023-12-26 05:39:42,368][123091] Updated weights for policy 0, policy_version 760243 (0.0009) [2023-12-26 05:39:42,402][123090] Updated weights for policy 1, policy_version 755381 (0.0008) [2023-12-26 05:39:42,430][123091] Updated weights for policy 0, policy_version 760253 (0.0007) [2023-12-26 05:39:42,475][123090] Updated weights for policy 1, policy_version 755391 (0.0007) [2023-12-26 05:39:42,489][123091] Updated weights for policy 0, policy_version 760264 (0.0010) [2023-12-26 05:39:43,246][123091] Updated weights for policy 0, policy_version 760274 (0.0009) [2023-12-26 05:39:43,299][123090] Updated weights for policy 1, policy_version 755401 (0.0009) [2023-12-26 05:39:43,316][123091] Updated weights for policy 0, policy_version 760284 (0.0008) [2023-12-26 05:39:43,361][123090] Updated weights for policy 1, policy_version 755411 (0.0009) [2023-12-26 05:39:43,382][123091] Updated weights for policy 0, policy_version 760294 (0.0007) [2023-12-26 05:39:43,427][123090] Updated weights for policy 1, policy_version 755421 (0.0009) [2023-12-26 05:39:43,447][123091] Updated weights for policy 0, policy_version 760304 (0.0006) [2023-12-26 05:39:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 388030464. Throughput: 0: 8742.8, 1: 8504.6. Samples: 388023580. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:43,785][121949] Avg episode reward: [(0, '6019.791'), (1, '5367.717')] [2023-12-26 05:39:44,160][123090] Updated weights for policy 1, policy_version 755431 (0.0006) [2023-12-26 05:39:44,183][123091] Updated weights for policy 0, policy_version 760314 (0.0005) [2023-12-26 05:39:44,221][123090] Updated weights for policy 1, policy_version 755441 (0.0005) [2023-12-26 05:39:44,250][123091] Updated weights for policy 0, policy_version 760324 (0.0006) [2023-12-26 05:39:44,281][123090] Updated weights for policy 1, policy_version 755451 (0.0005) [2023-12-26 05:39:44,315][123091] Updated weights for policy 0, policy_version 760334 (0.0005) [2023-12-26 05:39:44,981][123090] Updated weights for policy 1, policy_version 755461 (0.0006) [2023-12-26 05:39:44,995][123091] Updated weights for policy 0, policy_version 760344 (0.0009) [2023-12-26 05:39:45,050][123090] Updated weights for policy 1, policy_version 755471 (0.0007) [2023-12-26 05:39:45,063][123091] Updated weights for policy 0, policy_version 760354 (0.0010) [2023-12-26 05:39:45,105][123090] Updated weights for policy 1, policy_version 755481 (0.0008) [2023-12-26 05:39:45,121][123091] Updated weights for policy 0, policy_version 760364 (0.0008) [2023-12-26 05:39:45,939][123091] Updated weights for policy 0, policy_version 760374 (0.0007) [2023-12-26 05:39:45,961][123090] Updated weights for policy 1, policy_version 755491 (0.0010) [2023-12-26 05:39:46,006][123091] Updated weights for policy 0, policy_version 760384 (0.0006) [2023-12-26 05:39:46,028][123090] Updated weights for policy 1, policy_version 755501 (0.0008) [2023-12-26 05:39:46,066][123091] Updated weights for policy 0, policy_version 760394 (0.0009) [2023-12-26 05:39:46,078][123090] Updated weights for policy 1, policy_version 755511 (0.0009) [2023-12-26 05:39:46,672][123091] Updated weights for policy 0, policy_version 760404 (0.0009) [2023-12-26 05:39:46,741][123091] Updated weights for policy 0, policy_version 760414 (0.0006) [2023-12-26 05:39:46,794][123091] Updated weights for policy 0, policy_version 760424 (0.0005) [2023-12-26 05:39:46,949][123090] Updated weights for policy 1, policy_version 755521 (0.0009) [2023-12-26 05:39:47,006][123090] Updated weights for policy 1, policy_version 755531 (0.0008) [2023-12-26 05:39:47,073][123090] Updated weights for policy 1, policy_version 755541 (0.0009) [2023-12-26 05:39:47,134][123090] Updated weights for policy 1, policy_version 755551 (0.0010) [2023-12-26 05:39:47,551][123091] Updated weights for policy 0, policy_version 760434 (0.0006) [2023-12-26 05:39:47,605][123091] Updated weights for policy 0, policy_version 760444 (0.0009) [2023-12-26 05:39:47,661][123091] Updated weights for policy 0, policy_version 760454 (0.0009) [2023-12-26 05:39:47,716][123091] Updated weights for policy 0, policy_version 760464 (0.0008) [2023-12-26 05:39:47,939][123090] Updated weights for policy 1, policy_version 755561 (0.0005) [2023-12-26 05:39:47,992][123090] Updated weights for policy 1, policy_version 755571 (0.0005) [2023-12-26 05:39:48,061][123090] Updated weights for policy 1, policy_version 755581 (0.0005) [2023-12-26 05:39:48,543][123091] Updated weights for policy 0, policy_version 760474 (0.0011) [2023-12-26 05:39:48,607][123091] Updated weights for policy 0, policy_version 760484 (0.0006) [2023-12-26 05:39:48,661][123091] Updated weights for policy 0, policy_version 760494 (0.0006) [2023-12-26 05:39:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 388120576. Throughput: 0: 8864.5, 1: 8569.5. Samples: 388133812. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:48,785][121949] Avg episode reward: [(0, '5974.837'), (1, '5439.723')] [2023-12-26 05:39:48,801][123090] Updated weights for policy 1, policy_version 755591 (0.0007) [2023-12-26 05:39:48,871][123090] Updated weights for policy 1, policy_version 755601 (0.0009) [2023-12-26 05:39:48,933][123090] Updated weights for policy 1, policy_version 755611 (0.0006) [2023-12-26 05:39:49,385][123091] Updated weights for policy 0, policy_version 760504 (0.0010) [2023-12-26 05:39:49,448][123091] Updated weights for policy 0, policy_version 760514 (0.0011) [2023-12-26 05:39:49,511][123091] Updated weights for policy 0, policy_version 760524 (0.0010) [2023-12-26 05:39:49,738][123090] Updated weights for policy 1, policy_version 755621 (0.0006) [2023-12-26 05:39:49,798][123090] Updated weights for policy 1, policy_version 755631 (0.0005) [2023-12-26 05:39:49,866][123090] Updated weights for policy 1, policy_version 755641 (0.0009) [2023-12-26 05:39:50,233][123091] Updated weights for policy 0, policy_version 760534 (0.0009) [2023-12-26 05:39:50,288][123091] Updated weights for policy 0, policy_version 760544 (0.0010) [2023-12-26 05:39:50,356][123091] Updated weights for policy 0, policy_version 760554 (0.0013) [2023-12-26 05:39:50,629][123090] Updated weights for policy 1, policy_version 755651 (0.0010) [2023-12-26 05:39:50,685][123090] Updated weights for policy 1, policy_version 755661 (0.0009) [2023-12-26 05:39:50,744][123090] Updated weights for policy 1, policy_version 755671 (0.0009) [2023-12-26 05:39:51,082][123091] Updated weights for policy 0, policy_version 760564 (0.0010) [2023-12-26 05:39:51,152][123091] Updated weights for policy 0, policy_version 760574 (0.0007) [2023-12-26 05:39:51,223][123091] Updated weights for policy 0, policy_version 760584 (0.0005) [2023-12-26 05:39:51,568][123090] Updated weights for policy 1, policy_version 755681 (0.0010) [2023-12-26 05:39:51,625][123090] Updated weights for policy 1, policy_version 755691 (0.0009) [2023-12-26 05:39:51,698][123090] Updated weights for policy 1, policy_version 755701 (0.0009) [2023-12-26 05:39:51,775][123090] Updated weights for policy 1, policy_version 755711 (0.0009) [2023-12-26 05:39:52,020][123091] Updated weights for policy 0, policy_version 760594 (0.0007) [2023-12-26 05:39:52,086][123091] Updated weights for policy 0, policy_version 760604 (0.0009) [2023-12-26 05:39:52,155][123091] Updated weights for policy 0, policy_version 760614 (0.0010) [2023-12-26 05:39:52,219][123091] Updated weights for policy 0, policy_version 760624 (0.0010) [2023-12-26 05:39:52,603][123090] Updated weights for policy 1, policy_version 755721 (0.0010) [2023-12-26 05:39:52,676][123090] Updated weights for policy 1, policy_version 755731 (0.0011) [2023-12-26 05:39:52,748][123090] Updated weights for policy 1, policy_version 755741 (0.0011) [2023-12-26 05:39:52,982][123091] Updated weights for policy 0, policy_version 760634 (0.0009) [2023-12-26 05:39:53,037][123091] Updated weights for policy 0, policy_version 760644 (0.0009) [2023-12-26 05:39:53,088][123091] Updated weights for policy 0, policy_version 760654 (0.0007) [2023-12-26 05:39:53,564][123090] Updated weights for policy 1, policy_version 755751 (0.0010) [2023-12-26 05:39:53,626][123090] Updated weights for policy 1, policy_version 755761 (0.0010) [2023-12-26 05:39:53,683][123090] Updated weights for policy 1, policy_version 755771 (0.0011) [2023-12-26 05:39:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 388210688. Throughput: 0: 8894.5, 1: 8570.3. Samples: 388187608. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:53,785][121949] Avg episode reward: [(0, '6114.815'), (1, '5286.881')] [2023-12-26 05:39:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000755776_193478656.pth... [2023-12-26 05:39:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000754752_193216512.pth [2023-12-26 05:39:53,804][123091] Updated weights for policy 0, policy_version 760664 (0.0005) [2023-12-26 05:39:53,861][123091] Updated weights for policy 0, policy_version 760674 (0.0005) [2023-12-26 05:39:53,920][123091] Updated weights for policy 0, policy_version 760684 (0.0005) [2023-12-26 05:39:53,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000760688_194740224.pth... [2023-12-26 05:39:53,953][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000759632_194469888.pth [2023-12-26 05:39:54,369][123090] Updated weights for policy 1, policy_version 755781 (0.0006) [2023-12-26 05:39:54,439][123090] Updated weights for policy 1, policy_version 755791 (0.0005) [2023-12-26 05:39:54,507][123090] Updated weights for policy 1, policy_version 755801 (0.0005) [2023-12-26 05:39:54,623][123091] Updated weights for policy 0, policy_version 760694 (0.0005) [2023-12-26 05:39:54,682][123091] Updated weights for policy 0, policy_version 760704 (0.0005) [2023-12-26 05:39:54,736][123091] Updated weights for policy 0, policy_version 760714 (0.0005) [2023-12-26 05:39:55,145][123090] Updated weights for policy 1, policy_version 755811 (0.0006) [2023-12-26 05:39:55,211][123090] Updated weights for policy 1, policy_version 755821 (0.0007) [2023-12-26 05:39:55,274][123090] Updated weights for policy 1, policy_version 755831 (0.0005) [2023-12-26 05:39:55,398][123091] Updated weights for policy 0, policy_version 760724 (0.0005) [2023-12-26 05:39:55,466][123091] Updated weights for policy 0, policy_version 760734 (0.0008) [2023-12-26 05:39:55,530][123091] Updated weights for policy 0, policy_version 760744 (0.0011) [2023-12-26 05:39:55,910][123090] Updated weights for policy 1, policy_version 755841 (0.0005) [2023-12-26 05:39:55,959][123090] Updated weights for policy 1, policy_version 755851 (0.0005) [2023-12-26 05:39:56,011][123090] Updated weights for policy 1, policy_version 755861 (0.0005) [2023-12-26 05:39:56,078][123090] Updated weights for policy 1, policy_version 755871 (0.0008) [2023-12-26 05:39:56,155][123091] Updated weights for policy 0, policy_version 760754 (0.0011) [2023-12-26 05:39:56,220][123091] Updated weights for policy 0, policy_version 760764 (0.0009) [2023-12-26 05:39:56,287][123091] Updated weights for policy 0, policy_version 760774 (0.0007) [2023-12-26 05:39:56,352][123091] Updated weights for policy 0, policy_version 760784 (0.0009) [2023-12-26 05:39:56,826][123090] Updated weights for policy 1, policy_version 755881 (0.0009) [2023-12-26 05:39:56,880][123090] Updated weights for policy 1, policy_version 755891 (0.0008) [2023-12-26 05:39:56,929][123090] Updated weights for policy 1, policy_version 755901 (0.0009) [2023-12-26 05:39:57,141][123091] Updated weights for policy 0, policy_version 760794 (0.0011) [2023-12-26 05:39:57,200][123091] Updated weights for policy 0, policy_version 760804 (0.0011) [2023-12-26 05:39:57,261][123091] Updated weights for policy 0, policy_version 760814 (0.0010) [2023-12-26 05:39:57,606][123090] Updated weights for policy 1, policy_version 755911 (0.0005) [2023-12-26 05:39:57,655][123090] Updated weights for policy 1, policy_version 755921 (0.0005) [2023-12-26 05:39:57,705][123090] Updated weights for policy 1, policy_version 755931 (0.0005) [2023-12-26 05:39:58,043][123091] Updated weights for policy 0, policy_version 760824 (0.0008) [2023-12-26 05:39:58,102][123091] Updated weights for policy 0, policy_version 760834 (0.0008) [2023-12-26 05:39:58,165][123091] Updated weights for policy 0, policy_version 760844 (0.0008) [2023-12-26 05:39:58,423][123090] Updated weights for policy 1, policy_version 755941 (0.0006) [2023-12-26 05:39:58,494][123090] Updated weights for policy 1, policy_version 755951 (0.0007) [2023-12-26 05:39:58,560][123090] Updated weights for policy 1, policy_version 755961 (0.0009) [2023-12-26 05:39:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 388308992. Throughput: 0: 8958.8, 1: 8745.5. Samples: 388300484. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:39:58,785][121949] Avg episode reward: [(0, '6186.342'), (1, '5533.795')] [2023-12-26 05:39:58,967][123091] Updated weights for policy 0, policy_version 760854 (0.0009) [2023-12-26 05:39:59,033][123091] Updated weights for policy 0, policy_version 760864 (0.0009) [2023-12-26 05:39:59,100][123091] Updated weights for policy 0, policy_version 760874 (0.0010) [2023-12-26 05:39:59,472][123090] Updated weights for policy 1, policy_version 755971 (0.0009) [2023-12-26 05:39:59,531][123090] Updated weights for policy 1, policy_version 755981 (0.0009) [2023-12-26 05:39:59,592][123090] Updated weights for policy 1, policy_version 755991 (0.0010) [2023-12-26 05:39:59,899][123091] Updated weights for policy 0, policy_version 760884 (0.0008) [2023-12-26 05:39:59,971][123091] Updated weights for policy 0, policy_version 760894 (0.0007) [2023-12-26 05:40:00,032][123091] Updated weights for policy 0, policy_version 760904 (0.0006) [2023-12-26 05:40:00,428][123090] Updated weights for policy 1, policy_version 756001 (0.0009) [2023-12-26 05:40:00,476][123090] Updated weights for policy 1, policy_version 756011 (0.0010) [2023-12-26 05:40:00,528][123090] Updated weights for policy 1, policy_version 756021 (0.0010) [2023-12-26 05:40:00,584][123090] Updated weights for policy 1, policy_version 756031 (0.0009) [2023-12-26 05:40:00,814][123091] Updated weights for policy 0, policy_version 760914 (0.0006) [2023-12-26 05:40:00,867][123091] Updated weights for policy 0, policy_version 760924 (0.0007) [2023-12-26 05:40:00,929][123091] Updated weights for policy 0, policy_version 760934 (0.0007) [2023-12-26 05:40:00,977][123091] Updated weights for policy 0, policy_version 760944 (0.0010) [2023-12-26 05:40:01,340][123090] Updated weights for policy 1, policy_version 756041 (0.0010) [2023-12-26 05:40:01,415][123090] Updated weights for policy 1, policy_version 756051 (0.0008) [2023-12-26 05:40:01,480][123090] Updated weights for policy 1, policy_version 756061 (0.0008) [2023-12-26 05:40:01,804][123091] Updated weights for policy 0, policy_version 760954 (0.0010) [2023-12-26 05:40:01,855][123091] Updated weights for policy 0, policy_version 760965 (0.0008) [2023-12-26 05:40:01,913][123091] Updated weights for policy 0, policy_version 760975 (0.0005) [2023-12-26 05:40:02,228][123090] Updated weights for policy 1, policy_version 756071 (0.0007) [2023-12-26 05:40:02,291][123090] Updated weights for policy 1, policy_version 756081 (0.0006) [2023-12-26 05:40:02,371][123090] Updated weights for policy 1, policy_version 756091 (0.0007) [2023-12-26 05:40:02,641][123091] Updated weights for policy 0, policy_version 760985 (0.0009) [2023-12-26 05:40:02,699][123091] Updated weights for policy 0, policy_version 760995 (0.0010) [2023-12-26 05:40:02,761][123091] Updated weights for policy 0, policy_version 761005 (0.0010) [2023-12-26 05:40:03,164][123090] Updated weights for policy 1, policy_version 756101 (0.0007) [2023-12-26 05:40:03,223][123090] Updated weights for policy 1, policy_version 756111 (0.0010) [2023-12-26 05:40:03,288][123090] Updated weights for policy 1, policy_version 756121 (0.0010) [2023-12-26 05:40:03,537][123091] Updated weights for policy 0, policy_version 761015 (0.0007) [2023-12-26 05:40:03,593][123091] Updated weights for policy 0, policy_version 761025 (0.0006) [2023-12-26 05:40:03,652][123091] Updated weights for policy 0, policy_version 761035 (0.0005) [2023-12-26 05:40:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 388399104. Throughput: 0: 8999.0, 1: 8762.2. Samples: 388408096. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:40:03,785][121949] Avg episode reward: [(0, '6253.641'), (1, '5505.770')] [2023-12-26 05:40:04,139][123090] Updated weights for policy 1, policy_version 756131 (0.0011) [2023-12-26 05:40:04,202][123090] Updated weights for policy 1, policy_version 756141 (0.0011) [2023-12-26 05:40:04,259][123090] Updated weights for policy 1, policy_version 756151 (0.0011) [2023-12-26 05:40:04,408][123091] Updated weights for policy 0, policy_version 761045 (0.0008) [2023-12-26 05:40:04,456][123091] Updated weights for policy 0, policy_version 761055 (0.0010) [2023-12-26 05:40:04,511][123091] Updated weights for policy 0, policy_version 761065 (0.0010) [2023-12-26 05:40:05,109][123090] Updated weights for policy 1, policy_version 756161 (0.0011) [2023-12-26 05:40:05,157][123090] Updated weights for policy 1, policy_version 756171 (0.0010) [2023-12-26 05:40:05,205][123090] Updated weights for policy 1, policy_version 756181 (0.0010) [2023-12-26 05:40:05,252][123091] Updated weights for policy 0, policy_version 761075 (0.0010) [2023-12-26 05:40:05,264][123090] Updated weights for policy 1, policy_version 756191 (0.0010) [2023-12-26 05:40:05,317][123091] Updated weights for policy 0, policy_version 761085 (0.0006) [2023-12-26 05:40:05,375][123091] Updated weights for policy 0, policy_version 761095 (0.0006) [2023-12-26 05:40:06,106][123091] Updated weights for policy 0, policy_version 761105 (0.0006) [2023-12-26 05:40:06,136][123090] Updated weights for policy 1, policy_version 756201 (0.0007) [2023-12-26 05:40:06,171][123091] Updated weights for policy 0, policy_version 761115 (0.0009) [2023-12-26 05:40:06,194][123090] Updated weights for policy 1, policy_version 756211 (0.0009) [2023-12-26 05:40:06,234][123091] Updated weights for policy 0, policy_version 761125 (0.0008) [2023-12-26 05:40:06,256][123090] Updated weights for policy 1, policy_version 756221 (0.0010) [2023-12-26 05:40:06,302][123091] Updated weights for policy 0, policy_version 761135 (0.0009) [2023-12-26 05:40:07,089][123091] Updated weights for policy 0, policy_version 761145 (0.0009) [2023-12-26 05:40:07,099][123090] Updated weights for policy 1, policy_version 756231 (0.0008) [2023-12-26 05:40:07,139][123091] Updated weights for policy 0, policy_version 761155 (0.0009) [2023-12-26 05:40:07,155][123090] Updated weights for policy 1, policy_version 756241 (0.0009) [2023-12-26 05:40:07,191][123091] Updated weights for policy 0, policy_version 761165 (0.0007) [2023-12-26 05:40:07,219][123090] Updated weights for policy 1, policy_version 756251 (0.0008) [2023-12-26 05:40:08,004][123091] Updated weights for policy 0, policy_version 761175 (0.0007) [2023-12-26 05:40:08,065][123091] Updated weights for policy 0, policy_version 761185 (0.0009) [2023-12-26 05:40:08,093][123090] Updated weights for policy 1, policy_version 756261 (0.0010) [2023-12-26 05:40:08,132][123091] Updated weights for policy 0, policy_version 761195 (0.0008) [2023-12-26 05:40:08,156][123090] Updated weights for policy 1, policy_version 756271 (0.0008) [2023-12-26 05:40:08,226][123090] Updated weights for policy 1, policy_version 756281 (0.0009) [2023-12-26 05:40:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 388481024. Throughput: 0: 9036.4, 1: 8742.0. Samples: 388461204. Policy #0 lag: (min: 21.0, avg: 21.0, max: 21.0) [2023-12-26 05:40:08,785][121949] Avg episode reward: [(0, '6167.522'), (1, '5311.514')] [2023-12-26 05:40:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000761200_194871296.pth... [2023-12-26 05:40:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000756288_193609728.pth... [2023-12-26 05:40:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000760144_194600960.pth [2023-12-26 05:40:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000755264_193347584.pth [2023-12-26 05:40:08,883][123091] Updated weights for policy 0, policy_version 761205 (0.0006) [2023-12-26 05:40:08,946][123091] Updated weights for policy 0, policy_version 761215 (0.0006) [2023-12-26 05:40:09,008][123091] Updated weights for policy 0, policy_version 761225 (0.0008) [2023-12-26 05:40:09,134][123090] Updated weights for policy 1, policy_version 756291 (0.0008) [2023-12-26 05:40:09,202][123090] Updated weights for policy 1, policy_version 756301 (0.0009) [2023-12-26 05:40:09,279][123090] Updated weights for policy 1, policy_version 756311 (0.0009) [2023-12-26 05:40:09,755][123091] Updated weights for policy 0, policy_version 761235 (0.0008) [2023-12-26 05:40:09,817][123091] Updated weights for policy 0, policy_version 761245 (0.0006) [2023-12-26 05:40:09,890][123091] Updated weights for policy 0, policy_version 761255 (0.0010) [2023-12-26 05:40:10,161][123090] Updated weights for policy 1, policy_version 756321 (0.0009) [2023-12-26 05:40:10,224][123090] Updated weights for policy 1, policy_version 756331 (0.0009) [2023-12-26 05:40:10,299][123090] Updated weights for policy 1, policy_version 756341 (0.0009) [2023-12-26 05:40:10,347][123090] Updated weights for policy 1, policy_version 756351 (0.0008) [2023-12-26 05:40:10,618][123091] Updated weights for policy 0, policy_version 761265 (0.0010) [2023-12-26 05:40:10,681][123091] Updated weights for policy 0, policy_version 761275 (0.0007) [2023-12-26 05:40:10,743][123091] Updated weights for policy 0, policy_version 761285 (0.0008) [2023-12-26 05:40:10,791][123091] Updated weights for policy 0, policy_version 761295 (0.0010) [2023-12-26 05:40:11,146][123090] Updated weights for policy 1, policy_version 756361 (0.0009) [2023-12-26 05:40:11,222][123090] Updated weights for policy 1, policy_version 756371 (0.0008) [2023-12-26 05:40:11,292][123090] Updated weights for policy 1, policy_version 756381 (0.0008) [2023-12-26 05:40:11,526][123091] Updated weights for policy 0, policy_version 761305 (0.0011) [2023-12-26 05:40:11,589][123091] Updated weights for policy 0, policy_version 761315 (0.0011) [2023-12-26 05:40:11,662][123091] Updated weights for policy 0, policy_version 761325 (0.0011) [2023-12-26 05:40:12,149][123090] Updated weights for policy 1, policy_version 756391 (0.0010) [2023-12-26 05:40:12,211][123090] Updated weights for policy 1, policy_version 756401 (0.0010) [2023-12-26 05:40:12,278][123090] Updated weights for policy 1, policy_version 756411 (0.0010) [2023-12-26 05:40:12,396][123091] Updated weights for policy 0, policy_version 761335 (0.0010) [2023-12-26 05:40:12,454][123091] Updated weights for policy 0, policy_version 761345 (0.0009) [2023-12-26 05:40:12,524][123091] Updated weights for policy 0, policy_version 761355 (0.0005) [2023-12-26 05:40:13,061][123090] Updated weights for policy 1, policy_version 756421 (0.0009) [2023-12-26 05:40:13,120][123090] Updated weights for policy 1, policy_version 756431 (0.0010) [2023-12-26 05:40:13,182][123090] Updated weights for policy 1, policy_version 756441 (0.0010) [2023-12-26 05:40:13,260][123091] Updated weights for policy 0, policy_version 761365 (0.0007) [2023-12-26 05:40:13,330][123091] Updated weights for policy 0, policy_version 761375 (0.0006) [2023-12-26 05:40:13,389][123091] Updated weights for policy 0, policy_version 761385 (0.0008) [2023-12-26 05:40:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 388571136. Throughput: 0: 9138.5, 1: 8655.3. Samples: 388565144. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:13,785][121949] Avg episode reward: [(0, '6020.076'), (1, '5268.914')] [2023-12-26 05:40:13,955][123090] Updated weights for policy 1, policy_version 756451 (0.0009) [2023-12-26 05:40:14,003][123090] Updated weights for policy 1, policy_version 756461 (0.0009) [2023-12-26 05:40:14,065][123090] Updated weights for policy 1, policy_version 756471 (0.0009) [2023-12-26 05:40:14,188][123091] Updated weights for policy 0, policy_version 761395 (0.0009) [2023-12-26 05:40:14,246][123091] Updated weights for policy 0, policy_version 761405 (0.0009) [2023-12-26 05:40:14,300][123091] Updated weights for policy 0, policy_version 761415 (0.0009) [2023-12-26 05:40:14,916][123090] Updated weights for policy 1, policy_version 756481 (0.0008) [2023-12-26 05:40:14,982][123090] Updated weights for policy 1, policy_version 756491 (0.0011) [2023-12-26 05:40:15,048][123090] Updated weights for policy 1, policy_version 756501 (0.0010) [2023-12-26 05:40:15,061][123091] Updated weights for policy 0, policy_version 761425 (0.0009) [2023-12-26 05:40:15,113][123090] Updated weights for policy 1, policy_version 756511 (0.0010) [2023-12-26 05:40:15,126][123091] Updated weights for policy 0, policy_version 761435 (0.0010) [2023-12-26 05:40:15,186][123091] Updated weights for policy 0, policy_version 761445 (0.0008) [2023-12-26 05:40:15,253][123091] Updated weights for policy 0, policy_version 761455 (0.0006) [2023-12-26 05:40:15,993][123090] Updated weights for policy 1, policy_version 756521 (0.0006) [2023-12-26 05:40:16,001][123091] Updated weights for policy 0, policy_version 761465 (0.0010) [2023-12-26 05:40:16,056][123091] Updated weights for policy 0, policy_version 761475 (0.0010) [2023-12-26 05:40:16,057][123090] Updated weights for policy 1, policy_version 756531 (0.0006) [2023-12-26 05:40:16,107][123091] Updated weights for policy 0, policy_version 761485 (0.0010) [2023-12-26 05:40:16,113][123090] Updated weights for policy 1, policy_version 756541 (0.0005) [2023-12-26 05:40:16,755][123090] Updated weights for policy 1, policy_version 756551 (0.0005) [2023-12-26 05:40:16,823][123090] Updated weights for policy 1, policy_version 756561 (0.0008) [2023-12-26 05:40:16,889][123090] Updated weights for policy 1, policy_version 756571 (0.0010) [2023-12-26 05:40:16,932][123091] Updated weights for policy 0, policy_version 761495 (0.0010) [2023-12-26 05:40:17,001][123091] Updated weights for policy 0, policy_version 761505 (0.0010) [2023-12-26 05:40:17,075][123091] Updated weights for policy 0, policy_version 761515 (0.0010) [2023-12-26 05:40:17,620][123090] Updated weights for policy 1, policy_version 756581 (0.0008) [2023-12-26 05:40:17,674][123090] Updated weights for policy 1, policy_version 756591 (0.0010) [2023-12-26 05:40:17,727][123090] Updated weights for policy 1, policy_version 756601 (0.0010) [2023-12-26 05:40:17,887][123091] Updated weights for policy 0, policy_version 761525 (0.0010) [2023-12-26 05:40:17,945][123091] Updated weights for policy 0, policy_version 761535 (0.0010) [2023-12-26 05:40:18,007][123091] Updated weights for policy 0, policy_version 761545 (0.0010) [2023-12-26 05:40:18,549][123090] Updated weights for policy 1, policy_version 756611 (0.0009) [2023-12-26 05:40:18,618][123090] Updated weights for policy 1, policy_version 756621 (0.0007) [2023-12-26 05:40:18,683][123090] Updated weights for policy 1, policy_version 756631 (0.0011) [2023-12-26 05:40:18,727][123091] Updated weights for policy 0, policy_version 761555 (0.0010) [2023-12-26 05:40:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 388661248. Throughput: 0: 9129.8, 1: 8746.5. Samples: 388673400. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:18,784][121949] Avg episode reward: [(0, '6064.011'), (1, '5327.928')] [2023-12-26 05:40:18,798][123091] Updated weights for policy 0, policy_version 761565 (0.0008) [2023-12-26 05:40:18,860][123091] Updated weights for policy 0, policy_version 761575 (0.0009) [2023-12-26 05:40:19,345][123090] Updated weights for policy 1, policy_version 756641 (0.0010) [2023-12-26 05:40:19,418][123090] Updated weights for policy 1, policy_version 756651 (0.0008) [2023-12-26 05:40:19,492][123090] Updated weights for policy 1, policy_version 756661 (0.0010) [2023-12-26 05:40:19,526][123091] Updated weights for policy 0, policy_version 761585 (0.0008) [2023-12-26 05:40:19,558][123090] Updated weights for policy 1, policy_version 756671 (0.0009) [2023-12-26 05:40:19,585][123091] Updated weights for policy 0, policy_version 761595 (0.0005) [2023-12-26 05:40:19,660][123091] Updated weights for policy 0, policy_version 761605 (0.0005) [2023-12-26 05:40:19,730][123091] Updated weights for policy 0, policy_version 761615 (0.0005) [2023-12-26 05:40:20,358][123090] Updated weights for policy 1, policy_version 756681 (0.0008) [2023-12-26 05:40:20,405][123091] Updated weights for policy 0, policy_version 761625 (0.0008) [2023-12-26 05:40:20,432][123090] Updated weights for policy 1, policy_version 756691 (0.0008) [2023-12-26 05:40:20,467][123091] Updated weights for policy 0, policy_version 761635 (0.0007) [2023-12-26 05:40:20,498][123090] Updated weights for policy 1, policy_version 756701 (0.0009) [2023-12-26 05:40:20,534][123091] Updated weights for policy 0, policy_version 761645 (0.0007) [2023-12-26 05:40:21,281][123091] Updated weights for policy 0, policy_version 761655 (0.0006) [2023-12-26 05:40:21,352][123091] Updated weights for policy 0, policy_version 761665 (0.0011) [2023-12-26 05:40:21,373][123090] Updated weights for policy 1, policy_version 756711 (0.0008) [2023-12-26 05:40:21,416][123091] Updated weights for policy 0, policy_version 761675 (0.0008) [2023-12-26 05:40:21,432][123090] Updated weights for policy 1, policy_version 756721 (0.0007) [2023-12-26 05:40:21,500][123090] Updated weights for policy 1, policy_version 756731 (0.0009) [2023-12-26 05:40:22,259][123091] Updated weights for policy 0, policy_version 761685 (0.0009) [2023-12-26 05:40:22,327][123091] Updated weights for policy 0, policy_version 761695 (0.0010) [2023-12-26 05:40:22,398][123091] Updated weights for policy 0, policy_version 761705 (0.0010) [2023-12-26 05:40:22,403][123090] Updated weights for policy 1, policy_version 756741 (0.0009) [2023-12-26 05:40:22,467][123090] Updated weights for policy 1, policy_version 756751 (0.0006) [2023-12-26 05:40:22,532][123090] Updated weights for policy 1, policy_version 756761 (0.0005) [2023-12-26 05:40:23,275][123091] Updated weights for policy 0, policy_version 761715 (0.0010) [2023-12-26 05:40:23,323][123090] Updated weights for policy 1, policy_version 756771 (0.0006) [2023-12-26 05:40:23,342][123091] Updated weights for policy 0, policy_version 761725 (0.0009) [2023-12-26 05:40:23,389][123090] Updated weights for policy 1, policy_version 756781 (0.0007) [2023-12-26 05:40:23,395][123091] Updated weights for policy 0, policy_version 761735 (0.0009) [2023-12-26 05:40:23,446][123090] Updated weights for policy 1, policy_version 756791 (0.0008) [2023-12-26 05:40:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 388751360. Throughput: 0: 9144.3, 1: 8761.0. Samples: 388726260. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:23,785][121949] Avg episode reward: [(0, '6166.934'), (1, '5374.355')] [2023-12-26 05:40:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000761744_195010560.pth... [2023-12-26 05:40:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000756800_193740800.pth... [2023-12-26 05:40:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000760688_194740224.pth [2023-12-26 05:40:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000755776_193478656.pth [2023-12-26 05:40:24,196][123090] Updated weights for policy 1, policy_version 756801 (0.0009) [2023-12-26 05:40:24,261][123090] Updated weights for policy 1, policy_version 756811 (0.0006) [2023-12-26 05:40:24,280][123091] Updated weights for policy 0, policy_version 761745 (0.0008) [2023-12-26 05:40:24,339][123090] Updated weights for policy 1, policy_version 756821 (0.0007) [2023-12-26 05:40:24,343][123091] Updated weights for policy 0, policy_version 761755 (0.0009) [2023-12-26 05:40:24,399][123090] Updated weights for policy 1, policy_version 756831 (0.0010) [2023-12-26 05:40:24,406][123091] Updated weights for policy 0, policy_version 761765 (0.0008) [2023-12-26 05:40:24,465][123091] Updated weights for policy 0, policy_version 761775 (0.0009) [2023-12-26 05:40:25,168][123090] Updated weights for policy 1, policy_version 756841 (0.0010) [2023-12-26 05:40:25,220][123090] Updated weights for policy 1, policy_version 756851 (0.0010) [2023-12-26 05:40:25,278][123090] Updated weights for policy 1, policy_version 756861 (0.0010) [2023-12-26 05:40:25,285][123091] Updated weights for policy 0, policy_version 761785 (0.0006) [2023-12-26 05:40:25,343][123091] Updated weights for policy 0, policy_version 761795 (0.0008) [2023-12-26 05:40:25,402][123091] Updated weights for policy 0, policy_version 761805 (0.0009) [2023-12-26 05:40:26,102][123090] Updated weights for policy 1, policy_version 756871 (0.0010) [2023-12-26 05:40:26,157][123090] Updated weights for policy 1, policy_version 756881 (0.0008) [2023-12-26 05:40:26,221][123090] Updated weights for policy 1, policy_version 756891 (0.0008) [2023-12-26 05:40:26,223][123091] Updated weights for policy 0, policy_version 761815 (0.0009) [2023-12-26 05:40:26,285][123091] Updated weights for policy 0, policy_version 761825 (0.0010) [2023-12-26 05:40:26,342][123091] Updated weights for policy 0, policy_version 761836 (0.0010) [2023-12-26 05:40:27,026][123090] Updated weights for policy 1, policy_version 756901 (0.0006) [2023-12-26 05:40:27,085][123090] Updated weights for policy 1, policy_version 756911 (0.0005) [2023-12-26 05:40:27,133][123090] Updated weights for policy 1, policy_version 756921 (0.0009) [2023-12-26 05:40:27,200][123091] Updated weights for policy 0, policy_version 761846 (0.0009) [2023-12-26 05:40:27,249][123091] Updated weights for policy 0, policy_version 761857 (0.0010) [2023-12-26 05:40:27,310][123091] Updated weights for policy 0, policy_version 761868 (0.0010) [2023-12-26 05:40:27,910][123090] Updated weights for policy 1, policy_version 756931 (0.0009) [2023-12-26 05:40:27,975][123090] Updated weights for policy 1, policy_version 756941 (0.0009) [2023-12-26 05:40:28,040][123090] Updated weights for policy 1, policy_version 756951 (0.0009) [2023-12-26 05:40:28,175][123091] Updated weights for policy 0, policy_version 761878 (0.0009) [2023-12-26 05:40:28,224][123091] Updated weights for policy 0, policy_version 761888 (0.0009) [2023-12-26 05:40:28,273][123091] Updated weights for policy 0, policy_version 761899 (0.0009) [2023-12-26 05:40:28,696][123090] Updated weights for policy 1, policy_version 756961 (0.0008) [2023-12-26 05:40:28,763][123090] Updated weights for policy 1, policy_version 756971 (0.0005) [2023-12-26 05:40:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 388833280. Throughput: 0: 9103.2, 1: 8803.3. Samples: 388829372. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:28,785][121949] Avg episode reward: [(0, '6131.000'), (1, '5269.524')] [2023-12-26 05:40:28,824][123090] Updated weights for policy 1, policy_version 756981 (0.0005) [2023-12-26 05:40:28,896][123090] Updated weights for policy 1, policy_version 756991 (0.0005) [2023-12-26 05:40:29,202][123091] Updated weights for policy 0, policy_version 761909 (0.0009) [2023-12-26 05:40:29,273][123091] Updated weights for policy 0, policy_version 761919 (0.0009) [2023-12-26 05:40:29,323][123091] Updated weights for policy 0, policy_version 761929 (0.0009) [2023-12-26 05:40:29,505][123090] Updated weights for policy 1, policy_version 757001 (0.0005) [2023-12-26 05:40:29,551][123090] Updated weights for policy 1, policy_version 757011 (0.0005) [2023-12-26 05:40:29,607][123090] Updated weights for policy 1, policy_version 757021 (0.0007) [2023-12-26 05:40:30,056][123091] Updated weights for policy 0, policy_version 761939 (0.0008) [2023-12-26 05:40:30,118][123091] Updated weights for policy 0, policy_version 761949 (0.0010) [2023-12-26 05:40:30,179][123091] Updated weights for policy 0, policy_version 761959 (0.0009) [2023-12-26 05:40:30,397][123090] Updated weights for policy 1, policy_version 757031 (0.0008) [2023-12-26 05:40:30,469][123090] Updated weights for policy 1, policy_version 757041 (0.0010) [2023-12-26 05:40:30,532][123090] Updated weights for policy 1, policy_version 757051 (0.0009) [2023-12-26 05:40:30,988][123091] Updated weights for policy 0, policy_version 761969 (0.0009) [2023-12-26 05:40:31,056][123091] Updated weights for policy 0, policy_version 761979 (0.0009) [2023-12-26 05:40:31,111][123091] Updated weights for policy 0, policy_version 761989 (0.0010) [2023-12-26 05:40:31,177][123091] Updated weights for policy 0, policy_version 761999 (0.0008) [2023-12-26 05:40:31,353][123090] Updated weights for policy 1, policy_version 757061 (0.0010) [2023-12-26 05:40:31,422][123090] Updated weights for policy 1, policy_version 757071 (0.0010) [2023-12-26 05:40:31,484][123090] Updated weights for policy 1, policy_version 757081 (0.0009) [2023-12-26 05:40:32,016][123091] Updated weights for policy 0, policy_version 762009 (0.0009) [2023-12-26 05:40:32,078][123091] Updated weights for policy 0, policy_version 762019 (0.0009) [2023-12-26 05:40:32,129][123091] Updated weights for policy 0, policy_version 762029 (0.0010) [2023-12-26 05:40:32,289][123090] Updated weights for policy 1, policy_version 757091 (0.0009) [2023-12-26 05:40:32,352][123090] Updated weights for policy 1, policy_version 757101 (0.0009) [2023-12-26 05:40:32,423][123090] Updated weights for policy 1, policy_version 757111 (0.0009) [2023-12-26 05:40:32,958][123091] Updated weights for policy 0, policy_version 762039 (0.0007) [2023-12-26 05:40:33,003][123091] Updated weights for policy 0, policy_version 762049 (0.0005) [2023-12-26 05:40:33,047][123091] Updated weights for policy 0, policy_version 762059 (0.0005) [2023-12-26 05:40:33,276][123090] Updated weights for policy 1, policy_version 757121 (0.0009) [2023-12-26 05:40:33,331][123090] Updated weights for policy 1, policy_version 757131 (0.0009) [2023-12-26 05:40:33,400][123090] Updated weights for policy 1, policy_version 757141 (0.0009) [2023-12-26 05:40:33,472][123090] Updated weights for policy 1, policy_version 757151 (0.0009) [2023-12-26 05:40:33,781][123091] Updated weights for policy 0, policy_version 762069 (0.0005) [2023-12-26 05:40:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 388923392. Throughput: 0: 9022.4, 1: 8778.3. Samples: 388934844. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:33,785][121949] Avg episode reward: [(0, '5998.103'), (1, '5130.991')] [2023-12-26 05:40:33,830][123091] Updated weights for policy 0, policy_version 762079 (0.0005) [2023-12-26 05:40:33,885][123091] Updated weights for policy 0, policy_version 762089 (0.0008) [2023-12-26 05:40:34,334][123090] Updated weights for policy 1, policy_version 757161 (0.0010) [2023-12-26 05:40:34,403][123090] Updated weights for policy 1, policy_version 757171 (0.0010) [2023-12-26 05:40:34,461][123090] Updated weights for policy 1, policy_version 757181 (0.0009) [2023-12-26 05:40:34,680][123091] Updated weights for policy 0, policy_version 762099 (0.0008) [2023-12-26 05:40:34,728][123091] Updated weights for policy 0, policy_version 762109 (0.0009) [2023-12-26 05:40:34,787][123091] Updated weights for policy 0, policy_version 762119 (0.0008) [2023-12-26 05:40:35,275][123090] Updated weights for policy 1, policy_version 757191 (0.0009) [2023-12-26 05:40:35,339][123090] Updated weights for policy 1, policy_version 757201 (0.0009) [2023-12-26 05:40:35,393][123090] Updated weights for policy 1, policy_version 757211 (0.0009) [2023-12-26 05:40:35,643][123091] Updated weights for policy 0, policy_version 762129 (0.0010) [2023-12-26 05:40:35,706][123091] Updated weights for policy 0, policy_version 762139 (0.0009) [2023-12-26 05:40:35,760][123091] Updated weights for policy 0, policy_version 762149 (0.0009) [2023-12-26 05:40:35,810][123091] Updated weights for policy 0, policy_version 762160 (0.0010) [2023-12-26 05:40:36,223][123090] Updated weights for policy 1, policy_version 757221 (0.0010) [2023-12-26 05:40:36,290][123090] Updated weights for policy 1, policy_version 757231 (0.0011) [2023-12-26 05:40:36,354][123090] Updated weights for policy 1, policy_version 757241 (0.0011) [2023-12-26 05:40:36,691][123091] Updated weights for policy 0, policy_version 762170 (0.0006) [2023-12-26 05:40:36,746][123091] Updated weights for policy 0, policy_version 762180 (0.0006) [2023-12-26 05:40:36,803][123091] Updated weights for policy 0, policy_version 762190 (0.0005) [2023-12-26 05:40:37,130][123090] Updated weights for policy 1, policy_version 757251 (0.0009) [2023-12-26 05:40:37,188][123090] Updated weights for policy 1, policy_version 757261 (0.0005) [2023-12-26 05:40:37,236][123090] Updated weights for policy 1, policy_version 757271 (0.0005) [2023-12-26 05:40:37,578][123091] Updated weights for policy 0, policy_version 762200 (0.0010) [2023-12-26 05:40:37,650][123091] Updated weights for policy 0, policy_version 762210 (0.0010) [2023-12-26 05:40:37,722][123091] Updated weights for policy 0, policy_version 762220 (0.0010) [2023-12-26 05:40:37,926][123090] Updated weights for policy 1, policy_version 757281 (0.0005) [2023-12-26 05:40:37,981][123090] Updated weights for policy 1, policy_version 757291 (0.0005) [2023-12-26 05:40:38,033][123090] Updated weights for policy 1, policy_version 757301 (0.0008) [2023-12-26 05:40:38,100][123090] Updated weights for policy 1, policy_version 757311 (0.0010) [2023-12-26 05:40:38,532][123091] Updated weights for policy 0, policy_version 762230 (0.0010) [2023-12-26 05:40:38,597][123091] Updated weights for policy 0, policy_version 762240 (0.0011) [2023-12-26 05:40:38,664][123091] Updated weights for policy 0, policy_version 762250 (0.0011) [2023-12-26 05:40:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 389013504. Throughput: 0: 8979.9, 1: 8768.2. Samples: 388986272. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:38,786][121949] Avg episode reward: [(0, '6096.727'), (1, '5348.748')] [2023-12-26 05:40:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000762256_195141632.pth... [2023-12-26 05:40:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000757312_193871872.pth... [2023-12-26 05:40:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000761200_194871296.pth [2023-12-26 05:40:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000756288_193609728.pth [2023-12-26 05:40:38,932][123090] Updated weights for policy 1, policy_version 757321 (0.0011) [2023-12-26 05:40:38,999][123090] Updated weights for policy 1, policy_version 757331 (0.0010) [2023-12-26 05:40:39,057][123090] Updated weights for policy 1, policy_version 757341 (0.0010) [2023-12-26 05:40:39,499][123091] Updated weights for policy 0, policy_version 762260 (0.0010) [2023-12-26 05:40:39,556][123091] Updated weights for policy 0, policy_version 762270 (0.0009) [2023-12-26 05:40:39,624][123091] Updated weights for policy 0, policy_version 762280 (0.0009) [2023-12-26 05:40:39,935][123090] Updated weights for policy 1, policy_version 757351 (0.0011) [2023-12-26 05:40:40,004][123090] Updated weights for policy 1, policy_version 757361 (0.0011) [2023-12-26 05:40:40,072][123090] Updated weights for policy 1, policy_version 757371 (0.0011) [2023-12-26 05:40:40,496][123091] Updated weights for policy 0, policy_version 762290 (0.0009) [2023-12-26 05:40:40,567][123091] Updated weights for policy 0, policy_version 762300 (0.0009) [2023-12-26 05:40:40,628][123091] Updated weights for policy 0, policy_version 762310 (0.0009) [2023-12-26 05:40:40,684][123091] Updated weights for policy 0, policy_version 762320 (0.0009) [2023-12-26 05:40:40,887][123090] Updated weights for policy 1, policy_version 757381 (0.0011) [2023-12-26 05:40:40,944][123090] Updated weights for policy 1, policy_version 757391 (0.0010) [2023-12-26 05:40:41,008][123090] Updated weights for policy 1, policy_version 757401 (0.0011) [2023-12-26 05:40:41,629][123091] Updated weights for policy 0, policy_version 762330 (0.0009) [2023-12-26 05:40:41,704][123091] Updated weights for policy 0, policy_version 762340 (0.0009) [2023-12-26 05:40:41,776][123091] Updated weights for policy 0, policy_version 762350 (0.0009) [2023-12-26 05:40:41,891][123090] Updated weights for policy 1, policy_version 757411 (0.0011) [2023-12-26 05:40:41,952][123090] Updated weights for policy 1, policy_version 757421 (0.0011) [2023-12-26 05:40:42,007][123090] Updated weights for policy 1, policy_version 757431 (0.0010) [2023-12-26 05:40:42,586][123091] Updated weights for policy 0, policy_version 762360 (0.0009) [2023-12-26 05:40:42,647][123091] Updated weights for policy 0, policy_version 762370 (0.0009) [2023-12-26 05:40:42,711][123091] Updated weights for policy 0, policy_version 762380 (0.0008) [2023-12-26 05:40:42,862][123090] Updated weights for policy 1, policy_version 757441 (0.0010) [2023-12-26 05:40:42,929][123090] Updated weights for policy 1, policy_version 757451 (0.0010) [2023-12-26 05:40:42,984][123090] Updated weights for policy 1, policy_version 757461 (0.0010) [2023-12-26 05:40:43,028][123090] Updated weights for policy 1, policy_version 757471 (0.0010) [2023-12-26 05:40:43,521][123091] Updated weights for policy 0, policy_version 762390 (0.0007) [2023-12-26 05:40:43,568][123091] Updated weights for policy 0, policy_version 762400 (0.0005) [2023-12-26 05:40:43,623][123091] Updated weights for policy 0, policy_version 762410 (0.0009) [2023-12-26 05:40:43,747][123090] Updated weights for policy 1, policy_version 757481 (0.0006) [2023-12-26 05:40:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 389095424. Throughput: 0: 8829.5, 1: 8687.1. Samples: 389088732. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:43,785][121949] Avg episode reward: [(0, '6292.065'), (1, '5478.615')] [2023-12-26 05:40:43,804][123090] Updated weights for policy 1, policy_version 757491 (0.0005) [2023-12-26 05:40:43,852][123090] Updated weights for policy 1, policy_version 757501 (0.0005) [2023-12-26 05:40:44,278][123091] Updated weights for policy 0, policy_version 762420 (0.0008) [2023-12-26 05:40:44,323][123091] Updated weights for policy 0, policy_version 762430 (0.0005) [2023-12-26 05:40:44,375][123091] Updated weights for policy 0, policy_version 762440 (0.0005) [2023-12-26 05:40:44,536][123090] Updated weights for policy 1, policy_version 757511 (0.0005) [2023-12-26 05:40:44,592][123090] Updated weights for policy 1, policy_version 757521 (0.0005) [2023-12-26 05:40:44,656][123090] Updated weights for policy 1, policy_version 757531 (0.0010) [2023-12-26 05:40:45,172][123091] Updated weights for policy 0, policy_version 762450 (0.0006) [2023-12-26 05:40:45,244][123091] Updated weights for policy 0, policy_version 762460 (0.0008) [2023-12-26 05:40:45,307][123091] Updated weights for policy 0, policy_version 762470 (0.0006) [2023-12-26 05:40:45,369][123091] Updated weights for policy 0, policy_version 762480 (0.0005) [2023-12-26 05:40:45,443][123090] Updated weights for policy 1, policy_version 757541 (0.0010) [2023-12-26 05:40:45,499][123090] Updated weights for policy 1, policy_version 757551 (0.0010) [2023-12-26 05:40:45,543][123090] Updated weights for policy 1, policy_version 757561 (0.0010) [2023-12-26 05:40:46,039][123091] Updated weights for policy 0, policy_version 762490 (0.0005) [2023-12-26 05:40:46,108][123091] Updated weights for policy 0, policy_version 762500 (0.0005) [2023-12-26 05:40:46,170][123091] Updated weights for policy 0, policy_version 762510 (0.0005) [2023-12-26 05:40:46,301][123090] Updated weights for policy 1, policy_version 757571 (0.0009) [2023-12-26 05:40:46,372][123090] Updated weights for policy 1, policy_version 757581 (0.0005) [2023-12-26 05:40:46,445][123090] Updated weights for policy 1, policy_version 757591 (0.0005) [2023-12-26 05:40:46,829][123091] Updated weights for policy 0, policy_version 762520 (0.0009) [2023-12-26 05:40:46,873][123091] Updated weights for policy 0, policy_version 762530 (0.0010) [2023-12-26 05:40:46,922][123091] Updated weights for policy 0, policy_version 762540 (0.0009) [2023-12-26 05:40:47,138][123090] Updated weights for policy 1, policy_version 757601 (0.0006) [2023-12-26 05:40:47,201][123090] Updated weights for policy 1, policy_version 757611 (0.0010) [2023-12-26 05:40:47,257][123090] Updated weights for policy 1, policy_version 757621 (0.0010) [2023-12-26 05:40:47,327][123090] Updated weights for policy 1, policy_version 757631 (0.0010) [2023-12-26 05:40:47,639][123091] Updated weights for policy 0, policy_version 762550 (0.0007) [2023-12-26 05:40:47,688][123091] Updated weights for policy 0, policy_version 762560 (0.0005) [2023-12-26 05:40:47,738][123091] Updated weights for policy 0, policy_version 762570 (0.0005) [2023-12-26 05:40:48,145][123090] Updated weights for policy 1, policy_version 757641 (0.0010) [2023-12-26 05:40:48,193][123090] Updated weights for policy 1, policy_version 757651 (0.0010) [2023-12-26 05:40:48,244][123090] Updated weights for policy 1, policy_version 757661 (0.0010) [2023-12-26 05:40:48,411][123091] Updated weights for policy 0, policy_version 762580 (0.0008) [2023-12-26 05:40:48,460][123091] Updated weights for policy 0, policy_version 762590 (0.0009) [2023-12-26 05:40:48,509][123091] Updated weights for policy 0, policy_version 762601 (0.0009) [2023-12-26 05:40:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 389193728. Throughput: 0: 8934.9, 1: 8742.1. Samples: 389203564. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:48,785][121949] Avg episode reward: [(0, '6108.209'), (1, '5386.004')] [2023-12-26 05:40:49,096][123090] Updated weights for policy 1, policy_version 757671 (0.0010) [2023-12-26 05:40:49,163][123090] Updated weights for policy 1, policy_version 757681 (0.0010) [2023-12-26 05:40:49,221][123091] Updated weights for policy 0, policy_version 762611 (0.0009) [2023-12-26 05:40:49,229][123090] Updated weights for policy 1, policy_version 757691 (0.0009) [2023-12-26 05:40:49,292][123091] Updated weights for policy 0, policy_version 762621 (0.0008) [2023-12-26 05:40:49,352][123091] Updated weights for policy 0, policy_version 762631 (0.0008) [2023-12-26 05:40:50,057][123090] Updated weights for policy 1, policy_version 757701 (0.0009) [2023-12-26 05:40:50,113][123090] Updated weights for policy 1, policy_version 757711 (0.0010) [2023-12-26 05:40:50,162][123091] Updated weights for policy 0, policy_version 762641 (0.0006) [2023-12-26 05:40:50,176][123090] Updated weights for policy 1, policy_version 757721 (0.0010) [2023-12-26 05:40:50,219][123091] Updated weights for policy 0, policy_version 762651 (0.0006) [2023-12-26 05:40:50,279][123091] Updated weights for policy 0, policy_version 762661 (0.0009) [2023-12-26 05:40:50,343][123091] Updated weights for policy 0, policy_version 762671 (0.0008) [2023-12-26 05:40:51,022][123090] Updated weights for policy 1, policy_version 757731 (0.0010) [2023-12-26 05:40:51,090][123090] Updated weights for policy 1, policy_version 757741 (0.0007) [2023-12-26 05:40:51,164][123090] Updated weights for policy 1, policy_version 757751 (0.0011) [2023-12-26 05:40:51,201][123091] Updated weights for policy 0, policy_version 762681 (0.0009) [2023-12-26 05:40:51,268][123091] Updated weights for policy 0, policy_version 762691 (0.0009) [2023-12-26 05:40:51,332][123091] Updated weights for policy 0, policy_version 762701 (0.0009) [2023-12-26 05:40:52,015][123090] Updated weights for policy 1, policy_version 757761 (0.0008) [2023-12-26 05:40:52,085][123090] Updated weights for policy 1, policy_version 757771 (0.0009) [2023-12-26 05:40:52,128][123091] Updated weights for policy 0, policy_version 762711 (0.0010) [2023-12-26 05:40:52,149][123090] Updated weights for policy 1, policy_version 757781 (0.0007) [2023-12-26 05:40:52,181][123091] Updated weights for policy 0, policy_version 762721 (0.0011) [2023-12-26 05:40:52,209][123090] Updated weights for policy 1, policy_version 757791 (0.0006) [2023-12-26 05:40:52,236][123091] Updated weights for policy 0, policy_version 762731 (0.0010) [2023-12-26 05:40:52,960][123091] Updated weights for policy 0, policy_version 762741 (0.0009) [2023-12-26 05:40:52,973][123090] Updated weights for policy 1, policy_version 757801 (0.0006) [2023-12-26 05:40:53,023][123091] Updated weights for policy 0, policy_version 762751 (0.0008) [2023-12-26 05:40:53,032][123090] Updated weights for policy 1, policy_version 757811 (0.0007) [2023-12-26 05:40:53,089][123091] Updated weights for policy 0, policy_version 762761 (0.0009) [2023-12-26 05:40:53,089][123090] Updated weights for policy 1, policy_version 757821 (0.0010) [2023-12-26 05:40:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 389275648. Throughput: 0: 8907.9, 1: 8747.6. Samples: 389255704. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:53,785][121949] Avg episode reward: [(0, '6073.246'), (1, '5194.757')] [2023-12-26 05:40:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000762768_195272704.pth... [2023-12-26 05:40:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000761744_195010560.pth [2023-12-26 05:40:53,839][123090] Updated weights for policy 1, policy_version 757831 (0.0007) [2023-12-26 05:40:53,901][123091] Updated weights for policy 0, policy_version 762771 (0.0007) [2023-12-26 05:40:53,910][123090] Updated weights for policy 1, policy_version 757841 (0.0005) [2023-12-26 05:40:53,948][123091] Updated weights for policy 0, policy_version 762781 (0.0009) [2023-12-26 05:40:53,975][123090] Updated weights for policy 1, policy_version 757851 (0.0005) [2023-12-26 05:40:54,004][123091] Updated weights for policy 0, policy_version 762791 (0.0010) [2023-12-26 05:40:54,008][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000757856_194011136.pth... [2023-12-26 05:40:54,011][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000756800_193740800.pth [2023-12-26 05:40:54,744][123090] Updated weights for policy 1, policy_version 757861 (0.0008) [2023-12-26 05:40:54,791][123090] Updated weights for policy 1, policy_version 757871 (0.0010) [2023-12-26 05:40:54,841][123090] Updated weights for policy 1, policy_version 757881 (0.0010) [2023-12-26 05:40:54,852][123091] Updated weights for policy 0, policy_version 762801 (0.0009) [2023-12-26 05:40:54,914][123091] Updated weights for policy 0, policy_version 762811 (0.0007) [2023-12-26 05:40:54,972][123091] Updated weights for policy 0, policy_version 762821 (0.0009) [2023-12-26 05:40:55,034][123091] Updated weights for policy 0, policy_version 762831 (0.0009) [2023-12-26 05:40:55,678][123090] Updated weights for policy 1, policy_version 757891 (0.0010) [2023-12-26 05:40:55,744][123090] Updated weights for policy 1, policy_version 757901 (0.0010) [2023-12-26 05:40:55,796][123090] Updated weights for policy 1, policy_version 757911 (0.0010) [2023-12-26 05:40:55,861][123091] Updated weights for policy 0, policy_version 762841 (0.0008) [2023-12-26 05:40:55,922][123091] Updated weights for policy 0, policy_version 762851 (0.0009) [2023-12-26 05:40:55,986][123091] Updated weights for policy 0, policy_version 762861 (0.0009) [2023-12-26 05:40:56,612][123090] Updated weights for policy 1, policy_version 757921 (0.0010) [2023-12-26 05:40:56,681][123090] Updated weights for policy 1, policy_version 757931 (0.0010) [2023-12-26 05:40:56,753][123090] Updated weights for policy 1, policy_version 757941 (0.0010) [2023-12-26 05:40:56,808][123090] Updated weights for policy 1, policy_version 757951 (0.0010) [2023-12-26 05:40:56,815][123091] Updated weights for policy 0, policy_version 762871 (0.0007) [2023-12-26 05:40:56,880][123091] Updated weights for policy 0, policy_version 762881 (0.0009) [2023-12-26 05:40:56,930][123091] Updated weights for policy 0, policy_version 762891 (0.0009) [2023-12-26 05:40:57,601][123090] Updated weights for policy 1, policy_version 757961 (0.0010) [2023-12-26 05:40:57,656][123090] Updated weights for policy 1, policy_version 757971 (0.0010) [2023-12-26 05:40:57,702][123091] Updated weights for policy 0, policy_version 762901 (0.0009) [2023-12-26 05:40:57,711][123090] Updated weights for policy 1, policy_version 757981 (0.0010) [2023-12-26 05:40:57,757][123091] Updated weights for policy 0, policy_version 762911 (0.0009) [2023-12-26 05:40:57,817][123091] Updated weights for policy 0, policy_version 762921 (0.0007) [2023-12-26 05:40:58,636][123090] Updated weights for policy 1, policy_version 757991 (0.0010) [2023-12-26 05:40:58,683][123091] Updated weights for policy 0, policy_version 762931 (0.0006) [2023-12-26 05:40:58,705][123090] Updated weights for policy 1, policy_version 758001 (0.0013) [2023-12-26 05:40:58,751][123091] Updated weights for policy 0, policy_version 762941 (0.0008) [2023-12-26 05:40:58,771][123090] Updated weights for policy 1, policy_version 758011 (0.0009) [2023-12-26 05:40:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 389357568. Throughput: 0: 8857.8, 1: 8831.3. Samples: 389361152. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:40:58,785][121949] Avg episode reward: [(0, '6175.129'), (1, '5431.945')] [2023-12-26 05:40:58,819][123091] Updated weights for policy 0, policy_version 762951 (0.0007) [2023-12-26 05:40:59,613][123090] Updated weights for policy 1, policy_version 758021 (0.0010) [2023-12-26 05:40:59,619][123091] Updated weights for policy 0, policy_version 762961 (0.0009) [2023-12-26 05:40:59,662][123090] Updated weights for policy 1, policy_version 758031 (0.0009) [2023-12-26 05:40:59,673][123091] Updated weights for policy 0, policy_version 762971 (0.0007) [2023-12-26 05:40:59,711][123090] Updated weights for policy 1, policy_version 758041 (0.0009) [2023-12-26 05:40:59,722][123091] Updated weights for policy 0, policy_version 762981 (0.0006) [2023-12-26 05:40:59,770][123091] Updated weights for policy 0, policy_version 762991 (0.0008) [2023-12-26 05:41:00,554][123091] Updated weights for policy 0, policy_version 763002 (0.0010) [2023-12-26 05:41:00,587][123090] Updated weights for policy 1, policy_version 758051 (0.0006) [2023-12-26 05:41:00,609][123091] Updated weights for policy 0, policy_version 763012 (0.0009) [2023-12-26 05:41:00,641][123090] Updated weights for policy 1, policy_version 758061 (0.0009) [2023-12-26 05:41:00,661][123091] Updated weights for policy 0, policy_version 763022 (0.0007) [2023-12-26 05:41:00,707][123090] Updated weights for policy 1, policy_version 758071 (0.0010) [2023-12-26 05:41:01,438][123090] Updated weights for policy 1, policy_version 758081 (0.0006) [2023-12-26 05:41:01,486][123091] Updated weights for policy 0, policy_version 763032 (0.0008) [2023-12-26 05:41:01,497][123090] Updated weights for policy 1, policy_version 758091 (0.0006) [2023-12-26 05:41:01,546][123091] Updated weights for policy 0, policy_version 763042 (0.0009) [2023-12-26 05:41:01,567][123090] Updated weights for policy 1, policy_version 758101 (0.0006) [2023-12-26 05:41:01,606][123091] Updated weights for policy 0, policy_version 763052 (0.0008) [2023-12-26 05:41:01,630][123090] Updated weights for policy 1, policy_version 758111 (0.0007) [2023-12-26 05:41:02,451][123091] Updated weights for policy 0, policy_version 763062 (0.0008) [2023-12-26 05:41:02,459][123090] Updated weights for policy 1, policy_version 758121 (0.0009) [2023-12-26 05:41:02,509][123090] Updated weights for policy 1, policy_version 758131 (0.0008) [2023-12-26 05:41:02,509][123091] Updated weights for policy 0, policy_version 763072 (0.0010) [2023-12-26 05:41:02,561][123090] Updated weights for policy 1, policy_version 758141 (0.0008) [2023-12-26 05:41:02,563][123091] Updated weights for policy 0, policy_version 763082 (0.0008) [2023-12-26 05:41:03,396][123090] Updated weights for policy 1, policy_version 758151 (0.0008) [2023-12-26 05:41:03,407][123091] Updated weights for policy 0, policy_version 763092 (0.0009) [2023-12-26 05:41:03,448][123090] Updated weights for policy 1, policy_version 758161 (0.0007) [2023-12-26 05:41:03,464][123091] Updated weights for policy 0, policy_version 763102 (0.0009) [2023-12-26 05:41:03,501][123090] Updated weights for policy 1, policy_version 758171 (0.0008) [2023-12-26 05:41:03,521][123091] Updated weights for policy 0, policy_version 763112 (0.0007) [2023-12-26 05:41:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 389455872. Throughput: 0: 8797.9, 1: 8768.6. Samples: 389463892. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:03,784][121949] Avg episode reward: [(0, '6144.737'), (1, '5368.852')] [2023-12-26 05:41:04,248][123090] Updated weights for policy 1, policy_version 758181 (0.0008) [2023-12-26 05:41:04,310][123090] Updated weights for policy 1, policy_version 758191 (0.0009) [2023-12-26 05:41:04,373][123090] Updated weights for policy 1, policy_version 758201 (0.0010) [2023-12-26 05:41:04,433][123091] Updated weights for policy 0, policy_version 763122 (0.0010) [2023-12-26 05:41:04,492][123091] Updated weights for policy 0, policy_version 763132 (0.0009) [2023-12-26 05:41:04,547][123091] Updated weights for policy 0, policy_version 763142 (0.0010) [2023-12-26 05:41:04,614][123091] Updated weights for policy 0, policy_version 763152 (0.0009) [2023-12-26 05:41:04,988][123090] Updated weights for policy 1, policy_version 758211 (0.0007) [2023-12-26 05:41:05,048][123090] Updated weights for policy 1, policy_version 758221 (0.0006) [2023-12-26 05:41:05,121][123090] Updated weights for policy 1, policy_version 758231 (0.0010) [2023-12-26 05:41:05,564][123091] Updated weights for policy 0, policy_version 763162 (0.0010) [2023-12-26 05:41:05,624][123091] Updated weights for policy 0, policy_version 763173 (0.0010) [2023-12-26 05:41:05,690][123090] Updated weights for policy 1, policy_version 758241 (0.0007) [2023-12-26 05:41:05,739][123090] Updated weights for policy 1, policy_version 758251 (0.0005) [2023-12-26 05:41:05,787][123090] Updated weights for policy 1, policy_version 758261 (0.0005) [2023-12-26 05:41:05,836][123090] Updated weights for policy 1, policy_version 758271 (0.0008) [2023-12-26 05:41:06,575][123091] Updated weights for policy 0, policy_version 763185 (0.0010) [2023-12-26 05:41:06,621][123090] Updated weights for policy 1, policy_version 758281 (0.0006) [2023-12-26 05:41:06,636][123091] Updated weights for policy 0, policy_version 763195 (0.0009) [2023-12-26 05:41:06,678][123090] Updated weights for policy 1, policy_version 758291 (0.0005) [2023-12-26 05:41:06,695][123091] Updated weights for policy 0, policy_version 763205 (0.0009) [2023-12-26 05:41:06,732][123090] Updated weights for policy 1, policy_version 758301 (0.0005) [2023-12-26 05:41:06,752][123091] Updated weights for policy 0, policy_version 763215 (0.0009) [2023-12-26 05:41:07,486][123090] Updated weights for policy 1, policy_version 758311 (0.0006) [2023-12-26 05:41:07,541][123090] Updated weights for policy 1, policy_version 758321 (0.0005) [2023-12-26 05:41:07,589][123090] Updated weights for policy 1, policy_version 758331 (0.0005) [2023-12-26 05:41:07,644][123091] Updated weights for policy 0, policy_version 763225 (0.0010) [2023-12-26 05:41:07,712][123091] Updated weights for policy 0, policy_version 763235 (0.0011) [2023-12-26 05:41:07,780][123091] Updated weights for policy 0, policy_version 763245 (0.0010) [2023-12-26 05:41:08,353][123090] Updated weights for policy 1, policy_version 758341 (0.0007) [2023-12-26 05:41:08,414][123090] Updated weights for policy 1, policy_version 758351 (0.0010) [2023-12-26 05:41:08,472][123090] Updated weights for policy 1, policy_version 758361 (0.0010) [2023-12-26 05:41:08,621][123091] Updated weights for policy 0, policy_version 763255 (0.0008) [2023-12-26 05:41:08,686][123091] Updated weights for policy 0, policy_version 763265 (0.0008) [2023-12-26 05:41:08,755][123091] Updated weights for policy 0, policy_version 763275 (0.0008) [2023-12-26 05:41:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 389537792. Throughput: 0: 8704.0, 1: 8866.6. Samples: 389516936. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:08,785][121949] Avg episode reward: [(0, '6131.842'), (1, '5166.940')] [2023-12-26 05:41:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000763280_195403776.pth... [2023-12-26 05:41:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000758368_194142208.pth... [2023-12-26 05:41:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000757312_193871872.pth [2023-12-26 05:41:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000762256_195141632.pth [2023-12-26 05:41:09,304][123090] Updated weights for policy 1, policy_version 758371 (0.0010) [2023-12-26 05:41:09,369][123090] Updated weights for policy 1, policy_version 758381 (0.0010) [2023-12-26 05:41:09,444][123090] Updated weights for policy 1, policy_version 758391 (0.0011) [2023-12-26 05:41:09,445][123091] Updated weights for policy 0, policy_version 763285 (0.0009) [2023-12-26 05:41:09,508][123091] Updated weights for policy 0, policy_version 763295 (0.0008) [2023-12-26 05:41:09,571][123091] Updated weights for policy 0, policy_version 763305 (0.0008) [2023-12-26 05:41:10,366][123090] Updated weights for policy 1, policy_version 758401 (0.0010) [2023-12-26 05:41:10,410][123091] Updated weights for policy 0, policy_version 763315 (0.0009) [2023-12-26 05:41:10,438][123090] Updated weights for policy 1, policy_version 758411 (0.0011) [2023-12-26 05:41:10,463][123091] Updated weights for policy 0, policy_version 763325 (0.0007) [2023-12-26 05:41:10,508][123090] Updated weights for policy 1, policy_version 758421 (0.0011) [2023-12-26 05:41:10,517][123091] Updated weights for policy 0, policy_version 763335 (0.0006) [2023-12-26 05:41:10,564][123090] Updated weights for policy 1, policy_version 758431 (0.0010) [2023-12-26 05:41:11,255][123091] Updated weights for policy 0, policy_version 763345 (0.0006) [2023-12-26 05:41:11,319][123091] Updated weights for policy 0, policy_version 763355 (0.0008) [2023-12-26 05:41:11,336][123090] Updated weights for policy 1, policy_version 758441 (0.0008) [2023-12-26 05:41:11,392][123091] Updated weights for policy 0, policy_version 763365 (0.0010) [2023-12-26 05:41:11,411][123090] Updated weights for policy 1, policy_version 758451 (0.0008) [2023-12-26 05:41:11,457][123091] Updated weights for policy 0, policy_version 763375 (0.0008) [2023-12-26 05:41:11,478][123090] Updated weights for policy 1, policy_version 758461 (0.0007) [2023-12-26 05:41:12,283][123090] Updated weights for policy 1, policy_version 758471 (0.0010) [2023-12-26 05:41:12,343][123091] Updated weights for policy 0, policy_version 763385 (0.0010) [2023-12-26 05:41:12,359][123090] Updated weights for policy 1, policy_version 758481 (0.0011) [2023-12-26 05:41:12,408][123091] Updated weights for policy 0, policy_version 763395 (0.0009) [2023-12-26 05:41:12,421][123090] Updated weights for policy 1, policy_version 758491 (0.0009) [2023-12-26 05:41:12,474][123091] Updated weights for policy 0, policy_version 763405 (0.0010) [2023-12-26 05:41:13,034][123090] Updated weights for policy 1, policy_version 758501 (0.0006) [2023-12-26 05:41:13,093][123090] Updated weights for policy 1, policy_version 758511 (0.0005) [2023-12-26 05:41:13,152][123090] Updated weights for policy 1, policy_version 758521 (0.0005) [2023-12-26 05:41:13,379][123091] Updated weights for policy 0, policy_version 763415 (0.0010) [2023-12-26 05:41:13,433][123091] Updated weights for policy 0, policy_version 763425 (0.0009) [2023-12-26 05:41:13,492][123091] Updated weights for policy 0, policy_version 763435 (0.0009) [2023-12-26 05:41:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 389627904. Throughput: 0: 8736.1, 1: 8853.4. Samples: 389620904. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:13,785][121949] Avg episode reward: [(0, '6111.351'), (1, '5318.215')] [2023-12-26 05:41:13,905][123090] Updated weights for policy 1, policy_version 758531 (0.0007) [2023-12-26 05:41:13,948][123090] Updated weights for policy 1, policy_version 758541 (0.0010) [2023-12-26 05:41:13,999][123090] Updated weights for policy 1, policy_version 758551 (0.0010) [2023-12-26 05:41:14,237][123091] Updated weights for policy 0, policy_version 763445 (0.0007) [2023-12-26 05:41:14,284][123091] Updated weights for policy 0, policy_version 763455 (0.0006) [2023-12-26 05:41:14,339][123091] Updated weights for policy 0, policy_version 763465 (0.0006) [2023-12-26 05:41:14,872][123090] Updated weights for policy 1, policy_version 758561 (0.0010) [2023-12-26 05:41:14,931][123090] Updated weights for policy 1, policy_version 758571 (0.0011) [2023-12-26 05:41:14,995][123090] Updated weights for policy 1, policy_version 758581 (0.0011) [2023-12-26 05:41:15,058][123090] Updated weights for policy 1, policy_version 758591 (0.0011) [2023-12-26 05:41:15,061][123091] Updated weights for policy 0, policy_version 763475 (0.0006) [2023-12-26 05:41:15,118][123091] Updated weights for policy 0, policy_version 763485 (0.0009) [2023-12-26 05:41:15,168][123091] Updated weights for policy 0, policy_version 763495 (0.0009) [2023-12-26 05:41:15,821][123090] Updated weights for policy 1, policy_version 758601 (0.0011) [2023-12-26 05:41:15,888][123090] Updated weights for policy 1, policy_version 758611 (0.0011) [2023-12-26 05:41:15,933][123091] Updated weights for policy 0, policy_version 763505 (0.0009) [2023-12-26 05:41:15,955][123090] Updated weights for policy 1, policy_version 758621 (0.0011) [2023-12-26 05:41:15,993][123091] Updated weights for policy 0, policy_version 763515 (0.0005) [2023-12-26 05:41:16,055][123091] Updated weights for policy 0, policy_version 763525 (0.0005) [2023-12-26 05:41:16,114][123091] Updated weights for policy 0, policy_version 763535 (0.0009) [2023-12-26 05:41:16,694][123090] Updated weights for policy 1, policy_version 758631 (0.0010) [2023-12-26 05:41:16,748][123090] Updated weights for policy 1, policy_version 758641 (0.0010) [2023-12-26 05:41:16,790][123091] Updated weights for policy 0, policy_version 763545 (0.0006) [2023-12-26 05:41:16,799][123090] Updated weights for policy 1, policy_version 758651 (0.0008) [2023-12-26 05:41:16,841][123091] Updated weights for policy 0, policy_version 763555 (0.0005) [2023-12-26 05:41:16,900][123091] Updated weights for policy 0, policy_version 763565 (0.0005) [2023-12-26 05:41:17,571][123091] Updated weights for policy 0, policy_version 763575 (0.0005) [2023-12-26 05:41:17,642][123091] Updated weights for policy 0, policy_version 763585 (0.0005) [2023-12-26 05:41:17,664][123090] Updated weights for policy 1, policy_version 758661 (0.0007) [2023-12-26 05:41:17,701][123091] Updated weights for policy 0, policy_version 763595 (0.0005) [2023-12-26 05:41:17,719][123090] Updated weights for policy 1, policy_version 758671 (0.0006) [2023-12-26 05:41:17,783][123090] Updated weights for policy 1, policy_version 758681 (0.0006) [2023-12-26 05:41:18,375][123091] Updated weights for policy 0, policy_version 763605 (0.0008) [2023-12-26 05:41:18,442][123091] Updated weights for policy 0, policy_version 763615 (0.0011) [2023-12-26 05:41:18,512][123091] Updated weights for policy 0, policy_version 763625 (0.0010) [2023-12-26 05:41:18,560][123090] Updated weights for policy 1, policy_version 758691 (0.0010) [2023-12-26 05:41:18,624][123090] Updated weights for policy 1, policy_version 758701 (0.0010) [2023-12-26 05:41:18,687][123090] Updated weights for policy 1, policy_version 758711 (0.0010) [2023-12-26 05:41:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 389726208. Throughput: 0: 8838.4, 1: 8880.5. Samples: 389732196. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:18,785][121949] Avg episode reward: [(0, '6223.413'), (1, '5205.543')] [2023-12-26 05:41:19,295][123091] Updated weights for policy 0, policy_version 763635 (0.0010) [2023-12-26 05:41:19,362][123091] Updated weights for policy 0, policy_version 763645 (0.0011) [2023-12-26 05:41:19,432][123091] Updated weights for policy 0, policy_version 763655 (0.0010) [2023-12-26 05:41:19,501][123090] Updated weights for policy 1, policy_version 758721 (0.0009) [2023-12-26 05:41:19,555][123090] Updated weights for policy 1, policy_version 758731 (0.0006) [2023-12-26 05:41:19,614][123090] Updated weights for policy 1, policy_version 758741 (0.0005) [2023-12-26 05:41:19,675][123090] Updated weights for policy 1, policy_version 758751 (0.0005) [2023-12-26 05:41:20,328][123091] Updated weights for policy 0, policy_version 763665 (0.0009) [2023-12-26 05:41:20,385][123091] Updated weights for policy 0, policy_version 763675 (0.0009) [2023-12-26 05:41:20,444][123091] Updated weights for policy 0, policy_version 763685 (0.0008) [2023-12-26 05:41:20,464][123090] Updated weights for policy 1, policy_version 758761 (0.0010) [2023-12-26 05:41:20,493][123091] Updated weights for policy 0, policy_version 763695 (0.0005) [2023-12-26 05:41:20,516][123090] Updated weights for policy 1, policy_version 758771 (0.0008) [2023-12-26 05:41:20,578][123090] Updated weights for policy 1, policy_version 758781 (0.0007) [2023-12-26 05:41:21,384][123091] Updated weights for policy 0, policy_version 763705 (0.0009) [2023-12-26 05:41:21,405][123090] Updated weights for policy 1, policy_version 758791 (0.0008) [2023-12-26 05:41:21,452][123091] Updated weights for policy 0, policy_version 763715 (0.0008) [2023-12-26 05:41:21,468][123090] Updated weights for policy 1, policy_version 758801 (0.0008) [2023-12-26 05:41:21,523][123091] Updated weights for policy 0, policy_version 763725 (0.0007) [2023-12-26 05:41:21,537][123090] Updated weights for policy 1, policy_version 758811 (0.0009) [2023-12-26 05:41:22,257][123091] Updated weights for policy 0, policy_version 763735 (0.0008) [2023-12-26 05:41:22,320][123091] Updated weights for policy 0, policy_version 763745 (0.0009) [2023-12-26 05:41:22,391][123091] Updated weights for policy 0, policy_version 763755 (0.0009) [2023-12-26 05:41:22,430][123090] Updated weights for policy 1, policy_version 758822 (0.0010) [2023-12-26 05:41:22,488][123090] Updated weights for policy 1, policy_version 758832 (0.0011) [2023-12-26 05:41:22,553][123090] Updated weights for policy 1, policy_version 758842 (0.0011) [2023-12-26 05:41:23,254][123091] Updated weights for policy 0, policy_version 763765 (0.0010) [2023-12-26 05:41:23,321][123091] Updated weights for policy 0, policy_version 763775 (0.0010) [2023-12-26 05:41:23,350][123090] Updated weights for policy 1, policy_version 758852 (0.0009) [2023-12-26 05:41:23,377][123091] Updated weights for policy 0, policy_version 763785 (0.0009) [2023-12-26 05:41:23,413][123090] Updated weights for policy 1, policy_version 758862 (0.0006) [2023-12-26 05:41:23,475][123090] Updated weights for policy 1, policy_version 758872 (0.0009) [2023-12-26 05:41:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 389808128. Throughput: 0: 8811.3, 1: 8889.2. Samples: 389782788. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:23,784][121949] Avg episode reward: [(0, '5975.024'), (1, '5212.478')] [2023-12-26 05:41:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000763792_195534848.pth... [2023-12-26 05:41:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000758880_194273280.pth... [2023-12-26 05:41:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000762768_195272704.pth [2023-12-26 05:41:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000757856_194011136.pth [2023-12-26 05:41:24,235][123090] Updated weights for policy 1, policy_version 758882 (0.0009) [2023-12-26 05:41:24,266][123091] Updated weights for policy 0, policy_version 763795 (0.0009) [2023-12-26 05:41:24,293][123090] Updated weights for policy 1, policy_version 758892 (0.0009) [2023-12-26 05:41:24,328][123091] Updated weights for policy 0, policy_version 763805 (0.0007) [2023-12-26 05:41:24,346][123090] Updated weights for policy 1, policy_version 758902 (0.0009) [2023-12-26 05:41:24,393][123091] Updated weights for policy 0, policy_version 763815 (0.0007) [2023-12-26 05:41:24,407][123090] Updated weights for policy 1, policy_version 758912 (0.0010) [2023-12-26 05:41:25,218][123091] Updated weights for policy 0, policy_version 763825 (0.0008) [2023-12-26 05:41:25,227][123090] Updated weights for policy 1, policy_version 758922 (0.0010) [2023-12-26 05:41:25,284][123090] Updated weights for policy 1, policy_version 758932 (0.0008) [2023-12-26 05:41:25,286][123091] Updated weights for policy 0, policy_version 763835 (0.0008) [2023-12-26 05:41:25,342][123091] Updated weights for policy 0, policy_version 763845 (0.0009) [2023-12-26 05:41:25,344][123090] Updated weights for policy 1, policy_version 758942 (0.0007) [2023-12-26 05:41:25,408][123091] Updated weights for policy 0, policy_version 763855 (0.0009) [2023-12-26 05:41:26,102][123091] Updated weights for policy 0, policy_version 763865 (0.0008) [2023-12-26 05:41:26,168][123091] Updated weights for policy 0, policy_version 763875 (0.0009) [2023-12-26 05:41:26,239][123091] Updated weights for policy 0, policy_version 763885 (0.0005) [2023-12-26 05:41:26,261][123090] Updated weights for policy 1, policy_version 758952 (0.0009) [2023-12-26 05:41:26,331][123090] Updated weights for policy 1, policy_version 758962 (0.0010) [2023-12-26 05:41:26,400][123090] Updated weights for policy 1, policy_version 758972 (0.0009) [2023-12-26 05:41:26,942][123091] Updated weights for policy 0, policy_version 763895 (0.0009) [2023-12-26 05:41:26,994][123091] Updated weights for policy 0, policy_version 763905 (0.0010) [2023-12-26 05:41:27,040][123091] Updated weights for policy 0, policy_version 763916 (0.0005) [2023-12-26 05:41:27,265][123090] Updated weights for policy 1, policy_version 758982 (0.0010) [2023-12-26 05:41:27,324][123090] Updated weights for policy 1, policy_version 758992 (0.0010) [2023-12-26 05:41:27,389][123090] Updated weights for policy 1, policy_version 759002 (0.0010) [2023-12-26 05:41:27,793][123091] Updated weights for policy 0, policy_version 763926 (0.0008) [2023-12-26 05:41:27,844][123091] Updated weights for policy 0, policy_version 763936 (0.0010) [2023-12-26 05:41:27,891][123091] Updated weights for policy 0, policy_version 763946 (0.0010) [2023-12-26 05:41:28,225][123090] Updated weights for policy 1, policy_version 759012 (0.0010) [2023-12-26 05:41:28,271][123090] Updated weights for policy 1, policy_version 759022 (0.0008) [2023-12-26 05:41:28,318][123090] Updated weights for policy 1, policy_version 759032 (0.0008) [2023-12-26 05:41:28,678][123091] Updated weights for policy 0, policy_version 763956 (0.0008) [2023-12-26 05:41:28,740][123091] Updated weights for policy 0, policy_version 763966 (0.0005) [2023-12-26 05:41:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 389890048. Throughput: 0: 8886.4, 1: 8865.1. Samples: 389887548. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:28,785][121949] Avg episode reward: [(0, '5962.848'), (1, '5203.269')] [2023-12-26 05:41:28,800][123091] Updated weights for policy 0, policy_version 763976 (0.0005) [2023-12-26 05:41:29,248][123090] Updated weights for policy 1, policy_version 759042 (0.0008) [2023-12-26 05:41:29,316][123090] Updated weights for policy 1, policy_version 759052 (0.0009) [2023-12-26 05:41:29,390][123090] Updated weights for policy 1, policy_version 759062 (0.0010) [2023-12-26 05:41:29,461][123090] Updated weights for policy 1, policy_version 759072 (0.0010) [2023-12-26 05:41:29,579][123091] Updated weights for policy 0, policy_version 763986 (0.0007) [2023-12-26 05:41:29,632][123091] Updated weights for policy 0, policy_version 763996 (0.0010) [2023-12-26 05:41:29,688][123091] Updated weights for policy 0, policy_version 764006 (0.0010) [2023-12-26 05:41:29,741][123091] Updated weights for policy 0, policy_version 764016 (0.0008) [2023-12-26 05:41:30,304][123090] Updated weights for policy 1, policy_version 759082 (0.0009) [2023-12-26 05:41:30,369][123090] Updated weights for policy 1, policy_version 759092 (0.0009) [2023-12-26 05:41:30,429][123090] Updated weights for policy 1, policy_version 759102 (0.0009) [2023-12-26 05:41:30,584][123091] Updated weights for policy 0, policy_version 764026 (0.0005) [2023-12-26 05:41:30,650][123091] Updated weights for policy 0, policy_version 764036 (0.0006) [2023-12-26 05:41:30,709][123091] Updated weights for policy 0, policy_version 764046 (0.0009) [2023-12-26 05:41:31,317][123090] Updated weights for policy 1, policy_version 759112 (0.0009) [2023-12-26 05:41:31,386][123090] Updated weights for policy 1, policy_version 759122 (0.0009) [2023-12-26 05:41:31,407][123091] Updated weights for policy 0, policy_version 764056 (0.0006) [2023-12-26 05:41:31,442][123090] Updated weights for policy 1, policy_version 759132 (0.0008) [2023-12-26 05:41:31,468][123091] Updated weights for policy 0, policy_version 764066 (0.0006) [2023-12-26 05:41:31,536][123091] Updated weights for policy 0, policy_version 764076 (0.0009) [2023-12-26 05:41:32,233][123090] Updated weights for policy 1, policy_version 759142 (0.0010) [2023-12-26 05:41:32,297][123090] Updated weights for policy 1, policy_version 759152 (0.0009) [2023-12-26 05:41:32,356][123090] Updated weights for policy 1, policy_version 759162 (0.0008) [2023-12-26 05:41:32,365][123091] Updated weights for policy 0, policy_version 764086 (0.0009) [2023-12-26 05:41:32,424][123091] Updated weights for policy 0, policy_version 764096 (0.0008) [2023-12-26 05:41:32,479][123091] Updated weights for policy 0, policy_version 764106 (0.0009) [2023-12-26 05:41:33,211][123090] Updated weights for policy 1, policy_version 759172 (0.0009) [2023-12-26 05:41:33,268][123090] Updated weights for policy 1, policy_version 759182 (0.0008) [2023-12-26 05:41:33,319][123091] Updated weights for policy 0, policy_version 764116 (0.0007) [2023-12-26 05:41:33,327][123090] Updated weights for policy 1, policy_version 759192 (0.0009) [2023-12-26 05:41:33,384][123091] Updated weights for policy 0, policy_version 764126 (0.0005) [2023-12-26 05:41:33,441][123091] Updated weights for policy 0, policy_version 764136 (0.0005) [2023-12-26 05:41:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 389980160. Throughput: 0: 8767.3, 1: 8736.3. Samples: 389991228. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:33,785][121949] Avg episode reward: [(0, '6109.121'), (1, '5298.271')] [2023-12-26 05:41:34,159][123090] Updated weights for policy 1, policy_version 759202 (0.0008) [2023-12-26 05:41:34,203][123091] Updated weights for policy 0, policy_version 764146 (0.0006) [2023-12-26 05:41:34,221][123090] Updated weights for policy 1, policy_version 759212 (0.0009) [2023-12-26 05:41:34,268][123091] Updated weights for policy 0, policy_version 764156 (0.0009) [2023-12-26 05:41:34,283][123090] Updated weights for policy 1, policy_version 759222 (0.0009) [2023-12-26 05:41:34,325][123091] Updated weights for policy 0, policy_version 764166 (0.0008) [2023-12-26 05:41:34,350][123090] Updated weights for policy 1, policy_version 759232 (0.0008) [2023-12-26 05:41:34,377][123091] Updated weights for policy 0, policy_version 764176 (0.0009) [2023-12-26 05:41:35,145][123090] Updated weights for policy 1, policy_version 759242 (0.0008) [2023-12-26 05:41:35,209][123090] Updated weights for policy 1, policy_version 759252 (0.0009) [2023-12-26 05:41:35,242][123091] Updated weights for policy 0, policy_version 764186 (0.0008) [2023-12-26 05:41:35,277][123090] Updated weights for policy 1, policy_version 759262 (0.0008) [2023-12-26 05:41:35,295][123091] Updated weights for policy 0, policy_version 764196 (0.0006) [2023-12-26 05:41:35,348][123091] Updated weights for policy 0, policy_version 764206 (0.0006) [2023-12-26 05:41:36,091][123091] Updated weights for policy 0, policy_version 764216 (0.0009) [2023-12-26 05:41:36,093][123090] Updated weights for policy 1, policy_version 759272 (0.0007) [2023-12-26 05:41:36,155][123091] Updated weights for policy 0, policy_version 764226 (0.0008) [2023-12-26 05:41:36,165][123090] Updated weights for policy 1, policy_version 759282 (0.0010) [2023-12-26 05:41:36,212][123091] Updated weights for policy 0, policy_version 764236 (0.0010) [2023-12-26 05:41:36,227][123090] Updated weights for policy 1, policy_version 759292 (0.0007) [2023-12-26 05:41:36,965][123091] Updated weights for policy 0, policy_version 764246 (0.0007) [2023-12-26 05:41:37,011][123091] Updated weights for policy 0, policy_version 764256 (0.0006) [2023-12-26 05:41:37,060][123091] Updated weights for policy 0, policy_version 764266 (0.0005) [2023-12-26 05:41:37,088][123090] Updated weights for policy 1, policy_version 759302 (0.0007) [2023-12-26 05:41:37,140][123090] Updated weights for policy 1, policy_version 759312 (0.0010) [2023-12-26 05:41:37,193][123090] Updated weights for policy 1, policy_version 759322 (0.0009) [2023-12-26 05:41:37,653][123091] Updated weights for policy 0, policy_version 764276 (0.0008) [2023-12-26 05:41:37,716][123091] Updated weights for policy 0, policy_version 764286 (0.0009) [2023-12-26 05:41:37,789][123091] Updated weights for policy 0, policy_version 764296 (0.0011) [2023-12-26 05:41:37,975][123090] Updated weights for policy 1, policy_version 759332 (0.0008) [2023-12-26 05:41:38,044][123090] Updated weights for policy 1, policy_version 759342 (0.0006) [2023-12-26 05:41:38,106][123090] Updated weights for policy 1, policy_version 759352 (0.0005) [2023-12-26 05:41:38,620][123091] Updated weights for policy 0, policy_version 764307 (0.0010) [2023-12-26 05:41:38,677][123091] Updated weights for policy 0, policy_version 764317 (0.0009) [2023-12-26 05:41:38,732][123091] Updated weights for policy 0, policy_version 764327 (0.0010) [2023-12-26 05:41:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 390070272. Throughput: 0: 8759.5, 1: 8743.0. Samples: 390043320. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:38,785][121949] Avg episode reward: [(0, '6001.935'), (1, '5208.465')] [2023-12-26 05:41:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000759360_194396160.pth... [2023-12-26 05:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000764336_195674112.pth... [2023-12-26 05:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000758368_194142208.pth [2023-12-26 05:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000763280_195403776.pth [2023-12-26 05:41:38,840][123090] Updated weights for policy 1, policy_version 759362 (0.0006) [2023-12-26 05:41:38,903][123090] Updated weights for policy 1, policy_version 759372 (0.0009) [2023-12-26 05:41:38,960][123090] Updated weights for policy 1, policy_version 759382 (0.0010) [2023-12-26 05:41:39,011][123090] Updated weights for policy 1, policy_version 759392 (0.0008) [2023-12-26 05:41:39,587][123091] Updated weights for policy 0, policy_version 764337 (0.0009) [2023-12-26 05:41:39,651][123091] Updated weights for policy 0, policy_version 764347 (0.0008) [2023-12-26 05:41:39,713][123091] Updated weights for policy 0, policy_version 764357 (0.0006) [2023-12-26 05:41:39,772][123091] Updated weights for policy 0, policy_version 764367 (0.0010) [2023-12-26 05:41:39,862][123090] Updated weights for policy 1, policy_version 759402 (0.0010) [2023-12-26 05:41:39,936][123090] Updated weights for policy 1, policy_version 759412 (0.0009) [2023-12-26 05:41:40,003][123090] Updated weights for policy 1, policy_version 759422 (0.0009) [2023-12-26 05:41:40,556][123091] Updated weights for policy 0, policy_version 764377 (0.0006) [2023-12-26 05:41:40,622][123091] Updated weights for policy 0, policy_version 764387 (0.0006) [2023-12-26 05:41:40,694][123091] Updated weights for policy 0, policy_version 764397 (0.0006) [2023-12-26 05:41:40,813][123090] Updated weights for policy 1, policy_version 759432 (0.0006) [2023-12-26 05:41:40,869][123090] Updated weights for policy 1, policy_version 759442 (0.0006) [2023-12-26 05:41:40,921][123090] Updated weights for policy 1, policy_version 759452 (0.0005) [2023-12-26 05:41:41,373][123091] Updated weights for policy 0, policy_version 764407 (0.0008) [2023-12-26 05:41:41,426][123091] Updated weights for policy 0, policy_version 764417 (0.0011) [2023-12-26 05:41:41,474][123091] Updated weights for policy 0, policy_version 764427 (0.0010) [2023-12-26 05:41:41,679][123090] Updated weights for policy 1, policy_version 759462 (0.0007) [2023-12-26 05:41:41,751][123090] Updated weights for policy 1, policy_version 759472 (0.0008) [2023-12-26 05:41:41,804][123090] Updated weights for policy 1, policy_version 759482 (0.0006) [2023-12-26 05:41:42,356][123091] Updated weights for policy 0, policy_version 764437 (0.0010) [2023-12-26 05:41:42,415][123091] Updated weights for policy 0, policy_version 764447 (0.0009) [2023-12-26 05:41:42,479][123091] Updated weights for policy 0, policy_version 764457 (0.0009) [2023-12-26 05:41:42,545][123090] Updated weights for policy 1, policy_version 759492 (0.0008) [2023-12-26 05:41:42,610][123090] Updated weights for policy 1, policy_version 759502 (0.0009) [2023-12-26 05:41:42,676][123090] Updated weights for policy 1, policy_version 759512 (0.0008) [2023-12-26 05:41:43,373][123091] Updated weights for policy 0, policy_version 764467 (0.0010) [2023-12-26 05:41:43,428][123090] Updated weights for policy 1, policy_version 759522 (0.0008) [2023-12-26 05:41:43,431][123091] Updated weights for policy 0, policy_version 764477 (0.0009) [2023-12-26 05:41:43,493][123090] Updated weights for policy 1, policy_version 759532 (0.0008) [2023-12-26 05:41:43,495][123091] Updated weights for policy 0, policy_version 764487 (0.0007) [2023-12-26 05:41:43,556][123090] Updated weights for policy 1, policy_version 759542 (0.0008) [2023-12-26 05:41:43,606][123090] Updated weights for policy 1, policy_version 759552 (0.0009) [2023-12-26 05:41:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 390160384. Throughput: 0: 8810.3, 1: 8741.7. Samples: 390150992. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:43,784][121949] Avg episode reward: [(0, '6054.764'), (1, '5060.500')] [2023-12-26 05:41:44,313][123091] Updated weights for policy 0, policy_version 764497 (0.0010) [2023-12-26 05:41:44,373][123091] Updated weights for policy 0, policy_version 764507 (0.0010) [2023-12-26 05:41:44,419][123091] Updated weights for policy 0, policy_version 764517 (0.0008) [2023-12-26 05:41:44,425][123090] Updated weights for policy 1, policy_version 759562 (0.0007) [2023-12-26 05:41:44,471][123091] Updated weights for policy 0, policy_version 764527 (0.0008) [2023-12-26 05:41:44,482][123090] Updated weights for policy 1, policy_version 759572 (0.0008) [2023-12-26 05:41:44,535][123090] Updated weights for policy 1, policy_version 759582 (0.0009) [2023-12-26 05:41:45,325][123091] Updated weights for policy 0, policy_version 764537 (0.0009) [2023-12-26 05:41:45,392][123091] Updated weights for policy 0, policy_version 764547 (0.0009) [2023-12-26 05:41:45,404][123090] Updated weights for policy 1, policy_version 759592 (0.0008) [2023-12-26 05:41:45,456][123091] Updated weights for policy 0, policy_version 764557 (0.0009) [2023-12-26 05:41:45,467][123090] Updated weights for policy 1, policy_version 759602 (0.0008) [2023-12-26 05:41:45,535][123090] Updated weights for policy 1, policy_version 759612 (0.0008) [2023-12-26 05:41:46,189][123090] Updated weights for policy 1, policy_version 759622 (0.0008) [2023-12-26 05:41:46,251][123091] Updated weights for policy 0, policy_version 764567 (0.0009) [2023-12-26 05:41:46,255][123090] Updated weights for policy 1, policy_version 759632 (0.0005) [2023-12-26 05:41:46,308][123091] Updated weights for policy 0, policy_version 764577 (0.0011) [2023-12-26 05:41:46,314][123090] Updated weights for policy 1, policy_version 759642 (0.0005) [2023-12-26 05:41:46,364][123091] Updated weights for policy 0, policy_version 764587 (0.0008) [2023-12-26 05:41:47,119][123090] Updated weights for policy 1, policy_version 759652 (0.0010) [2023-12-26 05:41:47,181][123090] Updated weights for policy 1, policy_version 759662 (0.0010) [2023-12-26 05:41:47,211][123091] Updated weights for policy 0, policy_version 764597 (0.0009) [2023-12-26 05:41:47,243][123090] Updated weights for policy 1, policy_version 759672 (0.0010) [2023-12-26 05:41:47,263][123091] Updated weights for policy 0, policy_version 764607 (0.0007) [2023-12-26 05:41:47,309][123091] Updated weights for policy 0, policy_version 764617 (0.0007) [2023-12-26 05:41:48,001][123091] Updated weights for policy 0, policy_version 764627 (0.0009) [2023-12-26 05:41:48,052][123090] Updated weights for policy 1, policy_version 759682 (0.0010) [2023-12-26 05:41:48,068][123091] Updated weights for policy 0, policy_version 764637 (0.0011) [2023-12-26 05:41:48,119][123090] Updated weights for policy 1, policy_version 759692 (0.0011) [2023-12-26 05:41:48,131][123091] Updated weights for policy 0, policy_version 764647 (0.0011) [2023-12-26 05:41:48,187][123090] Updated weights for policy 1, policy_version 759702 (0.0010) [2023-12-26 05:41:48,254][123090] Updated weights for policy 1, policy_version 759712 (0.0010) [2023-12-26 05:41:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 390242304. Throughput: 0: 8829.6, 1: 8780.2. Samples: 390256336. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:48,785][121949] Avg episode reward: [(0, '6099.230'), (1, '5233.647')] [2023-12-26 05:41:48,949][123091] Updated weights for policy 0, policy_version 764657 (0.0011) [2023-12-26 05:41:49,013][123091] Updated weights for policy 0, policy_version 764667 (0.0009) [2023-12-26 05:41:49,066][123091] Updated weights for policy 0, policy_version 764677 (0.0007) [2023-12-26 05:41:49,067][123090] Updated weights for policy 1, policy_version 759722 (0.0009) [2023-12-26 05:41:49,130][123091] Updated weights for policy 0, policy_version 764687 (0.0008) [2023-12-26 05:41:49,132][123090] Updated weights for policy 1, policy_version 759732 (0.0009) [2023-12-26 05:41:49,183][123090] Updated weights for policy 1, policy_version 759742 (0.0010) [2023-12-26 05:41:49,936][123091] Updated weights for policy 0, policy_version 764697 (0.0008) [2023-12-26 05:41:49,997][123091] Updated weights for policy 0, policy_version 764707 (0.0008) [2023-12-26 05:41:50,033][123090] Updated weights for policy 1, policy_version 759752 (0.0009) [2023-12-26 05:41:50,063][123091] Updated weights for policy 0, policy_version 764717 (0.0008) [2023-12-26 05:41:50,094][123090] Updated weights for policy 1, policy_version 759762 (0.0009) [2023-12-26 05:41:50,150][123090] Updated weights for policy 1, policy_version 759773 (0.0009) [2023-12-26 05:41:50,841][123091] Updated weights for policy 0, policy_version 764727 (0.0006) [2023-12-26 05:41:50,913][123091] Updated weights for policy 0, policy_version 764737 (0.0006) [2023-12-26 05:41:50,978][123091] Updated weights for policy 0, policy_version 764747 (0.0006) [2023-12-26 05:41:51,096][123090] Updated weights for policy 1, policy_version 759783 (0.0008) [2023-12-26 05:41:51,152][123090] Updated weights for policy 1, policy_version 759793 (0.0008) [2023-12-26 05:41:51,214][123090] Updated weights for policy 1, policy_version 759803 (0.0005) [2023-12-26 05:41:51,716][123091] Updated weights for policy 0, policy_version 764757 (0.0006) [2023-12-26 05:41:51,786][123091] Updated weights for policy 0, policy_version 764767 (0.0009) [2023-12-26 05:41:51,858][123091] Updated weights for policy 0, policy_version 764777 (0.0011) [2023-12-26 05:41:51,931][123090] Updated weights for policy 1, policy_version 759813 (0.0008) [2023-12-26 05:41:51,992][123090] Updated weights for policy 1, policy_version 759823 (0.0009) [2023-12-26 05:41:52,049][123090] Updated weights for policy 1, policy_version 759833 (0.0006) [2023-12-26 05:41:52,592][123091] Updated weights for policy 0, policy_version 764787 (0.0011) [2023-12-26 05:41:52,659][123091] Updated weights for policy 0, policy_version 764797 (0.0011) [2023-12-26 05:41:52,722][123091] Updated weights for policy 0, policy_version 764807 (0.0010) [2023-12-26 05:41:52,838][123090] Updated weights for policy 1, policy_version 759843 (0.0005) [2023-12-26 05:41:52,906][123090] Updated weights for policy 1, policy_version 759853 (0.0007) [2023-12-26 05:41:52,970][123090] Updated weights for policy 1, policy_version 759863 (0.0009) [2023-12-26 05:41:53,473][123091] Updated weights for policy 0, policy_version 764817 (0.0010) [2023-12-26 05:41:53,538][123091] Updated weights for policy 0, policy_version 764827 (0.0010) [2023-12-26 05:41:53,605][123091] Updated weights for policy 0, policy_version 764837 (0.0008) [2023-12-26 05:41:53,676][123091] Updated weights for policy 0, policy_version 764847 (0.0005) [2023-12-26 05:41:53,711][123090] Updated weights for policy 1, policy_version 759873 (0.0009) [2023-12-26 05:41:53,782][123090] Updated weights for policy 1, policy_version 759883 (0.0009) [2023-12-26 05:41:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 390332416. Throughput: 0: 8899.7, 1: 8680.9. Samples: 390308060. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 05:41:53,785][121949] Avg episode reward: [(0, '5807.382'), (1, '5196.908')] [2023-12-26 05:41:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000764848_195805184.pth... [2023-12-26 05:41:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000763792_195534848.pth [2023-12-26 05:41:53,858][123090] Updated weights for policy 1, policy_version 759893 (0.0010) [2023-12-26 05:41:53,929][123090] Updated weights for policy 1, policy_version 759903 (0.0010) [2023-12-26 05:41:53,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000759904_194535424.pth... [2023-12-26 05:41:53,942][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000758880_194273280.pth [2023-12-26 05:41:54,371][123091] Updated weights for policy 0, policy_version 764857 (0.0007) [2023-12-26 05:41:54,426][123091] Updated weights for policy 0, policy_version 764867 (0.0005) [2023-12-26 05:41:54,492][123091] Updated weights for policy 0, policy_version 764877 (0.0005) [2023-12-26 05:41:54,796][123090] Updated weights for policy 1, policy_version 759913 (0.0009) [2023-12-26 05:41:54,853][123090] Updated weights for policy 1, policy_version 759923 (0.0009) [2023-12-26 05:41:54,906][123090] Updated weights for policy 1, policy_version 759933 (0.0009) [2023-12-26 05:41:55,238][123091] Updated weights for policy 0, policy_version 764887 (0.0009) [2023-12-26 05:41:55,292][123091] Updated weights for policy 0, policy_version 764898 (0.0009) [2023-12-26 05:41:55,339][123091] Updated weights for policy 0, policy_version 764908 (0.0009) [2023-12-26 05:41:55,780][123090] Updated weights for policy 1, policy_version 759943 (0.0010) [2023-12-26 05:41:55,842][123090] Updated weights for policy 1, policy_version 759953 (0.0009) [2023-12-26 05:41:55,907][123090] Updated weights for policy 1, policy_version 759963 (0.0009) [2023-12-26 05:41:56,179][123091] Updated weights for policy 0, policy_version 764918 (0.0010) [2023-12-26 05:41:56,234][123091] Updated weights for policy 0, policy_version 764928 (0.0010) [2023-12-26 05:41:56,285][123091] Updated weights for policy 0, policy_version 764938 (0.0010) [2023-12-26 05:41:56,782][123090] Updated weights for policy 1, policy_version 759973 (0.0008) [2023-12-26 05:41:56,844][123090] Updated weights for policy 1, policy_version 759983 (0.0007) [2023-12-26 05:41:56,904][123090] Updated weights for policy 1, policy_version 759993 (0.0005) [2023-12-26 05:41:56,926][123091] Updated weights for policy 0, policy_version 764948 (0.0011) [2023-12-26 05:41:56,996][123091] Updated weights for policy 0, policy_version 764958 (0.0007) [2023-12-26 05:41:57,064][123091] Updated weights for policy 0, policy_version 764968 (0.0005) [2023-12-26 05:41:57,597][123091] Updated weights for policy 0, policy_version 764978 (0.0005) [2023-12-26 05:41:57,650][123091] Updated weights for policy 0, policy_version 764988 (0.0005) [2023-12-26 05:41:57,710][123091] Updated weights for policy 0, policy_version 764998 (0.0005) [2023-12-26 05:41:57,764][123090] Updated weights for policy 1, policy_version 760003 (0.0007) [2023-12-26 05:41:57,768][123091] Updated weights for policy 0, policy_version 765008 (0.0009) [2023-12-26 05:41:57,826][123090] Updated weights for policy 1, policy_version 760013 (0.0009) [2023-12-26 05:41:57,894][123090] Updated weights for policy 1, policy_version 760023 (0.0009) [2023-12-26 05:41:58,572][123091] Updated weights for policy 0, policy_version 765018 (0.0011) [2023-12-26 05:41:58,632][123091] Updated weights for policy 0, policy_version 765028 (0.0011) [2023-12-26 05:41:58,675][123090] Updated weights for policy 1, policy_version 760033 (0.0009) [2023-12-26 05:41:58,698][123091] Updated weights for policy 0, policy_version 765038 (0.0011) [2023-12-26 05:41:58,741][123090] Updated weights for policy 1, policy_version 760043 (0.0009) [2023-12-26 05:41:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 390422528. Throughput: 0: 9032.2, 1: 8636.6. Samples: 390416000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:41:58,785][121949] Avg episode reward: [(0, '5824.226'), (1, '5245.771')] [2023-12-26 05:41:58,806][123090] Updated weights for policy 1, policy_version 760053 (0.0009) [2023-12-26 05:41:58,867][123090] Updated weights for policy 1, policy_version 760063 (0.0009) [2023-12-26 05:41:59,451][123091] Updated weights for policy 0, policy_version 765048 (0.0011) [2023-12-26 05:41:59,509][123091] Updated weights for policy 0, policy_version 765058 (0.0010) [2023-12-26 05:41:59,561][123091] Updated weights for policy 0, policy_version 765068 (0.0010) [2023-12-26 05:41:59,754][123090] Updated weights for policy 1, policy_version 760073 (0.0009) [2023-12-26 05:41:59,821][123090] Updated weights for policy 1, policy_version 760083 (0.0009) [2023-12-26 05:41:59,890][123090] Updated weights for policy 1, policy_version 760093 (0.0010) [2023-12-26 05:42:00,396][123091] Updated weights for policy 0, policy_version 765078 (0.0009) [2023-12-26 05:42:00,464][123091] Updated weights for policy 0, policy_version 765088 (0.0009) [2023-12-26 05:42:00,530][123091] Updated weights for policy 0, policy_version 765098 (0.0011) [2023-12-26 05:42:00,790][123090] Updated weights for policy 1, policy_version 760103 (0.0009) [2023-12-26 05:42:00,862][123090] Updated weights for policy 1, policy_version 760113 (0.0009) [2023-12-26 05:42:00,914][123090] Updated weights for policy 1, policy_version 760123 (0.0009) [2023-12-26 05:42:01,352][123091] Updated weights for policy 0, policy_version 765108 (0.0010) [2023-12-26 05:42:01,419][123091] Updated weights for policy 0, policy_version 765118 (0.0010) [2023-12-26 05:42:01,477][123091] Updated weights for policy 0, policy_version 765128 (0.0010) [2023-12-26 05:42:01,745][123090] Updated weights for policy 1, policy_version 760133 (0.0009) [2023-12-26 05:42:01,807][123090] Updated weights for policy 1, policy_version 760143 (0.0010) [2023-12-26 05:42:01,871][123090] Updated weights for policy 1, policy_version 760153 (0.0010) [2023-12-26 05:42:02,364][123091] Updated weights for policy 0, policy_version 765138 (0.0010) [2023-12-26 05:42:02,430][123091] Updated weights for policy 0, policy_version 765148 (0.0006) [2023-12-26 05:42:02,500][123091] Updated weights for policy 0, policy_version 765158 (0.0005) [2023-12-26 05:42:02,576][123090] Updated weights for policy 1, policy_version 760163 (0.0009) [2023-12-26 05:42:02,577][123091] Updated weights for policy 0, policy_version 765168 (0.0005) [2023-12-26 05:42:02,640][123090] Updated weights for policy 1, policy_version 760173 (0.0005) [2023-12-26 05:42:02,706][123090] Updated weights for policy 1, policy_version 760183 (0.0005) [2023-12-26 05:42:03,262][123091] Updated weights for policy 0, policy_version 765178 (0.0005) [2023-12-26 05:42:03,317][123091] Updated weights for policy 0, policy_version 765188 (0.0005) [2023-12-26 05:42:03,349][123090] Updated weights for policy 1, policy_version 760193 (0.0005) [2023-12-26 05:42:03,373][123091] Updated weights for policy 0, policy_version 765198 (0.0005) [2023-12-26 05:42:03,416][123090] Updated weights for policy 1, policy_version 760203 (0.0005) [2023-12-26 05:42:03,466][123090] Updated weights for policy 1, policy_version 760213 (0.0005) [2023-12-26 05:42:03,513][123090] Updated weights for policy 1, policy_version 760223 (0.0005) [2023-12-26 05:42:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 390512640. Throughput: 0: 8962.7, 1: 8610.6. Samples: 390522992. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:03,785][121949] Avg episode reward: [(0, '6049.556'), (1, '5253.673')] [2023-12-26 05:42:04,059][123091] Updated weights for policy 0, policy_version 765208 (0.0006) [2023-12-26 05:42:04,125][123091] Updated weights for policy 0, policy_version 765218 (0.0006) [2023-12-26 05:42:04,193][123091] Updated weights for policy 0, policy_version 765228 (0.0007) [2023-12-26 05:42:04,219][123090] Updated weights for policy 1, policy_version 760233 (0.0008) [2023-12-26 05:42:04,293][123090] Updated weights for policy 1, policy_version 760243 (0.0010) [2023-12-26 05:42:04,366][123090] Updated weights for policy 1, policy_version 760253 (0.0006) [2023-12-26 05:42:04,955][123091] Updated weights for policy 0, policy_version 765238 (0.0005) [2023-12-26 05:42:05,019][123091] Updated weights for policy 0, policy_version 765248 (0.0005) [2023-12-26 05:42:05,046][123090] Updated weights for policy 1, policy_version 760263 (0.0006) [2023-12-26 05:42:05,084][123091] Updated weights for policy 0, policy_version 765258 (0.0006) [2023-12-26 05:42:05,109][123090] Updated weights for policy 1, policy_version 760273 (0.0009) [2023-12-26 05:42:05,175][123090] Updated weights for policy 1, policy_version 760283 (0.0010) [2023-12-26 05:42:05,706][123091] Updated weights for policy 0, policy_version 765268 (0.0006) [2023-12-26 05:42:05,785][123091] Updated weights for policy 0, policy_version 765278 (0.0005) [2023-12-26 05:42:05,857][123091] Updated weights for policy 0, policy_version 765288 (0.0007) [2023-12-26 05:42:05,861][123090] Updated weights for policy 1, policy_version 760293 (0.0009) [2023-12-26 05:42:05,924][123090] Updated weights for policy 1, policy_version 760303 (0.0006) [2023-12-26 05:42:05,978][123090] Updated weights for policy 1, policy_version 760313 (0.0005) [2023-12-26 05:42:06,534][123091] Updated weights for policy 0, policy_version 765298 (0.0010) [2023-12-26 05:42:06,604][123091] Updated weights for policy 0, policy_version 765308 (0.0011) [2023-12-26 05:42:06,668][123091] Updated weights for policy 0, policy_version 765318 (0.0011) [2023-12-26 05:42:06,736][123091] Updated weights for policy 0, policy_version 765328 (0.0010) [2023-12-26 05:42:06,781][123090] Updated weights for policy 1, policy_version 760323 (0.0005) [2023-12-26 05:42:06,857][123090] Updated weights for policy 1, policy_version 760333 (0.0005) [2023-12-26 05:42:06,934][123090] Updated weights for policy 1, policy_version 760343 (0.0006) [2023-12-26 05:42:07,520][123091] Updated weights for policy 0, policy_version 765338 (0.0011) [2023-12-26 05:42:07,575][123091] Updated weights for policy 0, policy_version 765348 (0.0011) [2023-12-26 05:42:07,576][123090] Updated weights for policy 1, policy_version 760353 (0.0006) [2023-12-26 05:42:07,622][123090] Updated weights for policy 1, policy_version 760363 (0.0005) [2023-12-26 05:42:07,639][123091] Updated weights for policy 0, policy_version 765358 (0.0011) [2023-12-26 05:42:07,671][123090] Updated weights for policy 1, policy_version 760373 (0.0005) [2023-12-26 05:42:07,726][123090] Updated weights for policy 1, policy_version 760383 (0.0005) [2023-12-26 05:42:08,450][123091] Updated weights for policy 0, policy_version 765368 (0.0007) [2023-12-26 05:42:08,496][123090] Updated weights for policy 1, policy_version 760393 (0.0008) [2023-12-26 05:42:08,500][123091] Updated weights for policy 0, policy_version 765378 (0.0006) [2023-12-26 05:42:08,553][123090] Updated weights for policy 1, policy_version 760403 (0.0009) [2023-12-26 05:42:08,553][123091] Updated weights for policy 0, policy_version 765388 (0.0006) [2023-12-26 05:42:08,622][123090] Updated weights for policy 1, policy_version 760413 (0.0008) [2023-12-26 05:42:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 390610944. Throughput: 0: 9072.1, 1: 8681.3. Samples: 390581692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:08,785][121949] Avg episode reward: [(0, '6004.705'), (1, '4745.313')] [2023-12-26 05:42:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000765392_195944448.pth... [2023-12-26 05:42:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000760416_194666496.pth... [2023-12-26 05:42:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000759360_194396160.pth [2023-12-26 05:42:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000764336_195674112.pth [2023-12-26 05:42:09,191][123091] Updated weights for policy 0, policy_version 765398 (0.0007) [2023-12-26 05:42:09,273][123091] Updated weights for policy 0, policy_version 765408 (0.0008) [2023-12-26 05:42:09,330][123090] Updated weights for policy 1, policy_version 760423 (0.0006) [2023-12-26 05:42:09,341][123091] Updated weights for policy 0, policy_version 765418 (0.0009) [2023-12-26 05:42:09,394][123090] Updated weights for policy 1, policy_version 760433 (0.0008) [2023-12-26 05:42:09,467][123090] Updated weights for policy 1, policy_version 760443 (0.0008) [2023-12-26 05:42:10,162][123091] Updated weights for policy 0, policy_version 765428 (0.0009) [2023-12-26 05:42:10,216][123091] Updated weights for policy 0, policy_version 765438 (0.0009) [2023-12-26 05:42:10,286][123091] Updated weights for policy 0, policy_version 765448 (0.0009) [2023-12-26 05:42:10,300][123090] Updated weights for policy 1, policy_version 760453 (0.0009) [2023-12-26 05:42:10,364][123090] Updated weights for policy 1, policy_version 760463 (0.0011) [2023-12-26 05:42:10,425][123090] Updated weights for policy 1, policy_version 760473 (0.0009) [2023-12-26 05:42:11,109][123090] Updated weights for policy 1, policy_version 760483 (0.0008) [2023-12-26 05:42:11,182][123090] Updated weights for policy 1, policy_version 760493 (0.0011) [2023-12-26 05:42:11,194][123091] Updated weights for policy 0, policy_version 765458 (0.0008) [2023-12-26 05:42:11,251][123090] Updated weights for policy 1, policy_version 760503 (0.0011) [2023-12-26 05:42:11,261][123091] Updated weights for policy 0, policy_version 765468 (0.0006) [2023-12-26 05:42:11,320][123091] Updated weights for policy 0, policy_version 765478 (0.0008) [2023-12-26 05:42:11,389][123091] Updated weights for policy 0, policy_version 765488 (0.0009) [2023-12-26 05:42:12,085][123090] Updated weights for policy 1, policy_version 760513 (0.0009) [2023-12-26 05:42:12,154][123090] Updated weights for policy 1, policy_version 760523 (0.0007) [2023-12-26 05:42:12,167][123091] Updated weights for policy 0, policy_version 765498 (0.0010) [2023-12-26 05:42:12,221][123090] Updated weights for policy 1, policy_version 760533 (0.0008) [2023-12-26 05:42:12,229][123091] Updated weights for policy 0, policy_version 765508 (0.0008) [2023-12-26 05:42:12,290][123090] Updated weights for policy 1, policy_version 760543 (0.0009) [2023-12-26 05:42:12,293][123091] Updated weights for policy 0, policy_version 765518 (0.0007) [2023-12-26 05:42:13,056][123090] Updated weights for policy 1, policy_version 760553 (0.0009) [2023-12-26 05:42:13,107][123090] Updated weights for policy 1, policy_version 760563 (0.0009) [2023-12-26 05:42:13,143][123091] Updated weights for policy 0, policy_version 765528 (0.0010) [2023-12-26 05:42:13,156][123090] Updated weights for policy 1, policy_version 760573 (0.0007) [2023-12-26 05:42:13,205][123091] Updated weights for policy 0, policy_version 765538 (0.0011) [2023-12-26 05:42:13,264][123091] Updated weights for policy 0, policy_version 765548 (0.0010) [2023-12-26 05:42:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 390692864. Throughput: 0: 9042.3, 1: 8750.4. Samples: 390688220. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:13,785][121949] Avg episode reward: [(0, '5947.587'), (1, '4606.159')] [2023-12-26 05:42:14,010][123090] Updated weights for policy 1, policy_version 760583 (0.0009) [2023-12-26 05:42:14,069][123091] Updated weights for policy 0, policy_version 765558 (0.0011) [2023-12-26 05:42:14,071][123090] Updated weights for policy 1, policy_version 760593 (0.0007) [2023-12-26 05:42:14,122][123090] Updated weights for policy 1, policy_version 760603 (0.0009) [2023-12-26 05:42:14,130][123091] Updated weights for policy 0, policy_version 765568 (0.0005) [2023-12-26 05:42:14,193][123091] Updated weights for policy 0, policy_version 765578 (0.0005) [2023-12-26 05:42:14,870][123091] Updated weights for policy 0, policy_version 765588 (0.0005) [2023-12-26 05:42:14,938][123091] Updated weights for policy 0, policy_version 765598 (0.0005) [2023-12-26 05:42:15,000][123091] Updated weights for policy 0, policy_version 765608 (0.0009) [2023-12-26 05:42:15,037][123090] Updated weights for policy 1, policy_version 760613 (0.0007) [2023-12-26 05:42:15,093][123090] Updated weights for policy 1, policy_version 760623 (0.0008) [2023-12-26 05:42:15,157][123090] Updated weights for policy 1, policy_version 760633 (0.0009) [2023-12-26 05:42:15,779][123091] Updated weights for policy 0, policy_version 765618 (0.0011) [2023-12-26 05:42:15,829][123091] Updated weights for policy 0, policy_version 765628 (0.0010) [2023-12-26 05:42:15,878][123091] Updated weights for policy 0, policy_version 765638 (0.0009) [2023-12-26 05:42:16,010][123090] Updated weights for policy 1, policy_version 760643 (0.0009) [2023-12-26 05:42:16,070][123090] Updated weights for policy 1, policy_version 760653 (0.0009) [2023-12-26 05:42:16,127][123090] Updated weights for policy 1, policy_version 760663 (0.0009) [2023-12-26 05:42:16,608][123091] Updated weights for policy 0, policy_version 765649 (0.0009) [2023-12-26 05:42:16,664][123091] Updated weights for policy 0, policy_version 765659 (0.0009) [2023-12-26 05:42:16,719][123091] Updated weights for policy 0, policy_version 765669 (0.0010) [2023-12-26 05:42:16,775][123091] Updated weights for policy 0, policy_version 765679 (0.0009) [2023-12-26 05:42:16,973][123090] Updated weights for policy 1, policy_version 760673 (0.0009) [2023-12-26 05:42:17,041][123090] Updated weights for policy 1, policy_version 760683 (0.0009) [2023-12-26 05:42:17,098][123090] Updated weights for policy 1, policy_version 760693 (0.0009) [2023-12-26 05:42:17,161][123090] Updated weights for policy 1, policy_version 760703 (0.0008) [2023-12-26 05:42:17,576][123091] Updated weights for policy 0, policy_version 765689 (0.0010) [2023-12-26 05:42:17,648][123091] Updated weights for policy 0, policy_version 765699 (0.0005) [2023-12-26 05:42:17,719][123091] Updated weights for policy 0, policy_version 765709 (0.0007) [2023-12-26 05:42:17,997][123090] Updated weights for policy 1, policy_version 760713 (0.0009) [2023-12-26 05:42:18,046][123090] Updated weights for policy 1, policy_version 760723 (0.0009) [2023-12-26 05:42:18,109][123090] Updated weights for policy 1, policy_version 760733 (0.0009) [2023-12-26 05:42:18,432][123091] Updated weights for policy 0, policy_version 765719 (0.0008) [2023-12-26 05:42:18,496][123091] Updated weights for policy 0, policy_version 765729 (0.0009) [2023-12-26 05:42:18,565][123091] Updated weights for policy 0, policy_version 765739 (0.0005) [2023-12-26 05:42:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 390782976. Throughput: 0: 9079.7, 1: 8749.7. Samples: 390793548. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:18,785][121949] Avg episode reward: [(0, '6001.989'), (1, '4877.466')] [2023-12-26 05:42:18,990][123090] Updated weights for policy 1, policy_version 760743 (0.0009) [2023-12-26 05:42:19,039][123090] Updated weights for policy 1, policy_version 760753 (0.0009) [2023-12-26 05:42:19,093][123090] Updated weights for policy 1, policy_version 760763 (0.0009) [2023-12-26 05:42:19,322][123091] Updated weights for policy 0, policy_version 765749 (0.0010) [2023-12-26 05:42:19,398][123091] Updated weights for policy 0, policy_version 765759 (0.0010) [2023-12-26 05:42:19,466][123091] Updated weights for policy 0, policy_version 765769 (0.0011) [2023-12-26 05:42:19,998][123090] Updated weights for policy 1, policy_version 760773 (0.0007) [2023-12-26 05:42:20,066][123090] Updated weights for policy 1, policy_version 760783 (0.0005) [2023-12-26 05:42:20,133][123090] Updated weights for policy 1, policy_version 760793 (0.0008) [2023-12-26 05:42:20,266][123091] Updated weights for policy 0, policy_version 765779 (0.0011) [2023-12-26 05:42:20,333][123091] Updated weights for policy 0, policy_version 765789 (0.0011) [2023-12-26 05:42:20,403][123091] Updated weights for policy 0, policy_version 765799 (0.0011) [2023-12-26 05:42:20,920][123090] Updated weights for policy 1, policy_version 760803 (0.0009) [2023-12-26 05:42:20,985][123090] Updated weights for policy 1, policy_version 760813 (0.0009) [2023-12-26 05:42:21,059][123090] Updated weights for policy 1, policy_version 760823 (0.0009) [2023-12-26 05:42:21,226][123091] Updated weights for policy 0, policy_version 765809 (0.0011) [2023-12-26 05:42:21,286][123091] Updated weights for policy 0, policy_version 765819 (0.0011) [2023-12-26 05:42:21,331][123091] Updated weights for policy 0, policy_version 765829 (0.0010) [2023-12-26 05:42:21,401][123091] Updated weights for policy 0, policy_version 765839 (0.0013) [2023-12-26 05:42:21,957][123090] Updated weights for policy 1, policy_version 760833 (0.0010) [2023-12-26 05:42:22,053][123090] Updated weights for policy 1, policy_version 760843 (0.0010) [2023-12-26 05:42:22,128][123090] Updated weights for policy 1, policy_version 760853 (0.0009) [2023-12-26 05:42:22,184][123090] Updated weights for policy 1, policy_version 760863 (0.0009) [2023-12-26 05:42:22,246][123091] Updated weights for policy 0, policy_version 765849 (0.0010) [2023-12-26 05:42:22,308][123091] Updated weights for policy 0, policy_version 765859 (0.0010) [2023-12-26 05:42:22,376][123091] Updated weights for policy 0, policy_version 765869 (0.0010) [2023-12-26 05:42:23,009][123090] Updated weights for policy 1, policy_version 760873 (0.0009) [2023-12-26 05:42:23,078][123090] Updated weights for policy 1, policy_version 760883 (0.0010) [2023-12-26 05:42:23,142][123090] Updated weights for policy 1, policy_version 760893 (0.0010) [2023-12-26 05:42:23,208][123091] Updated weights for policy 0, policy_version 765879 (0.0010) [2023-12-26 05:42:23,265][123091] Updated weights for policy 0, policy_version 765889 (0.0009) [2023-12-26 05:42:23,319][123091] Updated weights for policy 0, policy_version 765899 (0.0009) [2023-12-26 05:42:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 390864896. Throughput: 0: 9060.8, 1: 8734.7. Samples: 390844120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:23,785][121949] Avg episode reward: [(0, '6167.558'), (1, '5076.574')] [2023-12-26 05:42:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000765904_196075520.pth... [2023-12-26 05:42:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000760896_194789376.pth... [2023-12-26 05:42:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000759904_194535424.pth [2023-12-26 05:42:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000764848_195805184.pth [2023-12-26 05:42:23,977][123090] Updated weights for policy 1, policy_version 760903 (0.0010) [2023-12-26 05:42:24,031][123090] Updated weights for policy 1, policy_version 760913 (0.0010) [2023-12-26 05:42:24,084][123090] Updated weights for policy 1, policy_version 760924 (0.0010) [2023-12-26 05:42:24,110][123091] Updated weights for policy 0, policy_version 765909 (0.0008) [2023-12-26 05:42:24,171][123091] Updated weights for policy 0, policy_version 765919 (0.0009) [2023-12-26 05:42:24,221][123091] Updated weights for policy 0, policy_version 765929 (0.0010) [2023-12-26 05:42:24,967][123091] Updated weights for policy 0, policy_version 765939 (0.0008) [2023-12-26 05:42:25,016][123090] Updated weights for policy 1, policy_version 760934 (0.0008) [2023-12-26 05:42:25,036][123091] Updated weights for policy 0, policy_version 765949 (0.0009) [2023-12-26 05:42:25,079][123090] Updated weights for policy 1, policy_version 760944 (0.0009) [2023-12-26 05:42:25,101][123091] Updated weights for policy 0, policy_version 765959 (0.0008) [2023-12-26 05:42:25,145][123090] Updated weights for policy 1, policy_version 760954 (0.0007) [2023-12-26 05:42:25,900][123091] Updated weights for policy 0, policy_version 765969 (0.0010) [2023-12-26 05:42:25,951][123091] Updated weights for policy 0, policy_version 765979 (0.0008) [2023-12-26 05:42:25,956][123090] Updated weights for policy 1, policy_version 760964 (0.0008) [2023-12-26 05:42:26,001][123091] Updated weights for policy 0, policy_version 765990 (0.0010) [2023-12-26 05:42:26,002][123090] Updated weights for policy 1, policy_version 760974 (0.0005) [2023-12-26 05:42:26,052][123091] Updated weights for policy 0, policy_version 766000 (0.0009) [2023-12-26 05:42:26,055][123090] Updated weights for policy 1, policy_version 760984 (0.0005) [2023-12-26 05:42:26,748][123090] Updated weights for policy 1, policy_version 760994 (0.0008) [2023-12-26 05:42:26,784][123091] Updated weights for policy 0, policy_version 766010 (0.0006) [2023-12-26 05:42:26,812][123090] Updated weights for policy 1, policy_version 761004 (0.0006) [2023-12-26 05:42:26,835][123091] Updated weights for policy 0, policy_version 766020 (0.0005) [2023-12-26 05:42:26,871][123090] Updated weights for policy 1, policy_version 761014 (0.0007) [2023-12-26 05:42:26,890][123091] Updated weights for policy 0, policy_version 766030 (0.0005) [2023-12-26 05:42:26,926][123090] Updated weights for policy 1, policy_version 761024 (0.0006) [2023-12-26 05:42:27,563][123091] Updated weights for policy 0, policy_version 766040 (0.0008) [2023-12-26 05:42:27,629][123091] Updated weights for policy 0, policy_version 766050 (0.0007) [2023-12-26 05:42:27,696][123091] Updated weights for policy 0, policy_version 766060 (0.0005) [2023-12-26 05:42:27,710][123090] Updated weights for policy 1, policy_version 761034 (0.0008) [2023-12-26 05:42:27,755][123090] Updated weights for policy 1, policy_version 761044 (0.0008) [2023-12-26 05:42:27,810][123090] Updated weights for policy 1, policy_version 761054 (0.0005) [2023-12-26 05:42:28,312][123091] Updated weights for policy 0, policy_version 766070 (0.0005) [2023-12-26 05:42:28,369][123091] Updated weights for policy 0, policy_version 766080 (0.0008) [2023-12-26 05:42:28,421][123091] Updated weights for policy 0, policy_version 766090 (0.0006) [2023-12-26 05:42:28,503][123090] Updated weights for policy 1, policy_version 761064 (0.0005) [2023-12-26 05:42:28,576][123090] Updated weights for policy 1, policy_version 761074 (0.0006) [2023-12-26 05:42:28,641][123090] Updated weights for policy 1, policy_version 761084 (0.0007) [2023-12-26 05:42:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 390963200. Throughput: 0: 9062.5, 1: 8705.8. Samples: 390950572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:28,785][121949] Avg episode reward: [(0, '6053.941'), (1, '5296.933')] [2023-12-26 05:42:29,195][123091] Updated weights for policy 0, policy_version 766100 (0.0007) [2023-12-26 05:42:29,274][123091] Updated weights for policy 0, policy_version 766110 (0.0007) [2023-12-26 05:42:29,343][123091] Updated weights for policy 0, policy_version 766120 (0.0006) [2023-12-26 05:42:29,399][123090] Updated weights for policy 1, policy_version 761094 (0.0008) [2023-12-26 05:42:29,470][123090] Updated weights for policy 1, policy_version 761104 (0.0011) [2023-12-26 05:42:29,526][123090] Updated weights for policy 1, policy_version 761114 (0.0010) [2023-12-26 05:42:30,048][123091] Updated weights for policy 0, policy_version 766130 (0.0009) [2023-12-26 05:42:30,119][123091] Updated weights for policy 0, policy_version 766140 (0.0005) [2023-12-26 05:42:30,194][123091] Updated weights for policy 0, policy_version 766150 (0.0005) [2023-12-26 05:42:30,257][123091] Updated weights for policy 0, policy_version 766160 (0.0005) [2023-12-26 05:42:30,261][123090] Updated weights for policy 1, policy_version 761124 (0.0008) [2023-12-26 05:42:30,318][123090] Updated weights for policy 1, policy_version 761134 (0.0006) [2023-12-26 05:42:30,374][123090] Updated weights for policy 1, policy_version 761144 (0.0005) [2023-12-26 05:42:30,877][123091] Updated weights for policy 0, policy_version 766170 (0.0010) [2023-12-26 05:42:30,929][123091] Updated weights for policy 0, policy_version 766180 (0.0010) [2023-12-26 05:42:30,982][123091] Updated weights for policy 0, policy_version 766190 (0.0010) [2023-12-26 05:42:31,007][123090] Updated weights for policy 1, policy_version 761154 (0.0007) [2023-12-26 05:42:31,090][123090] Updated weights for policy 1, policy_version 761164 (0.0009) [2023-12-26 05:42:31,161][123090] Updated weights for policy 1, policy_version 761174 (0.0010) [2023-12-26 05:42:31,231][123090] Updated weights for policy 1, policy_version 761184 (0.0009) [2023-12-26 05:42:31,831][123091] Updated weights for policy 0, policy_version 766200 (0.0006) [2023-12-26 05:42:31,883][123091] Updated weights for policy 0, policy_version 766210 (0.0005) [2023-12-26 05:42:31,963][123091] Updated weights for policy 0, policy_version 766220 (0.0008) [2023-12-26 05:42:32,055][123090] Updated weights for policy 1, policy_version 761194 (0.0009) [2023-12-26 05:42:32,127][123090] Updated weights for policy 1, policy_version 761204 (0.0009) [2023-12-26 05:42:32,197][123090] Updated weights for policy 1, policy_version 761214 (0.0006) [2023-12-26 05:42:32,624][123091] Updated weights for policy 0, policy_version 766230 (0.0007) [2023-12-26 05:42:32,688][123091] Updated weights for policy 0, policy_version 766240 (0.0007) [2023-12-26 05:42:32,747][123091] Updated weights for policy 0, policy_version 766250 (0.0010) [2023-12-26 05:42:32,961][123090] Updated weights for policy 1, policy_version 761224 (0.0009) [2023-12-26 05:42:33,015][123090] Updated weights for policy 1, policy_version 761234 (0.0010) [2023-12-26 05:42:33,068][123090] Updated weights for policy 1, policy_version 761245 (0.0010) [2023-12-26 05:42:33,419][123091] Updated weights for policy 0, policy_version 766260 (0.0008) [2023-12-26 05:42:33,490][123091] Updated weights for policy 0, policy_version 766270 (0.0006) [2023-12-26 05:42:33,549][123091] Updated weights for policy 0, policy_version 766280 (0.0006) [2023-12-26 05:42:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 391053312. Throughput: 0: 9210.3, 1: 8735.9. Samples: 391063916. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:33,785][121949] Avg episode reward: [(0, '5727.384'), (1, '5288.885')] [2023-12-26 05:42:33,973][123090] Updated weights for policy 1, policy_version 761256 (0.0007) [2023-12-26 05:42:34,027][123090] Updated weights for policy 1, policy_version 761266 (0.0005) [2023-12-26 05:42:34,086][123090] Updated weights for policy 1, policy_version 761277 (0.0007) [2023-12-26 05:42:34,207][123091] Updated weights for policy 0, policy_version 766290 (0.0008) [2023-12-26 05:42:34,262][123091] Updated weights for policy 0, policy_version 766300 (0.0010) [2023-12-26 05:42:34,328][123091] Updated weights for policy 0, policy_version 766310 (0.0007) [2023-12-26 05:42:34,393][123091] Updated weights for policy 0, policy_version 766320 (0.0006) [2023-12-26 05:42:34,896][123090] Updated weights for policy 1, policy_version 761287 (0.0005) [2023-12-26 05:42:34,968][123090] Updated weights for policy 1, policy_version 761297 (0.0005) [2023-12-26 05:42:35,031][123090] Updated weights for policy 1, policy_version 761307 (0.0006) [2023-12-26 05:42:35,155][123091] Updated weights for policy 0, policy_version 766330 (0.0005) [2023-12-26 05:42:35,211][123091] Updated weights for policy 0, policy_version 766340 (0.0005) [2023-12-26 05:42:35,277][123091] Updated weights for policy 0, policy_version 766350 (0.0005) [2023-12-26 05:42:35,704][123090] Updated weights for policy 1, policy_version 761317 (0.0005) [2023-12-26 05:42:35,773][123090] Updated weights for policy 1, policy_version 761327 (0.0005) [2023-12-26 05:42:35,836][123090] Updated weights for policy 1, policy_version 761337 (0.0008) [2023-12-26 05:42:35,969][123091] Updated weights for policy 0, policy_version 766360 (0.0008) [2023-12-26 05:42:36,029][123091] Updated weights for policy 0, policy_version 766370 (0.0009) [2023-12-26 05:42:36,096][123091] Updated weights for policy 0, policy_version 766380 (0.0009) [2023-12-26 05:42:36,538][123090] Updated weights for policy 1, policy_version 761347 (0.0010) [2023-12-26 05:42:36,614][123090] Updated weights for policy 1, policy_version 761357 (0.0010) [2023-12-26 05:42:36,682][123090] Updated weights for policy 1, policy_version 761367 (0.0009) [2023-12-26 05:42:36,870][123091] Updated weights for policy 0, policy_version 766390 (0.0011) [2023-12-26 05:42:36,918][123091] Updated weights for policy 0, policy_version 766400 (0.0011) [2023-12-26 05:42:36,978][123091] Updated weights for policy 0, policy_version 766410 (0.0011) [2023-12-26 05:42:37,481][123090] Updated weights for policy 1, policy_version 761377 (0.0009) [2023-12-26 05:42:37,536][123090] Updated weights for policy 1, policy_version 761387 (0.0006) [2023-12-26 05:42:37,584][123090] Updated weights for policy 1, policy_version 761397 (0.0005) [2023-12-26 05:42:37,640][123090] Updated weights for policy 1, policy_version 761407 (0.0005) [2023-12-26 05:42:37,812][123091] Updated weights for policy 0, policy_version 766420 (0.0011) [2023-12-26 05:42:37,869][123091] Updated weights for policy 0, policy_version 766430 (0.0011) [2023-12-26 05:42:37,922][123091] Updated weights for policy 0, policy_version 766440 (0.0011) [2023-12-26 05:42:38,369][123090] Updated weights for policy 1, policy_version 761417 (0.0008) [2023-12-26 05:42:38,431][123090] Updated weights for policy 1, policy_version 761427 (0.0008) [2023-12-26 05:42:38,494][123090] Updated weights for policy 1, policy_version 761437 (0.0008) [2023-12-26 05:42:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 391143424. Throughput: 0: 9266.9, 1: 8812.7. Samples: 391121644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:38,785][121949] Avg episode reward: [(0, '5727.126'), (1, '5291.306')] [2023-12-26 05:42:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000761440_194928640.pth... [2023-12-26 05:42:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000760416_194666496.pth [2023-12-26 05:42:38,803][123091] Updated weights for policy 0, policy_version 766450 (0.0011) [2023-12-26 05:42:38,863][123091] Updated weights for policy 0, policy_version 766460 (0.0011) [2023-12-26 05:42:38,922][123091] Updated weights for policy 0, policy_version 766470 (0.0011) [2023-12-26 05:42:38,976][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000766480_196222976.pth... [2023-12-26 05:42:38,977][123091] Updated weights for policy 0, policy_version 766480 (0.0011) [2023-12-26 05:42:38,981][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000765392_195944448.pth [2023-12-26 05:42:39,198][123090] Updated weights for policy 1, policy_version 761447 (0.0006) [2023-12-26 05:42:39,266][123090] Updated weights for policy 1, policy_version 761457 (0.0010) [2023-12-26 05:42:39,327][123090] Updated weights for policy 1, policy_version 761467 (0.0011) [2023-12-26 05:42:39,775][123091] Updated weights for policy 0, policy_version 766490 (0.0010) [2023-12-26 05:42:39,831][123091] Updated weights for policy 0, policy_version 766500 (0.0008) [2023-12-26 05:42:39,898][123091] Updated weights for policy 0, policy_version 766510 (0.0008) [2023-12-26 05:42:40,180][123090] Updated weights for policy 1, policy_version 761477 (0.0009) [2023-12-26 05:42:40,230][123090] Updated weights for policy 1, policy_version 761487 (0.0009) [2023-12-26 05:42:40,283][123090] Updated weights for policy 1, policy_version 761497 (0.0009) [2023-12-26 05:42:40,708][123091] Updated weights for policy 0, policy_version 766520 (0.0010) [2023-12-26 05:42:40,762][123091] Updated weights for policy 0, policy_version 766530 (0.0010) [2023-12-26 05:42:40,816][123091] Updated weights for policy 0, policy_version 766540 (0.0005) [2023-12-26 05:42:41,119][123090] Updated weights for policy 1, policy_version 761507 (0.0009) [2023-12-26 05:42:41,180][123090] Updated weights for policy 1, policy_version 761517 (0.0010) [2023-12-26 05:42:41,249][123090] Updated weights for policy 1, policy_version 761527 (0.0009) [2023-12-26 05:42:41,702][123091] Updated weights for policy 0, policy_version 766550 (0.0008) [2023-12-26 05:42:41,775][123091] Updated weights for policy 0, policy_version 766560 (0.0007) [2023-12-26 05:42:41,842][123091] Updated weights for policy 0, policy_version 766570 (0.0006) [2023-12-26 05:42:42,048][123090] Updated weights for policy 1, policy_version 761537 (0.0010) [2023-12-26 05:42:42,104][123090] Updated weights for policy 1, policy_version 761547 (0.0009) [2023-12-26 05:42:42,158][123090] Updated weights for policy 1, policy_version 761557 (0.0009) [2023-12-26 05:42:42,208][123090] Updated weights for policy 1, policy_version 761567 (0.0010) [2023-12-26 05:42:42,603][123091] Updated weights for policy 0, policy_version 766580 (0.0007) [2023-12-26 05:42:42,662][123091] Updated weights for policy 0, policy_version 766590 (0.0009) [2023-12-26 05:42:42,715][123091] Updated weights for policy 0, policy_version 766601 (0.0010) [2023-12-26 05:42:43,063][123090] Updated weights for policy 1, policy_version 761577 (0.0010) [2023-12-26 05:42:43,114][123090] Updated weights for policy 1, policy_version 761587 (0.0008) [2023-12-26 05:42:43,165][123090] Updated weights for policy 1, policy_version 761597 (0.0009) [2023-12-26 05:42:43,560][123091] Updated weights for policy 0, policy_version 766611 (0.0010) [2023-12-26 05:42:43,624][123091] Updated weights for policy 0, policy_version 766621 (0.0009) [2023-12-26 05:42:43,687][123091] Updated weights for policy 0, policy_version 766631 (0.0009) [2023-12-26 05:42:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 391233536. Throughput: 0: 9147.0, 1: 8850.1. Samples: 391225872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:43,785][121949] Avg episode reward: [(0, '5978.818'), (1, '5269.281')] [2023-12-26 05:42:44,020][123090] Updated weights for policy 1, policy_version 761607 (0.0009) [2023-12-26 05:42:44,075][123090] Updated weights for policy 1, policy_version 761617 (0.0009) [2023-12-26 05:42:44,138][123090] Updated weights for policy 1, policy_version 761628 (0.0010) [2023-12-26 05:42:44,395][123091] Updated weights for policy 0, policy_version 766641 (0.0010) [2023-12-26 05:42:44,460][123091] Updated weights for policy 0, policy_version 766651 (0.0009) [2023-12-26 05:42:44,532][123091] Updated weights for policy 0, policy_version 766661 (0.0009) [2023-12-26 05:42:44,597][123091] Updated weights for policy 0, policy_version 766671 (0.0010) [2023-12-26 05:42:44,956][123090] Updated weights for policy 1, policy_version 761638 (0.0009) [2023-12-26 05:42:45,022][123090] Updated weights for policy 1, policy_version 761648 (0.0010) [2023-12-26 05:42:45,082][123090] Updated weights for policy 1, policy_version 761658 (0.0009) [2023-12-26 05:42:45,432][123091] Updated weights for policy 0, policy_version 766681 (0.0010) [2023-12-26 05:42:45,504][123091] Updated weights for policy 0, policy_version 766691 (0.0010) [2023-12-26 05:42:45,561][123091] Updated weights for policy 0, policy_version 766701 (0.0010) [2023-12-26 05:42:45,794][123090] Updated weights for policy 1, policy_version 761668 (0.0009) [2023-12-26 05:42:45,841][123090] Updated weights for policy 1, policy_version 761678 (0.0009) [2023-12-26 05:42:45,893][123090] Updated weights for policy 1, policy_version 761688 (0.0010) [2023-12-26 05:42:46,439][123091] Updated weights for policy 0, policy_version 766711 (0.0009) [2023-12-26 05:42:46,491][123091] Updated weights for policy 0, policy_version 766721 (0.0009) [2023-12-26 05:42:46,551][123091] Updated weights for policy 0, policy_version 766731 (0.0008) [2023-12-26 05:42:46,724][123090] Updated weights for policy 1, policy_version 761698 (0.0009) [2023-12-26 05:42:46,790][123090] Updated weights for policy 1, policy_version 761708 (0.0010) [2023-12-26 05:42:46,853][123090] Updated weights for policy 1, policy_version 761718 (0.0010) [2023-12-26 05:42:46,927][123090] Updated weights for policy 1, policy_version 761728 (0.0010) [2023-12-26 05:42:47,300][123091] Updated weights for policy 0, policy_version 766741 (0.0005) [2023-12-26 05:42:47,366][123091] Updated weights for policy 0, policy_version 766751 (0.0011) [2023-12-26 05:42:47,428][123091] Updated weights for policy 0, policy_version 766761 (0.0010) [2023-12-26 05:42:47,738][123090] Updated weights for policy 1, policy_version 761738 (0.0010) [2023-12-26 05:42:47,789][123090] Updated weights for policy 1, policy_version 761748 (0.0010) [2023-12-26 05:42:47,849][123090] Updated weights for policy 1, policy_version 761758 (0.0010) [2023-12-26 05:42:48,057][123091] Updated weights for policy 0, policy_version 766771 (0.0009) [2023-12-26 05:42:48,120][123091] Updated weights for policy 0, policy_version 766781 (0.0010) [2023-12-26 05:42:48,189][123091] Updated weights for policy 0, policy_version 766791 (0.0010) [2023-12-26 05:42:48,677][123090] Updated weights for policy 1, policy_version 761768 (0.0011) [2023-12-26 05:42:48,740][123090] Updated weights for policy 1, policy_version 761778 (0.0011) [2023-12-26 05:42:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 391315456. Throughput: 0: 9126.4, 1: 8843.8. Samples: 391331648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:48,784][121949] Avg episode reward: [(0, '6076.241'), (1, '5256.889')] [2023-12-26 05:42:48,804][123090] Updated weights for policy 1, policy_version 761788 (0.0010) [2023-12-26 05:42:48,939][123091] Updated weights for policy 0, policy_version 766801 (0.0007) [2023-12-26 05:42:48,990][123091] Updated weights for policy 0, policy_version 766811 (0.0010) [2023-12-26 05:42:49,041][123091] Updated weights for policy 0, policy_version 766821 (0.0010) [2023-12-26 05:42:49,086][123091] Updated weights for policy 0, policy_version 766831 (0.0008) [2023-12-26 05:42:49,617][123090] Updated weights for policy 1, policy_version 761798 (0.0010) [2023-12-26 05:42:49,664][123090] Updated weights for policy 1, policy_version 761808 (0.0010) [2023-12-26 05:42:49,718][123090] Updated weights for policy 1, policy_version 761818 (0.0010) [2023-12-26 05:42:49,911][123091] Updated weights for policy 0, policy_version 766841 (0.0009) [2023-12-26 05:42:49,982][123091] Updated weights for policy 0, policy_version 766851 (0.0007) [2023-12-26 05:42:50,053][123091] Updated weights for policy 0, policy_version 766861 (0.0005) [2023-12-26 05:42:50,524][123090] Updated weights for policy 1, policy_version 761828 (0.0009) [2023-12-26 05:42:50,596][123090] Updated weights for policy 1, policy_version 761838 (0.0009) [2023-12-26 05:42:50,660][123090] Updated weights for policy 1, policy_version 761848 (0.0011) [2023-12-26 05:42:50,819][123091] Updated weights for policy 0, policy_version 766871 (0.0008) [2023-12-26 05:42:50,881][123091] Updated weights for policy 0, policy_version 766881 (0.0009) [2023-12-26 05:42:50,938][123091] Updated weights for policy 0, policy_version 766891 (0.0009) [2023-12-26 05:42:51,413][123090] Updated weights for policy 1, policy_version 761858 (0.0011) [2023-12-26 05:42:51,483][123090] Updated weights for policy 1, policy_version 761868 (0.0010) [2023-12-26 05:42:51,551][123090] Updated weights for policy 1, policy_version 761878 (0.0010) [2023-12-26 05:42:51,609][123090] Updated weights for policy 1, policy_version 761888 (0.0008) [2023-12-26 05:42:51,815][123091] Updated weights for policy 0, policy_version 766901 (0.0008) [2023-12-26 05:42:51,874][123091] Updated weights for policy 0, policy_version 766911 (0.0009) [2023-12-26 05:42:51,922][123091] Updated weights for policy 0, policy_version 766921 (0.0010) [2023-12-26 05:42:52,390][123090] Updated weights for policy 1, policy_version 761898 (0.0008) [2023-12-26 05:42:52,460][123090] Updated weights for policy 1, policy_version 761908 (0.0008) [2023-12-26 05:42:52,519][123090] Updated weights for policy 1, policy_version 761918 (0.0009) [2023-12-26 05:42:52,717][123091] Updated weights for policy 0, policy_version 766931 (0.0010) [2023-12-26 05:42:52,778][123091] Updated weights for policy 0, policy_version 766941 (0.0009) [2023-12-26 05:42:52,830][123091] Updated weights for policy 0, policy_version 766951 (0.0009) [2023-12-26 05:42:53,316][123090] Updated weights for policy 1, policy_version 761928 (0.0006) [2023-12-26 05:42:53,382][123090] Updated weights for policy 1, policy_version 761938 (0.0005) [2023-12-26 05:42:53,444][123090] Updated weights for policy 1, policy_version 761948 (0.0005) [2023-12-26 05:42:53,643][123091] Updated weights for policy 0, policy_version 766961 (0.0009) [2023-12-26 05:42:53,698][123091] Updated weights for policy 0, policy_version 766971 (0.0010) [2023-12-26 05:42:53,753][123091] Updated weights for policy 0, policy_version 766981 (0.0010) [2023-12-26 05:42:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17633.8). Total num frames: 391405568. Throughput: 0: 9045.7, 1: 8783.9. Samples: 391384024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:53,785][121949] Avg episode reward: [(0, '6055.777'), (1, '5202.393')] [2023-12-26 05:42:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000761952_195059712.pth... [2023-12-26 05:42:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000760896_194789376.pth [2023-12-26 05:42:53,801][123091] Updated weights for policy 0, policy_version 766991 (0.0010) [2023-12-26 05:42:53,803][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000766992_196354048.pth... [2023-12-26 05:42:53,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000765904_196075520.pth [2023-12-26 05:42:54,176][123090] Updated weights for policy 1, policy_version 761958 (0.0008) [2023-12-26 05:42:54,235][123090] Updated weights for policy 1, policy_version 761968 (0.0010) [2023-12-26 05:42:54,296][123090] Updated weights for policy 1, policy_version 761978 (0.0010) [2023-12-26 05:42:54,620][123091] Updated weights for policy 0, policy_version 767001 (0.0006) [2023-12-26 05:42:54,671][123091] Updated weights for policy 0, policy_version 767011 (0.0005) [2023-12-26 05:42:54,725][123091] Updated weights for policy 0, policy_version 767021 (0.0005) [2023-12-26 05:42:55,116][123090] Updated weights for policy 1, policy_version 761988 (0.0010) [2023-12-26 05:42:55,164][123090] Updated weights for policy 1, policy_version 761998 (0.0010) [2023-12-26 05:42:55,211][123090] Updated weights for policy 1, policy_version 762008 (0.0010) [2023-12-26 05:42:55,375][123091] Updated weights for policy 0, policy_version 767031 (0.0005) [2023-12-26 05:42:55,430][123091] Updated weights for policy 0, policy_version 767041 (0.0009) [2023-12-26 05:42:55,478][123091] Updated weights for policy 0, policy_version 767051 (0.0010) [2023-12-26 05:42:56,053][123090] Updated weights for policy 1, policy_version 762018 (0.0010) [2023-12-26 05:42:56,104][123090] Updated weights for policy 1, policy_version 762028 (0.0010) [2023-12-26 05:42:56,162][123090] Updated weights for policy 1, policy_version 762038 (0.0010) [2023-12-26 05:42:56,231][123090] Updated weights for policy 1, policy_version 762048 (0.0010) [2023-12-26 05:42:56,297][123091] Updated weights for policy 0, policy_version 767061 (0.0009) [2023-12-26 05:42:56,340][123091] Updated weights for policy 0, policy_version 767071 (0.0010) [2023-12-26 05:42:56,390][123091] Updated weights for policy 0, policy_version 767081 (0.0010) [2023-12-26 05:42:57,084][123090] Updated weights for policy 1, policy_version 762058 (0.0010) [2023-12-26 05:42:57,150][123090] Updated weights for policy 1, policy_version 762068 (0.0010) [2023-12-26 05:42:57,194][123091] Updated weights for policy 0, policy_version 767091 (0.0010) [2023-12-26 05:42:57,208][123090] Updated weights for policy 1, policy_version 762078 (0.0010) [2023-12-26 05:42:57,244][123091] Updated weights for policy 0, policy_version 767101 (0.0010) [2023-12-26 05:42:57,301][123091] Updated weights for policy 0, policy_version 767111 (0.0009) [2023-12-26 05:42:57,864][123090] Updated weights for policy 1, policy_version 762088 (0.0010) [2023-12-26 05:42:57,910][123090] Updated weights for policy 1, policy_version 762098 (0.0008) [2023-12-26 05:42:57,966][123090] Updated weights for policy 1, policy_version 762108 (0.0010) [2023-12-26 05:42:57,974][123091] Updated weights for policy 0, policy_version 767121 (0.0005) [2023-12-26 05:42:58,044][123091] Updated weights for policy 0, policy_version 767131 (0.0007) [2023-12-26 05:42:58,113][123091] Updated weights for policy 0, policy_version 767141 (0.0008) [2023-12-26 05:42:58,185][123091] Updated weights for policy 0, policy_version 767151 (0.0008) [2023-12-26 05:42:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 391495680. Throughput: 0: 9106.5, 1: 8763.6. Samples: 391492372. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:42:58,785][121949] Avg episode reward: [(0, '5891.283'), (1, '5249.252')] [2023-12-26 05:42:58,890][123090] Updated weights for policy 1, policy_version 762118 (0.0010) [2023-12-26 05:42:58,954][123090] Updated weights for policy 1, policy_version 762128 (0.0008) [2023-12-26 05:42:59,017][123090] Updated weights for policy 1, policy_version 762138 (0.0008) [2023-12-26 05:42:59,021][123091] Updated weights for policy 0, policy_version 767161 (0.0010) [2023-12-26 05:42:59,089][123091] Updated weights for policy 0, policy_version 767171 (0.0011) [2023-12-26 05:42:59,156][123091] Updated weights for policy 0, policy_version 767181 (0.0009) [2023-12-26 05:42:59,840][123090] Updated weights for policy 1, policy_version 762148 (0.0008) [2023-12-26 05:42:59,915][123090] Updated weights for policy 1, policy_version 762158 (0.0008) [2023-12-26 05:42:59,958][123091] Updated weights for policy 0, policy_version 767191 (0.0008) [2023-12-26 05:42:59,984][123090] Updated weights for policy 1, policy_version 762168 (0.0008) [2023-12-26 05:43:00,014][123091] Updated weights for policy 0, policy_version 767201 (0.0009) [2023-12-26 05:43:00,072][123091] Updated weights for policy 0, policy_version 767211 (0.0008) [2023-12-26 05:43:00,788][123090] Updated weights for policy 1, policy_version 762178 (0.0009) [2023-12-26 05:43:00,850][123090] Updated weights for policy 1, policy_version 762189 (0.0010) [2023-12-26 05:43:00,896][123091] Updated weights for policy 0, policy_version 767221 (0.0007) [2023-12-26 05:43:00,907][123090] Updated weights for policy 1, policy_version 762199 (0.0009) [2023-12-26 05:43:00,949][123091] Updated weights for policy 0, policy_version 767231 (0.0005) [2023-12-26 05:43:01,014][123091] Updated weights for policy 0, policy_version 767241 (0.0009) [2023-12-26 05:43:01,665][123090] Updated weights for policy 1, policy_version 762209 (0.0009) [2023-12-26 05:43:01,724][123090] Updated weights for policy 1, policy_version 762219 (0.0009) [2023-12-26 05:43:01,795][123090] Updated weights for policy 1, policy_version 762229 (0.0009) [2023-12-26 05:43:01,836][123091] Updated weights for policy 0, policy_version 767251 (0.0009) [2023-12-26 05:43:01,853][123090] Updated weights for policy 1, policy_version 762239 (0.0009) [2023-12-26 05:43:01,901][123091] Updated weights for policy 0, policy_version 767261 (0.0009) [2023-12-26 05:43:01,962][123091] Updated weights for policy 0, policy_version 767271 (0.0009) [2023-12-26 05:43:02,739][123090] Updated weights for policy 1, policy_version 762249 (0.0008) [2023-12-26 05:43:02,749][123091] Updated weights for policy 0, policy_version 767281 (0.0009) [2023-12-26 05:43:02,799][123090] Updated weights for policy 1, policy_version 762259 (0.0010) [2023-12-26 05:43:02,811][123091] Updated weights for policy 0, policy_version 767291 (0.0011) [2023-12-26 05:43:02,848][123090] Updated weights for policy 1, policy_version 762269 (0.0008) [2023-12-26 05:43:02,874][123091] Updated weights for policy 0, policy_version 767301 (0.0011) [2023-12-26 05:43:02,935][123091] Updated weights for policy 0, policy_version 767311 (0.0011) [2023-12-26 05:43:03,602][123091] Updated weights for policy 0, policy_version 767321 (0.0007) [2023-12-26 05:43:03,649][123091] Updated weights for policy 0, policy_version 767331 (0.0010) [2023-12-26 05:43:03,699][123091] Updated weights for policy 0, policy_version 767341 (0.0010) [2023-12-26 05:43:03,740][123090] Updated weights for policy 1, policy_version 762279 (0.0009) [2023-12-26 05:43:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 391585792. Throughput: 0: 9067.3, 1: 8781.0. Samples: 391596724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:03,785][121949] Avg episode reward: [(0, '6058.889'), (1, '5375.925')] [2023-12-26 05:43:03,798][123090] Updated weights for policy 1, policy_version 762289 (0.0014) [2023-12-26 05:43:03,857][123090] Updated weights for policy 1, policy_version 762299 (0.0010) [2023-12-26 05:43:04,400][123091] Updated weights for policy 0, policy_version 767351 (0.0007) [2023-12-26 05:43:04,460][123091] Updated weights for policy 0, policy_version 767361 (0.0011) [2023-12-26 05:43:04,525][123091] Updated weights for policy 0, policy_version 767371 (0.0009) [2023-12-26 05:43:04,789][123090] Updated weights for policy 1, policy_version 762309 (0.0009) [2023-12-26 05:43:04,848][123090] Updated weights for policy 1, policy_version 762319 (0.0009) [2023-12-26 05:43:04,901][123090] Updated weights for policy 1, policy_version 762329 (0.0010) [2023-12-26 05:43:05,235][123091] Updated weights for policy 0, policy_version 767381 (0.0011) [2023-12-26 05:43:05,289][123091] Updated weights for policy 0, policy_version 767391 (0.0010) [2023-12-26 05:43:05,333][123091] Updated weights for policy 0, policy_version 767401 (0.0010) [2023-12-26 05:43:05,807][123090] Updated weights for policy 1, policy_version 762339 (0.0009) [2023-12-26 05:43:05,861][123090] Updated weights for policy 1, policy_version 762349 (0.0009) [2023-12-26 05:43:05,913][123090] Updated weights for policy 1, policy_version 762359 (0.0009) [2023-12-26 05:43:06,078][123091] Updated weights for policy 0, policy_version 767411 (0.0010) [2023-12-26 05:43:06,146][123091] Updated weights for policy 0, policy_version 767421 (0.0010) [2023-12-26 05:43:06,207][123091] Updated weights for policy 0, policy_version 767431 (0.0006) [2023-12-26 05:43:06,845][123091] Updated weights for policy 0, policy_version 767441 (0.0005) [2023-12-26 05:43:06,870][123090] Updated weights for policy 1, policy_version 762369 (0.0009) [2023-12-26 05:43:06,915][123091] Updated weights for policy 0, policy_version 767451 (0.0008) [2023-12-26 05:43:06,931][123090] Updated weights for policy 1, policy_version 762379 (0.0007) [2023-12-26 05:43:06,967][123091] Updated weights for policy 0, policy_version 767461 (0.0011) [2023-12-26 05:43:06,996][123090] Updated weights for policy 1, policy_version 762389 (0.0006) [2023-12-26 05:43:07,015][123091] Updated weights for policy 0, policy_version 767471 (0.0010) [2023-12-26 05:43:07,060][123090] Updated weights for policy 1, policy_version 762399 (0.0008) [2023-12-26 05:43:07,824][123091] Updated weights for policy 0, policy_version 767481 (0.0010) [2023-12-26 05:43:07,886][123091] Updated weights for policy 0, policy_version 767491 (0.0010) [2023-12-26 05:43:07,899][123090] Updated weights for policy 1, policy_version 762409 (0.0006) [2023-12-26 05:43:07,952][123091] Updated weights for policy 0, policy_version 767501 (0.0009) [2023-12-26 05:43:07,963][123090] Updated weights for policy 1, policy_version 762419 (0.0005) [2023-12-26 05:43:08,034][123090] Updated weights for policy 1, policy_version 762429 (0.0006) [2023-12-26 05:43:08,739][123090] Updated weights for policy 1, policy_version 762439 (0.0009) [2023-12-26 05:43:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 391667712. Throughput: 0: 9145.9, 1: 8744.3. Samples: 391649176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:08,785][121949] Avg episode reward: [(0, '6117.251'), (1, '5374.877')] [2023-12-26 05:43:08,795][123090] Updated weights for policy 1, policy_version 762449 (0.0010) [2023-12-26 05:43:08,842][123091] Updated weights for policy 0, policy_version 767511 (0.0006) [2023-12-26 05:43:08,856][123090] Updated weights for policy 1, policy_version 762459 (0.0011) [2023-12-26 05:43:08,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000762464_195190784.pth... [2023-12-26 05:43:08,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000761440_194928640.pth [2023-12-26 05:43:08,902][123091] Updated weights for policy 0, policy_version 767521 (0.0008) [2023-12-26 05:43:08,970][123091] Updated weights for policy 0, policy_version 767531 (0.0009) [2023-12-26 05:43:09,000][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000767536_196493312.pth... [2023-12-26 05:43:09,005][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000766480_196222976.pth [2023-12-26 05:43:09,706][123090] Updated weights for policy 1, policy_version 762469 (0.0011) [2023-12-26 05:43:09,771][123090] Updated weights for policy 1, policy_version 762479 (0.0011) [2023-12-26 05:43:09,811][123091] Updated weights for policy 0, policy_version 767541 (0.0008) [2023-12-26 05:43:09,838][123090] Updated weights for policy 1, policy_version 762489 (0.0013) [2023-12-26 05:43:09,879][123091] Updated weights for policy 0, policy_version 767551 (0.0007) [2023-12-26 05:43:09,947][123091] Updated weights for policy 0, policy_version 767561 (0.0008) [2023-12-26 05:43:10,669][123090] Updated weights for policy 1, policy_version 762499 (0.0009) [2023-12-26 05:43:10,734][123090] Updated weights for policy 1, policy_version 762509 (0.0005) [2023-12-26 05:43:10,753][123091] Updated weights for policy 0, policy_version 767571 (0.0009) [2023-12-26 05:43:10,793][123090] Updated weights for policy 1, policy_version 762519 (0.0007) [2023-12-26 05:43:10,816][123091] Updated weights for policy 0, policy_version 767581 (0.0009) [2023-12-26 05:43:10,874][123091] Updated weights for policy 0, policy_version 767591 (0.0007) [2023-12-26 05:43:11,542][123090] Updated weights for policy 1, policy_version 762529 (0.0010) [2023-12-26 05:43:11,597][123090] Updated weights for policy 1, policy_version 762539 (0.0006) [2023-12-26 05:43:11,660][123090] Updated weights for policy 1, policy_version 762549 (0.0010) [2023-12-26 05:43:11,673][123091] Updated weights for policy 0, policy_version 767601 (0.0009) [2023-12-26 05:43:11,730][123090] Updated weights for policy 1, policy_version 762559 (0.0008) [2023-12-26 05:43:11,746][123091] Updated weights for policy 0, policy_version 767611 (0.0009) [2023-12-26 05:43:11,809][123091] Updated weights for policy 0, policy_version 767621 (0.0009) [2023-12-26 05:43:11,873][123091] Updated weights for policy 0, policy_version 767631 (0.0009) [2023-12-26 05:43:12,536][123090] Updated weights for policy 1, policy_version 762569 (0.0006) [2023-12-26 05:43:12,605][123090] Updated weights for policy 1, policy_version 762579 (0.0009) [2023-12-26 05:43:12,670][123090] Updated weights for policy 1, policy_version 762589 (0.0009) [2023-12-26 05:43:12,683][123091] Updated weights for policy 0, policy_version 767641 (0.0008) [2023-12-26 05:43:12,750][123091] Updated weights for policy 0, policy_version 767651 (0.0007) [2023-12-26 05:43:12,809][123091] Updated weights for policy 0, policy_version 767661 (0.0010) [2023-12-26 05:43:13,499][123091] Updated weights for policy 0, policy_version 767671 (0.0006) [2023-12-26 05:43:13,509][123090] Updated weights for policy 1, policy_version 762599 (0.0007) [2023-12-26 05:43:13,567][123091] Updated weights for policy 0, policy_version 767681 (0.0009) [2023-12-26 05:43:13,567][123090] Updated weights for policy 1, policy_version 762609 (0.0010) [2023-12-26 05:43:13,630][123090] Updated weights for policy 1, policy_version 762619 (0.0010) [2023-12-26 05:43:13,633][123091] Updated weights for policy 0, policy_version 767691 (0.0008) [2023-12-26 05:43:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 391766016. Throughput: 0: 9065.3, 1: 8782.8. Samples: 391753732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:13,785][121949] Avg episode reward: [(0, '6036.524'), (1, '5170.688')] [2023-12-26 05:43:14,415][123091] Updated weights for policy 0, policy_version 767701 (0.0008) [2023-12-26 05:43:14,460][123090] Updated weights for policy 1, policy_version 762629 (0.0009) [2023-12-26 05:43:14,471][123091] Updated weights for policy 0, policy_version 767711 (0.0008) [2023-12-26 05:43:14,516][123091] Updated weights for policy 0, policy_version 767721 (0.0008) [2023-12-26 05:43:14,522][123090] Updated weights for policy 1, policy_version 762639 (0.0009) [2023-12-26 05:43:14,591][123090] Updated weights for policy 1, policy_version 762649 (0.0010) [2023-12-26 05:43:15,357][123091] Updated weights for policy 0, policy_version 767731 (0.0008) [2023-12-26 05:43:15,424][123091] Updated weights for policy 0, policy_version 767741 (0.0011) [2023-12-26 05:43:15,465][123090] Updated weights for policy 1, policy_version 762659 (0.0008) [2023-12-26 05:43:15,495][123091] Updated weights for policy 0, policy_version 767751 (0.0011) [2023-12-26 05:43:15,534][123090] Updated weights for policy 1, policy_version 762669 (0.0007) [2023-12-26 05:43:15,601][123090] Updated weights for policy 1, policy_version 762679 (0.0007) [2023-12-26 05:43:16,239][123091] Updated weights for policy 0, policy_version 767761 (0.0011) [2023-12-26 05:43:16,299][123091] Updated weights for policy 0, policy_version 767771 (0.0009) [2023-12-26 05:43:16,361][123091] Updated weights for policy 0, policy_version 767781 (0.0008) [2023-12-26 05:43:16,417][123091] Updated weights for policy 0, policy_version 767791 (0.0005) [2023-12-26 05:43:16,420][123090] Updated weights for policy 1, policy_version 762689 (0.0010) [2023-12-26 05:43:16,486][123090] Updated weights for policy 1, policy_version 762699 (0.0010) [2023-12-26 05:43:16,539][123090] Updated weights for policy 1, policy_version 762709 (0.0009) [2023-12-26 05:43:16,594][123090] Updated weights for policy 1, policy_version 762719 (0.0010) [2023-12-26 05:43:17,101][123091] Updated weights for policy 0, policy_version 767801 (0.0005) [2023-12-26 05:43:17,154][123091] Updated weights for policy 0, policy_version 767811 (0.0005) [2023-12-26 05:43:17,204][123091] Updated weights for policy 0, policy_version 767821 (0.0005) [2023-12-26 05:43:17,541][123090] Updated weights for policy 1, policy_version 762729 (0.0010) [2023-12-26 05:43:17,594][123090] Updated weights for policy 1, policy_version 762739 (0.0010) [2023-12-26 05:43:17,648][123090] Updated weights for policy 1, policy_version 762749 (0.0010) [2023-12-26 05:43:17,885][123091] Updated weights for policy 0, policy_version 767831 (0.0005) [2023-12-26 05:43:17,939][123091] Updated weights for policy 0, policy_version 767841 (0.0008) [2023-12-26 05:43:17,990][123091] Updated weights for policy 0, policy_version 767851 (0.0010) [2023-12-26 05:43:18,590][123091] Updated weights for policy 0, policy_version 767861 (0.0006) [2023-12-26 05:43:18,611][123090] Updated weights for policy 1, policy_version 762759 (0.0009) [2023-12-26 05:43:18,649][123091] Updated weights for policy 0, policy_version 767871 (0.0008) [2023-12-26 05:43:18,671][123090] Updated weights for policy 1, policy_version 762769 (0.0010) [2023-12-26 05:43:18,716][123091] Updated weights for policy 0, policy_version 767881 (0.0011) [2023-12-26 05:43:18,726][123090] Updated weights for policy 1, policy_version 762779 (0.0008) [2023-12-26 05:43:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 391856128. Throughput: 0: 9052.8, 1: 8645.4. Samples: 391860332. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:18,785][121949] Avg episode reward: [(0, '6029.072'), (1, '5153.663')] [2023-12-26 05:43:19,446][123091] Updated weights for policy 0, policy_version 767891 (0.0008) [2023-12-26 05:43:19,513][123091] Updated weights for policy 0, policy_version 767901 (0.0009) [2023-12-26 05:43:19,581][123091] Updated weights for policy 0, policy_version 767911 (0.0011) [2023-12-26 05:43:19,681][123090] Updated weights for policy 1, policy_version 762789 (0.0009) [2023-12-26 05:43:19,735][123090] Updated weights for policy 1, policy_version 762799 (0.0010) [2023-12-26 05:43:19,802][123090] Updated weights for policy 1, policy_version 762809 (0.0010) [2023-12-26 05:43:20,315][123091] Updated weights for policy 0, policy_version 767921 (0.0008) [2023-12-26 05:43:20,377][123091] Updated weights for policy 0, policy_version 767931 (0.0008) [2023-12-26 05:43:20,447][123091] Updated weights for policy 0, policy_version 767941 (0.0008) [2023-12-26 05:43:20,510][123091] Updated weights for policy 0, policy_version 767951 (0.0008) [2023-12-26 05:43:20,728][123090] Updated weights for policy 1, policy_version 762819 (0.0010) [2023-12-26 05:43:20,797][123090] Updated weights for policy 1, policy_version 762829 (0.0008) [2023-12-26 05:43:20,860][123090] Updated weights for policy 1, policy_version 762839 (0.0009) [2023-12-26 05:43:21,310][123091] Updated weights for policy 0, policy_version 767961 (0.0009) [2023-12-26 05:43:21,386][123091] Updated weights for policy 0, policy_version 767971 (0.0009) [2023-12-26 05:43:21,452][123091] Updated weights for policy 0, policy_version 767981 (0.0010) [2023-12-26 05:43:21,722][123090] Updated weights for policy 1, policy_version 762849 (0.0009) [2023-12-26 05:43:21,791][123090] Updated weights for policy 1, policy_version 762859 (0.0009) [2023-12-26 05:43:21,862][123090] Updated weights for policy 1, policy_version 762869 (0.0009) [2023-12-26 05:43:21,935][123090] Updated weights for policy 1, policy_version 762879 (0.0008) [2023-12-26 05:43:22,302][123091] Updated weights for policy 0, policy_version 767991 (0.0009) [2023-12-26 05:43:22,370][123091] Updated weights for policy 0, policy_version 768001 (0.0009) [2023-12-26 05:43:22,435][123091] Updated weights for policy 0, policy_version 768011 (0.0010) [2023-12-26 05:43:22,684][123090] Updated weights for policy 1, policy_version 762889 (0.0008) [2023-12-26 05:43:22,746][123090] Updated weights for policy 1, policy_version 762899 (0.0010) [2023-12-26 05:43:22,807][123090] Updated weights for policy 1, policy_version 762909 (0.0010) [2023-12-26 05:43:23,154][123091] Updated weights for policy 0, policy_version 768021 (0.0010) [2023-12-26 05:43:23,207][123091] Updated weights for policy 0, policy_version 768031 (0.0010) [2023-12-26 05:43:23,265][123091] Updated weights for policy 0, policy_version 768041 (0.0009) [2023-12-26 05:43:23,624][123090] Updated weights for policy 1, policy_version 762919 (0.0009) [2023-12-26 05:43:23,679][123090] Updated weights for policy 1, policy_version 762929 (0.0008) [2023-12-26 05:43:23,737][123090] Updated weights for policy 1, policy_version 762939 (0.0009) [2023-12-26 05:43:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17689.1). Total num frames: 391938048. Throughput: 0: 9000.6, 1: 8527.3. Samples: 391910400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:23,785][121949] Avg episode reward: [(0, '6013.302'), (1, '5270.539')] [2023-12-26 05:43:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000768048_196624384.pth... [2023-12-26 05:43:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000762944_195313664.pth... [2023-12-26 05:43:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000766992_196354048.pth [2023-12-26 05:43:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000761952_195059712.pth [2023-12-26 05:43:24,139][123091] Updated weights for policy 0, policy_version 768051 (0.0010) [2023-12-26 05:43:24,191][123091] Updated weights for policy 0, policy_version 768061 (0.0010) [2023-12-26 05:43:24,246][123091] Updated weights for policy 0, policy_version 768071 (0.0011) [2023-12-26 05:43:24,562][123090] Updated weights for policy 1, policy_version 762949 (0.0009) [2023-12-26 05:43:24,612][123090] Updated weights for policy 1, policy_version 762959 (0.0009) [2023-12-26 05:43:24,660][123090] Updated weights for policy 1, policy_version 762969 (0.0009) [2023-12-26 05:43:25,064][123091] Updated weights for policy 0, policy_version 768081 (0.0010) [2023-12-26 05:43:25,119][123091] Updated weights for policy 0, policy_version 768091 (0.0010) [2023-12-26 05:43:25,170][123091] Updated weights for policy 0, policy_version 768101 (0.0010) [2023-12-26 05:43:25,215][123091] Updated weights for policy 0, policy_version 768111 (0.0010) [2023-12-26 05:43:25,511][123090] Updated weights for policy 1, policy_version 762979 (0.0009) [2023-12-26 05:43:25,563][123090] Updated weights for policy 1, policy_version 762989 (0.0008) [2023-12-26 05:43:25,616][123090] Updated weights for policy 1, policy_version 762999 (0.0008) [2023-12-26 05:43:26,057][123091] Updated weights for policy 0, policy_version 768121 (0.0010) [2023-12-26 05:43:26,104][123091] Updated weights for policy 0, policy_version 768131 (0.0010) [2023-12-26 05:43:26,158][123091] Updated weights for policy 0, policy_version 768141 (0.0010) [2023-12-26 05:43:26,465][123090] Updated weights for policy 1, policy_version 763009 (0.0009) [2023-12-26 05:43:26,534][123090] Updated weights for policy 1, policy_version 763019 (0.0009) [2023-12-26 05:43:26,590][123090] Updated weights for policy 1, policy_version 763029 (0.0009) [2023-12-26 05:43:26,642][123090] Updated weights for policy 1, policy_version 763039 (0.0009) [2023-12-26 05:43:27,009][123091] Updated weights for policy 0, policy_version 768151 (0.0010) [2023-12-26 05:43:27,059][123091] Updated weights for policy 0, policy_version 768161 (0.0010) [2023-12-26 05:43:27,113][123091] Updated weights for policy 0, policy_version 768171 (0.0010) [2023-12-26 05:43:27,468][123090] Updated weights for policy 1, policy_version 763049 (0.0009) [2023-12-26 05:43:27,516][123090] Updated weights for policy 1, policy_version 763059 (0.0009) [2023-12-26 05:43:27,564][123090] Updated weights for policy 1, policy_version 763069 (0.0009) [2023-12-26 05:43:27,927][123091] Updated weights for policy 0, policy_version 768181 (0.0010) [2023-12-26 05:43:27,974][123091] Updated weights for policy 0, policy_version 768191 (0.0009) [2023-12-26 05:43:28,026][123091] Updated weights for policy 0, policy_version 768201 (0.0008) [2023-12-26 05:43:28,418][123090] Updated weights for policy 1, policy_version 763079 (0.0009) [2023-12-26 05:43:28,477][123090] Updated weights for policy 1, policy_version 763089 (0.0008) [2023-12-26 05:43:28,539][123090] Updated weights for policy 1, policy_version 763099 (0.0009) [2023-12-26 05:43:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 392019968. Throughput: 0: 9003.3, 1: 8497.7. Samples: 392013416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:28,784][121949] Avg episode reward: [(0, '5962.367'), (1, '5306.132')] [2023-12-26 05:43:28,842][123091] Updated weights for policy 0, policy_version 768211 (0.0010) [2023-12-26 05:43:28,899][123091] Updated weights for policy 0, policy_version 768222 (0.0009) [2023-12-26 05:43:28,952][123091] Updated weights for policy 0, policy_version 768232 (0.0005) [2023-12-26 05:43:29,403][123090] Updated weights for policy 1, policy_version 763109 (0.0009) [2023-12-26 05:43:29,457][123090] Updated weights for policy 1, policy_version 763119 (0.0010) [2023-12-26 05:43:29,508][123090] Updated weights for policy 1, policy_version 763129 (0.0008) [2023-12-26 05:43:29,770][123091] Updated weights for policy 0, policy_version 768242 (0.0006) [2023-12-26 05:43:29,826][123091] Updated weights for policy 0, policy_version 768252 (0.0009) [2023-12-26 05:43:29,897][123091] Updated weights for policy 0, policy_version 768262 (0.0010) [2023-12-26 05:43:29,964][123091] Updated weights for policy 0, policy_version 768272 (0.0009) [2023-12-26 05:43:30,394][123090] Updated weights for policy 1, policy_version 763139 (0.0009) [2023-12-26 05:43:30,448][123090] Updated weights for policy 1, policy_version 763149 (0.0009) [2023-12-26 05:43:30,504][123090] Updated weights for policy 1, policy_version 763159 (0.0010) [2023-12-26 05:43:30,763][123091] Updated weights for policy 0, policy_version 768282 (0.0009) [2023-12-26 05:43:30,818][123091] Updated weights for policy 0, policy_version 768292 (0.0009) [2023-12-26 05:43:30,878][123091] Updated weights for policy 0, policy_version 768302 (0.0009) [2023-12-26 05:43:31,377][123090] Updated weights for policy 1, policy_version 763169 (0.0009) [2023-12-26 05:43:31,442][123090] Updated weights for policy 1, policy_version 763179 (0.0009) [2023-12-26 05:43:31,501][123090] Updated weights for policy 1, policy_version 763189 (0.0009) [2023-12-26 05:43:31,573][123090] Updated weights for policy 1, policy_version 763199 (0.0009) [2023-12-26 05:43:31,707][123091] Updated weights for policy 0, policy_version 768312 (0.0009) [2023-12-26 05:43:31,769][123091] Updated weights for policy 0, policy_version 768322 (0.0008) [2023-12-26 05:43:31,840][123091] Updated weights for policy 0, policy_version 768332 (0.0008) [2023-12-26 05:43:32,477][123090] Updated weights for policy 1, policy_version 763209 (0.0009) [2023-12-26 05:43:32,538][123090] Updated weights for policy 1, policy_version 763219 (0.0009) [2023-12-26 05:43:32,573][123091] Updated weights for policy 0, policy_version 768342 (0.0009) [2023-12-26 05:43:32,601][123090] Updated weights for policy 1, policy_version 763229 (0.0009) [2023-12-26 05:43:32,628][123091] Updated weights for policy 0, policy_version 768352 (0.0009) [2023-12-26 05:43:32,691][123091] Updated weights for policy 0, policy_version 768362 (0.0011) [2023-12-26 05:43:33,407][123091] Updated weights for policy 0, policy_version 768372 (0.0010) [2023-12-26 05:43:33,481][123091] Updated weights for policy 0, policy_version 768382 (0.0008) [2023-12-26 05:43:33,502][123090] Updated weights for policy 1, policy_version 763239 (0.0008) [2023-12-26 05:43:33,547][123091] Updated weights for policy 0, policy_version 768392 (0.0008) [2023-12-26 05:43:33,564][123090] Updated weights for policy 1, policy_version 763249 (0.0009) [2023-12-26 05:43:33,631][123090] Updated weights for policy 1, policy_version 763259 (0.0008) [2023-12-26 05:43:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 392110080. Throughput: 0: 9020.0, 1: 8426.7. Samples: 392116752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:33,785][121949] Avg episode reward: [(0, '5884.423'), (1, '5424.466')] [2023-12-26 05:43:34,291][123091] Updated weights for policy 0, policy_version 768402 (0.0009) [2023-12-26 05:43:34,357][123091] Updated weights for policy 0, policy_version 768412 (0.0010) [2023-12-26 05:43:34,420][123091] Updated weights for policy 0, policy_version 768422 (0.0011) [2023-12-26 05:43:34,486][123090] Updated weights for policy 1, policy_version 763269 (0.0009) [2023-12-26 05:43:34,491][123091] Updated weights for policy 0, policy_version 768432 (0.0010) [2023-12-26 05:43:34,549][123090] Updated weights for policy 1, policy_version 763279 (0.0009) [2023-12-26 05:43:34,616][123090] Updated weights for policy 1, policy_version 763289 (0.0010) [2023-12-26 05:43:35,263][123091] Updated weights for policy 0, policy_version 768442 (0.0010) [2023-12-26 05:43:35,331][123091] Updated weights for policy 0, policy_version 768452 (0.0007) [2023-12-26 05:43:35,386][123091] Updated weights for policy 0, policy_version 768463 (0.0010) [2023-12-26 05:43:35,474][123090] Updated weights for policy 1, policy_version 763299 (0.0010) [2023-12-26 05:43:35,539][123090] Updated weights for policy 1, policy_version 763309 (0.0009) [2023-12-26 05:43:35,601][123090] Updated weights for policy 1, policy_version 763319 (0.0009) [2023-12-26 05:43:36,086][123091] Updated weights for policy 0, policy_version 768473 (0.0006) [2023-12-26 05:43:36,150][123091] Updated weights for policy 0, policy_version 768483 (0.0007) [2023-12-26 05:43:36,220][123091] Updated weights for policy 0, policy_version 768493 (0.0009) [2023-12-26 05:43:36,468][123090] Updated weights for policy 1, policy_version 763329 (0.0009) [2023-12-26 05:43:36,537][123090] Updated weights for policy 1, policy_version 763339 (0.0009) [2023-12-26 05:43:36,609][123090] Updated weights for policy 1, policy_version 763349 (0.0010) [2023-12-26 05:43:36,673][123090] Updated weights for policy 1, policy_version 763359 (0.0010) [2023-12-26 05:43:36,976][123091] Updated weights for policy 0, policy_version 768503 (0.0009) [2023-12-26 05:43:37,037][123091] Updated weights for policy 0, policy_version 768513 (0.0009) [2023-12-26 05:43:37,103][123091] Updated weights for policy 0, policy_version 768523 (0.0010) [2023-12-26 05:43:37,511][123090] Updated weights for policy 1, policy_version 763369 (0.0006) [2023-12-26 05:43:37,566][123090] Updated weights for policy 1, policy_version 763379 (0.0006) [2023-12-26 05:43:37,629][123090] Updated weights for policy 1, policy_version 763389 (0.0005) [2023-12-26 05:43:38,008][123091] Updated weights for policy 0, policy_version 768533 (0.0010) [2023-12-26 05:43:38,082][123091] Updated weights for policy 0, policy_version 768543 (0.0010) [2023-12-26 05:43:38,144][123091] Updated weights for policy 0, policy_version 768553 (0.0006) [2023-12-26 05:43:38,407][123090] Updated weights for policy 1, policy_version 763399 (0.0006) [2023-12-26 05:43:38,479][123090] Updated weights for policy 1, policy_version 763409 (0.0008) [2023-12-26 05:43:38,551][123090] Updated weights for policy 1, policy_version 763419 (0.0010) [2023-12-26 05:43:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 392192000. Throughput: 0: 9067.8, 1: 8385.2. Samples: 392169408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-12-26 05:43:38,785][121949] Avg episode reward: [(0, '5769.812'), (1, '5379.975')] [2023-12-26 05:43:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000768560_196755456.pth... [2023-12-26 05:43:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000763424_195436544.pth... [2023-12-26 05:43:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000767536_196493312.pth [2023-12-26 05:43:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000762464_195190784.pth [2023-12-26 05:43:38,916][123091] Updated weights for policy 0, policy_version 768563 (0.0006) [2023-12-26 05:43:38,983][123091] Updated weights for policy 0, policy_version 768573 (0.0009) [2023-12-26 05:43:39,048][123091] Updated weights for policy 0, policy_version 768583 (0.0010) [2023-12-26 05:43:39,356][123090] Updated weights for policy 1, policy_version 763429 (0.0009) [2023-12-26 05:43:39,432][123090] Updated weights for policy 1, policy_version 763439 (0.0009) [2023-12-26 05:43:39,507][123090] Updated weights for policy 1, policy_version 763449 (0.0009) [2023-12-26 05:43:39,871][123091] Updated weights for policy 0, policy_version 768593 (0.0009) [2023-12-26 05:43:39,944][123091] Updated weights for policy 0, policy_version 768603 (0.0009) [2023-12-26 05:43:40,010][123091] Updated weights for policy 0, policy_version 768613 (0.0008) [2023-12-26 05:43:40,074][123091] Updated weights for policy 0, policy_version 768623 (0.0008) [2023-12-26 05:43:40,355][123090] Updated weights for policy 1, policy_version 763459 (0.0009) [2023-12-26 05:43:40,410][123090] Updated weights for policy 1, policy_version 763469 (0.0009) [2023-12-26 05:43:40,463][123090] Updated weights for policy 1, policy_version 763479 (0.0008) [2023-12-26 05:43:40,917][123091] Updated weights for policy 0, policy_version 768633 (0.0010) [2023-12-26 05:43:40,980][123091] Updated weights for policy 0, policy_version 768643 (0.0011) [2023-12-26 05:43:41,037][123091] Updated weights for policy 0, policy_version 768653 (0.0011) [2023-12-26 05:43:41,322][123090] Updated weights for policy 1, policy_version 763489 (0.0009) [2023-12-26 05:43:41,389][123090] Updated weights for policy 1, policy_version 763499 (0.0009) [2023-12-26 05:43:41,447][123090] Updated weights for policy 1, policy_version 763509 (0.0008) [2023-12-26 05:43:41,519][123090] Updated weights for policy 1, policy_version 763519 (0.0009) [2023-12-26 05:43:41,907][123091] Updated weights for policy 0, policy_version 768663 (0.0011) [2023-12-26 05:43:41,962][123091] Updated weights for policy 0, policy_version 768673 (0.0011) [2023-12-26 05:43:42,018][123091] Updated weights for policy 0, policy_version 768683 (0.0011) [2023-12-26 05:43:42,398][123090] Updated weights for policy 1, policy_version 763529 (0.0009) [2023-12-26 05:43:42,457][123090] Updated weights for policy 1, policy_version 763539 (0.0010) [2023-12-26 05:43:42,521][123090] Updated weights for policy 1, policy_version 763549 (0.0009) [2023-12-26 05:43:42,866][123091] Updated weights for policy 0, policy_version 768693 (0.0011) [2023-12-26 05:43:42,929][123091] Updated weights for policy 0, policy_version 768703 (0.0011) [2023-12-26 05:43:42,987][123091] Updated weights for policy 0, policy_version 768713 (0.0010) [2023-12-26 05:43:43,294][123090] Updated weights for policy 1, policy_version 763559 (0.0005) [2023-12-26 05:43:43,350][123090] Updated weights for policy 1, policy_version 763569 (0.0005) [2023-12-26 05:43:43,411][123090] Updated weights for policy 1, policy_version 763579 (0.0005) [2023-12-26 05:43:43,710][123091] Updated weights for policy 0, policy_version 768723 (0.0009) [2023-12-26 05:43:43,761][123091] Updated weights for policy 0, policy_version 768733 (0.0005) [2023-12-26 05:43:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 392273920. Throughput: 0: 8967.3, 1: 8329.2. Samples: 392270712. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:43:43,785][121949] Avg episode reward: [(0, '5828.516'), (1, '5303.310')] [2023-12-26 05:43:43,817][123091] Updated weights for policy 0, policy_version 768743 (0.0006) [2023-12-26 05:43:43,999][123090] Updated weights for policy 1, policy_version 763589 (0.0005) [2023-12-26 05:43:44,047][123090] Updated weights for policy 1, policy_version 763599 (0.0005) [2023-12-26 05:43:44,100][123090] Updated weights for policy 1, policy_version 763609 (0.0005) [2023-12-26 05:43:44,527][123091] Updated weights for policy 0, policy_version 768753 (0.0006) [2023-12-26 05:43:44,599][123091] Updated weights for policy 0, policy_version 768763 (0.0010) [2023-12-26 05:43:44,672][123091] Updated weights for policy 0, policy_version 768773 (0.0011) [2023-12-26 05:43:44,747][123091] Updated weights for policy 0, policy_version 768783 (0.0010) [2023-12-26 05:43:44,795][123090] Updated weights for policy 1, policy_version 763619 (0.0007) [2023-12-26 05:43:44,868][123090] Updated weights for policy 1, policy_version 763629 (0.0009) [2023-12-26 05:43:44,937][123090] Updated weights for policy 1, policy_version 763639 (0.0005) [2023-12-26 05:43:45,557][123090] Updated weights for policy 1, policy_version 763649 (0.0005) [2023-12-26 05:43:45,591][123091] Updated weights for policy 0, policy_version 768793 (0.0009) [2023-12-26 05:43:45,627][123090] Updated weights for policy 1, policy_version 763659 (0.0005) [2023-12-26 05:43:45,641][123091] Updated weights for policy 0, policy_version 768803 (0.0009) [2023-12-26 05:43:45,691][123091] Updated weights for policy 0, policy_version 768813 (0.0009) [2023-12-26 05:43:45,692][123090] Updated weights for policy 1, policy_version 763669 (0.0006) [2023-12-26 05:43:45,756][123090] Updated weights for policy 1, policy_version 763679 (0.0005) [2023-12-26 05:43:46,349][123091] Updated weights for policy 0, policy_version 768823 (0.0006) [2023-12-26 05:43:46,403][123091] Updated weights for policy 0, policy_version 768833 (0.0010) [2023-12-26 05:43:46,457][123091] Updated weights for policy 0, policy_version 768843 (0.0008) [2023-12-26 05:43:46,471][123090] Updated weights for policy 1, policy_version 763689 (0.0005) [2023-12-26 05:43:46,528][123090] Updated weights for policy 1, policy_version 763699 (0.0006) [2023-12-26 05:43:46,583][123090] Updated weights for policy 1, policy_version 763709 (0.0009) [2023-12-26 05:43:47,275][123090] Updated weights for policy 1, policy_version 763719 (0.0010) [2023-12-26 05:43:47,297][123091] Updated weights for policy 0, policy_version 768853 (0.0009) [2023-12-26 05:43:47,338][123090] Updated weights for policy 1, policy_version 763729 (0.0008) [2023-12-26 05:43:47,357][123091] Updated weights for policy 0, policy_version 768863 (0.0008) [2023-12-26 05:43:47,396][123090] Updated weights for policy 1, policy_version 763739 (0.0007) [2023-12-26 05:43:47,419][123091] Updated weights for policy 0, policy_version 768873 (0.0010) [2023-12-26 05:43:48,163][123091] Updated weights for policy 0, policy_version 768883 (0.0010) [2023-12-26 05:43:48,199][123090] Updated weights for policy 1, policy_version 763749 (0.0008) [2023-12-26 05:43:48,213][123091] Updated weights for policy 0, policy_version 768893 (0.0005) [2023-12-26 05:43:48,247][123090] Updated weights for policy 1, policy_version 763759 (0.0010) [2023-12-26 05:43:48,258][123091] Updated weights for policy 0, policy_version 768903 (0.0005) [2023-12-26 05:43:48,295][123090] Updated weights for policy 1, policy_version 763769 (0.0010) [2023-12-26 05:43:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 392372224. Throughput: 0: 8991.4, 1: 8484.5. Samples: 392383136. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:43:48,785][121949] Avg episode reward: [(0, '5890.608'), (1, '5268.206')] [2023-12-26 05:43:48,978][123091] Updated weights for policy 0, policy_version 768913 (0.0005) [2023-12-26 05:43:49,047][123091] Updated weights for policy 0, policy_version 768923 (0.0006) [2023-12-26 05:43:49,105][123090] Updated weights for policy 1, policy_version 763779 (0.0009) [2023-12-26 05:43:49,115][123091] Updated weights for policy 0, policy_version 768933 (0.0006) [2023-12-26 05:43:49,179][123090] Updated weights for policy 1, policy_version 763789 (0.0006) [2023-12-26 05:43:49,190][123091] Updated weights for policy 0, policy_version 768943 (0.0006) [2023-12-26 05:43:49,254][123090] Updated weights for policy 1, policy_version 763799 (0.0006) [2023-12-26 05:43:49,893][123091] Updated weights for policy 0, policy_version 768953 (0.0008) [2023-12-26 05:43:49,959][123091] Updated weights for policy 0, policy_version 768963 (0.0011) [2023-12-26 05:43:50,015][123090] Updated weights for policy 1, policy_version 763809 (0.0007) [2023-12-26 05:43:50,029][123091] Updated weights for policy 0, policy_version 768973 (0.0011) [2023-12-26 05:43:50,073][123090] Updated weights for policy 1, policy_version 763819 (0.0008) [2023-12-26 05:43:50,125][123090] Updated weights for policy 1, policy_version 763829 (0.0008) [2023-12-26 05:43:50,186][123090] Updated weights for policy 1, policy_version 763839 (0.0009) [2023-12-26 05:43:50,857][123091] Updated weights for policy 0, policy_version 768983 (0.0011) [2023-12-26 05:43:50,925][123091] Updated weights for policy 0, policy_version 768993 (0.0011) [2023-12-26 05:43:50,981][123091] Updated weights for policy 0, policy_version 769003 (0.0011) [2023-12-26 05:43:51,058][123090] Updated weights for policy 1, policy_version 763849 (0.0008) [2023-12-26 05:43:51,125][123090] Updated weights for policy 1, policy_version 763859 (0.0008) [2023-12-26 05:43:51,191][123090] Updated weights for policy 1, policy_version 763869 (0.0009) [2023-12-26 05:43:51,834][123091] Updated weights for policy 0, policy_version 769013 (0.0011) [2023-12-26 05:43:51,897][123091] Updated weights for policy 0, policy_version 769023 (0.0010) [2023-12-26 05:43:51,966][123091] Updated weights for policy 0, policy_version 769033 (0.0008) [2023-12-26 05:43:52,038][123090] Updated weights for policy 1, policy_version 763879 (0.0008) [2023-12-26 05:43:52,099][123090] Updated weights for policy 1, policy_version 763889 (0.0009) [2023-12-26 05:43:52,164][123090] Updated weights for policy 1, policy_version 763899 (0.0009) [2023-12-26 05:43:52,792][123091] Updated weights for policy 0, policy_version 769043 (0.0011) [2023-12-26 05:43:52,856][123091] Updated weights for policy 0, policy_version 769053 (0.0010) [2023-12-26 05:43:52,922][123091] Updated weights for policy 0, policy_version 769063 (0.0011) [2023-12-26 05:43:52,981][123090] Updated weights for policy 1, policy_version 763909 (0.0008) [2023-12-26 05:43:53,051][123090] Updated weights for policy 1, policy_version 763919 (0.0009) [2023-12-26 05:43:53,103][123090] Updated weights for policy 1, policy_version 763929 (0.0009) [2023-12-26 05:43:53,668][123091] Updated weights for policy 0, policy_version 769073 (0.0010) [2023-12-26 05:43:53,736][123091] Updated weights for policy 0, policy_version 769083 (0.0005) [2023-12-26 05:43:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 392454144. Throughput: 0: 8948.8, 1: 8546.4. Samples: 392436464. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:43:53,786][121949] Avg episode reward: [(0, '5793.067'), (1, '5445.209')] [2023-12-26 05:43:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000763936_195567616.pth... [2023-12-26 05:43:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000762944_195313664.pth [2023-12-26 05:43:53,800][123091] Updated weights for policy 0, policy_version 769093 (0.0010) [2023-12-26 05:43:53,856][123091] Updated weights for policy 0, policy_version 769103 (0.0010) [2023-12-26 05:43:53,858][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000769104_196894720.pth... [2023-12-26 05:43:53,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000768048_196624384.pth [2023-12-26 05:43:53,975][123090] Updated weights for policy 1, policy_version 763939 (0.0009) [2023-12-26 05:43:54,039][123090] Updated weights for policy 1, policy_version 763949 (0.0009) [2023-12-26 05:43:54,098][123090] Updated weights for policy 1, policy_version 763959 (0.0009) [2023-12-26 05:43:54,639][123091] Updated weights for policy 0, policy_version 769113 (0.0010) [2023-12-26 05:43:54,691][123091] Updated weights for policy 0, policy_version 769123 (0.0009) [2023-12-26 05:43:54,743][123091] Updated weights for policy 0, policy_version 769133 (0.0009) [2023-12-26 05:43:54,921][123090] Updated weights for policy 1, policy_version 763969 (0.0009) [2023-12-26 05:43:54,988][123090] Updated weights for policy 1, policy_version 763979 (0.0006) [2023-12-26 05:43:55,055][123090] Updated weights for policy 1, policy_version 763989 (0.0008) [2023-12-26 05:43:55,119][123090] Updated weights for policy 1, policy_version 763999 (0.0009) [2023-12-26 05:43:55,465][123091] Updated weights for policy 0, policy_version 769143 (0.0009) [2023-12-26 05:43:55,525][123091] Updated weights for policy 0, policy_version 769153 (0.0009) [2023-12-26 05:43:55,591][123091] Updated weights for policy 0, policy_version 769163 (0.0009) [2023-12-26 05:43:55,933][123090] Updated weights for policy 1, policy_version 764009 (0.0009) [2023-12-26 05:43:55,996][123090] Updated weights for policy 1, policy_version 764019 (0.0009) [2023-12-26 05:43:56,061][123090] Updated weights for policy 1, policy_version 764029 (0.0009) [2023-12-26 05:43:56,427][123091] Updated weights for policy 0, policy_version 769173 (0.0009) [2023-12-26 05:43:56,489][123091] Updated weights for policy 0, policy_version 769183 (0.0009) [2023-12-26 05:43:56,552][123091] Updated weights for policy 0, policy_version 769193 (0.0009) [2023-12-26 05:43:56,863][123090] Updated weights for policy 1, policy_version 764039 (0.0010) [2023-12-26 05:43:56,917][123090] Updated weights for policy 1, policy_version 764049 (0.0009) [2023-12-26 05:43:56,972][123090] Updated weights for policy 1, policy_version 764059 (0.0010) [2023-12-26 05:43:57,296][123091] Updated weights for policy 0, policy_version 769203 (0.0008) [2023-12-26 05:43:57,360][123091] Updated weights for policy 0, policy_version 769213 (0.0010) [2023-12-26 05:43:57,423][123091] Updated weights for policy 0, policy_version 769223 (0.0010) [2023-12-26 05:43:57,830][123090] Updated weights for policy 1, policy_version 764070 (0.0007) [2023-12-26 05:43:57,896][123090] Updated weights for policy 1, policy_version 764080 (0.0005) [2023-12-26 05:43:57,956][123090] Updated weights for policy 1, policy_version 764090 (0.0005) [2023-12-26 05:43:58,305][123091] Updated weights for policy 0, policy_version 769233 (0.0008) [2023-12-26 05:43:58,379][123091] Updated weights for policy 0, policy_version 769243 (0.0009) [2023-12-26 05:43:58,445][123091] Updated weights for policy 0, policy_version 769253 (0.0009) [2023-12-26 05:43:58,505][123091] Updated weights for policy 0, policy_version 769263 (0.0010) [2023-12-26 05:43:58,657][123090] Updated weights for policy 1, policy_version 764100 (0.0007) [2023-12-26 05:43:58,733][123090] Updated weights for policy 1, policy_version 764110 (0.0008) [2023-12-26 05:43:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 392544256. Throughput: 0: 9004.7, 1: 8492.9. Samples: 392541124. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:43:58,785][121949] Avg episode reward: [(0, '5760.915'), (1, '5487.982')] [2023-12-26 05:43:58,813][123090] Updated weights for policy 1, policy_version 764120 (0.0009) [2023-12-26 05:43:59,289][123091] Updated weights for policy 0, policy_version 769273 (0.0009) [2023-12-26 05:43:59,357][123091] Updated weights for policy 0, policy_version 769283 (0.0009) [2023-12-26 05:43:59,425][123091] Updated weights for policy 0, policy_version 769293 (0.0009) [2023-12-26 05:43:59,679][123090] Updated weights for policy 1, policy_version 764130 (0.0007) [2023-12-26 05:43:59,732][123090] Updated weights for policy 1, policy_version 764140 (0.0005) [2023-12-26 05:43:59,786][123090] Updated weights for policy 1, policy_version 764150 (0.0005) [2023-12-26 05:43:59,846][123090] Updated weights for policy 1, policy_version 764160 (0.0007) [2023-12-26 05:44:00,308][123091] Updated weights for policy 0, policy_version 769303 (0.0010) [2023-12-26 05:44:00,360][123091] Updated weights for policy 0, policy_version 769313 (0.0009) [2023-12-26 05:44:00,430][123091] Updated weights for policy 0, policy_version 769323 (0.0010) [2023-12-26 05:44:00,589][123090] Updated weights for policy 1, policy_version 764170 (0.0005) [2023-12-26 05:44:00,661][123090] Updated weights for policy 1, policy_version 764180 (0.0005) [2023-12-26 05:44:00,719][123090] Updated weights for policy 1, policy_version 764190 (0.0005) [2023-12-26 05:44:01,269][123091] Updated weights for policy 0, policy_version 769333 (0.0009) [2023-12-26 05:44:01,335][123091] Updated weights for policy 0, policy_version 769343 (0.0009) [2023-12-26 05:44:01,404][123091] Updated weights for policy 0, policy_version 769353 (0.0007) [2023-12-26 05:44:01,516][123090] Updated weights for policy 1, policy_version 764200 (0.0009) [2023-12-26 05:44:01,577][123090] Updated weights for policy 1, policy_version 764210 (0.0009) [2023-12-26 05:44:01,653][123090] Updated weights for policy 1, policy_version 764220 (0.0012) [2023-12-26 05:44:02,232][123091] Updated weights for policy 0, policy_version 769363 (0.0006) [2023-12-26 05:44:02,296][123091] Updated weights for policy 0, policy_version 769373 (0.0010) [2023-12-26 05:44:02,361][123091] Updated weights for policy 0, policy_version 769383 (0.0010) [2023-12-26 05:44:02,493][123090] Updated weights for policy 1, policy_version 764230 (0.0010) [2023-12-26 05:44:02,546][123090] Updated weights for policy 1, policy_version 764240 (0.0010) [2023-12-26 05:44:02,596][123090] Updated weights for policy 1, policy_version 764250 (0.0009) [2023-12-26 05:44:03,166][123091] Updated weights for policy 0, policy_version 769393 (0.0009) [2023-12-26 05:44:03,224][123091] Updated weights for policy 0, policy_version 769403 (0.0006) [2023-12-26 05:44:03,292][123091] Updated weights for policy 0, policy_version 769413 (0.0005) [2023-12-26 05:44:03,348][123091] Updated weights for policy 0, policy_version 769423 (0.0005) [2023-12-26 05:44:03,456][123090] Updated weights for policy 1, policy_version 764260 (0.0009) [2023-12-26 05:44:03,500][123090] Updated weights for policy 1, policy_version 764270 (0.0010) [2023-12-26 05:44:03,544][123090] Updated weights for policy 1, policy_version 764280 (0.0010) [2023-12-26 05:44:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 392634368. Throughput: 0: 8843.5, 1: 8585.1. Samples: 392644616. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:03,785][121949] Avg episode reward: [(0, '5728.219'), (1, '5418.022')] [2023-12-26 05:44:04,107][123091] Updated weights for policy 0, policy_version 769433 (0.0010) [2023-12-26 05:44:04,182][123091] Updated weights for policy 0, policy_version 769443 (0.0010) [2023-12-26 05:44:04,257][123091] Updated weights for policy 0, policy_version 769453 (0.0010) [2023-12-26 05:44:04,332][123090] Updated weights for policy 1, policy_version 764290 (0.0007) [2023-12-26 05:44:04,403][123090] Updated weights for policy 1, policy_version 764300 (0.0006) [2023-12-26 05:44:04,470][123090] Updated weights for policy 1, policy_version 764310 (0.0010) [2023-12-26 05:44:04,539][123090] Updated weights for policy 1, policy_version 764320 (0.0008) [2023-12-26 05:44:05,132][123090] Updated weights for policy 1, policy_version 764330 (0.0007) [2023-12-26 05:44:05,151][123091] Updated weights for policy 0, policy_version 769463 (0.0007) [2023-12-26 05:44:05,187][123090] Updated weights for policy 1, policy_version 764340 (0.0010) [2023-12-26 05:44:05,215][123091] Updated weights for policy 0, policy_version 769473 (0.0006) [2023-12-26 05:44:05,246][123090] Updated weights for policy 1, policy_version 764350 (0.0010) [2023-12-26 05:44:05,280][123091] Updated weights for policy 0, policy_version 769483 (0.0006) [2023-12-26 05:44:05,959][123090] Updated weights for policy 1, policy_version 764360 (0.0006) [2023-12-26 05:44:06,019][123090] Updated weights for policy 1, policy_version 764370 (0.0005) [2023-12-26 05:44:06,077][123090] Updated weights for policy 1, policy_version 764380 (0.0005) [2023-12-26 05:44:06,175][123091] Updated weights for policy 0, policy_version 769493 (0.0009) [2023-12-26 05:44:06,236][123091] Updated weights for policy 0, policy_version 769503 (0.0009) [2023-12-26 05:44:06,299][123091] Updated weights for policy 0, policy_version 769513 (0.0009) [2023-12-26 05:44:06,812][123090] Updated weights for policy 1, policy_version 764390 (0.0006) [2023-12-26 05:44:06,881][123090] Updated weights for policy 1, policy_version 764400 (0.0009) [2023-12-26 05:44:06,944][123090] Updated weights for policy 1, policy_version 764410 (0.0008) [2023-12-26 05:44:07,163][123091] Updated weights for policy 0, policy_version 769523 (0.0009) [2023-12-26 05:44:07,214][123091] Updated weights for policy 0, policy_version 769533 (0.0009) [2023-12-26 05:44:07,277][123091] Updated weights for policy 0, policy_version 769543 (0.0009) [2023-12-26 05:44:07,727][123090] Updated weights for policy 1, policy_version 764420 (0.0009) [2023-12-26 05:44:07,791][123090] Updated weights for policy 1, policy_version 764430 (0.0010) [2023-12-26 05:44:07,851][123090] Updated weights for policy 1, policy_version 764440 (0.0010) [2023-12-26 05:44:08,175][123091] Updated weights for policy 0, policy_version 769554 (0.0009) [2023-12-26 05:44:08,228][123091] Updated weights for policy 0, policy_version 769564 (0.0010) [2023-12-26 05:44:08,281][123091] Updated weights for policy 0, policy_version 769574 (0.0010) [2023-12-26 05:44:08,341][123091] Updated weights for policy 0, policy_version 769584 (0.0009) [2023-12-26 05:44:08,600][123090] Updated weights for policy 1, policy_version 764450 (0.0010) [2023-12-26 05:44:08,657][123090] Updated weights for policy 1, policy_version 764460 (0.0005) [2023-12-26 05:44:08,721][123090] Updated weights for policy 1, policy_version 764470 (0.0005) [2023-12-26 05:44:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 392716288. Throughput: 0: 8774.7, 1: 8726.0. Samples: 392697928. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:08,785][121949] Avg episode reward: [(0, '5760.866'), (1, '5483.437')] [2023-12-26 05:44:08,789][123090] Updated weights for policy 1, policy_version 764480 (0.0006) [2023-12-26 05:44:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000769584_197017600.pth... [2023-12-26 05:44:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000764480_195706880.pth... [2023-12-26 05:44:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000768560_196755456.pth [2023-12-26 05:44:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000763424_195436544.pth [2023-12-26 05:44:09,074][123091] Updated weights for policy 0, policy_version 769594 (0.0006) [2023-12-26 05:44:09,141][123091] Updated weights for policy 0, policy_version 769604 (0.0005) [2023-12-26 05:44:09,197][123091] Updated weights for policy 0, policy_version 769614 (0.0005) [2023-12-26 05:44:09,527][123090] Updated weights for policy 1, policy_version 764490 (0.0008) [2023-12-26 05:44:09,583][123090] Updated weights for policy 1, policy_version 764500 (0.0008) [2023-12-26 05:44:09,644][123090] Updated weights for policy 1, policy_version 764510 (0.0008) [2023-12-26 05:44:09,954][123091] Updated weights for policy 0, policy_version 769624 (0.0009) [2023-12-26 05:44:10,014][123091] Updated weights for policy 0, policy_version 769634 (0.0011) [2023-12-26 05:44:10,070][123091] Updated weights for policy 0, policy_version 769644 (0.0011) [2023-12-26 05:44:10,483][123090] Updated weights for policy 1, policy_version 764520 (0.0009) [2023-12-26 05:44:10,540][123090] Updated weights for policy 1, policy_version 764530 (0.0010) [2023-12-26 05:44:10,604][123090] Updated weights for policy 1, policy_version 764540 (0.0010) [2023-12-26 05:44:10,814][123091] Updated weights for policy 0, policy_version 769654 (0.0007) [2023-12-26 05:44:10,880][123091] Updated weights for policy 0, policy_version 769664 (0.0007) [2023-12-26 05:44:10,950][123091] Updated weights for policy 0, policy_version 769674 (0.0011) [2023-12-26 05:44:11,546][123090] Updated weights for policy 1, policy_version 764550 (0.0009) [2023-12-26 05:44:11,614][123090] Updated weights for policy 1, policy_version 764560 (0.0009) [2023-12-26 05:44:11,689][123090] Updated weights for policy 1, policy_version 764570 (0.0009) [2023-12-26 05:44:11,777][123091] Updated weights for policy 0, policy_version 769684 (0.0010) [2023-12-26 05:44:11,846][123091] Updated weights for policy 0, policy_version 769694 (0.0009) [2023-12-26 05:44:11,918][123091] Updated weights for policy 0, policy_version 769704 (0.0007) [2023-12-26 05:44:12,563][123090] Updated weights for policy 1, policy_version 764580 (0.0009) [2023-12-26 05:44:12,623][123090] Updated weights for policy 1, policy_version 764590 (0.0010) [2023-12-26 05:44:12,677][123090] Updated weights for policy 1, policy_version 764600 (0.0009) [2023-12-26 05:44:12,678][123091] Updated weights for policy 0, policy_version 769714 (0.0007) [2023-12-26 05:44:12,737][123091] Updated weights for policy 0, policy_version 769724 (0.0010) [2023-12-26 05:44:12,791][123091] Updated weights for policy 0, policy_version 769734 (0.0009) [2023-12-26 05:44:12,849][123091] Updated weights for policy 0, policy_version 769744 (0.0010) [2023-12-26 05:44:13,521][123090] Updated weights for policy 1, policy_version 764610 (0.0007) [2023-12-26 05:44:13,576][123090] Updated weights for policy 1, policy_version 764620 (0.0009) [2023-12-26 05:44:13,634][123090] Updated weights for policy 1, policy_version 764630 (0.0009) [2023-12-26 05:44:13,695][123090] Updated weights for policy 1, policy_version 764640 (0.0008) [2023-12-26 05:44:13,697][123091] Updated weights for policy 0, policy_version 769754 (0.0008) [2023-12-26 05:44:13,748][123091] Updated weights for policy 0, policy_version 769764 (0.0009) [2023-12-26 05:44:13,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 392806400. Throughput: 0: 8802.1, 1: 8743.5. Samples: 392802976. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:13,786][121949] Avg episode reward: [(0, '5692.605'), (1, '5485.915')] [2023-12-26 05:44:13,804][123091] Updated weights for policy 0, policy_version 769774 (0.0010) [2023-12-26 05:44:14,431][123090] Updated weights for policy 1, policy_version 764650 (0.0005) [2023-12-26 05:44:14,505][123090] Updated weights for policy 1, policy_version 764660 (0.0007) [2023-12-26 05:44:14,578][123090] Updated weights for policy 1, policy_version 764670 (0.0005) [2023-12-26 05:44:14,637][123091] Updated weights for policy 0, policy_version 769784 (0.0007) [2023-12-26 05:44:14,687][123091] Updated weights for policy 0, policy_version 769794 (0.0005) [2023-12-26 05:44:14,748][123091] Updated weights for policy 0, policy_version 769804 (0.0005) [2023-12-26 05:44:15,235][123090] Updated weights for policy 1, policy_version 764680 (0.0010) [2023-12-26 05:44:15,300][123090] Updated weights for policy 1, policy_version 764690 (0.0011) [2023-12-26 05:44:15,364][123090] Updated weights for policy 1, policy_version 764700 (0.0011) [2023-12-26 05:44:15,538][123091] Updated weights for policy 0, policy_version 769814 (0.0009) [2023-12-26 05:44:15,595][123091] Updated weights for policy 0, policy_version 769825 (0.0009) [2023-12-26 05:44:15,657][123091] Updated weights for policy 0, policy_version 769835 (0.0009) [2023-12-26 05:44:16,184][123090] Updated weights for policy 1, policy_version 764710 (0.0011) [2023-12-26 05:44:16,236][123090] Updated weights for policy 1, policy_version 764720 (0.0010) [2023-12-26 05:44:16,288][123090] Updated weights for policy 1, policy_version 764730 (0.0010) [2023-12-26 05:44:16,412][123091] Updated weights for policy 0, policy_version 769845 (0.0008) [2023-12-26 05:44:16,459][123091] Updated weights for policy 0, policy_version 769855 (0.0005) [2023-12-26 05:44:16,510][123091] Updated weights for policy 0, policy_version 769865 (0.0005) [2023-12-26 05:44:17,020][123090] Updated weights for policy 1, policy_version 764740 (0.0010) [2023-12-26 05:44:17,090][123090] Updated weights for policy 1, policy_version 764750 (0.0010) [2023-12-26 05:44:17,169][123090] Updated weights for policy 1, policy_version 764760 (0.0009) [2023-12-26 05:44:17,177][123091] Updated weights for policy 0, policy_version 769875 (0.0006) [2023-12-26 05:44:17,231][123091] Updated weights for policy 0, policy_version 769885 (0.0008) [2023-12-26 05:44:17,279][123091] Updated weights for policy 0, policy_version 769895 (0.0009) [2023-12-26 05:44:17,955][123091] Updated weights for policy 0, policy_version 769905 (0.0009) [2023-12-26 05:44:18,002][123091] Updated weights for policy 0, policy_version 769915 (0.0005) [2023-12-26 05:44:18,045][123090] Updated weights for policy 1, policy_version 764770 (0.0010) [2023-12-26 05:44:18,050][123091] Updated weights for policy 0, policy_version 769925 (0.0008) [2023-12-26 05:44:18,102][123090] Updated weights for policy 1, policy_version 764780 (0.0008) [2023-12-26 05:44:18,104][123091] Updated weights for policy 0, policy_version 769935 (0.0007) [2023-12-26 05:44:18,151][123090] Updated weights for policy 1, policy_version 764790 (0.0008) [2023-12-26 05:44:18,202][123090] Updated weights for policy 1, policy_version 764800 (0.0008) [2023-12-26 05:44:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 392896512. Throughput: 0: 8841.9, 1: 8818.4. Samples: 392911464. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:18,785][121949] Avg episode reward: [(0, '5667.487'), (1, '5222.812')] [2023-12-26 05:44:18,942][123091] Updated weights for policy 0, policy_version 769945 (0.0010) [2023-12-26 05:44:18,993][123091] Updated weights for policy 0, policy_version 769955 (0.0010) [2023-12-26 05:44:19,026][123090] Updated weights for policy 1, policy_version 764810 (0.0005) [2023-12-26 05:44:19,044][123091] Updated weights for policy 0, policy_version 769965 (0.0010) [2023-12-26 05:44:19,075][123090] Updated weights for policy 1, policy_version 764820 (0.0008) [2023-12-26 05:44:19,123][123090] Updated weights for policy 1, policy_version 764830 (0.0009) [2023-12-26 05:44:19,888][123091] Updated weights for policy 0, policy_version 769975 (0.0010) [2023-12-26 05:44:19,958][123091] Updated weights for policy 0, policy_version 769985 (0.0008) [2023-12-26 05:44:20,006][123090] Updated weights for policy 1, policy_version 764840 (0.0009) [2023-12-26 05:44:20,028][123091] Updated weights for policy 0, policy_version 769995 (0.0008) [2023-12-26 05:44:20,072][123090] Updated weights for policy 1, policy_version 764850 (0.0010) [2023-12-26 05:44:20,133][123090] Updated weights for policy 1, policy_version 764860 (0.0010) [2023-12-26 05:44:20,784][123091] Updated weights for policy 0, policy_version 770005 (0.0009) [2023-12-26 05:44:20,853][123091] Updated weights for policy 0, policy_version 770015 (0.0009) [2023-12-26 05:44:20,934][123091] Updated weights for policy 0, policy_version 770025 (0.0008) [2023-12-26 05:44:20,989][123090] Updated weights for policy 1, policy_version 764870 (0.0007) [2023-12-26 05:44:21,058][123090] Updated weights for policy 1, policy_version 764880 (0.0007) [2023-12-26 05:44:21,128][123090] Updated weights for policy 1, policy_version 764890 (0.0009) [2023-12-26 05:44:21,762][123091] Updated weights for policy 0, policy_version 770035 (0.0008) [2023-12-26 05:44:21,830][123091] Updated weights for policy 0, policy_version 770045 (0.0005) [2023-12-26 05:44:21,900][123091] Updated weights for policy 0, policy_version 770055 (0.0006) [2023-12-26 05:44:21,921][123090] Updated weights for policy 1, policy_version 764900 (0.0009) [2023-12-26 05:44:21,978][123090] Updated weights for policy 1, policy_version 764910 (0.0008) [2023-12-26 05:44:22,037][123090] Updated weights for policy 1, policy_version 764920 (0.0010) [2023-12-26 05:44:22,654][123091] Updated weights for policy 0, policy_version 770065 (0.0007) [2023-12-26 05:44:22,721][123091] Updated weights for policy 0, policy_version 770075 (0.0010) [2023-12-26 05:44:22,788][123091] Updated weights for policy 0, policy_version 770085 (0.0010) [2023-12-26 05:44:22,849][123091] Updated weights for policy 0, policy_version 770095 (0.0010) [2023-12-26 05:44:22,930][123090] Updated weights for policy 1, policy_version 764930 (0.0010) [2023-12-26 05:44:22,990][123090] Updated weights for policy 1, policy_version 764940 (0.0009) [2023-12-26 05:44:23,045][123090] Updated weights for policy 1, policy_version 764950 (0.0009) [2023-12-26 05:44:23,098][123090] Updated weights for policy 1, policy_version 764960 (0.0009) [2023-12-26 05:44:23,660][123091] Updated weights for policy 0, policy_version 770105 (0.0010) [2023-12-26 05:44:23,725][123091] Updated weights for policy 0, policy_version 770115 (0.0010) [2023-12-26 05:44:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 392978432. Throughput: 0: 8793.6, 1: 8845.9. Samples: 392963188. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:23,785][121949] Avg episode reward: [(0, '5835.092'), (1, '4987.587')] [2023-12-26 05:44:23,792][123091] Updated weights for policy 0, policy_version 770125 (0.0008) [2023-12-26 05:44:23,809][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000770128_197156864.pth... [2023-12-26 05:44:23,813][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000769104_196894720.pth [2023-12-26 05:44:23,818][123090] Updated weights for policy 1, policy_version 764970 (0.0011) [2023-12-26 05:44:23,875][123090] Updated weights for policy 1, policy_version 764980 (0.0010) [2023-12-26 05:44:23,931][123090] Updated weights for policy 1, policy_version 764990 (0.0010) [2023-12-26 05:44:23,939][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000764992_195837952.pth... [2023-12-26 05:44:23,942][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000763936_195567616.pth [2023-12-26 05:44:24,612][123090] Updated weights for policy 1, policy_version 765000 (0.0006) [2023-12-26 05:44:24,677][123090] Updated weights for policy 1, policy_version 765010 (0.0006) [2023-12-26 05:44:24,701][123091] Updated weights for policy 0, policy_version 770135 (0.0010) [2023-12-26 05:44:24,743][123090] Updated weights for policy 1, policy_version 765020 (0.0005) [2023-12-26 05:44:24,756][123091] Updated weights for policy 0, policy_version 770145 (0.0010) [2023-12-26 05:44:24,811][123091] Updated weights for policy 0, policy_version 770155 (0.0010) [2023-12-26 05:44:25,341][123090] Updated weights for policy 1, policy_version 765030 (0.0005) [2023-12-26 05:44:25,389][123090] Updated weights for policy 1, policy_version 765040 (0.0008) [2023-12-26 05:44:25,437][123090] Updated weights for policy 1, policy_version 765050 (0.0008) [2023-12-26 05:44:25,640][123091] Updated weights for policy 0, policy_version 770165 (0.0010) [2023-12-26 05:44:25,687][123091] Updated weights for policy 0, policy_version 770175 (0.0010) [2023-12-26 05:44:25,734][123091] Updated weights for policy 0, policy_version 770185 (0.0010) [2023-12-26 05:44:26,212][123090] Updated weights for policy 1, policy_version 765060 (0.0007) [2023-12-26 05:44:26,280][123090] Updated weights for policy 1, policy_version 765070 (0.0009) [2023-12-26 05:44:26,349][123090] Updated weights for policy 1, policy_version 765080 (0.0009) [2023-12-26 05:44:26,510][123091] Updated weights for policy 0, policy_version 770195 (0.0010) [2023-12-26 05:44:26,564][123091] Updated weights for policy 0, policy_version 770205 (0.0009) [2023-12-26 05:44:26,617][123091] Updated weights for policy 0, policy_version 770215 (0.0010) [2023-12-26 05:44:27,185][123090] Updated weights for policy 1, policy_version 765090 (0.0009) [2023-12-26 05:44:27,243][123090] Updated weights for policy 1, policy_version 765101 (0.0010) [2023-12-26 05:44:27,298][123090] Updated weights for policy 1, policy_version 765111 (0.0009) [2023-12-26 05:44:27,369][123091] Updated weights for policy 0, policy_version 770225 (0.0010) [2023-12-26 05:44:27,429][123091] Updated weights for policy 0, policy_version 770235 (0.0009) [2023-12-26 05:44:27,484][123091] Updated weights for policy 0, policy_version 770245 (0.0009) [2023-12-26 05:44:27,539][123091] Updated weights for policy 0, policy_version 770255 (0.0008) [2023-12-26 05:44:28,136][123091] Updated weights for policy 0, policy_version 770265 (0.0006) [2023-12-26 05:44:28,175][123090] Updated weights for policy 1, policy_version 765121 (0.0008) [2023-12-26 05:44:28,203][123091] Updated weights for policy 0, policy_version 770275 (0.0008) [2023-12-26 05:44:28,224][123090] Updated weights for policy 1, policy_version 765131 (0.0008) [2023-12-26 05:44:28,269][123091] Updated weights for policy 0, policy_version 770285 (0.0010) [2023-12-26 05:44:28,285][123090] Updated weights for policy 1, policy_version 765141 (0.0006) [2023-12-26 05:44:28,358][123090] Updated weights for policy 1, policy_version 765151 (0.0009) [2023-12-26 05:44:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 393076736. Throughput: 0: 8848.0, 1: 8925.0. Samples: 393070500. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:28,785][121949] Avg episode reward: [(0, '5825.656'), (1, '5029.795')] [2023-12-26 05:44:29,070][123091] Updated weights for policy 0, policy_version 770295 (0.0007) [2023-12-26 05:44:29,149][123091] Updated weights for policy 0, policy_version 770305 (0.0007) [2023-12-26 05:44:29,208][123090] Updated weights for policy 1, policy_version 765161 (0.0008) [2023-12-26 05:44:29,212][123091] Updated weights for policy 0, policy_version 770315 (0.0009) [2023-12-26 05:44:29,276][123090] Updated weights for policy 1, policy_version 765171 (0.0009) [2023-12-26 05:44:29,345][123090] Updated weights for policy 1, policy_version 765181 (0.0009) [2023-12-26 05:44:29,946][123091] Updated weights for policy 0, policy_version 770325 (0.0009) [2023-12-26 05:44:30,003][123091] Updated weights for policy 0, policy_version 770335 (0.0009) [2023-12-26 05:44:30,064][123091] Updated weights for policy 0, policy_version 770345 (0.0009) [2023-12-26 05:44:30,128][123090] Updated weights for policy 1, policy_version 765191 (0.0010) [2023-12-26 05:44:30,191][123090] Updated weights for policy 1, policy_version 765201 (0.0010) [2023-12-26 05:44:30,256][123090] Updated weights for policy 1, policy_version 765211 (0.0009) [2023-12-26 05:44:30,757][123091] Updated weights for policy 0, policy_version 770355 (0.0008) [2023-12-26 05:44:30,807][123091] Updated weights for policy 0, policy_version 770365 (0.0005) [2023-12-26 05:44:30,864][123091] Updated weights for policy 0, policy_version 770375 (0.0005) [2023-12-26 05:44:30,994][123090] Updated weights for policy 1, policy_version 765221 (0.0008) [2023-12-26 05:44:31,059][123090] Updated weights for policy 1, policy_version 765231 (0.0007) [2023-12-26 05:44:31,118][123090] Updated weights for policy 1, policy_version 765241 (0.0006) [2023-12-26 05:44:31,652][123091] Updated weights for policy 0, policy_version 770385 (0.0006) [2023-12-26 05:44:31,721][123091] Updated weights for policy 0, policy_version 770395 (0.0007) [2023-12-26 05:44:31,792][123091] Updated weights for policy 0, policy_version 770405 (0.0010) [2023-12-26 05:44:31,847][123091] Updated weights for policy 0, policy_version 770415 (0.0009) [2023-12-26 05:44:31,877][123090] Updated weights for policy 1, policy_version 765251 (0.0009) [2023-12-26 05:44:31,936][123090] Updated weights for policy 1, policy_version 765261 (0.0008) [2023-12-26 05:44:31,994][123090] Updated weights for policy 1, policy_version 765271 (0.0009) [2023-12-26 05:44:32,685][123091] Updated weights for policy 0, policy_version 770425 (0.0010) [2023-12-26 05:44:32,756][123091] Updated weights for policy 0, policy_version 770435 (0.0011) [2023-12-26 05:44:32,800][123090] Updated weights for policy 1, policy_version 765281 (0.0009) [2023-12-26 05:44:32,820][123091] Updated weights for policy 0, policy_version 770445 (0.0011) [2023-12-26 05:44:32,866][123090] Updated weights for policy 1, policy_version 765291 (0.0007) [2023-12-26 05:44:32,920][123090] Updated weights for policy 1, policy_version 765301 (0.0009) [2023-12-26 05:44:32,978][123090] Updated weights for policy 1, policy_version 765311 (0.0010) [2023-12-26 05:44:33,443][123091] Updated weights for policy 0, policy_version 770455 (0.0007) [2023-12-26 05:44:33,501][123091] Updated weights for policy 0, policy_version 770465 (0.0005) [2023-12-26 05:44:33,573][123091] Updated weights for policy 0, policy_version 770475 (0.0005) [2023-12-26 05:44:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 393166848. Throughput: 0: 8878.4, 1: 8798.0. Samples: 393178580. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:33,785][121949] Avg episode reward: [(0, '5813.121'), (1, '4787.416')] [2023-12-26 05:44:33,900][123090] Updated weights for policy 1, policy_version 765321 (0.0010) [2023-12-26 05:44:33,974][123090] Updated weights for policy 1, policy_version 765331 (0.0006) [2023-12-26 05:44:34,043][123090] Updated weights for policy 1, policy_version 765341 (0.0005) [2023-12-26 05:44:34,145][123091] Updated weights for policy 0, policy_version 770485 (0.0006) [2023-12-26 05:44:34,205][123091] Updated weights for policy 0, policy_version 770495 (0.0007) [2023-12-26 05:44:34,280][123091] Updated weights for policy 0, policy_version 770505 (0.0006) [2023-12-26 05:44:34,843][123090] Updated weights for policy 1, policy_version 765351 (0.0007) [2023-12-26 05:44:34,898][123090] Updated weights for policy 1, policy_version 765361 (0.0009) [2023-12-26 05:44:34,956][123090] Updated weights for policy 1, policy_version 765371 (0.0010) [2023-12-26 05:44:35,051][123091] Updated weights for policy 0, policy_version 770515 (0.0009) [2023-12-26 05:44:35,120][123091] Updated weights for policy 0, policy_version 770525 (0.0006) [2023-12-26 05:44:35,192][123091] Updated weights for policy 0, policy_version 770535 (0.0006) [2023-12-26 05:44:35,873][123090] Updated weights for policy 1, policy_version 765381 (0.0008) [2023-12-26 05:44:35,903][123091] Updated weights for policy 0, policy_version 770545 (0.0006) [2023-12-26 05:44:35,923][123090] Updated weights for policy 1, policy_version 765391 (0.0005) [2023-12-26 05:44:35,962][123091] Updated weights for policy 0, policy_version 770555 (0.0010) [2023-12-26 05:44:35,974][123090] Updated weights for policy 1, policy_version 765401 (0.0008) [2023-12-26 05:44:36,016][123091] Updated weights for policy 0, policy_version 770565 (0.0008) [2023-12-26 05:44:36,074][123091] Updated weights for policy 0, policy_version 770575 (0.0005) [2023-12-26 05:44:36,765][123090] Updated weights for policy 1, policy_version 765411 (0.0007) [2023-12-26 05:44:36,828][123090] Updated weights for policy 1, policy_version 765421 (0.0009) [2023-12-26 05:44:36,885][123090] Updated weights for policy 1, policy_version 765431 (0.0006) [2023-12-26 05:44:36,885][123091] Updated weights for policy 0, policy_version 770585 (0.0010) [2023-12-26 05:44:36,948][123091] Updated weights for policy 0, policy_version 770595 (0.0011) [2023-12-26 05:44:37,017][123091] Updated weights for policy 0, policy_version 770605 (0.0010) [2023-12-26 05:44:37,739][123090] Updated weights for policy 1, policy_version 765441 (0.0009) [2023-12-26 05:44:37,795][123090] Updated weights for policy 1, policy_version 765451 (0.0010) [2023-12-26 05:44:37,828][123091] Updated weights for policy 0, policy_version 770615 (0.0009) [2023-12-26 05:44:37,858][123090] Updated weights for policy 1, policy_version 765461 (0.0008) [2023-12-26 05:44:37,892][123091] Updated weights for policy 0, policy_version 770625 (0.0009) [2023-12-26 05:44:37,922][123090] Updated weights for policy 1, policy_version 765471 (0.0009) [2023-12-26 05:44:37,952][123091] Updated weights for policy 0, policy_version 770635 (0.0009) [2023-12-26 05:44:38,777][123090] Updated weights for policy 1, policy_version 765481 (0.0009) [2023-12-26 05:44:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 393248768. Throughput: 0: 8916.6, 1: 8791.4. Samples: 393233320. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:38,784][121949] Avg episode reward: [(0, '5793.094'), (1, '4484.583')] [2023-12-26 05:44:38,788][123091] Updated weights for policy 0, policy_version 770645 (0.0009) [2023-12-26 05:44:38,832][123090] Updated weights for policy 1, policy_version 765491 (0.0008) [2023-12-26 05:44:38,847][123091] Updated weights for policy 0, policy_version 770655 (0.0008) [2023-12-26 05:44:38,897][123090] Updated weights for policy 1, policy_version 765501 (0.0008) [2023-12-26 05:44:38,899][123091] Updated weights for policy 0, policy_version 770665 (0.0007) [2023-12-26 05:44:38,911][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000765504_195969024.pth... [2023-12-26 05:44:38,916][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000764480_195706880.pth [2023-12-26 05:44:38,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000770672_197296128.pth... [2023-12-26 05:44:38,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000769584_197017600.pth [2023-12-26 05:44:39,717][123090] Updated weights for policy 1, policy_version 765511 (0.0010) [2023-12-26 05:44:39,724][123091] Updated weights for policy 0, policy_version 770675 (0.0008) [2023-12-26 05:44:39,785][123090] Updated weights for policy 1, policy_version 765521 (0.0009) [2023-12-26 05:44:39,794][123091] Updated weights for policy 0, policy_version 770685 (0.0010) [2023-12-26 05:44:39,854][123090] Updated weights for policy 1, policy_version 765531 (0.0010) [2023-12-26 05:44:39,857][123091] Updated weights for policy 0, policy_version 770695 (0.0009) [2023-12-26 05:44:40,653][123091] Updated weights for policy 0, policy_version 770705 (0.0009) [2023-12-26 05:44:40,698][123090] Updated weights for policy 1, policy_version 765541 (0.0008) [2023-12-26 05:44:40,712][123091] Updated weights for policy 0, policy_version 770715 (0.0008) [2023-12-26 05:44:40,762][123090] Updated weights for policy 1, policy_version 765551 (0.0008) [2023-12-26 05:44:40,778][123091] Updated weights for policy 0, policy_version 770725 (0.0008) [2023-12-26 05:44:40,820][123090] Updated weights for policy 1, policy_version 765561 (0.0008) [2023-12-26 05:44:40,826][123091] Updated weights for policy 0, policy_version 770735 (0.0009) [2023-12-26 05:44:41,653][123090] Updated weights for policy 1, policy_version 765571 (0.0009) [2023-12-26 05:44:41,727][123091] Updated weights for policy 0, policy_version 770745 (0.0007) [2023-12-26 05:44:41,729][123090] Updated weights for policy 1, policy_version 765581 (0.0009) [2023-12-26 05:44:41,801][123091] Updated weights for policy 0, policy_version 770755 (0.0009) [2023-12-26 05:44:41,804][123090] Updated weights for policy 1, policy_version 765591 (0.0009) [2023-12-26 05:44:41,868][123091] Updated weights for policy 0, policy_version 770765 (0.0010) [2023-12-26 05:44:42,580][123090] Updated weights for policy 1, policy_version 765601 (0.0007) [2023-12-26 05:44:42,646][123090] Updated weights for policy 1, policy_version 765611 (0.0009) [2023-12-26 05:44:42,694][123091] Updated weights for policy 0, policy_version 770775 (0.0010) [2023-12-26 05:44:42,710][123090] Updated weights for policy 1, policy_version 765621 (0.0008) [2023-12-26 05:44:42,758][123091] Updated weights for policy 0, policy_version 770785 (0.0008) [2023-12-26 05:44:42,773][123090] Updated weights for policy 1, policy_version 765631 (0.0009) [2023-12-26 05:44:42,815][123091] Updated weights for policy 0, policy_version 770795 (0.0008) [2023-12-26 05:44:43,461][123090] Updated weights for policy 1, policy_version 765641 (0.0006) [2023-12-26 05:44:43,507][123090] Updated weights for policy 1, policy_version 765651 (0.0005) [2023-12-26 05:44:43,555][123090] Updated weights for policy 1, policy_version 765661 (0.0005) [2023-12-26 05:44:43,730][123091] Updated weights for policy 0, policy_version 770805 (0.0009) [2023-12-26 05:44:43,780][123091] Updated weights for policy 0, policy_version 770815 (0.0009) [2023-12-26 05:44:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 393338880. Throughput: 0: 8835.4, 1: 8783.3. Samples: 393333964. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:43,785][121949] Avg episode reward: [(0, '5689.705'), (1, '5059.573')] [2023-12-26 05:44:43,834][123091] Updated weights for policy 0, policy_version 770825 (0.0010) [2023-12-26 05:44:44,222][123090] Updated weights for policy 1, policy_version 765671 (0.0008) [2023-12-26 05:44:44,276][123090] Updated weights for policy 1, policy_version 765681 (0.0009) [2023-12-26 05:44:44,341][123090] Updated weights for policy 1, policy_version 765691 (0.0009) [2023-12-26 05:44:44,653][123091] Updated weights for policy 0, policy_version 770836 (0.0008) [2023-12-26 05:44:44,700][123091] Updated weights for policy 0, policy_version 770846 (0.0005) [2023-12-26 05:44:44,760][123091] Updated weights for policy 0, policy_version 770856 (0.0006) [2023-12-26 05:44:45,176][123090] Updated weights for policy 1, policy_version 765701 (0.0007) [2023-12-26 05:44:45,228][123090] Updated weights for policy 1, policy_version 765711 (0.0008) [2023-12-26 05:44:45,283][123090] Updated weights for policy 1, policy_version 765721 (0.0009) [2023-12-26 05:44:45,599][123091] Updated weights for policy 0, policy_version 770866 (0.0010) [2023-12-26 05:44:45,661][123091] Updated weights for policy 0, policy_version 770876 (0.0009) [2023-12-26 05:44:45,718][123091] Updated weights for policy 0, policy_version 770886 (0.0009) [2023-12-26 05:44:45,784][123091] Updated weights for policy 0, policy_version 770896 (0.0010) [2023-12-26 05:44:46,103][123090] Updated weights for policy 1, policy_version 765731 (0.0009) [2023-12-26 05:44:46,169][123090] Updated weights for policy 1, policy_version 765741 (0.0008) [2023-12-26 05:44:46,227][123090] Updated weights for policy 1, policy_version 765751 (0.0006) [2023-12-26 05:44:46,679][123091] Updated weights for policy 0, policy_version 770906 (0.0010) [2023-12-26 05:44:46,744][123091] Updated weights for policy 0, policy_version 770916 (0.0009) [2023-12-26 05:44:46,806][123091] Updated weights for policy 0, policy_version 770926 (0.0010) [2023-12-26 05:44:46,939][123090] Updated weights for policy 1, policy_version 765761 (0.0006) [2023-12-26 05:44:47,006][123090] Updated weights for policy 1, policy_version 765771 (0.0005) [2023-12-26 05:44:47,067][123090] Updated weights for policy 1, policy_version 765781 (0.0005) [2023-12-26 05:44:47,128][123090] Updated weights for policy 1, policy_version 765791 (0.0005) [2023-12-26 05:44:47,636][123091] Updated weights for policy 0, policy_version 770936 (0.0010) [2023-12-26 05:44:47,703][123091] Updated weights for policy 0, policy_version 770946 (0.0009) [2023-12-26 05:44:47,710][123090] Updated weights for policy 1, policy_version 765801 (0.0005) [2023-12-26 05:44:47,761][123090] Updated weights for policy 1, policy_version 765811 (0.0007) [2023-12-26 05:44:47,770][123091] Updated weights for policy 0, policy_version 770956 (0.0010) [2023-12-26 05:44:47,823][123090] Updated weights for policy 1, policy_version 765821 (0.0008) [2023-12-26 05:44:48,531][123091] Updated weights for policy 0, policy_version 770966 (0.0010) [2023-12-26 05:44:48,595][123091] Updated weights for policy 0, policy_version 770976 (0.0010) [2023-12-26 05:44:48,659][123091] Updated weights for policy 0, policy_version 770986 (0.0008) [2023-12-26 05:44:48,674][123090] Updated weights for policy 1, policy_version 765831 (0.0008) [2023-12-26 05:44:48,731][123090] Updated weights for policy 1, policy_version 765841 (0.0008) [2023-12-26 05:44:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 393428992. Throughput: 0: 8839.1, 1: 8877.2. Samples: 393441852. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:48,785][121949] Avg episode reward: [(0, '5629.101'), (1, '5340.304')] [2023-12-26 05:44:48,794][123090] Updated weights for policy 1, policy_version 765851 (0.0010) [2023-12-26 05:44:49,492][123091] Updated weights for policy 0, policy_version 770996 (0.0009) [2023-12-26 05:44:49,555][123091] Updated weights for policy 0, policy_version 771006 (0.0009) [2023-12-26 05:44:49,573][123090] Updated weights for policy 1, policy_version 765861 (0.0008) [2023-12-26 05:44:49,615][123091] Updated weights for policy 0, policy_version 771016 (0.0007) [2023-12-26 05:44:49,622][123090] Updated weights for policy 1, policy_version 765871 (0.0008) [2023-12-26 05:44:49,678][123090] Updated weights for policy 1, policy_version 765881 (0.0010) [2023-12-26 05:44:50,374][123091] Updated weights for policy 0, policy_version 771026 (0.0008) [2023-12-26 05:44:50,425][123091] Updated weights for policy 0, policy_version 771036 (0.0009) [2023-12-26 05:44:50,488][123091] Updated weights for policy 0, policy_version 771046 (0.0008) [2023-12-26 05:44:50,548][123091] Updated weights for policy 0, policy_version 771056 (0.0010) [2023-12-26 05:44:50,605][123090] Updated weights for policy 1, policy_version 765891 (0.0009) [2023-12-26 05:44:50,667][123090] Updated weights for policy 1, policy_version 765901 (0.0007) [2023-12-26 05:44:50,722][123090] Updated weights for policy 1, policy_version 765911 (0.0009) [2023-12-26 05:44:51,431][123091] Updated weights for policy 0, policy_version 771066 (0.0010) [2023-12-26 05:44:51,500][123091] Updated weights for policy 0, policy_version 771076 (0.0008) [2023-12-26 05:44:51,544][123090] Updated weights for policy 1, policy_version 765921 (0.0009) [2023-12-26 05:44:51,571][123091] Updated weights for policy 0, policy_version 771086 (0.0010) [2023-12-26 05:44:51,609][123090] Updated weights for policy 1, policy_version 765931 (0.0007) [2023-12-26 05:44:51,677][123090] Updated weights for policy 1, policy_version 765941 (0.0008) [2023-12-26 05:44:51,747][123090] Updated weights for policy 1, policy_version 765951 (0.0008) [2023-12-26 05:44:52,377][123091] Updated weights for policy 0, policy_version 771096 (0.0009) [2023-12-26 05:44:52,434][123091] Updated weights for policy 0, policy_version 771106 (0.0009) [2023-12-26 05:44:52,494][123091] Updated weights for policy 0, policy_version 771116 (0.0010) [2023-12-26 05:44:52,566][123090] Updated weights for policy 1, policy_version 765961 (0.0010) [2023-12-26 05:44:52,634][123090] Updated weights for policy 1, policy_version 765971 (0.0009) [2023-12-26 05:44:52,700][123090] Updated weights for policy 1, policy_version 765981 (0.0009) [2023-12-26 05:44:53,323][123091] Updated weights for policy 0, policy_version 771126 (0.0010) [2023-12-26 05:44:53,387][123091] Updated weights for policy 0, policy_version 771136 (0.0009) [2023-12-26 05:44:53,449][123091] Updated weights for policy 0, policy_version 771146 (0.0009) [2023-12-26 05:44:53,501][123090] Updated weights for policy 1, policy_version 765991 (0.0006) [2023-12-26 05:44:53,566][123090] Updated weights for policy 1, policy_version 766001 (0.0005) [2023-12-26 05:44:53,630][123090] Updated weights for policy 1, policy_version 766011 (0.0005) [2023-12-26 05:44:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 393519104. Throughput: 0: 8883.4, 1: 8785.5. Samples: 393493028. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:53,785][121949] Avg episode reward: [(0, '5805.966'), (1, '5415.859')] [2023-12-26 05:44:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000771152_197419008.pth... [2023-12-26 05:44:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000766016_196100096.pth... [2023-12-26 05:44:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000770128_197156864.pth [2023-12-26 05:44:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000764992_195837952.pth [2023-12-26 05:44:54,197][123091] Updated weights for policy 0, policy_version 771156 (0.0007) [2023-12-26 05:44:54,252][123091] Updated weights for policy 0, policy_version 771166 (0.0005) [2023-12-26 05:44:54,308][123091] Updated weights for policy 0, policy_version 771176 (0.0005) [2023-12-26 05:44:54,422][123090] Updated weights for policy 1, policy_version 766021 (0.0007) [2023-12-26 05:44:54,483][123090] Updated weights for policy 1, policy_version 766031 (0.0008) [2023-12-26 05:44:54,541][123090] Updated weights for policy 1, policy_version 766041 (0.0008) [2023-12-26 05:44:55,028][123091] Updated weights for policy 0, policy_version 771186 (0.0006) [2023-12-26 05:44:55,089][123091] Updated weights for policy 0, policy_version 771196 (0.0010) [2023-12-26 05:44:55,152][123091] Updated weights for policy 0, policy_version 771206 (0.0010) [2023-12-26 05:44:55,223][123091] Updated weights for policy 0, policy_version 771216 (0.0009) [2023-12-26 05:44:55,371][123090] Updated weights for policy 1, policy_version 766051 (0.0009) [2023-12-26 05:44:55,438][123090] Updated weights for policy 1, policy_version 766061 (0.0009) [2023-12-26 05:44:55,504][123090] Updated weights for policy 1, policy_version 766071 (0.0009) [2023-12-26 05:44:56,062][123091] Updated weights for policy 0, policy_version 771226 (0.0009) [2023-12-26 05:44:56,123][123091] Updated weights for policy 0, policy_version 771236 (0.0009) [2023-12-26 05:44:56,184][123091] Updated weights for policy 0, policy_version 771246 (0.0009) [2023-12-26 05:44:56,253][123090] Updated weights for policy 1, policy_version 766081 (0.0008) [2023-12-26 05:44:56,311][123090] Updated weights for policy 1, policy_version 766091 (0.0006) [2023-12-26 05:44:56,372][123090] Updated weights for policy 1, policy_version 766101 (0.0010) [2023-12-26 05:44:56,434][123090] Updated weights for policy 1, policy_version 766111 (0.0011) [2023-12-26 05:44:57,032][123091] Updated weights for policy 0, policy_version 771256 (0.0010) [2023-12-26 05:44:57,085][123091] Updated weights for policy 0, policy_version 771266 (0.0009) [2023-12-26 05:44:57,130][123090] Updated weights for policy 1, policy_version 766121 (0.0009) [2023-12-26 05:44:57,136][123091] Updated weights for policy 0, policy_version 771276 (0.0006) [2023-12-26 05:44:57,198][123090] Updated weights for policy 1, policy_version 766131 (0.0009) [2023-12-26 05:44:57,265][123090] Updated weights for policy 1, policy_version 766141 (0.0010) [2023-12-26 05:44:57,937][123090] Updated weights for policy 1, policy_version 766151 (0.0006) [2023-12-26 05:44:57,968][123091] Updated weights for policy 0, policy_version 771286 (0.0007) [2023-12-26 05:44:58,005][123090] Updated weights for policy 1, policy_version 766161 (0.0009) [2023-12-26 05:44:58,030][123091] Updated weights for policy 0, policy_version 771296 (0.0007) [2023-12-26 05:44:58,076][123090] Updated weights for policy 1, policy_version 766171 (0.0009) [2023-12-26 05:44:58,096][123091] Updated weights for policy 0, policy_version 771306 (0.0008) [2023-12-26 05:44:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 393601024. Throughput: 0: 8876.0, 1: 8815.7. Samples: 393599096. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:44:58,785][121949] Avg episode reward: [(0, '5865.526'), (1, '5223.934')] [2023-12-26 05:44:58,976][123090] Updated weights for policy 1, policy_version 766181 (0.0010) [2023-12-26 05:44:59,011][123091] Updated weights for policy 0, policy_version 771316 (0.0009) [2023-12-26 05:44:59,035][123090] Updated weights for policy 1, policy_version 766191 (0.0009) [2023-12-26 05:44:59,067][123091] Updated weights for policy 0, policy_version 771326 (0.0010) [2023-12-26 05:44:59,093][123090] Updated weights for policy 1, policy_version 766201 (0.0010) [2023-12-26 05:44:59,126][123091] Updated weights for policy 0, policy_version 771336 (0.0010) [2023-12-26 05:44:59,879][123091] Updated weights for policy 0, policy_version 771346 (0.0010) [2023-12-26 05:44:59,947][123091] Updated weights for policy 0, policy_version 771356 (0.0013) [2023-12-26 05:44:59,976][123090] Updated weights for policy 1, policy_version 766211 (0.0009) [2023-12-26 05:45:00,008][123091] Updated weights for policy 0, policy_version 771366 (0.0011) [2023-12-26 05:45:00,042][123090] Updated weights for policy 1, policy_version 766221 (0.0010) [2023-12-26 05:45:00,069][123091] Updated weights for policy 0, policy_version 771376 (0.0011) [2023-12-26 05:45:00,111][123090] Updated weights for policy 1, policy_version 766231 (0.0006) [2023-12-26 05:45:00,816][123091] Updated weights for policy 0, policy_version 771386 (0.0006) [2023-12-26 05:45:00,881][123091] Updated weights for policy 0, policy_version 771396 (0.0005) [2023-12-26 05:45:00,889][123090] Updated weights for policy 1, policy_version 766241 (0.0010) [2023-12-26 05:45:00,939][123091] Updated weights for policy 0, policy_version 771406 (0.0005) [2023-12-26 05:45:00,948][123090] Updated weights for policy 1, policy_version 766251 (0.0010) [2023-12-26 05:45:01,003][123090] Updated weights for policy 1, policy_version 766261 (0.0010) [2023-12-26 05:45:01,075][123090] Updated weights for policy 1, policy_version 766271 (0.0010) [2023-12-26 05:45:01,692][123091] Updated weights for policy 0, policy_version 771416 (0.0008) [2023-12-26 05:45:01,756][123091] Updated weights for policy 0, policy_version 771426 (0.0011) [2023-12-26 05:45:01,823][123091] Updated weights for policy 0, policy_version 771436 (0.0011) [2023-12-26 05:45:01,852][123090] Updated weights for policy 1, policy_version 766281 (0.0008) [2023-12-26 05:45:01,907][123090] Updated weights for policy 1, policy_version 766291 (0.0010) [2023-12-26 05:45:01,959][123090] Updated weights for policy 1, policy_version 766301 (0.0010) [2023-12-26 05:45:02,663][123091] Updated weights for policy 0, policy_version 771446 (0.0011) [2023-12-26 05:45:02,714][123091] Updated weights for policy 0, policy_version 771456 (0.0010) [2023-12-26 05:45:02,747][123090] Updated weights for policy 1, policy_version 766311 (0.0008) [2023-12-26 05:45:02,769][123091] Updated weights for policy 0, policy_version 771466 (0.0010) [2023-12-26 05:45:02,810][123090] Updated weights for policy 1, policy_version 766321 (0.0007) [2023-12-26 05:45:02,877][123090] Updated weights for policy 1, policy_version 766331 (0.0010) [2023-12-26 05:45:03,454][123091] Updated weights for policy 0, policy_version 771476 (0.0010) [2023-12-26 05:45:03,525][123091] Updated weights for policy 0, policy_version 771486 (0.0011) [2023-12-26 05:45:03,587][123091] Updated weights for policy 0, policy_version 771496 (0.0010) [2023-12-26 05:45:03,615][123090] Updated weights for policy 1, policy_version 766341 (0.0008) [2023-12-26 05:45:03,683][123090] Updated weights for policy 1, policy_version 766351 (0.0010) [2023-12-26 05:45:03,731][123090] Updated weights for policy 1, policy_version 766361 (0.0010) [2023-12-26 05:45:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 393699328. Throughput: 0: 8812.4, 1: 8820.2. Samples: 393704928. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:45:03,785][121949] Avg episode reward: [(0, '5775.772'), (1, '5025.203')] [2023-12-26 05:45:04,402][123091] Updated weights for policy 0, policy_version 771506 (0.0011) [2023-12-26 05:45:04,461][123091] Updated weights for policy 0, policy_version 771516 (0.0011) [2023-12-26 05:45:04,474][123090] Updated weights for policy 1, policy_version 766371 (0.0011) [2023-12-26 05:45:04,529][123091] Updated weights for policy 0, policy_version 771526 (0.0011) [2023-12-26 05:45:04,530][123090] Updated weights for policy 1, policy_version 766381 (0.0010) [2023-12-26 05:45:04,587][123090] Updated weights for policy 1, policy_version 766391 (0.0010) [2023-12-26 05:45:04,589][123091] Updated weights for policy 0, policy_version 771536 (0.0011) [2023-12-26 05:45:05,317][123090] Updated weights for policy 1, policy_version 766401 (0.0010) [2023-12-26 05:45:05,371][123090] Updated weights for policy 1, policy_version 766411 (0.0005) [2023-12-26 05:45:05,412][123091] Updated weights for policy 0, policy_version 771546 (0.0011) [2023-12-26 05:45:05,435][123090] Updated weights for policy 1, policy_version 766421 (0.0007) [2023-12-26 05:45:05,460][123091] Updated weights for policy 0, policy_version 771556 (0.0010) [2023-12-26 05:45:05,497][123090] Updated weights for policy 1, policy_version 766431 (0.0007) [2023-12-26 05:45:05,511][123091] Updated weights for policy 0, policy_version 771566 (0.0010) [2023-12-26 05:45:06,209][123090] Updated weights for policy 1, policy_version 766441 (0.0009) [2023-12-26 05:45:06,271][123090] Updated weights for policy 1, policy_version 766451 (0.0008) [2023-12-26 05:45:06,340][123090] Updated weights for policy 1, policy_version 766461 (0.0009) [2023-12-26 05:45:06,391][123091] Updated weights for policy 0, policy_version 771576 (0.0011) [2023-12-26 05:45:06,460][123091] Updated weights for policy 0, policy_version 771586 (0.0011) [2023-12-26 05:45:06,528][123091] Updated weights for policy 0, policy_version 771596 (0.0011) [2023-12-26 05:45:07,202][123090] Updated weights for policy 1, policy_version 766471 (0.0009) [2023-12-26 05:45:07,258][123090] Updated weights for policy 1, policy_version 766482 (0.0010) [2023-12-26 05:45:07,283][123091] Updated weights for policy 0, policy_version 771606 (0.0008) [2023-12-26 05:45:07,311][123090] Updated weights for policy 1, policy_version 766492 (0.0008) [2023-12-26 05:45:07,343][123091] Updated weights for policy 0, policy_version 771616 (0.0009) [2023-12-26 05:45:07,409][123091] Updated weights for policy 0, policy_version 771626 (0.0011) [2023-12-26 05:45:08,197][123090] Updated weights for policy 1, policy_version 766502 (0.0009) [2023-12-26 05:45:08,222][123091] Updated weights for policy 0, policy_version 771636 (0.0009) [2023-12-26 05:45:08,258][123090] Updated weights for policy 1, policy_version 766512 (0.0011) [2023-12-26 05:45:08,278][123091] Updated weights for policy 0, policy_version 771646 (0.0006) [2023-12-26 05:45:08,319][123090] Updated weights for policy 1, policy_version 766522 (0.0011) [2023-12-26 05:45:08,338][123091] Updated weights for policy 0, policy_version 771656 (0.0009) [2023-12-26 05:45:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 393781248. Throughput: 0: 8797.4, 1: 8874.5. Samples: 393758424. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:45:08,785][121949] Avg episode reward: [(0, '5757.619'), (1, '5106.124')] [2023-12-26 05:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000771664_197550080.pth... [2023-12-26 05:45:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000766528_196231168.pth... [2023-12-26 05:45:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000765504_195969024.pth [2023-12-26 05:45:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000770672_197296128.pth [2023-12-26 05:45:09,079][123090] Updated weights for policy 1, policy_version 766532 (0.0009) [2023-12-26 05:45:09,127][123090] Updated weights for policy 1, policy_version 766542 (0.0010) [2023-12-26 05:45:09,159][123091] Updated weights for policy 0, policy_version 771666 (0.0008) [2023-12-26 05:45:09,190][123090] Updated weights for policy 1, policy_version 766552 (0.0010) [2023-12-26 05:45:09,225][123091] Updated weights for policy 0, policy_version 771676 (0.0008) [2023-12-26 05:45:09,292][123091] Updated weights for policy 0, policy_version 771686 (0.0008) [2023-12-26 05:45:09,361][123091] Updated weights for policy 0, policy_version 771696 (0.0009) [2023-12-26 05:45:10,024][123090] Updated weights for policy 1, policy_version 766562 (0.0011) [2023-12-26 05:45:10,078][123090] Updated weights for policy 1, policy_version 766572 (0.0010) [2023-12-26 05:45:10,139][123090] Updated weights for policy 1, policy_version 766582 (0.0008) [2023-12-26 05:45:10,196][123091] Updated weights for policy 0, policy_version 771706 (0.0006) [2023-12-26 05:45:10,216][123090] Updated weights for policy 1, policy_version 766592 (0.0006) [2023-12-26 05:45:10,268][123091] Updated weights for policy 0, policy_version 771716 (0.0006) [2023-12-26 05:45:10,341][123091] Updated weights for policy 0, policy_version 771726 (0.0006) [2023-12-26 05:45:10,998][123091] Updated weights for policy 0, policy_version 771736 (0.0007) [2023-12-26 05:45:11,004][123090] Updated weights for policy 1, policy_version 766602 (0.0007) [2023-12-26 05:45:11,065][123091] Updated weights for policy 0, policy_version 771746 (0.0008) [2023-12-26 05:45:11,074][123090] Updated weights for policy 1, policy_version 766612 (0.0007) [2023-12-26 05:45:11,126][123091] Updated weights for policy 0, policy_version 771756 (0.0007) [2023-12-26 05:45:11,145][123090] Updated weights for policy 1, policy_version 766622 (0.0010) [2023-12-26 05:45:11,929][123090] Updated weights for policy 1, policy_version 766632 (0.0007) [2023-12-26 05:45:11,985][123090] Updated weights for policy 1, policy_version 766642 (0.0005) [2023-12-26 05:45:12,021][123091] Updated weights for policy 0, policy_version 771766 (0.0008) [2023-12-26 05:45:12,034][123090] Updated weights for policy 1, policy_version 766652 (0.0007) [2023-12-26 05:45:12,097][123091] Updated weights for policy 0, policy_version 771776 (0.0009) [2023-12-26 05:45:12,170][123091] Updated weights for policy 0, policy_version 771786 (0.0008) [2023-12-26 05:45:12,736][123090] Updated weights for policy 1, policy_version 766662 (0.0008) [2023-12-26 05:45:12,806][123090] Updated weights for policy 1, policy_version 766672 (0.0008) [2023-12-26 05:45:12,871][123090] Updated weights for policy 1, policy_version 766682 (0.0009) [2023-12-26 05:45:12,990][123091] Updated weights for policy 0, policy_version 771796 (0.0010) [2023-12-26 05:45:13,051][123091] Updated weights for policy 0, policy_version 771806 (0.0009) [2023-12-26 05:45:13,117][123091] Updated weights for policy 0, policy_version 771816 (0.0009) [2023-12-26 05:45:13,605][123090] Updated weights for policy 1, policy_version 766692 (0.0008) [2023-12-26 05:45:13,673][123090] Updated weights for policy 1, policy_version 766703 (0.0008) [2023-12-26 05:45:13,739][123090] Updated weights for policy 1, policy_version 766713 (0.0009) [2023-12-26 05:45:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.5, 300 sec: 17661.4). Total num frames: 393871360. Throughput: 0: 8781.6, 1: 8844.1. Samples: 393863656. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:45:13,784][121949] Avg episode reward: [(0, '5822.716'), (1, '5521.602')] [2023-12-26 05:45:13,804][123091] Updated weights for policy 0, policy_version 771826 (0.0006) [2023-12-26 05:45:13,869][123091] Updated weights for policy 0, policy_version 771836 (0.0010) [2023-12-26 05:45:13,931][123091] Updated weights for policy 0, policy_version 771846 (0.0010) [2023-12-26 05:45:13,992][123091] Updated weights for policy 0, policy_version 771856 (0.0009) [2023-12-26 05:45:14,539][123090] Updated weights for policy 1, policy_version 766723 (0.0010) [2023-12-26 05:45:14,594][123090] Updated weights for policy 1, policy_version 766733 (0.0010) [2023-12-26 05:45:14,658][123090] Updated weights for policy 1, policy_version 766743 (0.0010) [2023-12-26 05:45:14,789][123091] Updated weights for policy 0, policy_version 771866 (0.0007) [2023-12-26 05:45:14,845][123091] Updated weights for policy 0, policy_version 771876 (0.0008) [2023-12-26 05:45:14,906][123091] Updated weights for policy 0, policy_version 771886 (0.0009) [2023-12-26 05:45:15,493][123090] Updated weights for policy 1, policy_version 766753 (0.0007) [2023-12-26 05:45:15,570][123090] Updated weights for policy 1, policy_version 766763 (0.0005) [2023-12-26 05:45:15,642][123090] Updated weights for policy 1, policy_version 766773 (0.0008) [2023-12-26 05:45:15,664][123091] Updated weights for policy 0, policy_version 771896 (0.0006) [2023-12-26 05:45:15,707][123090] Updated weights for policy 1, policy_version 766783 (0.0009) [2023-12-26 05:45:15,733][123091] Updated weights for policy 0, policy_version 771906 (0.0007) [2023-12-26 05:45:15,785][123091] Updated weights for policy 0, policy_version 771916 (0.0011) [2023-12-26 05:45:16,279][123090] Updated weights for policy 1, policy_version 766793 (0.0006) [2023-12-26 05:45:16,330][123090] Updated weights for policy 1, policy_version 766803 (0.0005) [2023-12-26 05:45:16,401][123090] Updated weights for policy 1, policy_version 766813 (0.0005) [2023-12-26 05:45:16,407][123091] Updated weights for policy 0, policy_version 771926 (0.0010) [2023-12-26 05:45:16,473][123091] Updated weights for policy 0, policy_version 771936 (0.0010) [2023-12-26 05:45:16,532][123091] Updated weights for policy 0, policy_version 771946 (0.0010) [2023-12-26 05:45:17,137][123090] Updated weights for policy 1, policy_version 766823 (0.0008) [2023-12-26 05:45:17,191][123090] Updated weights for policy 1, policy_version 766833 (0.0009) [2023-12-26 05:45:17,192][123091] Updated weights for policy 0, policy_version 771956 (0.0008) [2023-12-26 05:45:17,245][123091] Updated weights for policy 0, policy_version 771966 (0.0005) [2023-12-26 05:45:17,251][123090] Updated weights for policy 1, policy_version 766843 (0.0009) [2023-12-26 05:45:17,298][123091] Updated weights for policy 0, policy_version 771976 (0.0005) [2023-12-26 05:45:17,970][123091] Updated weights for policy 0, policy_version 771986 (0.0006) [2023-12-26 05:45:18,026][123091] Updated weights for policy 0, policy_version 771996 (0.0008) [2023-12-26 05:45:18,038][123090] Updated weights for policy 1, policy_version 766853 (0.0010) [2023-12-26 05:45:18,074][123091] Updated weights for policy 0, policy_version 772006 (0.0010) [2023-12-26 05:45:18,089][123090] Updated weights for policy 1, policy_version 766863 (0.0010) [2023-12-26 05:45:18,125][123091] Updated weights for policy 0, policy_version 772016 (0.0010) [2023-12-26 05:45:18,148][123090] Updated weights for policy 1, policy_version 766873 (0.0010) [2023-12-26 05:45:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 393961472. Throughput: 0: 8837.7, 1: 8883.9. Samples: 393976052. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:45:18,785][121949] Avg episode reward: [(0, '5668.750'), (1, '5541.115')] [2023-12-26 05:45:18,906][123091] Updated weights for policy 0, policy_version 772026 (0.0009) [2023-12-26 05:45:18,957][123091] Updated weights for policy 0, policy_version 772036 (0.0009) [2023-12-26 05:45:18,982][123090] Updated weights for policy 1, policy_version 766883 (0.0010) [2023-12-26 05:45:19,010][123091] Updated weights for policy 0, policy_version 772046 (0.0007) [2023-12-26 05:45:19,030][123090] Updated weights for policy 1, policy_version 766893 (0.0010) [2023-12-26 05:45:19,074][123090] Updated weights for policy 1, policy_version 766903 (0.0010) [2023-12-26 05:45:19,897][123091] Updated weights for policy 0, policy_version 772056 (0.0009) [2023-12-26 05:45:19,923][123090] Updated weights for policy 1, policy_version 766913 (0.0010) [2023-12-26 05:45:19,963][123091] Updated weights for policy 0, policy_version 772066 (0.0008) [2023-12-26 05:45:19,990][123090] Updated weights for policy 1, policy_version 766923 (0.0008) [2023-12-26 05:45:20,024][123091] Updated weights for policy 0, policy_version 772076 (0.0008) [2023-12-26 05:45:20,051][123090] Updated weights for policy 1, policy_version 766933 (0.0009) [2023-12-26 05:45:20,119][123090] Updated weights for policy 1, policy_version 766943 (0.0009) [2023-12-26 05:45:20,875][123091] Updated weights for policy 0, policy_version 772086 (0.0008) [2023-12-26 05:45:20,920][123090] Updated weights for policy 1, policy_version 766953 (0.0008) [2023-12-26 05:45:20,940][123091] Updated weights for policy 0, policy_version 772096 (0.0009) [2023-12-26 05:45:20,984][123090] Updated weights for policy 1, policy_version 766963 (0.0008) [2023-12-26 05:45:21,011][123091] Updated weights for policy 0, policy_version 772106 (0.0008) [2023-12-26 05:45:21,050][123090] Updated weights for policy 1, policy_version 766973 (0.0008) [2023-12-26 05:45:21,854][123090] Updated weights for policy 1, policy_version 766983 (0.0008) [2023-12-26 05:45:21,875][123091] Updated weights for policy 0, policy_version 772116 (0.0009) [2023-12-26 05:45:21,911][123090] Updated weights for policy 1, policy_version 766993 (0.0008) [2023-12-26 05:45:21,942][123091] Updated weights for policy 0, policy_version 772126 (0.0009) [2023-12-26 05:45:21,983][123090] Updated weights for policy 1, policy_version 767003 (0.0008) [2023-12-26 05:45:22,003][123091] Updated weights for policy 0, policy_version 772136 (0.0006) [2023-12-26 05:45:22,769][123090] Updated weights for policy 1, policy_version 767013 (0.0009) [2023-12-26 05:45:22,835][123090] Updated weights for policy 1, policy_version 767023 (0.0013) [2023-12-26 05:45:22,839][123091] Updated weights for policy 0, policy_version 772146 (0.0008) [2023-12-26 05:45:22,900][123090] Updated weights for policy 1, policy_version 767033 (0.0011) [2023-12-26 05:45:22,908][123091] Updated weights for policy 0, policy_version 772156 (0.0008) [2023-12-26 05:45:22,973][123091] Updated weights for policy 0, policy_version 772166 (0.0007) [2023-12-26 05:45:23,046][123091] Updated weights for policy 0, policy_version 772176 (0.0007) [2023-12-26 05:45:23,732][123090] Updated weights for policy 1, policy_version 767043 (0.0011) [2023-12-26 05:45:23,758][123091] Updated weights for policy 0, policy_version 772186 (0.0009) [2023-12-26 05:45:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 394043392. Throughput: 0: 8740.6, 1: 8889.8. Samples: 394026692. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 05:45:23,785][121949] Avg episode reward: [(0, '5508.210'), (1, '5308.096')] [2023-12-26 05:45:23,792][123090] Updated weights for policy 1, policy_version 767053 (0.0009) [2023-12-26 05:45:23,814][123091] Updated weights for policy 0, policy_version 772196 (0.0008) [2023-12-26 05:45:23,855][123090] Updated weights for policy 1, policy_version 767063 (0.0010) [2023-12-26 05:45:23,887][123091] Updated weights for policy 0, policy_version 772206 (0.0007) [2023-12-26 05:45:23,897][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000772208_197689344.pth... [2023-12-26 05:45:23,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000771152_197419008.pth [2023-12-26 05:45:23,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000767072_196370432.pth... [2023-12-26 05:45:23,920][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000766016_196100096.pth [2023-12-26 05:45:24,591][123091] Updated weights for policy 0, policy_version 772216 (0.0010) [2023-12-26 05:45:24,643][123090] Updated weights for policy 1, policy_version 767073 (0.0010) [2023-12-26 05:45:24,655][123091] Updated weights for policy 0, policy_version 772226 (0.0011) [2023-12-26 05:45:24,701][123090] Updated weights for policy 1, policy_version 767083 (0.0007) [2023-12-26 05:45:24,715][123091] Updated weights for policy 0, policy_version 772236 (0.0010) [2023-12-26 05:45:24,755][123090] Updated weights for policy 1, policy_version 767093 (0.0008) [2023-12-26 05:45:24,807][123090] Updated weights for policy 1, policy_version 767103 (0.0009) [2023-12-26 05:45:25,415][123091] Updated weights for policy 0, policy_version 772246 (0.0008) [2023-12-26 05:45:25,490][123091] Updated weights for policy 0, policy_version 772256 (0.0005) [2023-12-26 05:45:25,544][123091] Updated weights for policy 0, policy_version 772266 (0.0005) [2023-12-26 05:45:25,595][123090] Updated weights for policy 1, policy_version 767113 (0.0005) [2023-12-26 05:45:25,646][123090] Updated weights for policy 1, policy_version 767123 (0.0005) [2023-12-26 05:45:25,692][123090] Updated weights for policy 1, policy_version 767133 (0.0005) [2023-12-26 05:45:26,247][123091] Updated weights for policy 0, policy_version 772276 (0.0007) [2023-12-26 05:45:26,312][123091] Updated weights for policy 0, policy_version 772286 (0.0010) [2023-12-26 05:45:26,373][123091] Updated weights for policy 0, policy_version 772296 (0.0010) [2023-12-26 05:45:26,448][123090] Updated weights for policy 1, policy_version 767143 (0.0008) [2023-12-26 05:45:26,517][123090] Updated weights for policy 1, policy_version 767153 (0.0008) [2023-12-26 05:45:26,588][123090] Updated weights for policy 1, policy_version 767163 (0.0005) [2023-12-26 05:45:27,072][123091] Updated weights for policy 0, policy_version 772306 (0.0009) [2023-12-26 05:45:27,140][123091] Updated weights for policy 0, policy_version 772316 (0.0006) [2023-12-26 05:45:27,201][123091] Updated weights for policy 0, policy_version 772326 (0.0005) [2023-12-26 05:45:27,267][123091] Updated weights for policy 0, policy_version 772336 (0.0008) [2023-12-26 05:45:27,407][123090] Updated weights for policy 1, policy_version 767173 (0.0007) [2023-12-26 05:45:27,471][123090] Updated weights for policy 1, policy_version 767183 (0.0005) [2023-12-26 05:45:27,531][123090] Updated weights for policy 1, policy_version 767193 (0.0005) [2023-12-26 05:45:27,875][123091] Updated weights for policy 0, policy_version 772346 (0.0006) [2023-12-26 05:45:27,924][123091] Updated weights for policy 0, policy_version 772356 (0.0005) [2023-12-26 05:45:27,976][123091] Updated weights for policy 0, policy_version 772366 (0.0005) [2023-12-26 05:45:28,156][123090] Updated weights for policy 1, policy_version 767203 (0.0005) [2023-12-26 05:45:28,217][123090] Updated weights for policy 1, policy_version 767213 (0.0005) [2023-12-26 05:45:28,279][123090] Updated weights for policy 1, policy_version 767223 (0.0005) [2023-12-26 05:45:28,627][123091] Updated weights for policy 0, policy_version 772376 (0.0006) [2023-12-26 05:45:28,697][123091] Updated weights for policy 0, policy_version 772386 (0.0007) [2023-12-26 05:45:28,752][123091] Updated weights for policy 0, policy_version 772396 (0.0010) [2023-12-26 05:45:28,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 394149888. Throughput: 0: 8886.9, 1: 8965.7. Samples: 394137328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:28,784][121949] Avg episode reward: [(0, '5825.781'), (1, '5075.078')] [2023-12-26 05:45:28,993][123090] Updated weights for policy 1, policy_version 767233 (0.0009) [2023-12-26 05:45:29,062][123090] Updated weights for policy 1, policy_version 767243 (0.0010) [2023-12-26 05:45:29,137][123090] Updated weights for policy 1, policy_version 767253 (0.0005) [2023-12-26 05:45:29,214][123090] Updated weights for policy 1, policy_version 767263 (0.0006) [2023-12-26 05:45:29,533][123091] Updated weights for policy 0, policy_version 772406 (0.0010) [2023-12-26 05:45:29,599][123091] Updated weights for policy 0, policy_version 772416 (0.0009) [2023-12-26 05:45:29,663][123091] Updated weights for policy 0, policy_version 772426 (0.0009) [2023-12-26 05:45:29,898][123090] Updated weights for policy 1, policy_version 767273 (0.0010) [2023-12-26 05:45:29,959][123090] Updated weights for policy 1, policy_version 767283 (0.0011) [2023-12-26 05:45:30,015][123090] Updated weights for policy 1, policy_version 767293 (0.0010) [2023-12-26 05:45:30,444][123091] Updated weights for policy 0, policy_version 772436 (0.0009) [2023-12-26 05:45:30,497][123091] Updated weights for policy 0, policy_version 772446 (0.0009) [2023-12-26 05:45:30,565][123091] Updated weights for policy 0, policy_version 772456 (0.0009) [2023-12-26 05:45:30,870][123090] Updated weights for policy 1, policy_version 767303 (0.0011) [2023-12-26 05:45:30,934][123090] Updated weights for policy 1, policy_version 767313 (0.0011) [2023-12-26 05:45:30,982][123090] Updated weights for policy 1, policy_version 767323 (0.0010) [2023-12-26 05:45:31,407][123091] Updated weights for policy 0, policy_version 772466 (0.0008) [2023-12-26 05:45:31,462][123091] Updated weights for policy 0, policy_version 772476 (0.0009) [2023-12-26 05:45:31,525][123091] Updated weights for policy 0, policy_version 772486 (0.0008) [2023-12-26 05:45:31,597][123091] Updated weights for policy 0, policy_version 772496 (0.0009) [2023-12-26 05:45:31,714][123090] Updated weights for policy 1, policy_version 767333 (0.0007) [2023-12-26 05:45:31,785][123090] Updated weights for policy 1, policy_version 767343 (0.0007) [2023-12-26 05:45:31,854][123090] Updated weights for policy 1, policy_version 767353 (0.0006) [2023-12-26 05:45:32,347][123091] Updated weights for policy 0, policy_version 772506 (0.0009) [2023-12-26 05:45:32,415][123091] Updated weights for policy 0, policy_version 772516 (0.0008) [2023-12-26 05:45:32,472][123091] Updated weights for policy 0, policy_version 772526 (0.0009) [2023-12-26 05:45:32,574][123090] Updated weights for policy 1, policy_version 767363 (0.0009) [2023-12-26 05:45:32,627][123090] Updated weights for policy 1, policy_version 767373 (0.0010) [2023-12-26 05:45:32,679][123090] Updated weights for policy 1, policy_version 767383 (0.0009) [2023-12-26 05:45:33,370][123091] Updated weights for policy 0, policy_version 772536 (0.0006) [2023-12-26 05:45:33,395][123090] Updated weights for policy 1, policy_version 767393 (0.0006) [2023-12-26 05:45:33,440][123091] Updated weights for policy 0, policy_version 772546 (0.0005) [2023-12-26 05:45:33,447][123090] Updated weights for policy 1, policy_version 767403 (0.0009) [2023-12-26 05:45:33,507][123090] Updated weights for policy 1, policy_version 767413 (0.0005) [2023-12-26 05:45:33,508][123091] Updated weights for policy 0, policy_version 772556 (0.0005) [2023-12-26 05:45:33,577][123090] Updated weights for policy 1, policy_version 767423 (0.0005) [2023-12-26 05:45:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 394240000. Throughput: 0: 8972.8, 1: 8972.8. Samples: 394249404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:33,785][121949] Avg episode reward: [(0, '5936.994'), (1, '5101.517')] [2023-12-26 05:45:34,111][123091] Updated weights for policy 0, policy_version 772566 (0.0008) [2023-12-26 05:45:34,172][123091] Updated weights for policy 0, policy_version 772576 (0.0010) [2023-12-26 05:45:34,240][123091] Updated weights for policy 0, policy_version 772586 (0.0008) [2023-12-26 05:45:34,282][123090] Updated weights for policy 1, policy_version 767433 (0.0008) [2023-12-26 05:45:34,354][123090] Updated weights for policy 1, policy_version 767443 (0.0008) [2023-12-26 05:45:34,419][123090] Updated weights for policy 1, policy_version 767453 (0.0007) [2023-12-26 05:45:35,022][123091] Updated weights for policy 0, policy_version 772596 (0.0006) [2023-12-26 05:45:35,073][123091] Updated weights for policy 0, policy_version 772606 (0.0005) [2023-12-26 05:45:35,132][123091] Updated weights for policy 0, policy_version 772616 (0.0005) [2023-12-26 05:45:35,228][123090] Updated weights for policy 1, policy_version 767463 (0.0010) [2023-12-26 05:45:35,271][123090] Updated weights for policy 1, policy_version 767473 (0.0010) [2023-12-26 05:45:35,322][123090] Updated weights for policy 1, policy_version 767483 (0.0010) [2023-12-26 05:45:35,912][123091] Updated weights for policy 0, policy_version 772626 (0.0009) [2023-12-26 05:45:35,973][123091] Updated weights for policy 0, policy_version 772636 (0.0010) [2023-12-26 05:45:36,017][123091] Updated weights for policy 0, policy_version 772646 (0.0010) [2023-12-26 05:45:36,064][123091] Updated weights for policy 0, policy_version 772656 (0.0010) [2023-12-26 05:45:36,087][123090] Updated weights for policy 1, policy_version 767493 (0.0008) [2023-12-26 05:45:36,155][123090] Updated weights for policy 1, policy_version 767503 (0.0008) [2023-12-26 05:45:36,214][123090] Updated weights for policy 1, policy_version 767513 (0.0008) [2023-12-26 05:45:36,947][123091] Updated weights for policy 0, policy_version 772666 (0.0010) [2023-12-26 05:45:36,975][123090] Updated weights for policy 1, policy_version 767523 (0.0007) [2023-12-26 05:45:37,006][123091] Updated weights for policy 0, policy_version 772676 (0.0009) [2023-12-26 05:45:37,047][123090] Updated weights for policy 1, policy_version 767533 (0.0006) [2023-12-26 05:45:37,061][123091] Updated weights for policy 0, policy_version 772686 (0.0009) [2023-12-26 05:45:37,114][123090] Updated weights for policy 1, policy_version 767543 (0.0006) [2023-12-26 05:45:37,890][123090] Updated weights for policy 1, policy_version 767553 (0.0009) [2023-12-26 05:45:37,928][123091] Updated weights for policy 0, policy_version 772696 (0.0009) [2023-12-26 05:45:37,958][123090] Updated weights for policy 1, policy_version 767563 (0.0010) [2023-12-26 05:45:37,985][123091] Updated weights for policy 0, policy_version 772706 (0.0007) [2023-12-26 05:45:38,017][123090] Updated weights for policy 1, policy_version 767573 (0.0010) [2023-12-26 05:45:38,050][123091] Updated weights for policy 0, policy_version 772716 (0.0006) [2023-12-26 05:45:38,070][123090] Updated weights for policy 1, policy_version 767583 (0.0010) [2023-12-26 05:45:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 394321920. Throughput: 0: 9010.5, 1: 9015.1. Samples: 394304180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:38,785][121949] Avg episode reward: [(0, '5590.565'), (1, '5057.634')] [2023-12-26 05:45:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000772720_197820416.pth... [2023-12-26 05:45:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000767584_196501504.pth... [2023-12-26 05:45:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000771664_197550080.pth [2023-12-26 05:45:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000766528_196231168.pth [2023-12-26 05:45:38,861][123091] Updated weights for policy 0, policy_version 772726 (0.0006) [2023-12-26 05:45:38,904][123090] Updated weights for policy 1, policy_version 767593 (0.0010) [2023-12-26 05:45:38,927][123091] Updated weights for policy 0, policy_version 772736 (0.0005) [2023-12-26 05:45:38,967][123090] Updated weights for policy 1, policy_version 767603 (0.0010) [2023-12-26 05:45:38,994][123091] Updated weights for policy 0, policy_version 772746 (0.0007) [2023-12-26 05:45:39,033][123090] Updated weights for policy 1, policy_version 767613 (0.0011) [2023-12-26 05:45:39,744][123091] Updated weights for policy 0, policy_version 772756 (0.0008) [2023-12-26 05:45:39,812][123091] Updated weights for policy 0, policy_version 772766 (0.0009) [2023-12-26 05:45:39,883][123091] Updated weights for policy 0, policy_version 772776 (0.0009) [2023-12-26 05:45:39,898][123090] Updated weights for policy 1, policy_version 767623 (0.0011) [2023-12-26 05:45:39,967][123090] Updated weights for policy 1, policy_version 767633 (0.0011) [2023-12-26 05:45:40,024][123090] Updated weights for policy 1, policy_version 767643 (0.0011) [2023-12-26 05:45:40,706][123091] Updated weights for policy 0, policy_version 772786 (0.0007) [2023-12-26 05:45:40,770][123091] Updated weights for policy 0, policy_version 772796 (0.0009) [2023-12-26 05:45:40,835][123091] Updated weights for policy 0, policy_version 772806 (0.0009) [2023-12-26 05:45:40,866][123090] Updated weights for policy 1, policy_version 767653 (0.0011) [2023-12-26 05:45:40,896][123091] Updated weights for policy 0, policy_version 772816 (0.0006) [2023-12-26 05:45:40,922][123090] Updated weights for policy 1, policy_version 767663 (0.0011) [2023-12-26 05:45:40,978][123090] Updated weights for policy 1, policy_version 767673 (0.0010) [2023-12-26 05:45:41,681][123091] Updated weights for policy 0, policy_version 772826 (0.0008) [2023-12-26 05:45:41,751][123091] Updated weights for policy 0, policy_version 772836 (0.0007) [2023-12-26 05:45:41,823][123091] Updated weights for policy 0, policy_version 772846 (0.0007) [2023-12-26 05:45:41,862][123090] Updated weights for policy 1, policy_version 767683 (0.0011) [2023-12-26 05:45:41,927][123090] Updated weights for policy 1, policy_version 767693 (0.0011) [2023-12-26 05:45:41,997][123090] Updated weights for policy 1, policy_version 767703 (0.0006) [2023-12-26 05:45:42,562][123091] Updated weights for policy 0, policy_version 772856 (0.0007) [2023-12-26 05:45:42,628][123091] Updated weights for policy 0, policy_version 772866 (0.0009) [2023-12-26 05:45:42,691][123091] Updated weights for policy 0, policy_version 772876 (0.0008) [2023-12-26 05:45:42,814][123090] Updated weights for policy 1, policy_version 767713 (0.0008) [2023-12-26 05:45:42,866][123090] Updated weights for policy 1, policy_version 767723 (0.0010) [2023-12-26 05:45:42,918][123090] Updated weights for policy 1, policy_version 767733 (0.0010) [2023-12-26 05:45:42,983][123090] Updated weights for policy 1, policy_version 767743 (0.0011) [2023-12-26 05:45:43,411][123091] Updated weights for policy 0, policy_version 772886 (0.0006) [2023-12-26 05:45:43,476][123091] Updated weights for policy 0, policy_version 772896 (0.0005) [2023-12-26 05:45:43,553][123091] Updated weights for policy 0, policy_version 772906 (0.0005) [2023-12-26 05:45:43,745][123090] Updated weights for policy 1, policy_version 767753 (0.0010) [2023-12-26 05:45:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 394412032. Throughput: 0: 8999.9, 1: 8952.4. Samples: 394406952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:43,785][121949] Avg episode reward: [(0, '5607.722'), (1, '4917.805')] [2023-12-26 05:45:43,808][123090] Updated weights for policy 1, policy_version 767763 (0.0011) [2023-12-26 05:45:43,872][123090] Updated weights for policy 1, policy_version 767773 (0.0010) [2023-12-26 05:45:44,241][123091] Updated weights for policy 0, policy_version 772916 (0.0005) [2023-12-26 05:45:44,293][123091] Updated weights for policy 0, policy_version 772926 (0.0006) [2023-12-26 05:45:44,353][123091] Updated weights for policy 0, policy_version 772936 (0.0005) [2023-12-26 05:45:44,645][123090] Updated weights for policy 1, policy_version 767783 (0.0007) [2023-12-26 05:45:44,696][123090] Updated weights for policy 1, policy_version 767793 (0.0005) [2023-12-26 05:45:44,772][123090] Updated weights for policy 1, policy_version 767803 (0.0006) [2023-12-26 05:45:45,133][123091] Updated weights for policy 0, policy_version 772946 (0.0005) [2023-12-26 05:45:45,203][123091] Updated weights for policy 0, policy_version 772956 (0.0006) [2023-12-26 05:45:45,277][123091] Updated weights for policy 0, policy_version 772966 (0.0006) [2023-12-26 05:45:45,345][123091] Updated weights for policy 0, policy_version 772976 (0.0006) [2023-12-26 05:45:45,571][123090] Updated weights for policy 1, policy_version 767813 (0.0009) [2023-12-26 05:45:45,643][123090] Updated weights for policy 1, policy_version 767823 (0.0010) [2023-12-26 05:45:45,716][123090] Updated weights for policy 1, policy_version 767833 (0.0010) [2023-12-26 05:45:46,096][123091] Updated weights for policy 0, policy_version 772986 (0.0010) [2023-12-26 05:45:46,166][123091] Updated weights for policy 0, policy_version 772996 (0.0010) [2023-12-26 05:45:46,226][123091] Updated weights for policy 0, policy_version 773006 (0.0010) [2023-12-26 05:45:46,449][123090] Updated weights for policy 1, policy_version 767843 (0.0010) [2023-12-26 05:45:46,501][123090] Updated weights for policy 1, policy_version 767853 (0.0008) [2023-12-26 05:45:46,558][123090] Updated weights for policy 1, policy_version 767863 (0.0009) [2023-12-26 05:45:46,977][123091] Updated weights for policy 0, policy_version 773016 (0.0010) [2023-12-26 05:45:47,050][123091] Updated weights for policy 0, policy_version 773026 (0.0006) [2023-12-26 05:45:47,109][123091] Updated weights for policy 0, policy_version 773036 (0.0008) [2023-12-26 05:45:47,435][123090] Updated weights for policy 1, policy_version 767873 (0.0009) [2023-12-26 05:45:47,514][123090] Updated weights for policy 1, policy_version 767883 (0.0010) [2023-12-26 05:45:47,584][123090] Updated weights for policy 1, policy_version 767893 (0.0010) [2023-12-26 05:45:47,645][123090] Updated weights for policy 1, policy_version 767903 (0.0009) [2023-12-26 05:45:47,854][123091] Updated weights for policy 0, policy_version 773046 (0.0010) [2023-12-26 05:45:47,916][123091] Updated weights for policy 0, policy_version 773056 (0.0011) [2023-12-26 05:45:47,981][123091] Updated weights for policy 0, policy_version 773066 (0.0010) [2023-12-26 05:45:48,527][123090] Updated weights for policy 1, policy_version 767913 (0.0008) [2023-12-26 05:45:48,595][123090] Updated weights for policy 1, policy_version 767923 (0.0008) [2023-12-26 05:45:48,647][123091] Updated weights for policy 0, policy_version 773076 (0.0009) [2023-12-26 05:45:48,661][123090] Updated weights for policy 1, policy_version 767933 (0.0008) [2023-12-26 05:45:48,712][123091] Updated weights for policy 0, policy_version 773086 (0.0009) [2023-12-26 05:45:48,783][123091] Updated weights for policy 0, policy_version 773096 (0.0011) [2023-12-26 05:45:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 394502144. Throughput: 0: 9065.6, 1: 8952.4. Samples: 394515740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:48,784][121949] Avg episode reward: [(0, '5885.771'), (1, '4907.759')] [2023-12-26 05:45:49,400][123090] Updated weights for policy 1, policy_version 767943 (0.0009) [2023-12-26 05:45:49,457][123090] Updated weights for policy 1, policy_version 767953 (0.0009) [2023-12-26 05:45:49,461][123091] Updated weights for policy 0, policy_version 773106 (0.0007) [2023-12-26 05:45:49,516][123091] Updated weights for policy 0, policy_version 773116 (0.0006) [2023-12-26 05:45:49,523][123090] Updated weights for policy 1, policy_version 767963 (0.0009) [2023-12-26 05:45:49,579][123091] Updated weights for policy 0, policy_version 773126 (0.0005) [2023-12-26 05:45:49,645][123091] Updated weights for policy 0, policy_version 773136 (0.0005) [2023-12-26 05:45:50,390][123091] Updated weights for policy 0, policy_version 773146 (0.0011) [2023-12-26 05:45:50,400][123090] Updated weights for policy 1, policy_version 767973 (0.0008) [2023-12-26 05:45:50,434][123091] Updated weights for policy 0, policy_version 773156 (0.0010) [2023-12-26 05:45:50,455][123090] Updated weights for policy 1, policy_version 767983 (0.0009) [2023-12-26 05:45:50,487][123091] Updated weights for policy 0, policy_version 773166 (0.0010) [2023-12-26 05:45:50,516][123090] Updated weights for policy 1, policy_version 767993 (0.0008) [2023-12-26 05:45:51,262][123091] Updated weights for policy 0, policy_version 773176 (0.0007) [2023-12-26 05:45:51,331][123091] Updated weights for policy 0, policy_version 773186 (0.0011) [2023-12-26 05:45:51,401][123090] Updated weights for policy 1, policy_version 768003 (0.0009) [2023-12-26 05:45:51,403][123091] Updated weights for policy 0, policy_version 773196 (0.0009) [2023-12-26 05:45:51,474][123090] Updated weights for policy 1, policy_version 768013 (0.0005) [2023-12-26 05:45:51,540][123090] Updated weights for policy 1, policy_version 768023 (0.0005) [2023-12-26 05:45:52,204][123090] Updated weights for policy 1, policy_version 768033 (0.0005) [2023-12-26 05:45:52,264][123090] Updated weights for policy 1, policy_version 768043 (0.0007) [2023-12-26 05:45:52,267][123091] Updated weights for policy 0, policy_version 773206 (0.0008) [2023-12-26 05:45:52,327][123091] Updated weights for policy 0, policy_version 773216 (0.0010) [2023-12-26 05:45:52,328][123090] Updated weights for policy 1, policy_version 768053 (0.0007) [2023-12-26 05:45:52,395][123091] Updated weights for policy 0, policy_version 773226 (0.0011) [2023-12-26 05:45:52,401][123090] Updated weights for policy 1, policy_version 768063 (0.0008) [2023-12-26 05:45:53,140][123091] Updated weights for policy 0, policy_version 773236 (0.0009) [2023-12-26 05:45:53,142][123090] Updated weights for policy 1, policy_version 768073 (0.0010) [2023-12-26 05:45:53,205][123090] Updated weights for policy 1, policy_version 768083 (0.0010) [2023-12-26 05:45:53,209][123091] Updated weights for policy 0, policy_version 773246 (0.0008) [2023-12-26 05:45:53,272][123090] Updated weights for policy 1, policy_version 768093 (0.0011) [2023-12-26 05:45:53,272][123091] Updated weights for policy 0, policy_version 773256 (0.0010) [2023-12-26 05:45:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 394592256. Throughput: 0: 9122.1, 1: 8896.7. Samples: 394569272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:53,786][121949] Avg episode reward: [(0, '5935.111'), (1, '4869.195')] [2023-12-26 05:45:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000773264_197959680.pth... [2023-12-26 05:45:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000768096_196632576.pth... [2023-12-26 05:45:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000767072_196370432.pth [2023-12-26 05:45:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000772208_197689344.pth [2023-12-26 05:45:53,997][123091] Updated weights for policy 0, policy_version 773266 (0.0010) [2023-12-26 05:45:54,050][123091] Updated weights for policy 0, policy_version 773276 (0.0009) [2023-12-26 05:45:54,099][123090] Updated weights for policy 1, policy_version 768103 (0.0010) [2023-12-26 05:45:54,101][123091] Updated weights for policy 0, policy_version 773286 (0.0008) [2023-12-26 05:45:54,166][123091] Updated weights for policy 0, policy_version 773296 (0.0008) [2023-12-26 05:45:54,166][123090] Updated weights for policy 1, policy_version 768113 (0.0010) [2023-12-26 05:45:54,236][123090] Updated weights for policy 1, policy_version 768123 (0.0010) [2023-12-26 05:45:54,929][123091] Updated weights for policy 0, policy_version 773306 (0.0010) [2023-12-26 05:45:54,979][123090] Updated weights for policy 1, policy_version 768133 (0.0008) [2023-12-26 05:45:55,002][123091] Updated weights for policy 0, policy_version 773316 (0.0007) [2023-12-26 05:45:55,039][123090] Updated weights for policy 1, policy_version 768143 (0.0007) [2023-12-26 05:45:55,054][123091] Updated weights for policy 0, policy_version 773326 (0.0011) [2023-12-26 05:45:55,106][123090] Updated weights for policy 1, policy_version 768153 (0.0010) [2023-12-26 05:45:55,768][123091] Updated weights for policy 0, policy_version 773336 (0.0010) [2023-12-26 05:45:55,833][123090] Updated weights for policy 1, policy_version 768163 (0.0009) [2023-12-26 05:45:55,842][123091] Updated weights for policy 0, policy_version 773346 (0.0010) [2023-12-26 05:45:55,897][123090] Updated weights for policy 1, policy_version 768173 (0.0005) [2023-12-26 05:45:55,897][123091] Updated weights for policy 0, policy_version 773356 (0.0010) [2023-12-26 05:45:55,953][123090] Updated weights for policy 1, policy_version 768183 (0.0005) [2023-12-26 05:45:56,579][123091] Updated weights for policy 0, policy_version 773366 (0.0010) [2023-12-26 05:45:56,641][123091] Updated weights for policy 0, policy_version 773376 (0.0009) [2023-12-26 05:45:56,661][123090] Updated weights for policy 1, policy_version 768193 (0.0005) [2023-12-26 05:45:56,695][123091] Updated weights for policy 0, policy_version 773386 (0.0008) [2023-12-26 05:45:56,722][123090] Updated weights for policy 1, policy_version 768203 (0.0006) [2023-12-26 05:45:56,795][123090] Updated weights for policy 1, policy_version 768213 (0.0005) [2023-12-26 05:45:56,856][123090] Updated weights for policy 1, policy_version 768223 (0.0008) [2023-12-26 05:45:57,454][123091] Updated weights for policy 0, policy_version 773396 (0.0006) [2023-12-26 05:45:57,511][123091] Updated weights for policy 0, policy_version 773406 (0.0006) [2023-12-26 05:45:57,554][123090] Updated weights for policy 1, policy_version 768233 (0.0006) [2023-12-26 05:45:57,567][123091] Updated weights for policy 0, policy_version 773416 (0.0005) [2023-12-26 05:45:57,601][123090] Updated weights for policy 1, policy_version 768243 (0.0007) [2023-12-26 05:45:57,658][123090] Updated weights for policy 1, policy_version 768253 (0.0005) [2023-12-26 05:45:58,161][123091] Updated weights for policy 0, policy_version 773426 (0.0006) [2023-12-26 05:45:58,233][123091] Updated weights for policy 0, policy_version 773436 (0.0008) [2023-12-26 05:45:58,288][123091] Updated weights for policy 0, policy_version 773446 (0.0008) [2023-12-26 05:45:58,355][123091] Updated weights for policy 0, policy_version 773456 (0.0008) [2023-12-26 05:45:58,356][123090] Updated weights for policy 1, policy_version 768263 (0.0007) [2023-12-26 05:45:58,430][123090] Updated weights for policy 1, policy_version 768273 (0.0011) [2023-12-26 05:45:58,502][123090] Updated weights for policy 1, policy_version 768283 (0.0008) [2023-12-26 05:45:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 394690560. Throughput: 0: 9198.4, 1: 8955.3. Samples: 394680572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:45:58,785][121949] Avg episode reward: [(0, '5979.234'), (1, '4959.556')] [2023-12-26 05:45:59,242][123091] Updated weights for policy 0, policy_version 773466 (0.0009) [2023-12-26 05:45:59,305][123091] Updated weights for policy 0, policy_version 773476 (0.0009) [2023-12-26 05:45:59,373][123091] Updated weights for policy 0, policy_version 773486 (0.0010) [2023-12-26 05:45:59,471][123090] Updated weights for policy 1, policy_version 768293 (0.0009) [2023-12-26 05:45:59,524][123090] Updated weights for policy 1, policy_version 768303 (0.0009) [2023-12-26 05:45:59,580][123090] Updated weights for policy 1, policy_version 768313 (0.0009) [2023-12-26 05:46:00,193][123091] Updated weights for policy 0, policy_version 773496 (0.0009) [2023-12-26 05:46:00,248][123091] Updated weights for policy 0, policy_version 773506 (0.0009) [2023-12-26 05:46:00,302][123091] Updated weights for policy 0, policy_version 773517 (0.0010) [2023-12-26 05:46:00,409][123090] Updated weights for policy 1, policy_version 768323 (0.0009) [2023-12-26 05:46:00,457][123090] Updated weights for policy 1, policy_version 768333 (0.0009) [2023-12-26 05:46:00,510][123090] Updated weights for policy 1, policy_version 768343 (0.0009) [2023-12-26 05:46:01,150][123091] Updated weights for policy 0, policy_version 773527 (0.0007) [2023-12-26 05:46:01,225][123091] Updated weights for policy 0, policy_version 773537 (0.0006) [2023-12-26 05:46:01,294][123091] Updated weights for policy 0, policy_version 773547 (0.0007) [2023-12-26 05:46:01,370][123090] Updated weights for policy 1, policy_version 768354 (0.0010) [2023-12-26 05:46:01,436][123090] Updated weights for policy 1, policy_version 768364 (0.0009) [2023-12-26 05:46:01,495][123090] Updated weights for policy 1, policy_version 768374 (0.0009) [2023-12-26 05:46:01,554][123090] Updated weights for policy 1, policy_version 768384 (0.0010) [2023-12-26 05:46:02,035][123091] Updated weights for policy 0, policy_version 773557 (0.0011) [2023-12-26 05:46:02,089][123091] Updated weights for policy 0, policy_version 773567 (0.0009) [2023-12-26 05:46:02,150][123091] Updated weights for policy 0, policy_version 773577 (0.0009) [2023-12-26 05:46:02,348][123090] Updated weights for policy 1, policy_version 768394 (0.0008) [2023-12-26 05:46:02,411][123090] Updated weights for policy 1, policy_version 768404 (0.0010) [2023-12-26 05:46:02,472][123090] Updated weights for policy 1, policy_version 768414 (0.0010) [2023-12-26 05:46:02,962][123091] Updated weights for policy 0, policy_version 773587 (0.0007) [2023-12-26 05:46:03,014][123091] Updated weights for policy 0, policy_version 773597 (0.0010) [2023-12-26 05:46:03,066][123091] Updated weights for policy 0, policy_version 773607 (0.0010) [2023-12-26 05:46:03,313][123090] Updated weights for policy 1, policy_version 768424 (0.0006) [2023-12-26 05:46:03,365][123090] Updated weights for policy 1, policy_version 768434 (0.0006) [2023-12-26 05:46:03,413][123090] Updated weights for policy 1, policy_version 768444 (0.0009) [2023-12-26 05:46:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 394772480. Throughput: 0: 9080.6, 1: 8893.9. Samples: 394784900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:03,785][121949] Avg episode reward: [(0, '5820.161'), (1, '4681.510')] [2023-12-26 05:46:03,844][123091] Updated weights for policy 0, policy_version 773617 (0.0010) [2023-12-26 05:46:03,918][123091] Updated weights for policy 0, policy_version 773627 (0.0007) [2023-12-26 05:46:03,990][123091] Updated weights for policy 0, policy_version 773637 (0.0009) [2023-12-26 05:46:04,055][123091] Updated weights for policy 0, policy_version 773647 (0.0008) [2023-12-26 05:46:04,286][123090] Updated weights for policy 1, policy_version 768454 (0.0009) [2023-12-26 05:46:04,364][123090] Updated weights for policy 1, policy_version 768464 (0.0010) [2023-12-26 05:46:04,438][123090] Updated weights for policy 1, policy_version 768474 (0.0011) [2023-12-26 05:46:04,816][123091] Updated weights for policy 0, policy_version 773657 (0.0009) [2023-12-26 05:46:04,880][123091] Updated weights for policy 0, policy_version 773667 (0.0008) [2023-12-26 05:46:04,936][123091] Updated weights for policy 0, policy_version 773677 (0.0006) [2023-12-26 05:46:05,230][123090] Updated weights for policy 1, policy_version 768484 (0.0008) [2023-12-26 05:46:05,295][123090] Updated weights for policy 1, policy_version 768494 (0.0009) [2023-12-26 05:46:05,362][123090] Updated weights for policy 1, policy_version 768504 (0.0009) [2023-12-26 05:46:05,743][123091] Updated weights for policy 0, policy_version 773687 (0.0009) [2023-12-26 05:46:05,802][123091] Updated weights for policy 0, policy_version 773697 (0.0010) [2023-12-26 05:46:05,870][123091] Updated weights for policy 0, policy_version 773707 (0.0011) [2023-12-26 05:46:06,099][123090] Updated weights for policy 1, policy_version 768514 (0.0009) [2023-12-26 05:46:06,164][123090] Updated weights for policy 1, policy_version 768524 (0.0009) [2023-12-26 05:46:06,224][123090] Updated weights for policy 1, policy_version 768534 (0.0011) [2023-12-26 05:46:06,281][123090] Updated weights for policy 1, policy_version 768544 (0.0011) [2023-12-26 05:46:06,726][123091] Updated weights for policy 0, policy_version 773717 (0.0011) [2023-12-26 05:46:06,790][123091] Updated weights for policy 0, policy_version 773727 (0.0011) [2023-12-26 05:46:06,861][123091] Updated weights for policy 0, policy_version 773737 (0.0011) [2023-12-26 05:46:07,113][123090] Updated weights for policy 1, policy_version 768554 (0.0009) [2023-12-26 05:46:07,184][123090] Updated weights for policy 1, policy_version 768564 (0.0008) [2023-12-26 05:46:07,257][123090] Updated weights for policy 1, policy_version 768574 (0.0008) [2023-12-26 05:46:07,660][123091] Updated weights for policy 0, policy_version 773747 (0.0010) [2023-12-26 05:46:07,727][123091] Updated weights for policy 0, policy_version 773757 (0.0010) [2023-12-26 05:46:07,781][123091] Updated weights for policy 0, policy_version 773767 (0.0010) [2023-12-26 05:46:08,019][123090] Updated weights for policy 1, policy_version 768584 (0.0007) [2023-12-26 05:46:08,078][123090] Updated weights for policy 1, policy_version 768594 (0.0006) [2023-12-26 05:46:08,141][123090] Updated weights for policy 1, policy_version 768604 (0.0006) [2023-12-26 05:46:08,715][123091] Updated weights for policy 0, policy_version 773777 (0.0010) [2023-12-26 05:46:08,771][123091] Updated weights for policy 0, policy_version 773787 (0.0010) [2023-12-26 05:46:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 394854400. Throughput: 0: 9123.7, 1: 8892.7. Samples: 394837428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:08,785][121949] Avg episode reward: [(0, '5712.970'), (1, '4503.629')] [2023-12-26 05:46:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000768608_196763648.pth... [2023-12-26 05:46:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000767584_196501504.pth [2023-12-26 05:46:08,827][123091] Updated weights for policy 0, policy_version 773797 (0.0009) [2023-12-26 05:46:08,883][123091] Updated weights for policy 0, policy_version 773807 (0.0009) [2023-12-26 05:46:08,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000773808_198098944.pth... [2023-12-26 05:46:08,892][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000772720_197820416.pth [2023-12-26 05:46:08,901][123090] Updated weights for policy 1, policy_version 768614 (0.0007) [2023-12-26 05:46:08,962][123090] Updated weights for policy 1, policy_version 768624 (0.0008) [2023-12-26 05:46:09,021][123090] Updated weights for policy 1, policy_version 768634 (0.0008) [2023-12-26 05:46:09,771][123091] Updated weights for policy 0, policy_version 773817 (0.0009) [2023-12-26 05:46:09,843][123091] Updated weights for policy 0, policy_version 773827 (0.0010) [2023-12-26 05:46:09,868][123090] Updated weights for policy 1, policy_version 768644 (0.0008) [2023-12-26 05:46:09,901][123091] Updated weights for policy 0, policy_version 773837 (0.0009) [2023-12-26 05:46:09,937][123090] Updated weights for policy 1, policy_version 768654 (0.0006) [2023-12-26 05:46:10,015][123090] Updated weights for policy 1, policy_version 768664 (0.0010) [2023-12-26 05:46:10,790][123090] Updated weights for policy 1, policy_version 768674 (0.0010) [2023-12-26 05:46:10,808][123091] Updated weights for policy 0, policy_version 773847 (0.0007) [2023-12-26 05:46:10,858][123090] Updated weights for policy 1, policy_version 768684 (0.0009) [2023-12-26 05:46:10,874][123091] Updated weights for policy 0, policy_version 773857 (0.0010) [2023-12-26 05:46:10,928][123091] Updated weights for policy 0, policy_version 773867 (0.0008) [2023-12-26 05:46:10,930][123090] Updated weights for policy 1, policy_version 768694 (0.0008) [2023-12-26 05:46:10,997][123090] Updated weights for policy 1, policy_version 768704 (0.0009) [2023-12-26 05:46:11,778][123091] Updated weights for policy 0, policy_version 773877 (0.0008) [2023-12-26 05:46:11,843][123091] Updated weights for policy 0, policy_version 773887 (0.0008) [2023-12-26 05:46:11,854][123090] Updated weights for policy 1, policy_version 768714 (0.0009) [2023-12-26 05:46:11,909][123091] Updated weights for policy 0, policy_version 773897 (0.0011) [2023-12-26 05:46:11,916][123090] Updated weights for policy 1, policy_version 768724 (0.0007) [2023-12-26 05:46:11,975][123090] Updated weights for policy 1, policy_version 768734 (0.0008) [2023-12-26 05:46:12,746][123091] Updated weights for policy 0, policy_version 773907 (0.0010) [2023-12-26 05:46:12,790][123090] Updated weights for policy 1, policy_version 768744 (0.0008) [2023-12-26 05:46:12,817][123091] Updated weights for policy 0, policy_version 773917 (0.0008) [2023-12-26 05:46:12,848][123090] Updated weights for policy 1, policy_version 768754 (0.0006) [2023-12-26 05:46:12,877][123091] Updated weights for policy 0, policy_version 773927 (0.0008) [2023-12-26 05:46:12,913][123090] Updated weights for policy 1, policy_version 768764 (0.0005) [2023-12-26 05:46:13,631][123090] Updated weights for policy 1, policy_version 768774 (0.0007) [2023-12-26 05:46:13,648][123091] Updated weights for policy 0, policy_version 773937 (0.0008) [2023-12-26 05:46:13,690][123090] Updated weights for policy 1, policy_version 768784 (0.0009) [2023-12-26 05:46:13,708][123091] Updated weights for policy 0, policy_version 773947 (0.0006) [2023-12-26 05:46:13,748][123090] Updated weights for policy 1, policy_version 768794 (0.0008) [2023-12-26 05:46:13,770][123091] Updated weights for policy 0, policy_version 773957 (0.0006) [2023-12-26 05:46:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 394944512. Throughput: 0: 8938.5, 1: 8845.2. Samples: 394937596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:13,784][121949] Avg episode reward: [(0, '5718.701'), (1, '4199.440')] [2023-12-26 05:46:13,839][123091] Updated weights for policy 0, policy_version 773967 (0.0005) [2023-12-26 05:46:14,448][123091] Updated weights for policy 0, policy_version 773977 (0.0005) [2023-12-26 05:46:14,499][123091] Updated weights for policy 0, policy_version 773987 (0.0005) [2023-12-26 05:46:14,547][123091] Updated weights for policy 0, policy_version 773997 (0.0005) [2023-12-26 05:46:14,647][123090] Updated weights for policy 1, policy_version 768804 (0.0009) [2023-12-26 05:46:14,698][123090] Updated weights for policy 1, policy_version 768814 (0.0008) [2023-12-26 05:46:14,751][123090] Updated weights for policy 1, policy_version 768824 (0.0009) [2023-12-26 05:46:15,318][123091] Updated weights for policy 0, policy_version 774007 (0.0007) [2023-12-26 05:46:15,383][123091] Updated weights for policy 0, policy_version 774017 (0.0009) [2023-12-26 05:46:15,434][123091] Updated weights for policy 0, policy_version 774027 (0.0010) [2023-12-26 05:46:15,583][123090] Updated weights for policy 1, policy_version 768834 (0.0008) [2023-12-26 05:46:15,654][123090] Updated weights for policy 1, policy_version 768844 (0.0006) [2023-12-26 05:46:15,729][123090] Updated weights for policy 1, policy_version 768854 (0.0009) [2023-12-26 05:46:15,796][123090] Updated weights for policy 1, policy_version 768864 (0.0010) [2023-12-26 05:46:16,084][123091] Updated weights for policy 0, policy_version 774037 (0.0008) [2023-12-26 05:46:16,132][123091] Updated weights for policy 0, policy_version 774047 (0.0005) [2023-12-26 05:46:16,179][123091] Updated weights for policy 0, policy_version 774057 (0.0005) [2023-12-26 05:46:16,688][123090] Updated weights for policy 1, policy_version 768874 (0.0006) [2023-12-26 05:46:16,744][123090] Updated weights for policy 1, policy_version 768884 (0.0006) [2023-12-26 05:46:16,806][123090] Updated weights for policy 1, policy_version 768894 (0.0006) [2023-12-26 05:46:16,847][123091] Updated weights for policy 0, policy_version 774067 (0.0006) [2023-12-26 05:46:16,914][123091] Updated weights for policy 0, policy_version 774077 (0.0005) [2023-12-26 05:46:16,963][123091] Updated weights for policy 0, policy_version 774087 (0.0005) [2023-12-26 05:46:17,517][123090] Updated weights for policy 1, policy_version 768904 (0.0008) [2023-12-26 05:46:17,567][123090] Updated weights for policy 1, policy_version 768914 (0.0009) [2023-12-26 05:46:17,615][123090] Updated weights for policy 1, policy_version 768924 (0.0008) [2023-12-26 05:46:17,699][123091] Updated weights for policy 0, policy_version 774097 (0.0007) [2023-12-26 05:46:17,758][123091] Updated weights for policy 0, policy_version 774107 (0.0005) [2023-12-26 05:46:17,806][123091] Updated weights for policy 0, policy_version 774117 (0.0008) [2023-12-26 05:46:17,855][123091] Updated weights for policy 0, policy_version 774127 (0.0009) [2023-12-26 05:46:18,459][123090] Updated weights for policy 1, policy_version 768934 (0.0007) [2023-12-26 05:46:18,528][123090] Updated weights for policy 1, policy_version 768944 (0.0005) [2023-12-26 05:46:18,590][123090] Updated weights for policy 1, policy_version 768954 (0.0010) [2023-12-26 05:46:18,653][123091] Updated weights for policy 0, policy_version 774137 (0.0005) [2023-12-26 05:46:18,719][123091] Updated weights for policy 0, policy_version 774147 (0.0005) [2023-12-26 05:46:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 395034624. Throughput: 0: 9009.2, 1: 8725.7. Samples: 395047472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:18,785][121949] Avg episode reward: [(0, '5801.166'), (1, '4292.471')] [2023-12-26 05:46:18,788][123091] Updated weights for policy 0, policy_version 774157 (0.0005) [2023-12-26 05:46:19,472][123090] Updated weights for policy 1, policy_version 768964 (0.0010) [2023-12-26 05:46:19,503][123091] Updated weights for policy 0, policy_version 774167 (0.0008) [2023-12-26 05:46:19,541][123090] Updated weights for policy 1, policy_version 768974 (0.0008) [2023-12-26 05:46:19,569][123091] Updated weights for policy 0, policy_version 774177 (0.0011) [2023-12-26 05:46:19,605][123090] Updated weights for policy 1, policy_version 768984 (0.0006) [2023-12-26 05:46:19,634][123091] Updated weights for policy 0, policy_version 774187 (0.0008) [2023-12-26 05:46:20,442][123090] Updated weights for policy 1, policy_version 768994 (0.0009) [2023-12-26 05:46:20,494][123091] Updated weights for policy 0, policy_version 774197 (0.0009) [2023-12-26 05:46:20,513][123090] Updated weights for policy 1, policy_version 769004 (0.0010) [2023-12-26 05:46:20,564][123091] Updated weights for policy 0, policy_version 774207 (0.0007) [2023-12-26 05:46:20,582][123090] Updated weights for policy 1, policy_version 769014 (0.0011) [2023-12-26 05:46:20,632][123091] Updated weights for policy 0, policy_version 774217 (0.0008) [2023-12-26 05:46:20,647][123090] Updated weights for policy 1, policy_version 769024 (0.0011) [2023-12-26 05:46:21,479][123090] Updated weights for policy 1, policy_version 769034 (0.0005) [2023-12-26 05:46:21,547][123091] Updated weights for policy 0, policy_version 774227 (0.0008) [2023-12-26 05:46:21,551][123090] Updated weights for policy 1, policy_version 769044 (0.0005) [2023-12-26 05:46:21,607][123091] Updated weights for policy 0, policy_version 774237 (0.0010) [2023-12-26 05:46:21,622][123090] Updated weights for policy 1, policy_version 769054 (0.0006) [2023-12-26 05:46:21,671][123091] Updated weights for policy 0, policy_version 774247 (0.0009) [2023-12-26 05:46:22,373][123090] Updated weights for policy 1, policy_version 769064 (0.0009) [2023-12-26 05:46:22,443][123090] Updated weights for policy 1, policy_version 769074 (0.0009) [2023-12-26 05:46:22,512][123090] Updated weights for policy 1, policy_version 769084 (0.0010) [2023-12-26 05:46:22,567][123091] Updated weights for policy 0, policy_version 774257 (0.0009) [2023-12-26 05:46:22,636][123091] Updated weights for policy 0, policy_version 774267 (0.0010) [2023-12-26 05:46:22,695][123091] Updated weights for policy 0, policy_version 774277 (0.0009) [2023-12-26 05:46:22,759][123091] Updated weights for policy 0, policy_version 774287 (0.0008) [2023-12-26 05:46:23,388][123090] Updated weights for policy 1, policy_version 769094 (0.0009) [2023-12-26 05:46:23,454][123090] Updated weights for policy 1, policy_version 769104 (0.0010) [2023-12-26 05:46:23,507][123091] Updated weights for policy 0, policy_version 774297 (0.0010) [2023-12-26 05:46:23,514][123090] Updated weights for policy 1, policy_version 769114 (0.0007) [2023-12-26 05:46:23,571][123091] Updated weights for policy 0, policy_version 774307 (0.0009) [2023-12-26 05:46:23,636][123091] Updated weights for policy 0, policy_version 774317 (0.0009) [2023-12-26 05:46:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 395124736. Throughput: 0: 8969.3, 1: 8662.1. Samples: 395097596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:23,785][121949] Avg episode reward: [(0, '5677.368'), (1, '4339.431')] [2023-12-26 05:46:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000774320_198230016.pth... [2023-12-26 05:46:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000769120_196894720.pth... [2023-12-26 05:46:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000773264_197959680.pth [2023-12-26 05:46:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000768096_196632576.pth [2023-12-26 05:46:24,356][123090] Updated weights for policy 1, policy_version 769124 (0.0009) [2023-12-26 05:46:24,424][123090] Updated weights for policy 1, policy_version 769134 (0.0009) [2023-12-26 05:46:24,455][123091] Updated weights for policy 0, policy_version 774327 (0.0009) [2023-12-26 05:46:24,480][123090] Updated weights for policy 1, policy_version 769144 (0.0007) [2023-12-26 05:46:24,505][123091] Updated weights for policy 0, policy_version 774337 (0.0008) [2023-12-26 05:46:24,558][123091] Updated weights for policy 0, policy_version 774347 (0.0010) [2023-12-26 05:46:25,172][123090] Updated weights for policy 1, policy_version 769154 (0.0008) [2023-12-26 05:46:25,229][123090] Updated weights for policy 1, policy_version 769164 (0.0006) [2023-12-26 05:46:25,292][123090] Updated weights for policy 1, policy_version 769174 (0.0007) [2023-12-26 05:46:25,295][123091] Updated weights for policy 0, policy_version 774357 (0.0009) [2023-12-26 05:46:25,352][123090] Updated weights for policy 1, policy_version 769184 (0.0010) [2023-12-26 05:46:25,356][123091] Updated weights for policy 0, policy_version 774367 (0.0009) [2023-12-26 05:46:25,406][123091] Updated weights for policy 0, policy_version 774377 (0.0009) [2023-12-26 05:46:26,031][123091] Updated weights for policy 0, policy_version 774387 (0.0008) [2023-12-26 05:46:26,090][123091] Updated weights for policy 0, policy_version 774397 (0.0005) [2023-12-26 05:46:26,143][123091] Updated weights for policy 0, policy_version 774407 (0.0005) [2023-12-26 05:46:26,178][123090] Updated weights for policy 1, policy_version 769194 (0.0008) [2023-12-26 05:46:26,230][123090] Updated weights for policy 1, policy_version 769204 (0.0010) [2023-12-26 05:46:26,286][123090] Updated weights for policy 1, policy_version 769214 (0.0009) [2023-12-26 05:46:26,833][123091] Updated weights for policy 0, policy_version 774417 (0.0005) [2023-12-26 05:46:26,879][123091] Updated weights for policy 0, policy_version 774427 (0.0006) [2023-12-26 05:46:26,926][123091] Updated weights for policy 0, policy_version 774437 (0.0005) [2023-12-26 05:46:26,984][123091] Updated weights for policy 0, policy_version 774447 (0.0005) [2023-12-26 05:46:27,216][123090] Updated weights for policy 1, policy_version 769224 (0.0009) [2023-12-26 05:46:27,271][123090] Updated weights for policy 1, policy_version 769234 (0.0009) [2023-12-26 05:46:27,326][123090] Updated weights for policy 1, policy_version 769244 (0.0010) [2023-12-26 05:46:27,733][123091] Updated weights for policy 0, policy_version 774457 (0.0005) [2023-12-26 05:46:27,788][123091] Updated weights for policy 0, policy_version 774467 (0.0005) [2023-12-26 05:46:27,833][123091] Updated weights for policy 0, policy_version 774477 (0.0005) [2023-12-26 05:46:28,200][123090] Updated weights for policy 1, policy_version 769254 (0.0009) [2023-12-26 05:46:28,255][123090] Updated weights for policy 1, policy_version 769264 (0.0009) [2023-12-26 05:46:28,306][123090] Updated weights for policy 1, policy_version 769274 (0.0009) [2023-12-26 05:46:28,563][123091] Updated weights for policy 0, policy_version 774487 (0.0008) [2023-12-26 05:46:28,614][123091] Updated weights for policy 0, policy_version 774497 (0.0009) [2023-12-26 05:46:28,671][123091] Updated weights for policy 0, policy_version 774507 (0.0009) [2023-12-26 05:46:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 395214848. Throughput: 0: 9055.0, 1: 8673.8. Samples: 395204744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:28,785][121949] Avg episode reward: [(0, '5501.725'), (1, '4045.272')] [2023-12-26 05:46:29,167][123090] Updated weights for policy 1, policy_version 769284 (0.0009) [2023-12-26 05:46:29,224][123090] Updated weights for policy 1, policy_version 769295 (0.0009) [2023-12-26 05:46:29,295][123090] Updated weights for policy 1, policy_version 769305 (0.0009) [2023-12-26 05:46:29,514][123091] Updated weights for policy 0, policy_version 774517 (0.0009) [2023-12-26 05:46:29,578][123091] Updated weights for policy 0, policy_version 774527 (0.0008) [2023-12-26 05:46:29,646][123091] Updated weights for policy 0, policy_version 774537 (0.0008) [2023-12-26 05:46:30,232][123090] Updated weights for policy 1, policy_version 769315 (0.0009) [2023-12-26 05:46:30,302][123090] Updated weights for policy 1, policy_version 769325 (0.0010) [2023-12-26 05:46:30,378][123090] Updated weights for policy 1, policy_version 769335 (0.0010) [2023-12-26 05:46:30,389][123091] Updated weights for policy 0, policy_version 774547 (0.0007) [2023-12-26 05:46:30,442][123091] Updated weights for policy 0, policy_version 774557 (0.0006) [2023-12-26 05:46:30,506][123091] Updated weights for policy 0, policy_version 774567 (0.0008) [2023-12-26 05:46:31,177][123090] Updated weights for policy 1, policy_version 769345 (0.0009) [2023-12-26 05:46:31,242][123090] Updated weights for policy 1, policy_version 769355 (0.0009) [2023-12-26 05:46:31,300][123090] Updated weights for policy 1, policy_version 769365 (0.0009) [2023-12-26 05:46:31,341][123091] Updated weights for policy 0, policy_version 774577 (0.0008) [2023-12-26 05:46:31,352][123090] Updated weights for policy 1, policy_version 769375 (0.0008) [2023-12-26 05:46:31,407][123091] Updated weights for policy 0, policy_version 774587 (0.0009) [2023-12-26 05:46:31,458][123091] Updated weights for policy 0, policy_version 774597 (0.0010) [2023-12-26 05:46:31,512][123091] Updated weights for policy 0, policy_version 774607 (0.0010) [2023-12-26 05:46:32,207][123090] Updated weights for policy 1, policy_version 769385 (0.0009) [2023-12-26 05:46:32,268][123090] Updated weights for policy 1, policy_version 769395 (0.0009) [2023-12-26 05:46:32,301][123091] Updated weights for policy 0, policy_version 774617 (0.0007) [2023-12-26 05:46:32,329][123090] Updated weights for policy 1, policy_version 769405 (0.0009) [2023-12-26 05:46:32,359][123091] Updated weights for policy 0, policy_version 774627 (0.0008) [2023-12-26 05:46:32,419][123091] Updated weights for policy 0, policy_version 774637 (0.0008) [2023-12-26 05:46:33,166][123090] Updated weights for policy 1, policy_version 769415 (0.0006) [2023-12-26 05:46:33,223][123090] Updated weights for policy 1, policy_version 769425 (0.0009) [2023-12-26 05:46:33,283][123090] Updated weights for policy 1, policy_version 769435 (0.0009) [2023-12-26 05:46:33,287][123091] Updated weights for policy 0, policy_version 774647 (0.0009) [2023-12-26 05:46:33,345][123091] Updated weights for policy 0, policy_version 774657 (0.0010) [2023-12-26 05:46:33,395][123091] Updated weights for policy 0, policy_version 774667 (0.0008) [2023-12-26 05:46:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 395296768. Throughput: 0: 8999.6, 1: 8610.0. Samples: 395308176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:33,785][121949] Avg episode reward: [(0, '5533.985'), (1, '4475.906')] [2023-12-26 05:46:34,046][123091] Updated weights for policy 0, policy_version 774677 (0.0005) [2023-12-26 05:46:34,091][123091] Updated weights for policy 0, policy_version 774687 (0.0005) [2023-12-26 05:46:34,159][123091] Updated weights for policy 0, policy_version 774697 (0.0006) [2023-12-26 05:46:34,163][123090] Updated weights for policy 1, policy_version 769445 (0.0009) [2023-12-26 05:46:34,226][123090] Updated weights for policy 1, policy_version 769455 (0.0009) [2023-12-26 05:46:34,292][123090] Updated weights for policy 1, policy_version 769465 (0.0009) [2023-12-26 05:46:34,918][123091] Updated weights for policy 0, policy_version 774707 (0.0007) [2023-12-26 05:46:34,976][123091] Updated weights for policy 0, policy_version 774717 (0.0005) [2023-12-26 05:46:35,045][123091] Updated weights for policy 0, policy_version 774727 (0.0011) [2023-12-26 05:46:35,109][123090] Updated weights for policy 1, policy_version 769475 (0.0009) [2023-12-26 05:46:35,173][123090] Updated weights for policy 1, policy_version 769485 (0.0009) [2023-12-26 05:46:35,236][123090] Updated weights for policy 1, policy_version 769495 (0.0009) [2023-12-26 05:46:35,833][123091] Updated weights for policy 0, policy_version 774737 (0.0011) [2023-12-26 05:46:35,893][123091] Updated weights for policy 0, policy_version 774747 (0.0011) [2023-12-26 05:46:35,946][123091] Updated weights for policy 0, policy_version 774757 (0.0010) [2023-12-26 05:46:35,999][123091] Updated weights for policy 0, policy_version 774767 (0.0011) [2023-12-26 05:46:36,067][123090] Updated weights for policy 1, policy_version 769505 (0.0009) [2023-12-26 05:46:36,136][123090] Updated weights for policy 1, policy_version 769515 (0.0009) [2023-12-26 05:46:36,209][123090] Updated weights for policy 1, policy_version 769525 (0.0009) [2023-12-26 05:46:36,286][123090] Updated weights for policy 1, policy_version 769535 (0.0009) [2023-12-26 05:46:36,865][123091] Updated weights for policy 0, policy_version 774777 (0.0009) [2023-12-26 05:46:36,928][123091] Updated weights for policy 0, policy_version 774787 (0.0009) [2023-12-26 05:46:36,994][123091] Updated weights for policy 0, policy_version 774797 (0.0010) [2023-12-26 05:46:37,148][123090] Updated weights for policy 1, policy_version 769545 (0.0010) [2023-12-26 05:46:37,209][123090] Updated weights for policy 1, policy_version 769555 (0.0009) [2023-12-26 05:46:37,271][123090] Updated weights for policy 1, policy_version 769565 (0.0010) [2023-12-26 05:46:37,669][123091] Updated weights for policy 0, policy_version 774807 (0.0009) [2023-12-26 05:46:37,732][123091] Updated weights for policy 0, policy_version 774817 (0.0011) [2023-12-26 05:46:37,787][123091] Updated weights for policy 0, policy_version 774827 (0.0011) [2023-12-26 05:46:38,162][123090] Updated weights for policy 1, policy_version 769575 (0.0009) [2023-12-26 05:46:38,213][123090] Updated weights for policy 1, policy_version 769585 (0.0008) [2023-12-26 05:46:38,265][123090] Updated weights for policy 1, policy_version 769595 (0.0009) [2023-12-26 05:46:38,619][123091] Updated weights for policy 0, policy_version 774837 (0.0010) [2023-12-26 05:46:38,678][123091] Updated weights for policy 0, policy_version 774847 (0.0011) [2023-12-26 05:46:38,730][123091] Updated weights for policy 0, policy_version 774857 (0.0011) [2023-12-26 05:46:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 395386880. Throughput: 0: 8984.1, 1: 8585.8. Samples: 395359916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:38,785][121949] Avg episode reward: [(0, '5823.514'), (1, '4838.167')] [2023-12-26 05:46:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000774864_198369280.pth... [2023-12-26 05:46:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000769600_197017600.pth... [2023-12-26 05:46:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000768608_196763648.pth [2023-12-26 05:46:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000773808_198098944.pth [2023-12-26 05:46:39,126][123090] Updated weights for policy 1, policy_version 769605 (0.0009) [2023-12-26 05:46:39,175][123090] Updated weights for policy 1, policy_version 769615 (0.0009) [2023-12-26 05:46:39,225][123090] Updated weights for policy 1, policy_version 769625 (0.0009) [2023-12-26 05:46:39,623][123091] Updated weights for policy 0, policy_version 774867 (0.0009) [2023-12-26 05:46:39,699][123091] Updated weights for policy 0, policy_version 774877 (0.0006) [2023-12-26 05:46:39,768][123091] Updated weights for policy 0, policy_version 774887 (0.0010) [2023-12-26 05:46:40,133][123090] Updated weights for policy 1, policy_version 769635 (0.0009) [2023-12-26 05:46:40,190][123090] Updated weights for policy 1, policy_version 769645 (0.0009) [2023-12-26 05:46:40,246][123090] Updated weights for policy 1, policy_version 769655 (0.0009) [2023-12-26 05:46:40,586][123091] Updated weights for policy 0, policy_version 774897 (0.0011) [2023-12-26 05:46:40,642][123091] Updated weights for policy 0, policy_version 774907 (0.0006) [2023-12-26 05:46:40,706][123091] Updated weights for policy 0, policy_version 774917 (0.0006) [2023-12-26 05:46:40,761][123091] Updated weights for policy 0, policy_version 774927 (0.0005) [2023-12-26 05:46:41,068][123090] Updated weights for policy 1, policy_version 769665 (0.0009) [2023-12-26 05:46:41,140][123090] Updated weights for policy 1, policy_version 769675 (0.0009) [2023-12-26 05:46:41,210][123090] Updated weights for policy 1, policy_version 769685 (0.0009) [2023-12-26 05:46:41,281][123090] Updated weights for policy 1, policy_version 769695 (0.0009) [2023-12-26 05:46:41,556][123091] Updated weights for policy 0, policy_version 774937 (0.0010) [2023-12-26 05:46:41,629][123091] Updated weights for policy 0, policy_version 774947 (0.0011) [2023-12-26 05:46:41,700][123091] Updated weights for policy 0, policy_version 774957 (0.0011) [2023-12-26 05:46:42,190][123090] Updated weights for policy 1, policy_version 769705 (0.0009) [2023-12-26 05:46:42,263][123090] Updated weights for policy 1, policy_version 769715 (0.0009) [2023-12-26 05:46:42,332][123090] Updated weights for policy 1, policy_version 769725 (0.0009) [2023-12-26 05:46:42,527][123091] Updated weights for policy 0, policy_version 774967 (0.0011) [2023-12-26 05:46:42,590][123091] Updated weights for policy 0, policy_version 774977 (0.0011) [2023-12-26 05:46:42,654][123091] Updated weights for policy 0, policy_version 774987 (0.0011) [2023-12-26 05:46:43,164][123090] Updated weights for policy 1, policy_version 769735 (0.0009) [2023-12-26 05:46:43,228][123090] Updated weights for policy 1, policy_version 769745 (0.0009) [2023-12-26 05:46:43,285][123090] Updated weights for policy 1, policy_version 769756 (0.0010) [2023-12-26 05:46:43,421][123091] Updated weights for policy 0, policy_version 774997 (0.0008) [2023-12-26 05:46:43,468][123091] Updated weights for policy 0, policy_version 775007 (0.0005) [2023-12-26 05:46:43,518][123091] Updated weights for policy 0, policy_version 775017 (0.0009) [2023-12-26 05:46:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 395468800. Throughput: 0: 8900.7, 1: 8441.6. Samples: 395460976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:43,785][121949] Avg episode reward: [(0, '5938.692'), (1, '4599.318')] [2023-12-26 05:46:44,174][123091] Updated weights for policy 0, policy_version 775027 (0.0009) [2023-12-26 05:46:44,218][123090] Updated weights for policy 1, policy_version 769766 (0.0010) [2023-12-26 05:46:44,229][123091] Updated weights for policy 0, policy_version 775037 (0.0007) [2023-12-26 05:46:44,289][123091] Updated weights for policy 0, policy_version 775047 (0.0005) [2023-12-26 05:46:44,294][123090] Updated weights for policy 1, policy_version 769776 (0.0008) [2023-12-26 05:46:44,360][123090] Updated weights for policy 1, policy_version 769786 (0.0009) [2023-12-26 05:46:44,982][123091] Updated weights for policy 0, policy_version 775057 (0.0005) [2023-12-26 05:46:45,045][123091] Updated weights for policy 0, policy_version 775067 (0.0006) [2023-12-26 05:46:45,117][123091] Updated weights for policy 0, policy_version 775077 (0.0006) [2023-12-26 05:46:45,184][123091] Updated weights for policy 0, policy_version 775087 (0.0009) [2023-12-26 05:46:45,262][123090] Updated weights for policy 1, policy_version 769796 (0.0010) [2023-12-26 05:46:45,330][123090] Updated weights for policy 1, policy_version 769806 (0.0010) [2023-12-26 05:46:45,393][123090] Updated weights for policy 1, policy_version 769816 (0.0010) [2023-12-26 05:46:45,920][123091] Updated weights for policy 0, policy_version 775097 (0.0006) [2023-12-26 05:46:45,974][123091] Updated weights for policy 0, policy_version 775107 (0.0006) [2023-12-26 05:46:46,038][123091] Updated weights for policy 0, policy_version 775117 (0.0006) [2023-12-26 05:46:46,290][123090] Updated weights for policy 1, policy_version 769827 (0.0010) [2023-12-26 05:46:46,345][123090] Updated weights for policy 1, policy_version 769837 (0.0010) [2023-12-26 05:46:46,402][123090] Updated weights for policy 1, policy_version 769847 (0.0009) [2023-12-26 05:46:46,652][123091] Updated weights for policy 0, policy_version 775127 (0.0007) [2023-12-26 05:46:46,715][123091] Updated weights for policy 0, policy_version 775137 (0.0007) [2023-12-26 05:46:46,776][123091] Updated weights for policy 0, policy_version 775147 (0.0009) [2023-12-26 05:46:47,165][123090] Updated weights for policy 1, policy_version 769857 (0.0011) [2023-12-26 05:46:47,220][123090] Updated weights for policy 1, policy_version 769867 (0.0009) [2023-12-26 05:46:47,274][123090] Updated weights for policy 1, policy_version 769877 (0.0009) [2023-12-26 05:46:47,331][123090] Updated weights for policy 1, policy_version 769887 (0.0009) [2023-12-26 05:46:47,534][123091] Updated weights for policy 0, policy_version 775157 (0.0007) [2023-12-26 05:46:47,588][123091] Updated weights for policy 0, policy_version 775167 (0.0005) [2023-12-26 05:46:47,635][123091] Updated weights for policy 0, policy_version 775177 (0.0005) [2023-12-26 05:46:48,202][123090] Updated weights for policy 1, policy_version 769897 (0.0009) [2023-12-26 05:46:48,255][123090] Updated weights for policy 1, policy_version 769907 (0.0009) [2023-12-26 05:46:48,304][123090] Updated weights for policy 1, policy_version 769917 (0.0008) [2023-12-26 05:46:48,387][123091] Updated weights for policy 0, policy_version 775187 (0.0006) [2023-12-26 05:46:48,451][123091] Updated weights for policy 0, policy_version 775197 (0.0009) [2023-12-26 05:46:48,510][123091] Updated weights for policy 0, policy_version 775207 (0.0010) [2023-12-26 05:46:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 395558912. Throughput: 0: 8996.9, 1: 8395.5. Samples: 395567556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:48,785][121949] Avg episode reward: [(0, '6004.079'), (1, '4466.463')] [2023-12-26 05:46:49,143][123090] Updated weights for policy 1, policy_version 769927 (0.0010) [2023-12-26 05:46:49,205][123090] Updated weights for policy 1, policy_version 769937 (0.0010) [2023-12-26 05:46:49,280][123090] Updated weights for policy 1, policy_version 769947 (0.0010) [2023-12-26 05:46:49,377][123091] Updated weights for policy 0, policy_version 775217 (0.0010) [2023-12-26 05:46:49,440][123091] Updated weights for policy 0, policy_version 775227 (0.0010) [2023-12-26 05:46:49,499][123091] Updated weights for policy 0, policy_version 775237 (0.0011) [2023-12-26 05:46:49,562][123091] Updated weights for policy 0, policy_version 775247 (0.0011) [2023-12-26 05:46:50,151][123090] Updated weights for policy 1, policy_version 769957 (0.0010) [2023-12-26 05:46:50,210][123090] Updated weights for policy 1, policy_version 769967 (0.0010) [2023-12-26 05:46:50,280][123090] Updated weights for policy 1, policy_version 769977 (0.0010) [2023-12-26 05:46:50,338][123091] Updated weights for policy 0, policy_version 775257 (0.0011) [2023-12-26 05:46:50,400][123091] Updated weights for policy 0, policy_version 775267 (0.0011) [2023-12-26 05:46:50,458][123091] Updated weights for policy 0, policy_version 775277 (0.0010) [2023-12-26 05:46:51,116][123090] Updated weights for policy 1, policy_version 769987 (0.0010) [2023-12-26 05:46:51,188][123090] Updated weights for policy 1, policy_version 769997 (0.0011) [2023-12-26 05:46:51,254][123090] Updated weights for policy 1, policy_version 770007 (0.0010) [2023-12-26 05:46:51,284][123091] Updated weights for policy 0, policy_version 775287 (0.0010) [2023-12-26 05:46:51,345][123091] Updated weights for policy 0, policy_version 775297 (0.0010) [2023-12-26 05:46:51,409][123091] Updated weights for policy 0, policy_version 775307 (0.0010) [2023-12-26 05:46:52,053][123090] Updated weights for policy 1, policy_version 770017 (0.0009) [2023-12-26 05:46:52,127][123090] Updated weights for policy 1, policy_version 770027 (0.0010) [2023-12-26 05:46:52,197][123090] Updated weights for policy 1, policy_version 770037 (0.0007) [2023-12-26 05:46:52,271][123091] Updated weights for policy 0, policy_version 775317 (0.0010) [2023-12-26 05:46:52,273][123090] Updated weights for policy 1, policy_version 770047 (0.0006) [2023-12-26 05:46:52,338][123091] Updated weights for policy 0, policy_version 775327 (0.0010) [2023-12-26 05:46:52,409][123091] Updated weights for policy 0, policy_version 775337 (0.0006) [2023-12-26 05:46:52,928][123090] Updated weights for policy 1, policy_version 770057 (0.0006) [2023-12-26 05:46:52,999][123090] Updated weights for policy 1, policy_version 770067 (0.0006) [2023-12-26 05:46:53,074][123090] Updated weights for policy 1, policy_version 770077 (0.0005) [2023-12-26 05:46:53,179][123091] Updated weights for policy 0, policy_version 775347 (0.0007) [2023-12-26 05:46:53,240][123091] Updated weights for policy 0, policy_version 775357 (0.0010) [2023-12-26 05:46:53,295][123091] Updated weights for policy 0, policy_version 775367 (0.0011) [2023-12-26 05:46:53,730][123090] Updated weights for policy 1, policy_version 770087 (0.0006) [2023-12-26 05:46:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 395640832. Throughput: 0: 8983.3, 1: 8383.0. Samples: 395618912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:53,785][121949] Avg episode reward: [(0, '5916.665'), (1, '4865.786')] [2023-12-26 05:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000775376_198500352.pth... [2023-12-26 05:46:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000774320_198230016.pth [2023-12-26 05:46:53,802][123090] Updated weights for policy 1, policy_version 770097 (0.0007) [2023-12-26 05:46:53,858][123090] Updated weights for policy 1, policy_version 770107 (0.0009) [2023-12-26 05:46:53,890][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000770112_197148672.pth... [2023-12-26 05:46:53,894][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000769120_196894720.pth [2023-12-26 05:46:54,033][123091] Updated weights for policy 0, policy_version 775377 (0.0010) [2023-12-26 05:46:54,101][123091] Updated weights for policy 0, policy_version 775387 (0.0005) [2023-12-26 05:46:54,163][123091] Updated weights for policy 0, policy_version 775397 (0.0008) [2023-12-26 05:46:54,215][123091] Updated weights for policy 0, policy_version 775407 (0.0008) [2023-12-26 05:46:54,713][123090] Updated weights for policy 1, policy_version 770117 (0.0010) [2023-12-26 05:46:54,780][123090] Updated weights for policy 1, policy_version 770127 (0.0009) [2023-12-26 05:46:54,840][123090] Updated weights for policy 1, policy_version 770137 (0.0009) [2023-12-26 05:46:54,908][123091] Updated weights for policy 0, policy_version 775417 (0.0008) [2023-12-26 05:46:54,973][123091] Updated weights for policy 0, policy_version 775427 (0.0011) [2023-12-26 05:46:55,038][123091] Updated weights for policy 0, policy_version 775437 (0.0007) [2023-12-26 05:46:55,685][123090] Updated weights for policy 1, policy_version 770147 (0.0009) [2023-12-26 05:46:55,701][123091] Updated weights for policy 0, policy_version 775447 (0.0006) [2023-12-26 05:46:55,749][123090] Updated weights for policy 1, policy_version 770157 (0.0009) [2023-12-26 05:46:55,751][123091] Updated weights for policy 0, policy_version 775457 (0.0008) [2023-12-26 05:46:55,811][123090] Updated weights for policy 1, policy_version 770167 (0.0008) [2023-12-26 05:46:55,814][123091] Updated weights for policy 0, policy_version 775467 (0.0009) [2023-12-26 05:46:56,557][123091] Updated weights for policy 0, policy_version 775477 (0.0007) [2023-12-26 05:46:56,604][123091] Updated weights for policy 0, policy_version 775487 (0.0005) [2023-12-26 05:46:56,650][123090] Updated weights for policy 1, policy_version 770177 (0.0010) [2023-12-26 05:46:56,654][123091] Updated weights for policy 0, policy_version 775497 (0.0006) [2023-12-26 05:46:56,706][123090] Updated weights for policy 1, policy_version 770187 (0.0009) [2023-12-26 05:46:56,785][123090] Updated weights for policy 1, policy_version 770197 (0.0010) [2023-12-26 05:46:56,858][123090] Updated weights for policy 1, policy_version 770207 (0.0010) [2023-12-26 05:46:57,388][123091] Updated weights for policy 0, policy_version 775507 (0.0009) [2023-12-26 05:46:57,434][123091] Updated weights for policy 0, policy_version 775517 (0.0008) [2023-12-26 05:46:57,481][123091] Updated weights for policy 0, policy_version 775527 (0.0008) [2023-12-26 05:46:57,667][123090] Updated weights for policy 1, policy_version 770217 (0.0009) [2023-12-26 05:46:57,721][123090] Updated weights for policy 1, policy_version 770227 (0.0010) [2023-12-26 05:46:57,766][123090] Updated weights for policy 1, policy_version 770237 (0.0008) [2023-12-26 05:46:58,330][123091] Updated weights for policy 0, policy_version 775537 (0.0010) [2023-12-26 05:46:58,407][123091] Updated weights for policy 0, policy_version 775547 (0.0009) [2023-12-26 05:46:58,477][123091] Updated weights for policy 0, policy_version 775557 (0.0009) [2023-12-26 05:46:58,546][123091] Updated weights for policy 0, policy_version 775567 (0.0010) [2023-12-26 05:46:58,632][123090] Updated weights for policy 1, policy_version 770247 (0.0009) [2023-12-26 05:46:58,694][123090] Updated weights for policy 1, policy_version 770257 (0.0010) [2023-12-26 05:46:58,759][123090] Updated weights for policy 1, policy_version 770267 (0.0010) [2023-12-26 05:46:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 395730944. Throughput: 0: 9162.2, 1: 8407.7. Samples: 395728244. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:46:58,785][121949] Avg episode reward: [(0, '5870.625'), (1, '5109.810')] [2023-12-26 05:46:59,412][123091] Updated weights for policy 0, policy_version 775577 (0.0010) [2023-12-26 05:46:59,467][123091] Updated weights for policy 0, policy_version 775587 (0.0010) [2023-12-26 05:46:59,525][123091] Updated weights for policy 0, policy_version 775597 (0.0010) [2023-12-26 05:46:59,573][123090] Updated weights for policy 1, policy_version 770277 (0.0008) [2023-12-26 05:46:59,630][123090] Updated weights for policy 1, policy_version 770287 (0.0009) [2023-12-26 05:46:59,685][123090] Updated weights for policy 1, policy_version 770297 (0.0010) [2023-12-26 05:47:00,380][123091] Updated weights for policy 0, policy_version 775607 (0.0009) [2023-12-26 05:47:00,433][123091] Updated weights for policy 0, policy_version 775617 (0.0009) [2023-12-26 05:47:00,485][123091] Updated weights for policy 0, policy_version 775627 (0.0009) [2023-12-26 05:47:00,495][123090] Updated weights for policy 1, policy_version 770307 (0.0008) [2023-12-26 05:47:00,569][123090] Updated weights for policy 1, policy_version 770317 (0.0005) [2023-12-26 05:47:00,644][123090] Updated weights for policy 1, policy_version 770327 (0.0005) [2023-12-26 05:47:01,267][123090] Updated weights for policy 1, policy_version 770337 (0.0006) [2023-12-26 05:47:01,337][123090] Updated weights for policy 1, policy_version 770347 (0.0006) [2023-12-26 05:47:01,406][123091] Updated weights for policy 0, policy_version 775637 (0.0009) [2023-12-26 05:47:01,407][123090] Updated weights for policy 1, policy_version 770357 (0.0008) [2023-12-26 05:47:01,459][123090] Updated weights for policy 1, policy_version 770367 (0.0005) [2023-12-26 05:47:01,473][123091] Updated weights for policy 0, policy_version 775647 (0.0008) [2023-12-26 05:47:01,537][123091] Updated weights for policy 0, policy_version 775657 (0.0010) [2023-12-26 05:47:02,262][123090] Updated weights for policy 1, policy_version 770377 (0.0009) [2023-12-26 05:47:02,337][123090] Updated weights for policy 1, policy_version 770387 (0.0009) [2023-12-26 05:47:02,360][123091] Updated weights for policy 0, policy_version 775667 (0.0008) [2023-12-26 05:47:02,409][123090] Updated weights for policy 1, policy_version 770397 (0.0008) [2023-12-26 05:47:02,420][123091] Updated weights for policy 0, policy_version 775677 (0.0007) [2023-12-26 05:47:02,470][123091] Updated weights for policy 0, policy_version 775687 (0.0008) [2023-12-26 05:47:03,071][123090] Updated weights for policy 1, policy_version 770408 (0.0007) [2023-12-26 05:47:03,122][123090] Updated weights for policy 1, policy_version 770418 (0.0005) [2023-12-26 05:47:03,174][123090] Updated weights for policy 1, policy_version 770428 (0.0006) [2023-12-26 05:47:03,347][123091] Updated weights for policy 0, policy_version 775697 (0.0010) [2023-12-26 05:47:03,401][123091] Updated weights for policy 0, policy_version 775707 (0.0009) [2023-12-26 05:47:03,463][123091] Updated weights for policy 0, policy_version 775717 (0.0010) [2023-12-26 05:47:03,524][123091] Updated weights for policy 0, policy_version 775727 (0.0010) [2023-12-26 05:47:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 395821056. Throughput: 0: 8968.1, 1: 8470.3. Samples: 395832200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:47:03,785][121949] Avg episode reward: [(0, '5906.237'), (1, '4983.521')] [2023-12-26 05:47:03,966][123090] Updated weights for policy 1, policy_version 770438 (0.0009) [2023-12-26 05:47:04,031][123090] Updated weights for policy 1, policy_version 770448 (0.0010) [2023-12-26 05:47:04,099][123090] Updated weights for policy 1, policy_version 770458 (0.0010) [2023-12-26 05:47:04,372][123091] Updated weights for policy 0, policy_version 775737 (0.0011) [2023-12-26 05:47:04,440][123091] Updated weights for policy 0, policy_version 775747 (0.0011) [2023-12-26 05:47:04,507][123091] Updated weights for policy 0, policy_version 775757 (0.0011) [2023-12-26 05:47:04,976][123090] Updated weights for policy 1, policy_version 770468 (0.0009) [2023-12-26 05:47:05,042][123090] Updated weights for policy 1, policy_version 770478 (0.0010) [2023-12-26 05:47:05,099][123090] Updated weights for policy 1, policy_version 770488 (0.0010) [2023-12-26 05:47:05,155][123091] Updated weights for policy 0, policy_version 775767 (0.0006) [2023-12-26 05:47:05,221][123091] Updated weights for policy 0, policy_version 775777 (0.0008) [2023-12-26 05:47:05,290][123091] Updated weights for policy 0, policy_version 775787 (0.0007) [2023-12-26 05:47:05,838][123091] Updated weights for policy 0, policy_version 775797 (0.0008) [2023-12-26 05:47:05,896][123091] Updated weights for policy 0, policy_version 775807 (0.0010) [2023-12-26 05:47:05,961][123091] Updated weights for policy 0, policy_version 775817 (0.0008) [2023-12-26 05:47:05,984][123090] Updated weights for policy 1, policy_version 770498 (0.0009) [2023-12-26 05:47:06,054][123090] Updated weights for policy 1, policy_version 770508 (0.0009) [2023-12-26 05:47:06,119][123090] Updated weights for policy 1, policy_version 770518 (0.0009) [2023-12-26 05:47:06,178][123090] Updated weights for policy 1, policy_version 770528 (0.0009) [2023-12-26 05:47:06,778][123091] Updated weights for policy 0, policy_version 775827 (0.0007) [2023-12-26 05:47:06,855][123091] Updated weights for policy 0, policy_version 775837 (0.0006) [2023-12-26 05:47:06,925][123091] Updated weights for policy 0, policy_version 775847 (0.0005) [2023-12-26 05:47:07,039][123090] Updated weights for policy 1, policy_version 770538 (0.0009) [2023-12-26 05:47:07,096][123090] Updated weights for policy 1, policy_version 770548 (0.0009) [2023-12-26 05:47:07,160][123090] Updated weights for policy 1, policy_version 770558 (0.0009) [2023-12-26 05:47:07,684][123091] Updated weights for policy 0, policy_version 775857 (0.0006) [2023-12-26 05:47:07,749][123091] Updated weights for policy 0, policy_version 775867 (0.0010) [2023-12-26 05:47:07,815][123091] Updated weights for policy 0, policy_version 775877 (0.0010) [2023-12-26 05:47:07,874][123091] Updated weights for policy 0, policy_version 775887 (0.0010) [2023-12-26 05:47:07,999][123090] Updated weights for policy 1, policy_version 770568 (0.0009) [2023-12-26 05:47:08,071][123090] Updated weights for policy 1, policy_version 770578 (0.0010) [2023-12-26 05:47:08,135][123090] Updated weights for policy 1, policy_version 770589 (0.0010) [2023-12-26 05:47:08,674][123091] Updated weights for policy 0, policy_version 775897 (0.0006) [2023-12-26 05:47:08,736][123091] Updated weights for policy 0, policy_version 775907 (0.0005) [2023-12-26 05:47:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 395902976. Throughput: 0: 9049.6, 1: 8463.8. Samples: 395885696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:47:08,785][121949] Avg episode reward: [(0, '5794.919'), (1, '4883.512')] [2023-12-26 05:47:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000770592_197271552.pth... [2023-12-26 05:47:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000769600_197017600.pth [2023-12-26 05:47:08,811][123091] Updated weights for policy 0, policy_version 775917 (0.0009) [2023-12-26 05:47:08,830][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000775920_198639616.pth... [2023-12-26 05:47:08,835][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000774864_198369280.pth [2023-12-26 05:47:08,997][123090] Updated weights for policy 1, policy_version 770599 (0.0010) [2023-12-26 05:47:09,051][123090] Updated weights for policy 1, policy_version 770609 (0.0009) [2023-12-26 05:47:09,104][123090] Updated weights for policy 1, policy_version 770619 (0.0009) [2023-12-26 05:47:09,590][123091] Updated weights for policy 0, policy_version 775927 (0.0009) [2023-12-26 05:47:09,654][123091] Updated weights for policy 0, policy_version 775937 (0.0009) [2023-12-26 05:47:09,721][123091] Updated weights for policy 0, policy_version 775947 (0.0010) [2023-12-26 05:47:09,898][123090] Updated weights for policy 1, policy_version 770629 (0.0009) [2023-12-26 05:47:09,968][123090] Updated weights for policy 1, policy_version 770639 (0.0010) [2023-12-26 05:47:10,042][123090] Updated weights for policy 1, policy_version 770649 (0.0009) [2023-12-26 05:47:10,565][123091] Updated weights for policy 0, policy_version 775957 (0.0007) [2023-12-26 05:47:10,621][123091] Updated weights for policy 0, policy_version 775967 (0.0006) [2023-12-26 05:47:10,691][123091] Updated weights for policy 0, policy_version 775977 (0.0009) [2023-12-26 05:47:10,898][123090] Updated weights for policy 1, policy_version 770659 (0.0010) [2023-12-26 05:47:10,962][123090] Updated weights for policy 1, policy_version 770669 (0.0010) [2023-12-26 05:47:11,024][123090] Updated weights for policy 1, policy_version 770679 (0.0009) [2023-12-26 05:47:11,480][123091] Updated weights for policy 0, policy_version 775987 (0.0010) [2023-12-26 05:47:11,539][123091] Updated weights for policy 0, policy_version 775997 (0.0010) [2023-12-26 05:47:11,609][123091] Updated weights for policy 0, policy_version 776007 (0.0010) [2023-12-26 05:47:11,938][123090] Updated weights for policy 1, policy_version 770689 (0.0010) [2023-12-26 05:47:12,004][123090] Updated weights for policy 1, policy_version 770699 (0.0009) [2023-12-26 05:47:12,065][123090] Updated weights for policy 1, policy_version 770709 (0.0009) [2023-12-26 05:47:12,131][123090] Updated weights for policy 1, policy_version 770719 (0.0009) [2023-12-26 05:47:12,467][123091] Updated weights for policy 0, policy_version 776017 (0.0010) [2023-12-26 05:47:12,527][123091] Updated weights for policy 0, policy_version 776027 (0.0010) [2023-12-26 05:47:12,586][123091] Updated weights for policy 0, policy_version 776037 (0.0009) [2023-12-26 05:47:12,645][123091] Updated weights for policy 0, policy_version 776047 (0.0009) [2023-12-26 05:47:12,987][123090] Updated weights for policy 1, policy_version 770729 (0.0009) [2023-12-26 05:47:13,056][123090] Updated weights for policy 1, policy_version 770739 (0.0009) [2023-12-26 05:47:13,120][123090] Updated weights for policy 1, policy_version 770749 (0.0010) [2023-12-26 05:47:13,423][123091] Updated weights for policy 0, policy_version 776057 (0.0006) [2023-12-26 05:47:13,481][123091] Updated weights for policy 0, policy_version 776067 (0.0005) [2023-12-26 05:47:13,543][123091] Updated weights for policy 0, policy_version 776077 (0.0005) [2023-12-26 05:47:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 395993088. Throughput: 0: 8951.1, 1: 8427.1. Samples: 395986764. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:13,785][121949] Avg episode reward: [(0, '5982.483'), (1, '4976.356')] [2023-12-26 05:47:14,015][123090] Updated weights for policy 1, policy_version 770759 (0.0010) [2023-12-26 05:47:14,072][123090] Updated weights for policy 1, policy_version 770769 (0.0010) [2023-12-26 05:47:14,135][123090] Updated weights for policy 1, policy_version 770779 (0.0009) [2023-12-26 05:47:14,234][123091] Updated weights for policy 0, policy_version 776087 (0.0008) [2023-12-26 05:47:14,291][123091] Updated weights for policy 0, policy_version 776098 (0.0009) [2023-12-26 05:47:14,343][123091] Updated weights for policy 0, policy_version 776109 (0.0011) [2023-12-26 05:47:15,032][123090] Updated weights for policy 1, policy_version 770789 (0.0009) [2023-12-26 05:47:15,101][123090] Updated weights for policy 1, policy_version 770799 (0.0009) [2023-12-26 05:47:15,161][123090] Updated weights for policy 1, policy_version 770809 (0.0009) [2023-12-26 05:47:15,165][123091] Updated weights for policy 0, policy_version 776119 (0.0008) [2023-12-26 05:47:15,232][123091] Updated weights for policy 0, policy_version 776129 (0.0008) [2023-12-26 05:47:15,293][123091] Updated weights for policy 0, policy_version 776139 (0.0009) [2023-12-26 05:47:16,015][123090] Updated weights for policy 1, policy_version 770820 (0.0008) [2023-12-26 05:47:16,071][123090] Updated weights for policy 1, policy_version 770830 (0.0009) [2023-12-26 05:47:16,078][123091] Updated weights for policy 0, policy_version 776149 (0.0008) [2023-12-26 05:47:16,138][123090] Updated weights for policy 1, policy_version 770840 (0.0008) [2023-12-26 05:47:16,146][123091] Updated weights for policy 0, policy_version 776159 (0.0007) [2023-12-26 05:47:16,198][123091] Updated weights for policy 0, policy_version 776169 (0.0010) [2023-12-26 05:47:16,903][123091] Updated weights for policy 0, policy_version 776179 (0.0010) [2023-12-26 05:47:16,969][123091] Updated weights for policy 0, policy_version 776189 (0.0010) [2023-12-26 05:47:17,020][123091] Updated weights for policy 0, policy_version 776199 (0.0009) [2023-12-26 05:47:17,027][123090] Updated weights for policy 1, policy_version 770850 (0.0007) [2023-12-26 05:47:17,085][123090] Updated weights for policy 1, policy_version 770860 (0.0009) [2023-12-26 05:47:17,154][123090] Updated weights for policy 1, policy_version 770870 (0.0009) [2023-12-26 05:47:17,220][123090] Updated weights for policy 1, policy_version 770880 (0.0009) [2023-12-26 05:47:17,751][123091] Updated weights for policy 0, policy_version 776209 (0.0008) [2023-12-26 05:47:17,816][123091] Updated weights for policy 0, policy_version 776219 (0.0010) [2023-12-26 05:47:17,882][123091] Updated weights for policy 0, policy_version 776229 (0.0011) [2023-12-26 05:47:17,944][123091] Updated weights for policy 0, policy_version 776239 (0.0010) [2023-12-26 05:47:18,062][123090] Updated weights for policy 1, policy_version 770890 (0.0008) [2023-12-26 05:47:18,126][123090] Updated weights for policy 1, policy_version 770900 (0.0009) [2023-12-26 05:47:18,192][123090] Updated weights for policy 1, policy_version 770910 (0.0009) [2023-12-26 05:47:18,760][123091] Updated weights for policy 0, policy_version 776249 (0.0008) [2023-12-26 05:47:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 396075008. Throughput: 0: 9004.7, 1: 8400.6. Samples: 396091408. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:18,784][121949] Avg episode reward: [(0, '5879.446'), (1, '5102.004')] [2023-12-26 05:47:18,825][123091] Updated weights for policy 0, policy_version 776259 (0.0007) [2023-12-26 05:47:18,896][123091] Updated weights for policy 0, policy_version 776269 (0.0009) [2023-12-26 05:47:19,053][123090] Updated weights for policy 1, policy_version 770920 (0.0009) [2023-12-26 05:47:19,120][123090] Updated weights for policy 1, policy_version 770930 (0.0010) [2023-12-26 05:47:19,180][123090] Updated weights for policy 1, policy_version 770940 (0.0009) [2023-12-26 05:47:19,662][123091] Updated weights for policy 0, policy_version 776279 (0.0011) [2023-12-26 05:47:19,725][123091] Updated weights for policy 0, policy_version 776289 (0.0011) [2023-12-26 05:47:19,783][123091] Updated weights for policy 0, policy_version 776299 (0.0009) [2023-12-26 05:47:20,050][123090] Updated weights for policy 1, policy_version 770950 (0.0010) [2023-12-26 05:47:20,118][123090] Updated weights for policy 1, policy_version 770960 (0.0009) [2023-12-26 05:47:20,177][123090] Updated weights for policy 1, policy_version 770970 (0.0009) [2023-12-26 05:47:20,605][123091] Updated weights for policy 0, policy_version 776309 (0.0009) [2023-12-26 05:47:20,667][123091] Updated weights for policy 0, policy_version 776319 (0.0008) [2023-12-26 05:47:20,726][123091] Updated weights for policy 0, policy_version 776329 (0.0010) [2023-12-26 05:47:21,016][123090] Updated weights for policy 1, policy_version 770980 (0.0009) [2023-12-26 05:47:21,088][123090] Updated weights for policy 1, policy_version 770990 (0.0010) [2023-12-26 05:47:21,156][123090] Updated weights for policy 1, policy_version 771000 (0.0009) [2023-12-26 05:47:21,556][123091] Updated weights for policy 0, policy_version 776339 (0.0010) [2023-12-26 05:47:21,609][123091] Updated weights for policy 0, policy_version 776349 (0.0011) [2023-12-26 05:47:21,669][123091] Updated weights for policy 0, policy_version 776359 (0.0008) [2023-12-26 05:47:22,039][123090] Updated weights for policy 1, policy_version 771010 (0.0009) [2023-12-26 05:47:22,105][123090] Updated weights for policy 1, policy_version 771020 (0.0009) [2023-12-26 05:47:22,168][123090] Updated weights for policy 1, policy_version 771030 (0.0008) [2023-12-26 05:47:22,238][123090] Updated weights for policy 1, policy_version 771040 (0.0009) [2023-12-26 05:47:22,513][123091] Updated weights for policy 0, policy_version 776369 (0.0007) [2023-12-26 05:47:22,584][123091] Updated weights for policy 0, policy_version 776379 (0.0011) [2023-12-26 05:47:22,643][123091] Updated weights for policy 0, policy_version 776389 (0.0011) [2023-12-26 05:47:22,706][123091] Updated weights for policy 0, policy_version 776399 (0.0010) [2023-12-26 05:47:23,054][123090] Updated weights for policy 1, policy_version 771050 (0.0006) [2023-12-26 05:47:23,126][123090] Updated weights for policy 1, policy_version 771060 (0.0006) [2023-12-26 05:47:23,193][123090] Updated weights for policy 1, policy_version 771070 (0.0005) [2023-12-26 05:47:23,492][123091] Updated weights for policy 0, policy_version 776409 (0.0009) [2023-12-26 05:47:23,551][123091] Updated weights for policy 0, policy_version 776419 (0.0010) [2023-12-26 05:47:23,615][123091] Updated weights for policy 0, policy_version 776429 (0.0011) [2023-12-26 05:47:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 396165120. Throughput: 0: 8972.2, 1: 8395.0. Samples: 396141440. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:23,785][121949] Avg episode reward: [(0, '5823.639'), (1, '5371.494')] [2023-12-26 05:47:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000771072_197394432.pth... [2023-12-26 05:47:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000776432_198770688.pth... [2023-12-26 05:47:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000770112_197148672.pth [2023-12-26 05:47:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000775376_198500352.pth [2023-12-26 05:47:23,869][123090] Updated weights for policy 1, policy_version 771080 (0.0008) [2023-12-26 05:47:23,929][123090] Updated weights for policy 1, policy_version 771090 (0.0009) [2023-12-26 05:47:23,992][123090] Updated weights for policy 1, policy_version 771100 (0.0010) [2023-12-26 05:47:24,389][123091] Updated weights for policy 0, policy_version 776439 (0.0007) [2023-12-26 05:47:24,455][123091] Updated weights for policy 0, policy_version 776449 (0.0006) [2023-12-26 05:47:24,515][123091] Updated weights for policy 0, policy_version 776459 (0.0008) [2023-12-26 05:47:24,875][123090] Updated weights for policy 1, policy_version 771110 (0.0010) [2023-12-26 05:47:24,951][123090] Updated weights for policy 1, policy_version 771120 (0.0007) [2023-12-26 05:47:25,016][123090] Updated weights for policy 1, policy_version 771130 (0.0005) [2023-12-26 05:47:25,116][123091] Updated weights for policy 0, policy_version 776469 (0.0007) [2023-12-26 05:47:25,166][123091] Updated weights for policy 0, policy_version 776479 (0.0005) [2023-12-26 05:47:25,216][123091] Updated weights for policy 0, policy_version 776489 (0.0005) [2023-12-26 05:47:25,787][123090] Updated weights for policy 1, policy_version 771140 (0.0007) [2023-12-26 05:47:25,830][123091] Updated weights for policy 0, policy_version 776499 (0.0006) [2023-12-26 05:47:25,842][123090] Updated weights for policy 1, policy_version 771150 (0.0008) [2023-12-26 05:47:25,887][123091] Updated weights for policy 0, policy_version 776509 (0.0008) [2023-12-26 05:47:25,905][123090] Updated weights for policy 1, policy_version 771160 (0.0007) [2023-12-26 05:47:25,946][123091] Updated weights for policy 0, policy_version 776519 (0.0008) [2023-12-26 05:47:26,614][123090] Updated weights for policy 1, policy_version 771170 (0.0008) [2023-12-26 05:47:26,670][123091] Updated weights for policy 0, policy_version 776529 (0.0010) [2023-12-26 05:47:26,675][123090] Updated weights for policy 1, policy_version 771180 (0.0009) [2023-12-26 05:47:26,730][123090] Updated weights for policy 1, policy_version 771190 (0.0008) [2023-12-26 05:47:26,732][123091] Updated weights for policy 0, policy_version 776539 (0.0007) [2023-12-26 05:47:26,787][123090] Updated weights for policy 1, policy_version 771200 (0.0008) [2023-12-26 05:47:26,793][123091] Updated weights for policy 0, policy_version 776549 (0.0007) [2023-12-26 05:47:26,863][123091] Updated weights for policy 0, policy_version 776559 (0.0006) [2023-12-26 05:47:27,604][123090] Updated weights for policy 1, policy_version 771210 (0.0009) [2023-12-26 05:47:27,610][123091] Updated weights for policy 0, policy_version 776569 (0.0006) [2023-12-26 05:47:27,658][123091] Updated weights for policy 0, policy_version 776579 (0.0005) [2023-12-26 05:47:27,662][123090] Updated weights for policy 1, policy_version 771220 (0.0010) [2023-12-26 05:47:27,709][123091] Updated weights for policy 0, policy_version 776589 (0.0005) [2023-12-26 05:47:27,721][123090] Updated weights for policy 1, policy_version 771230 (0.0008) [2023-12-26 05:47:28,362][123091] Updated weights for policy 0, policy_version 776599 (0.0007) [2023-12-26 05:47:28,413][123091] Updated weights for policy 0, policy_version 776609 (0.0008) [2023-12-26 05:47:28,470][123091] Updated weights for policy 0, policy_version 776619 (0.0008) [2023-12-26 05:47:28,634][123090] Updated weights for policy 1, policy_version 771240 (0.0009) [2023-12-26 05:47:28,701][123090] Updated weights for policy 1, policy_version 771250 (0.0005) [2023-12-26 05:47:28,769][123090] Updated weights for policy 1, policy_version 771260 (0.0005) [2023-12-26 05:47:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 396255232. Throughput: 0: 9099.4, 1: 8463.6. Samples: 396251312. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:28,785][121949] Avg episode reward: [(0, '5893.368'), (1, '5234.746')] [2023-12-26 05:47:29,204][123091] Updated weights for policy 0, policy_version 776629 (0.0007) [2023-12-26 05:47:29,267][123091] Updated weights for policy 0, policy_version 776639 (0.0007) [2023-12-26 05:47:29,341][123091] Updated weights for policy 0, policy_version 776649 (0.0008) [2023-12-26 05:47:29,519][123090] Updated weights for policy 1, policy_version 771270 (0.0008) [2023-12-26 05:47:29,584][123090] Updated weights for policy 1, policy_version 771280 (0.0009) [2023-12-26 05:47:29,642][123090] Updated weights for policy 1, policy_version 771290 (0.0009) [2023-12-26 05:47:30,103][123091] Updated weights for policy 0, policy_version 776659 (0.0009) [2023-12-26 05:47:30,153][123091] Updated weights for policy 0, policy_version 776669 (0.0009) [2023-12-26 05:47:30,204][123091] Updated weights for policy 0, policy_version 776679 (0.0008) [2023-12-26 05:47:30,439][123090] Updated weights for policy 1, policy_version 771300 (0.0007) [2023-12-26 05:47:30,499][123090] Updated weights for policy 1, policy_version 771310 (0.0007) [2023-12-26 05:47:30,559][123090] Updated weights for policy 1, policy_version 771320 (0.0010) [2023-12-26 05:47:31,018][123091] Updated weights for policy 0, policy_version 776689 (0.0010) [2023-12-26 05:47:31,077][123091] Updated weights for policy 0, policy_version 776699 (0.0009) [2023-12-26 05:47:31,143][123091] Updated weights for policy 0, policy_version 776709 (0.0009) [2023-12-26 05:47:31,203][123091] Updated weights for policy 0, policy_version 776719 (0.0010) [2023-12-26 05:47:31,368][123090] Updated weights for policy 1, policy_version 771330 (0.0010) [2023-12-26 05:47:31,425][123090] Updated weights for policy 1, policy_version 771340 (0.0008) [2023-12-26 05:47:31,482][123090] Updated weights for policy 1, policy_version 771350 (0.0009) [2023-12-26 05:47:31,539][123090] Updated weights for policy 1, policy_version 771360 (0.0009) [2023-12-26 05:47:32,020][123091] Updated weights for policy 0, policy_version 776729 (0.0009) [2023-12-26 05:47:32,089][123091] Updated weights for policy 0, policy_version 776739 (0.0006) [2023-12-26 05:47:32,157][123091] Updated weights for policy 0, policy_version 776749 (0.0007) [2023-12-26 05:47:32,422][123090] Updated weights for policy 1, policy_version 771370 (0.0007) [2023-12-26 05:47:32,482][123090] Updated weights for policy 1, policy_version 771380 (0.0005) [2023-12-26 05:47:32,544][123090] Updated weights for policy 1, policy_version 771390 (0.0007) [2023-12-26 05:47:32,930][123091] Updated weights for policy 0, policy_version 776759 (0.0007) [2023-12-26 05:47:32,988][123091] Updated weights for policy 0, policy_version 776769 (0.0005) [2023-12-26 05:47:33,037][123091] Updated weights for policy 0, policy_version 776779 (0.0005) [2023-12-26 05:47:33,325][123090] Updated weights for policy 1, policy_version 771400 (0.0008) [2023-12-26 05:47:33,373][123090] Updated weights for policy 1, policy_version 771410 (0.0008) [2023-12-26 05:47:33,424][123090] Updated weights for policy 1, policy_version 771420 (0.0008) [2023-12-26 05:47:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 396345344. Throughput: 0: 9049.2, 1: 8516.1. Samples: 396357996. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:33,786][121949] Avg episode reward: [(0, '5935.257'), (1, '4932.874')] [2023-12-26 05:47:33,797][123091] Updated weights for policy 0, policy_version 776789 (0.0008) [2023-12-26 05:47:33,848][123091] Updated weights for policy 0, policy_version 776799 (0.0010) [2023-12-26 05:47:33,891][123091] Updated weights for policy 0, policy_version 776809 (0.0010) [2023-12-26 05:47:34,325][123090] Updated weights for policy 1, policy_version 771430 (0.0009) [2023-12-26 05:47:34,396][123090] Updated weights for policy 1, policy_version 771440 (0.0009) [2023-12-26 05:47:34,457][123090] Updated weights for policy 1, policy_version 771450 (0.0008) [2023-12-26 05:47:34,732][123091] Updated weights for policy 0, policy_version 776819 (0.0009) [2023-12-26 05:47:34,802][123091] Updated weights for policy 0, policy_version 776829 (0.0008) [2023-12-26 05:47:34,878][123091] Updated weights for policy 0, policy_version 776839 (0.0007) [2023-12-26 05:47:35,241][123090] Updated weights for policy 1, policy_version 771460 (0.0007) [2023-12-26 05:47:35,292][123090] Updated weights for policy 1, policy_version 771470 (0.0005) [2023-12-26 05:47:35,344][123090] Updated weights for policy 1, policy_version 771480 (0.0005) [2023-12-26 05:47:35,560][123091] Updated weights for policy 0, policy_version 776849 (0.0006) [2023-12-26 05:47:35,630][123091] Updated weights for policy 0, policy_version 776859 (0.0009) [2023-12-26 05:47:35,702][123091] Updated weights for policy 0, policy_version 776869 (0.0008) [2023-12-26 05:47:35,775][123091] Updated weights for policy 0, policy_version 776879 (0.0005) [2023-12-26 05:47:36,135][123090] Updated weights for policy 1, policy_version 771490 (0.0007) [2023-12-26 05:47:36,206][123090] Updated weights for policy 1, policy_version 771500 (0.0006) [2023-12-26 05:47:36,272][123090] Updated weights for policy 1, policy_version 771510 (0.0008) [2023-12-26 05:47:36,339][123090] Updated weights for policy 1, policy_version 771520 (0.0005) [2023-12-26 05:47:36,459][123091] Updated weights for policy 0, policy_version 776889 (0.0010) [2023-12-26 05:47:36,526][123091] Updated weights for policy 0, policy_version 776899 (0.0011) [2023-12-26 05:47:36,593][123091] Updated weights for policy 0, policy_version 776909 (0.0011) [2023-12-26 05:47:37,099][123090] Updated weights for policy 1, policy_version 771530 (0.0006) [2023-12-26 05:47:37,160][123090] Updated weights for policy 1, policy_version 771540 (0.0009) [2023-12-26 05:47:37,217][123090] Updated weights for policy 1, policy_version 771550 (0.0009) [2023-12-26 05:47:37,409][123091] Updated weights for policy 0, policy_version 776919 (0.0011) [2023-12-26 05:47:37,480][123091] Updated weights for policy 0, policy_version 776929 (0.0011) [2023-12-26 05:47:37,539][123091] Updated weights for policy 0, policy_version 776939 (0.0011) [2023-12-26 05:47:38,059][123090] Updated weights for policy 1, policy_version 771560 (0.0009) [2023-12-26 05:47:38,112][123090] Updated weights for policy 1, policy_version 771570 (0.0009) [2023-12-26 05:47:38,160][123090] Updated weights for policy 1, policy_version 771580 (0.0008) [2023-12-26 05:47:38,318][123091] Updated weights for policy 0, policy_version 776949 (0.0011) [2023-12-26 05:47:38,393][123091] Updated weights for policy 0, policy_version 776959 (0.0009) [2023-12-26 05:47:38,447][123091] Updated weights for policy 0, policy_version 776969 (0.0009) [2023-12-26 05:47:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 396435456. Throughput: 0: 9093.8, 1: 8539.7. Samples: 396412420. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:38,785][121949] Avg episode reward: [(0, '5789.841'), (1, '4874.711')] [2023-12-26 05:47:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000776976_198909952.pth... [2023-12-26 05:47:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000771584_197525504.pth... [2023-12-26 05:47:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000775920_198639616.pth [2023-12-26 05:47:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000770592_197271552.pth [2023-12-26 05:47:39,074][123090] Updated weights for policy 1, policy_version 771590 (0.0010) [2023-12-26 05:47:39,137][123090] Updated weights for policy 1, policy_version 771600 (0.0010) [2023-12-26 05:47:39,202][123090] Updated weights for policy 1, policy_version 771610 (0.0009) [2023-12-26 05:47:39,233][123091] Updated weights for policy 0, policy_version 776979 (0.0009) [2023-12-26 05:47:39,294][123091] Updated weights for policy 0, policy_version 776989 (0.0008) [2023-12-26 05:47:39,361][123091] Updated weights for policy 0, policy_version 776999 (0.0008) [2023-12-26 05:47:40,086][123090] Updated weights for policy 1, policy_version 771620 (0.0008) [2023-12-26 05:47:40,151][123090] Updated weights for policy 1, policy_version 771630 (0.0010) [2023-12-26 05:47:40,182][123091] Updated weights for policy 0, policy_version 777009 (0.0008) [2023-12-26 05:47:40,218][123090] Updated weights for policy 1, policy_version 771640 (0.0010) [2023-12-26 05:47:40,245][123091] Updated weights for policy 0, policy_version 777019 (0.0008) [2023-12-26 05:47:40,311][123091] Updated weights for policy 0, policy_version 777029 (0.0010) [2023-12-26 05:47:40,377][123091] Updated weights for policy 0, policy_version 777039 (0.0010) [2023-12-26 05:47:41,043][123090] Updated weights for policy 1, policy_version 771650 (0.0009) [2023-12-26 05:47:41,118][123090] Updated weights for policy 1, policy_version 771660 (0.0009) [2023-12-26 05:47:41,193][123090] Updated weights for policy 1, policy_version 771670 (0.0008) [2023-12-26 05:47:41,196][123091] Updated weights for policy 0, policy_version 777049 (0.0009) [2023-12-26 05:47:41,260][123091] Updated weights for policy 0, policy_version 777059 (0.0008) [2023-12-26 05:47:41,264][123090] Updated weights for policy 1, policy_version 771680 (0.0009) [2023-12-26 05:47:41,319][123091] Updated weights for policy 0, policy_version 777069 (0.0008) [2023-12-26 05:47:42,109][123091] Updated weights for policy 0, policy_version 777079 (0.0008) [2023-12-26 05:47:42,164][123090] Updated weights for policy 1, policy_version 771690 (0.0007) [2023-12-26 05:47:42,170][123091] Updated weights for policy 0, policy_version 777089 (0.0008) [2023-12-26 05:47:42,215][123091] Updated weights for policy 0, policy_version 777099 (0.0007) [2023-12-26 05:47:42,234][123090] Updated weights for policy 1, policy_version 771700 (0.0008) [2023-12-26 05:47:42,307][123090] Updated weights for policy 1, policy_version 771710 (0.0010) [2023-12-26 05:47:42,983][123091] Updated weights for policy 0, policy_version 777109 (0.0009) [2023-12-26 05:47:43,035][123091] Updated weights for policy 0, policy_version 777119 (0.0009) [2023-12-26 05:47:43,090][123091] Updated weights for policy 0, policy_version 777129 (0.0007) [2023-12-26 05:47:43,136][123090] Updated weights for policy 1, policy_version 771720 (0.0008) [2023-12-26 05:47:43,214][123090] Updated weights for policy 1, policy_version 771730 (0.0005) [2023-12-26 05:47:43,291][123090] Updated weights for policy 1, policy_version 771740 (0.0005) [2023-12-26 05:47:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 396517376. Throughput: 0: 8995.3, 1: 8455.3. Samples: 396513528. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:43,785][121949] Avg episode reward: [(0, '5702.000'), (1, '5064.682')] [2023-12-26 05:47:43,851][123091] Updated weights for policy 0, policy_version 777139 (0.0007) [2023-12-26 05:47:43,899][123091] Updated weights for policy 0, policy_version 777149 (0.0010) [2023-12-26 05:47:43,916][123090] Updated weights for policy 1, policy_version 771750 (0.0007) [2023-12-26 05:47:43,943][123091] Updated weights for policy 0, policy_version 777159 (0.0010) [2023-12-26 05:47:43,975][123090] Updated weights for policy 1, policy_version 771760 (0.0010) [2023-12-26 05:47:44,026][123090] Updated weights for policy 1, policy_version 771770 (0.0010) [2023-12-26 05:47:44,792][123091] Updated weights for policy 0, policy_version 777169 (0.0010) [2023-12-26 05:47:44,837][123090] Updated weights for policy 1, policy_version 771780 (0.0010) [2023-12-26 05:47:44,856][123091] Updated weights for policy 0, policy_version 777179 (0.0011) [2023-12-26 05:47:44,903][123090] Updated weights for policy 1, policy_version 771790 (0.0011) [2023-12-26 05:47:44,917][123091] Updated weights for policy 0, policy_version 777189 (0.0011) [2023-12-26 05:47:44,963][123090] Updated weights for policy 1, policy_version 771800 (0.0011) [2023-12-26 05:47:44,982][123091] Updated weights for policy 0, policy_version 777199 (0.0008) [2023-12-26 05:47:45,729][123091] Updated weights for policy 0, policy_version 777209 (0.0005) [2023-12-26 05:47:45,787][123091] Updated weights for policy 0, policy_version 777219 (0.0010) [2023-12-26 05:47:45,801][123090] Updated weights for policy 1, policy_version 771810 (0.0011) [2023-12-26 05:47:45,846][123091] Updated weights for policy 0, policy_version 777229 (0.0011) [2023-12-26 05:47:45,864][123090] Updated weights for policy 1, policy_version 771820 (0.0010) [2023-12-26 05:47:45,927][123090] Updated weights for policy 1, policy_version 771830 (0.0010) [2023-12-26 05:47:45,975][123090] Updated weights for policy 1, policy_version 771840 (0.0010) [2023-12-26 05:47:46,590][123091] Updated weights for policy 0, policy_version 777239 (0.0010) [2023-12-26 05:47:46,642][123091] Updated weights for policy 0, policy_version 777249 (0.0010) [2023-12-26 05:47:46,692][123091] Updated weights for policy 0, policy_version 777259 (0.0010) [2023-12-26 05:47:46,806][123090] Updated weights for policy 1, policy_version 771850 (0.0010) [2023-12-26 05:47:46,853][123090] Updated weights for policy 1, policy_version 771860 (0.0010) [2023-12-26 05:47:46,904][123090] Updated weights for policy 1, policy_version 771870 (0.0010) [2023-12-26 05:47:47,521][123091] Updated weights for policy 0, policy_version 777269 (0.0010) [2023-12-26 05:47:47,583][123091] Updated weights for policy 0, policy_version 777279 (0.0010) [2023-12-26 05:47:47,648][123091] Updated weights for policy 0, policy_version 777289 (0.0010) [2023-12-26 05:47:47,741][123090] Updated weights for policy 1, policy_version 771880 (0.0009) [2023-12-26 05:47:47,788][123090] Updated weights for policy 1, policy_version 771890 (0.0008) [2023-12-26 05:47:47,852][123090] Updated weights for policy 1, policy_version 771900 (0.0008) [2023-12-26 05:47:48,445][123091] Updated weights for policy 0, policy_version 777299 (0.0009) [2023-12-26 05:47:48,510][123091] Updated weights for policy 0, policy_version 777309 (0.0009) [2023-12-26 05:47:48,572][123091] Updated weights for policy 0, policy_version 777319 (0.0009) [2023-12-26 05:47:48,593][123090] Updated weights for policy 1, policy_version 771910 (0.0007) [2023-12-26 05:47:48,649][123090] Updated weights for policy 1, policy_version 771920 (0.0008) [2023-12-26 05:47:48,710][123090] Updated weights for policy 1, policy_version 771930 (0.0009) [2023-12-26 05:47:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 396615680. Throughput: 0: 9096.5, 1: 8442.0. Samples: 396621432. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:48,784][121949] Avg episode reward: [(0, '5731.984'), (1, '5021.725')] [2023-12-26 05:47:49,258][123091] Updated weights for policy 0, policy_version 777329 (0.0006) [2023-12-26 05:47:49,321][123091] Updated weights for policy 0, policy_version 777339 (0.0007) [2023-12-26 05:47:49,391][123091] Updated weights for policy 0, policy_version 777349 (0.0009) [2023-12-26 05:47:49,456][123091] Updated weights for policy 0, policy_version 777359 (0.0009) [2023-12-26 05:47:49,570][123090] Updated weights for policy 1, policy_version 771940 (0.0008) [2023-12-26 05:47:49,630][123090] Updated weights for policy 1, policy_version 771950 (0.0005) [2023-12-26 05:47:49,700][123090] Updated weights for policy 1, policy_version 771960 (0.0009) [2023-12-26 05:47:50,333][123091] Updated weights for policy 0, policy_version 777369 (0.0010) [2023-12-26 05:47:50,387][123091] Updated weights for policy 0, policy_version 777379 (0.0009) [2023-12-26 05:47:50,455][123091] Updated weights for policy 0, policy_version 777389 (0.0009) [2023-12-26 05:47:50,468][123090] Updated weights for policy 1, policy_version 771970 (0.0010) [2023-12-26 05:47:50,516][123090] Updated weights for policy 1, policy_version 771980 (0.0008) [2023-12-26 05:47:50,575][123090] Updated weights for policy 1, policy_version 771990 (0.0007) [2023-12-26 05:47:50,640][123090] Updated weights for policy 1, policy_version 772000 (0.0008) [2023-12-26 05:47:51,236][123091] Updated weights for policy 0, policy_version 777399 (0.0009) [2023-12-26 05:47:51,298][123091] Updated weights for policy 0, policy_version 777409 (0.0009) [2023-12-26 05:47:51,363][123091] Updated weights for policy 0, policy_version 777419 (0.0009) [2023-12-26 05:47:51,493][123090] Updated weights for policy 1, policy_version 772010 (0.0010) [2023-12-26 05:47:51,561][123090] Updated weights for policy 1, policy_version 772020 (0.0009) [2023-12-26 05:47:51,626][123090] Updated weights for policy 1, policy_version 772030 (0.0009) [2023-12-26 05:47:52,225][123091] Updated weights for policy 0, policy_version 777430 (0.0010) [2023-12-26 05:47:52,279][123091] Updated weights for policy 0, policy_version 777440 (0.0009) [2023-12-26 05:47:52,339][123091] Updated weights for policy 0, policy_version 777450 (0.0009) [2023-12-26 05:47:52,447][123090] Updated weights for policy 1, policy_version 772040 (0.0009) [2023-12-26 05:47:52,496][123090] Updated weights for policy 1, policy_version 772051 (0.0009) [2023-12-26 05:47:52,562][123090] Updated weights for policy 1, policy_version 772061 (0.0006) [2023-12-26 05:47:53,211][123091] Updated weights for policy 0, policy_version 777460 (0.0009) [2023-12-26 05:47:53,266][123091] Updated weights for policy 0, policy_version 777470 (0.0009) [2023-12-26 05:47:53,318][123091] Updated weights for policy 0, policy_version 777480 (0.0008) [2023-12-26 05:47:53,374][123090] Updated weights for policy 1, policy_version 772071 (0.0009) [2023-12-26 05:47:53,428][123090] Updated weights for policy 1, policy_version 772081 (0.0009) [2023-12-26 05:47:53,483][123090] Updated weights for policy 1, policy_version 772091 (0.0010) [2023-12-26 05:47:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 396697600. Throughput: 0: 9029.0, 1: 8469.0. Samples: 396673104. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:53,785][121949] Avg episode reward: [(0, '5548.861'), (1, '4985.774')] [2023-12-26 05:47:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000777488_199041024.pth... [2023-12-26 05:47:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000772096_197656576.pth... [2023-12-26 05:47:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000776432_198770688.pth [2023-12-26 05:47:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000771072_197394432.pth [2023-12-26 05:47:54,141][123091] Updated weights for policy 0, policy_version 777490 (0.0010) [2023-12-26 05:47:54,199][123091] Updated weights for policy 0, policy_version 777500 (0.0009) [2023-12-26 05:47:54,263][123091] Updated weights for policy 0, policy_version 777510 (0.0011) [2023-12-26 05:47:54,327][123090] Updated weights for policy 1, policy_version 772101 (0.0010) [2023-12-26 05:47:54,331][123091] Updated weights for policy 0, policy_version 777520 (0.0010) [2023-12-26 05:47:54,390][123090] Updated weights for policy 1, policy_version 772111 (0.0009) [2023-12-26 05:47:54,446][123090] Updated weights for policy 1, policy_version 772121 (0.0008) [2023-12-26 05:47:55,095][123091] Updated weights for policy 0, policy_version 777530 (0.0010) [2023-12-26 05:47:55,158][123091] Updated weights for policy 0, policy_version 777540 (0.0010) [2023-12-26 05:47:55,218][123091] Updated weights for policy 0, policy_version 777550 (0.0011) [2023-12-26 05:47:55,241][123090] Updated weights for policy 1, policy_version 772131 (0.0008) [2023-12-26 05:47:55,307][123090] Updated weights for policy 1, policy_version 772141 (0.0008) [2023-12-26 05:47:55,370][123090] Updated weights for policy 1, policy_version 772151 (0.0008) [2023-12-26 05:47:55,978][123091] Updated weights for policy 0, policy_version 777560 (0.0010) [2023-12-26 05:47:56,036][123091] Updated weights for policy 0, policy_version 777570 (0.0010) [2023-12-26 05:47:56,085][123090] Updated weights for policy 1, policy_version 772161 (0.0008) [2023-12-26 05:47:56,090][123091] Updated weights for policy 0, policy_version 777580 (0.0010) [2023-12-26 05:47:56,138][123090] Updated weights for policy 1, policy_version 772171 (0.0005) [2023-12-26 05:47:56,192][123090] Updated weights for policy 1, policy_version 772181 (0.0005) [2023-12-26 05:47:56,244][123090] Updated weights for policy 1, policy_version 772191 (0.0005) [2023-12-26 05:47:56,872][123090] Updated weights for policy 1, policy_version 772201 (0.0008) [2023-12-26 05:47:56,910][123091] Updated weights for policy 0, policy_version 777590 (0.0010) [2023-12-26 05:47:56,932][123090] Updated weights for policy 1, policy_version 772211 (0.0008) [2023-12-26 05:47:56,962][123091] Updated weights for policy 0, policy_version 777600 (0.0010) [2023-12-26 05:47:56,983][123090] Updated weights for policy 1, policy_version 772221 (0.0005) [2023-12-26 05:47:57,023][123091] Updated weights for policy 0, policy_version 777610 (0.0010) [2023-12-26 05:47:57,798][123090] Updated weights for policy 1, policy_version 772231 (0.0005) [2023-12-26 05:47:57,803][123091] Updated weights for policy 0, policy_version 777620 (0.0010) [2023-12-26 05:47:57,855][123090] Updated weights for policy 1, policy_version 772241 (0.0005) [2023-12-26 05:47:57,857][123091] Updated weights for policy 0, policy_version 777630 (0.0007) [2023-12-26 05:47:57,910][123091] Updated weights for policy 0, policy_version 777640 (0.0005) [2023-12-26 05:47:57,924][123090] Updated weights for policy 1, policy_version 772251 (0.0005) [2023-12-26 05:47:58,660][123090] Updated weights for policy 1, policy_version 772261 (0.0008) [2023-12-26 05:47:58,728][123090] Updated weights for policy 1, policy_version 772271 (0.0008) [2023-12-26 05:47:58,758][123091] Updated weights for policy 0, policy_version 777650 (0.0007) [2023-12-26 05:47:58,785][121949] Fps is (10 sec: 16381.7, 60 sec: 17475.9, 300 sec: 17605.8). Total num frames: 396779520. Throughput: 0: 9051.0, 1: 8599.1. Samples: 396781036. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:47:58,786][121949] Avg episode reward: [(0, '5580.141'), (1, '5060.438')] [2023-12-26 05:47:58,799][123090] Updated weights for policy 1, policy_version 772281 (0.0008) [2023-12-26 05:47:58,819][123091] Updated weights for policy 0, policy_version 777660 (0.0009) [2023-12-26 05:47:58,896][123091] Updated weights for policy 0, policy_version 777670 (0.0007) [2023-12-26 05:47:58,946][123091] Updated weights for policy 0, policy_version 777680 (0.0006) [2023-12-26 05:47:59,595][123090] Updated weights for policy 1, policy_version 772291 (0.0009) [2023-12-26 05:47:59,662][123090] Updated weights for policy 1, policy_version 772301 (0.0009) [2023-12-26 05:47:59,721][123090] Updated weights for policy 1, policy_version 772311 (0.0010) [2023-12-26 05:47:59,745][123091] Updated weights for policy 0, policy_version 777690 (0.0008) [2023-12-26 05:47:59,811][123091] Updated weights for policy 0, policy_version 777700 (0.0008) [2023-12-26 05:47:59,874][123091] Updated weights for policy 0, policy_version 777710 (0.0009) [2023-12-26 05:48:00,533][123090] Updated weights for policy 1, policy_version 772321 (0.0006) [2023-12-26 05:48:00,602][123090] Updated weights for policy 1, policy_version 772331 (0.0009) [2023-12-26 05:48:00,620][123091] Updated weights for policy 0, policy_version 777720 (0.0007) [2023-12-26 05:48:00,653][123090] Updated weights for policy 1, policy_version 772341 (0.0010) [2023-12-26 05:48:00,676][123091] Updated weights for policy 0, policy_version 777730 (0.0007) [2023-12-26 05:48:00,708][123090] Updated weights for policy 1, policy_version 772351 (0.0009) [2023-12-26 05:48:00,744][123091] Updated weights for policy 0, policy_version 777740 (0.0005) [2023-12-26 05:48:01,409][123091] Updated weights for policy 0, policy_version 777750 (0.0008) [2023-12-26 05:48:01,484][123091] Updated weights for policy 0, policy_version 777760 (0.0008) [2023-12-26 05:48:01,550][123091] Updated weights for policy 0, policy_version 777770 (0.0009) [2023-12-26 05:48:01,565][123090] Updated weights for policy 1, policy_version 772361 (0.0008) [2023-12-26 05:48:01,636][123090] Updated weights for policy 1, policy_version 772371 (0.0009) [2023-12-26 05:48:01,691][123090] Updated weights for policy 1, policy_version 772381 (0.0010) [2023-12-26 05:48:02,386][123091] Updated weights for policy 0, policy_version 777780 (0.0007) [2023-12-26 05:48:02,453][123091] Updated weights for policy 0, policy_version 777790 (0.0008) [2023-12-26 05:48:02,505][123090] Updated weights for policy 1, policy_version 772391 (0.0007) [2023-12-26 05:48:02,517][123091] Updated weights for policy 0, policy_version 777800 (0.0010) [2023-12-26 05:48:02,563][123090] Updated weights for policy 1, policy_version 772401 (0.0006) [2023-12-26 05:48:02,617][123090] Updated weights for policy 1, policy_version 772411 (0.0009) [2023-12-26 05:48:03,270][123090] Updated weights for policy 1, policy_version 772422 (0.0010) [2023-12-26 05:48:03,337][123090] Updated weights for policy 1, policy_version 772432 (0.0009) [2023-12-26 05:48:03,352][123091] Updated weights for policy 0, policy_version 777810 (0.0008) [2023-12-26 05:48:03,398][123090] Updated weights for policy 1, policy_version 772442 (0.0008) [2023-12-26 05:48:03,401][123091] Updated weights for policy 0, policy_version 777820 (0.0008) [2023-12-26 05:48:03,447][123091] Updated weights for policy 0, policy_version 777830 (0.0009) [2023-12-26 05:48:03,494][123091] Updated weights for policy 0, policy_version 777840 (0.0009) [2023-12-26 05:48:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 396877824. Throughput: 0: 8976.8, 1: 8670.8. Samples: 396885548. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:03,784][121949] Avg episode reward: [(0, '5714.359'), (1, '5152.235')] [2023-12-26 05:48:04,122][123090] Updated weights for policy 1, policy_version 772452 (0.0009) [2023-12-26 05:48:04,181][123090] Updated weights for policy 1, policy_version 772462 (0.0008) [2023-12-26 05:48:04,242][123090] Updated weights for policy 1, policy_version 772472 (0.0009) [2023-12-26 05:48:04,386][123091] Updated weights for policy 0, policy_version 777850 (0.0010) [2023-12-26 05:48:04,458][123091] Updated weights for policy 0, policy_version 777860 (0.0010) [2023-12-26 05:48:04,526][123091] Updated weights for policy 0, policy_version 777870 (0.0009) [2023-12-26 05:48:05,121][123090] Updated weights for policy 1, policy_version 772482 (0.0010) [2023-12-26 05:48:05,182][123090] Updated weights for policy 1, policy_version 772492 (0.0009) [2023-12-26 05:48:05,196][123091] Updated weights for policy 0, policy_version 777880 (0.0006) [2023-12-26 05:48:05,243][123090] Updated weights for policy 1, policy_version 772502 (0.0007) [2023-12-26 05:48:05,255][123091] Updated weights for policy 0, policy_version 777890 (0.0006) [2023-12-26 05:48:05,299][123090] Updated weights for policy 1, policy_version 772512 (0.0010) [2023-12-26 05:48:05,307][123091] Updated weights for policy 0, policy_version 777900 (0.0009) [2023-12-26 05:48:06,127][123091] Updated weights for policy 0, policy_version 777910 (0.0008) [2023-12-26 05:48:06,172][123090] Updated weights for policy 1, policy_version 772522 (0.0008) [2023-12-26 05:48:06,188][123091] Updated weights for policy 0, policy_version 777920 (0.0009) [2023-12-26 05:48:06,233][123090] Updated weights for policy 1, policy_version 772532 (0.0008) [2023-12-26 05:48:06,253][123091] Updated weights for policy 0, policy_version 777930 (0.0010) [2023-12-26 05:48:06,291][123090] Updated weights for policy 1, policy_version 772542 (0.0007) [2023-12-26 05:48:07,049][123091] Updated weights for policy 0, policy_version 777940 (0.0007) [2023-12-26 05:48:07,116][123091] Updated weights for policy 0, policy_version 777950 (0.0005) [2023-12-26 05:48:07,141][123090] Updated weights for policy 1, policy_version 772552 (0.0006) [2023-12-26 05:48:07,181][123091] Updated weights for policy 0, policy_version 777960 (0.0006) [2023-12-26 05:48:07,199][123090] Updated weights for policy 1, policy_version 772562 (0.0005) [2023-12-26 05:48:07,249][123090] Updated weights for policy 1, policy_version 772572 (0.0005) [2023-12-26 05:48:07,850][123091] Updated weights for policy 0, policy_version 777970 (0.0006) [2023-12-26 05:48:07,920][123091] Updated weights for policy 0, policy_version 777980 (0.0009) [2023-12-26 05:48:07,933][123090] Updated weights for policy 1, policy_version 772582 (0.0008) [2023-12-26 05:48:07,990][123091] Updated weights for policy 0, policy_version 777990 (0.0009) [2023-12-26 05:48:07,997][123090] Updated weights for policy 1, policy_version 772592 (0.0006) [2023-12-26 05:48:08,052][123091] Updated weights for policy 0, policy_version 778000 (0.0008) [2023-12-26 05:48:08,062][123090] Updated weights for policy 1, policy_version 772602 (0.0009) [2023-12-26 05:48:08,784][121949] Fps is (10 sec: 18024.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 396959744. Throughput: 0: 9006.1, 1: 8686.6. Samples: 396937608. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:08,785][121949] Avg episode reward: [(0, '5711.008'), (1, '5104.466')] [2023-12-26 05:48:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000778000_199172096.pth... [2023-12-26 05:48:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000772608_197787648.pth... [2023-12-26 05:48:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000776976_198909952.pth [2023-12-26 05:48:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000771584_197525504.pth [2023-12-26 05:48:08,846][123090] Updated weights for policy 1, policy_version 772612 (0.0006) [2023-12-26 05:48:08,909][123090] Updated weights for policy 1, policy_version 772622 (0.0008) [2023-12-26 05:48:08,947][123091] Updated weights for policy 0, policy_version 778010 (0.0006) [2023-12-26 05:48:08,971][123090] Updated weights for policy 1, policy_version 772632 (0.0010) [2023-12-26 05:48:09,012][123091] Updated weights for policy 0, policy_version 778020 (0.0006) [2023-12-26 05:48:09,074][123091] Updated weights for policy 0, policy_version 778030 (0.0009) [2023-12-26 05:48:09,802][123090] Updated weights for policy 1, policy_version 772642 (0.0006) [2023-12-26 05:48:09,883][123090] Updated weights for policy 1, policy_version 772652 (0.0009) [2023-12-26 05:48:09,960][123090] Updated weights for policy 1, policy_version 772662 (0.0009) [2023-12-26 05:48:09,967][123091] Updated weights for policy 0, policy_version 778040 (0.0010) [2023-12-26 05:48:10,027][123090] Updated weights for policy 1, policy_version 772672 (0.0008) [2023-12-26 05:48:10,035][123091] Updated weights for policy 0, policy_version 778050 (0.0008) [2023-12-26 05:48:10,103][123091] Updated weights for policy 0, policy_version 778060 (0.0008) [2023-12-26 05:48:10,812][123090] Updated weights for policy 1, policy_version 772682 (0.0011) [2023-12-26 05:48:10,874][123091] Updated weights for policy 0, policy_version 778070 (0.0008) [2023-12-26 05:48:10,888][123090] Updated weights for policy 1, policy_version 772692 (0.0009) [2023-12-26 05:48:10,934][123091] Updated weights for policy 0, policy_version 778080 (0.0007) [2023-12-26 05:48:10,947][123090] Updated weights for policy 1, policy_version 772702 (0.0010) [2023-12-26 05:48:10,994][123091] Updated weights for policy 0, policy_version 778090 (0.0009) [2023-12-26 05:48:11,830][123090] Updated weights for policy 1, policy_version 772712 (0.0009) [2023-12-26 05:48:11,832][123091] Updated weights for policy 0, policy_version 778100 (0.0009) [2023-12-26 05:48:11,893][123091] Updated weights for policy 0, policy_version 778110 (0.0008) [2023-12-26 05:48:11,897][123090] Updated weights for policy 1, policy_version 772722 (0.0009) [2023-12-26 05:48:11,960][123091] Updated weights for policy 0, policy_version 778120 (0.0009) [2023-12-26 05:48:11,967][123090] Updated weights for policy 1, policy_version 772732 (0.0008) [2023-12-26 05:48:12,802][123091] Updated weights for policy 0, policy_version 778130 (0.0009) [2023-12-26 05:48:12,809][123090] Updated weights for policy 1, policy_version 772742 (0.0008) [2023-12-26 05:48:12,863][123091] Updated weights for policy 0, policy_version 778140 (0.0007) [2023-12-26 05:48:12,876][123090] Updated weights for policy 1, policy_version 772752 (0.0008) [2023-12-26 05:48:12,932][123091] Updated weights for policy 0, policy_version 778150 (0.0009) [2023-12-26 05:48:12,948][123090] Updated weights for policy 1, policy_version 772762 (0.0005) [2023-12-26 05:48:12,994][123091] Updated weights for policy 0, policy_version 778160 (0.0008) [2023-12-26 05:48:13,678][123090] Updated weights for policy 1, policy_version 772772 (0.0007) [2023-12-26 05:48:13,740][123090] Updated weights for policy 1, policy_version 772782 (0.0008) [2023-12-26 05:48:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 397041664. Throughput: 0: 8878.2, 1: 8691.3. Samples: 397041940. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:13,784][121949] Avg episode reward: [(0, '5801.660'), (1, '5335.059')] [2023-12-26 05:48:13,804][123090] Updated weights for policy 1, policy_version 772792 (0.0008) [2023-12-26 05:48:13,812][123091] Updated weights for policy 0, policy_version 778170 (0.0009) [2023-12-26 05:48:13,865][123091] Updated weights for policy 0, policy_version 778180 (0.0009) [2023-12-26 05:48:13,934][123091] Updated weights for policy 0, policy_version 778190 (0.0009) [2023-12-26 05:48:14,541][123090] Updated weights for policy 1, policy_version 772802 (0.0008) [2023-12-26 05:48:14,621][123090] Updated weights for policy 1, policy_version 772812 (0.0008) [2023-12-26 05:48:14,678][123090] Updated weights for policy 1, policy_version 772822 (0.0009) [2023-12-26 05:48:14,743][123090] Updated weights for policy 1, policy_version 772832 (0.0008) [2023-12-26 05:48:14,824][123091] Updated weights for policy 0, policy_version 778200 (0.0011) [2023-12-26 05:48:14,876][123091] Updated weights for policy 0, policy_version 778210 (0.0010) [2023-12-26 05:48:14,933][123091] Updated weights for policy 0, policy_version 778220 (0.0011) [2023-12-26 05:48:15,536][123090] Updated weights for policy 1, policy_version 772842 (0.0009) [2023-12-26 05:48:15,599][123090] Updated weights for policy 1, policy_version 772852 (0.0010) [2023-12-26 05:48:15,651][123090] Updated weights for policy 1, policy_version 772862 (0.0010) [2023-12-26 05:48:15,743][123091] Updated weights for policy 0, policy_version 778230 (0.0007) [2023-12-26 05:48:15,812][123091] Updated weights for policy 0, policy_version 778240 (0.0007) [2023-12-26 05:48:15,858][123091] Updated weights for policy 0, policy_version 778250 (0.0010) [2023-12-26 05:48:16,532][123090] Updated weights for policy 1, policy_version 772872 (0.0010) [2023-12-26 05:48:16,594][123090] Updated weights for policy 1, policy_version 772882 (0.0009) [2023-12-26 05:48:16,605][123091] Updated weights for policy 0, policy_version 778260 (0.0009) [2023-12-26 05:48:16,659][123090] Updated weights for policy 1, policy_version 772892 (0.0008) [2023-12-26 05:48:16,664][123091] Updated weights for policy 0, policy_version 778270 (0.0007) [2023-12-26 05:48:16,738][123091] Updated weights for policy 0, policy_version 778280 (0.0005) [2023-12-26 05:48:17,427][123091] Updated weights for policy 0, policy_version 778290 (0.0005) [2023-12-26 05:48:17,476][123091] Updated weights for policy 0, policy_version 778300 (0.0005) [2023-12-26 05:48:17,525][123091] Updated weights for policy 0, policy_version 778310 (0.0005) [2023-12-26 05:48:17,574][123090] Updated weights for policy 1, policy_version 772902 (0.0009) [2023-12-26 05:48:17,595][123091] Updated weights for policy 0, policy_version 778320 (0.0005) [2023-12-26 05:48:17,635][123090] Updated weights for policy 1, policy_version 772912 (0.0009) [2023-12-26 05:48:17,693][123090] Updated weights for policy 1, policy_version 772922 (0.0010) [2023-12-26 05:48:18,295][123091] Updated weights for policy 0, policy_version 778330 (0.0005) [2023-12-26 05:48:18,358][123091] Updated weights for policy 0, policy_version 778340 (0.0007) [2023-12-26 05:48:18,411][123091] Updated weights for policy 0, policy_version 778350 (0.0007) [2023-12-26 05:48:18,584][123090] Updated weights for policy 1, policy_version 772932 (0.0009) [2023-12-26 05:48:18,646][123090] Updated weights for policy 1, policy_version 772942 (0.0009) [2023-12-26 05:48:18,696][123090] Updated weights for policy 1, policy_version 772952 (0.0005) [2023-12-26 05:48:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 397139968. Throughput: 0: 8864.2, 1: 8694.9. Samples: 397148152. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:18,785][121949] Avg episode reward: [(0, '6022.431'), (1, '5347.372')] [2023-12-26 05:48:19,081][123091] Updated weights for policy 0, policy_version 778360 (0.0007) [2023-12-26 05:48:19,159][123091] Updated weights for policy 0, policy_version 778370 (0.0007) [2023-12-26 05:48:19,227][123091] Updated weights for policy 0, policy_version 778380 (0.0011) [2023-12-26 05:48:19,543][123090] Updated weights for policy 1, policy_version 772962 (0.0007) [2023-12-26 05:48:19,609][123090] Updated weights for policy 1, policy_version 772972 (0.0008) [2023-12-26 05:48:19,675][123090] Updated weights for policy 1, policy_version 772982 (0.0008) [2023-12-26 05:48:19,737][123090] Updated weights for policy 1, policy_version 772992 (0.0008) [2023-12-26 05:48:19,897][123091] Updated weights for policy 0, policy_version 778390 (0.0009) [2023-12-26 05:48:19,966][123091] Updated weights for policy 0, policy_version 778400 (0.0010) [2023-12-26 05:48:20,030][123091] Updated weights for policy 0, policy_version 778410 (0.0009) [2023-12-26 05:48:20,556][123090] Updated weights for policy 1, policy_version 773002 (0.0006) [2023-12-26 05:48:20,627][123090] Updated weights for policy 1, policy_version 773012 (0.0008) [2023-12-26 05:48:20,690][123090] Updated weights for policy 1, policy_version 773022 (0.0008) [2023-12-26 05:48:20,703][123091] Updated weights for policy 0, policy_version 778420 (0.0009) [2023-12-26 05:48:20,775][123091] Updated weights for policy 0, policy_version 778430 (0.0005) [2023-12-26 05:48:20,840][123091] Updated weights for policy 0, policy_version 778440 (0.0008) [2023-12-26 05:48:21,545][123090] Updated weights for policy 1, policy_version 773032 (0.0008) [2023-12-26 05:48:21,610][123090] Updated weights for policy 1, policy_version 773042 (0.0008) [2023-12-26 05:48:21,618][123091] Updated weights for policy 0, policy_version 778450 (0.0007) [2023-12-26 05:48:21,683][123090] Updated weights for policy 1, policy_version 773052 (0.0008) [2023-12-26 05:48:21,687][123091] Updated weights for policy 0, policy_version 778460 (0.0009) [2023-12-26 05:48:21,763][123091] Updated weights for policy 0, policy_version 778470 (0.0009) [2023-12-26 05:48:21,836][123091] Updated weights for policy 0, policy_version 778480 (0.0008) [2023-12-26 05:48:22,524][123090] Updated weights for policy 1, policy_version 773062 (0.0007) [2023-12-26 05:48:22,587][123090] Updated weights for policy 1, policy_version 773072 (0.0006) [2023-12-26 05:48:22,655][123090] Updated weights for policy 1, policy_version 773082 (0.0008) [2023-12-26 05:48:22,693][123091] Updated weights for policy 0, policy_version 778490 (0.0009) [2023-12-26 05:48:22,760][123091] Updated weights for policy 0, policy_version 778500 (0.0009) [2023-12-26 05:48:22,819][123091] Updated weights for policy 0, policy_version 778510 (0.0009) [2023-12-26 05:48:23,385][123090] Updated weights for policy 1, policy_version 773092 (0.0008) [2023-12-26 05:48:23,433][123090] Updated weights for policy 1, policy_version 773102 (0.0006) [2023-12-26 05:48:23,479][123090] Updated weights for policy 1, policy_version 773112 (0.0006) [2023-12-26 05:48:23,557][123091] Updated weights for policy 0, policy_version 778520 (0.0006) [2023-12-26 05:48:23,612][123091] Updated weights for policy 0, policy_version 778530 (0.0005) [2023-12-26 05:48:23,682][123091] Updated weights for policy 0, policy_version 778540 (0.0005) [2023-12-26 05:48:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 397230080. Throughput: 0: 8873.9, 1: 8661.7. Samples: 397201520. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:23,785][121949] Avg episode reward: [(0, '5804.080'), (1, '5290.518')] [2023-12-26 05:48:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000773120_197918720.pth... [2023-12-26 05:48:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000778544_199311360.pth... [2023-12-26 05:48:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000777488_199041024.pth [2023-12-26 05:48:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000772096_197656576.pth [2023-12-26 05:48:24,309][123090] Updated weights for policy 1, policy_version 773122 (0.0006) [2023-12-26 05:48:24,362][123090] Updated weights for policy 1, policy_version 773132 (0.0009) [2023-12-26 05:48:24,395][123091] Updated weights for policy 0, policy_version 778550 (0.0005) [2023-12-26 05:48:24,412][123090] Updated weights for policy 1, policy_version 773142 (0.0009) [2023-12-26 05:48:24,462][123091] Updated weights for policy 0, policy_version 778560 (0.0006) [2023-12-26 05:48:24,468][123090] Updated weights for policy 1, policy_version 773152 (0.0009) [2023-12-26 05:48:24,529][123091] Updated weights for policy 0, policy_version 778570 (0.0008) [2023-12-26 05:48:25,219][123091] Updated weights for policy 0, policy_version 778580 (0.0008) [2023-12-26 05:48:25,264][123091] Updated weights for policy 0, policy_version 778590 (0.0005) [2023-12-26 05:48:25,292][123090] Updated weights for policy 1, policy_version 773162 (0.0005) [2023-12-26 05:48:25,311][123091] Updated weights for policy 0, policy_version 778600 (0.0005) [2023-12-26 05:48:25,350][123090] Updated weights for policy 1, policy_version 773172 (0.0007) [2023-12-26 05:48:25,414][123090] Updated weights for policy 1, policy_version 773182 (0.0010) [2023-12-26 05:48:26,001][123091] Updated weights for policy 0, policy_version 778610 (0.0005) [2023-12-26 05:48:26,065][123091] Updated weights for policy 0, policy_version 778620 (0.0007) [2023-12-26 05:48:26,140][123091] Updated weights for policy 0, policy_version 778630 (0.0006) [2023-12-26 05:48:26,211][123091] Updated weights for policy 0, policy_version 778640 (0.0006) [2023-12-26 05:48:26,231][123090] Updated weights for policy 1, policy_version 773192 (0.0011) [2023-12-26 05:48:26,290][123090] Updated weights for policy 1, policy_version 773202 (0.0010) [2023-12-26 05:48:26,345][123090] Updated weights for policy 1, policy_version 773212 (0.0010) [2023-12-26 05:48:26,880][123091] Updated weights for policy 0, policy_version 778650 (0.0005) [2023-12-26 05:48:26,934][123091] Updated weights for policy 0, policy_version 778660 (0.0005) [2023-12-26 05:48:26,982][123091] Updated weights for policy 0, policy_version 778670 (0.0005) [2023-12-26 05:48:27,083][123090] Updated weights for policy 1, policy_version 773222 (0.0007) [2023-12-26 05:48:27,133][123090] Updated weights for policy 1, policy_version 773232 (0.0005) [2023-12-26 05:48:27,180][123090] Updated weights for policy 1, policy_version 773242 (0.0005) [2023-12-26 05:48:27,687][123091] Updated weights for policy 0, policy_version 778680 (0.0005) [2023-12-26 05:48:27,750][123091] Updated weights for policy 0, policy_version 778690 (0.0005) [2023-12-26 05:48:27,807][123091] Updated weights for policy 0, policy_version 778700 (0.0005) [2023-12-26 05:48:27,964][123090] Updated weights for policy 1, policy_version 773252 (0.0006) [2023-12-26 05:48:28,012][123090] Updated weights for policy 1, policy_version 773262 (0.0005) [2023-12-26 05:48:28,070][123090] Updated weights for policy 1, policy_version 773272 (0.0008) [2023-12-26 05:48:28,565][123091] Updated weights for policy 0, policy_version 778710 (0.0008) [2023-12-26 05:48:28,619][123091] Updated weights for policy 0, policy_version 778720 (0.0010) [2023-12-26 05:48:28,678][123091] Updated weights for policy 0, policy_version 778730 (0.0010) [2023-12-26 05:48:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 397320192. Throughput: 0: 8983.3, 1: 8771.3. Samples: 397312484. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:28,785][121949] Avg episode reward: [(0, '5615.476'), (1, '5436.453')] [2023-12-26 05:48:28,828][123090] Updated weights for policy 1, policy_version 773282 (0.0007) [2023-12-26 05:48:28,888][123090] Updated weights for policy 1, policy_version 773292 (0.0009) [2023-12-26 05:48:28,940][123090] Updated weights for policy 1, policy_version 773302 (0.0009) [2023-12-26 05:48:28,988][123090] Updated weights for policy 1, policy_version 773312 (0.0009) [2023-12-26 05:48:29,451][123091] Updated weights for policy 0, policy_version 778740 (0.0008) [2023-12-26 05:48:29,507][123091] Updated weights for policy 0, policy_version 778751 (0.0007) [2023-12-26 05:48:29,563][123091] Updated weights for policy 0, policy_version 778761 (0.0005) [2023-12-26 05:48:29,919][123090] Updated weights for policy 1, policy_version 773322 (0.0009) [2023-12-26 05:48:29,986][123090] Updated weights for policy 1, policy_version 773332 (0.0010) [2023-12-26 05:48:30,050][123090] Updated weights for policy 1, policy_version 773342 (0.0009) [2023-12-26 05:48:30,336][123091] Updated weights for policy 0, policy_version 778771 (0.0006) [2023-12-26 05:48:30,395][123091] Updated weights for policy 0, policy_version 778781 (0.0006) [2023-12-26 05:48:30,443][123091] Updated weights for policy 0, policy_version 778791 (0.0005) [2023-12-26 05:48:30,810][123090] Updated weights for policy 1, policy_version 773352 (0.0006) [2023-12-26 05:48:30,866][123090] Updated weights for policy 1, policy_version 773362 (0.0005) [2023-12-26 05:48:30,928][123090] Updated weights for policy 1, policy_version 773372 (0.0005) [2023-12-26 05:48:31,153][123091] Updated weights for policy 0, policy_version 778801 (0.0007) [2023-12-26 05:48:31,205][123091] Updated weights for policy 0, policy_version 778811 (0.0009) [2023-12-26 05:48:31,267][123091] Updated weights for policy 0, policy_version 778821 (0.0009) [2023-12-26 05:48:31,328][123091] Updated weights for policy 0, policy_version 778831 (0.0009) [2023-12-26 05:48:31,674][123090] Updated weights for policy 1, policy_version 773382 (0.0008) [2023-12-26 05:48:31,738][123090] Updated weights for policy 1, policy_version 773392 (0.0009) [2023-12-26 05:48:31,799][123090] Updated weights for policy 1, policy_version 773402 (0.0006) [2023-12-26 05:48:32,165][123091] Updated weights for policy 0, policy_version 778841 (0.0010) [2023-12-26 05:48:32,231][123091] Updated weights for policy 0, policy_version 778851 (0.0009) [2023-12-26 05:48:32,296][123091] Updated weights for policy 0, policy_version 778861 (0.0009) [2023-12-26 05:48:32,502][123090] Updated weights for policy 1, policy_version 773412 (0.0007) [2023-12-26 05:48:32,562][123090] Updated weights for policy 1, policy_version 773422 (0.0009) [2023-12-26 05:48:32,627][123090] Updated weights for policy 1, policy_version 773432 (0.0009) [2023-12-26 05:48:33,126][123091] Updated weights for policy 0, policy_version 778871 (0.0010) [2023-12-26 05:48:33,188][123091] Updated weights for policy 0, policy_version 778881 (0.0010) [2023-12-26 05:48:33,245][123091] Updated weights for policy 0, policy_version 778891 (0.0010) [2023-12-26 05:48:33,457][123090] Updated weights for policy 1, policy_version 773442 (0.0010) [2023-12-26 05:48:33,517][123090] Updated weights for policy 1, policy_version 773452 (0.0009) [2023-12-26 05:48:33,574][123090] Updated weights for policy 1, policy_version 773462 (0.0009) [2023-12-26 05:48:33,633][123090] Updated weights for policy 1, policy_version 773472 (0.0010) [2023-12-26 05:48:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 397410304. Throughput: 0: 9001.8, 1: 8759.0. Samples: 397420672. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:33,785][121949] Avg episode reward: [(0, '5805.868'), (1, '5605.961')] [2023-12-26 05:48:33,913][123091] Updated weights for policy 0, policy_version 778901 (0.0008) [2023-12-26 05:48:33,960][123091] Updated weights for policy 0, policy_version 778911 (0.0005) [2023-12-26 05:48:34,005][123091] Updated weights for policy 0, policy_version 778921 (0.0005) [2023-12-26 05:48:34,562][123090] Updated weights for policy 1, policy_version 773482 (0.0010) [2023-12-26 05:48:34,637][123090] Updated weights for policy 1, policy_version 773492 (0.0009) [2023-12-26 05:48:34,714][123090] Updated weights for policy 1, policy_version 773502 (0.0009) [2023-12-26 05:48:34,724][123091] Updated weights for policy 0, policy_version 778931 (0.0008) [2023-12-26 05:48:34,796][123091] Updated weights for policy 0, policy_version 778941 (0.0006) [2023-12-26 05:48:34,854][123091] Updated weights for policy 0, policy_version 778951 (0.0005) [2023-12-26 05:48:35,505][123091] Updated weights for policy 0, policy_version 778961 (0.0005) [2023-12-26 05:48:35,556][123091] Updated weights for policy 0, policy_version 778971 (0.0011) [2023-12-26 05:48:35,598][123090] Updated weights for policy 1, policy_version 773512 (0.0009) [2023-12-26 05:48:35,604][123091] Updated weights for policy 0, policy_version 778981 (0.0010) [2023-12-26 05:48:35,646][123090] Updated weights for policy 1, policy_version 773522 (0.0006) [2023-12-26 05:48:35,664][123091] Updated weights for policy 0, policy_version 778991 (0.0011) [2023-12-26 05:48:35,711][123090] Updated weights for policy 1, policy_version 773532 (0.0008) [2023-12-26 05:48:36,469][123090] Updated weights for policy 1, policy_version 773542 (0.0008) [2023-12-26 05:48:36,505][123091] Updated weights for policy 0, policy_version 779001 (0.0011) [2023-12-26 05:48:36,518][123090] Updated weights for policy 1, policy_version 773552 (0.0008) [2023-12-26 05:48:36,570][123091] Updated weights for policy 0, policy_version 779011 (0.0011) [2023-12-26 05:48:36,578][123090] Updated weights for policy 1, policy_version 773562 (0.0006) [2023-12-26 05:48:36,625][123091] Updated weights for policy 0, policy_version 779021 (0.0009) [2023-12-26 05:48:37,447][123090] Updated weights for policy 1, policy_version 773572 (0.0009) [2023-12-26 05:48:37,462][123091] Updated weights for policy 0, policy_version 779031 (0.0009) [2023-12-26 05:48:37,499][123090] Updated weights for policy 1, policy_version 773582 (0.0010) [2023-12-26 05:48:37,522][123091] Updated weights for policy 0, policy_version 779041 (0.0009) [2023-12-26 05:48:37,555][123090] Updated weights for policy 1, policy_version 773592 (0.0010) [2023-12-26 05:48:37,587][123091] Updated weights for policy 0, policy_version 779051 (0.0008) [2023-12-26 05:48:38,375][123091] Updated weights for policy 0, policy_version 779061 (0.0009) [2023-12-26 05:48:38,379][123090] Updated weights for policy 1, policy_version 773602 (0.0007) [2023-12-26 05:48:38,438][123091] Updated weights for policy 0, policy_version 779071 (0.0008) [2023-12-26 05:48:38,445][123090] Updated weights for policy 1, policy_version 773612 (0.0011) [2023-12-26 05:48:38,499][123090] Updated weights for policy 1, policy_version 773622 (0.0011) [2023-12-26 05:48:38,503][123091] Updated weights for policy 0, policy_version 779081 (0.0007) [2023-12-26 05:48:38,555][123090] Updated weights for policy 1, policy_version 773632 (0.0010) [2023-12-26 05:48:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 397500416. Throughput: 0: 9076.5, 1: 8733.9. Samples: 397474572. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:38,785][121949] Avg episode reward: [(0, '5854.679'), (1, '5549.364')] [2023-12-26 05:48:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000779088_199450624.pth... [2023-12-26 05:48:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000773632_198049792.pth... [2023-12-26 05:48:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000778000_199172096.pth [2023-12-26 05:48:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000772608_197787648.pth [2023-12-26 05:48:39,289][123091] Updated weights for policy 0, policy_version 779091 (0.0006) [2023-12-26 05:48:39,358][123091] Updated weights for policy 0, policy_version 779101 (0.0009) [2023-12-26 05:48:39,406][123090] Updated weights for policy 1, policy_version 773642 (0.0010) [2023-12-26 05:48:39,430][123091] Updated weights for policy 0, policy_version 779111 (0.0009) [2023-12-26 05:48:39,480][123090] Updated weights for policy 1, policy_version 773652 (0.0010) [2023-12-26 05:48:39,547][123090] Updated weights for policy 1, policy_version 773662 (0.0009) [2023-12-26 05:48:40,313][123091] Updated weights for policy 0, policy_version 779121 (0.0008) [2023-12-26 05:48:40,336][123090] Updated weights for policy 1, policy_version 773672 (0.0009) [2023-12-26 05:48:40,378][123091] Updated weights for policy 0, policy_version 779131 (0.0006) [2023-12-26 05:48:40,409][123090] Updated weights for policy 1, policy_version 773682 (0.0007) [2023-12-26 05:48:40,447][123091] Updated weights for policy 0, policy_version 779141 (0.0008) [2023-12-26 05:48:40,476][123090] Updated weights for policy 1, policy_version 773692 (0.0006) [2023-12-26 05:48:40,520][123091] Updated weights for policy 0, policy_version 779151 (0.0009) [2023-12-26 05:48:41,172][123090] Updated weights for policy 1, policy_version 773702 (0.0009) [2023-12-26 05:48:41,244][123090] Updated weights for policy 1, policy_version 773712 (0.0008) [2023-12-26 05:48:41,312][123090] Updated weights for policy 1, policy_version 773722 (0.0006) [2023-12-26 05:48:41,385][123091] Updated weights for policy 0, policy_version 779161 (0.0007) [2023-12-26 05:48:41,444][123091] Updated weights for policy 0, policy_version 779171 (0.0009) [2023-12-26 05:48:41,510][123091] Updated weights for policy 0, policy_version 779181 (0.0009) [2023-12-26 05:48:42,126][123090] Updated weights for policy 1, policy_version 773732 (0.0007) [2023-12-26 05:48:42,194][123090] Updated weights for policy 1, policy_version 773742 (0.0007) [2023-12-26 05:48:42,264][123090] Updated weights for policy 1, policy_version 773752 (0.0006) [2023-12-26 05:48:42,284][123091] Updated weights for policy 0, policy_version 779191 (0.0008) [2023-12-26 05:48:42,348][123091] Updated weights for policy 0, policy_version 779201 (0.0009) [2023-12-26 05:48:42,420][123091] Updated weights for policy 0, policy_version 779211 (0.0008) [2023-12-26 05:48:43,052][123090] Updated weights for policy 1, policy_version 773762 (0.0008) [2023-12-26 05:48:43,121][123090] Updated weights for policy 1, policy_version 773772 (0.0005) [2023-12-26 05:48:43,162][123091] Updated weights for policy 0, policy_version 779221 (0.0008) [2023-12-26 05:48:43,177][123090] Updated weights for policy 1, policy_version 773782 (0.0005) [2023-12-26 05:48:43,216][123091] Updated weights for policy 0, policy_version 779231 (0.0006) [2023-12-26 05:48:43,227][123090] Updated weights for policy 1, policy_version 773792 (0.0005) [2023-12-26 05:48:43,270][123091] Updated weights for policy 0, policy_version 779241 (0.0005) [2023-12-26 05:48:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 397582336. Throughput: 0: 9028.1, 1: 8680.6. Samples: 397577904. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:43,785][121949] Avg episode reward: [(0, '5845.540'), (1, '5490.205')] [2023-12-26 05:48:43,850][123090] Updated weights for policy 1, policy_version 773802 (0.0005) [2023-12-26 05:48:43,909][123090] Updated weights for policy 1, policy_version 773812 (0.0006) [2023-12-26 05:48:43,947][123091] Updated weights for policy 0, policy_version 779251 (0.0008) [2023-12-26 05:48:43,976][123090] Updated weights for policy 1, policy_version 773822 (0.0008) [2023-12-26 05:48:44,001][123091] Updated weights for policy 0, policy_version 779261 (0.0008) [2023-12-26 05:48:44,056][123091] Updated weights for policy 0, policy_version 779271 (0.0009) [2023-12-26 05:48:44,633][123090] Updated weights for policy 1, policy_version 773832 (0.0006) [2023-12-26 05:48:44,681][123090] Updated weights for policy 1, policy_version 773842 (0.0005) [2023-12-26 05:48:44,745][123090] Updated weights for policy 1, policy_version 773852 (0.0009) [2023-12-26 05:48:44,857][123091] Updated weights for policy 0, policy_version 779281 (0.0009) [2023-12-26 05:48:44,907][123091] Updated weights for policy 0, policy_version 779291 (0.0005) [2023-12-26 05:48:44,963][123091] Updated weights for policy 0, policy_version 779301 (0.0006) [2023-12-26 05:48:45,017][123091] Updated weights for policy 0, policy_version 779311 (0.0005) [2023-12-26 05:48:45,445][123090] Updated weights for policy 1, policy_version 773862 (0.0007) [2023-12-26 05:48:45,494][123090] Updated weights for policy 1, policy_version 773872 (0.0005) [2023-12-26 05:48:45,565][123090] Updated weights for policy 1, policy_version 773882 (0.0006) [2023-12-26 05:48:45,603][123091] Updated weights for policy 0, policy_version 779321 (0.0005) [2023-12-26 05:48:45,666][123091] Updated weights for policy 0, policy_version 779331 (0.0006) [2023-12-26 05:48:45,742][123091] Updated weights for policy 0, policy_version 779341 (0.0006) [2023-12-26 05:48:46,262][123090] Updated weights for policy 1, policy_version 773892 (0.0008) [2023-12-26 05:48:46,309][123090] Updated weights for policy 1, policy_version 773902 (0.0009) [2023-12-26 05:48:46,358][123090] Updated weights for policy 1, policy_version 773912 (0.0009) [2023-12-26 05:48:46,393][123091] Updated weights for policy 0, policy_version 779351 (0.0007) [2023-12-26 05:48:46,446][123091] Updated weights for policy 0, policy_version 779361 (0.0008) [2023-12-26 05:48:46,495][123091] Updated weights for policy 0, policy_version 779371 (0.0009) [2023-12-26 05:48:47,060][123090] Updated weights for policy 1, policy_version 773922 (0.0008) [2023-12-26 05:48:47,113][123090] Updated weights for policy 1, policy_version 773932 (0.0009) [2023-12-26 05:48:47,167][123090] Updated weights for policy 1, policy_version 773942 (0.0005) [2023-12-26 05:48:47,223][123090] Updated weights for policy 1, policy_version 773952 (0.0005) [2023-12-26 05:48:47,422][123091] Updated weights for policy 0, policy_version 779382 (0.0010) [2023-12-26 05:48:47,469][123091] Updated weights for policy 0, policy_version 779392 (0.0009) [2023-12-26 05:48:47,531][123091] Updated weights for policy 0, policy_version 779402 (0.0009) [2023-12-26 05:48:47,934][123090] Updated weights for policy 1, policy_version 773962 (0.0010) [2023-12-26 05:48:48,000][123090] Updated weights for policy 1, policy_version 773972 (0.0010) [2023-12-26 05:48:48,063][123090] Updated weights for policy 1, policy_version 773982 (0.0009) [2023-12-26 05:48:48,353][123091] Updated weights for policy 0, policy_version 779412 (0.0009) [2023-12-26 05:48:48,412][123091] Updated weights for policy 0, policy_version 779422 (0.0010) [2023-12-26 05:48:48,474][123091] Updated weights for policy 0, policy_version 779432 (0.0009) [2023-12-26 05:48:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 397680640. Throughput: 0: 9105.8, 1: 8818.9. Samples: 397692164. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:48,785][121949] Avg episode reward: [(0, '5829.589'), (1, '5453.504')] [2023-12-26 05:48:48,943][123090] Updated weights for policy 1, policy_version 773992 (0.0009) [2023-12-26 05:48:48,995][123090] Updated weights for policy 1, policy_version 774002 (0.0009) [2023-12-26 05:48:49,056][123090] Updated weights for policy 1, policy_version 774012 (0.0010) [2023-12-26 05:48:49,313][123091] Updated weights for policy 0, policy_version 779442 (0.0009) [2023-12-26 05:48:49,379][123091] Updated weights for policy 0, policy_version 779452 (0.0009) [2023-12-26 05:48:49,429][123091] Updated weights for policy 0, policy_version 779462 (0.0010) [2023-12-26 05:48:49,482][123091] Updated weights for policy 0, policy_version 779472 (0.0009) [2023-12-26 05:48:49,936][123090] Updated weights for policy 1, policy_version 774022 (0.0008) [2023-12-26 05:48:50,003][123090] Updated weights for policy 1, policy_version 774032 (0.0010) [2023-12-26 05:48:50,074][123090] Updated weights for policy 1, policy_version 774042 (0.0009) [2023-12-26 05:48:50,344][123091] Updated weights for policy 0, policy_version 779482 (0.0010) [2023-12-26 05:48:50,394][123091] Updated weights for policy 0, policy_version 779492 (0.0009) [2023-12-26 05:48:50,470][123091] Updated weights for policy 0, policy_version 779502 (0.0010) [2023-12-26 05:48:50,880][123090] Updated weights for policy 1, policy_version 774052 (0.0010) [2023-12-26 05:48:50,929][123090] Updated weights for policy 1, policy_version 774062 (0.0010) [2023-12-26 05:48:50,988][123090] Updated weights for policy 1, policy_version 774072 (0.0011) [2023-12-26 05:48:51,340][123091] Updated weights for policy 0, policy_version 779512 (0.0009) [2023-12-26 05:48:51,410][123091] Updated weights for policy 0, policy_version 779522 (0.0010) [2023-12-26 05:48:51,478][123091] Updated weights for policy 0, policy_version 779532 (0.0006) [2023-12-26 05:48:51,823][123090] Updated weights for policy 1, policy_version 774082 (0.0009) [2023-12-26 05:48:51,888][123090] Updated weights for policy 1, policy_version 774092 (0.0005) [2023-12-26 05:48:51,952][123090] Updated weights for policy 1, policy_version 774102 (0.0005) [2023-12-26 05:48:52,007][123090] Updated weights for policy 1, policy_version 774112 (0.0005) [2023-12-26 05:48:52,374][123091] Updated weights for policy 0, policy_version 779542 (0.0010) [2023-12-26 05:48:52,437][123091] Updated weights for policy 0, policy_version 779552 (0.0010) [2023-12-26 05:48:52,508][123091] Updated weights for policy 0, policy_version 779562 (0.0009) [2023-12-26 05:48:52,698][123090] Updated weights for policy 1, policy_version 774122 (0.0005) [2023-12-26 05:48:52,753][123090] Updated weights for policy 1, policy_version 774132 (0.0007) [2023-12-26 05:48:52,812][123090] Updated weights for policy 1, policy_version 774142 (0.0006) [2023-12-26 05:48:53,404][123091] Updated weights for policy 0, policy_version 779572 (0.0010) [2023-12-26 05:48:53,457][123091] Updated weights for policy 0, policy_version 779582 (0.0009) [2023-12-26 05:48:53,510][123091] Updated weights for policy 0, policy_version 779592 (0.0008) [2023-12-26 05:48:53,596][123090] Updated weights for policy 1, policy_version 774152 (0.0010) [2023-12-26 05:48:53,663][123090] Updated weights for policy 1, policy_version 774162 (0.0010) [2023-12-26 05:48:53,734][123090] Updated weights for policy 1, policy_version 774172 (0.0011) [2023-12-26 05:48:53,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 397770752. Throughput: 0: 9057.0, 1: 8826.9. Samples: 397742388. Policy #0 lag: (min: 13.0, avg: 17.0, max: 45.0) [2023-12-26 05:48:53,785][121949] Avg episode reward: [(0, '5791.195'), (1, '5409.951')] [2023-12-26 05:48:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000779600_199581696.pth... [2023-12-26 05:48:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000774176_198189056.pth... [2023-12-26 05:48:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000778544_199311360.pth [2023-12-26 05:48:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000773120_197918720.pth [2023-12-26 05:48:54,292][123091] Updated weights for policy 0, policy_version 779602 (0.0009) [2023-12-26 05:48:54,345][123091] Updated weights for policy 0, policy_version 779612 (0.0008) [2023-12-26 05:48:54,406][123091] Updated weights for policy 0, policy_version 779622 (0.0007) [2023-12-26 05:48:54,466][123091] Updated weights for policy 0, policy_version 779632 (0.0008) [2023-12-26 05:48:54,467][123090] Updated weights for policy 1, policy_version 774182 (0.0007) [2023-12-26 05:48:54,523][123090] Updated weights for policy 1, policy_version 774192 (0.0005) [2023-12-26 05:48:54,579][123090] Updated weights for policy 1, policy_version 774202 (0.0005) [2023-12-26 05:48:55,244][123090] Updated weights for policy 1, policy_version 774212 (0.0007) [2023-12-26 05:48:55,295][123091] Updated weights for policy 0, policy_version 779642 (0.0011) [2023-12-26 05:48:55,308][123090] Updated weights for policy 1, policy_version 774222 (0.0011) [2023-12-26 05:48:55,359][123091] Updated weights for policy 0, policy_version 779652 (0.0010) [2023-12-26 05:48:55,367][123090] Updated weights for policy 1, policy_version 774232 (0.0008) [2023-12-26 05:48:55,427][123091] Updated weights for policy 0, policy_version 779662 (0.0011) [2023-12-26 05:48:56,175][123090] Updated weights for policy 1, policy_version 774242 (0.0011) [2023-12-26 05:48:56,207][123091] Updated weights for policy 0, policy_version 779672 (0.0010) [2023-12-26 05:48:56,226][123090] Updated weights for policy 1, policy_version 774252 (0.0010) [2023-12-26 05:48:56,251][123091] Updated weights for policy 0, policy_version 779682 (0.0005) [2023-12-26 05:48:56,278][123090] Updated weights for policy 1, policy_version 774262 (0.0010) [2023-12-26 05:48:56,300][123091] Updated weights for policy 0, policy_version 779692 (0.0010) [2023-12-26 05:48:56,329][123090] Updated weights for policy 1, policy_version 774272 (0.0010) [2023-12-26 05:48:57,067][123091] Updated weights for policy 0, policy_version 779702 (0.0007) [2023-12-26 05:48:57,134][123091] Updated weights for policy 0, policy_version 779712 (0.0005) [2023-12-26 05:48:57,185][123090] Updated weights for policy 1, policy_version 774282 (0.0005) [2023-12-26 05:48:57,198][123091] Updated weights for policy 0, policy_version 779722 (0.0006) [2023-12-26 05:48:57,252][123090] Updated weights for policy 1, policy_version 774292 (0.0005) [2023-12-26 05:48:57,309][123090] Updated weights for policy 1, policy_version 774302 (0.0005) [2023-12-26 05:48:57,814][123091] Updated weights for policy 0, policy_version 779732 (0.0008) [2023-12-26 05:48:57,875][123091] Updated weights for policy 0, policy_version 779742 (0.0010) [2023-12-26 05:48:57,937][123091] Updated weights for policy 0, policy_version 779752 (0.0010) [2023-12-26 05:48:57,956][123090] Updated weights for policy 1, policy_version 774312 (0.0007) [2023-12-26 05:48:58,020][123090] Updated weights for policy 1, policy_version 774322 (0.0010) [2023-12-26 05:48:58,089][123090] Updated weights for policy 1, policy_version 774332 (0.0010) [2023-12-26 05:48:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17886.2, 300 sec: 17689.2). Total num frames: 397852672. Throughput: 0: 9091.7, 1: 8891.5. Samples: 397851188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:48:58,785][121949] Avg episode reward: [(0, '5854.661'), (1, '5564.223')] [2023-12-26 05:48:58,871][123091] Updated weights for policy 0, policy_version 779762 (0.0010) [2023-12-26 05:48:58,939][123091] Updated weights for policy 0, policy_version 779772 (0.0009) [2023-12-26 05:48:58,951][123090] Updated weights for policy 1, policy_version 774342 (0.0009) [2023-12-26 05:48:58,998][123091] Updated weights for policy 0, policy_version 779782 (0.0008) [2023-12-26 05:48:59,009][123090] Updated weights for policy 1, policy_version 774352 (0.0008) [2023-12-26 05:48:59,066][123091] Updated weights for policy 0, policy_version 779792 (0.0007) [2023-12-26 05:48:59,080][123090] Updated weights for policy 1, policy_version 774362 (0.0007) [2023-12-26 05:48:59,834][123090] Updated weights for policy 1, policy_version 774372 (0.0006) [2023-12-26 05:48:59,896][123090] Updated weights for policy 1, policy_version 774382 (0.0007) [2023-12-26 05:48:59,953][123090] Updated weights for policy 1, policy_version 774392 (0.0007) [2023-12-26 05:48:59,973][123091] Updated weights for policy 0, policy_version 779802 (0.0009) [2023-12-26 05:49:00,040][123091] Updated weights for policy 0, policy_version 779812 (0.0010) [2023-12-26 05:49:00,104][123091] Updated weights for policy 0, policy_version 779822 (0.0010) [2023-12-26 05:49:00,731][123090] Updated weights for policy 1, policy_version 774402 (0.0006) [2023-12-26 05:49:00,788][123090] Updated weights for policy 1, policy_version 774412 (0.0008) [2023-12-26 05:49:00,835][123090] Updated weights for policy 1, policy_version 774422 (0.0006) [2023-12-26 05:49:00,893][123090] Updated weights for policy 1, policy_version 774432 (0.0005) [2023-12-26 05:49:00,895][123091] Updated weights for policy 0, policy_version 779832 (0.0006) [2023-12-26 05:49:00,949][123091] Updated weights for policy 0, policy_version 779842 (0.0005) [2023-12-26 05:49:01,000][123091] Updated weights for policy 0, policy_version 779852 (0.0005) [2023-12-26 05:49:01,637][123090] Updated weights for policy 1, policy_version 774442 (0.0007) [2023-12-26 05:49:01,701][123090] Updated weights for policy 1, policy_version 774452 (0.0008) [2023-12-26 05:49:01,776][123090] Updated weights for policy 1, policy_version 774462 (0.0010) [2023-12-26 05:49:01,793][123091] Updated weights for policy 0, policy_version 779862 (0.0007) [2023-12-26 05:49:01,850][123091] Updated weights for policy 0, policy_version 779872 (0.0010) [2023-12-26 05:49:01,898][123091] Updated weights for policy 0, policy_version 779882 (0.0009) [2023-12-26 05:49:02,517][123090] Updated weights for policy 1, policy_version 774472 (0.0006) [2023-12-26 05:49:02,571][123090] Updated weights for policy 1, policy_version 774482 (0.0006) [2023-12-26 05:49:02,613][123091] Updated weights for policy 0, policy_version 779892 (0.0007) [2023-12-26 05:49:02,627][123090] Updated weights for policy 1, policy_version 774492 (0.0006) [2023-12-26 05:49:02,657][123091] Updated weights for policy 0, policy_version 779902 (0.0005) [2023-12-26 05:49:02,708][123091] Updated weights for policy 0, policy_version 779912 (0.0007) [2023-12-26 05:49:03,363][123091] Updated weights for policy 0, policy_version 779922 (0.0006) [2023-12-26 05:49:03,408][123090] Updated weights for policy 1, policy_version 774502 (0.0006) [2023-12-26 05:49:03,411][123091] Updated weights for policy 0, policy_version 779932 (0.0007) [2023-12-26 05:49:03,463][123091] Updated weights for policy 0, policy_version 779942 (0.0007) [2023-12-26 05:49:03,479][123090] Updated weights for policy 1, policy_version 774512 (0.0006) [2023-12-26 05:49:03,518][123091] Updated weights for policy 0, policy_version 779952 (0.0008) [2023-12-26 05:49:03,543][123090] Updated weights for policy 1, policy_version 774522 (0.0005) [2023-12-26 05:49:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 397950976. Throughput: 0: 9056.6, 1: 8968.2. Samples: 397959268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:03,786][121949] Avg episode reward: [(0, '5886.115'), (1, '5794.449')] [2023-12-26 05:49:04,215][123090] Updated weights for policy 1, policy_version 774532 (0.0007) [2023-12-26 05:49:04,283][123090] Updated weights for policy 1, policy_version 774542 (0.0011) [2023-12-26 05:49:04,347][123090] Updated weights for policy 1, policy_version 774552 (0.0011) [2023-12-26 05:49:04,400][123091] Updated weights for policy 0, policy_version 779962 (0.0006) [2023-12-26 05:49:04,458][123091] Updated weights for policy 0, policy_version 779972 (0.0009) [2023-12-26 05:49:04,523][123091] Updated weights for policy 0, policy_version 779982 (0.0009) [2023-12-26 05:49:05,166][123090] Updated weights for policy 1, policy_version 774562 (0.0010) [2023-12-26 05:49:05,239][123090] Updated weights for policy 1, policy_version 774572 (0.0010) [2023-12-26 05:49:05,275][123091] Updated weights for policy 0, policy_version 779992 (0.0006) [2023-12-26 05:49:05,287][123090] Updated weights for policy 1, policy_version 774582 (0.0010) [2023-12-26 05:49:05,322][123091] Updated weights for policy 0, policy_version 780002 (0.0007) [2023-12-26 05:49:05,338][123090] Updated weights for policy 1, policy_version 774592 (0.0010) [2023-12-26 05:49:05,373][123091] Updated weights for policy 0, policy_version 780012 (0.0010) [2023-12-26 05:49:06,136][123090] Updated weights for policy 1, policy_version 774602 (0.0007) [2023-12-26 05:49:06,144][123091] Updated weights for policy 0, policy_version 780022 (0.0011) [2023-12-26 05:49:06,193][123090] Updated weights for policy 1, policy_version 774612 (0.0007) [2023-12-26 05:49:06,211][123091] Updated weights for policy 0, policy_version 780032 (0.0011) [2023-12-26 05:49:06,258][123090] Updated weights for policy 1, policy_version 774622 (0.0007) [2023-12-26 05:49:06,279][123091] Updated weights for policy 0, policy_version 780042 (0.0011) [2023-12-26 05:49:06,977][123090] Updated weights for policy 1, policy_version 774632 (0.0006) [2023-12-26 05:49:07,043][123090] Updated weights for policy 1, policy_version 774642 (0.0005) [2023-12-26 05:49:07,099][123090] Updated weights for policy 1, policy_version 774652 (0.0005) [2023-12-26 05:49:07,109][123091] Updated weights for policy 0, policy_version 780052 (0.0011) [2023-12-26 05:49:07,157][123091] Updated weights for policy 0, policy_version 780062 (0.0010) [2023-12-26 05:49:07,204][123091] Updated weights for policy 0, policy_version 780072 (0.0010) [2023-12-26 05:49:07,743][123090] Updated weights for policy 1, policy_version 774662 (0.0006) [2023-12-26 05:49:07,814][123090] Updated weights for policy 1, policy_version 774672 (0.0005) [2023-12-26 05:49:07,883][123090] Updated weights for policy 1, policy_version 774682 (0.0006) [2023-12-26 05:49:07,949][123091] Updated weights for policy 0, policy_version 780082 (0.0010) [2023-12-26 05:49:08,017][123091] Updated weights for policy 0, policy_version 780092 (0.0011) [2023-12-26 05:49:08,081][123091] Updated weights for policy 0, policy_version 780102 (0.0011) [2023-12-26 05:49:08,148][123091] Updated weights for policy 0, policy_version 780112 (0.0008) [2023-12-26 05:49:08,648][123090] Updated weights for policy 1, policy_version 774692 (0.0009) [2023-12-26 05:49:08,713][123090] Updated weights for policy 1, policy_version 774702 (0.0011) [2023-12-26 05:49:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 398032896. Throughput: 0: 9013.6, 1: 9010.5. Samples: 398012608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:08,785][123090] Updated weights for policy 1, policy_version 774712 (0.0011) [2023-12-26 05:49:08,785][121949] Avg episode reward: [(0, '6056.669'), (1, '5805.747')] [2023-12-26 05:49:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000780112_199712768.pth... [2023-12-26 05:49:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000779088_199450624.pth [2023-12-26 05:49:08,837][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000774720_198328320.pth... [2023-12-26 05:49:08,842][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000773632_198049792.pth [2023-12-26 05:49:08,876][123091] Updated weights for policy 0, policy_version 780122 (0.0009) [2023-12-26 05:49:08,936][123091] Updated weights for policy 0, policy_version 780132 (0.0011) [2023-12-26 05:49:08,999][123091] Updated weights for policy 0, policy_version 780142 (0.0010) [2023-12-26 05:49:09,623][123090] Updated weights for policy 1, policy_version 774722 (0.0010) [2023-12-26 05:49:09,683][123090] Updated weights for policy 1, policy_version 774732 (0.0009) [2023-12-26 05:49:09,747][123090] Updated weights for policy 1, policy_version 774742 (0.0009) [2023-12-26 05:49:09,805][123090] Updated weights for policy 1, policy_version 774752 (0.0009) [2023-12-26 05:49:09,856][123091] Updated weights for policy 0, policy_version 780152 (0.0011) [2023-12-26 05:49:09,917][123091] Updated weights for policy 0, policy_version 780162 (0.0011) [2023-12-26 05:49:09,986][123091] Updated weights for policy 0, policy_version 780172 (0.0011) [2023-12-26 05:49:10,670][123090] Updated weights for policy 1, policy_version 774762 (0.0009) [2023-12-26 05:49:10,724][123090] Updated weights for policy 1, policy_version 774772 (0.0009) [2023-12-26 05:49:10,781][123090] Updated weights for policy 1, policy_version 774782 (0.0008) [2023-12-26 05:49:10,817][123091] Updated weights for policy 0, policy_version 780182 (0.0011) [2023-12-26 05:49:10,869][123091] Updated weights for policy 0, policy_version 780192 (0.0011) [2023-12-26 05:49:10,917][123091] Updated weights for policy 0, policy_version 780202 (0.0008) [2023-12-26 05:49:11,607][123090] Updated weights for policy 1, policy_version 774792 (0.0008) [2023-12-26 05:49:11,673][123090] Updated weights for policy 1, policy_version 774802 (0.0008) [2023-12-26 05:49:11,745][123091] Updated weights for policy 0, policy_version 780212 (0.0006) [2023-12-26 05:49:11,747][123090] Updated weights for policy 1, policy_version 774812 (0.0010) [2023-12-26 05:49:11,811][123091] Updated weights for policy 0, policy_version 780222 (0.0010) [2023-12-26 05:49:11,861][123091] Updated weights for policy 0, policy_version 780232 (0.0010) [2023-12-26 05:49:12,623][123090] Updated weights for policy 1, policy_version 774822 (0.0009) [2023-12-26 05:49:12,688][123090] Updated weights for policy 1, policy_version 774832 (0.0011) [2023-12-26 05:49:12,727][123091] Updated weights for policy 0, policy_version 780242 (0.0007) [2023-12-26 05:49:12,758][123090] Updated weights for policy 1, policy_version 774842 (0.0011) [2023-12-26 05:49:12,791][123091] Updated weights for policy 0, policy_version 780252 (0.0009) [2023-12-26 05:49:12,854][123091] Updated weights for policy 0, policy_version 780262 (0.0009) [2023-12-26 05:49:12,907][123091] Updated weights for policy 0, policy_version 780272 (0.0009) [2023-12-26 05:49:13,569][123090] Updated weights for policy 1, policy_version 774852 (0.0010) [2023-12-26 05:49:13,628][123090] Updated weights for policy 1, policy_version 774862 (0.0009) [2023-12-26 05:49:13,690][123090] Updated weights for policy 1, policy_version 774872 (0.0008) [2023-12-26 05:49:13,729][123091] Updated weights for policy 0, policy_version 780282 (0.0011) [2023-12-26 05:49:13,783][123091] Updated weights for policy 0, policy_version 780292 (0.0007) [2023-12-26 05:49:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 398123008. Throughput: 0: 8913.4, 1: 8987.8. Samples: 398118036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:13,785][121949] Avg episode reward: [(0, '5989.104'), (1, '5579.258')] [2023-12-26 05:49:13,843][123091] Updated weights for policy 0, policy_version 780302 (0.0005) [2023-12-26 05:49:14,531][123090] Updated weights for policy 1, policy_version 774882 (0.0006) [2023-12-26 05:49:14,593][123090] Updated weights for policy 1, policy_version 774892 (0.0009) [2023-12-26 05:49:14,653][123091] Updated weights for policy 0, policy_version 780312 (0.0010) [2023-12-26 05:49:14,656][123090] Updated weights for policy 1, policy_version 774902 (0.0011) [2023-12-26 05:49:14,711][123091] Updated weights for policy 0, policy_version 780322 (0.0011) [2023-12-26 05:49:14,718][123090] Updated weights for policy 1, policy_version 774912 (0.0011) [2023-12-26 05:49:14,781][123091] Updated weights for policy 0, policy_version 780332 (0.0010) [2023-12-26 05:49:15,526][123091] Updated weights for policy 0, policy_version 780342 (0.0009) [2023-12-26 05:49:15,582][123091] Updated weights for policy 0, policy_version 780352 (0.0011) [2023-12-26 05:49:15,596][123090] Updated weights for policy 1, policy_version 774922 (0.0010) [2023-12-26 05:49:15,637][123091] Updated weights for policy 0, policy_version 780362 (0.0008) [2023-12-26 05:49:15,658][123090] Updated weights for policy 1, policy_version 774932 (0.0010) [2023-12-26 05:49:15,727][123090] Updated weights for policy 1, policy_version 774942 (0.0007) [2023-12-26 05:49:16,311][123090] Updated weights for policy 1, policy_version 774952 (0.0005) [2023-12-26 05:49:16,359][123091] Updated weights for policy 0, policy_version 780372 (0.0005) [2023-12-26 05:49:16,359][123090] Updated weights for policy 1, policy_version 774962 (0.0005) [2023-12-26 05:49:16,411][123090] Updated weights for policy 1, policy_version 774972 (0.0006) [2023-12-26 05:49:16,424][123091] Updated weights for policy 0, policy_version 780382 (0.0005) [2023-12-26 05:49:16,481][123091] Updated weights for policy 0, policy_version 780392 (0.0005) [2023-12-26 05:49:17,188][123090] Updated weights for policy 1, policy_version 774982 (0.0008) [2023-12-26 05:49:17,191][123091] Updated weights for policy 0, policy_version 780402 (0.0007) [2023-12-26 05:49:17,247][123090] Updated weights for policy 1, policy_version 774992 (0.0006) [2023-12-26 05:49:17,249][123091] Updated weights for policy 0, policy_version 780412 (0.0011) [2023-12-26 05:49:17,307][123090] Updated weights for policy 1, policy_version 775002 (0.0006) [2023-12-26 05:49:17,309][123091] Updated weights for policy 0, policy_version 780422 (0.0010) [2023-12-26 05:49:17,360][123091] Updated weights for policy 0, policy_version 780432 (0.0010) [2023-12-26 05:49:18,138][123090] Updated weights for policy 1, policy_version 775012 (0.0007) [2023-12-26 05:49:18,189][123091] Updated weights for policy 0, policy_version 780442 (0.0011) [2023-12-26 05:49:18,204][123090] Updated weights for policy 1, policy_version 775022 (0.0007) [2023-12-26 05:49:18,243][123091] Updated weights for policy 0, policy_version 780452 (0.0008) [2023-12-26 05:49:18,272][123090] Updated weights for policy 1, policy_version 775032 (0.0005) [2023-12-26 05:49:18,295][123091] Updated weights for policy 0, policy_version 780462 (0.0005) [2023-12-26 05:49:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 398213120. Throughput: 0: 8918.2, 1: 8983.7. Samples: 398226252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:18,784][121949] Avg episode reward: [(0, '5829.441'), (1, '5440.156')] [2023-12-26 05:49:19,047][123090] Updated weights for policy 1, policy_version 775042 (0.0010) [2023-12-26 05:49:19,097][123091] Updated weights for policy 0, policy_version 780472 (0.0008) [2023-12-26 05:49:19,111][123090] Updated weights for policy 1, policy_version 775052 (0.0008) [2023-12-26 05:49:19,155][123091] Updated weights for policy 0, policy_version 780482 (0.0008) [2023-12-26 05:49:19,163][123090] Updated weights for policy 1, policy_version 775062 (0.0008) [2023-12-26 05:49:19,215][123091] Updated weights for policy 0, policy_version 780492 (0.0007) [2023-12-26 05:49:19,224][123090] Updated weights for policy 1, policy_version 775072 (0.0009) [2023-12-26 05:49:20,099][123091] Updated weights for policy 0, policy_version 780502 (0.0009) [2023-12-26 05:49:20,113][123090] Updated weights for policy 1, policy_version 775082 (0.0008) [2023-12-26 05:49:20,166][123091] Updated weights for policy 0, policy_version 780512 (0.0009) [2023-12-26 05:49:20,175][123090] Updated weights for policy 1, policy_version 775092 (0.0006) [2023-12-26 05:49:20,222][123091] Updated weights for policy 0, policy_version 780522 (0.0010) [2023-12-26 05:49:20,234][123090] Updated weights for policy 1, policy_version 775102 (0.0010) [2023-12-26 05:49:21,065][123090] Updated weights for policy 1, policy_version 775112 (0.0009) [2023-12-26 05:49:21,099][123091] Updated weights for policy 0, policy_version 780532 (0.0008) [2023-12-26 05:49:21,135][123090] Updated weights for policy 1, policy_version 775122 (0.0007) [2023-12-26 05:49:21,161][123091] Updated weights for policy 0, policy_version 780542 (0.0009) [2023-12-26 05:49:21,195][123090] Updated weights for policy 1, policy_version 775132 (0.0010) [2023-12-26 05:49:21,229][123091] Updated weights for policy 0, policy_version 780552 (0.0009) [2023-12-26 05:49:21,957][123090] Updated weights for policy 1, policy_version 775142 (0.0009) [2023-12-26 05:49:22,006][123090] Updated weights for policy 1, policy_version 775152 (0.0010) [2023-12-26 05:49:22,056][123090] Updated weights for policy 1, policy_version 775162 (0.0010) [2023-12-26 05:49:22,118][123091] Updated weights for policy 0, policy_version 780562 (0.0009) [2023-12-26 05:49:22,167][123091] Updated weights for policy 0, policy_version 780572 (0.0009) [2023-12-26 05:49:22,230][123091] Updated weights for policy 0, policy_version 780582 (0.0009) [2023-12-26 05:49:22,290][123091] Updated weights for policy 0, policy_version 780592 (0.0010) [2023-12-26 05:49:22,841][123090] Updated weights for policy 1, policy_version 775172 (0.0011) [2023-12-26 05:49:22,897][123090] Updated weights for policy 1, policy_version 775182 (0.0011) [2023-12-26 05:49:22,949][123090] Updated weights for policy 1, policy_version 775192 (0.0010) [2023-12-26 05:49:23,230][123091] Updated weights for policy 0, policy_version 780602 (0.0006) [2023-12-26 05:49:23,303][123091] Updated weights for policy 0, policy_version 780612 (0.0005) [2023-12-26 05:49:23,366][123091] Updated weights for policy 0, policy_version 780622 (0.0005) [2023-12-26 05:49:23,738][123090] Updated weights for policy 1, policy_version 775202 (0.0011) [2023-12-26 05:49:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 398295040. Throughput: 0: 8799.5, 1: 9011.5. Samples: 398276072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:23,785][121949] Avg episode reward: [(0, '5617.374'), (1, '5263.238')] [2023-12-26 05:49:23,788][123090] Updated weights for policy 1, policy_version 775212 (0.0010) [2023-12-26 05:49:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000780624_199843840.pth... [2023-12-26 05:49:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000779600_199581696.pth [2023-12-26 05:49:23,852][123090] Updated weights for policy 1, policy_version 775222 (0.0010) [2023-12-26 05:49:23,902][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000775232_198459392.pth... [2023-12-26 05:49:23,904][123090] Updated weights for policy 1, policy_version 775232 (0.0010) [2023-12-26 05:49:23,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000774176_198189056.pth [2023-12-26 05:49:23,965][123091] Updated weights for policy 0, policy_version 780632 (0.0007) [2023-12-26 05:49:24,025][123091] Updated weights for policy 0, policy_version 780642 (0.0006) [2023-12-26 05:49:24,095][123091] Updated weights for policy 0, policy_version 780652 (0.0006) [2023-12-26 05:49:24,704][123090] Updated weights for policy 1, policy_version 775242 (0.0005) [2023-12-26 05:49:24,760][123090] Updated weights for policy 1, policy_version 775252 (0.0007) [2023-12-26 05:49:24,810][123090] Updated weights for policy 1, policy_version 775262 (0.0010) [2023-12-26 05:49:24,880][123091] Updated weights for policy 0, policy_version 780662 (0.0008) [2023-12-26 05:49:24,939][123091] Updated weights for policy 0, policy_version 780672 (0.0010) [2023-12-26 05:49:25,008][123091] Updated weights for policy 0, policy_version 780682 (0.0010) [2023-12-26 05:49:25,600][123090] Updated weights for policy 1, policy_version 775272 (0.0011) [2023-12-26 05:49:25,663][123090] Updated weights for policy 1, policy_version 775282 (0.0010) [2023-12-26 05:49:25,729][123090] Updated weights for policy 1, policy_version 775292 (0.0010) [2023-12-26 05:49:25,802][123091] Updated weights for policy 0, policy_version 780692 (0.0010) [2023-12-26 05:49:25,854][123091] Updated weights for policy 0, policy_version 780702 (0.0009) [2023-12-26 05:49:25,905][123091] Updated weights for policy 0, policy_version 780712 (0.0007) [2023-12-26 05:49:26,541][123090] Updated weights for policy 1, policy_version 775302 (0.0010) [2023-12-26 05:49:26,589][123090] Updated weights for policy 1, policy_version 775312 (0.0010) [2023-12-26 05:49:26,626][123091] Updated weights for policy 0, policy_version 780722 (0.0006) [2023-12-26 05:49:26,649][123090] Updated weights for policy 1, policy_version 775322 (0.0010) [2023-12-26 05:49:26,675][123091] Updated weights for policy 0, policy_version 780732 (0.0006) [2023-12-26 05:49:26,739][123091] Updated weights for policy 0, policy_version 780742 (0.0005) [2023-12-26 05:49:26,800][123091] Updated weights for policy 0, policy_version 780752 (0.0005) [2023-12-26 05:49:27,476][123090] Updated weights for policy 1, policy_version 775332 (0.0009) [2023-12-26 05:49:27,533][123091] Updated weights for policy 0, policy_version 780762 (0.0005) [2023-12-26 05:49:27,537][123090] Updated weights for policy 1, policy_version 775342 (0.0010) [2023-12-26 05:49:27,588][123090] Updated weights for policy 1, policy_version 775352 (0.0010) [2023-12-26 05:49:27,595][123091] Updated weights for policy 0, policy_version 780772 (0.0005) [2023-12-26 05:49:27,657][123091] Updated weights for policy 0, policy_version 780782 (0.0005) [2023-12-26 05:49:28,238][123091] Updated weights for policy 0, policy_version 780792 (0.0005) [2023-12-26 05:49:28,286][123091] Updated weights for policy 0, policy_version 780802 (0.0005) [2023-12-26 05:49:28,327][123090] Updated weights for policy 1, policy_version 775362 (0.0010) [2023-12-26 05:49:28,357][123091] Updated weights for policy 0, policy_version 780812 (0.0006) [2023-12-26 05:49:28,397][123090] Updated weights for policy 1, policy_version 775372 (0.0006) [2023-12-26 05:49:28,457][123090] Updated weights for policy 1, policy_version 775382 (0.0005) [2023-12-26 05:49:28,515][123090] Updated weights for policy 1, policy_version 775392 (0.0005) [2023-12-26 05:49:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 398393344. Throughput: 0: 8888.9, 1: 9018.9. Samples: 398383752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:28,785][121949] Avg episode reward: [(0, '5893.516'), (1, '4952.682')] [2023-12-26 05:49:29,183][123091] Updated weights for policy 0, policy_version 780822 (0.0005) [2023-12-26 05:49:29,226][123090] Updated weights for policy 1, policy_version 775402 (0.0006) [2023-12-26 05:49:29,260][123091] Updated weights for policy 0, policy_version 780832 (0.0006) [2023-12-26 05:49:29,289][123090] Updated weights for policy 1, policy_version 775412 (0.0009) [2023-12-26 05:49:29,323][123091] Updated weights for policy 0, policy_version 780842 (0.0007) [2023-12-26 05:49:29,354][123090] Updated weights for policy 1, policy_version 775422 (0.0008) [2023-12-26 05:49:30,100][123091] Updated weights for policy 0, policy_version 780852 (0.0007) [2023-12-26 05:49:30,116][123090] Updated weights for policy 1, policy_version 775432 (0.0008) [2023-12-26 05:49:30,160][123091] Updated weights for policy 0, policy_version 780862 (0.0009) [2023-12-26 05:49:30,169][123090] Updated weights for policy 1, policy_version 775442 (0.0010) [2023-12-26 05:49:30,227][123090] Updated weights for policy 1, policy_version 775452 (0.0009) [2023-12-26 05:49:30,229][123091] Updated weights for policy 0, policy_version 780872 (0.0006) [2023-12-26 05:49:30,918][123091] Updated weights for policy 0, policy_version 780882 (0.0005) [2023-12-26 05:49:30,970][123091] Updated weights for policy 0, policy_version 780892 (0.0005) [2023-12-26 05:49:31,020][123091] Updated weights for policy 0, policy_version 780902 (0.0005) [2023-12-26 05:49:31,082][123091] Updated weights for policy 0, policy_version 780912 (0.0006) [2023-12-26 05:49:31,104][123090] Updated weights for policy 1, policy_version 775462 (0.0008) [2023-12-26 05:49:31,169][123090] Updated weights for policy 1, policy_version 775472 (0.0010) [2023-12-26 05:49:31,216][123090] Updated weights for policy 1, policy_version 775482 (0.0008) [2023-12-26 05:49:31,871][123091] Updated weights for policy 0, policy_version 780922 (0.0008) [2023-12-26 05:49:31,924][123091] Updated weights for policy 0, policy_version 780932 (0.0008) [2023-12-26 05:49:31,987][123091] Updated weights for policy 0, policy_version 780942 (0.0006) [2023-12-26 05:49:32,096][123090] Updated weights for policy 1, policy_version 775492 (0.0009) [2023-12-26 05:49:32,147][123090] Updated weights for policy 1, policy_version 775502 (0.0009) [2023-12-26 05:49:32,200][123090] Updated weights for policy 1, policy_version 775512 (0.0009) [2023-12-26 05:49:32,679][123091] Updated weights for policy 0, policy_version 780952 (0.0005) [2023-12-26 05:49:32,729][123091] Updated weights for policy 0, policy_version 780962 (0.0005) [2023-12-26 05:49:32,794][123091] Updated weights for policy 0, policy_version 780972 (0.0007) [2023-12-26 05:49:33,110][123090] Updated weights for policy 1, policy_version 775522 (0.0010) [2023-12-26 05:49:33,162][123090] Updated weights for policy 1, policy_version 775532 (0.0008) [2023-12-26 05:49:33,221][123090] Updated weights for policy 1, policy_version 775542 (0.0009) [2023-12-26 05:49:33,276][123090] Updated weights for policy 1, policy_version 775552 (0.0009) [2023-12-26 05:49:33,593][123091] Updated weights for policy 0, policy_version 780982 (0.0010) [2023-12-26 05:49:33,651][123091] Updated weights for policy 0, policy_version 780992 (0.0009) [2023-12-26 05:49:33,708][123091] Updated weights for policy 0, policy_version 781002 (0.0009) [2023-12-26 05:49:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 398483456. Throughput: 0: 8891.6, 1: 8892.1. Samples: 398492428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:33,785][121949] Avg episode reward: [(0, '5989.199'), (1, '5125.776')] [2023-12-26 05:49:33,975][123090] Updated weights for policy 1, policy_version 775562 (0.0009) [2023-12-26 05:49:34,038][123090] Updated weights for policy 1, policy_version 775572 (0.0008) [2023-12-26 05:49:34,099][123090] Updated weights for policy 1, policy_version 775582 (0.0007) [2023-12-26 05:49:34,557][123091] Updated weights for policy 0, policy_version 781012 (0.0009) [2023-12-26 05:49:34,620][123091] Updated weights for policy 0, policy_version 781022 (0.0010) [2023-12-26 05:49:34,687][123091] Updated weights for policy 0, policy_version 781032 (0.0010) [2023-12-26 05:49:34,949][123090] Updated weights for policy 1, policy_version 775592 (0.0009) [2023-12-26 05:49:34,998][123090] Updated weights for policy 1, policy_version 775602 (0.0009) [2023-12-26 05:49:35,052][123090] Updated weights for policy 1, policy_version 775612 (0.0010) [2023-12-26 05:49:35,486][123091] Updated weights for policy 0, policy_version 781042 (0.0009) [2023-12-26 05:49:35,543][123091] Updated weights for policy 0, policy_version 781052 (0.0005) [2023-12-26 05:49:35,607][123091] Updated weights for policy 0, policy_version 781062 (0.0008) [2023-12-26 05:49:35,665][123091] Updated weights for policy 0, policy_version 781072 (0.0010) [2023-12-26 05:49:35,833][123090] Updated weights for policy 1, policy_version 775622 (0.0008) [2023-12-26 05:49:35,895][123090] Updated weights for policy 1, policy_version 775632 (0.0008) [2023-12-26 05:49:35,961][123090] Updated weights for policy 1, policy_version 775642 (0.0008) [2023-12-26 05:49:36,468][123091] Updated weights for policy 0, policy_version 781082 (0.0011) [2023-12-26 05:49:36,527][123091] Updated weights for policy 0, policy_version 781092 (0.0011) [2023-12-26 05:49:36,590][123091] Updated weights for policy 0, policy_version 781102 (0.0011) [2023-12-26 05:49:36,785][123090] Updated weights for policy 1, policy_version 775652 (0.0010) [2023-12-26 05:49:36,853][123090] Updated weights for policy 1, policy_version 775662 (0.0008) [2023-12-26 05:49:36,922][123090] Updated weights for policy 1, policy_version 775672 (0.0009) [2023-12-26 05:49:37,402][123091] Updated weights for policy 0, policy_version 781112 (0.0007) [2023-12-26 05:49:37,471][123091] Updated weights for policy 0, policy_version 781122 (0.0005) [2023-12-26 05:49:37,535][123091] Updated weights for policy 0, policy_version 781132 (0.0006) [2023-12-26 05:49:37,692][123090] Updated weights for policy 1, policy_version 775682 (0.0007) [2023-12-26 05:49:37,769][123090] Updated weights for policy 1, policy_version 775692 (0.0006) [2023-12-26 05:49:37,832][123090] Updated weights for policy 1, policy_version 775702 (0.0006) [2023-12-26 05:49:37,894][123090] Updated weights for policy 1, policy_version 775712 (0.0006) [2023-12-26 05:49:38,211][123091] Updated weights for policy 0, policy_version 781142 (0.0010) [2023-12-26 05:49:38,259][123091] Updated weights for policy 0, policy_version 781152 (0.0010) [2023-12-26 05:49:38,307][123091] Updated weights for policy 0, policy_version 781162 (0.0010) [2023-12-26 05:49:38,570][123090] Updated weights for policy 1, policy_version 775722 (0.0005) [2023-12-26 05:49:38,629][123090] Updated weights for policy 1, policy_version 775732 (0.0007) [2023-12-26 05:49:38,685][123090] Updated weights for policy 1, policy_version 775742 (0.0010) [2023-12-26 05:49:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 398573568. Throughput: 0: 8917.5, 1: 8920.5. Samples: 398545100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:38,785][121949] Avg episode reward: [(0, '5812.905'), (1, '5406.197')] [2023-12-26 05:49:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000781168_199983104.pth... [2023-12-26 05:49:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000775744_198590464.pth... [2023-12-26 05:49:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000774720_198328320.pth [2023-12-26 05:49:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000780112_199712768.pth [2023-12-26 05:49:39,173][123091] Updated weights for policy 0, policy_version 781172 (0.0009) [2023-12-26 05:49:39,241][123091] Updated weights for policy 0, policy_version 781182 (0.0009) [2023-12-26 05:49:39,307][123091] Updated weights for policy 0, policy_version 781192 (0.0009) [2023-12-26 05:49:39,546][123090] Updated weights for policy 1, policy_version 775752 (0.0010) [2023-12-26 05:49:39,608][123090] Updated weights for policy 1, policy_version 775762 (0.0010) [2023-12-26 05:49:39,679][123090] Updated weights for policy 1, policy_version 775772 (0.0010) [2023-12-26 05:49:40,113][123091] Updated weights for policy 0, policy_version 781202 (0.0009) [2023-12-26 05:49:40,180][123091] Updated weights for policy 0, policy_version 781212 (0.0009) [2023-12-26 05:49:40,240][123091] Updated weights for policy 0, policy_version 781222 (0.0009) [2023-12-26 05:49:40,307][123091] Updated weights for policy 0, policy_version 781232 (0.0009) [2023-12-26 05:49:40,483][123090] Updated weights for policy 1, policy_version 775782 (0.0009) [2023-12-26 05:49:40,544][123090] Updated weights for policy 1, policy_version 775792 (0.0007) [2023-12-26 05:49:40,614][123090] Updated weights for policy 1, policy_version 775802 (0.0007) [2023-12-26 05:49:41,178][123091] Updated weights for policy 0, policy_version 781242 (0.0008) [2023-12-26 05:49:41,241][123091] Updated weights for policy 0, policy_version 781252 (0.0008) [2023-12-26 05:49:41,319][123091] Updated weights for policy 0, policy_version 781262 (0.0007) [2023-12-26 05:49:41,485][123090] Updated weights for policy 1, policy_version 775812 (0.0008) [2023-12-26 05:49:41,550][123090] Updated weights for policy 1, policy_version 775822 (0.0010) [2023-12-26 05:49:41,621][123090] Updated weights for policy 1, policy_version 775832 (0.0007) [2023-12-26 05:49:42,106][123091] Updated weights for policy 0, policy_version 781272 (0.0009) [2023-12-26 05:49:42,168][123091] Updated weights for policy 0, policy_version 781282 (0.0009) [2023-12-26 05:49:42,234][123091] Updated weights for policy 0, policy_version 781292 (0.0008) [2023-12-26 05:49:42,444][123090] Updated weights for policy 1, policy_version 775842 (0.0009) [2023-12-26 05:49:42,512][123090] Updated weights for policy 1, policy_version 775852 (0.0010) [2023-12-26 05:49:42,580][123090] Updated weights for policy 1, policy_version 775862 (0.0010) [2023-12-26 05:49:42,650][123090] Updated weights for policy 1, policy_version 775872 (0.0010) [2023-12-26 05:49:43,020][123091] Updated weights for policy 0, policy_version 781302 (0.0007) [2023-12-26 05:49:43,085][123091] Updated weights for policy 0, policy_version 781312 (0.0008) [2023-12-26 05:49:43,147][123091] Updated weights for policy 0, policy_version 781322 (0.0010) [2023-12-26 05:49:43,432][123090] Updated weights for policy 1, policy_version 775882 (0.0005) [2023-12-26 05:49:43,493][123090] Updated weights for policy 1, policy_version 775892 (0.0009) [2023-12-26 05:49:43,553][123090] Updated weights for policy 1, policy_version 775902 (0.0007) [2023-12-26 05:49:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 398655488. Throughput: 0: 8894.7, 1: 8829.6. Samples: 398648780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:43,784][121949] Avg episode reward: [(0, '5952.066'), (1, '5527.726')] [2023-12-26 05:49:43,994][123091] Updated weights for policy 0, policy_version 781332 (0.0009) [2023-12-26 05:49:44,067][123091] Updated weights for policy 0, policy_version 781342 (0.0009) [2023-12-26 05:49:44,136][123091] Updated weights for policy 0, policy_version 781352 (0.0010) [2023-12-26 05:49:44,241][123090] Updated weights for policy 1, policy_version 775912 (0.0006) [2023-12-26 05:49:44,298][123090] Updated weights for policy 1, policy_version 775922 (0.0005) [2023-12-26 05:49:44,353][123090] Updated weights for policy 1, policy_version 775932 (0.0006) [2023-12-26 05:49:44,866][123091] Updated weights for policy 0, policy_version 781362 (0.0009) [2023-12-26 05:49:44,924][123091] Updated weights for policy 0, policy_version 781372 (0.0009) [2023-12-26 05:49:44,978][123091] Updated weights for policy 0, policy_version 781382 (0.0009) [2023-12-26 05:49:45,040][123091] Updated weights for policy 0, policy_version 781392 (0.0009) [2023-12-26 05:49:45,111][123090] Updated weights for policy 1, policy_version 775942 (0.0008) [2023-12-26 05:49:45,178][123090] Updated weights for policy 1, policy_version 775952 (0.0011) [2023-12-26 05:49:45,248][123090] Updated weights for policy 1, policy_version 775962 (0.0008) [2023-12-26 05:49:45,883][123090] Updated weights for policy 1, policy_version 775972 (0.0006) [2023-12-26 05:49:45,935][123090] Updated weights for policy 1, policy_version 775982 (0.0006) [2023-12-26 05:49:45,959][123091] Updated weights for policy 0, policy_version 781402 (0.0009) [2023-12-26 05:49:45,984][123090] Updated weights for policy 1, policy_version 775992 (0.0008) [2023-12-26 05:49:46,020][123091] Updated weights for policy 0, policy_version 781412 (0.0010) [2023-12-26 05:49:46,074][123091] Updated weights for policy 0, policy_version 781422 (0.0010) [2023-12-26 05:49:46,834][123090] Updated weights for policy 1, policy_version 776002 (0.0007) [2023-12-26 05:49:46,853][123091] Updated weights for policy 0, policy_version 781432 (0.0010) [2023-12-26 05:49:46,890][123090] Updated weights for policy 1, policy_version 776012 (0.0006) [2023-12-26 05:49:46,912][123091] Updated weights for policy 0, policy_version 781442 (0.0011) [2023-12-26 05:49:46,952][123090] Updated weights for policy 1, policy_version 776022 (0.0008) [2023-12-26 05:49:46,966][123091] Updated weights for policy 0, policy_version 781452 (0.0010) [2023-12-26 05:49:47,012][123090] Updated weights for policy 1, policy_version 776032 (0.0006) [2023-12-26 05:49:47,775][123091] Updated weights for policy 0, policy_version 781462 (0.0009) [2023-12-26 05:49:47,817][123090] Updated weights for policy 1, policy_version 776042 (0.0009) [2023-12-26 05:49:47,825][123091] Updated weights for policy 0, policy_version 781472 (0.0007) [2023-12-26 05:49:47,872][123091] Updated weights for policy 0, policy_version 781482 (0.0009) [2023-12-26 05:49:47,878][123090] Updated weights for policy 1, policy_version 776052 (0.0008) [2023-12-26 05:49:47,929][123090] Updated weights for policy 1, policy_version 776062 (0.0008) [2023-12-26 05:49:48,631][123091] Updated weights for policy 0, policy_version 781492 (0.0008) [2023-12-26 05:49:48,690][123090] Updated weights for policy 1, policy_version 776072 (0.0007) [2023-12-26 05:49:48,697][123091] Updated weights for policy 0, policy_version 781502 (0.0009) [2023-12-26 05:49:48,757][123090] Updated weights for policy 1, policy_version 776082 (0.0006) [2023-12-26 05:49:48,766][123091] Updated weights for policy 0, policy_version 781512 (0.0008) [2023-12-26 05:49:48,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 398737408. Throughput: 0: 8883.4, 1: 8844.6. Samples: 398757024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:48,785][121949] Avg episode reward: [(0, '6160.381'), (1, '5689.558')] [2023-12-26 05:49:48,823][123090] Updated weights for policy 1, policy_version 776092 (0.0006) [2023-12-26 05:49:49,516][123091] Updated weights for policy 0, policy_version 781522 (0.0008) [2023-12-26 05:49:49,527][123090] Updated weights for policy 1, policy_version 776102 (0.0008) [2023-12-26 05:49:49,578][123091] Updated weights for policy 0, policy_version 781532 (0.0008) [2023-12-26 05:49:49,593][123090] Updated weights for policy 1, policy_version 776112 (0.0009) [2023-12-26 05:49:49,633][123091] Updated weights for policy 0, policy_version 781542 (0.0008) [2023-12-26 05:49:49,653][123090] Updated weights for policy 1, policy_version 776122 (0.0007) [2023-12-26 05:49:49,680][123091] Updated weights for policy 0, policy_version 781552 (0.0008) [2023-12-26 05:49:50,458][123091] Updated weights for policy 0, policy_version 781562 (0.0005) [2023-12-26 05:49:50,515][123091] Updated weights for policy 0, policy_version 781572 (0.0007) [2023-12-26 05:49:50,555][123090] Updated weights for policy 1, policy_version 776132 (0.0006) [2023-12-26 05:49:50,579][123091] Updated weights for policy 0, policy_version 781582 (0.0010) [2023-12-26 05:49:50,623][123090] Updated weights for policy 1, policy_version 776142 (0.0007) [2023-12-26 05:49:50,691][123090] Updated weights for policy 1, policy_version 776152 (0.0009) [2023-12-26 05:49:51,328][123091] Updated weights for policy 0, policy_version 781592 (0.0009) [2023-12-26 05:49:51,399][123091] Updated weights for policy 0, policy_version 781602 (0.0008) [2023-12-26 05:49:51,460][123091] Updated weights for policy 0, policy_version 781612 (0.0008) [2023-12-26 05:49:51,484][123090] Updated weights for policy 1, policy_version 776162 (0.0009) [2023-12-26 05:49:51,535][123090] Updated weights for policy 1, policy_version 776172 (0.0008) [2023-12-26 05:49:51,592][123090] Updated weights for policy 1, policy_version 776182 (0.0008) [2023-12-26 05:49:51,653][123090] Updated weights for policy 1, policy_version 776192 (0.0008) [2023-12-26 05:49:52,343][123091] Updated weights for policy 0, policy_version 781622 (0.0009) [2023-12-26 05:49:52,407][123091] Updated weights for policy 0, policy_version 781632 (0.0008) [2023-12-26 05:49:52,445][123090] Updated weights for policy 1, policy_version 776202 (0.0010) [2023-12-26 05:49:52,465][123091] Updated weights for policy 0, policy_version 781642 (0.0008) [2023-12-26 05:49:52,506][123090] Updated weights for policy 1, policy_version 776212 (0.0005) [2023-12-26 05:49:52,566][123090] Updated weights for policy 1, policy_version 776222 (0.0010) [2023-12-26 05:49:53,214][123091] Updated weights for policy 0, policy_version 781652 (0.0008) [2023-12-26 05:49:53,280][123091] Updated weights for policy 0, policy_version 781662 (0.0005) [2023-12-26 05:49:53,283][123090] Updated weights for policy 1, policy_version 776232 (0.0006) [2023-12-26 05:49:53,333][123090] Updated weights for policy 1, policy_version 776242 (0.0005) [2023-12-26 05:49:53,346][123091] Updated weights for policy 0, policy_version 781672 (0.0011) [2023-12-26 05:49:53,390][123090] Updated weights for policy 1, policy_version 776252 (0.0005) [2023-12-26 05:49:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 398835712. Throughput: 0: 8889.1, 1: 8825.2. Samples: 398809748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:53,784][121949] Avg episode reward: [(0, '6092.978'), (1, '5721.055')] [2023-12-26 05:49:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000781680_200114176.pth... [2023-12-26 05:49:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000776256_198721536.pth... [2023-12-26 05:49:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000775232_198459392.pth [2023-12-26 05:49:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000780624_199843840.pth [2023-12-26 05:49:54,046][123090] Updated weights for policy 1, policy_version 776262 (0.0008) [2023-12-26 05:49:54,071][123091] Updated weights for policy 0, policy_version 781682 (0.0010) [2023-12-26 05:49:54,105][123090] Updated weights for policy 1, policy_version 776272 (0.0010) [2023-12-26 05:49:54,141][123091] Updated weights for policy 0, policy_version 781692 (0.0008) [2023-12-26 05:49:54,160][123090] Updated weights for policy 1, policy_version 776282 (0.0010) [2023-12-26 05:49:54,207][123091] Updated weights for policy 0, policy_version 781702 (0.0008) [2023-12-26 05:49:54,271][123091] Updated weights for policy 0, policy_version 781712 (0.0008) [2023-12-26 05:49:54,944][123091] Updated weights for policy 0, policy_version 781722 (0.0009) [2023-12-26 05:49:54,997][123091] Updated weights for policy 0, policy_version 781732 (0.0009) [2023-12-26 05:49:55,054][123091] Updated weights for policy 0, policy_version 781742 (0.0009) [2023-12-26 05:49:55,061][123090] Updated weights for policy 1, policy_version 776292 (0.0010) [2023-12-26 05:49:55,117][123090] Updated weights for policy 1, policy_version 776302 (0.0009) [2023-12-26 05:49:55,165][123090] Updated weights for policy 1, policy_version 776312 (0.0009) [2023-12-26 05:49:55,781][123091] Updated weights for policy 0, policy_version 781752 (0.0010) [2023-12-26 05:49:55,845][123091] Updated weights for policy 0, policy_version 781762 (0.0011) [2023-12-26 05:49:55,904][123091] Updated weights for policy 0, policy_version 781772 (0.0010) [2023-12-26 05:49:56,048][123090] Updated weights for policy 1, policy_version 776322 (0.0009) [2023-12-26 05:49:56,109][123090] Updated weights for policy 1, policy_version 776332 (0.0009) [2023-12-26 05:49:56,169][123090] Updated weights for policy 1, policy_version 776342 (0.0009) [2023-12-26 05:49:56,225][123090] Updated weights for policy 1, policy_version 776352 (0.0008) [2023-12-26 05:49:56,717][123091] Updated weights for policy 0, policy_version 781782 (0.0010) [2023-12-26 05:49:56,765][123091] Updated weights for policy 0, policy_version 781792 (0.0010) [2023-12-26 05:49:56,815][123091] Updated weights for policy 0, policy_version 781802 (0.0010) [2023-12-26 05:49:56,986][123090] Updated weights for policy 1, policy_version 776363 (0.0009) [2023-12-26 05:49:57,040][123090] Updated weights for policy 1, policy_version 776374 (0.0010) [2023-12-26 05:49:57,096][123090] Updated weights for policy 1, policy_version 776384 (0.0010) [2023-12-26 05:49:57,479][123091] Updated weights for policy 0, policy_version 781812 (0.0008) [2023-12-26 05:49:57,531][123091] Updated weights for policy 0, policy_version 781822 (0.0005) [2023-12-26 05:49:57,588][123091] Updated weights for policy 0, policy_version 781832 (0.0005) [2023-12-26 05:49:57,909][123090] Updated weights for policy 1, policy_version 776394 (0.0005) [2023-12-26 05:49:57,954][123090] Updated weights for policy 1, policy_version 776404 (0.0005) [2023-12-26 05:49:58,017][123090] Updated weights for policy 1, policy_version 776414 (0.0008) [2023-12-26 05:49:58,320][123091] Updated weights for policy 0, policy_version 781842 (0.0010) [2023-12-26 05:49:58,384][123091] Updated weights for policy 0, policy_version 781852 (0.0009) [2023-12-26 05:49:58,451][123091] Updated weights for policy 0, policy_version 781862 (0.0011) [2023-12-26 05:49:58,517][123091] Updated weights for policy 0, policy_version 781872 (0.0009) [2023-12-26 05:49:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 398925824. Throughput: 0: 8972.1, 1: 8846.3. Samples: 398919864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:49:58,785][121949] Avg episode reward: [(0, '5955.852'), (1, '5528.402')] [2023-12-26 05:49:58,903][123090] Updated weights for policy 1, policy_version 776424 (0.0008) [2023-12-26 05:49:58,959][123090] Updated weights for policy 1, policy_version 776434 (0.0008) [2023-12-26 05:49:59,014][123090] Updated weights for policy 1, policy_version 776444 (0.0007) [2023-12-26 05:49:59,324][123091] Updated weights for policy 0, policy_version 781882 (0.0008) [2023-12-26 05:49:59,390][123091] Updated weights for policy 0, policy_version 781892 (0.0008) [2023-12-26 05:49:59,452][123091] Updated weights for policy 0, policy_version 781902 (0.0010) [2023-12-26 05:49:59,807][123090] Updated weights for policy 1, policy_version 776454 (0.0009) [2023-12-26 05:49:59,876][123090] Updated weights for policy 1, policy_version 776464 (0.0009) [2023-12-26 05:49:59,933][123090] Updated weights for policy 1, policy_version 776474 (0.0009) [2023-12-26 05:50:00,283][123091] Updated weights for policy 0, policy_version 781912 (0.0006) [2023-12-26 05:50:00,331][123091] Updated weights for policy 0, policy_version 781922 (0.0005) [2023-12-26 05:50:00,384][123091] Updated weights for policy 0, policy_version 781932 (0.0006) [2023-12-26 05:50:00,822][123090] Updated weights for policy 1, policy_version 776484 (0.0009) [2023-12-26 05:50:00,870][123090] Updated weights for policy 1, policy_version 776494 (0.0009) [2023-12-26 05:50:00,925][123090] Updated weights for policy 1, policy_version 776504 (0.0008) [2023-12-26 05:50:01,137][123091] Updated weights for policy 0, policy_version 781942 (0.0009) [2023-12-26 05:50:01,193][123091] Updated weights for policy 0, policy_version 781952 (0.0007) [2023-12-26 05:50:01,253][123091] Updated weights for policy 0, policy_version 781962 (0.0006) [2023-12-26 05:50:01,819][123090] Updated weights for policy 1, policy_version 776514 (0.0009) [2023-12-26 05:50:01,875][123090] Updated weights for policy 1, policy_version 776524 (0.0009) [2023-12-26 05:50:01,936][123090] Updated weights for policy 1, policy_version 776534 (0.0009) [2023-12-26 05:50:01,993][123090] Updated weights for policy 1, policy_version 776544 (0.0009) [2023-12-26 05:50:02,013][123091] Updated weights for policy 0, policy_version 781972 (0.0008) [2023-12-26 05:50:02,081][123091] Updated weights for policy 0, policy_version 781982 (0.0008) [2023-12-26 05:50:02,176][123091] Updated weights for policy 0, policy_version 781992 (0.0009) [2023-12-26 05:50:02,780][123090] Updated weights for policy 1, policy_version 776554 (0.0010) [2023-12-26 05:50:02,834][123090] Updated weights for policy 1, policy_version 776564 (0.0009) [2023-12-26 05:50:02,886][123090] Updated weights for policy 1, policy_version 776574 (0.0009) [2023-12-26 05:50:02,916][123091] Updated weights for policy 0, policy_version 782002 (0.0007) [2023-12-26 05:50:02,979][123091] Updated weights for policy 0, policy_version 782012 (0.0007) [2023-12-26 05:50:03,033][123091] Updated weights for policy 0, policy_version 782022 (0.0009) [2023-12-26 05:50:03,086][123091] Updated weights for policy 0, policy_version 782032 (0.0008) [2023-12-26 05:50:03,624][123090] Updated weights for policy 1, policy_version 776584 (0.0005) [2023-12-26 05:50:03,677][123090] Updated weights for policy 1, policy_version 776594 (0.0005) [2023-12-26 05:50:03,723][123090] Updated weights for policy 1, policy_version 776604 (0.0005) [2023-12-26 05:50:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 399015936. Throughput: 0: 8945.2, 1: 8819.1. Samples: 399025648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:03,785][121949] Avg episode reward: [(0, '6050.596'), (1, '5474.162')] [2023-12-26 05:50:03,866][123091] Updated weights for policy 0, policy_version 782042 (0.0007) [2023-12-26 05:50:03,924][123091] Updated weights for policy 0, policy_version 782052 (0.0009) [2023-12-26 05:50:03,985][123091] Updated weights for policy 0, policy_version 782062 (0.0008) [2023-12-26 05:50:04,496][123090] Updated weights for policy 1, policy_version 776614 (0.0006) [2023-12-26 05:50:04,553][123090] Updated weights for policy 1, policy_version 776624 (0.0005) [2023-12-26 05:50:04,611][123090] Updated weights for policy 1, policy_version 776634 (0.0006) [2023-12-26 05:50:04,758][123091] Updated weights for policy 0, policy_version 782072 (0.0007) [2023-12-26 05:50:04,812][123091] Updated weights for policy 0, policy_version 782082 (0.0006) [2023-12-26 05:50:04,859][123091] Updated weights for policy 0, policy_version 782092 (0.0005) [2023-12-26 05:50:05,291][123090] Updated weights for policy 1, policy_version 776644 (0.0005) [2023-12-26 05:50:05,339][123090] Updated weights for policy 1, policy_version 776654 (0.0005) [2023-12-26 05:50:05,400][123090] Updated weights for policy 1, policy_version 776664 (0.0005) [2023-12-26 05:50:05,532][123091] Updated weights for policy 0, policy_version 782102 (0.0005) [2023-12-26 05:50:05,581][123091] Updated weights for policy 0, policy_version 782112 (0.0006) [2023-12-26 05:50:05,637][123091] Updated weights for policy 0, policy_version 782122 (0.0005) [2023-12-26 05:50:06,064][123090] Updated weights for policy 1, policy_version 776674 (0.0005) [2023-12-26 05:50:06,130][123090] Updated weights for policy 1, policy_version 776684 (0.0006) [2023-12-26 05:50:06,202][123090] Updated weights for policy 1, policy_version 776694 (0.0005) [2023-12-26 05:50:06,278][123090] Updated weights for policy 1, policy_version 776704 (0.0006) [2023-12-26 05:50:06,355][123091] Updated weights for policy 0, policy_version 782132 (0.0007) [2023-12-26 05:50:06,411][123091] Updated weights for policy 0, policy_version 782142 (0.0010) [2023-12-26 05:50:06,465][123091] Updated weights for policy 0, policy_version 782152 (0.0010) [2023-12-26 05:50:06,982][123090] Updated weights for policy 1, policy_version 776714 (0.0011) [2023-12-26 05:50:07,053][123090] Updated weights for policy 1, policy_version 776724 (0.0010) [2023-12-26 05:50:07,117][123090] Updated weights for policy 1, policy_version 776734 (0.0010) [2023-12-26 05:50:07,292][123091] Updated weights for policy 0, policy_version 782162 (0.0009) [2023-12-26 05:50:07,347][123091] Updated weights for policy 0, policy_version 782172 (0.0005) [2023-12-26 05:50:07,408][123091] Updated weights for policy 0, policy_version 782182 (0.0005) [2023-12-26 05:50:07,466][123091] Updated weights for policy 0, policy_version 782192 (0.0005) [2023-12-26 05:50:07,986][123090] Updated weights for policy 1, policy_version 776744 (0.0009) [2023-12-26 05:50:08,019][123091] Updated weights for policy 0, policy_version 782202 (0.0009) [2023-12-26 05:50:08,044][123090] Updated weights for policy 1, policy_version 776754 (0.0007) [2023-12-26 05:50:08,071][123091] Updated weights for policy 0, policy_version 782212 (0.0010) [2023-12-26 05:50:08,106][123090] Updated weights for policy 1, policy_version 776764 (0.0006) [2023-12-26 05:50:08,124][123091] Updated weights for policy 0, policy_version 782222 (0.0010) [2023-12-26 05:50:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 399106048. Throughput: 0: 9049.2, 1: 8913.6. Samples: 399084392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:08,785][121949] Avg episode reward: [(0, '6202.282'), (1, '5486.409')] [2023-12-26 05:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000776768_198852608.pth... [2023-12-26 05:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000775744_198590464.pth [2023-12-26 05:50:08,857][123091] Updated weights for policy 0, policy_version 782232 (0.0007) [2023-12-26 05:50:08,920][123091] Updated weights for policy 0, policy_version 782242 (0.0005) [2023-12-26 05:50:08,964][123090] Updated weights for policy 1, policy_version 776774 (0.0007) [2023-12-26 05:50:08,990][123091] Updated weights for policy 0, policy_version 782252 (0.0011) [2023-12-26 05:50:09,013][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000782256_200261632.pth... [2023-12-26 05:50:09,017][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000781168_199983104.pth [2023-12-26 05:50:09,020][123090] Updated weights for policy 1, policy_version 776784 (0.0008) [2023-12-26 05:50:09,082][123090] Updated weights for policy 1, policy_version 776794 (0.0009) [2023-12-26 05:50:09,791][123091] Updated weights for policy 0, policy_version 782262 (0.0010) [2023-12-26 05:50:09,862][123091] Updated weights for policy 0, policy_version 782272 (0.0009) [2023-12-26 05:50:09,931][123091] Updated weights for policy 0, policy_version 782282 (0.0009) [2023-12-26 05:50:09,947][123090] Updated weights for policy 1, policy_version 776804 (0.0008) [2023-12-26 05:50:10,023][123090] Updated weights for policy 1, policy_version 776814 (0.0009) [2023-12-26 05:50:10,094][123090] Updated weights for policy 1, policy_version 776824 (0.0008) [2023-12-26 05:50:10,806][123091] Updated weights for policy 0, policy_version 782292 (0.0009) [2023-12-26 05:50:10,872][123091] Updated weights for policy 0, policy_version 782302 (0.0009) [2023-12-26 05:50:10,878][123090] Updated weights for policy 1, policy_version 776834 (0.0007) [2023-12-26 05:50:10,943][123091] Updated weights for policy 0, policy_version 782312 (0.0009) [2023-12-26 05:50:10,946][123090] Updated weights for policy 1, policy_version 776844 (0.0008) [2023-12-26 05:50:11,000][123090] Updated weights for policy 1, policy_version 776854 (0.0007) [2023-12-26 05:50:11,068][123090] Updated weights for policy 1, policy_version 776864 (0.0010) [2023-12-26 05:50:11,768][123091] Updated weights for policy 0, policy_version 782322 (0.0009) [2023-12-26 05:50:11,839][123091] Updated weights for policy 0, policy_version 782332 (0.0009) [2023-12-26 05:50:11,903][123091] Updated weights for policy 0, policy_version 782342 (0.0009) [2023-12-26 05:50:11,962][123090] Updated weights for policy 1, policy_version 776874 (0.0008) [2023-12-26 05:50:11,967][123091] Updated weights for policy 0, policy_version 782352 (0.0007) [2023-12-26 05:50:12,017][123090] Updated weights for policy 1, policy_version 776884 (0.0010) [2023-12-26 05:50:12,072][123090] Updated weights for policy 1, policy_version 776894 (0.0010) [2023-12-26 05:50:12,770][123091] Updated weights for policy 0, policy_version 782362 (0.0010) [2023-12-26 05:50:12,845][123091] Updated weights for policy 0, policy_version 782372 (0.0006) [2023-12-26 05:50:12,911][123091] Updated weights for policy 0, policy_version 782382 (0.0011) [2023-12-26 05:50:12,990][123090] Updated weights for policy 1, policy_version 776904 (0.0010) [2023-12-26 05:50:13,052][123090] Updated weights for policy 1, policy_version 776914 (0.0009) [2023-12-26 05:50:13,111][123090] Updated weights for policy 1, policy_version 776924 (0.0006) [2023-12-26 05:50:13,669][123091] Updated weights for policy 0, policy_version 782392 (0.0006) [2023-12-26 05:50:13,726][123091] Updated weights for policy 0, policy_version 782402 (0.0006) [2023-12-26 05:50:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 399187968. Throughput: 0: 9039.6, 1: 8830.7. Samples: 399187920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:13,785][121949] Avg episode reward: [(0, '6174.888'), (1, '5586.788')] [2023-12-26 05:50:13,786][123091] Updated weights for policy 0, policy_version 782412 (0.0006) [2023-12-26 05:50:13,789][123090] Updated weights for policy 1, policy_version 776934 (0.0007) [2023-12-26 05:50:13,856][123090] Updated weights for policy 1, policy_version 776944 (0.0008) [2023-12-26 05:50:13,921][123090] Updated weights for policy 1, policy_version 776954 (0.0008) [2023-12-26 05:50:14,525][123091] Updated weights for policy 0, policy_version 782422 (0.0006) [2023-12-26 05:50:14,580][123091] Updated weights for policy 0, policy_version 782432 (0.0005) [2023-12-26 05:50:14,638][123091] Updated weights for policy 0, policy_version 782442 (0.0005) [2023-12-26 05:50:14,645][123090] Updated weights for policy 1, policy_version 776964 (0.0008) [2023-12-26 05:50:14,705][123090] Updated weights for policy 1, policy_version 776974 (0.0011) [2023-12-26 05:50:14,767][123090] Updated weights for policy 1, policy_version 776984 (0.0010) [2023-12-26 05:50:15,336][123091] Updated weights for policy 0, policy_version 782452 (0.0011) [2023-12-26 05:50:15,398][123091] Updated weights for policy 0, policy_version 782462 (0.0009) [2023-12-26 05:50:15,456][123091] Updated weights for policy 0, policy_version 782472 (0.0009) [2023-12-26 05:50:15,614][123090] Updated weights for policy 1, policy_version 776994 (0.0006) [2023-12-26 05:50:15,677][123090] Updated weights for policy 1, policy_version 777004 (0.0007) [2023-12-26 05:50:15,727][123090] Updated weights for policy 1, policy_version 777014 (0.0005) [2023-12-26 05:50:15,780][123090] Updated weights for policy 1, policy_version 777024 (0.0005) [2023-12-26 05:50:16,124][123091] Updated weights for policy 0, policy_version 782482 (0.0008) [2023-12-26 05:50:16,173][123091] Updated weights for policy 0, policy_version 782492 (0.0011) [2023-12-26 05:50:16,221][123091] Updated weights for policy 0, policy_version 782502 (0.0010) [2023-12-26 05:50:16,272][123091] Updated weights for policy 0, policy_version 782512 (0.0008) [2023-12-26 05:50:16,460][123090] Updated weights for policy 1, policy_version 777034 (0.0005) [2023-12-26 05:50:16,511][123090] Updated weights for policy 1, policy_version 777044 (0.0005) [2023-12-26 05:50:16,563][123090] Updated weights for policy 1, policy_version 777054 (0.0008) [2023-12-26 05:50:17,031][123091] Updated weights for policy 0, policy_version 782522 (0.0005) [2023-12-26 05:50:17,085][123091] Updated weights for policy 0, policy_version 782532 (0.0005) [2023-12-26 05:50:17,134][123091] Updated weights for policy 0, policy_version 782542 (0.0008) [2023-12-26 05:50:17,408][123090] Updated weights for policy 1, policy_version 777064 (0.0006) [2023-12-26 05:50:17,458][123090] Updated weights for policy 1, policy_version 777074 (0.0008) [2023-12-26 05:50:17,506][123090] Updated weights for policy 1, policy_version 777084 (0.0008) [2023-12-26 05:50:17,881][123091] Updated weights for policy 0, policy_version 782552 (0.0006) [2023-12-26 05:50:17,934][123091] Updated weights for policy 0, policy_version 782562 (0.0005) [2023-12-26 05:50:17,998][123091] Updated weights for policy 0, policy_version 782572 (0.0005) [2023-12-26 05:50:18,167][123090] Updated weights for policy 1, policy_version 777094 (0.0005) [2023-12-26 05:50:18,217][123090] Updated weights for policy 1, policy_version 777104 (0.0005) [2023-12-26 05:50:18,267][123090] Updated weights for policy 1, policy_version 777114 (0.0005) [2023-12-26 05:50:18,729][123091] Updated weights for policy 0, policy_version 782582 (0.0005) [2023-12-26 05:50:18,778][123091] Updated weights for policy 0, policy_version 782592 (0.0006) [2023-12-26 05:50:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 399286272. Throughput: 0: 9060.5, 1: 8922.8. Samples: 399301676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:18,785][121949] Avg episode reward: [(0, '5952.663'), (1, '5649.478')] [2023-12-26 05:50:18,844][123091] Updated weights for policy 0, policy_version 782602 (0.0005) [2023-12-26 05:50:19,026][123090] Updated weights for policy 1, policy_version 777124 (0.0007) [2023-12-26 05:50:19,078][123090] Updated weights for policy 1, policy_version 777134 (0.0009) [2023-12-26 05:50:19,130][123090] Updated weights for policy 1, policy_version 777144 (0.0010) [2023-12-26 05:50:19,568][123091] Updated weights for policy 0, policy_version 782612 (0.0007) [2023-12-26 05:50:19,628][123091] Updated weights for policy 0, policy_version 782622 (0.0011) [2023-12-26 05:50:19,679][123091] Updated weights for policy 0, policy_version 782632 (0.0008) [2023-12-26 05:50:20,045][123090] Updated weights for policy 1, policy_version 777155 (0.0008) [2023-12-26 05:50:20,096][123090] Updated weights for policy 1, policy_version 777165 (0.0005) [2023-12-26 05:50:20,153][123090] Updated weights for policy 1, policy_version 777175 (0.0006) [2023-12-26 05:50:20,447][123091] Updated weights for policy 0, policy_version 782642 (0.0007) [2023-12-26 05:50:20,511][123091] Updated weights for policy 0, policy_version 782652 (0.0011) [2023-12-26 05:50:20,576][123091] Updated weights for policy 0, policy_version 782662 (0.0010) [2023-12-26 05:50:20,646][123091] Updated weights for policy 0, policy_version 782672 (0.0007) [2023-12-26 05:50:20,947][123090] Updated weights for policy 1, policy_version 777185 (0.0007) [2023-12-26 05:50:21,016][123090] Updated weights for policy 1, policy_version 777195 (0.0011) [2023-12-26 05:50:21,085][123090] Updated weights for policy 1, policy_version 777205 (0.0009) [2023-12-26 05:50:21,152][123090] Updated weights for policy 1, policy_version 777215 (0.0008) [2023-12-26 05:50:21,403][123091] Updated weights for policy 0, policy_version 782682 (0.0008) [2023-12-26 05:50:21,453][123091] Updated weights for policy 0, policy_version 782692 (0.0006) [2023-12-26 05:50:21,524][123091] Updated weights for policy 0, policy_version 782702 (0.0010) [2023-12-26 05:50:21,988][123090] Updated weights for policy 1, policy_version 777225 (0.0009) [2023-12-26 05:50:22,042][123090] Updated weights for policy 1, policy_version 777235 (0.0009) [2023-12-26 05:50:22,096][123090] Updated weights for policy 1, policy_version 777245 (0.0009) [2023-12-26 05:50:22,306][123091] Updated weights for policy 0, policy_version 782712 (0.0009) [2023-12-26 05:50:22,374][123091] Updated weights for policy 0, policy_version 782722 (0.0009) [2023-12-26 05:50:22,440][123091] Updated weights for policy 0, policy_version 782732 (0.0010) [2023-12-26 05:50:22,969][123090] Updated weights for policy 1, policy_version 777255 (0.0009) [2023-12-26 05:50:23,028][123090] Updated weights for policy 1, policy_version 777265 (0.0010) [2023-12-26 05:50:23,094][123090] Updated weights for policy 1, policy_version 777275 (0.0009) [2023-12-26 05:50:23,267][123091] Updated weights for policy 0, policy_version 782742 (0.0009) [2023-12-26 05:50:23,335][123091] Updated weights for policy 0, policy_version 782752 (0.0010) [2023-12-26 05:50:23,400][123091] Updated weights for policy 0, policy_version 782762 (0.0009) [2023-12-26 05:50:23,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 399376384. Throughput: 0: 9115.9, 1: 8902.3. Samples: 399355920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:23,785][121949] Avg episode reward: [(0, '5956.021'), (1, '5771.062')] [2023-12-26 05:50:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000782768_200392704.pth... [2023-12-26 05:50:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000777280_198983680.pth... [2023-12-26 05:50:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000781680_200114176.pth [2023-12-26 05:50:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000776256_198721536.pth [2023-12-26 05:50:23,937][123090] Updated weights for policy 1, policy_version 777285 (0.0009) [2023-12-26 05:50:23,999][123090] Updated weights for policy 1, policy_version 777296 (0.0009) [2023-12-26 05:50:24,071][123090] Updated weights for policy 1, policy_version 777306 (0.0009) [2023-12-26 05:50:24,195][123091] Updated weights for policy 0, policy_version 782772 (0.0010) [2023-12-26 05:50:24,261][123091] Updated weights for policy 0, policy_version 782782 (0.0009) [2023-12-26 05:50:24,324][123091] Updated weights for policy 0, policy_version 782792 (0.0010) [2023-12-26 05:50:24,917][123090] Updated weights for policy 1, policy_version 777316 (0.0007) [2023-12-26 05:50:24,975][123090] Updated weights for policy 1, policy_version 777326 (0.0006) [2023-12-26 05:50:25,028][123090] Updated weights for policy 1, policy_version 777336 (0.0005) [2023-12-26 05:50:25,062][123091] Updated weights for policy 0, policy_version 782802 (0.0007) [2023-12-26 05:50:25,131][123091] Updated weights for policy 0, policy_version 782812 (0.0006) [2023-12-26 05:50:25,202][123091] Updated weights for policy 0, policy_version 782822 (0.0005) [2023-12-26 05:50:25,273][123091] Updated weights for policy 0, policy_version 782832 (0.0005) [2023-12-26 05:50:25,790][123090] Updated weights for policy 1, policy_version 777346 (0.0005) [2023-12-26 05:50:25,841][123090] Updated weights for policy 1, policy_version 777356 (0.0008) [2023-12-26 05:50:25,896][123090] Updated weights for policy 1, policy_version 777366 (0.0008) [2023-12-26 05:50:25,951][123090] Updated weights for policy 1, policy_version 777376 (0.0008) [2023-12-26 05:50:25,966][123091] Updated weights for policy 0, policy_version 782842 (0.0008) [2023-12-26 05:50:26,018][123091] Updated weights for policy 0, policy_version 782852 (0.0007) [2023-12-26 05:50:26,084][123091] Updated weights for policy 0, policy_version 782862 (0.0010) [2023-12-26 05:50:26,767][123090] Updated weights for policy 1, policy_version 777386 (0.0009) [2023-12-26 05:50:26,828][123090] Updated weights for policy 1, policy_version 777396 (0.0009) [2023-12-26 05:50:26,879][123090] Updated weights for policy 1, policy_version 777406 (0.0009) [2023-12-26 05:50:26,956][123091] Updated weights for policy 0, policy_version 782872 (0.0010) [2023-12-26 05:50:27,017][123091] Updated weights for policy 0, policy_version 782882 (0.0010) [2023-12-26 05:50:27,083][123091] Updated weights for policy 0, policy_version 782892 (0.0010) [2023-12-26 05:50:27,708][123090] Updated weights for policy 1, policy_version 777416 (0.0009) [2023-12-26 05:50:27,780][123090] Updated weights for policy 1, policy_version 777426 (0.0009) [2023-12-26 05:50:27,848][123091] Updated weights for policy 0, policy_version 782902 (0.0007) [2023-12-26 05:50:27,850][123090] Updated weights for policy 1, policy_version 777436 (0.0010) [2023-12-26 05:50:27,906][123091] Updated weights for policy 0, policy_version 782912 (0.0005) [2023-12-26 05:50:27,954][123091] Updated weights for policy 0, policy_version 782922 (0.0005) [2023-12-26 05:50:28,687][123090] Updated weights for policy 1, policy_version 777446 (0.0010) [2023-12-26 05:50:28,695][123091] Updated weights for policy 0, policy_version 782932 (0.0006) [2023-12-26 05:50:28,746][123090] Updated weights for policy 1, policy_version 777456 (0.0008) [2023-12-26 05:50:28,751][123091] Updated weights for policy 0, policy_version 782942 (0.0010) [2023-12-26 05:50:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 399458304. Throughput: 0: 9131.6, 1: 8897.2. Samples: 399460076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:28,785][121949] Avg episode reward: [(0, '5953.186'), (1, '5848.748')] [2023-12-26 05:50:28,815][123090] Updated weights for policy 1, policy_version 777466 (0.0006) [2023-12-26 05:50:28,818][123091] Updated weights for policy 0, policy_version 782952 (0.0010) [2023-12-26 05:50:29,535][123090] Updated weights for policy 1, policy_version 777476 (0.0007) [2023-12-26 05:50:29,600][123090] Updated weights for policy 1, policy_version 777486 (0.0008) [2023-12-26 05:50:29,650][123091] Updated weights for policy 0, policy_version 782962 (0.0010) [2023-12-26 05:50:29,659][123090] Updated weights for policy 1, policy_version 777496 (0.0009) [2023-12-26 05:50:29,709][123091] Updated weights for policy 0, policy_version 782972 (0.0010) [2023-12-26 05:50:29,775][123091] Updated weights for policy 0, policy_version 782982 (0.0011) [2023-12-26 05:50:29,843][123091] Updated weights for policy 0, policy_version 782992 (0.0011) [2023-12-26 05:50:30,453][123090] Updated weights for policy 1, policy_version 777506 (0.0007) [2023-12-26 05:50:30,511][123090] Updated weights for policy 1, policy_version 777516 (0.0009) [2023-12-26 05:50:30,574][123090] Updated weights for policy 1, policy_version 777526 (0.0008) [2023-12-26 05:50:30,642][123090] Updated weights for policy 1, policy_version 777536 (0.0008) [2023-12-26 05:50:30,656][123091] Updated weights for policy 0, policy_version 783002 (0.0010) [2023-12-26 05:50:30,700][123091] Updated weights for policy 0, policy_version 783012 (0.0010) [2023-12-26 05:50:30,750][123091] Updated weights for policy 0, policy_version 783022 (0.0010) [2023-12-26 05:50:31,486][123090] Updated weights for policy 1, policy_version 777546 (0.0005) [2023-12-26 05:50:31,501][123091] Updated weights for policy 0, policy_version 783032 (0.0006) [2023-12-26 05:50:31,552][123090] Updated weights for policy 1, policy_version 777556 (0.0007) [2023-12-26 05:50:31,567][123091] Updated weights for policy 0, policy_version 783042 (0.0007) [2023-12-26 05:50:31,620][123090] Updated weights for policy 1, policy_version 777566 (0.0008) [2023-12-26 05:50:31,634][123091] Updated weights for policy 0, policy_version 783052 (0.0010) [2023-12-26 05:50:32,336][123090] Updated weights for policy 1, policy_version 777576 (0.0007) [2023-12-26 05:50:32,397][123090] Updated weights for policy 1, policy_version 777586 (0.0010) [2023-12-26 05:50:32,437][123091] Updated weights for policy 0, policy_version 783062 (0.0008) [2023-12-26 05:50:32,456][123090] Updated weights for policy 1, policy_version 777596 (0.0008) [2023-12-26 05:50:32,504][123091] Updated weights for policy 0, policy_version 783072 (0.0006) [2023-12-26 05:50:32,557][123091] Updated weights for policy 0, policy_version 783082 (0.0009) [2023-12-26 05:50:33,178][123090] Updated weights for policy 1, policy_version 777606 (0.0007) [2023-12-26 05:50:33,231][123090] Updated weights for policy 1, policy_version 777616 (0.0009) [2023-12-26 05:50:33,292][123090] Updated weights for policy 1, policy_version 777626 (0.0009) [2023-12-26 05:50:33,405][123091] Updated weights for policy 0, policy_version 783092 (0.0009) [2023-12-26 05:50:33,456][123091] Updated weights for policy 0, policy_version 783102 (0.0006) [2023-12-26 05:50:33,511][123091] Updated weights for policy 0, policy_version 783112 (0.0005) [2023-12-26 05:50:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 399556608. Throughput: 0: 9143.6, 1: 8847.8. Samples: 399566640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:33,785][121949] Avg episode reward: [(0, '5944.254'), (1, '5884.880')] [2023-12-26 05:50:34,032][123090] Updated weights for policy 1, policy_version 777636 (0.0009) [2023-12-26 05:50:34,105][123090] Updated weights for policy 1, policy_version 777646 (0.0006) [2023-12-26 05:50:34,172][123090] Updated weights for policy 1, policy_version 777656 (0.0007) [2023-12-26 05:50:34,214][123091] Updated weights for policy 0, policy_version 783122 (0.0007) [2023-12-26 05:50:34,275][123091] Updated weights for policy 0, policy_version 783132 (0.0010) [2023-12-26 05:50:34,330][123091] Updated weights for policy 0, policy_version 783142 (0.0010) [2023-12-26 05:50:34,391][123091] Updated weights for policy 0, policy_version 783152 (0.0009) [2023-12-26 05:50:34,988][123090] Updated weights for policy 1, policy_version 777666 (0.0009) [2023-12-26 05:50:35,047][123090] Updated weights for policy 1, policy_version 777676 (0.0010) [2023-12-26 05:50:35,109][123090] Updated weights for policy 1, policy_version 777686 (0.0010) [2023-12-26 05:50:35,175][123090] Updated weights for policy 1, policy_version 777696 (0.0010) [2023-12-26 05:50:35,226][123091] Updated weights for policy 0, policy_version 783162 (0.0008) [2023-12-26 05:50:35,294][123091] Updated weights for policy 0, policy_version 783172 (0.0008) [2023-12-26 05:50:35,360][123091] Updated weights for policy 0, policy_version 783182 (0.0010) [2023-12-26 05:50:35,874][123090] Updated weights for policy 1, policy_version 777706 (0.0005) [2023-12-26 05:50:35,930][123090] Updated weights for policy 1, policy_version 777716 (0.0005) [2023-12-26 05:50:35,985][123090] Updated weights for policy 1, policy_version 777726 (0.0005) [2023-12-26 05:50:36,273][123091] Updated weights for policy 0, policy_version 783192 (0.0009) [2023-12-26 05:50:36,342][123091] Updated weights for policy 0, policy_version 783202 (0.0009) [2023-12-26 05:50:36,405][123091] Updated weights for policy 0, policy_version 783212 (0.0009) [2023-12-26 05:50:36,760][123090] Updated weights for policy 1, policy_version 777736 (0.0009) [2023-12-26 05:50:36,827][123090] Updated weights for policy 1, policy_version 777746 (0.0010) [2023-12-26 05:50:36,893][123090] Updated weights for policy 1, policy_version 777756 (0.0008) [2023-12-26 05:50:37,227][123091] Updated weights for policy 0, policy_version 783222 (0.0009) [2023-12-26 05:50:37,285][123091] Updated weights for policy 0, policy_version 783232 (0.0009) [2023-12-26 05:50:37,339][123091] Updated weights for policy 0, policy_version 783242 (0.0009) [2023-12-26 05:50:37,678][123090] Updated weights for policy 1, policy_version 777766 (0.0006) [2023-12-26 05:50:37,729][123090] Updated weights for policy 1, policy_version 777776 (0.0005) [2023-12-26 05:50:37,775][123090] Updated weights for policy 1, policy_version 777786 (0.0006) [2023-12-26 05:50:38,224][123091] Updated weights for policy 0, policy_version 783252 (0.0010) [2023-12-26 05:50:38,281][123091] Updated weights for policy 0, policy_version 783262 (0.0009) [2023-12-26 05:50:38,350][123091] Updated weights for policy 0, policy_version 783272 (0.0010) [2023-12-26 05:50:38,536][123090] Updated weights for policy 1, policy_version 777796 (0.0007) [2023-12-26 05:50:38,603][123090] Updated weights for policy 1, policy_version 777806 (0.0009) [2023-12-26 05:50:38,670][123090] Updated weights for policy 1, policy_version 777816 (0.0009) [2023-12-26 05:50:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 399646720. Throughput: 0: 9117.9, 1: 8882.6. Samples: 399619776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:50:38,785][121949] Avg episode reward: [(0, '6063.868'), (1, '5812.706')] [2023-12-26 05:50:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000777824_199122944.pth... [2023-12-26 05:50:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000783280_200523776.pth... [2023-12-26 05:50:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000776768_198852608.pth [2023-12-26 05:50:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000782256_200261632.pth [2023-12-26 05:50:39,138][123091] Updated weights for policy 0, policy_version 783282 (0.0008) [2023-12-26 05:50:39,187][123091] Updated weights for policy 0, policy_version 783292 (0.0009) [2023-12-26 05:50:39,248][123091] Updated weights for policy 0, policy_version 783302 (0.0008) [2023-12-26 05:50:39,322][123091] Updated weights for policy 0, policy_version 783312 (0.0008) [2023-12-26 05:50:39,440][123090] Updated weights for policy 1, policy_version 777826 (0.0007) [2023-12-26 05:50:39,502][123090] Updated weights for policy 1, policy_version 777836 (0.0006) [2023-12-26 05:50:39,573][123090] Updated weights for policy 1, policy_version 777846 (0.0008) [2023-12-26 05:50:39,624][123090] Updated weights for policy 1, policy_version 777856 (0.0008) [2023-12-26 05:50:40,155][123091] Updated weights for policy 0, policy_version 783322 (0.0011) [2023-12-26 05:50:40,223][123091] Updated weights for policy 0, policy_version 783332 (0.0011) [2023-12-26 05:50:40,279][123091] Updated weights for policy 0, policy_version 783342 (0.0011) [2023-12-26 05:50:40,502][123090] Updated weights for policy 1, policy_version 777866 (0.0009) [2023-12-26 05:50:40,557][123090] Updated weights for policy 1, policy_version 777876 (0.0010) [2023-12-26 05:50:40,620][123090] Updated weights for policy 1, policy_version 777886 (0.0010) [2023-12-26 05:50:41,101][123091] Updated weights for policy 0, policy_version 783352 (0.0009) [2023-12-26 05:50:41,166][123091] Updated weights for policy 0, policy_version 783362 (0.0011) [2023-12-26 05:50:41,234][123091] Updated weights for policy 0, policy_version 783372 (0.0011) [2023-12-26 05:50:41,549][123090] Updated weights for policy 1, policy_version 777896 (0.0010) [2023-12-26 05:50:41,613][123090] Updated weights for policy 1, policy_version 777906 (0.0009) [2023-12-26 05:50:41,675][123090] Updated weights for policy 1, policy_version 777916 (0.0009) [2023-12-26 05:50:42,039][123091] Updated weights for policy 0, policy_version 783382 (0.0008) [2023-12-26 05:50:42,105][123091] Updated weights for policy 0, policy_version 783392 (0.0006) [2023-12-26 05:50:42,162][123091] Updated weights for policy 0, policy_version 783402 (0.0009) [2023-12-26 05:50:42,514][123090] Updated weights for policy 1, policy_version 777926 (0.0010) [2023-12-26 05:50:42,574][123090] Updated weights for policy 1, policy_version 777936 (0.0010) [2023-12-26 05:50:42,636][123090] Updated weights for policy 1, policy_version 777946 (0.0011) [2023-12-26 05:50:42,978][123091] Updated weights for policy 0, policy_version 783412 (0.0010) [2023-12-26 05:50:43,037][123091] Updated weights for policy 0, policy_version 783422 (0.0009) [2023-12-26 05:50:43,096][123091] Updated weights for policy 0, policy_version 783432 (0.0008) [2023-12-26 05:50:43,431][123090] Updated weights for policy 1, policy_version 777956 (0.0011) [2023-12-26 05:50:43,497][123090] Updated weights for policy 1, policy_version 777966 (0.0010) [2023-12-26 05:50:43,556][123090] Updated weights for policy 1, policy_version 777976 (0.0010) [2023-12-26 05:50:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 399728640. Throughput: 0: 9006.6, 1: 8825.2. Samples: 399722292. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:50:43,785][121949] Avg episode reward: [(0, '5930.547'), (1, '5786.810')] [2023-12-26 05:50:43,792][123091] Updated weights for policy 0, policy_version 783442 (0.0006) [2023-12-26 05:50:43,845][123091] Updated weights for policy 0, policy_version 783452 (0.0005) [2023-12-26 05:50:43,902][123091] Updated weights for policy 0, policy_version 783462 (0.0005) [2023-12-26 05:50:43,962][123091] Updated weights for policy 0, policy_version 783472 (0.0005) [2023-12-26 05:50:44,259][123090] Updated weights for policy 1, policy_version 777986 (0.0009) [2023-12-26 05:50:44,326][123090] Updated weights for policy 1, policy_version 777996 (0.0005) [2023-12-26 05:50:44,388][123090] Updated weights for policy 1, policy_version 778006 (0.0006) [2023-12-26 05:50:44,448][123090] Updated weights for policy 1, policy_version 778016 (0.0009) [2023-12-26 05:50:44,773][123091] Updated weights for policy 0, policy_version 783482 (0.0010) [2023-12-26 05:50:44,843][123091] Updated weights for policy 0, policy_version 783492 (0.0008) [2023-12-26 05:50:44,917][123091] Updated weights for policy 0, policy_version 783502 (0.0009) [2023-12-26 05:50:45,209][123090] Updated weights for policy 1, policy_version 778026 (0.0010) [2023-12-26 05:50:45,281][123090] Updated weights for policy 1, policy_version 778036 (0.0011) [2023-12-26 05:50:45,345][123090] Updated weights for policy 1, policy_version 778046 (0.0010) [2023-12-26 05:50:45,725][123091] Updated weights for policy 0, policy_version 783512 (0.0011) [2023-12-26 05:50:45,796][123091] Updated weights for policy 0, policy_version 783522 (0.0011) [2023-12-26 05:50:45,864][123091] Updated weights for policy 0, policy_version 783532 (0.0011) [2023-12-26 05:50:46,063][123090] Updated weights for policy 1, policy_version 778056 (0.0006) [2023-12-26 05:50:46,137][123090] Updated weights for policy 1, policy_version 778066 (0.0006) [2023-12-26 05:50:46,209][123090] Updated weights for policy 1, policy_version 778076 (0.0005) [2023-12-26 05:50:46,617][123091] Updated weights for policy 0, policy_version 783542 (0.0011) [2023-12-26 05:50:46,668][123091] Updated weights for policy 0, policy_version 783552 (0.0010) [2023-12-26 05:50:46,718][123091] Updated weights for policy 0, policy_version 783562 (0.0010) [2023-12-26 05:50:46,864][123090] Updated weights for policy 1, policy_version 778086 (0.0005) [2023-12-26 05:50:46,912][123090] Updated weights for policy 1, policy_version 778096 (0.0008) [2023-12-26 05:50:46,977][123090] Updated weights for policy 1, policy_version 778106 (0.0010) [2023-12-26 05:50:47,555][123091] Updated weights for policy 0, policy_version 783572 (0.0010) [2023-12-26 05:50:47,611][123091] Updated weights for policy 0, policy_version 783582 (0.0011) [2023-12-26 05:50:47,678][123091] Updated weights for policy 0, policy_version 783592 (0.0011) [2023-12-26 05:50:47,685][123090] Updated weights for policy 1, policy_version 778116 (0.0008) [2023-12-26 05:50:47,740][123090] Updated weights for policy 1, policy_version 778126 (0.0007) [2023-12-26 05:50:47,803][123090] Updated weights for policy 1, policy_version 778136 (0.0010) [2023-12-26 05:50:48,388][123091] Updated weights for policy 0, policy_version 783602 (0.0010) [2023-12-26 05:50:48,455][123091] Updated weights for policy 0, policy_version 783612 (0.0008) [2023-12-26 05:50:48,525][123091] Updated weights for policy 0, policy_version 783622 (0.0007) [2023-12-26 05:50:48,586][123091] Updated weights for policy 0, policy_version 783632 (0.0009) [2023-12-26 05:50:48,595][123090] Updated weights for policy 1, policy_version 778146 (0.0011) [2023-12-26 05:50:48,657][123090] Updated weights for policy 1, policy_version 778156 (0.0010) [2023-12-26 05:50:48,713][123090] Updated weights for policy 1, policy_version 778166 (0.0010) [2023-12-26 05:50:48,779][123090] Updated weights for policy 1, policy_version 778176 (0.0010) [2023-12-26 05:50:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 399826944. Throughput: 0: 9009.4, 1: 8916.9. Samples: 399832332. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:50:48,785][121949] Avg episode reward: [(0, '5653.431'), (1, '5611.514')] [2023-12-26 05:50:49,323][123091] Updated weights for policy 0, policy_version 783642 (0.0011) [2023-12-26 05:50:49,388][123091] Updated weights for policy 0, policy_version 783652 (0.0013) [2023-12-26 05:50:49,450][123091] Updated weights for policy 0, policy_version 783662 (0.0007) [2023-12-26 05:50:49,546][123090] Updated weights for policy 1, policy_version 778186 (0.0011) [2023-12-26 05:50:49,602][123090] Updated weights for policy 1, policy_version 778196 (0.0010) [2023-12-26 05:50:49,665][123090] Updated weights for policy 1, policy_version 778206 (0.0010) [2023-12-26 05:50:50,274][123091] Updated weights for policy 0, policy_version 783672 (0.0006) [2023-12-26 05:50:50,327][123091] Updated weights for policy 0, policy_version 783682 (0.0006) [2023-12-26 05:50:50,383][123091] Updated weights for policy 0, policy_version 783692 (0.0009) [2023-12-26 05:50:50,444][123090] Updated weights for policy 1, policy_version 778216 (0.0010) [2023-12-26 05:50:50,492][123090] Updated weights for policy 1, policy_version 778226 (0.0010) [2023-12-26 05:50:50,552][123090] Updated weights for policy 1, policy_version 778236 (0.0010) [2023-12-26 05:50:51,187][123091] Updated weights for policy 0, policy_version 783702 (0.0007) [2023-12-26 05:50:51,258][123091] Updated weights for policy 0, policy_version 783712 (0.0006) [2023-12-26 05:50:51,326][123091] Updated weights for policy 0, policy_version 783722 (0.0007) [2023-12-26 05:50:51,407][123090] Updated weights for policy 1, policy_version 778246 (0.0010) [2023-12-26 05:50:51,475][123090] Updated weights for policy 1, policy_version 778256 (0.0009) [2023-12-26 05:50:51,546][123090] Updated weights for policy 1, policy_version 778266 (0.0010) [2023-12-26 05:50:52,082][123091] Updated weights for policy 0, policy_version 783732 (0.0008) [2023-12-26 05:50:52,144][123091] Updated weights for policy 0, policy_version 783742 (0.0006) [2023-12-26 05:50:52,214][123091] Updated weights for policy 0, policy_version 783752 (0.0008) [2023-12-26 05:50:52,334][123090] Updated weights for policy 1, policy_version 778276 (0.0011) [2023-12-26 05:50:52,413][123090] Updated weights for policy 1, policy_version 778286 (0.0011) [2023-12-26 05:50:52,487][123090] Updated weights for policy 1, policy_version 778296 (0.0011) [2023-12-26 05:50:53,029][123091] Updated weights for policy 0, policy_version 783762 (0.0009) [2023-12-26 05:50:53,081][123091] Updated weights for policy 0, policy_version 783772 (0.0009) [2023-12-26 05:50:53,135][123091] Updated weights for policy 0, policy_version 783782 (0.0010) [2023-12-26 05:50:53,188][123091] Updated weights for policy 0, policy_version 783792 (0.0010) [2023-12-26 05:50:53,221][123090] Updated weights for policy 1, policy_version 778306 (0.0010) [2023-12-26 05:50:53,284][123090] Updated weights for policy 1, policy_version 778316 (0.0005) [2023-12-26 05:50:53,336][123090] Updated weights for policy 1, policy_version 778327 (0.0006) [2023-12-26 05:50:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 399908864. Throughput: 0: 8977.3, 1: 8834.1. Samples: 399885908. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:50:53,785][121949] Avg episode reward: [(0, '5692.597'), (1, '5607.773')] [2023-12-26 05:50:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000783792_200654848.pth... [2023-12-26 05:50:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000778336_199254016.pth... [2023-12-26 05:50:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000782768_200392704.pth [2023-12-26 05:50:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000777280_198983680.pth [2023-12-26 05:50:54,027][123090] Updated weights for policy 1, policy_version 778337 (0.0009) [2023-12-26 05:50:54,088][123090] Updated weights for policy 1, policy_version 778347 (0.0005) [2023-12-26 05:50:54,112][123091] Updated weights for policy 0, policy_version 783802 (0.0009) [2023-12-26 05:50:54,142][123090] Updated weights for policy 1, policy_version 778357 (0.0005) [2023-12-26 05:50:54,167][123091] Updated weights for policy 0, policy_version 783812 (0.0007) [2023-12-26 05:50:54,196][123090] Updated weights for policy 1, policy_version 778367 (0.0010) [2023-12-26 05:50:54,225][123091] Updated weights for policy 0, policy_version 783822 (0.0008) [2023-12-26 05:50:54,998][123090] Updated weights for policy 1, policy_version 778377 (0.0010) [2023-12-26 05:50:55,000][123091] Updated weights for policy 0, policy_version 783832 (0.0006) [2023-12-26 05:50:55,051][123090] Updated weights for policy 1, policy_version 778387 (0.0010) [2023-12-26 05:50:55,058][123091] Updated weights for policy 0, policy_version 783842 (0.0006) [2023-12-26 05:50:55,108][123090] Updated weights for policy 1, policy_version 778397 (0.0005) [2023-12-26 05:50:55,119][123091] Updated weights for policy 0, policy_version 783852 (0.0008) [2023-12-26 05:50:55,938][123090] Updated weights for policy 1, policy_version 778407 (0.0006) [2023-12-26 05:50:55,965][123091] Updated weights for policy 0, policy_version 783862 (0.0008) [2023-12-26 05:50:56,004][123090] Updated weights for policy 1, policy_version 778417 (0.0007) [2023-12-26 05:50:56,031][123091] Updated weights for policy 0, policy_version 783872 (0.0008) [2023-12-26 05:50:56,070][123090] Updated weights for policy 1, policy_version 778427 (0.0009) [2023-12-26 05:50:56,094][123091] Updated weights for policy 0, policy_version 783882 (0.0007) [2023-12-26 05:50:56,845][123090] Updated weights for policy 1, policy_version 778437 (0.0007) [2023-12-26 05:50:56,851][123091] Updated weights for policy 0, policy_version 783892 (0.0006) [2023-12-26 05:50:56,914][123091] Updated weights for policy 0, policy_version 783902 (0.0005) [2023-12-26 05:50:56,916][123090] Updated weights for policy 1, policy_version 778447 (0.0005) [2023-12-26 05:50:56,969][123090] Updated weights for policy 1, policy_version 778457 (0.0005) [2023-12-26 05:50:56,973][123091] Updated weights for policy 0, policy_version 783912 (0.0005) [2023-12-26 05:50:57,616][123091] Updated weights for policy 0, policy_version 783922 (0.0006) [2023-12-26 05:50:57,616][123090] Updated weights for policy 1, policy_version 778467 (0.0007) [2023-12-26 05:50:57,660][123090] Updated weights for policy 1, policy_version 778477 (0.0010) [2023-12-26 05:50:57,663][123091] Updated weights for policy 0, policy_version 783932 (0.0006) [2023-12-26 05:50:57,710][123091] Updated weights for policy 0, policy_version 783942 (0.0006) [2023-12-26 05:50:57,715][123090] Updated weights for policy 1, policy_version 778487 (0.0010) [2023-12-26 05:50:57,754][123091] Updated weights for policy 0, policy_version 783952 (0.0006) [2023-12-26 05:50:58,471][123091] Updated weights for policy 0, policy_version 783962 (0.0010) [2023-12-26 05:50:58,542][123091] Updated weights for policy 0, policy_version 783972 (0.0011) [2023-12-26 05:50:58,550][123090] Updated weights for policy 1, policy_version 778497 (0.0010) [2023-12-26 05:50:58,615][123091] Updated weights for policy 0, policy_version 783982 (0.0010) [2023-12-26 05:50:58,627][123090] Updated weights for policy 1, policy_version 778507 (0.0009) [2023-12-26 05:50:58,692][123090] Updated weights for policy 1, policy_version 778517 (0.0008) [2023-12-26 05:50:58,760][123090] Updated weights for policy 1, policy_version 778527 (0.0008) [2023-12-26 05:50:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 400007168. Throughput: 0: 8956.1, 1: 8981.1. Samples: 399995092. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:50:58,785][121949] Avg episode reward: [(0, '5752.446'), (1, '5659.073')] [2023-12-26 05:50:59,478][123091] Updated weights for policy 0, policy_version 783992 (0.0010) [2023-12-26 05:50:59,534][123091] Updated weights for policy 0, policy_version 784002 (0.0010) [2023-12-26 05:50:59,600][123091] Updated weights for policy 0, policy_version 784012 (0.0010) [2023-12-26 05:50:59,698][123090] Updated weights for policy 1, policy_version 778537 (0.0006) [2023-12-26 05:50:59,760][123090] Updated weights for policy 1, policy_version 778547 (0.0006) [2023-12-26 05:50:59,827][123090] Updated weights for policy 1, policy_version 778557 (0.0007) [2023-12-26 05:51:00,471][123091] Updated weights for policy 0, policy_version 784022 (0.0009) [2023-12-26 05:51:00,537][123091] Updated weights for policy 0, policy_version 784032 (0.0009) [2023-12-26 05:51:00,590][123090] Updated weights for policy 1, policy_version 778567 (0.0006) [2023-12-26 05:51:00,597][123091] Updated weights for policy 0, policy_version 784042 (0.0008) [2023-12-26 05:51:00,652][123090] Updated weights for policy 1, policy_version 778577 (0.0010) [2023-12-26 05:51:00,704][123090] Updated weights for policy 1, policy_version 778587 (0.0010) [2023-12-26 05:51:01,374][123091] Updated weights for policy 0, policy_version 784053 (0.0009) [2023-12-26 05:51:01,396][123090] Updated weights for policy 1, policy_version 778597 (0.0010) [2023-12-26 05:51:01,445][123091] Updated weights for policy 0, policy_version 784063 (0.0008) [2023-12-26 05:51:01,462][123090] Updated weights for policy 1, policy_version 778607 (0.0010) [2023-12-26 05:51:01,509][123091] Updated weights for policy 0, policy_version 784073 (0.0011) [2023-12-26 05:51:01,526][123090] Updated weights for policy 1, policy_version 778617 (0.0010) [2023-12-26 05:51:02,294][123091] Updated weights for policy 0, policy_version 784083 (0.0009) [2023-12-26 05:51:02,356][123090] Updated weights for policy 1, policy_version 778627 (0.0010) [2023-12-26 05:51:02,357][123091] Updated weights for policy 0, policy_version 784093 (0.0006) [2023-12-26 05:51:02,419][123091] Updated weights for policy 0, policy_version 784103 (0.0007) [2023-12-26 05:51:02,419][123090] Updated weights for policy 1, policy_version 778637 (0.0010) [2023-12-26 05:51:02,482][123090] Updated weights for policy 1, policy_version 778647 (0.0010) [2023-12-26 05:51:03,126][123090] Updated weights for policy 1, policy_version 778657 (0.0005) [2023-12-26 05:51:03,176][123090] Updated weights for policy 1, policy_version 778667 (0.0005) [2023-12-26 05:51:03,235][123090] Updated weights for policy 1, policy_version 778677 (0.0007) [2023-12-26 05:51:03,279][123091] Updated weights for policy 0, policy_version 784113 (0.0010) [2023-12-26 05:51:03,286][123090] Updated weights for policy 1, policy_version 778687 (0.0010) [2023-12-26 05:51:03,337][123091] Updated weights for policy 0, policy_version 784123 (0.0008) [2023-12-26 05:51:03,397][123091] Updated weights for policy 0, policy_version 784133 (0.0009) [2023-12-26 05:51:03,461][123091] Updated weights for policy 0, policy_version 784143 (0.0009) [2023-12-26 05:51:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 400089088. Throughput: 0: 8831.5, 1: 8894.2. Samples: 400099332. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:03,784][121949] Avg episode reward: [(0, '5558.527'), (1, '5595.598')] [2023-12-26 05:51:04,081][123090] Updated weights for policy 1, policy_version 778697 (0.0010) [2023-12-26 05:51:04,133][123090] Updated weights for policy 1, policy_version 778707 (0.0010) [2023-12-26 05:51:04,190][123090] Updated weights for policy 1, policy_version 778717 (0.0011) [2023-12-26 05:51:04,246][123091] Updated weights for policy 0, policy_version 784153 (0.0008) [2023-12-26 05:51:04,302][123091] Updated weights for policy 0, policy_version 784163 (0.0008) [2023-12-26 05:51:04,375][123091] Updated weights for policy 0, policy_version 784173 (0.0008) [2023-12-26 05:51:05,058][123090] Updated weights for policy 1, policy_version 778727 (0.0010) [2023-12-26 05:51:05,070][123091] Updated weights for policy 0, policy_version 784183 (0.0007) [2023-12-26 05:51:05,117][123090] Updated weights for policy 1, policy_version 778737 (0.0009) [2023-12-26 05:51:05,132][123091] Updated weights for policy 0, policy_version 784193 (0.0009) [2023-12-26 05:51:05,170][123090] Updated weights for policy 1, policy_version 778747 (0.0008) [2023-12-26 05:51:05,196][123091] Updated weights for policy 0, policy_version 784203 (0.0006) [2023-12-26 05:51:05,930][123090] Updated weights for policy 1, policy_version 778757 (0.0008) [2023-12-26 05:51:05,992][123090] Updated weights for policy 1, policy_version 778767 (0.0011) [2023-12-26 05:51:06,007][123091] Updated weights for policy 0, policy_version 784213 (0.0007) [2023-12-26 05:51:06,048][123090] Updated weights for policy 1, policy_version 778777 (0.0011) [2023-12-26 05:51:06,060][123091] Updated weights for policy 0, policy_version 784223 (0.0006) [2023-12-26 05:51:06,122][123091] Updated weights for policy 0, policy_version 784233 (0.0007) [2023-12-26 05:51:06,920][123090] Updated weights for policy 1, policy_version 778787 (0.0010) [2023-12-26 05:51:06,965][123091] Updated weights for policy 0, policy_version 784243 (0.0008) [2023-12-26 05:51:06,979][123090] Updated weights for policy 1, policy_version 778797 (0.0010) [2023-12-26 05:51:07,023][123091] Updated weights for policy 0, policy_version 784253 (0.0006) [2023-12-26 05:51:07,039][123090] Updated weights for policy 1, policy_version 778807 (0.0010) [2023-12-26 05:51:07,089][123091] Updated weights for policy 0, policy_version 784263 (0.0006) [2023-12-26 05:51:07,759][123091] Updated weights for policy 0, policy_version 784273 (0.0006) [2023-12-26 05:51:07,761][123090] Updated weights for policy 1, policy_version 778817 (0.0010) [2023-12-26 05:51:07,811][123091] Updated weights for policy 0, policy_version 784283 (0.0009) [2023-12-26 05:51:07,819][123090] Updated weights for policy 1, policy_version 778827 (0.0006) [2023-12-26 05:51:07,874][123091] Updated weights for policy 0, policy_version 784293 (0.0009) [2023-12-26 05:51:07,887][123090] Updated weights for policy 1, policy_version 778837 (0.0005) [2023-12-26 05:51:07,940][123091] Updated weights for policy 0, policy_version 784303 (0.0009) [2023-12-26 05:51:07,950][123090] Updated weights for policy 1, policy_version 778847 (0.0006) [2023-12-26 05:51:08,692][123091] Updated weights for policy 0, policy_version 784313 (0.0006) [2023-12-26 05:51:08,722][123090] Updated weights for policy 1, policy_version 778857 (0.0006) [2023-12-26 05:51:08,757][123091] Updated weights for policy 0, policy_version 784323 (0.0011) [2023-12-26 05:51:08,775][123090] Updated weights for policy 1, policy_version 778867 (0.0009) [2023-12-26 05:51:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 400171008. Throughput: 0: 8803.9, 1: 8917.5. Samples: 400153384. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:08,785][121949] Avg episode reward: [(0, '5842.183'), (1, '5691.254')] [2023-12-26 05:51:08,816][123091] Updated weights for policy 0, policy_version 784333 (0.0011) [2023-12-26 05:51:08,835][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000784336_200794112.pth... [2023-12-26 05:51:08,839][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000783280_200523776.pth [2023-12-26 05:51:08,845][123090] Updated weights for policy 1, policy_version 778877 (0.0010) [2023-12-26 05:51:08,864][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000778880_199393280.pth... [2023-12-26 05:51:08,867][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000777824_199122944.pth [2023-12-26 05:51:09,501][123091] Updated weights for policy 0, policy_version 784343 (0.0009) [2023-12-26 05:51:09,567][123091] Updated weights for policy 0, policy_version 784353 (0.0009) [2023-12-26 05:51:09,646][123091] Updated weights for policy 0, policy_version 784363 (0.0005) [2023-12-26 05:51:09,720][123090] Updated weights for policy 1, policy_version 778887 (0.0009) [2023-12-26 05:51:09,789][123090] Updated weights for policy 1, policy_version 778897 (0.0006) [2023-12-26 05:51:09,862][123090] Updated weights for policy 1, policy_version 778907 (0.0008) [2023-12-26 05:51:10,441][123091] Updated weights for policy 0, policy_version 784373 (0.0007) [2023-12-26 05:51:10,494][123091] Updated weights for policy 0, policy_version 784383 (0.0009) [2023-12-26 05:51:10,545][123091] Updated weights for policy 0, policy_version 784393 (0.0010) [2023-12-26 05:51:10,628][123090] Updated weights for policy 1, policy_version 778917 (0.0008) [2023-12-26 05:51:10,696][123090] Updated weights for policy 1, policy_version 778927 (0.0008) [2023-12-26 05:51:10,768][123090] Updated weights for policy 1, policy_version 778937 (0.0009) [2023-12-26 05:51:11,365][123091] Updated weights for policy 0, policy_version 784403 (0.0009) [2023-12-26 05:51:11,433][123091] Updated weights for policy 0, policy_version 784413 (0.0010) [2023-12-26 05:51:11,504][123091] Updated weights for policy 0, policy_version 784423 (0.0007) [2023-12-26 05:51:11,660][123090] Updated weights for policy 1, policy_version 778947 (0.0009) [2023-12-26 05:51:11,729][123090] Updated weights for policy 1, policy_version 778957 (0.0009) [2023-12-26 05:51:11,796][123090] Updated weights for policy 1, policy_version 778967 (0.0010) [2023-12-26 05:51:12,354][123091] Updated weights for policy 0, policy_version 784433 (0.0007) [2023-12-26 05:51:12,434][123091] Updated weights for policy 0, policy_version 784443 (0.0010) [2023-12-26 05:51:12,495][123091] Updated weights for policy 0, policy_version 784453 (0.0009) [2023-12-26 05:51:12,544][123091] Updated weights for policy 0, policy_version 784463 (0.0009) [2023-12-26 05:51:12,650][123090] Updated weights for policy 1, policy_version 778977 (0.0010) [2023-12-26 05:51:12,703][123090] Updated weights for policy 1, policy_version 778987 (0.0009) [2023-12-26 05:51:12,754][123090] Updated weights for policy 1, policy_version 778997 (0.0009) [2023-12-26 05:51:12,812][123090] Updated weights for policy 1, policy_version 779007 (0.0009) [2023-12-26 05:51:13,351][123091] Updated weights for policy 0, policy_version 784473 (0.0010) [2023-12-26 05:51:13,403][123091] Updated weights for policy 0, policy_version 784483 (0.0007) [2023-12-26 05:51:13,450][123091] Updated weights for policy 0, policy_version 784493 (0.0005) [2023-12-26 05:51:13,704][123090] Updated weights for policy 1, policy_version 779017 (0.0010) [2023-12-26 05:51:13,760][123090] Updated weights for policy 1, policy_version 779028 (0.0010) [2023-12-26 05:51:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 400261120. Throughput: 0: 8824.8, 1: 8915.2. Samples: 400258376. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:13,785][121949] Avg episode reward: [(0, '5950.855'), (1, '5797.201')] [2023-12-26 05:51:13,815][123090] Updated weights for policy 1, policy_version 779040 (0.0011) [2023-12-26 05:51:14,069][123091] Updated weights for policy 0, policy_version 784503 (0.0006) [2023-12-26 05:51:14,119][123091] Updated weights for policy 0, policy_version 784513 (0.0007) [2023-12-26 05:51:14,172][123091] Updated weights for policy 0, policy_version 784523 (0.0005) [2023-12-26 05:51:14,747][123090] Updated weights for policy 1, policy_version 779050 (0.0009) [2023-12-26 05:51:14,812][123090] Updated weights for policy 1, policy_version 779060 (0.0009) [2023-12-26 05:51:14,880][123090] Updated weights for policy 1, policy_version 779070 (0.0010) [2023-12-26 05:51:14,966][123091] Updated weights for policy 0, policy_version 784533 (0.0005) [2023-12-26 05:51:15,033][123091] Updated weights for policy 0, policy_version 784543 (0.0006) [2023-12-26 05:51:15,091][123091] Updated weights for policy 0, policy_version 784553 (0.0011) [2023-12-26 05:51:15,660][123090] Updated weights for policy 1, policy_version 779080 (0.0008) [2023-12-26 05:51:15,721][123090] Updated weights for policy 1, policy_version 779090 (0.0006) [2023-12-26 05:51:15,787][123090] Updated weights for policy 1, policy_version 779100 (0.0005) [2023-12-26 05:51:15,914][123091] Updated weights for policy 0, policy_version 784563 (0.0011) [2023-12-26 05:51:15,970][123091] Updated weights for policy 0, policy_version 784573 (0.0010) [2023-12-26 05:51:16,014][123091] Updated weights for policy 0, policy_version 784583 (0.0010) [2023-12-26 05:51:16,581][123090] Updated weights for policy 1, policy_version 779110 (0.0005) [2023-12-26 05:51:16,639][123090] Updated weights for policy 1, policy_version 779120 (0.0005) [2023-12-26 05:51:16,712][123090] Updated weights for policy 1, policy_version 779130 (0.0005) [2023-12-26 05:51:16,883][123091] Updated weights for policy 0, policy_version 784593 (0.0011) [2023-12-26 05:51:16,932][123091] Updated weights for policy 0, policy_version 784603 (0.0010) [2023-12-26 05:51:16,979][123091] Updated weights for policy 0, policy_version 784613 (0.0010) [2023-12-26 05:51:17,027][123091] Updated weights for policy 0, policy_version 784623 (0.0010) [2023-12-26 05:51:17,324][123090] Updated weights for policy 1, policy_version 779140 (0.0005) [2023-12-26 05:51:17,379][123090] Updated weights for policy 1, policy_version 779150 (0.0005) [2023-12-26 05:51:17,433][123090] Updated weights for policy 1, policy_version 779160 (0.0005) [2023-12-26 05:51:17,875][123091] Updated weights for policy 0, policy_version 784633 (0.0011) [2023-12-26 05:51:17,945][123091] Updated weights for policy 0, policy_version 784643 (0.0011) [2023-12-26 05:51:18,015][123091] Updated weights for policy 0, policy_version 784653 (0.0011) [2023-12-26 05:51:18,117][123090] Updated weights for policy 1, policy_version 779170 (0.0006) [2023-12-26 05:51:18,176][123090] Updated weights for policy 1, policy_version 779180 (0.0010) [2023-12-26 05:51:18,234][123090] Updated weights for policy 1, policy_version 779190 (0.0010) [2023-12-26 05:51:18,293][123090] Updated weights for policy 1, policy_version 779200 (0.0010) [2023-12-26 05:51:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 400351232. Throughput: 0: 8831.8, 1: 8934.5. Samples: 400366120. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:18,785][121949] Avg episode reward: [(0, '6023.015'), (1, '5712.161')] [2023-12-26 05:51:18,822][123091] Updated weights for policy 0, policy_version 784663 (0.0011) [2023-12-26 05:51:18,882][123091] Updated weights for policy 0, policy_version 784673 (0.0010) [2023-12-26 05:51:18,939][123091] Updated weights for policy 0, policy_version 784683 (0.0011) [2023-12-26 05:51:19,144][123090] Updated weights for policy 1, policy_version 779210 (0.0011) [2023-12-26 05:51:19,212][123090] Updated weights for policy 1, policy_version 779220 (0.0011) [2023-12-26 05:51:19,282][123090] Updated weights for policy 1, policy_version 779230 (0.0011) [2023-12-26 05:51:19,771][123091] Updated weights for policy 0, policy_version 784693 (0.0011) [2023-12-26 05:51:19,835][123091] Updated weights for policy 0, policy_version 784703 (0.0010) [2023-12-26 05:51:19,898][123091] Updated weights for policy 0, policy_version 784713 (0.0011) [2023-12-26 05:51:20,137][123090] Updated weights for policy 1, policy_version 779240 (0.0011) [2023-12-26 05:51:20,204][123090] Updated weights for policy 1, policy_version 779250 (0.0011) [2023-12-26 05:51:20,275][123090] Updated weights for policy 1, policy_version 779260 (0.0011) [2023-12-26 05:51:20,727][123091] Updated weights for policy 0, policy_version 784723 (0.0009) [2023-12-26 05:51:20,798][123091] Updated weights for policy 0, policy_version 784733 (0.0011) [2023-12-26 05:51:20,863][123091] Updated weights for policy 0, policy_version 784743 (0.0011) [2023-12-26 05:51:21,130][123090] Updated weights for policy 1, policy_version 779270 (0.0010) [2023-12-26 05:51:21,199][123090] Updated weights for policy 1, policy_version 779280 (0.0009) [2023-12-26 05:51:21,264][123090] Updated weights for policy 1, policy_version 779290 (0.0009) [2023-12-26 05:51:21,653][123091] Updated weights for policy 0, policy_version 784753 (0.0010) [2023-12-26 05:51:21,724][123091] Updated weights for policy 0, policy_version 784763 (0.0009) [2023-12-26 05:51:21,798][123091] Updated weights for policy 0, policy_version 784773 (0.0009) [2023-12-26 05:51:21,870][123091] Updated weights for policy 0, policy_version 784783 (0.0006) [2023-12-26 05:51:22,107][123090] Updated weights for policy 1, policy_version 779300 (0.0010) [2023-12-26 05:51:22,163][123090] Updated weights for policy 1, policy_version 779310 (0.0010) [2023-12-26 05:51:22,215][123090] Updated weights for policy 1, policy_version 779320 (0.0010) [2023-12-26 05:51:22,598][123091] Updated weights for policy 0, policy_version 784793 (0.0009) [2023-12-26 05:51:22,670][123091] Updated weights for policy 0, policy_version 784803 (0.0009) [2023-12-26 05:51:22,743][123091] Updated weights for policy 0, policy_version 784813 (0.0009) [2023-12-26 05:51:23,072][123090] Updated weights for policy 1, policy_version 779330 (0.0011) [2023-12-26 05:51:23,142][123090] Updated weights for policy 1, policy_version 779340 (0.0010) [2023-12-26 05:51:23,201][123090] Updated weights for policy 1, policy_version 779350 (0.0007) [2023-12-26 05:51:23,273][123090] Updated weights for policy 1, policy_version 779360 (0.0006) [2023-12-26 05:51:23,591][123091] Updated weights for policy 0, policy_version 784823 (0.0010) [2023-12-26 05:51:23,643][123091] Updated weights for policy 0, policy_version 784833 (0.0009) [2023-12-26 05:51:23,696][123091] Updated weights for policy 0, policy_version 784843 (0.0010) [2023-12-26 05:51:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 400441344. Throughput: 0: 8836.8, 1: 8874.8. Samples: 400416804. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:23,785][121949] Avg episode reward: [(0, '5975.868'), (1, '5810.355')] [2023-12-26 05:51:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000784848_200925184.pth... [2023-12-26 05:51:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000783792_200654848.pth [2023-12-26 05:51:23,827][123090] Updated weights for policy 1, policy_version 779370 (0.0007) [2023-12-26 05:51:23,887][123090] Updated weights for policy 1, policy_version 779380 (0.0010) [2023-12-26 05:51:23,946][123090] Updated weights for policy 1, policy_version 779390 (0.0010) [2023-12-26 05:51:23,955][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000779392_199524352.pth... [2023-12-26 05:51:23,958][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000778336_199254016.pth [2023-12-26 05:51:24,592][123091] Updated weights for policy 0, policy_version 784853 (0.0009) [2023-12-26 05:51:24,655][123091] Updated weights for policy 0, policy_version 784864 (0.0009) [2023-12-26 05:51:24,715][123091] Updated weights for policy 0, policy_version 784874 (0.0009) [2023-12-26 05:51:24,723][123090] Updated weights for policy 1, policy_version 779400 (0.0010) [2023-12-26 05:51:24,783][123090] Updated weights for policy 1, policy_version 779410 (0.0006) [2023-12-26 05:51:24,848][123090] Updated weights for policy 1, policy_version 779420 (0.0005) [2023-12-26 05:51:25,590][123090] Updated weights for policy 1, policy_version 779430 (0.0008) [2023-12-26 05:51:25,592][123091] Updated weights for policy 0, policy_version 784884 (0.0008) [2023-12-26 05:51:25,639][123090] Updated weights for policy 1, policy_version 779440 (0.0009) [2023-12-26 05:51:25,650][123091] Updated weights for policy 0, policy_version 784894 (0.0007) [2023-12-26 05:51:25,702][123090] Updated weights for policy 1, policy_version 779450 (0.0005) [2023-12-26 05:51:25,722][123091] Updated weights for policy 0, policy_version 784904 (0.0009) [2023-12-26 05:51:26,485][123090] Updated weights for policy 1, policy_version 779460 (0.0007) [2023-12-26 05:51:26,548][123090] Updated weights for policy 1, policy_version 779470 (0.0005) [2023-12-26 05:51:26,607][123091] Updated weights for policy 0, policy_version 784914 (0.0009) [2023-12-26 05:51:26,610][123090] Updated weights for policy 1, policy_version 779480 (0.0006) [2023-12-26 05:51:26,665][123091] Updated weights for policy 0, policy_version 784924 (0.0009) [2023-12-26 05:51:26,724][123091] Updated weights for policy 0, policy_version 784934 (0.0009) [2023-12-26 05:51:26,776][123091] Updated weights for policy 0, policy_version 784944 (0.0010) [2023-12-26 05:51:27,287][123090] Updated weights for policy 1, policy_version 779490 (0.0005) [2023-12-26 05:51:27,351][123090] Updated weights for policy 1, policy_version 779500 (0.0006) [2023-12-26 05:51:27,402][123090] Updated weights for policy 1, policy_version 779510 (0.0009) [2023-12-26 05:51:27,453][123090] Updated weights for policy 1, policy_version 779520 (0.0010) [2023-12-26 05:51:27,610][123091] Updated weights for policy 0, policy_version 784954 (0.0005) [2023-12-26 05:51:27,664][123091] Updated weights for policy 0, policy_version 784964 (0.0006) [2023-12-26 05:51:27,713][123091] Updated weights for policy 0, policy_version 784974 (0.0009) [2023-12-26 05:51:28,229][123090] Updated weights for policy 1, policy_version 779530 (0.0005) [2023-12-26 05:51:28,297][123090] Updated weights for policy 1, policy_version 779540 (0.0005) [2023-12-26 05:51:28,361][123090] Updated weights for policy 1, policy_version 779550 (0.0007) [2023-12-26 05:51:28,490][123091] Updated weights for policy 0, policy_version 784984 (0.0010) [2023-12-26 05:51:28,559][123091] Updated weights for policy 0, policy_version 784994 (0.0010) [2023-12-26 05:51:28,622][123091] Updated weights for policy 0, policy_version 785004 (0.0010) [2023-12-26 05:51:28,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 400531456. Throughput: 0: 8814.9, 1: 8971.9. Samples: 400522708. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:28,786][121949] Avg episode reward: [(0, '6011.684'), (1, '5781.509')] [2023-12-26 05:51:29,010][123090] Updated weights for policy 1, policy_version 779560 (0.0010) [2023-12-26 05:51:29,057][123090] Updated weights for policy 1, policy_version 779570 (0.0010) [2023-12-26 05:51:29,109][123090] Updated weights for policy 1, policy_version 779580 (0.0010) [2023-12-26 05:51:29,444][123091] Updated weights for policy 0, policy_version 785014 (0.0009) [2023-12-26 05:51:29,515][123091] Updated weights for policy 0, policy_version 785024 (0.0008) [2023-12-26 05:51:29,582][123091] Updated weights for policy 0, policy_version 785034 (0.0008) [2023-12-26 05:51:30,002][123090] Updated weights for policy 1, policy_version 779590 (0.0010) [2023-12-26 05:51:30,065][123090] Updated weights for policy 1, policy_version 779600 (0.0010) [2023-12-26 05:51:30,129][123090] Updated weights for policy 1, policy_version 779610 (0.0010) [2023-12-26 05:51:30,386][123091] Updated weights for policy 0, policy_version 785044 (0.0009) [2023-12-26 05:51:30,449][123091] Updated weights for policy 0, policy_version 785054 (0.0011) [2023-12-26 05:51:30,509][123091] Updated weights for policy 0, policy_version 785064 (0.0011) [2023-12-26 05:51:30,779][123090] Updated weights for policy 1, policy_version 779620 (0.0007) [2023-12-26 05:51:30,842][123090] Updated weights for policy 1, policy_version 779630 (0.0005) [2023-12-26 05:51:30,904][123090] Updated weights for policy 1, policy_version 779640 (0.0010) [2023-12-26 05:51:31,322][123091] Updated weights for policy 0, policy_version 785074 (0.0011) [2023-12-26 05:51:31,385][123091] Updated weights for policy 0, policy_version 785084 (0.0010) [2023-12-26 05:51:31,444][123091] Updated weights for policy 0, policy_version 785094 (0.0007) [2023-12-26 05:51:31,491][123091] Updated weights for policy 0, policy_version 785104 (0.0008) [2023-12-26 05:51:31,736][123090] Updated weights for policy 1, policy_version 779650 (0.0010) [2023-12-26 05:51:31,792][123090] Updated weights for policy 1, policy_version 779660 (0.0009) [2023-12-26 05:51:31,846][123090] Updated weights for policy 1, policy_version 779670 (0.0008) [2023-12-26 05:51:31,898][123090] Updated weights for policy 1, policy_version 779680 (0.0009) [2023-12-26 05:51:32,332][123091] Updated weights for policy 0, policy_version 785114 (0.0011) [2023-12-26 05:51:32,399][123091] Updated weights for policy 0, policy_version 785124 (0.0011) [2023-12-26 05:51:32,459][123091] Updated weights for policy 0, policy_version 785134 (0.0011) [2023-12-26 05:51:32,707][123090] Updated weights for policy 1, policy_version 779690 (0.0005) [2023-12-26 05:51:32,780][123090] Updated weights for policy 1, policy_version 779700 (0.0007) [2023-12-26 05:51:32,833][123090] Updated weights for policy 1, policy_version 779710 (0.0008) [2023-12-26 05:51:33,224][123091] Updated weights for policy 0, policy_version 785144 (0.0007) [2023-12-26 05:51:33,280][123091] Updated weights for policy 0, policy_version 785154 (0.0006) [2023-12-26 05:51:33,339][123091] Updated weights for policy 0, policy_version 785164 (0.0009) [2023-12-26 05:51:33,443][123090] Updated weights for policy 1, policy_version 779720 (0.0008) [2023-12-26 05:51:33,502][123090] Updated weights for policy 1, policy_version 779730 (0.0009) [2023-12-26 05:51:33,557][123090] Updated weights for policy 1, policy_version 779740 (0.0009) [2023-12-26 05:51:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 400621568. Throughput: 0: 8789.4, 1: 8960.9. Samples: 400631096. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:33,785][121949] Avg episode reward: [(0, '5962.757'), (1, '5770.779')] [2023-12-26 05:51:34,098][123091] Updated weights for policy 0, policy_version 785174 (0.0010) [2023-12-26 05:51:34,162][123091] Updated weights for policy 0, policy_version 785184 (0.0011) [2023-12-26 05:51:34,223][123091] Updated weights for policy 0, policy_version 785194 (0.0011) [2023-12-26 05:51:34,405][123090] Updated weights for policy 1, policy_version 779750 (0.0009) [2023-12-26 05:51:34,471][123090] Updated weights for policy 1, policy_version 779760 (0.0009) [2023-12-26 05:51:34,533][123090] Updated weights for policy 1, policy_version 779770 (0.0008) [2023-12-26 05:51:34,964][123091] Updated weights for policy 0, policy_version 785204 (0.0008) [2023-12-26 05:51:35,020][123091] Updated weights for policy 0, policy_version 785214 (0.0005) [2023-12-26 05:51:35,075][123091] Updated weights for policy 0, policy_version 785224 (0.0005) [2023-12-26 05:51:35,461][123090] Updated weights for policy 1, policy_version 779780 (0.0009) [2023-12-26 05:51:35,519][123090] Updated weights for policy 1, policy_version 779791 (0.0010) [2023-12-26 05:51:35,574][123090] Updated weights for policy 1, policy_version 779802 (0.0010) [2023-12-26 05:51:35,658][123091] Updated weights for policy 0, policy_version 785234 (0.0005) [2023-12-26 05:51:35,710][123091] Updated weights for policy 0, policy_version 785244 (0.0005) [2023-12-26 05:51:35,756][123091] Updated weights for policy 0, policy_version 785254 (0.0005) [2023-12-26 05:51:35,805][123091] Updated weights for policy 0, policy_version 785264 (0.0005) [2023-12-26 05:51:36,461][123091] Updated weights for policy 0, policy_version 785274 (0.0011) [2023-12-26 05:51:36,480][123090] Updated weights for policy 1, policy_version 779812 (0.0010) [2023-12-26 05:51:36,525][123091] Updated weights for policy 0, policy_version 785284 (0.0011) [2023-12-26 05:51:36,544][123090] Updated weights for policy 1, policy_version 779822 (0.0005) [2023-12-26 05:51:36,588][123091] Updated weights for policy 0, policy_version 785294 (0.0011) [2023-12-26 05:51:36,595][123090] Updated weights for policy 1, policy_version 779832 (0.0009) [2023-12-26 05:51:37,325][123090] Updated weights for policy 1, policy_version 779842 (0.0008) [2023-12-26 05:51:37,391][123090] Updated weights for policy 1, policy_version 779852 (0.0006) [2023-12-26 05:51:37,404][123091] Updated weights for policy 0, policy_version 785304 (0.0011) [2023-12-26 05:51:37,458][123090] Updated weights for policy 1, policy_version 779862 (0.0005) [2023-12-26 05:51:37,464][123091] Updated weights for policy 0, policy_version 785314 (0.0011) [2023-12-26 05:51:37,509][123090] Updated weights for policy 1, policy_version 779872 (0.0007) [2023-12-26 05:51:37,519][123091] Updated weights for policy 0, policy_version 785324 (0.0010) [2023-12-26 05:51:38,262][123090] Updated weights for policy 1, policy_version 779882 (0.0006) [2023-12-26 05:51:38,323][123090] Updated weights for policy 1, policy_version 779892 (0.0006) [2023-12-26 05:51:38,365][123091] Updated weights for policy 0, policy_version 785334 (0.0011) [2023-12-26 05:51:38,384][123090] Updated weights for policy 1, policy_version 779902 (0.0007) [2023-12-26 05:51:38,428][123091] Updated weights for policy 0, policy_version 785344 (0.0011) [2023-12-26 05:51:38,494][123091] Updated weights for policy 0, policy_version 785354 (0.0010) [2023-12-26 05:51:38,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 400711680. Throughput: 0: 8839.1, 1: 8921.6. Samples: 400685140. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:38,785][121949] Avg episode reward: [(0, '5970.109'), (1, '5761.147')] [2023-12-26 05:51:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000785360_201056256.pth... [2023-12-26 05:51:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000779904_199655424.pth... [2023-12-26 05:51:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000784336_200794112.pth [2023-12-26 05:51:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000778880_199393280.pth [2023-12-26 05:51:39,154][123090] Updated weights for policy 1, policy_version 779912 (0.0008) [2023-12-26 05:51:39,221][123090] Updated weights for policy 1, policy_version 779922 (0.0009) [2023-12-26 05:51:39,284][123090] Updated weights for policy 1, policy_version 779932 (0.0009) [2023-12-26 05:51:39,345][123091] Updated weights for policy 0, policy_version 785364 (0.0011) [2023-12-26 05:51:39,419][123091] Updated weights for policy 0, policy_version 785374 (0.0014) [2023-12-26 05:51:39,475][123091] Updated weights for policy 0, policy_version 785384 (0.0008) [2023-12-26 05:51:40,163][123090] Updated weights for policy 1, policy_version 779942 (0.0009) [2023-12-26 05:51:40,230][123090] Updated weights for policy 1, policy_version 779952 (0.0009) [2023-12-26 05:51:40,288][123090] Updated weights for policy 1, policy_version 779962 (0.0006) [2023-12-26 05:51:40,292][123091] Updated weights for policy 0, policy_version 785394 (0.0008) [2023-12-26 05:51:40,345][123091] Updated weights for policy 0, policy_version 785404 (0.0006) [2023-12-26 05:51:40,400][123091] Updated weights for policy 0, policy_version 785414 (0.0007) [2023-12-26 05:51:40,454][123091] Updated weights for policy 0, policy_version 785424 (0.0006) [2023-12-26 05:51:41,101][123090] Updated weights for policy 1, policy_version 779972 (0.0007) [2023-12-26 05:51:41,171][123090] Updated weights for policy 1, policy_version 779982 (0.0009) [2023-12-26 05:51:41,234][123090] Updated weights for policy 1, policy_version 779992 (0.0009) [2023-12-26 05:51:41,277][123091] Updated weights for policy 0, policy_version 785434 (0.0008) [2023-12-26 05:51:41,341][123091] Updated weights for policy 0, policy_version 785444 (0.0010) [2023-12-26 05:51:41,414][123091] Updated weights for policy 0, policy_version 785454 (0.0009) [2023-12-26 05:51:42,089][123090] Updated weights for policy 1, policy_version 780002 (0.0009) [2023-12-26 05:51:42,156][123090] Updated weights for policy 1, policy_version 780012 (0.0009) [2023-12-26 05:51:42,202][123091] Updated weights for policy 0, policy_version 785464 (0.0011) [2023-12-26 05:51:42,214][123090] Updated weights for policy 1, policy_version 780022 (0.0007) [2023-12-26 05:51:42,263][123091] Updated weights for policy 0, policy_version 785474 (0.0007) [2023-12-26 05:51:42,270][123090] Updated weights for policy 1, policy_version 780032 (0.0008) [2023-12-26 05:51:42,327][123091] Updated weights for policy 0, policy_version 785484 (0.0007) [2023-12-26 05:51:43,103][123091] Updated weights for policy 0, policy_version 785494 (0.0007) [2023-12-26 05:51:43,162][123091] Updated weights for policy 0, policy_version 785504 (0.0008) [2023-12-26 05:51:43,202][123090] Updated weights for policy 1, policy_version 780042 (0.0009) [2023-12-26 05:51:43,224][123091] Updated weights for policy 0, policy_version 785514 (0.0009) [2023-12-26 05:51:43,262][123090] Updated weights for policy 1, policy_version 780052 (0.0009) [2023-12-26 05:51:43,317][123090] Updated weights for policy 1, policy_version 780062 (0.0010) [2023-12-26 05:51:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 400793600. Throughput: 0: 8803.8, 1: 8836.5. Samples: 400788904. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:43,785][121949] Avg episode reward: [(0, '6009.629'), (1, '5727.802')] [2023-12-26 05:51:43,923][123091] Updated weights for policy 0, policy_version 785524 (0.0006) [2023-12-26 05:51:43,969][123091] Updated weights for policy 0, policy_version 785534 (0.0005) [2023-12-26 05:51:44,025][123091] Updated weights for policy 0, policy_version 785544 (0.0005) [2023-12-26 05:51:44,207][123090] Updated weights for policy 1, policy_version 780072 (0.0010) [2023-12-26 05:51:44,277][123090] Updated weights for policy 1, policy_version 780082 (0.0009) [2023-12-26 05:51:44,339][123090] Updated weights for policy 1, policy_version 780092 (0.0009) [2023-12-26 05:51:44,741][123091] Updated weights for policy 0, policy_version 785554 (0.0005) [2023-12-26 05:51:44,814][123091] Updated weights for policy 0, policy_version 785564 (0.0007) [2023-12-26 05:51:44,888][123091] Updated weights for policy 0, policy_version 785574 (0.0009) [2023-12-26 05:51:44,960][123091] Updated weights for policy 0, policy_version 785584 (0.0011) [2023-12-26 05:51:45,204][123090] Updated weights for policy 1, policy_version 780102 (0.0009) [2023-12-26 05:51:45,272][123090] Updated weights for policy 1, policy_version 780112 (0.0009) [2023-12-26 05:51:45,340][123090] Updated weights for policy 1, policy_version 780122 (0.0010) [2023-12-26 05:51:45,685][123091] Updated weights for policy 0, policy_version 785594 (0.0005) [2023-12-26 05:51:45,755][123091] Updated weights for policy 0, policy_version 785604 (0.0007) [2023-12-26 05:51:45,828][123091] Updated weights for policy 0, policy_version 785614 (0.0005) [2023-12-26 05:51:46,205][123090] Updated weights for policy 1, policy_version 780132 (0.0009) [2023-12-26 05:51:46,267][123090] Updated weights for policy 1, policy_version 780142 (0.0010) [2023-12-26 05:51:46,336][123090] Updated weights for policy 1, policy_version 780152 (0.0010) [2023-12-26 05:51:46,485][123091] Updated weights for policy 0, policy_version 785624 (0.0009) [2023-12-26 05:51:46,536][123091] Updated weights for policy 0, policy_version 785634 (0.0008) [2023-12-26 05:51:46,586][123091] Updated weights for policy 0, policy_version 785644 (0.0009) [2023-12-26 05:51:47,180][123090] Updated weights for policy 1, policy_version 780162 (0.0009) [2023-12-26 05:51:47,250][123090] Updated weights for policy 1, policy_version 780172 (0.0010) [2023-12-26 05:51:47,315][123090] Updated weights for policy 1, policy_version 780182 (0.0009) [2023-12-26 05:51:47,381][123091] Updated weights for policy 0, policy_version 785654 (0.0009) [2023-12-26 05:51:47,381][123090] Updated weights for policy 1, policy_version 780192 (0.0010) [2023-12-26 05:51:47,443][123091] Updated weights for policy 0, policy_version 785664 (0.0009) [2023-12-26 05:51:47,499][123091] Updated weights for policy 0, policy_version 785674 (0.0010) [2023-12-26 05:51:48,213][123091] Updated weights for policy 0, policy_version 785684 (0.0010) [2023-12-26 05:51:48,235][123090] Updated weights for policy 1, policy_version 780202 (0.0009) [2023-12-26 05:51:48,267][123091] Updated weights for policy 0, policy_version 785694 (0.0010) [2023-12-26 05:51:48,297][123090] Updated weights for policy 1, policy_version 780212 (0.0007) [2023-12-26 05:51:48,326][123091] Updated weights for policy 0, policy_version 785704 (0.0009) [2023-12-26 05:51:48,369][123090] Updated weights for policy 1, policy_version 780222 (0.0008) [2023-12-26 05:51:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 400883712. Throughput: 0: 8934.3, 1: 8736.1. Samples: 400894500. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:48,785][121949] Avg episode reward: [(0, '6075.167'), (1, '5716.357')] [2023-12-26 05:51:49,130][123091] Updated weights for policy 0, policy_version 785714 (0.0009) [2023-12-26 05:51:49,155][123090] Updated weights for policy 1, policy_version 780232 (0.0007) [2023-12-26 05:51:49,195][123091] Updated weights for policy 0, policy_version 785724 (0.0010) [2023-12-26 05:51:49,219][123090] Updated weights for policy 1, policy_version 780242 (0.0007) [2023-12-26 05:51:49,256][123091] Updated weights for policy 0, policy_version 785734 (0.0008) [2023-12-26 05:51:49,287][123090] Updated weights for policy 1, policy_version 780252 (0.0009) [2023-12-26 05:51:49,321][123091] Updated weights for policy 0, policy_version 785744 (0.0009) [2023-12-26 05:51:50,062][123090] Updated weights for policy 1, policy_version 780262 (0.0009) [2023-12-26 05:51:50,125][123090] Updated weights for policy 1, policy_version 780272 (0.0009) [2023-12-26 05:51:50,170][123091] Updated weights for policy 0, policy_version 785754 (0.0006) [2023-12-26 05:51:50,186][123090] Updated weights for policy 1, policy_version 780282 (0.0008) [2023-12-26 05:51:50,239][123091] Updated weights for policy 0, policy_version 785764 (0.0006) [2023-12-26 05:51:50,306][123091] Updated weights for policy 0, policy_version 785774 (0.0008) [2023-12-26 05:51:51,037][123090] Updated weights for policy 1, policy_version 780292 (0.0008) [2023-12-26 05:51:51,042][123091] Updated weights for policy 0, policy_version 785784 (0.0008) [2023-12-26 05:51:51,112][123090] Updated weights for policy 1, policy_version 780302 (0.0007) [2023-12-26 05:51:51,120][123091] Updated weights for policy 0, policy_version 785794 (0.0007) [2023-12-26 05:51:51,183][123090] Updated weights for policy 1, policy_version 780312 (0.0008) [2023-12-26 05:51:51,188][123091] Updated weights for policy 0, policy_version 785804 (0.0008) [2023-12-26 05:51:52,008][123090] Updated weights for policy 1, policy_version 780322 (0.0009) [2023-12-26 05:51:52,016][123091] Updated weights for policy 0, policy_version 785814 (0.0009) [2023-12-26 05:51:52,070][123090] Updated weights for policy 1, policy_version 780332 (0.0008) [2023-12-26 05:51:52,080][123091] Updated weights for policy 0, policy_version 785824 (0.0008) [2023-12-26 05:51:52,139][123090] Updated weights for policy 1, policy_version 780342 (0.0007) [2023-12-26 05:51:52,144][123091] Updated weights for policy 0, policy_version 785834 (0.0008) [2023-12-26 05:51:52,202][123090] Updated weights for policy 1, policy_version 780352 (0.0008) [2023-12-26 05:51:52,955][123091] Updated weights for policy 0, policy_version 785844 (0.0009) [2023-12-26 05:51:53,003][123091] Updated weights for policy 0, policy_version 785854 (0.0010) [2023-12-26 05:51:53,034][123090] Updated weights for policy 1, policy_version 780362 (0.0008) [2023-12-26 05:51:53,051][123091] Updated weights for policy 0, policy_version 785864 (0.0010) [2023-12-26 05:51:53,098][123090] Updated weights for policy 1, policy_version 780372 (0.0010) [2023-12-26 05:51:53,161][123090] Updated weights for policy 1, policy_version 780382 (0.0009) [2023-12-26 05:51:53,747][123091] Updated weights for policy 0, policy_version 785874 (0.0009) [2023-12-26 05:51:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 400965632. Throughput: 0: 8930.2, 1: 8713.7. Samples: 400947364. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:53,786][121949] Avg episode reward: [(0, '6091.599'), (1, '5863.464')] [2023-12-26 05:51:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000780384_199778304.pth... [2023-12-26 05:51:53,796][123091] Updated weights for policy 0, policy_version 785884 (0.0005) [2023-12-26 05:51:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000779392_199524352.pth [2023-12-26 05:51:53,842][123091] Updated weights for policy 0, policy_version 785894 (0.0005) [2023-12-26 05:51:53,891][123091] Updated weights for policy 0, policy_version 785904 (0.0005) [2023-12-26 05:51:53,892][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000785904_201195520.pth... [2023-12-26 05:51:53,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000784848_200925184.pth [2023-12-26 05:51:54,101][123090] Updated weights for policy 1, policy_version 780392 (0.0011) [2023-12-26 05:51:54,158][123090] Updated weights for policy 1, policy_version 780402 (0.0010) [2023-12-26 05:51:54,216][123090] Updated weights for policy 1, policy_version 780412 (0.0009) [2023-12-26 05:51:54,580][123091] Updated weights for policy 0, policy_version 785914 (0.0010) [2023-12-26 05:51:54,636][123091] Updated weights for policy 0, policy_version 785924 (0.0010) [2023-12-26 05:51:54,688][123091] Updated weights for policy 0, policy_version 785934 (0.0010) [2023-12-26 05:51:55,159][123090] Updated weights for policy 1, policy_version 780422 (0.0010) [2023-12-26 05:51:55,225][123090] Updated weights for policy 1, policy_version 780432 (0.0009) [2023-12-26 05:51:55,299][123090] Updated weights for policy 1, policy_version 780442 (0.0009) [2023-12-26 05:51:55,450][123091] Updated weights for policy 0, policy_version 785944 (0.0011) [2023-12-26 05:51:55,501][123091] Updated weights for policy 0, policy_version 785954 (0.0010) [2023-12-26 05:51:55,552][123091] Updated weights for policy 0, policy_version 785964 (0.0010) [2023-12-26 05:51:56,055][123090] Updated weights for policy 1, policy_version 780452 (0.0009) [2023-12-26 05:51:56,118][123090] Updated weights for policy 1, policy_version 780462 (0.0008) [2023-12-26 05:51:56,181][123090] Updated weights for policy 1, policy_version 780472 (0.0008) [2023-12-26 05:51:56,391][123091] Updated weights for policy 0, policy_version 785974 (0.0011) [2023-12-26 05:51:56,461][123091] Updated weights for policy 0, policy_version 785984 (0.0010) [2023-12-26 05:51:56,529][123091] Updated weights for policy 0, policy_version 785994 (0.0007) [2023-12-26 05:51:57,080][123090] Updated weights for policy 1, policy_version 780482 (0.0009) [2023-12-26 05:51:57,130][123090] Updated weights for policy 1, policy_version 780492 (0.0009) [2023-12-26 05:51:57,188][123090] Updated weights for policy 1, policy_version 780503 (0.0008) [2023-12-26 05:51:57,189][123091] Updated weights for policy 0, policy_version 786004 (0.0007) [2023-12-26 05:51:57,248][123091] Updated weights for policy 0, policy_version 786014 (0.0008) [2023-12-26 05:51:57,295][123091] Updated weights for policy 0, policy_version 786024 (0.0010) [2023-12-26 05:51:57,874][123091] Updated weights for policy 0, policy_version 786034 (0.0007) [2023-12-26 05:51:57,930][123091] Updated weights for policy 0, policy_version 786044 (0.0005) [2023-12-26 05:51:57,980][123091] Updated weights for policy 0, policy_version 786054 (0.0005) [2023-12-26 05:51:58,040][123091] Updated weights for policy 0, policy_version 786064 (0.0008) [2023-12-26 05:51:58,051][123090] Updated weights for policy 1, policy_version 780513 (0.0008) [2023-12-26 05:51:58,119][123090] Updated weights for policy 1, policy_version 780523 (0.0009) [2023-12-26 05:51:58,180][123090] Updated weights for policy 1, policy_version 780533 (0.0009) [2023-12-26 05:51:58,243][123090] Updated weights for policy 1, policy_version 780543 (0.0009) [2023-12-26 05:51:58,785][121949] Fps is (10 sec: 17201.9, 60 sec: 17476.1, 300 sec: 17744.7). Total num frames: 401055744. Throughput: 0: 8986.5, 1: 8684.1. Samples: 401053560. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:51:58,786][121949] Avg episode reward: [(0, '5962.495'), (1, '5854.747')] [2023-12-26 05:51:58,863][123091] Updated weights for policy 0, policy_version 786074 (0.0009) [2023-12-26 05:51:58,923][123091] Updated weights for policy 0, policy_version 786084 (0.0010) [2023-12-26 05:51:58,989][123091] Updated weights for policy 0, policy_version 786094 (0.0006) [2023-12-26 05:51:59,178][123090] Updated weights for policy 1, policy_version 780553 (0.0010) [2023-12-26 05:51:59,236][123090] Updated weights for policy 1, policy_version 780563 (0.0009) [2023-12-26 05:51:59,310][123090] Updated weights for policy 1, policy_version 780573 (0.0009) [2023-12-26 05:51:59,788][123091] Updated weights for policy 0, policy_version 786104 (0.0010) [2023-12-26 05:51:59,848][123091] Updated weights for policy 0, policy_version 786114 (0.0011) [2023-12-26 05:51:59,900][123091] Updated weights for policy 0, policy_version 786124 (0.0011) [2023-12-26 05:52:00,129][123090] Updated weights for policy 1, policy_version 780583 (0.0008) [2023-12-26 05:52:00,194][123090] Updated weights for policy 1, policy_version 780593 (0.0008) [2023-12-26 05:52:00,265][123090] Updated weights for policy 1, policy_version 780603 (0.0008) [2023-12-26 05:52:00,638][123091] Updated weights for policy 0, policy_version 786134 (0.0011) [2023-12-26 05:52:00,682][123091] Updated weights for policy 0, policy_version 786144 (0.0005) [2023-12-26 05:52:00,735][123091] Updated weights for policy 0, policy_version 786154 (0.0005) [2023-12-26 05:52:01,036][123090] Updated weights for policy 1, policy_version 780613 (0.0009) [2023-12-26 05:52:01,097][123090] Updated weights for policy 1, policy_version 780623 (0.0009) [2023-12-26 05:52:01,168][123090] Updated weights for policy 1, policy_version 780633 (0.0009) [2023-12-26 05:52:01,490][123091] Updated weights for policy 0, policy_version 786164 (0.0007) [2023-12-26 05:52:01,549][123091] Updated weights for policy 0, policy_version 786174 (0.0010) [2023-12-26 05:52:01,616][123091] Updated weights for policy 0, policy_version 786184 (0.0010) [2023-12-26 05:52:02,026][123090] Updated weights for policy 1, policy_version 780643 (0.0010) [2023-12-26 05:52:02,081][123090] Updated weights for policy 1, policy_version 780653 (0.0010) [2023-12-26 05:52:02,131][123090] Updated weights for policy 1, policy_version 780663 (0.0009) [2023-12-26 05:52:02,454][123091] Updated weights for policy 0, policy_version 786194 (0.0010) [2023-12-26 05:52:02,519][123091] Updated weights for policy 0, policy_version 786204 (0.0008) [2023-12-26 05:52:02,577][123091] Updated weights for policy 0, policy_version 786214 (0.0009) [2023-12-26 05:52:02,641][123091] Updated weights for policy 0, policy_version 786224 (0.0009) [2023-12-26 05:52:02,978][123090] Updated weights for policy 1, policy_version 780673 (0.0008) [2023-12-26 05:52:03,027][123090] Updated weights for policy 1, policy_version 780683 (0.0009) [2023-12-26 05:52:03,084][123090] Updated weights for policy 1, policy_version 780693 (0.0008) [2023-12-26 05:52:03,132][123090] Updated weights for policy 1, policy_version 780703 (0.0010) [2023-12-26 05:52:03,496][123091] Updated weights for policy 0, policy_version 786234 (0.0005) [2023-12-26 05:52:03,560][123091] Updated weights for policy 0, policy_version 786244 (0.0009) [2023-12-26 05:52:03,623][123091] Updated weights for policy 0, policy_version 786254 (0.0007) [2023-12-26 05:52:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 401145856. Throughput: 0: 8988.1, 1: 8597.1. Samples: 401157456. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:03,785][121949] Avg episode reward: [(0, '5928.688'), (1, '5757.439')] [2023-12-26 05:52:03,853][123090] Updated weights for policy 1, policy_version 780713 (0.0008) [2023-12-26 05:52:03,922][123090] Updated weights for policy 1, policy_version 780723 (0.0010) [2023-12-26 05:52:03,981][123090] Updated weights for policy 1, policy_version 780733 (0.0010) [2023-12-26 05:52:04,342][123091] Updated weights for policy 0, policy_version 786264 (0.0008) [2023-12-26 05:52:04,398][123091] Updated weights for policy 0, policy_version 786275 (0.0010) [2023-12-26 05:52:04,469][123091] Updated weights for policy 0, policy_version 786285 (0.0010) [2023-12-26 05:52:04,712][123090] Updated weights for policy 1, policy_version 780743 (0.0009) [2023-12-26 05:52:04,769][123090] Updated weights for policy 1, policy_version 780753 (0.0006) [2023-12-26 05:52:04,832][123090] Updated weights for policy 1, policy_version 780763 (0.0007) [2023-12-26 05:52:05,358][123091] Updated weights for policy 0, policy_version 786295 (0.0006) [2023-12-26 05:52:05,418][123091] Updated weights for policy 0, policy_version 786305 (0.0005) [2023-12-26 05:52:05,473][123091] Updated weights for policy 0, policy_version 786315 (0.0005) [2023-12-26 05:52:05,504][123090] Updated weights for policy 1, policy_version 780773 (0.0007) [2023-12-26 05:52:05,554][123090] Updated weights for policy 1, policy_version 780783 (0.0009) [2023-12-26 05:52:05,602][123090] Updated weights for policy 1, policy_version 780793 (0.0009) [2023-12-26 05:52:06,236][123091] Updated weights for policy 0, policy_version 786325 (0.0005) [2023-12-26 05:52:06,296][123091] Updated weights for policy 0, policy_version 786335 (0.0006) [2023-12-26 05:52:06,356][123091] Updated weights for policy 0, policy_version 786345 (0.0006) [2023-12-26 05:52:06,408][123090] Updated weights for policy 1, policy_version 780803 (0.0009) [2023-12-26 05:52:06,479][123090] Updated weights for policy 1, policy_version 780813 (0.0010) [2023-12-26 05:52:06,543][123090] Updated weights for policy 1, policy_version 780823 (0.0009) [2023-12-26 05:52:06,976][123091] Updated weights for policy 0, policy_version 786355 (0.0009) [2023-12-26 05:52:07,034][123091] Updated weights for policy 0, policy_version 786365 (0.0006) [2023-12-26 05:52:07,087][123091] Updated weights for policy 0, policy_version 786375 (0.0006) [2023-12-26 05:52:07,183][123090] Updated weights for policy 1, policy_version 780833 (0.0010) [2023-12-26 05:52:07,235][123090] Updated weights for policy 1, policy_version 780843 (0.0009) [2023-12-26 05:52:07,289][123090] Updated weights for policy 1, policy_version 780853 (0.0009) [2023-12-26 05:52:07,344][123090] Updated weights for policy 1, policy_version 780864 (0.0010) [2023-12-26 05:52:07,816][123091] Updated weights for policy 0, policy_version 786385 (0.0006) [2023-12-26 05:52:07,875][123091] Updated weights for policy 0, policy_version 786395 (0.0010) [2023-12-26 05:52:07,936][123091] Updated weights for policy 0, policy_version 786405 (0.0010) [2023-12-26 05:52:07,993][123091] Updated weights for policy 0, policy_version 786415 (0.0009) [2023-12-26 05:52:08,150][123090] Updated weights for policy 1, policy_version 780874 (0.0005) [2023-12-26 05:52:08,203][123090] Updated weights for policy 1, policy_version 780884 (0.0005) [2023-12-26 05:52:08,261][123090] Updated weights for policy 1, policy_version 780894 (0.0005) [2023-12-26 05:52:08,725][123091] Updated weights for policy 0, policy_version 786425 (0.0006) [2023-12-26 05:52:08,780][123091] Updated weights for policy 0, policy_version 786435 (0.0005) [2023-12-26 05:52:08,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 401235968. Throughput: 0: 9005.2, 1: 8674.3. Samples: 401212380. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:08,785][121949] Avg episode reward: [(0, '5900.324'), (1, '5660.159')] [2023-12-26 05:52:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000780896_199909376.pth... [2023-12-26 05:52:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000779904_199655424.pth [2023-12-26 05:52:08,838][123091] Updated weights for policy 0, policy_version 786445 (0.0006) [2023-12-26 05:52:08,854][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000786448_201334784.pth... [2023-12-26 05:52:08,858][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000785360_201056256.pth [2023-12-26 05:52:08,970][123090] Updated weights for policy 1, policy_version 780904 (0.0008) [2023-12-26 05:52:09,023][123090] Updated weights for policy 1, policy_version 780914 (0.0009) [2023-12-26 05:52:09,080][123090] Updated weights for policy 1, policy_version 780924 (0.0010) [2023-12-26 05:52:09,579][123091] Updated weights for policy 0, policy_version 786455 (0.0007) [2023-12-26 05:52:09,650][123091] Updated weights for policy 0, policy_version 786465 (0.0005) [2023-12-26 05:52:09,711][123091] Updated weights for policy 0, policy_version 786475 (0.0010) [2023-12-26 05:52:09,938][123090] Updated weights for policy 1, policy_version 780934 (0.0008) [2023-12-26 05:52:10,005][123090] Updated weights for policy 1, policy_version 780944 (0.0008) [2023-12-26 05:52:10,060][123090] Updated weights for policy 1, policy_version 780954 (0.0008) [2023-12-26 05:52:10,524][123091] Updated weights for policy 0, policy_version 786485 (0.0011) [2023-12-26 05:52:10,579][123091] Updated weights for policy 0, policy_version 786495 (0.0010) [2023-12-26 05:52:10,635][123091] Updated weights for policy 0, policy_version 786505 (0.0011) [2023-12-26 05:52:10,809][123090] Updated weights for policy 1, policy_version 780964 (0.0007) [2023-12-26 05:52:10,857][123090] Updated weights for policy 1, policy_version 780974 (0.0005) [2023-12-26 05:52:10,909][123090] Updated weights for policy 1, policy_version 780984 (0.0006) [2023-12-26 05:52:11,301][123091] Updated weights for policy 0, policy_version 786515 (0.0006) [2023-12-26 05:52:11,370][123091] Updated weights for policy 0, policy_version 786525 (0.0008) [2023-12-26 05:52:11,441][123091] Updated weights for policy 0, policy_version 786535 (0.0007) [2023-12-26 05:52:11,717][123090] Updated weights for policy 1, policy_version 780994 (0.0009) [2023-12-26 05:52:11,782][123090] Updated weights for policy 1, policy_version 781004 (0.0011) [2023-12-26 05:52:11,853][123090] Updated weights for policy 1, policy_version 781014 (0.0008) [2023-12-26 05:52:11,922][123090] Updated weights for policy 1, policy_version 781024 (0.0005) [2023-12-26 05:52:12,308][123091] Updated weights for policy 0, policy_version 786545 (0.0009) [2023-12-26 05:52:12,376][123091] Updated weights for policy 0, policy_version 786555 (0.0007) [2023-12-26 05:52:12,445][123091] Updated weights for policy 0, policy_version 786565 (0.0007) [2023-12-26 05:52:12,509][123091] Updated weights for policy 0, policy_version 786575 (0.0009) [2023-12-26 05:52:12,711][123090] Updated weights for policy 1, policy_version 781034 (0.0010) [2023-12-26 05:52:12,782][123090] Updated weights for policy 1, policy_version 781044 (0.0008) [2023-12-26 05:52:12,861][123090] Updated weights for policy 1, policy_version 781054 (0.0005) [2023-12-26 05:52:13,192][123091] Updated weights for policy 0, policy_version 786585 (0.0008) [2023-12-26 05:52:13,251][123091] Updated weights for policy 0, policy_version 786595 (0.0009) [2023-12-26 05:52:13,301][123091] Updated weights for policy 0, policy_version 786605 (0.0009) [2023-12-26 05:52:13,519][123090] Updated weights for policy 1, policy_version 781064 (0.0009) [2023-12-26 05:52:13,575][123090] Updated weights for policy 1, policy_version 781074 (0.0009) [2023-12-26 05:52:13,629][123090] Updated weights for policy 1, policy_version 781084 (0.0009) [2023-12-26 05:52:13,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 401334272. Throughput: 0: 9126.7, 1: 8659.1. Samples: 401323060. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:13,785][121949] Avg episode reward: [(0, '5853.896'), (1, '5772.058')] [2023-12-26 05:52:14,123][123091] Updated weights for policy 0, policy_version 786615 (0.0009) [2023-12-26 05:52:14,186][123091] Updated weights for policy 0, policy_version 786625 (0.0010) [2023-12-26 05:52:14,256][123091] Updated weights for policy 0, policy_version 786635 (0.0010) [2023-12-26 05:52:14,515][123090] Updated weights for policy 1, policy_version 781094 (0.0009) [2023-12-26 05:52:14,585][123090] Updated weights for policy 1, policy_version 781104 (0.0009) [2023-12-26 05:52:14,648][123090] Updated weights for policy 1, policy_version 781114 (0.0009) [2023-12-26 05:52:15,071][123091] Updated weights for policy 0, policy_version 786645 (0.0009) [2023-12-26 05:52:15,120][123091] Updated weights for policy 0, policy_version 786655 (0.0009) [2023-12-26 05:52:15,168][123091] Updated weights for policy 0, policy_version 786665 (0.0009) [2023-12-26 05:52:15,509][123090] Updated weights for policy 1, policy_version 781124 (0.0009) [2023-12-26 05:52:15,565][123090] Updated weights for policy 1, policy_version 781134 (0.0010) [2023-12-26 05:52:15,625][123090] Updated weights for policy 1, policy_version 781144 (0.0009) [2023-12-26 05:52:16,019][123091] Updated weights for policy 0, policy_version 786675 (0.0008) [2023-12-26 05:52:16,083][123091] Updated weights for policy 0, policy_version 786685 (0.0008) [2023-12-26 05:52:16,144][123091] Updated weights for policy 0, policy_version 786695 (0.0009) [2023-12-26 05:52:16,371][123090] Updated weights for policy 1, policy_version 781154 (0.0009) [2023-12-26 05:52:16,430][123090] Updated weights for policy 1, policy_version 781164 (0.0008) [2023-12-26 05:52:16,489][123090] Updated weights for policy 1, policy_version 781174 (0.0008) [2023-12-26 05:52:16,537][123090] Updated weights for policy 1, policy_version 781184 (0.0009) [2023-12-26 05:52:16,952][123091] Updated weights for policy 0, policy_version 786705 (0.0009) [2023-12-26 05:52:17,014][123091] Updated weights for policy 0, policy_version 786715 (0.0005) [2023-12-26 05:52:17,075][123091] Updated weights for policy 0, policy_version 786725 (0.0006) [2023-12-26 05:52:17,143][123091] Updated weights for policy 0, policy_version 786735 (0.0006) [2023-12-26 05:52:17,295][123090] Updated weights for policy 1, policy_version 781194 (0.0008) [2023-12-26 05:52:17,363][123090] Updated weights for policy 1, policy_version 781204 (0.0008) [2023-12-26 05:52:17,432][123090] Updated weights for policy 1, policy_version 781214 (0.0009) [2023-12-26 05:52:17,945][123091] Updated weights for policy 0, policy_version 786745 (0.0010) [2023-12-26 05:52:17,991][123091] Updated weights for policy 0, policy_version 786755 (0.0010) [2023-12-26 05:52:18,039][123091] Updated weights for policy 0, policy_version 786765 (0.0010) [2023-12-26 05:52:18,241][123090] Updated weights for policy 1, policy_version 781224 (0.0009) [2023-12-26 05:52:18,297][123090] Updated weights for policy 1, policy_version 781234 (0.0009) [2023-12-26 05:52:18,367][123090] Updated weights for policy 1, policy_version 781244 (0.0010) [2023-12-26 05:52:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 401416192. Throughput: 0: 9137.0, 1: 8587.3. Samples: 401428688. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:18,784][121949] Avg episode reward: [(0, '5855.413'), (1, '5865.205')] [2023-12-26 05:52:18,848][123091] Updated weights for policy 0, policy_version 786775 (0.0007) [2023-12-26 05:52:18,911][123091] Updated weights for policy 0, policy_version 786785 (0.0009) [2023-12-26 05:52:18,959][123091] Updated weights for policy 0, policy_version 786795 (0.0008) [2023-12-26 05:52:19,169][123090] Updated weights for policy 1, policy_version 781254 (0.0007) [2023-12-26 05:52:19,239][123090] Updated weights for policy 1, policy_version 781264 (0.0006) [2023-12-26 05:52:19,299][123090] Updated weights for policy 1, policy_version 781274 (0.0010) [2023-12-26 05:52:19,788][123091] Updated weights for policy 0, policy_version 786805 (0.0011) [2023-12-26 05:52:19,860][123091] Updated weights for policy 0, policy_version 786815 (0.0010) [2023-12-26 05:52:19,928][123091] Updated weights for policy 0, policy_version 786825 (0.0009) [2023-12-26 05:52:20,053][123090] Updated weights for policy 1, policy_version 781284 (0.0011) [2023-12-26 05:52:20,118][123090] Updated weights for policy 1, policy_version 781294 (0.0011) [2023-12-26 05:52:20,179][123090] Updated weights for policy 1, policy_version 781304 (0.0011) [2023-12-26 05:52:20,706][123091] Updated weights for policy 0, policy_version 786835 (0.0010) [2023-12-26 05:52:20,775][123091] Updated weights for policy 0, policy_version 786845 (0.0011) [2023-12-26 05:52:20,844][123091] Updated weights for policy 0, policy_version 786855 (0.0011) [2023-12-26 05:52:21,034][123090] Updated weights for policy 1, policy_version 781314 (0.0009) [2023-12-26 05:52:21,102][123090] Updated weights for policy 1, policy_version 781324 (0.0010) [2023-12-26 05:52:21,174][123090] Updated weights for policy 1, policy_version 781334 (0.0010) [2023-12-26 05:52:21,246][123090] Updated weights for policy 1, policy_version 781344 (0.0006) [2023-12-26 05:52:21,710][123091] Updated weights for policy 0, policy_version 786865 (0.0011) [2023-12-26 05:52:21,795][123091] Updated weights for policy 0, policy_version 786876 (0.0010) [2023-12-26 05:52:21,852][123091] Updated weights for policy 0, policy_version 786886 (0.0011) [2023-12-26 05:52:21,913][123091] Updated weights for policy 0, policy_version 786896 (0.0011) [2023-12-26 05:52:22,009][123090] Updated weights for policy 1, policy_version 781354 (0.0006) [2023-12-26 05:52:22,070][123090] Updated weights for policy 1, policy_version 781364 (0.0006) [2023-12-26 05:52:22,128][123090] Updated weights for policy 1, policy_version 781374 (0.0008) [2023-12-26 05:52:22,742][123091] Updated weights for policy 0, policy_version 786906 (0.0011) [2023-12-26 05:52:22,816][123091] Updated weights for policy 0, policy_version 786916 (0.0011) [2023-12-26 05:52:22,887][123091] Updated weights for policy 0, policy_version 786926 (0.0011) [2023-12-26 05:52:22,960][123090] Updated weights for policy 1, policy_version 781384 (0.0008) [2023-12-26 05:52:23,024][123090] Updated weights for policy 1, policy_version 781394 (0.0009) [2023-12-26 05:52:23,091][123090] Updated weights for policy 1, policy_version 781404 (0.0008) [2023-12-26 05:52:23,691][123091] Updated weights for policy 0, policy_version 786936 (0.0008) [2023-12-26 05:52:23,759][123091] Updated weights for policy 0, policy_version 786946 (0.0010) [2023-12-26 05:52:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 401498112. Throughput: 0: 9056.0, 1: 8638.6. Samples: 401481396. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:23,785][121949] Avg episode reward: [(0, '5883.493'), (1, '5772.085')] [2023-12-26 05:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000781408_200040448.pth... [2023-12-26 05:52:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000780384_199778304.pth [2023-12-26 05:52:23,823][123091] Updated weights for policy 0, policy_version 786956 (0.0009) [2023-12-26 05:52:23,841][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000786960_201465856.pth... [2023-12-26 05:52:23,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000785904_201195520.pth [2023-12-26 05:52:23,892][123090] Updated weights for policy 1, policy_version 781414 (0.0007) [2023-12-26 05:52:23,941][123090] Updated weights for policy 1, policy_version 781424 (0.0005) [2023-12-26 05:52:24,002][123090] Updated weights for policy 1, policy_version 781434 (0.0007) [2023-12-26 05:52:24,663][123091] Updated weights for policy 0, policy_version 786966 (0.0011) [2023-12-26 05:52:24,737][123091] Updated weights for policy 0, policy_version 786976 (0.0010) [2023-12-26 05:52:24,762][123090] Updated weights for policy 1, policy_version 781444 (0.0008) [2023-12-26 05:52:24,807][123091] Updated weights for policy 0, policy_version 786986 (0.0008) [2023-12-26 05:52:24,819][123090] Updated weights for policy 1, policy_version 781454 (0.0006) [2023-12-26 05:52:24,884][123090] Updated weights for policy 1, policy_version 781464 (0.0006) [2023-12-26 05:52:25,564][123091] Updated weights for policy 0, policy_version 786996 (0.0006) [2023-12-26 05:52:25,592][123090] Updated weights for policy 1, policy_version 781474 (0.0006) [2023-12-26 05:52:25,631][123091] Updated weights for policy 0, policy_version 787006 (0.0005) [2023-12-26 05:52:25,662][123090] Updated weights for policy 1, policy_version 781484 (0.0008) [2023-12-26 05:52:25,691][123091] Updated weights for policy 0, policy_version 787016 (0.0005) [2023-12-26 05:52:25,720][123090] Updated weights for policy 1, policy_version 781494 (0.0009) [2023-12-26 05:52:25,775][123090] Updated weights for policy 1, policy_version 781504 (0.0007) [2023-12-26 05:52:26,457][123091] Updated weights for policy 0, policy_version 787026 (0.0009) [2023-12-26 05:52:26,522][123091] Updated weights for policy 0, policy_version 787036 (0.0011) [2023-12-26 05:52:26,574][123090] Updated weights for policy 1, policy_version 781514 (0.0008) [2023-12-26 05:52:26,584][123091] Updated weights for policy 0, policy_version 787046 (0.0007) [2023-12-26 05:52:26,630][123090] Updated weights for policy 1, policy_version 781524 (0.0008) [2023-12-26 05:52:26,638][123091] Updated weights for policy 0, policy_version 787056 (0.0008) [2023-12-26 05:52:26,691][123090] Updated weights for policy 1, policy_version 781534 (0.0007) [2023-12-26 05:52:27,444][123091] Updated weights for policy 0, policy_version 787066 (0.0011) [2023-12-26 05:52:27,468][123090] Updated weights for policy 1, policy_version 781544 (0.0005) [2023-12-26 05:52:27,507][123091] Updated weights for policy 0, policy_version 787076 (0.0011) [2023-12-26 05:52:27,535][123090] Updated weights for policy 1, policy_version 781554 (0.0006) [2023-12-26 05:52:27,573][123091] Updated weights for policy 0, policy_version 787086 (0.0011) [2023-12-26 05:52:27,595][123090] Updated weights for policy 1, policy_version 781564 (0.0006) [2023-12-26 05:52:28,298][123090] Updated weights for policy 1, policy_version 781574 (0.0006) [2023-12-26 05:52:28,374][123090] Updated weights for policy 1, policy_version 781584 (0.0008) [2023-12-26 05:52:28,377][123091] Updated weights for policy 0, policy_version 787096 (0.0008) [2023-12-26 05:52:28,439][123091] Updated weights for policy 0, policy_version 787106 (0.0005) [2023-12-26 05:52:28,440][123090] Updated weights for policy 1, policy_version 781594 (0.0010) [2023-12-26 05:52:28,493][123091] Updated weights for policy 0, policy_version 787116 (0.0006) [2023-12-26 05:52:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17800.3). Total num frames: 401596416. Throughput: 0: 9070.6, 1: 8666.8. Samples: 401587084. Policy #0 lag: (min: 31.0, avg: 31.3, max: 45.0) [2023-12-26 05:52:28,784][121949] Avg episode reward: [(0, '5963.326'), (1, '5762.522')] [2023-12-26 05:52:29,127][123091] Updated weights for policy 0, policy_version 787126 (0.0008) [2023-12-26 05:52:29,178][123091] Updated weights for policy 0, policy_version 787136 (0.0010) [2023-12-26 05:52:29,235][123091] Updated weights for policy 0, policy_version 787146 (0.0010) [2023-12-26 05:52:29,287][123090] Updated weights for policy 1, policy_version 781604 (0.0007) [2023-12-26 05:52:29,360][123090] Updated weights for policy 1, policy_version 781614 (0.0008) [2023-12-26 05:52:29,420][123090] Updated weights for policy 1, policy_version 781624 (0.0010) [2023-12-26 05:52:29,984][123091] Updated weights for policy 0, policy_version 787156 (0.0006) [2023-12-26 05:52:30,051][123091] Updated weights for policy 0, policy_version 787166 (0.0008) [2023-12-26 05:52:30,118][123091] Updated weights for policy 0, policy_version 787176 (0.0011) [2023-12-26 05:52:30,294][123090] Updated weights for policy 1, policy_version 781634 (0.0010) [2023-12-26 05:52:30,357][123090] Updated weights for policy 1, policy_version 781644 (0.0008) [2023-12-26 05:52:30,419][123090] Updated weights for policy 1, policy_version 781654 (0.0009) [2023-12-26 05:52:30,479][123090] Updated weights for policy 1, policy_version 781664 (0.0008) [2023-12-26 05:52:30,926][123091] Updated weights for policy 0, policy_version 787186 (0.0011) [2023-12-26 05:52:30,992][123091] Updated weights for policy 0, policy_version 787196 (0.0005) [2023-12-26 05:52:31,068][123091] Updated weights for policy 0, policy_version 787206 (0.0007) [2023-12-26 05:52:31,135][123091] Updated weights for policy 0, policy_version 787216 (0.0007) [2023-12-26 05:52:31,252][123090] Updated weights for policy 1, policy_version 781674 (0.0007) [2023-12-26 05:52:31,318][123090] Updated weights for policy 1, policy_version 781684 (0.0010) [2023-12-26 05:52:31,383][123090] Updated weights for policy 1, policy_version 781694 (0.0011) [2023-12-26 05:52:31,869][123091] Updated weights for policy 0, policy_version 787226 (0.0010) [2023-12-26 05:52:31,925][123091] Updated weights for policy 0, policy_version 787236 (0.0009) [2023-12-26 05:52:31,985][123091] Updated weights for policy 0, policy_version 787246 (0.0005) [2023-12-26 05:52:32,204][123090] Updated weights for policy 1, policy_version 781704 (0.0011) [2023-12-26 05:52:32,267][123090] Updated weights for policy 1, policy_version 781714 (0.0010) [2023-12-26 05:52:32,334][123090] Updated weights for policy 1, policy_version 781724 (0.0011) [2023-12-26 05:52:32,720][123091] Updated weights for policy 0, policy_version 787256 (0.0009) [2023-12-26 05:52:32,771][123091] Updated weights for policy 0, policy_version 787266 (0.0010) [2023-12-26 05:52:32,829][123091] Updated weights for policy 0, policy_version 787276 (0.0006) [2023-12-26 05:52:33,047][123090] Updated weights for policy 1, policy_version 781734 (0.0011) [2023-12-26 05:52:33,099][123090] Updated weights for policy 1, policy_version 781744 (0.0010) [2023-12-26 05:52:33,147][123090] Updated weights for policy 1, policy_version 781754 (0.0010) [2023-12-26 05:52:33,436][123091] Updated weights for policy 0, policy_version 787286 (0.0005) [2023-12-26 05:52:33,500][123091] Updated weights for policy 0, policy_version 787296 (0.0005) [2023-12-26 05:52:33,552][123091] Updated weights for policy 0, policy_version 787306 (0.0005) [2023-12-26 05:52:33,784][121949] Fps is (10 sec: 18840.7, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 401686528. Throughput: 0: 9077.6, 1: 8771.0. Samples: 401697696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:33,786][121949] Avg episode reward: [(0, '5853.188'), (1, '5759.752')] [2023-12-26 05:52:33,925][123090] Updated weights for policy 1, policy_version 781764 (0.0008) [2023-12-26 05:52:33,994][123090] Updated weights for policy 1, policy_version 781774 (0.0005) [2023-12-26 05:52:34,059][123090] Updated weights for policy 1, policy_version 781784 (0.0006) [2023-12-26 05:52:34,191][123091] Updated weights for policy 0, policy_version 787316 (0.0008) [2023-12-26 05:52:34,251][123091] Updated weights for policy 0, policy_version 787326 (0.0011) [2023-12-26 05:52:34,305][123091] Updated weights for policy 0, policy_version 787336 (0.0010) [2023-12-26 05:52:34,787][123090] Updated weights for policy 1, policy_version 781794 (0.0006) [2023-12-26 05:52:34,856][123090] Updated weights for policy 1, policy_version 781804 (0.0008) [2023-12-26 05:52:34,916][123090] Updated weights for policy 1, policy_version 781814 (0.0006) [2023-12-26 05:52:34,979][123090] Updated weights for policy 1, policy_version 781824 (0.0005) [2023-12-26 05:52:35,103][123091] Updated weights for policy 0, policy_version 787346 (0.0007) [2023-12-26 05:52:35,155][123091] Updated weights for policy 0, policy_version 787356 (0.0010) [2023-12-26 05:52:35,202][123091] Updated weights for policy 0, policy_version 787366 (0.0010) [2023-12-26 05:52:35,254][123091] Updated weights for policy 0, policy_version 787376 (0.0008) [2023-12-26 05:52:35,728][123090] Updated weights for policy 1, policy_version 781834 (0.0010) [2023-12-26 05:52:35,779][123090] Updated weights for policy 1, policy_version 781844 (0.0010) [2023-12-26 05:52:35,839][123090] Updated weights for policy 1, policy_version 781854 (0.0007) [2023-12-26 05:52:36,012][123091] Updated weights for policy 0, policy_version 787386 (0.0007) [2023-12-26 05:52:36,078][123091] Updated weights for policy 0, policy_version 787396 (0.0005) [2023-12-26 05:52:36,147][123091] Updated weights for policy 0, policy_version 787406 (0.0008) [2023-12-26 05:52:36,687][123090] Updated weights for policy 1, policy_version 781864 (0.0010) [2023-12-26 05:52:36,757][123090] Updated weights for policy 1, policy_version 781874 (0.0011) [2023-12-26 05:52:36,800][123091] Updated weights for policy 0, policy_version 787416 (0.0005) [2023-12-26 05:52:36,824][123090] Updated weights for policy 1, policy_version 781884 (0.0011) [2023-12-26 05:52:36,853][123091] Updated weights for policy 0, policy_version 787426 (0.0006) [2023-12-26 05:52:36,907][123091] Updated weights for policy 0, policy_version 787436 (0.0005) [2023-12-26 05:52:37,594][123091] Updated weights for policy 0, policy_version 787446 (0.0007) [2023-12-26 05:52:37,622][123090] Updated weights for policy 1, policy_version 781894 (0.0011) [2023-12-26 05:52:37,661][123091] Updated weights for policy 0, policy_version 787456 (0.0007) [2023-12-26 05:52:37,693][123090] Updated weights for policy 1, policy_version 781904 (0.0010) [2023-12-26 05:52:37,721][123091] Updated weights for policy 0, policy_version 787466 (0.0008) [2023-12-26 05:52:37,764][123090] Updated weights for policy 1, policy_version 781914 (0.0011) [2023-12-26 05:52:38,451][123091] Updated weights for policy 0, policy_version 787476 (0.0008) [2023-12-26 05:52:38,513][123091] Updated weights for policy 0, policy_version 787486 (0.0010) [2023-12-26 05:52:38,562][123090] Updated weights for policy 1, policy_version 781924 (0.0008) [2023-12-26 05:52:38,572][123091] Updated weights for policy 0, policy_version 787496 (0.0007) [2023-12-26 05:52:38,614][123090] Updated weights for policy 1, policy_version 781934 (0.0005) [2023-12-26 05:52:38,672][123090] Updated weights for policy 1, policy_version 781944 (0.0006) [2023-12-26 05:52:38,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 401784832. Throughput: 0: 9126.2, 1: 8810.9. Samples: 401754536. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:38,786][121949] Avg episode reward: [(0, '5967.572'), (1, '5710.809')] [2023-12-26 05:52:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000781952_200179712.pth... [2023-12-26 05:52:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000787504_201605120.pth... [2023-12-26 05:52:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000780896_199909376.pth [2023-12-26 05:52:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000786448_201334784.pth [2023-12-26 05:52:39,429][123091] Updated weights for policy 0, policy_version 787506 (0.0007) [2023-12-26 05:52:39,444][123090] Updated weights for policy 1, policy_version 781954 (0.0007) [2023-12-26 05:52:39,491][123091] Updated weights for policy 0, policy_version 787516 (0.0007) [2023-12-26 05:52:39,508][123090] Updated weights for policy 1, policy_version 781964 (0.0011) [2023-12-26 05:52:39,546][123091] Updated weights for policy 0, policy_version 787526 (0.0008) [2023-12-26 05:52:39,568][123090] Updated weights for policy 1, policy_version 781974 (0.0011) [2023-12-26 05:52:39,597][123091] Updated weights for policy 0, policy_version 787536 (0.0009) [2023-12-26 05:52:39,632][123090] Updated weights for policy 1, policy_version 781984 (0.0009) [2023-12-26 05:52:40,428][123091] Updated weights for policy 0, policy_version 787546 (0.0010) [2023-12-26 05:52:40,492][123091] Updated weights for policy 0, policy_version 787556 (0.0009) [2023-12-26 05:52:40,508][123090] Updated weights for policy 1, policy_version 781994 (0.0008) [2023-12-26 05:52:40,554][123091] Updated weights for policy 0, policy_version 787566 (0.0010) [2023-12-26 05:52:40,571][123090] Updated weights for policy 1, policy_version 782004 (0.0008) [2023-12-26 05:52:40,640][123090] Updated weights for policy 1, policy_version 782014 (0.0010) [2023-12-26 05:52:41,350][123091] Updated weights for policy 0, policy_version 787576 (0.0009) [2023-12-26 05:52:41,432][123091] Updated weights for policy 0, policy_version 787586 (0.0008) [2023-12-26 05:52:41,503][123091] Updated weights for policy 0, policy_version 787596 (0.0008) [2023-12-26 05:52:41,540][123090] Updated weights for policy 1, policy_version 782024 (0.0007) [2023-12-26 05:52:41,609][123090] Updated weights for policy 1, policy_version 782034 (0.0009) [2023-12-26 05:52:41,694][123090] Updated weights for policy 1, policy_version 782044 (0.0009) [2023-12-26 05:52:42,290][123091] Updated weights for policy 0, policy_version 787606 (0.0008) [2023-12-26 05:52:42,361][123091] Updated weights for policy 0, policy_version 787616 (0.0008) [2023-12-26 05:52:42,414][123091] Updated weights for policy 0, policy_version 787626 (0.0007) [2023-12-26 05:52:42,514][123090] Updated weights for policy 1, policy_version 782054 (0.0009) [2023-12-26 05:52:42,574][123090] Updated weights for policy 1, policy_version 782064 (0.0009) [2023-12-26 05:52:42,634][123090] Updated weights for policy 1, policy_version 782075 (0.0010) [2023-12-26 05:52:43,232][123091] Updated weights for policy 0, policy_version 787636 (0.0009) [2023-12-26 05:52:43,290][123091] Updated weights for policy 0, policy_version 787646 (0.0006) [2023-12-26 05:52:43,338][123091] Updated weights for policy 0, policy_version 787656 (0.0005) [2023-12-26 05:52:43,492][123090] Updated weights for policy 1, policy_version 782085 (0.0006) [2023-12-26 05:52:43,545][123090] Updated weights for policy 1, policy_version 782095 (0.0005) [2023-12-26 05:52:43,601][123090] Updated weights for policy 1, policy_version 782105 (0.0005) [2023-12-26 05:52:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 401866752. Throughput: 0: 9075.9, 1: 8817.8. Samples: 401858768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:43,785][121949] Avg episode reward: [(0, '6048.793'), (1, '5733.256')] [2023-12-26 05:52:44,135][123091] Updated weights for policy 0, policy_version 787666 (0.0006) [2023-12-26 05:52:44,208][123091] Updated weights for policy 0, policy_version 787676 (0.0008) [2023-12-26 05:52:44,266][123091] Updated weights for policy 0, policy_version 787686 (0.0011) [2023-12-26 05:52:44,293][123090] Updated weights for policy 1, policy_version 782115 (0.0008) [2023-12-26 05:52:44,322][123091] Updated weights for policy 0, policy_version 787696 (0.0010) [2023-12-26 05:52:44,349][123090] Updated weights for policy 1, policy_version 782125 (0.0006) [2023-12-26 05:52:44,400][123090] Updated weights for policy 1, policy_version 782135 (0.0005) [2023-12-26 05:52:45,013][123091] Updated weights for policy 0, policy_version 787706 (0.0010) [2023-12-26 05:52:45,043][123090] Updated weights for policy 1, policy_version 782145 (0.0005) [2023-12-26 05:52:45,074][123091] Updated weights for policy 0, policy_version 787716 (0.0011) [2023-12-26 05:52:45,109][123090] Updated weights for policy 1, policy_version 782155 (0.0005) [2023-12-26 05:52:45,145][123091] Updated weights for policy 0, policy_version 787726 (0.0011) [2023-12-26 05:52:45,175][123090] Updated weights for policy 1, policy_version 782165 (0.0010) [2023-12-26 05:52:45,244][123090] Updated weights for policy 1, policy_version 782175 (0.0010) [2023-12-26 05:52:45,938][123091] Updated weights for policy 0, policy_version 787736 (0.0007) [2023-12-26 05:52:45,974][123090] Updated weights for policy 1, policy_version 782185 (0.0009) [2023-12-26 05:52:46,000][123091] Updated weights for policy 0, policy_version 787746 (0.0005) [2023-12-26 05:52:46,022][123090] Updated weights for policy 1, policy_version 782195 (0.0009) [2023-12-26 05:52:46,059][123091] Updated weights for policy 0, policy_version 787756 (0.0006) [2023-12-26 05:52:46,071][123090] Updated weights for policy 1, policy_version 782205 (0.0009) [2023-12-26 05:52:46,698][123091] Updated weights for policy 0, policy_version 787766 (0.0009) [2023-12-26 05:52:46,761][123091] Updated weights for policy 0, policy_version 787776 (0.0010) [2023-12-26 05:52:46,835][123091] Updated weights for policy 0, policy_version 787786 (0.0010) [2023-12-26 05:52:46,986][123090] Updated weights for policy 1, policy_version 782215 (0.0010) [2023-12-26 05:52:47,038][123090] Updated weights for policy 1, policy_version 782225 (0.0009) [2023-12-26 05:52:47,098][123090] Updated weights for policy 1, policy_version 782235 (0.0009) [2023-12-26 05:52:47,484][123091] Updated weights for policy 0, policy_version 787796 (0.0008) [2023-12-26 05:52:47,532][123091] Updated weights for policy 0, policy_version 787806 (0.0005) [2023-12-26 05:52:47,581][123091] Updated weights for policy 0, policy_version 787816 (0.0005) [2023-12-26 05:52:47,938][123090] Updated weights for policy 1, policy_version 782245 (0.0010) [2023-12-26 05:52:48,003][123090] Updated weights for policy 1, policy_version 782255 (0.0010) [2023-12-26 05:52:48,065][123090] Updated weights for policy 1, policy_version 782265 (0.0008) [2023-12-26 05:52:48,289][123091] Updated weights for policy 0, policy_version 787826 (0.0005) [2023-12-26 05:52:48,360][123091] Updated weights for policy 0, policy_version 787836 (0.0008) [2023-12-26 05:52:48,420][123091] Updated weights for policy 0, policy_version 787846 (0.0009) [2023-12-26 05:52:48,479][123091] Updated weights for policy 0, policy_version 787856 (0.0006) [2023-12-26 05:52:48,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 401956864. Throughput: 0: 9157.1, 1: 8887.2. Samples: 401969444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:48,784][121949] Avg episode reward: [(0, '5881.988'), (1, '5801.277')] [2023-12-26 05:52:48,963][123090] Updated weights for policy 1, policy_version 782275 (0.0010) [2023-12-26 05:52:49,012][123090] Updated weights for policy 1, policy_version 782285 (0.0009) [2023-12-26 05:52:49,076][123090] Updated weights for policy 1, policy_version 782295 (0.0010) [2023-12-26 05:52:49,233][123091] Updated weights for policy 0, policy_version 787866 (0.0008) [2023-12-26 05:52:49,294][123091] Updated weights for policy 0, policy_version 787876 (0.0009) [2023-12-26 05:52:49,363][123091] Updated weights for policy 0, policy_version 787886 (0.0009) [2023-12-26 05:52:49,971][123090] Updated weights for policy 1, policy_version 782305 (0.0009) [2023-12-26 05:52:50,030][123090] Updated weights for policy 1, policy_version 782315 (0.0008) [2023-12-26 05:52:50,100][123090] Updated weights for policy 1, policy_version 782325 (0.0009) [2023-12-26 05:52:50,170][123090] Updated weights for policy 1, policy_version 782335 (0.0007) [2023-12-26 05:52:50,213][123091] Updated weights for policy 0, policy_version 787897 (0.0010) [2023-12-26 05:52:50,276][123091] Updated weights for policy 0, policy_version 787907 (0.0009) [2023-12-26 05:52:50,347][123091] Updated weights for policy 0, policy_version 787917 (0.0006) [2023-12-26 05:52:50,898][123090] Updated weights for policy 1, policy_version 782345 (0.0009) [2023-12-26 05:52:50,964][123090] Updated weights for policy 1, policy_version 782355 (0.0011) [2023-12-26 05:52:51,030][123091] Updated weights for policy 0, policy_version 787927 (0.0008) [2023-12-26 05:52:51,037][123090] Updated weights for policy 1, policy_version 782365 (0.0011) [2023-12-26 05:52:51,098][123091] Updated weights for policy 0, policy_version 787937 (0.0009) [2023-12-26 05:52:51,160][123091] Updated weights for policy 0, policy_version 787947 (0.0009) [2023-12-26 05:52:51,861][123090] Updated weights for policy 1, policy_version 782375 (0.0010) [2023-12-26 05:52:51,930][123090] Updated weights for policy 1, policy_version 782385 (0.0011) [2023-12-26 05:52:51,991][123090] Updated weights for policy 1, policy_version 782395 (0.0008) [2023-12-26 05:52:52,001][123091] Updated weights for policy 0, policy_version 787957 (0.0008) [2023-12-26 05:52:52,062][123091] Updated weights for policy 0, policy_version 787967 (0.0010) [2023-12-26 05:52:52,158][123091] Updated weights for policy 0, policy_version 787977 (0.0009) [2023-12-26 05:52:52,812][123090] Updated weights for policy 1, policy_version 782405 (0.0009) [2023-12-26 05:52:52,864][123090] Updated weights for policy 1, policy_version 782415 (0.0009) [2023-12-26 05:52:52,921][123090] Updated weights for policy 1, policy_version 782425 (0.0009) [2023-12-26 05:52:52,972][123091] Updated weights for policy 0, policy_version 787987 (0.0010) [2023-12-26 05:52:53,042][123091] Updated weights for policy 0, policy_version 787997 (0.0009) [2023-12-26 05:52:53,098][123091] Updated weights for policy 0, policy_version 788007 (0.0009) [2023-12-26 05:52:53,623][123090] Updated weights for policy 1, policy_version 782435 (0.0008) [2023-12-26 05:52:53,675][123090] Updated weights for policy 1, policy_version 782446 (0.0007) [2023-12-26 05:52:53,731][123090] Updated weights for policy 1, policy_version 782456 (0.0008) [2023-12-26 05:52:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.5, 300 sec: 17855.9). Total num frames: 402046976. Throughput: 0: 9166.2, 1: 8840.5. Samples: 402022676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:53,784][121949] Avg episode reward: [(0, '5771.822'), (1, '5798.254')] [2023-12-26 05:52:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000788016_201736192.pth... [2023-12-26 05:52:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000782464_200310784.pth... [2023-12-26 05:52:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000781408_200040448.pth [2023-12-26 05:52:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000786960_201465856.pth [2023-12-26 05:52:53,828][123091] Updated weights for policy 0, policy_version 788017 (0.0007) [2023-12-26 05:52:53,888][123091] Updated weights for policy 0, policy_version 788027 (0.0009) [2023-12-26 05:52:53,936][123091] Updated weights for policy 0, policy_version 788037 (0.0008) [2023-12-26 05:52:53,988][123091] Updated weights for policy 0, policy_version 788047 (0.0005) [2023-12-26 05:52:54,518][123090] Updated weights for policy 1, policy_version 782466 (0.0009) [2023-12-26 05:52:54,578][123090] Updated weights for policy 1, policy_version 782476 (0.0007) [2023-12-26 05:52:54,629][123090] Updated weights for policy 1, policy_version 782486 (0.0005) [2023-12-26 05:52:54,679][123090] Updated weights for policy 1, policy_version 782496 (0.0005) [2023-12-26 05:52:54,711][123091] Updated weights for policy 0, policy_version 788057 (0.0006) [2023-12-26 05:52:54,772][123091] Updated weights for policy 0, policy_version 788067 (0.0005) [2023-12-26 05:52:54,830][123091] Updated weights for policy 0, policy_version 788077 (0.0006) [2023-12-26 05:52:55,453][123091] Updated weights for policy 0, policy_version 788087 (0.0005) [2023-12-26 05:52:55,507][123091] Updated weights for policy 0, policy_version 788097 (0.0006) [2023-12-26 05:52:55,533][123090] Updated weights for policy 1, policy_version 782506 (0.0010) [2023-12-26 05:52:55,558][123091] Updated weights for policy 0, policy_version 788107 (0.0009) [2023-12-26 05:52:55,578][123090] Updated weights for policy 1, policy_version 782516 (0.0008) [2023-12-26 05:52:55,623][123090] Updated weights for policy 1, policy_version 782526 (0.0007) [2023-12-26 05:52:56,231][123091] Updated weights for policy 0, policy_version 788117 (0.0006) [2023-12-26 05:52:56,278][123091] Updated weights for policy 0, policy_version 788127 (0.0006) [2023-12-26 05:52:56,324][123091] Updated weights for policy 0, policy_version 788137 (0.0005) [2023-12-26 05:52:56,338][123090] Updated weights for policy 1, policy_version 782536 (0.0005) [2023-12-26 05:52:56,411][123090] Updated weights for policy 1, policy_version 782546 (0.0005) [2023-12-26 05:52:56,473][123090] Updated weights for policy 1, policy_version 782556 (0.0005) [2023-12-26 05:52:56,859][123091] Updated weights for policy 0, policy_version 788147 (0.0005) [2023-12-26 05:52:56,910][123091] Updated weights for policy 0, policy_version 788157 (0.0005) [2023-12-26 05:52:56,958][123091] Updated weights for policy 0, policy_version 788167 (0.0005) [2023-12-26 05:52:57,165][123090] Updated weights for policy 1, policy_version 782566 (0.0008) [2023-12-26 05:52:57,232][123090] Updated weights for policy 1, policy_version 782576 (0.0010) [2023-12-26 05:52:57,307][123090] Updated weights for policy 1, policy_version 782586 (0.0008) [2023-12-26 05:52:57,722][123091] Updated weights for policy 0, policy_version 788177 (0.0007) [2023-12-26 05:52:57,787][123091] Updated weights for policy 0, policy_version 788187 (0.0005) [2023-12-26 05:52:57,857][123091] Updated weights for policy 0, policy_version 788197 (0.0006) [2023-12-26 05:52:57,922][123091] Updated weights for policy 0, policy_version 788207 (0.0011) [2023-12-26 05:52:58,156][123090] Updated weights for policy 1, policy_version 782596 (0.0009) [2023-12-26 05:52:58,222][123090] Updated weights for policy 1, policy_version 782606 (0.0006) [2023-12-26 05:52:58,288][123090] Updated weights for policy 1, policy_version 782616 (0.0010) [2023-12-26 05:52:58,667][123091] Updated weights for policy 0, policy_version 788217 (0.0008) [2023-12-26 05:52:58,735][123091] Updated weights for policy 0, policy_version 788227 (0.0013) [2023-12-26 05:52:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.6, 300 sec: 17828.0). Total num frames: 402137088. Throughput: 0: 9211.3, 1: 8834.0. Samples: 402135096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:52:58,785][121949] Avg episode reward: [(0, '5840.289'), (1, '5790.547')] [2023-12-26 05:52:58,806][123091] Updated weights for policy 0, policy_version 788237 (0.0011) [2023-12-26 05:52:59,135][123090] Updated weights for policy 1, policy_version 782626 (0.0010) [2023-12-26 05:52:59,194][123090] Updated weights for policy 1, policy_version 782636 (0.0010) [2023-12-26 05:52:59,252][123090] Updated weights for policy 1, policy_version 782646 (0.0010) [2023-12-26 05:52:59,305][123090] Updated weights for policy 1, policy_version 782656 (0.0006) [2023-12-26 05:52:59,550][123091] Updated weights for policy 0, policy_version 788247 (0.0011) [2023-12-26 05:52:59,616][123091] Updated weights for policy 0, policy_version 788257 (0.0009) [2023-12-26 05:52:59,686][123091] Updated weights for policy 0, policy_version 788267 (0.0010) [2023-12-26 05:53:00,137][123090] Updated weights for policy 1, policy_version 782666 (0.0006) [2023-12-26 05:53:00,191][123090] Updated weights for policy 1, policy_version 782676 (0.0007) [2023-12-26 05:53:00,246][123090] Updated weights for policy 1, policy_version 782686 (0.0010) [2023-12-26 05:53:00,484][123091] Updated weights for policy 0, policy_version 788277 (0.0010) [2023-12-26 05:53:00,549][123091] Updated weights for policy 0, policy_version 788287 (0.0007) [2023-12-26 05:53:00,601][123091] Updated weights for policy 0, policy_version 788297 (0.0005) [2023-12-26 05:53:01,020][123090] Updated weights for policy 1, policy_version 782696 (0.0010) [2023-12-26 05:53:01,089][123090] Updated weights for policy 1, policy_version 782706 (0.0009) [2023-12-26 05:53:01,152][123090] Updated weights for policy 1, policy_version 782716 (0.0007) [2023-12-26 05:53:01,294][123091] Updated weights for policy 0, policy_version 788307 (0.0007) [2023-12-26 05:53:01,350][123091] Updated weights for policy 0, policy_version 788317 (0.0010) [2023-12-26 05:53:01,419][123091] Updated weights for policy 0, policy_version 788327 (0.0008) [2023-12-26 05:53:01,950][123090] Updated weights for policy 1, policy_version 782726 (0.0008) [2023-12-26 05:53:02,011][123090] Updated weights for policy 1, policy_version 782736 (0.0009) [2023-12-26 05:53:02,071][123090] Updated weights for policy 1, policy_version 782746 (0.0009) [2023-12-26 05:53:02,221][123091] Updated weights for policy 0, policy_version 788337 (0.0010) [2023-12-26 05:53:02,291][123091] Updated weights for policy 0, policy_version 788347 (0.0011) [2023-12-26 05:53:02,360][123091] Updated weights for policy 0, policy_version 788357 (0.0008) [2023-12-26 05:53:02,426][123091] Updated weights for policy 0, policy_version 788367 (0.0006) [2023-12-26 05:53:02,833][123090] Updated weights for policy 1, policy_version 782756 (0.0008) [2023-12-26 05:53:02,902][123090] Updated weights for policy 1, policy_version 782766 (0.0005) [2023-12-26 05:53:02,971][123090] Updated weights for policy 1, policy_version 782776 (0.0008) [2023-12-26 05:53:03,124][123091] Updated weights for policy 0, policy_version 788377 (0.0005) [2023-12-26 05:53:03,182][123091] Updated weights for policy 0, policy_version 788387 (0.0005) [2023-12-26 05:53:03,233][123091] Updated weights for policy 0, policy_version 788397 (0.0005) [2023-12-26 05:53:03,740][123090] Updated weights for policy 1, policy_version 782786 (0.0008) [2023-12-26 05:53:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 402227200. Throughput: 0: 9309.9, 1: 8822.9. Samples: 402244668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:03,785][121949] Avg episode reward: [(0, '5824.326'), (1, '5669.109')] [2023-12-26 05:53:03,796][123090] Updated weights for policy 1, policy_version 782796 (0.0005) [2023-12-26 05:53:03,855][123091] Updated weights for policy 0, policy_version 788408 (0.0007) [2023-12-26 05:53:03,862][123090] Updated weights for policy 1, policy_version 782806 (0.0008) [2023-12-26 05:53:03,911][123091] Updated weights for policy 0, policy_version 788418 (0.0007) [2023-12-26 05:53:03,925][123090] Updated weights for policy 1, policy_version 782816 (0.0011) [2023-12-26 05:53:03,973][123091] Updated weights for policy 0, policy_version 788428 (0.0010) [2023-12-26 05:53:04,739][123090] Updated weights for policy 1, policy_version 782826 (0.0010) [2023-12-26 05:53:04,741][123091] Updated weights for policy 0, policy_version 788438 (0.0008) [2023-12-26 05:53:04,796][123090] Updated weights for policy 1, policy_version 782836 (0.0010) [2023-12-26 05:53:04,796][123091] Updated weights for policy 0, policy_version 788448 (0.0006) [2023-12-26 05:53:04,851][123090] Updated weights for policy 1, policy_version 782846 (0.0010) [2023-12-26 05:53:04,851][123091] Updated weights for policy 0, policy_version 788458 (0.0005) [2023-12-26 05:53:05,466][123091] Updated weights for policy 0, policy_version 788468 (0.0005) [2023-12-26 05:53:05,515][123091] Updated weights for policy 0, policy_version 788478 (0.0005) [2023-12-26 05:53:05,570][123091] Updated weights for policy 0, policy_version 788488 (0.0005) [2023-12-26 05:53:05,664][123090] Updated weights for policy 1, policy_version 782856 (0.0009) [2023-12-26 05:53:05,728][123090] Updated weights for policy 1, policy_version 782866 (0.0009) [2023-12-26 05:53:05,776][123090] Updated weights for policy 1, policy_version 782876 (0.0008) [2023-12-26 05:53:06,274][123091] Updated weights for policy 0, policy_version 788498 (0.0009) [2023-12-26 05:53:06,345][123091] Updated weights for policy 0, policy_version 788508 (0.0006) [2023-12-26 05:53:06,406][123091] Updated weights for policy 0, policy_version 788518 (0.0005) [2023-12-26 05:53:06,460][123091] Updated weights for policy 0, policy_version 788528 (0.0010) [2023-12-26 05:53:06,524][123090] Updated weights for policy 1, policy_version 782886 (0.0010) [2023-12-26 05:53:06,582][123090] Updated weights for policy 1, policy_version 782896 (0.0008) [2023-12-26 05:53:06,642][123090] Updated weights for policy 1, policy_version 782906 (0.0006) [2023-12-26 05:53:07,249][123091] Updated weights for policy 0, policy_version 788538 (0.0010) [2023-12-26 05:53:07,300][123091] Updated weights for policy 0, policy_version 788548 (0.0010) [2023-12-26 05:53:07,319][123090] Updated weights for policy 1, policy_version 782916 (0.0005) [2023-12-26 05:53:07,348][123091] Updated weights for policy 0, policy_version 788558 (0.0011) [2023-12-26 05:53:07,378][123090] Updated weights for policy 1, policy_version 782926 (0.0010) [2023-12-26 05:53:07,441][123090] Updated weights for policy 1, policy_version 782936 (0.0010) [2023-12-26 05:53:08,182][123091] Updated weights for policy 0, policy_version 788568 (0.0010) [2023-12-26 05:53:08,229][123091] Updated weights for policy 0, policy_version 788578 (0.0010) [2023-12-26 05:53:08,267][123090] Updated weights for policy 1, policy_version 782946 (0.0010) [2023-12-26 05:53:08,272][123091] Updated weights for policy 0, policy_version 788588 (0.0010) [2023-12-26 05:53:08,326][123090] Updated weights for policy 1, policy_version 782956 (0.0010) [2023-12-26 05:53:08,394][123090] Updated weights for policy 1, policy_version 782966 (0.0011) [2023-12-26 05:53:08,462][123090] Updated weights for policy 1, policy_version 782976 (0.0008) [2023-12-26 05:53:08,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 402325504. Throughput: 0: 9374.3, 1: 8831.2. Samples: 402300648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:08,785][121949] Avg episode reward: [(0, '5781.137'), (1, '5686.453')] [2023-12-26 05:53:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000782976_200441856.pth... [2023-12-26 05:53:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000788592_201883648.pth... [2023-12-26 05:53:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000781952_200179712.pth [2023-12-26 05:53:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000787504_201605120.pth [2023-12-26 05:53:09,146][123090] Updated weights for policy 1, policy_version 782986 (0.0005) [2023-12-26 05:53:09,207][123090] Updated weights for policy 1, policy_version 782996 (0.0009) [2023-12-26 05:53:09,212][123091] Updated weights for policy 0, policy_version 788598 (0.0009) [2023-12-26 05:53:09,278][123090] Updated weights for policy 1, policy_version 783006 (0.0008) [2023-12-26 05:53:09,279][123091] Updated weights for policy 0, policy_version 788608 (0.0010) [2023-12-26 05:53:09,331][123091] Updated weights for policy 0, policy_version 788618 (0.0009) [2023-12-26 05:53:10,116][123091] Updated weights for policy 0, policy_version 788628 (0.0008) [2023-12-26 05:53:10,148][123090] Updated weights for policy 1, policy_version 783016 (0.0009) [2023-12-26 05:53:10,177][123091] Updated weights for policy 0, policy_version 788638 (0.0009) [2023-12-26 05:53:10,221][123090] Updated weights for policy 1, policy_version 783026 (0.0007) [2023-12-26 05:53:10,242][123091] Updated weights for policy 0, policy_version 788648 (0.0007) [2023-12-26 05:53:10,289][123090] Updated weights for policy 1, policy_version 783036 (0.0009) [2023-12-26 05:53:10,879][123091] Updated weights for policy 0, policy_version 788658 (0.0008) [2023-12-26 05:53:10,926][123091] Updated weights for policy 0, policy_version 788668 (0.0010) [2023-12-26 05:53:10,974][123091] Updated weights for policy 0, policy_version 788678 (0.0010) [2023-12-26 05:53:11,030][123091] Updated weights for policy 0, policy_version 788688 (0.0011) [2023-12-26 05:53:11,167][123090] Updated weights for policy 1, policy_version 783046 (0.0008) [2023-12-26 05:53:11,239][123090] Updated weights for policy 1, policy_version 783056 (0.0009) [2023-12-26 05:53:11,307][123090] Updated weights for policy 1, policy_version 783066 (0.0009) [2023-12-26 05:53:11,871][123091] Updated weights for policy 0, policy_version 788698 (0.0010) [2023-12-26 05:53:11,939][123091] Updated weights for policy 0, policy_version 788708 (0.0010) [2023-12-26 05:53:12,001][123091] Updated weights for policy 0, policy_version 788718 (0.0009) [2023-12-26 05:53:12,179][123090] Updated weights for policy 1, policy_version 783076 (0.0009) [2023-12-26 05:53:12,233][123090] Updated weights for policy 1, policy_version 783086 (0.0009) [2023-12-26 05:53:12,305][123090] Updated weights for policy 1, policy_version 783096 (0.0010) [2023-12-26 05:53:12,806][123091] Updated weights for policy 0, policy_version 788728 (0.0010) [2023-12-26 05:53:12,858][123091] Updated weights for policy 0, policy_version 788738 (0.0010) [2023-12-26 05:53:12,913][123091] Updated weights for policy 0, policy_version 788748 (0.0010) [2023-12-26 05:53:13,166][123090] Updated weights for policy 1, policy_version 783106 (0.0009) [2023-12-26 05:53:13,231][123090] Updated weights for policy 1, policy_version 783116 (0.0007) [2023-12-26 05:53:13,294][123090] Updated weights for policy 1, policy_version 783126 (0.0010) [2023-12-26 05:53:13,353][123090] Updated weights for policy 1, policy_version 783136 (0.0010) [2023-12-26 05:53:13,745][123091] Updated weights for policy 0, policy_version 788758 (0.0010) [2023-12-26 05:53:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 402407424. Throughput: 0: 9383.0, 1: 8778.0. Samples: 402404332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:13,785][121949] Avg episode reward: [(0, '5955.064'), (1, '5667.986')] [2023-12-26 05:53:13,793][123091] Updated weights for policy 0, policy_version 788768 (0.0010) [2023-12-26 05:53:13,852][123091] Updated weights for policy 0, policy_version 788778 (0.0010) [2023-12-26 05:53:14,164][123090] Updated weights for policy 1, policy_version 783146 (0.0009) [2023-12-26 05:53:14,230][123090] Updated weights for policy 1, policy_version 783157 (0.0008) [2023-12-26 05:53:14,277][123090] Updated weights for policy 1, policy_version 783167 (0.0005) [2023-12-26 05:53:14,687][123091] Updated weights for policy 0, policy_version 788788 (0.0010) [2023-12-26 05:53:14,744][123091] Updated weights for policy 0, policy_version 788798 (0.0009) [2023-12-26 05:53:14,804][123091] Updated weights for policy 0, policy_version 788808 (0.0008) [2023-12-26 05:53:15,015][123090] Updated weights for policy 1, policy_version 783177 (0.0007) [2023-12-26 05:53:15,076][123090] Updated weights for policy 1, policy_version 783187 (0.0011) [2023-12-26 05:53:15,145][123090] Updated weights for policy 1, policy_version 783197 (0.0008) [2023-12-26 05:53:15,631][123091] Updated weights for policy 0, policy_version 788818 (0.0010) [2023-12-26 05:53:15,693][123091] Updated weights for policy 0, policy_version 788828 (0.0008) [2023-12-26 05:53:15,754][123091] Updated weights for policy 0, policy_version 788838 (0.0010) [2023-12-26 05:53:15,812][123091] Updated weights for policy 0, policy_version 788848 (0.0009) [2023-12-26 05:53:15,851][123090] Updated weights for policy 1, policy_version 783207 (0.0006) [2023-12-26 05:53:15,907][123090] Updated weights for policy 1, policy_version 783217 (0.0010) [2023-12-26 05:53:15,960][123090] Updated weights for policy 1, policy_version 783227 (0.0010) [2023-12-26 05:53:16,640][123091] Updated weights for policy 0, policy_version 788858 (0.0006) [2023-12-26 05:53:16,669][123090] Updated weights for policy 1, policy_version 783237 (0.0009) [2023-12-26 05:53:16,695][123091] Updated weights for policy 0, policy_version 788868 (0.0006) [2023-12-26 05:53:16,738][123090] Updated weights for policy 1, policy_version 783247 (0.0008) [2023-12-26 05:53:16,750][123091] Updated weights for policy 0, policy_version 788878 (0.0006) [2023-12-26 05:53:16,797][123090] Updated weights for policy 1, policy_version 783257 (0.0005) [2023-12-26 05:53:17,508][123091] Updated weights for policy 0, policy_version 788888 (0.0010) [2023-12-26 05:53:17,534][123090] Updated weights for policy 1, policy_version 783267 (0.0005) [2023-12-26 05:53:17,557][123091] Updated weights for policy 0, policy_version 788898 (0.0008) [2023-12-26 05:53:17,598][123090] Updated weights for policy 1, policy_version 783277 (0.0005) [2023-12-26 05:53:17,605][123091] Updated weights for policy 0, policy_version 788908 (0.0008) [2023-12-26 05:53:17,654][123090] Updated weights for policy 1, policy_version 783287 (0.0008) [2023-12-26 05:53:18,379][123091] Updated weights for policy 0, policy_version 788918 (0.0008) [2023-12-26 05:53:18,427][123091] Updated weights for policy 0, policy_version 788928 (0.0008) [2023-12-26 05:53:18,482][123091] Updated weights for policy 0, policy_version 788938 (0.0008) [2023-12-26 05:53:18,517][123090] Updated weights for policy 1, policy_version 783297 (0.0008) [2023-12-26 05:53:18,589][123090] Updated weights for policy 1, policy_version 783307 (0.0008) [2023-12-26 05:53:18,654][123090] Updated weights for policy 1, policy_version 783317 (0.0010) [2023-12-26 05:53:18,721][123090] Updated weights for policy 1, policy_version 783327 (0.0010) [2023-12-26 05:53:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 402505728. Throughput: 0: 9273.8, 1: 8819.9. Samples: 402511904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:18,785][121949] Avg episode reward: [(0, '5968.429'), (1, '5721.461')] [2023-12-26 05:53:19,303][123091] Updated weights for policy 0, policy_version 788948 (0.0007) [2023-12-26 05:53:19,377][123091] Updated weights for policy 0, policy_version 788958 (0.0007) [2023-12-26 05:53:19,457][123091] Updated weights for policy 0, policy_version 788968 (0.0006) [2023-12-26 05:53:19,539][123090] Updated weights for policy 1, policy_version 783337 (0.0008) [2023-12-26 05:53:19,612][123090] Updated weights for policy 1, policy_version 783347 (0.0005) [2023-12-26 05:53:19,685][123090] Updated weights for policy 1, policy_version 783357 (0.0006) [2023-12-26 05:53:20,231][123091] Updated weights for policy 0, policy_version 788978 (0.0008) [2023-12-26 05:53:20,300][123091] Updated weights for policy 0, policy_version 788988 (0.0011) [2023-12-26 05:53:20,369][123091] Updated weights for policy 0, policy_version 788998 (0.0011) [2023-12-26 05:53:20,441][123091] Updated weights for policy 0, policy_version 789008 (0.0011) [2023-12-26 05:53:20,471][123090] Updated weights for policy 1, policy_version 783367 (0.0006) [2023-12-26 05:53:20,546][123090] Updated weights for policy 1, policy_version 783377 (0.0005) [2023-12-26 05:53:20,622][123090] Updated weights for policy 1, policy_version 783387 (0.0008) [2023-12-26 05:53:21,286][123091] Updated weights for policy 0, policy_version 789018 (0.0011) [2023-12-26 05:53:21,356][123091] Updated weights for policy 0, policy_version 789028 (0.0012) [2023-12-26 05:53:21,420][123091] Updated weights for policy 0, policy_version 789038 (0.0010) [2023-12-26 05:53:21,448][123090] Updated weights for policy 1, policy_version 783397 (0.0008) [2023-12-26 05:53:21,518][123090] Updated weights for policy 1, policy_version 783407 (0.0009) [2023-12-26 05:53:21,572][123090] Updated weights for policy 1, policy_version 783417 (0.0009) [2023-12-26 05:53:22,231][123091] Updated weights for policy 0, policy_version 789048 (0.0006) [2023-12-26 05:53:22,291][123090] Updated weights for policy 1, policy_version 783427 (0.0008) [2023-12-26 05:53:22,296][123091] Updated weights for policy 0, policy_version 789058 (0.0007) [2023-12-26 05:53:22,340][123090] Updated weights for policy 1, policy_version 783437 (0.0008) [2023-12-26 05:53:22,360][123091] Updated weights for policy 0, policy_version 789068 (0.0006) [2023-12-26 05:53:22,406][123090] Updated weights for policy 1, policy_version 783447 (0.0008) [2023-12-26 05:53:23,125][123091] Updated weights for policy 0, policy_version 789078 (0.0008) [2023-12-26 05:53:23,186][123091] Updated weights for policy 0, policy_version 789088 (0.0009) [2023-12-26 05:53:23,225][123090] Updated weights for policy 1, policy_version 783457 (0.0008) [2023-12-26 05:53:23,240][123091] Updated weights for policy 0, policy_version 789098 (0.0008) [2023-12-26 05:53:23,289][123090] Updated weights for policy 1, policy_version 783467 (0.0009) [2023-12-26 05:53:23,358][123090] Updated weights for policy 1, policy_version 783477 (0.0011) [2023-12-26 05:53:23,426][123090] Updated weights for policy 1, policy_version 783487 (0.0011) [2023-12-26 05:53:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18158.8, 300 sec: 17855.8). Total num frames: 402587648. Throughput: 0: 9193.1, 1: 8769.3. Samples: 402562844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:23,786][121949] Avg episode reward: [(0, '6025.491'), (1, '5864.653')] [2023-12-26 05:53:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000789104_202014720.pth... [2023-12-26 05:53:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000783488_200572928.pth... [2023-12-26 05:53:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000788016_201736192.pth [2023-12-26 05:53:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000782464_200310784.pth [2023-12-26 05:53:24,060][123091] Updated weights for policy 0, policy_version 789108 (0.0006) [2023-12-26 05:53:24,117][123091] Updated weights for policy 0, policy_version 789118 (0.0005) [2023-12-26 05:53:24,172][123091] Updated weights for policy 0, policy_version 789128 (0.0006) [2023-12-26 05:53:24,178][123090] Updated weights for policy 1, policy_version 783497 (0.0007) [2023-12-26 05:53:24,248][123090] Updated weights for policy 1, policy_version 783507 (0.0005) [2023-12-26 05:53:24,324][123090] Updated weights for policy 1, policy_version 783517 (0.0005) [2023-12-26 05:53:24,814][123091] Updated weights for policy 0, policy_version 789138 (0.0007) [2023-12-26 05:53:24,863][123091] Updated weights for policy 0, policy_version 789148 (0.0007) [2023-12-26 05:53:24,935][123091] Updated weights for policy 0, policy_version 789158 (0.0009) [2023-12-26 05:53:24,996][123091] Updated weights for policy 0, policy_version 789168 (0.0008) [2023-12-26 05:53:25,008][123090] Updated weights for policy 1, policy_version 783527 (0.0006) [2023-12-26 05:53:25,078][123090] Updated weights for policy 1, policy_version 783537 (0.0005) [2023-12-26 05:53:25,138][123090] Updated weights for policy 1, policy_version 783547 (0.0005) [2023-12-26 05:53:25,606][123091] Updated weights for policy 0, policy_version 789178 (0.0005) [2023-12-26 05:53:25,653][123091] Updated weights for policy 0, policy_version 789188 (0.0005) [2023-12-26 05:53:25,702][123091] Updated weights for policy 0, policy_version 789198 (0.0005) [2023-12-26 05:53:25,876][123090] Updated weights for policy 1, policy_version 783557 (0.0007) [2023-12-26 05:53:25,934][123090] Updated weights for policy 1, policy_version 783567 (0.0010) [2023-12-26 05:53:25,984][123090] Updated weights for policy 1, policy_version 783577 (0.0008) [2023-12-26 05:53:26,432][123091] Updated weights for policy 0, policy_version 789208 (0.0006) [2023-12-26 05:53:26,507][123091] Updated weights for policy 0, policy_version 789218 (0.0006) [2023-12-26 05:53:26,558][123091] Updated weights for policy 0, policy_version 789228 (0.0010) [2023-12-26 05:53:26,674][123090] Updated weights for policy 1, policy_version 783587 (0.0005) [2023-12-26 05:53:26,736][123090] Updated weights for policy 1, policy_version 783597 (0.0005) [2023-12-26 05:53:26,790][123090] Updated weights for policy 1, policy_version 783607 (0.0006) [2023-12-26 05:53:27,229][123091] Updated weights for policy 0, policy_version 789239 (0.0010) [2023-12-26 05:53:27,290][123091] Updated weights for policy 0, policy_version 789250 (0.0010) [2023-12-26 05:53:27,354][123091] Updated weights for policy 0, policy_version 789260 (0.0009) [2023-12-26 05:53:27,451][123090] Updated weights for policy 1, policy_version 783617 (0.0009) [2023-12-26 05:53:27,505][123090] Updated weights for policy 1, policy_version 783627 (0.0005) [2023-12-26 05:53:27,576][123090] Updated weights for policy 1, policy_version 783637 (0.0005) [2023-12-26 05:53:27,642][123090] Updated weights for policy 1, policy_version 783647 (0.0005) [2023-12-26 05:53:28,317][123090] Updated weights for policy 1, policy_version 783657 (0.0005) [2023-12-26 05:53:28,320][123091] Updated weights for policy 0, policy_version 789270 (0.0007) [2023-12-26 05:53:28,377][123090] Updated weights for policy 1, policy_version 783667 (0.0009) [2023-12-26 05:53:28,380][123091] Updated weights for policy 0, policy_version 789280 (0.0008) [2023-12-26 05:53:28,436][123090] Updated weights for policy 1, policy_version 783677 (0.0010) [2023-12-26 05:53:28,439][123091] Updated weights for policy 0, policy_version 789290 (0.0006) [2023-12-26 05:53:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 402685952. Throughput: 0: 9261.7, 1: 8925.8. Samples: 402677204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:28,785][121949] Avg episode reward: [(0, '6070.201'), (1, '5905.382')] [2023-12-26 05:53:29,148][123091] Updated weights for policy 0, policy_version 789300 (0.0006) [2023-12-26 05:53:29,156][123090] Updated weights for policy 1, policy_version 783687 (0.0010) [2023-12-26 05:53:29,201][123091] Updated weights for policy 0, policy_version 789310 (0.0005) [2023-12-26 05:53:29,216][123090] Updated weights for policy 1, policy_version 783697 (0.0011) [2023-12-26 05:53:29,270][123091] Updated weights for policy 0, policy_version 789320 (0.0009) [2023-12-26 05:53:29,288][123090] Updated weights for policy 1, policy_version 783707 (0.0010) [2023-12-26 05:53:30,025][123091] Updated weights for policy 0, policy_version 789330 (0.0007) [2023-12-26 05:53:30,091][123091] Updated weights for policy 0, policy_version 789340 (0.0005) [2023-12-26 05:53:30,124][123090] Updated weights for policy 1, policy_version 783717 (0.0010) [2023-12-26 05:53:30,156][123091] Updated weights for policy 0, policy_version 789350 (0.0007) [2023-12-26 05:53:30,179][123090] Updated weights for policy 1, policy_version 783727 (0.0010) [2023-12-26 05:53:30,216][123091] Updated weights for policy 0, policy_version 789360 (0.0006) [2023-12-26 05:53:30,243][123090] Updated weights for policy 1, policy_version 783737 (0.0010) [2023-12-26 05:53:30,928][123091] Updated weights for policy 0, policy_version 789370 (0.0005) [2023-12-26 05:53:30,984][123091] Updated weights for policy 0, policy_version 789380 (0.0005) [2023-12-26 05:53:31,038][123091] Updated weights for policy 0, policy_version 789390 (0.0006) [2023-12-26 05:53:31,054][123090] Updated weights for policy 1, policy_version 783747 (0.0010) [2023-12-26 05:53:31,120][123090] Updated weights for policy 1, policy_version 783757 (0.0010) [2023-12-26 05:53:31,185][123090] Updated weights for policy 1, policy_version 783767 (0.0010) [2023-12-26 05:53:31,787][123091] Updated weights for policy 0, policy_version 789400 (0.0010) [2023-12-26 05:53:31,850][123091] Updated weights for policy 0, policy_version 789410 (0.0005) [2023-12-26 05:53:31,897][123091] Updated weights for policy 0, policy_version 789420 (0.0005) [2023-12-26 05:53:32,061][123090] Updated weights for policy 1, policy_version 783777 (0.0010) [2023-12-26 05:53:32,126][123090] Updated weights for policy 1, policy_version 783787 (0.0007) [2023-12-26 05:53:32,189][123090] Updated weights for policy 1, policy_version 783797 (0.0009) [2023-12-26 05:53:32,251][123090] Updated weights for policy 1, policy_version 783807 (0.0010) [2023-12-26 05:53:32,536][123091] Updated weights for policy 0, policy_version 789430 (0.0005) [2023-12-26 05:53:32,599][123091] Updated weights for policy 0, policy_version 789440 (0.0005) [2023-12-26 05:53:32,664][123091] Updated weights for policy 0, policy_version 789450 (0.0005) [2023-12-26 05:53:33,050][123090] Updated weights for policy 1, policy_version 783817 (0.0007) [2023-12-26 05:53:33,117][123090] Updated weights for policy 1, policy_version 783827 (0.0007) [2023-12-26 05:53:33,165][123090] Updated weights for policy 1, policy_version 783837 (0.0008) [2023-12-26 05:53:33,352][123091] Updated weights for policy 0, policy_version 789460 (0.0005) [2023-12-26 05:53:33,412][123091] Updated weights for policy 0, policy_version 789470 (0.0005) [2023-12-26 05:53:33,466][123091] Updated weights for policy 0, policy_version 789480 (0.0007) [2023-12-26 05:53:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18159.1, 300 sec: 17883.6). Total num frames: 402776064. Throughput: 0: 9263.3, 1: 8953.7. Samples: 402789208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:33,785][121949] Avg episode reward: [(0, '6017.758'), (1, '5646.085')] [2023-12-26 05:53:33,807][123090] Updated weights for policy 1, policy_version 783847 (0.0005) [2023-12-26 05:53:33,853][123090] Updated weights for policy 1, policy_version 783857 (0.0005) [2023-12-26 05:53:33,901][123090] Updated weights for policy 1, policy_version 783867 (0.0005) [2023-12-26 05:53:34,133][123091] Updated weights for policy 0, policy_version 789490 (0.0006) [2023-12-26 05:53:34,204][123091] Updated weights for policy 0, policy_version 789500 (0.0011) [2023-12-26 05:53:34,267][123091] Updated weights for policy 0, policy_version 789510 (0.0011) [2023-12-26 05:53:34,331][123091] Updated weights for policy 0, policy_version 789520 (0.0010) [2023-12-26 05:53:34,681][123090] Updated weights for policy 1, policy_version 783877 (0.0005) [2023-12-26 05:53:34,753][123090] Updated weights for policy 1, policy_version 783887 (0.0005) [2023-12-26 05:53:34,824][123090] Updated weights for policy 1, policy_version 783897 (0.0006) [2023-12-26 05:53:35,144][123091] Updated weights for policy 0, policy_version 789530 (0.0005) [2023-12-26 05:53:35,210][123091] Updated weights for policy 0, policy_version 789540 (0.0006) [2023-12-26 05:53:35,276][123091] Updated weights for policy 0, policy_version 789550 (0.0005) [2023-12-26 05:53:35,463][123090] Updated weights for policy 1, policy_version 783907 (0.0005) [2023-12-26 05:53:35,520][123090] Updated weights for policy 1, policy_version 783917 (0.0005) [2023-12-26 05:53:35,586][123090] Updated weights for policy 1, policy_version 783927 (0.0007) [2023-12-26 05:53:35,989][123091] Updated weights for policy 0, policy_version 789561 (0.0010) [2023-12-26 05:53:36,047][123091] Updated weights for policy 0, policy_version 789571 (0.0010) [2023-12-26 05:53:36,102][123091] Updated weights for policy 0, policy_version 789582 (0.0010) [2023-12-26 05:53:36,218][123090] Updated weights for policy 1, policy_version 783937 (0.0007) [2023-12-26 05:53:36,283][123090] Updated weights for policy 1, policy_version 783948 (0.0009) [2023-12-26 05:53:36,345][123090] Updated weights for policy 1, policy_version 783958 (0.0010) [2023-12-26 05:53:36,415][123090] Updated weights for policy 1, policy_version 783968 (0.0009) [2023-12-26 05:53:37,002][123091] Updated weights for policy 0, policy_version 789592 (0.0009) [2023-12-26 05:53:37,065][123091] Updated weights for policy 0, policy_version 789602 (0.0010) [2023-12-26 05:53:37,132][123091] Updated weights for policy 0, policy_version 789612 (0.0009) [2023-12-26 05:53:37,182][123090] Updated weights for policy 1, policy_version 783978 (0.0008) [2023-12-26 05:53:37,253][123090] Updated weights for policy 1, policy_version 783988 (0.0005) [2023-12-26 05:53:37,322][123090] Updated weights for policy 1, policy_version 783998 (0.0005) [2023-12-26 05:53:37,935][123091] Updated weights for policy 0, policy_version 789622 (0.0008) [2023-12-26 05:53:37,998][123091] Updated weights for policy 0, policy_version 789632 (0.0010) [2023-12-26 05:53:38,035][123090] Updated weights for policy 1, policy_version 784008 (0.0006) [2023-12-26 05:53:38,066][123091] Updated weights for policy 0, policy_version 789642 (0.0008) [2023-12-26 05:53:38,105][123090] Updated weights for policy 1, policy_version 784018 (0.0005) [2023-12-26 05:53:38,154][123090] Updated weights for policy 1, policy_version 784028 (0.0005) [2023-12-26 05:53:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17911.3). Total num frames: 402866176. Throughput: 0: 9264.3, 1: 9008.5. Samples: 402844956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:38,785][121949] Avg episode reward: [(0, '6110.234'), (1, '5636.078')] [2023-12-26 05:53:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000789648_202153984.pth... [2023-12-26 05:53:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000784032_200712192.pth... [2023-12-26 05:53:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000788592_201883648.pth [2023-12-26 05:53:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000782976_200441856.pth [2023-12-26 05:53:38,903][123090] Updated weights for policy 1, policy_version 784038 (0.0009) [2023-12-26 05:53:38,919][123091] Updated weights for policy 0, policy_version 789652 (0.0008) [2023-12-26 05:53:38,959][123090] Updated weights for policy 1, policy_version 784048 (0.0010) [2023-12-26 05:53:38,977][123091] Updated weights for policy 0, policy_version 789662 (0.0007) [2023-12-26 05:53:39,013][123090] Updated weights for policy 1, policy_version 784058 (0.0010) [2023-12-26 05:53:39,033][123091] Updated weights for policy 0, policy_version 789672 (0.0006) [2023-12-26 05:53:39,859][123090] Updated weights for policy 1, policy_version 784068 (0.0010) [2023-12-26 05:53:39,862][123091] Updated weights for policy 0, policy_version 789682 (0.0009) [2023-12-26 05:53:39,926][123091] Updated weights for policy 0, policy_version 789692 (0.0008) [2023-12-26 05:53:39,928][123090] Updated weights for policy 1, policy_version 784078 (0.0009) [2023-12-26 05:53:39,985][123090] Updated weights for policy 1, policy_version 784088 (0.0007) [2023-12-26 05:53:39,985][123091] Updated weights for policy 0, policy_version 789702 (0.0008) [2023-12-26 05:53:40,047][123091] Updated weights for policy 0, policy_version 789712 (0.0008) [2023-12-26 05:53:40,789][123091] Updated weights for policy 0, policy_version 789722 (0.0006) [2023-12-26 05:53:40,850][123091] Updated weights for policy 0, policy_version 789732 (0.0006) [2023-12-26 05:53:40,867][123090] Updated weights for policy 1, policy_version 784098 (0.0009) [2023-12-26 05:53:40,907][123091] Updated weights for policy 0, policy_version 789742 (0.0011) [2023-12-26 05:53:40,931][123090] Updated weights for policy 1, policy_version 784108 (0.0007) [2023-12-26 05:53:41,001][123090] Updated weights for policy 1, policy_version 784118 (0.0008) [2023-12-26 05:53:41,074][123090] Updated weights for policy 1, policy_version 784128 (0.0006) [2023-12-26 05:53:41,627][123091] Updated weights for policy 0, policy_version 789752 (0.0011) [2023-12-26 05:53:41,698][123091] Updated weights for policy 0, policy_version 789762 (0.0008) [2023-12-26 05:53:41,772][123091] Updated weights for policy 0, policy_version 789772 (0.0009) [2023-12-26 05:53:41,886][123090] Updated weights for policy 1, policy_version 784138 (0.0008) [2023-12-26 05:53:41,953][123090] Updated weights for policy 1, policy_version 784148 (0.0008) [2023-12-26 05:53:42,021][123090] Updated weights for policy 1, policy_version 784158 (0.0010) [2023-12-26 05:53:42,574][123091] Updated weights for policy 0, policy_version 789782 (0.0011) [2023-12-26 05:53:42,634][123091] Updated weights for policy 0, policy_version 789792 (0.0011) [2023-12-26 05:53:42,708][123091] Updated weights for policy 0, policy_version 789802 (0.0011) [2023-12-26 05:53:42,828][123090] Updated weights for policy 1, policy_version 784168 (0.0011) [2023-12-26 05:53:42,895][123090] Updated weights for policy 1, policy_version 784178 (0.0011) [2023-12-26 05:53:42,963][123090] Updated weights for policy 1, policy_version 784188 (0.0011) [2023-12-26 05:53:43,449][123091] Updated weights for policy 0, policy_version 789812 (0.0009) [2023-12-26 05:53:43,505][123091] Updated weights for policy 0, policy_version 789822 (0.0009) [2023-12-26 05:53:43,572][123091] Updated weights for policy 0, policy_version 789832 (0.0010) [2023-12-26 05:53:43,717][123090] Updated weights for policy 1, policy_version 784198 (0.0010) [2023-12-26 05:53:43,777][123090] Updated weights for policy 1, policy_version 784208 (0.0008) [2023-12-26 05:53:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 402956288. Throughput: 0: 9144.0, 1: 8974.5. Samples: 402950432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:43,785][121949] Avg episode reward: [(0, '6000.121'), (1, '5763.103')] [2023-12-26 05:53:43,842][123090] Updated weights for policy 1, policy_version 784218 (0.0009) [2023-12-26 05:53:44,280][123091] Updated weights for policy 0, policy_version 789842 (0.0006) [2023-12-26 05:53:44,336][123091] Updated weights for policy 0, policy_version 789852 (0.0007) [2023-12-26 05:53:44,404][123091] Updated weights for policy 0, policy_version 789862 (0.0011) [2023-12-26 05:53:44,466][123091] Updated weights for policy 0, policy_version 789872 (0.0010) [2023-12-26 05:53:44,574][123090] Updated weights for policy 1, policy_version 784228 (0.0008) [2023-12-26 05:53:44,637][123090] Updated weights for policy 1, policy_version 784238 (0.0007) [2023-12-26 05:53:44,692][123090] Updated weights for policy 1, policy_version 784248 (0.0010) [2023-12-26 05:53:45,263][123091] Updated weights for policy 0, policy_version 789882 (0.0010) [2023-12-26 05:53:45,319][123091] Updated weights for policy 0, policy_version 789892 (0.0011) [2023-12-26 05:53:45,379][123091] Updated weights for policy 0, policy_version 789902 (0.0006) [2023-12-26 05:53:45,548][123090] Updated weights for policy 1, policy_version 784258 (0.0010) [2023-12-26 05:53:45,605][123090] Updated weights for policy 1, policy_version 784268 (0.0011) [2023-12-26 05:53:45,660][123090] Updated weights for policy 1, policy_version 784278 (0.0010) [2023-12-26 05:53:45,720][123090] Updated weights for policy 1, policy_version 784288 (0.0010) [2023-12-26 05:53:46,078][123091] Updated weights for policy 0, policy_version 789912 (0.0006) [2023-12-26 05:53:46,132][123091] Updated weights for policy 0, policy_version 789922 (0.0005) [2023-12-26 05:53:46,208][123091] Updated weights for policy 0, policy_version 789932 (0.0006) [2023-12-26 05:53:46,376][123090] Updated weights for policy 1, policy_version 784298 (0.0005) [2023-12-26 05:53:46,432][123090] Updated weights for policy 1, policy_version 784308 (0.0005) [2023-12-26 05:53:46,481][123090] Updated weights for policy 1, policy_version 784318 (0.0005) [2023-12-26 05:53:46,863][123091] Updated weights for policy 0, policy_version 789942 (0.0009) [2023-12-26 05:53:46,927][123091] Updated weights for policy 0, policy_version 789952 (0.0011) [2023-12-26 05:53:46,994][123091] Updated weights for policy 0, policy_version 789962 (0.0011) [2023-12-26 05:53:47,141][123090] Updated weights for policy 1, policy_version 784328 (0.0008) [2023-12-26 05:53:47,189][123090] Updated weights for policy 1, policy_version 784338 (0.0009) [2023-12-26 05:53:47,249][123090] Updated weights for policy 1, policy_version 784348 (0.0010) [2023-12-26 05:53:47,808][123091] Updated weights for policy 0, policy_version 789972 (0.0011) [2023-12-26 05:53:47,860][123091] Updated weights for policy 0, policy_version 789982 (0.0008) [2023-12-26 05:53:47,914][123091] Updated weights for policy 0, policy_version 789992 (0.0005) [2023-12-26 05:53:48,052][123090] Updated weights for policy 1, policy_version 784358 (0.0010) [2023-12-26 05:53:48,103][123090] Updated weights for policy 1, policy_version 784368 (0.0010) [2023-12-26 05:53:48,150][123090] Updated weights for policy 1, policy_version 784378 (0.0010) [2023-12-26 05:53:48,672][123091] Updated weights for policy 0, policy_version 790002 (0.0005) [2023-12-26 05:53:48,737][123091] Updated weights for policy 0, policy_version 790012 (0.0005) [2023-12-26 05:53:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 403046400. Throughput: 0: 9112.8, 1: 9065.6. Samples: 403062688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:48,785][121949] Avg episode reward: [(0, '5870.014'), (1, '5814.913')] [2023-12-26 05:53:48,803][123091] Updated weights for policy 0, policy_version 790022 (0.0007) [2023-12-26 05:53:48,861][123091] Updated weights for policy 0, policy_version 790032 (0.0009) [2023-12-26 05:53:48,994][123090] Updated weights for policy 1, policy_version 784388 (0.0009) [2023-12-26 05:53:49,056][123090] Updated weights for policy 1, policy_version 784398 (0.0006) [2023-12-26 05:53:49,104][123090] Updated weights for policy 1, policy_version 784408 (0.0010) [2023-12-26 05:53:49,646][123091] Updated weights for policy 0, policy_version 790042 (0.0007) [2023-12-26 05:53:49,705][123091] Updated weights for policy 0, policy_version 790052 (0.0006) [2023-12-26 05:53:49,767][123091] Updated weights for policy 0, policy_version 790062 (0.0009) [2023-12-26 05:53:49,923][123090] Updated weights for policy 1, policy_version 784418 (0.0010) [2023-12-26 05:53:49,993][123090] Updated weights for policy 1, policy_version 784428 (0.0010) [2023-12-26 05:53:50,046][123090] Updated weights for policy 1, policy_version 784438 (0.0010) [2023-12-26 05:53:50,110][123090] Updated weights for policy 1, policy_version 784448 (0.0010) [2023-12-26 05:53:50,614][123091] Updated weights for policy 0, policy_version 790072 (0.0009) [2023-12-26 05:53:50,682][123091] Updated weights for policy 0, policy_version 790082 (0.0009) [2023-12-26 05:53:50,753][123091] Updated weights for policy 0, policy_version 790092 (0.0008) [2023-12-26 05:53:50,954][123090] Updated weights for policy 1, policy_version 784458 (0.0008) [2023-12-26 05:53:51,025][123090] Updated weights for policy 1, policy_version 784468 (0.0008) [2023-12-26 05:53:51,102][123090] Updated weights for policy 1, policy_version 784478 (0.0009) [2023-12-26 05:53:51,624][123091] Updated weights for policy 0, policy_version 790102 (0.0008) [2023-12-26 05:53:51,693][123091] Updated weights for policy 0, policy_version 790112 (0.0009) [2023-12-26 05:53:51,765][123091] Updated weights for policy 0, policy_version 790122 (0.0009) [2023-12-26 05:53:51,942][123090] Updated weights for policy 1, policy_version 784488 (0.0008) [2023-12-26 05:53:52,006][123090] Updated weights for policy 1, policy_version 784498 (0.0009) [2023-12-26 05:53:52,074][123090] Updated weights for policy 1, policy_version 784508 (0.0011) [2023-12-26 05:53:52,647][123091] Updated weights for policy 0, policy_version 790132 (0.0010) [2023-12-26 05:53:52,706][123091] Updated weights for policy 0, policy_version 790142 (0.0011) [2023-12-26 05:53:52,769][123091] Updated weights for policy 0, policy_version 790152 (0.0011) [2023-12-26 05:53:52,792][123090] Updated weights for policy 1, policy_version 784518 (0.0007) [2023-12-26 05:53:52,848][123090] Updated weights for policy 1, policy_version 784528 (0.0006) [2023-12-26 05:53:52,908][123090] Updated weights for policy 1, policy_version 784538 (0.0009) [2023-12-26 05:53:53,593][123091] Updated weights for policy 0, policy_version 790162 (0.0011) [2023-12-26 05:53:53,628][123090] Updated weights for policy 1, policy_version 784548 (0.0008) [2023-12-26 05:53:53,659][123091] Updated weights for policy 0, policy_version 790172 (0.0011) [2023-12-26 05:53:53,689][123090] Updated weights for policy 1, policy_version 784558 (0.0005) [2023-12-26 05:53:53,713][123091] Updated weights for policy 0, policy_version 790182 (0.0010) [2023-12-26 05:53:53,751][123090] Updated weights for policy 1, policy_version 784568 (0.0006) [2023-12-26 05:53:53,768][123091] Updated weights for policy 0, policy_version 790192 (0.0010) [2023-12-26 05:53:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 403136512. Throughput: 0: 9034.2, 1: 9024.9. Samples: 403113304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:53,785][121949] Avg episode reward: [(0, '5855.342'), (1, '5840.486')] [2023-12-26 05:53:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000790192_202293248.pth... [2023-12-26 05:53:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000789104_202014720.pth [2023-12-26 05:53:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000790192_202293248.pth [2023-12-26 05:53:53,798][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000784576_200851456.pth... [2023-12-26 05:53:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000783488_200572928.pth [2023-12-26 05:53:53,803][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000784576_200851456.pth [2023-12-26 05:53:54,415][123090] Updated weights for policy 1, policy_version 784578 (0.0005) [2023-12-26 05:53:54,488][123090] Updated weights for policy 1, policy_version 784588 (0.0006) [2023-12-26 05:53:54,513][123091] Updated weights for policy 0, policy_version 790202 (0.0008) [2023-12-26 05:53:54,560][123090] Updated weights for policy 1, policy_version 784598 (0.0006) [2023-12-26 05:53:54,582][123091] Updated weights for policy 0, policy_version 790212 (0.0008) [2023-12-26 05:53:54,617][123090] Updated weights for policy 1, policy_version 784608 (0.0007) [2023-12-26 05:53:54,653][123091] Updated weights for policy 0, policy_version 790222 (0.0006) [2023-12-26 05:53:55,351][123091] Updated weights for policy 0, policy_version 790232 (0.0010) [2023-12-26 05:53:55,357][123090] Updated weights for policy 1, policy_version 784618 (0.0008) [2023-12-26 05:53:55,413][123091] Updated weights for policy 0, policy_version 790242 (0.0009) [2023-12-26 05:53:55,420][123090] Updated weights for policy 1, policy_version 784628 (0.0008) [2023-12-26 05:53:55,474][123091] Updated weights for policy 0, policy_version 790252 (0.0005) [2023-12-26 05:53:55,485][123090] Updated weights for policy 1, policy_version 784638 (0.0009) [2023-12-26 05:53:56,116][123091] Updated weights for policy 0, policy_version 790262 (0.0008) [2023-12-26 05:53:56,163][123091] Updated weights for policy 0, policy_version 790272 (0.0010) [2023-12-26 05:53:56,225][123091] Updated weights for policy 0, policy_version 790282 (0.0010) [2023-12-26 05:53:56,368][123090] Updated weights for policy 1, policy_version 784648 (0.0009) [2023-12-26 05:53:56,424][123090] Updated weights for policy 1, policy_version 784658 (0.0009) [2023-12-26 05:53:56,487][123090] Updated weights for policy 1, policy_version 784668 (0.0009) [2023-12-26 05:53:57,001][123091] Updated weights for policy 0, policy_version 790292 (0.0009) [2023-12-26 05:53:57,051][123091] Updated weights for policy 0, policy_version 790302 (0.0006) [2023-12-26 05:53:57,107][123091] Updated weights for policy 0, policy_version 790312 (0.0007) [2023-12-26 05:53:57,244][123090] Updated weights for policy 1, policy_version 784678 (0.0009) [2023-12-26 05:53:57,301][123090] Updated weights for policy 1, policy_version 784688 (0.0010) [2023-12-26 05:53:57,353][123090] Updated weights for policy 1, policy_version 784698 (0.0009) [2023-12-26 05:53:57,796][123091] Updated weights for policy 0, policy_version 790322 (0.0006) [2023-12-26 05:53:57,846][123091] Updated weights for policy 0, policy_version 790332 (0.0010) [2023-12-26 05:53:57,893][123091] Updated weights for policy 0, policy_version 790342 (0.0010) [2023-12-26 05:53:57,945][123091] Updated weights for policy 0, policy_version 790352 (0.0010) [2023-12-26 05:53:58,194][123090] Updated weights for policy 1, policy_version 784708 (0.0009) [2023-12-26 05:53:58,262][123090] Updated weights for policy 1, policy_version 784718 (0.0007) [2023-12-26 05:53:58,339][123090] Updated weights for policy 1, policy_version 784728 (0.0007) [2023-12-26 05:53:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 403226624. Throughput: 0: 9099.8, 1: 9105.1. Samples: 403223552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:53:58,785][121949] Avg episode reward: [(0, '6027.768'), (1, '5702.689')] [2023-12-26 05:53:58,927][123091] Updated weights for policy 0, policy_version 790362 (0.0008) [2023-12-26 05:53:58,999][123091] Updated weights for policy 0, policy_version 790372 (0.0006) [2023-12-26 05:53:59,068][123091] Updated weights for policy 0, policy_version 790382 (0.0008) [2023-12-26 05:53:59,196][123090] Updated weights for policy 1, policy_version 784738 (0.0009) [2023-12-26 05:53:59,271][123090] Updated weights for policy 1, policy_version 784748 (0.0009) [2023-12-26 05:53:59,364][123090] Updated weights for policy 1, policy_version 784758 (0.0009) [2023-12-26 05:53:59,420][123090] Updated weights for policy 1, policy_version 784768 (0.0009) [2023-12-26 05:53:59,814][123091] Updated weights for policy 0, policy_version 790392 (0.0007) [2023-12-26 05:53:59,872][123091] Updated weights for policy 0, policy_version 790402 (0.0009) [2023-12-26 05:53:59,940][123091] Updated weights for policy 0, policy_version 790412 (0.0009) [2023-12-26 05:54:00,275][123090] Updated weights for policy 1, policy_version 784778 (0.0010) [2023-12-26 05:54:00,338][123090] Updated weights for policy 1, policy_version 784788 (0.0010) [2023-12-26 05:54:00,401][123090] Updated weights for policy 1, policy_version 784798 (0.0009) [2023-12-26 05:54:00,747][123091] Updated weights for policy 0, policy_version 790422 (0.0009) [2023-12-26 05:54:00,795][123091] Updated weights for policy 0, policy_version 790432 (0.0010) [2023-12-26 05:54:00,853][123091] Updated weights for policy 0, policy_version 790442 (0.0007) [2023-12-26 05:54:01,207][123090] Updated weights for policy 1, policy_version 784808 (0.0006) [2023-12-26 05:54:01,281][123090] Updated weights for policy 1, policy_version 784818 (0.0007) [2023-12-26 05:54:01,342][123090] Updated weights for policy 1, policy_version 784828 (0.0006) [2023-12-26 05:54:01,571][123091] Updated weights for policy 0, policy_version 790452 (0.0007) [2023-12-26 05:54:01,626][123091] Updated weights for policy 0, policy_version 790462 (0.0009) [2023-12-26 05:54:01,683][123091] Updated weights for policy 0, policy_version 790472 (0.0010) [2023-12-26 05:54:02,195][123090] Updated weights for policy 1, policy_version 784838 (0.0007) [2023-12-26 05:54:02,266][123090] Updated weights for policy 1, policy_version 784848 (0.0009) [2023-12-26 05:54:02,337][123090] Updated weights for policy 1, policy_version 784858 (0.0010) [2023-12-26 05:54:02,434][123091] Updated weights for policy 0, policy_version 790482 (0.0010) [2023-12-26 05:54:02,495][123091] Updated weights for policy 0, policy_version 790492 (0.0009) [2023-12-26 05:54:02,565][123091] Updated weights for policy 0, policy_version 790502 (0.0006) [2023-12-26 05:54:02,630][123091] Updated weights for policy 0, policy_version 790512 (0.0005) [2023-12-26 05:54:03,153][123090] Updated weights for policy 1, policy_version 784868 (0.0009) [2023-12-26 05:54:03,205][123090] Updated weights for policy 1, policy_version 784878 (0.0009) [2023-12-26 05:54:03,261][123090] Updated weights for policy 1, policy_version 784888 (0.0009) [2023-12-26 05:54:03,325][123091] Updated weights for policy 0, policy_version 790522 (0.0005) [2023-12-26 05:54:03,388][123091] Updated weights for policy 0, policy_version 790532 (0.0007) [2023-12-26 05:54:03,439][123091] Updated weights for policy 0, policy_version 790542 (0.0009) [2023-12-26 05:54:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 403316736. Throughput: 0: 9129.1, 1: 8993.2. Samples: 403327412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:54:03,785][121949] Avg episode reward: [(0, '6052.314'), (1, '5633.714')] [2023-12-26 05:54:04,125][123090] Updated weights for policy 1, policy_version 784898 (0.0009) [2023-12-26 05:54:04,181][123090] Updated weights for policy 1, policy_version 784908 (0.0010) [2023-12-26 05:54:04,217][123091] Updated weights for policy 0, policy_version 790552 (0.0008) [2023-12-26 05:54:04,247][123090] Updated weights for policy 1, policy_version 784918 (0.0010) [2023-12-26 05:54:04,276][123091] Updated weights for policy 0, policy_version 790562 (0.0009) [2023-12-26 05:54:04,310][123090] Updated weights for policy 1, policy_version 784928 (0.0010) [2023-12-26 05:54:04,345][123091] Updated weights for policy 0, policy_version 790572 (0.0009) [2023-12-26 05:54:05,103][123090] Updated weights for policy 1, policy_version 784938 (0.0009) [2023-12-26 05:54:05,146][123091] Updated weights for policy 0, policy_version 790582 (0.0008) [2023-12-26 05:54:05,150][123090] Updated weights for policy 1, policy_version 784948 (0.0009) [2023-12-26 05:54:05,199][123090] Updated weights for policy 1, policy_version 784958 (0.0006) [2023-12-26 05:54:05,207][123091] Updated weights for policy 0, policy_version 790592 (0.0009) [2023-12-26 05:54:05,270][123091] Updated weights for policy 0, policy_version 790602 (0.0009) [2023-12-26 05:54:06,010][123091] Updated weights for policy 0, policy_version 790612 (0.0008) [2023-12-26 05:54:06,012][123090] Updated weights for policy 1, policy_version 784968 (0.0005) [2023-12-26 05:54:06,066][123091] Updated weights for policy 0, policy_version 790622 (0.0010) [2023-12-26 05:54:06,068][123090] Updated weights for policy 1, policy_version 784978 (0.0005) [2023-12-26 05:54:06,127][123090] Updated weights for policy 1, policy_version 784988 (0.0008) [2023-12-26 05:54:06,138][123091] Updated weights for policy 0, policy_version 790632 (0.0009) [2023-12-26 05:54:06,913][123090] Updated weights for policy 1, policy_version 784998 (0.0007) [2023-12-26 05:54:06,926][123091] Updated weights for policy 0, policy_version 790642 (0.0006) [2023-12-26 05:54:06,974][123090] Updated weights for policy 1, policy_version 785008 (0.0005) [2023-12-26 05:54:06,977][123091] Updated weights for policy 0, policy_version 790652 (0.0007) [2023-12-26 05:54:07,026][123091] Updated weights for policy 0, policy_version 790662 (0.0008) [2023-12-26 05:54:07,036][123090] Updated weights for policy 1, policy_version 785018 (0.0005) [2023-12-26 05:54:07,077][123091] Updated weights for policy 0, policy_version 790672 (0.0007) [2023-12-26 05:54:07,741][123090] Updated weights for policy 1, policy_version 785028 (0.0007) [2023-12-26 05:54:07,789][123091] Updated weights for policy 0, policy_version 790682 (0.0006) [2023-12-26 05:54:07,792][123090] Updated weights for policy 1, policy_version 785038 (0.0007) [2023-12-26 05:54:07,849][123090] Updated weights for policy 1, policy_version 785048 (0.0008) [2023-12-26 05:54:07,849][123091] Updated weights for policy 0, policy_version 790692 (0.0006) [2023-12-26 05:54:07,917][123091] Updated weights for policy 0, policy_version 790702 (0.0006) [2023-12-26 05:54:08,658][123091] Updated weights for policy 0, policy_version 790712 (0.0009) [2023-12-26 05:54:08,710][123091] Updated weights for policy 0, policy_version 790722 (0.0009) [2023-12-26 05:54:08,718][123090] Updated weights for policy 1, policy_version 785058 (0.0008) [2023-12-26 05:54:08,768][123091] Updated weights for policy 0, policy_version 790732 (0.0009) [2023-12-26 05:54:08,780][123090] Updated weights for policy 1, policy_version 785068 (0.0007) [2023-12-26 05:54:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 403398656. Throughput: 0: 9155.4, 1: 9019.3. Samples: 403380700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:54:08,785][121949] Avg episode reward: [(0, '6051.827'), (1, '5669.366')] [2023-12-26 05:54:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000790736_202432512.pth... [2023-12-26 05:54:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000789648_202153984.pth [2023-12-26 05:54:08,843][123090] Updated weights for policy 1, policy_version 785078 (0.0009) [2023-12-26 05:54:08,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000785088_200982528.pth... [2023-12-26 05:54:08,898][123090] Updated weights for policy 1, policy_version 785088 (0.0009) [2023-12-26 05:54:08,899][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000784032_200712192.pth [2023-12-26 05:54:09,602][123091] Updated weights for policy 0, policy_version 790742 (0.0009) [2023-12-26 05:54:09,666][123091] Updated weights for policy 0, policy_version 790752 (0.0011) [2023-12-26 05:54:09,738][123091] Updated weights for policy 0, policy_version 790762 (0.0011) [2023-12-26 05:54:09,773][123090] Updated weights for policy 1, policy_version 785098 (0.0006) [2023-12-26 05:54:09,855][123090] Updated weights for policy 1, policy_version 785108 (0.0007) [2023-12-26 05:54:09,917][123090] Updated weights for policy 1, policy_version 785118 (0.0007) [2023-12-26 05:54:10,569][123091] Updated weights for policy 0, policy_version 790772 (0.0011) [2023-12-26 05:54:10,633][123091] Updated weights for policy 0, policy_version 790782 (0.0011) [2023-12-26 05:54:10,675][123090] Updated weights for policy 1, policy_version 785128 (0.0010) [2023-12-26 05:54:10,696][123091] Updated weights for policy 0, policy_version 790792 (0.0011) [2023-12-26 05:54:10,729][123090] Updated weights for policy 1, policy_version 785138 (0.0005) [2023-12-26 05:54:10,779][123090] Updated weights for policy 1, policy_version 785148 (0.0007) [2023-12-26 05:54:11,525][123091] Updated weights for policy 0, policy_version 790802 (0.0010) [2023-12-26 05:54:11,587][123091] Updated weights for policy 0, policy_version 790812 (0.0010) [2023-12-26 05:54:11,641][123090] Updated weights for policy 1, policy_version 785158 (0.0008) [2023-12-26 05:54:11,654][123091] Updated weights for policy 0, policy_version 790822 (0.0009) [2023-12-26 05:54:11,700][123090] Updated weights for policy 1, policy_version 785168 (0.0008) [2023-12-26 05:54:11,722][123091] Updated weights for policy 0, policy_version 790832 (0.0006) [2023-12-26 05:54:11,774][123090] Updated weights for policy 1, policy_version 785178 (0.0009) [2023-12-26 05:54:12,545][123091] Updated weights for policy 0, policy_version 790842 (0.0008) [2023-12-26 05:54:12,601][123090] Updated weights for policy 1, policy_version 785188 (0.0010) [2023-12-26 05:54:12,601][123091] Updated weights for policy 0, policy_version 790852 (0.0005) [2023-12-26 05:54:12,662][123091] Updated weights for policy 0, policy_version 790862 (0.0007) [2023-12-26 05:54:12,669][123090] Updated weights for policy 1, policy_version 785198 (0.0008) [2023-12-26 05:54:12,737][123090] Updated weights for policy 1, policy_version 785208 (0.0010) [2023-12-26 05:54:13,497][123091] Updated weights for policy 0, policy_version 790872 (0.0011) [2023-12-26 05:54:13,562][123091] Updated weights for policy 0, policy_version 790882 (0.0006) [2023-12-26 05:54:13,600][123090] Updated weights for policy 1, policy_version 785218 (0.0009) [2023-12-26 05:54:13,616][123091] Updated weights for policy 0, policy_version 790892 (0.0009) [2023-12-26 05:54:13,660][123090] Updated weights for policy 1, policy_version 785228 (0.0007) [2023-12-26 05:54:13,724][123090] Updated weights for policy 1, policy_version 785238 (0.0009) [2023-12-26 05:54:13,784][123090] Updated weights for policy 1, policy_version 785248 (0.0009) [2023-12-26 05:54:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 403496960. Throughput: 0: 9060.1, 1: 8909.0. Samples: 403485812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:54:13,785][121949] Avg episode reward: [(0, '6115.739'), (1, '5776.272')] [2023-12-26 05:54:14,455][123091] Updated weights for policy 0, policy_version 790902 (0.0010) [2023-12-26 05:54:14,495][123090] Updated weights for policy 1, policy_version 785258 (0.0005) [2023-12-26 05:54:14,517][123091] Updated weights for policy 0, policy_version 790912 (0.0008) [2023-12-26 05:54:14,557][123090] Updated weights for policy 1, policy_version 785268 (0.0005) [2023-12-26 05:54:14,586][123091] Updated weights for policy 0, policy_version 790922 (0.0009) [2023-12-26 05:54:14,617][123090] Updated weights for policy 1, policy_version 785278 (0.0006) [2023-12-26 05:54:15,329][123090] Updated weights for policy 1, policy_version 785288 (0.0008) [2023-12-26 05:54:15,391][123090] Updated weights for policy 1, policy_version 785298 (0.0008) [2023-12-26 05:54:15,446][123090] Updated weights for policy 1, policy_version 785308 (0.0008) [2023-12-26 05:54:15,476][123091] Updated weights for policy 0, policy_version 790932 (0.0009) [2023-12-26 05:54:15,532][123091] Updated weights for policy 0, policy_version 790942 (0.0010) [2023-12-26 05:54:15,601][123091] Updated weights for policy 0, policy_version 790952 (0.0006) [2023-12-26 05:54:16,199][123090] Updated weights for policy 1, policy_version 785318 (0.0009) [2023-12-26 05:54:16,262][123090] Updated weights for policy 1, policy_version 785328 (0.0010) [2023-12-26 05:54:16,309][123090] Updated weights for policy 1, policy_version 785338 (0.0010) [2023-12-26 05:54:16,331][123091] Updated weights for policy 0, policy_version 790962 (0.0006) [2023-12-26 05:54:16,399][123091] Updated weights for policy 0, policy_version 790972 (0.0006) [2023-12-26 05:54:16,454][123091] Updated weights for policy 0, policy_version 790982 (0.0011) [2023-12-26 05:54:16,506][123091] Updated weights for policy 0, policy_version 790992 (0.0010) [2023-12-26 05:54:17,161][123090] Updated weights for policy 1, policy_version 785348 (0.0010) [2023-12-26 05:54:17,183][123091] Updated weights for policy 0, policy_version 791002 (0.0008) [2023-12-26 05:54:17,208][123090] Updated weights for policy 1, policy_version 785358 (0.0010) [2023-12-26 05:54:17,227][123091] Updated weights for policy 0, policy_version 791012 (0.0010) [2023-12-26 05:54:17,271][123090] Updated weights for policy 1, policy_version 785368 (0.0008) [2023-12-26 05:54:17,282][123091] Updated weights for policy 0, policy_version 791022 (0.0010) [2023-12-26 05:54:17,886][123090] Updated weights for policy 1, policy_version 785378 (0.0005) [2023-12-26 05:54:17,951][123090] Updated weights for policy 1, policy_version 785388 (0.0005) [2023-12-26 05:54:18,026][123090] Updated weights for policy 1, policy_version 785398 (0.0006) [2023-12-26 05:54:18,100][123090] Updated weights for policy 1, policy_version 785408 (0.0009) [2023-12-26 05:54:18,165][123091] Updated weights for policy 0, policy_version 791032 (0.0009) [2023-12-26 05:54:18,214][123091] Updated weights for policy 0, policy_version 791042 (0.0009) [2023-12-26 05:54:18,266][123091] Updated weights for policy 0, policy_version 791052 (0.0008) [2023-12-26 05:54:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 403578880. Throughput: 0: 8950.4, 1: 8923.8. Samples: 403593548. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:18,785][121949] Avg episode reward: [(0, '6097.796'), (1, '5720.744')] [2023-12-26 05:54:18,841][123090] Updated weights for policy 1, policy_version 785418 (0.0010) [2023-12-26 05:54:18,905][123090] Updated weights for policy 1, policy_version 785428 (0.0010) [2023-12-26 05:54:18,979][123090] Updated weights for policy 1, policy_version 785438 (0.0010) [2023-12-26 05:54:19,114][123091] Updated weights for policy 0, policy_version 791062 (0.0007) [2023-12-26 05:54:19,168][123091] Updated weights for policy 0, policy_version 791072 (0.0005) [2023-12-26 05:54:19,240][123091] Updated weights for policy 0, policy_version 791082 (0.0006) [2023-12-26 05:54:19,748][123090] Updated weights for policy 1, policy_version 785448 (0.0008) [2023-12-26 05:54:19,815][123090] Updated weights for policy 1, policy_version 785458 (0.0007) [2023-12-26 05:54:19,885][123090] Updated weights for policy 1, policy_version 785468 (0.0007) [2023-12-26 05:54:20,020][123091] Updated weights for policy 0, policy_version 791092 (0.0008) [2023-12-26 05:54:20,090][123091] Updated weights for policy 0, policy_version 791102 (0.0010) [2023-12-26 05:54:20,160][123091] Updated weights for policy 0, policy_version 791112 (0.0009) [2023-12-26 05:54:20,581][123090] Updated weights for policy 1, policy_version 785478 (0.0007) [2023-12-26 05:54:20,652][123090] Updated weights for policy 1, policy_version 785488 (0.0006) [2023-12-26 05:54:20,723][123090] Updated weights for policy 1, policy_version 785498 (0.0006) [2023-12-26 05:54:21,019][123091] Updated weights for policy 0, policy_version 791122 (0.0008) [2023-12-26 05:54:21,088][123091] Updated weights for policy 0, policy_version 791132 (0.0011) [2023-12-26 05:54:21,153][123091] Updated weights for policy 0, policy_version 791142 (0.0009) [2023-12-26 05:54:21,216][123091] Updated weights for policy 0, policy_version 791152 (0.0010) [2023-12-26 05:54:21,430][123090] Updated weights for policy 1, policy_version 785508 (0.0008) [2023-12-26 05:54:21,504][123090] Updated weights for policy 1, policy_version 785518 (0.0009) [2023-12-26 05:54:21,573][123090] Updated weights for policy 1, policy_version 785528 (0.0009) [2023-12-26 05:54:22,069][123091] Updated weights for policy 0, policy_version 791162 (0.0010) [2023-12-26 05:54:22,137][123091] Updated weights for policy 0, policy_version 791172 (0.0009) [2023-12-26 05:54:22,198][123091] Updated weights for policy 0, policy_version 791182 (0.0010) [2023-12-26 05:54:22,417][123090] Updated weights for policy 1, policy_version 785538 (0.0009) [2023-12-26 05:54:22,495][123090] Updated weights for policy 1, policy_version 785548 (0.0010) [2023-12-26 05:54:22,560][123090] Updated weights for policy 1, policy_version 785558 (0.0008) [2023-12-26 05:54:22,622][123090] Updated weights for policy 1, policy_version 785568 (0.0007) [2023-12-26 05:54:23,085][123091] Updated weights for policy 0, policy_version 791192 (0.0010) [2023-12-26 05:54:23,154][123091] Updated weights for policy 0, policy_version 791202 (0.0010) [2023-12-26 05:54:23,222][123091] Updated weights for policy 0, policy_version 791212 (0.0009) [2023-12-26 05:54:23,432][123090] Updated weights for policy 1, policy_version 785578 (0.0010) [2023-12-26 05:54:23,492][123090] Updated weights for policy 1, policy_version 785588 (0.0009) [2023-12-26 05:54:23,562][123090] Updated weights for policy 1, policy_version 785598 (0.0009) [2023-12-26 05:54:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.5, 300 sec: 17883.5). Total num frames: 403668992. Throughput: 0: 8918.4, 1: 8890.5. Samples: 403646356. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:23,785][121949] Avg episode reward: [(0, '6065.134'), (1, '5686.794')] [2023-12-26 05:54:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000791216_202555392.pth... [2023-12-26 05:54:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000785600_201113600.pth... [2023-12-26 05:54:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000790192_202293248.pth [2023-12-26 05:54:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000784576_200851456.pth [2023-12-26 05:54:24,047][123091] Updated weights for policy 0, policy_version 791222 (0.0010) [2023-12-26 05:54:24,095][123091] Updated weights for policy 0, policy_version 791232 (0.0009) [2023-12-26 05:54:24,159][123091] Updated weights for policy 0, policy_version 791242 (0.0009) [2023-12-26 05:54:24,374][123090] Updated weights for policy 1, policy_version 785608 (0.0010) [2023-12-26 05:54:24,434][123090] Updated weights for policy 1, policy_version 785618 (0.0009) [2023-12-26 05:54:24,489][123090] Updated weights for policy 1, policy_version 785628 (0.0009) [2023-12-26 05:54:24,950][123091] Updated weights for policy 0, policy_version 791252 (0.0008) [2023-12-26 05:54:25,014][123091] Updated weights for policy 0, policy_version 791262 (0.0009) [2023-12-26 05:54:25,069][123091] Updated weights for policy 0, policy_version 791272 (0.0006) [2023-12-26 05:54:25,333][123090] Updated weights for policy 1, policy_version 785638 (0.0010) [2023-12-26 05:54:25,407][123090] Updated weights for policy 1, policy_version 785648 (0.0010) [2023-12-26 05:54:25,462][123090] Updated weights for policy 1, policy_version 785658 (0.0010) [2023-12-26 05:54:25,848][123091] Updated weights for policy 0, policy_version 791282 (0.0006) [2023-12-26 05:54:25,902][123091] Updated weights for policy 0, policy_version 791292 (0.0007) [2023-12-26 05:54:25,953][123091] Updated weights for policy 0, policy_version 791302 (0.0006) [2023-12-26 05:54:25,998][123091] Updated weights for policy 0, policy_version 791312 (0.0005) [2023-12-26 05:54:26,227][123090] Updated weights for policy 1, policy_version 785668 (0.0008) [2023-12-26 05:54:26,294][123090] Updated weights for policy 1, policy_version 785678 (0.0005) [2023-12-26 05:54:26,357][123090] Updated weights for policy 1, policy_version 785688 (0.0008) [2023-12-26 05:54:26,763][123091] Updated weights for policy 0, policy_version 791322 (0.0011) [2023-12-26 05:54:26,818][123091] Updated weights for policy 0, policy_version 791332 (0.0010) [2023-12-26 05:54:26,866][123091] Updated weights for policy 0, policy_version 791342 (0.0010) [2023-12-26 05:54:26,987][123090] Updated weights for policy 1, policy_version 785698 (0.0006) [2023-12-26 05:54:27,048][123090] Updated weights for policy 1, policy_version 785708 (0.0006) [2023-12-26 05:54:27,107][123090] Updated weights for policy 1, policy_version 785718 (0.0008) [2023-12-26 05:54:27,172][123090] Updated weights for policy 1, policy_version 785728 (0.0007) [2023-12-26 05:54:27,641][123091] Updated weights for policy 0, policy_version 791352 (0.0006) [2023-12-26 05:54:27,688][123091] Updated weights for policy 0, policy_version 791362 (0.0005) [2023-12-26 05:54:27,742][123091] Updated weights for policy 0, policy_version 791372 (0.0005) [2023-12-26 05:54:27,877][123090] Updated weights for policy 1, policy_version 785738 (0.0007) [2023-12-26 05:54:27,943][123090] Updated weights for policy 1, policy_version 785748 (0.0008) [2023-12-26 05:54:28,007][123090] Updated weights for policy 1, policy_version 785758 (0.0009) [2023-12-26 05:54:28,509][123091] Updated weights for policy 0, policy_version 791382 (0.0009) [2023-12-26 05:54:28,559][123091] Updated weights for policy 0, policy_version 791392 (0.0010) [2023-12-26 05:54:28,607][123091] Updated weights for policy 0, policy_version 791402 (0.0010) [2023-12-26 05:54:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 403759104. Throughput: 0: 8914.1, 1: 8903.6. Samples: 403752224. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:28,785][121949] Avg episode reward: [(0, '5962.264'), (1, '5701.533')] [2023-12-26 05:54:28,804][123090] Updated weights for policy 1, policy_version 785768 (0.0006) [2023-12-26 05:54:28,850][123090] Updated weights for policy 1, policy_version 785778 (0.0005) [2023-12-26 05:54:28,907][123090] Updated weights for policy 1, policy_version 785788 (0.0007) [2023-12-26 05:54:29,378][123091] Updated weights for policy 0, policy_version 791412 (0.0010) [2023-12-26 05:54:29,438][123091] Updated weights for policy 0, policy_version 791422 (0.0011) [2023-12-26 05:54:29,489][123091] Updated weights for policy 0, policy_version 791432 (0.0010) [2023-12-26 05:54:29,761][123090] Updated weights for policy 1, policy_version 785798 (0.0009) [2023-12-26 05:54:29,835][123090] Updated weights for policy 1, policy_version 785808 (0.0009) [2023-12-26 05:54:29,904][123090] Updated weights for policy 1, policy_version 785818 (0.0006) [2023-12-26 05:54:30,290][123091] Updated weights for policy 0, policy_version 791442 (0.0011) [2023-12-26 05:54:30,356][123091] Updated weights for policy 0, policy_version 791452 (0.0010) [2023-12-26 05:54:30,422][123091] Updated weights for policy 0, policy_version 791462 (0.0010) [2023-12-26 05:54:30,487][123091] Updated weights for policy 0, policy_version 791472 (0.0009) [2023-12-26 05:54:30,660][123090] Updated weights for policy 1, policy_version 785828 (0.0007) [2023-12-26 05:54:30,715][123090] Updated weights for policy 1, policy_version 785838 (0.0009) [2023-12-26 05:54:30,763][123090] Updated weights for policy 1, policy_version 785848 (0.0009) [2023-12-26 05:54:31,332][123091] Updated weights for policy 0, policy_version 791482 (0.0010) [2023-12-26 05:54:31,402][123091] Updated weights for policy 0, policy_version 791492 (0.0010) [2023-12-26 05:54:31,453][123091] Updated weights for policy 0, policy_version 791502 (0.0009) [2023-12-26 05:54:31,589][123090] Updated weights for policy 1, policy_version 785858 (0.0007) [2023-12-26 05:54:31,664][123090] Updated weights for policy 1, policy_version 785868 (0.0010) [2023-12-26 05:54:31,734][123090] Updated weights for policy 1, policy_version 785878 (0.0009) [2023-12-26 05:54:31,796][123090] Updated weights for policy 1, policy_version 785888 (0.0009) [2023-12-26 05:54:32,192][123091] Updated weights for policy 0, policy_version 791512 (0.0009) [2023-12-26 05:54:32,257][123091] Updated weights for policy 0, policy_version 791522 (0.0008) [2023-12-26 05:54:32,328][123091] Updated weights for policy 0, policy_version 791532 (0.0007) [2023-12-26 05:54:32,699][123090] Updated weights for policy 1, policy_version 785898 (0.0009) [2023-12-26 05:54:32,773][123090] Updated weights for policy 1, policy_version 785908 (0.0010) [2023-12-26 05:54:32,832][123090] Updated weights for policy 1, policy_version 785918 (0.0010) [2023-12-26 05:54:32,938][123091] Updated weights for policy 0, policy_version 791542 (0.0007) [2023-12-26 05:54:32,985][123091] Updated weights for policy 0, policy_version 791552 (0.0005) [2023-12-26 05:54:33,035][123091] Updated weights for policy 0, policy_version 791562 (0.0005) [2023-12-26 05:54:33,728][123091] Updated weights for policy 0, policy_version 791572 (0.0005) [2023-12-26 05:54:33,740][123090] Updated weights for policy 1, policy_version 785928 (0.0010) [2023-12-26 05:54:33,780][123091] Updated weights for policy 0, policy_version 791582 (0.0005) [2023-12-26 05:54:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 403841024. Throughput: 0: 8914.3, 1: 8787.7. Samples: 403859280. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:33,785][121949] Avg episode reward: [(0, '5872.417'), (1, '5735.665')] [2023-12-26 05:54:33,806][123090] Updated weights for policy 1, policy_version 785938 (0.0010) [2023-12-26 05:54:33,833][123091] Updated weights for policy 0, policy_version 791592 (0.0005) [2023-12-26 05:54:33,865][123090] Updated weights for policy 1, policy_version 785948 (0.0008) [2023-12-26 05:54:34,585][123091] Updated weights for policy 0, policy_version 791602 (0.0006) [2023-12-26 05:54:34,660][123091] Updated weights for policy 0, policy_version 791612 (0.0009) [2023-12-26 05:54:34,724][123091] Updated weights for policy 0, policy_version 791622 (0.0009) [2023-12-26 05:54:34,729][123090] Updated weights for policy 1, policy_version 785958 (0.0007) [2023-12-26 05:54:34,790][123091] Updated weights for policy 0, policy_version 791632 (0.0009) [2023-12-26 05:54:34,792][123090] Updated weights for policy 1, policy_version 785968 (0.0007) [2023-12-26 05:54:34,860][123090] Updated weights for policy 1, policy_version 785978 (0.0009) [2023-12-26 05:54:35,548][123090] Updated weights for policy 1, policy_version 785988 (0.0008) [2023-12-26 05:54:35,595][123090] Updated weights for policy 1, policy_version 785998 (0.0005) [2023-12-26 05:54:35,654][123091] Updated weights for policy 0, policy_version 791642 (0.0008) [2023-12-26 05:54:35,654][123090] Updated weights for policy 1, policy_version 786008 (0.0006) [2023-12-26 05:54:35,714][123091] Updated weights for policy 0, policy_version 791652 (0.0009) [2023-12-26 05:54:35,777][123091] Updated weights for policy 0, policy_version 791662 (0.0016) [2023-12-26 05:54:36,357][123090] Updated weights for policy 1, policy_version 786018 (0.0007) [2023-12-26 05:54:36,439][123090] Updated weights for policy 1, policy_version 786028 (0.0010) [2023-12-26 05:54:36,502][123090] Updated weights for policy 1, policy_version 786038 (0.0010) [2023-12-26 05:54:36,563][123090] Updated weights for policy 1, policy_version 786048 (0.0011) [2023-12-26 05:54:36,662][123091] Updated weights for policy 0, policy_version 791673 (0.0009) [2023-12-26 05:54:36,723][123091] Updated weights for policy 0, policy_version 791683 (0.0009) [2023-12-26 05:54:36,779][123091] Updated weights for policy 0, policy_version 791693 (0.0009) [2023-12-26 05:54:37,400][123090] Updated weights for policy 1, policy_version 786058 (0.0011) [2023-12-26 05:54:37,471][123090] Updated weights for policy 1, policy_version 786068 (0.0011) [2023-12-26 05:54:37,541][123090] Updated weights for policy 1, policy_version 786078 (0.0011) [2023-12-26 05:54:37,585][123091] Updated weights for policy 0, policy_version 791703 (0.0008) [2023-12-26 05:54:37,658][123091] Updated weights for policy 0, policy_version 791713 (0.0009) [2023-12-26 05:54:37,721][123091] Updated weights for policy 0, policy_version 791723 (0.0009) [2023-12-26 05:54:38,201][123090] Updated weights for policy 1, policy_version 786088 (0.0007) [2023-12-26 05:54:38,263][123090] Updated weights for policy 1, policy_version 786098 (0.0006) [2023-12-26 05:54:38,337][123090] Updated weights for policy 1, policy_version 786108 (0.0006) [2023-12-26 05:54:38,445][123091] Updated weights for policy 0, policy_version 791733 (0.0008) [2023-12-26 05:54:38,516][123091] Updated weights for policy 0, policy_version 791743 (0.0009) [2023-12-26 05:54:38,577][123091] Updated weights for policy 0, policy_version 791753 (0.0010) [2023-12-26 05:54:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 403939328. Throughput: 0: 8925.0, 1: 8826.6. Samples: 403912124. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:38,785][121949] Avg episode reward: [(0, '6104.368'), (1, '5824.951')] [2023-12-26 05:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000791760_202694656.pth... [2023-12-26 05:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000786112_201244672.pth... [2023-12-26 05:54:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000785088_200982528.pth [2023-12-26 05:54:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000790736_202432512.pth [2023-12-26 05:54:39,096][123090] Updated weights for policy 1, policy_version 786118 (0.0009) [2023-12-26 05:54:39,155][123090] Updated weights for policy 1, policy_version 786128 (0.0010) [2023-12-26 05:54:39,206][123090] Updated weights for policy 1, policy_version 786138 (0.0010) [2023-12-26 05:54:39,338][123091] Updated weights for policy 0, policy_version 791763 (0.0008) [2023-12-26 05:54:39,411][123091] Updated weights for policy 0, policy_version 791773 (0.0009) [2023-12-26 05:54:39,474][123091] Updated weights for policy 0, policy_version 791783 (0.0010) [2023-12-26 05:54:40,027][123090] Updated weights for policy 1, policy_version 786149 (0.0010) [2023-12-26 05:54:40,091][123090] Updated weights for policy 1, policy_version 786159 (0.0011) [2023-12-26 05:54:40,158][123090] Updated weights for policy 1, policy_version 786169 (0.0011) [2023-12-26 05:54:40,344][123091] Updated weights for policy 0, policy_version 791793 (0.0010) [2023-12-26 05:54:40,410][123091] Updated weights for policy 0, policy_version 791803 (0.0009) [2023-12-26 05:54:40,478][123091] Updated weights for policy 0, policy_version 791813 (0.0010) [2023-12-26 05:54:40,536][123091] Updated weights for policy 0, policy_version 791823 (0.0008) [2023-12-26 05:54:40,961][123090] Updated weights for policy 1, policy_version 786179 (0.0010) [2023-12-26 05:54:41,028][123090] Updated weights for policy 1, policy_version 786189 (0.0011) [2023-12-26 05:54:41,097][123090] Updated weights for policy 1, policy_version 786199 (0.0011) [2023-12-26 05:54:41,400][123091] Updated weights for policy 0, policy_version 791833 (0.0010) [2023-12-26 05:54:41,461][123091] Updated weights for policy 0, policy_version 791843 (0.0010) [2023-12-26 05:54:41,531][123091] Updated weights for policy 0, policy_version 791853 (0.0009) [2023-12-26 05:54:41,850][123090] Updated weights for policy 1, policy_version 786209 (0.0010) [2023-12-26 05:54:41,921][123090] Updated weights for policy 1, policy_version 786219 (0.0011) [2023-12-26 05:54:41,985][123090] Updated weights for policy 1, policy_version 786229 (0.0011) [2023-12-26 05:54:42,050][123090] Updated weights for policy 1, policy_version 786239 (0.0011) [2023-12-26 05:54:42,362][123091] Updated weights for policy 0, policy_version 791863 (0.0011) [2023-12-26 05:54:42,430][123091] Updated weights for policy 0, policy_version 791873 (0.0006) [2023-12-26 05:54:42,486][123091] Updated weights for policy 0, policy_version 791883 (0.0006) [2023-12-26 05:54:42,847][123090] Updated weights for policy 1, policy_version 786249 (0.0011) [2023-12-26 05:54:42,918][123090] Updated weights for policy 1, policy_version 786259 (0.0011) [2023-12-26 05:54:42,987][123090] Updated weights for policy 1, policy_version 786269 (0.0011) [2023-12-26 05:54:43,257][123091] Updated weights for policy 0, policy_version 791893 (0.0009) [2023-12-26 05:54:43,329][123091] Updated weights for policy 0, policy_version 791903 (0.0008) [2023-12-26 05:54:43,400][123091] Updated weights for policy 0, policy_version 791913 (0.0008) [2023-12-26 05:54:43,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17911.3). Total num frames: 404021248. Throughput: 0: 8832.4, 1: 8798.2. Samples: 404016936. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:43,786][121949] Avg episode reward: [(0, '5972.327'), (1, '5831.521')] [2023-12-26 05:54:43,827][123090] Updated weights for policy 1, policy_version 786279 (0.0010) [2023-12-26 05:54:43,883][123090] Updated weights for policy 1, policy_version 786289 (0.0010) [2023-12-26 05:54:43,938][123090] Updated weights for policy 1, policy_version 786299 (0.0010) [2023-12-26 05:54:44,038][123091] Updated weights for policy 0, policy_version 791923 (0.0006) [2023-12-26 05:54:44,092][123091] Updated weights for policy 0, policy_version 791933 (0.0006) [2023-12-26 05:54:44,155][123091] Updated weights for policy 0, policy_version 791943 (0.0005) [2023-12-26 05:54:44,682][123090] Updated weights for policy 1, policy_version 786309 (0.0010) [2023-12-26 05:54:44,742][123090] Updated weights for policy 1, policy_version 786319 (0.0010) [2023-12-26 05:54:44,809][123090] Updated weights for policy 1, policy_version 786329 (0.0011) [2023-12-26 05:54:44,810][123091] Updated weights for policy 0, policy_version 791953 (0.0007) [2023-12-26 05:54:44,872][123091] Updated weights for policy 0, policy_version 791963 (0.0010) [2023-12-26 05:54:44,929][123091] Updated weights for policy 0, policy_version 791973 (0.0011) [2023-12-26 05:54:44,977][123091] Updated weights for policy 0, policy_version 791983 (0.0008) [2023-12-26 05:54:45,651][123090] Updated weights for policy 1, policy_version 786339 (0.0011) [2023-12-26 05:54:45,703][123090] Updated weights for policy 1, policy_version 786349 (0.0010) [2023-12-26 05:54:45,719][123091] Updated weights for policy 0, policy_version 791993 (0.0006) [2023-12-26 05:54:45,759][123090] Updated weights for policy 1, policy_version 786359 (0.0010) [2023-12-26 05:54:45,771][123091] Updated weights for policy 0, policy_version 792003 (0.0005) [2023-12-26 05:54:45,819][123091] Updated weights for policy 0, policy_version 792013 (0.0005) [2023-12-26 05:54:46,506][123090] Updated weights for policy 1, policy_version 786369 (0.0010) [2023-12-26 05:54:46,516][123091] Updated weights for policy 0, policy_version 792023 (0.0005) [2023-12-26 05:54:46,556][123090] Updated weights for policy 1, policy_version 786379 (0.0005) [2023-12-26 05:54:46,578][123091] Updated weights for policy 0, policy_version 792033 (0.0005) [2023-12-26 05:54:46,604][123090] Updated weights for policy 1, policy_version 786389 (0.0006) [2023-12-26 05:54:46,638][123091] Updated weights for policy 0, policy_version 792043 (0.0005) [2023-12-26 05:54:46,667][123090] Updated weights for policy 1, policy_version 786399 (0.0007) [2023-12-26 05:54:47,302][123090] Updated weights for policy 1, policy_version 786409 (0.0006) [2023-12-26 05:54:47,345][123091] Updated weights for policy 0, policy_version 792053 (0.0008) [2023-12-26 05:54:47,365][123090] Updated weights for policy 1, policy_version 786419 (0.0005) [2023-12-26 05:54:47,396][123091] Updated weights for policy 0, policy_version 792063 (0.0010) [2023-12-26 05:54:47,429][123090] Updated weights for policy 1, policy_version 786429 (0.0005) [2023-12-26 05:54:47,452][123091] Updated weights for policy 0, policy_version 792073 (0.0010) [2023-12-26 05:54:48,006][123090] Updated weights for policy 1, policy_version 786439 (0.0006) [2023-12-26 05:54:48,071][123090] Updated weights for policy 1, policy_version 786449 (0.0006) [2023-12-26 05:54:48,145][123090] Updated weights for policy 1, policy_version 786459 (0.0005) [2023-12-26 05:54:48,147][123091] Updated weights for policy 0, policy_version 792083 (0.0008) [2023-12-26 05:54:48,213][123091] Updated weights for policy 0, policy_version 792093 (0.0006) [2023-12-26 05:54:48,270][123091] Updated weights for policy 0, policy_version 792103 (0.0005) [2023-12-26 05:54:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 404119552. Throughput: 0: 8956.8, 1: 8957.3. Samples: 404133548. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:48,785][121949] Avg episode reward: [(0, '5808.841'), (1, '5794.421')] [2023-12-26 05:54:48,831][123090] Updated weights for policy 1, policy_version 786469 (0.0005) [2023-12-26 05:54:48,897][123090] Updated weights for policy 1, policy_version 786479 (0.0006) [2023-12-26 05:54:48,934][123091] Updated weights for policy 0, policy_version 792113 (0.0008) [2023-12-26 05:54:48,965][123090] Updated weights for policy 1, policy_version 786489 (0.0006) [2023-12-26 05:54:48,988][123091] Updated weights for policy 0, policy_version 792123 (0.0008) [2023-12-26 05:54:49,048][123091] Updated weights for policy 0, policy_version 792133 (0.0009) [2023-12-26 05:54:49,110][123091] Updated weights for policy 0, policy_version 792143 (0.0009) [2023-12-26 05:54:49,764][123090] Updated weights for policy 1, policy_version 786499 (0.0008) [2023-12-26 05:54:49,824][123090] Updated weights for policy 1, policy_version 786509 (0.0009) [2023-12-26 05:54:49,904][123090] Updated weights for policy 1, policy_version 786519 (0.0010) [2023-12-26 05:54:49,979][123091] Updated weights for policy 0, policy_version 792153 (0.0009) [2023-12-26 05:54:50,033][123091] Updated weights for policy 0, policy_version 792163 (0.0010) [2023-12-26 05:54:50,087][123091] Updated weights for policy 0, policy_version 792173 (0.0010) [2023-12-26 05:54:50,635][123090] Updated weights for policy 1, policy_version 786529 (0.0008) [2023-12-26 05:54:50,693][123090] Updated weights for policy 1, policy_version 786539 (0.0009) [2023-12-26 05:54:50,759][123090] Updated weights for policy 1, policy_version 786549 (0.0009) [2023-12-26 05:54:50,820][123090] Updated weights for policy 1, policy_version 786559 (0.0009) [2023-12-26 05:54:51,002][123091] Updated weights for policy 0, policy_version 792183 (0.0011) [2023-12-26 05:54:51,072][123091] Updated weights for policy 0, policy_version 792193 (0.0011) [2023-12-26 05:54:51,130][123091] Updated weights for policy 0, policy_version 792203 (0.0011) [2023-12-26 05:54:51,599][123090] Updated weights for policy 1, policy_version 786569 (0.0006) [2023-12-26 05:54:51,674][123090] Updated weights for policy 1, policy_version 786579 (0.0008) [2023-12-26 05:54:51,743][123090] Updated weights for policy 1, policy_version 786589 (0.0008) [2023-12-26 05:54:51,904][123091] Updated weights for policy 0, policy_version 792213 (0.0008) [2023-12-26 05:54:51,974][123091] Updated weights for policy 0, policy_version 792223 (0.0009) [2023-12-26 05:54:52,040][123091] Updated weights for policy 0, policy_version 792233 (0.0008) [2023-12-26 05:54:52,595][123090] Updated weights for policy 1, policy_version 786599 (0.0008) [2023-12-26 05:54:52,655][123090] Updated weights for policy 1, policy_version 786609 (0.0009) [2023-12-26 05:54:52,720][123090] Updated weights for policy 1, policy_version 786619 (0.0009) [2023-12-26 05:54:52,764][123091] Updated weights for policy 0, policy_version 792243 (0.0009) [2023-12-26 05:54:52,824][123091] Updated weights for policy 0, policy_version 792253 (0.0011) [2023-12-26 05:54:52,883][123091] Updated weights for policy 0, policy_version 792263 (0.0011) [2023-12-26 05:54:53,542][123090] Updated weights for policy 1, policy_version 786629 (0.0009) [2023-12-26 05:54:53,610][123090] Updated weights for policy 1, policy_version 786639 (0.0009) [2023-12-26 05:54:53,685][123090] Updated weights for policy 1, policy_version 786649 (0.0009) [2023-12-26 05:54:53,690][123091] Updated weights for policy 0, policy_version 792273 (0.0011) [2023-12-26 05:54:53,747][123091] Updated weights for policy 0, policy_version 792283 (0.0006) [2023-12-26 05:54:53,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 404209664. Throughput: 0: 8925.8, 1: 8972.8. Samples: 404186136. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:53,785][121949] Avg episode reward: [(0, '5838.192'), (1, '5747.962')] [2023-12-26 05:54:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000786656_201383936.pth... [2023-12-26 05:54:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000785600_201113600.pth [2023-12-26 05:54:53,800][123091] Updated weights for policy 0, policy_version 792293 (0.0008) [2023-12-26 05:54:53,849][123091] Updated weights for policy 0, policy_version 792303 (0.0009) [2023-12-26 05:54:53,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000792304_202833920.pth... [2023-12-26 05:54:53,854][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000791216_202555392.pth [2023-12-26 05:54:54,555][123090] Updated weights for policy 1, policy_version 786659 (0.0009) [2023-12-26 05:54:54,622][123090] Updated weights for policy 1, policy_version 786669 (0.0009) [2023-12-26 05:54:54,636][123091] Updated weights for policy 0, policy_version 792313 (0.0008) [2023-12-26 05:54:54,683][123090] Updated weights for policy 1, policy_version 786679 (0.0009) [2023-12-26 05:54:54,693][123091] Updated weights for policy 0, policy_version 792323 (0.0009) [2023-12-26 05:54:54,749][123091] Updated weights for policy 0, policy_version 792333 (0.0007) [2023-12-26 05:54:55,484][123090] Updated weights for policy 1, policy_version 786689 (0.0009) [2023-12-26 05:54:55,557][123090] Updated weights for policy 1, policy_version 786699 (0.0007) [2023-12-26 05:54:55,587][123091] Updated weights for policy 0, policy_version 792343 (0.0009) [2023-12-26 05:54:55,626][123090] Updated weights for policy 1, policy_version 786709 (0.0005) [2023-12-26 05:54:55,642][123091] Updated weights for policy 0, policy_version 792353 (0.0008) [2023-12-26 05:54:55,679][123090] Updated weights for policy 1, policy_version 786719 (0.0006) [2023-12-26 05:54:55,690][123091] Updated weights for policy 0, policy_version 792363 (0.0007) [2023-12-26 05:54:56,477][123090] Updated weights for policy 1, policy_version 786729 (0.0009) [2023-12-26 05:54:56,539][123091] Updated weights for policy 0, policy_version 792373 (0.0009) [2023-12-26 05:54:56,539][123090] Updated weights for policy 1, policy_version 786739 (0.0009) [2023-12-26 05:54:56,597][123090] Updated weights for policy 1, policy_version 786749 (0.0009) [2023-12-26 05:54:56,599][123091] Updated weights for policy 0, policy_version 792383 (0.0007) [2023-12-26 05:54:56,654][123091] Updated weights for policy 0, policy_version 792393 (0.0009) [2023-12-26 05:54:57,412][123090] Updated weights for policy 1, policy_version 786759 (0.0009) [2023-12-26 05:54:57,473][123090] Updated weights for policy 1, policy_version 786769 (0.0011) [2023-12-26 05:54:57,485][123091] Updated weights for policy 0, policy_version 792403 (0.0008) [2023-12-26 05:54:57,533][123090] Updated weights for policy 1, policy_version 786779 (0.0005) [2023-12-26 05:54:57,543][123091] Updated weights for policy 0, policy_version 792413 (0.0006) [2023-12-26 05:54:57,596][123091] Updated weights for policy 0, policy_version 792423 (0.0005) [2023-12-26 05:54:58,274][123090] Updated weights for policy 1, policy_version 786789 (0.0006) [2023-12-26 05:54:58,349][123090] Updated weights for policy 1, policy_version 786799 (0.0008) [2023-12-26 05:54:58,411][123091] Updated weights for policy 0, policy_version 792433 (0.0005) [2023-12-26 05:54:58,425][123090] Updated weights for policy 1, policy_version 786809 (0.0007) [2023-12-26 05:54:58,488][123091] Updated weights for policy 0, policy_version 792443 (0.0010) [2023-12-26 05:54:58,551][123091] Updated weights for policy 0, policy_version 792453 (0.0009) [2023-12-26 05:54:58,612][123091] Updated weights for policy 0, policy_version 792463 (0.0010) [2023-12-26 05:54:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 404299776. Throughput: 0: 8931.6, 1: 8957.3. Samples: 404290816. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:54:58,785][121949] Avg episode reward: [(0, '5970.644'), (1, '5686.509')] [2023-12-26 05:54:59,199][123090] Updated weights for policy 1, policy_version 786819 (0.0009) [2023-12-26 05:54:59,270][123090] Updated weights for policy 1, policy_version 786829 (0.0009) [2023-12-26 05:54:59,325][123090] Updated weights for policy 1, policy_version 786839 (0.0009) [2023-12-26 05:54:59,588][123091] Updated weights for policy 0, policy_version 792473 (0.0006) [2023-12-26 05:54:59,655][123091] Updated weights for policy 0, policy_version 792483 (0.0005) [2023-12-26 05:54:59,716][123091] Updated weights for policy 0, policy_version 792493 (0.0005) [2023-12-26 05:55:00,157][123090] Updated weights for policy 1, policy_version 786849 (0.0007) [2023-12-26 05:55:00,215][123090] Updated weights for policy 1, policy_version 786859 (0.0009) [2023-12-26 05:55:00,274][123090] Updated weights for policy 1, policy_version 786869 (0.0009) [2023-12-26 05:55:00,330][123090] Updated weights for policy 1, policy_version 786879 (0.0010) [2023-12-26 05:55:00,390][123091] Updated weights for policy 0, policy_version 792503 (0.0006) [2023-12-26 05:55:00,443][123091] Updated weights for policy 0, policy_version 792513 (0.0005) [2023-12-26 05:55:00,496][123091] Updated weights for policy 0, policy_version 792523 (0.0006) [2023-12-26 05:55:01,200][123090] Updated weights for policy 1, policy_version 786889 (0.0009) [2023-12-26 05:55:01,254][123090] Updated weights for policy 1, policy_version 786899 (0.0009) [2023-12-26 05:55:01,283][123091] Updated weights for policy 0, policy_version 792533 (0.0009) [2023-12-26 05:55:01,322][123090] Updated weights for policy 1, policy_version 786909 (0.0009) [2023-12-26 05:55:01,348][123091] Updated weights for policy 0, policy_version 792543 (0.0008) [2023-12-26 05:55:01,417][123091] Updated weights for policy 0, policy_version 792553 (0.0008) [2023-12-26 05:55:02,148][123091] Updated weights for policy 0, policy_version 792563 (0.0009) [2023-12-26 05:55:02,202][123091] Updated weights for policy 0, policy_version 792573 (0.0009) [2023-12-26 05:55:02,222][123090] Updated weights for policy 1, policy_version 786919 (0.0009) [2023-12-26 05:55:02,262][123091] Updated weights for policy 0, policy_version 792583 (0.0007) [2023-12-26 05:55:02,286][123090] Updated weights for policy 1, policy_version 786929 (0.0011) [2023-12-26 05:55:02,342][123090] Updated weights for policy 1, policy_version 786939 (0.0011) [2023-12-26 05:55:03,030][123091] Updated weights for policy 0, policy_version 792593 (0.0009) [2023-12-26 05:55:03,056][123090] Updated weights for policy 1, policy_version 786949 (0.0011) [2023-12-26 05:55:03,080][123091] Updated weights for policy 0, policy_version 792603 (0.0008) [2023-12-26 05:55:03,117][123090] Updated weights for policy 1, policy_version 786959 (0.0008) [2023-12-26 05:55:03,127][123091] Updated weights for policy 0, policy_version 792613 (0.0008) [2023-12-26 05:55:03,174][123091] Updated weights for policy 0, policy_version 792623 (0.0008) [2023-12-26 05:55:03,176][123090] Updated weights for policy 1, policy_version 786969 (0.0009) [2023-12-26 05:55:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 404381696. Throughput: 0: 8940.0, 1: 8897.5. Samples: 404396228. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:03,784][121949] Avg episode reward: [(0, '6081.949'), (1, '5760.396')] [2023-12-26 05:55:03,927][123090] Updated weights for policy 1, policy_version 786979 (0.0010) [2023-12-26 05:55:03,990][123090] Updated weights for policy 1, policy_version 786989 (0.0010) [2023-12-26 05:55:04,054][123091] Updated weights for policy 0, policy_version 792633 (0.0007) [2023-12-26 05:55:04,055][123090] Updated weights for policy 1, policy_version 786999 (0.0011) [2023-12-26 05:55:04,116][123091] Updated weights for policy 0, policy_version 792643 (0.0010) [2023-12-26 05:55:04,190][123091] Updated weights for policy 0, policy_version 792653 (0.0010) [2023-12-26 05:55:04,788][123090] Updated weights for policy 1, policy_version 787009 (0.0008) [2023-12-26 05:55:04,857][123090] Updated weights for policy 1, policy_version 787019 (0.0010) [2023-12-26 05:55:04,912][123090] Updated weights for policy 1, policy_version 787029 (0.0010) [2023-12-26 05:55:04,967][123090] Updated weights for policy 1, policy_version 787039 (0.0010) [2023-12-26 05:55:05,009][123091] Updated weights for policy 0, policy_version 792663 (0.0009) [2023-12-26 05:55:05,077][123091] Updated weights for policy 0, policy_version 792673 (0.0009) [2023-12-26 05:55:05,144][123091] Updated weights for policy 0, policy_version 792683 (0.0009) [2023-12-26 05:55:05,772][123090] Updated weights for policy 1, policy_version 787049 (0.0010) [2023-12-26 05:55:05,831][123090] Updated weights for policy 1, policy_version 787059 (0.0010) [2023-12-26 05:55:05,896][123090] Updated weights for policy 1, policy_version 787069 (0.0010) [2023-12-26 05:55:05,970][123091] Updated weights for policy 0, policy_version 792693 (0.0007) [2023-12-26 05:55:06,022][123091] Updated weights for policy 0, policy_version 792703 (0.0009) [2023-12-26 05:55:06,079][123091] Updated weights for policy 0, policy_version 792713 (0.0009) [2023-12-26 05:55:06,722][123090] Updated weights for policy 1, policy_version 787079 (0.0010) [2023-12-26 05:55:06,785][123090] Updated weights for policy 1, policy_version 787089 (0.0010) [2023-12-26 05:55:06,841][123090] Updated weights for policy 1, policy_version 787099 (0.0010) [2023-12-26 05:55:06,909][123091] Updated weights for policy 0, policy_version 792723 (0.0009) [2023-12-26 05:55:06,965][123091] Updated weights for policy 0, policy_version 792733 (0.0010) [2023-12-26 05:55:07,020][123091] Updated weights for policy 0, policy_version 792743 (0.0010) [2023-12-26 05:55:07,606][123090] Updated weights for policy 1, policy_version 787109 (0.0008) [2023-12-26 05:55:07,663][123090] Updated weights for policy 1, policy_version 787119 (0.0006) [2023-12-26 05:55:07,721][123090] Updated weights for policy 1, policy_version 787129 (0.0007) [2023-12-26 05:55:07,787][123091] Updated weights for policy 0, policy_version 792753 (0.0010) [2023-12-26 05:55:07,841][123091] Updated weights for policy 0, policy_version 792763 (0.0010) [2023-12-26 05:55:07,899][123091] Updated weights for policy 0, policy_version 792773 (0.0009) [2023-12-26 05:55:07,962][123091] Updated weights for policy 0, policy_version 792783 (0.0005) [2023-12-26 05:55:08,482][123090] Updated weights for policy 1, policy_version 787139 (0.0006) [2023-12-26 05:55:08,542][123090] Updated weights for policy 1, policy_version 787149 (0.0009) [2023-12-26 05:55:08,602][123090] Updated weights for policy 1, policy_version 787159 (0.0009) [2023-12-26 05:55:08,723][123091] Updated weights for policy 0, policy_version 792793 (0.0006) [2023-12-26 05:55:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 404471808. Throughput: 0: 8939.1, 1: 8879.6. Samples: 404448196. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:08,784][121949] Avg episode reward: [(0, '6128.182'), (1, '5801.598')] [2023-12-26 05:55:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000787168_201515008.pth... [2023-12-26 05:55:08,792][123091] Updated weights for policy 0, policy_version 792803 (0.0006) [2023-12-26 05:55:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000786112_201244672.pth [2023-12-26 05:55:08,864][123091] Updated weights for policy 0, policy_version 792813 (0.0006) [2023-12-26 05:55:08,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000792816_202964992.pth... [2023-12-26 05:55:08,890][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000791760_202694656.pth [2023-12-26 05:55:09,511][123091] Updated weights for policy 0, policy_version 792823 (0.0005) [2023-12-26 05:55:09,546][123090] Updated weights for policy 1, policy_version 787169 (0.0009) [2023-12-26 05:55:09,577][123091] Updated weights for policy 0, policy_version 792833 (0.0006) [2023-12-26 05:55:09,613][123090] Updated weights for policy 1, policy_version 787179 (0.0009) [2023-12-26 05:55:09,642][123091] Updated weights for policy 0, policy_version 792843 (0.0006) [2023-12-26 05:55:09,680][123090] Updated weights for policy 1, policy_version 787189 (0.0009) [2023-12-26 05:55:09,736][123090] Updated weights for policy 1, policy_version 787199 (0.0009) [2023-12-26 05:55:10,442][123091] Updated weights for policy 0, policy_version 792853 (0.0008) [2023-12-26 05:55:10,503][123091] Updated weights for policy 0, policy_version 792863 (0.0009) [2023-12-26 05:55:10,576][123091] Updated weights for policy 0, policy_version 792873 (0.0008) [2023-12-26 05:55:10,596][123090] Updated weights for policy 1, policy_version 787209 (0.0009) [2023-12-26 05:55:10,647][123090] Updated weights for policy 1, policy_version 787219 (0.0010) [2023-12-26 05:55:10,713][123090] Updated weights for policy 1, policy_version 787229 (0.0009) [2023-12-26 05:55:11,401][123091] Updated weights for policy 0, policy_version 792883 (0.0008) [2023-12-26 05:55:11,460][123091] Updated weights for policy 0, policy_version 792893 (0.0009) [2023-12-26 05:55:11,520][123091] Updated weights for policy 0, policy_version 792903 (0.0008) [2023-12-26 05:55:11,619][123090] Updated weights for policy 1, policy_version 787239 (0.0009) [2023-12-26 05:55:11,690][123090] Updated weights for policy 1, policy_version 787249 (0.0009) [2023-12-26 05:55:11,764][123090] Updated weights for policy 1, policy_version 787259 (0.0010) [2023-12-26 05:55:12,284][123091] Updated weights for policy 0, policy_version 792913 (0.0006) [2023-12-26 05:55:12,351][123091] Updated weights for policy 0, policy_version 792923 (0.0010) [2023-12-26 05:55:12,419][123091] Updated weights for policy 0, policy_version 792933 (0.0009) [2023-12-26 05:55:12,484][123091] Updated weights for policy 0, policy_version 792943 (0.0010) [2023-12-26 05:55:12,607][123090] Updated weights for policy 1, policy_version 787269 (0.0007) [2023-12-26 05:55:12,676][123090] Updated weights for policy 1, policy_version 787279 (0.0007) [2023-12-26 05:55:12,749][123090] Updated weights for policy 1, policy_version 787290 (0.0010) [2023-12-26 05:55:13,355][123091] Updated weights for policy 0, policy_version 792953 (0.0008) [2023-12-26 05:55:13,420][123091] Updated weights for policy 0, policy_version 792963 (0.0009) [2023-12-26 05:55:13,455][123090] Updated weights for policy 1, policy_version 787300 (0.0008) [2023-12-26 05:55:13,475][123091] Updated weights for policy 0, policy_version 792973 (0.0008) [2023-12-26 05:55:13,515][123090] Updated weights for policy 1, policy_version 787310 (0.0009) [2023-12-26 05:55:13,574][123090] Updated weights for policy 1, policy_version 787320 (0.0010) [2023-12-26 05:55:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 404561920. Throughput: 0: 8973.8, 1: 8800.8. Samples: 404552088. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:13,785][121949] Avg episode reward: [(0, '6119.821'), (1, '5628.430')] [2023-12-26 05:55:14,078][123091] Updated weights for policy 0, policy_version 792983 (0.0009) [2023-12-26 05:55:14,146][123091] Updated weights for policy 0, policy_version 792993 (0.0009) [2023-12-26 05:55:14,206][123091] Updated weights for policy 0, policy_version 793003 (0.0009) [2023-12-26 05:55:14,446][123090] Updated weights for policy 1, policy_version 787330 (0.0010) [2023-12-26 05:55:14,501][123090] Updated weights for policy 1, policy_version 787340 (0.0009) [2023-12-26 05:55:14,554][123090] Updated weights for policy 1, policy_version 787350 (0.0009) [2023-12-26 05:55:14,617][123090] Updated weights for policy 1, policy_version 787360 (0.0008) [2023-12-26 05:55:15,013][123091] Updated weights for policy 0, policy_version 793013 (0.0008) [2023-12-26 05:55:15,084][123091] Updated weights for policy 0, policy_version 793023 (0.0007) [2023-12-26 05:55:15,140][123091] Updated weights for policy 0, policy_version 793033 (0.0009) [2023-12-26 05:55:15,438][123090] Updated weights for policy 1, policy_version 787370 (0.0010) [2023-12-26 05:55:15,493][123090] Updated weights for policy 1, policy_version 787380 (0.0009) [2023-12-26 05:55:15,554][123090] Updated weights for policy 1, policy_version 787390 (0.0009) [2023-12-26 05:55:15,987][123091] Updated weights for policy 0, policy_version 793043 (0.0009) [2023-12-26 05:55:16,051][123091] Updated weights for policy 0, policy_version 793053 (0.0007) [2023-12-26 05:55:16,110][123091] Updated weights for policy 0, policy_version 793063 (0.0009) [2023-12-26 05:55:16,330][123090] Updated weights for policy 1, policy_version 787400 (0.0006) [2023-12-26 05:55:16,375][123090] Updated weights for policy 1, policy_version 787410 (0.0005) [2023-12-26 05:55:16,422][123090] Updated weights for policy 1, policy_version 787420 (0.0005) [2023-12-26 05:55:16,844][123091] Updated weights for policy 0, policy_version 793073 (0.0008) [2023-12-26 05:55:16,901][123091] Updated weights for policy 0, policy_version 793083 (0.0005) [2023-12-26 05:55:16,949][123091] Updated weights for policy 0, policy_version 793093 (0.0005) [2023-12-26 05:55:17,002][123091] Updated weights for policy 0, policy_version 793103 (0.0005) [2023-12-26 05:55:17,073][123090] Updated weights for policy 1, policy_version 787430 (0.0007) [2023-12-26 05:55:17,127][123090] Updated weights for policy 1, policy_version 787440 (0.0010) [2023-12-26 05:55:17,197][123090] Updated weights for policy 1, policy_version 787450 (0.0010) [2023-12-26 05:55:17,683][123091] Updated weights for policy 0, policy_version 793113 (0.0005) [2023-12-26 05:55:17,754][123091] Updated weights for policy 0, policy_version 793123 (0.0009) [2023-12-26 05:55:17,814][123091] Updated weights for policy 0, policy_version 793133 (0.0010) [2023-12-26 05:55:17,968][123090] Updated weights for policy 1, policy_version 787460 (0.0009) [2023-12-26 05:55:18,025][123090] Updated weights for policy 1, policy_version 787470 (0.0009) [2023-12-26 05:55:18,078][123090] Updated weights for policy 1, policy_version 787480 (0.0009) [2023-12-26 05:55:18,543][123091] Updated weights for policy 0, policy_version 793143 (0.0009) [2023-12-26 05:55:18,607][123091] Updated weights for policy 0, policy_version 793153 (0.0011) [2023-12-26 05:55:18,674][123091] Updated weights for policy 0, policy_version 793163 (0.0011) [2023-12-26 05:55:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 404652032. Throughput: 0: 8965.0, 1: 8855.1. Samples: 404661188. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:18,785][121949] Avg episode reward: [(0, '6127.294'), (1, '5669.332')] [2023-12-26 05:55:19,021][123090] Updated weights for policy 1, policy_version 787490 (0.0009) [2023-12-26 05:55:19,094][123090] Updated weights for policy 1, policy_version 787500 (0.0006) [2023-12-26 05:55:19,165][123090] Updated weights for policy 1, policy_version 787510 (0.0005) [2023-12-26 05:55:19,233][123090] Updated weights for policy 1, policy_version 787520 (0.0007) [2023-12-26 05:55:19,451][123091] Updated weights for policy 0, policy_version 793173 (0.0008) [2023-12-26 05:55:19,514][123091] Updated weights for policy 0, policy_version 793183 (0.0007) [2023-12-26 05:55:19,582][123091] Updated weights for policy 0, policy_version 793193 (0.0010) [2023-12-26 05:55:20,027][123090] Updated weights for policy 1, policy_version 787530 (0.0009) [2023-12-26 05:55:20,106][123090] Updated weights for policy 1, policy_version 787540 (0.0007) [2023-12-26 05:55:20,176][123090] Updated weights for policy 1, policy_version 787550 (0.0009) [2023-12-26 05:55:20,379][123091] Updated weights for policy 0, policy_version 793203 (0.0011) [2023-12-26 05:55:20,439][123091] Updated weights for policy 0, policy_version 793213 (0.0011) [2023-12-26 05:55:20,496][123091] Updated weights for policy 0, policy_version 793223 (0.0011) [2023-12-26 05:55:20,928][123090] Updated weights for policy 1, policy_version 787560 (0.0009) [2023-12-26 05:55:20,996][123090] Updated weights for policy 1, policy_version 787570 (0.0009) [2023-12-26 05:55:21,066][123090] Updated weights for policy 1, policy_version 787580 (0.0009) [2023-12-26 05:55:21,319][123091] Updated weights for policy 0, policy_version 793233 (0.0011) [2023-12-26 05:55:21,377][123091] Updated weights for policy 0, policy_version 793243 (0.0008) [2023-12-26 05:55:21,451][123091] Updated weights for policy 0, policy_version 793253 (0.0008) [2023-12-26 05:55:21,519][123091] Updated weights for policy 0, policy_version 793263 (0.0009) [2023-12-26 05:55:21,936][123090] Updated weights for policy 1, policy_version 787590 (0.0010) [2023-12-26 05:55:22,007][123090] Updated weights for policy 1, policy_version 787600 (0.0011) [2023-12-26 05:55:22,068][123090] Updated weights for policy 1, policy_version 787610 (0.0011) [2023-12-26 05:55:22,361][123091] Updated weights for policy 0, policy_version 793273 (0.0010) [2023-12-26 05:55:22,429][123091] Updated weights for policy 0, policy_version 793283 (0.0009) [2023-12-26 05:55:22,481][123091] Updated weights for policy 0, policy_version 793293 (0.0009) [2023-12-26 05:55:22,873][123090] Updated weights for policy 1, policy_version 787620 (0.0010) [2023-12-26 05:55:22,926][123090] Updated weights for policy 1, policy_version 787630 (0.0011) [2023-12-26 05:55:22,995][123090] Updated weights for policy 1, policy_version 787640 (0.0011) [2023-12-26 05:55:23,349][123091] Updated weights for policy 0, policy_version 793303 (0.0010) [2023-12-26 05:55:23,404][123091] Updated weights for policy 0, policy_version 793313 (0.0009) [2023-12-26 05:55:23,458][123091] Updated weights for policy 0, policy_version 793323 (0.0009) [2023-12-26 05:55:23,763][123090] Updated weights for policy 1, policy_version 787650 (0.0010) [2023-12-26 05:55:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 404733952. Throughput: 0: 8972.0, 1: 8824.1. Samples: 404712948. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:23,785][121949] Avg episode reward: [(0, '6084.577'), (1, '5763.696')] [2023-12-26 05:55:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000793328_203096064.pth... [2023-12-26 05:55:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000792304_202833920.pth [2023-12-26 05:55:23,815][123090] Updated weights for policy 1, policy_version 787660 (0.0005) [2023-12-26 05:55:23,864][123090] Updated weights for policy 1, policy_version 787670 (0.0005) [2023-12-26 05:55:23,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000787680_201646080.pth... [2023-12-26 05:55:23,916][123090] Updated weights for policy 1, policy_version 787680 (0.0006) [2023-12-26 05:55:23,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000786656_201383936.pth [2023-12-26 05:55:24,353][123091] Updated weights for policy 0, policy_version 793334 (0.0009) [2023-12-26 05:55:24,413][123091] Updated weights for policy 0, policy_version 793344 (0.0009) [2023-12-26 05:55:24,470][123091] Updated weights for policy 0, policy_version 793354 (0.0009) [2023-12-26 05:55:24,725][123090] Updated weights for policy 1, policy_version 787690 (0.0005) [2023-12-26 05:55:24,790][123090] Updated weights for policy 1, policy_version 787700 (0.0006) [2023-12-26 05:55:24,851][123090] Updated weights for policy 1, policy_version 787710 (0.0005) [2023-12-26 05:55:25,371][123091] Updated weights for policy 0, policy_version 793364 (0.0009) [2023-12-26 05:55:25,428][123091] Updated weights for policy 0, policy_version 793374 (0.0010) [2023-12-26 05:55:25,485][123091] Updated weights for policy 0, policy_version 793384 (0.0010) [2023-12-26 05:55:25,512][123090] Updated weights for policy 1, policy_version 787720 (0.0005) [2023-12-26 05:55:25,566][123090] Updated weights for policy 1, policy_version 787730 (0.0005) [2023-12-26 05:55:25,628][123090] Updated weights for policy 1, policy_version 787740 (0.0005) [2023-12-26 05:55:26,316][123090] Updated weights for policy 1, policy_version 787750 (0.0007) [2023-12-26 05:55:26,377][123091] Updated weights for policy 0, policy_version 793394 (0.0009) [2023-12-26 05:55:26,388][123090] Updated weights for policy 1, policy_version 787760 (0.0006) [2023-12-26 05:55:26,443][123091] Updated weights for policy 0, policy_version 793404 (0.0009) [2023-12-26 05:55:26,450][123090] Updated weights for policy 1, policy_version 787770 (0.0008) [2023-12-26 05:55:26,503][123091] Updated weights for policy 0, policy_version 793414 (0.0009) [2023-12-26 05:55:26,558][123091] Updated weights for policy 0, policy_version 793424 (0.0009) [2023-12-26 05:55:27,137][123090] Updated weights for policy 1, policy_version 787780 (0.0008) [2023-12-26 05:55:27,202][123090] Updated weights for policy 1, policy_version 787790 (0.0009) [2023-12-26 05:55:27,283][123090] Updated weights for policy 1, policy_version 787800 (0.0010) [2023-12-26 05:55:27,402][123091] Updated weights for policy 0, policy_version 793434 (0.0008) [2023-12-26 05:55:27,462][123091] Updated weights for policy 0, policy_version 793444 (0.0009) [2023-12-26 05:55:27,515][123091] Updated weights for policy 0, policy_version 793454 (0.0010) [2023-12-26 05:55:28,047][123090] Updated weights for policy 1, policy_version 787810 (0.0007) [2023-12-26 05:55:28,107][123090] Updated weights for policy 1, policy_version 787820 (0.0010) [2023-12-26 05:55:28,158][123090] Updated weights for policy 1, policy_version 787830 (0.0009) [2023-12-26 05:55:28,206][123090] Updated weights for policy 1, policy_version 787840 (0.0008) [2023-12-26 05:55:28,343][123091] Updated weights for policy 0, policy_version 793464 (0.0010) [2023-12-26 05:55:28,407][123091] Updated weights for policy 0, policy_version 793474 (0.0010) [2023-12-26 05:55:28,476][123091] Updated weights for policy 0, policy_version 793484 (0.0009) [2023-12-26 05:55:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 404824064. Throughput: 0: 8909.9, 1: 8871.5. Samples: 404817092. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:28,784][121949] Avg episode reward: [(0, '6085.425'), (1, '5797.727')] [2023-12-26 05:55:29,024][123090] Updated weights for policy 1, policy_version 787850 (0.0007) [2023-12-26 05:55:29,071][123090] Updated weights for policy 1, policy_version 787860 (0.0005) [2023-12-26 05:55:29,116][123090] Updated weights for policy 1, policy_version 787870 (0.0005) [2023-12-26 05:55:29,324][123091] Updated weights for policy 0, policy_version 793494 (0.0009) [2023-12-26 05:55:29,396][123091] Updated weights for policy 0, policy_version 793504 (0.0009) [2023-12-26 05:55:29,465][123091] Updated weights for policy 0, policy_version 793514 (0.0009) [2023-12-26 05:55:29,888][123090] Updated weights for policy 1, policy_version 787880 (0.0007) [2023-12-26 05:55:29,956][123090] Updated weights for policy 1, policy_version 787890 (0.0008) [2023-12-26 05:55:30,018][123090] Updated weights for policy 1, policy_version 787900 (0.0009) [2023-12-26 05:55:30,334][123091] Updated weights for policy 0, policy_version 793524 (0.0010) [2023-12-26 05:55:30,404][123091] Updated weights for policy 0, policy_version 793534 (0.0010) [2023-12-26 05:55:30,470][123091] Updated weights for policy 0, policy_version 793544 (0.0008) [2023-12-26 05:55:30,778][123090] Updated weights for policy 1, policy_version 787910 (0.0007) [2023-12-26 05:55:30,835][123090] Updated weights for policy 1, policy_version 787920 (0.0005) [2023-12-26 05:55:30,887][123090] Updated weights for policy 1, policy_version 787930 (0.0009) [2023-12-26 05:55:31,325][123091] Updated weights for policy 0, policy_version 793554 (0.0008) [2023-12-26 05:55:31,401][123091] Updated weights for policy 0, policy_version 793564 (0.0007) [2023-12-26 05:55:31,460][123091] Updated weights for policy 0, policy_version 793574 (0.0010) [2023-12-26 05:55:31,515][123091] Updated weights for policy 0, policy_version 793584 (0.0010) [2023-12-26 05:55:31,631][123090] Updated weights for policy 1, policy_version 787940 (0.0008) [2023-12-26 05:55:31,697][123090] Updated weights for policy 1, policy_version 787950 (0.0009) [2023-12-26 05:55:31,769][123090] Updated weights for policy 1, policy_version 787960 (0.0008) [2023-12-26 05:55:32,388][123091] Updated weights for policy 0, policy_version 793594 (0.0009) [2023-12-26 05:55:32,445][123091] Updated weights for policy 0, policy_version 793604 (0.0009) [2023-12-26 05:55:32,503][123091] Updated weights for policy 0, policy_version 793614 (0.0008) [2023-12-26 05:55:32,561][123090] Updated weights for policy 1, policy_version 787970 (0.0006) [2023-12-26 05:55:32,609][123090] Updated weights for policy 1, policy_version 787980 (0.0010) [2023-12-26 05:55:32,663][123090] Updated weights for policy 1, policy_version 787990 (0.0008) [2023-12-26 05:55:32,744][123090] Updated weights for policy 1, policy_version 788000 (0.0010) [2023-12-26 05:55:33,330][123091] Updated weights for policy 0, policy_version 793624 (0.0006) [2023-12-26 05:55:33,379][123091] Updated weights for policy 0, policy_version 793634 (0.0005) [2023-12-26 05:55:33,434][123091] Updated weights for policy 0, policy_version 793644 (0.0005) [2023-12-26 05:55:33,490][123090] Updated weights for policy 1, policy_version 788010 (0.0005) [2023-12-26 05:55:33,536][123090] Updated weights for policy 1, policy_version 788020 (0.0005) [2023-12-26 05:55:33,583][123090] Updated weights for policy 1, policy_version 788030 (0.0006) [2023-12-26 05:55:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 404914176. Throughput: 0: 8706.9, 1: 8822.3. Samples: 404922360. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:33,785][121949] Avg episode reward: [(0, '6036.434'), (1, '5802.571')] [2023-12-26 05:55:34,204][123091] Updated weights for policy 0, policy_version 793654 (0.0008) [2023-12-26 05:55:34,272][123091] Updated weights for policy 0, policy_version 793664 (0.0011) [2023-12-26 05:55:34,343][123091] Updated weights for policy 0, policy_version 793674 (0.0010) [2023-12-26 05:55:34,454][123090] Updated weights for policy 1, policy_version 788040 (0.0010) [2023-12-26 05:55:34,524][123090] Updated weights for policy 1, policy_version 788050 (0.0010) [2023-12-26 05:55:34,588][123090] Updated weights for policy 1, policy_version 788060 (0.0009) [2023-12-26 05:55:35,148][123091] Updated weights for policy 0, policy_version 793684 (0.0010) [2023-12-26 05:55:35,209][123091] Updated weights for policy 0, policy_version 793694 (0.0006) [2023-12-26 05:55:35,270][123091] Updated weights for policy 0, policy_version 793704 (0.0005) [2023-12-26 05:55:35,420][123090] Updated weights for policy 1, policy_version 788070 (0.0010) [2023-12-26 05:55:35,472][123090] Updated weights for policy 1, policy_version 788080 (0.0010) [2023-12-26 05:55:35,525][123090] Updated weights for policy 1, policy_version 788090 (0.0008) [2023-12-26 05:55:35,953][123091] Updated weights for policy 0, policy_version 793714 (0.0006) [2023-12-26 05:55:36,009][123091] Updated weights for policy 0, policy_version 793724 (0.0009) [2023-12-26 05:55:36,067][123091] Updated weights for policy 0, policy_version 793734 (0.0009) [2023-12-26 05:55:36,122][123091] Updated weights for policy 0, policy_version 793744 (0.0010) [2023-12-26 05:55:36,302][123090] Updated weights for policy 1, policy_version 788100 (0.0010) [2023-12-26 05:55:36,353][123090] Updated weights for policy 1, policy_version 788110 (0.0009) [2023-12-26 05:55:36,405][123090] Updated weights for policy 1, policy_version 788120 (0.0009) [2023-12-26 05:55:36,990][123091] Updated weights for policy 0, policy_version 793754 (0.0009) [2023-12-26 05:55:37,053][123091] Updated weights for policy 0, policy_version 793764 (0.0009) [2023-12-26 05:55:37,115][123091] Updated weights for policy 0, policy_version 793774 (0.0009) [2023-12-26 05:55:37,279][123090] Updated weights for policy 1, policy_version 788130 (0.0009) [2023-12-26 05:55:37,336][123090] Updated weights for policy 1, policy_version 788140 (0.0009) [2023-12-26 05:55:37,398][123090] Updated weights for policy 1, policy_version 788150 (0.0009) [2023-12-26 05:55:37,456][123090] Updated weights for policy 1, policy_version 788160 (0.0010) [2023-12-26 05:55:37,965][123091] Updated weights for policy 0, policy_version 793784 (0.0009) [2023-12-26 05:55:38,019][123091] Updated weights for policy 0, policy_version 793794 (0.0009) [2023-12-26 05:55:38,075][123091] Updated weights for policy 0, policy_version 793804 (0.0009) [2023-12-26 05:55:38,178][123090] Updated weights for policy 1, policy_version 788170 (0.0005) [2023-12-26 05:55:38,238][123090] Updated weights for policy 1, policy_version 788180 (0.0006) [2023-12-26 05:55:38,290][123090] Updated weights for policy 1, policy_version 788190 (0.0008) [2023-12-26 05:55:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 404996096. Throughput: 0: 8740.7, 1: 8788.7. Samples: 404974960. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:38,785][121949] Avg episode reward: [(0, '6177.217'), (1, '5802.402')] [2023-12-26 05:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000793808_203218944.pth... [2023-12-26 05:55:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000788192_201777152.pth... [2023-12-26 05:55:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000787168_201515008.pth [2023-12-26 05:55:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000792816_202964992.pth [2023-12-26 05:55:38,881][123091] Updated weights for policy 0, policy_version 793814 (0.0007) [2023-12-26 05:55:38,930][123091] Updated weights for policy 0, policy_version 793824 (0.0005) [2023-12-26 05:55:38,983][123091] Updated weights for policy 0, policy_version 793834 (0.0005) [2023-12-26 05:55:39,025][123090] Updated weights for policy 1, policy_version 788200 (0.0006) [2023-12-26 05:55:39,087][123090] Updated weights for policy 1, policy_version 788210 (0.0005) [2023-12-26 05:55:39,133][123090] Updated weights for policy 1, policy_version 788220 (0.0005) [2023-12-26 05:55:39,730][123091] Updated weights for policy 0, policy_version 793844 (0.0006) [2023-12-26 05:55:39,795][123091] Updated weights for policy 0, policy_version 793854 (0.0006) [2023-12-26 05:55:39,863][123091] Updated weights for policy 0, policy_version 793864 (0.0008) [2023-12-26 05:55:39,988][123090] Updated weights for policy 1, policy_version 788230 (0.0009) [2023-12-26 05:55:40,060][123090] Updated weights for policy 1, policy_version 788240 (0.0008) [2023-12-26 05:55:40,135][123090] Updated weights for policy 1, policy_version 788250 (0.0008) [2023-12-26 05:55:40,658][123091] Updated weights for policy 0, policy_version 793874 (0.0009) [2023-12-26 05:55:40,710][123091] Updated weights for policy 0, policy_version 793884 (0.0008) [2023-12-26 05:55:40,773][123091] Updated weights for policy 0, policy_version 793894 (0.0008) [2023-12-26 05:55:40,837][123091] Updated weights for policy 0, policy_version 793904 (0.0009) [2023-12-26 05:55:40,927][123090] Updated weights for policy 1, policy_version 788260 (0.0011) [2023-12-26 05:55:40,994][123090] Updated weights for policy 1, policy_version 788270 (0.0006) [2023-12-26 05:55:41,067][123090] Updated weights for policy 1, policy_version 788280 (0.0009) [2023-12-26 05:55:41,624][123091] Updated weights for policy 0, policy_version 793914 (0.0007) [2023-12-26 05:55:41,690][123091] Updated weights for policy 0, policy_version 793924 (0.0007) [2023-12-26 05:55:41,759][123091] Updated weights for policy 0, policy_version 793934 (0.0009) [2023-12-26 05:55:41,889][123090] Updated weights for policy 1, policy_version 788290 (0.0010) [2023-12-26 05:55:41,961][123090] Updated weights for policy 1, policy_version 788300 (0.0010) [2023-12-26 05:55:42,043][123090] Updated weights for policy 1, policy_version 788310 (0.0010) [2023-12-26 05:55:42,119][123090] Updated weights for policy 1, policy_version 788320 (0.0008) [2023-12-26 05:55:42,461][123091] Updated weights for policy 0, policy_version 793944 (0.0006) [2023-12-26 05:55:42,509][123091] Updated weights for policy 0, policy_version 793954 (0.0005) [2023-12-26 05:55:42,594][123091] Updated weights for policy 0, policy_version 793964 (0.0005) [2023-12-26 05:55:43,010][123090] Updated weights for policy 1, policy_version 788330 (0.0010) [2023-12-26 05:55:43,069][123090] Updated weights for policy 1, policy_version 788342 (0.0010) [2023-12-26 05:55:43,123][123090] Updated weights for policy 1, policy_version 788352 (0.0010) [2023-12-26 05:55:43,300][123091] Updated weights for policy 0, policy_version 793974 (0.0009) [2023-12-26 05:55:43,355][123091] Updated weights for policy 0, policy_version 793984 (0.0010) [2023-12-26 05:55:43,406][123091] Updated weights for policy 0, policy_version 793994 (0.0010) [2023-12-26 05:55:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 405086208. Throughput: 0: 8745.9, 1: 8807.6. Samples: 405080720. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:43,785][121949] Avg episode reward: [(0, '6230.793'), (1, '5833.761')] [2023-12-26 05:55:43,976][123090] Updated weights for policy 1, policy_version 788362 (0.0009) [2023-12-26 05:55:44,034][123090] Updated weights for policy 1, policy_version 788372 (0.0009) [2023-12-26 05:55:44,096][123090] Updated weights for policy 1, policy_version 788382 (0.0010) [2023-12-26 05:55:44,253][123091] Updated weights for policy 0, policy_version 794004 (0.0010) [2023-12-26 05:55:44,302][123091] Updated weights for policy 0, policy_version 794014 (0.0009) [2023-12-26 05:55:44,353][123091] Updated weights for policy 0, policy_version 794024 (0.0009) [2023-12-26 05:55:44,947][123090] Updated weights for policy 1, policy_version 788392 (0.0010) [2023-12-26 05:55:45,012][123090] Updated weights for policy 1, policy_version 788402 (0.0009) [2023-12-26 05:55:45,079][123090] Updated weights for policy 1, policy_version 788412 (0.0009) [2023-12-26 05:55:45,152][123091] Updated weights for policy 0, policy_version 794034 (0.0009) [2023-12-26 05:55:45,218][123091] Updated weights for policy 0, policy_version 794044 (0.0009) [2023-12-26 05:55:45,279][123091] Updated weights for policy 0, policy_version 794054 (0.0009) [2023-12-26 05:55:45,344][123091] Updated weights for policy 0, policy_version 794064 (0.0010) [2023-12-26 05:55:45,943][123090] Updated weights for policy 1, policy_version 788422 (0.0009) [2023-12-26 05:55:45,992][123090] Updated weights for policy 1, policy_version 788432 (0.0008) [2023-12-26 05:55:46,048][123090] Updated weights for policy 1, policy_version 788442 (0.0009) [2023-12-26 05:55:46,095][123091] Updated weights for policy 0, policy_version 794074 (0.0011) [2023-12-26 05:55:46,153][123091] Updated weights for policy 0, policy_version 794084 (0.0010) [2023-12-26 05:55:46,204][123091] Updated weights for policy 0, policy_version 794094 (0.0007) [2023-12-26 05:55:46,848][123090] Updated weights for policy 1, policy_version 788452 (0.0007) [2023-12-26 05:55:46,895][123090] Updated weights for policy 1, policy_version 788462 (0.0009) [2023-12-26 05:55:46,948][123091] Updated weights for policy 0, policy_version 794104 (0.0009) [2023-12-26 05:55:46,957][123090] Updated weights for policy 1, policy_version 788472 (0.0007) [2023-12-26 05:55:47,000][123091] Updated weights for policy 0, policy_version 794114 (0.0007) [2023-12-26 05:55:47,063][123091] Updated weights for policy 0, policy_version 794124 (0.0010) [2023-12-26 05:55:47,710][123090] Updated weights for policy 1, policy_version 788482 (0.0009) [2023-12-26 05:55:47,763][123090] Updated weights for policy 1, policy_version 788492 (0.0006) [2023-12-26 05:55:47,786][123091] Updated weights for policy 0, policy_version 794134 (0.0007) [2023-12-26 05:55:47,826][123090] Updated weights for policy 1, policy_version 788502 (0.0005) [2023-12-26 05:55:47,848][123091] Updated weights for policy 0, policy_version 794144 (0.0005) [2023-12-26 05:55:47,889][123090] Updated weights for policy 1, policy_version 788512 (0.0005) [2023-12-26 05:55:47,911][123091] Updated weights for policy 0, policy_version 794154 (0.0005) [2023-12-26 05:55:48,591][123091] Updated weights for policy 0, policy_version 794164 (0.0005) [2023-12-26 05:55:48,664][123091] Updated weights for policy 0, policy_version 794174 (0.0006) [2023-12-26 05:55:48,698][123090] Updated weights for policy 1, policy_version 788522 (0.0011) [2023-12-26 05:55:48,736][123091] Updated weights for policy 0, policy_version 794184 (0.0007) [2023-12-26 05:55:48,767][123090] Updated weights for policy 1, policy_version 788532 (0.0011) [2023-12-26 05:55:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 405168128. Throughput: 0: 8817.6, 1: 8796.0. Samples: 405188840. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:48,785][121949] Avg episode reward: [(0, '6292.164'), (1, '5684.043')] [2023-12-26 05:55:48,842][123090] Updated weights for policy 1, policy_version 788542 (0.0010) [2023-12-26 05:55:49,502][123091] Updated weights for policy 0, policy_version 794194 (0.0008) [2023-12-26 05:55:49,565][123091] Updated weights for policy 0, policy_version 794204 (0.0011) [2023-12-26 05:55:49,628][123091] Updated weights for policy 0, policy_version 794214 (0.0011) [2023-12-26 05:55:49,644][123090] Updated weights for policy 1, policy_version 788552 (0.0006) [2023-12-26 05:55:49,694][123091] Updated weights for policy 0, policy_version 794224 (0.0011) [2023-12-26 05:55:49,709][123090] Updated weights for policy 1, policy_version 788562 (0.0009) [2023-12-26 05:55:49,777][123090] Updated weights for policy 1, policy_version 788572 (0.0009) [2023-12-26 05:55:50,494][123091] Updated weights for policy 0, policy_version 794234 (0.0005) [2023-12-26 05:55:50,566][123091] Updated weights for policy 0, policy_version 794244 (0.0006) [2023-12-26 05:55:50,605][123090] Updated weights for policy 1, policy_version 788582 (0.0009) [2023-12-26 05:55:50,631][123091] Updated weights for policy 0, policy_version 794254 (0.0008) [2023-12-26 05:55:50,675][123090] Updated weights for policy 1, policy_version 788592 (0.0010) [2023-12-26 05:55:50,743][123090] Updated weights for policy 1, policy_version 788602 (0.0011) [2023-12-26 05:55:51,413][123091] Updated weights for policy 0, policy_version 794264 (0.0008) [2023-12-26 05:55:51,482][123091] Updated weights for policy 0, policy_version 794274 (0.0009) [2023-12-26 05:55:51,549][123091] Updated weights for policy 0, policy_version 794284 (0.0010) [2023-12-26 05:55:51,568][123090] Updated weights for policy 1, policy_version 788612 (0.0010) [2023-12-26 05:55:51,637][123090] Updated weights for policy 1, policy_version 788622 (0.0008) [2023-12-26 05:55:51,702][123090] Updated weights for policy 1, policy_version 788632 (0.0006) [2023-12-26 05:55:52,411][123091] Updated weights for policy 0, policy_version 794294 (0.0009) [2023-12-26 05:55:52,468][123091] Updated weights for policy 0, policy_version 794304 (0.0009) [2023-12-26 05:55:52,511][123090] Updated weights for policy 1, policy_version 788642 (0.0011) [2023-12-26 05:55:52,519][123091] Updated weights for policy 0, policy_version 794314 (0.0008) [2023-12-26 05:55:52,560][123090] Updated weights for policy 1, policy_version 788652 (0.0010) [2023-12-26 05:55:52,611][123090] Updated weights for policy 1, policy_version 788662 (0.0010) [2023-12-26 05:55:52,663][123090] Updated weights for policy 1, policy_version 788672 (0.0010) [2023-12-26 05:55:53,294][123091] Updated weights for policy 0, policy_version 794324 (0.0007) [2023-12-26 05:55:53,354][123091] Updated weights for policy 0, policy_version 794334 (0.0009) [2023-12-26 05:55:53,420][123091] Updated weights for policy 0, policy_version 794344 (0.0009) [2023-12-26 05:55:53,461][123090] Updated weights for policy 1, policy_version 788682 (0.0005) [2023-12-26 05:55:53,511][123090] Updated weights for policy 1, policy_version 788692 (0.0006) [2023-12-26 05:55:53,569][123090] Updated weights for policy 1, policy_version 788702 (0.0010) [2023-12-26 05:55:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 405266432. Throughput: 0: 8827.7, 1: 8770.4. Samples: 405240116. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:53,785][121949] Avg episode reward: [(0, '6219.886'), (1, '5671.313')] [2023-12-26 05:55:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000788704_201908224.pth... [2023-12-26 05:55:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000794352_203358208.pth... [2023-12-26 05:55:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000793328_203096064.pth [2023-12-26 05:55:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000787680_201646080.pth [2023-12-26 05:55:54,073][123091] Updated weights for policy 0, policy_version 794354 (0.0008) [2023-12-26 05:55:54,126][123091] Updated weights for policy 0, policy_version 794364 (0.0006) [2023-12-26 05:55:54,178][123091] Updated weights for policy 0, policy_version 794374 (0.0005) [2023-12-26 05:55:54,240][123091] Updated weights for policy 0, policy_version 794384 (0.0005) [2023-12-26 05:55:54,373][123090] Updated weights for policy 1, policy_version 788712 (0.0007) [2023-12-26 05:55:54,448][123090] Updated weights for policy 1, policy_version 788722 (0.0010) [2023-12-26 05:55:54,508][123090] Updated weights for policy 1, policy_version 788732 (0.0010) [2023-12-26 05:55:54,868][123091] Updated weights for policy 0, policy_version 794394 (0.0006) [2023-12-26 05:55:54,937][123091] Updated weights for policy 0, policy_version 794404 (0.0006) [2023-12-26 05:55:55,001][123091] Updated weights for policy 0, policy_version 794414 (0.0006) [2023-12-26 05:55:55,250][123090] Updated weights for policy 1, policy_version 788742 (0.0011) [2023-12-26 05:55:55,306][123090] Updated weights for policy 1, policy_version 788752 (0.0011) [2023-12-26 05:55:55,363][123090] Updated weights for policy 1, policy_version 788762 (0.0011) [2023-12-26 05:55:55,694][123091] Updated weights for policy 0, policy_version 794424 (0.0006) [2023-12-26 05:55:55,753][123091] Updated weights for policy 0, policy_version 794435 (0.0006) [2023-12-26 05:55:55,812][123091] Updated weights for policy 0, policy_version 794445 (0.0005) [2023-12-26 05:55:56,161][123090] Updated weights for policy 1, policy_version 788772 (0.0008) [2023-12-26 05:55:56,213][123090] Updated weights for policy 1, policy_version 788782 (0.0005) [2023-12-26 05:55:56,271][123090] Updated weights for policy 1, policy_version 788792 (0.0005) [2023-12-26 05:55:56,527][123091] Updated weights for policy 0, policy_version 794455 (0.0005) [2023-12-26 05:55:56,573][123091] Updated weights for policy 0, policy_version 794465 (0.0008) [2023-12-26 05:55:56,638][123091] Updated weights for policy 0, policy_version 794475 (0.0010) [2023-12-26 05:55:57,053][123090] Updated weights for policy 1, policy_version 788802 (0.0009) [2023-12-26 05:55:57,119][123090] Updated weights for policy 1, policy_version 788812 (0.0010) [2023-12-26 05:55:57,188][123090] Updated weights for policy 1, policy_version 788822 (0.0010) [2023-12-26 05:55:57,258][123090] Updated weights for policy 1, policy_version 788832 (0.0010) [2023-12-26 05:55:57,336][123091] Updated weights for policy 0, policy_version 794485 (0.0009) [2023-12-26 05:55:57,397][123091] Updated weights for policy 0, policy_version 794495 (0.0008) [2023-12-26 05:55:57,454][123091] Updated weights for policy 0, policy_version 794505 (0.0009) [2023-12-26 05:55:57,937][123090] Updated weights for policy 1, policy_version 788842 (0.0005) [2023-12-26 05:55:57,991][123090] Updated weights for policy 1, policy_version 788852 (0.0006) [2023-12-26 05:55:58,073][123090] Updated weights for policy 1, policy_version 788862 (0.0009) [2023-12-26 05:55:58,322][123091] Updated weights for policy 0, policy_version 794515 (0.0009) [2023-12-26 05:55:58,396][123091] Updated weights for policy 0, policy_version 794525 (0.0011) [2023-12-26 05:55:58,472][123091] Updated weights for policy 0, policy_version 794535 (0.0010) [2023-12-26 05:55:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 405356544. Throughput: 0: 8918.2, 1: 8859.9. Samples: 405352096. Policy #0 lag: (min: 3.0, avg: 10.1, max: 35.0) [2023-12-26 05:55:58,785][121949] Avg episode reward: [(0, '6191.958'), (1, '5701.318')] [2023-12-26 05:55:58,973][123090] Updated weights for policy 1, policy_version 788872 (0.0010) [2023-12-26 05:55:59,034][123090] Updated weights for policy 1, policy_version 788882 (0.0009) [2023-12-26 05:55:59,088][123090] Updated weights for policy 1, policy_version 788892 (0.0005) [2023-12-26 05:55:59,351][123091] Updated weights for policy 0, policy_version 794545 (0.0013) [2023-12-26 05:55:59,420][123091] Updated weights for policy 0, policy_version 794555 (0.0010) [2023-12-26 05:55:59,485][123091] Updated weights for policy 0, policy_version 794565 (0.0010) [2023-12-26 05:55:59,549][123091] Updated weights for policy 0, policy_version 794575 (0.0008) [2023-12-26 05:55:59,918][123090] Updated weights for policy 1, policy_version 788902 (0.0008) [2023-12-26 05:55:59,983][123090] Updated weights for policy 1, policy_version 788912 (0.0009) [2023-12-26 05:56:00,044][123090] Updated weights for policy 1, policy_version 788922 (0.0007) [2023-12-26 05:56:00,361][123091] Updated weights for policy 0, policy_version 794585 (0.0007) [2023-12-26 05:56:00,417][123091] Updated weights for policy 0, policy_version 794595 (0.0010) [2023-12-26 05:56:00,476][123091] Updated weights for policy 0, policy_version 794606 (0.0008) [2023-12-26 05:56:00,808][123090] Updated weights for policy 1, policy_version 788932 (0.0007) [2023-12-26 05:56:00,862][123090] Updated weights for policy 1, policy_version 788942 (0.0009) [2023-12-26 05:56:00,914][123090] Updated weights for policy 1, policy_version 788952 (0.0009) [2023-12-26 05:56:01,320][123091] Updated weights for policy 0, policy_version 794616 (0.0010) [2023-12-26 05:56:01,389][123091] Updated weights for policy 0, policy_version 794626 (0.0009) [2023-12-26 05:56:01,449][123091] Updated weights for policy 0, policy_version 794636 (0.0010) [2023-12-26 05:56:01,795][123090] Updated weights for policy 1, policy_version 788962 (0.0009) [2023-12-26 05:56:01,850][123090] Updated weights for policy 1, policy_version 788972 (0.0010) [2023-12-26 05:56:01,905][123090] Updated weights for policy 1, policy_version 788982 (0.0010) [2023-12-26 05:56:01,964][123090] Updated weights for policy 1, policy_version 788992 (0.0010) [2023-12-26 05:56:02,290][123091] Updated weights for policy 0, policy_version 794646 (0.0009) [2023-12-26 05:56:02,352][123091] Updated weights for policy 0, policy_version 794656 (0.0009) [2023-12-26 05:56:02,421][123091] Updated weights for policy 0, policy_version 794666 (0.0009) [2023-12-26 05:56:02,815][123090] Updated weights for policy 1, policy_version 789002 (0.0006) [2023-12-26 05:56:02,877][123090] Updated weights for policy 1, policy_version 789012 (0.0005) [2023-12-26 05:56:02,932][123090] Updated weights for policy 1, policy_version 789022 (0.0005) [2023-12-26 05:56:03,118][123091] Updated weights for policy 0, policy_version 794676 (0.0009) [2023-12-26 05:56:03,177][123091] Updated weights for policy 0, policy_version 794686 (0.0010) [2023-12-26 05:56:03,232][123091] Updated weights for policy 0, policy_version 794696 (0.0010) [2023-12-26 05:56:03,654][123090] Updated weights for policy 1, policy_version 789032 (0.0008) [2023-12-26 05:56:03,706][123090] Updated weights for policy 1, policy_version 789042 (0.0006) [2023-12-26 05:56:03,767][123090] Updated weights for policy 1, policy_version 789052 (0.0005) [2023-12-26 05:56:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 405438464. Throughput: 0: 8814.5, 1: 8824.1. Samples: 405454924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:03,784][121949] Avg episode reward: [(0, '6227.894'), (1, '5569.204')] [2023-12-26 05:56:04,046][123091] Updated weights for policy 0, policy_version 794706 (0.0011) [2023-12-26 05:56:04,107][123091] Updated weights for policy 0, policy_version 794716 (0.0011) [2023-12-26 05:56:04,155][123091] Updated weights for policy 0, policy_version 794726 (0.0010) [2023-12-26 05:56:04,224][123091] Updated weights for policy 0, policy_version 794736 (0.0011) [2023-12-26 05:56:04,559][123090] Updated weights for policy 1, policy_version 789062 (0.0007) [2023-12-26 05:56:04,624][123090] Updated weights for policy 1, policy_version 789072 (0.0009) [2023-12-26 05:56:04,693][123090] Updated weights for policy 1, policy_version 789082 (0.0009) [2023-12-26 05:56:05,061][123091] Updated weights for policy 0, policy_version 794746 (0.0010) [2023-12-26 05:56:05,117][123091] Updated weights for policy 0, policy_version 794756 (0.0010) [2023-12-26 05:56:05,171][123091] Updated weights for policy 0, policy_version 794767 (0.0010) [2023-12-26 05:56:05,461][123090] Updated weights for policy 1, policy_version 789092 (0.0010) [2023-12-26 05:56:05,521][123090] Updated weights for policy 1, policy_version 789102 (0.0009) [2023-12-26 05:56:05,576][123090] Updated weights for policy 1, policy_version 789112 (0.0010) [2023-12-26 05:56:06,039][123091] Updated weights for policy 0, policy_version 794777 (0.0010) [2023-12-26 05:56:06,083][123091] Updated weights for policy 0, policy_version 794787 (0.0010) [2023-12-26 05:56:06,162][123091] Updated weights for policy 0, policy_version 794797 (0.0010) [2023-12-26 05:56:06,415][123090] Updated weights for policy 1, policy_version 789122 (0.0008) [2023-12-26 05:56:06,479][123090] Updated weights for policy 1, policy_version 789132 (0.0009) [2023-12-26 05:56:06,540][123090] Updated weights for policy 1, policy_version 789142 (0.0009) [2023-12-26 05:56:06,604][123090] Updated weights for policy 1, policy_version 789152 (0.0010) [2023-12-26 05:56:07,004][123091] Updated weights for policy 0, policy_version 794807 (0.0011) [2023-12-26 05:56:07,075][123091] Updated weights for policy 0, policy_version 794817 (0.0011) [2023-12-26 05:56:07,142][123091] Updated weights for policy 0, policy_version 794827 (0.0011) [2023-12-26 05:56:07,450][123090] Updated weights for policy 1, policy_version 789162 (0.0008) [2023-12-26 05:56:07,498][123090] Updated weights for policy 1, policy_version 789172 (0.0009) [2023-12-26 05:56:07,551][123090] Updated weights for policy 1, policy_version 789182 (0.0009) [2023-12-26 05:56:07,948][123091] Updated weights for policy 0, policy_version 794837 (0.0011) [2023-12-26 05:56:08,010][123091] Updated weights for policy 0, policy_version 794847 (0.0010) [2023-12-26 05:56:08,077][123091] Updated weights for policy 0, policy_version 794857 (0.0010) [2023-12-26 05:56:08,406][123090] Updated weights for policy 1, policy_version 789192 (0.0011) [2023-12-26 05:56:08,473][123090] Updated weights for policy 1, policy_version 789202 (0.0010) [2023-12-26 05:56:08,527][123090] Updated weights for policy 1, policy_version 789212 (0.0006) [2023-12-26 05:56:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 405528576. Throughput: 0: 8799.0, 1: 8826.2. Samples: 405506084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:08,785][121949] Avg episode reward: [(0, '6183.013'), (1, '5432.654')] [2023-12-26 05:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000794864_203489280.pth... [2023-12-26 05:56:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000789216_202039296.pth... [2023-12-26 05:56:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000793808_203218944.pth [2023-12-26 05:56:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000788192_201777152.pth [2023-12-26 05:56:08,933][123091] Updated weights for policy 0, policy_version 794867 (0.0010) [2023-12-26 05:56:08,987][123091] Updated weights for policy 0, policy_version 794877 (0.0010) [2023-12-26 05:56:09,045][123091] Updated weights for policy 0, policy_version 794888 (0.0010) [2023-12-26 05:56:09,190][123090] Updated weights for policy 1, policy_version 789222 (0.0005) [2023-12-26 05:56:09,258][123090] Updated weights for policy 1, policy_version 789232 (0.0009) [2023-12-26 05:56:09,318][123090] Updated weights for policy 1, policy_version 789242 (0.0011) [2023-12-26 05:56:09,956][123091] Updated weights for policy 0, policy_version 794898 (0.0009) [2023-12-26 05:56:10,029][123091] Updated weights for policy 0, policy_version 794908 (0.0005) [2023-12-26 05:56:10,104][123091] Updated weights for policy 0, policy_version 794918 (0.0005) [2023-12-26 05:56:10,154][123090] Updated weights for policy 1, policy_version 789252 (0.0010) [2023-12-26 05:56:10,174][123091] Updated weights for policy 0, policy_version 794928 (0.0006) [2023-12-26 05:56:10,226][123090] Updated weights for policy 1, policy_version 789262 (0.0009) [2023-12-26 05:56:10,306][123090] Updated weights for policy 1, policy_version 789272 (0.0009) [2023-12-26 05:56:10,777][123091] Updated weights for policy 0, policy_version 794938 (0.0010) [2023-12-26 05:56:10,825][123091] Updated weights for policy 0, policy_version 794948 (0.0008) [2023-12-26 05:56:10,879][123091] Updated weights for policy 0, policy_version 794958 (0.0006) [2023-12-26 05:56:11,071][123090] Updated weights for policy 1, policy_version 789282 (0.0009) [2023-12-26 05:56:11,146][123090] Updated weights for policy 1, policy_version 789292 (0.0008) [2023-12-26 05:56:11,204][123090] Updated weights for policy 1, policy_version 789302 (0.0008) [2023-12-26 05:56:11,699][123091] Updated weights for policy 0, policy_version 794968 (0.0008) [2023-12-26 05:56:11,769][123091] Updated weights for policy 0, policy_version 794978 (0.0009) [2023-12-26 05:56:11,835][123091] Updated weights for policy 0, policy_version 794988 (0.0007) [2023-12-26 05:56:12,078][123090] Updated weights for policy 1, policy_version 789313 (0.0008) [2023-12-26 05:56:12,135][123090] Updated weights for policy 1, policy_version 789323 (0.0011) [2023-12-26 05:56:12,213][123090] Updated weights for policy 1, policy_version 789333 (0.0011) [2023-12-26 05:56:12,282][123090] Updated weights for policy 1, policy_version 789343 (0.0010) [2023-12-26 05:56:12,608][123091] Updated weights for policy 0, policy_version 794998 (0.0009) [2023-12-26 05:56:12,668][123091] Updated weights for policy 0, policy_version 795008 (0.0010) [2023-12-26 05:56:12,723][123091] Updated weights for policy 0, policy_version 795018 (0.0010) [2023-12-26 05:56:13,119][123090] Updated weights for policy 1, policy_version 789353 (0.0008) [2023-12-26 05:56:13,172][123090] Updated weights for policy 1, policy_version 789363 (0.0008) [2023-12-26 05:56:13,233][123090] Updated weights for policy 1, policy_version 789373 (0.0009) [2023-12-26 05:56:13,572][123091] Updated weights for policy 0, policy_version 795028 (0.0008) [2023-12-26 05:56:13,632][123091] Updated weights for policy 0, policy_version 795038 (0.0005) [2023-12-26 05:56:13,687][123091] Updated weights for policy 0, policy_version 795048 (0.0005) [2023-12-26 05:56:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 405618688. Throughput: 0: 8880.9, 1: 8755.0. Samples: 405610708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:13,785][121949] Avg episode reward: [(0, '6088.666'), (1, '5364.144')] [2023-12-26 05:56:14,020][123090] Updated weights for policy 1, policy_version 789383 (0.0009) [2023-12-26 05:56:14,076][123090] Updated weights for policy 1, policy_version 789393 (0.0009) [2023-12-26 05:56:14,137][123090] Updated weights for policy 1, policy_version 789403 (0.0009) [2023-12-26 05:56:14,396][123091] Updated weights for policy 0, policy_version 795058 (0.0006) [2023-12-26 05:56:14,453][123091] Updated weights for policy 0, policy_version 795068 (0.0010) [2023-12-26 05:56:14,510][123091] Updated weights for policy 0, policy_version 795078 (0.0010) [2023-12-26 05:56:14,574][123091] Updated weights for policy 0, policy_version 795088 (0.0009) [2023-12-26 05:56:14,869][123090] Updated weights for policy 1, policy_version 789413 (0.0008) [2023-12-26 05:56:14,939][123090] Updated weights for policy 1, policy_version 789423 (0.0005) [2023-12-26 05:56:15,014][123090] Updated weights for policy 1, policy_version 789433 (0.0010) [2023-12-26 05:56:15,324][123091] Updated weights for policy 0, policy_version 795098 (0.0006) [2023-12-26 05:56:15,384][123091] Updated weights for policy 0, policy_version 795108 (0.0006) [2023-12-26 05:56:15,439][123091] Updated weights for policy 0, policy_version 795118 (0.0010) [2023-12-26 05:56:15,774][123090] Updated weights for policy 1, policy_version 789443 (0.0011) [2023-12-26 05:56:15,827][123090] Updated weights for policy 1, policy_version 789453 (0.0010) [2023-12-26 05:56:15,878][123090] Updated weights for policy 1, policy_version 789463 (0.0010) [2023-12-26 05:56:16,244][123091] Updated weights for policy 0, policy_version 795128 (0.0009) [2023-12-26 05:56:16,297][123091] Updated weights for policy 0, policy_version 795138 (0.0006) [2023-12-26 05:56:16,350][123091] Updated weights for policy 0, policy_version 795148 (0.0005) [2023-12-26 05:56:16,699][123090] Updated weights for policy 1, policy_version 789473 (0.0010) [2023-12-26 05:56:16,753][123090] Updated weights for policy 1, policy_version 789483 (0.0010) [2023-12-26 05:56:16,808][123090] Updated weights for policy 1, policy_version 789493 (0.0010) [2023-12-26 05:56:16,870][123090] Updated weights for policy 1, policy_version 789503 (0.0010) [2023-12-26 05:56:17,046][123091] Updated weights for policy 0, policy_version 795158 (0.0005) [2023-12-26 05:56:17,100][123091] Updated weights for policy 0, policy_version 795168 (0.0005) [2023-12-26 05:56:17,158][123091] Updated weights for policy 0, policy_version 795178 (0.0005) [2023-12-26 05:56:17,709][123090] Updated weights for policy 1, policy_version 789513 (0.0010) [2023-12-26 05:56:17,760][123090] Updated weights for policy 1, policy_version 789523 (0.0010) [2023-12-26 05:56:17,812][123090] Updated weights for policy 1, policy_version 789533 (0.0010) [2023-12-26 05:56:17,879][123091] Updated weights for policy 0, policy_version 795188 (0.0007) [2023-12-26 05:56:17,938][123091] Updated weights for policy 0, policy_version 795198 (0.0009) [2023-12-26 05:56:17,999][123091] Updated weights for policy 0, policy_version 795208 (0.0008) [2023-12-26 05:56:18,654][123090] Updated weights for policy 1, policy_version 789543 (0.0010) [2023-12-26 05:56:18,721][123090] Updated weights for policy 1, policy_version 789553 (0.0010) [2023-12-26 05:56:18,727][123091] Updated weights for policy 0, policy_version 795218 (0.0006) [2023-12-26 05:56:18,781][123091] Updated weights for policy 0, policy_version 795228 (0.0008) [2023-12-26 05:56:18,783][123090] Updated weights for policy 1, policy_version 789563 (0.0009) [2023-12-26 05:56:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 405700608. Throughput: 0: 9014.7, 1: 8702.3. Samples: 405719620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:18,784][121949] Avg episode reward: [(0, '6177.997'), (1, '5460.279')] [2023-12-26 05:56:18,832][123091] Updated weights for policy 0, policy_version 795238 (0.0007) [2023-12-26 05:56:18,900][123091] Updated weights for policy 0, policy_version 795248 (0.0009) [2023-12-26 05:56:19,578][123090] Updated weights for policy 1, policy_version 789573 (0.0008) [2023-12-26 05:56:19,642][123090] Updated weights for policy 1, policy_version 789583 (0.0008) [2023-12-26 05:56:19,716][123090] Updated weights for policy 1, policy_version 789593 (0.0011) [2023-12-26 05:56:19,763][123091] Updated weights for policy 0, policy_version 795258 (0.0007) [2023-12-26 05:56:19,820][123091] Updated weights for policy 0, policy_version 795268 (0.0009) [2023-12-26 05:56:19,893][123091] Updated weights for policy 0, policy_version 795278 (0.0010) [2023-12-26 05:56:20,439][123090] Updated weights for policy 1, policy_version 789603 (0.0009) [2023-12-26 05:56:20,514][123090] Updated weights for policy 1, policy_version 789613 (0.0006) [2023-12-26 05:56:20,593][123090] Updated weights for policy 1, policy_version 789623 (0.0007) [2023-12-26 05:56:20,797][123091] Updated weights for policy 0, policy_version 795288 (0.0008) [2023-12-26 05:56:20,867][123091] Updated weights for policy 0, policy_version 795298 (0.0006) [2023-12-26 05:56:20,930][123091] Updated weights for policy 0, policy_version 795308 (0.0006) [2023-12-26 05:56:21,263][123090] Updated weights for policy 1, policy_version 789633 (0.0007) [2023-12-26 05:56:21,322][123090] Updated weights for policy 1, policy_version 789643 (0.0009) [2023-12-26 05:56:21,400][123090] Updated weights for policy 1, policy_version 789653 (0.0010) [2023-12-26 05:56:21,463][123090] Updated weights for policy 1, policy_version 789663 (0.0008) [2023-12-26 05:56:21,719][123091] Updated weights for policy 0, policy_version 795318 (0.0007) [2023-12-26 05:56:21,793][123091] Updated weights for policy 0, policy_version 795328 (0.0010) [2023-12-26 05:56:21,866][123091] Updated weights for policy 0, policy_version 795338 (0.0010) [2023-12-26 05:56:22,350][123090] Updated weights for policy 1, policy_version 789673 (0.0010) [2023-12-26 05:56:22,419][123090] Updated weights for policy 1, policy_version 789683 (0.0010) [2023-12-26 05:56:22,485][123090] Updated weights for policy 1, policy_version 789693 (0.0010) [2023-12-26 05:56:22,712][123091] Updated weights for policy 0, policy_version 795348 (0.0010) [2023-12-26 05:56:22,777][123091] Updated weights for policy 0, policy_version 795358 (0.0010) [2023-12-26 05:56:22,844][123091] Updated weights for policy 0, policy_version 795368 (0.0010) [2023-12-26 05:56:23,332][123090] Updated weights for policy 1, policy_version 789703 (0.0009) [2023-12-26 05:56:23,385][123090] Updated weights for policy 1, policy_version 789713 (0.0010) [2023-12-26 05:56:23,434][123090] Updated weights for policy 1, policy_version 789723 (0.0009) [2023-12-26 05:56:23,672][123091] Updated weights for policy 0, policy_version 795378 (0.0009) [2023-12-26 05:56:23,724][123091] Updated weights for policy 0, policy_version 795388 (0.0010) [2023-12-26 05:56:23,772][123091] Updated weights for policy 0, policy_version 795398 (0.0010) [2023-12-26 05:56:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 405790720. Throughput: 0: 8964.4, 1: 8736.1. Samples: 405771484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:23,785][121949] Avg episode reward: [(0, '6153.524'), (1, '5411.749')] [2023-12-26 05:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000789728_202170368.pth... [2023-12-26 05:56:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000788704_201908224.pth [2023-12-26 05:56:23,827][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000795408_203628544.pth... [2023-12-26 05:56:23,827][123091] Updated weights for policy 0, policy_version 795408 (0.0006) [2023-12-26 05:56:23,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000794352_203358208.pth [2023-12-26 05:56:24,337][123090] Updated weights for policy 1, policy_version 789733 (0.0009) [2023-12-26 05:56:24,388][123090] Updated weights for policy 1, policy_version 789743 (0.0009) [2023-12-26 05:56:24,446][123090] Updated weights for policy 1, policy_version 789753 (0.0009) [2023-12-26 05:56:24,523][123091] Updated weights for policy 0, policy_version 795418 (0.0009) [2023-12-26 05:56:24,583][123091] Updated weights for policy 0, policy_version 795428 (0.0008) [2023-12-26 05:56:24,644][123091] Updated weights for policy 0, policy_version 795438 (0.0007) [2023-12-26 05:56:25,308][123090] Updated weights for policy 1, policy_version 789763 (0.0008) [2023-12-26 05:56:25,378][123090] Updated weights for policy 1, policy_version 789773 (0.0006) [2023-12-26 05:56:25,439][123091] Updated weights for policy 0, policy_version 795448 (0.0007) [2023-12-26 05:56:25,440][123090] Updated weights for policy 1, policy_version 789783 (0.0010) [2023-12-26 05:56:25,496][123091] Updated weights for policy 0, policy_version 795458 (0.0009) [2023-12-26 05:56:25,564][123091] Updated weights for policy 0, policy_version 795468 (0.0010) [2023-12-26 05:56:26,228][123090] Updated weights for policy 1, policy_version 789793 (0.0010) [2023-12-26 05:56:26,299][123090] Updated weights for policy 1, policy_version 789803 (0.0011) [2023-12-26 05:56:26,352][123090] Updated weights for policy 1, policy_version 789813 (0.0011) [2023-12-26 05:56:26,408][123090] Updated weights for policy 1, policy_version 789823 (0.0010) [2023-12-26 05:56:26,411][123091] Updated weights for policy 0, policy_version 795478 (0.0007) [2023-12-26 05:56:26,475][123091] Updated weights for policy 0, policy_version 795488 (0.0009) [2023-12-26 05:56:26,547][123091] Updated weights for policy 0, policy_version 795498 (0.0009) [2023-12-26 05:56:27,181][123090] Updated weights for policy 1, policy_version 789833 (0.0006) [2023-12-26 05:56:27,251][123090] Updated weights for policy 1, policy_version 789843 (0.0008) [2023-12-26 05:56:27,322][123090] Updated weights for policy 1, policy_version 789853 (0.0009) [2023-12-26 05:56:27,372][123091] Updated weights for policy 0, policy_version 795508 (0.0009) [2023-12-26 05:56:27,430][123091] Updated weights for policy 0, policy_version 795518 (0.0010) [2023-12-26 05:56:27,476][123091] Updated weights for policy 0, policy_version 795528 (0.0010) [2023-12-26 05:56:27,960][123090] Updated weights for policy 1, policy_version 789863 (0.0006) [2023-12-26 05:56:28,019][123090] Updated weights for policy 1, policy_version 789873 (0.0005) [2023-12-26 05:56:28,062][123090] Updated weights for policy 1, policy_version 789883 (0.0005) [2023-12-26 05:56:28,251][123091] Updated weights for policy 0, policy_version 795538 (0.0009) [2023-12-26 05:56:28,305][123091] Updated weights for policy 0, policy_version 795548 (0.0005) [2023-12-26 05:56:28,368][123091] Updated weights for policy 0, policy_version 795558 (0.0007) [2023-12-26 05:56:28,424][123091] Updated weights for policy 0, policy_version 795568 (0.0011) [2023-12-26 05:56:28,724][123090] Updated weights for policy 1, policy_version 789893 (0.0005) [2023-12-26 05:56:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 405880832. Throughput: 0: 8947.6, 1: 8720.7. Samples: 405875792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:28,784][121949] Avg episode reward: [(0, '5849.539'), (1, '5529.061')] [2023-12-26 05:56:28,795][123090] Updated weights for policy 1, policy_version 789903 (0.0008) [2023-12-26 05:56:28,848][123090] Updated weights for policy 1, policy_version 789913 (0.0009) [2023-12-26 05:56:29,169][123091] Updated weights for policy 0, policy_version 795578 (0.0007) [2023-12-26 05:56:29,244][123091] Updated weights for policy 0, policy_version 795588 (0.0011) [2023-12-26 05:56:29,304][123091] Updated weights for policy 0, policy_version 795598 (0.0011) [2023-12-26 05:56:29,627][123090] Updated weights for policy 1, policy_version 789923 (0.0008) [2023-12-26 05:56:29,692][123090] Updated weights for policy 1, policy_version 789933 (0.0010) [2023-12-26 05:56:29,755][123090] Updated weights for policy 1, policy_version 789943 (0.0011) [2023-12-26 05:56:30,118][123091] Updated weights for policy 0, policy_version 795608 (0.0011) [2023-12-26 05:56:30,173][123091] Updated weights for policy 0, policy_version 795618 (0.0010) [2023-12-26 05:56:30,228][123091] Updated weights for policy 0, policy_version 795628 (0.0010) [2023-12-26 05:56:30,515][123090] Updated weights for policy 1, policy_version 789953 (0.0010) [2023-12-26 05:56:30,566][123090] Updated weights for policy 1, policy_version 789963 (0.0005) [2023-12-26 05:56:30,616][123090] Updated weights for policy 1, policy_version 789973 (0.0005) [2023-12-26 05:56:30,673][123090] Updated weights for policy 1, policy_version 789983 (0.0005) [2023-12-26 05:56:30,991][123091] Updated weights for policy 0, policy_version 795638 (0.0008) [2023-12-26 05:56:31,055][123091] Updated weights for policy 0, policy_version 795648 (0.0008) [2023-12-26 05:56:31,114][123091] Updated weights for policy 0, policy_version 795658 (0.0009) [2023-12-26 05:56:31,415][123090] Updated weights for policy 1, policy_version 789993 (0.0009) [2023-12-26 05:56:31,475][123090] Updated weights for policy 1, policy_version 790003 (0.0009) [2023-12-26 05:56:31,533][123090] Updated weights for policy 1, policy_version 790013 (0.0009) [2023-12-26 05:56:31,927][123091] Updated weights for policy 0, policy_version 795668 (0.0010) [2023-12-26 05:56:31,979][123091] Updated weights for policy 0, policy_version 795678 (0.0009) [2023-12-26 05:56:32,046][123091] Updated weights for policy 0, policy_version 795688 (0.0008) [2023-12-26 05:56:32,401][123090] Updated weights for policy 1, policy_version 790023 (0.0008) [2023-12-26 05:56:32,473][123090] Updated weights for policy 1, policy_version 790033 (0.0006) [2023-12-26 05:56:32,539][123090] Updated weights for policy 1, policy_version 790043 (0.0005) [2023-12-26 05:56:32,798][123091] Updated weights for policy 0, policy_version 795698 (0.0007) [2023-12-26 05:56:32,864][123091] Updated weights for policy 0, policy_version 795708 (0.0005) [2023-12-26 05:56:32,922][123091] Updated weights for policy 0, policy_version 795718 (0.0005) [2023-12-26 05:56:32,975][123091] Updated weights for policy 0, policy_version 795728 (0.0005) [2023-12-26 05:56:33,175][123090] Updated weights for policy 1, policy_version 790053 (0.0005) [2023-12-26 05:56:33,235][123090] Updated weights for policy 1, policy_version 790063 (0.0005) [2023-12-26 05:56:33,292][123090] Updated weights for policy 1, policy_version 790073 (0.0005) [2023-12-26 05:56:33,719][123091] Updated weights for policy 0, policy_version 795738 (0.0005) [2023-12-26 05:56:33,780][123091] Updated weights for policy 0, policy_version 795748 (0.0006) [2023-12-26 05:56:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 405970944. Throughput: 0: 8923.9, 1: 8834.7. Samples: 405987980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:33,785][121949] Avg episode reward: [(0, '5825.006'), (1, '5734.004')] [2023-12-26 05:56:33,836][123091] Updated weights for policy 0, policy_version 795758 (0.0005) [2023-12-26 05:56:33,994][123090] Updated weights for policy 1, policy_version 790083 (0.0007) [2023-12-26 05:56:34,057][123090] Updated weights for policy 1, policy_version 790093 (0.0010) [2023-12-26 05:56:34,121][123090] Updated weights for policy 1, policy_version 790103 (0.0011) [2023-12-26 05:56:34,617][123091] Updated weights for policy 0, policy_version 795768 (0.0008) [2023-12-26 05:56:34,685][123091] Updated weights for policy 0, policy_version 795778 (0.0008) [2023-12-26 05:56:34,749][123091] Updated weights for policy 0, policy_version 795788 (0.0008) [2023-12-26 05:56:34,967][123090] Updated weights for policy 1, policy_version 790113 (0.0011) [2023-12-26 05:56:35,019][123090] Updated weights for policy 1, policy_version 790123 (0.0007) [2023-12-26 05:56:35,070][123090] Updated weights for policy 1, policy_version 790133 (0.0006) [2023-12-26 05:56:35,134][123090] Updated weights for policy 1, policy_version 790143 (0.0005) [2023-12-26 05:56:35,489][123091] Updated weights for policy 0, policy_version 795798 (0.0007) [2023-12-26 05:56:35,546][123091] Updated weights for policy 0, policy_version 795808 (0.0006) [2023-12-26 05:56:35,597][123091] Updated weights for policy 0, policy_version 795818 (0.0006) [2023-12-26 05:56:35,889][123090] Updated weights for policy 1, policy_version 790153 (0.0010) [2023-12-26 05:56:35,951][123090] Updated weights for policy 1, policy_version 790163 (0.0010) [2023-12-26 05:56:36,009][123090] Updated weights for policy 1, policy_version 790173 (0.0010) [2023-12-26 05:56:36,258][123091] Updated weights for policy 0, policy_version 795828 (0.0008) [2023-12-26 05:56:36,318][123091] Updated weights for policy 0, policy_version 795838 (0.0009) [2023-12-26 05:56:36,384][123091] Updated weights for policy 0, policy_version 795848 (0.0009) [2023-12-26 05:56:36,830][123090] Updated weights for policy 1, policy_version 790183 (0.0007) [2023-12-26 05:56:36,907][123090] Updated weights for policy 1, policy_version 790193 (0.0005) [2023-12-26 05:56:36,979][123090] Updated weights for policy 1, policy_version 790203 (0.0006) [2023-12-26 05:56:37,222][123091] Updated weights for policy 0, policy_version 795858 (0.0008) [2023-12-26 05:56:37,297][123091] Updated weights for policy 0, policy_version 795868 (0.0007) [2023-12-26 05:56:37,363][123091] Updated weights for policy 0, policy_version 795878 (0.0009) [2023-12-26 05:56:37,424][123091] Updated weights for policy 0, policy_version 795888 (0.0010) [2023-12-26 05:56:37,674][123090] Updated weights for policy 1, policy_version 790213 (0.0010) [2023-12-26 05:56:37,732][123090] Updated weights for policy 1, policy_version 790223 (0.0009) [2023-12-26 05:56:37,796][123090] Updated weights for policy 1, policy_version 790233 (0.0009) [2023-12-26 05:56:38,175][123091] Updated weights for policy 0, policy_version 795898 (0.0005) [2023-12-26 05:56:38,239][123091] Updated weights for policy 0, policy_version 795908 (0.0009) [2023-12-26 05:56:38,306][123091] Updated weights for policy 0, policy_version 795918 (0.0010) [2023-12-26 05:56:38,560][123090] Updated weights for policy 1, policy_version 790243 (0.0008) [2023-12-26 05:56:38,613][123090] Updated weights for policy 1, policy_version 790253 (0.0005) [2023-12-26 05:56:38,680][123090] Updated weights for policy 1, policy_version 790263 (0.0005) [2023-12-26 05:56:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 406069248. Throughput: 0: 8953.7, 1: 8858.6. Samples: 406041664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:38,785][121949] Avg episode reward: [(0, '6023.771'), (1, '5852.481')] [2023-12-26 05:56:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000795920_203759616.pth... [2023-12-26 05:56:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000790272_202309632.pth... [2023-12-26 05:56:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000794864_203489280.pth [2023-12-26 05:56:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000789216_202039296.pth [2023-12-26 05:56:39,169][123091] Updated weights for policy 0, policy_version 795928 (0.0010) [2023-12-26 05:56:39,239][123091] Updated weights for policy 0, policy_version 795938 (0.0010) [2023-12-26 05:56:39,299][123091] Updated weights for policy 0, policy_version 795948 (0.0010) [2023-12-26 05:56:39,319][123090] Updated weights for policy 1, policy_version 790273 (0.0006) [2023-12-26 05:56:39,393][123090] Updated weights for policy 1, policy_version 790283 (0.0009) [2023-12-26 05:56:39,456][123090] Updated weights for policy 1, policy_version 790293 (0.0008) [2023-12-26 05:56:39,520][123090] Updated weights for policy 1, policy_version 790303 (0.0009) [2023-12-26 05:56:40,139][123091] Updated weights for policy 0, policy_version 795958 (0.0007) [2023-12-26 05:56:40,208][123091] Updated weights for policy 0, policy_version 795968 (0.0005) [2023-12-26 05:56:40,272][123091] Updated weights for policy 0, policy_version 795978 (0.0005) [2023-12-26 05:56:40,352][123090] Updated weights for policy 1, policy_version 790313 (0.0007) [2023-12-26 05:56:40,409][123090] Updated weights for policy 1, policy_version 790323 (0.0009) [2023-12-26 05:56:40,480][123090] Updated weights for policy 1, policy_version 790333 (0.0010) [2023-12-26 05:56:41,023][123091] Updated weights for policy 0, policy_version 795988 (0.0009) [2023-12-26 05:56:41,096][123091] Updated weights for policy 0, policy_version 795998 (0.0009) [2023-12-26 05:56:41,179][123091] Updated weights for policy 0, policy_version 796008 (0.0009) [2023-12-26 05:56:41,393][123090] Updated weights for policy 1, policy_version 790343 (0.0009) [2023-12-26 05:56:41,463][123090] Updated weights for policy 1, policy_version 790353 (0.0006) [2023-12-26 05:56:41,542][123090] Updated weights for policy 1, policy_version 790363 (0.0005) [2023-12-26 05:56:41,978][123091] Updated weights for policy 0, policy_version 796018 (0.0007) [2023-12-26 05:56:42,048][123091] Updated weights for policy 0, policy_version 796028 (0.0008) [2023-12-26 05:56:42,109][123091] Updated weights for policy 0, policy_version 796038 (0.0008) [2023-12-26 05:56:42,165][123091] Updated weights for policy 0, policy_version 796048 (0.0005) [2023-12-26 05:56:42,237][123090] Updated weights for policy 1, policy_version 790373 (0.0006) [2023-12-26 05:56:42,311][123090] Updated weights for policy 1, policy_version 790383 (0.0008) [2023-12-26 05:56:42,384][123090] Updated weights for policy 1, policy_version 790393 (0.0008) [2023-12-26 05:56:42,885][123091] Updated weights for policy 0, policy_version 796058 (0.0005) [2023-12-26 05:56:42,957][123091] Updated weights for policy 0, policy_version 796068 (0.0005) [2023-12-26 05:56:43,022][123091] Updated weights for policy 0, policy_version 796078 (0.0007) [2023-12-26 05:56:43,151][123090] Updated weights for policy 1, policy_version 790403 (0.0008) [2023-12-26 05:56:43,204][123090] Updated weights for policy 1, policy_version 790413 (0.0005) [2023-12-26 05:56:43,251][123090] Updated weights for policy 1, policy_version 790423 (0.0005) [2023-12-26 05:56:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 406151168. Throughput: 0: 8838.1, 1: 8857.4. Samples: 406148396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:43,785][121949] Avg episode reward: [(0, '5914.626'), (1, '5871.828')] [2023-12-26 05:56:43,859][123091] Updated weights for policy 0, policy_version 796088 (0.0008) [2023-12-26 05:56:43,919][123090] Updated weights for policy 1, policy_version 790433 (0.0005) [2023-12-26 05:56:43,925][123091] Updated weights for policy 0, policy_version 796098 (0.0005) [2023-12-26 05:56:43,979][123090] Updated weights for policy 1, policy_version 790443 (0.0008) [2023-12-26 05:56:43,989][123091] Updated weights for policy 0, policy_version 796108 (0.0006) [2023-12-26 05:56:44,040][123090] Updated weights for policy 1, policy_version 790453 (0.0008) [2023-12-26 05:56:44,100][123090] Updated weights for policy 1, policy_version 790463 (0.0008) [2023-12-26 05:56:44,689][123091] Updated weights for policy 0, policy_version 796118 (0.0009) [2023-12-26 05:56:44,757][123091] Updated weights for policy 0, policy_version 796128 (0.0009) [2023-12-26 05:56:44,821][123091] Updated weights for policy 0, policy_version 796138 (0.0009) [2023-12-26 05:56:44,920][123090] Updated weights for policy 1, policy_version 790473 (0.0010) [2023-12-26 05:56:44,988][123090] Updated weights for policy 1, policy_version 790483 (0.0011) [2023-12-26 05:56:45,045][123090] Updated weights for policy 1, policy_version 790493 (0.0011) [2023-12-26 05:56:45,675][123091] Updated weights for policy 0, policy_version 796148 (0.0008) [2023-12-26 05:56:45,751][123091] Updated weights for policy 0, policy_version 796158 (0.0005) [2023-12-26 05:56:45,777][123090] Updated weights for policy 1, policy_version 790503 (0.0007) [2023-12-26 05:56:45,813][123091] Updated weights for policy 0, policy_version 796168 (0.0007) [2023-12-26 05:56:45,837][123090] Updated weights for policy 1, policy_version 790513 (0.0005) [2023-12-26 05:56:45,901][123090] Updated weights for policy 1, policy_version 790523 (0.0005) [2023-12-26 05:56:46,578][123091] Updated weights for policy 0, policy_version 796178 (0.0010) [2023-12-26 05:56:46,594][123090] Updated weights for policy 1, policy_version 790533 (0.0006) [2023-12-26 05:56:46,629][123091] Updated weights for policy 0, policy_version 796188 (0.0010) [2023-12-26 05:56:46,640][123090] Updated weights for policy 1, policy_version 790543 (0.0005) [2023-12-26 05:56:46,680][123091] Updated weights for policy 0, policy_version 796198 (0.0010) [2023-12-26 05:56:46,694][123090] Updated weights for policy 1, policy_version 790553 (0.0006) [2023-12-26 05:56:46,731][123091] Updated weights for policy 0, policy_version 796208 (0.0010) [2023-12-26 05:56:47,337][123090] Updated weights for policy 1, policy_version 790563 (0.0005) [2023-12-26 05:56:47,390][123090] Updated weights for policy 1, policy_version 790573 (0.0005) [2023-12-26 05:56:47,437][123090] Updated weights for policy 1, policy_version 790583 (0.0005) [2023-12-26 05:56:47,572][123091] Updated weights for policy 0, policy_version 796218 (0.0010) [2023-12-26 05:56:47,619][123091] Updated weights for policy 0, policy_version 796228 (0.0010) [2023-12-26 05:56:47,670][123091] Updated weights for policy 0, policy_version 796238 (0.0010) [2023-12-26 05:56:48,114][123090] Updated weights for policy 1, policy_version 790593 (0.0005) [2023-12-26 05:56:48,184][123090] Updated weights for policy 1, policy_version 790603 (0.0005) [2023-12-26 05:56:48,248][123090] Updated weights for policy 1, policy_version 790613 (0.0005) [2023-12-26 05:56:48,309][123090] Updated weights for policy 1, policy_version 790623 (0.0007) [2023-12-26 05:56:48,534][123091] Updated weights for policy 0, policy_version 796248 (0.0010) [2023-12-26 05:56:48,585][123091] Updated weights for policy 0, policy_version 796258 (0.0010) [2023-12-26 05:56:48,649][123091] Updated weights for policy 0, policy_version 796268 (0.0010) [2023-12-26 05:56:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 406249472. Throughput: 0: 8858.0, 1: 9013.0. Samples: 406259120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:48,785][121949] Avg episode reward: [(0, '5787.011'), (1, '5750.827')] [2023-12-26 05:56:49,071][123090] Updated weights for policy 1, policy_version 790633 (0.0009) [2023-12-26 05:56:49,138][123090] Updated weights for policy 1, policy_version 790643 (0.0009) [2023-12-26 05:56:49,202][123090] Updated weights for policy 1, policy_version 790653 (0.0009) [2023-12-26 05:56:49,497][123091] Updated weights for policy 0, policy_version 796278 (0.0010) [2023-12-26 05:56:49,556][123091] Updated weights for policy 0, policy_version 796288 (0.0008) [2023-12-26 05:56:49,621][123091] Updated weights for policy 0, policy_version 796298 (0.0006) [2023-12-26 05:56:50,096][123090] Updated weights for policy 1, policy_version 790663 (0.0009) [2023-12-26 05:56:50,159][123090] Updated weights for policy 1, policy_version 790673 (0.0008) [2023-12-26 05:56:50,232][123090] Updated weights for policy 1, policy_version 790683 (0.0008) [2023-12-26 05:56:50,387][123091] Updated weights for policy 0, policy_version 796308 (0.0005) [2023-12-26 05:56:50,446][123091] Updated weights for policy 0, policy_version 796318 (0.0005) [2023-12-26 05:56:50,504][123091] Updated weights for policy 0, policy_version 796328 (0.0006) [2023-12-26 05:56:50,975][123090] Updated weights for policy 1, policy_version 790693 (0.0007) [2023-12-26 05:56:51,045][123090] Updated weights for policy 1, policy_version 790703 (0.0007) [2023-12-26 05:56:51,107][123090] Updated weights for policy 1, policy_version 790713 (0.0009) [2023-12-26 05:56:51,189][123091] Updated weights for policy 0, policy_version 796338 (0.0006) [2023-12-26 05:56:51,258][123091] Updated weights for policy 0, policy_version 796348 (0.0011) [2023-12-26 05:56:51,324][123091] Updated weights for policy 0, policy_version 796358 (0.0010) [2023-12-26 05:56:51,393][123091] Updated weights for policy 0, policy_version 796368 (0.0010) [2023-12-26 05:56:51,936][123090] Updated weights for policy 1, policy_version 790723 (0.0009) [2023-12-26 05:56:51,985][123090] Updated weights for policy 1, policy_version 790733 (0.0007) [2023-12-26 05:56:52,054][123090] Updated weights for policy 1, policy_version 790743 (0.0005) [2023-12-26 05:56:52,150][123091] Updated weights for policy 0, policy_version 796378 (0.0008) [2023-12-26 05:56:52,197][123091] Updated weights for policy 0, policy_version 796388 (0.0008) [2023-12-26 05:56:52,245][123091] Updated weights for policy 0, policy_version 796398 (0.0008) [2023-12-26 05:56:52,870][123090] Updated weights for policy 1, policy_version 790753 (0.0006) [2023-12-26 05:56:52,942][123090] Updated weights for policy 1, policy_version 790763 (0.0009) [2023-12-26 05:56:53,006][123090] Updated weights for policy 1, policy_version 790773 (0.0009) [2023-12-26 05:56:53,059][123090] Updated weights for policy 1, policy_version 790783 (0.0006) [2023-12-26 05:56:53,064][123091] Updated weights for policy 0, policy_version 796408 (0.0010) [2023-12-26 05:56:53,116][123091] Updated weights for policy 0, policy_version 796418 (0.0011) [2023-12-26 05:56:53,165][123091] Updated weights for policy 0, policy_version 796428 (0.0011) [2023-12-26 05:56:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 406331392. Throughput: 0: 8890.7, 1: 9017.1. Samples: 406311940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:53,786][121949] Avg episode reward: [(0, '5876.963'), (1, '5725.747')] [2023-12-26 05:56:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000796432_203890688.pth... [2023-12-26 05:56:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000795408_203628544.pth [2023-12-26 05:56:53,819][123090] Updated weights for policy 1, policy_version 790793 (0.0005) [2023-12-26 05:56:53,878][123090] Updated weights for policy 1, policy_version 790803 (0.0005) [2023-12-26 05:56:53,930][123090] Updated weights for policy 1, policy_version 790813 (0.0005) [2023-12-26 05:56:53,943][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000790816_202448896.pth... [2023-12-26 05:56:53,946][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000789728_202170368.pth [2023-12-26 05:56:54,011][123091] Updated weights for policy 0, policy_version 796438 (0.0007) [2023-12-26 05:56:54,063][123091] Updated weights for policy 0, policy_version 796448 (0.0007) [2023-12-26 05:56:54,106][123091] Updated weights for policy 0, policy_version 796458 (0.0010) [2023-12-26 05:56:54,575][123090] Updated weights for policy 1, policy_version 790823 (0.0009) [2023-12-26 05:56:54,627][123090] Updated weights for policy 1, policy_version 790833 (0.0010) [2023-12-26 05:56:54,678][123090] Updated weights for policy 1, policy_version 790843 (0.0010) [2023-12-26 05:56:54,884][123091] Updated weights for policy 0, policy_version 796468 (0.0008) [2023-12-26 05:56:54,938][123091] Updated weights for policy 0, policy_version 796478 (0.0006) [2023-12-26 05:56:54,985][123091] Updated weights for policy 0, policy_version 796488 (0.0006) [2023-12-26 05:56:55,487][123090] Updated weights for policy 1, policy_version 790853 (0.0010) [2023-12-26 05:56:55,530][123090] Updated weights for policy 1, policy_version 790863 (0.0010) [2023-12-26 05:56:55,585][123090] Updated weights for policy 1, policy_version 790873 (0.0008) [2023-12-26 05:56:55,610][123091] Updated weights for policy 0, policy_version 796498 (0.0005) [2023-12-26 05:56:55,662][123091] Updated weights for policy 0, policy_version 796508 (0.0005) [2023-12-26 05:56:55,710][123091] Updated weights for policy 0, policy_version 796518 (0.0005) [2023-12-26 05:56:55,762][123091] Updated weights for policy 0, policy_version 796528 (0.0005) [2023-12-26 05:56:56,288][123090] Updated weights for policy 1, policy_version 790883 (0.0007) [2023-12-26 05:56:56,348][123090] Updated weights for policy 1, policy_version 790893 (0.0010) [2023-12-26 05:56:56,408][123090] Updated weights for policy 1, policy_version 790903 (0.0011) [2023-12-26 05:56:56,492][123091] Updated weights for policy 0, policy_version 796538 (0.0011) [2023-12-26 05:56:56,549][123091] Updated weights for policy 0, policy_version 796548 (0.0010) [2023-12-26 05:56:56,596][123091] Updated weights for policy 0, policy_version 796558 (0.0010) [2023-12-26 05:56:57,104][123090] Updated weights for policy 1, policy_version 790913 (0.0009) [2023-12-26 05:56:57,173][123090] Updated weights for policy 1, policy_version 790923 (0.0008) [2023-12-26 05:56:57,233][123090] Updated weights for policy 1, policy_version 790933 (0.0010) [2023-12-26 05:56:57,292][123090] Updated weights for policy 1, policy_version 790943 (0.0010) [2023-12-26 05:56:57,373][123091] Updated weights for policy 0, policy_version 796568 (0.0006) [2023-12-26 05:56:57,432][123091] Updated weights for policy 0, policy_version 796578 (0.0005) [2023-12-26 05:56:57,488][123091] Updated weights for policy 0, policy_version 796588 (0.0005) [2023-12-26 05:56:58,118][123090] Updated weights for policy 1, policy_version 790953 (0.0008) [2023-12-26 05:56:58,158][123091] Updated weights for policy 0, policy_version 796598 (0.0008) [2023-12-26 05:56:58,186][123090] Updated weights for policy 1, policy_version 790963 (0.0008) [2023-12-26 05:56:58,217][123091] Updated weights for policy 0, policy_version 796608 (0.0009) [2023-12-26 05:56:58,252][123090] Updated weights for policy 1, policy_version 790973 (0.0009) [2023-12-26 05:56:58,281][123091] Updated weights for policy 0, policy_version 796618 (0.0008) [2023-12-26 05:56:58,786][121949] Fps is (10 sec: 18019.1, 60 sec: 17885.3, 300 sec: 17911.2). Total num frames: 406429696. Throughput: 0: 8984.7, 1: 9105.0. Samples: 406424776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:56:58,787][121949] Avg episode reward: [(0, '6113.520'), (1, '5754.292')] [2023-12-26 05:56:59,123][123090] Updated weights for policy 1, policy_version 790983 (0.0009) [2023-12-26 05:56:59,193][123090] Updated weights for policy 1, policy_version 790993 (0.0007) [2023-12-26 05:56:59,193][123091] Updated weights for policy 0, policy_version 796628 (0.0009) [2023-12-26 05:56:59,260][123090] Updated weights for policy 1, policy_version 791003 (0.0008) [2023-12-26 05:56:59,268][123091] Updated weights for policy 0, policy_version 796638 (0.0008) [2023-12-26 05:56:59,343][123091] Updated weights for policy 0, policy_version 796648 (0.0009) [2023-12-26 05:57:00,076][123090] Updated weights for policy 1, policy_version 791013 (0.0009) [2023-12-26 05:57:00,140][123090] Updated weights for policy 1, policy_version 791023 (0.0010) [2023-12-26 05:57:00,199][123091] Updated weights for policy 0, policy_version 796658 (0.0009) [2023-12-26 05:57:00,201][123090] Updated weights for policy 1, policy_version 791033 (0.0011) [2023-12-26 05:57:00,262][123091] Updated weights for policy 0, policy_version 796668 (0.0006) [2023-12-26 05:57:00,333][123091] Updated weights for policy 0, policy_version 796678 (0.0007) [2023-12-26 05:57:00,398][123091] Updated weights for policy 0, policy_version 796688 (0.0007) [2023-12-26 05:57:00,902][123090] Updated weights for policy 1, policy_version 791043 (0.0009) [2023-12-26 05:57:00,962][123090] Updated weights for policy 1, policy_version 791053 (0.0005) [2023-12-26 05:57:01,022][123090] Updated weights for policy 1, policy_version 791063 (0.0006) [2023-12-26 05:57:01,024][123091] Updated weights for policy 0, policy_version 796698 (0.0006) [2023-12-26 05:57:01,095][123091] Updated weights for policy 0, policy_version 796708 (0.0009) [2023-12-26 05:57:01,158][123091] Updated weights for policy 0, policy_version 796718 (0.0010) [2023-12-26 05:57:01,817][123090] Updated weights for policy 1, policy_version 791073 (0.0008) [2023-12-26 05:57:01,871][123091] Updated weights for policy 0, policy_version 796728 (0.0006) [2023-12-26 05:57:01,881][123090] Updated weights for policy 1, policy_version 791083 (0.0005) [2023-12-26 05:57:01,937][123091] Updated weights for policy 0, policy_version 796738 (0.0008) [2023-12-26 05:57:01,943][123090] Updated weights for policy 1, policy_version 791093 (0.0005) [2023-12-26 05:57:02,000][123091] Updated weights for policy 0, policy_version 796748 (0.0008) [2023-12-26 05:57:02,009][123090] Updated weights for policy 1, policy_version 791103 (0.0005) [2023-12-26 05:57:02,701][123090] Updated weights for policy 1, policy_version 791113 (0.0005) [2023-12-26 05:57:02,767][123090] Updated weights for policy 1, policy_version 791123 (0.0005) [2023-12-26 05:57:02,822][123090] Updated weights for policy 1, policy_version 791133 (0.0005) [2023-12-26 05:57:02,884][123091] Updated weights for policy 0, policy_version 796758 (0.0006) [2023-12-26 05:57:02,958][123091] Updated weights for policy 0, policy_version 796768 (0.0005) [2023-12-26 05:57:03,028][123091] Updated weights for policy 0, policy_version 796778 (0.0008) [2023-12-26 05:57:03,501][123090] Updated weights for policy 1, policy_version 791143 (0.0005) [2023-12-26 05:57:03,548][123090] Updated weights for policy 1, policy_version 791153 (0.0005) [2023-12-26 05:57:03,602][123090] Updated weights for policy 1, policy_version 791163 (0.0006) [2023-12-26 05:57:03,784][121949] Fps is (10 sec: 18842.4, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 406519808. Throughput: 0: 8882.5, 1: 9152.1. Samples: 406531176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:03,784][121949] Avg episode reward: [(0, '6063.915'), (1, '5886.754')] [2023-12-26 05:57:03,838][123091] Updated weights for policy 0, policy_version 796788 (0.0009) [2023-12-26 05:57:03,916][123091] Updated weights for policy 0, policy_version 796798 (0.0009) [2023-12-26 05:57:03,983][123091] Updated weights for policy 0, policy_version 796808 (0.0009) [2023-12-26 05:57:04,270][123090] Updated weights for policy 1, policy_version 791173 (0.0006) [2023-12-26 05:57:04,324][123090] Updated weights for policy 1, policy_version 791183 (0.0006) [2023-12-26 05:57:04,383][123090] Updated weights for policy 1, policy_version 791193 (0.0006) [2023-12-26 05:57:04,896][123091] Updated weights for policy 0, policy_version 796818 (0.0009) [2023-12-26 05:57:04,958][123091] Updated weights for policy 0, policy_version 796829 (0.0011) [2023-12-26 05:57:05,012][123091] Updated weights for policy 0, policy_version 796839 (0.0010) [2023-12-26 05:57:05,108][123090] Updated weights for policy 1, policy_version 791203 (0.0008) [2023-12-26 05:57:05,178][123090] Updated weights for policy 1, policy_version 791213 (0.0011) [2023-12-26 05:57:05,246][123090] Updated weights for policy 1, policy_version 791223 (0.0011) [2023-12-26 05:57:05,762][123091] Updated weights for policy 0, policy_version 796850 (0.0008) [2023-12-26 05:57:05,819][123091] Updated weights for policy 0, policy_version 796860 (0.0006) [2023-12-26 05:57:05,882][123091] Updated weights for policy 0, policy_version 796870 (0.0006) [2023-12-26 05:57:05,945][123091] Updated weights for policy 0, policy_version 796880 (0.0006) [2023-12-26 05:57:05,949][123090] Updated weights for policy 1, policy_version 791233 (0.0010) [2023-12-26 05:57:06,001][123090] Updated weights for policy 1, policy_version 791243 (0.0010) [2023-12-26 05:57:06,053][123090] Updated weights for policy 1, policy_version 791253 (0.0010) [2023-12-26 05:57:06,102][123090] Updated weights for policy 1, policy_version 791263 (0.0010) [2023-12-26 05:57:06,754][123091] Updated weights for policy 0, policy_version 796890 (0.0009) [2023-12-26 05:57:06,807][123091] Updated weights for policy 0, policy_version 796900 (0.0009) [2023-12-26 05:57:06,855][123091] Updated weights for policy 0, policy_version 796910 (0.0009) [2023-12-26 05:57:06,975][123090] Updated weights for policy 1, policy_version 791273 (0.0011) [2023-12-26 05:57:07,028][123090] Updated weights for policy 1, policy_version 791283 (0.0010) [2023-12-26 05:57:07,083][123090] Updated weights for policy 1, policy_version 791293 (0.0011) [2023-12-26 05:57:07,714][123091] Updated weights for policy 0, policy_version 796920 (0.0009) [2023-12-26 05:57:07,763][123091] Updated weights for policy 0, policy_version 796930 (0.0009) [2023-12-26 05:57:07,810][123091] Updated weights for policy 0, policy_version 796940 (0.0009) [2023-12-26 05:57:07,935][123090] Updated weights for policy 1, policy_version 791303 (0.0010) [2023-12-26 05:57:07,982][123090] Updated weights for policy 1, policy_version 791313 (0.0010) [2023-12-26 05:57:08,038][123090] Updated weights for policy 1, policy_version 791323 (0.0010) [2023-12-26 05:57:08,656][123091] Updated weights for policy 0, policy_version 796950 (0.0009) [2023-12-26 05:57:08,714][123091] Updated weights for policy 0, policy_version 796960 (0.0005) [2023-12-26 05:57:08,775][123091] Updated weights for policy 0, policy_version 796970 (0.0005) [2023-12-26 05:57:08,784][121949] Fps is (10 sec: 17206.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 406601728. Throughput: 0: 8905.5, 1: 9188.9. Samples: 406585732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:08,785][121949] Avg episode reward: [(0, '6007.575'), (1, '5818.126')] [2023-12-26 05:57:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000791328_202579968.pth... [2023-12-26 05:57:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000790272_202309632.pth [2023-12-26 05:57:08,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000796976_204029952.pth... [2023-12-26 05:57:08,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000795920_203759616.pth [2023-12-26 05:57:08,885][123090] Updated weights for policy 1, policy_version 791333 (0.0010) [2023-12-26 05:57:08,941][123090] Updated weights for policy 1, policy_version 791343 (0.0010) [2023-12-26 05:57:08,986][123090] Updated weights for policy 1, policy_version 791353 (0.0010) [2023-12-26 05:57:09,477][123091] Updated weights for policy 0, policy_version 796980 (0.0008) [2023-12-26 05:57:09,532][123091] Updated weights for policy 0, policy_version 796990 (0.0009) [2023-12-26 05:57:09,600][123091] Updated weights for policy 0, policy_version 797000 (0.0007) [2023-12-26 05:57:09,763][123090] Updated weights for policy 1, policy_version 791363 (0.0009) [2023-12-26 05:57:09,830][123090] Updated weights for policy 1, policy_version 791373 (0.0009) [2023-12-26 05:57:09,898][123090] Updated weights for policy 1, policy_version 791383 (0.0010) [2023-12-26 05:57:10,380][123091] Updated weights for policy 0, policy_version 797010 (0.0006) [2023-12-26 05:57:10,441][123091] Updated weights for policy 0, policy_version 797020 (0.0009) [2023-12-26 05:57:10,493][123091] Updated weights for policy 0, policy_version 797030 (0.0009) [2023-12-26 05:57:10,550][123091] Updated weights for policy 0, policy_version 797040 (0.0009) [2023-12-26 05:57:10,710][123090] Updated weights for policy 1, policy_version 791393 (0.0008) [2023-12-26 05:57:10,778][123090] Updated weights for policy 1, policy_version 791403 (0.0009) [2023-12-26 05:57:10,844][123090] Updated weights for policy 1, policy_version 791413 (0.0010) [2023-12-26 05:57:10,921][123090] Updated weights for policy 1, policy_version 791423 (0.0011) [2023-12-26 05:57:11,441][123091] Updated weights for policy 0, policy_version 797050 (0.0009) [2023-12-26 05:57:11,497][123091] Updated weights for policy 0, policy_version 797060 (0.0009) [2023-12-26 05:57:11,558][123091] Updated weights for policy 0, policy_version 797070 (0.0009) [2023-12-26 05:57:11,743][123090] Updated weights for policy 1, policy_version 791433 (0.0011) [2023-12-26 05:57:11,807][123090] Updated weights for policy 1, policy_version 791443 (0.0011) [2023-12-26 05:57:11,879][123090] Updated weights for policy 1, policy_version 791453 (0.0011) [2023-12-26 05:57:12,429][123091] Updated weights for policy 0, policy_version 797080 (0.0009) [2023-12-26 05:57:12,481][123091] Updated weights for policy 0, policy_version 797090 (0.0009) [2023-12-26 05:57:12,545][123091] Updated weights for policy 0, policy_version 797100 (0.0009) [2023-12-26 05:57:12,709][123090] Updated weights for policy 1, policy_version 791463 (0.0010) [2023-12-26 05:57:12,775][123090] Updated weights for policy 1, policy_version 791473 (0.0010) [2023-12-26 05:57:12,826][123090] Updated weights for policy 1, policy_version 791483 (0.0009) [2023-12-26 05:57:13,398][123091] Updated weights for policy 0, policy_version 797110 (0.0006) [2023-12-26 05:57:13,466][123091] Updated weights for policy 0, policy_version 797120 (0.0006) [2023-12-26 05:57:13,516][123091] Updated weights for policy 0, policy_version 797130 (0.0005) [2023-12-26 05:57:13,698][123090] Updated weights for policy 1, policy_version 791493 (0.0009) [2023-12-26 05:57:13,747][123090] Updated weights for policy 1, policy_version 791503 (0.0009) [2023-12-26 05:57:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 406691840. Throughput: 0: 8873.4, 1: 9173.8. Samples: 406687916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:13,785][121949] Avg episode reward: [(0, '6124.592'), (1, '5852.510')] [2023-12-26 05:57:13,802][123090] Updated weights for policy 1, policy_version 791513 (0.0010) [2023-12-26 05:57:14,279][123091] Updated weights for policy 0, policy_version 797140 (0.0007) [2023-12-26 05:57:14,331][123091] Updated weights for policy 0, policy_version 797150 (0.0009) [2023-12-26 05:57:14,400][123091] Updated weights for policy 0, policy_version 797160 (0.0009) [2023-12-26 05:57:14,612][123090] Updated weights for policy 1, policy_version 791524 (0.0007) [2023-12-26 05:57:14,664][123090] Updated weights for policy 1, policy_version 791534 (0.0005) [2023-12-26 05:57:14,720][123090] Updated weights for policy 1, policy_version 791544 (0.0005) [2023-12-26 05:57:15,212][123091] Updated weights for policy 0, policy_version 797170 (0.0009) [2023-12-26 05:57:15,272][123091] Updated weights for policy 0, policy_version 797180 (0.0009) [2023-12-26 05:57:15,324][123091] Updated weights for policy 0, policy_version 797190 (0.0009) [2023-12-26 05:57:15,372][123091] Updated weights for policy 0, policy_version 797200 (0.0009) [2023-12-26 05:57:15,541][123090] Updated weights for policy 1, policy_version 791554 (0.0008) [2023-12-26 05:57:15,604][123090] Updated weights for policy 1, policy_version 791564 (0.0011) [2023-12-26 05:57:15,663][123090] Updated weights for policy 1, policy_version 791574 (0.0010) [2023-12-26 05:57:15,719][123090] Updated weights for policy 1, policy_version 791584 (0.0010) [2023-12-26 05:57:16,096][123091] Updated weights for policy 0, policy_version 797210 (0.0006) [2023-12-26 05:57:16,156][123091] Updated weights for policy 0, policy_version 797220 (0.0005) [2023-12-26 05:57:16,226][123091] Updated weights for policy 0, policy_version 797230 (0.0005) [2023-12-26 05:57:16,552][123090] Updated weights for policy 1, policy_version 791594 (0.0008) [2023-12-26 05:57:16,623][123090] Updated weights for policy 1, policy_version 791604 (0.0008) [2023-12-26 05:57:16,690][123090] Updated weights for policy 1, policy_version 791614 (0.0010) [2023-12-26 05:57:16,874][123091] Updated weights for policy 0, policy_version 797240 (0.0005) [2023-12-26 05:57:16,925][123091] Updated weights for policy 0, policy_version 797250 (0.0006) [2023-12-26 05:57:16,973][123091] Updated weights for policy 0, policy_version 797261 (0.0009) [2023-12-26 05:57:17,456][123090] Updated weights for policy 1, policy_version 791624 (0.0010) [2023-12-26 05:57:17,514][123090] Updated weights for policy 1, policy_version 791634 (0.0010) [2023-12-26 05:57:17,574][123090] Updated weights for policy 1, policy_version 791644 (0.0010) [2023-12-26 05:57:17,819][123091] Updated weights for policy 0, policy_version 797271 (0.0010) [2023-12-26 05:57:17,872][123091] Updated weights for policy 0, policy_version 797282 (0.0010) [2023-12-26 05:57:17,934][123091] Updated weights for policy 0, policy_version 797293 (0.0010) [2023-12-26 05:57:18,187][123090] Updated weights for policy 1, policy_version 791654 (0.0008) [2023-12-26 05:57:18,238][123090] Updated weights for policy 1, policy_version 791664 (0.0010) [2023-12-26 05:57:18,301][123090] Updated weights for policy 1, policy_version 791674 (0.0010) [2023-12-26 05:57:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 406781952. Throughput: 0: 8855.4, 1: 9089.9. Samples: 406795516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:18,784][121949] Avg episode reward: [(0, '6162.685'), (1, '5877.375')] [2023-12-26 05:57:18,835][123091] Updated weights for policy 0, policy_version 797303 (0.0010) [2023-12-26 05:57:18,899][123091] Updated weights for policy 0, policy_version 797313 (0.0010) [2023-12-26 05:57:18,965][123091] Updated weights for policy 0, policy_version 797323 (0.0010) [2023-12-26 05:57:19,126][123090] Updated weights for policy 1, policy_version 791684 (0.0010) [2023-12-26 05:57:19,173][123090] Updated weights for policy 1, policy_version 791694 (0.0008) [2023-12-26 05:57:19,233][123090] Updated weights for policy 1, policy_version 791704 (0.0006) [2023-12-26 05:57:19,865][123091] Updated weights for policy 0, policy_version 797333 (0.0009) [2023-12-26 05:57:19,934][123091] Updated weights for policy 0, policy_version 797343 (0.0008) [2023-12-26 05:57:20,002][123091] Updated weights for policy 0, policy_version 797353 (0.0009) [2023-12-26 05:57:20,053][123090] Updated weights for policy 1, policy_version 791714 (0.0009) [2023-12-26 05:57:20,113][123090] Updated weights for policy 1, policy_version 791724 (0.0011) [2023-12-26 05:57:20,170][123090] Updated weights for policy 1, policy_version 791734 (0.0010) [2023-12-26 05:57:20,228][123090] Updated weights for policy 1, policy_version 791744 (0.0011) [2023-12-26 05:57:20,816][123091] Updated weights for policy 0, policy_version 797363 (0.0009) [2023-12-26 05:57:20,882][123091] Updated weights for policy 0, policy_version 797373 (0.0009) [2023-12-26 05:57:20,944][123091] Updated weights for policy 0, policy_version 797383 (0.0009) [2023-12-26 05:57:21,104][123090] Updated weights for policy 1, policy_version 791754 (0.0011) [2023-12-26 05:57:21,170][123090] Updated weights for policy 1, policy_version 791764 (0.0011) [2023-12-26 05:57:21,230][123090] Updated weights for policy 1, policy_version 791774 (0.0011) [2023-12-26 05:57:21,848][123091] Updated weights for policy 0, policy_version 797393 (0.0009) [2023-12-26 05:57:21,913][123091] Updated weights for policy 0, policy_version 797403 (0.0009) [2023-12-26 05:57:21,975][123091] Updated weights for policy 0, policy_version 797413 (0.0009) [2023-12-26 05:57:22,031][123091] Updated weights for policy 0, policy_version 797423 (0.0009) [2023-12-26 05:57:22,105][123090] Updated weights for policy 1, policy_version 791784 (0.0011) [2023-12-26 05:57:22,173][123090] Updated weights for policy 1, policy_version 791794 (0.0011) [2023-12-26 05:57:22,221][123090] Updated weights for policy 1, policy_version 791804 (0.0010) [2023-12-26 05:57:22,887][123091] Updated weights for policy 0, policy_version 797433 (0.0009) [2023-12-26 05:57:22,947][123091] Updated weights for policy 0, policy_version 797443 (0.0009) [2023-12-26 05:57:23,004][123091] Updated weights for policy 0, policy_version 797453 (0.0009) [2023-12-26 05:57:23,062][123090] Updated weights for policy 1, policy_version 791814 (0.0011) [2023-12-26 05:57:23,125][123090] Updated weights for policy 1, policy_version 791824 (0.0010) [2023-12-26 05:57:23,170][123090] Updated weights for policy 1, policy_version 791834 (0.0010) [2023-12-26 05:57:23,779][123091] Updated weights for policy 0, policy_version 797463 (0.0009) [2023-12-26 05:57:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 406863872. Throughput: 0: 8800.7, 1: 9065.7. Samples: 406845652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:23,785][121949] Avg episode reward: [(0, '5940.923'), (1, '5902.960')] [2023-12-26 05:57:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000791840_202711040.pth... [2023-12-26 05:57:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000790816_202448896.pth [2023-12-26 05:57:23,836][123091] Updated weights for policy 0, policy_version 797473 (0.0009) [2023-12-26 05:57:23,888][123091] Updated weights for policy 0, policy_version 797483 (0.0010) [2023-12-26 05:57:23,913][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000797488_204161024.pth... [2023-12-26 05:57:23,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000796432_203890688.pth [2023-12-26 05:57:24,015][123090] Updated weights for policy 1, policy_version 791844 (0.0011) [2023-12-26 05:57:24,085][123090] Updated weights for policy 1, policy_version 791854 (0.0010) [2023-12-26 05:57:24,151][123090] Updated weights for policy 1, policy_version 791864 (0.0010) [2023-12-26 05:57:24,718][123091] Updated weights for policy 0, policy_version 797493 (0.0011) [2023-12-26 05:57:24,775][123091] Updated weights for policy 0, policy_version 797503 (0.0010) [2023-12-26 05:57:24,829][123091] Updated weights for policy 0, policy_version 797513 (0.0010) [2023-12-26 05:57:24,883][123090] Updated weights for policy 1, policy_version 791874 (0.0009) [2023-12-26 05:57:24,940][123090] Updated weights for policy 1, policy_version 791884 (0.0005) [2023-12-26 05:57:24,994][123090] Updated weights for policy 1, policy_version 791894 (0.0005) [2023-12-26 05:57:25,058][123090] Updated weights for policy 1, policy_version 791904 (0.0007) [2023-12-26 05:57:25,676][123091] Updated weights for policy 0, policy_version 797523 (0.0008) [2023-12-26 05:57:25,721][123090] Updated weights for policy 1, policy_version 791914 (0.0005) [2023-12-26 05:57:25,737][123091] Updated weights for policy 0, policy_version 797533 (0.0006) [2023-12-26 05:57:25,785][123090] Updated weights for policy 1, policy_version 791924 (0.0005) [2023-12-26 05:57:25,804][123091] Updated weights for policy 0, policy_version 797543 (0.0006) [2023-12-26 05:57:25,842][123090] Updated weights for policy 1, policy_version 791934 (0.0005) [2023-12-26 05:57:26,515][123091] Updated weights for policy 0, policy_version 797553 (0.0009) [2023-12-26 05:57:26,532][123090] Updated weights for policy 1, policy_version 791944 (0.0008) [2023-12-26 05:57:26,577][123091] Updated weights for policy 0, policy_version 797563 (0.0007) [2023-12-26 05:57:26,594][123090] Updated weights for policy 1, policy_version 791954 (0.0009) [2023-12-26 05:57:26,634][123091] Updated weights for policy 0, policy_version 797573 (0.0010) [2023-12-26 05:57:26,659][123090] Updated weights for policy 1, policy_version 791964 (0.0007) [2023-12-26 05:57:26,695][123091] Updated weights for policy 0, policy_version 797583 (0.0009) [2023-12-26 05:57:27,453][123090] Updated weights for policy 1, policy_version 791974 (0.0009) [2023-12-26 05:57:27,506][123091] Updated weights for policy 0, policy_version 797593 (0.0006) [2023-12-26 05:57:27,520][123090] Updated weights for policy 1, policy_version 791984 (0.0009) [2023-12-26 05:57:27,556][123091] Updated weights for policy 0, policy_version 797603 (0.0008) [2023-12-26 05:57:27,565][123090] Updated weights for policy 1, policy_version 791994 (0.0007) [2023-12-26 05:57:27,610][123091] Updated weights for policy 0, policy_version 797613 (0.0008) [2023-12-26 05:57:28,389][123090] Updated weights for policy 1, policy_version 792004 (0.0007) [2023-12-26 05:57:28,443][123091] Updated weights for policy 0, policy_version 797623 (0.0009) [2023-12-26 05:57:28,479][123090] Updated weights for policy 1, policy_version 792014 (0.0009) [2023-12-26 05:57:28,502][123091] Updated weights for policy 0, policy_version 797633 (0.0011) [2023-12-26 05:57:28,543][123090] Updated weights for policy 1, policy_version 792024 (0.0006) [2023-12-26 05:57:28,558][123091] Updated weights for policy 0, policy_version 797643 (0.0010) [2023-12-26 05:57:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17883.6). Total num frames: 406962176. Throughput: 0: 8794.5, 1: 9073.1. Samples: 406952440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:28,785][121949] Avg episode reward: [(0, '6044.504'), (1, '5860.230')] [2023-12-26 05:57:29,350][123091] Updated weights for policy 0, policy_version 797653 (0.0010) [2023-12-26 05:57:29,354][123090] Updated weights for policy 1, policy_version 792034 (0.0008) [2023-12-26 05:57:29,408][123091] Updated weights for policy 0, policy_version 797663 (0.0009) [2023-12-26 05:57:29,416][123090] Updated weights for policy 1, policy_version 792044 (0.0009) [2023-12-26 05:57:29,461][123091] Updated weights for policy 0, policy_version 797673 (0.0006) [2023-12-26 05:57:29,464][123090] Updated weights for policy 1, policy_version 792054 (0.0010) [2023-12-26 05:57:29,528][123090] Updated weights for policy 1, policy_version 792064 (0.0009) [2023-12-26 05:57:30,263][123091] Updated weights for policy 0, policy_version 797683 (0.0007) [2023-12-26 05:57:30,313][123091] Updated weights for policy 0, policy_version 797693 (0.0005) [2023-12-26 05:57:30,354][123090] Updated weights for policy 1, policy_version 792074 (0.0005) [2023-12-26 05:57:30,372][123091] Updated weights for policy 0, policy_version 797703 (0.0007) [2023-12-26 05:57:30,407][123090] Updated weights for policy 1, policy_version 792084 (0.0006) [2023-12-26 05:57:30,485][123090] Updated weights for policy 1, policy_version 792094 (0.0006) [2023-12-26 05:57:31,058][123091] Updated weights for policy 0, policy_version 797713 (0.0008) [2023-12-26 05:57:31,110][123090] Updated weights for policy 1, policy_version 792104 (0.0009) [2023-12-26 05:57:31,121][123091] Updated weights for policy 0, policy_version 797723 (0.0010) [2023-12-26 05:57:31,172][123090] Updated weights for policy 1, policy_version 792114 (0.0010) [2023-12-26 05:57:31,189][123091] Updated weights for policy 0, policy_version 797733 (0.0008) [2023-12-26 05:57:31,227][123090] Updated weights for policy 1, policy_version 792124 (0.0009) [2023-12-26 05:57:31,251][123091] Updated weights for policy 0, policy_version 797743 (0.0007) [2023-12-26 05:57:32,058][123090] Updated weights for policy 1, policy_version 792134 (0.0009) [2023-12-26 05:57:32,071][123091] Updated weights for policy 0, policy_version 797753 (0.0009) [2023-12-26 05:57:32,118][123091] Updated weights for policy 0, policy_version 797763 (0.0009) [2023-12-26 05:57:32,120][123090] Updated weights for policy 1, policy_version 792144 (0.0008) [2023-12-26 05:57:32,173][123091] Updated weights for policy 0, policy_version 797773 (0.0006) [2023-12-26 05:57:32,181][123090] Updated weights for policy 1, policy_version 792154 (0.0010) [2023-12-26 05:57:32,895][123091] Updated weights for policy 0, policy_version 797783 (0.0008) [2023-12-26 05:57:32,952][123091] Updated weights for policy 0, policy_version 797793 (0.0009) [2023-12-26 05:57:33,004][123091] Updated weights for policy 0, policy_version 797803 (0.0010) [2023-12-26 05:57:33,035][123090] Updated weights for policy 1, policy_version 792164 (0.0009) [2023-12-26 05:57:33,091][123090] Updated weights for policy 1, policy_version 792174 (0.0009) [2023-12-26 05:57:33,150][123090] Updated weights for policy 1, policy_version 792184 (0.0010) [2023-12-26 05:57:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 407044096. Throughput: 0: 8857.5, 1: 8931.9. Samples: 407059644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:33,784][121949] Avg episode reward: [(0, '6236.824'), (1, '5840.335')] [2023-12-26 05:57:33,799][123091] Updated weights for policy 0, policy_version 797813 (0.0010) [2023-12-26 05:57:33,856][123091] Updated weights for policy 0, policy_version 797823 (0.0009) [2023-12-26 05:57:33,916][123091] Updated weights for policy 0, policy_version 797833 (0.0009) [2023-12-26 05:57:34,016][123090] Updated weights for policy 1, policy_version 792194 (0.0009) [2023-12-26 05:57:34,074][123090] Updated weights for policy 1, policy_version 792204 (0.0009) [2023-12-26 05:57:34,138][123090] Updated weights for policy 1, policy_version 792214 (0.0009) [2023-12-26 05:57:34,203][123090] Updated weights for policy 1, policy_version 792224 (0.0009) [2023-12-26 05:57:34,756][123091] Updated weights for policy 0, policy_version 797843 (0.0008) [2023-12-26 05:57:34,812][123091] Updated weights for policy 0, policy_version 797853 (0.0006) [2023-12-26 05:57:34,868][123091] Updated weights for policy 0, policy_version 797863 (0.0005) [2023-12-26 05:57:35,072][123090] Updated weights for policy 1, policy_version 792234 (0.0005) [2023-12-26 05:57:35,143][123090] Updated weights for policy 1, policy_version 792244 (0.0006) [2023-12-26 05:57:35,197][123090] Updated weights for policy 1, policy_version 792254 (0.0005) [2023-12-26 05:57:35,502][123091] Updated weights for policy 0, policy_version 797873 (0.0006) [2023-12-26 05:57:35,553][123091] Updated weights for policy 0, policy_version 797883 (0.0010) [2023-12-26 05:57:35,607][123091] Updated weights for policy 0, policy_version 797893 (0.0010) [2023-12-26 05:57:35,655][123091] Updated weights for policy 0, policy_version 797903 (0.0010) [2023-12-26 05:57:35,872][123090] Updated weights for policy 1, policy_version 792264 (0.0009) [2023-12-26 05:57:35,947][123090] Updated weights for policy 1, policy_version 792274 (0.0005) [2023-12-26 05:57:36,017][123090] Updated weights for policy 1, policy_version 792284 (0.0005) [2023-12-26 05:57:36,506][123091] Updated weights for policy 0, policy_version 797913 (0.0009) [2023-12-26 05:57:36,570][123091] Updated weights for policy 0, policy_version 797923 (0.0009) [2023-12-26 05:57:36,639][123091] Updated weights for policy 0, policy_version 797933 (0.0009) [2023-12-26 05:57:36,712][123090] Updated weights for policy 1, policy_version 792294 (0.0005) [2023-12-26 05:57:36,786][123090] Updated weights for policy 1, policy_version 792304 (0.0007) [2023-12-26 05:57:36,844][123090] Updated weights for policy 1, policy_version 792314 (0.0006) [2023-12-26 05:57:37,404][123091] Updated weights for policy 0, policy_version 797943 (0.0010) [2023-12-26 05:57:37,454][123091] Updated weights for policy 0, policy_version 797953 (0.0010) [2023-12-26 05:57:37,501][123090] Updated weights for policy 1, policy_version 792324 (0.0005) [2023-12-26 05:57:37,514][123091] Updated weights for policy 0, policy_version 797963 (0.0011) [2023-12-26 05:57:37,564][123090] Updated weights for policy 1, policy_version 792334 (0.0005) [2023-12-26 05:57:37,631][123090] Updated weights for policy 1, policy_version 792344 (0.0008) [2023-12-26 05:57:38,301][123090] Updated weights for policy 1, policy_version 792354 (0.0005) [2023-12-26 05:57:38,369][123090] Updated weights for policy 1, policy_version 792364 (0.0008) [2023-12-26 05:57:38,440][123090] Updated weights for policy 1, policy_version 792374 (0.0008) [2023-12-26 05:57:38,451][123091] Updated weights for policy 0, policy_version 797973 (0.0009) [2023-12-26 05:57:38,503][123090] Updated weights for policy 1, policy_version 792384 (0.0008) [2023-12-26 05:57:38,514][123091] Updated weights for policy 0, policy_version 797983 (0.0010) [2023-12-26 05:57:38,569][123091] Updated weights for policy 0, policy_version 797993 (0.0010) [2023-12-26 05:57:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 407142400. Throughput: 0: 8858.2, 1: 8973.4. Samples: 407114356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:38,785][121949] Avg episode reward: [(0, '6086.968'), (1, '5854.767')] [2023-12-26 05:57:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000798000_204292096.pth... [2023-12-26 05:57:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000792384_202850304.pth... [2023-12-26 05:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000796976_204029952.pth [2023-12-26 05:57:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000791328_202579968.pth [2023-12-26 05:57:39,289][123090] Updated weights for policy 1, policy_version 792394 (0.0011) [2023-12-26 05:57:39,370][123090] Updated weights for policy 1, policy_version 792404 (0.0009) [2023-12-26 05:57:39,373][123091] Updated weights for policy 0, policy_version 798003 (0.0009) [2023-12-26 05:57:39,437][123090] Updated weights for policy 1, policy_version 792414 (0.0007) [2023-12-26 05:57:39,443][123091] Updated weights for policy 0, policy_version 798013 (0.0009) [2023-12-26 05:57:39,502][123091] Updated weights for policy 0, policy_version 798023 (0.0009) [2023-12-26 05:57:40,246][123090] Updated weights for policy 1, policy_version 792424 (0.0008) [2023-12-26 05:57:40,295][123090] Updated weights for policy 1, policy_version 792434 (0.0009) [2023-12-26 05:57:40,353][123091] Updated weights for policy 0, policy_version 798033 (0.0009) [2023-12-26 05:57:40,357][123090] Updated weights for policy 1, policy_version 792444 (0.0009) [2023-12-26 05:57:40,420][123091] Updated weights for policy 0, policy_version 798043 (0.0006) [2023-12-26 05:57:40,469][123091] Updated weights for policy 0, policy_version 798053 (0.0005) [2023-12-26 05:57:40,514][123091] Updated weights for policy 0, policy_version 798063 (0.0005) [2023-12-26 05:57:41,201][123090] Updated weights for policy 1, policy_version 792454 (0.0009) [2023-12-26 05:57:41,259][123090] Updated weights for policy 1, policy_version 792464 (0.0011) [2023-12-26 05:57:41,275][123091] Updated weights for policy 0, policy_version 798073 (0.0008) [2023-12-26 05:57:41,324][123090] Updated weights for policy 1, policy_version 792474 (0.0011) [2023-12-26 05:57:41,337][123091] Updated weights for policy 0, policy_version 798083 (0.0008) [2023-12-26 05:57:41,405][123091] Updated weights for policy 0, policy_version 798093 (0.0007) [2023-12-26 05:57:42,106][123090] Updated weights for policy 1, policy_version 792484 (0.0008) [2023-12-26 05:57:42,180][123090] Updated weights for policy 1, policy_version 792494 (0.0008) [2023-12-26 05:57:42,244][123090] Updated weights for policy 1, policy_version 792504 (0.0006) [2023-12-26 05:57:42,247][123091] Updated weights for policy 0, policy_version 798103 (0.0010) [2023-12-26 05:57:42,307][123091] Updated weights for policy 0, policy_version 798113 (0.0011) [2023-12-26 05:57:42,372][123091] Updated weights for policy 0, policy_version 798123 (0.0011) [2023-12-26 05:57:43,051][123090] Updated weights for policy 1, policy_version 792514 (0.0008) [2023-12-26 05:57:43,103][123090] Updated weights for policy 1, policy_version 792524 (0.0009) [2023-12-26 05:57:43,159][123090] Updated weights for policy 1, policy_version 792534 (0.0008) [2023-12-26 05:57:43,197][123091] Updated weights for policy 0, policy_version 798133 (0.0011) [2023-12-26 05:57:43,224][123090] Updated weights for policy 1, policy_version 792544 (0.0010) [2023-12-26 05:57:43,257][123091] Updated weights for policy 0, policy_version 798143 (0.0010) [2023-12-26 05:57:43,326][123091] Updated weights for policy 0, policy_version 798153 (0.0011) [2023-12-26 05:57:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 407224320. Throughput: 0: 8737.3, 1: 8924.8. Samples: 407219540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:43,785][121949] Avg episode reward: [(0, '5835.273'), (1, '5834.742')] [2023-12-26 05:57:43,991][123090] Updated weights for policy 1, policy_version 792554 (0.0005) [2023-12-26 05:57:44,011][123091] Updated weights for policy 0, policy_version 798163 (0.0009) [2023-12-26 05:57:44,045][123090] Updated weights for policy 1, policy_version 792564 (0.0006) [2023-12-26 05:57:44,069][123091] Updated weights for policy 0, policy_version 798173 (0.0005) [2023-12-26 05:57:44,108][123090] Updated weights for policy 1, policy_version 792574 (0.0008) [2023-12-26 05:57:44,134][123091] Updated weights for policy 0, policy_version 798183 (0.0006) [2023-12-26 05:57:44,835][123090] Updated weights for policy 1, policy_version 792584 (0.0006) [2023-12-26 05:57:44,874][123091] Updated weights for policy 0, policy_version 798193 (0.0006) [2023-12-26 05:57:44,899][123090] Updated weights for policy 1, policy_version 792594 (0.0006) [2023-12-26 05:57:44,938][123091] Updated weights for policy 0, policy_version 798203 (0.0008) [2023-12-26 05:57:44,959][123090] Updated weights for policy 1, policy_version 792604 (0.0007) [2023-12-26 05:57:45,000][123091] Updated weights for policy 0, policy_version 798213 (0.0008) [2023-12-26 05:57:45,060][123091] Updated weights for policy 0, policy_version 798223 (0.0008) [2023-12-26 05:57:45,766][123091] Updated weights for policy 0, policy_version 798233 (0.0010) [2023-12-26 05:57:45,782][123090] Updated weights for policy 1, policy_version 792614 (0.0008) [2023-12-26 05:57:45,825][123091] Updated weights for policy 0, policy_version 798243 (0.0009) [2023-12-26 05:57:45,832][123090] Updated weights for policy 1, policy_version 792624 (0.0005) [2023-12-26 05:57:45,881][123091] Updated weights for policy 0, policy_version 798253 (0.0011) [2023-12-26 05:57:45,886][123090] Updated weights for policy 1, policy_version 792634 (0.0005) [2023-12-26 05:57:46,595][123091] Updated weights for policy 0, policy_version 798263 (0.0007) [2023-12-26 05:57:46,668][123091] Updated weights for policy 0, policy_version 798273 (0.0007) [2023-12-26 05:57:46,694][123090] Updated weights for policy 1, policy_version 792644 (0.0006) [2023-12-26 05:57:46,731][123091] Updated weights for policy 0, policy_version 798283 (0.0011) [2023-12-26 05:57:46,743][123090] Updated weights for policy 1, policy_version 792654 (0.0007) [2023-12-26 05:57:46,789][123090] Updated weights for policy 1, policy_version 792664 (0.0006) [2023-12-26 05:57:47,502][123091] Updated weights for policy 0, policy_version 798293 (0.0011) [2023-12-26 05:57:47,553][123091] Updated weights for policy 0, policy_version 798303 (0.0010) [2023-12-26 05:57:47,576][123090] Updated weights for policy 1, policy_version 792674 (0.0006) [2023-12-26 05:57:47,608][123091] Updated weights for policy 0, policy_version 798313 (0.0010) [2023-12-26 05:57:47,628][123090] Updated weights for policy 1, policy_version 792684 (0.0006) [2023-12-26 05:57:47,682][123090] Updated weights for policy 1, policy_version 792694 (0.0007) [2023-12-26 05:57:47,734][123090] Updated weights for policy 1, policy_version 792704 (0.0008) [2023-12-26 05:57:48,449][123091] Updated weights for policy 0, policy_version 798323 (0.0010) [2023-12-26 05:57:48,513][123091] Updated weights for policy 0, policy_version 798333 (0.0011) [2023-12-26 05:57:48,569][123091] Updated weights for policy 0, policy_version 798343 (0.0011) [2023-12-26 05:57:48,595][123090] Updated weights for policy 1, policy_version 792714 (0.0009) [2023-12-26 05:57:48,645][123090] Updated weights for policy 1, policy_version 792724 (0.0008) [2023-12-26 05:57:48,694][123090] Updated weights for policy 1, policy_version 792734 (0.0008) [2023-12-26 05:57:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 407322624. Throughput: 0: 8812.5, 1: 8901.3. Samples: 407328300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 05:57:48,785][121949] Avg episode reward: [(0, '5993.127'), (1, '5793.244')] [2023-12-26 05:57:49,402][123091] Updated weights for policy 0, policy_version 798353 (0.0010) [2023-12-26 05:57:49,458][123091] Updated weights for policy 0, policy_version 798363 (0.0011) [2023-12-26 05:57:49,510][123091] Updated weights for policy 0, policy_version 798373 (0.0010) [2023-12-26 05:57:49,559][123090] Updated weights for policy 1, policy_version 792744 (0.0006) [2023-12-26 05:57:49,565][123091] Updated weights for policy 0, policy_version 798383 (0.0010) [2023-12-26 05:57:49,623][123090] Updated weights for policy 1, policy_version 792754 (0.0008) [2023-12-26 05:57:49,682][123090] Updated weights for policy 1, policy_version 792764 (0.0008) [2023-12-26 05:57:50,413][123091] Updated weights for policy 0, policy_version 798393 (0.0011) [2023-12-26 05:57:50,477][123091] Updated weights for policy 0, policy_version 798403 (0.0010) [2023-12-26 05:57:50,521][123090] Updated weights for policy 1, policy_version 792774 (0.0007) [2023-12-26 05:57:50,539][123091] Updated weights for policy 0, policy_version 798413 (0.0010) [2023-12-26 05:57:50,587][123090] Updated weights for policy 1, policy_version 792784 (0.0007) [2023-12-26 05:57:50,643][123090] Updated weights for policy 1, policy_version 792794 (0.0009) [2023-12-26 05:57:51,388][123091] Updated weights for policy 0, policy_version 798423 (0.0011) [2023-12-26 05:57:51,448][123091] Updated weights for policy 0, policy_version 798433 (0.0011) [2023-12-26 05:57:51,510][123090] Updated weights for policy 1, policy_version 792804 (0.0007) [2023-12-26 05:57:51,512][123091] Updated weights for policy 0, policy_version 798443 (0.0011) [2023-12-26 05:57:51,571][123090] Updated weights for policy 1, policy_version 792814 (0.0007) [2023-12-26 05:57:51,635][123090] Updated weights for policy 1, policy_version 792824 (0.0008) [2023-12-26 05:57:52,387][123091] Updated weights for policy 0, policy_version 798453 (0.0010) [2023-12-26 05:57:52,431][123090] Updated weights for policy 1, policy_version 792834 (0.0008) [2023-12-26 05:57:52,459][123091] Updated weights for policy 0, policy_version 798463 (0.0008) [2023-12-26 05:57:52,483][123090] Updated weights for policy 1, policy_version 792844 (0.0010) [2023-12-26 05:57:52,509][123091] Updated weights for policy 0, policy_version 798473 (0.0008) [2023-12-26 05:57:52,549][123090] Updated weights for policy 1, policy_version 792854 (0.0010) [2023-12-26 05:57:52,616][123090] Updated weights for policy 1, policy_version 792864 (0.0011) [2023-12-26 05:57:53,339][123091] Updated weights for policy 0, policy_version 798483 (0.0006) [2023-12-26 05:57:53,402][123091] Updated weights for policy 0, policy_version 798493 (0.0005) [2023-12-26 05:57:53,458][123091] Updated weights for policy 0, policy_version 798503 (0.0006) [2023-12-26 05:57:53,458][123090] Updated weights for policy 1, policy_version 792874 (0.0009) [2023-12-26 05:57:53,508][123090] Updated weights for policy 1, policy_version 792884 (0.0007) [2023-12-26 05:57:53,572][123090] Updated weights for policy 1, policy_version 792894 (0.0007) [2023-12-26 05:57:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 407404544. Throughput: 0: 8803.5, 1: 8812.5. Samples: 407378456. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:57:53,785][121949] Avg episode reward: [(0, '6220.007'), (1, '5775.246')] [2023-12-26 05:57:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000798512_204423168.pth... [2023-12-26 05:57:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000792896_202981376.pth... [2023-12-26 05:57:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000791840_202711040.pth [2023-12-26 05:57:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000797488_204161024.pth [2023-12-26 05:57:54,233][123091] Updated weights for policy 0, policy_version 798513 (0.0009) [2023-12-26 05:57:54,290][123091] Updated weights for policy 0, policy_version 798523 (0.0007) [2023-12-26 05:57:54,346][123091] Updated weights for policy 0, policy_version 798533 (0.0009) [2023-12-26 05:57:54,360][123090] Updated weights for policy 1, policy_version 792904 (0.0008) [2023-12-26 05:57:54,402][123091] Updated weights for policy 0, policy_version 798543 (0.0005) [2023-12-26 05:57:54,429][123090] Updated weights for policy 1, policy_version 792914 (0.0009) [2023-12-26 05:57:54,490][123090] Updated weights for policy 1, policy_version 792924 (0.0009) [2023-12-26 05:57:55,095][123091] Updated weights for policy 0, policy_version 798553 (0.0010) [2023-12-26 05:57:55,147][123091] Updated weights for policy 0, policy_version 798563 (0.0011) [2023-12-26 05:57:55,195][123091] Updated weights for policy 0, policy_version 798573 (0.0010) [2023-12-26 05:57:55,366][123090] Updated weights for policy 1, policy_version 792934 (0.0009) [2023-12-26 05:57:55,418][123090] Updated weights for policy 1, policy_version 792944 (0.0009) [2023-12-26 05:57:55,472][123090] Updated weights for policy 1, policy_version 792954 (0.0010) [2023-12-26 05:57:55,978][123091] Updated weights for policy 0, policy_version 798583 (0.0010) [2023-12-26 05:57:56,040][123091] Updated weights for policy 0, policy_version 798593 (0.0010) [2023-12-26 05:57:56,094][123091] Updated weights for policy 0, policy_version 798603 (0.0010) [2023-12-26 05:57:56,336][123090] Updated weights for policy 1, policy_version 792965 (0.0010) [2023-12-26 05:57:56,384][123090] Updated weights for policy 1, policy_version 792975 (0.0008) [2023-12-26 05:57:56,432][123090] Updated weights for policy 1, policy_version 792985 (0.0009) [2023-12-26 05:57:56,916][123091] Updated weights for policy 0, policy_version 798613 (0.0008) [2023-12-26 05:57:56,965][123091] Updated weights for policy 0, policy_version 798623 (0.0010) [2023-12-26 05:57:57,012][123091] Updated weights for policy 0, policy_version 798633 (0.0010) [2023-12-26 05:57:57,146][123090] Updated weights for policy 1, policy_version 792995 (0.0007) [2023-12-26 05:57:57,203][123090] Updated weights for policy 1, policy_version 793005 (0.0005) [2023-12-26 05:57:57,256][123090] Updated weights for policy 1, policy_version 793015 (0.0008) [2023-12-26 05:57:57,749][123091] Updated weights for policy 0, policy_version 798643 (0.0009) [2023-12-26 05:57:57,801][123091] Updated weights for policy 0, policy_version 798653 (0.0006) [2023-12-26 05:57:57,847][123091] Updated weights for policy 0, policy_version 798663 (0.0006) [2023-12-26 05:57:57,924][123090] Updated weights for policy 1, policy_version 793025 (0.0010) [2023-12-26 05:57:57,972][123090] Updated weights for policy 1, policy_version 793035 (0.0005) [2023-12-26 05:57:58,029][123090] Updated weights for policy 1, policy_version 793045 (0.0007) [2023-12-26 05:57:58,095][123090] Updated weights for policy 1, policy_version 793055 (0.0010) [2023-12-26 05:57:58,622][123091] Updated weights for policy 0, policy_version 798673 (0.0005) [2023-12-26 05:57:58,689][123091] Updated weights for policy 0, policy_version 798683 (0.0008) [2023-12-26 05:57:58,764][123091] Updated weights for policy 0, policy_version 798693 (0.0008) [2023-12-26 05:57:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17613.3, 300 sec: 17828.0). Total num frames: 407486464. Throughput: 0: 8871.0, 1: 8867.6. Samples: 407486152. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:57:58,785][121949] Avg episode reward: [(0, '6185.902'), (1, '5757.692')] [2023-12-26 05:57:58,827][123091] Updated weights for policy 0, policy_version 798703 (0.0008) [2023-12-26 05:57:58,962][123090] Updated weights for policy 1, policy_version 793065 (0.0009) [2023-12-26 05:57:59,030][123090] Updated weights for policy 1, policy_version 793075 (0.0010) [2023-12-26 05:57:59,090][123090] Updated weights for policy 1, policy_version 793085 (0.0009) [2023-12-26 05:57:59,656][123091] Updated weights for policy 0, policy_version 798713 (0.0009) [2023-12-26 05:57:59,723][123091] Updated weights for policy 0, policy_version 798723 (0.0010) [2023-12-26 05:57:59,794][123091] Updated weights for policy 0, policy_version 798733 (0.0009) [2023-12-26 05:57:59,809][123090] Updated weights for policy 1, policy_version 793095 (0.0008) [2023-12-26 05:57:59,878][123090] Updated weights for policy 1, policy_version 793105 (0.0009) [2023-12-26 05:57:59,937][123090] Updated weights for policy 1, policy_version 793115 (0.0009) [2023-12-26 05:58:00,556][123091] Updated weights for policy 0, policy_version 798743 (0.0009) [2023-12-26 05:58:00,613][123091] Updated weights for policy 0, policy_version 798753 (0.0009) [2023-12-26 05:58:00,685][123091] Updated weights for policy 0, policy_version 798763 (0.0009) [2023-12-26 05:58:00,731][123090] Updated weights for policy 1, policy_version 793125 (0.0008) [2023-12-26 05:58:00,792][123090] Updated weights for policy 1, policy_version 793135 (0.0005) [2023-12-26 05:58:00,853][123090] Updated weights for policy 1, policy_version 793145 (0.0006) [2023-12-26 05:58:01,506][123091] Updated weights for policy 0, policy_version 798773 (0.0010) [2023-12-26 05:58:01,554][123091] Updated weights for policy 0, policy_version 798783 (0.0010) [2023-12-26 05:58:01,624][123091] Updated weights for policy 0, policy_version 798793 (0.0011) [2023-12-26 05:58:01,630][123090] Updated weights for policy 1, policy_version 793155 (0.0007) [2023-12-26 05:58:01,692][123090] Updated weights for policy 1, policy_version 793165 (0.0008) [2023-12-26 05:58:01,770][123090] Updated weights for policy 1, policy_version 793175 (0.0011) [2023-12-26 05:58:02,440][123091] Updated weights for policy 0, policy_version 798803 (0.0009) [2023-12-26 05:58:02,497][123091] Updated weights for policy 0, policy_version 798813 (0.0010) [2023-12-26 05:58:02,511][123090] Updated weights for policy 1, policy_version 793185 (0.0010) [2023-12-26 05:58:02,556][123091] Updated weights for policy 0, policy_version 798823 (0.0011) [2023-12-26 05:58:02,561][123090] Updated weights for policy 1, policy_version 793195 (0.0005) [2023-12-26 05:58:02,617][123090] Updated weights for policy 1, policy_version 793205 (0.0005) [2023-12-26 05:58:02,668][123090] Updated weights for policy 1, policy_version 793215 (0.0010) [2023-12-26 05:58:03,250][123091] Updated weights for policy 0, policy_version 798833 (0.0011) [2023-12-26 05:58:03,308][123091] Updated weights for policy 0, policy_version 798843 (0.0006) [2023-12-26 05:58:03,361][123091] Updated weights for policy 0, policy_version 798853 (0.0006) [2023-12-26 05:58:03,426][123090] Updated weights for policy 1, policy_version 793225 (0.0010) [2023-12-26 05:58:03,428][123091] Updated weights for policy 0, policy_version 798863 (0.0006) [2023-12-26 05:58:03,490][123090] Updated weights for policy 1, policy_version 793235 (0.0006) [2023-12-26 05:58:03,547][123090] Updated weights for policy 1, policy_version 793245 (0.0005) [2023-12-26 05:58:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 407584768. Throughput: 0: 8848.8, 1: 8881.7. Samples: 407593392. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:03,785][121949] Avg episode reward: [(0, '5971.248'), (1, '5718.174')] [2023-12-26 05:58:04,254][123090] Updated weights for policy 1, policy_version 793255 (0.0007) [2023-12-26 05:58:04,283][123091] Updated weights for policy 0, policy_version 798873 (0.0007) [2023-12-26 05:58:04,314][123090] Updated weights for policy 1, policy_version 793265 (0.0008) [2023-12-26 05:58:04,344][123091] Updated weights for policy 0, policy_version 798883 (0.0010) [2023-12-26 05:58:04,372][123090] Updated weights for policy 1, policy_version 793275 (0.0008) [2023-12-26 05:58:04,404][123091] Updated weights for policy 0, policy_version 798893 (0.0008) [2023-12-26 05:58:05,133][123090] Updated weights for policy 1, policy_version 793285 (0.0009) [2023-12-26 05:58:05,199][123090] Updated weights for policy 1, policy_version 793295 (0.0010) [2023-12-26 05:58:05,251][123090] Updated weights for policy 1, policy_version 793305 (0.0010) [2023-12-26 05:58:05,274][123091] Updated weights for policy 0, policy_version 798903 (0.0008) [2023-12-26 05:58:05,333][123091] Updated weights for policy 0, policy_version 798913 (0.0008) [2023-12-26 05:58:05,392][123091] Updated weights for policy 0, policy_version 798923 (0.0010) [2023-12-26 05:58:06,044][123090] Updated weights for policy 1, policy_version 793315 (0.0010) [2023-12-26 05:58:06,090][123090] Updated weights for policy 1, policy_version 793325 (0.0008) [2023-12-26 05:58:06,156][123090] Updated weights for policy 1, policy_version 793335 (0.0008) [2023-12-26 05:58:06,322][123091] Updated weights for policy 0, policy_version 798933 (0.0010) [2023-12-26 05:58:06,385][123091] Updated weights for policy 0, policy_version 798943 (0.0011) [2023-12-26 05:58:06,448][123091] Updated weights for policy 0, policy_version 798953 (0.0011) [2023-12-26 05:58:06,907][123090] Updated weights for policy 1, policy_version 793345 (0.0007) [2023-12-26 05:58:06,969][123090] Updated weights for policy 1, policy_version 793355 (0.0010) [2023-12-26 05:58:07,030][123090] Updated weights for policy 1, policy_version 793365 (0.0009) [2023-12-26 05:58:07,085][123090] Updated weights for policy 1, policy_version 793375 (0.0009) [2023-12-26 05:58:07,227][123091] Updated weights for policy 0, policy_version 798963 (0.0011) [2023-12-26 05:58:07,286][123091] Updated weights for policy 0, policy_version 798973 (0.0011) [2023-12-26 05:58:07,334][123091] Updated weights for policy 0, policy_version 798983 (0.0010) [2023-12-26 05:58:07,986][123090] Updated weights for policy 1, policy_version 793385 (0.0007) [2023-12-26 05:58:08,051][123090] Updated weights for policy 1, policy_version 793395 (0.0005) [2023-12-26 05:58:08,097][123091] Updated weights for policy 0, policy_version 798993 (0.0010) [2023-12-26 05:58:08,109][123090] Updated weights for policy 1, policy_version 793405 (0.0006) [2023-12-26 05:58:08,149][123091] Updated weights for policy 0, policy_version 799003 (0.0011) [2023-12-26 05:58:08,207][123091] Updated weights for policy 0, policy_version 799013 (0.0010) [2023-12-26 05:58:08,259][123091] Updated weights for policy 0, policy_version 799023 (0.0010) [2023-12-26 05:58:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 407666688. Throughput: 0: 8838.4, 1: 8941.2. Samples: 407645732. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:08,784][121949] Avg episode reward: [(0, '6115.092'), (1, '5803.110')] [2023-12-26 05:58:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000799024_204554240.pth... [2023-12-26 05:58:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000798000_204292096.pth [2023-12-26 05:58:08,829][123090] Updated weights for policy 1, policy_version 793415 (0.0006) [2023-12-26 05:58:08,884][123090] Updated weights for policy 1, policy_version 793425 (0.0006) [2023-12-26 05:58:08,932][123090] Updated weights for policy 1, policy_version 793435 (0.0005) [2023-12-26 05:58:08,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000793440_203120640.pth... [2023-12-26 05:58:08,970][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000792384_202850304.pth [2023-12-26 05:58:09,107][123091] Updated weights for policy 0, policy_version 799033 (0.0011) [2023-12-26 05:58:09,170][123091] Updated weights for policy 0, policy_version 799043 (0.0011) [2023-12-26 05:58:09,238][123091] Updated weights for policy 0, policy_version 799053 (0.0010) [2023-12-26 05:58:09,824][123090] Updated weights for policy 1, policy_version 793445 (0.0009) [2023-12-26 05:58:09,892][123090] Updated weights for policy 1, policy_version 793455 (0.0009) [2023-12-26 05:58:09,961][123090] Updated weights for policy 1, policy_version 793465 (0.0009) [2023-12-26 05:58:10,044][123091] Updated weights for policy 0, policy_version 799063 (0.0011) [2023-12-26 05:58:10,116][123091] Updated weights for policy 0, policy_version 799073 (0.0011) [2023-12-26 05:58:10,184][123091] Updated weights for policy 0, policy_version 799083 (0.0011) [2023-12-26 05:58:10,761][123090] Updated weights for policy 1, policy_version 793475 (0.0008) [2023-12-26 05:58:10,827][123090] Updated weights for policy 1, policy_version 793485 (0.0009) [2023-12-26 05:58:10,887][123090] Updated weights for policy 1, policy_version 793495 (0.0009) [2023-12-26 05:58:11,007][123091] Updated weights for policy 0, policy_version 799093 (0.0011) [2023-12-26 05:58:11,081][123091] Updated weights for policy 0, policy_version 799103 (0.0010) [2023-12-26 05:58:11,150][123091] Updated weights for policy 0, policy_version 799113 (0.0009) [2023-12-26 05:58:11,704][123090] Updated weights for policy 1, policy_version 793505 (0.0008) [2023-12-26 05:58:11,781][123090] Updated weights for policy 1, policy_version 793515 (0.0009) [2023-12-26 05:58:11,857][123090] Updated weights for policy 1, policy_version 793525 (0.0010) [2023-12-26 05:58:11,918][123090] Updated weights for policy 1, policy_version 793535 (0.0010) [2023-12-26 05:58:11,929][123091] Updated weights for policy 0, policy_version 799123 (0.0008) [2023-12-26 05:58:11,986][123091] Updated weights for policy 0, policy_version 799133 (0.0009) [2023-12-26 05:58:12,047][123091] Updated weights for policy 0, policy_version 799143 (0.0011) [2023-12-26 05:58:12,737][123090] Updated weights for policy 1, policy_version 793545 (0.0008) [2023-12-26 05:58:12,799][123090] Updated weights for policy 1, policy_version 793555 (0.0006) [2023-12-26 05:58:12,842][123091] Updated weights for policy 0, policy_version 799153 (0.0010) [2023-12-26 05:58:12,858][123090] Updated weights for policy 1, policy_version 793565 (0.0007) [2023-12-26 05:58:12,899][123091] Updated weights for policy 0, policy_version 799163 (0.0008) [2023-12-26 05:58:12,959][123091] Updated weights for policy 0, policy_version 799173 (0.0010) [2023-12-26 05:58:13,015][123091] Updated weights for policy 0, policy_version 799183 (0.0009) [2023-12-26 05:58:13,566][123090] Updated weights for policy 1, policy_version 793575 (0.0005) [2023-12-26 05:58:13,622][123090] Updated weights for policy 1, policy_version 793585 (0.0005) [2023-12-26 05:58:13,677][123090] Updated weights for policy 1, policy_version 793595 (0.0005) [2023-12-26 05:58:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 407756800. Throughput: 0: 8847.9, 1: 8872.6. Samples: 407749864. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:13,785][121949] Avg episode reward: [(0, '6106.171'), (1, '5852.342')] [2023-12-26 05:58:13,875][123091] Updated weights for policy 0, policy_version 799193 (0.0009) [2023-12-26 05:58:13,923][123091] Updated weights for policy 0, policy_version 799204 (0.0006) [2023-12-26 05:58:13,986][123091] Updated weights for policy 0, policy_version 799214 (0.0005) [2023-12-26 05:58:14,365][123090] Updated weights for policy 1, policy_version 793605 (0.0005) [2023-12-26 05:58:14,416][123090] Updated weights for policy 1, policy_version 793615 (0.0005) [2023-12-26 05:58:14,465][123090] Updated weights for policy 1, policy_version 793625 (0.0006) [2023-12-26 05:58:14,679][123091] Updated weights for policy 0, policy_version 799224 (0.0008) [2023-12-26 05:58:14,737][123091] Updated weights for policy 0, policy_version 799234 (0.0009) [2023-12-26 05:58:14,804][123091] Updated weights for policy 0, policy_version 799244 (0.0008) [2023-12-26 05:58:15,258][123090] Updated weights for policy 1, policy_version 793635 (0.0007) [2023-12-26 05:58:15,326][123090] Updated weights for policy 1, policy_version 793645 (0.0011) [2023-12-26 05:58:15,397][123090] Updated weights for policy 1, policy_version 793655 (0.0011) [2023-12-26 05:58:15,651][123091] Updated weights for policy 0, policy_version 799254 (0.0007) [2023-12-26 05:58:15,699][123091] Updated weights for policy 0, policy_version 799264 (0.0005) [2023-12-26 05:58:15,745][123091] Updated weights for policy 0, policy_version 799274 (0.0005) [2023-12-26 05:58:16,151][123090] Updated weights for policy 1, policy_version 793665 (0.0011) [2023-12-26 05:58:16,217][123090] Updated weights for policy 1, policy_version 793675 (0.0010) [2023-12-26 05:58:16,281][123090] Updated weights for policy 1, policy_version 793685 (0.0011) [2023-12-26 05:58:16,343][123090] Updated weights for policy 1, policy_version 793695 (0.0010) [2023-12-26 05:58:16,469][123091] Updated weights for policy 0, policy_version 799284 (0.0009) [2023-12-26 05:58:16,520][123091] Updated weights for policy 0, policy_version 799294 (0.0009) [2023-12-26 05:58:16,572][123091] Updated weights for policy 0, policy_version 799304 (0.0009) [2023-12-26 05:58:17,063][123090] Updated weights for policy 1, policy_version 793705 (0.0006) [2023-12-26 05:58:17,110][123090] Updated weights for policy 1, policy_version 793715 (0.0005) [2023-12-26 05:58:17,159][123090] Updated weights for policy 1, policy_version 793725 (0.0006) [2023-12-26 05:58:17,490][123091] Updated weights for policy 0, policy_version 799314 (0.0009) [2023-12-26 05:58:17,544][123091] Updated weights for policy 0, policy_version 799324 (0.0010) [2023-12-26 05:58:17,598][123091] Updated weights for policy 0, policy_version 799335 (0.0010) [2023-12-26 05:58:17,863][123090] Updated weights for policy 1, policy_version 793735 (0.0005) [2023-12-26 05:58:17,921][123090] Updated weights for policy 1, policy_version 793745 (0.0005) [2023-12-26 05:58:17,977][123090] Updated weights for policy 1, policy_version 793755 (0.0005) [2023-12-26 05:58:18,561][123091] Updated weights for policy 0, policy_version 799345 (0.0010) [2023-12-26 05:58:18,617][123091] Updated weights for policy 0, policy_version 799355 (0.0009) [2023-12-26 05:58:18,643][123090] Updated weights for policy 1, policy_version 793765 (0.0008) [2023-12-26 05:58:18,677][123091] Updated weights for policy 0, policy_version 799365 (0.0005) [2023-12-26 05:58:18,699][123090] Updated weights for policy 1, policy_version 793775 (0.0010) [2023-12-26 05:58:18,740][123091] Updated weights for policy 0, policy_version 799375 (0.0005) [2023-12-26 05:58:18,771][123090] Updated weights for policy 1, policy_version 793785 (0.0011) [2023-12-26 05:58:18,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 407846912. Throughput: 0: 8778.5, 1: 9002.3. Samples: 407859788. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:18,786][121949] Avg episode reward: [(0, '6029.325'), (1, '5934.017')] [2023-12-26 05:58:19,428][123091] Updated weights for policy 0, policy_version 799385 (0.0005) [2023-12-26 05:58:19,490][123091] Updated weights for policy 0, policy_version 799395 (0.0006) [2023-12-26 05:58:19,545][123090] Updated weights for policy 1, policy_version 793795 (0.0010) [2023-12-26 05:58:19,549][123091] Updated weights for policy 0, policy_version 799405 (0.0007) [2023-12-26 05:58:19,608][123090] Updated weights for policy 1, policy_version 793805 (0.0008) [2023-12-26 05:58:19,666][123090] Updated weights for policy 1, policy_version 793815 (0.0008) [2023-12-26 05:58:20,405][123091] Updated weights for policy 0, policy_version 799415 (0.0008) [2023-12-26 05:58:20,453][123090] Updated weights for policy 1, policy_version 793825 (0.0008) [2023-12-26 05:58:20,456][123091] Updated weights for policy 0, policy_version 799425 (0.0008) [2023-12-26 05:58:20,505][123091] Updated weights for policy 0, policy_version 799435 (0.0006) [2023-12-26 05:58:20,523][123090] Updated weights for policy 1, policy_version 793835 (0.0009) [2023-12-26 05:58:20,597][123090] Updated weights for policy 1, policy_version 793845 (0.0009) [2023-12-26 05:58:20,656][123090] Updated weights for policy 1, policy_version 793855 (0.0008) [2023-12-26 05:58:21,384][123091] Updated weights for policy 0, policy_version 799445 (0.0007) [2023-12-26 05:58:21,454][123091] Updated weights for policy 0, policy_version 799455 (0.0008) [2023-12-26 05:58:21,482][123090] Updated weights for policy 1, policy_version 793865 (0.0009) [2023-12-26 05:58:21,510][123091] Updated weights for policy 0, policy_version 799465 (0.0008) [2023-12-26 05:58:21,547][123090] Updated weights for policy 1, policy_version 793875 (0.0006) [2023-12-26 05:58:21,598][123090] Updated weights for policy 1, policy_version 793885 (0.0009) [2023-12-26 05:58:22,338][123091] Updated weights for policy 0, policy_version 799475 (0.0008) [2023-12-26 05:58:22,372][123090] Updated weights for policy 1, policy_version 793895 (0.0008) [2023-12-26 05:58:22,408][123091] Updated weights for policy 0, policy_version 799485 (0.0009) [2023-12-26 05:58:22,441][123090] Updated weights for policy 1, policy_version 793905 (0.0009) [2023-12-26 05:58:22,477][123091] Updated weights for policy 0, policy_version 799495 (0.0006) [2023-12-26 05:58:22,507][123090] Updated weights for policy 1, policy_version 793915 (0.0009) [2023-12-26 05:58:23,256][123091] Updated weights for policy 0, policy_version 799505 (0.0008) [2023-12-26 05:58:23,312][123091] Updated weights for policy 0, policy_version 799515 (0.0009) [2023-12-26 05:58:23,314][123090] Updated weights for policy 1, policy_version 793925 (0.0008) [2023-12-26 05:58:23,376][123090] Updated weights for policy 1, policy_version 793935 (0.0008) [2023-12-26 05:58:23,383][123091] Updated weights for policy 0, policy_version 799525 (0.0008) [2023-12-26 05:58:23,438][123090] Updated weights for policy 1, policy_version 793945 (0.0008) [2023-12-26 05:58:23,441][123091] Updated weights for policy 0, policy_version 799535 (0.0008) [2023-12-26 05:58:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 407937024. Throughput: 0: 8771.9, 1: 8959.4. Samples: 407912264. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:23,785][121949] Avg episode reward: [(0, '5883.269'), (1, '5939.994')] [2023-12-26 05:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000799536_204685312.pth... [2023-12-26 05:58:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000793952_203251712.pth... [2023-12-26 05:58:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000792896_202981376.pth [2023-12-26 05:58:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000798512_204423168.pth [2023-12-26 05:58:24,223][123090] Updated weights for policy 1, policy_version 793955 (0.0009) [2023-12-26 05:58:24,283][123091] Updated weights for policy 0, policy_version 799545 (0.0008) [2023-12-26 05:58:24,291][123090] Updated weights for policy 1, policy_version 793965 (0.0005) [2023-12-26 05:58:24,356][123091] Updated weights for policy 0, policy_version 799555 (0.0008) [2023-12-26 05:58:24,358][123090] Updated weights for policy 1, policy_version 793975 (0.0006) [2023-12-26 05:58:24,419][123091] Updated weights for policy 0, policy_version 799565 (0.0008) [2023-12-26 05:58:25,147][123090] Updated weights for policy 1, policy_version 793985 (0.0008) [2023-12-26 05:58:25,212][123090] Updated weights for policy 1, policy_version 793995 (0.0010) [2023-12-26 05:58:25,215][123091] Updated weights for policy 0, policy_version 799575 (0.0007) [2023-12-26 05:58:25,275][123090] Updated weights for policy 1, policy_version 794005 (0.0007) [2023-12-26 05:58:25,277][123091] Updated weights for policy 0, policy_version 799585 (0.0008) [2023-12-26 05:58:25,341][123091] Updated weights for policy 0, policy_version 799595 (0.0008) [2023-12-26 05:58:25,344][123090] Updated weights for policy 1, policy_version 794015 (0.0006) [2023-12-26 05:58:26,133][123090] Updated weights for policy 1, policy_version 794025 (0.0010) [2023-12-26 05:58:26,155][123091] Updated weights for policy 0, policy_version 799605 (0.0007) [2023-12-26 05:58:26,195][123090] Updated weights for policy 1, policy_version 794035 (0.0009) [2023-12-26 05:58:26,203][123091] Updated weights for policy 0, policy_version 799615 (0.0007) [2023-12-26 05:58:26,250][123091] Updated weights for policy 0, policy_version 799625 (0.0009) [2023-12-26 05:58:26,252][123090] Updated weights for policy 1, policy_version 794045 (0.0007) [2023-12-26 05:58:27,011][123091] Updated weights for policy 0, policy_version 799635 (0.0008) [2023-12-26 05:58:27,076][123091] Updated weights for policy 0, policy_version 799645 (0.0008) [2023-12-26 05:58:27,107][123090] Updated weights for policy 1, policy_version 794055 (0.0009) [2023-12-26 05:58:27,125][123091] Updated weights for policy 0, policy_version 799655 (0.0009) [2023-12-26 05:58:27,162][123090] Updated weights for policy 1, policy_version 794065 (0.0008) [2023-12-26 05:58:27,208][123090] Updated weights for policy 1, policy_version 794075 (0.0008) [2023-12-26 05:58:27,907][123090] Updated weights for policy 1, policy_version 794086 (0.0008) [2023-12-26 05:58:27,971][123091] Updated weights for policy 0, policy_version 799665 (0.0008) [2023-12-26 05:58:27,976][123090] Updated weights for policy 1, policy_version 794096 (0.0005) [2023-12-26 05:58:28,033][123091] Updated weights for policy 0, policy_version 799675 (0.0009) [2023-12-26 05:58:28,044][123090] Updated weights for policy 1, policy_version 794106 (0.0007) [2023-12-26 05:58:28,090][123091] Updated weights for policy 0, policy_version 799685 (0.0009) [2023-12-26 05:58:28,151][123091] Updated weights for policy 0, policy_version 799695 (0.0010) [2023-12-26 05:58:28,728][123090] Updated weights for policy 1, policy_version 794116 (0.0006) [2023-12-26 05:58:28,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 408018944. Throughput: 0: 8790.4, 1: 8923.9. Samples: 408016680. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:28,785][121949] Avg episode reward: [(0, '6009.653'), (1, '5914.434')] [2023-12-26 05:58:28,787][123090] Updated weights for policy 1, policy_version 794126 (0.0005) [2023-12-26 05:58:28,866][123090] Updated weights for policy 1, policy_version 794136 (0.0006) [2023-12-26 05:58:29,103][123091] Updated weights for policy 0, policy_version 799705 (0.0010) [2023-12-26 05:58:29,162][123091] Updated weights for policy 0, policy_version 799716 (0.0011) [2023-12-26 05:58:29,220][123091] Updated weights for policy 0, policy_version 799727 (0.0010) [2023-12-26 05:58:29,615][123090] Updated weights for policy 1, policy_version 794146 (0.0007) [2023-12-26 05:58:29,670][123090] Updated weights for policy 1, policy_version 794156 (0.0010) [2023-12-26 05:58:29,725][123090] Updated weights for policy 1, policy_version 794166 (0.0010) [2023-12-26 05:58:29,788][123090] Updated weights for policy 1, policy_version 794176 (0.0011) [2023-12-26 05:58:30,097][123091] Updated weights for policy 0, policy_version 799737 (0.0009) [2023-12-26 05:58:30,159][123091] Updated weights for policy 0, policy_version 799747 (0.0009) [2023-12-26 05:58:30,224][123091] Updated weights for policy 0, policy_version 799757 (0.0009) [2023-12-26 05:58:30,624][123090] Updated weights for policy 1, policy_version 794186 (0.0010) [2023-12-26 05:58:30,683][123090] Updated weights for policy 1, policy_version 794196 (0.0009) [2023-12-26 05:58:30,732][123090] Updated weights for policy 1, policy_version 794206 (0.0009) [2023-12-26 05:58:31,054][123091] Updated weights for policy 0, policy_version 799767 (0.0009) [2023-12-26 05:58:31,118][123091] Updated weights for policy 0, policy_version 799777 (0.0010) [2023-12-26 05:58:31,180][123091] Updated weights for policy 0, policy_version 799787 (0.0008) [2023-12-26 05:58:31,518][123090] Updated weights for policy 1, policy_version 794216 (0.0006) [2023-12-26 05:58:31,577][123090] Updated weights for policy 1, policy_version 794226 (0.0009) [2023-12-26 05:58:31,651][123090] Updated weights for policy 1, policy_version 794236 (0.0010) [2023-12-26 05:58:31,968][123091] Updated weights for policy 0, policy_version 799797 (0.0010) [2023-12-26 05:58:32,035][123091] Updated weights for policy 0, policy_version 799807 (0.0010) [2023-12-26 05:58:32,095][123091] Updated weights for policy 0, policy_version 799817 (0.0009) [2023-12-26 05:58:32,451][123090] Updated weights for policy 1, policy_version 794246 (0.0007) [2023-12-26 05:58:32,509][123090] Updated weights for policy 1, policy_version 794256 (0.0009) [2023-12-26 05:58:32,568][123090] Updated weights for policy 1, policy_version 794266 (0.0009) [2023-12-26 05:58:32,955][123091] Updated weights for policy 0, policy_version 799827 (0.0009) [2023-12-26 05:58:33,018][123091] Updated weights for policy 0, policy_version 799837 (0.0009) [2023-12-26 05:58:33,077][123091] Updated weights for policy 0, policy_version 799847 (0.0010) [2023-12-26 05:58:33,358][123090] Updated weights for policy 1, policy_version 794276 (0.0010) [2023-12-26 05:58:33,429][123090] Updated weights for policy 1, policy_version 794286 (0.0011) [2023-12-26 05:58:33,494][123090] Updated weights for policy 1, policy_version 794296 (0.0007) [2023-12-26 05:58:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 408109056. Throughput: 0: 8649.6, 1: 8960.0. Samples: 408120736. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:33,785][121949] Avg episode reward: [(0, '6092.359'), (1, '5871.849')] [2023-12-26 05:58:33,969][123091] Updated weights for policy 0, policy_version 799857 (0.0009) [2023-12-26 05:58:34,041][123091] Updated weights for policy 0, policy_version 799867 (0.0009) [2023-12-26 05:58:34,107][123091] Updated weights for policy 0, policy_version 799877 (0.0009) [2023-12-26 05:58:34,158][123090] Updated weights for policy 1, policy_version 794306 (0.0008) [2023-12-26 05:58:34,163][123091] Updated weights for policy 0, policy_version 799887 (0.0010) [2023-12-26 05:58:34,216][123090] Updated weights for policy 1, policy_version 794316 (0.0008) [2023-12-26 05:58:34,272][123090] Updated weights for policy 1, policy_version 794326 (0.0008) [2023-12-26 05:58:34,331][123090] Updated weights for policy 1, policy_version 794336 (0.0009) [2023-12-26 05:58:34,986][123091] Updated weights for policy 0, policy_version 799897 (0.0008) [2023-12-26 05:58:35,034][123090] Updated weights for policy 1, policy_version 794346 (0.0011) [2023-12-26 05:58:35,045][123091] Updated weights for policy 0, policy_version 799907 (0.0007) [2023-12-26 05:58:35,093][123090] Updated weights for policy 1, policy_version 794356 (0.0010) [2023-12-26 05:58:35,097][123091] Updated weights for policy 0, policy_version 799917 (0.0007) [2023-12-26 05:58:35,160][123090] Updated weights for policy 1, policy_version 794366 (0.0010) [2023-12-26 05:58:35,933][123091] Updated weights for policy 0, policy_version 799927 (0.0010) [2023-12-26 05:58:35,955][123090] Updated weights for policy 1, policy_version 794376 (0.0010) [2023-12-26 05:58:35,993][123091] Updated weights for policy 0, policy_version 799937 (0.0009) [2023-12-26 05:58:36,007][123090] Updated weights for policy 1, policy_version 794386 (0.0010) [2023-12-26 05:58:36,057][123091] Updated weights for policy 0, policy_version 799947 (0.0006) [2023-12-26 05:58:36,067][123090] Updated weights for policy 1, policy_version 794396 (0.0011) [2023-12-26 05:58:36,878][123091] Updated weights for policy 0, policy_version 799957 (0.0006) [2023-12-26 05:58:36,900][123090] Updated weights for policy 1, policy_version 794406 (0.0010) [2023-12-26 05:58:36,935][123091] Updated weights for policy 0, policy_version 799967 (0.0008) [2023-12-26 05:58:36,957][123090] Updated weights for policy 1, policy_version 794416 (0.0009) [2023-12-26 05:58:36,987][123091] Updated weights for policy 0, policy_version 799977 (0.0009) [2023-12-26 05:58:37,004][123090] Updated weights for policy 1, policy_version 794426 (0.0005) [2023-12-26 05:58:37,700][123090] Updated weights for policy 1, policy_version 794436 (0.0005) [2023-12-26 05:58:37,754][123091] Updated weights for policy 0, policy_version 799987 (0.0008) [2023-12-26 05:58:37,755][123090] Updated weights for policy 1, policy_version 794446 (0.0010) [2023-12-26 05:58:37,816][123091] Updated weights for policy 0, policy_version 799997 (0.0006) [2023-12-26 05:58:37,817][123090] Updated weights for policy 1, policy_version 794456 (0.0011) [2023-12-26 05:58:37,876][123091] Updated weights for policy 0, policy_version 800007 (0.0007) [2023-12-26 05:58:38,650][123090] Updated weights for policy 1, policy_version 794466 (0.0010) [2023-12-26 05:58:38,701][123091] Updated weights for policy 0, policy_version 800017 (0.0009) [2023-12-26 05:58:38,716][123090] Updated weights for policy 1, policy_version 794476 (0.0009) [2023-12-26 05:58:38,770][123091] Updated weights for policy 0, policy_version 800027 (0.0009) [2023-12-26 05:58:38,776][123090] Updated weights for policy 1, policy_version 794486 (0.0008) [2023-12-26 05:58:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 408190976. Throughput: 0: 8651.3, 1: 9022.8. Samples: 408173788. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:38,785][121949] Avg episode reward: [(0, '5901.099'), (1, '5809.741')] [2023-12-26 05:58:38,833][123090] Updated weights for policy 1, policy_version 794496 (0.0008) [2023-12-26 05:58:38,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000794496_203390976.pth... [2023-12-26 05:58:38,833][123091] Updated weights for policy 0, policy_version 800037 (0.0009) [2023-12-26 05:58:38,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000793440_203120640.pth [2023-12-26 05:58:38,894][123091] Updated weights for policy 0, policy_version 800047 (0.0009) [2023-12-26 05:58:38,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000800048_204816384.pth... [2023-12-26 05:58:38,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000799024_204554240.pth [2023-12-26 05:58:39,667][123090] Updated weights for policy 1, policy_version 794506 (0.0010) [2023-12-26 05:58:39,734][123090] Updated weights for policy 1, policy_version 794516 (0.0011) [2023-12-26 05:58:39,756][123091] Updated weights for policy 0, policy_version 800057 (0.0009) [2023-12-26 05:58:39,796][123090] Updated weights for policy 1, policy_version 794526 (0.0010) [2023-12-26 05:58:39,818][123091] Updated weights for policy 0, policy_version 800067 (0.0009) [2023-12-26 05:58:39,889][123091] Updated weights for policy 0, policy_version 800077 (0.0008) [2023-12-26 05:58:40,538][123090] Updated weights for policy 1, policy_version 794536 (0.0005) [2023-12-26 05:58:40,608][123090] Updated weights for policy 1, policy_version 794546 (0.0006) [2023-12-26 05:58:40,654][123091] Updated weights for policy 0, policy_version 800087 (0.0008) [2023-12-26 05:58:40,680][123090] Updated weights for policy 1, policy_version 794556 (0.0006) [2023-12-26 05:58:40,715][123091] Updated weights for policy 0, policy_version 800097 (0.0008) [2023-12-26 05:58:40,773][123091] Updated weights for policy 0, policy_version 800107 (0.0010) [2023-12-26 05:58:41,382][123090] Updated weights for policy 1, policy_version 794566 (0.0008) [2023-12-26 05:58:41,452][123090] Updated weights for policy 1, policy_version 794576 (0.0010) [2023-12-26 05:58:41,519][123090] Updated weights for policy 1, policy_version 794586 (0.0010) [2023-12-26 05:58:41,690][123091] Updated weights for policy 0, policy_version 800117 (0.0010) [2023-12-26 05:58:41,762][123091] Updated weights for policy 0, policy_version 800127 (0.0010) [2023-12-26 05:58:41,822][123091] Updated weights for policy 0, policy_version 800137 (0.0010) [2023-12-26 05:58:42,340][123090] Updated weights for policy 1, policy_version 794596 (0.0008) [2023-12-26 05:58:42,407][123090] Updated weights for policy 1, policy_version 794606 (0.0009) [2023-12-26 05:58:42,475][123090] Updated weights for policy 1, policy_version 794616 (0.0009) [2023-12-26 05:58:42,683][123091] Updated weights for policy 0, policy_version 800147 (0.0010) [2023-12-26 05:58:42,750][123091] Updated weights for policy 0, policy_version 800157 (0.0011) [2023-12-26 05:58:42,810][123091] Updated weights for policy 0, policy_version 800167 (0.0011) [2023-12-26 05:58:43,302][123090] Updated weights for policy 1, policy_version 794626 (0.0009) [2023-12-26 05:58:43,369][123090] Updated weights for policy 1, policy_version 794636 (0.0009) [2023-12-26 05:58:43,422][123090] Updated weights for policy 1, policy_version 794646 (0.0009) [2023-12-26 05:58:43,478][123090] Updated weights for policy 1, policy_version 794656 (0.0009) [2023-12-26 05:58:43,617][123091] Updated weights for policy 0, policy_version 800177 (0.0011) [2023-12-26 05:58:43,669][123091] Updated weights for policy 0, policy_version 800187 (0.0010) [2023-12-26 05:58:43,722][123091] Updated weights for policy 0, policy_version 800197 (0.0007) [2023-12-26 05:58:43,778][123091] Updated weights for policy 0, policy_version 800207 (0.0005) [2023-12-26 05:58:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 408289280. Throughput: 0: 8586.8, 1: 9034.8. Samples: 408279124. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:43,785][121949] Avg episode reward: [(0, '5934.391'), (1, '5846.571')] [2023-12-26 05:58:44,357][123090] Updated weights for policy 1, policy_version 794666 (0.0006) [2023-12-26 05:58:44,388][123091] Updated weights for policy 0, policy_version 800217 (0.0008) [2023-12-26 05:58:44,401][123090] Updated weights for policy 1, policy_version 794676 (0.0005) [2023-12-26 05:58:44,437][123091] Updated weights for policy 0, policy_version 800227 (0.0009) [2023-12-26 05:58:44,452][123090] Updated weights for policy 1, policy_version 794686 (0.0006) [2023-12-26 05:58:44,494][123091] Updated weights for policy 0, policy_version 800237 (0.0009) [2023-12-26 05:58:45,147][123090] Updated weights for policy 1, policy_version 794696 (0.0006) [2023-12-26 05:58:45,224][123090] Updated weights for policy 1, policy_version 794706 (0.0010) [2023-12-26 05:58:45,298][123090] Updated weights for policy 1, policy_version 794716 (0.0009) [2023-12-26 05:58:45,337][123091] Updated weights for policy 0, policy_version 800247 (0.0007) [2023-12-26 05:58:45,403][123091] Updated weights for policy 0, policy_version 800257 (0.0006) [2023-12-26 05:58:45,466][123091] Updated weights for policy 0, policy_version 800267 (0.0006) [2023-12-26 05:58:45,977][123090] Updated weights for policy 1, policy_version 794726 (0.0006) [2023-12-26 05:58:46,032][123090] Updated weights for policy 1, policy_version 794736 (0.0006) [2023-12-26 05:58:46,089][123090] Updated weights for policy 1, policy_version 794746 (0.0005) [2023-12-26 05:58:46,283][123091] Updated weights for policy 0, policy_version 800277 (0.0008) [2023-12-26 05:58:46,337][123091] Updated weights for policy 0, policy_version 800287 (0.0010) [2023-12-26 05:58:46,399][123091] Updated weights for policy 0, policy_version 800297 (0.0010) [2023-12-26 05:58:46,738][123090] Updated weights for policy 1, policy_version 794756 (0.0005) [2023-12-26 05:58:46,812][123090] Updated weights for policy 1, policy_version 794766 (0.0005) [2023-12-26 05:58:46,874][123090] Updated weights for policy 1, policy_version 794776 (0.0005) [2023-12-26 05:58:47,301][123091] Updated weights for policy 0, policy_version 800307 (0.0010) [2023-12-26 05:58:47,356][123091] Updated weights for policy 0, policy_version 800317 (0.0010) [2023-12-26 05:58:47,416][123091] Updated weights for policy 0, policy_version 800328 (0.0011) [2023-12-26 05:58:47,539][123090] Updated weights for policy 1, policy_version 794786 (0.0007) [2023-12-26 05:58:47,615][123090] Updated weights for policy 1, policy_version 794796 (0.0005) [2023-12-26 05:58:47,691][123090] Updated weights for policy 1, policy_version 794806 (0.0006) [2023-12-26 05:58:47,752][123090] Updated weights for policy 1, policy_version 794816 (0.0006) [2023-12-26 05:58:48,370][123090] Updated weights for policy 1, policy_version 794826 (0.0006) [2023-12-26 05:58:48,371][123091] Updated weights for policy 0, policy_version 800338 (0.0010) [2023-12-26 05:58:48,432][123091] Updated weights for policy 0, policy_version 800348 (0.0008) [2023-12-26 05:58:48,434][123090] Updated weights for policy 1, policy_version 794836 (0.0008) [2023-12-26 05:58:48,482][123090] Updated weights for policy 1, policy_version 794846 (0.0010) [2023-12-26 05:58:48,489][123091] Updated weights for policy 0, policy_version 800358 (0.0006) [2023-12-26 05:58:48,553][123091] Updated weights for policy 0, policy_version 800368 (0.0008) [2023-12-26 05:58:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 408379392. Throughput: 0: 8543.6, 1: 9112.3. Samples: 408387908. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:48,785][121949] Avg episode reward: [(0, '5995.738'), (1, '5954.787')] [2023-12-26 05:58:49,228][123090] Updated weights for policy 1, policy_version 794856 (0.0008) [2023-12-26 05:58:49,304][123090] Updated weights for policy 1, policy_version 794866 (0.0008) [2023-12-26 05:58:49,376][123090] Updated weights for policy 1, policy_version 794876 (0.0009) [2023-12-26 05:58:49,426][123091] Updated weights for policy 0, policy_version 800378 (0.0007) [2023-12-26 05:58:49,487][123091] Updated weights for policy 0, policy_version 800388 (0.0008) [2023-12-26 05:58:49,556][123091] Updated weights for policy 0, policy_version 800398 (0.0007) [2023-12-26 05:58:50,178][123090] Updated weights for policy 1, policy_version 794886 (0.0007) [2023-12-26 05:58:50,248][123090] Updated weights for policy 1, policy_version 794896 (0.0010) [2023-12-26 05:58:50,322][123090] Updated weights for policy 1, policy_version 794906 (0.0010) [2023-12-26 05:58:50,403][123091] Updated weights for policy 0, policy_version 800408 (0.0009) [2023-12-26 05:58:50,461][123091] Updated weights for policy 0, policy_version 800418 (0.0009) [2023-12-26 05:58:50,516][123091] Updated weights for policy 0, policy_version 800428 (0.0009) [2023-12-26 05:58:51,008][123090] Updated weights for policy 1, policy_version 794916 (0.0009) [2023-12-26 05:58:51,085][123090] Updated weights for policy 1, policy_version 794926 (0.0008) [2023-12-26 05:58:51,162][123090] Updated weights for policy 1, policy_version 794936 (0.0007) [2023-12-26 05:58:51,383][123091] Updated weights for policy 0, policy_version 800438 (0.0008) [2023-12-26 05:58:51,449][123091] Updated weights for policy 0, policy_version 800448 (0.0009) [2023-12-26 05:58:51,516][123091] Updated weights for policy 0, policy_version 800458 (0.0010) [2023-12-26 05:58:51,890][123090] Updated weights for policy 1, policy_version 794946 (0.0007) [2023-12-26 05:58:51,946][123090] Updated weights for policy 1, policy_version 794956 (0.0011) [2023-12-26 05:58:52,010][123090] Updated weights for policy 1, policy_version 794966 (0.0011) [2023-12-26 05:58:52,078][123090] Updated weights for policy 1, policy_version 794976 (0.0011) [2023-12-26 05:58:52,347][123091] Updated weights for policy 0, policy_version 800468 (0.0008) [2023-12-26 05:58:52,408][123091] Updated weights for policy 0, policy_version 800478 (0.0009) [2023-12-26 05:58:52,461][123091] Updated weights for policy 0, policy_version 800488 (0.0009) [2023-12-26 05:58:52,869][123090] Updated weights for policy 1, policy_version 794986 (0.0010) [2023-12-26 05:58:52,924][123090] Updated weights for policy 1, policy_version 794996 (0.0010) [2023-12-26 05:58:52,975][123090] Updated weights for policy 1, policy_version 795006 (0.0010) [2023-12-26 05:58:53,316][123091] Updated weights for policy 0, policy_version 800498 (0.0007) [2023-12-26 05:58:53,363][123091] Updated weights for policy 0, policy_version 800508 (0.0010) [2023-12-26 05:58:53,406][123091] Updated weights for policy 0, policy_version 800518 (0.0010) [2023-12-26 05:58:53,460][123091] Updated weights for policy 0, policy_version 800528 (0.0010) [2023-12-26 05:58:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 408461312. Throughput: 0: 8547.1, 1: 9108.3. Samples: 408440224. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:53,785][121949] Avg episode reward: [(0, '5969.444'), (1, '5919.529')] [2023-12-26 05:58:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000800528_204939264.pth... [2023-12-26 05:58:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000799536_204685312.pth [2023-12-26 05:58:53,801][123090] Updated weights for policy 1, policy_version 795016 (0.0009) [2023-12-26 05:58:53,857][123090] Updated weights for policy 1, policy_version 795026 (0.0005) [2023-12-26 05:58:53,913][123090] Updated weights for policy 1, policy_version 795036 (0.0008) [2023-12-26 05:58:53,930][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000795040_203530240.pth... [2023-12-26 05:58:53,933][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000793952_203251712.pth [2023-12-26 05:58:54,326][123091] Updated weights for policy 0, policy_version 800538 (0.0007) [2023-12-26 05:58:54,395][123091] Updated weights for policy 0, policy_version 800548 (0.0006) [2023-12-26 05:58:54,455][123091] Updated weights for policy 0, policy_version 800558 (0.0005) [2023-12-26 05:58:54,736][123090] Updated weights for policy 1, policy_version 795046 (0.0010) [2023-12-26 05:58:54,791][123090] Updated weights for policy 1, policy_version 795056 (0.0010) [2023-12-26 05:58:54,850][123090] Updated weights for policy 1, policy_version 795066 (0.0010) [2023-12-26 05:58:55,200][123091] Updated weights for policy 0, policy_version 800568 (0.0009) [2023-12-26 05:58:55,255][123091] Updated weights for policy 0, policy_version 800578 (0.0010) [2023-12-26 05:58:55,312][123091] Updated weights for policy 0, policy_version 800588 (0.0010) [2023-12-26 05:58:55,670][123090] Updated weights for policy 1, policy_version 795076 (0.0010) [2023-12-26 05:58:55,730][123090] Updated weights for policy 1, policy_version 795086 (0.0005) [2023-12-26 05:58:55,786][123090] Updated weights for policy 1, policy_version 795096 (0.0006) [2023-12-26 05:58:56,016][123091] Updated weights for policy 0, policy_version 800598 (0.0007) [2023-12-26 05:58:56,078][123091] Updated weights for policy 0, policy_version 800608 (0.0005) [2023-12-26 05:58:56,137][123091] Updated weights for policy 0, policy_version 800618 (0.0005) [2023-12-26 05:58:56,417][123090] Updated weights for policy 1, policy_version 795106 (0.0006) [2023-12-26 05:58:56,472][123090] Updated weights for policy 1, policy_version 795116 (0.0010) [2023-12-26 05:58:56,519][123090] Updated weights for policy 1, policy_version 795126 (0.0010) [2023-12-26 05:58:56,579][123090] Updated weights for policy 1, policy_version 795136 (0.0007) [2023-12-26 05:58:56,931][123091] Updated weights for policy 0, policy_version 800628 (0.0007) [2023-12-26 05:58:56,978][123091] Updated weights for policy 0, policy_version 800638 (0.0010) [2023-12-26 05:58:57,034][123091] Updated weights for policy 0, policy_version 800648 (0.0005) [2023-12-26 05:58:57,412][123090] Updated weights for policy 1, policy_version 795146 (0.0006) [2023-12-26 05:58:57,473][123090] Updated weights for policy 1, policy_version 795156 (0.0005) [2023-12-26 05:58:57,533][123090] Updated weights for policy 1, policy_version 795166 (0.0005) [2023-12-26 05:58:57,856][123091] Updated weights for policy 0, policy_version 800658 (0.0010) [2023-12-26 05:58:57,919][123091] Updated weights for policy 0, policy_version 800668 (0.0009) [2023-12-26 05:58:57,968][123091] Updated weights for policy 0, policy_version 800678 (0.0009) [2023-12-26 05:58:58,020][123091] Updated weights for policy 0, policy_version 800688 (0.0009) [2023-12-26 05:58:58,257][123090] Updated weights for policy 1, policy_version 795176 (0.0009) [2023-12-26 05:58:58,324][123090] Updated weights for policy 1, policy_version 795186 (0.0010) [2023-12-26 05:58:58,397][123090] Updated weights for policy 1, policy_version 795196 (0.0010) [2023-12-26 05:58:58,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 408551424. Throughput: 0: 8565.4, 1: 9167.1. Samples: 408547828. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:58:58,785][121949] Avg episode reward: [(0, '5962.893'), (1, '5787.256')] [2023-12-26 05:58:58,982][123091] Updated weights for policy 0, policy_version 800698 (0.0009) [2023-12-26 05:58:59,048][123091] Updated weights for policy 0, policy_version 800708 (0.0009) [2023-12-26 05:58:59,109][123091] Updated weights for policy 0, policy_version 800718 (0.0008) [2023-12-26 05:58:59,351][123090] Updated weights for policy 1, policy_version 795206 (0.0010) [2023-12-26 05:58:59,425][123090] Updated weights for policy 1, policy_version 795216 (0.0010) [2023-12-26 05:58:59,481][123090] Updated weights for policy 1, policy_version 795226 (0.0009) [2023-12-26 05:58:59,838][123091] Updated weights for policy 0, policy_version 800728 (0.0010) [2023-12-26 05:58:59,910][123091] Updated weights for policy 0, policy_version 800738 (0.0007) [2023-12-26 05:58:59,982][123091] Updated weights for policy 0, policy_version 800748 (0.0008) [2023-12-26 05:59:00,314][123090] Updated weights for policy 1, policy_version 795236 (0.0009) [2023-12-26 05:59:00,378][123090] Updated weights for policy 1, policy_version 795246 (0.0007) [2023-12-26 05:59:00,435][123090] Updated weights for policy 1, policy_version 795256 (0.0010) [2023-12-26 05:59:00,845][123091] Updated weights for policy 0, policy_version 800758 (0.0010) [2023-12-26 05:59:00,894][123091] Updated weights for policy 0, policy_version 800768 (0.0009) [2023-12-26 05:59:00,944][123091] Updated weights for policy 0, policy_version 800779 (0.0009) [2023-12-26 05:59:01,197][123090] Updated weights for policy 1, policy_version 795266 (0.0010) [2023-12-26 05:59:01,267][123090] Updated weights for policy 1, policy_version 795276 (0.0011) [2023-12-26 05:59:01,319][123090] Updated weights for policy 1, policy_version 795286 (0.0010) [2023-12-26 05:59:01,395][123090] Updated weights for policy 1, policy_version 795296 (0.0011) [2023-12-26 05:59:01,852][123091] Updated weights for policy 0, policy_version 800789 (0.0009) [2023-12-26 05:59:01,913][123091] Updated weights for policy 0, policy_version 800799 (0.0008) [2023-12-26 05:59:01,972][123091] Updated weights for policy 0, policy_version 800809 (0.0008) [2023-12-26 05:59:02,139][123090] Updated weights for policy 1, policy_version 795306 (0.0005) [2023-12-26 05:59:02,187][123090] Updated weights for policy 1, policy_version 795316 (0.0005) [2023-12-26 05:59:02,238][123090] Updated weights for policy 1, policy_version 795326 (0.0007) [2023-12-26 05:59:02,746][123091] Updated weights for policy 0, policy_version 800819 (0.0008) [2023-12-26 05:59:02,800][123091] Updated weights for policy 0, policy_version 800829 (0.0009) [2023-12-26 05:59:02,852][123091] Updated weights for policy 0, policy_version 800839 (0.0009) [2023-12-26 05:59:03,052][123090] Updated weights for policy 1, policy_version 795336 (0.0010) [2023-12-26 05:59:03,128][123090] Updated weights for policy 1, policy_version 795346 (0.0010) [2023-12-26 05:59:03,193][123090] Updated weights for policy 1, policy_version 795356 (0.0010) [2023-12-26 05:59:03,594][123091] Updated weights for policy 0, policy_version 800849 (0.0009) [2023-12-26 05:59:03,645][123091] Updated weights for policy 0, policy_version 800860 (0.0009) [2023-12-26 05:59:03,698][123091] Updated weights for policy 0, policy_version 800870 (0.0009) [2023-12-26 05:59:03,760][123091] Updated weights for policy 0, policy_version 800880 (0.0009) [2023-12-26 05:59:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 408641536. Throughput: 0: 8555.8, 1: 9026.7. Samples: 408650996. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:03,785][121949] Avg episode reward: [(0, '6015.934'), (1, '5789.831')] [2023-12-26 05:59:04,011][123090] Updated weights for policy 1, policy_version 795366 (0.0010) [2023-12-26 05:59:04,081][123090] Updated weights for policy 1, policy_version 795376 (0.0009) [2023-12-26 05:59:04,147][123090] Updated weights for policy 1, policy_version 795386 (0.0008) [2023-12-26 05:59:04,522][123091] Updated weights for policy 0, policy_version 800890 (0.0009) [2023-12-26 05:59:04,571][123091] Updated weights for policy 0, policy_version 800900 (0.0008) [2023-12-26 05:59:04,627][123091] Updated weights for policy 0, policy_version 800910 (0.0009) [2023-12-26 05:59:04,957][123090] Updated weights for policy 1, policy_version 795396 (0.0009) [2023-12-26 05:59:05,019][123090] Updated weights for policy 1, policy_version 795406 (0.0011) [2023-12-26 05:59:05,089][123090] Updated weights for policy 1, policy_version 795416 (0.0010) [2023-12-26 05:59:05,473][123091] Updated weights for policy 0, policy_version 800920 (0.0008) [2023-12-26 05:59:05,525][123091] Updated weights for policy 0, policy_version 800930 (0.0009) [2023-12-26 05:59:05,573][123091] Updated weights for policy 0, policy_version 800940 (0.0008) [2023-12-26 05:59:05,896][123090] Updated weights for policy 1, policy_version 795426 (0.0010) [2023-12-26 05:59:05,958][123090] Updated weights for policy 1, policy_version 795436 (0.0010) [2023-12-26 05:59:06,002][123090] Updated weights for policy 1, policy_version 795446 (0.0010) [2023-12-26 05:59:06,053][123090] Updated weights for policy 1, policy_version 795456 (0.0010) [2023-12-26 05:59:06,419][123091] Updated weights for policy 0, policy_version 800950 (0.0009) [2023-12-26 05:59:06,481][123091] Updated weights for policy 0, policy_version 800960 (0.0009) [2023-12-26 05:59:06,541][123091] Updated weights for policy 0, policy_version 800970 (0.0009) [2023-12-26 05:59:06,900][123090] Updated weights for policy 1, policy_version 795466 (0.0005) [2023-12-26 05:59:06,964][123090] Updated weights for policy 1, policy_version 795476 (0.0007) [2023-12-26 05:59:07,022][123090] Updated weights for policy 1, policy_version 795486 (0.0010) [2023-12-26 05:59:07,292][123091] Updated weights for policy 0, policy_version 800980 (0.0010) [2023-12-26 05:59:07,349][123091] Updated weights for policy 0, policy_version 800990 (0.0010) [2023-12-26 05:59:07,413][123091] Updated weights for policy 0, policy_version 801001 (0.0011) [2023-12-26 05:59:07,773][123090] Updated weights for policy 1, policy_version 795496 (0.0010) [2023-12-26 05:59:07,828][123090] Updated weights for policy 1, policy_version 795506 (0.0010) [2023-12-26 05:59:07,903][123090] Updated weights for policy 1, policy_version 795516 (0.0011) [2023-12-26 05:59:08,186][123091] Updated weights for policy 0, policy_version 801012 (0.0011) [2023-12-26 05:59:08,234][123091] Updated weights for policy 0, policy_version 801022 (0.0009) [2023-12-26 05:59:08,282][123091] Updated weights for policy 0, policy_version 801032 (0.0009) [2023-12-26 05:59:08,768][123090] Updated weights for policy 1, policy_version 795526 (0.0010) [2023-12-26 05:59:08,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 408723456. Throughput: 0: 8535.0, 1: 9021.2. Samples: 408702296. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:08,785][121949] Avg episode reward: [(0, '5974.644'), (1, '5990.106')] [2023-12-26 05:59:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000801040_205070336.pth... [2023-12-26 05:59:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000800048_204816384.pth [2023-12-26 05:59:08,833][123090] Updated weights for policy 1, policy_version 795536 (0.0009) [2023-12-26 05:59:08,893][123090] Updated weights for policy 1, policy_version 795546 (0.0009) [2023-12-26 05:59:08,925][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000795552_203661312.pth... [2023-12-26 05:59:08,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000794496_203390976.pth [2023-12-26 05:59:09,216][123091] Updated weights for policy 0, policy_version 801043 (0.0010) [2023-12-26 05:59:09,281][123091] Updated weights for policy 0, policy_version 801053 (0.0009) [2023-12-26 05:59:09,341][123091] Updated weights for policy 0, policy_version 801063 (0.0010) [2023-12-26 05:59:09,698][123090] Updated weights for policy 1, policy_version 795556 (0.0009) [2023-12-26 05:59:09,766][123090] Updated weights for policy 1, policy_version 795566 (0.0010) [2023-12-26 05:59:09,836][123090] Updated weights for policy 1, policy_version 795576 (0.0010) [2023-12-26 05:59:10,227][123091] Updated weights for policy 0, policy_version 801073 (0.0010) [2023-12-26 05:59:10,290][123091] Updated weights for policy 0, policy_version 801083 (0.0010) [2023-12-26 05:59:10,351][123091] Updated weights for policy 0, policy_version 801093 (0.0010) [2023-12-26 05:59:10,412][123091] Updated weights for policy 0, policy_version 801103 (0.0009) [2023-12-26 05:59:10,661][123090] Updated weights for policy 1, policy_version 795586 (0.0009) [2023-12-26 05:59:10,724][123090] Updated weights for policy 1, policy_version 795596 (0.0009) [2023-12-26 05:59:10,788][123090] Updated weights for policy 1, policy_version 795606 (0.0009) [2023-12-26 05:59:10,861][123090] Updated weights for policy 1, policy_version 795616 (0.0006) [2023-12-26 05:59:11,303][123091] Updated weights for policy 0, policy_version 801113 (0.0010) [2023-12-26 05:59:11,377][123091] Updated weights for policy 0, policy_version 801123 (0.0011) [2023-12-26 05:59:11,439][123091] Updated weights for policy 0, policy_version 801133 (0.0009) [2023-12-26 05:59:11,633][123090] Updated weights for policy 1, policy_version 795626 (0.0007) [2023-12-26 05:59:11,684][123090] Updated weights for policy 1, policy_version 795636 (0.0007) [2023-12-26 05:59:11,748][123090] Updated weights for policy 1, policy_version 795646 (0.0007) [2023-12-26 05:59:12,351][123091] Updated weights for policy 0, policy_version 801143 (0.0009) [2023-12-26 05:59:12,415][123091] Updated weights for policy 0, policy_version 801153 (0.0010) [2023-12-26 05:59:12,444][123090] Updated weights for policy 1, policy_version 795656 (0.0007) [2023-12-26 05:59:12,480][123091] Updated weights for policy 0, policy_version 801163 (0.0006) [2023-12-26 05:59:12,512][123090] Updated weights for policy 1, policy_version 795666 (0.0010) [2023-12-26 05:59:12,564][123090] Updated weights for policy 1, policy_version 795676 (0.0010) [2023-12-26 05:59:13,341][123090] Updated weights for policy 1, policy_version 795686 (0.0009) [2023-12-26 05:59:13,344][123091] Updated weights for policy 0, policy_version 801173 (0.0006) [2023-12-26 05:59:13,389][123091] Updated weights for policy 0, policy_version 801183 (0.0009) [2023-12-26 05:59:13,400][123090] Updated weights for policy 1, policy_version 795696 (0.0010) [2023-12-26 05:59:13,433][123091] Updated weights for policy 0, policy_version 801193 (0.0006) [2023-12-26 05:59:13,448][123090] Updated weights for policy 1, policy_version 795706 (0.0010) [2023-12-26 05:59:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 408813568. Throughput: 0: 8488.0, 1: 9026.7. Samples: 408804840. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:13,785][121949] Avg episode reward: [(0, '5852.790'), (1, '5890.230')] [2023-12-26 05:59:14,176][123090] Updated weights for policy 1, policy_version 795716 (0.0010) [2023-12-26 05:59:14,238][123090] Updated weights for policy 1, policy_version 795726 (0.0010) [2023-12-26 05:59:14,272][123091] Updated weights for policy 0, policy_version 801203 (0.0007) [2023-12-26 05:59:14,302][123090] Updated weights for policy 1, policy_version 795736 (0.0006) [2023-12-26 05:59:14,337][123091] Updated weights for policy 0, policy_version 801213 (0.0009) [2023-12-26 05:59:14,395][123091] Updated weights for policy 0, policy_version 801224 (0.0010) [2023-12-26 05:59:14,990][123090] Updated weights for policy 1, policy_version 795746 (0.0005) [2023-12-26 05:59:15,061][123090] Updated weights for policy 1, policy_version 795756 (0.0009) [2023-12-26 05:59:15,133][123090] Updated weights for policy 1, policy_version 795766 (0.0011) [2023-12-26 05:59:15,204][123090] Updated weights for policy 1, policy_version 795776 (0.0010) [2023-12-26 05:59:15,300][123091] Updated weights for policy 0, policy_version 801234 (0.0009) [2023-12-26 05:59:15,369][123091] Updated weights for policy 0, policy_version 801244 (0.0009) [2023-12-26 05:59:15,425][123091] Updated weights for policy 0, policy_version 801254 (0.0008) [2023-12-26 05:59:15,499][123091] Updated weights for policy 0, policy_version 801264 (0.0010) [2023-12-26 05:59:16,020][123090] Updated weights for policy 1, policy_version 795786 (0.0011) [2023-12-26 05:59:16,083][123090] Updated weights for policy 1, policy_version 795796 (0.0010) [2023-12-26 05:59:16,146][123090] Updated weights for policy 1, policy_version 795806 (0.0010) [2023-12-26 05:59:16,279][123091] Updated weights for policy 0, policy_version 801274 (0.0005) [2023-12-26 05:59:16,344][123091] Updated weights for policy 0, policy_version 801284 (0.0006) [2023-12-26 05:59:16,401][123091] Updated weights for policy 0, policy_version 801294 (0.0011) [2023-12-26 05:59:16,966][123090] Updated weights for policy 1, policy_version 795816 (0.0006) [2023-12-26 05:59:17,045][123090] Updated weights for policy 1, policy_version 795826 (0.0005) [2023-12-26 05:59:17,108][123090] Updated weights for policy 1, policy_version 795836 (0.0005) [2023-12-26 05:59:17,127][123091] Updated weights for policy 0, policy_version 801304 (0.0011) [2023-12-26 05:59:17,170][123091] Updated weights for policy 0, policy_version 801314 (0.0010) [2023-12-26 05:59:17,218][123091] Updated weights for policy 0, policy_version 801324 (0.0010) [2023-12-26 05:59:17,785][123090] Updated weights for policy 1, policy_version 795846 (0.0006) [2023-12-26 05:59:17,837][123090] Updated weights for policy 1, policy_version 795856 (0.0009) [2023-12-26 05:59:17,895][123090] Updated weights for policy 1, policy_version 795866 (0.0009) [2023-12-26 05:59:18,042][123091] Updated weights for policy 0, policy_version 801334 (0.0007) [2023-12-26 05:59:18,091][123091] Updated weights for policy 0, policy_version 801344 (0.0006) [2023-12-26 05:59:18,141][123091] Updated weights for policy 0, policy_version 801354 (0.0011) [2023-12-26 05:59:18,726][123090] Updated weights for policy 1, policy_version 795876 (0.0008) [2023-12-26 05:59:18,778][123090] Updated weights for policy 1, policy_version 795886 (0.0005) [2023-12-26 05:59:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 408895488. Throughput: 0: 8562.4, 1: 9026.0. Samples: 408912212. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:18,785][121949] Avg episode reward: [(0, '5938.648'), (1, '5840.627')] [2023-12-26 05:59:18,846][123090] Updated weights for policy 1, policy_version 795896 (0.0005) [2023-12-26 05:59:18,920][123091] Updated weights for policy 0, policy_version 801364 (0.0009) [2023-12-26 05:59:18,986][123091] Updated weights for policy 0, policy_version 801374 (0.0010) [2023-12-26 05:59:19,060][123091] Updated weights for policy 0, policy_version 801384 (0.0011) [2023-12-26 05:59:19,559][123090] Updated weights for policy 1, policy_version 795906 (0.0007) [2023-12-26 05:59:19,623][123090] Updated weights for policy 1, policy_version 795916 (0.0009) [2023-12-26 05:59:19,672][123090] Updated weights for policy 1, policy_version 795926 (0.0009) [2023-12-26 05:59:19,721][123090] Updated weights for policy 1, policy_version 795936 (0.0009) [2023-12-26 05:59:19,864][123091] Updated weights for policy 0, policy_version 801394 (0.0011) [2023-12-26 05:59:19,932][123091] Updated weights for policy 0, policy_version 801404 (0.0012) [2023-12-26 05:59:19,989][123091] Updated weights for policy 0, policy_version 801414 (0.0010) [2023-12-26 05:59:20,050][123091] Updated weights for policy 0, policy_version 801424 (0.0006) [2023-12-26 05:59:20,554][123090] Updated weights for policy 1, policy_version 795946 (0.0008) [2023-12-26 05:59:20,637][123090] Updated weights for policy 1, policy_version 795956 (0.0009) [2023-12-26 05:59:20,709][123090] Updated weights for policy 1, policy_version 795966 (0.0008) [2023-12-26 05:59:20,816][123091] Updated weights for policy 0, policy_version 801434 (0.0010) [2023-12-26 05:59:20,875][123091] Updated weights for policy 0, policy_version 801444 (0.0010) [2023-12-26 05:59:20,942][123091] Updated weights for policy 0, policy_version 801454 (0.0010) [2023-12-26 05:59:21,473][123090] Updated weights for policy 1, policy_version 795976 (0.0009) [2023-12-26 05:59:21,524][123090] Updated weights for policy 1, policy_version 795986 (0.0010) [2023-12-26 05:59:21,578][123090] Updated weights for policy 1, policy_version 795996 (0.0009) [2023-12-26 05:59:21,821][123091] Updated weights for policy 0, policy_version 801464 (0.0010) [2023-12-26 05:59:21,875][123091] Updated weights for policy 0, policy_version 801474 (0.0009) [2023-12-26 05:59:21,935][123091] Updated weights for policy 0, policy_version 801484 (0.0009) [2023-12-26 05:59:22,444][123090] Updated weights for policy 1, policy_version 796006 (0.0009) [2023-12-26 05:59:22,512][123090] Updated weights for policy 1, policy_version 796016 (0.0010) [2023-12-26 05:59:22,566][123090] Updated weights for policy 1, policy_version 796026 (0.0010) [2023-12-26 05:59:22,768][123091] Updated weights for policy 0, policy_version 801494 (0.0009) [2023-12-26 05:59:22,817][123091] Updated weights for policy 0, policy_version 801504 (0.0009) [2023-12-26 05:59:22,869][123091] Updated weights for policy 0, policy_version 801514 (0.0009) [2023-12-26 05:59:23,385][123090] Updated weights for policy 1, policy_version 796036 (0.0010) [2023-12-26 05:59:23,454][123090] Updated weights for policy 1, policy_version 796046 (0.0011) [2023-12-26 05:59:23,517][123090] Updated weights for policy 1, policy_version 796056 (0.0011) [2023-12-26 05:59:23,764][123091] Updated weights for policy 0, policy_version 801524 (0.0009) [2023-12-26 05:59:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 408985600. Throughput: 0: 8581.1, 1: 9009.2. Samples: 408965348. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:23,785][121949] Avg episode reward: [(0, '6024.117'), (1, '5936.878')] [2023-12-26 05:59:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000796064_203792384.pth... [2023-12-26 05:59:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000795040_203530240.pth [2023-12-26 05:59:23,825][123091] Updated weights for policy 0, policy_version 801534 (0.0009) [2023-12-26 05:59:23,873][123091] Updated weights for policy 0, policy_version 801544 (0.0008) [2023-12-26 05:59:23,914][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000801552_205201408.pth... [2023-12-26 05:59:23,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000800528_204939264.pth [2023-12-26 05:59:24,284][123090] Updated weights for policy 1, policy_version 796066 (0.0009) [2023-12-26 05:59:24,332][123090] Updated weights for policy 1, policy_version 796076 (0.0005) [2023-12-26 05:59:24,386][123090] Updated weights for policy 1, policy_version 796086 (0.0005) [2023-12-26 05:59:24,463][123090] Updated weights for policy 1, policy_version 796096 (0.0005) [2023-12-26 05:59:24,737][123091] Updated weights for policy 0, policy_version 801554 (0.0009) [2023-12-26 05:59:24,789][123091] Updated weights for policy 0, policy_version 801564 (0.0009) [2023-12-26 05:59:24,841][123091] Updated weights for policy 0, policy_version 801575 (0.0009) [2023-12-26 05:59:25,106][123090] Updated weights for policy 1, policy_version 796106 (0.0006) [2023-12-26 05:59:25,159][123090] Updated weights for policy 1, policy_version 796116 (0.0005) [2023-12-26 05:59:25,213][123090] Updated weights for policy 1, policy_version 796126 (0.0005) [2023-12-26 05:59:25,655][123091] Updated weights for policy 0, policy_version 801586 (0.0009) [2023-12-26 05:59:25,703][123091] Updated weights for policy 0, policy_version 801596 (0.0005) [2023-12-26 05:59:25,757][123091] Updated weights for policy 0, policy_version 801606 (0.0005) [2023-12-26 05:59:25,814][123090] Updated weights for policy 1, policy_version 796136 (0.0005) [2023-12-26 05:59:25,819][123091] Updated weights for policy 0, policy_version 801616 (0.0005) [2023-12-26 05:59:25,870][123090] Updated weights for policy 1, policy_version 796146 (0.0006) [2023-12-26 05:59:25,927][123090] Updated weights for policy 1, policy_version 796156 (0.0005) [2023-12-26 05:59:26,546][123091] Updated weights for policy 0, policy_version 801626 (0.0010) [2023-12-26 05:59:26,551][123090] Updated weights for policy 1, policy_version 796166 (0.0005) [2023-12-26 05:59:26,593][123091] Updated weights for policy 0, policy_version 801636 (0.0010) [2023-12-26 05:59:26,600][123090] Updated weights for policy 1, policy_version 796176 (0.0005) [2023-12-26 05:59:26,638][123091] Updated weights for policy 0, policy_version 801646 (0.0010) [2023-12-26 05:59:26,651][123090] Updated weights for policy 1, policy_version 796186 (0.0005) [2023-12-26 05:59:27,366][123090] Updated weights for policy 1, policy_version 796196 (0.0006) [2023-12-26 05:59:27,407][123091] Updated weights for policy 0, policy_version 801656 (0.0008) [2023-12-26 05:59:27,439][123090] Updated weights for policy 1, policy_version 796206 (0.0006) [2023-12-26 05:59:27,460][123091] Updated weights for policy 0, policy_version 801666 (0.0005) [2023-12-26 05:59:27,513][123090] Updated weights for policy 1, policy_version 796216 (0.0006) [2023-12-26 05:59:27,517][123091] Updated weights for policy 0, policy_version 801676 (0.0005) [2023-12-26 05:59:28,229][123091] Updated weights for policy 0, policy_version 801686 (0.0005) [2023-12-26 05:59:28,262][123090] Updated weights for policy 1, policy_version 796226 (0.0005) [2023-12-26 05:59:28,289][123091] Updated weights for policy 0, policy_version 801696 (0.0005) [2023-12-26 05:59:28,308][123090] Updated weights for policy 1, policy_version 796236 (0.0005) [2023-12-26 05:59:28,353][123091] Updated weights for policy 0, policy_version 801706 (0.0007) [2023-12-26 05:59:28,374][123090] Updated weights for policy 1, policy_version 796246 (0.0008) [2023-12-26 05:59:28,426][123090] Updated weights for policy 1, policy_version 796256 (0.0008) [2023-12-26 05:59:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 409083904. Throughput: 0: 8616.9, 1: 9096.1. Samples: 409076208. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:28,785][121949] Avg episode reward: [(0, '6064.915'), (1, '5896.610')] [2023-12-26 05:59:28,996][123091] Updated weights for policy 0, policy_version 801716 (0.0007) [2023-12-26 05:59:29,057][123091] Updated weights for policy 0, policy_version 801726 (0.0005) [2023-12-26 05:59:29,123][123091] Updated weights for policy 0, policy_version 801736 (0.0005) [2023-12-26 05:59:29,141][123090] Updated weights for policy 1, policy_version 796266 (0.0010) [2023-12-26 05:59:29,203][123090] Updated weights for policy 1, policy_version 796276 (0.0010) [2023-12-26 05:59:29,273][123090] Updated weights for policy 1, policy_version 796286 (0.0011) [2023-12-26 05:59:29,875][123091] Updated weights for policy 0, policy_version 801746 (0.0006) [2023-12-26 05:59:29,940][123091] Updated weights for policy 0, policy_version 801756 (0.0008) [2023-12-26 05:59:30,007][123091] Updated weights for policy 0, policy_version 801766 (0.0009) [2023-12-26 05:59:30,069][123091] Updated weights for policy 0, policy_version 801776 (0.0010) [2023-12-26 05:59:30,076][123090] Updated weights for policy 1, policy_version 796296 (0.0011) [2023-12-26 05:59:30,139][123090] Updated weights for policy 1, policy_version 796306 (0.0010) [2023-12-26 05:59:30,201][123090] Updated weights for policy 1, policy_version 796316 (0.0010) [2023-12-26 05:59:30,871][123091] Updated weights for policy 0, policy_version 801786 (0.0010) [2023-12-26 05:59:30,927][123091] Updated weights for policy 0, policy_version 801796 (0.0008) [2023-12-26 05:59:30,983][123091] Updated weights for policy 0, policy_version 801806 (0.0008) [2023-12-26 05:59:30,998][123090] Updated weights for policy 1, policy_version 796326 (0.0010) [2023-12-26 05:59:31,069][123090] Updated weights for policy 1, policy_version 796336 (0.0010) [2023-12-26 05:59:31,138][123090] Updated weights for policy 1, policy_version 796346 (0.0009) [2023-12-26 05:59:31,830][123091] Updated weights for policy 0, policy_version 801816 (0.0008) [2023-12-26 05:59:31,880][123091] Updated weights for policy 0, policy_version 801826 (0.0009) [2023-12-26 05:59:31,934][123091] Updated weights for policy 0, policy_version 801836 (0.0010) [2023-12-26 05:59:31,971][123090] Updated weights for policy 1, policy_version 796356 (0.0007) [2023-12-26 05:59:32,028][123090] Updated weights for policy 1, policy_version 796366 (0.0010) [2023-12-26 05:59:32,092][123090] Updated weights for policy 1, policy_version 796376 (0.0010) [2023-12-26 05:59:32,814][123091] Updated weights for policy 0, policy_version 801846 (0.0010) [2023-12-26 05:59:32,869][123091] Updated weights for policy 0, policy_version 801857 (0.0011) [2023-12-26 05:59:32,909][123090] Updated weights for policy 1, policy_version 796386 (0.0009) [2023-12-26 05:59:32,925][123091] Updated weights for policy 0, policy_version 801867 (0.0009) [2023-12-26 05:59:32,958][123090] Updated weights for policy 1, policy_version 796396 (0.0008) [2023-12-26 05:59:33,014][123090] Updated weights for policy 1, policy_version 796406 (0.0010) [2023-12-26 05:59:33,634][123091] Updated weights for policy 0, policy_version 801877 (0.0008) [2023-12-26 05:59:33,686][123091] Updated weights for policy 0, policy_version 801887 (0.0009) [2023-12-26 05:59:33,743][123091] Updated weights for policy 0, policy_version 801897 (0.0009) [2023-12-26 05:59:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 409174016. Throughput: 0: 8683.5, 1: 8985.5. Samples: 409183016. Policy #0 lag: (min: 30.0, avg: 37.1, max: 62.0) [2023-12-26 05:59:33,786][121949] Avg episode reward: [(0, '6057.107'), (1, '5949.866')] [2023-12-26 05:59:33,894][123090] Updated weights for policy 1, policy_version 796417 (0.0010) [2023-12-26 05:59:33,954][123090] Updated weights for policy 1, policy_version 796428 (0.0011) [2023-12-26 05:59:34,010][123090] Updated weights for policy 1, policy_version 796440 (0.0011) [2023-12-26 05:59:34,497][123091] Updated weights for policy 0, policy_version 801907 (0.0009) [2023-12-26 05:59:34,549][123091] Updated weights for policy 0, policy_version 801917 (0.0008) [2023-12-26 05:59:34,616][123091] Updated weights for policy 0, policy_version 801927 (0.0009) [2023-12-26 05:59:34,922][123090] Updated weights for policy 1, policy_version 796450 (0.0009) [2023-12-26 05:59:34,972][123090] Updated weights for policy 1, policy_version 796460 (0.0005) [2023-12-26 05:59:35,020][123090] Updated weights for policy 1, policy_version 796470 (0.0005) [2023-12-26 05:59:35,066][123090] Updated weights for policy 1, policy_version 796480 (0.0005) [2023-12-26 05:59:35,482][123091] Updated weights for policy 0, policy_version 801937 (0.0009) [2023-12-26 05:59:35,551][123091] Updated weights for policy 0, policy_version 801947 (0.0010) [2023-12-26 05:59:35,604][123091] Updated weights for policy 0, policy_version 801957 (0.0009) [2023-12-26 05:59:35,675][123091] Updated weights for policy 0, policy_version 801967 (0.0009) [2023-12-26 05:59:35,854][123090] Updated weights for policy 1, policy_version 796490 (0.0010) [2023-12-26 05:59:35,919][123090] Updated weights for policy 1, policy_version 796500 (0.0009) [2023-12-26 05:59:35,969][123090] Updated weights for policy 1, policy_version 796510 (0.0008) [2023-12-26 05:59:36,493][123091] Updated weights for policy 0, policy_version 801977 (0.0010) [2023-12-26 05:59:36,555][123091] Updated weights for policy 0, policy_version 801987 (0.0009) [2023-12-26 05:59:36,616][123091] Updated weights for policy 0, policy_version 801997 (0.0006) [2023-12-26 05:59:36,826][123090] Updated weights for policy 1, policy_version 796520 (0.0009) [2023-12-26 05:59:36,884][123090] Updated weights for policy 1, policy_version 796530 (0.0009) [2023-12-26 05:59:36,953][123090] Updated weights for policy 1, policy_version 796540 (0.0010) [2023-12-26 05:59:37,460][123091] Updated weights for policy 0, policy_version 802007 (0.0009) [2023-12-26 05:59:37,512][123091] Updated weights for policy 0, policy_version 802017 (0.0010) [2023-12-26 05:59:37,562][123091] Updated weights for policy 0, policy_version 802027 (0.0009) [2023-12-26 05:59:37,707][123090] Updated weights for policy 1, policy_version 796550 (0.0009) [2023-12-26 05:59:37,758][123090] Updated weights for policy 1, policy_version 796560 (0.0009) [2023-12-26 05:59:37,820][123090] Updated weights for policy 1, policy_version 796570 (0.0009) [2023-12-26 05:59:38,388][123091] Updated weights for policy 0, policy_version 802037 (0.0008) [2023-12-26 05:59:38,456][123091] Updated weights for policy 0, policy_version 802047 (0.0008) [2023-12-26 05:59:38,521][123091] Updated weights for policy 0, policy_version 802057 (0.0009) [2023-12-26 05:59:38,681][123090] Updated weights for policy 1, policy_version 796580 (0.0010) [2023-12-26 05:59:38,737][123090] Updated weights for policy 1, policy_version 796590 (0.0009) [2023-12-26 05:59:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 409255936. Throughput: 0: 8713.2, 1: 8939.3. Samples: 409234588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:59:38,785][121949] Avg episode reward: [(0, '6144.206'), (1, '6003.467')] [2023-12-26 05:59:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000802064_205332480.pth... [2023-12-26 05:59:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000801040_205070336.pth [2023-12-26 05:59:38,802][123090] Updated weights for policy 1, policy_version 796600 (0.0009) [2023-12-26 05:59:38,859][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000796608_203931648.pth... [2023-12-26 05:59:38,864][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000795552_203661312.pth [2023-12-26 05:59:39,373][123091] Updated weights for policy 0, policy_version 802067 (0.0009) [2023-12-26 05:59:39,444][123091] Updated weights for policy 0, policy_version 802077 (0.0008) [2023-12-26 05:59:39,504][123091] Updated weights for policy 0, policy_version 802087 (0.0009) [2023-12-26 05:59:39,616][123090] Updated weights for policy 1, policy_version 796610 (0.0006) [2023-12-26 05:59:39,674][123090] Updated weights for policy 1, policy_version 796620 (0.0008) [2023-12-26 05:59:39,735][123090] Updated weights for policy 1, policy_version 796630 (0.0006) [2023-12-26 05:59:39,803][123090] Updated weights for policy 1, policy_version 796640 (0.0006) [2023-12-26 05:59:40,376][123091] Updated weights for policy 0, policy_version 802097 (0.0008) [2023-12-26 05:59:40,431][123091] Updated weights for policy 0, policy_version 802107 (0.0005) [2023-12-26 05:59:40,493][123091] Updated weights for policy 0, policy_version 802117 (0.0008) [2023-12-26 05:59:40,550][123091] Updated weights for policy 0, policy_version 802127 (0.0009) [2023-12-26 05:59:40,583][123090] Updated weights for policy 1, policy_version 796650 (0.0009) [2023-12-26 05:59:40,645][123090] Updated weights for policy 1, policy_version 796660 (0.0005) [2023-12-26 05:59:40,718][123090] Updated weights for policy 1, policy_version 796670 (0.0006) [2023-12-26 05:59:41,430][123091] Updated weights for policy 0, policy_version 802137 (0.0009) [2023-12-26 05:59:41,479][123091] Updated weights for policy 0, policy_version 802147 (0.0009) [2023-12-26 05:59:41,537][123091] Updated weights for policy 0, policy_version 802157 (0.0009) [2023-12-26 05:59:41,570][123090] Updated weights for policy 1, policy_version 796680 (0.0008) [2023-12-26 05:59:41,643][123090] Updated weights for policy 1, policy_version 796690 (0.0010) [2023-12-26 05:59:41,711][123090] Updated weights for policy 1, policy_version 796700 (0.0007) [2023-12-26 05:59:42,434][123091] Updated weights for policy 0, policy_version 802167 (0.0006) [2023-12-26 05:59:42,501][123091] Updated weights for policy 0, policy_version 802177 (0.0007) [2023-12-26 05:59:42,514][123090] Updated weights for policy 1, policy_version 796710 (0.0009) [2023-12-26 05:59:42,561][123091] Updated weights for policy 0, policy_version 802187 (0.0008) [2023-12-26 05:59:42,577][123090] Updated weights for policy 1, policy_version 796720 (0.0008) [2023-12-26 05:59:42,626][123090] Updated weights for policy 1, policy_version 796730 (0.0008) [2023-12-26 05:59:43,291][123091] Updated weights for policy 0, policy_version 802197 (0.0009) [2023-12-26 05:59:43,347][123091] Updated weights for policy 0, policy_version 802207 (0.0010) [2023-12-26 05:59:43,398][123090] Updated weights for policy 1, policy_version 796740 (0.0007) [2023-12-26 05:59:43,406][123091] Updated weights for policy 0, policy_version 802217 (0.0011) [2023-12-26 05:59:43,446][123090] Updated weights for policy 1, policy_version 796750 (0.0006) [2023-12-26 05:59:43,492][123090] Updated weights for policy 1, policy_version 796760 (0.0008) [2023-12-26 05:59:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 409346048. Throughput: 0: 8629.3, 1: 8887.5. Samples: 409336076. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:59:43,784][121949] Avg episode reward: [(0, '6174.881'), (1, '5967.827')] [2023-12-26 05:59:44,188][123091] Updated weights for policy 0, policy_version 802227 (0.0011) [2023-12-26 05:59:44,247][123091] Updated weights for policy 0, policy_version 802237 (0.0011) [2023-12-26 05:59:44,275][123090] Updated weights for policy 1, policy_version 796770 (0.0009) [2023-12-26 05:59:44,294][123091] Updated weights for policy 0, policy_version 802247 (0.0010) [2023-12-26 05:59:44,324][123090] Updated weights for policy 1, policy_version 796780 (0.0005) [2023-12-26 05:59:44,376][123090] Updated weights for policy 1, policy_version 796790 (0.0005) [2023-12-26 05:59:44,431][123090] Updated weights for policy 1, policy_version 796800 (0.0005) [2023-12-26 05:59:45,041][123091] Updated weights for policy 0, policy_version 802257 (0.0006) [2023-12-26 05:59:45,106][123091] Updated weights for policy 0, policy_version 802267 (0.0009) [2023-12-26 05:59:45,165][123091] Updated weights for policy 0, policy_version 802277 (0.0007) [2023-12-26 05:59:45,230][123090] Updated weights for policy 1, policy_version 796810 (0.0006) [2023-12-26 05:59:45,237][123091] Updated weights for policy 0, policy_version 802287 (0.0008) [2023-12-26 05:59:45,294][123090] Updated weights for policy 1, policy_version 796820 (0.0009) [2023-12-26 05:59:45,357][123090] Updated weights for policy 1, policy_version 796830 (0.0010) [2023-12-26 05:59:46,045][123091] Updated weights for policy 0, policy_version 802297 (0.0011) [2023-12-26 05:59:46,116][123091] Updated weights for policy 0, policy_version 802307 (0.0011) [2023-12-26 05:59:46,133][123090] Updated weights for policy 1, policy_version 796840 (0.0007) [2023-12-26 05:59:46,190][123091] Updated weights for policy 0, policy_version 802317 (0.0011) [2023-12-26 05:59:46,203][123090] Updated weights for policy 1, policy_version 796850 (0.0006) [2023-12-26 05:59:46,267][123090] Updated weights for policy 1, policy_version 796860 (0.0008) [2023-12-26 05:59:46,923][123090] Updated weights for policy 1, policy_version 796870 (0.0009) [2023-12-26 05:59:46,987][123090] Updated weights for policy 1, policy_version 796880 (0.0007) [2023-12-26 05:59:46,989][123091] Updated weights for policy 0, policy_version 802327 (0.0011) [2023-12-26 05:59:47,051][123091] Updated weights for policy 0, policy_version 802337 (0.0009) [2023-12-26 05:59:47,052][123090] Updated weights for policy 1, policy_version 796890 (0.0008) [2023-12-26 05:59:47,117][123091] Updated weights for policy 0, policy_version 802347 (0.0005) [2023-12-26 05:59:47,742][123090] Updated weights for policy 1, policy_version 796900 (0.0008) [2023-12-26 05:59:47,792][123090] Updated weights for policy 1, policy_version 796910 (0.0005) [2023-12-26 05:59:47,814][123091] Updated weights for policy 0, policy_version 802357 (0.0008) [2023-12-26 05:59:47,847][123090] Updated weights for policy 1, policy_version 796920 (0.0006) [2023-12-26 05:59:47,874][123091] Updated weights for policy 0, policy_version 802367 (0.0011) [2023-12-26 05:59:47,936][123091] Updated weights for policy 0, policy_version 802377 (0.0010) [2023-12-26 05:59:48,552][123090] Updated weights for policy 1, policy_version 796930 (0.0006) [2023-12-26 05:59:48,609][123090] Updated weights for policy 1, policy_version 796940 (0.0010) [2023-12-26 05:59:48,665][123090] Updated weights for policy 1, policy_version 796950 (0.0010) [2023-12-26 05:59:48,709][123091] Updated weights for policy 0, policy_version 802387 (0.0010) [2023-12-26 05:59:48,721][123090] Updated weights for policy 1, policy_version 796960 (0.0010) [2023-12-26 05:59:48,768][123091] Updated weights for policy 0, policy_version 802397 (0.0010) [2023-12-26 05:59:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 409436160. Throughput: 0: 8713.7, 1: 9013.8. Samples: 409448736. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:59:48,785][121949] Avg episode reward: [(0, '6113.739'), (1, '5897.326')] [2023-12-26 05:59:48,827][123091] Updated weights for policy 0, policy_version 802407 (0.0011) [2023-12-26 05:59:49,593][123091] Updated weights for policy 0, policy_version 802417 (0.0011) [2023-12-26 05:59:49,617][123090] Updated weights for policy 1, policy_version 796970 (0.0007) [2023-12-26 05:59:49,644][123091] Updated weights for policy 0, policy_version 802427 (0.0009) [2023-12-26 05:59:49,685][123090] Updated weights for policy 1, policy_version 796980 (0.0008) [2023-12-26 05:59:49,700][123091] Updated weights for policy 0, policy_version 802437 (0.0006) [2023-12-26 05:59:49,750][123090] Updated weights for policy 1, policy_version 796990 (0.0009) [2023-12-26 05:59:49,761][123091] Updated weights for policy 0, policy_version 802447 (0.0006) [2023-12-26 05:59:50,581][123091] Updated weights for policy 0, policy_version 802457 (0.0007) [2023-12-26 05:59:50,615][123090] Updated weights for policy 1, policy_version 797000 (0.0009) [2023-12-26 05:59:50,648][123091] Updated weights for policy 0, policy_version 802467 (0.0006) [2023-12-26 05:59:50,674][123090] Updated weights for policy 1, policy_version 797010 (0.0010) [2023-12-26 05:59:50,715][123091] Updated weights for policy 0, policy_version 802477 (0.0007) [2023-12-26 05:59:50,726][123090] Updated weights for policy 1, policy_version 797020 (0.0007) [2023-12-26 05:59:51,473][123091] Updated weights for policy 0, policy_version 802487 (0.0009) [2023-12-26 05:59:51,521][123090] Updated weights for policy 1, policy_version 797030 (0.0009) [2023-12-26 05:59:51,536][123091] Updated weights for policy 0, policy_version 802497 (0.0008) [2023-12-26 05:59:51,570][123090] Updated weights for policy 1, policy_version 797040 (0.0008) [2023-12-26 05:59:51,589][123091] Updated weights for policy 0, policy_version 802508 (0.0009) [2023-12-26 05:59:51,629][123090] Updated weights for policy 1, policy_version 797050 (0.0009) [2023-12-26 05:59:52,455][123091] Updated weights for policy 0, policy_version 802518 (0.0010) [2023-12-26 05:59:52,499][123090] Updated weights for policy 1, policy_version 797060 (0.0010) [2023-12-26 05:59:52,523][123091] Updated weights for policy 0, policy_version 802528 (0.0006) [2023-12-26 05:59:52,559][123090] Updated weights for policy 1, policy_version 797070 (0.0010) [2023-12-26 05:59:52,587][123091] Updated weights for policy 0, policy_version 802538 (0.0006) [2023-12-26 05:59:52,618][123090] Updated weights for policy 1, policy_version 797080 (0.0010) [2023-12-26 05:59:53,390][123090] Updated weights for policy 1, policy_version 797090 (0.0009) [2023-12-26 05:59:53,434][123091] Updated weights for policy 0, policy_version 802548 (0.0007) [2023-12-26 05:59:53,440][123090] Updated weights for policy 1, policy_version 797100 (0.0006) [2023-12-26 05:59:53,491][123091] Updated weights for policy 0, policy_version 802558 (0.0006) [2023-12-26 05:59:53,496][123090] Updated weights for policy 1, policy_version 797110 (0.0009) [2023-12-26 05:59:53,547][123090] Updated weights for policy 1, policy_version 797120 (0.0007) [2023-12-26 05:59:53,549][123091] Updated weights for policy 0, policy_version 802568 (0.0008) [2023-12-26 05:59:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 409526272. Throughput: 0: 8738.5, 1: 8984.7. Samples: 409499840. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:59:53,785][121949] Avg episode reward: [(0, '6087.921'), (1, '5926.973')] [2023-12-26 05:59:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000802576_205463552.pth... [2023-12-26 05:59:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000797120_204062720.pth... [2023-12-26 05:59:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000801552_205201408.pth [2023-12-26 05:59:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000796064_203792384.pth [2023-12-26 05:59:54,320][123090] Updated weights for policy 1, policy_version 797130 (0.0010) [2023-12-26 05:59:54,391][123090] Updated weights for policy 1, policy_version 797140 (0.0005) [2023-12-26 05:59:54,404][123091] Updated weights for policy 0, policy_version 802578 (0.0010) [2023-12-26 05:59:54,451][123090] Updated weights for policy 1, policy_version 797150 (0.0005) [2023-12-26 05:59:54,459][123091] Updated weights for policy 0, policy_version 802588 (0.0011) [2023-12-26 05:59:54,503][123091] Updated weights for policy 0, policy_version 802598 (0.0010) [2023-12-26 05:59:54,554][123091] Updated weights for policy 0, policy_version 802608 (0.0006) [2023-12-26 05:59:55,093][123090] Updated weights for policy 1, policy_version 797160 (0.0005) [2023-12-26 05:59:55,150][123090] Updated weights for policy 1, policy_version 797170 (0.0006) [2023-12-26 05:59:55,222][123090] Updated weights for policy 1, policy_version 797180 (0.0005) [2023-12-26 05:59:55,299][123091] Updated weights for policy 0, policy_version 802618 (0.0011) [2023-12-26 05:59:55,354][123091] Updated weights for policy 0, policy_version 802628 (0.0010) [2023-12-26 05:59:55,421][123091] Updated weights for policy 0, policy_version 802638 (0.0011) [2023-12-26 05:59:56,004][123090] Updated weights for policy 1, policy_version 797190 (0.0008) [2023-12-26 05:59:56,055][123091] Updated weights for policy 0, policy_version 802648 (0.0007) [2023-12-26 05:59:56,067][123090] Updated weights for policy 1, policy_version 797200 (0.0006) [2023-12-26 05:59:56,130][123091] Updated weights for policy 0, policy_version 802658 (0.0006) [2023-12-26 05:59:56,140][123090] Updated weights for policy 1, policy_version 797210 (0.0007) [2023-12-26 05:59:56,197][123091] Updated weights for policy 0, policy_version 802668 (0.0005) [2023-12-26 05:59:56,804][123091] Updated weights for policy 0, policy_version 802678 (0.0006) [2023-12-26 05:59:56,813][123090] Updated weights for policy 1, policy_version 797220 (0.0008) [2023-12-26 05:59:56,848][123091] Updated weights for policy 0, policy_version 802688 (0.0005) [2023-12-26 05:59:56,864][123090] Updated weights for policy 1, policy_version 797230 (0.0008) [2023-12-26 05:59:56,899][123091] Updated weights for policy 0, policy_version 802698 (0.0005) [2023-12-26 05:59:56,929][123090] Updated weights for policy 1, policy_version 797240 (0.0010) [2023-12-26 05:59:57,552][123091] Updated weights for policy 0, policy_version 802708 (0.0005) [2023-12-26 05:59:57,606][123091] Updated weights for policy 0, policy_version 802718 (0.0008) [2023-12-26 05:59:57,659][123091] Updated weights for policy 0, policy_version 802728 (0.0010) [2023-12-26 05:59:57,774][123090] Updated weights for policy 1, policy_version 797250 (0.0010) [2023-12-26 05:59:57,832][123090] Updated weights for policy 1, policy_version 797260 (0.0010) [2023-12-26 05:59:57,889][123090] Updated weights for policy 1, policy_version 797270 (0.0009) [2023-12-26 05:59:57,953][123090] Updated weights for policy 1, policy_version 797280 (0.0010) [2023-12-26 05:59:58,418][123091] Updated weights for policy 0, policy_version 802738 (0.0006) [2023-12-26 05:59:58,488][123091] Updated weights for policy 0, policy_version 802748 (0.0006) [2023-12-26 05:59:58,555][123091] Updated weights for policy 0, policy_version 802758 (0.0008) [2023-12-26 05:59:58,630][123091] Updated weights for policy 0, policy_version 802768 (0.0007) [2023-12-26 05:59:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 409616384. Throughput: 0: 8879.5, 1: 9041.8. Samples: 409611296. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 05:59:58,785][121949] Avg episode reward: [(0, '5957.569'), (1, '5918.382')] [2023-12-26 05:59:58,975][123090] Updated weights for policy 1, policy_version 797290 (0.0011) [2023-12-26 05:59:59,038][123090] Updated weights for policy 1, policy_version 797300 (0.0010) [2023-12-26 05:59:59,108][123090] Updated weights for policy 1, policy_version 797310 (0.0010) [2023-12-26 05:59:59,436][123091] Updated weights for policy 0, policy_version 802778 (0.0010) [2023-12-26 05:59:59,487][123091] Updated weights for policy 0, policy_version 802788 (0.0006) [2023-12-26 05:59:59,539][123091] Updated weights for policy 0, policy_version 802798 (0.0005) [2023-12-26 06:00:00,026][123090] Updated weights for policy 1, policy_version 797320 (0.0009) [2023-12-26 06:00:00,085][123090] Updated weights for policy 1, policy_version 797330 (0.0009) [2023-12-26 06:00:00,151][123090] Updated weights for policy 1, policy_version 797340 (0.0009) [2023-12-26 06:00:00,271][123091] Updated weights for policy 0, policy_version 802808 (0.0009) [2023-12-26 06:00:00,335][123091] Updated weights for policy 0, policy_version 802818 (0.0010) [2023-12-26 06:00:00,405][123091] Updated weights for policy 0, policy_version 802828 (0.0010) [2023-12-26 06:00:01,032][123090] Updated weights for policy 1, policy_version 797350 (0.0009) [2023-12-26 06:00:01,098][123090] Updated weights for policy 1, policy_version 797360 (0.0009) [2023-12-26 06:00:01,159][123091] Updated weights for policy 0, policy_version 802838 (0.0010) [2023-12-26 06:00:01,165][123090] Updated weights for policy 1, policy_version 797370 (0.0010) [2023-12-26 06:00:01,217][123091] Updated weights for policy 0, policy_version 802848 (0.0010) [2023-12-26 06:00:01,276][123091] Updated weights for policy 0, policy_version 802858 (0.0010) [2023-12-26 06:00:01,983][123090] Updated weights for policy 1, policy_version 797380 (0.0008) [2023-12-26 06:00:02,051][123090] Updated weights for policy 1, policy_version 797390 (0.0011) [2023-12-26 06:00:02,115][123091] Updated weights for policy 0, policy_version 802868 (0.0010) [2023-12-26 06:00:02,119][123090] Updated weights for policy 1, policy_version 797400 (0.0010) [2023-12-26 06:00:02,168][123091] Updated weights for policy 0, policy_version 802878 (0.0006) [2023-12-26 06:00:02,227][123091] Updated weights for policy 0, policy_version 802888 (0.0005) [2023-12-26 06:00:02,810][123090] Updated weights for policy 1, policy_version 797410 (0.0009) [2023-12-26 06:00:02,865][123090] Updated weights for policy 1, policy_version 797420 (0.0005) [2023-12-26 06:00:02,919][123090] Updated weights for policy 1, policy_version 797430 (0.0010) [2023-12-26 06:00:02,978][123090] Updated weights for policy 1, policy_version 797440 (0.0010) [2023-12-26 06:00:03,075][123091] Updated weights for policy 0, policy_version 802898 (0.0008) [2023-12-26 06:00:03,131][123091] Updated weights for policy 0, policy_version 802908 (0.0009) [2023-12-26 06:00:03,190][123091] Updated weights for policy 0, policy_version 802918 (0.0009) [2023-12-26 06:00:03,249][123091] Updated weights for policy 0, policy_version 802928 (0.0009) [2023-12-26 06:00:03,726][123090] Updated weights for policy 1, policy_version 797451 (0.0009) [2023-12-26 06:00:03,771][123090] Updated weights for policy 1, policy_version 797461 (0.0006) [2023-12-26 06:00:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 409698304. Throughput: 0: 8886.7, 1: 8912.9. Samples: 409713192. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:03,785][121949] Avg episode reward: [(0, '5965.764'), (1, '5875.520')] [2023-12-26 06:00:03,827][123090] Updated weights for policy 1, policy_version 797471 (0.0006) [2023-12-26 06:00:04,074][123091] Updated weights for policy 0, policy_version 802938 (0.0010) [2023-12-26 06:00:04,131][123091] Updated weights for policy 0, policy_version 802948 (0.0011) [2023-12-26 06:00:04,183][123091] Updated weights for policy 0, policy_version 802958 (0.0011) [2023-12-26 06:00:04,655][123090] Updated weights for policy 1, policy_version 797481 (0.0009) [2023-12-26 06:00:04,723][123090] Updated weights for policy 1, policy_version 797491 (0.0009) [2023-12-26 06:00:04,786][123090] Updated weights for policy 1, policy_version 797501 (0.0010) [2023-12-26 06:00:04,995][123091] Updated weights for policy 0, policy_version 802968 (0.0006) [2023-12-26 06:00:05,054][123091] Updated weights for policy 0, policy_version 802978 (0.0005) [2023-12-26 06:00:05,124][123091] Updated weights for policy 0, policy_version 802988 (0.0005) [2023-12-26 06:00:05,616][123090] Updated weights for policy 1, policy_version 797511 (0.0007) [2023-12-26 06:00:05,672][123090] Updated weights for policy 1, policy_version 797521 (0.0010) [2023-12-26 06:00:05,740][123090] Updated weights for policy 1, policy_version 797531 (0.0011) [2023-12-26 06:00:05,768][123091] Updated weights for policy 0, policy_version 802998 (0.0008) [2023-12-26 06:00:05,818][123091] Updated weights for policy 0, policy_version 803008 (0.0009) [2023-12-26 06:00:05,878][123091] Updated weights for policy 0, policy_version 803019 (0.0011) [2023-12-26 06:00:06,503][123090] Updated weights for policy 1, policy_version 797541 (0.0011) [2023-12-26 06:00:06,554][123090] Updated weights for policy 1, policy_version 797551 (0.0009) [2023-12-26 06:00:06,607][123090] Updated weights for policy 1, policy_version 797561 (0.0011) [2023-12-26 06:00:06,800][123091] Updated weights for policy 0, policy_version 803030 (0.0010) [2023-12-26 06:00:06,861][123091] Updated weights for policy 0, policy_version 803040 (0.0009) [2023-12-26 06:00:06,927][123091] Updated weights for policy 0, policy_version 803050 (0.0009) [2023-12-26 06:00:07,478][123090] Updated weights for policy 1, policy_version 797571 (0.0011) [2023-12-26 06:00:07,541][123090] Updated weights for policy 1, policy_version 797581 (0.0010) [2023-12-26 06:00:07,592][123090] Updated weights for policy 1, policy_version 797591 (0.0010) [2023-12-26 06:00:07,700][123091] Updated weights for policy 0, policy_version 803060 (0.0009) [2023-12-26 06:00:07,759][123091] Updated weights for policy 0, policy_version 803070 (0.0010) [2023-12-26 06:00:07,817][123091] Updated weights for policy 0, policy_version 803080 (0.0010) [2023-12-26 06:00:08,358][123090] Updated weights for policy 1, policy_version 797601 (0.0010) [2023-12-26 06:00:08,428][123090] Updated weights for policy 1, policy_version 797611 (0.0006) [2023-12-26 06:00:08,479][123090] Updated weights for policy 1, policy_version 797621 (0.0006) [2023-12-26 06:00:08,529][123090] Updated weights for policy 1, policy_version 797631 (0.0007) [2023-12-26 06:00:08,618][123091] Updated weights for policy 0, policy_version 803090 (0.0010) [2023-12-26 06:00:08,680][123091] Updated weights for policy 0, policy_version 803100 (0.0011) [2023-12-26 06:00:08,744][123091] Updated weights for policy 0, policy_version 803110 (0.0007) [2023-12-26 06:00:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 409788416. Throughput: 0: 8913.1, 1: 8896.8. Samples: 409766796. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:08,785][121949] Avg episode reward: [(0, '5889.241'), (1, '5923.669')] [2023-12-26 06:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000797632_204193792.pth... [2023-12-26 06:00:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000796608_203931648.pth [2023-12-26 06:00:08,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000803120_205602816.pth... [2023-12-26 06:00:08,807][123091] Updated weights for policy 0, policy_version 803120 (0.0008) [2023-12-26 06:00:08,809][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000802064_205332480.pth [2023-12-26 06:00:09,321][123090] Updated weights for policy 1, policy_version 797641 (0.0007) [2023-12-26 06:00:09,388][123090] Updated weights for policy 1, policy_version 797651 (0.0010) [2023-12-26 06:00:09,458][123090] Updated weights for policy 1, policy_version 797661 (0.0011) [2023-12-26 06:00:09,518][123091] Updated weights for policy 0, policy_version 803130 (0.0011) [2023-12-26 06:00:09,585][123091] Updated weights for policy 0, policy_version 803140 (0.0011) [2023-12-26 06:00:09,649][123091] Updated weights for policy 0, policy_version 803150 (0.0011) [2023-12-26 06:00:10,247][123090] Updated weights for policy 1, policy_version 797671 (0.0009) [2023-12-26 06:00:10,316][123090] Updated weights for policy 1, policy_version 797681 (0.0009) [2023-12-26 06:00:10,379][123090] Updated weights for policy 1, policy_version 797691 (0.0008) [2023-12-26 06:00:10,503][123091] Updated weights for policy 0, policy_version 803160 (0.0008) [2023-12-26 06:00:10,562][123091] Updated weights for policy 0, policy_version 803170 (0.0006) [2023-12-26 06:00:10,625][123091] Updated weights for policy 0, policy_version 803180 (0.0005) [2023-12-26 06:00:11,303][123090] Updated weights for policy 1, policy_version 797701 (0.0009) [2023-12-26 06:00:11,387][123090] Updated weights for policy 1, policy_version 797711 (0.0007) [2023-12-26 06:00:11,400][123091] Updated weights for policy 0, policy_version 803190 (0.0007) [2023-12-26 06:00:11,452][123090] Updated weights for policy 1, policy_version 797721 (0.0010) [2023-12-26 06:00:11,468][123091] Updated weights for policy 0, policy_version 803200 (0.0007) [2023-12-26 06:00:11,530][123091] Updated weights for policy 0, policy_version 803210 (0.0006) [2023-12-26 06:00:12,321][123090] Updated weights for policy 1, policy_version 797731 (0.0008) [2023-12-26 06:00:12,335][123091] Updated weights for policy 0, policy_version 803220 (0.0008) [2023-12-26 06:00:12,395][123090] Updated weights for policy 1, policy_version 797741 (0.0010) [2023-12-26 06:00:12,411][123091] Updated weights for policy 0, policy_version 803230 (0.0011) [2023-12-26 06:00:12,458][123090] Updated weights for policy 1, policy_version 797751 (0.0006) [2023-12-26 06:00:12,472][123091] Updated weights for policy 0, policy_version 803240 (0.0011) [2023-12-26 06:00:13,173][123090] Updated weights for policy 1, policy_version 797761 (0.0008) [2023-12-26 06:00:13,222][123090] Updated weights for policy 1, policy_version 797771 (0.0005) [2023-12-26 06:00:13,272][123090] Updated weights for policy 1, policy_version 797781 (0.0007) [2023-12-26 06:00:13,278][123091] Updated weights for policy 0, policy_version 803250 (0.0011) [2023-12-26 06:00:13,332][123090] Updated weights for policy 1, policy_version 797791 (0.0005) [2023-12-26 06:00:13,334][123091] Updated weights for policy 0, policy_version 803260 (0.0010) [2023-12-26 06:00:13,389][123091] Updated weights for policy 0, policy_version 803270 (0.0010) [2023-12-26 06:00:13,459][123091] Updated weights for policy 0, policy_version 803280 (0.0010) [2023-12-26 06:00:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 409878528. Throughput: 0: 8899.9, 1: 8743.8. Samples: 409870176. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:13,785][121949] Avg episode reward: [(0, '5913.763'), (1, '5891.188')] [2023-12-26 06:00:14,060][123090] Updated weights for policy 1, policy_version 797801 (0.0005) [2023-12-26 06:00:14,107][123090] Updated weights for policy 1, policy_version 797811 (0.0006) [2023-12-26 06:00:14,169][123090] Updated weights for policy 1, policy_version 797821 (0.0005) [2023-12-26 06:00:14,366][123091] Updated weights for policy 0, policy_version 803290 (0.0010) [2023-12-26 06:00:14,418][123091] Updated weights for policy 0, policy_version 803300 (0.0009) [2023-12-26 06:00:14,468][123091] Updated weights for policy 0, policy_version 803310 (0.0009) [2023-12-26 06:00:14,816][123090] Updated weights for policy 1, policy_version 797831 (0.0009) [2023-12-26 06:00:14,886][123090] Updated weights for policy 1, policy_version 797841 (0.0009) [2023-12-26 06:00:14,952][123090] Updated weights for policy 1, policy_version 797851 (0.0005) [2023-12-26 06:00:15,377][123091] Updated weights for policy 0, policy_version 803320 (0.0010) [2023-12-26 06:00:15,440][123091] Updated weights for policy 0, policy_version 803330 (0.0009) [2023-12-26 06:00:15,507][123091] Updated weights for policy 0, policy_version 803340 (0.0010) [2023-12-26 06:00:15,632][123090] Updated weights for policy 1, policy_version 797861 (0.0008) [2023-12-26 06:00:15,679][123090] Updated weights for policy 1, policy_version 797871 (0.0008) [2023-12-26 06:00:15,735][123090] Updated weights for policy 1, policy_version 797881 (0.0009) [2023-12-26 06:00:16,345][123091] Updated weights for policy 0, policy_version 803350 (0.0009) [2023-12-26 06:00:16,407][123091] Updated weights for policy 0, policy_version 803360 (0.0009) [2023-12-26 06:00:16,462][123091] Updated weights for policy 0, policy_version 803370 (0.0010) [2023-12-26 06:00:16,567][123090] Updated weights for policy 1, policy_version 797891 (0.0009) [2023-12-26 06:00:16,625][123090] Updated weights for policy 1, policy_version 797901 (0.0005) [2023-12-26 06:00:16,698][123090] Updated weights for policy 1, policy_version 797911 (0.0005) [2023-12-26 06:00:17,334][123091] Updated weights for policy 0, policy_version 803380 (0.0009) [2023-12-26 06:00:17,384][123091] Updated weights for policy 0, policy_version 803390 (0.0010) [2023-12-26 06:00:17,436][123090] Updated weights for policy 1, policy_version 797921 (0.0006) [2023-12-26 06:00:17,436][123091] Updated weights for policy 0, policy_version 803400 (0.0009) [2023-12-26 06:00:17,496][123090] Updated weights for policy 1, policy_version 797931 (0.0010) [2023-12-26 06:00:17,560][123090] Updated weights for policy 1, policy_version 797941 (0.0008) [2023-12-26 06:00:17,627][123090] Updated weights for policy 1, policy_version 797951 (0.0009) [2023-12-26 06:00:18,326][123091] Updated weights for policy 0, policy_version 803410 (0.0008) [2023-12-26 06:00:18,345][123090] Updated weights for policy 1, policy_version 797961 (0.0009) [2023-12-26 06:00:18,392][123091] Updated weights for policy 0, policy_version 803420 (0.0007) [2023-12-26 06:00:18,406][123090] Updated weights for policy 1, policy_version 797971 (0.0011) [2023-12-26 06:00:18,452][123091] Updated weights for policy 0, policy_version 803430 (0.0005) [2023-12-26 06:00:18,463][123090] Updated weights for policy 1, policy_version 797981 (0.0010) [2023-12-26 06:00:18,515][123091] Updated weights for policy 0, policy_version 803440 (0.0007) [2023-12-26 06:00:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 409968640. Throughput: 0: 8784.0, 1: 8855.0. Samples: 409976764. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:18,785][121949] Avg episode reward: [(0, '6035.580'), (1, '5902.263')] [2023-12-26 06:00:19,304][123090] Updated weights for policy 1, policy_version 797991 (0.0008) [2023-12-26 06:00:19,381][123090] Updated weights for policy 1, policy_version 798001 (0.0009) [2023-12-26 06:00:19,407][123091] Updated weights for policy 0, policy_version 803450 (0.0009) [2023-12-26 06:00:19,448][123090] Updated weights for policy 1, policy_version 798011 (0.0007) [2023-12-26 06:00:19,465][123091] Updated weights for policy 0, policy_version 803460 (0.0009) [2023-12-26 06:00:19,532][123091] Updated weights for policy 0, policy_version 803470 (0.0009) [2023-12-26 06:00:20,139][123090] Updated weights for policy 1, policy_version 798021 (0.0007) [2023-12-26 06:00:20,206][123090] Updated weights for policy 1, policy_version 798031 (0.0008) [2023-12-26 06:00:20,280][123090] Updated weights for policy 1, policy_version 798041 (0.0008) [2023-12-26 06:00:20,391][123091] Updated weights for policy 0, policy_version 803480 (0.0009) [2023-12-26 06:00:20,449][123091] Updated weights for policy 0, policy_version 803490 (0.0009) [2023-12-26 06:00:20,502][123091] Updated weights for policy 0, policy_version 803500 (0.0009) [2023-12-26 06:00:21,059][123090] Updated weights for policy 1, policy_version 798051 (0.0008) [2023-12-26 06:00:21,126][123090] Updated weights for policy 1, policy_version 798061 (0.0008) [2023-12-26 06:00:21,195][123090] Updated weights for policy 1, policy_version 798071 (0.0008) [2023-12-26 06:00:21,404][123091] Updated weights for policy 0, policy_version 803510 (0.0009) [2023-12-26 06:00:21,472][123091] Updated weights for policy 0, policy_version 803520 (0.0008) [2023-12-26 06:00:21,542][123091] Updated weights for policy 0, policy_version 803530 (0.0008) [2023-12-26 06:00:22,040][123090] Updated weights for policy 1, policy_version 798081 (0.0008) [2023-12-26 06:00:22,094][123090] Updated weights for policy 1, policy_version 798092 (0.0010) [2023-12-26 06:00:22,145][123090] Updated weights for policy 1, policy_version 798102 (0.0007) [2023-12-26 06:00:22,205][123090] Updated weights for policy 1, policy_version 798112 (0.0007) [2023-12-26 06:00:22,361][123091] Updated weights for policy 0, policy_version 803540 (0.0008) [2023-12-26 06:00:22,431][123091] Updated weights for policy 0, policy_version 803550 (0.0009) [2023-12-26 06:00:22,503][123091] Updated weights for policy 0, policy_version 803560 (0.0008) [2023-12-26 06:00:23,039][123090] Updated weights for policy 1, policy_version 798122 (0.0010) [2023-12-26 06:00:23,110][123090] Updated weights for policy 1, policy_version 798132 (0.0010) [2023-12-26 06:00:23,183][123090] Updated weights for policy 1, policy_version 798142 (0.0009) [2023-12-26 06:00:23,319][123091] Updated weights for policy 0, policy_version 803570 (0.0010) [2023-12-26 06:00:23,370][123091] Updated weights for policy 0, policy_version 803580 (0.0009) [2023-12-26 06:00:23,423][123091] Updated weights for policy 0, policy_version 803590 (0.0010) [2023-12-26 06:00:23,477][123091] Updated weights for policy 0, policy_version 803600 (0.0010) [2023-12-26 06:00:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 410050560. Throughput: 0: 8746.3, 1: 8874.0. Samples: 410027496. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:23,785][121949] Avg episode reward: [(0, '5998.084'), (1, '5905.516')] [2023-12-26 06:00:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000798144_204324864.pth... [2023-12-26 06:00:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000803600_205725696.pth... [2023-12-26 06:00:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000797120_204062720.pth [2023-12-26 06:00:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000802576_205463552.pth [2023-12-26 06:00:23,892][123090] Updated weights for policy 1, policy_version 798152 (0.0006) [2023-12-26 06:00:23,964][123090] Updated weights for policy 1, policy_version 798162 (0.0005) [2023-12-26 06:00:24,034][123090] Updated weights for policy 1, policy_version 798172 (0.0008) [2023-12-26 06:00:24,393][123091] Updated weights for policy 0, policy_version 803611 (0.0010) [2023-12-26 06:00:24,450][123091] Updated weights for policy 0, policy_version 803621 (0.0009) [2023-12-26 06:00:24,514][123091] Updated weights for policy 0, policy_version 803631 (0.0009) [2023-12-26 06:00:24,797][123090] Updated weights for policy 1, policy_version 798182 (0.0010) [2023-12-26 06:00:24,856][123090] Updated weights for policy 1, policy_version 798193 (0.0007) [2023-12-26 06:00:24,912][123090] Updated weights for policy 1, policy_version 798203 (0.0006) [2023-12-26 06:00:25,386][123091] Updated weights for policy 0, policy_version 803641 (0.0010) [2023-12-26 06:00:25,445][123091] Updated weights for policy 0, policy_version 803651 (0.0010) [2023-12-26 06:00:25,497][123091] Updated weights for policy 0, policy_version 803661 (0.0009) [2023-12-26 06:00:25,552][123090] Updated weights for policy 1, policy_version 798213 (0.0005) [2023-12-26 06:00:25,604][123090] Updated weights for policy 1, policy_version 798223 (0.0005) [2023-12-26 06:00:25,649][123090] Updated weights for policy 1, policy_version 798233 (0.0005) [2023-12-26 06:00:26,358][123090] Updated weights for policy 1, policy_version 798243 (0.0008) [2023-12-26 06:00:26,416][123090] Updated weights for policy 1, policy_version 798253 (0.0005) [2023-12-26 06:00:26,446][123091] Updated weights for policy 0, policy_version 803672 (0.0009) [2023-12-26 06:00:26,470][123090] Updated weights for policy 1, policy_version 798263 (0.0006) [2023-12-26 06:00:26,506][123091] Updated weights for policy 0, policy_version 803682 (0.0008) [2023-12-26 06:00:26,560][123091] Updated weights for policy 0, policy_version 803693 (0.0010) [2023-12-26 06:00:27,104][123090] Updated weights for policy 1, policy_version 798273 (0.0006) [2023-12-26 06:00:27,159][123090] Updated weights for policy 1, policy_version 798283 (0.0005) [2023-12-26 06:00:27,204][123090] Updated weights for policy 1, policy_version 798293 (0.0005) [2023-12-26 06:00:27,259][123090] Updated weights for policy 1, policy_version 798303 (0.0010) [2023-12-26 06:00:27,475][123091] Updated weights for policy 0, policy_version 803704 (0.0009) [2023-12-26 06:00:27,524][123091] Updated weights for policy 0, policy_version 803714 (0.0009) [2023-12-26 06:00:27,572][123091] Updated weights for policy 0, policy_version 803724 (0.0009) [2023-12-26 06:00:28,073][123090] Updated weights for policy 1, policy_version 798313 (0.0010) [2023-12-26 06:00:28,125][123090] Updated weights for policy 1, policy_version 798323 (0.0009) [2023-12-26 06:00:28,174][123090] Updated weights for policy 1, policy_version 798333 (0.0009) [2023-12-26 06:00:28,444][123091] Updated weights for policy 0, policy_version 803734 (0.0009) [2023-12-26 06:00:28,513][123091] Updated weights for policy 0, policy_version 803744 (0.0010) [2023-12-26 06:00:28,576][123091] Updated weights for policy 0, policy_version 803754 (0.0009) [2023-12-26 06:00:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 410140672. Throughput: 0: 8716.3, 1: 9001.1. Samples: 410133364. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:28,785][121949] Avg episode reward: [(0, '5928.999'), (1, '5864.822')] [2023-12-26 06:00:28,956][123090] Updated weights for policy 1, policy_version 798343 (0.0009) [2023-12-26 06:00:29,012][123090] Updated weights for policy 1, policy_version 798353 (0.0009) [2023-12-26 06:00:29,064][123090] Updated weights for policy 1, policy_version 798363 (0.0007) [2023-12-26 06:00:29,440][123091] Updated weights for policy 0, policy_version 803764 (0.0009) [2023-12-26 06:00:29,493][123091] Updated weights for policy 0, policy_version 803774 (0.0009) [2023-12-26 06:00:29,556][123091] Updated weights for policy 0, policy_version 803784 (0.0009) [2023-12-26 06:00:29,830][123090] Updated weights for policy 1, policy_version 798373 (0.0008) [2023-12-26 06:00:29,902][123090] Updated weights for policy 1, policy_version 798383 (0.0010) [2023-12-26 06:00:29,968][123090] Updated weights for policy 1, policy_version 798393 (0.0009) [2023-12-26 06:00:30,430][123091] Updated weights for policy 0, policy_version 803794 (0.0009) [2023-12-26 06:00:30,485][123091] Updated weights for policy 0, policy_version 803804 (0.0009) [2023-12-26 06:00:30,535][123091] Updated weights for policy 0, policy_version 803814 (0.0009) [2023-12-26 06:00:30,586][123091] Updated weights for policy 0, policy_version 803824 (0.0010) [2023-12-26 06:00:30,755][123090] Updated weights for policy 1, policy_version 798403 (0.0009) [2023-12-26 06:00:30,819][123090] Updated weights for policy 1, policy_version 798413 (0.0010) [2023-12-26 06:00:30,883][123090] Updated weights for policy 1, policy_version 798423 (0.0010) [2023-12-26 06:00:31,479][123091] Updated weights for policy 0, policy_version 803834 (0.0009) [2023-12-26 06:00:31,541][123091] Updated weights for policy 0, policy_version 803844 (0.0009) [2023-12-26 06:00:31,601][123091] Updated weights for policy 0, policy_version 803854 (0.0009) [2023-12-26 06:00:31,702][123090] Updated weights for policy 1, policy_version 798433 (0.0009) [2023-12-26 06:00:31,765][123090] Updated weights for policy 1, policy_version 798443 (0.0010) [2023-12-26 06:00:31,831][123090] Updated weights for policy 1, policy_version 798453 (0.0009) [2023-12-26 06:00:31,893][123090] Updated weights for policy 1, policy_version 798463 (0.0009) [2023-12-26 06:00:32,490][123091] Updated weights for policy 0, policy_version 803864 (0.0010) [2023-12-26 06:00:32,559][123091] Updated weights for policy 0, policy_version 803874 (0.0010) [2023-12-26 06:00:32,625][123091] Updated weights for policy 0, policy_version 803884 (0.0009) [2023-12-26 06:00:32,702][123090] Updated weights for policy 1, policy_version 798473 (0.0010) [2023-12-26 06:00:32,765][123090] Updated weights for policy 1, policy_version 798483 (0.0009) [2023-12-26 06:00:32,820][123090] Updated weights for policy 1, policy_version 798493 (0.0008) [2023-12-26 06:00:33,384][123091] Updated weights for policy 0, policy_version 803894 (0.0010) [2023-12-26 06:00:33,439][123091] Updated weights for policy 0, policy_version 803904 (0.0010) [2023-12-26 06:00:33,487][123091] Updated weights for policy 0, policy_version 803914 (0.0010) [2023-12-26 06:00:33,695][123090] Updated weights for policy 1, policy_version 798503 (0.0009) [2023-12-26 06:00:33,755][123090] Updated weights for policy 1, policy_version 798513 (0.0009) [2023-12-26 06:00:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 410222592. Throughput: 0: 8616.1, 1: 8888.9. Samples: 410236460. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:33,785][121949] Avg episode reward: [(0, '6167.475'), (1, '5770.167')] [2023-12-26 06:00:33,825][123090] Updated weights for policy 1, policy_version 798523 (0.0009) [2023-12-26 06:00:34,257][123091] Updated weights for policy 0, policy_version 803924 (0.0010) [2023-12-26 06:00:34,315][123091] Updated weights for policy 0, policy_version 803934 (0.0009) [2023-12-26 06:00:34,368][123091] Updated weights for policy 0, policy_version 803944 (0.0008) [2023-12-26 06:00:34,680][123090] Updated weights for policy 1, policy_version 798533 (0.0010) [2023-12-26 06:00:34,749][123090] Updated weights for policy 1, policy_version 798543 (0.0009) [2023-12-26 06:00:34,815][123090] Updated weights for policy 1, policy_version 798553 (0.0009) [2023-12-26 06:00:35,150][123091] Updated weights for policy 0, policy_version 803954 (0.0009) [2023-12-26 06:00:35,198][123091] Updated weights for policy 0, policy_version 803964 (0.0005) [2023-12-26 06:00:35,252][123091] Updated weights for policy 0, policy_version 803974 (0.0005) [2023-12-26 06:00:35,309][123091] Updated weights for policy 0, policy_version 803984 (0.0006) [2023-12-26 06:00:35,700][123090] Updated weights for policy 1, policy_version 798563 (0.0010) [2023-12-26 06:00:35,754][123090] Updated weights for policy 1, policy_version 798573 (0.0010) [2023-12-26 06:00:35,813][123090] Updated weights for policy 1, policy_version 798583 (0.0010) [2023-12-26 06:00:35,962][123091] Updated weights for policy 0, policy_version 803994 (0.0005) [2023-12-26 06:00:36,008][123091] Updated weights for policy 0, policy_version 804004 (0.0005) [2023-12-26 06:00:36,060][123091] Updated weights for policy 0, policy_version 804014 (0.0005) [2023-12-26 06:00:36,717][123090] Updated weights for policy 1, policy_version 798593 (0.0009) [2023-12-26 06:00:36,780][123090] Updated weights for policy 1, policy_version 798603 (0.0011) [2023-12-26 06:00:36,836][123090] Updated weights for policy 1, policy_version 798613 (0.0010) [2023-12-26 06:00:36,851][123091] Updated weights for policy 0, policy_version 804024 (0.0006) [2023-12-26 06:00:36,892][123090] Updated weights for policy 1, policy_version 798623 (0.0010) [2023-12-26 06:00:36,904][123091] Updated weights for policy 0, policy_version 804034 (0.0006) [2023-12-26 06:00:36,963][123091] Updated weights for policy 0, policy_version 804044 (0.0009) [2023-12-26 06:00:37,649][123091] Updated weights for policy 0, policy_version 804054 (0.0007) [2023-12-26 06:00:37,715][123091] Updated weights for policy 0, policy_version 804064 (0.0009) [2023-12-26 06:00:37,754][123090] Updated weights for policy 1, policy_version 798633 (0.0011) [2023-12-26 06:00:37,781][123091] Updated weights for policy 0, policy_version 804074 (0.0009) [2023-12-26 06:00:37,814][123090] Updated weights for policy 1, policy_version 798643 (0.0011) [2023-12-26 06:00:37,893][123090] Updated weights for policy 1, policy_version 798653 (0.0011) [2023-12-26 06:00:38,558][123091] Updated weights for policy 0, policy_version 804084 (0.0008) [2023-12-26 06:00:38,627][123091] Updated weights for policy 0, policy_version 804094 (0.0009) [2023-12-26 06:00:38,683][123091] Updated weights for policy 0, policy_version 804104 (0.0009) [2023-12-26 06:00:38,748][123090] Updated weights for policy 1, policy_version 798663 (0.0011) [2023-12-26 06:00:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 410312704. Throughput: 0: 8659.6, 1: 8879.6. Samples: 410289104. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:38,785][121949] Avg episode reward: [(0, '6067.183'), (1, '5812.379')] [2023-12-26 06:00:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000804112_205856768.pth... [2023-12-26 06:00:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000803120_205602816.pth [2023-12-26 06:00:38,796][123090] Updated weights for policy 1, policy_version 798673 (0.0010) [2023-12-26 06:00:38,848][123090] Updated weights for policy 1, policy_version 798683 (0.0010) [2023-12-26 06:00:38,872][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000798688_204464128.pth... [2023-12-26 06:00:38,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000797632_204193792.pth [2023-12-26 06:00:39,490][123091] Updated weights for policy 0, policy_version 804114 (0.0008) [2023-12-26 06:00:39,541][123091] Updated weights for policy 0, policy_version 804124 (0.0007) [2023-12-26 06:00:39,599][123091] Updated weights for policy 0, policy_version 804134 (0.0006) [2023-12-26 06:00:39,671][123091] Updated weights for policy 0, policy_version 804144 (0.0006) [2023-12-26 06:00:39,694][123090] Updated weights for policy 1, policy_version 798693 (0.0008) [2023-12-26 06:00:39,762][123090] Updated weights for policy 1, policy_version 798703 (0.0006) [2023-12-26 06:00:39,839][123090] Updated weights for policy 1, policy_version 798713 (0.0008) [2023-12-26 06:00:40,507][123091] Updated weights for policy 0, policy_version 804154 (0.0009) [2023-12-26 06:00:40,556][123091] Updated weights for policy 0, policy_version 804164 (0.0009) [2023-12-26 06:00:40,586][123090] Updated weights for policy 1, policy_version 798723 (0.0010) [2023-12-26 06:00:40,618][123091] Updated weights for policy 0, policy_version 804174 (0.0009) [2023-12-26 06:00:40,655][123090] Updated weights for policy 1, policy_version 798733 (0.0008) [2023-12-26 06:00:40,717][123090] Updated weights for policy 1, policy_version 798743 (0.0010) [2023-12-26 06:00:41,368][123091] Updated weights for policy 0, policy_version 804184 (0.0009) [2023-12-26 06:00:41,448][123091] Updated weights for policy 0, policy_version 804194 (0.0007) [2023-12-26 06:00:41,507][123091] Updated weights for policy 0, policy_version 804204 (0.0009) [2023-12-26 06:00:41,583][123090] Updated weights for policy 1, policy_version 798753 (0.0009) [2023-12-26 06:00:41,646][123090] Updated weights for policy 1, policy_version 798763 (0.0008) [2023-12-26 06:00:41,705][123090] Updated weights for policy 1, policy_version 798773 (0.0008) [2023-12-26 06:00:41,780][123090] Updated weights for policy 1, policy_version 798783 (0.0008) [2023-12-26 06:00:42,330][123091] Updated weights for policy 0, policy_version 804214 (0.0010) [2023-12-26 06:00:42,399][123091] Updated weights for policy 0, policy_version 804224 (0.0008) [2023-12-26 06:00:42,458][123091] Updated weights for policy 0, policy_version 804234 (0.0006) [2023-12-26 06:00:42,654][123090] Updated weights for policy 1, policy_version 798793 (0.0008) [2023-12-26 06:00:42,722][123090] Updated weights for policy 1, policy_version 798803 (0.0010) [2023-12-26 06:00:42,777][123090] Updated weights for policy 1, policy_version 798813 (0.0009) [2023-12-26 06:00:43,256][123091] Updated weights for policy 0, policy_version 804244 (0.0007) [2023-12-26 06:00:43,327][123091] Updated weights for policy 0, policy_version 804254 (0.0009) [2023-12-26 06:00:43,397][123091] Updated weights for policy 0, policy_version 804264 (0.0007) [2023-12-26 06:00:43,655][123090] Updated weights for policy 1, policy_version 798823 (0.0009) [2023-12-26 06:00:43,708][123090] Updated weights for policy 1, policy_version 798833 (0.0009) [2023-12-26 06:00:43,776][123090] Updated weights for policy 1, policy_version 798843 (0.0009) [2023-12-26 06:00:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 410394624. Throughput: 0: 8608.6, 1: 8777.1. Samples: 410393652. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:43,785][121949] Avg episode reward: [(0, '5970.794'), (1, '5718.809')] [2023-12-26 06:00:44,119][123091] Updated weights for policy 0, policy_version 804274 (0.0006) [2023-12-26 06:00:44,185][123091] Updated weights for policy 0, policy_version 804284 (0.0005) [2023-12-26 06:00:44,258][123091] Updated weights for policy 0, policy_version 804294 (0.0005) [2023-12-26 06:00:44,326][123091] Updated weights for policy 0, policy_version 804304 (0.0005) [2023-12-26 06:00:44,678][123090] Updated weights for policy 1, policy_version 798853 (0.0010) [2023-12-26 06:00:44,741][123090] Updated weights for policy 1, policy_version 798863 (0.0009) [2023-12-26 06:00:44,813][123090] Updated weights for policy 1, policy_version 798873 (0.0009) [2023-12-26 06:00:44,821][123091] Updated weights for policy 0, policy_version 804314 (0.0007) [2023-12-26 06:00:44,882][123091] Updated weights for policy 0, policy_version 804324 (0.0006) [2023-12-26 06:00:44,940][123091] Updated weights for policy 0, policy_version 804334 (0.0006) [2023-12-26 06:00:45,635][123091] Updated weights for policy 0, policy_version 804344 (0.0007) [2023-12-26 06:00:45,680][123090] Updated weights for policy 1, policy_version 798883 (0.0011) [2023-12-26 06:00:45,696][123091] Updated weights for policy 0, policy_version 804354 (0.0008) [2023-12-26 06:00:45,742][123090] Updated weights for policy 1, policy_version 798893 (0.0010) [2023-12-26 06:00:45,762][123091] Updated weights for policy 0, policy_version 804364 (0.0007) [2023-12-26 06:00:45,801][123090] Updated weights for policy 1, policy_version 798903 (0.0010) [2023-12-26 06:00:46,460][123091] Updated weights for policy 0, policy_version 804374 (0.0005) [2023-12-26 06:00:46,518][123091] Updated weights for policy 0, policy_version 804384 (0.0005) [2023-12-26 06:00:46,574][123091] Updated weights for policy 0, policy_version 804394 (0.0007) [2023-12-26 06:00:46,652][123090] Updated weights for policy 1, policy_version 798913 (0.0010) [2023-12-26 06:00:46,711][123090] Updated weights for policy 1, policy_version 798923 (0.0011) [2023-12-26 06:00:46,786][123090] Updated weights for policy 1, policy_version 798933 (0.0010) [2023-12-26 06:00:46,849][123090] Updated weights for policy 1, policy_version 798943 (0.0010) [2023-12-26 06:00:47,384][123091] Updated weights for policy 0, policy_version 804404 (0.0007) [2023-12-26 06:00:47,438][123091] Updated weights for policy 0, policy_version 804414 (0.0009) [2023-12-26 06:00:47,489][123091] Updated weights for policy 0, policy_version 804424 (0.0010) [2023-12-26 06:00:47,659][123090] Updated weights for policy 1, policy_version 798953 (0.0010) [2023-12-26 06:00:47,710][123090] Updated weights for policy 1, policy_version 798963 (0.0010) [2023-12-26 06:00:47,767][123090] Updated weights for policy 1, policy_version 798973 (0.0010) [2023-12-26 06:00:48,259][123091] Updated weights for policy 0, policy_version 804434 (0.0009) [2023-12-26 06:00:48,312][123091] Updated weights for policy 0, policy_version 804444 (0.0010) [2023-12-26 06:00:48,366][123091] Updated weights for policy 0, policy_version 804454 (0.0010) [2023-12-26 06:00:48,418][123091] Updated weights for policy 0, policy_version 804464 (0.0011) [2023-12-26 06:00:48,622][123090] Updated weights for policy 1, policy_version 798983 (0.0010) [2023-12-26 06:00:48,670][123090] Updated weights for policy 1, policy_version 798993 (0.0010) [2023-12-26 06:00:48,729][123090] Updated weights for policy 1, policy_version 799003 (0.0010) [2023-12-26 06:00:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 410492928. Throughput: 0: 8706.2, 1: 8783.4. Samples: 410500224. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:48,784][121949] Avg episode reward: [(0, '5932.184'), (1, '5735.953')] [2023-12-26 06:00:49,273][123091] Updated weights for policy 0, policy_version 804474 (0.0011) [2023-12-26 06:00:49,329][123091] Updated weights for policy 0, policy_version 804484 (0.0011) [2023-12-26 06:00:49,397][123091] Updated weights for policy 0, policy_version 804494 (0.0011) [2023-12-26 06:00:49,560][123090] Updated weights for policy 1, policy_version 799013 (0.0010) [2023-12-26 06:00:49,625][123090] Updated weights for policy 1, policy_version 799023 (0.0008) [2023-12-26 06:00:49,684][123090] Updated weights for policy 1, policy_version 799033 (0.0009) [2023-12-26 06:00:50,230][123091] Updated weights for policy 0, policy_version 804504 (0.0009) [2023-12-26 06:00:50,283][123091] Updated weights for policy 0, policy_version 804514 (0.0009) [2023-12-26 06:00:50,354][123091] Updated weights for policy 0, policy_version 804524 (0.0006) [2023-12-26 06:00:50,452][123090] Updated weights for policy 1, policy_version 799043 (0.0007) [2023-12-26 06:00:50,506][123090] Updated weights for policy 1, policy_version 799053 (0.0009) [2023-12-26 06:00:50,562][123090] Updated weights for policy 1, policy_version 799064 (0.0008) [2023-12-26 06:00:51,151][123091] Updated weights for policy 0, policy_version 804534 (0.0006) [2023-12-26 06:00:51,216][123091] Updated weights for policy 0, policy_version 804544 (0.0005) [2023-12-26 06:00:51,288][123091] Updated weights for policy 0, policy_version 804554 (0.0008) [2023-12-26 06:00:51,300][123090] Updated weights for policy 1, policy_version 799074 (0.0008) [2023-12-26 06:00:51,366][123090] Updated weights for policy 1, policy_version 799084 (0.0008) [2023-12-26 06:00:51,438][123090] Updated weights for policy 1, policy_version 799094 (0.0008) [2023-12-26 06:00:51,508][123090] Updated weights for policy 1, policy_version 799104 (0.0005) [2023-12-26 06:00:52,028][123091] Updated weights for policy 0, policy_version 804564 (0.0008) [2023-12-26 06:00:52,088][123091] Updated weights for policy 0, policy_version 804574 (0.0009) [2023-12-26 06:00:52,148][123091] Updated weights for policy 0, policy_version 804584 (0.0009) [2023-12-26 06:00:52,215][123090] Updated weights for policy 1, policy_version 799114 (0.0010) [2023-12-26 06:00:52,272][123090] Updated weights for policy 1, policy_version 799124 (0.0010) [2023-12-26 06:00:52,331][123090] Updated weights for policy 1, policy_version 799134 (0.0011) [2023-12-26 06:00:52,889][123091] Updated weights for policy 0, policy_version 804594 (0.0007) [2023-12-26 06:00:52,949][123091] Updated weights for policy 0, policy_version 804604 (0.0007) [2023-12-26 06:00:53,010][123091] Updated weights for policy 0, policy_version 804614 (0.0009) [2023-12-26 06:00:53,078][123091] Updated weights for policy 0, policy_version 804624 (0.0009) [2023-12-26 06:00:53,083][123090] Updated weights for policy 1, policy_version 799144 (0.0007) [2023-12-26 06:00:53,141][123090] Updated weights for policy 1, policy_version 799154 (0.0009) [2023-12-26 06:00:53,197][123090] Updated weights for policy 1, policy_version 799164 (0.0010) [2023-12-26 06:00:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 410574848. Throughput: 0: 8671.1, 1: 8791.0. Samples: 410552592. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:53,785][121949] Avg episode reward: [(0, '5971.393'), (1, '5724.042')] [2023-12-26 06:00:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000804624_205987840.pth... [2023-12-26 06:00:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000799168_204587008.pth... [2023-12-26 06:00:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000798144_204324864.pth [2023-12-26 06:00:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000803600_205725696.pth [2023-12-26 06:00:53,843][123090] Updated weights for policy 1, policy_version 799174 (0.0009) [2023-12-26 06:00:53,889][123090] Updated weights for policy 1, policy_version 799184 (0.0007) [2023-12-26 06:00:53,892][123091] Updated weights for policy 0, policy_version 804634 (0.0006) [2023-12-26 06:00:53,936][123090] Updated weights for policy 1, policy_version 799194 (0.0005) [2023-12-26 06:00:53,946][123091] Updated weights for policy 0, policy_version 804644 (0.0005) [2023-12-26 06:00:53,997][123091] Updated weights for policy 0, policy_version 804654 (0.0005) [2023-12-26 06:00:54,632][123090] Updated weights for policy 1, policy_version 799204 (0.0005) [2023-12-26 06:00:54,695][123090] Updated weights for policy 1, policy_version 799214 (0.0005) [2023-12-26 06:00:54,721][123091] Updated weights for policy 0, policy_version 804664 (0.0008) [2023-12-26 06:00:54,744][123090] Updated weights for policy 1, policy_version 799224 (0.0005) [2023-12-26 06:00:54,778][123091] Updated weights for policy 0, policy_version 804674 (0.0009) [2023-12-26 06:00:54,824][123091] Updated weights for policy 0, policy_version 804684 (0.0008) [2023-12-26 06:00:55,477][123090] Updated weights for policy 1, policy_version 799234 (0.0005) [2023-12-26 06:00:55,530][123090] Updated weights for policy 1, policy_version 799244 (0.0005) [2023-12-26 06:00:55,580][123090] Updated weights for policy 1, policy_version 799254 (0.0006) [2023-12-26 06:00:55,634][123090] Updated weights for policy 1, policy_version 799264 (0.0006) [2023-12-26 06:00:55,639][123091] Updated weights for policy 0, policy_version 804694 (0.0007) [2023-12-26 06:00:55,709][123091] Updated weights for policy 0, policy_version 804704 (0.0007) [2023-12-26 06:00:55,771][123091] Updated weights for policy 0, policy_version 804714 (0.0010) [2023-12-26 06:00:56,395][123090] Updated weights for policy 1, policy_version 799274 (0.0009) [2023-12-26 06:00:56,452][123090] Updated weights for policy 1, policy_version 799284 (0.0008) [2023-12-26 06:00:56,516][123090] Updated weights for policy 1, policy_version 799294 (0.0005) [2023-12-26 06:00:56,598][123091] Updated weights for policy 0, policy_version 804724 (0.0008) [2023-12-26 06:00:56,659][123091] Updated weights for policy 0, policy_version 804734 (0.0006) [2023-12-26 06:00:56,714][123091] Updated weights for policy 0, policy_version 804744 (0.0007) [2023-12-26 06:00:57,332][123090] Updated weights for policy 1, policy_version 799304 (0.0006) [2023-12-26 06:00:57,384][123091] Updated weights for policy 0, policy_version 804754 (0.0007) [2023-12-26 06:00:57,389][123090] Updated weights for policy 1, policy_version 799314 (0.0005) [2023-12-26 06:00:57,435][123091] Updated weights for policy 0, policy_version 804764 (0.0010) [2023-12-26 06:00:57,441][123090] Updated weights for policy 1, policy_version 799324 (0.0005) [2023-12-26 06:00:57,489][123091] Updated weights for policy 0, policy_version 804774 (0.0010) [2023-12-26 06:00:57,548][123091] Updated weights for policy 0, policy_version 804784 (0.0005) [2023-12-26 06:00:58,023][123090] Updated weights for policy 1, policy_version 799334 (0.0006) [2023-12-26 06:00:58,088][123090] Updated weights for policy 1, policy_version 799344 (0.0007) [2023-12-26 06:00:58,155][123090] Updated weights for policy 1, policy_version 799354 (0.0006) [2023-12-26 06:00:58,295][123091] Updated weights for policy 0, policy_version 804794 (0.0010) [2023-12-26 06:00:58,368][123091] Updated weights for policy 0, policy_version 804804 (0.0008) [2023-12-26 06:00:58,444][123091] Updated weights for policy 0, policy_version 804814 (0.0010) [2023-12-26 06:00:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 410673152. Throughput: 0: 8735.7, 1: 8948.2. Samples: 410665948. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:00:58,785][121949] Avg episode reward: [(0, '5898.941'), (1, '5724.014')] [2023-12-26 06:00:59,044][123090] Updated weights for policy 1, policy_version 799364 (0.0007) [2023-12-26 06:00:59,118][123090] Updated weights for policy 1, policy_version 799374 (0.0007) [2023-12-26 06:00:59,181][123090] Updated weights for policy 1, policy_version 799384 (0.0009) [2023-12-26 06:00:59,377][123091] Updated weights for policy 0, policy_version 804824 (0.0010) [2023-12-26 06:00:59,446][123091] Updated weights for policy 0, policy_version 804834 (0.0009) [2023-12-26 06:00:59,508][123091] Updated weights for policy 0, policy_version 804844 (0.0008) [2023-12-26 06:00:59,969][123090] Updated weights for policy 1, policy_version 799394 (0.0009) [2023-12-26 06:01:00,034][123090] Updated weights for policy 1, policy_version 799404 (0.0010) [2023-12-26 06:01:00,091][123090] Updated weights for policy 1, policy_version 799414 (0.0009) [2023-12-26 06:01:00,147][123090] Updated weights for policy 1, policy_version 799424 (0.0009) [2023-12-26 06:01:00,323][123091] Updated weights for policy 0, policy_version 804854 (0.0007) [2023-12-26 06:01:00,382][123091] Updated weights for policy 0, policy_version 804864 (0.0006) [2023-12-26 06:01:00,428][123091] Updated weights for policy 0, policy_version 804874 (0.0009) [2023-12-26 06:01:01,028][123090] Updated weights for policy 1, policy_version 799434 (0.0006) [2023-12-26 06:01:01,097][123090] Updated weights for policy 1, policy_version 799444 (0.0007) [2023-12-26 06:01:01,168][123090] Updated weights for policy 1, policy_version 799454 (0.0008) [2023-12-26 06:01:01,247][123091] Updated weights for policy 0, policy_version 804884 (0.0009) [2023-12-26 06:01:01,307][123091] Updated weights for policy 0, policy_version 804894 (0.0009) [2023-12-26 06:01:01,377][123091] Updated weights for policy 0, policy_version 804904 (0.0009) [2023-12-26 06:01:01,911][123090] Updated weights for policy 1, policy_version 799464 (0.0006) [2023-12-26 06:01:01,975][123090] Updated weights for policy 1, policy_version 799474 (0.0005) [2023-12-26 06:01:02,032][123090] Updated weights for policy 1, policy_version 799484 (0.0006) [2023-12-26 06:01:02,200][123091] Updated weights for policy 0, policy_version 804914 (0.0009) [2023-12-26 06:01:02,254][123091] Updated weights for policy 0, policy_version 804924 (0.0009) [2023-12-26 06:01:02,322][123091] Updated weights for policy 0, policy_version 804934 (0.0009) [2023-12-26 06:01:02,386][123091] Updated weights for policy 0, policy_version 804944 (0.0009) [2023-12-26 06:01:02,644][123090] Updated weights for policy 1, policy_version 799494 (0.0006) [2023-12-26 06:01:02,700][123090] Updated weights for policy 1, policy_version 799504 (0.0006) [2023-12-26 06:01:02,755][123090] Updated weights for policy 1, policy_version 799514 (0.0010) [2023-12-26 06:01:03,206][123091] Updated weights for policy 0, policy_version 804954 (0.0006) [2023-12-26 06:01:03,264][123091] Updated weights for policy 0, policy_version 804964 (0.0009) [2023-12-26 06:01:03,330][123091] Updated weights for policy 0, policy_version 804974 (0.0010) [2023-12-26 06:01:03,563][123090] Updated weights for policy 1, policy_version 799524 (0.0008) [2023-12-26 06:01:03,632][123090] Updated weights for policy 1, policy_version 799534 (0.0007) [2023-12-26 06:01:03,704][123090] Updated weights for policy 1, policy_version 799544 (0.0005) [2023-12-26 06:01:03,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 410763264. Throughput: 0: 8770.0, 1: 8869.3. Samples: 410770528. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:01:03,784][121949] Avg episode reward: [(0, '5913.848'), (1, '5801.874')] [2023-12-26 06:01:04,239][123091] Updated weights for policy 0, policy_version 804984 (0.0009) [2023-12-26 06:01:04,299][123091] Updated weights for policy 0, policy_version 804994 (0.0008) [2023-12-26 06:01:04,368][123091] Updated weights for policy 0, policy_version 805004 (0.0007) [2023-12-26 06:01:04,471][123090] Updated weights for policy 1, policy_version 799554 (0.0007) [2023-12-26 06:01:04,533][123090] Updated weights for policy 1, policy_version 799564 (0.0011) [2023-12-26 06:01:04,599][123090] Updated weights for policy 1, policy_version 799574 (0.0011) [2023-12-26 06:01:04,669][123090] Updated weights for policy 1, policy_version 799584 (0.0011) [2023-12-26 06:01:05,212][123091] Updated weights for policy 0, policy_version 805014 (0.0007) [2023-12-26 06:01:05,274][123091] Updated weights for policy 0, policy_version 805024 (0.0010) [2023-12-26 06:01:05,338][123091] Updated weights for policy 0, policy_version 805034 (0.0009) [2023-12-26 06:01:05,502][123090] Updated weights for policy 1, policy_version 799594 (0.0011) [2023-12-26 06:01:05,567][123090] Updated weights for policy 1, policy_version 799604 (0.0010) [2023-12-26 06:01:05,629][123090] Updated weights for policy 1, policy_version 799614 (0.0010) [2023-12-26 06:01:06,144][123091] Updated weights for policy 0, policy_version 805044 (0.0009) [2023-12-26 06:01:06,205][123091] Updated weights for policy 0, policy_version 805054 (0.0007) [2023-12-26 06:01:06,269][123091] Updated weights for policy 0, policy_version 805064 (0.0011) [2023-12-26 06:01:06,445][123090] Updated weights for policy 1, policy_version 799624 (0.0011) [2023-12-26 06:01:06,510][123090] Updated weights for policy 1, policy_version 799634 (0.0011) [2023-12-26 06:01:06,583][123090] Updated weights for policy 1, policy_version 799644 (0.0007) [2023-12-26 06:01:07,090][123091] Updated weights for policy 0, policy_version 805074 (0.0010) [2023-12-26 06:01:07,139][123091] Updated weights for policy 0, policy_version 805084 (0.0005) [2023-12-26 06:01:07,186][123091] Updated weights for policy 0, policy_version 805094 (0.0005) [2023-12-26 06:01:07,254][123091] Updated weights for policy 0, policy_version 805104 (0.0005) [2023-12-26 06:01:07,337][123090] Updated weights for policy 1, policy_version 799654 (0.0009) [2023-12-26 06:01:07,396][123090] Updated weights for policy 1, policy_version 799664 (0.0010) [2023-12-26 06:01:07,461][123090] Updated weights for policy 1, policy_version 799674 (0.0011) [2023-12-26 06:01:07,968][123091] Updated weights for policy 0, policy_version 805114 (0.0006) [2023-12-26 06:01:08,030][123091] Updated weights for policy 0, policy_version 805124 (0.0006) [2023-12-26 06:01:08,084][123091] Updated weights for policy 0, policy_version 805134 (0.0006) [2023-12-26 06:01:08,241][123090] Updated weights for policy 1, policy_version 799684 (0.0010) [2023-12-26 06:01:08,308][123090] Updated weights for policy 1, policy_version 799694 (0.0010) [2023-12-26 06:01:08,378][123090] Updated weights for policy 1, policy_version 799704 (0.0009) [2023-12-26 06:01:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 410845184. Throughput: 0: 8798.4, 1: 8845.6. Samples: 410821476. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:01:08,785][121949] Avg episode reward: [(0, '5782.757'), (1, '5728.288')] [2023-12-26 06:01:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000805136_206118912.pth... [2023-12-26 06:01:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000799712_204726272.pth... [2023-12-26 06:01:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000798688_204464128.pth [2023-12-26 06:01:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000804112_205856768.pth [2023-12-26 06:01:08,893][123091] Updated weights for policy 0, policy_version 805144 (0.0009) [2023-12-26 06:01:08,950][123091] Updated weights for policy 0, policy_version 805154 (0.0009) [2023-12-26 06:01:09,011][123091] Updated weights for policy 0, policy_version 805164 (0.0009) [2023-12-26 06:01:09,218][123090] Updated weights for policy 1, policy_version 799714 (0.0007) [2023-12-26 06:01:09,291][123090] Updated weights for policy 1, policy_version 799724 (0.0007) [2023-12-26 06:01:09,362][123090] Updated weights for policy 1, policy_version 799734 (0.0008) [2023-12-26 06:01:09,431][123090] Updated weights for policy 1, policy_version 799744 (0.0009) [2023-12-26 06:01:09,877][123091] Updated weights for policy 0, policy_version 805174 (0.0009) [2023-12-26 06:01:09,943][123091] Updated weights for policy 0, policy_version 805184 (0.0008) [2023-12-26 06:01:10,016][123091] Updated weights for policy 0, policy_version 805194 (0.0007) [2023-12-26 06:01:10,336][123090] Updated weights for policy 1, policy_version 799754 (0.0011) [2023-12-26 06:01:10,403][123090] Updated weights for policy 1, policy_version 799764 (0.0011) [2023-12-26 06:01:10,467][123090] Updated weights for policy 1, policy_version 799774 (0.0011) [2023-12-26 06:01:10,851][123091] Updated weights for policy 0, policy_version 805204 (0.0009) [2023-12-26 06:01:10,916][123091] Updated weights for policy 0, policy_version 805214 (0.0009) [2023-12-26 06:01:10,981][123091] Updated weights for policy 0, policy_version 805224 (0.0010) [2023-12-26 06:01:11,315][123090] Updated weights for policy 1, policy_version 799784 (0.0009) [2023-12-26 06:01:11,385][123090] Updated weights for policy 1, policy_version 799794 (0.0009) [2023-12-26 06:01:11,442][123090] Updated weights for policy 1, policy_version 799804 (0.0010) [2023-12-26 06:01:11,820][123091] Updated weights for policy 0, policy_version 805234 (0.0009) [2023-12-26 06:01:11,876][123091] Updated weights for policy 0, policy_version 805244 (0.0009) [2023-12-26 06:01:11,936][123091] Updated weights for policy 0, policy_version 805254 (0.0009) [2023-12-26 06:01:12,006][123091] Updated weights for policy 0, policy_version 805264 (0.0009) [2023-12-26 06:01:12,373][123090] Updated weights for policy 1, policy_version 799814 (0.0010) [2023-12-26 06:01:12,447][123090] Updated weights for policy 1, policy_version 799824 (0.0010) [2023-12-26 06:01:12,519][123090] Updated weights for policy 1, policy_version 799834 (0.0010) [2023-12-26 06:01:12,855][123091] Updated weights for policy 0, policy_version 805274 (0.0010) [2023-12-26 06:01:12,920][123091] Updated weights for policy 0, policy_version 805284 (0.0008) [2023-12-26 06:01:12,977][123091] Updated weights for policy 0, policy_version 805294 (0.0009) [2023-12-26 06:01:13,364][123090] Updated weights for policy 1, policy_version 799844 (0.0009) [2023-12-26 06:01:13,425][123090] Updated weights for policy 1, policy_version 799854 (0.0009) [2023-12-26 06:01:13,482][123090] Updated weights for policy 1, policy_version 799864 (0.0009) [2023-12-26 06:01:13,743][123091] Updated weights for policy 0, policy_version 805304 (0.0009) [2023-12-26 06:01:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 410927104. Throughput: 0: 8868.6, 1: 8677.1. Samples: 410922920. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:01:13,784][121949] Avg episode reward: [(0, '5869.371'), (1, '5769.022')] [2023-12-26 06:01:13,804][123091] Updated weights for policy 0, policy_version 805314 (0.0010) [2023-12-26 06:01:13,871][123091] Updated weights for policy 0, policy_version 805324 (0.0010) [2023-12-26 06:01:14,329][123090] Updated weights for policy 1, policy_version 799874 (0.0009) [2023-12-26 06:01:14,398][123090] Updated weights for policy 1, policy_version 799884 (0.0005) [2023-12-26 06:01:14,472][123090] Updated weights for policy 1, policy_version 799894 (0.0008) [2023-12-26 06:01:14,540][123090] Updated weights for policy 1, policy_version 799904 (0.0010) [2023-12-26 06:01:14,738][123091] Updated weights for policy 0, policy_version 805334 (0.0008) [2023-12-26 06:01:14,811][123091] Updated weights for policy 0, policy_version 805344 (0.0008) [2023-12-26 06:01:14,867][123091] Updated weights for policy 0, policy_version 805354 (0.0010) [2023-12-26 06:01:15,409][123090] Updated weights for policy 1, policy_version 799914 (0.0009) [2023-12-26 06:01:15,471][123090] Updated weights for policy 1, policy_version 799924 (0.0008) [2023-12-26 06:01:15,540][123090] Updated weights for policy 1, policy_version 799934 (0.0009) [2023-12-26 06:01:15,611][123091] Updated weights for policy 0, policy_version 805364 (0.0008) [2023-12-26 06:01:15,680][123091] Updated weights for policy 0, policy_version 805374 (0.0008) [2023-12-26 06:01:15,743][123091] Updated weights for policy 0, policy_version 805384 (0.0008) [2023-12-26 06:01:16,388][123090] Updated weights for policy 1, policy_version 799944 (0.0008) [2023-12-26 06:01:16,461][123090] Updated weights for policy 1, policy_version 799954 (0.0010) [2023-12-26 06:01:16,530][123090] Updated weights for policy 1, policy_version 799964 (0.0009) [2023-12-26 06:01:16,536][123091] Updated weights for policy 0, policy_version 805394 (0.0006) [2023-12-26 06:01:16,605][123091] Updated weights for policy 0, policy_version 805404 (0.0007) [2023-12-26 06:01:16,664][123091] Updated weights for policy 0, policy_version 805414 (0.0006) [2023-12-26 06:01:16,718][123091] Updated weights for policy 0, policy_version 805424 (0.0006) [2023-12-26 06:01:17,365][123090] Updated weights for policy 1, policy_version 799974 (0.0010) [2023-12-26 06:01:17,409][123090] Updated weights for policy 1, policy_version 799984 (0.0010) [2023-12-26 06:01:17,456][123090] Updated weights for policy 1, policy_version 799994 (0.0010) [2023-12-26 06:01:17,487][123091] Updated weights for policy 0, policy_version 805434 (0.0010) [2023-12-26 06:01:17,550][123091] Updated weights for policy 0, policy_version 805444 (0.0010) [2023-12-26 06:01:17,613][123091] Updated weights for policy 0, policy_version 805454 (0.0011) [2023-12-26 06:01:18,203][123090] Updated weights for policy 1, policy_version 800004 (0.0008) [2023-12-26 06:01:18,261][123090] Updated weights for policy 1, policy_version 800014 (0.0005) [2023-12-26 06:01:18,316][123090] Updated weights for policy 1, policy_version 800024 (0.0005) [2023-12-26 06:01:18,317][123091] Updated weights for policy 0, policy_version 805464 (0.0008) [2023-12-26 06:01:18,375][123091] Updated weights for policy 0, policy_version 805474 (0.0007) [2023-12-26 06:01:18,422][123091] Updated weights for policy 0, policy_version 805484 (0.0006) [2023-12-26 06:01:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 411017216. Throughput: 0: 8948.4, 1: 8641.0. Samples: 411027980. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:01:18,784][121949] Avg episode reward: [(0, '5905.328'), (1, '5802.669')] [2023-12-26 06:01:19,066][123091] Updated weights for policy 0, policy_version 805494 (0.0005) [2023-12-26 06:01:19,130][123091] Updated weights for policy 0, policy_version 805504 (0.0005) [2023-12-26 06:01:19,157][123090] Updated weights for policy 1, policy_version 800034 (0.0009) [2023-12-26 06:01:19,179][123091] Updated weights for policy 0, policy_version 805514 (0.0005) [2023-12-26 06:01:19,212][123090] Updated weights for policy 1, policy_version 800044 (0.0010) [2023-12-26 06:01:19,280][123090] Updated weights for policy 1, policy_version 800054 (0.0008) [2023-12-26 06:01:19,355][123090] Updated weights for policy 1, policy_version 800064 (0.0010) [2023-12-26 06:01:19,965][123091] Updated weights for policy 0, policy_version 805524 (0.0008) [2023-12-26 06:01:20,024][123091] Updated weights for policy 0, policy_version 805534 (0.0009) [2023-12-26 06:01:20,086][123091] Updated weights for policy 0, policy_version 805544 (0.0010) [2023-12-26 06:01:20,176][123090] Updated weights for policy 1, policy_version 800074 (0.0009) [2023-12-26 06:01:20,231][123090] Updated weights for policy 1, policy_version 800084 (0.0010) [2023-12-26 06:01:20,293][123090] Updated weights for policy 1, policy_version 800094 (0.0008) [2023-12-26 06:01:20,860][123091] Updated weights for policy 0, policy_version 805554 (0.0010) [2023-12-26 06:01:20,927][123091] Updated weights for policy 0, policy_version 805564 (0.0009) [2023-12-26 06:01:20,993][123091] Updated weights for policy 0, policy_version 805574 (0.0010) [2023-12-26 06:01:21,061][123091] Updated weights for policy 0, policy_version 805584 (0.0009) [2023-12-26 06:01:21,085][123090] Updated weights for policy 1, policy_version 800104 (0.0009) [2023-12-26 06:01:21,150][123090] Updated weights for policy 1, policy_version 800114 (0.0010) [2023-12-26 06:01:21,228][123090] Updated weights for policy 1, policy_version 800124 (0.0007) [2023-12-26 06:01:21,928][123091] Updated weights for policy 0, policy_version 805594 (0.0005) [2023-12-26 06:01:21,985][123091] Updated weights for policy 0, policy_version 805604 (0.0005) [2023-12-26 06:01:22,056][123091] Updated weights for policy 0, policy_version 805614 (0.0008) [2023-12-26 06:01:22,060][123090] Updated weights for policy 1, policy_version 800134 (0.0008) [2023-12-26 06:01:22,118][123090] Updated weights for policy 1, policy_version 800144 (0.0006) [2023-12-26 06:01:22,193][123090] Updated weights for policy 1, policy_version 800154 (0.0007) [2023-12-26 06:01:22,833][123091] Updated weights for policy 0, policy_version 805624 (0.0010) [2023-12-26 06:01:22,884][123091] Updated weights for policy 0, policy_version 805634 (0.0008) [2023-12-26 06:01:22,943][123091] Updated weights for policy 0, policy_version 805644 (0.0005) [2023-12-26 06:01:22,991][123090] Updated weights for policy 1, policy_version 800164 (0.0008) [2023-12-26 06:01:23,039][123090] Updated weights for policy 1, policy_version 800174 (0.0005) [2023-12-26 06:01:23,099][123090] Updated weights for policy 1, policy_version 800184 (0.0005) [2023-12-26 06:01:23,766][123091] Updated weights for policy 0, policy_version 805654 (0.0008) [2023-12-26 06:01:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 411099136. Throughput: 0: 8906.5, 1: 8680.6. Samples: 411080524. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 06:01:23,785][121949] Avg episode reward: [(0, '5828.964'), (1, '5768.636')] [2023-12-26 06:01:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000800192_204849152.pth... [2023-12-26 06:01:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000799168_204587008.pth [2023-12-26 06:01:23,818][123091] Updated weights for policy 0, policy_version 805665 (0.0009) [2023-12-26 06:01:23,862][123090] Updated weights for policy 1, policy_version 800194 (0.0005) [2023-12-26 06:01:23,870][123091] Updated weights for policy 0, policy_version 805676 (0.0009) [2023-12-26 06:01:23,892][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000805680_206258176.pth... [2023-12-26 06:01:23,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000804624_205987840.pth [2023-12-26 06:01:23,912][123090] Updated weights for policy 1, policy_version 800204 (0.0006) [2023-12-26 06:01:23,971][123090] Updated weights for policy 1, policy_version 800214 (0.0005) [2023-12-26 06:01:24,038][123090] Updated weights for policy 1, policy_version 800224 (0.0008) [2023-12-26 06:01:24,668][123091] Updated weights for policy 0, policy_version 805686 (0.0010) [2023-12-26 06:01:24,721][123091] Updated weights for policy 0, policy_version 805696 (0.0010) [2023-12-26 06:01:24,781][123091] Updated weights for policy 0, policy_version 805706 (0.0011) [2023-12-26 06:01:24,873][123090] Updated weights for policy 1, policy_version 800234 (0.0009) [2023-12-26 06:01:24,928][123090] Updated weights for policy 1, policy_version 800244 (0.0009) [2023-12-26 06:01:24,977][123090] Updated weights for policy 1, policy_version 800254 (0.0009) [2023-12-26 06:01:25,537][123091] Updated weights for policy 0, policy_version 805716 (0.0008) [2023-12-26 06:01:25,588][123091] Updated weights for policy 0, policy_version 805726 (0.0005) [2023-12-26 06:01:25,639][123091] Updated weights for policy 0, policy_version 805736 (0.0005) [2023-12-26 06:01:25,741][123090] Updated weights for policy 1, policy_version 800264 (0.0011) [2023-12-26 06:01:25,796][123090] Updated weights for policy 1, policy_version 800274 (0.0010) [2023-12-26 06:01:25,851][123090] Updated weights for policy 1, policy_version 800284 (0.0010) [2023-12-26 06:01:26,326][123091] Updated weights for policy 0, policy_version 805746 (0.0005) [2023-12-26 06:01:26,384][123091] Updated weights for policy 0, policy_version 805756 (0.0005) [2023-12-26 06:01:26,442][123091] Updated weights for policy 0, policy_version 805766 (0.0005) [2023-12-26 06:01:26,488][123091] Updated weights for policy 0, policy_version 805776 (0.0005) [2023-12-26 06:01:26,525][123090] Updated weights for policy 1, policy_version 800294 (0.0007) [2023-12-26 06:01:26,571][123090] Updated weights for policy 1, policy_version 800304 (0.0005) [2023-12-26 06:01:26,621][123090] Updated weights for policy 1, policy_version 800314 (0.0005) [2023-12-26 06:01:27,169][123091] Updated weights for policy 0, policy_version 805786 (0.0006) [2023-12-26 06:01:27,202][123090] Updated weights for policy 1, policy_version 800324 (0.0005) [2023-12-26 06:01:27,241][123091] Updated weights for policy 0, policy_version 805796 (0.0005) [2023-12-26 06:01:27,265][123090] Updated weights for policy 1, policy_version 800334 (0.0006) [2023-12-26 06:01:27,308][123091] Updated weights for policy 0, policy_version 805806 (0.0006) [2023-12-26 06:01:27,334][123090] Updated weights for policy 1, policy_version 800344 (0.0006) [2023-12-26 06:01:28,036][123090] Updated weights for policy 1, policy_version 800354 (0.0005) [2023-12-26 06:01:28,045][123091] Updated weights for policy 0, policy_version 805816 (0.0009) [2023-12-26 06:01:28,103][123091] Updated weights for policy 0, policy_version 805826 (0.0008) [2023-12-26 06:01:28,104][123090] Updated weights for policy 1, policy_version 800364 (0.0006) [2023-12-26 06:01:28,155][123091] Updated weights for policy 0, policy_version 805836 (0.0008) [2023-12-26 06:01:28,172][123090] Updated weights for policy 1, policy_version 800374 (0.0005) [2023-12-26 06:01:28,239][123090] Updated weights for policy 1, policy_version 800384 (0.0005) [2023-12-26 06:01:28,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 411197440. Throughput: 0: 8971.6, 1: 8805.7. Samples: 411193632. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:28,785][121949] Avg episode reward: [(0, '5798.706'), (1, '5892.126')] [2023-12-26 06:01:28,936][123091] Updated weights for policy 0, policy_version 805846 (0.0007) [2023-12-26 06:01:28,936][123090] Updated weights for policy 1, policy_version 800394 (0.0010) [2023-12-26 06:01:28,991][123091] Updated weights for policy 0, policy_version 805856 (0.0010) [2023-12-26 06:01:28,994][123090] Updated weights for policy 1, policy_version 800404 (0.0008) [2023-12-26 06:01:29,040][123091] Updated weights for policy 0, policy_version 805866 (0.0008) [2023-12-26 06:01:29,045][123090] Updated weights for policy 1, policy_version 800414 (0.0008) [2023-12-26 06:01:29,761][123091] Updated weights for policy 0, policy_version 805876 (0.0009) [2023-12-26 06:01:29,817][123091] Updated weights for policy 0, policy_version 805886 (0.0010) [2023-12-26 06:01:29,878][123090] Updated weights for policy 1, policy_version 800424 (0.0008) [2023-12-26 06:01:29,880][123091] Updated weights for policy 0, policy_version 805896 (0.0009) [2023-12-26 06:01:29,947][123090] Updated weights for policy 1, policy_version 800434 (0.0008) [2023-12-26 06:01:30,017][123090] Updated weights for policy 1, policy_version 800444 (0.0011) [2023-12-26 06:01:30,730][123091] Updated weights for policy 0, policy_version 805906 (0.0008) [2023-12-26 06:01:30,792][123091] Updated weights for policy 0, policy_version 805916 (0.0005) [2023-12-26 06:01:30,792][123090] Updated weights for policy 1, policy_version 800454 (0.0007) [2023-12-26 06:01:30,839][123090] Updated weights for policy 1, policy_version 800464 (0.0006) [2023-12-26 06:01:30,846][123091] Updated weights for policy 0, policy_version 805926 (0.0006) [2023-12-26 06:01:30,891][123090] Updated weights for policy 1, policy_version 800474 (0.0006) [2023-12-26 06:01:30,929][123091] Updated weights for policy 0, policy_version 805936 (0.0010) [2023-12-26 06:01:31,670][123090] Updated weights for policy 1, policy_version 800484 (0.0006) [2023-12-26 06:01:31,733][123090] Updated weights for policy 1, policy_version 800494 (0.0009) [2023-12-26 06:01:31,769][123091] Updated weights for policy 0, policy_version 805946 (0.0006) [2023-12-26 06:01:31,800][123090] Updated weights for policy 1, policy_version 800504 (0.0007) [2023-12-26 06:01:31,833][123091] Updated weights for policy 0, policy_version 805956 (0.0007) [2023-12-26 06:01:31,903][123091] Updated weights for policy 0, policy_version 805966 (0.0009) [2023-12-26 06:01:32,451][123090] Updated weights for policy 1, policy_version 800514 (0.0008) [2023-12-26 06:01:32,511][123090] Updated weights for policy 1, policy_version 800524 (0.0009) [2023-12-26 06:01:32,558][123090] Updated weights for policy 1, policy_version 800534 (0.0008) [2023-12-26 06:01:32,608][123090] Updated weights for policy 1, policy_version 800544 (0.0009) [2023-12-26 06:01:32,722][123091] Updated weights for policy 0, policy_version 805976 (0.0006) [2023-12-26 06:01:32,780][123091] Updated weights for policy 0, policy_version 805986 (0.0006) [2023-12-26 06:01:32,842][123091] Updated weights for policy 0, policy_version 805996 (0.0009) [2023-12-26 06:01:33,503][123091] Updated weights for policy 0, policy_version 806006 (0.0007) [2023-12-26 06:01:33,507][123090] Updated weights for policy 1, policy_version 800554 (0.0009) [2023-12-26 06:01:33,561][123091] Updated weights for policy 0, policy_version 806016 (0.0005) [2023-12-26 06:01:33,566][123090] Updated weights for policy 1, policy_version 800564 (0.0009) [2023-12-26 06:01:33,616][123091] Updated weights for policy 0, policy_version 806026 (0.0005) [2023-12-26 06:01:33,626][123090] Updated weights for policy 1, policy_version 800574 (0.0008) [2023-12-26 06:01:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 411295744. Throughput: 0: 8893.9, 1: 8923.8. Samples: 411302024. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:33,785][121949] Avg episode reward: [(0, '5810.053'), (1, '5857.332')] [2023-12-26 06:01:34,219][123091] Updated weights for policy 0, policy_version 806036 (0.0005) [2023-12-26 06:01:34,286][123091] Updated weights for policy 0, policy_version 806046 (0.0006) [2023-12-26 06:01:34,353][123091] Updated weights for policy 0, policy_version 806056 (0.0005) [2023-12-26 06:01:34,486][123090] Updated weights for policy 1, policy_version 800584 (0.0010) [2023-12-26 06:01:34,542][123090] Updated weights for policy 1, policy_version 800594 (0.0011) [2023-12-26 06:01:34,606][123090] Updated weights for policy 1, policy_version 800604 (0.0011) [2023-12-26 06:01:35,128][123091] Updated weights for policy 0, policy_version 806066 (0.0007) [2023-12-26 06:01:35,189][123091] Updated weights for policy 0, policy_version 806076 (0.0006) [2023-12-26 06:01:35,261][123091] Updated weights for policy 0, policy_version 806086 (0.0006) [2023-12-26 06:01:35,327][123091] Updated weights for policy 0, policy_version 806096 (0.0007) [2023-12-26 06:01:35,382][123090] Updated weights for policy 1, policy_version 800614 (0.0008) [2023-12-26 06:01:35,447][123090] Updated weights for policy 1, policy_version 800624 (0.0006) [2023-12-26 06:01:35,498][123090] Updated weights for policy 1, policy_version 800634 (0.0005) [2023-12-26 06:01:36,015][123091] Updated weights for policy 0, policy_version 806106 (0.0009) [2023-12-26 06:01:36,078][123091] Updated weights for policy 0, policy_version 806116 (0.0007) [2023-12-26 06:01:36,155][123091] Updated weights for policy 0, policy_version 806126 (0.0011) [2023-12-26 06:01:36,242][123090] Updated weights for policy 1, policy_version 800644 (0.0007) [2023-12-26 06:01:36,290][123090] Updated weights for policy 1, policy_version 800654 (0.0007) [2023-12-26 06:01:36,346][123090] Updated weights for policy 1, policy_version 800664 (0.0006) [2023-12-26 06:01:36,903][123091] Updated weights for policy 0, policy_version 806136 (0.0009) [2023-12-26 06:01:36,953][123091] Updated weights for policy 0, policy_version 806146 (0.0005) [2023-12-26 06:01:37,012][123091] Updated weights for policy 0, policy_version 806156 (0.0007) [2023-12-26 06:01:37,128][123090] Updated weights for policy 1, policy_version 800674 (0.0008) [2023-12-26 06:01:37,199][123090] Updated weights for policy 1, policy_version 800684 (0.0008) [2023-12-26 06:01:37,274][123090] Updated weights for policy 1, policy_version 800694 (0.0005) [2023-12-26 06:01:37,345][123090] Updated weights for policy 1, policy_version 800704 (0.0005) [2023-12-26 06:01:37,797][123091] Updated weights for policy 0, policy_version 806166 (0.0006) [2023-12-26 06:01:37,870][123091] Updated weights for policy 0, policy_version 806176 (0.0006) [2023-12-26 06:01:37,940][123091] Updated weights for policy 0, policy_version 806186 (0.0006) [2023-12-26 06:01:38,011][123090] Updated weights for policy 1, policy_version 800714 (0.0006) [2023-12-26 06:01:38,077][123090] Updated weights for policy 1, policy_version 800724 (0.0005) [2023-12-26 06:01:38,144][123090] Updated weights for policy 1, policy_version 800734 (0.0005) [2023-12-26 06:01:38,578][123091] Updated weights for policy 0, policy_version 806196 (0.0007) [2023-12-26 06:01:38,634][123091] Updated weights for policy 0, policy_version 806206 (0.0006) [2023-12-26 06:01:38,694][123091] Updated weights for policy 0, policy_version 806216 (0.0006) [2023-12-26 06:01:38,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 411385856. Throughput: 0: 8959.6, 1: 8932.2. Samples: 411357716. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:38,784][121949] Avg episode reward: [(0, '6004.272'), (1, '5910.814')] [2023-12-26 06:01:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000806224_206397440.pth... [2023-12-26 06:01:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000805136_206118912.pth [2023-12-26 06:01:38,797][123090] Updated weights for policy 1, policy_version 800744 (0.0006) [2023-12-26 06:01:38,856][123090] Updated weights for policy 1, policy_version 800754 (0.0005) [2023-12-26 06:01:38,916][123090] Updated weights for policy 1, policy_version 800764 (0.0006) [2023-12-26 06:01:38,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000800768_204996608.pth... [2023-12-26 06:01:38,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000799712_204726272.pth [2023-12-26 06:01:39,470][123091] Updated weights for policy 0, policy_version 806226 (0.0007) [2023-12-26 06:01:39,539][123091] Updated weights for policy 0, policy_version 806236 (0.0008) [2023-12-26 06:01:39,601][123091] Updated weights for policy 0, policy_version 806246 (0.0010) [2023-12-26 06:01:39,656][123090] Updated weights for policy 1, policy_version 800774 (0.0007) [2023-12-26 06:01:39,665][123091] Updated weights for policy 0, policy_version 806256 (0.0009) [2023-12-26 06:01:39,716][123090] Updated weights for policy 1, policy_version 800784 (0.0008) [2023-12-26 06:01:39,781][123090] Updated weights for policy 1, policy_version 800794 (0.0007) [2023-12-26 06:01:40,481][123091] Updated weights for policy 0, policy_version 806266 (0.0010) [2023-12-26 06:01:40,548][123091] Updated weights for policy 0, policy_version 806276 (0.0010) [2023-12-26 06:01:40,572][123090] Updated weights for policy 1, policy_version 800804 (0.0008) [2023-12-26 06:01:40,611][123091] Updated weights for policy 0, policy_version 806286 (0.0008) [2023-12-26 06:01:40,636][123090] Updated weights for policy 1, policy_version 800814 (0.0008) [2023-12-26 06:01:40,704][123090] Updated weights for policy 1, policy_version 800824 (0.0009) [2023-12-26 06:01:41,346][123091] Updated weights for policy 0, policy_version 806296 (0.0009) [2023-12-26 06:01:41,412][123091] Updated weights for policy 0, policy_version 806306 (0.0009) [2023-12-26 06:01:41,474][123091] Updated weights for policy 0, policy_version 806316 (0.0010) [2023-12-26 06:01:41,476][123090] Updated weights for policy 1, policy_version 800834 (0.0008) [2023-12-26 06:01:41,532][123090] Updated weights for policy 1, policy_version 800844 (0.0009) [2023-12-26 06:01:41,591][123090] Updated weights for policy 1, policy_version 800854 (0.0008) [2023-12-26 06:01:41,664][123090] Updated weights for policy 1, policy_version 800864 (0.0010) [2023-12-26 06:01:42,312][123091] Updated weights for policy 0, policy_version 806326 (0.0008) [2023-12-26 06:01:42,382][123091] Updated weights for policy 0, policy_version 806336 (0.0007) [2023-12-26 06:01:42,453][123091] Updated weights for policy 0, policy_version 806346 (0.0006) [2023-12-26 06:01:42,555][123090] Updated weights for policy 1, policy_version 800874 (0.0009) [2023-12-26 06:01:42,610][123090] Updated weights for policy 1, policy_version 800884 (0.0008) [2023-12-26 06:01:42,675][123090] Updated weights for policy 1, policy_version 800895 (0.0010) [2023-12-26 06:01:43,153][123091] Updated weights for policy 0, policy_version 806356 (0.0007) [2023-12-26 06:01:43,203][123091] Updated weights for policy 0, policy_version 806366 (0.0009) [2023-12-26 06:01:43,259][123091] Updated weights for policy 0, policy_version 806376 (0.0009) [2023-12-26 06:01:43,542][123090] Updated weights for policy 1, policy_version 800905 (0.0010) [2023-12-26 06:01:43,604][123090] Updated weights for policy 1, policy_version 800915 (0.0010) [2023-12-26 06:01:43,662][123090] Updated weights for policy 1, policy_version 800925 (0.0010) [2023-12-26 06:01:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 411475968. Throughput: 0: 8950.6, 1: 8856.0. Samples: 411467244. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:43,785][121949] Avg episode reward: [(0, '5839.224'), (1, '5945.524')] [2023-12-26 06:01:44,134][123091] Updated weights for policy 0, policy_version 806387 (0.0011) [2023-12-26 06:01:44,201][123091] Updated weights for policy 0, policy_version 806397 (0.0006) [2023-12-26 06:01:44,254][123091] Updated weights for policy 0, policy_version 806407 (0.0005) [2023-12-26 06:01:44,495][123090] Updated weights for policy 1, policy_version 800935 (0.0010) [2023-12-26 06:01:44,555][123090] Updated weights for policy 1, policy_version 800945 (0.0009) [2023-12-26 06:01:44,612][123090] Updated weights for policy 1, policy_version 800955 (0.0009) [2023-12-26 06:01:44,934][123091] Updated weights for policy 0, policy_version 806417 (0.0006) [2023-12-26 06:01:44,990][123091] Updated weights for policy 0, policy_version 806427 (0.0010) [2023-12-26 06:01:45,046][123091] Updated weights for policy 0, policy_version 806437 (0.0009) [2023-12-26 06:01:45,110][123091] Updated weights for policy 0, policy_version 806447 (0.0008) [2023-12-26 06:01:45,489][123090] Updated weights for policy 1, policy_version 800965 (0.0009) [2023-12-26 06:01:45,561][123090] Updated weights for policy 1, policy_version 800975 (0.0010) [2023-12-26 06:01:45,631][123090] Updated weights for policy 1, policy_version 800985 (0.0009) [2023-12-26 06:01:45,969][123091] Updated weights for policy 0, policy_version 806457 (0.0009) [2023-12-26 06:01:46,023][123091] Updated weights for policy 0, policy_version 806467 (0.0009) [2023-12-26 06:01:46,079][123091] Updated weights for policy 0, policy_version 806477 (0.0009) [2023-12-26 06:01:46,514][123090] Updated weights for policy 1, policy_version 800995 (0.0009) [2023-12-26 06:01:46,577][123090] Updated weights for policy 1, policy_version 801005 (0.0010) [2023-12-26 06:01:46,645][123090] Updated weights for policy 1, policy_version 801015 (0.0010) [2023-12-26 06:01:46,754][123091] Updated weights for policy 0, policy_version 806487 (0.0006) [2023-12-26 06:01:46,809][123091] Updated weights for policy 0, policy_version 806497 (0.0006) [2023-12-26 06:01:46,870][123091] Updated weights for policy 0, policy_version 806507 (0.0005) [2023-12-26 06:01:47,473][123090] Updated weights for policy 1, policy_version 801025 (0.0008) [2023-12-26 06:01:47,543][123090] Updated weights for policy 1, policy_version 801035 (0.0011) [2023-12-26 06:01:47,594][123090] Updated weights for policy 1, policy_version 801045 (0.0010) [2023-12-26 06:01:47,639][123090] Updated weights for policy 1, policy_version 801055 (0.0010) [2023-12-26 06:01:47,648][123091] Updated weights for policy 0, policy_version 806517 (0.0010) [2023-12-26 06:01:47,706][123091] Updated weights for policy 0, policy_version 806527 (0.0010) [2023-12-26 06:01:47,765][123091] Updated weights for policy 0, policy_version 806537 (0.0010) [2023-12-26 06:01:48,482][123090] Updated weights for policy 1, policy_version 801065 (0.0006) [2023-12-26 06:01:48,545][123090] Updated weights for policy 1, policy_version 801075 (0.0008) [2023-12-26 06:01:48,606][123091] Updated weights for policy 0, policy_version 806547 (0.0010) [2023-12-26 06:01:48,608][123090] Updated weights for policy 1, policy_version 801085 (0.0008) [2023-12-26 06:01:48,666][123091] Updated weights for policy 0, policy_version 806557 (0.0010) [2023-12-26 06:01:48,731][123091] Updated weights for policy 0, policy_version 806567 (0.0010) [2023-12-26 06:01:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 411557888. Throughput: 0: 9030.9, 1: 8773.9. Samples: 411571744. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:48,785][121949] Avg episode reward: [(0, '5808.953'), (1, '5756.872')] [2023-12-26 06:01:49,358][123090] Updated weights for policy 1, policy_version 801095 (0.0009) [2023-12-26 06:01:49,433][123090] Updated weights for policy 1, policy_version 801105 (0.0011) [2023-12-26 06:01:49,484][123090] Updated weights for policy 1, policy_version 801115 (0.0009) [2023-12-26 06:01:49,528][123091] Updated weights for policy 0, policy_version 806577 (0.0008) [2023-12-26 06:01:49,594][123091] Updated weights for policy 0, policy_version 806587 (0.0010) [2023-12-26 06:01:49,648][123091] Updated weights for policy 0, policy_version 806597 (0.0008) [2023-12-26 06:01:49,700][123091] Updated weights for policy 0, policy_version 806607 (0.0009) [2023-12-26 06:01:50,324][123090] Updated weights for policy 1, policy_version 801125 (0.0009) [2023-12-26 06:01:50,387][123090] Updated weights for policy 1, policy_version 801135 (0.0009) [2023-12-26 06:01:50,443][123090] Updated weights for policy 1, policy_version 801145 (0.0008) [2023-12-26 06:01:50,550][123091] Updated weights for policy 0, policy_version 806617 (0.0009) [2023-12-26 06:01:50,628][123091] Updated weights for policy 0, policy_version 806627 (0.0009) [2023-12-26 06:01:50,692][123091] Updated weights for policy 0, policy_version 806637 (0.0008) [2023-12-26 06:01:51,253][123090] Updated weights for policy 1, policy_version 801155 (0.0009) [2023-12-26 06:01:51,314][123090] Updated weights for policy 1, policy_version 801165 (0.0009) [2023-12-26 06:01:51,381][123090] Updated weights for policy 1, policy_version 801175 (0.0010) [2023-12-26 06:01:51,533][123091] Updated weights for policy 0, policy_version 806647 (0.0010) [2023-12-26 06:01:51,595][123091] Updated weights for policy 0, policy_version 806657 (0.0010) [2023-12-26 06:01:51,664][123091] Updated weights for policy 0, policy_version 806667 (0.0009) [2023-12-26 06:01:52,204][123090] Updated weights for policy 1, policy_version 801185 (0.0006) [2023-12-26 06:01:52,267][123090] Updated weights for policy 1, policy_version 801195 (0.0006) [2023-12-26 06:01:52,336][123090] Updated weights for policy 1, policy_version 801205 (0.0006) [2023-12-26 06:01:52,399][123090] Updated weights for policy 1, policy_version 801215 (0.0007) [2023-12-26 06:01:52,509][123091] Updated weights for policy 0, policy_version 806677 (0.0010) [2023-12-26 06:01:52,556][123091] Updated weights for policy 0, policy_version 806687 (0.0011) [2023-12-26 06:01:52,611][123091] Updated weights for policy 0, policy_version 806697 (0.0011) [2023-12-26 06:01:53,162][123090] Updated weights for policy 1, policy_version 801225 (0.0008) [2023-12-26 06:01:53,213][123090] Updated weights for policy 1, policy_version 801235 (0.0008) [2023-12-26 06:01:53,273][123090] Updated weights for policy 1, policy_version 801245 (0.0005) [2023-12-26 06:01:53,455][123091] Updated weights for policy 0, policy_version 806707 (0.0009) [2023-12-26 06:01:53,508][123091] Updated weights for policy 0, policy_version 806717 (0.0009) [2023-12-26 06:01:53,576][123091] Updated weights for policy 0, policy_version 806727 (0.0010) [2023-12-26 06:01:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.9, 300 sec: 17689.3). Total num frames: 411648000. Throughput: 0: 9022.2, 1: 8781.7. Samples: 411622656. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:53,785][121949] Avg episode reward: [(0, '5883.850'), (1, '5707.327')] [2023-12-26 06:01:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000806736_206528512.pth... [2023-12-26 06:01:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000801248_205119488.pth... [2023-12-26 06:01:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000805680_206258176.pth [2023-12-26 06:01:53,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000800192_204849152.pth [2023-12-26 06:01:53,994][123090] Updated weights for policy 1, policy_version 801255 (0.0005) [2023-12-26 06:01:54,047][123090] Updated weights for policy 1, policy_version 801265 (0.0005) [2023-12-26 06:01:54,098][123090] Updated weights for policy 1, policy_version 801275 (0.0005) [2023-12-26 06:01:54,326][123091] Updated weights for policy 0, policy_version 806737 (0.0009) [2023-12-26 06:01:54,379][123091] Updated weights for policy 0, policy_version 806747 (0.0007) [2023-12-26 06:01:54,425][123091] Updated weights for policy 0, policy_version 806757 (0.0007) [2023-12-26 06:01:54,482][123091] Updated weights for policy 0, policy_version 806767 (0.0007) [2023-12-26 06:01:54,797][123090] Updated weights for policy 1, policy_version 801285 (0.0005) [2023-12-26 06:01:54,855][123090] Updated weights for policy 1, policy_version 801295 (0.0007) [2023-12-26 06:01:54,910][123090] Updated weights for policy 1, policy_version 801305 (0.0006) [2023-12-26 06:01:55,366][123091] Updated weights for policy 0, policy_version 806777 (0.0010) [2023-12-26 06:01:55,425][123091] Updated weights for policy 0, policy_version 806787 (0.0010) [2023-12-26 06:01:55,482][123091] Updated weights for policy 0, policy_version 806797 (0.0010) [2023-12-26 06:01:55,617][123090] Updated weights for policy 1, policy_version 801315 (0.0007) [2023-12-26 06:01:55,678][123090] Updated weights for policy 1, policy_version 801325 (0.0009) [2023-12-26 06:01:55,726][123090] Updated weights for policy 1, policy_version 801335 (0.0009) [2023-12-26 06:01:56,331][123091] Updated weights for policy 0, policy_version 806807 (0.0010) [2023-12-26 06:01:56,383][123091] Updated weights for policy 0, policy_version 806817 (0.0010) [2023-12-26 06:01:56,431][123091] Updated weights for policy 0, policy_version 806827 (0.0010) [2023-12-26 06:01:56,569][123090] Updated weights for policy 1, policy_version 801345 (0.0009) [2023-12-26 06:01:56,617][123090] Updated weights for policy 1, policy_version 801355 (0.0008) [2023-12-26 06:01:56,665][123090] Updated weights for policy 1, policy_version 801365 (0.0009) [2023-12-26 06:01:56,726][123090] Updated weights for policy 1, policy_version 801375 (0.0009) [2023-12-26 06:01:57,231][123091] Updated weights for policy 0, policy_version 806837 (0.0008) [2023-12-26 06:01:57,295][123091] Updated weights for policy 0, policy_version 806847 (0.0006) [2023-12-26 06:01:57,359][123091] Updated weights for policy 0, policy_version 806857 (0.0006) [2023-12-26 06:01:57,639][123090] Updated weights for policy 1, policy_version 801385 (0.0009) [2023-12-26 06:01:57,691][123090] Updated weights for policy 1, policy_version 801395 (0.0010) [2023-12-26 06:01:57,751][123090] Updated weights for policy 1, policy_version 801405 (0.0009) [2023-12-26 06:01:57,929][123091] Updated weights for policy 0, policy_version 806867 (0.0007) [2023-12-26 06:01:57,981][123091] Updated weights for policy 0, policy_version 806877 (0.0009) [2023-12-26 06:01:58,036][123091] Updated weights for policy 0, policy_version 806887 (0.0009) [2023-12-26 06:01:58,657][123090] Updated weights for policy 1, policy_version 801415 (0.0009) [2023-12-26 06:01:58,728][123090] Updated weights for policy 1, policy_version 801425 (0.0010) [2023-12-26 06:01:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 411729920. Throughput: 0: 9055.5, 1: 8892.2. Samples: 411730564. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:01:58,785][121949] Avg episode reward: [(0, '5954.086'), (1, '5546.324')] [2023-12-26 06:01:58,804][123090] Updated weights for policy 1, policy_version 801435 (0.0008) [2023-12-26 06:01:58,989][123091] Updated weights for policy 0, policy_version 806897 (0.0010) [2023-12-26 06:01:59,056][123091] Updated weights for policy 0, policy_version 806907 (0.0006) [2023-12-26 06:01:59,121][123091] Updated weights for policy 0, policy_version 806917 (0.0006) [2023-12-26 06:01:59,181][123091] Updated weights for policy 0, policy_version 806927 (0.0005) [2023-12-26 06:01:59,616][123090] Updated weights for policy 1, policy_version 801445 (0.0007) [2023-12-26 06:01:59,677][123090] Updated weights for policy 1, policy_version 801455 (0.0007) [2023-12-26 06:01:59,731][123090] Updated weights for policy 1, policy_version 801465 (0.0009) [2023-12-26 06:01:59,979][123091] Updated weights for policy 0, policy_version 806937 (0.0009) [2023-12-26 06:02:00,040][123091] Updated weights for policy 0, policy_version 806947 (0.0006) [2023-12-26 06:02:00,110][123091] Updated weights for policy 0, policy_version 806957 (0.0009) [2023-12-26 06:02:00,439][123090] Updated weights for policy 1, policy_version 801475 (0.0007) [2023-12-26 06:02:00,487][123090] Updated weights for policy 1, policy_version 801485 (0.0010) [2023-12-26 06:02:00,541][123090] Updated weights for policy 1, policy_version 801495 (0.0010) [2023-12-26 06:02:00,857][123091] Updated weights for policy 0, policy_version 806967 (0.0007) [2023-12-26 06:02:00,902][123091] Updated weights for policy 0, policy_version 806977 (0.0005) [2023-12-26 06:02:00,957][123091] Updated weights for policy 0, policy_version 806988 (0.0008) [2023-12-26 06:02:01,248][123090] Updated weights for policy 1, policy_version 801505 (0.0005) [2023-12-26 06:02:01,314][123090] Updated weights for policy 1, policy_version 801515 (0.0006) [2023-12-26 06:02:01,379][123090] Updated weights for policy 1, policy_version 801525 (0.0008) [2023-12-26 06:02:01,443][123090] Updated weights for policy 1, policy_version 801535 (0.0006) [2023-12-26 06:02:01,740][123091] Updated weights for policy 0, policy_version 806998 (0.0008) [2023-12-26 06:02:01,806][123091] Updated weights for policy 0, policy_version 807008 (0.0008) [2023-12-26 06:02:01,868][123091] Updated weights for policy 0, policy_version 807018 (0.0008) [2023-12-26 06:02:02,214][123090] Updated weights for policy 1, policy_version 801545 (0.0010) [2023-12-26 06:02:02,277][123090] Updated weights for policy 1, policy_version 801555 (0.0010) [2023-12-26 06:02:02,341][123090] Updated weights for policy 1, policy_version 801565 (0.0011) [2023-12-26 06:02:02,643][123091] Updated weights for policy 0, policy_version 807028 (0.0009) [2023-12-26 06:02:02,712][123091] Updated weights for policy 0, policy_version 807038 (0.0009) [2023-12-26 06:02:02,776][123091] Updated weights for policy 0, policy_version 807048 (0.0009) [2023-12-26 06:02:03,120][123090] Updated weights for policy 1, policy_version 801575 (0.0010) [2023-12-26 06:02:03,176][123090] Updated weights for policy 1, policy_version 801585 (0.0010) [2023-12-26 06:02:03,235][123090] Updated weights for policy 1, policy_version 801595 (0.0010) [2023-12-26 06:02:03,578][123091] Updated weights for policy 0, policy_version 807058 (0.0010) [2023-12-26 06:02:03,638][123091] Updated weights for policy 0, policy_version 807068 (0.0008) [2023-12-26 06:02:03,699][123091] Updated weights for policy 0, policy_version 807078 (0.0009) [2023-12-26 06:02:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 411828224. Throughput: 0: 9033.4, 1: 8956.4. Samples: 411837528. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:03,785][121949] Avg episode reward: [(0, '5947.609'), (1, '5690.694')] [2023-12-26 06:02:03,992][123090] Updated weights for policy 1, policy_version 801605 (0.0011) [2023-12-26 06:02:04,056][123090] Updated weights for policy 1, policy_version 801615 (0.0010) [2023-12-26 06:02:04,119][123090] Updated weights for policy 1, policy_version 801625 (0.0011) [2023-12-26 06:02:04,581][123091] Updated weights for policy 0, policy_version 807089 (0.0010) [2023-12-26 06:02:04,644][123091] Updated weights for policy 0, policy_version 807099 (0.0009) [2023-12-26 06:02:04,692][123091] Updated weights for policy 0, policy_version 807109 (0.0008) [2023-12-26 06:02:04,740][123091] Updated weights for policy 0, policy_version 807119 (0.0009) [2023-12-26 06:02:04,839][123090] Updated weights for policy 1, policy_version 801635 (0.0007) [2023-12-26 06:02:04,898][123090] Updated weights for policy 1, policy_version 801645 (0.0005) [2023-12-26 06:02:04,957][123090] Updated weights for policy 1, policy_version 801655 (0.0005) [2023-12-26 06:02:05,554][123090] Updated weights for policy 1, policy_version 801665 (0.0005) [2023-12-26 06:02:05,592][123091] Updated weights for policy 0, policy_version 807129 (0.0006) [2023-12-26 06:02:05,606][123090] Updated weights for policy 1, policy_version 801675 (0.0005) [2023-12-26 06:02:05,638][123091] Updated weights for policy 0, policy_version 807139 (0.0005) [2023-12-26 06:02:05,651][123090] Updated weights for policy 1, policy_version 801685 (0.0005) [2023-12-26 06:02:05,683][123091] Updated weights for policy 0, policy_version 807149 (0.0005) [2023-12-26 06:02:05,698][123090] Updated weights for policy 1, policy_version 801695 (0.0005) [2023-12-26 06:02:06,391][123090] Updated weights for policy 1, policy_version 801705 (0.0006) [2023-12-26 06:02:06,465][123090] Updated weights for policy 1, policy_version 801715 (0.0006) [2023-12-26 06:02:06,521][123091] Updated weights for policy 0, policy_version 807159 (0.0006) [2023-12-26 06:02:06,539][123090] Updated weights for policy 1, policy_version 801725 (0.0010) [2023-12-26 06:02:06,578][123091] Updated weights for policy 0, policy_version 807169 (0.0009) [2023-12-26 06:02:06,641][123091] Updated weights for policy 0, policy_version 807179 (0.0009) [2023-12-26 06:02:07,316][123090] Updated weights for policy 1, policy_version 801735 (0.0011) [2023-12-26 06:02:07,365][123090] Updated weights for policy 1, policy_version 801745 (0.0010) [2023-12-26 06:02:07,413][123090] Updated weights for policy 1, policy_version 801755 (0.0010) [2023-12-26 06:02:07,484][123091] Updated weights for policy 0, policy_version 807189 (0.0009) [2023-12-26 06:02:07,548][123091] Updated weights for policy 0, policy_version 807200 (0.0009) [2023-12-26 06:02:07,612][123091] Updated weights for policy 0, policy_version 807210 (0.0009) [2023-12-26 06:02:08,277][123090] Updated weights for policy 1, policy_version 801765 (0.0010) [2023-12-26 06:02:08,328][123090] Updated weights for policy 1, policy_version 801775 (0.0010) [2023-12-26 06:02:08,391][123090] Updated weights for policy 1, policy_version 801785 (0.0011) [2023-12-26 06:02:08,478][123091] Updated weights for policy 0, policy_version 807220 (0.0009) [2023-12-26 06:02:08,535][123091] Updated weights for policy 0, policy_version 807230 (0.0009) [2023-12-26 06:02:08,585][123091] Updated weights for policy 0, policy_version 807240 (0.0009) [2023-12-26 06:02:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 411918336. Throughput: 0: 9002.8, 1: 9055.4. Samples: 411893140. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:08,785][121949] Avg episode reward: [(0, '6036.950'), (1, '5911.524')] [2023-12-26 06:02:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000807248_206659584.pth... [2023-12-26 06:02:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000801792_205258752.pth... [2023-12-26 06:02:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000806224_206397440.pth [2023-12-26 06:02:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000800768_204996608.pth [2023-12-26 06:02:09,234][123090] Updated weights for policy 1, policy_version 801795 (0.0011) [2023-12-26 06:02:09,293][123090] Updated weights for policy 1, policy_version 801805 (0.0011) [2023-12-26 06:02:09,368][123090] Updated weights for policy 1, policy_version 801815 (0.0011) [2023-12-26 06:02:09,476][123091] Updated weights for policy 0, policy_version 807250 (0.0008) [2023-12-26 06:02:09,542][123091] Updated weights for policy 0, policy_version 807260 (0.0008) [2023-12-26 06:02:09,611][123091] Updated weights for policy 0, policy_version 807270 (0.0008) [2023-12-26 06:02:09,680][123091] Updated weights for policy 0, policy_version 807280 (0.0009) [2023-12-26 06:02:10,250][123090] Updated weights for policy 1, policy_version 801825 (0.0010) [2023-12-26 06:02:10,305][123090] Updated weights for policy 1, policy_version 801835 (0.0010) [2023-12-26 06:02:10,371][123090] Updated weights for policy 1, policy_version 801845 (0.0011) [2023-12-26 06:02:10,427][123090] Updated weights for policy 1, policy_version 801855 (0.0010) [2023-12-26 06:02:10,497][123091] Updated weights for policy 0, policy_version 807290 (0.0010) [2023-12-26 06:02:10,569][123091] Updated weights for policy 0, policy_version 807300 (0.0010) [2023-12-26 06:02:10,644][123091] Updated weights for policy 0, policy_version 807310 (0.0010) [2023-12-26 06:02:11,202][123090] Updated weights for policy 1, policy_version 801865 (0.0010) [2023-12-26 06:02:11,269][123090] Updated weights for policy 1, policy_version 801875 (0.0011) [2023-12-26 06:02:11,341][123090] Updated weights for policy 1, policy_version 801885 (0.0011) [2023-12-26 06:02:11,541][123091] Updated weights for policy 0, policy_version 807320 (0.0009) [2023-12-26 06:02:11,610][123091] Updated weights for policy 0, policy_version 807330 (0.0009) [2023-12-26 06:02:11,696][123091] Updated weights for policy 0, policy_version 807340 (0.0010) [2023-12-26 06:02:12,161][123090] Updated weights for policy 1, policy_version 801895 (0.0008) [2023-12-26 06:02:12,233][123090] Updated weights for policy 1, policy_version 801905 (0.0009) [2023-12-26 06:02:12,302][123090] Updated weights for policy 1, policy_version 801915 (0.0011) [2023-12-26 06:02:12,593][123091] Updated weights for policy 0, policy_version 807350 (0.0009) [2023-12-26 06:02:12,654][123091] Updated weights for policy 0, policy_version 807360 (0.0009) [2023-12-26 06:02:12,714][123091] Updated weights for policy 0, policy_version 807370 (0.0009) [2023-12-26 06:02:13,099][123090] Updated weights for policy 1, policy_version 801925 (0.0011) [2023-12-26 06:02:13,151][123090] Updated weights for policy 1, policy_version 801935 (0.0010) [2023-12-26 06:02:13,199][123090] Updated weights for policy 1, policy_version 801945 (0.0010) [2023-12-26 06:02:13,443][123091] Updated weights for policy 0, policy_version 807380 (0.0008) [2023-12-26 06:02:13,505][123091] Updated weights for policy 0, policy_version 807390 (0.0006) [2023-12-26 06:02:13,571][123091] Updated weights for policy 0, policy_version 807400 (0.0007) [2023-12-26 06:02:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 412000256. Throughput: 0: 8821.9, 1: 8941.8. Samples: 411992996. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:13,784][121949] Avg episode reward: [(0, '6133.988'), (1, '5781.868')] [2023-12-26 06:02:13,895][123090] Updated weights for policy 1, policy_version 801955 (0.0010) [2023-12-26 06:02:13,947][123090] Updated weights for policy 1, policy_version 801965 (0.0010) [2023-12-26 06:02:14,029][123090] Updated weights for policy 1, policy_version 801975 (0.0007) [2023-12-26 06:02:14,309][123091] Updated weights for policy 0, policy_version 807410 (0.0007) [2023-12-26 06:02:14,368][123091] Updated weights for policy 0, policy_version 807420 (0.0010) [2023-12-26 06:02:14,435][123091] Updated weights for policy 0, policy_version 807430 (0.0006) [2023-12-26 06:02:14,503][123091] Updated weights for policy 0, policy_version 807440 (0.0005) [2023-12-26 06:02:14,785][123090] Updated weights for policy 1, policy_version 801985 (0.0008) [2023-12-26 06:02:14,853][123090] Updated weights for policy 1, policy_version 801995 (0.0010) [2023-12-26 06:02:14,920][123090] Updated weights for policy 1, policy_version 802005 (0.0010) [2023-12-26 06:02:14,984][123090] Updated weights for policy 1, policy_version 802015 (0.0010) [2023-12-26 06:02:15,137][123091] Updated weights for policy 0, policy_version 807450 (0.0009) [2023-12-26 06:02:15,199][123091] Updated weights for policy 0, policy_version 807460 (0.0009) [2023-12-26 06:02:15,256][123091] Updated weights for policy 0, policy_version 807470 (0.0009) [2023-12-26 06:02:15,796][123090] Updated weights for policy 1, policy_version 802025 (0.0010) [2023-12-26 06:02:15,848][123090] Updated weights for policy 1, policy_version 802035 (0.0009) [2023-12-26 06:02:15,902][123090] Updated weights for policy 1, policy_version 802045 (0.0011) [2023-12-26 06:02:15,984][123091] Updated weights for policy 0, policy_version 807480 (0.0009) [2023-12-26 06:02:16,042][123091] Updated weights for policy 0, policy_version 807490 (0.0009) [2023-12-26 06:02:16,091][123091] Updated weights for policy 0, policy_version 807500 (0.0009) [2023-12-26 06:02:16,623][123090] Updated weights for policy 1, policy_version 802055 (0.0009) [2023-12-26 06:02:16,675][123090] Updated weights for policy 1, policy_version 802065 (0.0010) [2023-12-26 06:02:16,722][123090] Updated weights for policy 1, policy_version 802075 (0.0006) [2023-12-26 06:02:16,961][123091] Updated weights for policy 0, policy_version 807510 (0.0010) [2023-12-26 06:02:17,024][123091] Updated weights for policy 0, policy_version 807520 (0.0011) [2023-12-26 06:02:17,088][123091] Updated weights for policy 0, policy_version 807530 (0.0011) [2023-12-26 06:02:17,492][123090] Updated weights for policy 1, policy_version 802085 (0.0008) [2023-12-26 06:02:17,552][123090] Updated weights for policy 1, policy_version 802095 (0.0011) [2023-12-26 06:02:17,612][123090] Updated weights for policy 1, policy_version 802105 (0.0011) [2023-12-26 06:02:17,954][123091] Updated weights for policy 0, policy_version 807540 (0.0010) [2023-12-26 06:02:18,018][123091] Updated weights for policy 0, policy_version 807550 (0.0009) [2023-12-26 06:02:18,068][123091] Updated weights for policy 0, policy_version 807560 (0.0009) [2023-12-26 06:02:18,460][123090] Updated weights for policy 1, policy_version 802115 (0.0011) [2023-12-26 06:02:18,523][123090] Updated weights for policy 1, policy_version 802125 (0.0010) [2023-12-26 06:02:18,585][123090] Updated weights for policy 1, policy_version 802135 (0.0010) [2023-12-26 06:02:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 412090368. Throughput: 0: 8836.3, 1: 8915.4. Samples: 412100848. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:18,785][121949] Avg episode reward: [(0, '6094.252'), (1, '5796.569')] [2023-12-26 06:02:18,913][123091] Updated weights for policy 0, policy_version 807570 (0.0009) [2023-12-26 06:02:18,966][123091] Updated weights for policy 0, policy_version 807580 (0.0009) [2023-12-26 06:02:19,027][123091] Updated weights for policy 0, policy_version 807590 (0.0009) [2023-12-26 06:02:19,076][123091] Updated weights for policy 0, policy_version 807600 (0.0009) [2023-12-26 06:02:19,407][123090] Updated weights for policy 1, policy_version 802145 (0.0010) [2023-12-26 06:02:19,454][123090] Updated weights for policy 1, policy_version 802155 (0.0010) [2023-12-26 06:02:19,523][123090] Updated weights for policy 1, policy_version 802165 (0.0010) [2023-12-26 06:02:19,591][123090] Updated weights for policy 1, policy_version 802175 (0.0010) [2023-12-26 06:02:19,976][123091] Updated weights for policy 0, policy_version 807610 (0.0009) [2023-12-26 06:02:20,042][123091] Updated weights for policy 0, policy_version 807620 (0.0009) [2023-12-26 06:02:20,100][123091] Updated weights for policy 0, policy_version 807630 (0.0009) [2023-12-26 06:02:20,457][123090] Updated weights for policy 1, policy_version 802185 (0.0010) [2023-12-26 06:02:20,527][123090] Updated weights for policy 1, policy_version 802195 (0.0010) [2023-12-26 06:02:20,595][123090] Updated weights for policy 1, policy_version 802205 (0.0010) [2023-12-26 06:02:20,887][123091] Updated weights for policy 0, policy_version 807640 (0.0009) [2023-12-26 06:02:20,945][123091] Updated weights for policy 0, policy_version 807650 (0.0009) [2023-12-26 06:02:20,994][123091] Updated weights for policy 0, policy_version 807660 (0.0009) [2023-12-26 06:02:21,351][123090] Updated weights for policy 1, policy_version 802215 (0.0007) [2023-12-26 06:02:21,422][123090] Updated weights for policy 1, policy_version 802225 (0.0008) [2023-12-26 06:02:21,477][123090] Updated weights for policy 1, policy_version 802235 (0.0010) [2023-12-26 06:02:21,898][123091] Updated weights for policy 0, policy_version 807670 (0.0010) [2023-12-26 06:02:21,963][123091] Updated weights for policy 0, policy_version 807680 (0.0011) [2023-12-26 06:02:22,028][123091] Updated weights for policy 0, policy_version 807690 (0.0009) [2023-12-26 06:02:22,242][123090] Updated weights for policy 1, policy_version 802245 (0.0008) [2023-12-26 06:02:22,310][123090] Updated weights for policy 1, policy_version 802255 (0.0008) [2023-12-26 06:02:22,372][123090] Updated weights for policy 1, policy_version 802265 (0.0008) [2023-12-26 06:02:22,921][123091] Updated weights for policy 0, policy_version 807700 (0.0008) [2023-12-26 06:02:22,991][123091] Updated weights for policy 0, policy_version 807710 (0.0009) [2023-12-26 06:02:23,050][123091] Updated weights for policy 0, policy_version 807720 (0.0008) [2023-12-26 06:02:23,161][123090] Updated weights for policy 1, policy_version 802275 (0.0007) [2023-12-26 06:02:23,210][123090] Updated weights for policy 1, policy_version 802285 (0.0009) [2023-12-26 06:02:23,268][123090] Updated weights for policy 1, policy_version 802295 (0.0009) [2023-12-26 06:02:23,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 412172288. Throughput: 0: 8753.5, 1: 8876.6. Samples: 412151076. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:23,785][121949] Avg episode reward: [(0, '6067.468'), (1, '5910.298')] [2023-12-26 06:02:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000802304_205389824.pth... [2023-12-26 06:02:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000807728_206782464.pth... [2023-12-26 06:02:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000801248_205119488.pth [2023-12-26 06:02:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000806736_206528512.pth [2023-12-26 06:02:23,823][123091] Updated weights for policy 0, policy_version 807730 (0.0008) [2023-12-26 06:02:23,877][123091] Updated weights for policy 0, policy_version 807741 (0.0010) [2023-12-26 06:02:23,931][123091] Updated weights for policy 0, policy_version 807751 (0.0009) [2023-12-26 06:02:24,066][123090] Updated weights for policy 1, policy_version 802305 (0.0009) [2023-12-26 06:02:24,129][123090] Updated weights for policy 1, policy_version 802315 (0.0011) [2023-12-26 06:02:24,182][123090] Updated weights for policy 1, policy_version 802325 (0.0010) [2023-12-26 06:02:24,249][123090] Updated weights for policy 1, policy_version 802335 (0.0010) [2023-12-26 06:02:24,819][123091] Updated weights for policy 0, policy_version 807761 (0.0010) [2023-12-26 06:02:24,875][123091] Updated weights for policy 0, policy_version 807771 (0.0009) [2023-12-26 06:02:24,921][123091] Updated weights for policy 0, policy_version 807781 (0.0008) [2023-12-26 06:02:24,994][123091] Updated weights for policy 0, policy_version 807791 (0.0005) [2023-12-26 06:02:25,073][123090] Updated weights for policy 1, policy_version 802345 (0.0010) [2023-12-26 06:02:25,127][123090] Updated weights for policy 1, policy_version 802355 (0.0010) [2023-12-26 06:02:25,186][123090] Updated weights for policy 1, policy_version 802365 (0.0010) [2023-12-26 06:02:25,701][123091] Updated weights for policy 0, policy_version 807801 (0.0008) [2023-12-26 06:02:25,761][123091] Updated weights for policy 0, policy_version 807811 (0.0009) [2023-12-26 06:02:25,812][123091] Updated weights for policy 0, policy_version 807821 (0.0009) [2023-12-26 06:02:26,004][123090] Updated weights for policy 1, policy_version 802375 (0.0010) [2023-12-26 06:02:26,063][123090] Updated weights for policy 1, policy_version 802385 (0.0010) [2023-12-26 06:02:26,118][123090] Updated weights for policy 1, policy_version 802395 (0.0010) [2023-12-26 06:02:26,650][123091] Updated weights for policy 0, policy_version 807831 (0.0009) [2023-12-26 06:02:26,706][123091] Updated weights for policy 0, policy_version 807841 (0.0008) [2023-12-26 06:02:26,752][123091] Updated weights for policy 0, policy_version 807851 (0.0008) [2023-12-26 06:02:26,946][123090] Updated weights for policy 1, policy_version 802405 (0.0010) [2023-12-26 06:02:26,996][123090] Updated weights for policy 1, policy_version 802415 (0.0010) [2023-12-26 06:02:27,050][123090] Updated weights for policy 1, policy_version 802425 (0.0010) [2023-12-26 06:02:27,469][123091] Updated weights for policy 0, policy_version 807861 (0.0007) [2023-12-26 06:02:27,518][123091] Updated weights for policy 0, policy_version 807871 (0.0005) [2023-12-26 06:02:27,567][123091] Updated weights for policy 0, policy_version 807881 (0.0005) [2023-12-26 06:02:27,876][123090] Updated weights for policy 1, policy_version 802435 (0.0010) [2023-12-26 06:02:27,926][123090] Updated weights for policy 1, policy_version 802445 (0.0010) [2023-12-26 06:02:27,970][123090] Updated weights for policy 1, policy_version 802455 (0.0010) [2023-12-26 06:02:28,201][123091] Updated weights for policy 0, policy_version 807891 (0.0007) [2023-12-26 06:02:28,260][123091] Updated weights for policy 0, policy_version 807901 (0.0010) [2023-12-26 06:02:28,307][123091] Updated weights for policy 0, policy_version 807911 (0.0010) [2023-12-26 06:02:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 412262400. Throughput: 0: 8709.4, 1: 8847.9. Samples: 412257320. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:28,785][121949] Avg episode reward: [(0, '6025.890'), (1, '5948.803')] [2023-12-26 06:02:28,827][123090] Updated weights for policy 1, policy_version 802465 (0.0010) [2023-12-26 06:02:28,895][123090] Updated weights for policy 1, policy_version 802475 (0.0005) [2023-12-26 06:02:28,951][123090] Updated weights for policy 1, policy_version 802485 (0.0009) [2023-12-26 06:02:28,981][123091] Updated weights for policy 0, policy_version 807921 (0.0008) [2023-12-26 06:02:29,007][123090] Updated weights for policy 1, policy_version 802495 (0.0010) [2023-12-26 06:02:29,029][123091] Updated weights for policy 0, policy_version 807931 (0.0005) [2023-12-26 06:02:29,084][123091] Updated weights for policy 0, policy_version 807941 (0.0005) [2023-12-26 06:02:29,146][123091] Updated weights for policy 0, policy_version 807951 (0.0005) [2023-12-26 06:02:29,848][123090] Updated weights for policy 1, policy_version 802505 (0.0011) [2023-12-26 06:02:29,902][123090] Updated weights for policy 1, policy_version 802515 (0.0010) [2023-12-26 06:02:29,914][123091] Updated weights for policy 0, policy_version 807961 (0.0010) [2023-12-26 06:02:29,966][123090] Updated weights for policy 1, policy_version 802525 (0.0011) [2023-12-26 06:02:29,976][123091] Updated weights for policy 0, policy_version 807971 (0.0009) [2023-12-26 06:02:30,027][123091] Updated weights for policy 0, policy_version 807981 (0.0010) [2023-12-26 06:02:30,807][123090] Updated weights for policy 1, policy_version 802535 (0.0007) [2023-12-26 06:02:30,872][123090] Updated weights for policy 1, policy_version 802545 (0.0005) [2023-12-26 06:02:30,874][123091] Updated weights for policy 0, policy_version 807991 (0.0010) [2023-12-26 06:02:30,932][123090] Updated weights for policy 1, policy_version 802555 (0.0006) [2023-12-26 06:02:30,943][123091] Updated weights for policy 0, policy_version 808001 (0.0010) [2023-12-26 06:02:31,011][123091] Updated weights for policy 0, policy_version 808011 (0.0010) [2023-12-26 06:02:31,709][123090] Updated weights for policy 1, policy_version 802565 (0.0008) [2023-12-26 06:02:31,761][123091] Updated weights for policy 0, policy_version 808021 (0.0009) [2023-12-26 06:02:31,772][123090] Updated weights for policy 1, policy_version 802575 (0.0010) [2023-12-26 06:02:31,819][123091] Updated weights for policy 0, policy_version 808031 (0.0010) [2023-12-26 06:02:31,835][123090] Updated weights for policy 1, policy_version 802585 (0.0010) [2023-12-26 06:02:31,881][123091] Updated weights for policy 0, policy_version 808041 (0.0010) [2023-12-26 06:02:32,657][123090] Updated weights for policy 1, policy_version 802595 (0.0011) [2023-12-26 06:02:32,679][123091] Updated weights for policy 0, policy_version 808051 (0.0010) [2023-12-26 06:02:32,713][123090] Updated weights for policy 1, policy_version 802605 (0.0010) [2023-12-26 06:02:32,731][123091] Updated weights for policy 0, policy_version 808061 (0.0005) [2023-12-26 06:02:32,765][123090] Updated weights for policy 1, policy_version 802615 (0.0010) [2023-12-26 06:02:32,787][123091] Updated weights for policy 0, policy_version 808071 (0.0007) [2023-12-26 06:02:33,420][123091] Updated weights for policy 0, policy_version 808081 (0.0005) [2023-12-26 06:02:33,474][123091] Updated weights for policy 0, policy_version 808091 (0.0006) [2023-12-26 06:02:33,521][123091] Updated weights for policy 0, policy_version 808101 (0.0008) [2023-12-26 06:02:33,580][123091] Updated weights for policy 0, policy_version 808111 (0.0010) [2023-12-26 06:02:33,598][123090] Updated weights for policy 1, policy_version 802625 (0.0010) [2023-12-26 06:02:33,654][123090] Updated weights for policy 1, policy_version 802635 (0.0008) [2023-12-26 06:02:33,716][123090] Updated weights for policy 1, policy_version 802645 (0.0006) [2023-12-26 06:02:33,783][123090] Updated weights for policy 1, policy_version 802655 (0.0005) [2023-12-26 06:02:33,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 412352512. Throughput: 0: 8762.7, 1: 8891.0. Samples: 412366160. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:33,785][121949] Avg episode reward: [(0, '6112.089'), (1, '5980.203')] [2023-12-26 06:02:34,312][123091] Updated weights for policy 0, policy_version 808121 (0.0010) [2023-12-26 06:02:34,377][123091] Updated weights for policy 0, policy_version 808131 (0.0006) [2023-12-26 06:02:34,441][123091] Updated weights for policy 0, policy_version 808141 (0.0006) [2023-12-26 06:02:34,459][123090] Updated weights for policy 1, policy_version 802665 (0.0007) [2023-12-26 06:02:34,515][123090] Updated weights for policy 1, policy_version 802675 (0.0011) [2023-12-26 06:02:34,568][123090] Updated weights for policy 1, policy_version 802685 (0.0011) [2023-12-26 06:02:35,187][123091] Updated weights for policy 0, policy_version 808151 (0.0009) [2023-12-26 06:02:35,238][123091] Updated weights for policy 0, policy_version 808161 (0.0010) [2023-12-26 06:02:35,281][123091] Updated weights for policy 0, policy_version 808171 (0.0010) [2023-12-26 06:02:35,385][123090] Updated weights for policy 1, policy_version 802695 (0.0010) [2023-12-26 06:02:35,444][123090] Updated weights for policy 1, policy_version 802705 (0.0008) [2023-12-26 06:02:35,501][123090] Updated weights for policy 1, policy_version 802715 (0.0010) [2023-12-26 06:02:36,137][123091] Updated weights for policy 0, policy_version 808181 (0.0014) [2023-12-26 06:02:36,199][123091] Updated weights for policy 0, policy_version 808191 (0.0008) [2023-12-26 06:02:36,263][123091] Updated weights for policy 0, policy_version 808201 (0.0009) [2023-12-26 06:02:36,336][123090] Updated weights for policy 1, policy_version 802725 (0.0011) [2023-12-26 06:02:36,397][123090] Updated weights for policy 1, policy_version 802735 (0.0011) [2023-12-26 06:02:36,450][123090] Updated weights for policy 1, policy_version 802745 (0.0011) [2023-12-26 06:02:37,029][123091] Updated weights for policy 0, policy_version 808211 (0.0007) [2023-12-26 06:02:37,084][123091] Updated weights for policy 0, policy_version 808221 (0.0005) [2023-12-26 06:02:37,132][123091] Updated weights for policy 0, policy_version 808231 (0.0005) [2023-12-26 06:02:37,243][123090] Updated weights for policy 1, policy_version 802755 (0.0009) [2023-12-26 06:02:37,326][123090] Updated weights for policy 1, policy_version 802765 (0.0006) [2023-12-26 06:02:37,382][123090] Updated weights for policy 1, policy_version 802775 (0.0007) [2023-12-26 06:02:37,861][123091] Updated weights for policy 0, policy_version 808241 (0.0006) [2023-12-26 06:02:37,924][123091] Updated weights for policy 0, policy_version 808251 (0.0010) [2023-12-26 06:02:37,984][123091] Updated weights for policy 0, policy_version 808261 (0.0011) [2023-12-26 06:02:38,051][123091] Updated weights for policy 0, policy_version 808271 (0.0011) [2023-12-26 06:02:38,089][123090] Updated weights for policy 1, policy_version 802785 (0.0009) [2023-12-26 06:02:38,165][123090] Updated weights for policy 1, policy_version 802795 (0.0006) [2023-12-26 06:02:38,224][123090] Updated weights for policy 1, policy_version 802805 (0.0009) [2023-12-26 06:02:38,276][123090] Updated weights for policy 1, policy_version 802815 (0.0008) [2023-12-26 06:02:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 412442624. Throughput: 0: 8820.9, 1: 8900.0. Samples: 412420088. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:38,785][121949] Avg episode reward: [(0, '6207.678'), (1, '5927.347')] [2023-12-26 06:02:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000808272_206921728.pth... [2023-12-26 06:02:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000802816_205520896.pth... [2023-12-26 06:02:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000807248_206659584.pth [2023-12-26 06:02:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000801792_205258752.pth [2023-12-26 06:02:38,862][123091] Updated weights for policy 0, policy_version 808281 (0.0010) [2023-12-26 06:02:38,914][123091] Updated weights for policy 0, policy_version 808291 (0.0010) [2023-12-26 06:02:38,966][123091] Updated weights for policy 0, policy_version 808301 (0.0010) [2023-12-26 06:02:38,980][123090] Updated weights for policy 1, policy_version 802825 (0.0010) [2023-12-26 06:02:39,028][123090] Updated weights for policy 1, policy_version 802835 (0.0010) [2023-12-26 06:02:39,079][123090] Updated weights for policy 1, policy_version 802845 (0.0010) [2023-12-26 06:02:39,787][123091] Updated weights for policy 0, policy_version 808311 (0.0011) [2023-12-26 06:02:39,846][123091] Updated weights for policy 0, policy_version 808321 (0.0011) [2023-12-26 06:02:39,919][123091] Updated weights for policy 0, policy_version 808331 (0.0011) [2023-12-26 06:02:39,948][123090] Updated weights for policy 1, policy_version 802855 (0.0008) [2023-12-26 06:02:40,025][123090] Updated weights for policy 1, policy_version 802865 (0.0006) [2023-12-26 06:02:40,073][123090] Updated weights for policy 1, policy_version 802875 (0.0006) [2023-12-26 06:02:40,759][123091] Updated weights for policy 0, policy_version 808341 (0.0010) [2023-12-26 06:02:40,820][123091] Updated weights for policy 0, policy_version 808351 (0.0010) [2023-12-26 06:02:40,836][123090] Updated weights for policy 1, policy_version 802885 (0.0007) [2023-12-26 06:02:40,883][123091] Updated weights for policy 0, policy_version 808361 (0.0009) [2023-12-26 06:02:40,884][123090] Updated weights for policy 1, policy_version 802895 (0.0009) [2023-12-26 06:02:40,942][123090] Updated weights for policy 1, policy_version 802905 (0.0010) [2023-12-26 06:02:41,790][123091] Updated weights for policy 0, policy_version 808371 (0.0009) [2023-12-26 06:02:41,827][123090] Updated weights for policy 1, policy_version 802915 (0.0009) [2023-12-26 06:02:41,849][123091] Updated weights for policy 0, policy_version 808381 (0.0009) [2023-12-26 06:02:41,883][123090] Updated weights for policy 1, policy_version 802925 (0.0008) [2023-12-26 06:02:41,903][123091] Updated weights for policy 0, policy_version 808391 (0.0008) [2023-12-26 06:02:41,949][123090] Updated weights for policy 1, policy_version 802935 (0.0008) [2023-12-26 06:02:42,759][123090] Updated weights for policy 1, policy_version 802945 (0.0008) [2023-12-26 06:02:42,762][123091] Updated weights for policy 0, policy_version 808401 (0.0009) [2023-12-26 06:02:42,824][123090] Updated weights for policy 1, policy_version 802955 (0.0006) [2023-12-26 06:02:42,828][123091] Updated weights for policy 0, policy_version 808411 (0.0008) [2023-12-26 06:02:42,885][123090] Updated weights for policy 1, policy_version 802965 (0.0006) [2023-12-26 06:02:42,892][123091] Updated weights for policy 0, policy_version 808421 (0.0010) [2023-12-26 06:02:42,945][123090] Updated weights for policy 1, policy_version 802975 (0.0007) [2023-12-26 06:02:42,950][123091] Updated weights for policy 0, policy_version 808431 (0.0009) [2023-12-26 06:02:43,754][123090] Updated weights for policy 1, policy_version 802985 (0.0008) [2023-12-26 06:02:43,761][123091] Updated weights for policy 0, policy_version 808441 (0.0008) [2023-12-26 06:02:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 412524544. Throughput: 0: 8783.0, 1: 8888.4. Samples: 412525780. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:43,785][121949] Avg episode reward: [(0, '6229.490'), (1, '5841.869')] [2023-12-26 06:02:43,809][123091] Updated weights for policy 0, policy_version 808451 (0.0007) [2023-12-26 06:02:43,811][123090] Updated weights for policy 1, policy_version 802995 (0.0008) [2023-12-26 06:02:43,853][123091] Updated weights for policy 0, policy_version 808461 (0.0007) [2023-12-26 06:02:43,861][123090] Updated weights for policy 1, policy_version 803005 (0.0010) [2023-12-26 06:02:44,650][123091] Updated weights for policy 0, policy_version 808471 (0.0010) [2023-12-26 06:02:44,721][123091] Updated weights for policy 0, policy_version 808481 (0.0009) [2023-12-26 06:02:44,761][123090] Updated weights for policy 1, policy_version 803015 (0.0007) [2023-12-26 06:02:44,786][123091] Updated weights for policy 0, policy_version 808491 (0.0009) [2023-12-26 06:02:44,827][123090] Updated weights for policy 1, policy_version 803025 (0.0009) [2023-12-26 06:02:44,890][123090] Updated weights for policy 1, policy_version 803035 (0.0010) [2023-12-26 06:02:45,581][123090] Updated weights for policy 1, policy_version 803045 (0.0009) [2023-12-26 06:02:45,631][123091] Updated weights for policy 0, policy_version 808501 (0.0007) [2023-12-26 06:02:45,648][123090] Updated weights for policy 1, policy_version 803055 (0.0009) [2023-12-26 06:02:45,692][123091] Updated weights for policy 0, policy_version 808511 (0.0010) [2023-12-26 06:02:45,708][123090] Updated weights for policy 1, policy_version 803065 (0.0009) [2023-12-26 06:02:45,752][123091] Updated weights for policy 0, policy_version 808521 (0.0008) [2023-12-26 06:02:46,505][123090] Updated weights for policy 1, policy_version 803075 (0.0007) [2023-12-26 06:02:46,566][123090] Updated weights for policy 1, policy_version 803085 (0.0005) [2023-12-26 06:02:46,618][123091] Updated weights for policy 0, policy_version 808531 (0.0009) [2023-12-26 06:02:46,639][123090] Updated weights for policy 1, policy_version 803095 (0.0005) [2023-12-26 06:02:46,672][123091] Updated weights for policy 0, policy_version 808541 (0.0009) [2023-12-26 06:02:46,732][123091] Updated weights for policy 0, policy_version 808551 (0.0008) [2023-12-26 06:02:47,269][123090] Updated weights for policy 1, policy_version 803105 (0.0005) [2023-12-26 06:02:47,335][123090] Updated weights for policy 1, policy_version 803115 (0.0006) [2023-12-26 06:02:47,403][123090] Updated weights for policy 1, policy_version 803125 (0.0005) [2023-12-26 06:02:47,469][123091] Updated weights for policy 0, policy_version 808561 (0.0008) [2023-12-26 06:02:47,473][123090] Updated weights for policy 1, policy_version 803135 (0.0006) [2023-12-26 06:02:47,529][123091] Updated weights for policy 0, policy_version 808571 (0.0011) [2023-12-26 06:02:47,577][123091] Updated weights for policy 0, policy_version 808581 (0.0009) [2023-12-26 06:02:47,632][123091] Updated weights for policy 0, policy_version 808591 (0.0010) [2023-12-26 06:02:48,211][123090] Updated weights for policy 1, policy_version 803145 (0.0010) [2023-12-26 06:02:48,275][123090] Updated weights for policy 1, policy_version 803155 (0.0009) [2023-12-26 06:02:48,343][123090] Updated weights for policy 1, policy_version 803165 (0.0010) [2023-12-26 06:02:48,506][123091] Updated weights for policy 0, policy_version 808601 (0.0010) [2023-12-26 06:02:48,572][123091] Updated weights for policy 0, policy_version 808611 (0.0009) [2023-12-26 06:02:48,640][123091] Updated weights for policy 0, policy_version 808621 (0.0010) [2023-12-26 06:02:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 412622848. Throughput: 0: 8755.6, 1: 8887.0. Samples: 412631444. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:48,785][121949] Avg episode reward: [(0, '6128.672'), (1, '5786.831')] [2023-12-26 06:02:49,232][123090] Updated weights for policy 1, policy_version 803176 (0.0008) [2023-12-26 06:02:49,290][123090] Updated weights for policy 1, policy_version 803186 (0.0008) [2023-12-26 06:02:49,355][123090] Updated weights for policy 1, policy_version 803196 (0.0008) [2023-12-26 06:02:49,383][123091] Updated weights for policy 0, policy_version 808631 (0.0009) [2023-12-26 06:02:49,445][123091] Updated weights for policy 0, policy_version 808641 (0.0009) [2023-12-26 06:02:49,511][123091] Updated weights for policy 0, policy_version 808651 (0.0006) [2023-12-26 06:02:50,279][123090] Updated weights for policy 1, policy_version 803206 (0.0008) [2023-12-26 06:02:50,287][123091] Updated weights for policy 0, policy_version 808661 (0.0008) [2023-12-26 06:02:50,335][123091] Updated weights for policy 0, policy_version 808671 (0.0006) [2023-12-26 06:02:50,350][123090] Updated weights for policy 1, policy_version 803216 (0.0009) [2023-12-26 06:02:50,398][123091] Updated weights for policy 0, policy_version 808681 (0.0005) [2023-12-26 06:02:50,414][123090] Updated weights for policy 1, policy_version 803226 (0.0009) [2023-12-26 06:02:51,013][123091] Updated weights for policy 0, policy_version 808691 (0.0006) [2023-12-26 06:02:51,087][123091] Updated weights for policy 0, policy_version 808701 (0.0008) [2023-12-26 06:02:51,158][123091] Updated weights for policy 0, policy_version 808711 (0.0009) [2023-12-26 06:02:51,309][123090] Updated weights for policy 1, policy_version 803236 (0.0009) [2023-12-26 06:02:51,385][123090] Updated weights for policy 1, policy_version 803246 (0.0009) [2023-12-26 06:02:51,452][123090] Updated weights for policy 1, policy_version 803256 (0.0006) [2023-12-26 06:02:51,942][123091] Updated weights for policy 0, policy_version 808721 (0.0010) [2023-12-26 06:02:52,005][123091] Updated weights for policy 0, policy_version 808731 (0.0005) [2023-12-26 06:02:52,067][123091] Updated weights for policy 0, policy_version 808741 (0.0005) [2023-12-26 06:02:52,127][123091] Updated weights for policy 0, policy_version 808751 (0.0007) [2023-12-26 06:02:52,228][123090] Updated weights for policy 1, policy_version 803266 (0.0007) [2023-12-26 06:02:52,291][123090] Updated weights for policy 1, policy_version 803276 (0.0008) [2023-12-26 06:02:52,366][123090] Updated weights for policy 1, policy_version 803287 (0.0010) [2023-12-26 06:02:52,833][123091] Updated weights for policy 0, policy_version 808761 (0.0005) [2023-12-26 06:02:52,890][123091] Updated weights for policy 0, policy_version 808771 (0.0006) [2023-12-26 06:02:52,947][123091] Updated weights for policy 0, policy_version 808781 (0.0006) [2023-12-26 06:02:53,259][123090] Updated weights for policy 1, policy_version 803297 (0.0009) [2023-12-26 06:02:53,312][123090] Updated weights for policy 1, policy_version 803307 (0.0009) [2023-12-26 06:02:53,372][123090] Updated weights for policy 1, policy_version 803317 (0.0010) [2023-12-26 06:02:53,423][123090] Updated weights for policy 1, policy_version 803327 (0.0010) [2023-12-26 06:02:53,562][123091] Updated weights for policy 0, policy_version 808791 (0.0006) [2023-12-26 06:02:53,625][123091] Updated weights for policy 0, policy_version 808801 (0.0006) [2023-12-26 06:02:53,691][123091] Updated weights for policy 0, policy_version 808811 (0.0006) [2023-12-26 06:02:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 412712960. Throughput: 0: 8827.3, 1: 8753.9. Samples: 412684292. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:53,785][121949] Avg episode reward: [(0, '5986.368'), (1, '5955.138')] [2023-12-26 06:02:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000808816_207060992.pth... [2023-12-26 06:02:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000803328_205651968.pth... [2023-12-26 06:02:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000807728_206782464.pth [2023-12-26 06:02:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000802304_205389824.pth [2023-12-26 06:02:54,316][123091] Updated weights for policy 0, policy_version 808821 (0.0006) [2023-12-26 06:02:54,375][123091] Updated weights for policy 0, policy_version 808831 (0.0006) [2023-12-26 06:02:54,383][123090] Updated weights for policy 1, policy_version 803337 (0.0007) [2023-12-26 06:02:54,441][123091] Updated weights for policy 0, policy_version 808841 (0.0009) [2023-12-26 06:02:54,450][123090] Updated weights for policy 1, policy_version 803347 (0.0007) [2023-12-26 06:02:54,519][123090] Updated weights for policy 1, policy_version 803357 (0.0009) [2023-12-26 06:02:55,184][123091] Updated weights for policy 0, policy_version 808851 (0.0007) [2023-12-26 06:02:55,250][123091] Updated weights for policy 0, policy_version 808861 (0.0006) [2023-12-26 06:02:55,280][123090] Updated weights for policy 1, policy_version 803367 (0.0006) [2023-12-26 06:02:55,304][123091] Updated weights for policy 0, policy_version 808871 (0.0010) [2023-12-26 06:02:55,327][123090] Updated weights for policy 1, policy_version 803377 (0.0005) [2023-12-26 06:02:55,379][123090] Updated weights for policy 1, policy_version 803387 (0.0005) [2023-12-26 06:02:56,064][123091] Updated weights for policy 0, policy_version 808881 (0.0009) [2023-12-26 06:02:56,126][123091] Updated weights for policy 0, policy_version 808891 (0.0010) [2023-12-26 06:02:56,183][123091] Updated weights for policy 0, policy_version 808901 (0.0009) [2023-12-26 06:02:56,207][123090] Updated weights for policy 1, policy_version 803397 (0.0006) [2023-12-26 06:02:56,242][123091] Updated weights for policy 0, policy_version 808911 (0.0008) [2023-12-26 06:02:56,256][123090] Updated weights for policy 1, policy_version 803407 (0.0008) [2023-12-26 06:02:56,319][123090] Updated weights for policy 1, policy_version 803417 (0.0008) [2023-12-26 06:02:57,010][123091] Updated weights for policy 0, policy_version 808921 (0.0005) [2023-12-26 06:02:57,063][123091] Updated weights for policy 0, policy_version 808931 (0.0005) [2023-12-26 06:02:57,113][123090] Updated weights for policy 1, policy_version 803427 (0.0009) [2023-12-26 06:02:57,114][123091] Updated weights for policy 0, policy_version 808941 (0.0005) [2023-12-26 06:02:57,169][123090] Updated weights for policy 1, policy_version 803437 (0.0005) [2023-12-26 06:02:57,219][123090] Updated weights for policy 1, policy_version 803447 (0.0005) [2023-12-26 06:02:57,802][123091] Updated weights for policy 0, policy_version 808951 (0.0008) [2023-12-26 06:02:57,863][123091] Updated weights for policy 0, policy_version 808961 (0.0010) [2023-12-26 06:02:57,897][123090] Updated weights for policy 1, policy_version 803457 (0.0005) [2023-12-26 06:02:57,922][123091] Updated weights for policy 0, policy_version 808971 (0.0006) [2023-12-26 06:02:57,967][123090] Updated weights for policy 1, policy_version 803467 (0.0005) [2023-12-26 06:02:58,044][123090] Updated weights for policy 1, policy_version 803477 (0.0007) [2023-12-26 06:02:58,110][123090] Updated weights for policy 1, policy_version 803487 (0.0007) [2023-12-26 06:02:58,742][123091] Updated weights for policy 0, policy_version 808981 (0.0009) [2023-12-26 06:02:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 412794880. Throughput: 0: 9042.1, 1: 8770.3. Samples: 412794556. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:02:58,785][121949] Avg episode reward: [(0, '6087.443'), (1, '5802.337')] [2023-12-26 06:02:58,799][123091] Updated weights for policy 0, policy_version 808991 (0.0007) [2023-12-26 06:02:58,867][123091] Updated weights for policy 0, policy_version 809001 (0.0008) [2023-12-26 06:02:58,902][123090] Updated weights for policy 1, policy_version 803497 (0.0010) [2023-12-26 06:02:58,969][123090] Updated weights for policy 1, policy_version 803507 (0.0010) [2023-12-26 06:02:59,038][123090] Updated weights for policy 1, policy_version 803517 (0.0010) [2023-12-26 06:02:59,660][123091] Updated weights for policy 0, policy_version 809011 (0.0006) [2023-12-26 06:02:59,723][123091] Updated weights for policy 0, policy_version 809021 (0.0006) [2023-12-26 06:02:59,795][123091] Updated weights for policy 0, policy_version 809031 (0.0010) [2023-12-26 06:02:59,823][123090] Updated weights for policy 1, policy_version 803527 (0.0009) [2023-12-26 06:02:59,893][123090] Updated weights for policy 1, policy_version 803537 (0.0009) [2023-12-26 06:02:59,964][123090] Updated weights for policy 1, policy_version 803547 (0.0009) [2023-12-26 06:03:00,469][123091] Updated weights for policy 0, policy_version 809041 (0.0011) [2023-12-26 06:03:00,520][123091] Updated weights for policy 0, policy_version 809051 (0.0007) [2023-12-26 06:03:00,579][123091] Updated weights for policy 0, policy_version 809061 (0.0005) [2023-12-26 06:03:00,650][123091] Updated weights for policy 0, policy_version 809071 (0.0005) [2023-12-26 06:03:00,704][123090] Updated weights for policy 1, policy_version 803557 (0.0006) [2023-12-26 06:03:00,756][123090] Updated weights for policy 1, policy_version 803567 (0.0005) [2023-12-26 06:03:00,805][123090] Updated weights for policy 1, policy_version 803577 (0.0005) [2023-12-26 06:03:01,328][123091] Updated weights for policy 0, policy_version 809081 (0.0006) [2023-12-26 06:03:01,404][123091] Updated weights for policy 0, policy_version 809091 (0.0009) [2023-12-26 06:03:01,459][123091] Updated weights for policy 0, policy_version 809101 (0.0010) [2023-12-26 06:03:01,548][123090] Updated weights for policy 1, policy_version 803587 (0.0007) [2023-12-26 06:03:01,604][123090] Updated weights for policy 1, policy_version 803597 (0.0008) [2023-12-26 06:03:01,681][123090] Updated weights for policy 1, policy_version 803607 (0.0007) [2023-12-26 06:03:02,212][123091] Updated weights for policy 0, policy_version 809111 (0.0010) [2023-12-26 06:03:02,282][123091] Updated weights for policy 0, policy_version 809121 (0.0009) [2023-12-26 06:03:02,343][123091] Updated weights for policy 0, policy_version 809131 (0.0009) [2023-12-26 06:03:02,345][123090] Updated weights for policy 1, policy_version 803617 (0.0007) [2023-12-26 06:03:02,418][123090] Updated weights for policy 1, policy_version 803627 (0.0008) [2023-12-26 06:03:02,484][123090] Updated weights for policy 1, policy_version 803637 (0.0006) [2023-12-26 06:03:02,552][123090] Updated weights for policy 1, policy_version 803647 (0.0005) [2023-12-26 06:03:03,200][123091] Updated weights for policy 0, policy_version 809141 (0.0007) [2023-12-26 06:03:03,210][123090] Updated weights for policy 1, policy_version 803657 (0.0010) [2023-12-26 06:03:03,249][123091] Updated weights for policy 0, policy_version 809151 (0.0010) [2023-12-26 06:03:03,260][123090] Updated weights for policy 1, policy_version 803667 (0.0009) [2023-12-26 06:03:03,298][123091] Updated weights for policy 0, policy_version 809161 (0.0007) [2023-12-26 06:03:03,313][123090] Updated weights for policy 1, policy_version 803677 (0.0008) [2023-12-26 06:03:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 412893184. Throughput: 0: 9046.0, 1: 8816.6. Samples: 412904668. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:03:03,785][121949] Avg episode reward: [(0, '6007.685'), (1, '5432.176')] [2023-12-26 06:03:04,120][123090] Updated weights for policy 1, policy_version 803687 (0.0008) [2023-12-26 06:03:04,187][123090] Updated weights for policy 1, policy_version 803697 (0.0008) [2023-12-26 06:03:04,193][123091] Updated weights for policy 0, policy_version 809171 (0.0008) [2023-12-26 06:03:04,256][123090] Updated weights for policy 1, policy_version 803707 (0.0008) [2023-12-26 06:03:04,259][123091] Updated weights for policy 0, policy_version 809181 (0.0009) [2023-12-26 06:03:04,328][123091] Updated weights for policy 0, policy_version 809191 (0.0008) [2023-12-26 06:03:04,970][123090] Updated weights for policy 1, policy_version 803717 (0.0008) [2023-12-26 06:03:05,022][123090] Updated weights for policy 1, policy_version 803727 (0.0009) [2023-12-26 06:03:05,083][123090] Updated weights for policy 1, policy_version 803737 (0.0009) [2023-12-26 06:03:05,149][123091] Updated weights for policy 0, policy_version 809201 (0.0009) [2023-12-26 06:03:05,219][123091] Updated weights for policy 0, policy_version 809211 (0.0005) [2023-12-26 06:03:05,294][123091] Updated weights for policy 0, policy_version 809221 (0.0006) [2023-12-26 06:03:05,358][123091] Updated weights for policy 0, policy_version 809231 (0.0007) [2023-12-26 06:03:05,774][123090] Updated weights for policy 1, policy_version 803747 (0.0010) [2023-12-26 06:03:05,828][123090] Updated weights for policy 1, policy_version 803757 (0.0010) [2023-12-26 06:03:05,882][123090] Updated weights for policy 1, policy_version 803767 (0.0009) [2023-12-26 06:03:05,964][123091] Updated weights for policy 0, policy_version 809241 (0.0005) [2023-12-26 06:03:06,020][123091] Updated weights for policy 0, policy_version 809251 (0.0005) [2023-12-26 06:03:06,073][123091] Updated weights for policy 0, policy_version 809261 (0.0005) [2023-12-26 06:03:06,661][123090] Updated weights for policy 1, policy_version 803778 (0.0010) [2023-12-26 06:03:06,731][123090] Updated weights for policy 1, policy_version 803788 (0.0009) [2023-12-26 06:03:06,797][123090] Updated weights for policy 1, policy_version 803798 (0.0009) [2023-12-26 06:03:06,874][123090] Updated weights for policy 1, policy_version 803808 (0.0009) [2023-12-26 06:03:06,936][123091] Updated weights for policy 0, policy_version 809271 (0.0006) [2023-12-26 06:03:07,003][123091] Updated weights for policy 0, policy_version 809281 (0.0008) [2023-12-26 06:03:07,074][123091] Updated weights for policy 0, policy_version 809291 (0.0007) [2023-12-26 06:03:07,674][123090] Updated weights for policy 1, policy_version 803818 (0.0010) [2023-12-26 06:03:07,731][123090] Updated weights for policy 1, policy_version 803828 (0.0007) [2023-12-26 06:03:07,737][123091] Updated weights for policy 0, policy_version 809301 (0.0008) [2023-12-26 06:03:07,778][123090] Updated weights for policy 1, policy_version 803838 (0.0007) [2023-12-26 06:03:07,799][123091] Updated weights for policy 0, policy_version 809311 (0.0008) [2023-12-26 06:03:07,855][123091] Updated weights for policy 0, policy_version 809321 (0.0010) [2023-12-26 06:03:08,612][123090] Updated weights for policy 1, policy_version 803848 (0.0009) [2023-12-26 06:03:08,677][123090] Updated weights for policy 1, policy_version 803858 (0.0009) [2023-12-26 06:03:08,700][123091] Updated weights for policy 0, policy_version 809331 (0.0010) [2023-12-26 06:03:08,746][123090] Updated weights for policy 1, policy_version 803868 (0.0008) [2023-12-26 06:03:08,764][123091] Updated weights for policy 0, policy_version 809341 (0.0011) [2023-12-26 06:03:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 412983296. Throughput: 0: 9082.3, 1: 8882.7. Samples: 412959496. Policy #0 lag: (min: 3.0, avg: 10.2, max: 35.0) [2023-12-26 06:03:08,785][121949] Avg episode reward: [(0, '6065.047'), (1, '5589.257')] [2023-12-26 06:03:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000803872_205791232.pth... [2023-12-26 06:03:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000802816_205520896.pth [2023-12-26 06:03:08,831][123091] Updated weights for policy 0, policy_version 809351 (0.0011) [2023-12-26 06:03:08,896][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000809360_207200256.pth... [2023-12-26 06:03:08,901][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000808272_206921728.pth [2023-12-26 06:03:09,454][123090] Updated weights for policy 1, policy_version 803878 (0.0012) [2023-12-26 06:03:09,521][123090] Updated weights for policy 1, policy_version 803888 (0.0011) [2023-12-26 06:03:09,564][123091] Updated weights for policy 0, policy_version 809361 (0.0008) [2023-12-26 06:03:09,586][123090] Updated weights for policy 1, policy_version 803898 (0.0011) [2023-12-26 06:03:09,615][123091] Updated weights for policy 0, policy_version 809371 (0.0010) [2023-12-26 06:03:09,663][123091] Updated weights for policy 0, policy_version 809381 (0.0009) [2023-12-26 06:03:09,720][123091] Updated weights for policy 0, policy_version 809391 (0.0009) [2023-12-26 06:03:10,440][123090] Updated weights for policy 1, policy_version 803908 (0.0011) [2023-12-26 06:03:10,508][123090] Updated weights for policy 1, policy_version 803918 (0.0010) [2023-12-26 06:03:10,570][123090] Updated weights for policy 1, policy_version 803928 (0.0007) [2023-12-26 06:03:10,613][123091] Updated weights for policy 0, policy_version 809401 (0.0009) [2023-12-26 06:03:10,679][123091] Updated weights for policy 0, policy_version 809411 (0.0008) [2023-12-26 06:03:10,734][123091] Updated weights for policy 0, policy_version 809421 (0.0010) [2023-12-26 06:03:11,366][123090] Updated weights for policy 1, policy_version 803938 (0.0008) [2023-12-26 06:03:11,439][123090] Updated weights for policy 1, policy_version 803948 (0.0010) [2023-12-26 06:03:11,501][123090] Updated weights for policy 1, policy_version 803958 (0.0010) [2023-12-26 06:03:11,553][123090] Updated weights for policy 1, policy_version 803968 (0.0010) [2023-12-26 06:03:11,628][123091] Updated weights for policy 0, policy_version 809431 (0.0010) [2023-12-26 06:03:11,689][123091] Updated weights for policy 0, policy_version 809441 (0.0008) [2023-12-26 06:03:11,756][123091] Updated weights for policy 0, policy_version 809451 (0.0008) [2023-12-26 06:03:12,449][123090] Updated weights for policy 1, policy_version 803978 (0.0006) [2023-12-26 06:03:12,509][123090] Updated weights for policy 1, policy_version 803988 (0.0007) [2023-12-26 06:03:12,568][123090] Updated weights for policy 1, policy_version 803998 (0.0009) [2023-12-26 06:03:12,571][123091] Updated weights for policy 0, policy_version 809461 (0.0009) [2023-12-26 06:03:12,630][123091] Updated weights for policy 0, policy_version 809471 (0.0009) [2023-12-26 06:03:12,689][123091] Updated weights for policy 0, policy_version 809481 (0.0010) [2023-12-26 06:03:13,207][123090] Updated weights for policy 1, policy_version 804008 (0.0010) [2023-12-26 06:03:13,272][123090] Updated weights for policy 1, policy_version 804018 (0.0011) [2023-12-26 06:03:13,339][123090] Updated weights for policy 1, policy_version 804028 (0.0009) [2023-12-26 06:03:13,603][123091] Updated weights for policy 0, policy_version 809491 (0.0010) [2023-12-26 06:03:13,654][123091] Updated weights for policy 0, policy_version 809501 (0.0009) [2023-12-26 06:03:13,705][123091] Updated weights for policy 0, policy_version 809511 (0.0006) [2023-12-26 06:03:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17717.0). Total num frames: 413073408. Throughput: 0: 9063.5, 1: 8833.0. Samples: 413062664. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:13,785][121949] Avg episode reward: [(0, '6165.095'), (1, '5926.602')] [2023-12-26 06:03:14,030][123090] Updated weights for policy 1, policy_version 804038 (0.0005) [2023-12-26 06:03:14,077][123090] Updated weights for policy 1, policy_version 804048 (0.0005) [2023-12-26 06:03:14,133][123090] Updated weights for policy 1, policy_version 804058 (0.0005) [2023-12-26 06:03:14,601][123091] Updated weights for policy 0, policy_version 809521 (0.0008) [2023-12-26 06:03:14,658][123091] Updated weights for policy 0, policy_version 809531 (0.0009) [2023-12-26 06:03:14,712][123091] Updated weights for policy 0, policy_version 809541 (0.0010) [2023-12-26 06:03:14,787][123091] Updated weights for policy 0, policy_version 809552 (0.0008) [2023-12-26 06:03:14,823][123090] Updated weights for policy 1, policy_version 804068 (0.0007) [2023-12-26 06:03:14,892][123090] Updated weights for policy 1, policy_version 804078 (0.0006) [2023-12-26 06:03:14,958][123090] Updated weights for policy 1, policy_version 804088 (0.0006) [2023-12-26 06:03:15,521][123091] Updated weights for policy 0, policy_version 809562 (0.0005) [2023-12-26 06:03:15,593][123091] Updated weights for policy 0, policy_version 809572 (0.0005) [2023-12-26 06:03:15,622][123090] Updated weights for policy 1, policy_version 804098 (0.0006) [2023-12-26 06:03:15,660][123091] Updated weights for policy 0, policy_version 809582 (0.0006) [2023-12-26 06:03:15,683][123090] Updated weights for policy 1, policy_version 804108 (0.0007) [2023-12-26 06:03:15,743][123090] Updated weights for policy 1, policy_version 804118 (0.0010) [2023-12-26 06:03:15,795][123090] Updated weights for policy 1, policy_version 804128 (0.0010) [2023-12-26 06:03:16,380][123091] Updated weights for policy 0, policy_version 809592 (0.0008) [2023-12-26 06:03:16,436][123091] Updated weights for policy 0, policy_version 809602 (0.0009) [2023-12-26 06:03:16,484][123091] Updated weights for policy 0, policy_version 809612 (0.0009) [2023-12-26 06:03:16,606][123090] Updated weights for policy 1, policy_version 804138 (0.0005) [2023-12-26 06:03:16,678][123090] Updated weights for policy 1, policy_version 804148 (0.0005) [2023-12-26 06:03:16,747][123090] Updated weights for policy 1, policy_version 804158 (0.0006) [2023-12-26 06:03:17,355][123091] Updated weights for policy 0, policy_version 809622 (0.0009) [2023-12-26 06:03:17,410][123091] Updated weights for policy 0, policy_version 809632 (0.0006) [2023-12-26 06:03:17,471][123090] Updated weights for policy 1, policy_version 804168 (0.0009) [2023-12-26 06:03:17,475][123091] Updated weights for policy 0, policy_version 809642 (0.0007) [2023-12-26 06:03:17,535][123090] Updated weights for policy 1, policy_version 804178 (0.0010) [2023-12-26 06:03:17,594][123090] Updated weights for policy 1, policy_version 804188 (0.0010) [2023-12-26 06:03:18,210][123091] Updated weights for policy 0, policy_version 809652 (0.0006) [2023-12-26 06:03:18,270][123091] Updated weights for policy 0, policy_version 809662 (0.0005) [2023-12-26 06:03:18,339][123091] Updated weights for policy 0, policy_version 809672 (0.0006) [2023-12-26 06:03:18,452][123090] Updated weights for policy 1, policy_version 804198 (0.0011) [2023-12-26 06:03:18,513][123090] Updated weights for policy 1, policy_version 804208 (0.0011) [2023-12-26 06:03:18,576][123090] Updated weights for policy 1, policy_version 804218 (0.0011) [2023-12-26 06:03:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 413163520. Throughput: 0: 8971.7, 1: 8930.1. Samples: 413171736. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:18,784][121949] Avg episode reward: [(0, '6092.638'), (1, '6021.485')] [2023-12-26 06:03:19,178][123091] Updated weights for policy 0, policy_version 809682 (0.0010) [2023-12-26 06:03:19,242][123091] Updated weights for policy 0, policy_version 809692 (0.0009) [2023-12-26 06:03:19,319][123091] Updated weights for policy 0, policy_version 809702 (0.0007) [2023-12-26 06:03:19,359][123090] Updated weights for policy 1, policy_version 804228 (0.0010) [2023-12-26 06:03:19,386][123091] Updated weights for policy 0, policy_version 809712 (0.0009) [2023-12-26 06:03:19,424][123090] Updated weights for policy 1, policy_version 804238 (0.0011) [2023-12-26 06:03:19,492][123090] Updated weights for policy 1, policy_version 804248 (0.0014) [2023-12-26 06:03:20,175][123091] Updated weights for policy 0, policy_version 809722 (0.0011) [2023-12-26 06:03:20,244][123091] Updated weights for policy 0, policy_version 809732 (0.0011) [2023-12-26 06:03:20,316][123091] Updated weights for policy 0, policy_version 809742 (0.0011) [2023-12-26 06:03:20,332][123090] Updated weights for policy 1, policy_version 804258 (0.0009) [2023-12-26 06:03:20,406][123090] Updated weights for policy 1, policy_version 804268 (0.0007) [2023-12-26 06:03:20,477][123090] Updated weights for policy 1, policy_version 804278 (0.0008) [2023-12-26 06:03:20,547][123090] Updated weights for policy 1, policy_version 804288 (0.0010) [2023-12-26 06:03:21,207][123091] Updated weights for policy 0, policy_version 809752 (0.0011) [2023-12-26 06:03:21,287][123091] Updated weights for policy 0, policy_version 809762 (0.0011) [2023-12-26 06:03:21,330][123090] Updated weights for policy 1, policy_version 804298 (0.0010) [2023-12-26 06:03:21,354][123091] Updated weights for policy 0, policy_version 809772 (0.0011) [2023-12-26 06:03:21,410][123090] Updated weights for policy 1, policy_version 804308 (0.0008) [2023-12-26 06:03:21,483][123090] Updated weights for policy 1, policy_version 804318 (0.0008) [2023-12-26 06:03:22,208][123090] Updated weights for policy 1, policy_version 804328 (0.0006) [2023-12-26 06:03:22,221][123091] Updated weights for policy 0, policy_version 809782 (0.0010) [2023-12-26 06:03:22,274][123090] Updated weights for policy 1, policy_version 804338 (0.0007) [2023-12-26 06:03:22,295][123091] Updated weights for policy 0, policy_version 809792 (0.0011) [2023-12-26 06:03:22,347][123090] Updated weights for policy 1, policy_version 804348 (0.0010) [2023-12-26 06:03:22,366][123091] Updated weights for policy 0, policy_version 809802 (0.0010) [2023-12-26 06:03:23,101][123091] Updated weights for policy 0, policy_version 809812 (0.0009) [2023-12-26 06:03:23,154][123091] Updated weights for policy 0, policy_version 809822 (0.0007) [2023-12-26 06:03:23,202][123090] Updated weights for policy 1, policy_version 804358 (0.0008) [2023-12-26 06:03:23,210][123091] Updated weights for policy 0, policy_version 809832 (0.0007) [2023-12-26 06:03:23,259][123090] Updated weights for policy 1, policy_version 804368 (0.0010) [2023-12-26 06:03:23,319][123090] Updated weights for policy 1, policy_version 804378 (0.0010) [2023-12-26 06:03:23,786][121949] Fps is (10 sec: 17200.1, 60 sec: 17885.4, 300 sec: 17716.8). Total num frames: 413245440. Throughput: 0: 8916.8, 1: 8923.0. Samples: 413222912. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:23,787][121949] Avg episode reward: [(0, '6175.607'), (1, '5981.865')] [2023-12-26 06:03:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000809840_207323136.pth... [2023-12-26 06:03:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000804384_205922304.pth... [2023-12-26 06:03:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000803328_205651968.pth [2023-12-26 06:03:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000808816_207060992.pth [2023-12-26 06:03:23,934][123091] Updated weights for policy 0, policy_version 809842 (0.0008) [2023-12-26 06:03:24,007][123091] Updated weights for policy 0, policy_version 809852 (0.0005) [2023-12-26 06:03:24,023][123090] Updated weights for policy 1, policy_version 804388 (0.0008) [2023-12-26 06:03:24,069][123091] Updated weights for policy 0, policy_version 809862 (0.0005) [2023-12-26 06:03:24,090][123090] Updated weights for policy 1, policy_version 804398 (0.0009) [2023-12-26 06:03:24,144][123091] Updated weights for policy 0, policy_version 809872 (0.0006) [2023-12-26 06:03:24,169][123090] Updated weights for policy 1, policy_version 804408 (0.0005) [2023-12-26 06:03:24,834][123090] Updated weights for policy 1, policy_version 804418 (0.0006) [2023-12-26 06:03:24,838][123091] Updated weights for policy 0, policy_version 809882 (0.0007) [2023-12-26 06:03:24,891][123090] Updated weights for policy 1, policy_version 804428 (0.0010) [2023-12-26 06:03:24,915][123091] Updated weights for policy 0, policy_version 809892 (0.0005) [2023-12-26 06:03:24,950][123090] Updated weights for policy 1, policy_version 804438 (0.0010) [2023-12-26 06:03:24,984][123091] Updated weights for policy 0, policy_version 809902 (0.0005) [2023-12-26 06:03:25,014][123090] Updated weights for policy 1, policy_version 804448 (0.0010) [2023-12-26 06:03:25,550][123091] Updated weights for policy 0, policy_version 809912 (0.0005) [2023-12-26 06:03:25,609][123091] Updated weights for policy 0, policy_version 809922 (0.0008) [2023-12-26 06:03:25,656][123091] Updated weights for policy 0, policy_version 809932 (0.0010) [2023-12-26 06:03:25,857][123090] Updated weights for policy 1, policy_version 804458 (0.0006) [2023-12-26 06:03:25,920][123090] Updated weights for policy 1, policy_version 804468 (0.0005) [2023-12-26 06:03:25,981][123090] Updated weights for policy 1, policy_version 804478 (0.0005) [2023-12-26 06:03:26,530][123091] Updated weights for policy 0, policy_version 809942 (0.0008) [2023-12-26 06:03:26,608][123091] Updated weights for policy 0, policy_version 809952 (0.0009) [2023-12-26 06:03:26,654][123090] Updated weights for policy 1, policy_version 804488 (0.0005) [2023-12-26 06:03:26,671][123091] Updated weights for policy 0, policy_version 809962 (0.0007) [2023-12-26 06:03:26,706][123090] Updated weights for policy 1, policy_version 804498 (0.0005) [2023-12-26 06:03:26,754][123090] Updated weights for policy 1, policy_version 804508 (0.0005) [2023-12-26 06:03:27,399][123090] Updated weights for policy 1, policy_version 804518 (0.0005) [2023-12-26 06:03:27,421][123091] Updated weights for policy 0, policy_version 809972 (0.0006) [2023-12-26 06:03:27,448][123090] Updated weights for policy 1, policy_version 804528 (0.0007) [2023-12-26 06:03:27,485][123091] Updated weights for policy 0, policy_version 809982 (0.0008) [2023-12-26 06:03:27,496][123090] Updated weights for policy 1, policy_version 804538 (0.0007) [2023-12-26 06:03:27,539][123091] Updated weights for policy 0, policy_version 809992 (0.0009) [2023-12-26 06:03:28,219][123091] Updated weights for policy 0, policy_version 810002 (0.0009) [2023-12-26 06:03:28,238][123090] Updated weights for policy 1, policy_version 804548 (0.0008) [2023-12-26 06:03:28,271][123091] Updated weights for policy 0, policy_version 810012 (0.0006) [2023-12-26 06:03:28,294][123090] Updated weights for policy 1, policy_version 804558 (0.0007) [2023-12-26 06:03:28,342][123091] Updated weights for policy 0, policy_version 810022 (0.0009) [2023-12-26 06:03:28,349][123090] Updated weights for policy 1, policy_version 804568 (0.0007) [2023-12-26 06:03:28,404][123091] Updated weights for policy 0, policy_version 810032 (0.0008) [2023-12-26 06:03:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 413343744. Throughput: 0: 8994.8, 1: 8987.6. Samples: 413334984. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:28,784][121949] Avg episode reward: [(0, '6139.794'), (1, '5978.075')] [2023-12-26 06:03:29,130][123091] Updated weights for policy 0, policy_version 810042 (0.0010) [2023-12-26 06:03:29,193][123091] Updated weights for policy 0, policy_version 810052 (0.0010) [2023-12-26 06:03:29,218][123090] Updated weights for policy 1, policy_version 804578 (0.0008) [2023-12-26 06:03:29,256][123091] Updated weights for policy 0, policy_version 810062 (0.0009) [2023-12-26 06:03:29,278][123090] Updated weights for policy 1, policy_version 804588 (0.0009) [2023-12-26 06:03:29,336][123090] Updated weights for policy 1, policy_version 804598 (0.0010) [2023-12-26 06:03:29,396][123090] Updated weights for policy 1, policy_version 804608 (0.0009) [2023-12-26 06:03:30,009][123091] Updated weights for policy 0, policy_version 810072 (0.0009) [2023-12-26 06:03:30,062][123091] Updated weights for policy 0, policy_version 810082 (0.0009) [2023-12-26 06:03:30,126][123091] Updated weights for policy 0, policy_version 810092 (0.0009) [2023-12-26 06:03:30,242][123090] Updated weights for policy 1, policy_version 804618 (0.0009) [2023-12-26 06:03:30,297][123090] Updated weights for policy 1, policy_version 804628 (0.0009) [2023-12-26 06:03:30,349][123090] Updated weights for policy 1, policy_version 804638 (0.0009) [2023-12-26 06:03:30,886][123091] Updated weights for policy 0, policy_version 810102 (0.0009) [2023-12-26 06:03:30,933][123091] Updated weights for policy 0, policy_version 810112 (0.0009) [2023-12-26 06:03:30,985][123091] Updated weights for policy 0, policy_version 810123 (0.0009) [2023-12-26 06:03:31,211][123090] Updated weights for policy 1, policy_version 804648 (0.0009) [2023-12-26 06:03:31,281][123090] Updated weights for policy 1, policy_version 804659 (0.0010) [2023-12-26 06:03:31,354][123090] Updated weights for policy 1, policy_version 804669 (0.0009) [2023-12-26 06:03:31,842][123091] Updated weights for policy 0, policy_version 810133 (0.0008) [2023-12-26 06:03:31,908][123091] Updated weights for policy 0, policy_version 810143 (0.0010) [2023-12-26 06:03:31,979][123091] Updated weights for policy 0, policy_version 810153 (0.0009) [2023-12-26 06:03:32,124][123090] Updated weights for policy 1, policy_version 804679 (0.0008) [2023-12-26 06:03:32,175][123090] Updated weights for policy 1, policy_version 804689 (0.0009) [2023-12-26 06:03:32,228][123090] Updated weights for policy 1, policy_version 804699 (0.0009) [2023-12-26 06:03:32,819][123091] Updated weights for policy 0, policy_version 810163 (0.0010) [2023-12-26 06:03:32,873][123091] Updated weights for policy 0, policy_version 810173 (0.0010) [2023-12-26 06:03:32,924][123091] Updated weights for policy 0, policy_version 810184 (0.0010) [2023-12-26 06:03:33,094][123090] Updated weights for policy 1, policy_version 804709 (0.0009) [2023-12-26 06:03:33,168][123090] Updated weights for policy 1, policy_version 804719 (0.0009) [2023-12-26 06:03:33,233][123090] Updated weights for policy 1, policy_version 804729 (0.0010) [2023-12-26 06:03:33,652][123091] Updated weights for policy 0, policy_version 810194 (0.0009) [2023-12-26 06:03:33,702][123091] Updated weights for policy 0, policy_version 810204 (0.0010) [2023-12-26 06:03:33,752][123091] Updated weights for policy 0, policy_version 810214 (0.0009) [2023-12-26 06:03:33,784][121949] Fps is (10 sec: 18025.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 413425664. Throughput: 0: 9073.9, 1: 8937.5. Samples: 413441956. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:33,784][121949] Avg episode reward: [(0, '6128.447'), (1, '6013.322')] [2023-12-26 06:03:33,800][123091] Updated weights for policy 0, policy_version 810224 (0.0009) [2023-12-26 06:03:34,070][123090] Updated weights for policy 1, policy_version 804739 (0.0010) [2023-12-26 06:03:34,131][123090] Updated weights for policy 1, policy_version 804749 (0.0009) [2023-12-26 06:03:34,203][123090] Updated weights for policy 1, policy_version 804759 (0.0009) [2023-12-26 06:03:34,690][123091] Updated weights for policy 0, policy_version 810234 (0.0010) [2023-12-26 06:03:34,748][123091] Updated weights for policy 0, policy_version 810244 (0.0010) [2023-12-26 06:03:34,810][123091] Updated weights for policy 0, policy_version 810254 (0.0010) [2023-12-26 06:03:35,025][123090] Updated weights for policy 1, policy_version 804769 (0.0009) [2023-12-26 06:03:35,103][123090] Updated weights for policy 1, policy_version 804779 (0.0010) [2023-12-26 06:03:35,184][123090] Updated weights for policy 1, policy_version 804789 (0.0010) [2023-12-26 06:03:35,253][123090] Updated weights for policy 1, policy_version 804799 (0.0009) [2023-12-26 06:03:35,526][123091] Updated weights for policy 0, policy_version 810264 (0.0006) [2023-12-26 06:03:35,575][123091] Updated weights for policy 0, policy_version 810274 (0.0005) [2023-12-26 06:03:35,623][123091] Updated weights for policy 0, policy_version 810284 (0.0005) [2023-12-26 06:03:36,123][123090] Updated weights for policy 1, policy_version 804809 (0.0009) [2023-12-26 06:03:36,184][123090] Updated weights for policy 1, policy_version 804819 (0.0010) [2023-12-26 06:03:36,251][123090] Updated weights for policy 1, policy_version 804829 (0.0009) [2023-12-26 06:03:36,332][123091] Updated weights for policy 0, policy_version 810294 (0.0009) [2023-12-26 06:03:36,392][123091] Updated weights for policy 0, policy_version 810304 (0.0011) [2023-12-26 06:03:36,456][123091] Updated weights for policy 0, policy_version 810314 (0.0011) [2023-12-26 06:03:37,014][123090] Updated weights for policy 1, policy_version 804839 (0.0009) [2023-12-26 06:03:37,078][123090] Updated weights for policy 1, policy_version 804849 (0.0009) [2023-12-26 06:03:37,136][123090] Updated weights for policy 1, policy_version 804859 (0.0009) [2023-12-26 06:03:37,306][123091] Updated weights for policy 0, policy_version 810324 (0.0011) [2023-12-26 06:03:37,369][123091] Updated weights for policy 0, policy_version 810334 (0.0010) [2023-12-26 06:03:37,420][123091] Updated weights for policy 0, policy_version 810344 (0.0010) [2023-12-26 06:03:37,923][123090] Updated weights for policy 1, policy_version 804869 (0.0010) [2023-12-26 06:03:37,994][123090] Updated weights for policy 1, policy_version 804879 (0.0010) [2023-12-26 06:03:38,053][123090] Updated weights for policy 1, policy_version 804889 (0.0010) [2023-12-26 06:03:38,250][123091] Updated weights for policy 0, policy_version 810354 (0.0011) [2023-12-26 06:03:38,312][123091] Updated weights for policy 0, policy_version 810364 (0.0010) [2023-12-26 06:03:38,382][123091] Updated weights for policy 0, policy_version 810374 (0.0008) [2023-12-26 06:03:38,449][123091] Updated weights for policy 0, policy_version 810384 (0.0009) [2023-12-26 06:03:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 413515776. Throughput: 0: 9039.8, 1: 8954.6. Samples: 413494040. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:38,785][121949] Avg episode reward: [(0, '6204.972'), (1, '6010.186')] [2023-12-26 06:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000810384_207462400.pth... [2023-12-26 06:03:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000804896_206053376.pth... [2023-12-26 06:03:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000803872_205791232.pth [2023-12-26 06:03:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000809360_207200256.pth [2023-12-26 06:03:38,878][123090] Updated weights for policy 1, policy_version 804899 (0.0009) [2023-12-26 06:03:38,947][123090] Updated weights for policy 1, policy_version 804909 (0.0006) [2023-12-26 06:03:39,012][123090] Updated weights for policy 1, policy_version 804919 (0.0010) [2023-12-26 06:03:39,214][123091] Updated weights for policy 0, policy_version 810394 (0.0009) [2023-12-26 06:03:39,280][123091] Updated weights for policy 0, policy_version 810404 (0.0007) [2023-12-26 06:03:39,338][123091] Updated weights for policy 0, policy_version 810414 (0.0006) [2023-12-26 06:03:39,795][123090] Updated weights for policy 1, policy_version 804929 (0.0010) [2023-12-26 06:03:39,867][123090] Updated weights for policy 1, policy_version 804939 (0.0010) [2023-12-26 06:03:39,941][123090] Updated weights for policy 1, policy_version 804949 (0.0010) [2023-12-26 06:03:40,010][123090] Updated weights for policy 1, policy_version 804959 (0.0009) [2023-12-26 06:03:40,128][123091] Updated weights for policy 0, policy_version 810424 (0.0010) [2023-12-26 06:03:40,191][123091] Updated weights for policy 0, policy_version 810434 (0.0009) [2023-12-26 06:03:40,245][123091] Updated weights for policy 0, policy_version 810444 (0.0009) [2023-12-26 06:03:40,779][123090] Updated weights for policy 1, policy_version 804969 (0.0006) [2023-12-26 06:03:40,837][123090] Updated weights for policy 1, policy_version 804979 (0.0005) [2023-12-26 06:03:40,887][123090] Updated weights for policy 1, policy_version 804989 (0.0006) [2023-12-26 06:03:40,969][123091] Updated weights for policy 0, policy_version 810454 (0.0007) [2023-12-26 06:03:41,042][123091] Updated weights for policy 0, policy_version 810464 (0.0006) [2023-12-26 06:03:41,107][123091] Updated weights for policy 0, policy_version 810474 (0.0006) [2023-12-26 06:03:41,608][123090] Updated weights for policy 1, policy_version 804999 (0.0006) [2023-12-26 06:03:41,678][123090] Updated weights for policy 1, policy_version 805009 (0.0010) [2023-12-26 06:03:41,755][123090] Updated weights for policy 1, policy_version 805019 (0.0009) [2023-12-26 06:03:41,888][123091] Updated weights for policy 0, policy_version 810484 (0.0007) [2023-12-26 06:03:41,961][123091] Updated weights for policy 0, policy_version 810494 (0.0008) [2023-12-26 06:03:42,035][123091] Updated weights for policy 0, policy_version 810504 (0.0010) [2023-12-26 06:03:42,596][123090] Updated weights for policy 1, policy_version 805029 (0.0009) [2023-12-26 06:03:42,659][123090] Updated weights for policy 1, policy_version 805039 (0.0009) [2023-12-26 06:03:42,728][123090] Updated weights for policy 1, policy_version 805049 (0.0009) [2023-12-26 06:03:42,796][123091] Updated weights for policy 0, policy_version 810514 (0.0009) [2023-12-26 06:03:42,859][123091] Updated weights for policy 0, policy_version 810524 (0.0010) [2023-12-26 06:03:42,916][123091] Updated weights for policy 0, policy_version 810534 (0.0010) [2023-12-26 06:03:42,970][123091] Updated weights for policy 0, policy_version 810544 (0.0010) [2023-12-26 06:03:43,426][123090] Updated weights for policy 1, policy_version 805059 (0.0010) [2023-12-26 06:03:43,479][123090] Updated weights for policy 1, policy_version 805069 (0.0009) [2023-12-26 06:03:43,530][123090] Updated weights for policy 1, policy_version 805079 (0.0009) [2023-12-26 06:03:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 413605888. Throughput: 0: 8912.8, 1: 8973.3. Samples: 413599428. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:43,785][121949] Avg episode reward: [(0, '6104.830'), (1, '6002.391')] [2023-12-26 06:03:43,839][123091] Updated weights for policy 0, policy_version 810554 (0.0010) [2023-12-26 06:03:43,896][123091] Updated weights for policy 0, policy_version 810564 (0.0009) [2023-12-26 06:03:43,947][123091] Updated weights for policy 0, policy_version 810574 (0.0010) [2023-12-26 06:03:44,253][123090] Updated weights for policy 1, policy_version 805089 (0.0009) [2023-12-26 06:03:44,312][123090] Updated weights for policy 1, policy_version 805099 (0.0005) [2023-12-26 06:03:44,369][123090] Updated weights for policy 1, policy_version 805109 (0.0005) [2023-12-26 06:03:44,430][123090] Updated weights for policy 1, policy_version 805119 (0.0006) [2023-12-26 06:03:44,822][123091] Updated weights for policy 0, policy_version 810584 (0.0008) [2023-12-26 06:03:44,884][123091] Updated weights for policy 0, policy_version 810594 (0.0009) [2023-12-26 06:03:44,958][123091] Updated weights for policy 0, policy_version 810604 (0.0010) [2023-12-26 06:03:45,229][123090] Updated weights for policy 1, policy_version 805129 (0.0005) [2023-12-26 06:03:45,294][123090] Updated weights for policy 1, policy_version 805139 (0.0005) [2023-12-26 06:03:45,355][123090] Updated weights for policy 1, policy_version 805149 (0.0005) [2023-12-26 06:03:45,878][123091] Updated weights for policy 0, policy_version 810614 (0.0009) [2023-12-26 06:03:45,946][123091] Updated weights for policy 0, policy_version 810624 (0.0009) [2023-12-26 06:03:46,007][123091] Updated weights for policy 0, policy_version 810634 (0.0009) [2023-12-26 06:03:46,022][123090] Updated weights for policy 1, policy_version 805159 (0.0007) [2023-12-26 06:03:46,093][123090] Updated weights for policy 1, policy_version 805169 (0.0007) [2023-12-26 06:03:46,161][123090] Updated weights for policy 1, policy_version 805179 (0.0008) [2023-12-26 06:03:46,819][123090] Updated weights for policy 1, policy_version 805189 (0.0008) [2023-12-26 06:03:46,892][123090] Updated weights for policy 1, policy_version 805199 (0.0010) [2023-12-26 06:03:46,915][123091] Updated weights for policy 0, policy_version 810644 (0.0009) [2023-12-26 06:03:46,951][123090] Updated weights for policy 1, policy_version 805209 (0.0010) [2023-12-26 06:03:46,968][123091] Updated weights for policy 0, policy_version 810654 (0.0006) [2023-12-26 06:03:47,033][123091] Updated weights for policy 0, policy_version 810664 (0.0008) [2023-12-26 06:03:47,594][123090] Updated weights for policy 1, policy_version 805219 (0.0009) [2023-12-26 06:03:47,658][123090] Updated weights for policy 1, policy_version 805229 (0.0009) [2023-12-26 06:03:47,727][123090] Updated weights for policy 1, policy_version 805239 (0.0008) [2023-12-26 06:03:47,964][123091] Updated weights for policy 0, policy_version 810674 (0.0010) [2023-12-26 06:03:48,039][123091] Updated weights for policy 0, policy_version 810684 (0.0009) [2023-12-26 06:03:48,112][123091] Updated weights for policy 0, policy_version 810694 (0.0010) [2023-12-26 06:03:48,175][123091] Updated weights for policy 0, policy_version 810704 (0.0010) [2023-12-26 06:03:48,407][123090] Updated weights for policy 1, policy_version 805249 (0.0006) [2023-12-26 06:03:48,472][123090] Updated weights for policy 1, policy_version 805259 (0.0007) [2023-12-26 06:03:48,535][123090] Updated weights for policy 1, policy_version 805269 (0.0006) [2023-12-26 06:03:48,600][123090] Updated weights for policy 1, policy_version 805279 (0.0009) [2023-12-26 06:03:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 413696000. Throughput: 0: 8773.8, 1: 9045.2. Samples: 413706520. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:48,785][121949] Avg episode reward: [(0, '6197.618'), (1, '5949.096')] [2023-12-26 06:03:48,948][123091] Updated weights for policy 0, policy_version 810714 (0.0009) [2023-12-26 06:03:49,018][123091] Updated weights for policy 0, policy_version 810724 (0.0010) [2023-12-26 06:03:49,079][123091] Updated weights for policy 0, policy_version 810734 (0.0010) [2023-12-26 06:03:49,403][123090] Updated weights for policy 1, policy_version 805289 (0.0009) [2023-12-26 06:03:49,473][123090] Updated weights for policy 1, policy_version 805299 (0.0009) [2023-12-26 06:03:49,547][123090] Updated weights for policy 1, policy_version 805309 (0.0009) [2023-12-26 06:03:49,992][123091] Updated weights for policy 0, policy_version 810744 (0.0009) [2023-12-26 06:03:50,050][123091] Updated weights for policy 0, policy_version 810754 (0.0009) [2023-12-26 06:03:50,099][123091] Updated weights for policy 0, policy_version 810764 (0.0009) [2023-12-26 06:03:50,429][123090] Updated weights for policy 1, policy_version 805319 (0.0010) [2023-12-26 06:03:50,496][123090] Updated weights for policy 1, policy_version 805329 (0.0009) [2023-12-26 06:03:50,559][123090] Updated weights for policy 1, policy_version 805339 (0.0009) [2023-12-26 06:03:50,960][123091] Updated weights for policy 0, policy_version 810774 (0.0009) [2023-12-26 06:03:51,019][123091] Updated weights for policy 0, policy_version 810785 (0.0011) [2023-12-26 06:03:51,086][123091] Updated weights for policy 0, policy_version 810795 (0.0009) [2023-12-26 06:03:51,369][123090] Updated weights for policy 1, policy_version 805349 (0.0010) [2023-12-26 06:03:51,437][123090] Updated weights for policy 1, policy_version 805359 (0.0009) [2023-12-26 06:03:51,491][123090] Updated weights for policy 1, policy_version 805369 (0.0009) [2023-12-26 06:03:51,920][123091] Updated weights for policy 0, policy_version 810805 (0.0007) [2023-12-26 06:03:51,986][123091] Updated weights for policy 0, policy_version 810815 (0.0006) [2023-12-26 06:03:52,059][123091] Updated weights for policy 0, policy_version 810825 (0.0006) [2023-12-26 06:03:52,317][123090] Updated weights for policy 1, policy_version 805379 (0.0009) [2023-12-26 06:03:52,387][123090] Updated weights for policy 1, policy_version 805389 (0.0010) [2023-12-26 06:03:52,461][123090] Updated weights for policy 1, policy_version 805399 (0.0010) [2023-12-26 06:03:52,760][123091] Updated weights for policy 0, policy_version 810835 (0.0009) [2023-12-26 06:03:52,828][123091] Updated weights for policy 0, policy_version 810845 (0.0009) [2023-12-26 06:03:52,894][123091] Updated weights for policy 0, policy_version 810855 (0.0007) [2023-12-26 06:03:53,403][123090] Updated weights for policy 1, policy_version 805409 (0.0010) [2023-12-26 06:03:53,459][123090] Updated weights for policy 1, policy_version 805419 (0.0010) [2023-12-26 06:03:53,513][123090] Updated weights for policy 1, policy_version 805429 (0.0010) [2023-12-26 06:03:53,566][123090] Updated weights for policy 1, policy_version 805439 (0.0010) [2023-12-26 06:03:53,588][123091] Updated weights for policy 0, policy_version 810865 (0.0006) [2023-12-26 06:03:53,646][123091] Updated weights for policy 0, policy_version 810875 (0.0009) [2023-12-26 06:03:53,699][123091] Updated weights for policy 0, policy_version 810885 (0.0010) [2023-12-26 06:03:53,752][123091] Updated weights for policy 0, policy_version 810895 (0.0009) [2023-12-26 06:03:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 413786112. Throughput: 0: 8737.2, 1: 8970.7. Samples: 413756356. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:53,785][121949] Avg episode reward: [(0, '6343.382'), (1, '5949.444')] [2023-12-26 06:03:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000810896_207593472.pth... [2023-12-26 06:03:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000805440_206192640.pth... [2023-12-26 06:03:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000809840_207323136.pth [2023-12-26 06:03:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000804384_205922304.pth [2023-12-26 06:03:54,464][123090] Updated weights for policy 1, policy_version 805449 (0.0010) [2023-12-26 06:03:54,532][123091] Updated weights for policy 0, policy_version 810905 (0.0007) [2023-12-26 06:03:54,535][123090] Updated weights for policy 1, policy_version 805459 (0.0008) [2023-12-26 06:03:54,585][123091] Updated weights for policy 0, policy_version 810915 (0.0006) [2023-12-26 06:03:54,597][123090] Updated weights for policy 1, policy_version 805469 (0.0009) [2023-12-26 06:03:54,646][123091] Updated weights for policy 0, policy_version 810925 (0.0008) [2023-12-26 06:03:55,314][123090] Updated weights for policy 1, policy_version 805479 (0.0008) [2023-12-26 06:03:55,378][123090] Updated weights for policy 1, policy_version 805489 (0.0005) [2023-12-26 06:03:55,391][123091] Updated weights for policy 0, policy_version 810935 (0.0008) [2023-12-26 06:03:55,445][123090] Updated weights for policy 1, policy_version 805499 (0.0006) [2023-12-26 06:03:55,448][123091] Updated weights for policy 0, policy_version 810945 (0.0009) [2023-12-26 06:03:55,516][123091] Updated weights for policy 0, policy_version 810955 (0.0009) [2023-12-26 06:03:56,089][123090] Updated weights for policy 1, policy_version 805509 (0.0008) [2023-12-26 06:03:56,151][123090] Updated weights for policy 1, policy_version 805519 (0.0009) [2023-12-26 06:03:56,207][123090] Updated weights for policy 1, policy_version 805529 (0.0009) [2023-12-26 06:03:56,368][123091] Updated weights for policy 0, policy_version 810965 (0.0010) [2023-12-26 06:03:56,426][123091] Updated weights for policy 0, policy_version 810975 (0.0010) [2023-12-26 06:03:56,485][123091] Updated weights for policy 0, policy_version 810985 (0.0010) [2023-12-26 06:03:56,965][123090] Updated weights for policy 1, policy_version 805539 (0.0008) [2023-12-26 06:03:57,023][123090] Updated weights for policy 1, policy_version 805549 (0.0009) [2023-12-26 06:03:57,092][123090] Updated weights for policy 1, policy_version 805559 (0.0008) [2023-12-26 06:03:57,359][123091] Updated weights for policy 0, policy_version 810996 (0.0010) [2023-12-26 06:03:57,416][123091] Updated weights for policy 0, policy_version 811006 (0.0010) [2023-12-26 06:03:57,471][123091] Updated weights for policy 0, policy_version 811016 (0.0010) [2023-12-26 06:03:57,837][123090] Updated weights for policy 1, policy_version 805569 (0.0010) [2023-12-26 06:03:57,892][123090] Updated weights for policy 1, policy_version 805579 (0.0008) [2023-12-26 06:03:57,946][123090] Updated weights for policy 1, policy_version 805589 (0.0008) [2023-12-26 06:03:58,013][123090] Updated weights for policy 1, policy_version 805599 (0.0007) [2023-12-26 06:03:58,405][123091] Updated weights for policy 0, policy_version 811026 (0.0009) [2023-12-26 06:03:58,477][123091] Updated weights for policy 0, policy_version 811036 (0.0008) [2023-12-26 06:03:58,544][123091] Updated weights for policy 0, policy_version 811046 (0.0008) [2023-12-26 06:03:58,616][123091] Updated weights for policy 0, policy_version 811056 (0.0008) [2023-12-26 06:03:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 413868032. Throughput: 0: 8795.1, 1: 9012.3. Samples: 413864000. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:03:58,785][121949] Avg episode reward: [(0, '6305.959'), (1, '6000.882')] [2023-12-26 06:03:58,851][123090] Updated weights for policy 1, policy_version 805609 (0.0008) [2023-12-26 06:03:58,926][123090] Updated weights for policy 1, policy_version 805619 (0.0006) [2023-12-26 06:03:58,992][123090] Updated weights for policy 1, policy_version 805629 (0.0011) [2023-12-26 06:03:59,369][123091] Updated weights for policy 0, policy_version 811066 (0.0009) [2023-12-26 06:03:59,435][123091] Updated weights for policy 0, policy_version 811076 (0.0009) [2023-12-26 06:03:59,492][123091] Updated weights for policy 0, policy_version 811086 (0.0009) [2023-12-26 06:03:59,823][123090] Updated weights for policy 1, policy_version 805639 (0.0010) [2023-12-26 06:03:59,894][123090] Updated weights for policy 1, policy_version 805649 (0.0007) [2023-12-26 06:03:59,966][123090] Updated weights for policy 1, policy_version 805659 (0.0007) [2023-12-26 06:04:00,337][123091] Updated weights for policy 0, policy_version 811096 (0.0010) [2023-12-26 06:04:00,395][123091] Updated weights for policy 0, policy_version 811106 (0.0010) [2023-12-26 06:04:00,446][123091] Updated weights for policy 0, policy_version 811116 (0.0010) [2023-12-26 06:04:00,675][123090] Updated weights for policy 1, policy_version 805669 (0.0006) [2023-12-26 06:04:00,734][123090] Updated weights for policy 1, policy_version 805679 (0.0005) [2023-12-26 06:04:00,800][123090] Updated weights for policy 1, policy_version 805690 (0.0007) [2023-12-26 06:04:01,225][123091] Updated weights for policy 0, policy_version 811126 (0.0008) [2023-12-26 06:04:01,289][123091] Updated weights for policy 0, policy_version 811136 (0.0010) [2023-12-26 06:04:01,353][123091] Updated weights for policy 0, policy_version 811146 (0.0011) [2023-12-26 06:04:01,488][123090] Updated weights for policy 1, policy_version 805700 (0.0006) [2023-12-26 06:04:01,553][123090] Updated weights for policy 1, policy_version 805710 (0.0008) [2023-12-26 06:04:01,614][123090] Updated weights for policy 1, policy_version 805720 (0.0008) [2023-12-26 06:04:02,187][123091] Updated weights for policy 0, policy_version 811156 (0.0011) [2023-12-26 06:04:02,245][123091] Updated weights for policy 0, policy_version 811166 (0.0010) [2023-12-26 06:04:02,304][123091] Updated weights for policy 0, policy_version 811176 (0.0010) [2023-12-26 06:04:02,351][123090] Updated weights for policy 1, policy_version 805730 (0.0008) [2023-12-26 06:04:02,412][123090] Updated weights for policy 1, policy_version 805740 (0.0010) [2023-12-26 06:04:02,477][123090] Updated weights for policy 1, policy_version 805750 (0.0005) [2023-12-26 06:04:02,544][123090] Updated weights for policy 1, policy_version 805760 (0.0006) [2023-12-26 06:04:03,150][123091] Updated weights for policy 0, policy_version 811186 (0.0011) [2023-12-26 06:04:03,211][123091] Updated weights for policy 0, policy_version 811196 (0.0011) [2023-12-26 06:04:03,266][123091] Updated weights for policy 0, policy_version 811206 (0.0011) [2023-12-26 06:04:03,274][123090] Updated weights for policy 1, policy_version 805770 (0.0008) [2023-12-26 06:04:03,326][123091] Updated weights for policy 0, policy_version 811216 (0.0011) [2023-12-26 06:04:03,329][123090] Updated weights for policy 1, policy_version 805780 (0.0006) [2023-12-26 06:04:03,383][123090] Updated weights for policy 1, policy_version 805790 (0.0009) [2023-12-26 06:04:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 413958144. Throughput: 0: 8758.4, 1: 8978.7. Samples: 413969908. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:03,785][121949] Avg episode reward: [(0, '6076.292'), (1, '6003.386')] [2023-12-26 06:04:04,151][123091] Updated weights for policy 0, policy_version 811226 (0.0011) [2023-12-26 06:04:04,203][123091] Updated weights for policy 0, policy_version 811236 (0.0010) [2023-12-26 06:04:04,246][123090] Updated weights for policy 1, policy_version 805800 (0.0006) [2023-12-26 06:04:04,266][123091] Updated weights for policy 0, policy_version 811246 (0.0010) [2023-12-26 06:04:04,296][123090] Updated weights for policy 1, policy_version 805810 (0.0005) [2023-12-26 06:04:04,345][123090] Updated weights for policy 1, policy_version 805820 (0.0005) [2023-12-26 06:04:05,046][123090] Updated weights for policy 1, policy_version 805830 (0.0008) [2023-12-26 06:04:05,051][123091] Updated weights for policy 0, policy_version 811256 (0.0007) [2023-12-26 06:04:05,105][123091] Updated weights for policy 0, policy_version 811266 (0.0005) [2023-12-26 06:04:05,107][123090] Updated weights for policy 1, policy_version 805840 (0.0009) [2023-12-26 06:04:05,171][123091] Updated weights for policy 0, policy_version 811276 (0.0008) [2023-12-26 06:04:05,173][123090] Updated weights for policy 1, policy_version 805850 (0.0007) [2023-12-26 06:04:05,843][123090] Updated weights for policy 1, policy_version 805860 (0.0009) [2023-12-26 06:04:05,874][123091] Updated weights for policy 0, policy_version 811286 (0.0008) [2023-12-26 06:04:05,890][123090] Updated weights for policy 1, policy_version 805870 (0.0008) [2023-12-26 06:04:05,926][123091] Updated weights for policy 0, policy_version 811296 (0.0010) [2023-12-26 06:04:05,942][123090] Updated weights for policy 1, policy_version 805880 (0.0007) [2023-12-26 06:04:05,994][123091] Updated weights for policy 0, policy_version 811306 (0.0011) [2023-12-26 06:04:06,828][123091] Updated weights for policy 0, policy_version 811316 (0.0011) [2023-12-26 06:04:06,830][123090] Updated weights for policy 1, policy_version 805890 (0.0009) [2023-12-26 06:04:06,884][123090] Updated weights for policy 1, policy_version 805900 (0.0007) [2023-12-26 06:04:06,892][123091] Updated weights for policy 0, policy_version 811326 (0.0011) [2023-12-26 06:04:06,937][123090] Updated weights for policy 1, policy_version 805910 (0.0009) [2023-12-26 06:04:06,942][123091] Updated weights for policy 0, policy_version 811336 (0.0008) [2023-12-26 06:04:07,001][123090] Updated weights for policy 1, policy_version 805920 (0.0009) [2023-12-26 06:04:07,675][123091] Updated weights for policy 0, policy_version 811346 (0.0008) [2023-12-26 06:04:07,726][123091] Updated weights for policy 0, policy_version 811356 (0.0010) [2023-12-26 06:04:07,729][123090] Updated weights for policy 1, policy_version 805930 (0.0006) [2023-12-26 06:04:07,777][123091] Updated weights for policy 0, policy_version 811366 (0.0010) [2023-12-26 06:04:07,784][123090] Updated weights for policy 1, policy_version 805940 (0.0006) [2023-12-26 06:04:07,824][123091] Updated weights for policy 0, policy_version 811376 (0.0010) [2023-12-26 06:04:07,835][123090] Updated weights for policy 1, policy_version 805950 (0.0006) [2023-12-26 06:04:08,684][123091] Updated weights for policy 0, policy_version 811386 (0.0011) [2023-12-26 06:04:08,700][123090] Updated weights for policy 1, policy_version 805960 (0.0006) [2023-12-26 06:04:08,744][123091] Updated weights for policy 0, policy_version 811396 (0.0010) [2023-12-26 06:04:08,760][123090] Updated weights for policy 1, policy_version 805970 (0.0007) [2023-12-26 06:04:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 414040064. Throughput: 0: 8812.6, 1: 9006.4. Samples: 414024736. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:08,785][121949] Avg episode reward: [(0, '6162.695'), (1, '6005.159')] [2023-12-26 06:04:08,800][123091] Updated weights for policy 0, policy_version 811406 (0.0010) [2023-12-26 06:04:08,810][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000811408_207724544.pth... [2023-12-26 06:04:08,814][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000810384_207462400.pth [2023-12-26 06:04:08,828][123090] Updated weights for policy 1, policy_version 805980 (0.0006) [2023-12-26 06:04:08,854][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000805984_206331904.pth... [2023-12-26 06:04:08,857][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000804896_206053376.pth [2023-12-26 06:04:09,660][123091] Updated weights for policy 0, policy_version 811416 (0.0011) [2023-12-26 06:04:09,704][123090] Updated weights for policy 1, policy_version 805990 (0.0010) [2023-12-26 06:04:09,724][123091] Updated weights for policy 0, policy_version 811426 (0.0011) [2023-12-26 06:04:09,766][123090] Updated weights for policy 1, policy_version 806000 (0.0006) [2023-12-26 06:04:09,789][123091] Updated weights for policy 0, policy_version 811436 (0.0009) [2023-12-26 06:04:09,828][123090] Updated weights for policy 1, policy_version 806010 (0.0009) [2023-12-26 06:04:10,597][123091] Updated weights for policy 0, policy_version 811446 (0.0011) [2023-12-26 06:04:10,644][123090] Updated weights for policy 1, policy_version 806020 (0.0009) [2023-12-26 06:04:10,661][123091] Updated weights for policy 0, policy_version 811456 (0.0011) [2023-12-26 06:04:10,718][123090] Updated weights for policy 1, policy_version 806030 (0.0006) [2023-12-26 06:04:10,718][123091] Updated weights for policy 0, policy_version 811466 (0.0011) [2023-12-26 06:04:10,779][123090] Updated weights for policy 1, policy_version 806040 (0.0005) [2023-12-26 06:04:11,571][123091] Updated weights for policy 0, policy_version 811476 (0.0010) [2023-12-26 06:04:11,604][123090] Updated weights for policy 1, policy_version 806050 (0.0008) [2023-12-26 06:04:11,640][123091] Updated weights for policy 0, policy_version 811486 (0.0009) [2023-12-26 06:04:11,682][123090] Updated weights for policy 1, policy_version 806060 (0.0009) [2023-12-26 06:04:11,707][123091] Updated weights for policy 0, policy_version 811496 (0.0007) [2023-12-26 06:04:11,747][123090] Updated weights for policy 1, policy_version 806070 (0.0009) [2023-12-26 06:04:11,811][123090] Updated weights for policy 1, policy_version 806080 (0.0009) [2023-12-26 06:04:12,504][123091] Updated weights for policy 0, policy_version 811506 (0.0008) [2023-12-26 06:04:12,564][123091] Updated weights for policy 0, policy_version 811516 (0.0005) [2023-12-26 06:04:12,629][123091] Updated weights for policy 0, policy_version 811526 (0.0005) [2023-12-26 06:04:12,681][123090] Updated weights for policy 1, policy_version 806090 (0.0009) [2023-12-26 06:04:12,692][123091] Updated weights for policy 0, policy_version 811536 (0.0006) [2023-12-26 06:04:12,737][123090] Updated weights for policy 1, policy_version 806100 (0.0010) [2023-12-26 06:04:12,804][123090] Updated weights for policy 1, policy_version 806110 (0.0010) [2023-12-26 06:04:13,449][123091] Updated weights for policy 0, policy_version 811546 (0.0009) [2023-12-26 06:04:13,496][123091] Updated weights for policy 0, policy_version 811556 (0.0009) [2023-12-26 06:04:13,551][123091] Updated weights for policy 0, policy_version 811566 (0.0008) [2023-12-26 06:04:13,594][123090] Updated weights for policy 1, policy_version 806120 (0.0010) [2023-12-26 06:04:13,656][123090] Updated weights for policy 1, policy_version 806130 (0.0010) [2023-12-26 06:04:13,730][123090] Updated weights for policy 1, policy_version 806140 (0.0010) [2023-12-26 06:04:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 414138368. Throughput: 0: 8736.2, 1: 8867.3. Samples: 414127140. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:13,784][121949] Avg episode reward: [(0, '6190.105'), (1, '6004.024')] [2023-12-26 06:04:14,437][123091] Updated weights for policy 0, policy_version 811576 (0.0008) [2023-12-26 06:04:14,471][123090] Updated weights for policy 1, policy_version 806150 (0.0010) [2023-12-26 06:04:14,491][123091] Updated weights for policy 0, policy_version 811586 (0.0006) [2023-12-26 06:04:14,526][123090] Updated weights for policy 1, policy_version 806160 (0.0010) [2023-12-26 06:04:14,553][123091] Updated weights for policy 0, policy_version 811596 (0.0009) [2023-12-26 06:04:14,584][123090] Updated weights for policy 1, policy_version 806170 (0.0010) [2023-12-26 06:04:15,326][123091] Updated weights for policy 0, policy_version 811606 (0.0009) [2023-12-26 06:04:15,338][123090] Updated weights for policy 1, policy_version 806180 (0.0010) [2023-12-26 06:04:15,378][123091] Updated weights for policy 0, policy_version 811616 (0.0007) [2023-12-26 06:04:15,403][123090] Updated weights for policy 1, policy_version 806190 (0.0011) [2023-12-26 06:04:15,432][123091] Updated weights for policy 0, policy_version 811626 (0.0008) [2023-12-26 06:04:15,464][123090] Updated weights for policy 1, policy_version 806200 (0.0011) [2023-12-26 06:04:16,168][123090] Updated weights for policy 1, policy_version 806210 (0.0007) [2023-12-26 06:04:16,242][123090] Updated weights for policy 1, policy_version 806220 (0.0005) [2023-12-26 06:04:16,278][123091] Updated weights for policy 0, policy_version 811636 (0.0006) [2023-12-26 06:04:16,304][123090] Updated weights for policy 1, policy_version 806230 (0.0005) [2023-12-26 06:04:16,335][123091] Updated weights for policy 0, policy_version 811646 (0.0005) [2023-12-26 06:04:16,362][123090] Updated weights for policy 1, policy_version 806240 (0.0005) [2023-12-26 06:04:16,405][123091] Updated weights for policy 0, policy_version 811656 (0.0006) [2023-12-26 06:04:17,011][123090] Updated weights for policy 1, policy_version 806250 (0.0005) [2023-12-26 06:04:17,023][123091] Updated weights for policy 0, policy_version 811666 (0.0005) [2023-12-26 06:04:17,064][123090] Updated weights for policy 1, policy_version 806260 (0.0009) [2023-12-26 06:04:17,071][123091] Updated weights for policy 0, policy_version 811676 (0.0006) [2023-12-26 06:04:17,116][123090] Updated weights for policy 1, policy_version 806270 (0.0010) [2023-12-26 06:04:17,126][123091] Updated weights for policy 0, policy_version 811686 (0.0006) [2023-12-26 06:04:17,175][123091] Updated weights for policy 0, policy_version 811696 (0.0005) [2023-12-26 06:04:17,889][123091] Updated weights for policy 0, policy_version 811706 (0.0006) [2023-12-26 06:04:17,949][123090] Updated weights for policy 1, policy_version 806280 (0.0010) [2023-12-26 06:04:17,963][123091] Updated weights for policy 0, policy_version 811717 (0.0008) [2023-12-26 06:04:18,019][123090] Updated weights for policy 1, policy_version 806290 (0.0008) [2023-12-26 06:04:18,022][123091] Updated weights for policy 0, policy_version 811727 (0.0009) [2023-12-26 06:04:18,081][123090] Updated weights for policy 1, policy_version 806300 (0.0010) [2023-12-26 06:04:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 414220288. Throughput: 0: 8724.5, 1: 8960.7. Samples: 414237792. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:18,785][121949] Avg episode reward: [(0, '6156.069'), (1, '6010.611')] [2023-12-26 06:04:18,797][123091] Updated weights for policy 0, policy_version 811737 (0.0006) [2023-12-26 06:04:18,860][123091] Updated weights for policy 0, policy_version 811747 (0.0009) [2023-12-26 06:04:18,928][123091] Updated weights for policy 0, policy_version 811757 (0.0009) [2023-12-26 06:04:18,951][123090] Updated weights for policy 1, policy_version 806310 (0.0009) [2023-12-26 06:04:19,017][123090] Updated weights for policy 1, policy_version 806320 (0.0010) [2023-12-26 06:04:19,080][123090] Updated weights for policy 1, policy_version 806330 (0.0009) [2023-12-26 06:04:19,695][123091] Updated weights for policy 0, policy_version 811767 (0.0006) [2023-12-26 06:04:19,765][123091] Updated weights for policy 0, policy_version 811777 (0.0007) [2023-12-26 06:04:19,831][123091] Updated weights for policy 0, policy_version 811787 (0.0009) [2023-12-26 06:04:19,927][123090] Updated weights for policy 1, policy_version 806340 (0.0008) [2023-12-26 06:04:19,995][123090] Updated weights for policy 1, policy_version 806350 (0.0006) [2023-12-26 06:04:20,062][123090] Updated weights for policy 1, policy_version 806360 (0.0010) [2023-12-26 06:04:20,678][123091] Updated weights for policy 0, policy_version 811797 (0.0009) [2023-12-26 06:04:20,733][123091] Updated weights for policy 0, policy_version 811807 (0.0008) [2023-12-26 06:04:20,795][123091] Updated weights for policy 0, policy_version 811817 (0.0009) [2023-12-26 06:04:20,897][123090] Updated weights for policy 1, policy_version 806370 (0.0009) [2023-12-26 06:04:20,968][123090] Updated weights for policy 1, policy_version 806380 (0.0010) [2023-12-26 06:04:21,038][123090] Updated weights for policy 1, policy_version 806390 (0.0009) [2023-12-26 06:04:21,107][123090] Updated weights for policy 1, policy_version 806400 (0.0010) [2023-12-26 06:04:21,692][123091] Updated weights for policy 0, policy_version 811827 (0.0010) [2023-12-26 06:04:21,764][123091] Updated weights for policy 0, policy_version 811837 (0.0010) [2023-12-26 06:04:21,831][123091] Updated weights for policy 0, policy_version 811847 (0.0006) [2023-12-26 06:04:21,936][123090] Updated weights for policy 1, policy_version 806410 (0.0009) [2023-12-26 06:04:21,995][123090] Updated weights for policy 1, policy_version 806420 (0.0010) [2023-12-26 06:04:22,056][123090] Updated weights for policy 1, policy_version 806430 (0.0009) [2023-12-26 06:04:22,610][123091] Updated weights for policy 0, policy_version 811857 (0.0006) [2023-12-26 06:04:22,673][123091] Updated weights for policy 0, policy_version 811867 (0.0010) [2023-12-26 06:04:22,740][123091] Updated weights for policy 0, policy_version 811877 (0.0010) [2023-12-26 06:04:22,806][123091] Updated weights for policy 0, policy_version 811887 (0.0010) [2023-12-26 06:04:22,902][123090] Updated weights for policy 1, policy_version 806440 (0.0011) [2023-12-26 06:04:22,969][123090] Updated weights for policy 1, policy_version 806450 (0.0009) [2023-12-26 06:04:23,029][123090] Updated weights for policy 1, policy_version 806460 (0.0008) [2023-12-26 06:04:23,604][123091] Updated weights for policy 0, policy_version 811897 (0.0008) [2023-12-26 06:04:23,672][123091] Updated weights for policy 0, policy_version 811907 (0.0006) [2023-12-26 06:04:23,744][123091] Updated weights for policy 0, policy_version 811917 (0.0005) [2023-12-26 06:04:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.8, 300 sec: 17716.9). Total num frames: 414310400. Throughput: 0: 8687.9, 1: 8953.6. Samples: 414287908. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:23,786][121949] Avg episode reward: [(0, '6271.369'), (1, '5977.163')] [2023-12-26 06:04:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000811920_207855616.pth... [2023-12-26 06:04:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000806464_206454784.pth... [2023-12-26 06:04:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000810896_207593472.pth [2023-12-26 06:04:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000805440_206192640.pth [2023-12-26 06:04:23,888][123090] Updated weights for policy 1, policy_version 806470 (0.0009) [2023-12-26 06:04:23,942][123090] Updated weights for policy 1, policy_version 806480 (0.0009) [2023-12-26 06:04:24,001][123090] Updated weights for policy 1, policy_version 806490 (0.0009) [2023-12-26 06:04:24,441][123091] Updated weights for policy 0, policy_version 811927 (0.0009) [2023-12-26 06:04:24,503][123091] Updated weights for policy 0, policy_version 811937 (0.0009) [2023-12-26 06:04:24,565][123091] Updated weights for policy 0, policy_version 811947 (0.0009) [2023-12-26 06:04:24,851][123090] Updated weights for policy 1, policy_version 806500 (0.0008) [2023-12-26 06:04:24,912][123090] Updated weights for policy 1, policy_version 806510 (0.0006) [2023-12-26 06:04:24,985][123090] Updated weights for policy 1, policy_version 806520 (0.0006) [2023-12-26 06:04:25,281][123091] Updated weights for policy 0, policy_version 811957 (0.0007) [2023-12-26 06:04:25,327][123091] Updated weights for policy 0, policy_version 811967 (0.0005) [2023-12-26 06:04:25,384][123091] Updated weights for policy 0, policy_version 811977 (0.0005) [2023-12-26 06:04:25,672][123090] Updated weights for policy 1, policy_version 806530 (0.0007) [2023-12-26 06:04:25,719][123090] Updated weights for policy 1, policy_version 806540 (0.0008) [2023-12-26 06:04:25,767][123090] Updated weights for policy 1, policy_version 806550 (0.0008) [2023-12-26 06:04:25,818][123090] Updated weights for policy 1, policy_version 806560 (0.0008) [2023-12-26 06:04:26,196][123091] Updated weights for policy 0, policy_version 811987 (0.0007) [2023-12-26 06:04:26,243][123091] Updated weights for policy 0, policy_version 811997 (0.0010) [2023-12-26 06:04:26,301][123091] Updated weights for policy 0, policy_version 812007 (0.0010) [2023-12-26 06:04:26,700][123090] Updated weights for policy 1, policy_version 806570 (0.0009) [2023-12-26 06:04:26,764][123090] Updated weights for policy 1, policy_version 806580 (0.0009) [2023-12-26 06:04:26,825][123090] Updated weights for policy 1, policy_version 806590 (0.0009) [2023-12-26 06:04:27,109][123091] Updated weights for policy 0, policy_version 812017 (0.0010) [2023-12-26 06:04:27,163][123091] Updated weights for policy 0, policy_version 812027 (0.0005) [2023-12-26 06:04:27,207][123091] Updated weights for policy 0, policy_version 812037 (0.0005) [2023-12-26 06:04:27,255][123091] Updated weights for policy 0, policy_version 812047 (0.0005) [2023-12-26 06:04:27,595][123090] Updated weights for policy 1, policy_version 806600 (0.0006) [2023-12-26 06:04:27,650][123090] Updated weights for policy 1, policy_version 806610 (0.0005) [2023-12-26 06:04:27,695][123090] Updated weights for policy 1, policy_version 806620 (0.0005) [2023-12-26 06:04:27,979][123091] Updated weights for policy 0, policy_version 812057 (0.0005) [2023-12-26 06:04:28,036][123091] Updated weights for policy 0, policy_version 812067 (0.0006) [2023-12-26 06:04:28,103][123091] Updated weights for policy 0, policy_version 812077 (0.0007) [2023-12-26 06:04:28,393][123090] Updated weights for policy 1, policy_version 806631 (0.0008) [2023-12-26 06:04:28,455][123090] Updated weights for policy 1, policy_version 806641 (0.0008) [2023-12-26 06:04:28,511][123090] Updated weights for policy 1, policy_version 806651 (0.0010) [2023-12-26 06:04:28,729][123091] Updated weights for policy 0, policy_version 812087 (0.0006) [2023-12-26 06:04:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 414400512. Throughput: 0: 8741.2, 1: 8934.7. Samples: 414394840. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:28,784][121949] Avg episode reward: [(0, '6130.486'), (1, '5976.254')] [2023-12-26 06:04:28,787][123091] Updated weights for policy 0, policy_version 812097 (0.0005) [2023-12-26 06:04:28,860][123091] Updated weights for policy 0, policy_version 812107 (0.0006) [2023-12-26 06:04:29,334][123090] Updated weights for policy 1, policy_version 806661 (0.0008) [2023-12-26 06:04:29,401][123090] Updated weights for policy 1, policy_version 806671 (0.0007) [2023-12-26 06:04:29,468][123090] Updated weights for policy 1, policy_version 806681 (0.0006) [2023-12-26 06:04:29,488][123091] Updated weights for policy 0, policy_version 812117 (0.0008) [2023-12-26 06:04:29,544][123091] Updated weights for policy 0, policy_version 812127 (0.0011) [2023-12-26 06:04:29,611][123091] Updated weights for policy 0, policy_version 812137 (0.0007) [2023-12-26 06:04:30,087][123090] Updated weights for policy 1, policy_version 806691 (0.0007) [2023-12-26 06:04:30,149][123090] Updated weights for policy 1, policy_version 806701 (0.0006) [2023-12-26 06:04:30,208][123090] Updated weights for policy 1, policy_version 806711 (0.0010) [2023-12-26 06:04:30,318][123091] Updated weights for policy 0, policy_version 812147 (0.0006) [2023-12-26 06:04:30,367][123091] Updated weights for policy 0, policy_version 812157 (0.0006) [2023-12-26 06:04:30,414][123091] Updated weights for policy 0, policy_version 812167 (0.0005) [2023-12-26 06:04:31,001][123090] Updated weights for policy 1, policy_version 806721 (0.0009) [2023-12-26 06:04:31,071][123090] Updated weights for policy 1, policy_version 806731 (0.0007) [2023-12-26 06:04:31,133][123090] Updated weights for policy 1, policy_version 806741 (0.0008) [2023-12-26 06:04:31,166][123091] Updated weights for policy 0, policy_version 812177 (0.0008) [2023-12-26 06:04:31,193][123090] Updated weights for policy 1, policy_version 806751 (0.0009) [2023-12-26 06:04:31,224][123091] Updated weights for policy 0, policy_version 812187 (0.0005) [2023-12-26 06:04:31,291][123091] Updated weights for policy 0, policy_version 812197 (0.0006) [2023-12-26 06:04:31,363][123091] Updated weights for policy 0, policy_version 812207 (0.0007) [2023-12-26 06:04:31,948][123090] Updated weights for policy 1, policy_version 806761 (0.0009) [2023-12-26 06:04:32,010][123090] Updated weights for policy 1, policy_version 806771 (0.0009) [2023-12-26 06:04:32,077][123090] Updated weights for policy 1, policy_version 806781 (0.0009) [2023-12-26 06:04:32,149][123091] Updated weights for policy 0, policy_version 812217 (0.0009) [2023-12-26 06:04:32,201][123091] Updated weights for policy 0, policy_version 812227 (0.0009) [2023-12-26 06:04:32,263][123091] Updated weights for policy 0, policy_version 812237 (0.0010) [2023-12-26 06:04:32,936][123090] Updated weights for policy 1, policy_version 806791 (0.0009) [2023-12-26 06:04:32,983][123090] Updated weights for policy 1, policy_version 806801 (0.0008) [2023-12-26 06:04:33,034][123090] Updated weights for policy 1, policy_version 806811 (0.0009) [2023-12-26 06:04:33,045][123091] Updated weights for policy 0, policy_version 812247 (0.0008) [2023-12-26 06:04:33,103][123091] Updated weights for policy 0, policy_version 812257 (0.0009) [2023-12-26 06:04:33,157][123091] Updated weights for policy 0, policy_version 812267 (0.0009) [2023-12-26 06:04:33,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 414490624. Throughput: 0: 8934.2, 1: 8820.1. Samples: 414505464. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:33,785][121949] Avg episode reward: [(0, '6098.506'), (1, '5918.420')] [2023-12-26 06:04:33,924][123090] Updated weights for policy 1, policy_version 806821 (0.0009) [2023-12-26 06:04:33,980][123091] Updated weights for policy 0, policy_version 812277 (0.0007) [2023-12-26 06:04:33,990][123090] Updated weights for policy 1, policy_version 806831 (0.0009) [2023-12-26 06:04:34,040][123091] Updated weights for policy 0, policy_version 812287 (0.0006) [2023-12-26 06:04:34,059][123090] Updated weights for policy 1, policy_version 806841 (0.0009) [2023-12-26 06:04:34,110][123091] Updated weights for policy 0, policy_version 812297 (0.0007) [2023-12-26 06:04:34,831][123091] Updated weights for policy 0, policy_version 812307 (0.0008) [2023-12-26 06:04:34,841][123090] Updated weights for policy 1, policy_version 806851 (0.0008) [2023-12-26 06:04:34,891][123091] Updated weights for policy 0, policy_version 812317 (0.0005) [2023-12-26 06:04:34,896][123090] Updated weights for policy 1, policy_version 806861 (0.0005) [2023-12-26 06:04:34,950][123091] Updated weights for policy 0, policy_version 812327 (0.0007) [2023-12-26 06:04:34,956][123090] Updated weights for policy 1, policy_version 806871 (0.0005) [2023-12-26 06:04:35,687][123090] Updated weights for policy 1, policy_version 806881 (0.0005) [2023-12-26 06:04:35,730][123091] Updated weights for policy 0, policy_version 812337 (0.0009) [2023-12-26 06:04:35,736][123090] Updated weights for policy 1, policy_version 806891 (0.0006) [2023-12-26 06:04:35,792][123090] Updated weights for policy 1, policy_version 806901 (0.0008) [2023-12-26 06:04:35,794][123091] Updated weights for policy 0, policy_version 812347 (0.0007) [2023-12-26 06:04:35,852][123091] Updated weights for policy 0, policy_version 812357 (0.0005) [2023-12-26 06:04:35,854][123090] Updated weights for policy 1, policy_version 806911 (0.0010) [2023-12-26 06:04:35,914][123091] Updated weights for policy 0, policy_version 812367 (0.0008) [2023-12-26 06:04:36,593][123090] Updated weights for policy 1, policy_version 806921 (0.0006) [2023-12-26 06:04:36,660][123090] Updated weights for policy 1, policy_version 806931 (0.0006) [2023-12-26 06:04:36,722][123090] Updated weights for policy 1, policy_version 806941 (0.0008) [2023-12-26 06:04:36,780][123091] Updated weights for policy 0, policy_version 812377 (0.0008) [2023-12-26 06:04:36,841][123091] Updated weights for policy 0, policy_version 812387 (0.0009) [2023-12-26 06:04:36,902][123091] Updated weights for policy 0, policy_version 812397 (0.0009) [2023-12-26 06:04:37,484][123090] Updated weights for policy 1, policy_version 806951 (0.0007) [2023-12-26 06:04:37,551][123090] Updated weights for policy 1, policy_version 806961 (0.0007) [2023-12-26 06:04:37,615][123090] Updated weights for policy 1, policy_version 806971 (0.0011) [2023-12-26 06:04:37,617][123091] Updated weights for policy 0, policy_version 812407 (0.0009) [2023-12-26 06:04:37,673][123091] Updated weights for policy 0, policy_version 812417 (0.0007) [2023-12-26 06:04:37,724][123091] Updated weights for policy 0, policy_version 812427 (0.0006) [2023-12-26 06:04:38,458][123090] Updated weights for policy 1, policy_version 806981 (0.0010) [2023-12-26 06:04:38,469][123091] Updated weights for policy 0, policy_version 812437 (0.0008) [2023-12-26 06:04:38,518][123091] Updated weights for policy 0, policy_version 812447 (0.0007) [2023-12-26 06:04:38,521][123090] Updated weights for policy 1, policy_version 806991 (0.0010) [2023-12-26 06:04:38,565][123091] Updated weights for policy 0, policy_version 812457 (0.0007) [2023-12-26 06:04:38,593][123090] Updated weights for policy 1, policy_version 807001 (0.0008) [2023-12-26 06:04:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 414588928. Throughput: 0: 8963.6, 1: 8900.0. Samples: 414560212. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:38,785][121949] Avg episode reward: [(0, '6213.103'), (1, '5828.821')] [2023-12-26 06:04:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000812464_207994880.pth... [2023-12-26 06:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000807008_206594048.pth... [2023-12-26 06:04:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000811408_207724544.pth [2023-12-26 06:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000805984_206331904.pth [2023-12-26 06:04:39,239][123091] Updated weights for policy 0, policy_version 812467 (0.0006) [2023-12-26 06:04:39,310][123091] Updated weights for policy 0, policy_version 812477 (0.0008) [2023-12-26 06:04:39,318][123090] Updated weights for policy 1, policy_version 807011 (0.0008) [2023-12-26 06:04:39,385][123091] Updated weights for policy 0, policy_version 812487 (0.0010) [2023-12-26 06:04:39,391][123090] Updated weights for policy 1, policy_version 807021 (0.0009) [2023-12-26 06:04:39,461][123090] Updated weights for policy 1, policy_version 807031 (0.0011) [2023-12-26 06:04:40,124][123091] Updated weights for policy 0, policy_version 812497 (0.0010) [2023-12-26 06:04:40,190][123091] Updated weights for policy 0, policy_version 812507 (0.0009) [2023-12-26 06:04:40,253][123090] Updated weights for policy 1, policy_version 807041 (0.0011) [2023-12-26 06:04:40,254][123091] Updated weights for policy 0, policy_version 812517 (0.0009) [2023-12-26 06:04:40,309][123090] Updated weights for policy 1, policy_version 807051 (0.0011) [2023-12-26 06:04:40,315][123091] Updated weights for policy 0, policy_version 812527 (0.0007) [2023-12-26 06:04:40,366][123090] Updated weights for policy 1, policy_version 807061 (0.0010) [2023-12-26 06:04:40,438][123090] Updated weights for policy 1, policy_version 807071 (0.0011) [2023-12-26 06:04:41,184][123091] Updated weights for policy 0, policy_version 812537 (0.0009) [2023-12-26 06:04:41,246][123091] Updated weights for policy 0, policy_version 812547 (0.0007) [2023-12-26 06:04:41,248][123090] Updated weights for policy 1, policy_version 807081 (0.0011) [2023-12-26 06:04:41,316][123091] Updated weights for policy 0, policy_version 812557 (0.0007) [2023-12-26 06:04:41,318][123090] Updated weights for policy 1, policy_version 807091 (0.0011) [2023-12-26 06:04:41,386][123090] Updated weights for policy 1, policy_version 807101 (0.0011) [2023-12-26 06:04:42,166][123091] Updated weights for policy 0, policy_version 812567 (0.0009) [2023-12-26 06:04:42,225][123091] Updated weights for policy 0, policy_version 812577 (0.0011) [2023-12-26 06:04:42,240][123090] Updated weights for policy 1, policy_version 807111 (0.0011) [2023-12-26 06:04:42,290][123091] Updated weights for policy 0, policy_version 812587 (0.0010) [2023-12-26 06:04:42,310][123090] Updated weights for policy 1, policy_version 807121 (0.0012) [2023-12-26 06:04:42,381][123090] Updated weights for policy 1, policy_version 807131 (0.0009) [2023-12-26 06:04:43,106][123091] Updated weights for policy 0, policy_version 812597 (0.0008) [2023-12-26 06:04:43,134][123090] Updated weights for policy 1, policy_version 807141 (0.0009) [2023-12-26 06:04:43,156][123091] Updated weights for policy 0, policy_version 812607 (0.0006) [2023-12-26 06:04:43,198][123090] Updated weights for policy 1, policy_version 807151 (0.0008) [2023-12-26 06:04:43,217][123091] Updated weights for policy 0, policy_version 812617 (0.0006) [2023-12-26 06:04:43,262][123090] Updated weights for policy 1, policy_version 807161 (0.0006) [2023-12-26 06:04:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 414670848. Throughput: 0: 8938.6, 1: 8877.0. Samples: 414665704. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:43,785][121949] Avg episode reward: [(0, '6160.658'), (1, '5887.155')] [2023-12-26 06:04:43,870][123091] Updated weights for policy 0, policy_version 812627 (0.0005) [2023-12-26 06:04:43,911][123090] Updated weights for policy 1, policy_version 807171 (0.0005) [2023-12-26 06:04:43,928][123091] Updated weights for policy 0, policy_version 812637 (0.0005) [2023-12-26 06:04:43,960][123090] Updated weights for policy 1, policy_version 807181 (0.0005) [2023-12-26 06:04:43,976][123091] Updated weights for policy 0, policy_version 812647 (0.0005) [2023-12-26 06:04:44,014][123090] Updated weights for policy 1, policy_version 807191 (0.0005) [2023-12-26 06:04:44,696][123091] Updated weights for policy 0, policy_version 812657 (0.0008) [2023-12-26 06:04:44,743][123091] Updated weights for policy 0, policy_version 812667 (0.0005) [2023-12-26 06:04:44,804][123091] Updated weights for policy 0, policy_version 812677 (0.0007) [2023-12-26 06:04:44,821][123090] Updated weights for policy 1, policy_version 807201 (0.0009) [2023-12-26 06:04:44,852][123091] Updated weights for policy 0, policy_version 812687 (0.0005) [2023-12-26 06:04:44,886][123090] Updated weights for policy 1, policy_version 807211 (0.0008) [2023-12-26 06:04:44,951][123090] Updated weights for policy 1, policy_version 807221 (0.0005) [2023-12-26 06:04:45,021][123090] Updated weights for policy 1, policy_version 807231 (0.0008) [2023-12-26 06:04:45,596][123091] Updated weights for policy 0, policy_version 812697 (0.0010) [2023-12-26 06:04:45,657][123091] Updated weights for policy 0, policy_version 812707 (0.0011) [2023-12-26 06:04:45,684][123090] Updated weights for policy 1, policy_version 807241 (0.0006) [2023-12-26 06:04:45,717][123091] Updated weights for policy 0, policy_version 812717 (0.0011) [2023-12-26 06:04:45,742][123090] Updated weights for policy 1, policy_version 807251 (0.0006) [2023-12-26 06:04:45,795][123090] Updated weights for policy 1, policy_version 807261 (0.0009) [2023-12-26 06:04:46,517][123091] Updated weights for policy 0, policy_version 812727 (0.0007) [2023-12-26 06:04:46,588][123091] Updated weights for policy 0, policy_version 812737 (0.0006) [2023-12-26 06:04:46,642][123090] Updated weights for policy 1, policy_version 807271 (0.0009) [2023-12-26 06:04:46,656][123091] Updated weights for policy 0, policy_version 812747 (0.0006) [2023-12-26 06:04:46,692][123090] Updated weights for policy 1, policy_version 807281 (0.0009) [2023-12-26 06:04:46,747][123090] Updated weights for policy 1, policy_version 807291 (0.0010) [2023-12-26 06:04:47,316][123091] Updated weights for policy 0, policy_version 812757 (0.0007) [2023-12-26 06:04:47,359][123091] Updated weights for policy 0, policy_version 812767 (0.0010) [2023-12-26 06:04:47,412][123091] Updated weights for policy 0, policy_version 812777 (0.0006) [2023-12-26 06:04:47,500][123090] Updated weights for policy 1, policy_version 807301 (0.0010) [2023-12-26 06:04:47,552][123090] Updated weights for policy 1, policy_version 807311 (0.0010) [2023-12-26 06:04:47,606][123090] Updated weights for policy 1, policy_version 807321 (0.0009) [2023-12-26 06:04:48,105][123091] Updated weights for policy 0, policy_version 812787 (0.0006) [2023-12-26 06:04:48,170][123091] Updated weights for policy 0, policy_version 812797 (0.0005) [2023-12-26 06:04:48,238][123091] Updated weights for policy 0, policy_version 812807 (0.0007) [2023-12-26 06:04:48,298][123090] Updated weights for policy 1, policy_version 807331 (0.0007) [2023-12-26 06:04:48,366][123090] Updated weights for policy 1, policy_version 807341 (0.0010) [2023-12-26 06:04:48,439][123090] Updated weights for policy 1, policy_version 807351 (0.0010) [2023-12-26 06:04:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 414769152. Throughput: 0: 9119.0, 1: 8890.0. Samples: 414780308. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:48,785][121949] Avg episode reward: [(0, '6118.201'), (1, '5886.066')] [2023-12-26 06:04:49,027][123091] Updated weights for policy 0, policy_version 812817 (0.0011) [2023-12-26 06:04:49,101][123091] Updated weights for policy 0, policy_version 812827 (0.0011) [2023-12-26 06:04:49,173][123091] Updated weights for policy 0, policy_version 812837 (0.0011) [2023-12-26 06:04:49,183][123090] Updated weights for policy 1, policy_version 807361 (0.0010) [2023-12-26 06:04:49,240][123091] Updated weights for policy 0, policy_version 812847 (0.0010) [2023-12-26 06:04:49,249][123090] Updated weights for policy 1, policy_version 807371 (0.0008) [2023-12-26 06:04:49,318][123090] Updated weights for policy 1, policy_version 807381 (0.0007) [2023-12-26 06:04:49,390][123090] Updated weights for policy 1, policy_version 807391 (0.0008) [2023-12-26 06:04:50,052][123091] Updated weights for policy 0, policy_version 812857 (0.0009) [2023-12-26 06:04:50,108][123091] Updated weights for policy 0, policy_version 812867 (0.0009) [2023-12-26 06:04:50,166][123091] Updated weights for policy 0, policy_version 812877 (0.0009) [2023-12-26 06:04:50,188][123090] Updated weights for policy 1, policy_version 807401 (0.0008) [2023-12-26 06:04:50,247][123090] Updated weights for policy 1, policy_version 807411 (0.0010) [2023-12-26 06:04:50,311][123090] Updated weights for policy 1, policy_version 807421 (0.0011) [2023-12-26 06:04:51,013][123091] Updated weights for policy 0, policy_version 812887 (0.0009) [2023-12-26 06:04:51,088][123091] Updated weights for policy 0, policy_version 812897 (0.0009) [2023-12-26 06:04:51,161][123090] Updated weights for policy 1, policy_version 807431 (0.0008) [2023-12-26 06:04:51,162][123091] Updated weights for policy 0, policy_version 812907 (0.0008) [2023-12-26 06:04:51,235][123090] Updated weights for policy 1, policy_version 807441 (0.0006) [2023-12-26 06:04:51,306][123090] Updated weights for policy 1, policy_version 807451 (0.0008) [2023-12-26 06:04:51,970][123091] Updated weights for policy 0, policy_version 812917 (0.0009) [2023-12-26 06:04:52,040][123091] Updated weights for policy 0, policy_version 812927 (0.0010) [2023-12-26 06:04:52,079][123090] Updated weights for policy 1, policy_version 807461 (0.0009) [2023-12-26 06:04:52,095][123091] Updated weights for policy 0, policy_version 812937 (0.0007) [2023-12-26 06:04:52,147][123090] Updated weights for policy 1, policy_version 807471 (0.0011) [2023-12-26 06:04:52,207][123090] Updated weights for policy 1, policy_version 807481 (0.0011) [2023-12-26 06:04:52,929][123091] Updated weights for policy 0, policy_version 812947 (0.0009) [2023-12-26 06:04:52,987][123091] Updated weights for policy 0, policy_version 812957 (0.0009) [2023-12-26 06:04:53,039][123090] Updated weights for policy 1, policy_version 807491 (0.0011) [2023-12-26 06:04:53,046][123091] Updated weights for policy 0, policy_version 812967 (0.0008) [2023-12-26 06:04:53,097][123090] Updated weights for policy 1, policy_version 807501 (0.0010) [2023-12-26 06:04:53,160][123090] Updated weights for policy 1, policy_version 807511 (0.0010) [2023-12-26 06:04:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 414851072. Throughput: 0: 9064.4, 1: 8876.9. Samples: 414832096. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:53,785][121949] Avg episode reward: [(0, '6108.493'), (1, '5879.332')] [2023-12-26 06:04:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000812976_208125952.pth... [2023-12-26 06:04:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000807520_206725120.pth... [2023-12-26 06:04:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000811920_207855616.pth [2023-12-26 06:04:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000806464_206454784.pth [2023-12-26 06:04:53,885][123091] Updated weights for policy 0, policy_version 812977 (0.0010) [2023-12-26 06:04:53,938][123091] Updated weights for policy 0, policy_version 812987 (0.0008) [2023-12-26 06:04:53,969][123090] Updated weights for policy 1, policy_version 807521 (0.0009) [2023-12-26 06:04:53,985][123091] Updated weights for policy 0, policy_version 812997 (0.0008) [2023-12-26 06:04:54,028][123090] Updated weights for policy 1, policy_version 807531 (0.0010) [2023-12-26 06:04:54,033][123091] Updated weights for policy 0, policy_version 813007 (0.0009) [2023-12-26 06:04:54,094][123090] Updated weights for policy 1, policy_version 807541 (0.0010) [2023-12-26 06:04:54,150][123090] Updated weights for policy 1, policy_version 807551 (0.0010) [2023-12-26 06:04:54,832][123091] Updated weights for policy 0, policy_version 813017 (0.0006) [2023-12-26 06:04:54,876][123090] Updated weights for policy 1, policy_version 807561 (0.0007) [2023-12-26 06:04:54,892][123091] Updated weights for policy 0, policy_version 813027 (0.0006) [2023-12-26 06:04:54,943][123090] Updated weights for policy 1, policy_version 807571 (0.0008) [2023-12-26 06:04:54,963][123091] Updated weights for policy 0, policy_version 813037 (0.0006) [2023-12-26 06:04:55,005][123090] Updated weights for policy 1, policy_version 807581 (0.0006) [2023-12-26 06:04:55,706][123091] Updated weights for policy 0, policy_version 813047 (0.0006) [2023-12-26 06:04:55,731][123090] Updated weights for policy 1, policy_version 807591 (0.0006) [2023-12-26 06:04:55,765][123091] Updated weights for policy 0, policy_version 813057 (0.0006) [2023-12-26 06:04:55,799][123090] Updated weights for policy 1, policy_version 807601 (0.0007) [2023-12-26 06:04:55,832][123091] Updated weights for policy 0, policy_version 813067 (0.0007) [2023-12-26 06:04:55,869][123090] Updated weights for policy 1, policy_version 807611 (0.0009) [2023-12-26 06:04:56,506][123090] Updated weights for policy 1, policy_version 807621 (0.0006) [2023-12-26 06:04:56,561][123090] Updated weights for policy 1, policy_version 807631 (0.0005) [2023-12-26 06:04:56,582][123091] Updated weights for policy 0, policy_version 813077 (0.0007) [2023-12-26 06:04:56,611][123090] Updated weights for policy 1, policy_version 807641 (0.0005) [2023-12-26 06:04:56,635][123091] Updated weights for policy 0, policy_version 813087 (0.0007) [2023-12-26 06:04:56,688][123091] Updated weights for policy 0, policy_version 813097 (0.0009) [2023-12-26 06:04:57,386][123090] Updated weights for policy 1, policy_version 807651 (0.0007) [2023-12-26 06:04:57,431][123090] Updated weights for policy 1, policy_version 807661 (0.0008) [2023-12-26 06:04:57,488][123090] Updated weights for policy 1, policy_version 807671 (0.0009) [2023-12-26 06:04:57,517][123091] Updated weights for policy 0, policy_version 813107 (0.0009) [2023-12-26 06:04:57,580][123091] Updated weights for policy 0, policy_version 813117 (0.0005) [2023-12-26 06:04:57,641][123091] Updated weights for policy 0, policy_version 813127 (0.0008) [2023-12-26 06:04:58,230][123090] Updated weights for policy 1, policy_version 807681 (0.0009) [2023-12-26 06:04:58,296][123090] Updated weights for policy 1, policy_version 807691 (0.0008) [2023-12-26 06:04:58,372][123090] Updated weights for policy 1, policy_version 807701 (0.0008) [2023-12-26 06:04:58,401][123091] Updated weights for policy 0, policy_version 813137 (0.0010) [2023-12-26 06:04:58,429][123090] Updated weights for policy 1, policy_version 807711 (0.0005) [2023-12-26 06:04:58,476][123091] Updated weights for policy 0, policy_version 813148 (0.0010) [2023-12-26 06:04:58,548][123091] Updated weights for policy 0, policy_version 813158 (0.0011) [2023-12-26 06:04:58,616][123091] Updated weights for policy 0, policy_version 813168 (0.0010) [2023-12-26 06:04:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 414949376. Throughput: 0: 9097.8, 1: 8957.1. Samples: 414939616. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 06:04:58,785][121949] Avg episode reward: [(0, '5813.350'), (1, '5792.065')] [2023-12-26 06:04:59,223][123090] Updated weights for policy 1, policy_version 807721 (0.0010) [2023-12-26 06:04:59,297][123090] Updated weights for policy 1, policy_version 807731 (0.0010) [2023-12-26 06:04:59,367][123090] Updated weights for policy 1, policy_version 807741 (0.0010) [2023-12-26 06:04:59,562][123091] Updated weights for policy 0, policy_version 813178 (0.0010) [2023-12-26 06:04:59,630][123091] Updated weights for policy 0, policy_version 813188 (0.0008) [2023-12-26 06:04:59,699][123091] Updated weights for policy 0, policy_version 813198 (0.0009) [2023-12-26 06:05:00,260][123090] Updated weights for policy 1, policy_version 807751 (0.0010) [2023-12-26 06:05:00,319][123090] Updated weights for policy 1, policy_version 807761 (0.0010) [2023-12-26 06:05:00,385][123090] Updated weights for policy 1, policy_version 807771 (0.0010) [2023-12-26 06:05:00,518][123091] Updated weights for policy 0, policy_version 813208 (0.0009) [2023-12-26 06:05:00,573][123091] Updated weights for policy 0, policy_version 813219 (0.0011) [2023-12-26 06:05:00,617][123091] Updated weights for policy 0, policy_version 813229 (0.0005) [2023-12-26 06:05:01,085][123090] Updated weights for policy 1, policy_version 807781 (0.0008) [2023-12-26 06:05:01,152][123090] Updated weights for policy 1, policy_version 807791 (0.0007) [2023-12-26 06:05:01,220][123090] Updated weights for policy 1, policy_version 807801 (0.0008) [2023-12-26 06:05:01,368][123091] Updated weights for policy 0, policy_version 813239 (0.0009) [2023-12-26 06:05:01,432][123091] Updated weights for policy 0, policy_version 813249 (0.0007) [2023-12-26 06:05:01,495][123091] Updated weights for policy 0, policy_version 813259 (0.0011) [2023-12-26 06:05:02,001][123090] Updated weights for policy 1, policy_version 807811 (0.0009) [2023-12-26 06:05:02,059][123090] Updated weights for policy 1, policy_version 807821 (0.0006) [2023-12-26 06:05:02,120][123090] Updated weights for policy 1, policy_version 807831 (0.0008) [2023-12-26 06:05:02,271][123091] Updated weights for policy 0, policy_version 813269 (0.0010) [2023-12-26 06:05:02,329][123091] Updated weights for policy 0, policy_version 813279 (0.0010) [2023-12-26 06:05:02,390][123091] Updated weights for policy 0, policy_version 813289 (0.0009) [2023-12-26 06:05:02,905][123090] Updated weights for policy 1, policy_version 807841 (0.0007) [2023-12-26 06:05:02,975][123090] Updated weights for policy 1, policy_version 807851 (0.0008) [2023-12-26 06:05:03,047][123090] Updated weights for policy 1, policy_version 807861 (0.0006) [2023-12-26 06:05:03,116][123091] Updated weights for policy 0, policy_version 813299 (0.0008) [2023-12-26 06:05:03,118][123090] Updated weights for policy 1, policy_version 807871 (0.0009) [2023-12-26 06:05:03,177][123091] Updated weights for policy 0, policy_version 813309 (0.0008) [2023-12-26 06:05:03,242][123091] Updated weights for policy 0, policy_version 813319 (0.0009) [2023-12-26 06:05:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 415031296. Throughput: 0: 9026.7, 1: 8937.5. Samples: 415046180. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:03,785][121949] Avg episode reward: [(0, '5689.989'), (1, '5861.263')] [2023-12-26 06:05:03,852][123090] Updated weights for policy 1, policy_version 807881 (0.0009) [2023-12-26 06:05:03,909][123090] Updated weights for policy 1, policy_version 807891 (0.0009) [2023-12-26 06:05:03,965][123090] Updated weights for policy 1, policy_version 807901 (0.0009) [2023-12-26 06:05:04,104][123091] Updated weights for policy 0, policy_version 813329 (0.0009) [2023-12-26 06:05:04,161][123091] Updated weights for policy 0, policy_version 813339 (0.0010) [2023-12-26 06:05:04,222][123091] Updated weights for policy 0, policy_version 813349 (0.0009) [2023-12-26 06:05:04,281][123091] Updated weights for policy 0, policy_version 813359 (0.0010) [2023-12-26 06:05:04,803][123090] Updated weights for policy 1, policy_version 807911 (0.0009) [2023-12-26 06:05:04,873][123090] Updated weights for policy 1, policy_version 807921 (0.0011) [2023-12-26 06:05:04,935][123090] Updated weights for policy 1, policy_version 807931 (0.0010) [2023-12-26 06:05:05,036][123091] Updated weights for policy 0, policy_version 813369 (0.0005) [2023-12-26 06:05:05,082][123091] Updated weights for policy 0, policy_version 813379 (0.0005) [2023-12-26 06:05:05,128][123091] Updated weights for policy 0, policy_version 813389 (0.0005) [2023-12-26 06:05:05,832][123090] Updated weights for policy 1, policy_version 807941 (0.0009) [2023-12-26 06:05:05,849][123091] Updated weights for policy 0, policy_version 813399 (0.0009) [2023-12-26 06:05:05,895][123090] Updated weights for policy 1, policy_version 807951 (0.0007) [2023-12-26 06:05:05,901][123091] Updated weights for policy 0, policy_version 813409 (0.0010) [2023-12-26 06:05:05,949][123091] Updated weights for policy 0, policy_version 813419 (0.0010) [2023-12-26 06:05:05,951][123090] Updated weights for policy 1, policy_version 807961 (0.0007) [2023-12-26 06:05:06,688][123090] Updated weights for policy 1, policy_version 807971 (0.0008) [2023-12-26 06:05:06,728][123091] Updated weights for policy 0, policy_version 813429 (0.0009) [2023-12-26 06:05:06,747][123090] Updated weights for policy 1, policy_version 807981 (0.0007) [2023-12-26 06:05:06,784][123091] Updated weights for policy 0, policy_version 813439 (0.0009) [2023-12-26 06:05:06,811][123090] Updated weights for policy 1, policy_version 807991 (0.0008) [2023-12-26 06:05:06,837][123091] Updated weights for policy 0, policy_version 813449 (0.0006) [2023-12-26 06:05:07,512][123091] Updated weights for policy 0, policy_version 813459 (0.0007) [2023-12-26 06:05:07,571][123091] Updated weights for policy 0, policy_version 813469 (0.0011) [2023-12-26 06:05:07,634][123091] Updated weights for policy 0, policy_version 813479 (0.0010) [2023-12-26 06:05:07,720][123090] Updated weights for policy 1, policy_version 808001 (0.0008) [2023-12-26 06:05:07,780][123090] Updated weights for policy 1, policy_version 808011 (0.0009) [2023-12-26 06:05:07,833][123090] Updated weights for policy 1, policy_version 808021 (0.0009) [2023-12-26 06:05:07,891][123090] Updated weights for policy 1, policy_version 808031 (0.0009) [2023-12-26 06:05:08,440][123091] Updated weights for policy 0, policy_version 813489 (0.0011) [2023-12-26 06:05:08,506][123091] Updated weights for policy 0, policy_version 813499 (0.0010) [2023-12-26 06:05:08,574][123091] Updated weights for policy 0, policy_version 813509 (0.0011) [2023-12-26 06:05:08,646][123091] Updated weights for policy 0, policy_version 813519 (0.0009) [2023-12-26 06:05:08,741][123090] Updated weights for policy 1, policy_version 808041 (0.0010) [2023-12-26 06:05:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 415121408. Throughput: 0: 9078.3, 1: 8958.9. Samples: 415099580. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:08,785][121949] Avg episode reward: [(0, '5833.230'), (1, '5905.391')] [2023-12-26 06:05:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000813520_208265216.pth... [2023-12-26 06:05:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000812464_207994880.pth [2023-12-26 06:05:08,810][123090] Updated weights for policy 1, policy_version 808051 (0.0010) [2023-12-26 06:05:08,883][123090] Updated weights for policy 1, policy_version 808061 (0.0009) [2023-12-26 06:05:08,899][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000808064_206864384.pth... [2023-12-26 06:05:08,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000807008_206594048.pth [2023-12-26 06:05:09,455][123091] Updated weights for policy 0, policy_version 813529 (0.0010) [2023-12-26 06:05:09,524][123091] Updated weights for policy 0, policy_version 813539 (0.0009) [2023-12-26 06:05:09,588][123091] Updated weights for policy 0, policy_version 813549 (0.0010) [2023-12-26 06:05:09,713][123090] Updated weights for policy 1, policy_version 808071 (0.0009) [2023-12-26 06:05:09,782][123090] Updated weights for policy 1, policy_version 808081 (0.0010) [2023-12-26 06:05:09,858][123090] Updated weights for policy 1, policy_version 808091 (0.0009) [2023-12-26 06:05:10,395][123091] Updated weights for policy 0, policy_version 813559 (0.0010) [2023-12-26 06:05:10,457][123091] Updated weights for policy 0, policy_version 813569 (0.0010) [2023-12-26 06:05:10,513][123091] Updated weights for policy 0, policy_version 813579 (0.0009) [2023-12-26 06:05:10,702][123090] Updated weights for policy 1, policy_version 808101 (0.0009) [2023-12-26 06:05:10,761][123090] Updated weights for policy 1, policy_version 808111 (0.0010) [2023-12-26 06:05:10,824][123090] Updated weights for policy 1, policy_version 808121 (0.0009) [2023-12-26 06:05:11,348][123091] Updated weights for policy 0, policy_version 813589 (0.0009) [2023-12-26 06:05:11,417][123091] Updated weights for policy 0, policy_version 813599 (0.0009) [2023-12-26 06:05:11,481][123091] Updated weights for policy 0, policy_version 813609 (0.0009) [2023-12-26 06:05:11,702][123090] Updated weights for policy 1, policy_version 808131 (0.0010) [2023-12-26 06:05:11,778][123090] Updated weights for policy 1, policy_version 808141 (0.0008) [2023-12-26 06:05:11,845][123090] Updated weights for policy 1, policy_version 808151 (0.0008) [2023-12-26 06:05:12,416][123091] Updated weights for policy 0, policy_version 813619 (0.0010) [2023-12-26 06:05:12,480][123091] Updated weights for policy 0, policy_version 813629 (0.0010) [2023-12-26 06:05:12,534][123091] Updated weights for policy 0, policy_version 813639 (0.0009) [2023-12-26 06:05:12,661][123090] Updated weights for policy 1, policy_version 808161 (0.0008) [2023-12-26 06:05:12,733][123090] Updated weights for policy 1, policy_version 808171 (0.0009) [2023-12-26 06:05:12,798][123090] Updated weights for policy 1, policy_version 808181 (0.0007) [2023-12-26 06:05:12,857][123090] Updated weights for policy 1, policy_version 808191 (0.0009) [2023-12-26 06:05:13,399][123091] Updated weights for policy 0, policy_version 813649 (0.0010) [2023-12-26 06:05:13,448][123091] Updated weights for policy 0, policy_version 813659 (0.0009) [2023-12-26 06:05:13,502][123091] Updated weights for policy 0, policy_version 813671 (0.0008) [2023-12-26 06:05:13,691][123090] Updated weights for policy 1, policy_version 808201 (0.0008) [2023-12-26 06:05:13,745][123090] Updated weights for policy 1, policy_version 808211 (0.0010) [2023-12-26 06:05:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 415203328. Throughput: 0: 9010.0, 1: 8899.5. Samples: 415200764. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:13,784][121949] Avg episode reward: [(0, '5920.291'), (1, '5901.562')] [2023-12-26 06:05:13,800][123090] Updated weights for policy 1, policy_version 808221 (0.0010) [2023-12-26 06:05:14,175][123091] Updated weights for policy 0, policy_version 813681 (0.0009) [2023-12-26 06:05:14,223][123091] Updated weights for policy 0, policy_version 813691 (0.0010) [2023-12-26 06:05:14,275][123091] Updated weights for policy 0, policy_version 813701 (0.0010) [2023-12-26 06:05:14,327][123091] Updated weights for policy 0, policy_version 813711 (0.0010) [2023-12-26 06:05:14,699][123090] Updated weights for policy 1, policy_version 808232 (0.0010) [2023-12-26 06:05:14,754][123090] Updated weights for policy 1, policy_version 808243 (0.0010) [2023-12-26 06:05:14,828][123090] Updated weights for policy 1, policy_version 808253 (0.0007) [2023-12-26 06:05:15,094][123091] Updated weights for policy 0, policy_version 813721 (0.0008) [2023-12-26 06:05:15,157][123091] Updated weights for policy 0, policy_version 813731 (0.0006) [2023-12-26 06:05:15,220][123091] Updated weights for policy 0, policy_version 813741 (0.0006) [2023-12-26 06:05:15,707][123090] Updated weights for policy 1, policy_version 808263 (0.0008) [2023-12-26 06:05:15,770][123090] Updated weights for policy 1, policy_version 808273 (0.0009) [2023-12-26 06:05:15,824][123090] Updated weights for policy 1, policy_version 808283 (0.0010) [2023-12-26 06:05:15,959][123091] Updated weights for policy 0, policy_version 813751 (0.0005) [2023-12-26 06:05:16,020][123091] Updated weights for policy 0, policy_version 813761 (0.0006) [2023-12-26 06:05:16,086][123091] Updated weights for policy 0, policy_version 813771 (0.0009) [2023-12-26 06:05:16,679][123090] Updated weights for policy 1, policy_version 808293 (0.0009) [2023-12-26 06:05:16,737][123090] Updated weights for policy 1, policy_version 808303 (0.0010) [2023-12-26 06:05:16,802][123090] Updated weights for policy 1, policy_version 808313 (0.0010) [2023-12-26 06:05:16,847][123091] Updated weights for policy 0, policy_version 813781 (0.0009) [2023-12-26 06:05:16,894][123091] Updated weights for policy 0, policy_version 813791 (0.0008) [2023-12-26 06:05:16,945][123091] Updated weights for policy 0, policy_version 813801 (0.0008) [2023-12-26 06:05:17,515][123091] Updated weights for policy 0, policy_version 813811 (0.0005) [2023-12-26 06:05:17,576][123091] Updated weights for policy 0, policy_version 813821 (0.0005) [2023-12-26 06:05:17,646][123091] Updated weights for policy 0, policy_version 813831 (0.0005) [2023-12-26 06:05:17,716][123090] Updated weights for policy 1, policy_version 808323 (0.0009) [2023-12-26 06:05:17,772][123090] Updated weights for policy 1, policy_version 808333 (0.0009) [2023-12-26 06:05:17,834][123090] Updated weights for policy 1, policy_version 808344 (0.0010) [2023-12-26 06:05:18,334][123091] Updated weights for policy 0, policy_version 813841 (0.0006) [2023-12-26 06:05:18,401][123091] Updated weights for policy 0, policy_version 813851 (0.0010) [2023-12-26 06:05:18,456][123091] Updated weights for policy 0, policy_version 813861 (0.0009) [2023-12-26 06:05:18,508][123091] Updated weights for policy 0, policy_version 813871 (0.0010) [2023-12-26 06:05:18,697][123090] Updated weights for policy 1, policy_version 808354 (0.0009) [2023-12-26 06:05:18,748][123090] Updated weights for policy 1, policy_version 808364 (0.0010) [2023-12-26 06:05:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 415293440. Throughput: 0: 9011.3, 1: 8794.8. Samples: 415306740. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:18,784][121949] Avg episode reward: [(0, '6020.987'), (1, '5984.622')] [2023-12-26 06:05:18,808][123090] Updated weights for policy 1, policy_version 808374 (0.0010) [2023-12-26 06:05:18,861][123090] Updated weights for policy 1, policy_version 808384 (0.0010) [2023-12-26 06:05:19,312][123091] Updated weights for policy 0, policy_version 813881 (0.0010) [2023-12-26 06:05:19,377][123091] Updated weights for policy 0, policy_version 813891 (0.0009) [2023-12-26 06:05:19,436][123091] Updated weights for policy 0, policy_version 813901 (0.0009) [2023-12-26 06:05:19,746][123090] Updated weights for policy 1, policy_version 808394 (0.0010) [2023-12-26 06:05:19,814][123090] Updated weights for policy 1, policy_version 808404 (0.0010) [2023-12-26 06:05:19,877][123090] Updated weights for policy 1, policy_version 808414 (0.0010) [2023-12-26 06:05:20,316][123091] Updated weights for policy 0, policy_version 813911 (0.0010) [2023-12-26 06:05:20,382][123091] Updated weights for policy 0, policy_version 813921 (0.0009) [2023-12-26 06:05:20,445][123091] Updated weights for policy 0, policy_version 813931 (0.0010) [2023-12-26 06:05:20,755][123090] Updated weights for policy 1, policy_version 808424 (0.0009) [2023-12-26 06:05:20,825][123090] Updated weights for policy 1, policy_version 808434 (0.0010) [2023-12-26 06:05:20,891][123090] Updated weights for policy 1, policy_version 808444 (0.0009) [2023-12-26 06:05:21,297][123091] Updated weights for policy 0, policy_version 813941 (0.0009) [2023-12-26 06:05:21,363][123091] Updated weights for policy 0, policy_version 813951 (0.0009) [2023-12-26 06:05:21,448][123091] Updated weights for policy 0, policy_version 813961 (0.0009) [2023-12-26 06:05:21,737][123090] Updated weights for policy 1, policy_version 808454 (0.0010) [2023-12-26 06:05:21,795][123090] Updated weights for policy 1, policy_version 808464 (0.0009) [2023-12-26 06:05:21,864][123090] Updated weights for policy 1, policy_version 808474 (0.0009) [2023-12-26 06:05:22,230][123091] Updated weights for policy 0, policy_version 813971 (0.0010) [2023-12-26 06:05:22,295][123091] Updated weights for policy 0, policy_version 813981 (0.0009) [2023-12-26 06:05:22,366][123091] Updated weights for policy 0, policy_version 813991 (0.0010) [2023-12-26 06:05:22,733][123090] Updated weights for policy 1, policy_version 808484 (0.0010) [2023-12-26 06:05:22,804][123090] Updated weights for policy 1, policy_version 808494 (0.0011) [2023-12-26 06:05:22,872][123090] Updated weights for policy 1, policy_version 808504 (0.0011) [2023-12-26 06:05:23,244][123091] Updated weights for policy 0, policy_version 814001 (0.0009) [2023-12-26 06:05:23,312][123091] Updated weights for policy 0, policy_version 814011 (0.0010) [2023-12-26 06:05:23,386][123091] Updated weights for policy 0, policy_version 814021 (0.0009) [2023-12-26 06:05:23,449][123091] Updated weights for policy 0, policy_version 814031 (0.0009) [2023-12-26 06:05:23,634][123090] Updated weights for policy 1, policy_version 808515 (0.0008) [2023-12-26 06:05:23,703][123090] Updated weights for policy 1, policy_version 808525 (0.0005) [2023-12-26 06:05:23,769][123090] Updated weights for policy 1, policy_version 808535 (0.0005) [2023-12-26 06:05:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 415375360. Throughput: 0: 8985.8, 1: 8702.5. Samples: 415356192. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:23,785][121949] Avg episode reward: [(0, '5990.822'), (1, '6033.616')] [2023-12-26 06:05:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000814032_208396288.pth... [2023-12-26 06:05:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000812976_208125952.pth [2023-12-26 06:05:23,822][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000808544_206987264.pth... [2023-12-26 06:05:23,825][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000807520_206725120.pth [2023-12-26 06:05:24,288][123091] Updated weights for policy 0, policy_version 814041 (0.0009) [2023-12-26 06:05:24,343][123091] Updated weights for policy 0, policy_version 814052 (0.0010) [2023-12-26 06:05:24,396][123091] Updated weights for policy 0, policy_version 814062 (0.0010) [2023-12-26 06:05:24,475][123090] Updated weights for policy 1, policy_version 808545 (0.0007) [2023-12-26 06:05:24,528][123090] Updated weights for policy 1, policy_version 808555 (0.0005) [2023-12-26 06:05:24,590][123090] Updated weights for policy 1, policy_version 808565 (0.0005) [2023-12-26 06:05:24,667][123090] Updated weights for policy 1, policy_version 808575 (0.0005) [2023-12-26 06:05:25,233][123091] Updated weights for policy 0, policy_version 814072 (0.0008) [2023-12-26 06:05:25,250][123090] Updated weights for policy 1, policy_version 808585 (0.0005) [2023-12-26 06:05:25,283][123091] Updated weights for policy 0, policy_version 814082 (0.0006) [2023-12-26 06:05:25,322][123090] Updated weights for policy 1, policy_version 808595 (0.0005) [2023-12-26 06:05:25,330][123091] Updated weights for policy 0, policy_version 814092 (0.0007) [2023-12-26 06:05:25,393][123090] Updated weights for policy 1, policy_version 808605 (0.0006) [2023-12-26 06:05:26,026][123091] Updated weights for policy 0, policy_version 814102 (0.0006) [2023-12-26 06:05:26,079][123091] Updated weights for policy 0, policy_version 814112 (0.0005) [2023-12-26 06:05:26,133][123091] Updated weights for policy 0, policy_version 814122 (0.0005) [2023-12-26 06:05:26,236][123090] Updated weights for policy 1, policy_version 808615 (0.0006) [2023-12-26 06:05:26,305][123090] Updated weights for policy 1, policy_version 808625 (0.0008) [2023-12-26 06:05:26,365][123090] Updated weights for policy 1, policy_version 808635 (0.0010) [2023-12-26 06:05:26,757][123091] Updated weights for policy 0, policy_version 814132 (0.0005) [2023-12-26 06:05:26,822][123091] Updated weights for policy 0, policy_version 814142 (0.0005) [2023-12-26 06:05:26,888][123091] Updated weights for policy 0, policy_version 814152 (0.0005) [2023-12-26 06:05:27,098][123090] Updated weights for policy 1, policy_version 808645 (0.0007) [2023-12-26 06:05:27,166][123090] Updated weights for policy 1, policy_version 808655 (0.0005) [2023-12-26 06:05:27,237][123090] Updated weights for policy 1, policy_version 808665 (0.0010) [2023-12-26 06:05:27,598][123091] Updated weights for policy 0, policy_version 814162 (0.0006) [2023-12-26 06:05:27,659][123091] Updated weights for policy 0, policy_version 814172 (0.0009) [2023-12-26 06:05:27,712][123091] Updated weights for policy 0, policy_version 814182 (0.0009) [2023-12-26 06:05:27,770][123091] Updated weights for policy 0, policy_version 814192 (0.0009) [2023-12-26 06:05:27,935][123090] Updated weights for policy 1, policy_version 808675 (0.0009) [2023-12-26 06:05:27,994][123090] Updated weights for policy 1, policy_version 808685 (0.0006) [2023-12-26 06:05:28,051][123090] Updated weights for policy 1, policy_version 808695 (0.0009) [2023-12-26 06:05:28,580][123091] Updated weights for policy 0, policy_version 814202 (0.0011) [2023-12-26 06:05:28,635][123091] Updated weights for policy 0, policy_version 814212 (0.0010) [2023-12-26 06:05:28,691][123091] Updated weights for policy 0, policy_version 814222 (0.0010) [2023-12-26 06:05:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 415473664. Throughput: 0: 9030.5, 1: 8762.0. Samples: 415466364. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:28,785][121949] Avg episode reward: [(0, '5973.424'), (1, '6035.689')] [2023-12-26 06:05:28,837][123090] Updated weights for policy 1, policy_version 808705 (0.0010) [2023-12-26 06:05:28,899][123090] Updated weights for policy 1, policy_version 808715 (0.0005) [2023-12-26 06:05:28,964][123090] Updated weights for policy 1, policy_version 808725 (0.0005) [2023-12-26 06:05:29,028][123090] Updated weights for policy 1, policy_version 808735 (0.0005) [2023-12-26 06:05:29,413][123091] Updated weights for policy 0, policy_version 814232 (0.0010) [2023-12-26 06:05:29,476][123091] Updated weights for policy 0, policy_version 814242 (0.0010) [2023-12-26 06:05:29,535][123091] Updated weights for policy 0, policy_version 814252 (0.0010) [2023-12-26 06:05:29,749][123090] Updated weights for policy 1, policy_version 808745 (0.0009) [2023-12-26 06:05:29,813][123090] Updated weights for policy 1, policy_version 808755 (0.0005) [2023-12-26 06:05:29,894][123090] Updated weights for policy 1, policy_version 808765 (0.0007) [2023-12-26 06:05:30,375][123091] Updated weights for policy 0, policy_version 814262 (0.0007) [2023-12-26 06:05:30,422][123091] Updated weights for policy 0, policy_version 814272 (0.0005) [2023-12-26 06:05:30,472][123091] Updated weights for policy 0, policy_version 814282 (0.0008) [2023-12-26 06:05:30,674][123090] Updated weights for policy 1, policy_version 808775 (0.0009) [2023-12-26 06:05:30,755][123090] Updated weights for policy 1, policy_version 808785 (0.0010) [2023-12-26 06:05:30,824][123090] Updated weights for policy 1, policy_version 808795 (0.0010) [2023-12-26 06:05:31,101][123091] Updated weights for policy 0, policy_version 814292 (0.0009) [2023-12-26 06:05:31,169][123091] Updated weights for policy 0, policy_version 814302 (0.0009) [2023-12-26 06:05:31,227][123091] Updated weights for policy 0, policy_version 814312 (0.0008) [2023-12-26 06:05:31,615][123090] Updated weights for policy 1, policy_version 808805 (0.0010) [2023-12-26 06:05:31,684][123090] Updated weights for policy 1, policy_version 808815 (0.0006) [2023-12-26 06:05:31,755][123090] Updated weights for policy 1, policy_version 808825 (0.0010) [2023-12-26 06:05:32,007][123091] Updated weights for policy 0, policy_version 814322 (0.0008) [2023-12-26 06:05:32,055][123091] Updated weights for policy 0, policy_version 814332 (0.0009) [2023-12-26 06:05:32,103][123091] Updated weights for policy 0, policy_version 814342 (0.0009) [2023-12-26 06:05:32,154][123091] Updated weights for policy 0, policy_version 814352 (0.0006) [2023-12-26 06:05:32,550][123090] Updated weights for policy 1, policy_version 808835 (0.0008) [2023-12-26 06:05:32,611][123090] Updated weights for policy 1, policy_version 808845 (0.0005) [2023-12-26 06:05:32,678][123090] Updated weights for policy 1, policy_version 808855 (0.0005) [2023-12-26 06:05:32,916][123091] Updated weights for policy 0, policy_version 814362 (0.0008) [2023-12-26 06:05:32,970][123091] Updated weights for policy 0, policy_version 814372 (0.0010) [2023-12-26 06:05:33,027][123091] Updated weights for policy 0, policy_version 814382 (0.0010) [2023-12-26 06:05:33,310][123090] Updated weights for policy 1, policy_version 808865 (0.0005) [2023-12-26 06:05:33,370][123090] Updated weights for policy 1, policy_version 808875 (0.0005) [2023-12-26 06:05:33,423][123090] Updated weights for policy 1, policy_version 808885 (0.0006) [2023-12-26 06:05:33,481][123090] Updated weights for policy 1, policy_version 808896 (0.0010) [2023-12-26 06:05:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 415563776. Throughput: 0: 8951.3, 1: 8741.6. Samples: 415576488. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:33,785][121949] Avg episode reward: [(0, '5922.173'), (1, '6043.547')] [2023-12-26 06:05:33,865][123091] Updated weights for policy 0, policy_version 814392 (0.0010) [2023-12-26 06:05:33,931][123091] Updated weights for policy 0, policy_version 814402 (0.0009) [2023-12-26 06:05:34,003][123091] Updated weights for policy 0, policy_version 814412 (0.0006) [2023-12-26 06:05:34,340][123090] Updated weights for policy 1, policy_version 808906 (0.0010) [2023-12-26 06:05:34,403][123090] Updated weights for policy 1, policy_version 808916 (0.0009) [2023-12-26 06:05:34,469][123090] Updated weights for policy 1, policy_version 808926 (0.0010) [2023-12-26 06:05:34,697][123091] Updated weights for policy 0, policy_version 814422 (0.0005) [2023-12-26 06:05:34,764][123091] Updated weights for policy 0, policy_version 814432 (0.0009) [2023-12-26 06:05:34,823][123091] Updated weights for policy 0, policy_version 814442 (0.0010) [2023-12-26 06:05:35,334][123090] Updated weights for policy 1, policy_version 808936 (0.0006) [2023-12-26 06:05:35,383][123090] Updated weights for policy 1, policy_version 808946 (0.0005) [2023-12-26 06:05:35,439][123090] Updated weights for policy 1, policy_version 808956 (0.0005) [2023-12-26 06:05:35,516][123091] Updated weights for policy 0, policy_version 814452 (0.0010) [2023-12-26 06:05:35,575][123091] Updated weights for policy 0, policy_version 814462 (0.0010) [2023-12-26 06:05:35,632][123091] Updated weights for policy 0, policy_version 814472 (0.0010) [2023-12-26 06:05:36,146][123090] Updated weights for policy 1, policy_version 808966 (0.0008) [2023-12-26 06:05:36,202][123090] Updated weights for policy 1, policy_version 808976 (0.0009) [2023-12-26 06:05:36,264][123090] Updated weights for policy 1, policy_version 808986 (0.0010) [2023-12-26 06:05:36,481][123091] Updated weights for policy 0, policy_version 814482 (0.0010) [2023-12-26 06:05:36,551][123091] Updated weights for policy 0, policy_version 814492 (0.0010) [2023-12-26 06:05:36,629][123091] Updated weights for policy 0, policy_version 814502 (0.0006) [2023-12-26 06:05:36,697][123091] Updated weights for policy 0, policy_version 814512 (0.0005) [2023-12-26 06:05:37,007][123090] Updated weights for policy 1, policy_version 808996 (0.0008) [2023-12-26 06:05:37,073][123090] Updated weights for policy 1, policy_version 809006 (0.0007) [2023-12-26 06:05:37,124][123090] Updated weights for policy 1, policy_version 809016 (0.0008) [2023-12-26 06:05:37,482][123091] Updated weights for policy 0, policy_version 814522 (0.0009) [2023-12-26 06:05:37,534][123091] Updated weights for policy 0, policy_version 814533 (0.0010) [2023-12-26 06:05:37,589][123091] Updated weights for policy 0, policy_version 814544 (0.0010) [2023-12-26 06:05:37,875][123090] Updated weights for policy 1, policy_version 809026 (0.0007) [2023-12-26 06:05:37,926][123090] Updated weights for policy 1, policy_version 809036 (0.0010) [2023-12-26 06:05:37,974][123090] Updated weights for policy 1, policy_version 809046 (0.0010) [2023-12-26 06:05:38,040][123090] Updated weights for policy 1, policy_version 809056 (0.0010) [2023-12-26 06:05:38,472][123091] Updated weights for policy 0, policy_version 814554 (0.0009) [2023-12-26 06:05:38,544][123091] Updated weights for policy 0, policy_version 814564 (0.0009) [2023-12-26 06:05:38,608][123091] Updated weights for policy 0, policy_version 814574 (0.0009) [2023-12-26 06:05:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 415653888. Throughput: 0: 8994.1, 1: 8728.2. Samples: 415629600. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:38,785][121949] Avg episode reward: [(0, '6081.719'), (1, '6047.625')] [2023-12-26 06:05:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000814576_208535552.pth... [2023-12-26 06:05:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000809056_207118336.pth... [2023-12-26 06:05:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000813520_208265216.pth [2023-12-26 06:05:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000808064_206864384.pth [2023-12-26 06:05:38,893][123090] Updated weights for policy 1, policy_version 809066 (0.0009) [2023-12-26 06:05:38,965][123090] Updated weights for policy 1, policy_version 809076 (0.0011) [2023-12-26 06:05:39,031][123090] Updated weights for policy 1, policy_version 809086 (0.0009) [2023-12-26 06:05:39,435][123091] Updated weights for policy 0, policy_version 814584 (0.0008) [2023-12-26 06:05:39,498][123091] Updated weights for policy 0, policy_version 814594 (0.0007) [2023-12-26 06:05:39,573][123091] Updated weights for policy 0, policy_version 814604 (0.0006) [2023-12-26 06:05:39,831][123090] Updated weights for policy 1, policy_version 809096 (0.0008) [2023-12-26 06:05:39,893][123090] Updated weights for policy 1, policy_version 809106 (0.0010) [2023-12-26 06:05:39,965][123090] Updated weights for policy 1, policy_version 809116 (0.0009) [2023-12-26 06:05:40,373][123091] Updated weights for policy 0, policy_version 814614 (0.0009) [2023-12-26 06:05:40,431][123091] Updated weights for policy 0, policy_version 814624 (0.0010) [2023-12-26 06:05:40,501][123091] Updated weights for policy 0, policy_version 814634 (0.0006) [2023-12-26 06:05:40,782][123090] Updated weights for policy 1, policy_version 809126 (0.0007) [2023-12-26 06:05:40,842][123090] Updated weights for policy 1, policy_version 809136 (0.0005) [2023-12-26 06:05:40,909][123090] Updated weights for policy 1, policy_version 809146 (0.0005) [2023-12-26 06:05:41,101][123091] Updated weights for policy 0, policy_version 814644 (0.0008) [2023-12-26 06:05:41,164][123091] Updated weights for policy 0, policy_version 814654 (0.0009) [2023-12-26 06:05:41,233][123091] Updated weights for policy 0, policy_version 814664 (0.0009) [2023-12-26 06:05:41,732][123090] Updated weights for policy 1, policy_version 809156 (0.0007) [2023-12-26 06:05:41,795][123090] Updated weights for policy 1, policy_version 809166 (0.0008) [2023-12-26 06:05:41,859][123090] Updated weights for policy 1, policy_version 809176 (0.0009) [2023-12-26 06:05:42,040][123091] Updated weights for policy 0, policy_version 814674 (0.0009) [2023-12-26 06:05:42,088][123091] Updated weights for policy 0, policy_version 814684 (0.0010) [2023-12-26 06:05:42,141][123091] Updated weights for policy 0, policy_version 814694 (0.0011) [2023-12-26 06:05:42,201][123091] Updated weights for policy 0, policy_version 814704 (0.0011) [2023-12-26 06:05:42,745][123090] Updated weights for policy 1, policy_version 809186 (0.0009) [2023-12-26 06:05:42,804][123090] Updated weights for policy 1, policy_version 809196 (0.0010) [2023-12-26 06:05:42,858][123090] Updated weights for policy 1, policy_version 809206 (0.0010) [2023-12-26 06:05:42,919][123090] Updated weights for policy 1, policy_version 809216 (0.0009) [2023-12-26 06:05:42,994][123091] Updated weights for policy 0, policy_version 814714 (0.0007) [2023-12-26 06:05:43,061][123091] Updated weights for policy 0, policy_version 814724 (0.0011) [2023-12-26 06:05:43,128][123091] Updated weights for policy 0, policy_version 814734 (0.0011) [2023-12-26 06:05:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 415735808. Throughput: 0: 8978.7, 1: 8682.7. Samples: 415734376. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:43,785][121949] Avg episode reward: [(0, '6245.947'), (1, '6045.651')] [2023-12-26 06:05:43,801][123090] Updated weights for policy 1, policy_version 809226 (0.0009) [2023-12-26 06:05:43,857][123090] Updated weights for policy 1, policy_version 809236 (0.0008) [2023-12-26 06:05:43,892][123091] Updated weights for policy 0, policy_version 814744 (0.0011) [2023-12-26 06:05:43,913][123090] Updated weights for policy 1, policy_version 809246 (0.0008) [2023-12-26 06:05:43,952][123091] Updated weights for policy 0, policy_version 814754 (0.0011) [2023-12-26 06:05:44,007][123091] Updated weights for policy 0, policy_version 814764 (0.0011) [2023-12-26 06:05:44,784][123091] Updated weights for policy 0, policy_version 814774 (0.0009) [2023-12-26 06:05:44,787][123090] Updated weights for policy 1, policy_version 809256 (0.0008) [2023-12-26 06:05:44,845][123090] Updated weights for policy 1, policy_version 809266 (0.0010) [2023-12-26 06:05:44,847][123091] Updated weights for policy 0, policy_version 814784 (0.0007) [2023-12-26 06:05:44,909][123090] Updated weights for policy 1, policy_version 809276 (0.0006) [2023-12-26 06:05:44,911][123091] Updated weights for policy 0, policy_version 814794 (0.0010) [2023-12-26 06:05:45,745][123091] Updated weights for policy 0, policy_version 814804 (0.0009) [2023-12-26 06:05:45,747][123090] Updated weights for policy 1, policy_version 809286 (0.0007) [2023-12-26 06:05:45,795][123091] Updated weights for policy 0, policy_version 814814 (0.0009) [2023-12-26 06:05:45,806][123090] Updated weights for policy 1, policy_version 809296 (0.0008) [2023-12-26 06:05:45,853][123091] Updated weights for policy 0, policy_version 814824 (0.0010) [2023-12-26 06:05:45,866][123090] Updated weights for policy 1, policy_version 809306 (0.0005) [2023-12-26 06:05:46,593][123091] Updated weights for policy 0, policy_version 814834 (0.0009) [2023-12-26 06:05:46,648][123091] Updated weights for policy 0, policy_version 814844 (0.0005) [2023-12-26 06:05:46,677][123090] Updated weights for policy 1, policy_version 809316 (0.0009) [2023-12-26 06:05:46,705][123091] Updated weights for policy 0, policy_version 814854 (0.0007) [2023-12-26 06:05:46,743][123090] Updated weights for policy 1, policy_version 809326 (0.0009) [2023-12-26 06:05:46,772][123091] Updated weights for policy 0, policy_version 814864 (0.0008) [2023-12-26 06:05:46,812][123090] Updated weights for policy 1, policy_version 809336 (0.0008) [2023-12-26 06:05:47,481][123091] Updated weights for policy 0, policy_version 814874 (0.0010) [2023-12-26 06:05:47,534][123091] Updated weights for policy 0, policy_version 814884 (0.0009) [2023-12-26 06:05:47,545][123090] Updated weights for policy 1, policy_version 809346 (0.0009) [2023-12-26 06:05:47,594][123090] Updated weights for policy 1, policy_version 809356 (0.0008) [2023-12-26 06:05:47,594][123091] Updated weights for policy 0, policy_version 814894 (0.0010) [2023-12-26 06:05:47,644][123090] Updated weights for policy 1, policy_version 809367 (0.0010) [2023-12-26 06:05:48,441][123091] Updated weights for policy 0, policy_version 814904 (0.0009) [2023-12-26 06:05:48,504][123091] Updated weights for policy 0, policy_version 814914 (0.0009) [2023-12-26 06:05:48,508][123090] Updated weights for policy 1, policy_version 809377 (0.0008) [2023-12-26 06:05:48,557][123091] Updated weights for policy 0, policy_version 814924 (0.0009) [2023-12-26 06:05:48,563][123090] Updated weights for policy 1, policy_version 809387 (0.0008) [2023-12-26 06:05:48,628][123090] Updated weights for policy 1, policy_version 809397 (0.0009) [2023-12-26 06:05:48,693][123090] Updated weights for policy 1, policy_version 809407 (0.0010) [2023-12-26 06:05:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 415834112. Throughput: 0: 9040.5, 1: 8591.4. Samples: 415839616. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:48,785][121949] Avg episode reward: [(0, '6192.902'), (1, '6042.819')] [2023-12-26 06:05:49,399][123091] Updated weights for policy 0, policy_version 814934 (0.0009) [2023-12-26 06:05:49,453][123091] Updated weights for policy 0, policy_version 814944 (0.0010) [2023-12-26 06:05:49,514][123091] Updated weights for policy 0, policy_version 814954 (0.0010) [2023-12-26 06:05:49,583][123090] Updated weights for policy 1, policy_version 809417 (0.0007) [2023-12-26 06:05:49,650][123090] Updated weights for policy 1, policy_version 809427 (0.0008) [2023-12-26 06:05:49,717][123090] Updated weights for policy 1, policy_version 809437 (0.0009) [2023-12-26 06:05:50,385][123091] Updated weights for policy 0, policy_version 814964 (0.0009) [2023-12-26 06:05:50,432][123091] Updated weights for policy 0, policy_version 814974 (0.0009) [2023-12-26 06:05:50,481][123091] Updated weights for policy 0, policy_version 814984 (0.0008) [2023-12-26 06:05:50,547][123090] Updated weights for policy 1, policy_version 809447 (0.0008) [2023-12-26 06:05:50,617][123090] Updated weights for policy 1, policy_version 809457 (0.0010) [2023-12-26 06:05:50,681][123090] Updated weights for policy 1, policy_version 809467 (0.0009) [2023-12-26 06:05:51,254][123091] Updated weights for policy 0, policy_version 814995 (0.0009) [2023-12-26 06:05:51,328][123091] Updated weights for policy 0, policy_version 815005 (0.0006) [2023-12-26 06:05:51,402][123091] Updated weights for policy 0, policy_version 815015 (0.0008) [2023-12-26 06:05:51,463][123090] Updated weights for policy 1, policy_version 809477 (0.0005) [2023-12-26 06:05:51,524][123090] Updated weights for policy 1, policy_version 809487 (0.0006) [2023-12-26 06:05:51,593][123090] Updated weights for policy 1, policy_version 809497 (0.0006) [2023-12-26 06:05:52,159][123091] Updated weights for policy 0, policy_version 815025 (0.0006) [2023-12-26 06:05:52,207][123091] Updated weights for policy 0, policy_version 815035 (0.0009) [2023-12-26 06:05:52,275][123091] Updated weights for policy 0, policy_version 815045 (0.0009) [2023-12-26 06:05:52,327][123091] Updated weights for policy 0, policy_version 815055 (0.0009) [2023-12-26 06:05:52,353][123090] Updated weights for policy 1, policy_version 809507 (0.0009) [2023-12-26 06:05:52,419][123090] Updated weights for policy 1, policy_version 809517 (0.0008) [2023-12-26 06:05:52,484][123090] Updated weights for policy 1, policy_version 809527 (0.0008) [2023-12-26 06:05:53,133][123091] Updated weights for policy 0, policy_version 815065 (0.0009) [2023-12-26 06:05:53,187][123091] Updated weights for policy 0, policy_version 815075 (0.0009) [2023-12-26 06:05:53,235][123091] Updated weights for policy 0, policy_version 815085 (0.0009) [2023-12-26 06:05:53,277][123090] Updated weights for policy 1, policy_version 809537 (0.0008) [2023-12-26 06:05:53,332][123090] Updated weights for policy 1, policy_version 809547 (0.0009) [2023-12-26 06:05:53,393][123090] Updated weights for policy 1, policy_version 809557 (0.0007) [2023-12-26 06:05:53,461][123090] Updated weights for policy 1, policy_version 809567 (0.0006) [2023-12-26 06:05:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 415916032. Throughput: 0: 9009.5, 1: 8594.6. Samples: 415891764. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:53,785][121949] Avg episode reward: [(0, '6112.222'), (1, '6040.950')] [2023-12-26 06:05:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000815088_208666624.pth... [2023-12-26 06:05:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000809568_207249408.pth... [2023-12-26 06:05:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000814032_208396288.pth [2023-12-26 06:05:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000808544_206987264.pth [2023-12-26 06:05:54,026][123091] Updated weights for policy 0, policy_version 815095 (0.0006) [2023-12-26 06:05:54,081][123090] Updated weights for policy 1, policy_version 809577 (0.0010) [2023-12-26 06:05:54,082][123091] Updated weights for policy 0, policy_version 815105 (0.0010) [2023-12-26 06:05:54,138][123090] Updated weights for policy 1, policy_version 809587 (0.0008) [2023-12-26 06:05:54,138][123091] Updated weights for policy 0, policy_version 815115 (0.0011) [2023-12-26 06:05:54,202][123090] Updated weights for policy 1, policy_version 809597 (0.0009) [2023-12-26 06:05:54,904][123091] Updated weights for policy 0, policy_version 815125 (0.0011) [2023-12-26 06:05:54,960][123091] Updated weights for policy 0, policy_version 815135 (0.0011) [2023-12-26 06:05:55,012][123091] Updated weights for policy 0, policy_version 815145 (0.0010) [2023-12-26 06:05:55,038][123090] Updated weights for policy 1, policy_version 809607 (0.0006) [2023-12-26 06:05:55,092][123090] Updated weights for policy 1, policy_version 809617 (0.0005) [2023-12-26 06:05:55,142][123090] Updated weights for policy 1, policy_version 809627 (0.0005) [2023-12-26 06:05:55,847][123091] Updated weights for policy 0, policy_version 815155 (0.0011) [2023-12-26 06:05:55,870][123090] Updated weights for policy 1, policy_version 809637 (0.0006) [2023-12-26 06:05:55,899][123091] Updated weights for policy 0, policy_version 815165 (0.0008) [2023-12-26 06:05:55,935][123090] Updated weights for policy 1, policy_version 809647 (0.0008) [2023-12-26 06:05:55,953][123091] Updated weights for policy 0, policy_version 815175 (0.0005) [2023-12-26 06:05:56,013][123090] Updated weights for policy 1, policy_version 809657 (0.0009) [2023-12-26 06:05:56,649][123091] Updated weights for policy 0, policy_version 815185 (0.0005) [2023-12-26 06:05:56,697][123091] Updated weights for policy 0, policy_version 815195 (0.0005) [2023-12-26 06:05:56,748][123091] Updated weights for policy 0, policy_version 815205 (0.0005) [2023-12-26 06:05:56,797][123091] Updated weights for policy 0, policy_version 815215 (0.0005) [2023-12-26 06:05:56,911][123090] Updated weights for policy 1, policy_version 809667 (0.0010) [2023-12-26 06:05:56,965][123090] Updated weights for policy 1, policy_version 809678 (0.0010) [2023-12-26 06:05:57,019][123090] Updated weights for policy 1, policy_version 809688 (0.0008) [2023-12-26 06:05:57,385][123091] Updated weights for policy 0, policy_version 815225 (0.0010) [2023-12-26 06:05:57,443][123091] Updated weights for policy 0, policy_version 815235 (0.0010) [2023-12-26 06:05:57,504][123091] Updated weights for policy 0, policy_version 815245 (0.0010) [2023-12-26 06:05:57,832][123090] Updated weights for policy 1, policy_version 809698 (0.0006) [2023-12-26 06:05:57,886][123090] Updated weights for policy 1, policy_version 809708 (0.0009) [2023-12-26 06:05:57,936][123090] Updated weights for policy 1, policy_version 809718 (0.0009) [2023-12-26 06:05:57,993][123090] Updated weights for policy 1, policy_version 809728 (0.0007) [2023-12-26 06:05:58,254][123091] Updated weights for policy 0, policy_version 815255 (0.0011) [2023-12-26 06:05:58,321][123091] Updated weights for policy 0, policy_version 815265 (0.0010) [2023-12-26 06:05:58,389][123091] Updated weights for policy 0, policy_version 815275 (0.0009) [2023-12-26 06:05:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 416006144. Throughput: 0: 9108.5, 1: 8694.6. Samples: 416001904. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:05:58,785][121949] Avg episode reward: [(0, '6158.319'), (1, '5901.342')] [2023-12-26 06:05:58,920][123090] Updated weights for policy 1, policy_version 809738 (0.0009) [2023-12-26 06:05:58,988][123090] Updated weights for policy 1, policy_version 809748 (0.0009) [2023-12-26 06:05:59,058][123090] Updated weights for policy 1, policy_version 809758 (0.0008) [2023-12-26 06:05:59,263][123091] Updated weights for policy 0, policy_version 815285 (0.0009) [2023-12-26 06:05:59,337][123091] Updated weights for policy 0, policy_version 815295 (0.0010) [2023-12-26 06:05:59,405][123091] Updated weights for policy 0, policy_version 815305 (0.0009) [2023-12-26 06:05:59,874][123090] Updated weights for policy 1, policy_version 809768 (0.0008) [2023-12-26 06:05:59,936][123090] Updated weights for policy 1, policy_version 809778 (0.0006) [2023-12-26 06:06:00,004][123090] Updated weights for policy 1, policy_version 809788 (0.0008) [2023-12-26 06:06:00,273][123091] Updated weights for policy 0, policy_version 815315 (0.0010) [2023-12-26 06:06:00,342][123091] Updated weights for policy 0, policy_version 815325 (0.0009) [2023-12-26 06:06:00,407][123091] Updated weights for policy 0, policy_version 815335 (0.0009) [2023-12-26 06:06:00,757][123090] Updated weights for policy 1, policy_version 809798 (0.0009) [2023-12-26 06:06:00,825][123090] Updated weights for policy 1, policy_version 809808 (0.0009) [2023-12-26 06:06:00,875][123090] Updated weights for policy 1, policy_version 809818 (0.0008) [2023-12-26 06:06:01,156][123091] Updated weights for policy 0, policy_version 815345 (0.0010) [2023-12-26 06:06:01,220][123091] Updated weights for policy 0, policy_version 815355 (0.0010) [2023-12-26 06:06:01,283][123091] Updated weights for policy 0, policy_version 815365 (0.0010) [2023-12-26 06:06:01,352][123091] Updated weights for policy 0, policy_version 815375 (0.0009) [2023-12-26 06:06:01,690][123090] Updated weights for policy 1, policy_version 809828 (0.0010) [2023-12-26 06:06:01,758][123090] Updated weights for policy 1, policy_version 809838 (0.0008) [2023-12-26 06:06:01,816][123090] Updated weights for policy 1, policy_version 809848 (0.0009) [2023-12-26 06:06:02,189][123091] Updated weights for policy 0, policy_version 815385 (0.0010) [2023-12-26 06:06:02,243][123091] Updated weights for policy 0, policy_version 815395 (0.0010) [2023-12-26 06:06:02,306][123091] Updated weights for policy 0, policy_version 815405 (0.0010) [2023-12-26 06:06:02,520][123090] Updated weights for policy 1, policy_version 809858 (0.0009) [2023-12-26 06:06:02,576][123090] Updated weights for policy 1, policy_version 809868 (0.0005) [2023-12-26 06:06:02,631][123090] Updated weights for policy 1, policy_version 809878 (0.0005) [2023-12-26 06:06:02,693][123090] Updated weights for policy 1, policy_version 809888 (0.0006) [2023-12-26 06:06:03,140][123091] Updated weights for policy 0, policy_version 815415 (0.0009) [2023-12-26 06:06:03,194][123091] Updated weights for policy 0, policy_version 815425 (0.0010) [2023-12-26 06:06:03,255][123091] Updated weights for policy 0, policy_version 815435 (0.0009) [2023-12-26 06:06:03,376][123090] Updated weights for policy 1, policy_version 809898 (0.0005) [2023-12-26 06:06:03,424][123090] Updated weights for policy 1, policy_version 809908 (0.0005) [2023-12-26 06:06:03,470][123090] Updated weights for policy 1, policy_version 809918 (0.0005) [2023-12-26 06:06:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 416096256. Throughput: 0: 8975.0, 1: 8809.1. Samples: 416107024. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:03,785][121949] Avg episode reward: [(0, '6210.044'), (1, '5724.799')] [2023-12-26 06:06:04,057][123091] Updated weights for policy 0, policy_version 815445 (0.0007) [2023-12-26 06:06:04,118][123091] Updated weights for policy 0, policy_version 815455 (0.0009) [2023-12-26 06:06:04,182][123091] Updated weights for policy 0, policy_version 815465 (0.0010) [2023-12-26 06:06:04,242][123090] Updated weights for policy 1, policy_version 809928 (0.0008) [2023-12-26 06:06:04,311][123090] Updated weights for policy 1, policy_version 809938 (0.0010) [2023-12-26 06:06:04,380][123090] Updated weights for policy 1, policy_version 809948 (0.0010) [2023-12-26 06:06:04,965][123091] Updated weights for policy 0, policy_version 815475 (0.0009) [2023-12-26 06:06:05,014][123091] Updated weights for policy 0, policy_version 815485 (0.0009) [2023-12-26 06:06:05,069][123091] Updated weights for policy 0, policy_version 815495 (0.0009) [2023-12-26 06:06:05,224][123090] Updated weights for policy 1, policy_version 809958 (0.0010) [2023-12-26 06:06:05,274][123090] Updated weights for policy 1, policy_version 809968 (0.0009) [2023-12-26 06:06:05,338][123090] Updated weights for policy 1, policy_version 809978 (0.0009) [2023-12-26 06:06:05,837][123091] Updated weights for policy 0, policy_version 815505 (0.0009) [2023-12-26 06:06:05,888][123091] Updated weights for policy 0, policy_version 815515 (0.0005) [2023-12-26 06:06:05,947][123091] Updated weights for policy 0, policy_version 815525 (0.0006) [2023-12-26 06:06:06,001][123091] Updated weights for policy 0, policy_version 815535 (0.0009) [2023-12-26 06:06:06,255][123090] Updated weights for policy 1, policy_version 809988 (0.0010) [2023-12-26 06:06:06,314][123090] Updated weights for policy 1, policy_version 809998 (0.0010) [2023-12-26 06:06:06,378][123090] Updated weights for policy 1, policy_version 810008 (0.0010) [2023-12-26 06:06:06,786][123091] Updated weights for policy 0, policy_version 815545 (0.0006) [2023-12-26 06:06:06,854][123091] Updated weights for policy 0, policy_version 815555 (0.0006) [2023-12-26 06:06:06,926][123091] Updated weights for policy 0, policy_version 815565 (0.0007) [2023-12-26 06:06:07,276][123090] Updated weights for policy 1, policy_version 810018 (0.0009) [2023-12-26 06:06:07,329][123090] Updated weights for policy 1, policy_version 810028 (0.0009) [2023-12-26 06:06:07,399][123090] Updated weights for policy 1, policy_version 810038 (0.0010) [2023-12-26 06:06:07,460][123090] Updated weights for policy 1, policy_version 810048 (0.0010) [2023-12-26 06:06:07,603][123091] Updated weights for policy 0, policy_version 815575 (0.0006) [2023-12-26 06:06:07,657][123091] Updated weights for policy 0, policy_version 815585 (0.0007) [2023-12-26 06:06:07,722][123091] Updated weights for policy 0, policy_version 815595 (0.0010) [2023-12-26 06:06:08,284][123090] Updated weights for policy 1, policy_version 810058 (0.0005) [2023-12-26 06:06:08,349][123090] Updated weights for policy 1, policy_version 810068 (0.0007) [2023-12-26 06:06:08,390][123091] Updated weights for policy 0, policy_version 815605 (0.0008) [2023-12-26 06:06:08,416][123090] Updated weights for policy 1, policy_version 810078 (0.0008) [2023-12-26 06:06:08,452][123091] Updated weights for policy 0, policy_version 815615 (0.0009) [2023-12-26 06:06:08,514][123091] Updated weights for policy 0, policy_version 815625 (0.0008) [2023-12-26 06:06:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 416186368. Throughput: 0: 9036.7, 1: 8809.3. Samples: 416159260. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:08,785][121949] Avg episode reward: [(0, '6063.346'), (1, '5687.192')] [2023-12-26 06:06:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000815632_208805888.pth... [2023-12-26 06:06:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000810080_207380480.pth... [2023-12-26 06:06:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000814576_208535552.pth [2023-12-26 06:06:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000809056_207118336.pth [2023-12-26 06:06:09,141][123090] Updated weights for policy 1, policy_version 810088 (0.0006) [2023-12-26 06:06:09,195][123090] Updated weights for policy 1, policy_version 810098 (0.0007) [2023-12-26 06:06:09,264][123090] Updated weights for policy 1, policy_version 810108 (0.0009) [2023-12-26 06:06:09,293][123091] Updated weights for policy 0, policy_version 815635 (0.0007) [2023-12-26 06:06:09,342][123091] Updated weights for policy 0, policy_version 815645 (0.0009) [2023-12-26 06:06:09,414][123091] Updated weights for policy 0, policy_version 815655 (0.0009) [2023-12-26 06:06:10,120][123090] Updated weights for policy 1, policy_version 810118 (0.0010) [2023-12-26 06:06:10,179][123090] Updated weights for policy 1, policy_version 810128 (0.0010) [2023-12-26 06:06:10,244][123090] Updated weights for policy 1, policy_version 810138 (0.0010) [2023-12-26 06:06:10,273][123091] Updated weights for policy 0, policy_version 815665 (0.0009) [2023-12-26 06:06:10,343][123091] Updated weights for policy 0, policy_version 815675 (0.0009) [2023-12-26 06:06:10,410][123091] Updated weights for policy 0, policy_version 815685 (0.0010) [2023-12-26 06:06:10,471][123091] Updated weights for policy 0, policy_version 815695 (0.0009) [2023-12-26 06:06:11,125][123090] Updated weights for policy 1, policy_version 810148 (0.0009) [2023-12-26 06:06:11,200][123090] Updated weights for policy 1, policy_version 810158 (0.0008) [2023-12-26 06:06:11,264][123091] Updated weights for policy 0, policy_version 815705 (0.0010) [2023-12-26 06:06:11,272][123090] Updated weights for policy 1, policy_version 810168 (0.0006) [2023-12-26 06:06:11,328][123091] Updated weights for policy 0, policy_version 815715 (0.0009) [2023-12-26 06:06:11,407][123091] Updated weights for policy 0, policy_version 815725 (0.0008) [2023-12-26 06:06:12,004][123090] Updated weights for policy 1, policy_version 810178 (0.0007) [2023-12-26 06:06:12,073][123090] Updated weights for policy 1, policy_version 810188 (0.0010) [2023-12-26 06:06:12,144][123090] Updated weights for policy 1, policy_version 810198 (0.0010) [2023-12-26 06:06:12,205][123090] Updated weights for policy 1, policy_version 810208 (0.0010) [2023-12-26 06:06:12,285][123091] Updated weights for policy 0, policy_version 815735 (0.0009) [2023-12-26 06:06:12,347][123091] Updated weights for policy 0, policy_version 815745 (0.0010) [2023-12-26 06:06:12,413][123091] Updated weights for policy 0, policy_version 815755 (0.0010) [2023-12-26 06:06:13,027][123090] Updated weights for policy 1, policy_version 810218 (0.0010) [2023-12-26 06:06:13,092][123090] Updated weights for policy 1, policy_version 810228 (0.0005) [2023-12-26 06:06:13,152][123090] Updated weights for policy 1, policy_version 810238 (0.0006) [2023-12-26 06:06:13,254][123091] Updated weights for policy 0, policy_version 815765 (0.0008) [2023-12-26 06:06:13,312][123091] Updated weights for policy 0, policy_version 815775 (0.0006) [2023-12-26 06:06:13,384][123091] Updated weights for policy 0, policy_version 815785 (0.0005) [2023-12-26 06:06:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 416268288. Throughput: 0: 8983.1, 1: 8738.6. Samples: 416263836. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:13,784][121949] Avg episode reward: [(0, '6060.145'), (1, '5573.358')] [2023-12-26 06:06:13,836][123090] Updated weights for policy 1, policy_version 810248 (0.0009) [2023-12-26 06:06:13,896][123090] Updated weights for policy 1, policy_version 810258 (0.0010) [2023-12-26 06:06:13,963][123090] Updated weights for policy 1, policy_version 810268 (0.0010) [2023-12-26 06:06:14,022][123091] Updated weights for policy 0, policy_version 815795 (0.0005) [2023-12-26 06:06:14,089][123091] Updated weights for policy 0, policy_version 815805 (0.0005) [2023-12-26 06:06:14,144][123091] Updated weights for policy 0, policy_version 815815 (0.0005) [2023-12-26 06:06:14,690][123090] Updated weights for policy 1, policy_version 810278 (0.0009) [2023-12-26 06:06:14,749][123090] Updated weights for policy 1, policy_version 810288 (0.0006) [2023-12-26 06:06:14,815][123090] Updated weights for policy 1, policy_version 810298 (0.0008) [2023-12-26 06:06:14,933][123091] Updated weights for policy 0, policy_version 815825 (0.0009) [2023-12-26 06:06:14,988][123091] Updated weights for policy 0, policy_version 815835 (0.0009) [2023-12-26 06:06:15,042][123091] Updated weights for policy 0, policy_version 815845 (0.0009) [2023-12-26 06:06:15,109][123091] Updated weights for policy 0, policy_version 815855 (0.0008) [2023-12-26 06:06:15,620][123090] Updated weights for policy 1, policy_version 810308 (0.0007) [2023-12-26 06:06:15,678][123090] Updated weights for policy 1, policy_version 810318 (0.0009) [2023-12-26 06:06:15,735][123090] Updated weights for policy 1, policy_version 810328 (0.0008) [2023-12-26 06:06:15,896][123091] Updated weights for policy 0, policy_version 815865 (0.0010) [2023-12-26 06:06:15,969][123091] Updated weights for policy 0, policy_version 815875 (0.0006) [2023-12-26 06:06:16,031][123091] Updated weights for policy 0, policy_version 815885 (0.0009) [2023-12-26 06:06:16,541][123090] Updated weights for policy 1, policy_version 810338 (0.0007) [2023-12-26 06:06:16,593][123090] Updated weights for policy 1, policy_version 810348 (0.0008) [2023-12-26 06:06:16,654][123090] Updated weights for policy 1, policy_version 810358 (0.0009) [2023-12-26 06:06:16,712][123090] Updated weights for policy 1, policy_version 810368 (0.0009) [2023-12-26 06:06:16,821][123091] Updated weights for policy 0, policy_version 815895 (0.0010) [2023-12-26 06:06:16,871][123091] Updated weights for policy 0, policy_version 815905 (0.0008) [2023-12-26 06:06:16,926][123091] Updated weights for policy 0, policy_version 815915 (0.0009) [2023-12-26 06:06:17,457][123090] Updated weights for policy 1, policy_version 810378 (0.0005) [2023-12-26 06:06:17,526][123090] Updated weights for policy 1, policy_version 810388 (0.0005) [2023-12-26 06:06:17,605][123090] Updated weights for policy 1, policy_version 810398 (0.0005) [2023-12-26 06:06:17,704][123091] Updated weights for policy 0, policy_version 815925 (0.0008) [2023-12-26 06:06:17,770][123091] Updated weights for policy 0, policy_version 815935 (0.0005) [2023-12-26 06:06:17,840][123091] Updated weights for policy 0, policy_version 815945 (0.0005) [2023-12-26 06:06:18,240][123090] Updated weights for policy 1, policy_version 810408 (0.0009) [2023-12-26 06:06:18,313][123090] Updated weights for policy 1, policy_version 810418 (0.0010) [2023-12-26 06:06:18,376][123090] Updated weights for policy 1, policy_version 810428 (0.0008) [2023-12-26 06:06:18,492][123091] Updated weights for policy 0, policy_version 815955 (0.0006) [2023-12-26 06:06:18,556][123091] Updated weights for policy 0, policy_version 815965 (0.0009) [2023-12-26 06:06:18,610][123091] Updated weights for policy 0, policy_version 815975 (0.0009) [2023-12-26 06:06:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 416366592. Throughput: 0: 8978.7, 1: 8761.1. Samples: 416374776. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:18,785][121949] Avg episode reward: [(0, '6089.953'), (1, '5671.739')] [2023-12-26 06:06:19,183][123090] Updated weights for policy 1, policy_version 810438 (0.0009) [2023-12-26 06:06:19,246][123090] Updated weights for policy 1, policy_version 810448 (0.0009) [2023-12-26 06:06:19,310][123090] Updated weights for policy 1, policy_version 810458 (0.0008) [2023-12-26 06:06:19,468][123091] Updated weights for policy 0, policy_version 815985 (0.0009) [2023-12-26 06:06:19,537][123091] Updated weights for policy 0, policy_version 815995 (0.0010) [2023-12-26 06:06:19,590][123091] Updated weights for policy 0, policy_version 816005 (0.0010) [2023-12-26 06:06:19,640][123091] Updated weights for policy 0, policy_version 816015 (0.0010) [2023-12-26 06:06:20,197][123090] Updated weights for policy 1, policy_version 810468 (0.0008) [2023-12-26 06:06:20,267][123090] Updated weights for policy 1, policy_version 810478 (0.0010) [2023-12-26 06:06:20,328][123090] Updated weights for policy 1, policy_version 810488 (0.0010) [2023-12-26 06:06:20,542][123091] Updated weights for policy 0, policy_version 816025 (0.0009) [2023-12-26 06:06:20,606][123091] Updated weights for policy 0, policy_version 816035 (0.0008) [2023-12-26 06:06:20,659][123091] Updated weights for policy 0, policy_version 816045 (0.0009) [2023-12-26 06:06:21,225][123090] Updated weights for policy 1, policy_version 810498 (0.0009) [2023-12-26 06:06:21,294][123090] Updated weights for policy 1, policy_version 810508 (0.0010) [2023-12-26 06:06:21,361][123090] Updated weights for policy 1, policy_version 810518 (0.0010) [2023-12-26 06:06:21,432][123090] Updated weights for policy 1, policy_version 810528 (0.0009) [2023-12-26 06:06:21,474][123091] Updated weights for policy 0, policy_version 816055 (0.0010) [2023-12-26 06:06:21,542][123091] Updated weights for policy 0, policy_version 816065 (0.0010) [2023-12-26 06:06:21,611][123091] Updated weights for policy 0, policy_version 816075 (0.0010) [2023-12-26 06:06:22,241][123090] Updated weights for policy 1, policy_version 810538 (0.0008) [2023-12-26 06:06:22,310][123090] Updated weights for policy 1, policy_version 810548 (0.0009) [2023-12-26 06:06:22,381][123090] Updated weights for policy 1, policy_version 810558 (0.0009) [2023-12-26 06:06:22,493][123091] Updated weights for policy 0, policy_version 816085 (0.0010) [2023-12-26 06:06:22,558][123091] Updated weights for policy 0, policy_version 816095 (0.0008) [2023-12-26 06:06:22,622][123091] Updated weights for policy 0, policy_version 816105 (0.0006) [2023-12-26 06:06:23,259][123090] Updated weights for policy 1, policy_version 810568 (0.0009) [2023-12-26 06:06:23,320][123090] Updated weights for policy 1, policy_version 810578 (0.0010) [2023-12-26 06:06:23,348][123091] Updated weights for policy 0, policy_version 816115 (0.0009) [2023-12-26 06:06:23,376][123090] Updated weights for policy 1, policy_version 810588 (0.0009) [2023-12-26 06:06:23,413][123091] Updated weights for policy 0, policy_version 816125 (0.0007) [2023-12-26 06:06:23,471][123091] Updated weights for policy 0, policy_version 816135 (0.0006) [2023-12-26 06:06:23,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 416448512. Throughput: 0: 8928.6, 1: 8721.9. Samples: 416423876. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:23,785][121949] Avg episode reward: [(0, '6214.980'), (1, '5768.058')] [2023-12-26 06:06:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000816144_208936960.pth... [2023-12-26 06:06:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000810592_207511552.pth... [2023-12-26 06:06:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000815088_208666624.pth [2023-12-26 06:06:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000809568_207249408.pth [2023-12-26 06:06:24,125][123091] Updated weights for policy 0, policy_version 816145 (0.0006) [2023-12-26 06:06:24,186][123091] Updated weights for policy 0, policy_version 816155 (0.0006) [2023-12-26 06:06:24,254][123091] Updated weights for policy 0, policy_version 816165 (0.0006) [2023-12-26 06:06:24,282][123090] Updated weights for policy 1, policy_version 810598 (0.0008) [2023-12-26 06:06:24,307][123091] Updated weights for policy 0, policy_version 816175 (0.0007) [2023-12-26 06:06:24,347][123090] Updated weights for policy 1, policy_version 810608 (0.0010) [2023-12-26 06:06:24,399][123090] Updated weights for policy 1, policy_version 810618 (0.0009) [2023-12-26 06:06:25,061][123091] Updated weights for policy 0, policy_version 816185 (0.0006) [2023-12-26 06:06:25,129][123091] Updated weights for policy 0, policy_version 816195 (0.0006) [2023-12-26 06:06:25,198][123091] Updated weights for policy 0, policy_version 816205 (0.0010) [2023-12-26 06:06:25,230][123090] Updated weights for policy 1, policy_version 810628 (0.0009) [2023-12-26 06:06:25,287][123090] Updated weights for policy 1, policy_version 810638 (0.0007) [2023-12-26 06:06:25,351][123090] Updated weights for policy 1, policy_version 810648 (0.0008) [2023-12-26 06:06:25,967][123091] Updated weights for policy 0, policy_version 816215 (0.0009) [2023-12-26 06:06:26,013][123091] Updated weights for policy 0, policy_version 816225 (0.0005) [2023-12-26 06:06:26,061][123091] Updated weights for policy 0, policy_version 816235 (0.0007) [2023-12-26 06:06:26,144][123090] Updated weights for policy 1, policy_version 810658 (0.0008) [2023-12-26 06:06:26,204][123090] Updated weights for policy 1, policy_version 810668 (0.0010) [2023-12-26 06:06:26,271][123090] Updated weights for policy 1, policy_version 810678 (0.0010) [2023-12-26 06:06:26,339][123090] Updated weights for policy 1, policy_version 810688 (0.0009) [2023-12-26 06:06:26,798][123091] Updated weights for policy 0, policy_version 816245 (0.0008) [2023-12-26 06:06:26,847][123091] Updated weights for policy 0, policy_version 816255 (0.0008) [2023-12-26 06:06:26,898][123091] Updated weights for policy 0, policy_version 816265 (0.0007) [2023-12-26 06:06:27,089][123090] Updated weights for policy 1, policy_version 810698 (0.0005) [2023-12-26 06:06:27,146][123090] Updated weights for policy 1, policy_version 810708 (0.0005) [2023-12-26 06:06:27,209][123090] Updated weights for policy 1, policy_version 810718 (0.0008) [2023-12-26 06:06:27,591][123091] Updated weights for policy 0, policy_version 816275 (0.0005) [2023-12-26 06:06:27,652][123091] Updated weights for policy 0, policy_version 816285 (0.0005) [2023-12-26 06:06:27,703][123091] Updated weights for policy 0, policy_version 816295 (0.0005) [2023-12-26 06:06:27,978][123090] Updated weights for policy 1, policy_version 810728 (0.0006) [2023-12-26 06:06:28,047][123090] Updated weights for policy 1, policy_version 810738 (0.0005) [2023-12-26 06:06:28,107][123090] Updated weights for policy 1, policy_version 810748 (0.0005) [2023-12-26 06:06:28,446][123091] Updated weights for policy 0, policy_version 816305 (0.0006) [2023-12-26 06:06:28,499][123091] Updated weights for policy 0, policy_version 816315 (0.0009) [2023-12-26 06:06:28,547][123091] Updated weights for policy 0, policy_version 816325 (0.0009) [2023-12-26 06:06:28,595][123091] Updated weights for policy 0, policy_version 816335 (0.0009) [2023-12-26 06:06:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 416538624. Throughput: 0: 9028.1, 1: 8690.7. Samples: 416531720. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:28,785][121949] Avg episode reward: [(0, '6273.279'), (1, '5865.584')] [2023-12-26 06:06:28,894][123090] Updated weights for policy 1, policy_version 810758 (0.0010) [2023-12-26 06:06:28,957][123090] Updated weights for policy 1, policy_version 810768 (0.0010) [2023-12-26 06:06:29,019][123090] Updated weights for policy 1, policy_version 810778 (0.0010) [2023-12-26 06:06:29,442][123091] Updated weights for policy 0, policy_version 816345 (0.0010) [2023-12-26 06:06:29,506][123091] Updated weights for policy 0, policy_version 816355 (0.0010) [2023-12-26 06:06:29,573][123091] Updated weights for policy 0, policy_version 816365 (0.0010) [2023-12-26 06:06:29,753][123090] Updated weights for policy 1, policy_version 810788 (0.0008) [2023-12-26 06:06:29,822][123090] Updated weights for policy 1, policy_version 810798 (0.0006) [2023-12-26 06:06:29,888][123090] Updated weights for policy 1, policy_version 810808 (0.0013) [2023-12-26 06:06:30,341][123091] Updated weights for policy 0, policy_version 816375 (0.0008) [2023-12-26 06:06:30,397][123091] Updated weights for policy 0, policy_version 816385 (0.0006) [2023-12-26 06:06:30,466][123091] Updated weights for policy 0, policy_version 816395 (0.0006) [2023-12-26 06:06:30,686][123090] Updated weights for policy 1, policy_version 810818 (0.0011) [2023-12-26 06:06:30,749][123090] Updated weights for policy 1, policy_version 810828 (0.0010) [2023-12-26 06:06:30,816][123090] Updated weights for policy 1, policy_version 810838 (0.0010) [2023-12-26 06:06:30,875][123090] Updated weights for policy 1, policy_version 810848 (0.0010) [2023-12-26 06:06:31,190][123091] Updated weights for policy 0, policy_version 816405 (0.0007) [2023-12-26 06:06:31,248][123091] Updated weights for policy 0, policy_version 816415 (0.0008) [2023-12-26 06:06:31,311][123091] Updated weights for policy 0, policy_version 816425 (0.0011) [2023-12-26 06:06:31,693][123090] Updated weights for policy 1, policy_version 810858 (0.0008) [2023-12-26 06:06:31,767][123090] Updated weights for policy 1, policy_version 810868 (0.0011) [2023-12-26 06:06:31,819][123090] Updated weights for policy 1, policy_version 810878 (0.0010) [2023-12-26 06:06:32,131][123091] Updated weights for policy 0, policy_version 816435 (0.0010) [2023-12-26 06:06:32,192][123091] Updated weights for policy 0, policy_version 816445 (0.0009) [2023-12-26 06:06:32,257][123091] Updated weights for policy 0, policy_version 816455 (0.0009) [2023-12-26 06:06:32,585][123090] Updated weights for policy 1, policy_version 810888 (0.0006) [2023-12-26 06:06:32,637][123090] Updated weights for policy 1, policy_version 810898 (0.0005) [2023-12-26 06:06:32,698][123090] Updated weights for policy 1, policy_version 810908 (0.0007) [2023-12-26 06:06:33,167][123091] Updated weights for policy 0, policy_version 816465 (0.0009) [2023-12-26 06:06:33,226][123091] Updated weights for policy 0, policy_version 816475 (0.0010) [2023-12-26 06:06:33,288][123091] Updated weights for policy 0, policy_version 816485 (0.0010) [2023-12-26 06:06:33,346][123090] Updated weights for policy 1, policy_version 810918 (0.0006) [2023-12-26 06:06:33,351][123091] Updated weights for policy 0, policy_version 816495 (0.0009) [2023-12-26 06:06:33,399][123090] Updated weights for policy 1, policy_version 810928 (0.0005) [2023-12-26 06:06:33,453][123090] Updated weights for policy 1, policy_version 810938 (0.0005) [2023-12-26 06:06:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 416628736. Throughput: 0: 8960.9, 1: 8798.4. Samples: 416638788. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:33,785][121949] Avg episode reward: [(0, '6207.606'), (1, '5960.721')] [2023-12-26 06:06:34,119][123090] Updated weights for policy 1, policy_version 810948 (0.0005) [2023-12-26 06:06:34,157][123091] Updated weights for policy 0, policy_version 816505 (0.0008) [2023-12-26 06:06:34,195][123090] Updated weights for policy 1, policy_version 810958 (0.0007) [2023-12-26 06:06:34,221][123091] Updated weights for policy 0, policy_version 816515 (0.0007) [2023-12-26 06:06:34,262][123090] Updated weights for policy 1, policy_version 810968 (0.0008) [2023-12-26 06:06:34,289][123091] Updated weights for policy 0, policy_version 816525 (0.0007) [2023-12-26 06:06:34,930][123090] Updated weights for policy 1, policy_version 810978 (0.0008) [2023-12-26 06:06:34,980][123091] Updated weights for policy 0, policy_version 816535 (0.0006) [2023-12-26 06:06:34,993][123090] Updated weights for policy 1, policy_version 810988 (0.0010) [2023-12-26 06:06:35,032][123091] Updated weights for policy 0, policy_version 816545 (0.0007) [2023-12-26 06:06:35,059][123090] Updated weights for policy 1, policy_version 810998 (0.0008) [2023-12-26 06:06:35,078][123091] Updated weights for policy 0, policy_version 816555 (0.0009) [2023-12-26 06:06:35,121][123090] Updated weights for policy 1, policy_version 811008 (0.0010) [2023-12-26 06:06:35,845][123091] Updated weights for policy 0, policy_version 816565 (0.0007) [2023-12-26 06:06:35,898][123091] Updated weights for policy 0, policy_version 816575 (0.0006) [2023-12-26 06:06:35,943][123090] Updated weights for policy 1, policy_version 811018 (0.0010) [2023-12-26 06:06:35,951][123091] Updated weights for policy 0, policy_version 816585 (0.0007) [2023-12-26 06:06:35,994][123090] Updated weights for policy 1, policy_version 811028 (0.0010) [2023-12-26 06:06:36,052][123090] Updated weights for policy 1, policy_version 811038 (0.0010) [2023-12-26 06:06:36,777][123091] Updated weights for policy 0, policy_version 816595 (0.0009) [2023-12-26 06:06:36,840][123091] Updated weights for policy 0, policy_version 816605 (0.0009) [2023-12-26 06:06:36,879][123090] Updated weights for policy 1, policy_version 811048 (0.0010) [2023-12-26 06:06:36,898][123091] Updated weights for policy 0, policy_version 816615 (0.0009) [2023-12-26 06:06:36,939][123090] Updated weights for policy 1, policy_version 811058 (0.0010) [2023-12-26 06:06:36,987][123090] Updated weights for policy 1, policy_version 811068 (0.0010) [2023-12-26 06:06:37,727][123091] Updated weights for policy 0, policy_version 816625 (0.0007) [2023-12-26 06:06:37,761][123090] Updated weights for policy 1, policy_version 811078 (0.0010) [2023-12-26 06:06:37,786][123091] Updated weights for policy 0, policy_version 816635 (0.0007) [2023-12-26 06:06:37,817][123090] Updated weights for policy 1, policy_version 811088 (0.0010) [2023-12-26 06:06:37,849][123091] Updated weights for policy 0, policy_version 816645 (0.0006) [2023-12-26 06:06:37,877][123090] Updated weights for policy 1, policy_version 811098 (0.0010) [2023-12-26 06:06:37,912][123091] Updated weights for policy 0, policy_version 816655 (0.0008) [2023-12-26 06:06:38,651][123090] Updated weights for policy 1, policy_version 811108 (0.0008) [2023-12-26 06:06:38,718][123090] Updated weights for policy 1, policy_version 811118 (0.0005) [2023-12-26 06:06:38,776][123091] Updated weights for policy 0, policy_version 816665 (0.0008) [2023-12-26 06:06:38,783][123090] Updated weights for policy 1, policy_version 811128 (0.0005) [2023-12-26 06:06:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 416710656. Throughput: 0: 9011.3, 1: 8836.8. Samples: 416694928. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:38,785][121949] Avg episode reward: [(0, '6231.652'), (1, '5916.463')] [2023-12-26 06:06:38,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000811136_207650816.pth... [2023-12-26 06:06:38,836][123091] Updated weights for policy 0, policy_version 816675 (0.0009) [2023-12-26 06:06:38,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000810080_207380480.pth [2023-12-26 06:06:38,888][123091] Updated weights for policy 0, policy_version 816685 (0.0010) [2023-12-26 06:06:38,899][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000816688_209076224.pth... [2023-12-26 06:06:38,902][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000815632_208805888.pth [2023-12-26 06:06:39,466][123090] Updated weights for policy 1, policy_version 811138 (0.0006) [2023-12-26 06:06:39,526][123090] Updated weights for policy 1, policy_version 811148 (0.0009) [2023-12-26 06:06:39,594][123090] Updated weights for policy 1, policy_version 811158 (0.0009) [2023-12-26 06:06:39,648][123091] Updated weights for policy 0, policy_version 816695 (0.0007) [2023-12-26 06:06:39,655][123090] Updated weights for policy 1, policy_version 811168 (0.0009) [2023-12-26 06:06:39,711][123091] Updated weights for policy 0, policy_version 816705 (0.0009) [2023-12-26 06:06:39,780][123091] Updated weights for policy 0, policy_version 816715 (0.0009) [2023-12-26 06:06:40,508][123090] Updated weights for policy 1, policy_version 811178 (0.0011) [2023-12-26 06:06:40,564][123090] Updated weights for policy 1, policy_version 811188 (0.0010) [2023-12-26 06:06:40,574][123091] Updated weights for policy 0, policy_version 816725 (0.0007) [2023-12-26 06:06:40,609][123090] Updated weights for policy 1, policy_version 811198 (0.0010) [2023-12-26 06:06:40,640][123091] Updated weights for policy 0, policy_version 816735 (0.0006) [2023-12-26 06:06:40,716][123091] Updated weights for policy 0, policy_version 816745 (0.0006) [2023-12-26 06:06:41,466][123091] Updated weights for policy 0, policy_version 816755 (0.0008) [2023-12-26 06:06:41,493][123090] Updated weights for policy 1, policy_version 811208 (0.0011) [2023-12-26 06:06:41,537][123091] Updated weights for policy 0, policy_version 816765 (0.0008) [2023-12-26 06:06:41,565][123090] Updated weights for policy 1, policy_version 811218 (0.0011) [2023-12-26 06:06:41,604][123091] Updated weights for policy 0, policy_version 816775 (0.0010) [2023-12-26 06:06:41,630][123090] Updated weights for policy 1, policy_version 811228 (0.0011) [2023-12-26 06:06:42,492][123091] Updated weights for policy 0, policy_version 816785 (0.0009) [2023-12-26 06:06:42,497][123090] Updated weights for policy 1, policy_version 811238 (0.0007) [2023-12-26 06:06:42,542][123091] Updated weights for policy 0, policy_version 816795 (0.0009) [2023-12-26 06:06:42,570][123090] Updated weights for policy 1, policy_version 811248 (0.0005) [2023-12-26 06:06:42,599][123091] Updated weights for policy 0, policy_version 816805 (0.0008) [2023-12-26 06:06:42,635][123090] Updated weights for policy 1, policy_version 811258 (0.0010) [2023-12-26 06:06:42,659][123091] Updated weights for policy 0, policy_version 816815 (0.0008) [2023-12-26 06:06:43,369][123090] Updated weights for policy 1, policy_version 811268 (0.0011) [2023-12-26 06:06:43,420][123090] Updated weights for policy 1, policy_version 811278 (0.0010) [2023-12-26 06:06:43,468][123090] Updated weights for policy 1, policy_version 811288 (0.0010) [2023-12-26 06:06:43,542][123091] Updated weights for policy 0, policy_version 816825 (0.0009) [2023-12-26 06:06:43,591][123091] Updated weights for policy 0, policy_version 816835 (0.0009) [2023-12-26 06:06:43,638][123091] Updated weights for policy 0, policy_version 816845 (0.0005) [2023-12-26 06:06:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 416808960. Throughput: 0: 8893.7, 1: 8821.2. Samples: 416799072. Policy #0 lag: (min: 31.0, avg: 31.9, max: 53.0) [2023-12-26 06:06:43,784][121949] Avg episode reward: [(0, '6251.888'), (1, '5778.299')] [2023-12-26 06:06:44,237][123090] Updated weights for policy 1, policy_version 811298 (0.0009) [2023-12-26 06:06:44,287][123090] Updated weights for policy 1, policy_version 811308 (0.0005) [2023-12-26 06:06:44,337][123090] Updated weights for policy 1, policy_version 811318 (0.0005) [2023-12-26 06:06:44,385][123090] Updated weights for policy 1, policy_version 811328 (0.0005) [2023-12-26 06:06:44,471][123091] Updated weights for policy 0, policy_version 816855 (0.0008) [2023-12-26 06:06:44,525][123091] Updated weights for policy 0, policy_version 816865 (0.0010) [2023-12-26 06:06:44,593][123091] Updated weights for policy 0, policy_version 816875 (0.0009) [2023-12-26 06:06:45,019][123090] Updated weights for policy 1, policy_version 811338 (0.0011) [2023-12-26 06:06:45,082][123090] Updated weights for policy 1, policy_version 811348 (0.0011) [2023-12-26 06:06:45,150][123090] Updated weights for policy 1, policy_version 811358 (0.0011) [2023-12-26 06:06:45,454][123091] Updated weights for policy 0, policy_version 816885 (0.0010) [2023-12-26 06:06:45,521][123091] Updated weights for policy 0, policy_version 816895 (0.0009) [2023-12-26 06:06:45,582][123091] Updated weights for policy 0, policy_version 816905 (0.0009) [2023-12-26 06:06:45,976][123090] Updated weights for policy 1, policy_version 811368 (0.0011) [2023-12-26 06:06:46,035][123090] Updated weights for policy 1, policy_version 811378 (0.0011) [2023-12-26 06:06:46,099][123090] Updated weights for policy 1, policy_version 811388 (0.0010) [2023-12-26 06:06:46,341][123091] Updated weights for policy 0, policy_version 816915 (0.0008) [2023-12-26 06:06:46,389][123091] Updated weights for policy 0, policy_version 816925 (0.0010) [2023-12-26 06:06:46,440][123091] Updated weights for policy 0, policy_version 816935 (0.0010) [2023-12-26 06:06:46,823][123090] Updated weights for policy 1, policy_version 811398 (0.0008) [2023-12-26 06:06:46,875][123090] Updated weights for policy 1, policy_version 811408 (0.0009) [2023-12-26 06:06:46,927][123090] Updated weights for policy 1, policy_version 811418 (0.0010) [2023-12-26 06:06:47,126][123091] Updated weights for policy 0, policy_version 816945 (0.0005) [2023-12-26 06:06:47,178][123091] Updated weights for policy 0, policy_version 816955 (0.0005) [2023-12-26 06:06:47,234][123091] Updated weights for policy 0, policy_version 816965 (0.0005) [2023-12-26 06:06:47,285][123091] Updated weights for policy 0, policy_version 816975 (0.0005) [2023-12-26 06:06:47,634][123090] Updated weights for policy 1, policy_version 811428 (0.0008) [2023-12-26 06:06:47,683][123090] Updated weights for policy 1, policy_version 811438 (0.0005) [2023-12-26 06:06:47,736][123090] Updated weights for policy 1, policy_version 811448 (0.0005) [2023-12-26 06:06:47,944][123091] Updated weights for policy 0, policy_version 816985 (0.0008) [2023-12-26 06:06:48,012][123091] Updated weights for policy 0, policy_version 816995 (0.0008) [2023-12-26 06:06:48,067][123091] Updated weights for policy 0, policy_version 817005 (0.0010) [2023-12-26 06:06:48,464][123090] Updated weights for policy 1, policy_version 811458 (0.0005) [2023-12-26 06:06:48,528][123090] Updated weights for policy 1, policy_version 811468 (0.0006) [2023-12-26 06:06:48,581][123090] Updated weights for policy 1, policy_version 811478 (0.0006) [2023-12-26 06:06:48,644][123090] Updated weights for policy 1, policy_version 811488 (0.0008) [2023-12-26 06:06:48,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 416899072. Throughput: 0: 8975.6, 1: 8879.2. Samples: 416910492. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:06:48,785][121949] Avg episode reward: [(0, '6293.223'), (1, '5710.775')] [2023-12-26 06:06:48,856][123091] Updated weights for policy 0, policy_version 817015 (0.0011) [2023-12-26 06:06:48,927][123091] Updated weights for policy 0, policy_version 817025 (0.0011) [2023-12-26 06:06:48,986][123091] Updated weights for policy 0, policy_version 817035 (0.0011) [2023-12-26 06:06:49,468][123090] Updated weights for policy 1, policy_version 811498 (0.0009) [2023-12-26 06:06:49,528][123090] Updated weights for policy 1, policy_version 811508 (0.0009) [2023-12-26 06:06:49,593][123090] Updated weights for policy 1, policy_version 811518 (0.0009) [2023-12-26 06:06:49,798][123091] Updated weights for policy 0, policy_version 817045 (0.0011) [2023-12-26 06:06:49,858][123091] Updated weights for policy 0, policy_version 817055 (0.0011) [2023-12-26 06:06:49,921][123091] Updated weights for policy 0, policy_version 817065 (0.0010) [2023-12-26 06:06:50,427][123090] Updated weights for policy 1, policy_version 811528 (0.0006) [2023-12-26 06:06:50,488][123090] Updated weights for policy 1, policy_version 811538 (0.0006) [2023-12-26 06:06:50,544][123090] Updated weights for policy 1, policy_version 811548 (0.0008) [2023-12-26 06:06:50,796][123091] Updated weights for policy 0, policy_version 817075 (0.0010) [2023-12-26 06:06:50,855][123091] Updated weights for policy 0, policy_version 817085 (0.0009) [2023-12-26 06:06:50,918][123091] Updated weights for policy 0, policy_version 817095 (0.0009) [2023-12-26 06:06:51,375][123090] Updated weights for policy 1, policy_version 811558 (0.0009) [2023-12-26 06:06:51,452][123090] Updated weights for policy 1, policy_version 811568 (0.0010) [2023-12-26 06:06:51,507][123090] Updated weights for policy 1, policy_version 811578 (0.0010) [2023-12-26 06:06:51,737][123091] Updated weights for policy 0, policy_version 817105 (0.0009) [2023-12-26 06:06:51,789][123091] Updated weights for policy 0, policy_version 817115 (0.0010) [2023-12-26 06:06:51,842][123091] Updated weights for policy 0, policy_version 817125 (0.0009) [2023-12-26 06:06:51,900][123091] Updated weights for policy 0, policy_version 817135 (0.0009) [2023-12-26 06:06:52,328][123090] Updated weights for policy 1, policy_version 811588 (0.0009) [2023-12-26 06:06:52,395][123090] Updated weights for policy 1, policy_version 811598 (0.0010) [2023-12-26 06:06:52,458][123090] Updated weights for policy 1, policy_version 811608 (0.0009) [2023-12-26 06:06:52,713][123091] Updated weights for policy 0, policy_version 817145 (0.0009) [2023-12-26 06:06:52,778][123091] Updated weights for policy 0, policy_version 817155 (0.0010) [2023-12-26 06:06:52,840][123091] Updated weights for policy 0, policy_version 817165 (0.0010) [2023-12-26 06:06:53,309][123090] Updated weights for policy 1, policy_version 811618 (0.0010) [2023-12-26 06:06:53,366][123090] Updated weights for policy 1, policy_version 811628 (0.0008) [2023-12-26 06:06:53,419][123090] Updated weights for policy 1, policy_version 811639 (0.0008) [2023-12-26 06:06:53,669][123091] Updated weights for policy 0, policy_version 817175 (0.0008) [2023-12-26 06:06:53,728][123091] Updated weights for policy 0, policy_version 817185 (0.0010) [2023-12-26 06:06:53,781][123091] Updated weights for policy 0, policy_version 817195 (0.0010) [2023-12-26 06:06:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 416980992. Throughput: 0: 8918.8, 1: 8895.6. Samples: 416960908. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:06:53,785][121949] Avg episode reward: [(0, '6234.723'), (1, '5819.736')] [2023-12-26 06:06:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000811648_207781888.pth... [2023-12-26 06:06:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000810592_207511552.pth [2023-12-26 06:06:53,811][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000817200_209207296.pth... [2023-12-26 06:06:53,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000816144_208936960.pth [2023-12-26 06:06:54,178][123090] Updated weights for policy 1, policy_version 811649 (0.0006) [2023-12-26 06:06:54,244][123090] Updated weights for policy 1, policy_version 811659 (0.0009) [2023-12-26 06:06:54,306][123090] Updated weights for policy 1, policy_version 811669 (0.0009) [2023-12-26 06:06:54,355][123090] Updated weights for policy 1, policy_version 811679 (0.0009) [2023-12-26 06:06:54,661][123091] Updated weights for policy 0, policy_version 817205 (0.0010) [2023-12-26 06:06:54,729][123091] Updated weights for policy 0, policy_version 817215 (0.0009) [2023-12-26 06:06:54,789][123091] Updated weights for policy 0, policy_version 817225 (0.0010) [2023-12-26 06:06:55,094][123090] Updated weights for policy 1, policy_version 811689 (0.0009) [2023-12-26 06:06:55,142][123090] Updated weights for policy 1, policy_version 811699 (0.0007) [2023-12-26 06:06:55,206][123090] Updated weights for policy 1, policy_version 811709 (0.0006) [2023-12-26 06:06:55,667][123091] Updated weights for policy 0, policy_version 817235 (0.0010) [2023-12-26 06:06:55,723][123091] Updated weights for policy 0, policy_version 817245 (0.0009) [2023-12-26 06:06:55,773][123091] Updated weights for policy 0, policy_version 817255 (0.0009) [2023-12-26 06:06:55,984][123090] Updated weights for policy 1, policy_version 811719 (0.0009) [2023-12-26 06:06:56,038][123090] Updated weights for policy 1, policy_version 811729 (0.0009) [2023-12-26 06:06:56,103][123090] Updated weights for policy 1, policy_version 811739 (0.0010) [2023-12-26 06:06:56,572][123091] Updated weights for policy 0, policy_version 817265 (0.0010) [2023-12-26 06:06:56,623][123091] Updated weights for policy 0, policy_version 817275 (0.0009) [2023-12-26 06:06:56,680][123091] Updated weights for policy 0, policy_version 817285 (0.0009) [2023-12-26 06:06:56,739][123091] Updated weights for policy 0, policy_version 817295 (0.0009) [2023-12-26 06:06:56,929][123090] Updated weights for policy 1, policy_version 811749 (0.0009) [2023-12-26 06:06:56,984][123090] Updated weights for policy 1, policy_version 811759 (0.0009) [2023-12-26 06:06:57,036][123090] Updated weights for policy 1, policy_version 811769 (0.0009) [2023-12-26 06:06:57,558][123091] Updated weights for policy 0, policy_version 817305 (0.0010) [2023-12-26 06:06:57,610][123091] Updated weights for policy 0, policy_version 817315 (0.0009) [2023-12-26 06:06:57,665][123091] Updated weights for policy 0, policy_version 817325 (0.0009) [2023-12-26 06:06:57,873][123090] Updated weights for policy 1, policy_version 811779 (0.0008) [2023-12-26 06:06:57,934][123090] Updated weights for policy 1, policy_version 811789 (0.0008) [2023-12-26 06:06:58,005][123090] Updated weights for policy 1, policy_version 811799 (0.0009) [2023-12-26 06:06:58,540][123091] Updated weights for policy 0, policy_version 817335 (0.0010) [2023-12-26 06:06:58,615][123091] Updated weights for policy 0, policy_version 817345 (0.0009) [2023-12-26 06:06:58,685][123091] Updated weights for policy 0, policy_version 817355 (0.0009) [2023-12-26 06:06:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 417071104. Throughput: 0: 8860.9, 1: 8943.4. Samples: 417065028. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:06:58,785][121949] Avg episode reward: [(0, '5999.277'), (1, '5891.171')] [2023-12-26 06:06:58,966][123090] Updated weights for policy 1, policy_version 811809 (0.0010) [2023-12-26 06:06:59,034][123090] Updated weights for policy 1, policy_version 811819 (0.0008) [2023-12-26 06:06:59,105][123090] Updated weights for policy 1, policy_version 811829 (0.0007) [2023-12-26 06:06:59,181][123090] Updated weights for policy 1, policy_version 811839 (0.0008) [2023-12-26 06:06:59,535][123091] Updated weights for policy 0, policy_version 817365 (0.0010) [2023-12-26 06:06:59,601][123091] Updated weights for policy 0, policy_version 817375 (0.0010) [2023-12-26 06:06:59,664][123091] Updated weights for policy 0, policy_version 817385 (0.0009) [2023-12-26 06:06:59,830][123090] Updated weights for policy 1, policy_version 811849 (0.0007) [2023-12-26 06:06:59,894][123090] Updated weights for policy 1, policy_version 811859 (0.0009) [2023-12-26 06:06:59,962][123090] Updated weights for policy 1, policy_version 811869 (0.0009) [2023-12-26 06:07:00,427][123091] Updated weights for policy 0, policy_version 817395 (0.0008) [2023-12-26 06:07:00,494][123091] Updated weights for policy 0, policy_version 817405 (0.0005) [2023-12-26 06:07:00,554][123091] Updated weights for policy 0, policy_version 817415 (0.0008) [2023-12-26 06:07:00,786][123090] Updated weights for policy 1, policy_version 811879 (0.0009) [2023-12-26 06:07:00,854][123090] Updated weights for policy 1, policy_version 811889 (0.0009) [2023-12-26 06:07:00,905][123090] Updated weights for policy 1, policy_version 811899 (0.0008) [2023-12-26 06:07:01,300][123091] Updated weights for policy 0, policy_version 817425 (0.0011) [2023-12-26 06:07:01,347][123091] Updated weights for policy 0, policy_version 817435 (0.0010) [2023-12-26 06:07:01,412][123091] Updated weights for policy 0, policy_version 817445 (0.0009) [2023-12-26 06:07:01,463][123091] Updated weights for policy 0, policy_version 817455 (0.0008) [2023-12-26 06:07:01,735][123090] Updated weights for policy 1, policy_version 811909 (0.0008) [2023-12-26 06:07:01,810][123090] Updated weights for policy 1, policy_version 811919 (0.0006) [2023-12-26 06:07:01,880][123090] Updated weights for policy 1, policy_version 811929 (0.0005) [2023-12-26 06:07:02,301][123091] Updated weights for policy 0, policy_version 817465 (0.0007) [2023-12-26 06:07:02,376][123091] Updated weights for policy 0, policy_version 817475 (0.0007) [2023-12-26 06:07:02,446][123091] Updated weights for policy 0, policy_version 817485 (0.0010) [2023-12-26 06:07:02,651][123090] Updated weights for policy 1, policy_version 811939 (0.0006) [2023-12-26 06:07:02,716][123090] Updated weights for policy 1, policy_version 811949 (0.0005) [2023-12-26 06:07:02,779][123090] Updated weights for policy 1, policy_version 811959 (0.0010) [2023-12-26 06:07:03,120][123091] Updated weights for policy 0, policy_version 817495 (0.0007) [2023-12-26 06:07:03,168][123091] Updated weights for policy 0, policy_version 817505 (0.0005) [2023-12-26 06:07:03,225][123091] Updated weights for policy 0, policy_version 817515 (0.0005) [2023-12-26 06:07:03,554][123090] Updated weights for policy 1, policy_version 811969 (0.0009) [2023-12-26 06:07:03,620][123090] Updated weights for policy 1, policy_version 811979 (0.0005) [2023-12-26 06:07:03,676][123090] Updated weights for policy 1, policy_version 811989 (0.0005) [2023-12-26 06:07:03,743][123090] Updated weights for policy 1, policy_version 811999 (0.0005) [2023-12-26 06:07:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 417161216. Throughput: 0: 8834.0, 1: 8861.3. Samples: 417171064. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:03,784][121949] Avg episode reward: [(0, '5926.234'), (1, '5973.946')] [2023-12-26 06:07:03,902][123091] Updated weights for policy 0, policy_version 817525 (0.0007) [2023-12-26 06:07:03,969][123091] Updated weights for policy 0, policy_version 817535 (0.0008) [2023-12-26 06:07:04,039][123091] Updated weights for policy 0, policy_version 817545 (0.0008) [2023-12-26 06:07:04,450][123090] Updated weights for policy 1, policy_version 812009 (0.0007) [2023-12-26 06:07:04,513][123090] Updated weights for policy 1, policy_version 812019 (0.0009) [2023-12-26 06:07:04,573][123090] Updated weights for policy 1, policy_version 812029 (0.0009) [2023-12-26 06:07:04,782][123091] Updated weights for policy 0, policy_version 817555 (0.0009) [2023-12-26 06:07:04,845][123091] Updated weights for policy 0, policy_version 817565 (0.0009) [2023-12-26 06:07:04,905][123091] Updated weights for policy 0, policy_version 817575 (0.0009) [2023-12-26 06:07:05,476][123090] Updated weights for policy 1, policy_version 812039 (0.0009) [2023-12-26 06:07:05,552][123090] Updated weights for policy 1, policy_version 812049 (0.0005) [2023-12-26 06:07:05,599][123090] Updated weights for policy 1, policy_version 812059 (0.0005) [2023-12-26 06:07:05,684][123091] Updated weights for policy 0, policy_version 817585 (0.0010) [2023-12-26 06:07:05,752][123091] Updated weights for policy 0, policy_version 817595 (0.0008) [2023-12-26 06:07:05,809][123091] Updated weights for policy 0, policy_version 817605 (0.0009) [2023-12-26 06:07:05,871][123091] Updated weights for policy 0, policy_version 817615 (0.0006) [2023-12-26 06:07:06,297][123090] Updated weights for policy 1, policy_version 812069 (0.0005) [2023-12-26 06:07:06,361][123090] Updated weights for policy 1, policy_version 812079 (0.0008) [2023-12-26 06:07:06,425][123090] Updated weights for policy 1, policy_version 812089 (0.0010) [2023-12-26 06:07:06,675][123091] Updated weights for policy 0, policy_version 817625 (0.0010) [2023-12-26 06:07:06,732][123091] Updated weights for policy 0, policy_version 817635 (0.0011) [2023-12-26 06:07:06,792][123091] Updated weights for policy 0, policy_version 817645 (0.0011) [2023-12-26 06:07:07,252][123090] Updated weights for policy 1, policy_version 812099 (0.0011) [2023-12-26 06:07:07,306][123090] Updated weights for policy 1, policy_version 812110 (0.0010) [2023-12-26 06:07:07,355][123090] Updated weights for policy 1, policy_version 812120 (0.0009) [2023-12-26 06:07:07,572][123091] Updated weights for policy 0, policy_version 817655 (0.0011) [2023-12-26 06:07:07,623][123091] Updated weights for policy 0, policy_version 817665 (0.0010) [2023-12-26 06:07:07,675][123091] Updated weights for policy 0, policy_version 817675 (0.0010) [2023-12-26 06:07:08,081][123090] Updated weights for policy 1, policy_version 812130 (0.0008) [2023-12-26 06:07:08,142][123090] Updated weights for policy 1, policy_version 812140 (0.0005) [2023-12-26 06:07:08,201][123090] Updated weights for policy 1, policy_version 812150 (0.0005) [2023-12-26 06:07:08,255][123090] Updated weights for policy 1, policy_version 812160 (0.0005) [2023-12-26 06:07:08,534][123091] Updated weights for policy 0, policy_version 817685 (0.0010) [2023-12-26 06:07:08,582][123091] Updated weights for policy 0, policy_version 817695 (0.0010) [2023-12-26 06:07:08,634][123091] Updated weights for policy 0, policy_version 817705 (0.0010) [2023-12-26 06:07:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 417251328. Throughput: 0: 8887.2, 1: 8915.8. Samples: 417225004. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:08,785][121949] Avg episode reward: [(0, '6042.259'), (1, '6058.174')] [2023-12-26 06:07:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000817712_209338368.pth... [2023-12-26 06:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000812160_207912960.pth... [2023-12-26 06:07:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000816688_209076224.pth [2023-12-26 06:07:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000811136_207650816.pth [2023-12-26 06:07:09,002][123090] Updated weights for policy 1, policy_version 812170 (0.0009) [2023-12-26 06:07:09,062][123090] Updated weights for policy 1, policy_version 812180 (0.0008) [2023-12-26 06:07:09,127][123090] Updated weights for policy 1, policy_version 812190 (0.0009) [2023-12-26 06:07:09,479][123091] Updated weights for policy 0, policy_version 817715 (0.0010) [2023-12-26 06:07:09,541][123091] Updated weights for policy 0, policy_version 817725 (0.0008) [2023-12-26 06:07:09,606][123091] Updated weights for policy 0, policy_version 817735 (0.0006) [2023-12-26 06:07:10,004][123090] Updated weights for policy 1, policy_version 812200 (0.0007) [2023-12-26 06:07:10,054][123090] Updated weights for policy 1, policy_version 812210 (0.0009) [2023-12-26 06:07:10,112][123090] Updated weights for policy 1, policy_version 812220 (0.0009) [2023-12-26 06:07:10,408][123091] Updated weights for policy 0, policy_version 817745 (0.0008) [2023-12-26 06:07:10,471][123091] Updated weights for policy 0, policy_version 817755 (0.0011) [2023-12-26 06:07:10,539][123091] Updated weights for policy 0, policy_version 817765 (0.0011) [2023-12-26 06:07:10,602][123091] Updated weights for policy 0, policy_version 817775 (0.0011) [2023-12-26 06:07:10,978][123090] Updated weights for policy 1, policy_version 812230 (0.0009) [2023-12-26 06:07:11,043][123090] Updated weights for policy 1, policy_version 812240 (0.0009) [2023-12-26 06:07:11,112][123090] Updated weights for policy 1, policy_version 812250 (0.0009) [2023-12-26 06:07:11,438][123091] Updated weights for policy 0, policy_version 817785 (0.0010) [2023-12-26 06:07:11,505][123091] Updated weights for policy 0, policy_version 817795 (0.0009) [2023-12-26 06:07:11,573][123091] Updated weights for policy 0, policy_version 817805 (0.0009) [2023-12-26 06:07:11,957][123090] Updated weights for policy 1, policy_version 812260 (0.0008) [2023-12-26 06:07:12,027][123090] Updated weights for policy 1, policy_version 812270 (0.0010) [2023-12-26 06:07:12,090][123090] Updated weights for policy 1, policy_version 812280 (0.0009) [2023-12-26 06:07:12,488][123091] Updated weights for policy 0, policy_version 817815 (0.0010) [2023-12-26 06:07:12,551][123091] Updated weights for policy 0, policy_version 817825 (0.0010) [2023-12-26 06:07:12,613][123091] Updated weights for policy 0, policy_version 817835 (0.0010) [2023-12-26 06:07:12,871][123090] Updated weights for policy 1, policy_version 812290 (0.0010) [2023-12-26 06:07:12,934][123090] Updated weights for policy 1, policy_version 812300 (0.0007) [2023-12-26 06:07:13,000][123090] Updated weights for policy 1, policy_version 812310 (0.0006) [2023-12-26 06:07:13,068][123090] Updated weights for policy 1, policy_version 812320 (0.0005) [2023-12-26 06:07:13,428][123091] Updated weights for policy 0, policy_version 817845 (0.0007) [2023-12-26 06:07:13,473][123091] Updated weights for policy 0, policy_version 817855 (0.0005) [2023-12-26 06:07:13,537][123091] Updated weights for policy 0, policy_version 817865 (0.0006) [2023-12-26 06:07:13,730][123090] Updated weights for policy 1, policy_version 812330 (0.0006) [2023-12-26 06:07:13,777][123090] Updated weights for policy 1, policy_version 812340 (0.0010) [2023-12-26 06:07:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 417333248. Throughput: 0: 8751.2, 1: 8929.2. Samples: 417327340. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:13,785][121949] Avg episode reward: [(0, '6194.154'), (1, '6014.166')] [2023-12-26 06:07:13,831][123090] Updated weights for policy 1, policy_version 812350 (0.0008) [2023-12-26 06:07:14,196][123091] Updated weights for policy 0, policy_version 817875 (0.0006) [2023-12-26 06:07:14,260][123091] Updated weights for policy 0, policy_version 817885 (0.0006) [2023-12-26 06:07:14,317][123091] Updated weights for policy 0, policy_version 817895 (0.0006) [2023-12-26 06:07:14,576][123090] Updated weights for policy 1, policy_version 812360 (0.0005) [2023-12-26 06:07:14,633][123090] Updated weights for policy 1, policy_version 812370 (0.0005) [2023-12-26 06:07:14,680][123090] Updated weights for policy 1, policy_version 812380 (0.0005) [2023-12-26 06:07:14,993][123091] Updated weights for policy 0, policy_version 817905 (0.0007) [2023-12-26 06:07:15,072][123091] Updated weights for policy 0, policy_version 817915 (0.0011) [2023-12-26 06:07:15,136][123091] Updated weights for policy 0, policy_version 817925 (0.0008) [2023-12-26 06:07:15,201][123091] Updated weights for policy 0, policy_version 817935 (0.0005) [2023-12-26 06:07:15,408][123090] Updated weights for policy 1, policy_version 812390 (0.0005) [2023-12-26 06:07:15,486][123090] Updated weights for policy 1, policy_version 812400 (0.0006) [2023-12-26 06:07:15,569][123090] Updated weights for policy 1, policy_version 812410 (0.0006) [2023-12-26 06:07:15,881][123091] Updated weights for policy 0, policy_version 817945 (0.0006) [2023-12-26 06:07:15,949][123091] Updated weights for policy 0, policy_version 817955 (0.0006) [2023-12-26 06:07:15,996][123091] Updated weights for policy 0, policy_version 817965 (0.0006) [2023-12-26 06:07:16,213][123090] Updated weights for policy 1, policy_version 812420 (0.0010) [2023-12-26 06:07:16,261][123090] Updated weights for policy 1, policy_version 812430 (0.0007) [2023-12-26 06:07:16,339][123090] Updated weights for policy 1, policy_version 812440 (0.0006) [2023-12-26 06:07:16,779][123091] Updated weights for policy 0, policy_version 817975 (0.0010) [2023-12-26 06:07:16,843][123091] Updated weights for policy 0, policy_version 817985 (0.0011) [2023-12-26 06:07:16,906][123091] Updated weights for policy 0, policy_version 817995 (0.0011) [2023-12-26 06:07:17,107][123090] Updated weights for policy 1, policy_version 812450 (0.0006) [2023-12-26 06:07:17,180][123090] Updated weights for policy 1, policy_version 812460 (0.0009) [2023-12-26 06:07:17,238][123090] Updated weights for policy 1, policy_version 812470 (0.0007) [2023-12-26 06:07:17,287][123090] Updated weights for policy 1, policy_version 812480 (0.0005) [2023-12-26 06:07:17,731][123091] Updated weights for policy 0, policy_version 818005 (0.0008) [2023-12-26 06:07:17,797][123091] Updated weights for policy 0, policy_version 818015 (0.0005) [2023-12-26 06:07:17,866][123091] Updated weights for policy 0, policy_version 818025 (0.0006) [2023-12-26 06:07:17,951][123090] Updated weights for policy 1, policy_version 812490 (0.0008) [2023-12-26 06:07:18,014][123090] Updated weights for policy 1, policy_version 812500 (0.0010) [2023-12-26 06:07:18,080][123090] Updated weights for policy 1, policy_version 812510 (0.0010) [2023-12-26 06:07:18,498][123091] Updated weights for policy 0, policy_version 818035 (0.0006) [2023-12-26 06:07:18,557][123091] Updated weights for policy 0, policy_version 818045 (0.0009) [2023-12-26 06:07:18,618][123091] Updated weights for policy 0, policy_version 818055 (0.0011) [2023-12-26 06:07:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 417431552. Throughput: 0: 8878.1, 1: 8995.8. Samples: 417443112. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:18,785][121949] Avg episode reward: [(0, '6173.875'), (1, '5971.104')] [2023-12-26 06:07:18,837][123090] Updated weights for policy 1, policy_version 812520 (0.0006) [2023-12-26 06:07:18,913][123090] Updated weights for policy 1, policy_version 812530 (0.0005) [2023-12-26 06:07:18,990][123090] Updated weights for policy 1, policy_version 812540 (0.0005) [2023-12-26 06:07:19,399][123091] Updated weights for policy 0, policy_version 818065 (0.0011) [2023-12-26 06:07:19,461][123091] Updated weights for policy 0, policy_version 818075 (0.0006) [2023-12-26 06:07:19,535][123091] Updated weights for policy 0, policy_version 818085 (0.0008) [2023-12-26 06:07:19,611][123091] Updated weights for policy 0, policy_version 818095 (0.0011) [2023-12-26 06:07:19,721][123090] Updated weights for policy 1, policy_version 812550 (0.0008) [2023-12-26 06:07:19,783][123090] Updated weights for policy 1, policy_version 812560 (0.0009) [2023-12-26 06:07:19,858][123090] Updated weights for policy 1, policy_version 812570 (0.0009) [2023-12-26 06:07:20,412][123091] Updated weights for policy 0, policy_version 818105 (0.0010) [2023-12-26 06:07:20,468][123091] Updated weights for policy 0, policy_version 818115 (0.0010) [2023-12-26 06:07:20,520][123091] Updated weights for policy 0, policy_version 818125 (0.0010) [2023-12-26 06:07:20,649][123090] Updated weights for policy 1, policy_version 812580 (0.0010) [2023-12-26 06:07:20,700][123090] Updated weights for policy 1, policy_version 812590 (0.0009) [2023-12-26 06:07:20,761][123090] Updated weights for policy 1, policy_version 812600 (0.0009) [2023-12-26 06:07:21,404][123091] Updated weights for policy 0, policy_version 818135 (0.0008) [2023-12-26 06:07:21,474][123091] Updated weights for policy 0, policy_version 818145 (0.0006) [2023-12-26 06:07:21,548][123091] Updated weights for policy 0, policy_version 818155 (0.0008) [2023-12-26 06:07:21,638][123090] Updated weights for policy 1, policy_version 812610 (0.0009) [2023-12-26 06:07:21,704][123090] Updated weights for policy 1, policy_version 812620 (0.0010) [2023-12-26 06:07:21,779][123090] Updated weights for policy 1, policy_version 812630 (0.0011) [2023-12-26 06:07:21,839][123090] Updated weights for policy 1, policy_version 812640 (0.0011) [2023-12-26 06:07:22,374][123091] Updated weights for policy 0, policy_version 818165 (0.0008) [2023-12-26 06:07:22,430][123091] Updated weights for policy 0, policy_version 818175 (0.0009) [2023-12-26 06:07:22,480][123091] Updated weights for policy 0, policy_version 818185 (0.0009) [2023-12-26 06:07:22,672][123090] Updated weights for policy 1, policy_version 812650 (0.0010) [2023-12-26 06:07:22,740][123090] Updated weights for policy 1, policy_version 812660 (0.0011) [2023-12-26 06:07:22,805][123090] Updated weights for policy 1, policy_version 812670 (0.0010) [2023-12-26 06:07:23,405][123091] Updated weights for policy 0, policy_version 818195 (0.0009) [2023-12-26 06:07:23,462][123091] Updated weights for policy 0, policy_version 818205 (0.0010) [2023-12-26 06:07:23,474][123090] Updated weights for policy 1, policy_version 812680 (0.0010) [2023-12-26 06:07:23,512][123091] Updated weights for policy 0, policy_version 818215 (0.0006) [2023-12-26 06:07:23,530][123090] Updated weights for policy 1, policy_version 812690 (0.0010) [2023-12-26 06:07:23,593][123090] Updated weights for policy 1, policy_version 812700 (0.0010) [2023-12-26 06:07:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 417521664. Throughput: 0: 8809.2, 1: 8963.7. Samples: 417494708. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:23,784][121949] Avg episode reward: [(0, '5998.343'), (1, '6022.513')] [2023-12-26 06:07:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000818224_209469440.pth... [2023-12-26 06:07:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000812704_208052224.pth... [2023-12-26 06:07:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000817200_209207296.pth [2023-12-26 06:07:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000811648_207781888.pth [2023-12-26 06:07:24,259][123090] Updated weights for policy 1, policy_version 812710 (0.0007) [2023-12-26 06:07:24,324][123090] Updated weights for policy 1, policy_version 812720 (0.0007) [2023-12-26 06:07:24,375][123090] Updated weights for policy 1, policy_version 812730 (0.0010) [2023-12-26 06:07:24,423][123091] Updated weights for policy 0, policy_version 818225 (0.0006) [2023-12-26 06:07:24,494][123091] Updated weights for policy 0, policy_version 818235 (0.0009) [2023-12-26 06:07:24,562][123091] Updated weights for policy 0, policy_version 818245 (0.0009) [2023-12-26 06:07:24,612][123091] Updated weights for policy 0, policy_version 818255 (0.0009) [2023-12-26 06:07:25,084][123090] Updated weights for policy 1, policy_version 812740 (0.0008) [2023-12-26 06:07:25,146][123090] Updated weights for policy 1, policy_version 812750 (0.0005) [2023-12-26 06:07:25,217][123090] Updated weights for policy 1, policy_version 812760 (0.0005) [2023-12-26 06:07:25,314][123091] Updated weights for policy 0, policy_version 818265 (0.0005) [2023-12-26 06:07:25,384][123091] Updated weights for policy 0, policy_version 818275 (0.0005) [2023-12-26 06:07:25,453][123091] Updated weights for policy 0, policy_version 818285 (0.0006) [2023-12-26 06:07:25,963][123090] Updated weights for policy 1, policy_version 812770 (0.0008) [2023-12-26 06:07:26,028][123090] Updated weights for policy 1, policy_version 812780 (0.0009) [2023-12-26 06:07:26,093][123090] Updated weights for policy 1, policy_version 812790 (0.0009) [2023-12-26 06:07:26,155][123090] Updated weights for policy 1, policy_version 812800 (0.0010) [2023-12-26 06:07:26,185][123091] Updated weights for policy 0, policy_version 818296 (0.0009) [2023-12-26 06:07:26,246][123091] Updated weights for policy 0, policy_version 818306 (0.0009) [2023-12-26 06:07:26,307][123091] Updated weights for policy 0, policy_version 818316 (0.0010) [2023-12-26 06:07:26,989][123090] Updated weights for policy 1, policy_version 812810 (0.0005) [2023-12-26 06:07:27,034][123090] Updated weights for policy 1, policy_version 812820 (0.0007) [2023-12-26 06:07:27,039][123091] Updated weights for policy 0, policy_version 818326 (0.0007) [2023-12-26 06:07:27,082][123090] Updated weights for policy 1, policy_version 812830 (0.0010) [2023-12-26 06:07:27,084][123091] Updated weights for policy 0, policy_version 818336 (0.0005) [2023-12-26 06:07:27,138][123091] Updated weights for policy 0, policy_version 818346 (0.0008) [2023-12-26 06:07:27,867][123091] Updated weights for policy 0, policy_version 818356 (0.0007) [2023-12-26 06:07:27,919][123091] Updated weights for policy 0, policy_version 818366 (0.0005) [2023-12-26 06:07:27,947][123090] Updated weights for policy 1, policy_version 812840 (0.0011) [2023-12-26 06:07:27,978][123091] Updated weights for policy 0, policy_version 818376 (0.0005) [2023-12-26 06:07:28,011][123090] Updated weights for policy 1, policy_version 812850 (0.0011) [2023-12-26 06:07:28,058][123090] Updated weights for policy 1, policy_version 812860 (0.0010) [2023-12-26 06:07:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 417603584. Throughput: 0: 8848.0, 1: 8995.4. Samples: 417602028. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:28,785][121949] Avg episode reward: [(0, '6095.590'), (1, '5934.521')] [2023-12-26 06:07:28,794][123090] Updated weights for policy 1, policy_version 812870 (0.0010) [2023-12-26 06:07:28,801][123091] Updated weights for policy 0, policy_version 818386 (0.0006) [2023-12-26 06:07:28,852][123090] Updated weights for policy 1, policy_version 812880 (0.0007) [2023-12-26 06:07:28,858][123091] Updated weights for policy 0, policy_version 818396 (0.0010) [2023-12-26 06:07:28,917][123091] Updated weights for policy 0, policy_version 818406 (0.0008) [2023-12-26 06:07:28,920][123090] Updated weights for policy 1, policy_version 812890 (0.0006) [2023-12-26 06:07:28,980][123091] Updated weights for policy 0, policy_version 818416 (0.0005) [2023-12-26 06:07:29,663][123090] Updated weights for policy 1, policy_version 812900 (0.0005) [2023-12-26 06:07:29,727][123090] Updated weights for policy 1, policy_version 812910 (0.0005) [2023-12-26 06:07:29,751][123091] Updated weights for policy 0, policy_version 818426 (0.0011) [2023-12-26 06:07:29,787][123090] Updated weights for policy 1, policy_version 812920 (0.0006) [2023-12-26 06:07:29,817][123091] Updated weights for policy 0, policy_version 818437 (0.0010) [2023-12-26 06:07:29,887][123091] Updated weights for policy 0, policy_version 818447 (0.0011) [2023-12-26 06:07:30,595][123090] Updated weights for policy 1, policy_version 812930 (0.0009) [2023-12-26 06:07:30,664][123090] Updated weights for policy 1, policy_version 812940 (0.0010) [2023-12-26 06:07:30,707][123091] Updated weights for policy 0, policy_version 818457 (0.0009) [2023-12-26 06:07:30,718][123090] Updated weights for policy 1, policy_version 812950 (0.0010) [2023-12-26 06:07:30,751][123091] Updated weights for policy 0, policy_version 818467 (0.0007) [2023-12-26 06:07:30,773][123090] Updated weights for policy 1, policy_version 812960 (0.0010) [2023-12-26 06:07:30,801][123091] Updated weights for policy 0, policy_version 818477 (0.0009) [2023-12-26 06:07:31,614][123090] Updated weights for policy 1, policy_version 812970 (0.0010) [2023-12-26 06:07:31,678][123090] Updated weights for policy 1, policy_version 812980 (0.0011) [2023-12-26 06:07:31,698][123091] Updated weights for policy 0, policy_version 818487 (0.0007) [2023-12-26 06:07:31,747][123090] Updated weights for policy 1, policy_version 812990 (0.0010) [2023-12-26 06:07:31,767][123091] Updated weights for policy 0, policy_version 818497 (0.0007) [2023-12-26 06:07:31,832][123091] Updated weights for policy 0, policy_version 818507 (0.0009) [2023-12-26 06:07:32,562][123090] Updated weights for policy 1, policy_version 813000 (0.0010) [2023-12-26 06:07:32,625][123090] Updated weights for policy 1, policy_version 813010 (0.0010) [2023-12-26 06:07:32,666][123091] Updated weights for policy 0, policy_version 818517 (0.0008) [2023-12-26 06:07:32,680][123090] Updated weights for policy 1, policy_version 813020 (0.0010) [2023-12-26 06:07:32,726][123091] Updated weights for policy 0, policy_version 818527 (0.0007) [2023-12-26 06:07:32,788][123091] Updated weights for policy 0, policy_version 818537 (0.0009) [2023-12-26 06:07:33,502][123090] Updated weights for policy 1, policy_version 813030 (0.0010) [2023-12-26 06:07:33,553][123090] Updated weights for policy 1, policy_version 813040 (0.0010) [2023-12-26 06:07:33,609][123090] Updated weights for policy 1, policy_version 813050 (0.0010) [2023-12-26 06:07:33,624][123091] Updated weights for policy 0, policy_version 818547 (0.0008) [2023-12-26 06:07:33,679][123091] Updated weights for policy 0, policy_version 818557 (0.0008) [2023-12-26 06:07:33,728][123091] Updated weights for policy 0, policy_version 818567 (0.0009) [2023-12-26 06:07:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 417701888. Throughput: 0: 8795.9, 1: 8917.7. Samples: 417707604. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:33,785][121949] Avg episode reward: [(0, '6109.984'), (1, '5747.625')] [2023-12-26 06:07:34,471][123090] Updated weights for policy 1, policy_version 813060 (0.0010) [2023-12-26 06:07:34,544][123090] Updated weights for policy 1, policy_version 813070 (0.0011) [2023-12-26 06:07:34,612][123091] Updated weights for policy 0, policy_version 818577 (0.0008) [2023-12-26 06:07:34,614][123090] Updated weights for policy 1, policy_version 813080 (0.0011) [2023-12-26 06:07:34,681][123091] Updated weights for policy 0, policy_version 818587 (0.0009) [2023-12-26 06:07:34,743][123091] Updated weights for policy 0, policy_version 818597 (0.0009) [2023-12-26 06:07:34,801][123091] Updated weights for policy 0, policy_version 818607 (0.0009) [2023-12-26 06:07:35,465][123090] Updated weights for policy 1, policy_version 813090 (0.0009) [2023-12-26 06:07:35,520][123090] Updated weights for policy 1, policy_version 813100 (0.0010) [2023-12-26 06:07:35,567][123090] Updated weights for policy 1, policy_version 813110 (0.0010) [2023-12-26 06:07:35,618][123090] Updated weights for policy 1, policy_version 813120 (0.0010) [2023-12-26 06:07:35,659][123091] Updated weights for policy 0, policy_version 818617 (0.0009) [2023-12-26 06:07:35,708][123091] Updated weights for policy 0, policy_version 818627 (0.0009) [2023-12-26 06:07:35,760][123091] Updated weights for policy 0, policy_version 818637 (0.0009) [2023-12-26 06:07:36,471][123090] Updated weights for policy 1, policy_version 813130 (0.0011) [2023-12-26 06:07:36,527][123090] Updated weights for policy 1, policy_version 813140 (0.0011) [2023-12-26 06:07:36,580][123090] Updated weights for policy 1, policy_version 813150 (0.0010) [2023-12-26 06:07:36,625][123091] Updated weights for policy 0, policy_version 818647 (0.0008) [2023-12-26 06:07:36,689][123091] Updated weights for policy 0, policy_version 818657 (0.0009) [2023-12-26 06:07:36,746][123091] Updated weights for policy 0, policy_version 818667 (0.0008) [2023-12-26 06:07:37,439][123090] Updated weights for policy 1, policy_version 813160 (0.0011) [2023-12-26 06:07:37,503][123090] Updated weights for policy 1, policy_version 813170 (0.0010) [2023-12-26 06:07:37,562][123090] Updated weights for policy 1, policy_version 813180 (0.0011) [2023-12-26 06:07:37,585][123091] Updated weights for policy 0, policy_version 818677 (0.0009) [2023-12-26 06:07:37,642][123091] Updated weights for policy 0, policy_version 818687 (0.0008) [2023-12-26 06:07:37,703][123091] Updated weights for policy 0, policy_version 818697 (0.0009) [2023-12-26 06:07:38,375][123090] Updated weights for policy 1, policy_version 813190 (0.0011) [2023-12-26 06:07:38,443][123090] Updated weights for policy 1, policy_version 813200 (0.0011) [2023-12-26 06:07:38,505][123090] Updated weights for policy 1, policy_version 813210 (0.0010) [2023-12-26 06:07:38,568][123091] Updated weights for policy 0, policy_version 818707 (0.0009) [2023-12-26 06:07:38,633][123091] Updated weights for policy 0, policy_version 818717 (0.0009) [2023-12-26 06:07:38,694][123091] Updated weights for policy 0, policy_version 818727 (0.0008) [2023-12-26 06:07:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 417783808. Throughput: 0: 8779.4, 1: 8917.9. Samples: 417757284. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:38,785][121949] Avg episode reward: [(0, '6216.862'), (1, '5649.138')] [2023-12-26 06:07:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000818736_209600512.pth... [2023-12-26 06:07:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000813216_208183296.pth... [2023-12-26 06:07:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000812160_207912960.pth [2023-12-26 06:07:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000817712_209338368.pth [2023-12-26 06:07:39,329][123090] Updated weights for policy 1, policy_version 813220 (0.0011) [2023-12-26 06:07:39,396][123090] Updated weights for policy 1, policy_version 813230 (0.0011) [2023-12-26 06:07:39,460][123090] Updated weights for policy 1, policy_version 813240 (0.0008) [2023-12-26 06:07:39,561][123091] Updated weights for policy 0, policy_version 818737 (0.0009) [2023-12-26 06:07:39,629][123091] Updated weights for policy 0, policy_version 818747 (0.0010) [2023-12-26 06:07:39,695][123091] Updated weights for policy 0, policy_version 818757 (0.0011) [2023-12-26 06:07:39,762][123091] Updated weights for policy 0, policy_version 818767 (0.0010) [2023-12-26 06:07:40,233][123090] Updated weights for policy 1, policy_version 813250 (0.0007) [2023-12-26 06:07:40,292][123090] Updated weights for policy 1, policy_version 813260 (0.0009) [2023-12-26 06:07:40,358][123090] Updated weights for policy 1, policy_version 813270 (0.0007) [2023-12-26 06:07:40,417][123090] Updated weights for policy 1, policy_version 813280 (0.0007) [2023-12-26 06:07:40,644][123091] Updated weights for policy 0, policy_version 818777 (0.0009) [2023-12-26 06:07:40,700][123091] Updated weights for policy 0, policy_version 818787 (0.0009) [2023-12-26 06:07:40,755][123091] Updated weights for policy 0, policy_version 818797 (0.0008) [2023-12-26 06:07:41,205][123090] Updated weights for policy 1, policy_version 813290 (0.0009) [2023-12-26 06:07:41,274][123090] Updated weights for policy 1, policy_version 813300 (0.0009) [2023-12-26 06:07:41,344][123090] Updated weights for policy 1, policy_version 813310 (0.0009) [2023-12-26 06:07:41,574][123091] Updated weights for policy 0, policy_version 818807 (0.0009) [2023-12-26 06:07:41,636][123091] Updated weights for policy 0, policy_version 818818 (0.0008) [2023-12-26 06:07:41,704][123091] Updated weights for policy 0, policy_version 818828 (0.0006) [2023-12-26 06:07:42,102][123090] Updated weights for policy 1, policy_version 813320 (0.0009) [2023-12-26 06:07:42,162][123090] Updated weights for policy 1, policy_version 813330 (0.0008) [2023-12-26 06:07:42,225][123090] Updated weights for policy 1, policy_version 813340 (0.0005) [2023-12-26 06:07:42,501][123091] Updated weights for policy 0, policy_version 818838 (0.0007) [2023-12-26 06:07:42,570][123091] Updated weights for policy 0, policy_version 818848 (0.0008) [2023-12-26 06:07:42,634][123091] Updated weights for policy 0, policy_version 818858 (0.0007) [2023-12-26 06:07:42,989][123090] Updated weights for policy 1, policy_version 813350 (0.0007) [2023-12-26 06:07:43,054][123090] Updated weights for policy 1, policy_version 813360 (0.0011) [2023-12-26 06:07:43,117][123090] Updated weights for policy 1, policy_version 813370 (0.0010) [2023-12-26 06:07:43,362][123091] Updated weights for policy 0, policy_version 818868 (0.0008) [2023-12-26 06:07:43,418][123091] Updated weights for policy 0, policy_version 818878 (0.0011) [2023-12-26 06:07:43,482][123091] Updated weights for policy 0, policy_version 818888 (0.0011) [2023-12-26 06:07:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 417865728. Throughput: 0: 8774.1, 1: 8895.7. Samples: 417860164. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:43,785][121949] Avg episode reward: [(0, '6125.326'), (1, '5830.337')] [2023-12-26 06:07:43,801][123090] Updated weights for policy 1, policy_version 813380 (0.0006) [2023-12-26 06:07:43,860][123090] Updated weights for policy 1, policy_version 813390 (0.0005) [2023-12-26 06:07:43,927][123090] Updated weights for policy 1, policy_version 813400 (0.0008) [2023-12-26 06:07:44,298][123091] Updated weights for policy 0, policy_version 818898 (0.0011) [2023-12-26 06:07:44,353][123091] Updated weights for policy 0, policy_version 818908 (0.0010) [2023-12-26 06:07:44,408][123091] Updated weights for policy 0, policy_version 818918 (0.0010) [2023-12-26 06:07:44,460][123091] Updated weights for policy 0, policy_version 818928 (0.0010) [2023-12-26 06:07:44,593][123090] Updated weights for policy 1, policy_version 813410 (0.0009) [2023-12-26 06:07:44,653][123090] Updated weights for policy 1, policy_version 813420 (0.0005) [2023-12-26 06:07:44,711][123090] Updated weights for policy 1, policy_version 813430 (0.0009) [2023-12-26 06:07:44,774][123090] Updated weights for policy 1, policy_version 813440 (0.0007) [2023-12-26 06:07:45,281][123091] Updated weights for policy 0, policy_version 818938 (0.0009) [2023-12-26 06:07:45,352][123091] Updated weights for policy 0, policy_version 818948 (0.0011) [2023-12-26 06:07:45,414][123091] Updated weights for policy 0, policy_version 818958 (0.0007) [2023-12-26 06:07:45,537][123090] Updated weights for policy 1, policy_version 813450 (0.0010) [2023-12-26 06:07:45,604][123090] Updated weights for policy 1, policy_version 813460 (0.0010) [2023-12-26 06:07:45,662][123090] Updated weights for policy 1, policy_version 813470 (0.0010) [2023-12-26 06:07:46,212][123091] Updated weights for policy 0, policy_version 818968 (0.0007) [2023-12-26 06:07:46,266][123091] Updated weights for policy 0, policy_version 818978 (0.0005) [2023-12-26 06:07:46,328][123091] Updated weights for policy 0, policy_version 818988 (0.0005) [2023-12-26 06:07:46,492][123090] Updated weights for policy 1, policy_version 813480 (0.0006) [2023-12-26 06:07:46,548][123090] Updated weights for policy 1, policy_version 813490 (0.0005) [2023-12-26 06:07:46,604][123090] Updated weights for policy 1, policy_version 813500 (0.0005) [2023-12-26 06:07:46,951][123091] Updated weights for policy 0, policy_version 818998 (0.0005) [2023-12-26 06:07:47,004][123091] Updated weights for policy 0, policy_version 819008 (0.0006) [2023-12-26 06:07:47,072][123091] Updated weights for policy 0, policy_version 819018 (0.0006) [2023-12-26 06:07:47,397][123090] Updated weights for policy 1, policy_version 813510 (0.0008) [2023-12-26 06:07:47,462][123090] Updated weights for policy 1, policy_version 813520 (0.0010) [2023-12-26 06:07:47,518][123090] Updated weights for policy 1, policy_version 813530 (0.0008) [2023-12-26 06:07:47,885][123091] Updated weights for policy 0, policy_version 819028 (0.0007) [2023-12-26 06:07:47,939][123091] Updated weights for policy 0, policy_version 819038 (0.0005) [2023-12-26 06:07:48,004][123091] Updated weights for policy 0, policy_version 819048 (0.0005) [2023-12-26 06:07:48,326][123090] Updated weights for policy 1, policy_version 813540 (0.0010) [2023-12-26 06:07:48,392][123090] Updated weights for policy 1, policy_version 813550 (0.0010) [2023-12-26 06:07:48,447][123090] Updated weights for policy 1, policy_version 813560 (0.0010) [2023-12-26 06:07:48,686][123091] Updated weights for policy 0, policy_version 819058 (0.0006) [2023-12-26 06:07:48,757][123091] Updated weights for policy 0, policy_version 819068 (0.0008) [2023-12-26 06:07:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 417955840. Throughput: 0: 8802.3, 1: 8967.7. Samples: 417970712. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:48,784][121949] Avg episode reward: [(0, '6120.131'), (1, '5920.103')] [2023-12-26 06:07:48,817][123091] Updated weights for policy 0, policy_version 819078 (0.0009) [2023-12-26 06:07:48,876][123091] Updated weights for policy 0, policy_version 819088 (0.0009) [2023-12-26 06:07:49,222][123090] Updated weights for policy 1, policy_version 813570 (0.0010) [2023-12-26 06:07:49,288][123090] Updated weights for policy 1, policy_version 813580 (0.0008) [2023-12-26 06:07:49,346][123090] Updated weights for policy 1, policy_version 813590 (0.0009) [2023-12-26 06:07:49,428][123090] Updated weights for policy 1, policy_version 813600 (0.0008) [2023-12-26 06:07:49,700][123091] Updated weights for policy 0, policy_version 819098 (0.0010) [2023-12-26 06:07:49,749][123091] Updated weights for policy 0, policy_version 819108 (0.0010) [2023-12-26 06:07:49,813][123091] Updated weights for policy 0, policy_version 819118 (0.0009) [2023-12-26 06:07:50,217][123090] Updated weights for policy 1, policy_version 813610 (0.0005) [2023-12-26 06:07:50,291][123090] Updated weights for policy 1, policy_version 813620 (0.0005) [2023-12-26 06:07:50,360][123090] Updated weights for policy 1, policy_version 813630 (0.0009) [2023-12-26 06:07:50,653][123091] Updated weights for policy 0, policy_version 819128 (0.0006) [2023-12-26 06:07:50,712][123091] Updated weights for policy 0, policy_version 819138 (0.0006) [2023-12-26 06:07:50,764][123091] Updated weights for policy 0, policy_version 819148 (0.0006) [2023-12-26 06:07:51,185][123090] Updated weights for policy 1, policy_version 813640 (0.0009) [2023-12-26 06:07:51,247][123090] Updated weights for policy 1, policy_version 813650 (0.0010) [2023-12-26 06:07:51,315][123090] Updated weights for policy 1, policy_version 813660 (0.0009) [2023-12-26 06:07:51,429][123091] Updated weights for policy 0, policy_version 819158 (0.0009) [2023-12-26 06:07:51,477][123091] Updated weights for policy 0, policy_version 819168 (0.0010) [2023-12-26 06:07:51,526][123091] Updated weights for policy 0, policy_version 819178 (0.0011) [2023-12-26 06:07:52,146][123090] Updated weights for policy 1, policy_version 813670 (0.0009) [2023-12-26 06:07:52,212][123090] Updated weights for policy 1, policy_version 813680 (0.0010) [2023-12-26 06:07:52,278][123090] Updated weights for policy 1, policy_version 813690 (0.0010) [2023-12-26 06:07:52,375][123091] Updated weights for policy 0, policy_version 819188 (0.0010) [2023-12-26 06:07:52,440][123091] Updated weights for policy 0, policy_version 819198 (0.0010) [2023-12-26 06:07:52,493][123091] Updated weights for policy 0, policy_version 819208 (0.0010) [2023-12-26 06:07:53,147][123090] Updated weights for policy 1, policy_version 813700 (0.0009) [2023-12-26 06:07:53,211][123090] Updated weights for policy 1, policy_version 813710 (0.0010) [2023-12-26 06:07:53,268][123090] Updated weights for policy 1, policy_version 813720 (0.0009) [2023-12-26 06:07:53,314][123091] Updated weights for policy 0, policy_version 819218 (0.0008) [2023-12-26 06:07:53,371][123091] Updated weights for policy 0, policy_version 819228 (0.0009) [2023-12-26 06:07:53,433][123091] Updated weights for policy 0, policy_version 819238 (0.0010) [2023-12-26 06:07:53,493][123091] Updated weights for policy 0, policy_version 819248 (0.0006) [2023-12-26 06:07:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 418045952. Throughput: 0: 8781.9, 1: 8953.4. Samples: 418023092. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:53,785][121949] Avg episode reward: [(0, '6012.945'), (1, '5914.595')] [2023-12-26 06:07:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000813728_208314368.pth... [2023-12-26 06:07:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000819248_209731584.pth... [2023-12-26 06:07:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000812704_208052224.pth [2023-12-26 06:07:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000818224_209469440.pth [2023-12-26 06:07:54,060][123090] Updated weights for policy 1, policy_version 813730 (0.0009) [2023-12-26 06:07:54,117][123090] Updated weights for policy 1, policy_version 813740 (0.0009) [2023-12-26 06:07:54,183][123090] Updated weights for policy 1, policy_version 813750 (0.0009) [2023-12-26 06:07:54,242][123091] Updated weights for policy 0, policy_version 819258 (0.0008) [2023-12-26 06:07:54,245][123090] Updated weights for policy 1, policy_version 813760 (0.0008) [2023-12-26 06:07:54,296][123091] Updated weights for policy 0, policy_version 819268 (0.0009) [2023-12-26 06:07:54,355][123091] Updated weights for policy 0, policy_version 819278 (0.0011) [2023-12-26 06:07:55,131][123091] Updated weights for policy 0, policy_version 819288 (0.0006) [2023-12-26 06:07:55,145][123090] Updated weights for policy 1, policy_version 813770 (0.0009) [2023-12-26 06:07:55,192][123091] Updated weights for policy 0, policy_version 819298 (0.0005) [2023-12-26 06:07:55,213][123090] Updated weights for policy 1, policy_version 813780 (0.0008) [2023-12-26 06:07:55,239][123091] Updated weights for policy 0, policy_version 819308 (0.0005) [2023-12-26 06:07:55,282][123090] Updated weights for policy 1, policy_version 813790 (0.0009) [2023-12-26 06:07:55,932][123091] Updated weights for policy 0, policy_version 819318 (0.0008) [2023-12-26 06:07:55,987][123091] Updated weights for policy 0, policy_version 819328 (0.0009) [2023-12-26 06:07:56,044][123091] Updated weights for policy 0, policy_version 819338 (0.0010) [2023-12-26 06:07:56,116][123090] Updated weights for policy 1, policy_version 813800 (0.0009) [2023-12-26 06:07:56,165][123090] Updated weights for policy 1, policy_version 813810 (0.0009) [2023-12-26 06:07:56,222][123090] Updated weights for policy 1, policy_version 813820 (0.0009) [2023-12-26 06:07:56,877][123091] Updated weights for policy 0, policy_version 819348 (0.0009) [2023-12-26 06:07:56,924][123091] Updated weights for policy 0, policy_version 819358 (0.0010) [2023-12-26 06:07:56,971][123091] Updated weights for policy 0, policy_version 819368 (0.0010) [2023-12-26 06:07:57,057][123090] Updated weights for policy 1, policy_version 813830 (0.0006) [2023-12-26 06:07:57,116][123090] Updated weights for policy 1, policy_version 813840 (0.0005) [2023-12-26 06:07:57,173][123090] Updated weights for policy 1, policy_version 813850 (0.0005) [2023-12-26 06:07:57,729][123091] Updated weights for policy 0, policy_version 819378 (0.0010) [2023-12-26 06:07:57,798][123091] Updated weights for policy 0, policy_version 819388 (0.0010) [2023-12-26 06:07:57,861][123091] Updated weights for policy 0, policy_version 819398 (0.0010) [2023-12-26 06:07:57,929][123091] Updated weights for policy 0, policy_version 819408 (0.0008) [2023-12-26 06:07:57,930][123090] Updated weights for policy 1, policy_version 813860 (0.0007) [2023-12-26 06:07:57,988][123090] Updated weights for policy 1, policy_version 813870 (0.0009) [2023-12-26 06:07:58,059][123090] Updated weights for policy 1, policy_version 813880 (0.0010) [2023-12-26 06:07:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 418127872. Throughput: 0: 8866.8, 1: 8926.6. Samples: 418128044. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:07:58,785][121949] Avg episode reward: [(0, '5921.713'), (1, '5965.318')] [2023-12-26 06:07:58,804][123091] Updated weights for policy 0, policy_version 819418 (0.0009) [2023-12-26 06:07:58,873][123091] Updated weights for policy 0, policy_version 819428 (0.0007) [2023-12-26 06:07:58,940][123091] Updated weights for policy 0, policy_version 819438 (0.0009) [2023-12-26 06:07:59,019][123090] Updated weights for policy 1, policy_version 813890 (0.0009) [2023-12-26 06:07:59,091][123090] Updated weights for policy 1, policy_version 813900 (0.0008) [2023-12-26 06:07:59,155][123090] Updated weights for policy 1, policy_version 813910 (0.0010) [2023-12-26 06:07:59,228][123090] Updated weights for policy 1, policy_version 813920 (0.0009) [2023-12-26 06:07:59,789][123091] Updated weights for policy 0, policy_version 819448 (0.0010) [2023-12-26 06:07:59,858][123091] Updated weights for policy 0, policy_version 819458 (0.0010) [2023-12-26 06:07:59,921][123091] Updated weights for policy 0, policy_version 819468 (0.0010) [2023-12-26 06:08:00,029][123090] Updated weights for policy 1, policy_version 813930 (0.0006) [2023-12-26 06:08:00,082][123090] Updated weights for policy 1, policy_version 813940 (0.0007) [2023-12-26 06:08:00,139][123090] Updated weights for policy 1, policy_version 813950 (0.0009) [2023-12-26 06:08:00,628][123091] Updated weights for policy 0, policy_version 819478 (0.0007) [2023-12-26 06:08:00,681][123091] Updated weights for policy 0, policy_version 819488 (0.0005) [2023-12-26 06:08:00,741][123091] Updated weights for policy 0, policy_version 819498 (0.0005) [2023-12-26 06:08:00,949][123090] Updated weights for policy 1, policy_version 813960 (0.0006) [2023-12-26 06:08:01,012][123090] Updated weights for policy 1, policy_version 813970 (0.0005) [2023-12-26 06:08:01,085][123090] Updated weights for policy 1, policy_version 813980 (0.0010) [2023-12-26 06:08:01,522][123091] Updated weights for policy 0, policy_version 819508 (0.0007) [2023-12-26 06:08:01,575][123091] Updated weights for policy 0, policy_version 819518 (0.0010) [2023-12-26 06:08:01,641][123091] Updated weights for policy 0, policy_version 819528 (0.0009) [2023-12-26 06:08:01,821][123090] Updated weights for policy 1, policy_version 813990 (0.0009) [2023-12-26 06:08:01,884][123090] Updated weights for policy 1, policy_version 814000 (0.0006) [2023-12-26 06:08:01,948][123090] Updated weights for policy 1, policy_version 814010 (0.0007) [2023-12-26 06:08:02,475][123091] Updated weights for policy 0, policy_version 819538 (0.0011) [2023-12-26 06:08:02,538][123091] Updated weights for policy 0, policy_version 819548 (0.0006) [2023-12-26 06:08:02,586][123090] Updated weights for policy 1, policy_version 814020 (0.0006) [2023-12-26 06:08:02,598][123091] Updated weights for policy 0, policy_version 819558 (0.0006) [2023-12-26 06:08:02,652][123091] Updated weights for policy 0, policy_version 819568 (0.0007) [2023-12-26 06:08:02,658][123090] Updated weights for policy 1, policy_version 814030 (0.0005) [2023-12-26 06:08:02,731][123090] Updated weights for policy 1, policy_version 814040 (0.0009) [2023-12-26 06:08:03,298][123091] Updated weights for policy 0, policy_version 819578 (0.0005) [2023-12-26 06:08:03,347][123091] Updated weights for policy 0, policy_version 819588 (0.0006) [2023-12-26 06:08:03,410][123091] Updated weights for policy 0, policy_version 819598 (0.0005) [2023-12-26 06:08:03,473][123090] Updated weights for policy 1, policy_version 814050 (0.0008) [2023-12-26 06:08:03,543][123090] Updated weights for policy 1, policy_version 814060 (0.0009) [2023-12-26 06:08:03,612][123090] Updated weights for policy 1, policy_version 814071 (0.0010) [2023-12-26 06:08:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 418226176. Throughput: 0: 8806.0, 1: 8800.3. Samples: 418235392. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:03,785][121949] Avg episode reward: [(0, '6057.444'), (1, '5967.831')] [2023-12-26 06:08:03,995][123091] Updated weights for policy 0, policy_version 819608 (0.0009) [2023-12-26 06:08:04,057][123091] Updated weights for policy 0, policy_version 819618 (0.0010) [2023-12-26 06:08:04,117][123091] Updated weights for policy 0, policy_version 819628 (0.0010) [2023-12-26 06:08:04,424][123090] Updated weights for policy 1, policy_version 814081 (0.0010) [2023-12-26 06:08:04,496][123090] Updated weights for policy 1, policy_version 814091 (0.0009) [2023-12-26 06:08:04,566][123090] Updated weights for policy 1, policy_version 814101 (0.0010) [2023-12-26 06:08:04,635][123090] Updated weights for policy 1, policy_version 814111 (0.0009) [2023-12-26 06:08:05,017][123091] Updated weights for policy 0, policy_version 819638 (0.0010) [2023-12-26 06:08:05,093][123091] Updated weights for policy 0, policy_version 819648 (0.0011) [2023-12-26 06:08:05,164][123091] Updated weights for policy 0, policy_version 819658 (0.0010) [2023-12-26 06:08:05,415][123090] Updated weights for policy 1, policy_version 814121 (0.0010) [2023-12-26 06:08:05,483][123090] Updated weights for policy 1, policy_version 814131 (0.0009) [2023-12-26 06:08:05,544][123090] Updated weights for policy 1, policy_version 814141 (0.0010) [2023-12-26 06:08:05,951][123091] Updated weights for policy 0, policy_version 819668 (0.0010) [2023-12-26 06:08:06,011][123091] Updated weights for policy 0, policy_version 819678 (0.0011) [2023-12-26 06:08:06,066][123091] Updated weights for policy 0, policy_version 819688 (0.0006) [2023-12-26 06:08:06,390][123090] Updated weights for policy 1, policy_version 814151 (0.0009) [2023-12-26 06:08:06,454][123090] Updated weights for policy 1, policy_version 814161 (0.0009) [2023-12-26 06:08:06,508][123090] Updated weights for policy 1, policy_version 814171 (0.0010) [2023-12-26 06:08:06,765][123091] Updated weights for policy 0, policy_version 819698 (0.0006) [2023-12-26 06:08:06,833][123091] Updated weights for policy 0, policy_version 819708 (0.0005) [2023-12-26 06:08:06,905][123091] Updated weights for policy 0, policy_version 819718 (0.0006) [2023-12-26 06:08:06,972][123091] Updated weights for policy 0, policy_version 819728 (0.0005) [2023-12-26 06:08:07,396][123090] Updated weights for policy 1, policy_version 814181 (0.0010) [2023-12-26 06:08:07,463][123090] Updated weights for policy 1, policy_version 814191 (0.0010) [2023-12-26 06:08:07,538][123090] Updated weights for policy 1, policy_version 814201 (0.0009) [2023-12-26 06:08:07,564][123091] Updated weights for policy 0, policy_version 819738 (0.0005) [2023-12-26 06:08:07,627][123091] Updated weights for policy 0, policy_version 819748 (0.0007) [2023-12-26 06:08:07,687][123091] Updated weights for policy 0, policy_version 819758 (0.0011) [2023-12-26 06:08:08,200][123090] Updated weights for policy 1, policy_version 814211 (0.0008) [2023-12-26 06:08:08,269][123090] Updated weights for policy 1, policy_version 814221 (0.0007) [2023-12-26 06:08:08,337][123090] Updated weights for policy 1, policy_version 814231 (0.0008) [2023-12-26 06:08:08,354][123091] Updated weights for policy 0, policy_version 819768 (0.0008) [2023-12-26 06:08:08,415][123091] Updated weights for policy 0, policy_version 819778 (0.0008) [2023-12-26 06:08:08,470][123091] Updated weights for policy 0, policy_version 819788 (0.0008) [2023-12-26 06:08:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 418316288. Throughput: 0: 8817.1, 1: 8796.3. Samples: 418287316. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:08,785][121949] Avg episode reward: [(0, '6055.297'), (1, '5851.133')] [2023-12-26 06:08:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000819792_209870848.pth... [2023-12-26 06:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000814240_208445440.pth... [2023-12-26 06:08:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000818736_209600512.pth [2023-12-26 06:08:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000813216_208183296.pth [2023-12-26 06:08:09,017][123090] Updated weights for policy 1, policy_version 814241 (0.0007) [2023-12-26 06:08:09,088][123090] Updated weights for policy 1, policy_version 814251 (0.0005) [2023-12-26 06:08:09,155][123090] Updated weights for policy 1, policy_version 814261 (0.0005) [2023-12-26 06:08:09,221][123090] Updated weights for policy 1, policy_version 814271 (0.0005) [2023-12-26 06:08:09,248][123091] Updated weights for policy 0, policy_version 819798 (0.0008) [2023-12-26 06:08:09,318][123091] Updated weights for policy 0, policy_version 819808 (0.0006) [2023-12-26 06:08:09,385][123091] Updated weights for policy 0, policy_version 819818 (0.0007) [2023-12-26 06:08:10,021][123090] Updated weights for policy 1, policy_version 814281 (0.0006) [2023-12-26 06:08:10,085][123090] Updated weights for policy 1, policy_version 814291 (0.0005) [2023-12-26 06:08:10,154][123090] Updated weights for policy 1, policy_version 814302 (0.0008) [2023-12-26 06:08:10,184][123091] Updated weights for policy 0, policy_version 819828 (0.0009) [2023-12-26 06:08:10,237][123091] Updated weights for policy 0, policy_version 819838 (0.0008) [2023-12-26 06:08:10,307][123091] Updated weights for policy 0, policy_version 819848 (0.0006) [2023-12-26 06:08:10,916][123090] Updated weights for policy 1, policy_version 814312 (0.0010) [2023-12-26 06:08:10,970][123090] Updated weights for policy 1, policy_version 814322 (0.0010) [2023-12-26 06:08:11,019][123091] Updated weights for policy 0, policy_version 819858 (0.0009) [2023-12-26 06:08:11,051][123090] Updated weights for policy 1, policy_version 814332 (0.0009) [2023-12-26 06:08:11,082][123091] Updated weights for policy 0, policy_version 819868 (0.0007) [2023-12-26 06:08:11,152][123091] Updated weights for policy 0, policy_version 819878 (0.0007) [2023-12-26 06:08:11,224][123091] Updated weights for policy 0, policy_version 819888 (0.0007) [2023-12-26 06:08:11,974][123090] Updated weights for policy 1, policy_version 814342 (0.0008) [2023-12-26 06:08:12,007][123091] Updated weights for policy 0, policy_version 819898 (0.0006) [2023-12-26 06:08:12,040][123090] Updated weights for policy 1, policy_version 814352 (0.0007) [2023-12-26 06:08:12,076][123091] Updated weights for policy 0, policy_version 819908 (0.0008) [2023-12-26 06:08:12,105][123090] Updated weights for policy 1, policy_version 814362 (0.0006) [2023-12-26 06:08:12,149][123091] Updated weights for policy 0, policy_version 819918 (0.0008) [2023-12-26 06:08:12,849][123091] Updated weights for policy 0, policy_version 819928 (0.0006) [2023-12-26 06:08:12,895][123091] Updated weights for policy 0, policy_version 819938 (0.0005) [2023-12-26 06:08:12,947][123091] Updated weights for policy 0, policy_version 819948 (0.0006) [2023-12-26 06:08:12,996][123090] Updated weights for policy 1, policy_version 814372 (0.0007) [2023-12-26 06:08:13,069][123090] Updated weights for policy 1, policy_version 814382 (0.0006) [2023-12-26 06:08:13,143][123090] Updated weights for policy 1, policy_version 814392 (0.0008) [2023-12-26 06:08:13,666][123091] Updated weights for policy 0, policy_version 819958 (0.0007) [2023-12-26 06:08:13,733][123091] Updated weights for policy 0, policy_version 819968 (0.0006) [2023-12-26 06:08:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 418398208. Throughput: 0: 8926.3, 1: 8745.2. Samples: 418397244. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:13,784][121949] Avg episode reward: [(0, '6086.834'), (1, '5801.103')] [2023-12-26 06:08:13,792][123091] Updated weights for policy 0, policy_version 819978 (0.0007) [2023-12-26 06:08:13,859][123090] Updated weights for policy 1, policy_version 814403 (0.0009) [2023-12-26 06:08:13,915][123090] Updated weights for policy 1, policy_version 814413 (0.0010) [2023-12-26 06:08:13,977][123090] Updated weights for policy 1, policy_version 814423 (0.0010) [2023-12-26 06:08:14,449][123091] Updated weights for policy 0, policy_version 819988 (0.0006) [2023-12-26 06:08:14,519][123091] Updated weights for policy 0, policy_version 819998 (0.0008) [2023-12-26 06:08:14,584][123091] Updated weights for policy 0, policy_version 820008 (0.0009) [2023-12-26 06:08:14,864][123090] Updated weights for policy 1, policy_version 814433 (0.0010) [2023-12-26 06:08:14,921][123090] Updated weights for policy 1, policy_version 814443 (0.0010) [2023-12-26 06:08:14,996][123090] Updated weights for policy 1, policy_version 814453 (0.0010) [2023-12-26 06:08:15,075][123090] Updated weights for policy 1, policy_version 814463 (0.0010) [2023-12-26 06:08:15,285][123091] Updated weights for policy 0, policy_version 820018 (0.0008) [2023-12-26 06:08:15,345][123091] Updated weights for policy 0, policy_version 820028 (0.0006) [2023-12-26 06:08:15,403][123091] Updated weights for policy 0, policy_version 820038 (0.0005) [2023-12-26 06:08:15,469][123091] Updated weights for policy 0, policy_version 820048 (0.0006) [2023-12-26 06:08:15,898][123090] Updated weights for policy 1, policy_version 814473 (0.0006) [2023-12-26 06:08:15,944][123090] Updated weights for policy 1, policy_version 814483 (0.0005) [2023-12-26 06:08:15,992][123090] Updated weights for policy 1, policy_version 814493 (0.0005) [2023-12-26 06:08:16,070][123091] Updated weights for policy 0, policy_version 820058 (0.0007) [2023-12-26 06:08:16,130][123091] Updated weights for policy 0, policy_version 820068 (0.0010) [2023-12-26 06:08:16,190][123091] Updated weights for policy 0, policy_version 820078 (0.0010) [2023-12-26 06:08:16,554][123090] Updated weights for policy 1, policy_version 814503 (0.0005) [2023-12-26 06:08:16,602][123090] Updated weights for policy 1, policy_version 814513 (0.0005) [2023-12-26 06:08:16,648][123090] Updated weights for policy 1, policy_version 814523 (0.0005) [2023-12-26 06:08:16,879][123091] Updated weights for policy 0, policy_version 820088 (0.0006) [2023-12-26 06:08:16,931][123091] Updated weights for policy 0, policy_version 820098 (0.0005) [2023-12-26 06:08:16,994][123091] Updated weights for policy 0, policy_version 820108 (0.0006) [2023-12-26 06:08:17,383][123090] Updated weights for policy 1, policy_version 814533 (0.0005) [2023-12-26 06:08:17,446][123090] Updated weights for policy 1, policy_version 814543 (0.0005) [2023-12-26 06:08:17,509][123090] Updated weights for policy 1, policy_version 814553 (0.0005) [2023-12-26 06:08:17,623][123091] Updated weights for policy 0, policy_version 820118 (0.0007) [2023-12-26 06:08:17,674][123091] Updated weights for policy 0, policy_version 820128 (0.0009) [2023-12-26 06:08:17,736][123091] Updated weights for policy 0, policy_version 820138 (0.0005) [2023-12-26 06:08:18,198][123090] Updated weights for policy 1, policy_version 814563 (0.0005) [2023-12-26 06:08:18,249][123090] Updated weights for policy 1, policy_version 814573 (0.0006) [2023-12-26 06:08:18,299][123090] Updated weights for policy 1, policy_version 814583 (0.0007) [2023-12-26 06:08:18,410][123091] Updated weights for policy 0, policy_version 820148 (0.0007) [2023-12-26 06:08:18,470][123091] Updated weights for policy 0, policy_version 820158 (0.0011) [2023-12-26 06:08:18,533][123091] Updated weights for policy 0, policy_version 820168 (0.0011) [2023-12-26 06:08:18,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17828.1). Total num frames: 418504704. Throughput: 0: 9101.5, 1: 8777.3. Samples: 418512148. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:18,784][121949] Avg episode reward: [(0, '6124.600'), (1, '5917.228')] [2023-12-26 06:08:19,091][123090] Updated weights for policy 1, policy_version 814593 (0.0007) [2023-12-26 06:08:19,147][123090] Updated weights for policy 1, policy_version 814603 (0.0005) [2023-12-26 06:08:19,200][123090] Updated weights for policy 1, policy_version 814613 (0.0005) [2023-12-26 06:08:19,269][123090] Updated weights for policy 1, policy_version 814623 (0.0008) [2023-12-26 06:08:19,374][123091] Updated weights for policy 0, policy_version 820178 (0.0010) [2023-12-26 06:08:19,444][123091] Updated weights for policy 0, policy_version 820188 (0.0008) [2023-12-26 06:08:19,526][123091] Updated weights for policy 0, policy_version 820198 (0.0008) [2023-12-26 06:08:19,591][123091] Updated weights for policy 0, policy_version 820208 (0.0008) [2023-12-26 06:08:20,127][123090] Updated weights for policy 1, policy_version 814633 (0.0008) [2023-12-26 06:08:20,194][123090] Updated weights for policy 1, policy_version 814643 (0.0008) [2023-12-26 06:08:20,268][123090] Updated weights for policy 1, policy_version 814653 (0.0008) [2023-12-26 06:08:20,357][123091] Updated weights for policy 0, policy_version 820218 (0.0008) [2023-12-26 06:08:20,405][123091] Updated weights for policy 0, policy_version 820228 (0.0008) [2023-12-26 06:08:20,453][123091] Updated weights for policy 0, policy_version 820238 (0.0008) [2023-12-26 06:08:21,101][123090] Updated weights for policy 1, policy_version 814663 (0.0009) [2023-12-26 06:08:21,170][123090] Updated weights for policy 1, policy_version 814673 (0.0009) [2023-12-26 06:08:21,224][123090] Updated weights for policy 1, policy_version 814683 (0.0009) [2023-12-26 06:08:21,324][123091] Updated weights for policy 0, policy_version 820248 (0.0010) [2023-12-26 06:08:21,392][123091] Updated weights for policy 0, policy_version 820258 (0.0012) [2023-12-26 06:08:21,459][123091] Updated weights for policy 0, policy_version 820268 (0.0011) [2023-12-26 06:08:22,121][123090] Updated weights for policy 1, policy_version 814693 (0.0009) [2023-12-26 06:08:22,175][123090] Updated weights for policy 1, policy_version 814703 (0.0009) [2023-12-26 06:08:22,240][123090] Updated weights for policy 1, policy_version 814713 (0.0010) [2023-12-26 06:08:22,315][123091] Updated weights for policy 0, policy_version 820278 (0.0011) [2023-12-26 06:08:22,386][123091] Updated weights for policy 0, policy_version 820288 (0.0009) [2023-12-26 06:08:22,449][123091] Updated weights for policy 0, policy_version 820298 (0.0010) [2023-12-26 06:08:23,118][123090] Updated weights for policy 1, policy_version 814723 (0.0008) [2023-12-26 06:08:23,180][123090] Updated weights for policy 1, policy_version 814733 (0.0009) [2023-12-26 06:08:23,237][123090] Updated weights for policy 1, policy_version 814743 (0.0009) [2023-12-26 06:08:23,270][123091] Updated weights for policy 0, policy_version 820308 (0.0011) [2023-12-26 06:08:23,321][123091] Updated weights for policy 0, policy_version 820318 (0.0010) [2023-12-26 06:08:23,381][123091] Updated weights for policy 0, policy_version 820328 (0.0011) [2023-12-26 06:08:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 418586624. Throughput: 0: 9120.3, 1: 8783.8. Samples: 418562972. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:23,785][121949] Avg episode reward: [(0, '6204.744'), (1, '5603.656')] [2023-12-26 06:08:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000814752_208576512.pth... [2023-12-26 06:08:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000820336_210010112.pth... [2023-12-26 06:08:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000813728_208314368.pth [2023-12-26 06:08:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000819248_209731584.pth [2023-12-26 06:08:24,015][123090] Updated weights for policy 1, policy_version 814753 (0.0009) [2023-12-26 06:08:24,080][123090] Updated weights for policy 1, policy_version 814763 (0.0009) [2023-12-26 06:08:24,149][123090] Updated weights for policy 1, policy_version 814773 (0.0009) [2023-12-26 06:08:24,214][123090] Updated weights for policy 1, policy_version 814783 (0.0009) [2023-12-26 06:08:24,221][123091] Updated weights for policy 0, policy_version 820338 (0.0011) [2023-12-26 06:08:24,284][123091] Updated weights for policy 0, policy_version 820348 (0.0010) [2023-12-26 06:08:24,350][123091] Updated weights for policy 0, policy_version 820358 (0.0011) [2023-12-26 06:08:24,416][123091] Updated weights for policy 0, policy_version 820368 (0.0011) [2023-12-26 06:08:25,039][123090] Updated weights for policy 1, policy_version 814793 (0.0009) [2023-12-26 06:08:25,095][123090] Updated weights for policy 1, policy_version 814803 (0.0008) [2023-12-26 06:08:25,151][123090] Updated weights for policy 1, policy_version 814813 (0.0009) [2023-12-26 06:08:25,222][123091] Updated weights for policy 0, policy_version 820378 (0.0010) [2023-12-26 06:08:25,283][123091] Updated weights for policy 0, policy_version 820388 (0.0010) [2023-12-26 06:08:25,354][123091] Updated weights for policy 0, policy_version 820398 (0.0011) [2023-12-26 06:08:25,976][123090] Updated weights for policy 1, policy_version 814823 (0.0008) [2023-12-26 06:08:26,031][123090] Updated weights for policy 1, policy_version 814833 (0.0009) [2023-12-26 06:08:26,082][123090] Updated weights for policy 1, policy_version 814843 (0.0009) [2023-12-26 06:08:26,116][123091] Updated weights for policy 0, policy_version 820408 (0.0010) [2023-12-26 06:08:26,174][123091] Updated weights for policy 0, policy_version 820418 (0.0010) [2023-12-26 06:08:26,243][123091] Updated weights for policy 0, policy_version 820428 (0.0010) [2023-12-26 06:08:26,938][123090] Updated weights for policy 1, policy_version 814853 (0.0009) [2023-12-26 06:08:26,998][123090] Updated weights for policy 1, policy_version 814863 (0.0009) [2023-12-26 06:08:27,048][123090] Updated weights for policy 1, policy_version 814873 (0.0009) [2023-12-26 06:08:27,055][123091] Updated weights for policy 0, policy_version 820438 (0.0011) [2023-12-26 06:08:27,099][123091] Updated weights for policy 0, policy_version 820448 (0.0010) [2023-12-26 06:08:27,154][123091] Updated weights for policy 0, policy_version 820458 (0.0009) [2023-12-26 06:08:27,880][123090] Updated weights for policy 1, policy_version 814883 (0.0008) [2023-12-26 06:08:27,936][123090] Updated weights for policy 1, policy_version 814893 (0.0009) [2023-12-26 06:08:27,961][123091] Updated weights for policy 0, policy_version 820468 (0.0005) [2023-12-26 06:08:27,993][123090] Updated weights for policy 1, policy_version 814903 (0.0009) [2023-12-26 06:08:28,021][123091] Updated weights for policy 0, policy_version 820478 (0.0006) [2023-12-26 06:08:28,081][123091] Updated weights for policy 0, policy_version 820488 (0.0005) [2023-12-26 06:08:28,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 418668544. Throughput: 0: 9156.1, 1: 8761.6. Samples: 418666468. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:28,785][121949] Avg episode reward: [(0, '6231.952'), (1, '5145.153')] [2023-12-26 06:08:28,792][123091] Updated weights for policy 0, policy_version 820498 (0.0005) [2023-12-26 06:08:28,853][123091] Updated weights for policy 0, policy_version 820508 (0.0006) [2023-12-26 06:08:28,886][123090] Updated weights for policy 1, policy_version 814913 (0.0010) [2023-12-26 06:08:28,914][123091] Updated weights for policy 0, policy_version 820518 (0.0007) [2023-12-26 06:08:28,946][123090] Updated weights for policy 1, policy_version 814923 (0.0008) [2023-12-26 06:08:28,977][123091] Updated weights for policy 0, policy_version 820528 (0.0008) [2023-12-26 06:08:28,999][123090] Updated weights for policy 1, policy_version 814933 (0.0008) [2023-12-26 06:08:29,054][123090] Updated weights for policy 1, policy_version 814943 (0.0009) [2023-12-26 06:08:29,723][123091] Updated weights for policy 0, policy_version 820538 (0.0005) [2023-12-26 06:08:29,785][123091] Updated weights for policy 0, policy_version 820548 (0.0006) [2023-12-26 06:08:29,855][123091] Updated weights for policy 0, policy_version 820558 (0.0007) [2023-12-26 06:08:29,987][123090] Updated weights for policy 1, policy_version 814953 (0.0009) [2023-12-26 06:08:30,057][123090] Updated weights for policy 1, policy_version 814963 (0.0010) [2023-12-26 06:08:30,128][123090] Updated weights for policy 1, policy_version 814973 (0.0010) [2023-12-26 06:08:30,501][123091] Updated weights for policy 0, policy_version 820568 (0.0009) [2023-12-26 06:08:30,562][123091] Updated weights for policy 0, policy_version 820578 (0.0009) [2023-12-26 06:08:30,617][123091] Updated weights for policy 0, policy_version 820588 (0.0009) [2023-12-26 06:08:30,979][123090] Updated weights for policy 1, policy_version 814983 (0.0010) [2023-12-26 06:08:31,036][123090] Updated weights for policy 1, policy_version 814993 (0.0009) [2023-12-26 06:08:31,108][123090] Updated weights for policy 1, policy_version 815003 (0.0009) [2023-12-26 06:08:31,427][123091] Updated weights for policy 0, policy_version 820598 (0.0009) [2023-12-26 06:08:31,477][123091] Updated weights for policy 0, policy_version 820608 (0.0009) [2023-12-26 06:08:31,535][123091] Updated weights for policy 0, policy_version 820618 (0.0009) [2023-12-26 06:08:31,962][123090] Updated weights for policy 1, policy_version 815013 (0.0009) [2023-12-26 06:08:32,022][123090] Updated weights for policy 1, policy_version 815023 (0.0009) [2023-12-26 06:08:32,086][123090] Updated weights for policy 1, policy_version 815033 (0.0009) [2023-12-26 06:08:32,309][123091] Updated weights for policy 0, policy_version 820628 (0.0009) [2023-12-26 06:08:32,381][123091] Updated weights for policy 0, policy_version 820638 (0.0006) [2023-12-26 06:08:32,438][123091] Updated weights for policy 0, policy_version 820648 (0.0006) [2023-12-26 06:08:32,982][123090] Updated weights for policy 1, policy_version 815043 (0.0010) [2023-12-26 06:08:33,042][123090] Updated weights for policy 1, policy_version 815053 (0.0009) [2023-12-26 06:08:33,097][123090] Updated weights for policy 1, policy_version 815063 (0.0009) [2023-12-26 06:08:33,123][123091] Updated weights for policy 0, policy_version 820658 (0.0006) [2023-12-26 06:08:33,177][123091] Updated weights for policy 0, policy_version 820668 (0.0009) [2023-12-26 06:08:33,239][123091] Updated weights for policy 0, policy_version 820678 (0.0008) [2023-12-26 06:08:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 418758656. Throughput: 0: 9208.4, 1: 8609.0. Samples: 418772500. Policy #0 lag: (min: 31.0, avg: 39.2, max: 63.0) [2023-12-26 06:08:33,785][121949] Avg episode reward: [(0, '6218.669'), (1, '5196.381')] [2023-12-26 06:08:33,928][123090] Updated weights for policy 1, policy_version 815073 (0.0008) [2023-12-26 06:08:33,985][123090] Updated weights for policy 1, policy_version 815083 (0.0010) [2023-12-26 06:08:34,047][123090] Updated weights for policy 1, policy_version 815093 (0.0009) [2023-12-26 06:08:34,057][123091] Updated weights for policy 0, policy_version 820689 (0.0009) [2023-12-26 06:08:34,102][123090] Updated weights for policy 1, policy_version 815103 (0.0009) [2023-12-26 06:08:34,124][123091] Updated weights for policy 0, policy_version 820699 (0.0008) [2023-12-26 06:08:34,186][123091] Updated weights for policy 0, policy_version 820709 (0.0009) [2023-12-26 06:08:34,254][123091] Updated weights for policy 0, policy_version 820719 (0.0010) [2023-12-26 06:08:34,922][123090] Updated weights for policy 1, policy_version 815113 (0.0009) [2023-12-26 06:08:34,979][123090] Updated weights for policy 1, policy_version 815123 (0.0009) [2023-12-26 06:08:35,036][123090] Updated weights for policy 1, policy_version 815133 (0.0010) [2023-12-26 06:08:35,057][123091] Updated weights for policy 0, policy_version 820729 (0.0008) [2023-12-26 06:08:35,120][123091] Updated weights for policy 0, policy_version 820739 (0.0009) [2023-12-26 06:08:35,182][123091] Updated weights for policy 0, policy_version 820749 (0.0009) [2023-12-26 06:08:35,864][123090] Updated weights for policy 1, policy_version 815143 (0.0007) [2023-12-26 06:08:35,928][123090] Updated weights for policy 1, policy_version 815153 (0.0005) [2023-12-26 06:08:35,995][123090] Updated weights for policy 1, policy_version 815163 (0.0006) [2023-12-26 06:08:36,022][123091] Updated weights for policy 0, policy_version 820759 (0.0008) [2023-12-26 06:08:36,077][123091] Updated weights for policy 0, policy_version 820769 (0.0008) [2023-12-26 06:08:36,145][123091] Updated weights for policy 0, policy_version 820779 (0.0010) [2023-12-26 06:08:36,682][123090] Updated weights for policy 1, policy_version 815173 (0.0008) [2023-12-26 06:08:36,752][123090] Updated weights for policy 1, policy_version 815183 (0.0008) [2023-12-26 06:08:36,820][123090] Updated weights for policy 1, policy_version 815193 (0.0008) [2023-12-26 06:08:37,008][123091] Updated weights for policy 0, policy_version 820789 (0.0010) [2023-12-26 06:08:37,067][123091] Updated weights for policy 0, policy_version 820799 (0.0011) [2023-12-26 06:08:37,131][123091] Updated weights for policy 0, policy_version 820809 (0.0011) [2023-12-26 06:08:37,548][123090] Updated weights for policy 1, policy_version 815203 (0.0007) [2023-12-26 06:08:37,600][123090] Updated weights for policy 1, policy_version 815213 (0.0011) [2023-12-26 06:08:37,652][123090] Updated weights for policy 1, policy_version 815223 (0.0010) [2023-12-26 06:08:37,942][123091] Updated weights for policy 0, policy_version 820819 (0.0011) [2023-12-26 06:08:37,991][123091] Updated weights for policy 0, policy_version 820829 (0.0011) [2023-12-26 06:08:38,041][123091] Updated weights for policy 0, policy_version 820839 (0.0006) [2023-12-26 06:08:38,456][123090] Updated weights for policy 1, policy_version 815233 (0.0011) [2023-12-26 06:08:38,518][123090] Updated weights for policy 1, policy_version 815243 (0.0010) [2023-12-26 06:08:38,584][123090] Updated weights for policy 1, policy_version 815253 (0.0009) [2023-12-26 06:08:38,645][123090] Updated weights for policy 1, policy_version 815263 (0.0009) [2023-12-26 06:08:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 418848768. Throughput: 0: 9178.6, 1: 8622.7. Samples: 418824148. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:08:38,785][121949] Avg episode reward: [(0, '6205.372'), (1, '5518.764')] [2023-12-26 06:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000815264_208707584.pth... [2023-12-26 06:08:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000820848_210141184.pth... [2023-12-26 06:08:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000819792_209870848.pth [2023-12-26 06:08:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000814240_208445440.pth [2023-12-26 06:08:38,876][123091] Updated weights for policy 0, policy_version 820849 (0.0006) [2023-12-26 06:08:38,936][123091] Updated weights for policy 0, policy_version 820859 (0.0011) [2023-12-26 06:08:39,002][123091] Updated weights for policy 0, policy_version 820869 (0.0011) [2023-12-26 06:08:39,054][123091] Updated weights for policy 0, policy_version 820879 (0.0011) [2023-12-26 06:08:39,496][123090] Updated weights for policy 1, policy_version 815273 (0.0011) [2023-12-26 06:08:39,553][123090] Updated weights for policy 1, policy_version 815283 (0.0010) [2023-12-26 06:08:39,616][123090] Updated weights for policy 1, policy_version 815293 (0.0009) [2023-12-26 06:08:39,852][123091] Updated weights for policy 0, policy_version 820889 (0.0011) [2023-12-26 06:08:39,916][123091] Updated weights for policy 0, policy_version 820899 (0.0011) [2023-12-26 06:08:39,988][123091] Updated weights for policy 0, policy_version 820909 (0.0011) [2023-12-26 06:08:40,467][123090] Updated weights for policy 1, policy_version 815303 (0.0010) [2023-12-26 06:08:40,530][123090] Updated weights for policy 1, policy_version 815313 (0.0010) [2023-12-26 06:08:40,603][123090] Updated weights for policy 1, policy_version 815323 (0.0010) [2023-12-26 06:08:40,800][123091] Updated weights for policy 0, policy_version 820919 (0.0010) [2023-12-26 06:08:40,848][123091] Updated weights for policy 0, policy_version 820929 (0.0010) [2023-12-26 06:08:40,896][123091] Updated weights for policy 0, policy_version 820939 (0.0010) [2023-12-26 06:08:41,440][123090] Updated weights for policy 1, policy_version 815333 (0.0010) [2023-12-26 06:08:41,512][123090] Updated weights for policy 1, policy_version 815343 (0.0011) [2023-12-26 06:08:41,595][123090] Updated weights for policy 1, policy_version 815353 (0.0011) [2023-12-26 06:08:41,752][123091] Updated weights for policy 0, policy_version 820949 (0.0010) [2023-12-26 06:08:41,815][123091] Updated weights for policy 0, policy_version 820959 (0.0011) [2023-12-26 06:08:41,863][123091] Updated weights for policy 0, policy_version 820969 (0.0010) [2023-12-26 06:08:42,374][123090] Updated weights for policy 1, policy_version 815363 (0.0009) [2023-12-26 06:08:42,444][123090] Updated weights for policy 1, policy_version 815373 (0.0011) [2023-12-26 06:08:42,504][123090] Updated weights for policy 1, policy_version 815383 (0.0010) [2023-12-26 06:08:42,637][123091] Updated weights for policy 0, policy_version 820979 (0.0006) [2023-12-26 06:08:42,687][123091] Updated weights for policy 0, policy_version 820989 (0.0007) [2023-12-26 06:08:42,739][123091] Updated weights for policy 0, policy_version 820999 (0.0010) [2023-12-26 06:08:43,358][123090] Updated weights for policy 1, policy_version 815393 (0.0010) [2023-12-26 06:08:43,419][123090] Updated weights for policy 1, policy_version 815403 (0.0009) [2023-12-26 06:08:43,484][123090] Updated weights for policy 1, policy_version 815413 (0.0009) [2023-12-26 06:08:43,518][123091] Updated weights for policy 0, policy_version 821009 (0.0010) [2023-12-26 06:08:43,546][123090] Updated weights for policy 1, policy_version 815423 (0.0007) [2023-12-26 06:08:43,570][123091] Updated weights for policy 0, policy_version 821019 (0.0010) [2023-12-26 06:08:43,613][123091] Updated weights for policy 0, policy_version 821029 (0.0010) [2023-12-26 06:08:43,661][123091] Updated weights for policy 0, policy_version 821039 (0.0010) [2023-12-26 06:08:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 418938880. Throughput: 0: 9136.2, 1: 8653.3. Samples: 418928568. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:08:43,785][121949] Avg episode reward: [(0, '6190.359'), (1, '5835.617')] [2023-12-26 06:08:44,269][123090] Updated weights for policy 1, policy_version 815433 (0.0006) [2023-12-26 06:08:44,329][123090] Updated weights for policy 1, policy_version 815443 (0.0006) [2023-12-26 06:08:44,382][123090] Updated weights for policy 1, policy_version 815453 (0.0005) [2023-12-26 06:08:44,406][123091] Updated weights for policy 0, policy_version 821049 (0.0007) [2023-12-26 06:08:44,475][123091] Updated weights for policy 0, policy_version 821059 (0.0006) [2023-12-26 06:08:44,531][123091] Updated weights for policy 0, policy_version 821069 (0.0005) [2023-12-26 06:08:45,118][123090] Updated weights for policy 1, policy_version 815463 (0.0006) [2023-12-26 06:08:45,182][123090] Updated weights for policy 1, policy_version 815473 (0.0007) [2023-12-26 06:08:45,214][123091] Updated weights for policy 0, policy_version 821079 (0.0009) [2023-12-26 06:08:45,239][123090] Updated weights for policy 1, policy_version 815483 (0.0011) [2023-12-26 06:08:45,278][123091] Updated weights for policy 0, policy_version 821089 (0.0009) [2023-12-26 06:08:45,346][123091] Updated weights for policy 0, policy_version 821099 (0.0008) [2023-12-26 06:08:46,017][123090] Updated weights for policy 1, policy_version 815493 (0.0009) [2023-12-26 06:08:46,071][123090] Updated weights for policy 1, policy_version 815503 (0.0006) [2023-12-26 06:08:46,106][123091] Updated weights for policy 0, policy_version 821109 (0.0011) [2023-12-26 06:08:46,130][123090] Updated weights for policy 1, policy_version 815513 (0.0006) [2023-12-26 06:08:46,169][123091] Updated weights for policy 0, policy_version 821119 (0.0010) [2023-12-26 06:08:46,224][123091] Updated weights for policy 0, policy_version 821129 (0.0010) [2023-12-26 06:08:46,740][123090] Updated weights for policy 1, policy_version 815523 (0.0006) [2023-12-26 06:08:46,809][123090] Updated weights for policy 1, policy_version 815533 (0.0005) [2023-12-26 06:08:46,877][123090] Updated weights for policy 1, policy_version 815543 (0.0006) [2023-12-26 06:08:46,941][123091] Updated weights for policy 0, policy_version 821139 (0.0009) [2023-12-26 06:08:46,984][123091] Updated weights for policy 0, policy_version 821149 (0.0005) [2023-12-26 06:08:47,044][123091] Updated weights for policy 0, policy_version 821159 (0.0005) [2023-12-26 06:08:47,658][123090] Updated weights for policy 1, policy_version 815553 (0.0009) [2023-12-26 06:08:47,705][123090] Updated weights for policy 1, policy_version 815563 (0.0010) [2023-12-26 06:08:47,710][123091] Updated weights for policy 0, policy_version 821169 (0.0006) [2023-12-26 06:08:47,768][123090] Updated weights for policy 1, policy_version 815573 (0.0010) [2023-12-26 06:08:47,769][123091] Updated weights for policy 0, policy_version 821179 (0.0006) [2023-12-26 06:08:47,816][123090] Updated weights for policy 1, policy_version 815583 (0.0010) [2023-12-26 06:08:47,827][123091] Updated weights for policy 0, policy_version 821189 (0.0010) [2023-12-26 06:08:47,887][123091] Updated weights for policy 0, policy_version 821199 (0.0011) [2023-12-26 06:08:48,529][123091] Updated weights for policy 0, policy_version 821209 (0.0006) [2023-12-26 06:08:48,590][123090] Updated weights for policy 1, policy_version 815593 (0.0010) [2023-12-26 06:08:48,598][123091] Updated weights for policy 0, policy_version 821219 (0.0007) [2023-12-26 06:08:48,658][123090] Updated weights for policy 1, policy_version 815603 (0.0010) [2023-12-26 06:08:48,659][123091] Updated weights for policy 0, policy_version 821229 (0.0011) [2023-12-26 06:08:48,725][123090] Updated weights for policy 1, policy_version 815613 (0.0009) [2023-12-26 06:08:48,784][121949] Fps is (10 sec: 18842.1, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 419037184. Throughput: 0: 9220.2, 1: 8718.3. Samples: 419042624. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:08:48,784][121949] Avg episode reward: [(0, '6233.826'), (1, '5879.112')] [2023-12-26 06:08:49,489][123091] Updated weights for policy 0, policy_version 821239 (0.0010) [2023-12-26 06:08:49,552][123091] Updated weights for policy 0, policy_version 821249 (0.0011) [2023-12-26 06:08:49,555][123090] Updated weights for policy 1, policy_version 815623 (0.0009) [2023-12-26 06:08:49,616][123091] Updated weights for policy 0, policy_version 821259 (0.0006) [2023-12-26 06:08:49,624][123090] Updated weights for policy 1, policy_version 815633 (0.0011) [2023-12-26 06:08:49,692][123090] Updated weights for policy 1, policy_version 815643 (0.0010) [2023-12-26 06:08:50,390][123091] Updated weights for policy 0, policy_version 821269 (0.0009) [2023-12-26 06:08:50,455][123091] Updated weights for policy 0, policy_version 821279 (0.0007) [2023-12-26 06:08:50,507][123091] Updated weights for policy 0, policy_version 821289 (0.0011) [2023-12-26 06:08:50,536][123090] Updated weights for policy 1, policy_version 815653 (0.0011) [2023-12-26 06:08:50,602][123090] Updated weights for policy 1, policy_version 815663 (0.0010) [2023-12-26 06:08:50,666][123090] Updated weights for policy 1, policy_version 815673 (0.0008) [2023-12-26 06:08:51,294][123091] Updated weights for policy 0, policy_version 821299 (0.0010) [2023-12-26 06:08:51,362][123091] Updated weights for policy 0, policy_version 821309 (0.0008) [2023-12-26 06:08:51,429][123091] Updated weights for policy 0, policy_version 821319 (0.0009) [2023-12-26 06:08:51,526][123090] Updated weights for policy 1, policy_version 815683 (0.0009) [2023-12-26 06:08:51,594][123090] Updated weights for policy 1, policy_version 815693 (0.0011) [2023-12-26 06:08:51,661][123090] Updated weights for policy 1, policy_version 815703 (0.0011) [2023-12-26 06:08:52,284][123091] Updated weights for policy 0, policy_version 821329 (0.0008) [2023-12-26 06:08:52,350][123091] Updated weights for policy 0, policy_version 821339 (0.0009) [2023-12-26 06:08:52,412][123091] Updated weights for policy 0, policy_version 821349 (0.0009) [2023-12-26 06:08:52,418][123090] Updated weights for policy 1, policy_version 815713 (0.0010) [2023-12-26 06:08:52,470][123090] Updated weights for policy 1, policy_version 815723 (0.0006) [2023-12-26 06:08:52,471][123091] Updated weights for policy 0, policy_version 821359 (0.0009) [2023-12-26 06:08:52,518][123090] Updated weights for policy 1, policy_version 815733 (0.0005) [2023-12-26 06:08:52,570][123090] Updated weights for policy 1, policy_version 815743 (0.0010) [2023-12-26 06:08:53,330][123090] Updated weights for policy 1, policy_version 815753 (0.0007) [2023-12-26 06:08:53,335][123091] Updated weights for policy 0, policy_version 821369 (0.0008) [2023-12-26 06:08:53,391][123090] Updated weights for policy 1, policy_version 815763 (0.0007) [2023-12-26 06:08:53,394][123091] Updated weights for policy 0, policy_version 821379 (0.0011) [2023-12-26 06:08:53,455][123091] Updated weights for policy 0, policy_version 821389 (0.0006) [2023-12-26 06:08:53,464][123090] Updated weights for policy 1, policy_version 815773 (0.0006) [2023-12-26 06:08:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 419119104. Throughput: 0: 9220.8, 1: 8692.1. Samples: 419093396. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:08:53,784][121949] Avg episode reward: [(0, '6246.806'), (1, '5954.561')] [2023-12-26 06:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000815776_208838656.pth... [2023-12-26 06:08:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000821392_210280448.pth... [2023-12-26 06:08:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000814752_208576512.pth [2023-12-26 06:08:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000820336_210010112.pth [2023-12-26 06:08:54,069][123091] Updated weights for policy 0, policy_version 821399 (0.0008) [2023-12-26 06:08:54,123][123091] Updated weights for policy 0, policy_version 821409 (0.0009) [2023-12-26 06:08:54,136][123090] Updated weights for policy 1, policy_version 815783 (0.0007) [2023-12-26 06:08:54,187][123091] Updated weights for policy 0, policy_version 821419 (0.0009) [2023-12-26 06:08:54,205][123090] Updated weights for policy 1, policy_version 815793 (0.0006) [2023-12-26 06:08:54,280][123090] Updated weights for policy 1, policy_version 815803 (0.0007) [2023-12-26 06:08:54,978][123091] Updated weights for policy 0, policy_version 821429 (0.0010) [2023-12-26 06:08:55,035][123091] Updated weights for policy 0, policy_version 821439 (0.0011) [2023-12-26 06:08:55,098][123091] Updated weights for policy 0, policy_version 821449 (0.0011) [2023-12-26 06:08:55,105][123090] Updated weights for policy 1, policy_version 815813 (0.0006) [2023-12-26 06:08:55,170][123090] Updated weights for policy 1, policy_version 815823 (0.0007) [2023-12-26 06:08:55,229][123090] Updated weights for policy 1, policy_version 815833 (0.0008) [2023-12-26 06:08:55,806][123091] Updated weights for policy 0, policy_version 821459 (0.0008) [2023-12-26 06:08:55,868][123091] Updated weights for policy 0, policy_version 821469 (0.0005) [2023-12-26 06:08:55,930][123091] Updated weights for policy 0, policy_version 821479 (0.0006) [2023-12-26 06:08:55,956][123090] Updated weights for policy 1, policy_version 815843 (0.0008) [2023-12-26 06:08:56,008][123090] Updated weights for policy 1, policy_version 815853 (0.0005) [2023-12-26 06:08:56,062][123090] Updated weights for policy 1, policy_version 815863 (0.0005) [2023-12-26 06:08:56,618][123091] Updated weights for policy 0, policy_version 821489 (0.0009) [2023-12-26 06:08:56,671][123091] Updated weights for policy 0, policy_version 821499 (0.0005) [2023-12-26 06:08:56,733][123091] Updated weights for policy 0, policy_version 821509 (0.0005) [2023-12-26 06:08:56,792][123090] Updated weights for policy 1, policy_version 815873 (0.0006) [2023-12-26 06:08:56,805][123091] Updated weights for policy 0, policy_version 821519 (0.0006) [2023-12-26 06:08:56,845][123090] Updated weights for policy 1, policy_version 815883 (0.0006) [2023-12-26 06:08:56,903][123090] Updated weights for policy 1, policy_version 815893 (0.0005) [2023-12-26 06:08:56,960][123090] Updated weights for policy 1, policy_version 815903 (0.0006) [2023-12-26 06:08:57,492][123091] Updated weights for policy 0, policy_version 821529 (0.0010) [2023-12-26 06:08:57,542][123091] Updated weights for policy 0, policy_version 821539 (0.0009) [2023-12-26 06:08:57,590][123091] Updated weights for policy 0, policy_version 821549 (0.0010) [2023-12-26 06:08:57,636][123090] Updated weights for policy 1, policy_version 815913 (0.0006) [2023-12-26 06:08:57,694][123090] Updated weights for policy 1, policy_version 815923 (0.0006) [2023-12-26 06:08:57,749][123090] Updated weights for policy 1, policy_version 815933 (0.0008) [2023-12-26 06:08:58,459][123091] Updated weights for policy 0, policy_version 821560 (0.0010) [2023-12-26 06:08:58,531][123091] Updated weights for policy 0, policy_version 821570 (0.0010) [2023-12-26 06:08:58,591][123090] Updated weights for policy 1, policy_version 815943 (0.0009) [2023-12-26 06:08:58,604][123091] Updated weights for policy 0, policy_version 821580 (0.0009) [2023-12-26 06:08:58,657][123090] Updated weights for policy 1, policy_version 815953 (0.0011) [2023-12-26 06:08:58,727][123090] Updated weights for policy 1, policy_version 815963 (0.0010) [2023-12-26 06:08:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 419217408. Throughput: 0: 9169.8, 1: 8812.4. Samples: 419206444. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:08:58,785][121949] Avg episode reward: [(0, '6218.238'), (1, '5978.453')] [2023-12-26 06:08:59,464][123091] Updated weights for policy 0, policy_version 821590 (0.0008) [2023-12-26 06:08:59,522][123091] Updated weights for policy 0, policy_version 821600 (0.0009) [2023-12-26 06:08:59,579][123091] Updated weights for policy 0, policy_version 821610 (0.0006) [2023-12-26 06:08:59,641][123090] Updated weights for policy 1, policy_version 815973 (0.0010) [2023-12-26 06:08:59,708][123090] Updated weights for policy 1, policy_version 815983 (0.0011) [2023-12-26 06:08:59,771][123090] Updated weights for policy 1, policy_version 815993 (0.0011) [2023-12-26 06:09:00,285][123091] Updated weights for policy 0, policy_version 821620 (0.0005) [2023-12-26 06:09:00,345][123091] Updated weights for policy 0, policy_version 821630 (0.0005) [2023-12-26 06:09:00,409][123091] Updated weights for policy 0, policy_version 821640 (0.0009) [2023-12-26 06:09:00,592][123090] Updated weights for policy 1, policy_version 816003 (0.0011) [2023-12-26 06:09:00,654][123090] Updated weights for policy 1, policy_version 816013 (0.0010) [2023-12-26 06:09:00,716][123090] Updated weights for policy 1, policy_version 816023 (0.0010) [2023-12-26 06:09:01,185][123091] Updated weights for policy 0, policy_version 821650 (0.0010) [2023-12-26 06:09:01,246][123091] Updated weights for policy 0, policy_version 821660 (0.0007) [2023-12-26 06:09:01,316][123091] Updated weights for policy 0, policy_version 821670 (0.0008) [2023-12-26 06:09:01,385][123091] Updated weights for policy 0, policy_version 821680 (0.0010) [2023-12-26 06:09:01,520][123090] Updated weights for policy 1, policy_version 816033 (0.0010) [2023-12-26 06:09:01,575][123090] Updated weights for policy 1, policy_version 816043 (0.0010) [2023-12-26 06:09:01,644][123090] Updated weights for policy 1, policy_version 816053 (0.0009) [2023-12-26 06:09:01,708][123090] Updated weights for policy 1, policy_version 816063 (0.0010) [2023-12-26 06:09:02,197][123091] Updated weights for policy 0, policy_version 821690 (0.0009) [2023-12-26 06:09:02,262][123091] Updated weights for policy 0, policy_version 821700 (0.0010) [2023-12-26 06:09:02,331][123091] Updated weights for policy 0, policy_version 821710 (0.0010) [2023-12-26 06:09:02,420][123090] Updated weights for policy 1, policy_version 816073 (0.0009) [2023-12-26 06:09:02,485][123090] Updated weights for policy 1, policy_version 816083 (0.0009) [2023-12-26 06:09:02,534][123090] Updated weights for policy 1, policy_version 816094 (0.0009) [2023-12-26 06:09:03,119][123091] Updated weights for policy 0, policy_version 821720 (0.0009) [2023-12-26 06:09:03,173][123091] Updated weights for policy 0, policy_version 821730 (0.0009) [2023-12-26 06:09:03,234][123091] Updated weights for policy 0, policy_version 821740 (0.0009) [2023-12-26 06:09:03,373][123090] Updated weights for policy 1, policy_version 816104 (0.0006) [2023-12-26 06:09:03,433][123090] Updated weights for policy 1, policy_version 816114 (0.0005) [2023-12-26 06:09:03,482][123090] Updated weights for policy 1, policy_version 816124 (0.0005) [2023-12-26 06:09:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 419299328. Throughput: 0: 8997.9, 1: 8743.6. Samples: 419310516. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:03,785][121949] Avg episode reward: [(0, '6196.806'), (1, '5964.104')] [2023-12-26 06:09:04,069][123091] Updated weights for policy 0, policy_version 821750 (0.0010) [2023-12-26 06:09:04,124][123091] Updated weights for policy 0, policy_version 821760 (0.0011) [2023-12-26 06:09:04,191][123091] Updated weights for policy 0, policy_version 821770 (0.0011) [2023-12-26 06:09:04,220][123090] Updated weights for policy 1, policy_version 816134 (0.0008) [2023-12-26 06:09:04,277][123090] Updated weights for policy 1, policy_version 816144 (0.0008) [2023-12-26 06:09:04,338][123090] Updated weights for policy 1, policy_version 816154 (0.0008) [2023-12-26 06:09:04,951][123091] Updated weights for policy 0, policy_version 821780 (0.0009) [2023-12-26 06:09:05,001][123091] Updated weights for policy 0, policy_version 821790 (0.0005) [2023-12-26 06:09:05,058][123091] Updated weights for policy 0, policy_version 821800 (0.0005) [2023-12-26 06:09:05,131][123090] Updated weights for policy 1, policy_version 816164 (0.0007) [2023-12-26 06:09:05,178][123090] Updated weights for policy 1, policy_version 816174 (0.0005) [2023-12-26 06:09:05,224][123090] Updated weights for policy 1, policy_version 816184 (0.0005) [2023-12-26 06:09:05,753][123091] Updated weights for policy 0, policy_version 821810 (0.0006) [2023-12-26 06:09:05,809][123091] Updated weights for policy 0, policy_version 821820 (0.0007) [2023-12-26 06:09:05,878][123091] Updated weights for policy 0, policy_version 821830 (0.0006) [2023-12-26 06:09:05,951][123091] Updated weights for policy 0, policy_version 821840 (0.0006) [2023-12-26 06:09:05,981][123090] Updated weights for policy 1, policy_version 816194 (0.0006) [2023-12-26 06:09:06,048][123090] Updated weights for policy 1, policy_version 816204 (0.0008) [2023-12-26 06:09:06,114][123090] Updated weights for policy 1, policy_version 816214 (0.0006) [2023-12-26 06:09:06,189][123090] Updated weights for policy 1, policy_version 816224 (0.0007) [2023-12-26 06:09:06,724][123091] Updated weights for policy 0, policy_version 821850 (0.0010) [2023-12-26 06:09:06,782][123091] Updated weights for policy 0, policy_version 821860 (0.0010) [2023-12-26 06:09:06,843][123091] Updated weights for policy 0, policy_version 821870 (0.0008) [2023-12-26 06:09:06,912][123090] Updated weights for policy 1, policy_version 816234 (0.0009) [2023-12-26 06:09:06,969][123090] Updated weights for policy 1, policy_version 816244 (0.0010) [2023-12-26 06:09:07,030][123090] Updated weights for policy 1, policy_version 816254 (0.0006) [2023-12-26 06:09:07,466][123091] Updated weights for policy 0, policy_version 821880 (0.0006) [2023-12-26 06:09:07,530][123091] Updated weights for policy 0, policy_version 821890 (0.0009) [2023-12-26 06:09:07,584][123091] Updated weights for policy 0, policy_version 821900 (0.0010) [2023-12-26 06:09:07,699][123090] Updated weights for policy 1, policy_version 816264 (0.0005) [2023-12-26 06:09:07,763][123090] Updated weights for policy 1, policy_version 816274 (0.0005) [2023-12-26 06:09:07,821][123090] Updated weights for policy 1, policy_version 816284 (0.0005) [2023-12-26 06:09:08,502][123091] Updated weights for policy 0, policy_version 821910 (0.0007) [2023-12-26 06:09:08,540][123090] Updated weights for policy 1, policy_version 816294 (0.0006) [2023-12-26 06:09:08,574][123091] Updated weights for policy 0, policy_version 821920 (0.0006) [2023-12-26 06:09:08,614][123090] Updated weights for policy 1, policy_version 816304 (0.0010) [2023-12-26 06:09:08,638][123091] Updated weights for policy 0, policy_version 821930 (0.0008) [2023-12-26 06:09:08,675][123090] Updated weights for policy 1, policy_version 816314 (0.0011) [2023-12-26 06:09:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 419397632. Throughput: 0: 9064.3, 1: 8787.2. Samples: 419366288. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:08,785][121949] Avg episode reward: [(0, '6217.196'), (1, '5922.909')] [2023-12-26 06:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000821936_210419712.pth... [2023-12-26 06:09:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000816320_208977920.pth... [2023-12-26 06:09:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000820848_210141184.pth [2023-12-26 06:09:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000815264_208707584.pth [2023-12-26 06:09:09,367][123091] Updated weights for policy 0, policy_version 821940 (0.0007) [2023-12-26 06:09:09,432][123091] Updated weights for policy 0, policy_version 821950 (0.0008) [2023-12-26 06:09:09,486][123090] Updated weights for policy 1, policy_version 816324 (0.0010) [2023-12-26 06:09:09,499][123091] Updated weights for policy 0, policy_version 821960 (0.0008) [2023-12-26 06:09:09,547][123090] Updated weights for policy 1, policy_version 816334 (0.0011) [2023-12-26 06:09:09,613][123090] Updated weights for policy 1, policy_version 816344 (0.0006) [2023-12-26 06:09:10,361][123091] Updated weights for policy 0, policy_version 821970 (0.0008) [2023-12-26 06:09:10,421][123090] Updated weights for policy 1, policy_version 816354 (0.0006) [2023-12-26 06:09:10,430][123091] Updated weights for policy 0, policy_version 821980 (0.0009) [2023-12-26 06:09:10,481][123090] Updated weights for policy 1, policy_version 816364 (0.0011) [2023-12-26 06:09:10,495][123091] Updated weights for policy 0, policy_version 821990 (0.0010) [2023-12-26 06:09:10,540][123090] Updated weights for policy 1, policy_version 816374 (0.0010) [2023-12-26 06:09:10,555][123091] Updated weights for policy 0, policy_version 822000 (0.0010) [2023-12-26 06:09:10,604][123090] Updated weights for policy 1, policy_version 816384 (0.0010) [2023-12-26 06:09:11,306][123091] Updated weights for policy 0, policy_version 822010 (0.0011) [2023-12-26 06:09:11,372][123091] Updated weights for policy 0, policy_version 822020 (0.0010) [2023-12-26 06:09:11,415][123090] Updated weights for policy 1, policy_version 816394 (0.0009) [2023-12-26 06:09:11,431][123091] Updated weights for policy 0, policy_version 822030 (0.0009) [2023-12-26 06:09:11,485][123090] Updated weights for policy 1, policy_version 816404 (0.0008) [2023-12-26 06:09:11,556][123090] Updated weights for policy 1, policy_version 816414 (0.0009) [2023-12-26 06:09:12,296][123091] Updated weights for policy 0, policy_version 822040 (0.0010) [2023-12-26 06:09:12,364][123091] Updated weights for policy 0, policy_version 822050 (0.0010) [2023-12-26 06:09:12,382][123090] Updated weights for policy 1, policy_version 816424 (0.0008) [2023-12-26 06:09:12,430][123091] Updated weights for policy 0, policy_version 822060 (0.0008) [2023-12-26 06:09:12,441][123090] Updated weights for policy 1, policy_version 816434 (0.0009) [2023-12-26 06:09:12,494][123090] Updated weights for policy 1, policy_version 816444 (0.0009) [2023-12-26 06:09:13,251][123091] Updated weights for policy 0, policy_version 822070 (0.0008) [2023-12-26 06:09:13,305][123091] Updated weights for policy 0, policy_version 822080 (0.0009) [2023-12-26 06:09:13,311][123090] Updated weights for policy 1, policy_version 816454 (0.0008) [2023-12-26 06:09:13,355][123090] Updated weights for policy 1, policy_version 816464 (0.0005) [2023-12-26 06:09:13,357][123091] Updated weights for policy 0, policy_version 822090 (0.0009) [2023-12-26 06:09:13,410][123090] Updated weights for policy 1, policy_version 816474 (0.0006) [2023-12-26 06:09:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 419479552. Throughput: 0: 9059.4, 1: 8839.2. Samples: 419471900. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:13,785][121949] Avg episode reward: [(0, '6267.625'), (1, '5899.996')] [2023-12-26 06:09:14,204][123090] Updated weights for policy 1, policy_version 816484 (0.0007) [2023-12-26 06:09:14,219][123091] Updated weights for policy 0, policy_version 822100 (0.0009) [2023-12-26 06:09:14,255][123090] Updated weights for policy 1, policy_version 816494 (0.0010) [2023-12-26 06:09:14,263][123091] Updated weights for policy 0, policy_version 822110 (0.0006) [2023-12-26 06:09:14,307][123090] Updated weights for policy 1, policy_version 816504 (0.0010) [2023-12-26 06:09:14,314][123091] Updated weights for policy 0, policy_version 822120 (0.0006) [2023-12-26 06:09:15,058][123090] Updated weights for policy 1, policy_version 816514 (0.0010) [2023-12-26 06:09:15,124][123090] Updated weights for policy 1, policy_version 816524 (0.0011) [2023-12-26 06:09:15,152][123091] Updated weights for policy 0, policy_version 822130 (0.0007) [2023-12-26 06:09:15,193][123090] Updated weights for policy 1, policy_version 816534 (0.0011) [2023-12-26 06:09:15,217][123091] Updated weights for policy 0, policy_version 822140 (0.0006) [2023-12-26 06:09:15,264][123090] Updated weights for policy 1, policy_version 816544 (0.0007) [2023-12-26 06:09:15,290][123091] Updated weights for policy 0, policy_version 822150 (0.0010) [2023-12-26 06:09:15,353][123091] Updated weights for policy 0, policy_version 822160 (0.0009) [2023-12-26 06:09:16,074][123090] Updated weights for policy 1, policy_version 816554 (0.0005) [2023-12-26 06:09:16,156][123090] Updated weights for policy 1, policy_version 816564 (0.0006) [2023-12-26 06:09:16,198][123091] Updated weights for policy 0, policy_version 822170 (0.0009) [2023-12-26 06:09:16,213][123090] Updated weights for policy 1, policy_version 816574 (0.0005) [2023-12-26 06:09:16,257][123091] Updated weights for policy 0, policy_version 822180 (0.0009) [2023-12-26 06:09:16,318][123091] Updated weights for policy 0, policy_version 822190 (0.0009) [2023-12-26 06:09:16,969][123090] Updated weights for policy 1, policy_version 816584 (0.0009) [2023-12-26 06:09:17,026][123090] Updated weights for policy 1, policy_version 816594 (0.0009) [2023-12-26 06:09:17,085][123090] Updated weights for policy 1, policy_version 816604 (0.0007) [2023-12-26 06:09:17,174][123091] Updated weights for policy 0, policy_version 822200 (0.0010) [2023-12-26 06:09:17,225][123091] Updated weights for policy 0, policy_version 822210 (0.0010) [2023-12-26 06:09:17,280][123091] Updated weights for policy 0, policy_version 822220 (0.0010) [2023-12-26 06:09:17,757][123090] Updated weights for policy 1, policy_version 816614 (0.0009) [2023-12-26 06:09:17,805][123090] Updated weights for policy 1, policy_version 816624 (0.0010) [2023-12-26 06:09:17,856][123090] Updated weights for policy 1, policy_version 816634 (0.0009) [2023-12-26 06:09:18,118][123091] Updated weights for policy 0, policy_version 822230 (0.0007) [2023-12-26 06:09:18,163][123091] Updated weights for policy 0, policy_version 822240 (0.0005) [2023-12-26 06:09:18,209][123091] Updated weights for policy 0, policy_version 822250 (0.0005) [2023-12-26 06:09:18,760][123090] Updated weights for policy 1, policy_version 816644 (0.0010) [2023-12-26 06:09:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 419561472. Throughput: 0: 8913.2, 1: 8963.6. Samples: 419576952. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:18,785][121949] Avg episode reward: [(0, '6173.355'), (1, '5748.906')] [2023-12-26 06:09:18,823][123090] Updated weights for policy 1, policy_version 816654 (0.0011) [2023-12-26 06:09:18,888][123090] Updated weights for policy 1, policy_version 816664 (0.0009) [2023-12-26 06:09:19,041][123091] Updated weights for policy 0, policy_version 822260 (0.0007) [2023-12-26 06:09:19,102][123091] Updated weights for policy 0, policy_version 822270 (0.0009) [2023-12-26 06:09:19,158][123091] Updated weights for policy 0, policy_version 822280 (0.0009) [2023-12-26 06:09:19,682][123090] Updated weights for policy 1, policy_version 816674 (0.0006) [2023-12-26 06:09:19,744][123090] Updated weights for policy 1, policy_version 816684 (0.0006) [2023-12-26 06:09:19,813][123090] Updated weights for policy 1, policy_version 816694 (0.0008) [2023-12-26 06:09:19,891][123090] Updated weights for policy 1, policy_version 816704 (0.0008) [2023-12-26 06:09:20,043][123091] Updated weights for policy 0, policy_version 822290 (0.0009) [2023-12-26 06:09:20,107][123091] Updated weights for policy 0, policy_version 822300 (0.0009) [2023-12-26 06:09:20,181][123091] Updated weights for policy 0, policy_version 822310 (0.0009) [2023-12-26 06:09:20,249][123091] Updated weights for policy 0, policy_version 822320 (0.0009) [2023-12-26 06:09:20,714][123090] Updated weights for policy 1, policy_version 816714 (0.0011) [2023-12-26 06:09:20,767][123090] Updated weights for policy 1, policy_version 816724 (0.0011) [2023-12-26 06:09:20,824][123090] Updated weights for policy 1, policy_version 816734 (0.0011) [2023-12-26 06:09:21,167][123091] Updated weights for policy 0, policy_version 822330 (0.0009) [2023-12-26 06:09:21,241][123091] Updated weights for policy 0, policy_version 822340 (0.0010) [2023-12-26 06:09:21,309][123091] Updated weights for policy 0, policy_version 822350 (0.0009) [2023-12-26 06:09:21,690][123090] Updated weights for policy 1, policy_version 816744 (0.0010) [2023-12-26 06:09:21,756][123090] Updated weights for policy 1, policy_version 816754 (0.0010) [2023-12-26 06:09:21,826][123090] Updated weights for policy 1, policy_version 816764 (0.0009) [2023-12-26 06:09:22,090][123091] Updated weights for policy 0, policy_version 822360 (0.0011) [2023-12-26 06:09:22,149][123091] Updated weights for policy 0, policy_version 822370 (0.0011) [2023-12-26 06:09:22,216][123091] Updated weights for policy 0, policy_version 822380 (0.0011) [2023-12-26 06:09:22,669][123090] Updated weights for policy 1, policy_version 816774 (0.0010) [2023-12-26 06:09:22,726][123090] Updated weights for policy 1, policy_version 816784 (0.0011) [2023-12-26 06:09:22,786][123090] Updated weights for policy 1, policy_version 816794 (0.0010) [2023-12-26 06:09:22,985][123091] Updated weights for policy 0, policy_version 822390 (0.0008) [2023-12-26 06:09:23,050][123091] Updated weights for policy 0, policy_version 822400 (0.0007) [2023-12-26 06:09:23,120][123091] Updated weights for policy 0, policy_version 822410 (0.0007) [2023-12-26 06:09:23,580][123090] Updated weights for policy 1, policy_version 816804 (0.0010) [2023-12-26 06:09:23,636][123090] Updated weights for policy 1, policy_version 816814 (0.0010) [2023-12-26 06:09:23,684][123090] Updated weights for policy 1, policy_version 816824 (0.0010) [2023-12-26 06:09:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 419651584. Throughput: 0: 8891.0, 1: 8940.6. Samples: 419626572. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:23,785][121949] Avg episode reward: [(0, '6146.797'), (1, '5807.889')] [2023-12-26 06:09:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000822416_210542592.pth... [2023-12-26 06:09:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000816832_209108992.pth... [2023-12-26 06:09:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000815776_208838656.pth [2023-12-26 06:09:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000821392_210280448.pth [2023-12-26 06:09:23,880][123091] Updated weights for policy 0, policy_version 822420 (0.0007) [2023-12-26 06:09:23,928][123091] Updated weights for policy 0, policy_version 822430 (0.0008) [2023-12-26 06:09:23,985][123091] Updated weights for policy 0, policy_version 822440 (0.0008) [2023-12-26 06:09:24,524][123090] Updated weights for policy 1, policy_version 816834 (0.0010) [2023-12-26 06:09:24,575][123090] Updated weights for policy 1, policy_version 816844 (0.0008) [2023-12-26 06:09:24,631][123090] Updated weights for policy 1, policy_version 816854 (0.0009) [2023-12-26 06:09:24,686][123090] Updated weights for policy 1, policy_version 816864 (0.0009) [2023-12-26 06:09:24,759][123091] Updated weights for policy 0, policy_version 822450 (0.0007) [2023-12-26 06:09:24,814][123091] Updated weights for policy 0, policy_version 822460 (0.0010) [2023-12-26 06:09:24,868][123091] Updated weights for policy 0, policy_version 822470 (0.0010) [2023-12-26 06:09:24,938][123091] Updated weights for policy 0, policy_version 822480 (0.0011) [2023-12-26 06:09:25,511][123090] Updated weights for policy 1, policy_version 816874 (0.0010) [2023-12-26 06:09:25,563][123090] Updated weights for policy 1, policy_version 816884 (0.0009) [2023-12-26 06:09:25,619][123090] Updated weights for policy 1, policy_version 816894 (0.0010) [2023-12-26 06:09:25,686][123091] Updated weights for policy 0, policy_version 822490 (0.0008) [2023-12-26 06:09:25,745][123091] Updated weights for policy 0, policy_version 822500 (0.0009) [2023-12-26 06:09:25,795][123091] Updated weights for policy 0, policy_version 822510 (0.0009) [2023-12-26 06:09:26,381][123090] Updated weights for policy 1, policy_version 816904 (0.0006) [2023-12-26 06:09:26,440][123090] Updated weights for policy 1, policy_version 816914 (0.0005) [2023-12-26 06:09:26,502][123090] Updated weights for policy 1, policy_version 816924 (0.0005) [2023-12-26 06:09:26,547][123091] Updated weights for policy 0, policy_version 822520 (0.0007) [2023-12-26 06:09:26,617][123091] Updated weights for policy 0, policy_version 822530 (0.0006) [2023-12-26 06:09:26,672][123091] Updated weights for policy 0, policy_version 822540 (0.0005) [2023-12-26 06:09:27,183][123090] Updated weights for policy 1, policy_version 816934 (0.0006) [2023-12-26 06:09:27,244][123090] Updated weights for policy 1, policy_version 816944 (0.0005) [2023-12-26 06:09:27,307][123090] Updated weights for policy 1, policy_version 816954 (0.0005) [2023-12-26 06:09:27,308][123091] Updated weights for policy 0, policy_version 822550 (0.0006) [2023-12-26 06:09:27,367][123091] Updated weights for policy 0, policy_version 822560 (0.0006) [2023-12-26 06:09:27,438][123091] Updated weights for policy 0, policy_version 822570 (0.0005) [2023-12-26 06:09:28,041][123091] Updated weights for policy 0, policy_version 822580 (0.0007) [2023-12-26 06:09:28,091][123091] Updated weights for policy 0, policy_version 822590 (0.0007) [2023-12-26 06:09:28,109][123090] Updated weights for policy 1, policy_version 816964 (0.0009) [2023-12-26 06:09:28,157][123091] Updated weights for policy 0, policy_version 822600 (0.0005) [2023-12-26 06:09:28,163][123090] Updated weights for policy 1, policy_version 816974 (0.0008) [2023-12-26 06:09:28,212][123090] Updated weights for policy 1, policy_version 816984 (0.0008) [2023-12-26 06:09:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.0, 300 sec: 17800.3). Total num frames: 419741696. Throughput: 0: 9002.0, 1: 8981.3. Samples: 419737812. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:28,784][121949] Avg episode reward: [(0, '6046.652'), (1, '5783.121')] [2023-12-26 06:09:28,838][123091] Updated weights for policy 0, policy_version 822610 (0.0006) [2023-12-26 06:09:28,887][123091] Updated weights for policy 0, policy_version 822620 (0.0009) [2023-12-26 06:09:28,951][123091] Updated weights for policy 0, policy_version 822630 (0.0008) [2023-12-26 06:09:29,019][123091] Updated weights for policy 0, policy_version 822640 (0.0009) [2023-12-26 06:09:29,058][123090] Updated weights for policy 1, policy_version 816994 (0.0009) [2023-12-26 06:09:29,128][123090] Updated weights for policy 1, policy_version 817004 (0.0007) [2023-12-26 06:09:29,193][123090] Updated weights for policy 1, policy_version 817014 (0.0009) [2023-12-26 06:09:29,265][123090] Updated weights for policy 1, policy_version 817024 (0.0009) [2023-12-26 06:09:29,750][123091] Updated weights for policy 0, policy_version 822650 (0.0010) [2023-12-26 06:09:29,815][123091] Updated weights for policy 0, policy_version 822660 (0.0009) [2023-12-26 06:09:29,882][123091] Updated weights for policy 0, policy_version 822670 (0.0009) [2023-12-26 06:09:30,090][123090] Updated weights for policy 1, policy_version 817034 (0.0006) [2023-12-26 06:09:30,162][123090] Updated weights for policy 1, policy_version 817044 (0.0006) [2023-12-26 06:09:30,228][123090] Updated weights for policy 1, policy_version 817054 (0.0008) [2023-12-26 06:09:30,753][123091] Updated weights for policy 0, policy_version 822680 (0.0010) [2023-12-26 06:09:30,825][123091] Updated weights for policy 0, policy_version 822690 (0.0006) [2023-12-26 06:09:30,889][123091] Updated weights for policy 0, policy_version 822700 (0.0006) [2023-12-26 06:09:30,944][123090] Updated weights for policy 1, policy_version 817064 (0.0008) [2023-12-26 06:09:31,005][123090] Updated weights for policy 1, policy_version 817074 (0.0009) [2023-12-26 06:09:31,072][123090] Updated weights for policy 1, policy_version 817084 (0.0009) [2023-12-26 06:09:31,737][123091] Updated weights for policy 0, policy_version 822710 (0.0009) [2023-12-26 06:09:31,795][123091] Updated weights for policy 0, policy_version 822720 (0.0010) [2023-12-26 06:09:31,858][123091] Updated weights for policy 0, policy_version 822730 (0.0011) [2023-12-26 06:09:31,940][123090] Updated weights for policy 1, policy_version 817094 (0.0009) [2023-12-26 06:09:31,997][123090] Updated weights for policy 1, policy_version 817104 (0.0010) [2023-12-26 06:09:32,055][123090] Updated weights for policy 1, policy_version 817114 (0.0009) [2023-12-26 06:09:32,663][123091] Updated weights for policy 0, policy_version 822740 (0.0010) [2023-12-26 06:09:32,715][123091] Updated weights for policy 0, policy_version 822750 (0.0010) [2023-12-26 06:09:32,770][123091] Updated weights for policy 0, policy_version 822760 (0.0010) [2023-12-26 06:09:32,864][123090] Updated weights for policy 1, policy_version 817124 (0.0007) [2023-12-26 06:09:32,915][123090] Updated weights for policy 1, policy_version 817134 (0.0009) [2023-12-26 06:09:32,969][123090] Updated weights for policy 1, policy_version 817145 (0.0010) [2023-12-26 06:09:33,410][123091] Updated weights for policy 0, policy_version 822770 (0.0009) [2023-12-26 06:09:33,482][123091] Updated weights for policy 0, policy_version 822780 (0.0006) [2023-12-26 06:09:33,553][123091] Updated weights for policy 0, policy_version 822790 (0.0005) [2023-12-26 06:09:33,622][123091] Updated weights for policy 0, policy_version 822800 (0.0005) [2023-12-26 06:09:33,763][123090] Updated weights for policy 1, policy_version 817157 (0.0008) [2023-12-26 06:09:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 419831808. Throughput: 0: 8943.6, 1: 8876.3. Samples: 419844524. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:33,785][121949] Avg episode reward: [(0, '6177.900'), (1, '5687.942')] [2023-12-26 06:09:33,817][123090] Updated weights for policy 1, policy_version 817167 (0.0005) [2023-12-26 06:09:33,865][123090] Updated weights for policy 1, policy_version 817177 (0.0005) [2023-12-26 06:09:34,225][123091] Updated weights for policy 0, policy_version 822810 (0.0005) [2023-12-26 06:09:34,283][123091] Updated weights for policy 0, policy_version 822820 (0.0006) [2023-12-26 06:09:34,332][123091] Updated weights for policy 0, policy_version 822830 (0.0005) [2023-12-26 06:09:34,688][123090] Updated weights for policy 1, policy_version 817187 (0.0007) [2023-12-26 06:09:34,755][123090] Updated weights for policy 1, policy_version 817197 (0.0010) [2023-12-26 06:09:34,813][123090] Updated weights for policy 1, policy_version 817207 (0.0010) [2023-12-26 06:09:35,020][123091] Updated weights for policy 0, policy_version 822840 (0.0005) [2023-12-26 06:09:35,071][123091] Updated weights for policy 0, policy_version 822850 (0.0005) [2023-12-26 06:09:35,125][123091] Updated weights for policy 0, policy_version 822860 (0.0007) [2023-12-26 06:09:35,642][123090] Updated weights for policy 1, policy_version 817217 (0.0009) [2023-12-26 06:09:35,709][123090] Updated weights for policy 1, policy_version 817227 (0.0008) [2023-12-26 06:09:35,773][123090] Updated weights for policy 1, policy_version 817237 (0.0007) [2023-12-26 06:09:35,828][123090] Updated weights for policy 1, policy_version 817247 (0.0007) [2023-12-26 06:09:35,892][123091] Updated weights for policy 0, policy_version 822870 (0.0011) [2023-12-26 06:09:35,963][123091] Updated weights for policy 0, policy_version 822880 (0.0011) [2023-12-26 06:09:36,033][123091] Updated weights for policy 0, policy_version 822890 (0.0011) [2023-12-26 06:09:36,619][123090] Updated weights for policy 1, policy_version 817257 (0.0010) [2023-12-26 06:09:36,694][123090] Updated weights for policy 1, policy_version 817267 (0.0011) [2023-12-26 06:09:36,773][123090] Updated weights for policy 1, policy_version 817277 (0.0010) [2023-12-26 06:09:36,809][123091] Updated weights for policy 0, policy_version 822900 (0.0009) [2023-12-26 06:09:36,883][123091] Updated weights for policy 0, policy_version 822910 (0.0011) [2023-12-26 06:09:36,951][123091] Updated weights for policy 0, policy_version 822920 (0.0010) [2023-12-26 06:09:37,569][123090] Updated weights for policy 1, policy_version 817287 (0.0010) [2023-12-26 06:09:37,629][123090] Updated weights for policy 1, policy_version 817297 (0.0010) [2023-12-26 06:09:37,669][123091] Updated weights for policy 0, policy_version 822930 (0.0010) [2023-12-26 06:09:37,692][123090] Updated weights for policy 1, policy_version 817307 (0.0010) [2023-12-26 06:09:37,726][123091] Updated weights for policy 0, policy_version 822940 (0.0007) [2023-12-26 06:09:37,776][123091] Updated weights for policy 0, policy_version 822950 (0.0009) [2023-12-26 06:09:37,835][123091] Updated weights for policy 0, policy_version 822960 (0.0008) [2023-12-26 06:09:38,514][123090] Updated weights for policy 1, policy_version 817317 (0.0011) [2023-12-26 06:09:38,568][123090] Updated weights for policy 1, policy_version 817327 (0.0010) [2023-12-26 06:09:38,636][123090] Updated weights for policy 1, policy_version 817337 (0.0006) [2023-12-26 06:09:38,683][123091] Updated weights for policy 0, policy_version 822970 (0.0011) [2023-12-26 06:09:38,727][123091] Updated weights for policy 0, policy_version 822980 (0.0010) [2023-12-26 06:09:38,775][123091] Updated weights for policy 0, policy_version 822990 (0.0011) [2023-12-26 06:09:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 419930112. Throughput: 0: 9002.1, 1: 8921.2. Samples: 419899940. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:38,784][121949] Avg episode reward: [(0, '6174.105'), (1, '5514.667')] [2023-12-26 06:09:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000822992_210690048.pth... [2023-12-26 06:09:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000817344_209240064.pth... [2023-12-26 06:09:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000821936_210419712.pth [2023-12-26 06:09:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000816320_208977920.pth [2023-12-26 06:09:39,376][123090] Updated weights for policy 1, policy_version 817347 (0.0007) [2023-12-26 06:09:39,444][123090] Updated weights for policy 1, policy_version 817357 (0.0010) [2023-12-26 06:09:39,510][123090] Updated weights for policy 1, policy_version 817367 (0.0006) [2023-12-26 06:09:39,621][123091] Updated weights for policy 0, policy_version 823000 (0.0011) [2023-12-26 06:09:39,681][123091] Updated weights for policy 0, policy_version 823010 (0.0011) [2023-12-26 06:09:39,741][123091] Updated weights for policy 0, policy_version 823020 (0.0011) [2023-12-26 06:09:40,288][123090] Updated weights for policy 1, policy_version 817377 (0.0006) [2023-12-26 06:09:40,362][123090] Updated weights for policy 1, policy_version 817387 (0.0006) [2023-12-26 06:09:40,425][123090] Updated weights for policy 1, policy_version 817397 (0.0006) [2023-12-26 06:09:40,493][123090] Updated weights for policy 1, policy_version 817407 (0.0006) [2023-12-26 06:09:40,580][123091] Updated weights for policy 0, policy_version 823030 (0.0009) [2023-12-26 06:09:40,648][123091] Updated weights for policy 0, policy_version 823040 (0.0007) [2023-12-26 06:09:40,710][123091] Updated weights for policy 0, policy_version 823050 (0.0010) [2023-12-26 06:09:41,123][123090] Updated weights for policy 1, policy_version 817417 (0.0009) [2023-12-26 06:09:41,193][123090] Updated weights for policy 1, policy_version 817427 (0.0010) [2023-12-26 06:09:41,253][123090] Updated weights for policy 1, policy_version 817437 (0.0009) [2023-12-26 06:09:41,597][123091] Updated weights for policy 0, policy_version 823060 (0.0009) [2023-12-26 06:09:41,672][123091] Updated weights for policy 0, policy_version 823070 (0.0010) [2023-12-26 06:09:41,741][123091] Updated weights for policy 0, policy_version 823080 (0.0010) [2023-12-26 06:09:42,080][123090] Updated weights for policy 1, policy_version 817447 (0.0007) [2023-12-26 06:09:42,141][123090] Updated weights for policy 1, policy_version 817457 (0.0006) [2023-12-26 06:09:42,206][123090] Updated weights for policy 1, policy_version 817467 (0.0008) [2023-12-26 06:09:42,497][123091] Updated weights for policy 0, policy_version 823090 (0.0008) [2023-12-26 06:09:42,558][123091] Updated weights for policy 0, policy_version 823100 (0.0005) [2023-12-26 06:09:42,624][123091] Updated weights for policy 0, policy_version 823110 (0.0007) [2023-12-26 06:09:42,689][123091] Updated weights for policy 0, policy_version 823120 (0.0009) [2023-12-26 06:09:42,989][123090] Updated weights for policy 1, policy_version 817477 (0.0009) [2023-12-26 06:09:43,053][123090] Updated weights for policy 1, policy_version 817487 (0.0009) [2023-12-26 06:09:43,115][123090] Updated weights for policy 1, policy_version 817497 (0.0009) [2023-12-26 06:09:43,496][123091] Updated weights for policy 0, policy_version 823130 (0.0009) [2023-12-26 06:09:43,556][123091] Updated weights for policy 0, policy_version 823140 (0.0010) [2023-12-26 06:09:43,615][123091] Updated weights for policy 0, policy_version 823150 (0.0009) [2023-12-26 06:09:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 420012032. Throughput: 0: 8926.3, 1: 8826.8. Samples: 420005336. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:43,785][121949] Avg episode reward: [(0, '6316.782'), (1, '5520.216')] [2023-12-26 06:09:43,986][123090] Updated weights for policy 1, policy_version 817508 (0.0009) [2023-12-26 06:09:44,041][123090] Updated weights for policy 1, policy_version 817520 (0.0011) [2023-12-26 06:09:44,088][123090] Updated weights for policy 1, policy_version 817530 (0.0009) [2023-12-26 06:09:44,314][123091] Updated weights for policy 0, policy_version 823160 (0.0010) [2023-12-26 06:09:44,379][123091] Updated weights for policy 0, policy_version 823170 (0.0010) [2023-12-26 06:09:44,445][123091] Updated weights for policy 0, policy_version 823180 (0.0010) [2023-12-26 06:09:44,966][123090] Updated weights for policy 1, policy_version 817540 (0.0009) [2023-12-26 06:09:45,031][123090] Updated weights for policy 1, policy_version 817550 (0.0009) [2023-12-26 06:09:45,097][123090] Updated weights for policy 1, policy_version 817560 (0.0009) [2023-12-26 06:09:45,270][123091] Updated weights for policy 0, policy_version 823190 (0.0010) [2023-12-26 06:09:45,337][123091] Updated weights for policy 0, policy_version 823200 (0.0011) [2023-12-26 06:09:45,408][123091] Updated weights for policy 0, policy_version 823210 (0.0011) [2023-12-26 06:09:45,912][123090] Updated weights for policy 1, policy_version 817570 (0.0009) [2023-12-26 06:09:45,963][123090] Updated weights for policy 1, policy_version 817580 (0.0007) [2023-12-26 06:09:46,010][123090] Updated weights for policy 1, policy_version 817590 (0.0005) [2023-12-26 06:09:46,067][123090] Updated weights for policy 1, policy_version 817600 (0.0005) [2023-12-26 06:09:46,197][123091] Updated weights for policy 0, policy_version 823220 (0.0008) [2023-12-26 06:09:46,263][123091] Updated weights for policy 0, policy_version 823230 (0.0005) [2023-12-26 06:09:46,343][123091] Updated weights for policy 0, policy_version 823240 (0.0005) [2023-12-26 06:09:46,696][123090] Updated weights for policy 1, policy_version 817610 (0.0005) [2023-12-26 06:09:46,750][123090] Updated weights for policy 1, policy_version 817620 (0.0008) [2023-12-26 06:09:46,801][123090] Updated weights for policy 1, policy_version 817630 (0.0009) [2023-12-26 06:09:47,021][123091] Updated weights for policy 0, policy_version 823250 (0.0010) [2023-12-26 06:09:47,088][123091] Updated weights for policy 0, policy_version 823260 (0.0010) [2023-12-26 06:09:47,151][123091] Updated weights for policy 0, policy_version 823270 (0.0010) [2023-12-26 06:09:47,204][123091] Updated weights for policy 0, policy_version 823280 (0.0010) [2023-12-26 06:09:47,647][123090] Updated weights for policy 1, policy_version 817640 (0.0008) [2023-12-26 06:09:47,715][123090] Updated weights for policy 1, policy_version 817650 (0.0009) [2023-12-26 06:09:47,787][123090] Updated weights for policy 1, policy_version 817660 (0.0009) [2023-12-26 06:09:48,009][123091] Updated weights for policy 0, policy_version 823290 (0.0005) [2023-12-26 06:09:48,066][123091] Updated weights for policy 0, policy_version 823300 (0.0005) [2023-12-26 06:09:48,129][123091] Updated weights for policy 0, policy_version 823310 (0.0005) [2023-12-26 06:09:48,519][123090] Updated weights for policy 1, policy_version 817670 (0.0009) [2023-12-26 06:09:48,571][123090] Updated weights for policy 1, policy_version 817680 (0.0009) [2023-12-26 06:09:48,628][123090] Updated weights for policy 1, policy_version 817690 (0.0006) [2023-12-26 06:09:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 420102144. Throughput: 0: 8967.7, 1: 8869.9. Samples: 420113208. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:48,785][121949] Avg episode reward: [(0, '6444.440'), (1, '5310.807')] [2023-12-26 06:09:48,875][123091] Updated weights for policy 0, policy_version 823320 (0.0005) [2023-12-26 06:09:48,942][123091] Updated weights for policy 0, policy_version 823330 (0.0006) [2023-12-26 06:09:49,018][123091] Updated weights for policy 0, policy_version 823340 (0.0006) [2023-12-26 06:09:49,297][123090] Updated weights for policy 1, policy_version 817700 (0.0006) [2023-12-26 06:09:49,366][123090] Updated weights for policy 1, policy_version 817710 (0.0008) [2023-12-26 06:09:49,435][123090] Updated weights for policy 1, policy_version 817720 (0.0008) [2023-12-26 06:09:49,684][123091] Updated weights for policy 0, policy_version 823350 (0.0005) [2023-12-26 06:09:49,752][123091] Updated weights for policy 0, policy_version 823360 (0.0005) [2023-12-26 06:09:49,822][123091] Updated weights for policy 0, policy_version 823370 (0.0006) [2023-12-26 06:09:50,303][123090] Updated weights for policy 1, policy_version 817730 (0.0009) [2023-12-26 06:09:50,367][123090] Updated weights for policy 1, policy_version 817740 (0.0009) [2023-12-26 06:09:50,420][123090] Updated weights for policy 1, policy_version 817750 (0.0010) [2023-12-26 06:09:50,474][123090] Updated weights for policy 1, policy_version 817760 (0.0010) [2023-12-26 06:09:50,541][123091] Updated weights for policy 0, policy_version 823380 (0.0009) [2023-12-26 06:09:50,612][123091] Updated weights for policy 0, policy_version 823390 (0.0008) [2023-12-26 06:09:50,677][123091] Updated weights for policy 0, policy_version 823400 (0.0008) [2023-12-26 06:09:51,287][123090] Updated weights for policy 1, policy_version 817770 (0.0006) [2023-12-26 06:09:51,363][123090] Updated weights for policy 1, policy_version 817780 (0.0007) [2023-12-26 06:09:51,424][123090] Updated weights for policy 1, policy_version 817790 (0.0007) [2023-12-26 06:09:51,479][123091] Updated weights for policy 0, policy_version 823410 (0.0006) [2023-12-26 06:09:51,550][123091] Updated weights for policy 0, policy_version 823420 (0.0005) [2023-12-26 06:09:51,620][123091] Updated weights for policy 0, policy_version 823430 (0.0009) [2023-12-26 06:09:51,679][123091] Updated weights for policy 0, policy_version 823440 (0.0008) [2023-12-26 06:09:52,271][123090] Updated weights for policy 1, policy_version 817800 (0.0010) [2023-12-26 06:09:52,334][123090] Updated weights for policy 1, policy_version 817810 (0.0009) [2023-12-26 06:09:52,405][123090] Updated weights for policy 1, policy_version 817820 (0.0010) [2023-12-26 06:09:52,482][123091] Updated weights for policy 0, policy_version 823450 (0.0010) [2023-12-26 06:09:52,532][123091] Updated weights for policy 0, policy_version 823460 (0.0008) [2023-12-26 06:09:52,589][123091] Updated weights for policy 0, policy_version 823470 (0.0007) [2023-12-26 06:09:53,248][123090] Updated weights for policy 1, policy_version 817830 (0.0009) [2023-12-26 06:09:53,316][123090] Updated weights for policy 1, policy_version 817840 (0.0009) [2023-12-26 06:09:53,383][123090] Updated weights for policy 1, policy_version 817850 (0.0008) [2023-12-26 06:09:53,401][123091] Updated weights for policy 0, policy_version 823480 (0.0007) [2023-12-26 06:09:53,453][123091] Updated weights for policy 0, policy_version 823490 (0.0008) [2023-12-26 06:09:53,506][123091] Updated weights for policy 0, policy_version 823500 (0.0009) [2023-12-26 06:09:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 420192256. Throughput: 0: 8955.8, 1: 8861.6. Samples: 420168072. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:53,784][121949] Avg episode reward: [(0, '6352.447'), (1, '5122.761')] [2023-12-26 06:09:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000823504_210821120.pth... [2023-12-26 06:09:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000817856_209371136.pth... [2023-12-26 06:09:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000822416_210542592.pth [2023-12-26 06:09:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000816832_209108992.pth [2023-12-26 06:09:54,073][123090] Updated weights for policy 1, policy_version 817860 (0.0007) [2023-12-26 06:09:54,139][123090] Updated weights for policy 1, policy_version 817870 (0.0006) [2023-12-26 06:09:54,207][123090] Updated weights for policy 1, policy_version 817880 (0.0006) [2023-12-26 06:09:54,248][123091] Updated weights for policy 0, policy_version 823510 (0.0007) [2023-12-26 06:09:54,305][123091] Updated weights for policy 0, policy_version 823520 (0.0009) [2023-12-26 06:09:54,369][123091] Updated weights for policy 0, policy_version 823530 (0.0009) [2023-12-26 06:09:54,970][123090] Updated weights for policy 1, policy_version 817890 (0.0008) [2023-12-26 06:09:55,031][123090] Updated weights for policy 1, policy_version 817900 (0.0011) [2023-12-26 06:09:55,087][123090] Updated weights for policy 1, policy_version 817910 (0.0009) [2023-12-26 06:09:55,153][123090] Updated weights for policy 1, policy_version 817920 (0.0007) [2023-12-26 06:09:55,213][123091] Updated weights for policy 0, policy_version 823540 (0.0008) [2023-12-26 06:09:55,281][123091] Updated weights for policy 0, policy_version 823550 (0.0005) [2023-12-26 06:09:55,352][123091] Updated weights for policy 0, policy_version 823560 (0.0005) [2023-12-26 06:09:55,961][123090] Updated weights for policy 1, policy_version 817930 (0.0009) [2023-12-26 06:09:56,014][123090] Updated weights for policy 1, policy_version 817940 (0.0011) [2023-12-26 06:09:56,042][123091] Updated weights for policy 0, policy_version 823570 (0.0006) [2023-12-26 06:09:56,079][123090] Updated weights for policy 1, policy_version 817950 (0.0011) [2023-12-26 06:09:56,091][123091] Updated weights for policy 0, policy_version 823580 (0.0005) [2023-12-26 06:09:56,143][123091] Updated weights for policy 0, policy_version 823590 (0.0005) [2023-12-26 06:09:56,200][123091] Updated weights for policy 0, policy_version 823600 (0.0005) [2023-12-26 06:09:56,881][123091] Updated weights for policy 0, policy_version 823610 (0.0005) [2023-12-26 06:09:56,919][123090] Updated weights for policy 1, policy_version 817960 (0.0011) [2023-12-26 06:09:56,956][123091] Updated weights for policy 0, policy_version 823620 (0.0005) [2023-12-26 06:09:56,979][123090] Updated weights for policy 1, policy_version 817970 (0.0011) [2023-12-26 06:09:57,026][123091] Updated weights for policy 0, policy_version 823630 (0.0005) [2023-12-26 06:09:57,031][123090] Updated weights for policy 1, policy_version 817980 (0.0010) [2023-12-26 06:09:57,772][123090] Updated weights for policy 1, policy_version 817990 (0.0010) [2023-12-26 06:09:57,774][123091] Updated weights for policy 0, policy_version 823640 (0.0009) [2023-12-26 06:09:57,823][123090] Updated weights for policy 1, policy_version 818000 (0.0010) [2023-12-26 06:09:57,825][123091] Updated weights for policy 0, policy_version 823650 (0.0010) [2023-12-26 06:09:57,872][123091] Updated weights for policy 0, policy_version 823660 (0.0010) [2023-12-26 06:09:57,874][123090] Updated weights for policy 1, policy_version 818010 (0.0010) [2023-12-26 06:09:58,665][123090] Updated weights for policy 1, policy_version 818020 (0.0009) [2023-12-26 06:09:58,771][123090] Updated weights for policy 1, policy_version 818030 (0.0007) [2023-12-26 06:09:58,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 420274176. Throughput: 0: 9030.7, 1: 8846.0. Samples: 420276356. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:09:58,785][121949] Avg episode reward: [(0, '6268.049'), (1, '5268.724')] [2023-12-26 06:09:58,824][123091] Updated weights for policy 0, policy_version 823670 (0.0010) [2023-12-26 06:09:58,835][123090] Updated weights for policy 1, policy_version 818040 (0.0009) [2023-12-26 06:09:58,899][123091] Updated weights for policy 0, policy_version 823680 (0.0009) [2023-12-26 06:09:58,962][123091] Updated weights for policy 0, policy_version 823690 (0.0011) [2023-12-26 06:09:59,657][123090] Updated weights for policy 1, policy_version 818050 (0.0008) [2023-12-26 06:09:59,725][123090] Updated weights for policy 1, policy_version 818060 (0.0011) [2023-12-26 06:09:59,786][123090] Updated weights for policy 1, policy_version 818070 (0.0009) [2023-12-26 06:09:59,842][123091] Updated weights for policy 0, policy_version 823700 (0.0008) [2023-12-26 06:09:59,847][123090] Updated weights for policy 1, policy_version 818080 (0.0008) [2023-12-26 06:09:59,909][123091] Updated weights for policy 0, policy_version 823710 (0.0008) [2023-12-26 06:09:59,974][123091] Updated weights for policy 0, policy_version 823720 (0.0010) [2023-12-26 06:10:00,558][123090] Updated weights for policy 1, policy_version 818090 (0.0008) [2023-12-26 06:10:00,589][123091] Updated weights for policy 0, policy_version 823730 (0.0008) [2023-12-26 06:10:00,617][123090] Updated weights for policy 1, policy_version 818100 (0.0010) [2023-12-26 06:10:00,645][123091] Updated weights for policy 0, policy_version 823740 (0.0006) [2023-12-26 06:10:00,665][123090] Updated weights for policy 1, policy_version 818110 (0.0010) [2023-12-26 06:10:00,702][123091] Updated weights for policy 0, policy_version 823750 (0.0007) [2023-12-26 06:10:00,766][123091] Updated weights for policy 0, policy_version 823760 (0.0007) [2023-12-26 06:10:01,511][123090] Updated weights for policy 1, policy_version 818120 (0.0010) [2023-12-26 06:10:01,574][123090] Updated weights for policy 1, policy_version 818130 (0.0011) [2023-12-26 06:10:01,599][123091] Updated weights for policy 0, policy_version 823770 (0.0006) [2023-12-26 06:10:01,629][123090] Updated weights for policy 1, policy_version 818140 (0.0008) [2023-12-26 06:10:01,662][123091] Updated weights for policy 0, policy_version 823780 (0.0009) [2023-12-26 06:10:01,713][123091] Updated weights for policy 0, policy_version 823790 (0.0009) [2023-12-26 06:10:02,439][123091] Updated weights for policy 0, policy_version 823800 (0.0009) [2023-12-26 06:10:02,453][123090] Updated weights for policy 1, policy_version 818150 (0.0007) [2023-12-26 06:10:02,504][123091] Updated weights for policy 0, policy_version 823810 (0.0010) [2023-12-26 06:10:02,517][123090] Updated weights for policy 1, policy_version 818160 (0.0005) [2023-12-26 06:10:02,565][123091] Updated weights for policy 0, policy_version 823820 (0.0008) [2023-12-26 06:10:02,579][123090] Updated weights for policy 1, policy_version 818170 (0.0009) [2023-12-26 06:10:03,381][123090] Updated weights for policy 1, policy_version 818180 (0.0010) [2023-12-26 06:10:03,391][123091] Updated weights for policy 0, policy_version 823830 (0.0009) [2023-12-26 06:10:03,432][123090] Updated weights for policy 1, policy_version 818190 (0.0010) [2023-12-26 06:10:03,439][123091] Updated weights for policy 0, policy_version 823840 (0.0010) [2023-12-26 06:10:03,483][123090] Updated weights for policy 1, policy_version 818200 (0.0010) [2023-12-26 06:10:03,486][123091] Updated weights for policy 0, policy_version 823850 (0.0010) [2023-12-26 06:10:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 420372480. Throughput: 0: 9038.7, 1: 8814.1. Samples: 420380332. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:10:03,785][121949] Avg episode reward: [(0, '6331.257'), (1, '5476.875')] [2023-12-26 06:10:04,294][123091] Updated weights for policy 0, policy_version 823860 (0.0008) [2023-12-26 06:10:04,331][123090] Updated weights for policy 1, policy_version 818210 (0.0010) [2023-12-26 06:10:04,360][123091] Updated weights for policy 0, policy_version 823870 (0.0006) [2023-12-26 06:10:04,398][123090] Updated weights for policy 1, policy_version 818220 (0.0011) [2023-12-26 06:10:04,426][123091] Updated weights for policy 0, policy_version 823880 (0.0010) [2023-12-26 06:10:04,454][123090] Updated weights for policy 1, policy_version 818230 (0.0011) [2023-12-26 06:10:04,522][123090] Updated weights for policy 1, policy_version 818240 (0.0011) [2023-12-26 06:10:05,096][123091] Updated weights for policy 0, policy_version 823890 (0.0008) [2023-12-26 06:10:05,179][123091] Updated weights for policy 0, policy_version 823900 (0.0011) [2023-12-26 06:10:05,217][123090] Updated weights for policy 1, policy_version 818250 (0.0005) [2023-12-26 06:10:05,237][123091] Updated weights for policy 0, policy_version 823910 (0.0010) [2023-12-26 06:10:05,268][123090] Updated weights for policy 1, policy_version 818260 (0.0009) [2023-12-26 06:10:05,298][123091] Updated weights for policy 0, policy_version 823920 (0.0011) [2023-12-26 06:10:05,323][123090] Updated weights for policy 1, policy_version 818270 (0.0006) [2023-12-26 06:10:05,943][123091] Updated weights for policy 0, policy_version 823930 (0.0006) [2023-12-26 06:10:06,011][123091] Updated weights for policy 0, policy_version 823940 (0.0007) [2023-12-26 06:10:06,082][123091] Updated weights for policy 0, policy_version 823950 (0.0006) [2023-12-26 06:10:06,152][123090] Updated weights for policy 1, policy_version 818280 (0.0010) [2023-12-26 06:10:06,221][123090] Updated weights for policy 1, policy_version 818290 (0.0007) [2023-12-26 06:10:06,295][123090] Updated weights for policy 1, policy_version 818300 (0.0006) [2023-12-26 06:10:06,886][123091] Updated weights for policy 0, policy_version 823960 (0.0010) [2023-12-26 06:10:06,946][123091] Updated weights for policy 0, policy_version 823970 (0.0010) [2023-12-26 06:10:07,006][123091] Updated weights for policy 0, policy_version 823980 (0.0010) [2023-12-26 06:10:07,012][123090] Updated weights for policy 1, policy_version 818310 (0.0005) [2023-12-26 06:10:07,076][123090] Updated weights for policy 1, policy_version 818320 (0.0009) [2023-12-26 06:10:07,143][123090] Updated weights for policy 1, policy_version 818330 (0.0010) [2023-12-26 06:10:07,786][123090] Updated weights for policy 1, policy_version 818340 (0.0008) [2023-12-26 06:10:07,860][123090] Updated weights for policy 1, policy_version 818351 (0.0007) [2023-12-26 06:10:07,905][123091] Updated weights for policy 0, policy_version 823990 (0.0008) [2023-12-26 06:10:07,922][123090] Updated weights for policy 1, policy_version 818361 (0.0006) [2023-12-26 06:10:07,963][123091] Updated weights for policy 0, policy_version 824000 (0.0006) [2023-12-26 06:10:08,029][123091] Updated weights for policy 0, policy_version 824010 (0.0005) [2023-12-26 06:10:08,667][123090] Updated weights for policy 1, policy_version 818371 (0.0007) [2023-12-26 06:10:08,718][123090] Updated weights for policy 1, policy_version 818381 (0.0010) [2023-12-26 06:10:08,730][123091] Updated weights for policy 0, policy_version 824020 (0.0007) [2023-12-26 06:10:08,781][123090] Updated weights for policy 1, policy_version 818391 (0.0009) [2023-12-26 06:10:08,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 420454400. Throughput: 0: 9152.5, 1: 8844.1. Samples: 420436420. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:10:08,785][121949] Avg episode reward: [(0, '6107.456'), (1, '5545.658')] [2023-12-26 06:10:08,793][123091] Updated weights for policy 0, policy_version 824030 (0.0008) [2023-12-26 06:10:08,841][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000818400_209510400.pth... [2023-12-26 06:10:08,844][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000817344_209240064.pth [2023-12-26 06:10:08,854][123091] Updated weights for policy 0, policy_version 824040 (0.0008) [2023-12-26 06:10:08,894][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000824048_210960384.pth... [2023-12-26 06:10:08,899][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000822992_210690048.pth [2023-12-26 06:10:09,656][123090] Updated weights for policy 1, policy_version 818401 (0.0009) [2023-12-26 06:10:09,711][123091] Updated weights for policy 0, policy_version 824050 (0.0009) [2023-12-26 06:10:09,721][123090] Updated weights for policy 1, policy_version 818411 (0.0009) [2023-12-26 06:10:09,773][123090] Updated weights for policy 1, policy_version 818421 (0.0008) [2023-12-26 06:10:09,775][123091] Updated weights for policy 0, policy_version 824060 (0.0008) [2023-12-26 06:10:09,831][123090] Updated weights for policy 1, policy_version 818431 (0.0008) [2023-12-26 06:10:09,844][123091] Updated weights for policy 0, policy_version 824070 (0.0009) [2023-12-26 06:10:09,912][123091] Updated weights for policy 0, policy_version 824080 (0.0008) [2023-12-26 06:10:10,691][123090] Updated weights for policy 1, policy_version 818441 (0.0010) [2023-12-26 06:10:10,716][123091] Updated weights for policy 0, policy_version 824090 (0.0007) [2023-12-26 06:10:10,754][123090] Updated weights for policy 1, policy_version 818451 (0.0008) [2023-12-26 06:10:10,782][123091] Updated weights for policy 0, policy_version 824100 (0.0008) [2023-12-26 06:10:10,821][123090] Updated weights for policy 1, policy_version 818461 (0.0009) [2023-12-26 06:10:10,842][123091] Updated weights for policy 0, policy_version 824110 (0.0008) [2023-12-26 06:10:11,685][123090] Updated weights for policy 1, policy_version 818471 (0.0008) [2023-12-26 06:10:11,708][123091] Updated weights for policy 0, policy_version 824120 (0.0009) [2023-12-26 06:10:11,753][123090] Updated weights for policy 1, policy_version 818481 (0.0009) [2023-12-26 06:10:11,778][123091] Updated weights for policy 0, policy_version 824130 (0.0010) [2023-12-26 06:10:11,822][123090] Updated weights for policy 1, policy_version 818491 (0.0006) [2023-12-26 06:10:11,848][123091] Updated weights for policy 0, policy_version 824140 (0.0008) [2023-12-26 06:10:12,573][123090] Updated weights for policy 1, policy_version 818501 (0.0006) [2023-12-26 06:10:12,606][123091] Updated weights for policy 0, policy_version 824150 (0.0008) [2023-12-26 06:10:12,628][123090] Updated weights for policy 1, policy_version 818511 (0.0007) [2023-12-26 06:10:12,661][123091] Updated weights for policy 0, policy_version 824160 (0.0007) [2023-12-26 06:10:12,679][123090] Updated weights for policy 1, policy_version 818521 (0.0009) [2023-12-26 06:10:12,727][123091] Updated weights for policy 0, policy_version 824170 (0.0008) [2023-12-26 06:10:13,447][123090] Updated weights for policy 1, policy_version 818531 (0.0007) [2023-12-26 06:10:13,487][123091] Updated weights for policy 0, policy_version 824180 (0.0009) [2023-12-26 06:10:13,506][123090] Updated weights for policy 1, policy_version 818541 (0.0006) [2023-12-26 06:10:13,541][123091] Updated weights for policy 0, policy_version 824190 (0.0005) [2023-12-26 06:10:13,567][123090] Updated weights for policy 1, policy_version 818551 (0.0009) [2023-12-26 06:10:13,600][123091] Updated weights for policy 0, policy_version 824200 (0.0005) [2023-12-26 06:10:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 420552704. Throughput: 0: 9013.6, 1: 8825.9. Samples: 420540592. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:10:13,785][121949] Avg episode reward: [(0, '5968.345'), (1, '5649.291')] [2023-12-26 06:10:14,317][123090] Updated weights for policy 1, policy_version 818561 (0.0007) [2023-12-26 06:10:14,321][123091] Updated weights for policy 0, policy_version 824210 (0.0007) [2023-12-26 06:10:14,371][123090] Updated weights for policy 1, policy_version 818571 (0.0005) [2023-12-26 06:10:14,391][123091] Updated weights for policy 0, policy_version 824220 (0.0010) [2023-12-26 06:10:14,422][123090] Updated weights for policy 1, policy_version 818581 (0.0006) [2023-12-26 06:10:14,460][123091] Updated weights for policy 0, policy_version 824230 (0.0009) [2023-12-26 06:10:14,470][123090] Updated weights for policy 1, policy_version 818591 (0.0006) [2023-12-26 06:10:14,527][123091] Updated weights for policy 0, policy_version 824240 (0.0009) [2023-12-26 06:10:15,213][123090] Updated weights for policy 1, policy_version 818601 (0.0010) [2023-12-26 06:10:15,273][123090] Updated weights for policy 1, policy_version 818611 (0.0010) [2023-12-26 06:10:15,285][123091] Updated weights for policy 0, policy_version 824250 (0.0008) [2023-12-26 06:10:15,337][123090] Updated weights for policy 1, policy_version 818621 (0.0010) [2023-12-26 06:10:15,340][123091] Updated weights for policy 0, policy_version 824260 (0.0006) [2023-12-26 06:10:15,406][123091] Updated weights for policy 0, policy_version 824270 (0.0005) [2023-12-26 06:10:16,169][123090] Updated weights for policy 1, policy_version 818631 (0.0010) [2023-12-26 06:10:16,227][123090] Updated weights for policy 1, policy_version 818641 (0.0010) [2023-12-26 06:10:16,247][123091] Updated weights for policy 0, policy_version 824280 (0.0008) [2023-12-26 06:10:16,286][123090] Updated weights for policy 1, policy_version 818651 (0.0010) [2023-12-26 06:10:16,302][123091] Updated weights for policy 0, policy_version 824290 (0.0007) [2023-12-26 06:10:16,356][123091] Updated weights for policy 0, policy_version 824300 (0.0009) [2023-12-26 06:10:17,025][123090] Updated weights for policy 1, policy_version 818661 (0.0009) [2023-12-26 06:10:17,075][123090] Updated weights for policy 1, policy_version 818671 (0.0010) [2023-12-26 06:10:17,123][123090] Updated weights for policy 1, policy_version 818681 (0.0010) [2023-12-26 06:10:17,197][123091] Updated weights for policy 0, policy_version 824310 (0.0008) [2023-12-26 06:10:17,252][123091] Updated weights for policy 0, policy_version 824320 (0.0009) [2023-12-26 06:10:17,308][123091] Updated weights for policy 0, policy_version 824330 (0.0009) [2023-12-26 06:10:17,962][123090] Updated weights for policy 1, policy_version 818691 (0.0010) [2023-12-26 06:10:18,014][123090] Updated weights for policy 1, policy_version 818701 (0.0009) [2023-12-26 06:10:18,069][123090] Updated weights for policy 1, policy_version 818711 (0.0007) [2023-12-26 06:10:18,133][123091] Updated weights for policy 0, policy_version 824340 (0.0007) [2023-12-26 06:10:18,205][123091] Updated weights for policy 0, policy_version 824350 (0.0005) [2023-12-26 06:10:18,271][123091] Updated weights for policy 0, policy_version 824360 (0.0006) [2023-12-26 06:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 420634624. Throughput: 0: 8966.7, 1: 8901.8. Samples: 420648604. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:10:18,785][121949] Avg episode reward: [(0, '6031.162'), (1, '5517.404')] [2023-12-26 06:10:18,891][123090] Updated weights for policy 1, policy_version 818721 (0.0011) [2023-12-26 06:10:18,943][123090] Updated weights for policy 1, policy_version 818731 (0.0008) [2023-12-26 06:10:19,013][123090] Updated weights for policy 1, policy_version 818741 (0.0005) [2023-12-26 06:10:19,016][123091] Updated weights for policy 0, policy_version 824370 (0.0010) [2023-12-26 06:10:19,071][123091] Updated weights for policy 0, policy_version 824380 (0.0008) [2023-12-26 06:10:19,084][123090] Updated weights for policy 1, policy_version 818751 (0.0005) [2023-12-26 06:10:19,122][123091] Updated weights for policy 0, policy_version 824390 (0.0009) [2023-12-26 06:10:19,188][123091] Updated weights for policy 0, policy_version 824400 (0.0010) [2023-12-26 06:10:19,882][123090] Updated weights for policy 1, policy_version 818761 (0.0010) [2023-12-26 06:10:19,935][123090] Updated weights for policy 1, policy_version 818771 (0.0010) [2023-12-26 06:10:20,002][123090] Updated weights for policy 1, policy_version 818781 (0.0011) [2023-12-26 06:10:20,119][123091] Updated weights for policy 0, policy_version 824410 (0.0006) [2023-12-26 06:10:20,173][123091] Updated weights for policy 0, policy_version 824420 (0.0009) [2023-12-26 06:10:20,227][123091] Updated weights for policy 0, policy_version 824430 (0.0009) [2023-12-26 06:10:20,870][123090] Updated weights for policy 1, policy_version 818791 (0.0011) [2023-12-26 06:10:20,939][123090] Updated weights for policy 1, policy_version 818801 (0.0011) [2023-12-26 06:10:21,004][123090] Updated weights for policy 1, policy_version 818811 (0.0011) [2023-12-26 06:10:21,055][123091] Updated weights for policy 0, policy_version 824440 (0.0009) [2023-12-26 06:10:21,126][123091] Updated weights for policy 0, policy_version 824450 (0.0008) [2023-12-26 06:10:21,182][123091] Updated weights for policy 0, policy_version 824460 (0.0009) [2023-12-26 06:10:21,824][123090] Updated weights for policy 1, policy_version 818821 (0.0009) [2023-12-26 06:10:21,892][123090] Updated weights for policy 1, policy_version 818831 (0.0006) [2023-12-26 06:10:21,960][123090] Updated weights for policy 1, policy_version 818841 (0.0010) [2023-12-26 06:10:22,004][123091] Updated weights for policy 0, policy_version 824470 (0.0010) [2023-12-26 06:10:22,069][123091] Updated weights for policy 0, policy_version 824480 (0.0011) [2023-12-26 06:10:22,137][123091] Updated weights for policy 0, policy_version 824490 (0.0011) [2023-12-26 06:10:22,712][123090] Updated weights for policy 1, policy_version 818851 (0.0009) [2023-12-26 06:10:22,778][123090] Updated weights for policy 1, policy_version 818861 (0.0007) [2023-12-26 06:10:22,839][123090] Updated weights for policy 1, policy_version 818871 (0.0008) [2023-12-26 06:10:22,948][123091] Updated weights for policy 0, policy_version 824500 (0.0011) [2023-12-26 06:10:23,013][123091] Updated weights for policy 0, policy_version 824510 (0.0011) [2023-12-26 06:10:23,084][123091] Updated weights for policy 0, policy_version 824520 (0.0011) [2023-12-26 06:10:23,641][123090] Updated weights for policy 1, policy_version 818881 (0.0006) [2023-12-26 06:10:23,719][123090] Updated weights for policy 1, policy_version 818891 (0.0005) [2023-12-26 06:10:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 420716544. Throughput: 0: 8896.2, 1: 8870.7. Samples: 420699456. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 06:10:23,785][121949] Avg episode reward: [(0, '6078.069'), (1, '5286.989')] [2023-12-26 06:10:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000824528_211083264.pth... [2023-12-26 06:10:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000823504_210821120.pth [2023-12-26 06:10:23,798][123090] Updated weights for policy 1, policy_version 818901 (0.0005) [2023-12-26 06:10:23,871][123090] Updated weights for policy 1, policy_version 818911 (0.0006) [2023-12-26 06:10:23,876][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000818912_209641472.pth... [2023-12-26 06:10:23,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000817856_209371136.pth [2023-12-26 06:10:23,881][123091] Updated weights for policy 0, policy_version 824530 (0.0011) [2023-12-26 06:10:23,942][123091] Updated weights for policy 0, policy_version 824540 (0.0008) [2023-12-26 06:10:24,000][123091] Updated weights for policy 0, policy_version 824550 (0.0009) [2023-12-26 06:10:24,048][123091] Updated weights for policy 0, policy_version 824560 (0.0006) [2023-12-26 06:10:24,559][123090] Updated weights for policy 1, policy_version 818921 (0.0006) [2023-12-26 06:10:24,619][123090] Updated weights for policy 1, policy_version 818931 (0.0005) [2023-12-26 06:10:24,666][123090] Updated weights for policy 1, policy_version 818941 (0.0009) [2023-12-26 06:10:24,851][123091] Updated weights for policy 0, policy_version 824570 (0.0009) [2023-12-26 06:10:24,919][123091] Updated weights for policy 0, policy_version 824580 (0.0008) [2023-12-26 06:10:24,981][123091] Updated weights for policy 0, policy_version 824590 (0.0009) [2023-12-26 06:10:25,459][123090] Updated weights for policy 1, policy_version 818951 (0.0010) [2023-12-26 06:10:25,506][123090] Updated weights for policy 1, policy_version 818961 (0.0010) [2023-12-26 06:10:25,550][123090] Updated weights for policy 1, policy_version 818971 (0.0010) [2023-12-26 06:10:25,723][123091] Updated weights for policy 0, policy_version 824600 (0.0005) [2023-12-26 06:10:25,789][123091] Updated weights for policy 0, policy_version 824610 (0.0005) [2023-12-26 06:10:25,866][123091] Updated weights for policy 0, policy_version 824620 (0.0005) [2023-12-26 06:10:26,318][123090] Updated weights for policy 1, policy_version 818981 (0.0010) [2023-12-26 06:10:26,375][123090] Updated weights for policy 1, policy_version 818991 (0.0009) [2023-12-26 06:10:26,407][123091] Updated weights for policy 0, policy_version 824630 (0.0008) [2023-12-26 06:10:26,439][123090] Updated weights for policy 1, policy_version 819001 (0.0005) [2023-12-26 06:10:26,466][123091] Updated weights for policy 0, policy_version 824640 (0.0011) [2023-12-26 06:10:26,526][123091] Updated weights for policy 0, policy_version 824650 (0.0011) [2023-12-26 06:10:27,277][123091] Updated weights for policy 0, policy_version 824660 (0.0009) [2023-12-26 06:10:27,330][123090] Updated weights for policy 1, policy_version 819011 (0.0007) [2023-12-26 06:10:27,335][123091] Updated weights for policy 0, policy_version 824670 (0.0007) [2023-12-26 06:10:27,385][123090] Updated weights for policy 1, policy_version 819021 (0.0006) [2023-12-26 06:10:27,386][123091] Updated weights for policy 0, policy_version 824680 (0.0009) [2023-12-26 06:10:27,435][123090] Updated weights for policy 1, policy_version 819031 (0.0006) [2023-12-26 06:10:28,204][123091] Updated weights for policy 0, policy_version 824690 (0.0010) [2023-12-26 06:10:28,247][123091] Updated weights for policy 0, policy_version 824700 (0.0010) [2023-12-26 06:10:28,283][123090] Updated weights for policy 1, policy_version 819041 (0.0008) [2023-12-26 06:10:28,291][123091] Updated weights for policy 0, policy_version 824710 (0.0010) [2023-12-26 06:10:28,331][123090] Updated weights for policy 1, policy_version 819051 (0.0010) [2023-12-26 06:10:28,354][123091] Updated weights for policy 0, policy_version 824720 (0.0010) [2023-12-26 06:10:28,391][123090] Updated weights for policy 1, policy_version 819061 (0.0010) [2023-12-26 06:10:28,448][123090] Updated weights for policy 1, policy_version 819072 (0.0010) [2023-12-26 06:10:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 420814848. Throughput: 0: 8961.9, 1: 8892.0. Samples: 420808760. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:28,785][121949] Avg episode reward: [(0, '6235.314'), (1, '5417.111')] [2023-12-26 06:10:29,136][123091] Updated weights for policy 0, policy_version 824730 (0.0006) [2023-12-26 06:10:29,184][123090] Updated weights for policy 1, policy_version 819082 (0.0011) [2023-12-26 06:10:29,195][123091] Updated weights for policy 0, policy_version 824740 (0.0005) [2023-12-26 06:10:29,259][123090] Updated weights for policy 1, policy_version 819093 (0.0009) [2023-12-26 06:10:29,267][123091] Updated weights for policy 0, policy_version 824750 (0.0007) [2023-12-26 06:10:29,319][123090] Updated weights for policy 1, policy_version 819103 (0.0008) [2023-12-26 06:10:30,092][123090] Updated weights for policy 1, policy_version 819113 (0.0007) [2023-12-26 06:10:30,101][123091] Updated weights for policy 0, policy_version 824760 (0.0008) [2023-12-26 06:10:30,152][123090] Updated weights for policy 1, policy_version 819123 (0.0006) [2023-12-26 06:10:30,169][123091] Updated weights for policy 0, policy_version 824770 (0.0008) [2023-12-26 06:10:30,208][123090] Updated weights for policy 1, policy_version 819133 (0.0005) [2023-12-26 06:10:30,236][123091] Updated weights for policy 0, policy_version 824781 (0.0009) [2023-12-26 06:10:30,870][123090] Updated weights for policy 1, policy_version 819143 (0.0005) [2023-12-26 06:10:30,915][123090] Updated weights for policy 1, policy_version 819153 (0.0005) [2023-12-26 06:10:30,963][123090] Updated weights for policy 1, policy_version 819163 (0.0008) [2023-12-26 06:10:31,131][123091] Updated weights for policy 0, policy_version 824791 (0.0010) [2023-12-26 06:10:31,196][123091] Updated weights for policy 0, policy_version 824801 (0.0010) [2023-12-26 06:10:31,260][123091] Updated weights for policy 0, policy_version 824811 (0.0009) [2023-12-26 06:10:31,780][123090] Updated weights for policy 1, policy_version 819173 (0.0009) [2023-12-26 06:10:31,849][123090] Updated weights for policy 1, policy_version 819183 (0.0006) [2023-12-26 06:10:31,921][123090] Updated weights for policy 1, policy_version 819193 (0.0005) [2023-12-26 06:10:32,128][123091] Updated weights for policy 0, policy_version 824821 (0.0010) [2023-12-26 06:10:32,182][123091] Updated weights for policy 0, policy_version 824831 (0.0010) [2023-12-26 06:10:32,235][123091] Updated weights for policy 0, policy_version 824842 (0.0010) [2023-12-26 06:10:32,578][123090] Updated weights for policy 1, policy_version 819203 (0.0007) [2023-12-26 06:10:32,632][123090] Updated weights for policy 1, policy_version 819213 (0.0009) [2023-12-26 06:10:32,692][123090] Updated weights for policy 1, policy_version 819223 (0.0010) [2023-12-26 06:10:33,165][123091] Updated weights for policy 0, policy_version 824852 (0.0009) [2023-12-26 06:10:33,217][123091] Updated weights for policy 0, policy_version 824863 (0.0010) [2023-12-26 06:10:33,276][123091] Updated weights for policy 0, policy_version 824873 (0.0009) [2023-12-26 06:10:33,379][123090] Updated weights for policy 1, policy_version 819233 (0.0009) [2023-12-26 06:10:33,428][123090] Updated weights for policy 1, policy_version 819243 (0.0005) [2023-12-26 06:10:33,490][123090] Updated weights for policy 1, policy_version 819253 (0.0005) [2023-12-26 06:10:33,542][123090] Updated weights for policy 1, policy_version 819263 (0.0005) [2023-12-26 06:10:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 420904960. Throughput: 0: 8871.9, 1: 8967.6. Samples: 420915984. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:33,785][121949] Avg episode reward: [(0, '6364.078'), (1, '5386.612')] [2023-12-26 06:10:34,178][123091] Updated weights for policy 0, policy_version 824883 (0.0009) [2023-12-26 06:10:34,238][123091] Updated weights for policy 0, policy_version 824893 (0.0009) [2023-12-26 06:10:34,290][123090] Updated weights for policy 1, policy_version 819273 (0.0009) [2023-12-26 06:10:34,315][123091] Updated weights for policy 0, policy_version 824903 (0.0009) [2023-12-26 06:10:34,347][123090] Updated weights for policy 1, policy_version 819283 (0.0011) [2023-12-26 06:10:34,404][123090] Updated weights for policy 1, policy_version 819293 (0.0011) [2023-12-26 06:10:35,148][123091] Updated weights for policy 0, policy_version 824913 (0.0008) [2023-12-26 06:10:35,213][123091] Updated weights for policy 0, policy_version 824923 (0.0009) [2023-12-26 06:10:35,232][123090] Updated weights for policy 1, policy_version 819303 (0.0009) [2023-12-26 06:10:35,270][123091] Updated weights for policy 0, policy_version 824933 (0.0006) [2023-12-26 06:10:35,295][123090] Updated weights for policy 1, policy_version 819313 (0.0009) [2023-12-26 06:10:35,332][123091] Updated weights for policy 0, policy_version 824943 (0.0008) [2023-12-26 06:10:35,356][123090] Updated weights for policy 1, policy_version 819323 (0.0010) [2023-12-26 06:10:36,144][123091] Updated weights for policy 0, policy_version 824953 (0.0008) [2023-12-26 06:10:36,150][123090] Updated weights for policy 1, policy_version 819333 (0.0008) [2023-12-26 06:10:36,214][123091] Updated weights for policy 0, policy_version 824963 (0.0008) [2023-12-26 06:10:36,214][123090] Updated weights for policy 1, policy_version 819343 (0.0008) [2023-12-26 06:10:36,278][123090] Updated weights for policy 1, policy_version 819353 (0.0008) [2023-12-26 06:10:36,278][123091] Updated weights for policy 0, policy_version 824973 (0.0009) [2023-12-26 06:10:37,019][123090] Updated weights for policy 1, policy_version 819363 (0.0007) [2023-12-26 06:10:37,074][123090] Updated weights for policy 1, policy_version 819373 (0.0008) [2023-12-26 06:10:37,139][123090] Updated weights for policy 1, policy_version 819383 (0.0007) [2023-12-26 06:10:37,148][123091] Updated weights for policy 0, policy_version 824983 (0.0009) [2023-12-26 06:10:37,214][123091] Updated weights for policy 0, policy_version 824993 (0.0008) [2023-12-26 06:10:37,278][123091] Updated weights for policy 0, policy_version 825003 (0.0010) [2023-12-26 06:10:37,921][123090] Updated weights for policy 1, policy_version 819393 (0.0009) [2023-12-26 06:10:37,977][123090] Updated weights for policy 1, policy_version 819403 (0.0009) [2023-12-26 06:10:38,036][123090] Updated weights for policy 1, policy_version 819413 (0.0009) [2023-12-26 06:10:38,097][123091] Updated weights for policy 0, policy_version 825013 (0.0010) [2023-12-26 06:10:38,099][123090] Updated weights for policy 1, policy_version 819423 (0.0008) [2023-12-26 06:10:38,164][123091] Updated weights for policy 0, policy_version 825023 (0.0009) [2023-12-26 06:10:38,211][123091] Updated weights for policy 0, policy_version 825033 (0.0009) [2023-12-26 06:10:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 420986880. Throughput: 0: 8802.0, 1: 8960.7. Samples: 420967396. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:38,785][121949] Avg episode reward: [(0, '6381.661'), (1, '5108.329')] [2023-12-26 06:10:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000825040_211214336.pth... [2023-12-26 06:10:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000819424_209772544.pth... [2023-12-26 06:10:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000824048_210960384.pth [2023-12-26 06:10:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000818400_209510400.pth [2023-12-26 06:10:38,942][123090] Updated weights for policy 1, policy_version 819433 (0.0010) [2023-12-26 06:10:39,005][123090] Updated weights for policy 1, policy_version 819443 (0.0009) [2023-12-26 06:10:39,045][123091] Updated weights for policy 0, policy_version 825043 (0.0008) [2023-12-26 06:10:39,064][123090] Updated weights for policy 1, policy_version 819453 (0.0009) [2023-12-26 06:10:39,100][123091] Updated weights for policy 0, policy_version 825053 (0.0008) [2023-12-26 06:10:39,156][123091] Updated weights for policy 0, policy_version 825063 (0.0009) [2023-12-26 06:10:39,925][123090] Updated weights for policy 1, policy_version 819463 (0.0009) [2023-12-26 06:10:39,995][123090] Updated weights for policy 1, policy_version 819473 (0.0009) [2023-12-26 06:10:40,027][123091] Updated weights for policy 0, policy_version 825073 (0.0009) [2023-12-26 06:10:40,060][123090] Updated weights for policy 1, policy_version 819483 (0.0009) [2023-12-26 06:10:40,094][123091] Updated weights for policy 0, policy_version 825083 (0.0008) [2023-12-26 06:10:40,142][123091] Updated weights for policy 0, policy_version 825093 (0.0009) [2023-12-26 06:10:40,203][123091] Updated weights for policy 0, policy_version 825103 (0.0010) [2023-12-26 06:10:40,890][123090] Updated weights for policy 1, policy_version 819493 (0.0009) [2023-12-26 06:10:40,938][123090] Updated weights for policy 1, policy_version 819503 (0.0009) [2023-12-26 06:10:40,998][123090] Updated weights for policy 1, policy_version 819513 (0.0009) [2023-12-26 06:10:41,066][123091] Updated weights for policy 0, policy_version 825113 (0.0007) [2023-12-26 06:10:41,122][123091] Updated weights for policy 0, policy_version 825123 (0.0006) [2023-12-26 06:10:41,190][123091] Updated weights for policy 0, policy_version 825133 (0.0008) [2023-12-26 06:10:41,932][123090] Updated weights for policy 1, policy_version 819523 (0.0009) [2023-12-26 06:10:41,992][123091] Updated weights for policy 0, policy_version 825143 (0.0007) [2023-12-26 06:10:41,995][123090] Updated weights for policy 1, policy_version 819533 (0.0009) [2023-12-26 06:10:42,056][123091] Updated weights for policy 0, policy_version 825153 (0.0007) [2023-12-26 06:10:42,062][123090] Updated weights for policy 1, policy_version 819543 (0.0009) [2023-12-26 06:10:42,118][123091] Updated weights for policy 0, policy_version 825163 (0.0007) [2023-12-26 06:10:42,871][123090] Updated weights for policy 1, policy_version 819553 (0.0010) [2023-12-26 06:10:42,936][123090] Updated weights for policy 1, policy_version 819563 (0.0010) [2023-12-26 06:10:42,978][123091] Updated weights for policy 0, policy_version 825173 (0.0010) [2023-12-26 06:10:43,000][123090] Updated weights for policy 1, policy_version 819573 (0.0008) [2023-12-26 06:10:43,033][123091] Updated weights for policy 0, policy_version 825183 (0.0009) [2023-12-26 06:10:43,066][123090] Updated weights for policy 1, policy_version 819583 (0.0009) [2023-12-26 06:10:43,095][123091] Updated weights for policy 0, policy_version 825193 (0.0010) [2023-12-26 06:10:43,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 421068800. Throughput: 0: 8704.7, 1: 8890.3. Samples: 421068132. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:43,785][121949] Avg episode reward: [(0, '6335.781'), (1, '5231.827')] [2023-12-26 06:10:43,830][123091] Updated weights for policy 0, policy_version 825204 (0.0008) [2023-12-26 06:10:43,887][123090] Updated weights for policy 1, policy_version 819593 (0.0006) [2023-12-26 06:10:43,896][123091] Updated weights for policy 0, policy_version 825214 (0.0005) [2023-12-26 06:10:43,955][123090] Updated weights for policy 1, policy_version 819603 (0.0005) [2023-12-26 06:10:43,957][123091] Updated weights for policy 0, policy_version 825224 (0.0006) [2023-12-26 06:10:44,008][123090] Updated weights for policy 1, policy_version 819613 (0.0006) [2023-12-26 06:10:44,578][123091] Updated weights for policy 0, policy_version 825234 (0.0006) [2023-12-26 06:10:44,639][123091] Updated weights for policy 0, policy_version 825244 (0.0005) [2023-12-26 06:10:44,703][123091] Updated weights for policy 0, policy_version 825254 (0.0005) [2023-12-26 06:10:44,756][123090] Updated weights for policy 1, policy_version 819623 (0.0008) [2023-12-26 06:10:44,770][123091] Updated weights for policy 0, policy_version 825264 (0.0007) [2023-12-26 06:10:44,828][123090] Updated weights for policy 1, policy_version 819633 (0.0007) [2023-12-26 06:10:44,899][123090] Updated weights for policy 1, policy_version 819643 (0.0007) [2023-12-26 06:10:45,458][123091] Updated weights for policy 0, policy_version 825274 (0.0008) [2023-12-26 06:10:45,524][123091] Updated weights for policy 0, policy_version 825284 (0.0008) [2023-12-26 06:10:45,594][123091] Updated weights for policy 0, policy_version 825294 (0.0007) [2023-12-26 06:10:45,728][123090] Updated weights for policy 1, policy_version 819653 (0.0010) [2023-12-26 06:10:45,782][123090] Updated weights for policy 1, policy_version 819664 (0.0010) [2023-12-26 06:10:45,834][123090] Updated weights for policy 1, policy_version 819675 (0.0009) [2023-12-26 06:10:46,195][123091] Updated weights for policy 0, policy_version 825304 (0.0006) [2023-12-26 06:10:46,256][123091] Updated weights for policy 0, policy_version 825314 (0.0005) [2023-12-26 06:10:46,307][123091] Updated weights for policy 0, policy_version 825324 (0.0006) [2023-12-26 06:10:46,649][123090] Updated weights for policy 1, policy_version 819685 (0.0007) [2023-12-26 06:10:46,708][123090] Updated weights for policy 1, policy_version 819695 (0.0010) [2023-12-26 06:10:46,762][123090] Updated weights for policy 1, policy_version 819705 (0.0010) [2023-12-26 06:10:46,943][123091] Updated weights for policy 0, policy_version 825334 (0.0007) [2023-12-26 06:10:47,004][123091] Updated weights for policy 0, policy_version 825344 (0.0010) [2023-12-26 06:10:47,064][123091] Updated weights for policy 0, policy_version 825354 (0.0011) [2023-12-26 06:10:47,685][123090] Updated weights for policy 1, policy_version 819716 (0.0010) [2023-12-26 06:10:47,738][123090] Updated weights for policy 1, policy_version 819726 (0.0009) [2023-12-26 06:10:47,760][123091] Updated weights for policy 0, policy_version 825364 (0.0008) [2023-12-26 06:10:47,795][123090] Updated weights for policy 1, policy_version 819736 (0.0008) [2023-12-26 06:10:47,814][123091] Updated weights for policy 0, policy_version 825374 (0.0006) [2023-12-26 06:10:47,868][123091] Updated weights for policy 0, policy_version 825384 (0.0005) [2023-12-26 06:10:48,553][123091] Updated weights for policy 0, policy_version 825394 (0.0005) [2023-12-26 06:10:48,618][123091] Updated weights for policy 0, policy_version 825404 (0.0007) [2023-12-26 06:10:48,680][123091] Updated weights for policy 0, policy_version 825414 (0.0009) [2023-12-26 06:10:48,745][123091] Updated weights for policy 0, policy_version 825424 (0.0005) [2023-12-26 06:10:48,745][123090] Updated weights for policy 1, policy_version 819746 (0.0009) [2023-12-26 06:10:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 421167104. Throughput: 0: 8891.8, 1: 8847.7. Samples: 421178612. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:48,785][121949] Avg episode reward: [(0, '6229.463'), (1, '5395.490')] [2023-12-26 06:10:48,808][123090] Updated weights for policy 1, policy_version 819757 (0.0010) [2023-12-26 06:10:48,868][123090] Updated weights for policy 1, policy_version 819767 (0.0010) [2023-12-26 06:10:49,420][123091] Updated weights for policy 0, policy_version 825434 (0.0009) [2023-12-26 06:10:49,491][123091] Updated weights for policy 0, policy_version 825444 (0.0006) [2023-12-26 06:10:49,554][123091] Updated weights for policy 0, policy_version 825454 (0.0006) [2023-12-26 06:10:49,815][123090] Updated weights for policy 1, policy_version 819777 (0.0010) [2023-12-26 06:10:49,892][123090] Updated weights for policy 1, policy_version 819787 (0.0010) [2023-12-26 06:10:49,965][123090] Updated weights for policy 1, policy_version 819797 (0.0010) [2023-12-26 06:10:50,031][123090] Updated weights for policy 1, policy_version 819807 (0.0009) [2023-12-26 06:10:50,275][123091] Updated weights for policy 0, policy_version 825464 (0.0008) [2023-12-26 06:10:50,341][123091] Updated weights for policy 0, policy_version 825474 (0.0009) [2023-12-26 06:10:50,392][123091] Updated weights for policy 0, policy_version 825484 (0.0010) [2023-12-26 06:10:50,848][123090] Updated weights for policy 1, policy_version 819817 (0.0006) [2023-12-26 06:10:50,920][123090] Updated weights for policy 1, policy_version 819827 (0.0006) [2023-12-26 06:10:50,982][123090] Updated weights for policy 1, policy_version 819837 (0.0005) [2023-12-26 06:10:51,217][123091] Updated weights for policy 0, policy_version 825494 (0.0009) [2023-12-26 06:10:51,284][123091] Updated weights for policy 0, policy_version 825505 (0.0010) [2023-12-26 06:10:51,354][123091] Updated weights for policy 0, policy_version 825515 (0.0009) [2023-12-26 06:10:51,686][123090] Updated weights for policy 1, policy_version 819847 (0.0008) [2023-12-26 06:10:51,752][123090] Updated weights for policy 1, policy_version 819857 (0.0009) [2023-12-26 06:10:51,818][123090] Updated weights for policy 1, policy_version 819867 (0.0010) [2023-12-26 06:10:52,138][123091] Updated weights for policy 0, policy_version 825525 (0.0008) [2023-12-26 06:10:52,194][123091] Updated weights for policy 0, policy_version 825535 (0.0009) [2023-12-26 06:10:52,258][123091] Updated weights for policy 0, policy_version 825545 (0.0009) [2023-12-26 06:10:52,674][123090] Updated weights for policy 1, policy_version 819877 (0.0010) [2023-12-26 06:10:52,741][123090] Updated weights for policy 1, policy_version 819887 (0.0010) [2023-12-26 06:10:52,804][123090] Updated weights for policy 1, policy_version 819897 (0.0010) [2023-12-26 06:10:53,067][123091] Updated weights for policy 0, policy_version 825555 (0.0009) [2023-12-26 06:10:53,117][123091] Updated weights for policy 0, policy_version 825565 (0.0008) [2023-12-26 06:10:53,172][123091] Updated weights for policy 0, policy_version 825575 (0.0005) [2023-12-26 06:10:53,582][123090] Updated weights for policy 1, policy_version 819907 (0.0009) [2023-12-26 06:10:53,629][123090] Updated weights for policy 1, policy_version 819917 (0.0005) [2023-12-26 06:10:53,690][123090] Updated weights for policy 1, policy_version 819927 (0.0005) [2023-12-26 06:10:53,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 421257216. Throughput: 0: 8852.4, 1: 8813.6. Samples: 421231388. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:53,784][121949] Avg episode reward: [(0, '6146.764'), (1, '5343.855')] [2023-12-26 06:10:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000825584_211353600.pth... [2023-12-26 06:10:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000819936_209903616.pth... [2023-12-26 06:10:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000824528_211083264.pth [2023-12-26 06:10:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000818912_209641472.pth [2023-12-26 06:10:53,880][123091] Updated weights for policy 0, policy_version 825585 (0.0007) [2023-12-26 06:10:53,938][123091] Updated weights for policy 0, policy_version 825595 (0.0005) [2023-12-26 06:10:53,990][123091] Updated weights for policy 0, policy_version 825605 (0.0006) [2023-12-26 06:10:54,043][123091] Updated weights for policy 0, policy_version 825615 (0.0009) [2023-12-26 06:10:54,371][123090] Updated weights for policy 1, policy_version 819937 (0.0005) [2023-12-26 06:10:54,442][123090] Updated weights for policy 1, policy_version 819947 (0.0006) [2023-12-26 06:10:54,510][123090] Updated weights for policy 1, policy_version 819957 (0.0005) [2023-12-26 06:10:54,571][123090] Updated weights for policy 1, policy_version 819967 (0.0005) [2023-12-26 06:10:54,880][123091] Updated weights for policy 0, policy_version 825625 (0.0006) [2023-12-26 06:10:54,929][123091] Updated weights for policy 0, policy_version 825635 (0.0006) [2023-12-26 06:10:54,981][123091] Updated weights for policy 0, policy_version 825645 (0.0011) [2023-12-26 06:10:55,338][123090] Updated weights for policy 1, policy_version 819977 (0.0005) [2023-12-26 06:10:55,408][123090] Updated weights for policy 1, policy_version 819987 (0.0009) [2023-12-26 06:10:55,471][123090] Updated weights for policy 1, policy_version 819997 (0.0010) [2023-12-26 06:10:55,708][123091] Updated weights for policy 0, policy_version 825655 (0.0007) [2023-12-26 06:10:55,777][123091] Updated weights for policy 0, policy_version 825665 (0.0005) [2023-12-26 06:10:55,822][123091] Updated weights for policy 0, policy_version 825675 (0.0005) [2023-12-26 06:10:56,172][123090] Updated weights for policy 1, policy_version 820007 (0.0007) [2023-12-26 06:10:56,229][123090] Updated weights for policy 1, policy_version 820017 (0.0005) [2023-12-26 06:10:56,286][123090] Updated weights for policy 1, policy_version 820027 (0.0005) [2023-12-26 06:10:56,570][123091] Updated weights for policy 0, policy_version 825685 (0.0005) [2023-12-26 06:10:56,615][123091] Updated weights for policy 0, policy_version 825695 (0.0005) [2023-12-26 06:10:56,660][123091] Updated weights for policy 0, policy_version 825705 (0.0005) [2023-12-26 06:10:56,973][123090] Updated weights for policy 1, policy_version 820037 (0.0005) [2023-12-26 06:10:57,021][123090] Updated weights for policy 1, policy_version 820047 (0.0005) [2023-12-26 06:10:57,078][123090] Updated weights for policy 1, policy_version 820057 (0.0005) [2023-12-26 06:10:57,327][123091] Updated weights for policy 0, policy_version 825715 (0.0009) [2023-12-26 06:10:57,380][123091] Updated weights for policy 0, policy_version 825725 (0.0006) [2023-12-26 06:10:57,431][123091] Updated weights for policy 0, policy_version 825735 (0.0006) [2023-12-26 06:10:57,715][123090] Updated weights for policy 1, policy_version 820067 (0.0005) [2023-12-26 06:10:57,769][123090] Updated weights for policy 1, policy_version 820077 (0.0005) [2023-12-26 06:10:57,816][123090] Updated weights for policy 1, policy_version 820087 (0.0005) [2023-12-26 06:10:58,143][123091] Updated weights for policy 0, policy_version 825745 (0.0008) [2023-12-26 06:10:58,213][123091] Updated weights for policy 0, policy_version 825755 (0.0006) [2023-12-26 06:10:58,287][123091] Updated weights for policy 0, policy_version 825765 (0.0010) [2023-12-26 06:10:58,350][123091] Updated weights for policy 0, policy_version 825775 (0.0011) [2023-12-26 06:10:58,571][123090] Updated weights for policy 1, policy_version 820097 (0.0005) [2023-12-26 06:10:58,642][123090] Updated weights for policy 1, policy_version 820107 (0.0008) [2023-12-26 06:10:58,715][123090] Updated weights for policy 1, policy_version 820117 (0.0008) [2023-12-26 06:10:58,787][121949] Fps is (10 sec: 18017.3, 60 sec: 17885.1, 300 sec: 17800.1). Total num frames: 421347328. Throughput: 0: 8989.8, 1: 8897.1. Samples: 421345556. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:10:58,787][121949] Avg episode reward: [(0, '6220.262'), (1, '5548.770')] [2023-12-26 06:10:58,795][123090] Updated weights for policy 1, policy_version 820127 (0.0007) [2023-12-26 06:10:59,254][123091] Updated weights for policy 0, policy_version 825785 (0.0009) [2023-12-26 06:10:59,325][123091] Updated weights for policy 0, policy_version 825795 (0.0008) [2023-12-26 06:10:59,394][123091] Updated weights for policy 0, policy_version 825805 (0.0008) [2023-12-26 06:10:59,632][123090] Updated weights for policy 1, policy_version 820137 (0.0006) [2023-12-26 06:10:59,682][123090] Updated weights for policy 1, policy_version 820147 (0.0005) [2023-12-26 06:10:59,740][123090] Updated weights for policy 1, policy_version 820157 (0.0007) [2023-12-26 06:11:00,208][123091] Updated weights for policy 0, policy_version 825815 (0.0009) [2023-12-26 06:11:00,267][123091] Updated weights for policy 0, policy_version 825825 (0.0009) [2023-12-26 06:11:00,319][123091] Updated weights for policy 0, policy_version 825835 (0.0009) [2023-12-26 06:11:00,505][123090] Updated weights for policy 1, policy_version 820167 (0.0010) [2023-12-26 06:11:00,560][123090] Updated weights for policy 1, policy_version 820177 (0.0010) [2023-12-26 06:11:00,626][123090] Updated weights for policy 1, policy_version 820187 (0.0010) [2023-12-26 06:11:01,160][123091] Updated weights for policy 0, policy_version 825846 (0.0010) [2023-12-26 06:11:01,213][123091] Updated weights for policy 0, policy_version 825856 (0.0009) [2023-12-26 06:11:01,275][123091] Updated weights for policy 0, policy_version 825866 (0.0009) [2023-12-26 06:11:01,376][123090] Updated weights for policy 1, policy_version 820197 (0.0010) [2023-12-26 06:11:01,430][123090] Updated weights for policy 1, policy_version 820207 (0.0006) [2023-12-26 06:11:01,484][123090] Updated weights for policy 1, policy_version 820217 (0.0005) [2023-12-26 06:11:02,176][123091] Updated weights for policy 0, policy_version 825876 (0.0010) [2023-12-26 06:11:02,223][123091] Updated weights for policy 0, policy_version 825886 (0.0009) [2023-12-26 06:11:02,266][123090] Updated weights for policy 1, policy_version 820227 (0.0010) [2023-12-26 06:11:02,287][123091] Updated weights for policy 0, policy_version 825896 (0.0009) [2023-12-26 06:11:02,322][123090] Updated weights for policy 1, policy_version 820237 (0.0009) [2023-12-26 06:11:02,388][123090] Updated weights for policy 1, policy_version 820247 (0.0009) [2023-12-26 06:11:02,976][123091] Updated weights for policy 0, policy_version 825906 (0.0009) [2023-12-26 06:11:03,039][123091] Updated weights for policy 0, policy_version 825916 (0.0008) [2023-12-26 06:11:03,095][123091] Updated weights for policy 0, policy_version 825926 (0.0005) [2023-12-26 06:11:03,147][123091] Updated weights for policy 0, policy_version 825936 (0.0005) [2023-12-26 06:11:03,250][123090] Updated weights for policy 1, policy_version 820257 (0.0009) [2023-12-26 06:11:03,312][123090] Updated weights for policy 1, policy_version 820267 (0.0009) [2023-12-26 06:11:03,378][123090] Updated weights for policy 1, policy_version 820277 (0.0010) [2023-12-26 06:11:03,448][123090] Updated weights for policy 1, policy_version 820287 (0.0008) [2023-12-26 06:11:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 421437440. Throughput: 0: 8945.0, 1: 8866.7. Samples: 421450136. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:03,785][121949] Avg episode reward: [(0, '6174.826'), (1, '5837.002')] [2023-12-26 06:11:03,952][123091] Updated weights for policy 0, policy_version 825946 (0.0011) [2023-12-26 06:11:04,013][123091] Updated weights for policy 0, policy_version 825956 (0.0011) [2023-12-26 06:11:04,071][123091] Updated weights for policy 0, policy_version 825966 (0.0009) [2023-12-26 06:11:04,263][123090] Updated weights for policy 1, policy_version 820297 (0.0009) [2023-12-26 06:11:04,328][123090] Updated weights for policy 1, policy_version 820307 (0.0010) [2023-12-26 06:11:04,396][123090] Updated weights for policy 1, policy_version 820317 (0.0010) [2023-12-26 06:11:04,931][123091] Updated weights for policy 0, policy_version 825976 (0.0010) [2023-12-26 06:11:04,982][123091] Updated weights for policy 0, policy_version 825986 (0.0009) [2023-12-26 06:11:05,033][123091] Updated weights for policy 0, policy_version 825996 (0.0009) [2023-12-26 06:11:05,091][123090] Updated weights for policy 1, policy_version 820327 (0.0009) [2023-12-26 06:11:05,158][123090] Updated weights for policy 1, policy_version 820337 (0.0009) [2023-12-26 06:11:05,223][123090] Updated weights for policy 1, policy_version 820347 (0.0010) [2023-12-26 06:11:05,898][123091] Updated weights for policy 0, policy_version 826006 (0.0010) [2023-12-26 06:11:05,955][123091] Updated weights for policy 0, policy_version 826016 (0.0009) [2023-12-26 06:11:05,985][123090] Updated weights for policy 1, policy_version 820357 (0.0009) [2023-12-26 06:11:06,005][123091] Updated weights for policy 0, policy_version 826026 (0.0009) [2023-12-26 06:11:06,033][123090] Updated weights for policy 1, policy_version 820367 (0.0008) [2023-12-26 06:11:06,091][123090] Updated weights for policy 1, policy_version 820377 (0.0008) [2023-12-26 06:11:06,853][123091] Updated weights for policy 0, policy_version 826036 (0.0009) [2023-12-26 06:11:06,904][123091] Updated weights for policy 0, policy_version 826046 (0.0010) [2023-12-26 06:11:06,905][123090] Updated weights for policy 1, policy_version 820387 (0.0009) [2023-12-26 06:11:06,951][123091] Updated weights for policy 0, policy_version 826056 (0.0008) [2023-12-26 06:11:06,963][123090] Updated weights for policy 1, policy_version 820397 (0.0007) [2023-12-26 06:11:07,013][123090] Updated weights for policy 1, policy_version 820407 (0.0008) [2023-12-26 06:11:07,813][123091] Updated weights for policy 0, policy_version 826066 (0.0008) [2023-12-26 06:11:07,862][123090] Updated weights for policy 1, policy_version 820417 (0.0007) [2023-12-26 06:11:07,869][123091] Updated weights for policy 0, policy_version 826076 (0.0009) [2023-12-26 06:11:07,917][123091] Updated weights for policy 0, policy_version 826086 (0.0008) [2023-12-26 06:11:07,934][123090] Updated weights for policy 1, policy_version 820427 (0.0007) [2023-12-26 06:11:07,967][123091] Updated weights for policy 0, policy_version 826096 (0.0006) [2023-12-26 06:11:07,983][123090] Updated weights for policy 1, policy_version 820437 (0.0008) [2023-12-26 06:11:08,044][123090] Updated weights for policy 1, policy_version 820447 (0.0006) [2023-12-26 06:11:08,784][121949] Fps is (10 sec: 17207.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 421519360. Throughput: 0: 8935.6, 1: 8895.6. Samples: 421501864. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:08,785][121949] Avg episode reward: [(0, '6142.480'), (1, '5841.050')] [2023-12-26 06:11:08,801][123091] Updated weights for policy 0, policy_version 826106 (0.0010) [2023-12-26 06:11:08,841][123090] Updated weights for policy 1, policy_version 820457 (0.0010) [2023-12-26 06:11:08,861][123091] Updated weights for policy 0, policy_version 826116 (0.0006) [2023-12-26 06:11:08,909][123090] Updated weights for policy 1, policy_version 820467 (0.0011) [2023-12-26 06:11:08,928][123091] Updated weights for policy 0, policy_version 826126 (0.0007) [2023-12-26 06:11:08,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000826128_211492864.pth... [2023-12-26 06:11:08,940][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000825040_211214336.pth [2023-12-26 06:11:08,969][123090] Updated weights for policy 1, policy_version 820477 (0.0011) [2023-12-26 06:11:08,983][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000820480_210042880.pth... [2023-12-26 06:11:08,986][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000819424_209772544.pth [2023-12-26 06:11:09,767][123091] Updated weights for policy 0, policy_version 826136 (0.0007) [2023-12-26 06:11:09,774][123090] Updated weights for policy 1, policy_version 820487 (0.0008) [2023-12-26 06:11:09,841][123091] Updated weights for policy 0, policy_version 826146 (0.0009) [2023-12-26 06:11:09,847][123090] Updated weights for policy 1, policy_version 820497 (0.0008) [2023-12-26 06:11:09,906][123091] Updated weights for policy 0, policy_version 826156 (0.0010) [2023-12-26 06:11:09,915][123090] Updated weights for policy 1, policy_version 820507 (0.0007) [2023-12-26 06:11:10,651][123091] Updated weights for policy 0, policy_version 826166 (0.0010) [2023-12-26 06:11:10,708][123091] Updated weights for policy 0, policy_version 826176 (0.0010) [2023-12-26 06:11:10,771][123091] Updated weights for policy 0, policy_version 826186 (0.0005) [2023-12-26 06:11:10,782][123090] Updated weights for policy 1, policy_version 820517 (0.0008) [2023-12-26 06:11:10,840][123090] Updated weights for policy 1, policy_version 820527 (0.0009) [2023-12-26 06:11:10,892][123090] Updated weights for policy 1, policy_version 820537 (0.0009) [2023-12-26 06:11:11,505][123091] Updated weights for policy 0, policy_version 826196 (0.0008) [2023-12-26 06:11:11,573][123091] Updated weights for policy 0, policy_version 826206 (0.0011) [2023-12-26 06:11:11,647][123091] Updated weights for policy 0, policy_version 826216 (0.0011) [2023-12-26 06:11:11,784][123090] Updated weights for policy 1, policy_version 820547 (0.0009) [2023-12-26 06:11:11,841][123090] Updated weights for policy 1, policy_version 820557 (0.0009) [2023-12-26 06:11:11,896][123090] Updated weights for policy 1, policy_version 820567 (0.0008) [2023-12-26 06:11:12,483][123091] Updated weights for policy 0, policy_version 826226 (0.0010) [2023-12-26 06:11:12,530][123091] Updated weights for policy 0, policy_version 826236 (0.0005) [2023-12-26 06:11:12,593][123091] Updated weights for policy 0, policy_version 826246 (0.0007) [2023-12-26 06:11:12,656][123091] Updated weights for policy 0, policy_version 826256 (0.0005) [2023-12-26 06:11:12,786][123090] Updated weights for policy 1, policy_version 820577 (0.0009) [2023-12-26 06:11:12,851][123090] Updated weights for policy 1, policy_version 820587 (0.0010) [2023-12-26 06:11:12,918][123090] Updated weights for policy 1, policy_version 820597 (0.0010) [2023-12-26 06:11:12,990][123090] Updated weights for policy 1, policy_version 820607 (0.0010) [2023-12-26 06:11:13,425][123091] Updated weights for policy 0, policy_version 826266 (0.0009) [2023-12-26 06:11:13,481][123091] Updated weights for policy 0, policy_version 826277 (0.0010) [2023-12-26 06:11:13,532][123091] Updated weights for policy 0, policy_version 826287 (0.0009) [2023-12-26 06:11:13,723][123090] Updated weights for policy 1, policy_version 820617 (0.0009) [2023-12-26 06:11:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 421609472. Throughput: 0: 8885.8, 1: 8822.7. Samples: 421605640. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:13,785][121949] Avg episode reward: [(0, '6334.243'), (1, '5880.822')] [2023-12-26 06:11:13,791][123090] Updated weights for policy 1, policy_version 820627 (0.0009) [2023-12-26 06:11:13,851][123090] Updated weights for policy 1, policy_version 820637 (0.0009) [2023-12-26 06:11:14,332][123091] Updated weights for policy 0, policy_version 826297 (0.0006) [2023-12-26 06:11:14,394][123091] Updated weights for policy 0, policy_version 826307 (0.0005) [2023-12-26 06:11:14,457][123091] Updated weights for policy 0, policy_version 826317 (0.0005) [2023-12-26 06:11:14,595][123090] Updated weights for policy 1, policy_version 820647 (0.0006) [2023-12-26 06:11:14,651][123090] Updated weights for policy 1, policy_version 820657 (0.0005) [2023-12-26 06:11:14,705][123090] Updated weights for policy 1, policy_version 820667 (0.0005) [2023-12-26 06:11:15,234][123091] Updated weights for policy 0, policy_version 826327 (0.0009) [2023-12-26 06:11:15,294][123091] Updated weights for policy 0, policy_version 826337 (0.0010) [2023-12-26 06:11:15,359][123091] Updated weights for policy 0, policy_version 826347 (0.0006) [2023-12-26 06:11:15,447][123090] Updated weights for policy 1, policy_version 820677 (0.0007) [2023-12-26 06:11:15,521][123090] Updated weights for policy 1, policy_version 820687 (0.0008) [2023-12-26 06:11:15,593][123090] Updated weights for policy 1, policy_version 820697 (0.0011) [2023-12-26 06:11:16,104][123091] Updated weights for policy 0, policy_version 826357 (0.0008) [2023-12-26 06:11:16,169][123091] Updated weights for policy 0, policy_version 826367 (0.0008) [2023-12-26 06:11:16,233][123091] Updated weights for policy 0, policy_version 826377 (0.0008) [2023-12-26 06:11:16,340][123090] Updated weights for policy 1, policy_version 820707 (0.0010) [2023-12-26 06:11:16,407][123090] Updated weights for policy 1, policy_version 820717 (0.0011) [2023-12-26 06:11:16,463][123090] Updated weights for policy 1, policy_version 820727 (0.0010) [2023-12-26 06:11:17,036][123091] Updated weights for policy 0, policy_version 826387 (0.0008) [2023-12-26 06:11:17,096][123091] Updated weights for policy 0, policy_version 826397 (0.0009) [2023-12-26 06:11:17,149][123091] Updated weights for policy 0, policy_version 826408 (0.0010) [2023-12-26 06:11:17,159][123090] Updated weights for policy 1, policy_version 820737 (0.0010) [2023-12-26 06:11:17,219][123090] Updated weights for policy 1, policy_version 820747 (0.0005) [2023-12-26 06:11:17,282][123090] Updated weights for policy 1, policy_version 820757 (0.0005) [2023-12-26 06:11:17,356][123090] Updated weights for policy 1, policy_version 820767 (0.0007) [2023-12-26 06:11:18,023][123091] Updated weights for policy 0, policy_version 826418 (0.0009) [2023-12-26 06:11:18,074][123091] Updated weights for policy 0, policy_version 826428 (0.0007) [2023-12-26 06:11:18,099][123090] Updated weights for policy 1, policy_version 820777 (0.0010) [2023-12-26 06:11:18,131][123091] Updated weights for policy 0, policy_version 826438 (0.0009) [2023-12-26 06:11:18,152][123090] Updated weights for policy 1, policy_version 820787 (0.0010) [2023-12-26 06:11:18,184][123091] Updated weights for policy 0, policy_version 826448 (0.0008) [2023-12-26 06:11:18,203][123090] Updated weights for policy 1, policy_version 820797 (0.0010) [2023-12-26 06:11:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 421699584. Throughput: 0: 8950.6, 1: 8783.7. Samples: 421714032. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:18,785][121949] Avg episode reward: [(0, '6242.848'), (1, '5980.344')] [2023-12-26 06:11:18,988][123091] Updated weights for policy 0, policy_version 826458 (0.0009) [2023-12-26 06:11:19,051][123091] Updated weights for policy 0, policy_version 826468 (0.0009) [2023-12-26 06:11:19,079][123090] Updated weights for policy 1, policy_version 820807 (0.0009) [2023-12-26 06:11:19,114][123091] Updated weights for policy 0, policy_version 826478 (0.0009) [2023-12-26 06:11:19,136][123090] Updated weights for policy 1, policy_version 820817 (0.0007) [2023-12-26 06:11:19,203][123090] Updated weights for policy 1, policy_version 820827 (0.0008) [2023-12-26 06:11:19,975][123091] Updated weights for policy 0, policy_version 826488 (0.0011) [2023-12-26 06:11:20,036][123091] Updated weights for policy 0, policy_version 826498 (0.0011) [2023-12-26 06:11:20,079][123090] Updated weights for policy 1, policy_version 820837 (0.0007) [2023-12-26 06:11:20,098][123091] Updated weights for policy 0, policy_version 826508 (0.0010) [2023-12-26 06:11:20,144][123090] Updated weights for policy 1, policy_version 820847 (0.0009) [2023-12-26 06:11:20,202][123090] Updated weights for policy 1, policy_version 820857 (0.0009) [2023-12-26 06:11:20,949][123091] Updated weights for policy 0, policy_version 826518 (0.0011) [2023-12-26 06:11:21,017][123091] Updated weights for policy 0, policy_version 826528 (0.0011) [2023-12-26 06:11:21,077][123090] Updated weights for policy 1, policy_version 820867 (0.0009) [2023-12-26 06:11:21,090][123091] Updated weights for policy 0, policy_version 826538 (0.0011) [2023-12-26 06:11:21,144][123090] Updated weights for policy 1, policy_version 820877 (0.0007) [2023-12-26 06:11:21,208][123090] Updated weights for policy 1, policy_version 820887 (0.0009) [2023-12-26 06:11:21,929][123091] Updated weights for policy 0, policy_version 826548 (0.0011) [2023-12-26 06:11:21,986][123091] Updated weights for policy 0, policy_version 826558 (0.0011) [2023-12-26 06:11:22,038][123091] Updated weights for policy 0, policy_version 826568 (0.0011) [2023-12-26 06:11:22,080][123090] Updated weights for policy 1, policy_version 820897 (0.0010) [2023-12-26 06:11:22,142][123090] Updated weights for policy 1, policy_version 820907 (0.0011) [2023-12-26 06:11:22,204][123090] Updated weights for policy 1, policy_version 820917 (0.0011) [2023-12-26 06:11:22,270][123090] Updated weights for policy 1, policy_version 820927 (0.0008) [2023-12-26 06:11:22,920][123091] Updated weights for policy 0, policy_version 826578 (0.0011) [2023-12-26 06:11:22,968][123091] Updated weights for policy 0, policy_version 826588 (0.0010) [2023-12-26 06:11:23,024][123091] Updated weights for policy 0, policy_version 826598 (0.0010) [2023-12-26 06:11:23,072][123091] Updated weights for policy 0, policy_version 826608 (0.0010) [2023-12-26 06:11:23,074][123090] Updated weights for policy 1, policy_version 820937 (0.0007) [2023-12-26 06:11:23,123][123090] Updated weights for policy 1, policy_version 820947 (0.0008) [2023-12-26 06:11:23,173][123090] Updated weights for policy 1, policy_version 820957 (0.0009) [2023-12-26 06:11:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 421781504. Throughput: 0: 8956.3, 1: 8730.7. Samples: 421763316. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:23,785][121949] Avg episode reward: [(0, '6219.739'), (1, '5987.054')] [2023-12-26 06:11:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000826608_211615744.pth... [2023-12-26 06:11:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000820960_210165760.pth... [2023-12-26 06:11:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000819936_209903616.pth [2023-12-26 06:11:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000825584_211353600.pth [2023-12-26 06:11:23,937][123091] Updated weights for policy 0, policy_version 826618 (0.0011) [2023-12-26 06:11:23,967][123090] Updated weights for policy 1, policy_version 820967 (0.0006) [2023-12-26 06:11:23,990][123091] Updated weights for policy 0, policy_version 826628 (0.0010) [2023-12-26 06:11:24,034][123090] Updated weights for policy 1, policy_version 820977 (0.0005) [2023-12-26 06:11:24,042][123091] Updated weights for policy 0, policy_version 826638 (0.0010) [2023-12-26 06:11:24,088][123090] Updated weights for policy 1, policy_version 820987 (0.0005) [2023-12-26 06:11:24,875][123091] Updated weights for policy 0, policy_version 826648 (0.0010) [2023-12-26 06:11:24,883][123090] Updated weights for policy 1, policy_version 820997 (0.0008) [2023-12-26 06:11:24,935][123091] Updated weights for policy 0, policy_version 826658 (0.0005) [2023-12-26 06:11:24,941][123090] Updated weights for policy 1, policy_version 821007 (0.0009) [2023-12-26 06:11:24,991][123091] Updated weights for policy 0, policy_version 826668 (0.0007) [2023-12-26 06:11:25,005][123090] Updated weights for policy 1, policy_version 821017 (0.0007) [2023-12-26 06:11:25,662][123091] Updated weights for policy 0, policy_version 826678 (0.0008) [2023-12-26 06:11:25,720][123091] Updated weights for policy 0, policy_version 826688 (0.0010) [2023-12-26 06:11:25,773][123091] Updated weights for policy 0, policy_version 826699 (0.0007) [2023-12-26 06:11:25,826][123090] Updated weights for policy 1, policy_version 821027 (0.0009) [2023-12-26 06:11:25,906][123090] Updated weights for policy 1, policy_version 821037 (0.0009) [2023-12-26 06:11:25,968][123090] Updated weights for policy 1, policy_version 821047 (0.0010) [2023-12-26 06:11:26,447][123091] Updated weights for policy 0, policy_version 826709 (0.0005) [2023-12-26 06:11:26,509][123091] Updated weights for policy 0, policy_version 826719 (0.0005) [2023-12-26 06:11:26,555][123091] Updated weights for policy 0, policy_version 826729 (0.0005) [2023-12-26 06:11:26,875][123090] Updated weights for policy 1, policy_version 821058 (0.0010) [2023-12-26 06:11:26,945][123090] Updated weights for policy 1, policy_version 821068 (0.0007) [2023-12-26 06:11:27,021][123090] Updated weights for policy 1, policy_version 821078 (0.0005) [2023-12-26 06:11:27,094][123090] Updated weights for policy 1, policy_version 821088 (0.0005) [2023-12-26 06:11:27,128][123091] Updated weights for policy 0, policy_version 826739 (0.0005) [2023-12-26 06:11:27,181][123091] Updated weights for policy 0, policy_version 826749 (0.0005) [2023-12-26 06:11:27,225][123091] Updated weights for policy 0, policy_version 826759 (0.0005) [2023-12-26 06:11:27,743][123090] Updated weights for policy 1, policy_version 821099 (0.0007) [2023-12-26 06:11:27,797][123090] Updated weights for policy 1, policy_version 821109 (0.0010) [2023-12-26 06:11:27,854][123090] Updated weights for policy 1, policy_version 821119 (0.0009) [2023-12-26 06:11:27,901][123091] Updated weights for policy 0, policy_version 826769 (0.0006) [2023-12-26 06:11:27,952][123091] Updated weights for policy 0, policy_version 826779 (0.0005) [2023-12-26 06:11:28,015][123091] Updated weights for policy 0, policy_version 826789 (0.0005) [2023-12-26 06:11:28,085][123091] Updated weights for policy 0, policy_version 826799 (0.0010) [2023-12-26 06:11:28,704][123090] Updated weights for policy 1, policy_version 821129 (0.0009) [2023-12-26 06:11:28,766][123090] Updated weights for policy 1, policy_version 821139 (0.0008) [2023-12-26 06:11:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 421871616. Throughput: 0: 9083.6, 1: 8782.6. Samples: 421872108. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:28,784][121949] Avg episode reward: [(0, '6306.028'), (1, '6030.775')] [2023-12-26 06:11:28,825][123090] Updated weights for policy 1, policy_version 821149 (0.0008) [2023-12-26 06:11:28,876][123091] Updated weights for policy 0, policy_version 826809 (0.0010) [2023-12-26 06:11:28,937][123091] Updated weights for policy 0, policy_version 826819 (0.0010) [2023-12-26 06:11:28,996][123091] Updated weights for policy 0, policy_version 826829 (0.0010) [2023-12-26 06:11:29,616][123090] Updated weights for policy 1, policy_version 821159 (0.0009) [2023-12-26 06:11:29,687][123090] Updated weights for policy 1, policy_version 821169 (0.0009) [2023-12-26 06:11:29,759][123090] Updated weights for policy 1, policy_version 821179 (0.0009) [2023-12-26 06:11:29,773][123091] Updated weights for policy 0, policy_version 826839 (0.0008) [2023-12-26 06:11:29,839][123091] Updated weights for policy 0, policy_version 826849 (0.0007) [2023-12-26 06:11:29,911][123091] Updated weights for policy 0, policy_version 826859 (0.0008) [2023-12-26 06:11:30,579][123090] Updated weights for policy 1, policy_version 821189 (0.0009) [2023-12-26 06:11:30,644][123090] Updated weights for policy 1, policy_version 821199 (0.0009) [2023-12-26 06:11:30,694][123091] Updated weights for policy 0, policy_version 826869 (0.0010) [2023-12-26 06:11:30,703][123090] Updated weights for policy 1, policy_version 821209 (0.0009) [2023-12-26 06:11:30,741][123091] Updated weights for policy 0, policy_version 826879 (0.0009) [2023-12-26 06:11:30,791][123091] Updated weights for policy 0, policy_version 826889 (0.0009) [2023-12-26 06:11:31,557][123090] Updated weights for policy 1, policy_version 821219 (0.0008) [2023-12-26 06:11:31,624][123090] Updated weights for policy 1, policy_version 821230 (0.0010) [2023-12-26 06:11:31,665][123091] Updated weights for policy 0, policy_version 826899 (0.0009) [2023-12-26 06:11:31,680][123090] Updated weights for policy 1, policy_version 821240 (0.0008) [2023-12-26 06:11:31,718][123091] Updated weights for policy 0, policy_version 826909 (0.0006) [2023-12-26 06:11:31,787][123091] Updated weights for policy 0, policy_version 826919 (0.0009) [2023-12-26 06:11:32,507][123090] Updated weights for policy 1, policy_version 821250 (0.0009) [2023-12-26 06:11:32,577][123090] Updated weights for policy 1, policy_version 821260 (0.0010) [2023-12-26 06:11:32,632][123091] Updated weights for policy 0, policy_version 826929 (0.0008) [2023-12-26 06:11:32,637][123090] Updated weights for policy 1, policy_version 821270 (0.0009) [2023-12-26 06:11:32,692][123091] Updated weights for policy 0, policy_version 826939 (0.0007) [2023-12-26 06:11:32,697][123090] Updated weights for policy 1, policy_version 821280 (0.0010) [2023-12-26 06:11:32,747][123091] Updated weights for policy 0, policy_version 826949 (0.0009) [2023-12-26 06:11:32,808][123091] Updated weights for policy 0, policy_version 826959 (0.0009) [2023-12-26 06:11:33,440][123090] Updated weights for policy 1, policy_version 821290 (0.0005) [2023-12-26 06:11:33,487][123090] Updated weights for policy 1, policy_version 821300 (0.0005) [2023-12-26 06:11:33,533][123090] Updated weights for policy 1, policy_version 821310 (0.0005) [2023-12-26 06:11:33,682][123091] Updated weights for policy 0, policy_version 826969 (0.0009) [2023-12-26 06:11:33,748][123091] Updated weights for policy 0, policy_version 826979 (0.0010) [2023-12-26 06:11:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 421961728. Throughput: 0: 8914.6, 1: 8808.2. Samples: 421976144. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:33,785][121949] Avg episode reward: [(0, '6281.790'), (1, '6033.400')] [2023-12-26 06:11:33,808][123091] Updated weights for policy 0, policy_version 826989 (0.0010) [2023-12-26 06:11:34,205][123090] Updated weights for policy 1, policy_version 821320 (0.0008) [2023-12-26 06:11:34,273][123090] Updated weights for policy 1, policy_version 821330 (0.0009) [2023-12-26 06:11:34,339][123090] Updated weights for policy 1, policy_version 821340 (0.0009) [2023-12-26 06:11:34,680][123091] Updated weights for policy 0, policy_version 826999 (0.0010) [2023-12-26 06:11:34,729][123091] Updated weights for policy 0, policy_version 827009 (0.0010) [2023-12-26 06:11:34,783][123091] Updated weights for policy 0, policy_version 827019 (0.0009) [2023-12-26 06:11:35,165][123090] Updated weights for policy 1, policy_version 821350 (0.0009) [2023-12-26 06:11:35,226][123090] Updated weights for policy 1, policy_version 821360 (0.0010) [2023-12-26 06:11:35,275][123090] Updated weights for policy 1, policy_version 821371 (0.0010) [2023-12-26 06:11:35,667][123091] Updated weights for policy 0, policy_version 827029 (0.0010) [2023-12-26 06:11:35,718][123091] Updated weights for policy 0, policy_version 827039 (0.0009) [2023-12-26 06:11:35,766][123091] Updated weights for policy 0, policy_version 827049 (0.0009) [2023-12-26 06:11:35,892][123090] Updated weights for policy 1, policy_version 821381 (0.0009) [2023-12-26 06:11:35,944][123090] Updated weights for policy 1, policy_version 821391 (0.0010) [2023-12-26 06:11:36,014][123090] Updated weights for policy 1, policy_version 821401 (0.0010) [2023-12-26 06:11:36,533][123091] Updated weights for policy 0, policy_version 827059 (0.0008) [2023-12-26 06:11:36,605][123091] Updated weights for policy 0, policy_version 827069 (0.0010) [2023-12-26 06:11:36,683][123091] Updated weights for policy 0, policy_version 827079 (0.0009) [2023-12-26 06:11:36,849][123090] Updated weights for policy 1, policy_version 821411 (0.0008) [2023-12-26 06:11:36,912][123090] Updated weights for policy 1, policy_version 821421 (0.0011) [2023-12-26 06:11:36,975][123090] Updated weights for policy 1, policy_version 821431 (0.0011) [2023-12-26 06:11:37,513][123091] Updated weights for policy 0, policy_version 827089 (0.0011) [2023-12-26 06:11:37,563][123091] Updated weights for policy 0, policy_version 827099 (0.0008) [2023-12-26 06:11:37,622][123091] Updated weights for policy 0, policy_version 827109 (0.0005) [2023-12-26 06:11:37,682][123091] Updated weights for policy 0, policy_version 827119 (0.0005) [2023-12-26 06:11:37,744][123090] Updated weights for policy 1, policy_version 821441 (0.0010) [2023-12-26 06:11:37,799][123090] Updated weights for policy 1, policy_version 821451 (0.0009) [2023-12-26 06:11:37,858][123090] Updated weights for policy 1, policy_version 821461 (0.0009) [2023-12-26 06:11:37,915][123090] Updated weights for policy 1, policy_version 821471 (0.0009) [2023-12-26 06:11:38,472][123091] Updated weights for policy 0, policy_version 827129 (0.0009) [2023-12-26 06:11:38,532][123091] Updated weights for policy 0, policy_version 827139 (0.0010) [2023-12-26 06:11:38,593][123091] Updated weights for policy 0, policy_version 827149 (0.0009) [2023-12-26 06:11:38,725][123090] Updated weights for policy 1, policy_version 821481 (0.0005) [2023-12-26 06:11:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 422051840. Throughput: 0: 8867.2, 1: 8870.5. Samples: 422029588. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:38,785][121949] Avg episode reward: [(0, '6189.750'), (1, '6031.920')] [2023-12-26 06:11:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000827152_211755008.pth... [2023-12-26 06:11:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000826128_211492864.pth [2023-12-26 06:11:38,807][123090] Updated weights for policy 1, policy_version 821491 (0.0005) [2023-12-26 06:11:38,876][123090] Updated weights for policy 1, policy_version 821501 (0.0006) [2023-12-26 06:11:38,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000821504_210305024.pth... [2023-12-26 06:11:38,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000820480_210042880.pth [2023-12-26 06:11:39,368][123091] Updated weights for policy 0, policy_version 827159 (0.0007) [2023-12-26 06:11:39,441][123091] Updated weights for policy 0, policy_version 827169 (0.0009) [2023-12-26 06:11:39,505][123091] Updated weights for policy 0, policy_version 827179 (0.0008) [2023-12-26 06:11:39,560][123090] Updated weights for policy 1, policy_version 821511 (0.0010) [2023-12-26 06:11:39,620][123090] Updated weights for policy 1, policy_version 821521 (0.0010) [2023-12-26 06:11:39,684][123090] Updated weights for policy 1, policy_version 821531 (0.0010) [2023-12-26 06:11:40,294][123091] Updated weights for policy 0, policy_version 827189 (0.0007) [2023-12-26 06:11:40,349][123091] Updated weights for policy 0, policy_version 827199 (0.0009) [2023-12-26 06:11:40,411][123091] Updated weights for policy 0, policy_version 827209 (0.0008) [2023-12-26 06:11:40,490][123090] Updated weights for policy 1, policy_version 821541 (0.0009) [2023-12-26 06:11:40,572][123090] Updated weights for policy 1, policy_version 821551 (0.0007) [2023-12-26 06:11:40,644][123090] Updated weights for policy 1, policy_version 821561 (0.0005) [2023-12-26 06:11:41,081][123091] Updated weights for policy 0, policy_version 827219 (0.0009) [2023-12-26 06:11:41,150][123091] Updated weights for policy 0, policy_version 827229 (0.0009) [2023-12-26 06:11:41,213][123091] Updated weights for policy 0, policy_version 827239 (0.0009) [2023-12-26 06:11:41,407][123090] Updated weights for policy 1, policy_version 821571 (0.0007) [2023-12-26 06:11:41,469][123090] Updated weights for policy 1, policy_version 821581 (0.0010) [2023-12-26 06:11:41,523][123090] Updated weights for policy 1, policy_version 821591 (0.0009) [2023-12-26 06:11:42,102][123091] Updated weights for policy 0, policy_version 827249 (0.0009) [2023-12-26 06:11:42,156][123091] Updated weights for policy 0, policy_version 827259 (0.0009) [2023-12-26 06:11:42,210][123091] Updated weights for policy 0, policy_version 827269 (0.0009) [2023-12-26 06:11:42,264][123091] Updated weights for policy 0, policy_version 827279 (0.0010) [2023-12-26 06:11:42,352][123090] Updated weights for policy 1, policy_version 821601 (0.0009) [2023-12-26 06:11:42,420][123090] Updated weights for policy 1, policy_version 821611 (0.0009) [2023-12-26 06:11:42,476][123090] Updated weights for policy 1, policy_version 821621 (0.0005) [2023-12-26 06:11:42,539][123090] Updated weights for policy 1, policy_version 821631 (0.0008) [2023-12-26 06:11:43,107][123091] Updated weights for policy 0, policy_version 827289 (0.0006) [2023-12-26 06:11:43,168][123091] Updated weights for policy 0, policy_version 827299 (0.0005) [2023-12-26 06:11:43,227][123091] Updated weights for policy 0, policy_version 827309 (0.0005) [2023-12-26 06:11:43,403][123090] Updated weights for policy 1, policy_version 821641 (0.0006) [2023-12-26 06:11:43,456][123090] Updated weights for policy 1, policy_version 821651 (0.0008) [2023-12-26 06:11:43,507][123090] Updated weights for policy 1, policy_version 821661 (0.0009) [2023-12-26 06:11:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 422141952. Throughput: 0: 8765.9, 1: 8801.0. Samples: 422136016. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:43,785][121949] Avg episode reward: [(0, '6081.533'), (1, '5985.845')] [2023-12-26 06:11:43,984][123091] Updated weights for policy 0, policy_version 827319 (0.0009) [2023-12-26 06:11:44,036][123091] Updated weights for policy 0, policy_version 827329 (0.0009) [2023-12-26 06:11:44,084][123091] Updated weights for policy 0, policy_version 827339 (0.0009) [2023-12-26 06:11:44,311][123090] Updated weights for policy 1, policy_version 821671 (0.0007) [2023-12-26 06:11:44,373][123090] Updated weights for policy 1, policy_version 821681 (0.0005) [2023-12-26 06:11:44,434][123090] Updated weights for policy 1, policy_version 821691 (0.0005) [2023-12-26 06:11:44,856][123091] Updated weights for policy 0, policy_version 827349 (0.0010) [2023-12-26 06:11:44,924][123091] Updated weights for policy 0, policy_version 827359 (0.0009) [2023-12-26 06:11:44,976][123091] Updated weights for policy 0, policy_version 827369 (0.0010) [2023-12-26 06:11:45,155][123090] Updated weights for policy 1, policy_version 821701 (0.0008) [2023-12-26 06:11:45,222][123090] Updated weights for policy 1, policy_version 821711 (0.0010) [2023-12-26 06:11:45,289][123090] Updated weights for policy 1, policy_version 821722 (0.0009) [2023-12-26 06:11:45,805][123091] Updated weights for policy 0, policy_version 827379 (0.0010) [2023-12-26 06:11:45,859][123091] Updated weights for policy 0, policy_version 827389 (0.0009) [2023-12-26 06:11:45,908][123091] Updated weights for policy 0, policy_version 827399 (0.0009) [2023-12-26 06:11:46,088][123090] Updated weights for policy 1, policy_version 821732 (0.0007) [2023-12-26 06:11:46,162][123090] Updated weights for policy 1, policy_version 821742 (0.0007) [2023-12-26 06:11:46,231][123090] Updated weights for policy 1, policy_version 821752 (0.0009) [2023-12-26 06:11:46,758][123091] Updated weights for policy 0, policy_version 827409 (0.0009) [2023-12-26 06:11:46,830][123091] Updated weights for policy 0, policy_version 827419 (0.0008) [2023-12-26 06:11:46,895][123091] Updated weights for policy 0, policy_version 827429 (0.0010) [2023-12-26 06:11:46,952][123091] Updated weights for policy 0, policy_version 827439 (0.0009) [2023-12-26 06:11:46,985][123090] Updated weights for policy 1, policy_version 821762 (0.0008) [2023-12-26 06:11:47,041][123090] Updated weights for policy 1, policy_version 821772 (0.0009) [2023-12-26 06:11:47,096][123090] Updated weights for policy 1, policy_version 821782 (0.0010) [2023-12-26 06:11:47,146][123090] Updated weights for policy 1, policy_version 821792 (0.0009) [2023-12-26 06:11:47,727][123091] Updated weights for policy 0, policy_version 827449 (0.0009) [2023-12-26 06:11:47,778][123091] Updated weights for policy 0, policy_version 827459 (0.0009) [2023-12-26 06:11:47,826][123091] Updated weights for policy 0, policy_version 827469 (0.0009) [2023-12-26 06:11:47,982][123090] Updated weights for policy 1, policy_version 821802 (0.0010) [2023-12-26 06:11:48,037][123090] Updated weights for policy 1, policy_version 821812 (0.0009) [2023-12-26 06:11:48,104][123090] Updated weights for policy 1, policy_version 821822 (0.0010) [2023-12-26 06:11:48,623][123091] Updated weights for policy 0, policy_version 827479 (0.0008) [2023-12-26 06:11:48,687][123091] Updated weights for policy 0, policy_version 827489 (0.0012) [2023-12-26 06:11:48,740][123091] Updated weights for policy 0, policy_version 827499 (0.0010) [2023-12-26 06:11:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 422232064. Throughput: 0: 8803.1, 1: 8782.6. Samples: 422241492. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:48,785][121949] Avg episode reward: [(0, '6165.536'), (1, '5941.545')] [2023-12-26 06:11:48,957][123090] Updated weights for policy 1, policy_version 821832 (0.0007) [2023-12-26 06:11:49,013][123090] Updated weights for policy 1, policy_version 821842 (0.0005) [2023-12-26 06:11:49,071][123090] Updated weights for policy 1, policy_version 821852 (0.0005) [2023-12-26 06:11:49,608][123091] Updated weights for policy 0, policy_version 827509 (0.0010) [2023-12-26 06:11:49,665][123091] Updated weights for policy 0, policy_version 827519 (0.0009) [2023-12-26 06:11:49,723][123091] Updated weights for policy 0, policy_version 827529 (0.0009) [2023-12-26 06:11:49,841][123090] Updated weights for policy 1, policy_version 821862 (0.0008) [2023-12-26 06:11:49,902][123090] Updated weights for policy 1, policy_version 821872 (0.0009) [2023-12-26 06:11:49,982][123090] Updated weights for policy 1, policy_version 821882 (0.0010) [2023-12-26 06:11:50,530][123091] Updated weights for policy 0, policy_version 827539 (0.0009) [2023-12-26 06:11:50,588][123091] Updated weights for policy 0, policy_version 827549 (0.0009) [2023-12-26 06:11:50,637][123091] Updated weights for policy 0, policy_version 827559 (0.0009) [2023-12-26 06:11:50,840][123090] Updated weights for policy 1, policy_version 821892 (0.0009) [2023-12-26 06:11:50,912][123090] Updated weights for policy 1, policy_version 821902 (0.0006) [2023-12-26 06:11:50,987][123090] Updated weights for policy 1, policy_version 821912 (0.0006) [2023-12-26 06:11:51,530][123091] Updated weights for policy 0, policy_version 827569 (0.0009) [2023-12-26 06:11:51,588][123091] Updated weights for policy 0, policy_version 827579 (0.0009) [2023-12-26 06:11:51,657][123091] Updated weights for policy 0, policy_version 827589 (0.0009) [2023-12-26 06:11:51,729][123091] Updated weights for policy 0, policy_version 827599 (0.0008) [2023-12-26 06:11:51,764][123090] Updated weights for policy 1, policy_version 821922 (0.0008) [2023-12-26 06:11:51,831][123090] Updated weights for policy 1, policy_version 821932 (0.0009) [2023-12-26 06:11:51,883][123090] Updated weights for policy 1, policy_version 821942 (0.0010) [2023-12-26 06:11:51,943][123090] Updated weights for policy 1, policy_version 821952 (0.0009) [2023-12-26 06:11:52,532][123091] Updated weights for policy 0, policy_version 827609 (0.0006) [2023-12-26 06:11:52,599][123091] Updated weights for policy 0, policy_version 827619 (0.0009) [2023-12-26 06:11:52,668][123091] Updated weights for policy 0, policy_version 827629 (0.0009) [2023-12-26 06:11:52,821][123090] Updated weights for policy 1, policy_version 821962 (0.0010) [2023-12-26 06:11:52,875][123090] Updated weights for policy 1, policy_version 821972 (0.0009) [2023-12-26 06:11:52,937][123090] Updated weights for policy 1, policy_version 821982 (0.0009) [2023-12-26 06:11:53,328][123091] Updated weights for policy 0, policy_version 827639 (0.0010) [2023-12-26 06:11:53,394][123091] Updated weights for policy 0, policy_version 827649 (0.0005) [2023-12-26 06:11:53,449][123091] Updated weights for policy 0, policy_version 827659 (0.0010) [2023-12-26 06:11:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 422313984. Throughput: 0: 8798.2, 1: 8777.2. Samples: 422292760. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:53,785][121949] Avg episode reward: [(0, '6114.777'), (1, '5946.101')] [2023-12-26 06:11:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000827664_211886080.pth... [2023-12-26 06:11:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000826608_211615744.pth [2023-12-26 06:11:53,822][123090] Updated weights for policy 1, policy_version 821992 (0.0009) [2023-12-26 06:11:53,870][123090] Updated weights for policy 1, policy_version 822002 (0.0009) [2023-12-26 06:11:53,920][123090] Updated weights for policy 1, policy_version 822012 (0.0009) [2023-12-26 06:11:53,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000822016_210436096.pth... [2023-12-26 06:11:53,940][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000820960_210165760.pth [2023-12-26 06:11:54,203][123091] Updated weights for policy 0, policy_version 827669 (0.0006) [2023-12-26 06:11:54,259][123091] Updated weights for policy 0, policy_version 827679 (0.0006) [2023-12-26 06:11:54,321][123091] Updated weights for policy 0, policy_version 827689 (0.0005) [2023-12-26 06:11:54,796][123090] Updated weights for policy 1, policy_version 822022 (0.0010) [2023-12-26 06:11:54,859][123090] Updated weights for policy 1, policy_version 822032 (0.0010) [2023-12-26 06:11:54,917][123090] Updated weights for policy 1, policy_version 822042 (0.0010) [2023-12-26 06:11:54,990][123091] Updated weights for policy 0, policy_version 827699 (0.0006) [2023-12-26 06:11:55,043][123091] Updated weights for policy 0, policy_version 827709 (0.0009) [2023-12-26 06:11:55,108][123091] Updated weights for policy 0, policy_version 827719 (0.0009) [2023-12-26 06:11:55,776][123090] Updated weights for policy 1, policy_version 822052 (0.0010) [2023-12-26 06:11:55,835][123090] Updated weights for policy 1, policy_version 822062 (0.0009) [2023-12-26 06:11:55,887][123090] Updated weights for policy 1, policy_version 822072 (0.0010) [2023-12-26 06:11:55,939][123091] Updated weights for policy 0, policy_version 827729 (0.0008) [2023-12-26 06:11:55,985][123091] Updated weights for policy 0, policy_version 827739 (0.0005) [2023-12-26 06:11:56,038][123091] Updated weights for policy 0, policy_version 827749 (0.0005) [2023-12-26 06:11:56,085][123091] Updated weights for policy 0, policy_version 827759 (0.0005) [2023-12-26 06:11:56,696][123090] Updated weights for policy 1, policy_version 822082 (0.0009) [2023-12-26 06:11:56,765][123090] Updated weights for policy 1, policy_version 822092 (0.0005) [2023-12-26 06:11:56,835][123090] Updated weights for policy 1, policy_version 822102 (0.0008) [2023-12-26 06:11:56,885][123091] Updated weights for policy 0, policy_version 827769 (0.0008) [2023-12-26 06:11:56,895][123090] Updated weights for policy 1, policy_version 822112 (0.0008) [2023-12-26 06:11:56,945][123091] Updated weights for policy 0, policy_version 827779 (0.0009) [2023-12-26 06:11:57,008][123091] Updated weights for policy 0, policy_version 827789 (0.0009) [2023-12-26 06:11:57,609][123090] Updated weights for policy 1, policy_version 822123 (0.0010) [2023-12-26 06:11:57,657][123090] Updated weights for policy 1, policy_version 822133 (0.0009) [2023-12-26 06:11:57,713][123090] Updated weights for policy 1, policy_version 822144 (0.0009) [2023-12-26 06:11:57,751][123091] Updated weights for policy 0, policy_version 827799 (0.0009) [2023-12-26 06:11:57,802][123091] Updated weights for policy 0, policy_version 827809 (0.0009) [2023-12-26 06:11:57,850][123091] Updated weights for policy 0, policy_version 827819 (0.0009) [2023-12-26 06:11:58,525][123090] Updated weights for policy 1, policy_version 822154 (0.0008) [2023-12-26 06:11:58,591][123090] Updated weights for policy 1, policy_version 822164 (0.0008) [2023-12-26 06:11:58,664][123090] Updated weights for policy 1, policy_version 822174 (0.0008) [2023-12-26 06:11:58,708][123091] Updated weights for policy 0, policy_version 827829 (0.0008) [2023-12-26 06:11:58,783][123091] Updated weights for policy 0, policy_version 827839 (0.0008) [2023-12-26 06:11:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17613.6, 300 sec: 17772.5). Total num frames: 422404096. Throughput: 0: 8863.2, 1: 8779.2. Samples: 422399548. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:11:58,785][121949] Avg episode reward: [(0, '6099.881'), (1, '6023.254')] [2023-12-26 06:11:58,854][123091] Updated weights for policy 0, policy_version 827849 (0.0008) [2023-12-26 06:11:59,509][123090] Updated weights for policy 1, policy_version 822184 (0.0008) [2023-12-26 06:11:59,572][123090] Updated weights for policy 1, policy_version 822194 (0.0008) [2023-12-26 06:11:59,628][123090] Updated weights for policy 1, policy_version 822204 (0.0008) [2023-12-26 06:11:59,695][123091] Updated weights for policy 0, policy_version 827859 (0.0009) [2023-12-26 06:11:59,759][123091] Updated weights for policy 0, policy_version 827869 (0.0010) [2023-12-26 06:11:59,808][123091] Updated weights for policy 0, policy_version 827879 (0.0009) [2023-12-26 06:12:00,456][123090] Updated weights for policy 1, policy_version 822214 (0.0010) [2023-12-26 06:12:00,520][123090] Updated weights for policy 1, policy_version 822224 (0.0011) [2023-12-26 06:12:00,584][123090] Updated weights for policy 1, policy_version 822234 (0.0011) [2023-12-26 06:12:00,668][123091] Updated weights for policy 0, policy_version 827889 (0.0008) [2023-12-26 06:12:00,716][123091] Updated weights for policy 0, policy_version 827899 (0.0009) [2023-12-26 06:12:00,775][123091] Updated weights for policy 0, policy_version 827909 (0.0009) [2023-12-26 06:12:00,826][123091] Updated weights for policy 0, policy_version 827919 (0.0009) [2023-12-26 06:12:01,422][123090] Updated weights for policy 1, policy_version 822244 (0.0009) [2023-12-26 06:12:01,487][123090] Updated weights for policy 1, policy_version 822254 (0.0011) [2023-12-26 06:12:01,539][123090] Updated weights for policy 1, policy_version 822264 (0.0010) [2023-12-26 06:12:01,713][123091] Updated weights for policy 0, policy_version 827929 (0.0008) [2023-12-26 06:12:01,773][123091] Updated weights for policy 0, policy_version 827939 (0.0009) [2023-12-26 06:12:01,840][123091] Updated weights for policy 0, policy_version 827949 (0.0009) [2023-12-26 06:12:02,341][123090] Updated weights for policy 1, policy_version 822274 (0.0009) [2023-12-26 06:12:02,409][123090] Updated weights for policy 1, policy_version 822284 (0.0008) [2023-12-26 06:12:02,470][123090] Updated weights for policy 1, policy_version 822294 (0.0008) [2023-12-26 06:12:02,535][123090] Updated weights for policy 1, policy_version 822304 (0.0009) [2023-12-26 06:12:02,681][123091] Updated weights for policy 0, policy_version 827959 (0.0010) [2023-12-26 06:12:02,736][123091] Updated weights for policy 0, policy_version 827969 (0.0010) [2023-12-26 06:12:02,780][123091] Updated weights for policy 0, policy_version 827979 (0.0010) [2023-12-26 06:12:03,296][123090] Updated weights for policy 1, policy_version 822314 (0.0010) [2023-12-26 06:12:03,355][123090] Updated weights for policy 1, policy_version 822324 (0.0009) [2023-12-26 06:12:03,426][123090] Updated weights for policy 1, policy_version 822334 (0.0010) [2023-12-26 06:12:03,541][123091] Updated weights for policy 0, policy_version 827989 (0.0008) [2023-12-26 06:12:03,591][123091] Updated weights for policy 0, policy_version 827999 (0.0005) [2023-12-26 06:12:03,637][123091] Updated weights for policy 0, policy_version 828009 (0.0005) [2023-12-26 06:12:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 422494208. Throughput: 0: 8832.3, 1: 8675.5. Samples: 422501884. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:12:03,785][121949] Avg episode reward: [(0, '6286.217'), (1, '5986.094')] [2023-12-26 06:12:04,278][123091] Updated weights for policy 0, policy_version 828019 (0.0007) [2023-12-26 06:12:04,337][123091] Updated weights for policy 0, policy_version 828029 (0.0008) [2023-12-26 06:12:04,361][123090] Updated weights for policy 1, policy_version 822344 (0.0009) [2023-12-26 06:12:04,406][123091] Updated weights for policy 0, policy_version 828039 (0.0009) [2023-12-26 06:12:04,425][123090] Updated weights for policy 1, policy_version 822354 (0.0008) [2023-12-26 06:12:04,488][123090] Updated weights for policy 1, policy_version 822364 (0.0007) [2023-12-26 06:12:05,172][123091] Updated weights for policy 0, policy_version 828049 (0.0008) [2023-12-26 06:12:05,240][123091] Updated weights for policy 0, policy_version 828059 (0.0005) [2023-12-26 06:12:05,254][123090] Updated weights for policy 1, policy_version 822374 (0.0007) [2023-12-26 06:12:05,316][123091] Updated weights for policy 0, policy_version 828069 (0.0006) [2023-12-26 06:12:05,318][123090] Updated weights for policy 1, policy_version 822384 (0.0006) [2023-12-26 06:12:05,376][123091] Updated weights for policy 0, policy_version 828079 (0.0006) [2023-12-26 06:12:05,388][123090] Updated weights for policy 1, policy_version 822394 (0.0006) [2023-12-26 06:12:05,997][123090] Updated weights for policy 1, policy_version 822404 (0.0008) [2023-12-26 06:12:06,048][123091] Updated weights for policy 0, policy_version 828089 (0.0010) [2023-12-26 06:12:06,061][123090] Updated weights for policy 1, policy_version 822414 (0.0008) [2023-12-26 06:12:06,110][123091] Updated weights for policy 0, policy_version 828099 (0.0010) [2023-12-26 06:12:06,126][123090] Updated weights for policy 1, policy_version 822424 (0.0009) [2023-12-26 06:12:06,172][123091] Updated weights for policy 0, policy_version 828109 (0.0011) [2023-12-26 06:12:06,878][123090] Updated weights for policy 1, policy_version 822434 (0.0010) [2023-12-26 06:12:06,890][123091] Updated weights for policy 0, policy_version 828119 (0.0007) [2023-12-26 06:12:06,936][123090] Updated weights for policy 1, policy_version 822444 (0.0009) [2023-12-26 06:12:06,949][123091] Updated weights for policy 0, policy_version 828129 (0.0007) [2023-12-26 06:12:07,004][123090] Updated weights for policy 1, policy_version 822454 (0.0009) [2023-12-26 06:12:07,017][123091] Updated weights for policy 0, policy_version 828139 (0.0006) [2023-12-26 06:12:07,069][123090] Updated weights for policy 1, policy_version 822464 (0.0008) [2023-12-26 06:12:07,778][123091] Updated weights for policy 0, policy_version 828149 (0.0007) [2023-12-26 06:12:07,833][123091] Updated weights for policy 0, policy_version 828159 (0.0006) [2023-12-26 06:12:07,873][123090] Updated weights for policy 1, policy_version 822474 (0.0006) [2023-12-26 06:12:07,883][123091] Updated weights for policy 0, policy_version 828169 (0.0005) [2023-12-26 06:12:07,936][123090] Updated weights for policy 1, policy_version 822484 (0.0005) [2023-12-26 06:12:07,989][123090] Updated weights for policy 1, policy_version 822494 (0.0005) [2023-12-26 06:12:08,541][123091] Updated weights for policy 0, policy_version 828179 (0.0005) [2023-12-26 06:12:08,600][123091] Updated weights for policy 0, policy_version 828189 (0.0007) [2023-12-26 06:12:08,653][123091] Updated weights for policy 0, policy_version 828199 (0.0010) [2023-12-26 06:12:08,740][123090] Updated weights for policy 1, policy_version 822504 (0.0010) [2023-12-26 06:12:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 422584320. Throughput: 0: 8922.0, 1: 8739.9. Samples: 422558096. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:12:08,784][121949] Avg episode reward: [(0, '6233.282'), (1, '5987.116')] [2023-12-26 06:12:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000828208_212025344.pth... [2023-12-26 06:12:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000827152_211755008.pth [2023-12-26 06:12:08,806][123090] Updated weights for policy 1, policy_version 822514 (0.0010) [2023-12-26 06:12:08,870][123090] Updated weights for policy 1, policy_version 822524 (0.0011) [2023-12-26 06:12:08,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000822528_210567168.pth... [2023-12-26 06:12:08,895][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000821504_210305024.pth [2023-12-26 06:12:09,380][123091] Updated weights for policy 0, policy_version 828209 (0.0010) [2023-12-26 06:12:09,457][123091] Updated weights for policy 0, policy_version 828219 (0.0007) [2023-12-26 06:12:09,529][123091] Updated weights for policy 0, policy_version 828229 (0.0006) [2023-12-26 06:12:09,597][123091] Updated weights for policy 0, policy_version 828239 (0.0009) [2023-12-26 06:12:09,749][123090] Updated weights for policy 1, policy_version 822534 (0.0008) [2023-12-26 06:12:09,824][123090] Updated weights for policy 1, policy_version 822544 (0.0006) [2023-12-26 06:12:09,895][123090] Updated weights for policy 1, policy_version 822554 (0.0008) [2023-12-26 06:12:10,441][123091] Updated weights for policy 0, policy_version 828249 (0.0009) [2023-12-26 06:12:10,510][123091] Updated weights for policy 0, policy_version 828259 (0.0009) [2023-12-26 06:12:10,565][123091] Updated weights for policy 0, policy_version 828269 (0.0009) [2023-12-26 06:12:10,641][123090] Updated weights for policy 1, policy_version 822564 (0.0009) [2023-12-26 06:12:10,704][123090] Updated weights for policy 1, policy_version 822574 (0.0008) [2023-12-26 06:12:10,761][123090] Updated weights for policy 1, policy_version 822584 (0.0008) [2023-12-26 06:12:11,437][123091] Updated weights for policy 0, policy_version 828279 (0.0009) [2023-12-26 06:12:11,490][123091] Updated weights for policy 0, policy_version 828289 (0.0009) [2023-12-26 06:12:11,548][123091] Updated weights for policy 0, policy_version 828299 (0.0010) [2023-12-26 06:12:11,595][123090] Updated weights for policy 1, policy_version 822594 (0.0007) [2023-12-26 06:12:11,665][123090] Updated weights for policy 1, policy_version 822604 (0.0008) [2023-12-26 06:12:11,732][123090] Updated weights for policy 1, policy_version 822614 (0.0009) [2023-12-26 06:12:11,807][123090] Updated weights for policy 1, policy_version 822624 (0.0008) [2023-12-26 06:12:12,442][123091] Updated weights for policy 0, policy_version 828309 (0.0009) [2023-12-26 06:12:12,502][123091] Updated weights for policy 0, policy_version 828319 (0.0009) [2023-12-26 06:12:12,525][123090] Updated weights for policy 1, policy_version 822634 (0.0008) [2023-12-26 06:12:12,555][123091] Updated weights for policy 0, policy_version 828329 (0.0007) [2023-12-26 06:12:12,588][123090] Updated weights for policy 1, policy_version 822644 (0.0009) [2023-12-26 06:12:12,642][123090] Updated weights for policy 1, policy_version 822654 (0.0007) [2023-12-26 06:12:13,343][123090] Updated weights for policy 1, policy_version 822664 (0.0009) [2023-12-26 06:12:13,412][123090] Updated weights for policy 1, policy_version 822674 (0.0009) [2023-12-26 06:12:13,432][123091] Updated weights for policy 0, policy_version 828339 (0.0008) [2023-12-26 06:12:13,472][123090] Updated weights for policy 1, policy_version 822684 (0.0010) [2023-12-26 06:12:13,483][123091] Updated weights for policy 0, policy_version 828349 (0.0008) [2023-12-26 06:12:13,539][123091] Updated weights for policy 0, policy_version 828359 (0.0009) [2023-12-26 06:12:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 422674432. Throughput: 0: 8840.5, 1: 8760.2. Samples: 422664144. Policy #0 lag: (min: 22.0, avg: 35.3, max: 54.0) [2023-12-26 06:12:13,785][121949] Avg episode reward: [(0, '6143.237'), (1, '5981.495')] [2023-12-26 06:12:14,259][123090] Updated weights for policy 1, policy_version 822694 (0.0006) [2023-12-26 06:12:14,311][123090] Updated weights for policy 1, policy_version 822704 (0.0005) [2023-12-26 06:12:14,370][123090] Updated weights for policy 1, policy_version 822715 (0.0008) [2023-12-26 06:12:14,414][123091] Updated weights for policy 0, policy_version 828369 (0.0009) [2023-12-26 06:12:14,471][123091] Updated weights for policy 0, policy_version 828379 (0.0009) [2023-12-26 06:12:14,527][123091] Updated weights for policy 0, policy_version 828389 (0.0009) [2023-12-26 06:12:14,597][123091] Updated weights for policy 0, policy_version 828399 (0.0005) [2023-12-26 06:12:15,217][123090] Updated weights for policy 1, policy_version 822725 (0.0009) [2023-12-26 06:12:15,282][123090] Updated weights for policy 1, policy_version 822735 (0.0009) [2023-12-26 06:12:15,356][123090] Updated weights for policy 1, policy_version 822745 (0.0008) [2023-12-26 06:12:15,377][123091] Updated weights for policy 0, policy_version 828409 (0.0005) [2023-12-26 06:12:15,436][123091] Updated weights for policy 0, policy_version 828419 (0.0005) [2023-12-26 06:12:15,492][123091] Updated weights for policy 0, policy_version 828429 (0.0008) [2023-12-26 06:12:16,068][123090] Updated weights for policy 1, policy_version 822755 (0.0007) [2023-12-26 06:12:16,127][123090] Updated weights for policy 1, policy_version 822765 (0.0005) [2023-12-26 06:12:16,178][123091] Updated weights for policy 0, policy_version 828439 (0.0007) [2023-12-26 06:12:16,179][123090] Updated weights for policy 1, policy_version 822775 (0.0005) [2023-12-26 06:12:16,232][123091] Updated weights for policy 0, policy_version 828449 (0.0008) [2023-12-26 06:12:16,281][123091] Updated weights for policy 0, policy_version 828459 (0.0010) [2023-12-26 06:12:16,828][123090] Updated weights for policy 1, policy_version 822785 (0.0005) [2023-12-26 06:12:16,888][123090] Updated weights for policy 1, policy_version 822795 (0.0005) [2023-12-26 06:12:16,944][123090] Updated weights for policy 1, policy_version 822805 (0.0005) [2023-12-26 06:12:17,020][123090] Updated weights for policy 1, policy_version 822815 (0.0005) [2023-12-26 06:12:17,140][123091] Updated weights for policy 0, policy_version 828469 (0.0008) [2023-12-26 06:12:17,215][123091] Updated weights for policy 0, policy_version 828479 (0.0005) [2023-12-26 06:12:17,282][123091] Updated weights for policy 0, policy_version 828489 (0.0005) [2023-12-26 06:12:17,763][123090] Updated weights for policy 1, policy_version 822826 (0.0010) [2023-12-26 06:12:17,821][123090] Updated weights for policy 1, policy_version 822836 (0.0010) [2023-12-26 06:12:17,872][123090] Updated weights for policy 1, policy_version 822846 (0.0009) [2023-12-26 06:12:17,984][123091] Updated weights for policy 0, policy_version 828499 (0.0007) [2023-12-26 06:12:18,033][123091] Updated weights for policy 0, policy_version 828509 (0.0011) [2023-12-26 06:12:18,081][123091] Updated weights for policy 0, policy_version 828519 (0.0010) [2023-12-26 06:12:18,628][123090] Updated weights for policy 1, policy_version 822856 (0.0006) [2023-12-26 06:12:18,679][123090] Updated weights for policy 1, policy_version 822866 (0.0005) [2023-12-26 06:12:18,733][123090] Updated weights for policy 1, policy_version 822876 (0.0006) [2023-12-26 06:12:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 422764544. Throughput: 0: 8866.3, 1: 8859.7. Samples: 422773812. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:18,785][121949] Avg episode reward: [(0, '6224.163'), (1, '5980.726')] [2023-12-26 06:12:18,923][123091] Updated weights for policy 0, policy_version 828529 (0.0010) [2023-12-26 06:12:19,003][123091] Updated weights for policy 0, policy_version 828539 (0.0006) [2023-12-26 06:12:19,077][123091] Updated weights for policy 0, policy_version 828549 (0.0005) [2023-12-26 06:12:19,142][123091] Updated weights for policy 0, policy_version 828559 (0.0006) [2023-12-26 06:12:19,415][123090] Updated weights for policy 1, policy_version 822886 (0.0007) [2023-12-26 06:12:19,463][123090] Updated weights for policy 1, policy_version 822896 (0.0008) [2023-12-26 06:12:19,529][123090] Updated weights for policy 1, policy_version 822906 (0.0008) [2023-12-26 06:12:19,870][123091] Updated weights for policy 0, policy_version 828569 (0.0010) [2023-12-26 06:12:19,940][123091] Updated weights for policy 0, policy_version 828579 (0.0010) [2023-12-26 06:12:20,001][123091] Updated weights for policy 0, policy_version 828589 (0.0009) [2023-12-26 06:12:20,388][123090] Updated weights for policy 1, policy_version 822916 (0.0009) [2023-12-26 06:12:20,439][123090] Updated weights for policy 1, policy_version 822926 (0.0009) [2023-12-26 06:12:20,498][123090] Updated weights for policy 1, policy_version 822936 (0.0010) [2023-12-26 06:12:20,766][123091] Updated weights for policy 0, policy_version 828599 (0.0007) [2023-12-26 06:12:20,827][123091] Updated weights for policy 0, policy_version 828609 (0.0006) [2023-12-26 06:12:20,900][123091] Updated weights for policy 0, policy_version 828619 (0.0008) [2023-12-26 06:12:21,378][123090] Updated weights for policy 1, policy_version 822946 (0.0010) [2023-12-26 06:12:21,447][123090] Updated weights for policy 1, policy_version 822956 (0.0010) [2023-12-26 06:12:21,511][123090] Updated weights for policy 1, policy_version 822966 (0.0009) [2023-12-26 06:12:21,574][123090] Updated weights for policy 1, policy_version 822976 (0.0009) [2023-12-26 06:12:21,650][123091] Updated weights for policy 0, policy_version 828629 (0.0008) [2023-12-26 06:12:21,712][123091] Updated weights for policy 0, policy_version 828639 (0.0009) [2023-12-26 06:12:21,776][123091] Updated weights for policy 0, policy_version 828649 (0.0010) [2023-12-26 06:12:22,399][123090] Updated weights for policy 1, policy_version 822986 (0.0009) [2023-12-26 06:12:22,470][123090] Updated weights for policy 1, policy_version 822996 (0.0010) [2023-12-26 06:12:22,545][123090] Updated weights for policy 1, policy_version 823006 (0.0010) [2023-12-26 06:12:22,657][123091] Updated weights for policy 0, policy_version 828659 (0.0009) [2023-12-26 06:12:22,722][123091] Updated weights for policy 0, policy_version 828669 (0.0008) [2023-12-26 06:12:22,790][123091] Updated weights for policy 0, policy_version 828679 (0.0009) [2023-12-26 06:12:23,382][123090] Updated weights for policy 1, policy_version 823016 (0.0008) [2023-12-26 06:12:23,445][123090] Updated weights for policy 1, policy_version 823026 (0.0005) [2023-12-26 06:12:23,490][123091] Updated weights for policy 0, policy_version 828689 (0.0010) [2023-12-26 06:12:23,514][123090] Updated weights for policy 1, policy_version 823036 (0.0005) [2023-12-26 06:12:23,560][123091] Updated weights for policy 0, policy_version 828699 (0.0008) [2023-12-26 06:12:23,631][123091] Updated weights for policy 0, policy_version 828709 (0.0007) [2023-12-26 06:12:23,698][123091] Updated weights for policy 0, policy_version 828719 (0.0008) [2023-12-26 06:12:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 422854656. Throughput: 0: 8908.7, 1: 8813.1. Samples: 422827068. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:23,785][121949] Avg episode reward: [(0, '6307.835'), (1, '5900.889')] [2023-12-26 06:12:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000828720_212156416.pth... [2023-12-26 06:12:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000823040_210698240.pth... [2023-12-26 06:12:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000822016_210436096.pth [2023-12-26 06:12:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000827664_211886080.pth [2023-12-26 06:12:24,320][123090] Updated weights for policy 1, policy_version 823046 (0.0008) [2023-12-26 06:12:24,388][123090] Updated weights for policy 1, policy_version 823056 (0.0010) [2023-12-26 06:12:24,388][123091] Updated weights for policy 0, policy_version 828729 (0.0008) [2023-12-26 06:12:24,446][123091] Updated weights for policy 0, policy_version 828739 (0.0008) [2023-12-26 06:12:24,447][123090] Updated weights for policy 1, policy_version 823066 (0.0010) [2023-12-26 06:12:24,517][123091] Updated weights for policy 0, policy_version 828749 (0.0009) [2023-12-26 06:12:25,258][123090] Updated weights for policy 1, policy_version 823076 (0.0008) [2023-12-26 06:12:25,292][123091] Updated weights for policy 0, policy_version 828759 (0.0009) [2023-12-26 06:12:25,323][123090] Updated weights for policy 1, policy_version 823086 (0.0006) [2023-12-26 06:12:25,340][123091] Updated weights for policy 0, policy_version 828769 (0.0009) [2023-12-26 06:12:25,373][123090] Updated weights for policy 1, policy_version 823096 (0.0005) [2023-12-26 06:12:25,398][123091] Updated weights for policy 0, policy_version 828779 (0.0009) [2023-12-26 06:12:26,042][123090] Updated weights for policy 1, policy_version 823106 (0.0008) [2023-12-26 06:12:26,100][123090] Updated weights for policy 1, policy_version 823116 (0.0005) [2023-12-26 06:12:26,121][123091] Updated weights for policy 0, policy_version 828789 (0.0006) [2023-12-26 06:12:26,156][123090] Updated weights for policy 1, policy_version 823126 (0.0006) [2023-12-26 06:12:26,176][123091] Updated weights for policy 0, policy_version 828799 (0.0005) [2023-12-26 06:12:26,209][123090] Updated weights for policy 1, policy_version 823136 (0.0009) [2023-12-26 06:12:26,237][123091] Updated weights for policy 0, policy_version 828809 (0.0005) [2023-12-26 06:12:26,998][123091] Updated weights for policy 0, policy_version 828819 (0.0007) [2023-12-26 06:12:27,050][123091] Updated weights for policy 0, policy_version 828829 (0.0011) [2023-12-26 06:12:27,061][123090] Updated weights for policy 1, policy_version 823146 (0.0008) [2023-12-26 06:12:27,098][123091] Updated weights for policy 0, policy_version 828839 (0.0010) [2023-12-26 06:12:27,113][123090] Updated weights for policy 1, policy_version 823156 (0.0006) [2023-12-26 06:12:27,181][123090] Updated weights for policy 1, policy_version 823166 (0.0007) [2023-12-26 06:12:27,847][123091] Updated weights for policy 0, policy_version 828849 (0.0010) [2023-12-26 06:12:27,913][123091] Updated weights for policy 0, policy_version 828859 (0.0008) [2023-12-26 06:12:27,924][123090] Updated weights for policy 1, policy_version 823176 (0.0006) [2023-12-26 06:12:27,984][123091] Updated weights for policy 0, policy_version 828869 (0.0007) [2023-12-26 06:12:27,987][123090] Updated weights for policy 1, policy_version 823186 (0.0005) [2023-12-26 06:12:28,052][123091] Updated weights for policy 0, policy_version 828879 (0.0006) [2023-12-26 06:12:28,066][123090] Updated weights for policy 1, policy_version 823196 (0.0005) [2023-12-26 06:12:28,664][123090] Updated weights for policy 1, policy_version 823206 (0.0007) [2023-12-26 06:12:28,717][123090] Updated weights for policy 1, policy_version 823216 (0.0007) [2023-12-26 06:12:28,780][123090] Updated weights for policy 1, policy_version 823226 (0.0006) [2023-12-26 06:12:28,782][123091] Updated weights for policy 0, policy_version 828889 (0.0009) [2023-12-26 06:12:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 422936576. Throughput: 0: 8961.8, 1: 8806.7. Samples: 422935604. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:28,785][121949] Avg episode reward: [(0, '6103.155'), (1, '5724.382')] [2023-12-26 06:12:28,849][123091] Updated weights for policy 0, policy_version 828899 (0.0009) [2023-12-26 06:12:28,907][123091] Updated weights for policy 0, policy_version 828909 (0.0010) [2023-12-26 06:12:29,605][123090] Updated weights for policy 1, policy_version 823236 (0.0006) [2023-12-26 06:12:29,628][123091] Updated weights for policy 0, policy_version 828919 (0.0010) [2023-12-26 06:12:29,657][123090] Updated weights for policy 1, policy_version 823246 (0.0006) [2023-12-26 06:12:29,675][123091] Updated weights for policy 0, policy_version 828929 (0.0010) [2023-12-26 06:12:29,707][123090] Updated weights for policy 1, policy_version 823256 (0.0009) [2023-12-26 06:12:29,734][123091] Updated weights for policy 0, policy_version 828939 (0.0010) [2023-12-26 06:12:30,549][123091] Updated weights for policy 0, policy_version 828949 (0.0010) [2023-12-26 06:12:30,597][123090] Updated weights for policy 1, policy_version 823266 (0.0007) [2023-12-26 06:12:30,604][123091] Updated weights for policy 0, policy_version 828959 (0.0010) [2023-12-26 06:12:30,655][123090] Updated weights for policy 1, policy_version 823276 (0.0009) [2023-12-26 06:12:30,666][123091] Updated weights for policy 0, policy_version 828969 (0.0009) [2023-12-26 06:12:30,720][123090] Updated weights for policy 1, policy_version 823286 (0.0010) [2023-12-26 06:12:30,787][123090] Updated weights for policy 1, policy_version 823296 (0.0009) [2023-12-26 06:12:31,476][123091] Updated weights for policy 0, policy_version 828979 (0.0009) [2023-12-26 06:12:31,531][123091] Updated weights for policy 0, policy_version 828989 (0.0010) [2023-12-26 06:12:31,578][123090] Updated weights for policy 1, policy_version 823306 (0.0009) [2023-12-26 06:12:31,592][123091] Updated weights for policy 0, policy_version 828999 (0.0008) [2023-12-26 06:12:31,641][123090] Updated weights for policy 1, policy_version 823316 (0.0010) [2023-12-26 06:12:31,709][123090] Updated weights for policy 1, policy_version 823326 (0.0009) [2023-12-26 06:12:32,392][123090] Updated weights for policy 1, policy_version 823336 (0.0009) [2023-12-26 06:12:32,429][123091] Updated weights for policy 0, policy_version 829009 (0.0009) [2023-12-26 06:12:32,452][123090] Updated weights for policy 1, policy_version 823346 (0.0010) [2023-12-26 06:12:32,487][123091] Updated weights for policy 0, policy_version 829019 (0.0011) [2023-12-26 06:12:32,522][123090] Updated weights for policy 1, policy_version 823356 (0.0010) [2023-12-26 06:12:32,552][123091] Updated weights for policy 0, policy_version 829029 (0.0011) [2023-12-26 06:12:32,610][123091] Updated weights for policy 0, policy_version 829039 (0.0010) [2023-12-26 06:12:33,235][123090] Updated weights for policy 1, policy_version 823366 (0.0007) [2023-12-26 06:12:33,281][123090] Updated weights for policy 1, policy_version 823376 (0.0005) [2023-12-26 06:12:33,337][123090] Updated weights for policy 1, policy_version 823386 (0.0006) [2023-12-26 06:12:33,418][123091] Updated weights for policy 0, policy_version 829049 (0.0011) [2023-12-26 06:12:33,468][123091] Updated weights for policy 0, policy_version 829059 (0.0010) [2023-12-26 06:12:33,519][123091] Updated weights for policy 0, policy_version 829069 (0.0010) [2023-12-26 06:12:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 423034880. Throughput: 0: 8962.7, 1: 8889.0. Samples: 423044824. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:33,785][121949] Avg episode reward: [(0, '6113.900'), (1, '5805.812')] [2023-12-26 06:12:34,006][123090] Updated weights for policy 1, policy_version 823396 (0.0008) [2023-12-26 06:12:34,055][123090] Updated weights for policy 1, policy_version 823406 (0.0005) [2023-12-26 06:12:34,102][123090] Updated weights for policy 1, policy_version 823416 (0.0005) [2023-12-26 06:12:34,338][123091] Updated weights for policy 0, policy_version 829079 (0.0010) [2023-12-26 06:12:34,404][123091] Updated weights for policy 0, policy_version 829089 (0.0011) [2023-12-26 06:12:34,471][123091] Updated weights for policy 0, policy_version 829099 (0.0011) [2023-12-26 06:12:34,835][123090] Updated weights for policy 1, policy_version 823426 (0.0007) [2023-12-26 06:12:34,902][123090] Updated weights for policy 1, policy_version 823436 (0.0010) [2023-12-26 06:12:34,973][123090] Updated weights for policy 1, policy_version 823446 (0.0010) [2023-12-26 06:12:35,038][123090] Updated weights for policy 1, policy_version 823456 (0.0010) [2023-12-26 06:12:35,289][123091] Updated weights for policy 0, policy_version 829109 (0.0010) [2023-12-26 06:12:35,340][123091] Updated weights for policy 0, policy_version 829119 (0.0010) [2023-12-26 06:12:35,394][123091] Updated weights for policy 0, policy_version 829129 (0.0007) [2023-12-26 06:12:35,769][123090] Updated weights for policy 1, policy_version 823466 (0.0010) [2023-12-26 06:12:35,815][123090] Updated weights for policy 1, policy_version 823476 (0.0010) [2023-12-26 06:12:35,870][123090] Updated weights for policy 1, policy_version 823486 (0.0009) [2023-12-26 06:12:36,097][123091] Updated weights for policy 0, policy_version 829139 (0.0007) [2023-12-26 06:12:36,164][123091] Updated weights for policy 0, policy_version 829149 (0.0007) [2023-12-26 06:12:36,236][123091] Updated weights for policy 0, policy_version 829159 (0.0006) [2023-12-26 06:12:36,719][123090] Updated weights for policy 1, policy_version 823496 (0.0009) [2023-12-26 06:12:36,772][123090] Updated weights for policy 1, policy_version 823506 (0.0010) [2023-12-26 06:12:36,824][123090] Updated weights for policy 1, policy_version 823516 (0.0009) [2023-12-26 06:12:36,941][123091] Updated weights for policy 0, policy_version 829169 (0.0006) [2023-12-26 06:12:37,007][123091] Updated weights for policy 0, policy_version 829179 (0.0005) [2023-12-26 06:12:37,066][123091] Updated weights for policy 0, policy_version 829189 (0.0008) [2023-12-26 06:12:37,124][123091] Updated weights for policy 0, policy_version 829200 (0.0008) [2023-12-26 06:12:37,510][123090] Updated weights for policy 1, policy_version 823526 (0.0007) [2023-12-26 06:12:37,583][123090] Updated weights for policy 1, policy_version 823536 (0.0005) [2023-12-26 06:12:37,646][123090] Updated weights for policy 1, policy_version 823546 (0.0010) [2023-12-26 06:12:37,976][123091] Updated weights for policy 0, policy_version 829210 (0.0009) [2023-12-26 06:12:38,025][123091] Updated weights for policy 0, policy_version 829220 (0.0009) [2023-12-26 06:12:38,081][123091] Updated weights for policy 0, policy_version 829230 (0.0006) [2023-12-26 06:12:38,369][123090] Updated weights for policy 1, policy_version 823556 (0.0010) [2023-12-26 06:12:38,435][123090] Updated weights for policy 1, policy_version 823566 (0.0008) [2023-12-26 06:12:38,504][123090] Updated weights for policy 1, policy_version 823576 (0.0011) [2023-12-26 06:12:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 423124992. Throughput: 0: 9018.8, 1: 8945.7. Samples: 423101160. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:38,785][121949] Avg episode reward: [(0, '6050.963'), (1, '5643.480')] [2023-12-26 06:12:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000823584_210837504.pth... [2023-12-26 06:12:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000822528_210567168.pth [2023-12-26 06:12:38,846][123091] Updated weights for policy 0, policy_version 829240 (0.0009) [2023-12-26 06:12:38,906][123091] Updated weights for policy 0, policy_version 829250 (0.0009) [2023-12-26 06:12:38,966][123091] Updated weights for policy 0, policy_version 829260 (0.0009) [2023-12-26 06:12:38,989][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000829264_212295680.pth... [2023-12-26 06:12:38,994][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000828208_212025344.pth [2023-12-26 06:12:39,319][123090] Updated weights for policy 1, policy_version 823586 (0.0011) [2023-12-26 06:12:39,387][123090] Updated weights for policy 1, policy_version 823596 (0.0009) [2023-12-26 06:12:39,456][123090] Updated weights for policy 1, policy_version 823606 (0.0010) [2023-12-26 06:12:39,523][123090] Updated weights for policy 1, policy_version 823616 (0.0010) [2023-12-26 06:12:39,794][123091] Updated weights for policy 0, policy_version 829270 (0.0008) [2023-12-26 06:12:39,864][123091] Updated weights for policy 0, policy_version 829280 (0.0010) [2023-12-26 06:12:39,926][123091] Updated weights for policy 0, policy_version 829290 (0.0009) [2023-12-26 06:12:40,398][123090] Updated weights for policy 1, policy_version 823626 (0.0007) [2023-12-26 06:12:40,455][123090] Updated weights for policy 1, policy_version 823636 (0.0010) [2023-12-26 06:12:40,518][123090] Updated weights for policy 1, policy_version 823646 (0.0008) [2023-12-26 06:12:40,684][123091] Updated weights for policy 0, policy_version 829300 (0.0008) [2023-12-26 06:12:40,751][123091] Updated weights for policy 0, policy_version 829310 (0.0008) [2023-12-26 06:12:40,818][123091] Updated weights for policy 0, policy_version 829320 (0.0010) [2023-12-26 06:12:41,379][123090] Updated weights for policy 1, policy_version 823656 (0.0008) [2023-12-26 06:12:41,450][123090] Updated weights for policy 1, policy_version 823666 (0.0009) [2023-12-26 06:12:41,522][123090] Updated weights for policy 1, policy_version 823676 (0.0009) [2023-12-26 06:12:41,610][123091] Updated weights for policy 0, policy_version 829330 (0.0009) [2023-12-26 06:12:41,677][123091] Updated weights for policy 0, policy_version 829340 (0.0009) [2023-12-26 06:12:41,751][123091] Updated weights for policy 0, policy_version 829350 (0.0008) [2023-12-26 06:12:41,828][123091] Updated weights for policy 0, policy_version 829360 (0.0006) [2023-12-26 06:12:42,408][123090] Updated weights for policy 1, policy_version 823686 (0.0008) [2023-12-26 06:12:42,474][123090] Updated weights for policy 1, policy_version 823696 (0.0005) [2023-12-26 06:12:42,534][123090] Updated weights for policy 1, policy_version 823706 (0.0007) [2023-12-26 06:12:42,547][123091] Updated weights for policy 0, policy_version 829370 (0.0006) [2023-12-26 06:12:42,614][123091] Updated weights for policy 0, policy_version 829380 (0.0006) [2023-12-26 06:12:42,679][123091] Updated weights for policy 0, policy_version 829390 (0.0010) [2023-12-26 06:12:43,316][123090] Updated weights for policy 1, policy_version 823716 (0.0008) [2023-12-26 06:12:43,372][123090] Updated weights for policy 1, policy_version 823726 (0.0009) [2023-12-26 06:12:43,431][123090] Updated weights for policy 1, policy_version 823736 (0.0009) [2023-12-26 06:12:43,491][123091] Updated weights for policy 0, policy_version 829400 (0.0008) [2023-12-26 06:12:43,551][123091] Updated weights for policy 0, policy_version 829410 (0.0010) [2023-12-26 06:12:43,615][123091] Updated weights for policy 0, policy_version 829420 (0.0009) [2023-12-26 06:12:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 423215104. Throughput: 0: 8950.5, 1: 8949.0. Samples: 423205024. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:43,785][121949] Avg episode reward: [(0, '6033.337'), (1, '5562.344')] [2023-12-26 06:12:44,265][123090] Updated weights for policy 1, policy_version 823746 (0.0010) [2023-12-26 06:12:44,317][123090] Updated weights for policy 1, policy_version 823756 (0.0008) [2023-12-26 06:12:44,371][123090] Updated weights for policy 1, policy_version 823766 (0.0009) [2023-12-26 06:12:44,427][123091] Updated weights for policy 0, policy_version 829430 (0.0009) [2023-12-26 06:12:44,431][123090] Updated weights for policy 1, policy_version 823776 (0.0008) [2023-12-26 06:12:44,477][123091] Updated weights for policy 0, policy_version 829440 (0.0007) [2023-12-26 06:12:44,529][123091] Updated weights for policy 0, policy_version 829450 (0.0005) [2023-12-26 06:12:45,251][123090] Updated weights for policy 1, policy_version 823786 (0.0008) [2023-12-26 06:12:45,306][123090] Updated weights for policy 1, policy_version 823796 (0.0008) [2023-12-26 06:12:45,329][123091] Updated weights for policy 0, policy_version 829460 (0.0006) [2023-12-26 06:12:45,366][123090] Updated weights for policy 1, policy_version 823806 (0.0006) [2023-12-26 06:12:45,404][123091] Updated weights for policy 0, policy_version 829470 (0.0007) [2023-12-26 06:12:45,477][123091] Updated weights for policy 0, policy_version 829480 (0.0008) [2023-12-26 06:12:45,989][123090] Updated weights for policy 1, policy_version 823816 (0.0005) [2023-12-26 06:12:46,058][123090] Updated weights for policy 1, policy_version 823826 (0.0006) [2023-12-26 06:12:46,077][123091] Updated weights for policy 0, policy_version 829490 (0.0006) [2023-12-26 06:12:46,125][123090] Updated weights for policy 1, policy_version 823836 (0.0006) [2023-12-26 06:12:46,150][123091] Updated weights for policy 0, policy_version 829500 (0.0007) [2023-12-26 06:12:46,212][123091] Updated weights for policy 0, policy_version 829510 (0.0006) [2023-12-26 06:12:46,268][123091] Updated weights for policy 0, policy_version 829520 (0.0009) [2023-12-26 06:12:46,946][123090] Updated weights for policy 1, policy_version 823846 (0.0009) [2023-12-26 06:12:46,978][123091] Updated weights for policy 0, policy_version 829530 (0.0005) [2023-12-26 06:12:46,996][123090] Updated weights for policy 1, policy_version 823856 (0.0009) [2023-12-26 06:12:47,040][123091] Updated weights for policy 0, policy_version 829540 (0.0005) [2023-12-26 06:12:47,042][123090] Updated weights for policy 1, policy_version 823866 (0.0008) [2023-12-26 06:12:47,110][123091] Updated weights for policy 0, policy_version 829550 (0.0005) [2023-12-26 06:12:47,871][123091] Updated weights for policy 0, policy_version 829560 (0.0008) [2023-12-26 06:12:47,898][123090] Updated weights for policy 1, policy_version 823876 (0.0005) [2023-12-26 06:12:47,923][123091] Updated weights for policy 0, policy_version 829571 (0.0010) [2023-12-26 06:12:47,943][123090] Updated weights for policy 1, policy_version 823886 (0.0006) [2023-12-26 06:12:47,968][123091] Updated weights for policy 0, policy_version 829581 (0.0007) [2023-12-26 06:12:47,988][123090] Updated weights for policy 1, policy_version 823896 (0.0007) [2023-12-26 06:12:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 423297024. Throughput: 0: 9035.4, 1: 8987.9. Samples: 423312932. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:48,784][121949] Avg episode reward: [(0, '6186.034'), (1, '5697.998')] [2023-12-26 06:12:48,823][123091] Updated weights for policy 0, policy_version 829591 (0.0009) [2023-12-26 06:12:48,843][123090] Updated weights for policy 1, policy_version 823906 (0.0009) [2023-12-26 06:12:48,889][123091] Updated weights for policy 0, policy_version 829601 (0.0008) [2023-12-26 06:12:48,895][123090] Updated weights for policy 1, policy_version 823916 (0.0009) [2023-12-26 06:12:48,961][123091] Updated weights for policy 0, policy_version 829611 (0.0006) [2023-12-26 06:12:48,962][123090] Updated weights for policy 1, policy_version 823926 (0.0008) [2023-12-26 06:12:49,027][123090] Updated weights for policy 1, policy_version 823936 (0.0010) [2023-12-26 06:12:49,790][123091] Updated weights for policy 0, policy_version 829621 (0.0009) [2023-12-26 06:12:49,859][123091] Updated weights for policy 0, policy_version 829631 (0.0009) [2023-12-26 06:12:49,865][123090] Updated weights for policy 1, policy_version 823946 (0.0008) [2023-12-26 06:12:49,930][123091] Updated weights for policy 0, policy_version 829641 (0.0008) [2023-12-26 06:12:49,936][123090] Updated weights for policy 1, policy_version 823956 (0.0008) [2023-12-26 06:12:50,010][123090] Updated weights for policy 1, policy_version 823966 (0.0008) [2023-12-26 06:12:50,743][123091] Updated weights for policy 0, policy_version 829651 (0.0009) [2023-12-26 06:12:50,810][123091] Updated weights for policy 0, policy_version 829661 (0.0010) [2023-12-26 06:12:50,868][123090] Updated weights for policy 1, policy_version 823976 (0.0008) [2023-12-26 06:12:50,874][123091] Updated weights for policy 0, policy_version 829671 (0.0010) [2023-12-26 06:12:50,937][123090] Updated weights for policy 1, policy_version 823986 (0.0009) [2023-12-26 06:12:50,997][123090] Updated weights for policy 1, policy_version 823996 (0.0010) [2023-12-26 06:12:51,728][123091] Updated weights for policy 0, policy_version 829681 (0.0007) [2023-12-26 06:12:51,797][123091] Updated weights for policy 0, policy_version 829691 (0.0010) [2023-12-26 06:12:51,860][123091] Updated weights for policy 0, policy_version 829701 (0.0009) [2023-12-26 06:12:51,870][123090] Updated weights for policy 1, policy_version 824006 (0.0009) [2023-12-26 06:12:51,925][123091] Updated weights for policy 0, policy_version 829711 (0.0006) [2023-12-26 06:12:51,959][123090] Updated weights for policy 1, policy_version 824016 (0.0007) [2023-12-26 06:12:52,010][123090] Updated weights for policy 1, policy_version 824026 (0.0010) [2023-12-26 06:12:52,783][123090] Updated weights for policy 1, policy_version 824036 (0.0010) [2023-12-26 06:12:52,815][123091] Updated weights for policy 0, policy_version 829721 (0.0009) [2023-12-26 06:12:52,846][123090] Updated weights for policy 1, policy_version 824046 (0.0008) [2023-12-26 06:12:52,880][123091] Updated weights for policy 0, policy_version 829731 (0.0010) [2023-12-26 06:12:52,919][123090] Updated weights for policy 1, policy_version 824056 (0.0005) [2023-12-26 06:12:52,945][123091] Updated weights for policy 0, policy_version 829741 (0.0009) [2023-12-26 06:12:53,699][123090] Updated weights for policy 1, policy_version 824066 (0.0005) [2023-12-26 06:12:53,728][123091] Updated weights for policy 0, policy_version 829751 (0.0009) [2023-12-26 06:12:53,758][123090] Updated weights for policy 1, policy_version 824076 (0.0007) [2023-12-26 06:12:53,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 423378944. Throughput: 0: 8947.9, 1: 8939.6. Samples: 423363032. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:53,784][121949] Avg episode reward: [(0, '6029.547'), (1, '5493.207')] [2023-12-26 06:12:53,787][123091] Updated weights for policy 0, policy_version 829761 (0.0009) [2023-12-26 06:12:53,808][123090] Updated weights for policy 1, policy_version 824086 (0.0008) [2023-12-26 06:12:53,837][123091] Updated weights for policy 0, policy_version 829771 (0.0008) [2023-12-26 06:12:53,851][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000824096_210968576.pth... [2023-12-26 06:12:53,852][123090] Updated weights for policy 1, policy_version 824096 (0.0007) [2023-12-26 06:12:53,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000823040_210698240.pth [2023-12-26 06:12:53,860][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000829776_212426752.pth... [2023-12-26 06:12:53,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000828720_212156416.pth [2023-12-26 06:12:54,653][123090] Updated weights for policy 1, policy_version 824106 (0.0010) [2023-12-26 06:12:54,704][123090] Updated weights for policy 1, policy_version 824116 (0.0010) [2023-12-26 06:12:54,720][123091] Updated weights for policy 0, policy_version 829781 (0.0006) [2023-12-26 06:12:54,752][123090] Updated weights for policy 1, policy_version 824126 (0.0010) [2023-12-26 06:12:54,768][123091] Updated weights for policy 0, policy_version 829791 (0.0006) [2023-12-26 06:12:54,821][123091] Updated weights for policy 0, policy_version 829801 (0.0009) [2023-12-26 06:12:55,629][123090] Updated weights for policy 1, policy_version 824136 (0.0011) [2023-12-26 06:12:55,653][123091] Updated weights for policy 0, policy_version 829812 (0.0008) [2023-12-26 06:12:55,690][123090] Updated weights for policy 1, policy_version 824146 (0.0007) [2023-12-26 06:12:55,705][123091] Updated weights for policy 0, policy_version 829822 (0.0010) [2023-12-26 06:12:55,759][123090] Updated weights for policy 1, policy_version 824156 (0.0006) [2023-12-26 06:12:55,760][123091] Updated weights for policy 0, policy_version 829832 (0.0010) [2023-12-26 06:12:56,381][123090] Updated weights for policy 1, policy_version 824166 (0.0009) [2023-12-26 06:12:56,433][123090] Updated weights for policy 1, policy_version 824176 (0.0010) [2023-12-26 06:12:56,488][123090] Updated weights for policy 1, policy_version 824186 (0.0010) [2023-12-26 06:12:56,513][123091] Updated weights for policy 0, policy_version 829842 (0.0010) [2023-12-26 06:12:56,560][123091] Updated weights for policy 0, policy_version 829852 (0.0010) [2023-12-26 06:12:56,611][123091] Updated weights for policy 0, policy_version 829862 (0.0010) [2023-12-26 06:12:56,661][123091] Updated weights for policy 0, policy_version 829872 (0.0010) [2023-12-26 06:12:57,346][123090] Updated weights for policy 1, policy_version 824196 (0.0009) [2023-12-26 06:12:57,408][123091] Updated weights for policy 0, policy_version 829882 (0.0008) [2023-12-26 06:12:57,409][123090] Updated weights for policy 1, policy_version 824206 (0.0009) [2023-12-26 06:12:57,458][123091] Updated weights for policy 0, policy_version 829892 (0.0007) [2023-12-26 06:12:57,464][123090] Updated weights for policy 1, policy_version 824216 (0.0010) [2023-12-26 06:12:57,506][123091] Updated weights for policy 0, policy_version 829902 (0.0008) [2023-12-26 06:12:58,196][123090] Updated weights for policy 1, policy_version 824226 (0.0010) [2023-12-26 06:12:58,263][123090] Updated weights for policy 1, policy_version 824236 (0.0009) [2023-12-26 06:12:58,336][123090] Updated weights for policy 1, policy_version 824246 (0.0010) [2023-12-26 06:12:58,405][123090] Updated weights for policy 1, policy_version 824256 (0.0009) [2023-12-26 06:12:58,451][123091] Updated weights for policy 0, policy_version 829912 (0.0008) [2023-12-26 06:12:58,513][123091] Updated weights for policy 0, policy_version 829922 (0.0008) [2023-12-26 06:12:58,575][123091] Updated weights for policy 0, policy_version 829932 (0.0008) [2023-12-26 06:12:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 423477248. Throughput: 0: 8928.0, 1: 8936.6. Samples: 423468052. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:12:58,785][121949] Avg episode reward: [(0, '6005.466'), (1, '5279.453')] [2023-12-26 06:12:59,294][123090] Updated weights for policy 1, policy_version 824266 (0.0008) [2023-12-26 06:12:59,361][123090] Updated weights for policy 1, policy_version 824276 (0.0008) [2023-12-26 06:12:59,430][123091] Updated weights for policy 0, policy_version 829942 (0.0008) [2023-12-26 06:12:59,433][123090] Updated weights for policy 1, policy_version 824286 (0.0008) [2023-12-26 06:12:59,506][123091] Updated weights for policy 0, policy_version 829952 (0.0006) [2023-12-26 06:12:59,575][123091] Updated weights for policy 0, policy_version 829962 (0.0006) [2023-12-26 06:13:00,233][123090] Updated weights for policy 1, policy_version 824296 (0.0008) [2023-12-26 06:13:00,295][123090] Updated weights for policy 1, policy_version 824306 (0.0008) [2023-12-26 06:13:00,323][123091] Updated weights for policy 0, policy_version 829972 (0.0009) [2023-12-26 06:13:00,352][123090] Updated weights for policy 1, policy_version 824316 (0.0008) [2023-12-26 06:13:00,383][123091] Updated weights for policy 0, policy_version 829982 (0.0008) [2023-12-26 06:13:00,438][123091] Updated weights for policy 0, policy_version 829992 (0.0009) [2023-12-26 06:13:01,038][123090] Updated weights for policy 1, policy_version 824326 (0.0008) [2023-12-26 06:13:01,105][123090] Updated weights for policy 1, policy_version 824336 (0.0009) [2023-12-26 06:13:01,173][123090] Updated weights for policy 1, policy_version 824346 (0.0008) [2023-12-26 06:13:01,232][123091] Updated weights for policy 0, policy_version 830002 (0.0010) [2023-12-26 06:13:01,304][123091] Updated weights for policy 0, policy_version 830012 (0.0011) [2023-12-26 06:13:01,362][123091] Updated weights for policy 0, policy_version 830022 (0.0011) [2023-12-26 06:13:01,429][123091] Updated weights for policy 0, policy_version 830032 (0.0008) [2023-12-26 06:13:01,987][123090] Updated weights for policy 1, policy_version 824356 (0.0009) [2023-12-26 06:13:02,035][123090] Updated weights for policy 1, policy_version 824366 (0.0009) [2023-12-26 06:13:02,086][123090] Updated weights for policy 1, policy_version 824376 (0.0008) [2023-12-26 06:13:02,283][123091] Updated weights for policy 0, policy_version 830042 (0.0009) [2023-12-26 06:13:02,340][123091] Updated weights for policy 0, policy_version 830052 (0.0011) [2023-12-26 06:13:02,417][123091] Updated weights for policy 0, policy_version 830062 (0.0012) [2023-12-26 06:13:02,850][123090] Updated weights for policy 1, policy_version 824386 (0.0008) [2023-12-26 06:13:02,911][123090] Updated weights for policy 1, policy_version 824396 (0.0006) [2023-12-26 06:13:02,966][123090] Updated weights for policy 1, policy_version 824406 (0.0006) [2023-12-26 06:13:03,021][123090] Updated weights for policy 1, policy_version 824416 (0.0006) [2023-12-26 06:13:03,136][123091] Updated weights for policy 0, policy_version 830072 (0.0005) [2023-12-26 06:13:03,186][123091] Updated weights for policy 0, policy_version 830082 (0.0010) [2023-12-26 06:13:03,237][123091] Updated weights for policy 0, policy_version 830092 (0.0010) [2023-12-26 06:13:03,689][123090] Updated weights for policy 1, policy_version 824426 (0.0009) [2023-12-26 06:13:03,734][123090] Updated weights for policy 1, policy_version 824436 (0.0007) [2023-12-26 06:13:03,781][123090] Updated weights for policy 1, policy_version 824446 (0.0005) [2023-12-26 06:13:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 423559168. Throughput: 0: 8892.6, 1: 8903.6. Samples: 423574644. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:03,785][121949] Avg episode reward: [(0, '6126.382'), (1, '5342.348')] [2023-12-26 06:13:04,069][123091] Updated weights for policy 0, policy_version 830102 (0.0010) [2023-12-26 06:13:04,125][123091] Updated weights for policy 0, policy_version 830112 (0.0009) [2023-12-26 06:13:04,185][123091] Updated weights for policy 0, policy_version 830122 (0.0009) [2023-12-26 06:13:04,558][123090] Updated weights for policy 1, policy_version 824456 (0.0005) [2023-12-26 06:13:04,611][123090] Updated weights for policy 1, policy_version 824466 (0.0008) [2023-12-26 06:13:04,671][123090] Updated weights for policy 1, policy_version 824476 (0.0009) [2023-12-26 06:13:05,048][123091] Updated weights for policy 0, policy_version 830132 (0.0010) [2023-12-26 06:13:05,123][123091] Updated weights for policy 0, policy_version 830142 (0.0009) [2023-12-26 06:13:05,176][123091] Updated weights for policy 0, policy_version 830152 (0.0010) [2023-12-26 06:13:05,482][123090] Updated weights for policy 1, policy_version 824486 (0.0009) [2023-12-26 06:13:05,539][123090] Updated weights for policy 1, policy_version 824496 (0.0009) [2023-12-26 06:13:05,587][123090] Updated weights for policy 1, policy_version 824506 (0.0009) [2023-12-26 06:13:05,951][123091] Updated weights for policy 0, policy_version 830163 (0.0008) [2023-12-26 06:13:05,999][123091] Updated weights for policy 0, policy_version 830173 (0.0005) [2023-12-26 06:13:06,047][123091] Updated weights for policy 0, policy_version 830183 (0.0005) [2023-12-26 06:13:06,469][123090] Updated weights for policy 1, policy_version 824516 (0.0009) [2023-12-26 06:13:06,524][123090] Updated weights for policy 1, policy_version 824526 (0.0009) [2023-12-26 06:13:06,608][123090] Updated weights for policy 1, policy_version 824536 (0.0008) [2023-12-26 06:13:06,803][123091] Updated weights for policy 0, policy_version 830193 (0.0008) [2023-12-26 06:13:06,856][123091] Updated weights for policy 0, policy_version 830203 (0.0009) [2023-12-26 06:13:06,910][123091] Updated weights for policy 0, policy_version 830213 (0.0010) [2023-12-26 06:13:06,970][123091] Updated weights for policy 0, policy_version 830223 (0.0009) [2023-12-26 06:13:07,457][123090] Updated weights for policy 1, policy_version 824546 (0.0009) [2023-12-26 06:13:07,523][123090] Updated weights for policy 1, policy_version 824556 (0.0009) [2023-12-26 06:13:07,581][123090] Updated weights for policy 1, policy_version 824566 (0.0010) [2023-12-26 06:13:07,660][123090] Updated weights for policy 1, policy_version 824576 (0.0010) [2023-12-26 06:13:07,802][123091] Updated weights for policy 0, policy_version 830233 (0.0009) [2023-12-26 06:13:07,865][123091] Updated weights for policy 0, policy_version 830243 (0.0010) [2023-12-26 06:13:07,926][123091] Updated weights for policy 0, policy_version 830253 (0.0009) [2023-12-26 06:13:08,528][123090] Updated weights for policy 1, policy_version 824586 (0.0010) [2023-12-26 06:13:08,586][123090] Updated weights for policy 1, policy_version 824596 (0.0009) [2023-12-26 06:13:08,636][123090] Updated weights for policy 1, policy_version 824606 (0.0009) [2023-12-26 06:13:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 423649280. Throughput: 0: 8874.1, 1: 8907.4. Samples: 423627232. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:08,785][121949] Avg episode reward: [(0, '6000.418'), (1, '5406.031')] [2023-12-26 06:13:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000824608_211099648.pth... [2023-12-26 06:13:08,792][123091] Updated weights for policy 0, policy_version 830263 (0.0010) [2023-12-26 06:13:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000823584_210837504.pth [2023-12-26 06:13:08,860][123091] Updated weights for policy 0, policy_version 830273 (0.0010) [2023-12-26 06:13:08,912][123091] Updated weights for policy 0, policy_version 830283 (0.0009) [2023-12-26 06:13:08,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000830288_212557824.pth... [2023-12-26 06:13:08,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000829264_212295680.pth [2023-12-26 06:13:09,507][123090] Updated weights for policy 1, policy_version 824616 (0.0010) [2023-12-26 06:13:09,569][123090] Updated weights for policy 1, policy_version 824626 (0.0009) [2023-12-26 06:13:09,634][123090] Updated weights for policy 1, policy_version 824636 (0.0010) [2023-12-26 06:13:09,785][123091] Updated weights for policy 0, policy_version 830293 (0.0008) [2023-12-26 06:13:09,854][123091] Updated weights for policy 0, policy_version 830303 (0.0010) [2023-12-26 06:13:09,918][123091] Updated weights for policy 0, policy_version 830313 (0.0010) [2023-12-26 06:13:10,438][123090] Updated weights for policy 1, policy_version 824646 (0.0009) [2023-12-26 06:13:10,492][123090] Updated weights for policy 1, policy_version 824656 (0.0005) [2023-12-26 06:13:10,556][123090] Updated weights for policy 1, policy_version 824666 (0.0006) [2023-12-26 06:13:10,766][123091] Updated weights for policy 0, policy_version 830323 (0.0009) [2023-12-26 06:13:10,843][123091] Updated weights for policy 0, policy_version 830333 (0.0010) [2023-12-26 06:13:10,917][123091] Updated weights for policy 0, policy_version 830343 (0.0010) [2023-12-26 06:13:11,329][123090] Updated weights for policy 1, policy_version 824676 (0.0007) [2023-12-26 06:13:11,394][123090] Updated weights for policy 1, policy_version 824686 (0.0017) [2023-12-26 06:13:11,462][123090] Updated weights for policy 1, policy_version 824696 (0.0011) [2023-12-26 06:13:11,718][123091] Updated weights for policy 0, policy_version 830353 (0.0009) [2023-12-26 06:13:11,787][123091] Updated weights for policy 0, policy_version 830363 (0.0006) [2023-12-26 06:13:11,843][123091] Updated weights for policy 0, policy_version 830373 (0.0008) [2023-12-26 06:13:11,915][123091] Updated weights for policy 0, policy_version 830383 (0.0007) [2023-12-26 06:13:12,182][123090] Updated weights for policy 1, policy_version 824706 (0.0010) [2023-12-26 06:13:12,243][123090] Updated weights for policy 1, policy_version 824716 (0.0010) [2023-12-26 06:13:12,317][123090] Updated weights for policy 1, policy_version 824726 (0.0010) [2023-12-26 06:13:12,389][123090] Updated weights for policy 1, policy_version 824736 (0.0008) [2023-12-26 06:13:12,689][123091] Updated weights for policy 0, policy_version 830393 (0.0008) [2023-12-26 06:13:12,751][123091] Updated weights for policy 0, policy_version 830403 (0.0008) [2023-12-26 06:13:12,810][123091] Updated weights for policy 0, policy_version 830413 (0.0008) [2023-12-26 06:13:13,257][123090] Updated weights for policy 1, policy_version 824746 (0.0005) [2023-12-26 06:13:13,312][123090] Updated weights for policy 1, policy_version 824756 (0.0005) [2023-12-26 06:13:13,377][123090] Updated weights for policy 1, policy_version 824766 (0.0005) [2023-12-26 06:13:13,497][123091] Updated weights for policy 0, policy_version 830423 (0.0006) [2023-12-26 06:13:13,555][123091] Updated weights for policy 0, policy_version 830433 (0.0005) [2023-12-26 06:13:13,617][123091] Updated weights for policy 0, policy_version 830443 (0.0005) [2023-12-26 06:13:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 423739392. Throughput: 0: 8766.9, 1: 8859.0. Samples: 423728764. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:13,785][121949] Avg episode reward: [(0, '5997.839'), (1, '5363.500')] [2023-12-26 06:13:14,094][123090] Updated weights for policy 1, policy_version 824776 (0.0005) [2023-12-26 06:13:14,155][123090] Updated weights for policy 1, policy_version 824786 (0.0005) [2023-12-26 06:13:14,222][123090] Updated weights for policy 1, policy_version 824796 (0.0005) [2023-12-26 06:13:14,237][123091] Updated weights for policy 0, policy_version 830453 (0.0005) [2023-12-26 06:13:14,294][123091] Updated weights for policy 0, policy_version 830463 (0.0007) [2023-12-26 06:13:14,356][123091] Updated weights for policy 0, policy_version 830473 (0.0008) [2023-12-26 06:13:14,905][123090] Updated weights for policy 1, policy_version 824806 (0.0008) [2023-12-26 06:13:14,970][123090] Updated weights for policy 1, policy_version 824816 (0.0010) [2023-12-26 06:13:15,040][123090] Updated weights for policy 1, policy_version 824826 (0.0009) [2023-12-26 06:13:15,129][123091] Updated weights for policy 0, policy_version 830483 (0.0007) [2023-12-26 06:13:15,179][123091] Updated weights for policy 0, policy_version 830493 (0.0009) [2023-12-26 06:13:15,233][123091] Updated weights for policy 0, policy_version 830503 (0.0010) [2023-12-26 06:13:15,879][123090] Updated weights for policy 1, policy_version 824836 (0.0009) [2023-12-26 06:13:15,936][123090] Updated weights for policy 1, policy_version 824846 (0.0009) [2023-12-26 06:13:16,000][123090] Updated weights for policy 1, policy_version 824856 (0.0008) [2023-12-26 06:13:16,102][123091] Updated weights for policy 0, policy_version 830513 (0.0011) [2023-12-26 06:13:16,162][123091] Updated weights for policy 0, policy_version 830524 (0.0009) [2023-12-26 06:13:16,215][123091] Updated weights for policy 0, policy_version 830534 (0.0009) [2023-12-26 06:13:16,268][123091] Updated weights for policy 0, policy_version 830544 (0.0009) [2023-12-26 06:13:16,880][123090] Updated weights for policy 1, policy_version 824866 (0.0009) [2023-12-26 06:13:16,946][123090] Updated weights for policy 1, policy_version 824876 (0.0010) [2023-12-26 06:13:16,999][123090] Updated weights for policy 1, policy_version 824886 (0.0008) [2023-12-26 06:13:17,021][123091] Updated weights for policy 0, policy_version 830554 (0.0008) [2023-12-26 06:13:17,062][123090] Updated weights for policy 1, policy_version 824896 (0.0009) [2023-12-26 06:13:17,087][123091] Updated weights for policy 0, policy_version 830564 (0.0005) [2023-12-26 06:13:17,157][123091] Updated weights for policy 0, policy_version 830574 (0.0008) [2023-12-26 06:13:17,886][123091] Updated weights for policy 0, policy_version 830584 (0.0008) [2023-12-26 06:13:17,939][123090] Updated weights for policy 1, policy_version 824906 (0.0009) [2023-12-26 06:13:17,946][123091] Updated weights for policy 0, policy_version 830594 (0.0007) [2023-12-26 06:13:18,007][123090] Updated weights for policy 1, policy_version 824916 (0.0009) [2023-12-26 06:13:18,013][123091] Updated weights for policy 0, policy_version 830604 (0.0007) [2023-12-26 06:13:18,061][123090] Updated weights for policy 1, policy_version 824926 (0.0009) [2023-12-26 06:13:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 423821312. Throughput: 0: 8848.6, 1: 8780.4. Samples: 423838128. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:18,785][121949] Avg episode reward: [(0, '5998.631'), (1, '5488.361')] [2023-12-26 06:13:18,835][123091] Updated weights for policy 0, policy_version 830614 (0.0006) [2023-12-26 06:13:18,891][123091] Updated weights for policy 0, policy_version 830624 (0.0009) [2023-12-26 06:13:18,899][123090] Updated weights for policy 1, policy_version 824936 (0.0008) [2023-12-26 06:13:18,952][123091] Updated weights for policy 0, policy_version 830634 (0.0009) [2023-12-26 06:13:18,959][123090] Updated weights for policy 1, policy_version 824946 (0.0009) [2023-12-26 06:13:19,022][123090] Updated weights for policy 1, policy_version 824956 (0.0008) [2023-12-26 06:13:19,804][123091] Updated weights for policy 0, policy_version 830644 (0.0010) [2023-12-26 06:13:19,870][123091] Updated weights for policy 0, policy_version 830654 (0.0009) [2023-12-26 06:13:19,871][123090] Updated weights for policy 1, policy_version 824966 (0.0009) [2023-12-26 06:13:19,939][123090] Updated weights for policy 1, policy_version 824976 (0.0009) [2023-12-26 06:13:19,943][123091] Updated weights for policy 0, policy_version 830664 (0.0009) [2023-12-26 06:13:20,001][123090] Updated weights for policy 1, policy_version 824986 (0.0010) [2023-12-26 06:13:20,756][123091] Updated weights for policy 0, policy_version 830674 (0.0009) [2023-12-26 06:13:20,824][123091] Updated weights for policy 0, policy_version 830684 (0.0010) [2023-12-26 06:13:20,855][123090] Updated weights for policy 1, policy_version 824996 (0.0009) [2023-12-26 06:13:20,896][123091] Updated weights for policy 0, policy_version 830694 (0.0009) [2023-12-26 06:13:20,923][123090] Updated weights for policy 1, policy_version 825006 (0.0010) [2023-12-26 06:13:20,963][123091] Updated weights for policy 0, policy_version 830704 (0.0007) [2023-12-26 06:13:20,999][123090] Updated weights for policy 1, policy_version 825016 (0.0009) [2023-12-26 06:13:21,798][123091] Updated weights for policy 0, policy_version 830715 (0.0007) [2023-12-26 06:13:21,871][123091] Updated weights for policy 0, policy_version 830725 (0.0005) [2023-12-26 06:13:21,882][123090] Updated weights for policy 1, policy_version 825026 (0.0010) [2023-12-26 06:13:21,944][123091] Updated weights for policy 0, policy_version 830735 (0.0005) [2023-12-26 06:13:21,945][123090] Updated weights for policy 1, policy_version 825036 (0.0009) [2023-12-26 06:13:22,013][123090] Updated weights for policy 1, policy_version 825046 (0.0009) [2023-12-26 06:13:22,081][123090] Updated weights for policy 1, policy_version 825056 (0.0009) [2023-12-26 06:13:22,732][123091] Updated weights for policy 0, policy_version 830745 (0.0008) [2023-12-26 06:13:22,785][123091] Updated weights for policy 0, policy_version 830755 (0.0009) [2023-12-26 06:13:22,848][123091] Updated weights for policy 0, policy_version 830765 (0.0010) [2023-12-26 06:13:22,882][123090] Updated weights for policy 1, policy_version 825066 (0.0011) [2023-12-26 06:13:22,946][123090] Updated weights for policy 1, policy_version 825076 (0.0011) [2023-12-26 06:13:23,007][123090] Updated weights for policy 1, policy_version 825086 (0.0011) [2023-12-26 06:13:23,536][123091] Updated weights for policy 0, policy_version 830775 (0.0007) [2023-12-26 06:13:23,585][123091] Updated weights for policy 0, policy_version 830785 (0.0007) [2023-12-26 06:13:23,640][123091] Updated weights for policy 0, policy_version 830795 (0.0005) [2023-12-26 06:13:23,766][123090] Updated weights for policy 1, policy_version 825096 (0.0008) [2023-12-26 06:13:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 423911424. Throughput: 0: 8796.4, 1: 8681.3. Samples: 423887652. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:23,785][121949] Avg episode reward: [(0, '6057.032'), (1, '5488.890')] [2023-12-26 06:13:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000830800_212688896.pth... [2023-12-26 06:13:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000829776_212426752.pth [2023-12-26 06:13:23,822][123090] Updated weights for policy 1, policy_version 825106 (0.0010) [2023-12-26 06:13:23,885][123090] Updated weights for policy 1, policy_version 825116 (0.0010) [2023-12-26 06:13:23,910][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000825120_211230720.pth... [2023-12-26 06:13:23,914][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000824096_210968576.pth [2023-12-26 06:13:24,417][123091] Updated weights for policy 0, policy_version 830805 (0.0008) [2023-12-26 06:13:24,486][123091] Updated weights for policy 0, policy_version 830815 (0.0006) [2023-12-26 06:13:24,556][123091] Updated weights for policy 0, policy_version 830825 (0.0005) [2023-12-26 06:13:24,687][123090] Updated weights for policy 1, policy_version 825126 (0.0007) [2023-12-26 06:13:24,745][123090] Updated weights for policy 1, policy_version 825136 (0.0006) [2023-12-26 06:13:24,812][123090] Updated weights for policy 1, policy_version 825146 (0.0006) [2023-12-26 06:13:25,161][123091] Updated weights for policy 0, policy_version 830835 (0.0005) [2023-12-26 06:13:25,231][123091] Updated weights for policy 0, policy_version 830845 (0.0005) [2023-12-26 06:13:25,302][123091] Updated weights for policy 0, policy_version 830855 (0.0005) [2023-12-26 06:13:25,504][123090] Updated weights for policy 1, policy_version 825156 (0.0007) [2023-12-26 06:13:25,567][123090] Updated weights for policy 1, policy_version 825166 (0.0010) [2023-12-26 06:13:25,625][123090] Updated weights for policy 1, policy_version 825176 (0.0010) [2023-12-26 06:13:25,925][123091] Updated weights for policy 0, policy_version 830865 (0.0005) [2023-12-26 06:13:25,975][123091] Updated weights for policy 0, policy_version 830875 (0.0005) [2023-12-26 06:13:26,026][123091] Updated weights for policy 0, policy_version 830885 (0.0005) [2023-12-26 06:13:26,086][123091] Updated weights for policy 0, policy_version 830895 (0.0005) [2023-12-26 06:13:26,358][123090] Updated weights for policy 1, policy_version 825187 (0.0008) [2023-12-26 06:13:26,405][123090] Updated weights for policy 1, policy_version 825197 (0.0005) [2023-12-26 06:13:26,452][123090] Updated weights for policy 1, policy_version 825207 (0.0005) [2023-12-26 06:13:26,736][123091] Updated weights for policy 0, policy_version 830905 (0.0005) [2023-12-26 06:13:26,784][123091] Updated weights for policy 0, policy_version 830915 (0.0005) [2023-12-26 06:13:26,839][123091] Updated weights for policy 0, policy_version 830925 (0.0005) [2023-12-26 06:13:27,175][123090] Updated weights for policy 1, policy_version 825217 (0.0006) [2023-12-26 06:13:27,222][123090] Updated weights for policy 1, policy_version 825227 (0.0010) [2023-12-26 06:13:27,269][123090] Updated weights for policy 1, policy_version 825237 (0.0010) [2023-12-26 06:13:27,323][123090] Updated weights for policy 1, policy_version 825247 (0.0007) [2023-12-26 06:13:27,459][123091] Updated weights for policy 0, policy_version 830935 (0.0005) [2023-12-26 06:13:27,527][123091] Updated weights for policy 0, policy_version 830945 (0.0005) [2023-12-26 06:13:27,591][123091] Updated weights for policy 0, policy_version 830955 (0.0005) [2023-12-26 06:13:28,086][123090] Updated weights for policy 1, policy_version 825257 (0.0009) [2023-12-26 06:13:28,146][123090] Updated weights for policy 1, policy_version 825267 (0.0010) [2023-12-26 06:13:28,205][123090] Updated weights for policy 1, policy_version 825278 (0.0010) [2023-12-26 06:13:28,269][123091] Updated weights for policy 0, policy_version 830965 (0.0005) [2023-12-26 06:13:28,316][123091] Updated weights for policy 0, policy_version 830975 (0.0005) [2023-12-26 06:13:28,388][123091] Updated weights for policy 0, policy_version 830985 (0.0006) [2023-12-26 06:13:28,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17886.0, 300 sec: 17800.3). Total num frames: 424009728. Throughput: 0: 8942.8, 1: 8778.9. Samples: 424002496. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:28,784][121949] Avg episode reward: [(0, '6072.639'), (1, '5530.302')] [2023-12-26 06:13:28,985][123090] Updated weights for policy 1, policy_version 825288 (0.0008) [2023-12-26 06:13:29,053][123090] Updated weights for policy 1, policy_version 825298 (0.0007) [2023-12-26 06:13:29,100][123091] Updated weights for policy 0, policy_version 830995 (0.0007) [2023-12-26 06:13:29,114][123090] Updated weights for policy 1, policy_version 825308 (0.0009) [2023-12-26 06:13:29,153][123091] Updated weights for policy 0, policy_version 831005 (0.0007) [2023-12-26 06:13:29,213][123091] Updated weights for policy 0, policy_version 831015 (0.0010) [2023-12-26 06:13:29,843][123090] Updated weights for policy 1, policy_version 825318 (0.0010) [2023-12-26 06:13:29,911][123090] Updated weights for policy 1, policy_version 825328 (0.0011) [2023-12-26 06:13:29,979][123090] Updated weights for policy 1, policy_version 825338 (0.0011) [2023-12-26 06:13:29,994][123091] Updated weights for policy 0, policy_version 831025 (0.0010) [2023-12-26 06:13:30,042][123091] Updated weights for policy 0, policy_version 831035 (0.0008) [2023-12-26 06:13:30,090][123091] Updated weights for policy 0, policy_version 831045 (0.0009) [2023-12-26 06:13:30,149][123091] Updated weights for policy 0, policy_version 831055 (0.0009) [2023-12-26 06:13:30,696][123090] Updated weights for policy 1, policy_version 825348 (0.0008) [2023-12-26 06:13:30,746][123090] Updated weights for policy 1, policy_version 825358 (0.0006) [2023-12-26 06:13:30,794][123090] Updated weights for policy 1, policy_version 825368 (0.0005) [2023-12-26 06:13:31,050][123091] Updated weights for policy 0, policy_version 831065 (0.0007) [2023-12-26 06:13:31,114][123091] Updated weights for policy 0, policy_version 831075 (0.0011) [2023-12-26 06:13:31,183][123091] Updated weights for policy 0, policy_version 831085 (0.0011) [2023-12-26 06:13:31,499][123090] Updated weights for policy 1, policy_version 825378 (0.0006) [2023-12-26 06:13:31,558][123090] Updated weights for policy 1, policy_version 825388 (0.0008) [2023-12-26 06:13:31,609][123090] Updated weights for policy 1, policy_version 825398 (0.0008) [2023-12-26 06:13:31,670][123090] Updated weights for policy 1, policy_version 825408 (0.0008) [2023-12-26 06:13:31,921][123091] Updated weights for policy 0, policy_version 831095 (0.0007) [2023-12-26 06:13:31,967][123091] Updated weights for policy 0, policy_version 831105 (0.0005) [2023-12-26 06:13:32,012][123091] Updated weights for policy 0, policy_version 831115 (0.0010) [2023-12-26 06:13:32,501][123090] Updated weights for policy 1, policy_version 825418 (0.0010) [2023-12-26 06:13:32,564][123090] Updated weights for policy 1, policy_version 825428 (0.0009) [2023-12-26 06:13:32,627][123090] Updated weights for policy 1, policy_version 825438 (0.0007) [2023-12-26 06:13:32,776][123091] Updated weights for policy 0, policy_version 831125 (0.0008) [2023-12-26 06:13:32,851][123091] Updated weights for policy 0, policy_version 831135 (0.0005) [2023-12-26 06:13:32,923][123091] Updated weights for policy 0, policy_version 831145 (0.0006) [2023-12-26 06:13:33,442][123090] Updated weights for policy 1, policy_version 825448 (0.0010) [2023-12-26 06:13:33,497][123090] Updated weights for policy 1, policy_version 825458 (0.0010) [2023-12-26 06:13:33,544][123090] Updated weights for policy 1, policy_version 825468 (0.0009) [2023-12-26 06:13:33,574][123091] Updated weights for policy 0, policy_version 831155 (0.0005) [2023-12-26 06:13:33,638][123091] Updated weights for policy 0, policy_version 831165 (0.0006) [2023-12-26 06:13:33,710][123091] Updated weights for policy 0, policy_version 831175 (0.0005) [2023-12-26 06:13:33,784][121949] Fps is (10 sec: 19661.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 424108032. Throughput: 0: 8976.0, 1: 8836.9. Samples: 424114512. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:33,785][121949] Avg episode reward: [(0, '6080.444'), (1, '5600.701')] [2023-12-26 06:13:34,340][123090] Updated weights for policy 1, policy_version 825478 (0.0006) [2023-12-26 06:13:34,413][123090] Updated weights for policy 1, policy_version 825488 (0.0006) [2023-12-26 06:13:34,449][123091] Updated weights for policy 0, policy_version 831185 (0.0008) [2023-12-26 06:13:34,481][123090] Updated weights for policy 1, policy_version 825498 (0.0005) [2023-12-26 06:13:34,497][123091] Updated weights for policy 0, policy_version 831195 (0.0011) [2023-12-26 06:13:34,565][123091] Updated weights for policy 0, policy_version 831205 (0.0010) [2023-12-26 06:13:34,629][123091] Updated weights for policy 0, policy_version 831215 (0.0011) [2023-12-26 06:13:35,258][123090] Updated weights for policy 1, policy_version 825508 (0.0007) [2023-12-26 06:13:35,326][123090] Updated weights for policy 1, policy_version 825518 (0.0010) [2023-12-26 06:13:35,382][123090] Updated weights for policy 1, policy_version 825528 (0.0009) [2023-12-26 06:13:35,438][123091] Updated weights for policy 0, policy_version 831225 (0.0010) [2023-12-26 06:13:35,496][123091] Updated weights for policy 0, policy_version 831235 (0.0010) [2023-12-26 06:13:35,559][123091] Updated weights for policy 0, policy_version 831245 (0.0011) [2023-12-26 06:13:36,075][123090] Updated weights for policy 1, policy_version 825538 (0.0007) [2023-12-26 06:13:36,155][123090] Updated weights for policy 1, policy_version 825548 (0.0006) [2023-12-26 06:13:36,223][123090] Updated weights for policy 1, policy_version 825558 (0.0009) [2023-12-26 06:13:36,296][123090] Updated weights for policy 1, policy_version 825568 (0.0009) [2023-12-26 06:13:36,328][123091] Updated weights for policy 0, policy_version 831255 (0.0007) [2023-12-26 06:13:36,396][123091] Updated weights for policy 0, policy_version 831265 (0.0005) [2023-12-26 06:13:36,469][123091] Updated weights for policy 0, policy_version 831275 (0.0007) [2023-12-26 06:13:37,087][123090] Updated weights for policy 1, policy_version 825578 (0.0009) [2023-12-26 06:13:37,143][123090] Updated weights for policy 1, policy_version 825588 (0.0009) [2023-12-26 06:13:37,201][123090] Updated weights for policy 1, policy_version 825598 (0.0009) [2023-12-26 06:13:37,244][123091] Updated weights for policy 0, policy_version 831285 (0.0011) [2023-12-26 06:13:37,302][123091] Updated weights for policy 0, policy_version 831295 (0.0010) [2023-12-26 06:13:37,364][123091] Updated weights for policy 0, policy_version 831305 (0.0010) [2023-12-26 06:13:38,068][123090] Updated weights for policy 1, policy_version 825608 (0.0008) [2023-12-26 06:13:38,129][123090] Updated weights for policy 1, policy_version 825618 (0.0009) [2023-12-26 06:13:38,187][123090] Updated weights for policy 1, policy_version 825628 (0.0009) [2023-12-26 06:13:38,206][123091] Updated weights for policy 0, policy_version 831315 (0.0011) [2023-12-26 06:13:38,287][123091] Updated weights for policy 0, policy_version 831325 (0.0011) [2023-12-26 06:13:38,352][123091] Updated weights for policy 0, policy_version 831335 (0.0011) [2023-12-26 06:13:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 424189952. Throughput: 0: 9012.1, 1: 8907.1. Samples: 424169396. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:38,785][121949] Avg episode reward: [(0, '6129.864'), (1, '5499.158')] [2023-12-26 06:13:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000825632_211361792.pth... [2023-12-26 06:13:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000831344_212828160.pth... [2023-12-26 06:13:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000830288_212557824.pth [2023-12-26 06:13:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000824608_211099648.pth [2023-12-26 06:13:39,052][123090] Updated weights for policy 1, policy_version 825638 (0.0008) [2023-12-26 06:13:39,111][123090] Updated weights for policy 1, policy_version 825648 (0.0008) [2023-12-26 06:13:39,168][123091] Updated weights for policy 0, policy_version 831345 (0.0010) [2023-12-26 06:13:39,171][123090] Updated weights for policy 1, policy_version 825658 (0.0009) [2023-12-26 06:13:39,224][123091] Updated weights for policy 0, policy_version 831355 (0.0010) [2023-12-26 06:13:39,288][123091] Updated weights for policy 0, policy_version 831365 (0.0011) [2023-12-26 06:13:39,357][123091] Updated weights for policy 0, policy_version 831375 (0.0008) [2023-12-26 06:13:40,111][123090] Updated weights for policy 1, policy_version 825668 (0.0009) [2023-12-26 06:13:40,129][123091] Updated weights for policy 0, policy_version 831385 (0.0007) [2023-12-26 06:13:40,181][123090] Updated weights for policy 1, policy_version 825678 (0.0008) [2023-12-26 06:13:40,182][123091] Updated weights for policy 0, policy_version 831395 (0.0006) [2023-12-26 06:13:40,238][123091] Updated weights for policy 0, policy_version 831405 (0.0006) [2023-12-26 06:13:40,252][123090] Updated weights for policy 1, policy_version 825688 (0.0009) [2023-12-26 06:13:41,010][123090] Updated weights for policy 1, policy_version 825698 (0.0010) [2023-12-26 06:13:41,025][123091] Updated weights for policy 0, policy_version 831415 (0.0009) [2023-12-26 06:13:41,084][123090] Updated weights for policy 1, policy_version 825708 (0.0008) [2023-12-26 06:13:41,095][123091] Updated weights for policy 0, policy_version 831425 (0.0009) [2023-12-26 06:13:41,154][123090] Updated weights for policy 1, policy_version 825718 (0.0008) [2023-12-26 06:13:41,164][123091] Updated weights for policy 0, policy_version 831435 (0.0010) [2023-12-26 06:13:41,217][123090] Updated weights for policy 1, policy_version 825728 (0.0007) [2023-12-26 06:13:42,001][123091] Updated weights for policy 0, policy_version 831445 (0.0011) [2023-12-26 06:13:42,069][123091] Updated weights for policy 0, policy_version 831455 (0.0011) [2023-12-26 06:13:42,085][123090] Updated weights for policy 1, policy_version 825738 (0.0008) [2023-12-26 06:13:42,133][123091] Updated weights for policy 0, policy_version 831465 (0.0011) [2023-12-26 06:13:42,149][123090] Updated weights for policy 1, policy_version 825748 (0.0006) [2023-12-26 06:13:42,210][123090] Updated weights for policy 1, policy_version 825758 (0.0008) [2023-12-26 06:13:42,978][123091] Updated weights for policy 0, policy_version 831475 (0.0011) [2023-12-26 06:13:43,033][123090] Updated weights for policy 1, policy_version 825768 (0.0010) [2023-12-26 06:13:43,045][123091] Updated weights for policy 0, policy_version 831485 (0.0011) [2023-12-26 06:13:43,095][123090] Updated weights for policy 1, policy_version 825778 (0.0006) [2023-12-26 06:13:43,104][123091] Updated weights for policy 0, policy_version 831495 (0.0011) [2023-12-26 06:13:43,158][123090] Updated weights for policy 1, policy_version 825788 (0.0008) [2023-12-26 06:13:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 424271872. Throughput: 0: 9000.2, 1: 8826.1. Samples: 424270236. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:43,784][121949] Avg episode reward: [(0, '6137.213'), (1, '5156.582')] [2023-12-26 06:13:43,907][123091] Updated weights for policy 0, policy_version 831505 (0.0011) [2023-12-26 06:13:43,962][123091] Updated weights for policy 0, policy_version 831515 (0.0010) [2023-12-26 06:13:43,965][123090] Updated weights for policy 1, policy_version 825798 (0.0009) [2023-12-26 06:13:44,013][123090] Updated weights for policy 1, policy_version 825808 (0.0007) [2023-12-26 06:13:44,014][123091] Updated weights for policy 0, policy_version 831525 (0.0011) [2023-12-26 06:13:44,070][123091] Updated weights for policy 0, policy_version 831535 (0.0010) [2023-12-26 06:13:44,072][123090] Updated weights for policy 1, policy_version 825818 (0.0005) [2023-12-26 06:13:44,894][123091] Updated weights for policy 0, policy_version 831545 (0.0006) [2023-12-26 06:13:44,949][123090] Updated weights for policy 1, policy_version 825828 (0.0009) [2023-12-26 06:13:44,951][123091] Updated weights for policy 0, policy_version 831555 (0.0006) [2023-12-26 06:13:45,009][123090] Updated weights for policy 1, policy_version 825838 (0.0009) [2023-12-26 06:13:45,013][123091] Updated weights for policy 0, policy_version 831565 (0.0006) [2023-12-26 06:13:45,074][123090] Updated weights for policy 1, policy_version 825848 (0.0009) [2023-12-26 06:13:45,768][123091] Updated weights for policy 0, policy_version 831575 (0.0005) [2023-12-26 06:13:45,813][123091] Updated weights for policy 0, policy_version 831585 (0.0005) [2023-12-26 06:13:45,863][123091] Updated weights for policy 0, policy_version 831595 (0.0005) [2023-12-26 06:13:45,970][123090] Updated weights for policy 1, policy_version 825858 (0.0010) [2023-12-26 06:13:46,029][123090] Updated weights for policy 1, policy_version 825868 (0.0010) [2023-12-26 06:13:46,084][123090] Updated weights for policy 1, policy_version 825878 (0.0010) [2023-12-26 06:13:46,138][123090] Updated weights for policy 1, policy_version 825888 (0.0010) [2023-12-26 06:13:46,514][123091] Updated weights for policy 0, policy_version 831605 (0.0005) [2023-12-26 06:13:46,565][123091] Updated weights for policy 0, policy_version 831615 (0.0005) [2023-12-26 06:13:46,619][123091] Updated weights for policy 0, policy_version 831625 (0.0005) [2023-12-26 06:13:47,065][123090] Updated weights for policy 1, policy_version 825898 (0.0009) [2023-12-26 06:13:47,122][123090] Updated weights for policy 1, policy_version 825908 (0.0009) [2023-12-26 06:13:47,179][123090] Updated weights for policy 1, policy_version 825918 (0.0009) [2023-12-26 06:13:47,370][123091] Updated weights for policy 0, policy_version 831635 (0.0007) [2023-12-26 06:13:47,425][123091] Updated weights for policy 0, policy_version 831645 (0.0010) [2023-12-26 06:13:47,479][123091] Updated weights for policy 0, policy_version 831655 (0.0010) [2023-12-26 06:13:48,016][123090] Updated weights for policy 1, policy_version 825928 (0.0008) [2023-12-26 06:13:48,066][123090] Updated weights for policy 1, policy_version 825938 (0.0005) [2023-12-26 06:13:48,115][123090] Updated weights for policy 1, policy_version 825948 (0.0005) [2023-12-26 06:13:48,241][123091] Updated weights for policy 0, policy_version 831665 (0.0010) [2023-12-26 06:13:48,294][123091] Updated weights for policy 0, policy_version 831675 (0.0006) [2023-12-26 06:13:48,371][123091] Updated weights for policy 0, policy_version 831685 (0.0007) [2023-12-26 06:13:48,447][123091] Updated weights for policy 0, policy_version 831695 (0.0008) [2023-12-26 06:13:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 424361984. Throughput: 0: 9080.4, 1: 8714.1. Samples: 424375392. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:48,784][121949] Avg episode reward: [(0, '6113.877'), (1, '4992.440')] [2023-12-26 06:13:48,981][123090] Updated weights for policy 1, policy_version 825958 (0.0009) [2023-12-26 06:13:49,050][123090] Updated weights for policy 1, policy_version 825968 (0.0009) [2023-12-26 06:13:49,113][123090] Updated weights for policy 1, policy_version 825978 (0.0010) [2023-12-26 06:13:49,147][123091] Updated weights for policy 0, policy_version 831705 (0.0007) [2023-12-26 06:13:49,210][123091] Updated weights for policy 0, policy_version 831715 (0.0008) [2023-12-26 06:13:49,277][123091] Updated weights for policy 0, policy_version 831725 (0.0007) [2023-12-26 06:13:49,966][123090] Updated weights for policy 1, policy_version 825988 (0.0009) [2023-12-26 06:13:49,974][123091] Updated weights for policy 0, policy_version 831735 (0.0007) [2023-12-26 06:13:50,034][123091] Updated weights for policy 0, policy_version 831745 (0.0009) [2023-12-26 06:13:50,035][123090] Updated weights for policy 1, policy_version 825998 (0.0008) [2023-12-26 06:13:50,098][123091] Updated weights for policy 0, policy_version 831755 (0.0009) [2023-12-26 06:13:50,101][123090] Updated weights for policy 1, policy_version 826008 (0.0008) [2023-12-26 06:13:50,896][123091] Updated weights for policy 0, policy_version 831765 (0.0008) [2023-12-26 06:13:50,916][123090] Updated weights for policy 1, policy_version 826018 (0.0008) [2023-12-26 06:13:50,965][123091] Updated weights for policy 0, policy_version 831775 (0.0008) [2023-12-26 06:13:50,977][123090] Updated weights for policy 1, policy_version 826028 (0.0009) [2023-12-26 06:13:51,037][123091] Updated weights for policy 0, policy_version 831785 (0.0007) [2023-12-26 06:13:51,046][123090] Updated weights for policy 1, policy_version 826038 (0.0009) [2023-12-26 06:13:51,116][123090] Updated weights for policy 1, policy_version 826048 (0.0009) [2023-12-26 06:13:51,770][123091] Updated weights for policy 0, policy_version 831795 (0.0009) [2023-12-26 06:13:51,818][123091] Updated weights for policy 0, policy_version 831805 (0.0008) [2023-12-26 06:13:51,870][123091] Updated weights for policy 0, policy_version 831815 (0.0008) [2023-12-26 06:13:51,984][123090] Updated weights for policy 1, policy_version 826058 (0.0009) [2023-12-26 06:13:52,053][123090] Updated weights for policy 1, policy_version 826068 (0.0009) [2023-12-26 06:13:52,124][123090] Updated weights for policy 1, policy_version 826078 (0.0010) [2023-12-26 06:13:52,738][123091] Updated weights for policy 0, policy_version 831825 (0.0009) [2023-12-26 06:13:52,806][123091] Updated weights for policy 0, policy_version 831835 (0.0007) [2023-12-26 06:13:52,873][123091] Updated weights for policy 0, policy_version 831845 (0.0007) [2023-12-26 06:13:52,943][123091] Updated weights for policy 0, policy_version 831855 (0.0008) [2023-12-26 06:13:52,978][123090] Updated weights for policy 1, policy_version 826088 (0.0008) [2023-12-26 06:13:53,041][123090] Updated weights for policy 1, policy_version 826098 (0.0009) [2023-12-26 06:13:53,106][123090] Updated weights for policy 1, policy_version 826108 (0.0009) [2023-12-26 06:13:53,654][123091] Updated weights for policy 0, policy_version 831865 (0.0006) [2023-12-26 06:13:53,710][123091] Updated weights for policy 0, policy_version 831875 (0.0005) [2023-12-26 06:13:53,768][123091] Updated weights for policy 0, policy_version 831885 (0.0005) [2023-12-26 06:13:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 424452096. Throughput: 0: 9110.9, 1: 8674.8. Samples: 424427588. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:53,784][121949] Avg episode reward: [(0, '6166.764'), (1, '5242.225')] [2023-12-26 06:13:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000831888_212967424.pth... [2023-12-26 06:13:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000826112_211484672.pth... [2023-12-26 06:13:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000830800_212688896.pth [2023-12-26 06:13:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000831888_212967424.pth [2023-12-26 06:13:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000825120_211230720.pth [2023-12-26 06:13:53,797][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000826112_211484672.pth [2023-12-26 06:13:53,923][123090] Updated weights for policy 1, policy_version 826118 (0.0007) [2023-12-26 06:13:53,973][123090] Updated weights for policy 1, policy_version 826128 (0.0006) [2023-12-26 06:13:54,019][123090] Updated weights for policy 1, policy_version 826138 (0.0005) [2023-12-26 06:13:54,415][123091] Updated weights for policy 0, policy_version 831895 (0.0006) [2023-12-26 06:13:54,460][123091] Updated weights for policy 0, policy_version 831905 (0.0005) [2023-12-26 06:13:54,520][123091] Updated weights for policy 0, policy_version 831915 (0.0005) [2023-12-26 06:13:54,794][123090] Updated weights for policy 1, policy_version 826148 (0.0007) [2023-12-26 06:13:54,864][123090] Updated weights for policy 1, policy_version 826158 (0.0010) [2023-12-26 06:13:54,937][123090] Updated weights for policy 1, policy_version 826168 (0.0010) [2023-12-26 06:13:55,167][123091] Updated weights for policy 0, policy_version 831925 (0.0008) [2023-12-26 06:13:55,219][123091] Updated weights for policy 0, policy_version 831935 (0.0010) [2023-12-26 06:13:55,274][123091] Updated weights for policy 0, policy_version 831945 (0.0010) [2023-12-26 06:13:55,674][123090] Updated weights for policy 1, policy_version 826178 (0.0009) [2023-12-26 06:13:55,720][123090] Updated weights for policy 1, policy_version 826188 (0.0006) [2023-12-26 06:13:55,768][123090] Updated weights for policy 1, policy_version 826198 (0.0009) [2023-12-26 06:13:55,825][123090] Updated weights for policy 1, policy_version 826208 (0.0011) [2023-12-26 06:13:56,141][123091] Updated weights for policy 0, policy_version 831955 (0.0009) [2023-12-26 06:13:56,199][123091] Updated weights for policy 0, policy_version 831965 (0.0009) [2023-12-26 06:13:56,262][123091] Updated weights for policy 0, policy_version 831975 (0.0009) [2023-12-26 06:13:56,557][123090] Updated weights for policy 1, policy_version 826218 (0.0006) [2023-12-26 06:13:56,617][123090] Updated weights for policy 1, policy_version 826228 (0.0005) [2023-12-26 06:13:56,669][123090] Updated weights for policy 1, policy_version 826238 (0.0006) [2023-12-26 06:13:57,148][123091] Updated weights for policy 0, policy_version 831985 (0.0009) [2023-12-26 06:13:57,209][123091] Updated weights for policy 0, policy_version 831995 (0.0009) [2023-12-26 06:13:57,271][123091] Updated weights for policy 0, policy_version 832005 (0.0009) [2023-12-26 06:13:57,319][123090] Updated weights for policy 1, policy_version 826248 (0.0007) [2023-12-26 06:13:57,328][123091] Updated weights for policy 0, policy_version 832015 (0.0009) [2023-12-26 06:13:57,384][123090] Updated weights for policy 1, policy_version 826258 (0.0009) [2023-12-26 06:13:57,439][123090] Updated weights for policy 1, policy_version 826268 (0.0007) [2023-12-26 06:13:58,035][123091] Updated weights for policy 0, policy_version 832025 (0.0007) [2023-12-26 06:13:58,061][123090] Updated weights for policy 1, policy_version 826278 (0.0008) [2023-12-26 06:13:58,097][123091] Updated weights for policy 0, policy_version 832035 (0.0008) [2023-12-26 06:13:58,117][123090] Updated weights for policy 1, policy_version 826288 (0.0011) [2023-12-26 06:13:58,157][123091] Updated weights for policy 0, policy_version 832045 (0.0008) [2023-12-26 06:13:58,173][123090] Updated weights for policy 1, policy_version 826298 (0.0010) [2023-12-26 06:13:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 424542208. Throughput: 0: 9197.1, 1: 8760.9. Samples: 424536876. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:13:58,785][121949] Avg episode reward: [(0, '6135.749'), (1, '5298.424')] [2023-12-26 06:13:58,992][123091] Updated weights for policy 0, policy_version 832055 (0.0010) [2023-12-26 06:13:59,062][123091] Updated weights for policy 0, policy_version 832065 (0.0010) [2023-12-26 06:13:59,081][123090] Updated weights for policy 1, policy_version 826308 (0.0009) [2023-12-26 06:13:59,121][123091] Updated weights for policy 0, policy_version 832075 (0.0011) [2023-12-26 06:13:59,150][123090] Updated weights for policy 1, policy_version 826318 (0.0006) [2023-12-26 06:13:59,212][123090] Updated weights for policy 1, policy_version 826328 (0.0009) [2023-12-26 06:13:59,964][123091] Updated weights for policy 0, policy_version 832085 (0.0011) [2023-12-26 06:14:00,018][123090] Updated weights for policy 1, policy_version 826338 (0.0008) [2023-12-26 06:14:00,026][123091] Updated weights for policy 0, policy_version 832095 (0.0009) [2023-12-26 06:14:00,081][123091] Updated weights for policy 0, policy_version 832105 (0.0007) [2023-12-26 06:14:00,087][123090] Updated weights for policy 1, policy_version 826348 (0.0006) [2023-12-26 06:14:00,155][123090] Updated weights for policy 1, policy_version 826358 (0.0008) [2023-12-26 06:14:00,206][123090] Updated weights for policy 1, policy_version 826368 (0.0009) [2023-12-26 06:14:00,894][123091] Updated weights for policy 0, policy_version 832115 (0.0009) [2023-12-26 06:14:00,935][123090] Updated weights for policy 1, policy_version 826378 (0.0005) [2023-12-26 06:14:00,964][123091] Updated weights for policy 0, policy_version 832125 (0.0006) [2023-12-26 06:14:00,980][123090] Updated weights for policy 1, policy_version 826388 (0.0005) [2023-12-26 06:14:01,030][123091] Updated weights for policy 0, policy_version 832135 (0.0008) [2023-12-26 06:14:01,046][123090] Updated weights for policy 1, policy_version 826398 (0.0006) [2023-12-26 06:14:01,774][123091] Updated weights for policy 0, policy_version 832145 (0.0008) [2023-12-26 06:14:01,790][123090] Updated weights for policy 1, policy_version 826408 (0.0006) [2023-12-26 06:14:01,837][123091] Updated weights for policy 0, policy_version 832155 (0.0008) [2023-12-26 06:14:01,859][123090] Updated weights for policy 1, policy_version 826418 (0.0006) [2023-12-26 06:14:01,895][123091] Updated weights for policy 0, policy_version 832165 (0.0008) [2023-12-26 06:14:01,934][123090] Updated weights for policy 1, policy_version 826428 (0.0005) [2023-12-26 06:14:01,964][123091] Updated weights for policy 0, policy_version 832175 (0.0007) [2023-12-26 06:14:02,668][123090] Updated weights for policy 1, policy_version 826438 (0.0007) [2023-12-26 06:14:02,672][123091] Updated weights for policy 0, policy_version 832185 (0.0006) [2023-12-26 06:14:02,731][123090] Updated weights for policy 1, policy_version 826448 (0.0010) [2023-12-26 06:14:02,736][123091] Updated weights for policy 0, policy_version 832195 (0.0005) [2023-12-26 06:14:02,792][123090] Updated weights for policy 1, policy_version 826458 (0.0008) [2023-12-26 06:14:02,799][123091] Updated weights for policy 0, policy_version 832205 (0.0006) [2023-12-26 06:14:03,431][123091] Updated weights for policy 0, policy_version 832215 (0.0005) [2023-12-26 06:14:03,509][123091] Updated weights for policy 0, policy_version 832225 (0.0005) [2023-12-26 06:14:03,551][123090] Updated weights for policy 1, policy_version 826468 (0.0009) [2023-12-26 06:14:03,575][123091] Updated weights for policy 0, policy_version 832235 (0.0005) [2023-12-26 06:14:03,620][123090] Updated weights for policy 1, policy_version 826478 (0.0010) [2023-12-26 06:14:03,683][123090] Updated weights for policy 1, policy_version 826489 (0.0010) [2023-12-26 06:14:03,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 424640512. Throughput: 0: 9179.9, 1: 8813.8. Samples: 424647844. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 06:14:03,785][121949] Avg episode reward: [(0, '5952.487'), (1, '5003.751')] [2023-12-26 06:14:04,240][123091] Updated weights for policy 0, policy_version 832245 (0.0008) [2023-12-26 06:14:04,300][123091] Updated weights for policy 0, policy_version 832255 (0.0011) [2023-12-26 06:14:04,370][123091] Updated weights for policy 0, policy_version 832265 (0.0011) [2023-12-26 06:14:04,496][123090] Updated weights for policy 1, policy_version 826499 (0.0009) [2023-12-26 06:14:04,563][123090] Updated weights for policy 1, policy_version 826509 (0.0009) [2023-12-26 06:14:04,628][123090] Updated weights for policy 1, policy_version 826519 (0.0009) [2023-12-26 06:14:05,196][123091] Updated weights for policy 0, policy_version 832275 (0.0011) [2023-12-26 06:14:05,258][123091] Updated weights for policy 0, policy_version 832285 (0.0010) [2023-12-26 06:14:05,323][123091] Updated weights for policy 0, policy_version 832295 (0.0011) [2023-12-26 06:14:05,445][123090] Updated weights for policy 1, policy_version 826529 (0.0009) [2023-12-26 06:14:05,506][123090] Updated weights for policy 1, policy_version 826539 (0.0009) [2023-12-26 06:14:05,564][123090] Updated weights for policy 1, policy_version 826549 (0.0006) [2023-12-26 06:14:05,616][123090] Updated weights for policy 1, policy_version 826559 (0.0005) [2023-12-26 06:14:06,032][123091] Updated weights for policy 0, policy_version 832305 (0.0010) [2023-12-26 06:14:06,093][123091] Updated weights for policy 0, policy_version 832315 (0.0009) [2023-12-26 06:14:06,159][123091] Updated weights for policy 0, policy_version 832325 (0.0009) [2023-12-26 06:14:06,217][123091] Updated weights for policy 0, policy_version 832335 (0.0010) [2023-12-26 06:14:06,377][123090] Updated weights for policy 1, policy_version 826569 (0.0009) [2023-12-26 06:14:06,433][123090] Updated weights for policy 1, policy_version 826579 (0.0009) [2023-12-26 06:14:06,493][123090] Updated weights for policy 1, policy_version 826589 (0.0009) [2023-12-26 06:14:07,005][123091] Updated weights for policy 0, policy_version 832345 (0.0011) [2023-12-26 06:14:07,064][123091] Updated weights for policy 0, policy_version 832355 (0.0011) [2023-12-26 06:14:07,127][123091] Updated weights for policy 0, policy_version 832365 (0.0006) [2023-12-26 06:14:07,371][123090] Updated weights for policy 1, policy_version 826599 (0.0008) [2023-12-26 06:14:07,441][123090] Updated weights for policy 1, policy_version 826609 (0.0009) [2023-12-26 06:14:07,516][123090] Updated weights for policy 1, policy_version 826619 (0.0009) [2023-12-26 06:14:07,860][123091] Updated weights for policy 0, policy_version 832375 (0.0005) [2023-12-26 06:14:07,913][123091] Updated weights for policy 0, policy_version 832385 (0.0005) [2023-12-26 06:14:07,973][123091] Updated weights for policy 0, policy_version 832395 (0.0008) [2023-12-26 06:14:08,403][123090] Updated weights for policy 1, policy_version 826629 (0.0008) [2023-12-26 06:14:08,478][123090] Updated weights for policy 1, policy_version 826639 (0.0009) [2023-12-26 06:14:08,552][123090] Updated weights for policy 1, policy_version 826649 (0.0010) [2023-12-26 06:14:08,685][123091] Updated weights for policy 0, policy_version 832405 (0.0005) [2023-12-26 06:14:08,763][123091] Updated weights for policy 0, policy_version 832415 (0.0006) [2023-12-26 06:14:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 424722432. Throughput: 0: 9222.3, 1: 8852.2. Samples: 424701004. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:08,785][121949] Avg episode reward: [(0, '5919.251'), (1, '4805.660')] [2023-12-26 06:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000826656_211623936.pth... [2023-12-26 06:14:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000825632_211361792.pth [2023-12-26 06:14:08,838][123091] Updated weights for policy 0, policy_version 832425 (0.0006) [2023-12-26 06:14:08,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000832432_213106688.pth... [2023-12-26 06:14:08,897][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000831344_212828160.pth [2023-12-26 06:14:09,284][123090] Updated weights for policy 1, policy_version 826659 (0.0007) [2023-12-26 06:14:09,354][123090] Updated weights for policy 1, policy_version 826669 (0.0008) [2023-12-26 06:14:09,373][123091] Updated weights for policy 0, policy_version 832435 (0.0006) [2023-12-26 06:14:09,431][123090] Updated weights for policy 1, policy_version 826679 (0.0008) [2023-12-26 06:14:09,441][123091] Updated weights for policy 0, policy_version 832445 (0.0010) [2023-12-26 06:14:09,516][123091] Updated weights for policy 0, policy_version 832455 (0.0010) [2023-12-26 06:14:10,266][123091] Updated weights for policy 0, policy_version 832465 (0.0010) [2023-12-26 06:14:10,312][123090] Updated weights for policy 1, policy_version 826689 (0.0008) [2023-12-26 06:14:10,328][123091] Updated weights for policy 0, policy_version 832475 (0.0008) [2023-12-26 06:14:10,378][123091] Updated weights for policy 0, policy_version 832485 (0.0008) [2023-12-26 06:14:10,380][123090] Updated weights for policy 1, policy_version 826699 (0.0009) [2023-12-26 06:14:10,425][123091] Updated weights for policy 0, policy_version 832495 (0.0007) [2023-12-26 06:14:10,452][123090] Updated weights for policy 1, policy_version 826709 (0.0005) [2023-12-26 06:14:10,527][123090] Updated weights for policy 1, policy_version 826719 (0.0005) [2023-12-26 06:14:11,173][123091] Updated weights for policy 0, policy_version 832505 (0.0007) [2023-12-26 06:14:11,245][123091] Updated weights for policy 0, policy_version 832515 (0.0011) [2023-12-26 06:14:11,281][123090] Updated weights for policy 1, policy_version 826729 (0.0007) [2023-12-26 06:14:11,313][123091] Updated weights for policy 0, policy_version 832525 (0.0007) [2023-12-26 06:14:11,341][123090] Updated weights for policy 1, policy_version 826740 (0.0009) [2023-12-26 06:14:11,414][123090] Updated weights for policy 1, policy_version 826750 (0.0010) [2023-12-26 06:14:12,143][123091] Updated weights for policy 0, policy_version 832535 (0.0009) [2023-12-26 06:14:12,210][123091] Updated weights for policy 0, policy_version 832545 (0.0010) [2023-12-26 06:14:12,228][123090] Updated weights for policy 1, policy_version 826760 (0.0009) [2023-12-26 06:14:12,276][123091] Updated weights for policy 0, policy_version 832555 (0.0010) [2023-12-26 06:14:12,300][123090] Updated weights for policy 1, policy_version 826770 (0.0008) [2023-12-26 06:14:12,372][123090] Updated weights for policy 1, policy_version 826780 (0.0009) [2023-12-26 06:14:13,051][123091] Updated weights for policy 0, policy_version 832565 (0.0008) [2023-12-26 06:14:13,125][123091] Updated weights for policy 0, policy_version 832575 (0.0005) [2023-12-26 06:14:13,172][123090] Updated weights for policy 1, policy_version 826790 (0.0008) [2023-12-26 06:14:13,189][123091] Updated weights for policy 0, policy_version 832585 (0.0005) [2023-12-26 06:14:13,220][123090] Updated weights for policy 1, policy_version 826800 (0.0007) [2023-12-26 06:14:13,290][123090] Updated weights for policy 1, policy_version 826810 (0.0005) [2023-12-26 06:14:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 424812544. Throughput: 0: 9151.8, 1: 8723.9. Samples: 424806908. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:13,785][121949] Avg episode reward: [(0, '6088.286'), (1, '5079.563')] [2023-12-26 06:14:13,796][123091] Updated weights for policy 0, policy_version 832595 (0.0005) [2023-12-26 06:14:13,851][123091] Updated weights for policy 0, policy_version 832605 (0.0007) [2023-12-26 06:14:13,911][123091] Updated weights for policy 0, policy_version 832615 (0.0010) [2023-12-26 06:14:14,010][123090] Updated weights for policy 1, policy_version 826820 (0.0005) [2023-12-26 06:14:14,059][123090] Updated weights for policy 1, policy_version 826830 (0.0006) [2023-12-26 06:14:14,119][123090] Updated weights for policy 1, policy_version 826840 (0.0006) [2023-12-26 06:14:14,620][123091] Updated weights for policy 0, policy_version 832625 (0.0008) [2023-12-26 06:14:14,677][123091] Updated weights for policy 0, policy_version 832635 (0.0006) [2023-12-26 06:14:14,737][123091] Updated weights for policy 0, policy_version 832645 (0.0006) [2023-12-26 06:14:14,806][123091] Updated weights for policy 0, policy_version 832655 (0.0007) [2023-12-26 06:14:14,936][123090] Updated weights for policy 1, policy_version 826850 (0.0006) [2023-12-26 06:14:15,008][123090] Updated weights for policy 1, policy_version 826860 (0.0007) [2023-12-26 06:14:15,071][123090] Updated weights for policy 1, policy_version 826870 (0.0006) [2023-12-26 06:14:15,131][123090] Updated weights for policy 1, policy_version 826880 (0.0005) [2023-12-26 06:14:15,585][123091] Updated weights for policy 0, policy_version 832665 (0.0010) [2023-12-26 06:14:15,637][123091] Updated weights for policy 0, policy_version 832675 (0.0010) [2023-12-26 06:14:15,703][123091] Updated weights for policy 0, policy_version 832685 (0.0010) [2023-12-26 06:14:15,855][123090] Updated weights for policy 1, policy_version 826890 (0.0006) [2023-12-26 06:14:15,928][123090] Updated weights for policy 1, policy_version 826900 (0.0005) [2023-12-26 06:14:15,985][123090] Updated weights for policy 1, policy_version 826910 (0.0005) [2023-12-26 06:14:16,533][123091] Updated weights for policy 0, policy_version 832695 (0.0010) [2023-12-26 06:14:16,600][123091] Updated weights for policy 0, policy_version 832705 (0.0011) [2023-12-26 06:14:16,634][123090] Updated weights for policy 1, policy_version 826920 (0.0005) [2023-12-26 06:14:16,656][123091] Updated weights for policy 0, policy_version 832715 (0.0011) [2023-12-26 06:14:16,689][123090] Updated weights for policy 1, policy_version 826930 (0.0005) [2023-12-26 06:14:16,747][123090] Updated weights for policy 1, policy_version 826940 (0.0005) [2023-12-26 06:14:17,448][123090] Updated weights for policy 1, policy_version 826950 (0.0005) [2023-12-26 06:14:17,478][123091] Updated weights for policy 0, policy_version 832725 (0.0011) [2023-12-26 06:14:17,504][123090] Updated weights for policy 1, policy_version 826960 (0.0005) [2023-12-26 06:14:17,544][123091] Updated weights for policy 0, policy_version 832735 (0.0010) [2023-12-26 06:14:17,561][123090] Updated weights for policy 1, policy_version 826970 (0.0005) [2023-12-26 06:14:17,610][123091] Updated weights for policy 0, policy_version 832745 (0.0011) [2023-12-26 06:14:18,299][123090] Updated weights for policy 1, policy_version 826980 (0.0007) [2023-12-26 06:14:18,364][123090] Updated weights for policy 1, policy_version 826990 (0.0010) [2023-12-26 06:14:18,434][123091] Updated weights for policy 0, policy_version 832755 (0.0009) [2023-12-26 06:14:18,439][123090] Updated weights for policy 1, policy_version 827000 (0.0011) [2023-12-26 06:14:18,486][123091] Updated weights for policy 0, policy_version 832765 (0.0008) [2023-12-26 06:14:18,543][123091] Updated weights for policy 0, policy_version 832775 (0.0009) [2023-12-26 06:14:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 424910848. Throughput: 0: 9104.0, 1: 8761.0. Samples: 424918436. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:18,785][121949] Avg episode reward: [(0, '6109.204'), (1, '5168.420')] [2023-12-26 06:14:19,260][123090] Updated weights for policy 1, policy_version 827010 (0.0010) [2023-12-26 06:14:19,330][123090] Updated weights for policy 1, policy_version 827020 (0.0009) [2023-12-26 06:14:19,397][123090] Updated weights for policy 1, policy_version 827030 (0.0010) [2023-12-26 06:14:19,398][123091] Updated weights for policy 0, policy_version 832785 (0.0009) [2023-12-26 06:14:19,461][123090] Updated weights for policy 1, policy_version 827040 (0.0011) [2023-12-26 06:14:19,464][123091] Updated weights for policy 0, policy_version 832795 (0.0006) [2023-12-26 06:14:19,530][123091] Updated weights for policy 0, policy_version 832805 (0.0009) [2023-12-26 06:14:19,594][123091] Updated weights for policy 0, policy_version 832815 (0.0009) [2023-12-26 06:14:20,234][123090] Updated weights for policy 1, policy_version 827050 (0.0005) [2023-12-26 06:14:20,301][123090] Updated weights for policy 1, policy_version 827060 (0.0006) [2023-12-26 06:14:20,353][123090] Updated weights for policy 1, policy_version 827070 (0.0006) [2023-12-26 06:14:20,479][123091] Updated weights for policy 0, policy_version 832825 (0.0006) [2023-12-26 06:14:20,541][123091] Updated weights for policy 0, policy_version 832835 (0.0006) [2023-12-26 06:14:20,616][123091] Updated weights for policy 0, policy_version 832845 (0.0007) [2023-12-26 06:14:20,973][123090] Updated weights for policy 1, policy_version 827080 (0.0005) [2023-12-26 06:14:21,042][123090] Updated weights for policy 1, policy_version 827090 (0.0008) [2023-12-26 06:14:21,114][123090] Updated weights for policy 1, policy_version 827100 (0.0006) [2023-12-26 06:14:21,391][123091] Updated weights for policy 0, policy_version 832855 (0.0009) [2023-12-26 06:14:21,451][123091] Updated weights for policy 0, policy_version 832865 (0.0011) [2023-12-26 06:14:21,502][123091] Updated weights for policy 0, policy_version 832875 (0.0010) [2023-12-26 06:14:21,877][123090] Updated weights for policy 1, policy_version 827110 (0.0007) [2023-12-26 06:14:21,944][123090] Updated weights for policy 1, policy_version 827120 (0.0008) [2023-12-26 06:14:22,007][123090] Updated weights for policy 1, policy_version 827130 (0.0006) [2023-12-26 06:14:22,392][123091] Updated weights for policy 0, policy_version 832885 (0.0009) [2023-12-26 06:14:22,455][123091] Updated weights for policy 0, policy_version 832895 (0.0009) [2023-12-26 06:14:22,525][123091] Updated weights for policy 0, policy_version 832905 (0.0009) [2023-12-26 06:14:22,761][123090] Updated weights for policy 1, policy_version 827140 (0.0007) [2023-12-26 06:14:22,820][123090] Updated weights for policy 1, policy_version 827150 (0.0011) [2023-12-26 06:14:22,880][123090] Updated weights for policy 1, policy_version 827160 (0.0010) [2023-12-26 06:14:23,367][123091] Updated weights for policy 0, policy_version 832915 (0.0009) [2023-12-26 06:14:23,425][123091] Updated weights for policy 0, policy_version 832925 (0.0010) [2023-12-26 06:14:23,477][123091] Updated weights for policy 0, policy_version 832935 (0.0009) [2023-12-26 06:14:23,718][123090] Updated weights for policy 1, policy_version 827170 (0.0010) [2023-12-26 06:14:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 424992768. Throughput: 0: 9058.8, 1: 8747.1. Samples: 424970660. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:23,785][121949] Avg episode reward: [(0, '6072.638'), (1, '5123.217')] [2023-12-26 06:14:23,785][123090] Updated weights for policy 1, policy_version 827180 (0.0010) [2023-12-26 06:14:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000832944_213237760.pth... [2023-12-26 06:14:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000831888_212967424.pth [2023-12-26 06:14:23,848][123090] Updated weights for policy 1, policy_version 827190 (0.0010) [2023-12-26 06:14:23,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000827200_211763200.pth... [2023-12-26 06:14:23,906][123090] Updated weights for policy 1, policy_version 827200 (0.0010) [2023-12-26 06:14:23,908][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000826112_211484672.pth [2023-12-26 06:14:24,344][123091] Updated weights for policy 0, policy_version 832945 (0.0009) [2023-12-26 06:14:24,403][123091] Updated weights for policy 0, policy_version 832955 (0.0009) [2023-12-26 06:14:24,459][123091] Updated weights for policy 0, policy_version 832965 (0.0009) [2023-12-26 06:14:24,507][123091] Updated weights for policy 0, policy_version 832975 (0.0009) [2023-12-26 06:14:24,698][123090] Updated weights for policy 1, policy_version 827210 (0.0010) [2023-12-26 06:14:24,751][123090] Updated weights for policy 1, policy_version 827220 (0.0010) [2023-12-26 06:14:24,814][123090] Updated weights for policy 1, policy_version 827230 (0.0010) [2023-12-26 06:14:25,365][123091] Updated weights for policy 0, policy_version 832985 (0.0010) [2023-12-26 06:14:25,427][123091] Updated weights for policy 0, policy_version 832995 (0.0009) [2023-12-26 06:14:25,495][123091] Updated weights for policy 0, policy_version 833005 (0.0009) [2023-12-26 06:14:25,626][123090] Updated weights for policy 1, policy_version 827240 (0.0009) [2023-12-26 06:14:25,680][123090] Updated weights for policy 1, policy_version 827250 (0.0009) [2023-12-26 06:14:25,738][123090] Updated weights for policy 1, policy_version 827260 (0.0009) [2023-12-26 06:14:26,253][123091] Updated weights for policy 0, policy_version 833015 (0.0006) [2023-12-26 06:14:26,319][123091] Updated weights for policy 0, policy_version 833025 (0.0005) [2023-12-26 06:14:26,377][123091] Updated weights for policy 0, policy_version 833035 (0.0005) [2023-12-26 06:14:26,660][123090] Updated weights for policy 1, policy_version 827270 (0.0009) [2023-12-26 06:14:26,717][123090] Updated weights for policy 1, policy_version 827280 (0.0010) [2023-12-26 06:14:26,775][123090] Updated weights for policy 1, policy_version 827290 (0.0009) [2023-12-26 06:14:27,034][123091] Updated weights for policy 0, policy_version 833045 (0.0007) [2023-12-26 06:14:27,090][123091] Updated weights for policy 0, policy_version 833055 (0.0010) [2023-12-26 06:14:27,135][123091] Updated weights for policy 0, policy_version 833065 (0.0010) [2023-12-26 06:14:27,674][123090] Updated weights for policy 1, policy_version 827300 (0.0010) [2023-12-26 06:14:27,730][123090] Updated weights for policy 1, policy_version 827310 (0.0009) [2023-12-26 06:14:27,778][123090] Updated weights for policy 1, policy_version 827320 (0.0008) [2023-12-26 06:14:27,930][123091] Updated weights for policy 0, policy_version 833075 (0.0010) [2023-12-26 06:14:27,984][123091] Updated weights for policy 0, policy_version 833085 (0.0010) [2023-12-26 06:14:28,038][123091] Updated weights for policy 0, policy_version 833095 (0.0010) [2023-12-26 06:14:28,669][123090] Updated weights for policy 1, policy_version 827330 (0.0009) [2023-12-26 06:14:28,727][123090] Updated weights for policy 1, policy_version 827340 (0.0010) [2023-12-26 06:14:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 425074688. Throughput: 0: 9095.1, 1: 8774.8. Samples: 425074384. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:28,785][121949] Avg episode reward: [(0, '6180.835'), (1, '4988.688')] [2023-12-26 06:14:28,785][123090] Updated weights for policy 1, policy_version 827350 (0.0010) [2023-12-26 06:14:28,788][123091] Updated weights for policy 0, policy_version 833105 (0.0010) [2023-12-26 06:14:28,842][123091] Updated weights for policy 0, policy_version 833115 (0.0006) [2023-12-26 06:14:28,842][123090] Updated weights for policy 1, policy_version 827360 (0.0009) [2023-12-26 06:14:28,896][123091] Updated weights for policy 0, policy_version 833125 (0.0007) [2023-12-26 06:14:28,943][123091] Updated weights for policy 0, policy_version 833135 (0.0008) [2023-12-26 06:14:29,678][123091] Updated weights for policy 0, policy_version 833145 (0.0009) [2023-12-26 06:14:29,740][123091] Updated weights for policy 0, policy_version 833155 (0.0009) [2023-12-26 06:14:29,782][123090] Updated weights for policy 1, policy_version 827370 (0.0008) [2023-12-26 06:14:29,800][123091] Updated weights for policy 0, policy_version 833165 (0.0009) [2023-12-26 06:14:29,842][123090] Updated weights for policy 1, policy_version 827380 (0.0008) [2023-12-26 06:14:29,906][123090] Updated weights for policy 1, policy_version 827390 (0.0009) [2023-12-26 06:14:30,567][123091] Updated weights for policy 0, policy_version 833175 (0.0007) [2023-12-26 06:14:30,625][123091] Updated weights for policy 0, policy_version 833185 (0.0005) [2023-12-26 06:14:30,690][123091] Updated weights for policy 0, policy_version 833195 (0.0007) [2023-12-26 06:14:30,787][123090] Updated weights for policy 1, policy_version 827400 (0.0010) [2023-12-26 06:14:30,847][123090] Updated weights for policy 1, policy_version 827410 (0.0010) [2023-12-26 06:14:30,903][123090] Updated weights for policy 1, policy_version 827421 (0.0010) [2023-12-26 06:14:31,399][123091] Updated weights for policy 0, policy_version 833205 (0.0008) [2023-12-26 06:14:31,462][123091] Updated weights for policy 0, policy_version 833215 (0.0010) [2023-12-26 06:14:31,524][123091] Updated weights for policy 0, policy_version 833225 (0.0010) [2023-12-26 06:14:31,769][123090] Updated weights for policy 1, policy_version 827431 (0.0009) [2023-12-26 06:14:31,838][123090] Updated weights for policy 1, policy_version 827441 (0.0010) [2023-12-26 06:14:31,900][123090] Updated weights for policy 1, policy_version 827451 (0.0009) [2023-12-26 06:14:32,288][123091] Updated weights for policy 0, policy_version 833235 (0.0009) [2023-12-26 06:14:32,361][123091] Updated weights for policy 0, policy_version 833245 (0.0006) [2023-12-26 06:14:32,431][123091] Updated weights for policy 0, policy_version 833255 (0.0009) [2023-12-26 06:14:32,712][123090] Updated weights for policy 1, policy_version 827461 (0.0009) [2023-12-26 06:14:32,768][123090] Updated weights for policy 1, policy_version 827471 (0.0010) [2023-12-26 06:14:32,823][123090] Updated weights for policy 1, policy_version 827481 (0.0010) [2023-12-26 06:14:33,170][123091] Updated weights for policy 0, policy_version 833265 (0.0009) [2023-12-26 06:14:33,226][123091] Updated weights for policy 0, policy_version 833275 (0.0005) [2023-12-26 06:14:33,286][123091] Updated weights for policy 0, policy_version 833285 (0.0005) [2023-12-26 06:14:33,341][123091] Updated weights for policy 0, policy_version 833295 (0.0005) [2023-12-26 06:14:33,551][123090] Updated weights for policy 1, policy_version 827491 (0.0008) [2023-12-26 06:14:33,604][123090] Updated weights for policy 1, policy_version 827501 (0.0007) [2023-12-26 06:14:33,654][123090] Updated weights for policy 1, policy_version 827511 (0.0006) [2023-12-26 06:14:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 425172992. Throughput: 0: 9134.5, 1: 8793.8. Samples: 425182172. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:33,785][121949] Avg episode reward: [(0, '6231.387'), (1, '4847.834')] [2023-12-26 06:14:33,934][123091] Updated weights for policy 0, policy_version 833305 (0.0009) [2023-12-26 06:14:33,990][123091] Updated weights for policy 0, policy_version 833315 (0.0010) [2023-12-26 06:14:34,042][123091] Updated weights for policy 0, policy_version 833326 (0.0010) [2023-12-26 06:14:34,363][123090] Updated weights for policy 1, policy_version 827521 (0.0006) [2023-12-26 06:14:34,432][123090] Updated weights for policy 1, policy_version 827531 (0.0009) [2023-12-26 06:14:34,504][123090] Updated weights for policy 1, policy_version 827541 (0.0010) [2023-12-26 06:14:34,573][123090] Updated weights for policy 1, policy_version 827551 (0.0010) [2023-12-26 06:14:34,878][123091] Updated weights for policy 0, policy_version 833336 (0.0007) [2023-12-26 06:14:34,950][123091] Updated weights for policy 0, policy_version 833346 (0.0010) [2023-12-26 06:14:35,018][123091] Updated weights for policy 0, policy_version 833356 (0.0011) [2023-12-26 06:14:35,408][123090] Updated weights for policy 1, policy_version 827561 (0.0008) [2023-12-26 06:14:35,482][123090] Updated weights for policy 1, policy_version 827571 (0.0005) [2023-12-26 06:14:35,551][123090] Updated weights for policy 1, policy_version 827581 (0.0008) [2023-12-26 06:14:35,777][123091] Updated weights for policy 0, policy_version 833366 (0.0010) [2023-12-26 06:14:35,824][123091] Updated weights for policy 0, policy_version 833376 (0.0008) [2023-12-26 06:14:35,883][123091] Updated weights for policy 0, policy_version 833386 (0.0009) [2023-12-26 06:14:36,345][123090] Updated weights for policy 1, policy_version 827591 (0.0010) [2023-12-26 06:14:36,410][123090] Updated weights for policy 1, policy_version 827601 (0.0010) [2023-12-26 06:14:36,474][123090] Updated weights for policy 1, policy_version 827611 (0.0010) [2023-12-26 06:14:36,716][123091] Updated weights for policy 0, policy_version 833396 (0.0010) [2023-12-26 06:14:36,777][123091] Updated weights for policy 0, policy_version 833406 (0.0009) [2023-12-26 06:14:36,848][123091] Updated weights for policy 0, policy_version 833416 (0.0006) [2023-12-26 06:14:37,300][123090] Updated weights for policy 1, policy_version 827621 (0.0009) [2023-12-26 06:14:37,361][123090] Updated weights for policy 1, policy_version 827631 (0.0009) [2023-12-26 06:14:37,426][123090] Updated weights for policy 1, policy_version 827641 (0.0008) [2023-12-26 06:14:37,642][123091] Updated weights for policy 0, policy_version 833426 (0.0005) [2023-12-26 06:14:37,702][123091] Updated weights for policy 0, policy_version 833436 (0.0009) [2023-12-26 06:14:37,753][123091] Updated weights for policy 0, policy_version 833446 (0.0011) [2023-12-26 06:14:37,804][123091] Updated weights for policy 0, policy_version 833456 (0.0010) [2023-12-26 06:14:38,196][123090] Updated weights for policy 1, policy_version 827651 (0.0007) [2023-12-26 06:14:38,284][123090] Updated weights for policy 1, policy_version 827661 (0.0010) [2023-12-26 06:14:38,353][123090] Updated weights for policy 1, policy_version 827671 (0.0009) [2023-12-26 06:14:38,642][123091] Updated weights for policy 0, policy_version 833466 (0.0005) [2023-12-26 06:14:38,716][123091] Updated weights for policy 0, policy_version 833476 (0.0005) [2023-12-26 06:14:38,780][123091] Updated weights for policy 0, policy_version 833486 (0.0009) [2023-12-26 06:14:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 425254912. Throughput: 0: 9116.0, 1: 8835.7. Samples: 425235416. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:38,785][121949] Avg episode reward: [(0, '6108.084'), (1, '5142.417')] [2023-12-26 06:14:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000827680_211886080.pth... [2023-12-26 06:14:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000833488_213377024.pth... [2023-12-26 06:14:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000826656_211623936.pth [2023-12-26 06:14:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000832432_213106688.pth [2023-12-26 06:14:39,127][123090] Updated weights for policy 1, policy_version 827681 (0.0009) [2023-12-26 06:14:39,188][123090] Updated weights for policy 1, policy_version 827691 (0.0009) [2023-12-26 06:14:39,256][123090] Updated weights for policy 1, policy_version 827701 (0.0009) [2023-12-26 06:14:39,326][123090] Updated weights for policy 1, policy_version 827711 (0.0010) [2023-12-26 06:14:39,491][123091] Updated weights for policy 0, policy_version 833496 (0.0009) [2023-12-26 06:14:39,551][123091] Updated weights for policy 0, policy_version 833506 (0.0010) [2023-12-26 06:14:39,618][123091] Updated weights for policy 0, policy_version 833516 (0.0010) [2023-12-26 06:14:40,172][123090] Updated weights for policy 1, policy_version 827721 (0.0010) [2023-12-26 06:14:40,234][123090] Updated weights for policy 1, policy_version 827731 (0.0009) [2023-12-26 06:14:40,300][123090] Updated weights for policy 1, policy_version 827741 (0.0009) [2023-12-26 06:14:40,446][123091] Updated weights for policy 0, policy_version 833526 (0.0010) [2023-12-26 06:14:40,525][123091] Updated weights for policy 0, policy_version 833536 (0.0011) [2023-12-26 06:14:40,589][123091] Updated weights for policy 0, policy_version 833546 (0.0009) [2023-12-26 06:14:41,150][123090] Updated weights for policy 1, policy_version 827751 (0.0009) [2023-12-26 06:14:41,222][123090] Updated weights for policy 1, policy_version 827761 (0.0008) [2023-12-26 06:14:41,285][123090] Updated weights for policy 1, policy_version 827771 (0.0009) [2023-12-26 06:14:41,394][123091] Updated weights for policy 0, policy_version 833556 (0.0009) [2023-12-26 06:14:41,446][123091] Updated weights for policy 0, policy_version 833566 (0.0007) [2023-12-26 06:14:41,504][123091] Updated weights for policy 0, policy_version 833576 (0.0007) [2023-12-26 06:14:42,168][123090] Updated weights for policy 1, policy_version 827781 (0.0011) [2023-12-26 06:14:42,235][123090] Updated weights for policy 1, policy_version 827791 (0.0010) [2023-12-26 06:14:42,304][123090] Updated weights for policy 1, policy_version 827801 (0.0010) [2023-12-26 06:14:42,384][123091] Updated weights for policy 0, policy_version 833586 (0.0010) [2023-12-26 06:14:42,448][123091] Updated weights for policy 0, policy_version 833596 (0.0008) [2023-12-26 06:14:42,517][123091] Updated weights for policy 0, policy_version 833606 (0.0010) [2023-12-26 06:14:42,582][123091] Updated weights for policy 0, policy_version 833616 (0.0010) [2023-12-26 06:14:43,141][123090] Updated weights for policy 1, policy_version 827811 (0.0010) [2023-12-26 06:14:43,201][123090] Updated weights for policy 1, policy_version 827821 (0.0009) [2023-12-26 06:14:43,263][123090] Updated weights for policy 1, policy_version 827831 (0.0009) [2023-12-26 06:14:43,440][123091] Updated weights for policy 0, policy_version 833626 (0.0010) [2023-12-26 06:14:43,491][123091] Updated weights for policy 0, policy_version 833636 (0.0010) [2023-12-26 06:14:43,539][123091] Updated weights for policy 0, policy_version 833646 (0.0009) [2023-12-26 06:14:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 425345024. Throughput: 0: 9050.9, 1: 8735.8. Samples: 425337276. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:43,784][121949] Avg episode reward: [(0, '5829.837'), (1, '5535.716')] [2023-12-26 06:14:44,077][123090] Updated weights for policy 1, policy_version 827841 (0.0009) [2023-12-26 06:14:44,142][123090] Updated weights for policy 1, policy_version 827851 (0.0005) [2023-12-26 06:14:44,200][123090] Updated weights for policy 1, policy_version 827861 (0.0005) [2023-12-26 06:14:44,265][123090] Updated weights for policy 1, policy_version 827871 (0.0008) [2023-12-26 06:14:44,405][123091] Updated weights for policy 0, policy_version 833656 (0.0009) [2023-12-26 06:14:44,466][123091] Updated weights for policy 0, policy_version 833666 (0.0010) [2023-12-26 06:14:44,534][123091] Updated weights for policy 0, policy_version 833676 (0.0010) [2023-12-26 06:14:45,039][123090] Updated weights for policy 1, policy_version 827881 (0.0010) [2023-12-26 06:14:45,105][123090] Updated weights for policy 1, policy_version 827891 (0.0010) [2023-12-26 06:14:45,172][123090] Updated weights for policy 1, policy_version 827901 (0.0010) [2023-12-26 06:14:45,350][123091] Updated weights for policy 0, policy_version 833686 (0.0010) [2023-12-26 06:14:45,416][123091] Updated weights for policy 0, policy_version 833696 (0.0009) [2023-12-26 06:14:45,471][123091] Updated weights for policy 0, policy_version 833706 (0.0009) [2023-12-26 06:14:46,023][123090] Updated weights for policy 1, policy_version 827911 (0.0009) [2023-12-26 06:14:46,091][123090] Updated weights for policy 1, policy_version 827921 (0.0008) [2023-12-26 06:14:46,160][123090] Updated weights for policy 1, policy_version 827931 (0.0009) [2023-12-26 06:14:46,287][123091] Updated weights for policy 0, policy_version 833716 (0.0008) [2023-12-26 06:14:46,339][123091] Updated weights for policy 0, policy_version 833726 (0.0006) [2023-12-26 06:14:46,388][123091] Updated weights for policy 0, policy_version 833736 (0.0007) [2023-12-26 06:14:47,022][123091] Updated weights for policy 0, policy_version 833746 (0.0007) [2023-12-26 06:14:47,059][123090] Updated weights for policy 1, policy_version 827941 (0.0009) [2023-12-26 06:14:47,091][123091] Updated weights for policy 0, policy_version 833756 (0.0009) [2023-12-26 06:14:47,115][123090] Updated weights for policy 1, policy_version 827951 (0.0005) [2023-12-26 06:14:47,139][123091] Updated weights for policy 0, policy_version 833766 (0.0010) [2023-12-26 06:14:47,176][123090] Updated weights for policy 1, policy_version 827961 (0.0006) [2023-12-26 06:14:47,194][123091] Updated weights for policy 0, policy_version 833776 (0.0010) [2023-12-26 06:14:47,900][123090] Updated weights for policy 1, policy_version 827971 (0.0008) [2023-12-26 06:14:47,955][123090] Updated weights for policy 1, policy_version 827981 (0.0010) [2023-12-26 06:14:47,995][123091] Updated weights for policy 0, policy_version 833786 (0.0010) [2023-12-26 06:14:48,007][123090] Updated weights for policy 1, policy_version 827991 (0.0010) [2023-12-26 06:14:48,053][123091] Updated weights for policy 0, policy_version 833796 (0.0010) [2023-12-26 06:14:48,120][123091] Updated weights for policy 0, policy_version 833806 (0.0011) [2023-12-26 06:14:48,766][123090] Updated weights for policy 1, policy_version 828001 (0.0010) [2023-12-26 06:14:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 425426944. Throughput: 0: 8986.3, 1: 8677.5. Samples: 425442716. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:48,784][121949] Avg episode reward: [(0, '5778.256'), (1, '5832.563')] [2023-12-26 06:14:48,813][123090] Updated weights for policy 1, policy_version 828011 (0.0005) [2023-12-26 06:14:48,864][123090] Updated weights for policy 1, policy_version 828021 (0.0006) [2023-12-26 06:14:48,918][123090] Updated weights for policy 1, policy_version 828031 (0.0006) [2023-12-26 06:14:48,924][123091] Updated weights for policy 0, policy_version 833816 (0.0010) [2023-12-26 06:14:48,989][123091] Updated weights for policy 0, policy_version 833826 (0.0010) [2023-12-26 06:14:49,052][123091] Updated weights for policy 0, policy_version 833836 (0.0011) [2023-12-26 06:14:49,738][123090] Updated weights for policy 1, policy_version 828041 (0.0009) [2023-12-26 06:14:49,793][123090] Updated weights for policy 1, policy_version 828051 (0.0009) [2023-12-26 06:14:49,859][123090] Updated weights for policy 1, policy_version 828061 (0.0009) [2023-12-26 06:14:49,926][123091] Updated weights for policy 0, policy_version 833846 (0.0010) [2023-12-26 06:14:49,984][123091] Updated weights for policy 0, policy_version 833856 (0.0008) [2023-12-26 06:14:50,043][123091] Updated weights for policy 0, policy_version 833866 (0.0009) [2023-12-26 06:14:50,721][123090] Updated weights for policy 1, policy_version 828071 (0.0010) [2023-12-26 06:14:50,786][123090] Updated weights for policy 1, policy_version 828081 (0.0011) [2023-12-26 06:14:50,850][123090] Updated weights for policy 1, policy_version 828091 (0.0010) [2023-12-26 06:14:50,883][123091] Updated weights for policy 0, policy_version 833876 (0.0007) [2023-12-26 06:14:50,946][123091] Updated weights for policy 0, policy_version 833886 (0.0009) [2023-12-26 06:14:51,003][123091] Updated weights for policy 0, policy_version 833896 (0.0009) [2023-12-26 06:14:51,757][123090] Updated weights for policy 1, policy_version 828101 (0.0013) [2023-12-26 06:14:51,826][123090] Updated weights for policy 1, policy_version 828111 (0.0011) [2023-12-26 06:14:51,880][123091] Updated weights for policy 0, policy_version 833906 (0.0008) [2023-12-26 06:14:51,890][123090] Updated weights for policy 1, policy_version 828121 (0.0009) [2023-12-26 06:14:51,945][123091] Updated weights for policy 0, policy_version 833916 (0.0007) [2023-12-26 06:14:51,998][123091] Updated weights for policy 0, policy_version 833926 (0.0009) [2023-12-26 06:14:52,060][123091] Updated weights for policy 0, policy_version 833936 (0.0009) [2023-12-26 06:14:52,721][123090] Updated weights for policy 1, policy_version 828131 (0.0011) [2023-12-26 06:14:52,781][123090] Updated weights for policy 1, policy_version 828141 (0.0010) [2023-12-26 06:14:52,836][123090] Updated weights for policy 1, policy_version 828151 (0.0010) [2023-12-26 06:14:52,890][123091] Updated weights for policy 0, policy_version 833946 (0.0011) [2023-12-26 06:14:52,949][123091] Updated weights for policy 0, policy_version 833956 (0.0010) [2023-12-26 06:14:53,011][123091] Updated weights for policy 0, policy_version 833966 (0.0010) [2023-12-26 06:14:53,565][123090] Updated weights for policy 1, policy_version 828161 (0.0010) [2023-12-26 06:14:53,629][123090] Updated weights for policy 1, policy_version 828171 (0.0006) [2023-12-26 06:14:53,686][123090] Updated weights for policy 1, policy_version 828181 (0.0006) [2023-12-26 06:14:53,749][123091] Updated weights for policy 0, policy_version 833976 (0.0008) [2023-12-26 06:14:53,755][123090] Updated weights for policy 1, policy_version 828191 (0.0007) [2023-12-26 06:14:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 425517056. Throughput: 0: 8946.1, 1: 8664.2. Samples: 425493468. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:53,785][121949] Avg episode reward: [(0, '5785.638'), (1, '5749.332')] [2023-12-26 06:14:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000828192_212017152.pth... [2023-12-26 06:14:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000827200_211763200.pth [2023-12-26 06:14:53,798][123091] Updated weights for policy 0, policy_version 833986 (0.0009) [2023-12-26 06:14:53,846][123091] Updated weights for policy 0, policy_version 833996 (0.0009) [2023-12-26 06:14:53,863][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000834000_213508096.pth... [2023-12-26 06:14:53,866][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000832944_213237760.pth [2023-12-26 06:14:54,528][123090] Updated weights for policy 1, policy_version 828201 (0.0010) [2023-12-26 06:14:54,592][123090] Updated weights for policy 1, policy_version 828211 (0.0011) [2023-12-26 06:14:54,649][123090] Updated weights for policy 1, policy_version 828221 (0.0011) [2023-12-26 06:14:54,713][123091] Updated weights for policy 0, policy_version 834006 (0.0009) [2023-12-26 06:14:54,770][123091] Updated weights for policy 0, policy_version 834016 (0.0009) [2023-12-26 06:14:54,826][123091] Updated weights for policy 0, policy_version 834026 (0.0009) [2023-12-26 06:14:55,461][123090] Updated weights for policy 1, policy_version 828231 (0.0007) [2023-12-26 06:14:55,512][123090] Updated weights for policy 1, policy_version 828241 (0.0006) [2023-12-26 06:14:55,574][123090] Updated weights for policy 1, policy_version 828251 (0.0005) [2023-12-26 06:14:55,701][123091] Updated weights for policy 0, policy_version 834036 (0.0009) [2023-12-26 06:14:55,761][123091] Updated weights for policy 0, policy_version 834046 (0.0009) [2023-12-26 06:14:55,826][123091] Updated weights for policy 0, policy_version 834056 (0.0011) [2023-12-26 06:14:56,267][123090] Updated weights for policy 1, policy_version 828261 (0.0008) [2023-12-26 06:14:56,330][123090] Updated weights for policy 1, policy_version 828271 (0.0009) [2023-12-26 06:14:56,404][123090] Updated weights for policy 1, policy_version 828281 (0.0008) [2023-12-26 06:14:56,668][123091] Updated weights for policy 0, policy_version 834066 (0.0011) [2023-12-26 06:14:56,735][123091] Updated weights for policy 0, policy_version 834076 (0.0011) [2023-12-26 06:14:56,782][123091] Updated weights for policy 0, policy_version 834086 (0.0010) [2023-12-26 06:14:56,829][123091] Updated weights for policy 0, policy_version 834096 (0.0005) [2023-12-26 06:14:57,072][123090] Updated weights for policy 1, policy_version 828291 (0.0007) [2023-12-26 06:14:57,134][123090] Updated weights for policy 1, policy_version 828301 (0.0005) [2023-12-26 06:14:57,196][123090] Updated weights for policy 1, policy_version 828311 (0.0005) [2023-12-26 06:14:57,545][123091] Updated weights for policy 0, policy_version 834106 (0.0006) [2023-12-26 06:14:57,592][123091] Updated weights for policy 0, policy_version 834116 (0.0009) [2023-12-26 06:14:57,636][123091] Updated weights for policy 0, policy_version 834126 (0.0010) [2023-12-26 06:14:57,839][123090] Updated weights for policy 1, policy_version 828321 (0.0006) [2023-12-26 06:14:57,890][123090] Updated weights for policy 1, policy_version 828331 (0.0010) [2023-12-26 06:14:57,949][123090] Updated weights for policy 1, policy_version 828341 (0.0010) [2023-12-26 06:14:58,001][123090] Updated weights for policy 1, policy_version 828351 (0.0010) [2023-12-26 06:14:58,502][123091] Updated weights for policy 0, policy_version 834136 (0.0008) [2023-12-26 06:14:58,574][123091] Updated weights for policy 0, policy_version 834146 (0.0008) [2023-12-26 06:14:58,648][123091] Updated weights for policy 0, policy_version 834156 (0.0008) [2023-12-26 06:14:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 425607168. Throughput: 0: 8872.4, 1: 8792.6. Samples: 425601828. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:14:58,785][121949] Avg episode reward: [(0, '5759.451'), (1, '5623.226')] [2023-12-26 06:14:58,937][123090] Updated weights for policy 1, policy_version 828361 (0.0010) [2023-12-26 06:14:59,000][123090] Updated weights for policy 1, policy_version 828371 (0.0010) [2023-12-26 06:14:59,062][123090] Updated weights for policy 1, policy_version 828381 (0.0009) [2023-12-26 06:14:59,427][123091] Updated weights for policy 0, policy_version 834166 (0.0009) [2023-12-26 06:14:59,482][123091] Updated weights for policy 0, policy_version 834176 (0.0010) [2023-12-26 06:14:59,536][123091] Updated weights for policy 0, policy_version 834186 (0.0009) [2023-12-26 06:14:59,919][123090] Updated weights for policy 1, policy_version 828391 (0.0009) [2023-12-26 06:14:59,991][123090] Updated weights for policy 1, policy_version 828401 (0.0009) [2023-12-26 06:15:00,053][123090] Updated weights for policy 1, policy_version 828411 (0.0008) [2023-12-26 06:15:00,271][123091] Updated weights for policy 0, policy_version 834196 (0.0010) [2023-12-26 06:15:00,323][123091] Updated weights for policy 0, policy_version 834206 (0.0010) [2023-12-26 06:15:00,385][123091] Updated weights for policy 0, policy_version 834216 (0.0011) [2023-12-26 06:15:00,917][123090] Updated weights for policy 1, policy_version 828421 (0.0010) [2023-12-26 06:15:00,974][123091] Updated weights for policy 0, policy_version 834226 (0.0010) [2023-12-26 06:15:00,982][123090] Updated weights for policy 1, policy_version 828431 (0.0009) [2023-12-26 06:15:01,033][123091] Updated weights for policy 0, policy_version 834236 (0.0008) [2023-12-26 06:15:01,045][123090] Updated weights for policy 1, policy_version 828441 (0.0008) [2023-12-26 06:15:01,102][123091] Updated weights for policy 0, policy_version 834246 (0.0010) [2023-12-26 06:15:01,170][123091] Updated weights for policy 0, policy_version 834256 (0.0011) [2023-12-26 06:15:01,945][123091] Updated weights for policy 0, policy_version 834266 (0.0013) [2023-12-26 06:15:01,978][123090] Updated weights for policy 1, policy_version 828451 (0.0008) [2023-12-26 06:15:02,007][123091] Updated weights for policy 0, policy_version 834276 (0.0011) [2023-12-26 06:15:02,041][123090] Updated weights for policy 1, policy_version 828461 (0.0007) [2023-12-26 06:15:02,059][123091] Updated weights for policy 0, policy_version 834286 (0.0007) [2023-12-26 06:15:02,105][123090] Updated weights for policy 1, policy_version 828471 (0.0009) [2023-12-26 06:15:02,764][123091] Updated weights for policy 0, policy_version 834296 (0.0006) [2023-12-26 06:15:02,815][123091] Updated weights for policy 0, policy_version 834306 (0.0006) [2023-12-26 06:15:02,869][123090] Updated weights for policy 1, policy_version 828481 (0.0009) [2023-12-26 06:15:02,890][123091] Updated weights for policy 0, policy_version 834316 (0.0007) [2023-12-26 06:15:02,926][123090] Updated weights for policy 1, policy_version 828491 (0.0006) [2023-12-26 06:15:02,997][123090] Updated weights for policy 1, policy_version 828501 (0.0007) [2023-12-26 06:15:03,063][123090] Updated weights for policy 1, policy_version 828511 (0.0010) [2023-12-26 06:15:03,544][123091] Updated weights for policy 0, policy_version 834326 (0.0007) [2023-12-26 06:15:03,595][123091] Updated weights for policy 0, policy_version 834336 (0.0008) [2023-12-26 06:15:03,639][123091] Updated weights for policy 0, policy_version 834346 (0.0010) [2023-12-26 06:15:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 425697280. Throughput: 0: 8899.7, 1: 8645.9. Samples: 425707984. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:03,784][121949] Avg episode reward: [(0, '5866.114'), (1, '5549.022')] [2023-12-26 06:15:03,867][123090] Updated weights for policy 1, policy_version 828521 (0.0011) [2023-12-26 06:15:03,934][123090] Updated weights for policy 1, policy_version 828531 (0.0011) [2023-12-26 06:15:03,998][123090] Updated weights for policy 1, policy_version 828541 (0.0011) [2023-12-26 06:15:04,413][123091] Updated weights for policy 0, policy_version 834356 (0.0008) [2023-12-26 06:15:04,478][123091] Updated weights for policy 0, policy_version 834366 (0.0006) [2023-12-26 06:15:04,553][123091] Updated weights for policy 0, policy_version 834376 (0.0006) [2023-12-26 06:15:04,820][123090] Updated weights for policy 1, policy_version 828551 (0.0010) [2023-12-26 06:15:04,867][123090] Updated weights for policy 1, policy_version 828561 (0.0010) [2023-12-26 06:15:04,918][123090] Updated weights for policy 1, policy_version 828571 (0.0010) [2023-12-26 06:15:05,215][123091] Updated weights for policy 0, policy_version 834386 (0.0006) [2023-12-26 06:15:05,276][123091] Updated weights for policy 0, policy_version 834396 (0.0005) [2023-12-26 06:15:05,330][123091] Updated weights for policy 0, policy_version 834406 (0.0005) [2023-12-26 06:15:05,384][123091] Updated weights for policy 0, policy_version 834416 (0.0005) [2023-12-26 06:15:05,771][123090] Updated weights for policy 1, policy_version 828581 (0.0010) [2023-12-26 06:15:05,834][123090] Updated weights for policy 1, policy_version 828591 (0.0010) [2023-12-26 06:15:05,897][123090] Updated weights for policy 1, policy_version 828601 (0.0010) [2023-12-26 06:15:05,986][123091] Updated weights for policy 0, policy_version 834426 (0.0011) [2023-12-26 06:15:06,030][123091] Updated weights for policy 0, policy_version 834436 (0.0010) [2023-12-26 06:15:06,081][123091] Updated weights for policy 0, policy_version 834446 (0.0010) [2023-12-26 06:15:06,729][123090] Updated weights for policy 1, policy_version 828611 (0.0011) [2023-12-26 06:15:06,785][123090] Updated weights for policy 1, policy_version 828621 (0.0010) [2023-12-26 06:15:06,841][123090] Updated weights for policy 1, policy_version 828631 (0.0010) [2023-12-26 06:15:06,925][123091] Updated weights for policy 0, policy_version 834456 (0.0009) [2023-12-26 06:15:06,988][123091] Updated weights for policy 0, policy_version 834466 (0.0009) [2023-12-26 06:15:07,051][123091] Updated weights for policy 0, policy_version 834476 (0.0009) [2023-12-26 06:15:07,563][123090] Updated weights for policy 1, policy_version 828641 (0.0010) [2023-12-26 06:15:07,628][123090] Updated weights for policy 1, policy_version 828651 (0.0008) [2023-12-26 06:15:07,687][123090] Updated weights for policy 1, policy_version 828661 (0.0010) [2023-12-26 06:15:07,749][123090] Updated weights for policy 1, policy_version 828671 (0.0010) [2023-12-26 06:15:07,882][123091] Updated weights for policy 0, policy_version 834486 (0.0008) [2023-12-26 06:15:07,935][123091] Updated weights for policy 0, policy_version 834496 (0.0007) [2023-12-26 06:15:07,995][123091] Updated weights for policy 0, policy_version 834506 (0.0007) [2023-12-26 06:15:08,556][123090] Updated weights for policy 1, policy_version 828681 (0.0010) [2023-12-26 06:15:08,619][123090] Updated weights for policy 1, policy_version 828691 (0.0010) [2023-12-26 06:15:08,678][123090] Updated weights for policy 1, policy_version 828701 (0.0010) [2023-12-26 06:15:08,709][123091] Updated weights for policy 0, policy_version 834516 (0.0008) [2023-12-26 06:15:08,757][123091] Updated weights for policy 0, policy_version 834526 (0.0010) [2023-12-26 06:15:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 425787392. Throughput: 0: 9014.5, 1: 8600.7. Samples: 425763344. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:08,784][121949] Avg episode reward: [(0, '5969.429'), (1, '5768.325')] [2023-12-26 06:15:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000828704_212148224.pth... [2023-12-26 06:15:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000827680_211886080.pth [2023-12-26 06:15:08,801][123091] Updated weights for policy 0, policy_version 834536 (0.0010) [2023-12-26 06:15:08,839][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000834544_213647360.pth... [2023-12-26 06:15:08,844][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000833488_213377024.pth [2023-12-26 06:15:09,511][123090] Updated weights for policy 1, policy_version 828711 (0.0009) [2023-12-26 06:15:09,571][123090] Updated weights for policy 1, policy_version 828721 (0.0006) [2023-12-26 06:15:09,629][123090] Updated weights for policy 1, policy_version 828731 (0.0009) [2023-12-26 06:15:09,684][123091] Updated weights for policy 0, policy_version 834546 (0.0010) [2023-12-26 06:15:09,750][123091] Updated weights for policy 0, policy_version 834556 (0.0008) [2023-12-26 06:15:09,821][123091] Updated weights for policy 0, policy_version 834566 (0.0008) [2023-12-26 06:15:09,887][123091] Updated weights for policy 0, policy_version 834576 (0.0007) [2023-12-26 06:15:10,474][123090] Updated weights for policy 1, policy_version 828741 (0.0010) [2023-12-26 06:15:10,522][123090] Updated weights for policy 1, policy_version 828751 (0.0010) [2023-12-26 06:15:10,570][123090] Updated weights for policy 1, policy_version 828761 (0.0010) [2023-12-26 06:15:10,650][123091] Updated weights for policy 0, policy_version 834586 (0.0009) [2023-12-26 06:15:10,710][123091] Updated weights for policy 0, policy_version 834596 (0.0008) [2023-12-26 06:15:10,775][123091] Updated weights for policy 0, policy_version 834606 (0.0008) [2023-12-26 06:15:11,467][123090] Updated weights for policy 1, policy_version 828771 (0.0010) [2023-12-26 06:15:11,522][123091] Updated weights for policy 0, policy_version 834616 (0.0008) [2023-12-26 06:15:11,535][123090] Updated weights for policy 1, policy_version 828781 (0.0008) [2023-12-26 06:15:11,585][123091] Updated weights for policy 0, policy_version 834626 (0.0008) [2023-12-26 06:15:11,595][123090] Updated weights for policy 1, policy_version 828791 (0.0009) [2023-12-26 06:15:11,657][123091] Updated weights for policy 0, policy_version 834636 (0.0009) [2023-12-26 06:15:12,441][123090] Updated weights for policy 1, policy_version 828801 (0.0009) [2023-12-26 06:15:12,474][123091] Updated weights for policy 0, policy_version 834646 (0.0010) [2023-12-26 06:15:12,512][123090] Updated weights for policy 1, policy_version 828811 (0.0008) [2023-12-26 06:15:12,543][123091] Updated weights for policy 0, policy_version 834656 (0.0006) [2023-12-26 06:15:12,576][123090] Updated weights for policy 1, policy_version 828821 (0.0009) [2023-12-26 06:15:12,604][123091] Updated weights for policy 0, policy_version 834666 (0.0006) [2023-12-26 06:15:12,641][123090] Updated weights for policy 1, policy_version 828831 (0.0009) [2023-12-26 06:15:13,315][123091] Updated weights for policy 0, policy_version 834676 (0.0007) [2023-12-26 06:15:13,378][123091] Updated weights for policy 0, policy_version 834686 (0.0009) [2023-12-26 06:15:13,427][123091] Updated weights for policy 0, policy_version 834696 (0.0009) [2023-12-26 06:15:13,490][123090] Updated weights for policy 1, policy_version 828841 (0.0010) [2023-12-26 06:15:13,556][123090] Updated weights for policy 1, policy_version 828851 (0.0009) [2023-12-26 06:15:13,620][123090] Updated weights for policy 1, policy_version 828861 (0.0009) [2023-12-26 06:15:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 425877504. Throughput: 0: 9013.0, 1: 8603.5. Samples: 425867124. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:13,785][121949] Avg episode reward: [(0, '5878.770'), (1, '5661.496')] [2023-12-26 06:15:14,186][123091] Updated weights for policy 0, policy_version 834707 (0.0008) [2023-12-26 06:15:14,249][123091] Updated weights for policy 0, policy_version 834717 (0.0006) [2023-12-26 06:15:14,306][123091] Updated weights for policy 0, policy_version 834727 (0.0009) [2023-12-26 06:15:14,503][123090] Updated weights for policy 1, policy_version 828871 (0.0009) [2023-12-26 06:15:14,562][123090] Updated weights for policy 1, policy_version 828882 (0.0008) [2023-12-26 06:15:14,613][123090] Updated weights for policy 1, policy_version 828892 (0.0009) [2023-12-26 06:15:15,086][123091] Updated weights for policy 0, policy_version 834737 (0.0006) [2023-12-26 06:15:15,145][123091] Updated weights for policy 0, policy_version 834747 (0.0006) [2023-12-26 06:15:15,209][123091] Updated weights for policy 0, policy_version 834757 (0.0006) [2023-12-26 06:15:15,277][123091] Updated weights for policy 0, policy_version 834767 (0.0006) [2023-12-26 06:15:15,472][123090] Updated weights for policy 1, policy_version 828902 (0.0009) [2023-12-26 06:15:15,537][123090] Updated weights for policy 1, policy_version 828913 (0.0010) [2023-12-26 06:15:15,605][123090] Updated weights for policy 1, policy_version 828923 (0.0010) [2023-12-26 06:15:16,054][123091] Updated weights for policy 0, policy_version 834777 (0.0006) [2023-12-26 06:15:16,121][123091] Updated weights for policy 0, policy_version 834787 (0.0005) [2023-12-26 06:15:16,193][123091] Updated weights for policy 0, policy_version 834797 (0.0005) [2023-12-26 06:15:16,410][123090] Updated weights for policy 1, policy_version 828933 (0.0010) [2023-12-26 06:15:16,466][123090] Updated weights for policy 1, policy_version 828943 (0.0009) [2023-12-26 06:15:16,529][123090] Updated weights for policy 1, policy_version 828953 (0.0005) [2023-12-26 06:15:16,807][123091] Updated weights for policy 0, policy_version 834807 (0.0005) [2023-12-26 06:15:16,854][123091] Updated weights for policy 0, policy_version 834817 (0.0006) [2023-12-26 06:15:16,914][123091] Updated weights for policy 0, policy_version 834827 (0.0005) [2023-12-26 06:15:17,287][123090] Updated weights for policy 1, policy_version 828963 (0.0007) [2023-12-26 06:15:17,337][123090] Updated weights for policy 1, policy_version 828973 (0.0010) [2023-12-26 06:15:17,395][123090] Updated weights for policy 1, policy_version 828983 (0.0010) [2023-12-26 06:15:17,587][123091] Updated weights for policy 0, policy_version 834837 (0.0007) [2023-12-26 06:15:17,645][123091] Updated weights for policy 0, policy_version 834847 (0.0009) [2023-12-26 06:15:17,710][123091] Updated weights for policy 0, policy_version 834857 (0.0011) [2023-12-26 06:15:18,201][123090] Updated weights for policy 1, policy_version 828993 (0.0010) [2023-12-26 06:15:18,263][123090] Updated weights for policy 1, policy_version 829005 (0.0010) [2023-12-26 06:15:18,316][123090] Updated weights for policy 1, policy_version 829015 (0.0009) [2023-12-26 06:15:18,499][123091] Updated weights for policy 0, policy_version 834867 (0.0010) [2023-12-26 06:15:18,564][123091] Updated weights for policy 0, policy_version 834877 (0.0005) [2023-12-26 06:15:18,630][123091] Updated weights for policy 0, policy_version 834887 (0.0006) [2023-12-26 06:15:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 425967616. Throughput: 0: 9026.7, 1: 8608.3. Samples: 425975744. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:18,784][121949] Avg episode reward: [(0, '6018.682'), (1, '5753.928')] [2023-12-26 06:15:19,248][123090] Updated weights for policy 1, policy_version 829025 (0.0010) [2023-12-26 06:15:19,263][123091] Updated weights for policy 0, policy_version 834897 (0.0006) [2023-12-26 06:15:19,314][123090] Updated weights for policy 1, policy_version 829035 (0.0007) [2023-12-26 06:15:19,315][123091] Updated weights for policy 0, policy_version 834907 (0.0008) [2023-12-26 06:15:19,384][123091] Updated weights for policy 0, policy_version 834917 (0.0008) [2023-12-26 06:15:19,387][123090] Updated weights for policy 1, policy_version 829045 (0.0009) [2023-12-26 06:15:19,446][123091] Updated weights for policy 0, policy_version 834927 (0.0007) [2023-12-26 06:15:19,448][123090] Updated weights for policy 1, policy_version 829055 (0.0009) [2023-12-26 06:15:20,287][123091] Updated weights for policy 0, policy_version 834937 (0.0009) [2023-12-26 06:15:20,296][123090] Updated weights for policy 1, policy_version 829065 (0.0007) [2023-12-26 06:15:20,353][123091] Updated weights for policy 0, policy_version 834947 (0.0007) [2023-12-26 06:15:20,361][123090] Updated weights for policy 1, policy_version 829075 (0.0007) [2023-12-26 06:15:20,413][123091] Updated weights for policy 0, policy_version 834957 (0.0009) [2023-12-26 06:15:20,424][123090] Updated weights for policy 1, policy_version 829085 (0.0008) [2023-12-26 06:15:21,195][123090] Updated weights for policy 1, policy_version 829095 (0.0008) [2023-12-26 06:15:21,247][123091] Updated weights for policy 0, policy_version 834967 (0.0008) [2023-12-26 06:15:21,268][123090] Updated weights for policy 1, policy_version 829105 (0.0009) [2023-12-26 06:15:21,311][123091] Updated weights for policy 0, policy_version 834977 (0.0009) [2023-12-26 06:15:21,330][123090] Updated weights for policy 1, policy_version 829115 (0.0008) [2023-12-26 06:15:21,380][123091] Updated weights for policy 0, policy_version 834987 (0.0008) [2023-12-26 06:15:22,151][123090] Updated weights for policy 1, policy_version 829125 (0.0010) [2023-12-26 06:15:22,228][123090] Updated weights for policy 1, policy_version 829135 (0.0011) [2023-12-26 06:15:22,255][123091] Updated weights for policy 0, policy_version 834997 (0.0010) [2023-12-26 06:15:22,288][123090] Updated weights for policy 1, policy_version 829145 (0.0008) [2023-12-26 06:15:22,317][123091] Updated weights for policy 0, policy_version 835007 (0.0008) [2023-12-26 06:15:22,387][123091] Updated weights for policy 0, policy_version 835017 (0.0010) [2023-12-26 06:15:23,084][123090] Updated weights for policy 1, policy_version 829155 (0.0010) [2023-12-26 06:15:23,134][123090] Updated weights for policy 1, policy_version 829165 (0.0008) [2023-12-26 06:15:23,176][123091] Updated weights for policy 0, policy_version 835027 (0.0010) [2023-12-26 06:15:23,191][123090] Updated weights for policy 1, policy_version 829175 (0.0007) [2023-12-26 06:15:23,236][123091] Updated weights for policy 0, policy_version 835037 (0.0008) [2023-12-26 06:15:23,302][123091] Updated weights for policy 0, policy_version 835047 (0.0010) [2023-12-26 06:15:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 426049536. Throughput: 0: 9007.3, 1: 8581.2. Samples: 426026900. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:23,785][121949] Avg episode reward: [(0, '6141.075'), (1, '5834.179')] [2023-12-26 06:15:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000835056_213778432.pth... [2023-12-26 06:15:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000829184_212271104.pth... [2023-12-26 06:15:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000834000_213508096.pth [2023-12-26 06:15:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000828192_212017152.pth [2023-12-26 06:15:23,874][123090] Updated weights for policy 1, policy_version 829185 (0.0006) [2023-12-26 06:15:23,937][123090] Updated weights for policy 1, policy_version 829195 (0.0010) [2023-12-26 06:15:24,006][123090] Updated weights for policy 1, policy_version 829205 (0.0009) [2023-12-26 06:15:24,075][123090] Updated weights for policy 1, policy_version 829215 (0.0010) [2023-12-26 06:15:24,154][123091] Updated weights for policy 0, policy_version 835057 (0.0010) [2023-12-26 06:15:24,218][123091] Updated weights for policy 0, policy_version 835067 (0.0009) [2023-12-26 06:15:24,272][123091] Updated weights for policy 0, policy_version 835077 (0.0009) [2023-12-26 06:15:24,326][123091] Updated weights for policy 0, policy_version 835087 (0.0009) [2023-12-26 06:15:24,821][123090] Updated weights for policy 1, policy_version 829225 (0.0006) [2023-12-26 06:15:24,870][123090] Updated weights for policy 1, policy_version 829235 (0.0008) [2023-12-26 06:15:24,920][123090] Updated weights for policy 1, policy_version 829245 (0.0009) [2023-12-26 06:15:25,191][123091] Updated weights for policy 0, policy_version 835097 (0.0006) [2023-12-26 06:15:25,250][123091] Updated weights for policy 0, policy_version 835107 (0.0006) [2023-12-26 06:15:25,309][123091] Updated weights for policy 0, policy_version 835117 (0.0010) [2023-12-26 06:15:25,698][123090] Updated weights for policy 1, policy_version 829255 (0.0007) [2023-12-26 06:15:25,744][123090] Updated weights for policy 1, policy_version 829265 (0.0005) [2023-12-26 06:15:25,802][123090] Updated weights for policy 1, policy_version 829275 (0.0005) [2023-12-26 06:15:25,990][123091] Updated weights for policy 0, policy_version 835127 (0.0007) [2023-12-26 06:15:26,043][123091] Updated weights for policy 0, policy_version 835137 (0.0005) [2023-12-26 06:15:26,088][123091] Updated weights for policy 0, policy_version 835147 (0.0005) [2023-12-26 06:15:26,467][123090] Updated weights for policy 1, policy_version 829285 (0.0007) [2023-12-26 06:15:26,514][123090] Updated weights for policy 1, policy_version 829295 (0.0005) [2023-12-26 06:15:26,566][123090] Updated weights for policy 1, policy_version 829305 (0.0008) [2023-12-26 06:15:26,820][123091] Updated weights for policy 0, policy_version 835157 (0.0007) [2023-12-26 06:15:26,876][123091] Updated weights for policy 0, policy_version 835167 (0.0010) [2023-12-26 06:15:26,924][123091] Updated weights for policy 0, policy_version 835177 (0.0009) [2023-12-26 06:15:27,277][123090] Updated weights for policy 1, policy_version 829315 (0.0006) [2023-12-26 06:15:27,334][123090] Updated weights for policy 1, policy_version 829325 (0.0010) [2023-12-26 06:15:27,401][123090] Updated weights for policy 1, policy_version 829335 (0.0010) [2023-12-26 06:15:27,808][123091] Updated weights for policy 0, policy_version 835187 (0.0009) [2023-12-26 06:15:27,870][123091] Updated weights for policy 0, policy_version 835197 (0.0009) [2023-12-26 06:15:27,932][123091] Updated weights for policy 0, policy_version 835207 (0.0009) [2023-12-26 06:15:28,178][123090] Updated weights for policy 1, policy_version 829345 (0.0010) [2023-12-26 06:15:28,231][123090] Updated weights for policy 1, policy_version 829355 (0.0010) [2023-12-26 06:15:28,282][123090] Updated weights for policy 1, policy_version 829365 (0.0009) [2023-12-26 06:15:28,345][123090] Updated weights for policy 1, policy_version 829375 (0.0009) [2023-12-26 06:15:28,682][123091] Updated weights for policy 0, policy_version 835217 (0.0008) [2023-12-26 06:15:28,734][123091] Updated weights for policy 0, policy_version 835227 (0.0006) [2023-12-26 06:15:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 426139648. Throughput: 0: 9022.3, 1: 8715.9. Samples: 426135496. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:28,785][121949] Avg episode reward: [(0, '6193.348'), (1, '5741.454')] [2023-12-26 06:15:28,802][123091] Updated weights for policy 0, policy_version 835237 (0.0006) [2023-12-26 06:15:28,863][123091] Updated weights for policy 0, policy_version 835247 (0.0006) [2023-12-26 06:15:29,067][123090] Updated weights for policy 1, policy_version 829385 (0.0009) [2023-12-26 06:15:29,138][123090] Updated weights for policy 1, policy_version 829396 (0.0010) [2023-12-26 06:15:29,206][123090] Updated weights for policy 1, policy_version 829406 (0.0007) [2023-12-26 06:15:29,657][123091] Updated weights for policy 0, policy_version 835257 (0.0005) [2023-12-26 06:15:29,710][123091] Updated weights for policy 0, policy_version 835267 (0.0005) [2023-12-26 06:15:29,765][123091] Updated weights for policy 0, policy_version 835277 (0.0008) [2023-12-26 06:15:30,059][123090] Updated weights for policy 1, policy_version 829416 (0.0008) [2023-12-26 06:15:30,117][123090] Updated weights for policy 1, policy_version 829426 (0.0008) [2023-12-26 06:15:30,176][123090] Updated weights for policy 1, policy_version 829436 (0.0009) [2023-12-26 06:15:30,555][123091] Updated weights for policy 0, policy_version 835287 (0.0007) [2023-12-26 06:15:30,619][123091] Updated weights for policy 0, policy_version 835297 (0.0009) [2023-12-26 06:15:30,682][123091] Updated weights for policy 0, policy_version 835307 (0.0010) [2023-12-26 06:15:30,954][123090] Updated weights for policy 1, policy_version 829446 (0.0007) [2023-12-26 06:15:31,007][123090] Updated weights for policy 1, policy_version 829456 (0.0005) [2023-12-26 06:15:31,076][123090] Updated weights for policy 1, policy_version 829466 (0.0008) [2023-12-26 06:15:31,545][123091] Updated weights for policy 0, policy_version 835317 (0.0009) [2023-12-26 06:15:31,618][123091] Updated weights for policy 0, policy_version 835327 (0.0010) [2023-12-26 06:15:31,673][123091] Updated weights for policy 0, policy_version 835337 (0.0009) [2023-12-26 06:15:31,738][123090] Updated weights for policy 1, policy_version 829476 (0.0008) [2023-12-26 06:15:31,798][123090] Updated weights for policy 1, policy_version 829486 (0.0010) [2023-12-26 06:15:31,851][123090] Updated weights for policy 1, policy_version 829496 (0.0010) [2023-12-26 06:15:32,444][123091] Updated weights for policy 0, policy_version 835347 (0.0008) [2023-12-26 06:15:32,507][123091] Updated weights for policy 0, policy_version 835357 (0.0007) [2023-12-26 06:15:32,576][123091] Updated weights for policy 0, policy_version 835367 (0.0005) [2023-12-26 06:15:32,751][123090] Updated weights for policy 1, policy_version 829506 (0.0009) [2023-12-26 06:15:32,814][123090] Updated weights for policy 1, policy_version 829516 (0.0010) [2023-12-26 06:15:32,875][123090] Updated weights for policy 1, policy_version 829526 (0.0009) [2023-12-26 06:15:32,936][123090] Updated weights for policy 1, policy_version 829536 (0.0010) [2023-12-26 06:15:33,323][123091] Updated weights for policy 0, policy_version 835377 (0.0006) [2023-12-26 06:15:33,377][123091] Updated weights for policy 0, policy_version 835387 (0.0006) [2023-12-26 06:15:33,431][123091] Updated weights for policy 0, policy_version 835397 (0.0005) [2023-12-26 06:15:33,486][123091] Updated weights for policy 0, policy_version 835407 (0.0005) [2023-12-26 06:15:33,702][123090] Updated weights for policy 1, policy_version 829546 (0.0009) [2023-12-26 06:15:33,752][123090] Updated weights for policy 1, policy_version 829556 (0.0009) [2023-12-26 06:15:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 426229760. Throughput: 0: 9039.4, 1: 8752.7. Samples: 426243360. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:33,785][121949] Avg episode reward: [(0, '6160.244'), (1, '5763.481')] [2023-12-26 06:15:33,802][123090] Updated weights for policy 1, policy_version 829566 (0.0009) [2023-12-26 06:15:34,213][123091] Updated weights for policy 0, policy_version 835417 (0.0010) [2023-12-26 06:15:34,277][123091] Updated weights for policy 0, policy_version 835427 (0.0009) [2023-12-26 06:15:34,343][123091] Updated weights for policy 0, policy_version 835437 (0.0009) [2023-12-26 06:15:34,681][123090] Updated weights for policy 1, policy_version 829576 (0.0009) [2023-12-26 06:15:34,745][123090] Updated weights for policy 1, policy_version 829586 (0.0008) [2023-12-26 06:15:34,825][123090] Updated weights for policy 1, policy_version 829596 (0.0010) [2023-12-26 06:15:35,107][123091] Updated weights for policy 0, policy_version 835447 (0.0007) [2023-12-26 06:15:35,163][123091] Updated weights for policy 0, policy_version 835457 (0.0005) [2023-12-26 06:15:35,221][123091] Updated weights for policy 0, policy_version 835467 (0.0005) [2023-12-26 06:15:35,562][123090] Updated weights for policy 1, policy_version 829606 (0.0008) [2023-12-26 06:15:35,626][123090] Updated weights for policy 1, policy_version 829616 (0.0009) [2023-12-26 06:15:35,690][123090] Updated weights for policy 1, policy_version 829626 (0.0008) [2023-12-26 06:15:35,902][123091] Updated weights for policy 0, policy_version 835477 (0.0006) [2023-12-26 06:15:35,967][123091] Updated weights for policy 0, policy_version 835487 (0.0006) [2023-12-26 06:15:36,018][123091] Updated weights for policy 0, policy_version 835497 (0.0005) [2023-12-26 06:15:36,463][123090] Updated weights for policy 1, policy_version 829636 (0.0005) [2023-12-26 06:15:36,535][123090] Updated weights for policy 1, policy_version 829646 (0.0005) [2023-12-26 06:15:36,603][123090] Updated weights for policy 1, policy_version 829656 (0.0006) [2023-12-26 06:15:36,806][123091] Updated weights for policy 0, policy_version 835507 (0.0006) [2023-12-26 06:15:36,861][123091] Updated weights for policy 0, policy_version 835517 (0.0010) [2023-12-26 06:15:36,924][123091] Updated weights for policy 0, policy_version 835527 (0.0010) [2023-12-26 06:15:37,295][123090] Updated weights for policy 1, policy_version 829666 (0.0006) [2023-12-26 06:15:37,367][123090] Updated weights for policy 1, policy_version 829676 (0.0009) [2023-12-26 06:15:37,435][123090] Updated weights for policy 1, policy_version 829686 (0.0009) [2023-12-26 06:15:37,498][123090] Updated weights for policy 1, policy_version 829696 (0.0009) [2023-12-26 06:15:37,763][123091] Updated weights for policy 0, policy_version 835537 (0.0011) [2023-12-26 06:15:37,827][123091] Updated weights for policy 0, policy_version 835547 (0.0011) [2023-12-26 06:15:37,892][123091] Updated weights for policy 0, policy_version 835557 (0.0011) [2023-12-26 06:15:37,950][123091] Updated weights for policy 0, policy_version 835567 (0.0010) [2023-12-26 06:15:38,355][123090] Updated weights for policy 1, policy_version 829706 (0.0009) [2023-12-26 06:15:38,412][123090] Updated weights for policy 1, policy_version 829716 (0.0010) [2023-12-26 06:15:38,475][123090] Updated weights for policy 1, policy_version 829726 (0.0010) [2023-12-26 06:15:38,715][123091] Updated weights for policy 0, policy_version 835577 (0.0011) [2023-12-26 06:15:38,783][123091] Updated weights for policy 0, policy_version 835587 (0.0011) [2023-12-26 06:15:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 426319872. Throughput: 0: 9116.7, 1: 8778.3. Samples: 426298740. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:38,784][121949] Avg episode reward: [(0, '6149.862'), (1, '5818.625')] [2023-12-26 06:15:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000829728_212410368.pth... [2023-12-26 06:15:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000828704_212148224.pth [2023-12-26 06:15:38,849][123091] Updated weights for policy 0, policy_version 835597 (0.0011) [2023-12-26 06:15:38,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000835600_213917696.pth... [2023-12-26 06:15:38,871][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000834544_213647360.pth [2023-12-26 06:15:39,353][123090] Updated weights for policy 1, policy_version 829736 (0.0009) [2023-12-26 06:15:39,423][123090] Updated weights for policy 1, policy_version 829746 (0.0009) [2023-12-26 06:15:39,481][123090] Updated weights for policy 1, policy_version 829756 (0.0010) [2023-12-26 06:15:39,623][123091] Updated weights for policy 0, policy_version 835607 (0.0010) [2023-12-26 06:15:39,685][123091] Updated weights for policy 0, policy_version 835617 (0.0010) [2023-12-26 06:15:39,748][123091] Updated weights for policy 0, policy_version 835627 (0.0010) [2023-12-26 06:15:40,313][123090] Updated weights for policy 1, policy_version 829766 (0.0010) [2023-12-26 06:15:40,378][123090] Updated weights for policy 1, policy_version 829776 (0.0011) [2023-12-26 06:15:40,446][123090] Updated weights for policy 1, policy_version 829786 (0.0011) [2023-12-26 06:15:40,603][123091] Updated weights for policy 0, policy_version 835637 (0.0008) [2023-12-26 06:15:40,670][123091] Updated weights for policy 0, policy_version 835647 (0.0006) [2023-12-26 06:15:40,742][123091] Updated weights for policy 0, policy_version 835657 (0.0007) [2023-12-26 06:15:41,316][123090] Updated weights for policy 1, policy_version 829796 (0.0011) [2023-12-26 06:15:41,382][123090] Updated weights for policy 1, policy_version 829806 (0.0011) [2023-12-26 06:15:41,453][123090] Updated weights for policy 1, policy_version 829816 (0.0009) [2023-12-26 06:15:41,522][123091] Updated weights for policy 0, policy_version 835667 (0.0010) [2023-12-26 06:15:41,590][123091] Updated weights for policy 0, policy_version 835677 (0.0009) [2023-12-26 06:15:41,648][123091] Updated weights for policy 0, policy_version 835687 (0.0009) [2023-12-26 06:15:42,257][123090] Updated weights for policy 1, policy_version 829826 (0.0008) [2023-12-26 06:15:42,338][123090] Updated weights for policy 1, policy_version 829836 (0.0006) [2023-12-26 06:15:42,406][123090] Updated weights for policy 1, policy_version 829846 (0.0009) [2023-12-26 06:15:42,467][123090] Updated weights for policy 1, policy_version 829856 (0.0009) [2023-12-26 06:15:42,489][123091] Updated weights for policy 0, policy_version 835697 (0.0009) [2023-12-26 06:15:42,551][123091] Updated weights for policy 0, policy_version 835707 (0.0009) [2023-12-26 06:15:42,607][123091] Updated weights for policy 0, policy_version 835717 (0.0009) [2023-12-26 06:15:42,659][123091] Updated weights for policy 0, policy_version 835727 (0.0009) [2023-12-26 06:15:43,242][123090] Updated weights for policy 1, policy_version 829866 (0.0006) [2023-12-26 06:15:43,300][123090] Updated weights for policy 1, policy_version 829876 (0.0007) [2023-12-26 06:15:43,359][123090] Updated weights for policy 1, policy_version 829886 (0.0006) [2023-12-26 06:15:43,513][123091] Updated weights for policy 0, policy_version 835737 (0.0006) [2023-12-26 06:15:43,560][123091] Updated weights for policy 0, policy_version 835747 (0.0005) [2023-12-26 06:15:43,614][123091] Updated weights for policy 0, policy_version 835757 (0.0005) [2023-12-26 06:15:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 426409984. Throughput: 0: 9092.8, 1: 8670.3. Samples: 426401168. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:43,785][121949] Avg episode reward: [(0, '6266.276'), (1, '5814.850')] [2023-12-26 06:15:44,109][123090] Updated weights for policy 1, policy_version 829896 (0.0006) [2023-12-26 06:15:44,163][123090] Updated weights for policy 1, policy_version 829906 (0.0009) [2023-12-26 06:15:44,220][123090] Updated weights for policy 1, policy_version 829916 (0.0008) [2023-12-26 06:15:44,314][123091] Updated weights for policy 0, policy_version 835767 (0.0006) [2023-12-26 06:15:44,367][123091] Updated weights for policy 0, policy_version 835777 (0.0005) [2023-12-26 06:15:44,422][123091] Updated weights for policy 0, policy_version 835787 (0.0007) [2023-12-26 06:15:45,134][123090] Updated weights for policy 1, policy_version 829926 (0.0008) [2023-12-26 06:15:45,173][123091] Updated weights for policy 0, policy_version 835797 (0.0009) [2023-12-26 06:15:45,198][123090] Updated weights for policy 1, policy_version 829936 (0.0009) [2023-12-26 06:15:45,237][123091] Updated weights for policy 0, policy_version 835807 (0.0011) [2023-12-26 06:15:45,265][123090] Updated weights for policy 1, policy_version 829946 (0.0009) [2023-12-26 06:15:45,297][123091] Updated weights for policy 0, policy_version 835817 (0.0011) [2023-12-26 06:15:46,003][123091] Updated weights for policy 0, policy_version 835827 (0.0009) [2023-12-26 06:15:46,075][123091] Updated weights for policy 0, policy_version 835837 (0.0005) [2023-12-26 06:15:46,125][123090] Updated weights for policy 1, policy_version 829956 (0.0005) [2023-12-26 06:15:46,139][123091] Updated weights for policy 0, policy_version 835847 (0.0006) [2023-12-26 06:15:46,184][123090] Updated weights for policy 1, policy_version 829966 (0.0005) [2023-12-26 06:15:46,262][123090] Updated weights for policy 1, policy_version 829976 (0.0005) [2023-12-26 06:15:46,738][123091] Updated weights for policy 0, policy_version 835857 (0.0005) [2023-12-26 06:15:46,796][123091] Updated weights for policy 0, policy_version 835867 (0.0006) [2023-12-26 06:15:46,852][123091] Updated weights for policy 0, policy_version 835877 (0.0006) [2023-12-26 06:15:46,922][123091] Updated weights for policy 0, policy_version 835887 (0.0005) [2023-12-26 06:15:47,020][123090] Updated weights for policy 1, policy_version 829986 (0.0007) [2023-12-26 06:15:47,082][123090] Updated weights for policy 1, policy_version 829996 (0.0010) [2023-12-26 06:15:47,158][123090] Updated weights for policy 1, policy_version 830006 (0.0009) [2023-12-26 06:15:47,225][123090] Updated weights for policy 1, policy_version 830016 (0.0009) [2023-12-26 06:15:47,604][123091] Updated weights for policy 0, policy_version 835897 (0.0006) [2023-12-26 06:15:47,665][123091] Updated weights for policy 0, policy_version 835907 (0.0008) [2023-12-26 06:15:47,722][123091] Updated weights for policy 0, policy_version 835917 (0.0009) [2023-12-26 06:15:47,979][123090] Updated weights for policy 1, policy_version 830026 (0.0009) [2023-12-26 06:15:48,039][123090] Updated weights for policy 1, policy_version 830036 (0.0009) [2023-12-26 06:15:48,091][123090] Updated weights for policy 1, policy_version 830046 (0.0009) [2023-12-26 06:15:48,534][123091] Updated weights for policy 0, policy_version 835927 (0.0007) [2023-12-26 06:15:48,602][123091] Updated weights for policy 0, policy_version 835937 (0.0009) [2023-12-26 06:15:48,665][123091] Updated weights for policy 0, policy_version 835947 (0.0010) [2023-12-26 06:15:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 426500096. Throughput: 0: 9116.1, 1: 8726.6. Samples: 426510912. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:48,785][121949] Avg episode reward: [(0, '6291.766'), (1, '5851.044')] [2023-12-26 06:15:48,808][123090] Updated weights for policy 1, policy_version 830056 (0.0006) [2023-12-26 06:15:48,875][123090] Updated weights for policy 1, policy_version 830066 (0.0006) [2023-12-26 06:15:48,938][123090] Updated weights for policy 1, policy_version 830076 (0.0005) [2023-12-26 06:15:49,501][123091] Updated weights for policy 0, policy_version 835957 (0.0008) [2023-12-26 06:15:49,559][123091] Updated weights for policy 0, policy_version 835967 (0.0009) [2023-12-26 06:15:49,613][123090] Updated weights for policy 1, policy_version 830086 (0.0006) [2023-12-26 06:15:49,616][123091] Updated weights for policy 0, policy_version 835977 (0.0011) [2023-12-26 06:15:49,668][123090] Updated weights for policy 1, policy_version 830096 (0.0006) [2023-12-26 06:15:49,739][123090] Updated weights for policy 1, policy_version 830106 (0.0006) [2023-12-26 06:15:50,408][123091] Updated weights for policy 0, policy_version 835987 (0.0011) [2023-12-26 06:15:50,433][123090] Updated weights for policy 1, policy_version 830116 (0.0006) [2023-12-26 06:15:50,467][123091] Updated weights for policy 0, policy_version 835997 (0.0011) [2023-12-26 06:15:50,491][123090] Updated weights for policy 1, policy_version 830126 (0.0006) [2023-12-26 06:15:50,521][123091] Updated weights for policy 0, policy_version 836007 (0.0011) [2023-12-26 06:15:50,543][123090] Updated weights for policy 1, policy_version 830136 (0.0006) [2023-12-26 06:15:51,323][123090] Updated weights for policy 1, policy_version 830146 (0.0008) [2023-12-26 06:15:51,390][123090] Updated weights for policy 1, policy_version 830156 (0.0012) [2023-12-26 06:15:51,437][123091] Updated weights for policy 0, policy_version 836017 (0.0010) [2023-12-26 06:15:51,462][123090] Updated weights for policy 1, policy_version 830166 (0.0011) [2023-12-26 06:15:51,503][123091] Updated weights for policy 0, policy_version 836027 (0.0008) [2023-12-26 06:15:51,533][123090] Updated weights for policy 1, policy_version 830176 (0.0011) [2023-12-26 06:15:51,568][123091] Updated weights for policy 0, policy_version 836037 (0.0009) [2023-12-26 06:15:51,638][123091] Updated weights for policy 0, policy_version 836047 (0.0009) [2023-12-26 06:15:52,309][123090] Updated weights for policy 1, policy_version 830186 (0.0008) [2023-12-26 06:15:52,377][123090] Updated weights for policy 1, policy_version 830196 (0.0011) [2023-12-26 06:15:52,441][123090] Updated weights for policy 1, policy_version 830206 (0.0011) [2023-12-26 06:15:52,524][123091] Updated weights for policy 0, policy_version 836057 (0.0009) [2023-12-26 06:15:52,585][123091] Updated weights for policy 0, policy_version 836067 (0.0009) [2023-12-26 06:15:52,645][123091] Updated weights for policy 0, policy_version 836077 (0.0009) [2023-12-26 06:15:53,265][123090] Updated weights for policy 1, policy_version 830216 (0.0010) [2023-12-26 06:15:53,316][123090] Updated weights for policy 1, policy_version 830226 (0.0010) [2023-12-26 06:15:53,328][123091] Updated weights for policy 0, policy_version 836087 (0.0006) [2023-12-26 06:15:53,368][123090] Updated weights for policy 1, policy_version 830236 (0.0010) [2023-12-26 06:15:53,374][123091] Updated weights for policy 0, policy_version 836097 (0.0005) [2023-12-26 06:15:53,420][123091] Updated weights for policy 0, policy_version 836107 (0.0005) [2023-12-26 06:15:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.6). Total num frames: 426590208. Throughput: 0: 9010.3, 1: 8787.2. Samples: 426564232. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 06:15:53,785][121949] Avg episode reward: [(0, '5964.899'), (1, '5824.788')] [2023-12-26 06:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000830240_212541440.pth... [2023-12-26 06:15:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000836112_214048768.pth... [2023-12-26 06:15:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000835056_213778432.pth [2023-12-26 06:15:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000829184_212271104.pth [2023-12-26 06:15:54,154][123091] Updated weights for policy 0, policy_version 836117 (0.0006) [2023-12-26 06:15:54,209][123090] Updated weights for policy 1, policy_version 830246 (0.0010) [2023-12-26 06:15:54,220][123091] Updated weights for policy 0, policy_version 836127 (0.0008) [2023-12-26 06:15:54,265][123090] Updated weights for policy 1, policy_version 830256 (0.0010) [2023-12-26 06:15:54,283][123091] Updated weights for policy 0, policy_version 836137 (0.0010) [2023-12-26 06:15:54,329][123090] Updated weights for policy 1, policy_version 830266 (0.0011) [2023-12-26 06:15:54,901][123091] Updated weights for policy 0, policy_version 836147 (0.0009) [2023-12-26 06:15:54,952][123091] Updated weights for policy 0, policy_version 836157 (0.0006) [2023-12-26 06:15:55,002][123091] Updated weights for policy 0, policy_version 836167 (0.0005) [2023-12-26 06:15:55,088][123090] Updated weights for policy 1, policy_version 830276 (0.0009) [2023-12-26 06:15:55,143][123090] Updated weights for policy 1, policy_version 830286 (0.0005) [2023-12-26 06:15:55,199][123090] Updated weights for policy 1, policy_version 830296 (0.0005) [2023-12-26 06:15:55,720][123091] Updated weights for policy 0, policy_version 836177 (0.0005) [2023-12-26 06:15:55,781][123091] Updated weights for policy 0, policy_version 836187 (0.0006) [2023-12-26 06:15:55,832][123091] Updated weights for policy 0, policy_version 836197 (0.0010) [2023-12-26 06:15:55,861][123090] Updated weights for policy 1, policy_version 830306 (0.0006) [2023-12-26 06:15:55,879][123091] Updated weights for policy 0, policy_version 836207 (0.0010) [2023-12-26 06:15:55,912][123090] Updated weights for policy 1, policy_version 830316 (0.0010) [2023-12-26 06:15:55,960][123090] Updated weights for policy 1, policy_version 830326 (0.0010) [2023-12-26 06:15:56,008][123090] Updated weights for policy 1, policy_version 830336 (0.0010) [2023-12-26 06:15:56,682][123091] Updated weights for policy 0, policy_version 836217 (0.0010) [2023-12-26 06:15:56,747][123091] Updated weights for policy 0, policy_version 836227 (0.0010) [2023-12-26 06:15:56,805][123091] Updated weights for policy 0, policy_version 836237 (0.0010) [2023-12-26 06:15:56,855][123090] Updated weights for policy 1, policy_version 830346 (0.0010) [2023-12-26 06:15:56,915][123090] Updated weights for policy 1, policy_version 830356 (0.0007) [2023-12-26 06:15:56,970][123090] Updated weights for policy 1, policy_version 830366 (0.0005) [2023-12-26 06:15:57,568][123091] Updated weights for policy 0, policy_version 836247 (0.0007) [2023-12-26 06:15:57,622][123091] Updated weights for policy 0, policy_version 836257 (0.0005) [2023-12-26 06:15:57,651][123090] Updated weights for policy 1, policy_version 830376 (0.0005) [2023-12-26 06:15:57,676][123091] Updated weights for policy 0, policy_version 836267 (0.0007) [2023-12-26 06:15:57,703][123090] Updated weights for policy 1, policy_version 830386 (0.0005) [2023-12-26 06:15:57,764][123090] Updated weights for policy 1, policy_version 830396 (0.0005) [2023-12-26 06:15:58,417][123091] Updated weights for policy 0, policy_version 836277 (0.0008) [2023-12-26 06:15:58,494][123091] Updated weights for policy 0, policy_version 836288 (0.0008) [2023-12-26 06:15:58,566][123090] Updated weights for policy 1, policy_version 830406 (0.0008) [2023-12-26 06:15:58,569][123091] Updated weights for policy 0, policy_version 836298 (0.0008) [2023-12-26 06:15:58,638][123090] Updated weights for policy 1, policy_version 830416 (0.0010) [2023-12-26 06:15:58,712][123090] Updated weights for policy 1, policy_version 830426 (0.0010) [2023-12-26 06:15:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 426688512. Throughput: 0: 9092.5, 1: 8894.7. Samples: 426676544. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:15:58,785][121949] Avg episode reward: [(0, '5783.180'), (1, '5813.202')] [2023-12-26 06:15:59,407][123091] Updated weights for policy 0, policy_version 836308 (0.0008) [2023-12-26 06:15:59,458][123091] Updated weights for policy 0, policy_version 836318 (0.0008) [2023-12-26 06:15:59,510][123091] Updated weights for policy 0, policy_version 836328 (0.0008) [2023-12-26 06:15:59,532][123090] Updated weights for policy 1, policy_version 830436 (0.0009) [2023-12-26 06:15:59,588][123090] Updated weights for policy 1, policy_version 830446 (0.0007) [2023-12-26 06:15:59,651][123090] Updated weights for policy 1, policy_version 830456 (0.0009) [2023-12-26 06:16:00,377][123091] Updated weights for policy 0, policy_version 836338 (0.0008) [2023-12-26 06:16:00,424][123091] Updated weights for policy 0, policy_version 836348 (0.0008) [2023-12-26 06:16:00,475][123091] Updated weights for policy 0, policy_version 836358 (0.0008) [2023-12-26 06:16:00,495][123090] Updated weights for policy 1, policy_version 830466 (0.0009) [2023-12-26 06:16:00,531][123091] Updated weights for policy 0, policy_version 836368 (0.0008) [2023-12-26 06:16:00,549][123090] Updated weights for policy 1, policy_version 830476 (0.0008) [2023-12-26 06:16:00,604][123090] Updated weights for policy 1, policy_version 830486 (0.0010) [2023-12-26 06:16:00,658][123090] Updated weights for policy 1, policy_version 830496 (0.0009) [2023-12-26 06:16:01,388][123091] Updated weights for policy 0, policy_version 836378 (0.0009) [2023-12-26 06:16:01,441][123091] Updated weights for policy 0, policy_version 836388 (0.0010) [2023-12-26 06:16:01,495][123091] Updated weights for policy 0, policy_version 836398 (0.0008) [2023-12-26 06:16:01,527][123090] Updated weights for policy 1, policy_version 830506 (0.0008) [2023-12-26 06:16:01,592][123090] Updated weights for policy 1, policy_version 830516 (0.0010) [2023-12-26 06:16:01,662][123090] Updated weights for policy 1, policy_version 830526 (0.0010) [2023-12-26 06:16:02,322][123091] Updated weights for policy 0, policy_version 836408 (0.0010) [2023-12-26 06:16:02,396][123091] Updated weights for policy 0, policy_version 836418 (0.0009) [2023-12-26 06:16:02,460][123091] Updated weights for policy 0, policy_version 836428 (0.0009) [2023-12-26 06:16:02,505][123090] Updated weights for policy 1, policy_version 830536 (0.0009) [2023-12-26 06:16:02,568][123090] Updated weights for policy 1, policy_version 830546 (0.0009) [2023-12-26 06:16:02,632][123090] Updated weights for policy 1, policy_version 830556 (0.0010) [2023-12-26 06:16:03,335][123091] Updated weights for policy 0, policy_version 836438 (0.0008) [2023-12-26 06:16:03,370][123090] Updated weights for policy 1, policy_version 830566 (0.0010) [2023-12-26 06:16:03,381][123091] Updated weights for policy 0, policy_version 836448 (0.0009) [2023-12-26 06:16:03,422][123090] Updated weights for policy 1, policy_version 830576 (0.0010) [2023-12-26 06:16:03,425][123091] Updated weights for policy 0, policy_version 836458 (0.0007) [2023-12-26 06:16:03,473][123090] Updated weights for policy 1, policy_version 830586 (0.0010) [2023-12-26 06:16:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 426770432. Throughput: 0: 8938.9, 1: 8919.2. Samples: 426779360. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:03,785][121949] Avg episode reward: [(0, '6050.331'), (1, '5848.044')] [2023-12-26 06:16:04,312][123091] Updated weights for policy 0, policy_version 836468 (0.0008) [2023-12-26 06:16:04,360][123090] Updated weights for policy 1, policy_version 830596 (0.0011) [2023-12-26 06:16:04,371][123091] Updated weights for policy 0, policy_version 836478 (0.0007) [2023-12-26 06:16:04,424][123091] Updated weights for policy 0, policy_version 836488 (0.0008) [2023-12-26 06:16:04,428][123090] Updated weights for policy 1, policy_version 830606 (0.0011) [2023-12-26 06:16:04,489][123090] Updated weights for policy 1, policy_version 830616 (0.0011) [2023-12-26 06:16:05,196][123090] Updated weights for policy 1, policy_version 830626 (0.0009) [2023-12-26 06:16:05,204][123091] Updated weights for policy 0, policy_version 836498 (0.0010) [2023-12-26 06:16:05,250][123090] Updated weights for policy 1, policy_version 830636 (0.0005) [2023-12-26 06:16:05,256][123091] Updated weights for policy 0, policy_version 836508 (0.0011) [2023-12-26 06:16:05,302][123090] Updated weights for policy 1, policy_version 830646 (0.0006) [2023-12-26 06:16:05,314][123091] Updated weights for policy 0, policy_version 836518 (0.0010) [2023-12-26 06:16:05,357][123090] Updated weights for policy 1, policy_version 830656 (0.0007) [2023-12-26 06:16:05,367][123091] Updated weights for policy 0, policy_version 836528 (0.0010) [2023-12-26 06:16:06,182][123090] Updated weights for policy 1, policy_version 830666 (0.0009) [2023-12-26 06:16:06,210][123091] Updated weights for policy 0, policy_version 836538 (0.0011) [2023-12-26 06:16:06,243][123090] Updated weights for policy 1, policy_version 830676 (0.0007) [2023-12-26 06:16:06,271][123091] Updated weights for policy 0, policy_version 836548 (0.0011) [2023-12-26 06:16:06,301][123090] Updated weights for policy 1, policy_version 830686 (0.0008) [2023-12-26 06:16:06,332][123091] Updated weights for policy 0, policy_version 836558 (0.0011) [2023-12-26 06:16:07,150][123090] Updated weights for policy 1, policy_version 830696 (0.0008) [2023-12-26 06:16:07,185][123091] Updated weights for policy 0, policy_version 836568 (0.0011) [2023-12-26 06:16:07,200][123090] Updated weights for policy 1, policy_version 830706 (0.0008) [2023-12-26 06:16:07,241][123091] Updated weights for policy 0, policy_version 836578 (0.0011) [2023-12-26 06:16:07,261][123090] Updated weights for policy 1, policy_version 830716 (0.0006) [2023-12-26 06:16:07,305][123091] Updated weights for policy 0, policy_version 836588 (0.0011) [2023-12-26 06:16:08,151][123090] Updated weights for policy 1, policy_version 830726 (0.0008) [2023-12-26 06:16:08,164][123091] Updated weights for policy 0, policy_version 836598 (0.0011) [2023-12-26 06:16:08,212][123090] Updated weights for policy 1, policy_version 830736 (0.0010) [2023-12-26 06:16:08,227][123091] Updated weights for policy 0, policy_version 836608 (0.0011) [2023-12-26 06:16:08,277][123090] Updated weights for policy 1, policy_version 830746 (0.0007) [2023-12-26 06:16:08,290][123091] Updated weights for policy 0, policy_version 836618 (0.0011) [2023-12-26 06:16:08,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 426852352. Throughput: 0: 8932.9, 1: 8941.6. Samples: 426831252. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:08,785][121949] Avg episode reward: [(0, '6119.112'), (1, '5786.854')] [2023-12-26 06:16:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000836624_214179840.pth... [2023-12-26 06:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000830752_212672512.pth... [2023-12-26 06:16:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000835600_213917696.pth [2023-12-26 06:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000829728_212410368.pth [2023-12-26 06:16:09,102][123091] Updated weights for policy 0, policy_version 836628 (0.0011) [2023-12-26 06:16:09,109][123090] Updated weights for policy 1, policy_version 830756 (0.0009) [2023-12-26 06:16:09,170][123091] Updated weights for policy 0, policy_version 836638 (0.0011) [2023-12-26 06:16:09,177][123090] Updated weights for policy 1, policy_version 830766 (0.0008) [2023-12-26 06:16:09,233][123091] Updated weights for policy 0, policy_version 836648 (0.0011) [2023-12-26 06:16:09,244][123090] Updated weights for policy 1, policy_version 830776 (0.0009) [2023-12-26 06:16:10,091][123090] Updated weights for policy 1, policy_version 830786 (0.0009) [2023-12-26 06:16:10,140][123091] Updated weights for policy 0, policy_version 836658 (0.0010) [2023-12-26 06:16:10,154][123090] Updated weights for policy 1, policy_version 830796 (0.0008) [2023-12-26 06:16:10,200][123091] Updated weights for policy 0, policy_version 836668 (0.0007) [2023-12-26 06:16:10,214][123090] Updated weights for policy 1, policy_version 830806 (0.0010) [2023-12-26 06:16:10,262][123091] Updated weights for policy 0, policy_version 836678 (0.0006) [2023-12-26 06:16:10,271][123090] Updated weights for policy 1, policy_version 830816 (0.0007) [2023-12-26 06:16:10,331][123091] Updated weights for policy 0, policy_version 836688 (0.0007) [2023-12-26 06:16:11,089][123091] Updated weights for policy 0, policy_version 836698 (0.0008) [2023-12-26 06:16:11,159][123091] Updated weights for policy 0, policy_version 836708 (0.0009) [2023-12-26 06:16:11,191][123090] Updated weights for policy 1, policy_version 830826 (0.0009) [2023-12-26 06:16:11,228][123091] Updated weights for policy 0, policy_version 836718 (0.0009) [2023-12-26 06:16:11,256][123090] Updated weights for policy 1, policy_version 830836 (0.0008) [2023-12-26 06:16:11,330][123090] Updated weights for policy 1, policy_version 830846 (0.0010) [2023-12-26 06:16:12,114][123091] Updated weights for policy 0, policy_version 836728 (0.0007) [2023-12-26 06:16:12,186][123091] Updated weights for policy 0, policy_version 836738 (0.0006) [2023-12-26 06:16:12,189][123090] Updated weights for policy 1, policy_version 830856 (0.0009) [2023-12-26 06:16:12,255][123090] Updated weights for policy 1, policy_version 830866 (0.0008) [2023-12-26 06:16:12,259][123091] Updated weights for policy 0, policy_version 836748 (0.0007) [2023-12-26 06:16:12,330][123090] Updated weights for policy 1, policy_version 830876 (0.0009) [2023-12-26 06:16:13,092][123091] Updated weights for policy 0, policy_version 836758 (0.0009) [2023-12-26 06:16:13,154][123091] Updated weights for policy 0, policy_version 836768 (0.0009) [2023-12-26 06:16:13,176][123090] Updated weights for policy 1, policy_version 830886 (0.0008) [2023-12-26 06:16:13,215][123091] Updated weights for policy 0, policy_version 836778 (0.0009) [2023-12-26 06:16:13,247][123090] Updated weights for policy 1, policy_version 830896 (0.0006) [2023-12-26 06:16:13,312][123090] Updated weights for policy 1, policy_version 830906 (0.0006) [2023-12-26 06:16:13,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 426934272. Throughput: 0: 8888.5, 1: 8768.2. Samples: 426930048. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:13,785][121949] Avg episode reward: [(0, '6217.736'), (1, '5867.962')] [2023-12-26 06:16:13,954][123091] Updated weights for policy 0, policy_version 836788 (0.0008) [2023-12-26 06:16:13,969][123090] Updated weights for policy 1, policy_version 830916 (0.0006) [2023-12-26 06:16:14,011][123091] Updated weights for policy 0, policy_version 836798 (0.0006) [2023-12-26 06:16:14,037][123090] Updated weights for policy 1, policy_version 830926 (0.0006) [2023-12-26 06:16:14,075][123091] Updated weights for policy 0, policy_version 836808 (0.0008) [2023-12-26 06:16:14,100][123090] Updated weights for policy 1, policy_version 830936 (0.0010) [2023-12-26 06:16:14,885][123091] Updated weights for policy 0, policy_version 836818 (0.0011) [2023-12-26 06:16:14,887][123090] Updated weights for policy 1, policy_version 830946 (0.0008) [2023-12-26 06:16:14,949][123091] Updated weights for policy 0, policy_version 836828 (0.0008) [2023-12-26 06:16:14,959][123090] Updated weights for policy 1, policy_version 830956 (0.0009) [2023-12-26 06:16:15,017][123091] Updated weights for policy 0, policy_version 836838 (0.0008) [2023-12-26 06:16:15,022][123090] Updated weights for policy 1, policy_version 830966 (0.0009) [2023-12-26 06:16:15,089][123091] Updated weights for policy 0, policy_version 836848 (0.0007) [2023-12-26 06:16:15,091][123090] Updated weights for policy 1, policy_version 830976 (0.0008) [2023-12-26 06:16:15,852][123091] Updated weights for policy 0, policy_version 836858 (0.0010) [2023-12-26 06:16:15,908][123091] Updated weights for policy 0, policy_version 836868 (0.0008) [2023-12-26 06:16:15,954][123090] Updated weights for policy 1, policy_version 830986 (0.0008) [2023-12-26 06:16:15,957][123091] Updated weights for policy 0, policy_version 836878 (0.0010) [2023-12-26 06:16:16,008][123090] Updated weights for policy 1, policy_version 830996 (0.0010) [2023-12-26 06:16:16,062][123090] Updated weights for policy 1, policy_version 831006 (0.0010) [2023-12-26 06:16:16,821][123091] Updated weights for policy 0, policy_version 836888 (0.0009) [2023-12-26 06:16:16,872][123091] Updated weights for policy 0, policy_version 836899 (0.0010) [2023-12-26 06:16:16,873][123090] Updated weights for policy 1, policy_version 831016 (0.0006) [2023-12-26 06:16:16,917][123091] Updated weights for policy 0, policy_version 836909 (0.0006) [2023-12-26 06:16:16,927][123090] Updated weights for policy 1, policy_version 831026 (0.0005) [2023-12-26 06:16:17,006][123090] Updated weights for policy 1, policy_version 831036 (0.0008) [2023-12-26 06:16:17,758][123091] Updated weights for policy 0, policy_version 836919 (0.0008) [2023-12-26 06:16:17,804][123090] Updated weights for policy 1, policy_version 831046 (0.0009) [2023-12-26 06:16:17,815][123091] Updated weights for policy 0, policy_version 836929 (0.0009) [2023-12-26 06:16:17,865][123090] Updated weights for policy 1, policy_version 831056 (0.0007) [2023-12-26 06:16:17,879][123091] Updated weights for policy 0, policy_version 836939 (0.0009) [2023-12-26 06:16:17,919][123090] Updated weights for policy 1, policy_version 831066 (0.0007) [2023-12-26 06:16:18,626][123090] Updated weights for policy 1, policy_version 831076 (0.0006) [2023-12-26 06:16:18,684][123090] Updated weights for policy 1, policy_version 831086 (0.0005) [2023-12-26 06:16:18,752][123090] Updated weights for policy 1, policy_version 831096 (0.0009) [2023-12-26 06:16:18,772][123091] Updated weights for policy 0, policy_version 836949 (0.0010) [2023-12-26 06:16:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 427016192. Throughput: 0: 8832.9, 1: 8764.9. Samples: 427035260. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:18,784][121949] Avg episode reward: [(0, '6248.536'), (1, '5729.431')] [2023-12-26 06:16:18,838][123091] Updated weights for policy 0, policy_version 836959 (0.0008) [2023-12-26 06:16:18,906][123091] Updated weights for policy 0, policy_version 836969 (0.0010) [2023-12-26 06:16:19,509][123090] Updated weights for policy 1, policy_version 831106 (0.0009) [2023-12-26 06:16:19,574][123090] Updated weights for policy 1, policy_version 831116 (0.0008) [2023-12-26 06:16:19,628][123090] Updated weights for policy 1, policy_version 831126 (0.0009) [2023-12-26 06:16:19,685][123090] Updated weights for policy 1, policy_version 831136 (0.0009) [2023-12-26 06:16:19,738][123091] Updated weights for policy 0, policy_version 836979 (0.0009) [2023-12-26 06:16:19,797][123091] Updated weights for policy 0, policy_version 836989 (0.0010) [2023-12-26 06:16:19,867][123091] Updated weights for policy 0, policy_version 836999 (0.0008) [2023-12-26 06:16:20,491][123090] Updated weights for policy 1, policy_version 831146 (0.0005) [2023-12-26 06:16:20,550][123090] Updated weights for policy 1, policy_version 831156 (0.0005) [2023-12-26 06:16:20,619][123090] Updated weights for policy 1, policy_version 831166 (0.0009) [2023-12-26 06:16:20,757][123091] Updated weights for policy 0, policy_version 837009 (0.0009) [2023-12-26 06:16:20,823][123091] Updated weights for policy 0, policy_version 837019 (0.0009) [2023-12-26 06:16:20,893][123091] Updated weights for policy 0, policy_version 837029 (0.0006) [2023-12-26 06:16:20,953][123091] Updated weights for policy 0, policy_version 837039 (0.0009) [2023-12-26 06:16:21,382][123090] Updated weights for policy 1, policy_version 831176 (0.0009) [2023-12-26 06:16:21,449][123090] Updated weights for policy 1, policy_version 831186 (0.0008) [2023-12-26 06:16:21,511][123090] Updated weights for policy 1, policy_version 831196 (0.0008) [2023-12-26 06:16:21,767][123091] Updated weights for policy 0, policy_version 837049 (0.0010) [2023-12-26 06:16:21,817][123091] Updated weights for policy 0, policy_version 837059 (0.0009) [2023-12-26 06:16:21,870][123091] Updated weights for policy 0, policy_version 837069 (0.0010) [2023-12-26 06:16:22,336][123090] Updated weights for policy 1, policy_version 831206 (0.0009) [2023-12-26 06:16:22,408][123090] Updated weights for policy 1, policy_version 831216 (0.0009) [2023-12-26 06:16:22,488][123090] Updated weights for policy 1, policy_version 831226 (0.0010) [2023-12-26 06:16:22,759][123091] Updated weights for policy 0, policy_version 837079 (0.0010) [2023-12-26 06:16:22,825][123091] Updated weights for policy 0, policy_version 837089 (0.0009) [2023-12-26 06:16:22,882][123091] Updated weights for policy 0, policy_version 837099 (0.0010) [2023-12-26 06:16:23,213][123090] Updated weights for policy 1, policy_version 831236 (0.0010) [2023-12-26 06:16:23,265][123090] Updated weights for policy 1, policy_version 831246 (0.0009) [2023-12-26 06:16:23,323][123090] Updated weights for policy 1, policy_version 831256 (0.0009) [2023-12-26 06:16:23,750][123091] Updated weights for policy 0, policy_version 837109 (0.0010) [2023-12-26 06:16:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 427106304. Throughput: 0: 8758.3, 1: 8757.7. Samples: 427086960. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:23,785][121949] Avg episode reward: [(0, '6287.218'), (1, '5646.013')] [2023-12-26 06:16:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000831264_212803584.pth... [2023-12-26 06:16:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000830240_212541440.pth [2023-12-26 06:16:23,802][123091] Updated weights for policy 0, policy_version 837119 (0.0009) [2023-12-26 06:16:23,854][123091] Updated weights for policy 0, policy_version 837129 (0.0009) [2023-12-26 06:16:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000837136_214310912.pth... [2023-12-26 06:16:23,908][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000836112_214048768.pth [2023-12-26 06:16:24,093][123090] Updated weights for policy 1, policy_version 831266 (0.0009) [2023-12-26 06:16:24,151][123090] Updated weights for policy 1, policy_version 831276 (0.0009) [2023-12-26 06:16:24,216][123090] Updated weights for policy 1, policy_version 831286 (0.0008) [2023-12-26 06:16:24,280][123090] Updated weights for policy 1, policy_version 831296 (0.0007) [2023-12-26 06:16:24,761][123091] Updated weights for policy 0, policy_version 837139 (0.0009) [2023-12-26 06:16:24,835][123091] Updated weights for policy 0, policy_version 837149 (0.0007) [2023-12-26 06:16:24,907][123091] Updated weights for policy 0, policy_version 837159 (0.0005) [2023-12-26 06:16:25,046][123090] Updated weights for policy 1, policy_version 831306 (0.0010) [2023-12-26 06:16:25,104][123090] Updated weights for policy 1, policy_version 831316 (0.0009) [2023-12-26 06:16:25,153][123090] Updated weights for policy 1, policy_version 831326 (0.0010) [2023-12-26 06:16:25,506][123091] Updated weights for policy 0, policy_version 837169 (0.0006) [2023-12-26 06:16:25,567][123091] Updated weights for policy 0, policy_version 837179 (0.0010) [2023-12-26 06:16:25,626][123091] Updated weights for policy 0, policy_version 837189 (0.0010) [2023-12-26 06:16:25,676][123091] Updated weights for policy 0, policy_version 837199 (0.0010) [2023-12-26 06:16:26,038][123090] Updated weights for policy 1, policy_version 831336 (0.0009) [2023-12-26 06:16:26,097][123090] Updated weights for policy 1, policy_version 831347 (0.0010) [2023-12-26 06:16:26,155][123090] Updated weights for policy 1, policy_version 831357 (0.0009) [2023-12-26 06:16:26,426][123091] Updated weights for policy 0, policy_version 837209 (0.0010) [2023-12-26 06:16:26,487][123091] Updated weights for policy 0, policy_version 837219 (0.0010) [2023-12-26 06:16:26,545][123091] Updated weights for policy 0, policy_version 837229 (0.0010) [2023-12-26 06:16:26,995][123090] Updated weights for policy 1, policy_version 831368 (0.0007) [2023-12-26 06:16:27,049][123090] Updated weights for policy 1, policy_version 831378 (0.0010) [2023-12-26 06:16:27,116][123090] Updated weights for policy 1, policy_version 831388 (0.0010) [2023-12-26 06:16:27,339][123091] Updated weights for policy 0, policy_version 837239 (0.0010) [2023-12-26 06:16:27,393][123091] Updated weights for policy 0, policy_version 837249 (0.0010) [2023-12-26 06:16:27,443][123091] Updated weights for policy 0, policy_version 837259 (0.0010) [2023-12-26 06:16:27,918][123090] Updated weights for policy 1, policy_version 831398 (0.0009) [2023-12-26 06:16:27,974][123090] Updated weights for policy 1, policy_version 831408 (0.0007) [2023-12-26 06:16:28,044][123090] Updated weights for policy 1, policy_version 831418 (0.0006) [2023-12-26 06:16:28,189][123091] Updated weights for policy 0, policy_version 837269 (0.0007) [2023-12-26 06:16:28,243][123091] Updated weights for policy 0, policy_version 837279 (0.0006) [2023-12-26 06:16:28,298][123091] Updated weights for policy 0, policy_version 837289 (0.0009) [2023-12-26 06:16:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 427196416. Throughput: 0: 8762.1, 1: 8814.2. Samples: 427192100. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:28,784][121949] Avg episode reward: [(0, '6132.506'), (1, '5691.314')] [2023-12-26 06:16:28,847][123090] Updated weights for policy 1, policy_version 831428 (0.0009) [2023-12-26 06:16:28,902][123090] Updated weights for policy 1, policy_version 831438 (0.0010) [2023-12-26 06:16:28,971][123090] Updated weights for policy 1, policy_version 831448 (0.0008) [2023-12-26 06:16:29,114][123091] Updated weights for policy 0, policy_version 837299 (0.0008) [2023-12-26 06:16:29,178][123091] Updated weights for policy 0, policy_version 837309 (0.0005) [2023-12-26 06:16:29,245][123091] Updated weights for policy 0, policy_version 837319 (0.0008) [2023-12-26 06:16:29,677][123090] Updated weights for policy 1, policy_version 831458 (0.0005) [2023-12-26 06:16:29,746][123090] Updated weights for policy 1, policy_version 831468 (0.0006) [2023-12-26 06:16:29,825][123090] Updated weights for policy 1, policy_version 831478 (0.0006) [2023-12-26 06:16:29,892][123090] Updated weights for policy 1, policy_version 831488 (0.0010) [2023-12-26 06:16:30,069][123091] Updated weights for policy 0, policy_version 837329 (0.0009) [2023-12-26 06:16:30,134][123091] Updated weights for policy 0, policy_version 837339 (0.0008) [2023-12-26 06:16:30,189][123091] Updated weights for policy 0, policy_version 837349 (0.0010) [2023-12-26 06:16:30,245][123091] Updated weights for policy 0, policy_version 837359 (0.0010) [2023-12-26 06:16:30,678][123090] Updated weights for policy 1, policy_version 831498 (0.0009) [2023-12-26 06:16:30,739][123090] Updated weights for policy 1, policy_version 831508 (0.0009) [2023-12-26 06:16:30,812][123090] Updated weights for policy 1, policy_version 831518 (0.0009) [2023-12-26 06:16:31,088][123091] Updated weights for policy 0, policy_version 837369 (0.0009) [2023-12-26 06:16:31,157][123091] Updated weights for policy 0, policy_version 837379 (0.0011) [2023-12-26 06:16:31,216][123091] Updated weights for policy 0, policy_version 837389 (0.0010) [2023-12-26 06:16:31,657][123090] Updated weights for policy 1, policy_version 831528 (0.0010) [2023-12-26 06:16:31,732][123090] Updated weights for policy 1, policy_version 831538 (0.0010) [2023-12-26 06:16:31,785][123090] Updated weights for policy 1, policy_version 831548 (0.0010) [2023-12-26 06:16:32,018][123091] Updated weights for policy 0, policy_version 837399 (0.0007) [2023-12-26 06:16:32,068][123091] Updated weights for policy 0, policy_version 837409 (0.0005) [2023-12-26 06:16:32,122][123091] Updated weights for policy 0, policy_version 837419 (0.0005) [2023-12-26 06:16:32,589][123090] Updated weights for policy 1, policy_version 831558 (0.0010) [2023-12-26 06:16:32,640][123090] Updated weights for policy 1, policy_version 831568 (0.0010) [2023-12-26 06:16:32,683][123090] Updated weights for policy 1, policy_version 831578 (0.0010) [2023-12-26 06:16:32,757][123091] Updated weights for policy 0, policy_version 837429 (0.0005) [2023-12-26 06:16:32,818][123091] Updated weights for policy 0, policy_version 837439 (0.0009) [2023-12-26 06:16:32,866][123091] Updated weights for policy 0, policy_version 837449 (0.0008) [2023-12-26 06:16:33,526][123090] Updated weights for policy 1, policy_version 831588 (0.0010) [2023-12-26 06:16:33,545][123091] Updated weights for policy 0, policy_version 837459 (0.0005) [2023-12-26 06:16:33,580][123090] Updated weights for policy 1, policy_version 831598 (0.0010) [2023-12-26 06:16:33,595][123091] Updated weights for policy 0, policy_version 837469 (0.0007) [2023-12-26 06:16:33,642][123091] Updated weights for policy 0, policy_version 837479 (0.0007) [2023-12-26 06:16:33,646][123090] Updated weights for policy 1, policy_version 831608 (0.0010) [2023-12-26 06:16:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 427294720. Throughput: 0: 8731.1, 1: 8808.5. Samples: 427300192. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:33,784][121949] Avg episode reward: [(0, '6181.066'), (1, '5740.326')] [2023-12-26 06:16:34,379][123091] Updated weights for policy 0, policy_version 837489 (0.0007) [2023-12-26 06:16:34,448][123091] Updated weights for policy 0, policy_version 837499 (0.0010) [2023-12-26 06:16:34,472][123090] Updated weights for policy 1, policy_version 831618 (0.0010) [2023-12-26 06:16:34,516][123091] Updated weights for policy 0, policy_version 837509 (0.0009) [2023-12-26 06:16:34,533][123090] Updated weights for policy 1, policy_version 831628 (0.0011) [2023-12-26 06:16:34,589][123091] Updated weights for policy 0, policy_version 837519 (0.0008) [2023-12-26 06:16:34,594][123090] Updated weights for policy 1, policy_version 831638 (0.0011) [2023-12-26 06:16:34,652][123090] Updated weights for policy 1, policy_version 831648 (0.0011) [2023-12-26 06:16:35,366][123091] Updated weights for policy 0, policy_version 837529 (0.0006) [2023-12-26 06:16:35,430][123091] Updated weights for policy 0, policy_version 837540 (0.0006) [2023-12-26 06:16:35,483][123090] Updated weights for policy 1, policy_version 831658 (0.0010) [2023-12-26 06:16:35,499][123091] Updated weights for policy 0, policy_version 837550 (0.0005) [2023-12-26 06:16:35,530][123090] Updated weights for policy 1, policy_version 831668 (0.0010) [2023-12-26 06:16:35,581][123090] Updated weights for policy 1, policy_version 831678 (0.0010) [2023-12-26 06:16:36,174][123091] Updated weights for policy 0, policy_version 837560 (0.0010) [2023-12-26 06:16:36,244][123091] Updated weights for policy 0, policy_version 837570 (0.0011) [2023-12-26 06:16:36,316][123091] Updated weights for policy 0, policy_version 837580 (0.0011) [2023-12-26 06:16:36,356][123090] Updated weights for policy 1, policy_version 831688 (0.0007) [2023-12-26 06:16:36,431][123090] Updated weights for policy 1, policy_version 831698 (0.0005) [2023-12-26 06:16:36,501][123090] Updated weights for policy 1, policy_version 831708 (0.0006) [2023-12-26 06:16:37,108][123091] Updated weights for policy 0, policy_version 837590 (0.0010) [2023-12-26 06:16:37,160][123091] Updated weights for policy 0, policy_version 837600 (0.0010) [2023-12-26 06:16:37,174][123090] Updated weights for policy 1, policy_version 831718 (0.0005) [2023-12-26 06:16:37,215][123091] Updated weights for policy 0, policy_version 837610 (0.0009) [2023-12-26 06:16:37,227][123090] Updated weights for policy 1, policy_version 831728 (0.0005) [2023-12-26 06:16:37,290][123090] Updated weights for policy 1, policy_version 831738 (0.0005) [2023-12-26 06:16:37,940][123090] Updated weights for policy 1, policy_version 831748 (0.0006) [2023-12-26 06:16:37,999][123090] Updated weights for policy 1, policy_version 831758 (0.0006) [2023-12-26 06:16:38,012][123091] Updated weights for policy 0, policy_version 837620 (0.0008) [2023-12-26 06:16:38,048][123090] Updated weights for policy 1, policy_version 831768 (0.0009) [2023-12-26 06:16:38,060][123091] Updated weights for policy 0, policy_version 837630 (0.0006) [2023-12-26 06:16:38,108][123091] Updated weights for policy 0, policy_version 837640 (0.0005) [2023-12-26 06:16:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 427376640. Throughput: 0: 8804.5, 1: 8776.4. Samples: 427355376. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:38,785][121949] Avg episode reward: [(0, '6421.480'), (1, '5938.739')] [2023-12-26 06:16:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000831776_212934656.pth... [2023-12-26 06:16:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000830752_212672512.pth [2023-12-26 06:16:38,816][123091] Updated weights for policy 0, policy_version 837650 (0.0006) [2023-12-26 06:16:38,883][123091] Updated weights for policy 0, policy_version 837660 (0.0010) [2023-12-26 06:16:38,913][123090] Updated weights for policy 1, policy_version 831778 (0.0008) [2023-12-26 06:16:38,945][123091] Updated weights for policy 0, policy_version 837670 (0.0010) [2023-12-26 06:16:38,969][123090] Updated weights for policy 1, policy_version 831788 (0.0005) [2023-12-26 06:16:38,997][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000837680_214450176.pth... [2023-12-26 06:16:38,998][123091] Updated weights for policy 0, policy_version 837680 (0.0009) [2023-12-26 06:16:39,000][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000836624_214179840.pth [2023-12-26 06:16:39,027][123090] Updated weights for policy 1, policy_version 831798 (0.0007) [2023-12-26 06:16:39,098][123090] Updated weights for policy 1, policy_version 831808 (0.0010) [2023-12-26 06:16:39,934][123091] Updated weights for policy 0, policy_version 837690 (0.0009) [2023-12-26 06:16:39,953][123090] Updated weights for policy 1, policy_version 831818 (0.0009) [2023-12-26 06:16:39,996][123091] Updated weights for policy 0, policy_version 837700 (0.0009) [2023-12-26 06:16:40,011][123090] Updated weights for policy 1, policy_version 831828 (0.0009) [2023-12-26 06:16:40,062][123091] Updated weights for policy 0, policy_version 837710 (0.0009) [2023-12-26 06:16:40,077][123090] Updated weights for policy 1, policy_version 831838 (0.0009) [2023-12-26 06:16:40,954][123091] Updated weights for policy 0, policy_version 837720 (0.0010) [2023-12-26 06:16:40,962][123090] Updated weights for policy 1, policy_version 831848 (0.0008) [2023-12-26 06:16:41,011][123091] Updated weights for policy 0, policy_version 837730 (0.0011) [2023-12-26 06:16:41,023][123090] Updated weights for policy 1, policy_version 831858 (0.0008) [2023-12-26 06:16:41,080][123091] Updated weights for policy 0, policy_version 837740 (0.0011) [2023-12-26 06:16:41,088][123090] Updated weights for policy 1, policy_version 831868 (0.0007) [2023-12-26 06:16:41,938][123091] Updated weights for policy 0, policy_version 837750 (0.0009) [2023-12-26 06:16:41,957][123090] Updated weights for policy 1, policy_version 831878 (0.0010) [2023-12-26 06:16:42,007][123091] Updated weights for policy 0, policy_version 837760 (0.0006) [2023-12-26 06:16:42,021][123090] Updated weights for policy 1, policy_version 831888 (0.0009) [2023-12-26 06:16:42,076][123091] Updated weights for policy 0, policy_version 837770 (0.0006) [2023-12-26 06:16:42,088][123090] Updated weights for policy 1, policy_version 831898 (0.0008) [2023-12-26 06:16:42,746][123091] Updated weights for policy 0, policy_version 837780 (0.0007) [2023-12-26 06:16:42,814][123091] Updated weights for policy 0, policy_version 837790 (0.0009) [2023-12-26 06:16:42,879][123091] Updated weights for policy 0, policy_version 837800 (0.0010) [2023-12-26 06:16:42,895][123090] Updated weights for policy 1, policy_version 831908 (0.0007) [2023-12-26 06:16:42,957][123090] Updated weights for policy 1, policy_version 831918 (0.0009) [2023-12-26 06:16:43,006][123090] Updated weights for policy 1, policy_version 831928 (0.0010) [2023-12-26 06:16:43,683][123091] Updated weights for policy 0, policy_version 837810 (0.0008) [2023-12-26 06:16:43,734][123091] Updated weights for policy 0, policy_version 837820 (0.0009) [2023-12-26 06:16:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 427458560. Throughput: 0: 8702.5, 1: 8696.3. Samples: 427459488. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:43,784][121949] Avg episode reward: [(0, '6302.373'), (1, '5927.530')] [2023-12-26 06:16:43,793][123091] Updated weights for policy 0, policy_version 837830 (0.0009) [2023-12-26 06:16:43,837][123090] Updated weights for policy 1, policy_version 831938 (0.0010) [2023-12-26 06:16:43,849][123091] Updated weights for policy 0, policy_version 837840 (0.0008) [2023-12-26 06:16:43,888][123090] Updated weights for policy 1, policy_version 831948 (0.0010) [2023-12-26 06:16:43,958][123090] Updated weights for policy 1, policy_version 831958 (0.0010) [2023-12-26 06:16:44,031][123090] Updated weights for policy 1, policy_version 831968 (0.0010) [2023-12-26 06:16:44,704][123091] Updated weights for policy 0, policy_version 837850 (0.0009) [2023-12-26 06:16:44,766][123091] Updated weights for policy 0, policy_version 837860 (0.0009) [2023-12-26 06:16:44,840][123091] Updated weights for policy 0, policy_version 837870 (0.0007) [2023-12-26 06:16:44,851][123090] Updated weights for policy 1, policy_version 831978 (0.0009) [2023-12-26 06:16:44,908][123090] Updated weights for policy 1, policy_version 831988 (0.0011) [2023-12-26 06:16:44,965][123090] Updated weights for policy 1, policy_version 831998 (0.0011) [2023-12-26 06:16:45,664][123091] Updated weights for policy 0, policy_version 837880 (0.0009) [2023-12-26 06:16:45,724][123091] Updated weights for policy 0, policy_version 837890 (0.0009) [2023-12-26 06:16:45,784][123091] Updated weights for policy 0, policy_version 837900 (0.0007) [2023-12-26 06:16:45,794][123090] Updated weights for policy 1, policy_version 832008 (0.0010) [2023-12-26 06:16:45,845][123090] Updated weights for policy 1, policy_version 832018 (0.0010) [2023-12-26 06:16:45,892][123090] Updated weights for policy 1, policy_version 832028 (0.0010) [2023-12-26 06:16:46,508][123091] Updated weights for policy 0, policy_version 837910 (0.0006) [2023-12-26 06:16:46,585][123091] Updated weights for policy 0, policy_version 837920 (0.0005) [2023-12-26 06:16:46,646][123091] Updated weights for policy 0, policy_version 837930 (0.0006) [2023-12-26 06:16:46,683][123090] Updated weights for policy 1, policy_version 832038 (0.0010) [2023-12-26 06:16:46,745][123090] Updated weights for policy 1, policy_version 832048 (0.0010) [2023-12-26 06:16:46,800][123090] Updated weights for policy 1, policy_version 832058 (0.0009) [2023-12-26 06:16:47,378][123091] Updated weights for policy 0, policy_version 837940 (0.0007) [2023-12-26 06:16:47,438][123091] Updated weights for policy 0, policy_version 837950 (0.0006) [2023-12-26 06:16:47,492][123090] Updated weights for policy 1, policy_version 832068 (0.0008) [2023-12-26 06:16:47,496][123091] Updated weights for policy 0, policy_version 837960 (0.0005) [2023-12-26 06:16:47,541][123090] Updated weights for policy 1, policy_version 832078 (0.0005) [2023-12-26 06:16:47,588][123090] Updated weights for policy 1, policy_version 832088 (0.0006) [2023-12-26 06:16:48,294][123091] Updated weights for policy 0, policy_version 837970 (0.0006) [2023-12-26 06:16:48,371][123090] Updated weights for policy 1, policy_version 832098 (0.0008) [2023-12-26 06:16:48,372][123091] Updated weights for policy 0, policy_version 837980 (0.0009) [2023-12-26 06:16:48,429][123091] Updated weights for policy 0, policy_version 837990 (0.0008) [2023-12-26 06:16:48,437][123090] Updated weights for policy 1, policy_version 832108 (0.0008) [2023-12-26 06:16:48,486][123091] Updated weights for policy 0, policy_version 838000 (0.0008) [2023-12-26 06:16:48,493][123090] Updated weights for policy 1, policy_version 832118 (0.0009) [2023-12-26 06:16:48,564][123090] Updated weights for policy 1, policy_version 832128 (0.0010) [2023-12-26 06:16:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 427556864. Throughput: 0: 8757.0, 1: 8723.8. Samples: 427565996. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:48,785][121949] Avg episode reward: [(0, '6312.941'), (1, '5784.274')] [2023-12-26 06:16:49,279][123091] Updated weights for policy 0, policy_version 838010 (0.0009) [2023-12-26 06:16:49,346][123091] Updated weights for policy 0, policy_version 838020 (0.0008) [2023-12-26 06:16:49,412][123090] Updated weights for policy 1, policy_version 832138 (0.0009) [2023-12-26 06:16:49,414][123091] Updated weights for policy 0, policy_version 838030 (0.0008) [2023-12-26 06:16:49,469][123090] Updated weights for policy 1, policy_version 832148 (0.0009) [2023-12-26 06:16:49,522][123090] Updated weights for policy 1, policy_version 832158 (0.0009) [2023-12-26 06:16:50,263][123091] Updated weights for policy 0, policy_version 838040 (0.0009) [2023-12-26 06:16:50,279][123090] Updated weights for policy 1, policy_version 832168 (0.0006) [2023-12-26 06:16:50,317][123091] Updated weights for policy 0, policy_version 838050 (0.0009) [2023-12-26 06:16:50,348][123090] Updated weights for policy 1, policy_version 832178 (0.0005) [2023-12-26 06:16:50,377][123091] Updated weights for policy 0, policy_version 838060 (0.0009) [2023-12-26 06:16:50,412][123090] Updated weights for policy 1, policy_version 832188 (0.0007) [2023-12-26 06:16:51,068][123090] Updated weights for policy 1, policy_version 832198 (0.0007) [2023-12-26 06:16:51,138][123090] Updated weights for policy 1, policy_version 832208 (0.0009) [2023-12-26 06:16:51,209][123090] Updated weights for policy 1, policy_version 832218 (0.0009) [2023-12-26 06:16:51,292][123091] Updated weights for policy 0, policy_version 838070 (0.0007) [2023-12-26 06:16:51,353][123091] Updated weights for policy 0, policy_version 838080 (0.0006) [2023-12-26 06:16:51,426][123091] Updated weights for policy 0, policy_version 838090 (0.0008) [2023-12-26 06:16:52,005][123090] Updated weights for policy 1, policy_version 832228 (0.0008) [2023-12-26 06:16:52,066][123090] Updated weights for policy 1, policy_version 832238 (0.0005) [2023-12-26 06:16:52,137][123090] Updated weights for policy 1, policy_version 832248 (0.0005) [2023-12-26 06:16:52,264][123091] Updated weights for policy 0, policy_version 838100 (0.0007) [2023-12-26 06:16:52,326][123091] Updated weights for policy 0, policy_version 838110 (0.0008) [2023-12-26 06:16:52,401][123091] Updated weights for policy 0, policy_version 838120 (0.0008) [2023-12-26 06:16:52,885][123090] Updated weights for policy 1, policy_version 832258 (0.0009) [2023-12-26 06:16:52,956][123090] Updated weights for policy 1, policy_version 832268 (0.0005) [2023-12-26 06:16:53,024][123090] Updated weights for policy 1, policy_version 832278 (0.0006) [2023-12-26 06:16:53,077][123090] Updated weights for policy 1, policy_version 832288 (0.0005) [2023-12-26 06:16:53,214][123091] Updated weights for policy 0, policy_version 838130 (0.0008) [2023-12-26 06:16:53,267][123091] Updated weights for policy 0, policy_version 838140 (0.0009) [2023-12-26 06:16:53,330][123091] Updated weights for policy 0, policy_version 838150 (0.0005) [2023-12-26 06:16:53,397][123091] Updated weights for policy 0, policy_version 838160 (0.0006) [2023-12-26 06:16:53,761][123090] Updated weights for policy 1, policy_version 832298 (0.0005) [2023-12-26 06:16:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 427638784. Throughput: 0: 8740.7, 1: 8741.8. Samples: 427617964. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:53,785][121949] Avg episode reward: [(0, '6354.266'), (1, '5777.962')] [2023-12-26 06:16:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000838160_214573056.pth... [2023-12-26 06:16:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000837136_214310912.pth [2023-12-26 06:16:53,830][123090] Updated weights for policy 1, policy_version 832308 (0.0005) [2023-12-26 06:16:53,902][123090] Updated weights for policy 1, policy_version 832318 (0.0005) [2023-12-26 06:16:53,918][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000832320_213073920.pth... [2023-12-26 06:16:53,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000831264_212803584.pth [2023-12-26 06:16:54,009][123091] Updated weights for policy 0, policy_version 838170 (0.0005) [2023-12-26 06:16:54,083][123091] Updated weights for policy 0, policy_version 838180 (0.0005) [2023-12-26 06:16:54,147][123091] Updated weights for policy 0, policy_version 838190 (0.0006) [2023-12-26 06:16:54,601][123090] Updated weights for policy 1, policy_version 832328 (0.0006) [2023-12-26 06:16:54,663][123090] Updated weights for policy 1, policy_version 832338 (0.0007) [2023-12-26 06:16:54,725][123090] Updated weights for policy 1, policy_version 832348 (0.0006) [2023-12-26 06:16:54,986][123091] Updated weights for policy 0, policy_version 838200 (0.0009) [2023-12-26 06:16:55,052][123091] Updated weights for policy 0, policy_version 838210 (0.0008) [2023-12-26 06:16:55,118][123091] Updated weights for policy 0, policy_version 838220 (0.0006) [2023-12-26 06:16:55,481][123090] Updated weights for policy 1, policy_version 832358 (0.0008) [2023-12-26 06:16:55,535][123090] Updated weights for policy 1, policy_version 832368 (0.0010) [2023-12-26 06:16:55,590][123090] Updated weights for policy 1, policy_version 832378 (0.0010) [2023-12-26 06:16:55,824][123091] Updated weights for policy 0, policy_version 838230 (0.0007) [2023-12-26 06:16:55,873][123091] Updated weights for policy 0, policy_version 838240 (0.0009) [2023-12-26 06:16:55,929][123091] Updated weights for policy 0, policy_version 838250 (0.0009) [2023-12-26 06:16:56,437][123090] Updated weights for policy 1, policy_version 832388 (0.0010) [2023-12-26 06:16:56,496][123090] Updated weights for policy 1, policy_version 832398 (0.0010) [2023-12-26 06:16:56,554][123090] Updated weights for policy 1, policy_version 832408 (0.0010) [2023-12-26 06:16:56,635][123091] Updated weights for policy 0, policy_version 838260 (0.0009) [2023-12-26 06:16:56,682][123091] Updated weights for policy 0, policy_version 838270 (0.0008) [2023-12-26 06:16:56,729][123091] Updated weights for policy 0, policy_version 838280 (0.0005) [2023-12-26 06:16:57,324][123090] Updated weights for policy 1, policy_version 832418 (0.0009) [2023-12-26 06:16:57,388][123090] Updated weights for policy 1, policy_version 832428 (0.0005) [2023-12-26 06:16:57,461][123090] Updated weights for policy 1, policy_version 832438 (0.0005) [2023-12-26 06:16:57,511][123091] Updated weights for policy 0, policy_version 838290 (0.0006) [2023-12-26 06:16:57,534][123090] Updated weights for policy 1, policy_version 832448 (0.0005) [2023-12-26 06:16:57,578][123091] Updated weights for policy 0, policy_version 838300 (0.0006) [2023-12-26 06:16:57,633][123091] Updated weights for policy 0, policy_version 838310 (0.0006) [2023-12-26 06:16:57,708][123091] Updated weights for policy 0, policy_version 838320 (0.0005) [2023-12-26 06:16:58,167][123090] Updated weights for policy 1, policy_version 832458 (0.0011) [2023-12-26 06:16:58,233][123090] Updated weights for policy 1, policy_version 832468 (0.0010) [2023-12-26 06:16:58,295][123090] Updated weights for policy 1, policy_version 832478 (0.0011) [2023-12-26 06:16:58,427][123091] Updated weights for policy 0, policy_version 838330 (0.0011) [2023-12-26 06:16:58,500][123091] Updated weights for policy 0, policy_version 838340 (0.0010) [2023-12-26 06:16:58,568][123091] Updated weights for policy 0, policy_version 838350 (0.0011) [2023-12-26 06:16:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 427737088. Throughput: 0: 8855.1, 1: 8906.0. Samples: 427729296. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:16:58,785][121949] Avg episode reward: [(0, '6331.944'), (1, '5777.839')] [2023-12-26 06:16:59,240][123090] Updated weights for policy 1, policy_version 832488 (0.0011) [2023-12-26 06:16:59,297][123090] Updated weights for policy 1, policy_version 832498 (0.0008) [2023-12-26 06:16:59,363][123090] Updated weights for policy 1, policy_version 832508 (0.0007) [2023-12-26 06:16:59,446][123091] Updated weights for policy 0, policy_version 838360 (0.0009) [2023-12-26 06:16:59,502][123091] Updated weights for policy 0, policy_version 838370 (0.0008) [2023-12-26 06:16:59,563][123091] Updated weights for policy 0, policy_version 838380 (0.0009) [2023-12-26 06:17:00,105][123090] Updated weights for policy 1, policy_version 832518 (0.0008) [2023-12-26 06:17:00,167][123090] Updated weights for policy 1, policy_version 832528 (0.0005) [2023-12-26 06:17:00,231][123090] Updated weights for policy 1, policy_version 832538 (0.0005) [2023-12-26 06:17:00,496][123091] Updated weights for policy 0, policy_version 838390 (0.0011) [2023-12-26 06:17:00,551][123091] Updated weights for policy 0, policy_version 838400 (0.0010) [2023-12-26 06:17:00,608][123091] Updated weights for policy 0, policy_version 838410 (0.0008) [2023-12-26 06:17:00,898][123090] Updated weights for policy 1, policy_version 832548 (0.0005) [2023-12-26 06:17:00,948][123090] Updated weights for policy 1, policy_version 832558 (0.0005) [2023-12-26 06:17:00,996][123090] Updated weights for policy 1, policy_version 832568 (0.0005) [2023-12-26 06:17:01,519][123091] Updated weights for policy 0, policy_version 838421 (0.0011) [2023-12-26 06:17:01,575][123091] Updated weights for policy 0, policy_version 838431 (0.0011) [2023-12-26 06:17:01,635][123091] Updated weights for policy 0, policy_version 838441 (0.0013) [2023-12-26 06:17:01,819][123090] Updated weights for policy 1, policy_version 832578 (0.0008) [2023-12-26 06:17:01,887][123090] Updated weights for policy 1, policy_version 832588 (0.0011) [2023-12-26 06:17:01,940][123090] Updated weights for policy 1, policy_version 832598 (0.0011) [2023-12-26 06:17:02,012][123090] Updated weights for policy 1, policy_version 832608 (0.0011) [2023-12-26 06:17:02,438][123091] Updated weights for policy 0, policy_version 838451 (0.0009) [2023-12-26 06:17:02,500][123091] Updated weights for policy 0, policy_version 838461 (0.0010) [2023-12-26 06:17:02,561][123091] Updated weights for policy 0, policy_version 838471 (0.0010) [2023-12-26 06:17:02,828][123090] Updated weights for policy 1, policy_version 832618 (0.0009) [2023-12-26 06:17:02,897][123090] Updated weights for policy 1, policy_version 832628 (0.0009) [2023-12-26 06:17:02,968][123090] Updated weights for policy 1, policy_version 832638 (0.0009) [2023-12-26 06:17:03,389][123091] Updated weights for policy 0, policy_version 838481 (0.0010) [2023-12-26 06:17:03,449][123091] Updated weights for policy 0, policy_version 838491 (0.0009) [2023-12-26 06:17:03,505][123091] Updated weights for policy 0, policy_version 838501 (0.0009) [2023-12-26 06:17:03,557][123091] Updated weights for policy 0, policy_version 838511 (0.0009) [2023-12-26 06:17:03,755][123090] Updated weights for policy 1, policy_version 832648 (0.0009) [2023-12-26 06:17:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 427819008. Throughput: 0: 8813.5, 1: 8912.2. Samples: 427832924. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:03,785][121949] Avg episode reward: [(0, '6086.085'), (1, '5830.156')] [2023-12-26 06:17:03,803][123090] Updated weights for policy 1, policy_version 832658 (0.0010) [2023-12-26 06:17:03,870][123090] Updated weights for policy 1, policy_version 832668 (0.0010) [2023-12-26 06:17:04,314][123091] Updated weights for policy 0, policy_version 838521 (0.0010) [2023-12-26 06:17:04,362][123091] Updated weights for policy 0, policy_version 838531 (0.0011) [2023-12-26 06:17:04,433][123091] Updated weights for policy 0, policy_version 838541 (0.0011) [2023-12-26 06:17:04,766][123090] Updated weights for policy 1, policy_version 832678 (0.0011) [2023-12-26 06:17:04,826][123090] Updated weights for policy 1, policy_version 832688 (0.0011) [2023-12-26 06:17:04,886][123090] Updated weights for policy 1, policy_version 832698 (0.0010) [2023-12-26 06:17:05,217][123091] Updated weights for policy 0, policy_version 838551 (0.0010) [2023-12-26 06:17:05,276][123091] Updated weights for policy 0, policy_version 838561 (0.0010) [2023-12-26 06:17:05,330][123091] Updated weights for policy 0, policy_version 838571 (0.0010) [2023-12-26 06:17:05,536][123090] Updated weights for policy 1, policy_version 832708 (0.0008) [2023-12-26 06:17:05,595][123090] Updated weights for policy 1, policy_version 832718 (0.0005) [2023-12-26 06:17:05,652][123090] Updated weights for policy 1, policy_version 832728 (0.0005) [2023-12-26 06:17:06,303][123091] Updated weights for policy 0, policy_version 838581 (0.0010) [2023-12-26 06:17:06,340][123090] Updated weights for policy 1, policy_version 832738 (0.0006) [2023-12-26 06:17:06,370][123091] Updated weights for policy 0, policy_version 838591 (0.0008) [2023-12-26 06:17:06,403][123090] Updated weights for policy 1, policy_version 832748 (0.0008) [2023-12-26 06:17:06,426][123091] Updated weights for policy 0, policy_version 838601 (0.0007) [2023-12-26 06:17:06,462][123090] Updated weights for policy 1, policy_version 832758 (0.0007) [2023-12-26 06:17:06,526][123090] Updated weights for policy 1, policy_version 832768 (0.0007) [2023-12-26 06:17:07,279][123091] Updated weights for policy 0, policy_version 838611 (0.0006) [2023-12-26 06:17:07,305][123090] Updated weights for policy 1, policy_version 832778 (0.0009) [2023-12-26 06:17:07,330][123091] Updated weights for policy 0, policy_version 838621 (0.0008) [2023-12-26 06:17:07,365][123090] Updated weights for policy 1, policy_version 832788 (0.0009) [2023-12-26 06:17:07,381][123091] Updated weights for policy 0, policy_version 838631 (0.0007) [2023-12-26 06:17:07,420][123090] Updated weights for policy 1, policy_version 832798 (0.0007) [2023-12-26 06:17:08,117][123091] Updated weights for policy 0, policy_version 838641 (0.0011) [2023-12-26 06:17:08,174][123091] Updated weights for policy 0, policy_version 838651 (0.0009) [2023-12-26 06:17:08,227][123091] Updated weights for policy 0, policy_version 838661 (0.0009) [2023-12-26 06:17:08,283][123091] Updated weights for policy 0, policy_version 838671 (0.0009) [2023-12-26 06:17:08,292][123090] Updated weights for policy 1, policy_version 832808 (0.0008) [2023-12-26 06:17:08,359][123090] Updated weights for policy 1, policy_version 832818 (0.0010) [2023-12-26 06:17:08,418][123090] Updated weights for policy 1, policy_version 832828 (0.0010) [2023-12-26 06:17:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 427909120. Throughput: 0: 8820.9, 1: 8933.2. Samples: 427885892. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:08,785][121949] Avg episode reward: [(0, '6115.928'), (1, '5884.315')] [2023-12-26 06:17:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000838672_214704128.pth... [2023-12-26 06:17:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000832832_213204992.pth... [2023-12-26 06:17:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000831776_212934656.pth [2023-12-26 06:17:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000837680_214450176.pth [2023-12-26 06:17:09,146][123091] Updated weights for policy 0, policy_version 838681 (0.0009) [2023-12-26 06:17:09,161][123090] Updated weights for policy 1, policy_version 832838 (0.0010) [2023-12-26 06:17:09,207][123091] Updated weights for policy 0, policy_version 838691 (0.0008) [2023-12-26 06:17:09,223][123090] Updated weights for policy 1, policy_version 832848 (0.0008) [2023-12-26 06:17:09,276][123091] Updated weights for policy 0, policy_version 838701 (0.0008) [2023-12-26 06:17:09,284][123090] Updated weights for policy 1, policy_version 832858 (0.0007) [2023-12-26 06:17:10,084][123091] Updated weights for policy 0, policy_version 838711 (0.0008) [2023-12-26 06:17:10,154][123091] Updated weights for policy 0, policy_version 838721 (0.0008) [2023-12-26 06:17:10,208][123090] Updated weights for policy 1, policy_version 832868 (0.0009) [2023-12-26 06:17:10,218][123091] Updated weights for policy 0, policy_version 838731 (0.0008) [2023-12-26 06:17:10,267][123090] Updated weights for policy 1, policy_version 832878 (0.0007) [2023-12-26 06:17:10,318][123090] Updated weights for policy 1, policy_version 832888 (0.0009) [2023-12-26 06:17:11,012][123091] Updated weights for policy 0, policy_version 838741 (0.0009) [2023-12-26 06:17:11,087][123091] Updated weights for policy 0, policy_version 838751 (0.0010) [2023-12-26 06:17:11,164][123091] Updated weights for policy 0, policy_version 838761 (0.0010) [2023-12-26 06:17:11,200][123090] Updated weights for policy 1, policy_version 832898 (0.0009) [2023-12-26 06:17:11,266][123090] Updated weights for policy 1, policy_version 832908 (0.0007) [2023-12-26 06:17:11,338][123090] Updated weights for policy 1, policy_version 832918 (0.0009) [2023-12-26 06:17:11,409][123090] Updated weights for policy 1, policy_version 832928 (0.0009) [2023-12-26 06:17:11,977][123091] Updated weights for policy 0, policy_version 838771 (0.0009) [2023-12-26 06:17:12,029][123091] Updated weights for policy 0, policy_version 838781 (0.0008) [2023-12-26 06:17:12,085][123091] Updated weights for policy 0, policy_version 838791 (0.0008) [2023-12-26 06:17:12,190][123090] Updated weights for policy 1, policy_version 832938 (0.0007) [2023-12-26 06:17:12,241][123090] Updated weights for policy 1, policy_version 832948 (0.0005) [2023-12-26 06:17:12,311][123090] Updated weights for policy 1, policy_version 832958 (0.0007) [2023-12-26 06:17:12,944][123091] Updated weights for policy 0, policy_version 838801 (0.0008) [2023-12-26 06:17:12,968][123090] Updated weights for policy 1, policy_version 832968 (0.0005) [2023-12-26 06:17:12,996][123091] Updated weights for policy 0, policy_version 838811 (0.0010) [2023-12-26 06:17:13,035][123090] Updated weights for policy 1, policy_version 832978 (0.0005) [2023-12-26 06:17:13,044][123091] Updated weights for policy 0, policy_version 838821 (0.0010) [2023-12-26 06:17:13,088][123091] Updated weights for policy 0, policy_version 838831 (0.0010) [2023-12-26 06:17:13,112][123090] Updated weights for policy 1, policy_version 832988 (0.0005) [2023-12-26 06:17:13,703][123090] Updated weights for policy 1, policy_version 832998 (0.0005) [2023-12-26 06:17:13,759][123090] Updated weights for policy 1, policy_version 833008 (0.0005) [2023-12-26 06:17:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 427991040. Throughput: 0: 8802.1, 1: 8896.8. Samples: 427988552. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:13,785][121949] Avg episode reward: [(0, '6125.041'), (1, '5939.060')] [2023-12-26 06:17:13,817][123090] Updated weights for policy 1, policy_version 833018 (0.0006) [2023-12-26 06:17:13,896][123091] Updated weights for policy 0, policy_version 838841 (0.0008) [2023-12-26 06:17:13,944][123091] Updated weights for policy 0, policy_version 838851 (0.0007) [2023-12-26 06:17:13,994][123091] Updated weights for policy 0, policy_version 838861 (0.0005) [2023-12-26 06:17:14,643][123090] Updated weights for policy 1, policy_version 833028 (0.0007) [2023-12-26 06:17:14,715][123090] Updated weights for policy 1, policy_version 833038 (0.0008) [2023-12-26 06:17:14,773][123091] Updated weights for policy 0, policy_version 838871 (0.0007) [2023-12-26 06:17:14,778][123090] Updated weights for policy 1, policy_version 833048 (0.0008) [2023-12-26 06:17:14,830][123091] Updated weights for policy 0, policy_version 838881 (0.0009) [2023-12-26 06:17:14,888][123091] Updated weights for policy 0, policy_version 838891 (0.0009) [2023-12-26 06:17:15,448][123090] Updated weights for policy 1, policy_version 833058 (0.0009) [2023-12-26 06:17:15,517][123090] Updated weights for policy 1, policy_version 833068 (0.0009) [2023-12-26 06:17:15,596][123090] Updated weights for policy 1, policy_version 833078 (0.0006) [2023-12-26 06:17:15,677][123090] Updated weights for policy 1, policy_version 833088 (0.0005) [2023-12-26 06:17:15,701][123091] Updated weights for policy 0, policy_version 838901 (0.0008) [2023-12-26 06:17:15,753][123091] Updated weights for policy 0, policy_version 838911 (0.0005) [2023-12-26 06:17:15,798][123091] Updated weights for policy 0, policy_version 838921 (0.0005) [2023-12-26 06:17:16,412][123090] Updated weights for policy 1, policy_version 833098 (0.0006) [2023-12-26 06:17:16,472][123090] Updated weights for policy 1, policy_version 833108 (0.0008) [2023-12-26 06:17:16,490][123091] Updated weights for policy 0, policy_version 838931 (0.0005) [2023-12-26 06:17:16,533][123090] Updated weights for policy 1, policy_version 833118 (0.0010) [2023-12-26 06:17:16,549][123091] Updated weights for policy 0, policy_version 838941 (0.0006) [2023-12-26 06:17:16,602][123091] Updated weights for policy 0, policy_version 838951 (0.0005) [2023-12-26 06:17:17,291][123090] Updated weights for policy 1, policy_version 833128 (0.0010) [2023-12-26 06:17:17,304][123091] Updated weights for policy 0, policy_version 838961 (0.0005) [2023-12-26 06:17:17,343][123090] Updated weights for policy 1, policy_version 833138 (0.0010) [2023-12-26 06:17:17,366][123091] Updated weights for policy 0, policy_version 838971 (0.0005) [2023-12-26 06:17:17,409][123090] Updated weights for policy 1, policy_version 833148 (0.0008) [2023-12-26 06:17:17,436][123091] Updated weights for policy 0, policy_version 838981 (0.0005) [2023-12-26 06:17:17,496][123091] Updated weights for policy 0, policy_version 838991 (0.0011) [2023-12-26 06:17:18,091][123091] Updated weights for policy 0, policy_version 839001 (0.0011) [2023-12-26 06:17:18,152][123091] Updated weights for policy 0, policy_version 839011 (0.0009) [2023-12-26 06:17:18,162][123090] Updated weights for policy 1, policy_version 833158 (0.0009) [2023-12-26 06:17:18,205][123091] Updated weights for policy 0, policy_version 839021 (0.0008) [2023-12-26 06:17:18,214][123090] Updated weights for policy 1, policy_version 833168 (0.0010) [2023-12-26 06:17:18,273][123090] Updated weights for policy 1, policy_version 833178 (0.0010) [2023-12-26 06:17:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 428089344. Throughput: 0: 8824.9, 1: 8982.8. Samples: 428101540. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:18,785][121949] Avg episode reward: [(0, '5817.640'), (1, '5874.683')] [2023-12-26 06:17:19,011][123091] Updated weights for policy 0, policy_version 839031 (0.0010) [2023-12-26 06:17:19,067][123091] Updated weights for policy 0, policy_version 839041 (0.0011) [2023-12-26 06:17:19,086][123090] Updated weights for policy 1, policy_version 833188 (0.0008) [2023-12-26 06:17:19,126][123091] Updated weights for policy 0, policy_version 839051 (0.0011) [2023-12-26 06:17:19,156][123090] Updated weights for policy 1, policy_version 833198 (0.0005) [2023-12-26 06:17:19,229][123090] Updated weights for policy 1, policy_version 833208 (0.0006) [2023-12-26 06:17:19,990][123091] Updated weights for policy 0, policy_version 839061 (0.0011) [2023-12-26 06:17:20,042][123090] Updated weights for policy 1, policy_version 833218 (0.0008) [2023-12-26 06:17:20,063][123091] Updated weights for policy 0, policy_version 839071 (0.0011) [2023-12-26 06:17:20,103][123090] Updated weights for policy 1, policy_version 833228 (0.0006) [2023-12-26 06:17:20,130][123091] Updated weights for policy 0, policy_version 839081 (0.0011) [2023-12-26 06:17:20,153][123090] Updated weights for policy 1, policy_version 833238 (0.0008) [2023-12-26 06:17:20,206][123090] Updated weights for policy 1, policy_version 833248 (0.0007) [2023-12-26 06:17:20,970][123090] Updated weights for policy 1, policy_version 833258 (0.0009) [2023-12-26 06:17:20,988][123091] Updated weights for policy 0, policy_version 839091 (0.0011) [2023-12-26 06:17:21,030][123090] Updated weights for policy 1, policy_version 833268 (0.0008) [2023-12-26 06:17:21,070][123091] Updated weights for policy 0, policy_version 839101 (0.0011) [2023-12-26 06:17:21,103][123090] Updated weights for policy 1, policy_version 833278 (0.0006) [2023-12-26 06:17:21,127][123091] Updated weights for policy 0, policy_version 839111 (0.0011) [2023-12-26 06:17:21,945][123090] Updated weights for policy 1, policy_version 833288 (0.0009) [2023-12-26 06:17:22,000][123090] Updated weights for policy 1, policy_version 833299 (0.0010) [2023-12-26 06:17:22,009][123091] Updated weights for policy 0, policy_version 839121 (0.0010) [2023-12-26 06:17:22,052][123090] Updated weights for policy 1, policy_version 833309 (0.0010) [2023-12-26 06:17:22,072][123091] Updated weights for policy 0, policy_version 839131 (0.0009) [2023-12-26 06:17:22,137][123091] Updated weights for policy 0, policy_version 839141 (0.0009) [2023-12-26 06:17:22,198][123091] Updated weights for policy 0, policy_version 839151 (0.0010) [2023-12-26 06:17:22,946][123090] Updated weights for policy 1, policy_version 833319 (0.0008) [2023-12-26 06:17:23,003][123090] Updated weights for policy 1, policy_version 833329 (0.0006) [2023-12-26 06:17:23,014][123091] Updated weights for policy 0, policy_version 839161 (0.0009) [2023-12-26 06:17:23,068][123090] Updated weights for policy 1, policy_version 833339 (0.0007) [2023-12-26 06:17:23,078][123091] Updated weights for policy 0, policy_version 839171 (0.0007) [2023-12-26 06:17:23,129][123091] Updated weights for policy 0, policy_version 839181 (0.0005) [2023-12-26 06:17:23,736][123090] Updated weights for policy 1, policy_version 833349 (0.0007) [2023-12-26 06:17:23,777][123091] Updated weights for policy 0, policy_version 839191 (0.0005) [2023-12-26 06:17:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 428171264. Throughput: 0: 8749.8, 1: 8977.0. Samples: 428153080. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:23,785][121949] Avg episode reward: [(0, '5965.635'), (1, '5858.000')] [2023-12-26 06:17:23,791][123090] Updated weights for policy 1, policy_version 833359 (0.0005) [2023-12-26 06:17:23,834][123091] Updated weights for policy 0, policy_version 839201 (0.0005) [2023-12-26 06:17:23,839][123090] Updated weights for policy 1, policy_version 833369 (0.0005) [2023-12-26 06:17:23,880][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000833376_213344256.pth... [2023-12-26 06:17:23,885][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000832320_213073920.pth [2023-12-26 06:17:23,889][123091] Updated weights for policy 0, policy_version 839211 (0.0006) [2023-12-26 06:17:23,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000839216_214843392.pth... [2023-12-26 06:17:23,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000838160_214573056.pth [2023-12-26 06:17:24,472][123090] Updated weights for policy 1, policy_version 833379 (0.0007) [2023-12-26 06:17:24,528][123090] Updated weights for policy 1, policy_version 833389 (0.0007) [2023-12-26 06:17:24,588][123090] Updated weights for policy 1, policy_version 833399 (0.0009) [2023-12-26 06:17:24,738][123091] Updated weights for policy 0, policy_version 839221 (0.0009) [2023-12-26 06:17:24,804][123091] Updated weights for policy 0, policy_version 839231 (0.0010) [2023-12-26 06:17:24,868][123091] Updated weights for policy 0, policy_version 839241 (0.0010) [2023-12-26 06:17:25,304][123090] Updated weights for policy 1, policy_version 833409 (0.0008) [2023-12-26 06:17:25,354][123090] Updated weights for policy 1, policy_version 833419 (0.0005) [2023-12-26 06:17:25,403][123090] Updated weights for policy 1, policy_version 833429 (0.0005) [2023-12-26 06:17:25,454][123090] Updated weights for policy 1, policy_version 833439 (0.0006) [2023-12-26 06:17:25,769][123091] Updated weights for policy 0, policy_version 839251 (0.0010) [2023-12-26 06:17:25,820][123091] Updated weights for policy 0, policy_version 839261 (0.0010) [2023-12-26 06:17:25,874][123091] Updated weights for policy 0, policy_version 839271 (0.0009) [2023-12-26 06:17:26,160][123090] Updated weights for policy 1, policy_version 833449 (0.0009) [2023-12-26 06:17:26,211][123090] Updated weights for policy 1, policy_version 833459 (0.0009) [2023-12-26 06:17:26,265][123090] Updated weights for policy 1, policy_version 833469 (0.0009) [2023-12-26 06:17:26,805][123091] Updated weights for policy 0, policy_version 839283 (0.0010) [2023-12-26 06:17:26,861][123091] Updated weights for policy 0, policy_version 839293 (0.0010) [2023-12-26 06:17:26,921][123091] Updated weights for policy 0, policy_version 839305 (0.0011) [2023-12-26 06:17:26,989][123090] Updated weights for policy 1, policy_version 833479 (0.0009) [2023-12-26 06:17:27,059][123090] Updated weights for policy 1, policy_version 833489 (0.0009) [2023-12-26 06:17:27,126][123090] Updated weights for policy 1, policy_version 833499 (0.0009) [2023-12-26 06:17:27,782][123091] Updated weights for policy 0, policy_version 839315 (0.0008) [2023-12-26 06:17:27,852][123091] Updated weights for policy 0, policy_version 839325 (0.0005) [2023-12-26 06:17:27,902][123090] Updated weights for policy 1, policy_version 833509 (0.0010) [2023-12-26 06:17:27,923][123091] Updated weights for policy 0, policy_version 839335 (0.0005) [2023-12-26 06:17:27,961][123090] Updated weights for policy 1, policy_version 833519 (0.0008) [2023-12-26 06:17:28,019][123090] Updated weights for policy 1, policy_version 833529 (0.0010) [2023-12-26 06:17:28,491][123091] Updated weights for policy 0, policy_version 839345 (0.0006) [2023-12-26 06:17:28,540][123091] Updated weights for policy 0, policy_version 839355 (0.0005) [2023-12-26 06:17:28,605][123091] Updated weights for policy 0, policy_version 839365 (0.0006) [2023-12-26 06:17:28,674][123091] Updated weights for policy 0, policy_version 839375 (0.0005) [2023-12-26 06:17:28,756][123090] Updated weights for policy 1, policy_version 833539 (0.0009) [2023-12-26 06:17:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 428269568. Throughput: 0: 8725.8, 1: 9096.9. Samples: 428261516. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:28,785][121949] Avg episode reward: [(0, '6155.939'), (1, '5858.388')] [2023-12-26 06:17:28,822][123090] Updated weights for policy 1, policy_version 833549 (0.0011) [2023-12-26 06:17:28,893][123090] Updated weights for policy 1, policy_version 833559 (0.0010) [2023-12-26 06:17:29,330][123091] Updated weights for policy 0, policy_version 839385 (0.0009) [2023-12-26 06:17:29,391][123091] Updated weights for policy 0, policy_version 839395 (0.0010) [2023-12-26 06:17:29,447][123091] Updated weights for policy 0, policy_version 839405 (0.0009) [2023-12-26 06:17:29,679][123090] Updated weights for policy 1, policy_version 833569 (0.0011) [2023-12-26 06:17:29,738][123090] Updated weights for policy 1, policy_version 833579 (0.0010) [2023-12-26 06:17:29,795][123090] Updated weights for policy 1, policy_version 833590 (0.0010) [2023-12-26 06:17:29,860][123090] Updated weights for policy 1, policy_version 833600 (0.0009) [2023-12-26 06:17:30,277][123091] Updated weights for policy 0, policy_version 839415 (0.0009) [2023-12-26 06:17:30,332][123091] Updated weights for policy 0, policy_version 839425 (0.0009) [2023-12-26 06:17:30,397][123091] Updated weights for policy 0, policy_version 839435 (0.0006) [2023-12-26 06:17:30,723][123090] Updated weights for policy 1, policy_version 833610 (0.0009) [2023-12-26 06:17:30,793][123090] Updated weights for policy 1, policy_version 833620 (0.0010) [2023-12-26 06:17:30,855][123090] Updated weights for policy 1, policy_version 833630 (0.0010) [2023-12-26 06:17:31,116][123091] Updated weights for policy 0, policy_version 839445 (0.0008) [2023-12-26 06:17:31,173][123091] Updated weights for policy 0, policy_version 839455 (0.0009) [2023-12-26 06:17:31,229][123091] Updated weights for policy 0, policy_version 839465 (0.0008) [2023-12-26 06:17:31,735][123090] Updated weights for policy 1, policy_version 833640 (0.0009) [2023-12-26 06:17:31,794][123090] Updated weights for policy 1, policy_version 833650 (0.0005) [2023-12-26 06:17:31,842][123090] Updated weights for policy 1, policy_version 833660 (0.0006) [2023-12-26 06:17:32,081][123091] Updated weights for policy 0, policy_version 839475 (0.0008) [2023-12-26 06:17:32,128][123091] Updated weights for policy 0, policy_version 839485 (0.0010) [2023-12-26 06:17:32,174][123091] Updated weights for policy 0, policy_version 839495 (0.0010) [2023-12-26 06:17:32,639][123090] Updated weights for policy 1, policy_version 833670 (0.0008) [2023-12-26 06:17:32,700][123090] Updated weights for policy 1, policy_version 833680 (0.0010) [2023-12-26 06:17:32,767][123090] Updated weights for policy 1, policy_version 833690 (0.0011) [2023-12-26 06:17:32,932][123091] Updated weights for policy 0, policy_version 839505 (0.0007) [2023-12-26 06:17:33,002][123091] Updated weights for policy 0, policy_version 839515 (0.0007) [2023-12-26 06:17:33,066][123091] Updated weights for policy 0, policy_version 839525 (0.0008) [2023-12-26 06:17:33,125][123091] Updated weights for policy 0, policy_version 839535 (0.0010) [2023-12-26 06:17:33,611][123090] Updated weights for policy 1, policy_version 833700 (0.0010) [2023-12-26 06:17:33,656][123090] Updated weights for policy 1, policy_version 833710 (0.0010) [2023-12-26 06:17:33,709][123090] Updated weights for policy 1, policy_version 833720 (0.0010) [2023-12-26 06:17:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 428359680. Throughput: 0: 8791.3, 1: 9070.8. Samples: 428369788. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:33,785][121949] Avg episode reward: [(0, '6140.299'), (1, '5720.319')] [2023-12-26 06:17:33,817][123091] Updated weights for policy 0, policy_version 839545 (0.0011) [2023-12-26 06:17:33,873][123091] Updated weights for policy 0, policy_version 839555 (0.0010) [2023-12-26 06:17:33,947][123091] Updated weights for policy 0, policy_version 839565 (0.0011) [2023-12-26 06:17:34,493][123090] Updated weights for policy 1, policy_version 833730 (0.0009) [2023-12-26 06:17:34,565][123090] Updated weights for policy 1, policy_version 833740 (0.0005) [2023-12-26 06:17:34,637][123090] Updated weights for policy 1, policy_version 833750 (0.0006) [2023-12-26 06:17:34,713][123090] Updated weights for policy 1, policy_version 833760 (0.0005) [2023-12-26 06:17:34,735][123091] Updated weights for policy 0, policy_version 839575 (0.0007) [2023-12-26 06:17:34,804][123091] Updated weights for policy 0, policy_version 839585 (0.0007) [2023-12-26 06:17:34,850][123091] Updated weights for policy 0, policy_version 839595 (0.0005) [2023-12-26 06:17:35,313][123090] Updated weights for policy 1, policy_version 833770 (0.0005) [2023-12-26 06:17:35,376][123090] Updated weights for policy 1, policy_version 833780 (0.0005) [2023-12-26 06:17:35,433][123090] Updated weights for policy 1, policy_version 833790 (0.0005) [2023-12-26 06:17:35,568][123091] Updated weights for policy 0, policy_version 839605 (0.0010) [2023-12-26 06:17:35,619][123091] Updated weights for policy 0, policy_version 839615 (0.0010) [2023-12-26 06:17:35,665][123091] Updated weights for policy 0, policy_version 839625 (0.0009) [2023-12-26 06:17:36,062][123090] Updated weights for policy 1, policy_version 833800 (0.0005) [2023-12-26 06:17:36,127][123090] Updated weights for policy 1, policy_version 833810 (0.0009) [2023-12-26 06:17:36,196][123090] Updated weights for policy 1, policy_version 833820 (0.0011) [2023-12-26 06:17:36,389][123091] Updated weights for policy 0, policy_version 839635 (0.0006) [2023-12-26 06:17:36,448][123091] Updated weights for policy 0, policy_version 839645 (0.0009) [2023-12-26 06:17:36,517][123091] Updated weights for policy 0, policy_version 839655 (0.0009) [2023-12-26 06:17:37,037][123090] Updated weights for policy 1, policy_version 833830 (0.0011) [2023-12-26 06:17:37,101][123090] Updated weights for policy 1, policy_version 833840 (0.0011) [2023-12-26 06:17:37,164][123090] Updated weights for policy 1, policy_version 833850 (0.0011) [2023-12-26 06:17:37,249][123091] Updated weights for policy 0, policy_version 839665 (0.0009) [2023-12-26 06:17:37,313][123091] Updated weights for policy 0, policy_version 839675 (0.0008) [2023-12-26 06:17:37,377][123091] Updated weights for policy 0, policy_version 839685 (0.0009) [2023-12-26 06:17:37,432][123091] Updated weights for policy 0, policy_version 839695 (0.0009) [2023-12-26 06:17:37,921][123090] Updated weights for policy 1, policy_version 833860 (0.0008) [2023-12-26 06:17:37,972][123090] Updated weights for policy 1, policy_version 833870 (0.0005) [2023-12-26 06:17:38,028][123090] Updated weights for policy 1, policy_version 833880 (0.0006) [2023-12-26 06:17:38,128][123091] Updated weights for policy 0, policy_version 839705 (0.0008) [2023-12-26 06:17:38,176][123091] Updated weights for policy 0, policy_version 839715 (0.0009) [2023-12-26 06:17:38,225][123091] Updated weights for policy 0, policy_version 839725 (0.0009) [2023-12-26 06:17:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 428449792. Throughput: 0: 8868.6, 1: 9120.2. Samples: 428427460. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:38,785][121949] Avg episode reward: [(0, '6159.547'), (1, '5838.192')] [2023-12-26 06:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000839728_214974464.pth... [2023-12-26 06:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000833888_213475328.pth... [2023-12-26 06:17:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000838672_214704128.pth [2023-12-26 06:17:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000832832_213204992.pth [2023-12-26 06:17:38,821][123090] Updated weights for policy 1, policy_version 833890 (0.0010) [2023-12-26 06:17:38,880][123090] Updated weights for policy 1, policy_version 833900 (0.0010) [2023-12-26 06:17:38,940][123090] Updated weights for policy 1, policy_version 833910 (0.0010) [2023-12-26 06:17:38,988][123090] Updated weights for policy 1, policy_version 833920 (0.0010) [2023-12-26 06:17:39,049][123091] Updated weights for policy 0, policy_version 839735 (0.0009) [2023-12-26 06:17:39,115][123091] Updated weights for policy 0, policy_version 839745 (0.0008) [2023-12-26 06:17:39,179][123091] Updated weights for policy 0, policy_version 839755 (0.0009) [2023-12-26 06:17:39,852][123090] Updated weights for policy 1, policy_version 833930 (0.0010) [2023-12-26 06:17:39,916][123090] Updated weights for policy 1, policy_version 833940 (0.0011) [2023-12-26 06:17:39,978][123090] Updated weights for policy 1, policy_version 833950 (0.0010) [2023-12-26 06:17:40,001][123091] Updated weights for policy 0, policy_version 839765 (0.0008) [2023-12-26 06:17:40,065][123091] Updated weights for policy 0, policy_version 839775 (0.0008) [2023-12-26 06:17:40,128][123091] Updated weights for policy 0, policy_version 839785 (0.0008) [2023-12-26 06:17:40,811][123090] Updated weights for policy 1, policy_version 833960 (0.0010) [2023-12-26 06:17:40,867][123090] Updated weights for policy 1, policy_version 833970 (0.0009) [2023-12-26 06:17:40,910][123091] Updated weights for policy 0, policy_version 839795 (0.0008) [2023-12-26 06:17:40,931][123090] Updated weights for policy 1, policy_version 833980 (0.0011) [2023-12-26 06:17:40,974][123091] Updated weights for policy 0, policy_version 839805 (0.0009) [2023-12-26 06:17:41,051][123091] Updated weights for policy 0, policy_version 839815 (0.0007) [2023-12-26 06:17:41,812][123090] Updated weights for policy 1, policy_version 833990 (0.0011) [2023-12-26 06:17:41,877][123090] Updated weights for policy 1, policy_version 834000 (0.0011) [2023-12-26 06:17:41,933][123091] Updated weights for policy 0, policy_version 839825 (0.0009) [2023-12-26 06:17:41,938][123090] Updated weights for policy 1, policy_version 834010 (0.0011) [2023-12-26 06:17:41,989][123091] Updated weights for policy 0, policy_version 839835 (0.0011) [2023-12-26 06:17:42,049][123091] Updated weights for policy 0, policy_version 839845 (0.0010) [2023-12-26 06:17:42,098][123091] Updated weights for policy 0, policy_version 839855 (0.0011) [2023-12-26 06:17:42,827][123090] Updated weights for policy 1, policy_version 834020 (0.0010) [2023-12-26 06:17:42,895][123090] Updated weights for policy 1, policy_version 834030 (0.0010) [2023-12-26 06:17:42,911][123091] Updated weights for policy 0, policy_version 839865 (0.0006) [2023-12-26 06:17:42,962][123091] Updated weights for policy 0, policy_version 839875 (0.0006) [2023-12-26 06:17:42,964][123090] Updated weights for policy 1, policy_version 834040 (0.0011) [2023-12-26 06:17:43,033][123091] Updated weights for policy 0, policy_version 839885 (0.0006) [2023-12-26 06:17:43,661][123090] Updated weights for policy 1, policy_version 834050 (0.0007) [2023-12-26 06:17:43,715][123090] Updated weights for policy 1, policy_version 834060 (0.0005) [2023-12-26 06:17:43,768][123091] Updated weights for policy 0, policy_version 839895 (0.0008) [2023-12-26 06:17:43,778][123090] Updated weights for policy 1, policy_version 834070 (0.0007) [2023-12-26 06:17:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 428531712. Throughput: 0: 8828.9, 1: 8999.5. Samples: 428531576. Policy #0 lag: (min: 2.0, avg: 12.3, max: 34.0) [2023-12-26 06:17:43,785][121949] Avg episode reward: [(0, '6277.600'), (1, '5937.995')] [2023-12-26 06:17:43,826][123091] Updated weights for policy 0, policy_version 839905 (0.0008) [2023-12-26 06:17:43,835][123090] Updated weights for policy 1, policy_version 834080 (0.0005) [2023-12-26 06:17:43,883][123091] Updated weights for policy 0, policy_version 839915 (0.0010) [2023-12-26 06:17:44,627][123090] Updated weights for policy 1, policy_version 834090 (0.0010) [2023-12-26 06:17:44,678][123090] Updated weights for policy 1, policy_version 834100 (0.0010) [2023-12-26 06:17:44,696][123091] Updated weights for policy 0, policy_version 839925 (0.0007) [2023-12-26 06:17:44,729][123090] Updated weights for policy 1, policy_version 834110 (0.0010) [2023-12-26 06:17:44,740][123091] Updated weights for policy 0, policy_version 839935 (0.0005) [2023-12-26 06:17:44,813][123091] Updated weights for policy 0, policy_version 839945 (0.0007) [2023-12-26 06:17:45,489][123090] Updated weights for policy 1, policy_version 834120 (0.0007) [2023-12-26 06:17:45,544][123091] Updated weights for policy 0, policy_version 839955 (0.0006) [2023-12-26 06:17:45,557][123090] Updated weights for policy 1, policy_version 834130 (0.0006) [2023-12-26 06:17:45,603][123091] Updated weights for policy 0, policy_version 839965 (0.0010) [2023-12-26 06:17:45,619][123090] Updated weights for policy 1, policy_version 834140 (0.0006) [2023-12-26 06:17:45,651][123091] Updated weights for policy 0, policy_version 839975 (0.0010) [2023-12-26 06:17:46,291][123090] Updated weights for policy 1, policy_version 834150 (0.0007) [2023-12-26 06:17:46,339][123090] Updated weights for policy 1, policy_version 834160 (0.0008) [2023-12-26 06:17:46,395][123090] Updated weights for policy 1, policy_version 834170 (0.0007) [2023-12-26 06:17:46,485][123091] Updated weights for policy 0, policy_version 839985 (0.0011) [2023-12-26 06:17:46,555][123091] Updated weights for policy 0, policy_version 839995 (0.0011) [2023-12-26 06:17:46,610][123091] Updated weights for policy 0, policy_version 840005 (0.0010) [2023-12-26 06:17:46,657][123091] Updated weights for policy 0, policy_version 840015 (0.0010) [2023-12-26 06:17:47,151][123090] Updated weights for policy 1, policy_version 834180 (0.0005) [2023-12-26 06:17:47,201][123090] Updated weights for policy 1, policy_version 834190 (0.0005) [2023-12-26 06:17:47,249][123090] Updated weights for policy 1, policy_version 834200 (0.0005) [2023-12-26 06:17:47,485][123091] Updated weights for policy 0, policy_version 840025 (0.0006) [2023-12-26 06:17:47,546][123091] Updated weights for policy 0, policy_version 840035 (0.0005) [2023-12-26 06:17:47,601][123091] Updated weights for policy 0, policy_version 840045 (0.0005) [2023-12-26 06:17:47,951][123090] Updated weights for policy 1, policy_version 834210 (0.0006) [2023-12-26 06:17:48,014][123090] Updated weights for policy 1, policy_version 834220 (0.0008) [2023-12-26 06:17:48,085][123090] Updated weights for policy 1, policy_version 834230 (0.0010) [2023-12-26 06:17:48,149][123090] Updated weights for policy 1, policy_version 834240 (0.0007) [2023-12-26 06:17:48,238][123091] Updated weights for policy 0, policy_version 840055 (0.0006) [2023-12-26 06:17:48,293][123091] Updated weights for policy 0, policy_version 840065 (0.0005) [2023-12-26 06:17:48,364][123091] Updated weights for policy 0, policy_version 840075 (0.0008) [2023-12-26 06:17:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 428630016. Throughput: 0: 8952.4, 1: 9067.3. Samples: 428643808. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:17:48,784][121949] Avg episode reward: [(0, '6354.384'), (1, '5954.969')] [2023-12-26 06:17:48,976][123090] Updated weights for policy 1, policy_version 834250 (0.0011) [2023-12-26 06:17:49,031][123090] Updated weights for policy 1, policy_version 834260 (0.0010) [2023-12-26 06:17:49,083][123090] Updated weights for policy 1, policy_version 834270 (0.0010) [2023-12-26 06:17:49,128][123091] Updated weights for policy 0, policy_version 840085 (0.0008) [2023-12-26 06:17:49,183][123091] Updated weights for policy 0, policy_version 840095 (0.0011) [2023-12-26 06:17:49,249][123091] Updated weights for policy 0, policy_version 840105 (0.0011) [2023-12-26 06:17:49,909][123090] Updated weights for policy 1, policy_version 834280 (0.0011) [2023-12-26 06:17:49,982][123091] Updated weights for policy 0, policy_version 840115 (0.0009) [2023-12-26 06:17:49,983][123090] Updated weights for policy 1, policy_version 834290 (0.0011) [2023-12-26 06:17:50,046][123091] Updated weights for policy 0, policy_version 840125 (0.0007) [2023-12-26 06:17:50,053][123090] Updated weights for policy 1, policy_version 834300 (0.0011) [2023-12-26 06:17:50,099][123091] Updated weights for policy 0, policy_version 840135 (0.0010) [2023-12-26 06:17:50,857][123091] Updated weights for policy 0, policy_version 840145 (0.0009) [2023-12-26 06:17:50,901][123090] Updated weights for policy 1, policy_version 834310 (0.0008) [2023-12-26 06:17:50,922][123091] Updated weights for policy 0, policy_version 840155 (0.0010) [2023-12-26 06:17:50,960][123090] Updated weights for policy 1, policy_version 834320 (0.0008) [2023-12-26 06:17:50,989][123091] Updated weights for policy 0, policy_version 840165 (0.0007) [2023-12-26 06:17:51,028][123090] Updated weights for policy 1, policy_version 834330 (0.0010) [2023-12-26 06:17:51,057][123091] Updated weights for policy 0, policy_version 840175 (0.0007) [2023-12-26 06:17:51,838][123091] Updated weights for policy 0, policy_version 840185 (0.0010) [2023-12-26 06:17:51,901][123091] Updated weights for policy 0, policy_version 840195 (0.0011) [2023-12-26 06:17:51,925][123090] Updated weights for policy 1, policy_version 834340 (0.0008) [2023-12-26 06:17:51,957][123091] Updated weights for policy 0, policy_version 840205 (0.0011) [2023-12-26 06:17:51,982][123090] Updated weights for policy 1, policy_version 834350 (0.0007) [2023-12-26 06:17:52,050][123090] Updated weights for policy 1, policy_version 834360 (0.0009) [2023-12-26 06:17:52,771][123091] Updated weights for policy 0, policy_version 840215 (0.0008) [2023-12-26 06:17:52,799][123090] Updated weights for policy 1, policy_version 834370 (0.0008) [2023-12-26 06:17:52,835][123091] Updated weights for policy 0, policy_version 840225 (0.0007) [2023-12-26 06:17:52,867][123090] Updated weights for policy 1, policy_version 834380 (0.0005) [2023-12-26 06:17:52,892][123091] Updated weights for policy 0, policy_version 840235 (0.0007) [2023-12-26 06:17:52,942][123090] Updated weights for policy 1, policy_version 834390 (0.0006) [2023-12-26 06:17:53,020][123090] Updated weights for policy 1, policy_version 834400 (0.0006) [2023-12-26 06:17:53,675][123090] Updated weights for policy 1, policy_version 834410 (0.0009) [2023-12-26 06:17:53,677][123091] Updated weights for policy 0, policy_version 840245 (0.0008) [2023-12-26 06:17:53,730][123090] Updated weights for policy 1, policy_version 834420 (0.0006) [2023-12-26 06:17:53,739][123091] Updated weights for policy 0, policy_version 840255 (0.0011) [2023-12-26 06:17:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 428711936. Throughput: 0: 8985.8, 1: 9009.1. Samples: 428695664. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:17:53,785][121949] Avg episode reward: [(0, '6332.275'), (1, '5953.752')] [2023-12-26 06:17:53,792][123090] Updated weights for policy 1, policy_version 834430 (0.0007) [2023-12-26 06:17:53,798][123091] Updated weights for policy 0, policy_version 840265 (0.0011) [2023-12-26 06:17:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000834432_213614592.pth... [2023-12-26 06:17:53,807][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000833376_213344256.pth [2023-12-26 06:17:53,841][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000840272_215113728.pth... [2023-12-26 06:17:53,846][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000839216_214843392.pth [2023-12-26 06:17:54,562][123090] Updated weights for policy 1, policy_version 834440 (0.0009) [2023-12-26 06:17:54,605][123091] Updated weights for policy 0, policy_version 840275 (0.0011) [2023-12-26 06:17:54,630][123090] Updated weights for policy 1, policy_version 834450 (0.0010) [2023-12-26 06:17:54,664][123091] Updated weights for policy 0, policy_version 840285 (0.0011) [2023-12-26 06:17:54,685][123090] Updated weights for policy 1, policy_version 834460 (0.0010) [2023-12-26 06:17:54,707][123091] Updated weights for policy 0, policy_version 840295 (0.0010) [2023-12-26 06:17:55,434][123090] Updated weights for policy 1, policy_version 834470 (0.0007) [2023-12-26 06:17:55,478][123091] Updated weights for policy 0, policy_version 840305 (0.0010) [2023-12-26 06:17:55,495][123090] Updated weights for policy 1, policy_version 834480 (0.0005) [2023-12-26 06:17:55,538][123091] Updated weights for policy 0, policy_version 840315 (0.0009) [2023-12-26 06:17:55,565][123090] Updated weights for policy 1, policy_version 834490 (0.0006) [2023-12-26 06:17:55,602][123091] Updated weights for policy 0, policy_version 840325 (0.0009) [2023-12-26 06:17:55,672][123091] Updated weights for policy 0, policy_version 840335 (0.0009) [2023-12-26 06:17:56,153][123090] Updated weights for policy 1, policy_version 834500 (0.0007) [2023-12-26 06:17:56,217][123090] Updated weights for policy 1, policy_version 834510 (0.0005) [2023-12-26 06:17:56,263][123090] Updated weights for policy 1, policy_version 834520 (0.0005) [2023-12-26 06:17:56,455][123091] Updated weights for policy 0, policy_version 840345 (0.0009) [2023-12-26 06:17:56,504][123091] Updated weights for policy 0, policy_version 840355 (0.0007) [2023-12-26 06:17:56,555][123091] Updated weights for policy 0, policy_version 840365 (0.0005) [2023-12-26 06:17:57,055][123090] Updated weights for policy 1, policy_version 834530 (0.0006) [2023-12-26 06:17:57,106][123090] Updated weights for policy 1, policy_version 834540 (0.0010) [2023-12-26 06:17:57,168][123090] Updated weights for policy 1, policy_version 834550 (0.0010) [2023-12-26 06:17:57,226][123090] Updated weights for policy 1, policy_version 834560 (0.0010) [2023-12-26 06:17:57,255][123091] Updated weights for policy 0, policy_version 840375 (0.0008) [2023-12-26 06:17:57,311][123091] Updated weights for policy 0, policy_version 840385 (0.0009) [2023-12-26 06:17:57,366][123091] Updated weights for policy 0, policy_version 840395 (0.0009) [2023-12-26 06:17:58,057][123090] Updated weights for policy 1, policy_version 834570 (0.0010) [2023-12-26 06:17:58,121][123090] Updated weights for policy 1, policy_version 834580 (0.0011) [2023-12-26 06:17:58,176][123090] Updated weights for policy 1, policy_version 834590 (0.0010) [2023-12-26 06:17:58,214][123091] Updated weights for policy 0, policy_version 840405 (0.0008) [2023-12-26 06:17:58,267][123091] Updated weights for policy 0, policy_version 840415 (0.0009) [2023-12-26 06:17:58,315][123091] Updated weights for policy 0, policy_version 840425 (0.0008) [2023-12-26 06:17:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 428810240. Throughput: 0: 9040.0, 1: 9100.8. Samples: 428804888. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:17:58,784][121949] Avg episode reward: [(0, '6143.078'), (1, '5976.084')] [2023-12-26 06:17:59,071][123090] Updated weights for policy 1, policy_version 834600 (0.0010) [2023-12-26 06:17:59,134][123090] Updated weights for policy 1, policy_version 834610 (0.0010) [2023-12-26 06:17:59,208][123090] Updated weights for policy 1, policy_version 834620 (0.0010) [2023-12-26 06:17:59,287][123091] Updated weights for policy 0, policy_version 840435 (0.0010) [2023-12-26 06:17:59,352][123091] Updated weights for policy 0, policy_version 840445 (0.0007) [2023-12-26 06:17:59,413][123091] Updated weights for policy 0, policy_version 840455 (0.0007) [2023-12-26 06:17:59,981][123090] Updated weights for policy 1, policy_version 834630 (0.0010) [2023-12-26 06:18:00,029][123090] Updated weights for policy 1, policy_version 834640 (0.0008) [2023-12-26 06:18:00,081][123090] Updated weights for policy 1, policy_version 834650 (0.0009) [2023-12-26 06:18:00,197][123091] Updated weights for policy 0, policy_version 840465 (0.0008) [2023-12-26 06:18:00,257][123091] Updated weights for policy 0, policy_version 840475 (0.0009) [2023-12-26 06:18:00,312][123091] Updated weights for policy 0, policy_version 840485 (0.0009) [2023-12-26 06:18:00,373][123091] Updated weights for policy 0, policy_version 840495 (0.0009) [2023-12-26 06:18:00,780][123090] Updated weights for policy 1, policy_version 834660 (0.0009) [2023-12-26 06:18:00,832][123090] Updated weights for policy 1, policy_version 834670 (0.0009) [2023-12-26 06:18:00,886][123090] Updated weights for policy 1, policy_version 834680 (0.0009) [2023-12-26 06:18:01,257][123091] Updated weights for policy 0, policy_version 840505 (0.0010) [2023-12-26 06:18:01,320][123091] Updated weights for policy 0, policy_version 840515 (0.0009) [2023-12-26 06:18:01,386][123091] Updated weights for policy 0, policy_version 840525 (0.0010) [2023-12-26 06:18:01,651][123090] Updated weights for policy 1, policy_version 834690 (0.0008) [2023-12-26 06:18:01,702][123090] Updated weights for policy 1, policy_version 834700 (0.0005) [2023-12-26 06:18:01,766][123090] Updated weights for policy 1, policy_version 834710 (0.0008) [2023-12-26 06:18:01,824][123090] Updated weights for policy 1, policy_version 834720 (0.0005) [2023-12-26 06:18:02,313][123091] Updated weights for policy 0, policy_version 840535 (0.0009) [2023-12-26 06:18:02,378][123091] Updated weights for policy 0, policy_version 840545 (0.0010) [2023-12-26 06:18:02,430][123091] Updated weights for policy 0, policy_version 840555 (0.0009) [2023-12-26 06:18:02,595][123090] Updated weights for policy 1, policy_version 834730 (0.0009) [2023-12-26 06:18:02,655][123090] Updated weights for policy 1, policy_version 834740 (0.0008) [2023-12-26 06:18:02,720][123090] Updated weights for policy 1, policy_version 834750 (0.0009) [2023-12-26 06:18:03,274][123091] Updated weights for policy 0, policy_version 840565 (0.0009) [2023-12-26 06:18:03,331][123091] Updated weights for policy 0, policy_version 840575 (0.0010) [2023-12-26 06:18:03,388][123091] Updated weights for policy 0, policy_version 840586 (0.0010) [2023-12-26 06:18:03,447][123090] Updated weights for policy 1, policy_version 834760 (0.0009) [2023-12-26 06:18:03,497][123090] Updated weights for policy 1, policy_version 834770 (0.0007) [2023-12-26 06:18:03,555][123090] Updated weights for policy 1, policy_version 834780 (0.0005) [2023-12-26 06:18:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 428900352. Throughput: 0: 8876.7, 1: 9044.3. Samples: 428907984. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:03,785][121949] Avg episode reward: [(0, '6111.432'), (1, '5881.318')] [2023-12-26 06:18:04,288][123091] Updated weights for policy 0, policy_version 840596 (0.0009) [2023-12-26 06:18:04,354][123091] Updated weights for policy 0, policy_version 840606 (0.0009) [2023-12-26 06:18:04,395][123090] Updated weights for policy 1, policy_version 834790 (0.0010) [2023-12-26 06:18:04,419][123091] Updated weights for policy 0, policy_version 840616 (0.0008) [2023-12-26 06:18:04,463][123090] Updated weights for policy 1, policy_version 834800 (0.0011) [2023-12-26 06:18:04,533][123090] Updated weights for policy 1, policy_version 834810 (0.0010) [2023-12-26 06:18:05,250][123091] Updated weights for policy 0, policy_version 840626 (0.0007) [2023-12-26 06:18:05,304][123091] Updated weights for policy 0, policy_version 840636 (0.0009) [2023-12-26 06:18:05,351][123090] Updated weights for policy 1, policy_version 834820 (0.0011) [2023-12-26 06:18:05,358][123091] Updated weights for policy 0, policy_version 840646 (0.0007) [2023-12-26 06:18:05,406][123090] Updated weights for policy 1, policy_version 834830 (0.0010) [2023-12-26 06:18:05,414][123091] Updated weights for policy 0, policy_version 840656 (0.0008) [2023-12-26 06:18:05,461][123090] Updated weights for policy 1, policy_version 834840 (0.0010) [2023-12-26 06:18:06,253][123090] Updated weights for policy 1, policy_version 834850 (0.0010) [2023-12-26 06:18:06,299][123091] Updated weights for policy 0, policy_version 840666 (0.0007) [2023-12-26 06:18:06,317][123090] Updated weights for policy 1, policy_version 834860 (0.0011) [2023-12-26 06:18:06,359][123091] Updated weights for policy 0, policy_version 840676 (0.0007) [2023-12-26 06:18:06,373][123090] Updated weights for policy 1, policy_version 834870 (0.0011) [2023-12-26 06:18:06,419][123091] Updated weights for policy 0, policy_version 840686 (0.0007) [2023-12-26 06:18:06,429][123090] Updated weights for policy 1, policy_version 834880 (0.0010) [2023-12-26 06:18:07,257][123090] Updated weights for policy 1, policy_version 834890 (0.0011) [2023-12-26 06:18:07,277][123091] Updated weights for policy 0, policy_version 840696 (0.0007) [2023-12-26 06:18:07,314][123090] Updated weights for policy 1, policy_version 834900 (0.0010) [2023-12-26 06:18:07,325][123091] Updated weights for policy 0, policy_version 840706 (0.0006) [2023-12-26 06:18:07,366][123090] Updated weights for policy 1, policy_version 834910 (0.0010) [2023-12-26 06:18:07,385][123091] Updated weights for policy 0, policy_version 840716 (0.0005) [2023-12-26 06:18:08,198][123090] Updated weights for policy 1, policy_version 834920 (0.0007) [2023-12-26 06:18:08,251][123091] Updated weights for policy 0, policy_version 840726 (0.0009) [2023-12-26 06:18:08,253][123090] Updated weights for policy 1, policy_version 834930 (0.0006) [2023-12-26 06:18:08,309][123090] Updated weights for policy 1, policy_version 834940 (0.0005) [2023-12-26 06:18:08,309][123091] Updated weights for policy 0, policy_version 840736 (0.0009) [2023-12-26 06:18:08,371][123091] Updated weights for policy 0, policy_version 840746 (0.0009) [2023-12-26 06:18:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 428982272. Throughput: 0: 8869.9, 1: 9033.3. Samples: 428958728. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:08,785][121949] Avg episode reward: [(0, '6095.142'), (1, '5888.194')] [2023-12-26 06:18:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000834944_213745664.pth... [2023-12-26 06:18:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000840752_215236608.pth... [2023-12-26 06:18:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000833888_213475328.pth [2023-12-26 06:18:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000839728_214974464.pth [2023-12-26 06:18:09,103][123090] Updated weights for policy 1, policy_version 834950 (0.0006) [2023-12-26 06:18:09,164][123090] Updated weights for policy 1, policy_version 834960 (0.0005) [2023-12-26 06:18:09,226][123091] Updated weights for policy 0, policy_version 840756 (0.0009) [2023-12-26 06:18:09,236][123090] Updated weights for policy 1, policy_version 834970 (0.0006) [2023-12-26 06:18:09,289][123091] Updated weights for policy 0, policy_version 840766 (0.0007) [2023-12-26 06:18:09,362][123091] Updated weights for policy 0, policy_version 840776 (0.0009) [2023-12-26 06:18:10,029][123090] Updated weights for policy 1, policy_version 834980 (0.0009) [2023-12-26 06:18:10,087][123090] Updated weights for policy 1, policy_version 834990 (0.0008) [2023-12-26 06:18:10,152][123090] Updated weights for policy 1, policy_version 835000 (0.0010) [2023-12-26 06:18:10,188][123091] Updated weights for policy 0, policy_version 840786 (0.0009) [2023-12-26 06:18:10,252][123091] Updated weights for policy 0, policy_version 840796 (0.0008) [2023-12-26 06:18:10,314][123091] Updated weights for policy 0, policy_version 840806 (0.0009) [2023-12-26 06:18:10,375][123091] Updated weights for policy 0, policy_version 840816 (0.0009) [2023-12-26 06:18:10,978][123090] Updated weights for policy 1, policy_version 835010 (0.0010) [2023-12-26 06:18:11,031][123090] Updated weights for policy 1, policy_version 835020 (0.0009) [2023-12-26 06:18:11,096][123090] Updated weights for policy 1, policy_version 835030 (0.0009) [2023-12-26 06:18:11,164][123090] Updated weights for policy 1, policy_version 835040 (0.0008) [2023-12-26 06:18:11,274][123091] Updated weights for policy 0, policy_version 840826 (0.0010) [2023-12-26 06:18:11,329][123091] Updated weights for policy 0, policy_version 840836 (0.0010) [2023-12-26 06:18:11,400][123091] Updated weights for policy 0, policy_version 840846 (0.0009) [2023-12-26 06:18:12,019][123090] Updated weights for policy 1, policy_version 835050 (0.0009) [2023-12-26 06:18:12,089][123090] Updated weights for policy 1, policy_version 835060 (0.0009) [2023-12-26 06:18:12,158][123090] Updated weights for policy 1, policy_version 835070 (0.0009) [2023-12-26 06:18:12,258][123091] Updated weights for policy 0, policy_version 840856 (0.0008) [2023-12-26 06:18:12,326][123091] Updated weights for policy 0, policy_version 840866 (0.0009) [2023-12-26 06:18:12,394][123091] Updated weights for policy 0, policy_version 840876 (0.0010) [2023-12-26 06:18:12,988][123090] Updated weights for policy 1, policy_version 835080 (0.0007) [2023-12-26 06:18:13,053][123090] Updated weights for policy 1, policy_version 835090 (0.0005) [2023-12-26 06:18:13,116][123090] Updated weights for policy 1, policy_version 835100 (0.0006) [2023-12-26 06:18:13,246][123091] Updated weights for policy 0, policy_version 840886 (0.0009) [2023-12-26 06:18:13,298][123091] Updated weights for policy 0, policy_version 840897 (0.0009) [2023-12-26 06:18:13,347][123091] Updated weights for policy 0, policy_version 840907 (0.0006) [2023-12-26 06:18:13,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 429064192. Throughput: 0: 8835.8, 1: 8909.2. Samples: 429060040. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:13,785][121949] Avg episode reward: [(0, '6113.566'), (1, '5885.631')] [2023-12-26 06:18:13,908][123090] Updated weights for policy 1, policy_version 835110 (0.0006) [2023-12-26 06:18:13,969][123090] Updated weights for policy 1, policy_version 835120 (0.0005) [2023-12-26 06:18:14,022][123091] Updated weights for policy 0, policy_version 840917 (0.0006) [2023-12-26 06:18:14,035][123090] Updated weights for policy 1, policy_version 835130 (0.0008) [2023-12-26 06:18:14,071][123091] Updated weights for policy 0, policy_version 840927 (0.0008) [2023-12-26 06:18:14,128][123091] Updated weights for policy 0, policy_version 840937 (0.0010) [2023-12-26 06:18:14,812][123090] Updated weights for policy 1, policy_version 835140 (0.0009) [2023-12-26 06:18:14,869][123090] Updated weights for policy 1, policy_version 835150 (0.0009) [2023-12-26 06:18:14,920][123090] Updated weights for policy 1, policy_version 835160 (0.0009) [2023-12-26 06:18:15,000][123091] Updated weights for policy 0, policy_version 840947 (0.0009) [2023-12-26 06:18:15,061][123091] Updated weights for policy 0, policy_version 840957 (0.0010) [2023-12-26 06:18:15,128][123091] Updated weights for policy 0, policy_version 840967 (0.0009) [2023-12-26 06:18:15,713][123090] Updated weights for policy 1, policy_version 835170 (0.0007) [2023-12-26 06:18:15,772][123090] Updated weights for policy 1, policy_version 835180 (0.0007) [2023-12-26 06:18:15,844][123090] Updated weights for policy 1, policy_version 835190 (0.0009) [2023-12-26 06:18:15,900][123090] Updated weights for policy 1, policy_version 835200 (0.0009) [2023-12-26 06:18:16,007][123091] Updated weights for policy 0, policy_version 840977 (0.0009) [2023-12-26 06:18:16,060][123091] Updated weights for policy 0, policy_version 840987 (0.0009) [2023-12-26 06:18:16,114][123091] Updated weights for policy 0, policy_version 840997 (0.0010) [2023-12-26 06:18:16,168][123091] Updated weights for policy 0, policy_version 841008 (0.0010) [2023-12-26 06:18:16,571][123090] Updated weights for policy 1, policy_version 835210 (0.0007) [2023-12-26 06:18:16,640][123090] Updated weights for policy 1, policy_version 835220 (0.0009) [2023-12-26 06:18:16,709][123090] Updated weights for policy 1, policy_version 835230 (0.0009) [2023-12-26 06:18:17,058][123091] Updated weights for policy 0, policy_version 841018 (0.0010) [2023-12-26 06:18:17,117][123091] Updated weights for policy 0, policy_version 841028 (0.0009) [2023-12-26 06:18:17,171][123091] Updated weights for policy 0, policy_version 841038 (0.0009) [2023-12-26 06:18:17,448][123090] Updated weights for policy 1, policy_version 835240 (0.0009) [2023-12-26 06:18:17,497][123090] Updated weights for policy 1, policy_version 835250 (0.0009) [2023-12-26 06:18:17,545][123090] Updated weights for policy 1, policy_version 835260 (0.0009) [2023-12-26 06:18:18,047][123091] Updated weights for policy 0, policy_version 841048 (0.0010) [2023-12-26 06:18:18,103][123091] Updated weights for policy 0, policy_version 841058 (0.0008) [2023-12-26 06:18:18,165][123091] Updated weights for policy 0, policy_version 841068 (0.0010) [2023-12-26 06:18:18,240][123090] Updated weights for policy 1, policy_version 835270 (0.0009) [2023-12-26 06:18:18,309][123090] Updated weights for policy 1, policy_version 835280 (0.0010) [2023-12-26 06:18:18,381][123090] Updated weights for policy 1, policy_version 835290 (0.0010) [2023-12-26 06:18:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 429154304. Throughput: 0: 8721.1, 1: 8972.3. Samples: 429165988. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:18,785][121949] Avg episode reward: [(0, '6173.580'), (1, '5871.846')] [2023-12-26 06:18:18,993][123091] Updated weights for policy 0, policy_version 841078 (0.0009) [2023-12-26 06:18:19,054][123091] Updated weights for policy 0, policy_version 841088 (0.0009) [2023-12-26 06:18:19,121][123091] Updated weights for policy 0, policy_version 841098 (0.0010) [2023-12-26 06:18:19,189][123090] Updated weights for policy 1, policy_version 835300 (0.0008) [2023-12-26 06:18:19,257][123090] Updated weights for policy 1, policy_version 835310 (0.0008) [2023-12-26 06:18:19,318][123090] Updated weights for policy 1, policy_version 835320 (0.0009) [2023-12-26 06:18:19,980][123091] Updated weights for policy 0, policy_version 841108 (0.0009) [2023-12-26 06:18:20,049][123091] Updated weights for policy 0, policy_version 841118 (0.0009) [2023-12-26 06:18:20,111][123091] Updated weights for policy 0, policy_version 841128 (0.0009) [2023-12-26 06:18:20,163][123090] Updated weights for policy 1, policy_version 835330 (0.0009) [2023-12-26 06:18:20,226][123090] Updated weights for policy 1, policy_version 835340 (0.0007) [2023-12-26 06:18:20,294][123090] Updated weights for policy 1, policy_version 835350 (0.0009) [2023-12-26 06:18:20,348][123090] Updated weights for policy 1, policy_version 835360 (0.0009) [2023-12-26 06:18:20,962][123091] Updated weights for policy 0, policy_version 841138 (0.0009) [2023-12-26 06:18:21,023][123091] Updated weights for policy 0, policy_version 841148 (0.0007) [2023-12-26 06:18:21,101][123091] Updated weights for policy 0, policy_version 841158 (0.0009) [2023-12-26 06:18:21,169][123091] Updated weights for policy 0, policy_version 841168 (0.0009) [2023-12-26 06:18:21,224][123090] Updated weights for policy 1, policy_version 835370 (0.0007) [2023-12-26 06:18:21,284][123090] Updated weights for policy 1, policy_version 835380 (0.0008) [2023-12-26 06:18:21,353][123090] Updated weights for policy 1, policy_version 835390 (0.0008) [2023-12-26 06:18:21,922][123091] Updated weights for policy 0, policy_version 841178 (0.0011) [2023-12-26 06:18:21,974][123091] Updated weights for policy 0, policy_version 841188 (0.0010) [2023-12-26 06:18:22,030][123091] Updated weights for policy 0, policy_version 841198 (0.0011) [2023-12-26 06:18:22,164][123090] Updated weights for policy 1, policy_version 835400 (0.0008) [2023-12-26 06:18:22,227][123090] Updated weights for policy 1, policy_version 835410 (0.0006) [2023-12-26 06:18:22,293][123090] Updated weights for policy 1, policy_version 835420 (0.0007) [2023-12-26 06:18:22,882][123091] Updated weights for policy 0, policy_version 841208 (0.0010) [2023-12-26 06:18:22,947][123091] Updated weights for policy 0, policy_version 841218 (0.0009) [2023-12-26 06:18:23,008][123091] Updated weights for policy 0, policy_version 841228 (0.0008) [2023-12-26 06:18:23,087][123090] Updated weights for policy 1, policy_version 835430 (0.0007) [2023-12-26 06:18:23,153][123090] Updated weights for policy 1, policy_version 835440 (0.0009) [2023-12-26 06:18:23,221][123090] Updated weights for policy 1, policy_version 835450 (0.0010) [2023-12-26 06:18:23,780][123091] Updated weights for policy 0, policy_version 841238 (0.0008) [2023-12-26 06:18:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 429236224. Throughput: 0: 8652.2, 1: 8884.4. Samples: 429216604. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:23,784][121949] Avg episode reward: [(0, '6211.939'), (1, '5770.702')] [2023-12-26 06:18:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000835456_213876736.pth... [2023-12-26 06:18:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000834432_213614592.pth [2023-12-26 06:18:23,834][123091] Updated weights for policy 0, policy_version 841248 (0.0010) [2023-12-26 06:18:23,878][123091] Updated weights for policy 0, policy_version 841258 (0.0010) [2023-12-26 06:18:23,909][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000841264_215367680.pth... [2023-12-26 06:18:23,914][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000840272_215113728.pth [2023-12-26 06:18:24,088][123090] Updated weights for policy 1, policy_version 835460 (0.0009) [2023-12-26 06:18:24,151][123090] Updated weights for policy 1, policy_version 835470 (0.0008) [2023-12-26 06:18:24,199][123090] Updated weights for policy 1, policy_version 835480 (0.0008) [2023-12-26 06:18:24,708][123091] Updated weights for policy 0, policy_version 841268 (0.0010) [2023-12-26 06:18:24,763][123091] Updated weights for policy 0, policy_version 841278 (0.0011) [2023-12-26 06:18:24,810][123091] Updated weights for policy 0, policy_version 841288 (0.0010) [2023-12-26 06:18:25,067][123090] Updated weights for policy 1, policy_version 835490 (0.0009) [2023-12-26 06:18:25,121][123090] Updated weights for policy 1, policy_version 835500 (0.0010) [2023-12-26 06:18:25,175][123090] Updated weights for policy 1, policy_version 835510 (0.0010) [2023-12-26 06:18:25,235][123090] Updated weights for policy 1, policy_version 835520 (0.0010) [2023-12-26 06:18:25,561][123091] Updated weights for policy 0, policy_version 841298 (0.0010) [2023-12-26 06:18:25,613][123091] Updated weights for policy 0, policy_version 841308 (0.0011) [2023-12-26 06:18:25,665][123091] Updated weights for policy 0, policy_version 841318 (0.0011) [2023-12-26 06:18:25,716][123091] Updated weights for policy 0, policy_version 841328 (0.0010) [2023-12-26 06:18:26,094][123090] Updated weights for policy 1, policy_version 835530 (0.0005) [2023-12-26 06:18:26,147][123090] Updated weights for policy 1, policy_version 835540 (0.0006) [2023-12-26 06:18:26,197][123090] Updated weights for policy 1, policy_version 835550 (0.0009) [2023-12-26 06:18:26,549][123091] Updated weights for policy 0, policy_version 841338 (0.0008) [2023-12-26 06:18:26,596][123091] Updated weights for policy 0, policy_version 841348 (0.0010) [2023-12-26 06:18:26,640][123091] Updated weights for policy 0, policy_version 841358 (0.0010) [2023-12-26 06:18:26,865][123090] Updated weights for policy 1, policy_version 835560 (0.0005) [2023-12-26 06:18:26,922][123090] Updated weights for policy 1, policy_version 835570 (0.0005) [2023-12-26 06:18:26,977][123090] Updated weights for policy 1, policy_version 835580 (0.0005) [2023-12-26 06:18:27,420][123091] Updated weights for policy 0, policy_version 841368 (0.0006) [2023-12-26 06:18:27,480][123091] Updated weights for policy 0, policy_version 841378 (0.0005) [2023-12-26 06:18:27,548][123091] Updated weights for policy 0, policy_version 841388 (0.0005) [2023-12-26 06:18:27,671][123090] Updated weights for policy 1, policy_version 835590 (0.0008) [2023-12-26 06:18:27,738][123090] Updated weights for policy 1, policy_version 835600 (0.0010) [2023-12-26 06:18:27,797][123090] Updated weights for policy 1, policy_version 835610 (0.0010) [2023-12-26 06:18:28,137][123091] Updated weights for policy 0, policy_version 841398 (0.0005) [2023-12-26 06:18:28,188][123091] Updated weights for policy 0, policy_version 841408 (0.0005) [2023-12-26 06:18:28,238][123091] Updated weights for policy 0, policy_version 841418 (0.0005) [2023-12-26 06:18:28,493][123090] Updated weights for policy 1, policy_version 835620 (0.0010) [2023-12-26 06:18:28,553][123090] Updated weights for policy 1, policy_version 835630 (0.0010) [2023-12-26 06:18:28,614][123090] Updated weights for policy 1, policy_version 835640 (0.0009) [2023-12-26 06:18:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 429334528. Throughput: 0: 8669.1, 1: 8941.8. Samples: 429324064. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:28,784][121949] Avg episode reward: [(0, '6194.937'), (1, '5711.584')] [2023-12-26 06:18:28,884][123091] Updated weights for policy 0, policy_version 841428 (0.0007) [2023-12-26 06:18:28,940][123091] Updated weights for policy 0, policy_version 841438 (0.0009) [2023-12-26 06:18:29,001][123091] Updated weights for policy 0, policy_version 841448 (0.0009) [2023-12-26 06:18:29,444][123090] Updated weights for policy 1, policy_version 835650 (0.0010) [2023-12-26 06:18:29,506][123090] Updated weights for policy 1, policy_version 835660 (0.0010) [2023-12-26 06:18:29,564][123090] Updated weights for policy 1, policy_version 835670 (0.0010) [2023-12-26 06:18:29,620][123090] Updated weights for policy 1, policy_version 835680 (0.0011) [2023-12-26 06:18:29,824][123091] Updated weights for policy 0, policy_version 841458 (0.0009) [2023-12-26 06:18:29,886][123091] Updated weights for policy 0, policy_version 841468 (0.0010) [2023-12-26 06:18:29,950][123091] Updated weights for policy 0, policy_version 841478 (0.0010) [2023-12-26 06:18:30,016][123091] Updated weights for policy 0, policy_version 841488 (0.0009) [2023-12-26 06:18:30,379][123090] Updated weights for policy 1, policy_version 835690 (0.0010) [2023-12-26 06:18:30,434][123090] Updated weights for policy 1, policy_version 835700 (0.0005) [2023-12-26 06:18:30,491][123090] Updated weights for policy 1, policy_version 835710 (0.0005) [2023-12-26 06:18:30,871][123091] Updated weights for policy 0, policy_version 841498 (0.0005) [2023-12-26 06:18:30,922][123091] Updated weights for policy 0, policy_version 841508 (0.0005) [2023-12-26 06:18:30,973][123091] Updated weights for policy 0, policy_version 841518 (0.0008) [2023-12-26 06:18:31,225][123090] Updated weights for policy 1, policy_version 835720 (0.0005) [2023-12-26 06:18:31,285][123090] Updated weights for policy 1, policy_version 835730 (0.0006) [2023-12-26 06:18:31,351][123090] Updated weights for policy 1, policy_version 835740 (0.0008) [2023-12-26 06:18:31,720][123091] Updated weights for policy 0, policy_version 841528 (0.0007) [2023-12-26 06:18:31,786][123091] Updated weights for policy 0, policy_version 841538 (0.0008) [2023-12-26 06:18:31,854][123091] Updated weights for policy 0, policy_version 841548 (0.0006) [2023-12-26 06:18:32,146][123090] Updated weights for policy 1, policy_version 835750 (0.0009) [2023-12-26 06:18:32,212][123090] Updated weights for policy 1, policy_version 835760 (0.0007) [2023-12-26 06:18:32,272][123090] Updated weights for policy 1, policy_version 835770 (0.0009) [2023-12-26 06:18:32,644][123091] Updated weights for policy 0, policy_version 841558 (0.0010) [2023-12-26 06:18:32,709][123091] Updated weights for policy 0, policy_version 841568 (0.0009) [2023-12-26 06:18:32,775][123091] Updated weights for policy 0, policy_version 841578 (0.0010) [2023-12-26 06:18:33,021][123090] Updated weights for policy 1, policy_version 835780 (0.0008) [2023-12-26 06:18:33,077][123090] Updated weights for policy 1, policy_version 835790 (0.0005) [2023-12-26 06:18:33,127][123090] Updated weights for policy 1, policy_version 835800 (0.0007) [2023-12-26 06:18:33,594][123091] Updated weights for policy 0, policy_version 841588 (0.0010) [2023-12-26 06:18:33,643][123091] Updated weights for policy 0, policy_version 841599 (0.0010) [2023-12-26 06:18:33,694][123091] Updated weights for policy 0, policy_version 841609 (0.0009) [2023-12-26 06:18:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 429424640. Throughput: 0: 8659.3, 1: 8912.0. Samples: 429434516. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:33,784][121949] Avg episode reward: [(0, '6199.752'), (1, '5576.337')] [2023-12-26 06:18:33,860][123090] Updated weights for policy 1, policy_version 835810 (0.0008) [2023-12-26 06:18:33,924][123090] Updated weights for policy 1, policy_version 835820 (0.0008) [2023-12-26 06:18:33,987][123090] Updated weights for policy 1, policy_version 835830 (0.0008) [2023-12-26 06:18:34,050][123090] Updated weights for policy 1, policy_version 835840 (0.0009) [2023-12-26 06:18:34,542][123091] Updated weights for policy 0, policy_version 841619 (0.0009) [2023-12-26 06:18:34,613][123091] Updated weights for policy 0, policy_version 841629 (0.0010) [2023-12-26 06:18:34,687][123091] Updated weights for policy 0, policy_version 841639 (0.0007) [2023-12-26 06:18:34,830][123090] Updated weights for policy 1, policy_version 835850 (0.0009) [2023-12-26 06:18:34,884][123090] Updated weights for policy 1, policy_version 835860 (0.0009) [2023-12-26 06:18:34,941][123090] Updated weights for policy 1, policy_version 835870 (0.0008) [2023-12-26 06:18:35,439][123091] Updated weights for policy 0, policy_version 841649 (0.0008) [2023-12-26 06:18:35,487][123091] Updated weights for policy 0, policy_version 841659 (0.0010) [2023-12-26 06:18:35,541][123091] Updated weights for policy 0, policy_version 841669 (0.0010) [2023-12-26 06:18:35,610][123091] Updated weights for policy 0, policy_version 841679 (0.0011) [2023-12-26 06:18:35,827][123090] Updated weights for policy 1, policy_version 835880 (0.0010) [2023-12-26 06:18:35,888][123090] Updated weights for policy 1, policy_version 835890 (0.0008) [2023-12-26 06:18:35,954][123090] Updated weights for policy 1, policy_version 835900 (0.0009) [2023-12-26 06:18:36,426][123091] Updated weights for policy 0, policy_version 841689 (0.0008) [2023-12-26 06:18:36,493][123091] Updated weights for policy 0, policy_version 841699 (0.0008) [2023-12-26 06:18:36,564][123091] Updated weights for policy 0, policy_version 841709 (0.0008) [2023-12-26 06:18:36,870][123090] Updated weights for policy 1, policy_version 835910 (0.0009) [2023-12-26 06:18:36,932][123090] Updated weights for policy 1, policy_version 835920 (0.0010) [2023-12-26 06:18:36,995][123090] Updated weights for policy 1, policy_version 835930 (0.0010) [2023-12-26 06:18:37,232][123091] Updated weights for policy 0, policy_version 841719 (0.0009) [2023-12-26 06:18:37,289][123091] Updated weights for policy 0, policy_version 841729 (0.0009) [2023-12-26 06:18:37,339][123091] Updated weights for policy 0, policy_version 841740 (0.0009) [2023-12-26 06:18:37,849][123090] Updated weights for policy 1, policy_version 835940 (0.0010) [2023-12-26 06:18:37,906][123090] Updated weights for policy 1, policy_version 835950 (0.0009) [2023-12-26 06:18:37,956][123090] Updated weights for policy 1, policy_version 835960 (0.0009) [2023-12-26 06:18:38,176][123091] Updated weights for policy 0, policy_version 841750 (0.0009) [2023-12-26 06:18:38,232][123091] Updated weights for policy 0, policy_version 841760 (0.0009) [2023-12-26 06:18:38,284][123091] Updated weights for policy 0, policy_version 841770 (0.0009) [2023-12-26 06:18:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 429506560. Throughput: 0: 8653.6, 1: 8908.8. Samples: 429485972. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:38,785][121949] Avg episode reward: [(0, '6241.060'), (1, '5650.080')] [2023-12-26 06:18:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000841776_215498752.pth... [2023-12-26 06:18:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000835968_214007808.pth... [2023-12-26 06:18:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000840752_215236608.pth [2023-12-26 06:18:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000834944_213745664.pth [2023-12-26 06:18:38,851][123090] Updated weights for policy 1, policy_version 835971 (0.0010) [2023-12-26 06:18:38,917][123090] Updated weights for policy 1, policy_version 835981 (0.0009) [2023-12-26 06:18:38,999][123090] Updated weights for policy 1, policy_version 835991 (0.0009) [2023-12-26 06:18:39,139][123091] Updated weights for policy 0, policy_version 841780 (0.0009) [2023-12-26 06:18:39,191][123091] Updated weights for policy 0, policy_version 841790 (0.0011) [2023-12-26 06:18:39,250][123091] Updated weights for policy 0, policy_version 841800 (0.0011) [2023-12-26 06:18:39,872][123090] Updated weights for policy 1, policy_version 836001 (0.0009) [2023-12-26 06:18:39,945][123090] Updated weights for policy 1, policy_version 836011 (0.0010) [2023-12-26 06:18:40,018][123090] Updated weights for policy 1, policy_version 836021 (0.0009) [2023-12-26 06:18:40,029][123091] Updated weights for policy 0, policy_version 841810 (0.0010) [2023-12-26 06:18:40,085][123090] Updated weights for policy 1, policy_version 836031 (0.0009) [2023-12-26 06:18:40,098][123091] Updated weights for policy 0, policy_version 841820 (0.0006) [2023-12-26 06:18:40,167][123091] Updated weights for policy 0, policy_version 841830 (0.0007) [2023-12-26 06:18:40,231][123091] Updated weights for policy 0, policy_version 841840 (0.0011) [2023-12-26 06:18:40,920][123090] Updated weights for policy 1, policy_version 836041 (0.0009) [2023-12-26 06:18:40,972][123090] Updated weights for policy 1, policy_version 836051 (0.0010) [2023-12-26 06:18:41,026][123091] Updated weights for policy 0, policy_version 841850 (0.0008) [2023-12-26 06:18:41,032][123090] Updated weights for policy 1, policy_version 836061 (0.0009) [2023-12-26 06:18:41,095][123091] Updated weights for policy 0, policy_version 841860 (0.0011) [2023-12-26 06:18:41,165][123091] Updated weights for policy 0, policy_version 841870 (0.0010) [2023-12-26 06:18:41,893][123090] Updated weights for policy 1, policy_version 836071 (0.0007) [2023-12-26 06:18:41,967][123090] Updated weights for policy 1, policy_version 836081 (0.0006) [2023-12-26 06:18:42,017][123091] Updated weights for policy 0, policy_version 841880 (0.0008) [2023-12-26 06:18:42,029][123090] Updated weights for policy 1, policy_version 836091 (0.0008) [2023-12-26 06:18:42,076][123091] Updated weights for policy 0, policy_version 841890 (0.0005) [2023-12-26 06:18:42,150][123091] Updated weights for policy 0, policy_version 841900 (0.0007) [2023-12-26 06:18:42,717][123090] Updated weights for policy 1, policy_version 836101 (0.0008) [2023-12-26 06:18:42,779][123090] Updated weights for policy 1, policy_version 836111 (0.0006) [2023-12-26 06:18:42,840][123090] Updated weights for policy 1, policy_version 836121 (0.0010) [2023-12-26 06:18:42,956][123091] Updated weights for policy 0, policy_version 841910 (0.0010) [2023-12-26 06:18:43,017][123091] Updated weights for policy 0, policy_version 841920 (0.0009) [2023-12-26 06:18:43,081][123091] Updated weights for policy 0, policy_version 841930 (0.0010) [2023-12-26 06:18:43,659][123090] Updated weights for policy 1, policy_version 836131 (0.0010) [2023-12-26 06:18:43,718][123090] Updated weights for policy 1, policy_version 836141 (0.0010) [2023-12-26 06:18:43,778][123090] Updated weights for policy 1, policy_version 836151 (0.0008) [2023-12-26 06:18:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 429588480. Throughput: 0: 8619.2, 1: 8789.2. Samples: 429588268. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:43,784][121949] Avg episode reward: [(0, '6237.730'), (1, '5769.629')] [2023-12-26 06:18:43,907][123091] Updated weights for policy 0, policy_version 841940 (0.0007) [2023-12-26 06:18:43,982][123091] Updated weights for policy 0, policy_version 841950 (0.0006) [2023-12-26 06:18:44,055][123091] Updated weights for policy 0, policy_version 841960 (0.0006) [2023-12-26 06:18:44,541][123090] Updated weights for policy 1, policy_version 836161 (0.0005) [2023-12-26 06:18:44,602][123090] Updated weights for policy 1, policy_version 836171 (0.0006) [2023-12-26 06:18:44,658][123090] Updated weights for policy 1, policy_version 836181 (0.0006) [2023-12-26 06:18:44,701][123091] Updated weights for policy 0, policy_version 841970 (0.0006) [2023-12-26 06:18:44,709][123090] Updated weights for policy 1, policy_version 836191 (0.0005) [2023-12-26 06:18:44,760][123091] Updated weights for policy 0, policy_version 841980 (0.0006) [2023-12-26 06:18:44,834][123091] Updated weights for policy 0, policy_version 841990 (0.0010) [2023-12-26 06:18:44,896][123091] Updated weights for policy 0, policy_version 842000 (0.0009) [2023-12-26 06:18:45,475][123090] Updated weights for policy 1, policy_version 836201 (0.0009) [2023-12-26 06:18:45,525][123090] Updated weights for policy 1, policy_version 836211 (0.0009) [2023-12-26 06:18:45,574][123090] Updated weights for policy 1, policy_version 836221 (0.0009) [2023-12-26 06:18:45,716][123091] Updated weights for policy 0, policy_version 842010 (0.0010) [2023-12-26 06:18:45,775][123091] Updated weights for policy 0, policy_version 842020 (0.0008) [2023-12-26 06:18:45,829][123091] Updated weights for policy 0, policy_version 842030 (0.0009) [2023-12-26 06:18:46,354][123090] Updated weights for policy 1, policy_version 836231 (0.0010) [2023-12-26 06:18:46,411][123090] Updated weights for policy 1, policy_version 836241 (0.0011) [2023-12-26 06:18:46,469][123090] Updated weights for policy 1, policy_version 836251 (0.0006) [2023-12-26 06:18:46,715][123091] Updated weights for policy 0, policy_version 842040 (0.0010) [2023-12-26 06:18:46,774][123091] Updated weights for policy 0, policy_version 842050 (0.0010) [2023-12-26 06:18:46,832][123091] Updated weights for policy 0, policy_version 842060 (0.0010) [2023-12-26 06:18:47,174][123090] Updated weights for policy 1, policy_version 836261 (0.0008) [2023-12-26 06:18:47,236][123090] Updated weights for policy 1, policy_version 836271 (0.0010) [2023-12-26 06:18:47,293][123090] Updated weights for policy 1, policy_version 836281 (0.0008) [2023-12-26 06:18:47,652][123091] Updated weights for policy 0, policy_version 842070 (0.0007) [2023-12-26 06:18:47,702][123091] Updated weights for policy 0, policy_version 842080 (0.0005) [2023-12-26 06:18:47,756][123091] Updated weights for policy 0, policy_version 842090 (0.0009) [2023-12-26 06:18:48,014][123090] Updated weights for policy 1, policy_version 836291 (0.0005) [2023-12-26 06:18:48,074][123090] Updated weights for policy 1, policy_version 836301 (0.0005) [2023-12-26 06:18:48,124][123090] Updated weights for policy 1, policy_version 836311 (0.0005) [2023-12-26 06:18:48,595][123091] Updated weights for policy 0, policy_version 842100 (0.0008) [2023-12-26 06:18:48,672][123091] Updated weights for policy 0, policy_version 842110 (0.0007) [2023-12-26 06:18:48,735][123091] Updated weights for policy 0, policy_version 842120 (0.0011) [2023-12-26 06:18:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 429678592. Throughput: 0: 8686.0, 1: 8826.9. Samples: 429696068. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:48,785][121949] Avg episode reward: [(0, '6181.098'), (1, '5775.669')] [2023-12-26 06:18:48,914][123090] Updated weights for policy 1, policy_version 836321 (0.0006) [2023-12-26 06:18:48,980][123090] Updated weights for policy 1, policy_version 836331 (0.0010) [2023-12-26 06:18:49,036][123090] Updated weights for policy 1, policy_version 836341 (0.0010) [2023-12-26 06:18:49,100][123090] Updated weights for policy 1, policy_version 836351 (0.0007) [2023-12-26 06:18:49,546][123091] Updated weights for policy 0, policy_version 842130 (0.0010) [2023-12-26 06:18:49,601][123091] Updated weights for policy 0, policy_version 842140 (0.0010) [2023-12-26 06:18:49,653][123091] Updated weights for policy 0, policy_version 842150 (0.0010) [2023-12-26 06:18:49,708][123091] Updated weights for policy 0, policy_version 842160 (0.0010) [2023-12-26 06:18:49,857][123090] Updated weights for policy 1, policy_version 836361 (0.0009) [2023-12-26 06:18:49,922][123090] Updated weights for policy 1, policy_version 836371 (0.0009) [2023-12-26 06:18:49,987][123090] Updated weights for policy 1, policy_version 836381 (0.0008) [2023-12-26 06:18:50,532][123091] Updated weights for policy 0, policy_version 842170 (0.0011) [2023-12-26 06:18:50,585][123091] Updated weights for policy 0, policy_version 842180 (0.0010) [2023-12-26 06:18:50,655][123091] Updated weights for policy 0, policy_version 842190 (0.0011) [2023-12-26 06:18:50,868][123090] Updated weights for policy 1, policy_version 836391 (0.0010) [2023-12-26 06:18:50,922][123090] Updated weights for policy 1, policy_version 836401 (0.0010) [2023-12-26 06:18:50,978][123090] Updated weights for policy 1, policy_version 836411 (0.0013) [2023-12-26 06:18:51,435][123091] Updated weights for policy 0, policy_version 842200 (0.0007) [2023-12-26 06:18:51,510][123091] Updated weights for policy 0, policy_version 842210 (0.0006) [2023-12-26 06:18:51,581][123091] Updated weights for policy 0, policy_version 842220 (0.0005) [2023-12-26 06:18:51,888][123090] Updated weights for policy 1, policy_version 836421 (0.0009) [2023-12-26 06:18:51,952][123090] Updated weights for policy 1, policy_version 836431 (0.0010) [2023-12-26 06:18:52,018][123090] Updated weights for policy 1, policy_version 836441 (0.0009) [2023-12-26 06:18:52,373][123091] Updated weights for policy 0, policy_version 842230 (0.0008) [2023-12-26 06:18:52,434][123091] Updated weights for policy 0, policy_version 842240 (0.0010) [2023-12-26 06:18:52,496][123091] Updated weights for policy 0, policy_version 842250 (0.0010) [2023-12-26 06:18:52,885][123090] Updated weights for policy 1, policy_version 836451 (0.0007) [2023-12-26 06:18:52,943][123090] Updated weights for policy 1, policy_version 836461 (0.0010) [2023-12-26 06:18:53,002][123090] Updated weights for policy 1, policy_version 836471 (0.0010) [2023-12-26 06:18:53,255][123091] Updated weights for policy 0, policy_version 842260 (0.0010) [2023-12-26 06:18:53,310][123091] Updated weights for policy 0, policy_version 842270 (0.0007) [2023-12-26 06:18:53,372][123091] Updated weights for policy 0, policy_version 842280 (0.0005) [2023-12-26 06:18:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 429768704. Throughput: 0: 8719.0, 1: 8803.3. Samples: 429747232. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:53,785][121949] Avg episode reward: [(0, '6207.723'), (1, '5704.461')] [2023-12-26 06:18:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000842288_215629824.pth... [2023-12-26 06:18:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000836480_214138880.pth... [2023-12-26 06:18:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000835456_213876736.pth [2023-12-26 06:18:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000841264_215367680.pth [2023-12-26 06:18:53,860][123090] Updated weights for policy 1, policy_version 836481 (0.0008) [2023-12-26 06:18:53,908][123090] Updated weights for policy 1, policy_version 836491 (0.0008) [2023-12-26 06:18:53,964][123090] Updated weights for policy 1, policy_version 836501 (0.0008) [2023-12-26 06:18:54,016][123090] Updated weights for policy 1, policy_version 836511 (0.0009) [2023-12-26 06:18:54,048][123091] Updated weights for policy 0, policy_version 842290 (0.0006) [2023-12-26 06:18:54,109][123091] Updated weights for policy 0, policy_version 842300 (0.0010) [2023-12-26 06:18:54,175][123091] Updated weights for policy 0, policy_version 842310 (0.0010) [2023-12-26 06:18:54,229][123091] Updated weights for policy 0, policy_version 842320 (0.0010) [2023-12-26 06:18:54,910][123090] Updated weights for policy 1, policy_version 836522 (0.0009) [2023-12-26 06:18:54,949][123091] Updated weights for policy 0, policy_version 842330 (0.0008) [2023-12-26 06:18:54,971][123090] Updated weights for policy 1, policy_version 836532 (0.0010) [2023-12-26 06:18:55,001][123091] Updated weights for policy 0, policy_version 842340 (0.0008) [2023-12-26 06:18:55,033][123090] Updated weights for policy 1, policy_version 836542 (0.0005) [2023-12-26 06:18:55,059][123091] Updated weights for policy 0, policy_version 842350 (0.0009) [2023-12-26 06:18:55,864][123091] Updated weights for policy 0, policy_version 842360 (0.0006) [2023-12-26 06:18:55,900][123090] Updated weights for policy 1, policy_version 836552 (0.0009) [2023-12-26 06:18:55,921][123091] Updated weights for policy 0, policy_version 842370 (0.0005) [2023-12-26 06:18:55,965][123090] Updated weights for policy 1, policy_version 836562 (0.0009) [2023-12-26 06:18:55,986][123091] Updated weights for policy 0, policy_version 842380 (0.0005) [2023-12-26 06:18:56,031][123090] Updated weights for policy 1, policy_version 836572 (0.0009) [2023-12-26 06:18:56,694][123091] Updated weights for policy 0, policy_version 842390 (0.0006) [2023-12-26 06:18:56,749][123091] Updated weights for policy 0, policy_version 842400 (0.0005) [2023-12-26 06:18:56,809][123091] Updated weights for policy 0, policy_version 842410 (0.0005) [2023-12-26 06:18:56,899][123090] Updated weights for policy 1, policy_version 836582 (0.0010) [2023-12-26 06:18:56,956][123090] Updated weights for policy 1, policy_version 836592 (0.0009) [2023-12-26 06:18:57,008][123090] Updated weights for policy 1, policy_version 836602 (0.0009) [2023-12-26 06:18:57,523][123091] Updated weights for policy 0, policy_version 842420 (0.0007) [2023-12-26 06:18:57,589][123091] Updated weights for policy 0, policy_version 842430 (0.0009) [2023-12-26 06:18:57,639][123091] Updated weights for policy 0, policy_version 842440 (0.0009) [2023-12-26 06:18:57,849][123090] Updated weights for policy 1, policy_version 836612 (0.0009) [2023-12-26 06:18:57,926][123090] Updated weights for policy 1, policy_version 836622 (0.0010) [2023-12-26 06:18:57,995][123090] Updated weights for policy 1, policy_version 836632 (0.0009) [2023-12-26 06:18:58,372][123091] Updated weights for policy 0, policy_version 842450 (0.0010) [2023-12-26 06:18:58,434][123091] Updated weights for policy 0, policy_version 842460 (0.0009) [2023-12-26 06:18:58,509][123091] Updated weights for policy 0, policy_version 842470 (0.0009) [2023-12-26 06:18:58,580][123091] Updated weights for policy 0, policy_version 842480 (0.0010) [2023-12-26 06:18:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 429858816. Throughput: 0: 8874.6, 1: 8750.4. Samples: 429853164. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:18:58,784][121949] Avg episode reward: [(0, '6096.322'), (1, '5801.978')] [2023-12-26 06:18:58,975][123090] Updated weights for policy 1, policy_version 836642 (0.0009) [2023-12-26 06:18:59,041][123090] Updated weights for policy 1, policy_version 836652 (0.0010) [2023-12-26 06:18:59,094][123090] Updated weights for policy 1, policy_version 836662 (0.0010) [2023-12-26 06:18:59,154][123090] Updated weights for policy 1, policy_version 836672 (0.0008) [2023-12-26 06:18:59,467][123091] Updated weights for policy 0, policy_version 842490 (0.0010) [2023-12-26 06:18:59,519][123091] Updated weights for policy 0, policy_version 842500 (0.0009) [2023-12-26 06:18:59,566][123091] Updated weights for policy 0, policy_version 842510 (0.0008) [2023-12-26 06:19:00,017][123090] Updated weights for policy 1, policy_version 836682 (0.0009) [2023-12-26 06:19:00,068][123090] Updated weights for policy 1, policy_version 836692 (0.0008) [2023-12-26 06:19:00,119][123090] Updated weights for policy 1, policy_version 836702 (0.0009) [2023-12-26 06:19:00,365][123091] Updated weights for policy 0, policy_version 842520 (0.0009) [2023-12-26 06:19:00,428][123091] Updated weights for policy 0, policy_version 842530 (0.0009) [2023-12-26 06:19:00,494][123091] Updated weights for policy 0, policy_version 842540 (0.0007) [2023-12-26 06:19:00,922][123090] Updated weights for policy 1, policy_version 836712 (0.0009) [2023-12-26 06:19:00,984][123090] Updated weights for policy 1, policy_version 836722 (0.0010) [2023-12-26 06:19:01,039][123090] Updated weights for policy 1, policy_version 836732 (0.0009) [2023-12-26 06:19:01,230][123091] Updated weights for policy 0, policy_version 842550 (0.0005) [2023-12-26 06:19:01,309][123091] Updated weights for policy 0, policy_version 842560 (0.0006) [2023-12-26 06:19:01,377][123091] Updated weights for policy 0, policy_version 842570 (0.0007) [2023-12-26 06:19:01,981][123090] Updated weights for policy 1, policy_version 836742 (0.0008) [2023-12-26 06:19:02,035][123090] Updated weights for policy 1, policy_version 836752 (0.0009) [2023-12-26 06:19:02,036][123091] Updated weights for policy 0, policy_version 842580 (0.0010) [2023-12-26 06:19:02,088][123090] Updated weights for policy 1, policy_version 836762 (0.0009) [2023-12-26 06:19:02,095][123091] Updated weights for policy 0, policy_version 842590 (0.0011) [2023-12-26 06:19:02,157][123091] Updated weights for policy 0, policy_version 842600 (0.0005) [2023-12-26 06:19:02,951][123091] Updated weights for policy 0, policy_version 842610 (0.0006) [2023-12-26 06:19:02,959][123090] Updated weights for policy 1, policy_version 836772 (0.0008) [2023-12-26 06:19:02,998][123091] Updated weights for policy 0, policy_version 842620 (0.0010) [2023-12-26 06:19:03,010][123090] Updated weights for policy 1, policy_version 836782 (0.0006) [2023-12-26 06:19:03,046][123091] Updated weights for policy 0, policy_version 842630 (0.0010) [2023-12-26 06:19:03,061][123090] Updated weights for policy 1, policy_version 836792 (0.0005) [2023-12-26 06:19:03,101][123091] Updated weights for policy 0, policy_version 842640 (0.0007) [2023-12-26 06:19:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 429940736. Throughput: 0: 8945.8, 1: 8625.7. Samples: 429956708. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:03,786][121949] Avg episode reward: [(0, '6089.169'), (1, '5865.022')] [2023-12-26 06:19:03,847][123090] Updated weights for policy 1, policy_version 836802 (0.0008) [2023-12-26 06:19:03,905][123090] Updated weights for policy 1, policy_version 836812 (0.0006) [2023-12-26 06:19:03,936][123091] Updated weights for policy 0, policy_version 842650 (0.0011) [2023-12-26 06:19:03,964][123090] Updated weights for policy 1, policy_version 836822 (0.0006) [2023-12-26 06:19:03,989][123091] Updated weights for policy 0, policy_version 842660 (0.0010) [2023-12-26 06:19:04,030][123090] Updated weights for policy 1, policy_version 836832 (0.0008) [2023-12-26 06:19:04,040][123091] Updated weights for policy 0, policy_version 842670 (0.0010) [2023-12-26 06:19:04,762][123090] Updated weights for policy 1, policy_version 836842 (0.0009) [2023-12-26 06:19:04,808][123090] Updated weights for policy 1, policy_version 836852 (0.0008) [2023-12-26 06:19:04,860][123090] Updated weights for policy 1, policy_version 836863 (0.0009) [2023-12-26 06:19:04,906][123091] Updated weights for policy 0, policy_version 842680 (0.0006) [2023-12-26 06:19:04,977][123091] Updated weights for policy 0, policy_version 842690 (0.0005) [2023-12-26 06:19:05,047][123091] Updated weights for policy 0, policy_version 842700 (0.0009) [2023-12-26 06:19:05,643][123090] Updated weights for policy 1, policy_version 836873 (0.0006) [2023-12-26 06:19:05,714][123090] Updated weights for policy 1, policy_version 836883 (0.0005) [2023-12-26 06:19:05,774][123090] Updated weights for policy 1, policy_version 836893 (0.0008) [2023-12-26 06:19:05,797][123091] Updated weights for policy 0, policy_version 842710 (0.0011) [2023-12-26 06:19:05,848][123091] Updated weights for policy 0, policy_version 842720 (0.0010) [2023-12-26 06:19:05,900][123091] Updated weights for policy 0, policy_version 842730 (0.0010) [2023-12-26 06:19:06,531][123090] Updated weights for policy 1, policy_version 836903 (0.0008) [2023-12-26 06:19:06,583][123090] Updated weights for policy 1, policy_version 836913 (0.0009) [2023-12-26 06:19:06,637][123090] Updated weights for policy 1, policy_version 836923 (0.0009) [2023-12-26 06:19:06,741][123091] Updated weights for policy 0, policy_version 842740 (0.0011) [2023-12-26 06:19:06,812][123091] Updated weights for policy 0, policy_version 842750 (0.0011) [2023-12-26 06:19:06,876][123091] Updated weights for policy 0, policy_version 842760 (0.0011) [2023-12-26 06:19:07,434][123090] Updated weights for policy 1, policy_version 836933 (0.0009) [2023-12-26 06:19:07,495][123090] Updated weights for policy 1, policy_version 836943 (0.0009) [2023-12-26 06:19:07,549][123090] Updated weights for policy 1, policy_version 836953 (0.0009) [2023-12-26 06:19:07,693][123091] Updated weights for policy 0, policy_version 842770 (0.0011) [2023-12-26 06:19:07,760][123091] Updated weights for policy 0, policy_version 842780 (0.0011) [2023-12-26 06:19:07,819][123091] Updated weights for policy 0, policy_version 842790 (0.0011) [2023-12-26 06:19:07,877][123091] Updated weights for policy 0, policy_version 842800 (0.0010) [2023-12-26 06:19:08,415][123090] Updated weights for policy 1, policy_version 836963 (0.0009) [2023-12-26 06:19:08,472][123090] Updated weights for policy 1, policy_version 836973 (0.0009) [2023-12-26 06:19:08,522][123090] Updated weights for policy 1, policy_version 836983 (0.0009) [2023-12-26 06:19:08,707][123091] Updated weights for policy 0, policy_version 842810 (0.0011) [2023-12-26 06:19:08,782][123091] Updated weights for policy 0, policy_version 842820 (0.0011) [2023-12-26 06:19:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 430030848. Throughput: 0: 8963.6, 1: 8668.7. Samples: 430010060. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:08,785][121949] Avg episode reward: [(0, '5992.131'), (1, '5948.436')] [2023-12-26 06:19:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000836992_214269952.pth... [2023-12-26 06:19:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000835968_214007808.pth [2023-12-26 06:19:08,845][123091] Updated weights for policy 0, policy_version 842830 (0.0011) [2023-12-26 06:19:08,854][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000842832_215769088.pth... [2023-12-26 06:19:08,857][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000841776_215498752.pth [2023-12-26 06:19:09,370][123090] Updated weights for policy 1, policy_version 836993 (0.0009) [2023-12-26 06:19:09,445][123090] Updated weights for policy 1, policy_version 837003 (0.0009) [2023-12-26 06:19:09,513][123090] Updated weights for policy 1, policy_version 837013 (0.0009) [2023-12-26 06:19:09,582][123090] Updated weights for policy 1, policy_version 837023 (0.0009) [2023-12-26 06:19:09,733][123091] Updated weights for policy 0, policy_version 842840 (0.0011) [2023-12-26 06:19:09,810][123091] Updated weights for policy 0, policy_version 842850 (0.0011) [2023-12-26 06:19:09,888][123091] Updated weights for policy 0, policy_version 842860 (0.0010) [2023-12-26 06:19:10,382][123090] Updated weights for policy 1, policy_version 837033 (0.0007) [2023-12-26 06:19:10,446][123090] Updated weights for policy 1, policy_version 837043 (0.0009) [2023-12-26 06:19:10,509][123090] Updated weights for policy 1, policy_version 837053 (0.0010) [2023-12-26 06:19:10,672][123091] Updated weights for policy 0, policy_version 842870 (0.0011) [2023-12-26 06:19:10,740][123091] Updated weights for policy 0, policy_version 842880 (0.0009) [2023-12-26 06:19:10,804][123091] Updated weights for policy 0, policy_version 842890 (0.0009) [2023-12-26 06:19:11,314][123090] Updated weights for policy 1, policy_version 837063 (0.0010) [2023-12-26 06:19:11,383][123090] Updated weights for policy 1, policy_version 837073 (0.0010) [2023-12-26 06:19:11,443][123090] Updated weights for policy 1, policy_version 837083 (0.0010) [2023-12-26 06:19:11,689][123091] Updated weights for policy 0, policy_version 842900 (0.0009) [2023-12-26 06:19:11,762][123091] Updated weights for policy 0, policy_version 842910 (0.0008) [2023-12-26 06:19:11,818][123091] Updated weights for policy 0, policy_version 842920 (0.0010) [2023-12-26 06:19:12,309][123090] Updated weights for policy 1, policy_version 837093 (0.0008) [2023-12-26 06:19:12,380][123090] Updated weights for policy 1, policy_version 837103 (0.0010) [2023-12-26 06:19:12,447][123090] Updated weights for policy 1, policy_version 837113 (0.0009) [2023-12-26 06:19:12,660][123091] Updated weights for policy 0, policy_version 842930 (0.0009) [2023-12-26 06:19:12,718][123091] Updated weights for policy 0, policy_version 842941 (0.0010) [2023-12-26 06:19:12,767][123091] Updated weights for policy 0, policy_version 842951 (0.0009) [2023-12-26 06:19:13,197][123090] Updated weights for policy 1, policy_version 837123 (0.0008) [2023-12-26 06:19:13,254][123090] Updated weights for policy 1, policy_version 837133 (0.0005) [2023-12-26 06:19:13,323][123090] Updated weights for policy 1, policy_version 837143 (0.0005) [2023-12-26 06:19:13,542][123091] Updated weights for policy 0, policy_version 842961 (0.0010) [2023-12-26 06:19:13,610][123091] Updated weights for policy 0, policy_version 842971 (0.0005) [2023-12-26 06:19:13,656][123091] Updated weights for policy 0, policy_version 842981 (0.0005) [2023-12-26 06:19:13,703][123091] Updated weights for policy 0, policy_version 842991 (0.0005) [2023-12-26 06:19:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 430120960. Throughput: 0: 8863.8, 1: 8616.6. Samples: 430110684. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:13,784][121949] Avg episode reward: [(0, '5930.786'), (1, '5883.787')] [2023-12-26 06:19:13,980][123090] Updated weights for policy 1, policy_version 837153 (0.0005) [2023-12-26 06:19:14,037][123090] Updated weights for policy 1, policy_version 837163 (0.0005) [2023-12-26 06:19:14,096][123090] Updated weights for policy 1, policy_version 837173 (0.0005) [2023-12-26 06:19:14,156][123090] Updated weights for policy 1, policy_version 837183 (0.0005) [2023-12-26 06:19:14,360][123091] Updated weights for policy 0, policy_version 843001 (0.0008) [2023-12-26 06:19:14,417][123091] Updated weights for policy 0, policy_version 843011 (0.0007) [2023-12-26 06:19:14,470][123091] Updated weights for policy 0, policy_version 843021 (0.0009) [2023-12-26 06:19:14,858][123090] Updated weights for policy 1, policy_version 837193 (0.0009) [2023-12-26 06:19:14,911][123090] Updated weights for policy 1, policy_version 837203 (0.0009) [2023-12-26 06:19:14,966][123090] Updated weights for policy 1, policy_version 837213 (0.0008) [2023-12-26 06:19:15,322][123091] Updated weights for policy 0, policy_version 843031 (0.0010) [2023-12-26 06:19:15,383][123091] Updated weights for policy 0, policy_version 843041 (0.0009) [2023-12-26 06:19:15,446][123091] Updated weights for policy 0, policy_version 843051 (0.0010) [2023-12-26 06:19:15,843][123090] Updated weights for policy 1, policy_version 837223 (0.0006) [2023-12-26 06:19:15,922][123090] Updated weights for policy 1, policy_version 837233 (0.0005) [2023-12-26 06:19:15,991][123090] Updated weights for policy 1, policy_version 837243 (0.0005) [2023-12-26 06:19:16,158][123091] Updated weights for policy 0, policy_version 843061 (0.0008) [2023-12-26 06:19:16,217][123091] Updated weights for policy 0, policy_version 843071 (0.0005) [2023-12-26 06:19:16,269][123091] Updated weights for policy 0, policy_version 843081 (0.0005) [2023-12-26 06:19:16,610][123090] Updated weights for policy 1, policy_version 837253 (0.0008) [2023-12-26 06:19:16,674][123090] Updated weights for policy 1, policy_version 837263 (0.0011) [2023-12-26 06:19:16,741][123090] Updated weights for policy 1, policy_version 837273 (0.0011) [2023-12-26 06:19:17,031][123091] Updated weights for policy 0, policy_version 843091 (0.0007) [2023-12-26 06:19:17,091][123091] Updated weights for policy 0, policy_version 843101 (0.0008) [2023-12-26 06:19:17,148][123091] Updated weights for policy 0, policy_version 843111 (0.0009) [2023-12-26 06:19:17,556][123090] Updated weights for policy 1, policy_version 837283 (0.0010) [2023-12-26 06:19:17,616][123090] Updated weights for policy 1, policy_version 837293 (0.0010) [2023-12-26 06:19:17,670][123090] Updated weights for policy 1, policy_version 837303 (0.0010) [2023-12-26 06:19:17,868][123091] Updated weights for policy 0, policy_version 843121 (0.0009) [2023-12-26 06:19:17,933][123091] Updated weights for policy 0, policy_version 843131 (0.0009) [2023-12-26 06:19:17,986][123091] Updated weights for policy 0, policy_version 843141 (0.0009) [2023-12-26 06:19:18,035][123091] Updated weights for policy 0, policy_version 843151 (0.0009) [2023-12-26 06:19:18,472][123090] Updated weights for policy 1, policy_version 837313 (0.0009) [2023-12-26 06:19:18,537][123090] Updated weights for policy 1, policy_version 837323 (0.0008) [2023-12-26 06:19:18,604][123090] Updated weights for policy 1, policy_version 837333 (0.0008) [2023-12-26 06:19:18,674][123090] Updated weights for policy 1, policy_version 837343 (0.0005) [2023-12-26 06:19:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 430211072. Throughput: 0: 8885.3, 1: 8629.3. Samples: 430222676. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:18,785][121949] Avg episode reward: [(0, '6026.441'), (1, '5873.429')] [2023-12-26 06:19:18,936][123091] Updated weights for policy 0, policy_version 843161 (0.0009) [2023-12-26 06:19:18,996][123091] Updated weights for policy 0, policy_version 843171 (0.0009) [2023-12-26 06:19:19,056][123091] Updated weights for policy 0, policy_version 843181 (0.0008) [2023-12-26 06:19:19,451][123090] Updated weights for policy 1, policy_version 837353 (0.0008) [2023-12-26 06:19:19,521][123090] Updated weights for policy 1, policy_version 837363 (0.0009) [2023-12-26 06:19:19,580][123090] Updated weights for policy 1, policy_version 837373 (0.0007) [2023-12-26 06:19:19,952][123091] Updated weights for policy 0, policy_version 843191 (0.0009) [2023-12-26 06:19:20,016][123091] Updated weights for policy 0, policy_version 843201 (0.0010) [2023-12-26 06:19:20,082][123091] Updated weights for policy 0, policy_version 843211 (0.0010) [2023-12-26 06:19:20,309][123090] Updated weights for policy 1, policy_version 837383 (0.0005) [2023-12-26 06:19:20,372][123090] Updated weights for policy 1, policy_version 837393 (0.0006) [2023-12-26 06:19:20,451][123090] Updated weights for policy 1, policy_version 837403 (0.0006) [2023-12-26 06:19:20,978][123091] Updated weights for policy 0, policy_version 843221 (0.0010) [2023-12-26 06:19:21,059][123091] Updated weights for policy 0, policy_version 843231 (0.0010) [2023-12-26 06:19:21,128][123091] Updated weights for policy 0, policy_version 843241 (0.0010) [2023-12-26 06:19:21,210][123090] Updated weights for policy 1, policy_version 837413 (0.0008) [2023-12-26 06:19:21,279][123090] Updated weights for policy 1, policy_version 837423 (0.0010) [2023-12-26 06:19:21,335][123090] Updated weights for policy 1, policy_version 837433 (0.0009) [2023-12-26 06:19:21,978][123091] Updated weights for policy 0, policy_version 843251 (0.0008) [2023-12-26 06:19:22,050][123091] Updated weights for policy 0, policy_version 843261 (0.0006) [2023-12-26 06:19:22,113][123091] Updated weights for policy 0, policy_version 843271 (0.0006) [2023-12-26 06:19:22,146][123090] Updated weights for policy 1, policy_version 837443 (0.0009) [2023-12-26 06:19:22,213][123090] Updated weights for policy 1, policy_version 837453 (0.0006) [2023-12-26 06:19:22,286][123090] Updated weights for policy 1, policy_version 837463 (0.0008) [2023-12-26 06:19:22,869][123091] Updated weights for policy 0, policy_version 843281 (0.0006) [2023-12-26 06:19:22,936][123091] Updated weights for policy 0, policy_version 843291 (0.0010) [2023-12-26 06:19:22,991][123091] Updated weights for policy 0, policy_version 843301 (0.0009) [2023-12-26 06:19:23,050][123091] Updated weights for policy 0, policy_version 843311 (0.0010) [2023-12-26 06:19:23,071][123090] Updated weights for policy 1, policy_version 837473 (0.0009) [2023-12-26 06:19:23,137][123090] Updated weights for policy 1, policy_version 837483 (0.0009) [2023-12-26 06:19:23,205][123090] Updated weights for policy 1, policy_version 837493 (0.0009) [2023-12-26 06:19:23,263][123090] Updated weights for policy 1, policy_version 837503 (0.0009) [2023-12-26 06:19:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 430292992. Throughput: 0: 8814.8, 1: 8682.2. Samples: 430273340. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:23,785][121949] Avg episode reward: [(0, '5967.083'), (1, '5836.104')] [2023-12-26 06:19:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000843312_215891968.pth... [2023-12-26 06:19:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000837504_214401024.pth... [2023-12-26 06:19:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000836480_214138880.pth [2023-12-26 06:19:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000842288_215629824.pth [2023-12-26 06:19:23,911][123091] Updated weights for policy 0, policy_version 843321 (0.0010) [2023-12-26 06:19:23,972][123091] Updated weights for policy 0, policy_version 843332 (0.0009) [2023-12-26 06:19:23,999][123090] Updated weights for policy 1, policy_version 837513 (0.0009) [2023-12-26 06:19:24,032][123091] Updated weights for policy 0, policy_version 843342 (0.0007) [2023-12-26 06:19:24,065][123090] Updated weights for policy 1, policy_version 837523 (0.0009) [2023-12-26 06:19:24,119][123090] Updated weights for policy 1, policy_version 837533 (0.0009) [2023-12-26 06:19:24,864][123091] Updated weights for policy 0, policy_version 843352 (0.0008) [2023-12-26 06:19:24,918][123091] Updated weights for policy 0, policy_version 843362 (0.0009) [2023-12-26 06:19:24,951][123090] Updated weights for policy 1, policy_version 837543 (0.0009) [2023-12-26 06:19:24,971][123091] Updated weights for policy 0, policy_version 843372 (0.0009) [2023-12-26 06:19:25,007][123090] Updated weights for policy 1, policy_version 837553 (0.0008) [2023-12-26 06:19:25,063][123090] Updated weights for policy 1, policy_version 837563 (0.0009) [2023-12-26 06:19:25,789][123091] Updated weights for policy 0, policy_version 843382 (0.0009) [2023-12-26 06:19:25,856][123091] Updated weights for policy 0, policy_version 843392 (0.0010) [2023-12-26 06:19:25,886][123090] Updated weights for policy 1, policy_version 837573 (0.0008) [2023-12-26 06:19:25,915][123091] Updated weights for policy 0, policy_version 843402 (0.0008) [2023-12-26 06:19:25,943][123090] Updated weights for policy 1, policy_version 837583 (0.0008) [2023-12-26 06:19:25,996][123090] Updated weights for policy 1, policy_version 837593 (0.0009) [2023-12-26 06:19:26,701][123091] Updated weights for policy 0, policy_version 843412 (0.0009) [2023-12-26 06:19:26,756][123091] Updated weights for policy 0, policy_version 843422 (0.0009) [2023-12-26 06:19:26,815][123091] Updated weights for policy 0, policy_version 843432 (0.0009) [2023-12-26 06:19:26,841][123090] Updated weights for policy 1, policy_version 837603 (0.0009) [2023-12-26 06:19:26,907][123090] Updated weights for policy 1, policy_version 837613 (0.0010) [2023-12-26 06:19:26,970][123090] Updated weights for policy 1, policy_version 837623 (0.0009) [2023-12-26 06:19:27,630][123091] Updated weights for policy 0, policy_version 843442 (0.0010) [2023-12-26 06:19:27,684][123091] Updated weights for policy 0, policy_version 843452 (0.0009) [2023-12-26 06:19:27,744][123091] Updated weights for policy 0, policy_version 843462 (0.0009) [2023-12-26 06:19:27,777][123090] Updated weights for policy 1, policy_version 837633 (0.0009) [2023-12-26 06:19:27,800][123091] Updated weights for policy 0, policy_version 843472 (0.0010) [2023-12-26 06:19:27,828][123090] Updated weights for policy 1, policy_version 837643 (0.0008) [2023-12-26 06:19:27,887][123090] Updated weights for policy 1, policy_version 837653 (0.0008) [2023-12-26 06:19:27,950][123090] Updated weights for policy 1, policy_version 837663 (0.0009) [2023-12-26 06:19:28,632][123091] Updated weights for policy 0, policy_version 843482 (0.0009) [2023-12-26 06:19:28,696][123091] Updated weights for policy 0, policy_version 843492 (0.0009) [2023-12-26 06:19:28,752][123091] Updated weights for policy 0, policy_version 843502 (0.0009) [2023-12-26 06:19:28,762][123090] Updated weights for policy 1, policy_version 837673 (0.0008) [2023-12-26 06:19:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 430383104. Throughput: 0: 8813.3, 1: 8726.1. Samples: 430377544. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:28,785][121949] Avg episode reward: [(0, '6212.766'), (1, '5791.787')] [2023-12-26 06:19:28,828][123090] Updated weights for policy 1, policy_version 837683 (0.0009) [2023-12-26 06:19:28,896][123090] Updated weights for policy 1, policy_version 837693 (0.0009) [2023-12-26 06:19:29,586][123091] Updated weights for policy 0, policy_version 843512 (0.0009) [2023-12-26 06:19:29,648][123091] Updated weights for policy 0, policy_version 843522 (0.0010) [2023-12-26 06:19:29,713][123091] Updated weights for policy 0, policy_version 843532 (0.0008) [2023-12-26 06:19:29,726][123090] Updated weights for policy 1, policy_version 837703 (0.0009) [2023-12-26 06:19:29,786][123090] Updated weights for policy 1, policy_version 837713 (0.0008) [2023-12-26 06:19:29,855][123090] Updated weights for policy 1, policy_version 837723 (0.0010) [2023-12-26 06:19:30,539][123091] Updated weights for policy 0, policy_version 843542 (0.0010) [2023-12-26 06:19:30,592][123091] Updated weights for policy 0, policy_version 843552 (0.0009) [2023-12-26 06:19:30,639][123091] Updated weights for policy 0, policy_version 843562 (0.0006) [2023-12-26 06:19:30,665][123090] Updated weights for policy 1, policy_version 837733 (0.0009) [2023-12-26 06:19:30,716][123090] Updated weights for policy 1, policy_version 837743 (0.0009) [2023-12-26 06:19:30,769][123090] Updated weights for policy 1, policy_version 837753 (0.0009) [2023-12-26 06:19:31,425][123091] Updated weights for policy 0, policy_version 843572 (0.0007) [2023-12-26 06:19:31,478][123091] Updated weights for policy 0, policy_version 843582 (0.0009) [2023-12-26 06:19:31,525][123091] Updated weights for policy 0, policy_version 843592 (0.0009) [2023-12-26 06:19:31,661][123090] Updated weights for policy 1, policy_version 837764 (0.0010) [2023-12-26 06:19:31,735][123090] Updated weights for policy 1, policy_version 837774 (0.0009) [2023-12-26 06:19:31,797][123090] Updated weights for policy 1, policy_version 837784 (0.0009) [2023-12-26 06:19:32,294][123091] Updated weights for policy 0, policy_version 843602 (0.0009) [2023-12-26 06:19:32,369][123091] Updated weights for policy 0, policy_version 843613 (0.0009) [2023-12-26 06:19:32,433][123091] Updated weights for policy 0, policy_version 843623 (0.0009) [2023-12-26 06:19:32,595][123090] Updated weights for policy 1, policy_version 837794 (0.0009) [2023-12-26 06:19:32,655][123090] Updated weights for policy 1, policy_version 837804 (0.0005) [2023-12-26 06:19:32,709][123090] Updated weights for policy 1, policy_version 837814 (0.0005) [2023-12-26 06:19:32,766][123090] Updated weights for policy 1, policy_version 837824 (0.0006) [2023-12-26 06:19:33,291][123091] Updated weights for policy 0, policy_version 843633 (0.0010) [2023-12-26 06:19:33,338][123091] Updated weights for policy 0, policy_version 843643 (0.0010) [2023-12-26 06:19:33,399][123091] Updated weights for policy 0, policy_version 843653 (0.0008) [2023-12-26 06:19:33,448][123091] Updated weights for policy 0, policy_version 843663 (0.0009) [2023-12-26 06:19:33,537][123090] Updated weights for policy 1, policy_version 837834 (0.0009) [2023-12-26 06:19:33,597][123090] Updated weights for policy 1, policy_version 837844 (0.0009) [2023-12-26 06:19:33,652][123090] Updated weights for policy 1, policy_version 837854 (0.0008) [2023-12-26 06:19:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 430473216. Throughput: 0: 8800.8, 1: 8635.7. Samples: 430480716. Policy #0 lag: (min: 28.0, avg: 31.9, max: 60.0) [2023-12-26 06:19:33,785][121949] Avg episode reward: [(0, '6177.882'), (1, '5826.460')] [2023-12-26 06:19:34,289][123091] Updated weights for policy 0, policy_version 843673 (0.0010) [2023-12-26 06:19:34,346][123091] Updated weights for policy 0, policy_version 843683 (0.0009) [2023-12-26 06:19:34,413][123091] Updated weights for policy 0, policy_version 843693 (0.0007) [2023-12-26 06:19:34,501][123090] Updated weights for policy 1, policy_version 837864 (0.0009) [2023-12-26 06:19:34,561][123090] Updated weights for policy 1, policy_version 837874 (0.0010) [2023-12-26 06:19:34,631][123090] Updated weights for policy 1, policy_version 837884 (0.0010) [2023-12-26 06:19:35,135][123091] Updated weights for policy 0, policy_version 843703 (0.0005) [2023-12-26 06:19:35,186][123091] Updated weights for policy 0, policy_version 843713 (0.0006) [2023-12-26 06:19:35,242][123091] Updated weights for policy 0, policy_version 843723 (0.0010) [2023-12-26 06:19:35,520][123090] Updated weights for policy 1, policy_version 837894 (0.0009) [2023-12-26 06:19:35,585][123090] Updated weights for policy 1, policy_version 837904 (0.0008) [2023-12-26 06:19:35,647][123090] Updated weights for policy 1, policy_version 837914 (0.0009) [2023-12-26 06:19:35,968][123091] Updated weights for policy 0, policy_version 843733 (0.0010) [2023-12-26 06:19:36,026][123091] Updated weights for policy 0, policy_version 843743 (0.0009) [2023-12-26 06:19:36,084][123091] Updated weights for policy 0, policy_version 843753 (0.0009) [2023-12-26 06:19:36,501][123090] Updated weights for policy 1, policy_version 837924 (0.0008) [2023-12-26 06:19:36,562][123090] Updated weights for policy 1, policy_version 837934 (0.0010) [2023-12-26 06:19:36,632][123090] Updated weights for policy 1, policy_version 837944 (0.0009) [2023-12-26 06:19:36,864][123091] Updated weights for policy 0, policy_version 843763 (0.0009) [2023-12-26 06:19:36,925][123091] Updated weights for policy 0, policy_version 843773 (0.0010) [2023-12-26 06:19:36,985][123091] Updated weights for policy 0, policy_version 843783 (0.0010) [2023-12-26 06:19:37,488][123090] Updated weights for policy 1, policy_version 837954 (0.0010) [2023-12-26 06:19:37,540][123090] Updated weights for policy 1, policy_version 837964 (0.0009) [2023-12-26 06:19:37,600][123090] Updated weights for policy 1, policy_version 837974 (0.0005) [2023-12-26 06:19:37,664][123090] Updated weights for policy 1, policy_version 837984 (0.0007) [2023-12-26 06:19:37,824][123091] Updated weights for policy 0, policy_version 843793 (0.0010) [2023-12-26 06:19:37,880][123091] Updated weights for policy 0, policy_version 843803 (0.0010) [2023-12-26 06:19:37,938][123091] Updated weights for policy 0, policy_version 843813 (0.0009) [2023-12-26 06:19:37,995][123091] Updated weights for policy 0, policy_version 843823 (0.0009) [2023-12-26 06:19:38,508][123090] Updated weights for policy 1, policy_version 837994 (0.0006) [2023-12-26 06:19:38,583][123090] Updated weights for policy 1, policy_version 838004 (0.0006) [2023-12-26 06:19:38,645][123090] Updated weights for policy 1, policy_version 838014 (0.0010) [2023-12-26 06:19:38,759][123091] Updated weights for policy 0, policy_version 843833 (0.0010) [2023-12-26 06:19:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 430555136. Throughput: 0: 8828.8, 1: 8625.5. Samples: 430532676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:19:38,785][121949] Avg episode reward: [(0, '6209.291'), (1, '5719.139')] [2023-12-26 06:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000838016_214532096.pth... [2023-12-26 06:19:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000836992_214269952.pth [2023-12-26 06:19:38,825][123091] Updated weights for policy 0, policy_version 843843 (0.0008) [2023-12-26 06:19:38,889][123091] Updated weights for policy 0, policy_version 843853 (0.0009) [2023-12-26 06:19:38,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000843856_216031232.pth... [2023-12-26 06:19:38,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000842832_215769088.pth [2023-12-26 06:19:39,480][123090] Updated weights for policy 1, policy_version 838024 (0.0007) [2023-12-26 06:19:39,541][123090] Updated weights for policy 1, policy_version 838034 (0.0006) [2023-12-26 06:19:39,604][123090] Updated weights for policy 1, policy_version 838044 (0.0006) [2023-12-26 06:19:39,756][123091] Updated weights for policy 0, policy_version 843863 (0.0009) [2023-12-26 06:19:39,823][123091] Updated weights for policy 0, policy_version 843873 (0.0010) [2023-12-26 06:19:39,895][123091] Updated weights for policy 0, policy_version 843883 (0.0009) [2023-12-26 06:19:40,367][123090] Updated weights for policy 1, policy_version 838054 (0.0009) [2023-12-26 06:19:40,432][123090] Updated weights for policy 1, policy_version 838064 (0.0011) [2023-12-26 06:19:40,502][123090] Updated weights for policy 1, policy_version 838074 (0.0011) [2023-12-26 06:19:40,784][123091] Updated weights for policy 0, policy_version 843893 (0.0009) [2023-12-26 06:19:40,833][123091] Updated weights for policy 0, policy_version 843903 (0.0009) [2023-12-26 06:19:40,882][123091] Updated weights for policy 0, policy_version 843913 (0.0009) [2023-12-26 06:19:41,359][123090] Updated weights for policy 1, policy_version 838084 (0.0010) [2023-12-26 06:19:41,431][123090] Updated weights for policy 1, policy_version 838094 (0.0008) [2023-12-26 06:19:41,494][123090] Updated weights for policy 1, policy_version 838104 (0.0008) [2023-12-26 06:19:41,763][123091] Updated weights for policy 0, policy_version 843923 (0.0009) [2023-12-26 06:19:41,834][123091] Updated weights for policy 0, policy_version 843933 (0.0010) [2023-12-26 06:19:41,897][123091] Updated weights for policy 0, policy_version 843943 (0.0010) [2023-12-26 06:19:42,219][123090] Updated weights for policy 1, policy_version 838114 (0.0009) [2023-12-26 06:19:42,284][123090] Updated weights for policy 1, policy_version 838124 (0.0010) [2023-12-26 06:19:42,349][123090] Updated weights for policy 1, policy_version 838134 (0.0011) [2023-12-26 06:19:42,409][123090] Updated weights for policy 1, policy_version 838144 (0.0011) [2023-12-26 06:19:42,773][123091] Updated weights for policy 0, policy_version 843953 (0.0009) [2023-12-26 06:19:42,825][123091] Updated weights for policy 0, policy_version 843963 (0.0010) [2023-12-26 06:19:42,881][123091] Updated weights for policy 0, policy_version 843973 (0.0010) [2023-12-26 06:19:42,936][123091] Updated weights for policy 0, policy_version 843983 (0.0009) [2023-12-26 06:19:43,214][123090] Updated weights for policy 1, policy_version 838154 (0.0005) [2023-12-26 06:19:43,261][123090] Updated weights for policy 1, policy_version 838164 (0.0005) [2023-12-26 06:19:43,309][123090] Updated weights for policy 1, policy_version 838174 (0.0005) [2023-12-26 06:19:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 430637056. Throughput: 0: 8684.6, 1: 8675.4. Samples: 430634364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:19:43,785][121949] Avg episode reward: [(0, '6177.398'), (1, '5620.431')] [2023-12-26 06:19:43,828][123091] Updated weights for policy 0, policy_version 843993 (0.0010) [2023-12-26 06:19:43,888][123091] Updated weights for policy 0, policy_version 844003 (0.0009) [2023-12-26 06:19:43,940][123091] Updated weights for policy 0, policy_version 844014 (0.0010) [2023-12-26 06:19:44,051][123090] Updated weights for policy 1, policy_version 838184 (0.0009) [2023-12-26 06:19:44,115][123090] Updated weights for policy 1, policy_version 838194 (0.0009) [2023-12-26 06:19:44,181][123090] Updated weights for policy 1, policy_version 838204 (0.0009) [2023-12-26 06:19:44,792][123091] Updated weights for policy 0, policy_version 844024 (0.0008) [2023-12-26 06:19:44,851][123091] Updated weights for policy 0, policy_version 844034 (0.0009) [2023-12-26 06:19:44,920][123091] Updated weights for policy 0, policy_version 844044 (0.0009) [2023-12-26 06:19:44,972][123090] Updated weights for policy 1, policy_version 838214 (0.0010) [2023-12-26 06:19:45,031][123090] Updated weights for policy 1, policy_version 838224 (0.0006) [2023-12-26 06:19:45,092][123090] Updated weights for policy 1, policy_version 838234 (0.0008) [2023-12-26 06:19:45,759][123091] Updated weights for policy 0, policy_version 844054 (0.0009) [2023-12-26 06:19:45,831][123091] Updated weights for policy 0, policy_version 844064 (0.0010) [2023-12-26 06:19:45,885][123090] Updated weights for policy 1, policy_version 838244 (0.0010) [2023-12-26 06:19:45,891][123091] Updated weights for policy 0, policy_version 844074 (0.0009) [2023-12-26 06:19:45,940][123090] Updated weights for policy 1, policy_version 838254 (0.0008) [2023-12-26 06:19:45,996][123090] Updated weights for policy 1, policy_version 838264 (0.0009) [2023-12-26 06:19:46,720][123091] Updated weights for policy 0, policy_version 844084 (0.0009) [2023-12-26 06:19:46,783][123091] Updated weights for policy 0, policy_version 844094 (0.0010) [2023-12-26 06:19:46,828][123091] Updated weights for policy 0, policy_version 844104 (0.0007) [2023-12-26 06:19:46,840][123090] Updated weights for policy 1, policy_version 838274 (0.0009) [2023-12-26 06:19:46,890][123090] Updated weights for policy 1, policy_version 838284 (0.0009) [2023-12-26 06:19:46,952][123090] Updated weights for policy 1, policy_version 838294 (0.0010) [2023-12-26 06:19:47,011][123090] Updated weights for policy 1, policy_version 838304 (0.0010) [2023-12-26 06:19:47,517][123091] Updated weights for policy 0, policy_version 844114 (0.0006) [2023-12-26 06:19:47,582][123091] Updated weights for policy 0, policy_version 844124 (0.0005) [2023-12-26 06:19:47,639][123091] Updated weights for policy 0, policy_version 844134 (0.0005) [2023-12-26 06:19:47,711][123091] Updated weights for policy 0, policy_version 844144 (0.0005) [2023-12-26 06:19:47,908][123090] Updated weights for policy 1, policy_version 838314 (0.0005) [2023-12-26 06:19:47,964][123090] Updated weights for policy 1, policy_version 838324 (0.0008) [2023-12-26 06:19:48,025][123090] Updated weights for policy 1, policy_version 838334 (0.0009) [2023-12-26 06:19:48,331][123091] Updated weights for policy 0, policy_version 844154 (0.0006) [2023-12-26 06:19:48,386][123091] Updated weights for policy 0, policy_version 844164 (0.0007) [2023-12-26 06:19:48,450][123091] Updated weights for policy 0, policy_version 844174 (0.0007) [2023-12-26 06:19:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 430727168. Throughput: 0: 8676.7, 1: 8753.1. Samples: 430741048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:19:48,785][121949] Avg episode reward: [(0, '6056.366'), (1, '5817.229')] [2023-12-26 06:19:48,840][123090] Updated weights for policy 1, policy_version 838344 (0.0010) [2023-12-26 06:19:48,898][123090] Updated weights for policy 1, policy_version 838354 (0.0011) [2023-12-26 06:19:48,950][123090] Updated weights for policy 1, policy_version 838364 (0.0010) [2023-12-26 06:19:49,149][123091] Updated weights for policy 0, policy_version 844184 (0.0006) [2023-12-26 06:19:49,218][123091] Updated weights for policy 0, policy_version 844194 (0.0007) [2023-12-26 06:19:49,282][123091] Updated weights for policy 0, policy_version 844204 (0.0011) [2023-12-26 06:19:49,811][123090] Updated weights for policy 1, policy_version 838374 (0.0008) [2023-12-26 06:19:49,880][123090] Updated weights for policy 1, policy_version 838384 (0.0008) [2023-12-26 06:19:49,953][123090] Updated weights for policy 1, policy_version 838394 (0.0008) [2023-12-26 06:19:50,053][123091] Updated weights for policy 0, policy_version 844214 (0.0007) [2023-12-26 06:19:50,128][123091] Updated weights for policy 0, policy_version 844224 (0.0006) [2023-12-26 06:19:50,190][123091] Updated weights for policy 0, policy_version 844234 (0.0008) [2023-12-26 06:19:50,619][123090] Updated weights for policy 1, policy_version 838404 (0.0010) [2023-12-26 06:19:50,673][123090] Updated weights for policy 1, policy_version 838414 (0.0007) [2023-12-26 06:19:50,729][123090] Updated weights for policy 1, policy_version 838424 (0.0008) [2023-12-26 06:19:51,009][123091] Updated weights for policy 0, policy_version 844244 (0.0009) [2023-12-26 06:19:51,083][123091] Updated weights for policy 0, policy_version 844254 (0.0008) [2023-12-26 06:19:51,144][123091] Updated weights for policy 0, policy_version 844264 (0.0007) [2023-12-26 06:19:51,573][123090] Updated weights for policy 1, policy_version 838434 (0.0010) [2023-12-26 06:19:51,638][123090] Updated weights for policy 1, policy_version 838445 (0.0008) [2023-12-26 06:19:51,693][123090] Updated weights for policy 1, policy_version 838455 (0.0009) [2023-12-26 06:19:51,946][123091] Updated weights for policy 0, policy_version 844274 (0.0009) [2023-12-26 06:19:52,015][123091] Updated weights for policy 0, policy_version 844284 (0.0009) [2023-12-26 06:19:52,081][123091] Updated weights for policy 0, policy_version 844294 (0.0010) [2023-12-26 06:19:52,149][123091] Updated weights for policy 0, policy_version 844304 (0.0007) [2023-12-26 06:19:52,457][123090] Updated weights for policy 1, policy_version 838465 (0.0009) [2023-12-26 06:19:52,522][123090] Updated weights for policy 1, policy_version 838475 (0.0008) [2023-12-26 06:19:52,592][123090] Updated weights for policy 1, policy_version 838485 (0.0008) [2023-12-26 06:19:52,664][123090] Updated weights for policy 1, policy_version 838495 (0.0006) [2023-12-26 06:19:52,811][123091] Updated weights for policy 0, policy_version 844314 (0.0005) [2023-12-26 06:19:52,884][123091] Updated weights for policy 0, policy_version 844324 (0.0006) [2023-12-26 06:19:52,945][123091] Updated weights for policy 0, policy_version 844334 (0.0009) [2023-12-26 06:19:53,338][123090] Updated weights for policy 1, policy_version 838505 (0.0005) [2023-12-26 06:19:53,416][123090] Updated weights for policy 1, policy_version 838515 (0.0005) [2023-12-26 06:19:53,487][123090] Updated weights for policy 1, policy_version 838525 (0.0005) [2023-12-26 06:19:53,571][123091] Updated weights for policy 0, policy_version 844345 (0.0009) [2023-12-26 06:19:53,627][123091] Updated weights for policy 0, policy_version 844355 (0.0010) [2023-12-26 06:19:53,684][123091] Updated weights for policy 0, policy_version 844365 (0.0009) [2023-12-26 06:19:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 430825472. Throughput: 0: 8689.6, 1: 8723.8. Samples: 430793664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:19:53,785][121949] Avg episode reward: [(0, '6062.694'), (1, '5945.846')] [2023-12-26 06:19:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000844368_216162304.pth... [2023-12-26 06:19:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000838528_214663168.pth... [2023-12-26 06:19:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000843312_215891968.pth [2023-12-26 06:19:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000837504_214401024.pth [2023-12-26 06:19:54,076][123090] Updated weights for policy 1, policy_version 838535 (0.0005) [2023-12-26 06:19:54,143][123090] Updated weights for policy 1, policy_version 838545 (0.0008) [2023-12-26 06:19:54,214][123090] Updated weights for policy 1, policy_version 838555 (0.0009) [2023-12-26 06:19:54,410][123091] Updated weights for policy 0, policy_version 844375 (0.0009) [2023-12-26 06:19:54,472][123091] Updated weights for policy 0, policy_version 844385 (0.0010) [2023-12-26 06:19:54,541][123091] Updated weights for policy 0, policy_version 844395 (0.0011) [2023-12-26 06:19:55,042][123090] Updated weights for policy 1, policy_version 838565 (0.0007) [2023-12-26 06:19:55,103][123090] Updated weights for policy 1, policy_version 838575 (0.0009) [2023-12-26 06:19:55,155][123090] Updated weights for policy 1, policy_version 838585 (0.0006) [2023-12-26 06:19:55,266][123091] Updated weights for policy 0, policy_version 844405 (0.0010) [2023-12-26 06:19:55,336][123091] Updated weights for policy 0, policy_version 844415 (0.0009) [2023-12-26 06:19:55,397][123091] Updated weights for policy 0, policy_version 844425 (0.0008) [2023-12-26 06:19:55,965][123090] Updated weights for policy 1, policy_version 838595 (0.0010) [2023-12-26 06:19:56,019][123090] Updated weights for policy 1, policy_version 838606 (0.0010) [2023-12-26 06:19:56,072][123090] Updated weights for policy 1, policy_version 838616 (0.0010) [2023-12-26 06:19:56,110][123091] Updated weights for policy 0, policy_version 844435 (0.0009) [2023-12-26 06:19:56,168][123091] Updated weights for policy 0, policy_version 844445 (0.0008) [2023-12-26 06:19:56,228][123091] Updated weights for policy 0, policy_version 844455 (0.0008) [2023-12-26 06:19:56,939][123090] Updated weights for policy 1, policy_version 838626 (0.0009) [2023-12-26 06:19:56,993][123090] Updated weights for policy 1, policy_version 838636 (0.0009) [2023-12-26 06:19:57,001][123091] Updated weights for policy 0, policy_version 844465 (0.0005) [2023-12-26 06:19:57,046][123090] Updated weights for policy 1, policy_version 838646 (0.0008) [2023-12-26 06:19:57,053][123091] Updated weights for policy 0, policy_version 844475 (0.0007) [2023-12-26 06:19:57,101][123090] Updated weights for policy 1, policy_version 838656 (0.0009) [2023-12-26 06:19:57,106][123091] Updated weights for policy 0, policy_version 844485 (0.0007) [2023-12-26 06:19:57,160][123091] Updated weights for policy 0, policy_version 844496 (0.0010) [2023-12-26 06:19:57,809][123090] Updated weights for policy 1, policy_version 838666 (0.0005) [2023-12-26 06:19:57,857][123090] Updated weights for policy 1, policy_version 838676 (0.0005) [2023-12-26 06:19:57,916][123090] Updated weights for policy 1, policy_version 838686 (0.0005) [2023-12-26 06:19:58,060][123091] Updated weights for policy 0, policy_version 844506 (0.0011) [2023-12-26 06:19:58,131][123091] Updated weights for policy 0, policy_version 844516 (0.0011) [2023-12-26 06:19:58,194][123091] Updated weights for policy 0, policy_version 844526 (0.0011) [2023-12-26 06:19:58,721][123090] Updated weights for policy 1, policy_version 838696 (0.0008) [2023-12-26 06:19:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 430907392. Throughput: 0: 8839.5, 1: 8841.7. Samples: 430906336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:19:58,784][121949] Avg episode reward: [(0, '6145.544'), (1, '5990.268')] [2023-12-26 06:19:58,795][123090] Updated weights for policy 1, policy_version 838706 (0.0007) [2023-12-26 06:19:58,848][123090] Updated weights for policy 1, policy_version 838716 (0.0006) [2023-12-26 06:19:59,133][123091] Updated weights for policy 0, policy_version 844536 (0.0010) [2023-12-26 06:19:59,187][123091] Updated weights for policy 0, policy_version 844546 (0.0010) [2023-12-26 06:19:59,250][123091] Updated weights for policy 0, policy_version 844556 (0.0010) [2023-12-26 06:19:59,658][123090] Updated weights for policy 1, policy_version 838726 (0.0009) [2023-12-26 06:19:59,728][123090] Updated weights for policy 1, policy_version 838736 (0.0010) [2023-12-26 06:19:59,775][123090] Updated weights for policy 1, policy_version 838746 (0.0010) [2023-12-26 06:20:00,178][123091] Updated weights for policy 0, policy_version 844566 (0.0009) [2023-12-26 06:20:00,240][123091] Updated weights for policy 0, policy_version 844576 (0.0009) [2023-12-26 06:20:00,300][123091] Updated weights for policy 0, policy_version 844586 (0.0008) [2023-12-26 06:20:00,618][123090] Updated weights for policy 1, policy_version 838756 (0.0010) [2023-12-26 06:20:00,672][123090] Updated weights for policy 1, policy_version 838766 (0.0010) [2023-12-26 06:20:00,730][123090] Updated weights for policy 1, policy_version 838776 (0.0010) [2023-12-26 06:20:01,089][123091] Updated weights for policy 0, policy_version 844596 (0.0008) [2023-12-26 06:20:01,168][123091] Updated weights for policy 0, policy_version 844606 (0.0009) [2023-12-26 06:20:01,242][123091] Updated weights for policy 0, policy_version 844616 (0.0009) [2023-12-26 06:20:01,557][123090] Updated weights for policy 1, policy_version 838786 (0.0009) [2023-12-26 06:20:01,630][123090] Updated weights for policy 1, policy_version 838796 (0.0007) [2023-12-26 06:20:01,695][123090] Updated weights for policy 1, policy_version 838806 (0.0008) [2023-12-26 06:20:01,759][123090] Updated weights for policy 1, policy_version 838816 (0.0008) [2023-12-26 06:20:02,064][123091] Updated weights for policy 0, policy_version 844626 (0.0009) [2023-12-26 06:20:02,134][123091] Updated weights for policy 0, policy_version 844636 (0.0011) [2023-12-26 06:20:02,195][123091] Updated weights for policy 0, policy_version 844646 (0.0010) [2023-12-26 06:20:02,269][123091] Updated weights for policy 0, policy_version 844656 (0.0009) [2023-12-26 06:20:02,492][123090] Updated weights for policy 1, policy_version 838826 (0.0009) [2023-12-26 06:20:02,542][123090] Updated weights for policy 1, policy_version 838836 (0.0009) [2023-12-26 06:20:02,599][123090] Updated weights for policy 1, policy_version 838846 (0.0006) [2023-12-26 06:20:03,068][123091] Updated weights for policy 0, policy_version 844666 (0.0009) [2023-12-26 06:20:03,118][123091] Updated weights for policy 0, policy_version 844676 (0.0008) [2023-12-26 06:20:03,170][123091] Updated weights for policy 0, policy_version 844686 (0.0005) [2023-12-26 06:20:03,248][123090] Updated weights for policy 1, policy_version 838856 (0.0005) [2023-12-26 06:20:03,305][123090] Updated weights for policy 1, policy_version 838866 (0.0008) [2023-12-26 06:20:03,367][123090] Updated weights for policy 1, policy_version 838876 (0.0009) [2023-12-26 06:20:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 430997504. Throughput: 0: 8719.1, 1: 8785.3. Samples: 431010376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:03,785][121949] Avg episode reward: [(0, '6175.947'), (1, '5998.101')] [2023-12-26 06:20:03,854][123091] Updated weights for policy 0, policy_version 844696 (0.0007) [2023-12-26 06:20:03,917][123091] Updated weights for policy 0, policy_version 844706 (0.0006) [2023-12-26 06:20:03,975][123091] Updated weights for policy 0, policy_version 844716 (0.0006) [2023-12-26 06:20:04,240][123090] Updated weights for policy 1, policy_version 838886 (0.0009) [2023-12-26 06:20:04,297][123090] Updated weights for policy 1, policy_version 838896 (0.0009) [2023-12-26 06:20:04,358][123090] Updated weights for policy 1, policy_version 838906 (0.0009) [2023-12-26 06:20:04,726][123091] Updated weights for policy 0, policy_version 844726 (0.0005) [2023-12-26 06:20:04,790][123091] Updated weights for policy 0, policy_version 844736 (0.0006) [2023-12-26 06:20:04,855][123091] Updated weights for policy 0, policy_version 844746 (0.0005) [2023-12-26 06:20:05,280][123090] Updated weights for policy 1, policy_version 838916 (0.0009) [2023-12-26 06:20:05,343][123090] Updated weights for policy 1, policy_version 838926 (0.0010) [2023-12-26 06:20:05,413][123090] Updated weights for policy 1, policy_version 838936 (0.0009) [2023-12-26 06:20:05,416][123091] Updated weights for policy 0, policy_version 844756 (0.0005) [2023-12-26 06:20:05,464][123091] Updated weights for policy 0, policy_version 844766 (0.0005) [2023-12-26 06:20:05,515][123091] Updated weights for policy 0, policy_version 844776 (0.0005) [2023-12-26 06:20:06,220][123090] Updated weights for policy 1, policy_version 838946 (0.0009) [2023-12-26 06:20:06,279][123090] Updated weights for policy 1, policy_version 838956 (0.0009) [2023-12-26 06:20:06,338][123091] Updated weights for policy 0, policy_version 844786 (0.0006) [2023-12-26 06:20:06,342][123090] Updated weights for policy 1, policy_version 838966 (0.0009) [2023-12-26 06:20:06,401][123090] Updated weights for policy 1, policy_version 838976 (0.0005) [2023-12-26 06:20:06,404][123091] Updated weights for policy 0, policy_version 844796 (0.0010) [2023-12-26 06:20:06,458][123091] Updated weights for policy 0, policy_version 844806 (0.0010) [2023-12-26 06:20:06,518][123091] Updated weights for policy 0, policy_version 844816 (0.0009) [2023-12-26 06:20:07,266][123090] Updated weights for policy 1, policy_version 838986 (0.0010) [2023-12-26 06:20:07,331][123090] Updated weights for policy 1, policy_version 838996 (0.0009) [2023-12-26 06:20:07,340][123091] Updated weights for policy 0, policy_version 844826 (0.0005) [2023-12-26 06:20:07,398][123090] Updated weights for policy 1, policy_version 839006 (0.0008) [2023-12-26 06:20:07,402][123091] Updated weights for policy 0, policy_version 844836 (0.0005) [2023-12-26 06:20:07,470][123091] Updated weights for policy 0, policy_version 844846 (0.0005) [2023-12-26 06:20:08,207][123091] Updated weights for policy 0, policy_version 844856 (0.0008) [2023-12-26 06:20:08,264][123090] Updated weights for policy 1, policy_version 839016 (0.0009) [2023-12-26 06:20:08,271][123091] Updated weights for policy 0, policy_version 844866 (0.0007) [2023-12-26 06:20:08,327][123090] Updated weights for policy 1, policy_version 839026 (0.0008) [2023-12-26 06:20:08,344][123091] Updated weights for policy 0, policy_version 844876 (0.0010) [2023-12-26 06:20:08,387][123090] Updated weights for policy 1, policy_version 839036 (0.0008) [2023-12-26 06:20:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 431087616. Throughput: 0: 8824.0, 1: 8736.0. Samples: 431063540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:08,785][121949] Avg episode reward: [(0, '6079.634'), (1, '5906.368')] [2023-12-26 06:20:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000844880_216293376.pth... [2023-12-26 06:20:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000839040_214794240.pth... [2023-12-26 06:20:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000843856_216031232.pth [2023-12-26 06:20:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000838016_214532096.pth [2023-12-26 06:20:09,109][123091] Updated weights for policy 0, policy_version 844886 (0.0010) [2023-12-26 06:20:09,162][123091] Updated weights for policy 0, policy_version 844896 (0.0010) [2023-12-26 06:20:09,219][123091] Updated weights for policy 0, policy_version 844906 (0.0009) [2023-12-26 06:20:09,224][123090] Updated weights for policy 1, policy_version 839046 (0.0009) [2023-12-26 06:20:09,288][123090] Updated weights for policy 1, policy_version 839056 (0.0006) [2023-12-26 06:20:09,372][123090] Updated weights for policy 1, policy_version 839066 (0.0009) [2023-12-26 06:20:10,122][123091] Updated weights for policy 0, policy_version 844916 (0.0010) [2023-12-26 06:20:10,179][123090] Updated weights for policy 1, policy_version 839076 (0.0008) [2023-12-26 06:20:10,196][123091] Updated weights for policy 0, policy_version 844926 (0.0009) [2023-12-26 06:20:10,241][123090] Updated weights for policy 1, policy_version 839086 (0.0007) [2023-12-26 06:20:10,262][123091] Updated weights for policy 0, policy_version 844936 (0.0008) [2023-12-26 06:20:10,312][123090] Updated weights for policy 1, policy_version 839096 (0.0007) [2023-12-26 06:20:10,998][123090] Updated weights for policy 1, policy_version 839106 (0.0008) [2023-12-26 06:20:11,076][123090] Updated weights for policy 1, policy_version 839116 (0.0009) [2023-12-26 06:20:11,086][123091] Updated weights for policy 0, policy_version 844946 (0.0009) [2023-12-26 06:20:11,143][123090] Updated weights for policy 1, policy_version 839126 (0.0009) [2023-12-26 06:20:11,160][123091] Updated weights for policy 0, policy_version 844956 (0.0008) [2023-12-26 06:20:11,207][123090] Updated weights for policy 1, policy_version 839136 (0.0008) [2023-12-26 06:20:11,215][123091] Updated weights for policy 0, policy_version 844966 (0.0007) [2023-12-26 06:20:11,282][123091] Updated weights for policy 0, policy_version 844976 (0.0010) [2023-12-26 06:20:12,072][123090] Updated weights for policy 1, policy_version 839146 (0.0009) [2023-12-26 06:20:12,116][123091] Updated weights for policy 0, policy_version 844986 (0.0008) [2023-12-26 06:20:12,139][123090] Updated weights for policy 1, policy_version 839156 (0.0009) [2023-12-26 06:20:12,181][123091] Updated weights for policy 0, policy_version 844996 (0.0008) [2023-12-26 06:20:12,209][123090] Updated weights for policy 1, policy_version 839166 (0.0009) [2023-12-26 06:20:12,254][123091] Updated weights for policy 0, policy_version 845006 (0.0008) [2023-12-26 06:20:13,033][123090] Updated weights for policy 1, policy_version 839176 (0.0010) [2023-12-26 06:20:13,100][123090] Updated weights for policy 1, policy_version 839186 (0.0007) [2023-12-26 06:20:13,105][123091] Updated weights for policy 0, policy_version 845016 (0.0008) [2023-12-26 06:20:13,155][123091] Updated weights for policy 0, policy_version 845026 (0.0006) [2023-12-26 06:20:13,165][123090] Updated weights for policy 1, policy_version 839196 (0.0008) [2023-12-26 06:20:13,216][123091] Updated weights for policy 0, policy_version 845036 (0.0006) [2023-12-26 06:20:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 431169536. Throughput: 0: 8833.8, 1: 8706.0. Samples: 431166832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:13,785][121949] Avg episode reward: [(0, '6152.967'), (1, '5911.377')] [2023-12-26 06:20:13,828][123091] Updated weights for policy 0, policy_version 845046 (0.0005) [2023-12-26 06:20:13,884][123091] Updated weights for policy 0, policy_version 845056 (0.0005) [2023-12-26 06:20:13,946][123091] Updated weights for policy 0, policy_version 845066 (0.0006) [2023-12-26 06:20:13,953][123090] Updated weights for policy 1, policy_version 839206 (0.0008) [2023-12-26 06:20:14,003][123090] Updated weights for policy 1, policy_version 839216 (0.0009) [2023-12-26 06:20:14,056][123090] Updated weights for policy 1, policy_version 839227 (0.0009) [2023-12-26 06:20:14,620][123091] Updated weights for policy 0, policy_version 845076 (0.0005) [2023-12-26 06:20:14,674][123091] Updated weights for policy 0, policy_version 845087 (0.0007) [2023-12-26 06:20:14,723][123091] Updated weights for policy 0, policy_version 845097 (0.0006) [2023-12-26 06:20:14,819][123090] Updated weights for policy 1, policy_version 839237 (0.0009) [2023-12-26 06:20:14,888][123090] Updated weights for policy 1, policy_version 839247 (0.0008) [2023-12-26 06:20:14,965][123090] Updated weights for policy 1, policy_version 839257 (0.0005) [2023-12-26 06:20:15,519][123091] Updated weights for policy 0, policy_version 845107 (0.0008) [2023-12-26 06:20:15,578][123091] Updated weights for policy 0, policy_version 845117 (0.0011) [2023-12-26 06:20:15,634][123091] Updated weights for policy 0, policy_version 845127 (0.0010) [2023-12-26 06:20:15,781][123090] Updated weights for policy 1, policy_version 839267 (0.0008) [2023-12-26 06:20:15,845][123090] Updated weights for policy 1, policy_version 839277 (0.0010) [2023-12-26 06:20:15,903][123090] Updated weights for policy 1, policy_version 839287 (0.0009) [2023-12-26 06:20:16,325][123091] Updated weights for policy 0, policy_version 845137 (0.0010) [2023-12-26 06:20:16,377][123091] Updated weights for policy 0, policy_version 845147 (0.0005) [2023-12-26 06:20:16,436][123091] Updated weights for policy 0, policy_version 845157 (0.0008) [2023-12-26 06:20:16,490][123091] Updated weights for policy 0, policy_version 845167 (0.0009) [2023-12-26 06:20:16,816][123090] Updated weights for policy 1, policy_version 839297 (0.0009) [2023-12-26 06:20:16,883][123090] Updated weights for policy 1, policy_version 839307 (0.0010) [2023-12-26 06:20:16,944][123090] Updated weights for policy 1, policy_version 839317 (0.0010) [2023-12-26 06:20:16,996][123090] Updated weights for policy 1, policy_version 839327 (0.0008) [2023-12-26 06:20:17,292][123091] Updated weights for policy 0, policy_version 845177 (0.0008) [2023-12-26 06:20:17,347][123091] Updated weights for policy 0, policy_version 845187 (0.0005) [2023-12-26 06:20:17,404][123091] Updated weights for policy 0, policy_version 845197 (0.0005) [2023-12-26 06:20:17,898][123090] Updated weights for policy 1, policy_version 839337 (0.0010) [2023-12-26 06:20:17,950][123090] Updated weights for policy 1, policy_version 839347 (0.0009) [2023-12-26 06:20:18,010][123090] Updated weights for policy 1, policy_version 839357 (0.0009) [2023-12-26 06:20:18,144][123091] Updated weights for policy 0, policy_version 845207 (0.0008) [2023-12-26 06:20:18,191][123091] Updated weights for policy 0, policy_version 845217 (0.0008) [2023-12-26 06:20:18,240][123091] Updated weights for policy 0, policy_version 845227 (0.0009) [2023-12-26 06:20:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 431259648. Throughput: 0: 8966.1, 1: 8698.3. Samples: 431275612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:18,785][121949] Avg episode reward: [(0, '6148.245'), (1, '5961.897')] [2023-12-26 06:20:18,863][123091] Updated weights for policy 0, policy_version 845237 (0.0009) [2023-12-26 06:20:18,910][123090] Updated weights for policy 1, policy_version 839367 (0.0009) [2023-12-26 06:20:18,933][123091] Updated weights for policy 0, policy_version 845247 (0.0009) [2023-12-26 06:20:18,959][123090] Updated weights for policy 1, policy_version 839377 (0.0008) [2023-12-26 06:20:18,999][123091] Updated weights for policy 0, policy_version 845257 (0.0008) [2023-12-26 06:20:19,020][123090] Updated weights for policy 1, policy_version 839387 (0.0008) [2023-12-26 06:20:19,877][123090] Updated weights for policy 1, policy_version 839397 (0.0008) [2023-12-26 06:20:19,880][123091] Updated weights for policy 0, policy_version 845267 (0.0010) [2023-12-26 06:20:19,942][123091] Updated weights for policy 0, policy_version 845277 (0.0011) [2023-12-26 06:20:19,946][123090] Updated weights for policy 1, policy_version 839407 (0.0008) [2023-12-26 06:20:20,002][123091] Updated weights for policy 0, policy_version 845287 (0.0011) [2023-12-26 06:20:20,010][123090] Updated weights for policy 1, policy_version 839417 (0.0006) [2023-12-26 06:20:20,832][123091] Updated weights for policy 0, policy_version 845297 (0.0011) [2023-12-26 06:20:20,848][123090] Updated weights for policy 1, policy_version 839427 (0.0006) [2023-12-26 06:20:20,892][123091] Updated weights for policy 0, policy_version 845307 (0.0011) [2023-12-26 06:20:20,913][123090] Updated weights for policy 1, policy_version 839437 (0.0006) [2023-12-26 06:20:20,960][123091] Updated weights for policy 0, policy_version 845317 (0.0009) [2023-12-26 06:20:20,974][123090] Updated weights for policy 1, policy_version 839447 (0.0009) [2023-12-26 06:20:21,018][123091] Updated weights for policy 0, policy_version 845327 (0.0006) [2023-12-26 06:20:21,837][123091] Updated weights for policy 0, policy_version 845337 (0.0007) [2023-12-26 06:20:21,860][123090] Updated weights for policy 1, policy_version 839457 (0.0009) [2023-12-26 06:20:21,900][123091] Updated weights for policy 0, policy_version 845347 (0.0006) [2023-12-26 06:20:21,923][123090] Updated weights for policy 1, policy_version 839467 (0.0006) [2023-12-26 06:20:21,969][123091] Updated weights for policy 0, policy_version 845357 (0.0008) [2023-12-26 06:20:21,991][123090] Updated weights for policy 1, policy_version 839477 (0.0008) [2023-12-26 06:20:22,051][123090] Updated weights for policy 1, policy_version 839487 (0.0010) [2023-12-26 06:20:22,725][123091] Updated weights for policy 0, policy_version 845367 (0.0010) [2023-12-26 06:20:22,776][123090] Updated weights for policy 1, policy_version 839497 (0.0010) [2023-12-26 06:20:22,777][123091] Updated weights for policy 0, policy_version 845377 (0.0010) [2023-12-26 06:20:22,832][123091] Updated weights for policy 0, policy_version 845387 (0.0011) [2023-12-26 06:20:22,839][123090] Updated weights for policy 1, policy_version 839507 (0.0010) [2023-12-26 06:20:22,905][123090] Updated weights for policy 1, policy_version 839517 (0.0010) [2023-12-26 06:20:23,625][123090] Updated weights for policy 1, policy_version 839527 (0.0007) [2023-12-26 06:20:23,660][123091] Updated weights for policy 0, policy_version 845397 (0.0008) [2023-12-26 06:20:23,680][123090] Updated weights for policy 1, policy_version 839537 (0.0005) [2023-12-26 06:20:23,731][123091] Updated weights for policy 0, policy_version 845407 (0.0006) [2023-12-26 06:20:23,735][123090] Updated weights for policy 1, policy_version 839547 (0.0005) [2023-12-26 06:20:23,781][123091] Updated weights for policy 0, policy_version 845417 (0.0009) [2023-12-26 06:20:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 431349760. Throughput: 0: 8925.9, 1: 8696.4. Samples: 431325676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:23,785][121949] Avg episode reward: [(0, '6074.333'), (1, '5900.467')] [2023-12-26 06:20:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000839552_214925312.pth... [2023-12-26 06:20:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000838528_214663168.pth [2023-12-26 06:20:23,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000845424_216432640.pth... [2023-12-26 06:20:23,821][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000844368_216162304.pth [2023-12-26 06:20:24,454][123090] Updated weights for policy 1, policy_version 839557 (0.0006) [2023-12-26 06:20:24,499][123091] Updated weights for policy 0, policy_version 845427 (0.0008) [2023-12-26 06:20:24,514][123090] Updated weights for policy 1, policy_version 839567 (0.0005) [2023-12-26 06:20:24,561][123091] Updated weights for policy 0, policy_version 845437 (0.0005) [2023-12-26 06:20:24,567][123090] Updated weights for policy 1, policy_version 839577 (0.0005) [2023-12-26 06:20:24,614][123091] Updated weights for policy 0, policy_version 845447 (0.0006) [2023-12-26 06:20:25,250][123090] Updated weights for policy 1, policy_version 839587 (0.0005) [2023-12-26 06:20:25,300][123091] Updated weights for policy 0, policy_version 845457 (0.0009) [2023-12-26 06:20:25,310][123090] Updated weights for policy 1, policy_version 839597 (0.0006) [2023-12-26 06:20:25,353][123091] Updated weights for policy 0, policy_version 845467 (0.0009) [2023-12-26 06:20:25,364][123090] Updated weights for policy 1, policy_version 839607 (0.0006) [2023-12-26 06:20:25,404][123091] Updated weights for policy 0, policy_version 845478 (0.0009) [2023-12-26 06:20:25,450][123091] Updated weights for policy 0, policy_version 845488 (0.0005) [2023-12-26 06:20:26,056][123090] Updated weights for policy 1, policy_version 839617 (0.0006) [2023-12-26 06:20:26,118][123090] Updated weights for policy 1, policy_version 839627 (0.0006) [2023-12-26 06:20:26,189][123090] Updated weights for policy 1, policy_version 839637 (0.0006) [2023-12-26 06:20:26,202][123091] Updated weights for policy 0, policy_version 845498 (0.0005) [2023-12-26 06:20:26,250][123090] Updated weights for policy 1, policy_version 839647 (0.0007) [2023-12-26 06:20:26,258][123091] Updated weights for policy 0, policy_version 845508 (0.0005) [2023-12-26 06:20:26,325][123091] Updated weights for policy 0, policy_version 845518 (0.0006) [2023-12-26 06:20:26,898][123090] Updated weights for policy 1, policy_version 839657 (0.0009) [2023-12-26 06:20:26,951][123090] Updated weights for policy 1, policy_version 839667 (0.0005) [2023-12-26 06:20:27,007][123090] Updated weights for policy 1, policy_version 839677 (0.0005) [2023-12-26 06:20:27,009][123091] Updated weights for policy 0, policy_version 845528 (0.0007) [2023-12-26 06:20:27,070][123091] Updated weights for policy 0, policy_version 845538 (0.0006) [2023-12-26 06:20:27,142][123091] Updated weights for policy 0, policy_version 845548 (0.0005) [2023-12-26 06:20:27,652][123090] Updated weights for policy 1, policy_version 839687 (0.0005) [2023-12-26 06:20:27,698][123090] Updated weights for policy 1, policy_version 839697 (0.0005) [2023-12-26 06:20:27,771][123090] Updated weights for policy 1, policy_version 839707 (0.0005) [2023-12-26 06:20:27,807][123091] Updated weights for policy 0, policy_version 845558 (0.0005) [2023-12-26 06:20:27,851][123091] Updated weights for policy 0, policy_version 845568 (0.0005) [2023-12-26 06:20:27,895][123091] Updated weights for policy 0, policy_version 845578 (0.0005) [2023-12-26 06:20:28,442][123090] Updated weights for policy 1, policy_version 839717 (0.0008) [2023-12-26 06:20:28,494][123090] Updated weights for policy 1, policy_version 839727 (0.0009) [2023-12-26 06:20:28,552][123090] Updated weights for policy 1, policy_version 839737 (0.0009) [2023-12-26 06:20:28,643][123091] Updated weights for policy 0, policy_version 845588 (0.0007) [2023-12-26 06:20:28,708][123091] Updated weights for policy 0, policy_version 845598 (0.0008) [2023-12-26 06:20:28,769][123091] Updated weights for policy 0, policy_version 845608 (0.0009) [2023-12-26 06:20:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 431448064. Throughput: 0: 9091.0, 1: 8842.5. Samples: 431441372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:28,785][121949] Avg episode reward: [(0, '6146.489'), (1, '5647.284')] [2023-12-26 06:20:29,336][123090] Updated weights for policy 1, policy_version 839747 (0.0008) [2023-12-26 06:20:29,403][123090] Updated weights for policy 1, policy_version 839757 (0.0007) [2023-12-26 06:20:29,462][123090] Updated weights for policy 1, policy_version 839767 (0.0010) [2023-12-26 06:20:29,622][123091] Updated weights for policy 0, policy_version 845618 (0.0009) [2023-12-26 06:20:29,679][123091] Updated weights for policy 0, policy_version 845628 (0.0009) [2023-12-26 06:20:29,738][123091] Updated weights for policy 0, policy_version 845638 (0.0009) [2023-12-26 06:20:29,794][123091] Updated weights for policy 0, policy_version 845648 (0.0010) [2023-12-26 06:20:30,271][123090] Updated weights for policy 1, policy_version 839777 (0.0010) [2023-12-26 06:20:30,334][123090] Updated weights for policy 1, policy_version 839787 (0.0005) [2023-12-26 06:20:30,396][123090] Updated weights for policy 1, policy_version 839797 (0.0006) [2023-12-26 06:20:30,459][123090] Updated weights for policy 1, policy_version 839807 (0.0005) [2023-12-26 06:20:30,592][123091] Updated weights for policy 0, policy_version 845658 (0.0005) [2023-12-26 06:20:30,655][123091] Updated weights for policy 0, policy_version 845668 (0.0006) [2023-12-26 06:20:30,717][123091] Updated weights for policy 0, policy_version 845678 (0.0010) [2023-12-26 06:20:31,089][123090] Updated weights for policy 1, policy_version 839817 (0.0009) [2023-12-26 06:20:31,157][123090] Updated weights for policy 1, policy_version 839827 (0.0011) [2023-12-26 06:20:31,219][123090] Updated weights for policy 1, policy_version 839837 (0.0010) [2023-12-26 06:20:31,487][123091] Updated weights for policy 0, policy_version 845688 (0.0011) [2023-12-26 06:20:31,549][123091] Updated weights for policy 0, policy_version 845698 (0.0011) [2023-12-26 06:20:31,620][123091] Updated weights for policy 0, policy_version 845708 (0.0011) [2023-12-26 06:20:31,969][123090] Updated weights for policy 1, policy_version 839847 (0.0007) [2023-12-26 06:20:32,039][123090] Updated weights for policy 1, policy_version 839857 (0.0005) [2023-12-26 06:20:32,109][123090] Updated weights for policy 1, policy_version 839867 (0.0006) [2023-12-26 06:20:32,398][123091] Updated weights for policy 0, policy_version 845718 (0.0010) [2023-12-26 06:20:32,456][123091] Updated weights for policy 0, policy_version 845728 (0.0009) [2023-12-26 06:20:32,509][123091] Updated weights for policy 0, policy_version 845738 (0.0008) [2023-12-26 06:20:32,807][123090] Updated weights for policy 1, policy_version 839877 (0.0006) [2023-12-26 06:20:32,863][123090] Updated weights for policy 1, policy_version 839887 (0.0005) [2023-12-26 06:20:32,912][123090] Updated weights for policy 1, policy_version 839897 (0.0005) [2023-12-26 06:20:33,184][123091] Updated weights for policy 0, policy_version 845748 (0.0005) [2023-12-26 06:20:33,238][123091] Updated weights for policy 0, policy_version 845758 (0.0005) [2023-12-26 06:20:33,291][123091] Updated weights for policy 0, policy_version 845768 (0.0005) [2023-12-26 06:20:33,563][123090] Updated weights for policy 1, policy_version 839907 (0.0005) [2023-12-26 06:20:33,612][123090] Updated weights for policy 1, policy_version 839917 (0.0005) [2023-12-26 06:20:33,656][123090] Updated weights for policy 1, policy_version 839927 (0.0005) [2023-12-26 06:20:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 431546368. Throughput: 0: 9145.2, 1: 8973.4. Samples: 431556388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:33,785][121949] Avg episode reward: [(0, '6184.126'), (1, '5698.635')] [2023-12-26 06:20:33,859][123091] Updated weights for policy 0, policy_version 845778 (0.0005) [2023-12-26 06:20:33,908][123091] Updated weights for policy 0, policy_version 845788 (0.0005) [2023-12-26 06:20:33,958][123091] Updated weights for policy 0, policy_version 845798 (0.0006) [2023-12-26 06:20:34,007][123091] Updated weights for policy 0, policy_version 845808 (0.0005) [2023-12-26 06:20:34,337][123090] Updated weights for policy 1, policy_version 839937 (0.0005) [2023-12-26 06:20:34,412][123090] Updated weights for policy 1, policy_version 839947 (0.0007) [2023-12-26 06:20:34,483][123090] Updated weights for policy 1, policy_version 839957 (0.0006) [2023-12-26 06:20:34,564][123090] Updated weights for policy 1, policy_version 839967 (0.0009) [2023-12-26 06:20:34,738][123091] Updated weights for policy 0, policy_version 845818 (0.0007) [2023-12-26 06:20:34,801][123091] Updated weights for policy 0, policy_version 845828 (0.0009) [2023-12-26 06:20:34,870][123091] Updated weights for policy 0, policy_version 845838 (0.0009) [2023-12-26 06:20:35,300][123090] Updated weights for policy 1, policy_version 839977 (0.0006) [2023-12-26 06:20:35,353][123090] Updated weights for policy 1, policy_version 839987 (0.0005) [2023-12-26 06:20:35,401][123090] Updated weights for policy 1, policy_version 839997 (0.0005) [2023-12-26 06:20:35,626][123091] Updated weights for policy 0, policy_version 845848 (0.0008) [2023-12-26 06:20:35,689][123091] Updated weights for policy 0, policy_version 845858 (0.0009) [2023-12-26 06:20:35,738][123091] Updated weights for policy 0, policy_version 845868 (0.0008) [2023-12-26 06:20:36,113][123090] Updated weights for policy 1, policy_version 840007 (0.0006) [2023-12-26 06:20:36,181][123090] Updated weights for policy 1, policy_version 840017 (0.0007) [2023-12-26 06:20:36,249][123090] Updated weights for policy 1, policy_version 840027 (0.0005) [2023-12-26 06:20:36,457][123091] Updated weights for policy 0, policy_version 845878 (0.0007) [2023-12-26 06:20:36,525][123091] Updated weights for policy 0, policy_version 845888 (0.0007) [2023-12-26 06:20:36,604][123091] Updated weights for policy 0, policy_version 845898 (0.0010) [2023-12-26 06:20:37,011][123090] Updated weights for policy 1, policy_version 840037 (0.0010) [2023-12-26 06:20:37,078][123090] Updated weights for policy 1, policy_version 840047 (0.0010) [2023-12-26 06:20:37,142][123090] Updated weights for policy 1, policy_version 840057 (0.0011) [2023-12-26 06:20:37,338][123091] Updated weights for policy 0, policy_version 845908 (0.0007) [2023-12-26 06:20:37,393][123091] Updated weights for policy 0, policy_version 845918 (0.0005) [2023-12-26 06:20:37,463][123091] Updated weights for policy 0, policy_version 845928 (0.0005) [2023-12-26 06:20:37,839][123090] Updated weights for policy 1, policy_version 840067 (0.0009) [2023-12-26 06:20:37,897][123090] Updated weights for policy 1, policy_version 840077 (0.0009) [2023-12-26 06:20:37,956][123090] Updated weights for policy 1, policy_version 840087 (0.0010) [2023-12-26 06:20:38,140][123091] Updated weights for policy 0, policy_version 845938 (0.0005) [2023-12-26 06:20:38,198][123091] Updated weights for policy 0, policy_version 845948 (0.0005) [2023-12-26 06:20:38,248][123091] Updated weights for policy 0, policy_version 845958 (0.0005) [2023-12-26 06:20:38,292][123091] Updated weights for policy 0, policy_version 845968 (0.0005) [2023-12-26 06:20:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 431636480. Throughput: 0: 9189.9, 1: 9033.2. Samples: 431613700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:38,785][121949] Avg episode reward: [(0, '6215.683'), (1, '5906.762')] [2023-12-26 06:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000845968_216571904.pth... [2023-12-26 06:20:38,791][123090] Updated weights for policy 1, policy_version 840097 (0.0007) [2023-12-26 06:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000844880_216293376.pth [2023-12-26 06:20:38,860][123090] Updated weights for policy 1, policy_version 840107 (0.0010) [2023-12-26 06:20:38,916][123090] Updated weights for policy 1, policy_version 840117 (0.0010) [2023-12-26 06:20:38,968][123090] Updated weights for policy 1, policy_version 840127 (0.0009) [2023-12-26 06:20:38,969][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000840128_215072768.pth... [2023-12-26 06:20:38,973][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000839040_214794240.pth [2023-12-26 06:20:39,052][123091] Updated weights for policy 0, policy_version 845978 (0.0005) [2023-12-26 06:20:39,096][123091] Updated weights for policy 0, policy_version 845988 (0.0005) [2023-12-26 06:20:39,146][123091] Updated weights for policy 0, policy_version 845998 (0.0006) [2023-12-26 06:20:39,893][123090] Updated weights for policy 1, policy_version 840137 (0.0010) [2023-12-26 06:20:39,914][123091] Updated weights for policy 0, policy_version 846008 (0.0006) [2023-12-26 06:20:39,957][123090] Updated weights for policy 1, policy_version 840147 (0.0011) [2023-12-26 06:20:39,978][123091] Updated weights for policy 0, policy_version 846018 (0.0008) [2023-12-26 06:20:40,016][123090] Updated weights for policy 1, policy_version 840157 (0.0009) [2023-12-26 06:20:40,039][123091] Updated weights for policy 0, policy_version 846028 (0.0007) [2023-12-26 06:20:40,740][123091] Updated weights for policy 0, policy_version 846038 (0.0009) [2023-12-26 06:20:40,786][123091] Updated weights for policy 0, policy_version 846048 (0.0005) [2023-12-26 06:20:40,853][123091] Updated weights for policy 0, policy_version 846058 (0.0010) [2023-12-26 06:20:40,928][123090] Updated weights for policy 1, policy_version 840167 (0.0010) [2023-12-26 06:20:40,987][123090] Updated weights for policy 1, policy_version 840177 (0.0010) [2023-12-26 06:20:41,046][123090] Updated weights for policy 1, policy_version 840187 (0.0009) [2023-12-26 06:20:41,649][123091] Updated weights for policy 0, policy_version 846068 (0.0010) [2023-12-26 06:20:41,722][123091] Updated weights for policy 0, policy_version 846078 (0.0008) [2023-12-26 06:20:41,784][123091] Updated weights for policy 0, policy_version 846088 (0.0009) [2023-12-26 06:20:41,862][123090] Updated weights for policy 1, policy_version 840197 (0.0010) [2023-12-26 06:20:41,921][123090] Updated weights for policy 1, policy_version 840207 (0.0010) [2023-12-26 06:20:41,975][123090] Updated weights for policy 1, policy_version 840217 (0.0010) [2023-12-26 06:20:42,571][123091] Updated weights for policy 0, policy_version 846098 (0.0010) [2023-12-26 06:20:42,627][123091] Updated weights for policy 0, policy_version 846108 (0.0010) [2023-12-26 06:20:42,681][123091] Updated weights for policy 0, policy_version 846119 (0.0010) [2023-12-26 06:20:42,809][123090] Updated weights for policy 1, policy_version 840227 (0.0008) [2023-12-26 06:20:42,870][123090] Updated weights for policy 1, policy_version 840237 (0.0007) [2023-12-26 06:20:42,939][123090] Updated weights for policy 1, policy_version 840247 (0.0009) [2023-12-26 06:20:43,441][123091] Updated weights for policy 0, policy_version 846129 (0.0009) [2023-12-26 06:20:43,501][123091] Updated weights for policy 0, policy_version 846139 (0.0011) [2023-12-26 06:20:43,561][123091] Updated weights for policy 0, policy_version 846149 (0.0011) [2023-12-26 06:20:43,621][123091] Updated weights for policy 0, policy_version 846159 (0.0011) [2023-12-26 06:20:43,706][123090] Updated weights for policy 1, policy_version 840257 (0.0011) [2023-12-26 06:20:43,765][123090] Updated weights for policy 1, policy_version 840267 (0.0010) [2023-12-26 06:20:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 431726592. Throughput: 0: 9177.8, 1: 8908.1. Samples: 431720200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:43,785][121949] Avg episode reward: [(0, '6162.428'), (1, '5980.008')] [2023-12-26 06:20:43,826][123090] Updated weights for policy 1, policy_version 840277 (0.0010) [2023-12-26 06:20:43,897][123090] Updated weights for policy 1, policy_version 840287 (0.0011) [2023-12-26 06:20:44,455][123091] Updated weights for policy 0, policy_version 846169 (0.0009) [2023-12-26 06:20:44,510][123091] Updated weights for policy 0, policy_version 846179 (0.0007) [2023-12-26 06:20:44,585][123091] Updated weights for policy 0, policy_version 846189 (0.0006) [2023-12-26 06:20:44,632][123090] Updated weights for policy 1, policy_version 840297 (0.0006) [2023-12-26 06:20:44,703][123090] Updated weights for policy 1, policy_version 840307 (0.0005) [2023-12-26 06:20:44,772][123090] Updated weights for policy 1, policy_version 840317 (0.0006) [2023-12-26 06:20:45,361][123091] Updated weights for policy 0, policy_version 846199 (0.0009) [2023-12-26 06:20:45,433][123091] Updated weights for policy 0, policy_version 846209 (0.0010) [2023-12-26 06:20:45,501][123091] Updated weights for policy 0, policy_version 846219 (0.0009) [2023-12-26 06:20:45,513][123090] Updated weights for policy 1, policy_version 840327 (0.0008) [2023-12-26 06:20:45,569][123090] Updated weights for policy 1, policy_version 840337 (0.0009) [2023-12-26 06:20:45,632][123090] Updated weights for policy 1, policy_version 840347 (0.0009) [2023-12-26 06:20:46,330][123091] Updated weights for policy 0, policy_version 846229 (0.0008) [2023-12-26 06:20:46,380][123091] Updated weights for policy 0, policy_version 846239 (0.0006) [2023-12-26 06:20:46,429][123091] Updated weights for policy 0, policy_version 846249 (0.0005) [2023-12-26 06:20:46,464][123090] Updated weights for policy 1, policy_version 840357 (0.0010) [2023-12-26 06:20:46,515][123090] Updated weights for policy 1, policy_version 840367 (0.0008) [2023-12-26 06:20:46,578][123090] Updated weights for policy 1, policy_version 840377 (0.0006) [2023-12-26 06:20:47,133][123091] Updated weights for policy 0, policy_version 846259 (0.0009) [2023-12-26 06:20:47,180][123091] Updated weights for policy 0, policy_version 846269 (0.0005) [2023-12-26 06:20:47,235][123091] Updated weights for policy 0, policy_version 846279 (0.0010) [2023-12-26 06:20:47,369][123090] Updated weights for policy 1, policy_version 840387 (0.0007) [2023-12-26 06:20:47,420][123090] Updated weights for policy 1, policy_version 840397 (0.0010) [2023-12-26 06:20:47,472][123090] Updated weights for policy 1, policy_version 840407 (0.0010) [2023-12-26 06:20:48,061][123091] Updated weights for policy 0, policy_version 846289 (0.0010) [2023-12-26 06:20:48,114][123091] Updated weights for policy 0, policy_version 846299 (0.0006) [2023-12-26 06:20:48,176][123091] Updated weights for policy 0, policy_version 846310 (0.0007) [2023-12-26 06:20:48,237][123090] Updated weights for policy 1, policy_version 840417 (0.0010) [2023-12-26 06:20:48,243][123091] Updated weights for policy 0, policy_version 846320 (0.0006) [2023-12-26 06:20:48,301][123090] Updated weights for policy 1, policy_version 840427 (0.0006) [2023-12-26 06:20:48,373][123090] Updated weights for policy 1, policy_version 840437 (0.0008) [2023-12-26 06:20:48,437][123090] Updated weights for policy 1, policy_version 840447 (0.0011) [2023-12-26 06:20:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18159.0, 300 sec: 17716.9). Total num frames: 431816704. Throughput: 0: 9265.4, 1: 8916.2. Samples: 431828544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:48,785][121949] Avg episode reward: [(0, '6008.344'), (1, '5929.716')] [2023-12-26 06:20:48,920][123091] Updated weights for policy 0, policy_version 846330 (0.0005) [2023-12-26 06:20:48,992][123091] Updated weights for policy 0, policy_version 846340 (0.0005) [2023-12-26 06:20:49,069][123091] Updated weights for policy 0, policy_version 846350 (0.0005) [2023-12-26 06:20:49,256][123090] Updated weights for policy 1, policy_version 840457 (0.0010) [2023-12-26 06:20:49,304][123090] Updated weights for policy 1, policy_version 840467 (0.0010) [2023-12-26 06:20:49,361][123090] Updated weights for policy 1, policy_version 840477 (0.0011) [2023-12-26 06:20:49,843][123091] Updated weights for policy 0, policy_version 846360 (0.0009) [2023-12-26 06:20:49,905][123091] Updated weights for policy 0, policy_version 846370 (0.0008) [2023-12-26 06:20:49,969][123091] Updated weights for policy 0, policy_version 846380 (0.0011) [2023-12-26 06:20:50,159][123090] Updated weights for policy 1, policy_version 840487 (0.0010) [2023-12-26 06:20:50,212][123090] Updated weights for policy 1, policy_version 840497 (0.0009) [2023-12-26 06:20:50,270][123090] Updated weights for policy 1, policy_version 840508 (0.0010) [2023-12-26 06:20:50,821][123091] Updated weights for policy 0, policy_version 846390 (0.0010) [2023-12-26 06:20:50,877][123091] Updated weights for policy 0, policy_version 846400 (0.0010) [2023-12-26 06:20:50,936][123091] Updated weights for policy 0, policy_version 846410 (0.0010) [2023-12-26 06:20:51,137][123090] Updated weights for policy 1, policy_version 840518 (0.0010) [2023-12-26 06:20:51,200][123090] Updated weights for policy 1, policy_version 840528 (0.0008) [2023-12-26 06:20:51,254][123090] Updated weights for policy 1, policy_version 840538 (0.0009) [2023-12-26 06:20:51,684][123091] Updated weights for policy 0, policy_version 846420 (0.0008) [2023-12-26 06:20:51,752][123091] Updated weights for policy 0, policy_version 846430 (0.0007) [2023-12-26 06:20:51,812][123091] Updated weights for policy 0, policy_version 846440 (0.0005) [2023-12-26 06:20:52,097][123090] Updated weights for policy 1, policy_version 840548 (0.0005) [2023-12-26 06:20:52,171][123090] Updated weights for policy 1, policy_version 840558 (0.0006) [2023-12-26 06:20:52,224][123090] Updated weights for policy 1, policy_version 840568 (0.0005) [2023-12-26 06:20:52,534][123091] Updated weights for policy 0, policy_version 846450 (0.0006) [2023-12-26 06:20:52,603][123091] Updated weights for policy 0, policy_version 846460 (0.0008) [2023-12-26 06:20:52,662][123091] Updated weights for policy 0, policy_version 846470 (0.0009) [2023-12-26 06:20:52,724][123091] Updated weights for policy 0, policy_version 846480 (0.0009) [2023-12-26 06:20:52,978][123090] Updated weights for policy 1, policy_version 840578 (0.0008) [2023-12-26 06:20:53,041][123090] Updated weights for policy 1, policy_version 840588 (0.0010) [2023-12-26 06:20:53,110][123090] Updated weights for policy 1, policy_version 840598 (0.0010) [2023-12-26 06:20:53,175][123090] Updated weights for policy 1, policy_version 840608 (0.0009) [2023-12-26 06:20:53,543][123091] Updated weights for policy 0, policy_version 846490 (0.0010) [2023-12-26 06:20:53,593][123091] Updated weights for policy 0, policy_version 846500 (0.0010) [2023-12-26 06:20:53,639][123091] Updated weights for policy 0, policy_version 846510 (0.0009) [2023-12-26 06:20:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 431906816. Throughput: 0: 9224.5, 1: 8934.0. Samples: 431880672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:53,784][121949] Avg episode reward: [(0, '6090.344'), (1, '5965.927')] [2023-12-26 06:20:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000846512_216711168.pth... [2023-12-26 06:20:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000840608_215195648.pth... [2023-12-26 06:20:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000845424_216432640.pth [2023-12-26 06:20:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000839552_214925312.pth [2023-12-26 06:20:53,992][123090] Updated weights for policy 1, policy_version 840618 (0.0007) [2023-12-26 06:20:54,059][123090] Updated weights for policy 1, policy_version 840628 (0.0009) [2023-12-26 06:20:54,131][123090] Updated weights for policy 1, policy_version 840638 (0.0010) [2023-12-26 06:20:54,485][123091] Updated weights for policy 0, policy_version 846520 (0.0009) [2023-12-26 06:20:54,552][123091] Updated weights for policy 0, policy_version 846530 (0.0008) [2023-12-26 06:20:54,600][123091] Updated weights for policy 0, policy_version 846540 (0.0007) [2023-12-26 06:20:54,874][123090] Updated weights for policy 1, policy_version 840648 (0.0006) [2023-12-26 06:20:54,929][123090] Updated weights for policy 1, policy_version 840658 (0.0006) [2023-12-26 06:20:54,987][123090] Updated weights for policy 1, policy_version 840668 (0.0010) [2023-12-26 06:20:55,287][123091] Updated weights for policy 0, policy_version 846550 (0.0006) [2023-12-26 06:20:55,343][123091] Updated weights for policy 0, policy_version 846560 (0.0006) [2023-12-26 06:20:55,405][123091] Updated weights for policy 0, policy_version 846570 (0.0006) [2023-12-26 06:20:55,880][123090] Updated weights for policy 1, policy_version 840678 (0.0009) [2023-12-26 06:20:55,932][123090] Updated weights for policy 1, policy_version 840688 (0.0009) [2023-12-26 06:20:55,996][123090] Updated weights for policy 1, policy_version 840698 (0.0009) [2023-12-26 06:20:56,050][123091] Updated weights for policy 0, policy_version 846580 (0.0008) [2023-12-26 06:20:56,116][123091] Updated weights for policy 0, policy_version 846590 (0.0009) [2023-12-26 06:20:56,173][123091] Updated weights for policy 0, policy_version 846600 (0.0009) [2023-12-26 06:20:56,728][123090] Updated weights for policy 1, policy_version 840708 (0.0008) [2023-12-26 06:20:56,792][123090] Updated weights for policy 1, policy_version 840718 (0.0006) [2023-12-26 06:20:56,856][123090] Updated weights for policy 1, policy_version 840728 (0.0007) [2023-12-26 06:20:57,087][123091] Updated weights for policy 0, policy_version 846610 (0.0010) [2023-12-26 06:20:57,149][123091] Updated weights for policy 0, policy_version 846620 (0.0010) [2023-12-26 06:20:57,212][123091] Updated weights for policy 0, policy_version 846630 (0.0010) [2023-12-26 06:20:57,274][123091] Updated weights for policy 0, policy_version 846640 (0.0010) [2023-12-26 06:20:57,599][123090] Updated weights for policy 1, policy_version 840738 (0.0005) [2023-12-26 06:20:57,652][123090] Updated weights for policy 1, policy_version 840748 (0.0008) [2023-12-26 06:20:57,702][123090] Updated weights for policy 1, policy_version 840758 (0.0008) [2023-12-26 06:20:57,781][123090] Updated weights for policy 1, policy_version 840768 (0.0009) [2023-12-26 06:20:58,035][123091] Updated weights for policy 0, policy_version 846650 (0.0007) [2023-12-26 06:20:58,093][123091] Updated weights for policy 0, policy_version 846660 (0.0009) [2023-12-26 06:20:58,153][123091] Updated weights for policy 0, policy_version 846670 (0.0009) [2023-12-26 06:20:58,645][123090] Updated weights for policy 1, policy_version 840778 (0.0008) [2023-12-26 06:20:58,717][123090] Updated weights for policy 1, policy_version 840788 (0.0011) [2023-12-26 06:20:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 431988736. Throughput: 0: 9285.9, 1: 8990.0. Samples: 431989248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:20:58,785][121949] Avg episode reward: [(0, '5979.671'), (1, '5930.357')] [2023-12-26 06:20:58,786][123090] Updated weights for policy 1, policy_version 840798 (0.0011) [2023-12-26 06:20:59,036][123091] Updated weights for policy 0, policy_version 846680 (0.0009) [2023-12-26 06:20:59,102][123091] Updated weights for policy 0, policy_version 846690 (0.0011) [2023-12-26 06:20:59,169][123091] Updated weights for policy 0, policy_version 846700 (0.0011) [2023-12-26 06:20:59,607][123090] Updated weights for policy 1, policy_version 840808 (0.0010) [2023-12-26 06:20:59,661][123090] Updated weights for policy 1, policy_version 840818 (0.0010) [2023-12-26 06:20:59,714][123090] Updated weights for policy 1, policy_version 840829 (0.0009) [2023-12-26 06:20:59,942][123091] Updated weights for policy 0, policy_version 846710 (0.0011) [2023-12-26 06:21:00,009][123091] Updated weights for policy 0, policy_version 846720 (0.0011) [2023-12-26 06:21:00,072][123091] Updated weights for policy 0, policy_version 846730 (0.0011) [2023-12-26 06:21:00,619][123090] Updated weights for policy 1, policy_version 840840 (0.0010) [2023-12-26 06:21:00,672][123090] Updated weights for policy 1, policy_version 840850 (0.0009) [2023-12-26 06:21:00,726][123090] Updated weights for policy 1, policy_version 840860 (0.0009) [2023-12-26 06:21:00,869][123091] Updated weights for policy 0, policy_version 846740 (0.0008) [2023-12-26 06:21:00,941][123091] Updated weights for policy 0, policy_version 846750 (0.0005) [2023-12-26 06:21:01,004][123091] Updated weights for policy 0, policy_version 846760 (0.0005) [2023-12-26 06:21:01,622][123090] Updated weights for policy 1, policy_version 840870 (0.0008) [2023-12-26 06:21:01,623][123091] Updated weights for policy 0, policy_version 846770 (0.0008) [2023-12-26 06:21:01,686][123090] Updated weights for policy 1, policy_version 840880 (0.0007) [2023-12-26 06:21:01,689][123091] Updated weights for policy 0, policy_version 846780 (0.0011) [2023-12-26 06:21:01,755][123091] Updated weights for policy 0, policy_version 846790 (0.0010) [2023-12-26 06:21:01,757][123090] Updated weights for policy 1, policy_version 840890 (0.0007) [2023-12-26 06:21:01,819][123091] Updated weights for policy 0, policy_version 846800 (0.0008) [2023-12-26 06:21:02,543][123090] Updated weights for policy 1, policy_version 840900 (0.0009) [2023-12-26 06:21:02,608][123090] Updated weights for policy 1, policy_version 840910 (0.0006) [2023-12-26 06:21:02,626][123091] Updated weights for policy 0, policy_version 846810 (0.0009) [2023-12-26 06:21:02,661][123090] Updated weights for policy 1, policy_version 840921 (0.0007) [2023-12-26 06:21:02,679][123091] Updated weights for policy 0, policy_version 846820 (0.0009) [2023-12-26 06:21:02,734][123091] Updated weights for policy 0, policy_version 846830 (0.0008) [2023-12-26 06:21:03,497][123090] Updated weights for policy 1, policy_version 840931 (0.0009) [2023-12-26 06:21:03,555][123090] Updated weights for policy 1, policy_version 840941 (0.0009) [2023-12-26 06:21:03,572][123091] Updated weights for policy 0, policy_version 846840 (0.0008) [2023-12-26 06:21:03,621][123090] Updated weights for policy 1, policy_version 840951 (0.0008) [2023-12-26 06:21:03,633][123091] Updated weights for policy 0, policy_version 846850 (0.0008) [2023-12-26 06:21:03,703][123091] Updated weights for policy 0, policy_version 846860 (0.0009) [2023-12-26 06:21:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 432087040. Throughput: 0: 9181.0, 1: 8960.5. Samples: 432091984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:21:03,785][121949] Avg episode reward: [(0, '6014.475'), (1, '5852.592')] [2023-12-26 06:21:04,387][123090] Updated weights for policy 1, policy_version 840961 (0.0006) [2023-12-26 06:21:04,443][123091] Updated weights for policy 0, policy_version 846870 (0.0009) [2023-12-26 06:21:04,449][123090] Updated weights for policy 1, policy_version 840971 (0.0007) [2023-12-26 06:21:04,497][123091] Updated weights for policy 0, policy_version 846880 (0.0009) [2023-12-26 06:21:04,511][123090] Updated weights for policy 1, policy_version 840981 (0.0006) [2023-12-26 06:21:04,549][123091] Updated weights for policy 0, policy_version 846890 (0.0009) [2023-12-26 06:21:04,569][123090] Updated weights for policy 1, policy_version 840991 (0.0007) [2023-12-26 06:21:05,300][123090] Updated weights for policy 1, policy_version 841001 (0.0006) [2023-12-26 06:21:05,360][123091] Updated weights for policy 0, policy_version 846900 (0.0008) [2023-12-26 06:21:05,366][123090] Updated weights for policy 1, policy_version 841011 (0.0005) [2023-12-26 06:21:05,411][123091] Updated weights for policy 0, policy_version 846910 (0.0006) [2023-12-26 06:21:05,425][123090] Updated weights for policy 1, policy_version 841021 (0.0008) [2023-12-26 06:21:05,465][123091] Updated weights for policy 0, policy_version 846920 (0.0006) [2023-12-26 06:21:06,139][123091] Updated weights for policy 0, policy_version 846930 (0.0006) [2023-12-26 06:21:06,208][123091] Updated weights for policy 0, policy_version 846940 (0.0010) [2023-12-26 06:21:06,232][123090] Updated weights for policy 1, policy_version 841031 (0.0011) [2023-12-26 06:21:06,268][123091] Updated weights for policy 0, policy_version 846950 (0.0011) [2023-12-26 06:21:06,288][123090] Updated weights for policy 1, policy_version 841041 (0.0010) [2023-12-26 06:21:06,339][123091] Updated weights for policy 0, policy_version 846960 (0.0008) [2023-12-26 06:21:06,360][123090] Updated weights for policy 1, policy_version 841051 (0.0007) [2023-12-26 06:21:06,988][123091] Updated weights for policy 0, policy_version 846970 (0.0007) [2023-12-26 06:21:07,041][123091] Updated weights for policy 0, policy_version 846980 (0.0010) [2023-12-26 06:21:07,092][123091] Updated weights for policy 0, policy_version 846990 (0.0010) [2023-12-26 06:21:07,183][123090] Updated weights for policy 1, policy_version 841061 (0.0011) [2023-12-26 06:21:07,247][123090] Updated weights for policy 1, policy_version 841071 (0.0010) [2023-12-26 06:21:07,307][123090] Updated weights for policy 1, policy_version 841081 (0.0010) [2023-12-26 06:21:07,929][123091] Updated weights for policy 0, policy_version 847000 (0.0010) [2023-12-26 06:21:07,995][123091] Updated weights for policy 0, policy_version 847010 (0.0010) [2023-12-26 06:21:08,054][123091] Updated weights for policy 0, policy_version 847020 (0.0010) [2023-12-26 06:21:08,130][123090] Updated weights for policy 1, policy_version 841091 (0.0010) [2023-12-26 06:21:08,178][123090] Updated weights for policy 1, policy_version 841101 (0.0010) [2023-12-26 06:21:08,221][123090] Updated weights for policy 1, policy_version 841111 (0.0010) [2023-12-26 06:21:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 432168960. Throughput: 0: 9250.7, 1: 9025.9. Samples: 432148120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:21:08,785][121949] Avg episode reward: [(0, '6003.588'), (1, '5893.232')] [2023-12-26 06:21:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000847024_216842240.pth... [2023-12-26 06:21:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000841120_215326720.pth... [2023-12-26 06:21:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000845968_216571904.pth [2023-12-26 06:21:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000840128_215072768.pth [2023-12-26 06:21:08,851][123091] Updated weights for policy 0, policy_version 847030 (0.0011) [2023-12-26 06:21:08,918][123091] Updated weights for policy 0, policy_version 847040 (0.0011) [2023-12-26 06:21:08,977][123091] Updated weights for policy 0, policy_version 847050 (0.0010) [2023-12-26 06:21:09,083][123090] Updated weights for policy 1, policy_version 841121 (0.0010) [2023-12-26 06:21:09,132][123090] Updated weights for policy 1, policy_version 841131 (0.0011) [2023-12-26 06:21:09,190][123090] Updated weights for policy 1, policy_version 841141 (0.0011) [2023-12-26 06:21:09,255][123090] Updated weights for policy 1, policy_version 841151 (0.0008) [2023-12-26 06:21:09,784][123091] Updated weights for policy 0, policy_version 847060 (0.0009) [2023-12-26 06:21:09,857][123091] Updated weights for policy 0, policy_version 847070 (0.0008) [2023-12-26 06:21:09,929][123091] Updated weights for policy 0, policy_version 847080 (0.0007) [2023-12-26 06:21:10,051][123090] Updated weights for policy 1, policy_version 841161 (0.0009) [2023-12-26 06:21:10,109][123090] Updated weights for policy 1, policy_version 841171 (0.0009) [2023-12-26 06:21:10,165][123090] Updated weights for policy 1, policy_version 841181 (0.0009) [2023-12-26 06:21:10,724][123091] Updated weights for policy 0, policy_version 847090 (0.0009) [2023-12-26 06:21:10,776][123091] Updated weights for policy 0, policy_version 847100 (0.0011) [2023-12-26 06:21:10,821][123091] Updated weights for policy 0, policy_version 847110 (0.0008) [2023-12-26 06:21:10,868][123091] Updated weights for policy 0, policy_version 847120 (0.0006) [2023-12-26 06:21:10,975][123090] Updated weights for policy 1, policy_version 841191 (0.0009) [2023-12-26 06:21:11,039][123090] Updated weights for policy 1, policy_version 841201 (0.0010) [2023-12-26 06:21:11,114][123090] Updated weights for policy 1, policy_version 841211 (0.0010) [2023-12-26 06:21:11,715][123091] Updated weights for policy 0, policy_version 847131 (0.0009) [2023-12-26 06:21:11,776][123091] Updated weights for policy 0, policy_version 847141 (0.0009) [2023-12-26 06:21:11,850][123091] Updated weights for policy 0, policy_version 847151 (0.0009) [2023-12-26 06:21:12,002][123090] Updated weights for policy 1, policy_version 841221 (0.0009) [2023-12-26 06:21:12,055][123090] Updated weights for policy 1, policy_version 841231 (0.0009) [2023-12-26 06:21:12,118][123090] Updated weights for policy 1, policy_version 841241 (0.0010) [2023-12-26 06:21:12,675][123091] Updated weights for policy 0, policy_version 847161 (0.0006) [2023-12-26 06:21:12,732][123091] Updated weights for policy 0, policy_version 847171 (0.0005) [2023-12-26 06:21:12,786][123091] Updated weights for policy 0, policy_version 847181 (0.0005) [2023-12-26 06:21:13,038][123090] Updated weights for policy 1, policy_version 841251 (0.0009) [2023-12-26 06:21:13,093][123090] Updated weights for policy 1, policy_version 841261 (0.0008) [2023-12-26 06:21:13,146][123090] Updated weights for policy 1, policy_version 841271 (0.0009) [2023-12-26 06:21:13,454][123091] Updated weights for policy 0, policy_version 847191 (0.0005) [2023-12-26 06:21:13,523][123091] Updated weights for policy 0, policy_version 847201 (0.0005) [2023-12-26 06:21:13,583][123091] Updated weights for policy 0, policy_version 847211 (0.0005) [2023-12-26 06:21:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 432259072. Throughput: 0: 9145.5, 1: 8858.2. Samples: 432251540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:21:13,785][121949] Avg episode reward: [(0, '5929.074'), (1, '5810.030')] [2023-12-26 06:21:13,985][123090] Updated weights for policy 1, policy_version 841281 (0.0008) [2023-12-26 06:21:14,054][123090] Updated weights for policy 1, policy_version 841291 (0.0006) [2023-12-26 06:21:14,125][123090] Updated weights for policy 1, policy_version 841301 (0.0006) [2023-12-26 06:21:14,196][123090] Updated weights for policy 1, policy_version 841311 (0.0006) [2023-12-26 06:21:14,252][123091] Updated weights for policy 0, policy_version 847221 (0.0008) [2023-12-26 06:21:14,321][123091] Updated weights for policy 0, policy_version 847231 (0.0010) [2023-12-26 06:21:14,387][123091] Updated weights for policy 0, policy_version 847241 (0.0007) [2023-12-26 06:21:14,877][123090] Updated weights for policy 1, policy_version 841321 (0.0007) [2023-12-26 06:21:14,940][123090] Updated weights for policy 1, policy_version 841331 (0.0011) [2023-12-26 06:21:15,004][123090] Updated weights for policy 1, policy_version 841341 (0.0010) [2023-12-26 06:21:15,117][123091] Updated weights for policy 0, policy_version 847251 (0.0007) [2023-12-26 06:21:15,178][123091] Updated weights for policy 0, policy_version 847261 (0.0011) [2023-12-26 06:21:15,253][123091] Updated weights for policy 0, policy_version 847271 (0.0011) [2023-12-26 06:21:15,798][123090] Updated weights for policy 1, policy_version 841351 (0.0011) [2023-12-26 06:21:15,850][123090] Updated weights for policy 1, policy_version 841361 (0.0010) [2023-12-26 06:21:15,902][123090] Updated weights for policy 1, policy_version 841371 (0.0010) [2023-12-26 06:21:16,082][123091] Updated weights for policy 0, policy_version 847281 (0.0011) [2023-12-26 06:21:16,134][123091] Updated weights for policy 0, policy_version 847291 (0.0010) [2023-12-26 06:21:16,182][123091] Updated weights for policy 0, policy_version 847301 (0.0011) [2023-12-26 06:21:16,230][123091] Updated weights for policy 0, policy_version 847311 (0.0011) [2023-12-26 06:21:16,617][123090] Updated weights for policy 1, policy_version 841381 (0.0009) [2023-12-26 06:21:16,680][123090] Updated weights for policy 1, policy_version 841391 (0.0010) [2023-12-26 06:21:16,738][123090] Updated weights for policy 1, policy_version 841401 (0.0010) [2023-12-26 06:21:17,053][123091] Updated weights for policy 0, policy_version 847321 (0.0010) [2023-12-26 06:21:17,101][123091] Updated weights for policy 0, policy_version 847331 (0.0010) [2023-12-26 06:21:17,160][123091] Updated weights for policy 0, policy_version 847341 (0.0011) [2023-12-26 06:21:17,540][123090] Updated weights for policy 1, policy_version 841411 (0.0010) [2023-12-26 06:21:17,598][123090] Updated weights for policy 1, policy_version 841421 (0.0010) [2023-12-26 06:21:17,656][123090] Updated weights for policy 1, policy_version 841431 (0.0010) [2023-12-26 06:21:17,921][123091] Updated weights for policy 0, policy_version 847351 (0.0007) [2023-12-26 06:21:17,965][123091] Updated weights for policy 0, policy_version 847361 (0.0005) [2023-12-26 06:21:18,024][123091] Updated weights for policy 0, policy_version 847371 (0.0005) [2023-12-26 06:21:18,489][123090] Updated weights for policy 1, policy_version 841441 (0.0010) [2023-12-26 06:21:18,560][123090] Updated weights for policy 1, policy_version 841451 (0.0011) [2023-12-26 06:21:18,635][123090] Updated weights for policy 1, policy_version 841461 (0.0010) [2023-12-26 06:21:18,711][123090] Updated weights for policy 1, policy_version 841471 (0.0011) [2023-12-26 06:21:18,715][123091] Updated weights for policy 0, policy_version 847381 (0.0006) [2023-12-26 06:21:18,783][123091] Updated weights for policy 0, policy_version 847391 (0.0008) [2023-12-26 06:21:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 432349184. Throughput: 0: 9132.2, 1: 8743.0. Samples: 432360768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:21:18,785][121949] Avg episode reward: [(0, '5876.409'), (1, '5803.879')] [2023-12-26 06:21:18,845][123091] Updated weights for policy 0, policy_version 847401 (0.0009) [2023-12-26 06:21:19,550][123090] Updated weights for policy 1, policy_version 841481 (0.0009) [2023-12-26 06:21:19,625][123090] Updated weights for policy 1, policy_version 841491 (0.0010) [2023-12-26 06:21:19,640][123091] Updated weights for policy 0, policy_version 847411 (0.0008) [2023-12-26 06:21:19,698][123091] Updated weights for policy 0, policy_version 847421 (0.0005) [2023-12-26 06:21:19,701][123090] Updated weights for policy 1, policy_version 841501 (0.0011) [2023-12-26 06:21:19,764][123091] Updated weights for policy 0, policy_version 847431 (0.0006) [2023-12-26 06:21:20,473][123090] Updated weights for policy 1, policy_version 841511 (0.0007) [2023-12-26 06:21:20,499][123091] Updated weights for policy 0, policy_version 847441 (0.0006) [2023-12-26 06:21:20,536][123090] Updated weights for policy 1, policy_version 841521 (0.0008) [2023-12-26 06:21:20,563][123091] Updated weights for policy 0, policy_version 847451 (0.0009) [2023-12-26 06:21:20,607][123090] Updated weights for policy 1, policy_version 841531 (0.0008) [2023-12-26 06:21:20,635][123091] Updated weights for policy 0, policy_version 847461 (0.0008) [2023-12-26 06:21:20,694][123091] Updated weights for policy 0, policy_version 847471 (0.0006) [2023-12-26 06:21:21,341][123090] Updated weights for policy 1, policy_version 841541 (0.0009) [2023-12-26 06:21:21,413][123090] Updated weights for policy 1, policy_version 841551 (0.0008) [2023-12-26 06:21:21,458][123091] Updated weights for policy 0, policy_version 847481 (0.0008) [2023-12-26 06:21:21,478][123090] Updated weights for policy 1, policy_version 841561 (0.0009) [2023-12-26 06:21:21,519][123091] Updated weights for policy 0, policy_version 847491 (0.0009) [2023-12-26 06:21:21,580][123091] Updated weights for policy 0, policy_version 847501 (0.0009) [2023-12-26 06:21:22,292][123090] Updated weights for policy 1, policy_version 841571 (0.0009) [2023-12-26 06:21:22,352][123090] Updated weights for policy 1, policy_version 841581 (0.0009) [2023-12-26 06:21:22,409][123091] Updated weights for policy 0, policy_version 847511 (0.0009) [2023-12-26 06:21:22,424][123090] Updated weights for policy 1, policy_version 841591 (0.0008) [2023-12-26 06:21:22,480][123091] Updated weights for policy 0, policy_version 847521 (0.0011) [2023-12-26 06:21:22,549][123091] Updated weights for policy 0, policy_version 847531 (0.0010) [2023-12-26 06:21:23,242][123090] Updated weights for policy 1, policy_version 841602 (0.0009) [2023-12-26 06:21:23,295][123090] Updated weights for policy 1, policy_version 841612 (0.0009) [2023-12-26 06:21:23,347][123090] Updated weights for policy 1, policy_version 841622 (0.0009) [2023-12-26 06:21:23,381][123091] Updated weights for policy 0, policy_version 847541 (0.0010) [2023-12-26 06:21:23,409][123090] Updated weights for policy 1, policy_version 841632 (0.0008) [2023-12-26 06:21:23,439][123091] Updated weights for policy 0, policy_version 847551 (0.0009) [2023-12-26 06:21:23,491][123091] Updated weights for policy 0, policy_version 847561 (0.0010) [2023-12-26 06:21:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 432439296. Throughput: 0: 9104.4, 1: 8679.0. Samples: 432413952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:21:23,785][121949] Avg episode reward: [(0, '5918.271'), (1, '5865.101')] [2023-12-26 06:21:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000847568_216981504.pth... [2023-12-26 06:21:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000841632_215457792.pth... [2023-12-26 06:21:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000840608_215195648.pth [2023-12-26 06:21:23,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000846512_216711168.pth [2023-12-26 06:21:24,262][123090] Updated weights for policy 1, policy_version 841642 (0.0009) [2023-12-26 06:21:24,290][123091] Updated weights for policy 0, policy_version 847571 (0.0008) [2023-12-26 06:21:24,324][123090] Updated weights for policy 1, policy_version 841652 (0.0008) [2023-12-26 06:21:24,351][123091] Updated weights for policy 0, policy_version 847581 (0.0009) [2023-12-26 06:21:24,386][123090] Updated weights for policy 1, policy_version 841662 (0.0006) [2023-12-26 06:21:24,406][123091] Updated weights for policy 0, policy_version 847591 (0.0009) [2023-12-26 06:21:25,137][123090] Updated weights for policy 1, policy_version 841672 (0.0009) [2023-12-26 06:21:25,192][123090] Updated weights for policy 1, policy_version 841682 (0.0009) [2023-12-26 06:21:25,239][123090] Updated weights for policy 1, policy_version 841692 (0.0009) [2023-12-26 06:21:25,262][123091] Updated weights for policy 0, policy_version 847601 (0.0009) [2023-12-26 06:21:25,319][123091] Updated weights for policy 0, policy_version 847611 (0.0009) [2023-12-26 06:21:25,375][123091] Updated weights for policy 0, policy_version 847621 (0.0009) [2023-12-26 06:21:25,429][123091] Updated weights for policy 0, policy_version 847631 (0.0009) [2023-12-26 06:21:26,113][123091] Updated weights for policy 0, policy_version 847641 (0.0009) [2023-12-26 06:21:26,128][123090] Updated weights for policy 1, policy_version 841702 (0.0009) [2023-12-26 06:21:26,157][123091] Updated weights for policy 0, policy_version 847651 (0.0006) [2023-12-26 06:21:26,173][123090] Updated weights for policy 1, policy_version 841712 (0.0008) [2023-12-26 06:21:26,202][123091] Updated weights for policy 0, policy_version 847661 (0.0008) [2023-12-26 06:21:26,232][123090] Updated weights for policy 1, policy_version 841722 (0.0007) [2023-12-26 06:21:26,933][123091] Updated weights for policy 0, policy_version 847671 (0.0010) [2023-12-26 06:21:27,001][123091] Updated weights for policy 0, policy_version 847681 (0.0009) [2023-12-26 06:21:27,062][123091] Updated weights for policy 0, policy_version 847691 (0.0009) [2023-12-26 06:21:27,095][123090] Updated weights for policy 1, policy_version 841732 (0.0009) [2023-12-26 06:21:27,150][123090] Updated weights for policy 1, policy_version 841742 (0.0008) [2023-12-26 06:21:27,202][123090] Updated weights for policy 1, policy_version 841752 (0.0009) [2023-12-26 06:21:27,883][123091] Updated weights for policy 0, policy_version 847701 (0.0007) [2023-12-26 06:21:27,953][123091] Updated weights for policy 0, policy_version 847711 (0.0007) [2023-12-26 06:21:28,017][123091] Updated weights for policy 0, policy_version 847722 (0.0010) [2023-12-26 06:21:28,024][123090] Updated weights for policy 1, policy_version 841762 (0.0009) [2023-12-26 06:21:28,087][123090] Updated weights for policy 1, policy_version 841772 (0.0008) [2023-12-26 06:21:28,144][123090] Updated weights for policy 1, policy_version 841782 (0.0009) [2023-12-26 06:21:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 432521216. Throughput: 0: 9065.4, 1: 8694.8. Samples: 432519412. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:28,785][121949] Avg episode reward: [(0, '6046.411'), (1, '5823.864')] [2023-12-26 06:21:28,800][123091] Updated weights for policy 0, policy_version 847732 (0.0010) [2023-12-26 06:21:28,869][123091] Updated weights for policy 0, policy_version 847742 (0.0007) [2023-12-26 06:21:28,933][123091] Updated weights for policy 0, policy_version 847752 (0.0009) [2023-12-26 06:21:28,965][123090] Updated weights for policy 1, policy_version 841793 (0.0008) [2023-12-26 06:21:29,029][123090] Updated weights for policy 1, policy_version 841803 (0.0009) [2023-12-26 06:21:29,092][123090] Updated weights for policy 1, policy_version 841813 (0.0008) [2023-12-26 06:21:29,147][123090] Updated weights for policy 1, policy_version 841823 (0.0009) [2023-12-26 06:21:29,743][123091] Updated weights for policy 0, policy_version 847762 (0.0009) [2023-12-26 06:21:29,805][123091] Updated weights for policy 0, policy_version 847772 (0.0010) [2023-12-26 06:21:29,875][123091] Updated weights for policy 0, policy_version 847782 (0.0010) [2023-12-26 06:21:29,938][123091] Updated weights for policy 0, policy_version 847792 (0.0010) [2023-12-26 06:21:30,002][123090] Updated weights for policy 1, policy_version 841833 (0.0009) [2023-12-26 06:21:30,057][123090] Updated weights for policy 1, policy_version 841843 (0.0009) [2023-12-26 06:21:30,116][123090] Updated weights for policy 1, policy_version 841853 (0.0009) [2023-12-26 06:21:30,669][123091] Updated weights for policy 0, policy_version 847802 (0.0005) [2023-12-26 06:21:30,739][123091] Updated weights for policy 0, policy_version 847812 (0.0005) [2023-12-26 06:21:30,795][123091] Updated weights for policy 0, policy_version 847822 (0.0008) [2023-12-26 06:21:31,005][123090] Updated weights for policy 1, policy_version 841864 (0.0010) [2023-12-26 06:21:31,074][123090] Updated weights for policy 1, policy_version 841874 (0.0009) [2023-12-26 06:21:31,145][123090] Updated weights for policy 1, policy_version 841884 (0.0010) [2023-12-26 06:21:31,549][123091] Updated weights for policy 0, policy_version 847832 (0.0010) [2023-12-26 06:21:31,618][123091] Updated weights for policy 0, policy_version 847842 (0.0009) [2023-12-26 06:21:31,678][123091] Updated weights for policy 0, policy_version 847852 (0.0009) [2023-12-26 06:21:31,943][123090] Updated weights for policy 1, policy_version 841894 (0.0007) [2023-12-26 06:21:32,003][123090] Updated weights for policy 1, policy_version 841904 (0.0009) [2023-12-26 06:21:32,064][123090] Updated weights for policy 1, policy_version 841914 (0.0010) [2023-12-26 06:21:32,376][123091] Updated weights for policy 0, policy_version 847862 (0.0009) [2023-12-26 06:21:32,428][123091] Updated weights for policy 0, policy_version 847872 (0.0009) [2023-12-26 06:21:32,482][123091] Updated weights for policy 0, policy_version 847882 (0.0009) [2023-12-26 06:21:32,886][123090] Updated weights for policy 1, policy_version 841924 (0.0010) [2023-12-26 06:21:32,938][123090] Updated weights for policy 1, policy_version 841934 (0.0009) [2023-12-26 06:21:32,991][123090] Updated weights for policy 1, policy_version 841944 (0.0008) [2023-12-26 06:21:33,308][123091] Updated weights for policy 0, policy_version 847892 (0.0008) [2023-12-26 06:21:33,352][123091] Updated weights for policy 0, policy_version 847902 (0.0005) [2023-12-26 06:21:33,403][123091] Updated weights for policy 0, policy_version 847912 (0.0005) [2023-12-26 06:21:33,758][123090] Updated weights for policy 1, policy_version 841954 (0.0009) [2023-12-26 06:21:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 432611328. Throughput: 0: 9060.2, 1: 8645.6. Samples: 432625304. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:33,785][121949] Avg episode reward: [(0, '5909.156'), (1, '5884.004')] [2023-12-26 06:21:33,808][123090] Updated weights for policy 1, policy_version 841964 (0.0005) [2023-12-26 06:21:33,862][123090] Updated weights for policy 1, policy_version 841974 (0.0010) [2023-12-26 06:21:33,946][123090] Updated weights for policy 1, policy_version 841984 (0.0010) [2023-12-26 06:21:34,115][123091] Updated weights for policy 0, policy_version 847922 (0.0006) [2023-12-26 06:21:34,183][123091] Updated weights for policy 0, policy_version 847932 (0.0006) [2023-12-26 06:21:34,255][123091] Updated weights for policy 0, policy_version 847942 (0.0006) [2023-12-26 06:21:34,324][123091] Updated weights for policy 0, policy_version 847952 (0.0005) [2023-12-26 06:21:34,744][123090] Updated weights for policy 1, policy_version 841994 (0.0010) [2023-12-26 06:21:34,810][123090] Updated weights for policy 1, policy_version 842004 (0.0011) [2023-12-26 06:21:34,876][123090] Updated weights for policy 1, policy_version 842014 (0.0009) [2023-12-26 06:21:35,016][123091] Updated weights for policy 0, policy_version 847962 (0.0006) [2023-12-26 06:21:35,082][123091] Updated weights for policy 0, policy_version 847972 (0.0005) [2023-12-26 06:21:35,148][123091] Updated weights for policy 0, policy_version 847982 (0.0006) [2023-12-26 06:21:35,698][123090] Updated weights for policy 1, policy_version 842024 (0.0010) [2023-12-26 06:21:35,757][123090] Updated weights for policy 1, policy_version 842034 (0.0010) [2023-12-26 06:21:35,816][123090] Updated weights for policy 1, policy_version 842044 (0.0010) [2023-12-26 06:21:35,817][123091] Updated weights for policy 0, policy_version 847992 (0.0005) [2023-12-26 06:21:35,869][123091] Updated weights for policy 0, policy_version 848002 (0.0005) [2023-12-26 06:21:35,929][123091] Updated weights for policy 0, policy_version 848012 (0.0005) [2023-12-26 06:21:36,594][123091] Updated weights for policy 0, policy_version 848022 (0.0006) [2023-12-26 06:21:36,652][123090] Updated weights for policy 1, policy_version 842054 (0.0011) [2023-12-26 06:21:36,665][123091] Updated weights for policy 0, policy_version 848032 (0.0009) [2023-12-26 06:21:36,719][123090] Updated weights for policy 1, policy_version 842064 (0.0011) [2023-12-26 06:21:36,731][123091] Updated weights for policy 0, policy_version 848042 (0.0010) [2023-12-26 06:21:36,788][123090] Updated weights for policy 1, policy_version 842074 (0.0009) [2023-12-26 06:21:37,384][123091] Updated weights for policy 0, policy_version 848052 (0.0009) [2023-12-26 06:21:37,455][123091] Updated weights for policy 0, policy_version 848062 (0.0005) [2023-12-26 06:21:37,512][123091] Updated weights for policy 0, policy_version 848072 (0.0005) [2023-12-26 06:21:37,589][123090] Updated weights for policy 1, policy_version 842084 (0.0009) [2023-12-26 06:21:37,659][123090] Updated weights for policy 1, policy_version 842094 (0.0011) [2023-12-26 06:21:37,729][123090] Updated weights for policy 1, policy_version 842104 (0.0010) [2023-12-26 06:21:38,256][123091] Updated weights for policy 0, policy_version 848082 (0.0010) [2023-12-26 06:21:38,329][123091] Updated weights for policy 0, policy_version 848092 (0.0008) [2023-12-26 06:21:38,391][123091] Updated weights for policy 0, policy_version 848102 (0.0009) [2023-12-26 06:21:38,447][123091] Updated weights for policy 0, policy_version 848112 (0.0010) [2023-12-26 06:21:38,549][123090] Updated weights for policy 1, policy_version 842114 (0.0010) [2023-12-26 06:21:38,622][123090] Updated weights for policy 1, policy_version 842124 (0.0010) [2023-12-26 06:21:38,689][123090] Updated weights for policy 1, policy_version 842134 (0.0010) [2023-12-26 06:21:38,744][123090] Updated weights for policy 1, policy_version 842144 (0.0010) [2023-12-26 06:21:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 432709632. Throughput: 0: 9149.4, 1: 8655.6. Samples: 432681900. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:38,785][121949] Avg episode reward: [(0, '5941.639'), (1, '5918.891')] [2023-12-26 06:21:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000848112_217120768.pth... [2023-12-26 06:21:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000842144_215588864.pth... [2023-12-26 06:21:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000847024_216842240.pth [2023-12-26 06:21:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000841120_215326720.pth [2023-12-26 06:21:39,266][123091] Updated weights for policy 0, policy_version 848122 (0.0010) [2023-12-26 06:21:39,329][123091] Updated weights for policy 0, policy_version 848132 (0.0010) [2023-12-26 06:21:39,393][123091] Updated weights for policy 0, policy_version 848142 (0.0011) [2023-12-26 06:21:39,606][123090] Updated weights for policy 1, policy_version 842154 (0.0005) [2023-12-26 06:21:39,677][123090] Updated weights for policy 1, policy_version 842164 (0.0006) [2023-12-26 06:21:39,750][123090] Updated weights for policy 1, policy_version 842174 (0.0006) [2023-12-26 06:21:40,256][123091] Updated weights for policy 0, policy_version 848152 (0.0011) [2023-12-26 06:21:40,312][123091] Updated weights for policy 0, policy_version 848162 (0.0011) [2023-12-26 06:21:40,364][123091] Updated weights for policy 0, policy_version 848172 (0.0011) [2023-12-26 06:21:40,515][123090] Updated weights for policy 1, policy_version 842184 (0.0010) [2023-12-26 06:21:40,581][123090] Updated weights for policy 1, policy_version 842194 (0.0011) [2023-12-26 06:21:40,645][123090] Updated weights for policy 1, policy_version 842204 (0.0011) [2023-12-26 06:21:41,207][123091] Updated weights for policy 0, policy_version 848182 (0.0011) [2023-12-26 06:21:41,274][123091] Updated weights for policy 0, policy_version 848192 (0.0011) [2023-12-26 06:21:41,339][123091] Updated weights for policy 0, policy_version 848202 (0.0009) [2023-12-26 06:21:41,471][123090] Updated weights for policy 1, policy_version 842214 (0.0009) [2023-12-26 06:21:41,528][123090] Updated weights for policy 1, policy_version 842224 (0.0009) [2023-12-26 06:21:41,582][123090] Updated weights for policy 1, policy_version 842234 (0.0009) [2023-12-26 06:21:42,202][123091] Updated weights for policy 0, policy_version 848212 (0.0008) [2023-12-26 06:21:42,264][123091] Updated weights for policy 0, policy_version 848222 (0.0008) [2023-12-26 06:21:42,332][123091] Updated weights for policy 0, policy_version 848232 (0.0009) [2023-12-26 06:21:42,374][123090] Updated weights for policy 1, policy_version 842244 (0.0008) [2023-12-26 06:21:42,440][123090] Updated weights for policy 1, policy_version 842254 (0.0010) [2023-12-26 06:21:42,502][123090] Updated weights for policy 1, policy_version 842264 (0.0008) [2023-12-26 06:21:43,203][123091] Updated weights for policy 0, policy_version 848242 (0.0010) [2023-12-26 06:21:43,220][123090] Updated weights for policy 1, policy_version 842274 (0.0006) [2023-12-26 06:21:43,253][123091] Updated weights for policy 0, policy_version 848252 (0.0007) [2023-12-26 06:21:43,281][123090] Updated weights for policy 1, policy_version 842284 (0.0010) [2023-12-26 06:21:43,318][123091] Updated weights for policy 0, policy_version 848262 (0.0007) [2023-12-26 06:21:43,326][123090] Updated weights for policy 1, policy_version 842294 (0.0008) [2023-12-26 06:21:43,372][123091] Updated weights for policy 0, policy_version 848272 (0.0009) [2023-12-26 06:21:43,375][123090] Updated weights for policy 1, policy_version 842304 (0.0007) [2023-12-26 06:21:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 432791552. Throughput: 0: 9064.1, 1: 8611.9. Samples: 432784668. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:43,785][121949] Avg episode reward: [(0, '5954.528'), (1, '5877.386')] [2023-12-26 06:21:44,142][123091] Updated weights for policy 0, policy_version 848282 (0.0006) [2023-12-26 06:21:44,173][123090] Updated weights for policy 1, policy_version 842314 (0.0008) [2023-12-26 06:21:44,208][123091] Updated weights for policy 0, policy_version 848292 (0.0008) [2023-12-26 06:21:44,220][123090] Updated weights for policy 1, policy_version 842324 (0.0008) [2023-12-26 06:21:44,272][123091] Updated weights for policy 0, policy_version 848302 (0.0008) [2023-12-26 06:21:44,276][123090] Updated weights for policy 1, policy_version 842334 (0.0007) [2023-12-26 06:21:44,977][123091] Updated weights for policy 0, policy_version 848312 (0.0006) [2023-12-26 06:21:45,032][123091] Updated weights for policy 0, policy_version 848322 (0.0009) [2023-12-26 06:21:45,091][123091] Updated weights for policy 0, policy_version 848332 (0.0009) [2023-12-26 06:21:45,142][123090] Updated weights for policy 1, policy_version 842344 (0.0008) [2023-12-26 06:21:45,213][123090] Updated weights for policy 1, policy_version 842354 (0.0009) [2023-12-26 06:21:45,280][123090] Updated weights for policy 1, policy_version 842364 (0.0010) [2023-12-26 06:21:45,963][123091] Updated weights for policy 0, policy_version 848342 (0.0007) [2023-12-26 06:21:46,034][123091] Updated weights for policy 0, policy_version 848352 (0.0007) [2023-12-26 06:21:46,070][123090] Updated weights for policy 1, policy_version 842374 (0.0007) [2023-12-26 06:21:46,091][123091] Updated weights for policy 0, policy_version 848362 (0.0005) [2023-12-26 06:21:46,135][123090] Updated weights for policy 1, policy_version 842384 (0.0006) [2023-12-26 06:21:46,209][123090] Updated weights for policy 1, policy_version 842394 (0.0005) [2023-12-26 06:21:46,723][123091] Updated weights for policy 0, policy_version 848372 (0.0006) [2023-12-26 06:21:46,819][123091] Updated weights for policy 0, policy_version 848382 (0.0007) [2023-12-26 06:21:46,826][123090] Updated weights for policy 1, policy_version 842404 (0.0005) [2023-12-26 06:21:46,875][123091] Updated weights for policy 0, policy_version 848392 (0.0010) [2023-12-26 06:21:46,880][123090] Updated weights for policy 1, policy_version 842414 (0.0005) [2023-12-26 06:21:46,936][123090] Updated weights for policy 1, policy_version 842424 (0.0007) [2023-12-26 06:21:47,615][123090] Updated weights for policy 1, policy_version 842434 (0.0005) [2023-12-26 06:21:47,651][123091] Updated weights for policy 0, policy_version 848402 (0.0009) [2023-12-26 06:21:47,680][123090] Updated weights for policy 1, policy_version 842444 (0.0010) [2023-12-26 06:21:47,711][123091] Updated weights for policy 0, policy_version 848412 (0.0005) [2023-12-26 06:21:47,741][123090] Updated weights for policy 1, policy_version 842454 (0.0011) [2023-12-26 06:21:47,777][123091] Updated weights for policy 0, policy_version 848422 (0.0006) [2023-12-26 06:21:47,796][123090] Updated weights for policy 1, policy_version 842464 (0.0009) [2023-12-26 06:21:47,835][123091] Updated weights for policy 0, policy_version 848432 (0.0005) [2023-12-26 06:21:48,498][123090] Updated weights for policy 1, policy_version 842474 (0.0006) [2023-12-26 06:21:48,538][123091] Updated weights for policy 0, policy_version 848442 (0.0011) [2023-12-26 06:21:48,559][123090] Updated weights for policy 1, policy_version 842484 (0.0010) [2023-12-26 06:21:48,597][123091] Updated weights for policy 0, policy_version 848452 (0.0011) [2023-12-26 06:21:48,615][123090] Updated weights for policy 1, policy_version 842494 (0.0010) [2023-12-26 06:21:48,661][123091] Updated weights for policy 0, policy_version 848462 (0.0011) [2023-12-26 06:21:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 432889856. Throughput: 0: 9119.9, 1: 8767.7. Samples: 432896920. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:48,785][121949] Avg episode reward: [(0, '5885.910'), (1, '5828.797')] [2023-12-26 06:21:49,366][123091] Updated weights for policy 0, policy_version 848472 (0.0008) [2023-12-26 06:21:49,404][123090] Updated weights for policy 1, policy_version 842504 (0.0008) [2023-12-26 06:21:49,435][123091] Updated weights for policy 0, policy_version 848482 (0.0008) [2023-12-26 06:21:49,459][123090] Updated weights for policy 1, policy_version 842514 (0.0006) [2023-12-26 06:21:49,487][123091] Updated weights for policy 0, policy_version 848492 (0.0008) [2023-12-26 06:21:49,522][123090] Updated weights for policy 1, policy_version 842524 (0.0005) [2023-12-26 06:21:50,297][123091] Updated weights for policy 0, policy_version 848502 (0.0007) [2023-12-26 06:21:50,319][123090] Updated weights for policy 1, policy_version 842534 (0.0011) [2023-12-26 06:21:50,355][123091] Updated weights for policy 0, policy_version 848512 (0.0009) [2023-12-26 06:21:50,382][123090] Updated weights for policy 1, policy_version 842544 (0.0011) [2023-12-26 06:21:50,413][123091] Updated weights for policy 0, policy_version 848522 (0.0008) [2023-12-26 06:21:50,454][123090] Updated weights for policy 1, policy_version 842554 (0.0011) [2023-12-26 06:21:51,264][123091] Updated weights for policy 0, policy_version 848532 (0.0007) [2023-12-26 06:21:51,276][123090] Updated weights for policy 1, policy_version 842564 (0.0010) [2023-12-26 06:21:51,327][123091] Updated weights for policy 0, policy_version 848542 (0.0008) [2023-12-26 06:21:51,334][123090] Updated weights for policy 1, policy_version 842574 (0.0009) [2023-12-26 06:21:51,394][123091] Updated weights for policy 0, policy_version 848552 (0.0008) [2023-12-26 06:21:51,411][123090] Updated weights for policy 1, policy_version 842584 (0.0008) [2023-12-26 06:21:52,233][123091] Updated weights for policy 0, policy_version 848562 (0.0009) [2023-12-26 06:21:52,263][123090] Updated weights for policy 1, policy_version 842594 (0.0008) [2023-12-26 06:21:52,289][123091] Updated weights for policy 0, policy_version 848572 (0.0011) [2023-12-26 06:21:52,319][123090] Updated weights for policy 1, policy_version 842604 (0.0007) [2023-12-26 06:21:52,350][123091] Updated weights for policy 0, policy_version 848582 (0.0011) [2023-12-26 06:21:52,387][123090] Updated weights for policy 1, policy_version 842614 (0.0007) [2023-12-26 06:21:52,413][123091] Updated weights for policy 0, policy_version 848592 (0.0011) [2023-12-26 06:21:52,441][123090] Updated weights for policy 1, policy_version 842624 (0.0009) [2023-12-26 06:21:53,224][123090] Updated weights for policy 1, policy_version 842634 (0.0007) [2023-12-26 06:21:53,268][123091] Updated weights for policy 0, policy_version 848602 (0.0008) [2023-12-26 06:21:53,278][123090] Updated weights for policy 1, policy_version 842644 (0.0007) [2023-12-26 06:21:53,334][123091] Updated weights for policy 0, policy_version 848612 (0.0009) [2023-12-26 06:21:53,351][123090] Updated weights for policy 1, policy_version 842654 (0.0006) [2023-12-26 06:21:53,396][123091] Updated weights for policy 0, policy_version 848622 (0.0009) [2023-12-26 06:21:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 432971776. Throughput: 0: 9070.0, 1: 8740.7. Samples: 432949604. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:53,785][121949] Avg episode reward: [(0, '6017.297'), (1, '5842.787')] [2023-12-26 06:21:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000848624_217251840.pth... [2023-12-26 06:21:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000842656_215719936.pth... [2023-12-26 06:21:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000847568_216981504.pth [2023-12-26 06:21:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000841632_215457792.pth [2023-12-26 06:21:53,934][123090] Updated weights for policy 1, policy_version 842664 (0.0005) [2023-12-26 06:21:53,991][123090] Updated weights for policy 1, policy_version 842674 (0.0005) [2023-12-26 06:21:54,046][123090] Updated weights for policy 1, policy_version 842684 (0.0006) [2023-12-26 06:21:54,144][123091] Updated weights for policy 0, policy_version 848632 (0.0008) [2023-12-26 06:21:54,205][123091] Updated weights for policy 0, policy_version 848642 (0.0009) [2023-12-26 06:21:54,267][123091] Updated weights for policy 0, policy_version 848653 (0.0010) [2023-12-26 06:21:54,829][123090] Updated weights for policy 1, policy_version 842694 (0.0010) [2023-12-26 06:21:54,897][123090] Updated weights for policy 1, policy_version 842704 (0.0009) [2023-12-26 06:21:54,967][123090] Updated weights for policy 1, policy_version 842714 (0.0007) [2023-12-26 06:21:55,142][123091] Updated weights for policy 0, policy_version 848663 (0.0009) [2023-12-26 06:21:55,207][123091] Updated weights for policy 0, policy_version 848673 (0.0009) [2023-12-26 06:21:55,260][123091] Updated weights for policy 0, policy_version 848684 (0.0007) [2023-12-26 06:21:55,609][123090] Updated weights for policy 1, policy_version 842724 (0.0007) [2023-12-26 06:21:55,658][123090] Updated weights for policy 1, policy_version 842734 (0.0009) [2023-12-26 06:21:55,712][123090] Updated weights for policy 1, policy_version 842744 (0.0010) [2023-12-26 06:21:55,936][123091] Updated weights for policy 0, policy_version 848694 (0.0006) [2023-12-26 06:21:55,985][123091] Updated weights for policy 0, policy_version 848704 (0.0005) [2023-12-26 06:21:56,039][123091] Updated weights for policy 0, policy_version 848714 (0.0005) [2023-12-26 06:21:56,637][123090] Updated weights for policy 1, policy_version 842755 (0.0010) [2023-12-26 06:21:56,694][123091] Updated weights for policy 0, policy_version 848724 (0.0007) [2023-12-26 06:21:56,696][123090] Updated weights for policy 1, policy_version 842765 (0.0008) [2023-12-26 06:21:56,740][123091] Updated weights for policy 0, policy_version 848734 (0.0005) [2023-12-26 06:21:56,754][123090] Updated weights for policy 1, policy_version 842775 (0.0008) [2023-12-26 06:21:56,789][123091] Updated weights for policy 0, policy_version 848744 (0.0006) [2023-12-26 06:21:57,430][123090] Updated weights for policy 1, policy_version 842785 (0.0008) [2023-12-26 06:21:57,484][123090] Updated weights for policy 1, policy_version 842795 (0.0010) [2023-12-26 06:21:57,542][123090] Updated weights for policy 1, policy_version 842806 (0.0010) [2023-12-26 06:21:57,561][123091] Updated weights for policy 0, policy_version 848754 (0.0009) [2023-12-26 06:21:57,595][123090] Updated weights for policy 1, policy_version 842816 (0.0007) [2023-12-26 06:21:57,620][123091] Updated weights for policy 0, policy_version 848764 (0.0006) [2023-12-26 06:21:57,678][123091] Updated weights for policy 0, policy_version 848774 (0.0005) [2023-12-26 06:21:57,737][123091] Updated weights for policy 0, policy_version 848784 (0.0006) [2023-12-26 06:21:58,476][123090] Updated weights for policy 1, policy_version 842826 (0.0008) [2023-12-26 06:21:58,518][123091] Updated weights for policy 0, policy_version 848794 (0.0009) [2023-12-26 06:21:58,544][123090] Updated weights for policy 1, policy_version 842836 (0.0008) [2023-12-26 06:21:58,585][123091] Updated weights for policy 0, policy_version 848804 (0.0008) [2023-12-26 06:21:58,618][123090] Updated weights for policy 1, policy_version 842846 (0.0010) [2023-12-26 06:21:58,662][123091] Updated weights for policy 0, policy_version 848814 (0.0007) [2023-12-26 06:21:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 433070080. Throughput: 0: 9119.7, 1: 8834.1. Samples: 433059460. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:21:58,785][121949] Avg episode reward: [(0, '6187.422'), (1, '5739.141')] [2023-12-26 06:21:59,456][123090] Updated weights for policy 1, policy_version 842856 (0.0009) [2023-12-26 06:21:59,509][123090] Updated weights for policy 1, policy_version 842866 (0.0009) [2023-12-26 06:21:59,567][123090] Updated weights for policy 1, policy_version 842876 (0.0009) [2023-12-26 06:21:59,575][123091] Updated weights for policy 0, policy_version 848824 (0.0006) [2023-12-26 06:21:59,622][123091] Updated weights for policy 0, policy_version 848834 (0.0005) [2023-12-26 06:21:59,670][123091] Updated weights for policy 0, policy_version 848844 (0.0005) [2023-12-26 06:22:00,403][123090] Updated weights for policy 1, policy_version 842886 (0.0010) [2023-12-26 06:22:00,451][123090] Updated weights for policy 1, policy_version 842896 (0.0010) [2023-12-26 06:22:00,457][123091] Updated weights for policy 0, policy_version 848854 (0.0008) [2023-12-26 06:22:00,502][123090] Updated weights for policy 1, policy_version 842906 (0.0010) [2023-12-26 06:22:00,505][123091] Updated weights for policy 0, policy_version 848864 (0.0006) [2023-12-26 06:22:00,562][123091] Updated weights for policy 0, policy_version 848874 (0.0006) [2023-12-26 06:22:01,157][123090] Updated weights for policy 1, policy_version 842916 (0.0009) [2023-12-26 06:22:01,223][123090] Updated weights for policy 1, policy_version 842926 (0.0006) [2023-12-26 06:22:01,283][123090] Updated weights for policy 1, policy_version 842936 (0.0008) [2023-12-26 06:22:01,478][123091] Updated weights for policy 0, policy_version 848884 (0.0006) [2023-12-26 06:22:01,531][123091] Updated weights for policy 0, policy_version 848894 (0.0005) [2023-12-26 06:22:01,586][123091] Updated weights for policy 0, policy_version 848904 (0.0005) [2023-12-26 06:22:02,098][123090] Updated weights for policy 1, policy_version 842946 (0.0008) [2023-12-26 06:22:02,160][123090] Updated weights for policy 1, policy_version 842956 (0.0010) [2023-12-26 06:22:02,219][123090] Updated weights for policy 1, policy_version 842966 (0.0010) [2023-12-26 06:22:02,282][123090] Updated weights for policy 1, policy_version 842976 (0.0007) [2023-12-26 06:22:02,290][123091] Updated weights for policy 0, policy_version 848914 (0.0007) [2023-12-26 06:22:02,361][123091] Updated weights for policy 0, policy_version 848924 (0.0006) [2023-12-26 06:22:02,435][123091] Updated weights for policy 0, policy_version 848934 (0.0005) [2023-12-26 06:22:02,498][123091] Updated weights for policy 0, policy_version 848944 (0.0005) [2023-12-26 06:22:03,074][123090] Updated weights for policy 1, policy_version 842986 (0.0010) [2023-12-26 06:22:03,128][123090] Updated weights for policy 1, policy_version 842996 (0.0010) [2023-12-26 06:22:03,154][123091] Updated weights for policy 0, policy_version 848954 (0.0008) [2023-12-26 06:22:03,175][123090] Updated weights for policy 1, policy_version 843006 (0.0010) [2023-12-26 06:22:03,213][123091] Updated weights for policy 0, policy_version 848964 (0.0008) [2023-12-26 06:22:03,265][123091] Updated weights for policy 0, policy_version 848974 (0.0008) [2023-12-26 06:22:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 433152000. Throughput: 0: 9074.2, 1: 8817.4. Samples: 433165892. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:03,785][121949] Avg episode reward: [(0, '6174.373'), (1, '5639.021')] [2023-12-26 06:22:03,947][123090] Updated weights for policy 1, policy_version 843016 (0.0008) [2023-12-26 06:22:03,948][123091] Updated weights for policy 0, policy_version 848984 (0.0008) [2023-12-26 06:22:04,004][123090] Updated weights for policy 1, policy_version 843026 (0.0007) [2023-12-26 06:22:04,010][123091] Updated weights for policy 0, policy_version 848994 (0.0008) [2023-12-26 06:22:04,056][123090] Updated weights for policy 1, policy_version 843036 (0.0010) [2023-12-26 06:22:04,068][123091] Updated weights for policy 0, policy_version 849004 (0.0008) [2023-12-26 06:22:04,732][123091] Updated weights for policy 0, policy_version 849014 (0.0006) [2023-12-26 06:22:04,802][123091] Updated weights for policy 0, policy_version 849024 (0.0005) [2023-12-26 06:22:04,861][123091] Updated weights for policy 0, policy_version 849034 (0.0006) [2023-12-26 06:22:04,907][123090] Updated weights for policy 1, policy_version 843046 (0.0010) [2023-12-26 06:22:04,956][123090] Updated weights for policy 1, policy_version 843056 (0.0010) [2023-12-26 06:22:05,000][123090] Updated weights for policy 1, policy_version 843066 (0.0010) [2023-12-26 06:22:05,450][123091] Updated weights for policy 0, policy_version 849044 (0.0005) [2023-12-26 06:22:05,517][123091] Updated weights for policy 0, policy_version 849054 (0.0005) [2023-12-26 06:22:05,578][123091] Updated weights for policy 0, policy_version 849064 (0.0008) [2023-12-26 06:22:05,676][123090] Updated weights for policy 1, policy_version 843076 (0.0006) [2023-12-26 06:22:05,737][123090] Updated weights for policy 1, policy_version 843086 (0.0005) [2023-12-26 06:22:05,802][123090] Updated weights for policy 1, policy_version 843096 (0.0005) [2023-12-26 06:22:06,274][123091] Updated weights for policy 0, policy_version 849074 (0.0009) [2023-12-26 06:22:06,348][123091] Updated weights for policy 0, policy_version 849084 (0.0006) [2023-12-26 06:22:06,427][123091] Updated weights for policy 0, policy_version 849094 (0.0006) [2023-12-26 06:22:06,489][123090] Updated weights for policy 1, policy_version 843106 (0.0009) [2023-12-26 06:22:06,493][123091] Updated weights for policy 0, policy_version 849104 (0.0006) [2023-12-26 06:22:06,549][123090] Updated weights for policy 1, policy_version 843116 (0.0006) [2023-12-26 06:22:06,618][123090] Updated weights for policy 1, policy_version 843126 (0.0005) [2023-12-26 06:22:06,684][123090] Updated weights for policy 1, policy_version 843136 (0.0007) [2023-12-26 06:22:07,150][123091] Updated weights for policy 0, policy_version 849114 (0.0005) [2023-12-26 06:22:07,211][123091] Updated weights for policy 0, policy_version 849124 (0.0005) [2023-12-26 06:22:07,273][123091] Updated weights for policy 0, policy_version 849134 (0.0007) [2023-12-26 06:22:07,502][123090] Updated weights for policy 1, policy_version 843146 (0.0006) [2023-12-26 06:22:07,551][123090] Updated weights for policy 1, policy_version 843156 (0.0010) [2023-12-26 06:22:07,600][123090] Updated weights for policy 1, policy_version 843166 (0.0010) [2023-12-26 06:22:08,032][123091] Updated weights for policy 0, policy_version 849144 (0.0007) [2023-12-26 06:22:08,087][123091] Updated weights for policy 0, policy_version 849154 (0.0005) [2023-12-26 06:22:08,139][123091] Updated weights for policy 0, policy_version 849164 (0.0005) [2023-12-26 06:22:08,443][123090] Updated weights for policy 1, policy_version 843176 (0.0009) [2023-12-26 06:22:08,506][123090] Updated weights for policy 1, policy_version 843186 (0.0009) [2023-12-26 06:22:08,566][123090] Updated weights for policy 1, policy_version 843196 (0.0008) [2023-12-26 06:22:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 433250304. Throughput: 0: 9133.2, 1: 8882.6. Samples: 433224660. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:08,785][121949] Avg episode reward: [(0, '6028.420'), (1, '5705.907')] [2023-12-26 06:22:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000843200_215859200.pth... [2023-12-26 06:22:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000849168_217391104.pth... [2023-12-26 06:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000842144_215588864.pth [2023-12-26 06:22:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000848112_217120768.pth [2023-12-26 06:22:08,912][123091] Updated weights for policy 0, policy_version 849174 (0.0008) [2023-12-26 06:22:08,975][123091] Updated weights for policy 0, policy_version 849184 (0.0010) [2023-12-26 06:22:09,033][123091] Updated weights for policy 0, policy_version 849194 (0.0010) [2023-12-26 06:22:09,377][123090] Updated weights for policy 1, policy_version 843206 (0.0009) [2023-12-26 06:22:09,446][123090] Updated weights for policy 1, policy_version 843216 (0.0009) [2023-12-26 06:22:09,506][123090] Updated weights for policy 1, policy_version 843226 (0.0009) [2023-12-26 06:22:09,894][123091] Updated weights for policy 0, policy_version 849204 (0.0011) [2023-12-26 06:22:09,956][123091] Updated weights for policy 0, policy_version 849214 (0.0010) [2023-12-26 06:22:10,024][123091] Updated weights for policy 0, policy_version 849224 (0.0011) [2023-12-26 06:22:10,332][123090] Updated weights for policy 1, policy_version 843236 (0.0009) [2023-12-26 06:22:10,392][123090] Updated weights for policy 1, policy_version 843246 (0.0009) [2023-12-26 06:22:10,463][123090] Updated weights for policy 1, policy_version 843256 (0.0010) [2023-12-26 06:22:10,821][123091] Updated weights for policy 0, policy_version 849234 (0.0010) [2023-12-26 06:22:10,882][123091] Updated weights for policy 0, policy_version 849244 (0.0008) [2023-12-26 06:22:10,949][123091] Updated weights for policy 0, policy_version 849254 (0.0005) [2023-12-26 06:22:11,008][123091] Updated weights for policy 0, policy_version 849264 (0.0010) [2023-12-26 06:22:11,361][123090] Updated weights for policy 1, policy_version 843266 (0.0009) [2023-12-26 06:22:11,439][123090] Updated weights for policy 1, policy_version 843276 (0.0008) [2023-12-26 06:22:11,494][123090] Updated weights for policy 1, policy_version 843286 (0.0008) [2023-12-26 06:22:11,551][123090] Updated weights for policy 1, policy_version 843296 (0.0009) [2023-12-26 06:22:11,860][123091] Updated weights for policy 0, policy_version 849274 (0.0010) [2023-12-26 06:22:11,917][123091] Updated weights for policy 0, policy_version 849284 (0.0010) [2023-12-26 06:22:11,968][123091] Updated weights for policy 0, policy_version 849295 (0.0009) [2023-12-26 06:22:12,421][123090] Updated weights for policy 1, policy_version 843306 (0.0009) [2023-12-26 06:22:12,490][123090] Updated weights for policy 1, policy_version 843316 (0.0009) [2023-12-26 06:22:12,548][123090] Updated weights for policy 1, policy_version 843326 (0.0010) [2023-12-26 06:22:12,810][123091] Updated weights for policy 0, policy_version 849305 (0.0008) [2023-12-26 06:22:12,864][123091] Updated weights for policy 0, policy_version 849315 (0.0009) [2023-12-26 06:22:12,920][123091] Updated weights for policy 0, policy_version 849325 (0.0010) [2023-12-26 06:22:13,411][123090] Updated weights for policy 1, policy_version 843336 (0.0009) [2023-12-26 06:22:13,464][123090] Updated weights for policy 1, policy_version 843346 (0.0010) [2023-12-26 06:22:13,519][123090] Updated weights for policy 1, policy_version 843356 (0.0009) [2023-12-26 06:22:13,661][123091] Updated weights for policy 0, policy_version 849335 (0.0007) [2023-12-26 06:22:13,710][123091] Updated weights for policy 0, policy_version 849345 (0.0010) [2023-12-26 06:22:13,770][123091] Updated weights for policy 0, policy_version 849355 (0.0010) [2023-12-26 06:22:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 433332224. Throughput: 0: 9117.2, 1: 8871.3. Samples: 433328892. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:13,784][121949] Avg episode reward: [(0, '6196.154'), (1, '5833.938')] [2023-12-26 06:22:14,355][123090] Updated weights for policy 1, policy_version 843366 (0.0009) [2023-12-26 06:22:14,419][123090] Updated weights for policy 1, policy_version 843376 (0.0010) [2023-12-26 06:22:14,469][123090] Updated weights for policy 1, policy_version 843386 (0.0010) [2023-12-26 06:22:14,589][123091] Updated weights for policy 0, policy_version 849365 (0.0011) [2023-12-26 06:22:14,648][123091] Updated weights for policy 0, policy_version 849375 (0.0011) [2023-12-26 06:22:14,699][123091] Updated weights for policy 0, policy_version 849385 (0.0010) [2023-12-26 06:22:15,285][123090] Updated weights for policy 1, policy_version 843396 (0.0010) [2023-12-26 06:22:15,350][123090] Updated weights for policy 1, policy_version 843406 (0.0009) [2023-12-26 06:22:15,420][123090] Updated weights for policy 1, policy_version 843416 (0.0007) [2023-12-26 06:22:15,486][123091] Updated weights for policy 0, policy_version 849395 (0.0011) [2023-12-26 06:22:15,559][123091] Updated weights for policy 0, policy_version 849405 (0.0010) [2023-12-26 06:22:15,625][123091] Updated weights for policy 0, policy_version 849415 (0.0009) [2023-12-26 06:22:16,280][123090] Updated weights for policy 1, policy_version 843426 (0.0008) [2023-12-26 06:22:16,288][123091] Updated weights for policy 0, policy_version 849425 (0.0005) [2023-12-26 06:22:16,346][123091] Updated weights for policy 0, policy_version 849435 (0.0008) [2023-12-26 06:22:16,348][123090] Updated weights for policy 1, policy_version 843436 (0.0008) [2023-12-26 06:22:16,405][123091] Updated weights for policy 0, policy_version 849445 (0.0006) [2023-12-26 06:22:16,410][123090] Updated weights for policy 1, policy_version 843446 (0.0009) [2023-12-26 06:22:16,466][123091] Updated weights for policy 0, policy_version 849455 (0.0008) [2023-12-26 06:22:16,474][123090] Updated weights for policy 1, policy_version 843456 (0.0008) [2023-12-26 06:22:17,172][123090] Updated weights for policy 1, policy_version 843466 (0.0007) [2023-12-26 06:22:17,224][123090] Updated weights for policy 1, policy_version 843476 (0.0010) [2023-12-26 06:22:17,238][123091] Updated weights for policy 0, policy_version 849465 (0.0009) [2023-12-26 06:22:17,286][123090] Updated weights for policy 1, policy_version 843486 (0.0010) [2023-12-26 06:22:17,297][123091] Updated weights for policy 0, policy_version 849475 (0.0006) [2023-12-26 06:22:17,363][123091] Updated weights for policy 0, policy_version 849485 (0.0009) [2023-12-26 06:22:18,039][123091] Updated weights for policy 0, policy_version 849495 (0.0007) [2023-12-26 06:22:18,054][123090] Updated weights for policy 1, policy_version 843496 (0.0011) [2023-12-26 06:22:18,101][123091] Updated weights for policy 0, policy_version 849505 (0.0005) [2023-12-26 06:22:18,120][123090] Updated weights for policy 1, policy_version 843506 (0.0005) [2023-12-26 06:22:18,171][123091] Updated weights for policy 0, policy_version 849515 (0.0005) [2023-12-26 06:22:18,191][123090] Updated weights for policy 1, policy_version 843516 (0.0005) [2023-12-26 06:22:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 433422336. Throughput: 0: 9167.8, 1: 8905.9. Samples: 433438620. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:18,785][121949] Avg episode reward: [(0, '6121.968'), (1, '5879.902')] [2023-12-26 06:22:18,862][123090] Updated weights for policy 1, policy_version 843526 (0.0005) [2023-12-26 06:22:18,895][123091] Updated weights for policy 0, policy_version 849525 (0.0007) [2023-12-26 06:22:18,929][123090] Updated weights for policy 1, policy_version 843536 (0.0008) [2023-12-26 06:22:18,963][123091] Updated weights for policy 0, policy_version 849535 (0.0009) [2023-12-26 06:22:18,995][123090] Updated weights for policy 1, policy_version 843546 (0.0007) [2023-12-26 06:22:19,033][123091] Updated weights for policy 0, policy_version 849545 (0.0008) [2023-12-26 06:22:19,778][123090] Updated weights for policy 1, policy_version 843556 (0.0008) [2023-12-26 06:22:19,812][123091] Updated weights for policy 0, policy_version 849555 (0.0009) [2023-12-26 06:22:19,854][123090] Updated weights for policy 1, policy_version 843566 (0.0011) [2023-12-26 06:22:19,880][123091] Updated weights for policy 0, policy_version 849565 (0.0011) [2023-12-26 06:22:19,923][123090] Updated weights for policy 1, policy_version 843576 (0.0009) [2023-12-26 06:22:19,950][123091] Updated weights for policy 0, policy_version 849575 (0.0011) [2023-12-26 06:22:20,655][123091] Updated weights for policy 0, policy_version 849585 (0.0011) [2023-12-26 06:22:20,719][123091] Updated weights for policy 0, policy_version 849595 (0.0010) [2023-12-26 06:22:20,749][123090] Updated weights for policy 1, policy_version 843586 (0.0009) [2023-12-26 06:22:20,788][123091] Updated weights for policy 0, policy_version 849605 (0.0009) [2023-12-26 06:22:20,818][123090] Updated weights for policy 1, policy_version 843596 (0.0011) [2023-12-26 06:22:20,853][123091] Updated weights for policy 0, policy_version 849615 (0.0011) [2023-12-26 06:22:20,878][123090] Updated weights for policy 1, policy_version 843606 (0.0011) [2023-12-26 06:22:20,931][123090] Updated weights for policy 1, policy_version 843616 (0.0011) [2023-12-26 06:22:21,734][123091] Updated weights for policy 0, policy_version 849625 (0.0011) [2023-12-26 06:22:21,804][123091] Updated weights for policy 0, policy_version 849635 (0.0011) [2023-12-26 06:22:21,833][123090] Updated weights for policy 1, policy_version 843626 (0.0008) [2023-12-26 06:22:21,873][123091] Updated weights for policy 0, policy_version 849645 (0.0011) [2023-12-26 06:22:21,893][123090] Updated weights for policy 1, policy_version 843636 (0.0008) [2023-12-26 06:22:21,955][123090] Updated weights for policy 1, policy_version 843646 (0.0009) [2023-12-26 06:22:22,661][123091] Updated weights for policy 0, policy_version 849655 (0.0009) [2023-12-26 06:22:22,732][123091] Updated weights for policy 0, policy_version 849665 (0.0011) [2023-12-26 06:22:22,798][123090] Updated weights for policy 1, policy_version 843656 (0.0008) [2023-12-26 06:22:22,801][123091] Updated weights for policy 0, policy_version 849675 (0.0006) [2023-12-26 06:22:22,870][123090] Updated weights for policy 1, policy_version 843666 (0.0009) [2023-12-26 06:22:22,928][123090] Updated weights for policy 1, policy_version 843676 (0.0009) [2023-12-26 06:22:23,557][123091] Updated weights for policy 0, policy_version 849685 (0.0006) [2023-12-26 06:22:23,613][123091] Updated weights for policy 0, policy_version 849695 (0.0005) [2023-12-26 06:22:23,672][123091] Updated weights for policy 0, policy_version 849705 (0.0005) [2023-12-26 06:22:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 433512448. Throughput: 0: 9070.9, 1: 8901.0. Samples: 433490632. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:23,784][121949] Avg episode reward: [(0, '6119.237'), (1, '5958.921')] [2023-12-26 06:22:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000849712_217530368.pth... [2023-12-26 06:22:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000848624_217251840.pth [2023-12-26 06:22:23,796][123090] Updated weights for policy 1, policy_version 843686 (0.0010) [2023-12-26 06:22:23,850][123090] Updated weights for policy 1, policy_version 843696 (0.0010) [2023-12-26 06:22:23,904][123090] Updated weights for policy 1, policy_version 843706 (0.0010) [2023-12-26 06:22:23,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000843712_215990272.pth... [2023-12-26 06:22:23,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000842656_215719936.pth [2023-12-26 06:22:24,352][123091] Updated weights for policy 0, policy_version 849715 (0.0007) [2023-12-26 06:22:24,406][123091] Updated weights for policy 0, policy_version 849725 (0.0008) [2023-12-26 06:22:24,467][123091] Updated weights for policy 0, policy_version 849735 (0.0006) [2023-12-26 06:22:24,828][123090] Updated weights for policy 1, policy_version 843716 (0.0011) [2023-12-26 06:22:24,882][123090] Updated weights for policy 1, policy_version 843727 (0.0009) [2023-12-26 06:22:24,942][123090] Updated weights for policy 1, policy_version 843737 (0.0008) [2023-12-26 06:22:25,210][123091] Updated weights for policy 0, policy_version 849745 (0.0006) [2023-12-26 06:22:25,275][123091] Updated weights for policy 0, policy_version 849755 (0.0011) [2023-12-26 06:22:25,326][123091] Updated weights for policy 0, policy_version 849765 (0.0010) [2023-12-26 06:22:25,380][123091] Updated weights for policy 0, policy_version 849775 (0.0010) [2023-12-26 06:22:25,750][123090] Updated weights for policy 1, policy_version 843747 (0.0009) [2023-12-26 06:22:25,797][123090] Updated weights for policy 1, policy_version 843757 (0.0008) [2023-12-26 06:22:25,853][123090] Updated weights for policy 1, policy_version 843767 (0.0009) [2023-12-26 06:22:26,218][123091] Updated weights for policy 0, policy_version 849785 (0.0009) [2023-12-26 06:22:26,278][123091] Updated weights for policy 0, policy_version 849795 (0.0009) [2023-12-26 06:22:26,341][123091] Updated weights for policy 0, policy_version 849805 (0.0009) [2023-12-26 06:22:26,615][123090] Updated weights for policy 1, policy_version 843777 (0.0008) [2023-12-26 06:22:26,670][123090] Updated weights for policy 1, policy_version 843787 (0.0009) [2023-12-26 06:22:26,724][123090] Updated weights for policy 1, policy_version 843797 (0.0010) [2023-12-26 06:22:26,781][123090] Updated weights for policy 1, policy_version 843807 (0.0010) [2023-12-26 06:22:27,165][123091] Updated weights for policy 0, policy_version 849815 (0.0009) [2023-12-26 06:22:27,216][123091] Updated weights for policy 0, policy_version 849825 (0.0009) [2023-12-26 06:22:27,271][123091] Updated weights for policy 0, policy_version 849835 (0.0009) [2023-12-26 06:22:27,598][123090] Updated weights for policy 1, policy_version 843817 (0.0010) [2023-12-26 06:22:27,646][123090] Updated weights for policy 1, policy_version 843827 (0.0010) [2023-12-26 06:22:27,693][123090] Updated weights for policy 1, policy_version 843837 (0.0010) [2023-12-26 06:22:28,058][123091] Updated weights for policy 0, policy_version 849845 (0.0007) [2023-12-26 06:22:28,110][123091] Updated weights for policy 0, policy_version 849855 (0.0006) [2023-12-26 06:22:28,168][123091] Updated weights for policy 0, policy_version 849865 (0.0008) [2023-12-26 06:22:28,504][123090] Updated weights for policy 1, policy_version 843847 (0.0010) [2023-12-26 06:22:28,552][123090] Updated weights for policy 1, policy_version 843857 (0.0010) [2023-12-26 06:22:28,606][123090] Updated weights for policy 1, policy_version 843867 (0.0010) [2023-12-26 06:22:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 433602560. Throughput: 0: 9126.8, 1: 8871.6. Samples: 433594592. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:28,784][121949] Avg episode reward: [(0, '6059.134'), (1, '6009.103')] [2023-12-26 06:22:29,001][123091] Updated weights for policy 0, policy_version 849875 (0.0009) [2023-12-26 06:22:29,048][123091] Updated weights for policy 0, policy_version 849885 (0.0009) [2023-12-26 06:22:29,096][123091] Updated weights for policy 0, policy_version 849895 (0.0009) [2023-12-26 06:22:29,402][123090] Updated weights for policy 1, policy_version 843877 (0.0010) [2023-12-26 06:22:29,473][123090] Updated weights for policy 1, policy_version 843887 (0.0010) [2023-12-26 06:22:29,544][123090] Updated weights for policy 1, policy_version 843897 (0.0006) [2023-12-26 06:22:29,948][123091] Updated weights for policy 0, policy_version 849905 (0.0009) [2023-12-26 06:22:30,000][123091] Updated weights for policy 0, policy_version 849915 (0.0010) [2023-12-26 06:22:30,058][123091] Updated weights for policy 0, policy_version 849925 (0.0008) [2023-12-26 06:22:30,117][123091] Updated weights for policy 0, policy_version 849935 (0.0007) [2023-12-26 06:22:30,266][123090] Updated weights for policy 1, policy_version 843907 (0.0005) [2023-12-26 06:22:30,328][123090] Updated weights for policy 1, policy_version 843917 (0.0009) [2023-12-26 06:22:30,373][123090] Updated weights for policy 1, policy_version 843927 (0.0010) [2023-12-26 06:22:30,877][123091] Updated weights for policy 0, policy_version 849945 (0.0006) [2023-12-26 06:22:30,927][123091] Updated weights for policy 0, policy_version 849955 (0.0005) [2023-12-26 06:22:30,972][123091] Updated weights for policy 0, policy_version 849965 (0.0005) [2023-12-26 06:22:31,200][123090] Updated weights for policy 1, policy_version 843937 (0.0010) [2023-12-26 06:22:31,269][123090] Updated weights for policy 1, policy_version 843947 (0.0008) [2023-12-26 06:22:31,323][123090] Updated weights for policy 1, policy_version 843957 (0.0007) [2023-12-26 06:22:31,402][123090] Updated weights for policy 1, policy_version 843967 (0.0008) [2023-12-26 06:22:31,712][123091] Updated weights for policy 0, policy_version 849975 (0.0006) [2023-12-26 06:22:31,776][123091] Updated weights for policy 0, policy_version 849985 (0.0009) [2023-12-26 06:22:31,825][123091] Updated weights for policy 0, policy_version 849995 (0.0009) [2023-12-26 06:22:32,228][123090] Updated weights for policy 1, policy_version 843977 (0.0010) [2023-12-26 06:22:32,291][123090] Updated weights for policy 1, policy_version 843987 (0.0010) [2023-12-26 06:22:32,347][123090] Updated weights for policy 1, policy_version 843997 (0.0010) [2023-12-26 06:22:32,646][123091] Updated weights for policy 0, policy_version 850005 (0.0009) [2023-12-26 06:22:32,702][123091] Updated weights for policy 0, policy_version 850015 (0.0009) [2023-12-26 06:22:32,755][123091] Updated weights for policy 0, policy_version 850025 (0.0010) [2023-12-26 06:22:33,115][123090] Updated weights for policy 1, policy_version 844007 (0.0007) [2023-12-26 06:22:33,172][123090] Updated weights for policy 1, policy_version 844017 (0.0005) [2023-12-26 06:22:33,221][123090] Updated weights for policy 1, policy_version 844027 (0.0005) [2023-12-26 06:22:33,551][123091] Updated weights for policy 0, policy_version 850035 (0.0008) [2023-12-26 06:22:33,614][123091] Updated weights for policy 0, policy_version 850045 (0.0005) [2023-12-26 06:22:33,680][123091] Updated weights for policy 0, policy_version 850055 (0.0005) [2023-12-26 06:22:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 433692672. Throughput: 0: 9088.3, 1: 8829.6. Samples: 433703228. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:33,785][121949] Avg episode reward: [(0, '6112.261'), (1, '5803.930')] [2023-12-26 06:22:33,896][123090] Updated weights for policy 1, policy_version 844037 (0.0007) [2023-12-26 06:22:33,959][123090] Updated weights for policy 1, policy_version 844047 (0.0009) [2023-12-26 06:22:34,020][123090] Updated weights for policy 1, policy_version 844057 (0.0009) [2023-12-26 06:22:34,323][123091] Updated weights for policy 0, policy_version 850065 (0.0009) [2023-12-26 06:22:34,396][123091] Updated weights for policy 0, policy_version 850075 (0.0006) [2023-12-26 06:22:34,470][123091] Updated weights for policy 0, policy_version 850085 (0.0006) [2023-12-26 06:22:34,539][123091] Updated weights for policy 0, policy_version 850095 (0.0006) [2023-12-26 06:22:34,816][123090] Updated weights for policy 1, policy_version 844067 (0.0008) [2023-12-26 06:22:34,883][123090] Updated weights for policy 1, policy_version 844077 (0.0005) [2023-12-26 06:22:34,940][123090] Updated weights for policy 1, policy_version 844087 (0.0007) [2023-12-26 06:22:35,156][123091] Updated weights for policy 0, policy_version 850105 (0.0006) [2023-12-26 06:22:35,203][123091] Updated weights for policy 0, policy_version 850115 (0.0006) [2023-12-26 06:22:35,258][123091] Updated weights for policy 0, policy_version 850125 (0.0005) [2023-12-26 06:22:35,707][123090] Updated weights for policy 1, policy_version 844097 (0.0010) [2023-12-26 06:22:35,759][123090] Updated weights for policy 1, policy_version 844107 (0.0010) [2023-12-26 06:22:35,807][123090] Updated weights for policy 1, policy_version 844117 (0.0010) [2023-12-26 06:22:35,864][123090] Updated weights for policy 1, policy_version 844127 (0.0010) [2023-12-26 06:22:35,958][123091] Updated weights for policy 0, policy_version 850135 (0.0009) [2023-12-26 06:22:36,023][123091] Updated weights for policy 0, policy_version 850145 (0.0011) [2023-12-26 06:22:36,081][123091] Updated weights for policy 0, policy_version 850155 (0.0010) [2023-12-26 06:22:36,712][123090] Updated weights for policy 1, policy_version 844137 (0.0009) [2023-12-26 06:22:36,770][123090] Updated weights for policy 1, policy_version 844147 (0.0009) [2023-12-26 06:22:36,829][123090] Updated weights for policy 1, policy_version 844157 (0.0008) [2023-12-26 06:22:36,897][123091] Updated weights for policy 0, policy_version 850165 (0.0011) [2023-12-26 06:22:36,943][123091] Updated weights for policy 0, policy_version 850175 (0.0009) [2023-12-26 06:22:37,002][123091] Updated weights for policy 0, policy_version 850185 (0.0005) [2023-12-26 06:22:37,623][123090] Updated weights for policy 1, policy_version 844167 (0.0006) [2023-12-26 06:22:37,692][123090] Updated weights for policy 1, policy_version 844177 (0.0005) [2023-12-26 06:22:37,764][123090] Updated weights for policy 1, policy_version 844187 (0.0008) [2023-12-26 06:22:37,774][123091] Updated weights for policy 0, policy_version 850195 (0.0007) [2023-12-26 06:22:37,829][123091] Updated weights for policy 0, policy_version 850205 (0.0011) [2023-12-26 06:22:37,884][123091] Updated weights for policy 0, policy_version 850215 (0.0010) [2023-12-26 06:22:38,406][123090] Updated weights for policy 1, policy_version 844197 (0.0006) [2023-12-26 06:22:38,466][123090] Updated weights for policy 1, policy_version 844207 (0.0007) [2023-12-26 06:22:38,530][123090] Updated weights for policy 1, policy_version 844217 (0.0009) [2023-12-26 06:22:38,716][123091] Updated weights for policy 0, policy_version 850225 (0.0010) [2023-12-26 06:22:38,776][123091] Updated weights for policy 0, policy_version 850236 (0.0010) [2023-12-26 06:22:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 433782784. Throughput: 0: 9151.4, 1: 8834.8. Samples: 433758980. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:38,785][121949] Avg episode reward: [(0, '6068.858'), (1, '5669.618')] [2023-12-26 06:22:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000844224_216121344.pth... [2023-12-26 06:22:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000843200_215859200.pth [2023-12-26 06:22:38,831][123091] Updated weights for policy 0, policy_version 850246 (0.0009) [2023-12-26 06:22:38,899][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000850256_217669632.pth... [2023-12-26 06:22:38,900][123091] Updated weights for policy 0, policy_version 850256 (0.0010) [2023-12-26 06:22:38,905][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000849168_217391104.pth [2023-12-26 06:22:39,351][123090] Updated weights for policy 1, policy_version 844227 (0.0009) [2023-12-26 06:22:39,423][123090] Updated weights for policy 1, policy_version 844237 (0.0008) [2023-12-26 06:22:39,497][123090] Updated weights for policy 1, policy_version 844247 (0.0010) [2023-12-26 06:22:39,759][123091] Updated weights for policy 0, policy_version 850266 (0.0011) [2023-12-26 06:22:39,828][123091] Updated weights for policy 0, policy_version 850276 (0.0011) [2023-12-26 06:22:39,898][123091] Updated weights for policy 0, policy_version 850286 (0.0010) [2023-12-26 06:22:40,296][123090] Updated weights for policy 1, policy_version 844257 (0.0007) [2023-12-26 06:22:40,363][123090] Updated weights for policy 1, policy_version 844267 (0.0005) [2023-12-26 06:22:40,434][123090] Updated weights for policy 1, policy_version 844277 (0.0006) [2023-12-26 06:22:40,510][123090] Updated weights for policy 1, policy_version 844287 (0.0005) [2023-12-26 06:22:40,776][123091] Updated weights for policy 0, policy_version 850296 (0.0009) [2023-12-26 06:22:40,846][123091] Updated weights for policy 0, policy_version 850306 (0.0009) [2023-12-26 06:22:40,911][123091] Updated weights for policy 0, policy_version 850316 (0.0009) [2023-12-26 06:22:41,244][123090] Updated weights for policy 1, policy_version 844297 (0.0008) [2023-12-26 06:22:41,313][123090] Updated weights for policy 1, policy_version 844307 (0.0007) [2023-12-26 06:22:41,382][123090] Updated weights for policy 1, policy_version 844317 (0.0008) [2023-12-26 06:22:41,798][123091] Updated weights for policy 0, policy_version 850326 (0.0009) [2023-12-26 06:22:41,853][123091] Updated weights for policy 0, policy_version 850336 (0.0009) [2023-12-26 06:22:41,916][123091] Updated weights for policy 0, policy_version 850346 (0.0010) [2023-12-26 06:22:42,130][123090] Updated weights for policy 1, policy_version 844327 (0.0009) [2023-12-26 06:22:42,200][123090] Updated weights for policy 1, policy_version 844337 (0.0010) [2023-12-26 06:22:42,270][123090] Updated weights for policy 1, policy_version 844347 (0.0010) [2023-12-26 06:22:42,745][123091] Updated weights for policy 0, policy_version 850356 (0.0010) [2023-12-26 06:22:42,805][123091] Updated weights for policy 0, policy_version 850366 (0.0009) [2023-12-26 06:22:42,858][123091] Updated weights for policy 0, policy_version 850376 (0.0008) [2023-12-26 06:22:43,131][123090] Updated weights for policy 1, policy_version 844357 (0.0009) [2023-12-26 06:22:43,202][123090] Updated weights for policy 1, policy_version 844367 (0.0008) [2023-12-26 06:22:43,275][123090] Updated weights for policy 1, policy_version 844377 (0.0009) [2023-12-26 06:22:43,610][123091] Updated weights for policy 0, policy_version 850386 (0.0006) [2023-12-26 06:22:43,656][123091] Updated weights for policy 0, policy_version 850396 (0.0005) [2023-12-26 06:22:43,703][123091] Updated weights for policy 0, policy_version 850406 (0.0005) [2023-12-26 06:22:43,750][123091] Updated weights for policy 0, policy_version 850416 (0.0005) [2023-12-26 06:22:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 433872896. Throughput: 0: 9053.8, 1: 8795.1. Samples: 433862660. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:43,785][121949] Avg episode reward: [(0, '6228.350'), (1, '5917.813')] [2023-12-26 06:22:44,035][123090] Updated weights for policy 1, policy_version 844387 (0.0009) [2023-12-26 06:22:44,091][123090] Updated weights for policy 1, policy_version 844397 (0.0005) [2023-12-26 06:22:44,154][123090] Updated weights for policy 1, policy_version 844407 (0.0010) [2023-12-26 06:22:44,511][123091] Updated weights for policy 0, policy_version 850426 (0.0010) [2023-12-26 06:22:44,559][123091] Updated weights for policy 0, policy_version 850436 (0.0010) [2023-12-26 06:22:44,624][123091] Updated weights for policy 0, policy_version 850446 (0.0010) [2023-12-26 06:22:44,834][123090] Updated weights for policy 1, policy_version 844417 (0.0008) [2023-12-26 06:22:44,895][123090] Updated weights for policy 1, policy_version 844427 (0.0008) [2023-12-26 06:22:44,957][123090] Updated weights for policy 1, policy_version 844437 (0.0009) [2023-12-26 06:22:45,018][123090] Updated weights for policy 1, policy_version 844447 (0.0009) [2023-12-26 06:22:45,446][123091] Updated weights for policy 0, policy_version 850456 (0.0010) [2023-12-26 06:22:45,507][123091] Updated weights for policy 0, policy_version 850466 (0.0010) [2023-12-26 06:22:45,575][123091] Updated weights for policy 0, policy_version 850476 (0.0007) [2023-12-26 06:22:45,784][123090] Updated weights for policy 1, policy_version 844457 (0.0006) [2023-12-26 06:22:45,844][123090] Updated weights for policy 1, policy_version 844467 (0.0005) [2023-12-26 06:22:45,907][123090] Updated weights for policy 1, policy_version 844477 (0.0009) [2023-12-26 06:22:46,326][123091] Updated weights for policy 0, policy_version 850486 (0.0009) [2023-12-26 06:22:46,392][123091] Updated weights for policy 0, policy_version 850496 (0.0010) [2023-12-26 06:22:46,461][123091] Updated weights for policy 0, policy_version 850506 (0.0010) [2023-12-26 06:22:46,547][123090] Updated weights for policy 1, policy_version 844487 (0.0006) [2023-12-26 06:22:46,603][123090] Updated weights for policy 1, policy_version 844497 (0.0008) [2023-12-26 06:22:46,652][123090] Updated weights for policy 1, policy_version 844507 (0.0009) [2023-12-26 06:22:47,142][123091] Updated weights for policy 0, policy_version 850516 (0.0009) [2023-12-26 06:22:47,207][123091] Updated weights for policy 0, policy_version 850526 (0.0006) [2023-12-26 06:22:47,256][123091] Updated weights for policy 0, policy_version 850536 (0.0005) [2023-12-26 06:22:47,502][123090] Updated weights for policy 1, policy_version 844517 (0.0007) [2023-12-26 06:22:47,558][123090] Updated weights for policy 1, policy_version 844527 (0.0008) [2023-12-26 06:22:47,610][123090] Updated weights for policy 1, policy_version 844537 (0.0009) [2023-12-26 06:22:47,918][123091] Updated weights for policy 0, policy_version 850546 (0.0006) [2023-12-26 06:22:47,979][123091] Updated weights for policy 0, policy_version 850556 (0.0005) [2023-12-26 06:22:48,044][123091] Updated weights for policy 0, policy_version 850566 (0.0006) [2023-12-26 06:22:48,109][123091] Updated weights for policy 0, policy_version 850576 (0.0005) [2023-12-26 06:22:48,534][123090] Updated weights for policy 1, policy_version 844547 (0.0010) [2023-12-26 06:22:48,599][123090] Updated weights for policy 1, policy_version 844557 (0.0009) [2023-12-26 06:22:48,667][123090] Updated weights for policy 1, policy_version 844567 (0.0009) [2023-12-26 06:22:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 433963008. Throughput: 0: 9131.9, 1: 8832.6. Samples: 433974288. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:48,784][121949] Avg episode reward: [(0, '6334.840'), (1, '5860.762')] [2023-12-26 06:22:48,806][123091] Updated weights for policy 0, policy_version 850586 (0.0009) [2023-12-26 06:22:48,867][123091] Updated weights for policy 0, policy_version 850596 (0.0009) [2023-12-26 06:22:48,924][123091] Updated weights for policy 0, policy_version 850606 (0.0007) [2023-12-26 06:22:49,511][123090] Updated weights for policy 1, policy_version 844577 (0.0009) [2023-12-26 06:22:49,561][123090] Updated weights for policy 1, policy_version 844587 (0.0009) [2023-12-26 06:22:49,625][123090] Updated weights for policy 1, policy_version 844597 (0.0009) [2023-12-26 06:22:49,688][123090] Updated weights for policy 1, policy_version 844607 (0.0008) [2023-12-26 06:22:49,708][123091] Updated weights for policy 0, policy_version 850616 (0.0010) [2023-12-26 06:22:49,775][123091] Updated weights for policy 0, policy_version 850626 (0.0011) [2023-12-26 06:22:49,850][123091] Updated weights for policy 0, policy_version 850636 (0.0008) [2023-12-26 06:22:50,478][123090] Updated weights for policy 1, policy_version 844617 (0.0005) [2023-12-26 06:22:50,548][123090] Updated weights for policy 1, policy_version 844627 (0.0008) [2023-12-26 06:22:50,600][123091] Updated weights for policy 0, policy_version 850646 (0.0010) [2023-12-26 06:22:50,620][123090] Updated weights for policy 1, policy_version 844637 (0.0007) [2023-12-26 06:22:50,665][123091] Updated weights for policy 0, policy_version 850656 (0.0010) [2023-12-26 06:22:50,718][123091] Updated weights for policy 0, policy_version 850666 (0.0011) [2023-12-26 06:22:51,442][123090] Updated weights for policy 1, policy_version 844647 (0.0008) [2023-12-26 06:22:51,514][123090] Updated weights for policy 1, policy_version 844657 (0.0008) [2023-12-26 06:22:51,564][123090] Updated weights for policy 1, policy_version 844667 (0.0008) [2023-12-26 06:22:51,583][123091] Updated weights for policy 0, policy_version 850676 (0.0011) [2023-12-26 06:22:51,649][123091] Updated weights for policy 0, policy_version 850686 (0.0012) [2023-12-26 06:22:51,707][123091] Updated weights for policy 0, policy_version 850696 (0.0009) [2023-12-26 06:22:52,323][123090] Updated weights for policy 1, policy_version 844677 (0.0006) [2023-12-26 06:22:52,393][123090] Updated weights for policy 1, policy_version 844687 (0.0009) [2023-12-26 06:22:52,458][123090] Updated weights for policy 1, policy_version 844697 (0.0009) [2023-12-26 06:22:52,512][123091] Updated weights for policy 0, policy_version 850706 (0.0010) [2023-12-26 06:22:52,567][123091] Updated weights for policy 0, policy_version 850716 (0.0010) [2023-12-26 06:22:52,632][123091] Updated weights for policy 0, policy_version 850726 (0.0009) [2023-12-26 06:22:52,700][123091] Updated weights for policy 0, policy_version 850736 (0.0010) [2023-12-26 06:22:53,289][123090] Updated weights for policy 1, policy_version 844707 (0.0010) [2023-12-26 06:22:53,353][123090] Updated weights for policy 1, policy_version 844717 (0.0010) [2023-12-26 06:22:53,414][123090] Updated weights for policy 1, policy_version 844727 (0.0009) [2023-12-26 06:22:53,555][123091] Updated weights for policy 0, policy_version 850746 (0.0009) [2023-12-26 06:22:53,609][123091] Updated weights for policy 0, policy_version 850756 (0.0009) [2023-12-26 06:22:53,666][123091] Updated weights for policy 0, policy_version 850766 (0.0010) [2023-12-26 06:22:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 434053120. Throughput: 0: 9049.2, 1: 8757.1. Samples: 434025944. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:53,785][121949] Avg episode reward: [(0, '6162.269'), (1, '5850.650')] [2023-12-26 06:22:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000850768_217800704.pth... [2023-12-26 06:22:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000844736_216252416.pth... [2023-12-26 06:22:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000843712_215990272.pth [2023-12-26 06:22:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000849712_217530368.pth [2023-12-26 06:22:54,233][123090] Updated weights for policy 1, policy_version 844737 (0.0009) [2023-12-26 06:22:54,300][123090] Updated weights for policy 1, policy_version 844747 (0.0010) [2023-12-26 06:22:54,365][123090] Updated weights for policy 1, policy_version 844757 (0.0009) [2023-12-26 06:22:54,433][123090] Updated weights for policy 1, policy_version 844767 (0.0008) [2023-12-26 06:22:54,505][123091] Updated weights for policy 0, policy_version 850776 (0.0009) [2023-12-26 06:22:54,572][123091] Updated weights for policy 0, policy_version 850786 (0.0010) [2023-12-26 06:22:54,637][123091] Updated weights for policy 0, policy_version 850796 (0.0010) [2023-12-26 06:22:55,204][123090] Updated weights for policy 1, policy_version 844777 (0.0006) [2023-12-26 06:22:55,252][123090] Updated weights for policy 1, policy_version 844787 (0.0005) [2023-12-26 06:22:55,297][123090] Updated weights for policy 1, policy_version 844797 (0.0005) [2023-12-26 06:22:55,537][123091] Updated weights for policy 0, policy_version 850806 (0.0009) [2023-12-26 06:22:55,595][123091] Updated weights for policy 0, policy_version 850816 (0.0010) [2023-12-26 06:22:55,649][123091] Updated weights for policy 0, policy_version 850827 (0.0010) [2023-12-26 06:22:56,023][123090] Updated weights for policy 1, policy_version 844807 (0.0008) [2023-12-26 06:22:56,072][123090] Updated weights for policy 1, policy_version 844817 (0.0005) [2023-12-26 06:22:56,124][123090] Updated weights for policy 1, policy_version 844827 (0.0005) [2023-12-26 06:22:56,502][123091] Updated weights for policy 0, policy_version 850837 (0.0010) [2023-12-26 06:22:56,567][123091] Updated weights for policy 0, policy_version 850847 (0.0009) [2023-12-26 06:22:56,614][123091] Updated weights for policy 0, policy_version 850857 (0.0009) [2023-12-26 06:22:56,861][123090] Updated weights for policy 1, policy_version 844837 (0.0008) [2023-12-26 06:22:56,908][123090] Updated weights for policy 1, policy_version 844847 (0.0008) [2023-12-26 06:22:56,960][123090] Updated weights for policy 1, policy_version 844857 (0.0008) [2023-12-26 06:22:57,433][123091] Updated weights for policy 0, policy_version 850867 (0.0008) [2023-12-26 06:22:57,491][123091] Updated weights for policy 0, policy_version 850877 (0.0005) [2023-12-26 06:22:57,547][123091] Updated weights for policy 0, policy_version 850887 (0.0005) [2023-12-26 06:22:57,725][123090] Updated weights for policy 1, policy_version 844867 (0.0010) [2023-12-26 06:22:57,795][123090] Updated weights for policy 1, policy_version 844877 (0.0010) [2023-12-26 06:22:57,856][123090] Updated weights for policy 1, policy_version 844887 (0.0009) [2023-12-26 06:22:58,328][123091] Updated weights for policy 0, policy_version 850898 (0.0008) [2023-12-26 06:22:58,393][123091] Updated weights for policy 0, policy_version 850908 (0.0009) [2023-12-26 06:22:58,466][123091] Updated weights for policy 0, policy_version 850918 (0.0009) [2023-12-26 06:22:58,538][123091] Updated weights for policy 0, policy_version 850928 (0.0010) [2023-12-26 06:22:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 434135040. Throughput: 0: 8990.4, 1: 8831.8. Samples: 434130892. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:22:58,785][121949] Avg episode reward: [(0, '5937.352'), (1, '5874.271')] [2023-12-26 06:22:58,819][123090] Updated weights for policy 1, policy_version 844897 (0.0010) [2023-12-26 06:22:58,881][123090] Updated weights for policy 1, policy_version 844907 (0.0009) [2023-12-26 06:22:58,944][123090] Updated weights for policy 1, policy_version 844917 (0.0007) [2023-12-26 06:22:59,009][123090] Updated weights for policy 1, policy_version 844927 (0.0010) [2023-12-26 06:22:59,421][123091] Updated weights for policy 0, policy_version 850938 (0.0009) [2023-12-26 06:22:59,474][123091] Updated weights for policy 0, policy_version 850949 (0.0010) [2023-12-26 06:22:59,529][123091] Updated weights for policy 0, policy_version 850959 (0.0010) [2023-12-26 06:22:59,842][123090] Updated weights for policy 1, policy_version 844937 (0.0009) [2023-12-26 06:22:59,920][123090] Updated weights for policy 1, policy_version 844947 (0.0006) [2023-12-26 06:22:59,995][123090] Updated weights for policy 1, policy_version 844957 (0.0007) [2023-12-26 06:23:00,396][123091] Updated weights for policy 0, policy_version 850969 (0.0010) [2023-12-26 06:23:00,456][123091] Updated weights for policy 0, policy_version 850979 (0.0009) [2023-12-26 06:23:00,511][123091] Updated weights for policy 0, policy_version 850989 (0.0009) [2023-12-26 06:23:00,755][123090] Updated weights for policy 1, policy_version 844968 (0.0010) [2023-12-26 06:23:00,804][123090] Updated weights for policy 1, policy_version 844978 (0.0009) [2023-12-26 06:23:00,855][123090] Updated weights for policy 1, policy_version 844988 (0.0010) [2023-12-26 06:23:01,389][123091] Updated weights for policy 0, policy_version 850999 (0.0010) [2023-12-26 06:23:01,447][123091] Updated weights for policy 0, policy_version 851009 (0.0008) [2023-12-26 06:23:01,498][123091] Updated weights for policy 0, policy_version 851019 (0.0010) [2023-12-26 06:23:01,669][123090] Updated weights for policy 1, policy_version 844999 (0.0009) [2023-12-26 06:23:01,736][123090] Updated weights for policy 1, policy_version 845009 (0.0007) [2023-12-26 06:23:01,793][123090] Updated weights for policy 1, policy_version 845019 (0.0010) [2023-12-26 06:23:02,366][123091] Updated weights for policy 0, policy_version 851029 (0.0009) [2023-12-26 06:23:02,435][123091] Updated weights for policy 0, policy_version 851039 (0.0010) [2023-12-26 06:23:02,494][123091] Updated weights for policy 0, policy_version 851049 (0.0010) [2023-12-26 06:23:02,569][123090] Updated weights for policy 1, policy_version 845029 (0.0010) [2023-12-26 06:23:02,633][123090] Updated weights for policy 1, policy_version 845039 (0.0010) [2023-12-26 06:23:02,694][123090] Updated weights for policy 1, policy_version 845049 (0.0009) [2023-12-26 06:23:03,217][123091] Updated weights for policy 0, policy_version 851059 (0.0008) [2023-12-26 06:23:03,261][123091] Updated weights for policy 0, policy_version 851069 (0.0005) [2023-12-26 06:23:03,306][123091] Updated weights for policy 0, policy_version 851079 (0.0005) [2023-12-26 06:23:03,570][123090] Updated weights for policy 1, policy_version 845059 (0.0008) [2023-12-26 06:23:03,638][123090] Updated weights for policy 1, policy_version 845069 (0.0006) [2023-12-26 06:23:03,688][123090] Updated weights for policy 1, policy_version 845079 (0.0005) [2023-12-26 06:23:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 434225152. Throughput: 0: 8871.1, 1: 8776.6. Samples: 434232768. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:23:03,785][121949] Avg episode reward: [(0, '5925.619'), (1, '5721.565')] [2023-12-26 06:23:04,101][123091] Updated weights for policy 0, policy_version 851089 (0.0005) [2023-12-26 06:23:04,166][123091] Updated weights for policy 0, policy_version 851099 (0.0005) [2023-12-26 06:23:04,244][123091] Updated weights for policy 0, policy_version 851109 (0.0006) [2023-12-26 06:23:04,316][123091] Updated weights for policy 0, policy_version 851119 (0.0006) [2023-12-26 06:23:04,354][123090] Updated weights for policy 1, policy_version 845089 (0.0006) [2023-12-26 06:23:04,414][123090] Updated weights for policy 1, policy_version 845099 (0.0009) [2023-12-26 06:23:04,477][123090] Updated weights for policy 1, policy_version 845109 (0.0010) [2023-12-26 06:23:04,539][123090] Updated weights for policy 1, policy_version 845119 (0.0010) [2023-12-26 06:23:04,954][123091] Updated weights for policy 0, policy_version 851129 (0.0008) [2023-12-26 06:23:05,004][123091] Updated weights for policy 0, policy_version 851139 (0.0006) [2023-12-26 06:23:05,060][123091] Updated weights for policy 0, policy_version 851150 (0.0010) [2023-12-26 06:23:05,392][123090] Updated weights for policy 1, policy_version 845129 (0.0010) [2023-12-26 06:23:05,444][123090] Updated weights for policy 1, policy_version 845139 (0.0009) [2023-12-26 06:23:05,497][123090] Updated weights for policy 1, policy_version 845149 (0.0009) [2023-12-26 06:23:05,930][123091] Updated weights for policy 0, policy_version 851160 (0.0006) [2023-12-26 06:23:05,992][123091] Updated weights for policy 0, policy_version 851170 (0.0005) [2023-12-26 06:23:06,059][123091] Updated weights for policy 0, policy_version 851180 (0.0005) [2023-12-26 06:23:06,282][123090] Updated weights for policy 1, policy_version 845159 (0.0009) [2023-12-26 06:23:06,337][123090] Updated weights for policy 1, policy_version 845169 (0.0009) [2023-12-26 06:23:06,401][123090] Updated weights for policy 1, policy_version 845179 (0.0009) [2023-12-26 06:23:06,841][123091] Updated weights for policy 0, policy_version 851190 (0.0008) [2023-12-26 06:23:06,901][123091] Updated weights for policy 0, policy_version 851200 (0.0009) [2023-12-26 06:23:06,954][123091] Updated weights for policy 0, policy_version 851210 (0.0010) [2023-12-26 06:23:07,206][123090] Updated weights for policy 1, policy_version 845189 (0.0007) [2023-12-26 06:23:07,272][123090] Updated weights for policy 1, policy_version 845199 (0.0005) [2023-12-26 06:23:07,345][123090] Updated weights for policy 1, policy_version 845209 (0.0005) [2023-12-26 06:23:07,626][123091] Updated weights for policy 0, policy_version 851220 (0.0009) [2023-12-26 06:23:07,686][123091] Updated weights for policy 0, policy_version 851230 (0.0009) [2023-12-26 06:23:07,746][123091] Updated weights for policy 0, policy_version 851240 (0.0009) [2023-12-26 06:23:08,086][123090] Updated weights for policy 1, policy_version 845219 (0.0005) [2023-12-26 06:23:08,139][123090] Updated weights for policy 1, policy_version 845229 (0.0005) [2023-12-26 06:23:08,188][123090] Updated weights for policy 1, policy_version 845239 (0.0005) [2023-12-26 06:23:08,596][123091] Updated weights for policy 0, policy_version 851250 (0.0009) [2023-12-26 06:23:08,646][123091] Updated weights for policy 0, policy_version 851260 (0.0009) [2023-12-26 06:23:08,695][123091] Updated weights for policy 0, policy_version 851270 (0.0009) [2023-12-26 06:23:08,750][123091] Updated weights for policy 0, policy_version 851280 (0.0010) [2023-12-26 06:23:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 434315264. Throughput: 0: 8901.1, 1: 8817.3. Samples: 434287960. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:23:08,785][121949] Avg episode reward: [(0, '6084.945'), (1, '5742.107')] [2023-12-26 06:23:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000851280_217931776.pth... [2023-12-26 06:23:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000845248_216383488.pth... [2023-12-26 06:23:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000844224_216121344.pth [2023-12-26 06:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000850256_217669632.pth [2023-12-26 06:23:08,966][123090] Updated weights for policy 1, policy_version 845249 (0.0007) [2023-12-26 06:23:09,020][123090] Updated weights for policy 1, policy_version 845259 (0.0010) [2023-12-26 06:23:09,072][123090] Updated weights for policy 1, policy_version 845269 (0.0009) [2023-12-26 06:23:09,133][123090] Updated weights for policy 1, policy_version 845279 (0.0009) [2023-12-26 06:23:09,595][123091] Updated weights for policy 0, policy_version 851290 (0.0009) [2023-12-26 06:23:09,658][123091] Updated weights for policy 0, policy_version 851300 (0.0010) [2023-12-26 06:23:09,719][123091] Updated weights for policy 0, policy_version 851310 (0.0009) [2023-12-26 06:23:10,014][123090] Updated weights for policy 1, policy_version 845289 (0.0010) [2023-12-26 06:23:10,070][123090] Updated weights for policy 1, policy_version 845299 (0.0006) [2023-12-26 06:23:10,127][123090] Updated weights for policy 1, policy_version 845309 (0.0005) [2023-12-26 06:23:10,598][123091] Updated weights for policy 0, policy_version 851321 (0.0010) [2023-12-26 06:23:10,652][123091] Updated weights for policy 0, policy_version 851331 (0.0010) [2023-12-26 06:23:10,706][123091] Updated weights for policy 0, policy_version 851342 (0.0010) [2023-12-26 06:23:10,830][123090] Updated weights for policy 1, policy_version 845319 (0.0005) [2023-12-26 06:23:10,891][123090] Updated weights for policy 1, policy_version 845329 (0.0005) [2023-12-26 06:23:10,948][123090] Updated weights for policy 1, policy_version 845339 (0.0005) [2023-12-26 06:23:11,558][123091] Updated weights for policy 0, policy_version 851352 (0.0009) [2023-12-26 06:23:11,622][123091] Updated weights for policy 0, policy_version 851362 (0.0008) [2023-12-26 06:23:11,695][123091] Updated weights for policy 0, policy_version 851372 (0.0008) [2023-12-26 06:23:11,709][123090] Updated weights for policy 1, policy_version 845349 (0.0007) [2023-12-26 06:23:11,774][123090] Updated weights for policy 1, policy_version 845359 (0.0010) [2023-12-26 06:23:11,845][123090] Updated weights for policy 1, policy_version 845369 (0.0010) [2023-12-26 06:23:12,439][123091] Updated weights for policy 0, policy_version 851382 (0.0009) [2023-12-26 06:23:12,500][123091] Updated weights for policy 0, policy_version 851392 (0.0010) [2023-12-26 06:23:12,562][123091] Updated weights for policy 0, policy_version 851402 (0.0009) [2023-12-26 06:23:12,732][123090] Updated weights for policy 1, policy_version 845380 (0.0010) [2023-12-26 06:23:12,796][123090] Updated weights for policy 1, policy_version 845390 (0.0009) [2023-12-26 06:23:12,859][123090] Updated weights for policy 1, policy_version 845400 (0.0007) [2023-12-26 06:23:13,426][123091] Updated weights for policy 0, policy_version 851412 (0.0007) [2023-12-26 06:23:13,475][123091] Updated weights for policy 0, policy_version 851422 (0.0005) [2023-12-26 06:23:13,535][123091] Updated weights for policy 0, policy_version 851432 (0.0008) [2023-12-26 06:23:13,723][123090] Updated weights for policy 1, policy_version 845410 (0.0008) [2023-12-26 06:23:13,782][123090] Updated weights for policy 1, policy_version 845420 (0.0010) [2023-12-26 06:23:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 434397184. Throughput: 0: 8866.4, 1: 8899.9. Samples: 434394076. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 06:23:13,784][121949] Avg episode reward: [(0, '6025.574'), (1, '5752.315')] [2023-12-26 06:23:13,837][123090] Updated weights for policy 1, policy_version 845430 (0.0009) [2023-12-26 06:23:13,892][123090] Updated weights for policy 1, policy_version 845440 (0.0009) [2023-12-26 06:23:14,242][123091] Updated weights for policy 0, policy_version 851442 (0.0011) [2023-12-26 06:23:14,306][123091] Updated weights for policy 0, policy_version 851452 (0.0009) [2023-12-26 06:23:14,366][123091] Updated weights for policy 0, policy_version 851462 (0.0010) [2023-12-26 06:23:14,431][123091] Updated weights for policy 0, policy_version 851472 (0.0011) [2023-12-26 06:23:14,779][123090] Updated weights for policy 1, policy_version 845450 (0.0007) [2023-12-26 06:23:14,833][123090] Updated weights for policy 1, policy_version 845460 (0.0008) [2023-12-26 06:23:14,887][123090] Updated weights for policy 1, policy_version 845470 (0.0007) [2023-12-26 06:23:15,269][123091] Updated weights for policy 0, policy_version 851482 (0.0011) [2023-12-26 06:23:15,336][123091] Updated weights for policy 0, policy_version 851492 (0.0011) [2023-12-26 06:23:15,395][123091] Updated weights for policy 0, policy_version 851502 (0.0011) [2023-12-26 06:23:15,692][123090] Updated weights for policy 1, policy_version 845480 (0.0008) [2023-12-26 06:23:15,757][123090] Updated weights for policy 1, policy_version 845490 (0.0009) [2023-12-26 06:23:15,822][123090] Updated weights for policy 1, policy_version 845500 (0.0008) [2023-12-26 06:23:16,156][123091] Updated weights for policy 0, policy_version 851512 (0.0010) [2023-12-26 06:23:16,225][123091] Updated weights for policy 0, policy_version 851522 (0.0011) [2023-12-26 06:23:16,273][123091] Updated weights for policy 0, policy_version 851532 (0.0010) [2023-12-26 06:23:16,624][123090] Updated weights for policy 1, policy_version 845510 (0.0010) [2023-12-26 06:23:16,673][123090] Updated weights for policy 1, policy_version 845520 (0.0009) [2023-12-26 06:23:16,735][123090] Updated weights for policy 1, policy_version 845530 (0.0009) [2023-12-26 06:23:17,067][123091] Updated weights for policy 0, policy_version 851542 (0.0007) [2023-12-26 06:23:17,124][123091] Updated weights for policy 0, policy_version 851552 (0.0005) [2023-12-26 06:23:17,185][123091] Updated weights for policy 0, policy_version 851562 (0.0005) [2023-12-26 06:23:17,655][123090] Updated weights for policy 1, policy_version 845540 (0.0010) [2023-12-26 06:23:17,716][123090] Updated weights for policy 1, policy_version 845550 (0.0009) [2023-12-26 06:23:17,779][123090] Updated weights for policy 1, policy_version 845560 (0.0005) [2023-12-26 06:23:17,824][123091] Updated weights for policy 0, policy_version 851572 (0.0007) [2023-12-26 06:23:17,902][123091] Updated weights for policy 0, policy_version 851582 (0.0011) [2023-12-26 06:23:17,951][123091] Updated weights for policy 0, policy_version 851592 (0.0011) [2023-12-26 06:23:18,513][123090] Updated weights for policy 1, policy_version 845570 (0.0005) [2023-12-26 06:23:18,587][123090] Updated weights for policy 1, policy_version 845580 (0.0006) [2023-12-26 06:23:18,657][123090] Updated weights for policy 1, policy_version 845590 (0.0010) [2023-12-26 06:23:18,728][123090] Updated weights for policy 1, policy_version 845600 (0.0011) [2023-12-26 06:23:18,764][123091] Updated weights for policy 0, policy_version 851602 (0.0011) [2023-12-26 06:23:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 434487296. Throughput: 0: 8877.7, 1: 8809.9. Samples: 434499168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:18,785][121949] Avg episode reward: [(0, '5766.542'), (1, '5631.292')] [2023-12-26 06:23:18,827][123091] Updated weights for policy 0, policy_version 851612 (0.0010) [2023-12-26 06:23:18,880][123091] Updated weights for policy 0, policy_version 851623 (0.0010) [2023-12-26 06:23:19,520][123090] Updated weights for policy 1, policy_version 845610 (0.0010) [2023-12-26 06:23:19,590][123090] Updated weights for policy 1, policy_version 845620 (0.0009) [2023-12-26 06:23:19,660][123090] Updated weights for policy 1, policy_version 845630 (0.0007) [2023-12-26 06:23:19,673][123091] Updated weights for policy 0, policy_version 851633 (0.0009) [2023-12-26 06:23:19,738][123091] Updated weights for policy 0, policy_version 851643 (0.0005) [2023-12-26 06:23:19,808][123091] Updated weights for policy 0, policy_version 851653 (0.0006) [2023-12-26 06:23:19,884][123091] Updated weights for policy 0, policy_version 851663 (0.0008) [2023-12-26 06:23:20,450][123090] Updated weights for policy 1, policy_version 845640 (0.0010) [2023-12-26 06:23:20,512][123090] Updated weights for policy 1, policy_version 845650 (0.0009) [2023-12-26 06:23:20,562][123090] Updated weights for policy 1, policy_version 845660 (0.0007) [2023-12-26 06:23:20,597][123091] Updated weights for policy 0, policy_version 851673 (0.0009) [2023-12-26 06:23:20,662][123091] Updated weights for policy 0, policy_version 851683 (0.0010) [2023-12-26 06:23:20,730][123091] Updated weights for policy 0, policy_version 851693 (0.0010) [2023-12-26 06:23:21,439][123090] Updated weights for policy 1, policy_version 845670 (0.0009) [2023-12-26 06:23:21,509][123090] Updated weights for policy 1, policy_version 845680 (0.0008) [2023-12-26 06:23:21,560][123091] Updated weights for policy 0, policy_version 851703 (0.0007) [2023-12-26 06:23:21,583][123090] Updated weights for policy 1, policy_version 845690 (0.0008) [2023-12-26 06:23:21,642][123091] Updated weights for policy 0, policy_version 851713 (0.0007) [2023-12-26 06:23:21,706][123091] Updated weights for policy 0, policy_version 851723 (0.0009) [2023-12-26 06:23:22,389][123090] Updated weights for policy 1, policy_version 845700 (0.0009) [2023-12-26 06:23:22,445][123090] Updated weights for policy 1, policy_version 845710 (0.0010) [2023-12-26 06:23:22,501][123090] Updated weights for policy 1, policy_version 845720 (0.0009) [2023-12-26 06:23:22,518][123091] Updated weights for policy 0, policy_version 851733 (0.0008) [2023-12-26 06:23:22,583][123091] Updated weights for policy 0, policy_version 851743 (0.0010) [2023-12-26 06:23:22,651][123091] Updated weights for policy 0, policy_version 851753 (0.0009) [2023-12-26 06:23:23,304][123090] Updated weights for policy 1, policy_version 845730 (0.0008) [2023-12-26 06:23:23,378][123090] Updated weights for policy 1, policy_version 845740 (0.0006) [2023-12-26 06:23:23,415][123091] Updated weights for policy 0, policy_version 851763 (0.0010) [2023-12-26 06:23:23,433][123090] Updated weights for policy 1, policy_version 845750 (0.0005) [2023-12-26 06:23:23,463][123091] Updated weights for policy 0, policy_version 851773 (0.0009) [2023-12-26 06:23:23,499][123090] Updated weights for policy 1, policy_version 845760 (0.0008) [2023-12-26 06:23:23,518][123091] Updated weights for policy 0, policy_version 851783 (0.0009) [2023-12-26 06:23:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 434577408. Throughput: 0: 8808.3, 1: 8782.8. Samples: 434550584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:23,786][121949] Avg episode reward: [(0, '5791.313'), (1, '5702.625')] [2023-12-26 06:23:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000851792_218062848.pth... [2023-12-26 06:23:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000845760_216514560.pth... [2023-12-26 06:23:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000844736_216252416.pth [2023-12-26 06:23:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000850768_217800704.pth [2023-12-26 06:23:24,221][123091] Updated weights for policy 0, policy_version 851793 (0.0008) [2023-12-26 06:23:24,277][123090] Updated weights for policy 1, policy_version 845770 (0.0010) [2023-12-26 06:23:24,282][123091] Updated weights for policy 0, policy_version 851803 (0.0008) [2023-12-26 06:23:24,338][123090] Updated weights for policy 1, policy_version 845780 (0.0011) [2023-12-26 06:23:24,341][123091] Updated weights for policy 0, policy_version 851813 (0.0007) [2023-12-26 06:23:24,406][123090] Updated weights for policy 1, policy_version 845790 (0.0011) [2023-12-26 06:23:24,413][123091] Updated weights for policy 0, policy_version 851823 (0.0006) [2023-12-26 06:23:25,135][123091] Updated weights for policy 0, policy_version 851833 (0.0006) [2023-12-26 06:23:25,147][123090] Updated weights for policy 1, policy_version 845800 (0.0010) [2023-12-26 06:23:25,198][123091] Updated weights for policy 0, policy_version 851843 (0.0006) [2023-12-26 06:23:25,206][123090] Updated weights for policy 1, policy_version 845810 (0.0010) [2023-12-26 06:23:25,262][123091] Updated weights for policy 0, policy_version 851853 (0.0006) [2023-12-26 06:23:25,265][123090] Updated weights for policy 1, policy_version 845820 (0.0010) [2023-12-26 06:23:25,934][123091] Updated weights for policy 0, policy_version 851863 (0.0005) [2023-12-26 06:23:25,992][123091] Updated weights for policy 0, policy_version 851873 (0.0005) [2023-12-26 06:23:26,054][123091] Updated weights for policy 0, policy_version 851883 (0.0005) [2023-12-26 06:23:26,076][123090] Updated weights for policy 1, policy_version 845830 (0.0008) [2023-12-26 06:23:26,138][123090] Updated weights for policy 1, policy_version 845840 (0.0010) [2023-12-26 06:23:26,201][123090] Updated weights for policy 1, policy_version 845850 (0.0010) [2023-12-26 06:23:26,804][123091] Updated weights for policy 0, policy_version 851893 (0.0008) [2023-12-26 06:23:26,849][123091] Updated weights for policy 0, policy_version 851903 (0.0010) [2023-12-26 06:23:26,904][123091] Updated weights for policy 0, policy_version 851913 (0.0011) [2023-12-26 06:23:26,944][123090] Updated weights for policy 1, policy_version 845860 (0.0008) [2023-12-26 06:23:26,990][123090] Updated weights for policy 1, policy_version 845870 (0.0005) [2023-12-26 06:23:27,037][123090] Updated weights for policy 1, policy_version 845880 (0.0005) [2023-12-26 06:23:27,741][123090] Updated weights for policy 1, policy_version 845890 (0.0005) [2023-12-26 06:23:27,746][123091] Updated weights for policy 0, policy_version 851923 (0.0009) [2023-12-26 06:23:27,796][123091] Updated weights for policy 0, policy_version 851933 (0.0006) [2023-12-26 06:23:27,804][123090] Updated weights for policy 1, policy_version 845900 (0.0006) [2023-12-26 06:23:27,843][123091] Updated weights for policy 0, policy_version 851943 (0.0010) [2023-12-26 06:23:27,858][123090] Updated weights for policy 1, policy_version 845910 (0.0010) [2023-12-26 06:23:27,909][123090] Updated weights for policy 1, policy_version 845920 (0.0010) [2023-12-26 06:23:28,539][123091] Updated weights for policy 0, policy_version 851953 (0.0008) [2023-12-26 06:23:28,603][123091] Updated weights for policy 0, policy_version 851963 (0.0005) [2023-12-26 06:23:28,662][123091] Updated weights for policy 0, policy_version 851973 (0.0005) [2023-12-26 06:23:28,680][123090] Updated weights for policy 1, policy_version 845930 (0.0010) [2023-12-26 06:23:28,719][123091] Updated weights for policy 0, policy_version 851983 (0.0005) [2023-12-26 06:23:28,735][123090] Updated weights for policy 1, policy_version 845940 (0.0010) [2023-12-26 06:23:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 434667520. Throughput: 0: 8926.2, 1: 8815.2. Samples: 434661020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:28,784][121949] Avg episode reward: [(0, '5922.627'), (1, '5717.639')] [2023-12-26 06:23:28,794][123090] Updated weights for policy 1, policy_version 845950 (0.0010) [2023-12-26 06:23:29,315][123091] Updated weights for policy 0, policy_version 851993 (0.0009) [2023-12-26 06:23:29,381][123091] Updated weights for policy 0, policy_version 852003 (0.0011) [2023-12-26 06:23:29,446][123091] Updated weights for policy 0, policy_version 852013 (0.0009) [2023-12-26 06:23:29,629][123090] Updated weights for policy 1, policy_version 845960 (0.0006) [2023-12-26 06:23:29,694][123090] Updated weights for policy 1, policy_version 845970 (0.0005) [2023-12-26 06:23:29,758][123090] Updated weights for policy 1, policy_version 845980 (0.0005) [2023-12-26 06:23:30,228][123091] Updated weights for policy 0, policy_version 852023 (0.0007) [2023-12-26 06:23:30,287][123091] Updated weights for policy 0, policy_version 852033 (0.0006) [2023-12-26 06:23:30,340][123091] Updated weights for policy 0, policy_version 852043 (0.0005) [2023-12-26 06:23:30,523][123090] Updated weights for policy 1, policy_version 845990 (0.0007) [2023-12-26 06:23:30,584][123090] Updated weights for policy 1, policy_version 846000 (0.0010) [2023-12-26 06:23:30,653][123090] Updated weights for policy 1, policy_version 846010 (0.0009) [2023-12-26 06:23:31,016][123091] Updated weights for policy 0, policy_version 852053 (0.0005) [2023-12-26 06:23:31,090][123091] Updated weights for policy 0, policy_version 852063 (0.0008) [2023-12-26 06:23:31,156][123091] Updated weights for policy 0, policy_version 852073 (0.0009) [2023-12-26 06:23:31,350][123090] Updated weights for policy 1, policy_version 846020 (0.0009) [2023-12-26 06:23:31,416][123090] Updated weights for policy 1, policy_version 846030 (0.0008) [2023-12-26 06:23:31,478][123090] Updated weights for policy 1, policy_version 846040 (0.0008) [2023-12-26 06:23:32,046][123091] Updated weights for policy 0, policy_version 852083 (0.0010) [2023-12-26 06:23:32,096][123091] Updated weights for policy 0, policy_version 852093 (0.0009) [2023-12-26 06:23:32,152][123091] Updated weights for policy 0, policy_version 852103 (0.0009) [2023-12-26 06:23:32,210][123090] Updated weights for policy 1, policy_version 846050 (0.0008) [2023-12-26 06:23:32,270][123090] Updated weights for policy 1, policy_version 846060 (0.0010) [2023-12-26 06:23:32,329][123090] Updated weights for policy 1, policy_version 846070 (0.0009) [2023-12-26 06:23:32,406][123090] Updated weights for policy 1, policy_version 846080 (0.0009) [2023-12-26 06:23:32,894][123091] Updated weights for policy 0, policy_version 852113 (0.0009) [2023-12-26 06:23:32,942][123091] Updated weights for policy 0, policy_version 852123 (0.0005) [2023-12-26 06:23:32,998][123091] Updated weights for policy 0, policy_version 852133 (0.0005) [2023-12-26 06:23:33,045][123091] Updated weights for policy 0, policy_version 852143 (0.0005) [2023-12-26 06:23:33,308][123090] Updated weights for policy 1, policy_version 846090 (0.0009) [2023-12-26 06:23:33,362][123090] Updated weights for policy 1, policy_version 846100 (0.0010) [2023-12-26 06:23:33,423][123090] Updated weights for policy 1, policy_version 846110 (0.0010) [2023-12-26 06:23:33,722][123091] Updated weights for policy 0, policy_version 852153 (0.0005) [2023-12-26 06:23:33,766][123091] Updated weights for policy 0, policy_version 852163 (0.0005) [2023-12-26 06:23:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 434757632. Throughput: 0: 8926.5, 1: 8772.5. Samples: 434770744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:33,785][121949] Avg episode reward: [(0, '5836.066'), (1, '5584.536')] [2023-12-26 06:23:33,816][123091] Updated weights for policy 0, policy_version 852173 (0.0005) [2023-12-26 06:23:34,343][123090] Updated weights for policy 1, policy_version 846120 (0.0009) [2023-12-26 06:23:34,404][123090] Updated weights for policy 1, policy_version 846130 (0.0009) [2023-12-26 06:23:34,468][123090] Updated weights for policy 1, policy_version 846140 (0.0009) [2023-12-26 06:23:34,606][123091] Updated weights for policy 0, policy_version 852183 (0.0008) [2023-12-26 06:23:34,669][123091] Updated weights for policy 0, policy_version 852193 (0.0009) [2023-12-26 06:23:34,732][123091] Updated weights for policy 0, policy_version 852203 (0.0008) [2023-12-26 06:23:35,345][123090] Updated weights for policy 1, policy_version 846150 (0.0009) [2023-12-26 06:23:35,394][123090] Updated weights for policy 1, policy_version 846160 (0.0009) [2023-12-26 06:23:35,449][123090] Updated weights for policy 1, policy_version 846170 (0.0008) [2023-12-26 06:23:35,461][123091] Updated weights for policy 0, policy_version 852213 (0.0008) [2023-12-26 06:23:35,514][123091] Updated weights for policy 0, policy_version 852223 (0.0009) [2023-12-26 06:23:35,564][123091] Updated weights for policy 0, policy_version 852234 (0.0009) [2023-12-26 06:23:36,293][123090] Updated weights for policy 1, policy_version 846180 (0.0009) [2023-12-26 06:23:36,364][123090] Updated weights for policy 1, policy_version 846190 (0.0010) [2023-12-26 06:23:36,407][123091] Updated weights for policy 0, policy_version 852244 (0.0008) [2023-12-26 06:23:36,425][123090] Updated weights for policy 1, policy_version 846200 (0.0009) [2023-12-26 06:23:36,470][123091] Updated weights for policy 0, policy_version 852254 (0.0008) [2023-12-26 06:23:36,540][123091] Updated weights for policy 0, policy_version 852264 (0.0009) [2023-12-26 06:23:37,237][123090] Updated weights for policy 1, policy_version 846210 (0.0009) [2023-12-26 06:23:37,294][123090] Updated weights for policy 1, policy_version 846220 (0.0005) [2023-12-26 06:23:37,356][123090] Updated weights for policy 1, policy_version 846230 (0.0005) [2023-12-26 06:23:37,383][123091] Updated weights for policy 0, policy_version 852274 (0.0009) [2023-12-26 06:23:37,413][123090] Updated weights for policy 1, policy_version 846240 (0.0006) [2023-12-26 06:23:37,433][123091] Updated weights for policy 0, policy_version 852284 (0.0009) [2023-12-26 06:23:37,489][123091] Updated weights for policy 0, policy_version 852294 (0.0009) [2023-12-26 06:23:37,541][123091] Updated weights for policy 0, policy_version 852304 (0.0009) [2023-12-26 06:23:38,033][123090] Updated weights for policy 1, policy_version 846250 (0.0007) [2023-12-26 06:23:38,091][123090] Updated weights for policy 1, policy_version 846260 (0.0008) [2023-12-26 06:23:38,143][123090] Updated weights for policy 1, policy_version 846270 (0.0010) [2023-12-26 06:23:38,458][123091] Updated weights for policy 0, policy_version 852314 (0.0010) [2023-12-26 06:23:38,521][123091] Updated weights for policy 0, policy_version 852324 (0.0010) [2023-12-26 06:23:38,575][123091] Updated weights for policy 0, policy_version 852335 (0.0010) [2023-12-26 06:23:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 434847744. Throughput: 0: 8937.6, 1: 8759.9. Samples: 434822332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:38,785][121949] Avg episode reward: [(0, '5920.350'), (1, '5616.753')] [2023-12-26 06:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000852336_218202112.pth... [2023-12-26 06:23:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000846272_216645632.pth... [2023-12-26 06:23:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000845248_216383488.pth [2023-12-26 06:23:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000851280_217931776.pth [2023-12-26 06:23:38,903][123090] Updated weights for policy 1, policy_version 846280 (0.0007) [2023-12-26 06:23:38,972][123090] Updated weights for policy 1, policy_version 846290 (0.0006) [2023-12-26 06:23:39,032][123090] Updated weights for policy 1, policy_version 846300 (0.0005) [2023-12-26 06:23:39,497][123091] Updated weights for policy 0, policy_version 852345 (0.0008) [2023-12-26 06:23:39,550][123091] Updated weights for policy 0, policy_version 852355 (0.0008) [2023-12-26 06:23:39,603][123091] Updated weights for policy 0, policy_version 852365 (0.0008) [2023-12-26 06:23:39,737][123090] Updated weights for policy 1, policy_version 846310 (0.0005) [2023-12-26 06:23:39,794][123090] Updated weights for policy 1, policy_version 846320 (0.0009) [2023-12-26 06:23:39,867][123090] Updated weights for policy 1, policy_version 846330 (0.0014) [2023-12-26 06:23:40,469][123091] Updated weights for policy 0, policy_version 852375 (0.0009) [2023-12-26 06:23:40,528][123091] Updated weights for policy 0, policy_version 852385 (0.0010) [2023-12-26 06:23:40,586][123091] Updated weights for policy 0, policy_version 852395 (0.0010) [2023-12-26 06:23:40,612][123090] Updated weights for policy 1, policy_version 846340 (0.0010) [2023-12-26 06:23:40,680][123090] Updated weights for policy 1, policy_version 846350 (0.0009) [2023-12-26 06:23:40,748][123090] Updated weights for policy 1, policy_version 846360 (0.0010) [2023-12-26 06:23:41,505][123091] Updated weights for policy 0, policy_version 852405 (0.0009) [2023-12-26 06:23:41,569][123091] Updated weights for policy 0, policy_version 852415 (0.0010) [2023-12-26 06:23:41,575][123090] Updated weights for policy 1, policy_version 846370 (0.0010) [2023-12-26 06:23:41,639][123091] Updated weights for policy 0, policy_version 852425 (0.0008) [2023-12-26 06:23:41,654][123090] Updated weights for policy 1, policy_version 846380 (0.0008) [2023-12-26 06:23:41,721][123090] Updated weights for policy 1, policy_version 846390 (0.0009) [2023-12-26 06:23:41,793][123090] Updated weights for policy 1, policy_version 846400 (0.0009) [2023-12-26 06:23:42,440][123091] Updated weights for policy 0, policy_version 852435 (0.0007) [2023-12-26 06:23:42,496][123091] Updated weights for policy 0, policy_version 852445 (0.0008) [2023-12-26 06:23:42,545][123091] Updated weights for policy 0, policy_version 852455 (0.0008) [2023-12-26 06:23:42,665][123090] Updated weights for policy 1, policy_version 846410 (0.0009) [2023-12-26 06:23:42,729][123090] Updated weights for policy 1, policy_version 846420 (0.0009) [2023-12-26 06:23:42,783][123090] Updated weights for policy 1, policy_version 846430 (0.0009) [2023-12-26 06:23:43,336][123091] Updated weights for policy 0, policy_version 852465 (0.0008) [2023-12-26 06:23:43,391][123091] Updated weights for policy 0, policy_version 852475 (0.0008) [2023-12-26 06:23:43,454][123091] Updated weights for policy 0, policy_version 852485 (0.0008) [2023-12-26 06:23:43,509][123091] Updated weights for policy 0, policy_version 852495 (0.0008) [2023-12-26 06:23:43,540][123090] Updated weights for policy 1, policy_version 846440 (0.0008) [2023-12-26 06:23:43,592][123090] Updated weights for policy 1, policy_version 846450 (0.0009) [2023-12-26 06:23:43,646][123090] Updated weights for policy 1, policy_version 846460 (0.0010) [2023-12-26 06:23:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 434937856. Throughput: 0: 8903.6, 1: 8783.3. Samples: 434926808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:43,785][121949] Avg episode reward: [(0, '6144.208'), (1, '5657.896')] [2023-12-26 06:23:44,144][123091] Updated weights for policy 0, policy_version 852505 (0.0006) [2023-12-26 06:23:44,196][123091] Updated weights for policy 0, policy_version 852515 (0.0006) [2023-12-26 06:23:44,266][123091] Updated weights for policy 0, policy_version 852525 (0.0005) [2023-12-26 06:23:44,600][123090] Updated weights for policy 1, policy_version 846471 (0.0009) [2023-12-26 06:23:44,657][123090] Updated weights for policy 1, policy_version 846481 (0.0010) [2023-12-26 06:23:44,724][123090] Updated weights for policy 1, policy_version 846491 (0.0010) [2023-12-26 06:23:45,037][123091] Updated weights for policy 0, policy_version 852535 (0.0008) [2023-12-26 06:23:45,086][123091] Updated weights for policy 0, policy_version 852545 (0.0009) [2023-12-26 06:23:45,154][123091] Updated weights for policy 0, policy_version 852555 (0.0010) [2023-12-26 06:23:45,586][123090] Updated weights for policy 1, policy_version 846501 (0.0009) [2023-12-26 06:23:45,635][123090] Updated weights for policy 1, policy_version 846511 (0.0008) [2023-12-26 06:23:45,703][123090] Updated weights for policy 1, policy_version 846521 (0.0009) [2023-12-26 06:23:45,981][123091] Updated weights for policy 0, policy_version 852565 (0.0008) [2023-12-26 06:23:46,046][123091] Updated weights for policy 0, policy_version 852575 (0.0005) [2023-12-26 06:23:46,119][123091] Updated weights for policy 0, policy_version 852585 (0.0005) [2023-12-26 06:23:46,600][123090] Updated weights for policy 1, policy_version 846531 (0.0009) [2023-12-26 06:23:46,653][123090] Updated weights for policy 1, policy_version 846541 (0.0010) [2023-12-26 06:23:46,692][123091] Updated weights for policy 0, policy_version 852595 (0.0005) [2023-12-26 06:23:46,710][123090] Updated weights for policy 1, policy_version 846551 (0.0009) [2023-12-26 06:23:46,752][123091] Updated weights for policy 0, policy_version 852605 (0.0007) [2023-12-26 06:23:46,807][123091] Updated weights for policy 0, policy_version 852615 (0.0010) [2023-12-26 06:23:47,593][123091] Updated weights for policy 0, policy_version 852625 (0.0011) [2023-12-26 06:23:47,608][123090] Updated weights for policy 1, policy_version 846561 (0.0007) [2023-12-26 06:23:47,645][123091] Updated weights for policy 0, policy_version 852635 (0.0010) [2023-12-26 06:23:47,657][123090] Updated weights for policy 1, policy_version 846571 (0.0005) [2023-12-26 06:23:47,690][123091] Updated weights for policy 0, policy_version 852645 (0.0010) [2023-12-26 06:23:47,714][123090] Updated weights for policy 1, policy_version 846581 (0.0006) [2023-12-26 06:23:47,738][123091] Updated weights for policy 0, policy_version 852655 (0.0011) [2023-12-26 06:23:47,772][123090] Updated weights for policy 1, policy_version 846591 (0.0007) [2023-12-26 06:23:48,542][123090] Updated weights for policy 1, policy_version 846601 (0.0007) [2023-12-26 06:23:48,560][123091] Updated weights for policy 0, policy_version 852665 (0.0011) [2023-12-26 06:23:48,603][123090] Updated weights for policy 1, policy_version 846611 (0.0008) [2023-12-26 06:23:48,616][123091] Updated weights for policy 0, policy_version 852675 (0.0011) [2023-12-26 06:23:48,663][123090] Updated weights for policy 1, policy_version 846621 (0.0009) [2023-12-26 06:23:48,680][123091] Updated weights for policy 0, policy_version 852685 (0.0011) [2023-12-26 06:23:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 435027968. Throughput: 0: 9042.3, 1: 8759.9. Samples: 435033868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:48,785][121949] Avg episode reward: [(0, '6221.743'), (1, '5545.289')] [2023-12-26 06:23:49,520][123091] Updated weights for policy 0, policy_version 852695 (0.0010) [2023-12-26 06:23:49,525][123090] Updated weights for policy 1, policy_version 846631 (0.0010) [2023-12-26 06:23:49,579][123091] Updated weights for policy 0, policy_version 852705 (0.0011) [2023-12-26 06:23:49,582][123090] Updated weights for policy 1, policy_version 846641 (0.0007) [2023-12-26 06:23:49,631][123091] Updated weights for policy 0, policy_version 852715 (0.0011) [2023-12-26 06:23:49,644][123090] Updated weights for policy 1, policy_version 846651 (0.0006) [2023-12-26 06:23:50,484][123090] Updated weights for policy 1, policy_version 846661 (0.0011) [2023-12-26 06:23:50,492][123091] Updated weights for policy 0, policy_version 852725 (0.0010) [2023-12-26 06:23:50,544][123090] Updated weights for policy 1, policy_version 846671 (0.0011) [2023-12-26 06:23:50,556][123091] Updated weights for policy 0, policy_version 852735 (0.0006) [2023-12-26 06:23:50,613][123090] Updated weights for policy 1, policy_version 846681 (0.0010) [2023-12-26 06:23:50,621][123091] Updated weights for policy 0, policy_version 852745 (0.0008) [2023-12-26 06:23:51,479][123090] Updated weights for policy 1, policy_version 846691 (0.0009) [2023-12-26 06:23:51,499][123091] Updated weights for policy 0, policy_version 852755 (0.0008) [2023-12-26 06:23:51,538][123090] Updated weights for policy 1, policy_version 846701 (0.0007) [2023-12-26 06:23:51,562][123091] Updated weights for policy 0, policy_version 852765 (0.0008) [2023-12-26 06:23:51,598][123090] Updated weights for policy 1, policy_version 846711 (0.0007) [2023-12-26 06:23:51,620][123091] Updated weights for policy 0, policy_version 852775 (0.0009) [2023-12-26 06:23:52,280][123090] Updated weights for policy 1, policy_version 846721 (0.0008) [2023-12-26 06:23:52,342][123090] Updated weights for policy 1, policy_version 846731 (0.0010) [2023-12-26 06:23:52,404][123090] Updated weights for policy 1, policy_version 846741 (0.0006) [2023-12-26 06:23:52,473][123090] Updated weights for policy 1, policy_version 846751 (0.0005) [2023-12-26 06:23:52,509][123091] Updated weights for policy 0, policy_version 852785 (0.0008) [2023-12-26 06:23:52,567][123091] Updated weights for policy 0, policy_version 852795 (0.0009) [2023-12-26 06:23:52,627][123091] Updated weights for policy 0, policy_version 852805 (0.0010) [2023-12-26 06:23:52,685][123091] Updated weights for policy 0, policy_version 852815 (0.0010) [2023-12-26 06:23:53,199][123090] Updated weights for policy 1, policy_version 846761 (0.0009) [2023-12-26 06:23:53,259][123090] Updated weights for policy 1, policy_version 846771 (0.0010) [2023-12-26 06:23:53,323][123090] Updated weights for policy 1, policy_version 846781 (0.0009) [2023-12-26 06:23:53,544][123091] Updated weights for policy 0, policy_version 852825 (0.0006) [2023-12-26 06:23:53,614][123091] Updated weights for policy 0, policy_version 852835 (0.0008) [2023-12-26 06:23:53,683][123091] Updated weights for policy 0, policy_version 852845 (0.0010) [2023-12-26 06:23:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 435109888. Throughput: 0: 8982.6, 1: 8702.8. Samples: 435083808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:53,785][121949] Avg episode reward: [(0, '6124.321'), (1, '5552.289')] [2023-12-26 06:23:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000852848_218333184.pth... [2023-12-26 06:23:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000846784_216776704.pth... [2023-12-26 06:23:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000851792_218062848.pth [2023-12-26 06:23:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000845760_216514560.pth [2023-12-26 06:23:54,101][123090] Updated weights for policy 1, policy_version 846791 (0.0009) [2023-12-26 06:23:54,162][123090] Updated weights for policy 1, policy_version 846801 (0.0009) [2023-12-26 06:23:54,219][123090] Updated weights for policy 1, policy_version 846811 (0.0005) [2023-12-26 06:23:54,503][123091] Updated weights for policy 0, policy_version 852855 (0.0009) [2023-12-26 06:23:54,565][123091] Updated weights for policy 0, policy_version 852865 (0.0009) [2023-12-26 06:23:54,636][123091] Updated weights for policy 0, policy_version 852875 (0.0009) [2023-12-26 06:23:55,034][123090] Updated weights for policy 1, policy_version 846821 (0.0008) [2023-12-26 06:23:55,091][123090] Updated weights for policy 1, policy_version 846831 (0.0011) [2023-12-26 06:23:55,162][123090] Updated weights for policy 1, policy_version 846841 (0.0011) [2023-12-26 06:23:55,497][123091] Updated weights for policy 0, policy_version 852885 (0.0009) [2023-12-26 06:23:55,548][123091] Updated weights for policy 0, policy_version 852895 (0.0009) [2023-12-26 06:23:55,604][123091] Updated weights for policy 0, policy_version 852905 (0.0009) [2023-12-26 06:23:55,847][123090] Updated weights for policy 1, policy_version 846851 (0.0010) [2023-12-26 06:23:55,893][123090] Updated weights for policy 1, policy_version 846861 (0.0009) [2023-12-26 06:23:55,946][123090] Updated weights for policy 1, policy_version 846872 (0.0010) [2023-12-26 06:23:56,291][123091] Updated weights for policy 0, policy_version 852915 (0.0008) [2023-12-26 06:23:56,355][123091] Updated weights for policy 0, policy_version 852925 (0.0005) [2023-12-26 06:23:56,409][123091] Updated weights for policy 0, policy_version 852935 (0.0005) [2023-12-26 06:23:56,838][123090] Updated weights for policy 1, policy_version 846883 (0.0009) [2023-12-26 06:23:56,893][123090] Updated weights for policy 1, policy_version 846893 (0.0005) [2023-12-26 06:23:56,927][123091] Updated weights for policy 0, policy_version 852945 (0.0005) [2023-12-26 06:23:56,947][123090] Updated weights for policy 1, policy_version 846903 (0.0005) [2023-12-26 06:23:56,981][123091] Updated weights for policy 0, policy_version 852955 (0.0005) [2023-12-26 06:23:57,037][123091] Updated weights for policy 0, policy_version 852965 (0.0005) [2023-12-26 06:23:57,085][123091] Updated weights for policy 0, policy_version 852975 (0.0006) [2023-12-26 06:23:57,597][123090] Updated weights for policy 1, policy_version 846913 (0.0006) [2023-12-26 06:23:57,657][123090] Updated weights for policy 1, policy_version 846923 (0.0009) [2023-12-26 06:23:57,712][123090] Updated weights for policy 1, policy_version 846933 (0.0009) [2023-12-26 06:23:57,775][123090] Updated weights for policy 1, policy_version 846943 (0.0009) [2023-12-26 06:23:57,881][123091] Updated weights for policy 0, policy_version 852985 (0.0009) [2023-12-26 06:23:57,929][123091] Updated weights for policy 0, policy_version 852996 (0.0009) [2023-12-26 06:23:57,977][123091] Updated weights for policy 0, policy_version 853007 (0.0010) [2023-12-26 06:23:58,716][123090] Updated weights for policy 1, policy_version 846953 (0.0009) [2023-12-26 06:23:58,785][121949] Fps is (10 sec: 16382.3, 60 sec: 17612.4, 300 sec: 17800.2). Total num frames: 435191808. Throughput: 0: 9024.3, 1: 8751.9. Samples: 435194028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:23:58,786][121949] Avg episode reward: [(0, '6145.478'), (1, '5625.487')] [2023-12-26 06:23:58,791][123090] Updated weights for policy 1, policy_version 846963 (0.0008) [2023-12-26 06:23:58,854][123090] Updated weights for policy 1, policy_version 846973 (0.0009) [2023-12-26 06:23:58,961][123091] Updated weights for policy 0, policy_version 853017 (0.0008) [2023-12-26 06:23:59,020][123091] Updated weights for policy 0, policy_version 853027 (0.0006) [2023-12-26 06:23:59,078][123091] Updated weights for policy 0, policy_version 853037 (0.0006) [2023-12-26 06:23:59,728][123090] Updated weights for policy 1, policy_version 846983 (0.0009) [2023-12-26 06:23:59,791][123090] Updated weights for policy 1, policy_version 846993 (0.0009) [2023-12-26 06:23:59,858][123090] Updated weights for policy 1, policy_version 847003 (0.0010) [2023-12-26 06:23:59,887][123091] Updated weights for policy 0, policy_version 853047 (0.0008) [2023-12-26 06:23:59,960][123091] Updated weights for policy 0, policy_version 853057 (0.0008) [2023-12-26 06:24:00,021][123091] Updated weights for policy 0, policy_version 853067 (0.0009) [2023-12-26 06:24:00,601][123090] Updated weights for policy 1, policy_version 847013 (0.0008) [2023-12-26 06:24:00,648][123090] Updated weights for policy 1, policy_version 847023 (0.0009) [2023-12-26 06:24:00,702][123090] Updated weights for policy 1, policy_version 847033 (0.0009) [2023-12-26 06:24:00,847][123091] Updated weights for policy 0, policy_version 853077 (0.0010) [2023-12-26 06:24:00,908][123091] Updated weights for policy 0, policy_version 853088 (0.0010) [2023-12-26 06:24:00,960][123091] Updated weights for policy 0, policy_version 853098 (0.0009) [2023-12-26 06:24:01,517][123090] Updated weights for policy 1, policy_version 847043 (0.0009) [2023-12-26 06:24:01,581][123090] Updated weights for policy 1, policy_version 847053 (0.0008) [2023-12-26 06:24:01,661][123090] Updated weights for policy 1, policy_version 847063 (0.0007) [2023-12-26 06:24:01,866][123091] Updated weights for policy 0, policy_version 853108 (0.0009) [2023-12-26 06:24:01,933][123091] Updated weights for policy 0, policy_version 853118 (0.0011) [2023-12-26 06:24:02,003][123091] Updated weights for policy 0, policy_version 853128 (0.0011) [2023-12-26 06:24:02,399][123090] Updated weights for policy 1, policy_version 847073 (0.0006) [2023-12-26 06:24:02,465][123090] Updated weights for policy 1, policy_version 847083 (0.0006) [2023-12-26 06:24:02,531][123090] Updated weights for policy 1, policy_version 847093 (0.0010) [2023-12-26 06:24:02,597][123090] Updated weights for policy 1, policy_version 847103 (0.0010) [2023-12-26 06:24:02,781][123091] Updated weights for policy 0, policy_version 853138 (0.0008) [2023-12-26 06:24:02,839][123091] Updated weights for policy 0, policy_version 853148 (0.0006) [2023-12-26 06:24:02,897][123091] Updated weights for policy 0, policy_version 853158 (0.0010) [2023-12-26 06:24:02,948][123091] Updated weights for policy 0, policy_version 853168 (0.0010) [2023-12-26 06:24:03,392][123090] Updated weights for policy 1, policy_version 847113 (0.0009) [2023-12-26 06:24:03,455][123090] Updated weights for policy 1, policy_version 847123 (0.0010) [2023-12-26 06:24:03,507][123090] Updated weights for policy 1, policy_version 847133 (0.0009) [2023-12-26 06:24:03,577][123091] Updated weights for policy 0, policy_version 853178 (0.0005) [2023-12-26 06:24:03,630][123091] Updated weights for policy 0, policy_version 853188 (0.0005) [2023-12-26 06:24:03,681][123091] Updated weights for policy 0, policy_version 853198 (0.0005) [2023-12-26 06:24:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 435290112. Throughput: 0: 8968.4, 1: 8756.8. Samples: 435296804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:03,785][121949] Avg episode reward: [(0, '6043.326'), (1, '5410.926')] [2023-12-26 06:24:04,340][123091] Updated weights for policy 0, policy_version 853208 (0.0005) [2023-12-26 06:24:04,395][123091] Updated weights for policy 0, policy_version 853218 (0.0005) [2023-12-26 06:24:04,446][123090] Updated weights for policy 1, policy_version 847143 (0.0009) [2023-12-26 06:24:04,467][123091] Updated weights for policy 0, policy_version 853228 (0.0007) [2023-12-26 06:24:04,511][123090] Updated weights for policy 1, policy_version 847153 (0.0007) [2023-12-26 06:24:04,574][123090] Updated weights for policy 1, policy_version 847163 (0.0010) [2023-12-26 06:24:05,272][123091] Updated weights for policy 0, policy_version 853238 (0.0010) [2023-12-26 06:24:05,332][123091] Updated weights for policy 0, policy_version 853248 (0.0010) [2023-12-26 06:24:05,399][123091] Updated weights for policy 0, policy_version 853258 (0.0009) [2023-12-26 06:24:05,407][123090] Updated weights for policy 1, policy_version 847173 (0.0009) [2023-12-26 06:24:05,480][123090] Updated weights for policy 1, policy_version 847183 (0.0009) [2023-12-26 06:24:05,554][123090] Updated weights for policy 1, policy_version 847193 (0.0010) [2023-12-26 06:24:06,220][123091] Updated weights for policy 0, policy_version 853268 (0.0010) [2023-12-26 06:24:06,286][123091] Updated weights for policy 0, policy_version 853278 (0.0011) [2023-12-26 06:24:06,314][123090] Updated weights for policy 1, policy_version 847203 (0.0008) [2023-12-26 06:24:06,353][123091] Updated weights for policy 0, policy_version 853288 (0.0011) [2023-12-26 06:24:06,377][123090] Updated weights for policy 1, policy_version 847213 (0.0006) [2023-12-26 06:24:06,445][123090] Updated weights for policy 1, policy_version 847223 (0.0006) [2023-12-26 06:24:07,145][123091] Updated weights for policy 0, policy_version 853298 (0.0010) [2023-12-26 06:24:07,193][123091] Updated weights for policy 0, policy_version 853308 (0.0009) [2023-12-26 06:24:07,206][123090] Updated weights for policy 1, policy_version 847233 (0.0005) [2023-12-26 06:24:07,251][123091] Updated weights for policy 0, policy_version 853318 (0.0010) [2023-12-26 06:24:07,272][123090] Updated weights for policy 1, policy_version 847243 (0.0006) [2023-12-26 06:24:07,317][123091] Updated weights for policy 0, policy_version 853328 (0.0007) [2023-12-26 06:24:07,331][123090] Updated weights for policy 1, policy_version 847253 (0.0009) [2023-12-26 06:24:07,395][123090] Updated weights for policy 1, policy_version 847263 (0.0008) [2023-12-26 06:24:08,055][123090] Updated weights for policy 1, policy_version 847273 (0.0006) [2023-12-26 06:24:08,115][123090] Updated weights for policy 1, policy_version 847283 (0.0007) [2023-12-26 06:24:08,132][123091] Updated weights for policy 0, policy_version 853338 (0.0010) [2023-12-26 06:24:08,181][123090] Updated weights for policy 1, policy_version 847293 (0.0008) [2023-12-26 06:24:08,183][123091] Updated weights for policy 0, policy_version 853348 (0.0010) [2023-12-26 06:24:08,242][123091] Updated weights for policy 0, policy_version 853358 (0.0010) [2023-12-26 06:24:08,784][121949] Fps is (10 sec: 18024.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 435372032. Throughput: 0: 8984.8, 1: 8765.1. Samples: 435349328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:08,785][121949] Avg episode reward: [(0, '5877.250'), (1, '5560.674')] [2023-12-26 06:24:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000847296_216907776.pth... [2023-12-26 06:24:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000853360_218464256.pth... [2023-12-26 06:24:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000846272_216645632.pth [2023-12-26 06:24:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000852336_218202112.pth [2023-12-26 06:24:08,892][123090] Updated weights for policy 1, policy_version 847303 (0.0011) [2023-12-26 06:24:08,952][123090] Updated weights for policy 1, policy_version 847313 (0.0005) [2023-12-26 06:24:09,009][123090] Updated weights for policy 1, policy_version 847323 (0.0005) [2023-12-26 06:24:09,072][123091] Updated weights for policy 0, policy_version 853368 (0.0010) [2023-12-26 06:24:09,115][123091] Updated weights for policy 0, policy_version 853378 (0.0010) [2023-12-26 06:24:09,162][123091] Updated weights for policy 0, policy_version 853388 (0.0010) [2023-12-26 06:24:09,779][123090] Updated weights for policy 1, policy_version 847333 (0.0008) [2023-12-26 06:24:09,847][123090] Updated weights for policy 1, policy_version 847343 (0.0011) [2023-12-26 06:24:09,918][123090] Updated weights for policy 1, policy_version 847353 (0.0010) [2023-12-26 06:24:10,014][123091] Updated weights for policy 0, policy_version 853398 (0.0010) [2023-12-26 06:24:10,077][123091] Updated weights for policy 0, policy_version 853408 (0.0011) [2023-12-26 06:24:10,141][123091] Updated weights for policy 0, policy_version 853418 (0.0011) [2023-12-26 06:24:10,701][123090] Updated weights for policy 1, policy_version 847363 (0.0008) [2023-12-26 06:24:10,756][123090] Updated weights for policy 1, policy_version 847373 (0.0010) [2023-12-26 06:24:10,818][123090] Updated weights for policy 1, policy_version 847383 (0.0010) [2023-12-26 06:24:10,975][123091] Updated weights for policy 0, policy_version 853428 (0.0011) [2023-12-26 06:24:11,038][123091] Updated weights for policy 0, policy_version 853438 (0.0011) [2023-12-26 06:24:11,104][123091] Updated weights for policy 0, policy_version 853448 (0.0008) [2023-12-26 06:24:11,656][123090] Updated weights for policy 1, policy_version 847393 (0.0010) [2023-12-26 06:24:11,731][123090] Updated weights for policy 1, policy_version 847403 (0.0009) [2023-12-26 06:24:11,797][123090] Updated weights for policy 1, policy_version 847413 (0.0009) [2023-12-26 06:24:11,867][123090] Updated weights for policy 1, policy_version 847423 (0.0009) [2023-12-26 06:24:11,897][123091] Updated weights for policy 0, policy_version 853458 (0.0008) [2023-12-26 06:24:11,973][123091] Updated weights for policy 0, policy_version 853468 (0.0007) [2023-12-26 06:24:12,029][123091] Updated weights for policy 0, policy_version 853478 (0.0011) [2023-12-26 06:24:12,089][123091] Updated weights for policy 0, policy_version 853488 (0.0011) [2023-12-26 06:24:12,752][123090] Updated weights for policy 1, policy_version 847433 (0.0008) [2023-12-26 06:24:12,805][123090] Updated weights for policy 1, policy_version 847443 (0.0010) [2023-12-26 06:24:12,825][123091] Updated weights for policy 0, policy_version 853498 (0.0010) [2023-12-26 06:24:12,854][123090] Updated weights for policy 1, policy_version 847453 (0.0010) [2023-12-26 06:24:12,873][123091] Updated weights for policy 0, policy_version 853508 (0.0011) [2023-12-26 06:24:12,921][123091] Updated weights for policy 0, policy_version 853518 (0.0011) [2023-12-26 06:24:13,662][123090] Updated weights for policy 1, policy_version 847463 (0.0010) [2023-12-26 06:24:13,714][123090] Updated weights for policy 1, policy_version 847473 (0.0010) [2023-12-26 06:24:13,751][123091] Updated weights for policy 0, policy_version 853528 (0.0007) [2023-12-26 06:24:13,770][123090] Updated weights for policy 1, policy_version 847483 (0.0010) [2023-12-26 06:24:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 435453952. Throughput: 0: 8910.4, 1: 8748.5. Samples: 435455672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:13,785][121949] Avg episode reward: [(0, '6000.643'), (1, '5718.405')] [2023-12-26 06:24:13,812][123091] Updated weights for policy 0, policy_version 853538 (0.0006) [2023-12-26 06:24:13,888][123091] Updated weights for policy 0, policy_version 853548 (0.0005) [2023-12-26 06:24:14,566][123091] Updated weights for policy 0, policy_version 853558 (0.0006) [2023-12-26 06:24:14,584][123090] Updated weights for policy 1, policy_version 847493 (0.0008) [2023-12-26 06:24:14,613][123091] Updated weights for policy 0, policy_version 853568 (0.0005) [2023-12-26 06:24:14,642][123090] Updated weights for policy 1, policy_version 847503 (0.0005) [2023-12-26 06:24:14,663][123091] Updated weights for policy 0, policy_version 853578 (0.0005) [2023-12-26 06:24:14,704][123090] Updated weights for policy 1, policy_version 847513 (0.0005) [2023-12-26 06:24:15,395][123091] Updated weights for policy 0, policy_version 853588 (0.0006) [2023-12-26 06:24:15,469][123091] Updated weights for policy 0, policy_version 853598 (0.0009) [2023-12-26 06:24:15,495][123090] Updated weights for policy 1, policy_version 847523 (0.0007) [2023-12-26 06:24:15,537][123091] Updated weights for policy 0, policy_version 853608 (0.0009) [2023-12-26 06:24:15,562][123090] Updated weights for policy 1, policy_version 847533 (0.0011) [2023-12-26 06:24:15,627][123090] Updated weights for policy 1, policy_version 847543 (0.0010) [2023-12-26 06:24:16,217][123091] Updated weights for policy 0, policy_version 853618 (0.0010) [2023-12-26 06:24:16,263][123091] Updated weights for policy 0, policy_version 853628 (0.0005) [2023-12-26 06:24:16,310][123091] Updated weights for policy 0, policy_version 853638 (0.0006) [2023-12-26 06:24:16,365][123091] Updated weights for policy 0, policy_version 853648 (0.0005) [2023-12-26 06:24:16,486][123090] Updated weights for policy 1, policy_version 847553 (0.0011) [2023-12-26 06:24:16,545][123090] Updated weights for policy 1, policy_version 847563 (0.0010) [2023-12-26 06:24:16,604][123090] Updated weights for policy 1, policy_version 847573 (0.0010) [2023-12-26 06:24:16,658][123090] Updated weights for policy 1, policy_version 847583 (0.0010) [2023-12-26 06:24:17,030][123091] Updated weights for policy 0, policy_version 853658 (0.0005) [2023-12-26 06:24:17,088][123091] Updated weights for policy 0, policy_version 853668 (0.0005) [2023-12-26 06:24:17,146][123091] Updated weights for policy 0, policy_version 853678 (0.0005) [2023-12-26 06:24:17,414][123090] Updated weights for policy 1, policy_version 847593 (0.0011) [2023-12-26 06:24:17,476][123090] Updated weights for policy 1, policy_version 847603 (0.0010) [2023-12-26 06:24:17,539][123090] Updated weights for policy 1, policy_version 847613 (0.0010) [2023-12-26 06:24:17,826][123091] Updated weights for policy 0, policy_version 853688 (0.0005) [2023-12-26 06:24:17,899][123091] Updated weights for policy 0, policy_version 853698 (0.0005) [2023-12-26 06:24:17,978][123091] Updated weights for policy 0, policy_version 853708 (0.0005) [2023-12-26 06:24:18,280][123090] Updated weights for policy 1, policy_version 847623 (0.0009) [2023-12-26 06:24:18,344][123090] Updated weights for policy 1, policy_version 847633 (0.0008) [2023-12-26 06:24:18,416][123090] Updated weights for policy 1, policy_version 847643 (0.0011) [2023-12-26 06:24:18,627][123091] Updated weights for policy 0, policy_version 853718 (0.0009) [2023-12-26 06:24:18,683][123091] Updated weights for policy 0, policy_version 853728 (0.0011) [2023-12-26 06:24:18,730][123091] Updated weights for policy 0, policy_version 853738 (0.0010) [2023-12-26 06:24:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 435560448. Throughput: 0: 8954.7, 1: 8754.2. Samples: 435567644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:18,785][121949] Avg episode reward: [(0, '6102.328'), (1, '5844.390')] [2023-12-26 06:24:19,162][123090] Updated weights for policy 1, policy_version 847653 (0.0008) [2023-12-26 06:24:19,221][123090] Updated weights for policy 1, policy_version 847663 (0.0008) [2023-12-26 06:24:19,281][123090] Updated weights for policy 1, policy_version 847673 (0.0008) [2023-12-26 06:24:19,555][123091] Updated weights for policy 0, policy_version 853748 (0.0009) [2023-12-26 06:24:19,614][123091] Updated weights for policy 0, policy_version 853758 (0.0011) [2023-12-26 06:24:19,682][123091] Updated weights for policy 0, policy_version 853768 (0.0011) [2023-12-26 06:24:20,071][123090] Updated weights for policy 1, policy_version 847683 (0.0008) [2023-12-26 06:24:20,142][123090] Updated weights for policy 1, policy_version 847693 (0.0009) [2023-12-26 06:24:20,200][123090] Updated weights for policy 1, policy_version 847703 (0.0009) [2023-12-26 06:24:20,514][123091] Updated weights for policy 0, policy_version 853778 (0.0011) [2023-12-26 06:24:20,581][123091] Updated weights for policy 0, policy_version 853788 (0.0010) [2023-12-26 06:24:20,651][123091] Updated weights for policy 0, policy_version 853798 (0.0010) [2023-12-26 06:24:20,714][123091] Updated weights for policy 0, policy_version 853808 (0.0011) [2023-12-26 06:24:21,072][123090] Updated weights for policy 1, policy_version 847713 (0.0009) [2023-12-26 06:24:21,136][123090] Updated weights for policy 1, policy_version 847723 (0.0009) [2023-12-26 06:24:21,204][123090] Updated weights for policy 1, policy_version 847733 (0.0009) [2023-12-26 06:24:21,268][123090] Updated weights for policy 1, policy_version 847743 (0.0010) [2023-12-26 06:24:21,507][123091] Updated weights for policy 0, policy_version 853818 (0.0007) [2023-12-26 06:24:21,578][123091] Updated weights for policy 0, policy_version 853828 (0.0009) [2023-12-26 06:24:21,654][123091] Updated weights for policy 0, policy_version 853838 (0.0008) [2023-12-26 06:24:22,142][123090] Updated weights for policy 1, policy_version 847753 (0.0006) [2023-12-26 06:24:22,213][123090] Updated weights for policy 1, policy_version 847763 (0.0005) [2023-12-26 06:24:22,276][123090] Updated weights for policy 1, policy_version 847773 (0.0006) [2023-12-26 06:24:22,483][123091] Updated weights for policy 0, policy_version 853848 (0.0009) [2023-12-26 06:24:22,538][123091] Updated weights for policy 0, policy_version 853858 (0.0009) [2023-12-26 06:24:22,604][123091] Updated weights for policy 0, policy_version 853868 (0.0009) [2023-12-26 06:24:23,068][123090] Updated weights for policy 1, policy_version 847783 (0.0008) [2023-12-26 06:24:23,130][123090] Updated weights for policy 1, policy_version 847793 (0.0007) [2023-12-26 06:24:23,193][123090] Updated weights for policy 1, policy_version 847803 (0.0010) [2023-12-26 06:24:23,379][123091] Updated weights for policy 0, policy_version 853878 (0.0008) [2023-12-26 06:24:23,432][123091] Updated weights for policy 0, policy_version 853888 (0.0008) [2023-12-26 06:24:23,486][123091] Updated weights for policy 0, policy_version 853898 (0.0010) [2023-12-26 06:24:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 435642368. Throughput: 0: 8934.5, 1: 8775.2. Samples: 435619268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:23,784][121949] Avg episode reward: [(0, '6232.178'), (1, '5783.701')] [2023-12-26 06:24:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000853904_218603520.pth... [2023-12-26 06:24:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000847808_217038848.pth... [2023-12-26 06:24:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000852848_218333184.pth [2023-12-26 06:24:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000846784_216776704.pth [2023-12-26 06:24:24,030][123090] Updated weights for policy 1, policy_version 847813 (0.0009) [2023-12-26 06:24:24,098][123090] Updated weights for policy 1, policy_version 847823 (0.0007) [2023-12-26 06:24:24,160][123090] Updated weights for policy 1, policy_version 847833 (0.0010) [2023-12-26 06:24:24,250][123091] Updated weights for policy 0, policy_version 853908 (0.0010) [2023-12-26 06:24:24,309][123091] Updated weights for policy 0, policy_version 853918 (0.0009) [2023-12-26 06:24:24,372][123091] Updated weights for policy 0, policy_version 853928 (0.0008) [2023-12-26 06:24:24,997][123090] Updated weights for policy 1, policy_version 847843 (0.0009) [2023-12-26 06:24:25,058][123090] Updated weights for policy 1, policy_version 847853 (0.0009) [2023-12-26 06:24:25,119][123090] Updated weights for policy 1, policy_version 847863 (0.0010) [2023-12-26 06:24:25,216][123091] Updated weights for policy 0, policy_version 853938 (0.0009) [2023-12-26 06:24:25,279][123091] Updated weights for policy 0, policy_version 853948 (0.0009) [2023-12-26 06:24:25,344][123091] Updated weights for policy 0, policy_version 853958 (0.0009) [2023-12-26 06:24:25,402][123091] Updated weights for policy 0, policy_version 853968 (0.0010) [2023-12-26 06:24:25,931][123090] Updated weights for policy 1, policy_version 847873 (0.0009) [2023-12-26 06:24:25,994][123090] Updated weights for policy 1, policy_version 847883 (0.0008) [2023-12-26 06:24:26,066][123090] Updated weights for policy 1, policy_version 847893 (0.0006) [2023-12-26 06:24:26,121][123090] Updated weights for policy 1, policy_version 847903 (0.0005) [2023-12-26 06:24:26,206][123091] Updated weights for policy 0, policy_version 853978 (0.0005) [2023-12-26 06:24:26,254][123091] Updated weights for policy 0, policy_version 853988 (0.0005) [2023-12-26 06:24:26,319][123091] Updated weights for policy 0, policy_version 853998 (0.0007) [2023-12-26 06:24:26,757][123090] Updated weights for policy 1, policy_version 847913 (0.0005) [2023-12-26 06:24:26,830][123090] Updated weights for policy 1, policy_version 847923 (0.0005) [2023-12-26 06:24:26,884][123090] Updated weights for policy 1, policy_version 847933 (0.0005) [2023-12-26 06:24:27,189][123091] Updated weights for policy 0, policy_version 854008 (0.0010) [2023-12-26 06:24:27,248][123091] Updated weights for policy 0, policy_version 854018 (0.0007) [2023-12-26 06:24:27,308][123091] Updated weights for policy 0, policy_version 854028 (0.0007) [2023-12-26 06:24:27,524][123090] Updated weights for policy 1, policy_version 847943 (0.0005) [2023-12-26 06:24:27,577][123090] Updated weights for policy 1, policy_version 847953 (0.0005) [2023-12-26 06:24:27,665][123090] Updated weights for policy 1, policy_version 847963 (0.0005) [2023-12-26 06:24:28,027][123091] Updated weights for policy 0, policy_version 854038 (0.0007) [2023-12-26 06:24:28,095][123091] Updated weights for policy 0, policy_version 854048 (0.0005) [2023-12-26 06:24:28,153][123091] Updated weights for policy 0, policy_version 854058 (0.0006) [2023-12-26 06:24:28,374][123090] Updated weights for policy 1, policy_version 847973 (0.0007) [2023-12-26 06:24:28,441][123090] Updated weights for policy 1, policy_version 847983 (0.0008) [2023-12-26 06:24:28,503][123090] Updated weights for policy 1, policy_version 847993 (0.0009) [2023-12-26 06:24:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 435732480. Throughput: 0: 8991.6, 1: 8753.7. Samples: 435725348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:28,785][121949] Avg episode reward: [(0, '6116.091'), (1, '5746.151')] [2023-12-26 06:24:28,862][123091] Updated weights for policy 0, policy_version 854068 (0.0005) [2023-12-26 06:24:28,931][123091] Updated weights for policy 0, policy_version 854078 (0.0006) [2023-12-26 06:24:29,012][123091] Updated weights for policy 0, policy_version 854088 (0.0006) [2023-12-26 06:24:29,280][123090] Updated weights for policy 1, policy_version 848003 (0.0008) [2023-12-26 06:24:29,356][123090] Updated weights for policy 1, policy_version 848013 (0.0007) [2023-12-26 06:24:29,424][123090] Updated weights for policy 1, policy_version 848023 (0.0009) [2023-12-26 06:24:29,627][123091] Updated weights for policy 0, policy_version 854098 (0.0006) [2023-12-26 06:24:29,676][123091] Updated weights for policy 0, policy_version 854108 (0.0009) [2023-12-26 06:24:29,733][123091] Updated weights for policy 0, policy_version 854119 (0.0010) [2023-12-26 06:24:30,179][123090] Updated weights for policy 1, policy_version 848033 (0.0008) [2023-12-26 06:24:30,248][123090] Updated weights for policy 1, policy_version 848043 (0.0010) [2023-12-26 06:24:30,313][123090] Updated weights for policy 1, policy_version 848053 (0.0010) [2023-12-26 06:24:30,385][123090] Updated weights for policy 1, policy_version 848063 (0.0008) [2023-12-26 06:24:30,571][123091] Updated weights for policy 0, policy_version 854129 (0.0007) [2023-12-26 06:24:30,625][123091] Updated weights for policy 0, policy_version 854140 (0.0008) [2023-12-26 06:24:30,678][123091] Updated weights for policy 0, policy_version 854151 (0.0010) [2023-12-26 06:24:31,038][123090] Updated weights for policy 1, policy_version 848073 (0.0006) [2023-12-26 06:24:31,096][123090] Updated weights for policy 1, policy_version 848083 (0.0007) [2023-12-26 06:24:31,162][123090] Updated weights for policy 1, policy_version 848093 (0.0008) [2023-12-26 06:24:31,571][123091] Updated weights for policy 0, policy_version 854161 (0.0009) [2023-12-26 06:24:31,641][123091] Updated weights for policy 0, policy_version 854171 (0.0009) [2023-12-26 06:24:31,701][123091] Updated weights for policy 0, policy_version 854181 (0.0009) [2023-12-26 06:24:31,762][123091] Updated weights for policy 0, policy_version 854191 (0.0010) [2023-12-26 06:24:31,946][123090] Updated weights for policy 1, policy_version 848103 (0.0008) [2023-12-26 06:24:31,995][123090] Updated weights for policy 1, policy_version 848113 (0.0008) [2023-12-26 06:24:32,044][123090] Updated weights for policy 1, policy_version 848123 (0.0009) [2023-12-26 06:24:32,562][123091] Updated weights for policy 0, policy_version 854201 (0.0007) [2023-12-26 06:24:32,617][123091] Updated weights for policy 0, policy_version 854211 (0.0005) [2023-12-26 06:24:32,671][123091] Updated weights for policy 0, policy_version 854221 (0.0005) [2023-12-26 06:24:32,861][123090] Updated weights for policy 1, policy_version 848133 (0.0007) [2023-12-26 06:24:32,936][123090] Updated weights for policy 1, policy_version 848143 (0.0005) [2023-12-26 06:24:32,999][123090] Updated weights for policy 1, policy_version 848153 (0.0006) [2023-12-26 06:24:33,443][123091] Updated weights for policy 0, policy_version 854231 (0.0008) [2023-12-26 06:24:33,505][123091] Updated weights for policy 0, policy_version 854241 (0.0008) [2023-12-26 06:24:33,571][123091] Updated weights for policy 0, policy_version 854251 (0.0007) [2023-12-26 06:24:33,667][123090] Updated weights for policy 1, policy_version 848163 (0.0006) [2023-12-26 06:24:33,722][123090] Updated weights for policy 1, policy_version 848173 (0.0009) [2023-12-26 06:24:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 435822592. Throughput: 0: 8933.2, 1: 8895.2. Samples: 435836144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:33,785][121949] Avg episode reward: [(0, '5968.020'), (1, '5812.322')] [2023-12-26 06:24:33,785][123090] Updated weights for policy 1, policy_version 848183 (0.0009) [2023-12-26 06:24:34,178][123091] Updated weights for policy 0, policy_version 854261 (0.0009) [2023-12-26 06:24:34,238][123091] Updated weights for policy 0, policy_version 854271 (0.0010) [2023-12-26 06:24:34,300][123091] Updated weights for policy 0, policy_version 854281 (0.0009) [2023-12-26 06:24:34,644][123090] Updated weights for policy 1, policy_version 848193 (0.0009) [2023-12-26 06:24:34,723][123090] Updated weights for policy 1, policy_version 848203 (0.0005) [2023-12-26 06:24:34,789][123090] Updated weights for policy 1, policy_version 848213 (0.0009) [2023-12-26 06:24:34,842][123090] Updated weights for policy 1, policy_version 848223 (0.0009) [2023-12-26 06:24:35,138][123091] Updated weights for policy 0, policy_version 854291 (0.0008) [2023-12-26 06:24:35,199][123091] Updated weights for policy 0, policy_version 854301 (0.0005) [2023-12-26 06:24:35,267][123091] Updated weights for policy 0, policy_version 854311 (0.0006) [2023-12-26 06:24:35,651][123090] Updated weights for policy 1, policy_version 848233 (0.0006) [2023-12-26 06:24:35,730][123090] Updated weights for policy 1, policy_version 848243 (0.0005) [2023-12-26 06:24:35,796][123090] Updated weights for policy 1, policy_version 848253 (0.0005) [2023-12-26 06:24:35,867][123091] Updated weights for policy 0, policy_version 854321 (0.0005) [2023-12-26 06:24:35,938][123091] Updated weights for policy 0, policy_version 854331 (0.0005) [2023-12-26 06:24:36,003][123091] Updated weights for policy 0, policy_version 854341 (0.0008) [2023-12-26 06:24:36,065][123091] Updated weights for policy 0, policy_version 854351 (0.0010) [2023-12-26 06:24:36,401][123090] Updated weights for policy 1, policy_version 848263 (0.0008) [2023-12-26 06:24:36,458][123090] Updated weights for policy 1, policy_version 848273 (0.0010) [2023-12-26 06:24:36,522][123090] Updated weights for policy 1, policy_version 848283 (0.0009) [2023-12-26 06:24:36,877][123091] Updated weights for policy 0, policy_version 854361 (0.0010) [2023-12-26 06:24:36,969][123091] Updated weights for policy 0, policy_version 854371 (0.0009) [2023-12-26 06:24:37,029][123091] Updated weights for policy 0, policy_version 854381 (0.0008) [2023-12-26 06:24:37,345][123090] Updated weights for policy 1, policy_version 848293 (0.0010) [2023-12-26 06:24:37,409][123090] Updated weights for policy 1, policy_version 848303 (0.0010) [2023-12-26 06:24:37,473][123090] Updated weights for policy 1, policy_version 848313 (0.0010) [2023-12-26 06:24:37,837][123091] Updated weights for policy 0, policy_version 854391 (0.0009) [2023-12-26 06:24:37,901][123091] Updated weights for policy 0, policy_version 854401 (0.0008) [2023-12-26 06:24:37,949][123091] Updated weights for policy 0, policy_version 854411 (0.0009) [2023-12-26 06:24:38,263][123090] Updated weights for policy 1, policy_version 848323 (0.0010) [2023-12-26 06:24:38,328][123090] Updated weights for policy 1, policy_version 848333 (0.0009) [2023-12-26 06:24:38,392][123090] Updated weights for policy 1, policy_version 848343 (0.0009) [2023-12-26 06:24:38,781][123091] Updated weights for policy 0, policy_version 854421 (0.0009) [2023-12-26 06:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 435912704. Throughput: 0: 9014.7, 1: 8939.0. Samples: 435891728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:38,785][121949] Avg episode reward: [(0, '6023.566'), (1, '5839.232')] [2023-12-26 06:24:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000848352_217178112.pth... [2023-12-26 06:24:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000847296_216907776.pth [2023-12-26 06:24:38,843][123091] Updated weights for policy 0, policy_version 854431 (0.0010) [2023-12-26 06:24:38,902][123091] Updated weights for policy 0, policy_version 854441 (0.0010) [2023-12-26 06:24:38,938][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000854448_218742784.pth... [2023-12-26 06:24:38,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000853360_218464256.pth [2023-12-26 06:24:39,170][123090] Updated weights for policy 1, policy_version 848353 (0.0009) [2023-12-26 06:24:39,233][123090] Updated weights for policy 1, policy_version 848363 (0.0009) [2023-12-26 06:24:39,296][123090] Updated weights for policy 1, policy_version 848373 (0.0006) [2023-12-26 06:24:39,366][123090] Updated weights for policy 1, policy_version 848383 (0.0010) [2023-12-26 06:24:39,787][123091] Updated weights for policy 0, policy_version 854451 (0.0009) [2023-12-26 06:24:39,850][123091] Updated weights for policy 0, policy_version 854461 (0.0010) [2023-12-26 06:24:39,913][123091] Updated weights for policy 0, policy_version 854471 (0.0010) [2023-12-26 06:24:40,200][123090] Updated weights for policy 1, policy_version 848393 (0.0009) [2023-12-26 06:24:40,259][123090] Updated weights for policy 1, policy_version 848403 (0.0006) [2023-12-26 06:24:40,317][123090] Updated weights for policy 1, policy_version 848413 (0.0008) [2023-12-26 06:24:40,784][123091] Updated weights for policy 0, policy_version 854481 (0.0010) [2023-12-26 06:24:40,836][123091] Updated weights for policy 0, policy_version 854491 (0.0009) [2023-12-26 06:24:40,892][123091] Updated weights for policy 0, policy_version 854501 (0.0010) [2023-12-26 06:24:40,944][123091] Updated weights for policy 0, policy_version 854511 (0.0009) [2023-12-26 06:24:41,123][123090] Updated weights for policy 1, policy_version 848423 (0.0008) [2023-12-26 06:24:41,189][123090] Updated weights for policy 1, policy_version 848433 (0.0007) [2023-12-26 06:24:41,264][123090] Updated weights for policy 1, policy_version 848443 (0.0006) [2023-12-26 06:24:41,891][123091] Updated weights for policy 0, policy_version 854521 (0.0009) [2023-12-26 06:24:41,954][123091] Updated weights for policy 0, policy_version 854531 (0.0010) [2023-12-26 06:24:42,010][123090] Updated weights for policy 1, policy_version 848453 (0.0010) [2023-12-26 06:24:42,015][123091] Updated weights for policy 0, policy_version 854541 (0.0008) [2023-12-26 06:24:42,072][123090] Updated weights for policy 1, policy_version 848463 (0.0009) [2023-12-26 06:24:42,130][123090] Updated weights for policy 1, policy_version 848473 (0.0009) [2023-12-26 06:24:42,805][123091] Updated weights for policy 0, policy_version 854551 (0.0009) [2023-12-26 06:24:42,857][123091] Updated weights for policy 0, policy_version 854561 (0.0009) [2023-12-26 06:24:42,920][123091] Updated weights for policy 0, policy_version 854571 (0.0009) [2023-12-26 06:24:42,992][123090] Updated weights for policy 1, policy_version 848483 (0.0009) [2023-12-26 06:24:43,059][123090] Updated weights for policy 1, policy_version 848493 (0.0009) [2023-12-26 06:24:43,116][123090] Updated weights for policy 1, policy_version 848503 (0.0009) [2023-12-26 06:24:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17855.8). Total num frames: 435994624. Throughput: 0: 8914.4, 1: 8855.2. Samples: 435993636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:43,785][121949] Avg episode reward: [(0, '6124.493'), (1, '5748.828')] [2023-12-26 06:24:43,800][123091] Updated weights for policy 0, policy_version 854581 (0.0010) [2023-12-26 06:24:43,864][123091] Updated weights for policy 0, policy_version 854591 (0.0009) [2023-12-26 06:24:43,920][123091] Updated weights for policy 0, policy_version 854601 (0.0009) [2023-12-26 06:24:43,963][123090] Updated weights for policy 1, policy_version 848513 (0.0010) [2023-12-26 06:24:44,024][123090] Updated weights for policy 1, policy_version 848523 (0.0008) [2023-12-26 06:24:44,080][123090] Updated weights for policy 1, policy_version 848533 (0.0009) [2023-12-26 06:24:44,147][123090] Updated weights for policy 1, policy_version 848543 (0.0009) [2023-12-26 06:24:44,661][123091] Updated weights for policy 0, policy_version 854611 (0.0007) [2023-12-26 06:24:44,732][123091] Updated weights for policy 0, policy_version 854621 (0.0006) [2023-12-26 06:24:44,806][123091] Updated weights for policy 0, policy_version 854631 (0.0010) [2023-12-26 06:24:45,015][123090] Updated weights for policy 1, policy_version 848553 (0.0010) [2023-12-26 06:24:45,076][123090] Updated weights for policy 1, policy_version 848563 (0.0010) [2023-12-26 06:24:45,144][123090] Updated weights for policy 1, policy_version 848573 (0.0009) [2023-12-26 06:24:45,561][123091] Updated weights for policy 0, policy_version 854641 (0.0009) [2023-12-26 06:24:45,623][123091] Updated weights for policy 0, policy_version 854651 (0.0005) [2023-12-26 06:24:45,685][123091] Updated weights for policy 0, policy_version 854661 (0.0006) [2023-12-26 06:24:45,752][123091] Updated weights for policy 0, policy_version 854671 (0.0008) [2023-12-26 06:24:46,037][123090] Updated weights for policy 1, policy_version 848583 (0.0010) [2023-12-26 06:24:46,096][123090] Updated weights for policy 1, policy_version 848593 (0.0009) [2023-12-26 06:24:46,167][123090] Updated weights for policy 1, policy_version 848603 (0.0005) [2023-12-26 06:24:46,408][123091] Updated weights for policy 0, policy_version 854681 (0.0006) [2023-12-26 06:24:46,489][123091] Updated weights for policy 0, policy_version 854692 (0.0010) [2023-12-26 06:24:46,545][123091] Updated weights for policy 0, policy_version 854702 (0.0011) [2023-12-26 06:24:46,815][123090] Updated weights for policy 1, policy_version 848613 (0.0006) [2023-12-26 06:24:46,883][123090] Updated weights for policy 1, policy_version 848623 (0.0005) [2023-12-26 06:24:46,952][123090] Updated weights for policy 1, policy_version 848633 (0.0008) [2023-12-26 06:24:47,313][123091] Updated weights for policy 0, policy_version 854712 (0.0011) [2023-12-26 06:24:47,364][123091] Updated weights for policy 0, policy_version 854722 (0.0011) [2023-12-26 06:24:47,411][123091] Updated weights for policy 0, policy_version 854732 (0.0010) [2023-12-26 06:24:47,571][123090] Updated weights for policy 1, policy_version 848643 (0.0006) [2023-12-26 06:24:47,623][123090] Updated weights for policy 1, policy_version 848653 (0.0005) [2023-12-26 06:24:47,673][123090] Updated weights for policy 1, policy_version 848663 (0.0005) [2023-12-26 06:24:48,122][123091] Updated weights for policy 0, policy_version 854742 (0.0007) [2023-12-26 06:24:48,167][123091] Updated weights for policy 0, policy_version 854752 (0.0005) [2023-12-26 06:24:48,222][123091] Updated weights for policy 0, policy_version 854762 (0.0005) [2023-12-26 06:24:48,516][123090] Updated weights for policy 1, policy_version 848673 (0.0008) [2023-12-26 06:24:48,571][123090] Updated weights for policy 1, policy_version 848683 (0.0009) [2023-12-26 06:24:48,632][123090] Updated weights for policy 1, policy_version 848693 (0.0009) [2023-12-26 06:24:48,686][123090] Updated weights for policy 1, policy_version 848703 (0.0008) [2023-12-26 06:24:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 436092928. Throughput: 0: 9022.4, 1: 8888.2. Samples: 436102784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:48,785][121949] Avg episode reward: [(0, '6013.587'), (1, '5843.719')] [2023-12-26 06:24:48,976][123091] Updated weights for policy 0, policy_version 854772 (0.0007) [2023-12-26 06:24:49,043][123091] Updated weights for policy 0, policy_version 854782 (0.0011) [2023-12-26 06:24:49,109][123091] Updated weights for policy 0, policy_version 854792 (0.0010) [2023-12-26 06:24:49,411][123090] Updated weights for policy 1, policy_version 848713 (0.0008) [2023-12-26 06:24:49,490][123090] Updated weights for policy 1, policy_version 848723 (0.0007) [2023-12-26 06:24:49,558][123090] Updated weights for policy 1, policy_version 848733 (0.0009) [2023-12-26 06:24:49,892][123091] Updated weights for policy 0, policy_version 854802 (0.0010) [2023-12-26 06:24:49,967][123091] Updated weights for policy 0, policy_version 854812 (0.0009) [2023-12-26 06:24:50,027][123091] Updated weights for policy 0, policy_version 854822 (0.0009) [2023-12-26 06:24:50,078][123091] Updated weights for policy 0, policy_version 854832 (0.0010) [2023-12-26 06:24:50,377][123090] Updated weights for policy 1, policy_version 848743 (0.0010) [2023-12-26 06:24:50,441][123090] Updated weights for policy 1, policy_version 848753 (0.0009) [2023-12-26 06:24:50,503][123090] Updated weights for policy 1, policy_version 848763 (0.0009) [2023-12-26 06:24:50,923][123091] Updated weights for policy 0, policy_version 854842 (0.0010) [2023-12-26 06:24:50,983][123091] Updated weights for policy 0, policy_version 854852 (0.0010) [2023-12-26 06:24:51,057][123091] Updated weights for policy 0, policy_version 854862 (0.0010) [2023-12-26 06:24:51,403][123090] Updated weights for policy 1, policy_version 848773 (0.0009) [2023-12-26 06:24:51,475][123090] Updated weights for policy 1, policy_version 848783 (0.0008) [2023-12-26 06:24:51,542][123090] Updated weights for policy 1, policy_version 848793 (0.0008) [2023-12-26 06:24:51,906][123091] Updated weights for policy 0, policy_version 854872 (0.0010) [2023-12-26 06:24:51,968][123091] Updated weights for policy 0, policy_version 854882 (0.0010) [2023-12-26 06:24:52,019][123091] Updated weights for policy 0, policy_version 854892 (0.0008) [2023-12-26 06:24:52,384][123090] Updated weights for policy 1, policy_version 848803 (0.0008) [2023-12-26 06:24:52,435][123090] Updated weights for policy 1, policy_version 848813 (0.0009) [2023-12-26 06:24:52,483][123090] Updated weights for policy 1, policy_version 848823 (0.0009) [2023-12-26 06:24:52,799][123091] Updated weights for policy 0, policy_version 854902 (0.0006) [2023-12-26 06:24:52,867][123091] Updated weights for policy 0, policy_version 854912 (0.0006) [2023-12-26 06:24:52,939][123091] Updated weights for policy 0, policy_version 854922 (0.0005) [2023-12-26 06:24:53,440][123090] Updated weights for policy 1, policy_version 848833 (0.0009) [2023-12-26 06:24:53,498][123090] Updated weights for policy 1, policy_version 848843 (0.0009) [2023-12-26 06:24:53,534][123091] Updated weights for policy 0, policy_version 854932 (0.0006) [2023-12-26 06:24:53,560][123090] Updated weights for policy 1, policy_version 848853 (0.0009) [2023-12-26 06:24:53,594][123091] Updated weights for policy 0, policy_version 854942 (0.0006) [2023-12-26 06:24:53,622][123090] Updated weights for policy 1, policy_version 848863 (0.0009) [2023-12-26 06:24:53,656][123091] Updated weights for policy 0, policy_version 854952 (0.0007) [2023-12-26 06:24:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 436183040. Throughput: 0: 8996.3, 1: 8887.0. Samples: 436154076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:53,785][121949] Avg episode reward: [(0, '5873.246'), (1, '5740.303')] [2023-12-26 06:24:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000854960_218873856.pth... [2023-12-26 06:24:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000848864_217309184.pth... [2023-12-26 06:24:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000853904_218603520.pth [2023-12-26 06:24:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000847808_217038848.pth [2023-12-26 06:24:54,318][123091] Updated weights for policy 0, policy_version 854962 (0.0006) [2023-12-26 06:24:54,373][123091] Updated weights for policy 0, policy_version 854972 (0.0010) [2023-12-26 06:24:54,428][123091] Updated weights for policy 0, policy_version 854982 (0.0010) [2023-12-26 06:24:54,484][123091] Updated weights for policy 0, policy_version 854992 (0.0011) [2023-12-26 06:24:54,491][123090] Updated weights for policy 1, policy_version 848873 (0.0007) [2023-12-26 06:24:54,552][123090] Updated weights for policy 1, policy_version 848883 (0.0010) [2023-12-26 06:24:54,607][123090] Updated weights for policy 1, policy_version 848893 (0.0009) [2023-12-26 06:24:55,183][123091] Updated weights for policy 0, policy_version 855002 (0.0005) [2023-12-26 06:24:55,245][123091] Updated weights for policy 0, policy_version 855012 (0.0005) [2023-12-26 06:24:55,306][123091] Updated weights for policy 0, policy_version 855022 (0.0005) [2023-12-26 06:24:55,533][123090] Updated weights for policy 1, policy_version 848903 (0.0009) [2023-12-26 06:24:55,591][123090] Updated weights for policy 1, policy_version 848913 (0.0009) [2023-12-26 06:24:55,656][123090] Updated weights for policy 1, policy_version 848923 (0.0008) [2023-12-26 06:24:56,039][123091] Updated weights for policy 0, policy_version 855032 (0.0008) [2023-12-26 06:24:56,093][123091] Updated weights for policy 0, policy_version 855042 (0.0010) [2023-12-26 06:24:56,144][123091] Updated weights for policy 0, policy_version 855052 (0.0010) [2023-12-26 06:24:56,489][123090] Updated weights for policy 1, policy_version 848933 (0.0010) [2023-12-26 06:24:56,562][123090] Updated weights for policy 1, policy_version 848943 (0.0010) [2023-12-26 06:24:56,632][123090] Updated weights for policy 1, policy_version 848953 (0.0009) [2023-12-26 06:24:56,972][123091] Updated weights for policy 0, policy_version 855063 (0.0010) [2023-12-26 06:24:57,028][123091] Updated weights for policy 0, policy_version 855073 (0.0008) [2023-12-26 06:24:57,097][123091] Updated weights for policy 0, policy_version 855083 (0.0010) [2023-12-26 06:24:57,482][123090] Updated weights for policy 1, policy_version 848963 (0.0010) [2023-12-26 06:24:57,533][123090] Updated weights for policy 1, policy_version 848973 (0.0008) [2023-12-26 06:24:57,591][123090] Updated weights for policy 1, policy_version 848983 (0.0010) [2023-12-26 06:24:57,944][123091] Updated weights for policy 0, policy_version 855093 (0.0009) [2023-12-26 06:24:57,998][123091] Updated weights for policy 0, policy_version 855103 (0.0010) [2023-12-26 06:24:58,064][123091] Updated weights for policy 0, policy_version 855113 (0.0009) [2023-12-26 06:24:58,475][123090] Updated weights for policy 1, policy_version 848993 (0.0010) [2023-12-26 06:24:58,544][123090] Updated weights for policy 1, policy_version 849003 (0.0011) [2023-12-26 06:24:58,608][123090] Updated weights for policy 1, policy_version 849013 (0.0011) [2023-12-26 06:24:58,683][123090] Updated weights for policy 1, policy_version 849023 (0.0010) [2023-12-26 06:24:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17886.2, 300 sec: 17855.8). Total num frames: 436264960. Throughput: 0: 9089.3, 1: 8766.2. Samples: 436259172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:24:58,785][121949] Avg episode reward: [(0, '5784.824'), (1, '5568.089')] [2023-12-26 06:24:58,900][123091] Updated weights for policy 0, policy_version 855123 (0.0010) [2023-12-26 06:24:58,968][123091] Updated weights for policy 0, policy_version 855133 (0.0008) [2023-12-26 06:24:59,040][123091] Updated weights for policy 0, policy_version 855143 (0.0008) [2023-12-26 06:24:59,477][123090] Updated weights for policy 1, policy_version 849033 (0.0006) [2023-12-26 06:24:59,543][123090] Updated weights for policy 1, policy_version 849043 (0.0005) [2023-12-26 06:24:59,615][123090] Updated weights for policy 1, policy_version 849053 (0.0005) [2023-12-26 06:24:59,850][123091] Updated weights for policy 0, policy_version 855153 (0.0008) [2023-12-26 06:24:59,919][123091] Updated weights for policy 0, policy_version 855163 (0.0011) [2023-12-26 06:24:59,983][123091] Updated weights for policy 0, policy_version 855173 (0.0006) [2023-12-26 06:25:00,046][123091] Updated weights for policy 0, policy_version 855183 (0.0008) [2023-12-26 06:25:00,307][123090] Updated weights for policy 1, policy_version 849063 (0.0009) [2023-12-26 06:25:00,363][123090] Updated weights for policy 1, policy_version 849073 (0.0010) [2023-12-26 06:25:00,410][123090] Updated weights for policy 1, policy_version 849083 (0.0008) [2023-12-26 06:25:00,834][123091] Updated weights for policy 0, policy_version 855193 (0.0008) [2023-12-26 06:25:00,902][123091] Updated weights for policy 0, policy_version 855203 (0.0009) [2023-12-26 06:25:00,954][123091] Updated weights for policy 0, policy_version 855213 (0.0005) [2023-12-26 06:25:01,281][123090] Updated weights for policy 1, policy_version 849093 (0.0009) [2023-12-26 06:25:01,343][123090] Updated weights for policy 1, policy_version 849103 (0.0008) [2023-12-26 06:25:01,412][123090] Updated weights for policy 1, policy_version 849113 (0.0009) [2023-12-26 06:25:01,784][123091] Updated weights for policy 0, policy_version 855223 (0.0008) [2023-12-26 06:25:01,842][123091] Updated weights for policy 0, policy_version 855233 (0.0010) [2023-12-26 06:25:01,898][123091] Updated weights for policy 0, policy_version 855243 (0.0009) [2023-12-26 06:25:02,144][123090] Updated weights for policy 1, policy_version 849123 (0.0009) [2023-12-26 06:25:02,205][123090] Updated weights for policy 1, policy_version 849133 (0.0010) [2023-12-26 06:25:02,267][123090] Updated weights for policy 1, policy_version 849143 (0.0008) [2023-12-26 06:25:02,809][123091] Updated weights for policy 0, policy_version 855254 (0.0010) [2023-12-26 06:25:02,874][123091] Updated weights for policy 0, policy_version 855264 (0.0010) [2023-12-26 06:25:02,940][123091] Updated weights for policy 0, policy_version 855274 (0.0010) [2023-12-26 06:25:03,025][123090] Updated weights for policy 1, policy_version 849153 (0.0009) [2023-12-26 06:25:03,096][123090] Updated weights for policy 1, policy_version 849163 (0.0008) [2023-12-26 06:25:03,163][123090] Updated weights for policy 1, policy_version 849173 (0.0009) [2023-12-26 06:25:03,237][123090] Updated weights for policy 1, policy_version 849183 (0.0008) [2023-12-26 06:25:03,727][123091] Updated weights for policy 0, policy_version 855284 (0.0008) [2023-12-26 06:25:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 436346880. Throughput: 0: 8904.9, 1: 8776.2. Samples: 436363292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:25:03,784][121949] Avg episode reward: [(0, '6075.946'), (1, '5655.369')] [2023-12-26 06:25:03,788][123091] Updated weights for policy 0, policy_version 855294 (0.0009) [2023-12-26 06:25:03,851][123091] Updated weights for policy 0, policy_version 855304 (0.0007) [2023-12-26 06:25:04,002][123090] Updated weights for policy 1, policy_version 849193 (0.0011) [2023-12-26 06:25:04,072][123090] Updated weights for policy 1, policy_version 849203 (0.0008) [2023-12-26 06:25:04,141][123090] Updated weights for policy 1, policy_version 849213 (0.0006) [2023-12-26 06:25:04,624][123091] Updated weights for policy 0, policy_version 855314 (0.0009) [2023-12-26 06:25:04,681][123091] Updated weights for policy 0, policy_version 855324 (0.0009) [2023-12-26 06:25:04,741][123091] Updated weights for policy 0, policy_version 855334 (0.0009) [2023-12-26 06:25:04,800][123091] Updated weights for policy 0, policy_version 855344 (0.0009) [2023-12-26 06:25:04,829][123090] Updated weights for policy 1, policy_version 849223 (0.0006) [2023-12-26 06:25:04,887][123090] Updated weights for policy 1, policy_version 849233 (0.0005) [2023-12-26 06:25:04,943][123090] Updated weights for policy 1, policy_version 849243 (0.0006) [2023-12-26 06:25:05,562][123091] Updated weights for policy 0, policy_version 855354 (0.0008) [2023-12-26 06:25:05,609][123091] Updated weights for policy 0, policy_version 855364 (0.0010) [2023-12-26 06:25:05,666][123091] Updated weights for policy 0, policy_version 855374 (0.0010) [2023-12-26 06:25:05,722][123090] Updated weights for policy 1, policy_version 849253 (0.0008) [2023-12-26 06:25:05,774][123090] Updated weights for policy 1, policy_version 849263 (0.0008) [2023-12-26 06:25:05,831][123090] Updated weights for policy 1, policy_version 849273 (0.0009) [2023-12-26 06:25:06,485][123091] Updated weights for policy 0, policy_version 855384 (0.0009) [2023-12-26 06:25:06,544][123091] Updated weights for policy 0, policy_version 855394 (0.0011) [2023-12-26 06:25:06,547][123090] Updated weights for policy 1, policy_version 849283 (0.0008) [2023-12-26 06:25:06,603][123090] Updated weights for policy 1, policy_version 849293 (0.0009) [2023-12-26 06:25:06,609][123091] Updated weights for policy 0, policy_version 855404 (0.0011) [2023-12-26 06:25:06,656][123090] Updated weights for policy 1, policy_version 849303 (0.0007) [2023-12-26 06:25:07,447][123091] Updated weights for policy 0, policy_version 855414 (0.0011) [2023-12-26 06:25:07,467][123090] Updated weights for policy 1, policy_version 849313 (0.0009) [2023-12-26 06:25:07,502][123091] Updated weights for policy 0, policy_version 855424 (0.0010) [2023-12-26 06:25:07,517][123090] Updated weights for policy 1, policy_version 849323 (0.0006) [2023-12-26 06:25:07,563][123091] Updated weights for policy 0, policy_version 855434 (0.0006) [2023-12-26 06:25:07,570][123090] Updated weights for policy 1, policy_version 849333 (0.0005) [2023-12-26 06:25:07,626][123090] Updated weights for policy 1, policy_version 849343 (0.0005) [2023-12-26 06:25:08,258][123091] Updated weights for policy 0, policy_version 855444 (0.0005) [2023-12-26 06:25:08,274][123090] Updated weights for policy 1, policy_version 849353 (0.0005) [2023-12-26 06:25:08,313][123091] Updated weights for policy 0, policy_version 855454 (0.0006) [2023-12-26 06:25:08,332][123090] Updated weights for policy 1, policy_version 849363 (0.0006) [2023-12-26 06:25:08,375][123091] Updated weights for policy 0, policy_version 855464 (0.0008) [2023-12-26 06:25:08,404][123090] Updated weights for policy 1, policy_version 849373 (0.0010) [2023-12-26 06:25:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 436445184. Throughput: 0: 8919.1, 1: 8832.5. Samples: 436418092. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:08,785][121949] Avg episode reward: [(0, '6101.763'), (1, '5853.975')] [2023-12-26 06:25:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000849376_217440256.pth... [2023-12-26 06:25:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000855472_219004928.pth... [2023-12-26 06:25:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000848352_217178112.pth [2023-12-26 06:25:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000854448_218742784.pth [2023-12-26 06:25:08,990][123091] Updated weights for policy 0, policy_version 855474 (0.0006) [2023-12-26 06:25:09,043][123091] Updated weights for policy 0, policy_version 855484 (0.0010) [2023-12-26 06:25:09,098][123091] Updated weights for policy 0, policy_version 855496 (0.0010) [2023-12-26 06:25:09,164][123090] Updated weights for policy 1, policy_version 849383 (0.0007) [2023-12-26 06:25:09,219][123090] Updated weights for policy 1, policy_version 849393 (0.0005) [2023-12-26 06:25:09,281][123090] Updated weights for policy 1, policy_version 849403 (0.0010) [2023-12-26 06:25:10,029][123091] Updated weights for policy 0, policy_version 855507 (0.0010) [2023-12-26 06:25:10,084][123091] Updated weights for policy 0, policy_version 855517 (0.0009) [2023-12-26 06:25:10,132][123090] Updated weights for policy 1, policy_version 849413 (0.0009) [2023-12-26 06:25:10,140][123091] Updated weights for policy 0, policy_version 855527 (0.0009) [2023-12-26 06:25:10,197][123090] Updated weights for policy 1, policy_version 849423 (0.0010) [2023-12-26 06:25:10,264][123090] Updated weights for policy 1, policy_version 849433 (0.0009) [2023-12-26 06:25:10,992][123091] Updated weights for policy 0, policy_version 855537 (0.0010) [2023-12-26 06:25:11,061][123090] Updated weights for policy 1, policy_version 849443 (0.0009) [2023-12-26 06:25:11,070][123091] Updated weights for policy 0, policy_version 855547 (0.0009) [2023-12-26 06:25:11,125][123090] Updated weights for policy 1, policy_version 849453 (0.0008) [2023-12-26 06:25:11,151][123091] Updated weights for policy 0, policy_version 855557 (0.0009) [2023-12-26 06:25:11,190][123090] Updated weights for policy 1, policy_version 849463 (0.0007) [2023-12-26 06:25:11,220][123091] Updated weights for policy 0, policy_version 855567 (0.0007) [2023-12-26 06:25:12,024][123091] Updated weights for policy 0, policy_version 855577 (0.0009) [2023-12-26 06:25:12,086][123091] Updated weights for policy 0, policy_version 855587 (0.0010) [2023-12-26 06:25:12,098][123090] Updated weights for policy 1, policy_version 849473 (0.0009) [2023-12-26 06:25:12,149][123091] Updated weights for policy 0, policy_version 855597 (0.0008) [2023-12-26 06:25:12,159][123090] Updated weights for policy 1, policy_version 849483 (0.0009) [2023-12-26 06:25:12,226][123090] Updated weights for policy 1, policy_version 849493 (0.0009) [2023-12-26 06:25:12,298][123090] Updated weights for policy 1, policy_version 849503 (0.0010) [2023-12-26 06:25:12,985][123091] Updated weights for policy 0, policy_version 855607 (0.0009) [2023-12-26 06:25:13,048][123091] Updated weights for policy 0, policy_version 855617 (0.0009) [2023-12-26 06:25:13,049][123090] Updated weights for policy 1, policy_version 849513 (0.0008) [2023-12-26 06:25:13,104][123091] Updated weights for policy 0, policy_version 855627 (0.0006) [2023-12-26 06:25:13,111][123090] Updated weights for policy 1, policy_version 849523 (0.0010) [2023-12-26 06:25:13,178][123090] Updated weights for policy 1, policy_version 849533 (0.0008) [2023-12-26 06:25:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 436527104. Throughput: 0: 8927.2, 1: 8808.1. Samples: 436523432. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:13,784][121949] Avg episode reward: [(0, '6198.966'), (1, '5874.715')] [2023-12-26 06:25:13,960][123091] Updated weights for policy 0, policy_version 855637 (0.0010) [2023-12-26 06:25:13,962][123090] Updated weights for policy 1, policy_version 849543 (0.0007) [2023-12-26 06:25:14,023][123091] Updated weights for policy 0, policy_version 855647 (0.0011) [2023-12-26 06:25:14,033][123090] Updated weights for policy 1, policy_version 849553 (0.0008) [2023-12-26 06:25:14,087][123091] Updated weights for policy 0, policy_version 855657 (0.0011) [2023-12-26 06:25:14,098][123090] Updated weights for policy 1, policy_version 849563 (0.0006) [2023-12-26 06:25:14,908][123091] Updated weights for policy 0, policy_version 855667 (0.0011) [2023-12-26 06:25:14,936][123090] Updated weights for policy 1, policy_version 849573 (0.0010) [2023-12-26 06:25:14,972][123091] Updated weights for policy 0, policy_version 855677 (0.0011) [2023-12-26 06:25:14,996][123090] Updated weights for policy 1, policy_version 849583 (0.0006) [2023-12-26 06:25:15,028][123091] Updated weights for policy 0, policy_version 855687 (0.0011) [2023-12-26 06:25:15,065][123090] Updated weights for policy 1, policy_version 849593 (0.0006) [2023-12-26 06:25:15,863][123091] Updated weights for policy 0, policy_version 855697 (0.0011) [2023-12-26 06:25:15,904][123090] Updated weights for policy 1, policy_version 849603 (0.0008) [2023-12-26 06:25:15,918][123091] Updated weights for policy 0, policy_version 855707 (0.0010) [2023-12-26 06:25:15,960][123090] Updated weights for policy 1, policy_version 849613 (0.0009) [2023-12-26 06:25:15,973][123091] Updated weights for policy 0, policy_version 855717 (0.0010) [2023-12-26 06:25:16,015][123090] Updated weights for policy 1, policy_version 849623 (0.0006) [2023-12-26 06:25:16,025][123091] Updated weights for policy 0, policy_version 855727 (0.0010) [2023-12-26 06:25:16,847][123091] Updated weights for policy 0, policy_version 855737 (0.0007) [2023-12-26 06:25:16,859][123090] Updated weights for policy 1, policy_version 849633 (0.0008) [2023-12-26 06:25:16,908][123091] Updated weights for policy 0, policy_version 855747 (0.0006) [2023-12-26 06:25:16,921][123090] Updated weights for policy 1, policy_version 849643 (0.0007) [2023-12-26 06:25:16,978][123090] Updated weights for policy 1, policy_version 849653 (0.0009) [2023-12-26 06:25:16,979][123091] Updated weights for policy 0, policy_version 855757 (0.0005) [2023-12-26 06:25:17,035][123090] Updated weights for policy 1, policy_version 849663 (0.0010) [2023-12-26 06:25:17,661][123091] Updated weights for policy 0, policy_version 855767 (0.0009) [2023-12-26 06:25:17,726][123091] Updated weights for policy 0, policy_version 855777 (0.0010) [2023-12-26 06:25:17,793][123091] Updated weights for policy 0, policy_version 855787 (0.0010) [2023-12-26 06:25:17,903][123090] Updated weights for policy 1, policy_version 849674 (0.0010) [2023-12-26 06:25:17,970][123090] Updated weights for policy 1, policy_version 849685 (0.0010) [2023-12-26 06:25:18,026][123090] Updated weights for policy 1, policy_version 849695 (0.0009) [2023-12-26 06:25:18,630][123091] Updated weights for policy 0, policy_version 855797 (0.0009) [2023-12-26 06:25:18,692][123091] Updated weights for policy 0, policy_version 855807 (0.0008) [2023-12-26 06:25:18,767][123091] Updated weights for policy 0, policy_version 855817 (0.0008) [2023-12-26 06:25:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 436609024. Throughput: 0: 8871.0, 1: 8704.5. Samples: 436627044. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:18,785][121949] Avg episode reward: [(0, '6295.886'), (1, '5800.042')] [2023-12-26 06:25:18,852][123090] Updated weights for policy 1, policy_version 849705 (0.0006) [2023-12-26 06:25:18,915][123090] Updated weights for policy 1, policy_version 849715 (0.0008) [2023-12-26 06:25:18,978][123090] Updated weights for policy 1, policy_version 849725 (0.0010) [2023-12-26 06:25:19,570][123091] Updated weights for policy 0, policy_version 855827 (0.0009) [2023-12-26 06:25:19,640][123091] Updated weights for policy 0, policy_version 855837 (0.0009) [2023-12-26 06:25:19,700][123091] Updated weights for policy 0, policy_version 855847 (0.0011) [2023-12-26 06:25:19,733][123090] Updated weights for policy 1, policy_version 849735 (0.0009) [2023-12-26 06:25:19,793][123090] Updated weights for policy 1, policy_version 849745 (0.0008) [2023-12-26 06:25:19,868][123090] Updated weights for policy 1, policy_version 849755 (0.0009) [2023-12-26 06:25:20,603][123091] Updated weights for policy 0, policy_version 855857 (0.0010) [2023-12-26 06:25:20,617][123090] Updated weights for policy 1, policy_version 849765 (0.0009) [2023-12-26 06:25:20,670][123091] Updated weights for policy 0, policy_version 855867 (0.0010) [2023-12-26 06:25:20,683][123090] Updated weights for policy 1, policy_version 849775 (0.0011) [2023-12-26 06:25:20,735][123091] Updated weights for policy 0, policy_version 855877 (0.0011) [2023-12-26 06:25:20,749][123090] Updated weights for policy 1, policy_version 849785 (0.0011) [2023-12-26 06:25:20,801][123091] Updated weights for policy 0, policy_version 855887 (0.0008) [2023-12-26 06:25:21,532][123090] Updated weights for policy 1, policy_version 849795 (0.0009) [2023-12-26 06:25:21,598][123090] Updated weights for policy 1, policy_version 849805 (0.0006) [2023-12-26 06:25:21,601][123091] Updated weights for policy 0, policy_version 855897 (0.0007) [2023-12-26 06:25:21,667][123090] Updated weights for policy 1, policy_version 849815 (0.0007) [2023-12-26 06:25:21,674][123091] Updated weights for policy 0, policy_version 855907 (0.0010) [2023-12-26 06:25:21,740][123091] Updated weights for policy 0, policy_version 855917 (0.0009) [2023-12-26 06:25:22,419][123090] Updated weights for policy 1, policy_version 849825 (0.0007) [2023-12-26 06:25:22,491][123090] Updated weights for policy 1, policy_version 849835 (0.0011) [2023-12-26 06:25:22,556][123090] Updated weights for policy 1, policy_version 849845 (0.0011) [2023-12-26 06:25:22,569][123091] Updated weights for policy 0, policy_version 855927 (0.0010) [2023-12-26 06:25:22,621][123090] Updated weights for policy 1, policy_version 849855 (0.0011) [2023-12-26 06:25:22,634][123091] Updated weights for policy 0, policy_version 855937 (0.0011) [2023-12-26 06:25:22,691][123091] Updated weights for policy 0, policy_version 855947 (0.0011) [2023-12-26 06:25:23,440][123090] Updated weights for policy 1, policy_version 849865 (0.0011) [2023-12-26 06:25:23,460][123091] Updated weights for policy 0, policy_version 855957 (0.0008) [2023-12-26 06:25:23,496][123090] Updated weights for policy 1, policy_version 849875 (0.0010) [2023-12-26 06:25:23,512][123091] Updated weights for policy 0, policy_version 855967 (0.0007) [2023-12-26 06:25:23,559][123090] Updated weights for policy 1, policy_version 849885 (0.0010) [2023-12-26 06:25:23,566][123091] Updated weights for policy 0, policy_version 855977 (0.0009) [2023-12-26 06:25:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 436707328. Throughput: 0: 8799.9, 1: 8708.6. Samples: 436679608. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:23,785][121949] Avg episode reward: [(0, '6247.029'), (1, '5851.080')] [2023-12-26 06:25:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000855984_219136000.pth... [2023-12-26 06:25:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000849888_217571328.pth... [2023-12-26 06:25:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000854960_218873856.pth [2023-12-26 06:25:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000848864_217309184.pth [2023-12-26 06:25:24,360][123091] Updated weights for policy 0, policy_version 855987 (0.0009) [2023-12-26 06:25:24,382][123090] Updated weights for policy 1, policy_version 849895 (0.0010) [2023-12-26 06:25:24,420][123091] Updated weights for policy 0, policy_version 855997 (0.0006) [2023-12-26 06:25:24,438][123090] Updated weights for policy 1, policy_version 849905 (0.0010) [2023-12-26 06:25:24,481][123091] Updated weights for policy 0, policy_version 856007 (0.0007) [2023-12-26 06:25:24,496][123090] Updated weights for policy 1, policy_version 849915 (0.0010) [2023-12-26 06:25:25,199][123091] Updated weights for policy 0, policy_version 856017 (0.0006) [2023-12-26 06:25:25,221][123090] Updated weights for policy 1, policy_version 849925 (0.0006) [2023-12-26 06:25:25,261][123091] Updated weights for policy 0, policy_version 856027 (0.0005) [2023-12-26 06:25:25,280][123090] Updated weights for policy 1, policy_version 849935 (0.0005) [2023-12-26 06:25:25,309][123091] Updated weights for policy 0, policy_version 856037 (0.0007) [2023-12-26 06:25:25,343][123090] Updated weights for policy 1, policy_version 849945 (0.0005) [2023-12-26 06:25:25,356][123091] Updated weights for policy 0, policy_version 856047 (0.0007) [2023-12-26 06:25:25,986][123090] Updated weights for policy 1, policy_version 849955 (0.0005) [2023-12-26 06:25:26,018][123091] Updated weights for policy 0, policy_version 856057 (0.0007) [2023-12-26 06:25:26,045][123090] Updated weights for policy 1, policy_version 849965 (0.0005) [2023-12-26 06:25:26,072][123091] Updated weights for policy 0, policy_version 856067 (0.0006) [2023-12-26 06:25:26,097][123090] Updated weights for policy 1, policy_version 849975 (0.0005) [2023-12-26 06:25:26,126][123091] Updated weights for policy 0, policy_version 856077 (0.0010) [2023-12-26 06:25:26,770][123090] Updated weights for policy 1, policy_version 849985 (0.0008) [2023-12-26 06:25:26,827][123090] Updated weights for policy 1, policy_version 849995 (0.0006) [2023-12-26 06:25:26,875][123091] Updated weights for policy 0, policy_version 856087 (0.0010) [2023-12-26 06:25:26,876][123090] Updated weights for policy 1, policy_version 850005 (0.0007) [2023-12-26 06:25:26,926][123090] Updated weights for policy 1, policy_version 850015 (0.0007) [2023-12-26 06:25:26,939][123091] Updated weights for policy 0, policy_version 856097 (0.0010) [2023-12-26 06:25:27,006][123091] Updated weights for policy 0, policy_version 856107 (0.0010) [2023-12-26 06:25:27,700][123090] Updated weights for policy 1, policy_version 850025 (0.0007) [2023-12-26 06:25:27,772][123090] Updated weights for policy 1, policy_version 850035 (0.0009) [2023-12-26 06:25:27,796][123091] Updated weights for policy 0, policy_version 856117 (0.0011) [2023-12-26 06:25:27,837][123090] Updated weights for policy 1, policy_version 850045 (0.0008) [2023-12-26 06:25:27,861][123091] Updated weights for policy 0, policy_version 856127 (0.0011) [2023-12-26 06:25:27,929][123091] Updated weights for policy 0, policy_version 856137 (0.0011) [2023-12-26 06:25:28,611][123090] Updated weights for policy 1, policy_version 850055 (0.0006) [2023-12-26 06:25:28,665][123091] Updated weights for policy 0, policy_version 856147 (0.0008) [2023-12-26 06:25:28,666][123090] Updated weights for policy 1, policy_version 850065 (0.0005) [2023-12-26 06:25:28,719][123091] Updated weights for policy 0, policy_version 856157 (0.0006) [2023-12-26 06:25:28,735][123090] Updated weights for policy 1, policy_version 850075 (0.0010) [2023-12-26 06:25:28,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 436797440. Throughput: 0: 8926.0, 1: 8800.2. Samples: 436791316. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:28,785][121949] Avg episode reward: [(0, '6238.366'), (1, '5896.794')] [2023-12-26 06:25:28,789][123091] Updated weights for policy 0, policy_version 856167 (0.0005) [2023-12-26 06:25:29,515][123091] Updated weights for policy 0, policy_version 856177 (0.0006) [2023-12-26 06:25:29,521][123090] Updated weights for policy 1, policy_version 850085 (0.0007) [2023-12-26 06:25:29,589][123091] Updated weights for policy 0, policy_version 856187 (0.0006) [2023-12-26 06:25:29,593][123090] Updated weights for policy 1, policy_version 850095 (0.0006) [2023-12-26 06:25:29,665][123091] Updated weights for policy 0, policy_version 856197 (0.0006) [2023-12-26 06:25:29,667][123090] Updated weights for policy 1, policy_version 850105 (0.0006) [2023-12-26 06:25:29,731][123091] Updated weights for policy 0, policy_version 856207 (0.0009) [2023-12-26 06:25:30,359][123090] Updated weights for policy 1, policy_version 850115 (0.0006) [2023-12-26 06:25:30,429][123090] Updated weights for policy 1, policy_version 850125 (0.0009) [2023-12-26 06:25:30,474][123091] Updated weights for policy 0, policy_version 856217 (0.0006) [2023-12-26 06:25:30,494][123090] Updated weights for policy 1, policy_version 850135 (0.0009) [2023-12-26 06:25:30,526][123091] Updated weights for policy 0, policy_version 856227 (0.0007) [2023-12-26 06:25:30,584][123091] Updated weights for policy 0, policy_version 856237 (0.0006) [2023-12-26 06:25:31,289][123091] Updated weights for policy 0, policy_version 856247 (0.0006) [2023-12-26 06:25:31,356][123091] Updated weights for policy 0, policy_version 856257 (0.0006) [2023-12-26 06:25:31,358][123090] Updated weights for policy 1, policy_version 850145 (0.0008) [2023-12-26 06:25:31,422][123091] Updated weights for policy 0, policy_version 856267 (0.0009) [2023-12-26 06:25:31,424][123090] Updated weights for policy 1, policy_version 850155 (0.0008) [2023-12-26 06:25:31,480][123090] Updated weights for policy 1, policy_version 850165 (0.0010) [2023-12-26 06:25:31,533][123090] Updated weights for policy 1, policy_version 850175 (0.0008) [2023-12-26 06:25:32,207][123091] Updated weights for policy 0, policy_version 856277 (0.0008) [2023-12-26 06:25:32,271][123091] Updated weights for policy 0, policy_version 856287 (0.0009) [2023-12-26 06:25:32,338][123091] Updated weights for policy 0, policy_version 856297 (0.0009) [2023-12-26 06:25:32,381][123090] Updated weights for policy 1, policy_version 850185 (0.0007) [2023-12-26 06:25:32,437][123090] Updated weights for policy 1, policy_version 850195 (0.0005) [2023-12-26 06:25:32,497][123090] Updated weights for policy 1, policy_version 850205 (0.0006) [2023-12-26 06:25:33,148][123091] Updated weights for policy 0, policy_version 856307 (0.0007) [2023-12-26 06:25:33,198][123091] Updated weights for policy 0, policy_version 856317 (0.0006) [2023-12-26 06:25:33,241][123091] Updated weights for policy 0, policy_version 856327 (0.0006) [2023-12-26 06:25:33,256][123090] Updated weights for policy 1, policy_version 850215 (0.0008) [2023-12-26 06:25:33,323][123090] Updated weights for policy 1, policy_version 850225 (0.0009) [2023-12-26 06:25:33,388][123090] Updated weights for policy 1, policy_version 850235 (0.0009) [2023-12-26 06:25:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 436887552. Throughput: 0: 8915.5, 1: 8804.3. Samples: 436900172. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:33,784][121949] Avg episode reward: [(0, '6131.882'), (1, '5740.303')] [2023-12-26 06:25:33,918][123091] Updated weights for policy 0, policy_version 856337 (0.0007) [2023-12-26 06:25:33,968][123091] Updated weights for policy 0, policy_version 856347 (0.0005) [2023-12-26 06:25:34,020][123091] Updated weights for policy 0, policy_version 856357 (0.0005) [2023-12-26 06:25:34,071][123091] Updated weights for policy 0, policy_version 856367 (0.0005) [2023-12-26 06:25:34,301][123090] Updated weights for policy 1, policy_version 850245 (0.0009) [2023-12-26 06:25:34,370][123090] Updated weights for policy 1, policy_version 850255 (0.0010) [2023-12-26 06:25:34,427][123090] Updated weights for policy 1, policy_version 850265 (0.0010) [2023-12-26 06:25:34,745][123091] Updated weights for policy 0, policy_version 856377 (0.0005) [2023-12-26 06:25:34,797][123091] Updated weights for policy 0, policy_version 856387 (0.0005) [2023-12-26 06:25:34,849][123091] Updated weights for policy 0, policy_version 856397 (0.0005) [2023-12-26 06:25:35,335][123090] Updated weights for policy 1, policy_version 850275 (0.0010) [2023-12-26 06:25:35,388][123090] Updated weights for policy 1, policy_version 850285 (0.0009) [2023-12-26 06:25:35,445][123090] Updated weights for policy 1, policy_version 850296 (0.0009) [2023-12-26 06:25:35,546][123091] Updated weights for policy 0, policy_version 856407 (0.0010) [2023-12-26 06:25:35,615][123091] Updated weights for policy 0, policy_version 856417 (0.0010) [2023-12-26 06:25:35,669][123091] Updated weights for policy 0, policy_version 856427 (0.0010) [2023-12-26 06:25:36,362][123090] Updated weights for policy 1, policy_version 850306 (0.0009) [2023-12-26 06:25:36,386][123091] Updated weights for policy 0, policy_version 856437 (0.0007) [2023-12-26 06:25:36,433][123090] Updated weights for policy 1, policy_version 850316 (0.0007) [2023-12-26 06:25:36,457][123091] Updated weights for policy 0, policy_version 856447 (0.0007) [2023-12-26 06:25:36,499][123090] Updated weights for policy 1, policy_version 850326 (0.0008) [2023-12-26 06:25:36,514][123091] Updated weights for policy 0, policy_version 856457 (0.0010) [2023-12-26 06:25:36,566][123090] Updated weights for policy 1, policy_version 850336 (0.0008) [2023-12-26 06:25:37,319][123091] Updated weights for policy 0, policy_version 856467 (0.0012) [2023-12-26 06:25:37,373][123090] Updated weights for policy 1, policy_version 850346 (0.0007) [2023-12-26 06:25:37,374][123091] Updated weights for policy 0, policy_version 856477 (0.0011) [2023-12-26 06:25:37,422][123091] Updated weights for policy 0, policy_version 856487 (0.0010) [2023-12-26 06:25:37,429][123090] Updated weights for policy 1, policy_version 850356 (0.0005) [2023-12-26 06:25:37,480][123090] Updated weights for policy 1, policy_version 850366 (0.0006) [2023-12-26 06:25:38,263][123090] Updated weights for policy 1, policy_version 850376 (0.0010) [2023-12-26 06:25:38,272][123091] Updated weights for policy 0, policy_version 856497 (0.0010) [2023-12-26 06:25:38,324][123090] Updated weights for policy 1, policy_version 850386 (0.0007) [2023-12-26 06:25:38,326][123091] Updated weights for policy 0, policy_version 856507 (0.0008) [2023-12-26 06:25:38,392][123091] Updated weights for policy 0, policy_version 856517 (0.0009) [2023-12-26 06:25:38,395][123090] Updated weights for policy 1, policy_version 850396 (0.0009) [2023-12-26 06:25:38,453][123091] Updated weights for policy 0, policy_version 856527 (0.0010) [2023-12-26 06:25:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 436977664. Throughput: 0: 9007.5, 1: 8763.0. Samples: 436953748. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:38,785][121949] Avg episode reward: [(0, '6086.663'), (1, '5704.324')] [2023-12-26 06:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000856528_219275264.pth... [2023-12-26 06:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000850400_217702400.pth... [2023-12-26 06:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000855472_219004928.pth [2023-12-26 06:25:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000849376_217440256.pth [2023-12-26 06:25:39,216][123090] Updated weights for policy 1, policy_version 850406 (0.0008) [2023-12-26 06:25:39,278][123090] Updated weights for policy 1, policy_version 850416 (0.0006) [2023-12-26 06:25:39,320][123091] Updated weights for policy 0, policy_version 856537 (0.0009) [2023-12-26 06:25:39,346][123090] Updated weights for policy 1, policy_version 850426 (0.0006) [2023-12-26 06:25:39,392][123091] Updated weights for policy 0, policy_version 856547 (0.0008) [2023-12-26 06:25:39,478][123091] Updated weights for policy 0, policy_version 856557 (0.0010) [2023-12-26 06:25:40,088][123090] Updated weights for policy 1, policy_version 850436 (0.0008) [2023-12-26 06:25:40,165][123090] Updated weights for policy 1, policy_version 850446 (0.0009) [2023-12-26 06:25:40,235][123090] Updated weights for policy 1, policy_version 850456 (0.0009) [2023-12-26 06:25:40,300][123091] Updated weights for policy 0, policy_version 856567 (0.0007) [2023-12-26 06:25:40,364][123091] Updated weights for policy 0, policy_version 856577 (0.0010) [2023-12-26 06:25:40,426][123091] Updated weights for policy 0, policy_version 856587 (0.0009) [2023-12-26 06:25:41,023][123090] Updated weights for policy 1, policy_version 850466 (0.0010) [2023-12-26 06:25:41,093][123090] Updated weights for policy 1, policy_version 850476 (0.0009) [2023-12-26 06:25:41,155][123090] Updated weights for policy 1, policy_version 850486 (0.0009) [2023-12-26 06:25:41,224][123090] Updated weights for policy 1, policy_version 850496 (0.0009) [2023-12-26 06:25:41,293][123091] Updated weights for policy 0, policy_version 856597 (0.0010) [2023-12-26 06:25:41,363][123091] Updated weights for policy 0, policy_version 856607 (0.0010) [2023-12-26 06:25:41,434][123091] Updated weights for policy 0, policy_version 856617 (0.0009) [2023-12-26 06:25:42,079][123090] Updated weights for policy 1, policy_version 850506 (0.0010) [2023-12-26 06:25:42,152][123090] Updated weights for policy 1, policy_version 850516 (0.0009) [2023-12-26 06:25:42,217][123090] Updated weights for policy 1, policy_version 850526 (0.0006) [2023-12-26 06:25:42,246][123091] Updated weights for policy 0, policy_version 856627 (0.0010) [2023-12-26 06:25:42,312][123091] Updated weights for policy 0, policy_version 856637 (0.0009) [2023-12-26 06:25:42,388][123091] Updated weights for policy 0, policy_version 856647 (0.0010) [2023-12-26 06:25:42,895][123090] Updated weights for policy 1, policy_version 850536 (0.0009) [2023-12-26 06:25:42,956][123090] Updated weights for policy 1, policy_version 850546 (0.0009) [2023-12-26 06:25:43,015][123090] Updated weights for policy 1, policy_version 850556 (0.0009) [2023-12-26 06:25:43,245][123091] Updated weights for policy 0, policy_version 856657 (0.0009) [2023-12-26 06:25:43,306][123091] Updated weights for policy 0, policy_version 856667 (0.0010) [2023-12-26 06:25:43,370][123091] Updated weights for policy 0, policy_version 856677 (0.0009) [2023-12-26 06:25:43,421][123091] Updated weights for policy 0, policy_version 856687 (0.0009) [2023-12-26 06:25:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 437059584. Throughput: 0: 8853.3, 1: 8848.3. Samples: 437055740. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:43,784][121949] Avg episode reward: [(0, '6007.827'), (1, '5613.949')] [2023-12-26 06:25:43,804][123090] Updated weights for policy 1, policy_version 850566 (0.0007) [2023-12-26 06:25:43,867][123090] Updated weights for policy 1, policy_version 850576 (0.0005) [2023-12-26 06:25:43,937][123090] Updated weights for policy 1, policy_version 850586 (0.0008) [2023-12-26 06:25:44,315][123091] Updated weights for policy 0, policy_version 856697 (0.0008) [2023-12-26 06:25:44,374][123091] Updated weights for policy 0, policy_version 856707 (0.0010) [2023-12-26 06:25:44,436][123091] Updated weights for policy 0, policy_version 856717 (0.0009) [2023-12-26 06:25:44,683][123090] Updated weights for policy 1, policy_version 850596 (0.0009) [2023-12-26 06:25:44,747][123090] Updated weights for policy 1, policy_version 850606 (0.0009) [2023-12-26 06:25:44,823][123090] Updated weights for policy 1, policy_version 850616 (0.0006) [2023-12-26 06:25:45,372][123091] Updated weights for policy 0, policy_version 856727 (0.0010) [2023-12-26 06:25:45,436][123091] Updated weights for policy 0, policy_version 856737 (0.0009) [2023-12-26 06:25:45,488][123091] Updated weights for policy 0, policy_version 856747 (0.0011) [2023-12-26 06:25:45,569][123090] Updated weights for policy 1, policy_version 850626 (0.0006) [2023-12-26 06:25:45,629][123090] Updated weights for policy 1, policy_version 850636 (0.0005) [2023-12-26 06:25:45,693][123090] Updated weights for policy 1, policy_version 850646 (0.0005) [2023-12-26 06:25:45,743][123090] Updated weights for policy 1, policy_version 850656 (0.0005) [2023-12-26 06:25:46,217][123091] Updated weights for policy 0, policy_version 856757 (0.0008) [2023-12-26 06:25:46,267][123091] Updated weights for policy 0, policy_version 856767 (0.0007) [2023-12-26 06:25:46,325][123090] Updated weights for policy 1, policy_version 850666 (0.0009) [2023-12-26 06:25:46,325][123091] Updated weights for policy 0, policy_version 856777 (0.0005) [2023-12-26 06:25:46,393][123090] Updated weights for policy 1, policy_version 850676 (0.0008) [2023-12-26 06:25:46,440][123090] Updated weights for policy 1, policy_version 850686 (0.0005) [2023-12-26 06:25:47,026][123091] Updated weights for policy 0, policy_version 856787 (0.0008) [2023-12-26 06:25:47,081][123090] Updated weights for policy 1, policy_version 850696 (0.0005) [2023-12-26 06:25:47,089][123091] Updated weights for policy 0, policy_version 856797 (0.0006) [2023-12-26 06:25:47,140][123090] Updated weights for policy 1, policy_version 850706 (0.0005) [2023-12-26 06:25:47,149][123091] Updated weights for policy 0, policy_version 856807 (0.0006) [2023-12-26 06:25:47,198][123090] Updated weights for policy 1, policy_version 850716 (0.0005) [2023-12-26 06:25:47,839][123091] Updated weights for policy 0, policy_version 856817 (0.0006) [2023-12-26 06:25:47,911][123091] Updated weights for policy 0, policy_version 856827 (0.0011) [2023-12-26 06:25:47,981][123091] Updated weights for policy 0, policy_version 856837 (0.0011) [2023-12-26 06:25:48,003][123090] Updated weights for policy 1, policy_version 850726 (0.0010) [2023-12-26 06:25:48,045][123091] Updated weights for policy 0, policy_version 856847 (0.0011) [2023-12-26 06:25:48,066][123090] Updated weights for policy 1, policy_version 850736 (0.0011) [2023-12-26 06:25:48,129][123090] Updated weights for policy 1, policy_version 850746 (0.0010) [2023-12-26 06:25:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 437149696. Throughput: 0: 8906.0, 1: 8916.9. Samples: 437165324. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:48,785][121949] Avg episode reward: [(0, '6001.896'), (1, '5715.794')] [2023-12-26 06:25:48,877][123091] Updated weights for policy 0, policy_version 856857 (0.0011) [2023-12-26 06:25:48,929][123091] Updated weights for policy 0, policy_version 856867 (0.0011) [2023-12-26 06:25:48,950][123090] Updated weights for policy 1, policy_version 850756 (0.0011) [2023-12-26 06:25:48,992][123091] Updated weights for policy 0, policy_version 856877 (0.0011) [2023-12-26 06:25:49,010][123090] Updated weights for policy 1, policy_version 850766 (0.0010) [2023-12-26 06:25:49,070][123090] Updated weights for policy 1, policy_version 850776 (0.0009) [2023-12-26 06:25:49,788][123091] Updated weights for policy 0, policy_version 856887 (0.0010) [2023-12-26 06:25:49,861][123091] Updated weights for policy 0, policy_version 856897 (0.0009) [2023-12-26 06:25:49,886][123090] Updated weights for policy 1, policy_version 850786 (0.0009) [2023-12-26 06:25:49,925][123091] Updated weights for policy 0, policy_version 856907 (0.0007) [2023-12-26 06:25:49,950][123090] Updated weights for policy 1, policy_version 850796 (0.0011) [2023-12-26 06:25:50,006][123090] Updated weights for policy 1, policy_version 850806 (0.0010) [2023-12-26 06:25:50,067][123090] Updated weights for policy 1, policy_version 850816 (0.0011) [2023-12-26 06:25:50,699][123091] Updated weights for policy 0, policy_version 856917 (0.0010) [2023-12-26 06:25:50,768][123091] Updated weights for policy 0, policy_version 856927 (0.0011) [2023-12-26 06:25:50,832][123091] Updated weights for policy 0, policy_version 856937 (0.0011) [2023-12-26 06:25:50,880][123090] Updated weights for policy 1, policy_version 850826 (0.0009) [2023-12-26 06:25:50,948][123090] Updated weights for policy 1, policy_version 850836 (0.0008) [2023-12-26 06:25:51,017][123090] Updated weights for policy 1, policy_version 850846 (0.0006) [2023-12-26 06:25:51,637][123091] Updated weights for policy 0, policy_version 856947 (0.0009) [2023-12-26 06:25:51,700][123091] Updated weights for policy 0, policy_version 856957 (0.0011) [2023-12-26 06:25:51,766][123091] Updated weights for policy 0, policy_version 856967 (0.0011) [2023-12-26 06:25:51,808][123090] Updated weights for policy 1, policy_version 850856 (0.0008) [2023-12-26 06:25:51,870][123090] Updated weights for policy 1, policy_version 850866 (0.0008) [2023-12-26 06:25:51,929][123090] Updated weights for policy 1, policy_version 850876 (0.0008) [2023-12-26 06:25:52,552][123091] Updated weights for policy 0, policy_version 856977 (0.0010) [2023-12-26 06:25:52,602][123091] Updated weights for policy 0, policy_version 856987 (0.0005) [2023-12-26 06:25:52,661][123091] Updated weights for policy 0, policy_version 856997 (0.0005) [2023-12-26 06:25:52,731][123091] Updated weights for policy 0, policy_version 857007 (0.0006) [2023-12-26 06:25:52,774][123090] Updated weights for policy 1, policy_version 850886 (0.0009) [2023-12-26 06:25:52,846][123090] Updated weights for policy 1, policy_version 850896 (0.0009) [2023-12-26 06:25:52,917][123090] Updated weights for policy 1, policy_version 850906 (0.0009) [2023-12-26 06:25:53,425][123091] Updated weights for policy 0, policy_version 857017 (0.0009) [2023-12-26 06:25:53,476][123091] Updated weights for policy 0, policy_version 857027 (0.0009) [2023-12-26 06:25:53,526][123091] Updated weights for policy 0, policy_version 857037 (0.0009) [2023-12-26 06:25:53,563][123090] Updated weights for policy 1, policy_version 850916 (0.0007) [2023-12-26 06:25:53,618][123090] Updated weights for policy 1, policy_version 850926 (0.0007) [2023-12-26 06:25:53,667][123090] Updated weights for policy 1, policy_version 850937 (0.0009) [2023-12-26 06:25:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 437248000. Throughput: 0: 8892.9, 1: 8867.7. Samples: 437217320. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:53,785][121949] Avg episode reward: [(0, '6124.998'), (1, '5848.881')] [2023-12-26 06:25:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000857040_219406336.pth... [2023-12-26 06:25:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000850944_217841664.pth... [2023-12-26 06:25:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000855984_219136000.pth [2023-12-26 06:25:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000849888_217571328.pth [2023-12-26 06:25:54,413][123091] Updated weights for policy 0, policy_version 857047 (0.0010) [2023-12-26 06:25:54,466][123090] Updated weights for policy 1, policy_version 850947 (0.0009) [2023-12-26 06:25:54,478][123091] Updated weights for policy 0, policy_version 857057 (0.0008) [2023-12-26 06:25:54,526][123090] Updated weights for policy 1, policy_version 850957 (0.0008) [2023-12-26 06:25:54,546][123091] Updated weights for policy 0, policy_version 857067 (0.0009) [2023-12-26 06:25:54,587][123090] Updated weights for policy 1, policy_version 850967 (0.0007) [2023-12-26 06:25:55,220][123091] Updated weights for policy 0, policy_version 857077 (0.0008) [2023-12-26 06:25:55,282][123091] Updated weights for policy 0, policy_version 857087 (0.0005) [2023-12-26 06:25:55,339][123091] Updated weights for policy 0, policy_version 857097 (0.0006) [2023-12-26 06:25:55,442][123090] Updated weights for policy 1, policy_version 850977 (0.0008) [2023-12-26 06:25:55,507][123090] Updated weights for policy 1, policy_version 850987 (0.0010) [2023-12-26 06:25:55,570][123090] Updated weights for policy 1, policy_version 850997 (0.0009) [2023-12-26 06:25:55,632][123090] Updated weights for policy 1, policy_version 851007 (0.0009) [2023-12-26 06:25:55,960][123091] Updated weights for policy 0, policy_version 857107 (0.0007) [2023-12-26 06:25:56,009][123091] Updated weights for policy 0, policy_version 857117 (0.0009) [2023-12-26 06:25:56,060][123091] Updated weights for policy 0, policy_version 857127 (0.0009) [2023-12-26 06:25:56,461][123090] Updated weights for policy 1, policy_version 851017 (0.0010) [2023-12-26 06:25:56,512][123090] Updated weights for policy 1, policy_version 851027 (0.0010) [2023-12-26 06:25:56,560][123090] Updated weights for policy 1, policy_version 851037 (0.0007) [2023-12-26 06:25:56,830][123091] Updated weights for policy 0, policy_version 857137 (0.0009) [2023-12-26 06:25:56,881][123091] Updated weights for policy 0, policy_version 857147 (0.0005) [2023-12-26 06:25:56,929][123091] Updated weights for policy 0, policy_version 857157 (0.0005) [2023-12-26 06:25:56,980][123091] Updated weights for policy 0, policy_version 857167 (0.0005) [2023-12-26 06:25:57,267][123090] Updated weights for policy 1, policy_version 851047 (0.0006) [2023-12-26 06:25:57,331][123090] Updated weights for policy 1, policy_version 851057 (0.0006) [2023-12-26 06:25:57,398][123090] Updated weights for policy 1, policy_version 851067 (0.0005) [2023-12-26 06:25:57,822][123091] Updated weights for policy 0, policy_version 857177 (0.0009) [2023-12-26 06:25:57,879][123091] Updated weights for policy 0, policy_version 857188 (0.0010) [2023-12-26 06:25:57,933][123091] Updated weights for policy 0, policy_version 857200 (0.0011) [2023-12-26 06:25:58,056][123090] Updated weights for policy 1, policy_version 851077 (0.0007) [2023-12-26 06:25:58,118][123090] Updated weights for policy 1, policy_version 851087 (0.0009) [2023-12-26 06:25:58,186][123090] Updated weights for policy 1, policy_version 851097 (0.0009) [2023-12-26 06:25:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 437329920. Throughput: 0: 8947.3, 1: 8900.8. Samples: 437326600. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:25:58,785][121949] Avg episode reward: [(0, '6190.576'), (1, '5711.195')] [2023-12-26 06:25:58,944][123091] Updated weights for policy 0, policy_version 857210 (0.0008) [2023-12-26 06:25:59,015][123091] Updated weights for policy 0, policy_version 857220 (0.0009) [2023-12-26 06:25:59,088][123091] Updated weights for policy 0, policy_version 857230 (0.0011) [2023-12-26 06:25:59,115][123090] Updated weights for policy 1, policy_version 851107 (0.0008) [2023-12-26 06:25:59,188][123090] Updated weights for policy 1, policy_version 851117 (0.0008) [2023-12-26 06:25:59,261][123090] Updated weights for policy 1, policy_version 851127 (0.0008) [2023-12-26 06:25:59,989][123091] Updated weights for policy 0, policy_version 857240 (0.0010) [2023-12-26 06:26:00,055][123091] Updated weights for policy 0, policy_version 857250 (0.0009) [2023-12-26 06:26:00,113][123090] Updated weights for policy 1, policy_version 851137 (0.0008) [2023-12-26 06:26:00,118][123091] Updated weights for policy 0, policy_version 857260 (0.0010) [2023-12-26 06:26:00,172][123090] Updated weights for policy 1, policy_version 851147 (0.0008) [2023-12-26 06:26:00,232][123090] Updated weights for policy 1, policy_version 851157 (0.0009) [2023-12-26 06:26:00,293][123090] Updated weights for policy 1, policy_version 851167 (0.0010) [2023-12-26 06:26:00,963][123091] Updated weights for policy 0, policy_version 857270 (0.0006) [2023-12-26 06:26:01,034][123091] Updated weights for policy 0, policy_version 857280 (0.0007) [2023-12-26 06:26:01,045][123090] Updated weights for policy 1, policy_version 851177 (0.0007) [2023-12-26 06:26:01,103][123091] Updated weights for policy 0, policy_version 857290 (0.0008) [2023-12-26 06:26:01,113][123090] Updated weights for policy 1, policy_version 851187 (0.0008) [2023-12-26 06:26:01,182][123090] Updated weights for policy 1, policy_version 851197 (0.0009) [2023-12-26 06:26:01,802][123091] Updated weights for policy 0, policy_version 857300 (0.0008) [2023-12-26 06:26:01,856][123091] Updated weights for policy 0, policy_version 857310 (0.0009) [2023-12-26 06:26:01,905][123091] Updated weights for policy 0, policy_version 857320 (0.0009) [2023-12-26 06:26:01,972][123090] Updated weights for policy 1, policy_version 851207 (0.0009) [2023-12-26 06:26:02,029][123090] Updated weights for policy 1, policy_version 851217 (0.0008) [2023-12-26 06:26:02,097][123090] Updated weights for policy 1, policy_version 851227 (0.0009) [2023-12-26 06:26:02,750][123091] Updated weights for policy 0, policy_version 857330 (0.0009) [2023-12-26 06:26:02,816][123091] Updated weights for policy 0, policy_version 857340 (0.0009) [2023-12-26 06:26:02,878][123091] Updated weights for policy 0, policy_version 857350 (0.0009) [2023-12-26 06:26:02,938][123090] Updated weights for policy 1, policy_version 851237 (0.0008) [2023-12-26 06:26:02,943][123091] Updated weights for policy 0, policy_version 857360 (0.0009) [2023-12-26 06:26:03,009][123090] Updated weights for policy 1, policy_version 851247 (0.0006) [2023-12-26 06:26:03,062][123090] Updated weights for policy 1, policy_version 851257 (0.0005) [2023-12-26 06:26:03,645][123091] Updated weights for policy 0, policy_version 857370 (0.0005) [2023-12-26 06:26:03,694][123091] Updated weights for policy 0, policy_version 857380 (0.0009) [2023-12-26 06:26:03,738][123091] Updated weights for policy 0, policy_version 857390 (0.0010) [2023-12-26 06:26:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 437420032. Throughput: 0: 8928.4, 1: 8911.8. Samples: 437429848. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:03,785][121949] Avg episode reward: [(0, '6336.239'), (1, '5387.820')] [2023-12-26 06:26:03,850][123090] Updated weights for policy 1, policy_version 851267 (0.0006) [2023-12-26 06:26:03,915][123090] Updated weights for policy 1, policy_version 851277 (0.0009) [2023-12-26 06:26:03,983][123090] Updated weights for policy 1, policy_version 851287 (0.0008) [2023-12-26 06:26:04,491][123091] Updated weights for policy 0, policy_version 857400 (0.0007) [2023-12-26 06:26:04,541][123091] Updated weights for policy 0, policy_version 857410 (0.0006) [2023-12-26 06:26:04,594][123091] Updated weights for policy 0, policy_version 857420 (0.0005) [2023-12-26 06:26:04,848][123090] Updated weights for policy 1, policy_version 851297 (0.0007) [2023-12-26 06:26:04,907][123090] Updated weights for policy 1, policy_version 851307 (0.0006) [2023-12-26 06:26:04,983][123090] Updated weights for policy 1, policy_version 851317 (0.0010) [2023-12-26 06:26:05,050][123090] Updated weights for policy 1, policy_version 851327 (0.0009) [2023-12-26 06:26:05,314][123091] Updated weights for policy 0, policy_version 857430 (0.0008) [2023-12-26 06:26:05,372][123091] Updated weights for policy 0, policy_version 857440 (0.0009) [2023-12-26 06:26:05,430][123091] Updated weights for policy 0, policy_version 857450 (0.0010) [2023-12-26 06:26:05,849][123090] Updated weights for policy 1, policy_version 851337 (0.0006) [2023-12-26 06:26:05,907][123090] Updated weights for policy 1, policy_version 851347 (0.0005) [2023-12-26 06:26:05,966][123090] Updated weights for policy 1, policy_version 851357 (0.0005) [2023-12-26 06:26:06,126][123091] Updated weights for policy 0, policy_version 857460 (0.0007) [2023-12-26 06:26:06,191][123091] Updated weights for policy 0, policy_version 857470 (0.0007) [2023-12-26 06:26:06,262][123091] Updated weights for policy 0, policy_version 857480 (0.0005) [2023-12-26 06:26:06,731][123090] Updated weights for policy 1, policy_version 851367 (0.0008) [2023-12-26 06:26:06,781][123090] Updated weights for policy 1, policy_version 851377 (0.0008) [2023-12-26 06:26:06,843][123090] Updated weights for policy 1, policy_version 851387 (0.0009) [2023-12-26 06:26:07,043][123091] Updated weights for policy 0, policy_version 857490 (0.0008) [2023-12-26 06:26:07,098][123091] Updated weights for policy 0, policy_version 857500 (0.0011) [2023-12-26 06:26:07,154][123091] Updated weights for policy 0, policy_version 857510 (0.0010) [2023-12-26 06:26:07,213][123091] Updated weights for policy 0, policy_version 857520 (0.0010) [2023-12-26 06:26:07,718][123090] Updated weights for policy 1, policy_version 851397 (0.0009) [2023-12-26 06:26:07,780][123090] Updated weights for policy 1, policy_version 851407 (0.0009) [2023-12-26 06:26:07,840][123090] Updated weights for policy 1, policy_version 851417 (0.0009) [2023-12-26 06:26:08,061][123091] Updated weights for policy 0, policy_version 857530 (0.0010) [2023-12-26 06:26:08,119][123091] Updated weights for policy 0, policy_version 857540 (0.0011) [2023-12-26 06:26:08,166][123091] Updated weights for policy 0, policy_version 857550 (0.0010) [2023-12-26 06:26:08,636][123090] Updated weights for policy 1, policy_version 851427 (0.0008) [2023-12-26 06:26:08,689][123090] Updated weights for policy 1, policy_version 851437 (0.0009) [2023-12-26 06:26:08,743][123090] Updated weights for policy 1, policy_version 851447 (0.0009) [2023-12-26 06:26:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 437501952. Throughput: 0: 9009.6, 1: 8881.2. Samples: 437484692. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:08,784][121949] Avg episode reward: [(0, '6219.567'), (1, '5131.104')] [2023-12-26 06:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000857552_219537408.pth... [2023-12-26 06:26:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000851456_217972736.pth... [2023-12-26 06:26:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000850400_217702400.pth [2023-12-26 06:26:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000856528_219275264.pth [2023-12-26 06:26:08,989][123091] Updated weights for policy 0, policy_version 857560 (0.0006) [2023-12-26 06:26:09,051][123091] Updated weights for policy 0, policy_version 857570 (0.0005) [2023-12-26 06:26:09,107][123091] Updated weights for policy 0, policy_version 857580 (0.0005) [2023-12-26 06:26:09,586][123090] Updated weights for policy 1, policy_version 851457 (0.0008) [2023-12-26 06:26:09,663][123090] Updated weights for policy 1, policy_version 851467 (0.0006) [2023-12-26 06:26:09,720][123090] Updated weights for policy 1, policy_version 851477 (0.0009) [2023-12-26 06:26:09,789][123090] Updated weights for policy 1, policy_version 851487 (0.0009) [2023-12-26 06:26:09,846][123091] Updated weights for policy 0, policy_version 857590 (0.0006) [2023-12-26 06:26:09,907][123091] Updated weights for policy 0, policy_version 857600 (0.0006) [2023-12-26 06:26:09,976][123091] Updated weights for policy 0, policy_version 857610 (0.0008) [2023-12-26 06:26:10,605][123090] Updated weights for policy 1, policy_version 851497 (0.0007) [2023-12-26 06:26:10,664][123090] Updated weights for policy 1, policy_version 851507 (0.0005) [2023-12-26 06:26:10,729][123091] Updated weights for policy 0, policy_version 857620 (0.0008) [2023-12-26 06:26:10,734][123090] Updated weights for policy 1, policy_version 851517 (0.0006) [2023-12-26 06:26:10,790][123091] Updated weights for policy 0, policy_version 857630 (0.0006) [2023-12-26 06:26:10,864][123091] Updated weights for policy 0, policy_version 857640 (0.0008) [2023-12-26 06:26:11,531][123090] Updated weights for policy 1, policy_version 851527 (0.0009) [2023-12-26 06:26:11,589][123090] Updated weights for policy 1, policy_version 851537 (0.0008) [2023-12-26 06:26:11,656][123091] Updated weights for policy 0, policy_version 857650 (0.0010) [2023-12-26 06:26:11,658][123090] Updated weights for policy 1, policy_version 851547 (0.0007) [2023-12-26 06:26:11,725][123091] Updated weights for policy 0, policy_version 857660 (0.0009) [2023-12-26 06:26:11,790][123091] Updated weights for policy 0, policy_version 857670 (0.0009) [2023-12-26 06:26:11,845][123091] Updated weights for policy 0, policy_version 857680 (0.0009) [2023-12-26 06:26:12,388][123090] Updated weights for policy 1, policy_version 851557 (0.0007) [2023-12-26 06:26:12,457][123090] Updated weights for policy 1, policy_version 851567 (0.0010) [2023-12-26 06:26:12,520][123090] Updated weights for policy 1, policy_version 851577 (0.0009) [2023-12-26 06:26:12,702][123091] Updated weights for policy 0, policy_version 857690 (0.0010) [2023-12-26 06:26:12,770][123091] Updated weights for policy 0, policy_version 857700 (0.0009) [2023-12-26 06:26:12,822][123091] Updated weights for policy 0, policy_version 857710 (0.0009) [2023-12-26 06:26:13,305][123090] Updated weights for policy 1, policy_version 851587 (0.0010) [2023-12-26 06:26:13,370][123090] Updated weights for policy 1, policy_version 851597 (0.0008) [2023-12-26 06:26:13,441][123090] Updated weights for policy 1, policy_version 851607 (0.0006) [2023-12-26 06:26:13,649][123091] Updated weights for policy 0, policy_version 857720 (0.0009) [2023-12-26 06:26:13,702][123091] Updated weights for policy 0, policy_version 857731 (0.0010) [2023-12-26 06:26:13,754][123091] Updated weights for policy 0, policy_version 857741 (0.0009) [2023-12-26 06:26:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 437600256. Throughput: 0: 8943.6, 1: 8772.4. Samples: 437588532. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:13,784][121949] Avg episode reward: [(0, '6151.853'), (1, '5210.382')] [2023-12-26 06:26:14,201][123090] Updated weights for policy 1, policy_version 851617 (0.0005) [2023-12-26 06:26:14,258][123090] Updated weights for policy 1, policy_version 851627 (0.0008) [2023-12-26 06:26:14,318][123090] Updated weights for policy 1, policy_version 851637 (0.0006) [2023-12-26 06:26:14,380][123090] Updated weights for policy 1, policy_version 851647 (0.0006) [2023-12-26 06:26:14,584][123091] Updated weights for policy 0, policy_version 857751 (0.0007) [2023-12-26 06:26:14,660][123091] Updated weights for policy 0, policy_version 857761 (0.0006) [2023-12-26 06:26:14,735][123091] Updated weights for policy 0, policy_version 857771 (0.0006) [2023-12-26 06:26:15,166][123090] Updated weights for policy 1, policy_version 851657 (0.0005) [2023-12-26 06:26:15,245][123090] Updated weights for policy 1, policy_version 851667 (0.0005) [2023-12-26 06:26:15,311][123090] Updated weights for policy 1, policy_version 851677 (0.0006) [2023-12-26 06:26:15,438][123091] Updated weights for policy 0, policy_version 857781 (0.0008) [2023-12-26 06:26:15,500][123091] Updated weights for policy 0, policy_version 857791 (0.0008) [2023-12-26 06:26:15,566][123091] Updated weights for policy 0, policy_version 857801 (0.0008) [2023-12-26 06:26:16,115][123090] Updated weights for policy 1, policy_version 851687 (0.0010) [2023-12-26 06:26:16,168][123090] Updated weights for policy 1, policy_version 851697 (0.0009) [2023-12-26 06:26:16,222][123090] Updated weights for policy 1, policy_version 851707 (0.0010) [2023-12-26 06:26:16,251][123091] Updated weights for policy 0, policy_version 857811 (0.0007) [2023-12-26 06:26:16,317][123091] Updated weights for policy 0, policy_version 857821 (0.0005) [2023-12-26 06:26:16,384][123091] Updated weights for policy 0, policy_version 857831 (0.0005) [2023-12-26 06:26:17,005][123091] Updated weights for policy 0, policy_version 857841 (0.0006) [2023-12-26 06:26:17,021][123090] Updated weights for policy 1, policy_version 851717 (0.0010) [2023-12-26 06:26:17,058][123091] Updated weights for policy 0, policy_version 857851 (0.0005) [2023-12-26 06:26:17,084][123090] Updated weights for policy 1, policy_version 851727 (0.0010) [2023-12-26 06:26:17,107][123091] Updated weights for policy 0, policy_version 857861 (0.0005) [2023-12-26 06:26:17,139][123090] Updated weights for policy 1, policy_version 851737 (0.0006) [2023-12-26 06:26:17,159][123091] Updated weights for policy 0, policy_version 857871 (0.0006) [2023-12-26 06:26:17,860][123091] Updated weights for policy 0, policy_version 857881 (0.0005) [2023-12-26 06:26:17,867][123090] Updated weights for policy 1, policy_version 851747 (0.0007) [2023-12-26 06:26:17,907][123091] Updated weights for policy 0, policy_version 857891 (0.0005) [2023-12-26 06:26:17,912][123090] Updated weights for policy 1, policy_version 851757 (0.0010) [2023-12-26 06:26:17,961][123091] Updated weights for policy 0, policy_version 857901 (0.0005) [2023-12-26 06:26:17,972][123090] Updated weights for policy 1, policy_version 851767 (0.0010) [2023-12-26 06:26:18,702][123091] Updated weights for policy 0, policy_version 857911 (0.0005) [2023-12-26 06:26:18,720][123090] Updated weights for policy 1, policy_version 851777 (0.0010) [2023-12-26 06:26:18,757][123091] Updated weights for policy 0, policy_version 857921 (0.0011) [2023-12-26 06:26:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 437682176. Throughput: 0: 8969.0, 1: 8819.2. Samples: 437700640. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:18,785][121949] Avg episode reward: [(0, '6030.262'), (1, '5597.947')] [2023-12-26 06:26:18,785][123090] Updated weights for policy 1, policy_version 851787 (0.0006) [2023-12-26 06:26:18,805][123091] Updated weights for policy 0, policy_version 857931 (0.0011) [2023-12-26 06:26:18,852][123090] Updated weights for policy 1, policy_version 851797 (0.0008) [2023-12-26 06:26:18,917][123090] Updated weights for policy 1, policy_version 851807 (0.0008) [2023-12-26 06:26:19,577][123091] Updated weights for policy 0, policy_version 857941 (0.0011) [2023-12-26 06:26:19,646][123091] Updated weights for policy 0, policy_version 857951 (0.0010) [2023-12-26 06:26:19,714][123091] Updated weights for policy 0, policy_version 857961 (0.0010) [2023-12-26 06:26:19,776][123090] Updated weights for policy 1, policy_version 851817 (0.0009) [2023-12-26 06:26:19,842][123090] Updated weights for policy 1, policy_version 851827 (0.0009) [2023-12-26 06:26:19,913][123090] Updated weights for policy 1, policy_version 851837 (0.0009) [2023-12-26 06:26:20,570][123091] Updated weights for policy 0, policy_version 857971 (0.0009) [2023-12-26 06:26:20,635][123091] Updated weights for policy 0, policy_version 857981 (0.0009) [2023-12-26 06:26:20,702][123091] Updated weights for policy 0, policy_version 857991 (0.0009) [2023-12-26 06:26:20,755][123090] Updated weights for policy 1, policy_version 851847 (0.0008) [2023-12-26 06:26:20,816][123090] Updated weights for policy 1, policy_version 851857 (0.0010) [2023-12-26 06:26:20,881][123090] Updated weights for policy 1, policy_version 851867 (0.0010) [2023-12-26 06:26:21,572][123091] Updated weights for policy 0, policy_version 858001 (0.0009) [2023-12-26 06:26:21,645][123091] Updated weights for policy 0, policy_version 858011 (0.0008) [2023-12-26 06:26:21,711][123091] Updated weights for policy 0, policy_version 858021 (0.0006) [2023-12-26 06:26:21,785][123091] Updated weights for policy 0, policy_version 858031 (0.0008) [2023-12-26 06:26:21,840][123090] Updated weights for policy 1, policy_version 851877 (0.0009) [2023-12-26 06:26:21,910][123090] Updated weights for policy 1, policy_version 851887 (0.0008) [2023-12-26 06:26:21,980][123090] Updated weights for policy 1, policy_version 851897 (0.0008) [2023-12-26 06:26:22,616][123091] Updated weights for policy 0, policy_version 858041 (0.0010) [2023-12-26 06:26:22,685][123091] Updated weights for policy 0, policy_version 858051 (0.0010) [2023-12-26 06:26:22,728][123090] Updated weights for policy 1, policy_version 851907 (0.0008) [2023-12-26 06:26:22,752][123091] Updated weights for policy 0, policy_version 858061 (0.0009) [2023-12-26 06:26:22,787][123090] Updated weights for policy 1, policy_version 851917 (0.0009) [2023-12-26 06:26:22,844][123090] Updated weights for policy 1, policy_version 851927 (0.0009) [2023-12-26 06:26:23,559][123090] Updated weights for policy 1, policy_version 851937 (0.0010) [2023-12-26 06:26:23,625][123090] Updated weights for policy 1, policy_version 851947 (0.0006) [2023-12-26 06:26:23,633][123091] Updated weights for policy 0, policy_version 858071 (0.0009) [2023-12-26 06:26:23,691][123090] Updated weights for policy 1, policy_version 851957 (0.0006) [2023-12-26 06:26:23,694][123091] Updated weights for policy 0, policy_version 858081 (0.0010) [2023-12-26 06:26:23,750][123091] Updated weights for policy 0, policy_version 858091 (0.0007) [2023-12-26 06:26:23,757][123090] Updated weights for policy 1, policy_version 851967 (0.0008) [2023-12-26 06:26:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 437780480. Throughput: 0: 8859.6, 1: 8835.4. Samples: 437750020. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:23,785][121949] Avg episode reward: [(0, '6206.858'), (1, '5189.859')] [2023-12-26 06:26:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000858096_219676672.pth... [2023-12-26 06:26:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000851968_218103808.pth... [2023-12-26 06:26:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000850944_217841664.pth [2023-12-26 06:26:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000857040_219406336.pth [2023-12-26 06:26:24,499][123090] Updated weights for policy 1, policy_version 851977 (0.0009) [2023-12-26 06:26:24,556][123090] Updated weights for policy 1, policy_version 851987 (0.0009) [2023-12-26 06:26:24,562][123091] Updated weights for policy 0, policy_version 858101 (0.0010) [2023-12-26 06:26:24,609][123090] Updated weights for policy 1, policy_version 851997 (0.0008) [2023-12-26 06:26:24,616][123091] Updated weights for policy 0, policy_version 858111 (0.0007) [2023-12-26 06:26:24,676][123091] Updated weights for policy 0, policy_version 858121 (0.0009) [2023-12-26 06:26:25,417][123090] Updated weights for policy 1, policy_version 852007 (0.0006) [2023-12-26 06:26:25,482][123090] Updated weights for policy 1, policy_version 852017 (0.0005) [2023-12-26 06:26:25,550][123090] Updated weights for policy 1, policy_version 852027 (0.0005) [2023-12-26 06:26:25,552][123091] Updated weights for policy 0, policy_version 858131 (0.0010) [2023-12-26 06:26:25,601][123091] Updated weights for policy 0, policy_version 858141 (0.0009) [2023-12-26 06:26:25,654][123091] Updated weights for policy 0, policy_version 858152 (0.0010) [2023-12-26 06:26:26,213][123090] Updated weights for policy 1, policy_version 852037 (0.0008) [2023-12-26 06:26:26,266][123090] Updated weights for policy 1, policy_version 852047 (0.0009) [2023-12-26 06:26:26,320][123090] Updated weights for policy 1, policy_version 852057 (0.0010) [2023-12-26 06:26:26,438][123091] Updated weights for policy 0, policy_version 858162 (0.0009) [2023-12-26 06:26:26,493][123091] Updated weights for policy 0, policy_version 858172 (0.0005) [2023-12-26 06:26:26,559][123091] Updated weights for policy 0, policy_version 858182 (0.0010) [2023-12-26 06:26:26,614][123091] Updated weights for policy 0, policy_version 858192 (0.0009) [2023-12-26 06:26:27,210][123090] Updated weights for policy 1, policy_version 852067 (0.0010) [2023-12-26 06:26:27,277][123090] Updated weights for policy 1, policy_version 852077 (0.0007) [2023-12-26 06:26:27,311][123091] Updated weights for policy 0, policy_version 858202 (0.0011) [2023-12-26 06:26:27,333][123090] Updated weights for policy 1, policy_version 852087 (0.0010) [2023-12-26 06:26:27,360][123091] Updated weights for policy 0, policy_version 858212 (0.0006) [2023-12-26 06:26:27,412][123091] Updated weights for policy 0, policy_version 858222 (0.0005) [2023-12-26 06:26:28,103][123090] Updated weights for policy 1, policy_version 852097 (0.0007) [2023-12-26 06:26:28,127][123091] Updated weights for policy 0, policy_version 858232 (0.0009) [2023-12-26 06:26:28,152][123090] Updated weights for policy 1, policy_version 852107 (0.0007) [2023-12-26 06:26:28,188][123091] Updated weights for policy 0, policy_version 858242 (0.0007) [2023-12-26 06:26:28,201][123090] Updated weights for policy 1, policy_version 852117 (0.0009) [2023-12-26 06:26:28,250][123091] Updated weights for policy 0, policy_version 858252 (0.0005) [2023-12-26 06:26:28,265][123090] Updated weights for policy 1, policy_version 852127 (0.0009) [2023-12-26 06:26:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 437862400. Throughput: 0: 8929.7, 1: 8870.5. Samples: 437856748. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:28,784][121949] Avg episode reward: [(0, '6201.920'), (1, '5047.525')] [2023-12-26 06:26:29,044][123090] Updated weights for policy 1, policy_version 852137 (0.0010) [2023-12-26 06:26:29,077][123091] Updated weights for policy 0, policy_version 858262 (0.0008) [2023-12-26 06:26:29,092][123090] Updated weights for policy 1, policy_version 852147 (0.0009) [2023-12-26 06:26:29,125][123091] Updated weights for policy 0, policy_version 858272 (0.0008) [2023-12-26 06:26:29,140][123090] Updated weights for policy 1, policy_version 852157 (0.0007) [2023-12-26 06:26:29,188][123091] Updated weights for policy 0, policy_version 858282 (0.0008) [2023-12-26 06:26:29,977][123091] Updated weights for policy 0, policy_version 858292 (0.0010) [2023-12-26 06:26:30,026][123090] Updated weights for policy 1, policy_version 852167 (0.0007) [2023-12-26 06:26:30,041][123091] Updated weights for policy 0, policy_version 858302 (0.0009) [2023-12-26 06:26:30,096][123090] Updated weights for policy 1, policy_version 852177 (0.0008) [2023-12-26 06:26:30,106][123091] Updated weights for policy 0, policy_version 858312 (0.0007) [2023-12-26 06:26:30,168][123090] Updated weights for policy 1, policy_version 852187 (0.0009) [2023-12-26 06:26:30,748][123091] Updated weights for policy 0, policy_version 858322 (0.0007) [2023-12-26 06:26:30,799][123091] Updated weights for policy 0, policy_version 858332 (0.0009) [2023-12-26 06:26:30,846][123091] Updated weights for policy 0, policy_version 858343 (0.0008) [2023-12-26 06:26:31,036][123090] Updated weights for policy 1, policy_version 852197 (0.0010) [2023-12-26 06:26:31,100][123090] Updated weights for policy 1, policy_version 852207 (0.0009) [2023-12-26 06:26:31,169][123090] Updated weights for policy 1, policy_version 852217 (0.0009) [2023-12-26 06:26:31,651][123091] Updated weights for policy 0, policy_version 858353 (0.0006) [2023-12-26 06:26:31,729][123091] Updated weights for policy 0, policy_version 858363 (0.0009) [2023-12-26 06:26:31,801][123091] Updated weights for policy 0, policy_version 858373 (0.0006) [2023-12-26 06:26:31,874][123091] Updated weights for policy 0, policy_version 858383 (0.0009) [2023-12-26 06:26:32,038][123090] Updated weights for policy 1, policy_version 852227 (0.0010) [2023-12-26 06:26:32,094][123090] Updated weights for policy 1, policy_version 852237 (0.0010) [2023-12-26 06:26:32,162][123090] Updated weights for policy 1, policy_version 852247 (0.0010) [2023-12-26 06:26:32,628][123091] Updated weights for policy 0, policy_version 858393 (0.0006) [2023-12-26 06:26:32,689][123091] Updated weights for policy 0, policy_version 858403 (0.0005) [2023-12-26 06:26:32,753][123091] Updated weights for policy 0, policy_version 858413 (0.0007) [2023-12-26 06:26:33,034][123090] Updated weights for policy 1, policy_version 852257 (0.0010) [2023-12-26 06:26:33,082][123090] Updated weights for policy 1, policy_version 852267 (0.0010) [2023-12-26 06:26:33,129][123090] Updated weights for policy 1, policy_version 852277 (0.0010) [2023-12-26 06:26:33,170][123090] Updated weights for policy 1, policy_version 852287 (0.0009) [2023-12-26 06:26:33,436][123091] Updated weights for policy 0, policy_version 858423 (0.0008) [2023-12-26 06:26:33,483][123091] Updated weights for policy 0, policy_version 858433 (0.0008) [2023-12-26 06:26:33,530][123091] Updated weights for policy 0, policy_version 858443 (0.0008) [2023-12-26 06:26:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 437952512. Throughput: 0: 8979.0, 1: 8751.9. Samples: 437963212. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:33,784][121949] Avg episode reward: [(0, '6179.351'), (1, '5310.831')] [2023-12-26 06:26:33,924][123090] Updated weights for policy 1, policy_version 852297 (0.0005) [2023-12-26 06:26:33,980][123090] Updated weights for policy 1, policy_version 852307 (0.0005) [2023-12-26 06:26:34,030][123090] Updated weights for policy 1, policy_version 852317 (0.0005) [2023-12-26 06:26:34,283][123091] Updated weights for policy 0, policy_version 858453 (0.0007) [2023-12-26 06:26:34,333][123091] Updated weights for policy 0, policy_version 858463 (0.0005) [2023-12-26 06:26:34,390][123091] Updated weights for policy 0, policy_version 858473 (0.0006) [2023-12-26 06:26:34,763][123090] Updated weights for policy 1, policy_version 852327 (0.0009) [2023-12-26 06:26:34,831][123090] Updated weights for policy 1, policy_version 852337 (0.0011) [2023-12-26 06:26:34,894][123090] Updated weights for policy 1, policy_version 852347 (0.0010) [2023-12-26 06:26:35,118][123091] Updated weights for policy 0, policy_version 858483 (0.0009) [2023-12-26 06:26:35,177][123091] Updated weights for policy 0, policy_version 858493 (0.0010) [2023-12-26 06:26:35,235][123091] Updated weights for policy 0, policy_version 858503 (0.0010) [2023-12-26 06:26:35,628][123090] Updated weights for policy 1, policy_version 852357 (0.0009) [2023-12-26 06:26:35,695][123090] Updated weights for policy 1, policy_version 852367 (0.0009) [2023-12-26 06:26:35,762][123090] Updated weights for policy 1, policy_version 852377 (0.0009) [2023-12-26 06:26:36,043][123091] Updated weights for policy 0, policy_version 858513 (0.0010) [2023-12-26 06:26:36,105][123091] Updated weights for policy 0, policy_version 858523 (0.0006) [2023-12-26 06:26:36,173][123091] Updated weights for policy 0, policy_version 858533 (0.0008) [2023-12-26 06:26:36,232][123091] Updated weights for policy 0, policy_version 858543 (0.0007) [2023-12-26 06:26:36,538][123090] Updated weights for policy 1, policy_version 852387 (0.0009) [2023-12-26 06:26:36,605][123090] Updated weights for policy 1, policy_version 852397 (0.0006) [2023-12-26 06:26:36,677][123090] Updated weights for policy 1, policy_version 852407 (0.0009) [2023-12-26 06:26:37,022][123091] Updated weights for policy 0, policy_version 858553 (0.0009) [2023-12-26 06:26:37,083][123091] Updated weights for policy 0, policy_version 858563 (0.0010) [2023-12-26 06:26:37,138][123091] Updated weights for policy 0, policy_version 858573 (0.0009) [2023-12-26 06:26:37,462][123090] Updated weights for policy 1, policy_version 852417 (0.0009) [2023-12-26 06:26:37,521][123090] Updated weights for policy 1, policy_version 852427 (0.0009) [2023-12-26 06:26:37,585][123090] Updated weights for policy 1, policy_version 852437 (0.0009) [2023-12-26 06:26:37,632][123090] Updated weights for policy 1, policy_version 852447 (0.0006) [2023-12-26 06:26:37,986][123091] Updated weights for policy 0, policy_version 858583 (0.0009) [2023-12-26 06:26:38,042][123091] Updated weights for policy 0, policy_version 858593 (0.0010) [2023-12-26 06:26:38,105][123091] Updated weights for policy 0, policy_version 858603 (0.0010) [2023-12-26 06:26:38,408][123090] Updated weights for policy 1, policy_version 852457 (0.0008) [2023-12-26 06:26:38,460][123090] Updated weights for policy 1, policy_version 852467 (0.0008) [2023-12-26 06:26:38,508][123090] Updated weights for policy 1, policy_version 852477 (0.0009) [2023-12-26 06:26:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 438042624. Throughput: 0: 9031.7, 1: 8784.7. Samples: 438019060. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:38,785][121949] Avg episode reward: [(0, '6335.405'), (1, '5431.782')] [2023-12-26 06:26:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000858608_219807744.pth... [2023-12-26 06:26:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000852480_218234880.pth... [2023-12-26 06:26:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000857552_219537408.pth [2023-12-26 06:26:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000851456_217972736.pth [2023-12-26 06:26:39,020][123091] Updated weights for policy 0, policy_version 858613 (0.0009) [2023-12-26 06:26:39,078][123091] Updated weights for policy 0, policy_version 858623 (0.0010) [2023-12-26 06:26:39,135][123091] Updated weights for policy 0, policy_version 858633 (0.0009) [2023-12-26 06:26:39,263][123090] Updated weights for policy 1, policy_version 852487 (0.0010) [2023-12-26 06:26:39,326][123090] Updated weights for policy 1, policy_version 852497 (0.0010) [2023-12-26 06:26:39,393][123090] Updated weights for policy 1, policy_version 852507 (0.0010) [2023-12-26 06:26:39,908][123091] Updated weights for policy 0, policy_version 858643 (0.0009) [2023-12-26 06:26:39,980][123091] Updated weights for policy 0, policy_version 858653 (0.0011) [2023-12-26 06:26:40,056][123091] Updated weights for policy 0, policy_version 858663 (0.0011) [2023-12-26 06:26:40,267][123090] Updated weights for policy 1, policy_version 852517 (0.0010) [2023-12-26 06:26:40,332][123090] Updated weights for policy 1, policy_version 852527 (0.0009) [2023-12-26 06:26:40,398][123090] Updated weights for policy 1, policy_version 852537 (0.0009) [2023-12-26 06:26:40,835][123091] Updated weights for policy 0, policy_version 858673 (0.0010) [2023-12-26 06:26:40,881][123091] Updated weights for policy 0, policy_version 858683 (0.0005) [2023-12-26 06:26:40,937][123091] Updated weights for policy 0, policy_version 858693 (0.0005) [2023-12-26 06:26:40,991][123091] Updated weights for policy 0, policy_version 858703 (0.0005) [2023-12-26 06:26:41,269][123090] Updated weights for policy 1, policy_version 852547 (0.0009) [2023-12-26 06:26:41,344][123090] Updated weights for policy 1, policy_version 852557 (0.0010) [2023-12-26 06:26:41,416][123090] Updated weights for policy 1, policy_version 852567 (0.0010) [2023-12-26 06:26:41,816][123091] Updated weights for policy 0, policy_version 858713 (0.0009) [2023-12-26 06:26:41,878][123091] Updated weights for policy 0, policy_version 858723 (0.0009) [2023-12-26 06:26:41,939][123091] Updated weights for policy 0, policy_version 858733 (0.0009) [2023-12-26 06:26:42,257][123090] Updated weights for policy 1, policy_version 852577 (0.0011) [2023-12-26 06:26:42,321][123090] Updated weights for policy 1, policy_version 852587 (0.0010) [2023-12-26 06:26:42,389][123090] Updated weights for policy 1, policy_version 852597 (0.0009) [2023-12-26 06:26:42,448][123090] Updated weights for policy 1, policy_version 852607 (0.0010) [2023-12-26 06:26:42,857][123091] Updated weights for policy 0, policy_version 858743 (0.0010) [2023-12-26 06:26:42,920][123091] Updated weights for policy 0, policy_version 858753 (0.0010) [2023-12-26 06:26:42,975][123091] Updated weights for policy 0, policy_version 858763 (0.0010) [2023-12-26 06:26:43,313][123090] Updated weights for policy 1, policy_version 852617 (0.0007) [2023-12-26 06:26:43,368][123090] Updated weights for policy 1, policy_version 852627 (0.0005) [2023-12-26 06:26:43,431][123090] Updated weights for policy 1, policy_version 852637 (0.0005) [2023-12-26 06:26:43,775][123091] Updated weights for policy 0, policy_version 858773 (0.0008) [2023-12-26 06:26:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 438124544. Throughput: 0: 8947.0, 1: 8707.0. Samples: 438121028. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:43,784][121949] Avg episode reward: [(0, '6267.784'), (1, '5485.679')] [2023-12-26 06:26:43,843][123091] Updated weights for policy 0, policy_version 858783 (0.0005) [2023-12-26 06:26:43,914][123091] Updated weights for policy 0, policy_version 858793 (0.0005) [2023-12-26 06:26:44,166][123090] Updated weights for policy 1, policy_version 852647 (0.0009) [2023-12-26 06:26:44,232][123090] Updated weights for policy 1, policy_version 852657 (0.0010) [2023-12-26 06:26:44,299][123090] Updated weights for policy 1, policy_version 852667 (0.0010) [2023-12-26 06:26:44,571][123091] Updated weights for policy 0, policy_version 858803 (0.0007) [2023-12-26 06:26:44,628][123091] Updated weights for policy 0, policy_version 858813 (0.0010) [2023-12-26 06:26:44,685][123091] Updated weights for policy 0, policy_version 858823 (0.0010) [2023-12-26 06:26:45,068][123090] Updated weights for policy 1, policy_version 852677 (0.0009) [2023-12-26 06:26:45,125][123090] Updated weights for policy 1, policy_version 852687 (0.0008) [2023-12-26 06:26:45,177][123090] Updated weights for policy 1, policy_version 852697 (0.0009) [2023-12-26 06:26:45,519][123091] Updated weights for policy 0, policy_version 858833 (0.0010) [2023-12-26 06:26:45,587][123091] Updated weights for policy 0, policy_version 858843 (0.0005) [2023-12-26 06:26:45,644][123091] Updated weights for policy 0, policy_version 858853 (0.0005) [2023-12-26 06:26:45,705][123091] Updated weights for policy 0, policy_version 858863 (0.0005) [2023-12-26 06:26:46,045][123090] Updated weights for policy 1, policy_version 852707 (0.0008) [2023-12-26 06:26:46,098][123090] Updated weights for policy 1, policy_version 852717 (0.0010) [2023-12-26 06:26:46,150][123090] Updated weights for policy 1, policy_version 852727 (0.0009) [2023-12-26 06:26:46,270][123091] Updated weights for policy 0, policy_version 858873 (0.0010) [2023-12-26 06:26:46,326][123091] Updated weights for policy 0, policy_version 858883 (0.0009) [2023-12-26 06:26:46,385][123091] Updated weights for policy 0, policy_version 858893 (0.0009) [2023-12-26 06:26:47,067][123090] Updated weights for policy 1, policy_version 852737 (0.0009) [2023-12-26 06:26:47,119][123091] Updated weights for policy 0, policy_version 858903 (0.0010) [2023-12-26 06:26:47,126][123090] Updated weights for policy 1, policy_version 852747 (0.0007) [2023-12-26 06:26:47,175][123091] Updated weights for policy 0, policy_version 858913 (0.0007) [2023-12-26 06:26:47,178][123090] Updated weights for policy 1, policy_version 852757 (0.0008) [2023-12-26 06:26:47,230][123091] Updated weights for policy 0, policy_version 858923 (0.0005) [2023-12-26 06:26:47,244][123090] Updated weights for policy 1, policy_version 852767 (0.0010) [2023-12-26 06:26:47,888][123091] Updated weights for policy 0, policy_version 858933 (0.0005) [2023-12-26 06:26:47,933][123091] Updated weights for policy 0, policy_version 858943 (0.0005) [2023-12-26 06:26:47,996][123091] Updated weights for policy 0, policy_version 858953 (0.0010) [2023-12-26 06:26:48,152][123090] Updated weights for policy 1, policy_version 852778 (0.0010) [2023-12-26 06:26:48,219][123090] Updated weights for policy 1, policy_version 852788 (0.0009) [2023-12-26 06:26:48,287][123090] Updated weights for policy 1, policy_version 852798 (0.0009) [2023-12-26 06:26:48,711][123091] Updated weights for policy 0, policy_version 858963 (0.0011) [2023-12-26 06:26:48,769][123091] Updated weights for policy 0, policy_version 858973 (0.0010) [2023-12-26 06:26:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 438214656. Throughput: 0: 9090.1, 1: 8674.9. Samples: 438229268. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:48,785][121949] Avg episode reward: [(0, '6077.729'), (1, '5683.164')] [2023-12-26 06:26:48,824][123091] Updated weights for policy 0, policy_version 858983 (0.0010) [2023-12-26 06:26:49,153][123090] Updated weights for policy 1, policy_version 852808 (0.0009) [2023-12-26 06:26:49,207][123090] Updated weights for policy 1, policy_version 852818 (0.0010) [2023-12-26 06:26:49,278][123090] Updated weights for policy 1, policy_version 852828 (0.0009) [2023-12-26 06:26:49,551][123091] Updated weights for policy 0, policy_version 858993 (0.0009) [2023-12-26 06:26:49,620][123091] Updated weights for policy 0, policy_version 859003 (0.0010) [2023-12-26 06:26:49,676][123091] Updated weights for policy 0, policy_version 859013 (0.0007) [2023-12-26 06:26:49,736][123091] Updated weights for policy 0, policy_version 859023 (0.0006) [2023-12-26 06:26:50,205][123090] Updated weights for policy 1, policy_version 852838 (0.0010) [2023-12-26 06:26:50,272][123090] Updated weights for policy 1, policy_version 852848 (0.0010) [2023-12-26 06:26:50,342][123090] Updated weights for policy 1, policy_version 852858 (0.0010) [2023-12-26 06:26:50,509][123091] Updated weights for policy 0, policy_version 859033 (0.0009) [2023-12-26 06:26:50,576][123091] Updated weights for policy 0, policy_version 859043 (0.0010) [2023-12-26 06:26:50,640][123091] Updated weights for policy 0, policy_version 859053 (0.0009) [2023-12-26 06:26:51,218][123090] Updated weights for policy 1, policy_version 852868 (0.0008) [2023-12-26 06:26:51,288][123090] Updated weights for policy 1, policy_version 852878 (0.0007) [2023-12-26 06:26:51,358][123090] Updated weights for policy 1, policy_version 852888 (0.0008) [2023-12-26 06:26:51,516][123091] Updated weights for policy 0, policy_version 859063 (0.0010) [2023-12-26 06:26:51,580][123091] Updated weights for policy 0, policy_version 859073 (0.0009) [2023-12-26 06:26:51,646][123091] Updated weights for policy 0, policy_version 859083 (0.0010) [2023-12-26 06:26:52,141][123090] Updated weights for policy 1, policy_version 852898 (0.0008) [2023-12-26 06:26:52,196][123090] Updated weights for policy 1, policy_version 852908 (0.0005) [2023-12-26 06:26:52,259][123090] Updated weights for policy 1, policy_version 852918 (0.0007) [2023-12-26 06:26:52,317][123090] Updated weights for policy 1, policy_version 852928 (0.0010) [2023-12-26 06:26:52,397][123091] Updated weights for policy 0, policy_version 859093 (0.0010) [2023-12-26 06:26:52,462][123091] Updated weights for policy 0, policy_version 859103 (0.0011) [2023-12-26 06:26:52,517][123091] Updated weights for policy 0, policy_version 859113 (0.0011) [2023-12-26 06:26:53,147][123090] Updated weights for policy 1, policy_version 852938 (0.0010) [2023-12-26 06:26:53,198][123090] Updated weights for policy 1, policy_version 852948 (0.0010) [2023-12-26 06:26:53,259][123090] Updated weights for policy 1, policy_version 852958 (0.0010) [2023-12-26 06:26:53,322][123091] Updated weights for policy 0, policy_version 859123 (0.0009) [2023-12-26 06:26:53,387][123091] Updated weights for policy 0, policy_version 859133 (0.0008) [2023-12-26 06:26:53,457][123091] Updated weights for policy 0, policy_version 859143 (0.0006) [2023-12-26 06:26:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 438304768. Throughput: 0: 9024.4, 1: 8647.3. Samples: 438279920. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:53,785][121949] Avg episode reward: [(0, '6135.695'), (1, '5719.549')] [2023-12-26 06:26:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000859152_219947008.pth... [2023-12-26 06:26:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000852960_218357760.pth... [2023-12-26 06:26:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000858096_219676672.pth [2023-12-26 06:26:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000851968_218103808.pth [2023-12-26 06:26:54,100][123090] Updated weights for policy 1, policy_version 852968 (0.0010) [2023-12-26 06:26:54,107][123091] Updated weights for policy 0, policy_version 859153 (0.0007) [2023-12-26 06:26:54,162][123091] Updated weights for policy 0, policy_version 859163 (0.0010) [2023-12-26 06:26:54,165][123090] Updated weights for policy 1, policy_version 852978 (0.0005) [2023-12-26 06:26:54,205][123091] Updated weights for policy 0, policy_version 859173 (0.0010) [2023-12-26 06:26:54,229][123090] Updated weights for policy 1, policy_version 852988 (0.0006) [2023-12-26 06:26:54,260][123091] Updated weights for policy 0, policy_version 859183 (0.0010) [2023-12-26 06:26:54,939][123090] Updated weights for policy 1, policy_version 852998 (0.0006) [2023-12-26 06:26:55,009][123090] Updated weights for policy 1, policy_version 853008 (0.0006) [2023-12-26 06:26:55,083][123090] Updated weights for policy 1, policy_version 853018 (0.0006) [2023-12-26 06:26:55,155][123091] Updated weights for policy 0, policy_version 859193 (0.0009) [2023-12-26 06:26:55,223][123091] Updated weights for policy 0, policy_version 859203 (0.0006) [2023-12-26 06:26:55,289][123091] Updated weights for policy 0, policy_version 859213 (0.0005) [2023-12-26 06:26:55,835][123090] Updated weights for policy 1, policy_version 853028 (0.0010) [2023-12-26 06:26:55,883][123090] Updated weights for policy 1, policy_version 853038 (0.0010) [2023-12-26 06:26:55,934][123090] Updated weights for policy 1, policy_version 853048 (0.0010) [2023-12-26 06:26:56,007][123091] Updated weights for policy 0, policy_version 859223 (0.0008) [2023-12-26 06:26:56,055][123091] Updated weights for policy 0, policy_version 859233 (0.0009) [2023-12-26 06:26:56,103][123091] Updated weights for policy 0, policy_version 859243 (0.0009) [2023-12-26 06:26:56,766][123090] Updated weights for policy 1, policy_version 853058 (0.0009) [2023-12-26 06:26:56,823][123090] Updated weights for policy 1, policy_version 853068 (0.0008) [2023-12-26 06:26:56,875][123090] Updated weights for policy 1, policy_version 853078 (0.0009) [2023-12-26 06:26:56,930][123091] Updated weights for policy 0, policy_version 859253 (0.0009) [2023-12-26 06:26:56,945][123090] Updated weights for policy 1, policy_version 853088 (0.0005) [2023-12-26 06:26:56,986][123091] Updated weights for policy 0, policy_version 859263 (0.0009) [2023-12-26 06:26:57,063][123091] Updated weights for policy 0, policy_version 859273 (0.0009) [2023-12-26 06:26:57,655][123090] Updated weights for policy 1, policy_version 853098 (0.0006) [2023-12-26 06:26:57,712][123090] Updated weights for policy 1, policy_version 853108 (0.0006) [2023-12-26 06:26:57,767][123090] Updated weights for policy 1, policy_version 853118 (0.0005) [2023-12-26 06:26:57,941][123091] Updated weights for policy 0, policy_version 859283 (0.0009) [2023-12-26 06:26:57,992][123091] Updated weights for policy 0, policy_version 859294 (0.0010) [2023-12-26 06:26:58,058][123091] Updated weights for policy 0, policy_version 859304 (0.0008) [2023-12-26 06:26:58,620][123090] Updated weights for policy 1, policy_version 853128 (0.0006) [2023-12-26 06:26:58,692][123090] Updated weights for policy 1, policy_version 853138 (0.0008) [2023-12-26 06:26:58,764][123090] Updated weights for policy 1, policy_version 853148 (0.0013) [2023-12-26 06:26:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 438386688. Throughput: 0: 9056.8, 1: 8693.8. Samples: 438387312. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 06:26:58,785][121949] Avg episode reward: [(0, '6085.147'), (1, '5765.466')] [2023-12-26 06:26:58,884][123091] Updated weights for policy 0, policy_version 859314 (0.0008) [2023-12-26 06:26:58,961][123091] Updated weights for policy 0, policy_version 859324 (0.0007) [2023-12-26 06:26:59,022][123091] Updated weights for policy 0, policy_version 859334 (0.0009) [2023-12-26 06:26:59,086][123091] Updated weights for policy 0, policy_version 859344 (0.0009) [2023-12-26 06:26:59,619][123090] Updated weights for policy 1, policy_version 853158 (0.0007) [2023-12-26 06:26:59,692][123090] Updated weights for policy 1, policy_version 853168 (0.0009) [2023-12-26 06:26:59,766][123090] Updated weights for policy 1, policy_version 853178 (0.0011) [2023-12-26 06:26:59,811][123091] Updated weights for policy 0, policy_version 859354 (0.0006) [2023-12-26 06:26:59,876][123091] Updated weights for policy 0, policy_version 859364 (0.0007) [2023-12-26 06:26:59,945][123091] Updated weights for policy 0, policy_version 859374 (0.0006) [2023-12-26 06:27:00,532][123090] Updated weights for policy 1, policy_version 853188 (0.0010) [2023-12-26 06:27:00,588][123090] Updated weights for policy 1, policy_version 853198 (0.0009) [2023-12-26 06:27:00,625][123091] Updated weights for policy 0, policy_version 859384 (0.0008) [2023-12-26 06:27:00,649][123090] Updated weights for policy 1, policy_version 853208 (0.0009) [2023-12-26 06:27:00,687][123091] Updated weights for policy 0, policy_version 859394 (0.0009) [2023-12-26 06:27:00,748][123091] Updated weights for policy 0, policy_version 859404 (0.0009) [2023-12-26 06:27:01,474][123090] Updated weights for policy 1, policy_version 853218 (0.0006) [2023-12-26 06:27:01,548][123090] Updated weights for policy 1, policy_version 853228 (0.0007) [2023-12-26 06:27:01,612][123090] Updated weights for policy 1, policy_version 853238 (0.0008) [2023-12-26 06:27:01,676][123091] Updated weights for policy 0, policy_version 859414 (0.0010) [2023-12-26 06:27:01,686][123090] Updated weights for policy 1, policy_version 853248 (0.0006) [2023-12-26 06:27:01,746][123091] Updated weights for policy 0, policy_version 859424 (0.0009) [2023-12-26 06:27:01,807][123091] Updated weights for policy 0, policy_version 859434 (0.0009) [2023-12-26 06:27:02,425][123090] Updated weights for policy 1, policy_version 853258 (0.0005) [2023-12-26 06:27:02,474][123090] Updated weights for policy 1, policy_version 853268 (0.0007) [2023-12-26 06:27:02,526][123090] Updated weights for policy 1, policy_version 853278 (0.0006) [2023-12-26 06:27:02,632][123091] Updated weights for policy 0, policy_version 859444 (0.0009) [2023-12-26 06:27:02,701][123091] Updated weights for policy 0, policy_version 859454 (0.0009) [2023-12-26 06:27:02,762][123091] Updated weights for policy 0, policy_version 859464 (0.0009) [2023-12-26 06:27:03,331][123090] Updated weights for policy 1, policy_version 853288 (0.0006) [2023-12-26 06:27:03,396][123090] Updated weights for policy 1, policy_version 853298 (0.0008) [2023-12-26 06:27:03,458][123090] Updated weights for policy 1, policy_version 853308 (0.0010) [2023-12-26 06:27:03,639][123091] Updated weights for policy 0, policy_version 859474 (0.0009) [2023-12-26 06:27:03,696][123091] Updated weights for policy 0, policy_version 859484 (0.0009) [2023-12-26 06:27:03,770][123091] Updated weights for policy 0, policy_version 859494 (0.0010) [2023-12-26 06:27:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 438476800. Throughput: 0: 8918.0, 1: 8646.8. Samples: 438491052. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:03,784][121949] Avg episode reward: [(0, '6024.129'), (1, '5918.277')] [2023-12-26 06:27:03,832][123091] Updated weights for policy 0, policy_version 859504 (0.0009) [2023-12-26 06:27:04,110][123090] Updated weights for policy 1, policy_version 853318 (0.0011) [2023-12-26 06:27:04,176][123090] Updated weights for policy 1, policy_version 853328 (0.0010) [2023-12-26 06:27:04,240][123090] Updated weights for policy 1, policy_version 853338 (0.0010) [2023-12-26 06:27:04,698][123091] Updated weights for policy 0, policy_version 859514 (0.0009) [2023-12-26 06:27:04,766][123091] Updated weights for policy 0, policy_version 859524 (0.0006) [2023-12-26 06:27:04,830][123091] Updated weights for policy 0, policy_version 859534 (0.0005) [2023-12-26 06:27:05,007][123090] Updated weights for policy 1, policy_version 853348 (0.0008) [2023-12-26 06:27:05,067][123090] Updated weights for policy 1, policy_version 853358 (0.0005) [2023-12-26 06:27:05,117][123090] Updated weights for policy 1, policy_version 853368 (0.0005) [2023-12-26 06:27:05,584][123091] Updated weights for policy 0, policy_version 859544 (0.0006) [2023-12-26 06:27:05,647][123091] Updated weights for policy 0, policy_version 859554 (0.0005) [2023-12-26 06:27:05,705][123091] Updated weights for policy 0, policy_version 859564 (0.0005) [2023-12-26 06:27:05,777][123090] Updated weights for policy 1, policy_version 853378 (0.0005) [2023-12-26 06:27:05,853][123090] Updated weights for policy 1, policy_version 853388 (0.0005) [2023-12-26 06:27:05,907][123090] Updated weights for policy 1, policy_version 853398 (0.0005) [2023-12-26 06:27:05,974][123090] Updated weights for policy 1, policy_version 853408 (0.0005) [2023-12-26 06:27:06,406][123091] Updated weights for policy 0, policy_version 859574 (0.0005) [2023-12-26 06:27:06,468][123091] Updated weights for policy 0, policy_version 859584 (0.0009) [2023-12-26 06:27:06,520][123091] Updated weights for policy 0, policy_version 859594 (0.0010) [2023-12-26 06:27:06,671][123090] Updated weights for policy 1, policy_version 853418 (0.0005) [2023-12-26 06:27:06,738][123090] Updated weights for policy 1, policy_version 853428 (0.0005) [2023-12-26 06:27:06,809][123090] Updated weights for policy 1, policy_version 853438 (0.0005) [2023-12-26 06:27:07,222][123091] Updated weights for policy 0, policy_version 859604 (0.0009) [2023-12-26 06:27:07,285][123091] Updated weights for policy 0, policy_version 859614 (0.0006) [2023-12-26 06:27:07,344][123091] Updated weights for policy 0, policy_version 859624 (0.0005) [2023-12-26 06:27:07,420][123090] Updated weights for policy 1, policy_version 853448 (0.0005) [2023-12-26 06:27:07,470][123090] Updated weights for policy 1, policy_version 853458 (0.0005) [2023-12-26 06:27:07,518][123090] Updated weights for policy 1, policy_version 853468 (0.0005) [2023-12-26 06:27:08,008][123091] Updated weights for policy 0, policy_version 859634 (0.0005) [2023-12-26 06:27:08,082][123091] Updated weights for policy 0, policy_version 859644 (0.0010) [2023-12-26 06:27:08,128][123090] Updated weights for policy 1, policy_version 853478 (0.0005) [2023-12-26 06:27:08,141][123091] Updated weights for policy 0, policy_version 859654 (0.0010) [2023-12-26 06:27:08,190][123090] Updated weights for policy 1, policy_version 853488 (0.0007) [2023-12-26 06:27:08,204][123091] Updated weights for policy 0, policy_version 859664 (0.0011) [2023-12-26 06:27:08,252][123090] Updated weights for policy 1, policy_version 853498 (0.0009) [2023-12-26 06:27:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 438575104. Throughput: 0: 8961.2, 1: 8768.0. Samples: 438547832. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:08,785][121949] Avg episode reward: [(0, '6134.467'), (1, '5928.832')] [2023-12-26 06:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000859664_220078080.pth... [2023-12-26 06:27:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000853504_218497024.pth... [2023-12-26 06:27:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000858608_219807744.pth [2023-12-26 06:27:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000852480_218234880.pth [2023-12-26 06:27:08,951][123091] Updated weights for policy 0, policy_version 859674 (0.0009) [2023-12-26 06:27:09,005][123091] Updated weights for policy 0, policy_version 859684 (0.0009) [2023-12-26 06:27:09,071][123091] Updated weights for policy 0, policy_version 859694 (0.0009) [2023-12-26 06:27:09,079][123090] Updated weights for policy 1, policy_version 853508 (0.0008) [2023-12-26 06:27:09,146][123090] Updated weights for policy 1, policy_version 853518 (0.0009) [2023-12-26 06:27:09,216][123090] Updated weights for policy 1, policy_version 853528 (0.0009) [2023-12-26 06:27:09,961][123091] Updated weights for policy 0, policy_version 859704 (0.0010) [2023-12-26 06:27:09,962][123090] Updated weights for policy 1, policy_version 853538 (0.0009) [2023-12-26 06:27:10,024][123090] Updated weights for policy 1, policy_version 853548 (0.0009) [2023-12-26 06:27:10,026][123091] Updated weights for policy 0, policy_version 859714 (0.0009) [2023-12-26 06:27:10,078][123090] Updated weights for policy 1, policy_version 853558 (0.0009) [2023-12-26 06:27:10,097][123091] Updated weights for policy 0, policy_version 859724 (0.0009) [2023-12-26 06:27:10,143][123090] Updated weights for policy 1, policy_version 853568 (0.0009) [2023-12-26 06:27:10,921][123091] Updated weights for policy 0, policy_version 859734 (0.0006) [2023-12-26 06:27:10,978][123090] Updated weights for policy 1, policy_version 853578 (0.0005) [2023-12-26 06:27:10,998][123091] Updated weights for policy 0, policy_version 859744 (0.0006) [2023-12-26 06:27:11,052][123090] Updated weights for policy 1, policy_version 853591 (0.0007) [2023-12-26 06:27:11,065][123091] Updated weights for policy 0, policy_version 859754 (0.0007) [2023-12-26 06:27:11,834][123091] Updated weights for policy 0, policy_version 859764 (0.0009) [2023-12-26 06:27:11,892][123091] Updated weights for policy 0, policy_version 859774 (0.0009) [2023-12-26 06:27:11,944][123090] Updated weights for policy 1, policy_version 853601 (0.0010) [2023-12-26 06:27:11,953][123091] Updated weights for policy 0, policy_version 859784 (0.0009) [2023-12-26 06:27:12,012][123090] Updated weights for policy 1, policy_version 853611 (0.0009) [2023-12-26 06:27:12,084][123090] Updated weights for policy 1, policy_version 853621 (0.0009) [2023-12-26 06:27:12,160][123090] Updated weights for policy 1, policy_version 853631 (0.0008) [2023-12-26 06:27:12,757][123091] Updated weights for policy 0, policy_version 859794 (0.0008) [2023-12-26 06:27:12,807][123091] Updated weights for policy 0, policy_version 859804 (0.0007) [2023-12-26 06:27:12,855][123091] Updated weights for policy 0, policy_version 859815 (0.0009) [2023-12-26 06:27:12,994][123090] Updated weights for policy 1, policy_version 853641 (0.0009) [2023-12-26 06:27:13,052][123090] Updated weights for policy 1, policy_version 853651 (0.0007) [2023-12-26 06:27:13,120][123090] Updated weights for policy 1, policy_version 853661 (0.0009) [2023-12-26 06:27:13,709][123091] Updated weights for policy 0, policy_version 859825 (0.0010) [2023-12-26 06:27:13,762][123091] Updated weights for policy 0, policy_version 859835 (0.0009) [2023-12-26 06:27:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 438657024. Throughput: 0: 8994.9, 1: 8767.1. Samples: 438656040. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:13,784][121949] Avg episode reward: [(0, '6269.202'), (1, '5825.004')] [2023-12-26 06:27:13,817][123091] Updated weights for policy 0, policy_version 859847 (0.0010) [2023-12-26 06:27:13,908][123090] Updated weights for policy 1, policy_version 853671 (0.0008) [2023-12-26 06:27:13,967][123090] Updated weights for policy 1, policy_version 853681 (0.0005) [2023-12-26 06:27:14,043][123090] Updated weights for policy 1, policy_version 853691 (0.0009) [2023-12-26 06:27:14,633][123091] Updated weights for policy 0, policy_version 859857 (0.0009) [2023-12-26 06:27:14,684][123091] Updated weights for policy 0, policy_version 859867 (0.0009) [2023-12-26 06:27:14,740][123091] Updated weights for policy 0, policy_version 859877 (0.0008) [2023-12-26 06:27:14,804][123090] Updated weights for policy 1, policy_version 853701 (0.0009) [2023-12-26 06:27:14,810][123091] Updated weights for policy 0, policy_version 859887 (0.0009) [2023-12-26 06:27:14,881][123090] Updated weights for policy 1, policy_version 853711 (0.0006) [2023-12-26 06:27:14,952][123090] Updated weights for policy 1, policy_version 853721 (0.0009) [2023-12-26 06:27:15,676][123091] Updated weights for policy 0, policy_version 859897 (0.0009) [2023-12-26 06:27:15,741][123091] Updated weights for policy 0, policy_version 859907 (0.0009) [2023-12-26 06:27:15,744][123090] Updated weights for policy 1, policy_version 853731 (0.0012) [2023-12-26 06:27:15,795][123090] Updated weights for policy 1, policy_version 853741 (0.0006) [2023-12-26 06:27:15,797][123091] Updated weights for policy 0, policy_version 859917 (0.0009) [2023-12-26 06:27:15,842][123090] Updated weights for policy 1, policy_version 853751 (0.0005) [2023-12-26 06:27:16,512][123091] Updated weights for policy 0, policy_version 859927 (0.0007) [2023-12-26 06:27:16,523][123090] Updated weights for policy 1, policy_version 853761 (0.0007) [2023-12-26 06:27:16,565][123091] Updated weights for policy 0, policy_version 859937 (0.0009) [2023-12-26 06:27:16,576][123090] Updated weights for policy 1, policy_version 853771 (0.0005) [2023-12-26 06:27:16,616][123091] Updated weights for policy 0, policy_version 859947 (0.0010) [2023-12-26 06:27:16,627][123090] Updated weights for policy 1, policy_version 853781 (0.0005) [2023-12-26 06:27:16,683][123090] Updated weights for policy 1, policy_version 853791 (0.0006) [2023-12-26 06:27:17,352][123090] Updated weights for policy 1, policy_version 853801 (0.0007) [2023-12-26 06:27:17,406][123090] Updated weights for policy 1, policy_version 853811 (0.0007) [2023-12-26 06:27:17,465][123091] Updated weights for policy 0, policy_version 859957 (0.0009) [2023-12-26 06:27:17,472][123090] Updated weights for policy 1, policy_version 853821 (0.0005) [2023-12-26 06:27:17,521][123091] Updated weights for policy 0, policy_version 859967 (0.0010) [2023-12-26 06:27:17,575][123091] Updated weights for policy 0, policy_version 859977 (0.0010) [2023-12-26 06:27:18,182][123090] Updated weights for policy 1, policy_version 853831 (0.0006) [2023-12-26 06:27:18,229][123090] Updated weights for policy 1, policy_version 853841 (0.0005) [2023-12-26 06:27:18,278][123090] Updated weights for policy 1, policy_version 853851 (0.0005) [2023-12-26 06:27:18,280][123091] Updated weights for policy 0, policy_version 859987 (0.0007) [2023-12-26 06:27:18,349][123091] Updated weights for policy 0, policy_version 859997 (0.0007) [2023-12-26 06:27:18,422][123091] Updated weights for policy 0, policy_version 860007 (0.0009) [2023-12-26 06:27:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 438755328. Throughput: 0: 8947.4, 1: 8882.3. Samples: 438765552. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:18,785][121949] Avg episode reward: [(0, '6260.705'), (1, '5587.658')] [2023-12-26 06:27:19,124][123091] Updated weights for policy 0, policy_version 860017 (0.0005) [2023-12-26 06:27:19,133][123090] Updated weights for policy 1, policy_version 853861 (0.0007) [2023-12-26 06:27:19,181][123091] Updated weights for policy 0, policy_version 860027 (0.0007) [2023-12-26 06:27:19,197][123090] Updated weights for policy 1, policy_version 853871 (0.0009) [2023-12-26 06:27:19,249][123091] Updated weights for policy 0, policy_version 860037 (0.0010) [2023-12-26 06:27:19,264][123090] Updated weights for policy 1, policy_version 853881 (0.0009) [2023-12-26 06:27:19,314][123091] Updated weights for policy 0, policy_version 860047 (0.0007) [2023-12-26 06:27:20,138][123090] Updated weights for policy 1, policy_version 853891 (0.0009) [2023-12-26 06:27:20,138][123091] Updated weights for policy 0, policy_version 860057 (0.0010) [2023-12-26 06:27:20,202][123091] Updated weights for policy 0, policy_version 860067 (0.0008) [2023-12-26 06:27:20,205][123090] Updated weights for policy 1, policy_version 853901 (0.0010) [2023-12-26 06:27:20,266][123091] Updated weights for policy 0, policy_version 860077 (0.0009) [2023-12-26 06:27:20,278][123090] Updated weights for policy 1, policy_version 853911 (0.0007) [2023-12-26 06:27:21,128][123090] Updated weights for policy 1, policy_version 853921 (0.0008) [2023-12-26 06:27:21,130][123091] Updated weights for policy 0, policy_version 860087 (0.0010) [2023-12-26 06:27:21,200][123091] Updated weights for policy 0, policy_version 860097 (0.0009) [2023-12-26 06:27:21,200][123090] Updated weights for policy 1, policy_version 853931 (0.0007) [2023-12-26 06:27:21,274][123091] Updated weights for policy 0, policy_version 860107 (0.0008) [2023-12-26 06:27:21,280][123090] Updated weights for policy 1, policy_version 853941 (0.0008) [2023-12-26 06:27:21,381][123090] Updated weights for policy 1, policy_version 853951 (0.0010) [2023-12-26 06:27:22,101][123091] Updated weights for policy 0, policy_version 860117 (0.0010) [2023-12-26 06:27:22,168][123091] Updated weights for policy 0, policy_version 860127 (0.0009) [2023-12-26 06:27:22,197][123090] Updated weights for policy 1, policy_version 853961 (0.0008) [2023-12-26 06:27:22,234][123091] Updated weights for policy 0, policy_version 860137 (0.0009) [2023-12-26 06:27:22,264][123090] Updated weights for policy 1, policy_version 853971 (0.0008) [2023-12-26 06:27:22,333][123090] Updated weights for policy 1, policy_version 853981 (0.0010) [2023-12-26 06:27:23,101][123091] Updated weights for policy 0, policy_version 860147 (0.0007) [2023-12-26 06:27:23,104][123090] Updated weights for policy 1, policy_version 853991 (0.0009) [2023-12-26 06:27:23,158][123090] Updated weights for policy 1, policy_version 854001 (0.0007) [2023-12-26 06:27:23,162][123091] Updated weights for policy 0, policy_version 860157 (0.0008) [2023-12-26 06:27:23,212][123090] Updated weights for policy 1, policy_version 854011 (0.0008) [2023-12-26 06:27:23,225][123091] Updated weights for policy 0, policy_version 860167 (0.0009) [2023-12-26 06:27:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 438837248. Throughput: 0: 8893.4, 1: 8809.1. Samples: 438815676. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:23,785][121949] Avg episode reward: [(0, '6186.447'), (1, '5390.750')] [2023-12-26 06:27:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000854016_218628096.pth... [2023-12-26 06:27:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000860176_220209152.pth... [2023-12-26 06:27:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000859152_219947008.pth [2023-12-26 06:27:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000852960_218357760.pth [2023-12-26 06:27:23,991][123091] Updated weights for policy 0, policy_version 860177 (0.0010) [2023-12-26 06:27:24,058][123091] Updated weights for policy 0, policy_version 860187 (0.0010) [2023-12-26 06:27:24,069][123090] Updated weights for policy 1, policy_version 854021 (0.0009) [2023-12-26 06:27:24,117][123091] Updated weights for policy 0, policy_version 860197 (0.0008) [2023-12-26 06:27:24,123][123090] Updated weights for policy 1, policy_version 854031 (0.0008) [2023-12-26 06:27:24,171][123091] Updated weights for policy 0, policy_version 860207 (0.0008) [2023-12-26 06:27:24,183][123090] Updated weights for policy 1, policy_version 854041 (0.0008) [2023-12-26 06:27:24,978][123090] Updated weights for policy 1, policy_version 854051 (0.0009) [2023-12-26 06:27:25,028][123091] Updated weights for policy 0, policy_version 860217 (0.0009) [2023-12-26 06:27:25,032][123090] Updated weights for policy 1, policy_version 854061 (0.0005) [2023-12-26 06:27:25,086][123091] Updated weights for policy 0, policy_version 860227 (0.0009) [2023-12-26 06:27:25,091][123090] Updated weights for policy 1, policy_version 854071 (0.0005) [2023-12-26 06:27:25,144][123091] Updated weights for policy 0, policy_version 860237 (0.0009) [2023-12-26 06:27:25,777][123090] Updated weights for policy 1, policy_version 854081 (0.0005) [2023-12-26 06:27:25,852][123090] Updated weights for policy 1, policy_version 854091 (0.0005) [2023-12-26 06:27:25,921][123090] Updated weights for policy 1, policy_version 854101 (0.0006) [2023-12-26 06:27:25,923][123091] Updated weights for policy 0, policy_version 860247 (0.0007) [2023-12-26 06:27:25,978][123091] Updated weights for policy 0, policy_version 860257 (0.0006) [2023-12-26 06:27:25,987][123090] Updated weights for policy 1, policy_version 854111 (0.0006) [2023-12-26 06:27:26,047][123091] Updated weights for policy 0, policy_version 860267 (0.0009) [2023-12-26 06:27:26,633][123090] Updated weights for policy 1, policy_version 854121 (0.0009) [2023-12-26 06:27:26,686][123090] Updated weights for policy 1, policy_version 854131 (0.0010) [2023-12-26 06:27:26,741][123090] Updated weights for policy 1, policy_version 854141 (0.0009) [2023-12-26 06:27:26,764][123091] Updated weights for policy 0, policy_version 860277 (0.0008) [2023-12-26 06:27:26,817][123091] Updated weights for policy 0, policy_version 860287 (0.0005) [2023-12-26 06:27:26,870][123091] Updated weights for policy 0, policy_version 860297 (0.0006) [2023-12-26 06:27:27,505][123091] Updated weights for policy 0, policy_version 860307 (0.0007) [2023-12-26 06:27:27,552][123091] Updated weights for policy 0, policy_version 860317 (0.0010) [2023-12-26 06:27:27,563][123090] Updated weights for policy 1, policy_version 854151 (0.0008) [2023-12-26 06:27:27,604][123091] Updated weights for policy 0, policy_version 860327 (0.0010) [2023-12-26 06:27:27,608][123090] Updated weights for policy 1, policy_version 854161 (0.0007) [2023-12-26 06:27:27,662][123090] Updated weights for policy 1, policy_version 854171 (0.0007) [2023-12-26 06:27:28,336][123091] Updated weights for policy 0, policy_version 860337 (0.0010) [2023-12-26 06:27:28,400][123091] Updated weights for policy 0, policy_version 860347 (0.0008) [2023-12-26 06:27:28,487][123091] Updated weights for policy 0, policy_version 860357 (0.0010) [2023-12-26 06:27:28,542][123091] Updated weights for policy 0, policy_version 860367 (0.0011) [2023-12-26 06:27:28,566][123090] Updated weights for policy 1, policy_version 854181 (0.0008) [2023-12-26 06:27:28,617][123090] Updated weights for policy 1, policy_version 854191 (0.0008) [2023-12-26 06:27:28,664][123090] Updated weights for policy 1, policy_version 854201 (0.0008) [2023-12-26 06:27:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 438935552. Throughput: 0: 8957.6, 1: 8888.5. Samples: 438924100. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:28,784][121949] Avg episode reward: [(0, '6132.974'), (1, '5364.333')] [2023-12-26 06:27:29,336][123091] Updated weights for policy 0, policy_version 860377 (0.0010) [2023-12-26 06:27:29,408][123091] Updated weights for policy 0, policy_version 860387 (0.0008) [2023-12-26 06:27:29,471][123091] Updated weights for policy 0, policy_version 860397 (0.0010) [2023-12-26 06:27:29,511][123090] Updated weights for policy 1, policy_version 854211 (0.0008) [2023-12-26 06:27:29,583][123090] Updated weights for policy 1, policy_version 854221 (0.0007) [2023-12-26 06:27:29,647][123090] Updated weights for policy 1, policy_version 854231 (0.0005) [2023-12-26 06:27:30,270][123091] Updated weights for policy 0, policy_version 860407 (0.0010) [2023-12-26 06:27:30,329][123091] Updated weights for policy 0, policy_version 860417 (0.0010) [2023-12-26 06:27:30,358][123090] Updated weights for policy 1, policy_version 854241 (0.0005) [2023-12-26 06:27:30,390][123091] Updated weights for policy 0, policy_version 860427 (0.0009) [2023-12-26 06:27:30,419][123090] Updated weights for policy 1, policy_version 854251 (0.0008) [2023-12-26 06:27:30,482][123090] Updated weights for policy 1, policy_version 854261 (0.0009) [2023-12-26 06:27:30,540][123090] Updated weights for policy 1, policy_version 854271 (0.0010) [2023-12-26 06:27:31,193][123091] Updated weights for policy 0, policy_version 860437 (0.0009) [2023-12-26 06:27:31,256][123091] Updated weights for policy 0, policy_version 860447 (0.0009) [2023-12-26 06:27:31,324][123091] Updated weights for policy 0, policy_version 860457 (0.0009) [2023-12-26 06:27:31,409][123090] Updated weights for policy 1, policy_version 854281 (0.0010) [2023-12-26 06:27:31,468][123090] Updated weights for policy 1, policy_version 854291 (0.0005) [2023-12-26 06:27:31,520][123090] Updated weights for policy 1, policy_version 854301 (0.0005) [2023-12-26 06:27:32,101][123091] Updated weights for policy 0, policy_version 860467 (0.0008) [2023-12-26 06:27:32,172][123091] Updated weights for policy 0, policy_version 860477 (0.0006) [2023-12-26 06:27:32,229][123090] Updated weights for policy 1, policy_version 854311 (0.0009) [2023-12-26 06:27:32,246][123091] Updated weights for policy 0, policy_version 860487 (0.0007) [2023-12-26 06:27:32,294][123090] Updated weights for policy 1, policy_version 854321 (0.0011) [2023-12-26 06:27:32,367][123090] Updated weights for policy 1, policy_version 854331 (0.0010) [2023-12-26 06:27:33,016][123091] Updated weights for policy 0, policy_version 860497 (0.0007) [2023-12-26 06:27:33,067][123091] Updated weights for policy 0, policy_version 860507 (0.0010) [2023-12-26 06:27:33,124][123091] Updated weights for policy 0, policy_version 860517 (0.0010) [2023-12-26 06:27:33,175][123091] Updated weights for policy 0, policy_version 860527 (0.0010) [2023-12-26 06:27:33,186][123090] Updated weights for policy 1, policy_version 854341 (0.0011) [2023-12-26 06:27:33,245][123090] Updated weights for policy 1, policy_version 854351 (0.0010) [2023-12-26 06:27:33,303][123090] Updated weights for policy 1, policy_version 854361 (0.0010) [2023-12-26 06:27:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 439017472. Throughput: 0: 8861.0, 1: 8936.0. Samples: 439030136. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:33,785][121949] Avg episode reward: [(0, '6252.362'), (1, '5383.203')] [2023-12-26 06:27:33,986][123090] Updated weights for policy 1, policy_version 854371 (0.0009) [2023-12-26 06:27:34,009][123091] Updated weights for policy 0, policy_version 860537 (0.0010) [2023-12-26 06:27:34,042][123090] Updated weights for policy 1, policy_version 854381 (0.0006) [2023-12-26 06:27:34,067][123091] Updated weights for policy 0, policy_version 860547 (0.0010) [2023-12-26 06:27:34,102][123090] Updated weights for policy 1, policy_version 854391 (0.0005) [2023-12-26 06:27:34,125][123091] Updated weights for policy 0, policy_version 860557 (0.0010) [2023-12-26 06:27:34,801][123091] Updated weights for policy 0, policy_version 860567 (0.0008) [2023-12-26 06:27:34,860][123090] Updated weights for policy 1, policy_version 854401 (0.0007) [2023-12-26 06:27:34,864][123091] Updated weights for policy 0, policy_version 860577 (0.0006) [2023-12-26 06:27:34,921][123090] Updated weights for policy 1, policy_version 854411 (0.0008) [2023-12-26 06:27:34,922][123091] Updated weights for policy 0, policy_version 860587 (0.0007) [2023-12-26 06:27:34,986][123090] Updated weights for policy 1, policy_version 854421 (0.0008) [2023-12-26 06:27:35,051][123090] Updated weights for policy 1, policy_version 854431 (0.0008) [2023-12-26 06:27:35,676][123091] Updated weights for policy 0, policy_version 860597 (0.0008) [2023-12-26 06:27:35,706][123090] Updated weights for policy 1, policy_version 854441 (0.0006) [2023-12-26 06:27:35,733][123091] Updated weights for policy 0, policy_version 860607 (0.0009) [2023-12-26 06:27:35,766][123090] Updated weights for policy 1, policy_version 854451 (0.0005) [2023-12-26 06:27:35,784][123091] Updated weights for policy 0, policy_version 860617 (0.0007) [2023-12-26 06:27:35,830][123090] Updated weights for policy 1, policy_version 854461 (0.0009) [2023-12-26 06:27:36,559][123090] Updated weights for policy 1, policy_version 854471 (0.0007) [2023-12-26 06:27:36,627][123091] Updated weights for policy 0, policy_version 860627 (0.0007) [2023-12-26 06:27:36,632][123090] Updated weights for policy 1, policy_version 854481 (0.0005) [2023-12-26 06:27:36,684][123091] Updated weights for policy 0, policy_version 860637 (0.0009) [2023-12-26 06:27:36,688][123090] Updated weights for policy 1, policy_version 854491 (0.0005) [2023-12-26 06:27:36,744][123091] Updated weights for policy 0, policy_version 860647 (0.0010) [2023-12-26 06:27:37,240][123090] Updated weights for policy 1, policy_version 854501 (0.0008) [2023-12-26 06:27:37,305][123090] Updated weights for policy 1, policy_version 854511 (0.0009) [2023-12-26 06:27:37,373][123090] Updated weights for policy 1, policy_version 854521 (0.0010) [2023-12-26 06:27:37,643][123091] Updated weights for policy 0, policy_version 860657 (0.0010) [2023-12-26 06:27:37,697][123091] Updated weights for policy 0, policy_version 860667 (0.0010) [2023-12-26 06:27:37,749][123091] Updated weights for policy 0, policy_version 860677 (0.0009) [2023-12-26 06:27:37,799][123091] Updated weights for policy 0, policy_version 860688 (0.0009) [2023-12-26 06:27:38,118][123090] Updated weights for policy 1, policy_version 854531 (0.0008) [2023-12-26 06:27:38,178][123090] Updated weights for policy 1, policy_version 854541 (0.0005) [2023-12-26 06:27:38,236][123090] Updated weights for policy 1, policy_version 854551 (0.0009) [2023-12-26 06:27:38,696][123091] Updated weights for policy 0, policy_version 860698 (0.0009) [2023-12-26 06:27:38,750][123091] Updated weights for policy 0, policy_version 860708 (0.0009) [2023-12-26 06:27:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 439107584. Throughput: 0: 8883.5, 1: 9061.9. Samples: 439087468. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:38,785][121949] Avg episode reward: [(0, '6266.608'), (1, '5272.046')] [2023-12-26 06:27:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000854560_218767360.pth... [2023-12-26 06:27:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000853504_218497024.pth [2023-12-26 06:27:38,814][123091] Updated weights for policy 0, policy_version 860718 (0.0009) [2023-12-26 06:27:38,821][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000860720_220348416.pth... [2023-12-26 06:27:38,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000859664_220078080.pth [2023-12-26 06:27:39,070][123090] Updated weights for policy 1, policy_version 854561 (0.0010) [2023-12-26 06:27:39,136][123090] Updated weights for policy 1, policy_version 854571 (0.0008) [2023-12-26 06:27:39,188][123090] Updated weights for policy 1, policy_version 854581 (0.0009) [2023-12-26 06:27:39,261][123090] Updated weights for policy 1, policy_version 854591 (0.0009) [2023-12-26 06:27:39,704][123091] Updated weights for policy 0, policy_version 860728 (0.0009) [2023-12-26 06:27:39,754][123091] Updated weights for policy 0, policy_version 860738 (0.0009) [2023-12-26 06:27:39,806][123091] Updated weights for policy 0, policy_version 860748 (0.0010) [2023-12-26 06:27:40,073][123090] Updated weights for policy 1, policy_version 854601 (0.0009) [2023-12-26 06:27:40,140][123090] Updated weights for policy 1, policy_version 854611 (0.0010) [2023-12-26 06:27:40,201][123090] Updated weights for policy 1, policy_version 854621 (0.0009) [2023-12-26 06:27:40,698][123091] Updated weights for policy 0, policy_version 860758 (0.0010) [2023-12-26 06:27:40,752][123091] Updated weights for policy 0, policy_version 860768 (0.0009) [2023-12-26 06:27:40,807][123091] Updated weights for policy 0, policy_version 860778 (0.0009) [2023-12-26 06:27:41,026][123090] Updated weights for policy 1, policy_version 854631 (0.0010) [2023-12-26 06:27:41,097][123090] Updated weights for policy 1, policy_version 854641 (0.0009) [2023-12-26 06:27:41,165][123090] Updated weights for policy 1, policy_version 854651 (0.0010) [2023-12-26 06:27:41,631][123091] Updated weights for policy 0, policy_version 860788 (0.0008) [2023-12-26 06:27:41,701][123091] Updated weights for policy 0, policy_version 860798 (0.0007) [2023-12-26 06:27:41,769][123091] Updated weights for policy 0, policy_version 860808 (0.0007) [2023-12-26 06:27:42,010][123090] Updated weights for policy 1, policy_version 854661 (0.0010) [2023-12-26 06:27:42,074][123090] Updated weights for policy 1, policy_version 854671 (0.0010) [2023-12-26 06:27:42,142][123090] Updated weights for policy 1, policy_version 854681 (0.0010) [2023-12-26 06:27:42,480][123091] Updated weights for policy 0, policy_version 860818 (0.0007) [2023-12-26 06:27:42,550][123091] Updated weights for policy 0, policy_version 860828 (0.0010) [2023-12-26 06:27:42,617][123091] Updated weights for policy 0, policy_version 860838 (0.0010) [2023-12-26 06:27:42,680][123091] Updated weights for policy 0, policy_version 860848 (0.0010) [2023-12-26 06:27:42,866][123090] Updated weights for policy 1, policy_version 854691 (0.0010) [2023-12-26 06:27:42,938][123090] Updated weights for policy 1, policy_version 854701 (0.0007) [2023-12-26 06:27:43,010][123090] Updated weights for policy 1, policy_version 854711 (0.0006) [2023-12-26 06:27:43,480][123091] Updated weights for policy 0, policy_version 860858 (0.0010) [2023-12-26 06:27:43,530][123091] Updated weights for policy 0, policy_version 860868 (0.0010) [2023-12-26 06:27:43,599][123091] Updated weights for policy 0, policy_version 860878 (0.0010) [2023-12-26 06:27:43,674][123090] Updated weights for policy 1, policy_version 854721 (0.0007) [2023-12-26 06:27:43,751][123090] Updated weights for policy 1, policy_version 854731 (0.0006) [2023-12-26 06:27:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 439197696. Throughput: 0: 8809.7, 1: 9043.3. Samples: 439190696. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:43,784][121949] Avg episode reward: [(0, '6326.390'), (1, '5085.426')] [2023-12-26 06:27:43,816][123090] Updated weights for policy 1, policy_version 854741 (0.0009) [2023-12-26 06:27:43,879][123090] Updated weights for policy 1, policy_version 854751 (0.0008) [2023-12-26 06:27:44,377][123091] Updated weights for policy 0, policy_version 860888 (0.0006) [2023-12-26 06:27:44,439][123091] Updated weights for policy 0, policy_version 860898 (0.0009) [2023-12-26 06:27:44,499][123091] Updated weights for policy 0, policy_version 860908 (0.0008) [2023-12-26 06:27:44,692][123090] Updated weights for policy 1, policy_version 854761 (0.0009) [2023-12-26 06:27:44,747][123090] Updated weights for policy 1, policy_version 854771 (0.0009) [2023-12-26 06:27:44,816][123090] Updated weights for policy 1, policy_version 854781 (0.0008) [2023-12-26 06:27:45,299][123091] Updated weights for policy 0, policy_version 860918 (0.0008) [2023-12-26 06:27:45,369][123091] Updated weights for policy 0, policy_version 860928 (0.0007) [2023-12-26 06:27:45,434][123091] Updated weights for policy 0, policy_version 860938 (0.0008) [2023-12-26 06:27:45,616][123090] Updated weights for policy 1, policy_version 854791 (0.0006) [2023-12-26 06:27:45,689][123090] Updated weights for policy 1, policy_version 854801 (0.0008) [2023-12-26 06:27:45,757][123090] Updated weights for policy 1, policy_version 854811 (0.0006) [2023-12-26 06:27:46,280][123091] Updated weights for policy 0, policy_version 860948 (0.0010) [2023-12-26 06:27:46,328][123091] Updated weights for policy 0, policy_version 860958 (0.0009) [2023-12-26 06:27:46,375][123091] Updated weights for policy 0, policy_version 860968 (0.0009) [2023-12-26 06:27:46,454][123090] Updated weights for policy 1, policy_version 854821 (0.0009) [2023-12-26 06:27:46,511][123090] Updated weights for policy 1, policy_version 854831 (0.0009) [2023-12-26 06:27:46,564][123090] Updated weights for policy 1, policy_version 854841 (0.0009) [2023-12-26 06:27:47,140][123091] Updated weights for policy 0, policy_version 860978 (0.0008) [2023-12-26 06:27:47,187][123091] Updated weights for policy 0, policy_version 860988 (0.0008) [2023-12-26 06:27:47,235][123091] Updated weights for policy 0, policy_version 860998 (0.0009) [2023-12-26 06:27:47,286][123091] Updated weights for policy 0, policy_version 861008 (0.0009) [2023-12-26 06:27:47,478][123090] Updated weights for policy 1, policy_version 854851 (0.0009) [2023-12-26 06:27:47,526][123090] Updated weights for policy 1, policy_version 854861 (0.0005) [2023-12-26 06:27:47,577][123090] Updated weights for policy 1, policy_version 854871 (0.0005) [2023-12-26 06:27:48,182][123091] Updated weights for policy 0, policy_version 861018 (0.0008) [2023-12-26 06:27:48,235][123091] Updated weights for policy 0, policy_version 861028 (0.0005) [2023-12-26 06:27:48,286][123091] Updated weights for policy 0, policy_version 861038 (0.0005) [2023-12-26 06:27:48,296][123090] Updated weights for policy 1, policy_version 854881 (0.0005) [2023-12-26 06:27:48,370][123090] Updated weights for policy 1, policy_version 854891 (0.0007) [2023-12-26 06:27:48,435][123090] Updated weights for policy 1, policy_version 854901 (0.0006) [2023-12-26 06:27:48,485][123090] Updated weights for policy 1, policy_version 854911 (0.0006) [2023-12-26 06:27:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 439287808. Throughput: 0: 8854.6, 1: 9100.3. Samples: 439299020. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:48,784][121949] Avg episode reward: [(0, '6343.562'), (1, '5250.122')] [2023-12-26 06:27:49,082][123091] Updated weights for policy 0, policy_version 861048 (0.0010) [2023-12-26 06:27:49,126][123091] Updated weights for policy 0, policy_version 861058 (0.0010) [2023-12-26 06:27:49,169][123091] Updated weights for policy 0, policy_version 861068 (0.0010) [2023-12-26 06:27:49,213][123090] Updated weights for policy 1, policy_version 854921 (0.0005) [2023-12-26 06:27:49,279][123090] Updated weights for policy 1, policy_version 854931 (0.0007) [2023-12-26 06:27:49,352][123090] Updated weights for policy 1, policy_version 854941 (0.0007) [2023-12-26 06:27:50,015][123090] Updated weights for policy 1, policy_version 854951 (0.0009) [2023-12-26 06:27:50,027][123091] Updated weights for policy 0, policy_version 861078 (0.0009) [2023-12-26 06:27:50,078][123090] Updated weights for policy 1, policy_version 854961 (0.0009) [2023-12-26 06:27:50,080][123091] Updated weights for policy 0, policy_version 861088 (0.0007) [2023-12-26 06:27:50,136][123091] Updated weights for policy 0, policy_version 861098 (0.0007) [2023-12-26 06:27:50,149][123090] Updated weights for policy 1, policy_version 854971 (0.0010) [2023-12-26 06:27:50,962][123090] Updated weights for policy 1, policy_version 854981 (0.0010) [2023-12-26 06:27:50,995][123091] Updated weights for policy 0, policy_version 861108 (0.0009) [2023-12-26 06:27:51,036][123090] Updated weights for policy 1, policy_version 854991 (0.0007) [2023-12-26 06:27:51,065][123091] Updated weights for policy 0, policy_version 861118 (0.0009) [2023-12-26 06:27:51,102][123090] Updated weights for policy 1, policy_version 855001 (0.0006) [2023-12-26 06:27:51,126][123091] Updated weights for policy 0, policy_version 861128 (0.0009) [2023-12-26 06:27:51,915][123090] Updated weights for policy 1, policy_version 855011 (0.0006) [2023-12-26 06:27:51,973][123091] Updated weights for policy 0, policy_version 861138 (0.0008) [2023-12-26 06:27:51,983][123090] Updated weights for policy 1, policy_version 855021 (0.0010) [2023-12-26 06:27:52,035][123091] Updated weights for policy 0, policy_version 861148 (0.0007) [2023-12-26 06:27:52,052][123090] Updated weights for policy 1, policy_version 855031 (0.0008) [2023-12-26 06:27:52,098][123091] Updated weights for policy 0, policy_version 861158 (0.0009) [2023-12-26 06:27:52,158][123091] Updated weights for policy 0, policy_version 861168 (0.0010) [2023-12-26 06:27:52,910][123090] Updated weights for policy 1, policy_version 855041 (0.0007) [2023-12-26 06:27:52,973][123091] Updated weights for policy 0, policy_version 861178 (0.0006) [2023-12-26 06:27:52,984][123090] Updated weights for policy 1, policy_version 855051 (0.0009) [2023-12-26 06:27:53,024][123091] Updated weights for policy 0, policy_version 861188 (0.0010) [2023-12-26 06:27:53,041][123090] Updated weights for policy 1, policy_version 855061 (0.0007) [2023-12-26 06:27:53,082][123091] Updated weights for policy 0, policy_version 861198 (0.0008) [2023-12-26 06:27:53,105][123090] Updated weights for policy 1, policy_version 855071 (0.0006) [2023-12-26 06:27:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 439369728. Throughput: 0: 8830.8, 1: 9040.2. Samples: 439352028. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:53,784][121949] Avg episode reward: [(0, '6265.717'), (1, '5502.533')] [2023-12-26 06:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000861200_220471296.pth... [2023-12-26 06:27:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000860176_220209152.pth [2023-12-26 06:27:53,817][123090] Updated weights for policy 1, policy_version 855081 (0.0009) [2023-12-26 06:27:53,865][123090] Updated weights for policy 1, policy_version 855091 (0.0009) [2023-12-26 06:27:53,916][123090] Updated weights for policy 1, policy_version 855102 (0.0010) [2023-12-26 06:27:53,923][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000855104_218906624.pth... [2023-12-26 06:27:53,926][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000854016_218628096.pth [2023-12-26 06:27:53,953][123091] Updated weights for policy 0, policy_version 861208 (0.0008) [2023-12-26 06:27:54,012][123091] Updated weights for policy 0, policy_version 861218 (0.0009) [2023-12-26 06:27:54,077][123091] Updated weights for policy 0, policy_version 861228 (0.0010) [2023-12-26 06:27:54,768][123090] Updated weights for policy 1, policy_version 855112 (0.0010) [2023-12-26 06:27:54,817][123090] Updated weights for policy 1, policy_version 855122 (0.0009) [2023-12-26 06:27:54,864][123090] Updated weights for policy 1, policy_version 855132 (0.0008) [2023-12-26 06:27:54,893][123091] Updated weights for policy 0, policy_version 861238 (0.0008) [2023-12-26 06:27:54,949][123091] Updated weights for policy 0, policy_version 861248 (0.0006) [2023-12-26 06:27:55,002][123091] Updated weights for policy 0, policy_version 861258 (0.0006) [2023-12-26 06:27:55,644][123090] Updated weights for policy 1, policy_version 855142 (0.0007) [2023-12-26 06:27:55,709][123090] Updated weights for policy 1, policy_version 855152 (0.0005) [2023-12-26 06:27:55,763][123090] Updated weights for policy 1, policy_version 855162 (0.0007) [2023-12-26 06:27:55,795][123091] Updated weights for policy 0, policy_version 861268 (0.0007) [2023-12-26 06:27:55,847][123091] Updated weights for policy 0, policy_version 861278 (0.0010) [2023-12-26 06:27:55,897][123091] Updated weights for policy 0, policy_version 861289 (0.0009) [2023-12-26 06:27:56,468][123090] Updated weights for policy 1, policy_version 855172 (0.0005) [2023-12-26 06:27:56,523][123090] Updated weights for policy 1, policy_version 855182 (0.0005) [2023-12-26 06:27:56,574][123090] Updated weights for policy 1, policy_version 855192 (0.0005) [2023-12-26 06:27:56,615][123091] Updated weights for policy 0, policy_version 861299 (0.0005) [2023-12-26 06:27:56,665][123091] Updated weights for policy 0, policy_version 861309 (0.0008) [2023-12-26 06:27:56,712][123091] Updated weights for policy 0, policy_version 861319 (0.0008) [2023-12-26 06:27:57,345][123090] Updated weights for policy 1, policy_version 855202 (0.0006) [2023-12-26 06:27:57,421][123090] Updated weights for policy 1, policy_version 855212 (0.0006) [2023-12-26 06:27:57,487][123090] Updated weights for policy 1, policy_version 855222 (0.0008) [2023-12-26 06:27:57,548][123090] Updated weights for policy 1, policy_version 855232 (0.0007) [2023-12-26 06:27:57,581][123091] Updated weights for policy 0, policy_version 861329 (0.0010) [2023-12-26 06:27:57,647][123091] Updated weights for policy 0, policy_version 861339 (0.0009) [2023-12-26 06:27:57,694][123091] Updated weights for policy 0, policy_version 861349 (0.0008) [2023-12-26 06:27:57,752][123091] Updated weights for policy 0, policy_version 861359 (0.0009) [2023-12-26 06:27:58,355][123090] Updated weights for policy 1, policy_version 855242 (0.0010) [2023-12-26 06:27:58,409][123090] Updated weights for policy 1, policy_version 855252 (0.0010) [2023-12-26 06:27:58,471][123090] Updated weights for policy 1, policy_version 855262 (0.0008) [2023-12-26 06:27:58,639][123091] Updated weights for policy 0, policy_version 861369 (0.0009) [2023-12-26 06:27:58,705][123091] Updated weights for policy 0, policy_version 861379 (0.0008) [2023-12-26 06:27:58,779][123091] Updated weights for policy 0, policy_version 861390 (0.0008) [2023-12-26 06:27:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 439459840. Throughput: 0: 8789.9, 1: 9040.5. Samples: 439458412. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:27:58,785][121949] Avg episode reward: [(0, '6209.100'), (1, '5708.104')] [2023-12-26 06:27:59,274][123090] Updated weights for policy 1, policy_version 855272 (0.0007) [2023-12-26 06:27:59,342][123090] Updated weights for policy 1, policy_version 855282 (0.0007) [2023-12-26 06:27:59,409][123090] Updated weights for policy 1, policy_version 855292 (0.0009) [2023-12-26 06:27:59,668][123091] Updated weights for policy 0, policy_version 861400 (0.0008) [2023-12-26 06:27:59,716][123091] Updated weights for policy 0, policy_version 861410 (0.0010) [2023-12-26 06:27:59,775][123091] Updated weights for policy 0, policy_version 861420 (0.0010) [2023-12-26 06:28:00,286][123090] Updated weights for policy 1, policy_version 855302 (0.0010) [2023-12-26 06:28:00,352][123090] Updated weights for policy 1, policy_version 855312 (0.0009) [2023-12-26 06:28:00,420][123090] Updated weights for policy 1, policy_version 855322 (0.0009) [2023-12-26 06:28:00,594][123091] Updated weights for policy 0, policy_version 861430 (0.0010) [2023-12-26 06:28:00,646][123091] Updated weights for policy 0, policy_version 861440 (0.0007) [2023-12-26 06:28:00,702][123091] Updated weights for policy 0, policy_version 861450 (0.0006) [2023-12-26 06:28:01,296][123090] Updated weights for policy 1, policy_version 855332 (0.0008) [2023-12-26 06:28:01,363][123090] Updated weights for policy 1, policy_version 855342 (0.0008) [2023-12-26 06:28:01,433][123090] Updated weights for policy 1, policy_version 855352 (0.0009) [2023-12-26 06:28:01,442][123091] Updated weights for policy 0, policy_version 861460 (0.0006) [2023-12-26 06:28:01,508][123091] Updated weights for policy 0, policy_version 861470 (0.0005) [2023-12-26 06:28:01,573][123091] Updated weights for policy 0, policy_version 861480 (0.0006) [2023-12-26 06:28:02,220][123091] Updated weights for policy 0, policy_version 861490 (0.0007) [2023-12-26 06:28:02,272][123090] Updated weights for policy 1, policy_version 855362 (0.0008) [2023-12-26 06:28:02,280][123091] Updated weights for policy 0, policy_version 861500 (0.0006) [2023-12-26 06:28:02,334][123091] Updated weights for policy 0, policy_version 861510 (0.0008) [2023-12-26 06:28:02,337][123090] Updated weights for policy 1, policy_version 855372 (0.0009) [2023-12-26 06:28:02,390][123091] Updated weights for policy 0, policy_version 861520 (0.0009) [2023-12-26 06:28:02,400][123090] Updated weights for policy 1, policy_version 855382 (0.0007) [2023-12-26 06:28:02,471][123090] Updated weights for policy 1, policy_version 855392 (0.0009) [2023-12-26 06:28:03,208][123091] Updated weights for policy 0, policy_version 861530 (0.0011) [2023-12-26 06:28:03,209][123090] Updated weights for policy 1, policy_version 855402 (0.0008) [2023-12-26 06:28:03,265][123090] Updated weights for policy 1, policy_version 855412 (0.0008) [2023-12-26 06:28:03,271][123091] Updated weights for policy 0, policy_version 861540 (0.0011) [2023-12-26 06:28:03,326][123091] Updated weights for policy 0, policy_version 861550 (0.0008) [2023-12-26 06:28:03,327][123090] Updated weights for policy 1, policy_version 855422 (0.0009) [2023-12-26 06:28:03,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 439549952. Throughput: 0: 8784.4, 1: 8915.9. Samples: 439562068. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:03,786][121949] Avg episode reward: [(0, '6306.978'), (1, '5614.354')] [2023-12-26 06:28:04,014][123091] Updated weights for policy 0, policy_version 861560 (0.0006) [2023-12-26 06:28:04,077][123091] Updated weights for policy 0, policy_version 861570 (0.0006) [2023-12-26 06:28:04,145][123091] Updated weights for policy 0, policy_version 861580 (0.0010) [2023-12-26 06:28:04,228][123090] Updated weights for policy 1, policy_version 855432 (0.0007) [2023-12-26 06:28:04,300][123090] Updated weights for policy 1, policy_version 855442 (0.0006) [2023-12-26 06:28:04,369][123090] Updated weights for policy 1, policy_version 855452 (0.0007) [2023-12-26 06:28:04,855][123091] Updated weights for policy 0, policy_version 861590 (0.0008) [2023-12-26 06:28:04,918][123091] Updated weights for policy 0, policy_version 861600 (0.0006) [2023-12-26 06:28:04,977][123091] Updated weights for policy 0, policy_version 861610 (0.0005) [2023-12-26 06:28:05,117][123090] Updated weights for policy 1, policy_version 855462 (0.0009) [2023-12-26 06:28:05,171][123090] Updated weights for policy 1, policy_version 855472 (0.0010) [2023-12-26 06:28:05,230][123090] Updated weights for policy 1, policy_version 855482 (0.0009) [2023-12-26 06:28:05,697][123091] Updated weights for policy 0, policy_version 861620 (0.0006) [2023-12-26 06:28:05,758][123091] Updated weights for policy 0, policy_version 861630 (0.0005) [2023-12-26 06:28:05,826][123091] Updated weights for policy 0, policy_version 861640 (0.0005) [2023-12-26 06:28:05,987][123090] Updated weights for policy 1, policy_version 855492 (0.0006) [2023-12-26 06:28:06,057][123090] Updated weights for policy 1, policy_version 855502 (0.0005) [2023-12-26 06:28:06,134][123090] Updated weights for policy 1, policy_version 855512 (0.0007) [2023-12-26 06:28:06,526][123091] Updated weights for policy 0, policy_version 861650 (0.0005) [2023-12-26 06:28:06,592][123091] Updated weights for policy 0, policy_version 861660 (0.0006) [2023-12-26 06:28:06,669][123091] Updated weights for policy 0, policy_version 861670 (0.0006) [2023-12-26 06:28:06,741][123091] Updated weights for policy 0, policy_version 861680 (0.0006) [2023-12-26 06:28:06,878][123090] Updated weights for policy 1, policy_version 855522 (0.0007) [2023-12-26 06:28:06,940][123090] Updated weights for policy 1, policy_version 855532 (0.0010) [2023-12-26 06:28:07,003][123090] Updated weights for policy 1, policy_version 855542 (0.0009) [2023-12-26 06:28:07,064][123090] Updated weights for policy 1, policy_version 855552 (0.0010) [2023-12-26 06:28:07,465][123091] Updated weights for policy 0, policy_version 861690 (0.0006) [2023-12-26 06:28:07,520][123091] Updated weights for policy 0, policy_version 861700 (0.0006) [2023-12-26 06:28:07,577][123091] Updated weights for policy 0, policy_version 861710 (0.0006) [2023-12-26 06:28:07,791][123090] Updated weights for policy 1, policy_version 855562 (0.0005) [2023-12-26 06:28:07,846][123090] Updated weights for policy 1, policy_version 855572 (0.0005) [2023-12-26 06:28:07,901][123090] Updated weights for policy 1, policy_version 855582 (0.0005) [2023-12-26 06:28:08,318][123091] Updated weights for policy 0, policy_version 861720 (0.0010) [2023-12-26 06:28:08,380][123091] Updated weights for policy 0, policy_version 861730 (0.0008) [2023-12-26 06:28:08,449][123091] Updated weights for policy 0, policy_version 861740 (0.0010) [2023-12-26 06:28:08,638][123090] Updated weights for policy 1, policy_version 855592 (0.0008) [2023-12-26 06:28:08,696][123090] Updated weights for policy 1, policy_version 855602 (0.0010) [2023-12-26 06:28:08,760][123090] Updated weights for policy 1, policy_version 855612 (0.0006) [2023-12-26 06:28:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 439640064. Throughput: 0: 8852.8, 1: 8984.4. Samples: 439618348. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:08,785][121949] Avg episode reward: [(0, '6301.618'), (1, '5542.984')] [2023-12-26 06:28:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000855616_219037696.pth... [2023-12-26 06:28:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000861744_220610560.pth... [2023-12-26 06:28:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000860720_220348416.pth [2023-12-26 06:28:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000854560_218767360.pth [2023-12-26 06:28:09,174][123091] Updated weights for policy 0, policy_version 861750 (0.0009) [2023-12-26 06:28:09,246][123091] Updated weights for policy 0, policy_version 861760 (0.0008) [2023-12-26 06:28:09,314][123091] Updated weights for policy 0, policy_version 861770 (0.0007) [2023-12-26 06:28:09,514][123090] Updated weights for policy 1, policy_version 855622 (0.0008) [2023-12-26 06:28:09,578][123090] Updated weights for policy 1, policy_version 855632 (0.0010) [2023-12-26 06:28:09,647][123090] Updated weights for policy 1, policy_version 855642 (0.0010) [2023-12-26 06:28:10,079][123091] Updated weights for policy 0, policy_version 861780 (0.0012) [2023-12-26 06:28:10,131][123091] Updated weights for policy 0, policy_version 861790 (0.0011) [2023-12-26 06:28:10,194][123091] Updated weights for policy 0, policy_version 861800 (0.0011) [2023-12-26 06:28:10,459][123090] Updated weights for policy 1, policy_version 855652 (0.0007) [2023-12-26 06:28:10,514][123090] Updated weights for policy 1, policy_version 855662 (0.0008) [2023-12-26 06:28:10,568][123090] Updated weights for policy 1, policy_version 855672 (0.0008) [2023-12-26 06:28:11,048][123091] Updated weights for policy 0, policy_version 861810 (0.0011) [2023-12-26 06:28:11,111][123091] Updated weights for policy 0, policy_version 861820 (0.0011) [2023-12-26 06:28:11,173][123091] Updated weights for policy 0, policy_version 861830 (0.0010) [2023-12-26 06:28:11,244][123091] Updated weights for policy 0, policy_version 861840 (0.0011) [2023-12-26 06:28:11,442][123090] Updated weights for policy 1, policy_version 855682 (0.0009) [2023-12-26 06:28:11,506][123090] Updated weights for policy 1, policy_version 855692 (0.0009) [2023-12-26 06:28:11,560][123090] Updated weights for policy 1, policy_version 855702 (0.0009) [2023-12-26 06:28:11,618][123090] Updated weights for policy 1, policy_version 855712 (0.0009) [2023-12-26 06:28:12,120][123091] Updated weights for policy 0, policy_version 861850 (0.0011) [2023-12-26 06:28:12,183][123091] Updated weights for policy 0, policy_version 861860 (0.0011) [2023-12-26 06:28:12,242][123091] Updated weights for policy 0, policy_version 861870 (0.0011) [2023-12-26 06:28:12,497][123090] Updated weights for policy 1, policy_version 855722 (0.0007) [2023-12-26 06:28:12,562][123090] Updated weights for policy 1, policy_version 855732 (0.0009) [2023-12-26 06:28:12,635][123090] Updated weights for policy 1, policy_version 855742 (0.0009) [2023-12-26 06:28:13,043][123091] Updated weights for policy 0, policy_version 861880 (0.0007) [2023-12-26 06:28:13,098][123091] Updated weights for policy 0, policy_version 861890 (0.0008) [2023-12-26 06:28:13,161][123091] Updated weights for policy 0, policy_version 861900 (0.0009) [2023-12-26 06:28:13,486][123090] Updated weights for policy 1, policy_version 855752 (0.0009) [2023-12-26 06:28:13,544][123090] Updated weights for policy 1, policy_version 855762 (0.0010) [2023-12-26 06:28:13,601][123090] Updated weights for policy 1, policy_version 855772 (0.0009) [2023-12-26 06:28:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 439730176. Throughput: 0: 8838.7, 1: 8939.4. Samples: 439724120. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:13,785][121949] Avg episode reward: [(0, '6222.225'), (1, '5631.446')] [2023-12-26 06:28:13,830][123091] Updated weights for policy 0, policy_version 861910 (0.0007) [2023-12-26 06:28:13,896][123091] Updated weights for policy 0, policy_version 861920 (0.0006) [2023-12-26 06:28:13,943][123091] Updated weights for policy 0, policy_version 861930 (0.0005) [2023-12-26 06:28:14,421][123090] Updated weights for policy 1, policy_version 855782 (0.0007) [2023-12-26 06:28:14,483][123090] Updated weights for policy 1, policy_version 855792 (0.0005) [2023-12-26 06:28:14,541][123090] Updated weights for policy 1, policy_version 855802 (0.0008) [2023-12-26 06:28:14,563][123091] Updated weights for policy 0, policy_version 861940 (0.0006) [2023-12-26 06:28:14,618][123091] Updated weights for policy 0, policy_version 861950 (0.0006) [2023-12-26 06:28:14,672][123091] Updated weights for policy 0, policy_version 861960 (0.0005) [2023-12-26 06:28:15,314][123090] Updated weights for policy 1, policy_version 855812 (0.0009) [2023-12-26 06:28:15,368][123090] Updated weights for policy 1, policy_version 855822 (0.0009) [2023-12-26 06:28:15,430][123090] Updated weights for policy 1, policy_version 855832 (0.0010) [2023-12-26 06:28:15,450][123091] Updated weights for policy 0, policy_version 861970 (0.0006) [2023-12-26 06:28:15,518][123091] Updated weights for policy 0, policy_version 861980 (0.0009) [2023-12-26 06:28:15,586][123091] Updated weights for policy 0, policy_version 861990 (0.0006) [2023-12-26 06:28:15,661][123091] Updated weights for policy 0, policy_version 862000 (0.0008) [2023-12-26 06:28:16,311][123091] Updated weights for policy 0, policy_version 862010 (0.0007) [2023-12-26 06:28:16,330][123090] Updated weights for policy 1, policy_version 855842 (0.0009) [2023-12-26 06:28:16,374][123091] Updated weights for policy 0, policy_version 862020 (0.0011) [2023-12-26 06:28:16,389][123090] Updated weights for policy 1, policy_version 855852 (0.0005) [2023-12-26 06:28:16,437][123091] Updated weights for policy 0, policy_version 862030 (0.0011) [2023-12-26 06:28:16,454][123090] Updated weights for policy 1, policy_version 855862 (0.0006) [2023-12-26 06:28:16,524][123090] Updated weights for policy 1, policy_version 855872 (0.0010) [2023-12-26 06:28:17,007][123091] Updated weights for policy 0, policy_version 862040 (0.0010) [2023-12-26 06:28:17,070][123091] Updated weights for policy 0, policy_version 862050 (0.0011) [2023-12-26 06:28:17,122][123091] Updated weights for policy 0, policy_version 862060 (0.0011) [2023-12-26 06:28:17,430][123090] Updated weights for policy 1, policy_version 855882 (0.0005) [2023-12-26 06:28:17,498][123090] Updated weights for policy 1, policy_version 855892 (0.0008) [2023-12-26 06:28:17,563][123090] Updated weights for policy 1, policy_version 855902 (0.0009) [2023-12-26 06:28:17,819][123091] Updated weights for policy 0, policy_version 862070 (0.0010) [2023-12-26 06:28:17,875][123091] Updated weights for policy 0, policy_version 862080 (0.0009) [2023-12-26 06:28:17,938][123091] Updated weights for policy 0, policy_version 862090 (0.0007) [2023-12-26 06:28:18,217][123090] Updated weights for policy 1, policy_version 855912 (0.0005) [2023-12-26 06:28:18,288][123090] Updated weights for policy 1, policy_version 855922 (0.0005) [2023-12-26 06:28:18,362][123090] Updated weights for policy 1, policy_version 855932 (0.0007) [2023-12-26 06:28:18,770][123091] Updated weights for policy 0, policy_version 862100 (0.0007) [2023-12-26 06:28:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 439820288. Throughput: 0: 8948.5, 1: 8928.1. Samples: 439834580. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:18,785][121949] Avg episode reward: [(0, '6144.316'), (1, '5696.102')] [2023-12-26 06:28:18,830][123091] Updated weights for policy 0, policy_version 862110 (0.0011) [2023-12-26 06:28:18,902][123091] Updated weights for policy 0, policy_version 862120 (0.0011) [2023-12-26 06:28:19,013][123090] Updated weights for policy 1, policy_version 855942 (0.0009) [2023-12-26 06:28:19,080][123090] Updated weights for policy 1, policy_version 855952 (0.0010) [2023-12-26 06:28:19,142][123090] Updated weights for policy 1, policy_version 855962 (0.0010) [2023-12-26 06:28:19,782][123091] Updated weights for policy 0, policy_version 862130 (0.0010) [2023-12-26 06:28:19,854][123091] Updated weights for policy 0, policy_version 862140 (0.0009) [2023-12-26 06:28:19,915][123091] Updated weights for policy 0, policy_version 862150 (0.0009) [2023-12-26 06:28:19,984][123090] Updated weights for policy 1, policy_version 855972 (0.0010) [2023-12-26 06:28:19,993][123091] Updated weights for policy 0, policy_version 862160 (0.0009) [2023-12-26 06:28:20,054][123090] Updated weights for policy 1, policy_version 855982 (0.0009) [2023-12-26 06:28:20,120][123090] Updated weights for policy 1, policy_version 855992 (0.0009) [2023-12-26 06:28:20,867][123090] Updated weights for policy 1, policy_version 856002 (0.0009) [2023-12-26 06:28:20,917][123091] Updated weights for policy 0, policy_version 862170 (0.0010) [2023-12-26 06:28:20,934][123090] Updated weights for policy 1, policy_version 856012 (0.0011) [2023-12-26 06:28:20,978][123091] Updated weights for policy 0, policy_version 862180 (0.0011) [2023-12-26 06:28:20,991][123090] Updated weights for policy 1, policy_version 856022 (0.0011) [2023-12-26 06:28:21,044][123091] Updated weights for policy 0, policy_version 862190 (0.0010) [2023-12-26 06:28:21,055][123090] Updated weights for policy 1, policy_version 856032 (0.0011) [2023-12-26 06:28:21,871][123090] Updated weights for policy 1, policy_version 856042 (0.0008) [2023-12-26 06:28:21,876][123091] Updated weights for policy 0, policy_version 862200 (0.0010) [2023-12-26 06:28:21,924][123091] Updated weights for policy 0, policy_version 862210 (0.0011) [2023-12-26 06:28:21,936][123090] Updated weights for policy 1, policy_version 856052 (0.0007) [2023-12-26 06:28:21,969][123091] Updated weights for policy 0, policy_version 862220 (0.0010) [2023-12-26 06:28:21,996][123090] Updated weights for policy 1, policy_version 856062 (0.0008) [2023-12-26 06:28:22,800][123090] Updated weights for policy 1, policy_version 856072 (0.0009) [2023-12-26 06:28:22,847][123091] Updated weights for policy 0, policy_version 862230 (0.0008) [2023-12-26 06:28:22,850][123090] Updated weights for policy 1, policy_version 856082 (0.0009) [2023-12-26 06:28:22,906][123090] Updated weights for policy 1, policy_version 856092 (0.0006) [2023-12-26 06:28:22,912][123091] Updated weights for policy 0, policy_version 862240 (0.0009) [2023-12-26 06:28:22,974][123091] Updated weights for policy 0, policy_version 862250 (0.0008) [2023-12-26 06:28:23,718][123091] Updated weights for policy 0, policy_version 862260 (0.0006) [2023-12-26 06:28:23,734][123090] Updated weights for policy 1, policy_version 856102 (0.0006) [2023-12-26 06:28:23,778][123091] Updated weights for policy 0, policy_version 862270 (0.0006) [2023-12-26 06:28:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 439902208. Throughput: 0: 8878.2, 1: 8847.5. Samples: 439885120. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:23,785][121949] Avg episode reward: [(0, '6081.433'), (1, '5540.181')] [2023-12-26 06:28:23,804][123090] Updated weights for policy 1, policy_version 856112 (0.0006) [2023-12-26 06:28:23,839][123091] Updated weights for policy 0, policy_version 862280 (0.0008) [2023-12-26 06:28:23,865][123090] Updated weights for policy 1, policy_version 856122 (0.0011) [2023-12-26 06:28:23,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000862288_220749824.pth... [2023-12-26 06:28:23,897][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000861200_220471296.pth [2023-12-26 06:28:23,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000856128_219168768.pth... [2023-12-26 06:28:23,902][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000855104_218906624.pth [2023-12-26 06:28:24,606][123091] Updated weights for policy 0, policy_version 862290 (0.0008) [2023-12-26 06:28:24,608][123090] Updated weights for policy 1, policy_version 856132 (0.0009) [2023-12-26 06:28:24,665][123090] Updated weights for policy 1, policy_version 856142 (0.0007) [2023-12-26 06:28:24,669][123091] Updated weights for policy 0, policy_version 862300 (0.0008) [2023-12-26 06:28:24,719][123090] Updated weights for policy 1, policy_version 856152 (0.0005) [2023-12-26 06:28:24,729][123091] Updated weights for policy 0, policy_version 862310 (0.0008) [2023-12-26 06:28:24,791][123091] Updated weights for policy 0, policy_version 862320 (0.0009) [2023-12-26 06:28:25,482][123090] Updated weights for policy 1, policy_version 856162 (0.0008) [2023-12-26 06:28:25,519][123091] Updated weights for policy 0, policy_version 862330 (0.0007) [2023-12-26 06:28:25,537][123090] Updated weights for policy 1, policy_version 856172 (0.0010) [2023-12-26 06:28:25,574][123091] Updated weights for policy 0, policy_version 862340 (0.0008) [2023-12-26 06:28:25,596][123090] Updated weights for policy 1, policy_version 856182 (0.0010) [2023-12-26 06:28:25,630][123091] Updated weights for policy 0, policy_version 862350 (0.0010) [2023-12-26 06:28:25,650][123090] Updated weights for policy 1, policy_version 856192 (0.0010) [2023-12-26 06:28:26,409][123090] Updated weights for policy 1, policy_version 856202 (0.0010) [2023-12-26 06:28:26,476][123090] Updated weights for policy 1, policy_version 856212 (0.0010) [2023-12-26 06:28:26,483][123091] Updated weights for policy 0, policy_version 862360 (0.0006) [2023-12-26 06:28:26,529][123091] Updated weights for policy 0, policy_version 862370 (0.0005) [2023-12-26 06:28:26,539][123090] Updated weights for policy 1, policy_version 856222 (0.0010) [2023-12-26 06:28:26,577][123091] Updated weights for policy 0, policy_version 862380 (0.0007) [2023-12-26 06:28:27,324][123090] Updated weights for policy 1, policy_version 856232 (0.0011) [2023-12-26 06:28:27,359][123091] Updated weights for policy 0, policy_version 862390 (0.0007) [2023-12-26 06:28:27,380][123090] Updated weights for policy 1, policy_version 856242 (0.0010) [2023-12-26 06:28:27,417][123091] Updated weights for policy 0, policy_version 862400 (0.0005) [2023-12-26 06:28:27,427][123090] Updated weights for policy 1, policy_version 856252 (0.0010) [2023-12-26 06:28:27,469][123091] Updated weights for policy 0, policy_version 862410 (0.0007) [2023-12-26 06:28:28,252][123091] Updated weights for policy 0, policy_version 862420 (0.0008) [2023-12-26 06:28:28,259][123090] Updated weights for policy 1, policy_version 856262 (0.0010) [2023-12-26 06:28:28,300][123091] Updated weights for policy 0, policy_version 862430 (0.0006) [2023-12-26 06:28:28,320][123090] Updated weights for policy 1, policy_version 856272 (0.0010) [2023-12-26 06:28:28,356][123091] Updated weights for policy 0, policy_version 862440 (0.0008) [2023-12-26 06:28:28,382][123090] Updated weights for policy 1, policy_version 856282 (0.0007) [2023-12-26 06:28:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 440000512. Throughput: 0: 8951.1, 1: 8858.9. Samples: 439992148. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:28,785][121949] Avg episode reward: [(0, '6120.821'), (1, '5525.548')] [2023-12-26 06:28:29,200][123091] Updated weights for policy 0, policy_version 862450 (0.0008) [2023-12-26 06:28:29,220][123090] Updated weights for policy 1, policy_version 856292 (0.0009) [2023-12-26 06:28:29,269][123091] Updated weights for policy 0, policy_version 862460 (0.0010) [2023-12-26 06:28:29,289][123090] Updated weights for policy 1, policy_version 856302 (0.0008) [2023-12-26 06:28:29,336][123091] Updated weights for policy 0, policy_version 862470 (0.0009) [2023-12-26 06:28:29,363][123090] Updated weights for policy 1, policy_version 856312 (0.0007) [2023-12-26 06:28:29,398][123091] Updated weights for policy 0, policy_version 862480 (0.0008) [2023-12-26 06:28:30,158][123090] Updated weights for policy 1, policy_version 856322 (0.0008) [2023-12-26 06:28:30,176][123091] Updated weights for policy 0, policy_version 862490 (0.0009) [2023-12-26 06:28:30,217][123090] Updated weights for policy 1, policy_version 856332 (0.0006) [2023-12-26 06:28:30,228][123091] Updated weights for policy 0, policy_version 862500 (0.0011) [2023-12-26 06:28:30,276][123091] Updated weights for policy 0, policy_version 862510 (0.0010) [2023-12-26 06:28:30,277][123090] Updated weights for policy 1, policy_version 856342 (0.0006) [2023-12-26 06:28:30,332][123090] Updated weights for policy 1, policy_version 856352 (0.0009) [2023-12-26 06:28:31,009][123091] Updated weights for policy 0, policy_version 862520 (0.0009) [2023-12-26 06:28:31,086][123091] Updated weights for policy 0, policy_version 862530 (0.0008) [2023-12-26 06:28:31,138][123090] Updated weights for policy 1, policy_version 856362 (0.0008) [2023-12-26 06:28:31,154][123091] Updated weights for policy 0, policy_version 862540 (0.0009) [2023-12-26 06:28:31,195][123090] Updated weights for policy 1, policy_version 856372 (0.0009) [2023-12-26 06:28:31,258][123090] Updated weights for policy 1, policy_version 856382 (0.0009) [2023-12-26 06:28:31,939][123091] Updated weights for policy 0, policy_version 862550 (0.0009) [2023-12-26 06:28:31,998][123091] Updated weights for policy 0, policy_version 862560 (0.0011) [2023-12-26 06:28:32,045][123091] Updated weights for policy 0, policy_version 862570 (0.0010) [2023-12-26 06:28:32,123][123090] Updated weights for policy 1, policy_version 856392 (0.0008) [2023-12-26 06:28:32,178][123090] Updated weights for policy 1, policy_version 856402 (0.0008) [2023-12-26 06:28:32,230][123090] Updated weights for policy 1, policy_version 856412 (0.0010) [2023-12-26 06:28:32,886][123091] Updated weights for policy 0, policy_version 862580 (0.0011) [2023-12-26 06:28:32,952][123091] Updated weights for policy 0, policy_version 862590 (0.0011) [2023-12-26 06:28:32,987][123090] Updated weights for policy 1, policy_version 856422 (0.0009) [2023-12-26 06:28:33,019][123091] Updated weights for policy 0, policy_version 862600 (0.0011) [2023-12-26 06:28:33,040][123090] Updated weights for policy 1, policy_version 856432 (0.0008) [2023-12-26 06:28:33,091][123090] Updated weights for policy 1, policy_version 856442 (0.0009) [2023-12-26 06:28:33,653][123091] Updated weights for policy 0, policy_version 862610 (0.0009) [2023-12-26 06:28:33,731][123091] Updated weights for policy 0, policy_version 862620 (0.0005) [2023-12-26 06:28:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 440082432. Throughput: 0: 9000.3, 1: 8784.7. Samples: 440099348. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:33,785][121949] Avg episode reward: [(0, '6143.337'), (1, '5624.500')] [2023-12-26 06:28:33,804][123091] Updated weights for policy 0, policy_version 862630 (0.0007) [2023-12-26 06:28:33,867][123091] Updated weights for policy 0, policy_version 862640 (0.0011) [2023-12-26 06:28:34,011][123090] Updated weights for policy 1, policy_version 856452 (0.0009) [2023-12-26 06:28:34,078][123090] Updated weights for policy 1, policy_version 856462 (0.0008) [2023-12-26 06:28:34,139][123090] Updated weights for policy 1, policy_version 856472 (0.0008) [2023-12-26 06:28:34,641][123091] Updated weights for policy 0, policy_version 862650 (0.0006) [2023-12-26 06:28:34,700][123091] Updated weights for policy 0, policy_version 862660 (0.0006) [2023-12-26 06:28:34,761][123091] Updated weights for policy 0, policy_version 862670 (0.0006) [2023-12-26 06:28:34,920][123090] Updated weights for policy 1, policy_version 856482 (0.0009) [2023-12-26 06:28:34,984][123090] Updated weights for policy 1, policy_version 856492 (0.0006) [2023-12-26 06:28:35,042][123090] Updated weights for policy 1, policy_version 856502 (0.0007) [2023-12-26 06:28:35,098][123090] Updated weights for policy 1, policy_version 856512 (0.0005) [2023-12-26 06:28:35,558][123091] Updated weights for policy 0, policy_version 862680 (0.0010) [2023-12-26 06:28:35,617][123091] Updated weights for policy 0, policy_version 862690 (0.0010) [2023-12-26 06:28:35,672][123091] Updated weights for policy 0, policy_version 862700 (0.0009) [2023-12-26 06:28:35,763][123090] Updated weights for policy 1, policy_version 856522 (0.0005) [2023-12-26 06:28:35,826][123090] Updated weights for policy 1, policy_version 856532 (0.0009) [2023-12-26 06:28:35,880][123090] Updated weights for policy 1, policy_version 856542 (0.0009) [2023-12-26 06:28:36,435][123091] Updated weights for policy 0, policy_version 862710 (0.0007) [2023-12-26 06:28:36,503][123091] Updated weights for policy 0, policy_version 862720 (0.0009) [2023-12-26 06:28:36,580][123091] Updated weights for policy 0, policy_version 862730 (0.0006) [2023-12-26 06:28:36,739][123090] Updated weights for policy 1, policy_version 856552 (0.0010) [2023-12-26 06:28:36,801][123090] Updated weights for policy 1, policy_version 856562 (0.0010) [2023-12-26 06:28:36,855][123090] Updated weights for policy 1, policy_version 856572 (0.0009) [2023-12-26 06:28:37,263][123091] Updated weights for policy 0, policy_version 862740 (0.0010) [2023-12-26 06:28:37,311][123091] Updated weights for policy 0, policy_version 862750 (0.0010) [2023-12-26 06:28:37,376][123091] Updated weights for policy 0, policy_version 862760 (0.0010) [2023-12-26 06:28:37,681][123090] Updated weights for policy 1, policy_version 856582 (0.0006) [2023-12-26 06:28:37,733][123090] Updated weights for policy 1, policy_version 856592 (0.0011) [2023-12-26 06:28:37,782][123090] Updated weights for policy 1, policy_version 856602 (0.0010) [2023-12-26 06:28:38,037][123091] Updated weights for policy 0, policy_version 862770 (0.0006) [2023-12-26 06:28:38,110][123091] Updated weights for policy 0, policy_version 862780 (0.0006) [2023-12-26 06:28:38,179][123091] Updated weights for policy 0, policy_version 862790 (0.0006) [2023-12-26 06:28:38,246][123091] Updated weights for policy 0, policy_version 862800 (0.0006) [2023-12-26 06:28:38,558][123090] Updated weights for policy 1, policy_version 856612 (0.0008) [2023-12-26 06:28:38,630][123090] Updated weights for policy 1, policy_version 856622 (0.0006) [2023-12-26 06:28:38,698][123090] Updated weights for policy 1, policy_version 856632 (0.0006) [2023-12-26 06:28:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 440180736. Throughput: 0: 9028.2, 1: 8783.3. Samples: 440153544. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:38,785][121949] Avg episode reward: [(0, '6174.103'), (1, '5679.844')] [2023-12-26 06:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000862800_220880896.pth... [2023-12-26 06:28:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000856640_219299840.pth... [2023-12-26 06:28:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000855616_219037696.pth [2023-12-26 06:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000861744_220610560.pth [2023-12-26 06:28:39,001][123091] Updated weights for policy 0, policy_version 862810 (0.0011) [2023-12-26 06:28:39,069][123091] Updated weights for policy 0, policy_version 862820 (0.0011) [2023-12-26 06:28:39,132][123091] Updated weights for policy 0, policy_version 862830 (0.0011) [2023-12-26 06:28:39,455][123090] Updated weights for policy 1, policy_version 856642 (0.0007) [2023-12-26 06:28:39,527][123090] Updated weights for policy 1, policy_version 856652 (0.0011) [2023-12-26 06:28:39,596][123090] Updated weights for policy 1, policy_version 856662 (0.0010) [2023-12-26 06:28:39,667][123090] Updated weights for policy 1, policy_version 856672 (0.0010) [2023-12-26 06:28:39,915][123091] Updated weights for policy 0, policy_version 862840 (0.0011) [2023-12-26 06:28:39,979][123091] Updated weights for policy 0, policy_version 862850 (0.0006) [2023-12-26 06:28:40,041][123091] Updated weights for policy 0, policy_version 862860 (0.0009) [2023-12-26 06:28:40,523][123090] Updated weights for policy 1, policy_version 856682 (0.0009) [2023-12-26 06:28:40,572][123090] Updated weights for policy 1, policy_version 856692 (0.0005) [2023-12-26 06:28:40,627][123090] Updated weights for policy 1, policy_version 856702 (0.0006) [2023-12-26 06:28:40,878][123091] Updated weights for policy 0, policy_version 862870 (0.0010) [2023-12-26 06:28:40,948][123091] Updated weights for policy 0, policy_version 862880 (0.0005) [2023-12-26 06:28:41,012][123091] Updated weights for policy 0, policy_version 862890 (0.0006) [2023-12-26 06:28:41,516][123090] Updated weights for policy 1, policy_version 856712 (0.0009) [2023-12-26 06:28:41,576][123090] Updated weights for policy 1, policy_version 856722 (0.0008) [2023-12-26 06:28:41,657][123090] Updated weights for policy 1, policy_version 856732 (0.0008) [2023-12-26 06:28:41,748][123091] Updated weights for policy 0, policy_version 862900 (0.0008) [2023-12-26 06:28:41,816][123091] Updated weights for policy 0, policy_version 862910 (0.0009) [2023-12-26 06:28:41,883][123091] Updated weights for policy 0, policy_version 862920 (0.0010) [2023-12-26 06:28:42,478][123090] Updated weights for policy 1, policy_version 856742 (0.0009) [2023-12-26 06:28:42,537][123090] Updated weights for policy 1, policy_version 856752 (0.0010) [2023-12-26 06:28:42,593][123090] Updated weights for policy 1, policy_version 856762 (0.0008) [2023-12-26 06:28:42,608][123091] Updated weights for policy 0, policy_version 862930 (0.0007) [2023-12-26 06:28:42,682][123091] Updated weights for policy 0, policy_version 862940 (0.0005) [2023-12-26 06:28:42,754][123091] Updated weights for policy 0, policy_version 862950 (0.0008) [2023-12-26 06:28:42,814][123091] Updated weights for policy 0, policy_version 862960 (0.0011) [2023-12-26 06:28:43,474][123090] Updated weights for policy 1, policy_version 856772 (0.0009) [2023-12-26 06:28:43,530][123090] Updated weights for policy 1, policy_version 856782 (0.0009) [2023-12-26 06:28:43,578][123090] Updated weights for policy 1, policy_version 856792 (0.0007) [2023-12-26 06:28:43,583][123091] Updated weights for policy 0, policy_version 862970 (0.0011) [2023-12-26 06:28:43,645][123091] Updated weights for policy 0, policy_version 862980 (0.0010) [2023-12-26 06:28:43,714][123091] Updated weights for policy 0, policy_version 862990 (0.0010) [2023-12-26 06:28:43,785][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.7, 300 sec: 17772.5). Total num frames: 440270848. Throughput: 0: 9081.4, 1: 8719.3. Samples: 440259452. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:43,786][121949] Avg episode reward: [(0, '6291.054'), (1, '5571.618')] [2023-12-26 06:28:44,403][123090] Updated weights for policy 1, policy_version 856802 (0.0008) [2023-12-26 06:28:44,471][123090] Updated weights for policy 1, policy_version 856812 (0.0005) [2023-12-26 06:28:44,519][123091] Updated weights for policy 0, policy_version 863000 (0.0010) [2023-12-26 06:28:44,535][123090] Updated weights for policy 1, policy_version 856822 (0.0007) [2023-12-26 06:28:44,574][123091] Updated weights for policy 0, policy_version 863010 (0.0010) [2023-12-26 06:28:44,594][123090] Updated weights for policy 1, policy_version 856832 (0.0006) [2023-12-26 06:28:44,617][123091] Updated weights for policy 0, policy_version 863020 (0.0010) [2023-12-26 06:28:45,367][123090] Updated weights for policy 1, policy_version 856842 (0.0008) [2023-12-26 06:28:45,428][123090] Updated weights for policy 1, policy_version 856852 (0.0005) [2023-12-26 06:28:45,466][123091] Updated weights for policy 0, policy_version 863030 (0.0010) [2023-12-26 06:28:45,491][123090] Updated weights for policy 1, policy_version 856862 (0.0007) [2023-12-26 06:28:45,522][123091] Updated weights for policy 0, policy_version 863040 (0.0011) [2023-12-26 06:28:45,584][123091] Updated weights for policy 0, policy_version 863050 (0.0010) [2023-12-26 06:28:46,293][123090] Updated weights for policy 1, policy_version 856872 (0.0008) [2023-12-26 06:28:46,345][123090] Updated weights for policy 1, policy_version 856882 (0.0008) [2023-12-26 06:28:46,393][123090] Updated weights for policy 1, policy_version 856892 (0.0008) [2023-12-26 06:28:46,418][123091] Updated weights for policy 0, policy_version 863060 (0.0010) [2023-12-26 06:28:46,481][123091] Updated weights for policy 0, policy_version 863070 (0.0010) [2023-12-26 06:28:46,548][123091] Updated weights for policy 0, policy_version 863080 (0.0011) [2023-12-26 06:28:47,243][123090] Updated weights for policy 1, policy_version 856902 (0.0009) [2023-12-26 06:28:47,298][123090] Updated weights for policy 1, policy_version 856912 (0.0009) [2023-12-26 06:28:47,358][123090] Updated weights for policy 1, policy_version 856922 (0.0009) [2023-12-26 06:28:47,360][123091] Updated weights for policy 0, policy_version 863090 (0.0010) [2023-12-26 06:28:47,419][123091] Updated weights for policy 0, policy_version 863100 (0.0010) [2023-12-26 06:28:47,482][123091] Updated weights for policy 0, policy_version 863110 (0.0010) [2023-12-26 06:28:47,544][123091] Updated weights for policy 0, policy_version 863120 (0.0010) [2023-12-26 06:28:48,222][123091] Updated weights for policy 0, policy_version 863130 (0.0007) [2023-12-26 06:28:48,230][123090] Updated weights for policy 1, policy_version 856932 (0.0006) [2023-12-26 06:28:48,279][123090] Updated weights for policy 1, policy_version 856942 (0.0006) [2023-12-26 06:28:48,294][123091] Updated weights for policy 0, policy_version 863140 (0.0009) [2023-12-26 06:28:48,342][123090] Updated weights for policy 1, policy_version 856952 (0.0006) [2023-12-26 06:28:48,364][123091] Updated weights for policy 0, policy_version 863150 (0.0008) [2023-12-26 06:28:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 440352768. Throughput: 0: 9077.2, 1: 8746.8. Samples: 440364144. Policy #0 lag: (min: 11.0, avg: 13.7, max: 43.0) [2023-12-26 06:28:48,785][121949] Avg episode reward: [(0, '6136.551'), (1, '5601.650')] [2023-12-26 06:28:49,032][123090] Updated weights for policy 1, policy_version 856962 (0.0009) [2023-12-26 06:28:49,094][123090] Updated weights for policy 1, policy_version 856972 (0.0005) [2023-12-26 06:28:49,163][123090] Updated weights for policy 1, policy_version 856982 (0.0007) [2023-12-26 06:28:49,179][123091] Updated weights for policy 0, policy_version 863160 (0.0007) [2023-12-26 06:28:49,233][123090] Updated weights for policy 1, policy_version 856992 (0.0013) [2023-12-26 06:28:49,245][123091] Updated weights for policy 0, policy_version 863170 (0.0009) [2023-12-26 06:28:49,315][123091] Updated weights for policy 0, policy_version 863180 (0.0011) [2023-12-26 06:28:49,982][123090] Updated weights for policy 1, policy_version 857002 (0.0008) [2023-12-26 06:28:50,044][123090] Updated weights for policy 1, policy_version 857012 (0.0011) [2023-12-26 06:28:50,101][123090] Updated weights for policy 1, policy_version 857022 (0.0010) [2023-12-26 06:28:50,137][123091] Updated weights for policy 0, policy_version 863190 (0.0011) [2023-12-26 06:28:50,192][123091] Updated weights for policy 0, policy_version 863200 (0.0011) [2023-12-26 06:28:50,259][123091] Updated weights for policy 0, policy_version 863210 (0.0011) [2023-12-26 06:28:50,772][123090] Updated weights for policy 1, policy_version 857032 (0.0007) [2023-12-26 06:28:50,837][123090] Updated weights for policy 1, policy_version 857042 (0.0008) [2023-12-26 06:28:50,907][123090] Updated weights for policy 1, policy_version 857052 (0.0008) [2023-12-26 06:28:51,035][123091] Updated weights for policy 0, policy_version 863220 (0.0010) [2023-12-26 06:28:51,110][123091] Updated weights for policy 0, policy_version 863230 (0.0010) [2023-12-26 06:28:51,174][123091] Updated weights for policy 0, policy_version 863240 (0.0011) [2023-12-26 06:28:51,697][123090] Updated weights for policy 1, policy_version 857062 (0.0011) [2023-12-26 06:28:51,770][123090] Updated weights for policy 1, policy_version 857072 (0.0009) [2023-12-26 06:28:51,838][123090] Updated weights for policy 1, policy_version 857082 (0.0009) [2023-12-26 06:28:52,006][123091] Updated weights for policy 0, policy_version 863250 (0.0010) [2023-12-26 06:28:52,082][123091] Updated weights for policy 0, policy_version 863260 (0.0006) [2023-12-26 06:28:52,151][123091] Updated weights for policy 0, policy_version 863270 (0.0006) [2023-12-26 06:28:52,224][123091] Updated weights for policy 0, policy_version 863280 (0.0005) [2023-12-26 06:28:52,698][123090] Updated weights for policy 1, policy_version 857092 (0.0008) [2023-12-26 06:28:52,765][123090] Updated weights for policy 1, policy_version 857102 (0.0011) [2023-12-26 06:28:52,833][123090] Updated weights for policy 1, policy_version 857112 (0.0011) [2023-12-26 06:28:52,959][123091] Updated weights for policy 0, policy_version 863290 (0.0009) [2023-12-26 06:28:53,020][123091] Updated weights for policy 0, policy_version 863300 (0.0009) [2023-12-26 06:28:53,080][123091] Updated weights for policy 0, policy_version 863310 (0.0009) [2023-12-26 06:28:53,662][123090] Updated weights for policy 1, policy_version 857122 (0.0011) [2023-12-26 06:28:53,713][123090] Updated weights for policy 1, policy_version 857132 (0.0010) [2023-12-26 06:28:53,757][123090] Updated weights for policy 1, policy_version 857142 (0.0010) [2023-12-26 06:28:53,784][121949] Fps is (10 sec: 16384.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 440434688. Throughput: 0: 9002.0, 1: 8761.2. Samples: 440417688. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:28:53,785][121949] Avg episode reward: [(0, '6133.631'), (1, '5750.511')] [2023-12-26 06:28:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000863312_221011968.pth... [2023-12-26 06:28:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000862288_220749824.pth [2023-12-26 06:28:53,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000857152_219430912.pth... [2023-12-26 06:28:53,812][123090] Updated weights for policy 1, policy_version 857152 (0.0010) [2023-12-26 06:28:53,817][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000856128_219168768.pth [2023-12-26 06:28:53,901][123091] Updated weights for policy 0, policy_version 863320 (0.0007) [2023-12-26 06:28:53,955][123091] Updated weights for policy 0, policy_version 863330 (0.0005) [2023-12-26 06:28:54,017][123091] Updated weights for policy 0, policy_version 863340 (0.0010) [2023-12-26 06:28:54,565][123090] Updated weights for policy 1, policy_version 857162 (0.0009) [2023-12-26 06:28:54,627][123090] Updated weights for policy 1, policy_version 857172 (0.0010) [2023-12-26 06:28:54,685][123090] Updated weights for policy 1, policy_version 857182 (0.0010) [2023-12-26 06:28:54,849][123091] Updated weights for policy 0, policy_version 863350 (0.0007) [2023-12-26 06:28:54,907][123091] Updated weights for policy 0, policy_version 863360 (0.0006) [2023-12-26 06:28:54,973][123091] Updated weights for policy 0, policy_version 863370 (0.0006) [2023-12-26 06:28:55,503][123090] Updated weights for policy 1, policy_version 857192 (0.0007) [2023-12-26 06:28:55,561][123090] Updated weights for policy 1, policy_version 857202 (0.0008) [2023-12-26 06:28:55,613][123090] Updated weights for policy 1, policy_version 857212 (0.0009) [2023-12-26 06:28:55,765][123091] Updated weights for policy 0, policy_version 863380 (0.0008) [2023-12-26 06:28:55,822][123091] Updated weights for policy 0, policy_version 863390 (0.0008) [2023-12-26 06:28:55,876][123091] Updated weights for policy 0, policy_version 863400 (0.0009) [2023-12-26 06:28:56,323][123090] Updated weights for policy 1, policy_version 857222 (0.0009) [2023-12-26 06:28:56,373][123090] Updated weights for policy 1, policy_version 857232 (0.0009) [2023-12-26 06:28:56,427][123090] Updated weights for policy 1, policy_version 857242 (0.0009) [2023-12-26 06:28:56,636][123091] Updated weights for policy 0, policy_version 863410 (0.0008) [2023-12-26 06:28:56,702][123091] Updated weights for policy 0, policy_version 863420 (0.0010) [2023-12-26 06:28:56,763][123091] Updated weights for policy 0, policy_version 863431 (0.0009) [2023-12-26 06:28:57,104][123090] Updated weights for policy 1, policy_version 857252 (0.0008) [2023-12-26 06:28:57,162][123090] Updated weights for policy 1, policy_version 857262 (0.0005) [2023-12-26 06:28:57,223][123090] Updated weights for policy 1, policy_version 857272 (0.0006) [2023-12-26 06:28:57,644][123091] Updated weights for policy 0, policy_version 863441 (0.0009) [2023-12-26 06:28:57,702][123091] Updated weights for policy 0, policy_version 863451 (0.0009) [2023-12-26 06:28:57,760][123091] Updated weights for policy 0, policy_version 863461 (0.0009) [2023-12-26 06:28:57,808][123091] Updated weights for policy 0, policy_version 863471 (0.0008) [2023-12-26 06:28:57,968][123090] Updated weights for policy 1, policy_version 857282 (0.0009) [2023-12-26 06:28:58,039][123090] Updated weights for policy 1, policy_version 857292 (0.0010) [2023-12-26 06:28:58,107][123090] Updated weights for policy 1, policy_version 857302 (0.0011) [2023-12-26 06:28:58,174][123090] Updated weights for policy 1, policy_version 857312 (0.0006) [2023-12-26 06:28:58,682][123091] Updated weights for policy 0, policy_version 863481 (0.0009) [2023-12-26 06:28:58,753][123091] Updated weights for policy 0, policy_version 863491 (0.0008) [2023-12-26 06:28:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 440524800. Throughput: 0: 8992.1, 1: 8807.3. Samples: 440525092. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:28:58,785][121949] Avg episode reward: [(0, '6261.432'), (1, '5752.932')] [2023-12-26 06:28:58,828][123091] Updated weights for policy 0, policy_version 863501 (0.0008) [2023-12-26 06:28:59,167][123090] Updated weights for policy 1, policy_version 857322 (0.0010) [2023-12-26 06:28:59,242][123090] Updated weights for policy 1, policy_version 857332 (0.0009) [2023-12-26 06:28:59,313][123090] Updated weights for policy 1, policy_version 857342 (0.0008) [2023-12-26 06:28:59,718][123091] Updated weights for policy 0, policy_version 863511 (0.0008) [2023-12-26 06:28:59,775][123091] Updated weights for policy 0, policy_version 863521 (0.0007) [2023-12-26 06:28:59,845][123091] Updated weights for policy 0, policy_version 863531 (0.0007) [2023-12-26 06:29:00,107][123090] Updated weights for policy 1, policy_version 857352 (0.0007) [2023-12-26 06:29:00,179][123090] Updated weights for policy 1, policy_version 857362 (0.0006) [2023-12-26 06:29:00,243][123090] Updated weights for policy 1, policy_version 857372 (0.0006) [2023-12-26 06:29:00,614][123091] Updated weights for policy 0, policy_version 863541 (0.0006) [2023-12-26 06:29:00,677][123091] Updated weights for policy 0, policy_version 863551 (0.0006) [2023-12-26 06:29:00,746][123091] Updated weights for policy 0, policy_version 863561 (0.0006) [2023-12-26 06:29:00,940][123090] Updated weights for policy 1, policy_version 857382 (0.0005) [2023-12-26 06:29:01,002][123090] Updated weights for policy 1, policy_version 857392 (0.0007) [2023-12-26 06:29:01,065][123090] Updated weights for policy 1, policy_version 857402 (0.0007) [2023-12-26 06:29:01,482][123091] Updated weights for policy 0, policy_version 863571 (0.0007) [2023-12-26 06:29:01,536][123091] Updated weights for policy 0, policy_version 863581 (0.0010) [2023-12-26 06:29:01,598][123091] Updated weights for policy 0, policy_version 863591 (0.0010) [2023-12-26 06:29:01,884][123090] Updated weights for policy 1, policy_version 857412 (0.0008) [2023-12-26 06:29:01,939][123090] Updated weights for policy 1, policy_version 857422 (0.0008) [2023-12-26 06:29:01,988][123090] Updated weights for policy 1, policy_version 857432 (0.0009) [2023-12-26 06:29:02,423][123091] Updated weights for policy 0, policy_version 863601 (0.0010) [2023-12-26 06:29:02,485][123091] Updated weights for policy 0, policy_version 863611 (0.0010) [2023-12-26 06:29:02,547][123091] Updated weights for policy 0, policy_version 863621 (0.0010) [2023-12-26 06:29:02,609][123091] Updated weights for policy 0, policy_version 863631 (0.0010) [2023-12-26 06:29:02,853][123090] Updated weights for policy 1, policy_version 857442 (0.0009) [2023-12-26 06:29:02,908][123090] Updated weights for policy 1, policy_version 857452 (0.0009) [2023-12-26 06:29:02,956][123090] Updated weights for policy 1, policy_version 857462 (0.0009) [2023-12-26 06:29:03,008][123090] Updated weights for policy 1, policy_version 857472 (0.0008) [2023-12-26 06:29:03,423][123091] Updated weights for policy 0, policy_version 863641 (0.0010) [2023-12-26 06:29:03,484][123091] Updated weights for policy 0, policy_version 863651 (0.0010) [2023-12-26 06:29:03,541][123091] Updated weights for policy 0, policy_version 863661 (0.0010) [2023-12-26 06:29:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 440614912. Throughput: 0: 8831.3, 1: 8775.3. Samples: 440626876. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:03,785][121949] Avg episode reward: [(0, '6338.811'), (1, '5594.292')] [2023-12-26 06:29:03,881][123090] Updated weights for policy 1, policy_version 857482 (0.0008) [2023-12-26 06:29:03,938][123090] Updated weights for policy 1, policy_version 857492 (0.0009) [2023-12-26 06:29:03,991][123090] Updated weights for policy 1, policy_version 857502 (0.0008) [2023-12-26 06:29:04,355][123091] Updated weights for policy 0, policy_version 863671 (0.0010) [2023-12-26 06:29:04,412][123091] Updated weights for policy 0, policy_version 863681 (0.0011) [2023-12-26 06:29:04,464][123091] Updated weights for policy 0, policy_version 863691 (0.0011) [2023-12-26 06:29:04,836][123090] Updated weights for policy 1, policy_version 857512 (0.0009) [2023-12-26 06:29:04,886][123090] Updated weights for policy 1, policy_version 857522 (0.0008) [2023-12-26 06:29:04,942][123090] Updated weights for policy 1, policy_version 857532 (0.0009) [2023-12-26 06:29:05,298][123091] Updated weights for policy 0, policy_version 863701 (0.0011) [2023-12-26 06:29:05,362][123091] Updated weights for policy 0, policy_version 863711 (0.0010) [2023-12-26 06:29:05,421][123091] Updated weights for policy 0, policy_version 863721 (0.0011) [2023-12-26 06:29:05,823][123090] Updated weights for policy 1, policy_version 857542 (0.0008) [2023-12-26 06:29:05,871][123090] Updated weights for policy 1, policy_version 857552 (0.0008) [2023-12-26 06:29:05,923][123090] Updated weights for policy 1, policy_version 857562 (0.0009) [2023-12-26 06:29:06,246][123091] Updated weights for policy 0, policy_version 863731 (0.0011) [2023-12-26 06:29:06,302][123091] Updated weights for policy 0, policy_version 863741 (0.0011) [2023-12-26 06:29:06,354][123091] Updated weights for policy 0, policy_version 863751 (0.0011) [2023-12-26 06:29:06,797][123090] Updated weights for policy 1, policy_version 857572 (0.0009) [2023-12-26 06:29:06,858][123090] Updated weights for policy 1, policy_version 857582 (0.0009) [2023-12-26 06:29:06,916][123090] Updated weights for policy 1, policy_version 857592 (0.0008) [2023-12-26 06:29:07,205][123091] Updated weights for policy 0, policy_version 863761 (0.0011) [2023-12-26 06:29:07,253][123091] Updated weights for policy 0, policy_version 863771 (0.0011) [2023-12-26 06:29:07,305][123091] Updated weights for policy 0, policy_version 863781 (0.0011) [2023-12-26 06:29:07,361][123091] Updated weights for policy 0, policy_version 863791 (0.0011) [2023-12-26 06:29:07,770][123090] Updated weights for policy 1, policy_version 857602 (0.0009) [2023-12-26 06:29:07,822][123090] Updated weights for policy 1, policy_version 857612 (0.0009) [2023-12-26 06:29:07,875][123090] Updated weights for policy 1, policy_version 857622 (0.0009) [2023-12-26 06:29:07,926][123090] Updated weights for policy 1, policy_version 857632 (0.0009) [2023-12-26 06:29:08,212][123091] Updated weights for policy 0, policy_version 863801 (0.0010) [2023-12-26 06:29:08,255][123091] Updated weights for policy 0, policy_version 863811 (0.0010) [2023-12-26 06:29:08,306][123091] Updated weights for policy 0, policy_version 863821 (0.0010) [2023-12-26 06:29:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 440696832. Throughput: 0: 8868.5, 1: 8736.5. Samples: 440677344. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:08,785][121949] Avg episode reward: [(0, '6304.929'), (1, '5460.129')] [2023-12-26 06:29:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000863824_221143040.pth... [2023-12-26 06:29:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000862800_220880896.pth [2023-12-26 06:29:08,799][123090] Updated weights for policy 1, policy_version 857642 (0.0009) [2023-12-26 06:29:08,851][123090] Updated weights for policy 1, policy_version 857652 (0.0008) [2023-12-26 06:29:08,900][123090] Updated weights for policy 1, policy_version 857662 (0.0009) [2023-12-26 06:29:08,906][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000857664_219561984.pth... [2023-12-26 06:29:08,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000856640_219299840.pth [2023-12-26 06:29:09,161][123091] Updated weights for policy 0, policy_version 863831 (0.0011) [2023-12-26 06:29:09,213][123091] Updated weights for policy 0, policy_version 863841 (0.0010) [2023-12-26 06:29:09,280][123091] Updated weights for policy 0, policy_version 863851 (0.0011) [2023-12-26 06:29:09,826][123090] Updated weights for policy 1, policy_version 857672 (0.0009) [2023-12-26 06:29:09,893][123090] Updated weights for policy 1, policy_version 857682 (0.0009) [2023-12-26 06:29:09,961][123090] Updated weights for policy 1, policy_version 857692 (0.0009) [2023-12-26 06:29:10,162][123091] Updated weights for policy 0, policy_version 863861 (0.0011) [2023-12-26 06:29:10,234][123091] Updated weights for policy 0, policy_version 863871 (0.0011) [2023-12-26 06:29:10,286][123091] Updated weights for policy 0, policy_version 863881 (0.0011) [2023-12-26 06:29:10,800][123090] Updated weights for policy 1, policy_version 857702 (0.0009) [2023-12-26 06:29:10,849][123090] Updated weights for policy 1, policy_version 857712 (0.0009) [2023-12-26 06:29:10,906][123090] Updated weights for policy 1, policy_version 857722 (0.0009) [2023-12-26 06:29:11,102][123091] Updated weights for policy 0, policy_version 863891 (0.0010) [2023-12-26 06:29:11,179][123091] Updated weights for policy 0, policy_version 863901 (0.0012) [2023-12-26 06:29:11,245][123091] Updated weights for policy 0, policy_version 863911 (0.0009) [2023-12-26 06:29:11,802][123090] Updated weights for policy 1, policy_version 857732 (0.0009) [2023-12-26 06:29:11,858][123090] Updated weights for policy 1, policy_version 857742 (0.0011) [2023-12-26 06:29:11,918][123090] Updated weights for policy 1, policy_version 857752 (0.0011) [2023-12-26 06:29:12,054][123091] Updated weights for policy 0, policy_version 863921 (0.0010) [2023-12-26 06:29:12,113][123091] Updated weights for policy 0, policy_version 863931 (0.0009) [2023-12-26 06:29:12,177][123091] Updated weights for policy 0, policy_version 863941 (0.0009) [2023-12-26 06:29:12,230][123091] Updated weights for policy 0, policy_version 863951 (0.0010) [2023-12-26 06:29:12,733][123090] Updated weights for policy 1, policy_version 857762 (0.0010) [2023-12-26 06:29:12,790][123090] Updated weights for policy 1, policy_version 857772 (0.0009) [2023-12-26 06:29:12,842][123090] Updated weights for policy 1, policy_version 857782 (0.0009) [2023-12-26 06:29:12,896][123090] Updated weights for policy 1, policy_version 857792 (0.0009) [2023-12-26 06:29:13,065][123091] Updated weights for policy 0, policy_version 863961 (0.0006) [2023-12-26 06:29:13,135][123091] Updated weights for policy 0, policy_version 863971 (0.0006) [2023-12-26 06:29:13,204][123091] Updated weights for policy 0, policy_version 863981 (0.0010) [2023-12-26 06:29:13,766][123090] Updated weights for policy 1, policy_version 857802 (0.0010) [2023-12-26 06:29:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 440778752. Throughput: 0: 8805.3, 1: 8656.8. Samples: 440777944. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:13,785][121949] Avg episode reward: [(0, '6246.661'), (1, '5601.411')] [2023-12-26 06:29:13,819][123090] Updated weights for policy 1, policy_version 857812 (0.0010) [2023-12-26 06:29:13,878][123090] Updated weights for policy 1, policy_version 857822 (0.0010) [2023-12-26 06:29:13,934][123091] Updated weights for policy 0, policy_version 863991 (0.0007) [2023-12-26 06:29:13,995][123091] Updated weights for policy 0, policy_version 864001 (0.0005) [2023-12-26 06:29:14,048][123091] Updated weights for policy 0, policy_version 864011 (0.0005) [2023-12-26 06:29:14,618][123091] Updated weights for policy 0, policy_version 864021 (0.0007) [2023-12-26 06:29:14,682][123091] Updated weights for policy 0, policy_version 864031 (0.0006) [2023-12-26 06:29:14,747][123091] Updated weights for policy 0, policy_version 864041 (0.0009) [2023-12-26 06:29:14,845][123090] Updated weights for policy 1, policy_version 857832 (0.0009) [2023-12-26 06:29:14,909][123090] Updated weights for policy 1, policy_version 857842 (0.0008) [2023-12-26 06:29:14,973][123090] Updated weights for policy 1, policy_version 857852 (0.0008) [2023-12-26 06:29:15,471][123091] Updated weights for policy 0, policy_version 864051 (0.0009) [2023-12-26 06:29:15,529][123091] Updated weights for policy 0, policy_version 864061 (0.0008) [2023-12-26 06:29:15,578][123091] Updated weights for policy 0, policy_version 864071 (0.0005) [2023-12-26 06:29:15,796][123090] Updated weights for policy 1, policy_version 857862 (0.0009) [2023-12-26 06:29:15,847][123090] Updated weights for policy 1, policy_version 857872 (0.0008) [2023-12-26 06:29:15,903][123090] Updated weights for policy 1, policy_version 857882 (0.0009) [2023-12-26 06:29:16,293][123091] Updated weights for policy 0, policy_version 864081 (0.0006) [2023-12-26 06:29:16,356][123091] Updated weights for policy 0, policy_version 864091 (0.0006) [2023-12-26 06:29:16,411][123091] Updated weights for policy 0, policy_version 864101 (0.0005) [2023-12-26 06:29:16,481][123091] Updated weights for policy 0, policy_version 864111 (0.0005) [2023-12-26 06:29:16,859][123090] Updated weights for policy 1, policy_version 857892 (0.0009) [2023-12-26 06:29:16,913][123090] Updated weights for policy 1, policy_version 857902 (0.0010) [2023-12-26 06:29:16,969][123090] Updated weights for policy 1, policy_version 857913 (0.0006) [2023-12-26 06:29:17,153][123091] Updated weights for policy 0, policy_version 864121 (0.0005) [2023-12-26 06:29:17,226][123091] Updated weights for policy 0, policy_version 864131 (0.0007) [2023-12-26 06:29:17,292][123091] Updated weights for policy 0, policy_version 864141 (0.0010) [2023-12-26 06:29:17,682][123090] Updated weights for policy 1, policy_version 857923 (0.0005) [2023-12-26 06:29:17,747][123090] Updated weights for policy 1, policy_version 857933 (0.0005) [2023-12-26 06:29:17,806][123090] Updated weights for policy 1, policy_version 857943 (0.0005) [2023-12-26 06:29:18,005][123091] Updated weights for policy 0, policy_version 864151 (0.0007) [2023-12-26 06:29:18,077][123091] Updated weights for policy 0, policy_version 864161 (0.0006) [2023-12-26 06:29:18,145][123091] Updated weights for policy 0, policy_version 864171 (0.0006) [2023-12-26 06:29:18,593][123090] Updated weights for policy 1, policy_version 857953 (0.0006) [2023-12-26 06:29:18,652][123090] Updated weights for policy 1, policy_version 857963 (0.0010) [2023-12-26 06:29:18,706][123090] Updated weights for policy 1, policy_version 857973 (0.0010) [2023-12-26 06:29:18,756][123091] Updated weights for policy 0, policy_version 864181 (0.0008) [2023-12-26 06:29:18,762][123090] Updated weights for policy 1, policy_version 857983 (0.0010) [2023-12-26 06:29:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 440877056. Throughput: 0: 8886.7, 1: 8625.8. Samples: 440887408. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:18,785][121949] Avg episode reward: [(0, '6160.443'), (1, '5785.790')] [2023-12-26 06:29:18,813][123091] Updated weights for policy 0, policy_version 864191 (0.0006) [2023-12-26 06:29:18,871][123091] Updated weights for policy 0, policy_version 864201 (0.0005) [2023-12-26 06:29:19,661][123091] Updated weights for policy 0, policy_version 864211 (0.0006) [2023-12-26 06:29:19,681][123090] Updated weights for policy 1, policy_version 857993 (0.0009) [2023-12-26 06:29:19,735][123091] Updated weights for policy 0, policy_version 864221 (0.0006) [2023-12-26 06:29:19,754][123090] Updated weights for policy 1, policy_version 858003 (0.0010) [2023-12-26 06:29:19,805][123091] Updated weights for policy 0, policy_version 864231 (0.0006) [2023-12-26 06:29:19,823][123090] Updated weights for policy 1, policy_version 858013 (0.0008) [2023-12-26 06:29:20,581][123091] Updated weights for policy 0, policy_version 864241 (0.0008) [2023-12-26 06:29:20,648][123091] Updated weights for policy 0, policy_version 864251 (0.0011) [2023-12-26 06:29:20,689][123090] Updated weights for policy 1, policy_version 858023 (0.0008) [2023-12-26 06:29:20,716][123091] Updated weights for policy 0, policy_version 864261 (0.0011) [2023-12-26 06:29:20,754][123090] Updated weights for policy 1, policy_version 858033 (0.0008) [2023-12-26 06:29:20,781][123091] Updated weights for policy 0, policy_version 864271 (0.0011) [2023-12-26 06:29:20,821][123090] Updated weights for policy 1, policy_version 858043 (0.0010) [2023-12-26 06:29:21,625][123091] Updated weights for policy 0, policy_version 864281 (0.0011) [2023-12-26 06:29:21,659][123090] Updated weights for policy 1, policy_version 858053 (0.0008) [2023-12-26 06:29:21,691][123091] Updated weights for policy 0, policy_version 864291 (0.0011) [2023-12-26 06:29:21,719][123090] Updated weights for policy 1, policy_version 858063 (0.0007) [2023-12-26 06:29:21,756][123091] Updated weights for policy 0, policy_version 864301 (0.0012) [2023-12-26 06:29:21,783][123090] Updated weights for policy 1, policy_version 858073 (0.0009) [2023-12-26 06:29:22,614][123090] Updated weights for policy 1, policy_version 858083 (0.0008) [2023-12-26 06:29:22,617][123091] Updated weights for policy 0, policy_version 864311 (0.0008) [2023-12-26 06:29:22,677][123091] Updated weights for policy 0, policy_version 864321 (0.0007) [2023-12-26 06:29:22,680][123090] Updated weights for policy 1, policy_version 858093 (0.0005) [2023-12-26 06:29:22,737][123091] Updated weights for policy 0, policy_version 864331 (0.0011) [2023-12-26 06:29:22,745][123090] Updated weights for policy 1, policy_version 858103 (0.0005) [2023-12-26 06:29:23,414][123091] Updated weights for policy 0, policy_version 864341 (0.0008) [2023-12-26 06:29:23,449][123090] Updated weights for policy 1, policy_version 858113 (0.0005) [2023-12-26 06:29:23,463][123091] Updated weights for policy 0, policy_version 864351 (0.0010) [2023-12-26 06:29:23,507][123090] Updated weights for policy 1, policy_version 858123 (0.0005) [2023-12-26 06:29:23,518][123091] Updated weights for policy 0, policy_version 864361 (0.0010) [2023-12-26 06:29:23,564][123090] Updated weights for policy 1, policy_version 858133 (0.0010) [2023-12-26 06:29:23,614][123090] Updated weights for policy 1, policy_version 858143 (0.0010) [2023-12-26 06:29:23,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 440967168. Throughput: 0: 8865.6, 1: 8571.7. Samples: 440938224. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:23,785][121949] Avg episode reward: [(0, '6149.359'), (1, '5689.370')] [2023-12-26 06:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000858144_219684864.pth... [2023-12-26 06:29:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000864368_221282304.pth... [2023-12-26 06:29:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000857152_219430912.pth [2023-12-26 06:29:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000863312_221011968.pth [2023-12-26 06:29:24,277][123091] Updated weights for policy 0, policy_version 864371 (0.0009) [2023-12-26 06:29:24,345][123091] Updated weights for policy 0, policy_version 864381 (0.0008) [2023-12-26 06:29:24,398][123090] Updated weights for policy 1, policy_version 858153 (0.0008) [2023-12-26 06:29:24,401][123091] Updated weights for policy 0, policy_version 864391 (0.0009) [2023-12-26 06:29:24,446][123090] Updated weights for policy 1, policy_version 858163 (0.0010) [2023-12-26 06:29:24,494][123090] Updated weights for policy 1, policy_version 858173 (0.0010) [2023-12-26 06:29:25,071][123091] Updated weights for policy 0, policy_version 864401 (0.0009) [2023-12-26 06:29:25,138][123091] Updated weights for policy 0, policy_version 864411 (0.0008) [2023-12-26 06:29:25,204][123091] Updated weights for policy 0, policy_version 864421 (0.0009) [2023-12-26 06:29:25,266][123091] Updated weights for policy 0, policy_version 864431 (0.0011) [2023-12-26 06:29:25,291][123090] Updated weights for policy 1, policy_version 858183 (0.0007) [2023-12-26 06:29:25,342][123090] Updated weights for policy 1, policy_version 858193 (0.0007) [2023-12-26 06:29:25,405][123090] Updated weights for policy 1, policy_version 858203 (0.0005) [2023-12-26 06:29:25,973][123091] Updated weights for policy 0, policy_version 864441 (0.0011) [2023-12-26 06:29:26,032][123091] Updated weights for policy 0, policy_version 864451 (0.0010) [2023-12-26 06:29:26,095][123091] Updated weights for policy 0, policy_version 864461 (0.0011) [2023-12-26 06:29:26,186][123090] Updated weights for policy 1, policy_version 858213 (0.0006) [2023-12-26 06:29:26,258][123090] Updated weights for policy 1, policy_version 858223 (0.0005) [2023-12-26 06:29:26,325][123090] Updated weights for policy 1, policy_version 858233 (0.0005) [2023-12-26 06:29:26,795][123091] Updated weights for policy 0, policy_version 864471 (0.0007) [2023-12-26 06:29:26,852][123091] Updated weights for policy 0, policy_version 864481 (0.0010) [2023-12-26 06:29:26,904][123091] Updated weights for policy 0, policy_version 864491 (0.0010) [2023-12-26 06:29:26,978][123090] Updated weights for policy 1, policy_version 858243 (0.0005) [2023-12-26 06:29:27,047][123090] Updated weights for policy 1, policy_version 858253 (0.0005) [2023-12-26 06:29:27,119][123090] Updated weights for policy 1, policy_version 858263 (0.0005) [2023-12-26 06:29:27,588][123091] Updated weights for policy 0, policy_version 864501 (0.0008) [2023-12-26 06:29:27,649][123091] Updated weights for policy 0, policy_version 864511 (0.0008) [2023-12-26 06:29:27,704][123090] Updated weights for policy 1, policy_version 858273 (0.0005) [2023-12-26 06:29:27,708][123091] Updated weights for policy 0, policy_version 864521 (0.0009) [2023-12-26 06:29:27,765][123090] Updated weights for policy 1, policy_version 858283 (0.0005) [2023-12-26 06:29:27,830][123090] Updated weights for policy 1, policy_version 858293 (0.0005) [2023-12-26 06:29:27,903][123090] Updated weights for policy 1, policy_version 858303 (0.0005) [2023-12-26 06:29:28,491][123090] Updated weights for policy 1, policy_version 858313 (0.0006) [2023-12-26 06:29:28,499][123091] Updated weights for policy 0, policy_version 864531 (0.0011) [2023-12-26 06:29:28,554][123090] Updated weights for policy 1, policy_version 858323 (0.0010) [2023-12-26 06:29:28,561][123091] Updated weights for policy 0, policy_version 864541 (0.0010) [2023-12-26 06:29:28,617][123090] Updated weights for policy 1, policy_version 858333 (0.0010) [2023-12-26 06:29:28,635][123091] Updated weights for policy 0, policy_version 864551 (0.0011) [2023-12-26 06:29:28,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 441065472. Throughput: 0: 8928.1, 1: 8692.1. Samples: 441052356. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:28,785][121949] Avg episode reward: [(0, '6163.814'), (1, '5448.215')] [2023-12-26 06:29:29,327][123091] Updated weights for policy 0, policy_version 864561 (0.0010) [2023-12-26 06:29:29,406][123090] Updated weights for policy 1, policy_version 858343 (0.0011) [2023-12-26 06:29:29,407][123091] Updated weights for policy 0, policy_version 864571 (0.0011) [2023-12-26 06:29:29,470][123090] Updated weights for policy 1, policy_version 858353 (0.0010) [2023-12-26 06:29:29,470][123091] Updated weights for policy 0, policy_version 864581 (0.0011) [2023-12-26 06:29:29,525][123091] Updated weights for policy 0, policy_version 864591 (0.0010) [2023-12-26 06:29:29,534][123090] Updated weights for policy 1, policy_version 858363 (0.0011) [2023-12-26 06:29:30,357][123091] Updated weights for policy 0, policy_version 864601 (0.0010) [2023-12-26 06:29:30,362][123090] Updated weights for policy 1, policy_version 858373 (0.0009) [2023-12-26 06:29:30,417][123090] Updated weights for policy 1, policy_version 858383 (0.0010) [2023-12-26 06:29:30,423][123091] Updated weights for policy 0, policy_version 864611 (0.0011) [2023-12-26 06:29:30,473][123090] Updated weights for policy 1, policy_version 858393 (0.0010) [2023-12-26 06:29:30,486][123091] Updated weights for policy 0, policy_version 864621 (0.0011) [2023-12-26 06:29:31,277][123091] Updated weights for policy 0, policy_version 864631 (0.0009) [2023-12-26 06:29:31,295][123090] Updated weights for policy 1, policy_version 858403 (0.0010) [2023-12-26 06:29:31,328][123091] Updated weights for policy 0, policy_version 864641 (0.0007) [2023-12-26 06:29:31,347][123090] Updated weights for policy 1, policy_version 858413 (0.0007) [2023-12-26 06:29:31,394][123091] Updated weights for policy 0, policy_version 864651 (0.0009) [2023-12-26 06:29:31,410][123090] Updated weights for policy 1, policy_version 858423 (0.0006) [2023-12-26 06:29:32,254][123091] Updated weights for policy 0, policy_version 864661 (0.0009) [2023-12-26 06:29:32,271][123090] Updated weights for policy 1, policy_version 858433 (0.0009) [2023-12-26 06:29:32,321][123091] Updated weights for policy 0, policy_version 864671 (0.0008) [2023-12-26 06:29:32,333][123090] Updated weights for policy 1, policy_version 858443 (0.0008) [2023-12-26 06:29:32,386][123091] Updated weights for policy 0, policy_version 864681 (0.0009) [2023-12-26 06:29:32,398][123090] Updated weights for policy 1, policy_version 858453 (0.0008) [2023-12-26 06:29:32,466][123090] Updated weights for policy 1, policy_version 858463 (0.0010) [2023-12-26 06:29:33,175][123091] Updated weights for policy 0, policy_version 864691 (0.0009) [2023-12-26 06:29:33,238][123091] Updated weights for policy 0, policy_version 864701 (0.0010) [2023-12-26 06:29:33,263][123090] Updated weights for policy 1, policy_version 858473 (0.0008) [2023-12-26 06:29:33,292][123091] Updated weights for policy 0, policy_version 864711 (0.0008) [2023-12-26 06:29:33,318][123090] Updated weights for policy 1, policy_version 858483 (0.0007) [2023-12-26 06:29:33,383][123090] Updated weights for policy 1, policy_version 858493 (0.0007) [2023-12-26 06:29:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 441147392. Throughput: 0: 8943.7, 1: 8723.6. Samples: 441159168. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:33,784][121949] Avg episode reward: [(0, '6246.873'), (1, '5568.363')] [2023-12-26 06:29:34,000][123091] Updated weights for policy 0, policy_version 864721 (0.0008) [2023-12-26 06:29:34,058][123091] Updated weights for policy 0, policy_version 864731 (0.0005) [2023-12-26 06:29:34,121][123090] Updated weights for policy 1, policy_version 858503 (0.0008) [2023-12-26 06:29:34,125][123091] Updated weights for policy 0, policy_version 864741 (0.0006) [2023-12-26 06:29:34,190][123091] Updated weights for policy 0, policy_version 864751 (0.0008) [2023-12-26 06:29:34,190][123090] Updated weights for policy 1, policy_version 858513 (0.0009) [2023-12-26 06:29:34,265][123090] Updated weights for policy 1, policy_version 858523 (0.0009) [2023-12-26 06:29:34,824][123091] Updated weights for policy 0, policy_version 864761 (0.0010) [2023-12-26 06:29:34,888][123091] Updated weights for policy 0, policy_version 864771 (0.0009) [2023-12-26 06:29:34,960][123091] Updated weights for policy 0, policy_version 864781 (0.0011) [2023-12-26 06:29:35,074][123090] Updated weights for policy 1, policy_version 858533 (0.0009) [2023-12-26 06:29:35,131][123090] Updated weights for policy 1, policy_version 858543 (0.0009) [2023-12-26 06:29:35,187][123090] Updated weights for policy 1, policy_version 858553 (0.0008) [2023-12-26 06:29:35,773][123091] Updated weights for policy 0, policy_version 864791 (0.0007) [2023-12-26 06:29:35,833][123091] Updated weights for policy 0, policy_version 864801 (0.0005) [2023-12-26 06:29:35,895][123091] Updated weights for policy 0, policy_version 864811 (0.0007) [2023-12-26 06:29:35,908][123090] Updated weights for policy 1, policy_version 858563 (0.0009) [2023-12-26 06:29:35,968][123090] Updated weights for policy 1, policy_version 858573 (0.0009) [2023-12-26 06:29:36,036][123090] Updated weights for policy 1, policy_version 858583 (0.0009) [2023-12-26 06:29:36,683][123091] Updated weights for policy 0, policy_version 864821 (0.0009) [2023-12-26 06:29:36,759][123091] Updated weights for policy 0, policy_version 864831 (0.0011) [2023-12-26 06:29:36,831][123091] Updated weights for policy 0, policy_version 864841 (0.0011) [2023-12-26 06:29:36,895][123090] Updated weights for policy 1, policy_version 858593 (0.0010) [2023-12-26 06:29:36,950][123090] Updated weights for policy 1, policy_version 858603 (0.0009) [2023-12-26 06:29:37,008][123090] Updated weights for policy 1, policy_version 858613 (0.0009) [2023-12-26 06:29:37,061][123090] Updated weights for policy 1, policy_version 858623 (0.0009) [2023-12-26 06:29:37,645][123091] Updated weights for policy 0, policy_version 864851 (0.0011) [2023-12-26 06:29:37,712][123091] Updated weights for policy 0, policy_version 864861 (0.0011) [2023-12-26 06:29:37,775][123091] Updated weights for policy 0, policy_version 864871 (0.0011) [2023-12-26 06:29:37,857][123090] Updated weights for policy 1, policy_version 858633 (0.0006) [2023-12-26 06:29:37,914][123090] Updated weights for policy 1, policy_version 858643 (0.0007) [2023-12-26 06:29:37,972][123090] Updated weights for policy 1, policy_version 858653 (0.0009) [2023-12-26 06:29:38,496][123091] Updated weights for policy 0, policy_version 864881 (0.0011) [2023-12-26 06:29:38,562][123091] Updated weights for policy 0, policy_version 864891 (0.0011) [2023-12-26 06:29:38,621][123091] Updated weights for policy 0, policy_version 864901 (0.0011) [2023-12-26 06:29:38,687][123091] Updated weights for policy 0, policy_version 864911 (0.0011) [2023-12-26 06:29:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 441237504. Throughput: 0: 8996.6, 1: 8706.1. Samples: 441214312. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:38,785][121949] Avg episode reward: [(0, '6333.822'), (1, '5628.960')] [2023-12-26 06:29:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000864912_221421568.pth... [2023-12-26 06:29:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000863824_221143040.pth [2023-12-26 06:29:38,817][123090] Updated weights for policy 1, policy_version 858663 (0.0009) [2023-12-26 06:29:38,886][123090] Updated weights for policy 1, policy_version 858673 (0.0009) [2023-12-26 06:29:38,939][123090] Updated weights for policy 1, policy_version 858683 (0.0009) [2023-12-26 06:29:38,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000858688_219824128.pth... [2023-12-26 06:29:38,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000857664_219561984.pth [2023-12-26 06:29:39,489][123091] Updated weights for policy 0, policy_version 864921 (0.0007) [2023-12-26 06:29:39,552][123091] Updated weights for policy 0, policy_version 864931 (0.0009) [2023-12-26 06:29:39,618][123091] Updated weights for policy 0, policy_version 864941 (0.0008) [2023-12-26 06:29:39,795][123090] Updated weights for policy 1, policy_version 858694 (0.0007) [2023-12-26 06:29:39,868][123090] Updated weights for policy 1, policy_version 858704 (0.0008) [2023-12-26 06:29:39,937][123090] Updated weights for policy 1, policy_version 858714 (0.0011) [2023-12-26 06:29:40,362][123091] Updated weights for policy 0, policy_version 864951 (0.0008) [2023-12-26 06:29:40,429][123091] Updated weights for policy 0, policy_version 864961 (0.0010) [2023-12-26 06:29:40,488][123091] Updated weights for policy 0, policy_version 864971 (0.0006) [2023-12-26 06:29:40,756][123090] Updated weights for policy 1, policy_version 858724 (0.0010) [2023-12-26 06:29:40,815][123090] Updated weights for policy 1, policy_version 858734 (0.0009) [2023-12-26 06:29:40,887][123090] Updated weights for policy 1, policy_version 858744 (0.0009) [2023-12-26 06:29:41,233][123091] Updated weights for policy 0, policy_version 864981 (0.0006) [2023-12-26 06:29:41,294][123091] Updated weights for policy 0, policy_version 864991 (0.0007) [2023-12-26 06:29:41,358][123091] Updated weights for policy 0, policy_version 865001 (0.0007) [2023-12-26 06:29:41,765][123090] Updated weights for policy 1, policy_version 858754 (0.0008) [2023-12-26 06:29:41,820][123090] Updated weights for policy 1, policy_version 858764 (0.0008) [2023-12-26 06:29:41,878][123090] Updated weights for policy 1, policy_version 858774 (0.0009) [2023-12-26 06:29:41,928][123090] Updated weights for policy 1, policy_version 858784 (0.0005) [2023-12-26 06:29:42,223][123091] Updated weights for policy 0, policy_version 865011 (0.0010) [2023-12-26 06:29:42,293][123091] Updated weights for policy 0, policy_version 865021 (0.0010) [2023-12-26 06:29:42,363][123091] Updated weights for policy 0, policy_version 865031 (0.0007) [2023-12-26 06:29:42,735][123090] Updated weights for policy 1, policy_version 858794 (0.0006) [2023-12-26 06:29:42,809][123090] Updated weights for policy 1, policy_version 858804 (0.0005) [2023-12-26 06:29:42,875][123090] Updated weights for policy 1, policy_version 858814 (0.0007) [2023-12-26 06:29:43,155][123091] Updated weights for policy 0, policy_version 865041 (0.0006) [2023-12-26 06:29:43,223][123091] Updated weights for policy 0, policy_version 865051 (0.0009) [2023-12-26 06:29:43,293][123091] Updated weights for policy 0, policy_version 865061 (0.0009) [2023-12-26 06:29:43,359][123091] Updated weights for policy 0, policy_version 865071 (0.0007) [2023-12-26 06:29:43,631][123090] Updated weights for policy 1, policy_version 858824 (0.0006) [2023-12-26 06:29:43,684][123090] Updated weights for policy 1, policy_version 858834 (0.0005) [2023-12-26 06:29:43,732][123090] Updated weights for policy 1, policy_version 858844 (0.0005) [2023-12-26 06:29:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17744.7). Total num frames: 441327616. Throughput: 0: 8989.6, 1: 8626.2. Samples: 441317804. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:43,785][121949] Avg episode reward: [(0, '6180.056'), (1, '5751.092')] [2023-12-26 06:29:44,000][123091] Updated weights for policy 0, policy_version 865081 (0.0006) [2023-12-26 06:29:44,060][123091] Updated weights for policy 0, policy_version 865091 (0.0005) [2023-12-26 06:29:44,115][123091] Updated weights for policy 0, policy_version 865101 (0.0006) [2023-12-26 06:29:44,396][123090] Updated weights for policy 1, policy_version 858854 (0.0007) [2023-12-26 06:29:44,459][123090] Updated weights for policy 1, policy_version 858864 (0.0010) [2023-12-26 06:29:44,510][123090] Updated weights for policy 1, policy_version 858874 (0.0010) [2023-12-26 06:29:44,784][123091] Updated weights for policy 0, policy_version 865111 (0.0009) [2023-12-26 06:29:44,849][123091] Updated weights for policy 0, policy_version 865121 (0.0011) [2023-12-26 06:29:44,920][123091] Updated weights for policy 0, policy_version 865131 (0.0011) [2023-12-26 06:29:45,410][123090] Updated weights for policy 1, policy_version 858884 (0.0010) [2023-12-26 06:29:45,496][123090] Updated weights for policy 1, policy_version 858894 (0.0011) [2023-12-26 06:29:45,562][123090] Updated weights for policy 1, policy_version 858904 (0.0009) [2023-12-26 06:29:45,679][123091] Updated weights for policy 0, policy_version 865141 (0.0008) [2023-12-26 06:29:45,739][123091] Updated weights for policy 0, policy_version 865151 (0.0006) [2023-12-26 06:29:45,788][123091] Updated weights for policy 0, policy_version 865161 (0.0005) [2023-12-26 06:29:46,275][123090] Updated weights for policy 1, policy_version 858914 (0.0007) [2023-12-26 06:29:46,348][123090] Updated weights for policy 1, policy_version 858924 (0.0010) [2023-12-26 06:29:46,411][123090] Updated weights for policy 1, policy_version 858934 (0.0011) [2023-12-26 06:29:46,452][123091] Updated weights for policy 0, policy_version 865171 (0.0005) [2023-12-26 06:29:46,468][123090] Updated weights for policy 1, policy_version 858944 (0.0009) [2023-12-26 06:29:46,513][123091] Updated weights for policy 0, policy_version 865181 (0.0006) [2023-12-26 06:29:46,564][123091] Updated weights for policy 0, policy_version 865191 (0.0006) [2023-12-26 06:29:47,204][123090] Updated weights for policy 1, policy_version 858954 (0.0010) [2023-12-26 06:29:47,231][123091] Updated weights for policy 0, policy_version 865201 (0.0005) [2023-12-26 06:29:47,248][123090] Updated weights for policy 1, policy_version 858964 (0.0010) [2023-12-26 06:29:47,303][123091] Updated weights for policy 0, policy_version 865211 (0.0005) [2023-12-26 06:29:47,307][123090] Updated weights for policy 1, policy_version 858974 (0.0010) [2023-12-26 06:29:47,364][123091] Updated weights for policy 0, policy_version 865221 (0.0005) [2023-12-26 06:29:47,433][123091] Updated weights for policy 0, policy_version 865231 (0.0005) [2023-12-26 06:29:47,950][123091] Updated weights for policy 0, policy_version 865241 (0.0005) [2023-12-26 06:29:48,010][123091] Updated weights for policy 0, policy_version 865251 (0.0005) [2023-12-26 06:29:48,072][123091] Updated weights for policy 0, policy_version 865261 (0.0005) [2023-12-26 06:29:48,162][123090] Updated weights for policy 1, policy_version 858984 (0.0006) [2023-12-26 06:29:48,211][123090] Updated weights for policy 1, policy_version 858994 (0.0005) [2023-12-26 06:29:48,258][123090] Updated weights for policy 1, policy_version 859004 (0.0005) [2023-12-26 06:29:48,714][123091] Updated weights for policy 0, policy_version 865271 (0.0008) [2023-12-26 06:29:48,766][123091] Updated weights for policy 0, policy_version 865281 (0.0011) [2023-12-26 06:29:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 441417728. Throughput: 0: 9209.9, 1: 8712.4. Samples: 441433376. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:48,785][121949] Avg episode reward: [(0, '6174.486'), (1, '5555.313')] [2023-12-26 06:29:48,833][123091] Updated weights for policy 0, policy_version 865291 (0.0006) [2023-12-26 06:29:49,002][123090] Updated weights for policy 1, policy_version 859014 (0.0008) [2023-12-26 06:29:49,054][123090] Updated weights for policy 1, policy_version 859024 (0.0010) [2023-12-26 06:29:49,117][123090] Updated weights for policy 1, policy_version 859034 (0.0010) [2023-12-26 06:29:49,638][123091] Updated weights for policy 0, policy_version 865301 (0.0007) [2023-12-26 06:29:49,702][123091] Updated weights for policy 0, policy_version 865311 (0.0006) [2023-12-26 06:29:49,773][123091] Updated weights for policy 0, policy_version 865321 (0.0006) [2023-12-26 06:29:49,935][123090] Updated weights for policy 1, policy_version 859044 (0.0010) [2023-12-26 06:29:49,998][123090] Updated weights for policy 1, policy_version 859054 (0.0010) [2023-12-26 06:29:50,066][123090] Updated weights for policy 1, policy_version 859064 (0.0009) [2023-12-26 06:29:50,560][123091] Updated weights for policy 0, policy_version 865331 (0.0009) [2023-12-26 06:29:50,632][123091] Updated weights for policy 0, policy_version 865341 (0.0008) [2023-12-26 06:29:50,684][123091] Updated weights for policy 0, policy_version 865351 (0.0008) [2023-12-26 06:29:50,925][123090] Updated weights for policy 1, policy_version 859074 (0.0010) [2023-12-26 06:29:50,987][123090] Updated weights for policy 1, policy_version 859084 (0.0010) [2023-12-26 06:29:51,047][123090] Updated weights for policy 1, policy_version 859094 (0.0010) [2023-12-26 06:29:51,112][123090] Updated weights for policy 1, policy_version 859104 (0.0007) [2023-12-26 06:29:51,471][123091] Updated weights for policy 0, policy_version 865361 (0.0007) [2023-12-26 06:29:51,533][123091] Updated weights for policy 0, policy_version 865371 (0.0009) [2023-12-26 06:29:51,599][123091] Updated weights for policy 0, policy_version 865381 (0.0010) [2023-12-26 06:29:51,667][123091] Updated weights for policy 0, policy_version 865391 (0.0008) [2023-12-26 06:29:51,869][123090] Updated weights for policy 1, policy_version 859114 (0.0006) [2023-12-26 06:29:51,923][123090] Updated weights for policy 1, policy_version 859124 (0.0006) [2023-12-26 06:29:51,996][123090] Updated weights for policy 1, policy_version 859134 (0.0006) [2023-12-26 06:29:52,563][123091] Updated weights for policy 0, policy_version 865401 (0.0010) [2023-12-26 06:29:52,614][123091] Updated weights for policy 0, policy_version 865412 (0.0010) [2023-12-26 06:29:52,667][123091] Updated weights for policy 0, policy_version 865423 (0.0010) [2023-12-26 06:29:52,719][123090] Updated weights for policy 1, policy_version 859144 (0.0006) [2023-12-26 06:29:52,772][123090] Updated weights for policy 1, policy_version 859154 (0.0006) [2023-12-26 06:29:52,820][123090] Updated weights for policy 1, policy_version 859164 (0.0005) [2023-12-26 06:29:53,528][123090] Updated weights for policy 1, policy_version 859174 (0.0005) [2023-12-26 06:29:53,595][123090] Updated weights for policy 1, policy_version 859184 (0.0005) [2023-12-26 06:29:53,618][123091] Updated weights for policy 0, policy_version 865433 (0.0009) [2023-12-26 06:29:53,657][123090] Updated weights for policy 1, policy_version 859194 (0.0007) [2023-12-26 06:29:53,684][123091] Updated weights for policy 0, policy_version 865443 (0.0010) [2023-12-26 06:29:53,738][123091] Updated weights for policy 0, policy_version 865453 (0.0008) [2023-12-26 06:29:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 441516032. Throughput: 0: 9223.3, 1: 8743.2. Samples: 441485836. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:53,784][121949] Avg episode reward: [(0, '6349.536'), (1, '5447.640')] [2023-12-26 06:29:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000865456_221560832.pth... [2023-12-26 06:29:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000859200_219955200.pth... [2023-12-26 06:29:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000864368_221282304.pth [2023-12-26 06:29:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000858144_219684864.pth [2023-12-26 06:29:54,327][123090] Updated weights for policy 1, policy_version 859204 (0.0010) [2023-12-26 06:29:54,386][123090] Updated weights for policy 1, policy_version 859214 (0.0010) [2023-12-26 06:29:54,448][123090] Updated weights for policy 1, policy_version 859224 (0.0010) [2023-12-26 06:29:54,616][123091] Updated weights for policy 0, policy_version 865463 (0.0009) [2023-12-26 06:29:54,683][123091] Updated weights for policy 0, policy_version 865473 (0.0009) [2023-12-26 06:29:54,739][123091] Updated weights for policy 0, policy_version 865483 (0.0009) [2023-12-26 06:29:55,204][123090] Updated weights for policy 1, policy_version 859234 (0.0009) [2023-12-26 06:29:55,266][123090] Updated weights for policy 1, policy_version 859244 (0.0005) [2023-12-26 06:29:55,332][123090] Updated weights for policy 1, policy_version 859254 (0.0005) [2023-12-26 06:29:55,386][123090] Updated weights for policy 1, policy_version 859264 (0.0009) [2023-12-26 06:29:55,615][123091] Updated weights for policy 0, policy_version 865493 (0.0009) [2023-12-26 06:29:55,667][123091] Updated weights for policy 0, policy_version 865503 (0.0009) [2023-12-26 06:29:55,715][123091] Updated weights for policy 0, policy_version 865513 (0.0009) [2023-12-26 06:29:56,172][123090] Updated weights for policy 1, policy_version 859274 (0.0009) [2023-12-26 06:29:56,222][123090] Updated weights for policy 1, policy_version 859284 (0.0009) [2023-12-26 06:29:56,272][123090] Updated weights for policy 1, policy_version 859294 (0.0009) [2023-12-26 06:29:56,545][123091] Updated weights for policy 0, policy_version 865523 (0.0008) [2023-12-26 06:29:56,597][123091] Updated weights for policy 0, policy_version 865534 (0.0009) [2023-12-26 06:29:56,644][123091] Updated weights for policy 0, policy_version 865544 (0.0009) [2023-12-26 06:29:57,130][123090] Updated weights for policy 1, policy_version 859304 (0.0009) [2023-12-26 06:29:57,194][123090] Updated weights for policy 1, policy_version 859314 (0.0006) [2023-12-26 06:29:57,253][123090] Updated weights for policy 1, policy_version 859324 (0.0005) [2023-12-26 06:29:57,520][123091] Updated weights for policy 0, policy_version 865555 (0.0010) [2023-12-26 06:29:57,574][123091] Updated weights for policy 0, policy_version 865565 (0.0010) [2023-12-26 06:29:57,634][123091] Updated weights for policy 0, policy_version 865577 (0.0010) [2023-12-26 06:29:57,898][123090] Updated weights for policy 1, policy_version 859334 (0.0005) [2023-12-26 06:29:57,945][123090] Updated weights for policy 1, policy_version 859344 (0.0005) [2023-12-26 06:29:58,009][123090] Updated weights for policy 1, policy_version 859354 (0.0009) [2023-12-26 06:29:58,455][123091] Updated weights for policy 0, policy_version 865587 (0.0008) [2023-12-26 06:29:58,515][123091] Updated weights for policy 0, policy_version 865597 (0.0009) [2023-12-26 06:29:58,581][123091] Updated weights for policy 0, policy_version 865607 (0.0010) [2023-12-26 06:29:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 441597952. Throughput: 0: 9178.7, 1: 8896.9. Samples: 441591348. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:29:58,785][121949] Avg episode reward: [(0, '6383.730'), (1, '5552.157')] [2023-12-26 06:29:58,847][123090] Updated weights for policy 1, policy_version 859364 (0.0009) [2023-12-26 06:29:58,899][123090] Updated weights for policy 1, policy_version 859374 (0.0008) [2023-12-26 06:29:58,969][123090] Updated weights for policy 1, policy_version 859384 (0.0008) [2023-12-26 06:29:59,467][123091] Updated weights for policy 0, policy_version 865617 (0.0009) [2023-12-26 06:29:59,542][123091] Updated weights for policy 0, policy_version 865627 (0.0007) [2023-12-26 06:29:59,595][123091] Updated weights for policy 0, policy_version 865637 (0.0009) [2023-12-26 06:29:59,660][123091] Updated weights for policy 0, policy_version 865647 (0.0010) [2023-12-26 06:29:59,743][123090] Updated weights for policy 1, policy_version 859394 (0.0009) [2023-12-26 06:29:59,804][123090] Updated weights for policy 1, policy_version 859404 (0.0009) [2023-12-26 06:29:59,873][123090] Updated weights for policy 1, policy_version 859414 (0.0007) [2023-12-26 06:29:59,940][123090] Updated weights for policy 1, policy_version 859424 (0.0007) [2023-12-26 06:30:00,486][123091] Updated weights for policy 0, policy_version 865657 (0.0010) [2023-12-26 06:30:00,551][123091] Updated weights for policy 0, policy_version 865667 (0.0009) [2023-12-26 06:30:00,609][123091] Updated weights for policy 0, policy_version 865677 (0.0009) [2023-12-26 06:30:00,745][123090] Updated weights for policy 1, policy_version 859434 (0.0010) [2023-12-26 06:30:00,801][123090] Updated weights for policy 1, policy_version 859444 (0.0010) [2023-12-26 06:30:00,853][123090] Updated weights for policy 1, policy_version 859454 (0.0010) [2023-12-26 06:30:01,401][123091] Updated weights for policy 0, policy_version 865687 (0.0008) [2023-12-26 06:30:01,456][123091] Updated weights for policy 0, policy_version 865697 (0.0008) [2023-12-26 06:30:01,508][123091] Updated weights for policy 0, policy_version 865707 (0.0008) [2023-12-26 06:30:01,709][123090] Updated weights for policy 1, policy_version 859464 (0.0009) [2023-12-26 06:30:01,759][123090] Updated weights for policy 1, policy_version 859474 (0.0009) [2023-12-26 06:30:01,816][123090] Updated weights for policy 1, policy_version 859484 (0.0007) [2023-12-26 06:30:02,319][123091] Updated weights for policy 0, policy_version 865717 (0.0009) [2023-12-26 06:30:02,386][123091] Updated weights for policy 0, policy_version 865727 (0.0010) [2023-12-26 06:30:02,447][123091] Updated weights for policy 0, policy_version 865737 (0.0010) [2023-12-26 06:30:02,567][123090] Updated weights for policy 1, policy_version 859494 (0.0009) [2023-12-26 06:30:02,629][123090] Updated weights for policy 1, policy_version 859504 (0.0008) [2023-12-26 06:30:02,699][123090] Updated weights for policy 1, policy_version 859514 (0.0005) [2023-12-26 06:30:03,309][123090] Updated weights for policy 1, policy_version 859524 (0.0005) [2023-12-26 06:30:03,315][123091] Updated weights for policy 0, policy_version 865747 (0.0009) [2023-12-26 06:30:03,358][123090] Updated weights for policy 1, policy_version 859534 (0.0008) [2023-12-26 06:30:03,372][123091] Updated weights for policy 0, policy_version 865757 (0.0008) [2023-12-26 06:30:03,411][123090] Updated weights for policy 1, policy_version 859544 (0.0010) [2023-12-26 06:30:03,430][123091] Updated weights for policy 0, policy_version 865767 (0.0008) [2023-12-26 06:30:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 441688064. Throughput: 0: 8993.4, 1: 8971.8. Samples: 441695844. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:03,785][121949] Avg episode reward: [(0, '6260.572'), (1, '5650.674')] [2023-12-26 06:30:04,202][123090] Updated weights for policy 1, policy_version 859554 (0.0007) [2023-12-26 06:30:04,272][123090] Updated weights for policy 1, policy_version 859564 (0.0009) [2023-12-26 06:30:04,306][123091] Updated weights for policy 0, policy_version 865777 (0.0009) [2023-12-26 06:30:04,344][123090] Updated weights for policy 1, policy_version 859574 (0.0006) [2023-12-26 06:30:04,364][123091] Updated weights for policy 0, policy_version 865787 (0.0009) [2023-12-26 06:30:04,399][123090] Updated weights for policy 1, policy_version 859584 (0.0006) [2023-12-26 06:30:04,417][123091] Updated weights for policy 0, policy_version 865798 (0.0009) [2023-12-26 06:30:04,470][123091] Updated weights for policy 0, policy_version 865808 (0.0010) [2023-12-26 06:30:05,117][123090] Updated weights for policy 1, policy_version 859594 (0.0010) [2023-12-26 06:30:05,177][123090] Updated weights for policy 1, policy_version 859604 (0.0011) [2023-12-26 06:30:05,237][123090] Updated weights for policy 1, policy_version 859614 (0.0011) [2023-12-26 06:30:05,388][123091] Updated weights for policy 0, policy_version 865818 (0.0009) [2023-12-26 06:30:05,451][123091] Updated weights for policy 0, policy_version 865828 (0.0009) [2023-12-26 06:30:05,513][123091] Updated weights for policy 0, policy_version 865838 (0.0009) [2023-12-26 06:30:06,014][123090] Updated weights for policy 1, policy_version 859624 (0.0006) [2023-12-26 06:30:06,084][123090] Updated weights for policy 1, policy_version 859634 (0.0005) [2023-12-26 06:30:06,159][123090] Updated weights for policy 1, policy_version 859644 (0.0008) [2023-12-26 06:30:06,404][123091] Updated weights for policy 0, policy_version 865848 (0.0011) [2023-12-26 06:30:06,472][123091] Updated weights for policy 0, policy_version 865858 (0.0011) [2023-12-26 06:30:06,540][123091] Updated weights for policy 0, policy_version 865868 (0.0011) [2023-12-26 06:30:06,938][123090] Updated weights for policy 1, policy_version 859654 (0.0011) [2023-12-26 06:30:06,994][123090] Updated weights for policy 1, policy_version 859664 (0.0010) [2023-12-26 06:30:07,063][123090] Updated weights for policy 1, policy_version 859674 (0.0011) [2023-12-26 06:30:07,366][123091] Updated weights for policy 0, policy_version 865878 (0.0011) [2023-12-26 06:30:07,426][123091] Updated weights for policy 0, policy_version 865888 (0.0011) [2023-12-26 06:30:07,487][123091] Updated weights for policy 0, policy_version 865898 (0.0011) [2023-12-26 06:30:07,913][123090] Updated weights for policy 1, policy_version 859684 (0.0011) [2023-12-26 06:30:07,980][123090] Updated weights for policy 1, policy_version 859694 (0.0011) [2023-12-26 06:30:08,041][123090] Updated weights for policy 1, policy_version 859704 (0.0009) [2023-12-26 06:30:08,255][123091] Updated weights for policy 0, policy_version 865908 (0.0008) [2023-12-26 06:30:08,320][123091] Updated weights for policy 0, policy_version 865918 (0.0010) [2023-12-26 06:30:08,384][123091] Updated weights for policy 0, policy_version 865928 (0.0011) [2023-12-26 06:30:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 441769984. Throughput: 0: 8948.9, 1: 9051.9. Samples: 441748260. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:08,785][121949] Avg episode reward: [(0, '6192.248'), (1, '5679.676')] [2023-12-26 06:30:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000865936_221683712.pth... [2023-12-26 06:30:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000859712_220086272.pth... [2023-12-26 06:30:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000858688_219824128.pth [2023-12-26 06:30:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000864912_221421568.pth [2023-12-26 06:30:08,902][123090] Updated weights for policy 1, policy_version 859714 (0.0008) [2023-12-26 06:30:08,970][123090] Updated weights for policy 1, policy_version 859724 (0.0011) [2023-12-26 06:30:09,035][123090] Updated weights for policy 1, policy_version 859734 (0.0011) [2023-12-26 06:30:09,102][123090] Updated weights for policy 1, policy_version 859744 (0.0011) [2023-12-26 06:30:09,208][123091] Updated weights for policy 0, policy_version 865938 (0.0010) [2023-12-26 06:30:09,277][123091] Updated weights for policy 0, policy_version 865948 (0.0010) [2023-12-26 06:30:09,342][123091] Updated weights for policy 0, policy_version 865958 (0.0009) [2023-12-26 06:30:09,415][123091] Updated weights for policy 0, policy_version 865968 (0.0008) [2023-12-26 06:30:09,972][123090] Updated weights for policy 1, policy_version 859754 (0.0011) [2023-12-26 06:30:10,034][123090] Updated weights for policy 1, policy_version 859764 (0.0010) [2023-12-26 06:30:10,096][123090] Updated weights for policy 1, policy_version 859774 (0.0011) [2023-12-26 06:30:10,266][123091] Updated weights for policy 0, policy_version 865978 (0.0009) [2023-12-26 06:30:10,320][123091] Updated weights for policy 0, policy_version 865988 (0.0009) [2023-12-26 06:30:10,380][123091] Updated weights for policy 0, policy_version 865998 (0.0009) [2023-12-26 06:30:10,924][123090] Updated weights for policy 1, policy_version 859784 (0.0011) [2023-12-26 06:30:10,985][123090] Updated weights for policy 1, policy_version 859794 (0.0011) [2023-12-26 06:30:11,048][123090] Updated weights for policy 1, policy_version 859804 (0.0010) [2023-12-26 06:30:11,281][123091] Updated weights for policy 0, policy_version 866008 (0.0009) [2023-12-26 06:30:11,342][123091] Updated weights for policy 0, policy_version 866018 (0.0009) [2023-12-26 06:30:11,427][123091] Updated weights for policy 0, policy_version 866028 (0.0009) [2023-12-26 06:30:12,048][123090] Updated weights for policy 1, policy_version 859814 (0.0011) [2023-12-26 06:30:12,120][123090] Updated weights for policy 1, policy_version 859824 (0.0011) [2023-12-26 06:30:12,184][123090] Updated weights for policy 1, policy_version 859834 (0.0010) [2023-12-26 06:30:12,240][123091] Updated weights for policy 0, policy_version 866038 (0.0007) [2023-12-26 06:30:12,310][123091] Updated weights for policy 0, policy_version 866048 (0.0007) [2023-12-26 06:30:12,385][123091] Updated weights for policy 0, policy_version 866058 (0.0010) [2023-12-26 06:30:13,042][123090] Updated weights for policy 1, policy_version 859844 (0.0009) [2023-12-26 06:30:13,091][123090] Updated weights for policy 1, policy_version 859854 (0.0009) [2023-12-26 06:30:13,144][123090] Updated weights for policy 1, policy_version 859864 (0.0009) [2023-12-26 06:30:13,185][123091] Updated weights for policy 0, policy_version 866068 (0.0006) [2023-12-26 06:30:13,233][123091] Updated weights for policy 0, policy_version 866078 (0.0007) [2023-12-26 06:30:13,284][123091] Updated weights for policy 0, policy_version 866088 (0.0006) [2023-12-26 06:30:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 441851904. Throughput: 0: 8795.8, 1: 8876.2. Samples: 441847596. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:13,785][121949] Avg episode reward: [(0, '6114.033'), (1, '5631.917')] [2023-12-26 06:30:14,064][123091] Updated weights for policy 0, policy_version 866098 (0.0007) [2023-12-26 06:30:14,075][123090] Updated weights for policy 1, policy_version 859874 (0.0009) [2023-12-26 06:30:14,128][123091] Updated weights for policy 0, policy_version 866108 (0.0006) [2023-12-26 06:30:14,135][123090] Updated weights for policy 1, policy_version 859884 (0.0009) [2023-12-26 06:30:14,189][123091] Updated weights for policy 0, policy_version 866118 (0.0007) [2023-12-26 06:30:14,200][123090] Updated weights for policy 1, policy_version 859894 (0.0009) [2023-12-26 06:30:14,252][123091] Updated weights for policy 0, policy_version 866128 (0.0008) [2023-12-26 06:30:14,264][123090] Updated weights for policy 1, policy_version 859904 (0.0008) [2023-12-26 06:30:15,056][123091] Updated weights for policy 0, policy_version 866138 (0.0010) [2023-12-26 06:30:15,117][123090] Updated weights for policy 1, policy_version 859914 (0.0008) [2023-12-26 06:30:15,118][123091] Updated weights for policy 0, policy_version 866148 (0.0010) [2023-12-26 06:30:15,183][123090] Updated weights for policy 1, policy_version 859924 (0.0007) [2023-12-26 06:30:15,184][123091] Updated weights for policy 0, policy_version 866158 (0.0009) [2023-12-26 06:30:15,234][123090] Updated weights for policy 1, policy_version 859934 (0.0006) [2023-12-26 06:30:15,996][123090] Updated weights for policy 1, policy_version 859944 (0.0005) [2023-12-26 06:30:16,055][123090] Updated weights for policy 1, policy_version 859954 (0.0005) [2023-12-26 06:30:16,058][123091] Updated weights for policy 0, policy_version 866168 (0.0008) [2023-12-26 06:30:16,109][123090] Updated weights for policy 1, policy_version 859964 (0.0005) [2023-12-26 06:30:16,112][123091] Updated weights for policy 0, policy_version 866178 (0.0010) [2023-12-26 06:30:16,173][123091] Updated weights for policy 0, policy_version 866188 (0.0009) [2023-12-26 06:30:16,766][123090] Updated weights for policy 1, policy_version 859974 (0.0008) [2023-12-26 06:30:16,828][123090] Updated weights for policy 1, policy_version 859984 (0.0008) [2023-12-26 06:30:16,900][123090] Updated weights for policy 1, policy_version 859994 (0.0007) [2023-12-26 06:30:17,038][123091] Updated weights for policy 0, policy_version 866198 (0.0009) [2023-12-26 06:30:17,100][123091] Updated weights for policy 0, policy_version 866208 (0.0010) [2023-12-26 06:30:17,152][123091] Updated weights for policy 0, policy_version 866218 (0.0009) [2023-12-26 06:30:17,704][123090] Updated weights for policy 1, policy_version 860004 (0.0009) [2023-12-26 06:30:17,775][123090] Updated weights for policy 1, policy_version 860014 (0.0010) [2023-12-26 06:30:17,836][123090] Updated weights for policy 1, policy_version 860024 (0.0009) [2023-12-26 06:30:17,904][123091] Updated weights for policy 0, policy_version 866228 (0.0006) [2023-12-26 06:30:17,967][123091] Updated weights for policy 0, policy_version 866238 (0.0005) [2023-12-26 06:30:18,023][123091] Updated weights for policy 0, policy_version 866248 (0.0005) [2023-12-26 06:30:18,656][123090] Updated weights for policy 1, policy_version 860034 (0.0009) [2023-12-26 06:30:18,719][123090] Updated weights for policy 1, policy_version 860044 (0.0010) [2023-12-26 06:30:18,762][123091] Updated weights for policy 0, policy_version 866258 (0.0006) [2023-12-26 06:30:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 441933824. Throughput: 0: 8776.7, 1: 8829.7. Samples: 441951456. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:18,784][121949] Avg episode reward: [(0, '6052.609'), (1, '5699.722')] [2023-12-26 06:30:18,786][123090] Updated weights for policy 1, policy_version 860054 (0.0010) [2023-12-26 06:30:18,818][123091] Updated weights for policy 0, policy_version 866268 (0.0009) [2023-12-26 06:30:18,850][123090] Updated weights for policy 1, policy_version 860064 (0.0010) [2023-12-26 06:30:18,873][123091] Updated weights for policy 0, policy_version 866278 (0.0007) [2023-12-26 06:30:18,929][123091] Updated weights for policy 0, policy_version 866288 (0.0009) [2023-12-26 06:30:19,684][123090] Updated weights for policy 1, policy_version 860074 (0.0006) [2023-12-26 06:30:19,759][123090] Updated weights for policy 1, policy_version 860084 (0.0008) [2023-12-26 06:30:19,781][123091] Updated weights for policy 0, policy_version 866298 (0.0007) [2023-12-26 06:30:19,837][123090] Updated weights for policy 1, policy_version 860094 (0.0010) [2023-12-26 06:30:19,851][123091] Updated weights for policy 0, policy_version 866308 (0.0008) [2023-12-26 06:30:19,917][123091] Updated weights for policy 0, policy_version 866318 (0.0010) [2023-12-26 06:30:20,622][123090] Updated weights for policy 1, policy_version 860104 (0.0008) [2023-12-26 06:30:20,696][123090] Updated weights for policy 1, policy_version 860114 (0.0008) [2023-12-26 06:30:20,768][123090] Updated weights for policy 1, policy_version 860124 (0.0009) [2023-12-26 06:30:20,773][123091] Updated weights for policy 0, policy_version 866328 (0.0009) [2023-12-26 06:30:20,860][123091] Updated weights for policy 0, policy_version 866338 (0.0006) [2023-12-26 06:30:20,932][123091] Updated weights for policy 0, policy_version 866348 (0.0007) [2023-12-26 06:30:21,606][123090] Updated weights for policy 1, policy_version 860134 (0.0008) [2023-12-26 06:30:21,681][123090] Updated weights for policy 1, policy_version 860144 (0.0008) [2023-12-26 06:30:21,723][123091] Updated weights for policy 0, policy_version 866358 (0.0011) [2023-12-26 06:30:21,752][123090] Updated weights for policy 1, policy_version 860154 (0.0007) [2023-12-26 06:30:21,791][123091] Updated weights for policy 0, policy_version 866368 (0.0010) [2023-12-26 06:30:21,848][123091] Updated weights for policy 0, policy_version 866378 (0.0010) [2023-12-26 06:30:22,505][123090] Updated weights for policy 1, policy_version 860164 (0.0008) [2023-12-26 06:30:22,557][123090] Updated weights for policy 1, policy_version 860174 (0.0008) [2023-12-26 06:30:22,619][123090] Updated weights for policy 1, policy_version 860184 (0.0009) [2023-12-26 06:30:22,681][123091] Updated weights for policy 0, policy_version 866388 (0.0010) [2023-12-26 06:30:22,747][123091] Updated weights for policy 0, policy_version 866398 (0.0007) [2023-12-26 06:30:22,810][123091] Updated weights for policy 0, policy_version 866408 (0.0005) [2023-12-26 06:30:23,372][123090] Updated weights for policy 1, policy_version 860194 (0.0009) [2023-12-26 06:30:23,435][123090] Updated weights for policy 1, policy_version 860204 (0.0009) [2023-12-26 06:30:23,488][123090] Updated weights for policy 1, policy_version 860214 (0.0008) [2023-12-26 06:30:23,510][123091] Updated weights for policy 0, policy_version 866418 (0.0005) [2023-12-26 06:30:23,539][123090] Updated weights for policy 1, policy_version 860224 (0.0009) [2023-12-26 06:30:23,571][123091] Updated weights for policy 0, policy_version 866428 (0.0005) [2023-12-26 06:30:23,637][123091] Updated weights for policy 0, policy_version 866438 (0.0005) [2023-12-26 06:30:23,713][123091] Updated weights for policy 0, policy_version 866448 (0.0009) [2023-12-26 06:30:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 442032128. Throughput: 0: 8715.6, 1: 8798.6. Samples: 442002448. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:23,785][121949] Avg episode reward: [(0, '6200.063'), (1, '5655.480')] [2023-12-26 06:30:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000866448_221814784.pth... [2023-12-26 06:30:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000860224_220217344.pth... [2023-12-26 06:30:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000859200_219955200.pth [2023-12-26 06:30:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000865456_221560832.pth [2023-12-26 06:30:24,366][123090] Updated weights for policy 1, policy_version 860234 (0.0009) [2023-12-26 06:30:24,429][123090] Updated weights for policy 1, policy_version 860244 (0.0010) [2023-12-26 06:30:24,495][123090] Updated weights for policy 1, policy_version 860254 (0.0008) [2023-12-26 06:30:24,518][123091] Updated weights for policy 0, policy_version 866458 (0.0008) [2023-12-26 06:30:24,563][123091] Updated weights for policy 0, policy_version 866468 (0.0007) [2023-12-26 06:30:24,612][123091] Updated weights for policy 0, policy_version 866478 (0.0005) [2023-12-26 06:30:25,314][123091] Updated weights for policy 0, policy_version 866488 (0.0008) [2023-12-26 06:30:25,347][123090] Updated weights for policy 1, policy_version 860264 (0.0006) [2023-12-26 06:30:25,375][123091] Updated weights for policy 0, policy_version 866498 (0.0008) [2023-12-26 06:30:25,395][123090] Updated weights for policy 1, policy_version 860274 (0.0007) [2023-12-26 06:30:25,436][123091] Updated weights for policy 0, policy_version 866508 (0.0009) [2023-12-26 06:30:25,445][123090] Updated weights for policy 1, policy_version 860284 (0.0010) [2023-12-26 06:30:26,249][123091] Updated weights for policy 0, policy_version 866518 (0.0009) [2023-12-26 06:30:26,282][123090] Updated weights for policy 1, policy_version 860294 (0.0007) [2023-12-26 06:30:26,297][123091] Updated weights for policy 0, policy_version 866528 (0.0010) [2023-12-26 06:30:26,333][123090] Updated weights for policy 1, policy_version 860304 (0.0005) [2023-12-26 06:30:26,348][123091] Updated weights for policy 0, policy_version 866538 (0.0010) [2023-12-26 06:30:26,390][123090] Updated weights for policy 1, policy_version 860314 (0.0006) [2023-12-26 06:30:27,069][123091] Updated weights for policy 0, policy_version 866548 (0.0011) [2023-12-26 06:30:27,121][123090] Updated weights for policy 1, policy_version 860324 (0.0007) [2023-12-26 06:30:27,125][123091] Updated weights for policy 0, policy_version 866558 (0.0011) [2023-12-26 06:30:27,185][123090] Updated weights for policy 1, policy_version 860334 (0.0005) [2023-12-26 06:30:27,189][123091] Updated weights for policy 0, policy_version 866568 (0.0011) [2023-12-26 06:30:27,247][123090] Updated weights for policy 1, policy_version 860344 (0.0005) [2023-12-26 06:30:27,882][123090] Updated weights for policy 1, policy_version 860354 (0.0006) [2023-12-26 06:30:27,940][123090] Updated weights for policy 1, policy_version 860364 (0.0010) [2023-12-26 06:30:27,998][123090] Updated weights for policy 1, policy_version 860374 (0.0010) [2023-12-26 06:30:28,019][123091] Updated weights for policy 0, policy_version 866578 (0.0011) [2023-12-26 06:30:28,052][123090] Updated weights for policy 1, policy_version 860384 (0.0010) [2023-12-26 06:30:28,077][123091] Updated weights for policy 0, policy_version 866588 (0.0010) [2023-12-26 06:30:28,126][123091] Updated weights for policy 0, policy_version 866598 (0.0010) [2023-12-26 06:30:28,182][123091] Updated weights for policy 0, policy_version 866608 (0.0009) [2023-12-26 06:30:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 442114048. Throughput: 0: 8762.0, 1: 8879.5. Samples: 442111676. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:28,785][121949] Avg episode reward: [(0, '6318.209'), (1, '5574.483')] [2023-12-26 06:30:28,877][123090] Updated weights for policy 1, policy_version 860394 (0.0010) [2023-12-26 06:30:28,943][123090] Updated weights for policy 1, policy_version 860404 (0.0010) [2023-12-26 06:30:29,006][123090] Updated weights for policy 1, policy_version 860414 (0.0010) [2023-12-26 06:30:29,022][123091] Updated weights for policy 0, policy_version 866618 (0.0006) [2023-12-26 06:30:29,078][123091] Updated weights for policy 0, policy_version 866628 (0.0009) [2023-12-26 06:30:29,135][123091] Updated weights for policy 0, policy_version 866638 (0.0009) [2023-12-26 06:30:29,799][123090] Updated weights for policy 1, policy_version 860424 (0.0006) [2023-12-26 06:30:29,861][123090] Updated weights for policy 1, policy_version 860434 (0.0008) [2023-12-26 06:30:29,927][123090] Updated weights for policy 1, policy_version 860444 (0.0007) [2023-12-26 06:30:30,021][123091] Updated weights for policy 0, policy_version 866648 (0.0009) [2023-12-26 06:30:30,080][123091] Updated weights for policy 0, policy_version 866658 (0.0010) [2023-12-26 06:30:30,138][123091] Updated weights for policy 0, policy_version 866668 (0.0010) [2023-12-26 06:30:30,687][123090] Updated weights for policy 1, policy_version 860454 (0.0008) [2023-12-26 06:30:30,748][123090] Updated weights for policy 1, policy_version 860464 (0.0009) [2023-12-26 06:30:30,804][123090] Updated weights for policy 1, policy_version 860474 (0.0009) [2023-12-26 06:30:30,992][123091] Updated weights for policy 0, policy_version 866678 (0.0009) [2023-12-26 06:30:31,052][123091] Updated weights for policy 0, policy_version 866688 (0.0008) [2023-12-26 06:30:31,114][123091] Updated weights for policy 0, policy_version 866698 (0.0010) [2023-12-26 06:30:31,591][123090] Updated weights for policy 1, policy_version 860484 (0.0008) [2023-12-26 06:30:31,659][123090] Updated weights for policy 1, policy_version 860494 (0.0010) [2023-12-26 06:30:31,725][123090] Updated weights for policy 1, policy_version 860504 (0.0009) [2023-12-26 06:30:31,956][123091] Updated weights for policy 0, policy_version 866708 (0.0009) [2023-12-26 06:30:32,026][123091] Updated weights for policy 0, policy_version 866718 (0.0009) [2023-12-26 06:30:32,090][123091] Updated weights for policy 0, policy_version 866728 (0.0010) [2023-12-26 06:30:32,581][123090] Updated weights for policy 1, policy_version 860514 (0.0009) [2023-12-26 06:30:32,646][123090] Updated weights for policy 1, policy_version 860524 (0.0010) [2023-12-26 06:30:32,706][123090] Updated weights for policy 1, policy_version 860534 (0.0009) [2023-12-26 06:30:32,770][123090] Updated weights for policy 1, policy_version 860544 (0.0009) [2023-12-26 06:30:32,899][123091] Updated weights for policy 0, policy_version 866738 (0.0009) [2023-12-26 06:30:32,971][123091] Updated weights for policy 0, policy_version 866748 (0.0005) [2023-12-26 06:30:33,033][123091] Updated weights for policy 0, policy_version 866758 (0.0005) [2023-12-26 06:30:33,101][123091] Updated weights for policy 0, policy_version 866768 (0.0009) [2023-12-26 06:30:33,621][123090] Updated weights for policy 1, policy_version 860554 (0.0010) [2023-12-26 06:30:33,683][123090] Updated weights for policy 1, policy_version 860564 (0.0010) [2023-12-26 06:30:33,746][123090] Updated weights for policy 1, policy_version 860574 (0.0007) [2023-12-26 06:30:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 442204160. Throughput: 0: 8546.2, 1: 8831.0. Samples: 442215352. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:33,785][121949] Avg episode reward: [(0, '6214.730'), (1, '5581.950')] [2023-12-26 06:30:33,804][123091] Updated weights for policy 0, policy_version 866778 (0.0010) [2023-12-26 06:30:33,850][123091] Updated weights for policy 0, policy_version 866788 (0.0010) [2023-12-26 06:30:33,908][123091] Updated weights for policy 0, policy_version 866798 (0.0008) [2023-12-26 06:30:34,337][123090] Updated weights for policy 1, policy_version 860584 (0.0010) [2023-12-26 06:30:34,408][123090] Updated weights for policy 1, policy_version 860594 (0.0011) [2023-12-26 06:30:34,477][123090] Updated weights for policy 1, policy_version 860604 (0.0011) [2023-12-26 06:30:34,651][123091] Updated weights for policy 0, policy_version 866808 (0.0009) [2023-12-26 06:30:34,714][123091] Updated weights for policy 0, policy_version 866818 (0.0011) [2023-12-26 06:30:34,777][123091] Updated weights for policy 0, policy_version 866828 (0.0011) [2023-12-26 06:30:35,293][123090] Updated weights for policy 1, policy_version 860614 (0.0010) [2023-12-26 06:30:35,350][123090] Updated weights for policy 1, policy_version 860624 (0.0010) [2023-12-26 06:30:35,405][123090] Updated weights for policy 1, policy_version 860634 (0.0010) [2023-12-26 06:30:35,534][123091] Updated weights for policy 0, policy_version 866838 (0.0010) [2023-12-26 06:30:35,584][123091] Updated weights for policy 0, policy_version 866848 (0.0009) [2023-12-26 06:30:35,646][123091] Updated weights for policy 0, policy_version 866858 (0.0006) [2023-12-26 06:30:36,088][123090] Updated weights for policy 1, policy_version 860644 (0.0010) [2023-12-26 06:30:36,149][123090] Updated weights for policy 1, policy_version 860654 (0.0008) [2023-12-26 06:30:36,205][123090] Updated weights for policy 1, policy_version 860664 (0.0008) [2023-12-26 06:30:36,368][123091] Updated weights for policy 0, policy_version 866868 (0.0006) [2023-12-26 06:30:36,433][123091] Updated weights for policy 0, policy_version 866878 (0.0009) [2023-12-26 06:30:36,498][123091] Updated weights for policy 0, policy_version 866888 (0.0009) [2023-12-26 06:30:37,035][123090] Updated weights for policy 1, policy_version 860674 (0.0009) [2023-12-26 06:30:37,105][123090] Updated weights for policy 1, policy_version 860684 (0.0010) [2023-12-26 06:30:37,171][123090] Updated weights for policy 1, policy_version 860694 (0.0010) [2023-12-26 06:30:37,240][123090] Updated weights for policy 1, policy_version 860704 (0.0010) [2023-12-26 06:30:37,322][123091] Updated weights for policy 0, policy_version 866898 (0.0009) [2023-12-26 06:30:37,369][123091] Updated weights for policy 0, policy_version 866908 (0.0010) [2023-12-26 06:30:37,413][123091] Updated weights for policy 0, policy_version 866918 (0.0010) [2023-12-26 06:30:37,467][123091] Updated weights for policy 0, policy_version 866928 (0.0010) [2023-12-26 06:30:37,976][123090] Updated weights for policy 1, policy_version 860714 (0.0009) [2023-12-26 06:30:38,026][123090] Updated weights for policy 1, policy_version 860724 (0.0008) [2023-12-26 06:30:38,085][123090] Updated weights for policy 1, policy_version 860734 (0.0010) [2023-12-26 06:30:38,280][123091] Updated weights for policy 0, policy_version 866938 (0.0011) [2023-12-26 06:30:38,349][123091] Updated weights for policy 0, policy_version 866948 (0.0008) [2023-12-26 06:30:38,412][123091] Updated weights for policy 0, policy_version 866958 (0.0010) [2023-12-26 06:30:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 442294272. Throughput: 0: 8590.0, 1: 8853.6. Samples: 442270804. Policy #0 lag: (min: 17.0, avg: 37.1, max: 49.0) [2023-12-26 06:30:38,786][121949] Avg episode reward: [(0, '6279.880'), (1, '5458.357')] [2023-12-26 06:30:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000866960_221945856.pth... [2023-12-26 06:30:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000860736_220348416.pth... [2023-12-26 06:30:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000865936_221683712.pth [2023-12-26 06:30:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000859712_220086272.pth [2023-12-26 06:30:38,906][123090] Updated weights for policy 1, policy_version 860744 (0.0007) [2023-12-26 06:30:38,972][123090] Updated weights for policy 1, policy_version 860754 (0.0009) [2023-12-26 06:30:39,032][123090] Updated weights for policy 1, policy_version 860765 (0.0009) [2023-12-26 06:30:39,324][123091] Updated weights for policy 0, policy_version 866968 (0.0009) [2023-12-26 06:30:39,391][123091] Updated weights for policy 0, policy_version 866978 (0.0009) [2023-12-26 06:30:39,459][123091] Updated weights for policy 0, policy_version 866988 (0.0008) [2023-12-26 06:30:39,925][123090] Updated weights for policy 1, policy_version 860775 (0.0011) [2023-12-26 06:30:39,997][123090] Updated weights for policy 1, policy_version 860785 (0.0011) [2023-12-26 06:30:40,066][123090] Updated weights for policy 1, policy_version 860795 (0.0010) [2023-12-26 06:30:40,309][123091] Updated weights for policy 0, policy_version 866998 (0.0009) [2023-12-26 06:30:40,371][123091] Updated weights for policy 0, policy_version 867008 (0.0009) [2023-12-26 06:30:40,435][123091] Updated weights for policy 0, policy_version 867018 (0.0009) [2023-12-26 06:30:40,872][123090] Updated weights for policy 1, policy_version 860805 (0.0010) [2023-12-26 06:30:40,946][123090] Updated weights for policy 1, policy_version 860815 (0.0008) [2023-12-26 06:30:41,006][123090] Updated weights for policy 1, policy_version 860825 (0.0010) [2023-12-26 06:30:41,324][123091] Updated weights for policy 0, policy_version 867028 (0.0009) [2023-12-26 06:30:41,393][123091] Updated weights for policy 0, policy_version 867038 (0.0009) [2023-12-26 06:30:41,444][123091] Updated weights for policy 0, policy_version 867048 (0.0010) [2023-12-26 06:30:41,802][123090] Updated weights for policy 1, policy_version 860835 (0.0010) [2023-12-26 06:30:41,875][123090] Updated weights for policy 1, policy_version 860845 (0.0009) [2023-12-26 06:30:41,939][123090] Updated weights for policy 1, policy_version 860855 (0.0009) [2023-12-26 06:30:42,255][123091] Updated weights for policy 0, policy_version 867058 (0.0009) [2023-12-26 06:30:42,327][123091] Updated weights for policy 0, policy_version 867068 (0.0008) [2023-12-26 06:30:42,396][123091] Updated weights for policy 0, policy_version 867078 (0.0010) [2023-12-26 06:30:42,457][123091] Updated weights for policy 0, policy_version 867088 (0.0011) [2023-12-26 06:30:42,782][123090] Updated weights for policy 1, policy_version 860865 (0.0009) [2023-12-26 06:30:42,834][123090] Updated weights for policy 1, policy_version 860875 (0.0009) [2023-12-26 06:30:42,882][123090] Updated weights for policy 1, policy_version 860885 (0.0009) [2023-12-26 06:30:42,944][123090] Updated weights for policy 1, policy_version 860895 (0.0010) [2023-12-26 06:30:43,242][123091] Updated weights for policy 0, policy_version 867098 (0.0006) [2023-12-26 06:30:43,301][123091] Updated weights for policy 0, policy_version 867108 (0.0006) [2023-12-26 06:30:43,372][123091] Updated weights for policy 0, policy_version 867118 (0.0005) [2023-12-26 06:30:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 442376192. Throughput: 0: 8612.7, 1: 8745.1. Samples: 442372448. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:30:43,785][121949] Avg episode reward: [(0, '6263.219'), (1, '5398.979')] [2023-12-26 06:30:43,875][123090] Updated weights for policy 1, policy_version 860905 (0.0010) [2023-12-26 06:30:43,930][123090] Updated weights for policy 1, policy_version 860915 (0.0010) [2023-12-26 06:30:43,988][123090] Updated weights for policy 1, policy_version 860925 (0.0010) [2023-12-26 06:30:44,055][123091] Updated weights for policy 0, policy_version 867128 (0.0009) [2023-12-26 06:30:44,125][123091] Updated weights for policy 0, policy_version 867138 (0.0009) [2023-12-26 06:30:44,192][123091] Updated weights for policy 0, policy_version 867148 (0.0009) [2023-12-26 06:30:44,882][123090] Updated weights for policy 1, policy_version 860935 (0.0009) [2023-12-26 06:30:44,944][123090] Updated weights for policy 1, policy_version 860945 (0.0009) [2023-12-26 06:30:44,998][123090] Updated weights for policy 1, policy_version 860955 (0.0009) [2023-12-26 06:30:45,000][123091] Updated weights for policy 0, policy_version 867158 (0.0010) [2023-12-26 06:30:45,070][123091] Updated weights for policy 0, policy_version 867168 (0.0011) [2023-12-26 06:30:45,130][123091] Updated weights for policy 0, policy_version 867178 (0.0011) [2023-12-26 06:30:45,762][123090] Updated weights for policy 1, policy_version 860965 (0.0008) [2023-12-26 06:30:45,811][123090] Updated weights for policy 1, policy_version 860975 (0.0009) [2023-12-26 06:30:45,865][123090] Updated weights for policy 1, policy_version 860985 (0.0009) [2023-12-26 06:30:45,934][123091] Updated weights for policy 0, policy_version 867188 (0.0011) [2023-12-26 06:30:45,987][123091] Updated weights for policy 0, policy_version 867198 (0.0007) [2023-12-26 06:30:46,039][123091] Updated weights for policy 0, policy_version 867208 (0.0009) [2023-12-26 06:30:46,665][123090] Updated weights for policy 1, policy_version 860995 (0.0009) [2023-12-26 06:30:46,739][123090] Updated weights for policy 1, policy_version 861005 (0.0008) [2023-12-26 06:30:46,811][123090] Updated weights for policy 1, policy_version 861015 (0.0008) [2023-12-26 06:30:46,856][123091] Updated weights for policy 0, policy_version 867218 (0.0009) [2023-12-26 06:30:46,906][123091] Updated weights for policy 0, policy_version 867228 (0.0008) [2023-12-26 06:30:46,959][123091] Updated weights for policy 0, policy_version 867238 (0.0006) [2023-12-26 06:30:47,028][123091] Updated weights for policy 0, policy_version 867248 (0.0006) [2023-12-26 06:30:47,520][123090] Updated weights for policy 1, policy_version 861025 (0.0007) [2023-12-26 06:30:47,585][123090] Updated weights for policy 1, policy_version 861035 (0.0007) [2023-12-26 06:30:47,651][123090] Updated weights for policy 1, policy_version 861045 (0.0007) [2023-12-26 06:30:47,716][123090] Updated weights for policy 1, policy_version 861055 (0.0007) [2023-12-26 06:30:47,734][123091] Updated weights for policy 0, policy_version 867258 (0.0005) [2023-12-26 06:30:47,779][123091] Updated weights for policy 0, policy_version 867268 (0.0005) [2023-12-26 06:30:47,841][123091] Updated weights for policy 0, policy_version 867278 (0.0006) [2023-12-26 06:30:48,394][123090] Updated weights for policy 1, policy_version 861065 (0.0010) [2023-12-26 06:30:48,461][123090] Updated weights for policy 1, policy_version 861075 (0.0010) [2023-12-26 06:30:48,476][123091] Updated weights for policy 0, policy_version 867288 (0.0007) [2023-12-26 06:30:48,532][123090] Updated weights for policy 1, policy_version 861085 (0.0010) [2023-12-26 06:30:48,540][123091] Updated weights for policy 0, policy_version 867298 (0.0007) [2023-12-26 06:30:48,602][123091] Updated weights for policy 0, policy_version 867308 (0.0006) [2023-12-26 06:30:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 442474496. Throughput: 0: 8731.5, 1: 8728.5. Samples: 442481544. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:30:48,785][121949] Avg episode reward: [(0, '6294.476'), (1, '5296.916')] [2023-12-26 06:30:49,261][123090] Updated weights for policy 1, policy_version 861095 (0.0008) [2023-12-26 06:30:49,300][123091] Updated weights for policy 0, policy_version 867318 (0.0007) [2023-12-26 06:30:49,331][123090] Updated weights for policy 1, policy_version 861105 (0.0009) [2023-12-26 06:30:49,381][123091] Updated weights for policy 0, policy_version 867328 (0.0008) [2023-12-26 06:30:49,400][123090] Updated weights for policy 1, policy_version 861115 (0.0011) [2023-12-26 06:30:49,439][123091] Updated weights for policy 0, policy_version 867338 (0.0007) [2023-12-26 06:30:50,160][123091] Updated weights for policy 0, policy_version 867348 (0.0006) [2023-12-26 06:30:50,166][123090] Updated weights for policy 1, policy_version 861125 (0.0010) [2023-12-26 06:30:50,220][123091] Updated weights for policy 0, policy_version 867358 (0.0006) [2023-12-26 06:30:50,226][123090] Updated weights for policy 1, policy_version 861135 (0.0010) [2023-12-26 06:30:50,284][123091] Updated weights for policy 0, policy_version 867368 (0.0005) [2023-12-26 06:30:50,290][123090] Updated weights for policy 1, policy_version 861145 (0.0010) [2023-12-26 06:30:51,110][123091] Updated weights for policy 0, policy_version 867378 (0.0007) [2023-12-26 06:30:51,153][123090] Updated weights for policy 1, policy_version 861155 (0.0010) [2023-12-26 06:30:51,178][123091] Updated weights for policy 0, policy_version 867388 (0.0007) [2023-12-26 06:30:51,213][123090] Updated weights for policy 1, policy_version 861165 (0.0010) [2023-12-26 06:30:51,241][123091] Updated weights for policy 0, policy_version 867398 (0.0006) [2023-12-26 06:30:51,277][123090] Updated weights for policy 1, policy_version 861175 (0.0010) [2023-12-26 06:30:51,301][123091] Updated weights for policy 0, policy_version 867408 (0.0005) [2023-12-26 06:30:52,095][123091] Updated weights for policy 0, policy_version 867418 (0.0006) [2023-12-26 06:30:52,105][123090] Updated weights for policy 1, policy_version 861185 (0.0010) [2023-12-26 06:30:52,164][123091] Updated weights for policy 0, policy_version 867428 (0.0008) [2023-12-26 06:30:52,169][123090] Updated weights for policy 1, policy_version 861195 (0.0010) [2023-12-26 06:30:52,230][123091] Updated weights for policy 0, policy_version 867438 (0.0007) [2023-12-26 06:30:52,243][123090] Updated weights for policy 1, policy_version 861205 (0.0011) [2023-12-26 06:30:52,307][123090] Updated weights for policy 1, policy_version 861215 (0.0011) [2023-12-26 06:30:52,983][123091] Updated weights for policy 0, policy_version 867448 (0.0008) [2023-12-26 06:30:53,031][123091] Updated weights for policy 0, policy_version 867458 (0.0009) [2023-12-26 06:30:53,075][123090] Updated weights for policy 1, policy_version 861225 (0.0010) [2023-12-26 06:30:53,086][123091] Updated weights for policy 0, policy_version 867468 (0.0006) [2023-12-26 06:30:53,137][123090] Updated weights for policy 1, policy_version 861235 (0.0010) [2023-12-26 06:30:53,215][123090] Updated weights for policy 1, policy_version 861245 (0.0011) [2023-12-26 06:30:53,727][123091] Updated weights for policy 0, policy_version 867478 (0.0005) [2023-12-26 06:30:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 442556416. Throughput: 0: 8806.8, 1: 8683.0. Samples: 442535296. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:30:53,785][121949] Avg episode reward: [(0, '6309.729'), (1, '5057.030')] [2023-12-26 06:30:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000861248_220479488.pth... [2023-12-26 06:30:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000860224_220217344.pth [2023-12-26 06:30:53,793][123091] Updated weights for policy 0, policy_version 867488 (0.0005) [2023-12-26 06:30:53,853][123091] Updated weights for policy 0, policy_version 867498 (0.0005) [2023-12-26 06:30:53,886][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000867504_222085120.pth... [2023-12-26 06:30:53,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000866448_221814784.pth [2023-12-26 06:30:54,029][123090] Updated weights for policy 1, policy_version 861255 (0.0010) [2023-12-26 06:30:54,080][123090] Updated weights for policy 1, policy_version 861265 (0.0010) [2023-12-26 06:30:54,139][123090] Updated weights for policy 1, policy_version 861275 (0.0010) [2023-12-26 06:30:54,564][123091] Updated weights for policy 0, policy_version 867508 (0.0009) [2023-12-26 06:30:54,616][123091] Updated weights for policy 0, policy_version 867518 (0.0010) [2023-12-26 06:30:54,667][123091] Updated weights for policy 0, policy_version 867528 (0.0010) [2023-12-26 06:30:54,976][123090] Updated weights for policy 1, policy_version 861285 (0.0010) [2023-12-26 06:30:55,048][123090] Updated weights for policy 1, policy_version 861295 (0.0011) [2023-12-26 06:30:55,110][123090] Updated weights for policy 1, policy_version 861305 (0.0010) [2023-12-26 06:30:55,498][123091] Updated weights for policy 0, policy_version 867538 (0.0010) [2023-12-26 06:30:55,556][123091] Updated weights for policy 0, policy_version 867548 (0.0010) [2023-12-26 06:30:55,604][123091] Updated weights for policy 0, policy_version 867558 (0.0010) [2023-12-26 06:30:55,655][123091] Updated weights for policy 0, policy_version 867568 (0.0010) [2023-12-26 06:30:55,836][123090] Updated weights for policy 1, policy_version 861315 (0.0009) [2023-12-26 06:30:55,892][123090] Updated weights for policy 1, policy_version 861325 (0.0005) [2023-12-26 06:30:55,947][123090] Updated weights for policy 1, policy_version 861335 (0.0005) [2023-12-26 06:30:56,468][123091] Updated weights for policy 0, policy_version 867578 (0.0010) [2023-12-26 06:30:56,519][123091] Updated weights for policy 0, policy_version 867588 (0.0010) [2023-12-26 06:30:56,563][123091] Updated weights for policy 0, policy_version 867598 (0.0010) [2023-12-26 06:30:56,634][123090] Updated weights for policy 1, policy_version 861345 (0.0007) [2023-12-26 06:30:56,722][123090] Updated weights for policy 1, policy_version 861355 (0.0007) [2023-12-26 06:30:56,783][123090] Updated weights for policy 1, policy_version 861365 (0.0009) [2023-12-26 06:30:56,831][123090] Updated weights for policy 1, policy_version 861375 (0.0009) [2023-12-26 06:30:57,395][123091] Updated weights for policy 0, policy_version 867608 (0.0010) [2023-12-26 06:30:57,456][123091] Updated weights for policy 0, policy_version 867618 (0.0010) [2023-12-26 06:30:57,503][123091] Updated weights for policy 0, policy_version 867628 (0.0010) [2023-12-26 06:30:57,554][123090] Updated weights for policy 1, policy_version 861385 (0.0006) [2023-12-26 06:30:57,616][123090] Updated weights for policy 1, policy_version 861395 (0.0007) [2023-12-26 06:30:57,676][123090] Updated weights for policy 1, policy_version 861405 (0.0005) [2023-12-26 06:30:58,375][123091] Updated weights for policy 0, policy_version 867638 (0.0010) [2023-12-26 06:30:58,422][123090] Updated weights for policy 1, policy_version 861415 (0.0008) [2023-12-26 06:30:58,440][123091] Updated weights for policy 0, policy_version 867648 (0.0010) [2023-12-26 06:30:58,495][123090] Updated weights for policy 1, policy_version 861425 (0.0008) [2023-12-26 06:30:58,510][123091] Updated weights for policy 0, policy_version 867658 (0.0014) [2023-12-26 06:30:58,558][123090] Updated weights for policy 1, policy_version 861435 (0.0008) [2023-12-26 06:30:58,785][121949] Fps is (10 sec: 18021.2, 60 sec: 17612.6, 300 sec: 17744.7). Total num frames: 442654720. Throughput: 0: 8898.4, 1: 8819.0. Samples: 442644888. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:30:58,785][121949] Avg episode reward: [(0, '6306.069'), (1, '5153.044')] [2023-12-26 06:30:59,382][123091] Updated weights for policy 0, policy_version 867668 (0.0010) [2023-12-26 06:30:59,423][123090] Updated weights for policy 1, policy_version 861445 (0.0007) [2023-12-26 06:30:59,441][123091] Updated weights for policy 0, policy_version 867678 (0.0009) [2023-12-26 06:30:59,484][123090] Updated weights for policy 1, policy_version 861455 (0.0005) [2023-12-26 06:30:59,502][123091] Updated weights for policy 0, policy_version 867688 (0.0009) [2023-12-26 06:30:59,534][123090] Updated weights for policy 1, policy_version 861465 (0.0006) [2023-12-26 06:31:00,271][123090] Updated weights for policy 1, policy_version 861475 (0.0007) [2023-12-26 06:31:00,324][123090] Updated weights for policy 1, policy_version 861485 (0.0005) [2023-12-26 06:31:00,371][123091] Updated weights for policy 0, policy_version 867698 (0.0010) [2023-12-26 06:31:00,376][123090] Updated weights for policy 1, policy_version 861495 (0.0005) [2023-12-26 06:31:00,431][123091] Updated weights for policy 0, policy_version 867708 (0.0008) [2023-12-26 06:31:00,487][123091] Updated weights for policy 0, policy_version 867718 (0.0010) [2023-12-26 06:31:00,989][123090] Updated weights for policy 1, policy_version 861505 (0.0005) [2023-12-26 06:31:01,057][123090] Updated weights for policy 1, policy_version 861515 (0.0007) [2023-12-26 06:31:01,116][123090] Updated weights for policy 1, policy_version 861525 (0.0008) [2023-12-26 06:31:01,186][123090] Updated weights for policy 1, policy_version 861535 (0.0009) [2023-12-26 06:31:01,389][123091] Updated weights for policy 0, policy_version 867729 (0.0009) [2023-12-26 06:31:01,457][123091] Updated weights for policy 0, policy_version 867739 (0.0010) [2023-12-26 06:31:01,520][123091] Updated weights for policy 0, policy_version 867749 (0.0010) [2023-12-26 06:31:01,589][123091] Updated weights for policy 0, policy_version 867759 (0.0010) [2023-12-26 06:31:01,974][123090] Updated weights for policy 1, policy_version 861545 (0.0008) [2023-12-26 06:31:02,031][123090] Updated weights for policy 1, policy_version 861555 (0.0008) [2023-12-26 06:31:02,088][123090] Updated weights for policy 1, policy_version 861565 (0.0009) [2023-12-26 06:31:02,417][123091] Updated weights for policy 0, policy_version 867769 (0.0011) [2023-12-26 06:31:02,479][123091] Updated weights for policy 0, policy_version 867779 (0.0011) [2023-12-26 06:31:02,540][123091] Updated weights for policy 0, policy_version 867789 (0.0011) [2023-12-26 06:31:02,893][123090] Updated weights for policy 1, policy_version 861575 (0.0009) [2023-12-26 06:31:02,956][123090] Updated weights for policy 1, policy_version 861585 (0.0010) [2023-12-26 06:31:03,025][123090] Updated weights for policy 1, policy_version 861595 (0.0009) [2023-12-26 06:31:03,335][123091] Updated weights for policy 0, policy_version 867799 (0.0010) [2023-12-26 06:31:03,387][123091] Updated weights for policy 0, policy_version 867809 (0.0009) [2023-12-26 06:31:03,438][123091] Updated weights for policy 0, policy_version 867819 (0.0009) [2023-12-26 06:31:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 442736640. Throughput: 0: 8811.9, 1: 8899.7. Samples: 442748480. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:03,784][121949] Avg episode reward: [(0, '6299.216'), (1, '5174.397')] [2023-12-26 06:31:03,833][123090] Updated weights for policy 1, policy_version 861605 (0.0009) [2023-12-26 06:31:03,892][123090] Updated weights for policy 1, policy_version 861615 (0.0009) [2023-12-26 06:31:03,945][123090] Updated weights for policy 1, policy_version 861625 (0.0009) [2023-12-26 06:31:04,308][123091] Updated weights for policy 0, policy_version 867829 (0.0010) [2023-12-26 06:31:04,371][123091] Updated weights for policy 0, policy_version 867839 (0.0011) [2023-12-26 06:31:04,431][123091] Updated weights for policy 0, policy_version 867849 (0.0011) [2023-12-26 06:31:04,832][123090] Updated weights for policy 1, policy_version 861635 (0.0009) [2023-12-26 06:31:04,884][123090] Updated weights for policy 1, policy_version 861645 (0.0009) [2023-12-26 06:31:04,933][123090] Updated weights for policy 1, policy_version 861655 (0.0008) [2023-12-26 06:31:05,210][123091] Updated weights for policy 0, policy_version 867859 (0.0011) [2023-12-26 06:31:05,265][123091] Updated weights for policy 0, policy_version 867869 (0.0006) [2023-12-26 06:31:05,320][123091] Updated weights for policy 0, policy_version 867879 (0.0005) [2023-12-26 06:31:05,864][123090] Updated weights for policy 1, policy_version 861665 (0.0008) [2023-12-26 06:31:05,909][123091] Updated weights for policy 0, policy_version 867889 (0.0005) [2023-12-26 06:31:05,931][123090] Updated weights for policy 1, policy_version 861675 (0.0009) [2023-12-26 06:31:05,975][123091] Updated weights for policy 0, policy_version 867899 (0.0009) [2023-12-26 06:31:05,987][123090] Updated weights for policy 1, policy_version 861685 (0.0007) [2023-12-26 06:31:06,039][123091] Updated weights for policy 0, policy_version 867909 (0.0011) [2023-12-26 06:31:06,042][123090] Updated weights for policy 1, policy_version 861695 (0.0008) [2023-12-26 06:31:06,103][123091] Updated weights for policy 0, policy_version 867919 (0.0011) [2023-12-26 06:31:06,897][123090] Updated weights for policy 1, policy_version 861705 (0.0008) [2023-12-26 06:31:06,920][123091] Updated weights for policy 0, policy_version 867929 (0.0006) [2023-12-26 06:31:06,962][123090] Updated weights for policy 1, policy_version 861715 (0.0010) [2023-12-26 06:31:06,983][123091] Updated weights for policy 0, policy_version 867939 (0.0005) [2023-12-26 06:31:07,032][123090] Updated weights for policy 1, policy_version 861725 (0.0009) [2023-12-26 06:31:07,044][123091] Updated weights for policy 0, policy_version 867949 (0.0005) [2023-12-26 06:31:07,739][123091] Updated weights for policy 0, policy_version 867959 (0.0009) [2023-12-26 06:31:07,790][123090] Updated weights for policy 1, policy_version 861735 (0.0006) [2023-12-26 06:31:07,807][123091] Updated weights for policy 0, policy_version 867969 (0.0006) [2023-12-26 06:31:07,853][123090] Updated weights for policy 1, policy_version 861745 (0.0006) [2023-12-26 06:31:07,870][123091] Updated weights for policy 0, policy_version 867979 (0.0007) [2023-12-26 06:31:07,917][123090] Updated weights for policy 1, policy_version 861755 (0.0006) [2023-12-26 06:31:08,545][123090] Updated weights for policy 1, policy_version 861765 (0.0005) [2023-12-26 06:31:08,580][123091] Updated weights for policy 0, policy_version 867989 (0.0011) [2023-12-26 06:31:08,598][123090] Updated weights for policy 1, policy_version 861775 (0.0005) [2023-12-26 06:31:08,632][123091] Updated weights for policy 0, policy_version 867999 (0.0011) [2023-12-26 06:31:08,673][123090] Updated weights for policy 1, policy_version 861785 (0.0005) [2023-12-26 06:31:08,699][123091] Updated weights for policy 0, policy_version 868009 (0.0011) [2023-12-26 06:31:08,784][121949] Fps is (10 sec: 18023.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 442834944. Throughput: 0: 8868.7, 1: 8870.1. Samples: 442800696. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:08,785][121949] Avg episode reward: [(0, '6161.906'), (1, '5224.936')] [2023-12-26 06:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000868016_222216192.pth... [2023-12-26 06:31:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000861792_220618752.pth... [2023-12-26 06:31:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000866960_221945856.pth [2023-12-26 06:31:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000860736_220348416.pth [2023-12-26 06:31:09,339][123090] Updated weights for policy 1, policy_version 861795 (0.0005) [2023-12-26 06:31:09,408][123090] Updated weights for policy 1, policy_version 861805 (0.0008) [2023-12-26 06:31:09,471][123091] Updated weights for policy 0, policy_version 868019 (0.0009) [2023-12-26 06:31:09,480][123090] Updated weights for policy 1, policy_version 861815 (0.0008) [2023-12-26 06:31:09,528][123091] Updated weights for policy 0, policy_version 868029 (0.0009) [2023-12-26 06:31:09,594][123091] Updated weights for policy 0, policy_version 868039 (0.0006) [2023-12-26 06:31:10,347][123090] Updated weights for policy 1, policy_version 861825 (0.0009) [2023-12-26 06:31:10,359][123091] Updated weights for policy 0, policy_version 868049 (0.0006) [2023-12-26 06:31:10,419][123090] Updated weights for policy 1, policy_version 861835 (0.0008) [2023-12-26 06:31:10,425][123091] Updated weights for policy 0, policy_version 868059 (0.0006) [2023-12-26 06:31:10,483][123090] Updated weights for policy 1, policy_version 861845 (0.0006) [2023-12-26 06:31:10,493][123091] Updated weights for policy 0, policy_version 868069 (0.0007) [2023-12-26 06:31:10,543][123090] Updated weights for policy 1, policy_version 861855 (0.0006) [2023-12-26 06:31:10,560][123091] Updated weights for policy 0, policy_version 868079 (0.0009) [2023-12-26 06:31:11,284][123090] Updated weights for policy 1, policy_version 861865 (0.0009) [2023-12-26 06:31:11,347][123090] Updated weights for policy 1, policy_version 861875 (0.0008) [2023-12-26 06:31:11,418][123090] Updated weights for policy 1, policy_version 861885 (0.0008) [2023-12-26 06:31:11,419][123091] Updated weights for policy 0, policy_version 868089 (0.0009) [2023-12-26 06:31:11,488][123091] Updated weights for policy 0, policy_version 868099 (0.0010) [2023-12-26 06:31:11,550][123091] Updated weights for policy 0, policy_version 868109 (0.0010) [2023-12-26 06:31:12,192][123090] Updated weights for policy 1, policy_version 861895 (0.0006) [2023-12-26 06:31:12,266][123090] Updated weights for policy 1, policy_version 861905 (0.0008) [2023-12-26 06:31:12,333][123090] Updated weights for policy 1, policy_version 861915 (0.0010) [2023-12-26 06:31:12,412][123091] Updated weights for policy 0, policy_version 868119 (0.0010) [2023-12-26 06:31:12,492][123091] Updated weights for policy 0, policy_version 868129 (0.0006) [2023-12-26 06:31:12,556][123091] Updated weights for policy 0, policy_version 868139 (0.0006) [2023-12-26 06:31:13,083][123090] Updated weights for policy 1, policy_version 861925 (0.0007) [2023-12-26 06:31:13,149][123090] Updated weights for policy 1, policy_version 861935 (0.0007) [2023-12-26 06:31:13,214][123090] Updated weights for policy 1, policy_version 861945 (0.0005) [2023-12-26 06:31:13,262][123091] Updated weights for policy 0, policy_version 868149 (0.0008) [2023-12-26 06:31:13,321][123091] Updated weights for policy 0, policy_version 868159 (0.0010) [2023-12-26 06:31:13,385][123091] Updated weights for policy 0, policy_version 868170 (0.0010) [2023-12-26 06:31:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 442916864. Throughput: 0: 8859.0, 1: 8862.1. Samples: 442909128. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:13,784][121949] Avg episode reward: [(0, '6124.122'), (1, '5207.221')] [2023-12-26 06:31:13,935][123090] Updated weights for policy 1, policy_version 861955 (0.0007) [2023-12-26 06:31:14,001][123090] Updated weights for policy 1, policy_version 861965 (0.0010) [2023-12-26 06:31:14,062][123090] Updated weights for policy 1, policy_version 861975 (0.0010) [2023-12-26 06:31:14,249][123091] Updated weights for policy 0, policy_version 868180 (0.0009) [2023-12-26 06:31:14,317][123091] Updated weights for policy 0, policy_version 868190 (0.0009) [2023-12-26 06:31:14,382][123091] Updated weights for policy 0, policy_version 868200 (0.0009) [2023-12-26 06:31:14,839][123090] Updated weights for policy 1, policy_version 861985 (0.0010) [2023-12-26 06:31:14,894][123090] Updated weights for policy 1, policy_version 861995 (0.0010) [2023-12-26 06:31:14,960][123090] Updated weights for policy 1, policy_version 862005 (0.0009) [2023-12-26 06:31:15,016][123090] Updated weights for policy 1, policy_version 862015 (0.0009) [2023-12-26 06:31:15,127][123091] Updated weights for policy 0, policy_version 868210 (0.0008) [2023-12-26 06:31:15,192][123091] Updated weights for policy 0, policy_version 868220 (0.0011) [2023-12-26 06:31:15,241][123091] Updated weights for policy 0, policy_version 868230 (0.0010) [2023-12-26 06:31:15,312][123091] Updated weights for policy 0, policy_version 868240 (0.0011) [2023-12-26 06:31:15,856][123090] Updated weights for policy 1, policy_version 862025 (0.0008) [2023-12-26 06:31:15,916][123090] Updated weights for policy 1, policy_version 862035 (0.0009) [2023-12-26 06:31:15,976][123090] Updated weights for policy 1, policy_version 862045 (0.0008) [2023-12-26 06:31:16,132][123091] Updated weights for policy 0, policy_version 868250 (0.0011) [2023-12-26 06:31:16,184][123091] Updated weights for policy 0, policy_version 868260 (0.0011) [2023-12-26 06:31:16,232][123091] Updated weights for policy 0, policy_version 868270 (0.0010) [2023-12-26 06:31:16,797][123090] Updated weights for policy 1, policy_version 862055 (0.0009) [2023-12-26 06:31:16,855][123090] Updated weights for policy 1, policy_version 862065 (0.0009) [2023-12-26 06:31:16,916][123090] Updated weights for policy 1, policy_version 862075 (0.0009) [2023-12-26 06:31:17,081][123091] Updated weights for policy 0, policy_version 868280 (0.0010) [2023-12-26 06:31:17,145][123091] Updated weights for policy 0, policy_version 868290 (0.0011) [2023-12-26 06:31:17,200][123091] Updated weights for policy 0, policy_version 868300 (0.0011) [2023-12-26 06:31:17,811][123090] Updated weights for policy 1, policy_version 862085 (0.0009) [2023-12-26 06:31:17,860][123090] Updated weights for policy 1, policy_version 862095 (0.0009) [2023-12-26 06:31:17,911][123090] Updated weights for policy 1, policy_version 862105 (0.0009) [2023-12-26 06:31:18,028][123091] Updated weights for policy 0, policy_version 868310 (0.0011) [2023-12-26 06:31:18,101][123091] Updated weights for policy 0, policy_version 868320 (0.0010) [2023-12-26 06:31:18,176][123091] Updated weights for policy 0, policy_version 868330 (0.0011) [2023-12-26 06:31:18,729][123090] Updated weights for policy 1, policy_version 862115 (0.0009) [2023-12-26 06:31:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 442998784. Throughput: 0: 8897.8, 1: 8875.6. Samples: 443015156. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:18,784][121949] Avg episode reward: [(0, '6232.955'), (1, '5027.553')] [2023-12-26 06:31:18,794][123090] Updated weights for policy 1, policy_version 862125 (0.0009) [2023-12-26 06:31:18,854][123090] Updated weights for policy 1, policy_version 862135 (0.0008) [2023-12-26 06:31:18,989][123091] Updated weights for policy 0, policy_version 868340 (0.0011) [2023-12-26 06:31:19,044][123091] Updated weights for policy 0, policy_version 868350 (0.0010) [2023-12-26 06:31:19,099][123091] Updated weights for policy 0, policy_version 868360 (0.0010) [2023-12-26 06:31:19,600][123090] Updated weights for policy 1, policy_version 862145 (0.0009) [2023-12-26 06:31:19,661][123090] Updated weights for policy 1, policy_version 862155 (0.0009) [2023-12-26 06:31:19,719][123090] Updated weights for policy 1, policy_version 862165 (0.0009) [2023-12-26 06:31:19,780][123090] Updated weights for policy 1, policy_version 862175 (0.0009) [2023-12-26 06:31:19,959][123091] Updated weights for policy 0, policy_version 868370 (0.0010) [2023-12-26 06:31:20,023][123091] Updated weights for policy 0, policy_version 868380 (0.0008) [2023-12-26 06:31:20,088][123091] Updated weights for policy 0, policy_version 868390 (0.0009) [2023-12-26 06:31:20,156][123091] Updated weights for policy 0, policy_version 868400 (0.0007) [2023-12-26 06:31:20,705][123090] Updated weights for policy 1, policy_version 862185 (0.0006) [2023-12-26 06:31:20,783][123090] Updated weights for policy 1, policy_version 862195 (0.0009) [2023-12-26 06:31:20,849][123091] Updated weights for policy 0, policy_version 868410 (0.0006) [2023-12-26 06:31:20,853][123090] Updated weights for policy 1, policy_version 862205 (0.0009) [2023-12-26 06:31:20,921][123091] Updated weights for policy 0, policy_version 868420 (0.0006) [2023-12-26 06:31:20,993][123091] Updated weights for policy 0, policy_version 868430 (0.0007) [2023-12-26 06:31:21,530][123090] Updated weights for policy 1, policy_version 862215 (0.0009) [2023-12-26 06:31:21,595][123090] Updated weights for policy 1, policy_version 862225 (0.0010) [2023-12-26 06:31:21,660][123090] Updated weights for policy 1, policy_version 862235 (0.0008) [2023-12-26 06:31:21,760][123091] Updated weights for policy 0, policy_version 868440 (0.0008) [2023-12-26 06:31:21,830][123091] Updated weights for policy 0, policy_version 868450 (0.0008) [2023-12-26 06:31:21,894][123091] Updated weights for policy 0, policy_version 868460 (0.0008) [2023-12-26 06:31:22,459][123090] Updated weights for policy 1, policy_version 862245 (0.0009) [2023-12-26 06:31:22,528][123090] Updated weights for policy 1, policy_version 862255 (0.0009) [2023-12-26 06:31:22,592][123090] Updated weights for policy 1, policy_version 862265 (0.0009) [2023-12-26 06:31:22,701][123091] Updated weights for policy 0, policy_version 868470 (0.0007) [2023-12-26 06:31:22,762][123091] Updated weights for policy 0, policy_version 868480 (0.0009) [2023-12-26 06:31:22,817][123091] Updated weights for policy 0, policy_version 868490 (0.0009) [2023-12-26 06:31:23,409][123090] Updated weights for policy 1, policy_version 862275 (0.0007) [2023-12-26 06:31:23,462][123090] Updated weights for policy 1, policy_version 862285 (0.0009) [2023-12-26 06:31:23,523][123090] Updated weights for policy 1, policy_version 862295 (0.0007) [2023-12-26 06:31:23,664][123091] Updated weights for policy 0, policy_version 868500 (0.0009) [2023-12-26 06:31:23,718][123091] Updated weights for policy 0, policy_version 868510 (0.0010) [2023-12-26 06:31:23,776][123091] Updated weights for policy 0, policy_version 868520 (0.0010) [2023-12-26 06:31:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 443088896. Throughput: 0: 8868.9, 1: 8840.3. Samples: 443067712. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:23,784][121949] Avg episode reward: [(0, '6375.114'), (1, '5151.558')] [2023-12-26 06:31:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000862304_220749824.pth... [2023-12-26 06:31:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000861248_220479488.pth [2023-12-26 06:31:23,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000868528_222347264.pth... [2023-12-26 06:31:23,822][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000867504_222085120.pth [2023-12-26 06:31:24,219][123090] Updated weights for policy 1, policy_version 862305 (0.0007) [2023-12-26 06:31:24,279][123090] Updated weights for policy 1, policy_version 862315 (0.0005) [2023-12-26 06:31:24,337][123090] Updated weights for policy 1, policy_version 862325 (0.0005) [2023-12-26 06:31:24,394][123090] Updated weights for policy 1, policy_version 862335 (0.0005) [2023-12-26 06:31:24,706][123091] Updated weights for policy 0, policy_version 868530 (0.0009) [2023-12-26 06:31:24,774][123091] Updated weights for policy 0, policy_version 868540 (0.0010) [2023-12-26 06:31:24,843][123091] Updated weights for policy 0, policy_version 868550 (0.0009) [2023-12-26 06:31:24,904][123091] Updated weights for policy 0, policy_version 868560 (0.0009) [2023-12-26 06:31:25,106][123090] Updated weights for policy 1, policy_version 862345 (0.0010) [2023-12-26 06:31:25,163][123090] Updated weights for policy 1, policy_version 862355 (0.0010) [2023-12-26 06:31:25,220][123090] Updated weights for policy 1, policy_version 862365 (0.0005) [2023-12-26 06:31:25,765][123091] Updated weights for policy 0, policy_version 868570 (0.0010) [2023-12-26 06:31:25,828][123091] Updated weights for policy 0, policy_version 868581 (0.0010) [2023-12-26 06:31:25,881][123091] Updated weights for policy 0, policy_version 868591 (0.0009) [2023-12-26 06:31:25,930][123090] Updated weights for policy 1, policy_version 862375 (0.0006) [2023-12-26 06:31:25,988][123090] Updated weights for policy 1, policy_version 862385 (0.0008) [2023-12-26 06:31:26,037][123090] Updated weights for policy 1, policy_version 862395 (0.0009) [2023-12-26 06:31:26,676][123091] Updated weights for policy 0, policy_version 868601 (0.0006) [2023-12-26 06:31:26,733][123091] Updated weights for policy 0, policy_version 868611 (0.0006) [2023-12-26 06:31:26,767][123090] Updated weights for policy 1, policy_version 862405 (0.0007) [2023-12-26 06:31:26,781][123091] Updated weights for policy 0, policy_version 868621 (0.0008) [2023-12-26 06:31:26,840][123090] Updated weights for policy 1, policy_version 862415 (0.0005) [2023-12-26 06:31:26,904][123090] Updated weights for policy 1, policy_version 862425 (0.0005) [2023-12-26 06:31:27,525][123090] Updated weights for policy 1, policy_version 862435 (0.0006) [2023-12-26 06:31:27,533][123091] Updated weights for policy 0, policy_version 868631 (0.0006) [2023-12-26 06:31:27,573][123090] Updated weights for policy 1, policy_version 862445 (0.0008) [2023-12-26 06:31:27,580][123091] Updated weights for policy 0, policy_version 868641 (0.0005) [2023-12-26 06:31:27,623][123090] Updated weights for policy 1, policy_version 862456 (0.0009) [2023-12-26 06:31:27,625][123091] Updated weights for policy 0, policy_version 868651 (0.0005) [2023-12-26 06:31:28,336][123091] Updated weights for policy 0, policy_version 868661 (0.0008) [2023-12-26 06:31:28,352][123090] Updated weights for policy 1, policy_version 862466 (0.0007) [2023-12-26 06:31:28,396][123091] Updated weights for policy 0, policy_version 868671 (0.0011) [2023-12-26 06:31:28,411][123090] Updated weights for policy 1, policy_version 862476 (0.0008) [2023-12-26 06:31:28,455][123091] Updated weights for policy 0, policy_version 868681 (0.0011) [2023-12-26 06:31:28,472][123090] Updated weights for policy 1, policy_version 862486 (0.0008) [2023-12-26 06:31:28,520][123090] Updated weights for policy 1, policy_version 862496 (0.0010) [2023-12-26 06:31:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 443187200. Throughput: 0: 8901.0, 1: 8964.9. Samples: 443176416. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:28,785][121949] Avg episode reward: [(0, '6327.783'), (1, '5327.746')] [2023-12-26 06:31:29,190][123091] Updated weights for policy 0, policy_version 868691 (0.0010) [2023-12-26 06:31:29,251][123091] Updated weights for policy 0, policy_version 868701 (0.0008) [2023-12-26 06:31:29,311][123091] Updated weights for policy 0, policy_version 868711 (0.0009) [2023-12-26 06:31:29,361][123090] Updated weights for policy 1, policy_version 862506 (0.0011) [2023-12-26 06:31:29,431][123090] Updated weights for policy 1, policy_version 862516 (0.0011) [2023-12-26 06:31:29,498][123090] Updated weights for policy 1, policy_version 862526 (0.0010) [2023-12-26 06:31:30,173][123091] Updated weights for policy 0, policy_version 868721 (0.0009) [2023-12-26 06:31:30,245][123091] Updated weights for policy 0, policy_version 868731 (0.0005) [2023-12-26 06:31:30,317][123091] Updated weights for policy 0, policy_version 868741 (0.0006) [2023-12-26 06:31:30,348][123090] Updated weights for policy 1, policy_version 862536 (0.0010) [2023-12-26 06:31:30,381][123091] Updated weights for policy 0, policy_version 868751 (0.0008) [2023-12-26 06:31:30,416][123090] Updated weights for policy 1, policy_version 862546 (0.0005) [2023-12-26 06:31:30,485][123090] Updated weights for policy 1, policy_version 862556 (0.0006) [2023-12-26 06:31:31,089][123091] Updated weights for policy 0, policy_version 868761 (0.0011) [2023-12-26 06:31:31,150][123091] Updated weights for policy 0, policy_version 868771 (0.0010) [2023-12-26 06:31:31,157][123090] Updated weights for policy 1, policy_version 862566 (0.0007) [2023-12-26 06:31:31,213][123091] Updated weights for policy 0, policy_version 868781 (0.0010) [2023-12-26 06:31:31,223][123090] Updated weights for policy 1, policy_version 862576 (0.0007) [2023-12-26 06:31:31,288][123090] Updated weights for policy 1, policy_version 862586 (0.0009) [2023-12-26 06:31:32,038][123091] Updated weights for policy 0, policy_version 868791 (0.0009) [2023-12-26 06:31:32,099][123091] Updated weights for policy 0, policy_version 868801 (0.0009) [2023-12-26 06:31:32,111][123090] Updated weights for policy 1, policy_version 862596 (0.0010) [2023-12-26 06:31:32,144][123091] Updated weights for policy 0, policy_version 868811 (0.0007) [2023-12-26 06:31:32,163][123090] Updated weights for policy 1, policy_version 862606 (0.0010) [2023-12-26 06:31:32,210][123090] Updated weights for policy 1, policy_version 862616 (0.0010) [2023-12-26 06:31:32,967][123091] Updated weights for policy 0, policy_version 868821 (0.0007) [2023-12-26 06:31:33,023][123091] Updated weights for policy 0, policy_version 868831 (0.0005) [2023-12-26 06:31:33,034][123090] Updated weights for policy 1, policy_version 862626 (0.0009) [2023-12-26 06:31:33,084][123091] Updated weights for policy 0, policy_version 868841 (0.0005) [2023-12-26 06:31:33,084][123090] Updated weights for policy 1, policy_version 862636 (0.0007) [2023-12-26 06:31:33,136][123090] Updated weights for policy 1, policy_version 862646 (0.0007) [2023-12-26 06:31:33,191][123090] Updated weights for policy 1, policy_version 862656 (0.0005) [2023-12-26 06:31:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 443269120. Throughput: 0: 8864.8, 1: 9005.9. Samples: 443285728. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:33,785][121949] Avg episode reward: [(0, '6202.514'), (1, '5537.712')] [2023-12-26 06:31:33,834][123090] Updated weights for policy 1, policy_version 862666 (0.0010) [2023-12-26 06:31:33,841][123091] Updated weights for policy 0, policy_version 868851 (0.0006) [2023-12-26 06:31:33,890][123090] Updated weights for policy 1, policy_version 862676 (0.0010) [2023-12-26 06:31:33,902][123091] Updated weights for policy 0, policy_version 868861 (0.0006) [2023-12-26 06:31:33,943][123090] Updated weights for policy 1, policy_version 862686 (0.0010) [2023-12-26 06:31:33,948][123091] Updated weights for policy 0, policy_version 868871 (0.0009) [2023-12-26 06:31:34,736][123090] Updated weights for policy 1, policy_version 862696 (0.0006) [2023-12-26 06:31:34,792][123090] Updated weights for policy 1, policy_version 862706 (0.0005) [2023-12-26 06:31:34,862][123090] Updated weights for policy 1, policy_version 862716 (0.0006) [2023-12-26 06:31:34,894][123091] Updated weights for policy 0, policy_version 868881 (0.0009) [2023-12-26 06:31:34,959][123091] Updated weights for policy 0, policy_version 868891 (0.0009) [2023-12-26 06:31:35,021][123091] Updated weights for policy 0, policy_version 868901 (0.0010) [2023-12-26 06:31:35,082][123091] Updated weights for policy 0, policy_version 868911 (0.0010) [2023-12-26 06:31:35,581][123090] Updated weights for policy 1, policy_version 862726 (0.0008) [2023-12-26 06:31:35,628][123090] Updated weights for policy 1, policy_version 862736 (0.0010) [2023-12-26 06:31:35,682][123090] Updated weights for policy 1, policy_version 862747 (0.0007) [2023-12-26 06:31:35,971][123091] Updated weights for policy 0, policy_version 868921 (0.0007) [2023-12-26 06:31:36,028][123091] Updated weights for policy 0, policy_version 868931 (0.0009) [2023-12-26 06:31:36,080][123091] Updated weights for policy 0, policy_version 868941 (0.0009) [2023-12-26 06:31:36,455][123090] Updated weights for policy 1, policy_version 862757 (0.0008) [2023-12-26 06:31:36,521][123090] Updated weights for policy 1, policy_version 862767 (0.0010) [2023-12-26 06:31:36,583][123090] Updated weights for policy 1, policy_version 862777 (0.0009) [2023-12-26 06:31:36,947][123091] Updated weights for policy 0, policy_version 868951 (0.0009) [2023-12-26 06:31:36,997][123091] Updated weights for policy 0, policy_version 868961 (0.0009) [2023-12-26 06:31:37,050][123091] Updated weights for policy 0, policy_version 868971 (0.0009) [2023-12-26 06:31:37,410][123090] Updated weights for policy 1, policy_version 862787 (0.0010) [2023-12-26 06:31:37,473][123090] Updated weights for policy 1, policy_version 862797 (0.0010) [2023-12-26 06:31:37,539][123090] Updated weights for policy 1, policy_version 862807 (0.0011) [2023-12-26 06:31:37,914][123091] Updated weights for policy 0, policy_version 868981 (0.0009) [2023-12-26 06:31:37,979][123091] Updated weights for policy 0, policy_version 868991 (0.0009) [2023-12-26 06:31:38,037][123091] Updated weights for policy 0, policy_version 869001 (0.0009) [2023-12-26 06:31:38,358][123090] Updated weights for policy 1, policy_version 862817 (0.0010) [2023-12-26 06:31:38,430][123090] Updated weights for policy 1, policy_version 862827 (0.0006) [2023-12-26 06:31:38,497][123090] Updated weights for policy 1, policy_version 862837 (0.0010) [2023-12-26 06:31:38,563][123090] Updated weights for policy 1, policy_version 862847 (0.0010) [2023-12-26 06:31:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 443359232. Throughput: 0: 8782.9, 1: 9052.0. Samples: 443337864. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:38,785][121949] Avg episode reward: [(0, '6043.114'), (1, '5542.202')] [2023-12-26 06:31:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000869008_222470144.pth... [2023-12-26 06:31:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000862848_220889088.pth... [2023-12-26 06:31:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000868016_222216192.pth [2023-12-26 06:31:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000861792_220618752.pth [2023-12-26 06:31:38,907][123091] Updated weights for policy 0, policy_version 869011 (0.0009) [2023-12-26 06:31:38,964][123091] Updated weights for policy 0, policy_version 869021 (0.0009) [2023-12-26 06:31:39,025][123091] Updated weights for policy 0, policy_version 869031 (0.0009) [2023-12-26 06:31:39,267][123090] Updated weights for policy 1, policy_version 862857 (0.0010) [2023-12-26 06:31:39,343][123090] Updated weights for policy 1, policy_version 862867 (0.0007) [2023-12-26 06:31:39,420][123090] Updated weights for policy 1, policy_version 862877 (0.0008) [2023-12-26 06:31:39,943][123091] Updated weights for policy 0, policy_version 869041 (0.0010) [2023-12-26 06:31:40,010][123091] Updated weights for policy 0, policy_version 869051 (0.0011) [2023-12-26 06:31:40,077][123091] Updated weights for policy 0, policy_version 869061 (0.0011) [2023-12-26 06:31:40,150][123091] Updated weights for policy 0, policy_version 869071 (0.0009) [2023-12-26 06:31:40,195][123090] Updated weights for policy 1, policy_version 862887 (0.0009) [2023-12-26 06:31:40,259][123090] Updated weights for policy 1, policy_version 862897 (0.0010) [2023-12-26 06:31:40,324][123090] Updated weights for policy 1, policy_version 862907 (0.0008) [2023-12-26 06:31:40,945][123091] Updated weights for policy 0, policy_version 869081 (0.0010) [2023-12-26 06:31:41,017][123091] Updated weights for policy 0, policy_version 869091 (0.0011) [2023-12-26 06:31:41,064][123090] Updated weights for policy 1, policy_version 862917 (0.0007) [2023-12-26 06:31:41,086][123091] Updated weights for policy 0, policy_version 869101 (0.0009) [2023-12-26 06:31:41,139][123090] Updated weights for policy 1, policy_version 862927 (0.0009) [2023-12-26 06:31:41,211][123090] Updated weights for policy 1, policy_version 862937 (0.0008) [2023-12-26 06:31:41,934][123091] Updated weights for policy 0, policy_version 869111 (0.0010) [2023-12-26 06:31:41,996][123091] Updated weights for policy 0, policy_version 869121 (0.0010) [2023-12-26 06:31:42,052][123090] Updated weights for policy 1, policy_version 862947 (0.0009) [2023-12-26 06:31:42,060][123091] Updated weights for policy 0, policy_version 869131 (0.0008) [2023-12-26 06:31:42,113][123090] Updated weights for policy 1, policy_version 862957 (0.0008) [2023-12-26 06:31:42,180][123090] Updated weights for policy 1, policy_version 862967 (0.0010) [2023-12-26 06:31:42,944][123090] Updated weights for policy 1, policy_version 862977 (0.0009) [2023-12-26 06:31:42,952][123091] Updated weights for policy 0, policy_version 869141 (0.0009) [2023-12-26 06:31:43,014][123090] Updated weights for policy 1, policy_version 862987 (0.0005) [2023-12-26 06:31:43,020][123091] Updated weights for policy 0, policy_version 869151 (0.0011) [2023-12-26 06:31:43,071][123090] Updated weights for policy 1, policy_version 862997 (0.0006) [2023-12-26 06:31:43,076][123091] Updated weights for policy 0, policy_version 869161 (0.0011) [2023-12-26 06:31:43,124][123090] Updated weights for policy 1, policy_version 863007 (0.0007) [2023-12-26 06:31:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 443441152. Throughput: 0: 8653.2, 1: 9013.1. Samples: 443439860. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:43,785][121949] Avg episode reward: [(0, '5992.646'), (1, '5403.891')] [2023-12-26 06:31:43,891][123091] Updated weights for policy 0, policy_version 869171 (0.0010) [2023-12-26 06:31:43,915][123090] Updated weights for policy 1, policy_version 863017 (0.0009) [2023-12-26 06:31:43,947][123091] Updated weights for policy 0, policy_version 869181 (0.0005) [2023-12-26 06:31:43,972][123090] Updated weights for policy 1, policy_version 863027 (0.0009) [2023-12-26 06:31:44,000][123091] Updated weights for policy 0, policy_version 869191 (0.0005) [2023-12-26 06:31:44,024][123090] Updated weights for policy 1, policy_version 863038 (0.0009) [2023-12-26 06:31:44,705][123091] Updated weights for policy 0, policy_version 869201 (0.0006) [2023-12-26 06:31:44,765][123091] Updated weights for policy 0, policy_version 869211 (0.0006) [2023-12-26 06:31:44,835][123091] Updated weights for policy 0, policy_version 869221 (0.0006) [2023-12-26 06:31:44,903][123091] Updated weights for policy 0, policy_version 869231 (0.0006) [2023-12-26 06:31:44,949][123090] Updated weights for policy 1, policy_version 863048 (0.0009) [2023-12-26 06:31:45,011][123090] Updated weights for policy 1, policy_version 863058 (0.0009) [2023-12-26 06:31:45,073][123090] Updated weights for policy 1, policy_version 863068 (0.0009) [2023-12-26 06:31:45,593][123091] Updated weights for policy 0, policy_version 869241 (0.0010) [2023-12-26 06:31:45,665][123091] Updated weights for policy 0, policy_version 869251 (0.0011) [2023-12-26 06:31:45,720][123091] Updated weights for policy 0, policy_version 869261 (0.0010) [2023-12-26 06:31:45,939][123090] Updated weights for policy 1, policy_version 863078 (0.0009) [2023-12-26 06:31:46,005][123090] Updated weights for policy 1, policy_version 863088 (0.0009) [2023-12-26 06:31:46,062][123090] Updated weights for policy 1, policy_version 863098 (0.0009) [2023-12-26 06:31:46,540][123091] Updated weights for policy 0, policy_version 869271 (0.0010) [2023-12-26 06:31:46,602][123091] Updated weights for policy 0, policy_version 869281 (0.0010) [2023-12-26 06:31:46,660][123091] Updated weights for policy 0, policy_version 869291 (0.0011) [2023-12-26 06:31:46,810][123090] Updated weights for policy 1, policy_version 863108 (0.0009) [2023-12-26 06:31:46,882][123090] Updated weights for policy 1, policy_version 863118 (0.0009) [2023-12-26 06:31:46,952][123090] Updated weights for policy 1, policy_version 863128 (0.0008) [2023-12-26 06:31:47,452][123091] Updated weights for policy 0, policy_version 869301 (0.0008) [2023-12-26 06:31:47,523][123091] Updated weights for policy 0, policy_version 869311 (0.0006) [2023-12-26 06:31:47,579][123091] Updated weights for policy 0, policy_version 869321 (0.0006) [2023-12-26 06:31:47,770][123090] Updated weights for policy 1, policy_version 863138 (0.0007) [2023-12-26 06:31:47,829][123090] Updated weights for policy 1, policy_version 863148 (0.0010) [2023-12-26 06:31:47,893][123090] Updated weights for policy 1, policy_version 863158 (0.0010) [2023-12-26 06:31:47,956][123090] Updated weights for policy 1, policy_version 863168 (0.0009) [2023-12-26 06:31:48,264][123091] Updated weights for policy 0, policy_version 869331 (0.0007) [2023-12-26 06:31:48,333][123091] Updated weights for policy 0, policy_version 869341 (0.0010) [2023-12-26 06:31:48,405][123091] Updated weights for policy 0, policy_version 869351 (0.0009) [2023-12-26 06:31:48,778][123090] Updated weights for policy 1, policy_version 863178 (0.0011) [2023-12-26 06:31:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 443531264. Throughput: 0: 8772.8, 1: 8939.1. Samples: 443545516. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:48,784][121949] Avg episode reward: [(0, '6072.612'), (1, '5251.089')] [2023-12-26 06:31:48,830][123090] Updated weights for policy 1, policy_version 863188 (0.0010) [2023-12-26 06:31:48,888][123090] Updated weights for policy 1, policy_version 863198 (0.0009) [2023-12-26 06:31:49,126][123091] Updated weights for policy 0, policy_version 869361 (0.0006) [2023-12-26 06:31:49,193][123091] Updated weights for policy 0, policy_version 869371 (0.0009) [2023-12-26 06:31:49,268][123091] Updated weights for policy 0, policy_version 869381 (0.0008) [2023-12-26 06:31:49,334][123091] Updated weights for policy 0, policy_version 869391 (0.0008) [2023-12-26 06:31:49,629][123090] Updated weights for policy 1, policy_version 863208 (0.0006) [2023-12-26 06:31:49,683][123090] Updated weights for policy 1, policy_version 863218 (0.0006) [2023-12-26 06:31:49,737][123090] Updated weights for policy 1, policy_version 863228 (0.0009) [2023-12-26 06:31:50,151][123091] Updated weights for policy 0, policy_version 869401 (0.0006) [2023-12-26 06:31:50,204][123091] Updated weights for policy 0, policy_version 869411 (0.0005) [2023-12-26 06:31:50,269][123091] Updated weights for policy 0, policy_version 869421 (0.0008) [2023-12-26 06:31:50,523][123090] Updated weights for policy 1, policy_version 863238 (0.0010) [2023-12-26 06:31:50,579][123090] Updated weights for policy 1, policy_version 863248 (0.0010) [2023-12-26 06:31:50,654][123090] Updated weights for policy 1, policy_version 863258 (0.0011) [2023-12-26 06:31:51,008][123091] Updated weights for policy 0, policy_version 869431 (0.0008) [2023-12-26 06:31:51,071][123091] Updated weights for policy 0, policy_version 869441 (0.0006) [2023-12-26 06:31:51,135][123091] Updated weights for policy 0, policy_version 869451 (0.0009) [2023-12-26 06:31:51,469][123090] Updated weights for policy 1, policy_version 863268 (0.0008) [2023-12-26 06:31:51,529][123090] Updated weights for policy 1, policy_version 863278 (0.0005) [2023-12-26 06:31:51,599][123090] Updated weights for policy 1, policy_version 863288 (0.0010) [2023-12-26 06:31:51,886][123091] Updated weights for policy 0, policy_version 869461 (0.0008) [2023-12-26 06:31:51,943][123091] Updated weights for policy 0, policy_version 869471 (0.0006) [2023-12-26 06:31:52,007][123091] Updated weights for policy 0, policy_version 869481 (0.0005) [2023-12-26 06:31:52,246][123090] Updated weights for policy 1, policy_version 863298 (0.0008) [2023-12-26 06:31:52,309][123090] Updated weights for policy 1, policy_version 863309 (0.0009) [2023-12-26 06:31:52,367][123090] Updated weights for policy 1, policy_version 863319 (0.0009) [2023-12-26 06:31:52,677][123091] Updated weights for policy 0, policy_version 869491 (0.0007) [2023-12-26 06:31:52,743][123091] Updated weights for policy 0, policy_version 869501 (0.0010) [2023-12-26 06:31:52,809][123091] Updated weights for policy 0, policy_version 869511 (0.0009) [2023-12-26 06:31:53,232][123090] Updated weights for policy 1, policy_version 863329 (0.0010) [2023-12-26 06:31:53,296][123090] Updated weights for policy 1, policy_version 863339 (0.0008) [2023-12-26 06:31:53,352][123090] Updated weights for policy 1, policy_version 863349 (0.0009) [2023-12-26 06:31:53,407][123090] Updated weights for policy 1, policy_version 863359 (0.0009) [2023-12-26 06:31:53,594][123091] Updated weights for policy 0, policy_version 869521 (0.0009) [2023-12-26 06:31:53,653][123091] Updated weights for policy 0, policy_version 869531 (0.0007) [2023-12-26 06:31:53,707][123091] Updated weights for policy 0, policy_version 869541 (0.0006) [2023-12-26 06:31:53,764][123091] Updated weights for policy 0, policy_version 869551 (0.0005) [2023-12-26 06:31:53,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 443629568. Throughput: 0: 8763.8, 1: 9008.7. Samples: 443600456. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:53,785][121949] Avg episode reward: [(0, '6285.728'), (1, '5300.398')] [2023-12-26 06:31:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000869552_222609408.pth... [2023-12-26 06:31:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000863360_221020160.pth... [2023-12-26 06:31:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000868528_222347264.pth [2023-12-26 06:31:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000862304_220749824.pth [2023-12-26 06:31:54,142][123090] Updated weights for policy 1, policy_version 863369 (0.0009) [2023-12-26 06:31:54,209][123090] Updated weights for policy 1, policy_version 863379 (0.0005) [2023-12-26 06:31:54,278][123090] Updated weights for policy 1, policy_version 863389 (0.0005) [2023-12-26 06:31:54,490][123091] Updated weights for policy 0, policy_version 869561 (0.0005) [2023-12-26 06:31:54,569][123091] Updated weights for policy 0, policy_version 869571 (0.0005) [2023-12-26 06:31:54,639][123091] Updated weights for policy 0, policy_version 869581 (0.0005) [2023-12-26 06:31:55,003][123090] Updated weights for policy 1, policy_version 863399 (0.0009) [2023-12-26 06:31:55,059][123090] Updated weights for policy 1, policy_version 863409 (0.0010) [2023-12-26 06:31:55,119][123090] Updated weights for policy 1, policy_version 863419 (0.0010) [2023-12-26 06:31:55,261][123091] Updated weights for policy 0, policy_version 869591 (0.0007) [2023-12-26 06:31:55,310][123091] Updated weights for policy 0, policy_version 869601 (0.0005) [2023-12-26 06:31:55,359][123091] Updated weights for policy 0, policy_version 869611 (0.0006) [2023-12-26 06:31:55,907][123090] Updated weights for policy 1, policy_version 863429 (0.0008) [2023-12-26 06:31:55,970][123090] Updated weights for policy 1, policy_version 863439 (0.0005) [2023-12-26 06:31:56,031][123090] Updated weights for policy 1, policy_version 863449 (0.0005) [2023-12-26 06:31:56,105][123091] Updated weights for policy 0, policy_version 869621 (0.0008) [2023-12-26 06:31:56,169][123091] Updated weights for policy 0, policy_version 869631 (0.0008) [2023-12-26 06:31:56,223][123091] Updated weights for policy 0, policy_version 869641 (0.0008) [2023-12-26 06:31:56,782][123090] Updated weights for policy 1, policy_version 863459 (0.0010) [2023-12-26 06:31:56,837][123090] Updated weights for policy 1, policy_version 863469 (0.0010) [2023-12-26 06:31:56,896][123090] Updated weights for policy 1, policy_version 863479 (0.0010) [2023-12-26 06:31:57,001][123091] Updated weights for policy 0, policy_version 869651 (0.0008) [2023-12-26 06:31:57,050][123091] Updated weights for policy 0, policy_version 869661 (0.0007) [2023-12-26 06:31:57,112][123091] Updated weights for policy 0, policy_version 869671 (0.0010) [2023-12-26 06:31:57,636][123090] Updated weights for policy 1, policy_version 863489 (0.0010) [2023-12-26 06:31:57,694][123090] Updated weights for policy 1, policy_version 863499 (0.0009) [2023-12-26 06:31:57,752][123090] Updated weights for policy 1, policy_version 863509 (0.0010) [2023-12-26 06:31:57,773][123091] Updated weights for policy 0, policy_version 869681 (0.0010) [2023-12-26 06:31:57,815][123090] Updated weights for policy 1, policy_version 863519 (0.0010) [2023-12-26 06:31:57,831][123091] Updated weights for policy 0, policy_version 869691 (0.0005) [2023-12-26 06:31:57,882][123091] Updated weights for policy 0, policy_version 869701 (0.0005) [2023-12-26 06:31:57,930][123091] Updated weights for policy 0, policy_version 869711 (0.0005) [2023-12-26 06:31:58,612][123090] Updated weights for policy 1, policy_version 863529 (0.0008) [2023-12-26 06:31:58,685][123090] Updated weights for policy 1, policy_version 863539 (0.0007) [2023-12-26 06:31:58,690][123091] Updated weights for policy 0, policy_version 869721 (0.0007) [2023-12-26 06:31:58,758][123090] Updated weights for policy 1, policy_version 863549 (0.0007) [2023-12-26 06:31:58,758][123091] Updated weights for policy 0, policy_version 869731 (0.0007) [2023-12-26 06:31:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.5, 300 sec: 17772.5). Total num frames: 443719680. Throughput: 0: 8843.6, 1: 9035.6. Samples: 443713696. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:31:58,785][121949] Avg episode reward: [(0, '6276.665'), (1, '5485.724')] [2023-12-26 06:31:58,821][123091] Updated weights for policy 0, policy_version 869741 (0.0007) [2023-12-26 06:31:59,610][123090] Updated weights for policy 1, policy_version 863559 (0.0008) [2023-12-26 06:31:59,641][123091] Updated weights for policy 0, policy_version 869751 (0.0008) [2023-12-26 06:31:59,672][123090] Updated weights for policy 1, policy_version 863569 (0.0010) [2023-12-26 06:31:59,705][123091] Updated weights for policy 0, policy_version 869761 (0.0008) [2023-12-26 06:31:59,732][123090] Updated weights for policy 1, policy_version 863579 (0.0008) [2023-12-26 06:31:59,762][123091] Updated weights for policy 0, policy_version 869771 (0.0008) [2023-12-26 06:32:00,515][123091] Updated weights for policy 0, policy_version 869781 (0.0006) [2023-12-26 06:32:00,553][123090] Updated weights for policy 1, policy_version 863589 (0.0009) [2023-12-26 06:32:00,585][123091] Updated weights for policy 0, policy_version 869791 (0.0007) [2023-12-26 06:32:00,612][123090] Updated weights for policy 1, policy_version 863599 (0.0008) [2023-12-26 06:32:00,635][123091] Updated weights for policy 0, policy_version 869801 (0.0009) [2023-12-26 06:32:00,667][123090] Updated weights for policy 1, policy_version 863609 (0.0008) [2023-12-26 06:32:01,426][123090] Updated weights for policy 1, policy_version 863619 (0.0008) [2023-12-26 06:32:01,446][123091] Updated weights for policy 0, policy_version 869811 (0.0007) [2023-12-26 06:32:01,485][123090] Updated weights for policy 1, policy_version 863629 (0.0010) [2023-12-26 06:32:01,496][123091] Updated weights for policy 0, policy_version 869821 (0.0008) [2023-12-26 06:32:01,540][123090] Updated weights for policy 1, policy_version 863639 (0.0010) [2023-12-26 06:32:01,544][123091] Updated weights for policy 0, policy_version 869831 (0.0006) [2023-12-26 06:32:02,387][123090] Updated weights for policy 1, policy_version 863649 (0.0010) [2023-12-26 06:32:02,415][123091] Updated weights for policy 0, policy_version 869841 (0.0009) [2023-12-26 06:32:02,447][123090] Updated weights for policy 1, policy_version 863659 (0.0010) [2023-12-26 06:32:02,463][123091] Updated weights for policy 0, policy_version 869851 (0.0007) [2023-12-26 06:32:02,505][123090] Updated weights for policy 1, policy_version 863669 (0.0010) [2023-12-26 06:32:02,508][123091] Updated weights for policy 0, policy_version 869861 (0.0008) [2023-12-26 06:32:02,554][123090] Updated weights for policy 1, policy_version 863679 (0.0010) [2023-12-26 06:32:02,557][123091] Updated weights for policy 0, policy_version 869871 (0.0006) [2023-12-26 06:32:03,292][123090] Updated weights for policy 1, policy_version 863689 (0.0006) [2023-12-26 06:32:03,358][123090] Updated weights for policy 1, policy_version 863699 (0.0006) [2023-12-26 06:32:03,406][123090] Updated weights for policy 1, policy_version 863709 (0.0005) [2023-12-26 06:32:03,450][123091] Updated weights for policy 0, policy_version 869881 (0.0009) [2023-12-26 06:32:03,500][123091] Updated weights for policy 0, policy_version 869891 (0.0010) [2023-12-26 06:32:03,552][123091] Updated weights for policy 0, policy_version 869901 (0.0010) [2023-12-26 06:32:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 443809792. Throughput: 0: 8826.1, 1: 9025.1. Samples: 443818460. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:03,784][121949] Avg episode reward: [(0, '6140.638'), (1, '5191.861')] [2023-12-26 06:32:04,098][123090] Updated weights for policy 1, policy_version 863719 (0.0007) [2023-12-26 06:32:04,168][123090] Updated weights for policy 1, policy_version 863729 (0.0008) [2023-12-26 06:32:04,233][123090] Updated weights for policy 1, policy_version 863739 (0.0009) [2023-12-26 06:32:04,451][123091] Updated weights for policy 0, policy_version 869911 (0.0010) [2023-12-26 06:32:04,516][123091] Updated weights for policy 0, policy_version 869921 (0.0010) [2023-12-26 06:32:04,579][123091] Updated weights for policy 0, policy_version 869931 (0.0010) [2023-12-26 06:32:05,042][123090] Updated weights for policy 1, policy_version 863749 (0.0010) [2023-12-26 06:32:05,107][123090] Updated weights for policy 1, policy_version 863759 (0.0010) [2023-12-26 06:32:05,167][123090] Updated weights for policy 1, policy_version 863769 (0.0009) [2023-12-26 06:32:05,406][123091] Updated weights for policy 0, policy_version 869941 (0.0010) [2023-12-26 06:32:05,455][123091] Updated weights for policy 0, policy_version 869951 (0.0009) [2023-12-26 06:32:05,512][123091] Updated weights for policy 0, policy_version 869961 (0.0009) [2023-12-26 06:32:05,978][123090] Updated weights for policy 1, policy_version 863779 (0.0009) [2023-12-26 06:32:06,048][123090] Updated weights for policy 1, policy_version 863789 (0.0007) [2023-12-26 06:32:06,123][123090] Updated weights for policy 1, policy_version 863799 (0.0007) [2023-12-26 06:32:06,284][123091] Updated weights for policy 0, policy_version 869971 (0.0008) [2023-12-26 06:32:06,348][123091] Updated weights for policy 0, policy_version 869981 (0.0009) [2023-12-26 06:32:06,414][123091] Updated weights for policy 0, policy_version 869991 (0.0009) [2023-12-26 06:32:06,893][123090] Updated weights for policy 1, policy_version 863809 (0.0008) [2023-12-26 06:32:06,950][123090] Updated weights for policy 1, policy_version 863819 (0.0010) [2023-12-26 06:32:07,004][123090] Updated weights for policy 1, policy_version 863829 (0.0010) [2023-12-26 06:32:07,063][123090] Updated weights for policy 1, policy_version 863839 (0.0008) [2023-12-26 06:32:07,295][123091] Updated weights for policy 0, policy_version 870001 (0.0010) [2023-12-26 06:32:07,362][123091] Updated weights for policy 0, policy_version 870011 (0.0009) [2023-12-26 06:32:07,419][123091] Updated weights for policy 0, policy_version 870021 (0.0010) [2023-12-26 06:32:07,476][123091] Updated weights for policy 0, policy_version 870031 (0.0008) [2023-12-26 06:32:07,785][123090] Updated weights for policy 1, policy_version 863849 (0.0005) [2023-12-26 06:32:07,837][123090] Updated weights for policy 1, policy_version 863859 (0.0005) [2023-12-26 06:32:07,898][123090] Updated weights for policy 1, policy_version 863869 (0.0005) [2023-12-26 06:32:08,401][123091] Updated weights for policy 0, policy_version 870041 (0.0009) [2023-12-26 06:32:08,466][123091] Updated weights for policy 0, policy_version 870051 (0.0010) [2023-12-26 06:32:08,529][123091] Updated weights for policy 0, policy_version 870061 (0.0009) [2023-12-26 06:32:08,556][123090] Updated weights for policy 1, policy_version 863879 (0.0006) [2023-12-26 06:32:08,623][123090] Updated weights for policy 1, policy_version 863889 (0.0007) [2023-12-26 06:32:08,681][123090] Updated weights for policy 1, policy_version 863899 (0.0009) [2023-12-26 06:32:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 443899904. Throughput: 0: 8796.7, 1: 9049.9. Samples: 443870812. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:08,785][121949] Avg episode reward: [(0, '6235.259'), (1, '5322.911')] [2023-12-26 06:32:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000870064_222740480.pth... [2023-12-26 06:32:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000863904_221159424.pth... [2023-12-26 06:32:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000869008_222470144.pth [2023-12-26 06:32:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000862848_220889088.pth [2023-12-26 06:32:09,398][123091] Updated weights for policy 0, policy_version 870071 (0.0009) [2023-12-26 06:32:09,468][123091] Updated weights for policy 0, policy_version 870081 (0.0007) [2023-12-26 06:32:09,510][123090] Updated weights for policy 1, policy_version 863909 (0.0007) [2023-12-26 06:32:09,531][123091] Updated weights for policy 0, policy_version 870091 (0.0008) [2023-12-26 06:32:09,575][123090] Updated weights for policy 1, policy_version 863919 (0.0006) [2023-12-26 06:32:09,649][123090] Updated weights for policy 1, policy_version 863929 (0.0007) [2023-12-26 06:32:10,386][123091] Updated weights for policy 0, policy_version 870101 (0.0008) [2023-12-26 06:32:10,403][123090] Updated weights for policy 1, policy_version 863939 (0.0008) [2023-12-26 06:32:10,437][123091] Updated weights for policy 0, policy_version 870111 (0.0009) [2023-12-26 06:32:10,466][123090] Updated weights for policy 1, policy_version 863949 (0.0009) [2023-12-26 06:32:10,491][123091] Updated weights for policy 0, policy_version 870121 (0.0008) [2023-12-26 06:32:10,524][123090] Updated weights for policy 1, policy_version 863959 (0.0008) [2023-12-26 06:32:11,347][123091] Updated weights for policy 0, policy_version 870131 (0.0009) [2023-12-26 06:32:11,375][123090] Updated weights for policy 1, policy_version 863969 (0.0008) [2023-12-26 06:32:11,419][123091] Updated weights for policy 0, policy_version 870141 (0.0009) [2023-12-26 06:32:11,445][123090] Updated weights for policy 1, policy_version 863979 (0.0010) [2023-12-26 06:32:11,481][123091] Updated weights for policy 0, policy_version 870151 (0.0008) [2023-12-26 06:32:11,503][123090] Updated weights for policy 1, policy_version 863989 (0.0008) [2023-12-26 06:32:11,566][123090] Updated weights for policy 1, policy_version 863999 (0.0009) [2023-12-26 06:32:12,323][123091] Updated weights for policy 0, policy_version 870161 (0.0008) [2023-12-26 06:32:12,403][123091] Updated weights for policy 0, policy_version 870171 (0.0009) [2023-12-26 06:32:12,460][123090] Updated weights for policy 1, policy_version 864009 (0.0008) [2023-12-26 06:32:12,470][123091] Updated weights for policy 0, policy_version 870181 (0.0009) [2023-12-26 06:32:12,527][123090] Updated weights for policy 1, policy_version 864019 (0.0009) [2023-12-26 06:32:12,538][123091] Updated weights for policy 0, policy_version 870191 (0.0009) [2023-12-26 06:32:12,593][123090] Updated weights for policy 1, policy_version 864029 (0.0010) [2023-12-26 06:32:13,294][123090] Updated weights for policy 1, policy_version 864039 (0.0006) [2023-12-26 06:32:13,344][123090] Updated weights for policy 1, policy_version 864049 (0.0005) [2023-12-26 06:32:13,406][123090] Updated weights for policy 1, policy_version 864059 (0.0006) [2023-12-26 06:32:13,408][123091] Updated weights for policy 0, policy_version 870201 (0.0009) [2023-12-26 06:32:13,463][123091] Updated weights for policy 0, policy_version 870211 (0.0008) [2023-12-26 06:32:13,520][123091] Updated weights for policy 0, policy_version 870222 (0.0010) [2023-12-26 06:32:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 443981824. Throughput: 0: 8740.5, 1: 8954.4. Samples: 443972684. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:13,784][121949] Avg episode reward: [(0, '6242.534'), (1, '5494.047')] [2023-12-26 06:32:14,114][123090] Updated weights for policy 1, policy_version 864069 (0.0007) [2023-12-26 06:32:14,168][123090] Updated weights for policy 1, policy_version 864079 (0.0006) [2023-12-26 06:32:14,219][123090] Updated weights for policy 1, policy_version 864089 (0.0008) [2023-12-26 06:32:14,238][123091] Updated weights for policy 0, policy_version 870232 (0.0008) [2023-12-26 06:32:14,286][123091] Updated weights for policy 0, policy_version 870242 (0.0008) [2023-12-26 06:32:14,336][123091] Updated weights for policy 0, policy_version 870252 (0.0006) [2023-12-26 06:32:14,981][123090] Updated weights for policy 1, policy_version 864099 (0.0007) [2023-12-26 06:32:15,057][123090] Updated weights for policy 1, policy_version 864109 (0.0007) [2023-12-26 06:32:15,087][123091] Updated weights for policy 0, policy_version 870262 (0.0007) [2023-12-26 06:32:15,117][123090] Updated weights for policy 1, policy_version 864119 (0.0011) [2023-12-26 06:32:15,149][123091] Updated weights for policy 0, policy_version 870272 (0.0006) [2023-12-26 06:32:15,213][123091] Updated weights for policy 0, policy_version 870282 (0.0006) [2023-12-26 06:32:15,812][123090] Updated weights for policy 1, policy_version 864129 (0.0010) [2023-12-26 06:32:15,864][123090] Updated weights for policy 1, policy_version 864139 (0.0005) [2023-12-26 06:32:15,887][123091] Updated weights for policy 0, policy_version 870292 (0.0006) [2023-12-26 06:32:15,921][123090] Updated weights for policy 1, policy_version 864149 (0.0005) [2023-12-26 06:32:15,936][123091] Updated weights for policy 0, policy_version 870302 (0.0008) [2023-12-26 06:32:15,974][123090] Updated weights for policy 1, policy_version 864159 (0.0005) [2023-12-26 06:32:15,984][123091] Updated weights for policy 0, policy_version 870312 (0.0007) [2023-12-26 06:32:16,605][123090] Updated weights for policy 1, policy_version 864169 (0.0010) [2023-12-26 06:32:16,653][123090] Updated weights for policy 1, policy_version 864179 (0.0010) [2023-12-26 06:32:16,701][123090] Updated weights for policy 1, policy_version 864189 (0.0010) [2023-12-26 06:32:16,720][123091] Updated weights for policy 0, policy_version 870322 (0.0005) [2023-12-26 06:32:16,767][123091] Updated weights for policy 0, policy_version 870332 (0.0005) [2023-12-26 06:32:16,816][123091] Updated weights for policy 0, policy_version 870342 (0.0005) [2023-12-26 06:32:16,862][123091] Updated weights for policy 0, policy_version 870352 (0.0005) [2023-12-26 06:32:17,447][123090] Updated weights for policy 1, policy_version 864199 (0.0007) [2023-12-26 06:32:17,500][123091] Updated weights for policy 0, policy_version 870362 (0.0008) [2023-12-26 06:32:17,510][123090] Updated weights for policy 1, policy_version 864209 (0.0005) [2023-12-26 06:32:17,558][123091] Updated weights for policy 0, policy_version 870372 (0.0010) [2023-12-26 06:32:17,565][123090] Updated weights for policy 1, policy_version 864219 (0.0007) [2023-12-26 06:32:17,608][123091] Updated weights for policy 0, policy_version 870382 (0.0006) [2023-12-26 06:32:18,263][123090] Updated weights for policy 1, policy_version 864229 (0.0010) [2023-12-26 06:32:18,330][123090] Updated weights for policy 1, policy_version 864239 (0.0008) [2023-12-26 06:32:18,393][123090] Updated weights for policy 1, policy_version 864249 (0.0010) [2023-12-26 06:32:18,501][123091] Updated weights for policy 0, policy_version 870392 (0.0006) [2023-12-26 06:32:18,563][123091] Updated weights for policy 0, policy_version 870402 (0.0008) [2023-12-26 06:32:18,623][123091] Updated weights for policy 0, policy_version 870412 (0.0008) [2023-12-26 06:32:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 444080128. Throughput: 0: 8795.6, 1: 9038.6. Samples: 444088268. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:18,785][121949] Avg episode reward: [(0, '6161.969'), (1, '5408.791')] [2023-12-26 06:32:19,204][123090] Updated weights for policy 1, policy_version 864259 (0.0009) [2023-12-26 06:32:19,273][123091] Updated weights for policy 0, policy_version 870422 (0.0008) [2023-12-26 06:32:19,279][123090] Updated weights for policy 1, policy_version 864269 (0.0007) [2023-12-26 06:32:19,329][123091] Updated weights for policy 0, policy_version 870432 (0.0011) [2023-12-26 06:32:19,345][123090] Updated weights for policy 1, policy_version 864279 (0.0008) [2023-12-26 06:32:19,397][123091] Updated weights for policy 0, policy_version 870442 (0.0011) [2023-12-26 06:32:20,152][123090] Updated weights for policy 1, policy_version 864289 (0.0009) [2023-12-26 06:32:20,221][123090] Updated weights for policy 1, policy_version 864299 (0.0011) [2023-12-26 06:32:20,234][123091] Updated weights for policy 0, policy_version 870452 (0.0009) [2023-12-26 06:32:20,293][123090] Updated weights for policy 1, policy_version 864309 (0.0006) [2023-12-26 06:32:20,304][123091] Updated weights for policy 0, policy_version 870462 (0.0008) [2023-12-26 06:32:20,361][123090] Updated weights for policy 1, policy_version 864319 (0.0006) [2023-12-26 06:32:20,370][123091] Updated weights for policy 0, policy_version 870472 (0.0009) [2023-12-26 06:32:21,068][123090] Updated weights for policy 1, policy_version 864329 (0.0008) [2023-12-26 06:32:21,142][123090] Updated weights for policy 1, policy_version 864339 (0.0007) [2023-12-26 06:32:21,196][123091] Updated weights for policy 0, policy_version 870482 (0.0010) [2023-12-26 06:32:21,211][123090] Updated weights for policy 1, policy_version 864349 (0.0007) [2023-12-26 06:32:21,268][123091] Updated weights for policy 0, policy_version 870492 (0.0009) [2023-12-26 06:32:21,338][123091] Updated weights for policy 0, policy_version 870502 (0.0007) [2023-12-26 06:32:21,411][123091] Updated weights for policy 0, policy_version 870512 (0.0010) [2023-12-26 06:32:22,002][123090] Updated weights for policy 1, policy_version 864359 (0.0006) [2023-12-26 06:32:22,056][123090] Updated weights for policy 1, policy_version 864369 (0.0006) [2023-12-26 06:32:22,133][123090] Updated weights for policy 1, policy_version 864379 (0.0006) [2023-12-26 06:32:22,240][123091] Updated weights for policy 0, policy_version 870522 (0.0009) [2023-12-26 06:32:22,311][123091] Updated weights for policy 0, policy_version 870532 (0.0009) [2023-12-26 06:32:22,377][123091] Updated weights for policy 0, policy_version 870542 (0.0009) [2023-12-26 06:32:22,885][123090] Updated weights for policy 1, policy_version 864389 (0.0008) [2023-12-26 06:32:22,947][123090] Updated weights for policy 1, policy_version 864399 (0.0009) [2023-12-26 06:32:23,011][123090] Updated weights for policy 1, policy_version 864409 (0.0009) [2023-12-26 06:32:23,194][123091] Updated weights for policy 0, policy_version 870552 (0.0009) [2023-12-26 06:32:23,252][123091] Updated weights for policy 0, policy_version 870562 (0.0009) [2023-12-26 06:32:23,308][123091] Updated weights for policy 0, policy_version 870572 (0.0009) [2023-12-26 06:32:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 444162048. Throughput: 0: 8851.9, 1: 9005.8. Samples: 444141460. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:23,785][121949] Avg episode reward: [(0, '6096.279'), (1, '5517.466')] [2023-12-26 06:32:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000870576_222871552.pth... [2023-12-26 06:32:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000869552_222609408.pth [2023-12-26 06:32:23,801][123090] Updated weights for policy 1, policy_version 864419 (0.0009) [2023-12-26 06:32:23,871][123090] Updated weights for policy 1, policy_version 864429 (0.0005) [2023-12-26 06:32:23,921][123090] Updated weights for policy 1, policy_version 864439 (0.0005) [2023-12-26 06:32:23,964][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000864448_221298688.pth... [2023-12-26 06:32:23,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000863360_221020160.pth [2023-12-26 06:32:24,097][123091] Updated weights for policy 0, policy_version 870582 (0.0007) [2023-12-26 06:32:24,171][123091] Updated weights for policy 0, policy_version 870592 (0.0005) [2023-12-26 06:32:24,241][123091] Updated weights for policy 0, policy_version 870602 (0.0005) [2023-12-26 06:32:24,645][123090] Updated weights for policy 1, policy_version 864449 (0.0006) [2023-12-26 06:32:24,699][123090] Updated weights for policy 1, policy_version 864459 (0.0010) [2023-12-26 06:32:24,753][123090] Updated weights for policy 1, policy_version 864469 (0.0010) [2023-12-26 06:32:24,810][123090] Updated weights for policy 1, policy_version 864479 (0.0010) [2023-12-26 06:32:24,908][123091] Updated weights for policy 0, policy_version 870612 (0.0007) [2023-12-26 06:32:24,962][123091] Updated weights for policy 0, policy_version 870622 (0.0010) [2023-12-26 06:32:25,027][123091] Updated weights for policy 0, policy_version 870632 (0.0010) [2023-12-26 06:32:25,634][123090] Updated weights for policy 1, policy_version 864489 (0.0006) [2023-12-26 06:32:25,661][123091] Updated weights for policy 0, policy_version 870642 (0.0006) [2023-12-26 06:32:25,687][123090] Updated weights for policy 1, policy_version 864499 (0.0006) [2023-12-26 06:32:25,726][123091] Updated weights for policy 0, policy_version 870652 (0.0005) [2023-12-26 06:32:25,749][123090] Updated weights for policy 1, policy_version 864509 (0.0008) [2023-12-26 06:32:25,780][123091] Updated weights for policy 0, policy_version 870662 (0.0005) [2023-12-26 06:32:25,827][123091] Updated weights for policy 0, policy_version 870672 (0.0005) [2023-12-26 06:32:26,440][123090] Updated weights for policy 1, policy_version 864519 (0.0006) [2023-12-26 06:32:26,492][123090] Updated weights for policy 1, policy_version 864529 (0.0006) [2023-12-26 06:32:26,494][123091] Updated weights for policy 0, policy_version 870682 (0.0006) [2023-12-26 06:32:26,542][123090] Updated weights for policy 1, policy_version 864539 (0.0005) [2023-12-26 06:32:26,549][123091] Updated weights for policy 0, policy_version 870692 (0.0005) [2023-12-26 06:32:26,597][123091] Updated weights for policy 0, policy_version 870702 (0.0005) [2023-12-26 06:32:27,255][123091] Updated weights for policy 0, policy_version 870712 (0.0005) [2023-12-26 06:32:27,281][123090] Updated weights for policy 1, policy_version 864549 (0.0008) [2023-12-26 06:32:27,315][123091] Updated weights for policy 0, policy_version 870722 (0.0010) [2023-12-26 06:32:27,340][123090] Updated weights for policy 1, policy_version 864559 (0.0010) [2023-12-26 06:32:27,362][123091] Updated weights for policy 0, policy_version 870732 (0.0010) [2023-12-26 06:32:27,406][123090] Updated weights for policy 1, policy_version 864569 (0.0010) [2023-12-26 06:32:28,154][123091] Updated weights for policy 0, policy_version 870742 (0.0012) [2023-12-26 06:32:28,205][123091] Updated weights for policy 0, policy_version 870752 (0.0009) [2023-12-26 06:32:28,220][123090] Updated weights for policy 1, policy_version 864579 (0.0009) [2023-12-26 06:32:28,255][123091] Updated weights for policy 0, policy_version 870762 (0.0010) [2023-12-26 06:32:28,275][123090] Updated weights for policy 1, policy_version 864589 (0.0005) [2023-12-26 06:32:28,323][123090] Updated weights for policy 1, policy_version 864599 (0.0006) [2023-12-26 06:32:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 444260352. Throughput: 0: 9046.3, 1: 9062.2. Samples: 444254736. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:28,785][121949] Avg episode reward: [(0, '6015.214'), (1, '5756.160')] [2023-12-26 06:32:29,064][123090] Updated weights for policy 1, policy_version 864609 (0.0009) [2023-12-26 06:32:29,123][123090] Updated weights for policy 1, policy_version 864619 (0.0009) [2023-12-26 06:32:29,165][123091] Updated weights for policy 0, policy_version 870772 (0.0009) [2023-12-26 06:32:29,185][123090] Updated weights for policy 1, policy_version 864629 (0.0006) [2023-12-26 06:32:29,232][123091] Updated weights for policy 0, policy_version 870782 (0.0008) [2023-12-26 06:32:29,256][123090] Updated weights for policy 1, policy_version 864639 (0.0007) [2023-12-26 06:32:29,297][123091] Updated weights for policy 0, policy_version 870792 (0.0008) [2023-12-26 06:32:30,050][123091] Updated weights for policy 0, policy_version 870802 (0.0009) [2023-12-26 06:32:30,087][123090] Updated weights for policy 1, policy_version 864649 (0.0007) [2023-12-26 06:32:30,107][123091] Updated weights for policy 0, policy_version 870812 (0.0009) [2023-12-26 06:32:30,148][123090] Updated weights for policy 1, policy_version 864659 (0.0010) [2023-12-26 06:32:30,169][123091] Updated weights for policy 0, policy_version 870822 (0.0007) [2023-12-26 06:32:30,206][123090] Updated weights for policy 1, policy_version 864669 (0.0009) [2023-12-26 06:32:30,229][123091] Updated weights for policy 0, policy_version 870832 (0.0008) [2023-12-26 06:32:30,979][123091] Updated weights for policy 0, policy_version 870842 (0.0005) [2023-12-26 06:32:31,054][123091] Updated weights for policy 0, policy_version 870852 (0.0007) [2023-12-26 06:32:31,091][123090] Updated weights for policy 1, policy_version 864679 (0.0007) [2023-12-26 06:32:31,116][123091] Updated weights for policy 0, policy_version 870862 (0.0007) [2023-12-26 06:32:31,180][123090] Updated weights for policy 1, policy_version 864689 (0.0009) [2023-12-26 06:32:31,234][123090] Updated weights for policy 1, policy_version 864699 (0.0006) [2023-12-26 06:32:31,919][123091] Updated weights for policy 0, policy_version 870872 (0.0009) [2023-12-26 06:32:31,984][123091] Updated weights for policy 0, policy_version 870882 (0.0010) [2023-12-26 06:32:32,041][123090] Updated weights for policy 1, policy_version 864709 (0.0007) [2023-12-26 06:32:32,048][123091] Updated weights for policy 0, policy_version 870892 (0.0010) [2023-12-26 06:32:32,098][123090] Updated weights for policy 1, policy_version 864719 (0.0010) [2023-12-26 06:32:32,160][123090] Updated weights for policy 1, policy_version 864729 (0.0009) [2023-12-26 06:32:32,788][123091] Updated weights for policy 0, policy_version 870902 (0.0008) [2023-12-26 06:32:32,849][123091] Updated weights for policy 0, policy_version 870912 (0.0009) [2023-12-26 06:32:32,907][123091] Updated weights for policy 0, policy_version 870922 (0.0010) [2023-12-26 06:32:33,003][123090] Updated weights for policy 1, policy_version 864739 (0.0008) [2023-12-26 06:32:33,068][123090] Updated weights for policy 1, policy_version 864749 (0.0005) [2023-12-26 06:32:33,133][123090] Updated weights for policy 1, policy_version 864759 (0.0007) [2023-12-26 06:32:33,753][123090] Updated weights for policy 1, policy_version 864769 (0.0009) [2023-12-26 06:32:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 444342272. Throughput: 0: 9012.1, 1: 9084.1. Samples: 444359844. Policy #0 lag: (min: 11.0, avg: 11.6, max: 34.0) [2023-12-26 06:32:33,784][121949] Avg episode reward: [(0, '6010.732'), (1, '5648.108')] [2023-12-26 06:32:33,790][123091] Updated weights for policy 0, policy_version 870932 (0.0009) [2023-12-26 06:32:33,821][123090] Updated weights for policy 1, policy_version 864779 (0.0005) [2023-12-26 06:32:33,851][123091] Updated weights for policy 0, policy_version 870942 (0.0008) [2023-12-26 06:32:33,883][123090] Updated weights for policy 1, policy_version 864789 (0.0005) [2023-12-26 06:32:33,907][123091] Updated weights for policy 0, policy_version 870952 (0.0009) [2023-12-26 06:32:33,948][123090] Updated weights for policy 1, policy_version 864799 (0.0005) [2023-12-26 06:32:34,564][123090] Updated weights for policy 1, policy_version 864809 (0.0010) [2023-12-26 06:32:34,620][123090] Updated weights for policy 1, policy_version 864819 (0.0010) [2023-12-26 06:32:34,690][123090] Updated weights for policy 1, policy_version 864829 (0.0011) [2023-12-26 06:32:34,794][123091] Updated weights for policy 0, policy_version 870962 (0.0009) [2023-12-26 06:32:34,842][123091] Updated weights for policy 0, policy_version 870972 (0.0009) [2023-12-26 06:32:34,906][123091] Updated weights for policy 0, policy_version 870982 (0.0009) [2023-12-26 06:32:34,962][123091] Updated weights for policy 0, policy_version 870992 (0.0008) [2023-12-26 06:32:35,478][123090] Updated weights for policy 1, policy_version 864839 (0.0007) [2023-12-26 06:32:35,536][123090] Updated weights for policy 1, policy_version 864849 (0.0006) [2023-12-26 06:32:35,596][123090] Updated weights for policy 1, policy_version 864859 (0.0010) [2023-12-26 06:32:35,806][123091] Updated weights for policy 0, policy_version 871002 (0.0006) [2023-12-26 06:32:35,871][123091] Updated weights for policy 0, policy_version 871012 (0.0005) [2023-12-26 06:32:35,937][123091] Updated weights for policy 0, policy_version 871022 (0.0005) [2023-12-26 06:32:36,309][123090] Updated weights for policy 1, policy_version 864869 (0.0007) [2023-12-26 06:32:36,377][123090] Updated weights for policy 1, policy_version 864879 (0.0008) [2023-12-26 06:32:36,448][123090] Updated weights for policy 1, policy_version 864889 (0.0008) [2023-12-26 06:32:36,660][123091] Updated weights for policy 0, policy_version 871032 (0.0008) [2023-12-26 06:32:36,708][123091] Updated weights for policy 0, policy_version 871042 (0.0008) [2023-12-26 06:32:36,781][123091] Updated weights for policy 0, policy_version 871052 (0.0008) [2023-12-26 06:32:37,251][123090] Updated weights for policy 1, policy_version 864899 (0.0008) [2023-12-26 06:32:37,303][123090] Updated weights for policy 1, policy_version 864909 (0.0008) [2023-12-26 06:32:37,350][123090] Updated weights for policy 1, policy_version 864919 (0.0007) [2023-12-26 06:32:37,605][123091] Updated weights for policy 0, policy_version 871062 (0.0010) [2023-12-26 06:32:37,669][123091] Updated weights for policy 0, policy_version 871072 (0.0011) [2023-12-26 06:32:37,721][123091] Updated weights for policy 0, policy_version 871082 (0.0011) [2023-12-26 06:32:38,184][123090] Updated weights for policy 1, policy_version 864929 (0.0008) [2023-12-26 06:32:38,250][123090] Updated weights for policy 1, policy_version 864939 (0.0009) [2023-12-26 06:32:38,313][123090] Updated weights for policy 1, policy_version 864949 (0.0008) [2023-12-26 06:32:38,379][123090] Updated weights for policy 1, policy_version 864959 (0.0009) [2023-12-26 06:32:38,551][123091] Updated weights for policy 0, policy_version 871092 (0.0011) [2023-12-26 06:32:38,599][123091] Updated weights for policy 0, policy_version 871102 (0.0010) [2023-12-26 06:32:38,663][123091] Updated weights for policy 0, policy_version 871112 (0.0011) [2023-12-26 06:32:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 444440576. Throughput: 0: 8968.6, 1: 9115.3. Samples: 444414232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:32:38,785][121949] Avg episode reward: [(0, '6097.056'), (1, '5639.730')] [2023-12-26 06:32:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000871120_223010816.pth... [2023-12-26 06:32:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000864960_221429760.pth... [2023-12-26 06:32:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000870064_222740480.pth [2023-12-26 06:32:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000863904_221159424.pth [2023-12-26 06:32:39,197][123090] Updated weights for policy 1, policy_version 864969 (0.0010) [2023-12-26 06:32:39,261][123090] Updated weights for policy 1, policy_version 864979 (0.0010) [2023-12-26 06:32:39,332][123090] Updated weights for policy 1, policy_version 864989 (0.0010) [2023-12-26 06:32:39,499][123091] Updated weights for policy 0, policy_version 871122 (0.0010) [2023-12-26 06:32:39,561][123091] Updated weights for policy 0, policy_version 871132 (0.0010) [2023-12-26 06:32:39,626][123091] Updated weights for policy 0, policy_version 871142 (0.0010) [2023-12-26 06:32:39,685][123091] Updated weights for policy 0, policy_version 871152 (0.0010) [2023-12-26 06:32:40,106][123090] Updated weights for policy 1, policy_version 864999 (0.0007) [2023-12-26 06:32:40,173][123090] Updated weights for policy 1, policy_version 865009 (0.0006) [2023-12-26 06:32:40,242][123090] Updated weights for policy 1, policy_version 865019 (0.0009) [2023-12-26 06:32:40,600][123091] Updated weights for policy 0, policy_version 871162 (0.0009) [2023-12-26 06:32:40,660][123091] Updated weights for policy 0, policy_version 871172 (0.0009) [2023-12-26 06:32:40,711][123091] Updated weights for policy 0, policy_version 871182 (0.0008) [2023-12-26 06:32:41,043][123090] Updated weights for policy 1, policy_version 865029 (0.0010) [2023-12-26 06:32:41,106][123090] Updated weights for policy 1, policy_version 865039 (0.0010) [2023-12-26 06:32:41,169][123090] Updated weights for policy 1, policy_version 865049 (0.0009) [2023-12-26 06:32:41,533][123091] Updated weights for policy 0, policy_version 871192 (0.0008) [2023-12-26 06:32:41,601][123091] Updated weights for policy 0, policy_version 871202 (0.0010) [2023-12-26 06:32:41,672][123091] Updated weights for policy 0, policy_version 871212 (0.0010) [2023-12-26 06:32:42,079][123090] Updated weights for policy 1, policy_version 865059 (0.0009) [2023-12-26 06:32:42,130][123090] Updated weights for policy 1, policy_version 865069 (0.0008) [2023-12-26 06:32:42,198][123090] Updated weights for policy 1, policy_version 865079 (0.0010) [2023-12-26 06:32:42,458][123091] Updated weights for policy 0, policy_version 871222 (0.0009) [2023-12-26 06:32:42,530][123091] Updated weights for policy 0, policy_version 871232 (0.0010) [2023-12-26 06:32:42,599][123091] Updated weights for policy 0, policy_version 871242 (0.0009) [2023-12-26 06:32:43,056][123090] Updated weights for policy 1, policy_version 865089 (0.0009) [2023-12-26 06:32:43,122][123090] Updated weights for policy 1, policy_version 865099 (0.0010) [2023-12-26 06:32:43,188][123090] Updated weights for policy 1, policy_version 865109 (0.0009) [2023-12-26 06:32:43,256][123090] Updated weights for policy 1, policy_version 865119 (0.0009) [2023-12-26 06:32:43,426][123091] Updated weights for policy 0, policy_version 871252 (0.0009) [2023-12-26 06:32:43,485][123091] Updated weights for policy 0, policy_version 871262 (0.0009) [2023-12-26 06:32:43,540][123091] Updated weights for policy 0, policy_version 871272 (0.0009) [2023-12-26 06:32:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 444522496. Throughput: 0: 8802.9, 1: 9014.1. Samples: 444515460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:32:43,784][121949] Avg episode reward: [(0, '6221.214'), (1, '5730.730')] [2023-12-26 06:32:44,105][123090] Updated weights for policy 1, policy_version 865129 (0.0010) [2023-12-26 06:32:44,176][123090] Updated weights for policy 1, policy_version 865139 (0.0009) [2023-12-26 06:32:44,241][123090] Updated weights for policy 1, policy_version 865149 (0.0009) [2023-12-26 06:32:44,374][123091] Updated weights for policy 0, policy_version 871282 (0.0009) [2023-12-26 06:32:44,425][123091] Updated weights for policy 0, policy_version 871292 (0.0009) [2023-12-26 06:32:44,476][123091] Updated weights for policy 0, policy_version 871302 (0.0009) [2023-12-26 06:32:44,532][123091] Updated weights for policy 0, policy_version 871312 (0.0010) [2023-12-26 06:32:45,129][123090] Updated weights for policy 1, policy_version 865159 (0.0009) [2023-12-26 06:32:45,207][123090] Updated weights for policy 1, policy_version 865169 (0.0009) [2023-12-26 06:32:45,271][123090] Updated weights for policy 1, policy_version 865179 (0.0009) [2023-12-26 06:32:45,286][123091] Updated weights for policy 0, policy_version 871322 (0.0008) [2023-12-26 06:32:45,350][123091] Updated weights for policy 0, policy_version 871332 (0.0009) [2023-12-26 06:32:45,414][123091] Updated weights for policy 0, policy_version 871342 (0.0009) [2023-12-26 06:32:46,109][123090] Updated weights for policy 1, policy_version 865189 (0.0008) [2023-12-26 06:32:46,162][123090] Updated weights for policy 1, policy_version 865199 (0.0008) [2023-12-26 06:32:46,164][123091] Updated weights for policy 0, policy_version 871352 (0.0007) [2023-12-26 06:32:46,218][123091] Updated weights for policy 0, policy_version 871362 (0.0006) [2023-12-26 06:32:46,218][123090] Updated weights for policy 1, policy_version 865209 (0.0009) [2023-12-26 06:32:46,277][123091] Updated weights for policy 0, policy_version 871372 (0.0005) [2023-12-26 06:32:46,928][123091] Updated weights for policy 0, policy_version 871382 (0.0005) [2023-12-26 06:32:46,972][123091] Updated weights for policy 0, policy_version 871392 (0.0006) [2023-12-26 06:32:47,032][123091] Updated weights for policy 0, policy_version 871402 (0.0007) [2023-12-26 06:32:47,140][123090] Updated weights for policy 1, policy_version 865219 (0.0009) [2023-12-26 06:32:47,194][123090] Updated weights for policy 1, policy_version 865229 (0.0008) [2023-12-26 06:32:47,256][123090] Updated weights for policy 1, policy_version 865239 (0.0009) [2023-12-26 06:32:47,734][123091] Updated weights for policy 0, policy_version 871412 (0.0008) [2023-12-26 06:32:47,787][123091] Updated weights for policy 0, policy_version 871422 (0.0005) [2023-12-26 06:32:47,835][123091] Updated weights for policy 0, policy_version 871432 (0.0005) [2023-12-26 06:32:48,162][123090] Updated weights for policy 1, policy_version 865249 (0.0009) [2023-12-26 06:32:48,234][123090] Updated weights for policy 1, policy_version 865259 (0.0009) [2023-12-26 06:32:48,307][123090] Updated weights for policy 1, policy_version 865269 (0.0006) [2023-12-26 06:32:48,382][123090] Updated weights for policy 1, policy_version 865279 (0.0009) [2023-12-26 06:32:48,531][123091] Updated weights for policy 0, policy_version 871442 (0.0005) [2023-12-26 06:32:48,604][123091] Updated weights for policy 0, policy_version 871453 (0.0011) [2023-12-26 06:32:48,662][123091] Updated weights for policy 0, policy_version 871463 (0.0010) [2023-12-26 06:32:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 444612608. Throughput: 0: 8906.4, 1: 8923.0. Samples: 444620784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:32:48,785][121949] Avg episode reward: [(0, '6130.919'), (1, '5714.236')] [2023-12-26 06:32:49,193][123090] Updated weights for policy 1, policy_version 865289 (0.0010) [2023-12-26 06:32:49,264][123090] Updated weights for policy 1, policy_version 865300 (0.0010) [2023-12-26 06:32:49,335][123090] Updated weights for policy 1, policy_version 865310 (0.0010) [2023-12-26 06:32:49,396][123091] Updated weights for policy 0, policy_version 871473 (0.0007) [2023-12-26 06:32:49,462][123091] Updated weights for policy 0, policy_version 871483 (0.0006) [2023-12-26 06:32:49,521][123091] Updated weights for policy 0, policy_version 871493 (0.0006) [2023-12-26 06:32:49,584][123091] Updated weights for policy 0, policy_version 871503 (0.0005) [2023-12-26 06:32:50,261][123090] Updated weights for policy 1, policy_version 865320 (0.0006) [2023-12-26 06:32:50,271][123091] Updated weights for policy 0, policy_version 871513 (0.0010) [2023-12-26 06:32:50,326][123091] Updated weights for policy 0, policy_version 871523 (0.0011) [2023-12-26 06:32:50,329][123090] Updated weights for policy 1, policy_version 865330 (0.0006) [2023-12-26 06:32:50,385][123091] Updated weights for policy 0, policy_version 871533 (0.0011) [2023-12-26 06:32:50,396][123090] Updated weights for policy 1, policy_version 865340 (0.0007) [2023-12-26 06:32:51,207][123091] Updated weights for policy 0, policy_version 871543 (0.0011) [2023-12-26 06:32:51,213][123090] Updated weights for policy 1, policy_version 865350 (0.0009) [2023-12-26 06:32:51,271][123091] Updated weights for policy 0, policy_version 871553 (0.0011) [2023-12-26 06:32:51,280][123090] Updated weights for policy 1, policy_version 865360 (0.0009) [2023-12-26 06:32:51,334][123090] Updated weights for policy 1, policy_version 865370 (0.0009) [2023-12-26 06:32:51,335][123091] Updated weights for policy 0, policy_version 871563 (0.0011) [2023-12-26 06:32:52,178][123091] Updated weights for policy 0, policy_version 871574 (0.0011) [2023-12-26 06:32:52,245][123091] Updated weights for policy 0, policy_version 871584 (0.0011) [2023-12-26 06:32:52,261][123090] Updated weights for policy 1, policy_version 865380 (0.0009) [2023-12-26 06:32:52,316][123091] Updated weights for policy 0, policy_version 871594 (0.0011) [2023-12-26 06:32:52,338][123090] Updated weights for policy 1, policy_version 865390 (0.0008) [2023-12-26 06:32:52,405][123090] Updated weights for policy 1, policy_version 865400 (0.0008) [2023-12-26 06:32:53,123][123091] Updated weights for policy 0, policy_version 871604 (0.0009) [2023-12-26 06:32:53,177][123091] Updated weights for policy 0, policy_version 871614 (0.0010) [2023-12-26 06:32:53,221][123090] Updated weights for policy 1, policy_version 865410 (0.0008) [2023-12-26 06:32:53,226][123091] Updated weights for policy 0, policy_version 871624 (0.0007) [2023-12-26 06:32:53,293][123090] Updated weights for policy 1, policy_version 865420 (0.0005) [2023-12-26 06:32:53,369][123090] Updated weights for policy 1, policy_version 865430 (0.0005) [2023-12-26 06:32:53,449][123090] Updated weights for policy 1, policy_version 865440 (0.0005) [2023-12-26 06:32:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 444694528. Throughput: 0: 8951.4, 1: 8862.6. Samples: 444672440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:32:53,784][121949] Avg episode reward: [(0, '6108.642'), (1, '5772.215')] [2023-12-26 06:32:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000865440_221552640.pth... [2023-12-26 06:32:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000871632_223141888.pth... [2023-12-26 06:32:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000864448_221298688.pth [2023-12-26 06:32:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000870576_222871552.pth [2023-12-26 06:32:54,011][123091] Updated weights for policy 0, policy_version 871634 (0.0006) [2023-12-26 06:32:54,069][123091] Updated weights for policy 0, policy_version 871644 (0.0010) [2023-12-26 06:32:54,131][123091] Updated weights for policy 0, policy_version 871654 (0.0010) [2023-12-26 06:32:54,143][123090] Updated weights for policy 1, policy_version 865450 (0.0006) [2023-12-26 06:32:54,188][123091] Updated weights for policy 0, policy_version 871664 (0.0010) [2023-12-26 06:32:54,205][123090] Updated weights for policy 1, policy_version 865460 (0.0008) [2023-12-26 06:32:54,255][123090] Updated weights for policy 1, policy_version 865470 (0.0008) [2023-12-26 06:32:54,966][123091] Updated weights for policy 0, policy_version 871674 (0.0009) [2023-12-26 06:32:55,032][123091] Updated weights for policy 0, policy_version 871684 (0.0010) [2023-12-26 06:32:55,036][123090] Updated weights for policy 1, policy_version 865480 (0.0007) [2023-12-26 06:32:55,091][123091] Updated weights for policy 0, policy_version 871694 (0.0011) [2023-12-26 06:32:55,103][123090] Updated weights for policy 1, policy_version 865490 (0.0005) [2023-12-26 06:32:55,177][123090] Updated weights for policy 1, policy_version 865500 (0.0005) [2023-12-26 06:32:55,878][123091] Updated weights for policy 0, policy_version 871704 (0.0010) [2023-12-26 06:32:55,883][123090] Updated weights for policy 1, policy_version 865510 (0.0005) [2023-12-26 06:32:55,925][123091] Updated weights for policy 0, policy_version 871714 (0.0010) [2023-12-26 06:32:55,941][123090] Updated weights for policy 1, policy_version 865520 (0.0006) [2023-12-26 06:32:55,987][123091] Updated weights for policy 0, policy_version 871724 (0.0011) [2023-12-26 06:32:55,998][123090] Updated weights for policy 1, policy_version 865530 (0.0007) [2023-12-26 06:32:56,750][123090] Updated weights for policy 1, policy_version 865540 (0.0006) [2023-12-26 06:32:56,800][123091] Updated weights for policy 0, policy_version 871734 (0.0010) [2023-12-26 06:32:56,817][123090] Updated weights for policy 1, policy_version 865550 (0.0008) [2023-12-26 06:32:56,853][123091] Updated weights for policy 0, policy_version 871744 (0.0008) [2023-12-26 06:32:56,881][123090] Updated weights for policy 1, policy_version 865560 (0.0008) [2023-12-26 06:32:56,911][123091] Updated weights for policy 0, policy_version 871754 (0.0008) [2023-12-26 06:32:57,455][123090] Updated weights for policy 1, policy_version 865570 (0.0008) [2023-12-26 06:32:57,505][123090] Updated weights for policy 1, policy_version 865580 (0.0008) [2023-12-26 06:32:57,558][123090] Updated weights for policy 1, policy_version 865591 (0.0009) [2023-12-26 06:32:57,784][123091] Updated weights for policy 0, policy_version 871764 (0.0009) [2023-12-26 06:32:57,845][123091] Updated weights for policy 0, policy_version 871774 (0.0009) [2023-12-26 06:32:57,900][123091] Updated weights for policy 0, policy_version 871784 (0.0009) [2023-12-26 06:32:58,486][123090] Updated weights for policy 1, policy_version 865601 (0.0008) [2023-12-26 06:32:58,546][123090] Updated weights for policy 1, policy_version 865611 (0.0010) [2023-12-26 06:32:58,610][123090] Updated weights for policy 1, policy_version 865621 (0.0009) [2023-12-26 06:32:58,675][123090] Updated weights for policy 1, policy_version 865631 (0.0009) [2023-12-26 06:32:58,680][123091] Updated weights for policy 0, policy_version 871794 (0.0009) [2023-12-26 06:32:58,749][123091] Updated weights for policy 0, policy_version 871804 (0.0008) [2023-12-26 06:32:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 444784640. Throughput: 0: 9032.7, 1: 8917.6. Samples: 444780448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:32:58,784][121949] Avg episode reward: [(0, '6116.181'), (1, '5815.159')] [2023-12-26 06:32:58,815][123091] Updated weights for policy 0, policy_version 871814 (0.0008) [2023-12-26 06:32:58,887][123091] Updated weights for policy 0, policy_version 871824 (0.0007) [2023-12-26 06:32:59,504][123090] Updated weights for policy 1, policy_version 865641 (0.0009) [2023-12-26 06:32:59,555][123090] Updated weights for policy 1, policy_version 865651 (0.0009) [2023-12-26 06:32:59,574][123091] Updated weights for policy 0, policy_version 871834 (0.0008) [2023-12-26 06:32:59,608][123090] Updated weights for policy 1, policy_version 865661 (0.0008) [2023-12-26 06:32:59,641][123091] Updated weights for policy 0, policy_version 871844 (0.0007) [2023-12-26 06:32:59,697][123091] Updated weights for policy 0, policy_version 871855 (0.0009) [2023-12-26 06:33:00,367][123090] Updated weights for policy 1, policy_version 865671 (0.0009) [2023-12-26 06:33:00,429][123090] Updated weights for policy 1, policy_version 865681 (0.0009) [2023-12-26 06:33:00,489][123090] Updated weights for policy 1, policy_version 865691 (0.0010) [2023-12-26 06:33:00,555][123091] Updated weights for policy 0, policy_version 871865 (0.0009) [2023-12-26 06:33:00,616][123091] Updated weights for policy 0, policy_version 871875 (0.0007) [2023-12-26 06:33:00,670][123091] Updated weights for policy 0, policy_version 871885 (0.0009) [2023-12-26 06:33:01,296][123090] Updated weights for policy 1, policy_version 865701 (0.0011) [2023-12-26 06:33:01,368][123090] Updated weights for policy 1, policy_version 865711 (0.0009) [2023-12-26 06:33:01,434][123090] Updated weights for policy 1, policy_version 865721 (0.0009) [2023-12-26 06:33:01,517][123091] Updated weights for policy 0, policy_version 871895 (0.0009) [2023-12-26 06:33:01,566][123091] Updated weights for policy 0, policy_version 871905 (0.0008) [2023-12-26 06:33:01,627][123091] Updated weights for policy 0, policy_version 871915 (0.0008) [2023-12-26 06:33:02,259][123090] Updated weights for policy 1, policy_version 865731 (0.0010) [2023-12-26 06:33:02,323][123090] Updated weights for policy 1, policy_version 865741 (0.0011) [2023-12-26 06:33:02,393][123090] Updated weights for policy 1, policy_version 865751 (0.0010) [2023-12-26 06:33:02,483][123091] Updated weights for policy 0, policy_version 871925 (0.0008) [2023-12-26 06:33:02,532][123091] Updated weights for policy 0, policy_version 871935 (0.0009) [2023-12-26 06:33:02,590][123091] Updated weights for policy 0, policy_version 871945 (0.0009) [2023-12-26 06:33:03,204][123090] Updated weights for policy 1, policy_version 865761 (0.0011) [2023-12-26 06:33:03,256][123090] Updated weights for policy 1, policy_version 865771 (0.0010) [2023-12-26 06:33:03,307][123090] Updated weights for policy 1, policy_version 865781 (0.0010) [2023-12-26 06:33:03,362][123091] Updated weights for policy 0, policy_version 871955 (0.0008) [2023-12-26 06:33:03,366][123090] Updated weights for policy 1, policy_version 865791 (0.0010) [2023-12-26 06:33:03,417][123091] Updated weights for policy 0, policy_version 871965 (0.0010) [2023-12-26 06:33:03,472][123091] Updated weights for policy 0, policy_version 871975 (0.0010) [2023-12-26 06:33:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 444874752. Throughput: 0: 8922.9, 1: 8754.8. Samples: 444883764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:03,785][121949] Avg episode reward: [(0, '6060.176'), (1, '5778.285')] [2023-12-26 06:33:04,172][123090] Updated weights for policy 1, policy_version 865801 (0.0009) [2023-12-26 06:33:04,232][123090] Updated weights for policy 1, policy_version 865811 (0.0009) [2023-12-26 06:33:04,299][123090] Updated weights for policy 1, policy_version 865821 (0.0008) [2023-12-26 06:33:04,308][123091] Updated weights for policy 0, policy_version 871985 (0.0010) [2023-12-26 06:33:04,378][123091] Updated weights for policy 0, policy_version 871995 (0.0011) [2023-12-26 06:33:04,441][123091] Updated weights for policy 0, policy_version 872005 (0.0011) [2023-12-26 06:33:04,508][123091] Updated weights for policy 0, policy_version 872015 (0.0011) [2023-12-26 06:33:05,075][123090] Updated weights for policy 1, policy_version 865831 (0.0005) [2023-12-26 06:33:05,141][123090] Updated weights for policy 1, policy_version 865841 (0.0005) [2023-12-26 06:33:05,205][123090] Updated weights for policy 1, policy_version 865851 (0.0006) [2023-12-26 06:33:05,232][123091] Updated weights for policy 0, policy_version 872025 (0.0008) [2023-12-26 06:33:05,292][123091] Updated weights for policy 0, policy_version 872035 (0.0006) [2023-12-26 06:33:05,354][123091] Updated weights for policy 0, policy_version 872045 (0.0011) [2023-12-26 06:33:05,924][123090] Updated weights for policy 1, policy_version 865861 (0.0008) [2023-12-26 06:33:05,980][123090] Updated weights for policy 1, policy_version 865871 (0.0010) [2023-12-26 06:33:06,048][123090] Updated weights for policy 1, policy_version 865881 (0.0011) [2023-12-26 06:33:06,057][123091] Updated weights for policy 0, policy_version 872055 (0.0007) [2023-12-26 06:33:06,107][123091] Updated weights for policy 0, policy_version 872065 (0.0007) [2023-12-26 06:33:06,161][123091] Updated weights for policy 0, policy_version 872075 (0.0006) [2023-12-26 06:33:06,837][123090] Updated weights for policy 1, policy_version 865891 (0.0010) [2023-12-26 06:33:06,904][123090] Updated weights for policy 1, policy_version 865901 (0.0009) [2023-12-26 06:33:06,971][123091] Updated weights for policy 0, policy_version 872085 (0.0007) [2023-12-26 06:33:06,977][123090] Updated weights for policy 1, policy_version 865911 (0.0009) [2023-12-26 06:33:07,026][123091] Updated weights for policy 0, policy_version 872095 (0.0009) [2023-12-26 06:33:07,074][123091] Updated weights for policy 0, policy_version 872105 (0.0009) [2023-12-26 06:33:07,829][123090] Updated weights for policy 1, policy_version 865921 (0.0009) [2023-12-26 06:33:07,891][123090] Updated weights for policy 1, policy_version 865931 (0.0010) [2023-12-26 06:33:07,897][123091] Updated weights for policy 0, policy_version 872115 (0.0009) [2023-12-26 06:33:07,941][123090] Updated weights for policy 1, policy_version 865941 (0.0008) [2023-12-26 06:33:07,950][123091] Updated weights for policy 0, policy_version 872125 (0.0006) [2023-12-26 06:33:08,006][123090] Updated weights for policy 1, policy_version 865951 (0.0009) [2023-12-26 06:33:08,015][123091] Updated weights for policy 0, policy_version 872135 (0.0008) [2023-12-26 06:33:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 444956672. Throughput: 0: 8955.3, 1: 8777.4. Samples: 444939432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:08,785][121949] Avg episode reward: [(0, '6139.956'), (1, '5746.025')] [2023-12-26 06:33:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000872144_223272960.pth... [2023-12-26 06:33:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000865952_221683712.pth... [2023-12-26 06:33:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000864960_221429760.pth [2023-12-26 06:33:08,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000871120_223010816.pth [2023-12-26 06:33:08,838][123091] Updated weights for policy 0, policy_version 872145 (0.0011) [2023-12-26 06:33:08,871][123090] Updated weights for policy 1, policy_version 865961 (0.0007) [2023-12-26 06:33:08,890][123091] Updated weights for policy 0, policy_version 872155 (0.0011) [2023-12-26 06:33:08,936][123090] Updated weights for policy 1, policy_version 865971 (0.0006) [2023-12-26 06:33:08,950][123091] Updated weights for policy 0, policy_version 872165 (0.0011) [2023-12-26 06:33:08,997][123090] Updated weights for policy 1, policy_version 865981 (0.0006) [2023-12-26 06:33:09,016][123091] Updated weights for policy 0, policy_version 872175 (0.0009) [2023-12-26 06:33:09,812][123091] Updated weights for policy 0, policy_version 872185 (0.0008) [2023-12-26 06:33:09,877][123091] Updated weights for policy 0, policy_version 872195 (0.0008) [2023-12-26 06:33:09,901][123090] Updated weights for policy 1, policy_version 865991 (0.0009) [2023-12-26 06:33:09,946][123091] Updated weights for policy 0, policy_version 872205 (0.0006) [2023-12-26 06:33:09,966][123090] Updated weights for policy 1, policy_version 866001 (0.0009) [2023-12-26 06:33:10,032][123090] Updated weights for policy 1, policy_version 866011 (0.0007) [2023-12-26 06:33:10,675][123091] Updated weights for policy 0, policy_version 872215 (0.0007) [2023-12-26 06:33:10,691][123090] Updated weights for policy 1, policy_version 866021 (0.0006) [2023-12-26 06:33:10,727][123091] Updated weights for policy 0, policy_version 872225 (0.0011) [2023-12-26 06:33:10,752][123090] Updated weights for policy 1, policy_version 866031 (0.0006) [2023-12-26 06:33:10,778][123091] Updated weights for policy 0, policy_version 872235 (0.0010) [2023-12-26 06:33:10,818][123090] Updated weights for policy 1, policy_version 866041 (0.0007) [2023-12-26 06:33:11,574][123090] Updated weights for policy 1, policy_version 866051 (0.0007) [2023-12-26 06:33:11,588][123091] Updated weights for policy 0, policy_version 872245 (0.0007) [2023-12-26 06:33:11,640][123090] Updated weights for policy 1, policy_version 866061 (0.0008) [2023-12-26 06:33:11,649][123091] Updated weights for policy 0, policy_version 872255 (0.0009) [2023-12-26 06:33:11,697][123090] Updated weights for policy 1, policy_version 866071 (0.0010) [2023-12-26 06:33:11,713][123091] Updated weights for policy 0, policy_version 872265 (0.0007) [2023-12-26 06:33:12,559][123091] Updated weights for policy 0, policy_version 872275 (0.0009) [2023-12-26 06:33:12,576][123090] Updated weights for policy 1, policy_version 866082 (0.0010) [2023-12-26 06:33:12,623][123091] Updated weights for policy 0, policy_version 872285 (0.0008) [2023-12-26 06:33:12,637][123090] Updated weights for policy 1, policy_version 866092 (0.0010) [2023-12-26 06:33:12,688][123091] Updated weights for policy 0, policy_version 872295 (0.0007) [2023-12-26 06:33:12,698][123090] Updated weights for policy 1, policy_version 866102 (0.0007) [2023-12-26 06:33:12,749][123090] Updated weights for policy 1, policy_version 866112 (0.0007) [2023-12-26 06:33:13,516][123091] Updated weights for policy 0, policy_version 872305 (0.0008) [2023-12-26 06:33:13,539][123090] Updated weights for policy 1, policy_version 866122 (0.0010) [2023-12-26 06:33:13,574][123091] Updated weights for policy 0, policy_version 872315 (0.0006) [2023-12-26 06:33:13,605][123090] Updated weights for policy 1, policy_version 866132 (0.0010) [2023-12-26 06:33:13,630][123091] Updated weights for policy 0, policy_version 872325 (0.0009) [2023-12-26 06:33:13,660][123090] Updated weights for policy 1, policy_version 866142 (0.0010) [2023-12-26 06:33:13,707][123091] Updated weights for policy 0, policy_version 872335 (0.0008) [2023-12-26 06:33:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 445054976. Throughput: 0: 8845.3, 1: 8674.0. Samples: 445043100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:13,784][121949] Avg episode reward: [(0, '6280.587'), (1, '5680.493')] [2023-12-26 06:33:14,495][123090] Updated weights for policy 1, policy_version 866152 (0.0010) [2023-12-26 06:33:14,500][123091] Updated weights for policy 0, policy_version 872345 (0.0010) [2023-12-26 06:33:14,552][123090] Updated weights for policy 1, policy_version 866162 (0.0011) [2023-12-26 06:33:14,560][123091] Updated weights for policy 0, policy_version 872355 (0.0008) [2023-12-26 06:33:14,605][123090] Updated weights for policy 1, policy_version 866172 (0.0010) [2023-12-26 06:33:14,620][123091] Updated weights for policy 0, policy_version 872365 (0.0011) [2023-12-26 06:33:15,442][123091] Updated weights for policy 0, policy_version 872375 (0.0011) [2023-12-26 06:33:15,466][123090] Updated weights for policy 1, policy_version 866182 (0.0011) [2023-12-26 06:33:15,506][123091] Updated weights for policy 0, policy_version 872385 (0.0011) [2023-12-26 06:33:15,525][123090] Updated weights for policy 1, policy_version 866192 (0.0010) [2023-12-26 06:33:15,565][123091] Updated weights for policy 0, policy_version 872395 (0.0011) [2023-12-26 06:33:15,586][123090] Updated weights for policy 1, policy_version 866202 (0.0010) [2023-12-26 06:33:16,257][123091] Updated weights for policy 0, policy_version 872405 (0.0007) [2023-12-26 06:33:16,305][123091] Updated weights for policy 0, policy_version 872415 (0.0005) [2023-12-26 06:33:16,330][123090] Updated weights for policy 1, policy_version 866212 (0.0008) [2023-12-26 06:33:16,371][123091] Updated weights for policy 0, policy_version 872425 (0.0005) [2023-12-26 06:33:16,383][123090] Updated weights for policy 1, policy_version 866222 (0.0010) [2023-12-26 06:33:16,434][123090] Updated weights for policy 1, policy_version 866232 (0.0010) [2023-12-26 06:33:17,136][123091] Updated weights for policy 0, policy_version 872435 (0.0007) [2023-12-26 06:33:17,187][123091] Updated weights for policy 0, policy_version 872445 (0.0010) [2023-12-26 06:33:17,237][123090] Updated weights for policy 1, policy_version 866242 (0.0010) [2023-12-26 06:33:17,241][123091] Updated weights for policy 0, policy_version 872455 (0.0010) [2023-12-26 06:33:17,292][123090] Updated weights for policy 1, policy_version 866252 (0.0010) [2023-12-26 06:33:17,361][123090] Updated weights for policy 1, policy_version 866262 (0.0010) [2023-12-26 06:33:17,434][123090] Updated weights for policy 1, policy_version 866272 (0.0010) [2023-12-26 06:33:18,068][123091] Updated weights for policy 0, policy_version 872465 (0.0010) [2023-12-26 06:33:18,128][123091] Updated weights for policy 0, policy_version 872475 (0.0010) [2023-12-26 06:33:18,183][123091] Updated weights for policy 0, policy_version 872485 (0.0010) [2023-12-26 06:33:18,184][123090] Updated weights for policy 1, policy_version 866282 (0.0010) [2023-12-26 06:33:18,241][123090] Updated weights for policy 1, policy_version 866292 (0.0009) [2023-12-26 06:33:18,247][123091] Updated weights for policy 0, policy_version 872495 (0.0011) [2023-12-26 06:33:18,306][123090] Updated weights for policy 1, policy_version 866302 (0.0011) [2023-12-26 06:33:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 445136896. Throughput: 0: 8850.2, 1: 8670.9. Samples: 445148296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:18,785][121949] Avg episode reward: [(0, '6273.143'), (1, '5721.867')] [2023-12-26 06:33:19,100][123090] Updated weights for policy 1, policy_version 866312 (0.0006) [2023-12-26 06:33:19,113][123091] Updated weights for policy 0, policy_version 872505 (0.0011) [2023-12-26 06:33:19,161][123091] Updated weights for policy 0, policy_version 872515 (0.0010) [2023-12-26 06:33:19,164][123090] Updated weights for policy 1, policy_version 866322 (0.0005) [2023-12-26 06:33:19,217][123091] Updated weights for policy 0, policy_version 872525 (0.0011) [2023-12-26 06:33:19,232][123090] Updated weights for policy 1, policy_version 866332 (0.0007) [2023-12-26 06:33:19,899][123090] Updated weights for policy 1, policy_version 866342 (0.0009) [2023-12-26 06:33:19,972][123090] Updated weights for policy 1, policy_version 866352 (0.0011) [2023-12-26 06:33:20,016][123091] Updated weights for policy 0, policy_version 872535 (0.0007) [2023-12-26 06:33:20,040][123090] Updated weights for policy 1, policy_version 866362 (0.0011) [2023-12-26 06:33:20,089][123091] Updated weights for policy 0, policy_version 872545 (0.0008) [2023-12-26 06:33:20,148][123091] Updated weights for policy 0, policy_version 872555 (0.0011) [2023-12-26 06:33:20,850][123090] Updated weights for policy 1, policy_version 866372 (0.0010) [2023-12-26 06:33:20,903][123090] Updated weights for policy 1, policy_version 866382 (0.0009) [2023-12-26 06:33:20,931][123091] Updated weights for policy 0, policy_version 872565 (0.0010) [2023-12-26 06:33:20,961][123090] Updated weights for policy 1, policy_version 866392 (0.0009) [2023-12-26 06:33:20,990][123091] Updated weights for policy 0, policy_version 872575 (0.0009) [2023-12-26 06:33:21,053][123091] Updated weights for policy 0, policy_version 872585 (0.0009) [2023-12-26 06:33:21,908][123090] Updated weights for policy 1, policy_version 866402 (0.0009) [2023-12-26 06:33:21,957][123091] Updated weights for policy 0, policy_version 872595 (0.0010) [2023-12-26 06:33:21,959][123090] Updated weights for policy 1, policy_version 866412 (0.0008) [2023-12-26 06:33:22,015][123090] Updated weights for policy 1, policy_version 866422 (0.0006) [2023-12-26 06:33:22,020][123091] Updated weights for policy 0, policy_version 872605 (0.0011) [2023-12-26 06:33:22,083][123090] Updated weights for policy 1, policy_version 866432 (0.0009) [2023-12-26 06:33:22,085][123091] Updated weights for policy 0, policy_version 872615 (0.0007) [2023-12-26 06:33:22,846][123091] Updated weights for policy 0, policy_version 872625 (0.0009) [2023-12-26 06:33:22,916][123091] Updated weights for policy 0, policy_version 872635 (0.0006) [2023-12-26 06:33:22,987][123090] Updated weights for policy 1, policy_version 866442 (0.0009) [2023-12-26 06:33:22,988][123091] Updated weights for policy 0, policy_version 872645 (0.0006) [2023-12-26 06:33:23,047][123090] Updated weights for policy 1, policy_version 866452 (0.0008) [2023-12-26 06:33:23,058][123091] Updated weights for policy 0, policy_version 872655 (0.0006) [2023-12-26 06:33:23,118][123090] Updated weights for policy 1, policy_version 866462 (0.0009) [2023-12-26 06:33:23,682][123091] Updated weights for policy 0, policy_version 872665 (0.0006) [2023-12-26 06:33:23,746][123091] Updated weights for policy 0, policy_version 872675 (0.0006) [2023-12-26 06:33:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 445218816. Throughput: 0: 8855.9, 1: 8616.1. Samples: 445200472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:23,784][121949] Avg episode reward: [(0, '6262.915'), (1, '5817.293')] [2023-12-26 06:33:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000866464_221814784.pth... [2023-12-26 06:33:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000865440_221552640.pth [2023-12-26 06:33:23,807][123091] Updated weights for policy 0, policy_version 872685 (0.0007) [2023-12-26 06:33:23,820][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000872688_223412224.pth... [2023-12-26 06:33:23,823][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000871632_223141888.pth [2023-12-26 06:33:24,008][123090] Updated weights for policy 1, policy_version 866472 (0.0009) [2023-12-26 06:33:24,056][123090] Updated weights for policy 1, policy_version 866482 (0.0008) [2023-12-26 06:33:24,105][123090] Updated weights for policy 1, policy_version 866492 (0.0009) [2023-12-26 06:33:24,585][123091] Updated weights for policy 0, policy_version 872695 (0.0007) [2023-12-26 06:33:24,645][123091] Updated weights for policy 0, policy_version 872705 (0.0006) [2023-12-26 06:33:24,698][123091] Updated weights for policy 0, policy_version 872715 (0.0005) [2023-12-26 06:33:24,994][123090] Updated weights for policy 1, policy_version 866502 (0.0008) [2023-12-26 06:33:25,047][123090] Updated weights for policy 1, policy_version 866512 (0.0010) [2023-12-26 06:33:25,097][123090] Updated weights for policy 1, policy_version 866522 (0.0009) [2023-12-26 06:33:25,382][123091] Updated weights for policy 0, policy_version 872725 (0.0005) [2023-12-26 06:33:25,449][123091] Updated weights for policy 0, policy_version 872735 (0.0005) [2023-12-26 06:33:25,508][123091] Updated weights for policy 0, policy_version 872745 (0.0005) [2023-12-26 06:33:25,983][123090] Updated weights for policy 1, policy_version 866532 (0.0010) [2023-12-26 06:33:26,040][123090] Updated weights for policy 1, policy_version 866542 (0.0009) [2023-12-26 06:33:26,093][123090] Updated weights for policy 1, policy_version 866552 (0.0010) [2023-12-26 06:33:26,223][123091] Updated weights for policy 0, policy_version 872755 (0.0009) [2023-12-26 06:33:26,270][123091] Updated weights for policy 0, policy_version 872765 (0.0010) [2023-12-26 06:33:26,335][123091] Updated weights for policy 0, policy_version 872775 (0.0011) [2023-12-26 06:33:26,876][123090] Updated weights for policy 1, policy_version 866562 (0.0008) [2023-12-26 06:33:26,936][123090] Updated weights for policy 1, policy_version 866572 (0.0005) [2023-12-26 06:33:27,011][123090] Updated weights for policy 1, policy_version 866582 (0.0005) [2023-12-26 06:33:27,072][123091] Updated weights for policy 0, policy_version 872785 (0.0010) [2023-12-26 06:33:27,074][123090] Updated weights for policy 1, policy_version 866592 (0.0007) [2023-12-26 06:33:27,119][123091] Updated weights for policy 0, policy_version 872795 (0.0010) [2023-12-26 06:33:27,169][123091] Updated weights for policy 0, policy_version 872805 (0.0010) [2023-12-26 06:33:27,212][123091] Updated weights for policy 0, policy_version 872815 (0.0010) [2023-12-26 06:33:27,715][123090] Updated weights for policy 1, policy_version 866602 (0.0009) [2023-12-26 06:33:27,780][123090] Updated weights for policy 1, policy_version 866612 (0.0009) [2023-12-26 06:33:27,839][123090] Updated weights for policy 1, policy_version 866622 (0.0005) [2023-12-26 06:33:28,059][123091] Updated weights for policy 0, policy_version 872825 (0.0010) [2023-12-26 06:33:28,128][123091] Updated weights for policy 0, policy_version 872835 (0.0010) [2023-12-26 06:33:28,197][123091] Updated weights for policy 0, policy_version 872845 (0.0010) [2023-12-26 06:33:28,512][123090] Updated weights for policy 1, policy_version 866632 (0.0009) [2023-12-26 06:33:28,573][123090] Updated weights for policy 1, policy_version 866642 (0.0009) [2023-12-26 06:33:28,645][123090] Updated weights for policy 1, policy_version 866652 (0.0006) [2023-12-26 06:33:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 445317120. Throughput: 0: 8989.8, 1: 8614.9. Samples: 445307668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:28,784][121949] Avg episode reward: [(0, '6166.756'), (1, '5791.785')] [2023-12-26 06:33:29,026][123091] Updated weights for policy 0, policy_version 872855 (0.0011) [2023-12-26 06:33:29,089][123091] Updated weights for policy 0, policy_version 872865 (0.0010) [2023-12-26 06:33:29,147][123091] Updated weights for policy 0, policy_version 872875 (0.0008) [2023-12-26 06:33:29,404][123090] Updated weights for policy 1, policy_version 866662 (0.0008) [2023-12-26 06:33:29,470][123090] Updated weights for policy 1, policy_version 866672 (0.0009) [2023-12-26 06:33:29,530][123090] Updated weights for policy 1, policy_version 866682 (0.0008) [2023-12-26 06:33:29,938][123091] Updated weights for policy 0, policy_version 872885 (0.0008) [2023-12-26 06:33:30,009][123091] Updated weights for policy 0, policy_version 872895 (0.0011) [2023-12-26 06:33:30,079][123091] Updated weights for policy 0, policy_version 872905 (0.0011) [2023-12-26 06:33:30,393][123090] Updated weights for policy 1, policy_version 866692 (0.0009) [2023-12-26 06:33:30,445][123090] Updated weights for policy 1, policy_version 866702 (0.0010) [2023-12-26 06:33:30,507][123090] Updated weights for policy 1, policy_version 866712 (0.0010) [2023-12-26 06:33:30,831][123091] Updated weights for policy 0, policy_version 872915 (0.0010) [2023-12-26 06:33:30,874][123091] Updated weights for policy 0, policy_version 872925 (0.0010) [2023-12-26 06:33:30,917][123091] Updated weights for policy 0, policy_version 872935 (0.0010) [2023-12-26 06:33:31,324][123090] Updated weights for policy 1, policy_version 866722 (0.0010) [2023-12-26 06:33:31,389][123090] Updated weights for policy 1, policy_version 866732 (0.0009) [2023-12-26 06:33:31,450][123090] Updated weights for policy 1, policy_version 866742 (0.0009) [2023-12-26 06:33:31,510][123090] Updated weights for policy 1, policy_version 866752 (0.0010) [2023-12-26 06:33:31,733][123091] Updated weights for policy 0, policy_version 872945 (0.0010) [2023-12-26 06:33:31,798][123091] Updated weights for policy 0, policy_version 872955 (0.0009) [2023-12-26 06:33:31,860][123091] Updated weights for policy 0, policy_version 872965 (0.0008) [2023-12-26 06:33:31,916][123091] Updated weights for policy 0, policy_version 872975 (0.0010) [2023-12-26 06:33:32,377][123090] Updated weights for policy 1, policy_version 866762 (0.0010) [2023-12-26 06:33:32,442][123090] Updated weights for policy 1, policy_version 866772 (0.0010) [2023-12-26 06:33:32,499][123090] Updated weights for policy 1, policy_version 866782 (0.0010) [2023-12-26 06:33:32,704][123091] Updated weights for policy 0, policy_version 872985 (0.0005) [2023-12-26 06:33:32,751][123091] Updated weights for policy 0, policy_version 872995 (0.0005) [2023-12-26 06:33:32,803][123091] Updated weights for policy 0, policy_version 873005 (0.0005) [2023-12-26 06:33:33,382][123090] Updated weights for policy 1, policy_version 866792 (0.0007) [2023-12-26 06:33:33,448][123090] Updated weights for policy 1, policy_version 866802 (0.0010) [2023-12-26 06:33:33,513][123091] Updated weights for policy 0, policy_version 873015 (0.0007) [2023-12-26 06:33:33,514][123090] Updated weights for policy 1, policy_version 866812 (0.0009) [2023-12-26 06:33:33,582][123091] Updated weights for policy 0, policy_version 873025 (0.0008) [2023-12-26 06:33:33,648][123091] Updated weights for policy 0, policy_version 873035 (0.0009) [2023-12-26 06:33:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 445407232. Throughput: 0: 8910.5, 1: 8691.2. Samples: 445412860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:33,784][121949] Avg episode reward: [(0, '6110.930'), (1, '5781.309')] [2023-12-26 06:33:34,320][123090] Updated weights for policy 1, policy_version 866822 (0.0010) [2023-12-26 06:33:34,382][123090] Updated weights for policy 1, policy_version 866832 (0.0009) [2023-12-26 06:33:34,436][123090] Updated weights for policy 1, policy_version 866842 (0.0007) [2023-12-26 06:33:34,468][123091] Updated weights for policy 0, policy_version 873045 (0.0009) [2023-12-26 06:33:34,532][123091] Updated weights for policy 0, policy_version 873055 (0.0010) [2023-12-26 06:33:34,592][123091] Updated weights for policy 0, policy_version 873065 (0.0010) [2023-12-26 06:33:35,254][123090] Updated weights for policy 1, policy_version 866852 (0.0007) [2023-12-26 06:33:35,301][123090] Updated weights for policy 1, policy_version 866862 (0.0008) [2023-12-26 06:33:35,349][123090] Updated weights for policy 1, policy_version 866872 (0.0009) [2023-12-26 06:33:35,416][123091] Updated weights for policy 0, policy_version 873075 (0.0009) [2023-12-26 06:33:35,474][123091] Updated weights for policy 0, policy_version 873085 (0.0009) [2023-12-26 06:33:35,537][123091] Updated weights for policy 0, policy_version 873095 (0.0009) [2023-12-26 06:33:36,197][123090] Updated weights for policy 1, policy_version 866882 (0.0009) [2023-12-26 06:33:36,265][123090] Updated weights for policy 1, policy_version 866892 (0.0009) [2023-12-26 06:33:36,331][123090] Updated weights for policy 1, policy_version 866902 (0.0010) [2023-12-26 06:33:36,360][123091] Updated weights for policy 0, policy_version 873105 (0.0009) [2023-12-26 06:33:36,398][123090] Updated weights for policy 1, policy_version 866912 (0.0009) [2023-12-26 06:33:36,433][123091] Updated weights for policy 0, policy_version 873115 (0.0008) [2023-12-26 06:33:36,499][123091] Updated weights for policy 0, policy_version 873125 (0.0008) [2023-12-26 06:33:36,563][123091] Updated weights for policy 0, policy_version 873135 (0.0006) [2023-12-26 06:33:37,207][123091] Updated weights for policy 0, policy_version 873145 (0.0009) [2023-12-26 06:33:37,266][123091] Updated weights for policy 0, policy_version 873155 (0.0009) [2023-12-26 06:33:37,287][123090] Updated weights for policy 1, policy_version 866922 (0.0007) [2023-12-26 06:33:37,317][123091] Updated weights for policy 0, policy_version 873165 (0.0008) [2023-12-26 06:33:37,339][123090] Updated weights for policy 1, policy_version 866932 (0.0008) [2023-12-26 06:33:37,408][123090] Updated weights for policy 1, policy_version 866942 (0.0009) [2023-12-26 06:33:38,184][123091] Updated weights for policy 0, policy_version 873175 (0.0010) [2023-12-26 06:33:38,240][123091] Updated weights for policy 0, policy_version 873185 (0.0009) [2023-12-26 06:33:38,255][123090] Updated weights for policy 1, policy_version 866952 (0.0009) [2023-12-26 06:33:38,303][123091] Updated weights for policy 0, policy_version 873195 (0.0007) [2023-12-26 06:33:38,318][123090] Updated weights for policy 1, policy_version 866962 (0.0009) [2023-12-26 06:33:38,389][123090] Updated weights for policy 1, policy_version 866972 (0.0009) [2023-12-26 06:33:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 445489152. Throughput: 0: 8873.9, 1: 8722.1. Samples: 445464264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:38,785][121949] Avg episode reward: [(0, '6186.871'), (1, '5880.038')] [2023-12-26 06:33:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000873200_223543296.pth... [2023-12-26 06:33:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000866976_221945856.pth... [2023-12-26 06:33:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000865952_221683712.pth [2023-12-26 06:33:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000872144_223272960.pth [2023-12-26 06:33:39,098][123091] Updated weights for policy 0, policy_version 873205 (0.0007) [2023-12-26 06:33:39,166][123091] Updated weights for policy 0, policy_version 873215 (0.0007) [2023-12-26 06:33:39,176][123090] Updated weights for policy 1, policy_version 866982 (0.0010) [2023-12-26 06:33:39,238][123091] Updated weights for policy 0, policy_version 873225 (0.0009) [2023-12-26 06:33:39,261][123090] Updated weights for policy 1, policy_version 866992 (0.0010) [2023-12-26 06:33:39,331][123090] Updated weights for policy 1, policy_version 867002 (0.0008) [2023-12-26 06:33:40,036][123091] Updated weights for policy 0, policy_version 873235 (0.0007) [2023-12-26 06:33:40,093][123091] Updated weights for policy 0, policy_version 873245 (0.0009) [2023-12-26 06:33:40,160][123091] Updated weights for policy 0, policy_version 873255 (0.0009) [2023-12-26 06:33:40,210][123090] Updated weights for policy 1, policy_version 867012 (0.0008) [2023-12-26 06:33:40,264][123090] Updated weights for policy 1, policy_version 867022 (0.0010) [2023-12-26 06:33:40,316][123090] Updated weights for policy 1, policy_version 867032 (0.0009) [2023-12-26 06:33:40,993][123091] Updated weights for policy 0, policy_version 873265 (0.0009) [2023-12-26 06:33:41,060][123091] Updated weights for policy 0, policy_version 873275 (0.0009) [2023-12-26 06:33:41,121][123091] Updated weights for policy 0, policy_version 873285 (0.0010) [2023-12-26 06:33:41,146][123090] Updated weights for policy 1, policy_version 867042 (0.0008) [2023-12-26 06:33:41,189][123091] Updated weights for policy 0, policy_version 873295 (0.0009) [2023-12-26 06:33:41,209][123090] Updated weights for policy 1, policy_version 867052 (0.0009) [2023-12-26 06:33:41,266][123090] Updated weights for policy 1, policy_version 867062 (0.0009) [2023-12-26 06:33:41,319][123090] Updated weights for policy 1, policy_version 867072 (0.0010) [2023-12-26 06:33:42,010][123091] Updated weights for policy 0, policy_version 873305 (0.0010) [2023-12-26 06:33:42,076][123091] Updated weights for policy 0, policy_version 873315 (0.0009) [2023-12-26 06:33:42,136][123091] Updated weights for policy 0, policy_version 873325 (0.0010) [2023-12-26 06:33:42,245][123090] Updated weights for policy 1, policy_version 867082 (0.0006) [2023-12-26 06:33:42,312][123090] Updated weights for policy 1, policy_version 867092 (0.0009) [2023-12-26 06:33:42,377][123090] Updated weights for policy 1, policy_version 867102 (0.0009) [2023-12-26 06:33:42,952][123091] Updated weights for policy 0, policy_version 873335 (0.0010) [2023-12-26 06:33:43,008][123091] Updated weights for policy 0, policy_version 873345 (0.0010) [2023-12-26 06:33:43,055][123091] Updated weights for policy 0, policy_version 873355 (0.0009) [2023-12-26 06:33:43,152][123090] Updated weights for policy 1, policy_version 867112 (0.0009) [2023-12-26 06:33:43,221][123090] Updated weights for policy 1, policy_version 867122 (0.0009) [2023-12-26 06:33:43,288][123090] Updated weights for policy 1, policy_version 867132 (0.0008) [2023-12-26 06:33:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 445571072. Throughput: 0: 8883.7, 1: 8596.3. Samples: 445567048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:43,785][121949] Avg episode reward: [(0, '6163.583'), (1, '5858.407')] [2023-12-26 06:33:43,884][123091] Updated weights for policy 0, policy_version 873365 (0.0007) [2023-12-26 06:33:43,930][123091] Updated weights for policy 0, policy_version 873375 (0.0005) [2023-12-26 06:33:43,973][123091] Updated weights for policy 0, policy_version 873385 (0.0005) [2023-12-26 06:33:44,097][123090] Updated weights for policy 1, policy_version 867142 (0.0007) [2023-12-26 06:33:44,158][123090] Updated weights for policy 1, policy_version 867152 (0.0005) [2023-12-26 06:33:44,216][123090] Updated weights for policy 1, policy_version 867162 (0.0006) [2023-12-26 06:33:44,854][123091] Updated weights for policy 0, policy_version 873395 (0.0006) [2023-12-26 06:33:44,856][123090] Updated weights for policy 1, policy_version 867172 (0.0008) [2023-12-26 06:33:44,920][123091] Updated weights for policy 0, policy_version 873405 (0.0008) [2023-12-26 06:33:44,921][123090] Updated weights for policy 1, policy_version 867182 (0.0011) [2023-12-26 06:33:44,977][123091] Updated weights for policy 0, policy_version 873415 (0.0007) [2023-12-26 06:33:44,980][123090] Updated weights for policy 1, policy_version 867192 (0.0011) [2023-12-26 06:33:45,835][123091] Updated weights for policy 0, policy_version 873425 (0.0010) [2023-12-26 06:33:45,839][123090] Updated weights for policy 1, policy_version 867202 (0.0009) [2023-12-26 06:33:45,891][123091] Updated weights for policy 0, policy_version 873435 (0.0007) [2023-12-26 06:33:45,897][123090] Updated weights for policy 1, policy_version 867212 (0.0010) [2023-12-26 06:33:45,947][123090] Updated weights for policy 1, policy_version 867222 (0.0008) [2023-12-26 06:33:45,950][123091] Updated weights for policy 0, policy_version 873445 (0.0009) [2023-12-26 06:33:46,001][123090] Updated weights for policy 1, policy_version 867232 (0.0008) [2023-12-26 06:33:46,009][123091] Updated weights for policy 0, policy_version 873455 (0.0009) [2023-12-26 06:33:46,835][123091] Updated weights for policy 0, policy_version 873465 (0.0008) [2023-12-26 06:33:46,851][123090] Updated weights for policy 1, policy_version 867242 (0.0009) [2023-12-26 06:33:46,903][123091] Updated weights for policy 0, policy_version 873475 (0.0007) [2023-12-26 06:33:46,910][123090] Updated weights for policy 1, policy_version 867252 (0.0008) [2023-12-26 06:33:46,962][123090] Updated weights for policy 1, policy_version 867262 (0.0005) [2023-12-26 06:33:46,971][123091] Updated weights for policy 0, policy_version 873485 (0.0008) [2023-12-26 06:33:47,748][123091] Updated weights for policy 0, policy_version 873495 (0.0006) [2023-12-26 06:33:47,758][123090] Updated weights for policy 1, policy_version 867272 (0.0008) [2023-12-26 06:33:47,802][123091] Updated weights for policy 0, policy_version 873505 (0.0006) [2023-12-26 06:33:47,823][123090] Updated weights for policy 1, policy_version 867282 (0.0008) [2023-12-26 06:33:47,848][123091] Updated weights for policy 0, policy_version 873515 (0.0008) [2023-12-26 06:33:47,886][123090] Updated weights for policy 1, policy_version 867292 (0.0009) [2023-12-26 06:33:48,672][123091] Updated weights for policy 0, policy_version 873525 (0.0007) [2023-12-26 06:33:48,703][123090] Updated weights for policy 1, policy_version 867302 (0.0010) [2023-12-26 06:33:48,739][123091] Updated weights for policy 0, policy_version 873535 (0.0007) [2023-12-26 06:33:48,766][123090] Updated weights for policy 1, policy_version 867312 (0.0010) [2023-12-26 06:33:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 445652992. Throughput: 0: 8878.7, 1: 8627.3. Samples: 445671532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:48,784][121949] Avg episode reward: [(0, '6148.751'), (1, '5811.516')] [2023-12-26 06:33:48,800][123091] Updated weights for policy 0, policy_version 873545 (0.0006) [2023-12-26 06:33:48,832][123090] Updated weights for policy 1, policy_version 867322 (0.0009) [2023-12-26 06:33:49,617][123091] Updated weights for policy 0, policy_version 873555 (0.0008) [2023-12-26 06:33:49,681][123090] Updated weights for policy 1, policy_version 867332 (0.0009) [2023-12-26 06:33:49,683][123091] Updated weights for policy 0, policy_version 873565 (0.0009) [2023-12-26 06:33:49,743][123091] Updated weights for policy 0, policy_version 873575 (0.0009) [2023-12-26 06:33:49,763][123090] Updated weights for policy 1, policy_version 867342 (0.0007) [2023-12-26 06:33:49,818][123090] Updated weights for policy 1, policy_version 867352 (0.0009) [2023-12-26 06:33:50,537][123091] Updated weights for policy 0, policy_version 873585 (0.0006) [2023-12-26 06:33:50,603][123091] Updated weights for policy 0, policy_version 873595 (0.0010) [2023-12-26 06:33:50,664][123091] Updated weights for policy 0, policy_version 873605 (0.0010) [2023-12-26 06:33:50,688][123090] Updated weights for policy 1, policy_version 867362 (0.0010) [2023-12-26 06:33:50,727][123091] Updated weights for policy 0, policy_version 873615 (0.0006) [2023-12-26 06:33:50,755][123090] Updated weights for policy 1, policy_version 867372 (0.0009) [2023-12-26 06:33:50,811][123090] Updated weights for policy 1, policy_version 867382 (0.0009) [2023-12-26 06:33:50,873][123090] Updated weights for policy 1, policy_version 867392 (0.0009) [2023-12-26 06:33:51,532][123091] Updated weights for policy 0, policy_version 873625 (0.0008) [2023-12-26 06:33:51,598][123091] Updated weights for policy 0, policy_version 873635 (0.0009) [2023-12-26 06:33:51,664][123091] Updated weights for policy 0, policy_version 873645 (0.0008) [2023-12-26 06:33:51,744][123090] Updated weights for policy 1, policy_version 867402 (0.0010) [2023-12-26 06:33:51,811][123090] Updated weights for policy 1, policy_version 867412 (0.0010) [2023-12-26 06:33:51,864][123090] Updated weights for policy 1, policy_version 867422 (0.0009) [2023-12-26 06:33:52,468][123091] Updated weights for policy 0, policy_version 873655 (0.0009) [2023-12-26 06:33:52,523][123091] Updated weights for policy 0, policy_version 873665 (0.0010) [2023-12-26 06:33:52,581][123091] Updated weights for policy 0, policy_version 873675 (0.0010) [2023-12-26 06:33:52,719][123090] Updated weights for policy 1, policy_version 867432 (0.0009) [2023-12-26 06:33:52,786][123090] Updated weights for policy 1, policy_version 867442 (0.0010) [2023-12-26 06:33:52,845][123090] Updated weights for policy 1, policy_version 867452 (0.0009) [2023-12-26 06:33:53,422][123091] Updated weights for policy 0, policy_version 873685 (0.0010) [2023-12-26 06:33:53,472][123091] Updated weights for policy 0, policy_version 873695 (0.0009) [2023-12-26 06:33:53,536][123091] Updated weights for policy 0, policy_version 873705 (0.0009) [2023-12-26 06:33:53,657][123090] Updated weights for policy 1, policy_version 867462 (0.0007) [2023-12-26 06:33:53,715][123090] Updated weights for policy 1, policy_version 867472 (0.0007) [2023-12-26 06:33:53,771][123090] Updated weights for policy 1, policy_version 867482 (0.0009) [2023-12-26 06:33:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 445743104. Throughput: 0: 8829.1, 1: 8560.4. Samples: 445721964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:53,785][121949] Avg episode reward: [(0, '6215.342'), (1, '5713.384')] [2023-12-26 06:33:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000873712_223674368.pth... [2023-12-26 06:33:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000872688_223412224.pth [2023-12-26 06:33:53,793][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000873712_223674368.pth [2023-12-26 06:33:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000867488_222076928.pth... [2023-12-26 06:33:53,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000866464_221814784.pth [2023-12-26 06:33:53,807][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000867488_222076928.pth [2023-12-26 06:33:54,412][123091] Updated weights for policy 0, policy_version 873715 (0.0010) [2023-12-26 06:33:54,475][123091] Updated weights for policy 0, policy_version 873725 (0.0009) [2023-12-26 06:33:54,530][123091] Updated weights for policy 0, policy_version 873735 (0.0010) [2023-12-26 06:33:54,555][123090] Updated weights for policy 1, policy_version 867492 (0.0008) [2023-12-26 06:33:54,623][123090] Updated weights for policy 1, policy_version 867502 (0.0009) [2023-12-26 06:33:54,685][123090] Updated weights for policy 1, policy_version 867512 (0.0010) [2023-12-26 06:33:55,218][123091] Updated weights for policy 0, policy_version 873745 (0.0006) [2023-12-26 06:33:55,278][123091] Updated weights for policy 0, policy_version 873755 (0.0011) [2023-12-26 06:33:55,334][123091] Updated weights for policy 0, policy_version 873765 (0.0011) [2023-12-26 06:33:55,399][123091] Updated weights for policy 0, policy_version 873775 (0.0010) [2023-12-26 06:33:55,560][123090] Updated weights for policy 1, policy_version 867522 (0.0009) [2023-12-26 06:33:55,621][123090] Updated weights for policy 1, policy_version 867532 (0.0009) [2023-12-26 06:33:55,678][123090] Updated weights for policy 1, policy_version 867542 (0.0009) [2023-12-26 06:33:55,747][123090] Updated weights for policy 1, policy_version 867552 (0.0009) [2023-12-26 06:33:56,232][123091] Updated weights for policy 0, policy_version 873785 (0.0010) [2023-12-26 06:33:56,286][123091] Updated weights for policy 0, policy_version 873795 (0.0010) [2023-12-26 06:33:56,340][123091] Updated weights for policy 0, policy_version 873805 (0.0010) [2023-12-26 06:33:56,478][123090] Updated weights for policy 1, policy_version 867562 (0.0005) [2023-12-26 06:33:56,545][123090] Updated weights for policy 1, policy_version 867572 (0.0006) [2023-12-26 06:33:56,607][123090] Updated weights for policy 1, policy_version 867582 (0.0008) [2023-12-26 06:33:57,180][123091] Updated weights for policy 0, policy_version 873816 (0.0011) [2023-12-26 06:33:57,227][123091] Updated weights for policy 0, policy_version 873826 (0.0010) [2023-12-26 06:33:57,235][123090] Updated weights for policy 1, policy_version 867592 (0.0006) [2023-12-26 06:33:57,274][123091] Updated weights for policy 0, policy_version 873836 (0.0010) [2023-12-26 06:33:57,290][123090] Updated weights for policy 1, policy_version 867602 (0.0005) [2023-12-26 06:33:57,352][123090] Updated weights for policy 1, policy_version 867612 (0.0010) [2023-12-26 06:33:58,049][123091] Updated weights for policy 0, policy_version 873846 (0.0010) [2023-12-26 06:33:58,116][123091] Updated weights for policy 0, policy_version 873856 (0.0009) [2023-12-26 06:33:58,150][123090] Updated weights for policy 1, policy_version 867622 (0.0010) [2023-12-26 06:33:58,178][123091] Updated weights for policy 0, policy_version 873866 (0.0009) [2023-12-26 06:33:58,218][123090] Updated weights for policy 1, policy_version 867632 (0.0010) [2023-12-26 06:33:58,273][123090] Updated weights for policy 1, policy_version 867642 (0.0009) [2023-12-26 06:33:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 445833216. Throughput: 0: 8822.7, 1: 8615.4. Samples: 445827816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:33:58,785][121949] Avg episode reward: [(0, '6301.205'), (1, '5740.792')] [2023-12-26 06:33:59,036][123091] Updated weights for policy 0, policy_version 873876 (0.0007) [2023-12-26 06:33:59,075][123090] Updated weights for policy 1, policy_version 867652 (0.0008) [2023-12-26 06:33:59,101][123091] Updated weights for policy 0, policy_version 873886 (0.0010) [2023-12-26 06:33:59,143][123090] Updated weights for policy 1, policy_version 867662 (0.0006) [2023-12-26 06:33:59,157][123091] Updated weights for policy 0, policy_version 873896 (0.0010) [2023-12-26 06:33:59,206][123090] Updated weights for policy 1, policy_version 867672 (0.0006) [2023-12-26 06:33:59,912][123091] Updated weights for policy 0, policy_version 873906 (0.0010) [2023-12-26 06:33:59,960][123090] Updated weights for policy 1, policy_version 867682 (0.0008) [2023-12-26 06:33:59,971][123091] Updated weights for policy 0, policy_version 873916 (0.0008) [2023-12-26 06:34:00,010][123090] Updated weights for policy 1, policy_version 867692 (0.0006) [2023-12-26 06:34:00,022][123091] Updated weights for policy 0, policy_version 873926 (0.0005) [2023-12-26 06:34:00,068][123090] Updated weights for policy 1, policy_version 867702 (0.0005) [2023-12-26 06:34:00,081][123091] Updated weights for policy 0, policy_version 873936 (0.0006) [2023-12-26 06:34:00,123][123090] Updated weights for policy 1, policy_version 867712 (0.0005) [2023-12-26 06:34:00,858][123091] Updated weights for policy 0, policy_version 873946 (0.0005) [2023-12-26 06:34:00,883][123090] Updated weights for policy 1, policy_version 867722 (0.0008) [2023-12-26 06:34:00,912][123091] Updated weights for policy 0, policy_version 873956 (0.0006) [2023-12-26 06:34:00,934][123090] Updated weights for policy 1, policy_version 867732 (0.0008) [2023-12-26 06:34:00,974][123091] Updated weights for policy 0, policy_version 873966 (0.0010) [2023-12-26 06:34:00,997][123090] Updated weights for policy 1, policy_version 867742 (0.0005) [2023-12-26 06:34:01,792][123091] Updated weights for policy 0, policy_version 873976 (0.0010) [2023-12-26 06:34:01,813][123090] Updated weights for policy 1, policy_version 867752 (0.0009) [2023-12-26 06:34:01,854][123091] Updated weights for policy 0, policy_version 873986 (0.0010) [2023-12-26 06:34:01,861][123090] Updated weights for policy 1, policy_version 867762 (0.0010) [2023-12-26 06:34:01,913][123091] Updated weights for policy 0, policy_version 873996 (0.0007) [2023-12-26 06:34:01,917][123090] Updated weights for policy 1, policy_version 867772 (0.0010) [2023-12-26 06:34:02,607][123091] Updated weights for policy 0, policy_version 874006 (0.0005) [2023-12-26 06:34:02,655][123091] Updated weights for policy 0, policy_version 874016 (0.0005) [2023-12-26 06:34:02,707][123091] Updated weights for policy 0, policy_version 874026 (0.0007) [2023-12-26 06:34:02,722][123090] Updated weights for policy 1, policy_version 867782 (0.0010) [2023-12-26 06:34:02,778][123090] Updated weights for policy 1, policy_version 867792 (0.0009) [2023-12-26 06:34:02,831][123090] Updated weights for policy 1, policy_version 867802 (0.0010) [2023-12-26 06:34:03,404][123091] Updated weights for policy 0, policy_version 874036 (0.0005) [2023-12-26 06:34:03,467][123091] Updated weights for policy 0, policy_version 874046 (0.0005) [2023-12-26 06:34:03,534][123091] Updated weights for policy 0, policy_version 874056 (0.0009) [2023-12-26 06:34:03,746][123090] Updated weights for policy 1, policy_version 867812 (0.0010) [2023-12-26 06:34:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 445923328. Throughput: 0: 8877.9, 1: 8644.0. Samples: 445936776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:34:03,785][121949] Avg episode reward: [(0, '6331.081'), (1, '5838.569')] [2023-12-26 06:34:03,810][123090] Updated weights for policy 1, policy_version 867822 (0.0009) [2023-12-26 06:34:03,883][123090] Updated weights for policy 1, policy_version 867832 (0.0009) [2023-12-26 06:34:04,291][123091] Updated weights for policy 0, policy_version 874066 (0.0008) [2023-12-26 06:34:04,369][123091] Updated weights for policy 0, policy_version 874076 (0.0007) [2023-12-26 06:34:04,440][123091] Updated weights for policy 0, policy_version 874086 (0.0010) [2023-12-26 06:34:04,503][123091] Updated weights for policy 0, policy_version 874096 (0.0010) [2023-12-26 06:34:04,689][123090] Updated weights for policy 1, policy_version 867842 (0.0010) [2023-12-26 06:34:04,746][123090] Updated weights for policy 1, policy_version 867852 (0.0010) [2023-12-26 06:34:04,795][123090] Updated weights for policy 1, policy_version 867862 (0.0009) [2023-12-26 06:34:04,844][123090] Updated weights for policy 1, policy_version 867872 (0.0009) [2023-12-26 06:34:05,278][123091] Updated weights for policy 0, policy_version 874106 (0.0009) [2023-12-26 06:34:05,323][123091] Updated weights for policy 0, policy_version 874116 (0.0006) [2023-12-26 06:34:05,378][123091] Updated weights for policy 0, policy_version 874126 (0.0005) [2023-12-26 06:34:05,681][123090] Updated weights for policy 1, policy_version 867882 (0.0010) [2023-12-26 06:34:05,740][123090] Updated weights for policy 1, policy_version 867892 (0.0010) [2023-12-26 06:34:05,797][123090] Updated weights for policy 1, policy_version 867902 (0.0009) [2023-12-26 06:34:06,249][123091] Updated weights for policy 0, policy_version 874136 (0.0009) [2023-12-26 06:34:06,316][123091] Updated weights for policy 0, policy_version 874146 (0.0010) [2023-12-26 06:34:06,382][123091] Updated weights for policy 0, policy_version 874156 (0.0010) [2023-12-26 06:34:06,624][123090] Updated weights for policy 1, policy_version 867912 (0.0009) [2023-12-26 06:34:06,682][123090] Updated weights for policy 1, policy_version 867922 (0.0008) [2023-12-26 06:34:06,731][123090] Updated weights for policy 1, policy_version 867932 (0.0009) [2023-12-26 06:34:07,202][123091] Updated weights for policy 0, policy_version 874166 (0.0010) [2023-12-26 06:34:07,254][123091] Updated weights for policy 0, policy_version 874176 (0.0010) [2023-12-26 06:34:07,304][123091] Updated weights for policy 0, policy_version 874186 (0.0010) [2023-12-26 06:34:07,541][123090] Updated weights for policy 1, policy_version 867942 (0.0007) [2023-12-26 06:34:07,606][123090] Updated weights for policy 1, policy_version 867952 (0.0009) [2023-12-26 06:34:07,659][123090] Updated weights for policy 1, policy_version 867962 (0.0009) [2023-12-26 06:34:08,150][123091] Updated weights for policy 0, policy_version 874196 (0.0010) [2023-12-26 06:34:08,205][123091] Updated weights for policy 0, policy_version 874206 (0.0010) [2023-12-26 06:34:08,256][123091] Updated weights for policy 0, policy_version 874216 (0.0008) [2023-12-26 06:34:08,477][123090] Updated weights for policy 1, policy_version 867973 (0.0010) [2023-12-26 06:34:08,546][123090] Updated weights for policy 1, policy_version 867983 (0.0010) [2023-12-26 06:34:08,615][123090] Updated weights for policy 1, policy_version 867993 (0.0010) [2023-12-26 06:34:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 446013440. Throughput: 0: 8890.7, 1: 8630.9. Samples: 445988944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:34:08,784][121949] Avg episode reward: [(0, '6140.439'), (1, '5888.014')] [2023-12-26 06:34:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000874224_223805440.pth... [2023-12-26 06:34:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000868000_222208000.pth... [2023-12-26 06:34:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000873200_223543296.pth [2023-12-26 06:34:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000866976_221945856.pth [2023-12-26 06:34:09,086][123091] Updated weights for policy 0, policy_version 874226 (0.0010) [2023-12-26 06:34:09,139][123091] Updated weights for policy 0, policy_version 874236 (0.0010) [2023-12-26 06:34:09,193][123091] Updated weights for policy 0, policy_version 874246 (0.0010) [2023-12-26 06:34:09,266][123091] Updated weights for policy 0, policy_version 874256 (0.0010) [2023-12-26 06:34:09,421][123090] Updated weights for policy 1, policy_version 868003 (0.0008) [2023-12-26 06:34:09,482][123090] Updated weights for policy 1, policy_version 868013 (0.0009) [2023-12-26 06:34:09,540][123090] Updated weights for policy 1, policy_version 868023 (0.0007) [2023-12-26 06:34:10,126][123091] Updated weights for policy 0, policy_version 874266 (0.0008) [2023-12-26 06:34:10,193][123091] Updated weights for policy 0, policy_version 874276 (0.0009) [2023-12-26 06:34:10,249][123091] Updated weights for policy 0, policy_version 874286 (0.0009) [2023-12-26 06:34:10,420][123090] Updated weights for policy 1, policy_version 868033 (0.0008) [2023-12-26 06:34:10,477][123090] Updated weights for policy 1, policy_version 868043 (0.0010) [2023-12-26 06:34:10,539][123090] Updated weights for policy 1, policy_version 868053 (0.0009) [2023-12-26 06:34:10,596][123090] Updated weights for policy 1, policy_version 868063 (0.0009) [2023-12-26 06:34:11,114][123091] Updated weights for policy 0, policy_version 874296 (0.0010) [2023-12-26 06:34:11,194][123091] Updated weights for policy 0, policy_version 874307 (0.0010) [2023-12-26 06:34:11,261][123091] Updated weights for policy 0, policy_version 874317 (0.0010) [2023-12-26 06:34:11,398][123090] Updated weights for policy 1, policy_version 868073 (0.0009) [2023-12-26 06:34:11,470][123090] Updated weights for policy 1, policy_version 868083 (0.0006) [2023-12-26 06:34:11,542][123090] Updated weights for policy 1, policy_version 868093 (0.0006) [2023-12-26 06:34:12,082][123091] Updated weights for policy 0, policy_version 874327 (0.0010) [2023-12-26 06:34:12,139][123091] Updated weights for policy 0, policy_version 874337 (0.0009) [2023-12-26 06:34:12,200][123091] Updated weights for policy 0, policy_version 874347 (0.0009) [2023-12-26 06:34:12,358][123090] Updated weights for policy 1, policy_version 868103 (0.0008) [2023-12-26 06:34:12,424][123090] Updated weights for policy 1, policy_version 868113 (0.0010) [2023-12-26 06:34:12,487][123090] Updated weights for policy 1, policy_version 868123 (0.0009) [2023-12-26 06:34:12,938][123091] Updated weights for policy 0, policy_version 874357 (0.0008) [2023-12-26 06:34:12,993][123091] Updated weights for policy 0, policy_version 874367 (0.0006) [2023-12-26 06:34:13,052][123091] Updated weights for policy 0, policy_version 874377 (0.0006) [2023-12-26 06:34:13,373][123090] Updated weights for policy 1, policy_version 868133 (0.0010) [2023-12-26 06:34:13,430][123090] Updated weights for policy 1, policy_version 868143 (0.0006) [2023-12-26 06:34:13,491][123090] Updated weights for policy 1, policy_version 868153 (0.0008) [2023-12-26 06:34:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 446095360. Throughput: 0: 8760.4, 1: 8619.3. Samples: 446089756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:34:13,785][121949] Avg episode reward: [(0, '6145.574'), (1, '5932.286')] [2023-12-26 06:34:13,817][123091] Updated weights for policy 0, policy_version 874387 (0.0007) [2023-12-26 06:34:13,871][123091] Updated weights for policy 0, policy_version 874397 (0.0009) [2023-12-26 06:34:13,923][123091] Updated weights for policy 0, policy_version 874408 (0.0009) [2023-12-26 06:34:14,260][123090] Updated weights for policy 1, policy_version 868163 (0.0008) [2023-12-26 06:34:14,318][123090] Updated weights for policy 1, policy_version 868173 (0.0011) [2023-12-26 06:34:14,378][123090] Updated weights for policy 1, policy_version 868183 (0.0010) [2023-12-26 06:34:14,697][123091] Updated weights for policy 0, policy_version 874418 (0.0008) [2023-12-26 06:34:14,753][123091] Updated weights for policy 0, policy_version 874428 (0.0006) [2023-12-26 06:34:14,810][123091] Updated weights for policy 0, policy_version 874438 (0.0011) [2023-12-26 06:34:14,866][123091] Updated weights for policy 0, policy_version 874448 (0.0011) [2023-12-26 06:34:15,102][123090] Updated weights for policy 1, policy_version 868193 (0.0010) [2023-12-26 06:34:15,174][123090] Updated weights for policy 1, policy_version 868203 (0.0008) [2023-12-26 06:34:15,247][123090] Updated weights for policy 1, policy_version 868213 (0.0011) [2023-12-26 06:34:15,326][123090] Updated weights for policy 1, policy_version 868223 (0.0011) [2023-12-26 06:34:15,650][123091] Updated weights for policy 0, policy_version 874458 (0.0010) [2023-12-26 06:34:15,724][123091] Updated weights for policy 0, policy_version 874468 (0.0006) [2023-12-26 06:34:15,793][123091] Updated weights for policy 0, policy_version 874478 (0.0011) [2023-12-26 06:34:16,059][123090] Updated weights for policy 1, policy_version 868233 (0.0009) [2023-12-26 06:34:16,116][123090] Updated weights for policy 1, policy_version 868243 (0.0008) [2023-12-26 06:34:16,169][123090] Updated weights for policy 1, policy_version 868253 (0.0009) [2023-12-26 06:34:16,596][123091] Updated weights for policy 0, policy_version 874488 (0.0011) [2023-12-26 06:34:16,649][123091] Updated weights for policy 0, policy_version 874498 (0.0011) [2023-12-26 06:34:16,716][123091] Updated weights for policy 0, policy_version 874508 (0.0009) [2023-12-26 06:34:17,061][123090] Updated weights for policy 1, policy_version 868263 (0.0009) [2023-12-26 06:34:17,120][123090] Updated weights for policy 1, policy_version 868273 (0.0010) [2023-12-26 06:34:17,173][123090] Updated weights for policy 1, policy_version 868283 (0.0010) [2023-12-26 06:34:17,426][123091] Updated weights for policy 0, policy_version 874518 (0.0009) [2023-12-26 06:34:17,500][123091] Updated weights for policy 0, policy_version 874528 (0.0011) [2023-12-26 06:34:17,565][123091] Updated weights for policy 0, policy_version 874538 (0.0010) [2023-12-26 06:34:17,922][123090] Updated weights for policy 1, policy_version 868293 (0.0009) [2023-12-26 06:34:17,980][123090] Updated weights for policy 1, policy_version 868303 (0.0005) [2023-12-26 06:34:18,037][123090] Updated weights for policy 1, policy_version 868313 (0.0006) [2023-12-26 06:34:18,281][123091] Updated weights for policy 0, policy_version 874548 (0.0010) [2023-12-26 06:34:18,345][123091] Updated weights for policy 0, policy_version 874558 (0.0010) [2023-12-26 06:34:18,412][123091] Updated weights for policy 0, policy_version 874568 (0.0009) [2023-12-26 06:34:18,763][123090] Updated weights for policy 1, policy_version 868323 (0.0005) [2023-12-26 06:34:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 446185472. Throughput: 0: 8804.3, 1: 8676.1. Samples: 446199480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:34:18,785][121949] Avg episode reward: [(0, '6152.295'), (1, '5837.420')] [2023-12-26 06:34:18,829][123090] Updated weights for policy 1, policy_version 868333 (0.0008) [2023-12-26 06:34:18,896][123090] Updated weights for policy 1, policy_version 868343 (0.0011) [2023-12-26 06:34:19,283][123091] Updated weights for policy 0, policy_version 874578 (0.0009) [2023-12-26 06:34:19,352][123091] Updated weights for policy 0, policy_version 874588 (0.0009) [2023-12-26 06:34:19,410][123091] Updated weights for policy 0, policy_version 874598 (0.0009) [2023-12-26 06:34:19,475][123091] Updated weights for policy 0, policy_version 874608 (0.0009) [2023-12-26 06:34:19,679][123090] Updated weights for policy 1, policy_version 868353 (0.0010) [2023-12-26 06:34:19,753][123090] Updated weights for policy 1, policy_version 868363 (0.0011) [2023-12-26 06:34:19,824][123090] Updated weights for policy 1, policy_version 868373 (0.0011) [2023-12-26 06:34:19,892][123090] Updated weights for policy 1, policy_version 868383 (0.0011) [2023-12-26 06:34:20,274][123091] Updated weights for policy 0, policy_version 874618 (0.0009) [2023-12-26 06:34:20,334][123091] Updated weights for policy 0, policy_version 874628 (0.0009) [2023-12-26 06:34:20,399][123091] Updated weights for policy 0, policy_version 874638 (0.0006) [2023-12-26 06:34:20,716][123090] Updated weights for policy 1, policy_version 868393 (0.0010) [2023-12-26 06:34:20,776][123090] Updated weights for policy 1, policy_version 868403 (0.0010) [2023-12-26 06:34:20,846][123090] Updated weights for policy 1, policy_version 868413 (0.0009) [2023-12-26 06:34:21,154][123091] Updated weights for policy 0, policy_version 874648 (0.0007) [2023-12-26 06:34:21,220][123091] Updated weights for policy 0, policy_version 874658 (0.0006) [2023-12-26 06:34:21,289][123091] Updated weights for policy 0, policy_version 874668 (0.0006) [2023-12-26 06:34:21,696][123090] Updated weights for policy 1, policy_version 868423 (0.0010) [2023-12-26 06:34:21,767][123090] Updated weights for policy 1, policy_version 868433 (0.0009) [2023-12-26 06:34:21,828][123090] Updated weights for policy 1, policy_version 868443 (0.0010) [2023-12-26 06:34:22,046][123091] Updated weights for policy 0, policy_version 874678 (0.0010) [2023-12-26 06:34:22,110][123091] Updated weights for policy 0, policy_version 874688 (0.0011) [2023-12-26 06:34:22,184][123091] Updated weights for policy 0, policy_version 874698 (0.0006) [2023-12-26 06:34:22,707][123090] Updated weights for policy 1, policy_version 868453 (0.0009) [2023-12-26 06:34:22,775][123090] Updated weights for policy 1, policy_version 868463 (0.0011) [2023-12-26 06:34:22,850][123090] Updated weights for policy 1, policy_version 868473 (0.0011) [2023-12-26 06:34:22,877][123091] Updated weights for policy 0, policy_version 874708 (0.0009) [2023-12-26 06:34:22,944][123091] Updated weights for policy 0, policy_version 874718 (0.0008) [2023-12-26 06:34:23,006][123091] Updated weights for policy 0, policy_version 874728 (0.0009) [2023-12-26 06:34:23,618][123090] Updated weights for policy 1, policy_version 868483 (0.0009) [2023-12-26 06:34:23,671][123090] Updated weights for policy 1, policy_version 868493 (0.0005) [2023-12-26 06:34:23,724][123090] Updated weights for policy 1, policy_version 868503 (0.0005) [2023-12-26 06:34:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 446275584. Throughput: 0: 8821.7, 1: 8676.2. Samples: 446251668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 06:34:23,784][121949] Avg episode reward: [(0, '6085.589'), (1, '5775.396')] [2023-12-26 06:34:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000874736_223936512.pth... [2023-12-26 06:34:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000868512_222339072.pth... [2023-12-26 06:34:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000867488_222076928.pth [2023-12-26 06:34:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000873712_223674368.pth [2023-12-26 06:34:23,880][123091] Updated weights for policy 0, policy_version 874738 (0.0010) [2023-12-26 06:34:23,937][123091] Updated weights for policy 0, policy_version 874748 (0.0009) [2023-12-26 06:34:24,003][123091] Updated weights for policy 0, policy_version 874758 (0.0010) [2023-12-26 06:34:24,061][123091] Updated weights for policy 0, policy_version 874768 (0.0010) [2023-12-26 06:34:24,342][123090] Updated weights for policy 1, policy_version 868513 (0.0005) [2023-12-26 06:34:24,404][123090] Updated weights for policy 1, policy_version 868523 (0.0005) [2023-12-26 06:34:24,479][123090] Updated weights for policy 1, policy_version 868533 (0.0009) [2023-12-26 06:34:24,548][123090] Updated weights for policy 1, policy_version 868543 (0.0010) [2023-12-26 06:34:24,880][123091] Updated weights for policy 0, policy_version 874778 (0.0005) [2023-12-26 06:34:24,949][123091] Updated weights for policy 0, policy_version 874788 (0.0005) [2023-12-26 06:34:25,006][123091] Updated weights for policy 0, policy_version 874798 (0.0006) [2023-12-26 06:34:25,189][123090] Updated weights for policy 1, policy_version 868553 (0.0006) [2023-12-26 06:34:25,240][123090] Updated weights for policy 1, policy_version 868563 (0.0006) [2023-12-26 06:34:25,305][123090] Updated weights for policy 1, policy_version 868573 (0.0010) [2023-12-26 06:34:25,656][123091] Updated weights for policy 0, policy_version 874808 (0.0008) [2023-12-26 06:34:25,712][123091] Updated weights for policy 0, policy_version 874818 (0.0008) [2023-12-26 06:34:25,772][123091] Updated weights for policy 0, policy_version 874828 (0.0009) [2023-12-26 06:34:26,094][123090] Updated weights for policy 1, policy_version 868583 (0.0007) [2023-12-26 06:34:26,155][123090] Updated weights for policy 1, policy_version 868593 (0.0005) [2023-12-26 06:34:26,226][123090] Updated weights for policy 1, policy_version 868603 (0.0005) [2023-12-26 06:34:26,681][123091] Updated weights for policy 0, policy_version 874838 (0.0009) [2023-12-26 06:34:26,746][123091] Updated weights for policy 0, policy_version 874848 (0.0009) [2023-12-26 06:34:26,815][123091] Updated weights for policy 0, policy_version 874858 (0.0006) [2023-12-26 06:34:26,959][123090] Updated weights for policy 1, policy_version 868613 (0.0008) [2023-12-26 06:34:27,014][123090] Updated weights for policy 1, policy_version 868623 (0.0009) [2023-12-26 06:34:27,078][123090] Updated weights for policy 1, policy_version 868633 (0.0006) [2023-12-26 06:34:27,532][123091] Updated weights for policy 0, policy_version 874868 (0.0008) [2023-12-26 06:34:27,598][123091] Updated weights for policy 0, policy_version 874878 (0.0010) [2023-12-26 06:34:27,658][123091] Updated weights for policy 0, policy_version 874888 (0.0006) [2023-12-26 06:34:27,770][123090] Updated weights for policy 1, policy_version 868643 (0.0007) [2023-12-26 06:34:27,827][123090] Updated weights for policy 1, policy_version 868653 (0.0005) [2023-12-26 06:34:27,873][123090] Updated weights for policy 1, policy_version 868663 (0.0005) [2023-12-26 06:34:28,351][123091] Updated weights for policy 0, policy_version 874898 (0.0006) [2023-12-26 06:34:28,417][123091] Updated weights for policy 0, policy_version 874908 (0.0010) [2023-12-26 06:34:28,452][123090] Updated weights for policy 1, policy_version 868673 (0.0006) [2023-12-26 06:34:28,479][123091] Updated weights for policy 0, policy_version 874918 (0.0008) [2023-12-26 06:34:28,511][123090] Updated weights for policy 1, policy_version 868683 (0.0010) [2023-12-26 06:34:28,534][123091] Updated weights for policy 0, policy_version 874928 (0.0006) [2023-12-26 06:34:28,582][123090] Updated weights for policy 1, policy_version 868693 (0.0009) [2023-12-26 06:34:28,652][123090] Updated weights for policy 1, policy_version 868703 (0.0008) [2023-12-26 06:34:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 446373888. Throughput: 0: 8827.7, 1: 8822.5. Samples: 446361308. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:28,785][121949] Avg episode reward: [(0, '5978.044'), (1, '5816.664')] [2023-12-26 06:34:29,332][123091] Updated weights for policy 0, policy_version 874938 (0.0011) [2023-12-26 06:34:29,346][123090] Updated weights for policy 1, policy_version 868713 (0.0008) [2023-12-26 06:34:29,403][123091] Updated weights for policy 0, policy_version 874948 (0.0014) [2023-12-26 06:34:29,406][123090] Updated weights for policy 1, policy_version 868723 (0.0009) [2023-12-26 06:34:29,453][123090] Updated weights for policy 1, policy_version 868733 (0.0011) [2023-12-26 06:34:29,462][123091] Updated weights for policy 0, policy_version 874958 (0.0010) [2023-12-26 06:34:30,206][123090] Updated weights for policy 1, policy_version 868743 (0.0009) [2023-12-26 06:34:30,250][123091] Updated weights for policy 0, policy_version 874968 (0.0006) [2023-12-26 06:34:30,266][123090] Updated weights for policy 1, policy_version 868753 (0.0010) [2023-12-26 06:34:30,303][123091] Updated weights for policy 0, policy_version 874978 (0.0005) [2023-12-26 06:34:30,330][123090] Updated weights for policy 1, policy_version 868763 (0.0010) [2023-12-26 06:34:30,353][123091] Updated weights for policy 0, policy_version 874988 (0.0005) [2023-12-26 06:34:30,994][123091] Updated weights for policy 0, policy_version 874998 (0.0005) [2023-12-26 06:34:31,036][123090] Updated weights for policy 1, policy_version 868773 (0.0009) [2023-12-26 06:34:31,057][123091] Updated weights for policy 0, policy_version 875008 (0.0006) [2023-12-26 06:34:31,104][123090] Updated weights for policy 1, policy_version 868783 (0.0006) [2023-12-26 06:34:31,127][123091] Updated weights for policy 0, policy_version 875018 (0.0007) [2023-12-26 06:34:31,169][123090] Updated weights for policy 1, policy_version 868793 (0.0007) [2023-12-26 06:34:31,960][123091] Updated weights for policy 0, policy_version 875028 (0.0009) [2023-12-26 06:34:31,981][123090] Updated weights for policy 1, policy_version 868803 (0.0006) [2023-12-26 06:34:32,013][123091] Updated weights for policy 0, policy_version 875038 (0.0009) [2023-12-26 06:34:32,043][123090] Updated weights for policy 1, policy_version 868813 (0.0007) [2023-12-26 06:34:32,067][123091] Updated weights for policy 0, policy_version 875048 (0.0009) [2023-12-26 06:34:32,105][123090] Updated weights for policy 1, policy_version 868823 (0.0008) [2023-12-26 06:34:32,945][123091] Updated weights for policy 0, policy_version 875058 (0.0007) [2023-12-26 06:34:32,948][123090] Updated weights for policy 1, policy_version 868833 (0.0009) [2023-12-26 06:34:33,005][123090] Updated weights for policy 1, policy_version 868843 (0.0008) [2023-12-26 06:34:33,012][123091] Updated weights for policy 0, policy_version 875068 (0.0008) [2023-12-26 06:34:33,060][123090] Updated weights for policy 1, policy_version 868853 (0.0007) [2023-12-26 06:34:33,063][123091] Updated weights for policy 0, policy_version 875078 (0.0009) [2023-12-26 06:34:33,118][123090] Updated weights for policy 1, policy_version 868863 (0.0009) [2023-12-26 06:34:33,120][123091] Updated weights for policy 0, policy_version 875088 (0.0007) [2023-12-26 06:34:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 446455808. Throughput: 0: 8891.2, 1: 8900.0. Samples: 446472136. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:33,784][121949] Avg episode reward: [(0, '6121.823'), (1, '5829.454')] [2023-12-26 06:34:33,881][123090] Updated weights for policy 1, policy_version 868873 (0.0006) [2023-12-26 06:34:33,925][123091] Updated weights for policy 0, policy_version 875098 (0.0008) [2023-12-26 06:34:33,943][123090] Updated weights for policy 1, policy_version 868883 (0.0008) [2023-12-26 06:34:33,982][123091] Updated weights for policy 0, policy_version 875108 (0.0009) [2023-12-26 06:34:33,998][123090] Updated weights for policy 1, policy_version 868893 (0.0007) [2023-12-26 06:34:34,034][123091] Updated weights for policy 0, policy_version 875118 (0.0010) [2023-12-26 06:34:34,783][123090] Updated weights for policy 1, policy_version 868903 (0.0010) [2023-12-26 06:34:34,848][123090] Updated weights for policy 1, policy_version 868913 (0.0009) [2023-12-26 06:34:34,895][123091] Updated weights for policy 0, policy_version 875128 (0.0009) [2023-12-26 06:34:34,901][123090] Updated weights for policy 1, policy_version 868923 (0.0008) [2023-12-26 06:34:34,948][123091] Updated weights for policy 0, policy_version 875138 (0.0009) [2023-12-26 06:34:35,010][123091] Updated weights for policy 0, policy_version 875148 (0.0010) [2023-12-26 06:34:35,743][123090] Updated weights for policy 1, policy_version 868933 (0.0009) [2023-12-26 06:34:35,805][123090] Updated weights for policy 1, policy_version 868943 (0.0009) [2023-12-26 06:34:35,844][123091] Updated weights for policy 0, policy_version 875158 (0.0009) [2023-12-26 06:34:35,863][123090] Updated weights for policy 1, policy_version 868953 (0.0008) [2023-12-26 06:34:35,900][123091] Updated weights for policy 0, policy_version 875168 (0.0009) [2023-12-26 06:34:35,952][123091] Updated weights for policy 0, policy_version 875178 (0.0010) [2023-12-26 06:34:36,696][123090] Updated weights for policy 1, policy_version 868963 (0.0008) [2023-12-26 06:34:36,754][123090] Updated weights for policy 1, policy_version 868973 (0.0009) [2023-12-26 06:34:36,790][123091] Updated weights for policy 0, policy_version 875188 (0.0008) [2023-12-26 06:34:36,815][123090] Updated weights for policy 1, policy_version 868983 (0.0008) [2023-12-26 06:34:36,854][123091] Updated weights for policy 0, policy_version 875198 (0.0006) [2023-12-26 06:34:36,906][123091] Updated weights for policy 0, policy_version 875208 (0.0008) [2023-12-26 06:34:37,576][123090] Updated weights for policy 1, policy_version 868993 (0.0009) [2023-12-26 06:34:37,637][123090] Updated weights for policy 1, policy_version 869003 (0.0009) [2023-12-26 06:34:37,652][123091] Updated weights for policy 0, policy_version 875218 (0.0008) [2023-12-26 06:34:37,701][123090] Updated weights for policy 1, policy_version 869013 (0.0009) [2023-12-26 06:34:37,721][123091] Updated weights for policy 0, policy_version 875228 (0.0007) [2023-12-26 06:34:37,760][123090] Updated weights for policy 1, policy_version 869023 (0.0008) [2023-12-26 06:34:37,787][123091] Updated weights for policy 0, policy_version 875238 (0.0008) [2023-12-26 06:34:37,852][123091] Updated weights for policy 0, policy_version 875248 (0.0006) [2023-12-26 06:34:38,527][123091] Updated weights for policy 0, policy_version 875258 (0.0005) [2023-12-26 06:34:38,597][123091] Updated weights for policy 0, policy_version 875268 (0.0006) [2023-12-26 06:34:38,654][123090] Updated weights for policy 1, policy_version 869033 (0.0008) [2023-12-26 06:34:38,666][123091] Updated weights for policy 0, policy_version 875278 (0.0006) [2023-12-26 06:34:38,713][123090] Updated weights for policy 1, policy_version 869043 (0.0009) [2023-12-26 06:34:38,764][123090] Updated weights for policy 1, policy_version 869053 (0.0009) [2023-12-26 06:34:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 446554112. Throughput: 0: 8889.1, 1: 8929.5. Samples: 446523800. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:38,785][121949] Avg episode reward: [(0, '6210.582'), (1, '5831.197')] [2023-12-26 06:34:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000875280_224075776.pth... [2023-12-26 06:34:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000869056_222478336.pth... [2023-12-26 06:34:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000868000_222208000.pth [2023-12-26 06:34:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000874224_223805440.pth [2023-12-26 06:34:39,371][123091] Updated weights for policy 0, policy_version 875288 (0.0009) [2023-12-26 06:34:39,434][123091] Updated weights for policy 0, policy_version 875298 (0.0010) [2023-12-26 06:34:39,499][123091] Updated weights for policy 0, policy_version 875308 (0.0010) [2023-12-26 06:34:39,636][123090] Updated weights for policy 1, policy_version 869063 (0.0009) [2023-12-26 06:34:39,701][123090] Updated weights for policy 1, policy_version 869073 (0.0009) [2023-12-26 06:34:39,766][123090] Updated weights for policy 1, policy_version 869083 (0.0009) [2023-12-26 06:34:40,343][123091] Updated weights for policy 0, policy_version 875318 (0.0010) [2023-12-26 06:34:40,415][123091] Updated weights for policy 0, policy_version 875328 (0.0009) [2023-12-26 06:34:40,481][123091] Updated weights for policy 0, policy_version 875338 (0.0010) [2023-12-26 06:34:40,604][123090] Updated weights for policy 1, policy_version 869093 (0.0009) [2023-12-26 06:34:40,670][123090] Updated weights for policy 1, policy_version 869103 (0.0010) [2023-12-26 06:34:40,747][123090] Updated weights for policy 1, policy_version 869113 (0.0010) [2023-12-26 06:34:41,316][123091] Updated weights for policy 0, policy_version 875348 (0.0010) [2023-12-26 06:34:41,372][123091] Updated weights for policy 0, policy_version 875358 (0.0009) [2023-12-26 06:34:41,446][123091] Updated weights for policy 0, policy_version 875368 (0.0010) [2023-12-26 06:34:41,609][123090] Updated weights for policy 1, policy_version 869123 (0.0009) [2023-12-26 06:34:41,682][123090] Updated weights for policy 1, policy_version 869133 (0.0007) [2023-12-26 06:34:41,760][123090] Updated weights for policy 1, policy_version 869143 (0.0007) [2023-12-26 06:34:42,295][123091] Updated weights for policy 0, policy_version 875378 (0.0007) [2023-12-26 06:34:42,363][123091] Updated weights for policy 0, policy_version 875388 (0.0007) [2023-12-26 06:34:42,428][123091] Updated weights for policy 0, policy_version 875398 (0.0010) [2023-12-26 06:34:42,498][123091] Updated weights for policy 0, policy_version 875408 (0.0010) [2023-12-26 06:34:42,571][123090] Updated weights for policy 1, policy_version 869153 (0.0006) [2023-12-26 06:34:42,635][123090] Updated weights for policy 1, policy_version 869163 (0.0010) [2023-12-26 06:34:42,698][123090] Updated weights for policy 1, policy_version 869173 (0.0010) [2023-12-26 06:34:42,759][123090] Updated weights for policy 1, policy_version 869183 (0.0007) [2023-12-26 06:34:43,276][123091] Updated weights for policy 0, policy_version 875418 (0.0010) [2023-12-26 06:34:43,337][123091] Updated weights for policy 0, policy_version 875428 (0.0010) [2023-12-26 06:34:43,392][123091] Updated weights for policy 0, policy_version 875438 (0.0010) [2023-12-26 06:34:43,606][123090] Updated weights for policy 1, policy_version 869193 (0.0008) [2023-12-26 06:34:43,659][123090] Updated weights for policy 1, policy_version 869203 (0.0009) [2023-12-26 06:34:43,715][123090] Updated weights for policy 1, policy_version 869213 (0.0009) [2023-12-26 06:34:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 446636032. Throughput: 0: 8885.8, 1: 8862.5. Samples: 446626488. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:43,784][121949] Avg episode reward: [(0, '6175.725'), (1, '5883.788')] [2023-12-26 06:34:44,097][123091] Updated weights for policy 0, policy_version 875448 (0.0006) [2023-12-26 06:34:44,157][123091] Updated weights for policy 0, policy_version 875458 (0.0005) [2023-12-26 06:34:44,216][123091] Updated weights for policy 0, policy_version 875468 (0.0005) [2023-12-26 06:34:44,640][123090] Updated weights for policy 1, policy_version 869223 (0.0010) [2023-12-26 06:34:44,696][123090] Updated weights for policy 1, policy_version 869233 (0.0009) [2023-12-26 06:34:44,754][123090] Updated weights for policy 1, policy_version 869243 (0.0009) [2023-12-26 06:34:44,881][123091] Updated weights for policy 0, policy_version 875478 (0.0007) [2023-12-26 06:34:44,946][123091] Updated weights for policy 0, policy_version 875488 (0.0008) [2023-12-26 06:34:45,006][123091] Updated weights for policy 0, policy_version 875498 (0.0011) [2023-12-26 06:34:45,583][123090] Updated weights for policy 1, policy_version 869253 (0.0007) [2023-12-26 06:34:45,651][123090] Updated weights for policy 1, policy_version 869263 (0.0005) [2023-12-26 06:34:45,699][123090] Updated weights for policy 1, policy_version 869273 (0.0005) [2023-12-26 06:34:45,710][123091] Updated weights for policy 0, policy_version 875508 (0.0007) [2023-12-26 06:34:45,781][123091] Updated weights for policy 0, policy_version 875518 (0.0006) [2023-12-26 06:34:45,830][123091] Updated weights for policy 0, policy_version 875528 (0.0005) [2023-12-26 06:34:46,333][123090] Updated weights for policy 1, policy_version 869283 (0.0006) [2023-12-26 06:34:46,389][123090] Updated weights for policy 1, policy_version 869293 (0.0005) [2023-12-26 06:34:46,451][123090] Updated weights for policy 1, policy_version 869303 (0.0005) [2023-12-26 06:34:46,552][123091] Updated weights for policy 0, policy_version 875538 (0.0005) [2023-12-26 06:34:46,625][123091] Updated weights for policy 0, policy_version 875548 (0.0006) [2023-12-26 06:34:46,705][123091] Updated weights for policy 0, policy_version 875558 (0.0006) [2023-12-26 06:34:46,767][123091] Updated weights for policy 0, policy_version 875568 (0.0006) [2023-12-26 06:34:47,236][123090] Updated weights for policy 1, policy_version 869313 (0.0009) [2023-12-26 06:34:47,309][123090] Updated weights for policy 1, policy_version 869323 (0.0006) [2023-12-26 06:34:47,376][123090] Updated weights for policy 1, policy_version 869333 (0.0005) [2023-12-26 06:34:47,381][123091] Updated weights for policy 0, policy_version 875578 (0.0011) [2023-12-26 06:34:47,442][123090] Updated weights for policy 1, policy_version 869343 (0.0005) [2023-12-26 06:34:47,444][123091] Updated weights for policy 0, policy_version 875588 (0.0011) [2023-12-26 06:34:47,499][123091] Updated weights for policy 0, policy_version 875598 (0.0010) [2023-12-26 06:34:48,129][123090] Updated weights for policy 1, policy_version 869353 (0.0006) [2023-12-26 06:34:48,199][123090] Updated weights for policy 1, policy_version 869363 (0.0008) [2023-12-26 06:34:48,252][123090] Updated weights for policy 1, policy_version 869373 (0.0009) [2023-12-26 06:34:48,327][123091] Updated weights for policy 0, policy_version 875608 (0.0007) [2023-12-26 06:34:48,388][123091] Updated weights for policy 0, policy_version 875618 (0.0010) [2023-12-26 06:34:48,452][123091] Updated weights for policy 0, policy_version 875628 (0.0011) [2023-12-26 06:34:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 446726144. Throughput: 0: 8921.7, 1: 8855.4. Samples: 446736748. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:48,785][121949] Avg episode reward: [(0, '6259.565'), (1, '5938.564')] [2023-12-26 06:34:49,096][123090] Updated weights for policy 1, policy_version 869383 (0.0007) [2023-12-26 06:34:49,168][123090] Updated weights for policy 1, policy_version 869393 (0.0007) [2023-12-26 06:34:49,197][123091] Updated weights for policy 0, policy_version 875638 (0.0010) [2023-12-26 06:34:49,232][123090] Updated weights for policy 1, policy_version 869403 (0.0011) [2023-12-26 06:34:49,262][123091] Updated weights for policy 0, policy_version 875648 (0.0011) [2023-12-26 06:34:49,333][123091] Updated weights for policy 0, policy_version 875658 (0.0011) [2023-12-26 06:34:50,018][123090] Updated weights for policy 1, policy_version 869413 (0.0010) [2023-12-26 06:34:50,070][123091] Updated weights for policy 0, policy_version 875668 (0.0010) [2023-12-26 06:34:50,086][123090] Updated weights for policy 1, policy_version 869423 (0.0011) [2023-12-26 06:34:50,128][123091] Updated weights for policy 0, policy_version 875678 (0.0006) [2023-12-26 06:34:50,144][123090] Updated weights for policy 1, policy_version 869433 (0.0008) [2023-12-26 06:34:50,197][123091] Updated weights for policy 0, policy_version 875688 (0.0007) [2023-12-26 06:34:50,918][123091] Updated weights for policy 0, policy_version 875698 (0.0008) [2023-12-26 06:34:50,947][123090] Updated weights for policy 1, policy_version 869443 (0.0011) [2023-12-26 06:34:50,986][123091] Updated weights for policy 0, policy_version 875708 (0.0008) [2023-12-26 06:34:51,012][123090] Updated weights for policy 1, policy_version 869453 (0.0011) [2023-12-26 06:34:51,052][123091] Updated weights for policy 0, policy_version 875718 (0.0008) [2023-12-26 06:34:51,081][123090] Updated weights for policy 1, policy_version 869463 (0.0008) [2023-12-26 06:34:51,116][123091] Updated weights for policy 0, policy_version 875728 (0.0008) [2023-12-26 06:34:51,895][123090] Updated weights for policy 1, policy_version 869473 (0.0008) [2023-12-26 06:34:51,899][123091] Updated weights for policy 0, policy_version 875738 (0.0009) [2023-12-26 06:34:51,947][123090] Updated weights for policy 1, policy_version 869483 (0.0008) [2023-12-26 06:34:51,957][123091] Updated weights for policy 0, policy_version 875748 (0.0006) [2023-12-26 06:34:51,999][123090] Updated weights for policy 1, policy_version 869493 (0.0008) [2023-12-26 06:34:52,010][123091] Updated weights for policy 0, policy_version 875758 (0.0006) [2023-12-26 06:34:52,058][123090] Updated weights for policy 1, policy_version 869503 (0.0008) [2023-12-26 06:34:52,833][123091] Updated weights for policy 0, policy_version 875768 (0.0008) [2023-12-26 06:34:52,849][123090] Updated weights for policy 1, policy_version 869513 (0.0006) [2023-12-26 06:34:52,894][123091] Updated weights for policy 0, policy_version 875778 (0.0008) [2023-12-26 06:34:52,903][123090] Updated weights for policy 1, policy_version 869523 (0.0007) [2023-12-26 06:34:52,959][123091] Updated weights for policy 0, policy_version 875788 (0.0009) [2023-12-26 06:34:52,961][123090] Updated weights for policy 1, policy_version 869533 (0.0008) [2023-12-26 06:34:53,745][123090] Updated weights for policy 1, policy_version 869543 (0.0009) [2023-12-26 06:34:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 446808064. Throughput: 0: 8963.8, 1: 8857.6. Samples: 446790908. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:53,785][121949] Avg episode reward: [(0, '6340.598'), (1, '5920.089')] [2023-12-26 06:34:53,793][123090] Updated weights for policy 1, policy_version 869553 (0.0009) [2023-12-26 06:34:53,814][123091] Updated weights for policy 0, policy_version 875798 (0.0007) [2023-12-26 06:34:53,842][123090] Updated weights for policy 1, policy_version 869563 (0.0007) [2023-12-26 06:34:53,871][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000869568_222609408.pth... [2023-12-26 06:34:53,873][123091] Updated weights for policy 0, policy_version 875808 (0.0010) [2023-12-26 06:34:53,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000868512_222339072.pth [2023-12-26 06:34:53,931][123091] Updated weights for policy 0, policy_version 875818 (0.0009) [2023-12-26 06:34:53,968][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000875824_224215040.pth... [2023-12-26 06:34:53,973][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000874736_223936512.pth [2023-12-26 06:34:54,647][123090] Updated weights for policy 1, policy_version 869573 (0.0010) [2023-12-26 06:34:54,702][123090] Updated weights for policy 1, policy_version 869583 (0.0010) [2023-12-26 06:34:54,758][123090] Updated weights for policy 1, policy_version 869593 (0.0010) [2023-12-26 06:34:54,806][123091] Updated weights for policy 0, policy_version 875828 (0.0009) [2023-12-26 06:34:54,854][123091] Updated weights for policy 0, policy_version 875838 (0.0008) [2023-12-26 06:34:54,905][123091] Updated weights for policy 0, policy_version 875848 (0.0009) [2023-12-26 06:34:55,555][123090] Updated weights for policy 1, policy_version 869603 (0.0009) [2023-12-26 06:34:55,626][123090] Updated weights for policy 1, policy_version 869613 (0.0007) [2023-12-26 06:34:55,691][123090] Updated weights for policy 1, policy_version 869623 (0.0008) [2023-12-26 06:34:55,794][123091] Updated weights for policy 0, policy_version 875858 (0.0010) [2023-12-26 06:34:55,844][123091] Updated weights for policy 0, policy_version 875868 (0.0009) [2023-12-26 06:34:55,895][123091] Updated weights for policy 0, policy_version 875878 (0.0010) [2023-12-26 06:34:55,956][123091] Updated weights for policy 0, policy_version 875888 (0.0009) [2023-12-26 06:34:56,358][123090] Updated weights for policy 1, policy_version 869633 (0.0008) [2023-12-26 06:34:56,433][123090] Updated weights for policy 1, policy_version 869643 (0.0007) [2023-12-26 06:34:56,504][123090] Updated weights for policy 1, policy_version 869653 (0.0007) [2023-12-26 06:34:56,576][123090] Updated weights for policy 1, policy_version 869663 (0.0005) [2023-12-26 06:34:56,868][123091] Updated weights for policy 0, policy_version 875898 (0.0009) [2023-12-26 06:34:56,933][123091] Updated weights for policy 0, policy_version 875908 (0.0010) [2023-12-26 06:34:56,995][123091] Updated weights for policy 0, policy_version 875918 (0.0009) [2023-12-26 06:34:57,088][123090] Updated weights for policy 1, policy_version 869673 (0.0005) [2023-12-26 06:34:57,147][123090] Updated weights for policy 1, policy_version 869683 (0.0005) [2023-12-26 06:34:57,206][123090] Updated weights for policy 1, policy_version 869693 (0.0005) [2023-12-26 06:34:57,859][123091] Updated weights for policy 0, policy_version 875928 (0.0009) [2023-12-26 06:34:57,863][123090] Updated weights for policy 1, policy_version 869703 (0.0007) [2023-12-26 06:34:57,925][123090] Updated weights for policy 1, policy_version 869713 (0.0006) [2023-12-26 06:34:57,928][123091] Updated weights for policy 0, policy_version 875938 (0.0010) [2023-12-26 06:34:57,983][123090] Updated weights for policy 1, policy_version 869723 (0.0007) [2023-12-26 06:34:57,994][123091] Updated weights for policy 0, policy_version 875948 (0.0009) [2023-12-26 06:34:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 446898176. Throughput: 0: 8944.8, 1: 9008.1. Samples: 446897636. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:34:58,785][121949] Avg episode reward: [(0, '6292.263'), (1, '5962.102')] [2023-12-26 06:34:58,853][123090] Updated weights for policy 1, policy_version 869733 (0.0008) [2023-12-26 06:34:58,930][123090] Updated weights for policy 1, policy_version 869743 (0.0008) [2023-12-26 06:34:58,932][123091] Updated weights for policy 0, policy_version 875958 (0.0008) [2023-12-26 06:34:58,994][123090] Updated weights for policy 1, policy_version 869753 (0.0007) [2023-12-26 06:34:59,002][123091] Updated weights for policy 0, policy_version 875968 (0.0007) [2023-12-26 06:34:59,074][123091] Updated weights for policy 0, policy_version 875978 (0.0008) [2023-12-26 06:34:59,864][123091] Updated weights for policy 0, policy_version 875988 (0.0008) [2023-12-26 06:34:59,875][123090] Updated weights for policy 1, policy_version 869763 (0.0007) [2023-12-26 06:34:59,917][123091] Updated weights for policy 0, policy_version 875998 (0.0006) [2023-12-26 06:34:59,942][123090] Updated weights for policy 1, policy_version 869773 (0.0009) [2023-12-26 06:34:59,984][123091] Updated weights for policy 0, policy_version 876008 (0.0008) [2023-12-26 06:35:00,008][123090] Updated weights for policy 1, policy_version 869783 (0.0008) [2023-12-26 06:35:00,692][123091] Updated weights for policy 0, policy_version 876018 (0.0007) [2023-12-26 06:35:00,761][123091] Updated weights for policy 0, policy_version 876028 (0.0006) [2023-12-26 06:35:00,813][123090] Updated weights for policy 1, policy_version 869793 (0.0006) [2023-12-26 06:35:00,826][123091] Updated weights for policy 0, policy_version 876038 (0.0006) [2023-12-26 06:35:00,880][123090] Updated weights for policy 1, policy_version 869803 (0.0008) [2023-12-26 06:35:00,893][123091] Updated weights for policy 0, policy_version 876048 (0.0006) [2023-12-26 06:35:00,933][123090] Updated weights for policy 1, policy_version 869813 (0.0009) [2023-12-26 06:35:00,986][123090] Updated weights for policy 1, policy_version 869823 (0.0009) [2023-12-26 06:35:01,687][123091] Updated weights for policy 0, policy_version 876058 (0.0008) [2023-12-26 06:35:01,751][123091] Updated weights for policy 0, policy_version 876068 (0.0009) [2023-12-26 06:35:01,789][123090] Updated weights for policy 1, policy_version 869833 (0.0008) [2023-12-26 06:35:01,805][123091] Updated weights for policy 0, policy_version 876078 (0.0008) [2023-12-26 06:35:01,845][123090] Updated weights for policy 1, policy_version 869843 (0.0009) [2023-12-26 06:35:01,901][123090] Updated weights for policy 1, policy_version 869853 (0.0009) [2023-12-26 06:35:02,638][123091] Updated weights for policy 0, policy_version 876089 (0.0010) [2023-12-26 06:35:02,689][123091] Updated weights for policy 0, policy_version 876099 (0.0008) [2023-12-26 06:35:02,722][123090] Updated weights for policy 1, policy_version 869863 (0.0009) [2023-12-26 06:35:02,746][123091] Updated weights for policy 0, policy_version 876109 (0.0007) [2023-12-26 06:35:02,780][123090] Updated weights for policy 1, policy_version 869873 (0.0009) [2023-12-26 06:35:02,828][123090] Updated weights for policy 1, policy_version 869883 (0.0009) [2023-12-26 06:35:03,577][123091] Updated weights for policy 0, policy_version 876119 (0.0008) [2023-12-26 06:35:03,640][123091] Updated weights for policy 0, policy_version 876129 (0.0008) [2023-12-26 06:35:03,677][123090] Updated weights for policy 1, policy_version 869893 (0.0009) [2023-12-26 06:35:03,700][123091] Updated weights for policy 0, policy_version 876139 (0.0006) [2023-12-26 06:35:03,735][123090] Updated weights for policy 1, policy_version 869903 (0.0010) [2023-12-26 06:35:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 446988288. Throughput: 0: 8870.8, 1: 8928.0. Samples: 447000428. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:03,785][121949] Avg episode reward: [(0, '6310.460'), (1, '5968.278')] [2023-12-26 06:35:03,788][123090] Updated weights for policy 1, policy_version 869913 (0.0009) [2023-12-26 06:35:04,550][123091] Updated weights for policy 0, policy_version 876149 (0.0008) [2023-12-26 06:35:04,606][123091] Updated weights for policy 0, policy_version 876159 (0.0010) [2023-12-26 06:35:04,641][123090] Updated weights for policy 1, policy_version 869923 (0.0007) [2023-12-26 06:35:04,665][123091] Updated weights for policy 0, policy_version 876169 (0.0010) [2023-12-26 06:35:04,700][123090] Updated weights for policy 1, policy_version 869933 (0.0010) [2023-12-26 06:35:04,767][123090] Updated weights for policy 1, policy_version 869943 (0.0010) [2023-12-26 06:35:05,450][123091] Updated weights for policy 0, policy_version 876179 (0.0009) [2023-12-26 06:35:05,503][123091] Updated weights for policy 0, policy_version 876189 (0.0005) [2023-12-26 06:35:05,562][123091] Updated weights for policy 0, policy_version 876199 (0.0008) [2023-12-26 06:35:05,589][123090] Updated weights for policy 1, policy_version 869953 (0.0010) [2023-12-26 06:35:05,651][123090] Updated weights for policy 1, policy_version 869963 (0.0010) [2023-12-26 06:35:05,713][123090] Updated weights for policy 1, policy_version 869973 (0.0010) [2023-12-26 06:35:05,775][123090] Updated weights for policy 1, policy_version 869983 (0.0010) [2023-12-26 06:35:06,309][123091] Updated weights for policy 0, policy_version 876209 (0.0006) [2023-12-26 06:35:06,362][123091] Updated weights for policy 0, policy_version 876219 (0.0009) [2023-12-26 06:35:06,422][123091] Updated weights for policy 0, policy_version 876229 (0.0008) [2023-12-26 06:35:06,481][123091] Updated weights for policy 0, policy_version 876239 (0.0008) [2023-12-26 06:35:06,600][123090] Updated weights for policy 1, policy_version 869993 (0.0011) [2023-12-26 06:35:06,666][123090] Updated weights for policy 1, policy_version 870003 (0.0011) [2023-12-26 06:35:06,737][123090] Updated weights for policy 1, policy_version 870013 (0.0009) [2023-12-26 06:35:07,354][123091] Updated weights for policy 0, policy_version 876249 (0.0008) [2023-12-26 06:35:07,426][123091] Updated weights for policy 0, policy_version 876259 (0.0009) [2023-12-26 06:35:07,474][123091] Updated weights for policy 0, policy_version 876269 (0.0009) [2023-12-26 06:35:07,578][123090] Updated weights for policy 1, policy_version 870023 (0.0010) [2023-12-26 06:35:07,640][123090] Updated weights for policy 1, policy_version 870033 (0.0010) [2023-12-26 06:35:07,698][123090] Updated weights for policy 1, policy_version 870043 (0.0010) [2023-12-26 06:35:08,280][123091] Updated weights for policy 0, policy_version 876279 (0.0006) [2023-12-26 06:35:08,355][123091] Updated weights for policy 0, policy_version 876289 (0.0008) [2023-12-26 06:35:08,421][123091] Updated weights for policy 0, policy_version 876299 (0.0009) [2023-12-26 06:35:08,453][123090] Updated weights for policy 1, policy_version 870053 (0.0010) [2023-12-26 06:35:08,501][123090] Updated weights for policy 1, policy_version 870063 (0.0010) [2023-12-26 06:35:08,550][123090] Updated weights for policy 1, policy_version 870073 (0.0010) [2023-12-26 06:35:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 447078400. Throughput: 0: 8861.8, 1: 8927.3. Samples: 447052176. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:08,785][121949] Avg episode reward: [(0, '6323.546'), (1, '5887.806')] [2023-12-26 06:35:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000876304_224337920.pth... [2023-12-26 06:35:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000870080_222740480.pth... [2023-12-26 06:35:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000875280_224075776.pth [2023-12-26 06:35:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000869056_222478336.pth [2023-12-26 06:35:09,168][123091] Updated weights for policy 0, policy_version 876309 (0.0006) [2023-12-26 06:35:09,243][123091] Updated weights for policy 0, policy_version 876319 (0.0007) [2023-12-26 06:35:09,308][123091] Updated weights for policy 0, policy_version 876329 (0.0007) [2023-12-26 06:35:09,444][123090] Updated weights for policy 1, policy_version 870083 (0.0009) [2023-12-26 06:35:09,518][123090] Updated weights for policy 1, policy_version 870093 (0.0009) [2023-12-26 06:35:09,571][123090] Updated weights for policy 1, policy_version 870103 (0.0010) [2023-12-26 06:35:10,042][123091] Updated weights for policy 0, policy_version 876339 (0.0008) [2023-12-26 06:35:10,114][123091] Updated weights for policy 0, policy_version 876349 (0.0009) [2023-12-26 06:35:10,187][123091] Updated weights for policy 0, policy_version 876359 (0.0006) [2023-12-26 06:35:10,416][123090] Updated weights for policy 1, policy_version 870113 (0.0009) [2023-12-26 06:35:10,481][123090] Updated weights for policy 1, policy_version 870123 (0.0009) [2023-12-26 06:35:10,526][123090] Updated weights for policy 1, policy_version 870133 (0.0010) [2023-12-26 06:35:10,589][123090] Updated weights for policy 1, policy_version 870143 (0.0010) [2023-12-26 06:35:10,879][123091] Updated weights for policy 0, policy_version 876369 (0.0006) [2023-12-26 06:35:10,936][123091] Updated weights for policy 0, policy_version 876379 (0.0006) [2023-12-26 06:35:10,984][123091] Updated weights for policy 0, policy_version 876389 (0.0006) [2023-12-26 06:35:11,053][123091] Updated weights for policy 0, policy_version 876399 (0.0007) [2023-12-26 06:35:11,475][123090] Updated weights for policy 1, policy_version 870153 (0.0009) [2023-12-26 06:35:11,536][123090] Updated weights for policy 1, policy_version 870163 (0.0010) [2023-12-26 06:35:11,592][123090] Updated weights for policy 1, policy_version 870173 (0.0010) [2023-12-26 06:35:11,835][123091] Updated weights for policy 0, policy_version 876409 (0.0011) [2023-12-26 06:35:11,900][123091] Updated weights for policy 0, policy_version 876419 (0.0011) [2023-12-26 06:35:11,971][123091] Updated weights for policy 0, policy_version 876429 (0.0011) [2023-12-26 06:35:12,466][123090] Updated weights for policy 1, policy_version 870183 (0.0009) [2023-12-26 06:35:12,532][123090] Updated weights for policy 1, policy_version 870193 (0.0008) [2023-12-26 06:35:12,596][123090] Updated weights for policy 1, policy_version 870203 (0.0010) [2023-12-26 06:35:12,759][123091] Updated weights for policy 0, policy_version 876439 (0.0007) [2023-12-26 06:35:12,816][123091] Updated weights for policy 0, policy_version 876449 (0.0011) [2023-12-26 06:35:12,868][123091] Updated weights for policy 0, policy_version 876459 (0.0010) [2023-12-26 06:35:13,448][123090] Updated weights for policy 1, policy_version 870213 (0.0010) [2023-12-26 06:35:13,495][123090] Updated weights for policy 1, policy_version 870223 (0.0009) [2023-12-26 06:35:13,559][123090] Updated weights for policy 1, policy_version 870233 (0.0009) [2023-12-26 06:35:13,639][123091] Updated weights for policy 0, policy_version 876469 (0.0011) [2023-12-26 06:35:13,704][123091] Updated weights for policy 0, policy_version 876479 (0.0010) [2023-12-26 06:35:13,762][123091] Updated weights for policy 0, policy_version 876489 (0.0008) [2023-12-26 06:35:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 447160320. Throughput: 0: 8878.3, 1: 8778.3. Samples: 447155848. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:13,784][121949] Avg episode reward: [(0, '6340.242'), (1, '5863.344')] [2023-12-26 06:35:14,312][123090] Updated weights for policy 1, policy_version 870243 (0.0008) [2023-12-26 06:35:14,365][123090] Updated weights for policy 1, policy_version 870253 (0.0005) [2023-12-26 06:35:14,415][123090] Updated weights for policy 1, policy_version 870263 (0.0005) [2023-12-26 06:35:14,452][123091] Updated weights for policy 0, policy_version 876499 (0.0007) [2023-12-26 06:35:14,510][123091] Updated weights for policy 0, policy_version 876509 (0.0010) [2023-12-26 06:35:14,572][123091] Updated weights for policy 0, policy_version 876519 (0.0010) [2023-12-26 06:35:15,189][123090] Updated weights for policy 1, policy_version 870273 (0.0008) [2023-12-26 06:35:15,242][123090] Updated weights for policy 1, policy_version 870283 (0.0011) [2023-12-26 06:35:15,306][123090] Updated weights for policy 1, policy_version 870293 (0.0011) [2023-12-26 06:35:15,359][123091] Updated weights for policy 0, policy_version 876529 (0.0011) [2023-12-26 06:35:15,370][123090] Updated weights for policy 1, policy_version 870303 (0.0011) [2023-12-26 06:35:15,427][123091] Updated weights for policy 0, policy_version 876539 (0.0011) [2023-12-26 06:35:15,494][123091] Updated weights for policy 0, policy_version 876549 (0.0011) [2023-12-26 06:35:15,555][123091] Updated weights for policy 0, policy_version 876559 (0.0011) [2023-12-26 06:35:16,223][123090] Updated weights for policy 1, policy_version 870313 (0.0011) [2023-12-26 06:35:16,282][123090] Updated weights for policy 1, policy_version 870323 (0.0010) [2023-12-26 06:35:16,319][123091] Updated weights for policy 0, policy_version 876569 (0.0011) [2023-12-26 06:35:16,330][123090] Updated weights for policy 1, policy_version 870333 (0.0010) [2023-12-26 06:35:16,377][123091] Updated weights for policy 0, policy_version 876579 (0.0010) [2023-12-26 06:35:16,420][123091] Updated weights for policy 0, policy_version 876589 (0.0010) [2023-12-26 06:35:17,041][123090] Updated weights for policy 1, policy_version 870343 (0.0007) [2023-12-26 06:35:17,114][123090] Updated weights for policy 1, policy_version 870353 (0.0005) [2023-12-26 06:35:17,191][123090] Updated weights for policy 1, policy_version 870363 (0.0007) [2023-12-26 06:35:17,255][123091] Updated weights for policy 0, policy_version 876599 (0.0007) [2023-12-26 06:35:17,314][123091] Updated weights for policy 0, policy_version 876609 (0.0006) [2023-12-26 06:35:17,371][123091] Updated weights for policy 0, policy_version 876619 (0.0005) [2023-12-26 06:35:17,930][123090] Updated weights for policy 1, policy_version 870373 (0.0009) [2023-12-26 06:35:17,987][123090] Updated weights for policy 1, policy_version 870383 (0.0009) [2023-12-26 06:35:18,042][123090] Updated weights for policy 1, policy_version 870393 (0.0009) [2023-12-26 06:35:18,156][123091] Updated weights for policy 0, policy_version 876629 (0.0006) [2023-12-26 06:35:18,206][123091] Updated weights for policy 0, policy_version 876639 (0.0006) [2023-12-26 06:35:18,249][123091] Updated weights for policy 0, policy_version 876649 (0.0006) [2023-12-26 06:35:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 447250432. Throughput: 0: 8886.7, 1: 8747.6. Samples: 447265684. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:18,785][121949] Avg episode reward: [(0, '6194.797'), (1, '5956.319')] [2023-12-26 06:35:18,791][123090] Updated weights for policy 1, policy_version 870403 (0.0009) [2023-12-26 06:35:18,856][123090] Updated weights for policy 1, policy_version 870413 (0.0009) [2023-12-26 06:35:18,917][123090] Updated weights for policy 1, policy_version 870423 (0.0009) [2023-12-26 06:35:19,038][123091] Updated weights for policy 0, policy_version 876659 (0.0007) [2023-12-26 06:35:19,100][123091] Updated weights for policy 0, policy_version 876669 (0.0011) [2023-12-26 06:35:19,163][123091] Updated weights for policy 0, policy_version 876679 (0.0011) [2023-12-26 06:35:19,767][123090] Updated weights for policy 1, policy_version 870433 (0.0008) [2023-12-26 06:35:19,828][123090] Updated weights for policy 1, policy_version 870443 (0.0009) [2023-12-26 06:35:19,893][123090] Updated weights for policy 1, policy_version 870453 (0.0006) [2023-12-26 06:35:19,966][123090] Updated weights for policy 1, policy_version 870463 (0.0008) [2023-12-26 06:35:20,013][123091] Updated weights for policy 0, policy_version 876689 (0.0010) [2023-12-26 06:35:20,080][123091] Updated weights for policy 0, policy_version 876699 (0.0005) [2023-12-26 06:35:20,152][123091] Updated weights for policy 0, policy_version 876709 (0.0008) [2023-12-26 06:35:20,216][123091] Updated weights for policy 0, policy_version 876719 (0.0008) [2023-12-26 06:35:20,784][123090] Updated weights for policy 1, policy_version 870473 (0.0006) [2023-12-26 06:35:20,845][123090] Updated weights for policy 1, policy_version 870483 (0.0006) [2023-12-26 06:35:20,907][123090] Updated weights for policy 1, policy_version 870493 (0.0006) [2023-12-26 06:35:20,930][123091] Updated weights for policy 0, policy_version 876729 (0.0008) [2023-12-26 06:35:20,994][123091] Updated weights for policy 0, policy_version 876739 (0.0006) [2023-12-26 06:35:21,064][123091] Updated weights for policy 0, policy_version 876749 (0.0008) [2023-12-26 06:35:21,753][123090] Updated weights for policy 1, policy_version 870503 (0.0009) [2023-12-26 06:35:21,823][123090] Updated weights for policy 1, policy_version 870513 (0.0009) [2023-12-26 06:35:21,828][123091] Updated weights for policy 0, policy_version 876759 (0.0007) [2023-12-26 06:35:21,880][123091] Updated weights for policy 0, policy_version 876769 (0.0008) [2023-12-26 06:35:21,887][123090] Updated weights for policy 1, policy_version 870523 (0.0008) [2023-12-26 06:35:21,936][123091] Updated weights for policy 0, policy_version 876779 (0.0008) [2023-12-26 06:35:22,734][123091] Updated weights for policy 0, policy_version 876789 (0.0009) [2023-12-26 06:35:22,742][123090] Updated weights for policy 1, policy_version 870533 (0.0006) [2023-12-26 06:35:22,782][123091] Updated weights for policy 0, policy_version 876799 (0.0010) [2023-12-26 06:35:22,793][123090] Updated weights for policy 1, policy_version 870543 (0.0006) [2023-12-26 06:35:22,848][123091] Updated weights for policy 0, policy_version 876809 (0.0010) [2023-12-26 06:35:22,856][123090] Updated weights for policy 1, policy_version 870553 (0.0007) [2023-12-26 06:35:23,680][123091] Updated weights for policy 0, policy_version 876819 (0.0011) [2023-12-26 06:35:23,688][123090] Updated weights for policy 1, policy_version 870563 (0.0006) [2023-12-26 06:35:23,729][123091] Updated weights for policy 0, policy_version 876829 (0.0010) [2023-12-26 06:35:23,739][123090] Updated weights for policy 1, policy_version 870573 (0.0008) [2023-12-26 06:35:23,778][123091] Updated weights for policy 0, policy_version 876839 (0.0007) [2023-12-26 06:35:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 447332352. Throughput: 0: 8910.5, 1: 8722.5. Samples: 447317284. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:23,785][121949] Avg episode reward: [(0, '6176.660'), (1, '5849.324')] [2023-12-26 06:35:23,785][123090] Updated weights for policy 1, policy_version 870583 (0.0008) [2023-12-26 06:35:23,823][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000876848_224477184.pth... [2023-12-26 06:35:23,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000875824_224215040.pth [2023-12-26 06:35:23,837][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000870592_222871552.pth... [2023-12-26 06:35:23,841][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000869568_222609408.pth [2023-12-26 06:35:24,518][123091] Updated weights for policy 0, policy_version 876849 (0.0009) [2023-12-26 06:35:24,573][123091] Updated weights for policy 0, policy_version 876859 (0.0005) [2023-12-26 06:35:24,628][123091] Updated weights for policy 0, policy_version 876869 (0.0005) [2023-12-26 06:35:24,687][123091] Updated weights for policy 0, policy_version 876879 (0.0006) [2023-12-26 06:35:24,694][123090] Updated weights for policy 1, policy_version 870593 (0.0008) [2023-12-26 06:35:24,762][123090] Updated weights for policy 1, policy_version 870603 (0.0009) [2023-12-26 06:35:24,815][123090] Updated weights for policy 1, policy_version 870613 (0.0009) [2023-12-26 06:35:24,864][123090] Updated weights for policy 1, policy_version 870623 (0.0009) [2023-12-26 06:35:25,340][123091] Updated weights for policy 0, policy_version 876889 (0.0009) [2023-12-26 06:35:25,405][123091] Updated weights for policy 0, policy_version 876899 (0.0010) [2023-12-26 06:35:25,466][123091] Updated weights for policy 0, policy_version 876909 (0.0009) [2023-12-26 06:35:25,677][123090] Updated weights for policy 1, policy_version 870634 (0.0008) [2023-12-26 06:35:25,740][123090] Updated weights for policy 1, policy_version 870644 (0.0010) [2023-12-26 06:35:25,789][123090] Updated weights for policy 1, policy_version 870654 (0.0010) [2023-12-26 06:35:26,342][123091] Updated weights for policy 0, policy_version 876919 (0.0010) [2023-12-26 06:35:26,404][123091] Updated weights for policy 0, policy_version 876929 (0.0010) [2023-12-26 06:35:26,455][123091] Updated weights for policy 0, policy_version 876939 (0.0010) [2023-12-26 06:35:26,501][123090] Updated weights for policy 1, policy_version 870664 (0.0006) [2023-12-26 06:35:26,558][123090] Updated weights for policy 1, policy_version 870674 (0.0005) [2023-12-26 06:35:26,606][123090] Updated weights for policy 1, policy_version 870684 (0.0006) [2023-12-26 06:35:27,224][123091] Updated weights for policy 0, policy_version 876949 (0.0009) [2023-12-26 06:35:27,278][123091] Updated weights for policy 0, policy_version 876959 (0.0009) [2023-12-26 06:35:27,337][123091] Updated weights for policy 0, policy_version 876969 (0.0009) [2023-12-26 06:35:27,343][123090] Updated weights for policy 1, policy_version 870694 (0.0007) [2023-12-26 06:35:27,403][123090] Updated weights for policy 1, policy_version 870704 (0.0009) [2023-12-26 06:35:27,465][123090] Updated weights for policy 1, policy_version 870714 (0.0009) [2023-12-26 06:35:28,138][123090] Updated weights for policy 1, policy_version 870724 (0.0008) [2023-12-26 06:35:28,191][123090] Updated weights for policy 1, policy_version 870734 (0.0005) [2023-12-26 06:35:28,231][123091] Updated weights for policy 0, policy_version 876979 (0.0008) [2023-12-26 06:35:28,247][123090] Updated weights for policy 1, policy_version 870744 (0.0008) [2023-12-26 06:35:28,279][123091] Updated weights for policy 0, policy_version 876989 (0.0005) [2023-12-26 06:35:28,329][123091] Updated weights for policy 0, policy_version 876999 (0.0008) [2023-12-26 06:35:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 447430656. Throughput: 0: 8934.5, 1: 8768.7. Samples: 447423132. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:28,785][121949] Avg episode reward: [(0, '6249.402'), (1, '5766.396')] [2023-12-26 06:35:29,073][123090] Updated weights for policy 1, policy_version 870754 (0.0010) [2023-12-26 06:35:29,141][123090] Updated weights for policy 1, policy_version 870764 (0.0009) [2023-12-26 06:35:29,172][123091] Updated weights for policy 0, policy_version 877009 (0.0009) [2023-12-26 06:35:29,207][123090] Updated weights for policy 1, policy_version 870774 (0.0010) [2023-12-26 06:35:29,240][123091] Updated weights for policy 0, policy_version 877019 (0.0008) [2023-12-26 06:35:29,277][123090] Updated weights for policy 1, policy_version 870784 (0.0008) [2023-12-26 06:35:29,306][123091] Updated weights for policy 0, policy_version 877029 (0.0009) [2023-12-26 06:35:29,369][123091] Updated weights for policy 0, policy_version 877039 (0.0009) [2023-12-26 06:35:30,119][123090] Updated weights for policy 1, policy_version 870794 (0.0007) [2023-12-26 06:35:30,181][123090] Updated weights for policy 1, policy_version 870804 (0.0007) [2023-12-26 06:35:30,184][123091] Updated weights for policy 0, policy_version 877049 (0.0009) [2023-12-26 06:35:30,245][123090] Updated weights for policy 1, policy_version 870814 (0.0008) [2023-12-26 06:35:30,248][123091] Updated weights for policy 0, policy_version 877059 (0.0009) [2023-12-26 06:35:30,315][123091] Updated weights for policy 0, policy_version 877069 (0.0010) [2023-12-26 06:35:31,047][123090] Updated weights for policy 1, policy_version 870824 (0.0006) [2023-12-26 06:35:31,075][123091] Updated weights for policy 0, policy_version 877079 (0.0008) [2023-12-26 06:35:31,116][123090] Updated weights for policy 1, policy_version 870834 (0.0006) [2023-12-26 06:35:31,144][123091] Updated weights for policy 0, policy_version 877089 (0.0008) [2023-12-26 06:35:31,190][123090] Updated weights for policy 1, policy_version 870844 (0.0007) [2023-12-26 06:35:31,217][123091] Updated weights for policy 0, policy_version 877099 (0.0008) [2023-12-26 06:35:31,945][123090] Updated weights for policy 1, policy_version 870854 (0.0006) [2023-12-26 06:35:32,020][123090] Updated weights for policy 1, policy_version 870864 (0.0006) [2023-12-26 06:35:32,027][123091] Updated weights for policy 0, policy_version 877109 (0.0009) [2023-12-26 06:35:32,072][123090] Updated weights for policy 1, policy_version 870874 (0.0009) [2023-12-26 06:35:32,081][123091] Updated weights for policy 0, policy_version 877119 (0.0006) [2023-12-26 06:35:32,138][123091] Updated weights for policy 0, policy_version 877129 (0.0006) [2023-12-26 06:35:32,818][123091] Updated weights for policy 0, policy_version 877139 (0.0006) [2023-12-26 06:35:32,872][123091] Updated weights for policy 0, policy_version 877149 (0.0009) [2023-12-26 06:35:32,887][123090] Updated weights for policy 1, policy_version 870884 (0.0008) [2023-12-26 06:35:32,933][123091] Updated weights for policy 0, policy_version 877159 (0.0008) [2023-12-26 06:35:32,939][123090] Updated weights for policy 1, policy_version 870894 (0.0008) [2023-12-26 06:35:32,990][123090] Updated weights for policy 1, policy_version 870904 (0.0008) [2023-12-26 06:35:33,709][123090] Updated weights for policy 1, policy_version 870914 (0.0008) [2023-12-26 06:35:33,772][123090] Updated weights for policy 1, policy_version 870924 (0.0005) [2023-12-26 06:35:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 447512576. Throughput: 0: 8818.0, 1: 8784.8. Samples: 447528872. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:33,785][121949] Avg episode reward: [(0, '6210.307'), (1, '5816.217')] [2023-12-26 06:35:33,810][123091] Updated weights for policy 0, policy_version 877169 (0.0008) [2023-12-26 06:35:33,822][123090] Updated weights for policy 1, policy_version 870934 (0.0005) [2023-12-26 06:35:33,866][123090] Updated weights for policy 1, policy_version 870944 (0.0005) [2023-12-26 06:35:33,866][123091] Updated weights for policy 0, policy_version 877179 (0.0008) [2023-12-26 06:35:33,919][123091] Updated weights for policy 0, policy_version 877190 (0.0010) [2023-12-26 06:35:33,973][123091] Updated weights for policy 0, policy_version 877200 (0.0010) [2023-12-26 06:35:34,632][123090] Updated weights for policy 1, policy_version 870954 (0.0011) [2023-12-26 06:35:34,695][123090] Updated weights for policy 1, policy_version 870964 (0.0010) [2023-12-26 06:35:34,759][123090] Updated weights for policy 1, policy_version 870974 (0.0010) [2023-12-26 06:35:34,802][123091] Updated weights for policy 0, policy_version 877210 (0.0009) [2023-12-26 06:35:34,850][123091] Updated weights for policy 0, policy_version 877220 (0.0009) [2023-12-26 06:35:34,899][123091] Updated weights for policy 0, policy_version 877230 (0.0009) [2023-12-26 06:35:35,550][123090] Updated weights for policy 1, policy_version 870984 (0.0006) [2023-12-26 06:35:35,615][123090] Updated weights for policy 1, policy_version 870994 (0.0007) [2023-12-26 06:35:35,622][123091] Updated weights for policy 0, policy_version 877240 (0.0006) [2023-12-26 06:35:35,672][123090] Updated weights for policy 1, policy_version 871004 (0.0006) [2023-12-26 06:35:35,683][123091] Updated weights for policy 0, policy_version 877250 (0.0009) [2023-12-26 06:35:35,742][123091] Updated weights for policy 0, policy_version 877260 (0.0009) [2023-12-26 06:35:36,415][123090] Updated weights for policy 1, policy_version 871014 (0.0009) [2023-12-26 06:35:36,484][123090] Updated weights for policy 1, policy_version 871024 (0.0008) [2023-12-26 06:35:36,549][123090] Updated weights for policy 1, policy_version 871034 (0.0009) [2023-12-26 06:35:36,556][123091] Updated weights for policy 0, policy_version 877270 (0.0009) [2023-12-26 06:35:36,623][123091] Updated weights for policy 0, policy_version 877280 (0.0009) [2023-12-26 06:35:36,687][123091] Updated weights for policy 0, policy_version 877290 (0.0010) [2023-12-26 06:35:37,330][123090] Updated weights for policy 1, policy_version 871044 (0.0009) [2023-12-26 06:35:37,392][123090] Updated weights for policy 1, policy_version 871054 (0.0008) [2023-12-26 06:35:37,441][123090] Updated weights for policy 1, policy_version 871064 (0.0009) [2023-12-26 06:35:37,535][123091] Updated weights for policy 0, policy_version 877300 (0.0010) [2023-12-26 06:35:37,604][123091] Updated weights for policy 0, policy_version 877310 (0.0010) [2023-12-26 06:35:37,670][123091] Updated weights for policy 0, policy_version 877320 (0.0010) [2023-12-26 06:35:38,292][123090] Updated weights for policy 1, policy_version 871074 (0.0008) [2023-12-26 06:35:38,365][123090] Updated weights for policy 1, policy_version 871084 (0.0007) [2023-12-26 06:35:38,439][123090] Updated weights for policy 1, policy_version 871094 (0.0009) [2023-12-26 06:35:38,500][123091] Updated weights for policy 0, policy_version 877330 (0.0008) [2023-12-26 06:35:38,500][123090] Updated weights for policy 1, policy_version 871104 (0.0010) [2023-12-26 06:35:38,553][123091] Updated weights for policy 0, policy_version 877340 (0.0005) [2023-12-26 06:35:38,617][123091] Updated weights for policy 0, policy_version 877350 (0.0006) [2023-12-26 06:35:38,683][123091] Updated weights for policy 0, policy_version 877360 (0.0009) [2023-12-26 06:35:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 447610880. Throughput: 0: 8786.4, 1: 8828.8. Samples: 447583592. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:38,785][121949] Avg episode reward: [(0, '6273.596'), (1, '5912.342')] [2023-12-26 06:35:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000871104_223002624.pth... [2023-12-26 06:35:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000877360_224608256.pth... [2023-12-26 06:35:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000870080_222740480.pth [2023-12-26 06:35:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000876304_224337920.pth [2023-12-26 06:35:39,263][123090] Updated weights for policy 1, policy_version 871114 (0.0006) [2023-12-26 06:35:39,329][123090] Updated weights for policy 1, policy_version 871124 (0.0005) [2023-12-26 06:35:39,405][123090] Updated weights for policy 1, policy_version 871134 (0.0010) [2023-12-26 06:35:39,558][123091] Updated weights for policy 0, policy_version 877370 (0.0010) [2023-12-26 06:35:39,625][123091] Updated weights for policy 0, policy_version 877381 (0.0009) [2023-12-26 06:35:39,697][123091] Updated weights for policy 0, policy_version 877391 (0.0007) [2023-12-26 06:35:40,118][123090] Updated weights for policy 1, policy_version 871144 (0.0006) [2023-12-26 06:35:40,185][123090] Updated weights for policy 1, policy_version 871154 (0.0010) [2023-12-26 06:35:40,249][123090] Updated weights for policy 1, policy_version 871164 (0.0010) [2023-12-26 06:35:40,513][123091] Updated weights for policy 0, policy_version 877401 (0.0009) [2023-12-26 06:35:40,577][123091] Updated weights for policy 0, policy_version 877411 (0.0009) [2023-12-26 06:35:40,628][123091] Updated weights for policy 0, policy_version 877421 (0.0010) [2023-12-26 06:35:41,021][123090] Updated weights for policy 1, policy_version 871174 (0.0009) [2023-12-26 06:35:41,101][123090] Updated weights for policy 1, policy_version 871184 (0.0009) [2023-12-26 06:35:41,170][123090] Updated weights for policy 1, policy_version 871194 (0.0008) [2023-12-26 06:35:41,550][123091] Updated weights for policy 0, policy_version 877431 (0.0010) [2023-12-26 06:35:41,617][123091] Updated weights for policy 0, policy_version 877441 (0.0010) [2023-12-26 06:35:41,677][123091] Updated weights for policy 0, policy_version 877451 (0.0010) [2023-12-26 06:35:42,019][123090] Updated weights for policy 1, policy_version 871204 (0.0008) [2023-12-26 06:35:42,082][123090] Updated weights for policy 1, policy_version 871214 (0.0010) [2023-12-26 06:35:42,139][123090] Updated weights for policy 1, policy_version 871224 (0.0009) [2023-12-26 06:35:42,531][123091] Updated weights for policy 0, policy_version 877461 (0.0010) [2023-12-26 06:35:42,597][123091] Updated weights for policy 0, policy_version 877471 (0.0010) [2023-12-26 06:35:42,663][123091] Updated weights for policy 0, policy_version 877481 (0.0010) [2023-12-26 06:35:42,995][123090] Updated weights for policy 1, policy_version 871234 (0.0009) [2023-12-26 06:35:43,047][123090] Updated weights for policy 1, policy_version 871244 (0.0010) [2023-12-26 06:35:43,100][123090] Updated weights for policy 1, policy_version 871254 (0.0010) [2023-12-26 06:35:43,152][123090] Updated weights for policy 1, policy_version 871264 (0.0010) [2023-12-26 06:35:43,523][123091] Updated weights for policy 0, policy_version 877491 (0.0010) [2023-12-26 06:35:43,585][123091] Updated weights for policy 0, policy_version 877501 (0.0010) [2023-12-26 06:35:43,650][123091] Updated weights for policy 0, policy_version 877511 (0.0010) [2023-12-26 06:35:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 447692800. Throughput: 0: 8787.3, 1: 8736.4. Samples: 447686204. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:43,785][121949] Avg episode reward: [(0, '6318.162'), (1, '5853.920')] [2023-12-26 06:35:43,959][123090] Updated weights for policy 1, policy_version 871274 (0.0005) [2023-12-26 06:35:44,029][123090] Updated weights for policy 1, policy_version 871284 (0.0005) [2023-12-26 06:35:44,085][123090] Updated weights for policy 1, policy_version 871294 (0.0005) [2023-12-26 06:35:44,502][123091] Updated weights for policy 0, policy_version 877521 (0.0010) [2023-12-26 06:35:44,550][123091] Updated weights for policy 0, policy_version 877531 (0.0009) [2023-12-26 06:35:44,598][123091] Updated weights for policy 0, policy_version 877541 (0.0009) [2023-12-26 06:35:44,654][123091] Updated weights for policy 0, policy_version 877551 (0.0008) [2023-12-26 06:35:44,780][123090] Updated weights for policy 1, policy_version 871304 (0.0010) [2023-12-26 06:35:44,840][123090] Updated weights for policy 1, policy_version 871314 (0.0011) [2023-12-26 06:35:44,909][123090] Updated weights for policy 1, policy_version 871324 (0.0011) [2023-12-26 06:35:45,508][123091] Updated weights for policy 0, policy_version 877561 (0.0009) [2023-12-26 06:35:45,564][123091] Updated weights for policy 0, policy_version 877571 (0.0009) [2023-12-26 06:35:45,618][123091] Updated weights for policy 0, policy_version 877581 (0.0008) [2023-12-26 06:35:45,747][123090] Updated weights for policy 1, policy_version 871334 (0.0011) [2023-12-26 06:35:45,819][123090] Updated weights for policy 1, policy_version 871344 (0.0011) [2023-12-26 06:35:45,881][123090] Updated weights for policy 1, policy_version 871354 (0.0010) [2023-12-26 06:35:46,483][123091] Updated weights for policy 0, policy_version 877591 (0.0009) [2023-12-26 06:35:46,533][123091] Updated weights for policy 0, policy_version 877601 (0.0009) [2023-12-26 06:35:46,579][123091] Updated weights for policy 0, policy_version 877611 (0.0009) [2023-12-26 06:35:46,676][123090] Updated weights for policy 1, policy_version 871364 (0.0009) [2023-12-26 06:35:46,742][123090] Updated weights for policy 1, policy_version 871374 (0.0006) [2023-12-26 06:35:46,811][123090] Updated weights for policy 1, policy_version 871384 (0.0008) [2023-12-26 06:35:47,330][123091] Updated weights for policy 0, policy_version 877621 (0.0007) [2023-12-26 06:35:47,374][123091] Updated weights for policy 0, policy_version 877631 (0.0005) [2023-12-26 06:35:47,421][123091] Updated weights for policy 0, policy_version 877641 (0.0005) [2023-12-26 06:35:47,674][123090] Updated weights for policy 1, policy_version 871394 (0.0010) [2023-12-26 06:35:47,723][123090] Updated weights for policy 1, policy_version 871404 (0.0009) [2023-12-26 06:35:47,780][123090] Updated weights for policy 1, policy_version 871415 (0.0010) [2023-12-26 06:35:48,115][123091] Updated weights for policy 0, policy_version 877651 (0.0005) [2023-12-26 06:35:48,175][123091] Updated weights for policy 0, policy_version 877661 (0.0009) [2023-12-26 06:35:48,231][123091] Updated weights for policy 0, policy_version 877671 (0.0009) [2023-12-26 06:35:48,704][123090] Updated weights for policy 1, policy_version 871425 (0.0010) [2023-12-26 06:35:48,766][123090] Updated weights for policy 1, policy_version 871435 (0.0010) [2023-12-26 06:35:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 447774720. Throughput: 0: 8807.8, 1: 8761.7. Samples: 447791056. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:48,785][121949] Avg episode reward: [(0, '6387.993'), (1, '5827.069')] [2023-12-26 06:35:48,835][123090] Updated weights for policy 1, policy_version 871445 (0.0009) [2023-12-26 06:35:48,906][123090] Updated weights for policy 1, policy_version 871455 (0.0008) [2023-12-26 06:35:49,064][123091] Updated weights for policy 0, policy_version 877681 (0.0009) [2023-12-26 06:35:49,130][123091] Updated weights for policy 0, policy_version 877691 (0.0007) [2023-12-26 06:35:49,179][123091] Updated weights for policy 0, policy_version 877701 (0.0005) [2023-12-26 06:35:49,245][123091] Updated weights for policy 0, policy_version 877711 (0.0007) [2023-12-26 06:35:49,778][123090] Updated weights for policy 1, policy_version 871465 (0.0006) [2023-12-26 06:35:49,855][123090] Updated weights for policy 1, policy_version 871476 (0.0007) [2023-12-26 06:35:49,921][123090] Updated weights for policy 1, policy_version 871486 (0.0009) [2023-12-26 06:35:50,026][123091] Updated weights for policy 0, policy_version 877721 (0.0008) [2023-12-26 06:35:50,091][123091] Updated weights for policy 0, policy_version 877731 (0.0008) [2023-12-26 06:35:50,161][123091] Updated weights for policy 0, policy_version 877741 (0.0008) [2023-12-26 06:35:50,618][123090] Updated weights for policy 1, policy_version 871496 (0.0009) [2023-12-26 06:35:50,676][123090] Updated weights for policy 1, policy_version 871506 (0.0006) [2023-12-26 06:35:50,733][123090] Updated weights for policy 1, policy_version 871516 (0.0006) [2023-12-26 06:35:50,943][123091] Updated weights for policy 0, policy_version 877751 (0.0009) [2023-12-26 06:35:50,994][123091] Updated weights for policy 0, policy_version 877761 (0.0010) [2023-12-26 06:35:51,056][123091] Updated weights for policy 0, policy_version 877771 (0.0010) [2023-12-26 06:35:51,549][123090] Updated weights for policy 1, policy_version 871526 (0.0008) [2023-12-26 06:35:51,618][123090] Updated weights for policy 1, policy_version 871536 (0.0009) [2023-12-26 06:35:51,686][123090] Updated weights for policy 1, policy_version 871546 (0.0008) [2023-12-26 06:35:51,892][123091] Updated weights for policy 0, policy_version 877781 (0.0010) [2023-12-26 06:35:51,943][123091] Updated weights for policy 0, policy_version 877791 (0.0009) [2023-12-26 06:35:52,008][123091] Updated weights for policy 0, policy_version 877801 (0.0010) [2023-12-26 06:35:52,518][123090] Updated weights for policy 1, policy_version 871556 (0.0009) [2023-12-26 06:35:52,590][123090] Updated weights for policy 1, policy_version 871566 (0.0007) [2023-12-26 06:35:52,659][123090] Updated weights for policy 1, policy_version 871576 (0.0006) [2023-12-26 06:35:52,831][123091] Updated weights for policy 0, policy_version 877811 (0.0008) [2023-12-26 06:35:52,879][123091] Updated weights for policy 0, policy_version 877821 (0.0006) [2023-12-26 06:35:52,933][123091] Updated weights for policy 0, policy_version 877831 (0.0010) [2023-12-26 06:35:53,430][123090] Updated weights for policy 1, policy_version 871586 (0.0008) [2023-12-26 06:35:53,497][123090] Updated weights for policy 1, policy_version 871596 (0.0009) [2023-12-26 06:35:53,560][123090] Updated weights for policy 1, policy_version 871606 (0.0009) [2023-12-26 06:35:53,629][123090] Updated weights for policy 1, policy_version 871616 (0.0007) [2023-12-26 06:35:53,735][123091] Updated weights for policy 0, policy_version 877841 (0.0009) [2023-12-26 06:35:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 447864832. Throughput: 0: 8803.4, 1: 8773.5. Samples: 447843144. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:53,785][121949] Avg episode reward: [(0, '6264.024'), (1, '5858.810')] [2023-12-26 06:35:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000871616_223133696.pth... [2023-12-26 06:35:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000870592_222871552.pth [2023-12-26 06:35:53,811][123091] Updated weights for policy 0, policy_version 877851 (0.0008) [2023-12-26 06:35:53,860][123091] Updated weights for policy 0, policy_version 877861 (0.0010) [2023-12-26 06:35:53,926][123091] Updated weights for policy 0, policy_version 877871 (0.0010) [2023-12-26 06:35:53,933][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000877872_224739328.pth... [2023-12-26 06:35:53,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000876848_224477184.pth [2023-12-26 06:35:54,371][123090] Updated weights for policy 1, policy_version 871626 (0.0005) [2023-12-26 06:35:54,435][123090] Updated weights for policy 1, policy_version 871636 (0.0005) [2023-12-26 06:35:54,504][123090] Updated weights for policy 1, policy_version 871646 (0.0005) [2023-12-26 06:35:54,660][123091] Updated weights for policy 0, policy_version 877881 (0.0009) [2023-12-26 06:35:54,718][123091] Updated weights for policy 0, policy_version 877891 (0.0006) [2023-12-26 06:35:54,775][123091] Updated weights for policy 0, policy_version 877901 (0.0005) [2023-12-26 06:35:55,262][123090] Updated weights for policy 1, policy_version 871657 (0.0009) [2023-12-26 06:35:55,340][123090] Updated weights for policy 1, policy_version 871667 (0.0008) [2023-12-26 06:35:55,407][123090] Updated weights for policy 1, policy_version 871677 (0.0009) [2023-12-26 06:35:55,435][123091] Updated weights for policy 0, policy_version 877911 (0.0005) [2023-12-26 06:35:55,480][123091] Updated weights for policy 0, policy_version 877921 (0.0007) [2023-12-26 06:35:55,529][123091] Updated weights for policy 0, policy_version 877931 (0.0006) [2023-12-26 06:35:56,207][123090] Updated weights for policy 1, policy_version 871687 (0.0009) [2023-12-26 06:35:56,224][123091] Updated weights for policy 0, policy_version 877941 (0.0006) [2023-12-26 06:35:56,260][123090] Updated weights for policy 1, policy_version 871697 (0.0008) [2023-12-26 06:35:56,281][123091] Updated weights for policy 0, policy_version 877951 (0.0008) [2023-12-26 06:35:56,317][123090] Updated weights for policy 1, policy_version 871707 (0.0010) [2023-12-26 06:35:56,337][123091] Updated weights for policy 0, policy_version 877961 (0.0007) [2023-12-26 06:35:57,132][123091] Updated weights for policy 0, policy_version 877971 (0.0009) [2023-12-26 06:35:57,165][123090] Updated weights for policy 1, policy_version 871717 (0.0009) [2023-12-26 06:35:57,185][123091] Updated weights for policy 0, policy_version 877981 (0.0011) [2023-12-26 06:35:57,220][123090] Updated weights for policy 1, policy_version 871727 (0.0008) [2023-12-26 06:35:57,249][123091] Updated weights for policy 0, policy_version 877992 (0.0007) [2023-12-26 06:35:57,277][123090] Updated weights for policy 1, policy_version 871737 (0.0010) [2023-12-26 06:35:57,906][123090] Updated weights for policy 1, policy_version 871747 (0.0010) [2023-12-26 06:35:57,966][123090] Updated weights for policy 1, policy_version 871757 (0.0007) [2023-12-26 06:35:58,027][123090] Updated weights for policy 1, policy_version 871767 (0.0006) [2023-12-26 06:35:58,104][123091] Updated weights for policy 0, policy_version 878002 (0.0007) [2023-12-26 06:35:58,166][123091] Updated weights for policy 0, policy_version 878012 (0.0010) [2023-12-26 06:35:58,226][123091] Updated weights for policy 0, policy_version 878022 (0.0009) [2023-12-26 06:35:58,290][123091] Updated weights for policy 0, policy_version 878032 (0.0009) [2023-12-26 06:35:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 447954944. Throughput: 0: 8838.7, 1: 8842.8. Samples: 447951516. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:35:58,785][121949] Avg episode reward: [(0, '6093.959'), (1, '5743.308')] [2023-12-26 06:35:58,874][123090] Updated weights for policy 1, policy_version 871777 (0.0008) [2023-12-26 06:35:58,943][123090] Updated weights for policy 1, policy_version 871787 (0.0006) [2023-12-26 06:35:59,023][123090] Updated weights for policy 1, policy_version 871797 (0.0007) [2023-12-26 06:35:59,087][123090] Updated weights for policy 1, policy_version 871807 (0.0007) [2023-12-26 06:35:59,237][123091] Updated weights for policy 0, policy_version 878042 (0.0007) [2023-12-26 06:35:59,305][123091] Updated weights for policy 0, policy_version 878052 (0.0008) [2023-12-26 06:35:59,370][123091] Updated weights for policy 0, policy_version 878062 (0.0009) [2023-12-26 06:35:59,811][123090] Updated weights for policy 1, policy_version 871817 (0.0009) [2023-12-26 06:35:59,877][123090] Updated weights for policy 1, policy_version 871827 (0.0008) [2023-12-26 06:35:59,944][123090] Updated weights for policy 1, policy_version 871837 (0.0010) [2023-12-26 06:36:00,234][123091] Updated weights for policy 0, policy_version 878072 (0.0007) [2023-12-26 06:36:00,289][123091] Updated weights for policy 0, policy_version 878082 (0.0005) [2023-12-26 06:36:00,341][123091] Updated weights for policy 0, policy_version 878092 (0.0005) [2023-12-26 06:36:00,784][123090] Updated weights for policy 1, policy_version 871847 (0.0007) [2023-12-26 06:36:00,843][123090] Updated weights for policy 1, policy_version 871857 (0.0005) [2023-12-26 06:36:00,900][123090] Updated weights for policy 1, policy_version 871867 (0.0005) [2023-12-26 06:36:01,102][123091] Updated weights for policy 0, policy_version 878102 (0.0006) [2023-12-26 06:36:01,168][123091] Updated weights for policy 0, policy_version 878112 (0.0007) [2023-12-26 06:36:01,237][123091] Updated weights for policy 0, policy_version 878122 (0.0005) [2023-12-26 06:36:01,659][123090] Updated weights for policy 1, policy_version 871877 (0.0007) [2023-12-26 06:36:01,727][123090] Updated weights for policy 1, policy_version 871887 (0.0008) [2023-12-26 06:36:01,791][123090] Updated weights for policy 1, policy_version 871897 (0.0007) [2023-12-26 06:36:01,995][123091] Updated weights for policy 0, policy_version 878132 (0.0009) [2023-12-26 06:36:02,047][123091] Updated weights for policy 0, policy_version 878142 (0.0011) [2023-12-26 06:36:02,092][123091] Updated weights for policy 0, policy_version 878152 (0.0010) [2023-12-26 06:36:02,505][123090] Updated weights for policy 1, policy_version 871907 (0.0006) [2023-12-26 06:36:02,568][123090] Updated weights for policy 1, policy_version 871917 (0.0009) [2023-12-26 06:36:02,622][123090] Updated weights for policy 1, policy_version 871927 (0.0009) [2023-12-26 06:36:02,939][123091] Updated weights for policy 0, policy_version 878162 (0.0011) [2023-12-26 06:36:02,991][123091] Updated weights for policy 0, policy_version 878172 (0.0011) [2023-12-26 06:36:03,043][123091] Updated weights for policy 0, policy_version 878182 (0.0010) [2023-12-26 06:36:03,094][123091] Updated weights for policy 0, policy_version 878192 (0.0010) [2023-12-26 06:36:03,315][123090] Updated weights for policy 1, policy_version 871937 (0.0009) [2023-12-26 06:36:03,374][123090] Updated weights for policy 1, policy_version 871947 (0.0008) [2023-12-26 06:36:03,421][123090] Updated weights for policy 1, policy_version 871957 (0.0008) [2023-12-26 06:36:03,477][123090] Updated weights for policy 1, policy_version 871967 (0.0008) [2023-12-26 06:36:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 448045056. Throughput: 0: 8741.4, 1: 8851.7. Samples: 448057376. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:36:03,784][121949] Avg episode reward: [(0, '6109.332'), (1, '5773.848')] [2023-12-26 06:36:03,948][123091] Updated weights for policy 0, policy_version 878202 (0.0011) [2023-12-26 06:36:03,996][123091] Updated weights for policy 0, policy_version 878212 (0.0011) [2023-12-26 06:36:04,053][123091] Updated weights for policy 0, policy_version 878222 (0.0011) [2023-12-26 06:36:04,168][123090] Updated weights for policy 1, policy_version 871977 (0.0008) [2023-12-26 06:36:04,220][123090] Updated weights for policy 1, policy_version 871987 (0.0008) [2023-12-26 06:36:04,279][123090] Updated weights for policy 1, policy_version 871997 (0.0007) [2023-12-26 06:36:04,923][123091] Updated weights for policy 0, policy_version 878232 (0.0010) [2023-12-26 06:36:04,979][123091] Updated weights for policy 0, policy_version 878242 (0.0009) [2023-12-26 06:36:05,034][123091] Updated weights for policy 0, policy_version 878252 (0.0009) [2023-12-26 06:36:05,056][123090] Updated weights for policy 1, policy_version 872007 (0.0007) [2023-12-26 06:36:05,121][123090] Updated weights for policy 1, policy_version 872017 (0.0008) [2023-12-26 06:36:05,187][123090] Updated weights for policy 1, policy_version 872027 (0.0008) [2023-12-26 06:36:05,873][123091] Updated weights for policy 0, policy_version 878262 (0.0008) [2023-12-26 06:36:05,933][123091] Updated weights for policy 0, policy_version 878272 (0.0006) [2023-12-26 06:36:05,940][123090] Updated weights for policy 1, policy_version 872037 (0.0007) [2023-12-26 06:36:06,000][123090] Updated weights for policy 1, policy_version 872047 (0.0005) [2023-12-26 06:36:06,003][123091] Updated weights for policy 0, policy_version 878282 (0.0007) [2023-12-26 06:36:06,070][123090] Updated weights for policy 1, policy_version 872057 (0.0006) [2023-12-26 06:36:06,746][123091] Updated weights for policy 0, policy_version 878292 (0.0007) [2023-12-26 06:36:06,769][123090] Updated weights for policy 1, policy_version 872067 (0.0008) [2023-12-26 06:36:06,816][123091] Updated weights for policy 0, policy_version 878302 (0.0007) [2023-12-26 06:36:06,827][123090] Updated weights for policy 1, policy_version 872077 (0.0008) [2023-12-26 06:36:06,884][123091] Updated weights for policy 0, policy_version 878312 (0.0010) [2023-12-26 06:36:06,887][123090] Updated weights for policy 1, policy_version 872087 (0.0008) [2023-12-26 06:36:07,663][123090] Updated weights for policy 1, policy_version 872097 (0.0007) [2023-12-26 06:36:07,703][123091] Updated weights for policy 0, policy_version 878322 (0.0008) [2023-12-26 06:36:07,722][123090] Updated weights for policy 1, policy_version 872107 (0.0009) [2023-12-26 06:36:07,764][123091] Updated weights for policy 0, policy_version 878332 (0.0008) [2023-12-26 06:36:07,783][123090] Updated weights for policy 1, policy_version 872117 (0.0008) [2023-12-26 06:36:07,825][123091] Updated weights for policy 0, policy_version 878342 (0.0006) [2023-12-26 06:36:07,843][123090] Updated weights for policy 1, policy_version 872127 (0.0009) [2023-12-26 06:36:07,889][123091] Updated weights for policy 0, policy_version 878352 (0.0005) [2023-12-26 06:36:08,623][123090] Updated weights for policy 1, policy_version 872137 (0.0007) [2023-12-26 06:36:08,650][123091] Updated weights for policy 0, policy_version 878362 (0.0010) [2023-12-26 06:36:08,686][123090] Updated weights for policy 1, policy_version 872147 (0.0007) [2023-12-26 06:36:08,712][123091] Updated weights for policy 0, policy_version 878372 (0.0010) [2023-12-26 06:36:08,745][123090] Updated weights for policy 1, policy_version 872157 (0.0009) [2023-12-26 06:36:08,767][123091] Updated weights for policy 0, policy_version 878382 (0.0010) [2023-12-26 06:36:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 448143360. Throughput: 0: 8734.5, 1: 8923.5. Samples: 448111896. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:36:08,785][121949] Avg episode reward: [(0, '6260.456'), (1, '5762.709')] [2023-12-26 06:36:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000878384_224870400.pth... [2023-12-26 06:36:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000872160_223272960.pth... [2023-12-26 06:36:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000877360_224608256.pth [2023-12-26 06:36:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000871104_223002624.pth [2023-12-26 06:36:09,545][123090] Updated weights for policy 1, policy_version 872167 (0.0008) [2023-12-26 06:36:09,592][123091] Updated weights for policy 0, policy_version 878392 (0.0010) [2023-12-26 06:36:09,608][123090] Updated weights for policy 1, policy_version 872177 (0.0009) [2023-12-26 06:36:09,655][123091] Updated weights for policy 0, policy_version 878402 (0.0009) [2023-12-26 06:36:09,671][123090] Updated weights for policy 1, policy_version 872187 (0.0009) [2023-12-26 06:36:09,703][123091] Updated weights for policy 0, policy_version 878412 (0.0009) [2023-12-26 06:36:10,530][123090] Updated weights for policy 1, policy_version 872197 (0.0009) [2023-12-26 06:36:10,585][123090] Updated weights for policy 1, policy_version 872207 (0.0008) [2023-12-26 06:36:10,588][123091] Updated weights for policy 0, policy_version 878422 (0.0008) [2023-12-26 06:36:10,642][123090] Updated weights for policy 1, policy_version 872217 (0.0009) [2023-12-26 06:36:10,648][123091] Updated weights for policy 0, policy_version 878432 (0.0008) [2023-12-26 06:36:10,711][123091] Updated weights for policy 0, policy_version 878442 (0.0009) [2023-12-26 06:36:11,518][123090] Updated weights for policy 1, policy_version 872227 (0.0008) [2023-12-26 06:36:11,530][123091] Updated weights for policy 0, policy_version 878452 (0.0009) [2023-12-26 06:36:11,586][123090] Updated weights for policy 1, policy_version 872237 (0.0006) [2023-12-26 06:36:11,596][123091] Updated weights for policy 0, policy_version 878462 (0.0008) [2023-12-26 06:36:11,659][123090] Updated weights for policy 1, policy_version 872247 (0.0008) [2023-12-26 06:36:11,667][123091] Updated weights for policy 0, policy_version 878472 (0.0010) [2023-12-26 06:36:12,461][123090] Updated weights for policy 1, policy_version 872257 (0.0007) [2023-12-26 06:36:12,511][123091] Updated weights for policy 0, policy_version 878482 (0.0009) [2023-12-26 06:36:12,515][123090] Updated weights for policy 1, policy_version 872267 (0.0008) [2023-12-26 06:36:12,576][123091] Updated weights for policy 0, policy_version 878492 (0.0009) [2023-12-26 06:36:12,585][123090] Updated weights for policy 1, policy_version 872277 (0.0007) [2023-12-26 06:36:12,637][123091] Updated weights for policy 0, policy_version 878502 (0.0009) [2023-12-26 06:36:12,659][123090] Updated weights for policy 1, policy_version 872287 (0.0006) [2023-12-26 06:36:12,687][123091] Updated weights for policy 0, policy_version 878512 (0.0009) [2023-12-26 06:36:13,383][123090] Updated weights for policy 1, policy_version 872297 (0.0008) [2023-12-26 06:36:13,431][123090] Updated weights for policy 1, policy_version 872307 (0.0008) [2023-12-26 06:36:13,480][123090] Updated weights for policy 1, policy_version 872317 (0.0009) [2023-12-26 06:36:13,539][123091] Updated weights for policy 0, policy_version 878522 (0.0010) [2023-12-26 06:36:13,593][123091] Updated weights for policy 0, policy_version 878532 (0.0010) [2023-12-26 06:36:13,644][123091] Updated weights for policy 0, policy_version 878542 (0.0007) [2023-12-26 06:36:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 448225280. Throughput: 0: 8679.8, 1: 8911.0. Samples: 448214716. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 06:36:13,785][121949] Avg episode reward: [(0, '6158.117'), (1, '5877.839')] [2023-12-26 06:36:14,341][123090] Updated weights for policy 1, policy_version 872327 (0.0008) [2023-12-26 06:36:14,347][123091] Updated weights for policy 0, policy_version 878552 (0.0008) [2023-12-26 06:36:14,399][123090] Updated weights for policy 1, policy_version 872337 (0.0009) [2023-12-26 06:36:14,409][123091] Updated weights for policy 0, policy_version 878562 (0.0006) [2023-12-26 06:36:14,453][123090] Updated weights for policy 1, policy_version 872347 (0.0009) [2023-12-26 06:36:14,462][123091] Updated weights for policy 0, policy_version 878572 (0.0005) [2023-12-26 06:36:15,235][123090] Updated weights for policy 1, policy_version 872357 (0.0010) [2023-12-26 06:36:15,298][123091] Updated weights for policy 0, policy_version 878582 (0.0006) [2023-12-26 06:36:15,304][123090] Updated weights for policy 1, policy_version 872367 (0.0011) [2023-12-26 06:36:15,355][123091] Updated weights for policy 0, policy_version 878592 (0.0006) [2023-12-26 06:36:15,361][123090] Updated weights for policy 1, policy_version 872377 (0.0010) [2023-12-26 06:36:15,420][123091] Updated weights for policy 0, policy_version 878602 (0.0006) [2023-12-26 06:36:16,076][123090] Updated weights for policy 1, policy_version 872387 (0.0009) [2023-12-26 06:36:16,131][123090] Updated weights for policy 1, policy_version 872397 (0.0005) [2023-12-26 06:36:16,172][123091] Updated weights for policy 0, policy_version 878612 (0.0007) [2023-12-26 06:36:16,186][123090] Updated weights for policy 1, policy_version 872407 (0.0005) [2023-12-26 06:36:16,238][123091] Updated weights for policy 0, policy_version 878622 (0.0006) [2023-12-26 06:36:16,294][123091] Updated weights for policy 0, policy_version 878632 (0.0005) [2023-12-26 06:36:16,943][123091] Updated weights for policy 0, policy_version 878642 (0.0005) [2023-12-26 06:36:16,995][123091] Updated weights for policy 0, policy_version 878652 (0.0005) [2023-12-26 06:36:16,995][123090] Updated weights for policy 1, policy_version 872417 (0.0009) [2023-12-26 06:36:17,045][123091] Updated weights for policy 0, policy_version 878662 (0.0006) [2023-12-26 06:36:17,051][123090] Updated weights for policy 1, policy_version 872427 (0.0010) [2023-12-26 06:36:17,097][123091] Updated weights for policy 0, policy_version 878672 (0.0005) [2023-12-26 06:36:17,103][123090] Updated weights for policy 1, policy_version 872437 (0.0010) [2023-12-26 06:36:17,168][123090] Updated weights for policy 1, policy_version 872447 (0.0010) [2023-12-26 06:36:17,820][123091] Updated weights for policy 0, policy_version 878682 (0.0010) [2023-12-26 06:36:17,877][123090] Updated weights for policy 1, policy_version 872457 (0.0006) [2023-12-26 06:36:17,878][123091] Updated weights for policy 0, policy_version 878692 (0.0010) [2023-12-26 06:36:17,933][123091] Updated weights for policy 0, policy_version 878702 (0.0010) [2023-12-26 06:36:17,942][123090] Updated weights for policy 1, policy_version 872467 (0.0009) [2023-12-26 06:36:18,003][123090] Updated weights for policy 1, policy_version 872477 (0.0009) [2023-12-26 06:36:18,725][123090] Updated weights for policy 1, policy_version 872487 (0.0006) [2023-12-26 06:36:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 448307200. Throughput: 0: 8764.3, 1: 8950.2. Samples: 448326024. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:18,785][121949] Avg episode reward: [(0, '5991.186'), (1, '5941.622')] [2023-12-26 06:36:18,796][123090] Updated weights for policy 1, policy_version 872497 (0.0005) [2023-12-26 06:36:18,815][123091] Updated weights for policy 0, policy_version 878712 (0.0009) [2023-12-26 06:36:18,858][123090] Updated weights for policy 1, policy_version 872507 (0.0005) [2023-12-26 06:36:18,865][123091] Updated weights for policy 0, policy_version 878722 (0.0009) [2023-12-26 06:36:18,918][123091] Updated weights for policy 0, policy_version 878732 (0.0009) [2023-12-26 06:36:19,580][123090] Updated weights for policy 1, policy_version 872517 (0.0008) [2023-12-26 06:36:19,648][123090] Updated weights for policy 1, policy_version 872527 (0.0011) [2023-12-26 06:36:19,720][123090] Updated weights for policy 1, policy_version 872537 (0.0011) [2023-12-26 06:36:19,859][123091] Updated weights for policy 0, policy_version 878742 (0.0010) [2023-12-26 06:36:19,929][123091] Updated weights for policy 0, policy_version 878752 (0.0009) [2023-12-26 06:36:19,998][123091] Updated weights for policy 0, policy_version 878762 (0.0009) [2023-12-26 06:36:20,597][123090] Updated weights for policy 1, policy_version 872547 (0.0010) [2023-12-26 06:36:20,665][123090] Updated weights for policy 1, policy_version 872557 (0.0007) [2023-12-26 06:36:20,726][123090] Updated weights for policy 1, policy_version 872567 (0.0008) [2023-12-26 06:36:20,840][123091] Updated weights for policy 0, policy_version 878772 (0.0010) [2023-12-26 06:36:20,903][123091] Updated weights for policy 0, policy_version 878782 (0.0011) [2023-12-26 06:36:20,957][123091] Updated weights for policy 0, policy_version 878792 (0.0011) [2023-12-26 06:36:21,551][123090] Updated weights for policy 1, policy_version 872577 (0.0008) [2023-12-26 06:36:21,626][123090] Updated weights for policy 1, policy_version 872587 (0.0009) [2023-12-26 06:36:21,691][123090] Updated weights for policy 1, policy_version 872597 (0.0009) [2023-12-26 06:36:21,759][123090] Updated weights for policy 1, policy_version 872607 (0.0010) [2023-12-26 06:36:21,767][123091] Updated weights for policy 0, policy_version 878802 (0.0010) [2023-12-26 06:36:21,819][123091] Updated weights for policy 0, policy_version 878812 (0.0008) [2023-12-26 06:36:21,872][123091] Updated weights for policy 0, policy_version 878822 (0.0008) [2023-12-26 06:36:21,918][123091] Updated weights for policy 0, policy_version 878832 (0.0005) [2023-12-26 06:36:22,610][123090] Updated weights for policy 1, policy_version 872617 (0.0006) [2023-12-26 06:36:22,672][123090] Updated weights for policy 1, policy_version 872627 (0.0005) [2023-12-26 06:36:22,736][123090] Updated weights for policy 1, policy_version 872637 (0.0006) [2023-12-26 06:36:22,743][123091] Updated weights for policy 0, policy_version 878842 (0.0011) [2023-12-26 06:36:22,810][123091] Updated weights for policy 0, policy_version 878852 (0.0011) [2023-12-26 06:36:22,874][123091] Updated weights for policy 0, policy_version 878862 (0.0011) [2023-12-26 06:36:23,293][123090] Updated weights for policy 1, policy_version 872647 (0.0006) [2023-12-26 06:36:23,353][123090] Updated weights for policy 1, policy_version 872657 (0.0005) [2023-12-26 06:36:23,403][123090] Updated weights for policy 1, policy_version 872667 (0.0005) [2023-12-26 06:36:23,713][123091] Updated weights for policy 0, policy_version 878872 (0.0011) [2023-12-26 06:36:23,776][123091] Updated weights for policy 0, policy_version 878882 (0.0011) [2023-12-26 06:36:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 448397312. Throughput: 0: 8714.0, 1: 8898.5. Samples: 448376156. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:23,785][121949] Avg episode reward: [(0, '5954.777'), (1, '5897.920')] [2023-12-26 06:36:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000872672_223404032.pth... [2023-12-26 06:36:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000871616_223133696.pth [2023-12-26 06:36:23,842][123091] Updated weights for policy 0, policy_version 878892 (0.0011) [2023-12-26 06:36:23,864][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000878896_225001472.pth... [2023-12-26 06:36:23,868][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000877872_224739328.pth [2023-12-26 06:36:24,163][123090] Updated weights for policy 1, policy_version 872677 (0.0008) [2023-12-26 06:36:24,233][123090] Updated weights for policy 1, policy_version 872687 (0.0011) [2023-12-26 06:36:24,296][123090] Updated weights for policy 1, policy_version 872697 (0.0011) [2023-12-26 06:36:24,620][123091] Updated weights for policy 0, policy_version 878903 (0.0011) [2023-12-26 06:36:24,671][123091] Updated weights for policy 0, policy_version 878913 (0.0009) [2023-12-26 06:36:24,719][123091] Updated weights for policy 0, policy_version 878923 (0.0008) [2023-12-26 06:36:25,122][123090] Updated weights for policy 1, policy_version 872707 (0.0010) [2023-12-26 06:36:25,173][123090] Updated weights for policy 1, policy_version 872717 (0.0010) [2023-12-26 06:36:25,224][123090] Updated weights for policy 1, policy_version 872727 (0.0010) [2023-12-26 06:36:25,454][123091] Updated weights for policy 0, policy_version 878933 (0.0005) [2023-12-26 06:36:25,507][123091] Updated weights for policy 0, policy_version 878943 (0.0005) [2023-12-26 06:36:25,560][123091] Updated weights for policy 0, policy_version 878953 (0.0005) [2023-12-26 06:36:26,051][123090] Updated weights for policy 1, policy_version 872737 (0.0010) [2023-12-26 06:36:26,118][123090] Updated weights for policy 1, policy_version 872747 (0.0011) [2023-12-26 06:36:26,181][123090] Updated weights for policy 1, policy_version 872757 (0.0010) [2023-12-26 06:36:26,200][123091] Updated weights for policy 0, policy_version 878963 (0.0005) [2023-12-26 06:36:26,243][123090] Updated weights for policy 1, policy_version 872767 (0.0010) [2023-12-26 06:36:26,256][123091] Updated weights for policy 0, policy_version 878973 (0.0009) [2023-12-26 06:36:26,312][123091] Updated weights for policy 0, policy_version 878983 (0.0009) [2023-12-26 06:36:27,011][123090] Updated weights for policy 1, policy_version 872777 (0.0006) [2023-12-26 06:36:27,067][123090] Updated weights for policy 1, policy_version 872787 (0.0005) [2023-12-26 06:36:27,121][123090] Updated weights for policy 1, policy_version 872797 (0.0005) [2023-12-26 06:36:27,174][123091] Updated weights for policy 0, policy_version 878993 (0.0009) [2023-12-26 06:36:27,236][123091] Updated weights for policy 0, policy_version 879003 (0.0009) [2023-12-26 06:36:27,292][123091] Updated weights for policy 0, policy_version 879014 (0.0010) [2023-12-26 06:36:27,356][123091] Updated weights for policy 0, policy_version 879024 (0.0009) [2023-12-26 06:36:27,821][123090] Updated weights for policy 1, policy_version 872807 (0.0005) [2023-12-26 06:36:27,873][123090] Updated weights for policy 1, policy_version 872817 (0.0005) [2023-12-26 06:36:27,925][123090] Updated weights for policy 1, policy_version 872827 (0.0005) [2023-12-26 06:36:28,062][123091] Updated weights for policy 0, policy_version 879034 (0.0009) [2023-12-26 06:36:28,123][123091] Updated weights for policy 0, policy_version 879044 (0.0009) [2023-12-26 06:36:28,179][123091] Updated weights for policy 0, policy_version 879054 (0.0009) [2023-12-26 06:36:28,598][123090] Updated weights for policy 1, policy_version 872837 (0.0007) [2023-12-26 06:36:28,660][123090] Updated weights for policy 1, policy_version 872847 (0.0009) [2023-12-26 06:36:28,719][123090] Updated weights for policy 1, policy_version 872857 (0.0010) [2023-12-26 06:36:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 448495616. Throughput: 0: 8814.1, 1: 8948.5. Samples: 448485524. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:28,785][121949] Avg episode reward: [(0, '6127.038'), (1, '5874.346')] [2023-12-26 06:36:28,959][123091] Updated weights for policy 0, policy_version 879064 (0.0010) [2023-12-26 06:36:29,019][123091] Updated weights for policy 0, policy_version 879074 (0.0010) [2023-12-26 06:36:29,074][123091] Updated weights for policy 0, policy_version 879084 (0.0009) [2023-12-26 06:36:29,596][123090] Updated weights for policy 1, policy_version 872867 (0.0010) [2023-12-26 06:36:29,663][123090] Updated weights for policy 1, policy_version 872877 (0.0011) [2023-12-26 06:36:29,734][123090] Updated weights for policy 1, policy_version 872887 (0.0011) [2023-12-26 06:36:29,872][123091] Updated weights for policy 0, policy_version 879094 (0.0008) [2023-12-26 06:36:29,935][123091] Updated weights for policy 0, policy_version 879104 (0.0006) [2023-12-26 06:36:29,997][123091] Updated weights for policy 0, policy_version 879114 (0.0008) [2023-12-26 06:36:30,555][123090] Updated weights for policy 1, policy_version 872897 (0.0010) [2023-12-26 06:36:30,607][123090] Updated weights for policy 1, policy_version 872907 (0.0010) [2023-12-26 06:36:30,654][123090] Updated weights for policy 1, policy_version 872917 (0.0010) [2023-12-26 06:36:30,698][123090] Updated weights for policy 1, policy_version 872927 (0.0010) [2023-12-26 06:36:30,750][123091] Updated weights for policy 0, policy_version 879124 (0.0007) [2023-12-26 06:36:30,820][123091] Updated weights for policy 0, policy_version 879134 (0.0006) [2023-12-26 06:36:30,880][123091] Updated weights for policy 0, policy_version 879144 (0.0005) [2023-12-26 06:36:31,526][123090] Updated weights for policy 1, policy_version 872937 (0.0008) [2023-12-26 06:36:31,582][123090] Updated weights for policy 1, policy_version 872947 (0.0010) [2023-12-26 06:36:31,583][123091] Updated weights for policy 0, policy_version 879154 (0.0005) [2023-12-26 06:36:31,649][123090] Updated weights for policy 1, policy_version 872957 (0.0011) [2023-12-26 06:36:31,650][123091] Updated weights for policy 0, policy_version 879164 (0.0008) [2023-12-26 06:36:31,717][123091] Updated weights for policy 0, policy_version 879174 (0.0010) [2023-12-26 06:36:31,768][123091] Updated weights for policy 0, policy_version 879184 (0.0009) [2023-12-26 06:36:32,407][123090] Updated weights for policy 1, policy_version 872967 (0.0010) [2023-12-26 06:36:32,459][123090] Updated weights for policy 1, policy_version 872977 (0.0010) [2023-12-26 06:36:32,516][123090] Updated weights for policy 1, policy_version 872987 (0.0011) [2023-12-26 06:36:32,634][123091] Updated weights for policy 0, policy_version 879194 (0.0009) [2023-12-26 06:36:32,680][123091] Updated weights for policy 0, policy_version 879204 (0.0007) [2023-12-26 06:36:32,736][123091] Updated weights for policy 0, policy_version 879214 (0.0007) [2023-12-26 06:36:33,356][123090] Updated weights for policy 1, policy_version 872997 (0.0008) [2023-12-26 06:36:33,419][123090] Updated weights for policy 1, policy_version 873007 (0.0005) [2023-12-26 06:36:33,466][123090] Updated weights for policy 1, policy_version 873017 (0.0005) [2023-12-26 06:36:33,489][123091] Updated weights for policy 0, policy_version 879224 (0.0009) [2023-12-26 06:36:33,545][123091] Updated weights for policy 0, policy_version 879234 (0.0010) [2023-12-26 06:36:33,603][123091] Updated weights for policy 0, policy_version 879244 (0.0010) [2023-12-26 06:36:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 448585728. Throughput: 0: 8857.8, 1: 8999.0. Samples: 448594616. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:33,785][121949] Avg episode reward: [(0, '6154.462'), (1, '5880.808')] [2023-12-26 06:36:33,979][123090] Updated weights for policy 1, policy_version 873027 (0.0005) [2023-12-26 06:36:34,027][123090] Updated weights for policy 1, policy_version 873037 (0.0005) [2023-12-26 06:36:34,073][123090] Updated weights for policy 1, policy_version 873047 (0.0005) [2023-12-26 06:36:34,446][123091] Updated weights for policy 0, policy_version 879254 (0.0007) [2023-12-26 06:36:34,512][123091] Updated weights for policy 0, policy_version 879264 (0.0005) [2023-12-26 06:36:34,570][123091] Updated weights for policy 0, policy_version 879274 (0.0006) [2023-12-26 06:36:34,931][123090] Updated weights for policy 1, policy_version 873057 (0.0007) [2023-12-26 06:36:34,999][123090] Updated weights for policy 1, policy_version 873067 (0.0009) [2023-12-26 06:36:35,067][123090] Updated weights for policy 1, policy_version 873077 (0.0009) [2023-12-26 06:36:35,127][123090] Updated weights for policy 1, policy_version 873087 (0.0009) [2023-12-26 06:36:35,252][123091] Updated weights for policy 0, policy_version 879284 (0.0007) [2023-12-26 06:36:35,311][123091] Updated weights for policy 0, policy_version 879294 (0.0008) [2023-12-26 06:36:35,363][123091] Updated weights for policy 0, policy_version 879304 (0.0011) [2023-12-26 06:36:36,007][123090] Updated weights for policy 1, policy_version 873097 (0.0010) [2023-12-26 06:36:36,081][123090] Updated weights for policy 1, policy_version 873107 (0.0010) [2023-12-26 06:36:36,084][123091] Updated weights for policy 0, policy_version 879314 (0.0007) [2023-12-26 06:36:36,149][123090] Updated weights for policy 1, policy_version 873117 (0.0010) [2023-12-26 06:36:36,154][123091] Updated weights for policy 0, policy_version 879324 (0.0008) [2023-12-26 06:36:36,221][123091] Updated weights for policy 0, policy_version 879334 (0.0009) [2023-12-26 06:36:36,285][123091] Updated weights for policy 0, policy_version 879344 (0.0009) [2023-12-26 06:36:36,972][123090] Updated weights for policy 1, policy_version 873127 (0.0011) [2023-12-26 06:36:37,026][123091] Updated weights for policy 0, policy_version 879354 (0.0006) [2023-12-26 06:36:37,032][123090] Updated weights for policy 1, policy_version 873137 (0.0010) [2023-12-26 06:36:37,078][123091] Updated weights for policy 0, policy_version 879364 (0.0005) [2023-12-26 06:36:37,080][123090] Updated weights for policy 1, policy_version 873147 (0.0010) [2023-12-26 06:36:37,128][123091] Updated weights for policy 0, policy_version 879374 (0.0007) [2023-12-26 06:36:37,856][123091] Updated weights for policy 0, policy_version 879384 (0.0006) [2023-12-26 06:36:37,910][123091] Updated weights for policy 0, policy_version 879394 (0.0007) [2023-12-26 06:36:37,922][123090] Updated weights for policy 1, policy_version 873157 (0.0010) [2023-12-26 06:36:37,971][123091] Updated weights for policy 0, policy_version 879404 (0.0007) [2023-12-26 06:36:37,989][123090] Updated weights for policy 1, policy_version 873167 (0.0010) [2023-12-26 06:36:38,061][123090] Updated weights for policy 1, policy_version 873177 (0.0010) [2023-12-26 06:36:38,697][123091] Updated weights for policy 0, policy_version 879414 (0.0010) [2023-12-26 06:36:38,745][123091] Updated weights for policy 0, policy_version 879424 (0.0010) [2023-12-26 06:36:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 448667648. Throughput: 0: 8894.7, 1: 9006.5. Samples: 448648696. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:38,785][121949] Avg episode reward: [(0, '6211.784'), (1, '5868.820')] [2023-12-26 06:36:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000873184_223535104.pth... [2023-12-26 06:36:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000872160_223272960.pth [2023-12-26 06:36:38,796][123091] Updated weights for policy 0, policy_version 879434 (0.0010) [2023-12-26 06:36:38,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000879440_225140736.pth... [2023-12-26 06:36:38,834][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000878384_224870400.pth [2023-12-26 06:36:38,880][123090] Updated weights for policy 1, policy_version 873187 (0.0010) [2023-12-26 06:36:38,941][123090] Updated weights for policy 1, policy_version 873197 (0.0010) [2023-12-26 06:36:38,996][123090] Updated weights for policy 1, policy_version 873207 (0.0010) [2023-12-26 06:36:39,662][123091] Updated weights for policy 0, policy_version 879444 (0.0010) [2023-12-26 06:36:39,724][123091] Updated weights for policy 0, policy_version 879454 (0.0008) [2023-12-26 06:36:39,793][123091] Updated weights for policy 0, policy_version 879464 (0.0006) [2023-12-26 06:36:39,864][123090] Updated weights for policy 1, policy_version 873217 (0.0010) [2023-12-26 06:36:39,931][123090] Updated weights for policy 1, policy_version 873227 (0.0010) [2023-12-26 06:36:39,997][123090] Updated weights for policy 1, policy_version 873237 (0.0011) [2023-12-26 06:36:40,065][123090] Updated weights for policy 1, policy_version 873247 (0.0011) [2023-12-26 06:36:40,609][123091] Updated weights for policy 0, policy_version 879474 (0.0009) [2023-12-26 06:36:40,687][123091] Updated weights for policy 0, policy_version 879484 (0.0006) [2023-12-26 06:36:40,763][123091] Updated weights for policy 0, policy_version 879494 (0.0009) [2023-12-26 06:36:40,806][123090] Updated weights for policy 1, policy_version 873257 (0.0007) [2023-12-26 06:36:40,832][123091] Updated weights for policy 0, policy_version 879504 (0.0008) [2023-12-26 06:36:40,868][123090] Updated weights for policy 1, policy_version 873267 (0.0006) [2023-12-26 06:36:40,933][123090] Updated weights for policy 1, policy_version 873277 (0.0006) [2023-12-26 06:36:41,582][123091] Updated weights for policy 0, policy_version 879514 (0.0010) [2023-12-26 06:36:41,648][123091] Updated weights for policy 0, policy_version 879524 (0.0011) [2023-12-26 06:36:41,706][123091] Updated weights for policy 0, policy_version 879534 (0.0008) [2023-12-26 06:36:41,732][123090] Updated weights for policy 1, policy_version 873287 (0.0011) [2023-12-26 06:36:41,802][123090] Updated weights for policy 1, policy_version 873297 (0.0009) [2023-12-26 06:36:41,861][123090] Updated weights for policy 1, policy_version 873307 (0.0009) [2023-12-26 06:36:42,480][123091] Updated weights for policy 0, policy_version 879544 (0.0006) [2023-12-26 06:36:42,542][123091] Updated weights for policy 0, policy_version 879554 (0.0005) [2023-12-26 06:36:42,597][123091] Updated weights for policy 0, policy_version 879564 (0.0007) [2023-12-26 06:36:42,764][123090] Updated weights for policy 1, policy_version 873317 (0.0010) [2023-12-26 06:36:42,846][123090] Updated weights for policy 1, policy_version 873327 (0.0011) [2023-12-26 06:36:42,909][123090] Updated weights for policy 1, policy_version 873337 (0.0011) [2023-12-26 06:36:43,384][123091] Updated weights for policy 0, policy_version 879574 (0.0009) [2023-12-26 06:36:43,435][123091] Updated weights for policy 0, policy_version 879584 (0.0009) [2023-12-26 06:36:43,483][123091] Updated weights for policy 0, policy_version 879594 (0.0008) [2023-12-26 06:36:43,719][123090] Updated weights for policy 1, policy_version 873347 (0.0011) [2023-12-26 06:36:43,766][123090] Updated weights for policy 1, policy_version 873357 (0.0010) [2023-12-26 06:36:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 448757760. Throughput: 0: 8888.4, 1: 8956.0. Samples: 448754516. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:43,785][121949] Avg episode reward: [(0, '6260.973'), (1, '5906.851')] [2023-12-26 06:36:43,814][123090] Updated weights for policy 1, policy_version 873367 (0.0010) [2023-12-26 06:36:44,325][123091] Updated weights for policy 0, policy_version 879604 (0.0009) [2023-12-26 06:36:44,384][123091] Updated weights for policy 0, policy_version 879614 (0.0009) [2023-12-26 06:36:44,449][123091] Updated weights for policy 0, policy_version 879624 (0.0009) [2023-12-26 06:36:44,673][123090] Updated weights for policy 1, policy_version 873377 (0.0010) [2023-12-26 06:36:44,738][123090] Updated weights for policy 1, policy_version 873387 (0.0011) [2023-12-26 06:36:44,813][123090] Updated weights for policy 1, policy_version 873397 (0.0009) [2023-12-26 06:36:44,880][123090] Updated weights for policy 1, policy_version 873407 (0.0008) [2023-12-26 06:36:45,265][123091] Updated weights for policy 0, policy_version 879634 (0.0009) [2023-12-26 06:36:45,323][123091] Updated weights for policy 0, policy_version 879644 (0.0009) [2023-12-26 06:36:45,384][123091] Updated weights for policy 0, policy_version 879654 (0.0009) [2023-12-26 06:36:45,445][123091] Updated weights for policy 0, policy_version 879664 (0.0009) [2023-12-26 06:36:45,726][123090] Updated weights for policy 1, policy_version 873417 (0.0011) [2023-12-26 06:36:45,782][123090] Updated weights for policy 1, policy_version 873427 (0.0011) [2023-12-26 06:36:45,834][123090] Updated weights for policy 1, policy_version 873437 (0.0010) [2023-12-26 06:36:46,273][123091] Updated weights for policy 0, policy_version 879674 (0.0009) [2023-12-26 06:36:46,321][123091] Updated weights for policy 0, policy_version 879684 (0.0009) [2023-12-26 06:36:46,368][123091] Updated weights for policy 0, policy_version 879694 (0.0008) [2023-12-26 06:36:46,673][123090] Updated weights for policy 1, policy_version 873447 (0.0010) [2023-12-26 06:36:46,729][123090] Updated weights for policy 1, policy_version 873457 (0.0010) [2023-12-26 06:36:46,788][123090] Updated weights for policy 1, policy_version 873467 (0.0010) [2023-12-26 06:36:47,014][123091] Updated weights for policy 0, policy_version 879704 (0.0006) [2023-12-26 06:36:47,069][123091] Updated weights for policy 0, policy_version 879714 (0.0005) [2023-12-26 06:36:47,123][123091] Updated weights for policy 0, policy_version 879724 (0.0006) [2023-12-26 06:36:47,577][123090] Updated weights for policy 1, policy_version 873477 (0.0008) [2023-12-26 06:36:47,650][123090] Updated weights for policy 1, policy_version 873487 (0.0005) [2023-12-26 06:36:47,715][123090] Updated weights for policy 1, policy_version 873497 (0.0006) [2023-12-26 06:36:47,920][123091] Updated weights for policy 0, policy_version 879734 (0.0010) [2023-12-26 06:36:47,978][123091] Updated weights for policy 0, policy_version 879744 (0.0010) [2023-12-26 06:36:48,051][123091] Updated weights for policy 0, policy_version 879754 (0.0010) [2023-12-26 06:36:48,469][123090] Updated weights for policy 1, policy_version 873507 (0.0007) [2023-12-26 06:36:48,534][123090] Updated weights for policy 1, policy_version 873517 (0.0006) [2023-12-26 06:36:48,599][123090] Updated weights for policy 1, policy_version 873527 (0.0009) [2023-12-26 06:36:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 448847872. Throughput: 0: 8934.1, 1: 8877.8. Samples: 448858912. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:48,785][121949] Avg episode reward: [(0, '6262.926'), (1, '5719.857')] [2023-12-26 06:36:48,865][123091] Updated weights for policy 0, policy_version 879764 (0.0008) [2023-12-26 06:36:48,919][123091] Updated weights for policy 0, policy_version 879774 (0.0005) [2023-12-26 06:36:48,974][123091] Updated weights for policy 0, policy_version 879784 (0.0005) [2023-12-26 06:36:49,441][123090] Updated weights for policy 1, policy_version 873537 (0.0007) [2023-12-26 06:36:49,506][123090] Updated weights for policy 1, policy_version 873547 (0.0008) [2023-12-26 06:36:49,562][123090] Updated weights for policy 1, policy_version 873557 (0.0009) [2023-12-26 06:36:49,615][123090] Updated weights for policy 1, policy_version 873567 (0.0009) [2023-12-26 06:36:49,836][123091] Updated weights for policy 0, policy_version 879794 (0.0007) [2023-12-26 06:36:49,895][123091] Updated weights for policy 0, policy_version 879804 (0.0011) [2023-12-26 06:36:49,963][123091] Updated weights for policy 0, policy_version 879814 (0.0008) [2023-12-26 06:36:50,031][123091] Updated weights for policy 0, policy_version 879824 (0.0006) [2023-12-26 06:36:50,489][123090] Updated weights for policy 1, policy_version 873577 (0.0009) [2023-12-26 06:36:50,558][123090] Updated weights for policy 1, policy_version 873587 (0.0009) [2023-12-26 06:36:50,634][123090] Updated weights for policy 1, policy_version 873597 (0.0008) [2023-12-26 06:36:50,834][123091] Updated weights for policy 0, policy_version 879834 (0.0008) [2023-12-26 06:36:50,897][123091] Updated weights for policy 0, policy_version 879844 (0.0008) [2023-12-26 06:36:50,964][123091] Updated weights for policy 0, policy_version 879854 (0.0008) [2023-12-26 06:36:51,477][123090] Updated weights for policy 1, policy_version 873607 (0.0007) [2023-12-26 06:36:51,534][123090] Updated weights for policy 1, policy_version 873617 (0.0005) [2023-12-26 06:36:51,592][123090] Updated weights for policy 1, policy_version 873627 (0.0005) [2023-12-26 06:36:51,812][123091] Updated weights for policy 0, policy_version 879864 (0.0010) [2023-12-26 06:36:51,868][123091] Updated weights for policy 0, policy_version 879874 (0.0010) [2023-12-26 06:36:51,938][123091] Updated weights for policy 0, policy_version 879884 (0.0009) [2023-12-26 06:36:52,359][123090] Updated weights for policy 1, policy_version 873637 (0.0008) [2023-12-26 06:36:52,426][123090] Updated weights for policy 1, policy_version 873647 (0.0008) [2023-12-26 06:36:52,486][123090] Updated weights for policy 1, policy_version 873657 (0.0008) [2023-12-26 06:36:52,846][123091] Updated weights for policy 0, policy_version 879894 (0.0010) [2023-12-26 06:36:52,912][123091] Updated weights for policy 0, policy_version 879904 (0.0009) [2023-12-26 06:36:52,973][123091] Updated weights for policy 0, policy_version 879914 (0.0010) [2023-12-26 06:36:53,159][123090] Updated weights for policy 1, policy_version 873667 (0.0008) [2023-12-26 06:36:53,222][123090] Updated weights for policy 1, policy_version 873677 (0.0009) [2023-12-26 06:36:53,283][123090] Updated weights for policy 1, policy_version 873687 (0.0009) [2023-12-26 06:36:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 448929792. Throughput: 0: 8924.2, 1: 8800.2. Samples: 448909500. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:53,785][121949] Avg episode reward: [(0, '6255.534'), (1, '5679.937')] [2023-12-26 06:36:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000873696_223666176.pth... [2023-12-26 06:36:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000872672_223404032.pth [2023-12-26 06:36:53,817][123091] Updated weights for policy 0, policy_version 879924 (0.0009) [2023-12-26 06:36:53,870][123091] Updated weights for policy 0, policy_version 879934 (0.0009) [2023-12-26 06:36:53,924][123091] Updated weights for policy 0, policy_version 879944 (0.0005) [2023-12-26 06:36:53,963][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000879952_225271808.pth... [2023-12-26 06:36:53,966][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000878896_225001472.pth [2023-12-26 06:36:54,082][123090] Updated weights for policy 1, policy_version 873697 (0.0009) [2023-12-26 06:36:54,144][123090] Updated weights for policy 1, policy_version 873707 (0.0009) [2023-12-26 06:36:54,211][123090] Updated weights for policy 1, policy_version 873717 (0.0010) [2023-12-26 06:36:54,285][123090] Updated weights for policy 1, policy_version 873727 (0.0008) [2023-12-26 06:36:54,670][123091] Updated weights for policy 0, policy_version 879954 (0.0006) [2023-12-26 06:36:54,729][123091] Updated weights for policy 0, policy_version 879964 (0.0009) [2023-12-26 06:36:54,783][123091] Updated weights for policy 0, policy_version 879974 (0.0009) [2023-12-26 06:36:54,838][123091] Updated weights for policy 0, policy_version 879984 (0.0009) [2023-12-26 06:36:55,092][123090] Updated weights for policy 1, policy_version 873737 (0.0006) [2023-12-26 06:36:55,161][123090] Updated weights for policy 1, policy_version 873747 (0.0006) [2023-12-26 06:36:55,235][123090] Updated weights for policy 1, policy_version 873757 (0.0006) [2023-12-26 06:36:55,731][123091] Updated weights for policy 0, policy_version 879994 (0.0009) [2023-12-26 06:36:55,795][123091] Updated weights for policy 0, policy_version 880005 (0.0009) [2023-12-26 06:36:55,847][123091] Updated weights for policy 0, policy_version 880015 (0.0008) [2023-12-26 06:36:55,853][123090] Updated weights for policy 1, policy_version 873767 (0.0008) [2023-12-26 06:36:55,915][123090] Updated weights for policy 1, policy_version 873777 (0.0009) [2023-12-26 06:36:55,966][123090] Updated weights for policy 1, policy_version 873787 (0.0009) [2023-12-26 06:36:56,686][123091] Updated weights for policy 0, policy_version 880025 (0.0009) [2023-12-26 06:36:56,734][123091] Updated weights for policy 0, policy_version 880036 (0.0008) [2023-12-26 06:36:56,740][123090] Updated weights for policy 1, policy_version 873797 (0.0010) [2023-12-26 06:36:56,782][123091] Updated weights for policy 0, policy_version 880046 (0.0008) [2023-12-26 06:36:56,793][123090] Updated weights for policy 1, policy_version 873807 (0.0007) [2023-12-26 06:36:56,844][123090] Updated weights for policy 1, policy_version 873817 (0.0009) [2023-12-26 06:36:57,638][123090] Updated weights for policy 1, policy_version 873827 (0.0007) [2023-12-26 06:36:57,664][123091] Updated weights for policy 0, policy_version 880056 (0.0010) [2023-12-26 06:36:57,693][123090] Updated weights for policy 1, policy_version 873837 (0.0010) [2023-12-26 06:36:57,723][123091] Updated weights for policy 0, policy_version 880066 (0.0011) [2023-12-26 06:36:57,755][123090] Updated weights for policy 1, policy_version 873847 (0.0010) [2023-12-26 06:36:57,777][123091] Updated weights for policy 0, policy_version 880076 (0.0010) [2023-12-26 06:36:58,568][123090] Updated weights for policy 1, policy_version 873857 (0.0010) [2023-12-26 06:36:58,624][123091] Updated weights for policy 0, policy_version 880086 (0.0010) [2023-12-26 06:36:58,631][123090] Updated weights for policy 1, policy_version 873867 (0.0010) [2023-12-26 06:36:58,695][123091] Updated weights for policy 0, policy_version 880096 (0.0009) [2023-12-26 06:36:58,703][123090] Updated weights for policy 1, policy_version 873877 (0.0009) [2023-12-26 06:36:58,763][123091] Updated weights for policy 0, policy_version 880106 (0.0010) [2023-12-26 06:36:58,784][123090] Updated weights for policy 1, policy_version 873887 (0.0010) [2023-12-26 06:36:58,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 449011712. Throughput: 0: 8904.0, 1: 8893.7. Samples: 449015612. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:36:58,785][121949] Avg episode reward: [(0, '6175.061'), (1, '5753.201')] [2023-12-26 06:36:59,608][123090] Updated weights for policy 1, policy_version 873897 (0.0006) [2023-12-26 06:36:59,657][123091] Updated weights for policy 0, policy_version 880116 (0.0007) [2023-12-26 06:36:59,677][123090] Updated weights for policy 1, policy_version 873907 (0.0005) [2023-12-26 06:36:59,711][123091] Updated weights for policy 0, policy_version 880126 (0.0005) [2023-12-26 06:36:59,748][123090] Updated weights for policy 1, policy_version 873917 (0.0006) [2023-12-26 06:36:59,767][123091] Updated weights for policy 0, policy_version 880136 (0.0006) [2023-12-26 06:37:00,472][123090] Updated weights for policy 1, policy_version 873927 (0.0009) [2023-12-26 06:37:00,503][123091] Updated weights for policy 0, policy_version 880146 (0.0007) [2023-12-26 06:37:00,531][123090] Updated weights for policy 1, policy_version 873937 (0.0010) [2023-12-26 06:37:00,551][123091] Updated weights for policy 0, policy_version 880156 (0.0006) [2023-12-26 06:37:00,595][123090] Updated weights for policy 1, policy_version 873947 (0.0009) [2023-12-26 06:37:00,616][123091] Updated weights for policy 0, policy_version 880166 (0.0006) [2023-12-26 06:37:00,681][123091] Updated weights for policy 0, policy_version 880176 (0.0008) [2023-12-26 06:37:01,437][123091] Updated weights for policy 0, policy_version 880186 (0.0009) [2023-12-26 06:37:01,468][123090] Updated weights for policy 1, policy_version 873957 (0.0008) [2023-12-26 06:37:01,484][123091] Updated weights for policy 0, policy_version 880196 (0.0008) [2023-12-26 06:37:01,527][123090] Updated weights for policy 1, policy_version 873967 (0.0008) [2023-12-26 06:37:01,533][123091] Updated weights for policy 0, policy_version 880206 (0.0008) [2023-12-26 06:37:01,582][123090] Updated weights for policy 1, policy_version 873978 (0.0009) [2023-12-26 06:37:02,409][123090] Updated weights for policy 1, policy_version 873988 (0.0008) [2023-12-26 06:37:02,424][123091] Updated weights for policy 0, policy_version 880216 (0.0010) [2023-12-26 06:37:02,468][123090] Updated weights for policy 1, policy_version 873998 (0.0006) [2023-12-26 06:37:02,490][123091] Updated weights for policy 0, policy_version 880226 (0.0009) [2023-12-26 06:37:02,519][123090] Updated weights for policy 1, policy_version 874008 (0.0007) [2023-12-26 06:37:02,554][123091] Updated weights for policy 0, policy_version 880236 (0.0009) [2023-12-26 06:37:03,161][123090] Updated weights for policy 1, policy_version 874018 (0.0007) [2023-12-26 06:37:03,226][123090] Updated weights for policy 1, policy_version 874028 (0.0005) [2023-12-26 06:37:03,298][123090] Updated weights for policy 1, policy_version 874038 (0.0005) [2023-12-26 06:37:03,317][123091] Updated weights for policy 0, policy_version 880246 (0.0010) [2023-12-26 06:37:03,362][123090] Updated weights for policy 1, policy_version 874048 (0.0006) [2023-12-26 06:37:03,380][123091] Updated weights for policy 0, policy_version 880256 (0.0011) [2023-12-26 06:37:03,449][123091] Updated weights for policy 0, policy_version 880266 (0.0010) [2023-12-26 06:37:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 449110016. Throughput: 0: 8828.9, 1: 8833.5. Samples: 449120832. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:03,784][121949] Avg episode reward: [(0, '6048.241'), (1, '5770.723')] [2023-12-26 06:37:04,083][123090] Updated weights for policy 1, policy_version 874058 (0.0009) [2023-12-26 06:37:04,142][123090] Updated weights for policy 1, policy_version 874068 (0.0010) [2023-12-26 06:37:04,203][123090] Updated weights for policy 1, policy_version 874078 (0.0010) [2023-12-26 06:37:04,259][123091] Updated weights for policy 0, policy_version 880276 (0.0008) [2023-12-26 06:37:04,336][123091] Updated weights for policy 0, policy_version 880286 (0.0006) [2023-12-26 06:37:04,404][123091] Updated weights for policy 0, policy_version 880296 (0.0006) [2023-12-26 06:37:05,051][123090] Updated weights for policy 1, policy_version 874088 (0.0010) [2023-12-26 06:37:05,108][123091] Updated weights for policy 0, policy_version 880306 (0.0007) [2023-12-26 06:37:05,114][123090] Updated weights for policy 1, policy_version 874098 (0.0010) [2023-12-26 06:37:05,159][123091] Updated weights for policy 0, policy_version 880316 (0.0010) [2023-12-26 06:37:05,168][123090] Updated weights for policy 1, policy_version 874108 (0.0010) [2023-12-26 06:37:05,206][123091] Updated weights for policy 0, policy_version 880326 (0.0010) [2023-12-26 06:37:05,271][123091] Updated weights for policy 0, policy_version 880336 (0.0009) [2023-12-26 06:37:06,006][123090] Updated weights for policy 1, policy_version 874118 (0.0010) [2023-12-26 06:37:06,066][123090] Updated weights for policy 1, policy_version 874128 (0.0010) [2023-12-26 06:37:06,126][123091] Updated weights for policy 0, policy_version 880346 (0.0008) [2023-12-26 06:37:06,134][123090] Updated weights for policy 1, policy_version 874138 (0.0011) [2023-12-26 06:37:06,188][123091] Updated weights for policy 0, policy_version 880356 (0.0007) [2023-12-26 06:37:06,250][123091] Updated weights for policy 0, policy_version 880366 (0.0009) [2023-12-26 06:37:06,966][123090] Updated weights for policy 1, policy_version 874148 (0.0013) [2023-12-26 06:37:07,017][123090] Updated weights for policy 1, policy_version 874158 (0.0010) [2023-12-26 06:37:07,028][123091] Updated weights for policy 0, policy_version 880376 (0.0007) [2023-12-26 06:37:07,069][123090] Updated weights for policy 1, policy_version 874168 (0.0010) [2023-12-26 06:37:07,084][123091] Updated weights for policy 0, policy_version 880386 (0.0006) [2023-12-26 06:37:07,143][123091] Updated weights for policy 0, policy_version 880396 (0.0008) [2023-12-26 06:37:07,916][123090] Updated weights for policy 1, policy_version 874178 (0.0011) [2023-12-26 06:37:07,958][123091] Updated weights for policy 0, policy_version 880406 (0.0008) [2023-12-26 06:37:07,968][123090] Updated weights for policy 1, policy_version 874188 (0.0010) [2023-12-26 06:37:08,006][123091] Updated weights for policy 0, policy_version 880416 (0.0007) [2023-12-26 06:37:08,019][123090] Updated weights for policy 1, policy_version 874198 (0.0010) [2023-12-26 06:37:08,062][123091] Updated weights for policy 0, policy_version 880426 (0.0010) [2023-12-26 06:37:08,072][123090] Updated weights for policy 1, policy_version 874208 (0.0010) [2023-12-26 06:37:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 449191936. Throughput: 0: 8864.6, 1: 8831.6. Samples: 449172480. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:08,785][121949] Avg episode reward: [(0, '6164.153'), (1, '5790.093')] [2023-12-26 06:37:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000880432_225394688.pth... [2023-12-26 06:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000874208_223797248.pth... [2023-12-26 06:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000873184_223535104.pth [2023-12-26 06:37:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000879440_225140736.pth [2023-12-26 06:37:08,923][123091] Updated weights for policy 0, policy_version 880436 (0.0007) [2023-12-26 06:37:08,924][123090] Updated weights for policy 1, policy_version 874218 (0.0010) [2023-12-26 06:37:08,972][123091] Updated weights for policy 0, policy_version 880446 (0.0009) [2023-12-26 06:37:08,991][123090] Updated weights for policy 1, policy_version 874228 (0.0010) [2023-12-26 06:37:09,020][123091] Updated weights for policy 0, policy_version 880456 (0.0006) [2023-12-26 06:37:09,043][123090] Updated weights for policy 1, policy_version 874238 (0.0010) [2023-12-26 06:37:09,807][123090] Updated weights for policy 1, policy_version 874248 (0.0007) [2023-12-26 06:37:09,872][123091] Updated weights for policy 0, policy_version 880466 (0.0008) [2023-12-26 06:37:09,879][123090] Updated weights for policy 1, policy_version 874258 (0.0007) [2023-12-26 06:37:09,945][123091] Updated weights for policy 0, policy_version 880476 (0.0007) [2023-12-26 06:37:09,950][123090] Updated weights for policy 1, policy_version 874268 (0.0008) [2023-12-26 06:37:10,009][123091] Updated weights for policy 0, policy_version 880486 (0.0010) [2023-12-26 06:37:10,065][123091] Updated weights for policy 0, policy_version 880496 (0.0009) [2023-12-26 06:37:10,670][123090] Updated weights for policy 1, policy_version 874278 (0.0006) [2023-12-26 06:37:10,746][123090] Updated weights for policy 1, policy_version 874288 (0.0007) [2023-12-26 06:37:10,813][123090] Updated weights for policy 1, policy_version 874298 (0.0010) [2023-12-26 06:37:10,892][123091] Updated weights for policy 0, policy_version 880506 (0.0009) [2023-12-26 06:37:10,946][123091] Updated weights for policy 0, policy_version 880516 (0.0010) [2023-12-26 06:37:11,001][123091] Updated weights for policy 0, policy_version 880526 (0.0010) [2023-12-26 06:37:11,601][123090] Updated weights for policy 1, policy_version 874308 (0.0009) [2023-12-26 06:37:11,675][123090] Updated weights for policy 1, policy_version 874318 (0.0009) [2023-12-26 06:37:11,747][123090] Updated weights for policy 1, policy_version 874328 (0.0010) [2023-12-26 06:37:11,925][123091] Updated weights for policy 0, policy_version 880536 (0.0010) [2023-12-26 06:37:11,993][123091] Updated weights for policy 0, policy_version 880546 (0.0010) [2023-12-26 06:37:12,065][123091] Updated weights for policy 0, policy_version 880556 (0.0009) [2023-12-26 06:37:12,636][123090] Updated weights for policy 1, policy_version 874338 (0.0009) [2023-12-26 06:37:12,695][123090] Updated weights for policy 1, policy_version 874348 (0.0010) [2023-12-26 06:37:12,758][123090] Updated weights for policy 1, policy_version 874358 (0.0009) [2023-12-26 06:37:12,816][123090] Updated weights for policy 1, policy_version 874368 (0.0009) [2023-12-26 06:37:12,891][123091] Updated weights for policy 0, policy_version 880566 (0.0009) [2023-12-26 06:37:12,938][123091] Updated weights for policy 0, policy_version 880576 (0.0009) [2023-12-26 06:37:13,000][123091] Updated weights for policy 0, policy_version 880586 (0.0010) [2023-12-26 06:37:13,626][123090] Updated weights for policy 1, policy_version 874378 (0.0010) [2023-12-26 06:37:13,703][123090] Updated weights for policy 1, policy_version 874388 (0.0009) [2023-12-26 06:37:13,766][123090] Updated weights for policy 1, policy_version 874398 (0.0009) [2023-12-26 06:37:13,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 449273856. Throughput: 0: 8784.1, 1: 8770.2. Samples: 449275468. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:13,785][121949] Avg episode reward: [(0, '6181.424'), (1, '5788.998')] [2023-12-26 06:37:13,858][123091] Updated weights for policy 0, policy_version 880596 (0.0010) [2023-12-26 06:37:13,915][123091] Updated weights for policy 0, policy_version 880606 (0.0009) [2023-12-26 06:37:13,968][123091] Updated weights for policy 0, policy_version 880616 (0.0010) [2023-12-26 06:37:14,535][123090] Updated weights for policy 1, policy_version 874408 (0.0006) [2023-12-26 06:37:14,593][123090] Updated weights for policy 1, policy_version 874418 (0.0006) [2023-12-26 06:37:14,667][123090] Updated weights for policy 1, policy_version 874428 (0.0005) [2023-12-26 06:37:14,852][123091] Updated weights for policy 0, policy_version 880626 (0.0010) [2023-12-26 06:37:14,922][123091] Updated weights for policy 0, policy_version 880636 (0.0010) [2023-12-26 06:37:14,982][123091] Updated weights for policy 0, policy_version 880646 (0.0009) [2023-12-26 06:37:15,050][123091] Updated weights for policy 0, policy_version 880656 (0.0010) [2023-12-26 06:37:15,385][123090] Updated weights for policy 1, policy_version 874438 (0.0008) [2023-12-26 06:37:15,454][123090] Updated weights for policy 1, policy_version 874448 (0.0009) [2023-12-26 06:37:15,522][123090] Updated weights for policy 1, policy_version 874458 (0.0009) [2023-12-26 06:37:15,899][123091] Updated weights for policy 0, policy_version 880666 (0.0006) [2023-12-26 06:37:15,958][123091] Updated weights for policy 0, policy_version 880676 (0.0006) [2023-12-26 06:37:16,024][123091] Updated weights for policy 0, policy_version 880686 (0.0007) [2023-12-26 06:37:16,408][123090] Updated weights for policy 1, policy_version 874468 (0.0009) [2023-12-26 06:37:16,480][123090] Updated weights for policy 1, policy_version 874478 (0.0009) [2023-12-26 06:37:16,535][123090] Updated weights for policy 1, policy_version 874488 (0.0009) [2023-12-26 06:37:16,687][123091] Updated weights for policy 0, policy_version 880696 (0.0008) [2023-12-26 06:37:16,747][123091] Updated weights for policy 0, policy_version 880706 (0.0009) [2023-12-26 06:37:16,810][123091] Updated weights for policy 0, policy_version 880716 (0.0009) [2023-12-26 06:37:17,387][123090] Updated weights for policy 1, policy_version 874498 (0.0009) [2023-12-26 06:37:17,442][123090] Updated weights for policy 1, policy_version 874508 (0.0009) [2023-12-26 06:37:17,504][123090] Updated weights for policy 1, policy_version 874518 (0.0009) [2023-12-26 06:37:17,523][123091] Updated weights for policy 0, policy_version 880726 (0.0010) [2023-12-26 06:37:17,553][123090] Updated weights for policy 1, policy_version 874528 (0.0008) [2023-12-26 06:37:17,571][123091] Updated weights for policy 0, policy_version 880736 (0.0008) [2023-12-26 06:37:17,626][123091] Updated weights for policy 0, policy_version 880746 (0.0009) [2023-12-26 06:37:18,383][123090] Updated weights for policy 1, policy_version 874538 (0.0010) [2023-12-26 06:37:18,451][123090] Updated weights for policy 1, policy_version 874548 (0.0009) [2023-12-26 06:37:18,485][123091] Updated weights for policy 0, policy_version 880757 (0.0009) [2023-12-26 06:37:18,516][123090] Updated weights for policy 1, policy_version 874558 (0.0006) [2023-12-26 06:37:18,551][123091] Updated weights for policy 0, policy_version 880767 (0.0009) [2023-12-26 06:37:18,627][123091] Updated weights for policy 0, policy_version 880777 (0.0009) [2023-12-26 06:37:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 449372160. Throughput: 0: 8729.3, 1: 8716.2. Samples: 449379660. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:18,784][121949] Avg episode reward: [(0, '6118.814'), (1, '5873.323')] [2023-12-26 06:37:19,195][123090] Updated weights for policy 1, policy_version 874568 (0.0005) [2023-12-26 06:37:19,269][123090] Updated weights for policy 1, policy_version 874578 (0.0008) [2023-12-26 06:37:19,339][123090] Updated weights for policy 1, policy_version 874588 (0.0008) [2023-12-26 06:37:19,472][123091] Updated weights for policy 0, policy_version 880787 (0.0009) [2023-12-26 06:37:19,534][123091] Updated weights for policy 0, policy_version 880797 (0.0009) [2023-12-26 06:37:19,603][123091] Updated weights for policy 0, policy_version 880807 (0.0010) [2023-12-26 06:37:20,137][123090] Updated weights for policy 1, policy_version 874598 (0.0010) [2023-12-26 06:37:20,209][123090] Updated weights for policy 1, policy_version 874608 (0.0011) [2023-12-26 06:37:20,282][123090] Updated weights for policy 1, policy_version 874618 (0.0011) [2023-12-26 06:37:20,458][123091] Updated weights for policy 0, policy_version 880817 (0.0009) [2023-12-26 06:37:20,524][123091] Updated weights for policy 0, policy_version 880827 (0.0010) [2023-12-26 06:37:20,580][123091] Updated weights for policy 0, policy_version 880837 (0.0009) [2023-12-26 06:37:20,651][123091] Updated weights for policy 0, policy_version 880847 (0.0010) [2023-12-26 06:37:21,085][123090] Updated weights for policy 1, policy_version 874628 (0.0009) [2023-12-26 06:37:21,158][123090] Updated weights for policy 1, policy_version 874638 (0.0010) [2023-12-26 06:37:21,229][123090] Updated weights for policy 1, policy_version 874648 (0.0009) [2023-12-26 06:37:21,522][123091] Updated weights for policy 0, policy_version 880857 (0.0010) [2023-12-26 06:37:21,583][123091] Updated weights for policy 0, policy_version 880867 (0.0009) [2023-12-26 06:37:21,650][123091] Updated weights for policy 0, policy_version 880877 (0.0010) [2023-12-26 06:37:22,084][123090] Updated weights for policy 1, policy_version 874658 (0.0010) [2023-12-26 06:37:22,150][123090] Updated weights for policy 1, policy_version 874668 (0.0010) [2023-12-26 06:37:22,220][123090] Updated weights for policy 1, policy_version 874678 (0.0009) [2023-12-26 06:37:22,290][123090] Updated weights for policy 1, policy_version 874688 (0.0010) [2023-12-26 06:37:22,596][123091] Updated weights for policy 0, policy_version 880887 (0.0008) [2023-12-26 06:37:22,654][123091] Updated weights for policy 0, policy_version 880897 (0.0006) [2023-12-26 06:37:22,722][123091] Updated weights for policy 0, policy_version 880907 (0.0006) [2023-12-26 06:37:23,081][123090] Updated weights for policy 1, policy_version 874698 (0.0010) [2023-12-26 06:37:23,150][123090] Updated weights for policy 1, policy_version 874708 (0.0009) [2023-12-26 06:37:23,218][123090] Updated weights for policy 1, policy_version 874718 (0.0010) [2023-12-26 06:37:23,380][123091] Updated weights for policy 0, policy_version 880917 (0.0008) [2023-12-26 06:37:23,443][123091] Updated weights for policy 0, policy_version 880927 (0.0010) [2023-12-26 06:37:23,501][123091] Updated weights for policy 0, policy_version 880937 (0.0010) [2023-12-26 06:37:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 449454080. Throughput: 0: 8653.3, 1: 8707.3. Samples: 449429928. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:23,785][121949] Avg episode reward: [(0, '6213.183'), (1, '5511.062')] [2023-12-26 06:37:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000880944_225525760.pth... [2023-12-26 06:37:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000874720_223928320.pth... [2023-12-26 06:37:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000879952_225271808.pth [2023-12-26 06:37:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000873696_223666176.pth [2023-12-26 06:37:23,960][123090] Updated weights for policy 1, policy_version 874728 (0.0006) [2023-12-26 06:37:24,015][123090] Updated weights for policy 1, policy_version 874738 (0.0005) [2023-12-26 06:37:24,071][123090] Updated weights for policy 1, policy_version 874748 (0.0005) [2023-12-26 06:37:24,406][123091] Updated weights for policy 0, policy_version 880947 (0.0010) [2023-12-26 06:37:24,458][123091] Updated weights for policy 0, policy_version 880958 (0.0009) [2023-12-26 06:37:24,518][123091] Updated weights for policy 0, policy_version 880968 (0.0009) [2023-12-26 06:37:24,746][123090] Updated weights for policy 1, policy_version 874758 (0.0008) [2023-12-26 06:37:24,805][123090] Updated weights for policy 1, policy_version 874768 (0.0010) [2023-12-26 06:37:24,872][123090] Updated weights for policy 1, policy_version 874778 (0.0009) [2023-12-26 06:37:25,253][123091] Updated weights for policy 0, policy_version 880978 (0.0007) [2023-12-26 06:37:25,300][123091] Updated weights for policy 0, policy_version 880988 (0.0008) [2023-12-26 06:37:25,351][123091] Updated weights for policy 0, policy_version 880998 (0.0010) [2023-12-26 06:37:25,399][123091] Updated weights for policy 0, policy_version 881008 (0.0010) [2023-12-26 06:37:25,642][123090] Updated weights for policy 1, policy_version 874788 (0.0007) [2023-12-26 06:37:25,702][123090] Updated weights for policy 1, policy_version 874798 (0.0010) [2023-12-26 06:37:25,756][123090] Updated weights for policy 1, policy_version 874809 (0.0010) [2023-12-26 06:37:26,116][123091] Updated weights for policy 0, policy_version 881018 (0.0005) [2023-12-26 06:37:26,171][123091] Updated weights for policy 0, policy_version 881028 (0.0006) [2023-12-26 06:37:26,225][123091] Updated weights for policy 0, policy_version 881038 (0.0006) [2023-12-26 06:37:26,560][123090] Updated weights for policy 1, policy_version 874820 (0.0008) [2023-12-26 06:37:26,615][123090] Updated weights for policy 1, policy_version 874830 (0.0005) [2023-12-26 06:37:26,675][123090] Updated weights for policy 1, policy_version 874840 (0.0005) [2023-12-26 06:37:26,962][123091] Updated weights for policy 0, policy_version 881048 (0.0008) [2023-12-26 06:37:27,018][123091] Updated weights for policy 0, policy_version 881058 (0.0009) [2023-12-26 06:37:27,069][123091] Updated weights for policy 0, policy_version 881068 (0.0009) [2023-12-26 06:37:27,335][123090] Updated weights for policy 1, policy_version 874850 (0.0006) [2023-12-26 06:37:27,392][123090] Updated weights for policy 1, policy_version 874860 (0.0010) [2023-12-26 06:37:27,464][123090] Updated weights for policy 1, policy_version 874870 (0.0010) [2023-12-26 06:37:27,533][123090] Updated weights for policy 1, policy_version 874880 (0.0010) [2023-12-26 06:37:27,829][123091] Updated weights for policy 0, policy_version 881078 (0.0007) [2023-12-26 06:37:27,896][123091] Updated weights for policy 0, policy_version 881088 (0.0005) [2023-12-26 06:37:27,961][123091] Updated weights for policy 0, policy_version 881098 (0.0007) [2023-12-26 06:37:28,346][123090] Updated weights for policy 1, policy_version 874890 (0.0010) [2023-12-26 06:37:28,409][123090] Updated weights for policy 1, policy_version 874900 (0.0010) [2023-12-26 06:37:28,474][123090] Updated weights for policy 1, policy_version 874910 (0.0008) [2023-12-26 06:37:28,717][123091] Updated weights for policy 0, policy_version 881108 (0.0009) [2023-12-26 06:37:28,770][123091] Updated weights for policy 0, policy_version 881118 (0.0010) [2023-12-26 06:37:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 449544192. Throughput: 0: 8635.1, 1: 8813.6. Samples: 449539700. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:28,784][121949] Avg episode reward: [(0, '6237.790'), (1, '5491.987')] [2023-12-26 06:37:28,832][123091] Updated weights for policy 0, policy_version 881129 (0.0010) [2023-12-26 06:37:29,142][123090] Updated weights for policy 1, policy_version 874920 (0.0005) [2023-12-26 06:37:29,204][123090] Updated weights for policy 1, policy_version 874930 (0.0005) [2023-12-26 06:37:29,274][123090] Updated weights for policy 1, policy_version 874940 (0.0006) [2023-12-26 06:37:29,748][123091] Updated weights for policy 0, policy_version 881139 (0.0009) [2023-12-26 06:37:29,809][123091] Updated weights for policy 0, policy_version 881149 (0.0010) [2023-12-26 06:37:29,881][123091] Updated weights for policy 0, policy_version 881159 (0.0010) [2023-12-26 06:37:29,968][123090] Updated weights for policy 1, policy_version 874950 (0.0006) [2023-12-26 06:37:30,024][123090] Updated weights for policy 1, policy_version 874960 (0.0005) [2023-12-26 06:37:30,079][123090] Updated weights for policy 1, policy_version 874970 (0.0005) [2023-12-26 06:37:30,713][123090] Updated weights for policy 1, policy_version 874980 (0.0006) [2023-12-26 06:37:30,779][123090] Updated weights for policy 1, policy_version 874990 (0.0009) [2023-12-26 06:37:30,781][123091] Updated weights for policy 0, policy_version 881169 (0.0009) [2023-12-26 06:37:30,833][123091] Updated weights for policy 0, policy_version 881179 (0.0008) [2023-12-26 06:37:30,844][123090] Updated weights for policy 1, policy_version 875000 (0.0008) [2023-12-26 06:37:30,885][123091] Updated weights for policy 0, policy_version 881189 (0.0009) [2023-12-26 06:37:30,939][123091] Updated weights for policy 0, policy_version 881199 (0.0009) [2023-12-26 06:37:31,574][123090] Updated weights for policy 1, policy_version 875010 (0.0008) [2023-12-26 06:37:31,640][123090] Updated weights for policy 1, policy_version 875020 (0.0008) [2023-12-26 06:37:31,709][123090] Updated weights for policy 1, policy_version 875030 (0.0008) [2023-12-26 06:37:31,780][123090] Updated weights for policy 1, policy_version 875040 (0.0008) [2023-12-26 06:37:31,822][123091] Updated weights for policy 0, policy_version 881209 (0.0009) [2023-12-26 06:37:31,885][123091] Updated weights for policy 0, policy_version 881219 (0.0009) [2023-12-26 06:37:31,943][123091] Updated weights for policy 0, policy_version 881229 (0.0009) [2023-12-26 06:37:32,577][123090] Updated weights for policy 1, policy_version 875050 (0.0010) [2023-12-26 06:37:32,635][123090] Updated weights for policy 1, policy_version 875060 (0.0010) [2023-12-26 06:37:32,690][123090] Updated weights for policy 1, policy_version 875070 (0.0009) [2023-12-26 06:37:32,726][123091] Updated weights for policy 0, policy_version 881239 (0.0009) [2023-12-26 06:37:32,778][123091] Updated weights for policy 0, policy_version 881249 (0.0008) [2023-12-26 06:37:32,833][123091] Updated weights for policy 0, policy_version 881259 (0.0009) [2023-12-26 06:37:33,520][123090] Updated weights for policy 1, policy_version 875080 (0.0007) [2023-12-26 06:37:33,567][123090] Updated weights for policy 1, policy_version 875090 (0.0009) [2023-12-26 06:37:33,623][123090] Updated weights for policy 1, policy_version 875100 (0.0009) [2023-12-26 06:37:33,679][123091] Updated weights for policy 0, policy_version 881269 (0.0009) [2023-12-26 06:37:33,742][123091] Updated weights for policy 0, policy_version 881279 (0.0010) [2023-12-26 06:37:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 449634304. Throughput: 0: 8589.1, 1: 8900.6. Samples: 449645952. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:33,785][121949] Avg episode reward: [(0, '6227.975'), (1, '5687.797')] [2023-12-26 06:37:33,800][123091] Updated weights for policy 0, policy_version 881289 (0.0009) [2023-12-26 06:37:34,469][123090] Updated weights for policy 1, policy_version 875110 (0.0007) [2023-12-26 06:37:34,523][123090] Updated weights for policy 1, policy_version 875120 (0.0007) [2023-12-26 06:37:34,587][123090] Updated weights for policy 1, policy_version 875130 (0.0009) [2023-12-26 06:37:34,658][123091] Updated weights for policy 0, policy_version 881299 (0.0010) [2023-12-26 06:37:34,722][123091] Updated weights for policy 0, policy_version 881309 (0.0009) [2023-12-26 06:37:34,782][123091] Updated weights for policy 0, policy_version 881319 (0.0010) [2023-12-26 06:37:35,395][123090] Updated weights for policy 1, policy_version 875140 (0.0010) [2023-12-26 06:37:35,444][123090] Updated weights for policy 1, policy_version 875150 (0.0009) [2023-12-26 06:37:35,493][123090] Updated weights for policy 1, policy_version 875160 (0.0009) [2023-12-26 06:37:35,609][123091] Updated weights for policy 0, policy_version 881329 (0.0009) [2023-12-26 06:37:35,669][123091] Updated weights for policy 0, policy_version 881339 (0.0010) [2023-12-26 06:37:35,720][123091] Updated weights for policy 0, policy_version 881349 (0.0009) [2023-12-26 06:37:35,777][123091] Updated weights for policy 0, policy_version 881359 (0.0010) [2023-12-26 06:37:36,378][123090] Updated weights for policy 1, policy_version 875170 (0.0009) [2023-12-26 06:37:36,452][123090] Updated weights for policy 1, policy_version 875180 (0.0011) [2023-12-26 06:37:36,523][123090] Updated weights for policy 1, policy_version 875190 (0.0010) [2023-12-26 06:37:36,591][123090] Updated weights for policy 1, policy_version 875200 (0.0006) [2023-12-26 06:37:36,654][123091] Updated weights for policy 0, policy_version 881369 (0.0009) [2023-12-26 06:37:36,727][123091] Updated weights for policy 0, policy_version 881379 (0.0010) [2023-12-26 06:37:36,797][123091] Updated weights for policy 0, policy_version 881389 (0.0010) [2023-12-26 06:37:37,327][123090] Updated weights for policy 1, policy_version 875210 (0.0005) [2023-12-26 06:37:37,405][123090] Updated weights for policy 1, policy_version 875220 (0.0010) [2023-12-26 06:37:37,463][123091] Updated weights for policy 0, policy_version 881399 (0.0008) [2023-12-26 06:37:37,464][123090] Updated weights for policy 1, policy_version 875230 (0.0010) [2023-12-26 06:37:37,533][123091] Updated weights for policy 0, policy_version 881409 (0.0007) [2023-12-26 06:37:37,605][123091] Updated weights for policy 0, policy_version 881419 (0.0007) [2023-12-26 06:37:38,254][123090] Updated weights for policy 1, policy_version 875240 (0.0010) [2023-12-26 06:37:38,313][123091] Updated weights for policy 0, policy_version 881429 (0.0007) [2023-12-26 06:37:38,318][123090] Updated weights for policy 1, policy_version 875250 (0.0010) [2023-12-26 06:37:38,378][123091] Updated weights for policy 0, policy_version 881439 (0.0007) [2023-12-26 06:37:38,388][123090] Updated weights for policy 1, policy_version 875260 (0.0010) [2023-12-26 06:37:38,439][123091] Updated weights for policy 0, policy_version 881449 (0.0008) [2023-12-26 06:37:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 449724416. Throughput: 0: 8570.4, 1: 8926.2. Samples: 449696848. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:38,785][121949] Avg episode reward: [(0, '6165.656'), (1, '5692.259')] [2023-12-26 06:37:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000881456_225656832.pth... [2023-12-26 06:37:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000875264_224067584.pth... [2023-12-26 06:37:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000880432_225394688.pth [2023-12-26 06:37:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000874208_223797248.pth [2023-12-26 06:37:39,137][123090] Updated weights for policy 1, policy_version 875270 (0.0009) [2023-12-26 06:37:39,200][123090] Updated weights for policy 1, policy_version 875280 (0.0010) [2023-12-26 06:37:39,265][123090] Updated weights for policy 1, policy_version 875290 (0.0008) [2023-12-26 06:37:39,325][123091] Updated weights for policy 0, policy_version 881459 (0.0009) [2023-12-26 06:37:39,385][123091] Updated weights for policy 0, policy_version 881469 (0.0009) [2023-12-26 06:37:39,460][123091] Updated weights for policy 0, policy_version 881479 (0.0009) [2023-12-26 06:37:39,974][123090] Updated weights for policy 1, policy_version 875300 (0.0007) [2023-12-26 06:37:40,046][123090] Updated weights for policy 1, policy_version 875310 (0.0005) [2023-12-26 06:37:40,120][123090] Updated weights for policy 1, policy_version 875320 (0.0005) [2023-12-26 06:37:40,337][123091] Updated weights for policy 0, policy_version 881489 (0.0009) [2023-12-26 06:37:40,399][123091] Updated weights for policy 0, policy_version 881499 (0.0010) [2023-12-26 06:37:40,461][123091] Updated weights for policy 0, policy_version 881509 (0.0009) [2023-12-26 06:37:40,522][123091] Updated weights for policy 0, policy_version 881519 (0.0009) [2023-12-26 06:37:40,757][123090] Updated weights for policy 1, policy_version 875330 (0.0005) [2023-12-26 06:37:40,834][123090] Updated weights for policy 1, policy_version 875340 (0.0006) [2023-12-26 06:37:40,911][123090] Updated weights for policy 1, policy_version 875350 (0.0005) [2023-12-26 06:37:40,984][123090] Updated weights for policy 1, policy_version 875360 (0.0009) [2023-12-26 06:37:41,336][123091] Updated weights for policy 0, policy_version 881529 (0.0009) [2023-12-26 06:37:41,408][123091] Updated weights for policy 0, policy_version 881539 (0.0009) [2023-12-26 06:37:41,455][123091] Updated weights for policy 0, policy_version 881549 (0.0008) [2023-12-26 06:37:41,795][123090] Updated weights for policy 1, policy_version 875370 (0.0009) [2023-12-26 06:37:41,859][123090] Updated weights for policy 1, policy_version 875380 (0.0008) [2023-12-26 06:37:41,926][123090] Updated weights for policy 1, policy_version 875390 (0.0008) [2023-12-26 06:37:42,307][123091] Updated weights for policy 0, policy_version 881559 (0.0006) [2023-12-26 06:37:42,377][123091] Updated weights for policy 0, policy_version 881569 (0.0009) [2023-12-26 06:37:42,450][123091] Updated weights for policy 0, policy_version 881579 (0.0008) [2023-12-26 06:37:42,768][123090] Updated weights for policy 1, policy_version 875400 (0.0006) [2023-12-26 06:37:42,837][123090] Updated weights for policy 1, policy_version 875410 (0.0006) [2023-12-26 06:37:42,909][123090] Updated weights for policy 1, policy_version 875420 (0.0008) [2023-12-26 06:37:43,300][123091] Updated weights for policy 0, policy_version 881589 (0.0009) [2023-12-26 06:37:43,356][123091] Updated weights for policy 0, policy_version 881599 (0.0010) [2023-12-26 06:37:43,420][123091] Updated weights for policy 0, policy_version 881609 (0.0009) [2023-12-26 06:37:43,611][123090] Updated weights for policy 1, policy_version 875430 (0.0009) [2023-12-26 06:37:43,670][123090] Updated weights for policy 1, policy_version 875440 (0.0008) [2023-12-26 06:37:43,729][123090] Updated weights for policy 1, policy_version 875450 (0.0009) [2023-12-26 06:37:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 449814528. Throughput: 0: 8601.4, 1: 8894.5. Samples: 449802924. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:43,784][121949] Avg episode reward: [(0, '6099.813'), (1, '5567.215')] [2023-12-26 06:37:44,252][123091] Updated weights for policy 0, policy_version 881619 (0.0010) [2023-12-26 06:37:44,319][123091] Updated weights for policy 0, policy_version 881629 (0.0008) [2023-12-26 06:37:44,386][123091] Updated weights for policy 0, policy_version 881640 (0.0007) [2023-12-26 06:37:44,544][123090] Updated weights for policy 1, policy_version 875460 (0.0009) [2023-12-26 06:37:44,597][123090] Updated weights for policy 1, policy_version 875470 (0.0010) [2023-12-26 06:37:44,651][123090] Updated weights for policy 1, policy_version 875480 (0.0009) [2023-12-26 06:37:45,152][123091] Updated weights for policy 0, policy_version 881650 (0.0007) [2023-12-26 06:37:45,217][123091] Updated weights for policy 0, policy_version 881660 (0.0010) [2023-12-26 06:37:45,280][123091] Updated weights for policy 0, policy_version 881670 (0.0010) [2023-12-26 06:37:45,343][123091] Updated weights for policy 0, policy_version 881680 (0.0010) [2023-12-26 06:37:45,476][123090] Updated weights for policy 1, policy_version 875490 (0.0008) [2023-12-26 06:37:45,532][123090] Updated weights for policy 1, policy_version 875500 (0.0010) [2023-12-26 06:37:45,579][123090] Updated weights for policy 1, policy_version 875510 (0.0008) [2023-12-26 06:37:45,639][123090] Updated weights for policy 1, policy_version 875520 (0.0010) [2023-12-26 06:37:46,194][123091] Updated weights for policy 0, policy_version 881690 (0.0009) [2023-12-26 06:37:46,257][123091] Updated weights for policy 0, policy_version 881700 (0.0008) [2023-12-26 06:37:46,317][123091] Updated weights for policy 0, policy_version 881710 (0.0008) [2023-12-26 06:37:46,478][123090] Updated weights for policy 1, policy_version 875530 (0.0011) [2023-12-26 06:37:46,529][123090] Updated weights for policy 1, policy_version 875540 (0.0010) [2023-12-26 06:37:46,603][123090] Updated weights for policy 1, policy_version 875550 (0.0008) [2023-12-26 06:37:47,064][123091] Updated weights for policy 0, policy_version 881720 (0.0006) [2023-12-26 06:37:47,117][123091] Updated weights for policy 0, policy_version 881730 (0.0005) [2023-12-26 06:37:47,166][123091] Updated weights for policy 0, policy_version 881740 (0.0005) [2023-12-26 06:37:47,318][123090] Updated weights for policy 1, policy_version 875560 (0.0011) [2023-12-26 06:37:47,370][123090] Updated weights for policy 1, policy_version 875570 (0.0010) [2023-12-26 06:37:47,426][123090] Updated weights for policy 1, policy_version 875580 (0.0009) [2023-12-26 06:37:48,033][123091] Updated weights for policy 0, policy_version 881750 (0.0008) [2023-12-26 06:37:48,096][123091] Updated weights for policy 0, policy_version 881760 (0.0010) [2023-12-26 06:37:48,153][123090] Updated weights for policy 1, policy_version 875590 (0.0007) [2023-12-26 06:37:48,160][123091] Updated weights for policy 0, policy_version 881770 (0.0008) [2023-12-26 06:37:48,216][123090] Updated weights for policy 1, policy_version 875600 (0.0008) [2023-12-26 06:37:48,281][123090] Updated weights for policy 1, policy_version 875610 (0.0008) [2023-12-26 06:37:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 449896448. Throughput: 0: 8585.7, 1: 8947.3. Samples: 449909816. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:48,785][121949] Avg episode reward: [(0, '6143.208'), (1, '5602.475')] [2023-12-26 06:37:48,994][123090] Updated weights for policy 1, policy_version 875620 (0.0009) [2023-12-26 06:37:49,048][123090] Updated weights for policy 1, policy_version 875630 (0.0006) [2023-12-26 06:37:49,050][123091] Updated weights for policy 0, policy_version 881780 (0.0010) [2023-12-26 06:37:49,101][123090] Updated weights for policy 1, policy_version 875640 (0.0005) [2023-12-26 06:37:49,108][123091] Updated weights for policy 0, policy_version 881790 (0.0009) [2023-12-26 06:37:49,162][123091] Updated weights for policy 0, policy_version 881800 (0.0009) [2023-12-26 06:37:49,867][123090] Updated weights for policy 1, policy_version 875650 (0.0006) [2023-12-26 06:37:49,948][123090] Updated weights for policy 1, policy_version 875660 (0.0011) [2023-12-26 06:37:49,954][123091] Updated weights for policy 0, policy_version 881810 (0.0009) [2023-12-26 06:37:50,008][123090] Updated weights for policy 1, policy_version 875670 (0.0011) [2023-12-26 06:37:50,019][123091] Updated weights for policy 0, policy_version 881820 (0.0006) [2023-12-26 06:37:50,067][123090] Updated weights for policy 1, policy_version 875680 (0.0010) [2023-12-26 06:37:50,080][123091] Updated weights for policy 0, policy_version 881830 (0.0008) [2023-12-26 06:37:50,150][123091] Updated weights for policy 0, policy_version 881840 (0.0009) [2023-12-26 06:37:50,885][123090] Updated weights for policy 1, policy_version 875690 (0.0011) [2023-12-26 06:37:50,953][123090] Updated weights for policy 1, policy_version 875700 (0.0011) [2023-12-26 06:37:50,986][123091] Updated weights for policy 0, policy_version 881850 (0.0007) [2023-12-26 06:37:51,021][123090] Updated weights for policy 1, policy_version 875710 (0.0011) [2023-12-26 06:37:51,055][123091] Updated weights for policy 0, policy_version 881860 (0.0010) [2023-12-26 06:37:51,121][123091] Updated weights for policy 0, policy_version 881870 (0.0009) [2023-12-26 06:37:51,831][123090] Updated weights for policy 1, policy_version 875720 (0.0006) [2023-12-26 06:37:51,895][123090] Updated weights for policy 1, policy_version 875730 (0.0005) [2023-12-26 06:37:51,962][123090] Updated weights for policy 1, policy_version 875740 (0.0007) [2023-12-26 06:37:51,970][123091] Updated weights for policy 0, policy_version 881880 (0.0008) [2023-12-26 06:37:52,033][123091] Updated weights for policy 0, policy_version 881890 (0.0008) [2023-12-26 06:37:52,086][123091] Updated weights for policy 0, policy_version 881900 (0.0009) [2023-12-26 06:37:52,753][123090] Updated weights for policy 1, policy_version 875750 (0.0007) [2023-12-26 06:37:52,823][123090] Updated weights for policy 1, policy_version 875760 (0.0008) [2023-12-26 06:37:52,892][123090] Updated weights for policy 1, policy_version 875770 (0.0009) [2023-12-26 06:37:52,979][123091] Updated weights for policy 0, policy_version 881910 (0.0010) [2023-12-26 06:37:53,038][123091] Updated weights for policy 0, policy_version 881920 (0.0009) [2023-12-26 06:37:53,099][123091] Updated weights for policy 0, policy_version 881930 (0.0010) [2023-12-26 06:37:53,539][123090] Updated weights for policy 1, policy_version 875780 (0.0007) [2023-12-26 06:37:53,609][123090] Updated weights for policy 1, policy_version 875790 (0.0006) [2023-12-26 06:37:53,668][123090] Updated weights for policy 1, policy_version 875800 (0.0005) [2023-12-26 06:37:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 449986560. Throughput: 0: 8569.6, 1: 8958.6. Samples: 449961252. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:53,785][121949] Avg episode reward: [(0, '6227.237'), (1, '5662.294')] [2023-12-26 06:37:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000881936_225779712.pth... [2023-12-26 06:37:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000875808_224206848.pth... [2023-12-26 06:37:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000880944_225525760.pth [2023-12-26 06:37:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000874720_223928320.pth [2023-12-26 06:37:54,015][123091] Updated weights for policy 0, policy_version 881940 (0.0008) [2023-12-26 06:37:54,072][123091] Updated weights for policy 0, policy_version 881950 (0.0006) [2023-12-26 06:37:54,129][123091] Updated weights for policy 0, policy_version 881960 (0.0009) [2023-12-26 06:37:54,411][123090] Updated weights for policy 1, policy_version 875810 (0.0006) [2023-12-26 06:37:54,482][123090] Updated weights for policy 1, policy_version 875820 (0.0011) [2023-12-26 06:37:54,553][123090] Updated weights for policy 1, policy_version 875830 (0.0010) [2023-12-26 06:37:54,617][123090] Updated weights for policy 1, policy_version 875840 (0.0010) [2023-12-26 06:37:54,884][123091] Updated weights for policy 0, policy_version 881970 (0.0008) [2023-12-26 06:37:54,953][123091] Updated weights for policy 0, policy_version 881980 (0.0006) [2023-12-26 06:37:55,014][123091] Updated weights for policy 0, policy_version 881990 (0.0005) [2023-12-26 06:37:55,077][123091] Updated weights for policy 0, policy_version 882000 (0.0008) [2023-12-26 06:37:55,424][123090] Updated weights for policy 1, policy_version 875850 (0.0010) [2023-12-26 06:37:55,478][123090] Updated weights for policy 1, policy_version 875860 (0.0010) [2023-12-26 06:37:55,533][123090] Updated weights for policy 1, policy_version 875870 (0.0010) [2023-12-26 06:37:55,803][123091] Updated weights for policy 0, policy_version 882010 (0.0011) [2023-12-26 06:37:55,855][123091] Updated weights for policy 0, policy_version 882020 (0.0005) [2023-12-26 06:37:55,909][123091] Updated weights for policy 0, policy_version 882030 (0.0008) [2023-12-26 06:37:56,369][123090] Updated weights for policy 1, policy_version 875880 (0.0010) [2023-12-26 06:37:56,424][123090] Updated weights for policy 1, policy_version 875890 (0.0010) [2023-12-26 06:37:56,470][123090] Updated weights for policy 1, policy_version 875900 (0.0010) [2023-12-26 06:37:56,660][123091] Updated weights for policy 0, policy_version 882040 (0.0009) [2023-12-26 06:37:56,712][123091] Updated weights for policy 0, policy_version 882050 (0.0009) [2023-12-26 06:37:56,768][123091] Updated weights for policy 0, policy_version 882060 (0.0009) [2023-12-26 06:37:57,307][123090] Updated weights for policy 1, policy_version 875910 (0.0010) [2023-12-26 06:37:57,361][123090] Updated weights for policy 1, policy_version 875920 (0.0010) [2023-12-26 06:37:57,412][123090] Updated weights for policy 1, policy_version 875930 (0.0010) [2023-12-26 06:37:57,604][123091] Updated weights for policy 0, policy_version 882070 (0.0011) [2023-12-26 06:37:57,651][123091] Updated weights for policy 0, policy_version 882080 (0.0010) [2023-12-26 06:37:57,712][123091] Updated weights for policy 0, policy_version 882091 (0.0009) [2023-12-26 06:37:58,204][123090] Updated weights for policy 1, policy_version 875940 (0.0010) [2023-12-26 06:37:58,256][123090] Updated weights for policy 1, policy_version 875950 (0.0010) [2023-12-26 06:37:58,319][123090] Updated weights for policy 1, policy_version 875960 (0.0010) [2023-12-26 06:37:58,500][123091] Updated weights for policy 0, policy_version 882101 (0.0009) [2023-12-26 06:37:58,560][123091] Updated weights for policy 0, policy_version 882111 (0.0008) [2023-12-26 06:37:58,625][123091] Updated weights for policy 0, policy_version 882121 (0.0006) [2023-12-26 06:37:58,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17749.2, 300 sec: 17633.6). Total num frames: 450076672. Throughput: 0: 8599.1, 1: 8987.7. Samples: 450066884. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:37:58,786][121949] Avg episode reward: [(0, '6263.149'), (1, '5584.010')] [2023-12-26 06:37:59,200][123090] Updated weights for policy 1, policy_version 875970 (0.0010) [2023-12-26 06:37:59,286][123090] Updated weights for policy 1, policy_version 875980 (0.0008) [2023-12-26 06:37:59,355][123090] Updated weights for policy 1, policy_version 875990 (0.0007) [2023-12-26 06:37:59,415][123090] Updated weights for policy 1, policy_version 876000 (0.0007) [2023-12-26 06:37:59,531][123091] Updated weights for policy 0, policy_version 882131 (0.0008) [2023-12-26 06:37:59,583][123091] Updated weights for policy 0, policy_version 882141 (0.0009) [2023-12-26 06:37:59,642][123091] Updated weights for policy 0, policy_version 882151 (0.0008) [2023-12-26 06:38:00,155][123090] Updated weights for policy 1, policy_version 876010 (0.0010) [2023-12-26 06:38:00,221][123090] Updated weights for policy 1, policy_version 876020 (0.0010) [2023-12-26 06:38:00,286][123090] Updated weights for policy 1, policy_version 876030 (0.0010) [2023-12-26 06:38:00,528][123091] Updated weights for policy 0, policy_version 882161 (0.0010) [2023-12-26 06:38:00,575][123091] Updated weights for policy 0, policy_version 882171 (0.0010) [2023-12-26 06:38:00,628][123091] Updated weights for policy 0, policy_version 882181 (0.0010) [2023-12-26 06:38:00,678][123091] Updated weights for policy 0, policy_version 882191 (0.0010) [2023-12-26 06:38:01,100][123090] Updated weights for policy 1, policy_version 876040 (0.0010) [2023-12-26 06:38:01,171][123090] Updated weights for policy 1, policy_version 876050 (0.0009) [2023-12-26 06:38:01,224][123090] Updated weights for policy 1, policy_version 876060 (0.0009) [2023-12-26 06:38:01,432][123091] Updated weights for policy 0, policy_version 882201 (0.0007) [2023-12-26 06:38:01,495][123091] Updated weights for policy 0, policy_version 882211 (0.0006) [2023-12-26 06:38:01,567][123091] Updated weights for policy 0, policy_version 882221 (0.0010) [2023-12-26 06:38:02,041][123090] Updated weights for policy 1, policy_version 876070 (0.0007) [2023-12-26 06:38:02,090][123090] Updated weights for policy 1, policy_version 876080 (0.0006) [2023-12-26 06:38:02,168][123090] Updated weights for policy 1, policy_version 876090 (0.0005) [2023-12-26 06:38:02,376][123091] Updated weights for policy 0, policy_version 882231 (0.0010) [2023-12-26 06:38:02,439][123091] Updated weights for policy 0, policy_version 882241 (0.0009) [2023-12-26 06:38:02,505][123091] Updated weights for policy 0, policy_version 882251 (0.0010) [2023-12-26 06:38:02,839][123090] Updated weights for policy 1, policy_version 876100 (0.0005) [2023-12-26 06:38:02,904][123090] Updated weights for policy 1, policy_version 876110 (0.0008) [2023-12-26 06:38:02,980][123090] Updated weights for policy 1, policy_version 876120 (0.0007) [2023-12-26 06:38:03,284][123091] Updated weights for policy 0, policy_version 882261 (0.0007) [2023-12-26 06:38:03,336][123091] Updated weights for policy 0, policy_version 882271 (0.0005) [2023-12-26 06:38:03,393][123091] Updated weights for policy 0, policy_version 882281 (0.0005) [2023-12-26 06:38:03,783][123090] Updated weights for policy 1, policy_version 876130 (0.0009) [2023-12-26 06:38:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 450158592. Throughput: 0: 8606.4, 1: 9006.2. Samples: 450172228. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:38:03,784][121949] Avg episode reward: [(0, '6163.632'), (1, '5428.741')] [2023-12-26 06:38:03,832][123090] Updated weights for policy 1, policy_version 876140 (0.0009) [2023-12-26 06:38:03,886][123090] Updated weights for policy 1, policy_version 876150 (0.0009) [2023-12-26 06:38:03,944][123090] Updated weights for policy 1, policy_version 876160 (0.0010) [2023-12-26 06:38:04,086][123091] Updated weights for policy 0, policy_version 882291 (0.0007) [2023-12-26 06:38:04,152][123091] Updated weights for policy 0, policy_version 882301 (0.0009) [2023-12-26 06:38:04,223][123091] Updated weights for policy 0, policy_version 882311 (0.0010) [2023-12-26 06:38:04,860][123090] Updated weights for policy 1, policy_version 876170 (0.0009) [2023-12-26 06:38:04,916][123091] Updated weights for policy 0, policy_version 882321 (0.0008) [2023-12-26 06:38:04,922][123090] Updated weights for policy 1, policy_version 876180 (0.0011) [2023-12-26 06:38:04,966][123091] Updated weights for policy 0, policy_version 882331 (0.0008) [2023-12-26 06:38:04,979][123090] Updated weights for policy 1, policy_version 876190 (0.0008) [2023-12-26 06:38:05,014][123091] Updated weights for policy 0, policy_version 882341 (0.0009) [2023-12-26 06:38:05,086][123091] Updated weights for policy 0, policy_version 882351 (0.0007) [2023-12-26 06:38:05,688][123090] Updated weights for policy 1, policy_version 876200 (0.0008) [2023-12-26 06:38:05,735][123090] Updated weights for policy 1, policy_version 876210 (0.0009) [2023-12-26 06:38:05,788][123090] Updated weights for policy 1, policy_version 876220 (0.0009) [2023-12-26 06:38:05,925][123091] Updated weights for policy 0, policy_version 882361 (0.0008) [2023-12-26 06:38:05,977][123091] Updated weights for policy 0, policy_version 882371 (0.0008) [2023-12-26 06:38:06,025][123091] Updated weights for policy 0, policy_version 882381 (0.0008) [2023-12-26 06:38:06,699][123090] Updated weights for policy 1, policy_version 876230 (0.0010) [2023-12-26 06:38:06,773][123090] Updated weights for policy 1, policy_version 876240 (0.0009) [2023-12-26 06:38:06,815][123091] Updated weights for policy 0, policy_version 882391 (0.0009) [2023-12-26 06:38:06,837][123090] Updated weights for policy 1, policy_version 876250 (0.0008) [2023-12-26 06:38:06,875][123091] Updated weights for policy 0, policy_version 882401 (0.0009) [2023-12-26 06:38:06,947][123091] Updated weights for policy 0, policy_version 882411 (0.0009) [2023-12-26 06:38:07,640][123090] Updated weights for policy 1, policy_version 876260 (0.0010) [2023-12-26 06:38:07,696][123091] Updated weights for policy 0, policy_version 882421 (0.0009) [2023-12-26 06:38:07,697][123090] Updated weights for policy 1, policy_version 876270 (0.0009) [2023-12-26 06:38:07,754][123090] Updated weights for policy 1, policy_version 876280 (0.0009) [2023-12-26 06:38:07,767][123091] Updated weights for policy 0, policy_version 882431 (0.0008) [2023-12-26 06:38:07,829][123091] Updated weights for policy 0, policy_version 882441 (0.0009) [2023-12-26 06:38:08,571][123091] Updated weights for policy 0, policy_version 882451 (0.0008) [2023-12-26 06:38:08,634][123090] Updated weights for policy 1, policy_version 876290 (0.0008) [2023-12-26 06:38:08,634][123091] Updated weights for policy 0, policy_version 882461 (0.0011) [2023-12-26 06:38:08,685][123090] Updated weights for policy 1, policy_version 876300 (0.0008) [2023-12-26 06:38:08,688][123091] Updated weights for policy 0, policy_version 882471 (0.0010) [2023-12-26 06:38:08,738][123090] Updated weights for policy 1, policy_version 876310 (0.0009) [2023-12-26 06:38:08,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 450248704. Throughput: 0: 8667.4, 1: 8993.2. Samples: 450224652. Policy #0 lag: (min: 6.0, avg: 12.8, max: 38.0) [2023-12-26 06:38:08,785][121949] Avg episode reward: [(0, '6196.612'), (1, '5454.000')] [2023-12-26 06:38:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000882480_225918976.pth... [2023-12-26 06:38:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000876320_224337920.pth... [2023-12-26 06:38:08,791][123090] Updated weights for policy 1, policy_version 876320 (0.0010) [2023-12-26 06:38:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000875264_224067584.pth [2023-12-26 06:38:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000881456_225656832.pth [2023-12-26 06:38:09,423][123091] Updated weights for policy 0, policy_version 882481 (0.0005) [2023-12-26 06:38:09,490][123091] Updated weights for policy 0, policy_version 882491 (0.0011) [2023-12-26 06:38:09,554][123091] Updated weights for policy 0, policy_version 882501 (0.0011) [2023-12-26 06:38:09,633][123091] Updated weights for policy 0, policy_version 882511 (0.0009) [2023-12-26 06:38:09,758][123090] Updated weights for policy 1, policy_version 876330 (0.0009) [2023-12-26 06:38:09,824][123090] Updated weights for policy 1, policy_version 876340 (0.0010) [2023-12-26 06:38:09,892][123090] Updated weights for policy 1, policy_version 876350 (0.0007) [2023-12-26 06:38:10,457][123091] Updated weights for policy 0, policy_version 882521 (0.0011) [2023-12-26 06:38:10,516][123091] Updated weights for policy 0, policy_version 882531 (0.0011) [2023-12-26 06:38:10,577][123091] Updated weights for policy 0, policy_version 882541 (0.0010) [2023-12-26 06:38:10,766][123090] Updated weights for policy 1, policy_version 876360 (0.0009) [2023-12-26 06:38:10,830][123090] Updated weights for policy 1, policy_version 876370 (0.0009) [2023-12-26 06:38:10,903][123090] Updated weights for policy 1, policy_version 876380 (0.0009) [2023-12-26 06:38:11,303][123091] Updated weights for policy 0, policy_version 882551 (0.0009) [2023-12-26 06:38:11,376][123091] Updated weights for policy 0, policy_version 882561 (0.0011) [2023-12-26 06:38:11,433][123091] Updated weights for policy 0, policy_version 882571 (0.0011) [2023-12-26 06:38:11,797][123090] Updated weights for policy 1, policy_version 876390 (0.0008) [2023-12-26 06:38:11,869][123090] Updated weights for policy 1, policy_version 876400 (0.0008) [2023-12-26 06:38:11,936][123090] Updated weights for policy 1, policy_version 876410 (0.0008) [2023-12-26 06:38:12,259][123091] Updated weights for policy 0, policy_version 882581 (0.0009) [2023-12-26 06:38:12,329][123091] Updated weights for policy 0, policy_version 882591 (0.0008) [2023-12-26 06:38:12,399][123091] Updated weights for policy 0, policy_version 882601 (0.0008) [2023-12-26 06:38:12,719][123090] Updated weights for policy 1, policy_version 876420 (0.0009) [2023-12-26 06:38:12,777][123090] Updated weights for policy 1, policy_version 876430 (0.0009) [2023-12-26 06:38:12,831][123090] Updated weights for policy 1, policy_version 876440 (0.0009) [2023-12-26 06:38:13,177][123091] Updated weights for policy 0, policy_version 882611 (0.0009) [2023-12-26 06:38:13,236][123091] Updated weights for policy 0, policy_version 882621 (0.0010) [2023-12-26 06:38:13,301][123091] Updated weights for policy 0, policy_version 882631 (0.0010) [2023-12-26 06:38:13,635][123090] Updated weights for policy 1, policy_version 876450 (0.0009) [2023-12-26 06:38:13,698][123090] Updated weights for policy 1, policy_version 876460 (0.0010) [2023-12-26 06:38:13,762][123090] Updated weights for policy 1, policy_version 876470 (0.0007) [2023-12-26 06:38:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 450330624. Throughput: 0: 8680.6, 1: 8857.3. Samples: 450328908. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:13,784][121949] Avg episode reward: [(0, '6208.429'), (1, '5559.060')] [2023-12-26 06:38:13,821][123090] Updated weights for policy 1, policy_version 876480 (0.0009) [2023-12-26 06:38:14,130][123091] Updated weights for policy 0, policy_version 882641 (0.0011) [2023-12-26 06:38:14,184][123091] Updated weights for policy 0, policy_version 882651 (0.0009) [2023-12-26 06:38:14,240][123091] Updated weights for policy 0, policy_version 882661 (0.0010) [2023-12-26 06:38:14,308][123091] Updated weights for policy 0, policy_version 882671 (0.0008) [2023-12-26 06:38:14,637][123090] Updated weights for policy 1, policy_version 876490 (0.0009) [2023-12-26 06:38:14,699][123090] Updated weights for policy 1, policy_version 876500 (0.0007) [2023-12-26 06:38:14,758][123090] Updated weights for policy 1, policy_version 876510 (0.0010) [2023-12-26 06:38:15,007][123091] Updated weights for policy 0, policy_version 882681 (0.0010) [2023-12-26 06:38:15,071][123091] Updated weights for policy 0, policy_version 882691 (0.0006) [2023-12-26 06:38:15,138][123091] Updated weights for policy 0, policy_version 882701 (0.0005) [2023-12-26 06:38:15,631][123090] Updated weights for policy 1, policy_version 876520 (0.0010) [2023-12-26 06:38:15,697][123090] Updated weights for policy 1, policy_version 876530 (0.0009) [2023-12-26 06:38:15,755][123090] Updated weights for policy 1, policy_version 876540 (0.0010) [2023-12-26 06:38:15,826][123091] Updated weights for policy 0, policy_version 882711 (0.0005) [2023-12-26 06:38:15,870][123091] Updated weights for policy 0, policy_version 882721 (0.0005) [2023-12-26 06:38:15,941][123091] Updated weights for policy 0, policy_version 882731 (0.0005) [2023-12-26 06:38:16,570][123090] Updated weights for policy 1, policy_version 876550 (0.0010) [2023-12-26 06:38:16,627][123091] Updated weights for policy 0, policy_version 882741 (0.0005) [2023-12-26 06:38:16,630][123090] Updated weights for policy 1, policy_version 876561 (0.0009) [2023-12-26 06:38:16,681][123091] Updated weights for policy 0, policy_version 882751 (0.0005) [2023-12-26 06:38:16,682][123090] Updated weights for policy 1, policy_version 876571 (0.0008) [2023-12-26 06:38:16,742][123091] Updated weights for policy 0, policy_version 882761 (0.0005) [2023-12-26 06:38:17,445][123091] Updated weights for policy 0, policy_version 882771 (0.0006) [2023-12-26 06:38:17,517][123091] Updated weights for policy 0, policy_version 882782 (0.0008) [2023-12-26 06:38:17,568][123090] Updated weights for policy 1, policy_version 876581 (0.0008) [2023-12-26 06:38:17,571][123091] Updated weights for policy 0, policy_version 882792 (0.0008) [2023-12-26 06:38:17,617][123090] Updated weights for policy 1, policy_version 876591 (0.0008) [2023-12-26 06:38:17,670][123090] Updated weights for policy 1, policy_version 876601 (0.0010) [2023-12-26 06:38:18,287][123091] Updated weights for policy 0, policy_version 882802 (0.0007) [2023-12-26 06:38:18,357][123091] Updated weights for policy 0, policy_version 882813 (0.0009) [2023-12-26 06:38:18,423][123091] Updated weights for policy 0, policy_version 882823 (0.0009) [2023-12-26 06:38:18,576][123090] Updated weights for policy 1, policy_version 876611 (0.0010) [2023-12-26 06:38:18,638][123090] Updated weights for policy 1, policy_version 876621 (0.0010) [2023-12-26 06:38:18,707][123090] Updated weights for policy 1, policy_version 876631 (0.0009) [2023-12-26 06:38:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 450428928. Throughput: 0: 8805.3, 1: 8735.9. Samples: 450435304. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:18,785][121949] Avg episode reward: [(0, '6182.148'), (1, '5635.457')] [2023-12-26 06:38:19,167][123091] Updated weights for policy 0, policy_version 882833 (0.0008) [2023-12-26 06:38:19,239][123091] Updated weights for policy 0, policy_version 882843 (0.0006) [2023-12-26 06:38:19,301][123091] Updated weights for policy 0, policy_version 882853 (0.0008) [2023-12-26 06:38:19,375][123091] Updated weights for policy 0, policy_version 882863 (0.0008) [2023-12-26 06:38:19,567][123090] Updated weights for policy 1, policy_version 876641 (0.0008) [2023-12-26 06:38:19,628][123090] Updated weights for policy 1, policy_version 876651 (0.0010) [2023-12-26 06:38:19,692][123090] Updated weights for policy 1, policy_version 876661 (0.0010) [2023-12-26 06:38:19,741][123090] Updated weights for policy 1, policy_version 876671 (0.0010) [2023-12-26 06:38:20,132][123091] Updated weights for policy 0, policy_version 882873 (0.0009) [2023-12-26 06:38:20,193][123091] Updated weights for policy 0, policy_version 882883 (0.0009) [2023-12-26 06:38:20,247][123091] Updated weights for policy 0, policy_version 882893 (0.0010) [2023-12-26 06:38:20,542][123090] Updated weights for policy 1, policy_version 876681 (0.0011) [2023-12-26 06:38:20,609][123090] Updated weights for policy 1, policy_version 876691 (0.0011) [2023-12-26 06:38:20,665][123090] Updated weights for policy 1, policy_version 876701 (0.0011) [2023-12-26 06:38:21,197][123091] Updated weights for policy 0, policy_version 882903 (0.0009) [2023-12-26 06:38:21,258][123091] Updated weights for policy 0, policy_version 882913 (0.0008) [2023-12-26 06:38:21,328][123091] Updated weights for policy 0, policy_version 882923 (0.0009) [2023-12-26 06:38:21,475][123090] Updated weights for policy 1, policy_version 876711 (0.0009) [2023-12-26 06:38:21,549][123090] Updated weights for policy 1, policy_version 876721 (0.0008) [2023-12-26 06:38:21,607][123090] Updated weights for policy 1, policy_version 876731 (0.0008) [2023-12-26 06:38:22,209][123091] Updated weights for policy 0, policy_version 882933 (0.0009) [2023-12-26 06:38:22,269][123091] Updated weights for policy 0, policy_version 882943 (0.0009) [2023-12-26 06:38:22,330][123091] Updated weights for policy 0, policy_version 882953 (0.0009) [2023-12-26 06:38:22,416][123090] Updated weights for policy 1, policy_version 876741 (0.0011) [2023-12-26 06:38:22,465][123090] Updated weights for policy 1, policy_version 876751 (0.0010) [2023-12-26 06:38:22,517][123090] Updated weights for policy 1, policy_version 876761 (0.0010) [2023-12-26 06:38:23,177][123091] Updated weights for policy 0, policy_version 882963 (0.0009) [2023-12-26 06:38:23,243][123091] Updated weights for policy 0, policy_version 882973 (0.0009) [2023-12-26 06:38:23,307][123091] Updated weights for policy 0, policy_version 882983 (0.0009) [2023-12-26 06:38:23,345][123090] Updated weights for policy 1, policy_version 876771 (0.0010) [2023-12-26 06:38:23,411][123090] Updated weights for policy 1, policy_version 876781 (0.0008) [2023-12-26 06:38:23,480][123090] Updated weights for policy 1, policy_version 876791 (0.0005) [2023-12-26 06:38:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 450510848. Throughput: 0: 8820.2, 1: 8726.8. Samples: 450486468. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:23,785][121949] Avg episode reward: [(0, '6146.271'), (1, '5587.748')] [2023-12-26 06:38:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000876800_224460800.pth... [2023-12-26 06:38:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000882992_226050048.pth... [2023-12-26 06:38:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000875808_224206848.pth [2023-12-26 06:38:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000881936_225779712.pth [2023-12-26 06:38:24,074][123091] Updated weights for policy 0, policy_version 882993 (0.0009) [2023-12-26 06:38:24,133][123091] Updated weights for policy 0, policy_version 883003 (0.0009) [2023-12-26 06:38:24,193][123090] Updated weights for policy 1, policy_version 876801 (0.0006) [2023-12-26 06:38:24,197][123091] Updated weights for policy 0, policy_version 883013 (0.0008) [2023-12-26 06:38:24,250][123090] Updated weights for policy 1, policy_version 876811 (0.0007) [2023-12-26 06:38:24,259][123091] Updated weights for policy 0, policy_version 883023 (0.0009) [2023-12-26 06:38:24,316][123090] Updated weights for policy 1, policy_version 876821 (0.0008) [2023-12-26 06:38:24,381][123090] Updated weights for policy 1, policy_version 876831 (0.0009) [2023-12-26 06:38:25,071][123091] Updated weights for policy 0, policy_version 883033 (0.0009) [2023-12-26 06:38:25,118][123090] Updated weights for policy 1, policy_version 876841 (0.0005) [2023-12-26 06:38:25,133][123091] Updated weights for policy 0, policy_version 883043 (0.0007) [2023-12-26 06:38:25,184][123090] Updated weights for policy 1, policy_version 876851 (0.0007) [2023-12-26 06:38:25,198][123091] Updated weights for policy 0, policy_version 883053 (0.0008) [2023-12-26 06:38:25,260][123090] Updated weights for policy 1, policy_version 876861 (0.0006) [2023-12-26 06:38:25,923][123091] Updated weights for policy 0, policy_version 883063 (0.0007) [2023-12-26 06:38:25,988][123091] Updated weights for policy 0, policy_version 883073 (0.0006) [2023-12-26 06:38:26,002][123090] Updated weights for policy 1, policy_version 876871 (0.0008) [2023-12-26 06:38:26,050][123091] Updated weights for policy 0, policy_version 883083 (0.0010) [2023-12-26 06:38:26,058][123090] Updated weights for policy 1, policy_version 876881 (0.0007) [2023-12-26 06:38:26,121][123090] Updated weights for policy 1, policy_version 876891 (0.0009) [2023-12-26 06:38:26,807][123090] Updated weights for policy 1, policy_version 876901 (0.0007) [2023-12-26 06:38:26,841][123091] Updated weights for policy 0, policy_version 883093 (0.0010) [2023-12-26 06:38:26,857][123090] Updated weights for policy 1, policy_version 876911 (0.0005) [2023-12-26 06:38:26,907][123091] Updated weights for policy 0, policy_version 883103 (0.0010) [2023-12-26 06:38:26,920][123090] Updated weights for policy 1, policy_version 876921 (0.0007) [2023-12-26 06:38:26,967][123091] Updated weights for policy 0, policy_version 883113 (0.0006) [2023-12-26 06:38:27,662][123090] Updated weights for policy 1, policy_version 876931 (0.0008) [2023-12-26 06:38:27,676][123091] Updated weights for policy 0, policy_version 883123 (0.0006) [2023-12-26 06:38:27,726][123091] Updated weights for policy 0, policy_version 883133 (0.0006) [2023-12-26 06:38:27,735][123090] Updated weights for policy 1, policy_version 876941 (0.0008) [2023-12-26 06:38:27,780][123091] Updated weights for policy 0, policy_version 883143 (0.0006) [2023-12-26 06:38:27,810][123090] Updated weights for policy 1, policy_version 876951 (0.0007) [2023-12-26 06:38:28,431][123090] Updated weights for policy 1, policy_version 876961 (0.0005) [2023-12-26 06:38:28,477][123091] Updated weights for policy 0, policy_version 883153 (0.0006) [2023-12-26 06:38:28,498][123090] Updated weights for policy 1, policy_version 876971 (0.0006) [2023-12-26 06:38:28,535][123091] Updated weights for policy 0, policy_version 883163 (0.0009) [2023-12-26 06:38:28,560][123090] Updated weights for policy 1, policy_version 876981 (0.0008) [2023-12-26 06:38:28,596][123091] Updated weights for policy 0, policy_version 883173 (0.0010) [2023-12-26 06:38:28,622][123090] Updated weights for policy 1, policy_version 876991 (0.0007) [2023-12-26 06:38:28,664][123091] Updated weights for policy 0, policy_version 883183 (0.0009) [2023-12-26 06:38:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 450609152. Throughput: 0: 8856.3, 1: 8741.1. Samples: 450594812. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:28,785][121949] Avg episode reward: [(0, '6078.429'), (1, '5540.451')] [2023-12-26 06:38:29,320][123090] Updated weights for policy 1, policy_version 877001 (0.0007) [2023-12-26 06:38:29,392][123090] Updated weights for policy 1, policy_version 877011 (0.0009) [2023-12-26 06:38:29,443][123090] Updated weights for policy 1, policy_version 877021 (0.0008) [2023-12-26 06:38:29,458][123091] Updated weights for policy 0, policy_version 883193 (0.0009) [2023-12-26 06:38:29,517][123091] Updated weights for policy 0, policy_version 883203 (0.0008) [2023-12-26 06:38:29,581][123091] Updated weights for policy 0, policy_version 883213 (0.0009) [2023-12-26 06:38:30,242][123090] Updated weights for policy 1, policy_version 877031 (0.0006) [2023-12-26 06:38:30,309][123090] Updated weights for policy 1, policy_version 877041 (0.0007) [2023-12-26 06:38:30,378][123090] Updated weights for policy 1, policy_version 877051 (0.0009) [2023-12-26 06:38:30,416][123091] Updated weights for policy 0, policy_version 883223 (0.0008) [2023-12-26 06:38:30,478][123091] Updated weights for policy 0, policy_version 883233 (0.0009) [2023-12-26 06:38:30,538][123091] Updated weights for policy 0, policy_version 883243 (0.0009) [2023-12-26 06:38:31,166][123090] Updated weights for policy 1, policy_version 877061 (0.0008) [2023-12-26 06:38:31,218][123090] Updated weights for policy 1, policy_version 877071 (0.0008) [2023-12-26 06:38:31,274][123090] Updated weights for policy 1, policy_version 877081 (0.0009) [2023-12-26 06:38:31,297][123091] Updated weights for policy 0, policy_version 883253 (0.0010) [2023-12-26 06:38:31,358][123091] Updated weights for policy 0, policy_version 883263 (0.0011) [2023-12-26 06:38:31,420][123091] Updated weights for policy 0, policy_version 883273 (0.0007) [2023-12-26 06:38:32,135][123090] Updated weights for policy 1, policy_version 877091 (0.0005) [2023-12-26 06:38:32,207][123090] Updated weights for policy 1, policy_version 877101 (0.0005) [2023-12-26 06:38:32,233][123091] Updated weights for policy 0, policy_version 883283 (0.0011) [2023-12-26 06:38:32,273][123090] Updated weights for policy 1, policy_version 877111 (0.0007) [2023-12-26 06:38:32,291][123091] Updated weights for policy 0, policy_version 883293 (0.0007) [2023-12-26 06:38:32,348][123091] Updated weights for policy 0, policy_version 883303 (0.0007) [2023-12-26 06:38:33,000][123090] Updated weights for policy 1, policy_version 877121 (0.0008) [2023-12-26 06:38:33,064][123090] Updated weights for policy 1, policy_version 877131 (0.0005) [2023-12-26 06:38:33,133][123090] Updated weights for policy 1, policy_version 877141 (0.0006) [2023-12-26 06:38:33,164][123091] Updated weights for policy 0, policy_version 883313 (0.0011) [2023-12-26 06:38:33,190][123090] Updated weights for policy 1, policy_version 877151 (0.0010) [2023-12-26 06:38:33,211][123091] Updated weights for policy 0, policy_version 883323 (0.0010) [2023-12-26 06:38:33,261][123091] Updated weights for policy 0, policy_version 883333 (0.0010) [2023-12-26 06:38:33,315][123091] Updated weights for policy 0, policy_version 883343 (0.0010) [2023-12-26 06:38:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 450691072. Throughput: 0: 8911.6, 1: 8737.2. Samples: 450704008. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:33,785][121949] Avg episode reward: [(0, '6112.907'), (1, '5569.850')] [2023-12-26 06:38:33,942][123090] Updated weights for policy 1, policy_version 877161 (0.0007) [2023-12-26 06:38:34,006][123090] Updated weights for policy 1, policy_version 877171 (0.0010) [2023-12-26 06:38:34,059][123091] Updated weights for policy 0, policy_version 883353 (0.0009) [2023-12-26 06:38:34,061][123090] Updated weights for policy 1, policy_version 877181 (0.0010) [2023-12-26 06:38:34,114][123091] Updated weights for policy 0, policy_version 883363 (0.0006) [2023-12-26 06:38:34,182][123091] Updated weights for policy 0, policy_version 883373 (0.0008) [2023-12-26 06:38:34,906][123090] Updated weights for policy 1, policy_version 877191 (0.0010) [2023-12-26 06:38:34,973][123090] Updated weights for policy 1, policy_version 877201 (0.0011) [2023-12-26 06:38:34,992][123091] Updated weights for policy 0, policy_version 883383 (0.0008) [2023-12-26 06:38:35,041][123090] Updated weights for policy 1, policy_version 877211 (0.0011) [2023-12-26 06:38:35,053][123091] Updated weights for policy 0, policy_version 883393 (0.0008) [2023-12-26 06:38:35,116][123091] Updated weights for policy 0, policy_version 883403 (0.0009) [2023-12-26 06:38:35,857][123090] Updated weights for policy 1, policy_version 877221 (0.0010) [2023-12-26 06:38:35,909][123090] Updated weights for policy 1, policy_version 877231 (0.0010) [2023-12-26 06:38:35,944][123091] Updated weights for policy 0, policy_version 883413 (0.0009) [2023-12-26 06:38:35,969][123090] Updated weights for policy 1, policy_version 877241 (0.0010) [2023-12-26 06:38:36,003][123091] Updated weights for policy 0, policy_version 883423 (0.0008) [2023-12-26 06:38:36,064][123091] Updated weights for policy 0, policy_version 883433 (0.0009) [2023-12-26 06:38:36,717][123090] Updated weights for policy 1, policy_version 877251 (0.0009) [2023-12-26 06:38:36,774][123090] Updated weights for policy 1, policy_version 877261 (0.0008) [2023-12-26 06:38:36,836][123090] Updated weights for policy 1, policy_version 877271 (0.0010) [2023-12-26 06:38:36,954][123091] Updated weights for policy 0, policy_version 883443 (0.0009) [2023-12-26 06:38:37,007][123091] Updated weights for policy 0, policy_version 883453 (0.0009) [2023-12-26 06:38:37,064][123091] Updated weights for policy 0, policy_version 883463 (0.0009) [2023-12-26 06:38:37,616][123090] Updated weights for policy 1, policy_version 877281 (0.0010) [2023-12-26 06:38:37,664][123090] Updated weights for policy 1, policy_version 877291 (0.0010) [2023-12-26 06:38:37,718][123090] Updated weights for policy 1, policy_version 877301 (0.0010) [2023-12-26 06:38:37,769][123090] Updated weights for policy 1, policy_version 877311 (0.0010) [2023-12-26 06:38:37,786][123091] Updated weights for policy 0, policy_version 883473 (0.0009) [2023-12-26 06:38:37,837][123091] Updated weights for policy 0, policy_version 883483 (0.0010) [2023-12-26 06:38:37,888][123091] Updated weights for policy 0, policy_version 883493 (0.0010) [2023-12-26 06:38:37,951][123091] Updated weights for policy 0, policy_version 883503 (0.0011) [2023-12-26 06:38:38,609][123090] Updated weights for policy 1, policy_version 877321 (0.0011) [2023-12-26 06:38:38,685][123090] Updated weights for policy 1, policy_version 877331 (0.0011) [2023-12-26 06:38:38,725][123091] Updated weights for policy 0, policy_version 883513 (0.0010) [2023-12-26 06:38:38,753][123090] Updated weights for policy 1, policy_version 877341 (0.0011) [2023-12-26 06:38:38,781][123091] Updated weights for policy 0, policy_version 883523 (0.0010) [2023-12-26 06:38:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 450781184. Throughput: 0: 8923.3, 1: 8750.8. Samples: 450756580. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:38,784][121949] Avg episode reward: [(0, '6109.232'), (1, '5394.693')] [2023-12-26 06:38:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000877344_224600064.pth... [2023-12-26 06:38:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000876320_224337920.pth [2023-12-26 06:38:38,840][123091] Updated weights for policy 0, policy_version 883533 (0.0010) [2023-12-26 06:38:38,859][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000883536_226189312.pth... [2023-12-26 06:38:38,864][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000882480_225918976.pth [2023-12-26 06:38:39,627][123090] Updated weights for policy 1, policy_version 877351 (0.0010) [2023-12-26 06:38:39,696][123091] Updated weights for policy 0, policy_version 883543 (0.0008) [2023-12-26 06:38:39,699][123090] Updated weights for policy 1, policy_version 877361 (0.0011) [2023-12-26 06:38:39,761][123091] Updated weights for policy 0, policy_version 883553 (0.0009) [2023-12-26 06:38:39,767][123090] Updated weights for policy 1, policy_version 877371 (0.0010) [2023-12-26 06:38:39,835][123091] Updated weights for policy 0, policy_version 883563 (0.0010) [2023-12-26 06:38:40,589][123090] Updated weights for policy 1, policy_version 877381 (0.0009) [2023-12-26 06:38:40,596][123091] Updated weights for policy 0, policy_version 883573 (0.0008) [2023-12-26 06:38:40,637][123090] Updated weights for policy 1, policy_version 877391 (0.0010) [2023-12-26 06:38:40,657][123091] Updated weights for policy 0, policy_version 883583 (0.0006) [2023-12-26 06:38:40,699][123090] Updated weights for policy 1, policy_version 877401 (0.0008) [2023-12-26 06:38:40,717][123091] Updated weights for policy 0, policy_version 883593 (0.0009) [2023-12-26 06:38:41,526][123090] Updated weights for policy 1, policy_version 877411 (0.0007) [2023-12-26 06:38:41,591][123090] Updated weights for policy 1, policy_version 877421 (0.0007) [2023-12-26 06:38:41,593][123091] Updated weights for policy 0, policy_version 883603 (0.0009) [2023-12-26 06:38:41,657][123091] Updated weights for policy 0, policy_version 883613 (0.0009) [2023-12-26 06:38:41,681][123090] Updated weights for policy 1, policy_version 877431 (0.0009) [2023-12-26 06:38:41,715][123091] Updated weights for policy 0, policy_version 883623 (0.0007) [2023-12-26 06:38:42,408][123090] Updated weights for policy 1, policy_version 877441 (0.0011) [2023-12-26 06:38:42,469][123090] Updated weights for policy 1, policy_version 877451 (0.0010) [2023-12-26 06:38:42,526][123090] Updated weights for policy 1, policy_version 877461 (0.0011) [2023-12-26 06:38:42,578][123090] Updated weights for policy 1, policy_version 877471 (0.0010) [2023-12-26 06:38:42,637][123091] Updated weights for policy 0, policy_version 883633 (0.0010) [2023-12-26 06:38:42,687][123091] Updated weights for policy 0, policy_version 883643 (0.0009) [2023-12-26 06:38:42,747][123091] Updated weights for policy 0, policy_version 883653 (0.0008) [2023-12-26 06:38:42,803][123091] Updated weights for policy 0, policy_version 883663 (0.0009) [2023-12-26 06:38:43,421][123090] Updated weights for policy 1, policy_version 877481 (0.0008) [2023-12-26 06:38:43,485][123090] Updated weights for policy 1, policy_version 877491 (0.0006) [2023-12-26 06:38:43,559][123090] Updated weights for policy 1, policy_version 877501 (0.0005) [2023-12-26 06:38:43,605][123091] Updated weights for policy 0, policy_version 883673 (0.0009) [2023-12-26 06:38:43,672][123091] Updated weights for policy 0, policy_version 883683 (0.0009) [2023-12-26 06:38:43,727][123091] Updated weights for policy 0, policy_version 883693 (0.0009) [2023-12-26 06:38:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 450871296. Throughput: 0: 8924.3, 1: 8698.4. Samples: 450859896. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:43,785][121949] Avg episode reward: [(0, '6006.322'), (1, '5447.973')] [2023-12-26 06:38:44,207][123090] Updated weights for policy 1, policy_version 877511 (0.0009) [2023-12-26 06:38:44,262][123090] Updated weights for policy 1, policy_version 877521 (0.0010) [2023-12-26 06:38:44,313][123090] Updated weights for policy 1, policy_version 877531 (0.0010) [2023-12-26 06:38:44,472][123091] Updated weights for policy 0, policy_version 883703 (0.0007) [2023-12-26 06:38:44,530][123091] Updated weights for policy 0, policy_version 883713 (0.0007) [2023-12-26 06:38:44,587][123091] Updated weights for policy 0, policy_version 883723 (0.0007) [2023-12-26 06:38:45,159][123090] Updated weights for policy 1, policy_version 877541 (0.0011) [2023-12-26 06:38:45,212][123090] Updated weights for policy 1, policy_version 877551 (0.0010) [2023-12-26 06:38:45,267][123090] Updated weights for policy 1, policy_version 877561 (0.0010) [2023-12-26 06:38:45,352][123091] Updated weights for policy 0, policy_version 883733 (0.0007) [2023-12-26 06:38:45,409][123091] Updated weights for policy 0, policy_version 883743 (0.0009) [2023-12-26 06:38:45,471][123091] Updated weights for policy 0, policy_version 883753 (0.0009) [2023-12-26 06:38:46,091][123090] Updated weights for policy 1, policy_version 877571 (0.0009) [2023-12-26 06:38:46,152][123090] Updated weights for policy 1, policy_version 877581 (0.0009) [2023-12-26 06:38:46,215][123090] Updated weights for policy 1, policy_version 877591 (0.0010) [2023-12-26 06:38:46,335][123091] Updated weights for policy 0, policy_version 883763 (0.0009) [2023-12-26 06:38:46,394][123091] Updated weights for policy 0, policy_version 883773 (0.0009) [2023-12-26 06:38:46,442][123091] Updated weights for policy 0, policy_version 883783 (0.0008) [2023-12-26 06:38:47,060][123090] Updated weights for policy 1, policy_version 877601 (0.0010) [2023-12-26 06:38:47,120][123090] Updated weights for policy 1, policy_version 877611 (0.0009) [2023-12-26 06:38:47,178][123090] Updated weights for policy 1, policy_version 877621 (0.0010) [2023-12-26 06:38:47,231][123090] Updated weights for policy 1, policy_version 877631 (0.0009) [2023-12-26 06:38:47,237][123091] Updated weights for policy 0, policy_version 883793 (0.0008) [2023-12-26 06:38:47,300][123091] Updated weights for policy 0, policy_version 883803 (0.0009) [2023-12-26 06:38:47,347][123091] Updated weights for policy 0, policy_version 883813 (0.0009) [2023-12-26 06:38:47,395][123091] Updated weights for policy 0, policy_version 883823 (0.0009) [2023-12-26 06:38:47,928][123090] Updated weights for policy 1, policy_version 877641 (0.0006) [2023-12-26 06:38:47,977][123090] Updated weights for policy 1, policy_version 877651 (0.0005) [2023-12-26 06:38:48,035][123090] Updated weights for policy 1, policy_version 877661 (0.0006) [2023-12-26 06:38:48,130][123091] Updated weights for policy 0, policy_version 883833 (0.0008) [2023-12-26 06:38:48,182][123091] Updated weights for policy 0, policy_version 883843 (0.0011) [2023-12-26 06:38:48,234][123091] Updated weights for policy 0, policy_version 883853 (0.0011) [2023-12-26 06:38:48,711][123090] Updated weights for policy 1, policy_version 877671 (0.0008) [2023-12-26 06:38:48,776][123090] Updated weights for policy 1, policy_version 877681 (0.0009) [2023-12-26 06:38:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 450953216. Throughput: 0: 8960.7, 1: 8752.1. Samples: 450969304. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:48,785][121949] Avg episode reward: [(0, '6031.093'), (1, '5374.536')] [2023-12-26 06:38:48,834][123090] Updated weights for policy 1, policy_version 877691 (0.0009) [2023-12-26 06:38:49,041][123091] Updated weights for policy 0, policy_version 883863 (0.0007) [2023-12-26 06:38:49,110][123091] Updated weights for policy 0, policy_version 883873 (0.0005) [2023-12-26 06:38:49,174][123091] Updated weights for policy 0, policy_version 883883 (0.0009) [2023-12-26 06:38:49,759][123090] Updated weights for policy 1, policy_version 877701 (0.0010) [2023-12-26 06:38:49,822][123090] Updated weights for policy 1, policy_version 877711 (0.0009) [2023-12-26 06:38:49,893][123090] Updated weights for policy 1, policy_version 877721 (0.0009) [2023-12-26 06:38:49,924][123091] Updated weights for policy 0, policy_version 883893 (0.0008) [2023-12-26 06:38:49,993][123091] Updated weights for policy 0, policy_version 883903 (0.0007) [2023-12-26 06:38:50,067][123091] Updated weights for policy 0, policy_version 883913 (0.0005) [2023-12-26 06:38:50,675][123090] Updated weights for policy 1, policy_version 877731 (0.0007) [2023-12-26 06:38:50,735][123091] Updated weights for policy 0, policy_version 883923 (0.0005) [2023-12-26 06:38:50,754][123090] Updated weights for policy 1, policy_version 877741 (0.0007) [2023-12-26 06:38:50,806][123091] Updated weights for policy 0, policy_version 883933 (0.0006) [2023-12-26 06:38:50,812][123090] Updated weights for policy 1, policy_version 877751 (0.0006) [2023-12-26 06:38:50,876][123091] Updated weights for policy 0, policy_version 883943 (0.0010) [2023-12-26 06:38:51,622][123090] Updated weights for policy 1, policy_version 877761 (0.0006) [2023-12-26 06:38:51,689][123090] Updated weights for policy 1, policy_version 877771 (0.0009) [2023-12-26 06:38:51,710][123091] Updated weights for policy 0, policy_version 883953 (0.0009) [2023-12-26 06:38:51,757][123090] Updated weights for policy 1, policy_version 877781 (0.0008) [2023-12-26 06:38:51,777][123091] Updated weights for policy 0, policy_version 883963 (0.0009) [2023-12-26 06:38:51,808][123090] Updated weights for policy 1, policy_version 877791 (0.0008) [2023-12-26 06:38:51,824][123091] Updated weights for policy 0, policy_version 883973 (0.0008) [2023-12-26 06:38:51,874][123091] Updated weights for policy 0, policy_version 883983 (0.0009) [2023-12-26 06:38:52,700][123090] Updated weights for policy 1, policy_version 877801 (0.0009) [2023-12-26 06:38:52,716][123091] Updated weights for policy 0, policy_version 883993 (0.0007) [2023-12-26 06:38:52,765][123090] Updated weights for policy 1, policy_version 877811 (0.0008) [2023-12-26 06:38:52,771][123091] Updated weights for policy 0, policy_version 884003 (0.0009) [2023-12-26 06:38:52,821][123091] Updated weights for policy 0, policy_version 884013 (0.0009) [2023-12-26 06:38:52,829][123090] Updated weights for policy 1, policy_version 877821 (0.0008) [2023-12-26 06:38:53,602][123090] Updated weights for policy 1, policy_version 877831 (0.0007) [2023-12-26 06:38:53,676][123090] Updated weights for policy 1, policy_version 877841 (0.0005) [2023-12-26 06:38:53,707][123091] Updated weights for policy 0, policy_version 884023 (0.0007) [2023-12-26 06:38:53,741][123090] Updated weights for policy 1, policy_version 877851 (0.0005) [2023-12-26 06:38:53,777][123091] Updated weights for policy 0, policy_version 884033 (0.0008) [2023-12-26 06:38:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 451043328. Throughput: 0: 8959.8, 1: 8747.7. Samples: 451021484. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:53,785][121949] Avg episode reward: [(0, '6059.942'), (1, '5349.490')] [2023-12-26 06:38:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000877856_224731136.pth... [2023-12-26 06:38:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000876800_224460800.pth [2023-12-26 06:38:53,851][123091] Updated weights for policy 0, policy_version 884043 (0.0010) [2023-12-26 06:38:53,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000884048_226320384.pth... [2023-12-26 06:38:53,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000882992_226050048.pth [2023-12-26 06:38:54,472][123090] Updated weights for policy 1, policy_version 877861 (0.0007) [2023-12-26 06:38:54,538][123090] Updated weights for policy 1, policy_version 877871 (0.0009) [2023-12-26 06:38:54,605][123090] Updated weights for policy 1, policy_version 877881 (0.0010) [2023-12-26 06:38:54,653][123091] Updated weights for policy 0, policy_version 884053 (0.0008) [2023-12-26 06:38:54,721][123091] Updated weights for policy 0, policy_version 884063 (0.0011) [2023-12-26 06:38:54,783][123091] Updated weights for policy 0, policy_version 884073 (0.0011) [2023-12-26 06:38:55,419][123090] Updated weights for policy 1, policy_version 877891 (0.0009) [2023-12-26 06:38:55,477][123090] Updated weights for policy 1, policy_version 877901 (0.0006) [2023-12-26 06:38:55,536][123091] Updated weights for policy 0, policy_version 884083 (0.0006) [2023-12-26 06:38:55,544][123090] Updated weights for policy 1, policy_version 877911 (0.0006) [2023-12-26 06:38:55,593][123091] Updated weights for policy 0, policy_version 884093 (0.0005) [2023-12-26 06:38:55,646][123091] Updated weights for policy 0, policy_version 884103 (0.0005) [2023-12-26 06:38:56,335][123091] Updated weights for policy 0, policy_version 884113 (0.0005) [2023-12-26 06:38:56,389][123091] Updated weights for policy 0, policy_version 884123 (0.0005) [2023-12-26 06:38:56,409][123090] Updated weights for policy 1, policy_version 877921 (0.0009) [2023-12-26 06:38:56,441][123091] Updated weights for policy 0, policy_version 884133 (0.0005) [2023-12-26 06:38:56,463][123090] Updated weights for policy 1, policy_version 877931 (0.0009) [2023-12-26 06:38:56,492][123091] Updated weights for policy 0, policy_version 884143 (0.0005) [2023-12-26 06:38:56,514][123090] Updated weights for policy 1, policy_version 877941 (0.0010) [2023-12-26 06:38:56,563][123090] Updated weights for policy 1, policy_version 877951 (0.0009) [2023-12-26 06:38:57,248][123091] Updated weights for policy 0, policy_version 884153 (0.0005) [2023-12-26 06:38:57,312][123091] Updated weights for policy 0, policy_version 884163 (0.0005) [2023-12-26 06:38:57,325][123090] Updated weights for policy 1, policy_version 877961 (0.0009) [2023-12-26 06:38:57,373][123091] Updated weights for policy 0, policy_version 884173 (0.0005) [2023-12-26 06:38:57,380][123090] Updated weights for policy 1, policy_version 877971 (0.0005) [2023-12-26 06:38:57,432][123090] Updated weights for policy 1, policy_version 877981 (0.0005) [2023-12-26 06:38:58,103][123091] Updated weights for policy 0, policy_version 884183 (0.0008) [2023-12-26 06:38:58,166][123091] Updated weights for policy 0, policy_version 884193 (0.0010) [2023-12-26 06:38:58,187][123090] Updated weights for policy 1, policy_version 877991 (0.0007) [2023-12-26 06:38:58,231][123091] Updated weights for policy 0, policy_version 884203 (0.0009) [2023-12-26 06:38:58,250][123090] Updated weights for policy 1, policy_version 878001 (0.0007) [2023-12-26 06:38:58,302][123090] Updated weights for policy 1, policy_version 878011 (0.0007) [2023-12-26 06:38:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17613.0, 300 sec: 17661.4). Total num frames: 451133440. Throughput: 0: 8932.2, 1: 8831.3. Samples: 451128264. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:38:58,785][121949] Avg episode reward: [(0, '6045.644'), (1, '5520.626')] [2023-12-26 06:38:59,130][123091] Updated weights for policy 0, policy_version 884213 (0.0007) [2023-12-26 06:38:59,152][123090] Updated weights for policy 1, policy_version 878021 (0.0008) [2023-12-26 06:38:59,195][123091] Updated weights for policy 0, policy_version 884223 (0.0008) [2023-12-26 06:38:59,210][123090] Updated weights for policy 1, policy_version 878031 (0.0007) [2023-12-26 06:38:59,265][123091] Updated weights for policy 0, policy_version 884233 (0.0010) [2023-12-26 06:38:59,285][123090] Updated weights for policy 1, policy_version 878041 (0.0007) [2023-12-26 06:38:59,968][123091] Updated weights for policy 0, policy_version 884243 (0.0013) [2023-12-26 06:39:00,025][123091] Updated weights for policy 0, policy_version 884253 (0.0009) [2023-12-26 06:39:00,073][123091] Updated weights for policy 0, policy_version 884263 (0.0008) [2023-12-26 06:39:00,109][123090] Updated weights for policy 1, policy_version 878051 (0.0009) [2023-12-26 06:39:00,167][123090] Updated weights for policy 1, policy_version 878061 (0.0010) [2023-12-26 06:39:00,225][123090] Updated weights for policy 1, policy_version 878071 (0.0010) [2023-12-26 06:39:00,937][123091] Updated weights for policy 0, policy_version 884273 (0.0008) [2023-12-26 06:39:00,987][123091] Updated weights for policy 0, policy_version 884283 (0.0009) [2023-12-26 06:39:01,046][123091] Updated weights for policy 0, policy_version 884293 (0.0009) [2023-12-26 06:39:01,059][123090] Updated weights for policy 1, policy_version 878081 (0.0010) [2023-12-26 06:39:01,124][123090] Updated weights for policy 1, policy_version 878091 (0.0010) [2023-12-26 06:39:01,140][123091] Updated weights for policy 0, policy_version 884303 (0.0009) [2023-12-26 06:39:01,192][123090] Updated weights for policy 1, policy_version 878101 (0.0010) [2023-12-26 06:39:01,248][123090] Updated weights for policy 1, policy_version 878111 (0.0010) [2023-12-26 06:39:01,925][123091] Updated weights for policy 0, policy_version 884313 (0.0010) [2023-12-26 06:39:01,977][123091] Updated weights for policy 0, policy_version 884323 (0.0009) [2023-12-26 06:39:02,031][123091] Updated weights for policy 0, policy_version 884334 (0.0010) [2023-12-26 06:39:02,070][123090] Updated weights for policy 1, policy_version 878121 (0.0009) [2023-12-26 06:39:02,128][123090] Updated weights for policy 1, policy_version 878131 (0.0009) [2023-12-26 06:39:02,182][123090] Updated weights for policy 1, policy_version 878141 (0.0010) [2023-12-26 06:39:02,931][123090] Updated weights for policy 1, policy_version 878151 (0.0007) [2023-12-26 06:39:02,934][123091] Updated weights for policy 0, policy_version 884344 (0.0008) [2023-12-26 06:39:02,995][123090] Updated weights for policy 1, policy_version 878161 (0.0005) [2023-12-26 06:39:02,998][123091] Updated weights for policy 0, policy_version 884354 (0.0009) [2023-12-26 06:39:03,058][123090] Updated weights for policy 1, policy_version 878171 (0.0005) [2023-12-26 06:39:03,071][123091] Updated weights for policy 0, policy_version 884364 (0.0008) [2023-12-26 06:39:03,669][123090] Updated weights for policy 1, policy_version 878181 (0.0005) [2023-12-26 06:39:03,717][123090] Updated weights for policy 1, policy_version 878191 (0.0006) [2023-12-26 06:39:03,773][123090] Updated weights for policy 1, policy_version 878201 (0.0009) [2023-12-26 06:39:03,783][123091] Updated weights for policy 0, policy_version 884374 (0.0008) [2023-12-26 06:39:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 451215360. Throughput: 0: 8837.5, 1: 8894.6. Samples: 451233248. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:03,785][121949] Avg episode reward: [(0, '6105.790'), (1, '5560.623')] [2023-12-26 06:39:03,837][123091] Updated weights for policy 0, policy_version 884384 (0.0007) [2023-12-26 06:39:03,899][123091] Updated weights for policy 0, policy_version 884394 (0.0009) [2023-12-26 06:39:04,621][123090] Updated weights for policy 1, policy_version 878211 (0.0009) [2023-12-26 06:39:04,669][123090] Updated weights for policy 1, policy_version 878221 (0.0010) [2023-12-26 06:39:04,720][123090] Updated weights for policy 1, policy_version 878231 (0.0010) [2023-12-26 06:39:04,740][123091] Updated weights for policy 0, policy_version 884404 (0.0008) [2023-12-26 06:39:04,801][123091] Updated weights for policy 0, policy_version 884414 (0.0009) [2023-12-26 06:39:04,857][123091] Updated weights for policy 0, policy_version 884424 (0.0008) [2023-12-26 06:39:05,565][123090] Updated weights for policy 1, policy_version 878241 (0.0010) [2023-12-26 06:39:05,615][123090] Updated weights for policy 1, policy_version 878251 (0.0010) [2023-12-26 06:39:05,663][123090] Updated weights for policy 1, policy_version 878261 (0.0010) [2023-12-26 06:39:05,678][123091] Updated weights for policy 0, policy_version 884434 (0.0008) [2023-12-26 06:39:05,710][123090] Updated weights for policy 1, policy_version 878271 (0.0010) [2023-12-26 06:39:05,743][123091] Updated weights for policy 0, policy_version 884444 (0.0008) [2023-12-26 06:39:05,807][123091] Updated weights for policy 0, policy_version 884454 (0.0009) [2023-12-26 06:39:05,863][123091] Updated weights for policy 0, policy_version 884464 (0.0009) [2023-12-26 06:39:06,581][123090] Updated weights for policy 1, policy_version 878281 (0.0010) [2023-12-26 06:39:06,645][123090] Updated weights for policy 1, policy_version 878291 (0.0011) [2023-12-26 06:39:06,661][123091] Updated weights for policy 0, policy_version 884474 (0.0008) [2023-12-26 06:39:06,704][123090] Updated weights for policy 1, policy_version 878301 (0.0010) [2023-12-26 06:39:06,717][123091] Updated weights for policy 0, policy_version 884484 (0.0008) [2023-12-26 06:39:06,774][123091] Updated weights for policy 0, policy_version 884494 (0.0008) [2023-12-26 06:39:07,467][123090] Updated weights for policy 1, policy_version 878311 (0.0008) [2023-12-26 06:39:07,495][123091] Updated weights for policy 0, policy_version 884504 (0.0005) [2023-12-26 06:39:07,527][123090] Updated weights for policy 1, policy_version 878321 (0.0006) [2023-12-26 06:39:07,564][123091] Updated weights for policy 0, policy_version 884514 (0.0005) [2023-12-26 06:39:07,592][123090] Updated weights for policy 1, policy_version 878331 (0.0006) [2023-12-26 06:39:07,625][123091] Updated weights for policy 0, policy_version 884524 (0.0006) [2023-12-26 06:39:08,327][123091] Updated weights for policy 0, policy_version 884534 (0.0008) [2023-12-26 06:39:08,369][123090] Updated weights for policy 1, policy_version 878341 (0.0008) [2023-12-26 06:39:08,397][123091] Updated weights for policy 0, policy_version 884544 (0.0007) [2023-12-26 06:39:08,433][123090] Updated weights for policy 1, policy_version 878351 (0.0008) [2023-12-26 06:39:08,451][123091] Updated weights for policy 0, policy_version 884554 (0.0006) [2023-12-26 06:39:08,492][123090] Updated weights for policy 1, policy_version 878361 (0.0008) [2023-12-26 06:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 451313664. Throughput: 0: 8851.5, 1: 8902.7. Samples: 451285404. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:08,785][121949] Avg episode reward: [(0, '6144.356'), (1, '5428.936')] [2023-12-26 06:39:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000884560_226451456.pth... [2023-12-26 06:39:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000878368_224862208.pth... [2023-12-26 06:39:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000883536_226189312.pth [2023-12-26 06:39:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000877344_224600064.pth [2023-12-26 06:39:09,100][123091] Updated weights for policy 0, policy_version 884564 (0.0005) [2023-12-26 06:39:09,145][123091] Updated weights for policy 0, policy_version 884574 (0.0005) [2023-12-26 06:39:09,195][123091] Updated weights for policy 0, policy_version 884584 (0.0005) [2023-12-26 06:39:09,306][123090] Updated weights for policy 1, policy_version 878371 (0.0007) [2023-12-26 06:39:09,384][123090] Updated weights for policy 1, policy_version 878381 (0.0007) [2023-12-26 06:39:09,452][123090] Updated weights for policy 1, policy_version 878391 (0.0009) [2023-12-26 06:39:09,968][123091] Updated weights for policy 0, policy_version 884595 (0.0009) [2023-12-26 06:39:10,032][123091] Updated weights for policy 0, policy_version 884605 (0.0011) [2023-12-26 06:39:10,101][123091] Updated weights for policy 0, policy_version 884615 (0.0011) [2023-12-26 06:39:10,266][123090] Updated weights for policy 1, policy_version 878401 (0.0009) [2023-12-26 06:39:10,343][123090] Updated weights for policy 1, policy_version 878411 (0.0006) [2023-12-26 06:39:10,409][123090] Updated weights for policy 1, policy_version 878421 (0.0008) [2023-12-26 06:39:10,478][123090] Updated weights for policy 1, policy_version 878431 (0.0009) [2023-12-26 06:39:10,895][123091] Updated weights for policy 0, policy_version 884625 (0.0010) [2023-12-26 06:39:10,949][123091] Updated weights for policy 0, policy_version 884635 (0.0006) [2023-12-26 06:39:11,007][123091] Updated weights for policy 0, policy_version 884645 (0.0009) [2023-12-26 06:39:11,070][123091] Updated weights for policy 0, policy_version 884655 (0.0009) [2023-12-26 06:39:11,269][123090] Updated weights for policy 1, policy_version 878441 (0.0007) [2023-12-26 06:39:11,322][123090] Updated weights for policy 1, policy_version 878451 (0.0006) [2023-12-26 06:39:11,399][123090] Updated weights for policy 1, policy_version 878461 (0.0010) [2023-12-26 06:39:11,920][123091] Updated weights for policy 0, policy_version 884665 (0.0010) [2023-12-26 06:39:11,986][123091] Updated weights for policy 0, policy_version 884675 (0.0008) [2023-12-26 06:39:12,046][123091] Updated weights for policy 0, policy_version 884685 (0.0008) [2023-12-26 06:39:12,201][123090] Updated weights for policy 1, policy_version 878471 (0.0010) [2023-12-26 06:39:12,270][123090] Updated weights for policy 1, policy_version 878481 (0.0008) [2023-12-26 06:39:12,344][123090] Updated weights for policy 1, policy_version 878491 (0.0010) [2023-12-26 06:39:12,810][123091] Updated weights for policy 0, policy_version 884695 (0.0009) [2023-12-26 06:39:12,873][123091] Updated weights for policy 0, policy_version 884705 (0.0010) [2023-12-26 06:39:12,943][123091] Updated weights for policy 0, policy_version 884715 (0.0011) [2023-12-26 06:39:13,176][123090] Updated weights for policy 1, policy_version 878501 (0.0008) [2023-12-26 06:39:13,238][123090] Updated weights for policy 1, policy_version 878511 (0.0009) [2023-12-26 06:39:13,294][123090] Updated weights for policy 1, policy_version 878521 (0.0008) [2023-12-26 06:39:13,658][123091] Updated weights for policy 0, policy_version 884725 (0.0008) [2023-12-26 06:39:13,714][123091] Updated weights for policy 0, policy_version 884735 (0.0005) [2023-12-26 06:39:13,776][123091] Updated weights for policy 0, policy_version 884745 (0.0006) [2023-12-26 06:39:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 451395584. Throughput: 0: 8922.8, 1: 8823.8. Samples: 451393404. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:13,785][121949] Avg episode reward: [(0, '6160.100'), (1, '5495.092')] [2023-12-26 06:39:14,128][123090] Updated weights for policy 1, policy_version 878531 (0.0008) [2023-12-26 06:39:14,203][123090] Updated weights for policy 1, policy_version 878541 (0.0005) [2023-12-26 06:39:14,267][123090] Updated weights for policy 1, policy_version 878551 (0.0005) [2023-12-26 06:39:14,420][123091] Updated weights for policy 0, policy_version 884755 (0.0007) [2023-12-26 06:39:14,486][123091] Updated weights for policy 0, policy_version 884765 (0.0011) [2023-12-26 06:39:14,544][123091] Updated weights for policy 0, policy_version 884775 (0.0011) [2023-12-26 06:39:15,030][123090] Updated weights for policy 1, policy_version 878561 (0.0008) [2023-12-26 06:39:15,084][123090] Updated weights for policy 1, policy_version 878571 (0.0010) [2023-12-26 06:39:15,143][123090] Updated weights for policy 1, policy_version 878581 (0.0010) [2023-12-26 06:39:15,197][123090] Updated weights for policy 1, policy_version 878591 (0.0010) [2023-12-26 06:39:15,277][123091] Updated weights for policy 0, policy_version 884785 (0.0010) [2023-12-26 06:39:15,343][123091] Updated weights for policy 0, policy_version 884795 (0.0011) [2023-12-26 06:39:15,407][123091] Updated weights for policy 0, policy_version 884805 (0.0011) [2023-12-26 06:39:15,466][123091] Updated weights for policy 0, policy_version 884815 (0.0011) [2023-12-26 06:39:16,125][123090] Updated weights for policy 1, policy_version 878601 (0.0010) [2023-12-26 06:39:16,188][123090] Updated weights for policy 1, policy_version 878611 (0.0009) [2023-12-26 06:39:16,191][123091] Updated weights for policy 0, policy_version 884825 (0.0006) [2023-12-26 06:39:16,253][123090] Updated weights for policy 1, policy_version 878621 (0.0009) [2023-12-26 06:39:16,255][123091] Updated weights for policy 0, policy_version 884835 (0.0007) [2023-12-26 06:39:16,325][123091] Updated weights for policy 0, policy_version 884845 (0.0008) [2023-12-26 06:39:17,062][123090] Updated weights for policy 1, policy_version 878631 (0.0007) [2023-12-26 06:39:17,123][123091] Updated weights for policy 0, policy_version 884855 (0.0009) [2023-12-26 06:39:17,128][123090] Updated weights for policy 1, policy_version 878641 (0.0010) [2023-12-26 06:39:17,189][123091] Updated weights for policy 0, policy_version 884865 (0.0010) [2023-12-26 06:39:17,191][123090] Updated weights for policy 1, policy_version 878651 (0.0010) [2023-12-26 06:39:17,247][123091] Updated weights for policy 0, policy_version 884875 (0.0010) [2023-12-26 06:39:17,879][123090] Updated weights for policy 1, policy_version 878661 (0.0009) [2023-12-26 06:39:17,946][123090] Updated weights for policy 1, policy_version 878671 (0.0009) [2023-12-26 06:39:18,005][123090] Updated weights for policy 1, policy_version 878681 (0.0008) [2023-12-26 06:39:18,068][123091] Updated weights for policy 0, policy_version 884885 (0.0010) [2023-12-26 06:39:18,134][123091] Updated weights for policy 0, policy_version 884895 (0.0010) [2023-12-26 06:39:18,197][123091] Updated weights for policy 0, policy_version 884905 (0.0008) [2023-12-26 06:39:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 451485696. Throughput: 0: 8960.3, 1: 8762.8. Samples: 451501544. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:18,785][121949] Avg episode reward: [(0, '6095.207'), (1, '5712.756')] [2023-12-26 06:39:18,845][123090] Updated weights for policy 1, policy_version 878691 (0.0009) [2023-12-26 06:39:18,913][123090] Updated weights for policy 1, policy_version 878701 (0.0009) [2023-12-26 06:39:18,974][123090] Updated weights for policy 1, policy_version 878711 (0.0008) [2023-12-26 06:39:18,979][123091] Updated weights for policy 0, policy_version 884915 (0.0007) [2023-12-26 06:39:19,046][123091] Updated weights for policy 0, policy_version 884925 (0.0011) [2023-12-26 06:39:19,094][123091] Updated weights for policy 0, policy_version 884935 (0.0010) [2023-12-26 06:39:19,835][123090] Updated weights for policy 1, policy_version 878721 (0.0009) [2023-12-26 06:39:19,848][123091] Updated weights for policy 0, policy_version 884945 (0.0010) [2023-12-26 06:39:19,909][123091] Updated weights for policy 0, policy_version 884955 (0.0008) [2023-12-26 06:39:19,911][123090] Updated weights for policy 1, policy_version 878731 (0.0009) [2023-12-26 06:39:19,979][123090] Updated weights for policy 1, policy_version 878741 (0.0008) [2023-12-26 06:39:19,984][123091] Updated weights for policy 0, policy_version 884965 (0.0008) [2023-12-26 06:39:20,035][123090] Updated weights for policy 1, policy_version 878751 (0.0007) [2023-12-26 06:39:20,049][123091] Updated weights for policy 0, policy_version 884975 (0.0008) [2023-12-26 06:39:20,830][123091] Updated weights for policy 0, policy_version 884985 (0.0008) [2023-12-26 06:39:20,900][123091] Updated weights for policy 0, policy_version 884995 (0.0008) [2023-12-26 06:39:20,925][123090] Updated weights for policy 1, policy_version 878761 (0.0009) [2023-12-26 06:39:20,967][123091] Updated weights for policy 0, policy_version 885005 (0.0008) [2023-12-26 06:39:20,990][123090] Updated weights for policy 1, policy_version 878771 (0.0009) [2023-12-26 06:39:21,063][123090] Updated weights for policy 1, policy_version 878781 (0.0009) [2023-12-26 06:39:21,826][123091] Updated weights for policy 0, policy_version 885015 (0.0006) [2023-12-26 06:39:21,852][123090] Updated weights for policy 1, policy_version 878791 (0.0009) [2023-12-26 06:39:21,888][123091] Updated weights for policy 0, policy_version 885025 (0.0007) [2023-12-26 06:39:21,924][123090] Updated weights for policy 1, policy_version 878801 (0.0008) [2023-12-26 06:39:21,955][123091] Updated weights for policy 0, policy_version 885035 (0.0007) [2023-12-26 06:39:21,995][123090] Updated weights for policy 1, policy_version 878811 (0.0007) [2023-12-26 06:39:22,768][123091] Updated weights for policy 0, policy_version 885045 (0.0008) [2023-12-26 06:39:22,811][123090] Updated weights for policy 1, policy_version 878821 (0.0007) [2023-12-26 06:39:22,829][123091] Updated weights for policy 0, policy_version 885055 (0.0007) [2023-12-26 06:39:22,873][123090] Updated weights for policy 1, policy_version 878831 (0.0009) [2023-12-26 06:39:22,893][123091] Updated weights for policy 0, policy_version 885065 (0.0008) [2023-12-26 06:39:22,938][123090] Updated weights for policy 1, policy_version 878841 (0.0010) [2023-12-26 06:39:23,735][123090] Updated weights for policy 1, policy_version 878851 (0.0010) [2023-12-26 06:39:23,746][123091] Updated weights for policy 0, policy_version 885075 (0.0006) [2023-12-26 06:39:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 451567616. Throughput: 0: 8961.8, 1: 8716.7. Samples: 451552116. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:23,785][121949] Avg episode reward: [(0, '5948.896'), (1, '5649.992')] [2023-12-26 06:39:23,796][123090] Updated weights for policy 1, policy_version 878861 (0.0011) [2023-12-26 06:39:23,810][123091] Updated weights for policy 0, policy_version 885085 (0.0008) [2023-12-26 06:39:23,862][123090] Updated weights for policy 1, policy_version 878871 (0.0009) [2023-12-26 06:39:23,875][123091] Updated weights for policy 0, policy_version 885095 (0.0008) [2023-12-26 06:39:23,918][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000878880_224993280.pth... [2023-12-26 06:39:23,921][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000877856_224731136.pth [2023-12-26 06:39:23,928][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000885104_226590720.pth... [2023-12-26 06:39:23,931][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000884048_226320384.pth [2023-12-26 06:39:24,662][123091] Updated weights for policy 0, policy_version 885105 (0.0007) [2023-12-26 06:39:24,699][123090] Updated weights for policy 1, policy_version 878881 (0.0011) [2023-12-26 06:39:24,717][123091] Updated weights for policy 0, policy_version 885115 (0.0007) [2023-12-26 06:39:24,749][123090] Updated weights for policy 1, policy_version 878891 (0.0010) [2023-12-26 06:39:24,778][123091] Updated weights for policy 0, policy_version 885125 (0.0007) [2023-12-26 06:39:24,802][123090] Updated weights for policy 1, policy_version 878901 (0.0011) [2023-12-26 06:39:24,831][123091] Updated weights for policy 0, policy_version 885135 (0.0006) [2023-12-26 06:39:24,857][123090] Updated weights for policy 1, policy_version 878911 (0.0010) [2023-12-26 06:39:25,632][123091] Updated weights for policy 0, policy_version 885145 (0.0009) [2023-12-26 06:39:25,683][123091] Updated weights for policy 0, policy_version 885155 (0.0008) [2023-12-26 06:39:25,715][123090] Updated weights for policy 1, policy_version 878921 (0.0010) [2023-12-26 06:39:25,729][123091] Updated weights for policy 0, policy_version 885165 (0.0008) [2023-12-26 06:39:25,779][123090] Updated weights for policy 1, policy_version 878931 (0.0010) [2023-12-26 06:39:25,851][123090] Updated weights for policy 1, policy_version 878941 (0.0011) [2023-12-26 06:39:26,563][123091] Updated weights for policy 0, policy_version 885175 (0.0009) [2023-12-26 06:39:26,613][123091] Updated weights for policy 0, policy_version 885185 (0.0008) [2023-12-26 06:39:26,639][123090] Updated weights for policy 1, policy_version 878951 (0.0011) [2023-12-26 06:39:26,676][123091] Updated weights for policy 0, policy_version 885195 (0.0007) [2023-12-26 06:39:26,695][123090] Updated weights for policy 1, policy_version 878961 (0.0010) [2023-12-26 06:39:26,751][123090] Updated weights for policy 1, policy_version 878971 (0.0010) [2023-12-26 06:39:27,517][123091] Updated weights for policy 0, policy_version 885205 (0.0007) [2023-12-26 06:39:27,572][123091] Updated weights for policy 0, policy_version 885215 (0.0009) [2023-12-26 06:39:27,580][123090] Updated weights for policy 1, policy_version 878981 (0.0010) [2023-12-26 06:39:27,627][123091] Updated weights for policy 0, policy_version 885225 (0.0009) [2023-12-26 06:39:27,636][123090] Updated weights for policy 1, policy_version 878991 (0.0010) [2023-12-26 06:39:27,691][123090] Updated weights for policy 1, policy_version 879001 (0.0010) [2023-12-26 06:39:28,485][123091] Updated weights for policy 0, policy_version 885235 (0.0007) [2023-12-26 06:39:28,534][123090] Updated weights for policy 1, policy_version 879011 (0.0011) [2023-12-26 06:39:28,537][123091] Updated weights for policy 0, policy_version 885245 (0.0008) [2023-12-26 06:39:28,593][123090] Updated weights for policy 1, policy_version 879021 (0.0010) [2023-12-26 06:39:28,593][123091] Updated weights for policy 0, policy_version 885255 (0.0007) [2023-12-26 06:39:28,655][123090] Updated weights for policy 1, policy_version 879031 (0.0010) [2023-12-26 06:39:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 451665920. Throughput: 0: 8962.6, 1: 8718.3. Samples: 451655536. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:28,785][121949] Avg episode reward: [(0, '5885.127'), (1, '5790.210')] [2023-12-26 06:39:29,434][123091] Updated weights for policy 0, policy_version 885265 (0.0008) [2023-12-26 06:39:29,495][123091] Updated weights for policy 0, policy_version 885275 (0.0009) [2023-12-26 06:39:29,515][123090] Updated weights for policy 1, policy_version 879041 (0.0010) [2023-12-26 06:39:29,560][123091] Updated weights for policy 0, policy_version 885285 (0.0007) [2023-12-26 06:39:29,574][123090] Updated weights for policy 1, policy_version 879051 (0.0010) [2023-12-26 06:39:29,619][123091] Updated weights for policy 0, policy_version 885295 (0.0006) [2023-12-26 06:39:29,636][123090] Updated weights for policy 1, policy_version 879061 (0.0010) [2023-12-26 06:39:29,706][123090] Updated weights for policy 1, policy_version 879071 (0.0010) [2023-12-26 06:39:30,459][123091] Updated weights for policy 0, policy_version 885305 (0.0009) [2023-12-26 06:39:30,505][123091] Updated weights for policy 0, policy_version 885315 (0.0008) [2023-12-26 06:39:30,523][123090] Updated weights for policy 1, policy_version 879081 (0.0010) [2023-12-26 06:39:30,564][123091] Updated weights for policy 0, policy_version 885325 (0.0006) [2023-12-26 06:39:30,578][123090] Updated weights for policy 1, policy_version 879091 (0.0010) [2023-12-26 06:39:30,637][123090] Updated weights for policy 1, policy_version 879101 (0.0010) [2023-12-26 06:39:31,454][123091] Updated weights for policy 0, policy_version 885335 (0.0008) [2023-12-26 06:39:31,505][123090] Updated weights for policy 1, policy_version 879111 (0.0010) [2023-12-26 06:39:31,513][123091] Updated weights for policy 0, policy_version 885345 (0.0008) [2023-12-26 06:39:31,573][123090] Updated weights for policy 1, policy_version 879121 (0.0011) [2023-12-26 06:39:31,580][123091] Updated weights for policy 0, policy_version 885355 (0.0007) [2023-12-26 06:39:31,632][123090] Updated weights for policy 1, policy_version 879131 (0.0010) [2023-12-26 06:39:32,436][123091] Updated weights for policy 0, policy_version 885365 (0.0009) [2023-12-26 06:39:32,453][123090] Updated weights for policy 1, policy_version 879141 (0.0008) [2023-12-26 06:39:32,495][123091] Updated weights for policy 0, policy_version 885375 (0.0011) [2023-12-26 06:39:32,518][123090] Updated weights for policy 1, policy_version 879151 (0.0006) [2023-12-26 06:39:32,551][123091] Updated weights for policy 0, policy_version 885385 (0.0010) [2023-12-26 06:39:32,589][123090] Updated weights for policy 1, policy_version 879161 (0.0008) [2023-12-26 06:39:33,241][123091] Updated weights for policy 0, policy_version 885395 (0.0009) [2023-12-26 06:39:33,261][123090] Updated weights for policy 1, policy_version 879171 (0.0007) [2023-12-26 06:39:33,294][123091] Updated weights for policy 0, policy_version 885405 (0.0006) [2023-12-26 06:39:33,332][123090] Updated weights for policy 1, policy_version 879181 (0.0005) [2023-12-26 06:39:33,353][123091] Updated weights for policy 0, policy_version 885415 (0.0006) [2023-12-26 06:39:33,388][123090] Updated weights for policy 1, policy_version 879191 (0.0006) [2023-12-26 06:39:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 451747840. Throughput: 0: 8920.8, 1: 8659.1. Samples: 451760400. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:33,785][121949] Avg episode reward: [(0, '5916.761'), (1, '5824.669')] [2023-12-26 06:39:33,909][123091] Updated weights for policy 0, policy_version 885425 (0.0005) [2023-12-26 06:39:33,964][123091] Updated weights for policy 0, policy_version 885435 (0.0005) [2023-12-26 06:39:34,016][123091] Updated weights for policy 0, policy_version 885445 (0.0005) [2023-12-26 06:39:34,082][123091] Updated weights for policy 0, policy_version 885455 (0.0005) [2023-12-26 06:39:34,175][123090] Updated weights for policy 1, policy_version 879201 (0.0010) [2023-12-26 06:39:34,247][123090] Updated weights for policy 1, policy_version 879211 (0.0007) [2023-12-26 06:39:34,319][123090] Updated weights for policy 1, policy_version 879221 (0.0008) [2023-12-26 06:39:34,391][123090] Updated weights for policy 1, policy_version 879231 (0.0008) [2023-12-26 06:39:34,874][123091] Updated weights for policy 0, policy_version 885465 (0.0005) [2023-12-26 06:39:34,935][123091] Updated weights for policy 0, policy_version 885475 (0.0006) [2023-12-26 06:39:34,999][123091] Updated weights for policy 0, policy_version 885485 (0.0008) [2023-12-26 06:39:35,159][123090] Updated weights for policy 1, policy_version 879241 (0.0010) [2023-12-26 06:39:35,212][123090] Updated weights for policy 1, policy_version 879251 (0.0010) [2023-12-26 06:39:35,270][123090] Updated weights for policy 1, policy_version 879261 (0.0010) [2023-12-26 06:39:35,740][123091] Updated weights for policy 0, policy_version 885495 (0.0007) [2023-12-26 06:39:35,787][123091] Updated weights for policy 0, policy_version 885505 (0.0005) [2023-12-26 06:39:35,840][123091] Updated weights for policy 0, policy_version 885515 (0.0008) [2023-12-26 06:39:36,104][123090] Updated weights for policy 1, policy_version 879271 (0.0011) [2023-12-26 06:39:36,168][123090] Updated weights for policy 1, policy_version 879281 (0.0011) [2023-12-26 06:39:36,225][123090] Updated weights for policy 1, policy_version 879291 (0.0011) [2023-12-26 06:39:36,546][123091] Updated weights for policy 0, policy_version 885525 (0.0007) [2023-12-26 06:39:36,620][123091] Updated weights for policy 0, policy_version 885535 (0.0007) [2023-12-26 06:39:36,688][123091] Updated weights for policy 0, policy_version 885545 (0.0008) [2023-12-26 06:39:37,069][123090] Updated weights for policy 1, policy_version 879301 (0.0008) [2023-12-26 06:39:37,171][123090] Updated weights for policy 1, policy_version 879311 (0.0006) [2023-12-26 06:39:37,240][123090] Updated weights for policy 1, policy_version 879321 (0.0008) [2023-12-26 06:39:37,457][123091] Updated weights for policy 0, policy_version 885555 (0.0011) [2023-12-26 06:39:37,512][123091] Updated weights for policy 0, policy_version 885565 (0.0011) [2023-12-26 06:39:37,571][123091] Updated weights for policy 0, policy_version 885575 (0.0011) [2023-12-26 06:39:37,965][123090] Updated weights for policy 1, policy_version 879331 (0.0010) [2023-12-26 06:39:38,028][123090] Updated weights for policy 1, policy_version 879341 (0.0010) [2023-12-26 06:39:38,091][123090] Updated weights for policy 1, policy_version 879351 (0.0009) [2023-12-26 06:39:38,279][123091] Updated weights for policy 0, policy_version 885585 (0.0011) [2023-12-26 06:39:38,333][123091] Updated weights for policy 0, policy_version 885595 (0.0009) [2023-12-26 06:39:38,397][123091] Updated weights for policy 0, policy_version 885605 (0.0009) [2023-12-26 06:39:38,460][123091] Updated weights for policy 0, policy_version 885615 (0.0006) [2023-12-26 06:39:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 451837952. Throughput: 0: 8960.4, 1: 8680.3. Samples: 451815312. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:38,784][121949] Avg episode reward: [(0, '5884.481'), (1, '5736.705')] [2023-12-26 06:39:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000885616_226721792.pth... [2023-12-26 06:39:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000879360_225116160.pth... [2023-12-26 06:39:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000884560_226451456.pth [2023-12-26 06:39:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000878368_224862208.pth [2023-12-26 06:39:38,845][123090] Updated weights for policy 1, policy_version 879361 (0.0009) [2023-12-26 06:39:38,906][123090] Updated weights for policy 1, policy_version 879371 (0.0008) [2023-12-26 06:39:38,969][123090] Updated weights for policy 1, policy_version 879381 (0.0009) [2023-12-26 06:39:39,034][123090] Updated weights for policy 1, policy_version 879391 (0.0010) [2023-12-26 06:39:39,280][123091] Updated weights for policy 0, policy_version 885625 (0.0009) [2023-12-26 06:39:39,343][123091] Updated weights for policy 0, policy_version 885635 (0.0007) [2023-12-26 06:39:39,413][123091] Updated weights for policy 0, policy_version 885645 (0.0008) [2023-12-26 06:39:39,891][123090] Updated weights for policy 1, policy_version 879401 (0.0009) [2023-12-26 06:39:39,952][123090] Updated weights for policy 1, policy_version 879411 (0.0008) [2023-12-26 06:39:40,011][123090] Updated weights for policy 1, policy_version 879421 (0.0010) [2023-12-26 06:39:40,181][123091] Updated weights for policy 0, policy_version 885655 (0.0009) [2023-12-26 06:39:40,241][123091] Updated weights for policy 0, policy_version 885665 (0.0008) [2023-12-26 06:39:40,312][123091] Updated weights for policy 0, policy_version 885675 (0.0011) [2023-12-26 06:39:40,781][123090] Updated weights for policy 1, policy_version 879431 (0.0006) [2023-12-26 06:39:40,848][123090] Updated weights for policy 1, policy_version 879441 (0.0010) [2023-12-26 06:39:40,905][123090] Updated weights for policy 1, policy_version 879451 (0.0010) [2023-12-26 06:39:40,979][123091] Updated weights for policy 0, policy_version 885685 (0.0010) [2023-12-26 06:39:41,046][123091] Updated weights for policy 0, policy_version 885695 (0.0008) [2023-12-26 06:39:41,110][123091] Updated weights for policy 0, policy_version 885705 (0.0010) [2023-12-26 06:39:41,805][123090] Updated weights for policy 1, policy_version 879461 (0.0010) [2023-12-26 06:39:41,863][123090] Updated weights for policy 1, policy_version 879471 (0.0009) [2023-12-26 06:39:41,885][123091] Updated weights for policy 0, policy_version 885715 (0.0010) [2023-12-26 06:39:41,924][123090] Updated weights for policy 1, policy_version 879481 (0.0009) [2023-12-26 06:39:41,942][123091] Updated weights for policy 0, policy_version 885725 (0.0011) [2023-12-26 06:39:41,998][123091] Updated weights for policy 0, policy_version 885735 (0.0008) [2023-12-26 06:39:42,755][123091] Updated weights for policy 0, policy_version 885745 (0.0008) [2023-12-26 06:39:42,784][123090] Updated weights for policy 1, policy_version 879491 (0.0007) [2023-12-26 06:39:42,820][123091] Updated weights for policy 0, policy_version 885755 (0.0005) [2023-12-26 06:39:42,851][123090] Updated weights for policy 1, policy_version 879501 (0.0006) [2023-12-26 06:39:42,881][123091] Updated weights for policy 0, policy_version 885765 (0.0009) [2023-12-26 06:39:42,908][123090] Updated weights for policy 1, policy_version 879511 (0.0008) [2023-12-26 06:39:42,938][123091] Updated weights for policy 0, policy_version 885775 (0.0010) [2023-12-26 06:39:43,637][123090] Updated weights for policy 1, policy_version 879521 (0.0009) [2023-12-26 06:39:43,713][123090] Updated weights for policy 1, policy_version 879531 (0.0006) [2023-12-26 06:39:43,770][123090] Updated weights for policy 1, policy_version 879541 (0.0005) [2023-12-26 06:39:43,780][123091] Updated weights for policy 0, policy_version 885785 (0.0008) [2023-12-26 06:39:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 451919872. Throughput: 0: 8970.8, 1: 8623.8. Samples: 451920024. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:43,785][121949] Avg episode reward: [(0, '5877.700'), (1, '5699.731')] [2023-12-26 06:39:43,831][123090] Updated weights for policy 1, policy_version 879551 (0.0005) [2023-12-26 06:39:43,834][123091] Updated weights for policy 0, policy_version 885795 (0.0005) [2023-12-26 06:39:43,879][123091] Updated weights for policy 0, policy_version 885805 (0.0005) [2023-12-26 06:39:44,547][123090] Updated weights for policy 1, policy_version 879561 (0.0009) [2023-12-26 06:39:44,576][123091] Updated weights for policy 0, policy_version 885815 (0.0006) [2023-12-26 06:39:44,603][123090] Updated weights for policy 1, policy_version 879571 (0.0007) [2023-12-26 06:39:44,622][123091] Updated weights for policy 0, policy_version 885825 (0.0005) [2023-12-26 06:39:44,663][123090] Updated weights for policy 1, policy_version 879581 (0.0009) [2023-12-26 06:39:44,675][123091] Updated weights for policy 0, policy_version 885835 (0.0009) [2023-12-26 06:39:45,504][123090] Updated weights for policy 1, policy_version 879591 (0.0010) [2023-12-26 06:39:45,524][123091] Updated weights for policy 0, policy_version 885845 (0.0010) [2023-12-26 06:39:45,571][123090] Updated weights for policy 1, policy_version 879601 (0.0008) [2023-12-26 06:39:45,574][123091] Updated weights for policy 0, policy_version 885855 (0.0008) [2023-12-26 06:39:45,628][123090] Updated weights for policy 1, policy_version 879611 (0.0010) [2023-12-26 06:39:45,637][123091] Updated weights for policy 0, policy_version 885865 (0.0007) [2023-12-26 06:39:46,401][123090] Updated weights for policy 1, policy_version 879621 (0.0010) [2023-12-26 06:39:46,459][123090] Updated weights for policy 1, policy_version 879631 (0.0010) [2023-12-26 06:39:46,473][123091] Updated weights for policy 0, policy_version 885875 (0.0007) [2023-12-26 06:39:46,511][123090] Updated weights for policy 1, policy_version 879641 (0.0008) [2023-12-26 06:39:46,533][123091] Updated weights for policy 0, policy_version 885885 (0.0008) [2023-12-26 06:39:46,592][123091] Updated weights for policy 0, policy_version 885895 (0.0005) [2023-12-26 06:39:47,277][123091] Updated weights for policy 0, policy_version 885905 (0.0009) [2023-12-26 06:39:47,326][123091] Updated weights for policy 0, policy_version 885915 (0.0005) [2023-12-26 06:39:47,390][123091] Updated weights for policy 0, policy_version 885925 (0.0006) [2023-12-26 06:39:47,400][123090] Updated weights for policy 1, policy_version 879651 (0.0009) [2023-12-26 06:39:47,450][123091] Updated weights for policy 0, policy_version 885935 (0.0006) [2023-12-26 06:39:47,467][123090] Updated weights for policy 1, policy_version 879661 (0.0009) [2023-12-26 06:39:47,541][123090] Updated weights for policy 1, policy_version 879671 (0.0009) [2023-12-26 06:39:48,144][123091] Updated weights for policy 0, policy_version 885945 (0.0009) [2023-12-26 06:39:48,207][123091] Updated weights for policy 0, policy_version 885955 (0.0009) [2023-12-26 06:39:48,262][123091] Updated weights for policy 0, policy_version 885965 (0.0010) [2023-12-26 06:39:48,395][123090] Updated weights for policy 1, policy_version 879681 (0.0010) [2023-12-26 06:39:48,449][123090] Updated weights for policy 1, policy_version 879691 (0.0009) [2023-12-26 06:39:48,495][123090] Updated weights for policy 1, policy_version 879701 (0.0006) [2023-12-26 06:39:48,558][123090] Updated weights for policy 1, policy_version 879711 (0.0006) [2023-12-26 06:39:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 452018176. Throughput: 0: 9049.2, 1: 8608.4. Samples: 452027844. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:48,785][121949] Avg episode reward: [(0, '5904.887'), (1, '5583.243')] [2023-12-26 06:39:49,087][123091] Updated weights for policy 0, policy_version 885975 (0.0006) [2023-12-26 06:39:49,163][123091] Updated weights for policy 0, policy_version 885985 (0.0005) [2023-12-26 06:39:49,236][123091] Updated weights for policy 0, policy_version 885995 (0.0007) [2023-12-26 06:39:49,335][123090] Updated weights for policy 1, policy_version 879721 (0.0006) [2023-12-26 06:39:49,413][123090] Updated weights for policy 1, policy_version 879731 (0.0007) [2023-12-26 06:39:49,476][123090] Updated weights for policy 1, policy_version 879741 (0.0006) [2023-12-26 06:39:49,828][123091] Updated weights for policy 0, policy_version 886005 (0.0009) [2023-12-26 06:39:49,894][123091] Updated weights for policy 0, policy_version 886015 (0.0006) [2023-12-26 06:39:49,963][123091] Updated weights for policy 0, policy_version 886025 (0.0009) [2023-12-26 06:39:50,234][123090] Updated weights for policy 1, policy_version 879751 (0.0009) [2023-12-26 06:39:50,299][123090] Updated weights for policy 1, policy_version 879761 (0.0011) [2023-12-26 06:39:50,364][123090] Updated weights for policy 1, policy_version 879771 (0.0011) [2023-12-26 06:39:50,827][123091] Updated weights for policy 0, policy_version 886035 (0.0010) [2023-12-26 06:39:50,892][123091] Updated weights for policy 0, policy_version 886045 (0.0009) [2023-12-26 06:39:50,962][123091] Updated weights for policy 0, policy_version 886055 (0.0009) [2023-12-26 06:39:51,172][123090] Updated weights for policy 1, policy_version 879781 (0.0010) [2023-12-26 06:39:51,236][123090] Updated weights for policy 1, policy_version 879791 (0.0011) [2023-12-26 06:39:51,308][123090] Updated weights for policy 1, policy_version 879801 (0.0011) [2023-12-26 06:39:51,863][123091] Updated weights for policy 0, policy_version 886065 (0.0010) [2023-12-26 06:39:51,917][123091] Updated weights for policy 0, policy_version 886075 (0.0010) [2023-12-26 06:39:51,984][123091] Updated weights for policy 0, policy_version 886085 (0.0011) [2023-12-26 06:39:52,051][123091] Updated weights for policy 0, policy_version 886095 (0.0011) [2023-12-26 06:39:52,118][123090] Updated weights for policy 1, policy_version 879811 (0.0010) [2023-12-26 06:39:52,183][123090] Updated weights for policy 1, policy_version 879821 (0.0007) [2023-12-26 06:39:52,241][123090] Updated weights for policy 1, policy_version 879831 (0.0008) [2023-12-26 06:39:52,765][123091] Updated weights for policy 0, policy_version 886105 (0.0007) [2023-12-26 06:39:52,822][123091] Updated weights for policy 0, policy_version 886115 (0.0005) [2023-12-26 06:39:52,871][123091] Updated weights for policy 0, policy_version 886125 (0.0005) [2023-12-26 06:39:53,066][123090] Updated weights for policy 1, policy_version 879841 (0.0009) [2023-12-26 06:39:53,115][123090] Updated weights for policy 1, policy_version 879851 (0.0006) [2023-12-26 06:39:53,182][123090] Updated weights for policy 1, policy_version 879861 (0.0005) [2023-12-26 06:39:53,246][123090] Updated weights for policy 1, policy_version 879871 (0.0005) [2023-12-26 06:39:53,687][123091] Updated weights for policy 0, policy_version 886135 (0.0009) [2023-12-26 06:39:53,753][123091] Updated weights for policy 0, policy_version 886145 (0.0010) [2023-12-26 06:39:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 452100096. Throughput: 0: 9049.3, 1: 8631.8. Samples: 452081056. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:53,785][121949] Avg episode reward: [(0, '5976.162'), (1, '5477.732')] [2023-12-26 06:39:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000879872_225247232.pth... [2023-12-26 06:39:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000878880_224993280.pth [2023-12-26 06:39:53,811][123091] Updated weights for policy 0, policy_version 886155 (0.0009) [2023-12-26 06:39:53,838][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000886160_226861056.pth... [2023-12-26 06:39:53,843][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000885104_226590720.pth [2023-12-26 06:39:53,915][123090] Updated weights for policy 1, policy_version 879881 (0.0009) [2023-12-26 06:39:53,970][123090] Updated weights for policy 1, policy_version 879892 (0.0010) [2023-12-26 06:39:54,018][123090] Updated weights for policy 1, policy_version 879902 (0.0009) [2023-12-26 06:39:54,647][123091] Updated weights for policy 0, policy_version 886165 (0.0010) [2023-12-26 06:39:54,696][123091] Updated weights for policy 0, policy_version 886176 (0.0009) [2023-12-26 06:39:54,758][123091] Updated weights for policy 0, policy_version 886187 (0.0009) [2023-12-26 06:39:54,883][123090] Updated weights for policy 1, policy_version 879912 (0.0010) [2023-12-26 06:39:54,949][123090] Updated weights for policy 1, policy_version 879922 (0.0009) [2023-12-26 06:39:55,007][123090] Updated weights for policy 1, policy_version 879932 (0.0008) [2023-12-26 06:39:55,572][123091] Updated weights for policy 0, policy_version 886197 (0.0007) [2023-12-26 06:39:55,633][123091] Updated weights for policy 0, policy_version 886207 (0.0009) [2023-12-26 06:39:55,680][123091] Updated weights for policy 0, policy_version 886217 (0.0008) [2023-12-26 06:39:55,846][123090] Updated weights for policy 1, policy_version 879942 (0.0008) [2023-12-26 06:39:55,894][123090] Updated weights for policy 1, policy_version 879952 (0.0009) [2023-12-26 06:39:55,945][123090] Updated weights for policy 1, policy_version 879962 (0.0009) [2023-12-26 06:39:56,554][123091] Updated weights for policy 0, policy_version 886227 (0.0009) [2023-12-26 06:39:56,606][123091] Updated weights for policy 0, policy_version 886237 (0.0009) [2023-12-26 06:39:56,660][123091] Updated weights for policy 0, policy_version 886247 (0.0010) [2023-12-26 06:39:56,729][123090] Updated weights for policy 1, policy_version 879972 (0.0009) [2023-12-26 06:39:56,781][123090] Updated weights for policy 1, policy_version 879982 (0.0010) [2023-12-26 06:39:56,848][123090] Updated weights for policy 1, policy_version 879993 (0.0009) [2023-12-26 06:39:57,511][123091] Updated weights for policy 0, policy_version 886257 (0.0008) [2023-12-26 06:39:57,565][123091] Updated weights for policy 0, policy_version 886267 (0.0007) [2023-12-26 06:39:57,566][123090] Updated weights for policy 1, policy_version 880003 (0.0007) [2023-12-26 06:39:57,620][123091] Updated weights for policy 0, policy_version 886277 (0.0007) [2023-12-26 06:39:57,622][123090] Updated weights for policy 1, policy_version 880013 (0.0009) [2023-12-26 06:39:57,676][123091] Updated weights for policy 0, policy_version 886287 (0.0008) [2023-12-26 06:39:57,678][123090] Updated weights for policy 1, policy_version 880023 (0.0008) [2023-12-26 06:39:58,509][123091] Updated weights for policy 0, policy_version 886297 (0.0009) [2023-12-26 06:39:58,547][123090] Updated weights for policy 1, policy_version 880033 (0.0009) [2023-12-26 06:39:58,575][123091] Updated weights for policy 0, policy_version 886307 (0.0008) [2023-12-26 06:39:58,615][123090] Updated weights for policy 1, policy_version 880043 (0.0010) [2023-12-26 06:39:58,645][123091] Updated weights for policy 0, policy_version 886317 (0.0010) [2023-12-26 06:39:58,682][123090] Updated weights for policy 1, policy_version 880053 (0.0008) [2023-12-26 06:39:58,758][123090] Updated weights for policy 1, policy_version 880063 (0.0009) [2023-12-26 06:39:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 452198400. Throughput: 0: 8950.4, 1: 8690.3. Samples: 452187236. Policy #0 lag: (min: 26.0, avg: 34.8, max: 58.0) [2023-12-26 06:39:58,785][121949] Avg episode reward: [(0, '5945.609'), (1, '5502.261')] [2023-12-26 06:39:59,570][123091] Updated weights for policy 0, policy_version 886327 (0.0010) [2023-12-26 06:39:59,610][123090] Updated weights for policy 1, policy_version 880073 (0.0006) [2023-12-26 06:39:59,635][123091] Updated weights for policy 0, policy_version 886337 (0.0009) [2023-12-26 06:39:59,669][123090] Updated weights for policy 1, policy_version 880083 (0.0005) [2023-12-26 06:39:59,684][123091] Updated weights for policy 0, policy_version 886347 (0.0010) [2023-12-26 06:39:59,719][123090] Updated weights for policy 1, policy_version 880093 (0.0006) [2023-12-26 06:40:00,505][123090] Updated weights for policy 1, policy_version 880103 (0.0009) [2023-12-26 06:40:00,546][123091] Updated weights for policy 0, policy_version 886357 (0.0010) [2023-12-26 06:40:00,573][123090] Updated weights for policy 1, policy_version 880113 (0.0006) [2023-12-26 06:40:00,609][123091] Updated weights for policy 0, policy_version 886367 (0.0010) [2023-12-26 06:40:00,628][123090] Updated weights for policy 1, policy_version 880123 (0.0009) [2023-12-26 06:40:00,670][123091] Updated weights for policy 0, policy_version 886377 (0.0007) [2023-12-26 06:40:01,354][123091] Updated weights for policy 0, policy_version 886387 (0.0010) [2023-12-26 06:40:01,422][123091] Updated weights for policy 0, policy_version 886397 (0.0007) [2023-12-26 06:40:01,436][123090] Updated weights for policy 1, policy_version 880133 (0.0010) [2023-12-26 06:40:01,484][123091] Updated weights for policy 0, policy_version 886407 (0.0006) [2023-12-26 06:40:01,504][123090] Updated weights for policy 1, policy_version 880143 (0.0011) [2023-12-26 06:40:01,574][123090] Updated weights for policy 1, policy_version 880153 (0.0010) [2023-12-26 06:40:02,298][123091] Updated weights for policy 0, policy_version 886417 (0.0006) [2023-12-26 06:40:02,360][123091] Updated weights for policy 0, policy_version 886427 (0.0008) [2023-12-26 06:40:02,385][123090] Updated weights for policy 1, policy_version 880163 (0.0010) [2023-12-26 06:40:02,419][123091] Updated weights for policy 0, policy_version 886437 (0.0009) [2023-12-26 06:40:02,434][123090] Updated weights for policy 1, policy_version 880173 (0.0008) [2023-12-26 06:40:02,474][123091] Updated weights for policy 0, policy_version 886447 (0.0008) [2023-12-26 06:40:02,487][123090] Updated weights for policy 1, policy_version 880183 (0.0007) [2023-12-26 06:40:03,199][123090] Updated weights for policy 1, policy_version 880193 (0.0008) [2023-12-26 06:40:03,255][123090] Updated weights for policy 1, policy_version 880203 (0.0007) [2023-12-26 06:40:03,266][123091] Updated weights for policy 0, policy_version 886457 (0.0008) [2023-12-26 06:40:03,305][123090] Updated weights for policy 1, policy_version 880213 (0.0005) [2023-12-26 06:40:03,315][123091] Updated weights for policy 0, policy_version 886467 (0.0008) [2023-12-26 06:40:03,358][123090] Updated weights for policy 1, policy_version 880223 (0.0006) [2023-12-26 06:40:03,365][123091] Updated weights for policy 0, policy_version 886477 (0.0010) [2023-12-26 06:40:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 452280320. Throughput: 0: 8856.2, 1: 8688.1. Samples: 452291036. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:03,785][121949] Avg episode reward: [(0, '6025.478'), (1, '5680.938')] [2023-12-26 06:40:04,167][123090] Updated weights for policy 1, policy_version 880233 (0.0006) [2023-12-26 06:40:04,236][123090] Updated weights for policy 1, policy_version 880243 (0.0007) [2023-12-26 06:40:04,270][123091] Updated weights for policy 0, policy_version 886487 (0.0009) [2023-12-26 06:40:04,307][123090] Updated weights for policy 1, policy_version 880253 (0.0007) [2023-12-26 06:40:04,332][123091] Updated weights for policy 0, policy_version 886497 (0.0008) [2023-12-26 06:40:04,382][123091] Updated weights for policy 0, policy_version 886507 (0.0009) [2023-12-26 06:40:05,023][123090] Updated weights for policy 1, policy_version 880263 (0.0010) [2023-12-26 06:40:05,073][123090] Updated weights for policy 1, policy_version 880273 (0.0009) [2023-12-26 06:40:05,131][123090] Updated weights for policy 1, policy_version 880283 (0.0009) [2023-12-26 06:40:05,264][123091] Updated weights for policy 0, policy_version 886517 (0.0010) [2023-12-26 06:40:05,319][123091] Updated weights for policy 0, policy_version 886528 (0.0010) [2023-12-26 06:40:05,378][123091] Updated weights for policy 0, policy_version 886538 (0.0010) [2023-12-26 06:40:05,707][123090] Updated weights for policy 1, policy_version 880293 (0.0008) [2023-12-26 06:40:05,764][123090] Updated weights for policy 1, policy_version 880303 (0.0005) [2023-12-26 06:40:05,835][123090] Updated weights for policy 1, policy_version 880313 (0.0006) [2023-12-26 06:40:06,286][123091] Updated weights for policy 0, policy_version 886548 (0.0010) [2023-12-26 06:40:06,351][123091] Updated weights for policy 0, policy_version 886558 (0.0009) [2023-12-26 06:40:06,401][123091] Updated weights for policy 0, policy_version 886568 (0.0009) [2023-12-26 06:40:06,666][123090] Updated weights for policy 1, policy_version 880323 (0.0010) [2023-12-26 06:40:06,717][123090] Updated weights for policy 1, policy_version 880333 (0.0009) [2023-12-26 06:40:06,772][123090] Updated weights for policy 1, policy_version 880343 (0.0008) [2023-12-26 06:40:07,279][123091] Updated weights for policy 0, policy_version 886578 (0.0006) [2023-12-26 06:40:07,338][123091] Updated weights for policy 0, policy_version 886588 (0.0005) [2023-12-26 06:40:07,398][123091] Updated weights for policy 0, policy_version 886598 (0.0005) [2023-12-26 06:40:07,452][123091] Updated weights for policy 0, policy_version 886608 (0.0005) [2023-12-26 06:40:07,596][123090] Updated weights for policy 1, policy_version 880353 (0.0008) [2023-12-26 06:40:07,660][123090] Updated weights for policy 1, policy_version 880363 (0.0005) [2023-12-26 06:40:07,717][123090] Updated weights for policy 1, policy_version 880373 (0.0005) [2023-12-26 06:40:07,771][123090] Updated weights for policy 1, policy_version 880383 (0.0005) [2023-12-26 06:40:08,127][123091] Updated weights for policy 0, policy_version 886618 (0.0005) [2023-12-26 06:40:08,199][123091] Updated weights for policy 0, policy_version 886628 (0.0005) [2023-12-26 06:40:08,270][123091] Updated weights for policy 0, policy_version 886638 (0.0006) [2023-12-26 06:40:08,411][123090] Updated weights for policy 1, policy_version 880393 (0.0008) [2023-12-26 06:40:08,479][123090] Updated weights for policy 1, policy_version 880403 (0.0010) [2023-12-26 06:40:08,547][123090] Updated weights for policy 1, policy_version 880413 (0.0009) [2023-12-26 06:40:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 452370432. Throughput: 0: 8816.2, 1: 8760.6. Samples: 452343072. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:08,785][121949] Avg episode reward: [(0, '6210.478'), (1, '5742.306')] [2023-12-26 06:40:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000886640_226983936.pth... [2023-12-26 06:40:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000880416_225386496.pth... [2023-12-26 06:40:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000885616_226721792.pth [2023-12-26 06:40:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000879360_225116160.pth [2023-12-26 06:40:08,917][123091] Updated weights for policy 0, policy_version 886648 (0.0005) [2023-12-26 06:40:08,965][123091] Updated weights for policy 0, policy_version 886658 (0.0006) [2023-12-26 06:40:09,012][123091] Updated weights for policy 0, policy_version 886668 (0.0005) [2023-12-26 06:40:09,464][123090] Updated weights for policy 1, policy_version 880423 (0.0009) [2023-12-26 06:40:09,528][123090] Updated weights for policy 1, policy_version 880433 (0.0009) [2023-12-26 06:40:09,584][123090] Updated weights for policy 1, policy_version 880443 (0.0009) [2023-12-26 06:40:09,775][123091] Updated weights for policy 0, policy_version 886678 (0.0008) [2023-12-26 06:40:09,838][123091] Updated weights for policy 0, policy_version 886688 (0.0012) [2023-12-26 06:40:09,903][123091] Updated weights for policy 0, policy_version 886698 (0.0010) [2023-12-26 06:40:10,453][123090] Updated weights for policy 1, policy_version 880453 (0.0007) [2023-12-26 06:40:10,505][123090] Updated weights for policy 1, policy_version 880463 (0.0006) [2023-12-26 06:40:10,557][123090] Updated weights for policy 1, policy_version 880473 (0.0006) [2023-12-26 06:40:10,700][123091] Updated weights for policy 0, policy_version 886708 (0.0008) [2023-12-26 06:40:10,758][123091] Updated weights for policy 0, policy_version 886718 (0.0009) [2023-12-26 06:40:10,816][123091] Updated weights for policy 0, policy_version 886728 (0.0011) [2023-12-26 06:40:11,306][123090] Updated weights for policy 1, policy_version 880483 (0.0006) [2023-12-26 06:40:11,375][123090] Updated weights for policy 1, policy_version 880493 (0.0009) [2023-12-26 06:40:11,436][123090] Updated weights for policy 1, policy_version 880503 (0.0009) [2023-12-26 06:40:11,635][123091] Updated weights for policy 0, policy_version 886738 (0.0011) [2023-12-26 06:40:11,693][123091] Updated weights for policy 0, policy_version 886748 (0.0011) [2023-12-26 06:40:11,764][123091] Updated weights for policy 0, policy_version 886758 (0.0010) [2023-12-26 06:40:11,831][123091] Updated weights for policy 0, policy_version 886768 (0.0011) [2023-12-26 06:40:12,249][123090] Updated weights for policy 1, policy_version 880513 (0.0010) [2023-12-26 06:40:12,319][123090] Updated weights for policy 1, policy_version 880523 (0.0010) [2023-12-26 06:40:12,391][123090] Updated weights for policy 1, policy_version 880533 (0.0009) [2023-12-26 06:40:12,463][123090] Updated weights for policy 1, policy_version 880543 (0.0009) [2023-12-26 06:40:12,649][123091] Updated weights for policy 0, policy_version 886778 (0.0011) [2023-12-26 06:40:12,701][123091] Updated weights for policy 0, policy_version 886788 (0.0010) [2023-12-26 06:40:12,755][123091] Updated weights for policy 0, policy_version 886798 (0.0009) [2023-12-26 06:40:13,219][123090] Updated weights for policy 1, policy_version 880553 (0.0006) [2023-12-26 06:40:13,279][123090] Updated weights for policy 1, policy_version 880563 (0.0005) [2023-12-26 06:40:13,330][123090] Updated weights for policy 1, policy_version 880573 (0.0005) [2023-12-26 06:40:13,504][123091] Updated weights for policy 0, policy_version 886808 (0.0006) [2023-12-26 06:40:13,562][123091] Updated weights for policy 0, policy_version 886818 (0.0005) [2023-12-26 06:40:13,639][123091] Updated weights for policy 0, policy_version 886828 (0.0005) [2023-12-26 06:40:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 452460544. Throughput: 0: 8882.7, 1: 8781.0. Samples: 452450400. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:13,785][121949] Avg episode reward: [(0, '6202.052'), (1, '5622.205')] [2023-12-26 06:40:14,133][123090] Updated weights for policy 1, policy_version 880583 (0.0006) [2023-12-26 06:40:14,189][123090] Updated weights for policy 1, policy_version 880593 (0.0007) [2023-12-26 06:40:14,253][123090] Updated weights for policy 1, policy_version 880603 (0.0008) [2023-12-26 06:40:14,265][123091] Updated weights for policy 0, policy_version 886838 (0.0008) [2023-12-26 06:40:14,331][123091] Updated weights for policy 0, policy_version 886848 (0.0011) [2023-12-26 06:40:14,400][123091] Updated weights for policy 0, policy_version 886858 (0.0010) [2023-12-26 06:40:15,032][123090] Updated weights for policy 1, policy_version 880613 (0.0007) [2023-12-26 06:40:15,105][123090] Updated weights for policy 1, policy_version 880623 (0.0006) [2023-12-26 06:40:15,170][123090] Updated weights for policy 1, policy_version 880633 (0.0009) [2023-12-26 06:40:15,267][123091] Updated weights for policy 0, policy_version 886868 (0.0010) [2023-12-26 06:40:15,330][123091] Updated weights for policy 0, policy_version 886878 (0.0010) [2023-12-26 06:40:15,392][123091] Updated weights for policy 0, policy_version 886888 (0.0010) [2023-12-26 06:40:15,934][123090] Updated weights for policy 1, policy_version 880643 (0.0008) [2023-12-26 06:40:15,985][123090] Updated weights for policy 1, policy_version 880653 (0.0005) [2023-12-26 06:40:16,035][123090] Updated weights for policy 1, policy_version 880663 (0.0005) [2023-12-26 06:40:16,194][123091] Updated weights for policy 0, policy_version 886898 (0.0008) [2023-12-26 06:40:16,242][123091] Updated weights for policy 0, policy_version 886908 (0.0005) [2023-12-26 06:40:16,291][123091] Updated weights for policy 0, policy_version 886918 (0.0005) [2023-12-26 06:40:16,337][123091] Updated weights for policy 0, policy_version 886928 (0.0005) [2023-12-26 06:40:16,713][123090] Updated weights for policy 1, policy_version 880673 (0.0005) [2023-12-26 06:40:16,767][123090] Updated weights for policy 1, policy_version 880683 (0.0005) [2023-12-26 06:40:16,826][123090] Updated weights for policy 1, policy_version 880693 (0.0005) [2023-12-26 06:40:16,881][123090] Updated weights for policy 1, policy_version 880703 (0.0009) [2023-12-26 06:40:17,084][123091] Updated weights for policy 0, policy_version 886938 (0.0009) [2023-12-26 06:40:17,138][123091] Updated weights for policy 0, policy_version 886948 (0.0009) [2023-12-26 06:40:17,190][123091] Updated weights for policy 0, policy_version 886958 (0.0009) [2023-12-26 06:40:17,663][123090] Updated weights for policy 1, policy_version 880713 (0.0006) [2023-12-26 06:40:17,724][123090] Updated weights for policy 1, policy_version 880723 (0.0005) [2023-12-26 06:40:17,779][123090] Updated weights for policy 1, policy_version 880733 (0.0005) [2023-12-26 06:40:18,072][123091] Updated weights for policy 0, policy_version 886968 (0.0010) [2023-12-26 06:40:18,120][123091] Updated weights for policy 0, policy_version 886978 (0.0009) [2023-12-26 06:40:18,176][123091] Updated weights for policy 0, policy_version 886988 (0.0009) [2023-12-26 06:40:18,490][123090] Updated weights for policy 1, policy_version 880743 (0.0008) [2023-12-26 06:40:18,546][123090] Updated weights for policy 1, policy_version 880753 (0.0009) [2023-12-26 06:40:18,608][123090] Updated weights for policy 1, policy_version 880763 (0.0010) [2023-12-26 06:40:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 452550656. Throughput: 0: 8921.9, 1: 8862.8. Samples: 452560708. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:18,785][121949] Avg episode reward: [(0, '6195.396'), (1, '5409.017')] [2023-12-26 06:40:19,044][123091] Updated weights for policy 0, policy_version 886998 (0.0010) [2023-12-26 06:40:19,111][123091] Updated weights for policy 0, policy_version 887008 (0.0010) [2023-12-26 06:40:19,173][123091] Updated weights for policy 0, policy_version 887018 (0.0009) [2023-12-26 06:40:19,526][123090] Updated weights for policy 1, policy_version 880773 (0.0009) [2023-12-26 06:40:19,580][123090] Updated weights for policy 1, policy_version 880783 (0.0009) [2023-12-26 06:40:19,642][123090] Updated weights for policy 1, policy_version 880793 (0.0010) [2023-12-26 06:40:19,973][123091] Updated weights for policy 0, policy_version 887028 (0.0010) [2023-12-26 06:40:20,024][123091] Updated weights for policy 0, policy_version 887038 (0.0008) [2023-12-26 06:40:20,094][123091] Updated weights for policy 0, policy_version 887048 (0.0010) [2023-12-26 06:40:20,496][123090] Updated weights for policy 1, policy_version 880803 (0.0010) [2023-12-26 06:40:20,551][123090] Updated weights for policy 1, policy_version 880813 (0.0009) [2023-12-26 06:40:20,615][123090] Updated weights for policy 1, policy_version 880823 (0.0010) [2023-12-26 06:40:20,945][123091] Updated weights for policy 0, policy_version 887058 (0.0010) [2023-12-26 06:40:21,006][123091] Updated weights for policy 0, policy_version 887068 (0.0009) [2023-12-26 06:40:21,089][123091] Updated weights for policy 0, policy_version 887078 (0.0009) [2023-12-26 06:40:21,153][123091] Updated weights for policy 0, policy_version 887088 (0.0009) [2023-12-26 06:40:21,498][123090] Updated weights for policy 1, policy_version 880833 (0.0009) [2023-12-26 06:40:21,566][123090] Updated weights for policy 1, policy_version 880843 (0.0009) [2023-12-26 06:40:21,635][123090] Updated weights for policy 1, policy_version 880853 (0.0007) [2023-12-26 06:40:21,708][123090] Updated weights for policy 1, policy_version 880863 (0.0008) [2023-12-26 06:40:21,985][123091] Updated weights for policy 0, policy_version 887098 (0.0008) [2023-12-26 06:40:22,053][123091] Updated weights for policy 0, policy_version 887108 (0.0008) [2023-12-26 06:40:22,113][123091] Updated weights for policy 0, policy_version 887118 (0.0008) [2023-12-26 06:40:22,530][123090] Updated weights for policy 1, policy_version 880873 (0.0009) [2023-12-26 06:40:22,582][123090] Updated weights for policy 1, policy_version 880883 (0.0009) [2023-12-26 06:40:22,638][123090] Updated weights for policy 1, policy_version 880893 (0.0009) [2023-12-26 06:40:22,914][123091] Updated weights for policy 0, policy_version 887128 (0.0009) [2023-12-26 06:40:22,979][123091] Updated weights for policy 0, policy_version 887138 (0.0009) [2023-12-26 06:40:23,037][123091] Updated weights for policy 0, policy_version 887148 (0.0010) [2023-12-26 06:40:23,465][123090] Updated weights for policy 1, policy_version 880903 (0.0006) [2023-12-26 06:40:23,520][123090] Updated weights for policy 1, policy_version 880913 (0.0005) [2023-12-26 06:40:23,574][123090] Updated weights for policy 1, policy_version 880923 (0.0005) [2023-12-26 06:40:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 452632576. Throughput: 0: 8841.8, 1: 8830.0. Samples: 452610544. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:23,784][121949] Avg episode reward: [(0, '6172.150'), (1, '5490.622')] [2023-12-26 06:40:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000887152_227115008.pth... [2023-12-26 06:40:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000880928_225517568.pth... [2023-12-26 06:40:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000879872_225247232.pth [2023-12-26 06:40:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000886160_226861056.pth [2023-12-26 06:40:23,912][123091] Updated weights for policy 0, policy_version 887158 (0.0010) [2023-12-26 06:40:23,965][123091] Updated weights for policy 0, policy_version 887168 (0.0009) [2023-12-26 06:40:24,020][123091] Updated weights for policy 0, policy_version 887178 (0.0009) [2023-12-26 06:40:24,295][123090] Updated weights for policy 1, policy_version 880933 (0.0008) [2023-12-26 06:40:24,354][123090] Updated weights for policy 1, policy_version 880943 (0.0009) [2023-12-26 06:40:24,407][123090] Updated weights for policy 1, policy_version 880953 (0.0008) [2023-12-26 06:40:24,896][123091] Updated weights for policy 0, policy_version 887188 (0.0010) [2023-12-26 06:40:24,951][123091] Updated weights for policy 0, policy_version 887199 (0.0010) [2023-12-26 06:40:25,003][123091] Updated weights for policy 0, policy_version 887209 (0.0010) [2023-12-26 06:40:25,194][123090] Updated weights for policy 1, policy_version 880963 (0.0010) [2023-12-26 06:40:25,245][123090] Updated weights for policy 1, policy_version 880973 (0.0010) [2023-12-26 06:40:25,296][123090] Updated weights for policy 1, policy_version 880983 (0.0010) [2023-12-26 06:40:25,892][123091] Updated weights for policy 0, policy_version 887219 (0.0009) [2023-12-26 06:40:25,942][123090] Updated weights for policy 1, policy_version 880993 (0.0010) [2023-12-26 06:40:25,947][123091] Updated weights for policy 0, policy_version 887230 (0.0009) [2023-12-26 06:40:25,996][123090] Updated weights for policy 1, policy_version 881003 (0.0006) [2023-12-26 06:40:26,003][123091] Updated weights for policy 0, policy_version 887240 (0.0008) [2023-12-26 06:40:26,043][123090] Updated weights for policy 1, policy_version 881013 (0.0007) [2023-12-26 06:40:26,098][123090] Updated weights for policy 1, policy_version 881023 (0.0008) [2023-12-26 06:40:26,806][123090] Updated weights for policy 1, policy_version 881033 (0.0006) [2023-12-26 06:40:26,879][123090] Updated weights for policy 1, policy_version 881043 (0.0005) [2023-12-26 06:40:26,884][123091] Updated weights for policy 0, policy_version 887250 (0.0009) [2023-12-26 06:40:26,947][123091] Updated weights for policy 0, policy_version 887260 (0.0009) [2023-12-26 06:40:26,950][123090] Updated weights for policy 1, policy_version 881053 (0.0006) [2023-12-26 06:40:27,005][123091] Updated weights for policy 0, policy_version 887270 (0.0010) [2023-12-26 06:40:27,063][123091] Updated weights for policy 0, policy_version 887280 (0.0010) [2023-12-26 06:40:27,628][123090] Updated weights for policy 1, policy_version 881063 (0.0005) [2023-12-26 06:40:27,682][123090] Updated weights for policy 1, policy_version 881073 (0.0005) [2023-12-26 06:40:27,747][123090] Updated weights for policy 1, policy_version 881083 (0.0008) [2023-12-26 06:40:27,825][123091] Updated weights for policy 0, policy_version 887290 (0.0009) [2023-12-26 06:40:27,880][123091] Updated weights for policy 0, policy_version 887300 (0.0010) [2023-12-26 06:40:27,943][123091] Updated weights for policy 0, policy_version 887310 (0.0009) [2023-12-26 06:40:28,470][123090] Updated weights for policy 1, policy_version 881093 (0.0010) [2023-12-26 06:40:28,530][123090] Updated weights for policy 1, policy_version 881103 (0.0009) [2023-12-26 06:40:28,599][123090] Updated weights for policy 1, policy_version 881113 (0.0009) [2023-12-26 06:40:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 452722688. Throughput: 0: 8755.3, 1: 8951.5. Samples: 452716828. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:28,785][121949] Avg episode reward: [(0, '6177.904'), (1, '5709.491')] [2023-12-26 06:40:28,801][123091] Updated weights for policy 0, policy_version 887320 (0.0009) [2023-12-26 06:40:28,854][123091] Updated weights for policy 0, policy_version 887330 (0.0010) [2023-12-26 06:40:28,904][123091] Updated weights for policy 0, policy_version 887340 (0.0009) [2023-12-26 06:40:29,372][123090] Updated weights for policy 1, policy_version 881123 (0.0010) [2023-12-26 06:40:29,430][123090] Updated weights for policy 1, policy_version 881133 (0.0010) [2023-12-26 06:40:29,482][123090] Updated weights for policy 1, policy_version 881143 (0.0008) [2023-12-26 06:40:29,806][123091] Updated weights for policy 0, policy_version 887350 (0.0010) [2023-12-26 06:40:29,874][123091] Updated weights for policy 0, policy_version 887360 (0.0010) [2023-12-26 06:40:29,934][123091] Updated weights for policy 0, policy_version 887370 (0.0008) [2023-12-26 06:40:30,377][123090] Updated weights for policy 1, policy_version 881153 (0.0010) [2023-12-26 06:40:30,424][123090] Updated weights for policy 1, policy_version 881163 (0.0006) [2023-12-26 06:40:30,470][123090] Updated weights for policy 1, policy_version 881173 (0.0005) [2023-12-26 06:40:30,529][123090] Updated weights for policy 1, policy_version 881183 (0.0005) [2023-12-26 06:40:30,771][123091] Updated weights for policy 0, policy_version 887380 (0.0009) [2023-12-26 06:40:30,829][123091] Updated weights for policy 0, policy_version 887390 (0.0010) [2023-12-26 06:40:30,878][123091] Updated weights for policy 0, policy_version 887400 (0.0009) [2023-12-26 06:40:31,229][123090] Updated weights for policy 1, policy_version 881193 (0.0009) [2023-12-26 06:40:31,290][123090] Updated weights for policy 1, policy_version 881203 (0.0010) [2023-12-26 06:40:31,359][123090] Updated weights for policy 1, policy_version 881213 (0.0009) [2023-12-26 06:40:31,774][123091] Updated weights for policy 0, policy_version 887410 (0.0009) [2023-12-26 06:40:31,844][123091] Updated weights for policy 0, policy_version 887420 (0.0009) [2023-12-26 06:40:31,918][123091] Updated weights for policy 0, policy_version 887430 (0.0010) [2023-12-26 06:40:31,984][123091] Updated weights for policy 0, policy_version 887440 (0.0009) [2023-12-26 06:40:32,187][123090] Updated weights for policy 1, policy_version 881223 (0.0010) [2023-12-26 06:40:32,248][123090] Updated weights for policy 1, policy_version 881233 (0.0006) [2023-12-26 06:40:32,311][123090] Updated weights for policy 1, policy_version 881243 (0.0008) [2023-12-26 06:40:32,811][123091] Updated weights for policy 0, policy_version 887450 (0.0010) [2023-12-26 06:40:32,871][123091] Updated weights for policy 0, policy_version 887460 (0.0010) [2023-12-26 06:40:32,924][123091] Updated weights for policy 0, policy_version 887470 (0.0009) [2023-12-26 06:40:33,127][123090] Updated weights for policy 1, policy_version 881253 (0.0009) [2023-12-26 06:40:33,184][123090] Updated weights for policy 1, policy_version 881264 (0.0009) [2023-12-26 06:40:33,237][123090] Updated weights for policy 1, policy_version 881274 (0.0008) [2023-12-26 06:40:33,735][123091] Updated weights for policy 0, policy_version 887480 (0.0009) [2023-12-26 06:40:33,784][123091] Updated weights for policy 0, policy_version 887490 (0.0009) [2023-12-26 06:40:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 452804608. Throughput: 0: 8631.0, 1: 8967.1. Samples: 452819760. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:33,785][121949] Avg episode reward: [(0, '6162.698'), (1, '5682.561')] [2023-12-26 06:40:33,836][123091] Updated weights for policy 0, policy_version 887500 (0.0009) [2023-12-26 06:40:34,080][123090] Updated weights for policy 1, policy_version 881284 (0.0009) [2023-12-26 06:40:34,137][123090] Updated weights for policy 1, policy_version 881294 (0.0008) [2023-12-26 06:40:34,201][123090] Updated weights for policy 1, policy_version 881304 (0.0009) [2023-12-26 06:40:34,676][123091] Updated weights for policy 0, policy_version 887510 (0.0010) [2023-12-26 06:40:34,740][123091] Updated weights for policy 0, policy_version 887520 (0.0009) [2023-12-26 06:40:34,805][123091] Updated weights for policy 0, policy_version 887530 (0.0010) [2023-12-26 06:40:35,055][123090] Updated weights for policy 1, policy_version 881314 (0.0008) [2023-12-26 06:40:35,112][123090] Updated weights for policy 1, policy_version 881324 (0.0005) [2023-12-26 06:40:35,169][123090] Updated weights for policy 1, policy_version 881334 (0.0005) [2023-12-26 06:40:35,235][123090] Updated weights for policy 1, policy_version 881344 (0.0010) [2023-12-26 06:40:35,646][123091] Updated weights for policy 0, policy_version 887540 (0.0010) [2023-12-26 06:40:35,704][123091] Updated weights for policy 0, policy_version 887550 (0.0008) [2023-12-26 06:40:35,759][123091] Updated weights for policy 0, policy_version 887560 (0.0010) [2023-12-26 06:40:35,946][123090] Updated weights for policy 1, policy_version 881354 (0.0009) [2023-12-26 06:40:36,005][123090] Updated weights for policy 1, policy_version 881364 (0.0009) [2023-12-26 06:40:36,062][123090] Updated weights for policy 1, policy_version 881374 (0.0009) [2023-12-26 06:40:36,597][123091] Updated weights for policy 0, policy_version 887570 (0.0009) [2023-12-26 06:40:36,646][123091] Updated weights for policy 0, policy_version 887580 (0.0009) [2023-12-26 06:40:36,697][123091] Updated weights for policy 0, policy_version 887590 (0.0010) [2023-12-26 06:40:36,750][123091] Updated weights for policy 0, policy_version 887600 (0.0010) [2023-12-26 06:40:36,916][123090] Updated weights for policy 1, policy_version 881385 (0.0010) [2023-12-26 06:40:36,964][123090] Updated weights for policy 1, policy_version 881395 (0.0007) [2023-12-26 06:40:37,010][123090] Updated weights for policy 1, policy_version 881405 (0.0005) [2023-12-26 06:40:37,677][123091] Updated weights for policy 0, policy_version 887610 (0.0010) [2023-12-26 06:40:37,738][123091] Updated weights for policy 0, policy_version 887620 (0.0009) [2023-12-26 06:40:37,794][123090] Updated weights for policy 1, policy_version 881415 (0.0006) [2023-12-26 06:40:37,802][123091] Updated weights for policy 0, policy_version 887630 (0.0009) [2023-12-26 06:40:37,860][123090] Updated weights for policy 1, policy_version 881425 (0.0006) [2023-12-26 06:40:37,925][123090] Updated weights for policy 1, policy_version 881435 (0.0008) [2023-12-26 06:40:38,667][123090] Updated weights for policy 1, policy_version 881445 (0.0008) [2023-12-26 06:40:38,688][123091] Updated weights for policy 0, policy_version 887640 (0.0009) [2023-12-26 06:40:38,727][123090] Updated weights for policy 1, policy_version 881455 (0.0009) [2023-12-26 06:40:38,742][123091] Updated weights for policy 0, policy_version 887650 (0.0009) [2023-12-26 06:40:38,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 452886528. Throughput: 0: 8610.0, 1: 8947.9. Samples: 452871160. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:38,785][121949] Avg episode reward: [(0, '6147.042'), (1, '5678.264')] [2023-12-26 06:40:38,788][123090] Updated weights for policy 1, policy_version 881465 (0.0008) [2023-12-26 06:40:38,794][123091] Updated weights for policy 0, policy_version 887660 (0.0007) [2023-12-26 06:40:38,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000887664_227246080.pth... [2023-12-26 06:40:38,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000886640_226983936.pth [2023-12-26 06:40:38,825][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000881472_225656832.pth... [2023-12-26 06:40:38,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000880416_225386496.pth [2023-12-26 06:40:39,621][123091] Updated weights for policy 0, policy_version 887670 (0.0010) [2023-12-26 06:40:39,649][123090] Updated weights for policy 1, policy_version 881475 (0.0006) [2023-12-26 06:40:39,690][123091] Updated weights for policy 0, policy_version 887680 (0.0010) [2023-12-26 06:40:39,707][123090] Updated weights for policy 1, policy_version 881485 (0.0007) [2023-12-26 06:40:39,753][123091] Updated weights for policy 0, policy_version 887690 (0.0008) [2023-12-26 06:40:39,767][123090] Updated weights for policy 1, policy_version 881495 (0.0007) [2023-12-26 06:40:40,540][123091] Updated weights for policy 0, policy_version 887700 (0.0010) [2023-12-26 06:40:40,588][123091] Updated weights for policy 0, policy_version 887710 (0.0009) [2023-12-26 06:40:40,640][123091] Updated weights for policy 0, policy_version 887720 (0.0010) [2023-12-26 06:40:40,642][123090] Updated weights for policy 1, policy_version 881505 (0.0009) [2023-12-26 06:40:40,701][123090] Updated weights for policy 1, policy_version 881515 (0.0008) [2023-12-26 06:40:40,757][123090] Updated weights for policy 1, policy_version 881525 (0.0009) [2023-12-26 06:40:40,813][123090] Updated weights for policy 1, policy_version 881535 (0.0009) [2023-12-26 06:40:41,466][123091] Updated weights for policy 0, policy_version 887730 (0.0008) [2023-12-26 06:40:41,523][123091] Updated weights for policy 0, policy_version 887740 (0.0010) [2023-12-26 06:40:41,573][123091] Updated weights for policy 0, policy_version 887750 (0.0009) [2023-12-26 06:40:41,648][123091] Updated weights for policy 0, policy_version 887760 (0.0009) [2023-12-26 06:40:41,687][123090] Updated weights for policy 1, policy_version 881545 (0.0009) [2023-12-26 06:40:41,768][123090] Updated weights for policy 1, policy_version 881555 (0.0010) [2023-12-26 06:40:41,837][123090] Updated weights for policy 1, policy_version 881565 (0.0008) [2023-12-26 06:40:42,521][123091] Updated weights for policy 0, policy_version 887770 (0.0008) [2023-12-26 06:40:42,586][123091] Updated weights for policy 0, policy_version 887780 (0.0009) [2023-12-26 06:40:42,653][123091] Updated weights for policy 0, policy_version 887790 (0.0009) [2023-12-26 06:40:42,702][123090] Updated weights for policy 1, policy_version 881575 (0.0008) [2023-12-26 06:40:42,757][123090] Updated weights for policy 1, policy_version 881585 (0.0008) [2023-12-26 06:40:42,816][123090] Updated weights for policy 1, policy_version 881595 (0.0008) [2023-12-26 06:40:43,444][123091] Updated weights for policy 0, policy_version 887800 (0.0009) [2023-12-26 06:40:43,500][123091] Updated weights for policy 0, policy_version 887810 (0.0009) [2023-12-26 06:40:43,550][123090] Updated weights for policy 1, policy_version 881605 (0.0005) [2023-12-26 06:40:43,559][123091] Updated weights for policy 0, policy_version 887820 (0.0009) [2023-12-26 06:40:43,600][123090] Updated weights for policy 1, policy_version 881615 (0.0005) [2023-12-26 06:40:43,652][123090] Updated weights for policy 1, policy_version 881625 (0.0007) [2023-12-26 06:40:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 452984832. Throughput: 0: 8564.5, 1: 8895.1. Samples: 452972916. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:43,785][121949] Avg episode reward: [(0, '6230.845'), (1, '5649.703')] [2023-12-26 06:40:44,340][123091] Updated weights for policy 0, policy_version 887830 (0.0007) [2023-12-26 06:40:44,402][123091] Updated weights for policy 0, policy_version 887840 (0.0008) [2023-12-26 06:40:44,445][123090] Updated weights for policy 1, policy_version 881635 (0.0010) [2023-12-26 06:40:44,462][123091] Updated weights for policy 0, policy_version 887850 (0.0007) [2023-12-26 06:40:44,497][123090] Updated weights for policy 1, policy_version 881645 (0.0010) [2023-12-26 06:40:44,544][123090] Updated weights for policy 1, policy_version 881655 (0.0010) [2023-12-26 06:40:45,174][123091] Updated weights for policy 0, policy_version 887860 (0.0006) [2023-12-26 06:40:45,245][123091] Updated weights for policy 0, policy_version 887870 (0.0011) [2023-12-26 06:40:45,309][123091] Updated weights for policy 0, policy_version 887880 (0.0011) [2023-12-26 06:40:45,417][123090] Updated weights for policy 1, policy_version 881665 (0.0010) [2023-12-26 06:40:45,485][123090] Updated weights for policy 1, policy_version 881675 (0.0011) [2023-12-26 06:40:45,553][123090] Updated weights for policy 1, policy_version 881685 (0.0011) [2023-12-26 06:40:45,611][123090] Updated weights for policy 1, policy_version 881695 (0.0011) [2023-12-26 06:40:46,080][123091] Updated weights for policy 0, policy_version 887890 (0.0010) [2023-12-26 06:40:46,139][123091] Updated weights for policy 0, policy_version 887900 (0.0009) [2023-12-26 06:40:46,201][123091] Updated weights for policy 0, policy_version 887910 (0.0010) [2023-12-26 06:40:46,260][123091] Updated weights for policy 0, policy_version 887920 (0.0010) [2023-12-26 06:40:46,418][123090] Updated weights for policy 1, policy_version 881705 (0.0010) [2023-12-26 06:40:46,465][123090] Updated weights for policy 1, policy_version 881715 (0.0010) [2023-12-26 06:40:46,513][123090] Updated weights for policy 1, policy_version 881725 (0.0010) [2023-12-26 06:40:47,133][123091] Updated weights for policy 0, policy_version 887930 (0.0008) [2023-12-26 06:40:47,185][123091] Updated weights for policy 0, policy_version 887940 (0.0008) [2023-12-26 06:40:47,212][123090] Updated weights for policy 1, policy_version 881735 (0.0009) [2023-12-26 06:40:47,236][123091] Updated weights for policy 0, policy_version 887950 (0.0006) [2023-12-26 06:40:47,259][123090] Updated weights for policy 1, policy_version 881745 (0.0010) [2023-12-26 06:40:47,310][123090] Updated weights for policy 1, policy_version 881755 (0.0010) [2023-12-26 06:40:48,070][123091] Updated weights for policy 0, policy_version 887960 (0.0009) [2023-12-26 06:40:48,118][123091] Updated weights for policy 0, policy_version 887970 (0.0009) [2023-12-26 06:40:48,161][123090] Updated weights for policy 1, policy_version 881765 (0.0010) [2023-12-26 06:40:48,176][123091] Updated weights for policy 0, policy_version 887980 (0.0007) [2023-12-26 06:40:48,224][123090] Updated weights for policy 1, policy_version 881775 (0.0010) [2023-12-26 06:40:48,287][123090] Updated weights for policy 1, policy_version 881785 (0.0010) [2023-12-26 06:40:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 453066752. Throughput: 0: 8590.4, 1: 8926.5. Samples: 453079296. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:48,785][121949] Avg episode reward: [(0, '6266.812'), (1, '5653.364')] [2023-12-26 06:40:49,014][123090] Updated weights for policy 1, policy_version 881795 (0.0010) [2023-12-26 06:40:49,076][123090] Updated weights for policy 1, policy_version 881805 (0.0010) [2023-12-26 06:40:49,105][123091] Updated weights for policy 0, policy_version 887990 (0.0008) [2023-12-26 06:40:49,131][123090] Updated weights for policy 1, policy_version 881815 (0.0010) [2023-12-26 06:40:49,160][123091] Updated weights for policy 0, policy_version 888000 (0.0008) [2023-12-26 06:40:49,222][123091] Updated weights for policy 0, policy_version 888010 (0.0009) [2023-12-26 06:40:49,964][123090] Updated weights for policy 1, policy_version 881825 (0.0010) [2023-12-26 06:40:50,034][123090] Updated weights for policy 1, policy_version 881835 (0.0011) [2023-12-26 06:40:50,098][123090] Updated weights for policy 1, policy_version 881845 (0.0011) [2023-12-26 06:40:50,101][123091] Updated weights for policy 0, policy_version 888020 (0.0008) [2023-12-26 06:40:50,159][123090] Updated weights for policy 1, policy_version 881855 (0.0010) [2023-12-26 06:40:50,161][123091] Updated weights for policy 0, policy_version 888030 (0.0006) [2023-12-26 06:40:50,220][123091] Updated weights for policy 0, policy_version 888040 (0.0005) [2023-12-26 06:40:50,910][123091] Updated weights for policy 0, policy_version 888050 (0.0006) [2023-12-26 06:40:50,939][123090] Updated weights for policy 1, policy_version 881865 (0.0010) [2023-12-26 06:40:50,973][123091] Updated weights for policy 0, policy_version 888060 (0.0008) [2023-12-26 06:40:50,996][123090] Updated weights for policy 1, policy_version 881875 (0.0010) [2023-12-26 06:40:51,043][123091] Updated weights for policy 0, policy_version 888070 (0.0008) [2023-12-26 06:40:51,060][123090] Updated weights for policy 1, policy_version 881885 (0.0010) [2023-12-26 06:40:51,114][123091] Updated weights for policy 0, policy_version 888080 (0.0007) [2023-12-26 06:40:51,878][123091] Updated weights for policy 0, policy_version 888090 (0.0009) [2023-12-26 06:40:51,938][123090] Updated weights for policy 1, policy_version 881895 (0.0008) [2023-12-26 06:40:51,942][123091] Updated weights for policy 0, policy_version 888100 (0.0008) [2023-12-26 06:40:52,002][123090] Updated weights for policy 1, policy_version 881905 (0.0006) [2023-12-26 06:40:52,002][123091] Updated weights for policy 0, policy_version 888110 (0.0010) [2023-12-26 06:40:52,058][123090] Updated weights for policy 1, policy_version 881915 (0.0006) [2023-12-26 06:40:52,830][123090] Updated weights for policy 1, policy_version 881925 (0.0007) [2023-12-26 06:40:52,879][123090] Updated weights for policy 1, policy_version 881935 (0.0005) [2023-12-26 06:40:52,892][123091] Updated weights for policy 0, policy_version 888120 (0.0008) [2023-12-26 06:40:52,934][123090] Updated weights for policy 1, policy_version 881945 (0.0006) [2023-12-26 06:40:52,966][123091] Updated weights for policy 0, policy_version 888130 (0.0008) [2023-12-26 06:40:53,023][123091] Updated weights for policy 0, policy_version 888140 (0.0010) [2023-12-26 06:40:53,649][123090] Updated weights for policy 1, policy_version 881955 (0.0005) [2023-12-26 06:40:53,699][123090] Updated weights for policy 1, policy_version 881965 (0.0005) [2023-12-26 06:40:53,758][123090] Updated weights for policy 1, policy_version 881975 (0.0005) [2023-12-26 06:40:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 453148672. Throughput: 0: 8634.1, 1: 8890.6. Samples: 453131680. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:53,785][121949] Avg episode reward: [(0, '6273.199'), (1, '5506.818')] [2023-12-26 06:40:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000888144_227368960.pth... [2023-12-26 06:40:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000887152_227115008.pth [2023-12-26 06:40:53,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000881984_225787904.pth... [2023-12-26 06:40:53,814][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000880928_225517568.pth [2023-12-26 06:40:53,945][123091] Updated weights for policy 0, policy_version 888150 (0.0010) [2023-12-26 06:40:54,022][123091] Updated weights for policy 0, policy_version 888160 (0.0009) [2023-12-26 06:40:54,096][123091] Updated weights for policy 0, policy_version 888170 (0.0010) [2023-12-26 06:40:54,441][123090] Updated weights for policy 1, policy_version 881985 (0.0006) [2023-12-26 06:40:54,509][123090] Updated weights for policy 1, policy_version 881995 (0.0005) [2023-12-26 06:40:54,565][123090] Updated weights for policy 1, policy_version 882005 (0.0005) [2023-12-26 06:40:54,628][123090] Updated weights for policy 1, policy_version 882015 (0.0006) [2023-12-26 06:40:54,893][123091] Updated weights for policy 0, policy_version 888180 (0.0008) [2023-12-26 06:40:54,964][123091] Updated weights for policy 0, policy_version 888190 (0.0008) [2023-12-26 06:40:55,028][123091] Updated weights for policy 0, policy_version 888200 (0.0009) [2023-12-26 06:40:55,244][123090] Updated weights for policy 1, policy_version 882025 (0.0007) [2023-12-26 06:40:55,296][123090] Updated weights for policy 1, policy_version 882035 (0.0010) [2023-12-26 06:40:55,341][123090] Updated weights for policy 1, policy_version 882045 (0.0006) [2023-12-26 06:40:55,849][123091] Updated weights for policy 0, policy_version 888210 (0.0010) [2023-12-26 06:40:55,900][123091] Updated weights for policy 0, policy_version 888220 (0.0010) [2023-12-26 06:40:55,955][123091] Updated weights for policy 0, policy_version 888230 (0.0009) [2023-12-26 06:40:56,013][123091] Updated weights for policy 0, policy_version 888240 (0.0009) [2023-12-26 06:40:56,034][123090] Updated weights for policy 1, policy_version 882055 (0.0005) [2023-12-26 06:40:56,089][123090] Updated weights for policy 1, policy_version 882065 (0.0010) [2023-12-26 06:40:56,142][123090] Updated weights for policy 1, policy_version 882076 (0.0010) [2023-12-26 06:40:56,794][123091] Updated weights for policy 0, policy_version 888250 (0.0010) [2023-12-26 06:40:56,858][123091] Updated weights for policy 0, policy_version 888260 (0.0009) [2023-12-26 06:40:56,922][123091] Updated weights for policy 0, policy_version 888270 (0.0009) [2023-12-26 06:40:57,012][123090] Updated weights for policy 1, policy_version 882086 (0.0008) [2023-12-26 06:40:57,077][123090] Updated weights for policy 1, policy_version 882096 (0.0010) [2023-12-26 06:40:57,130][123090] Updated weights for policy 1, policy_version 882106 (0.0009) [2023-12-26 06:40:57,732][123091] Updated weights for policy 0, policy_version 888280 (0.0010) [2023-12-26 06:40:57,783][123091] Updated weights for policy 0, policy_version 888290 (0.0009) [2023-12-26 06:40:57,851][123091] Updated weights for policy 0, policy_version 888300 (0.0009) [2023-12-26 06:40:57,966][123090] Updated weights for policy 1, policy_version 882116 (0.0010) [2023-12-26 06:40:58,023][123090] Updated weights for policy 1, policy_version 882126 (0.0009) [2023-12-26 06:40:58,079][123090] Updated weights for policy 1, policy_version 882136 (0.0007) [2023-12-26 06:40:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 453238784. Throughput: 0: 8542.4, 1: 8980.4. Samples: 453238924. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:40:58,785][121949] Avg episode reward: [(0, '6231.875'), (1, '5338.094')] [2023-12-26 06:40:58,813][123091] Updated weights for policy 0, policy_version 888310 (0.0011) [2023-12-26 06:40:58,871][123091] Updated weights for policy 0, policy_version 888320 (0.0010) [2023-12-26 06:40:58,943][123091] Updated weights for policy 0, policy_version 888330 (0.0009) [2023-12-26 06:40:58,977][123090] Updated weights for policy 1, policy_version 882146 (0.0008) [2023-12-26 06:40:59,048][123090] Updated weights for policy 1, policy_version 882156 (0.0008) [2023-12-26 06:40:59,117][123090] Updated weights for policy 1, policy_version 882166 (0.0009) [2023-12-26 06:40:59,178][123090] Updated weights for policy 1, policy_version 882176 (0.0010) [2023-12-26 06:40:59,852][123091] Updated weights for policy 0, policy_version 888340 (0.0009) [2023-12-26 06:40:59,906][123091] Updated weights for policy 0, policy_version 888350 (0.0008) [2023-12-26 06:40:59,971][123091] Updated weights for policy 0, policy_version 888360 (0.0009) [2023-12-26 06:41:00,031][123090] Updated weights for policy 1, policy_version 882186 (0.0010) [2023-12-26 06:41:00,099][123090] Updated weights for policy 1, policy_version 882196 (0.0011) [2023-12-26 06:41:00,170][123090] Updated weights for policy 1, policy_version 882206 (0.0010) [2023-12-26 06:41:00,822][123091] Updated weights for policy 0, policy_version 888370 (0.0010) [2023-12-26 06:41:00,872][123090] Updated weights for policy 1, policy_version 882216 (0.0007) [2023-12-26 06:41:00,878][123091] Updated weights for policy 0, policy_version 888380 (0.0009) [2023-12-26 06:41:00,932][123090] Updated weights for policy 1, policy_version 882226 (0.0007) [2023-12-26 06:41:00,937][123091] Updated weights for policy 0, policy_version 888390 (0.0010) [2023-12-26 06:41:00,982][123090] Updated weights for policy 1, policy_version 882236 (0.0008) [2023-12-26 06:41:00,999][123091] Updated weights for policy 0, policy_version 888400 (0.0008) [2023-12-26 06:41:01,822][123091] Updated weights for policy 0, policy_version 888410 (0.0010) [2023-12-26 06:41:01,877][123091] Updated weights for policy 0, policy_version 888420 (0.0009) [2023-12-26 06:41:01,882][123090] Updated weights for policy 1, policy_version 882246 (0.0007) [2023-12-26 06:41:01,930][123091] Updated weights for policy 0, policy_version 888431 (0.0010) [2023-12-26 06:41:01,950][123090] Updated weights for policy 1, policy_version 882256 (0.0005) [2023-12-26 06:41:02,013][123090] Updated weights for policy 1, policy_version 882266 (0.0009) [2023-12-26 06:41:02,753][123090] Updated weights for policy 1, policy_version 882276 (0.0010) [2023-12-26 06:41:02,763][123091] Updated weights for policy 0, policy_version 888441 (0.0011) [2023-12-26 06:41:02,805][123090] Updated weights for policy 1, policy_version 882286 (0.0010) [2023-12-26 06:41:02,819][123091] Updated weights for policy 0, policy_version 888451 (0.0008) [2023-12-26 06:41:02,873][123090] Updated weights for policy 1, policy_version 882296 (0.0011) [2023-12-26 06:41:02,877][123091] Updated weights for policy 0, policy_version 888461 (0.0006) [2023-12-26 06:41:03,613][123091] Updated weights for policy 0, policy_version 888471 (0.0005) [2023-12-26 06:41:03,665][123091] Updated weights for policy 0, policy_version 888481 (0.0005) [2023-12-26 06:41:03,670][123090] Updated weights for policy 1, policy_version 882306 (0.0010) [2023-12-26 06:41:03,729][123090] Updated weights for policy 1, policy_version 882316 (0.0005) [2023-12-26 06:41:03,735][123091] Updated weights for policy 0, policy_version 888491 (0.0005) [2023-12-26 06:41:03,782][123090] Updated weights for policy 1, policy_version 882326 (0.0006) [2023-12-26 06:41:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 453328896. Throughput: 0: 8462.0, 1: 8882.9. Samples: 453341228. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:03,784][121949] Avg episode reward: [(0, '6224.396'), (1, '5312.811')] [2023-12-26 06:41:03,846][123090] Updated weights for policy 1, policy_version 882336 (0.0006) [2023-12-26 06:41:04,436][123091] Updated weights for policy 0, policy_version 888501 (0.0006) [2023-12-26 06:41:04,500][123091] Updated weights for policy 0, policy_version 888511 (0.0011) [2023-12-26 06:41:04,562][123091] Updated weights for policy 0, policy_version 888521 (0.0011) [2023-12-26 06:41:04,621][123090] Updated weights for policy 1, policy_version 882346 (0.0009) [2023-12-26 06:41:04,686][123090] Updated weights for policy 1, policy_version 882356 (0.0009) [2023-12-26 06:41:04,750][123090] Updated weights for policy 1, policy_version 882366 (0.0009) [2023-12-26 06:41:05,278][123091] Updated weights for policy 0, policy_version 888531 (0.0008) [2023-12-26 06:41:05,335][123091] Updated weights for policy 0, policy_version 888541 (0.0005) [2023-12-26 06:41:05,385][123091] Updated weights for policy 0, policy_version 888551 (0.0005) [2023-12-26 06:41:05,625][123090] Updated weights for policy 1, policy_version 882376 (0.0009) [2023-12-26 06:41:05,679][123090] Updated weights for policy 1, policy_version 882387 (0.0010) [2023-12-26 06:41:05,731][123090] Updated weights for policy 1, policy_version 882397 (0.0009) [2023-12-26 06:41:05,976][123091] Updated weights for policy 0, policy_version 888561 (0.0005) [2023-12-26 06:41:06,025][123091] Updated weights for policy 0, policy_version 888571 (0.0005) [2023-12-26 06:41:06,092][123091] Updated weights for policy 0, policy_version 888581 (0.0009) [2023-12-26 06:41:06,166][123091] Updated weights for policy 0, policy_version 888591 (0.0009) [2023-12-26 06:41:06,616][123090] Updated weights for policy 1, policy_version 882407 (0.0006) [2023-12-26 06:41:06,685][123090] Updated weights for policy 1, policy_version 882417 (0.0005) [2023-12-26 06:41:06,749][123090] Updated weights for policy 1, policy_version 882427 (0.0005) [2023-12-26 06:41:07,035][123091] Updated weights for policy 0, policy_version 888601 (0.0008) [2023-12-26 06:41:07,087][123091] Updated weights for policy 0, policy_version 888611 (0.0009) [2023-12-26 06:41:07,156][123091] Updated weights for policy 0, policy_version 888621 (0.0009) [2023-12-26 06:41:07,477][123090] Updated weights for policy 1, policy_version 882437 (0.0008) [2023-12-26 06:41:07,535][123090] Updated weights for policy 1, policy_version 882447 (0.0009) [2023-12-26 06:41:07,591][123090] Updated weights for policy 1, policy_version 882457 (0.0010) [2023-12-26 06:41:07,904][123091] Updated weights for policy 0, policy_version 888631 (0.0007) [2023-12-26 06:41:07,961][123091] Updated weights for policy 0, policy_version 888641 (0.0005) [2023-12-26 06:41:08,017][123091] Updated weights for policy 0, policy_version 888651 (0.0007) [2023-12-26 06:41:08,410][123090] Updated weights for policy 1, policy_version 882467 (0.0010) [2023-12-26 06:41:08,459][123090] Updated weights for policy 1, policy_version 882477 (0.0009) [2023-12-26 06:41:08,522][123090] Updated weights for policy 1, policy_version 882487 (0.0009) [2023-12-26 06:41:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 453419008. Throughput: 0: 8551.6, 1: 8904.1. Samples: 453396052. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:08,785][121949] Avg episode reward: [(0, '6139.768'), (1, '5333.044')] [2023-12-26 06:41:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000882496_225918976.pth... [2023-12-26 06:41:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000881472_225656832.pth [2023-12-26 06:41:08,812][123091] Updated weights for policy 0, policy_version 888661 (0.0009) [2023-12-26 06:41:08,869][123091] Updated weights for policy 0, policy_version 888671 (0.0009) [2023-12-26 06:41:08,924][123091] Updated weights for policy 0, policy_version 888681 (0.0010) [2023-12-26 06:41:08,960][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000888688_227508224.pth... [2023-12-26 06:41:08,963][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000887664_227246080.pth [2023-12-26 06:41:09,386][123090] Updated weights for policy 1, policy_version 882497 (0.0009) [2023-12-26 06:41:09,457][123090] Updated weights for policy 1, policy_version 882507 (0.0010) [2023-12-26 06:41:09,526][123090] Updated weights for policy 1, policy_version 882517 (0.0009) [2023-12-26 06:41:09,576][123090] Updated weights for policy 1, policy_version 882527 (0.0009) [2023-12-26 06:41:09,821][123091] Updated weights for policy 0, policy_version 888691 (0.0010) [2023-12-26 06:41:09,895][123091] Updated weights for policy 0, policy_version 888701 (0.0009) [2023-12-26 06:41:09,966][123091] Updated weights for policy 0, policy_version 888711 (0.0010) [2023-12-26 06:41:10,433][123090] Updated weights for policy 1, policy_version 882537 (0.0006) [2023-12-26 06:41:10,503][123090] Updated weights for policy 1, policy_version 882547 (0.0006) [2023-12-26 06:41:10,566][123090] Updated weights for policy 1, policy_version 882557 (0.0008) [2023-12-26 06:41:10,842][123091] Updated weights for policy 0, policy_version 888721 (0.0010) [2023-12-26 06:41:10,903][123091] Updated weights for policy 0, policy_version 888731 (0.0010) [2023-12-26 06:41:10,965][123091] Updated weights for policy 0, policy_version 888741 (0.0010) [2023-12-26 06:41:11,043][123091] Updated weights for policy 0, policy_version 888751 (0.0010) [2023-12-26 06:41:11,267][123090] Updated weights for policy 1, policy_version 882567 (0.0009) [2023-12-26 06:41:11,340][123090] Updated weights for policy 1, policy_version 882577 (0.0007) [2023-12-26 06:41:11,413][123090] Updated weights for policy 1, policy_version 882587 (0.0009) [2023-12-26 06:41:11,795][123091] Updated weights for policy 0, policy_version 888761 (0.0009) [2023-12-26 06:41:11,871][123091] Updated weights for policy 0, policy_version 888771 (0.0007) [2023-12-26 06:41:11,934][123091] Updated weights for policy 0, policy_version 888781 (0.0006) [2023-12-26 06:41:12,232][123090] Updated weights for policy 1, policy_version 882597 (0.0010) [2023-12-26 06:41:12,291][123090] Updated weights for policy 1, policy_version 882607 (0.0010) [2023-12-26 06:41:12,361][123090] Updated weights for policy 1, policy_version 882617 (0.0009) [2023-12-26 06:41:12,656][123091] Updated weights for policy 0, policy_version 888791 (0.0007) [2023-12-26 06:41:12,725][123091] Updated weights for policy 0, policy_version 888801 (0.0010) [2023-12-26 06:41:12,792][123091] Updated weights for policy 0, policy_version 888811 (0.0009) [2023-12-26 06:41:13,193][123090] Updated weights for policy 1, policy_version 882627 (0.0008) [2023-12-26 06:41:13,271][123090] Updated weights for policy 1, policy_version 882637 (0.0005) [2023-12-26 06:41:13,342][123090] Updated weights for policy 1, policy_version 882647 (0.0005) [2023-12-26 06:41:13,548][123091] Updated weights for policy 0, policy_version 888821 (0.0008) [2023-12-26 06:41:13,596][123091] Updated weights for policy 0, policy_version 888831 (0.0005) [2023-12-26 06:41:13,647][123091] Updated weights for policy 0, policy_version 888841 (0.0009) [2023-12-26 06:41:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 453509120. Throughput: 0: 8591.6, 1: 8808.5. Samples: 453499836. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:13,785][121949] Avg episode reward: [(0, '6091.945'), (1, '5570.190')] [2023-12-26 06:41:13,897][123090] Updated weights for policy 1, policy_version 882657 (0.0005) [2023-12-26 06:41:13,953][123090] Updated weights for policy 1, policy_version 882667 (0.0005) [2023-12-26 06:41:14,005][123090] Updated weights for policy 1, policy_version 882677 (0.0005) [2023-12-26 06:41:14,066][123090] Updated weights for policy 1, policy_version 882687 (0.0007) [2023-12-26 06:41:14,491][123091] Updated weights for policy 0, policy_version 888851 (0.0010) [2023-12-26 06:41:14,545][123091] Updated weights for policy 0, policy_version 888861 (0.0010) [2023-12-26 06:41:14,596][123091] Updated weights for policy 0, policy_version 888872 (0.0009) [2023-12-26 06:41:14,844][123090] Updated weights for policy 1, policy_version 882697 (0.0009) [2023-12-26 06:41:14,910][123090] Updated weights for policy 1, policy_version 882707 (0.0010) [2023-12-26 06:41:14,967][123090] Updated weights for policy 1, policy_version 882717 (0.0009) [2023-12-26 06:41:15,458][123091] Updated weights for policy 0, policy_version 888882 (0.0010) [2023-12-26 06:41:15,506][123091] Updated weights for policy 0, policy_version 888892 (0.0009) [2023-12-26 06:41:15,561][123091] Updated weights for policy 0, policy_version 888903 (0.0009) [2023-12-26 06:41:15,817][123090] Updated weights for policy 1, policy_version 882727 (0.0009) [2023-12-26 06:41:15,874][123090] Updated weights for policy 1, policy_version 882737 (0.0009) [2023-12-26 06:41:15,940][123090] Updated weights for policy 1, policy_version 882747 (0.0009) [2023-12-26 06:41:16,422][123091] Updated weights for policy 0, policy_version 888913 (0.0008) [2023-12-26 06:41:16,479][123091] Updated weights for policy 0, policy_version 888923 (0.0007) [2023-12-26 06:41:16,542][123091] Updated weights for policy 0, policy_version 888933 (0.0005) [2023-12-26 06:41:16,597][123091] Updated weights for policy 0, policy_version 888943 (0.0008) [2023-12-26 06:41:16,773][123090] Updated weights for policy 1, policy_version 882757 (0.0010) [2023-12-26 06:41:16,832][123090] Updated weights for policy 1, policy_version 882767 (0.0009) [2023-12-26 06:41:16,879][123090] Updated weights for policy 1, policy_version 882777 (0.0008) [2023-12-26 06:41:17,416][123091] Updated weights for policy 0, policy_version 888953 (0.0010) [2023-12-26 06:41:17,466][123091] Updated weights for policy 0, policy_version 888963 (0.0010) [2023-12-26 06:41:17,526][123091] Updated weights for policy 0, policy_version 888973 (0.0010) [2023-12-26 06:41:17,702][123090] Updated weights for policy 1, policy_version 882787 (0.0010) [2023-12-26 06:41:17,765][123090] Updated weights for policy 1, policy_version 882797 (0.0009) [2023-12-26 06:41:17,822][123090] Updated weights for policy 1, policy_version 882807 (0.0009) [2023-12-26 06:41:18,191][123091] Updated weights for policy 0, policy_version 888983 (0.0008) [2023-12-26 06:41:18,241][123091] Updated weights for policy 0, policy_version 888993 (0.0009) [2023-12-26 06:41:18,293][123091] Updated weights for policy 0, policy_version 889004 (0.0009) [2023-12-26 06:41:18,665][123090] Updated weights for policy 1, policy_version 882817 (0.0009) [2023-12-26 06:41:18,725][123090] Updated weights for policy 1, policy_version 882827 (0.0005) [2023-12-26 06:41:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.6, 300 sec: 17605.9). Total num frames: 453591040. Throughput: 0: 8652.7, 1: 8811.3. Samples: 453605648. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:18,786][121949] Avg episode reward: [(0, '6110.021'), (1, '5805.833')] [2023-12-26 06:41:18,789][123090] Updated weights for policy 1, policy_version 882837 (0.0005) [2023-12-26 06:41:18,846][123090] Updated weights for policy 1, policy_version 882847 (0.0006) [2023-12-26 06:41:19,215][123091] Updated weights for policy 0, policy_version 889014 (0.0009) [2023-12-26 06:41:19,282][123091] Updated weights for policy 0, policy_version 889024 (0.0010) [2023-12-26 06:41:19,345][123091] Updated weights for policy 0, policy_version 889034 (0.0010) [2023-12-26 06:41:19,577][123090] Updated weights for policy 1, policy_version 882857 (0.0006) [2023-12-26 06:41:19,649][123090] Updated weights for policy 1, policy_version 882867 (0.0005) [2023-12-26 06:41:19,723][123090] Updated weights for policy 1, policy_version 882877 (0.0006) [2023-12-26 06:41:20,161][123091] Updated weights for policy 0, policy_version 889044 (0.0008) [2023-12-26 06:41:20,226][123091] Updated weights for policy 0, policy_version 889054 (0.0008) [2023-12-26 06:41:20,282][123091] Updated weights for policy 0, policy_version 889064 (0.0008) [2023-12-26 06:41:20,534][123090] Updated weights for policy 1, policy_version 882887 (0.0006) [2023-12-26 06:41:20,606][123090] Updated weights for policy 1, policy_version 882897 (0.0009) [2023-12-26 06:41:20,681][123090] Updated weights for policy 1, policy_version 882907 (0.0010) [2023-12-26 06:41:21,158][123091] Updated weights for policy 0, policy_version 889074 (0.0009) [2023-12-26 06:41:21,224][123091] Updated weights for policy 0, policy_version 889084 (0.0005) [2023-12-26 06:41:21,285][123091] Updated weights for policy 0, policy_version 889094 (0.0009) [2023-12-26 06:41:21,344][123091] Updated weights for policy 0, policy_version 889104 (0.0010) [2023-12-26 06:41:21,532][123090] Updated weights for policy 1, policy_version 882917 (0.0008) [2023-12-26 06:41:21,586][123090] Updated weights for policy 1, policy_version 882927 (0.0010) [2023-12-26 06:41:21,648][123090] Updated weights for policy 1, policy_version 882937 (0.0010) [2023-12-26 06:41:22,187][123091] Updated weights for policy 0, policy_version 889114 (0.0010) [2023-12-26 06:41:22,257][123091] Updated weights for policy 0, policy_version 889124 (0.0010) [2023-12-26 06:41:22,323][123091] Updated weights for policy 0, policy_version 889134 (0.0010) [2023-12-26 06:41:22,505][123090] Updated weights for policy 1, policy_version 882947 (0.0009) [2023-12-26 06:41:22,574][123090] Updated weights for policy 1, policy_version 882957 (0.0009) [2023-12-26 06:41:22,632][123090] Updated weights for policy 1, policy_version 882967 (0.0010) [2023-12-26 06:41:23,188][123091] Updated weights for policy 0, policy_version 889144 (0.0010) [2023-12-26 06:41:23,240][123091] Updated weights for policy 0, policy_version 889154 (0.0009) [2023-12-26 06:41:23,294][123091] Updated weights for policy 0, policy_version 889164 (0.0010) [2023-12-26 06:41:23,440][123090] Updated weights for policy 1, policy_version 882977 (0.0009) [2023-12-26 06:41:23,501][123090] Updated weights for policy 1, policy_version 882987 (0.0009) [2023-12-26 06:41:23,562][123090] Updated weights for policy 1, policy_version 882997 (0.0009) [2023-12-26 06:41:23,623][123090] Updated weights for policy 1, policy_version 883007 (0.0008) [2023-12-26 06:41:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 453681152. Throughput: 0: 8634.7, 1: 8828.1. Samples: 453656988. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:23,785][121949] Avg episode reward: [(0, '6180.128'), (1, '5731.149')] [2023-12-26 06:41:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000889168_227631104.pth... [2023-12-26 06:41:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000883008_226050048.pth... [2023-12-26 06:41:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000888144_227368960.pth [2023-12-26 06:41:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000881984_225787904.pth [2023-12-26 06:41:24,183][123091] Updated weights for policy 0, policy_version 889174 (0.0009) [2023-12-26 06:41:24,251][123091] Updated weights for policy 0, policy_version 889184 (0.0009) [2023-12-26 06:41:24,312][123091] Updated weights for policy 0, policy_version 889194 (0.0009) [2023-12-26 06:41:24,428][123090] Updated weights for policy 1, policy_version 883017 (0.0009) [2023-12-26 06:41:24,495][123090] Updated weights for policy 1, policy_version 883027 (0.0009) [2023-12-26 06:41:24,555][123090] Updated weights for policy 1, policy_version 883037 (0.0009) [2023-12-26 06:41:25,208][123091] Updated weights for policy 0, policy_version 889204 (0.0009) [2023-12-26 06:41:25,235][123090] Updated weights for policy 1, policy_version 883047 (0.0007) [2023-12-26 06:41:25,267][123091] Updated weights for policy 0, policy_version 889214 (0.0009) [2023-12-26 06:41:25,299][123090] Updated weights for policy 1, policy_version 883057 (0.0007) [2023-12-26 06:41:25,331][123091] Updated weights for policy 0, policy_version 889224 (0.0007) [2023-12-26 06:41:25,363][123090] Updated weights for policy 1, policy_version 883067 (0.0011) [2023-12-26 06:41:26,054][123090] Updated weights for policy 1, policy_version 883077 (0.0008) [2023-12-26 06:41:26,107][123090] Updated weights for policy 1, policy_version 883087 (0.0005) [2023-12-26 06:41:26,167][123090] Updated weights for policy 1, policy_version 883097 (0.0005) [2023-12-26 06:41:26,199][123091] Updated weights for policy 0, policy_version 889234 (0.0006) [2023-12-26 06:41:26,256][123091] Updated weights for policy 0, policy_version 889244 (0.0010) [2023-12-26 06:41:26,314][123091] Updated weights for policy 0, policy_version 889254 (0.0010) [2023-12-26 06:41:26,372][123091] Updated weights for policy 0, policy_version 889264 (0.0010) [2023-12-26 06:41:26,769][123090] Updated weights for policy 1, policy_version 883107 (0.0005) [2023-12-26 06:41:26,827][123090] Updated weights for policy 1, policy_version 883117 (0.0005) [2023-12-26 06:41:26,890][123090] Updated weights for policy 1, policy_version 883127 (0.0005) [2023-12-26 06:41:27,277][123091] Updated weights for policy 0, policy_version 889274 (0.0010) [2023-12-26 06:41:27,345][123091] Updated weights for policy 0, policy_version 889284 (0.0009) [2023-12-26 06:41:27,400][123091] Updated weights for policy 0, policy_version 889294 (0.0009) [2023-12-26 06:41:27,572][123090] Updated weights for policy 1, policy_version 883137 (0.0006) [2023-12-26 06:41:27,630][123090] Updated weights for policy 1, policy_version 883147 (0.0010) [2023-12-26 06:41:27,695][123090] Updated weights for policy 1, policy_version 883157 (0.0010) [2023-12-26 06:41:27,761][123090] Updated weights for policy 1, policy_version 883167 (0.0010) [2023-12-26 06:41:28,245][123091] Updated weights for policy 0, policy_version 889304 (0.0009) [2023-12-26 06:41:28,303][123091] Updated weights for policy 0, policy_version 889314 (0.0009) [2023-12-26 06:41:28,367][123091] Updated weights for policy 0, policy_version 889324 (0.0009) [2023-12-26 06:41:28,550][123090] Updated weights for policy 1, policy_version 883177 (0.0010) [2023-12-26 06:41:28,606][123090] Updated weights for policy 1, policy_version 883187 (0.0010) [2023-12-26 06:41:28,654][123090] Updated weights for policy 1, policy_version 883197 (0.0010) [2023-12-26 06:41:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 453771264. Throughput: 0: 8595.9, 1: 8939.2. Samples: 453761996. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:28,785][121949] Avg episode reward: [(0, '6136.700'), (1, '5734.239')] [2023-12-26 06:41:29,200][123091] Updated weights for policy 0, policy_version 889334 (0.0009) [2023-12-26 06:41:29,271][123091] Updated weights for policy 0, policy_version 889344 (0.0009) [2023-12-26 06:41:29,336][123091] Updated weights for policy 0, policy_version 889354 (0.0009) [2023-12-26 06:41:29,505][123090] Updated weights for policy 1, policy_version 883207 (0.0010) [2023-12-26 06:41:29,574][123090] Updated weights for policy 1, policy_version 883217 (0.0011) [2023-12-26 06:41:29,642][123090] Updated weights for policy 1, policy_version 883227 (0.0011) [2023-12-26 06:41:30,199][123091] Updated weights for policy 0, policy_version 889364 (0.0009) [2023-12-26 06:41:30,256][123091] Updated weights for policy 0, policy_version 889374 (0.0010) [2023-12-26 06:41:30,308][123091] Updated weights for policy 0, policy_version 889385 (0.0009) [2023-12-26 06:41:30,314][123090] Updated weights for policy 1, policy_version 883237 (0.0008) [2023-12-26 06:41:30,369][123090] Updated weights for policy 1, policy_version 883247 (0.0007) [2023-12-26 06:41:30,425][123090] Updated weights for policy 1, policy_version 883257 (0.0005) [2023-12-26 06:41:31,143][123090] Updated weights for policy 1, policy_version 883267 (0.0008) [2023-12-26 06:41:31,213][123090] Updated weights for policy 1, policy_version 883277 (0.0011) [2023-12-26 06:41:31,267][123091] Updated weights for policy 0, policy_version 889395 (0.0009) [2023-12-26 06:41:31,279][123090] Updated weights for policy 1, policy_version 883287 (0.0010) [2023-12-26 06:41:31,333][123091] Updated weights for policy 0, policy_version 889405 (0.0008) [2023-12-26 06:41:31,405][123091] Updated weights for policy 0, policy_version 889415 (0.0007) [2023-12-26 06:41:32,078][123090] Updated weights for policy 1, policy_version 883297 (0.0009) [2023-12-26 06:41:32,133][123090] Updated weights for policy 1, policy_version 883307 (0.0009) [2023-12-26 06:41:32,181][123091] Updated weights for policy 0, policy_version 889425 (0.0005) [2023-12-26 06:41:32,187][123090] Updated weights for policy 1, policy_version 883317 (0.0009) [2023-12-26 06:41:32,232][123091] Updated weights for policy 0, policy_version 889435 (0.0007) [2023-12-26 06:41:32,242][123090] Updated weights for policy 1, policy_version 883327 (0.0009) [2023-12-26 06:41:32,291][123091] Updated weights for policy 0, policy_version 889445 (0.0009) [2023-12-26 06:41:32,346][123091] Updated weights for policy 0, policy_version 889455 (0.0009) [2023-12-26 06:41:33,054][123091] Updated weights for policy 0, policy_version 889465 (0.0006) [2023-12-26 06:41:33,113][123091] Updated weights for policy 0, policy_version 889475 (0.0005) [2023-12-26 06:41:33,168][123091] Updated weights for policy 0, policy_version 889485 (0.0005) [2023-12-26 06:41:33,176][123090] Updated weights for policy 1, policy_version 883337 (0.0008) [2023-12-26 06:41:33,233][123090] Updated weights for policy 1, policy_version 883348 (0.0010) [2023-12-26 06:41:33,294][123090] Updated weights for policy 1, policy_version 883358 (0.0007) [2023-12-26 06:41:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 453853184. Throughput: 0: 8586.6, 1: 8928.2. Samples: 453867460. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:33,784][121949] Avg episode reward: [(0, '6109.005'), (1, '5755.094')] [2023-12-26 06:41:33,877][123091] Updated weights for policy 0, policy_version 889495 (0.0009) [2023-12-26 06:41:33,928][123091] Updated weights for policy 0, policy_version 889505 (0.0010) [2023-12-26 06:41:33,978][123090] Updated weights for policy 1, policy_version 883368 (0.0005) [2023-12-26 06:41:33,983][123091] Updated weights for policy 0, policy_version 889515 (0.0010) [2023-12-26 06:41:34,037][123090] Updated weights for policy 1, policy_version 883378 (0.0005) [2023-12-26 06:41:34,088][123090] Updated weights for policy 1, policy_version 883388 (0.0009) [2023-12-26 06:41:34,819][123091] Updated weights for policy 0, policy_version 889525 (0.0009) [2023-12-26 06:41:34,823][123090] Updated weights for policy 1, policy_version 883398 (0.0009) [2023-12-26 06:41:34,878][123091] Updated weights for policy 0, policy_version 889535 (0.0010) [2023-12-26 06:41:34,883][123090] Updated weights for policy 1, policy_version 883408 (0.0009) [2023-12-26 06:41:34,933][123091] Updated weights for policy 0, policy_version 889545 (0.0010) [2023-12-26 06:41:34,938][123090] Updated weights for policy 1, policy_version 883418 (0.0010) [2023-12-26 06:41:35,658][123090] Updated weights for policy 1, policy_version 883428 (0.0010) [2023-12-26 06:41:35,698][123091] Updated weights for policy 0, policy_version 889555 (0.0009) [2023-12-26 06:41:35,710][123090] Updated weights for policy 1, policy_version 883438 (0.0010) [2023-12-26 06:41:35,759][123091] Updated weights for policy 0, policy_version 889565 (0.0006) [2023-12-26 06:41:35,763][123090] Updated weights for policy 1, policy_version 883448 (0.0011) [2023-12-26 06:41:35,822][123091] Updated weights for policy 0, policy_version 889575 (0.0005) [2023-12-26 06:41:36,587][123091] Updated weights for policy 0, policy_version 889585 (0.0006) [2023-12-26 06:41:36,602][123090] Updated weights for policy 1, policy_version 883458 (0.0011) [2023-12-26 06:41:36,644][123091] Updated weights for policy 0, policy_version 889595 (0.0011) [2023-12-26 06:41:36,666][123090] Updated weights for policy 1, policy_version 883468 (0.0011) [2023-12-26 06:41:36,696][123091] Updated weights for policy 0, policy_version 889605 (0.0010) [2023-12-26 06:41:36,729][123090] Updated weights for policy 1, policy_version 883478 (0.0010) [2023-12-26 06:41:36,748][123091] Updated weights for policy 0, policy_version 889615 (0.0010) [2023-12-26 06:41:36,793][123090] Updated weights for policy 1, policy_version 883488 (0.0010) [2023-12-26 06:41:37,588][123091] Updated weights for policy 0, policy_version 889625 (0.0006) [2023-12-26 06:41:37,614][123090] Updated weights for policy 1, policy_version 883498 (0.0011) [2023-12-26 06:41:37,656][123091] Updated weights for policy 0, policy_version 889635 (0.0007) [2023-12-26 06:41:37,678][123090] Updated weights for policy 1, policy_version 883508 (0.0011) [2023-12-26 06:41:37,718][123091] Updated weights for policy 0, policy_version 889645 (0.0009) [2023-12-26 06:41:37,740][123090] Updated weights for policy 1, policy_version 883519 (0.0011) [2023-12-26 06:41:38,438][123091] Updated weights for policy 0, policy_version 889655 (0.0009) [2023-12-26 06:41:38,505][123091] Updated weights for policy 0, policy_version 889665 (0.0011) [2023-12-26 06:41:38,561][123090] Updated weights for policy 1, policy_version 883529 (0.0011) [2023-12-26 06:41:38,568][123091] Updated weights for policy 0, policy_version 889675 (0.0011) [2023-12-26 06:41:38,628][123090] Updated weights for policy 1, policy_version 883539 (0.0010) [2023-12-26 06:41:38,699][123090] Updated weights for policy 1, policy_version 883549 (0.0010) [2023-12-26 06:41:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 453951488. Throughput: 0: 8600.3, 1: 8980.3. Samples: 453922808. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:38,785][121949] Avg episode reward: [(0, '6046.754'), (1, '5738.928')] [2023-12-26 06:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000889680_227762176.pth... [2023-12-26 06:41:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000883552_226189312.pth... [2023-12-26 06:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000882496_225918976.pth [2023-12-26 06:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000888688_227508224.pth [2023-12-26 06:41:39,414][123091] Updated weights for policy 0, policy_version 889685 (0.0011) [2023-12-26 06:41:39,473][123091] Updated weights for policy 0, policy_version 889695 (0.0011) [2023-12-26 06:41:39,520][123090] Updated weights for policy 1, policy_version 883559 (0.0007) [2023-12-26 06:41:39,521][123091] Updated weights for policy 0, policy_version 889705 (0.0011) [2023-12-26 06:41:39,581][123090] Updated weights for policy 1, policy_version 883569 (0.0005) [2023-12-26 06:41:39,652][123090] Updated weights for policy 1, policy_version 883579 (0.0006) [2023-12-26 06:41:40,383][123091] Updated weights for policy 0, policy_version 889715 (0.0009) [2023-12-26 06:41:40,460][123091] Updated weights for policy 0, policy_version 889725 (0.0005) [2023-12-26 06:41:40,470][123090] Updated weights for policy 1, policy_version 883589 (0.0007) [2023-12-26 06:41:40,529][123091] Updated weights for policy 0, policy_version 889735 (0.0006) [2023-12-26 06:41:40,531][123090] Updated weights for policy 1, policy_version 883599 (0.0008) [2023-12-26 06:41:40,595][123090] Updated weights for policy 1, policy_version 883609 (0.0009) [2023-12-26 06:41:41,160][123091] Updated weights for policy 0, policy_version 889745 (0.0006) [2023-12-26 06:41:41,227][123091] Updated weights for policy 0, policy_version 889755 (0.0007) [2023-12-26 06:41:41,297][123091] Updated weights for policy 0, policy_version 889765 (0.0009) [2023-12-26 06:41:41,361][123091] Updated weights for policy 0, policy_version 889775 (0.0011) [2023-12-26 06:41:41,516][123090] Updated weights for policy 1, policy_version 883619 (0.0009) [2023-12-26 06:41:41,582][123090] Updated weights for policy 1, policy_version 883629 (0.0009) [2023-12-26 06:41:41,645][123090] Updated weights for policy 1, policy_version 883639 (0.0008) [2023-12-26 06:41:42,204][123091] Updated weights for policy 0, policy_version 889785 (0.0008) [2023-12-26 06:41:42,284][123091] Updated weights for policy 0, policy_version 889795 (0.0008) [2023-12-26 06:41:42,343][123091] Updated weights for policy 0, policy_version 889805 (0.0008) [2023-12-26 06:41:42,442][123090] Updated weights for policy 1, policy_version 883649 (0.0006) [2023-12-26 06:41:42,508][123090] Updated weights for policy 1, policy_version 883659 (0.0009) [2023-12-26 06:41:42,578][123090] Updated weights for policy 1, policy_version 883669 (0.0010) [2023-12-26 06:41:42,651][123090] Updated weights for policy 1, policy_version 883679 (0.0010) [2023-12-26 06:41:43,061][123091] Updated weights for policy 0, policy_version 889815 (0.0006) [2023-12-26 06:41:43,133][123091] Updated weights for policy 0, policy_version 889825 (0.0005) [2023-12-26 06:41:43,211][123091] Updated weights for policy 0, policy_version 889835 (0.0006) [2023-12-26 06:41:43,568][123090] Updated weights for policy 1, policy_version 883689 (0.0010) [2023-12-26 06:41:43,621][123090] Updated weights for policy 1, policy_version 883699 (0.0009) [2023-12-26 06:41:43,671][123090] Updated weights for policy 1, policy_version 883709 (0.0009) [2023-12-26 06:41:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 454033408. Throughput: 0: 8646.7, 1: 8830.0. Samples: 454025376. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:43,785][121949] Avg episode reward: [(0, '6026.449'), (1, '5621.754')] [2023-12-26 06:41:43,816][123091] Updated weights for policy 0, policy_version 889845 (0.0007) [2023-12-26 06:41:43,863][123091] Updated weights for policy 0, policy_version 889855 (0.0009) [2023-12-26 06:41:43,912][123091] Updated weights for policy 0, policy_version 889865 (0.0009) [2023-12-26 06:41:44,517][123090] Updated weights for policy 1, policy_version 883719 (0.0009) [2023-12-26 06:41:44,581][123090] Updated weights for policy 1, policy_version 883729 (0.0009) [2023-12-26 06:41:44,649][123090] Updated weights for policy 1, policy_version 883739 (0.0009) [2023-12-26 06:41:44,754][123091] Updated weights for policy 0, policy_version 889875 (0.0008) [2023-12-26 06:41:44,824][123091] Updated weights for policy 0, policy_version 889885 (0.0009) [2023-12-26 06:41:44,884][123091] Updated weights for policy 0, policy_version 889895 (0.0009) [2023-12-26 06:41:45,428][123090] Updated weights for policy 1, policy_version 883749 (0.0007) [2023-12-26 06:41:45,495][123090] Updated weights for policy 1, policy_version 883759 (0.0005) [2023-12-26 06:41:45,566][123090] Updated weights for policy 1, policy_version 883769 (0.0005) [2023-12-26 06:41:45,751][123091] Updated weights for policy 0, policy_version 889905 (0.0009) [2023-12-26 06:41:45,806][123091] Updated weights for policy 0, policy_version 889915 (0.0009) [2023-12-26 06:41:45,868][123091] Updated weights for policy 0, policy_version 889925 (0.0010) [2023-12-26 06:41:45,935][123091] Updated weights for policy 0, policy_version 889936 (0.0010) [2023-12-26 06:41:46,301][123090] Updated weights for policy 1, policy_version 883779 (0.0006) [2023-12-26 06:41:46,357][123090] Updated weights for policy 1, policy_version 883789 (0.0009) [2023-12-26 06:41:46,422][123090] Updated weights for policy 1, policy_version 883799 (0.0005) [2023-12-26 06:41:46,795][123091] Updated weights for policy 0, policy_version 889946 (0.0010) [2023-12-26 06:41:46,857][123091] Updated weights for policy 0, policy_version 889956 (0.0010) [2023-12-26 06:41:46,919][123091] Updated weights for policy 0, policy_version 889967 (0.0010) [2023-12-26 06:41:47,173][123090] Updated weights for policy 1, policy_version 883809 (0.0007) [2023-12-26 06:41:47,236][123090] Updated weights for policy 1, policy_version 883819 (0.0005) [2023-12-26 06:41:47,284][123090] Updated weights for policy 1, policy_version 883829 (0.0005) [2023-12-26 06:41:47,334][123090] Updated weights for policy 1, policy_version 883839 (0.0005) [2023-12-26 06:41:47,701][123091] Updated weights for policy 0, policy_version 889977 (0.0009) [2023-12-26 06:41:47,752][123091] Updated weights for policy 0, policy_version 889987 (0.0010) [2023-12-26 06:41:47,805][123091] Updated weights for policy 0, policy_version 889997 (0.0009) [2023-12-26 06:41:48,183][123090] Updated weights for policy 1, policy_version 883849 (0.0006) [2023-12-26 06:41:48,252][123090] Updated weights for policy 1, policy_version 883859 (0.0005) [2023-12-26 06:41:48,330][123090] Updated weights for policy 1, policy_version 883869 (0.0006) [2023-12-26 06:41:48,563][123091] Updated weights for policy 0, policy_version 890008 (0.0007) [2023-12-26 06:41:48,612][123091] Updated weights for policy 0, policy_version 890018 (0.0011) [2023-12-26 06:41:48,660][123091] Updated weights for policy 0, policy_version 890028 (0.0010) [2023-12-26 06:41:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 454123520. Throughput: 0: 8732.9, 1: 8869.0. Samples: 454133312. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:48,785][121949] Avg episode reward: [(0, '6034.568'), (1, '5613.754')] [2023-12-26 06:41:49,065][123090] Updated weights for policy 1, policy_version 883879 (0.0009) [2023-12-26 06:41:49,114][123090] Updated weights for policy 1, policy_version 883889 (0.0008) [2023-12-26 06:41:49,167][123090] Updated weights for policy 1, policy_version 883899 (0.0009) [2023-12-26 06:41:49,470][123091] Updated weights for policy 0, policy_version 890038 (0.0011) [2023-12-26 06:41:49,532][123091] Updated weights for policy 0, policy_version 890048 (0.0010) [2023-12-26 06:41:49,587][123091] Updated weights for policy 0, policy_version 890058 (0.0010) [2023-12-26 06:41:50,012][123090] Updated weights for policy 1, policy_version 883909 (0.0009) [2023-12-26 06:41:50,079][123090] Updated weights for policy 1, policy_version 883919 (0.0010) [2023-12-26 06:41:50,149][123090] Updated weights for policy 1, policy_version 883929 (0.0010) [2023-12-26 06:41:50,380][123091] Updated weights for policy 0, policy_version 890068 (0.0008) [2023-12-26 06:41:50,450][123091] Updated weights for policy 0, policy_version 890078 (0.0011) [2023-12-26 06:41:50,516][123091] Updated weights for policy 0, policy_version 890088 (0.0011) [2023-12-26 06:41:50,878][123090] Updated weights for policy 1, policy_version 883939 (0.0010) [2023-12-26 06:41:50,956][123090] Updated weights for policy 1, policy_version 883949 (0.0011) [2023-12-26 06:41:51,032][123090] Updated weights for policy 1, policy_version 883959 (0.0011) [2023-12-26 06:41:51,300][123091] Updated weights for policy 0, policy_version 890098 (0.0010) [2023-12-26 06:41:51,376][123091] Updated weights for policy 0, policy_version 890108 (0.0008) [2023-12-26 06:41:51,444][123091] Updated weights for policy 0, policy_version 890118 (0.0009) [2023-12-26 06:41:51,508][123091] Updated weights for policy 0, policy_version 890128 (0.0009) [2023-12-26 06:41:51,833][123090] Updated weights for policy 1, policy_version 883969 (0.0008) [2023-12-26 06:41:51,900][123090] Updated weights for policy 1, policy_version 883979 (0.0009) [2023-12-26 06:41:51,967][123090] Updated weights for policy 1, policy_version 883989 (0.0009) [2023-12-26 06:41:52,035][123090] Updated weights for policy 1, policy_version 883999 (0.0009) [2023-12-26 06:41:52,382][123091] Updated weights for policy 0, policy_version 890138 (0.0007) [2023-12-26 06:41:52,452][123091] Updated weights for policy 0, policy_version 890148 (0.0006) [2023-12-26 06:41:52,507][123091] Updated weights for policy 0, policy_version 890158 (0.0009) [2023-12-26 06:41:52,864][123090] Updated weights for policy 1, policy_version 884009 (0.0009) [2023-12-26 06:41:52,920][123090] Updated weights for policy 1, policy_version 884019 (0.0009) [2023-12-26 06:41:52,977][123090] Updated weights for policy 1, policy_version 884029 (0.0009) [2023-12-26 06:41:53,295][123091] Updated weights for policy 0, policy_version 890168 (0.0006) [2023-12-26 06:41:53,340][123091] Updated weights for policy 0, policy_version 890178 (0.0005) [2023-12-26 06:41:53,406][123091] Updated weights for policy 0, policy_version 890188 (0.0005) [2023-12-26 06:41:53,735][123090] Updated weights for policy 1, policy_version 884039 (0.0006) [2023-12-26 06:41:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 454205440. Throughput: 0: 8670.5, 1: 8881.5. Samples: 454185892. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 06:41:53,786][121949] Avg episode reward: [(0, '6025.697'), (1, '5670.984')] [2023-12-26 06:41:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000890192_227893248.pth... [2023-12-26 06:41:53,798][123090] Updated weights for policy 1, policy_version 884049 (0.0006) [2023-12-26 06:41:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000889168_227631104.pth [2023-12-26 06:41:53,848][123090] Updated weights for policy 1, policy_version 884059 (0.0005) [2023-12-26 06:41:53,872][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000884064_226320384.pth... [2023-12-26 06:41:53,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000883008_226050048.pth [2023-12-26 06:41:54,090][123091] Updated weights for policy 0, policy_version 890198 (0.0005) [2023-12-26 06:41:54,144][123091] Updated weights for policy 0, policy_version 890208 (0.0007) [2023-12-26 06:41:54,195][123091] Updated weights for policy 0, policy_version 890218 (0.0008) [2023-12-26 06:41:54,491][123090] Updated weights for policy 1, policy_version 884069 (0.0007) [2023-12-26 06:41:54,557][123090] Updated weights for policy 1, policy_version 884079 (0.0010) [2023-12-26 06:41:54,608][123090] Updated weights for policy 1, policy_version 884089 (0.0009) [2023-12-26 06:41:54,937][123091] Updated weights for policy 0, policy_version 890228 (0.0006) [2023-12-26 06:41:55,000][123091] Updated weights for policy 0, policy_version 890238 (0.0006) [2023-12-26 06:41:55,064][123091] Updated weights for policy 0, policy_version 890248 (0.0010) [2023-12-26 06:41:55,485][123090] Updated weights for policy 1, policy_version 884099 (0.0008) [2023-12-26 06:41:55,549][123090] Updated weights for policy 1, policy_version 884109 (0.0009) [2023-12-26 06:41:55,619][123090] Updated weights for policy 1, policy_version 884119 (0.0006) [2023-12-26 06:41:55,868][123091] Updated weights for policy 0, policy_version 890258 (0.0010) [2023-12-26 06:41:55,920][123091] Updated weights for policy 0, policy_version 890268 (0.0011) [2023-12-26 06:41:55,990][123091] Updated weights for policy 0, policy_version 890278 (0.0011) [2023-12-26 06:41:56,071][123091] Updated weights for policy 0, policy_version 890288 (0.0011) [2023-12-26 06:41:56,309][123090] Updated weights for policy 1, policy_version 884129 (0.0005) [2023-12-26 06:41:56,376][123090] Updated weights for policy 1, policy_version 884139 (0.0009) [2023-12-26 06:41:56,439][123090] Updated weights for policy 1, policy_version 884149 (0.0010) [2023-12-26 06:41:56,498][123090] Updated weights for policy 1, policy_version 884159 (0.0007) [2023-12-26 06:41:56,752][123091] Updated weights for policy 0, policy_version 890298 (0.0006) [2023-12-26 06:41:56,799][123091] Updated weights for policy 0, policy_version 890308 (0.0010) [2023-12-26 06:41:56,857][123091] Updated weights for policy 0, policy_version 890318 (0.0010) [2023-12-26 06:41:57,272][123090] Updated weights for policy 1, policy_version 884169 (0.0010) [2023-12-26 06:41:57,328][123090] Updated weights for policy 1, policy_version 884179 (0.0010) [2023-12-26 06:41:57,387][123090] Updated weights for policy 1, policy_version 884189 (0.0010) [2023-12-26 06:41:57,621][123091] Updated weights for policy 0, policy_version 890328 (0.0010) [2023-12-26 06:41:57,675][123091] Updated weights for policy 0, policy_version 890338 (0.0010) [2023-12-26 06:41:57,736][123091] Updated weights for policy 0, policy_version 890348 (0.0010) [2023-12-26 06:41:58,147][123090] Updated weights for policy 1, policy_version 884199 (0.0007) [2023-12-26 06:41:58,202][123090] Updated weights for policy 1, policy_version 884209 (0.0008) [2023-12-26 06:41:58,269][123090] Updated weights for policy 1, policy_version 884219 (0.0009) [2023-12-26 06:41:58,602][123091] Updated weights for policy 0, policy_version 890358 (0.0010) [2023-12-26 06:41:58,673][123091] Updated weights for policy 0, policy_version 890368 (0.0007) [2023-12-26 06:41:58,747][123091] Updated weights for policy 0, policy_version 890378 (0.0008) [2023-12-26 06:41:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 454303744. Throughput: 0: 8745.8, 1: 8927.7. Samples: 454295140. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:41:58,784][121949] Avg episode reward: [(0, '6001.634'), (1, '5764.907')] [2023-12-26 06:41:59,250][123090] Updated weights for policy 1, policy_version 884229 (0.0008) [2023-12-26 06:41:59,314][123090] Updated weights for policy 1, policy_version 884239 (0.0009) [2023-12-26 06:41:59,378][123090] Updated weights for policy 1, policy_version 884249 (0.0010) [2023-12-26 06:41:59,544][123091] Updated weights for policy 0, policy_version 890388 (0.0007) [2023-12-26 06:41:59,589][123091] Updated weights for policy 0, policy_version 890398 (0.0006) [2023-12-26 06:41:59,644][123091] Updated weights for policy 0, policy_version 890408 (0.0005) [2023-12-26 06:42:00,263][123090] Updated weights for policy 1, policy_version 884259 (0.0009) [2023-12-26 06:42:00,328][123090] Updated weights for policy 1, policy_version 884269 (0.0006) [2023-12-26 06:42:00,389][123090] Updated weights for policy 1, policy_version 884279 (0.0006) [2023-12-26 06:42:00,427][123091] Updated weights for policy 0, policy_version 890418 (0.0006) [2023-12-26 06:42:00,484][123091] Updated weights for policy 0, policy_version 890428 (0.0010) [2023-12-26 06:42:00,548][123091] Updated weights for policy 0, policy_version 890440 (0.0011) [2023-12-26 06:42:01,019][123090] Updated weights for policy 1, policy_version 884289 (0.0006) [2023-12-26 06:42:01,093][123090] Updated weights for policy 1, policy_version 884299 (0.0007) [2023-12-26 06:42:01,170][123090] Updated weights for policy 1, policy_version 884309 (0.0008) [2023-12-26 06:42:01,238][123090] Updated weights for policy 1, policy_version 884319 (0.0008) [2023-12-26 06:42:01,505][123091] Updated weights for policy 0, policy_version 890450 (0.0009) [2023-12-26 06:42:01,561][123091] Updated weights for policy 0, policy_version 890460 (0.0009) [2023-12-26 06:42:01,629][123091] Updated weights for policy 0, policy_version 890470 (0.0009) [2023-12-26 06:42:01,684][123091] Updated weights for policy 0, policy_version 890480 (0.0009) [2023-12-26 06:42:02,039][123090] Updated weights for policy 1, policy_version 884329 (0.0006) [2023-12-26 06:42:02,086][123090] Updated weights for policy 1, policy_version 884339 (0.0005) [2023-12-26 06:42:02,146][123090] Updated weights for policy 1, policy_version 884349 (0.0010) [2023-12-26 06:42:02,418][123091] Updated weights for policy 0, policy_version 890490 (0.0009) [2023-12-26 06:42:02,471][123091] Updated weights for policy 0, policy_version 890500 (0.0007) [2023-12-26 06:42:02,524][123091] Updated weights for policy 0, policy_version 890510 (0.0005) [2023-12-26 06:42:02,916][123090] Updated weights for policy 1, policy_version 884359 (0.0007) [2023-12-26 06:42:02,965][123090] Updated weights for policy 1, policy_version 884369 (0.0005) [2023-12-26 06:42:03,026][123090] Updated weights for policy 1, policy_version 884379 (0.0005) [2023-12-26 06:42:03,258][123091] Updated weights for policy 0, policy_version 890520 (0.0007) [2023-12-26 06:42:03,317][123091] Updated weights for policy 0, policy_version 890530 (0.0010) [2023-12-26 06:42:03,361][123091] Updated weights for policy 0, policy_version 890540 (0.0010) [2023-12-26 06:42:03,652][123090] Updated weights for policy 1, policy_version 884389 (0.0006) [2023-12-26 06:42:03,706][123090] Updated weights for policy 1, policy_version 884399 (0.0006) [2023-12-26 06:42:03,765][123090] Updated weights for policy 1, policy_version 884409 (0.0005) [2023-12-26 06:42:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 454385664. Throughput: 0: 8744.7, 1: 8946.9. Samples: 454401764. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:03,784][121949] Avg episode reward: [(0, '5943.326'), (1, '5680.634')] [2023-12-26 06:42:04,128][123091] Updated weights for policy 0, policy_version 890550 (0.0007) [2023-12-26 06:42:04,187][123091] Updated weights for policy 0, policy_version 890560 (0.0005) [2023-12-26 06:42:04,235][123091] Updated weights for policy 0, policy_version 890570 (0.0005) [2023-12-26 06:42:04,445][123090] Updated weights for policy 1, policy_version 884419 (0.0008) [2023-12-26 06:42:04,526][123090] Updated weights for policy 1, policy_version 884429 (0.0009) [2023-12-26 06:42:04,597][123090] Updated weights for policy 1, policy_version 884439 (0.0011) [2023-12-26 06:42:04,918][123091] Updated weights for policy 0, policy_version 890580 (0.0006) [2023-12-26 06:42:04,973][123091] Updated weights for policy 0, policy_version 890590 (0.0005) [2023-12-26 06:42:05,043][123091] Updated weights for policy 0, policy_version 890600 (0.0005) [2023-12-26 06:42:05,303][123090] Updated weights for policy 1, policy_version 884449 (0.0010) [2023-12-26 06:42:05,374][123090] Updated weights for policy 1, policy_version 884459 (0.0005) [2023-12-26 06:42:05,447][123090] Updated weights for policy 1, policy_version 884469 (0.0005) [2023-12-26 06:42:05,509][123090] Updated weights for policy 1, policy_version 884479 (0.0005) [2023-12-26 06:42:05,713][123091] Updated weights for policy 0, policy_version 890610 (0.0006) [2023-12-26 06:42:05,782][123091] Updated weights for policy 0, policy_version 890620 (0.0011) [2023-12-26 06:42:05,836][123091] Updated weights for policy 0, policy_version 890630 (0.0010) [2023-12-26 06:42:05,883][123091] Updated weights for policy 0, policy_version 890640 (0.0010) [2023-12-26 06:42:06,150][123090] Updated weights for policy 1, policy_version 884489 (0.0007) [2023-12-26 06:42:06,206][123090] Updated weights for policy 1, policy_version 884499 (0.0006) [2023-12-26 06:42:06,270][123090] Updated weights for policy 1, policy_version 884509 (0.0011) [2023-12-26 06:42:06,753][123091] Updated weights for policy 0, policy_version 890650 (0.0009) [2023-12-26 06:42:06,819][123091] Updated weights for policy 0, policy_version 890660 (0.0009) [2023-12-26 06:42:06,876][123091] Updated weights for policy 0, policy_version 890670 (0.0009) [2023-12-26 06:42:07,076][123090] Updated weights for policy 1, policy_version 884519 (0.0011) [2023-12-26 06:42:07,132][123090] Updated weights for policy 1, policy_version 884529 (0.0010) [2023-12-26 06:42:07,184][123090] Updated weights for policy 1, policy_version 884539 (0.0010) [2023-12-26 06:42:07,707][123091] Updated weights for policy 0, policy_version 890680 (0.0009) [2023-12-26 06:42:07,764][123091] Updated weights for policy 0, policy_version 890690 (0.0009) [2023-12-26 06:42:07,819][123091] Updated weights for policy 0, policy_version 890700 (0.0006) [2023-12-26 06:42:08,043][123090] Updated weights for policy 1, policy_version 884549 (0.0011) [2023-12-26 06:42:08,110][123090] Updated weights for policy 1, policy_version 884559 (0.0011) [2023-12-26 06:42:08,177][123090] Updated weights for policy 1, policy_version 884569 (0.0010) [2023-12-26 06:42:08,641][123091] Updated weights for policy 0, policy_version 890710 (0.0007) [2023-12-26 06:42:08,703][123091] Updated weights for policy 0, policy_version 890720 (0.0009) [2023-12-26 06:42:08,764][123091] Updated weights for policy 0, policy_version 890730 (0.0009) [2023-12-26 06:42:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 454475776. Throughput: 0: 8830.0, 1: 9007.4. Samples: 454459668. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:08,785][121949] Avg episode reward: [(0, '5957.034'), (1, '5556.719')] [2023-12-26 06:42:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000884576_226451456.pth... [2023-12-26 06:42:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000883552_226189312.pth [2023-12-26 06:42:08,798][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000890736_228032512.pth... [2023-12-26 06:42:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000889680_227762176.pth [2023-12-26 06:42:08,994][123090] Updated weights for policy 1, policy_version 884579 (0.0011) [2023-12-26 06:42:09,061][123090] Updated weights for policy 1, policy_version 884589 (0.0010) [2023-12-26 06:42:09,119][123090] Updated weights for policy 1, policy_version 884599 (0.0010) [2023-12-26 06:42:09,613][123091] Updated weights for policy 0, policy_version 890740 (0.0009) [2023-12-26 06:42:09,680][123091] Updated weights for policy 0, policy_version 890750 (0.0009) [2023-12-26 06:42:09,748][123091] Updated weights for policy 0, policy_version 890760 (0.0010) [2023-12-26 06:42:09,972][123090] Updated weights for policy 1, policy_version 884609 (0.0010) [2023-12-26 06:42:10,035][123090] Updated weights for policy 1, policy_version 884619 (0.0009) [2023-12-26 06:42:10,100][123090] Updated weights for policy 1, policy_version 884629 (0.0010) [2023-12-26 06:42:10,169][123090] Updated weights for policy 1, policy_version 884639 (0.0008) [2023-12-26 06:42:10,605][123091] Updated weights for policy 0, policy_version 890770 (0.0010) [2023-12-26 06:42:10,676][123091] Updated weights for policy 0, policy_version 890780 (0.0005) [2023-12-26 06:42:10,740][123091] Updated weights for policy 0, policy_version 890790 (0.0007) [2023-12-26 06:42:10,808][123091] Updated weights for policy 0, policy_version 890800 (0.0005) [2023-12-26 06:42:10,955][123090] Updated weights for policy 1, policy_version 884649 (0.0006) [2023-12-26 06:42:11,012][123090] Updated weights for policy 1, policy_version 884659 (0.0005) [2023-12-26 06:42:11,080][123090] Updated weights for policy 1, policy_version 884669 (0.0008) [2023-12-26 06:42:11,581][123091] Updated weights for policy 0, policy_version 890810 (0.0010) [2023-12-26 06:42:11,644][123091] Updated weights for policy 0, policy_version 890820 (0.0009) [2023-12-26 06:42:11,718][123091] Updated weights for policy 0, policy_version 890830 (0.0010) [2023-12-26 06:42:11,914][123090] Updated weights for policy 1, policy_version 884679 (0.0010) [2023-12-26 06:42:11,984][123090] Updated weights for policy 1, policy_version 884689 (0.0009) [2023-12-26 06:42:12,044][123090] Updated weights for policy 1, policy_version 884699 (0.0009) [2023-12-26 06:42:12,576][123091] Updated weights for policy 0, policy_version 890840 (0.0010) [2023-12-26 06:42:12,641][123091] Updated weights for policy 0, policy_version 890850 (0.0010) [2023-12-26 06:42:12,711][123091] Updated weights for policy 0, policy_version 890860 (0.0009) [2023-12-26 06:42:12,825][123090] Updated weights for policy 1, policy_version 884709 (0.0008) [2023-12-26 06:42:12,879][123090] Updated weights for policy 1, policy_version 884719 (0.0005) [2023-12-26 06:42:12,951][123090] Updated weights for policy 1, policy_version 884729 (0.0008) [2023-12-26 06:42:13,586][123091] Updated weights for policy 0, policy_version 890870 (0.0009) [2023-12-26 06:42:13,635][123091] Updated weights for policy 0, policy_version 890880 (0.0009) [2023-12-26 06:42:13,682][123090] Updated weights for policy 1, policy_version 884739 (0.0009) [2023-12-26 06:42:13,685][123091] Updated weights for policy 0, policy_version 890890 (0.0009) [2023-12-26 06:42:13,743][123090] Updated weights for policy 1, policy_version 884749 (0.0009) [2023-12-26 06:42:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 454565888. Throughput: 0: 8875.7, 1: 8878.1. Samples: 454560916. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:13,785][121949] Avg episode reward: [(0, '6100.766'), (1, '5519.984')] [2023-12-26 06:42:13,805][123090] Updated weights for policy 1, policy_version 884759 (0.0009) [2023-12-26 06:42:14,463][123090] Updated weights for policy 1, policy_version 884769 (0.0008) [2023-12-26 06:42:14,516][123090] Updated weights for policy 1, policy_version 884779 (0.0005) [2023-12-26 06:42:14,562][123090] Updated weights for policy 1, policy_version 884789 (0.0006) [2023-12-26 06:42:14,611][123091] Updated weights for policy 0, policy_version 890900 (0.0008) [2023-12-26 06:42:14,621][123090] Updated weights for policy 1, policy_version 884799 (0.0006) [2023-12-26 06:42:14,667][123091] Updated weights for policy 0, policy_version 890910 (0.0010) [2023-12-26 06:42:14,729][123091] Updated weights for policy 0, policy_version 890920 (0.0010) [2023-12-26 06:42:15,322][123090] Updated weights for policy 1, policy_version 884809 (0.0009) [2023-12-26 06:42:15,375][123090] Updated weights for policy 1, policy_version 884819 (0.0009) [2023-12-26 06:42:15,439][123090] Updated weights for policy 1, policy_version 884830 (0.0010) [2023-12-26 06:42:15,624][123091] Updated weights for policy 0, policy_version 890930 (0.0008) [2023-12-26 06:42:15,681][123091] Updated weights for policy 0, policy_version 890940 (0.0005) [2023-12-26 06:42:15,744][123091] Updated weights for policy 0, policy_version 890950 (0.0005) [2023-12-26 06:42:15,804][123091] Updated weights for policy 0, policy_version 890960 (0.0005) [2023-12-26 06:42:16,325][123090] Updated weights for policy 1, policy_version 884840 (0.0009) [2023-12-26 06:42:16,383][123091] Updated weights for policy 0, policy_version 890970 (0.0007) [2023-12-26 06:42:16,394][123090] Updated weights for policy 1, policy_version 884850 (0.0006) [2023-12-26 06:42:16,432][123091] Updated weights for policy 0, policy_version 890980 (0.0008) [2023-12-26 06:42:16,458][123090] Updated weights for policy 1, policy_version 884860 (0.0006) [2023-12-26 06:42:16,479][123091] Updated weights for policy 0, policy_version 890990 (0.0006) [2023-12-26 06:42:17,196][123091] Updated weights for policy 0, policy_version 891000 (0.0006) [2023-12-26 06:42:17,245][123091] Updated weights for policy 0, policy_version 891010 (0.0005) [2023-12-26 06:42:17,292][123091] Updated weights for policy 0, policy_version 891020 (0.0005) [2023-12-26 06:42:17,324][123090] Updated weights for policy 1, policy_version 884870 (0.0009) [2023-12-26 06:42:17,378][123090] Updated weights for policy 1, policy_version 884880 (0.0009) [2023-12-26 06:42:17,431][123090] Updated weights for policy 1, policy_version 884891 (0.0009) [2023-12-26 06:42:18,037][123091] Updated weights for policy 0, policy_version 891030 (0.0007) [2023-12-26 06:42:18,104][123091] Updated weights for policy 0, policy_version 891040 (0.0009) [2023-12-26 06:42:18,168][123091] Updated weights for policy 0, policy_version 891050 (0.0010) [2023-12-26 06:42:18,243][123090] Updated weights for policy 1, policy_version 884901 (0.0010) [2023-12-26 06:42:18,295][123090] Updated weights for policy 1, policy_version 884911 (0.0010) [2023-12-26 06:42:18,356][123090] Updated weights for policy 1, policy_version 884921 (0.0011) [2023-12-26 06:42:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 454656000. Throughput: 0: 8920.2, 1: 8887.0. Samples: 454668788. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:18,785][121949] Avg episode reward: [(0, '6195.149'), (1, '5423.866')] [2023-12-26 06:42:18,862][123091] Updated weights for policy 0, policy_version 891060 (0.0008) [2023-12-26 06:42:18,913][123091] Updated weights for policy 0, policy_version 891070 (0.0006) [2023-12-26 06:42:18,975][123091] Updated weights for policy 0, policy_version 891080 (0.0006) [2023-12-26 06:42:19,171][123090] Updated weights for policy 1, policy_version 884931 (0.0010) [2023-12-26 06:42:19,230][123090] Updated weights for policy 1, policy_version 884941 (0.0006) [2023-12-26 06:42:19,288][123090] Updated weights for policy 1, policy_version 884951 (0.0008) [2023-12-26 06:42:19,742][123091] Updated weights for policy 0, policy_version 891090 (0.0010) [2023-12-26 06:42:19,814][123091] Updated weights for policy 0, policy_version 891100 (0.0007) [2023-12-26 06:42:19,883][123091] Updated weights for policy 0, policy_version 891110 (0.0009) [2023-12-26 06:42:19,950][123091] Updated weights for policy 0, policy_version 891120 (0.0010) [2023-12-26 06:42:20,085][123090] Updated weights for policy 1, policy_version 884961 (0.0008) [2023-12-26 06:42:20,146][123090] Updated weights for policy 1, policy_version 884971 (0.0010) [2023-12-26 06:42:20,217][123090] Updated weights for policy 1, policy_version 884981 (0.0010) [2023-12-26 06:42:20,291][123090] Updated weights for policy 1, policy_version 884991 (0.0009) [2023-12-26 06:42:20,719][123091] Updated weights for policy 0, policy_version 891130 (0.0011) [2023-12-26 06:42:20,788][123091] Updated weights for policy 0, policy_version 891140 (0.0011) [2023-12-26 06:42:20,856][123091] Updated weights for policy 0, policy_version 891150 (0.0011) [2023-12-26 06:42:21,196][123090] Updated weights for policy 1, policy_version 885001 (0.0007) [2023-12-26 06:42:21,272][123090] Updated weights for policy 1, policy_version 885011 (0.0007) [2023-12-26 06:42:21,341][123090] Updated weights for policy 1, policy_version 885021 (0.0007) [2023-12-26 06:42:21,712][123091] Updated weights for policy 0, policy_version 891160 (0.0011) [2023-12-26 06:42:21,780][123091] Updated weights for policy 0, policy_version 891170 (0.0009) [2023-12-26 06:42:21,837][123091] Updated weights for policy 0, policy_version 891180 (0.0011) [2023-12-26 06:42:22,063][123090] Updated weights for policy 1, policy_version 885031 (0.0006) [2023-12-26 06:42:22,134][123090] Updated weights for policy 1, policy_version 885041 (0.0007) [2023-12-26 06:42:22,192][123090] Updated weights for policy 1, policy_version 885051 (0.0009) [2023-12-26 06:42:22,706][123091] Updated weights for policy 0, policy_version 891190 (0.0009) [2023-12-26 06:42:22,779][123091] Updated weights for policy 0, policy_version 891200 (0.0009) [2023-12-26 06:42:22,847][123091] Updated weights for policy 0, policy_version 891210 (0.0008) [2023-12-26 06:42:22,978][123090] Updated weights for policy 1, policy_version 885061 (0.0008) [2023-12-26 06:42:23,042][123090] Updated weights for policy 1, policy_version 885071 (0.0006) [2023-12-26 06:42:23,118][123090] Updated weights for policy 1, policy_version 885081 (0.0009) [2023-12-26 06:42:23,584][123091] Updated weights for policy 0, policy_version 891220 (0.0007) [2023-12-26 06:42:23,643][123091] Updated weights for policy 0, policy_version 891230 (0.0005) [2023-12-26 06:42:23,712][123091] Updated weights for policy 0, policy_version 891240 (0.0007) [2023-12-26 06:42:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 454746112. Throughput: 0: 8920.2, 1: 8817.0. Samples: 454720980. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:23,785][121949] Avg episode reward: [(0, '6179.271'), (1, '5392.087')] [2023-12-26 06:42:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000891248_228163584.pth... [2023-12-26 06:42:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000885088_226582528.pth... [2023-12-26 06:42:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000890192_227893248.pth [2023-12-26 06:42:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000884064_226320384.pth [2023-12-26 06:42:23,896][123090] Updated weights for policy 1, policy_version 885091 (0.0009) [2023-12-26 06:42:23,945][123090] Updated weights for policy 1, policy_version 885101 (0.0008) [2023-12-26 06:42:23,993][123090] Updated weights for policy 1, policy_version 885111 (0.0005) [2023-12-26 06:42:24,575][123091] Updated weights for policy 0, policy_version 891250 (0.0008) [2023-12-26 06:42:24,636][123091] Updated weights for policy 0, policy_version 891260 (0.0007) [2023-12-26 06:42:24,684][123091] Updated weights for policy 0, policy_version 891270 (0.0009) [2023-12-26 06:42:24,732][123091] Updated weights for policy 0, policy_version 891280 (0.0009) [2023-12-26 06:42:24,749][123090] Updated weights for policy 1, policy_version 885121 (0.0006) [2023-12-26 06:42:24,802][123090] Updated weights for policy 1, policy_version 885131 (0.0009) [2023-12-26 06:42:24,857][123090] Updated weights for policy 1, policy_version 885141 (0.0009) [2023-12-26 06:42:24,909][123090] Updated weights for policy 1, policy_version 885151 (0.0008) [2023-12-26 06:42:25,551][123091] Updated weights for policy 0, policy_version 891290 (0.0010) [2023-12-26 06:42:25,605][123091] Updated weights for policy 0, policy_version 891300 (0.0010) [2023-12-26 06:42:25,661][123091] Updated weights for policy 0, policy_version 891310 (0.0010) [2023-12-26 06:42:25,763][123090] Updated weights for policy 1, policy_version 885161 (0.0009) [2023-12-26 06:42:25,816][123090] Updated weights for policy 1, policy_version 885171 (0.0009) [2023-12-26 06:42:25,865][123090] Updated weights for policy 1, policy_version 885181 (0.0007) [2023-12-26 06:42:26,455][123091] Updated weights for policy 0, policy_version 891320 (0.0009) [2023-12-26 06:42:26,512][123091] Updated weights for policy 0, policy_version 891330 (0.0005) [2023-12-26 06:42:26,567][123091] Updated weights for policy 0, policy_version 891340 (0.0006) [2023-12-26 06:42:26,617][123090] Updated weights for policy 1, policy_version 885191 (0.0005) [2023-12-26 06:42:26,672][123090] Updated weights for policy 1, policy_version 885201 (0.0006) [2023-12-26 06:42:26,722][123090] Updated weights for policy 1, policy_version 885211 (0.0010) [2023-12-26 06:42:27,245][123091] Updated weights for policy 0, policy_version 891350 (0.0008) [2023-12-26 06:42:27,299][123091] Updated weights for policy 0, policy_version 891360 (0.0010) [2023-12-26 06:42:27,365][123091] Updated weights for policy 0, policy_version 891370 (0.0010) [2023-12-26 06:42:27,452][123090] Updated weights for policy 1, policy_version 885221 (0.0010) [2023-12-26 06:42:27,511][123090] Updated weights for policy 1, policy_version 885231 (0.0006) [2023-12-26 06:42:27,571][123090] Updated weights for policy 1, policy_version 885241 (0.0006) [2023-12-26 06:42:28,038][123091] Updated weights for policy 0, policy_version 891380 (0.0008) [2023-12-26 06:42:28,088][123091] Updated weights for policy 0, policy_version 891390 (0.0005) [2023-12-26 06:42:28,135][123091] Updated weights for policy 0, policy_version 891400 (0.0005) [2023-12-26 06:42:28,303][123090] Updated weights for policy 1, policy_version 885251 (0.0006) [2023-12-26 06:42:28,364][123090] Updated weights for policy 1, policy_version 885261 (0.0008) [2023-12-26 06:42:28,426][123090] Updated weights for policy 1, policy_version 885271 (0.0010) [2023-12-26 06:42:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 454836224. Throughput: 0: 8917.2, 1: 8930.4. Samples: 454828516. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:28,785][121949] Avg episode reward: [(0, '6024.268'), (1, '5502.643')] [2023-12-26 06:42:28,953][123091] Updated weights for policy 0, policy_version 891410 (0.0009) [2023-12-26 06:42:29,014][123091] Updated weights for policy 0, policy_version 891420 (0.0011) [2023-12-26 06:42:29,066][123091] Updated weights for policy 0, policy_version 891430 (0.0009) [2023-12-26 06:42:29,222][123090] Updated weights for policy 1, policy_version 885281 (0.0010) [2023-12-26 06:42:29,310][123090] Updated weights for policy 1, policy_version 885291 (0.0010) [2023-12-26 06:42:29,373][123090] Updated weights for policy 1, policy_version 885301 (0.0011) [2023-12-26 06:42:29,424][123090] Updated weights for policy 1, policy_version 885311 (0.0009) [2023-12-26 06:42:29,951][123091] Updated weights for policy 0, policy_version 891441 (0.0009) [2023-12-26 06:42:30,005][123091] Updated weights for policy 0, policy_version 891451 (0.0010) [2023-12-26 06:42:30,059][123091] Updated weights for policy 0, policy_version 891461 (0.0010) [2023-12-26 06:42:30,114][123091] Updated weights for policy 0, policy_version 891471 (0.0010) [2023-12-26 06:42:30,135][123090] Updated weights for policy 1, policy_version 885321 (0.0006) [2023-12-26 06:42:30,205][123090] Updated weights for policy 1, policy_version 885331 (0.0005) [2023-12-26 06:42:30,271][123090] Updated weights for policy 1, policy_version 885341 (0.0007) [2023-12-26 06:42:30,902][123090] Updated weights for policy 1, policy_version 885351 (0.0007) [2023-12-26 06:42:30,967][123090] Updated weights for policy 1, policy_version 885361 (0.0008) [2023-12-26 06:42:31,020][123090] Updated weights for policy 1, policy_version 885371 (0.0009) [2023-12-26 06:42:31,023][123091] Updated weights for policy 0, policy_version 891481 (0.0008) [2023-12-26 06:42:31,090][123091] Updated weights for policy 0, policy_version 891491 (0.0010) [2023-12-26 06:42:31,152][123091] Updated weights for policy 0, policy_version 891501 (0.0010) [2023-12-26 06:42:31,908][123090] Updated weights for policy 1, policy_version 885381 (0.0010) [2023-12-26 06:42:31,971][123090] Updated weights for policy 1, policy_version 885391 (0.0010) [2023-12-26 06:42:31,991][123091] Updated weights for policy 0, policy_version 891511 (0.0007) [2023-12-26 06:42:32,034][123090] Updated weights for policy 1, policy_version 885401 (0.0010) [2023-12-26 06:42:32,063][123091] Updated weights for policy 0, policy_version 891521 (0.0009) [2023-12-26 06:42:32,122][123091] Updated weights for policy 0, policy_version 891531 (0.0009) [2023-12-26 06:42:32,870][123090] Updated weights for policy 1, policy_version 885411 (0.0011) [2023-12-26 06:42:32,899][123091] Updated weights for policy 0, policy_version 891541 (0.0009) [2023-12-26 06:42:32,926][123090] Updated weights for policy 1, policy_version 885421 (0.0010) [2023-12-26 06:42:32,950][123091] Updated weights for policy 0, policy_version 891551 (0.0010) [2023-12-26 06:42:32,974][123090] Updated weights for policy 1, policy_version 885431 (0.0010) [2023-12-26 06:42:33,009][123091] Updated weights for policy 0, policy_version 891561 (0.0010) [2023-12-26 06:42:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 454918144. Throughput: 0: 8869.8, 1: 8947.1. Samples: 454935072. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:33,785][121949] Avg episode reward: [(0, '5973.125'), (1, '5656.381')] [2023-12-26 06:42:33,793][123091] Updated weights for policy 0, policy_version 891571 (0.0008) [2023-12-26 06:42:33,817][123090] Updated weights for policy 1, policy_version 885441 (0.0010) [2023-12-26 06:42:33,843][123091] Updated weights for policy 0, policy_version 891581 (0.0010) [2023-12-26 06:42:33,871][123090] Updated weights for policy 1, policy_version 885451 (0.0010) [2023-12-26 06:42:33,901][123091] Updated weights for policy 0, policy_version 891591 (0.0010) [2023-12-26 06:42:33,919][123090] Updated weights for policy 1, policy_version 885461 (0.0010) [2023-12-26 06:42:33,970][123090] Updated weights for policy 1, policy_version 885471 (0.0010) [2023-12-26 06:42:34,771][123091] Updated weights for policy 0, policy_version 891601 (0.0010) [2023-12-26 06:42:34,779][123090] Updated weights for policy 1, policy_version 885481 (0.0006) [2023-12-26 06:42:34,831][123091] Updated weights for policy 0, policy_version 891611 (0.0006) [2023-12-26 06:42:34,840][123090] Updated weights for policy 1, policy_version 885491 (0.0010) [2023-12-26 06:42:34,890][123091] Updated weights for policy 0, policy_version 891621 (0.0006) [2023-12-26 06:42:34,895][123090] Updated weights for policy 1, policy_version 885501 (0.0010) [2023-12-26 06:42:34,959][123091] Updated weights for policy 0, policy_version 891631 (0.0005) [2023-12-26 06:42:35,665][123091] Updated weights for policy 0, policy_version 891641 (0.0006) [2023-12-26 06:42:35,712][123090] Updated weights for policy 1, policy_version 885511 (0.0011) [2023-12-26 06:42:35,727][123091] Updated weights for policy 0, policy_version 891651 (0.0007) [2023-12-26 06:42:35,771][123090] Updated weights for policy 1, policy_version 885521 (0.0010) [2023-12-26 06:42:35,787][123091] Updated weights for policy 0, policy_version 891661 (0.0006) [2023-12-26 06:42:35,827][123090] Updated weights for policy 1, policy_version 885531 (0.0010) [2023-12-26 06:42:36,498][123091] Updated weights for policy 0, policy_version 891671 (0.0008) [2023-12-26 06:42:36,560][123091] Updated weights for policy 0, policy_version 891681 (0.0010) [2023-12-26 06:42:36,633][123091] Updated weights for policy 0, policy_version 891691 (0.0009) [2023-12-26 06:42:36,655][123090] Updated weights for policy 1, policy_version 885541 (0.0008) [2023-12-26 06:42:36,705][123090] Updated weights for policy 1, policy_version 885551 (0.0006) [2023-12-26 06:42:36,753][123090] Updated weights for policy 1, policy_version 885561 (0.0006) [2023-12-26 06:42:37,372][123091] Updated weights for policy 0, policy_version 891701 (0.0009) [2023-12-26 06:42:37,386][123090] Updated weights for policy 1, policy_version 885571 (0.0007) [2023-12-26 06:42:37,423][123091] Updated weights for policy 0, policy_version 891711 (0.0008) [2023-12-26 06:42:37,435][123090] Updated weights for policy 1, policy_version 885581 (0.0008) [2023-12-26 06:42:37,478][123091] Updated weights for policy 0, policy_version 891721 (0.0007) [2023-12-26 06:42:37,489][123090] Updated weights for policy 1, policy_version 885591 (0.0009) [2023-12-26 06:42:38,311][123090] Updated weights for policy 1, policy_version 885601 (0.0009) [2023-12-26 06:42:38,352][123091] Updated weights for policy 0, policy_version 891731 (0.0009) [2023-12-26 06:42:38,376][123090] Updated weights for policy 1, policy_version 885611 (0.0009) [2023-12-26 06:42:38,419][123091] Updated weights for policy 0, policy_version 891741 (0.0007) [2023-12-26 06:42:38,439][123090] Updated weights for policy 1, policy_version 885621 (0.0008) [2023-12-26 06:42:38,482][123091] Updated weights for policy 0, policy_version 891751 (0.0010) [2023-12-26 06:42:38,494][123090] Updated weights for policy 1, policy_version 885631 (0.0006) [2023-12-26 06:42:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 455016448. Throughput: 0: 8893.0, 1: 8948.4. Samples: 454988748. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:38,785][121949] Avg episode reward: [(0, '6181.768'), (1, '5631.384')] [2023-12-26 06:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000891760_228294656.pth... [2023-12-26 06:42:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000885632_226721792.pth... [2023-12-26 06:42:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000890736_228032512.pth [2023-12-26 06:42:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000884576_226451456.pth [2023-12-26 06:42:39,263][123090] Updated weights for policy 1, policy_version 885641 (0.0008) [2023-12-26 06:42:39,326][123090] Updated weights for policy 1, policy_version 885651 (0.0010) [2023-12-26 06:42:39,328][123091] Updated weights for policy 0, policy_version 891761 (0.0008) [2023-12-26 06:42:39,398][123090] Updated weights for policy 1, policy_version 885661 (0.0010) [2023-12-26 06:42:39,401][123091] Updated weights for policy 0, policy_version 891771 (0.0008) [2023-12-26 06:42:39,467][123091] Updated weights for policy 0, policy_version 891781 (0.0010) [2023-12-26 06:42:39,537][123091] Updated weights for policy 0, policy_version 891791 (0.0009) [2023-12-26 06:42:40,267][123090] Updated weights for policy 1, policy_version 885671 (0.0007) [2023-12-26 06:42:40,321][123091] Updated weights for policy 0, policy_version 891801 (0.0008) [2023-12-26 06:42:40,331][123090] Updated weights for policy 1, policy_version 885681 (0.0006) [2023-12-26 06:42:40,386][123091] Updated weights for policy 0, policy_version 891811 (0.0009) [2023-12-26 06:42:40,392][123090] Updated weights for policy 1, policy_version 885691 (0.0006) [2023-12-26 06:42:40,454][123091] Updated weights for policy 0, policy_version 891821 (0.0009) [2023-12-26 06:42:41,173][123090] Updated weights for policy 1, policy_version 885701 (0.0007) [2023-12-26 06:42:41,237][123090] Updated weights for policy 1, policy_version 885711 (0.0008) [2023-12-26 06:42:41,310][123091] Updated weights for policy 0, policy_version 891831 (0.0008) [2023-12-26 06:42:41,312][123090] Updated weights for policy 1, policy_version 885721 (0.0011) [2023-12-26 06:42:41,385][123091] Updated weights for policy 0, policy_version 891841 (0.0007) [2023-12-26 06:42:41,442][123091] Updated weights for policy 0, policy_version 891851 (0.0009) [2023-12-26 06:42:42,099][123090] Updated weights for policy 1, policy_version 885731 (0.0009) [2023-12-26 06:42:42,152][123090] Updated weights for policy 1, policy_version 885741 (0.0006) [2023-12-26 06:42:42,218][123090] Updated weights for policy 1, policy_version 885751 (0.0007) [2023-12-26 06:42:42,296][123091] Updated weights for policy 0, policy_version 891861 (0.0009) [2023-12-26 06:42:42,363][123091] Updated weights for policy 0, policy_version 891871 (0.0010) [2023-12-26 06:42:42,428][123091] Updated weights for policy 0, policy_version 891881 (0.0007) [2023-12-26 06:42:43,029][123090] Updated weights for policy 1, policy_version 885761 (0.0008) [2023-12-26 06:42:43,093][123090] Updated weights for policy 1, policy_version 885771 (0.0005) [2023-12-26 06:42:43,128][123091] Updated weights for policy 0, policy_version 891891 (0.0007) [2023-12-26 06:42:43,143][123090] Updated weights for policy 1, policy_version 885781 (0.0006) [2023-12-26 06:42:43,189][123091] Updated weights for policy 0, policy_version 891901 (0.0005) [2023-12-26 06:42:43,204][123090] Updated weights for policy 1, policy_version 885791 (0.0009) [2023-12-26 06:42:43,246][123091] Updated weights for policy 0, policy_version 891911 (0.0008) [2023-12-26 06:42:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 455098368. Throughput: 0: 8779.9, 1: 8940.9. Samples: 455092580. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:43,785][121949] Avg episode reward: [(0, '6152.938'), (1, '5594.862')] [2023-12-26 06:42:43,857][123090] Updated weights for policy 1, policy_version 885801 (0.0006) [2023-12-26 06:42:43,914][123090] Updated weights for policy 1, policy_version 885811 (0.0005) [2023-12-26 06:42:43,948][123091] Updated weights for policy 0, policy_version 891921 (0.0010) [2023-12-26 06:42:43,970][123090] Updated weights for policy 1, policy_version 885821 (0.0005) [2023-12-26 06:42:44,004][123091] Updated weights for policy 0, policy_version 891931 (0.0005) [2023-12-26 06:42:44,052][123091] Updated weights for policy 0, policy_version 891941 (0.0005) [2023-12-26 06:42:44,131][123091] Updated weights for policy 0, policy_version 891951 (0.0006) [2023-12-26 06:42:44,701][123090] Updated weights for policy 1, policy_version 885831 (0.0008) [2023-12-26 06:42:44,756][123090] Updated weights for policy 1, policy_version 885841 (0.0008) [2023-12-26 06:42:44,803][123091] Updated weights for policy 0, policy_version 891961 (0.0010) [2023-12-26 06:42:44,826][123090] Updated weights for policy 1, policy_version 885851 (0.0008) [2023-12-26 06:42:44,874][123091] Updated weights for policy 0, policy_version 891971 (0.0011) [2023-12-26 06:42:44,941][123091] Updated weights for policy 0, policy_version 891981 (0.0010) [2023-12-26 06:42:45,545][123090] Updated weights for policy 1, policy_version 885861 (0.0009) [2023-12-26 06:42:45,600][123090] Updated weights for policy 1, policy_version 885871 (0.0009) [2023-12-26 06:42:45,659][123090] Updated weights for policy 1, policy_version 885881 (0.0010) [2023-12-26 06:42:45,713][123091] Updated weights for policy 0, policy_version 891991 (0.0007) [2023-12-26 06:42:45,763][123091] Updated weights for policy 0, policy_version 892001 (0.0005) [2023-12-26 06:42:45,812][123091] Updated weights for policy 0, policy_version 892011 (0.0005) [2023-12-26 06:42:46,338][123090] Updated weights for policy 1, policy_version 885891 (0.0011) [2023-12-26 06:42:46,405][123090] Updated weights for policy 1, policy_version 885901 (0.0010) [2023-12-26 06:42:46,460][123090] Updated weights for policy 1, policy_version 885911 (0.0010) [2023-12-26 06:42:46,487][123091] Updated weights for policy 0, policy_version 892021 (0.0006) [2023-12-26 06:42:46,548][123091] Updated weights for policy 0, policy_version 892031 (0.0005) [2023-12-26 06:42:46,623][123091] Updated weights for policy 0, policy_version 892041 (0.0005) [2023-12-26 06:42:47,277][123090] Updated weights for policy 1, policy_version 885921 (0.0010) [2023-12-26 06:42:47,324][123091] Updated weights for policy 0, policy_version 892051 (0.0007) [2023-12-26 06:42:47,332][123090] Updated weights for policy 1, policy_version 885931 (0.0010) [2023-12-26 06:42:47,386][123091] Updated weights for policy 0, policy_version 892061 (0.0010) [2023-12-26 06:42:47,388][123090] Updated weights for policy 1, policy_version 885941 (0.0010) [2023-12-26 06:42:47,437][123091] Updated weights for policy 0, policy_version 892071 (0.0010) [2023-12-26 06:42:47,443][123090] Updated weights for policy 1, policy_version 885951 (0.0010) [2023-12-26 06:42:48,159][123091] Updated weights for policy 0, policy_version 892081 (0.0010) [2023-12-26 06:42:48,213][123091] Updated weights for policy 0, policy_version 892091 (0.0010) [2023-12-26 06:42:48,275][123091] Updated weights for policy 0, policy_version 892101 (0.0010) [2023-12-26 06:42:48,285][123090] Updated weights for policy 1, policy_version 885961 (0.0010) [2023-12-26 06:42:48,335][123091] Updated weights for policy 0, policy_version 892111 (0.0010) [2023-12-26 06:42:48,355][123090] Updated weights for policy 1, policy_version 885971 (0.0008) [2023-12-26 06:42:48,418][123090] Updated weights for policy 1, policy_version 885981 (0.0008) [2023-12-26 06:42:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 455196672. Throughput: 0: 8917.3, 1: 8983.2. Samples: 455207288. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:48,785][121949] Avg episode reward: [(0, '6092.261'), (1, '5564.804')] [2023-12-26 06:42:49,076][123090] Updated weights for policy 1, policy_version 885991 (0.0010) [2023-12-26 06:42:49,128][123090] Updated weights for policy 1, policy_version 886001 (0.0010) [2023-12-26 06:42:49,156][123091] Updated weights for policy 0, policy_version 892121 (0.0011) [2023-12-26 06:42:49,192][123090] Updated weights for policy 1, policy_version 886011 (0.0010) [2023-12-26 06:42:49,215][123091] Updated weights for policy 0, policy_version 892131 (0.0011) [2023-12-26 06:42:49,282][123091] Updated weights for policy 0, policy_version 892141 (0.0011) [2023-12-26 06:42:49,971][123090] Updated weights for policy 1, policy_version 886021 (0.0010) [2023-12-26 06:42:50,024][123090] Updated weights for policy 1, policy_version 886031 (0.0009) [2023-12-26 06:42:50,088][123090] Updated weights for policy 1, policy_version 886041 (0.0008) [2023-12-26 06:42:50,139][123091] Updated weights for policy 0, policy_version 892151 (0.0009) [2023-12-26 06:42:50,198][123091] Updated weights for policy 0, policy_version 892161 (0.0010) [2023-12-26 06:42:50,258][123091] Updated weights for policy 0, policy_version 892171 (0.0010) [2023-12-26 06:42:50,880][123090] Updated weights for policy 1, policy_version 886051 (0.0007) [2023-12-26 06:42:50,942][123090] Updated weights for policy 1, policy_version 886061 (0.0007) [2023-12-26 06:42:51,013][123090] Updated weights for policy 1, policy_version 886071 (0.0008) [2023-12-26 06:42:51,129][123091] Updated weights for policy 0, policy_version 892181 (0.0008) [2023-12-26 06:42:51,194][123091] Updated weights for policy 0, policy_version 892191 (0.0008) [2023-12-26 06:42:51,255][123091] Updated weights for policy 0, policy_version 892201 (0.0010) [2023-12-26 06:42:51,831][123090] Updated weights for policy 1, policy_version 886081 (0.0009) [2023-12-26 06:42:51,904][123090] Updated weights for policy 1, policy_version 886091 (0.0006) [2023-12-26 06:42:51,963][123090] Updated weights for policy 1, policy_version 886101 (0.0010) [2023-12-26 06:42:52,007][123091] Updated weights for policy 0, policy_version 892211 (0.0009) [2023-12-26 06:42:52,033][123090] Updated weights for policy 1, policy_version 886111 (0.0009) [2023-12-26 06:42:52,065][123091] Updated weights for policy 0, policy_version 892221 (0.0009) [2023-12-26 06:42:52,137][123091] Updated weights for policy 0, policy_version 892231 (0.0009) [2023-12-26 06:42:52,820][123090] Updated weights for policy 1, policy_version 886121 (0.0009) [2023-12-26 06:42:52,880][123090] Updated weights for policy 1, policy_version 886131 (0.0010) [2023-12-26 06:42:52,940][123090] Updated weights for policy 1, policy_version 886141 (0.0009) [2023-12-26 06:42:52,993][123091] Updated weights for policy 0, policy_version 892241 (0.0009) [2023-12-26 06:42:53,046][123091] Updated weights for policy 0, policy_version 892251 (0.0009) [2023-12-26 06:42:53,111][123091] Updated weights for policy 0, policy_version 892261 (0.0010) [2023-12-26 06:42:53,183][123091] Updated weights for policy 0, policy_version 892271 (0.0009) [2023-12-26 06:42:53,774][123090] Updated weights for policy 1, policy_version 886151 (0.0010) [2023-12-26 06:42:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17633.7). Total num frames: 455278592. Throughput: 0: 8837.8, 1: 8944.5. Samples: 455259872. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:53,785][121949] Avg episode reward: [(0, '6062.267'), (1, '5610.545')] [2023-12-26 06:42:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000892272_228425728.pth... [2023-12-26 06:42:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000891248_228163584.pth [2023-12-26 06:42:53,836][123090] Updated weights for policy 1, policy_version 886161 (0.0009) [2023-12-26 06:42:53,906][123090] Updated weights for policy 1, policy_version 886171 (0.0010) [2023-12-26 06:42:53,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000886176_226861056.pth... [2023-12-26 06:42:53,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000885088_226582528.pth [2023-12-26 06:42:54,044][123091] Updated weights for policy 0, policy_version 892281 (0.0006) [2023-12-26 06:42:54,101][123091] Updated weights for policy 0, policy_version 892291 (0.0005) [2023-12-26 06:42:54,174][123091] Updated weights for policy 0, policy_version 892301 (0.0005) [2023-12-26 06:42:54,720][123090] Updated weights for policy 1, policy_version 886181 (0.0010) [2023-12-26 06:42:54,782][123090] Updated weights for policy 1, policy_version 886191 (0.0010) [2023-12-26 06:42:54,832][123091] Updated weights for policy 0, policy_version 892311 (0.0006) [2023-12-26 06:42:54,838][123090] Updated weights for policy 1, policy_version 886201 (0.0010) [2023-12-26 06:42:54,891][123091] Updated weights for policy 0, policy_version 892321 (0.0007) [2023-12-26 06:42:54,956][123091] Updated weights for policy 0, policy_version 892331 (0.0009) [2023-12-26 06:42:55,619][123090] Updated weights for policy 1, policy_version 886211 (0.0010) [2023-12-26 06:42:55,674][123090] Updated weights for policy 1, policy_version 886221 (0.0010) [2023-12-26 06:42:55,728][123091] Updated weights for policy 0, policy_version 892341 (0.0010) [2023-12-26 06:42:55,736][123090] Updated weights for policy 1, policy_version 886231 (0.0010) [2023-12-26 06:42:55,775][123091] Updated weights for policy 0, policy_version 892351 (0.0010) [2023-12-26 06:42:55,827][123091] Updated weights for policy 0, policy_version 892361 (0.0010) [2023-12-26 06:42:56,460][123090] Updated weights for policy 1, policy_version 886241 (0.0010) [2023-12-26 06:42:56,512][123090] Updated weights for policy 1, policy_version 886251 (0.0008) [2023-12-26 06:42:56,566][123090] Updated weights for policy 1, policy_version 886261 (0.0009) [2023-12-26 06:42:56,617][123090] Updated weights for policy 1, policy_version 886271 (0.0009) [2023-12-26 06:42:56,655][123091] Updated weights for policy 0, policy_version 892371 (0.0009) [2023-12-26 06:42:56,719][123091] Updated weights for policy 0, policy_version 892381 (0.0011) [2023-12-26 06:42:56,779][123091] Updated weights for policy 0, policy_version 892391 (0.0011) [2023-12-26 06:42:57,489][123090] Updated weights for policy 1, policy_version 886281 (0.0008) [2023-12-26 06:42:57,540][123090] Updated weights for policy 1, policy_version 886291 (0.0005) [2023-12-26 06:42:57,559][123091] Updated weights for policy 0, policy_version 892401 (0.0010) [2023-12-26 06:42:57,607][123090] Updated weights for policy 1, policy_version 886301 (0.0005) [2023-12-26 06:42:57,610][123091] Updated weights for policy 0, policy_version 892411 (0.0005) [2023-12-26 06:42:57,659][123091] Updated weights for policy 0, policy_version 892421 (0.0008) [2023-12-26 06:42:57,706][123091] Updated weights for policy 0, policy_version 892431 (0.0010) [2023-12-26 06:42:58,312][123090] Updated weights for policy 1, policy_version 886311 (0.0007) [2023-12-26 06:42:58,388][123090] Updated weights for policy 1, policy_version 886321 (0.0008) [2023-12-26 06:42:58,451][123090] Updated weights for policy 1, policy_version 886331 (0.0008) [2023-12-26 06:42:58,648][123091] Updated weights for policy 0, policy_version 892441 (0.0010) [2023-12-26 06:42:58,715][123091] Updated weights for policy 0, policy_version 892451 (0.0011) [2023-12-26 06:42:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 455368704. Throughput: 0: 8920.2, 1: 8980.7. Samples: 455366456. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:42:58,785][123091] Updated weights for policy 0, policy_version 892461 (0.0007) [2023-12-26 06:42:58,785][121949] Avg episode reward: [(0, '5971.244'), (1, '5732.192')] [2023-12-26 06:42:59,255][123090] Updated weights for policy 1, policy_version 886341 (0.0010) [2023-12-26 06:42:59,322][123090] Updated weights for policy 1, policy_version 886351 (0.0010) [2023-12-26 06:42:59,390][123090] Updated weights for policy 1, policy_version 886361 (0.0010) [2023-12-26 06:42:59,582][123091] Updated weights for policy 0, policy_version 892471 (0.0005) [2023-12-26 06:42:59,642][123091] Updated weights for policy 0, policy_version 892481 (0.0005) [2023-12-26 06:42:59,704][123091] Updated weights for policy 0, policy_version 892491 (0.0005) [2023-12-26 06:43:00,115][123090] Updated weights for policy 1, policy_version 886371 (0.0006) [2023-12-26 06:43:00,177][123090] Updated weights for policy 1, policy_version 886381 (0.0005) [2023-12-26 06:43:00,243][123090] Updated weights for policy 1, policy_version 886391 (0.0005) [2023-12-26 06:43:00,471][123091] Updated weights for policy 0, policy_version 892501 (0.0008) [2023-12-26 06:43:00,538][123091] Updated weights for policy 0, policy_version 892511 (0.0010) [2023-12-26 06:43:00,607][123091] Updated weights for policy 0, policy_version 892521 (0.0009) [2023-12-26 06:43:00,947][123090] Updated weights for policy 1, policy_version 886401 (0.0006) [2023-12-26 06:43:01,006][123090] Updated weights for policy 1, policy_version 886411 (0.0009) [2023-12-26 06:43:01,064][123090] Updated weights for policy 1, policy_version 886421 (0.0010) [2023-12-26 06:43:01,131][123090] Updated weights for policy 1, policy_version 886431 (0.0007) [2023-12-26 06:43:01,439][123091] Updated weights for policy 0, policy_version 892531 (0.0009) [2023-12-26 06:43:01,495][123091] Updated weights for policy 0, policy_version 892541 (0.0009) [2023-12-26 06:43:01,547][123091] Updated weights for policy 0, policy_version 892551 (0.0010) [2023-12-26 06:43:02,010][123090] Updated weights for policy 1, policy_version 886441 (0.0010) [2023-12-26 06:43:02,076][123090] Updated weights for policy 1, policy_version 886451 (0.0010) [2023-12-26 06:43:02,139][123090] Updated weights for policy 1, policy_version 886461 (0.0010) [2023-12-26 06:43:02,312][123091] Updated weights for policy 0, policy_version 892561 (0.0010) [2023-12-26 06:43:02,382][123091] Updated weights for policy 0, policy_version 892571 (0.0009) [2023-12-26 06:43:02,449][123091] Updated weights for policy 0, policy_version 892581 (0.0006) [2023-12-26 06:43:02,518][123091] Updated weights for policy 0, policy_version 892591 (0.0009) [2023-12-26 06:43:02,935][123090] Updated weights for policy 1, policy_version 886471 (0.0006) [2023-12-26 06:43:02,986][123090] Updated weights for policy 1, policy_version 886481 (0.0006) [2023-12-26 06:43:03,036][123090] Updated weights for policy 1, policy_version 886491 (0.0009) [2023-12-26 06:43:03,338][123091] Updated weights for policy 0, policy_version 892601 (0.0009) [2023-12-26 06:43:03,392][123091] Updated weights for policy 0, policy_version 892611 (0.0010) [2023-12-26 06:43:03,444][123091] Updated weights for policy 0, policy_version 892621 (0.0009) [2023-12-26 06:43:03,770][123090] Updated weights for policy 1, policy_version 886501 (0.0008) [2023-12-26 06:43:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 455458816. Throughput: 0: 8858.9, 1: 8990.3. Samples: 455472000. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:03,784][121949] Avg episode reward: [(0, '5805.991'), (1, '5644.770')] [2023-12-26 06:43:03,822][123090] Updated weights for policy 1, policy_version 886511 (0.0007) [2023-12-26 06:43:03,896][123090] Updated weights for policy 1, policy_version 886521 (0.0007) [2023-12-26 06:43:04,373][123091] Updated weights for policy 0, policy_version 892631 (0.0009) [2023-12-26 06:43:04,437][123091] Updated weights for policy 0, policy_version 892641 (0.0009) [2023-12-26 06:43:04,507][123091] Updated weights for policy 0, policy_version 892651 (0.0010) [2023-12-26 06:43:04,641][123090] Updated weights for policy 1, policy_version 886531 (0.0008) [2023-12-26 06:43:04,688][123090] Updated weights for policy 1, policy_version 886541 (0.0010) [2023-12-26 06:43:04,747][123090] Updated weights for policy 1, policy_version 886551 (0.0010) [2023-12-26 06:43:05,341][123091] Updated weights for policy 0, policy_version 892661 (0.0010) [2023-12-26 06:43:05,394][123091] Updated weights for policy 0, policy_version 892672 (0.0009) [2023-12-26 06:43:05,459][123091] Updated weights for policy 0, policy_version 892682 (0.0009) [2023-12-26 06:43:05,546][123090] Updated weights for policy 1, policy_version 886561 (0.0011) [2023-12-26 06:43:05,610][123090] Updated weights for policy 1, policy_version 886571 (0.0011) [2023-12-26 06:43:05,669][123090] Updated weights for policy 1, policy_version 886581 (0.0010) [2023-12-26 06:43:05,717][123090] Updated weights for policy 1, policy_version 886591 (0.0010) [2023-12-26 06:43:06,297][123091] Updated weights for policy 0, policy_version 892692 (0.0008) [2023-12-26 06:43:06,357][123091] Updated weights for policy 0, policy_version 892702 (0.0010) [2023-12-26 06:43:06,414][123091] Updated weights for policy 0, policy_version 892712 (0.0010) [2023-12-26 06:43:06,521][123090] Updated weights for policy 1, policy_version 886601 (0.0008) [2023-12-26 06:43:06,575][123090] Updated weights for policy 1, policy_version 886611 (0.0009) [2023-12-26 06:43:06,638][123090] Updated weights for policy 1, policy_version 886621 (0.0009) [2023-12-26 06:43:07,260][123091] Updated weights for policy 0, policy_version 892722 (0.0010) [2023-12-26 06:43:07,324][123091] Updated weights for policy 0, policy_version 892732 (0.0009) [2023-12-26 06:43:07,387][123091] Updated weights for policy 0, policy_version 892742 (0.0009) [2023-12-26 06:43:07,454][123091] Updated weights for policy 0, policy_version 892752 (0.0010) [2023-12-26 06:43:07,483][123090] Updated weights for policy 1, policy_version 886631 (0.0006) [2023-12-26 06:43:07,537][123090] Updated weights for policy 1, policy_version 886641 (0.0005) [2023-12-26 06:43:07,603][123090] Updated weights for policy 1, policy_version 886651 (0.0005) [2023-12-26 06:43:08,287][123091] Updated weights for policy 0, policy_version 892762 (0.0010) [2023-12-26 06:43:08,336][123090] Updated weights for policy 1, policy_version 886661 (0.0007) [2023-12-26 06:43:08,342][123091] Updated weights for policy 0, policy_version 892772 (0.0010) [2023-12-26 06:43:08,395][123090] Updated weights for policy 1, policy_version 886671 (0.0008) [2023-12-26 06:43:08,407][123091] Updated weights for policy 0, policy_version 892782 (0.0011) [2023-12-26 06:43:08,458][123090] Updated weights for policy 1, policy_version 886681 (0.0009) [2023-12-26 06:43:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 455548928. Throughput: 0: 8819.5, 1: 9028.6. Samples: 455524144. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:08,784][121949] Avg episode reward: [(0, '5807.433'), (1, '5621.057')] [2023-12-26 06:43:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000892784_228556800.pth... [2023-12-26 06:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000886688_226992128.pth... [2023-12-26 06:43:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000891760_228294656.pth [2023-12-26 06:43:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000885632_226721792.pth [2023-12-26 06:43:09,180][123091] Updated weights for policy 0, policy_version 892792 (0.0010) [2023-12-26 06:43:09,246][123091] Updated weights for policy 0, policy_version 892802 (0.0011) [2023-12-26 06:43:09,291][123090] Updated weights for policy 1, policy_version 886691 (0.0007) [2023-12-26 06:43:09,309][123091] Updated weights for policy 0, policy_version 892812 (0.0010) [2023-12-26 06:43:09,355][123090] Updated weights for policy 1, policy_version 886701 (0.0008) [2023-12-26 06:43:09,429][123090] Updated weights for policy 1, policy_version 886711 (0.0009) [2023-12-26 06:43:10,127][123091] Updated weights for policy 0, policy_version 892822 (0.0010) [2023-12-26 06:43:10,187][123091] Updated weights for policy 0, policy_version 892832 (0.0011) [2023-12-26 06:43:10,209][123090] Updated weights for policy 1, policy_version 886721 (0.0006) [2023-12-26 06:43:10,255][123091] Updated weights for policy 0, policy_version 892842 (0.0008) [2023-12-26 06:43:10,280][123090] Updated weights for policy 1, policy_version 886731 (0.0006) [2023-12-26 06:43:10,348][123090] Updated weights for policy 1, policy_version 886741 (0.0007) [2023-12-26 06:43:10,408][123090] Updated weights for policy 1, policy_version 886751 (0.0006) [2023-12-26 06:43:10,991][123091] Updated weights for policy 0, policy_version 892852 (0.0007) [2023-12-26 06:43:11,063][123091] Updated weights for policy 0, policy_version 892862 (0.0009) [2023-12-26 06:43:11,129][123091] Updated weights for policy 0, policy_version 892872 (0.0008) [2023-12-26 06:43:11,162][123090] Updated weights for policy 1, policy_version 886761 (0.0008) [2023-12-26 06:43:11,234][123090] Updated weights for policy 1, policy_version 886771 (0.0006) [2023-12-26 06:43:11,305][123090] Updated weights for policy 1, policy_version 886781 (0.0011) [2023-12-26 06:43:11,904][123091] Updated weights for policy 0, policy_version 892882 (0.0007) [2023-12-26 06:43:11,971][123091] Updated weights for policy 0, policy_version 892892 (0.0005) [2023-12-26 06:43:12,041][123091] Updated weights for policy 0, policy_version 892902 (0.0006) [2023-12-26 06:43:12,102][123091] Updated weights for policy 0, policy_version 892912 (0.0009) [2023-12-26 06:43:12,116][123090] Updated weights for policy 1, policy_version 886791 (0.0011) [2023-12-26 06:43:12,168][123090] Updated weights for policy 1, policy_version 886801 (0.0010) [2023-12-26 06:43:12,231][123090] Updated weights for policy 1, policy_version 886811 (0.0010) [2023-12-26 06:43:12,840][123091] Updated weights for policy 0, policy_version 892922 (0.0011) [2023-12-26 06:43:12,891][123091] Updated weights for policy 0, policy_version 892932 (0.0010) [2023-12-26 06:43:12,947][123091] Updated weights for policy 0, policy_version 892942 (0.0011) [2023-12-26 06:43:13,055][123090] Updated weights for policy 1, policy_version 886821 (0.0011) [2023-12-26 06:43:13,103][123090] Updated weights for policy 1, policy_version 886831 (0.0010) [2023-12-26 06:43:13,150][123090] Updated weights for policy 1, policy_version 886841 (0.0010) [2023-12-26 06:43:13,693][123091] Updated weights for policy 0, policy_version 892952 (0.0007) [2023-12-26 06:43:13,754][123091] Updated weights for policy 0, policy_version 892962 (0.0007) [2023-12-26 06:43:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 455630848. Throughput: 0: 8834.6, 1: 8981.2. Samples: 455630224. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:13,785][121949] Avg episode reward: [(0, '5884.975'), (1, '5685.889')] [2023-12-26 06:43:13,810][123091] Updated weights for policy 0, policy_version 892972 (0.0007) [2023-12-26 06:43:13,917][123090] Updated weights for policy 1, policy_version 886851 (0.0009) [2023-12-26 06:43:13,977][123090] Updated weights for policy 1, policy_version 886861 (0.0006) [2023-12-26 06:43:14,052][123090] Updated weights for policy 1, policy_version 886871 (0.0009) [2023-12-26 06:43:14,449][123091] Updated weights for policy 0, policy_version 892982 (0.0006) [2023-12-26 06:43:14,505][123091] Updated weights for policy 0, policy_version 892992 (0.0007) [2023-12-26 06:43:14,569][123091] Updated weights for policy 0, policy_version 893002 (0.0010) [2023-12-26 06:43:14,774][123090] Updated weights for policy 1, policy_version 886881 (0.0009) [2023-12-26 06:43:14,840][123090] Updated weights for policy 1, policy_version 886891 (0.0011) [2023-12-26 06:43:14,909][123090] Updated weights for policy 1, policy_version 886901 (0.0011) [2023-12-26 06:43:14,969][123090] Updated weights for policy 1, policy_version 886911 (0.0011) [2023-12-26 06:43:15,363][123091] Updated weights for policy 0, policy_version 893012 (0.0011) [2023-12-26 06:43:15,420][123091] Updated weights for policy 0, policy_version 893022 (0.0011) [2023-12-26 06:43:15,487][123091] Updated weights for policy 0, policy_version 893032 (0.0011) [2023-12-26 06:43:15,810][123090] Updated weights for policy 1, policy_version 886921 (0.0011) [2023-12-26 06:43:15,858][123090] Updated weights for policy 1, policy_version 886931 (0.0010) [2023-12-26 06:43:15,905][123090] Updated weights for policy 1, policy_version 886941 (0.0010) [2023-12-26 06:43:16,318][123091] Updated weights for policy 0, policy_version 893042 (0.0011) [2023-12-26 06:43:16,381][123091] Updated weights for policy 0, policy_version 893052 (0.0011) [2023-12-26 06:43:16,444][123091] Updated weights for policy 0, policy_version 893062 (0.0011) [2023-12-26 06:43:16,507][123091] Updated weights for policy 0, policy_version 893072 (0.0011) [2023-12-26 06:43:16,720][123090] Updated weights for policy 1, policy_version 886951 (0.0010) [2023-12-26 06:43:16,770][123090] Updated weights for policy 1, policy_version 886961 (0.0010) [2023-12-26 06:43:16,819][123090] Updated weights for policy 1, policy_version 886971 (0.0010) [2023-12-26 06:43:17,271][123091] Updated weights for policy 0, policy_version 893082 (0.0005) [2023-12-26 06:43:17,331][123091] Updated weights for policy 0, policy_version 893092 (0.0009) [2023-12-26 06:43:17,386][123091] Updated weights for policy 0, policy_version 893102 (0.0009) [2023-12-26 06:43:17,668][123090] Updated weights for policy 1, policy_version 886981 (0.0010) [2023-12-26 06:43:17,727][123090] Updated weights for policy 1, policy_version 886991 (0.0010) [2023-12-26 06:43:17,793][123090] Updated weights for policy 1, policy_version 887001 (0.0010) [2023-12-26 06:43:18,196][123091] Updated weights for policy 0, policy_version 893112 (0.0009) [2023-12-26 06:43:18,243][123091] Updated weights for policy 0, policy_version 893122 (0.0008) [2023-12-26 06:43:18,306][123091] Updated weights for policy 0, policy_version 893132 (0.0009) [2023-12-26 06:43:18,620][123090] Updated weights for policy 1, policy_version 887011 (0.0010) [2023-12-26 06:43:18,684][123090] Updated weights for policy 1, policy_version 887021 (0.0010) [2023-12-26 06:43:18,751][123090] Updated weights for policy 1, policy_version 887031 (0.0010) [2023-12-26 06:43:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 455720960. Throughput: 0: 8883.4, 1: 8951.3. Samples: 455737632. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:18,785][121949] Avg episode reward: [(0, '5974.535'), (1, '5665.838')] [2023-12-26 06:43:19,164][123091] Updated weights for policy 0, policy_version 893142 (0.0009) [2023-12-26 06:43:19,232][123091] Updated weights for policy 0, policy_version 893152 (0.0010) [2023-12-26 06:43:19,299][123091] Updated weights for policy 0, policy_version 893162 (0.0010) [2023-12-26 06:43:19,521][123090] Updated weights for policy 1, policy_version 887041 (0.0011) [2023-12-26 06:43:19,581][123090] Updated weights for policy 1, policy_version 887051 (0.0010) [2023-12-26 06:43:19,656][123090] Updated weights for policy 1, policy_version 887061 (0.0009) [2023-12-26 06:43:19,721][123090] Updated weights for policy 1, policy_version 887071 (0.0009) [2023-12-26 06:43:20,121][123091] Updated weights for policy 0, policy_version 893172 (0.0009) [2023-12-26 06:43:20,173][123091] Updated weights for policy 0, policy_version 893182 (0.0011) [2023-12-26 06:43:20,221][123091] Updated weights for policy 0, policy_version 893192 (0.0010) [2023-12-26 06:43:20,575][123090] Updated weights for policy 1, policy_version 887081 (0.0009) [2023-12-26 06:43:20,645][123090] Updated weights for policy 1, policy_version 887091 (0.0008) [2023-12-26 06:43:20,709][123090] Updated weights for policy 1, policy_version 887101 (0.0009) [2023-12-26 06:43:21,053][123091] Updated weights for policy 0, policy_version 893202 (0.0010) [2023-12-26 06:43:21,116][123091] Updated weights for policy 0, policy_version 893212 (0.0010) [2023-12-26 06:43:21,180][123091] Updated weights for policy 0, policy_version 893222 (0.0009) [2023-12-26 06:43:21,232][123091] Updated weights for policy 0, policy_version 893232 (0.0009) [2023-12-26 06:43:21,573][123090] Updated weights for policy 1, policy_version 887111 (0.0009) [2023-12-26 06:43:21,631][123090] Updated weights for policy 1, policy_version 887121 (0.0009) [2023-12-26 06:43:21,696][123090] Updated weights for policy 1, policy_version 887131 (0.0009) [2023-12-26 06:43:22,093][123091] Updated weights for policy 0, policy_version 893242 (0.0010) [2023-12-26 06:43:22,150][123091] Updated weights for policy 0, policy_version 893252 (0.0010) [2023-12-26 06:43:22,205][123091] Updated weights for policy 0, policy_version 893262 (0.0008) [2023-12-26 06:43:22,555][123090] Updated weights for policy 1, policy_version 887141 (0.0010) [2023-12-26 06:43:22,609][123090] Updated weights for policy 1, policy_version 887151 (0.0010) [2023-12-26 06:43:22,662][123090] Updated weights for policy 1, policy_version 887161 (0.0009) [2023-12-26 06:43:22,980][123091] Updated weights for policy 0, policy_version 893272 (0.0009) [2023-12-26 06:43:23,044][123091] Updated weights for policy 0, policy_version 893282 (0.0010) [2023-12-26 06:43:23,093][123091] Updated weights for policy 0, policy_version 893292 (0.0009) [2023-12-26 06:43:23,520][123090] Updated weights for policy 1, policy_version 887171 (0.0010) [2023-12-26 06:43:23,579][123090] Updated weights for policy 1, policy_version 887181 (0.0009) [2023-12-26 06:43:23,646][123090] Updated weights for policy 1, policy_version 887191 (0.0009) [2023-12-26 06:43:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 455811072. Throughput: 0: 8824.5, 1: 8922.3. Samples: 455787356. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:23,785][121949] Avg episode reward: [(0, '6022.633'), (1, '5586.337')] [2023-12-26 06:43:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000893296_228687872.pth... [2023-12-26 06:43:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000887200_227123200.pth... [2023-12-26 06:43:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000886176_226861056.pth [2023-12-26 06:43:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000892272_228425728.pth [2023-12-26 06:43:23,968][123091] Updated weights for policy 0, policy_version 893302 (0.0010) [2023-12-26 06:43:24,025][123091] Updated weights for policy 0, policy_version 893312 (0.0010) [2023-12-26 06:43:24,081][123091] Updated weights for policy 0, policy_version 893322 (0.0010) [2023-12-26 06:43:24,532][123090] Updated weights for policy 1, policy_version 887202 (0.0010) [2023-12-26 06:43:24,587][123090] Updated weights for policy 1, policy_version 887212 (0.0009) [2023-12-26 06:43:24,643][123090] Updated weights for policy 1, policy_version 887222 (0.0006) [2023-12-26 06:43:24,698][123090] Updated weights for policy 1, policy_version 887232 (0.0009) [2023-12-26 06:43:24,889][123091] Updated weights for policy 0, policy_version 893332 (0.0008) [2023-12-26 06:43:24,955][123091] Updated weights for policy 0, policy_version 893342 (0.0009) [2023-12-26 06:43:25,019][123091] Updated weights for policy 0, policy_version 893352 (0.0006) [2023-12-26 06:43:25,597][123091] Updated weights for policy 0, policy_version 893362 (0.0005) [2023-12-26 06:43:25,598][123090] Updated weights for policy 1, policy_version 887242 (0.0010) [2023-12-26 06:43:25,649][123091] Updated weights for policy 0, policy_version 893372 (0.0007) [2023-12-26 06:43:25,659][123090] Updated weights for policy 1, policy_version 887252 (0.0008) [2023-12-26 06:43:25,700][123091] Updated weights for policy 0, policy_version 893382 (0.0007) [2023-12-26 06:43:25,724][123090] Updated weights for policy 1, policy_version 887262 (0.0007) [2023-12-26 06:43:25,751][123091] Updated weights for policy 0, policy_version 893392 (0.0007) [2023-12-26 06:43:26,348][123091] Updated weights for policy 0, policy_version 893402 (0.0008) [2023-12-26 06:43:26,407][123091] Updated weights for policy 0, policy_version 893412 (0.0010) [2023-12-26 06:43:26,480][123091] Updated weights for policy 0, policy_version 893422 (0.0010) [2023-12-26 06:43:26,599][123090] Updated weights for policy 1, policy_version 887272 (0.0009) [2023-12-26 06:43:26,646][123090] Updated weights for policy 1, policy_version 887282 (0.0009) [2023-12-26 06:43:26,693][123090] Updated weights for policy 1, policy_version 887292 (0.0008) [2023-12-26 06:43:27,187][123091] Updated weights for policy 0, policy_version 893432 (0.0010) [2023-12-26 06:43:27,241][123091] Updated weights for policy 0, policy_version 893443 (0.0010) [2023-12-26 06:43:27,295][123091] Updated weights for policy 0, policy_version 893453 (0.0009) [2023-12-26 06:43:27,551][123090] Updated weights for policy 1, policy_version 887302 (0.0007) [2023-12-26 06:43:27,605][123090] Updated weights for policy 1, policy_version 887312 (0.0005) [2023-12-26 06:43:27,654][123090] Updated weights for policy 1, policy_version 887322 (0.0006) [2023-12-26 06:43:28,165][123091] Updated weights for policy 0, policy_version 893463 (0.0009) [2023-12-26 06:43:28,231][123091] Updated weights for policy 0, policy_version 893473 (0.0010) [2023-12-26 06:43:28,302][123091] Updated weights for policy 0, policy_version 893483 (0.0009) [2023-12-26 06:43:28,315][123090] Updated weights for policy 1, policy_version 887332 (0.0005) [2023-12-26 06:43:28,383][123090] Updated weights for policy 1, policy_version 887342 (0.0006) [2023-12-26 06:43:28,450][123090] Updated weights for policy 1, policy_version 887352 (0.0005) [2023-12-26 06:43:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 455901184. Throughput: 0: 8923.8, 1: 8835.6. Samples: 455891748. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:28,784][121949] Avg episode reward: [(0, '6040.619'), (1, '5577.237')] [2023-12-26 06:43:29,119][123090] Updated weights for policy 1, policy_version 887362 (0.0006) [2023-12-26 06:43:29,174][123090] Updated weights for policy 1, policy_version 887372 (0.0010) [2023-12-26 06:43:29,201][123091] Updated weights for policy 0, policy_version 893493 (0.0009) [2023-12-26 06:43:29,244][123090] Updated weights for policy 1, policy_version 887382 (0.0010) [2023-12-26 06:43:29,272][123091] Updated weights for policy 0, policy_version 893503 (0.0007) [2023-12-26 06:43:29,307][123090] Updated weights for policy 1, policy_version 887392 (0.0008) [2023-12-26 06:43:29,333][123091] Updated weights for policy 0, policy_version 893513 (0.0009) [2023-12-26 06:43:30,038][123091] Updated weights for policy 0, policy_version 893523 (0.0009) [2023-12-26 06:43:30,090][123091] Updated weights for policy 0, policy_version 893533 (0.0005) [2023-12-26 06:43:30,094][123090] Updated weights for policy 1, policy_version 887402 (0.0011) [2023-12-26 06:43:30,153][123091] Updated weights for policy 0, policy_version 893543 (0.0005) [2023-12-26 06:43:30,156][123090] Updated weights for policy 1, policy_version 887412 (0.0010) [2023-12-26 06:43:30,223][123090] Updated weights for policy 1, policy_version 887422 (0.0011) [2023-12-26 06:43:30,822][123091] Updated weights for policy 0, policy_version 893553 (0.0005) [2023-12-26 06:43:30,873][123091] Updated weights for policy 0, policy_version 893563 (0.0005) [2023-12-26 06:43:30,928][123091] Updated weights for policy 0, policy_version 893573 (0.0005) [2023-12-26 06:43:30,987][123091] Updated weights for policy 0, policy_version 893583 (0.0005) [2023-12-26 06:43:31,035][123090] Updated weights for policy 1, policy_version 887432 (0.0010) [2023-12-26 06:43:31,101][123090] Updated weights for policy 1, policy_version 887442 (0.0010) [2023-12-26 06:43:31,172][123090] Updated weights for policy 1, policy_version 887452 (0.0010) [2023-12-26 06:43:31,791][123091] Updated weights for policy 0, policy_version 893593 (0.0010) [2023-12-26 06:43:31,858][123091] Updated weights for policy 0, policy_version 893603 (0.0011) [2023-12-26 06:43:31,909][123091] Updated weights for policy 0, policy_version 893613 (0.0010) [2023-12-26 06:43:31,969][123090] Updated weights for policy 1, policy_version 887462 (0.0008) [2023-12-26 06:43:32,016][123090] Updated weights for policy 1, policy_version 887472 (0.0009) [2023-12-26 06:43:32,076][123090] Updated weights for policy 1, policy_version 887482 (0.0009) [2023-12-26 06:43:32,687][123091] Updated weights for policy 0, policy_version 893623 (0.0007) [2023-12-26 06:43:32,734][123091] Updated weights for policy 0, policy_version 893633 (0.0005) [2023-12-26 06:43:32,777][123091] Updated weights for policy 0, policy_version 893643 (0.0005) [2023-12-26 06:43:32,928][123090] Updated weights for policy 1, policy_version 887492 (0.0009) [2023-12-26 06:43:32,982][123090] Updated weights for policy 1, policy_version 887502 (0.0010) [2023-12-26 06:43:33,035][123090] Updated weights for policy 1, policy_version 887512 (0.0009) [2023-12-26 06:43:33,415][123091] Updated weights for policy 0, policy_version 893653 (0.0005) [2023-12-26 06:43:33,472][123091] Updated weights for policy 0, policy_version 893663 (0.0005) [2023-12-26 06:43:33,534][123091] Updated weights for policy 0, policy_version 893673 (0.0007) [2023-12-26 06:43:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 455991296. Throughput: 0: 8859.7, 1: 8792.0. Samples: 456001616. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:33,785][121949] Avg episode reward: [(0, '6006.221'), (1, '5574.957')] [2023-12-26 06:43:33,898][123090] Updated weights for policy 1, policy_version 887522 (0.0010) [2023-12-26 06:43:33,954][123090] Updated weights for policy 1, policy_version 887532 (0.0010) [2023-12-26 06:43:34,005][123090] Updated weights for policy 1, policy_version 887542 (0.0010) [2023-12-26 06:43:34,068][123090] Updated weights for policy 1, policy_version 887552 (0.0010) [2023-12-26 06:43:34,228][123091] Updated weights for policy 0, policy_version 893683 (0.0010) [2023-12-26 06:43:34,301][123091] Updated weights for policy 0, policy_version 893693 (0.0009) [2023-12-26 06:43:34,372][123091] Updated weights for policy 0, policy_version 893703 (0.0008) [2023-12-26 06:43:34,938][123090] Updated weights for policy 1, policy_version 887562 (0.0009) [2023-12-26 06:43:35,005][123090] Updated weights for policy 1, policy_version 887572 (0.0010) [2023-12-26 06:43:35,061][123090] Updated weights for policy 1, policy_version 887582 (0.0010) [2023-12-26 06:43:35,158][123091] Updated weights for policy 0, policy_version 893713 (0.0008) [2023-12-26 06:43:35,208][123091] Updated weights for policy 0, policy_version 893723 (0.0010) [2023-12-26 06:43:35,262][123091] Updated weights for policy 0, policy_version 893733 (0.0010) [2023-12-26 06:43:35,309][123091] Updated weights for policy 0, policy_version 893743 (0.0010) [2023-12-26 06:43:35,883][123090] Updated weights for policy 1, policy_version 887592 (0.0010) [2023-12-26 06:43:35,945][123090] Updated weights for policy 1, policy_version 887602 (0.0010) [2023-12-26 06:43:36,012][123090] Updated weights for policy 1, policy_version 887612 (0.0010) [2023-12-26 06:43:36,106][123091] Updated weights for policy 0, policy_version 893753 (0.0010) [2023-12-26 06:43:36,172][123091] Updated weights for policy 0, policy_version 893763 (0.0010) [2023-12-26 06:43:36,240][123091] Updated weights for policy 0, policy_version 893773 (0.0011) [2023-12-26 06:43:36,840][123090] Updated weights for policy 1, policy_version 887622 (0.0010) [2023-12-26 06:43:36,895][123090] Updated weights for policy 1, policy_version 887632 (0.0010) [2023-12-26 06:43:36,959][123090] Updated weights for policy 1, policy_version 887642 (0.0010) [2023-12-26 06:43:37,061][123091] Updated weights for policy 0, policy_version 893783 (0.0011) [2023-12-26 06:43:37,136][123091] Updated weights for policy 0, policy_version 893793 (0.0010) [2023-12-26 06:43:37,203][123091] Updated weights for policy 0, policy_version 893803 (0.0005) [2023-12-26 06:43:37,717][123090] Updated weights for policy 1, policy_version 887652 (0.0006) [2023-12-26 06:43:37,765][123090] Updated weights for policy 1, policy_version 887662 (0.0009) [2023-12-26 06:43:37,826][123090] Updated weights for policy 1, policy_version 887672 (0.0009) [2023-12-26 06:43:37,861][123091] Updated weights for policy 0, policy_version 893813 (0.0008) [2023-12-26 06:43:37,919][123091] Updated weights for policy 0, policy_version 893823 (0.0010) [2023-12-26 06:43:37,977][123091] Updated weights for policy 0, policy_version 893833 (0.0010) [2023-12-26 06:43:38,666][123090] Updated weights for policy 1, policy_version 887682 (0.0009) [2023-12-26 06:43:38,726][123090] Updated weights for policy 1, policy_version 887692 (0.0010) [2023-12-26 06:43:38,766][123091] Updated weights for policy 0, policy_version 893843 (0.0010) [2023-12-26 06:43:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 456073216. Throughput: 0: 8916.9, 1: 8737.4. Samples: 456054316. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:38,784][121949] Avg episode reward: [(0, '6056.615'), (1, '5551.266')] [2023-12-26 06:43:38,785][123090] Updated weights for policy 1, policy_version 887702 (0.0011) [2023-12-26 06:43:38,830][123091] Updated weights for policy 0, policy_version 893853 (0.0011) [2023-12-26 06:43:38,842][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000887712_227254272.pth... [2023-12-26 06:43:38,845][123090] Updated weights for policy 1, policy_version 887712 (0.0010) [2023-12-26 06:43:38,847][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000886688_226992128.pth [2023-12-26 06:43:38,882][123091] Updated weights for policy 0, policy_version 893863 (0.0010) [2023-12-26 06:43:38,931][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000893872_228835328.pth... [2023-12-26 06:43:38,936][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000892784_228556800.pth [2023-12-26 06:43:39,640][123090] Updated weights for policy 1, policy_version 887722 (0.0011) [2023-12-26 06:43:39,677][123091] Updated weights for policy 0, policy_version 893873 (0.0010) [2023-12-26 06:43:39,700][123090] Updated weights for policy 1, policy_version 887732 (0.0011) [2023-12-26 06:43:39,740][123091] Updated weights for policy 0, policy_version 893883 (0.0007) [2023-12-26 06:43:39,764][123090] Updated weights for policy 1, policy_version 887742 (0.0011) [2023-12-26 06:43:39,808][123091] Updated weights for policy 0, policy_version 893893 (0.0006) [2023-12-26 06:43:39,870][123091] Updated weights for policy 0, policy_version 893903 (0.0010) [2023-12-26 06:43:40,603][123090] Updated weights for policy 1, policy_version 887752 (0.0010) [2023-12-26 06:43:40,641][123091] Updated weights for policy 0, policy_version 893913 (0.0009) [2023-12-26 06:43:40,667][123090] Updated weights for policy 1, policy_version 887762 (0.0011) [2023-12-26 06:43:40,696][123091] Updated weights for policy 0, policy_version 893923 (0.0008) [2023-12-26 06:43:40,735][123090] Updated weights for policy 1, policy_version 887772 (0.0011) [2023-12-26 06:43:40,759][123091] Updated weights for policy 0, policy_version 893933 (0.0008) [2023-12-26 06:43:41,583][123090] Updated weights for policy 1, policy_version 887782 (0.0011) [2023-12-26 06:43:41,604][123091] Updated weights for policy 0, policy_version 893943 (0.0010) [2023-12-26 06:43:41,652][123090] Updated weights for policy 1, policy_version 887792 (0.0009) [2023-12-26 06:43:41,675][123091] Updated weights for policy 0, policy_version 893953 (0.0009) [2023-12-26 06:43:41,721][123090] Updated weights for policy 1, policy_version 887802 (0.0009) [2023-12-26 06:43:41,748][123091] Updated weights for policy 0, policy_version 893963 (0.0008) [2023-12-26 06:43:42,549][123091] Updated weights for policy 0, policy_version 893973 (0.0008) [2023-12-26 06:43:42,586][123090] Updated weights for policy 1, policy_version 887812 (0.0009) [2023-12-26 06:43:42,612][123091] Updated weights for policy 0, policy_version 893983 (0.0007) [2023-12-26 06:43:42,648][123090] Updated weights for policy 1, policy_version 887822 (0.0009) [2023-12-26 06:43:42,676][123091] Updated weights for policy 0, policy_version 893993 (0.0007) [2023-12-26 06:43:42,711][123090] Updated weights for policy 1, policy_version 887832 (0.0010) [2023-12-26 06:43:43,464][123090] Updated weights for policy 1, policy_version 887842 (0.0010) [2023-12-26 06:43:43,479][123091] Updated weights for policy 0, policy_version 894003 (0.0006) [2023-12-26 06:43:43,513][123090] Updated weights for policy 1, policy_version 887852 (0.0008) [2023-12-26 06:43:43,540][123091] Updated weights for policy 0, policy_version 894013 (0.0009) [2023-12-26 06:43:43,564][123090] Updated weights for policy 1, policy_version 887862 (0.0008) [2023-12-26 06:43:43,603][123091] Updated weights for policy 0, policy_version 894023 (0.0007) [2023-12-26 06:43:43,622][123090] Updated weights for policy 1, policy_version 887872 (0.0008) [2023-12-26 06:43:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 456171520. Throughput: 0: 8915.0, 1: 8706.7. Samples: 456159428. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:43,785][121949] Avg episode reward: [(0, '6219.599'), (1, '5601.933')] [2023-12-26 06:43:44,380][123091] Updated weights for policy 0, policy_version 894033 (0.0009) [2023-12-26 06:43:44,444][123091] Updated weights for policy 0, policy_version 894043 (0.0009) [2023-12-26 06:43:44,481][123090] Updated weights for policy 1, policy_version 887882 (0.0009) [2023-12-26 06:43:44,496][123091] Updated weights for policy 0, policy_version 894053 (0.0007) [2023-12-26 06:43:44,526][123090] Updated weights for policy 1, policy_version 887892 (0.0006) [2023-12-26 06:43:44,551][123091] Updated weights for policy 0, policy_version 894063 (0.0008) [2023-12-26 06:43:44,574][123090] Updated weights for policy 1, policy_version 887902 (0.0009) [2023-12-26 06:43:45,353][123091] Updated weights for policy 0, policy_version 894073 (0.0006) [2023-12-26 06:43:45,424][123091] Updated weights for policy 0, policy_version 894083 (0.0006) [2023-12-26 06:43:45,486][123091] Updated weights for policy 0, policy_version 894093 (0.0007) [2023-12-26 06:43:45,535][123090] Updated weights for policy 1, policy_version 887912 (0.0009) [2023-12-26 06:43:45,600][123090] Updated weights for policy 1, policy_version 887922 (0.0010) [2023-12-26 06:43:45,671][123090] Updated weights for policy 1, policy_version 887932 (0.0009) [2023-12-26 06:43:46,156][123091] Updated weights for policy 0, policy_version 894103 (0.0006) [2023-12-26 06:43:46,200][123091] Updated weights for policy 0, policy_version 894113 (0.0005) [2023-12-26 06:43:46,250][123091] Updated weights for policy 0, policy_version 894123 (0.0005) [2023-12-26 06:43:46,344][123090] Updated weights for policy 1, policy_version 887942 (0.0005) [2023-12-26 06:43:46,413][123090] Updated weights for policy 1, policy_version 887952 (0.0005) [2023-12-26 06:43:46,465][123090] Updated weights for policy 1, policy_version 887962 (0.0005) [2023-12-26 06:43:47,106][123091] Updated weights for policy 0, policy_version 894133 (0.0010) [2023-12-26 06:43:47,131][123090] Updated weights for policy 1, policy_version 887972 (0.0005) [2023-12-26 06:43:47,167][123091] Updated weights for policy 0, policy_version 894143 (0.0009) [2023-12-26 06:43:47,191][123090] Updated weights for policy 1, policy_version 887982 (0.0007) [2023-12-26 06:43:47,217][123091] Updated weights for policy 0, policy_version 894153 (0.0007) [2023-12-26 06:43:47,247][123090] Updated weights for policy 1, policy_version 887992 (0.0010) [2023-12-26 06:43:47,960][123090] Updated weights for policy 1, policy_version 888002 (0.0009) [2023-12-26 06:43:48,009][123090] Updated weights for policy 1, policy_version 888012 (0.0005) [2023-12-26 06:43:48,072][123091] Updated weights for policy 0, policy_version 894163 (0.0008) [2023-12-26 06:43:48,078][123090] Updated weights for policy 1, policy_version 888022 (0.0010) [2023-12-26 06:43:48,133][123091] Updated weights for policy 0, policy_version 894173 (0.0006) [2023-12-26 06:43:48,138][123090] Updated weights for policy 1, policy_version 888032 (0.0010) [2023-12-26 06:43:48,187][123091] Updated weights for policy 0, policy_version 894183 (0.0009) [2023-12-26 06:43:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 456253440. Throughput: 0: 8939.3, 1: 8731.8. Samples: 456267200. Policy #0 lag: (min: 53.0, avg: 56.0, max: 56.0) [2023-12-26 06:43:48,785][121949] Avg episode reward: [(0, '6107.161'), (1, '5522.334')] [2023-12-26 06:43:48,903][123090] Updated weights for policy 1, policy_version 888042 (0.0005) [2023-12-26 06:43:48,977][123090] Updated weights for policy 1, policy_version 888052 (0.0005) [2023-12-26 06:43:49,047][123090] Updated weights for policy 1, policy_version 888062 (0.0008) [2023-12-26 06:43:49,064][123091] Updated weights for policy 0, policy_version 894193 (0.0010) [2023-12-26 06:43:49,130][123091] Updated weights for policy 0, policy_version 894203 (0.0009) [2023-12-26 06:43:49,203][123091] Updated weights for policy 0, policy_version 894213 (0.0009) [2023-12-26 06:43:49,268][123091] Updated weights for policy 0, policy_version 894223 (0.0009) [2023-12-26 06:43:49,826][123090] Updated weights for policy 1, policy_version 888072 (0.0007) [2023-12-26 06:43:49,883][123090] Updated weights for policy 1, policy_version 888082 (0.0009) [2023-12-26 06:43:49,954][123090] Updated weights for policy 1, policy_version 888092 (0.0009) [2023-12-26 06:43:50,105][123091] Updated weights for policy 0, policy_version 894233 (0.0010) [2023-12-26 06:43:50,160][123091] Updated weights for policy 0, policy_version 894243 (0.0010) [2023-12-26 06:43:50,217][123091] Updated weights for policy 0, policy_version 894254 (0.0010) [2023-12-26 06:43:50,724][123090] Updated weights for policy 1, policy_version 888102 (0.0009) [2023-12-26 06:43:50,782][123090] Updated weights for policy 1, policy_version 888112 (0.0009) [2023-12-26 06:43:50,846][123090] Updated weights for policy 1, policy_version 888122 (0.0008) [2023-12-26 06:43:51,107][123091] Updated weights for policy 0, policy_version 894264 (0.0010) [2023-12-26 06:43:51,173][123091] Updated weights for policy 0, policy_version 894274 (0.0008) [2023-12-26 06:43:51,246][123091] Updated weights for policy 0, policy_version 894284 (0.0006) [2023-12-26 06:43:51,691][123090] Updated weights for policy 1, policy_version 888132 (0.0009) [2023-12-26 06:43:51,759][123090] Updated weights for policy 1, policy_version 888142 (0.0010) [2023-12-26 06:43:51,826][123090] Updated weights for policy 1, policy_version 888152 (0.0009) [2023-12-26 06:43:52,096][123091] Updated weights for policy 0, policy_version 894294 (0.0009) [2023-12-26 06:43:52,160][123091] Updated weights for policy 0, policy_version 894304 (0.0010) [2023-12-26 06:43:52,217][123091] Updated weights for policy 0, policy_version 894314 (0.0009) [2023-12-26 06:43:52,688][123090] Updated weights for policy 1, policy_version 888162 (0.0009) [2023-12-26 06:43:52,754][123090] Updated weights for policy 1, policy_version 888172 (0.0010) [2023-12-26 06:43:52,822][123090] Updated weights for policy 1, policy_version 888182 (0.0009) [2023-12-26 06:43:52,881][123090] Updated weights for policy 1, policy_version 888192 (0.0009) [2023-12-26 06:43:53,049][123091] Updated weights for policy 0, policy_version 894324 (0.0009) [2023-12-26 06:43:53,103][123091] Updated weights for policy 0, policy_version 894334 (0.0010) [2023-12-26 06:43:53,162][123091] Updated weights for policy 0, policy_version 894344 (0.0009) [2023-12-26 06:43:53,678][123090] Updated weights for policy 1, policy_version 888202 (0.0009) [2023-12-26 06:43:53,743][123090] Updated weights for policy 1, policy_version 888212 (0.0009) [2023-12-26 06:43:53,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 456335360. Throughput: 0: 8933.6, 1: 8704.5. Samples: 456317860. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:43:53,785][121949] Avg episode reward: [(0, '5945.025'), (1, '5380.960')] [2023-12-26 06:43:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000894352_228958208.pth... [2023-12-26 06:43:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000893296_228687872.pth [2023-12-26 06:43:53,810][123090] Updated weights for policy 1, policy_version 888222 (0.0010) [2023-12-26 06:43:53,818][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000888224_227385344.pth... [2023-12-26 06:43:53,821][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000887200_227123200.pth [2023-12-26 06:43:54,017][123091] Updated weights for policy 0, policy_version 894355 (0.0010) [2023-12-26 06:43:54,068][123091] Updated weights for policy 0, policy_version 894365 (0.0010) [2023-12-26 06:43:54,125][123091] Updated weights for policy 0, policy_version 894375 (0.0009) [2023-12-26 06:43:54,659][123090] Updated weights for policy 1, policy_version 888232 (0.0010) [2023-12-26 06:43:54,725][123090] Updated weights for policy 1, policy_version 888242 (0.0009) [2023-12-26 06:43:54,790][123090] Updated weights for policy 1, policy_version 888252 (0.0009) [2023-12-26 06:43:54,979][123091] Updated weights for policy 0, policy_version 894385 (0.0009) [2023-12-26 06:43:55,047][123091] Updated weights for policy 0, policy_version 894395 (0.0006) [2023-12-26 06:43:55,114][123091] Updated weights for policy 0, policy_version 894405 (0.0009) [2023-12-26 06:43:55,177][123091] Updated weights for policy 0, policy_version 894415 (0.0010) [2023-12-26 06:43:55,603][123090] Updated weights for policy 1, policy_version 888262 (0.0010) [2023-12-26 06:43:55,660][123090] Updated weights for policy 1, policy_version 888272 (0.0008) [2023-12-26 06:43:55,728][123090] Updated weights for policy 1, policy_version 888282 (0.0008) [2023-12-26 06:43:55,941][123091] Updated weights for policy 0, policy_version 894425 (0.0006) [2023-12-26 06:43:55,990][123091] Updated weights for policy 0, policy_version 894435 (0.0005) [2023-12-26 06:43:56,038][123091] Updated weights for policy 0, policy_version 894445 (0.0005) [2023-12-26 06:43:56,563][123090] Updated weights for policy 1, policy_version 888292 (0.0007) [2023-12-26 06:43:56,629][123090] Updated weights for policy 1, policy_version 888302 (0.0005) [2023-12-26 06:43:56,706][123090] Updated weights for policy 1, policy_version 888312 (0.0005) [2023-12-26 06:43:56,858][123091] Updated weights for policy 0, policy_version 894455 (0.0008) [2023-12-26 06:43:56,912][123091] Updated weights for policy 0, policy_version 894465 (0.0009) [2023-12-26 06:43:56,964][123091] Updated weights for policy 0, policy_version 894475 (0.0006) [2023-12-26 06:43:57,358][123090] Updated weights for policy 1, policy_version 888322 (0.0007) [2023-12-26 06:43:57,408][123090] Updated weights for policy 1, policy_version 888332 (0.0005) [2023-12-26 06:43:57,461][123090] Updated weights for policy 1, policy_version 888342 (0.0006) [2023-12-26 06:43:57,529][123090] Updated weights for policy 1, policy_version 888352 (0.0007) [2023-12-26 06:43:57,665][123091] Updated weights for policy 0, policy_version 894485 (0.0005) [2023-12-26 06:43:57,727][123091] Updated weights for policy 0, policy_version 894495 (0.0005) [2023-12-26 06:43:57,790][123091] Updated weights for policy 0, policy_version 894505 (0.0005) [2023-12-26 06:43:58,293][123090] Updated weights for policy 1, policy_version 888362 (0.0010) [2023-12-26 06:43:58,362][123090] Updated weights for policy 1, policy_version 888372 (0.0010) [2023-12-26 06:43:58,434][123090] Updated weights for policy 1, policy_version 888382 (0.0009) [2023-12-26 06:43:58,488][123091] Updated weights for policy 0, policy_version 894515 (0.0007) [2023-12-26 06:43:58,557][123091] Updated weights for policy 0, policy_version 894525 (0.0010) [2023-12-26 06:43:58,619][123091] Updated weights for policy 0, policy_version 894535 (0.0010) [2023-12-26 06:43:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 456433664. Throughput: 0: 8908.7, 1: 8703.4. Samples: 456422768. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:43:58,785][121949] Avg episode reward: [(0, '5918.667'), (1, '5520.426')] [2023-12-26 06:43:59,335][123090] Updated weights for policy 1, policy_version 888392 (0.0008) [2023-12-26 06:43:59,411][123090] Updated weights for policy 1, policy_version 888402 (0.0009) [2023-12-26 06:43:59,470][123091] Updated weights for policy 0, policy_version 894545 (0.0009) [2023-12-26 06:43:59,476][123090] Updated weights for policy 1, policy_version 888412 (0.0010) [2023-12-26 06:43:59,535][123091] Updated weights for policy 0, policy_version 894555 (0.0010) [2023-12-26 06:43:59,602][123091] Updated weights for policy 0, policy_version 894565 (0.0008) [2023-12-26 06:43:59,668][123091] Updated weights for policy 0, policy_version 894575 (0.0010) [2023-12-26 06:44:00,344][123090] Updated weights for policy 1, policy_version 888422 (0.0009) [2023-12-26 06:44:00,403][123090] Updated weights for policy 1, policy_version 888432 (0.0010) [2023-12-26 06:44:00,449][123091] Updated weights for policy 0, policy_version 894585 (0.0006) [2023-12-26 06:44:00,474][123090] Updated weights for policy 1, policy_version 888442 (0.0009) [2023-12-26 06:44:00,505][123091] Updated weights for policy 0, policy_version 894595 (0.0006) [2023-12-26 06:44:00,574][123091] Updated weights for policy 0, policy_version 894605 (0.0006) [2023-12-26 06:44:01,224][123091] Updated weights for policy 0, policy_version 894615 (0.0005) [2023-12-26 06:44:01,283][123091] Updated weights for policy 0, policy_version 894625 (0.0007) [2023-12-26 06:44:01,327][123090] Updated weights for policy 1, policy_version 888452 (0.0008) [2023-12-26 06:44:01,338][123091] Updated weights for policy 0, policy_version 894635 (0.0007) [2023-12-26 06:44:01,393][123090] Updated weights for policy 1, policy_version 888462 (0.0008) [2023-12-26 06:44:01,460][123090] Updated weights for policy 1, policy_version 888472 (0.0005) [2023-12-26 06:44:02,155][123091] Updated weights for policy 0, policy_version 894645 (0.0009) [2023-12-26 06:44:02,183][123090] Updated weights for policy 1, policy_version 888482 (0.0006) [2023-12-26 06:44:02,213][123091] Updated weights for policy 0, policy_version 894655 (0.0009) [2023-12-26 06:44:02,245][123090] Updated weights for policy 1, policy_version 888492 (0.0009) [2023-12-26 06:44:02,279][123091] Updated weights for policy 0, policy_version 894665 (0.0010) [2023-12-26 06:44:02,314][123090] Updated weights for policy 1, policy_version 888502 (0.0009) [2023-12-26 06:44:02,383][123090] Updated weights for policy 1, policy_version 888512 (0.0009) [2023-12-26 06:44:03,104][123091] Updated weights for policy 0, policy_version 894675 (0.0009) [2023-12-26 06:44:03,156][123090] Updated weights for policy 1, policy_version 888522 (0.0008) [2023-12-26 06:44:03,158][123091] Updated weights for policy 0, policy_version 894685 (0.0008) [2023-12-26 06:44:03,204][123090] Updated weights for policy 1, policy_version 888532 (0.0008) [2023-12-26 06:44:03,208][123091] Updated weights for policy 0, policy_version 894695 (0.0007) [2023-12-26 06:44:03,253][123090] Updated weights for policy 1, policy_version 888542 (0.0007) [2023-12-26 06:44:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 456515584. Throughput: 0: 8934.9, 1: 8660.5. Samples: 456529428. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:03,785][121949] Avg episode reward: [(0, '6128.334'), (1, '5470.866')] [2023-12-26 06:44:03,984][123091] Updated weights for policy 0, policy_version 894705 (0.0008) [2023-12-26 06:44:04,047][123091] Updated weights for policy 0, policy_version 894715 (0.0008) [2023-12-26 06:44:04,103][123091] Updated weights for policy 0, policy_version 894725 (0.0008) [2023-12-26 06:44:04,145][123090] Updated weights for policy 1, policy_version 888552 (0.0009) [2023-12-26 06:44:04,161][123091] Updated weights for policy 0, policy_version 894735 (0.0010) [2023-12-26 06:44:04,221][123090] Updated weights for policy 1, policy_version 888562 (0.0005) [2023-12-26 06:44:04,291][123090] Updated weights for policy 1, policy_version 888572 (0.0005) [2023-12-26 06:44:04,953][123091] Updated weights for policy 0, policy_version 894745 (0.0005) [2023-12-26 06:44:05,020][123091] Updated weights for policy 0, policy_version 894755 (0.0007) [2023-12-26 06:44:05,043][123090] Updated weights for policy 1, policy_version 888582 (0.0006) [2023-12-26 06:44:05,086][123091] Updated weights for policy 0, policy_version 894765 (0.0009) [2023-12-26 06:44:05,101][123090] Updated weights for policy 1, policy_version 888592 (0.0005) [2023-12-26 06:44:05,160][123090] Updated weights for policy 1, policy_version 888602 (0.0006) [2023-12-26 06:44:05,765][123090] Updated weights for policy 1, policy_version 888612 (0.0006) [2023-12-26 06:44:05,820][123090] Updated weights for policy 1, policy_version 888622 (0.0010) [2023-12-26 06:44:05,887][123090] Updated weights for policy 1, policy_version 888632 (0.0009) [2023-12-26 06:44:05,896][123091] Updated weights for policy 0, policy_version 894775 (0.0007) [2023-12-26 06:44:05,963][123091] Updated weights for policy 0, policy_version 894785 (0.0006) [2023-12-26 06:44:06,034][123091] Updated weights for policy 0, policy_version 894795 (0.0005) [2023-12-26 06:44:06,693][123091] Updated weights for policy 0, policy_version 894805 (0.0005) [2023-12-26 06:44:06,753][123090] Updated weights for policy 1, policy_version 888642 (0.0009) [2023-12-26 06:44:06,754][123091] Updated weights for policy 0, policy_version 894815 (0.0006) [2023-12-26 06:44:06,804][123091] Updated weights for policy 0, policy_version 894825 (0.0006) [2023-12-26 06:44:06,821][123090] Updated weights for policy 1, policy_version 888652 (0.0007) [2023-12-26 06:44:06,890][123090] Updated weights for policy 1, policy_version 888662 (0.0008) [2023-12-26 06:44:06,964][123090] Updated weights for policy 1, policy_version 888672 (0.0008) [2023-12-26 06:44:07,614][123091] Updated weights for policy 0, policy_version 894835 (0.0009) [2023-12-26 06:44:07,681][123091] Updated weights for policy 0, policy_version 894845 (0.0011) [2023-12-26 06:44:07,682][123090] Updated weights for policy 1, policy_version 888682 (0.0010) [2023-12-26 06:44:07,735][123090] Updated weights for policy 1, policy_version 888692 (0.0007) [2023-12-26 06:44:07,748][123091] Updated weights for policy 0, policy_version 894855 (0.0011) [2023-12-26 06:44:07,795][123090] Updated weights for policy 1, policy_version 888702 (0.0010) [2023-12-26 06:44:08,552][123091] Updated weights for policy 0, policy_version 894865 (0.0010) [2023-12-26 06:44:08,623][123091] Updated weights for policy 0, policy_version 894875 (0.0010) [2023-12-26 06:44:08,635][123090] Updated weights for policy 1, policy_version 888712 (0.0007) [2023-12-26 06:44:08,687][123091] Updated weights for policy 0, policy_version 894885 (0.0011) [2023-12-26 06:44:08,698][123090] Updated weights for policy 1, policy_version 888722 (0.0006) [2023-12-26 06:44:08,746][123091] Updated weights for policy 0, policy_version 894895 (0.0011) [2023-12-26 06:44:08,755][123090] Updated weights for policy 1, policy_version 888732 (0.0009) [2023-12-26 06:44:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 456613888. Throughput: 0: 8978.5, 1: 8710.2. Samples: 456583344. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:08,785][121949] Avg episode reward: [(0, '6117.113'), (1, '5449.081')] [2023-12-26 06:44:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000894896_229097472.pth... [2023-12-26 06:44:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000888736_227516416.pth... [2023-12-26 06:44:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000893872_228835328.pth [2023-12-26 06:44:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000887712_227254272.pth [2023-12-26 06:44:09,555][123091] Updated weights for policy 0, policy_version 894905 (0.0007) [2023-12-26 06:44:09,625][123091] Updated weights for policy 0, policy_version 894915 (0.0006) [2023-12-26 06:44:09,631][123090] Updated weights for policy 1, policy_version 888742 (0.0009) [2023-12-26 06:44:09,694][123091] Updated weights for policy 0, policy_version 894925 (0.0006) [2023-12-26 06:44:09,695][123090] Updated weights for policy 1, policy_version 888752 (0.0008) [2023-12-26 06:44:09,756][123090] Updated weights for policy 1, policy_version 888762 (0.0009) [2023-12-26 06:44:10,481][123091] Updated weights for policy 0, policy_version 894935 (0.0010) [2023-12-26 06:44:10,548][123091] Updated weights for policy 0, policy_version 894945 (0.0011) [2023-12-26 06:44:10,555][123090] Updated weights for policy 1, policy_version 888772 (0.0008) [2023-12-26 06:44:10,608][123091] Updated weights for policy 0, policy_version 894955 (0.0011) [2023-12-26 06:44:10,620][123090] Updated weights for policy 1, policy_version 888782 (0.0007) [2023-12-26 06:44:10,676][123090] Updated weights for policy 1, policy_version 888792 (0.0009) [2023-12-26 06:44:11,308][123091] Updated weights for policy 0, policy_version 894965 (0.0010) [2023-12-26 06:44:11,372][123091] Updated weights for policy 0, policy_version 894975 (0.0010) [2023-12-26 06:44:11,429][123091] Updated weights for policy 0, policy_version 894985 (0.0011) [2023-12-26 06:44:11,574][123090] Updated weights for policy 1, policy_version 888802 (0.0010) [2023-12-26 06:44:11,633][123090] Updated weights for policy 1, policy_version 888812 (0.0009) [2023-12-26 06:44:11,704][123090] Updated weights for policy 1, policy_version 888822 (0.0008) [2023-12-26 06:44:11,771][123090] Updated weights for policy 1, policy_version 888832 (0.0008) [2023-12-26 06:44:12,208][123091] Updated weights for policy 0, policy_version 894995 (0.0011) [2023-12-26 06:44:12,271][123091] Updated weights for policy 0, policy_version 895005 (0.0009) [2023-12-26 06:44:12,335][123091] Updated weights for policy 0, policy_version 895015 (0.0010) [2023-12-26 06:44:12,537][123090] Updated weights for policy 1, policy_version 888842 (0.0007) [2023-12-26 06:44:12,604][123090] Updated weights for policy 1, policy_version 888852 (0.0006) [2023-12-26 06:44:12,663][123090] Updated weights for policy 1, policy_version 888862 (0.0009) [2023-12-26 06:44:13,067][123091] Updated weights for policy 0, policy_version 895025 (0.0009) [2023-12-26 06:44:13,132][123091] Updated weights for policy 0, policy_version 895035 (0.0008) [2023-12-26 06:44:13,201][123091] Updated weights for policy 0, policy_version 895045 (0.0005) [2023-12-26 06:44:13,272][123091] Updated weights for policy 0, policy_version 895055 (0.0008) [2023-12-26 06:44:13,471][123090] Updated weights for policy 1, policy_version 888872 (0.0009) [2023-12-26 06:44:13,524][123090] Updated weights for policy 1, policy_version 888882 (0.0010) [2023-12-26 06:44:13,583][123090] Updated weights for policy 1, policy_version 888893 (0.0010) [2023-12-26 06:44:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 456695808. Throughput: 0: 8932.3, 1: 8756.6. Samples: 456687748. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:13,785][121949] Avg episode reward: [(0, '6119.562'), (1, '5480.084')] [2023-12-26 06:44:13,934][123091] Updated weights for policy 0, policy_version 895065 (0.0006) [2023-12-26 06:44:13,980][123091] Updated weights for policy 0, policy_version 895075 (0.0005) [2023-12-26 06:44:14,042][123091] Updated weights for policy 0, policy_version 895085 (0.0005) [2023-12-26 06:44:14,357][123090] Updated weights for policy 1, policy_version 888903 (0.0010) [2023-12-26 06:44:14,417][123090] Updated weights for policy 1, policy_version 888913 (0.0010) [2023-12-26 06:44:14,479][123090] Updated weights for policy 1, policy_version 888923 (0.0010) [2023-12-26 06:44:14,851][123091] Updated weights for policy 0, policy_version 895095 (0.0007) [2023-12-26 06:44:14,919][123091] Updated weights for policy 0, policy_version 895105 (0.0008) [2023-12-26 06:44:14,983][123091] Updated weights for policy 0, policy_version 895115 (0.0008) [2023-12-26 06:44:15,281][123090] Updated weights for policy 1, policy_version 888933 (0.0007) [2023-12-26 06:44:15,342][123090] Updated weights for policy 1, policy_version 888943 (0.0006) [2023-12-26 06:44:15,410][123090] Updated weights for policy 1, policy_version 888953 (0.0006) [2023-12-26 06:44:15,812][123091] Updated weights for policy 0, policy_version 895125 (0.0008) [2023-12-26 06:44:15,863][123091] Updated weights for policy 0, policy_version 895135 (0.0009) [2023-12-26 06:44:15,923][123091] Updated weights for policy 0, policy_version 895145 (0.0009) [2023-12-26 06:44:16,108][123090] Updated weights for policy 1, policy_version 888963 (0.0006) [2023-12-26 06:44:16,170][123090] Updated weights for policy 1, policy_version 888973 (0.0005) [2023-12-26 06:44:16,223][123090] Updated weights for policy 1, policy_version 888983 (0.0006) [2023-12-26 06:44:16,672][123091] Updated weights for policy 0, policy_version 895155 (0.0008) [2023-12-26 06:44:16,737][123091] Updated weights for policy 0, policy_version 895165 (0.0005) [2023-12-26 06:44:16,794][123091] Updated weights for policy 0, policy_version 895175 (0.0005) [2023-12-26 06:44:17,004][123090] Updated weights for policy 1, policy_version 888993 (0.0008) [2023-12-26 06:44:17,070][123090] Updated weights for policy 1, policy_version 889003 (0.0010) [2023-12-26 06:44:17,140][123090] Updated weights for policy 1, policy_version 889013 (0.0010) [2023-12-26 06:44:17,206][123090] Updated weights for policy 1, policy_version 889023 (0.0010) [2023-12-26 06:44:17,491][123091] Updated weights for policy 0, policy_version 895185 (0.0006) [2023-12-26 06:44:17,541][123091] Updated weights for policy 0, policy_version 895195 (0.0008) [2023-12-26 06:44:17,589][123091] Updated weights for policy 0, policy_version 895205 (0.0009) [2023-12-26 06:44:17,636][123091] Updated weights for policy 0, policy_version 895215 (0.0009) [2023-12-26 06:44:18,019][123090] Updated weights for policy 1, policy_version 889033 (0.0011) [2023-12-26 06:44:18,078][123090] Updated weights for policy 1, policy_version 889043 (0.0010) [2023-12-26 06:44:18,139][123090] Updated weights for policy 1, policy_version 889053 (0.0006) [2023-12-26 06:44:18,560][123091] Updated weights for policy 0, policy_version 895225 (0.0009) [2023-12-26 06:44:18,615][123091] Updated weights for policy 0, policy_version 895235 (0.0009) [2023-12-26 06:44:18,674][123091] Updated weights for policy 0, policy_version 895245 (0.0009) [2023-12-26 06:44:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 456785920. Throughput: 0: 8906.0, 1: 8759.8. Samples: 456796576. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:18,785][121949] Avg episode reward: [(0, '6118.607'), (1, '5531.268')] [2023-12-26 06:44:18,870][123090] Updated weights for policy 1, policy_version 889063 (0.0005) [2023-12-26 06:44:18,924][123090] Updated weights for policy 1, policy_version 889073 (0.0010) [2023-12-26 06:44:18,971][123090] Updated weights for policy 1, policy_version 889083 (0.0010) [2023-12-26 06:44:19,573][123091] Updated weights for policy 0, policy_version 895255 (0.0007) [2023-12-26 06:44:19,651][123091] Updated weights for policy 0, policy_version 895265 (0.0006) [2023-12-26 06:44:19,720][123091] Updated weights for policy 0, policy_version 895275 (0.0006) [2023-12-26 06:44:19,830][123090] Updated weights for policy 1, policy_version 889093 (0.0010) [2023-12-26 06:44:19,906][123090] Updated weights for policy 1, policy_version 889103 (0.0010) [2023-12-26 06:44:19,980][123090] Updated weights for policy 1, policy_version 889113 (0.0009) [2023-12-26 06:44:20,463][123091] Updated weights for policy 0, policy_version 895285 (0.0008) [2023-12-26 06:44:20,516][123091] Updated weights for policy 0, policy_version 895295 (0.0010) [2023-12-26 06:44:20,572][123091] Updated weights for policy 0, policy_version 895305 (0.0009) [2023-12-26 06:44:20,794][123090] Updated weights for policy 1, policy_version 889123 (0.0008) [2023-12-26 06:44:20,869][123090] Updated weights for policy 1, policy_version 889133 (0.0005) [2023-12-26 06:44:20,939][123090] Updated weights for policy 1, policy_version 889143 (0.0007) [2023-12-26 06:44:21,479][123091] Updated weights for policy 0, policy_version 895315 (0.0010) [2023-12-26 06:44:21,532][123091] Updated weights for policy 0, policy_version 895325 (0.0010) [2023-12-26 06:44:21,590][123091] Updated weights for policy 0, policy_version 895335 (0.0009) [2023-12-26 06:44:21,639][123090] Updated weights for policy 1, policy_version 889153 (0.0006) [2023-12-26 06:44:21,694][123090] Updated weights for policy 1, policy_version 889163 (0.0008) [2023-12-26 06:44:21,763][123090] Updated weights for policy 1, policy_version 889173 (0.0009) [2023-12-26 06:44:21,824][123090] Updated weights for policy 1, policy_version 889183 (0.0011) [2023-12-26 06:44:22,397][123091] Updated weights for policy 0, policy_version 895345 (0.0010) [2023-12-26 06:44:22,463][123091] Updated weights for policy 0, policy_version 895355 (0.0009) [2023-12-26 06:44:22,528][123091] Updated weights for policy 0, policy_version 895365 (0.0008) [2023-12-26 06:44:22,603][123091] Updated weights for policy 0, policy_version 895375 (0.0006) [2023-12-26 06:44:22,665][123090] Updated weights for policy 1, policy_version 889193 (0.0010) [2023-12-26 06:44:22,713][123090] Updated weights for policy 1, policy_version 889203 (0.0010) [2023-12-26 06:44:22,773][123090] Updated weights for policy 1, policy_version 889213 (0.0010) [2023-12-26 06:44:23,353][123091] Updated weights for policy 0, policy_version 895385 (0.0005) [2023-12-26 06:44:23,413][123091] Updated weights for policy 0, policy_version 895395 (0.0009) [2023-12-26 06:44:23,464][123091] Updated weights for policy 0, policy_version 895405 (0.0010) [2023-12-26 06:44:23,632][123090] Updated weights for policy 1, policy_version 889223 (0.0009) [2023-12-26 06:44:23,699][123090] Updated weights for policy 1, policy_version 889233 (0.0005) [2023-12-26 06:44:23,749][123090] Updated weights for policy 1, policy_version 889243 (0.0005) [2023-12-26 06:44:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 456876032. Throughput: 0: 8848.4, 1: 8782.4. Samples: 456847704. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:23,785][121949] Avg episode reward: [(0, '6084.306'), (1, '5272.331')] [2023-12-26 06:44:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000895408_229228544.pth... [2023-12-26 06:44:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000889248_227647488.pth... [2023-12-26 06:44:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000894352_228958208.pth [2023-12-26 06:44:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000888224_227385344.pth [2023-12-26 06:44:24,276][123091] Updated weights for policy 0, policy_version 895415 (0.0011) [2023-12-26 06:44:24,335][123091] Updated weights for policy 0, policy_version 895425 (0.0011) [2023-12-26 06:44:24,382][123091] Updated weights for policy 0, policy_version 895435 (0.0010) [2023-12-26 06:44:24,438][123090] Updated weights for policy 1, policy_version 889253 (0.0007) [2023-12-26 06:44:24,488][123090] Updated weights for policy 1, policy_version 889263 (0.0006) [2023-12-26 06:44:24,536][123090] Updated weights for policy 1, policy_version 889273 (0.0006) [2023-12-26 06:44:25,194][123091] Updated weights for policy 0, policy_version 895445 (0.0009) [2023-12-26 06:44:25,253][123091] Updated weights for policy 0, policy_version 895455 (0.0009) [2023-12-26 06:44:25,297][123090] Updated weights for policy 1, policy_version 889283 (0.0006) [2023-12-26 06:44:25,324][123091] Updated weights for policy 0, policy_version 895465 (0.0010) [2023-12-26 06:44:25,350][123090] Updated weights for policy 1, policy_version 889293 (0.0007) [2023-12-26 06:44:25,400][123090] Updated weights for policy 1, policy_version 889303 (0.0005) [2023-12-26 06:44:26,138][123091] Updated weights for policy 0, policy_version 895475 (0.0010) [2023-12-26 06:44:26,180][123090] Updated weights for policy 1, policy_version 889313 (0.0008) [2023-12-26 06:44:26,208][123091] Updated weights for policy 0, policy_version 895485 (0.0009) [2023-12-26 06:44:26,243][123090] Updated weights for policy 1, policy_version 889323 (0.0006) [2023-12-26 06:44:26,274][123091] Updated weights for policy 0, policy_version 895495 (0.0009) [2023-12-26 06:44:26,302][123090] Updated weights for policy 1, policy_version 889333 (0.0006) [2023-12-26 06:44:26,354][123090] Updated weights for policy 1, policy_version 889343 (0.0008) [2023-12-26 06:44:27,115][123090] Updated weights for policy 1, policy_version 889353 (0.0009) [2023-12-26 06:44:27,143][123091] Updated weights for policy 0, policy_version 895505 (0.0009) [2023-12-26 06:44:27,167][123090] Updated weights for policy 1, policy_version 889363 (0.0010) [2023-12-26 06:44:27,204][123091] Updated weights for policy 0, policy_version 895515 (0.0007) [2023-12-26 06:44:27,218][123090] Updated weights for policy 1, policy_version 889373 (0.0010) [2023-12-26 06:44:27,267][123091] Updated weights for policy 0, policy_version 895525 (0.0008) [2023-12-26 06:44:27,335][123091] Updated weights for policy 0, policy_version 895535 (0.0009) [2023-12-26 06:44:27,933][123090] Updated weights for policy 1, policy_version 889383 (0.0008) [2023-12-26 06:44:28,003][123090] Updated weights for policy 1, policy_version 889393 (0.0010) [2023-12-26 06:44:28,068][123090] Updated weights for policy 1, policy_version 889403 (0.0005) [2023-12-26 06:44:28,218][123091] Updated weights for policy 0, policy_version 895545 (0.0009) [2023-12-26 06:44:28,277][123091] Updated weights for policy 0, policy_version 895555 (0.0010) [2023-12-26 06:44:28,341][123091] Updated weights for policy 0, policy_version 895565 (0.0008) [2023-12-26 06:44:28,705][123090] Updated weights for policy 1, policy_version 889413 (0.0005) [2023-12-26 06:44:28,768][123090] Updated weights for policy 1, policy_version 889423 (0.0008) [2023-12-26 06:44:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 456957952. Throughput: 0: 8805.7, 1: 8853.8. Samples: 456954104. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:28,785][121949] Avg episode reward: [(0, '6126.629'), (1, '5277.106')] [2023-12-26 06:44:28,830][123090] Updated weights for policy 1, policy_version 889433 (0.0010) [2023-12-26 06:44:29,094][123091] Updated weights for policy 0, policy_version 895575 (0.0008) [2023-12-26 06:44:29,149][123091] Updated weights for policy 0, policy_version 895585 (0.0008) [2023-12-26 06:44:29,211][123091] Updated weights for policy 0, policy_version 895595 (0.0008) [2023-12-26 06:44:29,615][123090] Updated weights for policy 1, policy_version 889443 (0.0009) [2023-12-26 06:44:29,680][123090] Updated weights for policy 1, policy_version 889453 (0.0007) [2023-12-26 06:44:29,750][123090] Updated weights for policy 1, policy_version 889463 (0.0006) [2023-12-26 06:44:30,090][123091] Updated weights for policy 0, policy_version 895605 (0.0010) [2023-12-26 06:44:30,154][123091] Updated weights for policy 0, policy_version 895615 (0.0010) [2023-12-26 06:44:30,206][123091] Updated weights for policy 0, policy_version 895625 (0.0010) [2023-12-26 06:44:30,470][123090] Updated weights for policy 1, policy_version 889473 (0.0010) [2023-12-26 06:44:30,540][123090] Updated weights for policy 1, policy_version 889483 (0.0006) [2023-12-26 06:44:30,612][123090] Updated weights for policy 1, policy_version 889493 (0.0005) [2023-12-26 06:44:30,674][123090] Updated weights for policy 1, policy_version 889503 (0.0010) [2023-12-26 06:44:31,011][123091] Updated weights for policy 0, policy_version 895635 (0.0008) [2023-12-26 06:44:31,077][123091] Updated weights for policy 0, policy_version 895645 (0.0010) [2023-12-26 06:44:31,140][123091] Updated weights for policy 0, policy_version 895655 (0.0009) [2023-12-26 06:44:31,408][123090] Updated weights for policy 1, policy_version 889513 (0.0008) [2023-12-26 06:44:31,480][123090] Updated weights for policy 1, policy_version 889523 (0.0006) [2023-12-26 06:44:31,547][123090] Updated weights for policy 1, policy_version 889533 (0.0006) [2023-12-26 06:44:32,013][123091] Updated weights for policy 0, policy_version 895665 (0.0009) [2023-12-26 06:44:32,081][123091] Updated weights for policy 0, policy_version 895675 (0.0010) [2023-12-26 06:44:32,146][123091] Updated weights for policy 0, policy_version 895685 (0.0009) [2023-12-26 06:44:32,207][123091] Updated weights for policy 0, policy_version 895695 (0.0010) [2023-12-26 06:44:32,332][123090] Updated weights for policy 1, policy_version 889543 (0.0008) [2023-12-26 06:44:32,394][123090] Updated weights for policy 1, policy_version 889553 (0.0009) [2023-12-26 06:44:32,449][123090] Updated weights for policy 1, policy_version 889563 (0.0009) [2023-12-26 06:44:32,996][123091] Updated weights for policy 0, policy_version 895705 (0.0010) [2023-12-26 06:44:33,049][123091] Updated weights for policy 0, policy_version 895715 (0.0010) [2023-12-26 06:44:33,111][123091] Updated weights for policy 0, policy_version 895726 (0.0010) [2023-12-26 06:44:33,276][123090] Updated weights for policy 1, policy_version 889573 (0.0006) [2023-12-26 06:44:33,342][123090] Updated weights for policy 1, policy_version 889583 (0.0005) [2023-12-26 06:44:33,408][123090] Updated weights for policy 1, policy_version 889593 (0.0008) [2023-12-26 06:44:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 457048064. Throughput: 0: 8768.1, 1: 8864.9. Samples: 457060684. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:33,785][121949] Avg episode reward: [(0, '6025.178'), (1, '5464.161')] [2023-12-26 06:44:33,986][123091] Updated weights for policy 0, policy_version 895736 (0.0009) [2023-12-26 06:44:34,041][123091] Updated weights for policy 0, policy_version 895746 (0.0009) [2023-12-26 06:44:34,054][123090] Updated weights for policy 1, policy_version 889603 (0.0007) [2023-12-26 06:44:34,091][123091] Updated weights for policy 0, policy_version 895756 (0.0008) [2023-12-26 06:44:34,111][123090] Updated weights for policy 1, policy_version 889613 (0.0008) [2023-12-26 06:44:34,184][123090] Updated weights for policy 1, policy_version 889623 (0.0010) [2023-12-26 06:44:34,952][123091] Updated weights for policy 0, policy_version 895766 (0.0010) [2023-12-26 06:44:34,979][123090] Updated weights for policy 1, policy_version 889633 (0.0009) [2023-12-26 06:44:35,008][123091] Updated weights for policy 0, policy_version 895776 (0.0009) [2023-12-26 06:44:35,048][123090] Updated weights for policy 1, policy_version 889643 (0.0008) [2023-12-26 06:44:35,059][123091] Updated weights for policy 0, policy_version 895786 (0.0008) [2023-12-26 06:44:35,115][123090] Updated weights for policy 1, policy_version 889653 (0.0008) [2023-12-26 06:44:35,180][123090] Updated weights for policy 1, policy_version 889663 (0.0009) [2023-12-26 06:44:35,927][123091] Updated weights for policy 0, policy_version 895796 (0.0010) [2023-12-26 06:44:35,941][123090] Updated weights for policy 1, policy_version 889673 (0.0008) [2023-12-26 06:44:35,983][123091] Updated weights for policy 0, policy_version 895806 (0.0007) [2023-12-26 06:44:36,009][123090] Updated weights for policy 1, policy_version 889683 (0.0009) [2023-12-26 06:44:36,041][123091] Updated weights for policy 0, policy_version 895816 (0.0009) [2023-12-26 06:44:36,075][123090] Updated weights for policy 1, policy_version 889693 (0.0007) [2023-12-26 06:44:36,913][123090] Updated weights for policy 1, policy_version 889703 (0.0008) [2023-12-26 06:44:36,917][123091] Updated weights for policy 0, policy_version 895826 (0.0009) [2023-12-26 06:44:36,967][123090] Updated weights for policy 1, policy_version 889713 (0.0008) [2023-12-26 06:44:36,977][123091] Updated weights for policy 0, policy_version 895836 (0.0009) [2023-12-26 06:44:37,019][123090] Updated weights for policy 1, policy_version 889723 (0.0007) [2023-12-26 06:44:37,028][123091] Updated weights for policy 0, policy_version 895846 (0.0007) [2023-12-26 06:44:37,090][123091] Updated weights for policy 0, policy_version 895856 (0.0010) [2023-12-26 06:44:37,731][123090] Updated weights for policy 1, policy_version 889733 (0.0005) [2023-12-26 06:44:37,778][123090] Updated weights for policy 1, policy_version 889743 (0.0005) [2023-12-26 06:44:37,834][123090] Updated weights for policy 1, policy_version 889753 (0.0009) [2023-12-26 06:44:38,016][123091] Updated weights for policy 0, policy_version 895866 (0.0010) [2023-12-26 06:44:38,069][123091] Updated weights for policy 0, policy_version 895876 (0.0009) [2023-12-26 06:44:38,124][123091] Updated weights for policy 0, policy_version 895886 (0.0010) [2023-12-26 06:44:38,655][123090] Updated weights for policy 1, policy_version 889763 (0.0009) [2023-12-26 06:44:38,722][123090] Updated weights for policy 1, policy_version 889773 (0.0009) [2023-12-26 06:44:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 457129984. Throughput: 0: 8772.0, 1: 8871.1. Samples: 457111800. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:38,785][121949] Avg episode reward: [(0, '5891.377'), (1, '5576.998')] [2023-12-26 06:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000895888_229351424.pth... [2023-12-26 06:44:38,790][123090] Updated weights for policy 1, policy_version 889783 (0.0008) [2023-12-26 06:44:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000894896_229097472.pth [2023-12-26 06:44:38,840][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000889792_227786752.pth... [2023-12-26 06:44:38,844][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000888736_227516416.pth [2023-12-26 06:44:38,979][123091] Updated weights for policy 0, policy_version 895896 (0.0010) [2023-12-26 06:44:39,034][123091] Updated weights for policy 0, policy_version 895906 (0.0005) [2023-12-26 06:44:39,102][123091] Updated weights for policy 0, policy_version 895916 (0.0006) [2023-12-26 06:44:39,663][123090] Updated weights for policy 1, policy_version 889793 (0.0009) [2023-12-26 06:44:39,732][123090] Updated weights for policy 1, policy_version 889803 (0.0008) [2023-12-26 06:44:39,789][123090] Updated weights for policy 1, policy_version 889813 (0.0009) [2023-12-26 06:44:39,855][123090] Updated weights for policy 1, policy_version 889823 (0.0009) [2023-12-26 06:44:39,905][123091] Updated weights for policy 0, policy_version 895926 (0.0006) [2023-12-26 06:44:39,977][123091] Updated weights for policy 0, policy_version 895936 (0.0006) [2023-12-26 06:44:40,047][123091] Updated weights for policy 0, policy_version 895946 (0.0008) [2023-12-26 06:44:40,634][123090] Updated weights for policy 1, policy_version 889833 (0.0008) [2023-12-26 06:44:40,687][123090] Updated weights for policy 1, policy_version 889843 (0.0009) [2023-12-26 06:44:40,743][123090] Updated weights for policy 1, policy_version 889853 (0.0009) [2023-12-26 06:44:40,832][123091] Updated weights for policy 0, policy_version 895956 (0.0010) [2023-12-26 06:44:40,884][123091] Updated weights for policy 0, policy_version 895966 (0.0006) [2023-12-26 06:44:40,934][123091] Updated weights for policy 0, policy_version 895976 (0.0005) [2023-12-26 06:44:41,682][123090] Updated weights for policy 1, policy_version 889863 (0.0009) [2023-12-26 06:44:41,732][123091] Updated weights for policy 0, policy_version 895986 (0.0009) [2023-12-26 06:44:41,753][123090] Updated weights for policy 1, policy_version 889873 (0.0009) [2023-12-26 06:44:41,806][123091] Updated weights for policy 0, policy_version 895996 (0.0007) [2023-12-26 06:44:41,819][123090] Updated weights for policy 1, policy_version 889883 (0.0007) [2023-12-26 06:44:41,873][123091] Updated weights for policy 0, policy_version 896006 (0.0010) [2023-12-26 06:44:41,937][123091] Updated weights for policy 0, policy_version 896016 (0.0010) [2023-12-26 06:44:42,599][123090] Updated weights for policy 1, policy_version 889893 (0.0008) [2023-12-26 06:44:42,646][123090] Updated weights for policy 1, policy_version 889903 (0.0005) [2023-12-26 06:44:42,704][123090] Updated weights for policy 1, policy_version 889913 (0.0006) [2023-12-26 06:44:42,739][123091] Updated weights for policy 0, policy_version 896026 (0.0011) [2023-12-26 06:44:42,806][123091] Updated weights for policy 0, policy_version 896036 (0.0011) [2023-12-26 06:44:42,865][123091] Updated weights for policy 0, policy_version 896046 (0.0010) [2023-12-26 06:44:43,516][123090] Updated weights for policy 1, policy_version 889923 (0.0007) [2023-12-26 06:44:43,563][123090] Updated weights for policy 1, policy_version 889933 (0.0010) [2023-12-26 06:44:43,623][123091] Updated weights for policy 0, policy_version 896056 (0.0006) [2023-12-26 06:44:43,626][123090] Updated weights for policy 1, policy_version 889943 (0.0009) [2023-12-26 06:44:43,685][123091] Updated weights for policy 0, policy_version 896066 (0.0006) [2023-12-26 06:44:43,754][123091] Updated weights for policy 0, policy_version 896076 (0.0011) [2023-12-26 06:44:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 457228288. Throughput: 0: 8745.1, 1: 8869.0. Samples: 457215400. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:43,785][121949] Avg episode reward: [(0, '5901.229'), (1, '5553.252')] [2023-12-26 06:44:44,414][123090] Updated weights for policy 1, policy_version 889953 (0.0006) [2023-12-26 06:44:44,474][123090] Updated weights for policy 1, policy_version 889963 (0.0007) [2023-12-26 06:44:44,528][123090] Updated weights for policy 1, policy_version 889973 (0.0008) [2023-12-26 06:44:44,534][123091] Updated weights for policy 0, policy_version 896086 (0.0009) [2023-12-26 06:44:44,582][123091] Updated weights for policy 0, policy_version 896096 (0.0007) [2023-12-26 06:44:44,592][123090] Updated weights for policy 1, policy_version 889983 (0.0008) [2023-12-26 06:44:44,633][123091] Updated weights for policy 0, policy_version 896106 (0.0008) [2023-12-26 06:44:45,424][123090] Updated weights for policy 1, policy_version 889993 (0.0010) [2023-12-26 06:44:45,471][123091] Updated weights for policy 0, policy_version 896116 (0.0007) [2023-12-26 06:44:45,483][123090] Updated weights for policy 1, policy_version 890003 (0.0009) [2023-12-26 06:44:45,530][123091] Updated weights for policy 0, policy_version 896126 (0.0005) [2023-12-26 06:44:45,561][123090] Updated weights for policy 1, policy_version 890013 (0.0009) [2023-12-26 06:44:45,597][123091] Updated weights for policy 0, policy_version 896136 (0.0006) [2023-12-26 06:44:46,262][123091] Updated weights for policy 0, policy_version 896146 (0.0006) [2023-12-26 06:44:46,312][123091] Updated weights for policy 0, policy_version 896156 (0.0005) [2023-12-26 06:44:46,358][123091] Updated weights for policy 0, policy_version 896166 (0.0005) [2023-12-26 06:44:46,388][123090] Updated weights for policy 1, policy_version 890023 (0.0008) [2023-12-26 06:44:46,415][123091] Updated weights for policy 0, policy_version 896176 (0.0007) [2023-12-26 06:44:46,445][123090] Updated weights for policy 1, policy_version 890033 (0.0008) [2023-12-26 06:44:46,497][123090] Updated weights for policy 1, policy_version 890043 (0.0010) [2023-12-26 06:44:47,099][123091] Updated weights for policy 0, policy_version 896186 (0.0006) [2023-12-26 06:44:47,151][123091] Updated weights for policy 0, policy_version 896196 (0.0005) [2023-12-26 06:44:47,215][123091] Updated weights for policy 0, policy_version 896206 (0.0007) [2023-12-26 06:44:47,346][123090] Updated weights for policy 1, policy_version 890053 (0.0009) [2023-12-26 06:44:47,403][123090] Updated weights for policy 1, policy_version 890063 (0.0010) [2023-12-26 06:44:47,460][123090] Updated weights for policy 1, policy_version 890073 (0.0010) [2023-12-26 06:44:47,921][123091] Updated weights for policy 0, policy_version 896216 (0.0008) [2023-12-26 06:44:47,991][123091] Updated weights for policy 0, policy_version 896226 (0.0008) [2023-12-26 06:44:48,058][123091] Updated weights for policy 0, policy_version 896236 (0.0009) [2023-12-26 06:44:48,240][123090] Updated weights for policy 1, policy_version 890083 (0.0010) [2023-12-26 06:44:48,288][123090] Updated weights for policy 1, policy_version 890093 (0.0009) [2023-12-26 06:44:48,349][123090] Updated weights for policy 1, policy_version 890103 (0.0009) [2023-12-26 06:44:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 457310208. Throughput: 0: 8753.9, 1: 8899.5. Samples: 457323828. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:48,785][121949] Avg episode reward: [(0, '6082.241'), (1, '5413.101')] [2023-12-26 06:44:48,847][123091] Updated weights for policy 0, policy_version 896246 (0.0010) [2023-12-26 06:44:48,909][123091] Updated weights for policy 0, policy_version 896256 (0.0010) [2023-12-26 06:44:48,972][123091] Updated weights for policy 0, policy_version 896266 (0.0010) [2023-12-26 06:44:49,208][123090] Updated weights for policy 1, policy_version 890113 (0.0009) [2023-12-26 06:44:49,277][123090] Updated weights for policy 1, policy_version 890123 (0.0008) [2023-12-26 06:44:49,364][123090] Updated weights for policy 1, policy_version 890133 (0.0009) [2023-12-26 06:44:49,427][123090] Updated weights for policy 1, policy_version 890143 (0.0010) [2023-12-26 06:44:49,765][123091] Updated weights for policy 0, policy_version 896276 (0.0008) [2023-12-26 06:44:49,819][123091] Updated weights for policy 0, policy_version 896286 (0.0008) [2023-12-26 06:44:49,880][123091] Updated weights for policy 0, policy_version 896296 (0.0009) [2023-12-26 06:44:50,166][123090] Updated weights for policy 1, policy_version 890153 (0.0010) [2023-12-26 06:44:50,230][123090] Updated weights for policy 1, policy_version 890163 (0.0009) [2023-12-26 06:44:50,305][123090] Updated weights for policy 1, policy_version 890173 (0.0006) [2023-12-26 06:44:50,724][123091] Updated weights for policy 0, policy_version 896306 (0.0009) [2023-12-26 06:44:50,774][123091] Updated weights for policy 0, policy_version 896316 (0.0009) [2023-12-26 06:44:50,828][123091] Updated weights for policy 0, policy_version 896326 (0.0009) [2023-12-26 06:44:50,880][123091] Updated weights for policy 0, policy_version 896336 (0.0009) [2023-12-26 06:44:51,073][123090] Updated weights for policy 1, policy_version 890183 (0.0008) [2023-12-26 06:44:51,133][123090] Updated weights for policy 1, policy_version 890193 (0.0008) [2023-12-26 06:44:51,194][123090] Updated weights for policy 1, policy_version 890203 (0.0007) [2023-12-26 06:44:51,810][123091] Updated weights for policy 0, policy_version 896346 (0.0006) [2023-12-26 06:44:51,872][123091] Updated weights for policy 0, policy_version 896356 (0.0006) [2023-12-26 06:44:51,928][123091] Updated weights for policy 0, policy_version 896366 (0.0010) [2023-12-26 06:44:51,970][123090] Updated weights for policy 1, policy_version 890213 (0.0009) [2023-12-26 06:44:52,023][123090] Updated weights for policy 1, policy_version 890223 (0.0008) [2023-12-26 06:44:52,075][123090] Updated weights for policy 1, policy_version 890233 (0.0010) [2023-12-26 06:44:52,800][123091] Updated weights for policy 0, policy_version 896376 (0.0009) [2023-12-26 06:44:52,810][123090] Updated weights for policy 1, policy_version 890243 (0.0006) [2023-12-26 06:44:52,860][123090] Updated weights for policy 1, policy_version 890253 (0.0007) [2023-12-26 06:44:52,865][123091] Updated weights for policy 0, policy_version 896386 (0.0009) [2023-12-26 06:44:52,916][123090] Updated weights for policy 1, policy_version 890263 (0.0006) [2023-12-26 06:44:52,923][123091] Updated weights for policy 0, policy_version 896396 (0.0009) [2023-12-26 06:44:53,551][123090] Updated weights for policy 1, policy_version 890273 (0.0006) [2023-12-26 06:44:53,613][123090] Updated weights for policy 1, policy_version 890283 (0.0007) [2023-12-26 06:44:53,683][123090] Updated weights for policy 1, policy_version 890293 (0.0005) [2023-12-26 06:44:53,754][123090] Updated weights for policy 1, policy_version 890303 (0.0005) [2023-12-26 06:44:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 457400320. Throughput: 0: 8719.6, 1: 8891.2. Samples: 457375832. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:53,785][121949] Avg episode reward: [(0, '6151.377'), (1, '5484.990')] [2023-12-26 06:44:53,785][123091] Updated weights for policy 0, policy_version 896406 (0.0009) [2023-12-26 06:44:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000890304_227917824.pth... [2023-12-26 06:44:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000889248_227647488.pth [2023-12-26 06:44:53,838][123091] Updated weights for policy 0, policy_version 896416 (0.0009) [2023-12-26 06:44:53,905][123091] Updated weights for policy 0, policy_version 896426 (0.0009) [2023-12-26 06:44:53,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000896432_229490688.pth... [2023-12-26 06:44:53,952][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000895408_229228544.pth [2023-12-26 06:44:54,423][123090] Updated weights for policy 1, policy_version 890313 (0.0009) [2023-12-26 06:44:54,482][123090] Updated weights for policy 1, policy_version 890323 (0.0009) [2023-12-26 06:44:54,553][123090] Updated weights for policy 1, policy_version 890333 (0.0007) [2023-12-26 06:44:54,832][123091] Updated weights for policy 0, policy_version 896436 (0.0010) [2023-12-26 06:44:54,888][123091] Updated weights for policy 0, policy_version 896446 (0.0009) [2023-12-26 06:44:54,957][123091] Updated weights for policy 0, policy_version 896456 (0.0010) [2023-12-26 06:44:55,368][123090] Updated weights for policy 1, policy_version 890343 (0.0009) [2023-12-26 06:44:55,432][123090] Updated weights for policy 1, policy_version 890353 (0.0008) [2023-12-26 06:44:55,490][123090] Updated weights for policy 1, policy_version 890363 (0.0005) [2023-12-26 06:44:55,680][123091] Updated weights for policy 0, policy_version 896466 (0.0009) [2023-12-26 06:44:55,741][123091] Updated weights for policy 0, policy_version 896476 (0.0005) [2023-12-26 06:44:55,787][123091] Updated weights for policy 0, policy_version 896486 (0.0005) [2023-12-26 06:44:55,845][123091] Updated weights for policy 0, policy_version 896496 (0.0005) [2023-12-26 06:44:56,210][123090] Updated weights for policy 1, policy_version 890373 (0.0006) [2023-12-26 06:44:56,258][123090] Updated weights for policy 1, policy_version 890383 (0.0006) [2023-12-26 06:44:56,307][123090] Updated weights for policy 1, policy_version 890393 (0.0009) [2023-12-26 06:44:56,511][123091] Updated weights for policy 0, policy_version 896506 (0.0010) [2023-12-26 06:44:56,573][123091] Updated weights for policy 0, policy_version 896516 (0.0010) [2023-12-26 06:44:56,635][123091] Updated weights for policy 0, policy_version 896526 (0.0011) [2023-12-26 06:44:57,031][123090] Updated weights for policy 1, policy_version 890403 (0.0010) [2023-12-26 06:44:57,083][123090] Updated weights for policy 1, policy_version 890413 (0.0010) [2023-12-26 06:44:57,139][123090] Updated weights for policy 1, policy_version 890423 (0.0010) [2023-12-26 06:44:57,370][123091] Updated weights for policy 0, policy_version 896536 (0.0011) [2023-12-26 06:44:57,428][123091] Updated weights for policy 0, policy_version 896546 (0.0011) [2023-12-26 06:44:57,490][123091] Updated weights for policy 0, policy_version 896556 (0.0010) [2023-12-26 06:44:57,980][123090] Updated weights for policy 1, policy_version 890433 (0.0010) [2023-12-26 06:44:58,038][123090] Updated weights for policy 1, policy_version 890443 (0.0009) [2023-12-26 06:44:58,093][123090] Updated weights for policy 1, policy_version 890453 (0.0008) [2023-12-26 06:44:58,153][123090] Updated weights for policy 1, policy_version 890463 (0.0010) [2023-12-26 06:44:58,410][123091] Updated weights for policy 0, policy_version 896566 (0.0009) [2023-12-26 06:44:58,481][123091] Updated weights for policy 0, policy_version 896576 (0.0008) [2023-12-26 06:44:58,550][123091] Updated weights for policy 0, policy_version 896586 (0.0008) [2023-12-26 06:44:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 457490432. Throughput: 0: 8726.4, 1: 9011.1. Samples: 457485936. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:44:58,785][121949] Avg episode reward: [(0, '6091.206'), (1, '5650.204')] [2023-12-26 06:44:59,038][123090] Updated weights for policy 1, policy_version 890473 (0.0008) [2023-12-26 06:44:59,108][123090] Updated weights for policy 1, policy_version 890483 (0.0008) [2023-12-26 06:44:59,180][123090] Updated weights for policy 1, policy_version 890493 (0.0008) [2023-12-26 06:44:59,312][123091] Updated weights for policy 0, policy_version 896596 (0.0009) [2023-12-26 06:44:59,371][123091] Updated weights for policy 0, policy_version 896606 (0.0010) [2023-12-26 06:44:59,443][123091] Updated weights for policy 0, policy_version 896616 (0.0009) [2023-12-26 06:44:59,990][123090] Updated weights for policy 1, policy_version 890503 (0.0009) [2023-12-26 06:45:00,046][123090] Updated weights for policy 1, policy_version 890513 (0.0009) [2023-12-26 06:45:00,100][123090] Updated weights for policy 1, policy_version 890523 (0.0009) [2023-12-26 06:45:00,247][123091] Updated weights for policy 0, policy_version 896626 (0.0009) [2023-12-26 06:45:00,297][123091] Updated weights for policy 0, policy_version 896636 (0.0009) [2023-12-26 06:45:00,359][123091] Updated weights for policy 0, policy_version 896646 (0.0009) [2023-12-26 06:45:00,424][123091] Updated weights for policy 0, policy_version 896656 (0.0010) [2023-12-26 06:45:00,936][123090] Updated weights for policy 1, policy_version 890533 (0.0009) [2023-12-26 06:45:01,007][123090] Updated weights for policy 1, policy_version 890543 (0.0007) [2023-12-26 06:45:01,079][123090] Updated weights for policy 1, policy_version 890553 (0.0007) [2023-12-26 06:45:01,242][123091] Updated weights for policy 0, policy_version 896666 (0.0008) [2023-12-26 06:45:01,311][123091] Updated weights for policy 0, policy_version 896676 (0.0009) [2023-12-26 06:45:01,377][123091] Updated weights for policy 0, policy_version 896686 (0.0010) [2023-12-26 06:45:01,906][123090] Updated weights for policy 1, policy_version 890563 (0.0008) [2023-12-26 06:45:01,971][123090] Updated weights for policy 1, policy_version 890573 (0.0009) [2023-12-26 06:45:02,049][123090] Updated weights for policy 1, policy_version 890583 (0.0006) [2023-12-26 06:45:02,235][123091] Updated weights for policy 0, policy_version 896696 (0.0011) [2023-12-26 06:45:02,297][123091] Updated weights for policy 0, policy_version 896706 (0.0008) [2023-12-26 06:45:02,355][123091] Updated weights for policy 0, policy_version 896716 (0.0010) [2023-12-26 06:45:02,873][123090] Updated weights for policy 1, policy_version 890593 (0.0006) [2023-12-26 06:45:02,927][123090] Updated weights for policy 1, policy_version 890603 (0.0010) [2023-12-26 06:45:02,976][123090] Updated weights for policy 1, policy_version 890613 (0.0009) [2023-12-26 06:45:03,025][123090] Updated weights for policy 1, policy_version 890623 (0.0009) [2023-12-26 06:45:03,076][123091] Updated weights for policy 0, policy_version 896726 (0.0007) [2023-12-26 06:45:03,143][123091] Updated weights for policy 0, policy_version 896736 (0.0007) [2023-12-26 06:45:03,206][123091] Updated weights for policy 0, policy_version 896746 (0.0008) [2023-12-26 06:45:03,705][123090] Updated weights for policy 1, policy_version 890633 (0.0005) [2023-12-26 06:45:03,757][123090] Updated weights for policy 1, policy_version 890643 (0.0009) [2023-12-26 06:45:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 457572352. Throughput: 0: 8678.6, 1: 8953.5. Samples: 457590020. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:03,785][121949] Avg episode reward: [(0, '6040.114'), (1, '5725.109')] [2023-12-26 06:45:03,810][123090] Updated weights for policy 1, policy_version 890654 (0.0010) [2023-12-26 06:45:03,868][123091] Updated weights for policy 0, policy_version 896756 (0.0008) [2023-12-26 06:45:03,927][123091] Updated weights for policy 0, policy_version 896766 (0.0006) [2023-12-26 06:45:03,985][123091] Updated weights for policy 0, policy_version 896776 (0.0005) [2023-12-26 06:45:04,643][123090] Updated weights for policy 1, policy_version 890664 (0.0009) [2023-12-26 06:45:04,700][123090] Updated weights for policy 1, policy_version 890674 (0.0009) [2023-12-26 06:45:04,761][123090] Updated weights for policy 1, policy_version 890684 (0.0009) [2023-12-26 06:45:04,791][123091] Updated weights for policy 0, policy_version 896786 (0.0009) [2023-12-26 06:45:04,839][123091] Updated weights for policy 0, policy_version 896796 (0.0010) [2023-12-26 06:45:04,883][123091] Updated weights for policy 0, policy_version 896806 (0.0010) [2023-12-26 06:45:04,944][123091] Updated weights for policy 0, policy_version 896816 (0.0008) [2023-12-26 06:45:05,531][123090] Updated weights for policy 1, policy_version 890694 (0.0006) [2023-12-26 06:45:05,579][123090] Updated weights for policy 1, policy_version 890704 (0.0005) [2023-12-26 06:45:05,633][123090] Updated weights for policy 1, policy_version 890714 (0.0008) [2023-12-26 06:45:05,762][123091] Updated weights for policy 0, policy_version 896826 (0.0005) [2023-12-26 06:45:05,814][123091] Updated weights for policy 0, policy_version 896836 (0.0008) [2023-12-26 06:45:05,868][123091] Updated weights for policy 0, policy_version 896846 (0.0010) [2023-12-26 06:45:06,327][123090] Updated weights for policy 1, policy_version 890724 (0.0010) [2023-12-26 06:45:06,395][123090] Updated weights for policy 1, policy_version 890734 (0.0009) [2023-12-26 06:45:06,457][123090] Updated weights for policy 1, policy_version 890744 (0.0009) [2023-12-26 06:45:06,710][123091] Updated weights for policy 0, policy_version 896856 (0.0007) [2023-12-26 06:45:06,772][123091] Updated weights for policy 0, policy_version 896866 (0.0010) [2023-12-26 06:45:06,835][123091] Updated weights for policy 0, policy_version 896876 (0.0010) [2023-12-26 06:45:07,250][123090] Updated weights for policy 1, policy_version 890754 (0.0009) [2023-12-26 06:45:07,327][123090] Updated weights for policy 1, policy_version 890764 (0.0006) [2023-12-26 06:45:07,387][123090] Updated weights for policy 1, policy_version 890774 (0.0010) [2023-12-26 06:45:07,458][123090] Updated weights for policy 1, policy_version 890784 (0.0010) [2023-12-26 06:45:07,631][123091] Updated weights for policy 0, policy_version 896886 (0.0010) [2023-12-26 06:45:07,697][123091] Updated weights for policy 0, policy_version 896896 (0.0010) [2023-12-26 06:45:07,763][123091] Updated weights for policy 0, policy_version 896906 (0.0011) [2023-12-26 06:45:08,124][123090] Updated weights for policy 1, policy_version 890794 (0.0006) [2023-12-26 06:45:08,190][123090] Updated weights for policy 1, policy_version 890804 (0.0010) [2023-12-26 06:45:08,260][123090] Updated weights for policy 1, policy_version 890814 (0.0010) [2023-12-26 06:45:08,535][123091] Updated weights for policy 0, policy_version 896916 (0.0011) [2023-12-26 06:45:08,594][123091] Updated weights for policy 0, policy_version 896926 (0.0011) [2023-12-26 06:45:08,656][123091] Updated weights for policy 0, policy_version 896936 (0.0011) [2023-12-26 06:45:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 457670656. Throughput: 0: 8720.0, 1: 8963.0. Samples: 457643440. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:08,785][121949] Avg episode reward: [(0, '6087.277'), (1, '5743.296')] [2023-12-26 06:45:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000896944_229621760.pth... [2023-12-26 06:45:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000890816_228048896.pth... [2023-12-26 06:45:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000895888_229351424.pth [2023-12-26 06:45:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000889792_227786752.pth [2023-12-26 06:45:09,055][123090] Updated weights for policy 1, policy_version 890824 (0.0011) [2023-12-26 06:45:09,111][123090] Updated weights for policy 1, policy_version 890834 (0.0010) [2023-12-26 06:45:09,170][123090] Updated weights for policy 1, policy_version 890844 (0.0010) [2023-12-26 06:45:09,494][123091] Updated weights for policy 0, policy_version 896946 (0.0010) [2023-12-26 06:45:09,558][123091] Updated weights for policy 0, policy_version 896956 (0.0009) [2023-12-26 06:45:09,640][123091] Updated weights for policy 0, policy_version 896966 (0.0006) [2023-12-26 06:45:09,721][123091] Updated weights for policy 0, policy_version 896976 (0.0006) [2023-12-26 06:45:10,002][123090] Updated weights for policy 1, policy_version 890854 (0.0010) [2023-12-26 06:45:10,077][123090] Updated weights for policy 1, policy_version 890864 (0.0010) [2023-12-26 06:45:10,150][123090] Updated weights for policy 1, policy_version 890874 (0.0009) [2023-12-26 06:45:10,396][123091] Updated weights for policy 0, policy_version 896986 (0.0009) [2023-12-26 06:45:10,465][123091] Updated weights for policy 0, policy_version 896996 (0.0009) [2023-12-26 06:45:10,520][123091] Updated weights for policy 0, policy_version 897006 (0.0008) [2023-12-26 06:45:11,015][123090] Updated weights for policy 1, policy_version 890884 (0.0008) [2023-12-26 06:45:11,091][123090] Updated weights for policy 1, policy_version 890894 (0.0008) [2023-12-26 06:45:11,162][123090] Updated weights for policy 1, policy_version 890904 (0.0008) [2023-12-26 06:45:11,357][123091] Updated weights for policy 0, policy_version 897016 (0.0009) [2023-12-26 06:45:11,431][123091] Updated weights for policy 0, policy_version 897026 (0.0009) [2023-12-26 06:45:11,489][123091] Updated weights for policy 0, policy_version 897036 (0.0010) [2023-12-26 06:45:11,998][123090] Updated weights for policy 1, policy_version 890914 (0.0008) [2023-12-26 06:45:12,069][123090] Updated weights for policy 1, policy_version 890924 (0.0006) [2023-12-26 06:45:12,139][123090] Updated weights for policy 1, policy_version 890934 (0.0008) [2023-12-26 06:45:12,201][123090] Updated weights for policy 1, policy_version 890944 (0.0009) [2023-12-26 06:45:12,397][123091] Updated weights for policy 0, policy_version 897046 (0.0009) [2023-12-26 06:45:12,459][123091] Updated weights for policy 0, policy_version 897056 (0.0009) [2023-12-26 06:45:12,519][123091] Updated weights for policy 0, policy_version 897066 (0.0009) [2023-12-26 06:45:13,016][123090] Updated weights for policy 1, policy_version 890954 (0.0007) [2023-12-26 06:45:13,094][123090] Updated weights for policy 1, policy_version 890964 (0.0008) [2023-12-26 06:45:13,169][123090] Updated weights for policy 1, policy_version 890974 (0.0009) [2023-12-26 06:45:13,371][123091] Updated weights for policy 0, policy_version 897077 (0.0010) [2023-12-26 06:45:13,435][123091] Updated weights for policy 0, policy_version 897087 (0.0010) [2023-12-26 06:45:13,500][123091] Updated weights for policy 0, policy_version 897097 (0.0010) [2023-12-26 06:45:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 457752576. Throughput: 0: 8701.9, 1: 8907.2. Samples: 457746516. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:13,785][121949] Avg episode reward: [(0, '6060.634'), (1, '5687.594')] [2023-12-26 06:45:13,940][123090] Updated weights for policy 1, policy_version 890984 (0.0006) [2023-12-26 06:45:14,003][123090] Updated weights for policy 1, policy_version 890994 (0.0010) [2023-12-26 06:45:14,060][123090] Updated weights for policy 1, policy_version 891004 (0.0009) [2023-12-26 06:45:14,340][123091] Updated weights for policy 0, policy_version 897107 (0.0010) [2023-12-26 06:45:14,407][123091] Updated weights for policy 0, policy_version 897117 (0.0010) [2023-12-26 06:45:14,472][123091] Updated weights for policy 0, policy_version 897127 (0.0009) [2023-12-26 06:45:14,913][123090] Updated weights for policy 1, policy_version 891014 (0.0009) [2023-12-26 06:45:14,978][123090] Updated weights for policy 1, policy_version 891024 (0.0010) [2023-12-26 06:45:15,042][123090] Updated weights for policy 1, policy_version 891034 (0.0010) [2023-12-26 06:45:15,335][123091] Updated weights for policy 0, policy_version 897137 (0.0010) [2023-12-26 06:45:15,404][123091] Updated weights for policy 0, policy_version 897147 (0.0010) [2023-12-26 06:45:15,473][123091] Updated weights for policy 0, policy_version 897157 (0.0009) [2023-12-26 06:45:15,544][123091] Updated weights for policy 0, policy_version 897167 (0.0010) [2023-12-26 06:45:15,876][123090] Updated weights for policy 1, policy_version 891044 (0.0009) [2023-12-26 06:45:15,932][123090] Updated weights for policy 1, policy_version 891054 (0.0009) [2023-12-26 06:45:15,984][123090] Updated weights for policy 1, policy_version 891064 (0.0009) [2023-12-26 06:45:16,359][123091] Updated weights for policy 0, policy_version 897177 (0.0010) [2023-12-26 06:45:16,416][123091] Updated weights for policy 0, policy_version 897187 (0.0009) [2023-12-26 06:45:16,464][123091] Updated weights for policy 0, policy_version 897197 (0.0009) [2023-12-26 06:45:16,862][123090] Updated weights for policy 1, policy_version 891074 (0.0010) [2023-12-26 06:45:16,925][123090] Updated weights for policy 1, policy_version 891084 (0.0010) [2023-12-26 06:45:16,978][123090] Updated weights for policy 1, policy_version 891094 (0.0010) [2023-12-26 06:45:17,043][123090] Updated weights for policy 1, policy_version 891104 (0.0009) [2023-12-26 06:45:17,322][123091] Updated weights for policy 0, policy_version 897207 (0.0010) [2023-12-26 06:45:17,389][123091] Updated weights for policy 0, policy_version 897217 (0.0009) [2023-12-26 06:45:17,460][123091] Updated weights for policy 0, policy_version 897227 (0.0007) [2023-12-26 06:45:17,875][123090] Updated weights for policy 1, policy_version 891114 (0.0007) [2023-12-26 06:45:17,934][123090] Updated weights for policy 1, policy_version 891124 (0.0007) [2023-12-26 06:45:18,002][123090] Updated weights for policy 1, policy_version 891134 (0.0007) [2023-12-26 06:45:18,198][123091] Updated weights for policy 0, policy_version 897237 (0.0008) [2023-12-26 06:45:18,259][123091] Updated weights for policy 0, policy_version 897247 (0.0011) [2023-12-26 06:45:18,327][123091] Updated weights for policy 0, policy_version 897257 (0.0011) [2023-12-26 06:45:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 457834496. Throughput: 0: 8704.5, 1: 8807.4. Samples: 457848720. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:18,785][121949] Avg episode reward: [(0, '6149.560'), (1, '5612.614')] [2023-12-26 06:45:18,824][123090] Updated weights for policy 1, policy_version 891144 (0.0008) [2023-12-26 06:45:18,888][123090] Updated weights for policy 1, policy_version 891154 (0.0009) [2023-12-26 06:45:18,949][123090] Updated weights for policy 1, policy_version 891164 (0.0009) [2023-12-26 06:45:19,136][123091] Updated weights for policy 0, policy_version 897267 (0.0008) [2023-12-26 06:45:19,206][123091] Updated weights for policy 0, policy_version 897277 (0.0009) [2023-12-26 06:45:19,277][123091] Updated weights for policy 0, policy_version 897287 (0.0008) [2023-12-26 06:45:19,797][123090] Updated weights for policy 1, policy_version 891174 (0.0007) [2023-12-26 06:45:19,875][123090] Updated weights for policy 1, policy_version 891184 (0.0007) [2023-12-26 06:45:19,951][123090] Updated weights for policy 1, policy_version 891194 (0.0010) [2023-12-26 06:45:20,008][123091] Updated weights for policy 0, policy_version 897297 (0.0010) [2023-12-26 06:45:20,077][123091] Updated weights for policy 0, policy_version 897307 (0.0006) [2023-12-26 06:45:20,151][123091] Updated weights for policy 0, policy_version 897317 (0.0007) [2023-12-26 06:45:20,220][123091] Updated weights for policy 0, policy_version 897327 (0.0006) [2023-12-26 06:45:20,710][123090] Updated weights for policy 1, policy_version 891204 (0.0008) [2023-12-26 06:45:20,781][123090] Updated weights for policy 1, policy_version 891214 (0.0009) [2023-12-26 06:45:20,842][123090] Updated weights for policy 1, policy_version 891224 (0.0010) [2023-12-26 06:45:20,986][123091] Updated weights for policy 0, policy_version 897337 (0.0007) [2023-12-26 06:45:21,058][123091] Updated weights for policy 0, policy_version 897347 (0.0008) [2023-12-26 06:45:21,128][123091] Updated weights for policy 0, policy_version 897357 (0.0008) [2023-12-26 06:45:21,675][123090] Updated weights for policy 1, policy_version 891234 (0.0010) [2023-12-26 06:45:21,750][123090] Updated weights for policy 1, policy_version 891244 (0.0009) [2023-12-26 06:45:21,813][123090] Updated weights for policy 1, policy_version 891254 (0.0010) [2023-12-26 06:45:21,889][123090] Updated weights for policy 1, policy_version 891264 (0.0011) [2023-12-26 06:45:21,936][123091] Updated weights for policy 0, policy_version 897367 (0.0009) [2023-12-26 06:45:22,001][123091] Updated weights for policy 0, policy_version 897377 (0.0009) [2023-12-26 06:45:22,062][123091] Updated weights for policy 0, policy_version 897387 (0.0009) [2023-12-26 06:45:22,695][123090] Updated weights for policy 1, policy_version 891274 (0.0011) [2023-12-26 06:45:22,771][123090] Updated weights for policy 1, policy_version 891284 (0.0011) [2023-12-26 06:45:22,841][123091] Updated weights for policy 0, policy_version 897397 (0.0006) [2023-12-26 06:45:22,842][123090] Updated weights for policy 1, policy_version 891294 (0.0011) [2023-12-26 06:45:22,895][123091] Updated weights for policy 0, policy_version 897407 (0.0006) [2023-12-26 06:45:22,953][123091] Updated weights for policy 0, policy_version 897417 (0.0005) [2023-12-26 06:45:23,627][123090] Updated weights for policy 1, policy_version 891304 (0.0010) [2023-12-26 06:45:23,682][123090] Updated weights for policy 1, policy_version 891314 (0.0007) [2023-12-26 06:45:23,713][123091] Updated weights for policy 0, policy_version 897427 (0.0006) [2023-12-26 06:45:23,746][123090] Updated weights for policy 1, policy_version 891324 (0.0006) [2023-12-26 06:45:23,777][123091] Updated weights for policy 0, policy_version 897437 (0.0007) [2023-12-26 06:45:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 457924608. Throughput: 0: 8742.3, 1: 8786.7. Samples: 457900604. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:23,785][121949] Avg episode reward: [(0, '6115.380'), (1, '5478.916')] [2023-12-26 06:45:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000891328_228179968.pth... [2023-12-26 06:45:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000890304_227917824.pth [2023-12-26 06:45:23,833][123091] Updated weights for policy 0, policy_version 897447 (0.0009) [2023-12-26 06:45:23,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000897456_229752832.pth... [2023-12-26 06:45:23,891][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000896432_229490688.pth [2023-12-26 06:45:24,419][123090] Updated weights for policy 1, policy_version 891334 (0.0009) [2023-12-26 06:45:24,487][123090] Updated weights for policy 1, policy_version 891344 (0.0010) [2023-12-26 06:45:24,557][123090] Updated weights for policy 1, policy_version 891354 (0.0011) [2023-12-26 06:45:24,633][123091] Updated weights for policy 0, policy_version 897457 (0.0009) [2023-12-26 06:45:24,699][123091] Updated weights for policy 0, policy_version 897467 (0.0011) [2023-12-26 06:45:24,747][123091] Updated weights for policy 0, policy_version 897477 (0.0010) [2023-12-26 06:45:24,816][123091] Updated weights for policy 0, policy_version 897487 (0.0009) [2023-12-26 06:45:25,324][123090] Updated weights for policy 1, policy_version 891364 (0.0010) [2023-12-26 06:45:25,378][123090] Updated weights for policy 1, policy_version 891374 (0.0009) [2023-12-26 06:45:25,438][123090] Updated weights for policy 1, policy_version 891384 (0.0010) [2023-12-26 06:45:25,566][123091] Updated weights for policy 0, policy_version 897497 (0.0006) [2023-12-26 06:45:25,635][123091] Updated weights for policy 0, policy_version 897507 (0.0005) [2023-12-26 06:45:25,698][123091] Updated weights for policy 0, policy_version 897517 (0.0008) [2023-12-26 06:45:26,262][123090] Updated weights for policy 1, policy_version 891394 (0.0010) [2023-12-26 06:45:26,312][123090] Updated weights for policy 1, policy_version 891405 (0.0009) [2023-12-26 06:45:26,370][123090] Updated weights for policy 1, policy_version 891415 (0.0009) [2023-12-26 06:45:26,446][123091] Updated weights for policy 0, policy_version 897527 (0.0007) [2023-12-26 06:45:26,499][123091] Updated weights for policy 0, policy_version 897537 (0.0005) [2023-12-26 06:45:26,553][123091] Updated weights for policy 0, policy_version 897547 (0.0005) [2023-12-26 06:45:27,237][123090] Updated weights for policy 1, policy_version 891425 (0.0009) [2023-12-26 06:45:27,298][123090] Updated weights for policy 1, policy_version 891435 (0.0009) [2023-12-26 06:45:27,341][123091] Updated weights for policy 0, policy_version 897557 (0.0005) [2023-12-26 06:45:27,354][123090] Updated weights for policy 1, policy_version 891445 (0.0009) [2023-12-26 06:45:27,390][123091] Updated weights for policy 0, policy_version 897567 (0.0007) [2023-12-26 06:45:27,423][123090] Updated weights for policy 1, policy_version 891455 (0.0009) [2023-12-26 06:45:27,435][123091] Updated weights for policy 0, policy_version 897577 (0.0007) [2023-12-26 06:45:28,171][123091] Updated weights for policy 0, policy_version 897587 (0.0008) [2023-12-26 06:45:28,218][123091] Updated weights for policy 0, policy_version 897597 (0.0005) [2023-12-26 06:45:28,277][123091] Updated weights for policy 0, policy_version 897607 (0.0005) [2023-12-26 06:45:28,291][123090] Updated weights for policy 1, policy_version 891465 (0.0009) [2023-12-26 06:45:28,362][123090] Updated weights for policy 1, policy_version 891475 (0.0009) [2023-12-26 06:45:28,419][123090] Updated weights for policy 1, policy_version 891485 (0.0010) [2023-12-26 06:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 458014720. Throughput: 0: 8820.8, 1: 8798.5. Samples: 458008268. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:28,785][121949] Avg episode reward: [(0, '5992.490'), (1, '5397.756')] [2023-12-26 06:45:28,929][123091] Updated weights for policy 0, policy_version 897617 (0.0007) [2023-12-26 06:45:28,981][123091] Updated weights for policy 0, policy_version 897627 (0.0009) [2023-12-26 06:45:29,031][123091] Updated weights for policy 0, policy_version 897637 (0.0009) [2023-12-26 06:45:29,090][123091] Updated weights for policy 0, policy_version 897647 (0.0008) [2023-12-26 06:45:29,353][123090] Updated weights for policy 1, policy_version 891495 (0.0009) [2023-12-26 06:45:29,420][123090] Updated weights for policy 1, policy_version 891505 (0.0010) [2023-12-26 06:45:29,487][123090] Updated weights for policy 1, policy_version 891515 (0.0010) [2023-12-26 06:45:29,945][123091] Updated weights for policy 0, policy_version 897657 (0.0009) [2023-12-26 06:45:30,009][123091] Updated weights for policy 0, policy_version 897667 (0.0009) [2023-12-26 06:45:30,066][123091] Updated weights for policy 0, policy_version 897677 (0.0009) [2023-12-26 06:45:30,325][123090] Updated weights for policy 1, policy_version 891525 (0.0008) [2023-12-26 06:45:30,386][123090] Updated weights for policy 1, policy_version 891535 (0.0010) [2023-12-26 06:45:30,445][123090] Updated weights for policy 1, policy_version 891545 (0.0010) [2023-12-26 06:45:30,878][123091] Updated weights for policy 0, policy_version 897687 (0.0009) [2023-12-26 06:45:30,945][123091] Updated weights for policy 0, policy_version 897697 (0.0009) [2023-12-26 06:45:31,000][123091] Updated weights for policy 0, policy_version 897707 (0.0009) [2023-12-26 06:45:31,243][123090] Updated weights for policy 1, policy_version 891555 (0.0010) [2023-12-26 06:45:31,300][123090] Updated weights for policy 1, policy_version 891565 (0.0009) [2023-12-26 06:45:31,363][123090] Updated weights for policy 1, policy_version 891575 (0.0009) [2023-12-26 06:45:31,866][123091] Updated weights for policy 0, policy_version 897717 (0.0009) [2023-12-26 06:45:31,928][123091] Updated weights for policy 0, policy_version 897727 (0.0009) [2023-12-26 06:45:31,996][123091] Updated weights for policy 0, policy_version 897737 (0.0009) [2023-12-26 06:45:32,142][123090] Updated weights for policy 1, policy_version 891585 (0.0007) [2023-12-26 06:45:32,195][123090] Updated weights for policy 1, policy_version 891595 (0.0009) [2023-12-26 06:45:32,253][123090] Updated weights for policy 1, policy_version 891605 (0.0010) [2023-12-26 06:45:32,322][123090] Updated weights for policy 1, policy_version 891615 (0.0010) [2023-12-26 06:45:32,751][123091] Updated weights for policy 0, policy_version 897747 (0.0008) [2023-12-26 06:45:32,816][123091] Updated weights for policy 0, policy_version 897757 (0.0009) [2023-12-26 06:45:32,874][123091] Updated weights for policy 0, policy_version 897767 (0.0009) [2023-12-26 06:45:33,191][123090] Updated weights for policy 1, policy_version 891625 (0.0009) [2023-12-26 06:45:33,253][123090] Updated weights for policy 1, policy_version 891635 (0.0009) [2023-12-26 06:45:33,315][123090] Updated weights for policy 1, policy_version 891645 (0.0009) [2023-12-26 06:45:33,666][123091] Updated weights for policy 0, policy_version 897777 (0.0010) [2023-12-26 06:45:33,718][123091] Updated weights for policy 0, policy_version 897787 (0.0011) [2023-12-26 06:45:33,782][123091] Updated weights for policy 0, policy_version 897797 (0.0011) [2023-12-26 06:45:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458096640. Throughput: 0: 8778.0, 1: 8751.6. Samples: 458112656. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:33,784][121949] Avg episode reward: [(0, '6040.575'), (1, '5481.564')] [2023-12-26 06:45:33,845][123091] Updated weights for policy 0, policy_version 897807 (0.0010) [2023-12-26 06:45:34,153][123090] Updated weights for policy 1, policy_version 891655 (0.0009) [2023-12-26 06:45:34,219][123090] Updated weights for policy 1, policy_version 891665 (0.0007) [2023-12-26 06:45:34,287][123090] Updated weights for policy 1, policy_version 891675 (0.0007) [2023-12-26 06:45:34,650][123091] Updated weights for policy 0, policy_version 897817 (0.0011) [2023-12-26 06:45:34,709][123091] Updated weights for policy 0, policy_version 897827 (0.0011) [2023-12-26 06:45:34,772][123091] Updated weights for policy 0, policy_version 897837 (0.0011) [2023-12-26 06:45:35,063][123090] Updated weights for policy 1, policy_version 891685 (0.0007) [2023-12-26 06:45:35,126][123090] Updated weights for policy 1, policy_version 891695 (0.0006) [2023-12-26 06:45:35,198][123090] Updated weights for policy 1, policy_version 891705 (0.0005) [2023-12-26 06:45:35,587][123091] Updated weights for policy 0, policy_version 897847 (0.0011) [2023-12-26 06:45:35,631][123091] Updated weights for policy 0, policy_version 897857 (0.0010) [2023-12-26 06:45:35,678][123091] Updated weights for policy 0, policy_version 897867 (0.0010) [2023-12-26 06:45:35,920][123090] Updated weights for policy 1, policy_version 891715 (0.0007) [2023-12-26 06:45:35,981][123090] Updated weights for policy 1, policy_version 891725 (0.0008) [2023-12-26 06:45:36,036][123090] Updated weights for policy 1, policy_version 891735 (0.0009) [2023-12-26 06:45:36,533][123091] Updated weights for policy 0, policy_version 897877 (0.0010) [2023-12-26 06:45:36,594][123091] Updated weights for policy 0, policy_version 897887 (0.0009) [2023-12-26 06:45:36,645][123091] Updated weights for policy 0, policy_version 897897 (0.0010) [2023-12-26 06:45:36,888][123090] Updated weights for policy 1, policy_version 891745 (0.0009) [2023-12-26 06:45:36,941][123090] Updated weights for policy 1, policy_version 891755 (0.0009) [2023-12-26 06:45:37,003][123090] Updated weights for policy 1, policy_version 891765 (0.0010) [2023-12-26 06:45:37,059][123090] Updated weights for policy 1, policy_version 891775 (0.0009) [2023-12-26 06:45:37,531][123091] Updated weights for policy 0, policy_version 897907 (0.0010) [2023-12-26 06:45:37,588][123091] Updated weights for policy 0, policy_version 897917 (0.0009) [2023-12-26 06:45:37,644][123091] Updated weights for policy 0, policy_version 897927 (0.0009) [2023-12-26 06:45:37,876][123090] Updated weights for policy 1, policy_version 891785 (0.0010) [2023-12-26 06:45:37,926][123090] Updated weights for policy 1, policy_version 891795 (0.0010) [2023-12-26 06:45:37,978][123090] Updated weights for policy 1, policy_version 891805 (0.0006) [2023-12-26 06:45:38,468][123091] Updated weights for policy 0, policy_version 897937 (0.0006) [2023-12-26 06:45:38,528][123091] Updated weights for policy 0, policy_version 897947 (0.0009) [2023-12-26 06:45:38,596][123091] Updated weights for policy 0, policy_version 897957 (0.0009) [2023-12-26 06:45:38,656][123091] Updated weights for policy 0, policy_version 897967 (0.0009) [2023-12-26 06:45:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 458186752. Throughput: 0: 8790.7, 1: 8734.6. Samples: 458164468. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 06:45:38,785][121949] Avg episode reward: [(0, '6232.123'), (1, '5433.204')] [2023-12-26 06:45:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000897968_229883904.pth... [2023-12-26 06:45:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000896944_229621760.pth [2023-12-26 06:45:38,803][123090] Updated weights for policy 1, policy_version 891815 (0.0009) [2023-12-26 06:45:38,873][123090] Updated weights for policy 1, policy_version 891825 (0.0011) [2023-12-26 06:45:38,937][123090] Updated weights for policy 1, policy_version 891835 (0.0011) [2023-12-26 06:45:38,970][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000891840_228311040.pth... [2023-12-26 06:45:38,975][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000890816_228048896.pth [2023-12-26 06:45:39,509][123091] Updated weights for policy 0, policy_version 897977 (0.0009) [2023-12-26 06:45:39,572][123091] Updated weights for policy 0, policy_version 897987 (0.0009) [2023-12-26 06:45:39,641][123091] Updated weights for policy 0, policy_version 897997 (0.0009) [2023-12-26 06:45:39,772][123090] Updated weights for policy 1, policy_version 891845 (0.0011) [2023-12-26 06:45:39,845][123090] Updated weights for policy 1, policy_version 891855 (0.0011) [2023-12-26 06:45:39,909][123090] Updated weights for policy 1, policy_version 891865 (0.0011) [2023-12-26 06:45:40,478][123091] Updated weights for policy 0, policy_version 898007 (0.0009) [2023-12-26 06:45:40,532][123091] Updated weights for policy 0, policy_version 898017 (0.0009) [2023-12-26 06:45:40,596][123091] Updated weights for policy 0, policy_version 898027 (0.0009) [2023-12-26 06:45:40,732][123090] Updated weights for policy 1, policy_version 891875 (0.0009) [2023-12-26 06:45:40,799][123090] Updated weights for policy 1, policy_version 891885 (0.0011) [2023-12-26 06:45:40,866][123090] Updated weights for policy 1, policy_version 891895 (0.0011) [2023-12-26 06:45:41,469][123091] Updated weights for policy 0, policy_version 898037 (0.0009) [2023-12-26 06:45:41,529][123091] Updated weights for policy 0, policy_version 898047 (0.0009) [2023-12-26 06:45:41,597][123091] Updated weights for policy 0, policy_version 898057 (0.0009) [2023-12-26 06:45:41,743][123090] Updated weights for policy 1, policy_version 891905 (0.0010) [2023-12-26 06:45:41,813][123090] Updated weights for policy 1, policy_version 891915 (0.0009) [2023-12-26 06:45:41,878][123090] Updated weights for policy 1, policy_version 891925 (0.0009) [2023-12-26 06:45:41,932][123090] Updated weights for policy 1, policy_version 891935 (0.0009) [2023-12-26 06:45:42,515][123091] Updated weights for policy 0, policy_version 898067 (0.0009) [2023-12-26 06:45:42,578][123091] Updated weights for policy 0, policy_version 898077 (0.0011) [2023-12-26 06:45:42,647][123091] Updated weights for policy 0, policy_version 898087 (0.0010) [2023-12-26 06:45:42,759][123090] Updated weights for policy 1, policy_version 891945 (0.0009) [2023-12-26 06:45:42,826][123090] Updated weights for policy 1, policy_version 891955 (0.0010) [2023-12-26 06:45:42,894][123090] Updated weights for policy 1, policy_version 891965 (0.0010) [2023-12-26 06:45:43,540][123091] Updated weights for policy 0, policy_version 898097 (0.0009) [2023-12-26 06:45:43,547][123090] Updated weights for policy 1, policy_version 891975 (0.0007) [2023-12-26 06:45:43,602][123091] Updated weights for policy 0, policy_version 898107 (0.0006) [2023-12-26 06:45:43,612][123090] Updated weights for policy 1, policy_version 891985 (0.0010) [2023-12-26 06:45:43,662][123090] Updated weights for policy 1, policy_version 891995 (0.0005) [2023-12-26 06:45:43,663][123091] Updated weights for policy 0, policy_version 898117 (0.0009) [2023-12-26 06:45:43,722][123091] Updated weights for policy 0, policy_version 898127 (0.0009) [2023-12-26 06:45:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 458276864. Throughput: 0: 8711.5, 1: 8596.3. Samples: 458264788. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:45:43,785][121949] Avg episode reward: [(0, '6311.594'), (1, '5547.630')] [2023-12-26 06:45:44,356][123090] Updated weights for policy 1, policy_version 892005 (0.0005) [2023-12-26 06:45:44,411][123090] Updated weights for policy 1, policy_version 892015 (0.0009) [2023-12-26 06:45:44,481][123090] Updated weights for policy 1, policy_version 892025 (0.0010) [2023-12-26 06:45:44,631][123091] Updated weights for policy 0, policy_version 898137 (0.0009) [2023-12-26 06:45:44,694][123091] Updated weights for policy 0, policy_version 898147 (0.0008) [2023-12-26 06:45:44,760][123091] Updated weights for policy 0, policy_version 898157 (0.0009) [2023-12-26 06:45:45,314][123090] Updated weights for policy 1, policy_version 892035 (0.0009) [2023-12-26 06:45:45,387][123090] Updated weights for policy 1, policy_version 892045 (0.0008) [2023-12-26 06:45:45,453][123090] Updated weights for policy 1, policy_version 892055 (0.0010) [2023-12-26 06:45:45,614][123091] Updated weights for policy 0, policy_version 898167 (0.0007) [2023-12-26 06:45:45,682][123091] Updated weights for policy 0, policy_version 898177 (0.0005) [2023-12-26 06:45:45,747][123091] Updated weights for policy 0, policy_version 898187 (0.0005) [2023-12-26 06:45:46,247][123090] Updated weights for policy 1, policy_version 892065 (0.0009) [2023-12-26 06:45:46,305][123090] Updated weights for policy 1, policy_version 892075 (0.0010) [2023-12-26 06:45:46,358][123090] Updated weights for policy 1, policy_version 892085 (0.0009) [2023-12-26 06:45:46,418][123090] Updated weights for policy 1, policy_version 892095 (0.0005) [2023-12-26 06:45:46,421][123091] Updated weights for policy 0, policy_version 898197 (0.0008) [2023-12-26 06:45:46,477][123091] Updated weights for policy 0, policy_version 898207 (0.0010) [2023-12-26 06:45:46,532][123091] Updated weights for policy 0, policy_version 898218 (0.0010) [2023-12-26 06:45:47,104][123090] Updated weights for policy 1, policy_version 892105 (0.0010) [2023-12-26 06:45:47,163][123090] Updated weights for policy 1, policy_version 892115 (0.0010) [2023-12-26 06:45:47,219][123090] Updated weights for policy 1, policy_version 892125 (0.0006) [2023-12-26 06:45:47,366][123091] Updated weights for policy 0, policy_version 898228 (0.0008) [2023-12-26 06:45:47,428][123091] Updated weights for policy 0, policy_version 898238 (0.0008) [2023-12-26 06:45:47,486][123091] Updated weights for policy 0, policy_version 898248 (0.0010) [2023-12-26 06:45:47,862][123090] Updated weights for policy 1, policy_version 892135 (0.0005) [2023-12-26 06:45:47,910][123090] Updated weights for policy 1, policy_version 892145 (0.0005) [2023-12-26 06:45:47,955][123090] Updated weights for policy 1, policy_version 892155 (0.0005) [2023-12-26 06:45:48,189][123091] Updated weights for policy 0, policy_version 898258 (0.0008) [2023-12-26 06:45:48,238][123091] Updated weights for policy 0, policy_version 898268 (0.0005) [2023-12-26 06:45:48,287][123091] Updated weights for policy 0, policy_version 898278 (0.0005) [2023-12-26 06:45:48,355][123091] Updated weights for policy 0, policy_version 898288 (0.0007) [2023-12-26 06:45:48,712][123090] Updated weights for policy 1, policy_version 892165 (0.0007) [2023-12-26 06:45:48,773][123090] Updated weights for policy 1, policy_version 892176 (0.0008) [2023-12-26 06:45:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458358784. Throughput: 0: 8706.8, 1: 8738.6. Samples: 458375064. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:45:48,785][121949] Avg episode reward: [(0, '6274.609'), (1, '5777.349')] [2023-12-26 06:45:48,839][123090] Updated weights for policy 1, policy_version 892186 (0.0006) [2023-12-26 06:45:49,151][123091] Updated weights for policy 0, policy_version 898298 (0.0008) [2023-12-26 06:45:49,210][123091] Updated weights for policy 0, policy_version 898308 (0.0009) [2023-12-26 06:45:49,279][123091] Updated weights for policy 0, policy_version 898318 (0.0010) [2023-12-26 06:45:49,624][123090] Updated weights for policy 1, policy_version 892196 (0.0007) [2023-12-26 06:45:49,685][123090] Updated weights for policy 1, policy_version 892206 (0.0008) [2023-12-26 06:45:49,754][123090] Updated weights for policy 1, policy_version 892216 (0.0010) [2023-12-26 06:45:50,145][123091] Updated weights for policy 0, policy_version 898328 (0.0009) [2023-12-26 06:45:50,214][123091] Updated weights for policy 0, policy_version 898338 (0.0009) [2023-12-26 06:45:50,272][123091] Updated weights for policy 0, policy_version 898348 (0.0009) [2023-12-26 06:45:50,570][123090] Updated weights for policy 1, policy_version 892226 (0.0009) [2023-12-26 06:45:50,649][123090] Updated weights for policy 1, policy_version 892236 (0.0007) [2023-12-26 06:45:50,713][123090] Updated weights for policy 1, policy_version 892246 (0.0011) [2023-12-26 06:45:50,769][123090] Updated weights for policy 1, policy_version 892256 (0.0011) [2023-12-26 06:45:51,137][123091] Updated weights for policy 0, policy_version 898358 (0.0010) [2023-12-26 06:45:51,195][123091] Updated weights for policy 0, policy_version 898368 (0.0011) [2023-12-26 06:45:51,255][123091] Updated weights for policy 0, policy_version 898378 (0.0011) [2023-12-26 06:45:51,589][123090] Updated weights for policy 1, policy_version 892266 (0.0011) [2023-12-26 06:45:51,660][123090] Updated weights for policy 1, policy_version 892276 (0.0009) [2023-12-26 06:45:51,729][123090] Updated weights for policy 1, policy_version 892286 (0.0007) [2023-12-26 06:45:52,091][123091] Updated weights for policy 0, policy_version 898388 (0.0010) [2023-12-26 06:45:52,143][123091] Updated weights for policy 0, policy_version 898398 (0.0009) [2023-12-26 06:45:52,206][123091] Updated weights for policy 0, policy_version 898408 (0.0009) [2023-12-26 06:45:52,555][123090] Updated weights for policy 1, policy_version 892296 (0.0009) [2023-12-26 06:45:52,613][123090] Updated weights for policy 1, policy_version 892306 (0.0010) [2023-12-26 06:45:52,675][123090] Updated weights for policy 1, policy_version 892316 (0.0009) [2023-12-26 06:45:52,945][123091] Updated weights for policy 0, policy_version 898418 (0.0007) [2023-12-26 06:45:53,015][123091] Updated weights for policy 0, policy_version 898428 (0.0006) [2023-12-26 06:45:53,083][123091] Updated weights for policy 0, policy_version 898438 (0.0005) [2023-12-26 06:45:53,148][123091] Updated weights for policy 0, policy_version 898448 (0.0006) [2023-12-26 06:45:53,503][123090] Updated weights for policy 1, policy_version 892326 (0.0007) [2023-12-26 06:45:53,555][123090] Updated weights for policy 1, policy_version 892336 (0.0005) [2023-12-26 06:45:53,603][123090] Updated weights for policy 1, policy_version 892346 (0.0005) [2023-12-26 06:45:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458448896. Throughput: 0: 8662.0, 1: 8730.0. Samples: 458426080. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:45:53,785][121949] Avg episode reward: [(0, '6223.698'), (1, '5683.975')] [2023-12-26 06:45:53,792][123091] Updated weights for policy 0, policy_version 898458 (0.0007) [2023-12-26 06:45:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000892352_228442112.pth... [2023-12-26 06:45:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000891328_228179968.pth [2023-12-26 06:45:53,848][123091] Updated weights for policy 0, policy_version 898468 (0.0006) [2023-12-26 06:45:53,905][123091] Updated weights for policy 0, policy_version 898478 (0.0006) [2023-12-26 06:45:53,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000898480_230014976.pth... [2023-12-26 06:45:53,924][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000897456_229752832.pth [2023-12-26 06:45:54,282][123090] Updated weights for policy 1, policy_version 892356 (0.0007) [2023-12-26 06:45:54,338][123090] Updated weights for policy 1, policy_version 892366 (0.0009) [2023-12-26 06:45:54,396][123090] Updated weights for policy 1, policy_version 892376 (0.0010) [2023-12-26 06:45:54,511][123091] Updated weights for policy 0, policy_version 898488 (0.0005) [2023-12-26 06:45:54,568][123091] Updated weights for policy 0, policy_version 898498 (0.0006) [2023-12-26 06:45:54,628][123091] Updated weights for policy 0, policy_version 898508 (0.0007) [2023-12-26 06:45:55,246][123090] Updated weights for policy 1, policy_version 892386 (0.0010) [2023-12-26 06:45:55,295][123090] Updated weights for policy 1, policy_version 892396 (0.0009) [2023-12-26 06:45:55,344][123090] Updated weights for policy 1, policy_version 892406 (0.0009) [2023-12-26 06:45:55,393][123091] Updated weights for policy 0, policy_version 898518 (0.0010) [2023-12-26 06:45:55,402][123090] Updated weights for policy 1, policy_version 892416 (0.0009) [2023-12-26 06:45:55,449][123091] Updated weights for policy 0, policy_version 898528 (0.0010) [2023-12-26 06:45:55,500][123091] Updated weights for policy 0, policy_version 898538 (0.0010) [2023-12-26 06:45:56,185][123091] Updated weights for policy 0, policy_version 898548 (0.0008) [2023-12-26 06:45:56,238][123091] Updated weights for policy 0, policy_version 898558 (0.0006) [2023-12-26 06:45:56,297][123091] Updated weights for policy 0, policy_version 898568 (0.0007) [2023-12-26 06:45:56,314][123090] Updated weights for policy 1, policy_version 892426 (0.0011) [2023-12-26 06:45:56,380][123090] Updated weights for policy 1, policy_version 892436 (0.0010) [2023-12-26 06:45:56,450][123090] Updated weights for policy 1, policy_version 892446 (0.0010) [2023-12-26 06:45:57,021][123091] Updated weights for policy 0, policy_version 898578 (0.0008) [2023-12-26 06:45:57,041][123090] Updated weights for policy 1, policy_version 892456 (0.0008) [2023-12-26 06:45:57,087][123091] Updated weights for policy 0, policy_version 898588 (0.0010) [2023-12-26 06:45:57,106][123090] Updated weights for policy 1, policy_version 892466 (0.0009) [2023-12-26 06:45:57,130][123091] Updated weights for policy 0, policy_version 898598 (0.0010) [2023-12-26 06:45:57,170][123090] Updated weights for policy 1, policy_version 892476 (0.0008) [2023-12-26 06:45:57,188][123091] Updated weights for policy 0, policy_version 898608 (0.0010) [2023-12-26 06:45:57,820][123091] Updated weights for policy 0, policy_version 898618 (0.0005) [2023-12-26 06:45:57,877][123091] Updated weights for policy 0, policy_version 898628 (0.0009) [2023-12-26 06:45:57,927][123091] Updated weights for policy 0, policy_version 898638 (0.0010) [2023-12-26 06:45:57,957][123090] Updated weights for policy 1, policy_version 892486 (0.0006) [2023-12-26 06:45:58,021][123090] Updated weights for policy 1, policy_version 892496 (0.0008) [2023-12-26 06:45:58,079][123090] Updated weights for policy 1, policy_version 892506 (0.0009) [2023-12-26 06:45:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458539008. Throughput: 0: 8830.4, 1: 8744.7. Samples: 458537396. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:45:58,785][121949] Avg episode reward: [(0, '6249.059'), (1, '5596.505')] [2023-12-26 06:45:58,814][123091] Updated weights for policy 0, policy_version 898648 (0.0009) [2023-12-26 06:45:58,882][123091] Updated weights for policy 0, policy_version 898658 (0.0010) [2023-12-26 06:45:58,944][123091] Updated weights for policy 0, policy_version 898668 (0.0009) [2023-12-26 06:45:59,070][123090] Updated weights for policy 1, policy_version 892516 (0.0010) [2023-12-26 06:45:59,135][123090] Updated weights for policy 1, policy_version 892526 (0.0010) [2023-12-26 06:45:59,197][123090] Updated weights for policy 1, policy_version 892536 (0.0010) [2023-12-26 06:45:59,764][123091] Updated weights for policy 0, policy_version 898678 (0.0010) [2023-12-26 06:45:59,825][123091] Updated weights for policy 0, policy_version 898688 (0.0010) [2023-12-26 06:45:59,891][123091] Updated weights for policy 0, policy_version 898698 (0.0010) [2023-12-26 06:46:00,048][123090] Updated weights for policy 1, policy_version 892546 (0.0009) [2023-12-26 06:46:00,113][123090] Updated weights for policy 1, policy_version 892557 (0.0010) [2023-12-26 06:46:00,178][123090] Updated weights for policy 1, policy_version 892567 (0.0009) [2023-12-26 06:46:00,666][123091] Updated weights for policy 0, policy_version 898708 (0.0008) [2023-12-26 06:46:00,713][123091] Updated weights for policy 0, policy_version 898718 (0.0005) [2023-12-26 06:46:00,775][123091] Updated weights for policy 0, policy_version 898728 (0.0006) [2023-12-26 06:46:01,029][123090] Updated weights for policy 1, policy_version 892577 (0.0009) [2023-12-26 06:46:01,098][123090] Updated weights for policy 1, policy_version 892587 (0.0009) [2023-12-26 06:46:01,169][123090] Updated weights for policy 1, policy_version 892597 (0.0009) [2023-12-26 06:46:01,228][123090] Updated weights for policy 1, policy_version 892607 (0.0009) [2023-12-26 06:46:01,595][123091] Updated weights for policy 0, policy_version 898738 (0.0010) [2023-12-26 06:46:01,664][123091] Updated weights for policy 0, policy_version 898748 (0.0011) [2023-12-26 06:46:01,733][123091] Updated weights for policy 0, policy_version 898758 (0.0011) [2023-12-26 06:46:01,789][123091] Updated weights for policy 0, policy_version 898768 (0.0011) [2023-12-26 06:46:02,058][123090] Updated weights for policy 1, policy_version 892617 (0.0010) [2023-12-26 06:46:02,125][123090] Updated weights for policy 1, policy_version 892627 (0.0010) [2023-12-26 06:46:02,196][123090] Updated weights for policy 1, policy_version 892637 (0.0010) [2023-12-26 06:46:02,623][123091] Updated weights for policy 0, policy_version 898778 (0.0011) [2023-12-26 06:46:02,687][123091] Updated weights for policy 0, policy_version 898788 (0.0010) [2023-12-26 06:46:02,740][123091] Updated weights for policy 0, policy_version 898798 (0.0011) [2023-12-26 06:46:02,959][123090] Updated weights for policy 1, policy_version 892647 (0.0010) [2023-12-26 06:46:03,010][123090] Updated weights for policy 1, policy_version 892657 (0.0010) [2023-12-26 06:46:03,058][123090] Updated weights for policy 1, policy_version 892667 (0.0007) [2023-12-26 06:46:03,491][123091] Updated weights for policy 0, policy_version 898808 (0.0006) [2023-12-26 06:46:03,537][123091] Updated weights for policy 0, policy_version 898818 (0.0005) [2023-12-26 06:46:03,588][123091] Updated weights for policy 0, policy_version 898828 (0.0005) [2023-12-26 06:46:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 458629120. Throughput: 0: 8882.0, 1: 8737.5. Samples: 458641600. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:03,785][121949] Avg episode reward: [(0, '6194.514'), (1, '5512.229')] [2023-12-26 06:46:03,835][123090] Updated weights for policy 1, policy_version 892677 (0.0006) [2023-12-26 06:46:03,908][123090] Updated weights for policy 1, policy_version 892687 (0.0007) [2023-12-26 06:46:03,982][123090] Updated weights for policy 1, policy_version 892697 (0.0011) [2023-12-26 06:46:04,206][123091] Updated weights for policy 0, policy_version 898838 (0.0007) [2023-12-26 06:46:04,270][123091] Updated weights for policy 0, policy_version 898848 (0.0008) [2023-12-26 06:46:04,344][123091] Updated weights for policy 0, policy_version 898858 (0.0009) [2023-12-26 06:46:04,745][123090] Updated weights for policy 1, policy_version 892707 (0.0009) [2023-12-26 06:46:04,808][123090] Updated weights for policy 1, policy_version 892717 (0.0008) [2023-12-26 06:46:04,868][123090] Updated weights for policy 1, policy_version 892727 (0.0010) [2023-12-26 06:46:05,141][123091] Updated weights for policy 0, policy_version 898868 (0.0011) [2023-12-26 06:46:05,189][123091] Updated weights for policy 0, policy_version 898878 (0.0010) [2023-12-26 06:46:05,240][123091] Updated weights for policy 0, policy_version 898888 (0.0010) [2023-12-26 06:46:05,665][123090] Updated weights for policy 1, policy_version 892737 (0.0010) [2023-12-26 06:46:05,726][123090] Updated weights for policy 1, policy_version 892747 (0.0005) [2023-12-26 06:46:05,772][123090] Updated weights for policy 1, policy_version 892757 (0.0005) [2023-12-26 06:46:05,827][123090] Updated weights for policy 1, policy_version 892767 (0.0009) [2023-12-26 06:46:06,082][123091] Updated weights for policy 0, policy_version 898898 (0.0011) [2023-12-26 06:46:06,156][123091] Updated weights for policy 0, policy_version 898908 (0.0011) [2023-12-26 06:46:06,223][123091] Updated weights for policy 0, policy_version 898918 (0.0011) [2023-12-26 06:46:06,295][123091] Updated weights for policy 0, policy_version 898928 (0.0011) [2023-12-26 06:46:06,555][123090] Updated weights for policy 1, policy_version 892777 (0.0011) [2023-12-26 06:46:06,610][123090] Updated weights for policy 1, policy_version 892787 (0.0010) [2023-12-26 06:46:06,671][123090] Updated weights for policy 1, policy_version 892797 (0.0009) [2023-12-26 06:46:07,080][123091] Updated weights for policy 0, policy_version 898938 (0.0010) [2023-12-26 06:46:07,138][123091] Updated weights for policy 0, policy_version 898948 (0.0010) [2023-12-26 06:46:07,194][123091] Updated weights for policy 0, policy_version 898958 (0.0009) [2023-12-26 06:46:07,365][123090] Updated weights for policy 1, policy_version 892807 (0.0006) [2023-12-26 06:46:07,419][123090] Updated weights for policy 1, policy_version 892817 (0.0006) [2023-12-26 06:46:07,476][123090] Updated weights for policy 1, policy_version 892827 (0.0011) [2023-12-26 06:46:08,046][123091] Updated weights for policy 0, policy_version 898968 (0.0009) [2023-12-26 06:46:08,105][123091] Updated weights for policy 0, policy_version 898978 (0.0008) [2023-12-26 06:46:08,166][123091] Updated weights for policy 0, policy_version 898988 (0.0010) [2023-12-26 06:46:08,325][123090] Updated weights for policy 1, policy_version 892837 (0.0010) [2023-12-26 06:46:08,392][123090] Updated weights for policy 1, policy_version 892847 (0.0007) [2023-12-26 06:46:08,453][123090] Updated weights for policy 1, policy_version 892857 (0.0008) [2023-12-26 06:46:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458719232. Throughput: 0: 8888.0, 1: 8780.5. Samples: 458695688. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:08,785][121949] Avg episode reward: [(0, '6117.288'), (1, '5436.333')] [2023-12-26 06:46:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000898992_230146048.pth... [2023-12-26 06:46:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000892864_228573184.pth... [2023-12-26 06:46:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000897968_229883904.pth [2023-12-26 06:46:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000891840_228311040.pth [2023-12-26 06:46:08,933][123091] Updated weights for policy 0, policy_version 898998 (0.0007) [2023-12-26 06:46:08,993][123091] Updated weights for policy 0, policy_version 899008 (0.0009) [2023-12-26 06:46:09,053][123091] Updated weights for policy 0, policy_version 899018 (0.0009) [2023-12-26 06:46:09,288][123090] Updated weights for policy 1, policy_version 892867 (0.0009) [2023-12-26 06:46:09,353][123090] Updated weights for policy 1, policy_version 892877 (0.0011) [2023-12-26 06:46:09,424][123090] Updated weights for policy 1, policy_version 892887 (0.0012) [2023-12-26 06:46:09,912][123091] Updated weights for policy 0, policy_version 899028 (0.0009) [2023-12-26 06:46:09,976][123091] Updated weights for policy 0, policy_version 899038 (0.0009) [2023-12-26 06:46:10,042][123091] Updated weights for policy 0, policy_version 899048 (0.0009) [2023-12-26 06:46:10,261][123090] Updated weights for policy 1, policy_version 892897 (0.0010) [2023-12-26 06:46:10,328][123090] Updated weights for policy 1, policy_version 892907 (0.0011) [2023-12-26 06:46:10,383][123090] Updated weights for policy 1, policy_version 892917 (0.0010) [2023-12-26 06:46:10,447][123090] Updated weights for policy 1, policy_version 892927 (0.0011) [2023-12-26 06:46:10,896][123091] Updated weights for policy 0, policy_version 899058 (0.0009) [2023-12-26 06:46:10,950][123091] Updated weights for policy 0, policy_version 899068 (0.0009) [2023-12-26 06:46:10,999][123091] Updated weights for policy 0, policy_version 899078 (0.0009) [2023-12-26 06:46:11,074][123091] Updated weights for policy 0, policy_version 899088 (0.0010) [2023-12-26 06:46:11,343][123090] Updated weights for policy 1, policy_version 892937 (0.0011) [2023-12-26 06:46:11,416][123090] Updated weights for policy 1, policy_version 892947 (0.0009) [2023-12-26 06:46:11,483][123090] Updated weights for policy 1, policy_version 892957 (0.0009) [2023-12-26 06:46:11,954][123091] Updated weights for policy 0, policy_version 899098 (0.0010) [2023-12-26 06:46:12,024][123091] Updated weights for policy 0, policy_version 899108 (0.0009) [2023-12-26 06:46:12,095][123091] Updated weights for policy 0, policy_version 899118 (0.0009) [2023-12-26 06:46:12,354][123090] Updated weights for policy 1, policy_version 892967 (0.0011) [2023-12-26 06:46:12,419][123090] Updated weights for policy 1, policy_version 892977 (0.0010) [2023-12-26 06:46:12,482][123090] Updated weights for policy 1, policy_version 892987 (0.0009) [2023-12-26 06:46:12,873][123091] Updated weights for policy 0, policy_version 899128 (0.0009) [2023-12-26 06:46:12,929][123091] Updated weights for policy 0, policy_version 899138 (0.0009) [2023-12-26 06:46:12,985][123091] Updated weights for policy 0, policy_version 899148 (0.0009) [2023-12-26 06:46:13,310][123090] Updated weights for policy 1, policy_version 892997 (0.0009) [2023-12-26 06:46:13,366][123090] Updated weights for policy 1, policy_version 893007 (0.0009) [2023-12-26 06:46:13,441][123090] Updated weights for policy 1, policy_version 893017 (0.0009) [2023-12-26 06:46:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 458801152. Throughput: 0: 8801.4, 1: 8714.5. Samples: 458796484. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:13,784][121949] Avg episode reward: [(0, '6252.855'), (1, '5557.378')] [2023-12-26 06:46:13,828][123091] Updated weights for policy 0, policy_version 899158 (0.0009) [2023-12-26 06:46:13,879][123091] Updated weights for policy 0, policy_version 899168 (0.0010) [2023-12-26 06:46:13,924][123091] Updated weights for policy 0, policy_version 899178 (0.0008) [2023-12-26 06:46:14,307][123090] Updated weights for policy 1, policy_version 893027 (0.0009) [2023-12-26 06:46:14,372][123090] Updated weights for policy 1, policy_version 893037 (0.0010) [2023-12-26 06:46:14,435][123090] Updated weights for policy 1, policy_version 893047 (0.0009) [2023-12-26 06:46:14,684][123091] Updated weights for policy 0, policy_version 899188 (0.0008) [2023-12-26 06:46:14,746][123091] Updated weights for policy 0, policy_version 899198 (0.0009) [2023-12-26 06:46:14,816][123091] Updated weights for policy 0, policy_version 899208 (0.0008) [2023-12-26 06:46:15,257][123090] Updated weights for policy 1, policy_version 893057 (0.0010) [2023-12-26 06:46:15,321][123090] Updated weights for policy 1, policy_version 893067 (0.0009) [2023-12-26 06:46:15,376][123090] Updated weights for policy 1, policy_version 893077 (0.0010) [2023-12-26 06:46:15,428][123090] Updated weights for policy 1, policy_version 893087 (0.0010) [2023-12-26 06:46:15,637][123091] Updated weights for policy 0, policy_version 899218 (0.0009) [2023-12-26 06:46:15,701][123091] Updated weights for policy 0, policy_version 899228 (0.0008) [2023-12-26 06:46:15,756][123091] Updated weights for policy 0, policy_version 899238 (0.0009) [2023-12-26 06:46:15,818][123091] Updated weights for policy 0, policy_version 899248 (0.0009) [2023-12-26 06:46:16,307][123090] Updated weights for policy 1, policy_version 893097 (0.0010) [2023-12-26 06:46:16,372][123090] Updated weights for policy 1, policy_version 893107 (0.0009) [2023-12-26 06:46:16,434][123090] Updated weights for policy 1, policy_version 893117 (0.0010) [2023-12-26 06:46:16,648][123091] Updated weights for policy 0, policy_version 899258 (0.0009) [2023-12-26 06:46:16,704][123091] Updated weights for policy 0, policy_version 899268 (0.0009) [2023-12-26 06:46:16,755][123091] Updated weights for policy 0, policy_version 899278 (0.0009) [2023-12-26 06:46:17,267][123090] Updated weights for policy 1, policy_version 893127 (0.0009) [2023-12-26 06:46:17,321][123090] Updated weights for policy 1, policy_version 893137 (0.0009) [2023-12-26 06:46:17,385][123090] Updated weights for policy 1, policy_version 893147 (0.0008) [2023-12-26 06:46:17,578][123091] Updated weights for policy 0, policy_version 899288 (0.0007) [2023-12-26 06:46:17,625][123091] Updated weights for policy 0, policy_version 899298 (0.0005) [2023-12-26 06:46:17,690][123091] Updated weights for policy 0, policy_version 899308 (0.0009) [2023-12-26 06:46:18,263][123090] Updated weights for policy 1, policy_version 893157 (0.0009) [2023-12-26 06:46:18,320][123090] Updated weights for policy 1, policy_version 893167 (0.0006) [2023-12-26 06:46:18,398][123090] Updated weights for policy 1, policy_version 893177 (0.0010) [2023-12-26 06:46:18,441][123091] Updated weights for policy 0, policy_version 899318 (0.0008) [2023-12-26 06:46:18,514][123091] Updated weights for policy 0, policy_version 899328 (0.0009) [2023-12-26 06:46:18,577][123091] Updated weights for policy 0, policy_version 899338 (0.0008) [2023-12-26 06:46:18,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 458891264. Throughput: 0: 8780.0, 1: 8715.4. Samples: 458899956. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:18,786][121949] Avg episode reward: [(0, '6241.406'), (1, '5678.244')] [2023-12-26 06:46:19,198][123090] Updated weights for policy 1, policy_version 893187 (0.0011) [2023-12-26 06:46:19,273][123090] Updated weights for policy 1, policy_version 893197 (0.0011) [2023-12-26 06:46:19,341][123090] Updated weights for policy 1, policy_version 893207 (0.0011) [2023-12-26 06:46:19,453][123091] Updated weights for policy 0, policy_version 899348 (0.0007) [2023-12-26 06:46:19,517][123091] Updated weights for policy 0, policy_version 899358 (0.0009) [2023-12-26 06:46:19,582][123091] Updated weights for policy 0, policy_version 899368 (0.0009) [2023-12-26 06:46:20,160][123090] Updated weights for policy 1, policy_version 893217 (0.0010) [2023-12-26 06:46:20,227][123090] Updated weights for policy 1, policy_version 893227 (0.0011) [2023-12-26 06:46:20,291][123090] Updated weights for policy 1, policy_version 893237 (0.0011) [2023-12-26 06:46:20,361][123090] Updated weights for policy 1, policy_version 893247 (0.0009) [2023-12-26 06:46:20,458][123091] Updated weights for policy 0, policy_version 899378 (0.0009) [2023-12-26 06:46:20,524][123091] Updated weights for policy 0, policy_version 899388 (0.0009) [2023-12-26 06:46:20,615][123091] Updated weights for policy 0, policy_version 899398 (0.0009) [2023-12-26 06:46:20,679][123091] Updated weights for policy 0, policy_version 899408 (0.0008) [2023-12-26 06:46:21,102][123090] Updated weights for policy 1, policy_version 893257 (0.0007) [2023-12-26 06:46:21,179][123090] Updated weights for policy 1, policy_version 893267 (0.0010) [2023-12-26 06:46:21,242][123090] Updated weights for policy 1, policy_version 893277 (0.0010) [2023-12-26 06:46:21,569][123091] Updated weights for policy 0, policy_version 899418 (0.0009) [2023-12-26 06:46:21,637][123091] Updated weights for policy 0, policy_version 899428 (0.0009) [2023-12-26 06:46:21,697][123091] Updated weights for policy 0, policy_version 899438 (0.0010) [2023-12-26 06:46:22,109][123090] Updated weights for policy 1, policy_version 893287 (0.0010) [2023-12-26 06:46:22,157][123090] Updated weights for policy 1, policy_version 893297 (0.0009) [2023-12-26 06:46:22,206][123090] Updated weights for policy 1, policy_version 893307 (0.0009) [2023-12-26 06:46:22,562][123091] Updated weights for policy 0, policy_version 899448 (0.0010) [2023-12-26 06:46:22,625][123091] Updated weights for policy 0, policy_version 899458 (0.0010) [2023-12-26 06:46:22,688][123091] Updated weights for policy 0, policy_version 899468 (0.0010) [2023-12-26 06:46:23,083][123090] Updated weights for policy 1, policy_version 893317 (0.0009) [2023-12-26 06:46:23,146][123090] Updated weights for policy 1, policy_version 893327 (0.0009) [2023-12-26 06:46:23,210][123090] Updated weights for policy 1, policy_version 893337 (0.0009) [2023-12-26 06:46:23,543][123091] Updated weights for policy 0, policy_version 899478 (0.0010) [2023-12-26 06:46:23,598][123091] Updated weights for policy 0, policy_version 899488 (0.0010) [2023-12-26 06:46:23,642][123091] Updated weights for policy 0, policy_version 899498 (0.0010) [2023-12-26 06:46:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 458973184. Throughput: 0: 8744.1, 1: 8703.6. Samples: 458949620. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:23,785][121949] Avg episode reward: [(0, '6212.835'), (1, '5644.997')] [2023-12-26 06:46:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000899504_230277120.pth... [2023-12-26 06:46:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000893344_228696064.pth... [2023-12-26 06:46:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000892352_228442112.pth [2023-12-26 06:46:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000898480_230014976.pth [2023-12-26 06:46:24,051][123090] Updated weights for policy 1, policy_version 893347 (0.0009) [2023-12-26 06:46:24,098][123090] Updated weights for policy 1, policy_version 893357 (0.0008) [2023-12-26 06:46:24,158][123090] Updated weights for policy 1, policy_version 893367 (0.0008) [2023-12-26 06:46:24,489][123091] Updated weights for policy 0, policy_version 899508 (0.0010) [2023-12-26 06:46:24,559][123091] Updated weights for policy 0, policy_version 899518 (0.0011) [2023-12-26 06:46:24,622][123091] Updated weights for policy 0, policy_version 899528 (0.0011) [2023-12-26 06:46:24,901][123090] Updated weights for policy 1, policy_version 893377 (0.0007) [2023-12-26 06:46:24,969][123090] Updated weights for policy 1, policy_version 893387 (0.0005) [2023-12-26 06:46:25,026][123090] Updated weights for policy 1, policy_version 893397 (0.0006) [2023-12-26 06:46:25,092][123090] Updated weights for policy 1, policy_version 893407 (0.0005) [2023-12-26 06:46:25,246][123091] Updated weights for policy 0, policy_version 899538 (0.0010) [2023-12-26 06:46:25,320][123091] Updated weights for policy 0, policy_version 899548 (0.0011) [2023-12-26 06:46:25,386][123091] Updated weights for policy 0, policy_version 899558 (0.0011) [2023-12-26 06:46:25,457][123091] Updated weights for policy 0, policy_version 899568 (0.0011) [2023-12-26 06:46:25,743][123090] Updated weights for policy 1, policy_version 893417 (0.0005) [2023-12-26 06:46:25,820][123090] Updated weights for policy 1, policy_version 893427 (0.0005) [2023-12-26 06:46:25,892][123090] Updated weights for policy 1, policy_version 893437 (0.0005) [2023-12-26 06:46:26,194][123091] Updated weights for policy 0, policy_version 899578 (0.0005) [2023-12-26 06:46:26,261][123091] Updated weights for policy 0, policy_version 899588 (0.0006) [2023-12-26 06:46:26,330][123091] Updated weights for policy 0, policy_version 899598 (0.0006) [2023-12-26 06:46:26,453][123090] Updated weights for policy 1, policy_version 893447 (0.0006) [2023-12-26 06:46:26,519][123090] Updated weights for policy 1, policy_version 893457 (0.0006) [2023-12-26 06:46:26,586][123090] Updated weights for policy 1, policy_version 893467 (0.0006) [2023-12-26 06:46:26,907][123091] Updated weights for policy 0, policy_version 899608 (0.0005) [2023-12-26 06:46:26,955][123091] Updated weights for policy 0, policy_version 899618 (0.0005) [2023-12-26 06:46:26,999][123091] Updated weights for policy 0, policy_version 899628 (0.0005) [2023-12-26 06:46:27,261][123090] Updated weights for policy 1, policy_version 893477 (0.0007) [2023-12-26 06:46:27,323][123090] Updated weights for policy 1, policy_version 893487 (0.0006) [2023-12-26 06:46:27,380][123090] Updated weights for policy 1, policy_version 893497 (0.0009) [2023-12-26 06:46:27,667][123091] Updated weights for policy 0, policy_version 899638 (0.0005) [2023-12-26 06:46:27,718][123091] Updated weights for policy 0, policy_version 899648 (0.0006) [2023-12-26 06:46:27,778][123091] Updated weights for policy 0, policy_version 899658 (0.0006) [2023-12-26 06:46:28,273][123090] Updated weights for policy 1, policy_version 893507 (0.0008) [2023-12-26 06:46:28,336][123090] Updated weights for policy 1, policy_version 893517 (0.0009) [2023-12-26 06:46:28,407][123090] Updated weights for policy 1, policy_version 893527 (0.0009) [2023-12-26 06:46:28,479][123091] Updated weights for policy 0, policy_version 899668 (0.0007) [2023-12-26 06:46:28,541][123091] Updated weights for policy 0, policy_version 899678 (0.0010) [2023-12-26 06:46:28,588][123091] Updated weights for policy 0, policy_version 899688 (0.0010) [2023-12-26 06:46:28,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 459071488. Throughput: 0: 8872.5, 1: 8814.9. Samples: 459060716. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:28,785][121949] Avg episode reward: [(0, '6146.942'), (1, '5629.375')] [2023-12-26 06:46:29,228][123090] Updated weights for policy 1, policy_version 893537 (0.0009) [2023-12-26 06:46:29,304][123090] Updated weights for policy 1, policy_version 893547 (0.0009) [2023-12-26 06:46:29,369][123090] Updated weights for policy 1, policy_version 893557 (0.0009) [2023-12-26 06:46:29,410][123091] Updated weights for policy 0, policy_version 899698 (0.0010) [2023-12-26 06:46:29,433][123090] Updated weights for policy 1, policy_version 893567 (0.0009) [2023-12-26 06:46:29,460][123091] Updated weights for policy 0, policy_version 899708 (0.0009) [2023-12-26 06:46:29,507][123091] Updated weights for policy 0, policy_version 899718 (0.0008) [2023-12-26 06:46:29,552][123091] Updated weights for policy 0, policy_version 899728 (0.0005) [2023-12-26 06:46:30,300][123091] Updated weights for policy 0, policy_version 899738 (0.0009) [2023-12-26 06:46:30,333][123090] Updated weights for policy 1, policy_version 893577 (0.0007) [2023-12-26 06:46:30,357][123091] Updated weights for policy 0, policy_version 899748 (0.0009) [2023-12-26 06:46:30,390][123090] Updated weights for policy 1, policy_version 893587 (0.0009) [2023-12-26 06:46:30,419][123091] Updated weights for policy 0, policy_version 899758 (0.0007) [2023-12-26 06:46:30,449][123090] Updated weights for policy 1, policy_version 893597 (0.0009) [2023-12-26 06:46:31,096][123091] Updated weights for policy 0, policy_version 899768 (0.0007) [2023-12-26 06:46:31,167][123091] Updated weights for policy 0, policy_version 899778 (0.0009) [2023-12-26 06:46:31,234][123091] Updated weights for policy 0, policy_version 899788 (0.0010) [2023-12-26 06:46:31,345][123090] Updated weights for policy 1, policy_version 893607 (0.0010) [2023-12-26 06:46:31,405][123090] Updated weights for policy 1, policy_version 893617 (0.0009) [2023-12-26 06:46:31,466][123090] Updated weights for policy 1, policy_version 893628 (0.0010) [2023-12-26 06:46:31,965][123091] Updated weights for policy 0, policy_version 899798 (0.0009) [2023-12-26 06:46:32,029][123091] Updated weights for policy 0, policy_version 899808 (0.0009) [2023-12-26 06:46:32,081][123091] Updated weights for policy 0, policy_version 899818 (0.0009) [2023-12-26 06:46:32,301][123090] Updated weights for policy 1, policy_version 893638 (0.0010) [2023-12-26 06:46:32,353][123090] Updated weights for policy 1, policy_version 893648 (0.0010) [2023-12-26 06:46:32,419][123090] Updated weights for policy 1, policy_version 893658 (0.0010) [2023-12-26 06:46:32,925][123091] Updated weights for policy 0, policy_version 899828 (0.0009) [2023-12-26 06:46:32,987][123091] Updated weights for policy 0, policy_version 899838 (0.0009) [2023-12-26 06:46:33,045][123091] Updated weights for policy 0, policy_version 899848 (0.0010) [2023-12-26 06:46:33,228][123090] Updated weights for policy 1, policy_version 893668 (0.0008) [2023-12-26 06:46:33,297][123090] Updated weights for policy 1, policy_version 893678 (0.0005) [2023-12-26 06:46:33,369][123090] Updated weights for policy 1, policy_version 893688 (0.0006) [2023-12-26 06:46:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 459153408. Throughput: 0: 8936.5, 1: 8644.0. Samples: 459166192. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:33,785][121949] Avg episode reward: [(0, '6117.696'), (1, '5609.036')] [2023-12-26 06:46:33,929][123091] Updated weights for policy 0, policy_version 899858 (0.0010) [2023-12-26 06:46:33,989][123091] Updated weights for policy 0, policy_version 899868 (0.0009) [2023-12-26 06:46:34,046][123091] Updated weights for policy 0, policy_version 899878 (0.0010) [2023-12-26 06:46:34,095][123090] Updated weights for policy 1, policy_version 893698 (0.0005) [2023-12-26 06:46:34,098][123091] Updated weights for policy 0, policy_version 899888 (0.0010) [2023-12-26 06:46:34,165][123090] Updated weights for policy 1, policy_version 893708 (0.0006) [2023-12-26 06:46:34,236][123090] Updated weights for policy 1, policy_version 893718 (0.0009) [2023-12-26 06:46:34,302][123090] Updated weights for policy 1, policy_version 893728 (0.0006) [2023-12-26 06:46:34,983][123091] Updated weights for policy 0, policy_version 899898 (0.0009) [2023-12-26 06:46:35,042][123091] Updated weights for policy 0, policy_version 899908 (0.0008) [2023-12-26 06:46:35,064][123090] Updated weights for policy 1, policy_version 893738 (0.0011) [2023-12-26 06:46:35,088][123091] Updated weights for policy 0, policy_version 899918 (0.0010) [2023-12-26 06:46:35,122][123090] Updated weights for policy 1, policy_version 893748 (0.0010) [2023-12-26 06:46:35,176][123090] Updated weights for policy 1, policy_version 893758 (0.0010) [2023-12-26 06:46:35,842][123091] Updated weights for policy 0, policy_version 899928 (0.0006) [2023-12-26 06:46:35,901][123091] Updated weights for policy 0, policy_version 899938 (0.0006) [2023-12-26 06:46:35,903][123090] Updated weights for policy 1, policy_version 893768 (0.0006) [2023-12-26 06:46:35,957][123091] Updated weights for policy 0, policy_version 899948 (0.0006) [2023-12-26 06:46:35,961][123090] Updated weights for policy 1, policy_version 893778 (0.0007) [2023-12-26 06:46:36,013][123090] Updated weights for policy 1, policy_version 893788 (0.0010) [2023-12-26 06:46:36,614][123091] Updated weights for policy 0, policy_version 899958 (0.0007) [2023-12-26 06:46:36,668][123091] Updated weights for policy 0, policy_version 899968 (0.0009) [2023-12-26 06:46:36,732][123091] Updated weights for policy 0, policy_version 899978 (0.0009) [2023-12-26 06:46:36,834][123090] Updated weights for policy 1, policy_version 893798 (0.0010) [2023-12-26 06:46:36,898][123090] Updated weights for policy 1, policy_version 893808 (0.0011) [2023-12-26 06:46:36,965][123090] Updated weights for policy 1, policy_version 893818 (0.0011) [2023-12-26 06:46:37,528][123091] Updated weights for policy 0, policy_version 899988 (0.0007) [2023-12-26 06:46:37,575][123091] Updated weights for policy 0, policy_version 899998 (0.0005) [2023-12-26 06:46:37,620][123091] Updated weights for policy 0, policy_version 900008 (0.0005) [2023-12-26 06:46:37,788][123090] Updated weights for policy 1, policy_version 893828 (0.0011) [2023-12-26 06:46:37,848][123090] Updated weights for policy 1, policy_version 893838 (0.0011) [2023-12-26 06:46:37,914][123090] Updated weights for policy 1, policy_version 893848 (0.0010) [2023-12-26 06:46:38,429][123091] Updated weights for policy 0, policy_version 900018 (0.0006) [2023-12-26 06:46:38,502][123091] Updated weights for policy 0, policy_version 900028 (0.0006) [2023-12-26 06:46:38,565][123091] Updated weights for policy 0, policy_version 900038 (0.0008) [2023-12-26 06:46:38,618][123091] Updated weights for policy 0, policy_version 900048 (0.0007) [2023-12-26 06:46:38,724][123090] Updated weights for policy 1, policy_version 893858 (0.0009) [2023-12-26 06:46:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 459243520. Throughput: 0: 8997.2, 1: 8663.7. Samples: 459220816. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:38,784][121949] Avg episode reward: [(0, '6062.673'), (1, '5535.816')] [2023-12-26 06:46:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000900048_230416384.pth... [2023-12-26 06:46:38,795][123090] Updated weights for policy 1, policy_version 893868 (0.0011) [2023-12-26 06:46:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000898992_230146048.pth [2023-12-26 06:46:38,852][123090] Updated weights for policy 1, policy_version 893878 (0.0011) [2023-12-26 06:46:38,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000893888_228835328.pth... [2023-12-26 06:46:38,905][123090] Updated weights for policy 1, policy_version 893888 (0.0011) [2023-12-26 06:46:38,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000892864_228573184.pth [2023-12-26 06:46:39,311][123091] Updated weights for policy 0, policy_version 900058 (0.0011) [2023-12-26 06:46:39,380][123091] Updated weights for policy 0, policy_version 900068 (0.0012) [2023-12-26 06:46:39,445][123091] Updated weights for policy 0, policy_version 900078 (0.0010) [2023-12-26 06:46:39,742][123090] Updated weights for policy 1, policy_version 893898 (0.0011) [2023-12-26 06:46:39,810][123090] Updated weights for policy 1, policy_version 893908 (0.0008) [2023-12-26 06:46:39,889][123090] Updated weights for policy 1, policy_version 893918 (0.0010) [2023-12-26 06:46:40,298][123091] Updated weights for policy 0, policy_version 900088 (0.0007) [2023-12-26 06:46:40,361][123091] Updated weights for policy 0, policy_version 900098 (0.0006) [2023-12-26 06:46:40,434][123091] Updated weights for policy 0, policy_version 900108 (0.0006) [2023-12-26 06:46:40,662][123090] Updated weights for policy 1, policy_version 893928 (0.0006) [2023-12-26 06:46:40,731][123090] Updated weights for policy 1, policy_version 893938 (0.0005) [2023-12-26 06:46:40,790][123090] Updated weights for policy 1, policy_version 893948 (0.0006) [2023-12-26 06:46:41,147][123091] Updated weights for policy 0, policy_version 900118 (0.0008) [2023-12-26 06:46:41,216][123091] Updated weights for policy 0, policy_version 900128 (0.0007) [2023-12-26 06:46:41,292][123091] Updated weights for policy 0, policy_version 900138 (0.0007) [2023-12-26 06:46:41,574][123090] Updated weights for policy 1, policy_version 893958 (0.0008) [2023-12-26 06:46:41,643][123090] Updated weights for policy 1, policy_version 893968 (0.0010) [2023-12-26 06:46:41,706][123090] Updated weights for policy 1, policy_version 893978 (0.0008) [2023-12-26 06:46:42,139][123091] Updated weights for policy 0, policy_version 900148 (0.0008) [2023-12-26 06:46:42,193][123091] Updated weights for policy 0, policy_version 900158 (0.0010) [2023-12-26 06:46:42,263][123091] Updated weights for policy 0, policy_version 900168 (0.0010) [2023-12-26 06:46:42,462][123090] Updated weights for policy 1, policy_version 893988 (0.0007) [2023-12-26 06:46:42,530][123090] Updated weights for policy 1, policy_version 893998 (0.0006) [2023-12-26 06:46:42,605][123090] Updated weights for policy 1, policy_version 894008 (0.0006) [2023-12-26 06:46:43,185][123091] Updated weights for policy 0, policy_version 900178 (0.0009) [2023-12-26 06:46:43,244][123091] Updated weights for policy 0, policy_version 900188 (0.0006) [2023-12-26 06:46:43,320][123091] Updated weights for policy 0, policy_version 900198 (0.0005) [2023-12-26 06:46:43,350][123090] Updated weights for policy 1, policy_version 894018 (0.0006) [2023-12-26 06:46:43,377][123091] Updated weights for policy 0, policy_version 900208 (0.0006) [2023-12-26 06:46:43,420][123090] Updated weights for policy 1, policy_version 894028 (0.0008) [2023-12-26 06:46:43,482][123090] Updated weights for policy 1, policy_version 894038 (0.0010) [2023-12-26 06:46:43,544][123090] Updated weights for policy 1, policy_version 894048 (0.0010) [2023-12-26 06:46:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 459333632. Throughput: 0: 8871.2, 1: 8663.6. Samples: 459326464. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:43,785][121949] Avg episode reward: [(0, '6113.967'), (1, '5560.375')] [2023-12-26 06:46:44,047][123091] Updated weights for policy 0, policy_version 900218 (0.0006) [2023-12-26 06:46:44,098][123091] Updated weights for policy 0, policy_version 900228 (0.0008) [2023-12-26 06:46:44,160][123091] Updated weights for policy 0, policy_version 900238 (0.0008) [2023-12-26 06:46:44,264][123090] Updated weights for policy 1, policy_version 894058 (0.0010) [2023-12-26 06:46:44,332][123090] Updated weights for policy 1, policy_version 894068 (0.0006) [2023-12-26 06:46:44,399][123090] Updated weights for policy 1, policy_version 894078 (0.0009) [2023-12-26 06:46:44,900][123091] Updated weights for policy 0, policy_version 900248 (0.0011) [2023-12-26 06:46:44,963][123091] Updated weights for policy 0, policy_version 900258 (0.0011) [2023-12-26 06:46:45,031][123091] Updated weights for policy 0, policy_version 900268 (0.0011) [2023-12-26 06:46:45,206][123090] Updated weights for policy 1, policy_version 894088 (0.0011) [2023-12-26 06:46:45,269][123090] Updated weights for policy 1, policy_version 894098 (0.0011) [2023-12-26 06:46:45,332][123090] Updated weights for policy 1, policy_version 894108 (0.0010) [2023-12-26 06:46:45,858][123091] Updated weights for policy 0, policy_version 900278 (0.0011) [2023-12-26 06:46:45,915][123091] Updated weights for policy 0, policy_version 900288 (0.0010) [2023-12-26 06:46:45,976][123091] Updated weights for policy 0, policy_version 900298 (0.0010) [2023-12-26 06:46:46,141][123090] Updated weights for policy 1, policy_version 894118 (0.0010) [2023-12-26 06:46:46,211][123090] Updated weights for policy 1, policy_version 894128 (0.0010) [2023-12-26 06:46:46,280][123090] Updated weights for policy 1, policy_version 894138 (0.0010) [2023-12-26 06:46:46,800][123091] Updated weights for policy 0, policy_version 900308 (0.0010) [2023-12-26 06:46:46,858][123091] Updated weights for policy 0, policy_version 900318 (0.0010) [2023-12-26 06:46:46,905][123091] Updated weights for policy 0, policy_version 900328 (0.0010) [2023-12-26 06:46:47,028][123090] Updated weights for policy 1, policy_version 894148 (0.0008) [2023-12-26 06:46:47,075][123090] Updated weights for policy 1, policy_version 894158 (0.0005) [2023-12-26 06:46:47,125][123090] Updated weights for policy 1, policy_version 894168 (0.0005) [2023-12-26 06:46:47,726][123091] Updated weights for policy 0, policy_version 900338 (0.0010) [2023-12-26 06:46:47,777][123091] Updated weights for policy 0, policy_version 900348 (0.0010) [2023-12-26 06:46:47,833][123091] Updated weights for policy 0, policy_version 900358 (0.0010) [2023-12-26 06:46:47,887][123091] Updated weights for policy 0, policy_version 900368 (0.0010) [2023-12-26 06:46:47,915][123090] Updated weights for policy 1, policy_version 894178 (0.0007) [2023-12-26 06:46:47,983][123090] Updated weights for policy 1, policy_version 894188 (0.0010) [2023-12-26 06:46:48,040][123090] Updated weights for policy 1, policy_version 894198 (0.0010) [2023-12-26 06:46:48,103][123090] Updated weights for policy 1, policy_version 894208 (0.0010) [2023-12-26 06:46:48,686][123091] Updated weights for policy 0, policy_version 900378 (0.0010) [2023-12-26 06:46:48,741][123091] Updated weights for policy 0, policy_version 900388 (0.0010) [2023-12-26 06:46:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 459415552. Throughput: 0: 8882.9, 1: 8730.1. Samples: 459434188. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:48,785][121949] Avg episode reward: [(0, '6239.751'), (1, '5503.399')] [2023-12-26 06:46:48,792][123091] Updated weights for policy 0, policy_version 900398 (0.0010) [2023-12-26 06:46:48,939][123090] Updated weights for policy 1, policy_version 894218 (0.0011) [2023-12-26 06:46:48,998][123090] Updated weights for policy 1, policy_version 894228 (0.0010) [2023-12-26 06:46:49,050][123090] Updated weights for policy 1, policy_version 894238 (0.0011) [2023-12-26 06:46:49,643][123091] Updated weights for policy 0, policy_version 900408 (0.0009) [2023-12-26 06:46:49,706][123091] Updated weights for policy 0, policy_version 900418 (0.0009) [2023-12-26 06:46:49,752][123091] Updated weights for policy 0, policy_version 900428 (0.0008) [2023-12-26 06:46:49,889][123090] Updated weights for policy 1, policy_version 894248 (0.0010) [2023-12-26 06:46:49,956][123090] Updated weights for policy 1, policy_version 894258 (0.0011) [2023-12-26 06:46:50,019][123090] Updated weights for policy 1, policy_version 894268 (0.0009) [2023-12-26 06:46:50,511][123091] Updated weights for policy 0, policy_version 900438 (0.0007) [2023-12-26 06:46:50,573][123091] Updated weights for policy 0, policy_version 900448 (0.0007) [2023-12-26 06:46:50,639][123091] Updated weights for policy 0, policy_version 900458 (0.0010) [2023-12-26 06:46:50,859][123090] Updated weights for policy 1, policy_version 894278 (0.0007) [2023-12-26 06:46:50,925][123090] Updated weights for policy 1, policy_version 894288 (0.0009) [2023-12-26 06:46:50,991][123090] Updated weights for policy 1, policy_version 894298 (0.0009) [2023-12-26 06:46:51,429][123091] Updated weights for policy 0, policy_version 900468 (0.0010) [2023-12-26 06:46:51,496][123091] Updated weights for policy 0, policy_version 900478 (0.0009) [2023-12-26 06:46:51,568][123091] Updated weights for policy 0, policy_version 900488 (0.0011) [2023-12-26 06:46:51,854][123090] Updated weights for policy 1, policy_version 894308 (0.0010) [2023-12-26 06:46:51,904][123090] Updated weights for policy 1, policy_version 894318 (0.0009) [2023-12-26 06:46:51,954][123090] Updated weights for policy 1, policy_version 894328 (0.0009) [2023-12-26 06:46:52,380][123091] Updated weights for policy 0, policy_version 900498 (0.0011) [2023-12-26 06:46:52,435][123091] Updated weights for policy 0, policy_version 900508 (0.0011) [2023-12-26 06:46:52,487][123091] Updated weights for policy 0, policy_version 900518 (0.0011) [2023-12-26 06:46:52,558][123091] Updated weights for policy 0, policy_version 900528 (0.0011) [2023-12-26 06:46:52,772][123090] Updated weights for policy 1, policy_version 894338 (0.0009) [2023-12-26 06:46:52,825][123090] Updated weights for policy 1, policy_version 894348 (0.0008) [2023-12-26 06:46:52,889][123090] Updated weights for policy 1, policy_version 894358 (0.0005) [2023-12-26 06:46:52,949][123090] Updated weights for policy 1, policy_version 894368 (0.0006) [2023-12-26 06:46:53,352][123091] Updated weights for policy 0, policy_version 900538 (0.0010) [2023-12-26 06:46:53,404][123091] Updated weights for policy 0, policy_version 900549 (0.0009) [2023-12-26 06:46:53,452][123091] Updated weights for policy 0, policy_version 900559 (0.0008) [2023-12-26 06:46:53,748][123090] Updated weights for policy 1, policy_version 894378 (0.0010) [2023-12-26 06:46:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 459505664. Throughput: 0: 8858.8, 1: 8681.1. Samples: 459484988. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:53,785][121949] Avg episode reward: [(0, '6331.714'), (1, '5461.126')] [2023-12-26 06:46:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000900560_230547456.pth... [2023-12-26 06:46:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000899504_230277120.pth [2023-12-26 06:46:53,816][123090] Updated weights for policy 1, policy_version 894388 (0.0006) [2023-12-26 06:46:53,885][123090] Updated weights for policy 1, policy_version 894398 (0.0005) [2023-12-26 06:46:53,900][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000894400_228966400.pth... [2023-12-26 06:46:53,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000893344_228696064.pth [2023-12-26 06:46:54,122][123091] Updated weights for policy 0, policy_version 900569 (0.0005) [2023-12-26 06:46:54,179][123091] Updated weights for policy 0, policy_version 900579 (0.0005) [2023-12-26 06:46:54,230][123091] Updated weights for policy 0, policy_version 900589 (0.0005) [2023-12-26 06:46:54,595][123090] Updated weights for policy 1, policy_version 894408 (0.0008) [2023-12-26 06:46:54,660][123090] Updated weights for policy 1, policy_version 894418 (0.0009) [2023-12-26 06:46:54,725][123090] Updated weights for policy 1, policy_version 894428 (0.0009) [2023-12-26 06:46:54,952][123091] Updated weights for policy 0, policy_version 900599 (0.0008) [2023-12-26 06:46:55,019][123091] Updated weights for policy 0, policy_version 900609 (0.0005) [2023-12-26 06:46:55,089][123091] Updated weights for policy 0, policy_version 900619 (0.0008) [2023-12-26 06:46:55,552][123090] Updated weights for policy 1, policy_version 894438 (0.0009) [2023-12-26 06:46:55,615][123090] Updated weights for policy 1, policy_version 894448 (0.0008) [2023-12-26 06:46:55,684][123090] Updated weights for policy 1, policy_version 894458 (0.0010) [2023-12-26 06:46:55,796][123091] Updated weights for policy 0, policy_version 900629 (0.0008) [2023-12-26 06:46:55,849][123091] Updated weights for policy 0, policy_version 900639 (0.0005) [2023-12-26 06:46:55,904][123091] Updated weights for policy 0, policy_version 900649 (0.0006) [2023-12-26 06:46:56,558][123090] Updated weights for policy 1, policy_version 894468 (0.0008) [2023-12-26 06:46:56,610][123090] Updated weights for policy 1, policy_version 894478 (0.0006) [2023-12-26 06:46:56,658][123090] Updated weights for policy 1, policy_version 894488 (0.0009) [2023-12-26 06:46:56,669][123091] Updated weights for policy 0, policy_version 900659 (0.0007) [2023-12-26 06:46:56,723][123091] Updated weights for policy 0, policy_version 900669 (0.0010) [2023-12-26 06:46:56,777][123091] Updated weights for policy 0, policy_version 900679 (0.0010) [2023-12-26 06:46:57,454][123090] Updated weights for policy 1, policy_version 894498 (0.0009) [2023-12-26 06:46:57,507][123090] Updated weights for policy 1, policy_version 894508 (0.0010) [2023-12-26 06:46:57,556][123090] Updated weights for policy 1, policy_version 894519 (0.0008) [2023-12-26 06:46:57,561][123091] Updated weights for policy 0, policy_version 900689 (0.0010) [2023-12-26 06:46:57,609][123091] Updated weights for policy 0, policy_version 900699 (0.0005) [2023-12-26 06:46:57,661][123091] Updated weights for policy 0, policy_version 900709 (0.0005) [2023-12-26 06:46:57,708][123091] Updated weights for policy 0, policy_version 900719 (0.0005) [2023-12-26 06:46:58,471][123090] Updated weights for policy 1, policy_version 894529 (0.0006) [2023-12-26 06:46:58,485][123091] Updated weights for policy 0, policy_version 900729 (0.0009) [2023-12-26 06:46:58,544][123090] Updated weights for policy 1, policy_version 894539 (0.0008) [2023-12-26 06:46:58,555][123091] Updated weights for policy 0, policy_version 900739 (0.0009) [2023-12-26 06:46:58,607][123090] Updated weights for policy 1, policy_version 894549 (0.0008) [2023-12-26 06:46:58,619][123091] Updated weights for policy 0, policy_version 900749 (0.0010) [2023-12-26 06:46:58,678][123090] Updated weights for policy 1, policy_version 894559 (0.0008) [2023-12-26 06:46:58,787][121949] Fps is (10 sec: 18836.2, 60 sec: 17748.5, 300 sec: 17689.0). Total num frames: 459603968. Throughput: 0: 8986.0, 1: 8737.5. Samples: 459594092. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:46:58,788][121949] Avg episode reward: [(0, '6366.886'), (1, '5499.529')] [2023-12-26 06:46:59,573][123090] Updated weights for policy 1, policy_version 894569 (0.0010) [2023-12-26 06:46:59,589][123091] Updated weights for policy 0, policy_version 900759 (0.0008) [2023-12-26 06:46:59,625][123090] Updated weights for policy 1, policy_version 894579 (0.0010) [2023-12-26 06:46:59,649][123091] Updated weights for policy 0, policy_version 900769 (0.0006) [2023-12-26 06:46:59,673][123090] Updated weights for policy 1, policy_version 894589 (0.0010) [2023-12-26 06:46:59,702][123091] Updated weights for policy 0, policy_version 900779 (0.0006) [2023-12-26 06:47:00,524][123090] Updated weights for policy 1, policy_version 894599 (0.0011) [2023-12-26 06:47:00,569][123091] Updated weights for policy 0, policy_version 900789 (0.0008) [2023-12-26 06:47:00,583][123090] Updated weights for policy 1, policy_version 894609 (0.0010) [2023-12-26 06:47:00,622][123091] Updated weights for policy 0, policy_version 900799 (0.0006) [2023-12-26 06:47:00,636][123090] Updated weights for policy 1, policy_version 894619 (0.0010) [2023-12-26 06:47:00,668][123091] Updated weights for policy 0, policy_version 900809 (0.0010) [2023-12-26 06:47:01,487][123090] Updated weights for policy 1, policy_version 894629 (0.0010) [2023-12-26 06:47:01,533][123091] Updated weights for policy 0, policy_version 900819 (0.0009) [2023-12-26 06:47:01,548][123090] Updated weights for policy 1, policy_version 894639 (0.0010) [2023-12-26 06:47:01,590][123091] Updated weights for policy 0, policy_version 900829 (0.0006) [2023-12-26 06:47:01,604][123090] Updated weights for policy 1, policy_version 894649 (0.0008) [2023-12-26 06:47:01,655][123091] Updated weights for policy 0, policy_version 900839 (0.0010) [2023-12-26 06:47:02,367][123090] Updated weights for policy 1, policy_version 894659 (0.0008) [2023-12-26 06:47:02,430][123090] Updated weights for policy 1, policy_version 894669 (0.0009) [2023-12-26 06:47:02,494][123090] Updated weights for policy 1, policy_version 894679 (0.0009) [2023-12-26 06:47:02,526][123091] Updated weights for policy 0, policy_version 900849 (0.0010) [2023-12-26 06:47:02,589][123091] Updated weights for policy 0, policy_version 900859 (0.0009) [2023-12-26 06:47:02,638][123091] Updated weights for policy 0, policy_version 900869 (0.0009) [2023-12-26 06:47:02,691][123091] Updated weights for policy 0, policy_version 900879 (0.0010) [2023-12-26 06:47:03,275][123090] Updated weights for policy 1, policy_version 894689 (0.0009) [2023-12-26 06:47:03,338][123090] Updated weights for policy 1, policy_version 894699 (0.0010) [2023-12-26 06:47:03,401][123090] Updated weights for policy 1, policy_version 894709 (0.0010) [2023-12-26 06:47:03,462][123090] Updated weights for policy 1, policy_version 894719 (0.0009) [2023-12-26 06:47:03,520][123091] Updated weights for policy 0, policy_version 900889 (0.0009) [2023-12-26 06:47:03,587][123091] Updated weights for policy 0, policy_version 900899 (0.0010) [2023-12-26 06:47:03,654][123091] Updated weights for policy 0, policy_version 900909 (0.0010) [2023-12-26 06:47:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 459685888. Throughput: 0: 8912.3, 1: 8747.4. Samples: 459694640. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:03,785][121949] Avg episode reward: [(0, '6292.059'), (1, '5616.803')] [2023-12-26 06:47:04,251][123090] Updated weights for policy 1, policy_version 894729 (0.0009) [2023-12-26 06:47:04,312][123090] Updated weights for policy 1, policy_version 894739 (0.0009) [2023-12-26 06:47:04,381][123090] Updated weights for policy 1, policy_version 894749 (0.0009) [2023-12-26 06:47:04,509][123091] Updated weights for policy 0, policy_version 900919 (0.0010) [2023-12-26 06:47:04,576][123091] Updated weights for policy 0, policy_version 900929 (0.0010) [2023-12-26 06:47:04,647][123091] Updated weights for policy 0, policy_version 900939 (0.0011) [2023-12-26 06:47:05,219][123090] Updated weights for policy 1, policy_version 894759 (0.0009) [2023-12-26 06:47:05,276][123090] Updated weights for policy 1, policy_version 894769 (0.0009) [2023-12-26 06:47:05,336][123090] Updated weights for policy 1, policy_version 894779 (0.0009) [2023-12-26 06:47:05,452][123091] Updated weights for policy 0, policy_version 900949 (0.0011) [2023-12-26 06:47:05,499][123091] Updated weights for policy 0, policy_version 900959 (0.0010) [2023-12-26 06:47:05,543][123091] Updated weights for policy 0, policy_version 900969 (0.0010) [2023-12-26 06:47:06,223][123090] Updated weights for policy 1, policy_version 894789 (0.0009) [2023-12-26 06:47:06,290][123091] Updated weights for policy 0, policy_version 900979 (0.0010) [2023-12-26 06:47:06,291][123090] Updated weights for policy 1, policy_version 894799 (0.0010) [2023-12-26 06:47:06,356][123091] Updated weights for policy 0, policy_version 900989 (0.0009) [2023-12-26 06:47:06,360][123090] Updated weights for policy 1, policy_version 894809 (0.0005) [2023-12-26 06:47:06,424][123091] Updated weights for policy 0, policy_version 900999 (0.0008) [2023-12-26 06:47:07,078][123091] Updated weights for policy 0, policy_version 901009 (0.0006) [2023-12-26 06:47:07,131][123091] Updated weights for policy 0, policy_version 901019 (0.0011) [2023-12-26 06:47:07,140][123090] Updated weights for policy 1, policy_version 894819 (0.0007) [2023-12-26 06:47:07,184][123091] Updated weights for policy 0, policy_version 901029 (0.0011) [2023-12-26 06:47:07,203][123090] Updated weights for policy 1, policy_version 894829 (0.0010) [2023-12-26 06:47:07,244][123091] Updated weights for policy 0, policy_version 901039 (0.0011) [2023-12-26 06:47:07,259][123090] Updated weights for policy 1, policy_version 894839 (0.0005) [2023-12-26 06:47:08,002][123091] Updated weights for policy 0, policy_version 901049 (0.0006) [2023-12-26 06:47:08,017][123090] Updated weights for policy 1, policy_version 894849 (0.0009) [2023-12-26 06:47:08,051][123091] Updated weights for policy 0, policy_version 901059 (0.0005) [2023-12-26 06:47:08,071][123090] Updated weights for policy 1, policy_version 894859 (0.0007) [2023-12-26 06:47:08,108][123091] Updated weights for policy 0, policy_version 901069 (0.0005) [2023-12-26 06:47:08,126][123090] Updated weights for policy 1, policy_version 894869 (0.0009) [2023-12-26 06:47:08,193][123090] Updated weights for policy 1, policy_version 894879 (0.0010) [2023-12-26 06:47:08,739][123091] Updated weights for policy 0, policy_version 901079 (0.0005) [2023-12-26 06:47:08,784][121949] Fps is (10 sec: 16388.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 459767808. Throughput: 0: 8960.3, 1: 8752.7. Samples: 459746700. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:08,785][121949] Avg episode reward: [(0, '6240.516'), (1, '5591.294')] [2023-12-26 06:47:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000894880_229089280.pth... [2023-12-26 06:47:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000893888_228835328.pth [2023-12-26 06:47:08,798][123091] Updated weights for policy 0, policy_version 901089 (0.0007) [2023-12-26 06:47:08,857][123091] Updated weights for policy 0, policy_version 901099 (0.0006) [2023-12-26 06:47:08,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000901104_230686720.pth... [2023-12-26 06:47:08,893][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000900048_230416384.pth [2023-12-26 06:47:09,090][123090] Updated weights for policy 1, policy_version 894889 (0.0010) [2023-12-26 06:47:09,145][123090] Updated weights for policy 1, policy_version 894899 (0.0006) [2023-12-26 06:47:09,204][123090] Updated weights for policy 1, policy_version 894909 (0.0006) [2023-12-26 06:47:09,602][123091] Updated weights for policy 0, policy_version 901109 (0.0010) [2023-12-26 06:47:09,684][123091] Updated weights for policy 0, policy_version 901119 (0.0011) [2023-12-26 06:47:09,762][123091] Updated weights for policy 0, policy_version 901129 (0.0010) [2023-12-26 06:47:09,964][123090] Updated weights for policy 1, policy_version 894919 (0.0007) [2023-12-26 06:47:10,031][123090] Updated weights for policy 1, policy_version 894929 (0.0009) [2023-12-26 06:47:10,100][123090] Updated weights for policy 1, policy_version 894939 (0.0009) [2023-12-26 06:47:10,636][123091] Updated weights for policy 0, policy_version 901139 (0.0009) [2023-12-26 06:47:10,697][123091] Updated weights for policy 0, policy_version 901149 (0.0010) [2023-12-26 06:47:10,765][123091] Updated weights for policy 0, policy_version 901159 (0.0010) [2023-12-26 06:47:10,891][123090] Updated weights for policy 1, policy_version 894949 (0.0008) [2023-12-26 06:47:10,953][123090] Updated weights for policy 1, policy_version 894959 (0.0010) [2023-12-26 06:47:11,017][123090] Updated weights for policy 1, policy_version 894969 (0.0008) [2023-12-26 06:47:11,595][123091] Updated weights for policy 0, policy_version 901169 (0.0010) [2023-12-26 06:47:11,664][123091] Updated weights for policy 0, policy_version 901179 (0.0008) [2023-12-26 06:47:11,743][123091] Updated weights for policy 0, policy_version 901189 (0.0007) [2023-12-26 06:47:11,813][123091] Updated weights for policy 0, policy_version 901199 (0.0008) [2023-12-26 06:47:11,897][123090] Updated weights for policy 1, policy_version 894979 (0.0009) [2023-12-26 06:47:11,969][123090] Updated weights for policy 1, policy_version 894989 (0.0010) [2023-12-26 06:47:12,041][123090] Updated weights for policy 1, policy_version 894999 (0.0010) [2023-12-26 06:47:12,541][123091] Updated weights for policy 0, policy_version 901209 (0.0008) [2023-12-26 06:47:12,593][123091] Updated weights for policy 0, policy_version 901219 (0.0008) [2023-12-26 06:47:12,652][123091] Updated weights for policy 0, policy_version 901229 (0.0006) [2023-12-26 06:47:12,898][123090] Updated weights for policy 1, policy_version 895009 (0.0010) [2023-12-26 06:47:12,963][123090] Updated weights for policy 1, policy_version 895019 (0.0009) [2023-12-26 06:47:13,027][123090] Updated weights for policy 1, policy_version 895029 (0.0009) [2023-12-26 06:47:13,100][123090] Updated weights for policy 1, policy_version 895039 (0.0009) [2023-12-26 06:47:13,408][123091] Updated weights for policy 0, policy_version 901239 (0.0008) [2023-12-26 06:47:13,468][123091] Updated weights for policy 0, policy_version 901249 (0.0008) [2023-12-26 06:47:13,527][123091] Updated weights for policy 0, policy_version 901259 (0.0005) [2023-12-26 06:47:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 459857920. Throughput: 0: 8959.5, 1: 8639.2. Samples: 459852660. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:13,785][121949] Avg episode reward: [(0, '6299.344'), (1, '5581.926')] [2023-12-26 06:47:13,969][123090] Updated weights for policy 1, policy_version 895049 (0.0010) [2023-12-26 06:47:14,018][123090] Updated weights for policy 1, policy_version 895059 (0.0009) [2023-12-26 06:47:14,073][123090] Updated weights for policy 1, policy_version 895069 (0.0010) [2023-12-26 06:47:14,165][123091] Updated weights for policy 0, policy_version 901269 (0.0008) [2023-12-26 06:47:14,235][123091] Updated weights for policy 0, policy_version 901279 (0.0006) [2023-12-26 06:47:14,300][123091] Updated weights for policy 0, policy_version 901289 (0.0008) [2023-12-26 06:47:14,920][123090] Updated weights for policy 1, policy_version 895079 (0.0010) [2023-12-26 06:47:14,995][123090] Updated weights for policy 1, policy_version 895089 (0.0009) [2023-12-26 06:47:15,061][123091] Updated weights for policy 0, policy_version 901299 (0.0009) [2023-12-26 06:47:15,064][123090] Updated weights for policy 1, policy_version 895099 (0.0008) [2023-12-26 06:47:15,125][123091] Updated weights for policy 0, policy_version 901309 (0.0007) [2023-12-26 06:47:15,185][123091] Updated weights for policy 0, policy_version 901319 (0.0009) [2023-12-26 06:47:15,888][123090] Updated weights for policy 1, policy_version 895109 (0.0008) [2023-12-26 06:47:15,931][123091] Updated weights for policy 0, policy_version 901329 (0.0009) [2023-12-26 06:47:15,945][123090] Updated weights for policy 1, policy_version 895119 (0.0008) [2023-12-26 06:47:15,994][123090] Updated weights for policy 1, policy_version 895129 (0.0010) [2023-12-26 06:47:16,004][123091] Updated weights for policy 0, policy_version 901339 (0.0005) [2023-12-26 06:47:16,073][123091] Updated weights for policy 0, policy_version 901349 (0.0009) [2023-12-26 06:47:16,133][123091] Updated weights for policy 0, policy_version 901359 (0.0008) [2023-12-26 06:47:16,728][123090] Updated weights for policy 1, policy_version 895139 (0.0008) [2023-12-26 06:47:16,738][123091] Updated weights for policy 0, policy_version 901369 (0.0010) [2023-12-26 06:47:16,790][123090] Updated weights for policy 1, policy_version 895149 (0.0008) [2023-12-26 06:47:16,800][123091] Updated weights for policy 0, policy_version 901379 (0.0007) [2023-12-26 06:47:16,844][123090] Updated weights for policy 1, policy_version 895159 (0.0008) [2023-12-26 06:47:16,859][123091] Updated weights for policy 0, policy_version 901389 (0.0005) [2023-12-26 06:47:17,549][123091] Updated weights for policy 0, policy_version 901399 (0.0005) [2023-12-26 06:47:17,600][123091] Updated weights for policy 0, policy_version 901409 (0.0005) [2023-12-26 06:47:17,635][123090] Updated weights for policy 1, policy_version 895169 (0.0009) [2023-12-26 06:47:17,646][123091] Updated weights for policy 0, policy_version 901419 (0.0005) [2023-12-26 06:47:17,702][123090] Updated weights for policy 1, policy_version 895179 (0.0010) [2023-12-26 06:47:17,773][123090] Updated weights for policy 1, policy_version 895189 (0.0010) [2023-12-26 06:47:17,835][123090] Updated weights for policy 1, policy_version 895199 (0.0007) [2023-12-26 06:47:18,336][123091] Updated weights for policy 0, policy_version 901429 (0.0008) [2023-12-26 06:47:18,403][123091] Updated weights for policy 0, policy_version 901439 (0.0011) [2023-12-26 06:47:18,462][123091] Updated weights for policy 0, policy_version 901449 (0.0011) [2023-12-26 06:47:18,540][123090] Updated weights for policy 1, policy_version 895209 (0.0009) [2023-12-26 06:47:18,606][123090] Updated weights for policy 1, policy_version 895219 (0.0011) [2023-12-26 06:47:18,674][123090] Updated weights for policy 1, policy_version 895229 (0.0010) [2023-12-26 06:47:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.5, 300 sec: 17661.4). Total num frames: 459956224. Throughput: 0: 9030.2, 1: 8681.9. Samples: 459963232. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:18,784][121949] Avg episode reward: [(0, '6283.694'), (1, '5776.494')] [2023-12-26 06:47:19,282][123091] Updated weights for policy 0, policy_version 901459 (0.0009) [2023-12-26 06:47:19,349][123091] Updated weights for policy 0, policy_version 901469 (0.0008) [2023-12-26 06:47:19,411][123091] Updated weights for policy 0, policy_version 901479 (0.0010) [2023-12-26 06:47:19,430][123090] Updated weights for policy 1, policy_version 895239 (0.0009) [2023-12-26 06:47:19,494][123090] Updated weights for policy 1, policy_version 895249 (0.0008) [2023-12-26 06:47:19,560][123090] Updated weights for policy 1, policy_version 895259 (0.0010) [2023-12-26 06:47:20,153][123091] Updated weights for policy 0, policy_version 901489 (0.0010) [2023-12-26 06:47:20,214][123091] Updated weights for policy 0, policy_version 901499 (0.0011) [2023-12-26 06:47:20,282][123091] Updated weights for policy 0, policy_version 901509 (0.0011) [2023-12-26 06:47:20,349][123091] Updated weights for policy 0, policy_version 901519 (0.0010) [2023-12-26 06:47:20,356][123090] Updated weights for policy 1, policy_version 895269 (0.0008) [2023-12-26 06:47:20,429][123090] Updated weights for policy 1, policy_version 895279 (0.0010) [2023-12-26 06:47:20,501][123090] Updated weights for policy 1, policy_version 895289 (0.0008) [2023-12-26 06:47:21,149][123091] Updated weights for policy 0, policy_version 901529 (0.0010) [2023-12-26 06:47:21,217][123091] Updated weights for policy 0, policy_version 901539 (0.0010) [2023-12-26 06:47:21,283][123091] Updated weights for policy 0, policy_version 901549 (0.0010) [2023-12-26 06:47:21,343][123090] Updated weights for policy 1, policy_version 895299 (0.0009) [2023-12-26 06:47:21,413][123090] Updated weights for policy 1, policy_version 895309 (0.0009) [2023-12-26 06:47:21,483][123090] Updated weights for policy 1, policy_version 895319 (0.0009) [2023-12-26 06:47:22,135][123091] Updated weights for policy 0, policy_version 901559 (0.0009) [2023-12-26 06:47:22,191][123091] Updated weights for policy 0, policy_version 901570 (0.0010) [2023-12-26 06:47:22,250][123091] Updated weights for policy 0, policy_version 901580 (0.0009) [2023-12-26 06:47:22,278][123090] Updated weights for policy 1, policy_version 895329 (0.0009) [2023-12-26 06:47:22,350][123090] Updated weights for policy 1, policy_version 895339 (0.0007) [2023-12-26 06:47:22,418][123090] Updated weights for policy 1, policy_version 895349 (0.0010) [2023-12-26 06:47:22,486][123090] Updated weights for policy 1, policy_version 895359 (0.0010) [2023-12-26 06:47:23,072][123091] Updated weights for policy 0, policy_version 901590 (0.0008) [2023-12-26 06:47:23,133][123091] Updated weights for policy 0, policy_version 901600 (0.0010) [2023-12-26 06:47:23,197][123091] Updated weights for policy 0, policy_version 901610 (0.0010) [2023-12-26 06:47:23,320][123090] Updated weights for policy 1, policy_version 895369 (0.0010) [2023-12-26 06:47:23,385][123090] Updated weights for policy 1, policy_version 895379 (0.0009) [2023-12-26 06:47:23,440][123090] Updated weights for policy 1, policy_version 895389 (0.0008) [2023-12-26 06:47:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 460038144. Throughput: 0: 8995.0, 1: 8643.6. Samples: 460014556. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:23,784][121949] Avg episode reward: [(0, '6334.174'), (1, '5744.678')] [2023-12-26 06:47:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000901616_230817792.pth... [2023-12-26 06:47:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000895392_229220352.pth... [2023-12-26 06:47:23,791][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000900560_230547456.pth [2023-12-26 06:47:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000894400_228966400.pth [2023-12-26 06:47:24,041][123091] Updated weights for policy 0, policy_version 901620 (0.0009) [2023-12-26 06:47:24,104][123091] Updated weights for policy 0, policy_version 901630 (0.0010) [2023-12-26 06:47:24,161][123091] Updated weights for policy 0, policy_version 901640 (0.0009) [2023-12-26 06:47:24,233][123090] Updated weights for policy 1, policy_version 895399 (0.0008) [2023-12-26 06:47:24,286][123090] Updated weights for policy 1, policy_version 895409 (0.0009) [2023-12-26 06:47:24,335][123090] Updated weights for policy 1, policy_version 895419 (0.0009) [2023-12-26 06:47:25,006][123091] Updated weights for policy 0, policy_version 901650 (0.0010) [2023-12-26 06:47:25,064][123091] Updated weights for policy 0, policy_version 901660 (0.0010) [2023-12-26 06:47:25,136][123091] Updated weights for policy 0, policy_version 901670 (0.0009) [2023-12-26 06:47:25,186][123090] Updated weights for policy 1, policy_version 895429 (0.0008) [2023-12-26 06:47:25,196][123091] Updated weights for policy 0, policy_version 901680 (0.0009) [2023-12-26 06:47:25,232][123090] Updated weights for policy 1, policy_version 895439 (0.0008) [2023-12-26 06:47:25,289][123090] Updated weights for policy 1, policy_version 895449 (0.0009) [2023-12-26 06:47:26,005][123091] Updated weights for policy 0, policy_version 901690 (0.0009) [2023-12-26 06:47:26,082][123091] Updated weights for policy 0, policy_version 901700 (0.0009) [2023-12-26 06:47:26,113][123090] Updated weights for policy 1, policy_version 895459 (0.0009) [2023-12-26 06:47:26,154][123091] Updated weights for policy 0, policy_version 901710 (0.0008) [2023-12-26 06:47:26,179][123090] Updated weights for policy 1, policy_version 895469 (0.0010) [2023-12-26 06:47:26,242][123090] Updated weights for policy 1, policy_version 895479 (0.0010) [2023-12-26 06:47:26,938][123091] Updated weights for policy 0, policy_version 901720 (0.0009) [2023-12-26 06:47:26,993][123091] Updated weights for policy 0, policy_version 901731 (0.0009) [2023-12-26 06:47:27,044][123090] Updated weights for policy 1, policy_version 895489 (0.0009) [2023-12-26 06:47:27,046][123091] Updated weights for policy 0, policy_version 901741 (0.0009) [2023-12-26 06:47:27,097][123090] Updated weights for policy 1, policy_version 895499 (0.0009) [2023-12-26 06:47:27,159][123090] Updated weights for policy 1, policy_version 895509 (0.0009) [2023-12-26 06:47:27,220][123090] Updated weights for policy 1, policy_version 895519 (0.0009) [2023-12-26 06:47:27,862][123091] Updated weights for policy 0, policy_version 901751 (0.0005) [2023-12-26 06:47:27,911][123091] Updated weights for policy 0, policy_version 901761 (0.0005) [2023-12-26 06:47:27,955][123091] Updated weights for policy 0, policy_version 901771 (0.0005) [2023-12-26 06:47:28,061][123090] Updated weights for policy 1, policy_version 895529 (0.0010) [2023-12-26 06:47:28,119][123090] Updated weights for policy 1, policy_version 895539 (0.0009) [2023-12-26 06:47:28,180][123090] Updated weights for policy 1, policy_version 895549 (0.0009) [2023-12-26 06:47:28,623][123091] Updated weights for policy 0, policy_version 901781 (0.0008) [2023-12-26 06:47:28,688][123091] Updated weights for policy 0, policy_version 901791 (0.0009) [2023-12-26 06:47:28,752][123091] Updated weights for policy 0, policy_version 901801 (0.0009) [2023-12-26 06:47:28,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 460120064. Throughput: 0: 8957.5, 1: 8618.2. Samples: 460117372. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:28,785][121949] Avg episode reward: [(0, '6361.310'), (1, '5801.839')] [2023-12-26 06:47:29,042][123090] Updated weights for policy 1, policy_version 895560 (0.0009) [2023-12-26 06:47:29,089][123090] Updated weights for policy 1, policy_version 895570 (0.0008) [2023-12-26 06:47:29,137][123090] Updated weights for policy 1, policy_version 895580 (0.0009) [2023-12-26 06:47:29,590][123091] Updated weights for policy 0, policy_version 901811 (0.0009) [2023-12-26 06:47:29,642][123091] Updated weights for policy 0, policy_version 901821 (0.0009) [2023-12-26 06:47:29,716][123091] Updated weights for policy 0, policy_version 901831 (0.0010) [2023-12-26 06:47:30,003][123090] Updated weights for policy 1, policy_version 895590 (0.0010) [2023-12-26 06:47:30,066][123090] Updated weights for policy 1, policy_version 895600 (0.0009) [2023-12-26 06:47:30,131][123090] Updated weights for policy 1, policy_version 895610 (0.0009) [2023-12-26 06:47:30,538][123091] Updated weights for policy 0, policy_version 901841 (0.0009) [2023-12-26 06:47:30,608][123091] Updated weights for policy 0, policy_version 901851 (0.0005) [2023-12-26 06:47:30,672][123091] Updated weights for policy 0, policy_version 901861 (0.0005) [2023-12-26 06:47:30,745][123091] Updated weights for policy 0, policy_version 901871 (0.0006) [2023-12-26 06:47:30,994][123090] Updated weights for policy 1, policy_version 895620 (0.0008) [2023-12-26 06:47:31,065][123090] Updated weights for policy 1, policy_version 895630 (0.0007) [2023-12-26 06:47:31,129][123090] Updated weights for policy 1, policy_version 895640 (0.0009) [2023-12-26 06:47:31,440][123091] Updated weights for policy 0, policy_version 901881 (0.0010) [2023-12-26 06:47:31,489][123091] Updated weights for policy 0, policy_version 901891 (0.0011) [2023-12-26 06:47:31,536][123091] Updated weights for policy 0, policy_version 901901 (0.0010) [2023-12-26 06:47:31,976][123090] Updated weights for policy 1, policy_version 895650 (0.0009) [2023-12-26 06:47:32,029][123090] Updated weights for policy 1, policy_version 895660 (0.0009) [2023-12-26 06:47:32,085][123090] Updated weights for policy 1, policy_version 895670 (0.0009) [2023-12-26 06:47:32,148][123090] Updated weights for policy 1, policy_version 895680 (0.0009) [2023-12-26 06:47:32,259][123091] Updated weights for policy 0, policy_version 901911 (0.0010) [2023-12-26 06:47:32,331][123091] Updated weights for policy 0, policy_version 901921 (0.0011) [2023-12-26 06:47:32,398][123091] Updated weights for policy 0, policy_version 901931 (0.0011) [2023-12-26 06:47:32,946][123090] Updated weights for policy 1, policy_version 895690 (0.0007) [2023-12-26 06:47:33,004][123090] Updated weights for policy 1, policy_version 895701 (0.0010) [2023-12-26 06:47:33,061][123090] Updated weights for policy 1, policy_version 895711 (0.0009) [2023-12-26 06:47:33,132][123091] Updated weights for policy 0, policy_version 901941 (0.0008) [2023-12-26 06:47:33,179][123091] Updated weights for policy 0, policy_version 901951 (0.0005) [2023-12-26 06:47:33,224][123091] Updated weights for policy 0, policy_version 901961 (0.0005) [2023-12-26 06:47:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 460210176. Throughput: 0: 9025.8, 1: 8536.9. Samples: 460224508. Policy #0 lag: (min: 20.0, avg: 37.2, max: 52.0) [2023-12-26 06:47:33,785][121949] Avg episode reward: [(0, '6291.381'), (1, '5789.391')] [2023-12-26 06:47:33,927][123091] Updated weights for policy 0, policy_version 901971 (0.0007) [2023-12-26 06:47:33,936][123090] Updated weights for policy 1, policy_version 895721 (0.0006) [2023-12-26 06:47:33,972][123091] Updated weights for policy 0, policy_version 901981 (0.0009) [2023-12-26 06:47:33,982][123090] Updated weights for policy 1, policy_version 895731 (0.0005) [2023-12-26 06:47:34,020][123091] Updated weights for policy 0, policy_version 901991 (0.0010) [2023-12-26 06:47:34,034][123090] Updated weights for policy 1, policy_version 895741 (0.0005) [2023-12-26 06:47:34,805][123090] Updated weights for policy 1, policy_version 895751 (0.0007) [2023-12-26 06:47:34,859][123090] Updated weights for policy 1, policy_version 895761 (0.0008) [2023-12-26 06:47:34,888][123091] Updated weights for policy 0, policy_version 902001 (0.0010) [2023-12-26 06:47:34,917][123090] Updated weights for policy 1, policy_version 895771 (0.0009) [2023-12-26 06:47:34,947][123091] Updated weights for policy 0, policy_version 902011 (0.0011) [2023-12-26 06:47:35,017][123091] Updated weights for policy 0, policy_version 902021 (0.0011) [2023-12-26 06:47:35,077][123091] Updated weights for policy 0, policy_version 902031 (0.0008) [2023-12-26 06:47:35,739][123091] Updated weights for policy 0, policy_version 902041 (0.0005) [2023-12-26 06:47:35,788][123091] Updated weights for policy 0, policy_version 902051 (0.0005) [2023-12-26 06:47:35,816][123090] Updated weights for policy 1, policy_version 895781 (0.0009) [2023-12-26 06:47:35,849][123091] Updated weights for policy 0, policy_version 902061 (0.0005) [2023-12-26 06:47:35,873][123090] Updated weights for policy 1, policy_version 895791 (0.0008) [2023-12-26 06:47:35,934][123090] Updated weights for policy 1, policy_version 895801 (0.0010) [2023-12-26 06:47:36,600][123091] Updated weights for policy 0, policy_version 902071 (0.0006) [2023-12-26 06:47:36,677][123091] Updated weights for policy 0, policy_version 902081 (0.0006) [2023-12-26 06:47:36,749][123091] Updated weights for policy 0, policy_version 902091 (0.0009) [2023-12-26 06:47:36,754][123090] Updated weights for policy 1, policy_version 895811 (0.0008) [2023-12-26 06:47:36,831][123090] Updated weights for policy 1, policy_version 895821 (0.0006) [2023-12-26 06:47:36,904][123090] Updated weights for policy 1, policy_version 895831 (0.0006) [2023-12-26 06:47:37,478][123091] Updated weights for policy 0, policy_version 902101 (0.0008) [2023-12-26 06:47:37,540][123091] Updated weights for policy 0, policy_version 902111 (0.0006) [2023-12-26 06:47:37,609][123091] Updated weights for policy 0, policy_version 902121 (0.0005) [2023-12-26 06:47:37,624][123090] Updated weights for policy 1, policy_version 895841 (0.0010) [2023-12-26 06:47:37,684][123090] Updated weights for policy 1, policy_version 895851 (0.0005) [2023-12-26 06:47:37,737][123090] Updated weights for policy 1, policy_version 895861 (0.0005) [2023-12-26 06:47:37,790][123090] Updated weights for policy 1, policy_version 895871 (0.0005) [2023-12-26 06:47:38,272][123091] Updated weights for policy 0, policy_version 902131 (0.0006) [2023-12-26 06:47:38,337][123091] Updated weights for policy 0, policy_version 902141 (0.0007) [2023-12-26 06:47:38,401][123091] Updated weights for policy 0, policy_version 902151 (0.0008) [2023-12-26 06:47:38,586][123090] Updated weights for policy 1, policy_version 895881 (0.0007) [2023-12-26 06:47:38,652][123090] Updated weights for policy 1, policy_version 895891 (0.0005) [2023-12-26 06:47:38,719][123090] Updated weights for policy 1, policy_version 895901 (0.0005) [2023-12-26 06:47:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 460308480. Throughput: 0: 9084.9, 1: 8553.9. Samples: 460278732. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:47:38,785][121949] Avg episode reward: [(0, '6172.460'), (1, '5570.513')] [2023-12-26 06:47:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000902160_230957056.pth... [2023-12-26 06:47:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000895904_229351424.pth... [2023-12-26 06:47:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000894880_229089280.pth [2023-12-26 06:47:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000901104_230686720.pth [2023-12-26 06:47:39,181][123091] Updated weights for policy 0, policy_version 902161 (0.0008) [2023-12-26 06:47:39,251][123091] Updated weights for policy 0, policy_version 902171 (0.0008) [2023-12-26 06:47:39,311][123091] Updated weights for policy 0, policy_version 902181 (0.0010) [2023-12-26 06:47:39,380][123091] Updated weights for policy 0, policy_version 902191 (0.0010) [2023-12-26 06:47:39,471][123090] Updated weights for policy 1, policy_version 895911 (0.0009) [2023-12-26 06:47:39,525][123090] Updated weights for policy 1, policy_version 895921 (0.0009) [2023-12-26 06:47:39,579][123090] Updated weights for policy 1, policy_version 895931 (0.0009) [2023-12-26 06:47:40,267][123091] Updated weights for policy 0, policy_version 902201 (0.0010) [2023-12-26 06:47:40,338][123091] Updated weights for policy 0, policy_version 902211 (0.0010) [2023-12-26 06:47:40,389][123091] Updated weights for policy 0, policy_version 902221 (0.0009) [2023-12-26 06:47:40,408][123090] Updated weights for policy 1, policy_version 895941 (0.0007) [2023-12-26 06:47:40,478][123090] Updated weights for policy 1, policy_version 895951 (0.0007) [2023-12-26 06:47:40,540][123090] Updated weights for policy 1, policy_version 895961 (0.0009) [2023-12-26 06:47:41,258][123091] Updated weights for policy 0, policy_version 902231 (0.0009) [2023-12-26 06:47:41,325][123091] Updated weights for policy 0, policy_version 902241 (0.0008) [2023-12-26 06:47:41,339][123090] Updated weights for policy 1, policy_version 895971 (0.0008) [2023-12-26 06:47:41,402][123091] Updated weights for policy 0, policy_version 902251 (0.0009) [2023-12-26 06:47:41,409][123090] Updated weights for policy 1, policy_version 895981 (0.0015) [2023-12-26 06:47:41,507][123090] Updated weights for policy 1, policy_version 895991 (0.0010) [2023-12-26 06:47:42,175][123091] Updated weights for policy 0, policy_version 902261 (0.0008) [2023-12-26 06:47:42,268][123091] Updated weights for policy 0, policy_version 902271 (0.0011) [2023-12-26 06:47:42,334][123091] Updated weights for policy 0, policy_version 902281 (0.0011) [2023-12-26 06:47:42,361][123090] Updated weights for policy 1, policy_version 896001 (0.0011) [2023-12-26 06:47:42,432][123090] Updated weights for policy 1, policy_version 896011 (0.0011) [2023-12-26 06:47:42,499][123090] Updated weights for policy 1, policy_version 896021 (0.0010) [2023-12-26 06:47:42,565][123090] Updated weights for policy 1, policy_version 896031 (0.0010) [2023-12-26 06:47:43,082][123091] Updated weights for policy 0, policy_version 902291 (0.0009) [2023-12-26 06:47:43,134][123091] Updated weights for policy 0, policy_version 902301 (0.0006) [2023-12-26 06:47:43,191][123091] Updated weights for policy 0, policy_version 902311 (0.0006) [2023-12-26 06:47:43,218][123090] Updated weights for policy 1, policy_version 896041 (0.0006) [2023-12-26 06:47:43,279][123090] Updated weights for policy 1, policy_version 896051 (0.0005) [2023-12-26 06:47:43,339][123090] Updated weights for policy 1, policy_version 896061 (0.0006) [2023-12-26 06:47:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 460390400. Throughput: 0: 8986.2, 1: 8556.7. Samples: 460383472. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:47:43,784][121949] Avg episode reward: [(0, '6194.826'), (1, '5656.797')] [2023-12-26 06:47:43,815][123091] Updated weights for policy 0, policy_version 902321 (0.0006) [2023-12-26 06:47:43,866][123091] Updated weights for policy 0, policy_version 902331 (0.0005) [2023-12-26 06:47:43,914][123091] Updated weights for policy 0, policy_version 902341 (0.0005) [2023-12-26 06:47:43,968][123091] Updated weights for policy 0, policy_version 902351 (0.0007) [2023-12-26 06:47:44,011][123090] Updated weights for policy 1, policy_version 896071 (0.0008) [2023-12-26 06:47:44,063][123090] Updated weights for policy 1, policy_version 896081 (0.0007) [2023-12-26 06:47:44,118][123090] Updated weights for policy 1, policy_version 896091 (0.0005) [2023-12-26 06:47:44,829][123091] Updated weights for policy 0, policy_version 902362 (0.0008) [2023-12-26 06:47:44,837][123090] Updated weights for policy 1, policy_version 896101 (0.0007) [2023-12-26 06:47:44,887][123090] Updated weights for policy 1, policy_version 896111 (0.0008) [2023-12-26 06:47:44,896][123091] Updated weights for policy 0, policy_version 902372 (0.0006) [2023-12-26 06:47:44,946][123090] Updated weights for policy 1, policy_version 896121 (0.0008) [2023-12-26 06:47:44,971][123091] Updated weights for policy 0, policy_version 902382 (0.0006) [2023-12-26 06:47:45,709][123091] Updated weights for policy 0, policy_version 902392 (0.0009) [2023-12-26 06:47:45,722][123090] Updated weights for policy 1, policy_version 896131 (0.0008) [2023-12-26 06:47:45,765][123091] Updated weights for policy 0, policy_version 902402 (0.0006) [2023-12-26 06:47:45,786][123090] Updated weights for policy 1, policy_version 896141 (0.0009) [2023-12-26 06:47:45,822][123091] Updated weights for policy 0, policy_version 902412 (0.0006) [2023-12-26 06:47:45,849][123090] Updated weights for policy 1, policy_version 896151 (0.0009) [2023-12-26 06:47:46,481][123091] Updated weights for policy 0, policy_version 902422 (0.0005) [2023-12-26 06:47:46,536][123091] Updated weights for policy 0, policy_version 902432 (0.0006) [2023-12-26 06:47:46,594][123091] Updated weights for policy 0, policy_version 902442 (0.0005) [2023-12-26 06:47:46,751][123090] Updated weights for policy 1, policy_version 896161 (0.0010) [2023-12-26 06:47:46,817][123090] Updated weights for policy 1, policy_version 896171 (0.0009) [2023-12-26 06:47:46,884][123090] Updated weights for policy 1, policy_version 896181 (0.0007) [2023-12-26 06:47:46,952][123090] Updated weights for policy 1, policy_version 896191 (0.0006) [2023-12-26 06:47:47,270][123091] Updated weights for policy 0, policy_version 902452 (0.0007) [2023-12-26 06:47:47,336][123091] Updated weights for policy 0, policy_version 902462 (0.0010) [2023-12-26 06:47:47,403][123091] Updated weights for policy 0, policy_version 902472 (0.0010) [2023-12-26 06:47:47,619][123090] Updated weights for policy 1, policy_version 896201 (0.0009) [2023-12-26 06:47:47,682][123090] Updated weights for policy 1, policy_version 896211 (0.0009) [2023-12-26 06:47:47,750][123090] Updated weights for policy 1, policy_version 896221 (0.0010) [2023-12-26 06:47:48,156][123091] Updated weights for policy 0, policy_version 902483 (0.0011) [2023-12-26 06:47:48,213][123091] Updated weights for policy 0, policy_version 902493 (0.0007) [2023-12-26 06:47:48,263][123091] Updated weights for policy 0, policy_version 902503 (0.0005) [2023-12-26 06:47:48,584][123090] Updated weights for policy 1, policy_version 896231 (0.0007) [2023-12-26 06:47:48,644][123090] Updated weights for policy 1, policy_version 896241 (0.0008) [2023-12-26 06:47:48,707][123090] Updated weights for policy 1, policy_version 896251 (0.0010) [2023-12-26 06:47:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 460488704. Throughput: 0: 9166.3, 1: 8664.4. Samples: 460497020. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:47:48,785][121949] Avg episode reward: [(0, '6362.769'), (1, '5811.743')] [2023-12-26 06:47:49,045][123091] Updated weights for policy 0, policy_version 902513 (0.0006) [2023-12-26 06:47:49,113][123091] Updated weights for policy 0, policy_version 902523 (0.0009) [2023-12-26 06:47:49,173][123091] Updated weights for policy 0, policy_version 902533 (0.0009) [2023-12-26 06:47:49,235][123091] Updated weights for policy 0, policy_version 902543 (0.0009) [2023-12-26 06:47:49,490][123090] Updated weights for policy 1, policy_version 896261 (0.0009) [2023-12-26 06:47:49,555][123090] Updated weights for policy 1, policy_version 896271 (0.0008) [2023-12-26 06:47:49,622][123090] Updated weights for policy 1, policy_version 896281 (0.0008) [2023-12-26 06:47:50,094][123091] Updated weights for policy 0, policy_version 902553 (0.0010) [2023-12-26 06:47:50,156][123091] Updated weights for policy 0, policy_version 902563 (0.0010) [2023-12-26 06:47:50,223][123091] Updated weights for policy 0, policy_version 902573 (0.0011) [2023-12-26 06:47:50,425][123090] Updated weights for policy 1, policy_version 896291 (0.0009) [2023-12-26 06:47:50,489][123090] Updated weights for policy 1, policy_version 896301 (0.0009) [2023-12-26 06:47:50,551][123090] Updated weights for policy 1, policy_version 896311 (0.0010) [2023-12-26 06:47:50,940][123091] Updated weights for policy 0, policy_version 902583 (0.0007) [2023-12-26 06:47:50,997][123091] Updated weights for policy 0, policy_version 902593 (0.0006) [2023-12-26 06:47:51,070][123091] Updated weights for policy 0, policy_version 902603 (0.0008) [2023-12-26 06:47:51,494][123090] Updated weights for policy 1, policy_version 896321 (0.0010) [2023-12-26 06:47:51,548][123090] Updated weights for policy 1, policy_version 896331 (0.0009) [2023-12-26 06:47:51,601][123090] Updated weights for policy 1, policy_version 896341 (0.0009) [2023-12-26 06:47:51,671][123090] Updated weights for policy 1, policy_version 896351 (0.0009) [2023-12-26 06:47:51,819][123091] Updated weights for policy 0, policy_version 902613 (0.0010) [2023-12-26 06:47:51,873][123091] Updated weights for policy 0, policy_version 902623 (0.0009) [2023-12-26 06:47:51,935][123091] Updated weights for policy 0, policy_version 902633 (0.0009) [2023-12-26 06:47:52,556][123090] Updated weights for policy 1, policy_version 896361 (0.0010) [2023-12-26 06:47:52,623][123090] Updated weights for policy 1, policy_version 896371 (0.0010) [2023-12-26 06:47:52,673][123091] Updated weights for policy 0, policy_version 902643 (0.0009) [2023-12-26 06:47:52,687][123090] Updated weights for policy 1, policy_version 896381 (0.0009) [2023-12-26 06:47:52,726][123091] Updated weights for policy 0, policy_version 902653 (0.0009) [2023-12-26 06:47:52,786][123091] Updated weights for policy 0, policy_version 902663 (0.0006) [2023-12-26 06:47:53,439][123091] Updated weights for policy 0, policy_version 902673 (0.0006) [2023-12-26 06:47:53,494][123091] Updated weights for policy 0, policy_version 902683 (0.0005) [2023-12-26 06:47:53,525][123090] Updated weights for policy 1, policy_version 896391 (0.0007) [2023-12-26 06:47:53,541][123091] Updated weights for policy 0, policy_version 902693 (0.0005) [2023-12-26 06:47:53,596][123091] Updated weights for policy 0, policy_version 902703 (0.0005) [2023-12-26 06:47:53,602][123090] Updated weights for policy 1, policy_version 896401 (0.0005) [2023-12-26 06:47:53,681][123090] Updated weights for policy 1, policy_version 896411 (0.0005) [2023-12-26 06:47:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 460578816. Throughput: 0: 9168.7, 1: 8644.0. Samples: 460548272. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:47:53,785][121949] Avg episode reward: [(0, '6332.159'), (1, '5729.185')] [2023-12-26 06:47:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000902704_231096320.pth... [2023-12-26 06:47:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000896416_229482496.pth... [2023-12-26 06:47:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000895392_229220352.pth [2023-12-26 06:47:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000901616_230817792.pth [2023-12-26 06:47:54,218][123091] Updated weights for policy 0, policy_version 902713 (0.0005) [2023-12-26 06:47:54,278][123091] Updated weights for policy 0, policy_version 902723 (0.0005) [2023-12-26 06:47:54,306][123090] Updated weights for policy 1, policy_version 896421 (0.0005) [2023-12-26 06:47:54,335][123091] Updated weights for policy 0, policy_version 902733 (0.0008) [2023-12-26 06:47:54,356][123090] Updated weights for policy 1, policy_version 896431 (0.0005) [2023-12-26 06:47:54,404][123090] Updated weights for policy 1, policy_version 896441 (0.0005) [2023-12-26 06:47:55,050][123091] Updated weights for policy 0, policy_version 902743 (0.0007) [2023-12-26 06:47:55,111][123091] Updated weights for policy 0, policy_version 902753 (0.0006) [2023-12-26 06:47:55,163][123091] Updated weights for policy 0, policy_version 902763 (0.0005) [2023-12-26 06:47:55,218][123090] Updated weights for policy 1, policy_version 896451 (0.0006) [2023-12-26 06:47:55,288][123090] Updated weights for policy 1, policy_version 896461 (0.0005) [2023-12-26 06:47:55,345][123090] Updated weights for policy 1, policy_version 896471 (0.0005) [2023-12-26 06:47:55,900][123091] Updated weights for policy 0, policy_version 902773 (0.0007) [2023-12-26 06:47:55,966][123091] Updated weights for policy 0, policy_version 902783 (0.0009) [2023-12-26 06:47:56,031][123091] Updated weights for policy 0, policy_version 902793 (0.0010) [2023-12-26 06:47:56,095][123090] Updated weights for policy 1, policy_version 896481 (0.0008) [2023-12-26 06:47:56,149][123090] Updated weights for policy 1, policy_version 896491 (0.0006) [2023-12-26 06:47:56,214][123090] Updated weights for policy 1, policy_version 896501 (0.0006) [2023-12-26 06:47:56,288][123090] Updated weights for policy 1, policy_version 896511 (0.0005) [2023-12-26 06:47:56,803][123091] Updated weights for policy 0, policy_version 902803 (0.0009) [2023-12-26 06:47:56,860][123091] Updated weights for policy 0, policy_version 902813 (0.0005) [2023-12-26 06:47:56,911][123090] Updated weights for policy 1, policy_version 896521 (0.0005) [2023-12-26 06:47:56,922][123091] Updated weights for policy 0, policy_version 902823 (0.0005) [2023-12-26 06:47:56,963][123090] Updated weights for policy 1, policy_version 896531 (0.0005) [2023-12-26 06:47:57,017][123090] Updated weights for policy 1, policy_version 896541 (0.0005) [2023-12-26 06:47:57,643][123091] Updated weights for policy 0, policy_version 902833 (0.0006) [2023-12-26 06:47:57,645][123090] Updated weights for policy 1, policy_version 896551 (0.0005) [2023-12-26 06:47:57,696][123091] Updated weights for policy 0, policy_version 902843 (0.0009) [2023-12-26 06:47:57,698][123090] Updated weights for policy 1, policy_version 896561 (0.0005) [2023-12-26 06:47:57,749][123091] Updated weights for policy 0, policy_version 902853 (0.0009) [2023-12-26 06:47:57,759][123090] Updated weights for policy 1, policy_version 896571 (0.0005) [2023-12-26 06:47:57,804][123091] Updated weights for policy 0, policy_version 902863 (0.0009) [2023-12-26 06:47:58,583][123090] Updated weights for policy 1, policy_version 896581 (0.0006) [2023-12-26 06:47:58,611][123091] Updated weights for policy 0, policy_version 902873 (0.0010) [2023-12-26 06:47:58,649][123090] Updated weights for policy 1, policy_version 896591 (0.0008) [2023-12-26 06:47:58,685][123091] Updated weights for policy 0, policy_version 902883 (0.0009) [2023-12-26 06:47:58,723][123090] Updated weights for policy 1, policy_version 896601 (0.0009) [2023-12-26 06:47:58,751][123091] Updated weights for policy 0, policy_version 902893 (0.0009) [2023-12-26 06:47:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17886.7, 300 sec: 17689.2). Total num frames: 460677120. Throughput: 0: 9232.2, 1: 8774.0. Samples: 460662940. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:47:58,785][121949] Avg episode reward: [(0, '6223.603'), (1, '5622.152')] [2023-12-26 06:47:59,521][123091] Updated weights for policy 0, policy_version 902903 (0.0007) [2023-12-26 06:47:59,588][123091] Updated weights for policy 0, policy_version 902913 (0.0007) [2023-12-26 06:47:59,600][123090] Updated weights for policy 1, policy_version 896611 (0.0010) [2023-12-26 06:47:59,647][123091] Updated weights for policy 0, policy_version 902923 (0.0011) [2023-12-26 06:47:59,667][123090] Updated weights for policy 1, policy_version 896621 (0.0010) [2023-12-26 06:47:59,734][123090] Updated weights for policy 1, policy_version 896631 (0.0011) [2023-12-26 06:48:00,402][123091] Updated weights for policy 0, policy_version 902933 (0.0008) [2023-12-26 06:48:00,453][123091] Updated weights for policy 0, policy_version 902943 (0.0010) [2023-12-26 06:48:00,501][123091] Updated weights for policy 0, policy_version 902953 (0.0010) [2023-12-26 06:48:00,544][123090] Updated weights for policy 1, policy_version 896641 (0.0009) [2023-12-26 06:48:00,598][123090] Updated weights for policy 1, policy_version 896651 (0.0009) [2023-12-26 06:48:00,651][123090] Updated weights for policy 1, policy_version 896661 (0.0009) [2023-12-26 06:48:00,708][123090] Updated weights for policy 1, policy_version 896671 (0.0009) [2023-12-26 06:48:01,309][123091] Updated weights for policy 0, policy_version 902963 (0.0009) [2023-12-26 06:48:01,377][123091] Updated weights for policy 0, policy_version 902973 (0.0008) [2023-12-26 06:48:01,443][123091] Updated weights for policy 0, policy_version 902983 (0.0006) [2023-12-26 06:48:01,548][123090] Updated weights for policy 1, policy_version 896681 (0.0010) [2023-12-26 06:48:01,614][123090] Updated weights for policy 1, policy_version 896691 (0.0009) [2023-12-26 06:48:01,685][123090] Updated weights for policy 1, policy_version 896701 (0.0009) [2023-12-26 06:48:02,204][123091] Updated weights for policy 0, policy_version 902993 (0.0006) [2023-12-26 06:48:02,267][123091] Updated weights for policy 0, policy_version 903003 (0.0007) [2023-12-26 06:48:02,320][123091] Updated weights for policy 0, policy_version 903013 (0.0007) [2023-12-26 06:48:02,385][123091] Updated weights for policy 0, policy_version 903023 (0.0008) [2023-12-26 06:48:02,606][123090] Updated weights for policy 1, policy_version 896711 (0.0009) [2023-12-26 06:48:02,667][123090] Updated weights for policy 1, policy_version 896721 (0.0009) [2023-12-26 06:48:02,728][123090] Updated weights for policy 1, policy_version 896731 (0.0009) [2023-12-26 06:48:03,059][123091] Updated weights for policy 0, policy_version 903033 (0.0010) [2023-12-26 06:48:03,102][123091] Updated weights for policy 0, policy_version 903043 (0.0010) [2023-12-26 06:48:03,147][123091] Updated weights for policy 0, policy_version 903053 (0.0005) [2023-12-26 06:48:03,402][123090] Updated weights for policy 1, policy_version 896741 (0.0008) [2023-12-26 06:48:03,448][123090] Updated weights for policy 1, policy_version 896751 (0.0006) [2023-12-26 06:48:03,502][123090] Updated weights for policy 1, policy_version 896761 (0.0007) [2023-12-26 06:48:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 460759040. Throughput: 0: 9172.4, 1: 8754.0. Samples: 460769924. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:03,785][121949] Avg episode reward: [(0, '6233.506'), (1, '5387.152')] [2023-12-26 06:48:03,893][123091] Updated weights for policy 0, policy_version 903063 (0.0007) [2023-12-26 06:48:03,948][123091] Updated weights for policy 0, policy_version 903073 (0.0007) [2023-12-26 06:48:03,992][123091] Updated weights for policy 0, policy_version 903083 (0.0010) [2023-12-26 06:48:04,354][123090] Updated weights for policy 1, policy_version 896771 (0.0008) [2023-12-26 06:48:04,413][123090] Updated weights for policy 1, policy_version 896781 (0.0010) [2023-12-26 06:48:04,462][123090] Updated weights for policy 1, policy_version 896791 (0.0009) [2023-12-26 06:48:04,794][123091] Updated weights for policy 0, policy_version 903093 (0.0011) [2023-12-26 06:48:04,842][123091] Updated weights for policy 0, policy_version 903103 (0.0010) [2023-12-26 06:48:04,906][123091] Updated weights for policy 0, policy_version 903113 (0.0011) [2023-12-26 06:48:05,296][123090] Updated weights for policy 1, policy_version 896801 (0.0009) [2023-12-26 06:48:05,363][123090] Updated weights for policy 1, policy_version 896811 (0.0005) [2023-12-26 06:48:05,409][123090] Updated weights for policy 1, policy_version 896821 (0.0005) [2023-12-26 06:48:05,455][123090] Updated weights for policy 1, policy_version 896831 (0.0005) [2023-12-26 06:48:05,670][123091] Updated weights for policy 0, policy_version 903123 (0.0011) [2023-12-26 06:48:05,732][123091] Updated weights for policy 0, policy_version 903133 (0.0010) [2023-12-26 06:48:05,794][123091] Updated weights for policy 0, policy_version 903143 (0.0011) [2023-12-26 06:48:06,179][123090] Updated weights for policy 1, policy_version 896841 (0.0010) [2023-12-26 06:48:06,236][123090] Updated weights for policy 1, policy_version 896851 (0.0010) [2023-12-26 06:48:06,294][123090] Updated weights for policy 1, policy_version 896861 (0.0010) [2023-12-26 06:48:06,504][123091] Updated weights for policy 0, policy_version 903153 (0.0011) [2023-12-26 06:48:06,568][123091] Updated weights for policy 0, policy_version 903163 (0.0011) [2023-12-26 06:48:06,633][123091] Updated weights for policy 0, policy_version 903173 (0.0011) [2023-12-26 06:48:06,696][123091] Updated weights for policy 0, policy_version 903183 (0.0011) [2023-12-26 06:48:07,130][123090] Updated weights for policy 1, policy_version 896871 (0.0011) [2023-12-26 06:48:07,182][123090] Updated weights for policy 1, policy_version 896881 (0.0010) [2023-12-26 06:48:07,235][123090] Updated weights for policy 1, policy_version 896891 (0.0010) [2023-12-26 06:48:07,507][123091] Updated weights for policy 0, policy_version 903193 (0.0011) [2023-12-26 06:48:07,567][123091] Updated weights for policy 0, policy_version 903203 (0.0011) [2023-12-26 06:48:07,619][123091] Updated weights for policy 0, policy_version 903213 (0.0011) [2023-12-26 06:48:08,024][123090] Updated weights for policy 1, policy_version 896901 (0.0010) [2023-12-26 06:48:08,077][123090] Updated weights for policy 1, policy_version 896911 (0.0010) [2023-12-26 06:48:08,129][123090] Updated weights for policy 1, policy_version 896921 (0.0010) [2023-12-26 06:48:08,422][123091] Updated weights for policy 0, policy_version 903223 (0.0011) [2023-12-26 06:48:08,479][123091] Updated weights for policy 0, policy_version 903233 (0.0011) [2023-12-26 06:48:08,539][123091] Updated weights for policy 0, policy_version 903243 (0.0010) [2023-12-26 06:48:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 460849152. Throughput: 0: 9218.5, 1: 8783.2. Samples: 460824632. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:08,784][121949] Avg episode reward: [(0, '6360.846'), (1, '5579.750')] [2023-12-26 06:48:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000903248_231235584.pth... [2023-12-26 06:48:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000896928_229613568.pth... [2023-12-26 06:48:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000902160_230957056.pth [2023-12-26 06:48:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000895904_229351424.pth [2023-12-26 06:48:08,966][123090] Updated weights for policy 1, policy_version 896931 (0.0010) [2023-12-26 06:48:09,034][123090] Updated weights for policy 1, policy_version 896941 (0.0010) [2023-12-26 06:48:09,098][123090] Updated weights for policy 1, policy_version 896951 (0.0009) [2023-12-26 06:48:09,376][123091] Updated weights for policy 0, policy_version 903253 (0.0013) [2023-12-26 06:48:09,445][123091] Updated weights for policy 0, policy_version 903263 (0.0009) [2023-12-26 06:48:09,500][123091] Updated weights for policy 0, policy_version 903273 (0.0009) [2023-12-26 06:48:09,960][123090] Updated weights for policy 1, policy_version 896961 (0.0009) [2023-12-26 06:48:10,013][123090] Updated weights for policy 1, policy_version 896971 (0.0005) [2023-12-26 06:48:10,074][123090] Updated weights for policy 1, policy_version 896981 (0.0005) [2023-12-26 06:48:10,147][123090] Updated weights for policy 1, policy_version 896991 (0.0006) [2023-12-26 06:48:10,293][123091] Updated weights for policy 0, policy_version 903283 (0.0010) [2023-12-26 06:48:10,361][123091] Updated weights for policy 0, policy_version 903293 (0.0010) [2023-12-26 06:48:10,417][123091] Updated weights for policy 0, policy_version 903303 (0.0009) [2023-12-26 06:48:10,846][123090] Updated weights for policy 1, policy_version 897001 (0.0010) [2023-12-26 06:48:10,905][123090] Updated weights for policy 1, policy_version 897011 (0.0010) [2023-12-26 06:48:10,965][123090] Updated weights for policy 1, policy_version 897021 (0.0010) [2023-12-26 06:48:11,267][123091] Updated weights for policy 0, policy_version 903313 (0.0009) [2023-12-26 06:48:11,323][123091] Updated weights for policy 0, policy_version 903323 (0.0007) [2023-12-26 06:48:11,399][123091] Updated weights for policy 0, policy_version 903333 (0.0008) [2023-12-26 06:48:11,469][123091] Updated weights for policy 0, policy_version 903343 (0.0006) [2023-12-26 06:48:11,845][123090] Updated weights for policy 1, policy_version 897031 (0.0010) [2023-12-26 06:48:11,906][123090] Updated weights for policy 1, policy_version 897041 (0.0009) [2023-12-26 06:48:11,966][123090] Updated weights for policy 1, policy_version 897051 (0.0009) [2023-12-26 06:48:12,194][123091] Updated weights for policy 0, policy_version 903353 (0.0008) [2023-12-26 06:48:12,246][123091] Updated weights for policy 0, policy_version 903363 (0.0008) [2023-12-26 06:48:12,316][123091] Updated weights for policy 0, policy_version 903373 (0.0008) [2023-12-26 06:48:12,835][123090] Updated weights for policy 1, policy_version 897061 (0.0010) [2023-12-26 06:48:12,892][123090] Updated weights for policy 1, policy_version 897071 (0.0009) [2023-12-26 06:48:12,957][123090] Updated weights for policy 1, policy_version 897081 (0.0009) [2023-12-26 06:48:13,090][123091] Updated weights for policy 0, policy_version 903383 (0.0006) [2023-12-26 06:48:13,147][123091] Updated weights for policy 0, policy_version 903393 (0.0008) [2023-12-26 06:48:13,199][123091] Updated weights for policy 0, policy_version 903403 (0.0011) [2023-12-26 06:48:13,714][123090] Updated weights for policy 1, policy_version 897091 (0.0008) [2023-12-26 06:48:13,768][123090] Updated weights for policy 1, policy_version 897101 (0.0005) [2023-12-26 06:48:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 460931072. Throughput: 0: 9237.6, 1: 8776.8. Samples: 460928020. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:13,785][121949] Avg episode reward: [(0, '6373.714'), (1, '5648.704')] [2023-12-26 06:48:13,838][123090] Updated weights for policy 1, policy_version 897111 (0.0008) [2023-12-26 06:48:13,995][123091] Updated weights for policy 0, policy_version 903413 (0.0010) [2023-12-26 06:48:14,051][123091] Updated weights for policy 0, policy_version 903423 (0.0006) [2023-12-26 06:48:14,112][123091] Updated weights for policy 0, policy_version 903433 (0.0008) [2023-12-26 06:48:14,526][123090] Updated weights for policy 1, policy_version 897121 (0.0005) [2023-12-26 06:48:14,576][123090] Updated weights for policy 1, policy_version 897131 (0.0005) [2023-12-26 06:48:14,623][123090] Updated weights for policy 1, policy_version 897141 (0.0005) [2023-12-26 06:48:14,679][123090] Updated weights for policy 1, policy_version 897151 (0.0005) [2023-12-26 06:48:14,921][123091] Updated weights for policy 0, policy_version 903443 (0.0010) [2023-12-26 06:48:14,975][123091] Updated weights for policy 0, policy_version 903453 (0.0010) [2023-12-26 06:48:15,038][123091] Updated weights for policy 0, policy_version 903463 (0.0010) [2023-12-26 06:48:15,403][123090] Updated weights for policy 1, policy_version 897161 (0.0005) [2023-12-26 06:48:15,470][123090] Updated weights for policy 1, policy_version 897171 (0.0006) [2023-12-26 06:48:15,545][123090] Updated weights for policy 1, policy_version 897181 (0.0005) [2023-12-26 06:48:15,999][123091] Updated weights for policy 0, policy_version 903473 (0.0010) [2023-12-26 06:48:16,051][123091] Updated weights for policy 0, policy_version 903483 (0.0009) [2023-12-26 06:48:16,102][123091] Updated weights for policy 0, policy_version 903493 (0.0009) [2023-12-26 06:48:16,161][123091] Updated weights for policy 0, policy_version 903503 (0.0009) [2023-12-26 06:48:16,199][123090] Updated weights for policy 1, policy_version 897191 (0.0005) [2023-12-26 06:48:16,267][123090] Updated weights for policy 1, policy_version 897201 (0.0005) [2023-12-26 06:48:16,331][123090] Updated weights for policy 1, policy_version 897211 (0.0005) [2023-12-26 06:48:16,966][123090] Updated weights for policy 1, policy_version 897221 (0.0007) [2023-12-26 06:48:17,025][123090] Updated weights for policy 1, policy_version 897231 (0.0005) [2023-12-26 06:48:17,075][123090] Updated weights for policy 1, policy_version 897241 (0.0005) [2023-12-26 06:48:17,082][123091] Updated weights for policy 0, policy_version 903513 (0.0006) [2023-12-26 06:48:17,150][123091] Updated weights for policy 0, policy_version 903523 (0.0008) [2023-12-26 06:48:17,205][123091] Updated weights for policy 0, policy_version 903533 (0.0010) [2023-12-26 06:48:17,705][123090] Updated weights for policy 1, policy_version 897251 (0.0005) [2023-12-26 06:48:17,755][123090] Updated weights for policy 1, policy_version 897261 (0.0005) [2023-12-26 06:48:17,806][123090] Updated weights for policy 1, policy_version 897271 (0.0006) [2023-12-26 06:48:18,061][123091] Updated weights for policy 0, policy_version 903543 (0.0010) [2023-12-26 06:48:18,112][123091] Updated weights for policy 0, policy_version 903553 (0.0010) [2023-12-26 06:48:18,164][123091] Updated weights for policy 0, policy_version 903563 (0.0010) [2023-12-26 06:48:18,468][123090] Updated weights for policy 1, policy_version 897281 (0.0005) [2023-12-26 06:48:18,535][123090] Updated weights for policy 1, policy_version 897291 (0.0006) [2023-12-26 06:48:18,596][123090] Updated weights for policy 1, policy_version 897301 (0.0006) [2023-12-26 06:48:18,656][123090] Updated weights for policy 1, policy_version 897311 (0.0006) [2023-12-26 06:48:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 461029376. Throughput: 0: 9097.7, 1: 9009.6. Samples: 461039336. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:18,785][121949] Avg episode reward: [(0, '6363.788'), (1, '5636.839')] [2023-12-26 06:48:18,943][123091] Updated weights for policy 0, policy_version 903573 (0.0009) [2023-12-26 06:48:19,008][123091] Updated weights for policy 0, policy_version 903583 (0.0010) [2023-12-26 06:48:19,071][123091] Updated weights for policy 0, policy_version 903593 (0.0011) [2023-12-26 06:48:19,333][123090] Updated weights for policy 1, policy_version 897321 (0.0006) [2023-12-26 06:48:19,400][123090] Updated weights for policy 1, policy_version 897331 (0.0010) [2023-12-26 06:48:19,448][123090] Updated weights for policy 1, policy_version 897341 (0.0010) [2023-12-26 06:48:19,844][123091] Updated weights for policy 0, policy_version 903603 (0.0010) [2023-12-26 06:48:19,908][123091] Updated weights for policy 0, policy_version 903613 (0.0010) [2023-12-26 06:48:19,973][123091] Updated weights for policy 0, policy_version 903623 (0.0011) [2023-12-26 06:48:20,319][123090] Updated weights for policy 1, policy_version 897351 (0.0008) [2023-12-26 06:48:20,386][123090] Updated weights for policy 1, policy_version 897361 (0.0009) [2023-12-26 06:48:20,461][123090] Updated weights for policy 1, policy_version 897371 (0.0008) [2023-12-26 06:48:20,819][123091] Updated weights for policy 0, policy_version 903633 (0.0011) [2023-12-26 06:48:20,883][123091] Updated weights for policy 0, policy_version 903643 (0.0011) [2023-12-26 06:48:20,948][123091] Updated weights for policy 0, policy_version 903653 (0.0011) [2023-12-26 06:48:21,020][123091] Updated weights for policy 0, policy_version 903663 (0.0011) [2023-12-26 06:48:21,276][123090] Updated weights for policy 1, policy_version 897381 (0.0009) [2023-12-26 06:48:21,339][123090] Updated weights for policy 1, policy_version 897391 (0.0009) [2023-12-26 06:48:21,414][123090] Updated weights for policy 1, policy_version 897401 (0.0009) [2023-12-26 06:48:21,835][123091] Updated weights for policy 0, policy_version 903673 (0.0009) [2023-12-26 06:48:21,906][123091] Updated weights for policy 0, policy_version 903684 (0.0010) [2023-12-26 06:48:21,969][123091] Updated weights for policy 0, policy_version 903694 (0.0010) [2023-12-26 06:48:22,260][123090] Updated weights for policy 1, policy_version 897411 (0.0009) [2023-12-26 06:48:22,331][123090] Updated weights for policy 1, policy_version 897421 (0.0009) [2023-12-26 06:48:22,400][123090] Updated weights for policy 1, policy_version 897431 (0.0010) [2023-12-26 06:48:22,815][123091] Updated weights for policy 0, policy_version 903704 (0.0009) [2023-12-26 06:48:22,880][123091] Updated weights for policy 0, policy_version 903714 (0.0009) [2023-12-26 06:48:22,951][123091] Updated weights for policy 0, policy_version 903724 (0.0009) [2023-12-26 06:48:23,239][123090] Updated weights for policy 1, policy_version 897441 (0.0009) [2023-12-26 06:48:23,288][123090] Updated weights for policy 1, policy_version 897451 (0.0009) [2023-12-26 06:48:23,350][123090] Updated weights for policy 1, policy_version 897461 (0.0009) [2023-12-26 06:48:23,396][123090] Updated weights for policy 1, policy_version 897471 (0.0008) [2023-12-26 06:48:23,662][123091] Updated weights for policy 0, policy_version 903734 (0.0006) [2023-12-26 06:48:23,718][123091] Updated weights for policy 0, policy_version 903744 (0.0006) [2023-12-26 06:48:23,774][123091] Updated weights for policy 0, policy_version 903754 (0.0006) [2023-12-26 06:48:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 461111296. Throughput: 0: 9038.5, 1: 9008.6. Samples: 461090852. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:23,785][121949] Avg episode reward: [(0, '6372.614'), (1, '5776.496')] [2023-12-26 06:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000897472_229752832.pth... [2023-12-26 06:48:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000896416_229482496.pth [2023-12-26 06:48:23,805][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000903760_231366656.pth... [2023-12-26 06:48:23,808][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000902704_231096320.pth [2023-12-26 06:48:24,311][123090] Updated weights for policy 1, policy_version 897481 (0.0010) [2023-12-26 06:48:24,368][123090] Updated weights for policy 1, policy_version 897491 (0.0010) [2023-12-26 06:48:24,431][123090] Updated weights for policy 1, policy_version 897501 (0.0010) [2023-12-26 06:48:24,510][123091] Updated weights for policy 0, policy_version 903764 (0.0006) [2023-12-26 06:48:24,559][123091] Updated weights for policy 0, policy_version 903774 (0.0005) [2023-12-26 06:48:24,613][123091] Updated weights for policy 0, policy_version 903784 (0.0006) [2023-12-26 06:48:25,236][123090] Updated weights for policy 1, policy_version 897511 (0.0007) [2023-12-26 06:48:25,298][123090] Updated weights for policy 1, policy_version 897521 (0.0005) [2023-12-26 06:48:25,351][123090] Updated weights for policy 1, policy_version 897531 (0.0005) [2023-12-26 06:48:25,431][123091] Updated weights for policy 0, policy_version 903794 (0.0006) [2023-12-26 06:48:25,484][123091] Updated weights for policy 0, policy_version 903804 (0.0009) [2023-12-26 06:48:25,536][123091] Updated weights for policy 0, policy_version 903814 (0.0010) [2023-12-26 06:48:25,589][123091] Updated weights for policy 0, policy_version 903824 (0.0010) [2023-12-26 06:48:26,062][123090] Updated weights for policy 1, policy_version 897541 (0.0005) [2023-12-26 06:48:26,114][123090] Updated weights for policy 1, policy_version 897551 (0.0005) [2023-12-26 06:48:26,189][123090] Updated weights for policy 1, policy_version 897561 (0.0007) [2023-12-26 06:48:26,465][123091] Updated weights for policy 0, policy_version 903834 (0.0007) [2023-12-26 06:48:26,528][123091] Updated weights for policy 0, policy_version 903844 (0.0005) [2023-12-26 06:48:26,586][123091] Updated weights for policy 0, policy_version 903854 (0.0006) [2023-12-26 06:48:26,868][123090] Updated weights for policy 1, policy_version 897571 (0.0008) [2023-12-26 06:48:26,932][123090] Updated weights for policy 1, policy_version 897581 (0.0005) [2023-12-26 06:48:26,993][123090] Updated weights for policy 1, policy_version 897591 (0.0005) [2023-12-26 06:48:27,265][123091] Updated weights for policy 0, policy_version 903864 (0.0005) [2023-12-26 06:48:27,325][123091] Updated weights for policy 0, policy_version 903874 (0.0006) [2023-12-26 06:48:27,373][123091] Updated weights for policy 0, policy_version 903884 (0.0005) [2023-12-26 06:48:27,582][123090] Updated weights for policy 1, policy_version 897601 (0.0005) [2023-12-26 06:48:27,642][123090] Updated weights for policy 1, policy_version 897611 (0.0005) [2023-12-26 06:48:27,700][123090] Updated weights for policy 1, policy_version 897621 (0.0005) [2023-12-26 06:48:27,763][123090] Updated weights for policy 1, policy_version 897631 (0.0010) [2023-12-26 06:48:28,120][123091] Updated weights for policy 0, policy_version 903894 (0.0007) [2023-12-26 06:48:28,190][123091] Updated weights for policy 0, policy_version 903904 (0.0010) [2023-12-26 06:48:28,249][123091] Updated weights for policy 0, policy_version 903914 (0.0010) [2023-12-26 06:48:28,503][123090] Updated weights for policy 1, policy_version 897641 (0.0010) [2023-12-26 06:48:28,565][123090] Updated weights for policy 1, policy_version 897651 (0.0010) [2023-12-26 06:48:28,624][123090] Updated weights for policy 1, policy_version 897661 (0.0010) [2023-12-26 06:48:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18159.0, 300 sec: 17689.2). Total num frames: 461209600. Throughput: 0: 9093.4, 1: 9062.4. Samples: 461200484. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:28,784][121949] Avg episode reward: [(0, '6367.174'), (1, '5791.116')] [2023-12-26 06:48:29,043][123091] Updated weights for policy 0, policy_version 903924 (0.0008) [2023-12-26 06:48:29,091][123091] Updated weights for policy 0, policy_version 903934 (0.0009) [2023-12-26 06:48:29,139][123091] Updated weights for policy 0, policy_version 903944 (0.0009) [2023-12-26 06:48:29,450][123090] Updated weights for policy 1, policy_version 897671 (0.0010) [2023-12-26 06:48:29,518][123090] Updated weights for policy 1, policy_version 897681 (0.0010) [2023-12-26 06:48:29,581][123090] Updated weights for policy 1, policy_version 897691 (0.0005) [2023-12-26 06:48:30,044][123091] Updated weights for policy 0, policy_version 903954 (0.0008) [2023-12-26 06:48:30,094][123091] Updated weights for policy 0, policy_version 903964 (0.0009) [2023-12-26 06:48:30,153][123091] Updated weights for policy 0, policy_version 903975 (0.0009) [2023-12-26 06:48:30,302][123090] Updated weights for policy 1, policy_version 897701 (0.0007) [2023-12-26 06:48:30,355][123090] Updated weights for policy 1, policy_version 897711 (0.0010) [2023-12-26 06:48:30,416][123090] Updated weights for policy 1, policy_version 897721 (0.0008) [2023-12-26 06:48:31,022][123091] Updated weights for policy 0, policy_version 903985 (0.0009) [2023-12-26 06:48:31,085][123091] Updated weights for policy 0, policy_version 903995 (0.0009) [2023-12-26 06:48:31,141][123091] Updated weights for policy 0, policy_version 904005 (0.0011) [2023-12-26 06:48:31,192][123090] Updated weights for policy 1, policy_version 897731 (0.0009) [2023-12-26 06:48:31,209][123091] Updated weights for policy 0, policy_version 904015 (0.0011) [2023-12-26 06:48:31,247][123090] Updated weights for policy 1, policy_version 897741 (0.0008) [2023-12-26 06:48:31,300][123090] Updated weights for policy 1, policy_version 897751 (0.0009) [2023-12-26 06:48:32,039][123091] Updated weights for policy 0, policy_version 904025 (0.0009) [2023-12-26 06:48:32,109][123091] Updated weights for policy 0, policy_version 904035 (0.0010) [2023-12-26 06:48:32,122][123090] Updated weights for policy 1, policy_version 897761 (0.0009) [2023-12-26 06:48:32,170][123091] Updated weights for policy 0, policy_version 904045 (0.0008) [2023-12-26 06:48:32,187][123090] Updated weights for policy 1, policy_version 897771 (0.0008) [2023-12-26 06:48:32,245][123090] Updated weights for policy 1, policy_version 897781 (0.0010) [2023-12-26 06:48:32,321][123090] Updated weights for policy 1, policy_version 897791 (0.0008) [2023-12-26 06:48:32,988][123091] Updated weights for policy 0, policy_version 904055 (0.0007) [2023-12-26 06:48:33,041][123091] Updated weights for policy 0, policy_version 904065 (0.0005) [2023-12-26 06:48:33,086][123091] Updated weights for policy 0, policy_version 904075 (0.0009) [2023-12-26 06:48:33,144][123090] Updated weights for policy 1, policy_version 897801 (0.0008) [2023-12-26 06:48:33,194][123090] Updated weights for policy 1, policy_version 897811 (0.0009) [2023-12-26 06:48:33,250][123090] Updated weights for policy 1, policy_version 897821 (0.0007) [2023-12-26 06:48:33,766][123091] Updated weights for policy 0, policy_version 904085 (0.0007) [2023-12-26 06:48:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.3, 300 sec: 17689.2). Total num frames: 461291520. Throughput: 0: 8969.2, 1: 9025.8. Samples: 461306800. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:33,785][121949] Avg episode reward: [(0, '6300.276'), (1, '5649.563')] [2023-12-26 06:48:33,819][123091] Updated weights for policy 0, policy_version 904095 (0.0005) [2023-12-26 06:48:33,871][123091] Updated weights for policy 0, policy_version 904105 (0.0005) [2023-12-26 06:48:33,936][123090] Updated weights for policy 1, policy_version 897831 (0.0007) [2023-12-26 06:48:33,989][123090] Updated weights for policy 1, policy_version 897841 (0.0006) [2023-12-26 06:48:34,038][123090] Updated weights for policy 1, policy_version 897851 (0.0005) [2023-12-26 06:48:34,556][123091] Updated weights for policy 0, policy_version 904115 (0.0005) [2023-12-26 06:48:34,625][123091] Updated weights for policy 0, policy_version 904125 (0.0006) [2023-12-26 06:48:34,679][123091] Updated weights for policy 0, policy_version 904135 (0.0009) [2023-12-26 06:48:34,846][123090] Updated weights for policy 1, policy_version 897861 (0.0005) [2023-12-26 06:48:34,893][123090] Updated weights for policy 1, policy_version 897871 (0.0005) [2023-12-26 06:48:34,939][123090] Updated weights for policy 1, policy_version 897881 (0.0005) [2023-12-26 06:48:35,591][123091] Updated weights for policy 0, policy_version 904145 (0.0010) [2023-12-26 06:48:35,592][123090] Updated weights for policy 1, policy_version 897891 (0.0006) [2023-12-26 06:48:35,650][123091] Updated weights for policy 0, policy_version 904155 (0.0007) [2023-12-26 06:48:35,651][123090] Updated weights for policy 1, policy_version 897901 (0.0009) [2023-12-26 06:48:35,705][123090] Updated weights for policy 1, policy_version 897911 (0.0009) [2023-12-26 06:48:35,709][123091] Updated weights for policy 0, policy_version 904165 (0.0009) [2023-12-26 06:48:35,772][123091] Updated weights for policy 0, policy_version 904175 (0.0008) [2023-12-26 06:48:36,460][123090] Updated weights for policy 1, policy_version 897921 (0.0009) [2023-12-26 06:48:36,530][123090] Updated weights for policy 1, policy_version 897931 (0.0009) [2023-12-26 06:48:36,587][123090] Updated weights for policy 1, policy_version 897941 (0.0008) [2023-12-26 06:48:36,643][123091] Updated weights for policy 0, policy_version 904185 (0.0011) [2023-12-26 06:48:36,650][123090] Updated weights for policy 1, policy_version 897951 (0.0006) [2023-12-26 06:48:36,710][123091] Updated weights for policy 0, policy_version 904195 (0.0011) [2023-12-26 06:48:36,758][123091] Updated weights for policy 0, policy_version 904205 (0.0010) [2023-12-26 06:48:37,495][123091] Updated weights for policy 0, policy_version 904215 (0.0008) [2023-12-26 06:48:37,541][123090] Updated weights for policy 1, policy_version 897961 (0.0008) [2023-12-26 06:48:37,556][123091] Updated weights for policy 0, policy_version 904225 (0.0007) [2023-12-26 06:48:37,615][123090] Updated weights for policy 1, policy_version 897971 (0.0009) [2023-12-26 06:48:37,619][123091] Updated weights for policy 0, policy_version 904235 (0.0005) [2023-12-26 06:48:37,684][123090] Updated weights for policy 1, policy_version 897981 (0.0008) [2023-12-26 06:48:38,414][123090] Updated weights for policy 1, policy_version 897991 (0.0009) [2023-12-26 06:48:38,467][123090] Updated weights for policy 1, policy_version 898001 (0.0009) [2023-12-26 06:48:38,497][123091] Updated weights for policy 0, policy_version 904245 (0.0008) [2023-12-26 06:48:38,517][123090] Updated weights for policy 1, policy_version 898011 (0.0009) [2023-12-26 06:48:38,548][123091] Updated weights for policy 0, policy_version 904255 (0.0006) [2023-12-26 06:48:38,603][123091] Updated weights for policy 0, policy_version 904265 (0.0007) [2023-12-26 06:48:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 461389824. Throughput: 0: 8960.0, 1: 9100.3. Samples: 461360984. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:38,785][121949] Avg episode reward: [(0, '6248.803'), (1, '5420.496')] [2023-12-26 06:48:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000904272_231497728.pth... [2023-12-26 06:48:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000898016_229892096.pth... [2023-12-26 06:48:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000903248_231235584.pth [2023-12-26 06:48:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000896928_229613568.pth [2023-12-26 06:48:39,395][123091] Updated weights for policy 0, policy_version 904275 (0.0008) [2023-12-26 06:48:39,438][123090] Updated weights for policy 1, policy_version 898021 (0.0008) [2023-12-26 06:48:39,465][123091] Updated weights for policy 0, policy_version 904285 (0.0010) [2023-12-26 06:48:39,501][123090] Updated weights for policy 1, policy_version 898031 (0.0007) [2023-12-26 06:48:39,522][123091] Updated weights for policy 0, policy_version 904295 (0.0009) [2023-12-26 06:48:39,553][123090] Updated weights for policy 1, policy_version 898041 (0.0007) [2023-12-26 06:48:40,312][123091] Updated weights for policy 0, policy_version 904305 (0.0009) [2023-12-26 06:48:40,380][123091] Updated weights for policy 0, policy_version 904315 (0.0011) [2023-12-26 06:48:40,423][123090] Updated weights for policy 1, policy_version 898051 (0.0008) [2023-12-26 06:48:40,444][123091] Updated weights for policy 0, policy_version 904325 (0.0011) [2023-12-26 06:48:40,482][123090] Updated weights for policy 1, policy_version 898061 (0.0007) [2023-12-26 06:48:40,509][123091] Updated weights for policy 0, policy_version 904335 (0.0011) [2023-12-26 06:48:40,533][123090] Updated weights for policy 1, policy_version 898071 (0.0009) [2023-12-26 06:48:41,289][123091] Updated weights for policy 0, policy_version 904345 (0.0013) [2023-12-26 06:48:41,357][123091] Updated weights for policy 0, policy_version 904355 (0.0010) [2023-12-26 06:48:41,413][123090] Updated weights for policy 1, policy_version 898081 (0.0010) [2023-12-26 06:48:41,432][123091] Updated weights for policy 0, policy_version 904365 (0.0008) [2023-12-26 06:48:41,483][123090] Updated weights for policy 1, policy_version 898091 (0.0010) [2023-12-26 06:48:41,549][123090] Updated weights for policy 1, policy_version 898101 (0.0010) [2023-12-26 06:48:41,627][123090] Updated weights for policy 1, policy_version 898111 (0.0009) [2023-12-26 06:48:42,257][123091] Updated weights for policy 0, policy_version 904375 (0.0008) [2023-12-26 06:48:42,327][123091] Updated weights for policy 0, policy_version 904385 (0.0010) [2023-12-26 06:48:42,401][123091] Updated weights for policy 0, policy_version 904395 (0.0009) [2023-12-26 06:48:42,496][123090] Updated weights for policy 1, policy_version 898121 (0.0010) [2023-12-26 06:48:42,558][123090] Updated weights for policy 1, policy_version 898131 (0.0010) [2023-12-26 06:48:42,619][123090] Updated weights for policy 1, policy_version 898141 (0.0008) [2023-12-26 06:48:43,261][123091] Updated weights for policy 0, policy_version 904405 (0.0009) [2023-12-26 06:48:43,315][123091] Updated weights for policy 0, policy_version 904415 (0.0009) [2023-12-26 06:48:43,370][123091] Updated weights for policy 0, policy_version 904425 (0.0010) [2023-12-26 06:48:43,418][123090] Updated weights for policy 1, policy_version 898151 (0.0006) [2023-12-26 06:48:43,471][123090] Updated weights for policy 1, policy_version 898161 (0.0009) [2023-12-26 06:48:43,524][123090] Updated weights for policy 1, policy_version 898171 (0.0009) [2023-12-26 06:48:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 461471744. Throughput: 0: 8837.5, 1: 8946.8. Samples: 461463232. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:43,785][121949] Avg episode reward: [(0, '6300.239'), (1, '5433.199')] [2023-12-26 06:48:44,190][123091] Updated weights for policy 0, policy_version 904435 (0.0009) [2023-12-26 06:48:44,243][123091] Updated weights for policy 0, policy_version 904445 (0.0006) [2023-12-26 06:48:44,303][123091] Updated weights for policy 0, policy_version 904455 (0.0005) [2023-12-26 06:48:44,383][123090] Updated weights for policy 1, policy_version 898181 (0.0009) [2023-12-26 06:48:44,431][123090] Updated weights for policy 1, policy_version 898191 (0.0009) [2023-12-26 06:48:44,478][123090] Updated weights for policy 1, policy_version 898201 (0.0008) [2023-12-26 06:48:45,112][123091] Updated weights for policy 0, policy_version 904465 (0.0007) [2023-12-26 06:48:45,183][123091] Updated weights for policy 0, policy_version 904475 (0.0011) [2023-12-26 06:48:45,246][123091] Updated weights for policy 0, policy_version 904485 (0.0011) [2023-12-26 06:48:45,313][123091] Updated weights for policy 0, policy_version 904495 (0.0011) [2023-12-26 06:48:45,333][123090] Updated weights for policy 1, policy_version 898211 (0.0008) [2023-12-26 06:48:45,388][123090] Updated weights for policy 1, policy_version 898221 (0.0005) [2023-12-26 06:48:45,438][123090] Updated weights for policy 1, policy_version 898231 (0.0006) [2023-12-26 06:48:46,118][123090] Updated weights for policy 1, policy_version 898241 (0.0005) [2023-12-26 06:48:46,118][123091] Updated weights for policy 0, policy_version 904505 (0.0011) [2023-12-26 06:48:46,180][123091] Updated weights for policy 0, policy_version 904515 (0.0010) [2023-12-26 06:48:46,183][123090] Updated weights for policy 1, policy_version 898251 (0.0005) [2023-12-26 06:48:46,242][123091] Updated weights for policy 0, policy_version 904525 (0.0011) [2023-12-26 06:48:46,244][123090] Updated weights for policy 1, policy_version 898261 (0.0005) [2023-12-26 06:48:46,300][123090] Updated weights for policy 1, policy_version 898271 (0.0005) [2023-12-26 06:48:46,985][123090] Updated weights for policy 1, policy_version 898281 (0.0008) [2023-12-26 06:48:47,039][123090] Updated weights for policy 1, policy_version 898291 (0.0009) [2023-12-26 06:48:47,059][123091] Updated weights for policy 0, policy_version 904535 (0.0011) [2023-12-26 06:48:47,084][123090] Updated weights for policy 1, policy_version 898301 (0.0006) [2023-12-26 06:48:47,122][123091] Updated weights for policy 0, policy_version 904545 (0.0011) [2023-12-26 06:48:47,181][123091] Updated weights for policy 0, policy_version 904555 (0.0010) [2023-12-26 06:48:47,904][123090] Updated weights for policy 1, policy_version 898311 (0.0007) [2023-12-26 06:48:47,964][123090] Updated weights for policy 1, policy_version 898321 (0.0005) [2023-12-26 06:48:47,990][123091] Updated weights for policy 0, policy_version 904565 (0.0011) [2023-12-26 06:48:48,026][123090] Updated weights for policy 1, policy_version 898331 (0.0006) [2023-12-26 06:48:48,049][123091] Updated weights for policy 0, policy_version 904575 (0.0010) [2023-12-26 06:48:48,107][123091] Updated weights for policy 0, policy_version 904585 (0.0010) [2023-12-26 06:48:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 461553664. Throughput: 0: 8746.8, 1: 9031.3. Samples: 461569940. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:48,785][121949] Avg episode reward: [(0, '6384.373'), (1, '5386.965')] [2023-12-26 06:48:48,812][123090] Updated weights for policy 1, policy_version 898341 (0.0008) [2023-12-26 06:48:48,865][123090] Updated weights for policy 1, policy_version 898351 (0.0009) [2023-12-26 06:48:48,917][123090] Updated weights for policy 1, policy_version 898361 (0.0008) [2023-12-26 06:48:48,942][123091] Updated weights for policy 0, policy_version 904595 (0.0011) [2023-12-26 06:48:49,007][123091] Updated weights for policy 0, policy_version 904605 (0.0007) [2023-12-26 06:48:49,070][123091] Updated weights for policy 0, policy_version 904615 (0.0010) [2023-12-26 06:48:49,716][123090] Updated weights for policy 1, policy_version 898371 (0.0006) [2023-12-26 06:48:49,781][123090] Updated weights for policy 1, policy_version 898381 (0.0005) [2023-12-26 06:48:49,852][123090] Updated weights for policy 1, policy_version 898391 (0.0009) [2023-12-26 06:48:49,874][123091] Updated weights for policy 0, policy_version 904625 (0.0011) [2023-12-26 06:48:49,943][123091] Updated weights for policy 0, policy_version 904635 (0.0011) [2023-12-26 06:48:50,009][123091] Updated weights for policy 0, policy_version 904645 (0.0011) [2023-12-26 06:48:50,069][123091] Updated weights for policy 0, policy_version 904655 (0.0011) [2023-12-26 06:48:50,553][123090] Updated weights for policy 1, policy_version 898401 (0.0010) [2023-12-26 06:48:50,617][123090] Updated weights for policy 1, policy_version 898411 (0.0009) [2023-12-26 06:48:50,674][123090] Updated weights for policy 1, policy_version 898421 (0.0009) [2023-12-26 06:48:50,729][123090] Updated weights for policy 1, policy_version 898431 (0.0010) [2023-12-26 06:48:50,898][123091] Updated weights for policy 0, policy_version 904665 (0.0011) [2023-12-26 06:48:50,962][123091] Updated weights for policy 0, policy_version 904675 (0.0011) [2023-12-26 06:48:51,022][123091] Updated weights for policy 0, policy_version 904685 (0.0011) [2023-12-26 06:48:51,568][123090] Updated weights for policy 1, policy_version 898441 (0.0009) [2023-12-26 06:48:51,634][123090] Updated weights for policy 1, policy_version 898451 (0.0010) [2023-12-26 06:48:51,694][123090] Updated weights for policy 1, policy_version 898461 (0.0009) [2023-12-26 06:48:51,902][123091] Updated weights for policy 0, policy_version 904695 (0.0011) [2023-12-26 06:48:51,971][123091] Updated weights for policy 0, policy_version 904705 (0.0010) [2023-12-26 06:48:52,030][123091] Updated weights for policy 0, policy_version 904715 (0.0005) [2023-12-26 06:48:52,590][123090] Updated weights for policy 1, policy_version 898471 (0.0009) [2023-12-26 06:48:52,658][123090] Updated weights for policy 1, policy_version 898481 (0.0009) [2023-12-26 06:48:52,718][123090] Updated weights for policy 1, policy_version 898491 (0.0009) [2023-12-26 06:48:52,733][123091] Updated weights for policy 0, policy_version 904725 (0.0008) [2023-12-26 06:48:52,795][123091] Updated weights for policy 0, policy_version 904735 (0.0010) [2023-12-26 06:48:52,861][123091] Updated weights for policy 0, policy_version 904745 (0.0010) [2023-12-26 06:48:53,511][123090] Updated weights for policy 1, policy_version 898501 (0.0007) [2023-12-26 06:48:53,573][123090] Updated weights for policy 1, policy_version 898511 (0.0008) [2023-12-26 06:48:53,623][123091] Updated weights for policy 0, policy_version 904755 (0.0010) [2023-12-26 06:48:53,641][123090] Updated weights for policy 1, policy_version 898521 (0.0007) [2023-12-26 06:48:53,681][123091] Updated weights for policy 0, policy_version 904765 (0.0009) [2023-12-26 06:48:53,737][123091] Updated weights for policy 0, policy_version 904775 (0.0009) [2023-12-26 06:48:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 461651968. Throughput: 0: 8688.3, 1: 9021.6. Samples: 461621580. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:53,785][121949] Avg episode reward: [(0, '6271.799'), (1, '5240.160')] [2023-12-26 06:48:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000904784_231628800.pth... [2023-12-26 06:48:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000898528_230023168.pth... [2023-12-26 06:48:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000903760_231366656.pth [2023-12-26 06:48:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000897472_229752832.pth [2023-12-26 06:48:54,334][123090] Updated weights for policy 1, policy_version 898531 (0.0006) [2023-12-26 06:48:54,388][123090] Updated weights for policy 1, policy_version 898541 (0.0006) [2023-12-26 06:48:54,447][123090] Updated weights for policy 1, policy_version 898551 (0.0008) [2023-12-26 06:48:54,479][123091] Updated weights for policy 0, policy_version 904785 (0.0009) [2023-12-26 06:48:54,546][123091] Updated weights for policy 0, policy_version 904795 (0.0010) [2023-12-26 06:48:54,605][123091] Updated weights for policy 0, policy_version 904805 (0.0010) [2023-12-26 06:48:54,669][123091] Updated weights for policy 0, policy_version 904815 (0.0011) [2023-12-26 06:48:55,204][123090] Updated weights for policy 1, policy_version 898561 (0.0007) [2023-12-26 06:48:55,256][123090] Updated weights for policy 1, policy_version 898571 (0.0009) [2023-12-26 06:48:55,303][123090] Updated weights for policy 1, policy_version 898581 (0.0005) [2023-12-26 06:48:55,353][123090] Updated weights for policy 1, policy_version 898591 (0.0007) [2023-12-26 06:48:55,500][123091] Updated weights for policy 0, policy_version 904825 (0.0010) [2023-12-26 06:48:55,554][123091] Updated weights for policy 0, policy_version 904835 (0.0010) [2023-12-26 06:48:55,616][123091] Updated weights for policy 0, policy_version 904845 (0.0010) [2023-12-26 06:48:56,192][123090] Updated weights for policy 1, policy_version 898601 (0.0008) [2023-12-26 06:48:56,267][123090] Updated weights for policy 1, policy_version 898611 (0.0009) [2023-12-26 06:48:56,325][123090] Updated weights for policy 1, policy_version 898621 (0.0008) [2023-12-26 06:48:56,441][123091] Updated weights for policy 0, policy_version 904855 (0.0010) [2023-12-26 06:48:56,508][123091] Updated weights for policy 0, policy_version 904865 (0.0011) [2023-12-26 06:48:56,564][123091] Updated weights for policy 0, policy_version 904875 (0.0010) [2023-12-26 06:48:57,064][123090] Updated weights for policy 1, policy_version 898631 (0.0006) [2023-12-26 06:48:57,135][123090] Updated weights for policy 1, policy_version 898641 (0.0005) [2023-12-26 06:48:57,162][123091] Updated weights for policy 0, policy_version 904885 (0.0009) [2023-12-26 06:48:57,203][123090] Updated weights for policy 1, policy_version 898651 (0.0005) [2023-12-26 06:48:57,223][123091] Updated weights for policy 0, policy_version 904895 (0.0009) [2023-12-26 06:48:57,285][123091] Updated weights for policy 0, policy_version 904905 (0.0009) [2023-12-26 06:48:57,899][123090] Updated weights for policy 1, policy_version 898661 (0.0007) [2023-12-26 06:48:57,954][123090] Updated weights for policy 1, policy_version 898671 (0.0009) [2023-12-26 06:48:58,009][123090] Updated weights for policy 1, policy_version 898681 (0.0008) [2023-12-26 06:48:58,043][123091] Updated weights for policy 0, policy_version 904915 (0.0009) [2023-12-26 06:48:58,106][123091] Updated weights for policy 0, policy_version 904925 (0.0011) [2023-12-26 06:48:58,173][123091] Updated weights for policy 0, policy_version 904935 (0.0011) [2023-12-26 06:48:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 461733888. Throughput: 0: 8746.1, 1: 9085.7. Samples: 461730452. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:48:58,785][121949] Avg episode reward: [(0, '6242.013'), (1, '5322.728')] [2023-12-26 06:48:58,978][123090] Updated weights for policy 1, policy_version 898691 (0.0008) [2023-12-26 06:48:59,047][123090] Updated weights for policy 1, policy_version 898701 (0.0009) [2023-12-26 06:48:59,101][123091] Updated weights for policy 0, policy_version 904945 (0.0011) [2023-12-26 06:48:59,117][123090] Updated weights for policy 1, policy_version 898711 (0.0008) [2023-12-26 06:48:59,168][123091] Updated weights for policy 0, policy_version 904955 (0.0011) [2023-12-26 06:48:59,238][123091] Updated weights for policy 0, policy_version 904965 (0.0011) [2023-12-26 06:48:59,293][123091] Updated weights for policy 0, policy_version 904975 (0.0010) [2023-12-26 06:48:59,947][123090] Updated weights for policy 1, policy_version 898721 (0.0007) [2023-12-26 06:49:00,013][123090] Updated weights for policy 1, policy_version 898731 (0.0010) [2023-12-26 06:49:00,060][123091] Updated weights for policy 0, policy_version 904985 (0.0008) [2023-12-26 06:49:00,067][123090] Updated weights for policy 1, policy_version 898741 (0.0008) [2023-12-26 06:49:00,112][123091] Updated weights for policy 0, policy_version 904995 (0.0008) [2023-12-26 06:49:00,127][123090] Updated weights for policy 1, policy_version 898751 (0.0005) [2023-12-26 06:49:00,171][123091] Updated weights for policy 0, policy_version 905005 (0.0008) [2023-12-26 06:49:00,954][123090] Updated weights for policy 1, policy_version 898761 (0.0008) [2023-12-26 06:49:00,971][123091] Updated weights for policy 0, policy_version 905015 (0.0009) [2023-12-26 06:49:01,012][123090] Updated weights for policy 1, policy_version 898771 (0.0007) [2023-12-26 06:49:01,031][123091] Updated weights for policy 0, policy_version 905025 (0.0009) [2023-12-26 06:49:01,082][123090] Updated weights for policy 1, policy_version 898781 (0.0008) [2023-12-26 06:49:01,089][123091] Updated weights for policy 0, policy_version 905035 (0.0009) [2023-12-26 06:49:01,920][123091] Updated weights for policy 0, policy_version 905045 (0.0008) [2023-12-26 06:49:01,935][123090] Updated weights for policy 1, policy_version 898791 (0.0008) [2023-12-26 06:49:01,991][123090] Updated weights for policy 1, policy_version 898801 (0.0008) [2023-12-26 06:49:01,998][123091] Updated weights for policy 0, policy_version 905055 (0.0006) [2023-12-26 06:49:02,046][123090] Updated weights for policy 1, policy_version 898811 (0.0009) [2023-12-26 06:49:02,074][123091] Updated weights for policy 0, policy_version 905065 (0.0006) [2023-12-26 06:49:02,810][123091] Updated weights for policy 0, policy_version 905075 (0.0010) [2023-12-26 06:49:02,869][123091] Updated weights for policy 0, policy_version 905085 (0.0009) [2023-12-26 06:49:02,927][123090] Updated weights for policy 1, policy_version 898821 (0.0008) [2023-12-26 06:49:02,937][123091] Updated weights for policy 0, policy_version 905095 (0.0007) [2023-12-26 06:49:02,994][123090] Updated weights for policy 1, policy_version 898831 (0.0009) [2023-12-26 06:49:03,052][123090] Updated weights for policy 1, policy_version 898841 (0.0009) [2023-12-26 06:49:03,701][123090] Updated weights for policy 1, policy_version 898851 (0.0009) [2023-12-26 06:49:03,749][123090] Updated weights for policy 1, policy_version 898861 (0.0005) [2023-12-26 06:49:03,766][123091] Updated weights for policy 0, policy_version 905105 (0.0007) [2023-12-26 06:49:03,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 461815808. Throughput: 0: 8783.7, 1: 8864.2. Samples: 461833488. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:03,785][121949] Avg episode reward: [(0, '6211.554'), (1, '5439.135')] [2023-12-26 06:49:03,797][123090] Updated weights for policy 1, policy_version 898871 (0.0005) [2023-12-26 06:49:03,818][123091] Updated weights for policy 0, policy_version 905115 (0.0009) [2023-12-26 06:49:03,879][123091] Updated weights for policy 0, policy_version 905125 (0.0007) [2023-12-26 06:49:03,949][123091] Updated weights for policy 0, policy_version 905135 (0.0005) [2023-12-26 06:49:04,444][123090] Updated weights for policy 1, policy_version 898881 (0.0006) [2023-12-26 06:49:04,509][123090] Updated weights for policy 1, policy_version 898891 (0.0010) [2023-12-26 06:49:04,572][123090] Updated weights for policy 1, policy_version 898901 (0.0011) [2023-12-26 06:49:04,642][123090] Updated weights for policy 1, policy_version 898911 (0.0010) [2023-12-26 06:49:04,736][123091] Updated weights for policy 0, policy_version 905145 (0.0005) [2023-12-26 06:49:04,798][123091] Updated weights for policy 0, policy_version 905155 (0.0008) [2023-12-26 06:49:04,858][123091] Updated weights for policy 0, policy_version 905165 (0.0007) [2023-12-26 06:49:05,399][123090] Updated weights for policy 1, policy_version 898921 (0.0006) [2023-12-26 06:49:05,467][123090] Updated weights for policy 1, policy_version 898931 (0.0006) [2023-12-26 06:49:05,526][123090] Updated weights for policy 1, policy_version 898941 (0.0005) [2023-12-26 06:49:05,650][123091] Updated weights for policy 0, policy_version 905175 (0.0009) [2023-12-26 06:49:05,717][123091] Updated weights for policy 0, policy_version 905185 (0.0009) [2023-12-26 06:49:05,780][123091] Updated weights for policy 0, policy_version 905195 (0.0010) [2023-12-26 06:49:06,232][123090] Updated weights for policy 1, policy_version 898951 (0.0006) [2023-12-26 06:49:06,306][123090] Updated weights for policy 1, policy_version 898961 (0.0006) [2023-12-26 06:49:06,377][123090] Updated weights for policy 1, policy_version 898971 (0.0010) [2023-12-26 06:49:06,672][123091] Updated weights for policy 0, policy_version 905205 (0.0011) [2023-12-26 06:49:06,732][123091] Updated weights for policy 0, policy_version 905215 (0.0009) [2023-12-26 06:49:06,791][123091] Updated weights for policy 0, policy_version 905225 (0.0008) [2023-12-26 06:49:07,138][123090] Updated weights for policy 1, policy_version 898981 (0.0008) [2023-12-26 06:49:07,213][123090] Updated weights for policy 1, policy_version 898991 (0.0006) [2023-12-26 06:49:07,272][123090] Updated weights for policy 1, policy_version 899001 (0.0010) [2023-12-26 06:49:07,682][123091] Updated weights for policy 0, policy_version 905235 (0.0009) [2023-12-26 06:49:07,736][123091] Updated weights for policy 0, policy_version 905245 (0.0010) [2023-12-26 06:49:07,790][123091] Updated weights for policy 0, policy_version 905257 (0.0010) [2023-12-26 06:49:07,933][123090] Updated weights for policy 1, policy_version 899011 (0.0010) [2023-12-26 06:49:07,984][123090] Updated weights for policy 1, policy_version 899021 (0.0010) [2023-12-26 06:49:08,039][123090] Updated weights for policy 1, policy_version 899031 (0.0010) [2023-12-26 06:49:08,666][123091] Updated weights for policy 0, policy_version 905267 (0.0010) [2023-12-26 06:49:08,735][123091] Updated weights for policy 0, policy_version 905277 (0.0009) [2023-12-26 06:49:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 461905920. Throughput: 0: 8784.4, 1: 8948.6. Samples: 461888832. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:08,785][121949] Avg episode reward: [(0, '6093.087'), (1, '5446.093')] [2023-12-26 06:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000899040_230154240.pth... [2023-12-26 06:49:08,791][123091] Updated weights for policy 0, policy_version 905287 (0.0009) [2023-12-26 06:49:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000898016_229892096.pth [2023-12-26 06:49:08,840][123090] Updated weights for policy 1, policy_version 899041 (0.0010) [2023-12-26 06:49:08,841][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000905296_231759872.pth... [2023-12-26 06:49:08,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000904272_231497728.pth [2023-12-26 06:49:08,904][123090] Updated weights for policy 1, policy_version 899051 (0.0011) [2023-12-26 06:49:08,971][123090] Updated weights for policy 1, policy_version 899061 (0.0011) [2023-12-26 06:49:09,038][123090] Updated weights for policy 1, policy_version 899071 (0.0010) [2023-12-26 06:49:09,634][123091] Updated weights for policy 0, policy_version 905297 (0.0009) [2023-12-26 06:49:09,687][123091] Updated weights for policy 0, policy_version 905307 (0.0009) [2023-12-26 06:49:09,735][123091] Updated weights for policy 0, policy_version 905317 (0.0008) [2023-12-26 06:49:09,788][123091] Updated weights for policy 0, policy_version 905327 (0.0009) [2023-12-26 06:49:09,882][123090] Updated weights for policy 1, policy_version 899081 (0.0011) [2023-12-26 06:49:09,952][123090] Updated weights for policy 1, policy_version 899091 (0.0008) [2023-12-26 06:49:10,022][123090] Updated weights for policy 1, policy_version 899101 (0.0006) [2023-12-26 06:49:10,664][123091] Updated weights for policy 0, policy_version 905337 (0.0008) [2023-12-26 06:49:10,728][123091] Updated weights for policy 0, policy_version 905347 (0.0010) [2023-12-26 06:49:10,794][123091] Updated weights for policy 0, policy_version 905357 (0.0009) [2023-12-26 06:49:10,795][123090] Updated weights for policy 1, policy_version 899111 (0.0010) [2023-12-26 06:49:10,851][123090] Updated weights for policy 1, policy_version 899121 (0.0009) [2023-12-26 06:49:10,915][123090] Updated weights for policy 1, policy_version 899131 (0.0008) [2023-12-26 06:49:11,547][123091] Updated weights for policy 0, policy_version 905367 (0.0009) [2023-12-26 06:49:11,621][123091] Updated weights for policy 0, policy_version 905377 (0.0009) [2023-12-26 06:49:11,696][123091] Updated weights for policy 0, policy_version 905387 (0.0010) [2023-12-26 06:49:11,842][123090] Updated weights for policy 1, policy_version 899141 (0.0010) [2023-12-26 06:49:11,905][123090] Updated weights for policy 1, policy_version 899151 (0.0010) [2023-12-26 06:49:11,975][123090] Updated weights for policy 1, policy_version 899161 (0.0010) [2023-12-26 06:49:12,546][123091] Updated weights for policy 0, policy_version 905397 (0.0010) [2023-12-26 06:49:12,610][123091] Updated weights for policy 0, policy_version 905407 (0.0011) [2023-12-26 06:49:12,677][123091] Updated weights for policy 0, policy_version 905417 (0.0011) [2023-12-26 06:49:12,802][123090] Updated weights for policy 1, policy_version 899171 (0.0010) [2023-12-26 06:49:12,870][123090] Updated weights for policy 1, policy_version 899181 (0.0006) [2023-12-26 06:49:12,931][123090] Updated weights for policy 1, policy_version 899191 (0.0005) [2023-12-26 06:49:13,489][123091] Updated weights for policy 0, policy_version 905427 (0.0011) [2023-12-26 06:49:13,542][123091] Updated weights for policy 0, policy_version 905437 (0.0009) [2023-12-26 06:49:13,589][123091] Updated weights for policy 0, policy_version 905447 (0.0008) [2023-12-26 06:49:13,648][123090] Updated weights for policy 1, policy_version 899201 (0.0006) [2023-12-26 06:49:13,701][123090] Updated weights for policy 1, policy_version 899211 (0.0009) [2023-12-26 06:49:13,752][123090] Updated weights for policy 1, policy_version 899221 (0.0008) [2023-12-26 06:49:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 461996032. Throughput: 0: 8685.1, 1: 8883.8. Samples: 461991084. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:13,785][121949] Avg episode reward: [(0, '6194.285'), (1, '5642.601')] [2023-12-26 06:49:13,805][123090] Updated weights for policy 1, policy_version 899231 (0.0007) [2023-12-26 06:49:14,366][123091] Updated weights for policy 0, policy_version 905457 (0.0009) [2023-12-26 06:49:14,420][123091] Updated weights for policy 0, policy_version 905467 (0.0009) [2023-12-26 06:49:14,475][123091] Updated weights for policy 0, policy_version 905479 (0.0011) [2023-12-26 06:49:14,593][123090] Updated weights for policy 1, policy_version 899241 (0.0005) [2023-12-26 06:49:14,641][123090] Updated weights for policy 1, policy_version 899251 (0.0005) [2023-12-26 06:49:14,688][123090] Updated weights for policy 1, policy_version 899261 (0.0005) [2023-12-26 06:49:15,273][123091] Updated weights for policy 0, policy_version 905490 (0.0010) [2023-12-26 06:49:15,323][123091] Updated weights for policy 0, policy_version 905500 (0.0009) [2023-12-26 06:49:15,386][123091] Updated weights for policy 0, policy_version 905510 (0.0008) [2023-12-26 06:49:15,414][123090] Updated weights for policy 1, policy_version 899271 (0.0008) [2023-12-26 06:49:15,448][123091] Updated weights for policy 0, policy_version 905520 (0.0009) [2023-12-26 06:49:15,471][123090] Updated weights for policy 1, policy_version 899281 (0.0007) [2023-12-26 06:49:15,535][123090] Updated weights for policy 1, policy_version 899291 (0.0005) [2023-12-26 06:49:16,200][123090] Updated weights for policy 1, policy_version 899301 (0.0007) [2023-12-26 06:49:16,255][123090] Updated weights for policy 1, policy_version 899311 (0.0006) [2023-12-26 06:49:16,304][123091] Updated weights for policy 0, policy_version 905530 (0.0005) [2023-12-26 06:49:16,312][123090] Updated weights for policy 1, policy_version 899321 (0.0005) [2023-12-26 06:49:16,359][123091] Updated weights for policy 0, policy_version 905540 (0.0006) [2023-12-26 06:49:16,408][123091] Updated weights for policy 0, policy_version 905550 (0.0005) [2023-12-26 06:49:16,997][123090] Updated weights for policy 1, policy_version 899331 (0.0007) [2023-12-26 06:49:17,045][123091] Updated weights for policy 0, policy_version 905560 (0.0006) [2023-12-26 06:49:17,055][123090] Updated weights for policy 1, policy_version 899341 (0.0009) [2023-12-26 06:49:17,100][123091] Updated weights for policy 0, policy_version 905570 (0.0006) [2023-12-26 06:49:17,115][123090] Updated weights for policy 1, policy_version 899351 (0.0009) [2023-12-26 06:49:17,150][123091] Updated weights for policy 0, policy_version 905580 (0.0005) [2023-12-26 06:49:17,912][123091] Updated weights for policy 0, policy_version 905590 (0.0008) [2023-12-26 06:49:17,960][123091] Updated weights for policy 0, policy_version 905600 (0.0009) [2023-12-26 06:49:17,973][123090] Updated weights for policy 1, policy_version 899361 (0.0008) [2023-12-26 06:49:18,012][123091] Updated weights for policy 0, policy_version 905610 (0.0009) [2023-12-26 06:49:18,030][123090] Updated weights for policy 1, policy_version 899371 (0.0008) [2023-12-26 06:49:18,081][123090] Updated weights for policy 1, policy_version 899381 (0.0005) [2023-12-26 06:49:18,132][123090] Updated weights for policy 1, policy_version 899391 (0.0005) [2023-12-26 06:49:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 462086144. Throughput: 0: 8729.1, 1: 8959.2. Samples: 462102776. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:18,786][121949] Avg episode reward: [(0, '6304.183'), (1, '5785.832')] [2023-12-26 06:49:18,866][123091] Updated weights for policy 0, policy_version 905620 (0.0009) [2023-12-26 06:49:18,927][123090] Updated weights for policy 1, policy_version 899401 (0.0010) [2023-12-26 06:49:18,928][123091] Updated weights for policy 0, policy_version 905630 (0.0009) [2023-12-26 06:49:18,982][123091] Updated weights for policy 0, policy_version 905640 (0.0007) [2023-12-26 06:49:18,986][123090] Updated weights for policy 1, policy_version 899411 (0.0010) [2023-12-26 06:49:19,057][123090] Updated weights for policy 1, policy_version 899421 (0.0010) [2023-12-26 06:49:19,840][123091] Updated weights for policy 0, policy_version 905650 (0.0009) [2023-12-26 06:49:19,877][123090] Updated weights for policy 1, policy_version 899431 (0.0010) [2023-12-26 06:49:19,904][123091] Updated weights for policy 0, policy_version 905660 (0.0008) [2023-12-26 06:49:19,947][123090] Updated weights for policy 1, policy_version 899441 (0.0010) [2023-12-26 06:49:19,970][123091] Updated weights for policy 0, policy_version 905670 (0.0009) [2023-12-26 06:49:20,011][123090] Updated weights for policy 1, policy_version 899451 (0.0011) [2023-12-26 06:49:20,031][123091] Updated weights for policy 0, policy_version 905680 (0.0006) [2023-12-26 06:49:20,807][123091] Updated weights for policy 0, policy_version 905690 (0.0009) [2023-12-26 06:49:20,821][123090] Updated weights for policy 1, policy_version 899461 (0.0011) [2023-12-26 06:49:20,867][123091] Updated weights for policy 0, policy_version 905700 (0.0009) [2023-12-26 06:49:20,880][123090] Updated weights for policy 1, policy_version 899471 (0.0010) [2023-12-26 06:49:20,943][123091] Updated weights for policy 0, policy_version 905710 (0.0009) [2023-12-26 06:49:20,952][123090] Updated weights for policy 1, policy_version 899481 (0.0008) [2023-12-26 06:49:21,787][123090] Updated weights for policy 1, policy_version 899491 (0.0010) [2023-12-26 06:49:21,807][123091] Updated weights for policy 0, policy_version 905720 (0.0009) [2023-12-26 06:49:21,844][123090] Updated weights for policy 1, policy_version 899501 (0.0010) [2023-12-26 06:49:21,867][123091] Updated weights for policy 0, policy_version 905730 (0.0008) [2023-12-26 06:49:21,896][123090] Updated weights for policy 1, policy_version 899511 (0.0010) [2023-12-26 06:49:21,926][123091] Updated weights for policy 0, policy_version 905740 (0.0008) [2023-12-26 06:49:22,654][123091] Updated weights for policy 0, policy_version 905750 (0.0010) [2023-12-26 06:49:22,719][123091] Updated weights for policy 0, policy_version 905760 (0.0010) [2023-12-26 06:49:22,758][123090] Updated weights for policy 1, policy_version 899521 (0.0010) [2023-12-26 06:49:22,794][123091] Updated weights for policy 0, policy_version 905770 (0.0005) [2023-12-26 06:49:22,823][123090] Updated weights for policy 1, policy_version 899531 (0.0011) [2023-12-26 06:49:22,887][123090] Updated weights for policy 1, policy_version 899541 (0.0011) [2023-12-26 06:49:22,952][123090] Updated weights for policy 1, policy_version 899551 (0.0010) [2023-12-26 06:49:23,567][123091] Updated weights for policy 0, policy_version 905780 (0.0008) [2023-12-26 06:49:23,618][123091] Updated weights for policy 0, policy_version 905790 (0.0011) [2023-12-26 06:49:23,670][123091] Updated weights for policy 0, policy_version 905800 (0.0010) [2023-12-26 06:49:23,761][123090] Updated weights for policy 1, policy_version 899561 (0.0008) [2023-12-26 06:49:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 462176256. Throughput: 0: 8714.7, 1: 8894.4. Samples: 462153392. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:23,785][121949] Avg episode reward: [(0, '6342.519'), (1, '5700.448')] [2023-12-26 06:49:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000905808_231890944.pth... [2023-12-26 06:49:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000904784_231628800.pth [2023-12-26 06:49:23,809][123090] Updated weights for policy 1, policy_version 899571 (0.0009) [2023-12-26 06:49:23,862][123090] Updated weights for policy 1, policy_version 899581 (0.0009) [2023-12-26 06:49:23,874][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000899584_230293504.pth... [2023-12-26 06:49:23,878][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000898528_230023168.pth [2023-12-26 06:49:24,394][123091] Updated weights for policy 0, policy_version 905810 (0.0009) [2023-12-26 06:49:24,446][123091] Updated weights for policy 0, policy_version 905820 (0.0005) [2023-12-26 06:49:24,506][123091] Updated weights for policy 0, policy_version 905830 (0.0011) [2023-12-26 06:49:24,558][123091] Updated weights for policy 0, policy_version 905840 (0.0010) [2023-12-26 06:49:24,733][123090] Updated weights for policy 1, policy_version 899591 (0.0007) [2023-12-26 06:49:24,791][123090] Updated weights for policy 1, policy_version 899601 (0.0005) [2023-12-26 06:49:24,851][123090] Updated weights for policy 1, policy_version 899611 (0.0005) [2023-12-26 06:49:25,260][123091] Updated weights for policy 0, policy_version 905850 (0.0005) [2023-12-26 06:49:25,312][123091] Updated weights for policy 0, policy_version 905860 (0.0005) [2023-12-26 06:49:25,375][123091] Updated weights for policy 0, policy_version 905870 (0.0005) [2023-12-26 06:49:25,577][123090] Updated weights for policy 1, policy_version 899621 (0.0005) [2023-12-26 06:49:25,634][123090] Updated weights for policy 1, policy_version 899631 (0.0005) [2023-12-26 06:49:25,695][123090] Updated weights for policy 1, policy_version 899641 (0.0008) [2023-12-26 06:49:26,098][123091] Updated weights for policy 0, policy_version 905880 (0.0009) [2023-12-26 06:49:26,161][123091] Updated weights for policy 0, policy_version 905890 (0.0010) [2023-12-26 06:49:26,227][123091] Updated weights for policy 0, policy_version 905900 (0.0010) [2023-12-26 06:49:26,496][123090] Updated weights for policy 1, policy_version 899651 (0.0008) [2023-12-26 06:49:26,562][123090] Updated weights for policy 1, policy_version 899661 (0.0010) [2023-12-26 06:49:26,634][123090] Updated weights for policy 1, policy_version 899671 (0.0007) [2023-12-26 06:49:26,946][123091] Updated weights for policy 0, policy_version 905910 (0.0007) [2023-12-26 06:49:27,010][123091] Updated weights for policy 0, policy_version 905920 (0.0005) [2023-12-26 06:49:27,079][123091] Updated weights for policy 0, policy_version 905930 (0.0009) [2023-12-26 06:49:27,421][123090] Updated weights for policy 1, policy_version 899681 (0.0006) [2023-12-26 06:49:27,482][123090] Updated weights for policy 1, policy_version 899691 (0.0009) [2023-12-26 06:49:27,547][123090] Updated weights for policy 1, policy_version 899701 (0.0009) [2023-12-26 06:49:27,599][123090] Updated weights for policy 1, policy_version 899711 (0.0008) [2023-12-26 06:49:27,839][123091] Updated weights for policy 0, policy_version 905940 (0.0010) [2023-12-26 06:49:27,885][123091] Updated weights for policy 0, policy_version 905950 (0.0010) [2023-12-26 06:49:27,946][123091] Updated weights for policy 0, policy_version 905960 (0.0010) [2023-12-26 06:49:28,415][123090] Updated weights for policy 1, policy_version 899721 (0.0009) [2023-12-26 06:49:28,478][123090] Updated weights for policy 1, policy_version 899731 (0.0010) [2023-12-26 06:49:28,550][123090] Updated weights for policy 1, policy_version 899741 (0.0009) [2023-12-26 06:49:28,730][123091] Updated weights for policy 0, policy_version 905970 (0.0009) [2023-12-26 06:49:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 462266368. Throughput: 0: 8809.3, 1: 8943.0. Samples: 462262080. Policy #0 lag: (min: 0.0, avg: 26.3, max: 32.0) [2023-12-26 06:49:28,784][121949] Avg episode reward: [(0, '6348.781'), (1, '5553.419')] [2023-12-26 06:49:28,786][123091] Updated weights for policy 0, policy_version 905980 (0.0005) [2023-12-26 06:49:28,854][123091] Updated weights for policy 0, policy_version 905990 (0.0005) [2023-12-26 06:49:28,921][123091] Updated weights for policy 0, policy_version 906000 (0.0005) [2023-12-26 06:49:29,436][123090] Updated weights for policy 1, policy_version 899751 (0.0010) [2023-12-26 06:49:29,498][123090] Updated weights for policy 1, policy_version 899761 (0.0009) [2023-12-26 06:49:29,508][123091] Updated weights for policy 0, policy_version 906010 (0.0005) [2023-12-26 06:49:29,561][123090] Updated weights for policy 1, policy_version 899771 (0.0009) [2023-12-26 06:49:29,567][123091] Updated weights for policy 0, policy_version 906020 (0.0007) [2023-12-26 06:49:29,640][123091] Updated weights for policy 0, policy_version 906030 (0.0007) [2023-12-26 06:49:30,416][123091] Updated weights for policy 0, policy_version 906040 (0.0006) [2023-12-26 06:49:30,438][123090] Updated weights for policy 1, policy_version 899781 (0.0008) [2023-12-26 06:49:30,472][123091] Updated weights for policy 0, policy_version 906050 (0.0006) [2023-12-26 06:49:30,498][123090] Updated weights for policy 1, policy_version 899791 (0.0008) [2023-12-26 06:49:30,518][123091] Updated weights for policy 0, policy_version 906060 (0.0009) [2023-12-26 06:49:30,558][123090] Updated weights for policy 1, policy_version 899801 (0.0009) [2023-12-26 06:49:31,352][123091] Updated weights for policy 0, policy_version 906070 (0.0009) [2023-12-26 06:49:31,404][123090] Updated weights for policy 1, policy_version 899811 (0.0008) [2023-12-26 06:49:31,424][123091] Updated weights for policy 0, policy_version 906080 (0.0011) [2023-12-26 06:49:31,465][123090] Updated weights for policy 1, policy_version 899821 (0.0006) [2023-12-26 06:49:31,488][123091] Updated weights for policy 0, policy_version 906090 (0.0011) [2023-12-26 06:49:31,525][123090] Updated weights for policy 1, policy_version 899831 (0.0007) [2023-12-26 06:49:32,293][123090] Updated weights for policy 1, policy_version 899841 (0.0009) [2023-12-26 06:49:32,305][123091] Updated weights for policy 0, policy_version 906100 (0.0011) [2023-12-26 06:49:32,357][123090] Updated weights for policy 1, policy_version 899851 (0.0007) [2023-12-26 06:49:32,368][123091] Updated weights for policy 0, policy_version 906110 (0.0011) [2023-12-26 06:49:32,424][123090] Updated weights for policy 1, policy_version 899861 (0.0008) [2023-12-26 06:49:32,432][123091] Updated weights for policy 0, policy_version 906120 (0.0011) [2023-12-26 06:49:32,486][123090] Updated weights for policy 1, policy_version 899871 (0.0010) [2023-12-26 06:49:33,227][123090] Updated weights for policy 1, policy_version 899881 (0.0007) [2023-12-26 06:49:33,258][123091] Updated weights for policy 0, policy_version 906130 (0.0011) [2023-12-26 06:49:33,277][123090] Updated weights for policy 1, policy_version 899891 (0.0008) [2023-12-26 06:49:33,317][123091] Updated weights for policy 0, policy_version 906140 (0.0010) [2023-12-26 06:49:33,328][123090] Updated weights for policy 1, policy_version 899901 (0.0008) [2023-12-26 06:49:33,375][123091] Updated weights for policy 0, policy_version 906150 (0.0010) [2023-12-26 06:49:33,427][123091] Updated weights for policy 0, policy_version 906160 (0.0011) [2023-12-26 06:49:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 462356480. Throughput: 0: 8858.1, 1: 8863.9. Samples: 462367432. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:33,785][121949] Avg episode reward: [(0, '6233.333'), (1, '5587.360')] [2023-12-26 06:49:34,153][123090] Updated weights for policy 1, policy_version 899911 (0.0008) [2023-12-26 06:49:34,214][123091] Updated weights for policy 0, policy_version 906170 (0.0011) [2023-12-26 06:49:34,221][123090] Updated weights for policy 1, policy_version 899921 (0.0007) [2023-12-26 06:49:34,273][123091] Updated weights for policy 0, policy_version 906180 (0.0011) [2023-12-26 06:49:34,286][123090] Updated weights for policy 1, policy_version 899931 (0.0010) [2023-12-26 06:49:34,329][123091] Updated weights for policy 0, policy_version 906190 (0.0010) [2023-12-26 06:49:35,109][123090] Updated weights for policy 1, policy_version 899941 (0.0008) [2023-12-26 06:49:35,168][123090] Updated weights for policy 1, policy_version 899951 (0.0010) [2023-12-26 06:49:35,192][123091] Updated weights for policy 0, policy_version 906200 (0.0009) [2023-12-26 06:49:35,229][123090] Updated weights for policy 1, policy_version 899961 (0.0009) [2023-12-26 06:49:35,257][123091] Updated weights for policy 0, policy_version 906210 (0.0008) [2023-12-26 06:49:35,331][123091] Updated weights for policy 0, policy_version 906220 (0.0008) [2023-12-26 06:49:36,064][123090] Updated weights for policy 1, policy_version 899971 (0.0009) [2023-12-26 06:49:36,133][123090] Updated weights for policy 1, policy_version 899981 (0.0009) [2023-12-26 06:49:36,147][123091] Updated weights for policy 0, policy_version 906230 (0.0009) [2023-12-26 06:49:36,195][123090] Updated weights for policy 1, policy_version 899991 (0.0009) [2023-12-26 06:49:36,211][123091] Updated weights for policy 0, policy_version 906240 (0.0007) [2023-12-26 06:49:36,276][123091] Updated weights for policy 0, policy_version 906250 (0.0008) [2023-12-26 06:49:37,044][123090] Updated weights for policy 1, policy_version 900001 (0.0009) [2023-12-26 06:49:37,099][123090] Updated weights for policy 1, policy_version 900011 (0.0009) [2023-12-26 06:49:37,129][123091] Updated weights for policy 0, policy_version 906260 (0.0009) [2023-12-26 06:49:37,155][123090] Updated weights for policy 1, policy_version 900021 (0.0008) [2023-12-26 06:49:37,179][123091] Updated weights for policy 0, policy_version 906270 (0.0009) [2023-12-26 06:49:37,204][123090] Updated weights for policy 1, policy_version 900031 (0.0008) [2023-12-26 06:49:37,226][123091] Updated weights for policy 0, policy_version 906280 (0.0009) [2023-12-26 06:49:37,978][123090] Updated weights for policy 1, policy_version 900041 (0.0006) [2023-12-26 06:49:38,043][123090] Updated weights for policy 1, policy_version 900051 (0.0005) [2023-12-26 06:49:38,117][123090] Updated weights for policy 1, policy_version 900061 (0.0005) [2023-12-26 06:49:38,163][123091] Updated weights for policy 0, policy_version 906290 (0.0009) [2023-12-26 06:49:38,218][123091] Updated weights for policy 0, policy_version 906300 (0.0010) [2023-12-26 06:49:38,277][123091] Updated weights for policy 0, policy_version 906310 (0.0010) [2023-12-26 06:49:38,331][123091] Updated weights for policy 0, policy_version 906320 (0.0010) [2023-12-26 06:49:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 462438400. Throughput: 0: 8862.4, 1: 8844.4. Samples: 462418380. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:38,785][121949] Avg episode reward: [(0, '6092.507'), (1, '5613.696')] [2023-12-26 06:49:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000906320_232022016.pth... [2023-12-26 06:49:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000905296_231759872.pth [2023-12-26 06:49:38,826][123090] Updated weights for policy 1, policy_version 900071 (0.0009) [2023-12-26 06:49:38,886][123090] Updated weights for policy 1, policy_version 900081 (0.0010) [2023-12-26 06:49:38,950][123090] Updated weights for policy 1, policy_version 900091 (0.0010) [2023-12-26 06:49:38,978][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000900096_230424576.pth... [2023-12-26 06:49:38,981][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000899040_230154240.pth [2023-12-26 06:49:39,206][123091] Updated weights for policy 0, policy_version 906330 (0.0010) [2023-12-26 06:49:39,276][123091] Updated weights for policy 0, policy_version 906340 (0.0011) [2023-12-26 06:49:39,347][123091] Updated weights for policy 0, policy_version 906350 (0.0011) [2023-12-26 06:49:39,780][123090] Updated weights for policy 1, policy_version 900101 (0.0010) [2023-12-26 06:49:39,868][123090] Updated weights for policy 1, policy_version 900111 (0.0009) [2023-12-26 06:49:39,941][123090] Updated weights for policy 1, policy_version 900121 (0.0009) [2023-12-26 06:49:40,126][123091] Updated weights for policy 0, policy_version 906360 (0.0008) [2023-12-26 06:49:40,187][123091] Updated weights for policy 0, policy_version 906370 (0.0007) [2023-12-26 06:49:40,254][123091] Updated weights for policy 0, policy_version 906380 (0.0009) [2023-12-26 06:49:40,654][123090] Updated weights for policy 1, policy_version 900131 (0.0007) [2023-12-26 06:49:40,706][123090] Updated weights for policy 1, policy_version 900141 (0.0005) [2023-12-26 06:49:40,758][123090] Updated weights for policy 1, policy_version 900151 (0.0009) [2023-12-26 06:49:41,056][123091] Updated weights for policy 0, policy_version 906390 (0.0010) [2023-12-26 06:49:41,118][123091] Updated weights for policy 0, policy_version 906400 (0.0010) [2023-12-26 06:49:41,188][123091] Updated weights for policy 0, policy_version 906410 (0.0010) [2023-12-26 06:49:41,647][123090] Updated weights for policy 1, policy_version 900161 (0.0009) [2023-12-26 06:49:41,715][123090] Updated weights for policy 1, policy_version 900171 (0.0009) [2023-12-26 06:49:41,787][123090] Updated weights for policy 1, policy_version 900181 (0.0010) [2023-12-26 06:49:41,843][123090] Updated weights for policy 1, policy_version 900191 (0.0010) [2023-12-26 06:49:41,939][123091] Updated weights for policy 0, policy_version 906420 (0.0006) [2023-12-26 06:49:42,000][123091] Updated weights for policy 0, policy_version 906430 (0.0005) [2023-12-26 06:49:42,069][123091] Updated weights for policy 0, policy_version 906440 (0.0007) [2023-12-26 06:49:42,808][123090] Updated weights for policy 1, policy_version 900201 (0.0009) [2023-12-26 06:49:42,850][123091] Updated weights for policy 0, policy_version 906450 (0.0009) [2023-12-26 06:49:42,874][123090] Updated weights for policy 1, policy_version 900211 (0.0010) [2023-12-26 06:49:42,915][123091] Updated weights for policy 0, policy_version 906460 (0.0006) [2023-12-26 06:49:42,942][123090] Updated weights for policy 1, policy_version 900221 (0.0009) [2023-12-26 06:49:42,987][123091] Updated weights for policy 0, policy_version 906470 (0.0010) [2023-12-26 06:49:43,050][123091] Updated weights for policy 0, policy_version 906480 (0.0011) [2023-12-26 06:49:43,724][123091] Updated weights for policy 0, policy_version 906490 (0.0011) [2023-12-26 06:49:43,775][123091] Updated weights for policy 0, policy_version 906500 (0.0010) [2023-12-26 06:49:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 462520320. Throughput: 0: 8771.2, 1: 8790.9. Samples: 462520748. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:43,785][121949] Avg episode reward: [(0, '6148.141'), (1, '5596.667')] [2023-12-26 06:49:43,813][123090] Updated weights for policy 1, policy_version 900231 (0.0008) [2023-12-26 06:49:43,829][123091] Updated weights for policy 0, policy_version 906510 (0.0009) [2023-12-26 06:49:43,867][123090] Updated weights for policy 1, policy_version 900241 (0.0008) [2023-12-26 06:49:43,918][123090] Updated weights for policy 1, policy_version 900251 (0.0005) [2023-12-26 06:49:44,615][123091] Updated weights for policy 0, policy_version 906520 (0.0010) [2023-12-26 06:49:44,616][123090] Updated weights for policy 1, policy_version 900261 (0.0008) [2023-12-26 06:49:44,673][123090] Updated weights for policy 1, policy_version 900271 (0.0006) [2023-12-26 06:49:44,673][123091] Updated weights for policy 0, policy_version 906530 (0.0010) [2023-12-26 06:49:44,725][123090] Updated weights for policy 1, policy_version 900281 (0.0007) [2023-12-26 06:49:44,736][123091] Updated weights for policy 0, policy_version 906540 (0.0010) [2023-12-26 06:49:45,520][123091] Updated weights for policy 0, policy_version 906550 (0.0011) [2023-12-26 06:49:45,567][123090] Updated weights for policy 1, policy_version 900291 (0.0007) [2023-12-26 06:49:45,572][123091] Updated weights for policy 0, policy_version 906560 (0.0011) [2023-12-26 06:49:45,621][123091] Updated weights for policy 0, policy_version 906570 (0.0010) [2023-12-26 06:49:45,641][123090] Updated weights for policy 1, policy_version 900301 (0.0006) [2023-12-26 06:49:45,704][123090] Updated weights for policy 1, policy_version 900311 (0.0005) [2023-12-26 06:49:46,401][123090] Updated weights for policy 1, policy_version 900321 (0.0005) [2023-12-26 06:49:46,429][123091] Updated weights for policy 0, policy_version 906580 (0.0008) [2023-12-26 06:49:46,454][123090] Updated weights for policy 1, policy_version 900331 (0.0008) [2023-12-26 06:49:46,495][123091] Updated weights for policy 0, policy_version 906590 (0.0008) [2023-12-26 06:49:46,498][123090] Updated weights for policy 1, policy_version 900341 (0.0007) [2023-12-26 06:49:46,558][123091] Updated weights for policy 0, policy_version 906600 (0.0011) [2023-12-26 06:49:46,563][123090] Updated weights for policy 1, policy_version 900351 (0.0008) [2023-12-26 06:49:47,299][123091] Updated weights for policy 0, policy_version 906610 (0.0011) [2023-12-26 06:49:47,343][123091] Updated weights for policy 0, policy_version 906620 (0.0010) [2023-12-26 06:49:47,363][123090] Updated weights for policy 1, policy_version 900361 (0.0006) [2023-12-26 06:49:47,399][123091] Updated weights for policy 0, policy_version 906630 (0.0011) [2023-12-26 06:49:47,429][123090] Updated weights for policy 1, policy_version 900371 (0.0006) [2023-12-26 06:49:47,462][123091] Updated weights for policy 0, policy_version 906640 (0.0011) [2023-12-26 06:49:47,494][123090] Updated weights for policy 1, policy_version 900381 (0.0005) [2023-12-26 06:49:48,165][123090] Updated weights for policy 1, policy_version 900391 (0.0009) [2023-12-26 06:49:48,227][123090] Updated weights for policy 1, policy_version 900401 (0.0010) [2023-12-26 06:49:48,234][123091] Updated weights for policy 0, policy_version 906650 (0.0010) [2023-12-26 06:49:48,282][123090] Updated weights for policy 1, policy_version 900411 (0.0010) [2023-12-26 06:49:48,296][123091] Updated weights for policy 0, policy_version 906660 (0.0010) [2023-12-26 06:49:48,355][123091] Updated weights for policy 0, policy_version 906670 (0.0010) [2023-12-26 06:49:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 462618624. Throughput: 0: 8819.5, 1: 8865.2. Samples: 462629304. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:48,785][121949] Avg episode reward: [(0, '6244.615'), (1, '5394.292')] [2023-12-26 06:49:49,106][123090] Updated weights for policy 1, policy_version 900421 (0.0010) [2023-12-26 06:49:49,172][123090] Updated weights for policy 1, policy_version 900431 (0.0010) [2023-12-26 06:49:49,180][123091] Updated weights for policy 0, policy_version 906680 (0.0009) [2023-12-26 06:49:49,240][123090] Updated weights for policy 1, policy_version 900441 (0.0011) [2023-12-26 06:49:49,243][123091] Updated weights for policy 0, policy_version 906690 (0.0011) [2023-12-26 06:49:49,302][123091] Updated weights for policy 0, policy_version 906700 (0.0011) [2023-12-26 06:49:50,058][123090] Updated weights for policy 1, policy_version 900451 (0.0009) [2023-12-26 06:49:50,122][123090] Updated weights for policy 1, policy_version 900461 (0.0007) [2023-12-26 06:49:50,131][123091] Updated weights for policy 0, policy_version 906710 (0.0010) [2023-12-26 06:49:50,180][123091] Updated weights for policy 0, policy_version 906720 (0.0009) [2023-12-26 06:49:50,180][123090] Updated weights for policy 1, policy_version 900471 (0.0006) [2023-12-26 06:49:50,237][123091] Updated weights for policy 0, policy_version 906730 (0.0007) [2023-12-26 06:49:50,932][123090] Updated weights for policy 1, policy_version 900481 (0.0010) [2023-12-26 06:49:50,998][123090] Updated weights for policy 1, policy_version 900491 (0.0009) [2023-12-26 06:49:51,057][123090] Updated weights for policy 1, policy_version 900501 (0.0008) [2023-12-26 06:49:51,077][123091] Updated weights for policy 0, policy_version 906740 (0.0008) [2023-12-26 06:49:51,123][123090] Updated weights for policy 1, policy_version 900511 (0.0010) [2023-12-26 06:49:51,143][123091] Updated weights for policy 0, policy_version 906750 (0.0007) [2023-12-26 06:49:51,208][123091] Updated weights for policy 0, policy_version 906760 (0.0009) [2023-12-26 06:49:51,945][123090] Updated weights for policy 1, policy_version 900521 (0.0010) [2023-12-26 06:49:51,995][123091] Updated weights for policy 0, policy_version 906770 (0.0007) [2023-12-26 06:49:52,001][123090] Updated weights for policy 1, policy_version 900531 (0.0010) [2023-12-26 06:49:52,061][123090] Updated weights for policy 1, policy_version 900541 (0.0010) [2023-12-26 06:49:52,063][123091] Updated weights for policy 0, policy_version 906780 (0.0006) [2023-12-26 06:49:52,134][123091] Updated weights for policy 0, policy_version 906790 (0.0011) [2023-12-26 06:49:52,197][123091] Updated weights for policy 0, policy_version 906800 (0.0011) [2023-12-26 06:49:52,962][123091] Updated weights for policy 0, policy_version 906810 (0.0008) [2023-12-26 06:49:52,963][123090] Updated weights for policy 1, policy_version 900551 (0.0009) [2023-12-26 06:49:53,022][123091] Updated weights for policy 0, policy_version 906820 (0.0008) [2023-12-26 06:49:53,024][123090] Updated weights for policy 1, policy_version 900561 (0.0008) [2023-12-26 06:49:53,072][123091] Updated weights for policy 0, policy_version 906830 (0.0007) [2023-12-26 06:49:53,088][123090] Updated weights for policy 1, policy_version 900571 (0.0009) [2023-12-26 06:49:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 462700544. Throughput: 0: 8810.1, 1: 8798.0. Samples: 462681200. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:53,785][121949] Avg episode reward: [(0, '6194.859'), (1, '5348.144')] [2023-12-26 06:49:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000900576_230547456.pth... [2023-12-26 06:49:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000899584_230293504.pth [2023-12-26 06:49:53,816][123091] Updated weights for policy 0, policy_version 906840 (0.0010) [2023-12-26 06:49:53,867][123091] Updated weights for policy 0, policy_version 906850 (0.0010) [2023-12-26 06:49:53,891][123090] Updated weights for policy 1, policy_version 900581 (0.0008) [2023-12-26 06:49:53,914][123091] Updated weights for policy 0, policy_version 906860 (0.0010) [2023-12-26 06:49:53,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000906864_232161280.pth... [2023-12-26 06:49:53,940][123090] Updated weights for policy 1, policy_version 900591 (0.0007) [2023-12-26 06:49:53,943][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000905808_231890944.pth [2023-12-26 06:49:54,011][123090] Updated weights for policy 1, policy_version 900601 (0.0009) [2023-12-26 06:49:54,747][123091] Updated weights for policy 0, policy_version 906870 (0.0007) [2023-12-26 06:49:54,803][123091] Updated weights for policy 0, policy_version 906880 (0.0005) [2023-12-26 06:49:54,857][123091] Updated weights for policy 0, policy_version 906890 (0.0005) [2023-12-26 06:49:54,871][123090] Updated weights for policy 1, policy_version 900611 (0.0009) [2023-12-26 06:49:54,935][123090] Updated weights for policy 1, policy_version 900621 (0.0008) [2023-12-26 06:49:54,996][123090] Updated weights for policy 1, policy_version 900631 (0.0009) [2023-12-26 06:49:55,655][123091] Updated weights for policy 0, policy_version 906900 (0.0010) [2023-12-26 06:49:55,713][123091] Updated weights for policy 0, policy_version 906910 (0.0010) [2023-12-26 06:49:55,782][123091] Updated weights for policy 0, policy_version 906920 (0.0011) [2023-12-26 06:49:55,813][123090] Updated weights for policy 1, policy_version 900641 (0.0008) [2023-12-26 06:49:55,866][123090] Updated weights for policy 1, policy_version 900651 (0.0006) [2023-12-26 06:49:55,929][123090] Updated weights for policy 1, policy_version 900661 (0.0008) [2023-12-26 06:49:55,977][123090] Updated weights for policy 1, policy_version 900671 (0.0009) [2023-12-26 06:49:56,569][123091] Updated weights for policy 0, policy_version 906930 (0.0009) [2023-12-26 06:49:56,618][123091] Updated weights for policy 0, policy_version 906940 (0.0005) [2023-12-26 06:49:56,668][123091] Updated weights for policy 0, policy_version 906950 (0.0009) [2023-12-26 06:49:56,729][123091] Updated weights for policy 0, policy_version 906960 (0.0010) [2023-12-26 06:49:56,769][123090] Updated weights for policy 1, policy_version 900681 (0.0010) [2023-12-26 06:49:56,819][123090] Updated weights for policy 1, policy_version 900691 (0.0007) [2023-12-26 06:49:56,885][123090] Updated weights for policy 1, policy_version 900701 (0.0005) [2023-12-26 06:49:57,481][123091] Updated weights for policy 0, policy_version 906970 (0.0005) [2023-12-26 06:49:57,528][123091] Updated weights for policy 0, policy_version 906980 (0.0006) [2023-12-26 06:49:57,530][123090] Updated weights for policy 1, policy_version 900711 (0.0006) [2023-12-26 06:49:57,574][123091] Updated weights for policy 0, policy_version 906990 (0.0005) [2023-12-26 06:49:57,599][123090] Updated weights for policy 1, policy_version 900721 (0.0006) [2023-12-26 06:49:57,657][123090] Updated weights for policy 1, policy_version 900731 (0.0006) [2023-12-26 06:49:58,327][123091] Updated weights for policy 0, policy_version 907000 (0.0007) [2023-12-26 06:49:58,399][123090] Updated weights for policy 1, policy_version 900741 (0.0007) [2023-12-26 06:49:58,401][123091] Updated weights for policy 0, policy_version 907010 (0.0008) [2023-12-26 06:49:58,465][123090] Updated weights for policy 1, policy_version 900751 (0.0006) [2023-12-26 06:49:58,470][123091] Updated weights for policy 0, policy_version 907020 (0.0006) [2023-12-26 06:49:58,536][123090] Updated weights for policy 1, policy_version 900761 (0.0010) [2023-12-26 06:49:58,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 462798848. Throughput: 0: 8937.7, 1: 8788.7. Samples: 462788780. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:49:58,785][121949] Avg episode reward: [(0, '6338.030'), (1, '5620.434')] [2023-12-26 06:49:59,269][123091] Updated weights for policy 0, policy_version 907030 (0.0007) [2023-12-26 06:49:59,336][123091] Updated weights for policy 0, policy_version 907040 (0.0006) [2023-12-26 06:49:59,400][123091] Updated weights for policy 0, policy_version 907050 (0.0008) [2023-12-26 06:49:59,461][123090] Updated weights for policy 1, policy_version 900771 (0.0009) [2023-12-26 06:49:59,512][123090] Updated weights for policy 1, policy_version 900781 (0.0009) [2023-12-26 06:49:59,572][123090] Updated weights for policy 1, policy_version 900791 (0.0010) [2023-12-26 06:50:00,103][123091] Updated weights for policy 0, policy_version 907060 (0.0008) [2023-12-26 06:50:00,162][123091] Updated weights for policy 0, policy_version 907070 (0.0010) [2023-12-26 06:50:00,222][123091] Updated weights for policy 0, policy_version 907080 (0.0009) [2023-12-26 06:50:00,444][123090] Updated weights for policy 1, policy_version 900801 (0.0010) [2023-12-26 06:50:00,502][123090] Updated weights for policy 1, policy_version 900811 (0.0010) [2023-12-26 06:50:00,555][123090] Updated weights for policy 1, policy_version 900821 (0.0009) [2023-12-26 06:50:00,611][123090] Updated weights for policy 1, policy_version 900832 (0.0010) [2023-12-26 06:50:00,946][123091] Updated weights for policy 0, policy_version 907090 (0.0008) [2023-12-26 06:50:01,018][123091] Updated weights for policy 0, policy_version 907100 (0.0005) [2023-12-26 06:50:01,083][123091] Updated weights for policy 0, policy_version 907110 (0.0006) [2023-12-26 06:50:01,157][123091] Updated weights for policy 0, policy_version 907120 (0.0007) [2023-12-26 06:50:01,515][123090] Updated weights for policy 1, policy_version 900842 (0.0007) [2023-12-26 06:50:01,564][123090] Updated weights for policy 1, policy_version 900852 (0.0007) [2023-12-26 06:50:01,626][123090] Updated weights for policy 1, policy_version 900862 (0.0007) [2023-12-26 06:50:01,899][123091] Updated weights for policy 0, policy_version 907130 (0.0009) [2023-12-26 06:50:01,964][123091] Updated weights for policy 0, policy_version 907140 (0.0009) [2023-12-26 06:50:02,029][123091] Updated weights for policy 0, policy_version 907150 (0.0009) [2023-12-26 06:50:02,453][123090] Updated weights for policy 1, policy_version 900872 (0.0009) [2023-12-26 06:50:02,509][123090] Updated weights for policy 1, policy_version 900882 (0.0009) [2023-12-26 06:50:02,568][123090] Updated weights for policy 1, policy_version 900892 (0.0010) [2023-12-26 06:50:02,800][123091] Updated weights for policy 0, policy_version 907160 (0.0009) [2023-12-26 06:50:02,859][123091] Updated weights for policy 0, policy_version 907170 (0.0009) [2023-12-26 06:50:02,922][123091] Updated weights for policy 0, policy_version 907180 (0.0009) [2023-12-26 06:50:03,385][123090] Updated weights for policy 1, policy_version 900902 (0.0007) [2023-12-26 06:50:03,446][123090] Updated weights for policy 1, policy_version 900912 (0.0006) [2023-12-26 06:50:03,511][123090] Updated weights for policy 1, policy_version 900922 (0.0005) [2023-12-26 06:50:03,753][123091] Updated weights for policy 0, policy_version 907190 (0.0007) [2023-12-26 06:50:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 462880768. Throughput: 0: 8937.7, 1: 8640.8. Samples: 462893804. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:03,785][121949] Avg episode reward: [(0, '6207.569'), (1, '5662.117')] [2023-12-26 06:50:03,825][123091] Updated weights for policy 0, policy_version 907200 (0.0005) [2023-12-26 06:50:03,893][123091] Updated weights for policy 0, policy_version 907210 (0.0010) [2023-12-26 06:50:04,190][123090] Updated weights for policy 1, policy_version 900932 (0.0005) [2023-12-26 06:50:04,253][123090] Updated weights for policy 1, policy_version 900942 (0.0007) [2023-12-26 06:50:04,310][123090] Updated weights for policy 1, policy_version 900952 (0.0006) [2023-12-26 06:50:04,696][123091] Updated weights for policy 0, policy_version 907220 (0.0009) [2023-12-26 06:50:04,749][123091] Updated weights for policy 0, policy_version 907230 (0.0010) [2023-12-26 06:50:04,810][123091] Updated weights for policy 0, policy_version 907241 (0.0010) [2023-12-26 06:50:05,065][123090] Updated weights for policy 1, policy_version 900962 (0.0009) [2023-12-26 06:50:05,117][123090] Updated weights for policy 1, policy_version 900972 (0.0010) [2023-12-26 06:50:05,166][123090] Updated weights for policy 1, policy_version 900982 (0.0006) [2023-12-26 06:50:05,217][123090] Updated weights for policy 1, policy_version 900992 (0.0009) [2023-12-26 06:50:05,709][123091] Updated weights for policy 0, policy_version 907251 (0.0009) [2023-12-26 06:50:05,762][123091] Updated weights for policy 0, policy_version 907261 (0.0010) [2023-12-26 06:50:05,822][123091] Updated weights for policy 0, policy_version 907272 (0.0010) [2023-12-26 06:50:05,982][123090] Updated weights for policy 1, policy_version 901002 (0.0010) [2023-12-26 06:50:06,034][123090] Updated weights for policy 1, policy_version 901012 (0.0010) [2023-12-26 06:50:06,108][123090] Updated weights for policy 1, policy_version 901022 (0.0010) [2023-12-26 06:50:06,643][123091] Updated weights for policy 0, policy_version 907282 (0.0010) [2023-12-26 06:50:06,705][123091] Updated weights for policy 0, policy_version 907292 (0.0009) [2023-12-26 06:50:06,760][123091] Updated weights for policy 0, policy_version 907302 (0.0010) [2023-12-26 06:50:06,818][123091] Updated weights for policy 0, policy_version 907312 (0.0010) [2023-12-26 06:50:06,928][123090] Updated weights for policy 1, policy_version 901032 (0.0008) [2023-12-26 06:50:06,986][123090] Updated weights for policy 1, policy_version 901042 (0.0008) [2023-12-26 06:50:07,040][123090] Updated weights for policy 1, policy_version 901052 (0.0009) [2023-12-26 06:50:07,705][123091] Updated weights for policy 0, policy_version 907322 (0.0009) [2023-12-26 06:50:07,742][123090] Updated weights for policy 1, policy_version 901062 (0.0008) [2023-12-26 06:50:07,770][123091] Updated weights for policy 0, policy_version 907332 (0.0008) [2023-12-26 06:50:07,801][123090] Updated weights for policy 1, policy_version 901072 (0.0005) [2023-12-26 06:50:07,823][123091] Updated weights for policy 0, policy_version 907342 (0.0009) [2023-12-26 06:50:07,860][123090] Updated weights for policy 1, policy_version 901082 (0.0005) [2023-12-26 06:50:08,554][123090] Updated weights for policy 1, policy_version 901092 (0.0006) [2023-12-26 06:50:08,624][123090] Updated weights for policy 1, policy_version 901102 (0.0006) [2023-12-26 06:50:08,690][123090] Updated weights for policy 1, policy_version 901112 (0.0006) [2023-12-26 06:50:08,725][123091] Updated weights for policy 0, policy_version 907352 (0.0006) [2023-12-26 06:50:08,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 462970880. Throughput: 0: 8946.9, 1: 8702.9. Samples: 462947636. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:08,785][121949] Avg episode reward: [(0, '6080.778'), (1, '5183.188')] [2023-12-26 06:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000901120_230686720.pth... [2023-12-26 06:50:08,794][123091] Updated weights for policy 0, policy_version 907362 (0.0005) [2023-12-26 06:50:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000900096_230424576.pth [2023-12-26 06:50:08,850][123091] Updated weights for policy 0, policy_version 907372 (0.0005) [2023-12-26 06:50:08,875][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000907376_232292352.pth... [2023-12-26 06:50:08,878][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000906320_232022016.pth [2023-12-26 06:50:09,344][123090] Updated weights for policy 1, policy_version 901122 (0.0006) [2023-12-26 06:50:09,411][123090] Updated weights for policy 1, policy_version 901132 (0.0009) [2023-12-26 06:50:09,467][123090] Updated weights for policy 1, policy_version 901142 (0.0008) [2023-12-26 06:50:09,520][123090] Updated weights for policy 1, policy_version 901152 (0.0008) [2023-12-26 06:50:09,614][123091] Updated weights for policy 0, policy_version 907382 (0.0009) [2023-12-26 06:50:09,674][123091] Updated weights for policy 0, policy_version 907392 (0.0011) [2023-12-26 06:50:09,737][123091] Updated weights for policy 0, policy_version 907402 (0.0011) [2023-12-26 06:50:10,369][123090] Updated weights for policy 1, policy_version 901162 (0.0009) [2023-12-26 06:50:10,447][123090] Updated weights for policy 1, policy_version 901172 (0.0011) [2023-12-26 06:50:10,509][123090] Updated weights for policy 1, policy_version 901182 (0.0010) [2023-12-26 06:50:10,582][123091] Updated weights for policy 0, policy_version 907412 (0.0009) [2023-12-26 06:50:10,655][123091] Updated weights for policy 0, policy_version 907422 (0.0006) [2023-12-26 06:50:10,721][123091] Updated weights for policy 0, policy_version 907432 (0.0011) [2023-12-26 06:50:11,348][123090] Updated weights for policy 1, policy_version 901192 (0.0010) [2023-12-26 06:50:11,424][123090] Updated weights for policy 1, policy_version 901202 (0.0010) [2023-12-26 06:50:11,492][123090] Updated weights for policy 1, policy_version 901212 (0.0009) [2023-12-26 06:50:11,501][123091] Updated weights for policy 0, policy_version 907442 (0.0010) [2023-12-26 06:50:11,565][123091] Updated weights for policy 0, policy_version 907452 (0.0009) [2023-12-26 06:50:11,637][123091] Updated weights for policy 0, policy_version 907462 (0.0010) [2023-12-26 06:50:11,694][123091] Updated weights for policy 0, policy_version 907472 (0.0010) [2023-12-26 06:50:12,346][123090] Updated weights for policy 1, policy_version 901222 (0.0010) [2023-12-26 06:50:12,410][123090] Updated weights for policy 1, policy_version 901232 (0.0009) [2023-12-26 06:50:12,446][123091] Updated weights for policy 0, policy_version 907482 (0.0008) [2023-12-26 06:50:12,467][123090] Updated weights for policy 1, policy_version 901242 (0.0009) [2023-12-26 06:50:12,497][123091] Updated weights for policy 0, policy_version 907492 (0.0009) [2023-12-26 06:50:12,552][123091] Updated weights for policy 0, policy_version 907502 (0.0010) [2023-12-26 06:50:13,324][123090] Updated weights for policy 1, policy_version 901252 (0.0008) [2023-12-26 06:50:13,377][123090] Updated weights for policy 1, policy_version 901262 (0.0010) [2023-12-26 06:50:13,424][123091] Updated weights for policy 0, policy_version 907512 (0.0010) [2023-12-26 06:50:13,427][123090] Updated weights for policy 1, policy_version 901272 (0.0006) [2023-12-26 06:50:13,479][123091] Updated weights for policy 0, policy_version 907522 (0.0009) [2023-12-26 06:50:13,547][123091] Updated weights for policy 0, policy_version 907532 (0.0009) [2023-12-26 06:50:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 463060992. Throughput: 0: 8807.5, 1: 8737.2. Samples: 463051596. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:13,785][121949] Avg episode reward: [(0, '6143.281'), (1, '5194.630')] [2023-12-26 06:50:14,169][123090] Updated weights for policy 1, policy_version 901282 (0.0006) [2023-12-26 06:50:14,222][123090] Updated weights for policy 1, policy_version 901292 (0.0010) [2023-12-26 06:50:14,276][123090] Updated weights for policy 1, policy_version 901302 (0.0010) [2023-12-26 06:50:14,305][123091] Updated weights for policy 0, policy_version 907542 (0.0008) [2023-12-26 06:50:14,341][123090] Updated weights for policy 1, policy_version 901312 (0.0010) [2023-12-26 06:50:14,360][123091] Updated weights for policy 0, policy_version 907552 (0.0008) [2023-12-26 06:50:14,415][123091] Updated weights for policy 0, policy_version 907562 (0.0009) [2023-12-26 06:50:15,174][123090] Updated weights for policy 1, policy_version 901322 (0.0011) [2023-12-26 06:50:15,246][123090] Updated weights for policy 1, policy_version 901332 (0.0011) [2023-12-26 06:50:15,305][123091] Updated weights for policy 0, policy_version 907572 (0.0009) [2023-12-26 06:50:15,314][123090] Updated weights for policy 1, policy_version 901342 (0.0011) [2023-12-26 06:50:15,372][123091] Updated weights for policy 0, policy_version 907582 (0.0009) [2023-12-26 06:50:15,445][123091] Updated weights for policy 0, policy_version 907592 (0.0009) [2023-12-26 06:50:16,130][123090] Updated weights for policy 1, policy_version 901352 (0.0010) [2023-12-26 06:50:16,173][123090] Updated weights for policy 1, policy_version 901362 (0.0007) [2023-12-26 06:50:16,229][123090] Updated weights for policy 1, policy_version 901372 (0.0005) [2023-12-26 06:50:16,253][123091] Updated weights for policy 0, policy_version 907602 (0.0008) [2023-12-26 06:50:16,307][123091] Updated weights for policy 0, policy_version 907612 (0.0008) [2023-12-26 06:50:16,366][123091] Updated weights for policy 0, policy_version 907622 (0.0010) [2023-12-26 06:50:16,432][123091] Updated weights for policy 0, policy_version 907632 (0.0011) [2023-12-26 06:50:16,934][123090] Updated weights for policy 1, policy_version 901382 (0.0005) [2023-12-26 06:50:17,000][123090] Updated weights for policy 1, policy_version 901392 (0.0005) [2023-12-26 06:50:17,062][123090] Updated weights for policy 1, policy_version 901402 (0.0006) [2023-12-26 06:50:17,147][123091] Updated weights for policy 0, policy_version 907642 (0.0007) [2023-12-26 06:50:17,207][123091] Updated weights for policy 0, policy_version 907652 (0.0009) [2023-12-26 06:50:17,262][123091] Updated weights for policy 0, policy_version 907662 (0.0008) [2023-12-26 06:50:17,823][123090] Updated weights for policy 1, policy_version 901412 (0.0010) [2023-12-26 06:50:17,871][123090] Updated weights for policy 1, policy_version 901422 (0.0010) [2023-12-26 06:50:17,914][123090] Updated weights for policy 1, policy_version 901432 (0.0010) [2023-12-26 06:50:18,085][123091] Updated weights for policy 0, policy_version 907672 (0.0009) [2023-12-26 06:50:18,141][123091] Updated weights for policy 0, policy_version 907682 (0.0009) [2023-12-26 06:50:18,199][123091] Updated weights for policy 0, policy_version 907692 (0.0009) [2023-12-26 06:50:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 463142912. Throughput: 0: 8783.5, 1: 8795.7. Samples: 463158496. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:18,785][121949] Avg episode reward: [(0, '6265.754'), (1, '5607.203')] [2023-12-26 06:50:18,828][123090] Updated weights for policy 1, policy_version 901442 (0.0009) [2023-12-26 06:50:18,885][123090] Updated weights for policy 1, policy_version 901452 (0.0006) [2023-12-26 06:50:18,941][123090] Updated weights for policy 1, policy_version 901462 (0.0009) [2023-12-26 06:50:18,943][123091] Updated weights for policy 0, policy_version 907702 (0.0010) [2023-12-26 06:50:19,001][123090] Updated weights for policy 1, policy_version 901472 (0.0006) [2023-12-26 06:50:19,004][123091] Updated weights for policy 0, policy_version 907712 (0.0011) [2023-12-26 06:50:19,065][123091] Updated weights for policy 0, policy_version 907722 (0.0011) [2023-12-26 06:50:19,760][123090] Updated weights for policy 1, policy_version 901482 (0.0009) [2023-12-26 06:50:19,830][123090] Updated weights for policy 1, policy_version 901492 (0.0009) [2023-12-26 06:50:19,832][123091] Updated weights for policy 0, policy_version 907732 (0.0009) [2023-12-26 06:50:19,896][123090] Updated weights for policy 1, policy_version 901502 (0.0008) [2023-12-26 06:50:19,897][123091] Updated weights for policy 0, policy_version 907742 (0.0009) [2023-12-26 06:50:19,964][123091] Updated weights for policy 0, policy_version 907752 (0.0010) [2023-12-26 06:50:20,690][123091] Updated weights for policy 0, policy_version 907762 (0.0006) [2023-12-26 06:50:20,755][123091] Updated weights for policy 0, policy_version 907772 (0.0005) [2023-12-26 06:50:20,792][123090] Updated weights for policy 1, policy_version 901512 (0.0009) [2023-12-26 06:50:20,815][123091] Updated weights for policy 0, policy_version 907782 (0.0005) [2023-12-26 06:50:20,855][123090] Updated weights for policy 1, policy_version 901522 (0.0010) [2023-12-26 06:50:20,881][123091] Updated weights for policy 0, policy_version 907792 (0.0005) [2023-12-26 06:50:20,906][123090] Updated weights for policy 1, policy_version 901532 (0.0009) [2023-12-26 06:50:21,627][123091] Updated weights for policy 0, policy_version 907802 (0.0007) [2023-12-26 06:50:21,681][123091] Updated weights for policy 0, policy_version 907812 (0.0009) [2023-12-26 06:50:21,747][123091] Updated weights for policy 0, policy_version 907822 (0.0007) [2023-12-26 06:50:21,872][123090] Updated weights for policy 1, policy_version 901542 (0.0010) [2023-12-26 06:50:21,924][123090] Updated weights for policy 1, policy_version 901552 (0.0008) [2023-12-26 06:50:21,983][123090] Updated weights for policy 1, policy_version 901562 (0.0010) [2023-12-26 06:50:22,514][123091] Updated weights for policy 0, policy_version 907832 (0.0009) [2023-12-26 06:50:22,584][123091] Updated weights for policy 0, policy_version 907842 (0.0009) [2023-12-26 06:50:22,654][123091] Updated weights for policy 0, policy_version 907852 (0.0009) [2023-12-26 06:50:22,886][123090] Updated weights for policy 1, policy_version 901572 (0.0010) [2023-12-26 06:50:22,944][123090] Updated weights for policy 1, policy_version 901582 (0.0010) [2023-12-26 06:50:22,998][123090] Updated weights for policy 1, policy_version 901592 (0.0009) [2023-12-26 06:50:23,402][123091] Updated weights for policy 0, policy_version 907862 (0.0007) [2023-12-26 06:50:23,468][123091] Updated weights for policy 0, policy_version 907872 (0.0006) [2023-12-26 06:50:23,530][123091] Updated weights for policy 0, policy_version 907882 (0.0009) [2023-12-26 06:50:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 463233024. Throughput: 0: 8844.4, 1: 8769.0. Samples: 463210984. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:23,785][121949] Avg episode reward: [(0, '6244.598'), (1, '5654.637')] [2023-12-26 06:50:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000901600_230809600.pth... [2023-12-26 06:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000907888_232423424.pth... [2023-12-26 06:50:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000900576_230547456.pth [2023-12-26 06:50:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000906864_232161280.pth [2023-12-26 06:50:23,886][123090] Updated weights for policy 1, policy_version 901602 (0.0010) [2023-12-26 06:50:23,948][123090] Updated weights for policy 1, policy_version 901612 (0.0010) [2023-12-26 06:50:23,999][123090] Updated weights for policy 1, policy_version 901622 (0.0010) [2023-12-26 06:50:24,054][123090] Updated weights for policy 1, policy_version 901632 (0.0010) [2023-12-26 06:50:24,162][123091] Updated weights for policy 0, policy_version 907892 (0.0010) [2023-12-26 06:50:24,224][123091] Updated weights for policy 0, policy_version 907902 (0.0009) [2023-12-26 06:50:24,285][123091] Updated weights for policy 0, policy_version 907912 (0.0010) [2023-12-26 06:50:24,892][123090] Updated weights for policy 1, policy_version 901642 (0.0005) [2023-12-26 06:50:24,946][123090] Updated weights for policy 1, policy_version 901652 (0.0005) [2023-12-26 06:50:24,998][123090] Updated weights for policy 1, policy_version 901662 (0.0006) [2023-12-26 06:50:25,114][123091] Updated weights for policy 0, policy_version 907922 (0.0007) [2023-12-26 06:50:25,189][123091] Updated weights for policy 0, policy_version 907932 (0.0005) [2023-12-26 06:50:25,253][123091] Updated weights for policy 0, policy_version 907942 (0.0005) [2023-12-26 06:50:25,319][123091] Updated weights for policy 0, policy_version 907952 (0.0006) [2023-12-26 06:50:25,707][123090] Updated weights for policy 1, policy_version 901672 (0.0009) [2023-12-26 06:50:25,767][123090] Updated weights for policy 1, policy_version 901682 (0.0009) [2023-12-26 06:50:25,836][123090] Updated weights for policy 1, policy_version 901692 (0.0009) [2023-12-26 06:50:26,009][123091] Updated weights for policy 0, policy_version 907962 (0.0010) [2023-12-26 06:50:26,061][123091] Updated weights for policy 0, policy_version 907972 (0.0009) [2023-12-26 06:50:26,116][123091] Updated weights for policy 0, policy_version 907982 (0.0010) [2023-12-26 06:50:26,620][123090] Updated weights for policy 1, policy_version 901702 (0.0009) [2023-12-26 06:50:26,678][123090] Updated weights for policy 1, policy_version 901712 (0.0009) [2023-12-26 06:50:26,735][123090] Updated weights for policy 1, policy_version 901722 (0.0008) [2023-12-26 06:50:26,960][123091] Updated weights for policy 0, policy_version 907992 (0.0008) [2023-12-26 06:50:27,027][123091] Updated weights for policy 0, policy_version 908002 (0.0008) [2023-12-26 06:50:27,087][123091] Updated weights for policy 0, policy_version 908012 (0.0008) [2023-12-26 06:50:27,607][123090] Updated weights for policy 1, policy_version 901732 (0.0009) [2023-12-26 06:50:27,660][123090] Updated weights for policy 1, policy_version 901742 (0.0009) [2023-12-26 06:50:27,724][123090] Updated weights for policy 1, policy_version 901752 (0.0009) [2023-12-26 06:50:27,819][123091] Updated weights for policy 0, policy_version 908022 (0.0009) [2023-12-26 06:50:27,891][123091] Updated weights for policy 0, policy_version 908032 (0.0010) [2023-12-26 06:50:27,940][123091] Updated weights for policy 0, policy_version 908042 (0.0005) [2023-12-26 06:50:28,534][123090] Updated weights for policy 1, policy_version 901762 (0.0008) [2023-12-26 06:50:28,589][123090] Updated weights for policy 1, policy_version 901772 (0.0006) [2023-12-26 06:50:28,641][123091] Updated weights for policy 0, policy_version 908052 (0.0007) [2023-12-26 06:50:28,647][123090] Updated weights for policy 1, policy_version 901782 (0.0007) [2023-12-26 06:50:28,703][123090] Updated weights for policy 1, policy_version 901792 (0.0007) [2023-12-26 06:50:28,708][123091] Updated weights for policy 0, policy_version 908062 (0.0010) [2023-12-26 06:50:28,772][123091] Updated weights for policy 0, policy_version 908072 (0.0009) [2023-12-26 06:50:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 463323136. Throughput: 0: 8949.6, 1: 8759.5. Samples: 463317656. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:28,784][121949] Avg episode reward: [(0, '6274.986'), (1, '5493.237')] [2023-12-26 06:50:29,502][123090] Updated weights for policy 1, policy_version 901802 (0.0006) [2023-12-26 06:50:29,564][123090] Updated weights for policy 1, policy_version 901812 (0.0005) [2023-12-26 06:50:29,626][123091] Updated weights for policy 0, policy_version 908082 (0.0010) [2023-12-26 06:50:29,628][123090] Updated weights for policy 1, policy_version 901822 (0.0007) [2023-12-26 06:50:29,688][123091] Updated weights for policy 0, policy_version 908092 (0.0010) [2023-12-26 06:50:29,754][123091] Updated weights for policy 0, policy_version 908102 (0.0009) [2023-12-26 06:50:29,823][123091] Updated weights for policy 0, policy_version 908112 (0.0009) [2023-12-26 06:50:30,441][123090] Updated weights for policy 1, policy_version 901832 (0.0009) [2023-12-26 06:50:30,493][123090] Updated weights for policy 1, policy_version 901842 (0.0010) [2023-12-26 06:50:30,526][123091] Updated weights for policy 0, policy_version 908122 (0.0007) [2023-12-26 06:50:30,544][123090] Updated weights for policy 1, policy_version 901852 (0.0009) [2023-12-26 06:50:30,587][123091] Updated weights for policy 0, policy_version 908132 (0.0009) [2023-12-26 06:50:30,641][123091] Updated weights for policy 0, policy_version 908142 (0.0008) [2023-12-26 06:50:31,416][123090] Updated weights for policy 1, policy_version 901862 (0.0009) [2023-12-26 06:50:31,420][123091] Updated weights for policy 0, policy_version 908152 (0.0009) [2023-12-26 06:50:31,469][123090] Updated weights for policy 1, policy_version 901872 (0.0008) [2023-12-26 06:50:31,472][123091] Updated weights for policy 0, policy_version 908162 (0.0009) [2023-12-26 06:50:31,522][123090] Updated weights for policy 1, policy_version 901882 (0.0006) [2023-12-26 06:50:31,524][123091] Updated weights for policy 0, policy_version 908172 (0.0009) [2023-12-26 06:50:32,315][123091] Updated weights for policy 0, policy_version 908182 (0.0009) [2023-12-26 06:50:32,379][123091] Updated weights for policy 0, policy_version 908192 (0.0010) [2023-12-26 06:50:32,418][123090] Updated weights for policy 1, policy_version 901892 (0.0009) [2023-12-26 06:50:32,433][123091] Updated weights for policy 0, policy_version 908202 (0.0009) [2023-12-26 06:50:32,478][123090] Updated weights for policy 1, policy_version 901902 (0.0006) [2023-12-26 06:50:32,547][123090] Updated weights for policy 1, policy_version 901912 (0.0010) [2023-12-26 06:50:33,287][123091] Updated weights for policy 0, policy_version 908212 (0.0010) [2023-12-26 06:50:33,318][123090] Updated weights for policy 1, policy_version 901922 (0.0010) [2023-12-26 06:50:33,337][123091] Updated weights for policy 0, policy_version 908222 (0.0008) [2023-12-26 06:50:33,365][123090] Updated weights for policy 1, policy_version 901932 (0.0010) [2023-12-26 06:50:33,385][123091] Updated weights for policy 0, policy_version 908232 (0.0005) [2023-12-26 06:50:33,420][123090] Updated weights for policy 1, policy_version 901942 (0.0007) [2023-12-26 06:50:33,486][123090] Updated weights for policy 1, policy_version 901952 (0.0005) [2023-12-26 06:50:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 463413248. Throughput: 0: 8914.2, 1: 8720.5. Samples: 463422860. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:33,784][121949] Avg episode reward: [(0, '6356.933'), (1, '5230.582')] [2023-12-26 06:50:34,228][123090] Updated weights for policy 1, policy_version 901962 (0.0008) [2023-12-26 06:50:34,267][123091] Updated weights for policy 0, policy_version 908243 (0.0008) [2023-12-26 06:50:34,296][123090] Updated weights for policy 1, policy_version 901972 (0.0008) [2023-12-26 06:50:34,370][123090] Updated weights for policy 1, policy_version 901982 (0.0009) [2023-12-26 06:50:34,373][123091] Updated weights for policy 0, policy_version 908253 (0.0006) [2023-12-26 06:50:34,436][123091] Updated weights for policy 0, policy_version 908263 (0.0009) [2023-12-26 06:50:35,076][123090] Updated weights for policy 1, policy_version 901992 (0.0006) [2023-12-26 06:50:35,135][123090] Updated weights for policy 1, policy_version 902002 (0.0008) [2023-12-26 06:50:35,186][123091] Updated weights for policy 0, policy_version 908273 (0.0009) [2023-12-26 06:50:35,198][123090] Updated weights for policy 1, policy_version 902012 (0.0009) [2023-12-26 06:50:35,248][123091] Updated weights for policy 0, policy_version 908283 (0.0010) [2023-12-26 06:50:35,306][123091] Updated weights for policy 0, policy_version 908293 (0.0010) [2023-12-26 06:50:35,357][123091] Updated weights for policy 0, policy_version 908303 (0.0010) [2023-12-26 06:50:35,904][123090] Updated weights for policy 1, policy_version 902022 (0.0010) [2023-12-26 06:50:35,975][123090] Updated weights for policy 1, policy_version 902032 (0.0010) [2023-12-26 06:50:36,040][123090] Updated weights for policy 1, policy_version 902042 (0.0010) [2023-12-26 06:50:36,127][123091] Updated weights for policy 0, policy_version 908313 (0.0007) [2023-12-26 06:50:36,192][123091] Updated weights for policy 0, policy_version 908323 (0.0008) [2023-12-26 06:50:36,260][123091] Updated weights for policy 0, policy_version 908333 (0.0008) [2023-12-26 06:50:36,972][123090] Updated weights for policy 1, policy_version 902052 (0.0008) [2023-12-26 06:50:36,973][123091] Updated weights for policy 0, policy_version 908343 (0.0009) [2023-12-26 06:50:37,033][123091] Updated weights for policy 0, policy_version 908353 (0.0010) [2023-12-26 06:50:37,035][123090] Updated weights for policy 1, policy_version 902062 (0.0006) [2023-12-26 06:50:37,090][123090] Updated weights for policy 1, policy_version 902072 (0.0006) [2023-12-26 06:50:37,100][123091] Updated weights for policy 0, policy_version 908363 (0.0011) [2023-12-26 06:50:37,771][123091] Updated weights for policy 0, policy_version 908373 (0.0008) [2023-12-26 06:50:37,841][123091] Updated weights for policy 0, policy_version 908383 (0.0005) [2023-12-26 06:50:37,891][123090] Updated weights for policy 1, policy_version 902082 (0.0008) [2023-12-26 06:50:37,910][123091] Updated weights for policy 0, policy_version 908393 (0.0005) [2023-12-26 06:50:37,950][123090] Updated weights for policy 1, policy_version 902092 (0.0006) [2023-12-26 06:50:38,007][123090] Updated weights for policy 1, policy_version 902102 (0.0006) [2023-12-26 06:50:38,063][123090] Updated weights for policy 1, policy_version 902112 (0.0009) [2023-12-26 06:50:38,710][123091] Updated weights for policy 0, policy_version 908403 (0.0006) [2023-12-26 06:50:38,767][123091] Updated weights for policy 0, policy_version 908413 (0.0009) [2023-12-26 06:50:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 463495168. Throughput: 0: 8953.1, 1: 8717.1. Samples: 463476356. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:38,785][121949] Avg episode reward: [(0, '6322.210'), (1, '5316.242')] [2023-12-26 06:50:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000902112_230940672.pth... [2023-12-26 06:50:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000901120_230686720.pth [2023-12-26 06:50:38,831][123091] Updated weights for policy 0, policy_version 908423 (0.0010) [2023-12-26 06:50:38,862][123090] Updated weights for policy 1, policy_version 902122 (0.0008) [2023-12-26 06:50:38,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000908432_232562688.pth... [2023-12-26 06:50:38,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000907376_232292352.pth [2023-12-26 06:50:38,914][123090] Updated weights for policy 1, policy_version 902132 (0.0009) [2023-12-26 06:50:38,967][123090] Updated weights for policy 1, policy_version 902142 (0.0009) [2023-12-26 06:50:39,667][123091] Updated weights for policy 0, policy_version 908433 (0.0007) [2023-12-26 06:50:39,728][123091] Updated weights for policy 0, policy_version 908443 (0.0006) [2023-12-26 06:50:39,798][123091] Updated weights for policy 0, policy_version 908453 (0.0006) [2023-12-26 06:50:39,865][123091] Updated weights for policy 0, policy_version 908463 (0.0009) [2023-12-26 06:50:39,891][123090] Updated weights for policy 1, policy_version 902152 (0.0009) [2023-12-26 06:50:39,957][123090] Updated weights for policy 1, policy_version 902162 (0.0007) [2023-12-26 06:50:40,026][123090] Updated weights for policy 1, policy_version 902172 (0.0010) [2023-12-26 06:50:40,660][123091] Updated weights for policy 0, policy_version 908473 (0.0009) [2023-12-26 06:50:40,709][123091] Updated weights for policy 0, policy_version 908483 (0.0008) [2023-12-26 06:50:40,775][123091] Updated weights for policy 0, policy_version 908493 (0.0009) [2023-12-26 06:50:40,858][123090] Updated weights for policy 1, policy_version 902182 (0.0010) [2023-12-26 06:50:40,909][123090] Updated weights for policy 1, policy_version 902192 (0.0009) [2023-12-26 06:50:40,970][123090] Updated weights for policy 1, policy_version 902202 (0.0009) [2023-12-26 06:50:41,642][123091] Updated weights for policy 0, policy_version 908503 (0.0010) [2023-12-26 06:50:41,713][123091] Updated weights for policy 0, policy_version 908513 (0.0010) [2023-12-26 06:50:41,782][123091] Updated weights for policy 0, policy_version 908523 (0.0010) [2023-12-26 06:50:41,949][123090] Updated weights for policy 1, policy_version 902213 (0.0009) [2023-12-26 06:50:42,003][123090] Updated weights for policy 1, policy_version 902223 (0.0010) [2023-12-26 06:50:42,057][123090] Updated weights for policy 1, policy_version 902233 (0.0010) [2023-12-26 06:50:42,613][123091] Updated weights for policy 0, policy_version 908533 (0.0010) [2023-12-26 06:50:42,679][123091] Updated weights for policy 0, policy_version 908543 (0.0006) [2023-12-26 06:50:42,754][123091] Updated weights for policy 0, policy_version 908554 (0.0007) [2023-12-26 06:50:42,902][123090] Updated weights for policy 1, policy_version 902243 (0.0008) [2023-12-26 06:50:42,956][123090] Updated weights for policy 1, policy_version 902253 (0.0007) [2023-12-26 06:50:43,007][123090] Updated weights for policy 1, policy_version 902263 (0.0005) [2023-12-26 06:50:43,385][123091] Updated weights for policy 0, policy_version 908564 (0.0008) [2023-12-26 06:50:43,454][123091] Updated weights for policy 0, policy_version 908574 (0.0007) [2023-12-26 06:50:43,520][123091] Updated weights for policy 0, policy_version 908584 (0.0005) [2023-12-26 06:50:43,572][123090] Updated weights for policy 1, policy_version 902273 (0.0005) [2023-12-26 06:50:43,639][123090] Updated weights for policy 1, policy_version 902283 (0.0007) [2023-12-26 06:50:43,695][123090] Updated weights for policy 1, policy_version 902293 (0.0010) [2023-12-26 06:50:43,759][123090] Updated weights for policy 1, policy_version 902303 (0.0011) [2023-12-26 06:50:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 463593472. Throughput: 0: 8891.8, 1: 8668.3. Samples: 463578976. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:43,785][121949] Avg episode reward: [(0, '6206.520'), (1, '5555.628')] [2023-12-26 06:50:44,219][123091] Updated weights for policy 0, policy_version 908594 (0.0006) [2023-12-26 06:50:44,285][123091] Updated weights for policy 0, policy_version 908604 (0.0010) [2023-12-26 06:50:44,328][123091] Updated weights for policy 0, policy_version 908614 (0.0010) [2023-12-26 06:50:44,376][123091] Updated weights for policy 0, policy_version 908624 (0.0010) [2023-12-26 06:50:44,524][123090] Updated weights for policy 1, policy_version 902313 (0.0008) [2023-12-26 06:50:44,578][123090] Updated weights for policy 1, policy_version 902323 (0.0010) [2023-12-26 06:50:44,633][123090] Updated weights for policy 1, policy_version 902333 (0.0010) [2023-12-26 06:50:45,235][123091] Updated weights for policy 0, policy_version 908634 (0.0006) [2023-12-26 06:50:45,301][123091] Updated weights for policy 0, policy_version 908644 (0.0007) [2023-12-26 06:50:45,370][123091] Updated weights for policy 0, policy_version 908654 (0.0010) [2023-12-26 06:50:45,516][123090] Updated weights for policy 1, policy_version 902343 (0.0007) [2023-12-26 06:50:45,596][123090] Updated weights for policy 1, policy_version 902353 (0.0006) [2023-12-26 06:50:45,663][123090] Updated weights for policy 1, policy_version 902363 (0.0007) [2023-12-26 06:50:46,123][123091] Updated weights for policy 0, policy_version 908664 (0.0006) [2023-12-26 06:50:46,185][123091] Updated weights for policy 0, policy_version 908674 (0.0005) [2023-12-26 06:50:46,256][123091] Updated weights for policy 0, policy_version 908684 (0.0005) [2023-12-26 06:50:46,485][123090] Updated weights for policy 1, policy_version 902373 (0.0009) [2023-12-26 06:50:46,545][123090] Updated weights for policy 1, policy_version 902383 (0.0008) [2023-12-26 06:50:46,611][123090] Updated weights for policy 1, policy_version 902393 (0.0009) [2023-12-26 06:50:46,937][123091] Updated weights for policy 0, policy_version 908694 (0.0007) [2023-12-26 06:50:46,988][123091] Updated weights for policy 0, policy_version 908704 (0.0010) [2023-12-26 06:50:47,043][123091] Updated weights for policy 0, policy_version 908714 (0.0011) [2023-12-26 06:50:47,427][123090] Updated weights for policy 1, policy_version 902403 (0.0008) [2023-12-26 06:50:47,483][123090] Updated weights for policy 1, policy_version 902413 (0.0009) [2023-12-26 06:50:47,533][123090] Updated weights for policy 1, policy_version 902423 (0.0010) [2023-12-26 06:50:47,845][123091] Updated weights for policy 0, policy_version 908724 (0.0010) [2023-12-26 06:50:47,900][123091] Updated weights for policy 0, policy_version 908734 (0.0010) [2023-12-26 06:50:47,955][123091] Updated weights for policy 0, policy_version 908744 (0.0010) [2023-12-26 06:50:48,257][123090] Updated weights for policy 1, policy_version 902433 (0.0010) [2023-12-26 06:50:48,321][123090] Updated weights for policy 1, policy_version 902443 (0.0008) [2023-12-26 06:50:48,400][123090] Updated weights for policy 1, policy_version 902453 (0.0011) [2023-12-26 06:50:48,471][123090] Updated weights for policy 1, policy_version 902463 (0.0011) [2023-12-26 06:50:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 463675392. Throughput: 0: 8901.0, 1: 8744.2. Samples: 463687844. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:48,785][121949] Avg episode reward: [(0, '6183.451'), (1, '5504.959')] [2023-12-26 06:50:48,849][123091] Updated weights for policy 0, policy_version 908754 (0.0010) [2023-12-26 06:50:48,899][123091] Updated weights for policy 0, policy_version 908764 (0.0009) [2023-12-26 06:50:48,948][123091] Updated weights for policy 0, policy_version 908774 (0.0008) [2023-12-26 06:50:48,997][123091] Updated weights for policy 0, policy_version 908784 (0.0009) [2023-12-26 06:50:49,260][123090] Updated weights for policy 1, policy_version 902473 (0.0011) [2023-12-26 06:50:49,320][123090] Updated weights for policy 1, policy_version 902483 (0.0010) [2023-12-26 06:50:49,382][123090] Updated weights for policy 1, policy_version 902493 (0.0011) [2023-12-26 06:50:49,894][123091] Updated weights for policy 0, policy_version 908794 (0.0009) [2023-12-26 06:50:49,966][123091] Updated weights for policy 0, policy_version 908804 (0.0009) [2023-12-26 06:50:50,039][123091] Updated weights for policy 0, policy_version 908814 (0.0009) [2023-12-26 06:50:50,240][123090] Updated weights for policy 1, policy_version 902503 (0.0009) [2023-12-26 06:50:50,293][123090] Updated weights for policy 1, policy_version 902513 (0.0009) [2023-12-26 06:50:50,350][123090] Updated weights for policy 1, policy_version 902523 (0.0010) [2023-12-26 06:50:50,858][123091] Updated weights for policy 0, policy_version 908824 (0.0008) [2023-12-26 06:50:50,931][123091] Updated weights for policy 0, policy_version 908834 (0.0009) [2023-12-26 06:50:50,999][123091] Updated weights for policy 0, policy_version 908844 (0.0009) [2023-12-26 06:50:51,212][123090] Updated weights for policy 1, policy_version 902533 (0.0009) [2023-12-26 06:50:51,275][123090] Updated weights for policy 1, policy_version 902543 (0.0008) [2023-12-26 06:50:51,338][123090] Updated weights for policy 1, policy_version 902553 (0.0009) [2023-12-26 06:50:51,819][123091] Updated weights for policy 0, policy_version 908854 (0.0010) [2023-12-26 06:50:51,884][123091] Updated weights for policy 0, policy_version 908865 (0.0010) [2023-12-26 06:50:51,934][123091] Updated weights for policy 0, policy_version 908875 (0.0009) [2023-12-26 06:50:52,178][123090] Updated weights for policy 1, policy_version 902563 (0.0011) [2023-12-26 06:50:52,226][123090] Updated weights for policy 1, policy_version 902573 (0.0009) [2023-12-26 06:50:52,288][123090] Updated weights for policy 1, policy_version 902583 (0.0008) [2023-12-26 06:50:52,778][123091] Updated weights for policy 0, policy_version 908885 (0.0009) [2023-12-26 06:50:52,844][123091] Updated weights for policy 0, policy_version 908895 (0.0009) [2023-12-26 06:50:52,904][123091] Updated weights for policy 0, policy_version 908905 (0.0007) [2023-12-26 06:50:53,134][123090] Updated weights for policy 1, policy_version 902593 (0.0009) [2023-12-26 06:50:53,184][123090] Updated weights for policy 1, policy_version 902603 (0.0009) [2023-12-26 06:50:53,231][123090] Updated weights for policy 1, policy_version 902613 (0.0008) [2023-12-26 06:50:53,279][123090] Updated weights for policy 1, policy_version 902623 (0.0009) [2023-12-26 06:50:53,692][123091] Updated weights for policy 0, policy_version 908915 (0.0008) [2023-12-26 06:50:53,760][123091] Updated weights for policy 0, policy_version 908925 (0.0008) [2023-12-26 06:50:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 463757312. Throughput: 0: 8875.6, 1: 8678.3. Samples: 463737560. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:53,785][121949] Avg episode reward: [(0, '6217.910'), (1, '5609.740')] [2023-12-26 06:50:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000902624_231071744.pth... [2023-12-26 06:50:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000901600_230809600.pth [2023-12-26 06:50:53,825][123091] Updated weights for policy 0, policy_version 908935 (0.0009) [2023-12-26 06:50:53,878][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000908944_232693760.pth... [2023-12-26 06:50:53,882][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000907888_232423424.pth [2023-12-26 06:50:54,142][123090] Updated weights for policy 1, policy_version 902633 (0.0008) [2023-12-26 06:50:54,202][123090] Updated weights for policy 1, policy_version 902643 (0.0009) [2023-12-26 06:50:54,262][123090] Updated weights for policy 1, policy_version 902653 (0.0009) [2023-12-26 06:50:54,649][123091] Updated weights for policy 0, policy_version 908945 (0.0010) [2023-12-26 06:50:54,721][123091] Updated weights for policy 0, policy_version 908955 (0.0009) [2023-12-26 06:50:54,786][123091] Updated weights for policy 0, policy_version 908965 (0.0009) [2023-12-26 06:50:54,857][123091] Updated weights for policy 0, policy_version 908975 (0.0006) [2023-12-26 06:50:55,078][123090] Updated weights for policy 1, policy_version 902663 (0.0008) [2023-12-26 06:50:55,135][123090] Updated weights for policy 1, policy_version 902673 (0.0009) [2023-12-26 06:50:55,193][123090] Updated weights for policy 1, policy_version 902683 (0.0009) [2023-12-26 06:50:55,600][123091] Updated weights for policy 0, policy_version 908985 (0.0008) [2023-12-26 06:50:55,673][123091] Updated weights for policy 0, policy_version 908995 (0.0009) [2023-12-26 06:50:55,721][123091] Updated weights for policy 0, policy_version 909005 (0.0009) [2023-12-26 06:50:56,017][123090] Updated weights for policy 1, policy_version 902693 (0.0009) [2023-12-26 06:50:56,069][123090] Updated weights for policy 1, policy_version 902703 (0.0009) [2023-12-26 06:50:56,137][123090] Updated weights for policy 1, policy_version 902713 (0.0009) [2023-12-26 06:50:56,505][123091] Updated weights for policy 0, policy_version 909015 (0.0006) [2023-12-26 06:50:56,562][123091] Updated weights for policy 0, policy_version 909025 (0.0005) [2023-12-26 06:50:56,614][123091] Updated weights for policy 0, policy_version 909035 (0.0005) [2023-12-26 06:50:56,967][123090] Updated weights for policy 1, policy_version 902723 (0.0008) [2023-12-26 06:50:57,029][123090] Updated weights for policy 1, policy_version 902733 (0.0010) [2023-12-26 06:50:57,083][123090] Updated weights for policy 1, policy_version 902743 (0.0009) [2023-12-26 06:50:57,308][123091] Updated weights for policy 0, policy_version 909045 (0.0008) [2023-12-26 06:50:57,367][123091] Updated weights for policy 0, policy_version 909055 (0.0010) [2023-12-26 06:50:57,417][123091] Updated weights for policy 0, policy_version 909065 (0.0010) [2023-12-26 06:50:57,919][123090] Updated weights for policy 1, policy_version 902753 (0.0009) [2023-12-26 06:50:57,983][123090] Updated weights for policy 1, policy_version 902763 (0.0010) [2023-12-26 06:50:58,047][123090] Updated weights for policy 1, policy_version 902773 (0.0010) [2023-12-26 06:50:58,107][123090] Updated weights for policy 1, policy_version 902783 (0.0010) [2023-12-26 06:50:58,265][123091] Updated weights for policy 0, policy_version 909075 (0.0009) [2023-12-26 06:50:58,328][123091] Updated weights for policy 0, policy_version 909085 (0.0008) [2023-12-26 06:50:58,392][123091] Updated weights for policy 0, policy_version 909095 (0.0008) [2023-12-26 06:50:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 463847424. Throughput: 0: 8941.7, 1: 8630.7. Samples: 463842352. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:50:58,785][121949] Avg episode reward: [(0, '6136.933'), (1, '5408.748')] [2023-12-26 06:50:58,972][123090] Updated weights for policy 1, policy_version 902793 (0.0009) [2023-12-26 06:50:59,031][123090] Updated weights for policy 1, policy_version 902803 (0.0009) [2023-12-26 06:50:59,090][123090] Updated weights for policy 1, policy_version 902813 (0.0008) [2023-12-26 06:50:59,178][123091] Updated weights for policy 0, policy_version 909105 (0.0006) [2023-12-26 06:50:59,246][123091] Updated weights for policy 0, policy_version 909115 (0.0009) [2023-12-26 06:50:59,312][123091] Updated weights for policy 0, policy_version 909125 (0.0007) [2023-12-26 06:50:59,385][123091] Updated weights for policy 0, policy_version 909135 (0.0009) [2023-12-26 06:50:59,940][123090] Updated weights for policy 1, policy_version 902823 (0.0009) [2023-12-26 06:51:00,009][123090] Updated weights for policy 1, policy_version 902833 (0.0009) [2023-12-26 06:51:00,066][123090] Updated weights for policy 1, policy_version 902843 (0.0009) [2023-12-26 06:51:00,147][123091] Updated weights for policy 0, policy_version 909145 (0.0006) [2023-12-26 06:51:00,198][123091] Updated weights for policy 0, policy_version 909155 (0.0005) [2023-12-26 06:51:00,256][123091] Updated weights for policy 0, policy_version 909165 (0.0006) [2023-12-26 06:51:00,896][123091] Updated weights for policy 0, policy_version 909175 (0.0005) [2023-12-26 06:51:00,902][123090] Updated weights for policy 1, policy_version 902853 (0.0010) [2023-12-26 06:51:00,954][123090] Updated weights for policy 1, policy_version 902863 (0.0010) [2023-12-26 06:51:00,970][123091] Updated weights for policy 0, policy_version 909185 (0.0005) [2023-12-26 06:51:01,007][123090] Updated weights for policy 1, policy_version 902873 (0.0010) [2023-12-26 06:51:01,036][123091] Updated weights for policy 0, policy_version 909195 (0.0006) [2023-12-26 06:51:01,773][123091] Updated weights for policy 0, policy_version 909205 (0.0008) [2023-12-26 06:51:01,832][123090] Updated weights for policy 1, policy_version 902883 (0.0010) [2023-12-26 06:51:01,836][123091] Updated weights for policy 0, policy_version 909215 (0.0010) [2023-12-26 06:51:01,893][123091] Updated weights for policy 0, policy_version 909225 (0.0009) [2023-12-26 06:51:01,896][123090] Updated weights for policy 1, policy_version 902893 (0.0008) [2023-12-26 06:51:01,962][123090] Updated weights for policy 1, policy_version 902903 (0.0007) [2023-12-26 06:51:02,652][123091] Updated weights for policy 0, policy_version 909235 (0.0009) [2023-12-26 06:51:02,713][123091] Updated weights for policy 0, policy_version 909245 (0.0005) [2023-12-26 06:51:02,749][123090] Updated weights for policy 1, policy_version 902913 (0.0009) [2023-12-26 06:51:02,768][123091] Updated weights for policy 0, policy_version 909255 (0.0007) [2023-12-26 06:51:02,815][123090] Updated weights for policy 1, policy_version 902923 (0.0007) [2023-12-26 06:51:02,871][123090] Updated weights for policy 1, policy_version 902933 (0.0009) [2023-12-26 06:51:02,930][123090] Updated weights for policy 1, policy_version 902943 (0.0010) [2023-12-26 06:51:03,407][123091] Updated weights for policy 0, policy_version 909265 (0.0007) [2023-12-26 06:51:03,471][123091] Updated weights for policy 0, policy_version 909275 (0.0005) [2023-12-26 06:51:03,533][123091] Updated weights for policy 0, policy_version 909285 (0.0005) [2023-12-26 06:51:03,593][123091] Updated weights for policy 0, policy_version 909295 (0.0005) [2023-12-26 06:51:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 463937536. Throughput: 0: 9029.6, 1: 8558.8. Samples: 463949972. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:51:03,784][121949] Avg episode reward: [(0, '6202.646'), (1, '5243.412')] [2023-12-26 06:51:03,801][123090] Updated weights for policy 1, policy_version 902953 (0.0009) [2023-12-26 06:51:03,868][123090] Updated weights for policy 1, policy_version 902963 (0.0009) [2023-12-26 06:51:03,927][123090] Updated weights for policy 1, policy_version 902973 (0.0009) [2023-12-26 06:51:04,389][123091] Updated weights for policy 0, policy_version 909305 (0.0008) [2023-12-26 06:51:04,456][123091] Updated weights for policy 0, policy_version 909315 (0.0009) [2023-12-26 06:51:04,525][123091] Updated weights for policy 0, policy_version 909325 (0.0008) [2023-12-26 06:51:04,719][123090] Updated weights for policy 1, policy_version 902983 (0.0009) [2023-12-26 06:51:04,772][123090] Updated weights for policy 1, policy_version 902993 (0.0009) [2023-12-26 06:51:04,823][123090] Updated weights for policy 1, policy_version 903003 (0.0007) [2023-12-26 06:51:05,367][123091] Updated weights for policy 0, policy_version 909335 (0.0010) [2023-12-26 06:51:05,432][123091] Updated weights for policy 0, policy_version 909345 (0.0009) [2023-12-26 06:51:05,486][123091] Updated weights for policy 0, policy_version 909355 (0.0010) [2023-12-26 06:51:05,537][123090] Updated weights for policy 1, policy_version 903013 (0.0005) [2023-12-26 06:51:05,589][123090] Updated weights for policy 1, policy_version 903023 (0.0006) [2023-12-26 06:51:05,642][123090] Updated weights for policy 1, policy_version 903033 (0.0010) [2023-12-26 06:51:06,252][123091] Updated weights for policy 0, policy_version 909365 (0.0009) [2023-12-26 06:51:06,319][123091] Updated weights for policy 0, policy_version 909375 (0.0008) [2023-12-26 06:51:06,371][123090] Updated weights for policy 1, policy_version 903043 (0.0010) [2023-12-26 06:51:06,383][123091] Updated weights for policy 0, policy_version 909385 (0.0008) [2023-12-26 06:51:06,435][123090] Updated weights for policy 1, policy_version 903053 (0.0010) [2023-12-26 06:51:06,499][123090] Updated weights for policy 1, policy_version 903063 (0.0011) [2023-12-26 06:51:07,164][123091] Updated weights for policy 0, policy_version 909395 (0.0007) [2023-12-26 06:51:07,218][123091] Updated weights for policy 0, policy_version 909405 (0.0006) [2023-12-26 06:51:07,268][123091] Updated weights for policy 0, policy_version 909415 (0.0005) [2023-12-26 06:51:07,339][123090] Updated weights for policy 1, policy_version 903073 (0.0011) [2023-12-26 06:51:07,401][123090] Updated weights for policy 1, policy_version 903083 (0.0010) [2023-12-26 06:51:07,471][123090] Updated weights for policy 1, policy_version 903093 (0.0010) [2023-12-26 06:51:07,529][123090] Updated weights for policy 1, policy_version 903103 (0.0010) [2023-12-26 06:51:08,032][123091] Updated weights for policy 0, policy_version 909425 (0.0005) [2023-12-26 06:51:08,085][123091] Updated weights for policy 0, policy_version 909435 (0.0009) [2023-12-26 06:51:08,133][123091] Updated weights for policy 0, policy_version 909445 (0.0009) [2023-12-26 06:51:08,185][123091] Updated weights for policy 0, policy_version 909455 (0.0009) [2023-12-26 06:51:08,312][123090] Updated weights for policy 1, policy_version 903113 (0.0010) [2023-12-26 06:51:08,380][123090] Updated weights for policy 1, policy_version 903123 (0.0010) [2023-12-26 06:51:08,453][123090] Updated weights for policy 1, policy_version 903133 (0.0009) [2023-12-26 06:51:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 464027648. Throughput: 0: 8985.3, 1: 8627.0. Samples: 464003540. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:51:08,785][121949] Avg episode reward: [(0, '6330.705'), (1, '5306.360')] [2023-12-26 06:51:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000909456_232824832.pth... [2023-12-26 06:51:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000903136_231202816.pth... [2023-12-26 06:51:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000902112_230940672.pth [2023-12-26 06:51:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000908432_232562688.pth [2023-12-26 06:51:08,989][123091] Updated weights for policy 0, policy_version 909465 (0.0007) [2023-12-26 06:51:09,061][123091] Updated weights for policy 0, policy_version 909475 (0.0006) [2023-12-26 06:51:09,126][123091] Updated weights for policy 0, policy_version 909485 (0.0006) [2023-12-26 06:51:09,258][123090] Updated weights for policy 1, policy_version 903143 (0.0009) [2023-12-26 06:51:09,335][123090] Updated weights for policy 1, policy_version 903153 (0.0007) [2023-12-26 06:51:09,406][123090] Updated weights for policy 1, policy_version 903163 (0.0008) [2023-12-26 06:51:09,866][123091] Updated weights for policy 0, policy_version 909495 (0.0007) [2023-12-26 06:51:09,940][123091] Updated weights for policy 0, policy_version 909505 (0.0006) [2023-12-26 06:51:10,007][123091] Updated weights for policy 0, policy_version 909515 (0.0007) [2023-12-26 06:51:10,207][123090] Updated weights for policy 1, policy_version 903173 (0.0008) [2023-12-26 06:51:10,262][123090] Updated weights for policy 1, policy_version 903183 (0.0010) [2023-12-26 06:51:10,318][123090] Updated weights for policy 1, policy_version 903193 (0.0009) [2023-12-26 06:51:10,743][123091] Updated weights for policy 0, policy_version 909525 (0.0007) [2023-12-26 06:51:10,804][123091] Updated weights for policy 0, policy_version 909536 (0.0007) [2023-12-26 06:51:10,858][123091] Updated weights for policy 0, policy_version 909547 (0.0010) [2023-12-26 06:51:11,121][123090] Updated weights for policy 1, policy_version 903203 (0.0010) [2023-12-26 06:51:11,192][123090] Updated weights for policy 1, policy_version 903213 (0.0009) [2023-12-26 06:51:11,255][123090] Updated weights for policy 1, policy_version 903223 (0.0008) [2023-12-26 06:51:11,792][123091] Updated weights for policy 0, policy_version 909557 (0.0009) [2023-12-26 06:51:11,857][123091] Updated weights for policy 0, policy_version 909567 (0.0010) [2023-12-26 06:51:11,921][123091] Updated weights for policy 0, policy_version 909577 (0.0008) [2023-12-26 06:51:12,003][123090] Updated weights for policy 1, policy_version 903233 (0.0010) [2023-12-26 06:51:12,062][123090] Updated weights for policy 1, policy_version 903243 (0.0006) [2023-12-26 06:51:12,113][123090] Updated weights for policy 1, policy_version 903253 (0.0005) [2023-12-26 06:51:12,173][123090] Updated weights for policy 1, policy_version 903263 (0.0005) [2023-12-26 06:51:12,791][123091] Updated weights for policy 0, policy_version 909587 (0.0010) [2023-12-26 06:51:12,842][123091] Updated weights for policy 0, policy_version 909597 (0.0009) [2023-12-26 06:51:12,907][123091] Updated weights for policy 0, policy_version 909607 (0.0009) [2023-12-26 06:51:12,953][123090] Updated weights for policy 1, policy_version 903273 (0.0008) [2023-12-26 06:51:13,026][123090] Updated weights for policy 1, policy_version 903283 (0.0006) [2023-12-26 06:51:13,098][123090] Updated weights for policy 1, policy_version 903293 (0.0005) [2023-12-26 06:51:13,693][123091] Updated weights for policy 0, policy_version 909617 (0.0007) [2023-12-26 06:51:13,759][123091] Updated weights for policy 0, policy_version 909627 (0.0005) [2023-12-26 06:51:13,767][123090] Updated weights for policy 1, policy_version 903303 (0.0005) [2023-12-26 06:51:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 464109568. Throughput: 0: 8927.0, 1: 8663.3. Samples: 464109220. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:51:13,784][121949] Avg episode reward: [(0, '6267.843'), (1, '5300.537')] [2023-12-26 06:51:13,819][123091] Updated weights for policy 0, policy_version 909637 (0.0007) [2023-12-26 06:51:13,839][123090] Updated weights for policy 1, policy_version 903313 (0.0007) [2023-12-26 06:51:13,877][123091] Updated weights for policy 0, policy_version 909647 (0.0007) [2023-12-26 06:51:13,899][123090] Updated weights for policy 1, policy_version 903323 (0.0006) [2023-12-26 06:51:14,501][123090] Updated weights for policy 1, policy_version 903333 (0.0008) [2023-12-26 06:51:14,563][123090] Updated weights for policy 1, policy_version 903343 (0.0009) [2023-12-26 06:51:14,625][123090] Updated weights for policy 1, policy_version 903353 (0.0010) [2023-12-26 06:51:14,702][123091] Updated weights for policy 0, policy_version 909657 (0.0009) [2023-12-26 06:51:14,769][123091] Updated weights for policy 0, policy_version 909667 (0.0010) [2023-12-26 06:51:14,844][123091] Updated weights for policy 0, policy_version 909677 (0.0010) [2023-12-26 06:51:15,369][123090] Updated weights for policy 1, policy_version 903363 (0.0007) [2023-12-26 06:51:15,430][123090] Updated weights for policy 1, policy_version 903373 (0.0007) [2023-12-26 06:51:15,491][123091] Updated weights for policy 0, policy_version 909687 (0.0006) [2023-12-26 06:51:15,504][123090] Updated weights for policy 1, policy_version 903383 (0.0009) [2023-12-26 06:51:15,559][123091] Updated weights for policy 0, policy_version 909697 (0.0007) [2023-12-26 06:51:15,629][123091] Updated weights for policy 0, policy_version 909707 (0.0010) [2023-12-26 06:51:16,312][123090] Updated weights for policy 1, policy_version 903393 (0.0007) [2023-12-26 06:51:16,378][123090] Updated weights for policy 1, policy_version 903403 (0.0005) [2023-12-26 06:51:16,387][123091] Updated weights for policy 0, policy_version 909717 (0.0008) [2023-12-26 06:51:16,438][123091] Updated weights for policy 0, policy_version 909727 (0.0008) [2023-12-26 06:51:16,446][123090] Updated weights for policy 1, policy_version 903413 (0.0008) [2023-12-26 06:51:16,496][123091] Updated weights for policy 0, policy_version 909737 (0.0008) [2023-12-26 06:51:16,503][123090] Updated weights for policy 1, policy_version 903423 (0.0007) [2023-12-26 06:51:17,289][123090] Updated weights for policy 1, policy_version 903433 (0.0010) [2023-12-26 06:51:17,320][123091] Updated weights for policy 0, policy_version 909747 (0.0008) [2023-12-26 06:51:17,352][123090] Updated weights for policy 1, policy_version 903443 (0.0008) [2023-12-26 06:51:17,386][123091] Updated weights for policy 0, policy_version 909757 (0.0008) [2023-12-26 06:51:17,402][123090] Updated weights for policy 1, policy_version 903453 (0.0008) [2023-12-26 06:51:17,455][123091] Updated weights for policy 0, policy_version 909767 (0.0008) [2023-12-26 06:51:18,213][123090] Updated weights for policy 1, policy_version 903463 (0.0008) [2023-12-26 06:51:18,253][123091] Updated weights for policy 0, policy_version 909777 (0.0009) [2023-12-26 06:51:18,268][123090] Updated weights for policy 1, policy_version 903473 (0.0009) [2023-12-26 06:51:18,314][123091] Updated weights for policy 0, policy_version 909787 (0.0007) [2023-12-26 06:51:18,341][123090] Updated weights for policy 1, policy_version 903483 (0.0009) [2023-12-26 06:51:18,380][123091] Updated weights for policy 0, policy_version 909797 (0.0009) [2023-12-26 06:51:18,446][123091] Updated weights for policy 0, policy_version 909807 (0.0010) [2023-12-26 06:51:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 464207872. Throughput: 0: 8937.7, 1: 8739.2. Samples: 464218320. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:51:18,784][121949] Avg episode reward: [(0, '6208.024'), (1, '5408.236')] [2023-12-26 06:51:19,108][123090] Updated weights for policy 1, policy_version 903493 (0.0008) [2023-12-26 06:51:19,172][123091] Updated weights for policy 0, policy_version 909817 (0.0006) [2023-12-26 06:51:19,181][123090] Updated weights for policy 1, policy_version 903503 (0.0007) [2023-12-26 06:51:19,247][123091] Updated weights for policy 0, policy_version 909827 (0.0007) [2023-12-26 06:51:19,256][123090] Updated weights for policy 1, policy_version 903513 (0.0008) [2023-12-26 06:51:19,316][123091] Updated weights for policy 0, policy_version 909837 (0.0009) [2023-12-26 06:51:20,067][123090] Updated weights for policy 1, policy_version 903523 (0.0007) [2023-12-26 06:51:20,101][123091] Updated weights for policy 0, policy_version 909847 (0.0008) [2023-12-26 06:51:20,135][123090] Updated weights for policy 1, policy_version 903533 (0.0009) [2023-12-26 06:51:20,163][123091] Updated weights for policy 0, policy_version 909857 (0.0008) [2023-12-26 06:51:20,198][123090] Updated weights for policy 1, policy_version 903543 (0.0007) [2023-12-26 06:51:20,228][123091] Updated weights for policy 0, policy_version 909867 (0.0008) [2023-12-26 06:51:20,963][123090] Updated weights for policy 1, policy_version 903553 (0.0009) [2023-12-26 06:51:21,033][123090] Updated weights for policy 1, policy_version 903563 (0.0010) [2023-12-26 06:51:21,098][123090] Updated weights for policy 1, policy_version 903573 (0.0011) [2023-12-26 06:51:21,127][123091] Updated weights for policy 0, policy_version 909877 (0.0009) [2023-12-26 06:51:21,165][123090] Updated weights for policy 1, policy_version 903583 (0.0009) [2023-12-26 06:51:21,182][123091] Updated weights for policy 0, policy_version 909887 (0.0009) [2023-12-26 06:51:21,232][123091] Updated weights for policy 0, policy_version 909897 (0.0009) [2023-12-26 06:51:22,015][123090] Updated weights for policy 1, policy_version 903593 (0.0010) [2023-12-26 06:51:22,069][123090] Updated weights for policy 1, policy_version 903603 (0.0009) [2023-12-26 06:51:22,101][123091] Updated weights for policy 0, policy_version 909907 (0.0009) [2023-12-26 06:51:22,121][123090] Updated weights for policy 1, policy_version 903613 (0.0009) [2023-12-26 06:51:22,162][123091] Updated weights for policy 0, policy_version 909917 (0.0008) [2023-12-26 06:51:22,219][123091] Updated weights for policy 0, policy_version 909927 (0.0009) [2023-12-26 06:51:23,013][123090] Updated weights for policy 1, policy_version 903623 (0.0007) [2023-12-26 06:51:23,072][123090] Updated weights for policy 1, policy_version 903633 (0.0005) [2023-12-26 06:51:23,087][123091] Updated weights for policy 0, policy_version 909937 (0.0009) [2023-12-26 06:51:23,141][123090] Updated weights for policy 1, policy_version 903643 (0.0006) [2023-12-26 06:51:23,154][123091] Updated weights for policy 0, policy_version 909947 (0.0010) [2023-12-26 06:51:23,218][123091] Updated weights for policy 0, policy_version 909957 (0.0010) [2023-12-26 06:51:23,284][123091] Updated weights for policy 0, policy_version 909967 (0.0010) [2023-12-26 06:51:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 464289792. Throughput: 0: 8905.3, 1: 8744.0. Samples: 464270572. Policy #0 lag: (min: 31.0, avg: 44.9, max: 63.0) [2023-12-26 06:51:23,784][121949] Avg episode reward: [(0, '6238.364'), (1, '5464.650')] [2023-12-26 06:51:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000909968_232955904.pth... [2023-12-26 06:51:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000903648_231333888.pth... [2023-12-26 06:51:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000908944_232693760.pth [2023-12-26 06:51:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000902624_231071744.pth [2023-12-26 06:51:23,892][123090] Updated weights for policy 1, policy_version 903653 (0.0009) [2023-12-26 06:51:23,957][123090] Updated weights for policy 1, policy_version 903663 (0.0010) [2023-12-26 06:51:24,015][123090] Updated weights for policy 1, policy_version 903673 (0.0010) [2023-12-26 06:51:24,132][123091] Updated weights for policy 0, policy_version 909977 (0.0009) [2023-12-26 06:51:24,204][123091] Updated weights for policy 0, policy_version 909987 (0.0009) [2023-12-26 06:51:24,268][123091] Updated weights for policy 0, policy_version 909997 (0.0009) [2023-12-26 06:51:24,715][123090] Updated weights for policy 1, policy_version 903683 (0.0009) [2023-12-26 06:51:24,779][123090] Updated weights for policy 1, policy_version 903693 (0.0005) [2023-12-26 06:51:24,845][123090] Updated weights for policy 1, policy_version 903703 (0.0009) [2023-12-26 06:51:24,987][123091] Updated weights for policy 0, policy_version 910007 (0.0010) [2023-12-26 06:51:25,049][123091] Updated weights for policy 0, policy_version 910017 (0.0010) [2023-12-26 06:51:25,111][123091] Updated weights for policy 0, policy_version 910027 (0.0010) [2023-12-26 06:51:25,584][123090] Updated weights for policy 1, policy_version 903713 (0.0010) [2023-12-26 06:51:25,636][123090] Updated weights for policy 1, policy_version 903723 (0.0009) [2023-12-26 06:51:25,701][123090] Updated weights for policy 1, policy_version 903733 (0.0009) [2023-12-26 06:51:25,756][123090] Updated weights for policy 1, policy_version 903743 (0.0010) [2023-12-26 06:51:25,956][123091] Updated weights for policy 0, policy_version 910037 (0.0008) [2023-12-26 06:51:26,015][123091] Updated weights for policy 0, policy_version 910047 (0.0006) [2023-12-26 06:51:26,077][123091] Updated weights for policy 0, policy_version 910057 (0.0007) [2023-12-26 06:51:26,607][123090] Updated weights for policy 1, policy_version 903753 (0.0006) [2023-12-26 06:51:26,667][123090] Updated weights for policy 1, policy_version 903763 (0.0006) [2023-12-26 06:51:26,731][123090] Updated weights for policy 1, policy_version 903773 (0.0006) [2023-12-26 06:51:26,736][123091] Updated weights for policy 0, policy_version 910067 (0.0007) [2023-12-26 06:51:26,796][123091] Updated weights for policy 0, policy_version 910077 (0.0011) [2023-12-26 06:51:26,853][123091] Updated weights for policy 0, policy_version 910087 (0.0010) [2023-12-26 06:51:27,495][123090] Updated weights for policy 1, policy_version 903783 (0.0009) [2023-12-26 06:51:27,547][123090] Updated weights for policy 1, policy_version 903793 (0.0009) [2023-12-26 06:51:27,595][123090] Updated weights for policy 1, policy_version 903804 (0.0009) [2023-12-26 06:51:27,652][123091] Updated weights for policy 0, policy_version 910097 (0.0010) [2023-12-26 06:51:27,721][123091] Updated weights for policy 0, policy_version 910107 (0.0007) [2023-12-26 06:51:27,778][123091] Updated weights for policy 0, policy_version 910117 (0.0006) [2023-12-26 06:51:27,833][123091] Updated weights for policy 0, policy_version 910127 (0.0007) [2023-12-26 06:51:28,401][123090] Updated weights for policy 1, policy_version 903815 (0.0007) [2023-12-26 06:51:28,448][123090] Updated weights for policy 1, policy_version 903825 (0.0006) [2023-12-26 06:51:28,513][123090] Updated weights for policy 1, policy_version 903835 (0.0005) [2023-12-26 06:51:28,704][123091] Updated weights for policy 0, policy_version 910138 (0.0010) [2023-12-26 06:51:28,758][123091] Updated weights for policy 0, policy_version 910150 (0.0010) [2023-12-26 06:51:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 464379904. Throughput: 0: 8900.0, 1: 8822.8. Samples: 464376508. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:28,786][121949] Avg episode reward: [(0, '6316.268'), (1, '5695.518')] [2023-12-26 06:51:29,186][123090] Updated weights for policy 1, policy_version 903845 (0.0005) [2023-12-26 06:51:29,256][123090] Updated weights for policy 1, policy_version 903855 (0.0007) [2023-12-26 06:51:29,329][123090] Updated weights for policy 1, policy_version 903865 (0.0006) [2023-12-26 06:51:29,701][123091] Updated weights for policy 0, policy_version 910162 (0.0010) [2023-12-26 06:51:29,768][123091] Updated weights for policy 0, policy_version 910172 (0.0007) [2023-12-26 06:51:29,824][123091] Updated weights for policy 0, policy_version 910182 (0.0009) [2023-12-26 06:51:29,885][123091] Updated weights for policy 0, policy_version 910192 (0.0008) [2023-12-26 06:51:30,063][123090] Updated weights for policy 1, policy_version 903875 (0.0009) [2023-12-26 06:51:30,120][123090] Updated weights for policy 1, policy_version 903885 (0.0005) [2023-12-26 06:51:30,173][123090] Updated weights for policy 1, policy_version 903895 (0.0005) [2023-12-26 06:51:30,695][123091] Updated weights for policy 0, policy_version 910202 (0.0011) [2023-12-26 06:51:30,756][123091] Updated weights for policy 0, policy_version 910212 (0.0010) [2023-12-26 06:51:30,821][123091] Updated weights for policy 0, policy_version 910222 (0.0010) [2023-12-26 06:51:30,894][123090] Updated weights for policy 1, policy_version 903905 (0.0006) [2023-12-26 06:51:30,949][123090] Updated weights for policy 1, policy_version 903915 (0.0005) [2023-12-26 06:51:31,003][123090] Updated weights for policy 1, policy_version 903925 (0.0005) [2023-12-26 06:51:31,066][123090] Updated weights for policy 1, policy_version 903935 (0.0007) [2023-12-26 06:51:31,601][123091] Updated weights for policy 0, policy_version 910232 (0.0011) [2023-12-26 06:51:31,665][123091] Updated weights for policy 0, policy_version 910242 (0.0010) [2023-12-26 06:51:31,734][123091] Updated weights for policy 0, policy_version 910252 (0.0008) [2023-12-26 06:51:31,804][123090] Updated weights for policy 1, policy_version 903945 (0.0008) [2023-12-26 06:51:31,873][123090] Updated weights for policy 1, policy_version 903955 (0.0009) [2023-12-26 06:51:31,942][123090] Updated weights for policy 1, policy_version 903965 (0.0009) [2023-12-26 06:51:32,561][123091] Updated weights for policy 0, policy_version 910262 (0.0010) [2023-12-26 06:51:32,623][123091] Updated weights for policy 0, policy_version 910272 (0.0010) [2023-12-26 06:51:32,690][123091] Updated weights for policy 0, policy_version 910282 (0.0009) [2023-12-26 06:51:32,766][123090] Updated weights for policy 1, policy_version 903975 (0.0008) [2023-12-26 06:51:32,830][123090] Updated weights for policy 1, policy_version 903985 (0.0009) [2023-12-26 06:51:32,884][123090] Updated weights for policy 1, policy_version 903995 (0.0010) [2023-12-26 06:51:33,332][123091] Updated weights for policy 0, policy_version 910292 (0.0007) [2023-12-26 06:51:33,401][123091] Updated weights for policy 0, policy_version 910302 (0.0009) [2023-12-26 06:51:33,466][123091] Updated weights for policy 0, policy_version 910312 (0.0009) [2023-12-26 06:51:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 464470016. Throughput: 0: 8836.0, 1: 8842.0. Samples: 464483352. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:33,785][121949] Avg episode reward: [(0, '6223.908'), (1, '5590.053')] [2023-12-26 06:51:33,808][123090] Updated weights for policy 1, policy_version 904006 (0.0009) [2023-12-26 06:51:33,869][123090] Updated weights for policy 1, policy_version 904016 (0.0010) [2023-12-26 06:51:33,923][123090] Updated weights for policy 1, policy_version 904028 (0.0010) [2023-12-26 06:51:34,151][123091] Updated weights for policy 0, policy_version 910322 (0.0008) [2023-12-26 06:51:34,222][123091] Updated weights for policy 0, policy_version 910332 (0.0007) [2023-12-26 06:51:34,285][123091] Updated weights for policy 0, policy_version 910342 (0.0011) [2023-12-26 06:51:34,351][123091] Updated weights for policy 0, policy_version 910352 (0.0011) [2023-12-26 06:51:34,748][123090] Updated weights for policy 1, policy_version 904038 (0.0007) [2023-12-26 06:51:34,815][123090] Updated weights for policy 1, policy_version 904048 (0.0007) [2023-12-26 06:51:34,888][123090] Updated weights for policy 1, policy_version 904058 (0.0005) [2023-12-26 06:51:35,039][123091] Updated weights for policy 0, policy_version 910362 (0.0005) [2023-12-26 06:51:35,096][123091] Updated weights for policy 0, policy_version 910372 (0.0006) [2023-12-26 06:51:35,144][123091] Updated weights for policy 0, policy_version 910382 (0.0005) [2023-12-26 06:51:35,568][123090] Updated weights for policy 1, policy_version 904068 (0.0007) [2023-12-26 06:51:35,632][123090] Updated weights for policy 1, policy_version 904078 (0.0010) [2023-12-26 06:51:35,696][123090] Updated weights for policy 1, policy_version 904088 (0.0009) [2023-12-26 06:51:35,760][123091] Updated weights for policy 0, policy_version 910392 (0.0006) [2023-12-26 06:51:35,818][123091] Updated weights for policy 0, policy_version 910402 (0.0006) [2023-12-26 06:51:35,891][123091] Updated weights for policy 0, policy_version 910412 (0.0006) [2023-12-26 06:51:36,603][123090] Updated weights for policy 1, policy_version 904098 (0.0008) [2023-12-26 06:51:36,609][123091] Updated weights for policy 0, policy_version 910422 (0.0006) [2023-12-26 06:51:36,665][123090] Updated weights for policy 1, policy_version 904108 (0.0005) [2023-12-26 06:51:36,681][123091] Updated weights for policy 0, policy_version 910432 (0.0006) [2023-12-26 06:51:36,730][123090] Updated weights for policy 1, policy_version 904118 (0.0007) [2023-12-26 06:51:36,748][123091] Updated weights for policy 0, policy_version 910442 (0.0011) [2023-12-26 06:51:36,790][123090] Updated weights for policy 1, policy_version 904128 (0.0008) [2023-12-26 06:51:37,375][123091] Updated weights for policy 0, policy_version 910452 (0.0009) [2023-12-26 06:51:37,437][123091] Updated weights for policy 0, policy_version 910462 (0.0006) [2023-12-26 06:51:37,494][123091] Updated weights for policy 0, policy_version 910472 (0.0007) [2023-12-26 06:51:37,572][123090] Updated weights for policy 1, policy_version 904138 (0.0005) [2023-12-26 06:51:37,631][123090] Updated weights for policy 1, policy_version 904148 (0.0005) [2023-12-26 06:51:37,707][123090] Updated weights for policy 1, policy_version 904158 (0.0005) [2023-12-26 06:51:38,150][123091] Updated weights for policy 0, policy_version 910482 (0.0005) [2023-12-26 06:51:38,221][123091] Updated weights for policy 0, policy_version 910492 (0.0006) [2023-12-26 06:51:38,283][123091] Updated weights for policy 0, policy_version 910502 (0.0010) [2023-12-26 06:51:38,344][123091] Updated weights for policy 0, policy_version 910512 (0.0010) [2023-12-26 06:51:38,433][123090] Updated weights for policy 1, policy_version 904168 (0.0009) [2023-12-26 06:51:38,501][123090] Updated weights for policy 1, policy_version 904178 (0.0010) [2023-12-26 06:51:38,566][123090] Updated weights for policy 1, policy_version 904188 (0.0009) [2023-12-26 06:51:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 464568320. Throughput: 0: 8988.6, 1: 8865.0. Samples: 464540972. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:38,785][121949] Avg episode reward: [(0, '6276.318'), (1, '5575.076')] [2023-12-26 06:51:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000910512_233095168.pth... [2023-12-26 06:51:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000904192_231473152.pth... [2023-12-26 06:51:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000903136_231202816.pth [2023-12-26 06:51:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000909456_232824832.pth [2023-12-26 06:51:39,071][123091] Updated weights for policy 0, policy_version 910522 (0.0010) [2023-12-26 06:51:39,122][123091] Updated weights for policy 0, policy_version 910532 (0.0007) [2023-12-26 06:51:39,176][123091] Updated weights for policy 0, policy_version 910542 (0.0005) [2023-12-26 06:51:39,402][123090] Updated weights for policy 1, policy_version 904198 (0.0008) [2023-12-26 06:51:39,473][123090] Updated weights for policy 1, policy_version 904208 (0.0010) [2023-12-26 06:51:39,548][123090] Updated weights for policy 1, policy_version 904218 (0.0010) [2023-12-26 06:51:40,012][123091] Updated weights for policy 0, policy_version 910552 (0.0009) [2023-12-26 06:51:40,075][123091] Updated weights for policy 0, policy_version 910562 (0.0009) [2023-12-26 06:51:40,135][123091] Updated weights for policy 0, policy_version 910572 (0.0009) [2023-12-26 06:51:40,357][123090] Updated weights for policy 1, policy_version 904228 (0.0010) [2023-12-26 06:51:40,426][123090] Updated weights for policy 1, policy_version 904238 (0.0009) [2023-12-26 06:51:40,495][123090] Updated weights for policy 1, policy_version 904248 (0.0010) [2023-12-26 06:51:40,946][123091] Updated weights for policy 0, policy_version 910582 (0.0010) [2023-12-26 06:51:41,005][123091] Updated weights for policy 0, policy_version 910592 (0.0009) [2023-12-26 06:51:41,072][123091] Updated weights for policy 0, policy_version 910602 (0.0008) [2023-12-26 06:51:41,220][123090] Updated weights for policy 1, policy_version 904258 (0.0009) [2023-12-26 06:51:41,289][123090] Updated weights for policy 1, policy_version 904268 (0.0006) [2023-12-26 06:51:41,365][123090] Updated weights for policy 1, policy_version 904278 (0.0008) [2023-12-26 06:51:41,436][123090] Updated weights for policy 1, policy_version 904288 (0.0009) [2023-12-26 06:51:42,045][123091] Updated weights for policy 0, policy_version 910612 (0.0009) [2023-12-26 06:51:42,101][123090] Updated weights for policy 1, policy_version 904298 (0.0008) [2023-12-26 06:51:42,112][123091] Updated weights for policy 0, policy_version 910622 (0.0009) [2023-12-26 06:51:42,167][123090] Updated weights for policy 1, policy_version 904308 (0.0007) [2023-12-26 06:51:42,179][123091] Updated weights for policy 0, policy_version 910632 (0.0008) [2023-12-26 06:51:42,232][123090] Updated weights for policy 1, policy_version 904318 (0.0006) [2023-12-26 06:51:42,896][123091] Updated weights for policy 0, policy_version 910642 (0.0009) [2023-12-26 06:51:42,956][123091] Updated weights for policy 0, policy_version 910652 (0.0011) [2023-12-26 06:51:43,003][123090] Updated weights for policy 1, policy_version 904328 (0.0010) [2023-12-26 06:51:43,020][123091] Updated weights for policy 0, policy_version 910662 (0.0011) [2023-12-26 06:51:43,060][123090] Updated weights for policy 1, policy_version 904338 (0.0006) [2023-12-26 06:51:43,072][123091] Updated weights for policy 0, policy_version 910672 (0.0011) [2023-12-26 06:51:43,130][123090] Updated weights for policy 1, policy_version 904348 (0.0006) [2023-12-26 06:51:43,734][123090] Updated weights for policy 1, policy_version 904358 (0.0006) [2023-12-26 06:51:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 464650240. Throughput: 0: 8989.6, 1: 8921.1. Samples: 464648332. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:43,785][121949] Avg episode reward: [(0, '6291.601'), (1, '5424.272')] [2023-12-26 06:51:43,802][123090] Updated weights for policy 1, policy_version 904368 (0.0007) [2023-12-26 06:51:43,872][123090] Updated weights for policy 1, policy_version 904378 (0.0008) [2023-12-26 06:51:43,929][123091] Updated weights for policy 0, policy_version 910682 (0.0010) [2023-12-26 06:51:43,972][123091] Updated weights for policy 0, policy_version 910692 (0.0009) [2023-12-26 06:51:44,020][123091] Updated weights for policy 0, policy_version 910702 (0.0005) [2023-12-26 06:51:44,664][123090] Updated weights for policy 1, policy_version 904388 (0.0009) [2023-12-26 06:51:44,706][123091] Updated weights for policy 0, policy_version 910712 (0.0009) [2023-12-26 06:51:44,725][123090] Updated weights for policy 1, policy_version 904398 (0.0008) [2023-12-26 06:51:44,758][123091] Updated weights for policy 0, policy_version 910722 (0.0011) [2023-12-26 06:51:44,787][123090] Updated weights for policy 1, policy_version 904408 (0.0008) [2023-12-26 06:51:44,822][123091] Updated weights for policy 0, policy_version 910732 (0.0009) [2023-12-26 06:51:45,639][123091] Updated weights for policy 0, policy_version 910742 (0.0008) [2023-12-26 06:51:45,654][123090] Updated weights for policy 1, policy_version 904418 (0.0009) [2023-12-26 06:51:45,702][123091] Updated weights for policy 0, policy_version 910752 (0.0008) [2023-12-26 06:51:45,705][123090] Updated weights for policy 1, policy_version 904428 (0.0008) [2023-12-26 06:51:45,762][123090] Updated weights for policy 1, policy_version 904438 (0.0008) [2023-12-26 06:51:45,771][123091] Updated weights for policy 0, policy_version 910762 (0.0009) [2023-12-26 06:51:45,830][123090] Updated weights for policy 1, policy_version 904448 (0.0010) [2023-12-26 06:51:46,604][123091] Updated weights for policy 0, policy_version 910772 (0.0006) [2023-12-26 06:51:46,624][123090] Updated weights for policy 1, policy_version 904458 (0.0009) [2023-12-26 06:51:46,664][123091] Updated weights for policy 0, policy_version 910782 (0.0010) [2023-12-26 06:51:46,689][123090] Updated weights for policy 1, policy_version 904468 (0.0010) [2023-12-26 06:51:46,726][123091] Updated weights for policy 0, policy_version 910792 (0.0008) [2023-12-26 06:51:46,747][123090] Updated weights for policy 1, policy_version 904478 (0.0008) [2023-12-26 06:51:47,518][123091] Updated weights for policy 0, policy_version 910802 (0.0008) [2023-12-26 06:51:47,569][123091] Updated weights for policy 0, policy_version 910812 (0.0008) [2023-12-26 06:51:47,593][123090] Updated weights for policy 1, policy_version 904488 (0.0009) [2023-12-26 06:51:47,625][123091] Updated weights for policy 0, policy_version 910822 (0.0007) [2023-12-26 06:51:47,640][123090] Updated weights for policy 1, policy_version 904498 (0.0008) [2023-12-26 06:51:47,689][123091] Updated weights for policy 0, policy_version 910832 (0.0007) [2023-12-26 06:51:47,695][123090] Updated weights for policy 1, policy_version 904508 (0.0009) [2023-12-26 06:51:48,524][123090] Updated weights for policy 1, policy_version 904518 (0.0009) [2023-12-26 06:51:48,534][123091] Updated weights for policy 0, policy_version 910842 (0.0009) [2023-12-26 06:51:48,583][123090] Updated weights for policy 1, policy_version 904528 (0.0007) [2023-12-26 06:51:48,598][123091] Updated weights for policy 0, policy_version 910853 (0.0010) [2023-12-26 06:51:48,639][123090] Updated weights for policy 1, policy_version 904538 (0.0008) [2023-12-26 06:51:48,656][123091] Updated weights for policy 0, policy_version 910863 (0.0011) [2023-12-26 06:51:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 464748544. Throughput: 0: 8916.8, 1: 8958.8. Samples: 464754376. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:48,785][121949] Avg episode reward: [(0, '6331.964'), (1, '5363.034')] [2023-12-26 06:51:49,389][123090] Updated weights for policy 1, policy_version 904548 (0.0008) [2023-12-26 06:51:49,447][123090] Updated weights for policy 1, policy_version 904558 (0.0009) [2023-12-26 06:51:49,503][123090] Updated weights for policy 1, policy_version 904568 (0.0010) [2023-12-26 06:51:49,519][123091] Updated weights for policy 0, policy_version 910873 (0.0009) [2023-12-26 06:51:49,571][123091] Updated weights for policy 0, policy_version 910883 (0.0006) [2023-12-26 06:51:49,636][123091] Updated weights for policy 0, policy_version 910893 (0.0006) [2023-12-26 06:51:50,374][123090] Updated weights for policy 1, policy_version 904578 (0.0009) [2023-12-26 06:51:50,430][123090] Updated weights for policy 1, policy_version 904588 (0.0009) [2023-12-26 06:51:50,433][123091] Updated weights for policy 0, policy_version 910903 (0.0007) [2023-12-26 06:51:50,489][123091] Updated weights for policy 0, policy_version 910913 (0.0008) [2023-12-26 06:51:50,491][123090] Updated weights for policy 1, policy_version 904598 (0.0007) [2023-12-26 06:51:50,535][123091] Updated weights for policy 0, policy_version 910923 (0.0008) [2023-12-26 06:51:50,546][123090] Updated weights for policy 1, policy_version 904608 (0.0008) [2023-12-26 06:51:51,404][123090] Updated weights for policy 1, policy_version 904618 (0.0010) [2023-12-26 06:51:51,419][123091] Updated weights for policy 0, policy_version 910933 (0.0007) [2023-12-26 06:51:51,457][123090] Updated weights for policy 1, policy_version 904628 (0.0009) [2023-12-26 06:51:51,481][123091] Updated weights for policy 0, policy_version 910943 (0.0006) [2023-12-26 06:51:51,511][123090] Updated weights for policy 1, policy_version 904638 (0.0009) [2023-12-26 06:51:51,537][123091] Updated weights for policy 0, policy_version 910953 (0.0008) [2023-12-26 06:51:52,341][123091] Updated weights for policy 0, policy_version 910963 (0.0010) [2023-12-26 06:51:52,395][123091] Updated weights for policy 0, policy_version 910973 (0.0008) [2023-12-26 06:51:52,398][123090] Updated weights for policy 1, policy_version 904648 (0.0009) [2023-12-26 06:51:52,450][123091] Updated weights for policy 0, policy_version 910983 (0.0009) [2023-12-26 06:51:52,464][123090] Updated weights for policy 1, policy_version 904658 (0.0008) [2023-12-26 06:51:52,526][123090] Updated weights for policy 1, policy_version 904668 (0.0010) [2023-12-26 06:51:53,278][123090] Updated weights for policy 1, policy_version 904678 (0.0009) [2023-12-26 06:51:53,328][123091] Updated weights for policy 0, policy_version 910993 (0.0007) [2023-12-26 06:51:53,335][123090] Updated weights for policy 1, policy_version 904688 (0.0009) [2023-12-26 06:51:53,379][123090] Updated weights for policy 1, policy_version 904698 (0.0007) [2023-12-26 06:51:53,380][123091] Updated weights for policy 0, policy_version 911003 (0.0010) [2023-12-26 06:51:53,427][123091] Updated weights for policy 0, policy_version 911013 (0.0007) [2023-12-26 06:51:53,478][123091] Updated weights for policy 0, policy_version 911023 (0.0009) [2023-12-26 06:51:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17717.1). Total num frames: 464830464. Throughput: 0: 8893.4, 1: 8925.7. Samples: 464805400. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:53,784][121949] Avg episode reward: [(0, '6252.531'), (1, '5570.371')] [2023-12-26 06:51:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000911024_233226240.pth... [2023-12-26 06:51:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000904704_231604224.pth... [2023-12-26 06:51:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000909968_232955904.pth [2023-12-26 06:51:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000903648_231333888.pth [2023-12-26 06:51:54,262][123090] Updated weights for policy 1, policy_version 904708 (0.0009) [2023-12-26 06:51:54,309][123091] Updated weights for policy 0, policy_version 911033 (0.0006) [2023-12-26 06:51:54,319][123090] Updated weights for policy 1, policy_version 904718 (0.0008) [2023-12-26 06:51:54,360][123091] Updated weights for policy 0, policy_version 911043 (0.0005) [2023-12-26 06:51:54,365][123090] Updated weights for policy 1, policy_version 904728 (0.0010) [2023-12-26 06:51:54,412][123091] Updated weights for policy 0, policy_version 911053 (0.0006) [2023-12-26 06:51:55,117][123090] Updated weights for policy 1, policy_version 904738 (0.0010) [2023-12-26 06:51:55,184][123090] Updated weights for policy 1, policy_version 904748 (0.0009) [2023-12-26 06:51:55,230][123091] Updated weights for policy 0, policy_version 911063 (0.0009) [2023-12-26 06:51:55,246][123090] Updated weights for policy 1, policy_version 904758 (0.0010) [2023-12-26 06:51:55,276][123091] Updated weights for policy 0, policy_version 911073 (0.0006) [2023-12-26 06:51:55,302][123090] Updated weights for policy 1, policy_version 904768 (0.0009) [2023-12-26 06:51:55,323][123091] Updated weights for policy 0, policy_version 911083 (0.0005) [2023-12-26 06:51:55,956][123090] Updated weights for policy 1, policy_version 904778 (0.0005) [2023-12-26 06:51:56,010][123091] Updated weights for policy 0, policy_version 911093 (0.0005) [2023-12-26 06:51:56,029][123090] Updated weights for policy 1, policy_version 904788 (0.0007) [2023-12-26 06:51:56,070][123091] Updated weights for policy 0, policy_version 911103 (0.0006) [2023-12-26 06:51:56,088][123090] Updated weights for policy 1, policy_version 904798 (0.0010) [2023-12-26 06:51:56,119][123091] Updated weights for policy 0, policy_version 911113 (0.0005) [2023-12-26 06:51:56,827][123090] Updated weights for policy 1, policy_version 904808 (0.0010) [2023-12-26 06:51:56,832][123091] Updated weights for policy 0, policy_version 911123 (0.0007) [2023-12-26 06:51:56,878][123090] Updated weights for policy 1, policy_version 904818 (0.0010) [2023-12-26 06:51:56,890][123091] Updated weights for policy 0, policy_version 911133 (0.0010) [2023-12-26 06:51:56,929][123090] Updated weights for policy 1, policy_version 904828 (0.0010) [2023-12-26 06:51:56,952][123091] Updated weights for policy 0, policy_version 911143 (0.0010) [2023-12-26 06:51:57,701][123090] Updated weights for policy 1, policy_version 904838 (0.0007) [2023-12-26 06:51:57,765][123090] Updated weights for policy 1, policy_version 904848 (0.0005) [2023-12-26 06:51:57,771][123091] Updated weights for policy 0, policy_version 911153 (0.0010) [2023-12-26 06:51:57,816][123090] Updated weights for policy 1, policy_version 904858 (0.0005) [2023-12-26 06:51:57,837][123091] Updated weights for policy 0, policy_version 911163 (0.0010) [2023-12-26 06:51:57,891][123091] Updated weights for policy 0, policy_version 911173 (0.0010) [2023-12-26 06:51:57,949][123091] Updated weights for policy 0, policy_version 911183 (0.0010) [2023-12-26 06:51:58,619][123090] Updated weights for policy 1, policy_version 904868 (0.0005) [2023-12-26 06:51:58,694][123090] Updated weights for policy 1, policy_version 904878 (0.0006) [2023-12-26 06:51:58,743][123091] Updated weights for policy 0, policy_version 911193 (0.0007) [2023-12-26 06:51:58,765][123090] Updated weights for policy 1, policy_version 904888 (0.0008) [2023-12-26 06:51:58,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 464912384. Throughput: 0: 8920.8, 1: 8975.2. Samples: 464914540. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:51:58,785][121949] Avg episode reward: [(0, '6275.159'), (1, '5794.649')] [2023-12-26 06:51:58,815][123091] Updated weights for policy 0, policy_version 911203 (0.0008) [2023-12-26 06:51:58,875][123091] Updated weights for policy 0, policy_version 911213 (0.0010) [2023-12-26 06:51:59,524][123090] Updated weights for policy 1, policy_version 904898 (0.0008) [2023-12-26 06:51:59,587][123090] Updated weights for policy 1, policy_version 904908 (0.0011) [2023-12-26 06:51:59,643][123090] Updated weights for policy 1, policy_version 904918 (0.0010) [2023-12-26 06:51:59,692][123091] Updated weights for policy 0, policy_version 911223 (0.0007) [2023-12-26 06:51:59,704][123090] Updated weights for policy 1, policy_version 904928 (0.0010) [2023-12-26 06:51:59,738][123091] Updated weights for policy 0, policy_version 911233 (0.0005) [2023-12-26 06:51:59,791][123091] Updated weights for policy 0, policy_version 911243 (0.0005) [2023-12-26 06:52:00,549][123090] Updated weights for policy 1, policy_version 904938 (0.0010) [2023-12-26 06:52:00,594][123091] Updated weights for policy 0, policy_version 911253 (0.0009) [2023-12-26 06:52:00,612][123090] Updated weights for policy 1, policy_version 904948 (0.0010) [2023-12-26 06:52:00,641][123091] Updated weights for policy 0, policy_version 911263 (0.0010) [2023-12-26 06:52:00,663][123090] Updated weights for policy 1, policy_version 904958 (0.0010) [2023-12-26 06:52:00,691][123091] Updated weights for policy 0, policy_version 911273 (0.0010) [2023-12-26 06:52:01,526][123091] Updated weights for policy 0, policy_version 911283 (0.0009) [2023-12-26 06:52:01,547][123090] Updated weights for policy 1, policy_version 904968 (0.0010) [2023-12-26 06:52:01,582][123091] Updated weights for policy 0, policy_version 911293 (0.0006) [2023-12-26 06:52:01,612][123090] Updated weights for policy 1, policy_version 904978 (0.0011) [2023-12-26 06:52:01,652][123091] Updated weights for policy 0, policy_version 911303 (0.0007) [2023-12-26 06:52:01,671][123090] Updated weights for policy 1, policy_version 904988 (0.0009) [2023-12-26 06:52:02,306][123091] Updated weights for policy 0, policy_version 911313 (0.0006) [2023-12-26 06:52:02,369][123091] Updated weights for policy 0, policy_version 911324 (0.0008) [2023-12-26 06:52:02,426][123091] Updated weights for policy 0, policy_version 911334 (0.0007) [2023-12-26 06:52:02,469][123090] Updated weights for policy 1, policy_version 904998 (0.0006) [2023-12-26 06:52:02,484][123091] Updated weights for policy 0, policy_version 911344 (0.0006) [2023-12-26 06:52:02,527][123090] Updated weights for policy 1, policy_version 905008 (0.0005) [2023-12-26 06:52:02,593][123090] Updated weights for policy 1, policy_version 905018 (0.0005) [2023-12-26 06:52:03,279][123091] Updated weights for policy 0, policy_version 911354 (0.0009) [2023-12-26 06:52:03,327][123091] Updated weights for policy 0, policy_version 911365 (0.0009) [2023-12-26 06:52:03,372][123090] Updated weights for policy 1, policy_version 905028 (0.0007) [2023-12-26 06:52:03,384][123091] Updated weights for policy 0, policy_version 911375 (0.0009) [2023-12-26 06:52:03,421][123090] Updated weights for policy 1, policy_version 905038 (0.0009) [2023-12-26 06:52:03,474][123090] Updated weights for policy 1, policy_version 905049 (0.0010) [2023-12-26 06:52:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 465010688. Throughput: 0: 8941.9, 1: 8895.5. Samples: 465021004. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:03,785][121949] Avg episode reward: [(0, '6246.009'), (1, '5838.189')] [2023-12-26 06:52:04,041][123091] Updated weights for policy 0, policy_version 911385 (0.0005) [2023-12-26 06:52:04,095][123091] Updated weights for policy 0, policy_version 911395 (0.0006) [2023-12-26 06:52:04,159][123091] Updated weights for policy 0, policy_version 911405 (0.0006) [2023-12-26 06:52:04,418][123090] Updated weights for policy 1, policy_version 905060 (0.0010) [2023-12-26 06:52:04,478][123090] Updated weights for policy 1, policy_version 905070 (0.0009) [2023-12-26 06:52:04,534][123090] Updated weights for policy 1, policy_version 905080 (0.0009) [2023-12-26 06:52:04,892][123091] Updated weights for policy 0, policy_version 911415 (0.0009) [2023-12-26 06:52:04,942][123091] Updated weights for policy 0, policy_version 911425 (0.0009) [2023-12-26 06:52:05,000][123091] Updated weights for policy 0, policy_version 911435 (0.0010) [2023-12-26 06:52:05,306][123090] Updated weights for policy 1, policy_version 905090 (0.0010) [2023-12-26 06:52:05,353][123090] Updated weights for policy 1, policy_version 905100 (0.0010) [2023-12-26 06:52:05,411][123090] Updated weights for policy 1, policy_version 905110 (0.0010) [2023-12-26 06:52:05,466][123090] Updated weights for policy 1, policy_version 905120 (0.0010) [2023-12-26 06:52:05,872][123091] Updated weights for policy 0, policy_version 911445 (0.0010) [2023-12-26 06:52:05,933][123091] Updated weights for policy 0, policy_version 911455 (0.0010) [2023-12-26 06:52:05,988][123091] Updated weights for policy 0, policy_version 911465 (0.0010) [2023-12-26 06:52:06,309][123090] Updated weights for policy 1, policy_version 905130 (0.0011) [2023-12-26 06:52:06,369][123090] Updated weights for policy 1, policy_version 905140 (0.0011) [2023-12-26 06:52:06,440][123090] Updated weights for policy 1, policy_version 905150 (0.0011) [2023-12-26 06:52:06,688][123091] Updated weights for policy 0, policy_version 911475 (0.0009) [2023-12-26 06:52:06,763][123091] Updated weights for policy 0, policy_version 911485 (0.0006) [2023-12-26 06:52:06,832][123091] Updated weights for policy 0, policy_version 911495 (0.0006) [2023-12-26 06:52:07,282][123090] Updated weights for policy 1, policy_version 905160 (0.0007) [2023-12-26 06:52:07,343][123090] Updated weights for policy 1, policy_version 905170 (0.0005) [2023-12-26 06:52:07,402][123090] Updated weights for policy 1, policy_version 905180 (0.0005) [2023-12-26 06:52:07,570][123091] Updated weights for policy 0, policy_version 911505 (0.0007) [2023-12-26 06:52:07,628][123091] Updated weights for policy 0, policy_version 911515 (0.0010) [2023-12-26 06:52:07,675][123091] Updated weights for policy 0, policy_version 911525 (0.0009) [2023-12-26 06:52:07,749][123091] Updated weights for policy 0, policy_version 911535 (0.0005) [2023-12-26 06:52:08,124][123090] Updated weights for policy 1, policy_version 905190 (0.0005) [2023-12-26 06:52:08,179][123090] Updated weights for policy 1, policy_version 905200 (0.0005) [2023-12-26 06:52:08,247][123090] Updated weights for policy 1, policy_version 905210 (0.0005) [2023-12-26 06:52:08,439][123091] Updated weights for policy 0, policy_version 911545 (0.0008) [2023-12-26 06:52:08,509][123091] Updated weights for policy 0, policy_version 911555 (0.0007) [2023-12-26 06:52:08,571][123091] Updated weights for policy 0, policy_version 911565 (0.0007) [2023-12-26 06:52:08,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 465100800. Throughput: 0: 8985.3, 1: 8866.1. Samples: 465073888. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:08,785][121949] Avg episode reward: [(0, '6272.198'), (1, '5751.931')] [2023-12-26 06:52:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000911568_233365504.pth... [2023-12-26 06:52:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000905216_231735296.pth... [2023-12-26 06:52:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000910512_233095168.pth [2023-12-26 06:52:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000904192_231473152.pth [2023-12-26 06:52:08,985][123090] Updated weights for policy 1, policy_version 905220 (0.0007) [2023-12-26 06:52:09,032][123090] Updated weights for policy 1, policy_version 905230 (0.0007) [2023-12-26 06:52:09,078][123090] Updated weights for policy 1, policy_version 905240 (0.0008) [2023-12-26 06:52:09,252][123091] Updated weights for policy 0, policy_version 911575 (0.0007) [2023-12-26 06:52:09,318][123091] Updated weights for policy 0, policy_version 911585 (0.0009) [2023-12-26 06:52:09,384][123091] Updated weights for policy 0, policy_version 911595 (0.0009) [2023-12-26 06:52:09,980][123090] Updated weights for policy 1, policy_version 905250 (0.0010) [2023-12-26 06:52:10,055][123090] Updated weights for policy 1, policy_version 905260 (0.0008) [2023-12-26 06:52:10,127][123090] Updated weights for policy 1, policy_version 905270 (0.0008) [2023-12-26 06:52:10,195][123090] Updated weights for policy 1, policy_version 905280 (0.0008) [2023-12-26 06:52:10,206][123091] Updated weights for policy 0, policy_version 911605 (0.0010) [2023-12-26 06:52:10,270][123091] Updated weights for policy 0, policy_version 911615 (0.0011) [2023-12-26 06:52:10,335][123091] Updated weights for policy 0, policy_version 911625 (0.0011) [2023-12-26 06:52:10,995][123090] Updated weights for policy 1, policy_version 905290 (0.0005) [2023-12-26 06:52:11,061][123090] Updated weights for policy 1, policy_version 905300 (0.0008) [2023-12-26 06:52:11,110][123090] Updated weights for policy 1, policy_version 905310 (0.0008) [2023-12-26 06:52:11,178][123091] Updated weights for policy 0, policy_version 911635 (0.0011) [2023-12-26 06:52:11,245][123091] Updated weights for policy 0, policy_version 911645 (0.0011) [2023-12-26 06:52:11,314][123091] Updated weights for policy 0, policy_version 911655 (0.0011) [2023-12-26 06:52:11,939][123090] Updated weights for policy 1, policy_version 905320 (0.0009) [2023-12-26 06:52:11,999][123090] Updated weights for policy 1, policy_version 905330 (0.0007) [2023-12-26 06:52:12,065][123090] Updated weights for policy 1, policy_version 905340 (0.0006) [2023-12-26 06:52:12,105][123091] Updated weights for policy 0, policy_version 911665 (0.0010) [2023-12-26 06:52:12,158][123091] Updated weights for policy 0, policy_version 911675 (0.0009) [2023-12-26 06:52:12,222][123091] Updated weights for policy 0, policy_version 911685 (0.0009) [2023-12-26 06:52:12,289][123091] Updated weights for policy 0, policy_version 911695 (0.0008) [2023-12-26 06:52:12,881][123090] Updated weights for policy 1, policy_version 905350 (0.0005) [2023-12-26 06:52:12,938][123090] Updated weights for policy 1, policy_version 905360 (0.0006) [2023-12-26 06:52:12,996][123090] Updated weights for policy 1, policy_version 905370 (0.0009) [2023-12-26 06:52:13,121][123091] Updated weights for policy 0, policy_version 911705 (0.0007) [2023-12-26 06:52:13,194][123091] Updated weights for policy 0, policy_version 911715 (0.0010) [2023-12-26 06:52:13,254][123091] Updated weights for policy 0, policy_version 911725 (0.0011) [2023-12-26 06:52:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 465182720. Throughput: 0: 9012.5, 1: 8855.8. Samples: 465180576. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:13,785][121949] Avg episode reward: [(0, '6313.388'), (1, '5766.289')] [2023-12-26 06:52:13,790][123090] Updated weights for policy 1, policy_version 905380 (0.0010) [2023-12-26 06:52:13,842][123090] Updated weights for policy 1, policy_version 905390 (0.0008) [2023-12-26 06:52:13,890][123090] Updated weights for policy 1, policy_version 905400 (0.0009) [2023-12-26 06:52:14,039][123091] Updated weights for policy 0, policy_version 911735 (0.0007) [2023-12-26 06:52:14,093][123091] Updated weights for policy 0, policy_version 911745 (0.0006) [2023-12-26 06:52:14,156][123091] Updated weights for policy 0, policy_version 911755 (0.0006) [2023-12-26 06:52:14,841][123091] Updated weights for policy 0, policy_version 911765 (0.0006) [2023-12-26 06:52:14,858][123090] Updated weights for policy 1, policy_version 905410 (0.0010) [2023-12-26 06:52:14,904][123091] Updated weights for policy 0, policy_version 911775 (0.0011) [2023-12-26 06:52:14,925][123090] Updated weights for policy 1, policy_version 905420 (0.0010) [2023-12-26 06:52:14,968][123091] Updated weights for policy 0, policy_version 911785 (0.0011) [2023-12-26 06:52:14,992][123090] Updated weights for policy 1, policy_version 905430 (0.0011) [2023-12-26 06:52:15,060][123090] Updated weights for policy 1, policy_version 905440 (0.0011) [2023-12-26 06:52:15,783][123091] Updated weights for policy 0, policy_version 911795 (0.0011) [2023-12-26 06:52:15,844][123091] Updated weights for policy 0, policy_version 911805 (0.0011) [2023-12-26 06:52:15,876][123090] Updated weights for policy 1, policy_version 905450 (0.0008) [2023-12-26 06:52:15,900][123091] Updated weights for policy 0, policy_version 911815 (0.0011) [2023-12-26 06:52:15,942][123090] Updated weights for policy 1, policy_version 905460 (0.0008) [2023-12-26 06:52:16,005][123090] Updated weights for policy 1, policy_version 905470 (0.0008) [2023-12-26 06:52:16,628][123091] Updated weights for policy 0, policy_version 911825 (0.0010) [2023-12-26 06:52:16,683][123090] Updated weights for policy 1, policy_version 905480 (0.0006) [2023-12-26 06:52:16,689][123091] Updated weights for policy 0, policy_version 911835 (0.0008) [2023-12-26 06:52:16,743][123090] Updated weights for policy 1, policy_version 905490 (0.0005) [2023-12-26 06:52:16,750][123091] Updated weights for policy 0, policy_version 911845 (0.0009) [2023-12-26 06:52:16,806][123091] Updated weights for policy 0, policy_version 911855 (0.0008) [2023-12-26 06:52:16,811][123090] Updated weights for policy 1, policy_version 905500 (0.0005) [2023-12-26 06:52:17,456][123090] Updated weights for policy 1, policy_version 905510 (0.0006) [2023-12-26 06:52:17,514][123090] Updated weights for policy 1, policy_version 905520 (0.0006) [2023-12-26 06:52:17,566][123090] Updated weights for policy 1, policy_version 905530 (0.0007) [2023-12-26 06:52:17,627][123091] Updated weights for policy 0, policy_version 911865 (0.0006) [2023-12-26 06:52:17,674][123091] Updated weights for policy 0, policy_version 911875 (0.0005) [2023-12-26 06:52:17,736][123091] Updated weights for policy 0, policy_version 911885 (0.0005) [2023-12-26 06:52:18,245][123090] Updated weights for policy 1, policy_version 905540 (0.0006) [2023-12-26 06:52:18,306][123090] Updated weights for policy 1, policy_version 905550 (0.0006) [2023-12-26 06:52:18,374][123090] Updated weights for policy 1, policy_version 905560 (0.0013) [2023-12-26 06:52:18,463][123091] Updated weights for policy 0, policy_version 911895 (0.0006) [2023-12-26 06:52:18,537][123091] Updated weights for policy 0, policy_version 911905 (0.0007) [2023-12-26 06:52:18,600][123091] Updated weights for policy 0, policy_version 911915 (0.0011) [2023-12-26 06:52:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 465281024. Throughput: 0: 9081.9, 1: 8830.6. Samples: 465289416. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:18,785][121949] Avg episode reward: [(0, '6293.186'), (1, '5759.394')] [2023-12-26 06:52:19,172][123090] Updated weights for policy 1, policy_version 905570 (0.0011) [2023-12-26 06:52:19,227][123090] Updated weights for policy 1, policy_version 905580 (0.0010) [2023-12-26 06:52:19,298][123090] Updated weights for policy 1, policy_version 905590 (0.0010) [2023-12-26 06:52:19,376][123090] Updated weights for policy 1, policy_version 905600 (0.0009) [2023-12-26 06:52:19,412][123091] Updated weights for policy 0, policy_version 911925 (0.0009) [2023-12-26 06:52:19,484][123091] Updated weights for policy 0, policy_version 911935 (0.0008) [2023-12-26 06:52:19,550][123091] Updated weights for policy 0, policy_version 911945 (0.0006) [2023-12-26 06:52:20,086][123090] Updated weights for policy 1, policy_version 905610 (0.0010) [2023-12-26 06:52:20,149][123090] Updated weights for policy 1, policy_version 905620 (0.0010) [2023-12-26 06:52:20,218][123090] Updated weights for policy 1, policy_version 905630 (0.0006) [2023-12-26 06:52:20,274][123091] Updated weights for policy 0, policy_version 911955 (0.0008) [2023-12-26 06:52:20,336][123091] Updated weights for policy 0, policy_version 911965 (0.0009) [2023-12-26 06:52:20,401][123091] Updated weights for policy 0, policy_version 911975 (0.0009) [2023-12-26 06:52:20,962][123090] Updated weights for policy 1, policy_version 905640 (0.0009) [2023-12-26 06:52:21,025][123090] Updated weights for policy 1, policy_version 905650 (0.0008) [2023-12-26 06:52:21,091][123090] Updated weights for policy 1, policy_version 905660 (0.0009) [2023-12-26 06:52:21,300][123091] Updated weights for policy 0, policy_version 911985 (0.0010) [2023-12-26 06:52:21,372][123091] Updated weights for policy 0, policy_version 911995 (0.0010) [2023-12-26 06:52:21,437][123091] Updated weights for policy 0, policy_version 912005 (0.0009) [2023-12-26 06:52:21,496][123091] Updated weights for policy 0, policy_version 912015 (0.0010) [2023-12-26 06:52:21,973][123090] Updated weights for policy 1, policy_version 905670 (0.0007) [2023-12-26 06:52:22,045][123090] Updated weights for policy 1, policy_version 905680 (0.0007) [2023-12-26 06:52:22,107][123090] Updated weights for policy 1, policy_version 905690 (0.0008) [2023-12-26 06:52:22,390][123091] Updated weights for policy 0, policy_version 912025 (0.0008) [2023-12-26 06:52:22,457][123091] Updated weights for policy 0, policy_version 912035 (0.0008) [2023-12-26 06:52:22,524][123091] Updated weights for policy 0, policy_version 912045 (0.0010) [2023-12-26 06:52:22,877][123090] Updated weights for policy 1, policy_version 905700 (0.0009) [2023-12-26 06:52:22,936][123090] Updated weights for policy 1, policy_version 905710 (0.0009) [2023-12-26 06:52:22,999][123090] Updated weights for policy 1, policy_version 905720 (0.0010) [2023-12-26 06:52:23,372][123091] Updated weights for policy 0, policy_version 912055 (0.0010) [2023-12-26 06:52:23,430][123091] Updated weights for policy 0, policy_version 912065 (0.0010) [2023-12-26 06:52:23,487][123091] Updated weights for policy 0, policy_version 912075 (0.0010) [2023-12-26 06:52:23,669][123090] Updated weights for policy 1, policy_version 905730 (0.0009) [2023-12-26 06:52:23,729][123090] Updated weights for policy 1, policy_version 905740 (0.0006) [2023-12-26 06:52:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 465362944. Throughput: 0: 8943.8, 1: 8842.6. Samples: 465341356. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:23,785][121949] Avg episode reward: [(0, '6240.958'), (1, '5716.500')] [2023-12-26 06:52:23,786][123090] Updated weights for policy 1, policy_version 905750 (0.0006) [2023-12-26 06:52:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000912080_233496576.pth... [2023-12-26 06:52:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000911024_233226240.pth [2023-12-26 06:52:23,850][123090] Updated weights for policy 1, policy_version 905760 (0.0006) [2023-12-26 06:52:23,850][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000905760_231874560.pth... [2023-12-26 06:52:23,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000904704_231604224.pth [2023-12-26 06:52:24,373][123091] Updated weights for policy 0, policy_version 912085 (0.0007) [2023-12-26 06:52:24,425][123091] Updated weights for policy 0, policy_version 912095 (0.0005) [2023-12-26 06:52:24,485][123091] Updated weights for policy 0, policy_version 912105 (0.0005) [2023-12-26 06:52:24,524][123090] Updated weights for policy 1, policy_version 905770 (0.0006) [2023-12-26 06:52:24,583][123090] Updated weights for policy 1, policy_version 905780 (0.0007) [2023-12-26 06:52:24,644][123090] Updated weights for policy 1, policy_version 905790 (0.0005) [2023-12-26 06:52:25,165][123091] Updated weights for policy 0, policy_version 912115 (0.0007) [2023-12-26 06:52:25,212][123091] Updated weights for policy 0, policy_version 912125 (0.0009) [2023-12-26 06:52:25,264][123091] Updated weights for policy 0, policy_version 912135 (0.0007) [2023-12-26 06:52:25,324][123090] Updated weights for policy 1, policy_version 905800 (0.0009) [2023-12-26 06:52:25,393][123090] Updated weights for policy 1, policy_version 905810 (0.0010) [2023-12-26 06:52:25,459][123090] Updated weights for policy 1, policy_version 905820 (0.0010) [2023-12-26 06:52:26,001][123091] Updated weights for policy 0, policy_version 912145 (0.0008) [2023-12-26 06:52:26,053][123091] Updated weights for policy 0, policy_version 912155 (0.0009) [2023-12-26 06:52:26,109][123091] Updated weights for policy 0, policy_version 912165 (0.0009) [2023-12-26 06:52:26,169][123091] Updated weights for policy 0, policy_version 912175 (0.0009) [2023-12-26 06:52:26,256][123090] Updated weights for policy 1, policy_version 905830 (0.0010) [2023-12-26 06:52:26,322][123090] Updated weights for policy 1, policy_version 905840 (0.0010) [2023-12-26 06:52:26,377][123090] Updated weights for policy 1, policy_version 905850 (0.0010) [2023-12-26 06:52:26,996][123091] Updated weights for policy 0, policy_version 912185 (0.0008) [2023-12-26 06:52:27,052][123091] Updated weights for policy 0, policy_version 912195 (0.0005) [2023-12-26 06:52:27,102][123091] Updated weights for policy 0, policy_version 912205 (0.0007) [2023-12-26 06:52:27,141][123090] Updated weights for policy 1, policy_version 905860 (0.0009) [2023-12-26 06:52:27,202][123090] Updated weights for policy 1, policy_version 905870 (0.0005) [2023-12-26 06:52:27,264][123090] Updated weights for policy 1, policy_version 905880 (0.0010) [2023-12-26 06:52:27,841][123091] Updated weights for policy 0, policy_version 912215 (0.0006) [2023-12-26 06:52:27,903][123091] Updated weights for policy 0, policy_version 912225 (0.0006) [2023-12-26 06:52:27,964][123091] Updated weights for policy 0, policy_version 912235 (0.0010) [2023-12-26 06:52:28,028][123090] Updated weights for policy 1, policy_version 905890 (0.0011) [2023-12-26 06:52:28,097][123090] Updated weights for policy 1, policy_version 905900 (0.0010) [2023-12-26 06:52:28,165][123090] Updated weights for policy 1, policy_version 905910 (0.0010) [2023-12-26 06:52:28,208][123090] Updated weights for policy 1, policy_version 905920 (0.0010) [2023-12-26 06:52:28,664][123091] Updated weights for policy 0, policy_version 912245 (0.0007) [2023-12-26 06:52:28,715][123091] Updated weights for policy 0, policy_version 912255 (0.0007) [2023-12-26 06:52:28,771][123091] Updated weights for policy 0, policy_version 912265 (0.0009) [2023-12-26 06:52:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 465453056. Throughput: 0: 8923.9, 1: 8890.0. Samples: 465449956. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:28,784][121949] Avg episode reward: [(0, '6138.521'), (1, '5659.171')] [2023-12-26 06:52:29,045][123090] Updated weights for policy 1, policy_version 905930 (0.0010) [2023-12-26 06:52:29,106][123090] Updated weights for policy 1, policy_version 905940 (0.0010) [2023-12-26 06:52:29,171][123090] Updated weights for policy 1, policy_version 905950 (0.0010) [2023-12-26 06:52:29,594][123091] Updated weights for policy 0, policy_version 912275 (0.0009) [2023-12-26 06:52:29,646][123091] Updated weights for policy 0, policy_version 912285 (0.0008) [2023-12-26 06:52:29,709][123091] Updated weights for policy 0, policy_version 912295 (0.0009) [2023-12-26 06:52:29,996][123090] Updated weights for policy 1, policy_version 905960 (0.0010) [2023-12-26 06:52:30,060][123090] Updated weights for policy 1, policy_version 905970 (0.0010) [2023-12-26 06:52:30,124][123090] Updated weights for policy 1, policy_version 905980 (0.0009) [2023-12-26 06:52:30,510][123091] Updated weights for policy 0, policy_version 912305 (0.0008) [2023-12-26 06:52:30,560][123091] Updated weights for policy 0, policy_version 912315 (0.0006) [2023-12-26 06:52:30,621][123091] Updated weights for policy 0, policy_version 912325 (0.0009) [2023-12-26 06:52:30,679][123091] Updated weights for policy 0, policy_version 912335 (0.0010) [2023-12-26 06:52:30,940][123090] Updated weights for policy 1, policy_version 905990 (0.0009) [2023-12-26 06:52:30,995][123090] Updated weights for policy 1, policy_version 906000 (0.0008) [2023-12-26 06:52:31,064][123090] Updated weights for policy 1, policy_version 906010 (0.0008) [2023-12-26 06:52:31,511][123091] Updated weights for policy 0, policy_version 912345 (0.0007) [2023-12-26 06:52:31,577][123091] Updated weights for policy 0, policy_version 912355 (0.0007) [2023-12-26 06:52:31,637][123091] Updated weights for policy 0, policy_version 912365 (0.0008) [2023-12-26 06:52:31,894][123090] Updated weights for policy 1, policy_version 906020 (0.0008) [2023-12-26 06:52:31,952][123090] Updated weights for policy 1, policy_version 906030 (0.0005) [2023-12-26 06:52:32,015][123090] Updated weights for policy 1, policy_version 906040 (0.0008) [2023-12-26 06:52:32,303][123091] Updated weights for policy 0, policy_version 912375 (0.0009) [2023-12-26 06:52:32,365][123091] Updated weights for policy 0, policy_version 912385 (0.0009) [2023-12-26 06:52:32,430][123091] Updated weights for policy 0, policy_version 912395 (0.0009) [2023-12-26 06:52:32,750][123090] Updated weights for policy 1, policy_version 906050 (0.0009) [2023-12-26 06:52:32,813][123090] Updated weights for policy 1, policy_version 906060 (0.0006) [2023-12-26 06:52:32,891][123090] Updated weights for policy 1, policy_version 906070 (0.0005) [2023-12-26 06:52:32,959][123090] Updated weights for policy 1, policy_version 906080 (0.0008) [2023-12-26 06:52:33,174][123091] Updated weights for policy 0, policy_version 912405 (0.0007) [2023-12-26 06:52:33,224][123091] Updated weights for policy 0, policy_version 912415 (0.0005) [2023-12-26 06:52:33,274][123091] Updated weights for policy 0, policy_version 912425 (0.0005) [2023-12-26 06:52:33,664][123090] Updated weights for policy 1, policy_version 906090 (0.0006) [2023-12-26 06:52:33,720][123090] Updated weights for policy 1, policy_version 906100 (0.0005) [2023-12-26 06:52:33,774][123090] Updated weights for policy 1, policy_version 906110 (0.0006) [2023-12-26 06:52:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 465551360. Throughput: 0: 8985.3, 1: 8898.7. Samples: 465559152. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:33,785][121949] Avg episode reward: [(0, '6037.848'), (1, '5682.275')] [2023-12-26 06:52:33,972][123091] Updated weights for policy 0, policy_version 912435 (0.0006) [2023-12-26 06:52:34,036][123091] Updated weights for policy 0, policy_version 912445 (0.0009) [2023-12-26 06:52:34,103][123091] Updated weights for policy 0, policy_version 912455 (0.0006) [2023-12-26 06:52:34,549][123090] Updated weights for policy 1, policy_version 906120 (0.0007) [2023-12-26 06:52:34,617][123090] Updated weights for policy 1, policy_version 906130 (0.0006) [2023-12-26 06:52:34,680][123090] Updated weights for policy 1, policy_version 906140 (0.0005) [2023-12-26 06:52:34,847][123091] Updated weights for policy 0, policy_version 912465 (0.0006) [2023-12-26 06:52:34,924][123091] Updated weights for policy 0, policy_version 912475 (0.0008) [2023-12-26 06:52:34,989][123091] Updated weights for policy 0, policy_version 912485 (0.0009) [2023-12-26 06:52:35,050][123091] Updated weights for policy 0, policy_version 912495 (0.0010) [2023-12-26 06:52:35,364][123090] Updated weights for policy 1, policy_version 906150 (0.0008) [2023-12-26 06:52:35,414][123090] Updated weights for policy 1, policy_version 906161 (0.0009) [2023-12-26 06:52:35,463][123090] Updated weights for policy 1, policy_version 906171 (0.0009) [2023-12-26 06:52:35,826][123091] Updated weights for policy 0, policy_version 912505 (0.0006) [2023-12-26 06:52:35,883][123091] Updated weights for policy 0, policy_version 912515 (0.0006) [2023-12-26 06:52:35,941][123091] Updated weights for policy 0, policy_version 912525 (0.0005) [2023-12-26 06:52:36,402][123090] Updated weights for policy 1, policy_version 906181 (0.0009) [2023-12-26 06:52:36,472][123090] Updated weights for policy 1, policy_version 906191 (0.0009) [2023-12-26 06:52:36,535][123090] Updated weights for policy 1, policy_version 906201 (0.0009) [2023-12-26 06:52:36,663][123091] Updated weights for policy 0, policy_version 912535 (0.0009) [2023-12-26 06:52:36,724][123091] Updated weights for policy 0, policy_version 912545 (0.0010) [2023-12-26 06:52:36,784][123091] Updated weights for policy 0, policy_version 912555 (0.0007) [2023-12-26 06:52:37,433][123090] Updated weights for policy 1, policy_version 906211 (0.0009) [2023-12-26 06:52:37,497][123090] Updated weights for policy 1, policy_version 906221 (0.0009) [2023-12-26 06:52:37,532][123091] Updated weights for policy 0, policy_version 912565 (0.0007) [2023-12-26 06:52:37,561][123090] Updated weights for policy 1, policy_version 906231 (0.0008) [2023-12-26 06:52:37,598][123091] Updated weights for policy 0, policy_version 912575 (0.0009) [2023-12-26 06:52:37,669][123091] Updated weights for policy 0, policy_version 912585 (0.0010) [2023-12-26 06:52:38,295][123090] Updated weights for policy 1, policy_version 906241 (0.0006) [2023-12-26 06:52:38,362][123090] Updated weights for policy 1, policy_version 906251 (0.0007) [2023-12-26 06:52:38,375][123091] Updated weights for policy 0, policy_version 912595 (0.0007) [2023-12-26 06:52:38,430][123090] Updated weights for policy 1, policy_version 906261 (0.0008) [2023-12-26 06:52:38,435][123091] Updated weights for policy 0, policy_version 912605 (0.0009) [2023-12-26 06:52:38,489][123090] Updated weights for policy 1, policy_version 906271 (0.0009) [2023-12-26 06:52:38,498][123091] Updated weights for policy 0, policy_version 912615 (0.0009) [2023-12-26 06:52:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 465641472. Throughput: 0: 9054.8, 1: 8914.6. Samples: 465614024. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:38,785][121949] Avg episode reward: [(0, '6139.425'), (1, '5779.427')] [2023-12-26 06:52:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000912624_233635840.pth... [2023-12-26 06:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000906272_232005632.pth... [2023-12-26 06:52:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000905216_231735296.pth [2023-12-26 06:52:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000911568_233365504.pth [2023-12-26 06:52:39,168][123091] Updated weights for policy 0, policy_version 912625 (0.0009) [2023-12-26 06:52:39,233][123091] Updated weights for policy 0, policy_version 912635 (0.0008) [2023-12-26 06:52:39,304][123091] Updated weights for policy 0, policy_version 912645 (0.0011) [2023-12-26 06:52:39,365][123090] Updated weights for policy 1, policy_version 906281 (0.0007) [2023-12-26 06:52:39,365][123091] Updated weights for policy 0, policy_version 912655 (0.0011) [2023-12-26 06:52:39,438][123090] Updated weights for policy 1, policy_version 906291 (0.0009) [2023-12-26 06:52:39,499][123090] Updated weights for policy 1, policy_version 906301 (0.0009) [2023-12-26 06:52:40,198][123091] Updated weights for policy 0, policy_version 912665 (0.0011) [2023-12-26 06:52:40,265][123091] Updated weights for policy 0, policy_version 912675 (0.0011) [2023-12-26 06:52:40,333][123091] Updated weights for policy 0, policy_version 912685 (0.0011) [2023-12-26 06:52:40,361][123090] Updated weights for policy 1, policy_version 906311 (0.0007) [2023-12-26 06:52:40,418][123090] Updated weights for policy 1, policy_version 906321 (0.0009) [2023-12-26 06:52:40,478][123090] Updated weights for policy 1, policy_version 906331 (0.0009) [2023-12-26 06:52:41,195][123091] Updated weights for policy 0, policy_version 912695 (0.0011) [2023-12-26 06:52:41,254][123091] Updated weights for policy 0, policy_version 912705 (0.0011) [2023-12-26 06:52:41,315][123091] Updated weights for policy 0, policy_version 912715 (0.0011) [2023-12-26 06:52:41,361][123090] Updated weights for policy 1, policy_version 906341 (0.0008) [2023-12-26 06:52:41,432][123090] Updated weights for policy 1, policy_version 906351 (0.0009) [2023-12-26 06:52:41,508][123090] Updated weights for policy 1, policy_version 906361 (0.0009) [2023-12-26 06:52:42,191][123091] Updated weights for policy 0, policy_version 912725 (0.0011) [2023-12-26 06:52:42,262][123091] Updated weights for policy 0, policy_version 912735 (0.0011) [2023-12-26 06:52:42,331][123091] Updated weights for policy 0, policy_version 912745 (0.0011) [2023-12-26 06:52:42,381][123090] Updated weights for policy 1, policy_version 906371 (0.0008) [2023-12-26 06:52:42,432][123090] Updated weights for policy 1, policy_version 906381 (0.0009) [2023-12-26 06:52:42,485][123090] Updated weights for policy 1, policy_version 906391 (0.0009) [2023-12-26 06:52:43,155][123091] Updated weights for policy 0, policy_version 912755 (0.0010) [2023-12-26 06:52:43,211][123091] Updated weights for policy 0, policy_version 912765 (0.0010) [2023-12-26 06:52:43,266][123091] Updated weights for policy 0, policy_version 912775 (0.0010) [2023-12-26 06:52:43,310][123090] Updated weights for policy 1, policy_version 906401 (0.0008) [2023-12-26 06:52:43,365][123090] Updated weights for policy 1, policy_version 906411 (0.0005) [2023-12-26 06:52:43,431][123090] Updated weights for policy 1, policy_version 906421 (0.0007) [2023-12-26 06:52:43,497][123090] Updated weights for policy 1, policy_version 906431 (0.0008) [2023-12-26 06:52:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 465723392. Throughput: 0: 9023.9, 1: 8796.8. Samples: 465716464. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:43,784][121949] Avg episode reward: [(0, '6252.983'), (1, '5835.766')] [2023-12-26 06:52:44,112][123091] Updated weights for policy 0, policy_version 912785 (0.0011) [2023-12-26 06:52:44,172][123091] Updated weights for policy 0, policy_version 912795 (0.0011) [2023-12-26 06:52:44,190][123090] Updated weights for policy 1, policy_version 906441 (0.0010) [2023-12-26 06:52:44,234][123091] Updated weights for policy 0, policy_version 912805 (0.0010) [2023-12-26 06:52:44,246][123090] Updated weights for policy 1, policy_version 906451 (0.0009) [2023-12-26 06:52:44,278][123091] Updated weights for policy 0, policy_version 912815 (0.0010) [2023-12-26 06:52:44,304][123090] Updated weights for policy 1, policy_version 906461 (0.0007) [2023-12-26 06:52:45,048][123090] Updated weights for policy 1, policy_version 906471 (0.0007) [2023-12-26 06:52:45,099][123091] Updated weights for policy 0, policy_version 912825 (0.0008) [2023-12-26 06:52:45,116][123090] Updated weights for policy 1, policy_version 906481 (0.0007) [2023-12-26 06:52:45,161][123091] Updated weights for policy 0, policy_version 912835 (0.0007) [2023-12-26 06:52:45,179][123090] Updated weights for policy 1, policy_version 906491 (0.0010) [2023-12-26 06:52:45,228][123091] Updated weights for policy 0, policy_version 912845 (0.0006) [2023-12-26 06:52:45,861][123090] Updated weights for policy 1, policy_version 906501 (0.0008) [2023-12-26 06:52:45,908][123090] Updated weights for policy 1, policy_version 906511 (0.0005) [2023-12-26 06:52:45,954][123090] Updated weights for policy 1, policy_version 906521 (0.0005) [2023-12-26 06:52:46,000][123091] Updated weights for policy 0, policy_version 912855 (0.0006) [2023-12-26 06:52:46,053][123091] Updated weights for policy 0, policy_version 912865 (0.0005) [2023-12-26 06:52:46,108][123091] Updated weights for policy 0, policy_version 912875 (0.0005) [2023-12-26 06:52:46,627][123090] Updated weights for policy 1, policy_version 906531 (0.0005) [2023-12-26 06:52:46,690][123090] Updated weights for policy 1, policy_version 906541 (0.0005) [2023-12-26 06:52:46,743][123090] Updated weights for policy 1, policy_version 906551 (0.0005) [2023-12-26 06:52:46,978][123091] Updated weights for policy 0, policy_version 912885 (0.0009) [2023-12-26 06:52:47,041][123091] Updated weights for policy 0, policy_version 912895 (0.0009) [2023-12-26 06:52:47,094][123091] Updated weights for policy 0, policy_version 912905 (0.0009) [2023-12-26 06:52:47,465][123090] Updated weights for policy 1, policy_version 906561 (0.0005) [2023-12-26 06:52:47,519][123090] Updated weights for policy 1, policy_version 906571 (0.0005) [2023-12-26 06:52:47,586][123090] Updated weights for policy 1, policy_version 906581 (0.0005) [2023-12-26 06:52:47,654][123090] Updated weights for policy 1, policy_version 906591 (0.0010) [2023-12-26 06:52:47,956][123091] Updated weights for policy 0, policy_version 912915 (0.0009) [2023-12-26 06:52:48,016][123091] Updated weights for policy 0, policy_version 912925 (0.0009) [2023-12-26 06:52:48,075][123091] Updated weights for policy 0, policy_version 912935 (0.0009) [2023-12-26 06:52:48,408][123090] Updated weights for policy 1, policy_version 906601 (0.0011) [2023-12-26 06:52:48,483][123090] Updated weights for policy 1, policy_version 906611 (0.0011) [2023-12-26 06:52:48,553][123090] Updated weights for policy 1, policy_version 906621 (0.0010) [2023-12-26 06:52:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 465813504. Throughput: 0: 8970.8, 1: 8911.4. Samples: 465825704. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:48,785][121949] Avg episode reward: [(0, '6177.391'), (1, '5818.857')] [2023-12-26 06:52:48,827][123091] Updated weights for policy 0, policy_version 912945 (0.0008) [2023-12-26 06:52:48,887][123091] Updated weights for policy 0, policy_version 912955 (0.0007) [2023-12-26 06:52:48,948][123091] Updated weights for policy 0, policy_version 912965 (0.0006) [2023-12-26 06:52:49,003][123091] Updated weights for policy 0, policy_version 912975 (0.0005) [2023-12-26 06:52:49,391][123090] Updated weights for policy 1, policy_version 906631 (0.0009) [2023-12-26 06:52:49,449][123090] Updated weights for policy 1, policy_version 906641 (0.0008) [2023-12-26 06:52:49,504][123090] Updated weights for policy 1, policy_version 906651 (0.0010) [2023-12-26 06:52:49,703][123091] Updated weights for policy 0, policy_version 912985 (0.0010) [2023-12-26 06:52:49,767][123091] Updated weights for policy 0, policy_version 912995 (0.0011) [2023-12-26 06:52:49,823][123091] Updated weights for policy 0, policy_version 913005 (0.0011) [2023-12-26 06:52:50,275][123090] Updated weights for policy 1, policy_version 906661 (0.0005) [2023-12-26 06:52:50,326][123090] Updated weights for policy 1, policy_version 906671 (0.0006) [2023-12-26 06:52:50,379][123090] Updated weights for policy 1, policy_version 906681 (0.0006) [2023-12-26 06:52:50,599][123091] Updated weights for policy 0, policy_version 913015 (0.0008) [2023-12-26 06:52:50,663][123091] Updated weights for policy 0, policy_version 913025 (0.0006) [2023-12-26 06:52:50,716][123091] Updated weights for policy 0, policy_version 913035 (0.0007) [2023-12-26 06:52:51,187][123090] Updated weights for policy 1, policy_version 906691 (0.0007) [2023-12-26 06:52:51,258][123090] Updated weights for policy 1, policy_version 906701 (0.0010) [2023-12-26 06:52:51,328][123090] Updated weights for policy 1, policy_version 906711 (0.0011) [2023-12-26 06:52:51,412][123091] Updated weights for policy 0, policy_version 913045 (0.0006) [2023-12-26 06:52:51,488][123091] Updated weights for policy 0, policy_version 913055 (0.0005) [2023-12-26 06:52:51,564][123091] Updated weights for policy 0, policy_version 913065 (0.0007) [2023-12-26 06:52:52,112][123090] Updated weights for policy 1, policy_version 906721 (0.0010) [2023-12-26 06:52:52,167][123090] Updated weights for policy 1, policy_version 906731 (0.0006) [2023-12-26 06:52:52,215][123090] Updated weights for policy 1, policy_version 906741 (0.0009) [2023-12-26 06:52:52,279][123090] Updated weights for policy 1, policy_version 906751 (0.0008) [2023-12-26 06:52:52,322][123091] Updated weights for policy 0, policy_version 913075 (0.0011) [2023-12-26 06:52:52,389][123091] Updated weights for policy 0, policy_version 913085 (0.0010) [2023-12-26 06:52:52,454][123091] Updated weights for policy 0, policy_version 913095 (0.0007) [2023-12-26 06:52:53,067][123090] Updated weights for policy 1, policy_version 906761 (0.0008) [2023-12-26 06:52:53,121][123090] Updated weights for policy 1, policy_version 906771 (0.0006) [2023-12-26 06:52:53,169][123090] Updated weights for policy 1, policy_version 906781 (0.0005) [2023-12-26 06:52:53,242][123091] Updated weights for policy 0, policy_version 913105 (0.0006) [2023-12-26 06:52:53,294][123091] Updated weights for policy 0, policy_version 913115 (0.0011) [2023-12-26 06:52:53,348][123091] Updated weights for policy 0, policy_version 913125 (0.0010) [2023-12-26 06:52:53,404][123091] Updated weights for policy 0, policy_version 913135 (0.0011) [2023-12-26 06:52:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 465903616. Throughput: 0: 8986.4, 1: 8929.2. Samples: 465880096. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:53,785][121949] Avg episode reward: [(0, '6192.801'), (1, '5766.973')] [2023-12-26 06:52:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000913136_233766912.pth... [2023-12-26 06:52:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000906784_232136704.pth... [2023-12-26 06:52:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000912080_233496576.pth [2023-12-26 06:52:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000905760_231874560.pth [2023-12-26 06:52:53,874][123090] Updated weights for policy 1, policy_version 906791 (0.0008) [2023-12-26 06:52:53,921][123090] Updated weights for policy 1, policy_version 906801 (0.0009) [2023-12-26 06:52:53,974][123090] Updated weights for policy 1, policy_version 906811 (0.0009) [2023-12-26 06:52:54,217][123091] Updated weights for policy 0, policy_version 913145 (0.0006) [2023-12-26 06:52:54,265][123091] Updated weights for policy 0, policy_version 913155 (0.0005) [2023-12-26 06:52:54,314][123091] Updated weights for policy 0, policy_version 913165 (0.0005) [2023-12-26 06:52:54,762][123090] Updated weights for policy 1, policy_version 906821 (0.0005) [2023-12-26 06:52:54,822][123090] Updated weights for policy 1, policy_version 906831 (0.0005) [2023-12-26 06:52:54,883][123090] Updated weights for policy 1, policy_version 906841 (0.0006) [2023-12-26 06:52:55,008][123091] Updated weights for policy 0, policy_version 913175 (0.0009) [2023-12-26 06:52:55,075][123091] Updated weights for policy 0, policy_version 913185 (0.0011) [2023-12-26 06:52:55,138][123091] Updated weights for policy 0, policy_version 913195 (0.0010) [2023-12-26 06:52:55,532][123090] Updated weights for policy 1, policy_version 906851 (0.0005) [2023-12-26 06:52:55,583][123090] Updated weights for policy 1, policy_version 906861 (0.0005) [2023-12-26 06:52:55,636][123090] Updated weights for policy 1, policy_version 906871 (0.0010) [2023-12-26 06:52:55,775][123091] Updated weights for policy 0, policy_version 913205 (0.0005) [2023-12-26 06:52:55,823][123091] Updated weights for policy 0, policy_version 913215 (0.0005) [2023-12-26 06:52:55,876][123091] Updated weights for policy 0, policy_version 913225 (0.0006) [2023-12-26 06:52:56,388][123090] Updated weights for policy 1, policy_version 906881 (0.0006) [2023-12-26 06:52:56,442][123090] Updated weights for policy 1, policy_version 906891 (0.0005) [2023-12-26 06:52:56,499][123090] Updated weights for policy 1, policy_version 906901 (0.0005) [2023-12-26 06:52:56,563][123090] Updated weights for policy 1, policy_version 906911 (0.0005) [2023-12-26 06:52:56,655][123091] Updated weights for policy 0, policy_version 913235 (0.0005) [2023-12-26 06:52:56,727][123091] Updated weights for policy 0, policy_version 913245 (0.0006) [2023-12-26 06:52:56,792][123091] Updated weights for policy 0, policy_version 913255 (0.0006) [2023-12-26 06:52:57,219][123090] Updated weights for policy 1, policy_version 906921 (0.0005) [2023-12-26 06:52:57,275][123090] Updated weights for policy 1, policy_version 906931 (0.0006) [2023-12-26 06:52:57,309][123091] Updated weights for policy 0, policy_version 913265 (0.0006) [2023-12-26 06:52:57,338][123090] Updated weights for policy 1, policy_version 906941 (0.0007) [2023-12-26 06:52:57,368][123091] Updated weights for policy 0, policy_version 913275 (0.0011) [2023-12-26 06:52:57,429][123091] Updated weights for policy 0, policy_version 913285 (0.0010) [2023-12-26 06:52:57,498][123091] Updated weights for policy 0, policy_version 913295 (0.0010) [2023-12-26 06:52:57,967][123090] Updated weights for policy 1, policy_version 906951 (0.0006) [2023-12-26 06:52:58,035][123090] Updated weights for policy 1, policy_version 906961 (0.0006) [2023-12-26 06:52:58,095][123090] Updated weights for policy 1, policy_version 906971 (0.0008) [2023-12-26 06:52:58,218][123091] Updated weights for policy 0, policy_version 913305 (0.0008) [2023-12-26 06:52:58,285][123091] Updated weights for policy 0, policy_version 913315 (0.0006) [2023-12-26 06:52:58,356][123091] Updated weights for policy 0, policy_version 913325 (0.0007) [2023-12-26 06:52:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18159.0, 300 sec: 17772.5). Total num frames: 466001920. Throughput: 0: 9061.4, 1: 9066.0. Samples: 465996312. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:52:58,785][121949] Avg episode reward: [(0, '6293.455'), (1, '5683.238')] [2023-12-26 06:52:58,902][123090] Updated weights for policy 1, policy_version 906981 (0.0008) [2023-12-26 06:52:58,967][123090] Updated weights for policy 1, policy_version 906991 (0.0006) [2023-12-26 06:52:59,037][123090] Updated weights for policy 1, policy_version 907001 (0.0008) [2023-12-26 06:52:59,322][123091] Updated weights for policy 0, policy_version 913335 (0.0006) [2023-12-26 06:52:59,384][123091] Updated weights for policy 0, policy_version 913345 (0.0008) [2023-12-26 06:52:59,442][123091] Updated weights for policy 0, policy_version 913355 (0.0010) [2023-12-26 06:52:59,743][123090] Updated weights for policy 1, policy_version 907011 (0.0007) [2023-12-26 06:52:59,799][123090] Updated weights for policy 1, policy_version 907021 (0.0005) [2023-12-26 06:52:59,873][123090] Updated weights for policy 1, policy_version 907031 (0.0006) [2023-12-26 06:53:00,156][123091] Updated weights for policy 0, policy_version 913365 (0.0008) [2023-12-26 06:53:00,213][123091] Updated weights for policy 0, policy_version 913375 (0.0005) [2023-12-26 06:53:00,276][123091] Updated weights for policy 0, policy_version 913385 (0.0005) [2023-12-26 06:53:00,727][123090] Updated weights for policy 1, policy_version 907041 (0.0007) [2023-12-26 06:53:00,789][123090] Updated weights for policy 1, policy_version 907051 (0.0009) [2023-12-26 06:53:00,844][123090] Updated weights for policy 1, policy_version 907061 (0.0010) [2023-12-26 06:53:00,896][123090] Updated weights for policy 1, policy_version 907071 (0.0009) [2023-12-26 06:53:00,912][123091] Updated weights for policy 0, policy_version 913395 (0.0005) [2023-12-26 06:53:00,960][123091] Updated weights for policy 0, policy_version 913405 (0.0005) [2023-12-26 06:53:01,007][123091] Updated weights for policy 0, policy_version 913415 (0.0005) [2023-12-26 06:53:01,771][123091] Updated weights for policy 0, policy_version 913425 (0.0009) [2023-12-26 06:53:01,777][123090] Updated weights for policy 1, policy_version 907081 (0.0010) [2023-12-26 06:53:01,832][123090] Updated weights for policy 1, policy_version 907091 (0.0007) [2023-12-26 06:53:01,841][123091] Updated weights for policy 0, policy_version 913435 (0.0005) [2023-12-26 06:53:01,897][123090] Updated weights for policy 1, policy_version 907101 (0.0008) [2023-12-26 06:53:01,905][123091] Updated weights for policy 0, policy_version 913445 (0.0005) [2023-12-26 06:53:01,966][123091] Updated weights for policy 0, policy_version 913455 (0.0007) [2023-12-26 06:53:02,617][123090] Updated weights for policy 1, policy_version 907111 (0.0010) [2023-12-26 06:53:02,630][123091] Updated weights for policy 0, policy_version 913465 (0.0007) [2023-12-26 06:53:02,685][123091] Updated weights for policy 0, policy_version 913475 (0.0006) [2023-12-26 06:53:02,687][123090] Updated weights for policy 1, policy_version 907121 (0.0010) [2023-12-26 06:53:02,743][123091] Updated weights for policy 0, policy_version 913485 (0.0006) [2023-12-26 06:53:02,754][123090] Updated weights for policy 1, policy_version 907131 (0.0010) [2023-12-26 06:53:03,447][123091] Updated weights for policy 0, policy_version 913495 (0.0010) [2023-12-26 06:53:03,493][123091] Updated weights for policy 0, policy_version 913505 (0.0010) [2023-12-26 06:53:03,534][123090] Updated weights for policy 1, policy_version 907141 (0.0010) [2023-12-26 06:53:03,540][123091] Updated weights for policy 0, policy_version 913515 (0.0010) [2023-12-26 06:53:03,581][123090] Updated weights for policy 1, policy_version 907151 (0.0007) [2023-12-26 06:53:03,640][123090] Updated weights for policy 1, policy_version 907161 (0.0005) [2023-12-26 06:53:03,784][121949] Fps is (10 sec: 19661.5, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 466100224. Throughput: 0: 9108.8, 1: 9051.7. Samples: 466106636. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:53:03,785][121949] Avg episode reward: [(0, '6137.271'), (1, '5676.581')] [2023-12-26 06:53:04,278][123091] Updated weights for policy 0, policy_version 913525 (0.0010) [2023-12-26 06:53:04,349][123091] Updated weights for policy 0, policy_version 913535 (0.0010) [2023-12-26 06:53:04,418][123091] Updated weights for policy 0, policy_version 913545 (0.0010) [2023-12-26 06:53:04,463][123090] Updated weights for policy 1, policy_version 907171 (0.0007) [2023-12-26 06:53:04,530][123090] Updated weights for policy 1, policy_version 907181 (0.0010) [2023-12-26 06:53:04,597][123090] Updated weights for policy 1, policy_version 907191 (0.0010) [2023-12-26 06:53:05,126][123091] Updated weights for policy 0, policy_version 913555 (0.0010) [2023-12-26 06:53:05,178][123091] Updated weights for policy 0, policy_version 913565 (0.0008) [2023-12-26 06:53:05,237][123091] Updated weights for policy 0, policy_version 913575 (0.0005) [2023-12-26 06:53:05,398][123090] Updated weights for policy 1, policy_version 907201 (0.0010) [2023-12-26 06:53:05,453][123090] Updated weights for policy 1, policy_version 907211 (0.0005) [2023-12-26 06:53:05,501][123090] Updated weights for policy 1, policy_version 907221 (0.0006) [2023-12-26 06:53:05,557][123090] Updated weights for policy 1, policy_version 907231 (0.0006) [2023-12-26 06:53:06,064][123091] Updated weights for policy 0, policy_version 913585 (0.0010) [2023-12-26 06:53:06,125][123091] Updated weights for policy 0, policy_version 913595 (0.0008) [2023-12-26 06:53:06,188][123091] Updated weights for policy 0, policy_version 913605 (0.0007) [2023-12-26 06:53:06,253][123091] Updated weights for policy 0, policy_version 913615 (0.0006) [2023-12-26 06:53:06,296][123090] Updated weights for policy 1, policy_version 907241 (0.0010) [2023-12-26 06:53:06,349][123090] Updated weights for policy 1, policy_version 907251 (0.0011) [2023-12-26 06:53:06,401][123090] Updated weights for policy 1, policy_version 907261 (0.0010) [2023-12-26 06:53:06,980][123091] Updated weights for policy 0, policy_version 913625 (0.0010) [2023-12-26 06:53:07,028][123091] Updated weights for policy 0, policy_version 913635 (0.0010) [2023-12-26 06:53:07,091][123091] Updated weights for policy 0, policy_version 913645 (0.0011) [2023-12-26 06:53:07,198][123090] Updated weights for policy 1, policy_version 907271 (0.0007) [2023-12-26 06:53:07,256][123090] Updated weights for policy 1, policy_version 907281 (0.0010) [2023-12-26 06:53:07,315][123090] Updated weights for policy 1, policy_version 907291 (0.0010) [2023-12-26 06:53:07,898][123091] Updated weights for policy 0, policy_version 913655 (0.0007) [2023-12-26 06:53:07,954][123091] Updated weights for policy 0, policy_version 913665 (0.0005) [2023-12-26 06:53:08,023][123091] Updated weights for policy 0, policy_version 913675 (0.0006) [2023-12-26 06:53:08,073][123090] Updated weights for policy 1, policy_version 907301 (0.0010) [2023-12-26 06:53:08,139][123090] Updated weights for policy 1, policy_version 907311 (0.0010) [2023-12-26 06:53:08,195][123090] Updated weights for policy 1, policy_version 907321 (0.0010) [2023-12-26 06:53:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 466182144. Throughput: 0: 9169.6, 1: 9057.1. Samples: 466161556. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:53:08,785][121949] Avg episode reward: [(0, '6160.873'), (1, '5704.184')] [2023-12-26 06:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000907328_232275968.pth... [2023-12-26 06:53:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000906272_232005632.pth [2023-12-26 06:53:08,799][123091] Updated weights for policy 0, policy_version 913685 (0.0008) [2023-12-26 06:53:08,857][123091] Updated weights for policy 0, policy_version 913695 (0.0008) [2023-12-26 06:53:08,923][123091] Updated weights for policy 0, policy_version 913705 (0.0009) [2023-12-26 06:53:08,959][123090] Updated weights for policy 1, policy_version 907331 (0.0010) [2023-12-26 06:53:08,966][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000913712_233914368.pth... [2023-12-26 06:53:08,971][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000912624_233635840.pth [2023-12-26 06:53:09,014][123090] Updated weights for policy 1, policy_version 907341 (0.0010) [2023-12-26 06:53:09,061][123090] Updated weights for policy 1, policy_version 907351 (0.0010) [2023-12-26 06:53:09,737][123091] Updated weights for policy 0, policy_version 913715 (0.0008) [2023-12-26 06:53:09,805][123091] Updated weights for policy 0, policy_version 913725 (0.0010) [2023-12-26 06:53:09,873][123091] Updated weights for policy 0, policy_version 913735 (0.0009) [2023-12-26 06:53:09,887][123090] Updated weights for policy 1, policy_version 907361 (0.0010) [2023-12-26 06:53:09,957][123090] Updated weights for policy 1, policy_version 907371 (0.0010) [2023-12-26 06:53:10,024][123090] Updated weights for policy 1, policy_version 907381 (0.0010) [2023-12-26 06:53:10,083][123090] Updated weights for policy 1, policy_version 907391 (0.0010) [2023-12-26 06:53:10,679][123091] Updated weights for policy 0, policy_version 913745 (0.0009) [2023-12-26 06:53:10,748][123091] Updated weights for policy 0, policy_version 913755 (0.0009) [2023-12-26 06:53:10,812][123091] Updated weights for policy 0, policy_version 913765 (0.0011) [2023-12-26 06:53:10,841][123090] Updated weights for policy 1, policy_version 907401 (0.0010) [2023-12-26 06:53:10,866][123091] Updated weights for policy 0, policy_version 913775 (0.0010) [2023-12-26 06:53:10,897][123090] Updated weights for policy 1, policy_version 907411 (0.0010) [2023-12-26 06:53:10,963][123090] Updated weights for policy 1, policy_version 907421 (0.0010) [2023-12-26 06:53:11,683][123091] Updated weights for policy 0, policy_version 913785 (0.0010) [2023-12-26 06:53:11,757][123091] Updated weights for policy 0, policy_version 913795 (0.0009) [2023-12-26 06:53:11,829][123091] Updated weights for policy 0, policy_version 913805 (0.0006) [2023-12-26 06:53:11,903][123090] Updated weights for policy 1, policy_version 907431 (0.0007) [2023-12-26 06:53:11,978][123090] Updated weights for policy 1, policy_version 907441 (0.0006) [2023-12-26 06:53:12,054][123090] Updated weights for policy 1, policy_version 907451 (0.0006) [2023-12-26 06:53:12,617][123091] Updated weights for policy 0, policy_version 913815 (0.0008) [2023-12-26 06:53:12,684][123091] Updated weights for policy 0, policy_version 913825 (0.0010) [2023-12-26 06:53:12,742][123091] Updated weights for policy 0, policy_version 913835 (0.0009) [2023-12-26 06:53:12,772][123090] Updated weights for policy 1, policy_version 907461 (0.0007) [2023-12-26 06:53:12,828][123090] Updated weights for policy 1, policy_version 907471 (0.0005) [2023-12-26 06:53:12,885][123090] Updated weights for policy 1, policy_version 907481 (0.0005) [2023-12-26 06:53:13,574][123091] Updated weights for policy 0, policy_version 913845 (0.0009) [2023-12-26 06:53:13,630][123091] Updated weights for policy 0, policy_version 913855 (0.0011) [2023-12-26 06:53:13,667][123090] Updated weights for policy 1, policy_version 907491 (0.0005) [2023-12-26 06:53:13,693][123091] Updated weights for policy 0, policy_version 913865 (0.0011) [2023-12-26 06:53:13,732][123090] Updated weights for policy 1, policy_version 907501 (0.0010) [2023-12-26 06:53:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 466272256. Throughput: 0: 9183.1, 1: 8988.7. Samples: 466267688. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:53:13,784][121949] Avg episode reward: [(0, '6283.622'), (1, '5695.239')] [2023-12-26 06:53:13,796][123090] Updated weights for policy 1, policy_version 907511 (0.0008) [2023-12-26 06:53:14,525][123091] Updated weights for policy 0, policy_version 913875 (0.0011) [2023-12-26 06:53:14,586][123091] Updated weights for policy 0, policy_version 913885 (0.0010) [2023-12-26 06:53:14,643][123090] Updated weights for policy 1, policy_version 907521 (0.0008) [2023-12-26 06:53:14,645][123091] Updated weights for policy 0, policy_version 913895 (0.0010) [2023-12-26 06:53:14,708][123090] Updated weights for policy 1, policy_version 907531 (0.0008) [2023-12-26 06:53:14,775][123090] Updated weights for policy 1, policy_version 907541 (0.0009) [2023-12-26 06:53:14,841][123090] Updated weights for policy 1, policy_version 907551 (0.0009) [2023-12-26 06:53:15,470][123091] Updated weights for policy 0, policy_version 913905 (0.0010) [2023-12-26 06:53:15,536][123091] Updated weights for policy 0, policy_version 913915 (0.0011) [2023-12-26 06:53:15,599][123091] Updated weights for policy 0, policy_version 913925 (0.0011) [2023-12-26 06:53:15,663][123091] Updated weights for policy 0, policy_version 913935 (0.0011) [2023-12-26 06:53:15,697][123090] Updated weights for policy 1, policy_version 907561 (0.0008) [2023-12-26 06:53:15,751][123090] Updated weights for policy 1, policy_version 907571 (0.0009) [2023-12-26 06:53:15,808][123090] Updated weights for policy 1, policy_version 907581 (0.0009) [2023-12-26 06:53:16,452][123091] Updated weights for policy 0, policy_version 913945 (0.0006) [2023-12-26 06:53:16,518][123091] Updated weights for policy 0, policy_version 913955 (0.0005) [2023-12-26 06:53:16,571][123091] Updated weights for policy 0, policy_version 913965 (0.0005) [2023-12-26 06:53:16,692][123090] Updated weights for policy 1, policy_version 907591 (0.0009) [2023-12-26 06:53:16,749][123090] Updated weights for policy 1, policy_version 907601 (0.0010) [2023-12-26 06:53:16,813][123090] Updated weights for policy 1, policy_version 907611 (0.0009) [2023-12-26 06:53:17,197][123091] Updated weights for policy 0, policy_version 913975 (0.0005) [2023-12-26 06:53:17,251][123091] Updated weights for policy 0, policy_version 913985 (0.0005) [2023-12-26 06:53:17,298][123091] Updated weights for policy 0, policy_version 913995 (0.0005) [2023-12-26 06:53:17,740][123090] Updated weights for policy 1, policy_version 907621 (0.0009) [2023-12-26 06:53:17,797][123090] Updated weights for policy 1, policy_version 907632 (0.0009) [2023-12-26 06:53:17,854][123090] Updated weights for policy 1, policy_version 907642 (0.0009) [2023-12-26 06:53:17,911][123091] Updated weights for policy 0, policy_version 914005 (0.0005) [2023-12-26 06:53:17,975][123091] Updated weights for policy 0, policy_version 914015 (0.0005) [2023-12-26 06:53:18,021][123091] Updated weights for policy 0, policy_version 914025 (0.0005) [2023-12-26 06:53:18,762][123091] Updated weights for policy 0, policy_version 914035 (0.0006) [2023-12-26 06:53:18,781][123090] Updated weights for policy 1, policy_version 907652 (0.0009) [2023-12-26 06:53:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 466354176. Throughput: 0: 9152.4, 1: 8908.7. Samples: 466371900. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 06:53:18,784][121949] Avg episode reward: [(0, '6275.024'), (1, '5785.442')] [2023-12-26 06:53:18,823][123091] Updated weights for policy 0, policy_version 914045 (0.0007) [2023-12-26 06:53:18,839][123090] Updated weights for policy 1, policy_version 907662 (0.0006) [2023-12-26 06:53:18,882][123091] Updated weights for policy 0, policy_version 914055 (0.0010) [2023-12-26 06:53:18,903][123090] Updated weights for policy 1, policy_version 907672 (0.0007) [2023-12-26 06:53:19,676][123091] Updated weights for policy 0, policy_version 914065 (0.0011) [2023-12-26 06:53:19,725][123090] Updated weights for policy 1, policy_version 907682 (0.0007) [2023-12-26 06:53:19,732][123091] Updated weights for policy 0, policy_version 914075 (0.0008) [2023-12-26 06:53:19,785][123090] Updated weights for policy 1, policy_version 907692 (0.0011) [2023-12-26 06:53:19,793][123091] Updated weights for policy 0, policy_version 914085 (0.0007) [2023-12-26 06:53:19,855][123091] Updated weights for policy 0, policy_version 914095 (0.0008) [2023-12-26 06:53:19,859][123090] Updated weights for policy 1, policy_version 907702 (0.0008) [2023-12-26 06:53:19,931][123090] Updated weights for policy 1, policy_version 907712 (0.0006) [2023-12-26 06:53:20,617][123091] Updated weights for policy 0, policy_version 914105 (0.0010) [2023-12-26 06:53:20,683][123091] Updated weights for policy 0, policy_version 914115 (0.0009) [2023-12-26 06:53:20,688][123090] Updated weights for policy 1, policy_version 907722 (0.0007) [2023-12-26 06:53:20,746][123090] Updated weights for policy 1, policy_version 907732 (0.0007) [2023-12-26 06:53:20,758][123091] Updated weights for policy 0, policy_version 914125 (0.0008) [2023-12-26 06:53:20,802][123090] Updated weights for policy 1, policy_version 907742 (0.0007) [2023-12-26 06:53:21,504][123091] Updated weights for policy 0, policy_version 914135 (0.0009) [2023-12-26 06:53:21,557][123091] Updated weights for policy 0, policy_version 914145 (0.0009) [2023-12-26 06:53:21,608][123091] Updated weights for policy 0, policy_version 914155 (0.0010) [2023-12-26 06:53:21,690][123090] Updated weights for policy 1, policy_version 907752 (0.0009) [2023-12-26 06:53:21,765][123090] Updated weights for policy 1, policy_version 907762 (0.0008) [2023-12-26 06:53:21,824][123090] Updated weights for policy 1, policy_version 907772 (0.0006) [2023-12-26 06:53:22,480][123091] Updated weights for policy 0, policy_version 914165 (0.0008) [2023-12-26 06:53:22,556][123090] Updated weights for policy 1, policy_version 907782 (0.0007) [2023-12-26 06:53:22,557][123091] Updated weights for policy 0, policy_version 914175 (0.0005) [2023-12-26 06:53:22,611][123091] Updated weights for policy 0, policy_version 914185 (0.0008) [2023-12-26 06:53:22,622][123090] Updated weights for policy 1, policy_version 907792 (0.0008) [2023-12-26 06:53:22,681][123090] Updated weights for policy 1, policy_version 907802 (0.0008) [2023-12-26 06:53:23,347][123091] Updated weights for policy 0, policy_version 914195 (0.0007) [2023-12-26 06:53:23,403][123091] Updated weights for policy 0, policy_version 914205 (0.0010) [2023-12-26 06:53:23,463][123090] Updated weights for policy 1, policy_version 907812 (0.0007) [2023-12-26 06:53:23,465][123091] Updated weights for policy 0, policy_version 914215 (0.0007) [2023-12-26 06:53:23,524][123090] Updated weights for policy 1, policy_version 907822 (0.0007) [2023-12-26 06:53:23,595][123090] Updated weights for policy 1, policy_version 907832 (0.0005) [2023-12-26 06:53:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 466452480. Throughput: 0: 9117.8, 1: 8894.6. Samples: 466424580. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:23,785][121949] Avg episode reward: [(0, '6197.426'), (1, '5932.069')] [2023-12-26 06:53:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000914224_234045440.pth... [2023-12-26 06:53:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000907840_232407040.pth... [2023-12-26 06:53:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000906784_232136704.pth [2023-12-26 06:53:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000913136_233766912.pth [2023-12-26 06:53:24,199][123090] Updated weights for policy 1, policy_version 907842 (0.0006) [2023-12-26 06:53:24,269][123090] Updated weights for policy 1, policy_version 907852 (0.0006) [2023-12-26 06:53:24,341][123090] Updated weights for policy 1, policy_version 907862 (0.0006) [2023-12-26 06:53:24,346][123091] Updated weights for policy 0, policy_version 914225 (0.0008) [2023-12-26 06:53:24,408][123090] Updated weights for policy 1, policy_version 907872 (0.0007) [2023-12-26 06:53:24,432][123091] Updated weights for policy 0, policy_version 914235 (0.0009) [2023-12-26 06:53:24,499][123091] Updated weights for policy 0, policy_version 914245 (0.0009) [2023-12-26 06:53:24,561][123091] Updated weights for policy 0, policy_version 914255 (0.0006) [2023-12-26 06:53:25,174][123090] Updated weights for policy 1, policy_version 907882 (0.0010) [2023-12-26 06:53:25,238][123090] Updated weights for policy 1, policy_version 907892 (0.0011) [2023-12-26 06:53:25,254][123091] Updated weights for policy 0, policy_version 914265 (0.0006) [2023-12-26 06:53:25,290][123090] Updated weights for policy 1, policy_version 907902 (0.0010) [2023-12-26 06:53:25,317][123091] Updated weights for policy 0, policy_version 914275 (0.0005) [2023-12-26 06:53:25,378][123091] Updated weights for policy 0, policy_version 914285 (0.0005) [2023-12-26 06:53:26,098][123091] Updated weights for policy 0, policy_version 914295 (0.0008) [2023-12-26 06:53:26,109][123090] Updated weights for policy 1, policy_version 907912 (0.0010) [2023-12-26 06:53:26,153][123091] Updated weights for policy 0, policy_version 914305 (0.0006) [2023-12-26 06:53:26,175][123090] Updated weights for policy 1, policy_version 907922 (0.0010) [2023-12-26 06:53:26,211][123091] Updated weights for policy 0, policy_version 914315 (0.0007) [2023-12-26 06:53:26,242][123090] Updated weights for policy 1, policy_version 907932 (0.0010) [2023-12-26 06:53:26,976][123090] Updated weights for policy 1, policy_version 907942 (0.0007) [2023-12-26 06:53:26,981][123091] Updated weights for policy 0, policy_version 914325 (0.0006) [2023-12-26 06:53:27,027][123090] Updated weights for policy 1, policy_version 907952 (0.0005) [2023-12-26 06:53:27,039][123091] Updated weights for policy 0, policy_version 914335 (0.0006) [2023-12-26 06:53:27,103][123091] Updated weights for policy 0, policy_version 914345 (0.0007) [2023-12-26 06:53:27,110][123090] Updated weights for policy 1, policy_version 907962 (0.0005) [2023-12-26 06:53:27,755][123090] Updated weights for policy 1, policy_version 907972 (0.0006) [2023-12-26 06:53:27,815][123090] Updated weights for policy 1, policy_version 907982 (0.0005) [2023-12-26 06:53:27,837][123091] Updated weights for policy 0, policy_version 914356 (0.0006) [2023-12-26 06:53:27,871][123090] Updated weights for policy 1, policy_version 907992 (0.0005) [2023-12-26 06:53:27,886][123091] Updated weights for policy 0, policy_version 914367 (0.0009) [2023-12-26 06:53:27,954][123091] Updated weights for policy 0, policy_version 914378 (0.0010) [2023-12-26 06:53:28,629][123090] Updated weights for policy 1, policy_version 908002 (0.0006) [2023-12-26 06:53:28,682][123090] Updated weights for policy 1, policy_version 908012 (0.0010) [2023-12-26 06:53:28,739][123090] Updated weights for policy 1, policy_version 908022 (0.0010) [2023-12-26 06:53:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 466534400. Throughput: 0: 9168.0, 1: 9022.0. Samples: 466535012. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:28,784][121949] Avg episode reward: [(0, '6268.709'), (1, '5900.178')] [2023-12-26 06:53:28,789][123091] Updated weights for policy 0, policy_version 914388 (0.0010) [2023-12-26 06:53:28,791][123090] Updated weights for policy 1, policy_version 908032 (0.0009) [2023-12-26 06:53:28,855][123091] Updated weights for policy 0, policy_version 914398 (0.0010) [2023-12-26 06:53:28,902][123091] Updated weights for policy 0, policy_version 914408 (0.0008) [2023-12-26 06:53:29,684][123091] Updated weights for policy 0, policy_version 914418 (0.0008) [2023-12-26 06:53:29,685][123090] Updated weights for policy 1, policy_version 908042 (0.0008) [2023-12-26 06:53:29,731][123091] Updated weights for policy 0, policy_version 914428 (0.0007) [2023-12-26 06:53:29,748][123090] Updated weights for policy 1, policy_version 908052 (0.0008) [2023-12-26 06:53:29,786][123091] Updated weights for policy 0, policy_version 914438 (0.0007) [2023-12-26 06:53:29,806][123090] Updated weights for policy 1, policy_version 908062 (0.0007) [2023-12-26 06:53:29,849][123091] Updated weights for policy 0, policy_version 914448 (0.0011) [2023-12-26 06:53:30,573][123090] Updated weights for policy 1, policy_version 908072 (0.0008) [2023-12-26 06:53:30,636][123090] Updated weights for policy 1, policy_version 908082 (0.0010) [2023-12-26 06:53:30,676][123091] Updated weights for policy 0, policy_version 914458 (0.0010) [2023-12-26 06:53:30,683][123090] Updated weights for policy 1, policy_version 908092 (0.0010) [2023-12-26 06:53:30,730][123091] Updated weights for policy 0, policy_version 914468 (0.0010) [2023-12-26 06:53:30,780][123091] Updated weights for policy 0, policy_version 914478 (0.0010) [2023-12-26 06:53:31,520][123090] Updated weights for policy 1, policy_version 908102 (0.0010) [2023-12-26 06:53:31,571][123090] Updated weights for policy 1, policy_version 908112 (0.0009) [2023-12-26 06:53:31,588][123091] Updated weights for policy 0, policy_version 914488 (0.0006) [2023-12-26 06:53:31,643][123090] Updated weights for policy 1, policy_version 908122 (0.0007) [2023-12-26 06:53:31,657][123091] Updated weights for policy 0, policy_version 914498 (0.0010) [2023-12-26 06:53:31,721][123091] Updated weights for policy 0, policy_version 914508 (0.0011) [2023-12-26 06:53:32,387][123090] Updated weights for policy 1, policy_version 908132 (0.0008) [2023-12-26 06:53:32,399][123091] Updated weights for policy 0, policy_version 914518 (0.0009) [2023-12-26 06:53:32,439][123090] Updated weights for policy 1, policy_version 908142 (0.0008) [2023-12-26 06:53:32,446][123091] Updated weights for policy 0, policy_version 914528 (0.0007) [2023-12-26 06:53:32,487][123090] Updated weights for policy 1, policy_version 908152 (0.0008) [2023-12-26 06:53:32,494][123091] Updated weights for policy 0, policy_version 914538 (0.0006) [2023-12-26 06:53:33,272][123090] Updated weights for policy 1, policy_version 908162 (0.0007) [2023-12-26 06:53:33,327][123090] Updated weights for policy 1, policy_version 908172 (0.0007) [2023-12-26 06:53:33,340][123091] Updated weights for policy 0, policy_version 914548 (0.0007) [2023-12-26 06:53:33,387][123090] Updated weights for policy 1, policy_version 908182 (0.0009) [2023-12-26 06:53:33,395][123091] Updated weights for policy 0, policy_version 914558 (0.0005) [2023-12-26 06:53:33,448][123090] Updated weights for policy 1, policy_version 908192 (0.0010) [2023-12-26 06:53:33,456][123091] Updated weights for policy 0, policy_version 914568 (0.0006) [2023-12-26 06:53:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 466632704. Throughput: 0: 9205.8, 1: 8938.4. Samples: 466642192. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:33,784][121949] Avg episode reward: [(0, '6255.431'), (1, '5850.451')] [2023-12-26 06:53:34,208][123090] Updated weights for policy 1, policy_version 908202 (0.0008) [2023-12-26 06:53:34,238][123091] Updated weights for policy 0, policy_version 914578 (0.0009) [2023-12-26 06:53:34,264][123090] Updated weights for policy 1, policy_version 908212 (0.0010) [2023-12-26 06:53:34,290][123091] Updated weights for policy 0, policy_version 914588 (0.0010) [2023-12-26 06:53:34,323][123090] Updated weights for policy 1, policy_version 908222 (0.0010) [2023-12-26 06:53:34,347][123091] Updated weights for policy 0, policy_version 914598 (0.0010) [2023-12-26 06:53:34,406][123091] Updated weights for policy 0, policy_version 914608 (0.0011) [2023-12-26 06:53:35,098][123090] Updated weights for policy 1, policy_version 908232 (0.0006) [2023-12-26 06:53:35,140][123091] Updated weights for policy 0, policy_version 914618 (0.0006) [2023-12-26 06:53:35,153][123090] Updated weights for policy 1, policy_version 908242 (0.0005) [2023-12-26 06:53:35,191][123091] Updated weights for policy 0, policy_version 914628 (0.0005) [2023-12-26 06:53:35,202][123090] Updated weights for policy 1, policy_version 908252 (0.0005) [2023-12-26 06:53:35,239][123091] Updated weights for policy 0, policy_version 914638 (0.0005) [2023-12-26 06:53:35,892][123090] Updated weights for policy 1, policy_version 908262 (0.0006) [2023-12-26 06:53:35,963][123090] Updated weights for policy 1, policy_version 908272 (0.0006) [2023-12-26 06:53:36,031][123090] Updated weights for policy 1, policy_version 908282 (0.0007) [2023-12-26 06:53:36,032][123091] Updated weights for policy 0, policy_version 914648 (0.0007) [2023-12-26 06:53:36,104][123091] Updated weights for policy 0, policy_version 914658 (0.0010) [2023-12-26 06:53:36,181][123091] Updated weights for policy 0, policy_version 914668 (0.0010) [2023-12-26 06:53:36,802][123090] Updated weights for policy 1, policy_version 908292 (0.0006) [2023-12-26 06:53:36,873][123090] Updated weights for policy 1, policy_version 908302 (0.0006) [2023-12-26 06:53:36,925][123090] Updated weights for policy 1, policy_version 908312 (0.0009) [2023-12-26 06:53:37,020][123091] Updated weights for policy 0, policy_version 914678 (0.0008) [2023-12-26 06:53:37,072][123091] Updated weights for policy 0, policy_version 914688 (0.0005) [2023-12-26 06:53:37,136][123091] Updated weights for policy 0, policy_version 914698 (0.0005) [2023-12-26 06:53:37,607][123090] Updated weights for policy 1, policy_version 908322 (0.0009) [2023-12-26 06:53:37,681][123090] Updated weights for policy 1, policy_version 908332 (0.0009) [2023-12-26 06:53:37,751][123090] Updated weights for policy 1, policy_version 908342 (0.0010) [2023-12-26 06:53:37,811][123090] Updated weights for policy 1, policy_version 908352 (0.0008) [2023-12-26 06:53:37,905][123091] Updated weights for policy 0, policy_version 914708 (0.0008) [2023-12-26 06:53:37,958][123091] Updated weights for policy 0, policy_version 914718 (0.0009) [2023-12-26 06:53:38,024][123091] Updated weights for policy 0, policy_version 914728 (0.0010) [2023-12-26 06:53:38,673][123090] Updated weights for policy 1, policy_version 908362 (0.0009) [2023-12-26 06:53:38,744][123090] Updated weights for policy 1, policy_version 908372 (0.0009) [2023-12-26 06:53:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 466714624. Throughput: 0: 9173.0, 1: 8989.7. Samples: 466697416. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:38,785][121949] Avg episode reward: [(0, '6346.945'), (1, '5732.756')] [2023-12-26 06:53:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000914736_234176512.pth... [2023-12-26 06:53:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000913712_233914368.pth [2023-12-26 06:53:38,814][123090] Updated weights for policy 1, policy_version 908382 (0.0010) [2023-12-26 06:53:38,821][123091] Updated weights for policy 0, policy_version 914738 (0.0008) [2023-12-26 06:53:38,825][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000908384_232546304.pth... [2023-12-26 06:53:38,830][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000907328_232275968.pth [2023-12-26 06:53:38,887][123091] Updated weights for policy 0, policy_version 914748 (0.0009) [2023-12-26 06:53:38,951][123091] Updated weights for policy 0, policy_version 914758 (0.0008) [2023-12-26 06:53:39,014][123091] Updated weights for policy 0, policy_version 914768 (0.0010) [2023-12-26 06:53:39,685][123090] Updated weights for policy 1, policy_version 908392 (0.0010) [2023-12-26 06:53:39,752][123090] Updated weights for policy 1, policy_version 908402 (0.0011) [2023-12-26 06:53:39,811][123090] Updated weights for policy 1, policy_version 908412 (0.0010) [2023-12-26 06:53:39,881][123091] Updated weights for policy 0, policy_version 914778 (0.0010) [2023-12-26 06:53:39,949][123091] Updated weights for policy 0, policy_version 914788 (0.0009) [2023-12-26 06:53:40,019][123091] Updated weights for policy 0, policy_version 914798 (0.0011) [2023-12-26 06:53:40,616][123090] Updated weights for policy 1, policy_version 908422 (0.0007) [2023-12-26 06:53:40,680][123090] Updated weights for policy 1, policy_version 908432 (0.0005) [2023-12-26 06:53:40,744][123090] Updated weights for policy 1, policy_version 908442 (0.0007) [2023-12-26 06:53:40,842][123091] Updated weights for policy 0, policy_version 914808 (0.0011) [2023-12-26 06:53:40,908][123091] Updated weights for policy 0, policy_version 914818 (0.0010) [2023-12-26 06:53:40,971][123091] Updated weights for policy 0, policy_version 914828 (0.0011) [2023-12-26 06:53:41,508][123090] Updated weights for policy 1, policy_version 908452 (0.0010) [2023-12-26 06:53:41,570][123090] Updated weights for policy 1, policy_version 908462 (0.0009) [2023-12-26 06:53:41,625][123090] Updated weights for policy 1, policy_version 908472 (0.0009) [2023-12-26 06:53:41,876][123091] Updated weights for policy 0, policy_version 914838 (0.0010) [2023-12-26 06:53:41,930][123091] Updated weights for policy 0, policy_version 914848 (0.0009) [2023-12-26 06:53:41,984][123091] Updated weights for policy 0, policy_version 914858 (0.0009) [2023-12-26 06:53:42,503][123090] Updated weights for policy 1, policy_version 908482 (0.0008) [2023-12-26 06:53:42,568][123090] Updated weights for policy 1, policy_version 908492 (0.0006) [2023-12-26 06:53:42,630][123090] Updated weights for policy 1, policy_version 908502 (0.0006) [2023-12-26 06:53:42,696][123090] Updated weights for policy 1, policy_version 908512 (0.0008) [2023-12-26 06:53:42,814][123091] Updated weights for policy 0, policy_version 914868 (0.0010) [2023-12-26 06:53:42,877][123091] Updated weights for policy 0, policy_version 914878 (0.0011) [2023-12-26 06:53:42,940][123091] Updated weights for policy 0, policy_version 914888 (0.0011) [2023-12-26 06:53:43,389][123090] Updated weights for policy 1, policy_version 908522 (0.0005) [2023-12-26 06:53:43,455][123090] Updated weights for policy 1, policy_version 908532 (0.0006) [2023-12-26 06:53:43,521][123090] Updated weights for policy 1, policy_version 908542 (0.0005) [2023-12-26 06:53:43,650][123091] Updated weights for policy 0, policy_version 914898 (0.0010) [2023-12-26 06:53:43,697][123091] Updated weights for policy 0, policy_version 914908 (0.0008) [2023-12-26 06:53:43,755][123091] Updated weights for policy 0, policy_version 914918 (0.0006) [2023-12-26 06:53:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 466804736. Throughput: 0: 9033.4, 1: 8824.5. Samples: 466799912. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:43,785][121949] Avg episode reward: [(0, '6369.457'), (1, '5510.051')] [2023-12-26 06:53:43,810][123091] Updated weights for policy 0, policy_version 914928 (0.0006) [2023-12-26 06:53:44,158][123090] Updated weights for policy 1, policy_version 908552 (0.0008) [2023-12-26 06:53:44,211][123090] Updated weights for policy 1, policy_version 908562 (0.0010) [2023-12-26 06:53:44,277][123090] Updated weights for policy 1, policy_version 908572 (0.0007) [2023-12-26 06:53:44,560][123091] Updated weights for policy 0, policy_version 914938 (0.0006) [2023-12-26 06:53:44,628][123091] Updated weights for policy 0, policy_version 914948 (0.0005) [2023-12-26 06:53:44,695][123091] Updated weights for policy 0, policy_version 914958 (0.0006) [2023-12-26 06:53:45,126][123090] Updated weights for policy 1, policy_version 908582 (0.0009) [2023-12-26 06:53:45,180][123090] Updated weights for policy 1, policy_version 908592 (0.0010) [2023-12-26 06:53:45,239][123090] Updated weights for policy 1, policy_version 908602 (0.0009) [2023-12-26 06:53:45,326][123091] Updated weights for policy 0, policy_version 914968 (0.0009) [2023-12-26 06:53:45,395][123091] Updated weights for policy 0, policy_version 914978 (0.0010) [2023-12-26 06:53:45,453][123091] Updated weights for policy 0, policy_version 914988 (0.0009) [2023-12-26 06:53:46,043][123090] Updated weights for policy 1, policy_version 908612 (0.0010) [2023-12-26 06:53:46,094][123090] Updated weights for policy 1, policy_version 908622 (0.0010) [2023-12-26 06:53:46,153][123090] Updated weights for policy 1, policy_version 908632 (0.0010) [2023-12-26 06:53:46,302][123091] Updated weights for policy 0, policy_version 914998 (0.0009) [2023-12-26 06:53:46,361][123091] Updated weights for policy 0, policy_version 915008 (0.0009) [2023-12-26 06:53:46,420][123091] Updated weights for policy 0, policy_version 915018 (0.0009) [2023-12-26 06:53:46,871][123090] Updated weights for policy 1, policy_version 908642 (0.0010) [2023-12-26 06:53:46,937][123090] Updated weights for policy 1, policy_version 908652 (0.0010) [2023-12-26 06:53:46,992][123090] Updated weights for policy 1, policy_version 908662 (0.0010) [2023-12-26 06:53:47,055][123090] Updated weights for policy 1, policy_version 908672 (0.0010) [2023-12-26 06:53:47,289][123091] Updated weights for policy 0, policy_version 915028 (0.0009) [2023-12-26 06:53:47,340][123091] Updated weights for policy 0, policy_version 915038 (0.0009) [2023-12-26 06:53:47,393][123091] Updated weights for policy 0, policy_version 915048 (0.0009) [2023-12-26 06:53:47,876][123090] Updated weights for policy 1, policy_version 908682 (0.0010) [2023-12-26 06:53:47,927][123090] Updated weights for policy 1, policy_version 908692 (0.0010) [2023-12-26 06:53:47,982][123090] Updated weights for policy 1, policy_version 908702 (0.0010) [2023-12-26 06:53:48,259][123091] Updated weights for policy 0, policy_version 915058 (0.0009) [2023-12-26 06:53:48,325][123091] Updated weights for policy 0, policy_version 915068 (0.0010) [2023-12-26 06:53:48,399][123091] Updated weights for policy 0, policy_version 915078 (0.0009) [2023-12-26 06:53:48,470][123091] Updated weights for policy 0, policy_version 915088 (0.0011) [2023-12-26 06:53:48,741][123090] Updated weights for policy 1, policy_version 908712 (0.0009) [2023-12-26 06:53:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 466894848. Throughput: 0: 8954.6, 1: 8876.6. Samples: 466909044. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:48,785][121949] Avg episode reward: [(0, '6338.072'), (1, '5512.439')] [2023-12-26 06:53:48,789][123090] Updated weights for policy 1, policy_version 908722 (0.0006) [2023-12-26 06:53:48,841][123090] Updated weights for policy 1, policy_version 908732 (0.0007) [2023-12-26 06:53:49,245][123091] Updated weights for policy 0, policy_version 915098 (0.0007) [2023-12-26 06:53:49,313][123091] Updated weights for policy 0, policy_version 915108 (0.0009) [2023-12-26 06:53:49,381][123091] Updated weights for policy 0, policy_version 915118 (0.0010) [2023-12-26 06:53:49,581][123090] Updated weights for policy 1, policy_version 908742 (0.0009) [2023-12-26 06:53:49,642][123090] Updated weights for policy 1, policy_version 908752 (0.0009) [2023-12-26 06:53:49,692][123090] Updated weights for policy 1, policy_version 908762 (0.0009) [2023-12-26 06:53:50,242][123091] Updated weights for policy 0, policy_version 915128 (0.0009) [2023-12-26 06:53:50,307][123091] Updated weights for policy 0, policy_version 915138 (0.0009) [2023-12-26 06:53:50,365][123091] Updated weights for policy 0, policy_version 915148 (0.0010) [2023-12-26 06:53:50,505][123090] Updated weights for policy 1, policy_version 908772 (0.0007) [2023-12-26 06:53:50,563][123090] Updated weights for policy 1, policy_version 908782 (0.0007) [2023-12-26 06:53:50,629][123090] Updated weights for policy 1, policy_version 908792 (0.0010) [2023-12-26 06:53:51,230][123091] Updated weights for policy 0, policy_version 915158 (0.0007) [2023-12-26 06:53:51,291][123091] Updated weights for policy 0, policy_version 915168 (0.0006) [2023-12-26 06:53:51,350][123091] Updated weights for policy 0, policy_version 915178 (0.0008) [2023-12-26 06:53:51,468][123090] Updated weights for policy 1, policy_version 908802 (0.0010) [2023-12-26 06:53:51,528][123090] Updated weights for policy 1, policy_version 908812 (0.0009) [2023-12-26 06:53:51,592][123090] Updated weights for policy 1, policy_version 908822 (0.0009) [2023-12-26 06:53:51,660][123090] Updated weights for policy 1, policy_version 908832 (0.0009) [2023-12-26 06:53:52,134][123091] Updated weights for policy 0, policy_version 915188 (0.0009) [2023-12-26 06:53:52,187][123091] Updated weights for policy 0, policy_version 915198 (0.0009) [2023-12-26 06:53:52,254][123091] Updated weights for policy 0, policy_version 915208 (0.0009) [2023-12-26 06:53:52,488][123090] Updated weights for policy 1, policy_version 908842 (0.0010) [2023-12-26 06:53:52,544][123090] Updated weights for policy 1, policy_version 908852 (0.0009) [2023-12-26 06:53:52,601][123090] Updated weights for policy 1, policy_version 908862 (0.0009) [2023-12-26 06:53:53,100][123091] Updated weights for policy 0, policy_version 915218 (0.0009) [2023-12-26 06:53:53,164][123091] Updated weights for policy 0, policy_version 915228 (0.0009) [2023-12-26 06:53:53,212][123091] Updated weights for policy 0, policy_version 915238 (0.0008) [2023-12-26 06:53:53,260][123091] Updated weights for policy 0, policy_version 915248 (0.0009) [2023-12-26 06:53:53,437][123090] Updated weights for policy 1, policy_version 908872 (0.0010) [2023-12-26 06:53:53,492][123090] Updated weights for policy 1, policy_version 908882 (0.0009) [2023-12-26 06:53:53,548][123090] Updated weights for policy 1, policy_version 908892 (0.0009) [2023-12-26 06:53:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 466984960. Throughput: 0: 8903.0, 1: 8865.5. Samples: 466961144. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:53,785][121949] Avg episode reward: [(0, '6365.074'), (1, '5643.452')] [2023-12-26 06:53:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000908896_232677376.pth... [2023-12-26 06:53:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000915248_234307584.pth... [2023-12-26 06:53:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000907840_232407040.pth [2023-12-26 06:53:53,799][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000908896_232677376.pth [2023-12-26 06:53:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000914224_234045440.pth [2023-12-26 06:53:53,800][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000915248_234307584.pth [2023-12-26 06:53:54,153][123091] Updated weights for policy 0, policy_version 915258 (0.0009) [2023-12-26 06:53:54,206][123091] Updated weights for policy 0, policy_version 915268 (0.0009) [2023-12-26 06:53:54,245][123090] Updated weights for policy 1, policy_version 908902 (0.0010) [2023-12-26 06:53:54,259][123091] Updated weights for policy 0, policy_version 915278 (0.0010) [2023-12-26 06:53:54,296][123090] Updated weights for policy 1, policy_version 908912 (0.0010) [2023-12-26 06:53:54,347][123090] Updated weights for policy 1, policy_version 908922 (0.0010) [2023-12-26 06:53:55,142][123091] Updated weights for policy 0, policy_version 915288 (0.0009) [2023-12-26 06:53:55,145][123090] Updated weights for policy 1, policy_version 908932 (0.0008) [2023-12-26 06:53:55,205][123091] Updated weights for policy 0, policy_version 915298 (0.0008) [2023-12-26 06:53:55,209][123090] Updated weights for policy 1, policy_version 908942 (0.0007) [2023-12-26 06:53:55,258][123091] Updated weights for policy 0, policy_version 915308 (0.0009) [2023-12-26 06:53:55,260][123090] Updated weights for policy 1, policy_version 908952 (0.0007) [2023-12-26 06:53:56,005][123090] Updated weights for policy 1, policy_version 908962 (0.0008) [2023-12-26 06:53:56,060][123090] Updated weights for policy 1, policy_version 908972 (0.0010) [2023-12-26 06:53:56,113][123090] Updated weights for policy 1, policy_version 908982 (0.0009) [2023-12-26 06:53:56,119][123091] Updated weights for policy 0, policy_version 915318 (0.0008) [2023-12-26 06:53:56,167][123090] Updated weights for policy 1, policy_version 908992 (0.0008) [2023-12-26 06:53:56,180][123091] Updated weights for policy 0, policy_version 915328 (0.0008) [2023-12-26 06:53:56,241][123091] Updated weights for policy 0, policy_version 915338 (0.0010) [2023-12-26 06:53:57,028][123090] Updated weights for policy 1, policy_version 909002 (0.0005) [2023-12-26 06:53:57,058][123091] Updated weights for policy 0, policy_version 915348 (0.0009) [2023-12-26 06:53:57,083][123090] Updated weights for policy 1, policy_version 909012 (0.0008) [2023-12-26 06:53:57,111][123091] Updated weights for policy 0, policy_version 915358 (0.0007) [2023-12-26 06:53:57,135][123090] Updated weights for policy 1, policy_version 909022 (0.0009) [2023-12-26 06:53:57,165][123091] Updated weights for policy 0, policy_version 915368 (0.0009) [2023-12-26 06:53:57,872][123090] Updated weights for policy 1, policy_version 909032 (0.0010) [2023-12-26 06:53:57,937][123090] Updated weights for policy 1, policy_version 909042 (0.0007) [2023-12-26 06:53:57,992][123090] Updated weights for policy 1, policy_version 909052 (0.0006) [2023-12-26 06:53:58,076][123091] Updated weights for policy 0, policy_version 915378 (0.0010) [2023-12-26 06:53:58,146][123091] Updated weights for policy 0, policy_version 915388 (0.0010) [2023-12-26 06:53:58,200][123091] Updated weights for policy 0, policy_version 915398 (0.0009) [2023-12-26 06:53:58,259][123091] Updated weights for policy 0, policy_version 915408 (0.0009) [2023-12-26 06:53:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 467066880. Throughput: 0: 8818.9, 1: 8890.7. Samples: 467064620. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:53:58,785][121949] Avg episode reward: [(0, '6359.439'), (1, '5758.210')] [2023-12-26 06:53:58,866][123090] Updated weights for policy 1, policy_version 909062 (0.0008) [2023-12-26 06:53:58,923][123090] Updated weights for policy 1, policy_version 909072 (0.0006) [2023-12-26 06:53:58,997][123090] Updated weights for policy 1, policy_version 909082 (0.0007) [2023-12-26 06:53:59,192][123091] Updated weights for policy 0, policy_version 915418 (0.0009) [2023-12-26 06:53:59,270][123091] Updated weights for policy 0, policy_version 915428 (0.0011) [2023-12-26 06:53:59,347][123091] Updated weights for policy 0, policy_version 915438 (0.0007) [2023-12-26 06:53:59,825][123090] Updated weights for policy 1, policy_version 909092 (0.0008) [2023-12-26 06:53:59,889][123090] Updated weights for policy 1, policy_version 909102 (0.0009) [2023-12-26 06:53:59,966][123090] Updated weights for policy 1, policy_version 909112 (0.0009) [2023-12-26 06:54:00,028][123091] Updated weights for policy 0, policy_version 915448 (0.0009) [2023-12-26 06:54:00,084][123091] Updated weights for policy 0, policy_version 915458 (0.0007) [2023-12-26 06:54:00,144][123091] Updated weights for policy 0, policy_version 915468 (0.0009) [2023-12-26 06:54:00,750][123090] Updated weights for policy 1, policy_version 909122 (0.0008) [2023-12-26 06:54:00,812][123090] Updated weights for policy 1, policy_version 909132 (0.0005) [2023-12-26 06:54:00,888][123090] Updated weights for policy 1, policy_version 909142 (0.0005) [2023-12-26 06:54:00,936][123090] Updated weights for policy 1, policy_version 909152 (0.0005) [2023-12-26 06:54:00,962][123091] Updated weights for policy 0, policy_version 915478 (0.0009) [2023-12-26 06:54:01,023][123091] Updated weights for policy 0, policy_version 915488 (0.0008) [2023-12-26 06:54:01,087][123091] Updated weights for policy 0, policy_version 915498 (0.0010) [2023-12-26 06:54:01,641][123090] Updated weights for policy 1, policy_version 909162 (0.0009) [2023-12-26 06:54:01,705][123090] Updated weights for policy 1, policy_version 909172 (0.0009) [2023-12-26 06:54:01,777][123090] Updated weights for policy 1, policy_version 909182 (0.0007) [2023-12-26 06:54:01,824][123091] Updated weights for policy 0, policy_version 915508 (0.0007) [2023-12-26 06:54:01,886][123091] Updated weights for policy 0, policy_version 915518 (0.0010) [2023-12-26 06:54:01,953][123091] Updated weights for policy 0, policy_version 915528 (0.0010) [2023-12-26 06:54:02,577][123090] Updated weights for policy 1, policy_version 909192 (0.0006) [2023-12-26 06:54:02,628][123090] Updated weights for policy 1, policy_version 909202 (0.0005) [2023-12-26 06:54:02,689][123090] Updated weights for policy 1, policy_version 909212 (0.0005) [2023-12-26 06:54:02,765][123091] Updated weights for policy 0, policy_version 915538 (0.0009) [2023-12-26 06:54:02,828][123091] Updated weights for policy 0, policy_version 915548 (0.0006) [2023-12-26 06:54:02,897][123091] Updated weights for policy 0, policy_version 915558 (0.0006) [2023-12-26 06:54:02,962][123091] Updated weights for policy 0, policy_version 915568 (0.0005) [2023-12-26 06:54:03,522][123090] Updated weights for policy 1, policy_version 909222 (0.0008) [2023-12-26 06:54:03,567][123091] Updated weights for policy 0, policy_version 915578 (0.0005) [2023-12-26 06:54:03,575][123090] Updated weights for policy 1, policy_version 909232 (0.0009) [2023-12-26 06:54:03,618][123091] Updated weights for policy 0, policy_version 915588 (0.0005) [2023-12-26 06:54:03,634][123090] Updated weights for policy 1, policy_version 909242 (0.0006) [2023-12-26 06:54:03,668][123091] Updated weights for policy 0, policy_version 915598 (0.0005) [2023-12-26 06:54:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 467165184. Throughput: 0: 8805.5, 1: 8962.4. Samples: 467171456. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:03,785][121949] Avg episode reward: [(0, '6365.361'), (1, '5719.395')] [2023-12-26 06:54:04,368][123091] Updated weights for policy 0, policy_version 915608 (0.0006) [2023-12-26 06:54:04,438][123091] Updated weights for policy 0, policy_version 915618 (0.0006) [2023-12-26 06:54:04,488][123091] Updated weights for policy 0, policy_version 915628 (0.0008) [2023-12-26 06:54:04,541][123090] Updated weights for policy 1, policy_version 909252 (0.0007) [2023-12-26 06:54:04,607][123090] Updated weights for policy 1, policy_version 909262 (0.0009) [2023-12-26 06:54:04,682][123090] Updated weights for policy 1, policy_version 909272 (0.0010) [2023-12-26 06:54:05,254][123091] Updated weights for policy 0, policy_version 915639 (0.0009) [2023-12-26 06:54:05,305][123091] Updated weights for policy 0, policy_version 915649 (0.0009) [2023-12-26 06:54:05,345][123090] Updated weights for policy 1, policy_version 909282 (0.0009) [2023-12-26 06:54:05,353][123091] Updated weights for policy 0, policy_version 915659 (0.0008) [2023-12-26 06:54:05,396][123090] Updated weights for policy 1, policy_version 909292 (0.0006) [2023-12-26 06:54:05,451][123090] Updated weights for policy 1, policy_version 909302 (0.0009) [2023-12-26 06:54:05,508][123090] Updated weights for policy 1, policy_version 909312 (0.0009) [2023-12-26 06:54:06,242][123091] Updated weights for policy 0, policy_version 915669 (0.0007) [2023-12-26 06:54:06,307][123091] Updated weights for policy 0, policy_version 915679 (0.0008) [2023-12-26 06:54:06,311][123090] Updated weights for policy 1, policy_version 909322 (0.0009) [2023-12-26 06:54:06,363][123090] Updated weights for policy 1, policy_version 909332 (0.0010) [2023-12-26 06:54:06,365][123091] Updated weights for policy 0, policy_version 915689 (0.0008) [2023-12-26 06:54:06,419][123090] Updated weights for policy 1, policy_version 909342 (0.0007) [2023-12-26 06:54:07,203][123090] Updated weights for policy 1, policy_version 909352 (0.0010) [2023-12-26 06:54:07,229][123091] Updated weights for policy 0, policy_version 915699 (0.0010) [2023-12-26 06:54:07,261][123090] Updated weights for policy 1, policy_version 909362 (0.0008) [2023-12-26 06:54:07,284][123091] Updated weights for policy 0, policy_version 915709 (0.0008) [2023-12-26 06:54:07,326][123090] Updated weights for policy 1, policy_version 909372 (0.0009) [2023-12-26 06:54:07,344][123091] Updated weights for policy 0, policy_version 915719 (0.0008) [2023-12-26 06:54:08,135][123090] Updated weights for policy 1, policy_version 909382 (0.0006) [2023-12-26 06:54:08,194][123090] Updated weights for policy 1, policy_version 909392 (0.0010) [2023-12-26 06:54:08,202][123091] Updated weights for policy 0, policy_version 915729 (0.0009) [2023-12-26 06:54:08,246][123090] Updated weights for policy 1, policy_version 909402 (0.0010) [2023-12-26 06:54:08,265][123091] Updated weights for policy 0, policy_version 915739 (0.0006) [2023-12-26 06:54:08,325][123091] Updated weights for policy 0, policy_version 915749 (0.0006) [2023-12-26 06:54:08,387][123091] Updated weights for policy 0, policy_version 915759 (0.0007) [2023-12-26 06:54:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 467247104. Throughput: 0: 8807.4, 1: 8974.9. Samples: 467224788. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:08,785][121949] Avg episode reward: [(0, '6283.469'), (1, '5791.510')] [2023-12-26 06:54:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000915760_234438656.pth... [2023-12-26 06:54:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000909408_232808448.pth... [2023-12-26 06:54:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000914736_234176512.pth [2023-12-26 06:54:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000908384_232546304.pth [2023-12-26 06:54:09,093][123090] Updated weights for policy 1, policy_version 909412 (0.0009) [2023-12-26 06:54:09,095][123091] Updated weights for policy 0, policy_version 915769 (0.0005) [2023-12-26 06:54:09,157][123091] Updated weights for policy 0, policy_version 915779 (0.0006) [2023-12-26 06:54:09,159][123090] Updated weights for policy 1, policy_version 909422 (0.0009) [2023-12-26 06:54:09,218][123091] Updated weights for policy 0, policy_version 915789 (0.0006) [2023-12-26 06:54:09,224][123090] Updated weights for policy 1, policy_version 909432 (0.0010) [2023-12-26 06:54:10,002][123091] Updated weights for policy 0, policy_version 915799 (0.0006) [2023-12-26 06:54:10,051][123091] Updated weights for policy 0, policy_version 915809 (0.0006) [2023-12-26 06:54:10,119][123091] Updated weights for policy 0, policy_version 915819 (0.0009) [2023-12-26 06:54:10,134][123090] Updated weights for policy 1, policy_version 909442 (0.0010) [2023-12-26 06:54:10,193][123090] Updated weights for policy 1, policy_version 909452 (0.0009) [2023-12-26 06:54:10,263][123090] Updated weights for policy 1, policy_version 909462 (0.0009) [2023-12-26 06:54:10,330][123090] Updated weights for policy 1, policy_version 909472 (0.0009) [2023-12-26 06:54:10,823][123091] Updated weights for policy 0, policy_version 915829 (0.0006) [2023-12-26 06:54:10,889][123091] Updated weights for policy 0, policy_version 915839 (0.0006) [2023-12-26 06:54:10,945][123091] Updated weights for policy 0, policy_version 915849 (0.0005) [2023-12-26 06:54:11,104][123090] Updated weights for policy 1, policy_version 909482 (0.0007) [2023-12-26 06:54:11,176][123090] Updated weights for policy 1, policy_version 909492 (0.0008) [2023-12-26 06:54:11,250][123090] Updated weights for policy 1, policy_version 909502 (0.0009) [2023-12-26 06:54:11,701][123091] Updated weights for policy 0, policy_version 915859 (0.0007) [2023-12-26 06:54:11,774][123091] Updated weights for policy 0, policy_version 915869 (0.0010) [2023-12-26 06:54:11,834][123091] Updated weights for policy 0, policy_version 915879 (0.0010) [2023-12-26 06:54:11,998][123090] Updated weights for policy 1, policy_version 909512 (0.0009) [2023-12-26 06:54:12,065][123090] Updated weights for policy 1, policy_version 909522 (0.0010) [2023-12-26 06:54:12,133][123090] Updated weights for policy 1, policy_version 909532 (0.0009) [2023-12-26 06:54:12,701][123091] Updated weights for policy 0, policy_version 915889 (0.0010) [2023-12-26 06:54:12,758][123091] Updated weights for policy 0, policy_version 915899 (0.0009) [2023-12-26 06:54:12,818][123091] Updated weights for policy 0, policy_version 915909 (0.0010) [2023-12-26 06:54:12,885][123091] Updated weights for policy 0, policy_version 915919 (0.0010) [2023-12-26 06:54:12,985][123090] Updated weights for policy 1, policy_version 909542 (0.0010) [2023-12-26 06:54:13,050][123090] Updated weights for policy 1, policy_version 909552 (0.0010) [2023-12-26 06:54:13,118][123090] Updated weights for policy 1, policy_version 909562 (0.0010) [2023-12-26 06:54:13,650][123091] Updated weights for policy 0, policy_version 915929 (0.0010) [2023-12-26 06:54:13,714][123091] Updated weights for policy 0, policy_version 915939 (0.0010) [2023-12-26 06:54:13,779][123091] Updated weights for policy 0, policy_version 915949 (0.0010) [2023-12-26 06:54:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 467329024. Throughput: 0: 8773.7, 1: 8885.7. Samples: 467329684. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:13,785][121949] Avg episode reward: [(0, '6302.536'), (1, '5913.334')] [2023-12-26 06:54:13,981][123090] Updated weights for policy 1, policy_version 909572 (0.0010) [2023-12-26 06:54:14,035][123090] Updated weights for policy 1, policy_version 909582 (0.0008) [2023-12-26 06:54:14,088][123090] Updated weights for policy 1, policy_version 909592 (0.0009) [2023-12-26 06:54:14,599][123091] Updated weights for policy 0, policy_version 915959 (0.0010) [2023-12-26 06:54:14,661][123091] Updated weights for policy 0, policy_version 915969 (0.0007) [2023-12-26 06:54:14,725][123091] Updated weights for policy 0, policy_version 915979 (0.0010) [2023-12-26 06:54:14,952][123090] Updated weights for policy 1, policy_version 909602 (0.0009) [2023-12-26 06:54:15,008][123090] Updated weights for policy 1, policy_version 909612 (0.0010) [2023-12-26 06:54:15,072][123090] Updated weights for policy 1, policy_version 909622 (0.0010) [2023-12-26 06:54:15,128][123090] Updated weights for policy 1, policy_version 909632 (0.0009) [2023-12-26 06:54:15,485][123091] Updated weights for policy 0, policy_version 915989 (0.0009) [2023-12-26 06:54:15,535][123091] Updated weights for policy 0, policy_version 915999 (0.0010) [2023-12-26 06:54:15,596][123091] Updated weights for policy 0, policy_version 916009 (0.0010) [2023-12-26 06:54:16,012][123090] Updated weights for policy 1, policy_version 909642 (0.0010) [2023-12-26 06:54:16,075][123090] Updated weights for policy 1, policy_version 909652 (0.0010) [2023-12-26 06:54:16,150][123090] Updated weights for policy 1, policy_version 909662 (0.0009) [2023-12-26 06:54:16,352][123091] Updated weights for policy 0, policy_version 916019 (0.0010) [2023-12-26 06:54:16,419][123091] Updated weights for policy 0, policy_version 916029 (0.0008) [2023-12-26 06:54:16,485][123091] Updated weights for policy 0, policy_version 916039 (0.0005) [2023-12-26 06:54:17,035][123090] Updated weights for policy 1, policy_version 909672 (0.0010) [2023-12-26 06:54:17,090][123090] Updated weights for policy 1, policy_version 909682 (0.0009) [2023-12-26 06:54:17,106][123091] Updated weights for policy 0, policy_version 916049 (0.0005) [2023-12-26 06:54:17,150][123090] Updated weights for policy 1, policy_version 909693 (0.0010) [2023-12-26 06:54:17,154][123091] Updated weights for policy 0, policy_version 916059 (0.0005) [2023-12-26 06:54:17,210][123091] Updated weights for policy 0, policy_version 916069 (0.0007) [2023-12-26 06:54:17,279][123091] Updated weights for policy 0, policy_version 916079 (0.0007) [2023-12-26 06:54:18,038][123090] Updated weights for policy 1, policy_version 909704 (0.0008) [2023-12-26 06:54:18,046][123091] Updated weights for policy 0, policy_version 916089 (0.0010) [2023-12-26 06:54:18,096][123090] Updated weights for policy 1, policy_version 909714 (0.0007) [2023-12-26 06:54:18,105][123091] Updated weights for policy 0, policy_version 916099 (0.0011) [2023-12-26 06:54:18,146][123090] Updated weights for policy 1, policy_version 909724 (0.0008) [2023-12-26 06:54:18,161][123091] Updated weights for policy 0, policy_version 916109 (0.0011) [2023-12-26 06:54:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 467419136. Throughput: 0: 8805.3, 1: 8793.9. Samples: 467434160. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:18,785][121949] Avg episode reward: [(0, '6307.631'), (1, '5880.032')] [2023-12-26 06:54:18,913][123091] Updated weights for policy 0, policy_version 916119 (0.0008) [2023-12-26 06:54:18,976][123091] Updated weights for policy 0, policy_version 916129 (0.0008) [2023-12-26 06:54:18,984][123090] Updated weights for policy 1, policy_version 909734 (0.0007) [2023-12-26 06:54:19,036][123091] Updated weights for policy 0, policy_version 916139 (0.0008) [2023-12-26 06:54:19,046][123090] Updated weights for policy 1, policy_version 909744 (0.0009) [2023-12-26 06:54:19,103][123090] Updated weights for policy 1, policy_version 909754 (0.0009) [2023-12-26 06:54:19,809][123091] Updated weights for policy 0, policy_version 916149 (0.0008) [2023-12-26 06:54:19,876][123091] Updated weights for policy 0, policy_version 916159 (0.0009) [2023-12-26 06:54:19,940][123091] Updated weights for policy 0, policy_version 916169 (0.0007) [2023-12-26 06:54:20,001][123090] Updated weights for policy 1, policy_version 909764 (0.0009) [2023-12-26 06:54:20,072][123090] Updated weights for policy 1, policy_version 909774 (0.0008) [2023-12-26 06:54:20,140][123090] Updated weights for policy 1, policy_version 909784 (0.0008) [2023-12-26 06:54:20,717][123091] Updated weights for policy 0, policy_version 916179 (0.0008) [2023-12-26 06:54:20,768][123091] Updated weights for policy 0, policy_version 916189 (0.0009) [2023-12-26 06:54:20,823][123091] Updated weights for policy 0, policy_version 916199 (0.0009) [2023-12-26 06:54:20,911][123090] Updated weights for policy 1, policy_version 909794 (0.0008) [2023-12-26 06:54:20,984][123090] Updated weights for policy 1, policy_version 909804 (0.0009) [2023-12-26 06:54:21,057][123090] Updated weights for policy 1, policy_version 909814 (0.0009) [2023-12-26 06:54:21,134][123090] Updated weights for policy 1, policy_version 909824 (0.0007) [2023-12-26 06:54:21,661][123091] Updated weights for policy 0, policy_version 916209 (0.0009) [2023-12-26 06:54:21,728][123091] Updated weights for policy 0, policy_version 916219 (0.0010) [2023-12-26 06:54:21,805][123091] Updated weights for policy 0, policy_version 916229 (0.0010) [2023-12-26 06:54:21,873][123091] Updated weights for policy 0, policy_version 916239 (0.0010) [2023-12-26 06:54:21,978][123090] Updated weights for policy 1, policy_version 909834 (0.0009) [2023-12-26 06:54:22,043][123090] Updated weights for policy 1, policy_version 909844 (0.0009) [2023-12-26 06:54:22,108][123090] Updated weights for policy 1, policy_version 909854 (0.0008) [2023-12-26 06:54:22,689][123091] Updated weights for policy 0, policy_version 916249 (0.0010) [2023-12-26 06:54:22,743][123091] Updated weights for policy 0, policy_version 916259 (0.0010) [2023-12-26 06:54:22,807][123091] Updated weights for policy 0, policy_version 916269 (0.0009) [2023-12-26 06:54:22,928][123090] Updated weights for policy 1, policy_version 909864 (0.0010) [2023-12-26 06:54:22,989][123090] Updated weights for policy 1, policy_version 909874 (0.0009) [2023-12-26 06:54:23,045][123090] Updated weights for policy 1, policy_version 909884 (0.0009) [2023-12-26 06:54:23,651][123091] Updated weights for policy 0, policy_version 916279 (0.0010) [2023-12-26 06:54:23,705][123091] Updated weights for policy 0, policy_version 916291 (0.0010) [2023-12-26 06:54:23,752][123091] Updated weights for policy 0, policy_version 916301 (0.0009) [2023-12-26 06:54:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 467509248. Throughput: 0: 8805.4, 1: 8729.9. Samples: 467486504. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:23,785][121949] Avg episode reward: [(0, '6331.076'), (1, '5723.456')] [2023-12-26 06:54:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000916304_234577920.pth... [2023-12-26 06:54:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000909888_232931328.pth... [2023-12-26 06:54:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000908896_232677376.pth [2023-12-26 06:54:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000915248_234307584.pth [2023-12-26 06:54:23,870][123090] Updated weights for policy 1, policy_version 909894 (0.0008) [2023-12-26 06:54:23,921][123090] Updated weights for policy 1, policy_version 909904 (0.0009) [2023-12-26 06:54:23,989][123090] Updated weights for policy 1, policy_version 909914 (0.0009) [2023-12-26 06:54:24,588][123091] Updated weights for policy 0, policy_version 916311 (0.0010) [2023-12-26 06:54:24,647][123091] Updated weights for policy 0, policy_version 916321 (0.0010) [2023-12-26 06:54:24,704][123091] Updated weights for policy 0, policy_version 916331 (0.0009) [2023-12-26 06:54:24,797][123090] Updated weights for policy 1, policy_version 909924 (0.0009) [2023-12-26 06:54:24,852][123090] Updated weights for policy 1, policy_version 909934 (0.0009) [2023-12-26 06:54:24,899][123090] Updated weights for policy 1, policy_version 909944 (0.0009) [2023-12-26 06:54:25,536][123091] Updated weights for policy 0, policy_version 916341 (0.0009) [2023-12-26 06:54:25,598][123091] Updated weights for policy 0, policy_version 916351 (0.0009) [2023-12-26 06:54:25,648][123091] Updated weights for policy 0, policy_version 916361 (0.0009) [2023-12-26 06:54:25,752][123090] Updated weights for policy 1, policy_version 909954 (0.0009) [2023-12-26 06:54:25,801][123090] Updated weights for policy 1, policy_version 909964 (0.0009) [2023-12-26 06:54:25,859][123090] Updated weights for policy 1, policy_version 909974 (0.0009) [2023-12-26 06:54:25,906][123090] Updated weights for policy 1, policy_version 909984 (0.0009) [2023-12-26 06:54:26,479][123091] Updated weights for policy 0, policy_version 916372 (0.0009) [2023-12-26 06:54:26,529][123091] Updated weights for policy 0, policy_version 916382 (0.0009) [2023-12-26 06:54:26,578][123091] Updated weights for policy 0, policy_version 916392 (0.0009) [2023-12-26 06:54:26,779][123090] Updated weights for policy 1, policy_version 909994 (0.0009) [2023-12-26 06:54:26,839][123090] Updated weights for policy 1, policy_version 910004 (0.0009) [2023-12-26 06:54:26,897][123090] Updated weights for policy 1, policy_version 910014 (0.0009) [2023-12-26 06:54:27,424][123091] Updated weights for policy 0, policy_version 916402 (0.0009) [2023-12-26 06:54:27,481][123091] Updated weights for policy 0, policy_version 916412 (0.0009) [2023-12-26 06:54:27,532][123091] Updated weights for policy 0, policy_version 916422 (0.0009) [2023-12-26 06:54:27,592][123091] Updated weights for policy 0, policy_version 916432 (0.0009) [2023-12-26 06:54:27,719][123090] Updated weights for policy 1, policy_version 910024 (0.0010) [2023-12-26 06:54:27,787][123090] Updated weights for policy 1, policy_version 910034 (0.0010) [2023-12-26 06:54:27,866][123090] Updated weights for policy 1, policy_version 910044 (0.0010) [2023-12-26 06:54:28,349][123091] Updated weights for policy 0, policy_version 916442 (0.0009) [2023-12-26 06:54:28,415][123091] Updated weights for policy 0, policy_version 916452 (0.0008) [2023-12-26 06:54:28,466][123091] Updated weights for policy 0, policy_version 916462 (0.0008) [2023-12-26 06:54:28,728][123090] Updated weights for policy 1, policy_version 910054 (0.0009) [2023-12-26 06:54:28,778][123090] Updated weights for policy 1, policy_version 910064 (0.0008) [2023-12-26 06:54:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 467591168. Throughput: 0: 8794.7, 1: 8720.5. Samples: 467588092. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:28,785][121949] Avg episode reward: [(0, '6287.546'), (1, '5604.286')] [2023-12-26 06:54:28,826][123090] Updated weights for policy 1, policy_version 910074 (0.0009) [2023-12-26 06:54:29,223][123091] Updated weights for policy 0, policy_version 916472 (0.0009) [2023-12-26 06:54:29,295][123091] Updated weights for policy 0, policy_version 916482 (0.0008) [2023-12-26 06:54:29,366][123091] Updated weights for policy 0, policy_version 916492 (0.0009) [2023-12-26 06:54:29,632][123090] Updated weights for policy 1, policy_version 910084 (0.0007) [2023-12-26 06:54:29,689][123090] Updated weights for policy 1, policy_version 910094 (0.0005) [2023-12-26 06:54:29,739][123090] Updated weights for policy 1, policy_version 910104 (0.0005) [2023-12-26 06:54:30,073][123091] Updated weights for policy 0, policy_version 916502 (0.0009) [2023-12-26 06:54:30,141][123091] Updated weights for policy 0, policy_version 916512 (0.0009) [2023-12-26 06:54:30,191][123091] Updated weights for policy 0, policy_version 916522 (0.0009) [2023-12-26 06:54:30,471][123090] Updated weights for policy 1, policy_version 910114 (0.0007) [2023-12-26 06:54:30,526][123090] Updated weights for policy 1, policy_version 910124 (0.0009) [2023-12-26 06:54:30,577][123090] Updated weights for policy 1, policy_version 910134 (0.0009) [2023-12-26 06:54:30,638][123090] Updated weights for policy 1, policy_version 910144 (0.0009) [2023-12-26 06:54:31,057][123091] Updated weights for policy 0, policy_version 916532 (0.0009) [2023-12-26 06:54:31,129][123091] Updated weights for policy 0, policy_version 916542 (0.0008) [2023-12-26 06:54:31,191][123091] Updated weights for policy 0, policy_version 916552 (0.0008) [2023-12-26 06:54:31,403][123090] Updated weights for policy 1, policy_version 910154 (0.0008) [2023-12-26 06:54:31,472][123090] Updated weights for policy 1, policy_version 910164 (0.0008) [2023-12-26 06:54:31,540][123090] Updated weights for policy 1, policy_version 910174 (0.0006) [2023-12-26 06:54:32,013][123091] Updated weights for policy 0, policy_version 916562 (0.0007) [2023-12-26 06:54:32,074][123091] Updated weights for policy 0, policy_version 916573 (0.0010) [2023-12-26 06:54:32,140][123091] Updated weights for policy 0, policy_version 916583 (0.0010) [2023-12-26 06:54:32,310][123090] Updated weights for policy 1, policy_version 910184 (0.0007) [2023-12-26 06:54:32,383][123090] Updated weights for policy 1, policy_version 910194 (0.0007) [2023-12-26 06:54:32,452][123090] Updated weights for policy 1, policy_version 910204 (0.0008) [2023-12-26 06:54:32,877][123091] Updated weights for policy 0, policy_version 916593 (0.0010) [2023-12-26 06:54:32,929][123091] Updated weights for policy 0, policy_version 916603 (0.0005) [2023-12-26 06:54:32,981][123091] Updated weights for policy 0, policy_version 916613 (0.0005) [2023-12-26 06:54:33,029][123091] Updated weights for policy 0, policy_version 916623 (0.0005) [2023-12-26 06:54:33,284][123090] Updated weights for policy 1, policy_version 910214 (0.0009) [2023-12-26 06:54:33,335][123090] Updated weights for policy 1, policy_version 910224 (0.0009) [2023-12-26 06:54:33,384][123090] Updated weights for policy 1, policy_version 910234 (0.0009) [2023-12-26 06:54:33,693][123091] Updated weights for policy 0, policy_version 916633 (0.0005) [2023-12-26 06:54:33,754][123091] Updated weights for policy 0, policy_version 916643 (0.0005) [2023-12-26 06:54:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 467681280. Throughput: 0: 8829.5, 1: 8641.0. Samples: 467695216. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:33,784][121949] Avg episode reward: [(0, '6182.178'), (1, '5666.638')] [2023-12-26 06:54:33,804][123091] Updated weights for policy 0, policy_version 916653 (0.0005) [2023-12-26 06:54:34,346][123090] Updated weights for policy 1, policy_version 910244 (0.0009) [2023-12-26 06:54:34,410][123090] Updated weights for policy 1, policy_version 910254 (0.0009) [2023-12-26 06:54:34,434][123091] Updated weights for policy 0, policy_version 916663 (0.0005) [2023-12-26 06:54:34,466][123090] Updated weights for policy 1, policy_version 910264 (0.0009) [2023-12-26 06:54:34,503][123091] Updated weights for policy 0, policy_version 916673 (0.0006) [2023-12-26 06:54:34,569][123091] Updated weights for policy 0, policy_version 916683 (0.0006) [2023-12-26 06:54:35,326][123090] Updated weights for policy 1, policy_version 910274 (0.0009) [2023-12-26 06:54:35,328][123091] Updated weights for policy 0, policy_version 916693 (0.0008) [2023-12-26 06:54:35,377][123090] Updated weights for policy 1, policy_version 910284 (0.0006) [2023-12-26 06:54:35,386][123091] Updated weights for policy 0, policy_version 916703 (0.0010) [2023-12-26 06:54:35,427][123090] Updated weights for policy 1, policy_version 910294 (0.0007) [2023-12-26 06:54:35,441][123091] Updated weights for policy 0, policy_version 916713 (0.0010) [2023-12-26 06:54:35,483][123090] Updated weights for policy 1, policy_version 910304 (0.0007) [2023-12-26 06:54:36,211][123091] Updated weights for policy 0, policy_version 916723 (0.0010) [2023-12-26 06:54:36,270][123091] Updated weights for policy 0, policy_version 916733 (0.0008) [2023-12-26 06:54:36,337][123091] Updated weights for policy 0, policy_version 916743 (0.0009) [2023-12-26 06:54:36,362][123090] Updated weights for policy 1, policy_version 910314 (0.0007) [2023-12-26 06:54:36,418][123090] Updated weights for policy 1, policy_version 910324 (0.0009) [2023-12-26 06:54:36,477][123090] Updated weights for policy 1, policy_version 910334 (0.0010) [2023-12-26 06:54:37,177][123091] Updated weights for policy 0, policy_version 916753 (0.0007) [2023-12-26 06:54:37,237][123091] Updated weights for policy 0, policy_version 916763 (0.0005) [2023-12-26 06:54:37,272][123090] Updated weights for policy 1, policy_version 910344 (0.0009) [2023-12-26 06:54:37,300][123091] Updated weights for policy 0, policy_version 916773 (0.0005) [2023-12-26 06:54:37,333][123090] Updated weights for policy 1, policy_version 910354 (0.0009) [2023-12-26 06:54:37,372][123091] Updated weights for policy 0, policy_version 916783 (0.0005) [2023-12-26 06:54:37,393][123090] Updated weights for policy 1, policy_version 910364 (0.0009) [2023-12-26 06:54:38,027][123091] Updated weights for policy 0, policy_version 916793 (0.0008) [2023-12-26 06:54:38,084][123091] Updated weights for policy 0, policy_version 916803 (0.0006) [2023-12-26 06:54:38,149][123091] Updated weights for policy 0, policy_version 916813 (0.0010) [2023-12-26 06:54:38,247][123090] Updated weights for policy 1, policy_version 910374 (0.0007) [2023-12-26 06:54:38,316][123090] Updated weights for policy 1, policy_version 910384 (0.0006) [2023-12-26 06:54:38,384][123090] Updated weights for policy 1, policy_version 910394 (0.0007) [2023-12-26 06:54:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 467771392. Throughput: 0: 8884.0, 1: 8599.7. Samples: 467747904. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:38,785][121949] Avg episode reward: [(0, '6240.816'), (1, '5798.391')] [2023-12-26 06:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000916816_234708992.pth... [2023-12-26 06:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000910400_233062400.pth... [2023-12-26 06:54:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000915760_234438656.pth [2023-12-26 06:54:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000909408_232808448.pth [2023-12-26 06:54:38,985][123091] Updated weights for policy 0, policy_version 916823 (0.0006) [2023-12-26 06:54:39,038][123091] Updated weights for policy 0, policy_version 916833 (0.0009) [2023-12-26 06:54:39,094][123091] Updated weights for policy 0, policy_version 916843 (0.0009) [2023-12-26 06:54:39,207][123090] Updated weights for policy 1, policy_version 910404 (0.0010) [2023-12-26 06:54:39,274][123090] Updated weights for policy 1, policy_version 910414 (0.0009) [2023-12-26 06:54:39,342][123090] Updated weights for policy 1, policy_version 910424 (0.0011) [2023-12-26 06:54:39,984][123091] Updated weights for policy 0, policy_version 916853 (0.0009) [2023-12-26 06:54:40,049][123091] Updated weights for policy 0, policy_version 916863 (0.0009) [2023-12-26 06:54:40,115][123091] Updated weights for policy 0, policy_version 916873 (0.0009) [2023-12-26 06:54:40,239][123090] Updated weights for policy 1, policy_version 910434 (0.0010) [2023-12-26 06:54:40,289][123090] Updated weights for policy 1, policy_version 910444 (0.0009) [2023-12-26 06:54:40,342][123090] Updated weights for policy 1, policy_version 910454 (0.0009) [2023-12-26 06:54:40,404][123090] Updated weights for policy 1, policy_version 910464 (0.0009) [2023-12-26 06:54:40,965][123091] Updated weights for policy 0, policy_version 916883 (0.0009) [2023-12-26 06:54:41,017][123091] Updated weights for policy 0, policy_version 916893 (0.0009) [2023-12-26 06:54:41,099][123091] Updated weights for policy 0, policy_version 916903 (0.0010) [2023-12-26 06:54:41,265][123090] Updated weights for policy 1, policy_version 910474 (0.0011) [2023-12-26 06:54:41,337][123090] Updated weights for policy 1, policy_version 910484 (0.0011) [2023-12-26 06:54:41,413][123090] Updated weights for policy 1, policy_version 910494 (0.0010) [2023-12-26 06:54:41,962][123091] Updated weights for policy 0, policy_version 916913 (0.0010) [2023-12-26 06:54:42,021][123091] Updated weights for policy 0, policy_version 916923 (0.0009) [2023-12-26 06:54:42,078][123091] Updated weights for policy 0, policy_version 916933 (0.0009) [2023-12-26 06:54:42,142][123091] Updated weights for policy 0, policy_version 916943 (0.0009) [2023-12-26 06:54:42,158][123090] Updated weights for policy 1, policy_version 910504 (0.0008) [2023-12-26 06:54:42,214][123090] Updated weights for policy 1, policy_version 910514 (0.0011) [2023-12-26 06:54:42,279][123090] Updated weights for policy 1, policy_version 910524 (0.0011) [2023-12-26 06:54:42,969][123091] Updated weights for policy 0, policy_version 916953 (0.0006) [2023-12-26 06:54:43,030][123091] Updated weights for policy 0, policy_version 916963 (0.0006) [2023-12-26 06:54:43,087][123091] Updated weights for policy 0, policy_version 916973 (0.0009) [2023-12-26 06:54:43,111][123090] Updated weights for policy 1, policy_version 910534 (0.0010) [2023-12-26 06:54:43,160][123090] Updated weights for policy 1, policy_version 910544 (0.0010) [2023-12-26 06:54:43,216][123090] Updated weights for policy 1, policy_version 910554 (0.0011) [2023-12-26 06:54:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 467853312. Throughput: 0: 8924.0, 1: 8532.4. Samples: 467850156. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:43,785][121949] Avg episode reward: [(0, '6258.560'), (1, '5662.512')] [2023-12-26 06:54:43,885][123091] Updated weights for policy 0, policy_version 916983 (0.0006) [2023-12-26 06:54:43,938][123091] Updated weights for policy 0, policy_version 916993 (0.0005) [2023-12-26 06:54:43,986][123091] Updated weights for policy 0, policy_version 917003 (0.0007) [2023-12-26 06:54:44,082][123090] Updated weights for policy 1, policy_version 910564 (0.0009) [2023-12-26 06:54:44,131][123090] Updated weights for policy 1, policy_version 910574 (0.0005) [2023-12-26 06:54:44,179][123090] Updated weights for policy 1, policy_version 910584 (0.0005) [2023-12-26 06:54:44,698][123091] Updated weights for policy 0, policy_version 917013 (0.0005) [2023-12-26 06:54:44,763][123091] Updated weights for policy 0, policy_version 917023 (0.0008) [2023-12-26 06:54:44,826][123091] Updated weights for policy 0, policy_version 917033 (0.0008) [2023-12-26 06:54:44,878][123090] Updated weights for policy 1, policy_version 910594 (0.0006) [2023-12-26 06:54:44,930][123090] Updated weights for policy 1, policy_version 910604 (0.0009) [2023-12-26 06:54:44,996][123090] Updated weights for policy 1, policy_version 910614 (0.0009) [2023-12-26 06:54:45,065][123090] Updated weights for policy 1, policy_version 910624 (0.0009) [2023-12-26 06:54:45,550][123091] Updated weights for policy 0, policy_version 917043 (0.0009) [2023-12-26 06:54:45,611][123091] Updated weights for policy 0, policy_version 917053 (0.0009) [2023-12-26 06:54:45,672][123091] Updated weights for policy 0, policy_version 917063 (0.0009) [2023-12-26 06:54:45,888][123090] Updated weights for policy 1, policy_version 910634 (0.0010) [2023-12-26 06:54:45,944][123090] Updated weights for policy 1, policy_version 910644 (0.0010) [2023-12-26 06:54:46,010][123090] Updated weights for policy 1, policy_version 910654 (0.0010) [2023-12-26 06:54:46,461][123091] Updated weights for policy 0, policy_version 917073 (0.0009) [2023-12-26 06:54:46,520][123091] Updated weights for policy 0, policy_version 917083 (0.0008) [2023-12-26 06:54:46,580][123091] Updated weights for policy 0, policy_version 917093 (0.0006) [2023-12-26 06:54:46,640][123091] Updated weights for policy 0, policy_version 917103 (0.0006) [2023-12-26 06:54:46,814][123090] Updated weights for policy 1, policy_version 910664 (0.0009) [2023-12-26 06:54:46,869][123090] Updated weights for policy 1, policy_version 910674 (0.0010) [2023-12-26 06:54:46,913][123090] Updated weights for policy 1, policy_version 910684 (0.0010) [2023-12-26 06:54:47,314][123091] Updated weights for policy 0, policy_version 917113 (0.0005) [2023-12-26 06:54:47,374][123091] Updated weights for policy 0, policy_version 917123 (0.0005) [2023-12-26 06:54:47,423][123091] Updated weights for policy 0, policy_version 917133 (0.0005) [2023-12-26 06:54:47,663][123090] Updated weights for policy 1, policy_version 910694 (0.0007) [2023-12-26 06:54:47,724][123090] Updated weights for policy 1, policy_version 910704 (0.0005) [2023-12-26 06:54:47,779][123090] Updated weights for policy 1, policy_version 910714 (0.0005) [2023-12-26 06:54:48,288][123091] Updated weights for policy 0, policy_version 917143 (0.0010) [2023-12-26 06:54:48,344][123091] Updated weights for policy 0, policy_version 917154 (0.0010) [2023-12-26 06:54:48,410][123091] Updated weights for policy 0, policy_version 917164 (0.0009) [2023-12-26 06:54:48,429][123090] Updated weights for policy 1, policy_version 910724 (0.0005) [2023-12-26 06:54:48,501][123090] Updated weights for policy 1, policy_version 910734 (0.0011) [2023-12-26 06:54:48,569][123090] Updated weights for policy 1, policy_version 910744 (0.0011) [2023-12-26 06:54:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 467951616. Throughput: 0: 8944.8, 1: 8580.8. Samples: 467960108. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:48,785][121949] Avg episode reward: [(0, '6213.572'), (1, '5648.488')] [2023-12-26 06:54:49,252][123091] Updated weights for policy 0, policy_version 917174 (0.0009) [2023-12-26 06:54:49,321][123091] Updated weights for policy 0, policy_version 917184 (0.0009) [2023-12-26 06:54:49,391][123091] Updated weights for policy 0, policy_version 917194 (0.0009) [2023-12-26 06:54:49,418][123090] Updated weights for policy 1, policy_version 910754 (0.0010) [2023-12-26 06:54:49,478][123090] Updated weights for policy 1, policy_version 910764 (0.0009) [2023-12-26 06:54:49,544][123090] Updated weights for policy 1, policy_version 910774 (0.0009) [2023-12-26 06:54:49,606][123090] Updated weights for policy 1, policy_version 910784 (0.0009) [2023-12-26 06:54:50,209][123091] Updated weights for policy 0, policy_version 917204 (0.0008) [2023-12-26 06:54:50,272][123091] Updated weights for policy 0, policy_version 917214 (0.0007) [2023-12-26 06:54:50,335][123091] Updated weights for policy 0, policy_version 917224 (0.0005) [2023-12-26 06:54:50,453][123090] Updated weights for policy 1, policy_version 910794 (0.0005) [2023-12-26 06:54:50,523][123090] Updated weights for policy 1, policy_version 910804 (0.0006) [2023-12-26 06:54:50,584][123090] Updated weights for policy 1, policy_version 910814 (0.0010) [2023-12-26 06:54:51,025][123091] Updated weights for policy 0, policy_version 917234 (0.0006) [2023-12-26 06:54:51,091][123091] Updated weights for policy 0, policy_version 917244 (0.0009) [2023-12-26 06:54:51,155][123091] Updated weights for policy 0, policy_version 917254 (0.0010) [2023-12-26 06:54:51,212][123091] Updated weights for policy 0, policy_version 917264 (0.0009) [2023-12-26 06:54:51,443][123090] Updated weights for policy 1, policy_version 910824 (0.0010) [2023-12-26 06:54:51,512][123090] Updated weights for policy 1, policy_version 910834 (0.0007) [2023-12-26 06:54:51,586][123090] Updated weights for policy 1, policy_version 910844 (0.0006) [2023-12-26 06:54:52,045][123091] Updated weights for policy 0, policy_version 917274 (0.0009) [2023-12-26 06:54:52,099][123091] Updated weights for policy 0, policy_version 917284 (0.0009) [2023-12-26 06:54:52,161][123091] Updated weights for policy 0, policy_version 917294 (0.0008) [2023-12-26 06:54:52,345][123090] Updated weights for policy 1, policy_version 910854 (0.0009) [2023-12-26 06:54:52,413][123090] Updated weights for policy 1, policy_version 910864 (0.0009) [2023-12-26 06:54:52,478][123090] Updated weights for policy 1, policy_version 910874 (0.0010) [2023-12-26 06:54:52,860][123091] Updated weights for policy 0, policy_version 917304 (0.0006) [2023-12-26 06:54:52,915][123091] Updated weights for policy 0, policy_version 917314 (0.0005) [2023-12-26 06:54:52,973][123091] Updated weights for policy 0, policy_version 917324 (0.0009) [2023-12-26 06:54:53,359][123090] Updated weights for policy 1, policy_version 910884 (0.0008) [2023-12-26 06:54:53,422][123090] Updated weights for policy 1, policy_version 910894 (0.0005) [2023-12-26 06:54:53,483][123090] Updated weights for policy 1, policy_version 910904 (0.0005) [2023-12-26 06:54:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 468033536. Throughput: 0: 8950.2, 1: 8551.6. Samples: 468012364. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:53,785][121949] Avg episode reward: [(0, '6317.374'), (1, '5634.696')] [2023-12-26 06:54:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000910912_233193472.pth... [2023-12-26 06:54:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000909888_232931328.pth [2023-12-26 06:54:53,795][123091] Updated weights for policy 0, policy_version 917334 (0.0009) [2023-12-26 06:54:53,859][123091] Updated weights for policy 0, policy_version 917344 (0.0010) [2023-12-26 06:54:53,910][123091] Updated weights for policy 0, policy_version 917354 (0.0009) [2023-12-26 06:54:53,940][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000917360_234848256.pth... [2023-12-26 06:54:53,943][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000916304_234577920.pth [2023-12-26 06:54:54,144][123090] Updated weights for policy 1, policy_version 910914 (0.0005) [2023-12-26 06:54:54,210][123090] Updated weights for policy 1, policy_version 910924 (0.0006) [2023-12-26 06:54:54,275][123090] Updated weights for policy 1, policy_version 910934 (0.0009) [2023-12-26 06:54:54,342][123090] Updated weights for policy 1, policy_version 910944 (0.0009) [2023-12-26 06:54:54,769][123091] Updated weights for policy 0, policy_version 917364 (0.0008) [2023-12-26 06:54:54,822][123091] Updated weights for policy 0, policy_version 917374 (0.0005) [2023-12-26 06:54:54,875][123091] Updated weights for policy 0, policy_version 917384 (0.0005) [2023-12-26 06:54:55,172][123090] Updated weights for policy 1, policy_version 910954 (0.0005) [2023-12-26 06:54:55,234][123090] Updated weights for policy 1, policy_version 910964 (0.0005) [2023-12-26 06:54:55,289][123090] Updated weights for policy 1, policy_version 910974 (0.0005) [2023-12-26 06:54:55,672][123091] Updated weights for policy 0, policy_version 917394 (0.0006) [2023-12-26 06:54:55,724][123091] Updated weights for policy 0, policy_version 917405 (0.0008) [2023-12-26 06:54:55,785][123091] Updated weights for policy 0, policy_version 917416 (0.0008) [2023-12-26 06:54:55,992][123090] Updated weights for policy 1, policy_version 910984 (0.0009) [2023-12-26 06:54:56,060][123090] Updated weights for policy 1, policy_version 910994 (0.0009) [2023-12-26 06:54:56,128][123090] Updated weights for policy 1, policy_version 911004 (0.0007) [2023-12-26 06:54:56,671][123091] Updated weights for policy 0, policy_version 917427 (0.0010) [2023-12-26 06:54:56,723][123091] Updated weights for policy 0, policy_version 917437 (0.0009) [2023-12-26 06:54:56,773][123091] Updated weights for policy 0, policy_version 917447 (0.0008) [2023-12-26 06:54:56,820][123090] Updated weights for policy 1, policy_version 911014 (0.0007) [2023-12-26 06:54:56,867][123090] Updated weights for policy 1, policy_version 911024 (0.0008) [2023-12-26 06:54:56,928][123090] Updated weights for policy 1, policy_version 911034 (0.0008) [2023-12-26 06:54:57,598][123091] Updated weights for policy 0, policy_version 917457 (0.0009) [2023-12-26 06:54:57,615][123090] Updated weights for policy 1, policy_version 911044 (0.0008) [2023-12-26 06:54:57,648][123091] Updated weights for policy 0, policy_version 917467 (0.0008) [2023-12-26 06:54:57,666][123090] Updated weights for policy 1, policy_version 911054 (0.0005) [2023-12-26 06:54:57,696][123091] Updated weights for policy 0, policy_version 917477 (0.0009) [2023-12-26 06:54:57,719][123090] Updated weights for policy 1, policy_version 911064 (0.0005) [2023-12-26 06:54:57,746][123091] Updated weights for policy 0, policy_version 917488 (0.0008) [2023-12-26 06:54:58,465][123090] Updated weights for policy 1, policy_version 911074 (0.0005) [2023-12-26 06:54:58,532][123090] Updated weights for policy 1, policy_version 911084 (0.0008) [2023-12-26 06:54:58,603][123090] Updated weights for policy 1, policy_version 911094 (0.0008) [2023-12-26 06:54:58,675][123090] Updated weights for policy 1, policy_version 911104 (0.0008) [2023-12-26 06:54:58,686][123091] Updated weights for policy 0, policy_version 917498 (0.0009) [2023-12-26 06:54:58,767][123091] Updated weights for policy 0, policy_version 917508 (0.0008) [2023-12-26 06:54:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 468123648. Throughput: 0: 8921.8, 1: 8623.9. Samples: 468119240. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:54:58,785][121949] Avg episode reward: [(0, '6271.661'), (1, '5529.073')] [2023-12-26 06:54:58,831][123091] Updated weights for policy 0, policy_version 917518 (0.0010) [2023-12-26 06:54:59,628][123090] Updated weights for policy 1, policy_version 911114 (0.0011) [2023-12-26 06:54:59,681][123090] Updated weights for policy 1, policy_version 911124 (0.0010) [2023-12-26 06:54:59,727][123091] Updated weights for policy 0, policy_version 917528 (0.0007) [2023-12-26 06:54:59,729][123090] Updated weights for policy 1, policy_version 911134 (0.0010) [2023-12-26 06:54:59,795][123091] Updated weights for policy 0, policy_version 917538 (0.0008) [2023-12-26 06:54:59,854][123091] Updated weights for policy 0, policy_version 917548 (0.0010) [2023-12-26 06:55:00,580][123090] Updated weights for policy 1, policy_version 911144 (0.0010) [2023-12-26 06:55:00,640][123090] Updated weights for policy 1, policy_version 911154 (0.0010) [2023-12-26 06:55:00,660][123091] Updated weights for policy 0, policy_version 917558 (0.0007) [2023-12-26 06:55:00,692][123090] Updated weights for policy 1, policy_version 911164 (0.0010) [2023-12-26 06:55:00,717][123091] Updated weights for policy 0, policy_version 917568 (0.0005) [2023-12-26 06:55:00,786][123091] Updated weights for policy 0, policy_version 917578 (0.0005) [2023-12-26 06:55:01,470][123091] Updated weights for policy 0, policy_version 917588 (0.0006) [2023-12-26 06:55:01,490][123090] Updated weights for policy 1, policy_version 911174 (0.0009) [2023-12-26 06:55:01,514][123091] Updated weights for policy 0, policy_version 917598 (0.0008) [2023-12-26 06:55:01,541][123090] Updated weights for policy 1, policy_version 911184 (0.0008) [2023-12-26 06:55:01,565][123091] Updated weights for policy 0, policy_version 917608 (0.0008) [2023-12-26 06:55:01,594][123090] Updated weights for policy 1, policy_version 911194 (0.0007) [2023-12-26 06:55:02,389][123091] Updated weights for policy 0, policy_version 917618 (0.0008) [2023-12-26 06:55:02,406][123090] Updated weights for policy 1, policy_version 911204 (0.0007) [2023-12-26 06:55:02,437][123091] Updated weights for policy 0, policy_version 917628 (0.0006) [2023-12-26 06:55:02,464][123090] Updated weights for policy 1, policy_version 911214 (0.0009) [2023-12-26 06:55:02,483][123091] Updated weights for policy 0, policy_version 917638 (0.0005) [2023-12-26 06:55:02,521][123090] Updated weights for policy 1, policy_version 911224 (0.0009) [2023-12-26 06:55:02,535][123091] Updated weights for policy 0, policy_version 917648 (0.0006) [2023-12-26 06:55:03,204][123091] Updated weights for policy 0, policy_version 917658 (0.0005) [2023-12-26 06:55:03,264][123091] Updated weights for policy 0, policy_version 917668 (0.0005) [2023-12-26 06:55:03,323][123091] Updated weights for policy 0, policy_version 917678 (0.0005) [2023-12-26 06:55:03,448][123090] Updated weights for policy 1, policy_version 911234 (0.0010) [2023-12-26 06:55:03,501][123090] Updated weights for policy 1, policy_version 911244 (0.0009) [2023-12-26 06:55:03,548][123090] Updated weights for policy 1, policy_version 911254 (0.0005) [2023-12-26 06:55:03,597][123090] Updated weights for policy 1, policy_version 911264 (0.0007) [2023-12-26 06:55:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 468213760. Throughput: 0: 8900.1, 1: 8641.0. Samples: 468223508. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:55:03,785][121949] Avg episode reward: [(0, '6278.969'), (1, '5463.740')] [2023-12-26 06:55:04,040][123091] Updated weights for policy 0, policy_version 917688 (0.0010) [2023-12-26 06:55:04,099][123091] Updated weights for policy 0, policy_version 917698 (0.0011) [2023-12-26 06:55:04,162][123091] Updated weights for policy 0, policy_version 917708 (0.0011) [2023-12-26 06:55:04,422][123090] Updated weights for policy 1, policy_version 911274 (0.0009) [2023-12-26 06:55:04,487][123090] Updated weights for policy 1, policy_version 911284 (0.0008) [2023-12-26 06:55:04,549][123090] Updated weights for policy 1, policy_version 911294 (0.0009) [2023-12-26 06:55:04,998][123091] Updated weights for policy 0, policy_version 917718 (0.0007) [2023-12-26 06:55:05,049][123091] Updated weights for policy 0, policy_version 917728 (0.0006) [2023-12-26 06:55:05,099][123091] Updated weights for policy 0, policy_version 917738 (0.0005) [2023-12-26 06:55:05,374][123090] Updated weights for policy 1, policy_version 911304 (0.0009) [2023-12-26 06:55:05,443][123090] Updated weights for policy 1, policy_version 911314 (0.0008) [2023-12-26 06:55:05,520][123090] Updated weights for policy 1, policy_version 911324 (0.0005) [2023-12-26 06:55:05,763][123091] Updated weights for policy 0, policy_version 917748 (0.0005) [2023-12-26 06:55:05,835][123091] Updated weights for policy 0, policy_version 917758 (0.0006) [2023-12-26 06:55:05,905][123091] Updated weights for policy 0, policy_version 917768 (0.0005) [2023-12-26 06:55:06,270][123090] Updated weights for policy 1, policy_version 911334 (0.0009) [2023-12-26 06:55:06,334][123090] Updated weights for policy 1, policy_version 911344 (0.0011) [2023-12-26 06:55:06,404][123090] Updated weights for policy 1, policy_version 911354 (0.0010) [2023-12-26 06:55:06,648][123091] Updated weights for policy 0, policy_version 917778 (0.0007) [2023-12-26 06:55:06,705][123091] Updated weights for policy 0, policy_version 917788 (0.0010) [2023-12-26 06:55:06,753][123091] Updated weights for policy 0, policy_version 917798 (0.0009) [2023-12-26 06:55:06,821][123091] Updated weights for policy 0, policy_version 917808 (0.0010) [2023-12-26 06:55:07,221][123090] Updated weights for policy 1, policy_version 911364 (0.0011) [2023-12-26 06:55:07,283][123090] Updated weights for policy 1, policy_version 911375 (0.0009) [2023-12-26 06:55:07,341][123090] Updated weights for policy 1, policy_version 911385 (0.0010) [2023-12-26 06:55:07,535][123091] Updated weights for policy 0, policy_version 917818 (0.0009) [2023-12-26 06:55:07,601][123091] Updated weights for policy 0, policy_version 917828 (0.0008) [2023-12-26 06:55:07,668][123091] Updated weights for policy 0, policy_version 917838 (0.0009) [2023-12-26 06:55:08,250][123090] Updated weights for policy 1, policy_version 911395 (0.0009) [2023-12-26 06:55:08,305][123090] Updated weights for policy 1, policy_version 911405 (0.0010) [2023-12-26 06:55:08,372][123090] Updated weights for policy 1, policy_version 911415 (0.0008) [2023-12-26 06:55:08,382][123091] Updated weights for policy 0, policy_version 917848 (0.0011) [2023-12-26 06:55:08,434][123091] Updated weights for policy 0, policy_version 917858 (0.0010) [2023-12-26 06:55:08,489][123091] Updated weights for policy 0, policy_version 917868 (0.0010) [2023-12-26 06:55:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 468303872. Throughput: 0: 8920.2, 1: 8663.8. Samples: 468277784. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:55:08,785][121949] Avg episode reward: [(0, '6328.995'), (1, '5481.914')] [2023-12-26 06:55:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000917872_234979328.pth... [2023-12-26 06:55:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000911424_233324544.pth... [2023-12-26 06:55:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000916816_234708992.pth [2023-12-26 06:55:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000910400_233062400.pth [2023-12-26 06:55:09,228][123090] Updated weights for policy 1, policy_version 911425 (0.0007) [2023-12-26 06:55:09,300][123090] Updated weights for policy 1, policy_version 911435 (0.0009) [2023-12-26 06:55:09,335][123091] Updated weights for policy 0, policy_version 917878 (0.0011) [2023-12-26 06:55:09,372][123090] Updated weights for policy 1, policy_version 911445 (0.0009) [2023-12-26 06:55:09,404][123091] Updated weights for policy 0, policy_version 917888 (0.0011) [2023-12-26 06:55:09,439][123090] Updated weights for policy 1, policy_version 911455 (0.0008) [2023-12-26 06:55:09,472][123091] Updated weights for policy 0, policy_version 917898 (0.0010) [2023-12-26 06:55:10,255][123090] Updated weights for policy 1, policy_version 911465 (0.0010) [2023-12-26 06:55:10,292][123091] Updated weights for policy 0, policy_version 917908 (0.0010) [2023-12-26 06:55:10,310][123090] Updated weights for policy 1, policy_version 911475 (0.0009) [2023-12-26 06:55:10,356][123091] Updated weights for policy 0, policy_version 917918 (0.0009) [2023-12-26 06:55:10,367][123090] Updated weights for policy 1, policy_version 911485 (0.0009) [2023-12-26 06:55:10,412][123091] Updated weights for policy 0, policy_version 917928 (0.0009) [2023-12-26 06:55:11,114][123091] Updated weights for policy 0, policy_version 917938 (0.0008) [2023-12-26 06:55:11,179][123091] Updated weights for policy 0, policy_version 917948 (0.0008) [2023-12-26 06:55:11,244][123091] Updated weights for policy 0, policy_version 917958 (0.0011) [2023-12-26 06:55:11,265][123090] Updated weights for policy 1, policy_version 911495 (0.0007) [2023-12-26 06:55:11,309][123091] Updated weights for policy 0, policy_version 917968 (0.0011) [2023-12-26 06:55:11,325][123090] Updated weights for policy 1, policy_version 911505 (0.0009) [2023-12-26 06:55:11,398][123090] Updated weights for policy 1, policy_version 911515 (0.0010) [2023-12-26 06:55:12,106][123091] Updated weights for policy 0, policy_version 917978 (0.0010) [2023-12-26 06:55:12,168][123091] Updated weights for policy 0, policy_version 917988 (0.0010) [2023-12-26 06:55:12,231][123091] Updated weights for policy 0, policy_version 917998 (0.0009) [2023-12-26 06:55:12,256][123090] Updated weights for policy 1, policy_version 911525 (0.0010) [2023-12-26 06:55:12,326][123090] Updated weights for policy 1, policy_version 911535 (0.0010) [2023-12-26 06:55:12,399][123090] Updated weights for policy 1, policy_version 911545 (0.0009) [2023-12-26 06:55:13,067][123091] Updated weights for policy 0, policy_version 918008 (0.0010) [2023-12-26 06:55:13,131][123091] Updated weights for policy 0, policy_version 918018 (0.0009) [2023-12-26 06:55:13,194][123091] Updated weights for policy 0, policy_version 918028 (0.0009) [2023-12-26 06:55:13,238][123090] Updated weights for policy 1, policy_version 911556 (0.0008) [2023-12-26 06:55:13,286][123090] Updated weights for policy 1, policy_version 911566 (0.0005) [2023-12-26 06:55:13,344][123090] Updated weights for policy 1, policy_version 911576 (0.0005) [2023-12-26 06:55:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 468385792. Throughput: 0: 8998.5, 1: 8618.4. Samples: 468380852. Policy #0 lag: (min: 27.0, avg: 37.5, max: 59.0) [2023-12-26 06:55:13,785][121949] Avg episode reward: [(0, '6280.455'), (1, '5611.226')] [2023-12-26 06:55:14,041][123091] Updated weights for policy 0, policy_version 918038 (0.0010) [2023-12-26 06:55:14,099][123091] Updated weights for policy 0, policy_version 918048 (0.0010) [2023-12-26 06:55:14,110][123090] Updated weights for policy 1, policy_version 911586 (0.0008) [2023-12-26 06:55:14,165][123091] Updated weights for policy 0, policy_version 918058 (0.0010) [2023-12-26 06:55:14,174][123090] Updated weights for policy 1, policy_version 911596 (0.0006) [2023-12-26 06:55:14,244][123090] Updated weights for policy 1, policy_version 911606 (0.0005) [2023-12-26 06:55:14,317][123090] Updated weights for policy 1, policy_version 911616 (0.0007) [2023-12-26 06:55:14,949][123090] Updated weights for policy 1, policy_version 911626 (0.0009) [2023-12-26 06:55:15,010][123090] Updated weights for policy 1, policy_version 911636 (0.0009) [2023-12-26 06:55:15,061][123091] Updated weights for policy 0, policy_version 918068 (0.0007) [2023-12-26 06:55:15,080][123090] Updated weights for policy 1, policy_version 911646 (0.0009) [2023-12-26 06:55:15,123][123091] Updated weights for policy 0, policy_version 918078 (0.0008) [2023-12-26 06:55:15,187][123091] Updated weights for policy 0, policy_version 918088 (0.0009) [2023-12-26 06:55:15,882][123091] Updated weights for policy 0, policy_version 918098 (0.0009) [2023-12-26 06:55:15,883][123090] Updated weights for policy 1, policy_version 911656 (0.0010) [2023-12-26 06:55:15,948][123091] Updated weights for policy 0, policy_version 918108 (0.0008) [2023-12-26 06:55:15,951][123090] Updated weights for policy 1, policy_version 911666 (0.0011) [2023-12-26 06:55:16,010][123091] Updated weights for policy 0, policy_version 918118 (0.0007) [2023-12-26 06:55:16,015][123090] Updated weights for policy 1, policy_version 911676 (0.0011) [2023-12-26 06:55:16,068][123091] Updated weights for policy 0, policy_version 918128 (0.0005) [2023-12-26 06:55:16,736][123090] Updated weights for policy 1, policy_version 911686 (0.0007) [2023-12-26 06:55:16,794][123090] Updated weights for policy 1, policy_version 911696 (0.0005) [2023-12-26 06:55:16,800][123091] Updated weights for policy 0, policy_version 918138 (0.0008) [2023-12-26 06:55:16,850][123090] Updated weights for policy 1, policy_version 911706 (0.0005) [2023-12-26 06:55:16,859][123091] Updated weights for policy 0, policy_version 918148 (0.0010) [2023-12-26 06:55:16,922][123091] Updated weights for policy 0, policy_version 918158 (0.0011) [2023-12-26 06:55:17,592][123091] Updated weights for policy 0, policy_version 918168 (0.0006) [2023-12-26 06:55:17,612][123090] Updated weights for policy 1, policy_version 911716 (0.0007) [2023-12-26 06:55:17,641][123091] Updated weights for policy 0, policy_version 918178 (0.0005) [2023-12-26 06:55:17,660][123090] Updated weights for policy 1, policy_version 911726 (0.0010) [2023-12-26 06:55:17,687][123091] Updated weights for policy 0, policy_version 918188 (0.0005) [2023-12-26 06:55:17,708][123090] Updated weights for policy 1, policy_version 911736 (0.0010) [2023-12-26 06:55:18,377][123091] Updated weights for policy 0, policy_version 918198 (0.0008) [2023-12-26 06:55:18,444][123091] Updated weights for policy 0, policy_version 918208 (0.0005) [2023-12-26 06:55:18,505][123091] Updated weights for policy 0, policy_version 918218 (0.0005) [2023-12-26 06:55:18,563][123090] Updated weights for policy 1, policy_version 911746 (0.0010) [2023-12-26 06:55:18,623][123090] Updated weights for policy 1, policy_version 911756 (0.0010) [2023-12-26 06:55:18,682][123090] Updated weights for policy 1, policy_version 911766 (0.0010) [2023-12-26 06:55:18,746][123090] Updated weights for policy 1, policy_version 911776 (0.0010) [2023-12-26 06:55:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 468484096. Throughput: 0: 8993.1, 1: 8675.7. Samples: 468490316. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:18,785][121949] Avg episode reward: [(0, '6188.032'), (1, '5716.012')] [2023-12-26 06:55:19,223][123091] Updated weights for policy 0, policy_version 918228 (0.0006) [2023-12-26 06:55:19,287][123091] Updated weights for policy 0, policy_version 918238 (0.0009) [2023-12-26 06:55:19,351][123091] Updated weights for policy 0, policy_version 918248 (0.0010) [2023-12-26 06:55:19,612][123090] Updated weights for policy 1, policy_version 911786 (0.0010) [2023-12-26 06:55:19,667][123090] Updated weights for policy 1, policy_version 911796 (0.0010) [2023-12-26 06:55:19,724][123090] Updated weights for policy 1, policy_version 911806 (0.0010) [2023-12-26 06:55:20,140][123091] Updated weights for policy 0, policy_version 918258 (0.0009) [2023-12-26 06:55:20,196][123091] Updated weights for policy 0, policy_version 918268 (0.0011) [2023-12-26 06:55:20,259][123091] Updated weights for policy 0, policy_version 918278 (0.0011) [2023-12-26 06:55:20,327][123091] Updated weights for policy 0, policy_version 918288 (0.0010) [2023-12-26 06:55:20,558][123090] Updated weights for policy 1, policy_version 911816 (0.0009) [2023-12-26 06:55:20,631][123090] Updated weights for policy 1, policy_version 911826 (0.0009) [2023-12-26 06:55:20,702][123090] Updated weights for policy 1, policy_version 911836 (0.0009) [2023-12-26 06:55:21,190][123091] Updated weights for policy 0, policy_version 918298 (0.0007) [2023-12-26 06:55:21,266][123091] Updated weights for policy 0, policy_version 918308 (0.0006) [2023-12-26 06:55:21,338][123091] Updated weights for policy 0, policy_version 918318 (0.0007) [2023-12-26 06:55:21,633][123090] Updated weights for policy 1, policy_version 911846 (0.0008) [2023-12-26 06:55:21,701][123090] Updated weights for policy 1, policy_version 911856 (0.0008) [2023-12-26 06:55:21,781][123090] Updated weights for policy 1, policy_version 911866 (0.0009) [2023-12-26 06:55:22,068][123091] Updated weights for policy 0, policy_version 918328 (0.0010) [2023-12-26 06:55:22,120][123091] Updated weights for policy 0, policy_version 918338 (0.0011) [2023-12-26 06:55:22,172][123091] Updated weights for policy 0, policy_version 918348 (0.0011) [2023-12-26 06:55:22,598][123090] Updated weights for policy 1, policy_version 911876 (0.0009) [2023-12-26 06:55:22,663][123090] Updated weights for policy 1, policy_version 911886 (0.0008) [2023-12-26 06:55:22,727][123090] Updated weights for policy 1, policy_version 911896 (0.0009) [2023-12-26 06:55:23,044][123091] Updated weights for policy 0, policy_version 918358 (0.0011) [2023-12-26 06:55:23,115][123091] Updated weights for policy 0, policy_version 918368 (0.0011) [2023-12-26 06:55:23,182][123091] Updated weights for policy 0, policy_version 918378 (0.0011) [2023-12-26 06:55:23,563][123090] Updated weights for policy 1, policy_version 911906 (0.0009) [2023-12-26 06:55:23,623][123090] Updated weights for policy 1, policy_version 911916 (0.0008) [2023-12-26 06:55:23,687][123090] Updated weights for policy 1, policy_version 911926 (0.0009) [2023-12-26 06:55:23,746][123090] Updated weights for policy 1, policy_version 911936 (0.0009) [2023-12-26 06:55:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 468566016. Throughput: 0: 8963.0, 1: 8674.5. Samples: 468541596. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:23,785][121949] Avg episode reward: [(0, '6091.853'), (1, '5754.163')] [2023-12-26 06:55:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000918384_235110400.pth... [2023-12-26 06:55:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000911936_233455616.pth... [2023-12-26 06:55:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000917360_234848256.pth [2023-12-26 06:55:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000910912_233193472.pth [2023-12-26 06:55:23,975][123091] Updated weights for policy 0, policy_version 918388 (0.0011) [2023-12-26 06:55:24,034][123091] Updated weights for policy 0, policy_version 918398 (0.0011) [2023-12-26 06:55:24,082][123091] Updated weights for policy 0, policy_version 918408 (0.0010) [2023-12-26 06:55:24,508][123090] Updated weights for policy 1, policy_version 911946 (0.0005) [2023-12-26 06:55:24,577][123090] Updated weights for policy 1, policy_version 911956 (0.0009) [2023-12-26 06:55:24,633][123090] Updated weights for policy 1, policy_version 911966 (0.0010) [2023-12-26 06:55:24,857][123091] Updated weights for policy 0, policy_version 918418 (0.0009) [2023-12-26 06:55:24,920][123091] Updated weights for policy 0, policy_version 918428 (0.0011) [2023-12-26 06:55:24,979][123091] Updated weights for policy 0, policy_version 918438 (0.0011) [2023-12-26 06:55:25,043][123091] Updated weights for policy 0, policy_version 918448 (0.0011) [2023-12-26 06:55:25,352][123090] Updated weights for policy 1, policy_version 911976 (0.0010) [2023-12-26 06:55:25,403][123090] Updated weights for policy 1, policy_version 911986 (0.0010) [2023-12-26 06:55:25,454][123090] Updated weights for policy 1, policy_version 911996 (0.0010) [2023-12-26 06:55:25,854][123091] Updated weights for policy 0, policy_version 918458 (0.0006) [2023-12-26 06:55:25,925][123091] Updated weights for policy 0, policy_version 918468 (0.0010) [2023-12-26 06:55:25,992][123091] Updated weights for policy 0, policy_version 918478 (0.0011) [2023-12-26 06:55:26,181][123090] Updated weights for policy 1, policy_version 912006 (0.0010) [2023-12-26 06:55:26,250][123090] Updated weights for policy 1, policy_version 912016 (0.0010) [2023-12-26 06:55:26,320][123090] Updated weights for policy 1, policy_version 912026 (0.0010) [2023-12-26 06:55:26,735][123091] Updated weights for policy 0, policy_version 918488 (0.0007) [2023-12-26 06:55:26,794][123091] Updated weights for policy 0, policy_version 918498 (0.0010) [2023-12-26 06:55:26,856][123091] Updated weights for policy 0, policy_version 918508 (0.0010) [2023-12-26 06:55:27,024][123090] Updated weights for policy 1, policy_version 912036 (0.0008) [2023-12-26 06:55:27,087][123090] Updated weights for policy 1, policy_version 912046 (0.0005) [2023-12-26 06:55:27,155][123090] Updated weights for policy 1, policy_version 912056 (0.0005) [2023-12-26 06:55:27,602][123091] Updated weights for policy 0, policy_version 918518 (0.0007) [2023-12-26 06:55:27,645][123091] Updated weights for policy 0, policy_version 918528 (0.0005) [2023-12-26 06:55:27,703][123091] Updated weights for policy 0, policy_version 918538 (0.0005) [2023-12-26 06:55:27,806][123090] Updated weights for policy 1, policy_version 912066 (0.0005) [2023-12-26 06:55:27,860][123090] Updated weights for policy 1, policy_version 912076 (0.0005) [2023-12-26 06:55:27,919][123090] Updated weights for policy 1, policy_version 912086 (0.0005) [2023-12-26 06:55:27,973][123090] Updated weights for policy 1, policy_version 912096 (0.0005) [2023-12-26 06:55:28,419][123091] Updated weights for policy 0, policy_version 918548 (0.0007) [2023-12-26 06:55:28,475][123091] Updated weights for policy 0, policy_version 918558 (0.0010) [2023-12-26 06:55:28,537][123091] Updated weights for policy 0, policy_version 918568 (0.0010) [2023-12-26 06:55:28,673][123090] Updated weights for policy 1, policy_version 912106 (0.0005) [2023-12-26 06:55:28,721][123090] Updated weights for policy 1, policy_version 912116 (0.0005) [2023-12-26 06:55:28,773][123090] Updated weights for policy 1, policy_version 912126 (0.0005) [2023-12-26 06:55:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 468656128. Throughput: 0: 8991.1, 1: 8785.9. Samples: 468650124. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:28,785][121949] Avg episode reward: [(0, '5956.696'), (1, '5515.940')] [2023-12-26 06:55:29,401][123091] Updated weights for policy 0, policy_version 918578 (0.0010) [2023-12-26 06:55:29,456][123091] Updated weights for policy 0, policy_version 918588 (0.0009) [2023-12-26 06:55:29,508][123091] Updated weights for policy 0, policy_version 918598 (0.0009) [2023-12-26 06:55:29,562][123091] Updated weights for policy 0, policy_version 918608 (0.0008) [2023-12-26 06:55:29,574][123090] Updated weights for policy 1, policy_version 912136 (0.0007) [2023-12-26 06:55:29,627][123090] Updated weights for policy 1, policy_version 912146 (0.0009) [2023-12-26 06:55:29,675][123090] Updated weights for policy 1, policy_version 912156 (0.0009) [2023-12-26 06:55:30,439][123091] Updated weights for policy 0, policy_version 918618 (0.0010) [2023-12-26 06:55:30,484][123090] Updated weights for policy 1, policy_version 912166 (0.0008) [2023-12-26 06:55:30,499][123091] Updated weights for policy 0, policy_version 918628 (0.0009) [2023-12-26 06:55:30,547][123090] Updated weights for policy 1, policy_version 912176 (0.0007) [2023-12-26 06:55:30,553][123091] Updated weights for policy 0, policy_version 918638 (0.0008) [2023-12-26 06:55:30,613][123090] Updated weights for policy 1, policy_version 912186 (0.0008) [2023-12-26 06:55:31,321][123091] Updated weights for policy 0, policy_version 918648 (0.0009) [2023-12-26 06:55:31,385][123091] Updated weights for policy 0, policy_version 918658 (0.0008) [2023-12-26 06:55:31,450][123091] Updated weights for policy 0, policy_version 918668 (0.0010) [2023-12-26 06:55:31,475][123090] Updated weights for policy 1, policy_version 912196 (0.0009) [2023-12-26 06:55:31,543][123090] Updated weights for policy 1, policy_version 912206 (0.0009) [2023-12-26 06:55:31,610][123090] Updated weights for policy 1, policy_version 912216 (0.0010) [2023-12-26 06:55:32,304][123091] Updated weights for policy 0, policy_version 918678 (0.0009) [2023-12-26 06:55:32,367][123091] Updated weights for policy 0, policy_version 918688 (0.0009) [2023-12-26 06:55:32,385][123090] Updated weights for policy 1, policy_version 912226 (0.0008) [2023-12-26 06:55:32,420][123091] Updated weights for policy 0, policy_version 918698 (0.0008) [2023-12-26 06:55:32,451][123090] Updated weights for policy 1, policy_version 912236 (0.0009) [2023-12-26 06:55:32,516][123090] Updated weights for policy 1, policy_version 912246 (0.0009) [2023-12-26 06:55:32,583][123090] Updated weights for policy 1, policy_version 912256 (0.0010) [2023-12-26 06:55:33,251][123091] Updated weights for policy 0, policy_version 918708 (0.0009) [2023-12-26 06:55:33,297][123091] Updated weights for policy 0, policy_version 918718 (0.0008) [2023-12-26 06:55:33,351][123091] Updated weights for policy 0, policy_version 918728 (0.0009) [2023-12-26 06:55:33,375][123090] Updated weights for policy 1, policy_version 912266 (0.0007) [2023-12-26 06:55:33,426][123090] Updated weights for policy 1, policy_version 912276 (0.0009) [2023-12-26 06:55:33,478][123090] Updated weights for policy 1, policy_version 912286 (0.0009) [2023-12-26 06:55:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 468746240. Throughput: 0: 8916.7, 1: 8742.2. Samples: 468754760. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:33,784][121949] Avg episode reward: [(0, '6094.317'), (1, '5587.009')] [2023-12-26 06:55:34,199][123091] Updated weights for policy 0, policy_version 918738 (0.0009) [2023-12-26 06:55:34,258][123091] Updated weights for policy 0, policy_version 918749 (0.0010) [2023-12-26 06:55:34,321][123091] Updated weights for policy 0, policy_version 918759 (0.0009) [2023-12-26 06:55:34,332][123090] Updated weights for policy 1, policy_version 912296 (0.0009) [2023-12-26 06:55:34,398][123090] Updated weights for policy 1, policy_version 912306 (0.0008) [2023-12-26 06:55:34,465][123090] Updated weights for policy 1, policy_version 912316 (0.0009) [2023-12-26 06:55:35,095][123091] Updated weights for policy 0, policy_version 918769 (0.0009) [2023-12-26 06:55:35,169][123091] Updated weights for policy 0, policy_version 918779 (0.0005) [2023-12-26 06:55:35,239][123091] Updated weights for policy 0, policy_version 918790 (0.0009) [2023-12-26 06:55:35,304][123091] Updated weights for policy 0, policy_version 918800 (0.0005) [2023-12-26 06:55:35,313][123090] Updated weights for policy 1, policy_version 912326 (0.0009) [2023-12-26 06:55:35,385][123090] Updated weights for policy 1, policy_version 912336 (0.0010) [2023-12-26 06:55:35,456][123090] Updated weights for policy 1, policy_version 912346 (0.0010) [2023-12-26 06:55:35,943][123091] Updated weights for policy 0, policy_version 918810 (0.0010) [2023-12-26 06:55:36,007][123091] Updated weights for policy 0, policy_version 918820 (0.0010) [2023-12-26 06:55:36,078][123091] Updated weights for policy 0, policy_version 918830 (0.0008) [2023-12-26 06:55:36,235][123090] Updated weights for policy 1, policy_version 912356 (0.0007) [2023-12-26 06:55:36,298][123090] Updated weights for policy 1, policy_version 912366 (0.0005) [2023-12-26 06:55:36,369][123090] Updated weights for policy 1, policy_version 912376 (0.0007) [2023-12-26 06:55:36,919][123091] Updated weights for policy 0, policy_version 918840 (0.0008) [2023-12-26 06:55:36,990][123091] Updated weights for policy 0, policy_version 918850 (0.0010) [2023-12-26 06:55:37,062][123091] Updated weights for policy 0, policy_version 918860 (0.0008) [2023-12-26 06:55:37,102][123090] Updated weights for policy 1, policy_version 912386 (0.0011) [2023-12-26 06:55:37,169][123090] Updated weights for policy 1, policy_version 912396 (0.0010) [2023-12-26 06:55:37,232][123090] Updated weights for policy 1, policy_version 912406 (0.0010) [2023-12-26 06:55:37,303][123090] Updated weights for policy 1, policy_version 912416 (0.0010) [2023-12-26 06:55:37,881][123091] Updated weights for policy 0, policy_version 918870 (0.0009) [2023-12-26 06:55:37,946][123091] Updated weights for policy 0, policy_version 918880 (0.0010) [2023-12-26 06:55:38,021][123091] Updated weights for policy 0, policy_version 918890 (0.0009) [2023-12-26 06:55:38,051][123090] Updated weights for policy 1, policy_version 912426 (0.0005) [2023-12-26 06:55:38,123][123090] Updated weights for policy 1, policy_version 912436 (0.0006) [2023-12-26 06:55:38,191][123090] Updated weights for policy 1, policy_version 912446 (0.0005) [2023-12-26 06:55:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 468828160. Throughput: 0: 8925.6, 1: 8757.1. Samples: 468808084. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:38,784][121949] Avg episode reward: [(0, '6203.258'), (1, '5754.275')] [2023-12-26 06:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000918896_235241472.pth... [2023-12-26 06:55:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000917872_234979328.pth [2023-12-26 06:55:38,797][123090] Updated weights for policy 1, policy_version 912456 (0.0005) [2023-12-26 06:55:38,860][123091] Updated weights for policy 0, policy_version 918900 (0.0009) [2023-12-26 06:55:38,865][123090] Updated weights for policy 1, policy_version 912466 (0.0005) [2023-12-26 06:55:38,922][123091] Updated weights for policy 0, policy_version 918910 (0.0007) [2023-12-26 06:55:38,932][123090] Updated weights for policy 1, policy_version 912476 (0.0007) [2023-12-26 06:55:38,955][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000912480_233594880.pth... [2023-12-26 06:55:38,960][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000911424_233324544.pth [2023-12-26 06:55:38,978][123091] Updated weights for policy 0, policy_version 918920 (0.0006) [2023-12-26 06:55:39,678][123090] Updated weights for policy 1, policy_version 912486 (0.0009) [2023-12-26 06:55:39,722][123091] Updated weights for policy 0, policy_version 918930 (0.0007) [2023-12-26 06:55:39,745][123090] Updated weights for policy 1, policy_version 912496 (0.0009) [2023-12-26 06:55:39,783][123091] Updated weights for policy 0, policy_version 918940 (0.0007) [2023-12-26 06:55:39,803][123090] Updated weights for policy 1, policy_version 912506 (0.0011) [2023-12-26 06:55:39,847][123091] Updated weights for policy 0, policy_version 918950 (0.0007) [2023-12-26 06:55:39,905][123091] Updated weights for policy 0, policy_version 918960 (0.0009) [2023-12-26 06:55:40,531][123090] Updated weights for policy 1, policy_version 912516 (0.0010) [2023-12-26 06:55:40,603][123090] Updated weights for policy 1, policy_version 912526 (0.0009) [2023-12-26 06:55:40,673][123090] Updated weights for policy 1, policy_version 912536 (0.0007) [2023-12-26 06:55:40,796][123091] Updated weights for policy 0, policy_version 918970 (0.0009) [2023-12-26 06:55:40,853][123091] Updated weights for policy 0, policy_version 918980 (0.0009) [2023-12-26 06:55:40,921][123091] Updated weights for policy 0, policy_version 918990 (0.0009) [2023-12-26 06:55:41,450][123090] Updated weights for policy 1, policy_version 912546 (0.0008) [2023-12-26 06:55:41,523][123090] Updated weights for policy 1, policy_version 912556 (0.0010) [2023-12-26 06:55:41,600][123090] Updated weights for policy 1, policy_version 912566 (0.0009) [2023-12-26 06:55:41,663][123090] Updated weights for policy 1, policy_version 912576 (0.0009) [2023-12-26 06:55:41,856][123091] Updated weights for policy 0, policy_version 919000 (0.0009) [2023-12-26 06:55:41,915][123091] Updated weights for policy 0, policy_version 919010 (0.0010) [2023-12-26 06:55:41,965][123091] Updated weights for policy 0, policy_version 919020 (0.0009) [2023-12-26 06:55:42,481][123090] Updated weights for policy 1, policy_version 912586 (0.0009) [2023-12-26 06:55:42,551][123090] Updated weights for policy 1, policy_version 912596 (0.0008) [2023-12-26 06:55:42,610][123090] Updated weights for policy 1, policy_version 912606 (0.0009) [2023-12-26 06:55:42,826][123091] Updated weights for policy 0, policy_version 919030 (0.0010) [2023-12-26 06:55:42,883][123091] Updated weights for policy 0, policy_version 919040 (0.0005) [2023-12-26 06:55:42,942][123091] Updated weights for policy 0, policy_version 919050 (0.0006) [2023-12-26 06:55:43,467][123090] Updated weights for policy 1, policy_version 912616 (0.0009) [2023-12-26 06:55:43,531][123090] Updated weights for policy 1, policy_version 912626 (0.0008) [2023-12-26 06:55:43,588][123090] Updated weights for policy 1, policy_version 912636 (0.0009) [2023-12-26 06:55:43,651][123091] Updated weights for policy 0, policy_version 919060 (0.0008) [2023-12-26 06:55:43,699][123091] Updated weights for policy 0, policy_version 919070 (0.0007) [2023-12-26 06:55:43,760][123091] Updated weights for policy 0, policy_version 919080 (0.0010) [2023-12-26 06:55:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 468918272. Throughput: 0: 8885.5, 1: 8761.5. Samples: 468913356. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:43,785][121949] Avg episode reward: [(0, '6255.449'), (1, '5829.406')] [2023-12-26 06:55:44,442][123090] Updated weights for policy 1, policy_version 912646 (0.0009) [2023-12-26 06:55:44,502][123090] Updated weights for policy 1, policy_version 912656 (0.0009) [2023-12-26 06:55:44,569][123090] Updated weights for policy 1, policy_version 912666 (0.0010) [2023-12-26 06:55:44,610][123091] Updated weights for policy 0, policy_version 919090 (0.0008) [2023-12-26 06:55:44,677][123091] Updated weights for policy 0, policy_version 919100 (0.0009) [2023-12-26 06:55:44,750][123091] Updated weights for policy 0, policy_version 919110 (0.0009) [2023-12-26 06:55:44,811][123091] Updated weights for policy 0, policy_version 919120 (0.0007) [2023-12-26 06:55:45,429][123090] Updated weights for policy 1, policy_version 912676 (0.0010) [2023-12-26 06:55:45,489][123090] Updated weights for policy 1, policy_version 912686 (0.0008) [2023-12-26 06:55:45,516][123091] Updated weights for policy 0, policy_version 919130 (0.0010) [2023-12-26 06:55:45,541][123090] Updated weights for policy 1, policy_version 912696 (0.0007) [2023-12-26 06:55:45,577][123091] Updated weights for policy 0, policy_version 919140 (0.0006) [2023-12-26 06:55:45,643][123091] Updated weights for policy 0, policy_version 919150 (0.0005) [2023-12-26 06:55:46,336][123091] Updated weights for policy 0, policy_version 919160 (0.0005) [2023-12-26 06:55:46,405][123091] Updated weights for policy 0, policy_version 919170 (0.0005) [2023-12-26 06:55:46,451][123090] Updated weights for policy 1, policy_version 912706 (0.0009) [2023-12-26 06:55:46,460][123091] Updated weights for policy 0, policy_version 919180 (0.0005) [2023-12-26 06:55:46,505][123090] Updated weights for policy 1, policy_version 912716 (0.0009) [2023-12-26 06:55:46,560][123090] Updated weights for policy 1, policy_version 912726 (0.0009) [2023-12-26 06:55:46,614][123090] Updated weights for policy 1, policy_version 912736 (0.0009) [2023-12-26 06:55:47,070][123091] Updated weights for policy 0, policy_version 919190 (0.0008) [2023-12-26 06:55:47,130][123091] Updated weights for policy 0, policy_version 919200 (0.0010) [2023-12-26 06:55:47,186][123091] Updated weights for policy 0, policy_version 919210 (0.0009) [2023-12-26 06:55:47,514][123090] Updated weights for policy 1, policy_version 912746 (0.0007) [2023-12-26 06:55:47,562][123090] Updated weights for policy 1, policy_version 912756 (0.0007) [2023-12-26 06:55:47,617][123090] Updated weights for policy 1, policy_version 912766 (0.0010) [2023-12-26 06:55:47,945][123091] Updated weights for policy 0, policy_version 919220 (0.0009) [2023-12-26 06:55:47,997][123091] Updated weights for policy 0, policy_version 919230 (0.0009) [2023-12-26 06:55:48,050][123091] Updated weights for policy 0, policy_version 919240 (0.0009) [2023-12-26 06:55:48,442][123090] Updated weights for policy 1, policy_version 912776 (0.0011) [2023-12-26 06:55:48,513][123090] Updated weights for policy 1, policy_version 912786 (0.0011) [2023-12-26 06:55:48,590][123090] Updated weights for policy 1, policy_version 912796 (0.0011) [2023-12-26 06:55:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 469008384. Throughput: 0: 8948.6, 1: 8747.4. Samples: 469019824. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:48,785][121949] Avg episode reward: [(0, '6253.354'), (1, '5784.086')] [2023-12-26 06:55:48,874][123091] Updated weights for policy 0, policy_version 919250 (0.0009) [2023-12-26 06:55:48,932][123091] Updated weights for policy 0, policy_version 919260 (0.0009) [2023-12-26 06:55:48,995][123091] Updated weights for policy 0, policy_version 919270 (0.0009) [2023-12-26 06:55:49,064][123091] Updated weights for policy 0, policy_version 919280 (0.0010) [2023-12-26 06:55:49,381][123090] Updated weights for policy 1, policy_version 912806 (0.0008) [2023-12-26 06:55:49,450][123090] Updated weights for policy 1, policy_version 912816 (0.0009) [2023-12-26 06:55:49,505][123090] Updated weights for policy 1, policy_version 912826 (0.0009) [2023-12-26 06:55:49,883][123091] Updated weights for policy 0, policy_version 919290 (0.0010) [2023-12-26 06:55:49,946][123091] Updated weights for policy 0, policy_version 919300 (0.0011) [2023-12-26 06:55:50,018][123091] Updated weights for policy 0, policy_version 919310 (0.0009) [2023-12-26 06:55:50,357][123090] Updated weights for policy 1, policy_version 912836 (0.0009) [2023-12-26 06:55:50,416][123090] Updated weights for policy 1, policy_version 912846 (0.0009) [2023-12-26 06:55:50,475][123090] Updated weights for policy 1, policy_version 912856 (0.0009) [2023-12-26 06:55:50,859][123091] Updated weights for policy 0, policy_version 919320 (0.0010) [2023-12-26 06:55:50,915][123091] Updated weights for policy 0, policy_version 919330 (0.0010) [2023-12-26 06:55:50,976][123091] Updated weights for policy 0, policy_version 919341 (0.0011) [2023-12-26 06:55:51,271][123090] Updated weights for policy 1, policy_version 912866 (0.0009) [2023-12-26 06:55:51,323][123090] Updated weights for policy 1, policy_version 912876 (0.0005) [2023-12-26 06:55:51,383][123090] Updated weights for policy 1, policy_version 912886 (0.0009) [2023-12-26 06:55:51,438][123090] Updated weights for policy 1, policy_version 912896 (0.0006) [2023-12-26 06:55:51,862][123091] Updated weights for policy 0, policy_version 919351 (0.0007) [2023-12-26 06:55:51,920][123091] Updated weights for policy 0, policy_version 919361 (0.0007) [2023-12-26 06:55:51,977][123091] Updated weights for policy 0, policy_version 919371 (0.0010) [2023-12-26 06:55:52,239][123090] Updated weights for policy 1, policy_version 912906 (0.0010) [2023-12-26 06:55:52,302][123090] Updated weights for policy 1, policy_version 912916 (0.0011) [2023-12-26 06:55:52,374][123090] Updated weights for policy 1, policy_version 912926 (0.0011) [2023-12-26 06:55:52,832][123091] Updated weights for policy 0, policy_version 919381 (0.0010) [2023-12-26 06:55:52,903][123091] Updated weights for policy 0, policy_version 919391 (0.0010) [2023-12-26 06:55:52,963][123091] Updated weights for policy 0, policy_version 919401 (0.0009) [2023-12-26 06:55:53,096][123090] Updated weights for policy 1, policy_version 912936 (0.0006) [2023-12-26 06:55:53,154][123090] Updated weights for policy 1, policy_version 912946 (0.0007) [2023-12-26 06:55:53,219][123090] Updated weights for policy 1, policy_version 912956 (0.0010) [2023-12-26 06:55:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 469090304. Throughput: 0: 8887.8, 1: 8736.3. Samples: 469070876. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:53,785][121949] Avg episode reward: [(0, '6167.817'), (1, '5834.824')] [2023-12-26 06:55:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000912960_233717760.pth... [2023-12-26 06:55:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000911936_233455616.pth [2023-12-26 06:55:53,811][123091] Updated weights for policy 0, policy_version 919411 (0.0010) [2023-12-26 06:55:53,874][123091] Updated weights for policy 0, policy_version 919421 (0.0009) [2023-12-26 06:55:53,946][123091] Updated weights for policy 0, policy_version 919431 (0.0008) [2023-12-26 06:55:54,001][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000919440_235380736.pth... [2023-12-26 06:55:54,005][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000918384_235110400.pth [2023-12-26 06:55:54,009][123090] Updated weights for policy 1, policy_version 912966 (0.0010) [2023-12-26 06:55:54,071][123090] Updated weights for policy 1, policy_version 912976 (0.0010) [2023-12-26 06:55:54,134][123090] Updated weights for policy 1, policy_version 912986 (0.0010) [2023-12-26 06:55:54,771][123091] Updated weights for policy 0, policy_version 919441 (0.0008) [2023-12-26 06:55:54,830][123091] Updated weights for policy 0, policy_version 919451 (0.0008) [2023-12-26 06:55:54,885][123091] Updated weights for policy 0, policy_version 919461 (0.0009) [2023-12-26 06:55:54,951][123091] Updated weights for policy 0, policy_version 919471 (0.0007) [2023-12-26 06:55:54,956][123090] Updated weights for policy 1, policy_version 912996 (0.0011) [2023-12-26 06:55:55,026][123090] Updated weights for policy 1, policy_version 913006 (0.0010) [2023-12-26 06:55:55,074][123090] Updated weights for policy 1, policy_version 913016 (0.0010) [2023-12-26 06:55:55,768][123091] Updated weights for policy 0, policy_version 919481 (0.0009) [2023-12-26 06:55:55,824][123091] Updated weights for policy 0, policy_version 919491 (0.0009) [2023-12-26 06:55:55,888][123090] Updated weights for policy 1, policy_version 913026 (0.0010) [2023-12-26 06:55:55,890][123091] Updated weights for policy 0, policy_version 919501 (0.0009) [2023-12-26 06:55:55,946][123090] Updated weights for policy 1, policy_version 913036 (0.0010) [2023-12-26 06:55:56,021][123090] Updated weights for policy 1, policy_version 913046 (0.0011) [2023-12-26 06:55:56,077][123090] Updated weights for policy 1, policy_version 913056 (0.0010) [2023-12-26 06:55:56,735][123091] Updated weights for policy 0, policy_version 919511 (0.0008) [2023-12-26 06:55:56,788][123091] Updated weights for policy 0, policy_version 919521 (0.0010) [2023-12-26 06:55:56,846][123091] Updated weights for policy 0, policy_version 919531 (0.0009) [2023-12-26 06:55:56,862][123090] Updated weights for policy 1, policy_version 913066 (0.0005) [2023-12-26 06:55:56,910][123090] Updated weights for policy 1, policy_version 913076 (0.0005) [2023-12-26 06:55:56,962][123090] Updated weights for policy 1, policy_version 913086 (0.0006) [2023-12-26 06:55:57,610][123091] Updated weights for policy 0, policy_version 919541 (0.0007) [2023-12-26 06:55:57,647][123090] Updated weights for policy 1, policy_version 913096 (0.0006) [2023-12-26 06:55:57,673][123091] Updated weights for policy 0, policy_version 919551 (0.0006) [2023-12-26 06:55:57,709][123090] Updated weights for policy 1, policy_version 913106 (0.0005) [2023-12-26 06:55:57,743][123091] Updated weights for policy 0, policy_version 919561 (0.0005) [2023-12-26 06:55:57,777][123090] Updated weights for policy 1, policy_version 913116 (0.0006) [2023-12-26 06:55:58,435][123091] Updated weights for policy 0, policy_version 919571 (0.0007) [2023-12-26 06:55:58,499][123091] Updated weights for policy 0, policy_version 919581 (0.0010) [2023-12-26 06:55:58,570][123091] Updated weights for policy 0, policy_version 919591 (0.0011) [2023-12-26 06:55:58,588][123090] Updated weights for policy 1, policy_version 913126 (0.0009) [2023-12-26 06:55:58,650][123090] Updated weights for policy 1, policy_version 913136 (0.0007) [2023-12-26 06:55:58,725][123090] Updated weights for policy 1, policy_version 913146 (0.0009) [2023-12-26 06:55:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 469188608. Throughput: 0: 8825.8, 1: 8869.4. Samples: 469177136. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:55:58,785][121949] Avg episode reward: [(0, '6169.313'), (1, '5834.049')] [2023-12-26 06:55:59,381][123091] Updated weights for policy 0, policy_version 919601 (0.0011) [2023-12-26 06:55:59,452][123091] Updated weights for policy 0, policy_version 919611 (0.0010) [2023-12-26 06:55:59,511][123091] Updated weights for policy 0, policy_version 919621 (0.0010) [2023-12-26 06:55:59,568][123090] Updated weights for policy 1, policy_version 913156 (0.0008) [2023-12-26 06:55:59,574][123091] Updated weights for policy 0, policy_version 919631 (0.0011) [2023-12-26 06:55:59,623][123090] Updated weights for policy 1, policy_version 913166 (0.0008) [2023-12-26 06:55:59,668][123090] Updated weights for policy 1, policy_version 913176 (0.0005) [2023-12-26 06:56:00,298][123091] Updated weights for policy 0, policy_version 919641 (0.0007) [2023-12-26 06:56:00,353][123091] Updated weights for policy 0, policy_version 919651 (0.0005) [2023-12-26 06:56:00,401][123090] Updated weights for policy 1, policy_version 913186 (0.0005) [2023-12-26 06:56:00,407][123091] Updated weights for policy 0, policy_version 919661 (0.0007) [2023-12-26 06:56:00,466][123090] Updated weights for policy 1, policy_version 913196 (0.0005) [2023-12-26 06:56:00,514][123090] Updated weights for policy 1, policy_version 913206 (0.0005) [2023-12-26 06:56:00,577][123090] Updated weights for policy 1, policy_version 913216 (0.0007) [2023-12-26 06:56:01,093][123091] Updated weights for policy 0, policy_version 919671 (0.0006) [2023-12-26 06:56:01,156][123091] Updated weights for policy 0, policy_version 919681 (0.0009) [2023-12-26 06:56:01,220][123091] Updated weights for policy 0, policy_version 919691 (0.0007) [2023-12-26 06:56:01,302][123090] Updated weights for policy 1, policy_version 913226 (0.0008) [2023-12-26 06:56:01,364][123090] Updated weights for policy 1, policy_version 913236 (0.0008) [2023-12-26 06:56:01,430][123090] Updated weights for policy 1, policy_version 913246 (0.0009) [2023-12-26 06:56:02,006][123091] Updated weights for policy 0, policy_version 919701 (0.0009) [2023-12-26 06:56:02,070][123091] Updated weights for policy 0, policy_version 919711 (0.0011) [2023-12-26 06:56:02,135][123091] Updated weights for policy 0, policy_version 919721 (0.0011) [2023-12-26 06:56:02,302][123090] Updated weights for policy 1, policy_version 913256 (0.0007) [2023-12-26 06:56:02,371][123090] Updated weights for policy 1, policy_version 913266 (0.0008) [2023-12-26 06:56:02,442][123090] Updated weights for policy 1, policy_version 913276 (0.0006) [2023-12-26 06:56:02,886][123091] Updated weights for policy 0, policy_version 919731 (0.0010) [2023-12-26 06:56:02,950][123091] Updated weights for policy 0, policy_version 919741 (0.0011) [2023-12-26 06:56:03,013][123091] Updated weights for policy 0, policy_version 919751 (0.0011) [2023-12-26 06:56:03,170][123090] Updated weights for policy 1, policy_version 913286 (0.0007) [2023-12-26 06:56:03,225][123090] Updated weights for policy 1, policy_version 913296 (0.0005) [2023-12-26 06:56:03,284][123090] Updated weights for policy 1, policy_version 913306 (0.0005) [2023-12-26 06:56:03,685][123091] Updated weights for policy 0, policy_version 919761 (0.0010) [2023-12-26 06:56:03,750][123091] Updated weights for policy 0, policy_version 919771 (0.0005) [2023-12-26 06:56:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 469270528. Throughput: 0: 8855.5, 1: 8857.2. Samples: 469287384. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:03,784][121949] Avg episode reward: [(0, '6286.079'), (1, '5660.125')] [2023-12-26 06:56:03,805][123091] Updated weights for policy 0, policy_version 919781 (0.0005) [2023-12-26 06:56:03,866][123091] Updated weights for policy 0, policy_version 919791 (0.0007) [2023-12-26 06:56:03,980][123090] Updated weights for policy 1, policy_version 913316 (0.0005) [2023-12-26 06:56:04,038][123090] Updated weights for policy 1, policy_version 913326 (0.0006) [2023-12-26 06:56:04,089][123090] Updated weights for policy 1, policy_version 913336 (0.0007) [2023-12-26 06:56:04,649][123091] Updated weights for policy 0, policy_version 919801 (0.0010) [2023-12-26 06:56:04,709][123091] Updated weights for policy 0, policy_version 919811 (0.0010) [2023-12-26 06:56:04,766][123091] Updated weights for policy 0, policy_version 919821 (0.0009) [2023-12-26 06:56:04,869][123090] Updated weights for policy 1, policy_version 913346 (0.0006) [2023-12-26 06:56:04,919][123090] Updated weights for policy 1, policy_version 913356 (0.0009) [2023-12-26 06:56:04,967][123090] Updated weights for policy 1, policy_version 913366 (0.0009) [2023-12-26 06:56:05,028][123090] Updated weights for policy 1, policy_version 913376 (0.0010) [2023-12-26 06:56:05,490][123091] Updated weights for policy 0, policy_version 919831 (0.0007) [2023-12-26 06:56:05,538][123091] Updated weights for policy 0, policy_version 919841 (0.0010) [2023-12-26 06:56:05,589][123091] Updated weights for policy 0, policy_version 919851 (0.0008) [2023-12-26 06:56:05,939][123090] Updated weights for policy 1, policy_version 913386 (0.0009) [2023-12-26 06:56:05,994][123090] Updated weights for policy 1, policy_version 913397 (0.0010) [2023-12-26 06:56:06,059][123090] Updated weights for policy 1, policy_version 913407 (0.0007) [2023-12-26 06:56:06,261][123091] Updated weights for policy 0, policy_version 919861 (0.0006) [2023-12-26 06:56:06,327][123091] Updated weights for policy 0, policy_version 919871 (0.0005) [2023-12-26 06:56:06,391][123091] Updated weights for policy 0, policy_version 919881 (0.0006) [2023-12-26 06:56:06,845][123090] Updated weights for policy 1, policy_version 913417 (0.0009) [2023-12-26 06:56:06,913][123090] Updated weights for policy 1, policy_version 913428 (0.0010) [2023-12-26 06:56:06,966][123090] Updated weights for policy 1, policy_version 913438 (0.0010) [2023-12-26 06:56:07,058][123091] Updated weights for policy 0, policy_version 919891 (0.0006) [2023-12-26 06:56:07,110][123091] Updated weights for policy 0, policy_version 919901 (0.0005) [2023-12-26 06:56:07,157][123091] Updated weights for policy 0, policy_version 919911 (0.0006) [2023-12-26 06:56:07,778][123090] Updated weights for policy 1, policy_version 913448 (0.0009) [2023-12-26 06:56:07,836][123090] Updated weights for policy 1, policy_version 913458 (0.0010) [2023-12-26 06:56:07,867][123091] Updated weights for policy 0, policy_version 919921 (0.0008) [2023-12-26 06:56:07,896][123090] Updated weights for policy 1, policy_version 913468 (0.0009) [2023-12-26 06:56:07,931][123091] Updated weights for policy 0, policy_version 919931 (0.0006) [2023-12-26 06:56:07,984][123091] Updated weights for policy 0, policy_version 919941 (0.0006) [2023-12-26 06:56:08,035][123091] Updated weights for policy 0, policy_version 919951 (0.0010) [2023-12-26 06:56:08,713][123090] Updated weights for policy 1, policy_version 913478 (0.0009) [2023-12-26 06:56:08,777][123090] Updated weights for policy 1, policy_version 913488 (0.0009) [2023-12-26 06:56:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 469360640. Throughput: 0: 8898.3, 1: 8898.4. Samples: 469342440. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:08,784][121949] Avg episode reward: [(0, '6243.618'), (1, '5706.699')] [2023-12-26 06:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000919952_235511808.pth... [2023-12-26 06:56:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000918896_235241472.pth [2023-12-26 06:56:08,845][123090] Updated weights for policy 1, policy_version 913498 (0.0009) [2023-12-26 06:56:08,872][123091] Updated weights for policy 0, policy_version 919961 (0.0006) [2023-12-26 06:56:08,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000913504_233857024.pth... [2023-12-26 06:56:08,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000912480_233594880.pth [2023-12-26 06:56:08,925][123091] Updated weights for policy 0, policy_version 919971 (0.0005) [2023-12-26 06:56:08,983][123091] Updated weights for policy 0, policy_version 919981 (0.0007) [2023-12-26 06:56:09,534][123090] Updated weights for policy 1, policy_version 913508 (0.0006) [2023-12-26 06:56:09,611][123090] Updated weights for policy 1, policy_version 913518 (0.0006) [2023-12-26 06:56:09,688][123090] Updated weights for policy 1, policy_version 913528 (0.0005) [2023-12-26 06:56:09,709][123091] Updated weights for policy 0, policy_version 919991 (0.0009) [2023-12-26 06:56:09,774][123091] Updated weights for policy 0, policy_version 920001 (0.0011) [2023-12-26 06:56:09,834][123091] Updated weights for policy 0, policy_version 920011 (0.0011) [2023-12-26 06:56:10,391][123090] Updated weights for policy 1, policy_version 913538 (0.0007) [2023-12-26 06:56:10,448][123090] Updated weights for policy 1, policy_version 913548 (0.0008) [2023-12-26 06:56:10,516][123090] Updated weights for policy 1, policy_version 913558 (0.0009) [2023-12-26 06:56:10,588][123090] Updated weights for policy 1, policy_version 913568 (0.0005) [2023-12-26 06:56:10,683][123091] Updated weights for policy 0, policy_version 920021 (0.0008) [2023-12-26 06:56:10,737][123091] Updated weights for policy 0, policy_version 920031 (0.0005) [2023-12-26 06:56:10,787][123091] Updated weights for policy 0, policy_version 920041 (0.0010) [2023-12-26 06:56:11,392][123090] Updated weights for policy 1, policy_version 913578 (0.0010) [2023-12-26 06:56:11,463][123090] Updated weights for policy 1, policy_version 913588 (0.0010) [2023-12-26 06:56:11,534][123090] Updated weights for policy 1, policy_version 913598 (0.0008) [2023-12-26 06:56:11,663][123091] Updated weights for policy 0, policy_version 920051 (0.0010) [2023-12-26 06:56:11,738][123091] Updated weights for policy 0, policy_version 920061 (0.0011) [2023-12-26 06:56:11,808][123091] Updated weights for policy 0, policy_version 920071 (0.0010) [2023-12-26 06:56:12,375][123090] Updated weights for policy 1, policy_version 913608 (0.0009) [2023-12-26 06:56:12,433][123090] Updated weights for policy 1, policy_version 913618 (0.0010) [2023-12-26 06:56:12,487][123090] Updated weights for policy 1, policy_version 913628 (0.0010) [2023-12-26 06:56:12,629][123091] Updated weights for policy 0, policy_version 920081 (0.0009) [2023-12-26 06:56:12,694][123091] Updated weights for policy 0, policy_version 920091 (0.0007) [2023-12-26 06:56:12,765][123091] Updated weights for policy 0, policy_version 920101 (0.0006) [2023-12-26 06:56:12,823][123091] Updated weights for policy 0, policy_version 920111 (0.0006) [2023-12-26 06:56:13,348][123090] Updated weights for policy 1, policy_version 913638 (0.0009) [2023-12-26 06:56:13,409][123090] Updated weights for policy 1, policy_version 913648 (0.0010) [2023-12-26 06:56:13,472][123090] Updated weights for policy 1, policy_version 913658 (0.0009) [2023-12-26 06:56:13,580][123091] Updated weights for policy 0, policy_version 920121 (0.0009) [2023-12-26 06:56:13,634][123091] Updated weights for policy 0, policy_version 920131 (0.0010) [2023-12-26 06:56:13,683][123091] Updated weights for policy 0, policy_version 920141 (0.0009) [2023-12-26 06:56:13,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 469458944. Throughput: 0: 8917.1, 1: 8814.8. Samples: 469448056. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:13,785][121949] Avg episode reward: [(0, '6239.386'), (1, '5836.079')] [2023-12-26 06:56:14,301][123090] Updated weights for policy 1, policy_version 913668 (0.0009) [2023-12-26 06:56:14,366][123090] Updated weights for policy 1, policy_version 913678 (0.0009) [2023-12-26 06:56:14,427][123090] Updated weights for policy 1, policy_version 913688 (0.0010) [2023-12-26 06:56:14,510][123091] Updated weights for policy 0, policy_version 920151 (0.0009) [2023-12-26 06:56:14,558][123091] Updated weights for policy 0, policy_version 920161 (0.0009) [2023-12-26 06:56:14,617][123091] Updated weights for policy 0, policy_version 920171 (0.0009) [2023-12-26 06:56:15,264][123090] Updated weights for policy 1, policy_version 913698 (0.0010) [2023-12-26 06:56:15,329][123090] Updated weights for policy 1, policy_version 913708 (0.0010) [2023-12-26 06:56:15,398][123090] Updated weights for policy 1, policy_version 913718 (0.0010) [2023-12-26 06:56:15,463][123090] Updated weights for policy 1, policy_version 913728 (0.0009) [2023-12-26 06:56:15,493][123091] Updated weights for policy 0, policy_version 920181 (0.0009) [2023-12-26 06:56:15,550][123091] Updated weights for policy 0, policy_version 920191 (0.0008) [2023-12-26 06:56:15,608][123091] Updated weights for policy 0, policy_version 920201 (0.0005) [2023-12-26 06:56:16,341][123090] Updated weights for policy 1, policy_version 913738 (0.0010) [2023-12-26 06:56:16,397][123091] Updated weights for policy 0, policy_version 920211 (0.0006) [2023-12-26 06:56:16,405][123090] Updated weights for policy 1, policy_version 913748 (0.0009) [2023-12-26 06:56:16,468][123090] Updated weights for policy 1, policy_version 913758 (0.0010) [2023-12-26 06:56:16,489][123091] Updated weights for policy 0, policy_version 920221 (0.0008) [2023-12-26 06:56:16,556][123091] Updated weights for policy 0, policy_version 920231 (0.0009) [2023-12-26 06:56:17,257][123091] Updated weights for policy 0, policy_version 920241 (0.0009) [2023-12-26 06:56:17,316][123091] Updated weights for policy 0, policy_version 920251 (0.0009) [2023-12-26 06:56:17,339][123090] Updated weights for policy 1, policy_version 913768 (0.0009) [2023-12-26 06:56:17,367][123091] Updated weights for policy 0, policy_version 920261 (0.0006) [2023-12-26 06:56:17,399][123090] Updated weights for policy 1, policy_version 913778 (0.0010) [2023-12-26 06:56:17,419][123091] Updated weights for policy 0, policy_version 920271 (0.0006) [2023-12-26 06:56:17,464][123090] Updated weights for policy 1, policy_version 913788 (0.0009) [2023-12-26 06:56:18,222][123091] Updated weights for policy 0, policy_version 920281 (0.0009) [2023-12-26 06:56:18,277][123090] Updated weights for policy 1, policy_version 913798 (0.0009) [2023-12-26 06:56:18,279][123091] Updated weights for policy 0, policy_version 920291 (0.0008) [2023-12-26 06:56:18,334][123091] Updated weights for policy 0, policy_version 920301 (0.0009) [2023-12-26 06:56:18,341][123090] Updated weights for policy 1, policy_version 913808 (0.0009) [2023-12-26 06:56:18,402][123090] Updated weights for policy 1, policy_version 913818 (0.0008) [2023-12-26 06:56:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 469540864. Throughput: 0: 8933.2, 1: 8750.7. Samples: 469550536. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:18,785][121949] Avg episode reward: [(0, '6262.244'), (1, '5908.726')] [2023-12-26 06:56:19,155][123091] Updated weights for policy 0, policy_version 920311 (0.0007) [2023-12-26 06:56:19,200][123091] Updated weights for policy 0, policy_version 920321 (0.0005) [2023-12-26 06:56:19,268][123091] Updated weights for policy 0, policy_version 920331 (0.0009) [2023-12-26 06:56:19,276][123090] Updated weights for policy 1, policy_version 913828 (0.0008) [2023-12-26 06:56:19,344][123090] Updated weights for policy 1, policy_version 913838 (0.0010) [2023-12-26 06:56:19,414][123090] Updated weights for policy 1, policy_version 913848 (0.0011) [2023-12-26 06:56:20,126][123091] Updated weights for policy 0, policy_version 920341 (0.0009) [2023-12-26 06:56:20,189][123091] Updated weights for policy 0, policy_version 920351 (0.0009) [2023-12-26 06:56:20,250][123090] Updated weights for policy 1, policy_version 913858 (0.0009) [2023-12-26 06:56:20,252][123091] Updated weights for policy 0, policy_version 920361 (0.0011) [2023-12-26 06:56:20,299][123090] Updated weights for policy 1, policy_version 913868 (0.0007) [2023-12-26 06:56:20,356][123090] Updated weights for policy 1, policy_version 913878 (0.0009) [2023-12-26 06:56:20,421][123090] Updated weights for policy 1, policy_version 913888 (0.0009) [2023-12-26 06:56:21,001][123091] Updated weights for policy 0, policy_version 920371 (0.0009) [2023-12-26 06:56:21,069][123091] Updated weights for policy 0, policy_version 920381 (0.0008) [2023-12-26 06:56:21,135][123091] Updated weights for policy 0, policy_version 920391 (0.0008) [2023-12-26 06:56:21,380][123090] Updated weights for policy 1, policy_version 913898 (0.0009) [2023-12-26 06:56:21,453][123090] Updated weights for policy 1, policy_version 913908 (0.0009) [2023-12-26 06:56:21,510][123090] Updated weights for policy 1, policy_version 913918 (0.0009) [2023-12-26 06:56:21,919][123091] Updated weights for policy 0, policy_version 920401 (0.0010) [2023-12-26 06:56:21,991][123091] Updated weights for policy 0, policy_version 920411 (0.0007) [2023-12-26 06:56:22,058][123091] Updated weights for policy 0, policy_version 920421 (0.0008) [2023-12-26 06:56:22,131][123091] Updated weights for policy 0, policy_version 920431 (0.0010) [2023-12-26 06:56:22,407][123090] Updated weights for policy 1, policy_version 913928 (0.0010) [2023-12-26 06:56:22,460][123090] Updated weights for policy 1, policy_version 913938 (0.0010) [2023-12-26 06:56:22,552][123090] Updated weights for policy 1, policy_version 913948 (0.0009) [2023-12-26 06:56:22,849][123091] Updated weights for policy 0, policy_version 920441 (0.0006) [2023-12-26 06:56:22,918][123091] Updated weights for policy 0, policy_version 920451 (0.0005) [2023-12-26 06:56:22,993][123091] Updated weights for policy 0, policy_version 920461 (0.0006) [2023-12-26 06:56:23,429][123090] Updated weights for policy 1, policy_version 913958 (0.0010) [2023-12-26 06:56:23,490][123090] Updated weights for policy 1, policy_version 913968 (0.0009) [2023-12-26 06:56:23,554][123090] Updated weights for policy 1, policy_version 913978 (0.0009) [2023-12-26 06:56:23,742][123091] Updated weights for policy 0, policy_version 920471 (0.0005) [2023-12-26 06:56:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 469622784. Throughput: 0: 8913.1, 1: 8706.0. Samples: 469600940. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:23,784][121949] Avg episode reward: [(0, '6241.801'), (1, '5801.974')] [2023-12-26 06:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000913984_233979904.pth... [2023-12-26 06:56:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000912960_233717760.pth [2023-12-26 06:56:23,814][123091] Updated weights for policy 0, policy_version 920481 (0.0006) [2023-12-26 06:56:23,877][123091] Updated weights for policy 0, policy_version 920491 (0.0005) [2023-12-26 06:56:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000920496_235651072.pth... [2023-12-26 06:56:23,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000919440_235380736.pth [2023-12-26 06:56:24,431][123090] Updated weights for policy 1, policy_version 913988 (0.0009) [2023-12-26 06:56:24,487][123090] Updated weights for policy 1, policy_version 913998 (0.0008) [2023-12-26 06:56:24,489][123091] Updated weights for policy 0, policy_version 920501 (0.0008) [2023-12-26 06:56:24,549][123090] Updated weights for policy 1, policy_version 914008 (0.0009) [2023-12-26 06:56:24,551][123091] Updated weights for policy 0, policy_version 920511 (0.0009) [2023-12-26 06:56:24,595][123091] Updated weights for policy 0, policy_version 920521 (0.0008) [2023-12-26 06:56:25,382][123090] Updated weights for policy 1, policy_version 914018 (0.0010) [2023-12-26 06:56:25,443][123091] Updated weights for policy 0, policy_version 920531 (0.0010) [2023-12-26 06:56:25,445][123090] Updated weights for policy 1, policy_version 914028 (0.0009) [2023-12-26 06:56:25,495][123091] Updated weights for policy 0, policy_version 920541 (0.0009) [2023-12-26 06:56:25,516][123090] Updated weights for policy 1, policy_version 914038 (0.0007) [2023-12-26 06:56:25,544][123091] Updated weights for policy 0, policy_version 920551 (0.0007) [2023-12-26 06:56:25,564][123090] Updated weights for policy 1, policy_version 914048 (0.0008) [2023-12-26 06:56:26,357][123090] Updated weights for policy 1, policy_version 914058 (0.0005) [2023-12-26 06:56:26,408][123091] Updated weights for policy 0, policy_version 920561 (0.0009) [2023-12-26 06:56:26,415][123090] Updated weights for policy 1, policy_version 914068 (0.0005) [2023-12-26 06:56:26,466][123091] Updated weights for policy 0, policy_version 920571 (0.0009) [2023-12-26 06:56:26,473][123090] Updated weights for policy 1, policy_version 914078 (0.0006) [2023-12-26 06:56:26,518][123091] Updated weights for policy 0, policy_version 920581 (0.0009) [2023-12-26 06:56:26,564][123091] Updated weights for policy 0, policy_version 920591 (0.0008) [2023-12-26 06:56:27,139][123090] Updated weights for policy 1, policy_version 914088 (0.0009) [2023-12-26 06:56:27,194][123090] Updated weights for policy 1, policy_version 914098 (0.0010) [2023-12-26 06:56:27,245][123090] Updated weights for policy 1, policy_version 914108 (0.0010) [2023-12-26 06:56:27,415][123091] Updated weights for policy 0, policy_version 920601 (0.0009) [2023-12-26 06:56:27,468][123091] Updated weights for policy 0, policy_version 920611 (0.0009) [2023-12-26 06:56:27,527][123091] Updated weights for policy 0, policy_version 920621 (0.0010) [2023-12-26 06:56:28,026][123090] Updated weights for policy 1, policy_version 914118 (0.0007) [2023-12-26 06:56:28,083][123090] Updated weights for policy 1, policy_version 914128 (0.0005) [2023-12-26 06:56:28,133][123090] Updated weights for policy 1, policy_version 914138 (0.0005) [2023-12-26 06:56:28,420][123091] Updated weights for policy 0, policy_version 920632 (0.0008) [2023-12-26 06:56:28,488][123091] Updated weights for policy 0, policy_version 920642 (0.0009) [2023-12-26 06:56:28,562][123091] Updated weights for policy 0, policy_version 920652 (0.0010) [2023-12-26 06:56:28,775][123090] Updated weights for policy 1, policy_version 914148 (0.0005) [2023-12-26 06:56:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 469712896. Throughput: 0: 8989.6, 1: 8622.1. Samples: 469705884. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:28,784][121949] Avg episode reward: [(0, '6203.343'), (1, '5806.574')] [2023-12-26 06:56:28,829][123090] Updated weights for policy 1, policy_version 914158 (0.0006) [2023-12-26 06:56:28,886][123090] Updated weights for policy 1, policy_version 914168 (0.0005) [2023-12-26 06:56:29,413][123091] Updated weights for policy 0, policy_version 920662 (0.0010) [2023-12-26 06:56:29,479][123091] Updated weights for policy 0, policy_version 920672 (0.0009) [2023-12-26 06:56:29,543][123091] Updated weights for policy 0, policy_version 920682 (0.0010) [2023-12-26 06:56:29,603][123090] Updated weights for policy 1, policy_version 914178 (0.0005) [2023-12-26 06:56:29,672][123090] Updated weights for policy 1, policy_version 914188 (0.0005) [2023-12-26 06:56:29,731][123090] Updated weights for policy 1, policy_version 914198 (0.0008) [2023-12-26 06:56:29,783][123090] Updated weights for policy 1, policy_version 914208 (0.0007) [2023-12-26 06:56:30,360][123091] Updated weights for policy 0, policy_version 920692 (0.0008) [2023-12-26 06:56:30,432][123091] Updated weights for policy 0, policy_version 920702 (0.0009) [2023-12-26 06:56:30,491][123091] Updated weights for policy 0, policy_version 920712 (0.0010) [2023-12-26 06:56:30,542][123090] Updated weights for policy 1, policy_version 914218 (0.0008) [2023-12-26 06:56:30,609][123090] Updated weights for policy 1, policy_version 914228 (0.0008) [2023-12-26 06:56:30,657][123090] Updated weights for policy 1, policy_version 914238 (0.0005) [2023-12-26 06:56:31,131][123091] Updated weights for policy 0, policy_version 920722 (0.0006) [2023-12-26 06:56:31,185][123091] Updated weights for policy 0, policy_version 920732 (0.0009) [2023-12-26 06:56:31,242][123091] Updated weights for policy 0, policy_version 920742 (0.0010) [2023-12-26 06:56:31,298][123091] Updated weights for policy 0, policy_version 920752 (0.0010) [2023-12-26 06:56:31,438][123090] Updated weights for policy 1, policy_version 914248 (0.0009) [2023-12-26 06:56:31,495][123090] Updated weights for policy 1, policy_version 914258 (0.0009) [2023-12-26 06:56:31,552][123090] Updated weights for policy 1, policy_version 914268 (0.0010) [2023-12-26 06:56:32,046][123091] Updated weights for policy 0, policy_version 920762 (0.0005) [2023-12-26 06:56:32,092][123091] Updated weights for policy 0, policy_version 920772 (0.0005) [2023-12-26 06:56:32,155][123091] Updated weights for policy 0, policy_version 920782 (0.0008) [2023-12-26 06:56:32,430][123090] Updated weights for policy 1, policy_version 914278 (0.0009) [2023-12-26 06:56:32,485][123090] Updated weights for policy 1, policy_version 914288 (0.0009) [2023-12-26 06:56:32,552][123090] Updated weights for policy 1, policy_version 914298 (0.0009) [2023-12-26 06:56:32,973][123091] Updated weights for policy 0, policy_version 920792 (0.0009) [2023-12-26 06:56:33,028][123091] Updated weights for policy 0, policy_version 920802 (0.0009) [2023-12-26 06:56:33,081][123091] Updated weights for policy 0, policy_version 920812 (0.0010) [2023-12-26 06:56:33,433][123090] Updated weights for policy 1, policy_version 914308 (0.0009) [2023-12-26 06:56:33,491][123090] Updated weights for policy 1, policy_version 914318 (0.0008) [2023-12-26 06:56:33,556][123090] Updated weights for policy 1, policy_version 914328 (0.0008) [2023-12-26 06:56:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 469803008. Throughput: 0: 8919.6, 1: 8734.7. Samples: 469814272. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:33,785][121949] Avg episode reward: [(0, '6201.463'), (1, '5778.350')] [2023-12-26 06:56:33,836][123091] Updated weights for policy 0, policy_version 920822 (0.0009) [2023-12-26 06:56:33,899][123091] Updated weights for policy 0, policy_version 920832 (0.0005) [2023-12-26 06:56:33,975][123091] Updated weights for policy 0, policy_version 920842 (0.0005) [2023-12-26 06:56:34,476][123090] Updated weights for policy 1, policy_version 914338 (0.0009) [2023-12-26 06:56:34,548][123090] Updated weights for policy 1, policy_version 914348 (0.0009) [2023-12-26 06:56:34,616][123090] Updated weights for policy 1, policy_version 914358 (0.0007) [2023-12-26 06:56:34,633][123091] Updated weights for policy 0, policy_version 920852 (0.0006) [2023-12-26 06:56:34,680][123090] Updated weights for policy 1, policy_version 914368 (0.0008) [2023-12-26 06:56:34,702][123091] Updated weights for policy 0, policy_version 920862 (0.0010) [2023-12-26 06:56:34,767][123091] Updated weights for policy 0, policy_version 920872 (0.0011) [2023-12-26 06:56:35,390][123090] Updated weights for policy 1, policy_version 914378 (0.0005) [2023-12-26 06:56:35,438][123090] Updated weights for policy 1, policy_version 914388 (0.0005) [2023-12-26 06:56:35,442][123091] Updated weights for policy 0, policy_version 920882 (0.0009) [2023-12-26 06:56:35,485][123090] Updated weights for policy 1, policy_version 914398 (0.0005) [2023-12-26 06:56:35,491][123091] Updated weights for policy 0, policy_version 920892 (0.0005) [2023-12-26 06:56:35,541][123091] Updated weights for policy 0, policy_version 920902 (0.0006) [2023-12-26 06:56:35,608][123091] Updated weights for policy 0, policy_version 920912 (0.0005) [2023-12-26 06:56:36,176][123090] Updated weights for policy 1, policy_version 914408 (0.0006) [2023-12-26 06:56:36,242][123090] Updated weights for policy 1, policy_version 914418 (0.0005) [2023-12-26 06:56:36,290][123091] Updated weights for policy 0, policy_version 920922 (0.0008) [2023-12-26 06:56:36,313][123090] Updated weights for policy 1, policy_version 914428 (0.0008) [2023-12-26 06:56:36,356][123091] Updated weights for policy 0, policy_version 920932 (0.0005) [2023-12-26 06:56:36,423][123091] Updated weights for policy 0, policy_version 920942 (0.0006) [2023-12-26 06:56:37,142][123090] Updated weights for policy 1, policy_version 914438 (0.0010) [2023-12-26 06:56:37,172][123091] Updated weights for policy 0, policy_version 920952 (0.0007) [2023-12-26 06:56:37,200][123090] Updated weights for policy 1, policy_version 914448 (0.0010) [2023-12-26 06:56:37,232][123091] Updated weights for policy 0, policy_version 920962 (0.0008) [2023-12-26 06:56:37,269][123090] Updated weights for policy 1, policy_version 914458 (0.0007) [2023-12-26 06:56:37,284][123091] Updated weights for policy 0, policy_version 920972 (0.0010) [2023-12-26 06:56:37,997][123090] Updated weights for policy 1, policy_version 914468 (0.0007) [2023-12-26 06:56:38,015][123091] Updated weights for policy 0, policy_version 920982 (0.0011) [2023-12-26 06:56:38,049][123090] Updated weights for policy 1, policy_version 914478 (0.0007) [2023-12-26 06:56:38,074][123091] Updated weights for policy 0, policy_version 920992 (0.0010) [2023-12-26 06:56:38,098][123090] Updated weights for policy 1, policy_version 914488 (0.0007) [2023-12-26 06:56:38,129][123091] Updated weights for policy 0, policy_version 921002 (0.0010) [2023-12-26 06:56:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 469893120. Throughput: 0: 9039.8, 1: 8769.4. Samples: 469872292. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:38,785][121949] Avg episode reward: [(0, '6242.922'), (1, '5576.854')] [2023-12-26 06:56:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000921008_235782144.pth... [2023-12-26 06:56:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000914496_234110976.pth... [2023-12-26 06:56:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000919952_235511808.pth [2023-12-26 06:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000913504_233857024.pth [2023-12-26 06:56:38,959][123090] Updated weights for policy 1, policy_version 914498 (0.0008) [2023-12-26 06:56:38,962][123091] Updated weights for policy 0, policy_version 921012 (0.0010) [2023-12-26 06:56:39,020][123090] Updated weights for policy 1, policy_version 914508 (0.0006) [2023-12-26 06:56:39,022][123091] Updated weights for policy 0, policy_version 921022 (0.0011) [2023-12-26 06:56:39,070][123090] Updated weights for policy 1, policy_version 914518 (0.0006) [2023-12-26 06:56:39,082][123091] Updated weights for policy 0, policy_version 921032 (0.0011) [2023-12-26 06:56:39,122][123090] Updated weights for policy 1, policy_version 914528 (0.0006) [2023-12-26 06:56:39,874][123090] Updated weights for policy 1, policy_version 914538 (0.0009) [2023-12-26 06:56:39,918][123091] Updated weights for policy 0, policy_version 921042 (0.0010) [2023-12-26 06:56:39,938][123090] Updated weights for policy 1, policy_version 914548 (0.0008) [2023-12-26 06:56:39,984][123091] Updated weights for policy 0, policy_version 921052 (0.0008) [2023-12-26 06:56:40,006][123090] Updated weights for policy 1, policy_version 914558 (0.0009) [2023-12-26 06:56:40,045][123091] Updated weights for policy 0, policy_version 921062 (0.0010) [2023-12-26 06:56:40,109][123091] Updated weights for policy 0, policy_version 921072 (0.0011) [2023-12-26 06:56:40,822][123091] Updated weights for policy 0, policy_version 921082 (0.0005) [2023-12-26 06:56:40,881][123090] Updated weights for policy 1, policy_version 914568 (0.0010) [2023-12-26 06:56:40,883][123091] Updated weights for policy 0, policy_version 921092 (0.0009) [2023-12-26 06:56:40,943][123091] Updated weights for policy 0, policy_version 921102 (0.0005) [2023-12-26 06:56:40,948][123090] Updated weights for policy 1, policy_version 914578 (0.0010) [2023-12-26 06:56:41,003][123090] Updated weights for policy 1, policy_version 914588 (0.0010) [2023-12-26 06:56:41,761][123091] Updated weights for policy 0, policy_version 921112 (0.0009) [2023-12-26 06:56:41,825][123091] Updated weights for policy 0, policy_version 921122 (0.0010) [2023-12-26 06:56:41,869][123090] Updated weights for policy 1, policy_version 914598 (0.0008) [2023-12-26 06:56:41,896][123091] Updated weights for policy 0, policy_version 921132 (0.0010) [2023-12-26 06:56:41,933][123090] Updated weights for policy 1, policy_version 914608 (0.0006) [2023-12-26 06:56:42,007][123090] Updated weights for policy 1, policy_version 914618 (0.0010) [2023-12-26 06:56:42,694][123090] Updated weights for policy 1, policy_version 914628 (0.0009) [2023-12-26 06:56:42,745][123091] Updated weights for policy 0, policy_version 921142 (0.0010) [2023-12-26 06:56:42,760][123090] Updated weights for policy 1, policy_version 914638 (0.0008) [2023-12-26 06:56:42,807][123091] Updated weights for policy 0, policy_version 921152 (0.0011) [2023-12-26 06:56:42,824][123090] Updated weights for policy 1, policy_version 914648 (0.0010) [2023-12-26 06:56:42,874][123091] Updated weights for policy 0, policy_version 921162 (0.0011) [2023-12-26 06:56:43,578][123090] Updated weights for policy 1, policy_version 914658 (0.0011) [2023-12-26 06:56:43,641][123090] Updated weights for policy 1, policy_version 914668 (0.0007) [2023-12-26 06:56:43,681][123091] Updated weights for policy 0, policy_version 921172 (0.0008) [2023-12-26 06:56:43,700][123090] Updated weights for policy 1, policy_version 914678 (0.0006) [2023-12-26 06:56:43,730][123091] Updated weights for policy 0, policy_version 921182 (0.0007) [2023-12-26 06:56:43,757][123090] Updated weights for policy 1, policy_version 914688 (0.0006) [2023-12-26 06:56:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 469983232. Throughput: 0: 9073.6, 1: 8711.8. Samples: 469977480. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:43,785][121949] Avg episode reward: [(0, '6123.201'), (1, '5536.759')] [2023-12-26 06:56:43,788][123091] Updated weights for policy 0, policy_version 921192 (0.0009) [2023-12-26 06:56:44,479][123090] Updated weights for policy 1, policy_version 914698 (0.0010) [2023-12-26 06:56:44,534][123090] Updated weights for policy 1, policy_version 914708 (0.0010) [2023-12-26 06:56:44,589][123090] Updated weights for policy 1, policy_version 914718 (0.0010) [2023-12-26 06:56:44,591][123091] Updated weights for policy 0, policy_version 921202 (0.0009) [2023-12-26 06:56:44,642][123091] Updated weights for policy 0, policy_version 921212 (0.0008) [2023-12-26 06:56:44,690][123091] Updated weights for policy 0, policy_version 921222 (0.0008) [2023-12-26 06:56:44,739][123091] Updated weights for policy 0, policy_version 921232 (0.0008) [2023-12-26 06:56:45,445][123090] Updated weights for policy 1, policy_version 914728 (0.0011) [2023-12-26 06:56:45,497][123090] Updated weights for policy 1, policy_version 914738 (0.0010) [2023-12-26 06:56:45,569][123090] Updated weights for policy 1, policy_version 914748 (0.0011) [2023-12-26 06:56:45,614][123091] Updated weights for policy 0, policy_version 921242 (0.0009) [2023-12-26 06:56:45,663][123091] Updated weights for policy 0, policy_version 921252 (0.0008) [2023-12-26 06:56:45,726][123091] Updated weights for policy 0, policy_version 921262 (0.0008) [2023-12-26 06:56:46,390][123090] Updated weights for policy 1, policy_version 914758 (0.0007) [2023-12-26 06:56:46,442][123090] Updated weights for policy 1, policy_version 914768 (0.0005) [2023-12-26 06:56:46,494][123090] Updated weights for policy 1, policy_version 914778 (0.0005) [2023-12-26 06:56:46,581][123091] Updated weights for policy 0, policy_version 921272 (0.0010) [2023-12-26 06:56:46,643][123091] Updated weights for policy 0, policy_version 921282 (0.0011) [2023-12-26 06:56:46,689][123091] Updated weights for policy 0, policy_version 921292 (0.0009) [2023-12-26 06:56:47,128][123090] Updated weights for policy 1, policy_version 914788 (0.0005) [2023-12-26 06:56:47,177][123090] Updated weights for policy 1, policy_version 914798 (0.0005) [2023-12-26 06:56:47,234][123090] Updated weights for policy 1, policy_version 914808 (0.0008) [2023-12-26 06:56:47,425][123091] Updated weights for policy 0, policy_version 921302 (0.0005) [2023-12-26 06:56:47,478][123091] Updated weights for policy 0, policy_version 921312 (0.0006) [2023-12-26 06:56:47,542][123091] Updated weights for policy 0, policy_version 921322 (0.0010) [2023-12-26 06:56:48,021][123090] Updated weights for policy 1, policy_version 914818 (0.0010) [2023-12-26 06:56:48,072][123090] Updated weights for policy 1, policy_version 914828 (0.0009) [2023-12-26 06:56:48,118][123090] Updated weights for policy 1, policy_version 914838 (0.0006) [2023-12-26 06:56:48,168][123090] Updated weights for policy 1, policy_version 914848 (0.0007) [2023-12-26 06:56:48,351][123091] Updated weights for policy 0, policy_version 921332 (0.0011) [2023-12-26 06:56:48,419][123091] Updated weights for policy 0, policy_version 921342 (0.0011) [2023-12-26 06:56:48,486][123091] Updated weights for policy 0, policy_version 921352 (0.0011) [2023-12-26 06:56:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 470073344. Throughput: 0: 8987.4, 1: 8743.3. Samples: 470085264. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:48,785][121949] Avg episode reward: [(0, '6196.976'), (1, '5652.485')] [2023-12-26 06:56:49,019][123090] Updated weights for policy 1, policy_version 914858 (0.0009) [2023-12-26 06:56:49,076][123090] Updated weights for policy 1, policy_version 914868 (0.0009) [2023-12-26 06:56:49,137][123090] Updated weights for policy 1, policy_version 914878 (0.0010) [2023-12-26 06:56:49,278][123091] Updated weights for policy 0, policy_version 921362 (0.0010) [2023-12-26 06:56:49,345][123091] Updated weights for policy 0, policy_version 921372 (0.0010) [2023-12-26 06:56:49,418][123091] Updated weights for policy 0, policy_version 921382 (0.0010) [2023-12-26 06:56:49,485][123091] Updated weights for policy 0, policy_version 921392 (0.0010) [2023-12-26 06:56:49,989][123090] Updated weights for policy 1, policy_version 914888 (0.0009) [2023-12-26 06:56:50,048][123090] Updated weights for policy 1, policy_version 914898 (0.0009) [2023-12-26 06:56:50,101][123090] Updated weights for policy 1, policy_version 914908 (0.0009) [2023-12-26 06:56:50,343][123091] Updated weights for policy 0, policy_version 921402 (0.0010) [2023-12-26 06:56:50,401][123091] Updated weights for policy 0, policy_version 921412 (0.0009) [2023-12-26 06:56:50,458][123091] Updated weights for policy 0, policy_version 921422 (0.0010) [2023-12-26 06:56:50,904][123090] Updated weights for policy 1, policy_version 914918 (0.0009) [2023-12-26 06:56:50,975][123090] Updated weights for policy 1, policy_version 914928 (0.0006) [2023-12-26 06:56:51,054][123090] Updated weights for policy 1, policy_version 914938 (0.0007) [2023-12-26 06:56:51,360][123091] Updated weights for policy 0, policy_version 921432 (0.0009) [2023-12-26 06:56:51,427][123091] Updated weights for policy 0, policy_version 921442 (0.0009) [2023-12-26 06:56:51,500][123091] Updated weights for policy 0, policy_version 921452 (0.0006) [2023-12-26 06:56:51,864][123090] Updated weights for policy 1, policy_version 914948 (0.0010) [2023-12-26 06:56:51,921][123090] Updated weights for policy 1, policy_version 914958 (0.0009) [2023-12-26 06:56:51,975][123090] Updated weights for policy 1, policy_version 914968 (0.0009) [2023-12-26 06:56:52,321][123091] Updated weights for policy 0, policy_version 921462 (0.0008) [2023-12-26 06:56:52,390][123091] Updated weights for policy 0, policy_version 921472 (0.0009) [2023-12-26 06:56:52,453][123091] Updated weights for policy 0, policy_version 921482 (0.0010) [2023-12-26 06:56:52,794][123090] Updated weights for policy 1, policy_version 914978 (0.0010) [2023-12-26 06:56:52,862][123090] Updated weights for policy 1, policy_version 914988 (0.0008) [2023-12-26 06:56:52,913][123090] Updated weights for policy 1, policy_version 914998 (0.0010) [2023-12-26 06:56:52,966][123090] Updated weights for policy 1, policy_version 915008 (0.0008) [2023-12-26 06:56:53,349][123091] Updated weights for policy 0, policy_version 921492 (0.0010) [2023-12-26 06:56:53,412][123091] Updated weights for policy 0, policy_version 921502 (0.0010) [2023-12-26 06:56:53,474][123091] Updated weights for policy 0, policy_version 921512 (0.0009) [2023-12-26 06:56:53,601][123090] Updated weights for policy 1, policy_version 915018 (0.0005) [2023-12-26 06:56:53,655][123090] Updated weights for policy 1, policy_version 915028 (0.0005) [2023-12-26 06:56:53,709][123090] Updated weights for policy 1, policy_version 915038 (0.0005) [2023-12-26 06:56:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 470163456. Throughput: 0: 8903.0, 1: 8726.5. Samples: 470135768. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:53,785][121949] Avg episode reward: [(0, '6221.751'), (1, '5664.703')] [2023-12-26 06:56:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000915040_234250240.pth... [2023-12-26 06:56:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000921520_235913216.pth... [2023-12-26 06:56:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000913984_233979904.pth [2023-12-26 06:56:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000920496_235651072.pth [2023-12-26 06:56:54,350][123091] Updated weights for policy 0, policy_version 921522 (0.0010) [2023-12-26 06:56:54,400][123091] Updated weights for policy 0, policy_version 921532 (0.0008) [2023-12-26 06:56:54,462][123091] Updated weights for policy 0, policy_version 921543 (0.0009) [2023-12-26 06:56:54,474][123090] Updated weights for policy 1, policy_version 915048 (0.0006) [2023-12-26 06:56:54,524][123090] Updated weights for policy 1, policy_version 915058 (0.0007) [2023-12-26 06:56:54,578][123090] Updated weights for policy 1, policy_version 915068 (0.0008) [2023-12-26 06:56:55,133][123091] Updated weights for policy 0, policy_version 921553 (0.0009) [2023-12-26 06:56:55,187][123091] Updated weights for policy 0, policy_version 921563 (0.0006) [2023-12-26 06:56:55,244][123091] Updated weights for policy 0, policy_version 921573 (0.0009) [2023-12-26 06:56:55,300][123091] Updated weights for policy 0, policy_version 921583 (0.0009) [2023-12-26 06:56:55,452][123090] Updated weights for policy 1, policy_version 915079 (0.0010) [2023-12-26 06:56:55,508][123090] Updated weights for policy 1, policy_version 915089 (0.0009) [2023-12-26 06:56:55,560][123090] Updated weights for policy 1, policy_version 915099 (0.0009) [2023-12-26 06:56:56,043][123091] Updated weights for policy 0, policy_version 921593 (0.0006) [2023-12-26 06:56:56,088][123091] Updated weights for policy 0, policy_version 921603 (0.0005) [2023-12-26 06:56:56,142][123091] Updated weights for policy 0, policy_version 921613 (0.0006) [2023-12-26 06:56:56,471][123090] Updated weights for policy 1, policy_version 915109 (0.0010) [2023-12-26 06:56:56,527][123090] Updated weights for policy 1, policy_version 915119 (0.0010) [2023-12-26 06:56:56,577][123090] Updated weights for policy 1, policy_version 915129 (0.0009) [2023-12-26 06:56:56,843][123091] Updated weights for policy 0, policy_version 921623 (0.0005) [2023-12-26 06:56:56,900][123091] Updated weights for policy 0, policy_version 921633 (0.0005) [2023-12-26 06:56:56,945][123091] Updated weights for policy 0, policy_version 921643 (0.0005) [2023-12-26 06:56:57,353][123090] Updated weights for policy 1, policy_version 915139 (0.0010) [2023-12-26 06:56:57,405][123090] Updated weights for policy 1, policy_version 915149 (0.0010) [2023-12-26 06:56:57,452][123090] Updated weights for policy 1, policy_version 915159 (0.0010) [2023-12-26 06:56:57,580][123091] Updated weights for policy 0, policy_version 921653 (0.0007) [2023-12-26 06:56:57,636][123091] Updated weights for policy 0, policy_version 921664 (0.0010) [2023-12-26 06:56:57,688][123091] Updated weights for policy 0, policy_version 921675 (0.0010) [2023-12-26 06:56:58,102][123090] Updated weights for policy 1, policy_version 915169 (0.0010) [2023-12-26 06:56:58,167][123090] Updated weights for policy 1, policy_version 915179 (0.0008) [2023-12-26 06:56:58,225][123090] Updated weights for policy 1, policy_version 915189 (0.0009) [2023-12-26 06:56:58,296][123090] Updated weights for policy 1, policy_version 915199 (0.0010) [2023-12-26 06:56:58,611][123091] Updated weights for policy 0, policy_version 921685 (0.0009) [2023-12-26 06:56:58,685][123091] Updated weights for policy 0, policy_version 921695 (0.0010) [2023-12-26 06:56:58,763][123091] Updated weights for policy 0, policy_version 921705 (0.0009) [2023-12-26 06:56:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 470245376. Throughput: 0: 8951.8, 1: 8749.0. Samples: 470244592. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:56:58,785][121949] Avg episode reward: [(0, '6300.152'), (1, '5683.092')] [2023-12-26 06:56:59,177][123090] Updated weights for policy 1, policy_version 915209 (0.0008) [2023-12-26 06:56:59,247][123090] Updated weights for policy 1, policy_version 915219 (0.0009) [2023-12-26 06:56:59,317][123090] Updated weights for policy 1, policy_version 915229 (0.0010) [2023-12-26 06:56:59,583][123091] Updated weights for policy 0, policy_version 921715 (0.0008) [2023-12-26 06:56:59,642][123091] Updated weights for policy 0, policy_version 921725 (0.0005) [2023-12-26 06:56:59,708][123091] Updated weights for policy 0, policy_version 921735 (0.0005) [2023-12-26 06:57:00,183][123090] Updated weights for policy 1, policy_version 915239 (0.0009) [2023-12-26 06:57:00,238][123090] Updated weights for policy 1, policy_version 915249 (0.0009) [2023-12-26 06:57:00,302][123090] Updated weights for policy 1, policy_version 915259 (0.0006) [2023-12-26 06:57:00,453][123091] Updated weights for policy 0, policy_version 921745 (0.0006) [2023-12-26 06:57:00,504][123091] Updated weights for policy 0, policy_version 921755 (0.0009) [2023-12-26 06:57:00,559][123091] Updated weights for policy 0, policy_version 921766 (0.0010) [2023-12-26 06:57:00,610][123091] Updated weights for policy 0, policy_version 921776 (0.0009) [2023-12-26 06:57:01,096][123090] Updated weights for policy 1, policy_version 915269 (0.0009) [2023-12-26 06:57:01,156][123090] Updated weights for policy 1, policy_version 915279 (0.0009) [2023-12-26 06:57:01,217][123090] Updated weights for policy 1, policy_version 915289 (0.0009) [2023-12-26 06:57:01,450][123091] Updated weights for policy 0, policy_version 921786 (0.0007) [2023-12-26 06:57:01,496][123091] Updated weights for policy 0, policy_version 921796 (0.0009) [2023-12-26 06:57:01,549][123091] Updated weights for policy 0, policy_version 921806 (0.0010) [2023-12-26 06:57:02,066][123090] Updated weights for policy 1, policy_version 915299 (0.0008) [2023-12-26 06:57:02,122][123090] Updated weights for policy 1, policy_version 915309 (0.0006) [2023-12-26 06:57:02,177][123090] Updated weights for policy 1, policy_version 915319 (0.0005) [2023-12-26 06:57:02,254][123091] Updated weights for policy 0, policy_version 921816 (0.0007) [2023-12-26 06:57:02,316][123091] Updated weights for policy 0, policy_version 921826 (0.0011) [2023-12-26 06:57:02,374][123091] Updated weights for policy 0, policy_version 921836 (0.0009) [2023-12-26 06:57:02,951][123090] Updated weights for policy 1, policy_version 915329 (0.0006) [2023-12-26 06:57:03,009][123090] Updated weights for policy 1, policy_version 915339 (0.0010) [2023-12-26 06:57:03,048][123091] Updated weights for policy 0, policy_version 921846 (0.0007) [2023-12-26 06:57:03,064][123090] Updated weights for policy 1, policy_version 915349 (0.0010) [2023-12-26 06:57:03,101][123091] Updated weights for policy 0, policy_version 921856 (0.0005) [2023-12-26 06:57:03,118][123090] Updated weights for policy 1, policy_version 915359 (0.0010) [2023-12-26 06:57:03,171][123091] Updated weights for policy 0, policy_version 921866 (0.0005) [2023-12-26 06:57:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 470335488. Throughput: 0: 9005.9, 1: 8801.9. Samples: 470351888. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:57:03,785][121949] Avg episode reward: [(0, '6362.507'), (1, '5699.016')] [2023-12-26 06:57:03,801][123091] Updated weights for policy 0, policy_version 921876 (0.0006) [2023-12-26 06:57:03,874][123091] Updated weights for policy 0, policy_version 921886 (0.0011) [2023-12-26 06:57:03,902][123090] Updated weights for policy 1, policy_version 915369 (0.0008) [2023-12-26 06:57:03,943][123091] Updated weights for policy 0, policy_version 921896 (0.0005) [2023-12-26 06:57:03,957][123090] Updated weights for policy 1, policy_version 915379 (0.0008) [2023-12-26 06:57:04,016][123090] Updated weights for policy 1, policy_version 915389 (0.0010) [2023-12-26 06:57:04,618][123091] Updated weights for policy 0, policy_version 921906 (0.0006) [2023-12-26 06:57:04,683][123091] Updated weights for policy 0, policy_version 921916 (0.0009) [2023-12-26 06:57:04,744][123091] Updated weights for policy 0, policy_version 921926 (0.0007) [2023-12-26 06:57:04,801][123090] Updated weights for policy 1, policy_version 915399 (0.0009) [2023-12-26 06:57:04,811][123091] Updated weights for policy 0, policy_version 921936 (0.0008) [2023-12-26 06:57:04,866][123090] Updated weights for policy 1, policy_version 915409 (0.0007) [2023-12-26 06:57:04,923][123090] Updated weights for policy 1, policy_version 915419 (0.0009) [2023-12-26 06:57:05,579][123091] Updated weights for policy 0, policy_version 921946 (0.0008) [2023-12-26 06:57:05,647][123091] Updated weights for policy 0, policy_version 921956 (0.0011) [2023-12-26 06:57:05,685][123090] Updated weights for policy 1, policy_version 915429 (0.0010) [2023-12-26 06:57:05,708][123091] Updated weights for policy 0, policy_version 921966 (0.0010) [2023-12-26 06:57:05,744][123090] Updated weights for policy 1, policy_version 915439 (0.0008) [2023-12-26 06:57:05,803][123090] Updated weights for policy 1, policy_version 915449 (0.0009) [2023-12-26 06:57:06,525][123091] Updated weights for policy 0, policy_version 921976 (0.0011) [2023-12-26 06:57:06,596][123091] Updated weights for policy 0, policy_version 921986 (0.0011) [2023-12-26 06:57:06,668][123091] Updated weights for policy 0, policy_version 921996 (0.0011) [2023-12-26 06:57:06,686][123090] Updated weights for policy 1, policy_version 915459 (0.0010) [2023-12-26 06:57:06,747][123090] Updated weights for policy 1, policy_version 915469 (0.0008) [2023-12-26 06:57:06,807][123090] Updated weights for policy 1, policy_version 915479 (0.0009) [2023-12-26 06:57:07,328][123091] Updated weights for policy 0, policy_version 922006 (0.0011) [2023-12-26 06:57:07,379][123091] Updated weights for policy 0, policy_version 922016 (0.0010) [2023-12-26 06:57:07,435][123091] Updated weights for policy 0, policy_version 922026 (0.0011) [2023-12-26 06:57:07,650][123090] Updated weights for policy 1, policy_version 915489 (0.0009) [2023-12-26 06:57:07,716][123090] Updated weights for policy 1, policy_version 915499 (0.0006) [2023-12-26 06:57:07,773][123090] Updated weights for policy 1, policy_version 915509 (0.0005) [2023-12-26 06:57:07,830][123090] Updated weights for policy 1, policy_version 915519 (0.0005) [2023-12-26 06:57:08,250][123091] Updated weights for policy 0, policy_version 922036 (0.0008) [2023-12-26 06:57:08,295][123091] Updated weights for policy 0, policy_version 922046 (0.0005) [2023-12-26 06:57:08,353][123091] Updated weights for policy 0, policy_version 922056 (0.0010) [2023-12-26 06:57:08,493][123090] Updated weights for policy 1, policy_version 915529 (0.0009) [2023-12-26 06:57:08,549][123090] Updated weights for policy 1, policy_version 915539 (0.0010) [2023-12-26 06:57:08,604][123090] Updated weights for policy 1, policy_version 915549 (0.0010) [2023-12-26 06:57:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 470433792. Throughput: 0: 9016.7, 1: 8857.9. Samples: 470405300. Policy #0 lag: (min: 5.0, avg: 12.4, max: 37.0) [2023-12-26 06:57:08,785][121949] Avg episode reward: [(0, '6277.907'), (1, '5776.068')] [2023-12-26 06:57:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000922064_236052480.pth... [2023-12-26 06:57:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000915552_234381312.pth... [2023-12-26 06:57:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000914496_234110976.pth [2023-12-26 06:57:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000921008_235782144.pth [2023-12-26 06:57:09,049][123091] Updated weights for policy 0, policy_version 922066 (0.0011) [2023-12-26 06:57:09,096][123091] Updated weights for policy 0, policy_version 922076 (0.0010) [2023-12-26 06:57:09,143][123091] Updated weights for policy 0, policy_version 922086 (0.0010) [2023-12-26 06:57:09,205][123091] Updated weights for policy 0, policy_version 922096 (0.0010) [2023-12-26 06:57:09,468][123090] Updated weights for policy 1, policy_version 915559 (0.0010) [2023-12-26 06:57:09,528][123090] Updated weights for policy 1, policy_version 915569 (0.0009) [2023-12-26 06:57:09,597][123090] Updated weights for policy 1, policy_version 915579 (0.0009) [2023-12-26 06:57:10,072][123091] Updated weights for policy 0, policy_version 922106 (0.0006) [2023-12-26 06:57:10,144][123091] Updated weights for policy 0, policy_version 922116 (0.0009) [2023-12-26 06:57:10,208][123091] Updated weights for policy 0, policy_version 922126 (0.0009) [2023-12-26 06:57:10,445][123090] Updated weights for policy 1, policy_version 915589 (0.0007) [2023-12-26 06:57:10,511][123090] Updated weights for policy 1, policy_version 915599 (0.0007) [2023-12-26 06:57:10,570][123090] Updated weights for policy 1, policy_version 915609 (0.0005) [2023-12-26 06:57:10,870][123091] Updated weights for policy 0, policy_version 922136 (0.0006) [2023-12-26 06:57:10,935][123091] Updated weights for policy 0, policy_version 922146 (0.0006) [2023-12-26 06:57:10,990][123091] Updated weights for policy 0, policy_version 922156 (0.0007) [2023-12-26 06:57:11,284][123090] Updated weights for policy 1, policy_version 915619 (0.0006) [2023-12-26 06:57:11,359][123090] Updated weights for policy 1, policy_version 915629 (0.0007) [2023-12-26 06:57:11,436][123090] Updated weights for policy 1, policy_version 915639 (0.0010) [2023-12-26 06:57:11,781][123091] Updated weights for policy 0, policy_version 922166 (0.0008) [2023-12-26 06:57:11,849][123091] Updated weights for policy 0, policy_version 922176 (0.0009) [2023-12-26 06:57:11,917][123091] Updated weights for policy 0, policy_version 922186 (0.0009) [2023-12-26 06:57:12,228][123090] Updated weights for policy 1, policy_version 915649 (0.0010) [2023-12-26 06:57:12,292][123090] Updated weights for policy 1, policy_version 915659 (0.0009) [2023-12-26 06:57:12,362][123090] Updated weights for policy 1, policy_version 915669 (0.0010) [2023-12-26 06:57:12,442][123090] Updated weights for policy 1, policy_version 915679 (0.0009) [2023-12-26 06:57:12,759][123091] Updated weights for policy 0, policy_version 922196 (0.0010) [2023-12-26 06:57:12,827][123091] Updated weights for policy 0, policy_version 922206 (0.0009) [2023-12-26 06:57:12,894][123091] Updated weights for policy 0, policy_version 922216 (0.0009) [2023-12-26 06:57:13,270][123090] Updated weights for policy 1, policy_version 915689 (0.0009) [2023-12-26 06:57:13,318][123090] Updated weights for policy 1, policy_version 915699 (0.0009) [2023-12-26 06:57:13,363][123090] Updated weights for policy 1, policy_version 915709 (0.0007) [2023-12-26 06:57:13,686][123091] Updated weights for policy 0, policy_version 922226 (0.0008) [2023-12-26 06:57:13,740][123091] Updated weights for policy 0, policy_version 922236 (0.0006) [2023-12-26 06:57:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 470515712. Throughput: 0: 9030.8, 1: 8880.7. Samples: 470511904. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:13,784][121949] Avg episode reward: [(0, '6196.998'), (1, '5802.111')] [2023-12-26 06:57:13,797][123091] Updated weights for policy 0, policy_version 922246 (0.0006) [2023-12-26 06:57:13,850][123091] Updated weights for policy 0, policy_version 922256 (0.0010) [2023-12-26 06:57:14,110][123090] Updated weights for policy 1, policy_version 915719 (0.0009) [2023-12-26 06:57:14,167][123090] Updated weights for policy 1, policy_version 915729 (0.0005) [2023-12-26 06:57:14,247][123090] Updated weights for policy 1, policy_version 915739 (0.0006) [2023-12-26 06:57:14,501][123091] Updated weights for policy 0, policy_version 922266 (0.0005) [2023-12-26 06:57:14,558][123091] Updated weights for policy 0, policy_version 922276 (0.0006) [2023-12-26 06:57:14,638][123091] Updated weights for policy 0, policy_version 922286 (0.0010) [2023-12-26 06:57:14,959][123090] Updated weights for policy 1, policy_version 915749 (0.0005) [2023-12-26 06:57:15,026][123090] Updated weights for policy 1, policy_version 915759 (0.0006) [2023-12-26 06:57:15,099][123090] Updated weights for policy 1, policy_version 915769 (0.0006) [2023-12-26 06:57:15,469][123091] Updated weights for policy 0, policy_version 922296 (0.0009) [2023-12-26 06:57:15,532][123091] Updated weights for policy 0, policy_version 922306 (0.0008) [2023-12-26 06:57:15,595][123091] Updated weights for policy 0, policy_version 922316 (0.0009) [2023-12-26 06:57:15,837][123090] Updated weights for policy 1, policy_version 915779 (0.0007) [2023-12-26 06:57:15,905][123090] Updated weights for policy 1, policy_version 915789 (0.0006) [2023-12-26 06:57:15,968][123090] Updated weights for policy 1, policy_version 915799 (0.0006) [2023-12-26 06:57:16,400][123091] Updated weights for policy 0, policy_version 922326 (0.0007) [2023-12-26 06:57:16,469][123091] Updated weights for policy 0, policy_version 922336 (0.0006) [2023-12-26 06:57:16,535][123091] Updated weights for policy 0, policy_version 922346 (0.0005) [2023-12-26 06:57:16,712][123090] Updated weights for policy 1, policy_version 915809 (0.0006) [2023-12-26 06:57:16,763][123090] Updated weights for policy 1, policy_version 915819 (0.0010) [2023-12-26 06:57:16,811][123090] Updated weights for policy 1, policy_version 915829 (0.0010) [2023-12-26 06:57:16,863][123090] Updated weights for policy 1, policy_version 915839 (0.0010) [2023-12-26 06:57:17,195][123091] Updated weights for policy 0, policy_version 922356 (0.0008) [2023-12-26 06:57:17,251][123091] Updated weights for policy 0, policy_version 922366 (0.0011) [2023-12-26 06:57:17,312][123091] Updated weights for policy 0, policy_version 922376 (0.0009) [2023-12-26 06:57:17,607][123090] Updated weights for policy 1, policy_version 915849 (0.0006) [2023-12-26 06:57:17,658][123090] Updated weights for policy 1, policy_version 915859 (0.0005) [2023-12-26 06:57:17,723][123090] Updated weights for policy 1, policy_version 915869 (0.0005) [2023-12-26 06:57:18,116][123091] Updated weights for policy 0, policy_version 922386 (0.0006) [2023-12-26 06:57:18,170][123091] Updated weights for policy 0, policy_version 922396 (0.0010) [2023-12-26 06:57:18,218][123091] Updated weights for policy 0, policy_version 922406 (0.0010) [2023-12-26 06:57:18,271][123091] Updated weights for policy 0, policy_version 922416 (0.0009) [2023-12-26 06:57:18,332][123090] Updated weights for policy 1, policy_version 915879 (0.0008) [2023-12-26 06:57:18,402][123090] Updated weights for policy 1, policy_version 915889 (0.0009) [2023-12-26 06:57:18,470][123090] Updated weights for policy 1, policy_version 915899 (0.0010) [2023-12-26 06:57:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 470614016. Throughput: 0: 9045.5, 1: 8940.0. Samples: 470623620. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:18,784][121949] Avg episode reward: [(0, '6153.860'), (1, '5766.402')] [2023-12-26 06:57:19,077][123091] Updated weights for policy 0, policy_version 922426 (0.0011) [2023-12-26 06:57:19,141][123091] Updated weights for policy 0, policy_version 922436 (0.0011) [2023-12-26 06:57:19,207][123091] Updated weights for policy 0, policy_version 922446 (0.0011) [2023-12-26 06:57:19,332][123090] Updated weights for policy 1, policy_version 915909 (0.0010) [2023-12-26 06:57:19,402][123090] Updated weights for policy 1, policy_version 915919 (0.0007) [2023-12-26 06:57:19,473][123090] Updated weights for policy 1, policy_version 915929 (0.0007) [2023-12-26 06:57:20,064][123091] Updated weights for policy 0, policy_version 922456 (0.0010) [2023-12-26 06:57:20,132][123091] Updated weights for policy 0, policy_version 922466 (0.0009) [2023-12-26 06:57:20,196][123091] Updated weights for policy 0, policy_version 922476 (0.0010) [2023-12-26 06:57:20,228][123090] Updated weights for policy 1, policy_version 915939 (0.0008) [2023-12-26 06:57:20,286][123090] Updated weights for policy 1, policy_version 915949 (0.0009) [2023-12-26 06:57:20,343][123090] Updated weights for policy 1, policy_version 915959 (0.0009) [2023-12-26 06:57:21,060][123091] Updated weights for policy 0, policy_version 922486 (0.0009) [2023-12-26 06:57:21,124][123091] Updated weights for policy 0, policy_version 922496 (0.0009) [2023-12-26 06:57:21,186][123091] Updated weights for policy 0, policy_version 922506 (0.0010) [2023-12-26 06:57:21,232][123090] Updated weights for policy 1, policy_version 915970 (0.0010) [2023-12-26 06:57:21,302][123090] Updated weights for policy 1, policy_version 915980 (0.0010) [2023-12-26 06:57:21,376][123090] Updated weights for policy 1, policy_version 915990 (0.0009) [2023-12-26 06:57:21,443][123090] Updated weights for policy 1, policy_version 916000 (0.0010) [2023-12-26 06:57:22,050][123091] Updated weights for policy 0, policy_version 922516 (0.0010) [2023-12-26 06:57:22,108][123091] Updated weights for policy 0, policy_version 922526 (0.0009) [2023-12-26 06:57:22,170][123091] Updated weights for policy 0, policy_version 922536 (0.0009) [2023-12-26 06:57:22,338][123090] Updated weights for policy 1, policy_version 916010 (0.0011) [2023-12-26 06:57:22,407][123090] Updated weights for policy 1, policy_version 916020 (0.0011) [2023-12-26 06:57:22,483][123090] Updated weights for policy 1, policy_version 916030 (0.0011) [2023-12-26 06:57:23,041][123091] Updated weights for policy 0, policy_version 922546 (0.0009) [2023-12-26 06:57:23,091][123091] Updated weights for policy 0, policy_version 922556 (0.0009) [2023-12-26 06:57:23,140][123091] Updated weights for policy 0, policy_version 922566 (0.0009) [2023-12-26 06:57:23,197][123091] Updated weights for policy 0, policy_version 922576 (0.0009) [2023-12-26 06:57:23,319][123090] Updated weights for policy 1, policy_version 916040 (0.0011) [2023-12-26 06:57:23,387][123090] Updated weights for policy 1, policy_version 916050 (0.0011) [2023-12-26 06:57:23,458][123090] Updated weights for policy 1, policy_version 916060 (0.0011) [2023-12-26 06:57:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 470695936. Throughput: 0: 8918.5, 1: 8881.8. Samples: 470673304. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:23,785][121949] Avg episode reward: [(0, '6233.447'), (1, '5762.234')] [2023-12-26 06:57:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000922576_236183552.pth... [2023-12-26 06:57:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000916064_234512384.pth... [2023-12-26 06:57:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000915040_234250240.pth [2023-12-26 06:57:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000921520_235913216.pth [2023-12-26 06:57:24,068][123091] Updated weights for policy 0, policy_version 922586 (0.0009) [2023-12-26 06:57:24,129][123091] Updated weights for policy 0, policy_version 922596 (0.0009) [2023-12-26 06:57:24,181][123091] Updated weights for policy 0, policy_version 922606 (0.0009) [2023-12-26 06:57:24,247][123090] Updated weights for policy 1, policy_version 916070 (0.0010) [2023-12-26 06:57:24,295][123090] Updated weights for policy 1, policy_version 916080 (0.0010) [2023-12-26 06:57:24,359][123090] Updated weights for policy 1, policy_version 916090 (0.0010) [2023-12-26 06:57:25,020][123091] Updated weights for policy 0, policy_version 922616 (0.0009) [2023-12-26 06:57:25,084][123091] Updated weights for policy 0, policy_version 922626 (0.0009) [2023-12-26 06:57:25,143][123091] Updated weights for policy 0, policy_version 922636 (0.0009) [2023-12-26 06:57:25,209][123090] Updated weights for policy 1, policy_version 916100 (0.0011) [2023-12-26 06:57:25,268][123090] Updated weights for policy 1, policy_version 916110 (0.0010) [2023-12-26 06:57:25,326][123090] Updated weights for policy 1, policy_version 916120 (0.0010) [2023-12-26 06:57:25,975][123091] Updated weights for policy 0, policy_version 922646 (0.0009) [2023-12-26 06:57:26,035][123091] Updated weights for policy 0, policy_version 922656 (0.0009) [2023-12-26 06:57:26,087][123091] Updated weights for policy 0, policy_version 922666 (0.0009) [2023-12-26 06:57:26,151][123090] Updated weights for policy 1, policy_version 916130 (0.0010) [2023-12-26 06:57:26,206][123090] Updated weights for policy 1, policy_version 916140 (0.0010) [2023-12-26 06:57:26,251][123090] Updated weights for policy 1, policy_version 916150 (0.0010) [2023-12-26 06:57:26,310][123090] Updated weights for policy 1, policy_version 916160 (0.0010) [2023-12-26 06:57:26,876][123091] Updated weights for policy 0, policy_version 922676 (0.0009) [2023-12-26 06:57:26,934][123091] Updated weights for policy 0, policy_version 922686 (0.0009) [2023-12-26 06:57:26,986][123091] Updated weights for policy 0, policy_version 922696 (0.0009) [2023-12-26 06:57:27,121][123090] Updated weights for policy 1, policy_version 916170 (0.0009) [2023-12-26 06:57:27,168][123090] Updated weights for policy 1, policy_version 916180 (0.0005) [2023-12-26 06:57:27,216][123090] Updated weights for policy 1, policy_version 916190 (0.0009) [2023-12-26 06:57:27,855][123091] Updated weights for policy 0, policy_version 922706 (0.0008) [2023-12-26 06:57:27,902][123091] Updated weights for policy 0, policy_version 922716 (0.0009) [2023-12-26 06:57:27,950][123091] Updated weights for policy 0, policy_version 922726 (0.0009) [2023-12-26 06:57:28,001][123091] Updated weights for policy 0, policy_version 922736 (0.0008) [2023-12-26 06:57:28,024][123090] Updated weights for policy 1, policy_version 916200 (0.0010) [2023-12-26 06:57:28,089][123090] Updated weights for policy 1, policy_version 916210 (0.0010) [2023-12-26 06:57:28,154][123090] Updated weights for policy 1, policy_version 916220 (0.0010) [2023-12-26 06:57:28,750][123090] Updated weights for policy 1, policy_version 916230 (0.0009) [2023-12-26 06:57:28,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 470777856. Throughput: 0: 8874.2, 1: 8858.2. Samples: 470775440. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:28,785][121949] Avg episode reward: [(0, '6267.252'), (1, '5750.824')] [2023-12-26 06:57:28,814][123090] Updated weights for policy 1, policy_version 916240 (0.0010) [2023-12-26 06:57:28,878][123090] Updated weights for policy 1, policy_version 916250 (0.0009) [2023-12-26 06:57:28,903][123091] Updated weights for policy 0, policy_version 922746 (0.0008) [2023-12-26 06:57:28,954][123091] Updated weights for policy 0, policy_version 922756 (0.0009) [2023-12-26 06:57:29,007][123091] Updated weights for policy 0, policy_version 922766 (0.0010) [2023-12-26 06:57:29,597][123090] Updated weights for policy 1, policy_version 916260 (0.0007) [2023-12-26 06:57:29,652][123090] Updated weights for policy 1, policy_version 916270 (0.0010) [2023-12-26 06:57:29,710][123090] Updated weights for policy 1, policy_version 916280 (0.0010) [2023-12-26 06:57:29,899][123091] Updated weights for policy 0, policy_version 922776 (0.0010) [2023-12-26 06:57:29,971][123091] Updated weights for policy 0, policy_version 922786 (0.0009) [2023-12-26 06:57:30,034][123091] Updated weights for policy 0, policy_version 922796 (0.0010) [2023-12-26 06:57:30,522][123090] Updated weights for policy 1, policy_version 916290 (0.0010) [2023-12-26 06:57:30,588][123090] Updated weights for policy 1, policy_version 916300 (0.0010) [2023-12-26 06:57:30,649][123090] Updated weights for policy 1, policy_version 916310 (0.0010) [2023-12-26 06:57:30,722][123090] Updated weights for policy 1, policy_version 916320 (0.0010) [2023-12-26 06:57:30,863][123091] Updated weights for policy 0, policy_version 922806 (0.0009) [2023-12-26 06:57:30,911][123091] Updated weights for policy 0, policy_version 922816 (0.0008) [2023-12-26 06:57:30,978][123091] Updated weights for policy 0, policy_version 922826 (0.0009) [2023-12-26 06:57:31,478][123090] Updated weights for policy 1, policy_version 916330 (0.0005) [2023-12-26 06:57:31,528][123090] Updated weights for policy 1, policy_version 916340 (0.0005) [2023-12-26 06:57:31,576][123090] Updated weights for policy 1, policy_version 916350 (0.0005) [2023-12-26 06:57:31,873][123091] Updated weights for policy 0, policy_version 922836 (0.0009) [2023-12-26 06:57:31,943][123091] Updated weights for policy 0, policy_version 922846 (0.0010) [2023-12-26 06:57:32,008][123091] Updated weights for policy 0, policy_version 922856 (0.0010) [2023-12-26 06:57:32,284][123090] Updated weights for policy 1, policy_version 916360 (0.0006) [2023-12-26 06:57:32,356][123090] Updated weights for policy 1, policy_version 916370 (0.0006) [2023-12-26 06:57:32,420][123090] Updated weights for policy 1, policy_version 916380 (0.0006) [2023-12-26 06:57:32,898][123091] Updated weights for policy 0, policy_version 922866 (0.0010) [2023-12-26 06:57:32,955][123091] Updated weights for policy 0, policy_version 922876 (0.0009) [2023-12-26 06:57:33,019][123091] Updated weights for policy 0, policy_version 922886 (0.0009) [2023-12-26 06:57:33,087][123091] Updated weights for policy 0, policy_version 922896 (0.0009) [2023-12-26 06:57:33,150][123090] Updated weights for policy 1, policy_version 916390 (0.0008) [2023-12-26 06:57:33,211][123090] Updated weights for policy 1, policy_version 916400 (0.0010) [2023-12-26 06:57:33,258][123090] Updated weights for policy 1, policy_version 916410 (0.0010) [2023-12-26 06:57:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 470867968. Throughput: 0: 8787.4, 1: 8890.6. Samples: 470880772. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:33,784][121949] Avg episode reward: [(0, '6268.803'), (1, '5776.716')] [2023-12-26 06:57:33,955][123091] Updated weights for policy 0, policy_version 922906 (0.0010) [2023-12-26 06:57:33,977][123090] Updated weights for policy 1, policy_version 916420 (0.0008) [2023-12-26 06:57:34,020][123091] Updated weights for policy 0, policy_version 922916 (0.0007) [2023-12-26 06:57:34,042][123090] Updated weights for policy 1, policy_version 916430 (0.0005) [2023-12-26 06:57:34,080][123091] Updated weights for policy 0, policy_version 922926 (0.0008) [2023-12-26 06:57:34,102][123090] Updated weights for policy 1, policy_version 916440 (0.0005) [2023-12-26 06:57:34,906][123090] Updated weights for policy 1, policy_version 916450 (0.0009) [2023-12-26 06:57:34,920][123091] Updated weights for policy 0, policy_version 922936 (0.0009) [2023-12-26 06:57:34,957][123090] Updated weights for policy 1, policy_version 916460 (0.0010) [2023-12-26 06:57:34,980][123091] Updated weights for policy 0, policy_version 922946 (0.0007) [2023-12-26 06:57:35,012][123090] Updated weights for policy 1, policy_version 916470 (0.0010) [2023-12-26 06:57:35,037][123091] Updated weights for policy 0, policy_version 922956 (0.0006) [2023-12-26 06:57:35,064][123090] Updated weights for policy 1, policy_version 916480 (0.0010) [2023-12-26 06:57:35,802][123090] Updated weights for policy 1, policy_version 916490 (0.0011) [2023-12-26 06:57:35,857][123090] Updated weights for policy 1, policy_version 916500 (0.0010) [2023-12-26 06:57:35,903][123091] Updated weights for policy 0, policy_version 922966 (0.0006) [2023-12-26 06:57:35,925][123090] Updated weights for policy 1, policy_version 916510 (0.0011) [2023-12-26 06:57:35,960][123091] Updated weights for policy 0, policy_version 922976 (0.0009) [2023-12-26 06:57:36,021][123091] Updated weights for policy 0, policy_version 922986 (0.0008) [2023-12-26 06:57:36,637][123090] Updated weights for policy 1, policy_version 916520 (0.0010) [2023-12-26 06:57:36,689][123090] Updated weights for policy 1, policy_version 916530 (0.0010) [2023-12-26 06:57:36,745][123090] Updated weights for policy 1, policy_version 916540 (0.0010) [2023-12-26 06:57:36,890][123091] Updated weights for policy 0, policy_version 922996 (0.0009) [2023-12-26 06:57:36,955][123091] Updated weights for policy 0, policy_version 923006 (0.0009) [2023-12-26 06:57:37,021][123091] Updated weights for policy 0, policy_version 923016 (0.0009) [2023-12-26 06:57:37,531][123090] Updated weights for policy 1, policy_version 916550 (0.0010) [2023-12-26 06:57:37,584][123090] Updated weights for policy 1, policy_version 916560 (0.0010) [2023-12-26 06:57:37,640][123090] Updated weights for policy 1, policy_version 916570 (0.0010) [2023-12-26 06:57:37,901][123091] Updated weights for policy 0, policy_version 923026 (0.0010) [2023-12-26 06:57:37,971][123091] Updated weights for policy 0, policy_version 923036 (0.0010) [2023-12-26 06:57:38,035][123091] Updated weights for policy 0, policy_version 923046 (0.0009) [2023-12-26 06:57:38,096][123091] Updated weights for policy 0, policy_version 923056 (0.0009) [2023-12-26 06:57:38,492][123090] Updated weights for policy 1, policy_version 916580 (0.0010) [2023-12-26 06:57:38,540][123090] Updated weights for policy 1, policy_version 916590 (0.0010) [2023-12-26 06:57:38,588][123090] Updated weights for policy 1, policy_version 916600 (0.0010) [2023-12-26 06:57:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 470958080. Throughput: 0: 8777.2, 1: 8953.6. Samples: 470933652. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:38,785][121949] Avg episode reward: [(0, '6342.949'), (1, '5799.629')] [2023-12-26 06:57:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000923056_236306432.pth... [2023-12-26 06:57:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000916608_234651648.pth... [2023-12-26 06:57:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000922064_236052480.pth [2023-12-26 06:57:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000915552_234381312.pth [2023-12-26 06:57:38,954][123091] Updated weights for policy 0, policy_version 923066 (0.0011) [2023-12-26 06:57:39,018][123091] Updated weights for policy 0, policy_version 923076 (0.0010) [2023-12-26 06:57:39,080][123091] Updated weights for policy 0, policy_version 923086 (0.0011) [2023-12-26 06:57:39,449][123090] Updated weights for policy 1, policy_version 916610 (0.0010) [2023-12-26 06:57:39,514][123090] Updated weights for policy 1, policy_version 916620 (0.0009) [2023-12-26 06:57:39,567][123090] Updated weights for policy 1, policy_version 916630 (0.0009) [2023-12-26 06:57:39,633][123090] Updated weights for policy 1, policy_version 916640 (0.0008) [2023-12-26 06:57:39,899][123091] Updated weights for policy 0, policy_version 923096 (0.0010) [2023-12-26 06:57:39,965][123091] Updated weights for policy 0, policy_version 923106 (0.0009) [2023-12-26 06:57:40,022][123091] Updated weights for policy 0, policy_version 923116 (0.0010) [2023-12-26 06:57:40,503][123090] Updated weights for policy 1, policy_version 916650 (0.0009) [2023-12-26 06:57:40,586][123090] Updated weights for policy 1, policy_version 916660 (0.0010) [2023-12-26 06:57:40,656][123090] Updated weights for policy 1, policy_version 916670 (0.0009) [2023-12-26 06:57:40,819][123091] Updated weights for policy 0, policy_version 923126 (0.0007) [2023-12-26 06:57:40,876][123091] Updated weights for policy 0, policy_version 923136 (0.0006) [2023-12-26 06:57:40,925][123091] Updated weights for policy 0, policy_version 923146 (0.0005) [2023-12-26 06:57:41,514][123090] Updated weights for policy 1, policy_version 916680 (0.0010) [2023-12-26 06:57:41,571][123090] Updated weights for policy 1, policy_version 916690 (0.0009) [2023-12-26 06:57:41,634][123090] Updated weights for policy 1, policy_version 916700 (0.0009) [2023-12-26 06:57:41,805][123091] Updated weights for policy 0, policy_version 923156 (0.0007) [2023-12-26 06:57:41,861][123091] Updated weights for policy 0, policy_version 923166 (0.0009) [2023-12-26 06:57:41,918][123091] Updated weights for policy 0, policy_version 923176 (0.0009) [2023-12-26 06:57:42,505][123090] Updated weights for policy 1, policy_version 916710 (0.0009) [2023-12-26 06:57:42,557][123090] Updated weights for policy 1, policy_version 916720 (0.0009) [2023-12-26 06:57:42,617][123090] Updated weights for policy 1, policy_version 916730 (0.0009) [2023-12-26 06:57:42,780][123091] Updated weights for policy 0, policy_version 923186 (0.0009) [2023-12-26 06:57:42,842][123091] Updated weights for policy 0, policy_version 923196 (0.0005) [2023-12-26 06:57:42,905][123091] Updated weights for policy 0, policy_version 923206 (0.0005) [2023-12-26 06:57:42,954][123091] Updated weights for policy 0, policy_version 923216 (0.0005) [2023-12-26 06:57:43,517][123090] Updated weights for policy 1, policy_version 916740 (0.0009) [2023-12-26 06:57:43,574][123090] Updated weights for policy 1, policy_version 916750 (0.0010) [2023-12-26 06:57:43,629][123090] Updated weights for policy 1, policy_version 916760 (0.0009) [2023-12-26 06:57:43,675][123091] Updated weights for policy 0, policy_version 923226 (0.0009) [2023-12-26 06:57:43,722][123091] Updated weights for policy 0, policy_version 923236 (0.0009) [2023-12-26 06:57:43,775][123091] Updated weights for policy 0, policy_version 923246 (0.0009) [2023-12-26 06:57:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 471040000. Throughput: 0: 8671.4, 1: 8880.0. Samples: 471034404. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:43,785][121949] Avg episode reward: [(0, '6248.846'), (1, '5802.453')] [2023-12-26 06:57:44,508][123091] Updated weights for policy 0, policy_version 923256 (0.0006) [2023-12-26 06:57:44,541][123090] Updated weights for policy 1, policy_version 916770 (0.0007) [2023-12-26 06:57:44,570][123091] Updated weights for policy 0, policy_version 923266 (0.0008) [2023-12-26 06:57:44,602][123090] Updated weights for policy 1, policy_version 916780 (0.0010) [2023-12-26 06:57:44,631][123091] Updated weights for policy 0, policy_version 923276 (0.0009) [2023-12-26 06:57:44,654][123090] Updated weights for policy 1, policy_version 916790 (0.0008) [2023-12-26 06:57:44,706][123090] Updated weights for policy 1, policy_version 916800 (0.0009) [2023-12-26 06:57:45,335][123091] Updated weights for policy 0, policy_version 923286 (0.0007) [2023-12-26 06:57:45,387][123091] Updated weights for policy 0, policy_version 923296 (0.0005) [2023-12-26 06:57:45,442][123091] Updated weights for policy 0, policy_version 923306 (0.0006) [2023-12-26 06:57:45,610][123090] Updated weights for policy 1, policy_version 916811 (0.0010) [2023-12-26 06:57:45,665][123090] Updated weights for policy 1, policy_version 916821 (0.0010) [2023-12-26 06:57:45,718][123090] Updated weights for policy 1, policy_version 916832 (0.0010) [2023-12-26 06:57:46,134][123091] Updated weights for policy 0, policy_version 923316 (0.0006) [2023-12-26 06:57:46,208][123091] Updated weights for policy 0, policy_version 923326 (0.0006) [2023-12-26 06:57:46,266][123091] Updated weights for policy 0, policy_version 923336 (0.0009) [2023-12-26 06:57:46,624][123090] Updated weights for policy 1, policy_version 916842 (0.0011) [2023-12-26 06:57:46,692][123090] Updated weights for policy 1, policy_version 916852 (0.0011) [2023-12-26 06:57:46,756][123090] Updated weights for policy 1, policy_version 916862 (0.0011) [2023-12-26 06:57:47,075][123091] Updated weights for policy 0, policy_version 923346 (0.0009) [2023-12-26 06:57:47,130][123091] Updated weights for policy 0, policy_version 923356 (0.0010) [2023-12-26 06:57:47,177][123091] Updated weights for policy 0, policy_version 923366 (0.0010) [2023-12-26 06:57:47,225][123091] Updated weights for policy 0, policy_version 923376 (0.0010) [2023-12-26 06:57:47,585][123090] Updated weights for policy 1, policy_version 916872 (0.0010) [2023-12-26 06:57:47,657][123090] Updated weights for policy 1, policy_version 916882 (0.0010) [2023-12-26 06:57:47,731][123090] Updated weights for policy 1, policy_version 916892 (0.0010) [2023-12-26 06:57:47,902][123091] Updated weights for policy 0, policy_version 923386 (0.0010) [2023-12-26 06:57:47,957][123091] Updated weights for policy 0, policy_version 923396 (0.0010) [2023-12-26 06:57:48,016][123091] Updated weights for policy 0, policy_version 923406 (0.0010) [2023-12-26 06:57:48,505][123090] Updated weights for policy 1, policy_version 916902 (0.0009) [2023-12-26 06:57:48,556][123090] Updated weights for policy 1, policy_version 916912 (0.0008) [2023-12-26 06:57:48,629][123090] Updated weights for policy 1, policy_version 916922 (0.0005) [2023-12-26 06:57:48,773][123091] Updated weights for policy 0, policy_version 923416 (0.0011) [2023-12-26 06:57:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 471130112. Throughput: 0: 8742.6, 1: 8813.8. Samples: 471141924. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:48,784][121949] Avg episode reward: [(0, '6263.797'), (1, '5765.665')] [2023-12-26 06:57:48,837][123091] Updated weights for policy 0, policy_version 923426 (0.0007) [2023-12-26 06:57:48,905][123091] Updated weights for policy 0, policy_version 923436 (0.0006) [2023-12-26 06:57:49,414][123090] Updated weights for policy 1, policy_version 916932 (0.0007) [2023-12-26 06:57:49,462][123090] Updated weights for policy 1, policy_version 916942 (0.0009) [2023-12-26 06:57:49,514][123090] Updated weights for policy 1, policy_version 916952 (0.0008) [2023-12-26 06:57:49,662][123091] Updated weights for policy 0, policy_version 923446 (0.0009) [2023-12-26 06:57:49,712][123091] Updated weights for policy 0, policy_version 923456 (0.0010) [2023-12-26 06:57:49,763][123091] Updated weights for policy 0, policy_version 923466 (0.0010) [2023-12-26 06:57:50,363][123090] Updated weights for policy 1, policy_version 916962 (0.0009) [2023-12-26 06:57:50,415][123090] Updated weights for policy 1, policy_version 916972 (0.0009) [2023-12-26 06:57:50,473][123090] Updated weights for policy 1, policy_version 916982 (0.0009) [2023-12-26 06:57:50,522][123090] Updated weights for policy 1, policy_version 916992 (0.0008) [2023-12-26 06:57:50,596][123091] Updated weights for policy 0, policy_version 923476 (0.0011) [2023-12-26 06:57:50,658][123091] Updated weights for policy 0, policy_version 923486 (0.0010) [2023-12-26 06:57:50,718][123091] Updated weights for policy 0, policy_version 923496 (0.0011) [2023-12-26 06:57:51,388][123090] Updated weights for policy 1, policy_version 917002 (0.0010) [2023-12-26 06:57:51,453][123090] Updated weights for policy 1, policy_version 917012 (0.0009) [2023-12-26 06:57:51,516][123090] Updated weights for policy 1, policy_version 917022 (0.0009) [2023-12-26 06:57:51,527][123091] Updated weights for policy 0, policy_version 923506 (0.0010) [2023-12-26 06:57:51,601][123091] Updated weights for policy 0, policy_version 923516 (0.0008) [2023-12-26 06:57:51,674][123091] Updated weights for policy 0, policy_version 923526 (0.0008) [2023-12-26 06:57:51,746][123091] Updated weights for policy 0, policy_version 923536 (0.0008) [2023-12-26 06:57:52,465][123090] Updated weights for policy 1, policy_version 917032 (0.0006) [2023-12-26 06:57:52,469][123091] Updated weights for policy 0, policy_version 923546 (0.0011) [2023-12-26 06:57:52,523][123090] Updated weights for policy 1, policy_version 917042 (0.0006) [2023-12-26 06:57:52,533][123091] Updated weights for policy 0, policy_version 923556 (0.0011) [2023-12-26 06:57:52,582][123090] Updated weights for policy 1, policy_version 917052 (0.0005) [2023-12-26 06:57:52,596][123091] Updated weights for policy 0, policy_version 923566 (0.0011) [2023-12-26 06:57:53,335][123091] Updated weights for policy 0, policy_version 923576 (0.0007) [2023-12-26 06:57:53,339][123090] Updated weights for policy 1, policy_version 917062 (0.0006) [2023-12-26 06:57:53,402][123090] Updated weights for policy 1, policy_version 917072 (0.0006) [2023-12-26 06:57:53,403][123091] Updated weights for policy 0, policy_version 923586 (0.0011) [2023-12-26 06:57:53,466][123091] Updated weights for policy 0, policy_version 923596 (0.0010) [2023-12-26 06:57:53,469][123090] Updated weights for policy 1, policy_version 917082 (0.0006) [2023-12-26 06:57:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 471220224. Throughput: 0: 8734.5, 1: 8787.1. Samples: 471193772. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:53,785][121949] Avg episode reward: [(0, '6368.699'), (1, '5792.087')] [2023-12-26 06:57:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000923600_236445696.pth... [2023-12-26 06:57:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000917088_234774528.pth... [2023-12-26 06:57:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000922576_236183552.pth [2023-12-26 06:57:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000916064_234512384.pth [2023-12-26 06:57:54,090][123090] Updated weights for policy 1, policy_version 917092 (0.0005) [2023-12-26 06:57:54,158][123090] Updated weights for policy 1, policy_version 917102 (0.0008) [2023-12-26 06:57:54,219][123090] Updated weights for policy 1, policy_version 917112 (0.0008) [2023-12-26 06:57:54,244][123091] Updated weights for policy 0, policy_version 923606 (0.0007) [2023-12-26 06:57:54,293][123091] Updated weights for policy 0, policy_version 923616 (0.0005) [2023-12-26 06:57:54,349][123091] Updated weights for policy 0, policy_version 923626 (0.0005) [2023-12-26 06:57:54,942][123090] Updated weights for policy 1, policy_version 917122 (0.0009) [2023-12-26 06:57:55,005][123090] Updated weights for policy 1, policy_version 917132 (0.0009) [2023-12-26 06:57:55,023][123091] Updated weights for policy 0, policy_version 923636 (0.0006) [2023-12-26 06:57:55,065][123090] Updated weights for policy 1, policy_version 917142 (0.0007) [2023-12-26 06:57:55,089][123091] Updated weights for policy 0, policy_version 923646 (0.0005) [2023-12-26 06:57:55,122][123090] Updated weights for policy 1, policy_version 917152 (0.0005) [2023-12-26 06:57:55,162][123091] Updated weights for policy 0, policy_version 923656 (0.0005) [2023-12-26 06:57:55,739][123090] Updated weights for policy 1, policy_version 917162 (0.0005) [2023-12-26 06:57:55,812][123090] Updated weights for policy 1, policy_version 917172 (0.0005) [2023-12-26 06:57:55,864][123090] Updated weights for policy 1, policy_version 917182 (0.0005) [2023-12-26 06:57:55,941][123091] Updated weights for policy 0, policy_version 923666 (0.0006) [2023-12-26 06:57:56,000][123091] Updated weights for policy 0, policy_version 923676 (0.0010) [2023-12-26 06:57:56,049][123091] Updated weights for policy 0, policy_version 923686 (0.0010) [2023-12-26 06:57:56,106][123091] Updated weights for policy 0, policy_version 923696 (0.0010) [2023-12-26 06:57:56,580][123090] Updated weights for policy 1, policy_version 917192 (0.0009) [2023-12-26 06:57:56,638][123090] Updated weights for policy 1, policy_version 917202 (0.0010) [2023-12-26 06:57:56,697][123090] Updated weights for policy 1, policy_version 917212 (0.0010) [2023-12-26 06:57:56,989][123091] Updated weights for policy 0, policy_version 923706 (0.0010) [2023-12-26 06:57:57,057][123091] Updated weights for policy 0, policy_version 923716 (0.0009) [2023-12-26 06:57:57,109][123091] Updated weights for policy 0, policy_version 923726 (0.0010) [2023-12-26 06:57:57,413][123090] Updated weights for policy 1, policy_version 917222 (0.0009) [2023-12-26 06:57:57,479][123090] Updated weights for policy 1, policy_version 917232 (0.0008) [2023-12-26 06:57:57,545][123090] Updated weights for policy 1, policy_version 917242 (0.0008) [2023-12-26 06:57:57,996][123091] Updated weights for policy 0, policy_version 923736 (0.0009) [2023-12-26 06:57:58,059][123091] Updated weights for policy 0, policy_version 923746 (0.0010) [2023-12-26 06:57:58,126][123091] Updated weights for policy 0, policy_version 923756 (0.0009) [2023-12-26 06:57:58,213][123090] Updated weights for policy 1, policy_version 917252 (0.0006) [2023-12-26 06:57:58,269][123090] Updated weights for policy 1, policy_version 917262 (0.0005) [2023-12-26 06:57:58,339][123090] Updated weights for policy 1, policy_version 917272 (0.0007) [2023-12-26 06:57:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 471310336. Throughput: 0: 8729.7, 1: 8910.6. Samples: 471305716. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:57:58,785][121949] Avg episode reward: [(0, '6373.585'), (1, '5862.587')] [2023-12-26 06:57:59,119][123091] Updated weights for policy 0, policy_version 923766 (0.0008) [2023-12-26 06:57:59,144][123090] Updated weights for policy 1, policy_version 917282 (0.0008) [2023-12-26 06:57:59,191][123091] Updated weights for policy 0, policy_version 923776 (0.0009) [2023-12-26 06:57:59,209][123090] Updated weights for policy 1, policy_version 917292 (0.0007) [2023-12-26 06:57:59,268][123091] Updated weights for policy 0, policy_version 923786 (0.0008) [2023-12-26 06:57:59,284][123090] Updated weights for policy 1, policy_version 917302 (0.0009) [2023-12-26 06:57:59,355][123090] Updated weights for policy 1, policy_version 917312 (0.0009) [2023-12-26 06:58:00,080][123090] Updated weights for policy 1, policy_version 917322 (0.0010) [2023-12-26 06:58:00,136][123090] Updated weights for policy 1, policy_version 917332 (0.0010) [2023-12-26 06:58:00,172][123091] Updated weights for policy 0, policy_version 923796 (0.0007) [2023-12-26 06:58:00,191][123090] Updated weights for policy 1, policy_version 917342 (0.0010) [2023-12-26 06:58:00,225][123091] Updated weights for policy 0, policy_version 923806 (0.0007) [2023-12-26 06:58:00,281][123091] Updated weights for policy 0, policy_version 923816 (0.0007) [2023-12-26 06:58:01,012][123091] Updated weights for policy 0, policy_version 923826 (0.0007) [2023-12-26 06:58:01,016][123090] Updated weights for policy 1, policy_version 917352 (0.0010) [2023-12-26 06:58:01,074][123091] Updated weights for policy 0, policy_version 923836 (0.0011) [2023-12-26 06:58:01,086][123090] Updated weights for policy 1, policy_version 917362 (0.0011) [2023-12-26 06:58:01,140][123091] Updated weights for policy 0, policy_version 923846 (0.0010) [2023-12-26 06:58:01,154][123090] Updated weights for policy 1, policy_version 917372 (0.0011) [2023-12-26 06:58:01,195][123091] Updated weights for policy 0, policy_version 923856 (0.0006) [2023-12-26 06:58:01,901][123091] Updated weights for policy 0, policy_version 923866 (0.0007) [2023-12-26 06:58:01,962][123091] Updated weights for policy 0, policy_version 923876 (0.0008) [2023-12-26 06:58:01,980][123090] Updated weights for policy 1, policy_version 917382 (0.0010) [2023-12-26 06:58:02,031][123091] Updated weights for policy 0, policy_version 923886 (0.0007) [2023-12-26 06:58:02,042][123090] Updated weights for policy 1, policy_version 917392 (0.0007) [2023-12-26 06:58:02,098][123090] Updated weights for policy 1, policy_version 917402 (0.0005) [2023-12-26 06:58:02,723][123091] Updated weights for policy 0, policy_version 923896 (0.0009) [2023-12-26 06:58:02,782][123091] Updated weights for policy 0, policy_version 923906 (0.0009) [2023-12-26 06:58:02,838][123091] Updated weights for policy 0, policy_version 923916 (0.0009) [2023-12-26 06:58:02,895][123090] Updated weights for policy 1, policy_version 917412 (0.0005) [2023-12-26 06:58:02,965][123090] Updated weights for policy 1, policy_version 917422 (0.0005) [2023-12-26 06:58:03,020][123090] Updated weights for policy 1, policy_version 917432 (0.0005) [2023-12-26 06:58:03,670][123090] Updated weights for policy 1, policy_version 917442 (0.0005) [2023-12-26 06:58:03,727][123090] Updated weights for policy 1, policy_version 917452 (0.0005) [2023-12-26 06:58:03,735][123091] Updated weights for policy 0, policy_version 923926 (0.0009) [2023-12-26 06:58:03,776][123090] Updated weights for policy 1, policy_version 917462 (0.0005) [2023-12-26 06:58:03,782][123091] Updated weights for policy 0, policy_version 923936 (0.0009) [2023-12-26 06:58:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 471392256. Throughput: 0: 8645.7, 1: 8852.2. Samples: 471411028. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:03,785][121949] Avg episode reward: [(0, '6363.775'), (1, '5914.824')] [2023-12-26 06:58:03,838][123090] Updated weights for policy 1, policy_version 917472 (0.0006) [2023-12-26 06:58:03,840][123091] Updated weights for policy 0, policy_version 923946 (0.0008) [2023-12-26 06:58:04,512][123090] Updated weights for policy 1, policy_version 917482 (0.0006) [2023-12-26 06:58:04,576][123090] Updated weights for policy 1, policy_version 917492 (0.0009) [2023-12-26 06:58:04,632][123090] Updated weights for policy 1, policy_version 917502 (0.0006) [2023-12-26 06:58:04,725][123091] Updated weights for policy 0, policy_version 923956 (0.0009) [2023-12-26 06:58:04,777][123091] Updated weights for policy 0, policy_version 923966 (0.0009) [2023-12-26 06:58:04,825][123091] Updated weights for policy 0, policy_version 923976 (0.0009) [2023-12-26 06:58:05,413][123090] Updated weights for policy 1, policy_version 917512 (0.0009) [2023-12-26 06:58:05,479][123090] Updated weights for policy 1, policy_version 917522 (0.0010) [2023-12-26 06:58:05,538][123090] Updated weights for policy 1, policy_version 917532 (0.0010) [2023-12-26 06:58:05,612][123091] Updated weights for policy 0, policy_version 923986 (0.0009) [2023-12-26 06:58:05,680][123091] Updated weights for policy 0, policy_version 923996 (0.0009) [2023-12-26 06:58:05,744][123091] Updated weights for policy 0, policy_version 924006 (0.0010) [2023-12-26 06:58:05,800][123091] Updated weights for policy 0, policy_version 924016 (0.0009) [2023-12-26 06:58:06,235][123090] Updated weights for policy 1, policy_version 917542 (0.0007) [2023-12-26 06:58:06,294][123090] Updated weights for policy 1, policy_version 917552 (0.0005) [2023-12-26 06:58:06,352][123090] Updated weights for policy 1, policy_version 917562 (0.0005) [2023-12-26 06:58:06,707][123091] Updated weights for policy 0, policy_version 924026 (0.0010) [2023-12-26 06:58:06,767][123091] Updated weights for policy 0, policy_version 924036 (0.0009) [2023-12-26 06:58:06,837][123091] Updated weights for policy 0, policy_version 924046 (0.0010) [2023-12-26 06:58:07,011][123090] Updated weights for policy 1, policy_version 917572 (0.0008) [2023-12-26 06:58:07,071][123090] Updated weights for policy 1, policy_version 917582 (0.0011) [2023-12-26 06:58:07,135][123090] Updated weights for policy 1, policy_version 917592 (0.0010) [2023-12-26 06:58:07,634][123091] Updated weights for policy 0, policy_version 924056 (0.0006) [2023-12-26 06:58:07,689][123091] Updated weights for policy 0, policy_version 924066 (0.0005) [2023-12-26 06:58:07,756][123091] Updated weights for policy 0, policy_version 924076 (0.0008) [2023-12-26 06:58:07,937][123090] Updated weights for policy 1, policy_version 917602 (0.0010) [2023-12-26 06:58:08,018][123090] Updated weights for policy 1, policy_version 917612 (0.0007) [2023-12-26 06:58:08,082][123090] Updated weights for policy 1, policy_version 917622 (0.0009) [2023-12-26 06:58:08,147][123090] Updated weights for policy 1, policy_version 917632 (0.0008) [2023-12-26 06:58:08,495][123091] Updated weights for policy 0, policy_version 924086 (0.0007) [2023-12-26 06:58:08,550][123091] Updated weights for policy 0, policy_version 924096 (0.0006) [2023-12-26 06:58:08,609][123091] Updated weights for policy 0, policy_version 924106 (0.0005) [2023-12-26 06:58:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 471490560. Throughput: 0: 8645.1, 1: 8957.1. Samples: 471465408. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:08,785][121949] Avg episode reward: [(0, '6332.388'), (1, '5942.784')] [2023-12-26 06:58:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000917632_234913792.pth... [2023-12-26 06:58:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000924112_236576768.pth... [2023-12-26 06:58:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000916608_234651648.pth [2023-12-26 06:58:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000923056_236306432.pth [2023-12-26 06:58:08,918][123090] Updated weights for policy 1, policy_version 917642 (0.0006) [2023-12-26 06:58:08,980][123090] Updated weights for policy 1, policy_version 917652 (0.0007) [2023-12-26 06:58:09,040][123090] Updated weights for policy 1, policy_version 917662 (0.0008) [2023-12-26 06:58:09,385][123091] Updated weights for policy 0, policy_version 924116 (0.0007) [2023-12-26 06:58:09,455][123091] Updated weights for policy 0, policy_version 924126 (0.0010) [2023-12-26 06:58:09,520][123091] Updated weights for policy 0, policy_version 924136 (0.0009) [2023-12-26 06:58:09,874][123090] Updated weights for policy 1, policy_version 917672 (0.0009) [2023-12-26 06:58:09,951][123090] Updated weights for policy 1, policy_version 917682 (0.0009) [2023-12-26 06:58:10,019][123090] Updated weights for policy 1, policy_version 917692 (0.0010) [2023-12-26 06:58:10,395][123091] Updated weights for policy 0, policy_version 924146 (0.0009) [2023-12-26 06:58:10,467][123091] Updated weights for policy 0, policy_version 924156 (0.0005) [2023-12-26 06:58:10,541][123091] Updated weights for policy 0, policy_version 924166 (0.0005) [2023-12-26 06:58:10,588][123091] Updated weights for policy 0, policy_version 924176 (0.0005) [2023-12-26 06:58:10,833][123090] Updated weights for policy 1, policy_version 917702 (0.0007) [2023-12-26 06:58:10,894][123090] Updated weights for policy 1, policy_version 917712 (0.0005) [2023-12-26 06:58:10,947][123090] Updated weights for policy 1, policy_version 917722 (0.0006) [2023-12-26 06:58:11,219][123091] Updated weights for policy 0, policy_version 924186 (0.0007) [2023-12-26 06:58:11,283][123091] Updated weights for policy 0, policy_version 924196 (0.0006) [2023-12-26 06:58:11,356][123091] Updated weights for policy 0, policy_version 924206 (0.0007) [2023-12-26 06:58:11,727][123090] Updated weights for policy 1, policy_version 917732 (0.0007) [2023-12-26 06:58:11,780][123090] Updated weights for policy 1, policy_version 917742 (0.0010) [2023-12-26 06:58:11,843][123090] Updated weights for policy 1, policy_version 917752 (0.0009) [2023-12-26 06:58:12,188][123091] Updated weights for policy 0, policy_version 924216 (0.0009) [2023-12-26 06:58:12,240][123091] Updated weights for policy 0, policy_version 924226 (0.0010) [2023-12-26 06:58:12,301][123091] Updated weights for policy 0, policy_version 924236 (0.0010) [2023-12-26 06:58:12,713][123090] Updated weights for policy 1, policy_version 917762 (0.0009) [2023-12-26 06:58:12,771][123090] Updated weights for policy 1, policy_version 917772 (0.0005) [2023-12-26 06:58:12,822][123090] Updated weights for policy 1, policy_version 917782 (0.0010) [2023-12-26 06:58:12,874][123090] Updated weights for policy 1, policy_version 917792 (0.0010) [2023-12-26 06:58:12,997][123091] Updated weights for policy 0, policy_version 924246 (0.0006) [2023-12-26 06:58:13,059][123091] Updated weights for policy 0, policy_version 924256 (0.0006) [2023-12-26 06:58:13,123][123091] Updated weights for policy 0, policy_version 924266 (0.0006) [2023-12-26 06:58:13,557][123090] Updated weights for policy 1, policy_version 917802 (0.0005) [2023-12-26 06:58:13,605][123090] Updated weights for policy 1, policy_version 917812 (0.0005) [2023-12-26 06:58:13,666][123090] Updated weights for policy 1, policy_version 917822 (0.0006) [2023-12-26 06:58:13,781][123091] Updated weights for policy 0, policy_version 924276 (0.0008) [2023-12-26 06:58:13,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 471580672. Throughput: 0: 8719.2, 1: 8977.8. Samples: 471571804. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:13,784][121949] Avg episode reward: [(0, '6333.752'), (1, '5886.774')] [2023-12-26 06:58:13,825][123091] Updated weights for policy 0, policy_version 924286 (0.0010) [2023-12-26 06:58:13,873][123091] Updated weights for policy 0, policy_version 924296 (0.0010) [2023-12-26 06:58:14,349][123090] Updated weights for policy 1, policy_version 917832 (0.0005) [2023-12-26 06:58:14,398][123090] Updated weights for policy 1, policy_version 917842 (0.0005) [2023-12-26 06:58:14,452][123090] Updated weights for policy 1, policy_version 917852 (0.0005) [2023-12-26 06:58:14,739][123091] Updated weights for policy 0, policy_version 924306 (0.0011) [2023-12-26 06:58:14,821][123091] Updated weights for policy 0, policy_version 924316 (0.0011) [2023-12-26 06:58:14,878][123091] Updated weights for policy 0, policy_version 924326 (0.0011) [2023-12-26 06:58:14,948][123091] Updated weights for policy 0, policy_version 924336 (0.0010) [2023-12-26 06:58:15,188][123090] Updated weights for policy 1, policy_version 917862 (0.0007) [2023-12-26 06:58:15,250][123090] Updated weights for policy 1, policy_version 917872 (0.0009) [2023-12-26 06:58:15,307][123090] Updated weights for policy 1, policy_version 917882 (0.0009) [2023-12-26 06:58:15,755][123091] Updated weights for policy 0, policy_version 924346 (0.0010) [2023-12-26 06:58:15,806][123091] Updated weights for policy 0, policy_version 924356 (0.0010) [2023-12-26 06:58:15,854][123091] Updated weights for policy 0, policy_version 924366 (0.0010) [2023-12-26 06:58:16,134][123090] Updated weights for policy 1, policy_version 917892 (0.0007) [2023-12-26 06:58:16,190][123090] Updated weights for policy 1, policy_version 917902 (0.0005) [2023-12-26 06:58:16,243][123090] Updated weights for policy 1, policy_version 917912 (0.0005) [2023-12-26 06:58:16,701][123091] Updated weights for policy 0, policy_version 924376 (0.0010) [2023-12-26 06:58:16,753][123091] Updated weights for policy 0, policy_version 924386 (0.0010) [2023-12-26 06:58:16,805][123091] Updated weights for policy 0, policy_version 924396 (0.0010) [2023-12-26 06:58:16,953][123090] Updated weights for policy 1, policy_version 917922 (0.0005) [2023-12-26 06:58:17,024][123090] Updated weights for policy 1, policy_version 917932 (0.0009) [2023-12-26 06:58:17,098][123090] Updated weights for policy 1, policy_version 917942 (0.0008) [2023-12-26 06:58:17,163][123090] Updated weights for policy 1, policy_version 917952 (0.0009) [2023-12-26 06:58:17,633][123091] Updated weights for policy 0, policy_version 924406 (0.0010) [2023-12-26 06:58:17,677][123091] Updated weights for policy 0, policy_version 924416 (0.0010) [2023-12-26 06:58:17,725][123091] Updated weights for policy 0, policy_version 924426 (0.0010) [2023-12-26 06:58:17,867][123090] Updated weights for policy 1, policy_version 917962 (0.0005) [2023-12-26 06:58:17,913][123090] Updated weights for policy 1, policy_version 917972 (0.0007) [2023-12-26 06:58:17,961][123090] Updated weights for policy 1, policy_version 917982 (0.0006) [2023-12-26 06:58:18,587][123091] Updated weights for policy 0, policy_version 924436 (0.0010) [2023-12-26 06:58:18,651][123091] Updated weights for policy 0, policy_version 924446 (0.0010) [2023-12-26 06:58:18,702][123090] Updated weights for policy 1, policy_version 917992 (0.0010) [2023-12-26 06:58:18,714][123091] Updated weights for policy 0, policy_version 924456 (0.0010) [2023-12-26 06:58:18,765][123090] Updated weights for policy 1, policy_version 918002 (0.0010) [2023-12-26 06:58:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 471670784. Throughput: 0: 8828.7, 1: 8995.6. Samples: 471682868. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:18,785][121949] Avg episode reward: [(0, '6298.021'), (1, '5876.054')] [2023-12-26 06:58:18,822][123090] Updated weights for policy 1, policy_version 918012 (0.0010) [2023-12-26 06:58:19,535][123091] Updated weights for policy 0, policy_version 924466 (0.0010) [2023-12-26 06:58:19,595][123091] Updated weights for policy 0, policy_version 924476 (0.0008) [2023-12-26 06:58:19,599][123090] Updated weights for policy 1, policy_version 918022 (0.0009) [2023-12-26 06:58:19,655][123090] Updated weights for policy 1, policy_version 918032 (0.0008) [2023-12-26 06:58:19,655][123091] Updated weights for policy 0, policy_version 924486 (0.0008) [2023-12-26 06:58:19,707][123090] Updated weights for policy 1, policy_version 918042 (0.0008) [2023-12-26 06:58:19,725][123091] Updated weights for policy 0, policy_version 924496 (0.0008) [2023-12-26 06:58:20,498][123091] Updated weights for policy 0, policy_version 924506 (0.0011) [2023-12-26 06:58:20,546][123091] Updated weights for policy 0, policy_version 924516 (0.0010) [2023-12-26 06:58:20,594][123090] Updated weights for policy 1, policy_version 918052 (0.0009) [2023-12-26 06:58:20,624][123091] Updated weights for policy 0, policy_version 924526 (0.0010) [2023-12-26 06:58:20,667][123090] Updated weights for policy 1, policy_version 918062 (0.0011) [2023-12-26 06:58:20,734][123090] Updated weights for policy 1, policy_version 918072 (0.0011) [2023-12-26 06:58:21,544][123091] Updated weights for policy 0, policy_version 924536 (0.0010) [2023-12-26 06:58:21,555][123090] Updated weights for policy 1, policy_version 918082 (0.0010) [2023-12-26 06:58:21,613][123091] Updated weights for policy 0, policy_version 924546 (0.0011) [2023-12-26 06:58:21,622][123090] Updated weights for policy 1, policy_version 918092 (0.0007) [2023-12-26 06:58:21,684][123091] Updated weights for policy 0, policy_version 924556 (0.0011) [2023-12-26 06:58:21,693][123090] Updated weights for policy 1, policy_version 918102 (0.0007) [2023-12-26 06:58:21,770][123090] Updated weights for policy 1, policy_version 918112 (0.0009) [2023-12-26 06:58:22,426][123091] Updated weights for policy 0, policy_version 924566 (0.0008) [2023-12-26 06:58:22,489][123091] Updated weights for policy 0, policy_version 924576 (0.0010) [2023-12-26 06:58:22,557][123091] Updated weights for policy 0, policy_version 924586 (0.0011) [2023-12-26 06:58:22,653][123090] Updated weights for policy 1, policy_version 918122 (0.0009) [2023-12-26 06:58:22,723][123090] Updated weights for policy 1, policy_version 918132 (0.0009) [2023-12-26 06:58:22,782][123090] Updated weights for policy 1, policy_version 918142 (0.0008) [2023-12-26 06:58:23,370][123091] Updated weights for policy 0, policy_version 924596 (0.0011) [2023-12-26 06:58:23,440][123091] Updated weights for policy 0, policy_version 924606 (0.0011) [2023-12-26 06:58:23,510][123091] Updated weights for policy 0, policy_version 924616 (0.0010) [2023-12-26 06:58:23,626][123090] Updated weights for policy 1, policy_version 918152 (0.0009) [2023-12-26 06:58:23,687][123090] Updated weights for policy 1, policy_version 918162 (0.0009) [2023-12-26 06:58:23,735][123090] Updated weights for policy 1, policy_version 918172 (0.0009) [2023-12-26 06:58:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 471760896. Throughput: 0: 8846.7, 1: 8932.0. Samples: 471733692. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:23,784][121949] Avg episode reward: [(0, '6253.506'), (1, '5841.575')] [2023-12-26 06:58:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000918176_235053056.pth... [2023-12-26 06:58:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000924624_236707840.pth... [2023-12-26 06:58:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000917088_234774528.pth [2023-12-26 06:58:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000923600_236445696.pth [2023-12-26 06:58:24,314][123091] Updated weights for policy 0, policy_version 924626 (0.0010) [2023-12-26 06:58:24,369][123091] Updated weights for policy 0, policy_version 924636 (0.0010) [2023-12-26 06:58:24,423][123091] Updated weights for policy 0, policy_version 924646 (0.0010) [2023-12-26 06:58:24,474][123091] Updated weights for policy 0, policy_version 924656 (0.0010) [2023-12-26 06:58:24,594][123090] Updated weights for policy 1, policy_version 918182 (0.0009) [2023-12-26 06:58:24,662][123090] Updated weights for policy 1, policy_version 918192 (0.0009) [2023-12-26 06:58:24,719][123090] Updated weights for policy 1, policy_version 918202 (0.0009) [2023-12-26 06:58:25,223][123091] Updated weights for policy 0, policy_version 924666 (0.0005) [2023-12-26 06:58:25,286][123091] Updated weights for policy 0, policy_version 924676 (0.0005) [2023-12-26 06:58:25,340][123091] Updated weights for policy 0, policy_version 924686 (0.0005) [2023-12-26 06:58:25,536][123090] Updated weights for policy 1, policy_version 918212 (0.0007) [2023-12-26 06:58:25,598][123090] Updated weights for policy 1, policy_version 918222 (0.0005) [2023-12-26 06:58:25,659][123090] Updated weights for policy 1, policy_version 918232 (0.0005) [2023-12-26 06:58:26,085][123091] Updated weights for policy 0, policy_version 924696 (0.0008) [2023-12-26 06:58:26,145][123091] Updated weights for policy 0, policy_version 924706 (0.0009) [2023-12-26 06:58:26,204][123091] Updated weights for policy 0, policy_version 924716 (0.0008) [2023-12-26 06:58:26,411][123090] Updated weights for policy 1, policy_version 918242 (0.0009) [2023-12-26 06:58:26,457][123090] Updated weights for policy 1, policy_version 918252 (0.0005) [2023-12-26 06:58:26,504][123090] Updated weights for policy 1, policy_version 918262 (0.0006) [2023-12-26 06:58:26,553][123090] Updated weights for policy 1, policy_version 918272 (0.0006) [2023-12-26 06:58:27,011][123091] Updated weights for policy 0, policy_version 924726 (0.0007) [2023-12-26 06:58:27,058][123091] Updated weights for policy 0, policy_version 924736 (0.0008) [2023-12-26 06:58:27,105][123091] Updated weights for policy 0, policy_version 924746 (0.0010) [2023-12-26 06:58:27,264][123090] Updated weights for policy 1, policy_version 918282 (0.0006) [2023-12-26 06:58:27,313][123090] Updated weights for policy 1, policy_version 918292 (0.0009) [2023-12-26 06:58:27,366][123090] Updated weights for policy 1, policy_version 918302 (0.0009) [2023-12-26 06:58:27,858][123091] Updated weights for policy 0, policy_version 924756 (0.0008) [2023-12-26 06:58:27,902][123091] Updated weights for policy 0, policy_version 924766 (0.0005) [2023-12-26 06:58:27,957][123091] Updated weights for policy 0, policy_version 924776 (0.0005) [2023-12-26 06:58:28,265][123090] Updated weights for policy 1, policy_version 918312 (0.0008) [2023-12-26 06:58:28,334][123090] Updated weights for policy 1, policy_version 918322 (0.0010) [2023-12-26 06:58:28,398][123090] Updated weights for policy 1, policy_version 918332 (0.0009) [2023-12-26 06:58:28,669][123091] Updated weights for policy 0, policy_version 924786 (0.0006) [2023-12-26 06:58:28,721][123091] Updated weights for policy 0, policy_version 924796 (0.0006) [2023-12-26 06:58:28,771][123091] Updated weights for policy 0, policy_version 924806 (0.0005) [2023-12-26 06:58:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 471842816. Throughput: 0: 8903.8, 1: 8977.5. Samples: 471839064. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:28,784][121949] Avg episode reward: [(0, '6273.116'), (1, '5859.973')] [2023-12-26 06:58:28,832][123091] Updated weights for policy 0, policy_version 924816 (0.0005) [2023-12-26 06:58:29,286][123090] Updated weights for policy 1, policy_version 918342 (0.0009) [2023-12-26 06:58:29,344][123090] Updated weights for policy 1, policy_version 918352 (0.0009) [2023-12-26 06:58:29,414][123090] Updated weights for policy 1, policy_version 918362 (0.0009) [2023-12-26 06:58:29,504][123091] Updated weights for policy 0, policy_version 924826 (0.0005) [2023-12-26 06:58:29,559][123091] Updated weights for policy 0, policy_version 924836 (0.0005) [2023-12-26 06:58:29,605][123091] Updated weights for policy 0, policy_version 924846 (0.0005) [2023-12-26 06:58:30,290][123090] Updated weights for policy 1, policy_version 918372 (0.0009) [2023-12-26 06:58:30,349][123090] Updated weights for policy 1, policy_version 918382 (0.0009) [2023-12-26 06:58:30,406][123091] Updated weights for policy 0, policy_version 924856 (0.0006) [2023-12-26 06:58:30,413][123090] Updated weights for policy 1, policy_version 918392 (0.0010) [2023-12-26 06:58:30,451][123091] Updated weights for policy 0, policy_version 924866 (0.0008) [2023-12-26 06:58:30,510][123091] Updated weights for policy 0, policy_version 924876 (0.0009) [2023-12-26 06:58:31,266][123090] Updated weights for policy 1, policy_version 918402 (0.0008) [2023-12-26 06:58:31,329][123090] Updated weights for policy 1, policy_version 918412 (0.0010) [2023-12-26 06:58:31,382][123091] Updated weights for policy 0, policy_version 924886 (0.0010) [2023-12-26 06:58:31,396][123090] Updated weights for policy 1, policy_version 918422 (0.0009) [2023-12-26 06:58:31,449][123091] Updated weights for policy 0, policy_version 924896 (0.0007) [2023-12-26 06:58:31,464][123090] Updated weights for policy 1, policy_version 918432 (0.0009) [2023-12-26 06:58:31,518][123091] Updated weights for policy 0, policy_version 924906 (0.0008) [2023-12-26 06:58:32,302][123090] Updated weights for policy 1, policy_version 918442 (0.0011) [2023-12-26 06:58:32,315][123091] Updated weights for policy 0, policy_version 924916 (0.0010) [2023-12-26 06:58:32,351][123090] Updated weights for policy 1, policy_version 918452 (0.0010) [2023-12-26 06:58:32,376][123091] Updated weights for policy 0, policy_version 924926 (0.0007) [2023-12-26 06:58:32,408][123090] Updated weights for policy 1, policy_version 918462 (0.0007) [2023-12-26 06:58:32,430][123091] Updated weights for policy 0, policy_version 924936 (0.0009) [2023-12-26 06:58:33,230][123090] Updated weights for policy 1, policy_version 918472 (0.0010) [2023-12-26 06:58:33,245][123091] Updated weights for policy 0, policy_version 924946 (0.0008) [2023-12-26 06:58:33,287][123090] Updated weights for policy 1, policy_version 918482 (0.0009) [2023-12-26 06:58:33,293][123091] Updated weights for policy 0, policy_version 924956 (0.0006) [2023-12-26 06:58:33,335][123090] Updated weights for policy 1, policy_version 918492 (0.0006) [2023-12-26 06:58:33,342][123091] Updated weights for policy 0, policy_version 924966 (0.0008) [2023-12-26 06:58:33,391][123091] Updated weights for policy 0, policy_version 924976 (0.0009) [2023-12-26 06:58:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 471932928. Throughput: 0: 8843.5, 1: 8990.0. Samples: 471944436. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:33,785][121949] Avg episode reward: [(0, '6250.672'), (1, '5876.892')] [2023-12-26 06:58:34,038][123091] Updated weights for policy 0, policy_version 924986 (0.0007) [2023-12-26 06:58:34,050][123090] Updated weights for policy 1, policy_version 918502 (0.0007) [2023-12-26 06:58:34,087][123091] Updated weights for policy 0, policy_version 924996 (0.0007) [2023-12-26 06:58:34,116][123090] Updated weights for policy 1, policy_version 918512 (0.0006) [2023-12-26 06:58:34,139][123091] Updated weights for policy 0, policy_version 925006 (0.0007) [2023-12-26 06:58:34,188][123090] Updated weights for policy 1, policy_version 918522 (0.0008) [2023-12-26 06:58:34,812][123090] Updated weights for policy 1, policy_version 918532 (0.0007) [2023-12-26 06:58:34,871][123090] Updated weights for policy 1, policy_version 918542 (0.0005) [2023-12-26 06:58:34,939][123090] Updated weights for policy 1, policy_version 918552 (0.0005) [2023-12-26 06:58:34,949][123091] Updated weights for policy 0, policy_version 925016 (0.0006) [2023-12-26 06:58:35,007][123091] Updated weights for policy 0, policy_version 925026 (0.0005) [2023-12-26 06:58:35,054][123091] Updated weights for policy 0, policy_version 925036 (0.0005) [2023-12-26 06:58:35,687][123090] Updated weights for policy 1, policy_version 918562 (0.0006) [2023-12-26 06:58:35,756][123090] Updated weights for policy 1, policy_version 918572 (0.0009) [2023-12-26 06:58:35,819][123090] Updated weights for policy 1, policy_version 918582 (0.0009) [2023-12-26 06:58:35,824][123091] Updated weights for policy 0, policy_version 925046 (0.0005) [2023-12-26 06:58:35,879][123091] Updated weights for policy 0, policy_version 925056 (0.0005) [2023-12-26 06:58:35,881][123090] Updated weights for policy 1, policy_version 918592 (0.0008) [2023-12-26 06:58:35,946][123091] Updated weights for policy 0, policy_version 925066 (0.0009) [2023-12-26 06:58:36,730][123091] Updated weights for policy 0, policy_version 925076 (0.0009) [2023-12-26 06:58:36,755][123090] Updated weights for policy 1, policy_version 918602 (0.0009) [2023-12-26 06:58:36,798][123091] Updated weights for policy 0, policy_version 925086 (0.0006) [2023-12-26 06:58:36,804][123090] Updated weights for policy 1, policy_version 918612 (0.0009) [2023-12-26 06:58:36,859][123091] Updated weights for policy 0, policy_version 925096 (0.0009) [2023-12-26 06:58:36,860][123090] Updated weights for policy 1, policy_version 918622 (0.0007) [2023-12-26 06:58:37,549][123091] Updated weights for policy 0, policy_version 925106 (0.0009) [2023-12-26 06:58:37,608][123091] Updated weights for policy 0, policy_version 925116 (0.0009) [2023-12-26 06:58:37,663][123090] Updated weights for policy 1, policy_version 918632 (0.0007) [2023-12-26 06:58:37,669][123091] Updated weights for policy 0, policy_version 925126 (0.0008) [2023-12-26 06:58:37,729][123091] Updated weights for policy 0, policy_version 925136 (0.0008) [2023-12-26 06:58:37,736][123090] Updated weights for policy 1, policy_version 918642 (0.0006) [2023-12-26 06:58:37,804][123090] Updated weights for policy 1, policy_version 918652 (0.0007) [2023-12-26 06:58:38,515][123091] Updated weights for policy 0, policy_version 925146 (0.0007) [2023-12-26 06:58:38,520][123090] Updated weights for policy 1, policy_version 918662 (0.0007) [2023-12-26 06:58:38,574][123090] Updated weights for policy 1, policy_version 918672 (0.0008) [2023-12-26 06:58:38,575][123091] Updated weights for policy 0, policy_version 925156 (0.0008) [2023-12-26 06:58:38,638][123090] Updated weights for policy 1, policy_version 918682 (0.0007) [2023-12-26 06:58:38,641][123091] Updated weights for policy 0, policy_version 925166 (0.0008) [2023-12-26 06:58:38,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 472031232. Throughput: 0: 8881.8, 1: 9049.1. Samples: 472000668. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:38,785][121949] Avg episode reward: [(0, '6240.630'), (1, '5897.752')] [2023-12-26 06:58:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000918688_235184128.pth... [2023-12-26 06:58:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000925168_236847104.pth... [2023-12-26 06:58:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000924112_236576768.pth [2023-12-26 06:58:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000917632_234913792.pth [2023-12-26 06:58:39,393][123091] Updated weights for policy 0, policy_version 925176 (0.0009) [2023-12-26 06:58:39,474][123091] Updated weights for policy 0, policy_version 925186 (0.0011) [2023-12-26 06:58:39,524][123090] Updated weights for policy 1, policy_version 918692 (0.0009) [2023-12-26 06:58:39,538][123091] Updated weights for policy 0, policy_version 925196 (0.0011) [2023-12-26 06:58:39,584][123090] Updated weights for policy 1, policy_version 918702 (0.0010) [2023-12-26 06:58:39,649][123090] Updated weights for policy 1, policy_version 918712 (0.0011) [2023-12-26 06:58:40,325][123091] Updated weights for policy 0, policy_version 925206 (0.0011) [2023-12-26 06:58:40,384][123091] Updated weights for policy 0, policy_version 925216 (0.0011) [2023-12-26 06:58:40,455][123091] Updated weights for policy 0, policy_version 925226 (0.0011) [2023-12-26 06:58:40,488][123090] Updated weights for policy 1, policy_version 918722 (0.0010) [2023-12-26 06:58:40,555][123090] Updated weights for policy 1, policy_version 918732 (0.0010) [2023-12-26 06:58:40,623][123090] Updated weights for policy 1, policy_version 918742 (0.0009) [2023-12-26 06:58:40,689][123090] Updated weights for policy 1, policy_version 918752 (0.0010) [2023-12-26 06:58:41,083][123091] Updated weights for policy 0, policy_version 925236 (0.0009) [2023-12-26 06:58:41,152][123091] Updated weights for policy 0, policy_version 925246 (0.0011) [2023-12-26 06:58:41,227][123091] Updated weights for policy 0, policy_version 925256 (0.0011) [2023-12-26 06:58:41,598][123090] Updated weights for policy 1, policy_version 918762 (0.0008) [2023-12-26 06:58:41,688][123090] Updated weights for policy 1, policy_version 918772 (0.0008) [2023-12-26 06:58:41,758][123090] Updated weights for policy 1, policy_version 918782 (0.0008) [2023-12-26 06:58:42,075][123091] Updated weights for policy 0, policy_version 925266 (0.0010) [2023-12-26 06:58:42,137][123091] Updated weights for policy 0, policy_version 925276 (0.0006) [2023-12-26 06:58:42,200][123091] Updated weights for policy 0, policy_version 925286 (0.0006) [2023-12-26 06:58:42,257][123091] Updated weights for policy 0, policy_version 925296 (0.0005) [2023-12-26 06:58:42,586][123090] Updated weights for policy 1, policy_version 918792 (0.0006) [2023-12-26 06:58:42,667][123090] Updated weights for policy 1, policy_version 918802 (0.0006) [2023-12-26 06:58:42,733][123090] Updated weights for policy 1, policy_version 918812 (0.0005) [2023-12-26 06:58:42,924][123091] Updated weights for policy 0, policy_version 925306 (0.0011) [2023-12-26 06:58:42,975][123091] Updated weights for policy 0, policy_version 925316 (0.0010) [2023-12-26 06:58:43,023][123091] Updated weights for policy 0, policy_version 925326 (0.0010) [2023-12-26 06:58:43,437][123090] Updated weights for policy 1, policy_version 918822 (0.0008) [2023-12-26 06:58:43,490][123090] Updated weights for policy 1, policy_version 918832 (0.0009) [2023-12-26 06:58:43,541][123090] Updated weights for policy 1, policy_version 918842 (0.0009) [2023-12-26 06:58:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 472113152. Throughput: 0: 8896.5, 1: 8901.1. Samples: 472106608. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:43,785][121949] Avg episode reward: [(0, '6214.339'), (1, '5895.569')] [2023-12-26 06:58:43,863][123091] Updated weights for policy 0, policy_version 925336 (0.0006) [2023-12-26 06:58:43,912][123091] Updated weights for policy 0, policy_version 925346 (0.0009) [2023-12-26 06:58:43,978][123091] Updated weights for policy 0, policy_version 925356 (0.0010) [2023-12-26 06:58:44,381][123090] Updated weights for policy 1, policy_version 918852 (0.0008) [2023-12-26 06:58:44,427][123090] Updated weights for policy 1, policy_version 918862 (0.0008) [2023-12-26 06:58:44,477][123090] Updated weights for policy 1, policy_version 918872 (0.0008) [2023-12-26 06:58:44,793][123091] Updated weights for policy 0, policy_version 925366 (0.0010) [2023-12-26 06:58:44,860][123091] Updated weights for policy 0, policy_version 925376 (0.0009) [2023-12-26 06:58:44,933][123091] Updated weights for policy 0, policy_version 925386 (0.0009) [2023-12-26 06:58:45,352][123090] Updated weights for policy 1, policy_version 918882 (0.0009) [2023-12-26 06:58:45,414][123090] Updated weights for policy 1, policy_version 918892 (0.0010) [2023-12-26 06:58:45,465][123090] Updated weights for policy 1, policy_version 918902 (0.0009) [2023-12-26 06:58:45,517][123090] Updated weights for policy 1, policy_version 918912 (0.0010) [2023-12-26 06:58:45,678][123091] Updated weights for policy 0, policy_version 925396 (0.0009) [2023-12-26 06:58:45,739][123091] Updated weights for policy 0, policy_version 925406 (0.0005) [2023-12-26 06:58:45,800][123091] Updated weights for policy 0, policy_version 925416 (0.0005) [2023-12-26 06:58:46,310][123090] Updated weights for policy 1, policy_version 918922 (0.0005) [2023-12-26 06:58:46,370][123090] Updated weights for policy 1, policy_version 918932 (0.0005) [2023-12-26 06:58:46,400][123091] Updated weights for policy 0, policy_version 925426 (0.0006) [2023-12-26 06:58:46,435][123090] Updated weights for policy 1, policy_version 918942 (0.0008) [2023-12-26 06:58:46,463][123091] Updated weights for policy 0, policy_version 925436 (0.0005) [2023-12-26 06:58:46,516][123091] Updated weights for policy 0, policy_version 925446 (0.0006) [2023-12-26 06:58:46,570][123091] Updated weights for policy 0, policy_version 925456 (0.0005) [2023-12-26 06:58:47,287][123090] Updated weights for policy 1, policy_version 918952 (0.0009) [2023-12-26 06:58:47,342][123091] Updated weights for policy 0, policy_version 925466 (0.0010) [2023-12-26 06:58:47,344][123090] Updated weights for policy 1, policy_version 918962 (0.0009) [2023-12-26 06:58:47,395][123091] Updated weights for policy 0, policy_version 925476 (0.0005) [2023-12-26 06:58:47,411][123090] Updated weights for policy 1, policy_version 918972 (0.0010) [2023-12-26 06:58:47,449][123091] Updated weights for policy 0, policy_version 925486 (0.0005) [2023-12-26 06:58:48,245][123091] Updated weights for policy 0, policy_version 925496 (0.0010) [2023-12-26 06:58:48,266][123090] Updated weights for policy 1, policy_version 918982 (0.0010) [2023-12-26 06:58:48,306][123091] Updated weights for policy 0, policy_version 925506 (0.0011) [2023-12-26 06:58:48,339][123090] Updated weights for policy 1, policy_version 918992 (0.0009) [2023-12-26 06:58:48,380][123091] Updated weights for policy 0, policy_version 925516 (0.0011) [2023-12-26 06:58:48,405][123090] Updated weights for policy 1, policy_version 919002 (0.0008) [2023-12-26 06:58:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 472203264. Throughput: 0: 8994.7, 1: 8830.7. Samples: 472213172. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:48,785][121949] Avg episode reward: [(0, '6304.412'), (1, '5831.018')] [2023-12-26 06:58:49,163][123090] Updated weights for policy 1, policy_version 919012 (0.0008) [2023-12-26 06:58:49,180][123091] Updated weights for policy 0, policy_version 925526 (0.0009) [2023-12-26 06:58:49,227][123090] Updated weights for policy 1, policy_version 919022 (0.0010) [2023-12-26 06:58:49,244][123091] Updated weights for policy 0, policy_version 925536 (0.0011) [2023-12-26 06:58:49,283][123090] Updated weights for policy 1, policy_version 919032 (0.0011) [2023-12-26 06:58:49,305][123091] Updated weights for policy 0, policy_version 925546 (0.0007) [2023-12-26 06:58:50,006][123090] Updated weights for policy 1, policy_version 919042 (0.0008) [2023-12-26 06:58:50,072][123090] Updated weights for policy 1, policy_version 919052 (0.0010) [2023-12-26 06:58:50,126][123090] Updated weights for policy 1, policy_version 919062 (0.0009) [2023-12-26 06:58:50,176][123090] Updated weights for policy 1, policy_version 919072 (0.0009) [2023-12-26 06:58:50,218][123091] Updated weights for policy 0, policy_version 925556 (0.0010) [2023-12-26 06:58:50,286][123091] Updated weights for policy 0, policy_version 925566 (0.0010) [2023-12-26 06:58:50,335][123091] Updated weights for policy 0, policy_version 925576 (0.0009) [2023-12-26 06:58:51,028][123090] Updated weights for policy 1, policy_version 919082 (0.0010) [2023-12-26 06:58:51,093][123090] Updated weights for policy 1, policy_version 919092 (0.0008) [2023-12-26 06:58:51,159][123090] Updated weights for policy 1, policy_version 919102 (0.0009) [2023-12-26 06:58:51,200][123091] Updated weights for policy 0, policy_version 925586 (0.0010) [2023-12-26 06:58:51,261][123091] Updated weights for policy 0, policy_version 925596 (0.0011) [2023-12-26 06:58:51,326][123091] Updated weights for policy 0, policy_version 925606 (0.0011) [2023-12-26 06:58:51,392][123091] Updated weights for policy 0, policy_version 925616 (0.0011) [2023-12-26 06:58:51,976][123090] Updated weights for policy 1, policy_version 919112 (0.0009) [2023-12-26 06:58:52,051][123090] Updated weights for policy 1, policy_version 919122 (0.0008) [2023-12-26 06:58:52,123][123090] Updated weights for policy 1, policy_version 919132 (0.0009) [2023-12-26 06:58:52,157][123091] Updated weights for policy 0, policy_version 925626 (0.0011) [2023-12-26 06:58:52,209][123091] Updated weights for policy 0, policy_version 925636 (0.0011) [2023-12-26 06:58:52,276][123091] Updated weights for policy 0, policy_version 925646 (0.0011) [2023-12-26 06:58:52,910][123090] Updated weights for policy 1, policy_version 919142 (0.0008) [2023-12-26 06:58:52,959][123090] Updated weights for policy 1, policy_version 919152 (0.0009) [2023-12-26 06:58:53,010][123090] Updated weights for policy 1, policy_version 919162 (0.0009) [2023-12-26 06:58:53,122][123091] Updated weights for policy 0, policy_version 925656 (0.0010) [2023-12-26 06:58:53,180][123091] Updated weights for policy 0, policy_version 925666 (0.0010) [2023-12-26 06:58:53,241][123091] Updated weights for policy 0, policy_version 925676 (0.0010) [2023-12-26 06:58:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 472285184. Throughput: 0: 8999.1, 1: 8771.7. Samples: 472265096. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:53,785][121949] Avg episode reward: [(0, '6352.422'), (1, '5772.833')] [2023-12-26 06:58:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000925680_236978176.pth... [2023-12-26 06:58:53,793][123090] Updated weights for policy 1, policy_version 919172 (0.0009) [2023-12-26 06:58:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000924624_236707840.pth [2023-12-26 06:58:53,850][123090] Updated weights for policy 1, policy_version 919182 (0.0006) [2023-12-26 06:58:53,915][123090] Updated weights for policy 1, policy_version 919192 (0.0006) [2023-12-26 06:58:53,960][123091] Updated weights for policy 0, policy_version 925686 (0.0007) [2023-12-26 06:58:53,964][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000919200_235315200.pth... [2023-12-26 06:58:53,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000918176_235053056.pth [2023-12-26 06:58:54,020][123091] Updated weights for policy 0, policy_version 925696 (0.0005) [2023-12-26 06:58:54,074][123091] Updated weights for policy 0, policy_version 925706 (0.0005) [2023-12-26 06:58:54,614][123090] Updated weights for policy 1, policy_version 919202 (0.0006) [2023-12-26 06:58:54,686][123090] Updated weights for policy 1, policy_version 919212 (0.0006) [2023-12-26 06:58:54,697][123091] Updated weights for policy 0, policy_version 925716 (0.0006) [2023-12-26 06:58:54,752][123090] Updated weights for policy 1, policy_version 919222 (0.0005) [2023-12-26 06:58:54,753][123091] Updated weights for policy 0, policy_version 925726 (0.0008) [2023-12-26 06:58:54,805][123091] Updated weights for policy 0, policy_version 925736 (0.0008) [2023-12-26 06:58:54,824][123090] Updated weights for policy 1, policy_version 919232 (0.0009) [2023-12-26 06:58:55,527][123091] Updated weights for policy 0, policy_version 925746 (0.0006) [2023-12-26 06:58:55,543][123090] Updated weights for policy 1, policy_version 919242 (0.0007) [2023-12-26 06:58:55,581][123091] Updated weights for policy 0, policy_version 925756 (0.0005) [2023-12-26 06:58:55,596][123090] Updated weights for policy 1, policy_version 919252 (0.0009) [2023-12-26 06:58:55,632][123091] Updated weights for policy 0, policy_version 925766 (0.0006) [2023-12-26 06:58:55,666][123090] Updated weights for policy 1, policy_version 919262 (0.0006) [2023-12-26 06:58:55,676][123091] Updated weights for policy 0, policy_version 925776 (0.0010) [2023-12-26 06:58:56,346][123090] Updated weights for policy 1, policy_version 919272 (0.0010) [2023-12-26 06:58:56,390][123091] Updated weights for policy 0, policy_version 925786 (0.0005) [2023-12-26 06:58:56,407][123090] Updated weights for policy 1, policy_version 919282 (0.0011) [2023-12-26 06:58:56,447][123091] Updated weights for policy 0, policy_version 925796 (0.0005) [2023-12-26 06:58:56,459][123090] Updated weights for policy 1, policy_version 919292 (0.0010) [2023-12-26 06:58:56,503][123091] Updated weights for policy 0, policy_version 925806 (0.0006) [2023-12-26 06:58:57,161][123091] Updated weights for policy 0, policy_version 925816 (0.0006) [2023-12-26 06:58:57,164][123090] Updated weights for policy 1, policy_version 919302 (0.0005) [2023-12-26 06:58:57,214][123091] Updated weights for policy 0, policy_version 925826 (0.0006) [2023-12-26 06:58:57,230][123090] Updated weights for policy 1, policy_version 919312 (0.0006) [2023-12-26 06:58:57,273][123091] Updated weights for policy 0, policy_version 925836 (0.0007) [2023-12-26 06:58:57,293][123090] Updated weights for policy 1, policy_version 919322 (0.0005) [2023-12-26 06:58:57,987][123091] Updated weights for policy 0, policy_version 925846 (0.0006) [2023-12-26 06:58:58,052][123091] Updated weights for policy 0, policy_version 925856 (0.0007) [2023-12-26 06:58:58,084][123090] Updated weights for policy 1, policy_version 919332 (0.0008) [2023-12-26 06:58:58,112][123091] Updated weights for policy 0, policy_version 925866 (0.0007) [2023-12-26 06:58:58,143][123090] Updated weights for policy 1, policy_version 919342 (0.0008) [2023-12-26 06:58:58,200][123090] Updated weights for policy 1, policy_version 919352 (0.0009) [2023-12-26 06:58:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 472383488. Throughput: 0: 9103.2, 1: 8852.3. Samples: 472379804. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:58:58,785][121949] Avg episode reward: [(0, '6250.033'), (1, '5889.655')] [2023-12-26 06:58:58,981][123091] Updated weights for policy 0, policy_version 925876 (0.0009) [2023-12-26 06:58:59,043][123091] Updated weights for policy 0, policy_version 925886 (0.0010) [2023-12-26 06:58:59,108][123091] Updated weights for policy 0, policy_version 925896 (0.0010) [2023-12-26 06:58:59,153][123090] Updated weights for policy 1, policy_version 919362 (0.0010) [2023-12-26 06:58:59,215][123090] Updated weights for policy 1, policy_version 919372 (0.0009) [2023-12-26 06:58:59,289][123090] Updated weights for policy 1, policy_version 919382 (0.0009) [2023-12-26 06:58:59,354][123090] Updated weights for policy 1, policy_version 919392 (0.0010) [2023-12-26 06:58:59,855][123091] Updated weights for policy 0, policy_version 925906 (0.0009) [2023-12-26 06:58:59,920][123091] Updated weights for policy 0, policy_version 925916 (0.0009) [2023-12-26 06:58:59,988][123091] Updated weights for policy 0, policy_version 925926 (0.0009) [2023-12-26 06:59:00,052][123091] Updated weights for policy 0, policy_version 925936 (0.0008) [2023-12-26 06:59:00,215][123090] Updated weights for policy 1, policy_version 919402 (0.0011) [2023-12-26 06:59:00,273][123090] Updated weights for policy 1, policy_version 919412 (0.0010) [2023-12-26 06:59:00,332][123090] Updated weights for policy 1, policy_version 919422 (0.0010) [2023-12-26 06:59:00,876][123091] Updated weights for policy 0, policy_version 925946 (0.0009) [2023-12-26 06:59:00,923][123091] Updated weights for policy 0, policy_version 925956 (0.0008) [2023-12-26 06:59:00,971][123091] Updated weights for policy 0, policy_version 925966 (0.0009) [2023-12-26 06:59:01,148][123090] Updated weights for policy 1, policy_version 919432 (0.0011) [2023-12-26 06:59:01,217][123090] Updated weights for policy 1, policy_version 919442 (0.0010) [2023-12-26 06:59:01,277][123090] Updated weights for policy 1, policy_version 919452 (0.0011) [2023-12-26 06:59:01,843][123091] Updated weights for policy 0, policy_version 925976 (0.0009) [2023-12-26 06:59:01,894][123091] Updated weights for policy 0, policy_version 925986 (0.0009) [2023-12-26 06:59:01,943][123091] Updated weights for policy 0, policy_version 925996 (0.0009) [2023-12-26 06:59:02,123][123090] Updated weights for policy 1, policy_version 919462 (0.0007) [2023-12-26 06:59:02,173][123090] Updated weights for policy 1, policy_version 919472 (0.0008) [2023-12-26 06:59:02,226][123090] Updated weights for policy 1, policy_version 919482 (0.0006) [2023-12-26 06:59:02,708][123091] Updated weights for policy 0, policy_version 926006 (0.0006) [2023-12-26 06:59:02,770][123091] Updated weights for policy 0, policy_version 926016 (0.0005) [2023-12-26 06:59:02,832][123091] Updated weights for policy 0, policy_version 926026 (0.0009) [2023-12-26 06:59:03,055][123090] Updated weights for policy 1, policy_version 919493 (0.0008) [2023-12-26 06:59:03,106][123090] Updated weights for policy 1, policy_version 919503 (0.0010) [2023-12-26 06:59:03,151][123090] Updated weights for policy 1, policy_version 919513 (0.0005) [2023-12-26 06:59:03,595][123091] Updated weights for policy 0, policy_version 926036 (0.0010) [2023-12-26 06:59:03,643][123091] Updated weights for policy 0, policy_version 926046 (0.0010) [2023-12-26 06:59:03,693][123091] Updated weights for policy 0, policy_version 926056 (0.0010) [2023-12-26 06:59:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17717.0). Total num frames: 472473600. Throughput: 0: 9097.0, 1: 8680.5. Samples: 472482852. Policy #0 lag: (min: 17.0, avg: 36.7, max: 49.0) [2023-12-26 06:59:03,784][121949] Avg episode reward: [(0, '6237.519'), (1, '5876.435')] [2023-12-26 06:59:03,953][123090] Updated weights for policy 1, policy_version 919523 (0.0008) [2023-12-26 06:59:04,017][123090] Updated weights for policy 1, policy_version 919533 (0.0009) [2023-12-26 06:59:04,092][123090] Updated weights for policy 1, policy_version 919543 (0.0006) [2023-12-26 06:59:04,417][123091] Updated weights for policy 0, policy_version 926066 (0.0008) [2023-12-26 06:59:04,479][123091] Updated weights for policy 0, policy_version 926076 (0.0007) [2023-12-26 06:59:04,543][123091] Updated weights for policy 0, policy_version 926086 (0.0007) [2023-12-26 06:59:04,594][123091] Updated weights for policy 0, policy_version 926096 (0.0006) [2023-12-26 06:59:04,750][123090] Updated weights for policy 1, policy_version 919553 (0.0006) [2023-12-26 06:59:04,807][123090] Updated weights for policy 1, policy_version 919563 (0.0007) [2023-12-26 06:59:04,877][123090] Updated weights for policy 1, policy_version 919573 (0.0011) [2023-12-26 06:59:04,929][123090] Updated weights for policy 1, policy_version 919583 (0.0010) [2023-12-26 06:59:05,258][123091] Updated weights for policy 0, policy_version 926106 (0.0005) [2023-12-26 06:59:05,316][123091] Updated weights for policy 0, policy_version 926116 (0.0005) [2023-12-26 06:59:05,371][123091] Updated weights for policy 0, policy_version 926126 (0.0005) [2023-12-26 06:59:05,769][123090] Updated weights for policy 1, policy_version 919593 (0.0007) [2023-12-26 06:59:05,837][123090] Updated weights for policy 1, policy_version 919603 (0.0005) [2023-12-26 06:59:05,883][123090] Updated weights for policy 1, policy_version 919613 (0.0005) [2023-12-26 06:59:06,025][123091] Updated weights for policy 0, policy_version 926136 (0.0006) [2023-12-26 06:59:06,083][123091] Updated weights for policy 0, policy_version 926146 (0.0006) [2023-12-26 06:59:06,155][123091] Updated weights for policy 0, policy_version 926156 (0.0007) [2023-12-26 06:59:06,671][123090] Updated weights for policy 1, policy_version 919623 (0.0009) [2023-12-26 06:59:06,734][123090] Updated weights for policy 1, policy_version 919633 (0.0011) [2023-12-26 06:59:06,801][123090] Updated weights for policy 1, policy_version 919643 (0.0011) [2023-12-26 06:59:06,900][123091] Updated weights for policy 0, policy_version 926166 (0.0009) [2023-12-26 06:59:06,961][123091] Updated weights for policy 0, policy_version 926176 (0.0005) [2023-12-26 06:59:07,015][123091] Updated weights for policy 0, policy_version 926186 (0.0006) [2023-12-26 06:59:07,550][123090] Updated weights for policy 1, policy_version 919653 (0.0011) [2023-12-26 06:59:07,583][123091] Updated weights for policy 0, policy_version 926196 (0.0007) [2023-12-26 06:59:07,607][123090] Updated weights for policy 1, policy_version 919663 (0.0006) [2023-12-26 06:59:07,635][123091] Updated weights for policy 0, policy_version 926206 (0.0009) [2023-12-26 06:59:07,654][123090] Updated weights for policy 1, policy_version 919673 (0.0005) [2023-12-26 06:59:07,719][123091] Updated weights for policy 0, policy_version 926216 (0.0008) [2023-12-26 06:59:08,316][123090] Updated weights for policy 1, policy_version 919683 (0.0006) [2023-12-26 06:59:08,385][123090] Updated weights for policy 1, policy_version 919693 (0.0007) [2023-12-26 06:59:08,394][123091] Updated weights for policy 0, policy_version 926226 (0.0006) [2023-12-26 06:59:08,446][123091] Updated weights for policy 0, policy_version 926236 (0.0008) [2023-12-26 06:59:08,448][123090] Updated weights for policy 1, policy_version 919703 (0.0007) [2023-12-26 06:59:08,501][123091] Updated weights for policy 0, policy_version 926246 (0.0008) [2023-12-26 06:59:08,569][123091] Updated weights for policy 0, policy_version 926256 (0.0008) [2023-12-26 06:59:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 472571904. Throughput: 0: 9215.1, 1: 8736.7. Samples: 472541524. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:08,785][121949] Avg episode reward: [(0, '6338.930'), (1, '5892.219')] [2023-12-26 06:59:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000926256_237125632.pth... [2023-12-26 06:59:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000919712_235446272.pth... [2023-12-26 06:59:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000925168_236847104.pth [2023-12-26 06:59:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000918688_235184128.pth [2023-12-26 06:59:09,253][123090] Updated weights for policy 1, policy_version 919713 (0.0006) [2023-12-26 06:59:09,313][123090] Updated weights for policy 1, policy_version 919723 (0.0008) [2023-12-26 06:59:09,377][123090] Updated weights for policy 1, policy_version 919733 (0.0008) [2023-12-26 06:59:09,426][123091] Updated weights for policy 0, policy_version 926266 (0.0010) [2023-12-26 06:59:09,445][123090] Updated weights for policy 1, policy_version 919743 (0.0008) [2023-12-26 06:59:09,490][123091] Updated weights for policy 0, policy_version 926276 (0.0008) [2023-12-26 06:59:09,562][123091] Updated weights for policy 0, policy_version 926286 (0.0006) [2023-12-26 06:59:10,289][123090] Updated weights for policy 1, policy_version 919753 (0.0009) [2023-12-26 06:59:10,334][123091] Updated weights for policy 0, policy_version 926296 (0.0008) [2023-12-26 06:59:10,356][123090] Updated weights for policy 1, policy_version 919763 (0.0008) [2023-12-26 06:59:10,395][123091] Updated weights for policy 0, policy_version 926306 (0.0008) [2023-12-26 06:59:10,419][123090] Updated weights for policy 1, policy_version 919773 (0.0008) [2023-12-26 06:59:10,449][123091] Updated weights for policy 0, policy_version 926316 (0.0008) [2023-12-26 06:59:11,278][123091] Updated weights for policy 0, policy_version 926326 (0.0010) [2023-12-26 06:59:11,289][123090] Updated weights for policy 1, policy_version 919783 (0.0008) [2023-12-26 06:59:11,342][123091] Updated weights for policy 0, policy_version 926336 (0.0011) [2023-12-26 06:59:11,358][123090] Updated weights for policy 1, policy_version 919793 (0.0007) [2023-12-26 06:59:11,415][123091] Updated weights for policy 0, policy_version 926346 (0.0011) [2023-12-26 06:59:11,430][123090] Updated weights for policy 1, policy_version 919803 (0.0009) [2023-12-26 06:59:12,171][123091] Updated weights for policy 0, policy_version 926356 (0.0007) [2023-12-26 06:59:12,244][123091] Updated weights for policy 0, policy_version 926366 (0.0007) [2023-12-26 06:59:12,316][123091] Updated weights for policy 0, policy_version 926376 (0.0011) [2023-12-26 06:59:12,335][123090] Updated weights for policy 1, policy_version 919813 (0.0008) [2023-12-26 06:59:12,406][123090] Updated weights for policy 1, policy_version 919823 (0.0006) [2023-12-26 06:59:12,463][123090] Updated weights for policy 1, policy_version 919833 (0.0006) [2023-12-26 06:59:13,082][123091] Updated weights for policy 0, policy_version 926386 (0.0010) [2023-12-26 06:59:13,115][123090] Updated weights for policy 1, policy_version 919843 (0.0008) [2023-12-26 06:59:13,130][123091] Updated weights for policy 0, policy_version 926396 (0.0005) [2023-12-26 06:59:13,165][123090] Updated weights for policy 1, policy_version 919853 (0.0009) [2023-12-26 06:59:13,189][123091] Updated weights for policy 0, policy_version 926406 (0.0007) [2023-12-26 06:59:13,233][123090] Updated weights for policy 1, policy_version 919863 (0.0009) [2023-12-26 06:59:13,238][123091] Updated weights for policy 0, policy_version 926416 (0.0006) [2023-12-26 06:59:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 472653824. Throughput: 0: 9228.6, 1: 8731.7. Samples: 472647280. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:13,785][121949] Avg episode reward: [(0, '6280.646'), (1, '5921.703')] [2023-12-26 06:59:13,953][123091] Updated weights for policy 0, policy_version 926426 (0.0010) [2023-12-26 06:59:14,008][123091] Updated weights for policy 0, policy_version 926436 (0.0005) [2023-12-26 06:59:14,065][123091] Updated weights for policy 0, policy_version 926446 (0.0006) [2023-12-26 06:59:14,177][123090] Updated weights for policy 1, policy_version 919873 (0.0009) [2023-12-26 06:59:14,232][123090] Updated weights for policy 1, policy_version 919884 (0.0010) [2023-12-26 06:59:14,306][123090] Updated weights for policy 1, policy_version 919894 (0.0009) [2023-12-26 06:59:14,364][123090] Updated weights for policy 1, policy_version 919904 (0.0009) [2023-12-26 06:59:14,839][123091] Updated weights for policy 0, policy_version 926456 (0.0008) [2023-12-26 06:59:14,892][123091] Updated weights for policy 0, policy_version 926467 (0.0009) [2023-12-26 06:59:14,950][123091] Updated weights for policy 0, policy_version 926477 (0.0009) [2023-12-26 06:59:15,196][123090] Updated weights for policy 1, policy_version 919914 (0.0009) [2023-12-26 06:59:15,255][123090] Updated weights for policy 1, policy_version 919924 (0.0010) [2023-12-26 06:59:15,319][123090] Updated weights for policy 1, policy_version 919934 (0.0009) [2023-12-26 06:59:15,739][123091] Updated weights for policy 0, policy_version 926487 (0.0007) [2023-12-26 06:59:15,794][123091] Updated weights for policy 0, policy_version 926497 (0.0006) [2023-12-26 06:59:15,838][123091] Updated weights for policy 0, policy_version 926507 (0.0005) [2023-12-26 06:59:16,244][123090] Updated weights for policy 1, policy_version 919944 (0.0009) [2023-12-26 06:59:16,304][123090] Updated weights for policy 1, policy_version 919954 (0.0009) [2023-12-26 06:59:16,366][123090] Updated weights for policy 1, policy_version 919964 (0.0010) [2023-12-26 06:59:16,445][123091] Updated weights for policy 0, policy_version 926517 (0.0008) [2023-12-26 06:59:16,508][123091] Updated weights for policy 0, policy_version 926527 (0.0009) [2023-12-26 06:59:16,559][123091] Updated weights for policy 0, policy_version 926537 (0.0005) [2023-12-26 06:59:17,186][123090] Updated weights for policy 1, policy_version 919974 (0.0010) [2023-12-26 06:59:17,240][123090] Updated weights for policy 1, policy_version 919984 (0.0010) [2023-12-26 06:59:17,288][123090] Updated weights for policy 1, policy_version 919994 (0.0010) [2023-12-26 06:59:17,355][123091] Updated weights for policy 0, policy_version 926547 (0.0007) [2023-12-26 06:59:17,420][123091] Updated weights for policy 0, policy_version 926557 (0.0009) [2023-12-26 06:59:17,469][123091] Updated weights for policy 0, policy_version 926567 (0.0009) [2023-12-26 06:59:18,089][123090] Updated weights for policy 1, policy_version 920004 (0.0009) [2023-12-26 06:59:18,147][123090] Updated weights for policy 1, policy_version 920014 (0.0009) [2023-12-26 06:59:18,200][123090] Updated weights for policy 1, policy_version 920025 (0.0009) [2023-12-26 06:59:18,324][123091] Updated weights for policy 0, policy_version 926577 (0.0009) [2023-12-26 06:59:18,386][123091] Updated weights for policy 0, policy_version 926587 (0.0008) [2023-12-26 06:59:18,458][123091] Updated weights for policy 0, policy_version 926597 (0.0005) [2023-12-26 06:59:18,532][123091] Updated weights for policy 0, policy_version 926607 (0.0007) [2023-12-26 06:59:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 472743936. Throughput: 0: 9242.3, 1: 8749.1. Samples: 472754048. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:18,785][121949] Avg episode reward: [(0, '6264.922'), (1, '5888.112')] [2023-12-26 06:59:19,091][123090] Updated weights for policy 1, policy_version 920035 (0.0010) [2023-12-26 06:59:19,145][123090] Updated weights for policy 1, policy_version 920045 (0.0009) [2023-12-26 06:59:19,193][123090] Updated weights for policy 1, policy_version 920055 (0.0005) [2023-12-26 06:59:19,320][123091] Updated weights for policy 0, policy_version 926617 (0.0010) [2023-12-26 06:59:19,384][123091] Updated weights for policy 0, policy_version 926627 (0.0010) [2023-12-26 06:59:19,433][123091] Updated weights for policy 0, policy_version 926637 (0.0009) [2023-12-26 06:59:20,042][123090] Updated weights for policy 1, policy_version 920065 (0.0008) [2023-12-26 06:59:20,105][123090] Updated weights for policy 1, policy_version 920075 (0.0008) [2023-12-26 06:59:20,164][123090] Updated weights for policy 1, policy_version 920085 (0.0005) [2023-12-26 06:59:20,224][123090] Updated weights for policy 1, policy_version 920095 (0.0010) [2023-12-26 06:59:20,330][123091] Updated weights for policy 0, policy_version 926648 (0.0010) [2023-12-26 06:59:20,391][123091] Updated weights for policy 0, policy_version 926658 (0.0010) [2023-12-26 06:59:20,452][123091] Updated weights for policy 0, policy_version 926668 (0.0009) [2023-12-26 06:59:21,091][123090] Updated weights for policy 1, policy_version 920105 (0.0010) [2023-12-26 06:59:21,154][123090] Updated weights for policy 1, policy_version 920115 (0.0010) [2023-12-26 06:59:21,224][123090] Updated weights for policy 1, policy_version 920125 (0.0010) [2023-12-26 06:59:21,283][123091] Updated weights for policy 0, policy_version 926678 (0.0008) [2023-12-26 06:59:21,348][123091] Updated weights for policy 0, policy_version 926688 (0.0010) [2023-12-26 06:59:21,421][123091] Updated weights for policy 0, policy_version 926698 (0.0010) [2023-12-26 06:59:22,096][123090] Updated weights for policy 1, policy_version 920135 (0.0007) [2023-12-26 06:59:22,166][123090] Updated weights for policy 1, policy_version 920145 (0.0007) [2023-12-26 06:59:22,249][123090] Updated weights for policy 1, policy_version 920155 (0.0006) [2023-12-26 06:59:22,300][123091] Updated weights for policy 0, policy_version 926708 (0.0010) [2023-12-26 06:59:22,376][123091] Updated weights for policy 0, policy_version 926718 (0.0010) [2023-12-26 06:59:22,438][123091] Updated weights for policy 0, policy_version 926728 (0.0010) [2023-12-26 06:59:23,006][123090] Updated weights for policy 1, policy_version 920165 (0.0008) [2023-12-26 06:59:23,069][123090] Updated weights for policy 1, policy_version 920175 (0.0007) [2023-12-26 06:59:23,139][123090] Updated weights for policy 1, policy_version 920185 (0.0010) [2023-12-26 06:59:23,228][123091] Updated weights for policy 0, policy_version 926738 (0.0009) [2023-12-26 06:59:23,287][123091] Updated weights for policy 0, policy_version 926748 (0.0006) [2023-12-26 06:59:23,347][123091] Updated weights for policy 0, policy_version 926758 (0.0006) [2023-12-26 06:59:23,417][123091] Updated weights for policy 0, policy_version 926768 (0.0009) [2023-12-26 06:59:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 472825856. Throughput: 0: 9168.8, 1: 8680.0. Samples: 472803860. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:23,785][121949] Avg episode reward: [(0, '6341.463'), (1, '5942.655')] [2023-12-26 06:59:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000926768_237256704.pth... [2023-12-26 06:59:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000920192_235569152.pth... [2023-12-26 06:59:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000925680_236978176.pth [2023-12-26 06:59:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000919200_235315200.pth [2023-12-26 06:59:23,931][123090] Updated weights for policy 1, policy_version 920195 (0.0009) [2023-12-26 06:59:23,979][123090] Updated weights for policy 1, policy_version 920205 (0.0009) [2023-12-26 06:59:24,032][123090] Updated weights for policy 1, policy_version 920215 (0.0009) [2023-12-26 06:59:24,185][123091] Updated weights for policy 0, policy_version 926778 (0.0011) [2023-12-26 06:59:24,253][123091] Updated weights for policy 0, policy_version 926788 (0.0011) [2023-12-26 06:59:24,320][123091] Updated weights for policy 0, policy_version 926798 (0.0011) [2023-12-26 06:59:24,907][123090] Updated weights for policy 1, policy_version 920225 (0.0009) [2023-12-26 06:59:24,962][123090] Updated weights for policy 1, policy_version 920235 (0.0009) [2023-12-26 06:59:25,015][123090] Updated weights for policy 1, policy_version 920245 (0.0009) [2023-12-26 06:59:25,067][123090] Updated weights for policy 1, policy_version 920255 (0.0009) [2023-12-26 06:59:25,138][123091] Updated weights for policy 0, policy_version 926808 (0.0010) [2023-12-26 06:59:25,182][123091] Updated weights for policy 0, policy_version 926818 (0.0010) [2023-12-26 06:59:25,230][123091] Updated weights for policy 0, policy_version 926828 (0.0010) [2023-12-26 06:59:25,894][123090] Updated weights for policy 1, policy_version 920265 (0.0008) [2023-12-26 06:59:25,945][123090] Updated weights for policy 1, policy_version 920275 (0.0009) [2023-12-26 06:59:26,017][123090] Updated weights for policy 1, policy_version 920285 (0.0009) [2023-12-26 06:59:26,079][123091] Updated weights for policy 0, policy_version 926838 (0.0011) [2023-12-26 06:59:26,144][123091] Updated weights for policy 0, policy_version 926848 (0.0010) [2023-12-26 06:59:26,199][123091] Updated weights for policy 0, policy_version 926858 (0.0010) [2023-12-26 06:59:26,843][123090] Updated weights for policy 1, policy_version 920295 (0.0009) [2023-12-26 06:59:26,902][123090] Updated weights for policy 1, policy_version 920305 (0.0009) [2023-12-26 06:59:26,965][123090] Updated weights for policy 1, policy_version 920315 (0.0009) [2023-12-26 06:59:27,010][123091] Updated weights for policy 0, policy_version 926868 (0.0010) [2023-12-26 06:59:27,064][123091] Updated weights for policy 0, policy_version 926878 (0.0010) [2023-12-26 06:59:27,107][123091] Updated weights for policy 0, policy_version 926888 (0.0010) [2023-12-26 06:59:27,784][123090] Updated weights for policy 1, policy_version 920325 (0.0009) [2023-12-26 06:59:27,831][123090] Updated weights for policy 1, policy_version 920335 (0.0008) [2023-12-26 06:59:27,876][123090] Updated weights for policy 1, policy_version 920345 (0.0007) [2023-12-26 06:59:27,942][123091] Updated weights for policy 0, policy_version 926898 (0.0009) [2023-12-26 06:59:27,993][123091] Updated weights for policy 0, policy_version 926908 (0.0005) [2023-12-26 06:59:28,064][123091] Updated weights for policy 0, policy_version 926918 (0.0005) [2023-12-26 06:59:28,118][123091] Updated weights for policy 0, policy_version 926928 (0.0007) [2023-12-26 06:59:28,725][123090] Updated weights for policy 1, policy_version 920355 (0.0009) [2023-12-26 06:59:28,774][123090] Updated weights for policy 1, policy_version 920365 (0.0009) [2023-12-26 06:59:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 472907776. Throughput: 0: 9094.7, 1: 8688.2. Samples: 472906840. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:28,785][121949] Avg episode reward: [(0, '6332.695'), (1, '5950.663')] [2023-12-26 06:59:28,833][123090] Updated weights for policy 1, policy_version 920375 (0.0008) [2023-12-26 06:59:28,926][123091] Updated weights for policy 0, policy_version 926938 (0.0008) [2023-12-26 06:59:28,993][123091] Updated weights for policy 0, policy_version 926948 (0.0010) [2023-12-26 06:59:29,061][123091] Updated weights for policy 0, policy_version 926958 (0.0010) [2023-12-26 06:59:29,674][123090] Updated weights for policy 1, policy_version 920385 (0.0008) [2023-12-26 06:59:29,728][123090] Updated weights for policy 1, policy_version 920396 (0.0010) [2023-12-26 06:59:29,787][123090] Updated weights for policy 1, policy_version 920406 (0.0009) [2023-12-26 06:59:29,851][123090] Updated weights for policy 1, policy_version 920416 (0.0009) [2023-12-26 06:59:29,868][123091] Updated weights for policy 0, policy_version 926968 (0.0007) [2023-12-26 06:59:29,929][123091] Updated weights for policy 0, policy_version 926978 (0.0009) [2023-12-26 06:59:29,988][123091] Updated weights for policy 0, policy_version 926988 (0.0006) [2023-12-26 06:59:30,738][123090] Updated weights for policy 1, policy_version 920426 (0.0009) [2023-12-26 06:59:30,756][123091] Updated weights for policy 0, policy_version 926998 (0.0008) [2023-12-26 06:59:30,794][123090] Updated weights for policy 1, policy_version 920436 (0.0007) [2023-12-26 06:59:30,813][123091] Updated weights for policy 0, policy_version 927008 (0.0009) [2023-12-26 06:59:30,853][123090] Updated weights for policy 1, policy_version 920447 (0.0008) [2023-12-26 06:59:30,867][123091] Updated weights for policy 0, policy_version 927018 (0.0009) [2023-12-26 06:59:31,685][123091] Updated weights for policy 0, policy_version 927028 (0.0008) [2023-12-26 06:59:31,710][123090] Updated weights for policy 1, policy_version 920457 (0.0008) [2023-12-26 06:59:31,755][123091] Updated weights for policy 0, policy_version 927038 (0.0010) [2023-12-26 06:59:31,783][123090] Updated weights for policy 1, policy_version 920467 (0.0010) [2023-12-26 06:59:31,803][123091] Updated weights for policy 0, policy_version 927048 (0.0006) [2023-12-26 06:59:31,842][123090] Updated weights for policy 1, policy_version 920477 (0.0007) [2023-12-26 06:59:32,603][123091] Updated weights for policy 0, policy_version 927058 (0.0008) [2023-12-26 06:59:32,675][123090] Updated weights for policy 1, policy_version 920487 (0.0008) [2023-12-26 06:59:32,680][123091] Updated weights for policy 0, policy_version 927068 (0.0005) [2023-12-26 06:59:32,731][123090] Updated weights for policy 1, policy_version 920497 (0.0009) [2023-12-26 06:59:32,752][123091] Updated weights for policy 0, policy_version 927078 (0.0005) [2023-12-26 06:59:32,780][123090] Updated weights for policy 1, policy_version 920507 (0.0009) [2023-12-26 06:59:32,813][123091] Updated weights for policy 0, policy_version 927088 (0.0008) [2023-12-26 06:59:33,521][123090] Updated weights for policy 1, policy_version 920517 (0.0007) [2023-12-26 06:59:33,548][123091] Updated weights for policy 0, policy_version 927098 (0.0007) [2023-12-26 06:59:33,585][123090] Updated weights for policy 1, policy_version 920527 (0.0008) [2023-12-26 06:59:33,606][123091] Updated weights for policy 0, policy_version 927108 (0.0009) [2023-12-26 06:59:33,640][123090] Updated weights for policy 1, policy_version 920537 (0.0006) [2023-12-26 06:59:33,665][123091] Updated weights for policy 0, policy_version 927118 (0.0009) [2023-12-26 06:59:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 473006080. Throughput: 0: 9062.3, 1: 8685.7. Samples: 473011832. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:33,785][121949] Avg episode reward: [(0, '6239.272'), (1, '5671.800')] [2023-12-26 06:59:34,470][123090] Updated weights for policy 1, policy_version 920547 (0.0009) [2023-12-26 06:59:34,501][123091] Updated weights for policy 0, policy_version 927128 (0.0007) [2023-12-26 06:59:34,534][123090] Updated weights for policy 1, policy_version 920557 (0.0009) [2023-12-26 06:59:34,565][123091] Updated weights for policy 0, policy_version 927138 (0.0006) [2023-12-26 06:59:34,604][123090] Updated weights for policy 1, policy_version 920567 (0.0008) [2023-12-26 06:59:34,624][123091] Updated weights for policy 0, policy_version 927148 (0.0008) [2023-12-26 06:59:35,430][123091] Updated weights for policy 0, policy_version 927158 (0.0009) [2023-12-26 06:59:35,434][123090] Updated weights for policy 1, policy_version 920577 (0.0008) [2023-12-26 06:59:35,486][123090] Updated weights for policy 1, policy_version 920587 (0.0006) [2023-12-26 06:59:35,491][123091] Updated weights for policy 0, policy_version 927168 (0.0009) [2023-12-26 06:59:35,542][123090] Updated weights for policy 1, policy_version 920597 (0.0007) [2023-12-26 06:59:35,551][123091] Updated weights for policy 0, policy_version 927178 (0.0009) [2023-12-26 06:59:35,592][123090] Updated weights for policy 1, policy_version 920607 (0.0008) [2023-12-26 06:59:36,378][123091] Updated weights for policy 0, policy_version 927188 (0.0009) [2023-12-26 06:59:36,439][123090] Updated weights for policy 1, policy_version 920617 (0.0009) [2023-12-26 06:59:36,444][123091] Updated weights for policy 0, policy_version 927198 (0.0010) [2023-12-26 06:59:36,504][123090] Updated weights for policy 1, policy_version 920627 (0.0009) [2023-12-26 06:59:36,506][123091] Updated weights for policy 0, policy_version 927208 (0.0007) [2023-12-26 06:59:36,566][123090] Updated weights for policy 1, policy_version 920637 (0.0008) [2023-12-26 06:59:37,347][123091] Updated weights for policy 0, policy_version 927218 (0.0008) [2023-12-26 06:59:37,399][123090] Updated weights for policy 1, policy_version 920647 (0.0009) [2023-12-26 06:59:37,410][123091] Updated weights for policy 0, policy_version 927228 (0.0010) [2023-12-26 06:59:37,459][123090] Updated weights for policy 1, policy_version 920657 (0.0009) [2023-12-26 06:59:37,472][123091] Updated weights for policy 0, policy_version 927238 (0.0006) [2023-12-26 06:59:37,516][123090] Updated weights for policy 1, policy_version 920667 (0.0010) [2023-12-26 06:59:37,538][123091] Updated weights for policy 0, policy_version 927248 (0.0007) [2023-12-26 06:59:38,260][123091] Updated weights for policy 0, policy_version 927258 (0.0007) [2023-12-26 06:59:38,315][123091] Updated weights for policy 0, policy_version 927268 (0.0011) [2023-12-26 06:59:38,344][123090] Updated weights for policy 1, policy_version 920677 (0.0008) [2023-12-26 06:59:38,382][123091] Updated weights for policy 0, policy_version 927278 (0.0011) [2023-12-26 06:59:38,408][123090] Updated weights for policy 1, policy_version 920687 (0.0006) [2023-12-26 06:59:38,471][123090] Updated weights for policy 1, policy_version 920697 (0.0007) [2023-12-26 06:59:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 473088000. Throughput: 0: 9077.4, 1: 8648.0. Samples: 473062740. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:38,785][121949] Avg episode reward: [(0, '6232.792'), (1, '5648.825')] [2023-12-26 06:59:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000927280_237387776.pth... [2023-12-26 06:59:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000920704_235700224.pth... [2023-12-26 06:59:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000926256_237125632.pth [2023-12-26 06:59:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000919712_235446272.pth [2023-12-26 06:59:39,007][123091] Updated weights for policy 0, policy_version 927288 (0.0007) [2023-12-26 06:59:39,072][123091] Updated weights for policy 0, policy_version 927298 (0.0006) [2023-12-26 06:59:39,138][123091] Updated weights for policy 0, policy_version 927308 (0.0007) [2023-12-26 06:59:39,142][123090] Updated weights for policy 1, policy_version 920707 (0.0009) [2023-12-26 06:59:39,199][123090] Updated weights for policy 1, policy_version 920717 (0.0009) [2023-12-26 06:59:39,267][123090] Updated weights for policy 1, policy_version 920727 (0.0009) [2023-12-26 06:59:39,902][123091] Updated weights for policy 0, policy_version 927318 (0.0009) [2023-12-26 06:59:39,976][123091] Updated weights for policy 0, policy_version 927328 (0.0009) [2023-12-26 06:59:40,047][123091] Updated weights for policy 0, policy_version 927338 (0.0007) [2023-12-26 06:59:40,140][123090] Updated weights for policy 1, policy_version 920737 (0.0009) [2023-12-26 06:59:40,194][123090] Updated weights for policy 1, policy_version 920747 (0.0010) [2023-12-26 06:59:40,257][123090] Updated weights for policy 1, policy_version 920757 (0.0009) [2023-12-26 06:59:40,329][123090] Updated weights for policy 1, policy_version 920767 (0.0009) [2023-12-26 06:59:40,813][123091] Updated weights for policy 0, policy_version 927348 (0.0009) [2023-12-26 06:59:40,862][123091] Updated weights for policy 0, policy_version 927358 (0.0009) [2023-12-26 06:59:40,910][123091] Updated weights for policy 0, policy_version 927368 (0.0007) [2023-12-26 06:59:41,223][123090] Updated weights for policy 1, policy_version 920777 (0.0009) [2023-12-26 06:59:41,295][123090] Updated weights for policy 1, policy_version 920787 (0.0010) [2023-12-26 06:59:41,364][123090] Updated weights for policy 1, policy_version 920797 (0.0009) [2023-12-26 06:59:41,722][123091] Updated weights for policy 0, policy_version 927378 (0.0006) [2023-12-26 06:59:41,791][123091] Updated weights for policy 0, policy_version 927388 (0.0009) [2023-12-26 06:59:41,851][123091] Updated weights for policy 0, policy_version 927398 (0.0009) [2023-12-26 06:59:41,910][123091] Updated weights for policy 0, policy_version 927408 (0.0009) [2023-12-26 06:59:42,207][123090] Updated weights for policy 1, policy_version 920807 (0.0009) [2023-12-26 06:59:42,265][123090] Updated weights for policy 1, policy_version 920817 (0.0009) [2023-12-26 06:59:42,326][123090] Updated weights for policy 1, policy_version 920827 (0.0007) [2023-12-26 06:59:42,726][123091] Updated weights for policy 0, policy_version 927418 (0.0006) [2023-12-26 06:59:42,779][123091] Updated weights for policy 0, policy_version 927428 (0.0005) [2023-12-26 06:59:42,831][123091] Updated weights for policy 0, policy_version 927438 (0.0005) [2023-12-26 06:59:43,183][123090] Updated weights for policy 1, policy_version 920837 (0.0008) [2023-12-26 06:59:43,239][123090] Updated weights for policy 1, policy_version 920847 (0.0009) [2023-12-26 06:59:43,300][123090] Updated weights for policy 1, policy_version 920857 (0.0009) [2023-12-26 06:59:43,544][123091] Updated weights for policy 0, policy_version 927448 (0.0005) [2023-12-26 06:59:43,606][123091] Updated weights for policy 0, policy_version 927458 (0.0005) [2023-12-26 06:59:43,656][123091] Updated weights for policy 0, policy_version 927468 (0.0005) [2023-12-26 06:59:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 473178112. Throughput: 0: 8986.2, 1: 8535.0. Samples: 473168260. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:43,784][121949] Avg episode reward: [(0, '6171.441'), (1, '5720.848')] [2023-12-26 06:59:44,040][123090] Updated weights for policy 1, policy_version 920867 (0.0010) [2023-12-26 06:59:44,098][123090] Updated weights for policy 1, policy_version 920877 (0.0010) [2023-12-26 06:59:44,154][123090] Updated weights for policy 1, policy_version 920887 (0.0008) [2023-12-26 06:59:44,423][123091] Updated weights for policy 0, policy_version 927478 (0.0008) [2023-12-26 06:59:44,489][123091] Updated weights for policy 0, policy_version 927488 (0.0009) [2023-12-26 06:59:44,550][123091] Updated weights for policy 0, policy_version 927498 (0.0009) [2023-12-26 06:59:44,975][123090] Updated weights for policy 1, policy_version 920897 (0.0009) [2023-12-26 06:59:45,025][123090] Updated weights for policy 1, policy_version 920907 (0.0007) [2023-12-26 06:59:45,089][123090] Updated weights for policy 1, policy_version 920917 (0.0007) [2023-12-26 06:59:45,160][123090] Updated weights for policy 1, policy_version 920927 (0.0010) [2023-12-26 06:59:45,404][123091] Updated weights for policy 0, policy_version 927508 (0.0010) [2023-12-26 06:59:45,467][123091] Updated weights for policy 0, policy_version 927518 (0.0010) [2023-12-26 06:59:45,537][123091] Updated weights for policy 0, policy_version 927528 (0.0010) [2023-12-26 06:59:45,819][123090] Updated weights for policy 1, policy_version 920937 (0.0006) [2023-12-26 06:59:45,877][123090] Updated weights for policy 1, policy_version 920947 (0.0005) [2023-12-26 06:59:45,936][123090] Updated weights for policy 1, policy_version 920957 (0.0005) [2023-12-26 06:59:46,356][123091] Updated weights for policy 0, policy_version 927538 (0.0008) [2023-12-26 06:59:46,427][123091] Updated weights for policy 0, policy_version 927548 (0.0005) [2023-12-26 06:59:46,497][123091] Updated weights for policy 0, policy_version 927558 (0.0005) [2023-12-26 06:59:46,564][123091] Updated weights for policy 0, policy_version 927568 (0.0005) [2023-12-26 06:59:46,628][123090] Updated weights for policy 1, policy_version 920967 (0.0008) [2023-12-26 06:59:46,699][123090] Updated weights for policy 1, policy_version 920977 (0.0010) [2023-12-26 06:59:46,768][123090] Updated weights for policy 1, policy_version 920987 (0.0007) [2023-12-26 06:59:47,222][123091] Updated weights for policy 0, policy_version 927578 (0.0011) [2023-12-26 06:59:47,281][123091] Updated weights for policy 0, policy_version 927588 (0.0010) [2023-12-26 06:59:47,348][123091] Updated weights for policy 0, policy_version 927598 (0.0011) [2023-12-26 06:59:47,545][123090] Updated weights for policy 1, policy_version 920997 (0.0008) [2023-12-26 06:59:47,608][123090] Updated weights for policy 1, policy_version 921007 (0.0010) [2023-12-26 06:59:47,671][123090] Updated weights for policy 1, policy_version 921017 (0.0010) [2023-12-26 06:59:48,151][123091] Updated weights for policy 0, policy_version 927608 (0.0011) [2023-12-26 06:59:48,195][123091] Updated weights for policy 0, policy_version 927618 (0.0010) [2023-12-26 06:59:48,246][123091] Updated weights for policy 0, policy_version 927628 (0.0010) [2023-12-26 06:59:48,509][123090] Updated weights for policy 1, policy_version 921027 (0.0010) [2023-12-26 06:59:48,573][123090] Updated weights for policy 1, policy_version 921037 (0.0010) [2023-12-26 06:59:48,637][123090] Updated weights for policy 1, policy_version 921047 (0.0010) [2023-12-26 06:59:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 473268224. Throughput: 0: 9014.1, 1: 8650.7. Samples: 473277772. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:48,785][121949] Avg episode reward: [(0, '6196.227'), (1, '5589.143')] [2023-12-26 06:59:49,021][123091] Updated weights for policy 0, policy_version 927638 (0.0008) [2023-12-26 06:59:49,081][123091] Updated weights for policy 0, policy_version 927648 (0.0006) [2023-12-26 06:59:49,144][123091] Updated weights for policy 0, policy_version 927658 (0.0006) [2023-12-26 06:59:49,521][123090] Updated weights for policy 1, policy_version 921057 (0.0010) [2023-12-26 06:59:49,578][123090] Updated weights for policy 1, policy_version 921067 (0.0011) [2023-12-26 06:59:49,627][123090] Updated weights for policy 1, policy_version 921077 (0.0010) [2023-12-26 06:59:49,690][123090] Updated weights for policy 1, policy_version 921087 (0.0010) [2023-12-26 06:59:49,944][123091] Updated weights for policy 0, policy_version 927668 (0.0007) [2023-12-26 06:59:50,010][123091] Updated weights for policy 0, policy_version 927678 (0.0008) [2023-12-26 06:59:50,076][123091] Updated weights for policy 0, policy_version 927688 (0.0008) [2023-12-26 06:59:50,457][123090] Updated weights for policy 1, policy_version 921097 (0.0007) [2023-12-26 06:59:50,525][123090] Updated weights for policy 1, policy_version 921107 (0.0006) [2023-12-26 06:59:50,592][123090] Updated weights for policy 1, policy_version 921117 (0.0007) [2023-12-26 06:59:50,803][123091] Updated weights for policy 0, policy_version 927698 (0.0008) [2023-12-26 06:59:50,874][123091] Updated weights for policy 0, policy_version 927708 (0.0009) [2023-12-26 06:59:50,928][123091] Updated weights for policy 0, policy_version 927718 (0.0010) [2023-12-26 06:59:50,981][123091] Updated weights for policy 0, policy_version 927728 (0.0009) [2023-12-26 06:59:51,238][123090] Updated weights for policy 1, policy_version 921127 (0.0010) [2023-12-26 06:59:51,302][123090] Updated weights for policy 1, policy_version 921137 (0.0010) [2023-12-26 06:59:51,370][123090] Updated weights for policy 1, policy_version 921147 (0.0010) [2023-12-26 06:59:51,832][123091] Updated weights for policy 0, policy_version 927738 (0.0009) [2023-12-26 06:59:51,898][123091] Updated weights for policy 0, policy_version 927748 (0.0009) [2023-12-26 06:59:51,969][123091] Updated weights for policy 0, policy_version 927758 (0.0010) [2023-12-26 06:59:52,183][123090] Updated weights for policy 1, policy_version 921157 (0.0008) [2023-12-26 06:59:52,246][123090] Updated weights for policy 1, policy_version 921167 (0.0008) [2023-12-26 06:59:52,305][123090] Updated weights for policy 1, policy_version 921177 (0.0006) [2023-12-26 06:59:52,753][123091] Updated weights for policy 0, policy_version 927768 (0.0006) [2023-12-26 06:59:52,818][123091] Updated weights for policy 0, policy_version 927778 (0.0007) [2023-12-26 06:59:52,885][123091] Updated weights for policy 0, policy_version 927788 (0.0006) [2023-12-26 06:59:53,071][123090] Updated weights for policy 1, policy_version 921187 (0.0008) [2023-12-26 06:59:53,120][123090] Updated weights for policy 1, policy_version 921197 (0.0009) [2023-12-26 06:59:53,168][123090] Updated weights for policy 1, policy_version 921207 (0.0008) [2023-12-26 06:59:53,587][123091] Updated weights for policy 0, policy_version 927798 (0.0007) [2023-12-26 06:59:53,639][123091] Updated weights for policy 0, policy_version 927808 (0.0008) [2023-12-26 06:59:53,690][123091] Updated weights for policy 0, policy_version 927818 (0.0009) [2023-12-26 06:59:53,785][121949] Fps is (10 sec: 18021.3, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 473358336. Throughput: 0: 8919.7, 1: 8622.9. Samples: 473330952. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:53,786][121949] Avg episode reward: [(0, '6205.366'), (1, '5559.526')] [2023-12-26 06:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000927824_237527040.pth... [2023-12-26 06:59:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000921216_235831296.pth... [2023-12-26 06:59:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000926768_237256704.pth [2023-12-26 06:59:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000920192_235569152.pth [2023-12-26 06:59:54,058][123090] Updated weights for policy 1, policy_version 921217 (0.0010) [2023-12-26 06:59:54,115][123090] Updated weights for policy 1, policy_version 921227 (0.0009) [2023-12-26 06:59:54,173][123090] Updated weights for policy 1, policy_version 921237 (0.0009) [2023-12-26 06:59:54,228][123090] Updated weights for policy 1, policy_version 921247 (0.0008) [2023-12-26 06:59:54,499][123091] Updated weights for policy 0, policy_version 927828 (0.0009) [2023-12-26 06:59:54,546][123091] Updated weights for policy 0, policy_version 927838 (0.0009) [2023-12-26 06:59:54,605][123091] Updated weights for policy 0, policy_version 927848 (0.0009) [2023-12-26 06:59:55,069][123090] Updated weights for policy 1, policy_version 921257 (0.0010) [2023-12-26 06:59:55,134][123090] Updated weights for policy 1, policy_version 921267 (0.0008) [2023-12-26 06:59:55,196][123090] Updated weights for policy 1, policy_version 921277 (0.0009) [2023-12-26 06:59:55,428][123091] Updated weights for policy 0, policy_version 927858 (0.0010) [2023-12-26 06:59:55,474][123091] Updated weights for policy 0, policy_version 927868 (0.0005) [2023-12-26 06:59:55,530][123091] Updated weights for policy 0, policy_version 927878 (0.0005) [2023-12-26 06:59:55,590][123091] Updated weights for policy 0, policy_version 927888 (0.0005) [2023-12-26 06:59:56,089][123090] Updated weights for policy 1, policy_version 921287 (0.0009) [2023-12-26 06:59:56,148][123090] Updated weights for policy 1, policy_version 921297 (0.0010) [2023-12-26 06:59:56,207][123090] Updated weights for policy 1, policy_version 921307 (0.0010) [2023-12-26 06:59:56,276][123091] Updated weights for policy 0, policy_version 927898 (0.0006) [2023-12-26 06:59:56,349][123091] Updated weights for policy 0, policy_version 927908 (0.0005) [2023-12-26 06:59:56,417][123091] Updated weights for policy 0, policy_version 927918 (0.0005) [2023-12-26 06:59:57,083][123090] Updated weights for policy 1, policy_version 921317 (0.0009) [2023-12-26 06:59:57,139][123090] Updated weights for policy 1, policy_version 921327 (0.0007) [2023-12-26 06:59:57,144][123091] Updated weights for policy 0, policy_version 927928 (0.0009) [2023-12-26 06:59:57,201][123090] Updated weights for policy 1, policy_version 921337 (0.0008) [2023-12-26 06:59:57,207][123091] Updated weights for policy 0, policy_version 927938 (0.0010) [2023-12-26 06:59:57,268][123091] Updated weights for policy 0, policy_version 927948 (0.0010) [2023-12-26 06:59:57,971][123091] Updated weights for policy 0, policy_version 927958 (0.0007) [2023-12-26 06:59:58,036][123091] Updated weights for policy 0, policy_version 927968 (0.0007) [2023-12-26 06:59:58,101][123091] Updated weights for policy 0, policy_version 927978 (0.0010) [2023-12-26 06:59:58,103][123090] Updated weights for policy 1, policy_version 921347 (0.0006) [2023-12-26 06:59:58,170][123090] Updated weights for policy 1, policy_version 921357 (0.0009) [2023-12-26 06:59:58,239][123090] Updated weights for policy 1, policy_version 921367 (0.0009) [2023-12-26 06:59:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 473440256. Throughput: 0: 8957.9, 1: 8586.6. Samples: 473436780. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 06:59:58,785][121949] Avg episode reward: [(0, '6129.381'), (1, '5564.870')] [2023-12-26 06:59:58,953][123091] Updated weights for policy 0, policy_version 927988 (0.0006) [2023-12-26 06:59:59,017][123091] Updated weights for policy 0, policy_version 927998 (0.0006) [2023-12-26 06:59:59,076][123091] Updated weights for policy 0, policy_version 928008 (0.0010) [2023-12-26 06:59:59,121][123090] Updated weights for policy 1, policy_version 921377 (0.0009) [2023-12-26 06:59:59,187][123090] Updated weights for policy 1, policy_version 921387 (0.0008) [2023-12-26 06:59:59,255][123090] Updated weights for policy 1, policy_version 921397 (0.0009) [2023-12-26 06:59:59,320][123090] Updated weights for policy 1, policy_version 921407 (0.0009) [2023-12-26 06:59:59,908][123091] Updated weights for policy 0, policy_version 928018 (0.0010) [2023-12-26 06:59:59,974][123091] Updated weights for policy 0, policy_version 928028 (0.0009) [2023-12-26 07:00:00,038][123091] Updated weights for policy 0, policy_version 928038 (0.0009) [2023-12-26 07:00:00,096][123091] Updated weights for policy 0, policy_version 928048 (0.0008) [2023-12-26 07:00:00,149][123090] Updated weights for policy 1, policy_version 921417 (0.0009) [2023-12-26 07:00:00,210][123090] Updated weights for policy 1, policy_version 921427 (0.0009) [2023-12-26 07:00:00,274][123090] Updated weights for policy 1, policy_version 921437 (0.0009) [2023-12-26 07:00:00,817][123091] Updated weights for policy 0, policy_version 928058 (0.0009) [2023-12-26 07:00:00,874][123091] Updated weights for policy 0, policy_version 928068 (0.0010) [2023-12-26 07:00:00,932][123091] Updated weights for policy 0, policy_version 928078 (0.0010) [2023-12-26 07:00:01,083][123090] Updated weights for policy 1, policy_version 921447 (0.0010) [2023-12-26 07:00:01,147][123090] Updated weights for policy 1, policy_version 921457 (0.0010) [2023-12-26 07:00:01,213][123090] Updated weights for policy 1, policy_version 921467 (0.0011) [2023-12-26 07:00:01,679][123091] Updated weights for policy 0, policy_version 928088 (0.0011) [2023-12-26 07:00:01,748][123091] Updated weights for policy 0, policy_version 928098 (0.0011) [2023-12-26 07:00:01,810][123091] Updated weights for policy 0, policy_version 928108 (0.0010) [2023-12-26 07:00:02,047][123090] Updated weights for policy 1, policy_version 921477 (0.0010) [2023-12-26 07:00:02,113][123090] Updated weights for policy 1, policy_version 921487 (0.0009) [2023-12-26 07:00:02,175][123090] Updated weights for policy 1, policy_version 921497 (0.0009) [2023-12-26 07:00:02,637][123091] Updated weights for policy 0, policy_version 928118 (0.0008) [2023-12-26 07:00:02,698][123091] Updated weights for policy 0, policy_version 928128 (0.0006) [2023-12-26 07:00:02,759][123091] Updated weights for policy 0, policy_version 928138 (0.0010) [2023-12-26 07:00:02,987][123090] Updated weights for policy 1, policy_version 921507 (0.0008) [2023-12-26 07:00:03,060][123090] Updated weights for policy 1, policy_version 921517 (0.0005) [2023-12-26 07:00:03,135][123090] Updated weights for policy 1, policy_version 921527 (0.0005) [2023-12-26 07:00:03,379][123091] Updated weights for policy 0, policy_version 928148 (0.0009) [2023-12-26 07:00:03,441][123091] Updated weights for policy 0, policy_version 928158 (0.0008) [2023-12-26 07:00:03,504][123091] Updated weights for policy 0, policy_version 928168 (0.0008) [2023-12-26 07:00:03,740][123090] Updated weights for policy 1, policy_version 921537 (0.0006) [2023-12-26 07:00:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 473530368. Throughput: 0: 8925.2, 1: 8609.4. Samples: 473543108. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:03,785][121949] Avg episode reward: [(0, '6194.150'), (1, '5182.236')] [2023-12-26 07:00:03,801][123090] Updated weights for policy 1, policy_version 921547 (0.0009) [2023-12-26 07:00:03,869][123090] Updated weights for policy 1, policy_version 921557 (0.0010) [2023-12-26 07:00:03,926][123090] Updated weights for policy 1, policy_version 921567 (0.0006) [2023-12-26 07:00:04,269][123091] Updated weights for policy 0, policy_version 928178 (0.0008) [2023-12-26 07:00:04,335][123091] Updated weights for policy 0, policy_version 928188 (0.0010) [2023-12-26 07:00:04,387][123091] Updated weights for policy 0, policy_version 928198 (0.0009) [2023-12-26 07:00:04,437][123091] Updated weights for policy 0, policy_version 928208 (0.0009) [2023-12-26 07:00:04,687][123090] Updated weights for policy 1, policy_version 921577 (0.0009) [2023-12-26 07:00:04,745][123090] Updated weights for policy 1, policy_version 921587 (0.0005) [2023-12-26 07:00:04,804][123090] Updated weights for policy 1, policy_version 921597 (0.0008) [2023-12-26 07:00:05,331][123091] Updated weights for policy 0, policy_version 928218 (0.0009) [2023-12-26 07:00:05,390][123091] Updated weights for policy 0, policy_version 928228 (0.0010) [2023-12-26 07:00:05,452][123091] Updated weights for policy 0, policy_version 928238 (0.0011) [2023-12-26 07:00:05,595][123090] Updated weights for policy 1, policy_version 921607 (0.0010) [2023-12-26 07:00:05,650][123090] Updated weights for policy 1, policy_version 921617 (0.0009) [2023-12-26 07:00:05,706][123090] Updated weights for policy 1, policy_version 921627 (0.0010) [2023-12-26 07:00:06,132][123091] Updated weights for policy 0, policy_version 928248 (0.0008) [2023-12-26 07:00:06,189][123091] Updated weights for policy 0, policy_version 928258 (0.0009) [2023-12-26 07:00:06,261][123091] Updated weights for policy 0, policy_version 928268 (0.0009) [2023-12-26 07:00:06,477][123090] Updated weights for policy 1, policy_version 921637 (0.0010) [2023-12-26 07:00:06,541][123090] Updated weights for policy 1, policy_version 921647 (0.0009) [2023-12-26 07:00:06,607][123090] Updated weights for policy 1, policy_version 921657 (0.0009) [2023-12-26 07:00:07,020][123091] Updated weights for policy 0, policy_version 928278 (0.0009) [2023-12-26 07:00:07,073][123091] Updated weights for policy 0, policy_version 928288 (0.0011) [2023-12-26 07:00:07,129][123091] Updated weights for policy 0, policy_version 928298 (0.0011) [2023-12-26 07:00:07,454][123090] Updated weights for policy 1, policy_version 921667 (0.0009) [2023-12-26 07:00:07,513][123090] Updated weights for policy 1, policy_version 921677 (0.0009) [2023-12-26 07:00:07,570][123090] Updated weights for policy 1, policy_version 921687 (0.0008) [2023-12-26 07:00:07,935][123091] Updated weights for policy 0, policy_version 928308 (0.0009) [2023-12-26 07:00:07,983][123091] Updated weights for policy 0, policy_version 928318 (0.0005) [2023-12-26 07:00:08,039][123091] Updated weights for policy 0, policy_version 928328 (0.0005) [2023-12-26 07:00:08,410][123090] Updated weights for policy 1, policy_version 921697 (0.0009) [2023-12-26 07:00:08,478][123090] Updated weights for policy 1, policy_version 921707 (0.0010) [2023-12-26 07:00:08,546][123090] Updated weights for policy 1, policy_version 921717 (0.0010) [2023-12-26 07:00:08,608][123090] Updated weights for policy 1, policy_version 921727 (0.0009) [2023-12-26 07:00:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 473620480. Throughput: 0: 8973.0, 1: 8654.2. Samples: 473597084. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:08,785][121949] Avg episode reward: [(0, '6266.435'), (1, '5195.189')] [2023-12-26 07:00:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000928336_237658112.pth... [2023-12-26 07:00:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000921728_235962368.pth... [2023-12-26 07:00:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000927280_237387776.pth [2023-12-26 07:00:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000920704_235700224.pth [2023-12-26 07:00:08,824][123091] Updated weights for policy 0, policy_version 928338 (0.0006) [2023-12-26 07:00:08,879][123091] Updated weights for policy 0, policy_version 928348 (0.0010) [2023-12-26 07:00:08,934][123091] Updated weights for policy 0, policy_version 928358 (0.0009) [2023-12-26 07:00:08,988][123091] Updated weights for policy 0, policy_version 928368 (0.0009) [2023-12-26 07:00:09,466][123090] Updated weights for policy 1, policy_version 921737 (0.0010) [2023-12-26 07:00:09,538][123090] Updated weights for policy 1, policy_version 921747 (0.0007) [2023-12-26 07:00:09,603][123090] Updated weights for policy 1, policy_version 921757 (0.0008) [2023-12-26 07:00:09,829][123091] Updated weights for policy 0, policy_version 928378 (0.0010) [2023-12-26 07:00:09,901][123091] Updated weights for policy 0, policy_version 928388 (0.0007) [2023-12-26 07:00:09,975][123091] Updated weights for policy 0, policy_version 928398 (0.0009) [2023-12-26 07:00:10,426][123090] Updated weights for policy 1, policy_version 921767 (0.0008) [2023-12-26 07:00:10,494][123090] Updated weights for policy 1, policy_version 921777 (0.0010) [2023-12-26 07:00:10,557][123090] Updated weights for policy 1, policy_version 921787 (0.0010) [2023-12-26 07:00:10,761][123091] Updated weights for policy 0, policy_version 928408 (0.0010) [2023-12-26 07:00:10,814][123091] Updated weights for policy 0, policy_version 928418 (0.0007) [2023-12-26 07:00:10,873][123091] Updated weights for policy 0, policy_version 928428 (0.0006) [2023-12-26 07:00:11,462][123090] Updated weights for policy 1, policy_version 921797 (0.0010) [2023-12-26 07:00:11,524][123090] Updated weights for policy 1, policy_version 921807 (0.0010) [2023-12-26 07:00:11,582][123090] Updated weights for policy 1, policy_version 921817 (0.0009) [2023-12-26 07:00:11,631][123091] Updated weights for policy 0, policy_version 928438 (0.0006) [2023-12-26 07:00:11,690][123091] Updated weights for policy 0, policy_version 928448 (0.0007) [2023-12-26 07:00:11,767][123091] Updated weights for policy 0, policy_version 928458 (0.0008) [2023-12-26 07:00:12,408][123090] Updated weights for policy 1, policy_version 921827 (0.0008) [2023-12-26 07:00:12,473][123090] Updated weights for policy 1, policy_version 921837 (0.0005) [2023-12-26 07:00:12,541][123090] Updated weights for policy 1, policy_version 921847 (0.0009) [2023-12-26 07:00:12,569][123091] Updated weights for policy 0, policy_version 928468 (0.0007) [2023-12-26 07:00:12,633][123091] Updated weights for policy 0, policy_version 928478 (0.0008) [2023-12-26 07:00:12,705][123091] Updated weights for policy 0, policy_version 928488 (0.0009) [2023-12-26 07:00:13,331][123090] Updated weights for policy 1, policy_version 921857 (0.0010) [2023-12-26 07:00:13,408][123090] Updated weights for policy 1, policy_version 921867 (0.0009) [2023-12-26 07:00:13,414][123091] Updated weights for policy 0, policy_version 928498 (0.0009) [2023-12-26 07:00:13,478][123090] Updated weights for policy 1, policy_version 921877 (0.0009) [2023-12-26 07:00:13,488][123091] Updated weights for policy 0, policy_version 928508 (0.0006) [2023-12-26 07:00:13,538][123090] Updated weights for policy 1, policy_version 921887 (0.0007) [2023-12-26 07:00:13,545][123091] Updated weights for policy 0, policy_version 928518 (0.0009) [2023-12-26 07:00:13,614][123091] Updated weights for policy 0, policy_version 928528 (0.0010) [2023-12-26 07:00:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 473710592. Throughput: 0: 9011.3, 1: 8610.7. Samples: 473699828. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:13,785][121949] Avg episode reward: [(0, '6196.451'), (1, '5345.220')] [2023-12-26 07:00:14,352][123090] Updated weights for policy 1, policy_version 921897 (0.0010) [2023-12-26 07:00:14,411][123090] Updated weights for policy 1, policy_version 921907 (0.0010) [2023-12-26 07:00:14,433][123091] Updated weights for policy 0, policy_version 928538 (0.0007) [2023-12-26 07:00:14,475][123090] Updated weights for policy 1, policy_version 921917 (0.0010) [2023-12-26 07:00:14,491][123091] Updated weights for policy 0, policy_version 928548 (0.0009) [2023-12-26 07:00:14,559][123091] Updated weights for policy 0, policy_version 928558 (0.0006) [2023-12-26 07:00:15,302][123090] Updated weights for policy 1, policy_version 921927 (0.0008) [2023-12-26 07:00:15,369][123090] Updated weights for policy 1, policy_version 921937 (0.0007) [2023-12-26 07:00:15,386][123091] Updated weights for policy 0, policy_version 928568 (0.0006) [2023-12-26 07:00:15,437][123090] Updated weights for policy 1, policy_version 921947 (0.0010) [2023-12-26 07:00:15,449][123091] Updated weights for policy 0, policy_version 928578 (0.0008) [2023-12-26 07:00:15,507][123091] Updated weights for policy 0, policy_version 928588 (0.0009) [2023-12-26 07:00:16,194][123090] Updated weights for policy 1, policy_version 921957 (0.0008) [2023-12-26 07:00:16,247][123090] Updated weights for policy 1, policy_version 921967 (0.0006) [2023-12-26 07:00:16,308][123090] Updated weights for policy 1, policy_version 921977 (0.0006) [2023-12-26 07:00:16,308][123091] Updated weights for policy 0, policy_version 928598 (0.0007) [2023-12-26 07:00:16,381][123091] Updated weights for policy 0, policy_version 928608 (0.0007) [2023-12-26 07:00:16,455][123091] Updated weights for policy 0, policy_version 928618 (0.0006) [2023-12-26 07:00:17,028][123090] Updated weights for policy 1, policy_version 921987 (0.0007) [2023-12-26 07:00:17,099][123090] Updated weights for policy 1, policy_version 921997 (0.0008) [2023-12-26 07:00:17,127][123091] Updated weights for policy 0, policy_version 928628 (0.0006) [2023-12-26 07:00:17,163][123090] Updated weights for policy 1, policy_version 922007 (0.0010) [2023-12-26 07:00:17,194][123091] Updated weights for policy 0, policy_version 928638 (0.0006) [2023-12-26 07:00:17,254][123091] Updated weights for policy 0, policy_version 928648 (0.0008) [2023-12-26 07:00:17,977][123090] Updated weights for policy 1, policy_version 922017 (0.0010) [2023-12-26 07:00:18,000][123091] Updated weights for policy 0, policy_version 928658 (0.0009) [2023-12-26 07:00:18,041][123090] Updated weights for policy 1, policy_version 922027 (0.0005) [2023-12-26 07:00:18,061][123091] Updated weights for policy 0, policy_version 928668 (0.0011) [2023-12-26 07:00:18,105][123090] Updated weights for policy 1, policy_version 922037 (0.0006) [2023-12-26 07:00:18,131][123091] Updated weights for policy 0, policy_version 928678 (0.0011) [2023-12-26 07:00:18,164][123090] Updated weights for policy 1, policy_version 922047 (0.0009) [2023-12-26 07:00:18,183][123091] Updated weights for policy 0, policy_version 928688 (0.0011) [2023-12-26 07:00:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 473792512. Throughput: 0: 9013.2, 1: 8644.3. Samples: 473806416. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:18,785][121949] Avg episode reward: [(0, '6199.631'), (1, '5511.010')] [2023-12-26 07:00:18,972][123090] Updated weights for policy 1, policy_version 922057 (0.0010) [2023-12-26 07:00:18,972][123091] Updated weights for policy 0, policy_version 928698 (0.0011) [2023-12-26 07:00:19,024][123090] Updated weights for policy 1, policy_version 922067 (0.0010) [2023-12-26 07:00:19,041][123091] Updated weights for policy 0, policy_version 928708 (0.0005) [2023-12-26 07:00:19,089][123090] Updated weights for policy 1, policy_version 922077 (0.0011) [2023-12-26 07:00:19,108][123091] Updated weights for policy 0, policy_version 928718 (0.0010) [2023-12-26 07:00:19,957][123091] Updated weights for policy 0, policy_version 928728 (0.0008) [2023-12-26 07:00:20,004][123090] Updated weights for policy 1, policy_version 922087 (0.0011) [2023-12-26 07:00:20,026][123091] Updated weights for policy 0, policy_version 928738 (0.0008) [2023-12-26 07:00:20,075][123090] Updated weights for policy 1, policy_version 922097 (0.0011) [2023-12-26 07:00:20,101][123091] Updated weights for policy 0, policy_version 928748 (0.0008) [2023-12-26 07:00:20,142][123090] Updated weights for policy 1, policy_version 922107 (0.0010) [2023-12-26 07:00:20,878][123091] Updated weights for policy 0, policy_version 928758 (0.0010) [2023-12-26 07:00:20,944][123091] Updated weights for policy 0, policy_version 928768 (0.0010) [2023-12-26 07:00:20,985][123090] Updated weights for policy 1, policy_version 922117 (0.0009) [2023-12-26 07:00:21,011][123091] Updated weights for policy 0, policy_version 928778 (0.0008) [2023-12-26 07:00:21,053][123090] Updated weights for policy 1, policy_version 922127 (0.0008) [2023-12-26 07:00:21,125][123090] Updated weights for policy 1, policy_version 922137 (0.0009) [2023-12-26 07:00:21,934][123091] Updated weights for policy 0, policy_version 928788 (0.0009) [2023-12-26 07:00:21,994][123091] Updated weights for policy 0, policy_version 928798 (0.0011) [2023-12-26 07:00:22,058][123091] Updated weights for policy 0, policy_version 928808 (0.0011) [2023-12-26 07:00:22,088][123090] Updated weights for policy 1, policy_version 922147 (0.0010) [2023-12-26 07:00:22,150][123090] Updated weights for policy 1, policy_version 922157 (0.0008) [2023-12-26 07:00:22,204][123090] Updated weights for policy 1, policy_version 922167 (0.0009) [2023-12-26 07:00:22,900][123091] Updated weights for policy 0, policy_version 928818 (0.0011) [2023-12-26 07:00:22,960][123091] Updated weights for policy 0, policy_version 928828 (0.0011) [2023-12-26 07:00:23,019][123091] Updated weights for policy 0, policy_version 928838 (0.0011) [2023-12-26 07:00:23,075][123091] Updated weights for policy 0, policy_version 928848 (0.0011) [2023-12-26 07:00:23,120][123090] Updated weights for policy 1, policy_version 922177 (0.0009) [2023-12-26 07:00:23,182][123090] Updated weights for policy 1, policy_version 922187 (0.0009) [2023-12-26 07:00:23,245][123090] Updated weights for policy 1, policy_version 922197 (0.0009) [2023-12-26 07:00:23,311][123090] Updated weights for policy 1, policy_version 922207 (0.0009) [2023-12-26 07:00:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 473874432. Throughput: 0: 9002.4, 1: 8611.0. Samples: 473855340. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:23,785][121949] Avg episode reward: [(0, '6232.569'), (1, '5565.933')] [2023-12-26 07:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000928848_237789184.pth... [2023-12-26 07:00:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000922208_236085248.pth... [2023-12-26 07:00:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000921216_235831296.pth [2023-12-26 07:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000927824_237527040.pth [2023-12-26 07:00:23,896][123091] Updated weights for policy 0, policy_version 928858 (0.0009) [2023-12-26 07:00:23,949][123091] Updated weights for policy 0, policy_version 928868 (0.0010) [2023-12-26 07:00:24,000][123091] Updated weights for policy 0, policy_version 928878 (0.0010) [2023-12-26 07:00:24,167][123090] Updated weights for policy 1, policy_version 922217 (0.0010) [2023-12-26 07:00:24,230][123090] Updated weights for policy 1, policy_version 922227 (0.0008) [2023-12-26 07:00:24,296][123090] Updated weights for policy 1, policy_version 922237 (0.0009) [2023-12-26 07:00:24,752][123091] Updated weights for policy 0, policy_version 928888 (0.0011) [2023-12-26 07:00:24,825][123091] Updated weights for policy 0, policy_version 928898 (0.0011) [2023-12-26 07:00:24,890][123091] Updated weights for policy 0, policy_version 928908 (0.0011) [2023-12-26 07:00:25,066][123090] Updated weights for policy 1, policy_version 922247 (0.0010) [2023-12-26 07:00:25,110][123090] Updated weights for policy 1, policy_version 922257 (0.0010) [2023-12-26 07:00:25,166][123090] Updated weights for policy 1, policy_version 922267 (0.0010) [2023-12-26 07:00:25,661][123091] Updated weights for policy 0, policy_version 928918 (0.0010) [2023-12-26 07:00:25,725][123091] Updated weights for policy 0, policy_version 928928 (0.0009) [2023-12-26 07:00:25,789][123091] Updated weights for policy 0, policy_version 928938 (0.0009) [2023-12-26 07:00:26,011][123090] Updated weights for policy 1, policy_version 922277 (0.0010) [2023-12-26 07:00:26,068][123090] Updated weights for policy 1, policy_version 922287 (0.0007) [2023-12-26 07:00:26,118][123090] Updated weights for policy 1, policy_version 922297 (0.0005) [2023-12-26 07:00:26,672][123091] Updated weights for policy 0, policy_version 928948 (0.0010) [2023-12-26 07:00:26,731][123091] Updated weights for policy 0, policy_version 928958 (0.0009) [2023-12-26 07:00:26,790][123091] Updated weights for policy 0, policy_version 928968 (0.0009) [2023-12-26 07:00:26,797][123090] Updated weights for policy 1, policy_version 922307 (0.0006) [2023-12-26 07:00:26,852][123090] Updated weights for policy 1, policy_version 922317 (0.0006) [2023-12-26 07:00:26,922][123090] Updated weights for policy 1, policy_version 922327 (0.0005) [2023-12-26 07:00:27,581][123090] Updated weights for policy 1, policy_version 922337 (0.0005) [2023-12-26 07:00:27,641][123090] Updated weights for policy 1, policy_version 922347 (0.0005) [2023-12-26 07:00:27,694][123090] Updated weights for policy 1, policy_version 922357 (0.0009) [2023-12-26 07:00:27,704][123091] Updated weights for policy 0, policy_version 928978 (0.0009) [2023-12-26 07:00:27,741][123090] Updated weights for policy 1, policy_version 922367 (0.0009) [2023-12-26 07:00:27,760][123091] Updated weights for policy 0, policy_version 928988 (0.0009) [2023-12-26 07:00:27,822][123091] Updated weights for policy 0, policy_version 928998 (0.0009) [2023-12-26 07:00:27,876][123091] Updated weights for policy 0, policy_version 929008 (0.0009) [2023-12-26 07:00:28,548][123090] Updated weights for policy 1, policy_version 922377 (0.0009) [2023-12-26 07:00:28,606][123090] Updated weights for policy 1, policy_version 922387 (0.0008) [2023-12-26 07:00:28,666][123090] Updated weights for policy 1, policy_version 922397 (0.0009) [2023-12-26 07:00:28,710][123091] Updated weights for policy 0, policy_version 929018 (0.0008) [2023-12-26 07:00:28,766][123091] Updated weights for policy 0, policy_version 929028 (0.0009) [2023-12-26 07:00:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 473964544. Throughput: 0: 8915.6, 1: 8678.3. Samples: 473959988. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:28,785][121949] Avg episode reward: [(0, '6346.817'), (1, '5176.951')] [2023-12-26 07:00:28,815][123091] Updated weights for policy 0, policy_version 929038 (0.0009) [2023-12-26 07:00:29,548][123090] Updated weights for policy 1, policy_version 922407 (0.0009) [2023-12-26 07:00:29,562][123091] Updated weights for policy 0, policy_version 929048 (0.0007) [2023-12-26 07:00:29,600][123090] Updated weights for policy 1, policy_version 922417 (0.0009) [2023-12-26 07:00:29,615][123091] Updated weights for policy 0, policy_version 929058 (0.0008) [2023-12-26 07:00:29,648][123090] Updated weights for policy 1, policy_version 922427 (0.0007) [2023-12-26 07:00:29,659][123091] Updated weights for policy 0, policy_version 929068 (0.0009) [2023-12-26 07:00:30,444][123091] Updated weights for policy 0, policy_version 929078 (0.0009) [2023-12-26 07:00:30,493][123091] Updated weights for policy 0, policy_version 929088 (0.0009) [2023-12-26 07:00:30,534][123090] Updated weights for policy 1, policy_version 922437 (0.0008) [2023-12-26 07:00:30,549][123091] Updated weights for policy 0, policy_version 929098 (0.0008) [2023-12-26 07:00:30,593][123090] Updated weights for policy 1, policy_version 922447 (0.0008) [2023-12-26 07:00:30,651][123090] Updated weights for policy 1, policy_version 922457 (0.0008) [2023-12-26 07:00:31,235][123091] Updated weights for policy 0, policy_version 929108 (0.0008) [2023-12-26 07:00:31,307][123091] Updated weights for policy 0, policy_version 929118 (0.0008) [2023-12-26 07:00:31,382][123091] Updated weights for policy 0, policy_version 929128 (0.0009) [2023-12-26 07:00:31,526][123090] Updated weights for policy 1, policy_version 922467 (0.0009) [2023-12-26 07:00:31,582][123090] Updated weights for policy 1, policy_version 922477 (0.0009) [2023-12-26 07:00:31,641][123090] Updated weights for policy 1, policy_version 922487 (0.0009) [2023-12-26 07:00:32,171][123091] Updated weights for policy 0, policy_version 929138 (0.0011) [2023-12-26 07:00:32,222][123091] Updated weights for policy 0, policy_version 929148 (0.0010) [2023-12-26 07:00:32,278][123091] Updated weights for policy 0, policy_version 929158 (0.0010) [2023-12-26 07:00:32,338][123091] Updated weights for policy 0, policy_version 929168 (0.0010) [2023-12-26 07:00:32,457][123090] Updated weights for policy 1, policy_version 922497 (0.0009) [2023-12-26 07:00:32,518][123090] Updated weights for policy 1, policy_version 922507 (0.0009) [2023-12-26 07:00:32,579][123090] Updated weights for policy 1, policy_version 922517 (0.0010) [2023-12-26 07:00:32,632][123090] Updated weights for policy 1, policy_version 922527 (0.0009) [2023-12-26 07:00:33,189][123091] Updated weights for policy 0, policy_version 929178 (0.0010) [2023-12-26 07:00:33,243][123091] Updated weights for policy 0, policy_version 929188 (0.0010) [2023-12-26 07:00:33,319][123091] Updated weights for policy 0, policy_version 929198 (0.0010) [2023-12-26 07:00:33,382][123090] Updated weights for policy 1, policy_version 922537 (0.0009) [2023-12-26 07:00:33,434][123090] Updated weights for policy 1, policy_version 922547 (0.0009) [2023-12-26 07:00:33,489][123090] Updated weights for policy 1, policy_version 922557 (0.0009) [2023-12-26 07:00:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 474054656. Throughput: 0: 8905.4, 1: 8574.3. Samples: 474064360. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:33,785][121949] Avg episode reward: [(0, '6363.049'), (1, '5072.598')] [2023-12-26 07:00:34,115][123091] Updated weights for policy 0, policy_version 929208 (0.0009) [2023-12-26 07:00:34,171][123091] Updated weights for policy 0, policy_version 929218 (0.0009) [2023-12-26 07:00:34,231][123091] Updated weights for policy 0, policy_version 929228 (0.0009) [2023-12-26 07:00:34,310][123090] Updated weights for policy 1, policy_version 922567 (0.0009) [2023-12-26 07:00:34,361][123090] Updated weights for policy 1, policy_version 922577 (0.0009) [2023-12-26 07:00:34,425][123090] Updated weights for policy 1, policy_version 922587 (0.0010) [2023-12-26 07:00:35,026][123091] Updated weights for policy 0, policy_version 929238 (0.0007) [2023-12-26 07:00:35,090][123091] Updated weights for policy 0, policy_version 929248 (0.0006) [2023-12-26 07:00:35,166][123091] Updated weights for policy 0, policy_version 929258 (0.0005) [2023-12-26 07:00:35,301][123090] Updated weights for policy 1, policy_version 922597 (0.0009) [2023-12-26 07:00:35,363][123090] Updated weights for policy 1, policy_version 922607 (0.0010) [2023-12-26 07:00:35,426][123090] Updated weights for policy 1, policy_version 922617 (0.0010) [2023-12-26 07:00:35,764][123091] Updated weights for policy 0, policy_version 929268 (0.0006) [2023-12-26 07:00:35,828][123091] Updated weights for policy 0, policy_version 929278 (0.0006) [2023-12-26 07:00:35,896][123091] Updated weights for policy 0, policy_version 929288 (0.0007) [2023-12-26 07:00:36,287][123090] Updated weights for policy 1, policy_version 922627 (0.0009) [2023-12-26 07:00:36,344][123090] Updated weights for policy 1, policy_version 922637 (0.0009) [2023-12-26 07:00:36,398][123090] Updated weights for policy 1, policy_version 922647 (0.0009) [2023-12-26 07:00:36,663][123091] Updated weights for policy 0, policy_version 929298 (0.0006) [2023-12-26 07:00:36,716][123091] Updated weights for policy 0, policy_version 929308 (0.0008) [2023-12-26 07:00:36,779][123091] Updated weights for policy 0, policy_version 929318 (0.0005) [2023-12-26 07:00:36,841][123091] Updated weights for policy 0, policy_version 929328 (0.0006) [2023-12-26 07:00:37,287][123090] Updated weights for policy 1, policy_version 922657 (0.0009) [2023-12-26 07:00:37,344][123090] Updated weights for policy 1, policy_version 922667 (0.0008) [2023-12-26 07:00:37,392][123090] Updated weights for policy 1, policy_version 922677 (0.0009) [2023-12-26 07:00:37,445][123090] Updated weights for policy 1, policy_version 922687 (0.0007) [2023-12-26 07:00:37,608][123091] Updated weights for policy 0, policy_version 929338 (0.0011) [2023-12-26 07:00:37,656][123091] Updated weights for policy 0, policy_version 929348 (0.0010) [2023-12-26 07:00:37,714][123091] Updated weights for policy 0, policy_version 929358 (0.0010) [2023-12-26 07:00:38,264][123090] Updated weights for policy 1, policy_version 922697 (0.0009) [2023-12-26 07:00:38,325][123090] Updated weights for policy 1, policy_version 922707 (0.0009) [2023-12-26 07:00:38,398][123090] Updated weights for policy 1, policy_version 922717 (0.0009) [2023-12-26 07:00:38,550][123091] Updated weights for policy 0, policy_version 929368 (0.0011) [2023-12-26 07:00:38,615][123091] Updated weights for policy 0, policy_version 929378 (0.0006) [2023-12-26 07:00:38,687][123091] Updated weights for policy 0, policy_version 929388 (0.0005) [2023-12-26 07:00:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 474144768. Throughput: 0: 8941.2, 1: 8529.9. Samples: 474117144. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:38,785][121949] Avg episode reward: [(0, '6289.866'), (1, '5410.408')] [2023-12-26 07:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000929392_237928448.pth... [2023-12-26 07:00:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000922720_236216320.pth... [2023-12-26 07:00:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000921728_235962368.pth [2023-12-26 07:00:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000928336_237658112.pth [2023-12-26 07:00:39,306][123090] Updated weights for policy 1, policy_version 922727 (0.0009) [2023-12-26 07:00:39,368][123091] Updated weights for policy 0, policy_version 929398 (0.0008) [2023-12-26 07:00:39,375][123090] Updated weights for policy 1, policy_version 922737 (0.0009) [2023-12-26 07:00:39,435][123090] Updated weights for policy 1, policy_version 922747 (0.0008) [2023-12-26 07:00:39,436][123091] Updated weights for policy 0, policy_version 929408 (0.0011) [2023-12-26 07:00:39,496][123091] Updated weights for policy 0, policy_version 929418 (0.0011) [2023-12-26 07:00:40,299][123090] Updated weights for policy 1, policy_version 922757 (0.0005) [2023-12-26 07:00:40,346][123091] Updated weights for policy 0, policy_version 929428 (0.0010) [2023-12-26 07:00:40,374][123090] Updated weights for policy 1, policy_version 922767 (0.0006) [2023-12-26 07:00:40,405][123091] Updated weights for policy 0, policy_version 929438 (0.0008) [2023-12-26 07:00:40,438][123090] Updated weights for policy 1, policy_version 922777 (0.0008) [2023-12-26 07:00:40,469][123091] Updated weights for policy 0, policy_version 929448 (0.0008) [2023-12-26 07:00:41,237][123090] Updated weights for policy 1, policy_version 922787 (0.0010) [2023-12-26 07:00:41,300][123090] Updated weights for policy 1, policy_version 922797 (0.0009) [2023-12-26 07:00:41,306][123091] Updated weights for policy 0, policy_version 929458 (0.0010) [2023-12-26 07:00:41,369][123091] Updated weights for policy 0, policy_version 929468 (0.0009) [2023-12-26 07:00:41,373][123090] Updated weights for policy 1, policy_version 922807 (0.0009) [2023-12-26 07:00:41,434][123091] Updated weights for policy 0, policy_version 929478 (0.0008) [2023-12-26 07:00:41,485][123091] Updated weights for policy 0, policy_version 929488 (0.0010) [2023-12-26 07:00:42,110][123090] Updated weights for policy 1, policy_version 922817 (0.0010) [2023-12-26 07:00:42,165][123090] Updated weights for policy 1, policy_version 922827 (0.0007) [2023-12-26 07:00:42,229][123090] Updated weights for policy 1, policy_version 922837 (0.0005) [2023-12-26 07:00:42,299][123090] Updated weights for policy 1, policy_version 922847 (0.0011) [2023-12-26 07:00:42,416][123091] Updated weights for policy 0, policy_version 929498 (0.0007) [2023-12-26 07:00:42,487][123091] Updated weights for policy 0, policy_version 929508 (0.0006) [2023-12-26 07:00:42,551][123091] Updated weights for policy 0, policy_version 929518 (0.0009) [2023-12-26 07:00:43,135][123090] Updated weights for policy 1, policy_version 922857 (0.0006) [2023-12-26 07:00:43,191][123090] Updated weights for policy 1, policy_version 922867 (0.0005) [2023-12-26 07:00:43,257][123091] Updated weights for policy 0, policy_version 929528 (0.0008) [2023-12-26 07:00:43,262][123090] Updated weights for policy 1, policy_version 922877 (0.0006) [2023-12-26 07:00:43,315][123091] Updated weights for policy 0, policy_version 929538 (0.0010) [2023-12-26 07:00:43,380][123091] Updated weights for policy 0, policy_version 929548 (0.0010) [2023-12-26 07:00:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 474226688. Throughput: 0: 8860.1, 1: 8540.0. Samples: 474219784. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:43,784][121949] Avg episode reward: [(0, '6310.927'), (1, '5634.600')] [2023-12-26 07:00:43,873][123090] Updated weights for policy 1, policy_version 922887 (0.0005) [2023-12-26 07:00:43,929][123090] Updated weights for policy 1, policy_version 922897 (0.0005) [2023-12-26 07:00:43,999][123090] Updated weights for policy 1, policy_version 922907 (0.0005) [2023-12-26 07:00:44,198][123091] Updated weights for policy 0, policy_version 929558 (0.0011) [2023-12-26 07:00:44,253][123091] Updated weights for policy 0, policy_version 929568 (0.0009) [2023-12-26 07:00:44,301][123091] Updated weights for policy 0, policy_version 929578 (0.0009) [2023-12-26 07:00:44,789][123090] Updated weights for policy 1, policy_version 922917 (0.0009) [2023-12-26 07:00:44,854][123090] Updated weights for policy 1, policy_version 922927 (0.0008) [2023-12-26 07:00:44,908][123090] Updated weights for policy 1, policy_version 922937 (0.0010) [2023-12-26 07:00:45,082][123091] Updated weights for policy 0, policy_version 929588 (0.0007) [2023-12-26 07:00:45,154][123091] Updated weights for policy 0, policy_version 929598 (0.0008) [2023-12-26 07:00:45,225][123091] Updated weights for policy 0, policy_version 929608 (0.0011) [2023-12-26 07:00:45,622][123090] Updated weights for policy 1, policy_version 922947 (0.0006) [2023-12-26 07:00:45,683][123090] Updated weights for policy 1, policy_version 922957 (0.0005) [2023-12-26 07:00:45,732][123090] Updated weights for policy 1, policy_version 922967 (0.0005) [2023-12-26 07:00:46,043][123091] Updated weights for policy 0, policy_version 929618 (0.0010) [2023-12-26 07:00:46,100][123091] Updated weights for policy 0, policy_version 929628 (0.0009) [2023-12-26 07:00:46,158][123091] Updated weights for policy 0, policy_version 929638 (0.0009) [2023-12-26 07:00:46,215][123091] Updated weights for policy 0, policy_version 929648 (0.0006) [2023-12-26 07:00:46,441][123090] Updated weights for policy 1, policy_version 922977 (0.0005) [2023-12-26 07:00:46,505][123090] Updated weights for policy 1, policy_version 922987 (0.0005) [2023-12-26 07:00:46,568][123090] Updated weights for policy 1, policy_version 922997 (0.0005) [2023-12-26 07:00:46,637][123090] Updated weights for policy 1, policy_version 923007 (0.0005) [2023-12-26 07:00:46,894][123091] Updated weights for policy 0, policy_version 929658 (0.0005) [2023-12-26 07:00:46,948][123091] Updated weights for policy 0, policy_version 929668 (0.0005) [2023-12-26 07:00:47,006][123091] Updated weights for policy 0, policy_version 929678 (0.0005) [2023-12-26 07:00:47,394][123090] Updated weights for policy 1, policy_version 923017 (0.0009) [2023-12-26 07:00:47,451][123090] Updated weights for policy 1, policy_version 923027 (0.0009) [2023-12-26 07:00:47,505][123090] Updated weights for policy 1, policy_version 923038 (0.0010) [2023-12-26 07:00:47,623][123091] Updated weights for policy 0, policy_version 929688 (0.0005) [2023-12-26 07:00:47,692][123091] Updated weights for policy 0, policy_version 929698 (0.0006) [2023-12-26 07:00:47,760][123091] Updated weights for policy 0, policy_version 929708 (0.0010) [2023-12-26 07:00:48,346][123090] Updated weights for policy 1, policy_version 923048 (0.0008) [2023-12-26 07:00:48,416][123090] Updated weights for policy 1, policy_version 923058 (0.0010) [2023-12-26 07:00:48,476][123091] Updated weights for policy 0, policy_version 929718 (0.0009) [2023-12-26 07:00:48,483][123090] Updated weights for policy 1, policy_version 923068 (0.0007) [2023-12-26 07:00:48,543][123091] Updated weights for policy 0, policy_version 929728 (0.0009) [2023-12-26 07:00:48,612][123091] Updated weights for policy 0, policy_version 929738 (0.0007) [2023-12-26 07:00:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 474324992. Throughput: 0: 8894.6, 1: 8642.5. Samples: 474332276. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:48,785][121949] Avg episode reward: [(0, '6398.817'), (1, '5368.087')] [2023-12-26 07:00:49,328][123090] Updated weights for policy 1, policy_version 923078 (0.0007) [2023-12-26 07:00:49,380][123091] Updated weights for policy 0, policy_version 929748 (0.0007) [2023-12-26 07:00:49,399][123090] Updated weights for policy 1, policy_version 923088 (0.0009) [2023-12-26 07:00:49,436][123091] Updated weights for policy 0, policy_version 929758 (0.0010) [2023-12-26 07:00:49,462][123090] Updated weights for policy 1, policy_version 923098 (0.0010) [2023-12-26 07:00:49,500][123091] Updated weights for policy 0, policy_version 929768 (0.0011) [2023-12-26 07:00:50,281][123091] Updated weights for policy 0, policy_version 929778 (0.0011) [2023-12-26 07:00:50,322][123090] Updated weights for policy 1, policy_version 923108 (0.0009) [2023-12-26 07:00:50,333][123091] Updated weights for policy 0, policy_version 929788 (0.0010) [2023-12-26 07:00:50,375][123090] Updated weights for policy 1, policy_version 923118 (0.0005) [2023-12-26 07:00:50,390][123091] Updated weights for policy 0, policy_version 929798 (0.0011) [2023-12-26 07:00:50,435][123090] Updated weights for policy 1, policy_version 923128 (0.0006) [2023-12-26 07:00:50,445][123091] Updated weights for policy 0, policy_version 929808 (0.0010) [2023-12-26 07:00:51,305][123090] Updated weights for policy 1, policy_version 923138 (0.0007) [2023-12-26 07:00:51,319][123091] Updated weights for policy 0, policy_version 929818 (0.0011) [2023-12-26 07:00:51,379][123090] Updated weights for policy 1, policy_version 923148 (0.0007) [2023-12-26 07:00:51,400][123091] Updated weights for policy 0, policy_version 929828 (0.0010) [2023-12-26 07:00:51,444][123090] Updated weights for policy 1, policy_version 923158 (0.0007) [2023-12-26 07:00:51,465][123091] Updated weights for policy 0, policy_version 929838 (0.0011) [2023-12-26 07:00:51,505][123090] Updated weights for policy 1, policy_version 923168 (0.0005) [2023-12-26 07:00:52,307][123091] Updated weights for policy 0, policy_version 929848 (0.0010) [2023-12-26 07:00:52,319][123090] Updated weights for policy 1, policy_version 923178 (0.0007) [2023-12-26 07:00:52,371][123091] Updated weights for policy 0, policy_version 929858 (0.0010) [2023-12-26 07:00:52,379][123090] Updated weights for policy 1, policy_version 923188 (0.0007) [2023-12-26 07:00:52,427][123091] Updated weights for policy 0, policy_version 929868 (0.0011) [2023-12-26 07:00:52,435][123090] Updated weights for policy 1, policy_version 923198 (0.0007) [2023-12-26 07:00:53,215][123091] Updated weights for policy 0, policy_version 929878 (0.0007) [2023-12-26 07:00:53,296][123091] Updated weights for policy 0, policy_version 929888 (0.0005) [2023-12-26 07:00:53,301][123090] Updated weights for policy 1, policy_version 923208 (0.0008) [2023-12-26 07:00:53,351][123090] Updated weights for policy 1, policy_version 923218 (0.0007) [2023-12-26 07:00:53,361][123091] Updated weights for policy 0, policy_version 929898 (0.0008) [2023-12-26 07:00:53,396][123090] Updated weights for policy 1, policy_version 923228 (0.0006) [2023-12-26 07:00:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 474406912. Throughput: 0: 8857.1, 1: 8598.9. Samples: 474382604. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:53,785][121949] Avg episode reward: [(0, '6421.875'), (1, '5326.020')] [2023-12-26 07:00:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000923232_236347392.pth... [2023-12-26 07:00:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000929904_238059520.pth... [2023-12-26 07:00:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000922208_236085248.pth [2023-12-26 07:00:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000928848_237789184.pth [2023-12-26 07:00:54,115][123091] Updated weights for policy 0, policy_version 929908 (0.0010) [2023-12-26 07:00:54,173][123090] Updated weights for policy 1, policy_version 923238 (0.0006) [2023-12-26 07:00:54,180][123091] Updated weights for policy 0, policy_version 929918 (0.0009) [2023-12-26 07:00:54,236][123090] Updated weights for policy 1, policy_version 923248 (0.0005) [2023-12-26 07:00:54,251][123091] Updated weights for policy 0, policy_version 929928 (0.0007) [2023-12-26 07:00:54,294][123090] Updated weights for policy 1, policy_version 923258 (0.0005) [2023-12-26 07:00:54,913][123090] Updated weights for policy 1, policy_version 923268 (0.0005) [2023-12-26 07:00:54,970][123090] Updated weights for policy 1, policy_version 923278 (0.0010) [2023-12-26 07:00:54,986][123091] Updated weights for policy 0, policy_version 929938 (0.0008) [2023-12-26 07:00:55,015][123090] Updated weights for policy 1, policy_version 923288 (0.0009) [2023-12-26 07:00:55,050][123091] Updated weights for policy 0, policy_version 929948 (0.0006) [2023-12-26 07:00:55,116][123091] Updated weights for policy 0, policy_version 929958 (0.0006) [2023-12-26 07:00:55,176][123091] Updated weights for policy 0, policy_version 929968 (0.0006) [2023-12-26 07:00:55,672][123090] Updated weights for policy 1, policy_version 923298 (0.0006) [2023-12-26 07:00:55,719][123090] Updated weights for policy 1, policy_version 923308 (0.0005) [2023-12-26 07:00:55,768][123090] Updated weights for policy 1, policy_version 923318 (0.0005) [2023-12-26 07:00:55,826][123090] Updated weights for policy 1, policy_version 923328 (0.0005) [2023-12-26 07:00:55,851][123091] Updated weights for policy 0, policy_version 929978 (0.0006) [2023-12-26 07:00:55,921][123091] Updated weights for policy 0, policy_version 929988 (0.0005) [2023-12-26 07:00:55,993][123091] Updated weights for policy 0, policy_version 929998 (0.0005) [2023-12-26 07:00:56,415][123090] Updated weights for policy 1, policy_version 923338 (0.0005) [2023-12-26 07:00:56,473][123090] Updated weights for policy 1, policy_version 923348 (0.0008) [2023-12-26 07:00:56,531][123090] Updated weights for policy 1, policy_version 923358 (0.0010) [2023-12-26 07:00:56,606][123091] Updated weights for policy 0, policy_version 930008 (0.0005) [2023-12-26 07:00:56,681][123091] Updated weights for policy 0, policy_version 930018 (0.0005) [2023-12-26 07:00:56,753][123091] Updated weights for policy 0, policy_version 930028 (0.0005) [2023-12-26 07:00:57,276][123090] Updated weights for policy 1, policy_version 923368 (0.0008) [2023-12-26 07:00:57,333][123090] Updated weights for policy 1, policy_version 923378 (0.0009) [2023-12-26 07:00:57,380][123090] Updated weights for policy 1, policy_version 923388 (0.0009) [2023-12-26 07:00:57,468][123091] Updated weights for policy 0, policy_version 930038 (0.0008) [2023-12-26 07:00:57,522][123091] Updated weights for policy 0, policy_version 930048 (0.0010) [2023-12-26 07:00:57,577][123091] Updated weights for policy 0, policy_version 930058 (0.0010) [2023-12-26 07:00:58,126][123090] Updated weights for policy 1, policy_version 923398 (0.0008) [2023-12-26 07:00:58,191][123090] Updated weights for policy 1, policy_version 923408 (0.0007) [2023-12-26 07:00:58,255][123090] Updated weights for policy 1, policy_version 923418 (0.0006) [2023-12-26 07:00:58,355][123091] Updated weights for policy 0, policy_version 930068 (0.0010) [2023-12-26 07:00:58,422][123091] Updated weights for policy 0, policy_version 930078 (0.0009) [2023-12-26 07:00:58,500][123091] Updated weights for policy 0, policy_version 930088 (0.0007) [2023-12-26 07:00:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 474505216. Throughput: 0: 8940.8, 1: 8777.5. Samples: 474497152. Policy #0 lag: (min: 31.0, avg: 33.4, max: 63.0) [2023-12-26 07:00:58,784][121949] Avg episode reward: [(0, '6237.600'), (1, '5663.066')] [2023-12-26 07:00:59,134][123090] Updated weights for policy 1, policy_version 923428 (0.0009) [2023-12-26 07:00:59,201][123090] Updated weights for policy 1, policy_version 923438 (0.0010) [2023-12-26 07:00:59,270][123090] Updated weights for policy 1, policy_version 923448 (0.0010) [2023-12-26 07:00:59,337][123091] Updated weights for policy 0, policy_version 930098 (0.0010) [2023-12-26 07:00:59,402][123091] Updated weights for policy 0, policy_version 930108 (0.0011) [2023-12-26 07:00:59,458][123091] Updated weights for policy 0, policy_version 930118 (0.0008) [2023-12-26 07:00:59,516][123091] Updated weights for policy 0, policy_version 930128 (0.0005) [2023-12-26 07:01:00,048][123090] Updated weights for policy 1, policy_version 923458 (0.0010) [2023-12-26 07:01:00,100][123090] Updated weights for policy 1, policy_version 923468 (0.0008) [2023-12-26 07:01:00,155][123090] Updated weights for policy 1, policy_version 923478 (0.0009) [2023-12-26 07:01:00,212][123090] Updated weights for policy 1, policy_version 923488 (0.0009) [2023-12-26 07:01:00,312][123091] Updated weights for policy 0, policy_version 930138 (0.0005) [2023-12-26 07:01:00,376][123091] Updated weights for policy 0, policy_version 930148 (0.0005) [2023-12-26 07:01:00,449][123091] Updated weights for policy 0, policy_version 930158 (0.0005) [2023-12-26 07:01:01,002][123090] Updated weights for policy 1, policy_version 923498 (0.0005) [2023-12-26 07:01:01,067][123090] Updated weights for policy 1, policy_version 923508 (0.0009) [2023-12-26 07:01:01,133][123090] Updated weights for policy 1, policy_version 923518 (0.0008) [2023-12-26 07:01:01,136][123091] Updated weights for policy 0, policy_version 930168 (0.0007) [2023-12-26 07:01:01,203][123091] Updated weights for policy 0, policy_version 930178 (0.0009) [2023-12-26 07:01:01,266][123091] Updated weights for policy 0, policy_version 930188 (0.0006) [2023-12-26 07:01:01,908][123090] Updated weights for policy 1, policy_version 923528 (0.0009) [2023-12-26 07:01:01,961][123090] Updated weights for policy 1, policy_version 923538 (0.0010) [2023-12-26 07:01:02,017][123090] Updated weights for policy 1, policy_version 923548 (0.0009) [2023-12-26 07:01:02,039][123091] Updated weights for policy 0, policy_version 930198 (0.0008) [2023-12-26 07:01:02,099][123091] Updated weights for policy 0, policy_version 930208 (0.0010) [2023-12-26 07:01:02,159][123091] Updated weights for policy 0, policy_version 930218 (0.0010) [2023-12-26 07:01:02,700][123090] Updated weights for policy 1, policy_version 923558 (0.0006) [2023-12-26 07:01:02,752][123090] Updated weights for policy 1, policy_version 923568 (0.0006) [2023-12-26 07:01:02,820][123090] Updated weights for policy 1, policy_version 923578 (0.0006) [2023-12-26 07:01:03,026][123091] Updated weights for policy 0, policy_version 930228 (0.0009) [2023-12-26 07:01:03,087][123091] Updated weights for policy 0, policy_version 930238 (0.0006) [2023-12-26 07:01:03,147][123091] Updated weights for policy 0, policy_version 930248 (0.0006) [2023-12-26 07:01:03,590][123090] Updated weights for policy 1, policy_version 923588 (0.0007) [2023-12-26 07:01:03,648][123090] Updated weights for policy 1, policy_version 923598 (0.0010) [2023-12-26 07:01:03,697][123090] Updated weights for policy 1, policy_version 923609 (0.0010) [2023-12-26 07:01:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 474595328. Throughput: 0: 8941.9, 1: 8795.5. Samples: 474604596. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:03,784][121949] Avg episode reward: [(0, '6039.842'), (1, '5602.377')] [2023-12-26 07:01:03,842][123091] Updated weights for policy 0, policy_version 930258 (0.0008) [2023-12-26 07:01:03,904][123091] Updated weights for policy 0, policy_version 930268 (0.0008) [2023-12-26 07:01:03,966][123091] Updated weights for policy 0, policy_version 930278 (0.0008) [2023-12-26 07:01:04,018][123091] Updated weights for policy 0, policy_version 930288 (0.0008) [2023-12-26 07:01:04,500][123090] Updated weights for policy 1, policy_version 923619 (0.0009) [2023-12-26 07:01:04,565][123090] Updated weights for policy 1, policy_version 923629 (0.0006) [2023-12-26 07:01:04,625][123090] Updated weights for policy 1, policy_version 923639 (0.0006) [2023-12-26 07:01:04,839][123091] Updated weights for policy 0, policy_version 930298 (0.0006) [2023-12-26 07:01:04,895][123091] Updated weights for policy 0, policy_version 930308 (0.0005) [2023-12-26 07:01:04,948][123091] Updated weights for policy 0, policy_version 930318 (0.0007) [2023-12-26 07:01:05,350][123090] Updated weights for policy 1, policy_version 923649 (0.0007) [2023-12-26 07:01:05,398][123090] Updated weights for policy 1, policy_version 923659 (0.0005) [2023-12-26 07:01:05,458][123090] Updated weights for policy 1, policy_version 923669 (0.0005) [2023-12-26 07:01:05,515][123090] Updated weights for policy 1, policy_version 923679 (0.0005) [2023-12-26 07:01:05,777][123091] Updated weights for policy 0, policy_version 930328 (0.0010) [2023-12-26 07:01:05,830][123091] Updated weights for policy 0, policy_version 930338 (0.0010) [2023-12-26 07:01:05,886][123091] Updated weights for policy 0, policy_version 930349 (0.0010) [2023-12-26 07:01:06,203][123090] Updated weights for policy 1, policy_version 923689 (0.0010) [2023-12-26 07:01:06,268][123090] Updated weights for policy 1, policy_version 923699 (0.0011) [2023-12-26 07:01:06,339][123090] Updated weights for policy 1, policy_version 923709 (0.0011) [2023-12-26 07:01:06,777][123091] Updated weights for policy 0, policy_version 930359 (0.0009) [2023-12-26 07:01:06,834][123091] Updated weights for policy 0, policy_version 930369 (0.0009) [2023-12-26 07:01:06,888][123091] Updated weights for policy 0, policy_version 930379 (0.0009) [2023-12-26 07:01:07,177][123090] Updated weights for policy 1, policy_version 923719 (0.0010) [2023-12-26 07:01:07,237][123090] Updated weights for policy 1, policy_version 923729 (0.0011) [2023-12-26 07:01:07,308][123090] Updated weights for policy 1, policy_version 923739 (0.0011) [2023-12-26 07:01:07,632][123091] Updated weights for policy 0, policy_version 930389 (0.0007) [2023-12-26 07:01:07,694][123091] Updated weights for policy 0, policy_version 930399 (0.0005) [2023-12-26 07:01:07,757][123091] Updated weights for policy 0, policy_version 930409 (0.0005) [2023-12-26 07:01:07,995][123090] Updated weights for policy 1, policy_version 923749 (0.0010) [2023-12-26 07:01:08,047][123090] Updated weights for policy 1, policy_version 923759 (0.0009) [2023-12-26 07:01:08,112][123090] Updated weights for policy 1, policy_version 923769 (0.0009) [2023-12-26 07:01:08,480][123091] Updated weights for policy 0, policy_version 930419 (0.0005) [2023-12-26 07:01:08,536][123091] Updated weights for policy 0, policy_version 930429 (0.0005) [2023-12-26 07:01:08,587][123091] Updated weights for policy 0, policy_version 930439 (0.0005) [2023-12-26 07:01:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 474685440. Throughput: 0: 8960.0, 1: 8905.3. Samples: 474659284. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:08,785][121949] Avg episode reward: [(0, '6130.320'), (1, '5511.693')] [2023-12-26 07:01:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000930448_238198784.pth... [2023-12-26 07:01:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000923776_236486656.pth... [2023-12-26 07:01:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000929392_237928448.pth [2023-12-26 07:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000922720_236216320.pth [2023-12-26 07:01:08,953][123090] Updated weights for policy 1, policy_version 923779 (0.0010) [2023-12-26 07:01:09,002][123090] Updated weights for policy 1, policy_version 923789 (0.0008) [2023-12-26 07:01:09,070][123090] Updated weights for policy 1, policy_version 923799 (0.0005) [2023-12-26 07:01:09,438][123091] Updated weights for policy 0, policy_version 930449 (0.0009) [2023-12-26 07:01:09,506][123091] Updated weights for policy 0, policy_version 930459 (0.0010) [2023-12-26 07:01:09,569][123091] Updated weights for policy 0, policy_version 930469 (0.0010) [2023-12-26 07:01:09,628][123091] Updated weights for policy 0, policy_version 930479 (0.0010) [2023-12-26 07:01:09,831][123090] Updated weights for policy 1, policy_version 923809 (0.0006) [2023-12-26 07:01:09,903][123090] Updated weights for policy 1, policy_version 923819 (0.0010) [2023-12-26 07:01:09,971][123090] Updated weights for policy 1, policy_version 923829 (0.0009) [2023-12-26 07:01:10,040][123090] Updated weights for policy 1, policy_version 923839 (0.0008) [2023-12-26 07:01:10,508][123091] Updated weights for policy 0, policy_version 930489 (0.0009) [2023-12-26 07:01:10,565][123091] Updated weights for policy 0, policy_version 930499 (0.0009) [2023-12-26 07:01:10,629][123091] Updated weights for policy 0, policy_version 930509 (0.0009) [2023-12-26 07:01:10,805][123090] Updated weights for policy 1, policy_version 923849 (0.0011) [2023-12-26 07:01:10,864][123090] Updated weights for policy 1, policy_version 923859 (0.0011) [2023-12-26 07:01:10,920][123090] Updated weights for policy 1, policy_version 923869 (0.0010) [2023-12-26 07:01:11,420][123091] Updated weights for policy 0, policy_version 930519 (0.0007) [2023-12-26 07:01:11,487][123091] Updated weights for policy 0, policy_version 930529 (0.0006) [2023-12-26 07:01:11,553][123091] Updated weights for policy 0, policy_version 930539 (0.0006) [2023-12-26 07:01:11,729][123090] Updated weights for policy 1, policy_version 923879 (0.0010) [2023-12-26 07:01:11,800][123090] Updated weights for policy 1, policy_version 923889 (0.0008) [2023-12-26 07:01:11,867][123090] Updated weights for policy 1, policy_version 923899 (0.0010) [2023-12-26 07:01:12,168][123091] Updated weights for policy 0, policy_version 930549 (0.0008) [2023-12-26 07:01:12,236][123091] Updated weights for policy 0, policy_version 930559 (0.0009) [2023-12-26 07:01:12,299][123091] Updated weights for policy 0, policy_version 930569 (0.0009) [2023-12-26 07:01:12,713][123090] Updated weights for policy 1, policy_version 923909 (0.0008) [2023-12-26 07:01:12,769][123090] Updated weights for policy 1, policy_version 923919 (0.0005) [2023-12-26 07:01:12,832][123090] Updated weights for policy 1, policy_version 923929 (0.0005) [2023-12-26 07:01:13,127][123091] Updated weights for policy 0, policy_version 930579 (0.0008) [2023-12-26 07:01:13,177][123091] Updated weights for policy 0, policy_version 930589 (0.0005) [2023-12-26 07:01:13,253][123091] Updated weights for policy 0, policy_version 930599 (0.0005) [2023-12-26 07:01:13,493][123090] Updated weights for policy 1, policy_version 923939 (0.0006) [2023-12-26 07:01:13,553][123090] Updated weights for policy 1, policy_version 923949 (0.0010) [2023-12-26 07:01:13,612][123090] Updated weights for policy 1, policy_version 923959 (0.0010) [2023-12-26 07:01:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 474775552. Throughput: 0: 9001.8, 1: 8890.2. Samples: 474765132. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:13,785][121949] Avg episode reward: [(0, '6292.474'), (1, '5342.045')] [2023-12-26 07:01:13,990][123091] Updated weights for policy 0, policy_version 930609 (0.0006) [2023-12-26 07:01:14,047][123091] Updated weights for policy 0, policy_version 930620 (0.0009) [2023-12-26 07:01:14,095][123091] Updated weights for policy 0, policy_version 930630 (0.0009) [2023-12-26 07:01:14,160][123091] Updated weights for policy 0, policy_version 930640 (0.0009) [2023-12-26 07:01:14,338][123090] Updated weights for policy 1, policy_version 923969 (0.0010) [2023-12-26 07:01:14,404][123090] Updated weights for policy 1, policy_version 923979 (0.0010) [2023-12-26 07:01:14,468][123090] Updated weights for policy 1, policy_version 923989 (0.0011) [2023-12-26 07:01:14,533][123090] Updated weights for policy 1, policy_version 923999 (0.0008) [2023-12-26 07:01:15,078][123091] Updated weights for policy 0, policy_version 930650 (0.0010) [2023-12-26 07:01:15,131][123091] Updated weights for policy 0, policy_version 930660 (0.0009) [2023-12-26 07:01:15,187][123091] Updated weights for policy 0, policy_version 930670 (0.0009) [2023-12-26 07:01:15,257][123090] Updated weights for policy 1, policy_version 924009 (0.0007) [2023-12-26 07:01:15,311][123090] Updated weights for policy 1, policy_version 924019 (0.0008) [2023-12-26 07:01:15,364][123090] Updated weights for policy 1, policy_version 924029 (0.0009) [2023-12-26 07:01:16,066][123091] Updated weights for policy 0, policy_version 930680 (0.0010) [2023-12-26 07:01:16,125][123091] Updated weights for policy 0, policy_version 930690 (0.0009) [2023-12-26 07:01:16,139][123090] Updated weights for policy 1, policy_version 924039 (0.0010) [2023-12-26 07:01:16,184][123091] Updated weights for policy 0, policy_version 930700 (0.0009) [2023-12-26 07:01:16,195][123090] Updated weights for policy 1, policy_version 924049 (0.0006) [2023-12-26 07:01:16,254][123090] Updated weights for policy 1, policy_version 924059 (0.0009) [2023-12-26 07:01:17,004][123091] Updated weights for policy 0, policy_version 930710 (0.0006) [2023-12-26 07:01:17,036][123090] Updated weights for policy 1, policy_version 924069 (0.0009) [2023-12-26 07:01:17,072][123091] Updated weights for policy 0, policy_version 930720 (0.0006) [2023-12-26 07:01:17,097][123090] Updated weights for policy 1, policy_version 924079 (0.0009) [2023-12-26 07:01:17,141][123091] Updated weights for policy 0, policy_version 930730 (0.0008) [2023-12-26 07:01:17,153][123090] Updated weights for policy 1, policy_version 924089 (0.0009) [2023-12-26 07:01:17,887][123091] Updated weights for policy 0, policy_version 930740 (0.0010) [2023-12-26 07:01:17,967][123091] Updated weights for policy 0, policy_version 930750 (0.0010) [2023-12-26 07:01:17,984][123090] Updated weights for policy 1, policy_version 924099 (0.0008) [2023-12-26 07:01:18,030][123091] Updated weights for policy 0, policy_version 930760 (0.0011) [2023-12-26 07:01:18,048][123090] Updated weights for policy 1, policy_version 924109 (0.0007) [2023-12-26 07:01:18,108][123090] Updated weights for policy 1, policy_version 924119 (0.0007) [2023-12-26 07:01:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 474857472. Throughput: 0: 8965.5, 1: 8988.8. Samples: 474872304. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:18,784][121949] Avg episode reward: [(0, '6248.693'), (1, '5437.584')] [2023-12-26 07:01:18,817][123091] Updated weights for policy 0, policy_version 930770 (0.0009) [2023-12-26 07:01:18,882][123091] Updated weights for policy 0, policy_version 930780 (0.0008) [2023-12-26 07:01:18,945][123091] Updated weights for policy 0, policy_version 930790 (0.0008) [2023-12-26 07:01:18,973][123090] Updated weights for policy 1, policy_version 924129 (0.0009) [2023-12-26 07:01:19,007][123091] Updated weights for policy 0, policy_version 930800 (0.0008) [2023-12-26 07:01:19,031][123090] Updated weights for policy 1, policy_version 924139 (0.0009) [2023-12-26 07:01:19,101][123090] Updated weights for policy 1, policy_version 924149 (0.0010) [2023-12-26 07:01:19,183][123090] Updated weights for policy 1, policy_version 924159 (0.0009) [2023-12-26 07:01:19,747][123091] Updated weights for policy 0, policy_version 930810 (0.0006) [2023-12-26 07:01:19,812][123091] Updated weights for policy 0, policy_version 930820 (0.0009) [2023-12-26 07:01:19,874][123091] Updated weights for policy 0, policy_version 930830 (0.0010) [2023-12-26 07:01:20,072][123090] Updated weights for policy 1, policy_version 924169 (0.0009) [2023-12-26 07:01:20,141][123090] Updated weights for policy 1, policy_version 924179 (0.0008) [2023-12-26 07:01:20,204][123090] Updated weights for policy 1, policy_version 924189 (0.0009) [2023-12-26 07:01:20,726][123091] Updated weights for policy 0, policy_version 930840 (0.0010) [2023-12-26 07:01:20,798][123091] Updated weights for policy 0, policy_version 930850 (0.0010) [2023-12-26 07:01:20,867][123091] Updated weights for policy 0, policy_version 930860 (0.0010) [2023-12-26 07:01:21,066][123090] Updated weights for policy 1, policy_version 924199 (0.0009) [2023-12-26 07:01:21,134][123090] Updated weights for policy 1, policy_version 924209 (0.0008) [2023-12-26 07:01:21,190][123090] Updated weights for policy 1, policy_version 924219 (0.0006) [2023-12-26 07:01:21,761][123091] Updated weights for policy 0, policy_version 930870 (0.0010) [2023-12-26 07:01:21,813][123091] Updated weights for policy 0, policy_version 930880 (0.0008) [2023-12-26 07:01:21,882][123091] Updated weights for policy 0, policy_version 930890 (0.0006) [2023-12-26 07:01:22,023][123090] Updated weights for policy 1, policy_version 924229 (0.0007) [2023-12-26 07:01:22,098][123090] Updated weights for policy 1, policy_version 924239 (0.0006) [2023-12-26 07:01:22,166][123090] Updated weights for policy 1, policy_version 924249 (0.0006) [2023-12-26 07:01:22,693][123091] Updated weights for policy 0, policy_version 930900 (0.0010) [2023-12-26 07:01:22,761][123091] Updated weights for policy 0, policy_version 930910 (0.0011) [2023-12-26 07:01:22,814][123091] Updated weights for policy 0, policy_version 930920 (0.0011) [2023-12-26 07:01:22,962][123090] Updated weights for policy 1, policy_version 924259 (0.0012) [2023-12-26 07:01:23,018][123090] Updated weights for policy 1, policy_version 924269 (0.0006) [2023-12-26 07:01:23,076][123090] Updated weights for policy 1, policy_version 924279 (0.0006) [2023-12-26 07:01:23,583][123091] Updated weights for policy 0, policy_version 930930 (0.0011) [2023-12-26 07:01:23,631][123091] Updated weights for policy 0, policy_version 930940 (0.0009) [2023-12-26 07:01:23,684][123091] Updated weights for policy 0, policy_version 930951 (0.0011) [2023-12-26 07:01:23,762][123090] Updated weights for policy 1, policy_version 924289 (0.0005) [2023-12-26 07:01:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 474947584. Throughput: 0: 8911.7, 1: 8976.4. Samples: 474922104. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:23,785][121949] Avg episode reward: [(0, '6257.810'), (1, '5555.323')] [2023-12-26 07:01:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000930960_238329856.pth... [2023-12-26 07:01:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000929904_238059520.pth [2023-12-26 07:01:23,835][123090] Updated weights for policy 1, policy_version 924299 (0.0009) [2023-12-26 07:01:23,899][123090] Updated weights for policy 1, policy_version 924309 (0.0008) [2023-12-26 07:01:23,973][123090] Updated weights for policy 1, policy_version 924319 (0.0005) [2023-12-26 07:01:23,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000924320_236625920.pth... [2023-12-26 07:01:23,985][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000923232_236347392.pth [2023-12-26 07:01:24,555][123091] Updated weights for policy 0, policy_version 930961 (0.0010) [2023-12-26 07:01:24,622][123091] Updated weights for policy 0, policy_version 930971 (0.0011) [2023-12-26 07:01:24,650][123090] Updated weights for policy 1, policy_version 924329 (0.0006) [2023-12-26 07:01:24,677][123091] Updated weights for policy 0, policy_version 930981 (0.0010) [2023-12-26 07:01:24,706][123090] Updated weights for policy 1, policy_version 924339 (0.0006) [2023-12-26 07:01:24,729][123091] Updated weights for policy 0, policy_version 930991 (0.0009) [2023-12-26 07:01:24,760][123090] Updated weights for policy 1, policy_version 924349 (0.0009) [2023-12-26 07:01:25,437][123091] Updated weights for policy 0, policy_version 931001 (0.0005) [2023-12-26 07:01:25,483][123090] Updated weights for policy 1, policy_version 924359 (0.0006) [2023-12-26 07:01:25,498][123091] Updated weights for policy 0, policy_version 931011 (0.0007) [2023-12-26 07:01:25,547][123090] Updated weights for policy 1, policy_version 924369 (0.0007) [2023-12-26 07:01:25,549][123091] Updated weights for policy 0, policy_version 931021 (0.0007) [2023-12-26 07:01:25,606][123090] Updated weights for policy 1, policy_version 924379 (0.0007) [2023-12-26 07:01:26,348][123090] Updated weights for policy 1, policy_version 924389 (0.0007) [2023-12-26 07:01:26,401][123091] Updated weights for policy 0, policy_version 931031 (0.0009) [2023-12-26 07:01:26,412][123090] Updated weights for policy 1, policy_version 924399 (0.0009) [2023-12-26 07:01:26,455][123091] Updated weights for policy 0, policy_version 931041 (0.0007) [2023-12-26 07:01:26,469][123090] Updated weights for policy 1, policy_version 924409 (0.0008) [2023-12-26 07:01:26,519][123091] Updated weights for policy 0, policy_version 931051 (0.0008) [2023-12-26 07:01:27,220][123091] Updated weights for policy 0, policy_version 931061 (0.0009) [2023-12-26 07:01:27,239][123090] Updated weights for policy 1, policy_version 924419 (0.0006) [2023-12-26 07:01:27,275][123091] Updated weights for policy 0, policy_version 931071 (0.0008) [2023-12-26 07:01:27,291][123090] Updated weights for policy 1, policy_version 924429 (0.0007) [2023-12-26 07:01:27,328][123091] Updated weights for policy 0, policy_version 931081 (0.0009) [2023-12-26 07:01:27,350][123090] Updated weights for policy 1, policy_version 924439 (0.0008) [2023-12-26 07:01:28,089][123091] Updated weights for policy 0, policy_version 931091 (0.0008) [2023-12-26 07:01:28,141][123091] Updated weights for policy 0, policy_version 931101 (0.0008) [2023-12-26 07:01:28,151][123090] Updated weights for policy 1, policy_version 924449 (0.0006) [2023-12-26 07:01:28,187][123091] Updated weights for policy 0, policy_version 931111 (0.0008) [2023-12-26 07:01:28,201][123090] Updated weights for policy 1, policy_version 924459 (0.0009) [2023-12-26 07:01:28,256][123090] Updated weights for policy 1, policy_version 924469 (0.0009) [2023-12-26 07:01:28,309][123090] Updated weights for policy 1, policy_version 924479 (0.0010) [2023-12-26 07:01:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 475037696. Throughput: 0: 8945.1, 1: 9100.0. Samples: 475031812. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:28,784][121949] Avg episode reward: [(0, '6292.811'), (1, '5481.606')] [2023-12-26 07:01:29,014][123091] Updated weights for policy 0, policy_version 931121 (0.0007) [2023-12-26 07:01:29,063][123091] Updated weights for policy 0, policy_version 931131 (0.0005) [2023-12-26 07:01:29,116][123091] Updated weights for policy 0, policy_version 931141 (0.0005) [2023-12-26 07:01:29,135][123090] Updated weights for policy 1, policy_version 924489 (0.0010) [2023-12-26 07:01:29,175][123091] Updated weights for policy 0, policy_version 931151 (0.0005) [2023-12-26 07:01:29,195][123090] Updated weights for policy 1, policy_version 924499 (0.0010) [2023-12-26 07:01:29,261][123090] Updated weights for policy 1, policy_version 924509 (0.0011) [2023-12-26 07:01:29,846][123091] Updated weights for policy 0, policy_version 931161 (0.0008) [2023-12-26 07:01:29,910][123091] Updated weights for policy 0, policy_version 931171 (0.0009) [2023-12-26 07:01:29,981][123091] Updated weights for policy 0, policy_version 931181 (0.0007) [2023-12-26 07:01:30,121][123090] Updated weights for policy 1, policy_version 924519 (0.0009) [2023-12-26 07:01:30,180][123090] Updated weights for policy 1, policy_version 924529 (0.0010) [2023-12-26 07:01:30,238][123090] Updated weights for policy 1, policy_version 924539 (0.0009) [2023-12-26 07:01:30,758][123091] Updated weights for policy 0, policy_version 931191 (0.0009) [2023-12-26 07:01:30,806][123091] Updated weights for policy 0, policy_version 931201 (0.0010) [2023-12-26 07:01:30,851][123091] Updated weights for policy 0, policy_version 931211 (0.0007) [2023-12-26 07:01:31,062][123090] Updated weights for policy 1, policy_version 924549 (0.0008) [2023-12-26 07:01:31,118][123090] Updated weights for policy 1, policy_version 924559 (0.0007) [2023-12-26 07:01:31,186][123090] Updated weights for policy 1, policy_version 924569 (0.0008) [2023-12-26 07:01:31,772][123091] Updated weights for policy 0, policy_version 931221 (0.0010) [2023-12-26 07:01:31,828][123091] Updated weights for policy 0, policy_version 931231 (0.0010) [2023-12-26 07:01:31,879][123091] Updated weights for policy 0, policy_version 931241 (0.0009) [2023-12-26 07:01:31,996][123090] Updated weights for policy 1, policy_version 924579 (0.0009) [2023-12-26 07:01:32,056][123090] Updated weights for policy 1, policy_version 924589 (0.0009) [2023-12-26 07:01:32,127][123090] Updated weights for policy 1, policy_version 924599 (0.0009) [2023-12-26 07:01:32,744][123091] Updated weights for policy 0, policy_version 931251 (0.0009) [2023-12-26 07:01:32,796][123091] Updated weights for policy 0, policy_version 931261 (0.0009) [2023-12-26 07:01:32,843][123091] Updated weights for policy 0, policy_version 931271 (0.0008) [2023-12-26 07:01:32,886][123090] Updated weights for policy 1, policy_version 924609 (0.0009) [2023-12-26 07:01:32,935][123090] Updated weights for policy 1, policy_version 924619 (0.0005) [2023-12-26 07:01:33,000][123090] Updated weights for policy 1, policy_version 924629 (0.0006) [2023-12-26 07:01:33,069][123090] Updated weights for policy 1, policy_version 924639 (0.0011) [2023-12-26 07:01:33,596][123091] Updated weights for policy 0, policy_version 931282 (0.0010) [2023-12-26 07:01:33,652][123091] Updated weights for policy 0, policy_version 931292 (0.0008) [2023-12-26 07:01:33,711][123091] Updated weights for policy 0, policy_version 931302 (0.0006) [2023-12-26 07:01:33,758][123091] Updated weights for policy 0, policy_version 931312 (0.0005) [2023-12-26 07:01:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 475127808. Throughput: 0: 8900.7, 1: 9017.6. Samples: 475138600. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:33,785][121949] Avg episode reward: [(0, '6226.015'), (1, '5509.913')] [2023-12-26 07:01:33,829][123090] Updated weights for policy 1, policy_version 924649 (0.0010) [2023-12-26 07:01:33,890][123090] Updated weights for policy 1, policy_version 924659 (0.0010) [2023-12-26 07:01:33,951][123090] Updated weights for policy 1, policy_version 924669 (0.0010) [2023-12-26 07:01:34,543][123091] Updated weights for policy 0, policy_version 931322 (0.0010) [2023-12-26 07:01:34,600][123091] Updated weights for policy 0, policy_version 931332 (0.0010) [2023-12-26 07:01:34,663][123091] Updated weights for policy 0, policy_version 931342 (0.0009) [2023-12-26 07:01:34,709][123090] Updated weights for policy 1, policy_version 924679 (0.0010) [2023-12-26 07:01:34,761][123090] Updated weights for policy 1, policy_version 924689 (0.0010) [2023-12-26 07:01:34,824][123090] Updated weights for policy 1, policy_version 924699 (0.0011) [2023-12-26 07:01:35,348][123091] Updated weights for policy 0, policy_version 931352 (0.0006) [2023-12-26 07:01:35,394][123091] Updated weights for policy 0, policy_version 931362 (0.0005) [2023-12-26 07:01:35,439][123091] Updated weights for policy 0, policy_version 931372 (0.0005) [2023-12-26 07:01:35,577][123090] Updated weights for policy 1, policy_version 924709 (0.0010) [2023-12-26 07:01:35,632][123090] Updated weights for policy 1, policy_version 924719 (0.0010) [2023-12-26 07:01:35,699][123090] Updated weights for policy 1, policy_version 924729 (0.0011) [2023-12-26 07:01:36,196][123091] Updated weights for policy 0, policy_version 931382 (0.0006) [2023-12-26 07:01:36,265][123091] Updated weights for policy 0, policy_version 931392 (0.0006) [2023-12-26 07:01:36,321][123091] Updated weights for policy 0, policy_version 931402 (0.0006) [2023-12-26 07:01:36,556][123090] Updated weights for policy 1, policy_version 924739 (0.0010) [2023-12-26 07:01:36,613][123090] Updated weights for policy 1, policy_version 924749 (0.0011) [2023-12-26 07:01:36,689][123090] Updated weights for policy 1, policy_version 924759 (0.0011) [2023-12-26 07:01:36,989][123091] Updated weights for policy 0, policy_version 931412 (0.0006) [2023-12-26 07:01:37,064][123091] Updated weights for policy 0, policy_version 931422 (0.0007) [2023-12-26 07:01:37,128][123091] Updated weights for policy 0, policy_version 931432 (0.0009) [2023-12-26 07:01:37,516][123090] Updated weights for policy 1, policy_version 924769 (0.0011) [2023-12-26 07:01:37,574][123090] Updated weights for policy 1, policy_version 924779 (0.0009) [2023-12-26 07:01:37,636][123090] Updated weights for policy 1, policy_version 924789 (0.0010) [2023-12-26 07:01:37,699][123090] Updated weights for policy 1, policy_version 924799 (0.0009) [2023-12-26 07:01:37,900][123091] Updated weights for policy 0, policy_version 931442 (0.0010) [2023-12-26 07:01:37,962][123091] Updated weights for policy 0, policy_version 931452 (0.0005) [2023-12-26 07:01:38,032][123091] Updated weights for policy 0, policy_version 931462 (0.0010) [2023-12-26 07:01:38,097][123091] Updated weights for policy 0, policy_version 931472 (0.0009) [2023-12-26 07:01:38,579][123090] Updated weights for policy 1, policy_version 924809 (0.0007) [2023-12-26 07:01:38,649][123090] Updated weights for policy 1, policy_version 924819 (0.0006) [2023-12-26 07:01:38,706][123090] Updated weights for policy 1, policy_version 924829 (0.0009) [2023-12-26 07:01:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 475217920. Throughput: 0: 8971.4, 1: 9059.6. Samples: 475193996. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:38,785][121949] Avg episode reward: [(0, '6192.109'), (1, '5539.177')] [2023-12-26 07:01:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000924832_236756992.pth... [2023-12-26 07:01:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000923776_236486656.pth [2023-12-26 07:01:38,827][123091] Updated weights for policy 0, policy_version 931482 (0.0006) [2023-12-26 07:01:38,873][123091] Updated weights for policy 0, policy_version 931492 (0.0006) [2023-12-26 07:01:38,920][123091] Updated weights for policy 0, policy_version 931502 (0.0007) [2023-12-26 07:01:38,929][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000931504_238469120.pth... [2023-12-26 07:01:38,932][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000930448_238198784.pth [2023-12-26 07:01:39,518][123090] Updated weights for policy 1, policy_version 924839 (0.0009) [2023-12-26 07:01:39,574][123090] Updated weights for policy 1, policy_version 924849 (0.0008) [2023-12-26 07:01:39,627][123090] Updated weights for policy 1, policy_version 924859 (0.0008) [2023-12-26 07:01:39,766][123091] Updated weights for policy 0, policy_version 931512 (0.0009) [2023-12-26 07:01:39,827][123091] Updated weights for policy 0, policy_version 931522 (0.0010) [2023-12-26 07:01:39,894][123091] Updated weights for policy 0, policy_version 931532 (0.0010) [2023-12-26 07:01:40,445][123090] Updated weights for policy 1, policy_version 924869 (0.0008) [2023-12-26 07:01:40,506][123090] Updated weights for policy 1, policy_version 924879 (0.0010) [2023-12-26 07:01:40,554][123090] Updated weights for policy 1, policy_version 924889 (0.0010) [2023-12-26 07:01:40,718][123091] Updated weights for policy 0, policy_version 931542 (0.0007) [2023-12-26 07:01:40,788][123091] Updated weights for policy 0, policy_version 931552 (0.0005) [2023-12-26 07:01:40,843][123091] Updated weights for policy 0, policy_version 931562 (0.0006) [2023-12-26 07:01:41,388][123090] Updated weights for policy 1, policy_version 924899 (0.0010) [2023-12-26 07:01:41,457][123090] Updated weights for policy 1, policy_version 924909 (0.0009) [2023-12-26 07:01:41,530][123090] Updated weights for policy 1, policy_version 924919 (0.0010) [2023-12-26 07:01:41,585][123091] Updated weights for policy 0, policy_version 931572 (0.0006) [2023-12-26 07:01:41,652][123091] Updated weights for policy 0, policy_version 931582 (0.0008) [2023-12-26 07:01:41,717][123091] Updated weights for policy 0, policy_version 931592 (0.0010) [2023-12-26 07:01:42,446][123090] Updated weights for policy 1, policy_version 924929 (0.0010) [2023-12-26 07:01:42,478][123091] Updated weights for policy 0, policy_version 931602 (0.0008) [2023-12-26 07:01:42,510][123090] Updated weights for policy 1, policy_version 924939 (0.0009) [2023-12-26 07:01:42,544][123091] Updated weights for policy 0, policy_version 931612 (0.0006) [2023-12-26 07:01:42,568][123090] Updated weights for policy 1, policy_version 924949 (0.0009) [2023-12-26 07:01:42,610][123091] Updated weights for policy 0, policy_version 931622 (0.0007) [2023-12-26 07:01:42,622][123090] Updated weights for policy 1, policy_version 924959 (0.0008) [2023-12-26 07:01:42,665][123091] Updated weights for policy 0, policy_version 931632 (0.0010) [2023-12-26 07:01:43,356][123090] Updated weights for policy 1, policy_version 924969 (0.0006) [2023-12-26 07:01:43,407][123090] Updated weights for policy 1, policy_version 924979 (0.0005) [2023-12-26 07:01:43,478][123090] Updated weights for policy 1, policy_version 924989 (0.0007) [2023-12-26 07:01:43,505][123091] Updated weights for policy 0, policy_version 931642 (0.0006) [2023-12-26 07:01:43,556][123091] Updated weights for policy 0, policy_version 931652 (0.0008) [2023-12-26 07:01:43,624][123091] Updated weights for policy 0, policy_version 931662 (0.0007) [2023-12-26 07:01:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 475308032. Throughput: 0: 8914.5, 1: 8882.3. Samples: 475298008. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:43,785][121949] Avg episode reward: [(0, '6187.964'), (1, '5532.846')] [2023-12-26 07:01:44,295][123091] Updated weights for policy 0, policy_version 931672 (0.0009) [2023-12-26 07:01:44,302][123090] Updated weights for policy 1, policy_version 924999 (0.0007) [2023-12-26 07:01:44,342][123091] Updated weights for policy 0, policy_version 931682 (0.0010) [2023-12-26 07:01:44,359][123090] Updated weights for policy 1, policy_version 925009 (0.0007) [2023-12-26 07:01:44,393][123091] Updated weights for policy 0, policy_version 931692 (0.0010) [2023-12-26 07:01:44,402][123090] Updated weights for policy 1, policy_version 925019 (0.0007) [2023-12-26 07:01:45,162][123091] Updated weights for policy 0, policy_version 931702 (0.0010) [2023-12-26 07:01:45,233][123091] Updated weights for policy 0, policy_version 931712 (0.0011) [2023-12-26 07:01:45,274][123090] Updated weights for policy 1, policy_version 925029 (0.0008) [2023-12-26 07:01:45,304][123091] Updated weights for policy 0, policy_version 931722 (0.0011) [2023-12-26 07:01:45,338][123090] Updated weights for policy 1, policy_version 925039 (0.0010) [2023-12-26 07:01:45,408][123090] Updated weights for policy 1, policy_version 925049 (0.0009) [2023-12-26 07:01:46,106][123091] Updated weights for policy 0, policy_version 931732 (0.0011) [2023-12-26 07:01:46,168][123091] Updated weights for policy 0, policy_version 931742 (0.0010) [2023-12-26 07:01:46,223][123091] Updated weights for policy 0, policy_version 931752 (0.0010) [2023-12-26 07:01:46,239][123090] Updated weights for policy 1, policy_version 925059 (0.0008) [2023-12-26 07:01:46,304][123090] Updated weights for policy 1, policy_version 925069 (0.0007) [2023-12-26 07:01:46,353][123090] Updated weights for policy 1, policy_version 925079 (0.0009) [2023-12-26 07:01:47,015][123091] Updated weights for policy 0, policy_version 931762 (0.0009) [2023-12-26 07:01:47,075][123091] Updated weights for policy 0, policy_version 931772 (0.0006) [2023-12-26 07:01:47,132][123091] Updated weights for policy 0, policy_version 931782 (0.0005) [2023-12-26 07:01:47,196][123091] Updated weights for policy 0, policy_version 931792 (0.0005) [2023-12-26 07:01:47,202][123090] Updated weights for policy 1, policy_version 925089 (0.0009) [2023-12-26 07:01:47,258][123090] Updated weights for policy 1, policy_version 925099 (0.0009) [2023-12-26 07:01:47,306][123090] Updated weights for policy 1, policy_version 925109 (0.0009) [2023-12-26 07:01:47,355][123090] Updated weights for policy 1, policy_version 925119 (0.0008) [2023-12-26 07:01:47,921][123091] Updated weights for policy 0, policy_version 931802 (0.0005) [2023-12-26 07:01:47,983][123091] Updated weights for policy 0, policy_version 931812 (0.0005) [2023-12-26 07:01:48,049][123091] Updated weights for policy 0, policy_version 931822 (0.0006) [2023-12-26 07:01:48,255][123090] Updated weights for policy 1, policy_version 925129 (0.0010) [2023-12-26 07:01:48,334][123090] Updated weights for policy 1, policy_version 925139 (0.0010) [2023-12-26 07:01:48,408][123090] Updated weights for policy 1, policy_version 925149 (0.0010) [2023-12-26 07:01:48,640][123091] Updated weights for policy 0, policy_version 931832 (0.0005) [2023-12-26 07:01:48,715][123091] Updated weights for policy 0, policy_version 931842 (0.0007) [2023-12-26 07:01:48,778][123091] Updated weights for policy 0, policy_version 931852 (0.0011) [2023-12-26 07:01:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 475389952. Throughput: 0: 8966.4, 1: 8816.1. Samples: 475404808. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:48,785][121949] Avg episode reward: [(0, '6289.314'), (1, '5400.264')] [2023-12-26 07:01:49,269][123090] Updated weights for policy 1, policy_version 925159 (0.0009) [2023-12-26 07:01:49,330][123090] Updated weights for policy 1, policy_version 925169 (0.0009) [2023-12-26 07:01:49,401][123090] Updated weights for policy 1, policy_version 925179 (0.0009) [2023-12-26 07:01:49,550][123091] Updated weights for policy 0, policy_version 931862 (0.0010) [2023-12-26 07:01:49,612][123091] Updated weights for policy 0, policy_version 931872 (0.0011) [2023-12-26 07:01:49,659][123091] Updated weights for policy 0, policy_version 931882 (0.0010) [2023-12-26 07:01:50,242][123090] Updated weights for policy 1, policy_version 925189 (0.0009) [2023-12-26 07:01:50,298][123090] Updated weights for policy 1, policy_version 925199 (0.0008) [2023-12-26 07:01:50,355][123090] Updated weights for policy 1, policy_version 925209 (0.0008) [2023-12-26 07:01:50,504][123091] Updated weights for policy 0, policy_version 931892 (0.0010) [2023-12-26 07:01:50,555][123091] Updated weights for policy 0, policy_version 931902 (0.0010) [2023-12-26 07:01:50,625][123091] Updated weights for policy 0, policy_version 931912 (0.0011) [2023-12-26 07:01:51,213][123090] Updated weights for policy 1, policy_version 925219 (0.0008) [2023-12-26 07:01:51,281][123090] Updated weights for policy 1, policy_version 925229 (0.0010) [2023-12-26 07:01:51,355][123090] Updated weights for policy 1, policy_version 925239 (0.0009) [2023-12-26 07:01:51,478][123091] Updated weights for policy 0, policy_version 931922 (0.0010) [2023-12-26 07:01:51,530][123091] Updated weights for policy 0, policy_version 931932 (0.0009) [2023-12-26 07:01:51,584][123091] Updated weights for policy 0, policy_version 931942 (0.0009) [2023-12-26 07:01:51,643][123091] Updated weights for policy 0, policy_version 931952 (0.0010) [2023-12-26 07:01:52,149][123090] Updated weights for policy 1, policy_version 925249 (0.0009) [2023-12-26 07:01:52,215][123090] Updated weights for policy 1, policy_version 925259 (0.0009) [2023-12-26 07:01:52,288][123090] Updated weights for policy 1, policy_version 925269 (0.0010) [2023-12-26 07:01:52,366][123090] Updated weights for policy 1, policy_version 925279 (0.0007) [2023-12-26 07:01:52,580][123091] Updated weights for policy 0, policy_version 931962 (0.0007) [2023-12-26 07:01:52,649][123091] Updated weights for policy 0, policy_version 931972 (0.0008) [2023-12-26 07:01:52,719][123091] Updated weights for policy 0, policy_version 931982 (0.0010) [2023-12-26 07:01:53,083][123090] Updated weights for policy 1, policy_version 925289 (0.0009) [2023-12-26 07:01:53,139][123090] Updated weights for policy 1, policy_version 925299 (0.0008) [2023-12-26 07:01:53,196][123090] Updated weights for policy 1, policy_version 925309 (0.0008) [2023-12-26 07:01:53,510][123091] Updated weights for policy 0, policy_version 931992 (0.0009) [2023-12-26 07:01:53,571][123091] Updated weights for policy 0, policy_version 932002 (0.0009) [2023-12-26 07:01:53,627][123091] Updated weights for policy 0, policy_version 932012 (0.0009) [2023-12-26 07:01:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 475480064. Throughput: 0: 8947.1, 1: 8731.2. Samples: 475454808. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:53,785][121949] Avg episode reward: [(0, '6205.294'), (1, '5264.109')] [2023-12-26 07:01:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000932016_238600192.pth... [2023-12-26 07:01:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000925312_236879872.pth... [2023-12-26 07:01:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000924320_236625920.pth [2023-12-26 07:01:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000930960_238329856.pth [2023-12-26 07:01:53,954][123090] Updated weights for policy 1, policy_version 925319 (0.0006) [2023-12-26 07:01:54,018][123090] Updated weights for policy 1, policy_version 925329 (0.0005) [2023-12-26 07:01:54,078][123090] Updated weights for policy 1, policy_version 925339 (0.0006) [2023-12-26 07:01:54,529][123091] Updated weights for policy 0, policy_version 932022 (0.0010) [2023-12-26 07:01:54,582][123091] Updated weights for policy 0, policy_version 932032 (0.0010) [2023-12-26 07:01:54,643][123091] Updated weights for policy 0, policy_version 932042 (0.0010) [2023-12-26 07:01:54,680][123090] Updated weights for policy 1, policy_version 925349 (0.0005) [2023-12-26 07:01:54,730][123090] Updated weights for policy 1, policy_version 925359 (0.0007) [2023-12-26 07:01:54,787][123090] Updated weights for policy 1, policy_version 925369 (0.0005) [2023-12-26 07:01:55,514][123091] Updated weights for policy 0, policy_version 932052 (0.0009) [2023-12-26 07:01:55,571][123091] Updated weights for policy 0, policy_version 932062 (0.0010) [2023-12-26 07:01:55,616][123090] Updated weights for policy 1, policy_version 925379 (0.0007) [2023-12-26 07:01:55,619][123091] Updated weights for policy 0, policy_version 932072 (0.0008) [2023-12-26 07:01:55,667][123090] Updated weights for policy 1, policy_version 925389 (0.0008) [2023-12-26 07:01:55,723][123090] Updated weights for policy 1, policy_version 925399 (0.0005) [2023-12-26 07:01:56,494][123090] Updated weights for policy 1, policy_version 925409 (0.0008) [2023-12-26 07:01:56,506][123091] Updated weights for policy 0, policy_version 932082 (0.0007) [2023-12-26 07:01:56,557][123090] Updated weights for policy 1, policy_version 925419 (0.0010) [2023-12-26 07:01:56,569][123091] Updated weights for policy 0, policy_version 932092 (0.0008) [2023-12-26 07:01:56,609][123090] Updated weights for policy 1, policy_version 925429 (0.0010) [2023-12-26 07:01:56,629][123091] Updated weights for policy 0, policy_version 932102 (0.0007) [2023-12-26 07:01:56,664][123090] Updated weights for policy 1, policy_version 925439 (0.0010) [2023-12-26 07:01:56,690][123091] Updated weights for policy 0, policy_version 932112 (0.0009) [2023-12-26 07:01:57,363][123090] Updated weights for policy 1, policy_version 925449 (0.0007) [2023-12-26 07:01:57,410][123090] Updated weights for policy 1, policy_version 925459 (0.0010) [2023-12-26 07:01:57,457][123090] Updated weights for policy 1, policy_version 925469 (0.0010) [2023-12-26 07:01:57,530][123091] Updated weights for policy 0, policy_version 932122 (0.0005) [2023-12-26 07:01:57,587][123091] Updated weights for policy 0, policy_version 932132 (0.0005) [2023-12-26 07:01:57,650][123091] Updated weights for policy 0, policy_version 932142 (0.0007) [2023-12-26 07:01:58,281][123090] Updated weights for policy 1, policy_version 925479 (0.0009) [2023-12-26 07:01:58,343][123090] Updated weights for policy 1, policy_version 925489 (0.0009) [2023-12-26 07:01:58,406][123091] Updated weights for policy 0, policy_version 932152 (0.0008) [2023-12-26 07:01:58,410][123090] Updated weights for policy 1, policy_version 925499 (0.0009) [2023-12-26 07:01:58,477][123091] Updated weights for policy 0, policy_version 932162 (0.0009) [2023-12-26 07:01:58,547][123091] Updated weights for policy 0, policy_version 932172 (0.0009) [2023-12-26 07:01:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 475570176. Throughput: 0: 8877.3, 1: 8811.6. Samples: 475561128. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:01:58,785][121949] Avg episode reward: [(0, '6157.503'), (1, '5212.773')] [2023-12-26 07:01:59,353][123091] Updated weights for policy 0, policy_version 932182 (0.0007) [2023-12-26 07:01:59,412][123090] Updated weights for policy 1, policy_version 925509 (0.0008) [2023-12-26 07:01:59,426][123091] Updated weights for policy 0, policy_version 932192 (0.0010) [2023-12-26 07:01:59,477][123090] Updated weights for policy 1, policy_version 925519 (0.0007) [2023-12-26 07:01:59,506][123091] Updated weights for policy 0, policy_version 932202 (0.0006) [2023-12-26 07:01:59,545][123090] Updated weights for policy 1, policy_version 925529 (0.0007) [2023-12-26 07:02:00,218][123091] Updated weights for policy 0, policy_version 932212 (0.0007) [2023-12-26 07:02:00,224][123090] Updated weights for policy 1, policy_version 925539 (0.0006) [2023-12-26 07:02:00,287][123091] Updated weights for policy 0, policy_version 932222 (0.0006) [2023-12-26 07:02:00,296][123090] Updated weights for policy 1, policy_version 925549 (0.0008) [2023-12-26 07:02:00,355][123091] Updated weights for policy 0, policy_version 932232 (0.0008) [2023-12-26 07:02:00,362][123090] Updated weights for policy 1, policy_version 925559 (0.0009) [2023-12-26 07:02:00,972][123091] Updated weights for policy 0, policy_version 932242 (0.0011) [2023-12-26 07:02:01,025][123091] Updated weights for policy 0, policy_version 932252 (0.0009) [2023-12-26 07:02:01,089][123091] Updated weights for policy 0, policy_version 932262 (0.0008) [2023-12-26 07:02:01,128][123090] Updated weights for policy 1, policy_version 925569 (0.0007) [2023-12-26 07:02:01,155][123091] Updated weights for policy 0, policy_version 932272 (0.0010) [2023-12-26 07:02:01,197][123090] Updated weights for policy 1, policy_version 925579 (0.0009) [2023-12-26 07:02:01,265][123090] Updated weights for policy 1, policy_version 925589 (0.0008) [2023-12-26 07:02:01,326][123090] Updated weights for policy 1, policy_version 925599 (0.0009) [2023-12-26 07:02:01,995][123091] Updated weights for policy 0, policy_version 932282 (0.0011) [2023-12-26 07:02:02,058][123091] Updated weights for policy 0, policy_version 932292 (0.0010) [2023-12-26 07:02:02,117][123091] Updated weights for policy 0, policy_version 932302 (0.0007) [2023-12-26 07:02:02,132][123090] Updated weights for policy 1, policy_version 925609 (0.0009) [2023-12-26 07:02:02,196][123090] Updated weights for policy 1, policy_version 925619 (0.0010) [2023-12-26 07:02:02,247][123090] Updated weights for policy 1, policy_version 925629 (0.0009) [2023-12-26 07:02:02,816][123091] Updated weights for policy 0, policy_version 932312 (0.0005) [2023-12-26 07:02:02,866][123091] Updated weights for policy 0, policy_version 932322 (0.0005) [2023-12-26 07:02:02,923][123091] Updated weights for policy 0, policy_version 932332 (0.0005) [2023-12-26 07:02:03,021][123090] Updated weights for policy 1, policy_version 925639 (0.0010) [2023-12-26 07:02:03,067][123090] Updated weights for policy 1, policy_version 925649 (0.0006) [2023-12-26 07:02:03,132][123090] Updated weights for policy 1, policy_version 925659 (0.0005) [2023-12-26 07:02:03,622][123091] Updated weights for policy 0, policy_version 932342 (0.0005) [2023-12-26 07:02:03,686][123091] Updated weights for policy 0, policy_version 932352 (0.0005) [2023-12-26 07:02:03,752][123091] Updated weights for policy 0, policy_version 932362 (0.0006) [2023-12-26 07:02:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 475660288. Throughput: 0: 8967.8, 1: 8754.1. Samples: 475669792. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:03,785][121949] Avg episode reward: [(0, '6205.027'), (1, '5316.257')] [2023-12-26 07:02:03,912][123090] Updated weights for policy 1, policy_version 925669 (0.0007) [2023-12-26 07:02:03,975][123090] Updated weights for policy 1, policy_version 925679 (0.0009) [2023-12-26 07:02:04,038][123090] Updated weights for policy 1, policy_version 925689 (0.0009) [2023-12-26 07:02:04,533][123091] Updated weights for policy 0, policy_version 932372 (0.0009) [2023-12-26 07:02:04,587][123091] Updated weights for policy 0, policy_version 932382 (0.0009) [2023-12-26 07:02:04,652][123091] Updated weights for policy 0, policy_version 932392 (0.0010) [2023-12-26 07:02:04,820][123090] Updated weights for policy 1, policy_version 925699 (0.0010) [2023-12-26 07:02:04,882][123090] Updated weights for policy 1, policy_version 925709 (0.0009) [2023-12-26 07:02:04,929][123090] Updated weights for policy 1, policy_version 925719 (0.0008) [2023-12-26 07:02:05,439][123091] Updated weights for policy 0, policy_version 932403 (0.0009) [2023-12-26 07:02:05,502][123091] Updated weights for policy 0, policy_version 932413 (0.0009) [2023-12-26 07:02:05,567][123091] Updated weights for policy 0, policy_version 932423 (0.0010) [2023-12-26 07:02:05,810][123090] Updated weights for policy 1, policy_version 925729 (0.0009) [2023-12-26 07:02:05,873][123090] Updated weights for policy 1, policy_version 925739 (0.0009) [2023-12-26 07:02:05,935][123090] Updated weights for policy 1, policy_version 925749 (0.0007) [2023-12-26 07:02:06,002][123090] Updated weights for policy 1, policy_version 925759 (0.0009) [2023-12-26 07:02:06,277][123091] Updated weights for policy 0, policy_version 932433 (0.0009) [2023-12-26 07:02:06,334][123091] Updated weights for policy 0, policy_version 932443 (0.0009) [2023-12-26 07:02:06,398][123091] Updated weights for policy 0, policy_version 932453 (0.0010) [2023-12-26 07:02:06,465][123091] Updated weights for policy 0, policy_version 932463 (0.0010) [2023-12-26 07:02:06,828][123090] Updated weights for policy 1, policy_version 925769 (0.0009) [2023-12-26 07:02:06,886][123090] Updated weights for policy 1, policy_version 925779 (0.0010) [2023-12-26 07:02:06,937][123090] Updated weights for policy 1, policy_version 925789 (0.0010) [2023-12-26 07:02:07,300][123091] Updated weights for policy 0, policy_version 932473 (0.0010) [2023-12-26 07:02:07,358][123091] Updated weights for policy 0, policy_version 932483 (0.0010) [2023-12-26 07:02:07,409][123091] Updated weights for policy 0, policy_version 932493 (0.0009) [2023-12-26 07:02:07,788][123090] Updated weights for policy 1, policy_version 925799 (0.0010) [2023-12-26 07:02:07,848][123090] Updated weights for policy 1, policy_version 925809 (0.0009) [2023-12-26 07:02:07,907][123090] Updated weights for policy 1, policy_version 925819 (0.0009) [2023-12-26 07:02:08,233][123091] Updated weights for policy 0, policy_version 932503 (0.0010) [2023-12-26 07:02:08,299][123091] Updated weights for policy 0, policy_version 932513 (0.0010) [2023-12-26 07:02:08,369][123091] Updated weights for policy 0, policy_version 932523 (0.0009) [2023-12-26 07:02:08,752][123090] Updated weights for policy 1, policy_version 925829 (0.0010) [2023-12-26 07:02:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 475742208. Throughput: 0: 8996.7, 1: 8779.0. Samples: 475722012. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:08,785][121949] Avg episode reward: [(0, '6284.717'), (1, '5468.578')] [2023-12-26 07:02:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000932528_238731264.pth... [2023-12-26 07:02:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000931504_238469120.pth [2023-12-26 07:02:08,804][123090] Updated weights for policy 1, policy_version 925839 (0.0010) [2023-12-26 07:02:08,864][123090] Updated weights for policy 1, policy_version 925849 (0.0010) [2023-12-26 07:02:08,900][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000925856_237019136.pth... [2023-12-26 07:02:08,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000924832_236756992.pth [2023-12-26 07:02:09,158][123091] Updated weights for policy 0, policy_version 932533 (0.0007) [2023-12-26 07:02:09,221][123091] Updated weights for policy 0, policy_version 932543 (0.0006) [2023-12-26 07:02:09,295][123091] Updated weights for policy 0, policy_version 932553 (0.0011) [2023-12-26 07:02:09,733][123090] Updated weights for policy 1, policy_version 925859 (0.0008) [2023-12-26 07:02:09,805][123090] Updated weights for policy 1, policy_version 925869 (0.0006) [2023-12-26 07:02:09,867][123090] Updated weights for policy 1, policy_version 925879 (0.0009) [2023-12-26 07:02:10,121][123091] Updated weights for policy 0, policy_version 932563 (0.0010) [2023-12-26 07:02:10,173][123091] Updated weights for policy 0, policy_version 932573 (0.0009) [2023-12-26 07:02:10,222][123091] Updated weights for policy 0, policy_version 932583 (0.0009) [2023-12-26 07:02:10,660][123090] Updated weights for policy 1, policy_version 925889 (0.0011) [2023-12-26 07:02:10,716][123090] Updated weights for policy 1, policy_version 925899 (0.0010) [2023-12-26 07:02:10,775][123090] Updated weights for policy 1, policy_version 925909 (0.0010) [2023-12-26 07:02:10,830][123090] Updated weights for policy 1, policy_version 925919 (0.0010) [2023-12-26 07:02:11,076][123091] Updated weights for policy 0, policy_version 932593 (0.0009) [2023-12-26 07:02:11,144][123091] Updated weights for policy 0, policy_version 932603 (0.0009) [2023-12-26 07:02:11,196][123091] Updated weights for policy 0, policy_version 932613 (0.0009) [2023-12-26 07:02:11,250][123091] Updated weights for policy 0, policy_version 932623 (0.0009) [2023-12-26 07:02:11,695][123090] Updated weights for policy 1, policy_version 925929 (0.0011) [2023-12-26 07:02:11,765][123090] Updated weights for policy 1, policy_version 925939 (0.0010) [2023-12-26 07:02:11,836][123090] Updated weights for policy 1, policy_version 925949 (0.0011) [2023-12-26 07:02:12,096][123091] Updated weights for policy 0, policy_version 932633 (0.0006) [2023-12-26 07:02:12,151][123091] Updated weights for policy 0, policy_version 932643 (0.0005) [2023-12-26 07:02:12,218][123091] Updated weights for policy 0, policy_version 932653 (0.0007) [2023-12-26 07:02:12,641][123090] Updated weights for policy 1, policy_version 925959 (0.0010) [2023-12-26 07:02:12,697][123090] Updated weights for policy 1, policy_version 925969 (0.0010) [2023-12-26 07:02:12,764][123090] Updated weights for policy 1, policy_version 925979 (0.0010) [2023-12-26 07:02:13,019][123091] Updated weights for policy 0, policy_version 932663 (0.0008) [2023-12-26 07:02:13,078][123091] Updated weights for policy 0, policy_version 932673 (0.0009) [2023-12-26 07:02:13,151][123091] Updated weights for policy 0, policy_version 932683 (0.0006) [2023-12-26 07:02:13,578][123090] Updated weights for policy 1, policy_version 925989 (0.0010) [2023-12-26 07:02:13,630][123090] Updated weights for policy 1, policy_version 925999 (0.0008) [2023-12-26 07:02:13,686][123090] Updated weights for policy 1, policy_version 926010 (0.0009) [2023-12-26 07:02:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 475832320. Throughput: 0: 8954.6, 1: 8669.7. Samples: 475824908. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:13,785][121949] Avg episode reward: [(0, '6266.834'), (1, '5504.009')] [2023-12-26 07:02:13,891][123091] Updated weights for policy 0, policy_version 932693 (0.0007) [2023-12-26 07:02:13,958][123091] Updated weights for policy 0, policy_version 932703 (0.0009) [2023-12-26 07:02:14,026][123091] Updated weights for policy 0, policy_version 932713 (0.0010) [2023-12-26 07:02:14,529][123090] Updated weights for policy 1, policy_version 926020 (0.0009) [2023-12-26 07:02:14,582][123090] Updated weights for policy 1, policy_version 926031 (0.0010) [2023-12-26 07:02:14,635][123090] Updated weights for policy 1, policy_version 926042 (0.0010) [2023-12-26 07:02:14,751][123091] Updated weights for policy 0, policy_version 932723 (0.0008) [2023-12-26 07:02:14,818][123091] Updated weights for policy 0, policy_version 932733 (0.0009) [2023-12-26 07:02:14,885][123091] Updated weights for policy 0, policy_version 932743 (0.0009) [2023-12-26 07:02:15,514][123090] Updated weights for policy 1, policy_version 926053 (0.0010) [2023-12-26 07:02:15,585][123090] Updated weights for policy 1, policy_version 926063 (0.0011) [2023-12-26 07:02:15,639][123091] Updated weights for policy 0, policy_version 932753 (0.0010) [2023-12-26 07:02:15,655][123090] Updated weights for policy 1, policy_version 926073 (0.0010) [2023-12-26 07:02:15,699][123091] Updated weights for policy 0, policy_version 932763 (0.0005) [2023-12-26 07:02:15,769][123091] Updated weights for policy 0, policy_version 932773 (0.0005) [2023-12-26 07:02:15,831][123091] Updated weights for policy 0, policy_version 932783 (0.0005) [2023-12-26 07:02:16,324][123090] Updated weights for policy 1, policy_version 926083 (0.0007) [2023-12-26 07:02:16,384][123090] Updated weights for policy 1, policy_version 926093 (0.0005) [2023-12-26 07:02:16,447][123090] Updated weights for policy 1, policy_version 926103 (0.0008) [2023-12-26 07:02:16,631][123091] Updated weights for policy 0, policy_version 932793 (0.0010) [2023-12-26 07:02:16,682][123091] Updated weights for policy 0, policy_version 932803 (0.0010) [2023-12-26 07:02:16,730][123091] Updated weights for policy 0, policy_version 932813 (0.0010) [2023-12-26 07:02:17,098][123090] Updated weights for policy 1, policy_version 926113 (0.0008) [2023-12-26 07:02:17,159][123090] Updated weights for policy 1, policy_version 926123 (0.0005) [2023-12-26 07:02:17,221][123090] Updated weights for policy 1, policy_version 926133 (0.0006) [2023-12-26 07:02:17,277][123090] Updated weights for policy 1, policy_version 926143 (0.0005) [2023-12-26 07:02:17,577][123091] Updated weights for policy 0, policy_version 932823 (0.0010) [2023-12-26 07:02:17,640][123091] Updated weights for policy 0, policy_version 932833 (0.0010) [2023-12-26 07:02:17,706][123091] Updated weights for policy 0, policy_version 932843 (0.0010) [2023-12-26 07:02:17,922][123090] Updated weights for policy 1, policy_version 926153 (0.0008) [2023-12-26 07:02:17,972][123090] Updated weights for policy 1, policy_version 926163 (0.0009) [2023-12-26 07:02:18,032][123090] Updated weights for policy 1, policy_version 926173 (0.0010) [2023-12-26 07:02:18,390][123091] Updated weights for policy 0, policy_version 932853 (0.0008) [2023-12-26 07:02:18,449][123091] Updated weights for policy 0, policy_version 932863 (0.0008) [2023-12-26 07:02:18,514][123091] Updated weights for policy 0, policy_version 932873 (0.0013) [2023-12-26 07:02:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 475922432. Throughput: 0: 8965.5, 1: 8703.7. Samples: 475933716. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:18,785][121949] Avg episode reward: [(0, '6284.356'), (1, '5430.525')] [2023-12-26 07:02:18,982][123090] Updated weights for policy 1, policy_version 926183 (0.0009) [2023-12-26 07:02:19,050][123090] Updated weights for policy 1, policy_version 926193 (0.0009) [2023-12-26 07:02:19,118][123090] Updated weights for policy 1, policy_version 926203 (0.0009) [2023-12-26 07:02:19,318][123091] Updated weights for policy 0, policy_version 932883 (0.0010) [2023-12-26 07:02:19,391][123091] Updated weights for policy 0, policy_version 932893 (0.0008) [2023-12-26 07:02:19,462][123091] Updated weights for policy 0, policy_version 932903 (0.0006) [2023-12-26 07:02:19,954][123090] Updated weights for policy 1, policy_version 926213 (0.0009) [2023-12-26 07:02:20,025][123090] Updated weights for policy 1, policy_version 926223 (0.0008) [2023-12-26 07:02:20,083][123090] Updated weights for policy 1, policy_version 926233 (0.0009) [2023-12-26 07:02:20,240][123091] Updated weights for policy 0, policy_version 932913 (0.0007) [2023-12-26 07:02:20,295][123091] Updated weights for policy 0, policy_version 932923 (0.0010) [2023-12-26 07:02:20,361][123091] Updated weights for policy 0, policy_version 932933 (0.0009) [2023-12-26 07:02:20,411][123091] Updated weights for policy 0, policy_version 932943 (0.0010) [2023-12-26 07:02:20,905][123090] Updated weights for policy 1, policy_version 926243 (0.0008) [2023-12-26 07:02:20,971][123090] Updated weights for policy 1, policy_version 926253 (0.0006) [2023-12-26 07:02:21,042][123090] Updated weights for policy 1, policy_version 926263 (0.0008) [2023-12-26 07:02:21,296][123091] Updated weights for policy 0, policy_version 932953 (0.0011) [2023-12-26 07:02:21,357][123091] Updated weights for policy 0, policy_version 932963 (0.0011) [2023-12-26 07:02:21,426][123091] Updated weights for policy 0, policy_version 932973 (0.0010) [2023-12-26 07:02:21,901][123090] Updated weights for policy 1, policy_version 926273 (0.0009) [2023-12-26 07:02:21,963][123090] Updated weights for policy 1, policy_version 926283 (0.0009) [2023-12-26 07:02:22,033][123090] Updated weights for policy 1, policy_version 926293 (0.0010) [2023-12-26 07:02:22,108][123090] Updated weights for policy 1, policy_version 926303 (0.0011) [2023-12-26 07:02:22,224][123091] Updated weights for policy 0, policy_version 932983 (0.0007) [2023-12-26 07:02:22,289][123091] Updated weights for policy 0, policy_version 932993 (0.0006) [2023-12-26 07:02:22,358][123091] Updated weights for policy 0, policy_version 933003 (0.0008) [2023-12-26 07:02:22,920][123090] Updated weights for policy 1, policy_version 926313 (0.0011) [2023-12-26 07:02:22,989][123090] Updated weights for policy 1, policy_version 926323 (0.0011) [2023-12-26 07:02:23,047][123090] Updated weights for policy 1, policy_version 926333 (0.0007) [2023-12-26 07:02:23,200][123091] Updated weights for policy 0, policy_version 933013 (0.0008) [2023-12-26 07:02:23,254][123091] Updated weights for policy 0, policy_version 933023 (0.0010) [2023-12-26 07:02:23,312][123091] Updated weights for policy 0, policy_version 933033 (0.0010) [2023-12-26 07:02:23,715][123090] Updated weights for policy 1, policy_version 926343 (0.0009) [2023-12-26 07:02:23,767][123090] Updated weights for policy 1, policy_version 926353 (0.0006) [2023-12-26 07:02:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 476004352. Throughput: 0: 8897.1, 1: 8666.9. Samples: 475984380. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:23,785][121949] Avg episode reward: [(0, '6300.111'), (1, '5480.332')] [2023-12-26 07:02:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000933040_238862336.pth... [2023-12-26 07:02:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000932016_238600192.pth [2023-12-26 07:02:23,814][123090] Updated weights for policy 1, policy_version 926363 (0.0005) [2023-12-26 07:02:23,839][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000926368_237150208.pth... [2023-12-26 07:02:23,842][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000925312_236879872.pth [2023-12-26 07:02:24,101][123091] Updated weights for policy 0, policy_version 933043 (0.0010) [2023-12-26 07:02:24,153][123091] Updated weights for policy 0, policy_version 933053 (0.0008) [2023-12-26 07:02:24,218][123091] Updated weights for policy 0, policy_version 933063 (0.0009) [2023-12-26 07:02:24,677][123090] Updated weights for policy 1, policy_version 926373 (0.0007) [2023-12-26 07:02:24,745][123090] Updated weights for policy 1, policy_version 926383 (0.0009) [2023-12-26 07:02:24,812][123090] Updated weights for policy 1, policy_version 926393 (0.0010) [2023-12-26 07:02:24,932][123091] Updated weights for policy 0, policy_version 933073 (0.0010) [2023-12-26 07:02:24,987][123091] Updated weights for policy 0, policy_version 933083 (0.0009) [2023-12-26 07:02:25,038][123091] Updated weights for policy 0, policy_version 933093 (0.0009) [2023-12-26 07:02:25,094][123091] Updated weights for policy 0, policy_version 933103 (0.0009) [2023-12-26 07:02:25,540][123090] Updated weights for policy 1, policy_version 926403 (0.0010) [2023-12-26 07:02:25,602][123090] Updated weights for policy 1, policy_version 926413 (0.0010) [2023-12-26 07:02:25,672][123090] Updated weights for policy 1, policy_version 926423 (0.0010) [2023-12-26 07:02:25,713][123091] Updated weights for policy 0, policy_version 933113 (0.0005) [2023-12-26 07:02:25,765][123091] Updated weights for policy 0, policy_version 933123 (0.0005) [2023-12-26 07:02:25,821][123091] Updated weights for policy 0, policy_version 933133 (0.0005) [2023-12-26 07:02:26,435][123090] Updated weights for policy 1, policy_version 926433 (0.0010) [2023-12-26 07:02:26,505][123090] Updated weights for policy 1, policy_version 926443 (0.0006) [2023-12-26 07:02:26,526][123091] Updated weights for policy 0, policy_version 933143 (0.0008) [2023-12-26 07:02:26,573][123090] Updated weights for policy 1, policy_version 926453 (0.0008) [2023-12-26 07:02:26,581][123091] Updated weights for policy 0, policy_version 933153 (0.0007) [2023-12-26 07:02:26,627][123090] Updated weights for policy 1, policy_version 926463 (0.0007) [2023-12-26 07:02:26,637][123091] Updated weights for policy 0, policy_version 933163 (0.0009) [2023-12-26 07:02:27,368][123090] Updated weights for policy 1, policy_version 926473 (0.0006) [2023-12-26 07:02:27,438][123090] Updated weights for policy 1, policy_version 926483 (0.0005) [2023-12-26 07:02:27,500][123090] Updated weights for policy 1, policy_version 926493 (0.0005) [2023-12-26 07:02:27,502][123091] Updated weights for policy 0, policy_version 933173 (0.0008) [2023-12-26 07:02:27,554][123091] Updated weights for policy 0, policy_version 933183 (0.0010) [2023-12-26 07:02:27,615][123091] Updated weights for policy 0, policy_version 933193 (0.0009) [2023-12-26 07:02:28,169][123090] Updated weights for policy 1, policy_version 926503 (0.0005) [2023-12-26 07:02:28,218][123090] Updated weights for policy 1, policy_version 926513 (0.0005) [2023-12-26 07:02:28,266][123090] Updated weights for policy 1, policy_version 926523 (0.0007) [2023-12-26 07:02:28,495][123091] Updated weights for policy 0, policy_version 933203 (0.0009) [2023-12-26 07:02:28,560][123091] Updated weights for policy 0, policy_version 933213 (0.0010) [2023-12-26 07:02:28,621][123091] Updated weights for policy 0, policy_version 933223 (0.0009) [2023-12-26 07:02:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 476102656. Throughput: 0: 8910.1, 1: 8779.1. Samples: 476094020. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:28,785][121949] Avg episode reward: [(0, '6308.069'), (1, '5560.099')] [2023-12-26 07:02:29,069][123090] Updated weights for policy 1, policy_version 926533 (0.0010) [2023-12-26 07:02:29,119][123090] Updated weights for policy 1, policy_version 926543 (0.0010) [2023-12-26 07:02:29,166][123090] Updated weights for policy 1, policy_version 926553 (0.0010) [2023-12-26 07:02:29,469][123091] Updated weights for policy 0, policy_version 933233 (0.0009) [2023-12-26 07:02:29,526][123091] Updated weights for policy 0, policy_version 933243 (0.0009) [2023-12-26 07:02:29,586][123091] Updated weights for policy 0, policy_version 933253 (0.0009) [2023-12-26 07:02:29,639][123091] Updated weights for policy 0, policy_version 933263 (0.0009) [2023-12-26 07:02:29,990][123090] Updated weights for policy 1, policy_version 926563 (0.0009) [2023-12-26 07:02:30,049][123090] Updated weights for policy 1, policy_version 926573 (0.0005) [2023-12-26 07:02:30,109][123090] Updated weights for policy 1, policy_version 926583 (0.0005) [2023-12-26 07:02:30,406][123091] Updated weights for policy 0, policy_version 933273 (0.0006) [2023-12-26 07:02:30,461][123091] Updated weights for policy 0, policy_version 933283 (0.0005) [2023-12-26 07:02:30,521][123091] Updated weights for policy 0, policy_version 933293 (0.0005) [2023-12-26 07:02:30,704][123090] Updated weights for policy 1, policy_version 926593 (0.0006) [2023-12-26 07:02:30,771][123090] Updated weights for policy 1, policy_version 926603 (0.0010) [2023-12-26 07:02:30,822][123090] Updated weights for policy 1, policy_version 926613 (0.0010) [2023-12-26 07:02:30,873][123090] Updated weights for policy 1, policy_version 926623 (0.0010) [2023-12-26 07:02:31,256][123091] Updated weights for policy 0, policy_version 933303 (0.0006) [2023-12-26 07:02:31,317][123091] Updated weights for policy 0, policy_version 933313 (0.0006) [2023-12-26 07:02:31,388][123091] Updated weights for policy 0, policy_version 933323 (0.0009) [2023-12-26 07:02:31,719][123090] Updated weights for policy 1, policy_version 926633 (0.0006) [2023-12-26 07:02:31,786][123090] Updated weights for policy 1, policy_version 926643 (0.0007) [2023-12-26 07:02:31,843][123090] Updated weights for policy 1, policy_version 926653 (0.0005) [2023-12-26 07:02:32,187][123091] Updated weights for policy 0, policy_version 933333 (0.0010) [2023-12-26 07:02:32,245][123091] Updated weights for policy 0, policy_version 933343 (0.0007) [2023-12-26 07:02:32,306][123091] Updated weights for policy 0, policy_version 933353 (0.0008) [2023-12-26 07:02:32,601][123090] Updated weights for policy 1, policy_version 926663 (0.0009) [2023-12-26 07:02:32,652][123090] Updated weights for policy 1, policy_version 926673 (0.0010) [2023-12-26 07:02:32,711][123090] Updated weights for policy 1, policy_version 926683 (0.0010) [2023-12-26 07:02:33,043][123091] Updated weights for policy 0, policy_version 933363 (0.0006) [2023-12-26 07:02:33,095][123091] Updated weights for policy 0, policy_version 933373 (0.0010) [2023-12-26 07:02:33,138][123091] Updated weights for policy 0, policy_version 933383 (0.0010) [2023-12-26 07:02:33,514][123090] Updated weights for policy 1, policy_version 926693 (0.0008) [2023-12-26 07:02:33,578][123090] Updated weights for policy 1, policy_version 926703 (0.0007) [2023-12-26 07:02:33,631][123090] Updated weights for policy 1, policy_version 926713 (0.0008) [2023-12-26 07:02:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 476192768. Throughput: 0: 8848.4, 1: 8883.8. Samples: 476202760. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:33,785][121949] Avg episode reward: [(0, '6326.839'), (1, '5566.567')] [2023-12-26 07:02:33,951][123091] Updated weights for policy 0, policy_version 933393 (0.0010) [2023-12-26 07:02:34,011][123091] Updated weights for policy 0, policy_version 933403 (0.0006) [2023-12-26 07:02:34,073][123091] Updated weights for policy 0, policy_version 933413 (0.0009) [2023-12-26 07:02:34,120][123091] Updated weights for policy 0, policy_version 933423 (0.0010) [2023-12-26 07:02:34,415][123090] Updated weights for policy 1, policy_version 926723 (0.0009) [2023-12-26 07:02:34,475][123090] Updated weights for policy 1, policy_version 926733 (0.0011) [2023-12-26 07:02:34,547][123090] Updated weights for policy 1, policy_version 926743 (0.0011) [2023-12-26 07:02:34,870][123091] Updated weights for policy 0, policy_version 933433 (0.0009) [2023-12-26 07:02:34,939][123091] Updated weights for policy 0, policy_version 933443 (0.0005) [2023-12-26 07:02:35,001][123091] Updated weights for policy 0, policy_version 933453 (0.0005) [2023-12-26 07:02:35,240][123090] Updated weights for policy 1, policy_version 926753 (0.0010) [2023-12-26 07:02:35,288][123090] Updated weights for policy 1, policy_version 926763 (0.0005) [2023-12-26 07:02:35,343][123090] Updated weights for policy 1, policy_version 926773 (0.0005) [2023-12-26 07:02:35,398][123090] Updated weights for policy 1, policy_version 926783 (0.0005) [2023-12-26 07:02:35,646][123091] Updated weights for policy 0, policy_version 933463 (0.0005) [2023-12-26 07:02:35,704][123091] Updated weights for policy 0, policy_version 933473 (0.0006) [2023-12-26 07:02:35,775][123091] Updated weights for policy 0, policy_version 933483 (0.0006) [2023-12-26 07:02:36,075][123090] Updated weights for policy 1, policy_version 926793 (0.0005) [2023-12-26 07:02:36,135][123090] Updated weights for policy 1, policy_version 926803 (0.0007) [2023-12-26 07:02:36,196][123090] Updated weights for policy 1, policy_version 926813 (0.0006) [2023-12-26 07:02:36,588][123091] Updated weights for policy 0, policy_version 933493 (0.0011) [2023-12-26 07:02:36,642][123091] Updated weights for policy 0, policy_version 933503 (0.0010) [2023-12-26 07:02:36,694][123091] Updated weights for policy 0, policy_version 933513 (0.0011) [2023-12-26 07:02:36,836][123090] Updated weights for policy 1, policy_version 926823 (0.0008) [2023-12-26 07:02:36,901][123090] Updated weights for policy 1, policy_version 926833 (0.0009) [2023-12-26 07:02:36,963][123090] Updated weights for policy 1, policy_version 926843 (0.0010) [2023-12-26 07:02:37,545][123091] Updated weights for policy 0, policy_version 933523 (0.0011) [2023-12-26 07:02:37,605][123091] Updated weights for policy 0, policy_version 933533 (0.0011) [2023-12-26 07:02:37,672][123091] Updated weights for policy 0, policy_version 933543 (0.0011) [2023-12-26 07:02:37,692][123090] Updated weights for policy 1, policy_version 926853 (0.0008) [2023-12-26 07:02:37,757][123090] Updated weights for policy 1, policy_version 926863 (0.0010) [2023-12-26 07:02:37,820][123090] Updated weights for policy 1, policy_version 926873 (0.0010) [2023-12-26 07:02:38,482][123091] Updated weights for policy 0, policy_version 933553 (0.0010) [2023-12-26 07:02:38,513][123090] Updated weights for policy 1, policy_version 926883 (0.0006) [2023-12-26 07:02:38,547][123091] Updated weights for policy 0, policy_version 933563 (0.0007) [2023-12-26 07:02:38,571][123090] Updated weights for policy 1, policy_version 926893 (0.0008) [2023-12-26 07:02:38,610][123091] Updated weights for policy 0, policy_version 933573 (0.0009) [2023-12-26 07:02:38,630][123090] Updated weights for policy 1, policy_version 926903 (0.0008) [2023-12-26 07:02:38,669][123091] Updated weights for policy 0, policy_version 933583 (0.0007) [2023-12-26 07:02:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 476291072. Throughput: 0: 8920.9, 1: 8976.1. Samples: 476260172. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:38,785][121949] Avg episode reward: [(0, '6143.423'), (1, '5695.161')] [2023-12-26 07:02:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000926912_237289472.pth... [2023-12-26 07:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000933584_239001600.pth... [2023-12-26 07:02:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000932528_238731264.pth [2023-12-26 07:02:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000925856_237019136.pth [2023-12-26 07:02:39,450][123091] Updated weights for policy 0, policy_version 933593 (0.0008) [2023-12-26 07:02:39,499][123090] Updated weights for policy 1, policy_version 926913 (0.0009) [2023-12-26 07:02:39,509][123091] Updated weights for policy 0, policy_version 933603 (0.0008) [2023-12-26 07:02:39,564][123090] Updated weights for policy 1, policy_version 926923 (0.0006) [2023-12-26 07:02:39,569][123091] Updated weights for policy 0, policy_version 933613 (0.0008) [2023-12-26 07:02:39,640][123090] Updated weights for policy 1, policy_version 926933 (0.0006) [2023-12-26 07:02:39,707][123090] Updated weights for policy 1, policy_version 926943 (0.0010) [2023-12-26 07:02:40,336][123091] Updated weights for policy 0, policy_version 933623 (0.0007) [2023-12-26 07:02:40,402][123091] Updated weights for policy 0, policy_version 933633 (0.0009) [2023-12-26 07:02:40,468][123091] Updated weights for policy 0, policy_version 933643 (0.0010) [2023-12-26 07:02:40,506][123090] Updated weights for policy 1, policy_version 926953 (0.0008) [2023-12-26 07:02:40,560][123090] Updated weights for policy 1, policy_version 926963 (0.0009) [2023-12-26 07:02:40,621][123090] Updated weights for policy 1, policy_version 926973 (0.0009) [2023-12-26 07:02:41,270][123091] Updated weights for policy 0, policy_version 933653 (0.0009) [2023-12-26 07:02:41,326][123091] Updated weights for policy 0, policy_version 933663 (0.0006) [2023-12-26 07:02:41,403][123091] Updated weights for policy 0, policy_version 933673 (0.0009) [2023-12-26 07:02:41,492][123090] Updated weights for policy 1, policy_version 926983 (0.0006) [2023-12-26 07:02:41,559][123090] Updated weights for policy 1, policy_version 926993 (0.0006) [2023-12-26 07:02:41,626][123090] Updated weights for policy 1, policy_version 927003 (0.0008) [2023-12-26 07:02:42,256][123091] Updated weights for policy 0, policy_version 933683 (0.0009) [2023-12-26 07:02:42,316][123091] Updated weights for policy 0, policy_version 933693 (0.0009) [2023-12-26 07:02:42,376][123091] Updated weights for policy 0, policy_version 933703 (0.0010) [2023-12-26 07:02:42,433][123090] Updated weights for policy 1, policy_version 927013 (0.0008) [2023-12-26 07:02:42,498][123090] Updated weights for policy 1, policy_version 927023 (0.0008) [2023-12-26 07:02:42,567][123090] Updated weights for policy 1, policy_version 927033 (0.0005) [2023-12-26 07:02:43,210][123091] Updated weights for policy 0, policy_version 933713 (0.0007) [2023-12-26 07:02:43,267][123091] Updated weights for policy 0, policy_version 933723 (0.0009) [2023-12-26 07:02:43,321][123091] Updated weights for policy 0, policy_version 933733 (0.0009) [2023-12-26 07:02:43,373][123091] Updated weights for policy 0, policy_version 933743 (0.0009) [2023-12-26 07:02:43,396][123090] Updated weights for policy 1, policy_version 927043 (0.0010) [2023-12-26 07:02:43,458][123090] Updated weights for policy 1, policy_version 927053 (0.0009) [2023-12-26 07:02:43,517][123090] Updated weights for policy 1, policy_version 927063 (0.0009) [2023-12-26 07:02:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 476372992. Throughput: 0: 8959.5, 1: 8893.5. Samples: 476364512. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:43,784][121949] Avg episode reward: [(0, '6109.294'), (1, '5829.892')] [2023-12-26 07:02:44,198][123091] Updated weights for policy 0, policy_version 933753 (0.0009) [2023-12-26 07:02:44,248][123091] Updated weights for policy 0, policy_version 933763 (0.0009) [2023-12-26 07:02:44,297][123091] Updated weights for policy 0, policy_version 933773 (0.0009) [2023-12-26 07:02:44,340][123090] Updated weights for policy 1, policy_version 927073 (0.0009) [2023-12-26 07:02:44,395][123090] Updated weights for policy 1, policy_version 927083 (0.0008) [2023-12-26 07:02:44,456][123090] Updated weights for policy 1, policy_version 927093 (0.0009) [2023-12-26 07:02:44,525][123090] Updated weights for policy 1, policy_version 927103 (0.0009) [2023-12-26 07:02:45,160][123091] Updated weights for policy 0, policy_version 933783 (0.0009) [2023-12-26 07:02:45,214][123091] Updated weights for policy 0, policy_version 933793 (0.0010) [2023-12-26 07:02:45,276][123091] Updated weights for policy 0, policy_version 933803 (0.0009) [2023-12-26 07:02:45,363][123090] Updated weights for policy 1, policy_version 927113 (0.0009) [2023-12-26 07:02:45,430][123090] Updated weights for policy 1, policy_version 927123 (0.0009) [2023-12-26 07:02:45,492][123090] Updated weights for policy 1, policy_version 927133 (0.0010) [2023-12-26 07:02:46,124][123091] Updated weights for policy 0, policy_version 933813 (0.0009) [2023-12-26 07:02:46,180][123091] Updated weights for policy 0, policy_version 933823 (0.0009) [2023-12-26 07:02:46,244][123091] Updated weights for policy 0, policy_version 933833 (0.0009) [2023-12-26 07:02:46,316][123090] Updated weights for policy 1, policy_version 927143 (0.0010) [2023-12-26 07:02:46,374][123090] Updated weights for policy 1, policy_version 927153 (0.0010) [2023-12-26 07:02:46,424][123090] Updated weights for policy 1, policy_version 927163 (0.0010) [2023-12-26 07:02:47,127][123091] Updated weights for policy 0, policy_version 933843 (0.0009) [2023-12-26 07:02:47,171][123090] Updated weights for policy 1, policy_version 927173 (0.0007) [2023-12-26 07:02:47,186][123091] Updated weights for policy 0, policy_version 933853 (0.0011) [2023-12-26 07:02:47,230][123090] Updated weights for policy 1, policy_version 927183 (0.0005) [2023-12-26 07:02:47,233][123091] Updated weights for policy 0, policy_version 933863 (0.0010) [2023-12-26 07:02:47,283][123090] Updated weights for policy 1, policy_version 927193 (0.0006) [2023-12-26 07:02:47,949][123091] Updated weights for policy 0, policy_version 933873 (0.0010) [2023-12-26 07:02:48,010][123091] Updated weights for policy 0, policy_version 933883 (0.0006) [2023-12-26 07:02:48,059][123091] Updated weights for policy 0, policy_version 933893 (0.0005) [2023-12-26 07:02:48,110][123091] Updated weights for policy 0, policy_version 933903 (0.0007) [2023-12-26 07:02:48,143][123090] Updated weights for policy 1, policy_version 927203 (0.0008) [2023-12-26 07:02:48,209][123090] Updated weights for policy 1, policy_version 927213 (0.0006) [2023-12-26 07:02:48,264][123090] Updated weights for policy 1, policy_version 927223 (0.0005) [2023-12-26 07:02:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 476454912. Throughput: 0: 8866.8, 1: 8901.6. Samples: 476469368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:48,785][121949] Avg episode reward: [(0, '6163.225'), (1, '5781.888')] [2023-12-26 07:02:48,897][123091] Updated weights for policy 0, policy_version 933913 (0.0006) [2023-12-26 07:02:48,909][123090] Updated weights for policy 1, policy_version 927233 (0.0005) [2023-12-26 07:02:48,960][123091] Updated weights for policy 0, policy_version 933923 (0.0005) [2023-12-26 07:02:48,982][123090] Updated weights for policy 1, policy_version 927243 (0.0008) [2023-12-26 07:02:49,027][123091] Updated weights for policy 0, policy_version 933933 (0.0008) [2023-12-26 07:02:49,034][123090] Updated weights for policy 1, policy_version 927253 (0.0007) [2023-12-26 07:02:49,082][123090] Updated weights for policy 1, policy_version 927263 (0.0008) [2023-12-26 07:02:49,815][123091] Updated weights for policy 0, policy_version 933943 (0.0011) [2023-12-26 07:02:49,895][123091] Updated weights for policy 0, policy_version 933953 (0.0011) [2023-12-26 07:02:49,955][123090] Updated weights for policy 1, policy_version 927273 (0.0008) [2023-12-26 07:02:49,959][123091] Updated weights for policy 0, policy_version 933963 (0.0011) [2023-12-26 07:02:50,010][123090] Updated weights for policy 1, policy_version 927283 (0.0009) [2023-12-26 07:02:50,067][123090] Updated weights for policy 1, policy_version 927293 (0.0009) [2023-12-26 07:02:50,782][123091] Updated weights for policy 0, policy_version 933973 (0.0010) [2023-12-26 07:02:50,852][123091] Updated weights for policy 0, policy_version 933983 (0.0007) [2023-12-26 07:02:50,914][123090] Updated weights for policy 1, policy_version 927303 (0.0010) [2023-12-26 07:02:50,917][123091] Updated weights for policy 0, policy_version 933993 (0.0007) [2023-12-26 07:02:50,983][123090] Updated weights for policy 1, policy_version 927313 (0.0011) [2023-12-26 07:02:51,061][123090] Updated weights for policy 1, policy_version 927323 (0.0011) [2023-12-26 07:02:51,695][123091] Updated weights for policy 0, policy_version 934003 (0.0008) [2023-12-26 07:02:51,767][123091] Updated weights for policy 0, policy_version 934013 (0.0009) [2023-12-26 07:02:51,820][123091] Updated weights for policy 0, policy_version 934023 (0.0007) [2023-12-26 07:02:51,920][123090] Updated weights for policy 1, policy_version 927333 (0.0010) [2023-12-26 07:02:51,977][123090] Updated weights for policy 1, policy_version 927343 (0.0011) [2023-12-26 07:02:52,037][123090] Updated weights for policy 1, policy_version 927353 (0.0010) [2023-12-26 07:02:52,587][123091] Updated weights for policy 0, policy_version 934033 (0.0006) [2023-12-26 07:02:52,658][123091] Updated weights for policy 0, policy_version 934043 (0.0009) [2023-12-26 07:02:52,727][123091] Updated weights for policy 0, policy_version 934053 (0.0010) [2023-12-26 07:02:52,793][123091] Updated weights for policy 0, policy_version 934063 (0.0010) [2023-12-26 07:02:52,842][123090] Updated weights for policy 1, policy_version 927363 (0.0011) [2023-12-26 07:02:52,891][123090] Updated weights for policy 1, policy_version 927373 (0.0009) [2023-12-26 07:02:52,943][123090] Updated weights for policy 1, policy_version 927383 (0.0009) [2023-12-26 07:02:53,672][123091] Updated weights for policy 0, policy_version 934073 (0.0010) [2023-12-26 07:02:53,687][123090] Updated weights for policy 1, policy_version 927393 (0.0008) [2023-12-26 07:02:53,737][123091] Updated weights for policy 0, policy_version 934083 (0.0008) [2023-12-26 07:02:53,752][123090] Updated weights for policy 1, policy_version 927403 (0.0010) [2023-12-26 07:02:53,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 476536832. Throughput: 0: 8857.9, 1: 8898.4. Samples: 476521044. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:53,785][121949] Avg episode reward: [(0, '6104.130'), (1, '5837.178')] [2023-12-26 07:02:53,800][123091] Updated weights for policy 0, policy_version 934093 (0.0008) [2023-12-26 07:02:53,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000934096_239132672.pth... [2023-12-26 07:02:53,814][123090] Updated weights for policy 1, policy_version 927413 (0.0007) [2023-12-26 07:02:53,817][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000933040_238862336.pth [2023-12-26 07:02:53,874][123090] Updated weights for policy 1, policy_version 927423 (0.0005) [2023-12-26 07:02:53,880][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000927424_237420544.pth... [2023-12-26 07:02:53,884][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000926368_237150208.pth [2023-12-26 07:02:54,490][123091] Updated weights for policy 0, policy_version 934103 (0.0009) [2023-12-26 07:02:54,559][123091] Updated weights for policy 0, policy_version 934113 (0.0008) [2023-12-26 07:02:54,618][123091] Updated weights for policy 0, policy_version 934123 (0.0010) [2023-12-26 07:02:54,627][123090] Updated weights for policy 1, policy_version 927433 (0.0007) [2023-12-26 07:02:54,675][123090] Updated weights for policy 1, policy_version 927443 (0.0008) [2023-12-26 07:02:54,733][123090] Updated weights for policy 1, policy_version 927453 (0.0009) [2023-12-26 07:02:55,492][123091] Updated weights for policy 0, policy_version 934133 (0.0009) [2023-12-26 07:02:55,505][123090] Updated weights for policy 1, policy_version 927463 (0.0008) [2023-12-26 07:02:55,544][123091] Updated weights for policy 0, policy_version 934143 (0.0009) [2023-12-26 07:02:55,552][123090] Updated weights for policy 1, policy_version 927473 (0.0006) [2023-12-26 07:02:55,594][123091] Updated weights for policy 0, policy_version 934153 (0.0009) [2023-12-26 07:02:55,600][123090] Updated weights for policy 1, policy_version 927483 (0.0005) [2023-12-26 07:02:56,308][123090] Updated weights for policy 1, policy_version 927493 (0.0006) [2023-12-26 07:02:56,358][123090] Updated weights for policy 1, policy_version 927503 (0.0005) [2023-12-26 07:02:56,390][123091] Updated weights for policy 0, policy_version 934163 (0.0009) [2023-12-26 07:02:56,413][123090] Updated weights for policy 1, policy_version 927513 (0.0005) [2023-12-26 07:02:56,442][123091] Updated weights for policy 0, policy_version 934173 (0.0009) [2023-12-26 07:02:56,495][123091] Updated weights for policy 0, policy_version 934184 (0.0010) [2023-12-26 07:02:57,167][123090] Updated weights for policy 1, policy_version 927523 (0.0006) [2023-12-26 07:02:57,223][123090] Updated weights for policy 1, policy_version 927533 (0.0009) [2023-12-26 07:02:57,236][123091] Updated weights for policy 0, policy_version 934194 (0.0009) [2023-12-26 07:02:57,273][123090] Updated weights for policy 1, policy_version 927543 (0.0009) [2023-12-26 07:02:57,307][123091] Updated weights for policy 0, policy_version 934204 (0.0006) [2023-12-26 07:02:57,367][123091] Updated weights for policy 0, policy_version 934214 (0.0008) [2023-12-26 07:02:57,418][123091] Updated weights for policy 0, policy_version 934224 (0.0010) [2023-12-26 07:02:58,103][123091] Updated weights for policy 0, policy_version 934234 (0.0009) [2023-12-26 07:02:58,112][123090] Updated weights for policy 1, policy_version 927553 (0.0009) [2023-12-26 07:02:58,171][123091] Updated weights for policy 0, policy_version 934244 (0.0009) [2023-12-26 07:02:58,179][123090] Updated weights for policy 1, policy_version 927563 (0.0008) [2023-12-26 07:02:58,233][123091] Updated weights for policy 0, policy_version 934254 (0.0009) [2023-12-26 07:02:58,237][123090] Updated weights for policy 1, policy_version 927573 (0.0007) [2023-12-26 07:02:58,302][123090] Updated weights for policy 1, policy_version 927583 (0.0009) [2023-12-26 07:02:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 476635136. Throughput: 0: 8901.5, 1: 8989.5. Samples: 476630000. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:02:58,784][121949] Avg episode reward: [(0, '6291.277'), (1, '5743.202')] [2023-12-26 07:02:59,111][123090] Updated weights for policy 1, policy_version 927593 (0.0008) [2023-12-26 07:02:59,124][123091] Updated weights for policy 0, policy_version 934264 (0.0009) [2023-12-26 07:02:59,179][123090] Updated weights for policy 1, policy_version 927603 (0.0008) [2023-12-26 07:02:59,208][123091] Updated weights for policy 0, policy_version 934274 (0.0008) [2023-12-26 07:02:59,261][123090] Updated weights for policy 1, policy_version 927613 (0.0009) [2023-12-26 07:02:59,281][123091] Updated weights for policy 0, policy_version 934284 (0.0008) [2023-12-26 07:02:59,996][123091] Updated weights for policy 0, policy_version 934294 (0.0009) [2023-12-26 07:03:00,052][123091] Updated weights for policy 0, policy_version 934304 (0.0009) [2023-12-26 07:03:00,108][123091] Updated weights for policy 0, policy_version 934314 (0.0008) [2023-12-26 07:03:00,139][123090] Updated weights for policy 1, policy_version 927623 (0.0008) [2023-12-26 07:03:00,216][123090] Updated weights for policy 1, policy_version 927633 (0.0009) [2023-12-26 07:03:00,291][123090] Updated weights for policy 1, policy_version 927643 (0.0009) [2023-12-26 07:03:00,895][123090] Updated weights for policy 1, policy_version 927653 (0.0005) [2023-12-26 07:03:00,943][123091] Updated weights for policy 0, policy_version 934324 (0.0007) [2023-12-26 07:03:00,961][123090] Updated weights for policy 1, policy_version 927663 (0.0005) [2023-12-26 07:03:00,991][123091] Updated weights for policy 0, policy_version 934334 (0.0009) [2023-12-26 07:03:01,024][123090] Updated weights for policy 1, policy_version 927673 (0.0005) [2023-12-26 07:03:01,042][123091] Updated weights for policy 0, policy_version 934344 (0.0009) [2023-12-26 07:03:01,840][123090] Updated weights for policy 1, policy_version 927683 (0.0008) [2023-12-26 07:03:01,841][123091] Updated weights for policy 0, policy_version 934354 (0.0009) [2023-12-26 07:03:01,888][123090] Updated weights for policy 1, policy_version 927693 (0.0007) [2023-12-26 07:03:01,907][123091] Updated weights for policy 0, policy_version 934364 (0.0009) [2023-12-26 07:03:01,941][123090] Updated weights for policy 1, policy_version 927703 (0.0006) [2023-12-26 07:03:01,955][123091] Updated weights for policy 0, policy_version 934374 (0.0008) [2023-12-26 07:03:02,652][123090] Updated weights for policy 1, policy_version 927713 (0.0005) [2023-12-26 07:03:02,705][123090] Updated weights for policy 1, policy_version 927723 (0.0005) [2023-12-26 07:03:02,767][123090] Updated weights for policy 1, policy_version 927733 (0.0008) [2023-12-26 07:03:02,826][123090] Updated weights for policy 1, policy_version 927743 (0.0009) [2023-12-26 07:03:02,838][123091] Updated weights for policy 0, policy_version 934385 (0.0008) [2023-12-26 07:03:02,899][123091] Updated weights for policy 0, policy_version 934395 (0.0010) [2023-12-26 07:03:02,959][123091] Updated weights for policy 0, policy_version 934405 (0.0009) [2023-12-26 07:03:03,014][123091] Updated weights for policy 0, policy_version 934415 (0.0007) [2023-12-26 07:03:03,675][123090] Updated weights for policy 1, policy_version 927753 (0.0006) [2023-12-26 07:03:03,714][123091] Updated weights for policy 0, policy_version 934425 (0.0006) [2023-12-26 07:03:03,727][123090] Updated weights for policy 1, policy_version 927763 (0.0005) [2023-12-26 07:03:03,775][123091] Updated weights for policy 0, policy_version 934435 (0.0005) [2023-12-26 07:03:03,778][123090] Updated weights for policy 1, policy_version 927773 (0.0005) [2023-12-26 07:03:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 476717056. Throughput: 0: 8861.2, 1: 8975.4. Samples: 476736360. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:03,785][121949] Avg episode reward: [(0, '6353.166'), (1, '5729.777')] [2023-12-26 07:03:03,841][123091] Updated weights for policy 0, policy_version 934445 (0.0010) [2023-12-26 07:03:04,577][123090] Updated weights for policy 1, policy_version 927783 (0.0010) [2023-12-26 07:03:04,624][123091] Updated weights for policy 0, policy_version 934455 (0.0010) [2023-12-26 07:03:04,624][123090] Updated weights for policy 1, policy_version 927793 (0.0010) [2023-12-26 07:03:04,687][123090] Updated weights for policy 1, policy_version 927803 (0.0010) [2023-12-26 07:03:04,690][123091] Updated weights for policy 0, policy_version 934465 (0.0011) [2023-12-26 07:03:04,752][123091] Updated weights for policy 0, policy_version 934475 (0.0010) [2023-12-26 07:03:05,515][123090] Updated weights for policy 1, policy_version 927813 (0.0010) [2023-12-26 07:03:05,532][123091] Updated weights for policy 0, policy_version 934485 (0.0010) [2023-12-26 07:03:05,574][123090] Updated weights for policy 1, policy_version 927823 (0.0010) [2023-12-26 07:03:05,594][123091] Updated weights for policy 0, policy_version 934495 (0.0011) [2023-12-26 07:03:05,636][123090] Updated weights for policy 1, policy_version 927833 (0.0010) [2023-12-26 07:03:05,656][123091] Updated weights for policy 0, policy_version 934505 (0.0010) [2023-12-26 07:03:06,437][123090] Updated weights for policy 1, policy_version 927843 (0.0009) [2023-12-26 07:03:06,457][123091] Updated weights for policy 0, policy_version 934515 (0.0010) [2023-12-26 07:03:06,503][123090] Updated weights for policy 1, policy_version 927853 (0.0009) [2023-12-26 07:03:06,523][123091] Updated weights for policy 0, policy_version 934525 (0.0008) [2023-12-26 07:03:06,569][123090] Updated weights for policy 1, policy_version 927863 (0.0008) [2023-12-26 07:03:06,587][123091] Updated weights for policy 0, policy_version 934535 (0.0008) [2023-12-26 07:03:07,272][123090] Updated weights for policy 1, policy_version 927873 (0.0009) [2023-12-26 07:03:07,286][123091] Updated weights for policy 0, policy_version 934545 (0.0008) [2023-12-26 07:03:07,335][123091] Updated weights for policy 0, policy_version 934555 (0.0006) [2023-12-26 07:03:07,341][123090] Updated weights for policy 1, policy_version 927883 (0.0008) [2023-12-26 07:03:07,381][123091] Updated weights for policy 0, policy_version 934565 (0.0005) [2023-12-26 07:03:07,410][123090] Updated weights for policy 1, policy_version 927893 (0.0008) [2023-12-26 07:03:07,427][123091] Updated weights for policy 0, policy_version 934575 (0.0006) [2023-12-26 07:03:07,475][123090] Updated weights for policy 1, policy_version 927903 (0.0008) [2023-12-26 07:03:08,104][123091] Updated weights for policy 0, policy_version 934585 (0.0008) [2023-12-26 07:03:08,126][123090] Updated weights for policy 1, policy_version 927913 (0.0005) [2023-12-26 07:03:08,159][123091] Updated weights for policy 0, policy_version 934595 (0.0010) [2023-12-26 07:03:08,187][123090] Updated weights for policy 1, policy_version 927923 (0.0005) [2023-12-26 07:03:08,207][123091] Updated weights for policy 0, policy_version 934605 (0.0009) [2023-12-26 07:03:08,256][123090] Updated weights for policy 1, policy_version 927933 (0.0005) [2023-12-26 07:03:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 476815360. Throughput: 0: 8878.1, 1: 8997.6. Samples: 476788784. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:08,785][121949] Avg episode reward: [(0, '6353.906'), (1, '5749.752')] [2023-12-26 07:03:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000934608_239263744.pth... [2023-12-26 07:03:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000927936_237551616.pth... [2023-12-26 07:03:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000933584_239001600.pth [2023-12-26 07:03:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000926912_237289472.pth [2023-12-26 07:03:08,993][123090] Updated weights for policy 1, policy_version 927943 (0.0006) [2023-12-26 07:03:09,051][123090] Updated weights for policy 1, policy_version 927953 (0.0009) [2023-12-26 07:03:09,110][123091] Updated weights for policy 0, policy_version 934615 (0.0009) [2023-12-26 07:03:09,115][123090] Updated weights for policy 1, policy_version 927963 (0.0009) [2023-12-26 07:03:09,163][123091] Updated weights for policy 0, policy_version 934625 (0.0010) [2023-12-26 07:03:09,217][123091] Updated weights for policy 0, policy_version 934635 (0.0009) [2023-12-26 07:03:09,907][123090] Updated weights for policy 1, policy_version 927973 (0.0007) [2023-12-26 07:03:09,981][123090] Updated weights for policy 1, policy_version 927983 (0.0008) [2023-12-26 07:03:10,047][123090] Updated weights for policy 1, policy_version 927993 (0.0008) [2023-12-26 07:03:10,114][123091] Updated weights for policy 0, policy_version 934645 (0.0009) [2023-12-26 07:03:10,163][123091] Updated weights for policy 0, policy_version 934655 (0.0006) [2023-12-26 07:03:10,223][123091] Updated weights for policy 0, policy_version 934665 (0.0006) [2023-12-26 07:03:10,737][123090] Updated weights for policy 1, policy_version 928003 (0.0007) [2023-12-26 07:03:10,806][123090] Updated weights for policy 1, policy_version 928013 (0.0005) [2023-12-26 07:03:10,872][123090] Updated weights for policy 1, policy_version 928023 (0.0007) [2023-12-26 07:03:11,167][123091] Updated weights for policy 0, policy_version 934675 (0.0009) [2023-12-26 07:03:11,227][123091] Updated weights for policy 0, policy_version 934685 (0.0010) [2023-12-26 07:03:11,287][123091] Updated weights for policy 0, policy_version 934695 (0.0010) [2023-12-26 07:03:11,652][123090] Updated weights for policy 1, policy_version 928033 (0.0007) [2023-12-26 07:03:11,722][123090] Updated weights for policy 1, policy_version 928043 (0.0007) [2023-12-26 07:03:11,795][123090] Updated weights for policy 1, policy_version 928053 (0.0009) [2023-12-26 07:03:11,855][123090] Updated weights for policy 1, policy_version 928063 (0.0010) [2023-12-26 07:03:12,177][123091] Updated weights for policy 0, policy_version 934705 (0.0010) [2023-12-26 07:03:12,244][123091] Updated weights for policy 0, policy_version 934715 (0.0010) [2023-12-26 07:03:12,309][123091] Updated weights for policy 0, policy_version 934725 (0.0010) [2023-12-26 07:03:12,379][123091] Updated weights for policy 0, policy_version 934735 (0.0011) [2023-12-26 07:03:12,602][123090] Updated weights for policy 1, policy_version 928073 (0.0010) [2023-12-26 07:03:12,664][123090] Updated weights for policy 1, policy_version 928083 (0.0010) [2023-12-26 07:03:12,727][123090] Updated weights for policy 1, policy_version 928093 (0.0010) [2023-12-26 07:03:13,232][123091] Updated weights for policy 0, policy_version 934745 (0.0008) [2023-12-26 07:03:13,285][123091] Updated weights for policy 0, policy_version 934755 (0.0010) [2023-12-26 07:03:13,334][123091] Updated weights for policy 0, policy_version 934765 (0.0009) [2023-12-26 07:03:13,583][123090] Updated weights for policy 1, policy_version 928103 (0.0010) [2023-12-26 07:03:13,638][123090] Updated weights for policy 1, policy_version 928113 (0.0010) [2023-12-26 07:03:13,689][123090] Updated weights for policy 1, policy_version 928123 (0.0010) [2023-12-26 07:03:13,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 476905472. Throughput: 0: 8797.5, 1: 9021.2. Samples: 476895860. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:13,785][121949] Avg episode reward: [(0, '6325.496'), (1, '5616.037')] [2023-12-26 07:03:14,212][123091] Updated weights for policy 0, policy_version 934775 (0.0010) [2023-12-26 07:03:14,273][123091] Updated weights for policy 0, policy_version 934785 (0.0009) [2023-12-26 07:03:14,332][123091] Updated weights for policy 0, policy_version 934795 (0.0010) [2023-12-26 07:03:14,426][123090] Updated weights for policy 1, policy_version 928133 (0.0008) [2023-12-26 07:03:14,480][123090] Updated weights for policy 1, policy_version 928143 (0.0009) [2023-12-26 07:03:14,531][123090] Updated weights for policy 1, policy_version 928153 (0.0010) [2023-12-26 07:03:15,233][123091] Updated weights for policy 0, policy_version 934805 (0.0010) [2023-12-26 07:03:15,298][123091] Updated weights for policy 0, policy_version 934815 (0.0009) [2023-12-26 07:03:15,300][123090] Updated weights for policy 1, policy_version 928163 (0.0010) [2023-12-26 07:03:15,359][123091] Updated weights for policy 0, policy_version 934825 (0.0006) [2023-12-26 07:03:15,363][123090] Updated weights for policy 1, policy_version 928173 (0.0010) [2023-12-26 07:03:15,416][123090] Updated weights for policy 1, policy_version 928183 (0.0005) [2023-12-26 07:03:16,115][123090] Updated weights for policy 1, policy_version 928193 (0.0005) [2023-12-26 07:03:16,177][123090] Updated weights for policy 1, policy_version 928203 (0.0005) [2023-12-26 07:03:16,225][123090] Updated weights for policy 1, policy_version 928213 (0.0005) [2023-12-26 07:03:16,281][123090] Updated weights for policy 1, policy_version 928223 (0.0005) [2023-12-26 07:03:16,286][123091] Updated weights for policy 0, policy_version 934835 (0.0009) [2023-12-26 07:03:16,343][123091] Updated weights for policy 0, policy_version 934845 (0.0010) [2023-12-26 07:03:16,397][123091] Updated weights for policy 0, policy_version 934855 (0.0010) [2023-12-26 07:03:17,039][123090] Updated weights for policy 1, policy_version 928233 (0.0007) [2023-12-26 07:03:17,120][123090] Updated weights for policy 1, policy_version 928243 (0.0006) [2023-12-26 07:03:17,186][123090] Updated weights for policy 1, policy_version 928253 (0.0006) [2023-12-26 07:03:17,211][123091] Updated weights for policy 0, policy_version 934865 (0.0009) [2023-12-26 07:03:17,269][123091] Updated weights for policy 0, policy_version 934875 (0.0010) [2023-12-26 07:03:17,328][123091] Updated weights for policy 0, policy_version 934885 (0.0010) [2023-12-26 07:03:17,375][123091] Updated weights for policy 0, policy_version 934895 (0.0010) [2023-12-26 07:03:17,892][123090] Updated weights for policy 1, policy_version 928263 (0.0007) [2023-12-26 07:03:17,967][123090] Updated weights for policy 1, policy_version 928273 (0.0005) [2023-12-26 07:03:18,033][123090] Updated weights for policy 1, policy_version 928283 (0.0006) [2023-12-26 07:03:18,158][123091] Updated weights for policy 0, policy_version 934905 (0.0010) [2023-12-26 07:03:18,206][123091] Updated weights for policy 0, policy_version 934915 (0.0008) [2023-12-26 07:03:18,267][123091] Updated weights for policy 0, policy_version 934925 (0.0009) [2023-12-26 07:03:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 476987392. Throughput: 0: 8734.2, 1: 9045.3. Samples: 477002836. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:18,785][121949] Avg episode reward: [(0, '6342.046'), (1, '5602.213')] [2023-12-26 07:03:18,840][123090] Updated weights for policy 1, policy_version 928293 (0.0005) [2023-12-26 07:03:18,908][123090] Updated weights for policy 1, policy_version 928303 (0.0005) [2023-12-26 07:03:18,976][123090] Updated weights for policy 1, policy_version 928313 (0.0008) [2023-12-26 07:03:19,097][123091] Updated weights for policy 0, policy_version 934935 (0.0009) [2023-12-26 07:03:19,160][123091] Updated weights for policy 0, policy_version 934945 (0.0010) [2023-12-26 07:03:19,227][123091] Updated weights for policy 0, policy_version 934955 (0.0010) [2023-12-26 07:03:19,687][123090] Updated weights for policy 1, policy_version 928323 (0.0006) [2023-12-26 07:03:19,758][123090] Updated weights for policy 1, policy_version 928333 (0.0007) [2023-12-26 07:03:19,830][123090] Updated weights for policy 1, policy_version 928343 (0.0010) [2023-12-26 07:03:20,071][123091] Updated weights for policy 0, policy_version 934965 (0.0010) [2023-12-26 07:03:20,137][123091] Updated weights for policy 0, policy_version 934975 (0.0013) [2023-12-26 07:03:20,193][123091] Updated weights for policy 0, policy_version 934985 (0.0011) [2023-12-26 07:03:20,556][123090] Updated weights for policy 1, policy_version 928353 (0.0009) [2023-12-26 07:03:20,633][123090] Updated weights for policy 1, policy_version 928363 (0.0008) [2023-12-26 07:03:20,696][123090] Updated weights for policy 1, policy_version 928373 (0.0008) [2023-12-26 07:03:20,759][123090] Updated weights for policy 1, policy_version 928383 (0.0008) [2023-12-26 07:03:20,971][123091] Updated weights for policy 0, policy_version 934995 (0.0011) [2023-12-26 07:03:21,037][123091] Updated weights for policy 0, policy_version 935005 (0.0010) [2023-12-26 07:03:21,100][123091] Updated weights for policy 0, policy_version 935015 (0.0011) [2023-12-26 07:03:21,640][123090] Updated weights for policy 1, policy_version 928393 (0.0009) [2023-12-26 07:03:21,707][123090] Updated weights for policy 1, policy_version 928403 (0.0008) [2023-12-26 07:03:21,773][123090] Updated weights for policy 1, policy_version 928413 (0.0008) [2023-12-26 07:03:21,912][123091] Updated weights for policy 0, policy_version 935025 (0.0011) [2023-12-26 07:03:21,976][123091] Updated weights for policy 0, policy_version 935035 (0.0011) [2023-12-26 07:03:22,048][123091] Updated weights for policy 0, policy_version 935045 (0.0011) [2023-12-26 07:03:22,104][123091] Updated weights for policy 0, policy_version 935055 (0.0011) [2023-12-26 07:03:22,625][123090] Updated weights for policy 1, policy_version 928423 (0.0009) [2023-12-26 07:03:22,690][123090] Updated weights for policy 1, policy_version 928433 (0.0009) [2023-12-26 07:03:22,755][123090] Updated weights for policy 1, policy_version 928443 (0.0009) [2023-12-26 07:03:22,956][123091] Updated weights for policy 0, policy_version 935065 (0.0011) [2023-12-26 07:03:23,015][123091] Updated weights for policy 0, policy_version 935075 (0.0010) [2023-12-26 07:03:23,078][123091] Updated weights for policy 0, policy_version 935085 (0.0010) [2023-12-26 07:03:23,583][123090] Updated weights for policy 1, policy_version 928453 (0.0009) [2023-12-26 07:03:23,632][123090] Updated weights for policy 1, policy_version 928463 (0.0009) [2023-12-26 07:03:23,688][123090] Updated weights for policy 1, policy_version 928473 (0.0008) [2023-12-26 07:03:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 477077504. Throughput: 0: 8673.3, 1: 8993.2. Samples: 477055160. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:23,785][121949] Avg episode reward: [(0, '6306.946'), (1, '5663.400')] [2023-12-26 07:03:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000935088_239386624.pth... [2023-12-26 07:03:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000928480_237690880.pth... [2023-12-26 07:03:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000934096_239132672.pth [2023-12-26 07:03:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000927424_237420544.pth [2023-12-26 07:03:23,904][123091] Updated weights for policy 0, policy_version 935095 (0.0010) [2023-12-26 07:03:23,960][123091] Updated weights for policy 0, policy_version 935105 (0.0011) [2023-12-26 07:03:24,023][123091] Updated weights for policy 0, policy_version 935115 (0.0011) [2023-12-26 07:03:24,559][123090] Updated weights for policy 1, policy_version 928483 (0.0009) [2023-12-26 07:03:24,620][123090] Updated weights for policy 1, policy_version 928493 (0.0009) [2023-12-26 07:03:24,675][123090] Updated weights for policy 1, policy_version 928503 (0.0009) [2023-12-26 07:03:24,853][123091] Updated weights for policy 0, policy_version 935125 (0.0011) [2023-12-26 07:03:24,923][123091] Updated weights for policy 0, policy_version 935135 (0.0010) [2023-12-26 07:03:24,985][123091] Updated weights for policy 0, policy_version 935145 (0.0010) [2023-12-26 07:03:25,514][123090] Updated weights for policy 1, policy_version 928513 (0.0009) [2023-12-26 07:03:25,575][123090] Updated weights for policy 1, policy_version 928523 (0.0009) [2023-12-26 07:03:25,636][123090] Updated weights for policy 1, policy_version 928534 (0.0010) [2023-12-26 07:03:25,691][123090] Updated weights for policy 1, policy_version 928544 (0.0010) [2023-12-26 07:03:25,737][123091] Updated weights for policy 0, policy_version 935155 (0.0010) [2023-12-26 07:03:25,801][123091] Updated weights for policy 0, policy_version 935165 (0.0009) [2023-12-26 07:03:25,875][123091] Updated weights for policy 0, policy_version 935175 (0.0005) [2023-12-26 07:03:26,572][123090] Updated weights for policy 1, policy_version 928554 (0.0009) [2023-12-26 07:03:26,624][123091] Updated weights for policy 0, policy_version 935185 (0.0009) [2023-12-26 07:03:26,625][123090] Updated weights for policy 1, policy_version 928564 (0.0009) [2023-12-26 07:03:26,670][123090] Updated weights for policy 1, policy_version 928574 (0.0007) [2023-12-26 07:03:26,672][123091] Updated weights for policy 0, policy_version 935195 (0.0008) [2023-12-26 07:03:26,729][123091] Updated weights for policy 0, policy_version 935205 (0.0008) [2023-12-26 07:03:26,784][123091] Updated weights for policy 0, policy_version 935215 (0.0009) [2023-12-26 07:03:27,532][123090] Updated weights for policy 1, policy_version 928584 (0.0008) [2023-12-26 07:03:27,556][123091] Updated weights for policy 0, policy_version 935225 (0.0008) [2023-12-26 07:03:27,580][123090] Updated weights for policy 1, policy_version 928594 (0.0007) [2023-12-26 07:03:27,614][123091] Updated weights for policy 0, policy_version 935235 (0.0007) [2023-12-26 07:03:27,634][123090] Updated weights for policy 1, policy_version 928604 (0.0009) [2023-12-26 07:03:27,678][123091] Updated weights for policy 0, policy_version 935245 (0.0009) [2023-12-26 07:03:28,457][123091] Updated weights for policy 0, policy_version 935255 (0.0007) [2023-12-26 07:03:28,497][123090] Updated weights for policy 1, policy_version 928614 (0.0007) [2023-12-26 07:03:28,512][123091] Updated weights for policy 0, policy_version 935265 (0.0009) [2023-12-26 07:03:28,560][123090] Updated weights for policy 1, policy_version 928624 (0.0009) [2023-12-26 07:03:28,561][123091] Updated weights for policy 0, policy_version 935275 (0.0008) [2023-12-26 07:03:28,617][123090] Updated weights for policy 1, policy_version 928634 (0.0008) [2023-12-26 07:03:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 477167616. Throughput: 0: 8695.6, 1: 8919.4. Samples: 477157188. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:28,785][121949] Avg episode reward: [(0, '6279.669'), (1, '5643.234')] [2023-12-26 07:03:29,285][123090] Updated weights for policy 1, policy_version 928644 (0.0010) [2023-12-26 07:03:29,357][123090] Updated weights for policy 1, policy_version 928654 (0.0008) [2023-12-26 07:03:29,417][123090] Updated weights for policy 1, policy_version 928664 (0.0009) [2023-12-26 07:03:29,441][123091] Updated weights for policy 0, policy_version 935285 (0.0010) [2023-12-26 07:03:29,508][123091] Updated weights for policy 0, policy_version 935295 (0.0011) [2023-12-26 07:03:29,576][123091] Updated weights for policy 0, policy_version 935305 (0.0011) [2023-12-26 07:03:30,283][123090] Updated weights for policy 1, policy_version 928674 (0.0006) [2023-12-26 07:03:30,344][123091] Updated weights for policy 0, policy_version 935315 (0.0009) [2023-12-26 07:03:30,350][123090] Updated weights for policy 1, policy_version 928684 (0.0010) [2023-12-26 07:03:30,408][123091] Updated weights for policy 0, policy_version 935325 (0.0005) [2023-12-26 07:03:30,410][123090] Updated weights for policy 1, policy_version 928694 (0.0010) [2023-12-26 07:03:30,472][123091] Updated weights for policy 0, policy_version 935335 (0.0007) [2023-12-26 07:03:30,476][123090] Updated weights for policy 1, policy_version 928704 (0.0010) [2023-12-26 07:03:31,100][123091] Updated weights for policy 0, policy_version 935345 (0.0006) [2023-12-26 07:03:31,164][123091] Updated weights for policy 0, policy_version 935355 (0.0008) [2023-12-26 07:03:31,170][123090] Updated weights for policy 1, policy_version 928714 (0.0011) [2023-12-26 07:03:31,220][123091] Updated weights for policy 0, policy_version 935365 (0.0006) [2023-12-26 07:03:31,234][123090] Updated weights for policy 1, policy_version 928724 (0.0010) [2023-12-26 07:03:31,276][123091] Updated weights for policy 0, policy_version 935375 (0.0007) [2023-12-26 07:03:31,299][123090] Updated weights for policy 1, policy_version 928734 (0.0011) [2023-12-26 07:03:32,088][123091] Updated weights for policy 0, policy_version 935385 (0.0008) [2023-12-26 07:03:32,127][123090] Updated weights for policy 1, policy_version 928744 (0.0010) [2023-12-26 07:03:32,147][123091] Updated weights for policy 0, policy_version 935395 (0.0007) [2023-12-26 07:03:32,183][123090] Updated weights for policy 1, policy_version 928754 (0.0010) [2023-12-26 07:03:32,202][123091] Updated weights for policy 0, policy_version 935405 (0.0007) [2023-12-26 07:03:32,227][123090] Updated weights for policy 1, policy_version 928764 (0.0010) [2023-12-26 07:03:33,049][123091] Updated weights for policy 0, policy_version 935415 (0.0010) [2023-12-26 07:03:33,073][123090] Updated weights for policy 1, policy_version 928774 (0.0009) [2023-12-26 07:03:33,102][123091] Updated weights for policy 0, policy_version 935425 (0.0011) [2023-12-26 07:03:33,140][123090] Updated weights for policy 1, policy_version 928784 (0.0006) [2023-12-26 07:03:33,167][123091] Updated weights for policy 0, policy_version 935435 (0.0007) [2023-12-26 07:03:33,207][123090] Updated weights for policy 1, policy_version 928794 (0.0008) [2023-12-26 07:03:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 477249536. Throughput: 0: 8748.2, 1: 8926.7. Samples: 477264736. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:33,784][121949] Avg episode reward: [(0, '6351.404'), (1, '5483.960')] [2023-12-26 07:03:33,805][123091] Updated weights for policy 0, policy_version 935445 (0.0005) [2023-12-26 07:03:33,862][123091] Updated weights for policy 0, policy_version 935455 (0.0005) [2023-12-26 07:03:33,924][123091] Updated weights for policy 0, policy_version 935465 (0.0007) [2023-12-26 07:03:33,934][123090] Updated weights for policy 1, policy_version 928804 (0.0007) [2023-12-26 07:03:34,000][123090] Updated weights for policy 1, policy_version 928814 (0.0010) [2023-12-26 07:03:34,065][123090] Updated weights for policy 1, policy_version 928824 (0.0010) [2023-12-26 07:03:34,624][123091] Updated weights for policy 0, policy_version 935475 (0.0005) [2023-12-26 07:03:34,699][123091] Updated weights for policy 0, policy_version 935485 (0.0006) [2023-12-26 07:03:34,774][123091] Updated weights for policy 0, policy_version 935495 (0.0006) [2023-12-26 07:03:34,884][123090] Updated weights for policy 1, policy_version 928834 (0.0010) [2023-12-26 07:03:34,936][123090] Updated weights for policy 1, policy_version 928844 (0.0009) [2023-12-26 07:03:34,994][123090] Updated weights for policy 1, policy_version 928854 (0.0009) [2023-12-26 07:03:35,061][123090] Updated weights for policy 1, policy_version 928864 (0.0009) [2023-12-26 07:03:35,452][123091] Updated weights for policy 0, policy_version 935505 (0.0006) [2023-12-26 07:03:35,501][123091] Updated weights for policy 0, policy_version 935515 (0.0009) [2023-12-26 07:03:35,557][123091] Updated weights for policy 0, policy_version 935525 (0.0009) [2023-12-26 07:03:35,609][123091] Updated weights for policy 0, policy_version 935535 (0.0010) [2023-12-26 07:03:35,918][123090] Updated weights for policy 1, policy_version 928874 (0.0010) [2023-12-26 07:03:35,978][123090] Updated weights for policy 1, policy_version 928884 (0.0010) [2023-12-26 07:03:36,026][123090] Updated weights for policy 1, policy_version 928894 (0.0009) [2023-12-26 07:03:36,482][123091] Updated weights for policy 0, policy_version 935545 (0.0010) [2023-12-26 07:03:36,545][123091] Updated weights for policy 0, policy_version 935555 (0.0010) [2023-12-26 07:03:36,604][123091] Updated weights for policy 0, policy_version 935565 (0.0009) [2023-12-26 07:03:36,892][123090] Updated weights for policy 1, policy_version 928904 (0.0010) [2023-12-26 07:03:36,949][123090] Updated weights for policy 1, policy_version 928914 (0.0010) [2023-12-26 07:03:36,999][123090] Updated weights for policy 1, policy_version 928924 (0.0010) [2023-12-26 07:03:37,459][123091] Updated weights for policy 0, policy_version 935575 (0.0009) [2023-12-26 07:03:37,524][123091] Updated weights for policy 0, policy_version 935585 (0.0009) [2023-12-26 07:03:37,584][123091] Updated weights for policy 0, policy_version 935595 (0.0009) [2023-12-26 07:03:37,803][123090] Updated weights for policy 1, policy_version 928934 (0.0010) [2023-12-26 07:03:37,865][123090] Updated weights for policy 1, policy_version 928944 (0.0010) [2023-12-26 07:03:37,920][123090] Updated weights for policy 1, policy_version 928954 (0.0010) [2023-12-26 07:03:38,428][123091] Updated weights for policy 0, policy_version 935605 (0.0009) [2023-12-26 07:03:38,484][123091] Updated weights for policy 0, policy_version 935615 (0.0009) [2023-12-26 07:03:38,536][123091] Updated weights for policy 0, policy_version 935625 (0.0009) [2023-12-26 07:03:38,752][123090] Updated weights for policy 1, policy_version 928964 (0.0010) [2023-12-26 07:03:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 477339648. Throughput: 0: 8768.4, 1: 8932.4. Samples: 477317584. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:38,785][121949] Avg episode reward: [(0, '6316.929'), (1, '5486.173')] [2023-12-26 07:03:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000935632_239525888.pth... [2023-12-26 07:03:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000934608_239263744.pth [2023-12-26 07:03:38,812][123090] Updated weights for policy 1, policy_version 928974 (0.0007) [2023-12-26 07:03:38,876][123090] Updated weights for policy 1, policy_version 928984 (0.0006) [2023-12-26 07:03:38,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000928992_237821952.pth... [2023-12-26 07:03:38,931][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000927936_237551616.pth [2023-12-26 07:03:39,453][123091] Updated weights for policy 0, policy_version 935635 (0.0009) [2023-12-26 07:03:39,518][123091] Updated weights for policy 0, policy_version 935645 (0.0010) [2023-12-26 07:03:39,587][123091] Updated weights for policy 0, policy_version 935655 (0.0010) [2023-12-26 07:03:39,642][123090] Updated weights for policy 1, policy_version 928994 (0.0006) [2023-12-26 07:03:39,707][123090] Updated weights for policy 1, policy_version 929004 (0.0010) [2023-12-26 07:03:39,776][123090] Updated weights for policy 1, policy_version 929014 (0.0010) [2023-12-26 07:03:39,851][123090] Updated weights for policy 1, policy_version 929024 (0.0010) [2023-12-26 07:03:40,371][123091] Updated weights for policy 0, policy_version 935665 (0.0009) [2023-12-26 07:03:40,428][123091] Updated weights for policy 0, policy_version 935675 (0.0009) [2023-12-26 07:03:40,486][123091] Updated weights for policy 0, policy_version 935685 (0.0010) [2023-12-26 07:03:40,537][123091] Updated weights for policy 0, policy_version 935695 (0.0010) [2023-12-26 07:03:40,614][123090] Updated weights for policy 1, policy_version 929034 (0.0006) [2023-12-26 07:03:40,680][123090] Updated weights for policy 1, policy_version 929044 (0.0008) [2023-12-26 07:03:40,751][123090] Updated weights for policy 1, policy_version 929054 (0.0007) [2023-12-26 07:03:41,346][123091] Updated weights for policy 0, policy_version 935705 (0.0006) [2023-12-26 07:03:41,414][123091] Updated weights for policy 0, policy_version 935715 (0.0009) [2023-12-26 07:03:41,479][123091] Updated weights for policy 0, policy_version 935725 (0.0009) [2023-12-26 07:03:41,583][123090] Updated weights for policy 1, policy_version 929064 (0.0010) [2023-12-26 07:03:41,674][123090] Updated weights for policy 1, policy_version 929074 (0.0010) [2023-12-26 07:03:41,745][123090] Updated weights for policy 1, policy_version 929084 (0.0009) [2023-12-26 07:03:42,202][123091] Updated weights for policy 0, policy_version 935735 (0.0009) [2023-12-26 07:03:42,269][123091] Updated weights for policy 0, policy_version 935745 (0.0008) [2023-12-26 07:03:42,340][123091] Updated weights for policy 0, policy_version 935755 (0.0009) [2023-12-26 07:03:42,581][123090] Updated weights for policy 1, policy_version 929094 (0.0009) [2023-12-26 07:03:42,635][123090] Updated weights for policy 1, policy_version 929104 (0.0008) [2023-12-26 07:03:42,705][123090] Updated weights for policy 1, policy_version 929114 (0.0007) [2023-12-26 07:03:43,195][123091] Updated weights for policy 0, policy_version 935765 (0.0010) [2023-12-26 07:03:43,251][123091] Updated weights for policy 0, policy_version 935775 (0.0009) [2023-12-26 07:03:43,302][123091] Updated weights for policy 0, policy_version 935785 (0.0008) [2023-12-26 07:03:43,420][123090] Updated weights for policy 1, policy_version 929124 (0.0006) [2023-12-26 07:03:43,480][123090] Updated weights for policy 1, policy_version 929134 (0.0006) [2023-12-26 07:03:43,542][123090] Updated weights for policy 1, policy_version 929144 (0.0006) [2023-12-26 07:03:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 477429760. Throughput: 0: 8718.8, 1: 8856.4. Samples: 477420888. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:43,785][121949] Avg episode reward: [(0, '6306.256'), (1, '5527.017')] [2023-12-26 07:03:44,164][123090] Updated weights for policy 1, policy_version 929154 (0.0007) [2023-12-26 07:03:44,208][123091] Updated weights for policy 0, policy_version 935795 (0.0008) [2023-12-26 07:03:44,225][123090] Updated weights for policy 1, policy_version 929164 (0.0009) [2023-12-26 07:03:44,253][123091] Updated weights for policy 0, policy_version 935805 (0.0008) [2023-12-26 07:03:44,286][123090] Updated weights for policy 1, policy_version 929174 (0.0008) [2023-12-26 07:03:44,312][123091] Updated weights for policy 0, policy_version 935815 (0.0008) [2023-12-26 07:03:44,342][123090] Updated weights for policy 1, policy_version 929184 (0.0007) [2023-12-26 07:03:45,160][123090] Updated weights for policy 1, policy_version 929194 (0.0006) [2023-12-26 07:03:45,161][123091] Updated weights for policy 0, policy_version 935825 (0.0009) [2023-12-26 07:03:45,222][123091] Updated weights for policy 0, policy_version 935835 (0.0009) [2023-12-26 07:03:45,230][123090] Updated weights for policy 1, policy_version 929204 (0.0005) [2023-12-26 07:03:45,284][123091] Updated weights for policy 0, policy_version 935845 (0.0008) [2023-12-26 07:03:45,301][123090] Updated weights for policy 1, policy_version 929214 (0.0008) [2023-12-26 07:03:45,357][123091] Updated weights for policy 0, policy_version 935855 (0.0006) [2023-12-26 07:03:46,087][123091] Updated weights for policy 0, policy_version 935865 (0.0009) [2023-12-26 07:03:46,102][123090] Updated weights for policy 1, policy_version 929224 (0.0007) [2023-12-26 07:03:46,139][123091] Updated weights for policy 0, policy_version 935875 (0.0009) [2023-12-26 07:03:46,155][123090] Updated weights for policy 1, policy_version 929234 (0.0009) [2023-12-26 07:03:46,199][123091] Updated weights for policy 0, policy_version 935885 (0.0007) [2023-12-26 07:03:46,219][123090] Updated weights for policy 1, policy_version 929244 (0.0009) [2023-12-26 07:03:46,883][123090] Updated weights for policy 1, policy_version 929254 (0.0007) [2023-12-26 07:03:46,891][123091] Updated weights for policy 0, policy_version 935895 (0.0006) [2023-12-26 07:03:46,946][123091] Updated weights for policy 0, policy_version 935905 (0.0005) [2023-12-26 07:03:46,949][123090] Updated weights for policy 1, policy_version 929264 (0.0006) [2023-12-26 07:03:46,993][123091] Updated weights for policy 0, policy_version 935915 (0.0005) [2023-12-26 07:03:47,003][123090] Updated weights for policy 1, policy_version 929274 (0.0006) [2023-12-26 07:03:47,668][123091] Updated weights for policy 0, policy_version 935925 (0.0006) [2023-12-26 07:03:47,715][123091] Updated weights for policy 0, policy_version 935935 (0.0010) [2023-12-26 07:03:47,768][123091] Updated weights for policy 0, policy_version 935945 (0.0009) [2023-12-26 07:03:47,775][123090] Updated weights for policy 1, policy_version 929284 (0.0009) [2023-12-26 07:03:47,826][123090] Updated weights for policy 1, policy_version 929294 (0.0009) [2023-12-26 07:03:47,879][123090] Updated weights for policy 1, policy_version 929304 (0.0010) [2023-12-26 07:03:48,574][123091] Updated weights for policy 0, policy_version 935955 (0.0007) [2023-12-26 07:03:48,636][123091] Updated weights for policy 0, policy_version 935965 (0.0006) [2023-12-26 07:03:48,702][123091] Updated weights for policy 0, policy_version 935975 (0.0007) [2023-12-26 07:03:48,703][123090] Updated weights for policy 1, policy_version 929314 (0.0009) [2023-12-26 07:03:48,768][123090] Updated weights for policy 1, policy_version 929324 (0.0011) [2023-12-26 07:03:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 477519872. Throughput: 0: 8760.0, 1: 8901.1. Samples: 477531112. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:48,785][121949] Avg episode reward: [(0, '6349.902'), (1, '5613.054')] [2023-12-26 07:03:48,837][123090] Updated weights for policy 1, policy_version 929334 (0.0010) [2023-12-26 07:03:48,901][123090] Updated weights for policy 1, policy_version 929344 (0.0008) [2023-12-26 07:03:49,539][123091] Updated weights for policy 0, policy_version 935985 (0.0010) [2023-12-26 07:03:49,607][123091] Updated weights for policy 0, policy_version 935995 (0.0005) [2023-12-26 07:03:49,666][123090] Updated weights for policy 1, policy_version 929354 (0.0009) [2023-12-26 07:03:49,669][123091] Updated weights for policy 0, policy_version 936005 (0.0005) [2023-12-26 07:03:49,729][123090] Updated weights for policy 1, policy_version 929364 (0.0009) [2023-12-26 07:03:49,731][123091] Updated weights for policy 0, policy_version 936015 (0.0005) [2023-12-26 07:03:49,791][123090] Updated weights for policy 1, policy_version 929374 (0.0010) [2023-12-26 07:03:50,394][123091] Updated weights for policy 0, policy_version 936025 (0.0005) [2023-12-26 07:03:50,441][123091] Updated weights for policy 0, policy_version 936035 (0.0005) [2023-12-26 07:03:50,488][123091] Updated weights for policy 0, policy_version 936045 (0.0006) [2023-12-26 07:03:50,665][123090] Updated weights for policy 1, policy_version 929384 (0.0009) [2023-12-26 07:03:50,722][123090] Updated weights for policy 1, policy_version 929394 (0.0009) [2023-12-26 07:03:50,793][123090] Updated weights for policy 1, policy_version 929404 (0.0009) [2023-12-26 07:03:51,329][123091] Updated weights for policy 0, policy_version 936055 (0.0007) [2023-12-26 07:03:51,403][123091] Updated weights for policy 0, policy_version 936065 (0.0008) [2023-12-26 07:03:51,469][123091] Updated weights for policy 0, policy_version 936075 (0.0009) [2023-12-26 07:03:51,669][123090] Updated weights for policy 1, policy_version 929414 (0.0009) [2023-12-26 07:03:51,736][123090] Updated weights for policy 1, policy_version 929424 (0.0009) [2023-12-26 07:03:51,798][123090] Updated weights for policy 1, policy_version 929434 (0.0008) [2023-12-26 07:03:52,317][123091] Updated weights for policy 0, policy_version 936085 (0.0011) [2023-12-26 07:03:52,371][123091] Updated weights for policy 0, policy_version 936095 (0.0009) [2023-12-26 07:03:52,431][123091] Updated weights for policy 0, policy_version 936105 (0.0008) [2023-12-26 07:03:52,509][123090] Updated weights for policy 1, policy_version 929444 (0.0008) [2023-12-26 07:03:52,570][123090] Updated weights for policy 1, policy_version 929454 (0.0005) [2023-12-26 07:03:52,637][123090] Updated weights for policy 1, policy_version 929464 (0.0006) [2023-12-26 07:03:53,247][123090] Updated weights for policy 1, policy_version 929474 (0.0006) [2023-12-26 07:03:53,269][123091] Updated weights for policy 0, policy_version 936115 (0.0008) [2023-12-26 07:03:53,311][123090] Updated weights for policy 1, policy_version 929484 (0.0007) [2023-12-26 07:03:53,322][123091] Updated weights for policy 0, policy_version 936125 (0.0008) [2023-12-26 07:03:53,376][123090] Updated weights for policy 1, policy_version 929494 (0.0007) [2023-12-26 07:03:53,390][123091] Updated weights for policy 0, policy_version 936135 (0.0005) [2023-12-26 07:03:53,445][123090] Updated weights for policy 1, policy_version 929504 (0.0005) [2023-12-26 07:03:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 477609984. Throughput: 0: 8760.2, 1: 8880.2. Samples: 477582608. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:53,785][121949] Avg episode reward: [(0, '6339.966'), (1, '5702.209')] [2023-12-26 07:03:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000929504_237953024.pth... [2023-12-26 07:03:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000936144_239656960.pth... [2023-12-26 07:03:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000928480_237690880.pth [2023-12-26 07:03:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000935088_239386624.pth [2023-12-26 07:03:54,086][123091] Updated weights for policy 0, policy_version 936145 (0.0006) [2023-12-26 07:03:54,093][123090] Updated weights for policy 1, policy_version 929514 (0.0009) [2023-12-26 07:03:54,145][123091] Updated weights for policy 0, policy_version 936155 (0.0010) [2023-12-26 07:03:54,154][123090] Updated weights for policy 1, policy_version 929524 (0.0008) [2023-12-26 07:03:54,207][123091] Updated weights for policy 0, policy_version 936165 (0.0010) [2023-12-26 07:03:54,215][123090] Updated weights for policy 1, policy_version 929534 (0.0007) [2023-12-26 07:03:54,269][123091] Updated weights for policy 0, policy_version 936175 (0.0010) [2023-12-26 07:03:54,966][123091] Updated weights for policy 0, policy_version 936185 (0.0009) [2023-12-26 07:03:55,021][123090] Updated weights for policy 1, policy_version 929544 (0.0007) [2023-12-26 07:03:55,027][123091] Updated weights for policy 0, policy_version 936195 (0.0011) [2023-12-26 07:03:55,080][123090] Updated weights for policy 1, policy_version 929554 (0.0007) [2023-12-26 07:03:55,090][123091] Updated weights for policy 0, policy_version 936205 (0.0010) [2023-12-26 07:03:55,147][123090] Updated weights for policy 1, policy_version 929564 (0.0008) [2023-12-26 07:03:55,885][123091] Updated weights for policy 0, policy_version 936215 (0.0010) [2023-12-26 07:03:55,891][123090] Updated weights for policy 1, policy_version 929574 (0.0007) [2023-12-26 07:03:55,938][123090] Updated weights for policy 1, policy_version 929584 (0.0006) [2023-12-26 07:03:55,941][123091] Updated weights for policy 0, policy_version 936225 (0.0009) [2023-12-26 07:03:55,986][123090] Updated weights for policy 1, policy_version 929594 (0.0008) [2023-12-26 07:03:55,998][123091] Updated weights for policy 0, policy_version 936235 (0.0007) [2023-12-26 07:03:56,747][123091] Updated weights for policy 0, policy_version 936245 (0.0008) [2023-12-26 07:03:56,797][123091] Updated weights for policy 0, policy_version 936255 (0.0008) [2023-12-26 07:03:56,810][123090] Updated weights for policy 1, policy_version 929604 (0.0008) [2023-12-26 07:03:56,848][123091] Updated weights for policy 0, policy_version 936265 (0.0006) [2023-12-26 07:03:56,854][123090] Updated weights for policy 1, policy_version 929614 (0.0010) [2023-12-26 07:03:56,909][123090] Updated weights for policy 1, policy_version 929624 (0.0010) [2023-12-26 07:03:57,592][123091] Updated weights for policy 0, policy_version 936275 (0.0006) [2023-12-26 07:03:57,647][123091] Updated weights for policy 0, policy_version 936285 (0.0010) [2023-12-26 07:03:57,700][123091] Updated weights for policy 0, policy_version 936295 (0.0009) [2023-12-26 07:03:57,731][123090] Updated weights for policy 1, policy_version 929634 (0.0009) [2023-12-26 07:03:57,785][123090] Updated weights for policy 1, policy_version 929644 (0.0008) [2023-12-26 07:03:57,839][123090] Updated weights for policy 1, policy_version 929654 (0.0009) [2023-12-26 07:03:57,894][123090] Updated weights for policy 1, policy_version 929664 (0.0008) [2023-12-26 07:03:58,547][123091] Updated weights for policy 0, policy_version 936305 (0.0009) [2023-12-26 07:03:58,612][123091] Updated weights for policy 0, policy_version 936315 (0.0008) [2023-12-26 07:03:58,682][123091] Updated weights for policy 0, policy_version 936325 (0.0007) [2023-12-26 07:03:58,749][123091] Updated weights for policy 0, policy_version 936335 (0.0008) [2023-12-26 07:03:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 477700096. Throughput: 0: 8837.9, 1: 8888.3. Samples: 477693536. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:03:58,785][121949] Avg episode reward: [(0, '6321.322'), (1, '5641.880')] [2023-12-26 07:03:58,966][123090] Updated weights for policy 1, policy_version 929674 (0.0008) [2023-12-26 07:03:59,033][123090] Updated weights for policy 1, policy_version 929684 (0.0009) [2023-12-26 07:03:59,094][123090] Updated weights for policy 1, policy_version 929694 (0.0009) [2023-12-26 07:03:59,548][123091] Updated weights for policy 0, policy_version 936345 (0.0009) [2023-12-26 07:03:59,605][123091] Updated weights for policy 0, policy_version 936355 (0.0009) [2023-12-26 07:03:59,664][123091] Updated weights for policy 0, policy_version 936365 (0.0009) [2023-12-26 07:03:59,897][123090] Updated weights for policy 1, policy_version 929704 (0.0010) [2023-12-26 07:03:59,965][123090] Updated weights for policy 1, policy_version 929714 (0.0011) [2023-12-26 07:04:00,029][123090] Updated weights for policy 1, policy_version 929724 (0.0010) [2023-12-26 07:04:00,465][123091] Updated weights for policy 0, policy_version 936375 (0.0007) [2023-12-26 07:04:00,509][123091] Updated weights for policy 0, policy_version 936385 (0.0005) [2023-12-26 07:04:00,570][123091] Updated weights for policy 0, policy_version 936395 (0.0010) [2023-12-26 07:04:00,853][123090] Updated weights for policy 1, policy_version 929734 (0.0010) [2023-12-26 07:04:00,902][123090] Updated weights for policy 1, policy_version 929744 (0.0007) [2023-12-26 07:04:00,948][123090] Updated weights for policy 1, policy_version 929754 (0.0010) [2023-12-26 07:04:01,304][123091] Updated weights for policy 0, policy_version 936405 (0.0008) [2023-12-26 07:04:01,364][123091] Updated weights for policy 0, policy_version 936415 (0.0010) [2023-12-26 07:04:01,422][123091] Updated weights for policy 0, policy_version 936426 (0.0010) [2023-12-26 07:04:01,689][123090] Updated weights for policy 1, policy_version 929764 (0.0010) [2023-12-26 07:04:01,762][123090] Updated weights for policy 1, policy_version 929774 (0.0010) [2023-12-26 07:04:01,818][123090] Updated weights for policy 1, policy_version 929784 (0.0008) [2023-12-26 07:04:02,334][123091] Updated weights for policy 0, policy_version 936437 (0.0010) [2023-12-26 07:04:02,399][123091] Updated weights for policy 0, policy_version 936447 (0.0008) [2023-12-26 07:04:02,462][123091] Updated weights for policy 0, policy_version 936457 (0.0009) [2023-12-26 07:04:02,635][123090] Updated weights for policy 1, policy_version 929794 (0.0009) [2023-12-26 07:04:02,712][123090] Updated weights for policy 1, policy_version 929804 (0.0010) [2023-12-26 07:04:02,783][123090] Updated weights for policy 1, policy_version 929814 (0.0011) [2023-12-26 07:04:02,831][123090] Updated weights for policy 1, policy_version 929824 (0.0010) [2023-12-26 07:04:03,174][123091] Updated weights for policy 0, policy_version 936467 (0.0008) [2023-12-26 07:04:03,235][123091] Updated weights for policy 0, policy_version 936477 (0.0005) [2023-12-26 07:04:03,293][123091] Updated weights for policy 0, policy_version 936487 (0.0005) [2023-12-26 07:04:03,641][123090] Updated weights for policy 1, policy_version 929834 (0.0010) [2023-12-26 07:04:03,700][123090] Updated weights for policy 1, policy_version 929844 (0.0010) [2023-12-26 07:04:03,758][123090] Updated weights for policy 1, policy_version 929854 (0.0010) [2023-12-26 07:04:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 477790208. Throughput: 0: 8925.1, 1: 8770.2. Samples: 477799124. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:03,785][121949] Avg episode reward: [(0, '6314.037'), (1, '5560.033')] [2023-12-26 07:04:03,950][123091] Updated weights for policy 0, policy_version 936497 (0.0005) [2023-12-26 07:04:03,998][123091] Updated weights for policy 0, policy_version 936507 (0.0009) [2023-12-26 07:04:04,050][123091] Updated weights for policy 0, policy_version 936517 (0.0009) [2023-12-26 07:04:04,107][123091] Updated weights for policy 0, policy_version 936527 (0.0009) [2023-12-26 07:04:04,626][123090] Updated weights for policy 1, policy_version 929864 (0.0011) [2023-12-26 07:04:04,695][123090] Updated weights for policy 1, policy_version 929874 (0.0011) [2023-12-26 07:04:04,763][123090] Updated weights for policy 1, policy_version 929884 (0.0006) [2023-12-26 07:04:04,914][123091] Updated weights for policy 0, policy_version 936537 (0.0008) [2023-12-26 07:04:04,969][123091] Updated weights for policy 0, policy_version 936547 (0.0006) [2023-12-26 07:04:05,030][123091] Updated weights for policy 0, policy_version 936557 (0.0005) [2023-12-26 07:04:05,541][123090] Updated weights for policy 1, policy_version 929894 (0.0008) [2023-12-26 07:04:05,592][123090] Updated weights for policy 1, policy_version 929904 (0.0010) [2023-12-26 07:04:05,631][123091] Updated weights for policy 0, policy_version 936567 (0.0006) [2023-12-26 07:04:05,640][123090] Updated weights for policy 1, policy_version 929914 (0.0010) [2023-12-26 07:04:05,687][123091] Updated weights for policy 0, policy_version 936577 (0.0006) [2023-12-26 07:04:05,750][123091] Updated weights for policy 0, policy_version 936587 (0.0005) [2023-12-26 07:04:06,335][123090] Updated weights for policy 1, policy_version 929924 (0.0009) [2023-12-26 07:04:06,400][123090] Updated weights for policy 1, policy_version 929934 (0.0009) [2023-12-26 07:04:06,459][123091] Updated weights for policy 0, policy_version 936597 (0.0007) [2023-12-26 07:04:06,464][123090] Updated weights for policy 1, policy_version 929944 (0.0011) [2023-12-26 07:04:06,512][123091] Updated weights for policy 0, policy_version 936607 (0.0011) [2023-12-26 07:04:06,564][123091] Updated weights for policy 0, policy_version 936617 (0.0010) [2023-12-26 07:04:07,243][123091] Updated weights for policy 0, policy_version 936627 (0.0007) [2023-12-26 07:04:07,273][123090] Updated weights for policy 1, policy_version 929954 (0.0011) [2023-12-26 07:04:07,291][123091] Updated weights for policy 0, policy_version 936637 (0.0011) [2023-12-26 07:04:07,325][123090] Updated weights for policy 1, policy_version 929964 (0.0010) [2023-12-26 07:04:07,343][123091] Updated weights for policy 0, policy_version 936647 (0.0011) [2023-12-26 07:04:07,380][123090] Updated weights for policy 1, policy_version 929974 (0.0010) [2023-12-26 07:04:07,432][123090] Updated weights for policy 1, policy_version 929984 (0.0010) [2023-12-26 07:04:08,180][123091] Updated weights for policy 0, policy_version 936657 (0.0010) [2023-12-26 07:04:08,248][123091] Updated weights for policy 0, policy_version 936667 (0.0005) [2023-12-26 07:04:08,264][123090] Updated weights for policy 1, policy_version 929994 (0.0010) [2023-12-26 07:04:08,307][123091] Updated weights for policy 0, policy_version 936677 (0.0005) [2023-12-26 07:04:08,317][123090] Updated weights for policy 1, policy_version 930004 (0.0010) [2023-12-26 07:04:08,371][123091] Updated weights for policy 0, policy_version 936687 (0.0009) [2023-12-26 07:04:08,384][123090] Updated weights for policy 1, policy_version 930014 (0.0010) [2023-12-26 07:04:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 477880320. Throughput: 0: 9003.7, 1: 8766.5. Samples: 477854820. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:08,785][121949] Avg episode reward: [(0, '6323.846'), (1, '5565.608')] [2023-12-26 07:04:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000930016_238084096.pth... [2023-12-26 07:04:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000936688_239796224.pth... [2023-12-26 07:04:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000928992_237821952.pth [2023-12-26 07:04:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000935632_239525888.pth [2023-12-26 07:04:09,005][123091] Updated weights for policy 0, policy_version 936697 (0.0010) [2023-12-26 07:04:09,063][123091] Updated weights for policy 0, policy_version 936707 (0.0006) [2023-12-26 07:04:09,134][123091] Updated weights for policy 0, policy_version 936717 (0.0006) [2023-12-26 07:04:09,188][123090] Updated weights for policy 1, policy_version 930024 (0.0009) [2023-12-26 07:04:09,259][123090] Updated weights for policy 1, policy_version 930034 (0.0008) [2023-12-26 07:04:09,332][123090] Updated weights for policy 1, policy_version 930044 (0.0006) [2023-12-26 07:04:09,952][123091] Updated weights for policy 0, policy_version 936727 (0.0009) [2023-12-26 07:04:10,017][123091] Updated weights for policy 0, policy_version 936737 (0.0009) [2023-12-26 07:04:10,077][123091] Updated weights for policy 0, policy_version 936747 (0.0010) [2023-12-26 07:04:10,138][123090] Updated weights for policy 1, policy_version 930054 (0.0010) [2023-12-26 07:04:10,198][123090] Updated weights for policy 1, policy_version 930064 (0.0011) [2023-12-26 07:04:10,258][123090] Updated weights for policy 1, policy_version 930074 (0.0011) [2023-12-26 07:04:10,792][123091] Updated weights for policy 0, policy_version 936757 (0.0009) [2023-12-26 07:04:10,844][123091] Updated weights for policy 0, policy_version 936767 (0.0009) [2023-12-26 07:04:10,901][123091] Updated weights for policy 0, policy_version 936777 (0.0009) [2023-12-26 07:04:11,085][123090] Updated weights for policy 1, policy_version 930084 (0.0011) [2023-12-26 07:04:11,151][123090] Updated weights for policy 1, policy_version 930094 (0.0010) [2023-12-26 07:04:11,216][123090] Updated weights for policy 1, policy_version 930104 (0.0009) [2023-12-26 07:04:11,753][123091] Updated weights for policy 0, policy_version 936787 (0.0009) [2023-12-26 07:04:11,817][123091] Updated weights for policy 0, policy_version 936797 (0.0010) [2023-12-26 07:04:11,869][123091] Updated weights for policy 0, policy_version 936807 (0.0009) [2023-12-26 07:04:12,102][123090] Updated weights for policy 1, policy_version 930114 (0.0009) [2023-12-26 07:04:12,158][123090] Updated weights for policy 1, policy_version 930124 (0.0008) [2023-12-26 07:04:12,221][123090] Updated weights for policy 1, policy_version 930134 (0.0008) [2023-12-26 07:04:12,294][123090] Updated weights for policy 1, policy_version 930144 (0.0008) [2023-12-26 07:04:12,756][123091] Updated weights for policy 0, policy_version 936817 (0.0007) [2023-12-26 07:04:12,827][123091] Updated weights for policy 0, policy_version 936827 (0.0008) [2023-12-26 07:04:12,899][123091] Updated weights for policy 0, policy_version 936837 (0.0008) [2023-12-26 07:04:12,964][123091] Updated weights for policy 0, policy_version 936847 (0.0005) [2023-12-26 07:04:13,005][123090] Updated weights for policy 1, policy_version 930154 (0.0006) [2023-12-26 07:04:13,061][123090] Updated weights for policy 1, policy_version 930164 (0.0008) [2023-12-26 07:04:13,116][123090] Updated weights for policy 1, policy_version 930175 (0.0010) [2023-12-26 07:04:13,698][123091] Updated weights for policy 0, policy_version 936857 (0.0009) [2023-12-26 07:04:13,760][123091] Updated weights for policy 0, policy_version 936867 (0.0009) [2023-12-26 07:04:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 477962240. Throughput: 0: 9051.3, 1: 8810.2. Samples: 477960956. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:13,784][121949] Avg episode reward: [(0, '6384.131'), (1, '5640.561')] [2023-12-26 07:04:13,821][123091] Updated weights for policy 0, policy_version 936877 (0.0010) [2023-12-26 07:04:13,955][123090] Updated weights for policy 1, policy_version 930185 (0.0009) [2023-12-26 07:04:14,006][123090] Updated weights for policy 1, policy_version 930196 (0.0010) [2023-12-26 07:04:14,066][123090] Updated weights for policy 1, policy_version 930206 (0.0010) [2023-12-26 07:04:14,614][123091] Updated weights for policy 0, policy_version 936887 (0.0010) [2023-12-26 07:04:14,676][123091] Updated weights for policy 0, policy_version 936897 (0.0009) [2023-12-26 07:04:14,742][123091] Updated weights for policy 0, policy_version 936907 (0.0009) [2023-12-26 07:04:14,956][123090] Updated weights for policy 1, policy_version 930216 (0.0007) [2023-12-26 07:04:15,028][123090] Updated weights for policy 1, policy_version 930226 (0.0006) [2023-12-26 07:04:15,101][123090] Updated weights for policy 1, policy_version 930236 (0.0006) [2023-12-26 07:04:15,614][123091] Updated weights for policy 0, policy_version 936917 (0.0009) [2023-12-26 07:04:15,681][123091] Updated weights for policy 0, policy_version 936927 (0.0009) [2023-12-26 07:04:15,733][123091] Updated weights for policy 0, policy_version 936937 (0.0008) [2023-12-26 07:04:15,884][123090] Updated weights for policy 1, policy_version 930246 (0.0008) [2023-12-26 07:04:15,945][123090] Updated weights for policy 1, policy_version 930256 (0.0008) [2023-12-26 07:04:16,001][123090] Updated weights for policy 1, policy_version 930266 (0.0009) [2023-12-26 07:04:16,475][123091] Updated weights for policy 0, policy_version 936947 (0.0008) [2023-12-26 07:04:16,520][123091] Updated weights for policy 0, policy_version 936957 (0.0005) [2023-12-26 07:04:16,565][123091] Updated weights for policy 0, policy_version 936967 (0.0005) [2023-12-26 07:04:16,773][123090] Updated weights for policy 1, policy_version 930276 (0.0007) [2023-12-26 07:04:16,843][123090] Updated weights for policy 1, policy_version 930286 (0.0005) [2023-12-26 07:04:16,912][123090] Updated weights for policy 1, policy_version 930296 (0.0005) [2023-12-26 07:04:17,218][123091] Updated weights for policy 0, policy_version 936977 (0.0005) [2023-12-26 07:04:17,272][123091] Updated weights for policy 0, policy_version 936987 (0.0005) [2023-12-26 07:04:17,333][123091] Updated weights for policy 0, policy_version 936997 (0.0005) [2023-12-26 07:04:17,387][123091] Updated weights for policy 0, policy_version 937007 (0.0005) [2023-12-26 07:04:17,558][123090] Updated weights for policy 1, policy_version 930306 (0.0007) [2023-12-26 07:04:17,614][123090] Updated weights for policy 1, policy_version 930317 (0.0012) [2023-12-26 07:04:17,672][123090] Updated weights for policy 1, policy_version 930327 (0.0009) [2023-12-26 07:04:18,070][123091] Updated weights for policy 0, policy_version 937017 (0.0009) [2023-12-26 07:04:18,131][123091] Updated weights for policy 0, policy_version 937027 (0.0009) [2023-12-26 07:04:18,200][123091] Updated weights for policy 0, policy_version 937037 (0.0008) [2023-12-26 07:04:18,436][123090] Updated weights for policy 1, policy_version 930337 (0.0009) [2023-12-26 07:04:18,492][123090] Updated weights for policy 1, policy_version 930347 (0.0005) [2023-12-26 07:04:18,570][123090] Updated weights for policy 1, policy_version 930357 (0.0005) [2023-12-26 07:04:18,641][123090] Updated weights for policy 1, policy_version 930367 (0.0006) [2023-12-26 07:04:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 478060544. Throughput: 0: 9086.2, 1: 8833.2. Samples: 478071112. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:18,785][121949] Avg episode reward: [(0, '6393.092'), (1, '5807.656')] [2023-12-26 07:04:18,922][123091] Updated weights for policy 0, policy_version 937047 (0.0005) [2023-12-26 07:04:18,990][123091] Updated weights for policy 0, policy_version 937057 (0.0006) [2023-12-26 07:04:19,046][123091] Updated weights for policy 0, policy_version 937067 (0.0005) [2023-12-26 07:04:19,362][123090] Updated weights for policy 1, policy_version 930377 (0.0009) [2023-12-26 07:04:19,426][123090] Updated weights for policy 1, policy_version 930387 (0.0010) [2023-12-26 07:04:19,486][123090] Updated weights for policy 1, policy_version 930397 (0.0009) [2023-12-26 07:04:19,767][123091] Updated weights for policy 0, policy_version 937077 (0.0006) [2023-12-26 07:04:19,834][123091] Updated weights for policy 0, policy_version 937087 (0.0006) [2023-12-26 07:04:19,899][123091] Updated weights for policy 0, policy_version 937097 (0.0010) [2023-12-26 07:04:20,237][123090] Updated weights for policy 1, policy_version 930407 (0.0006) [2023-12-26 07:04:20,297][123090] Updated weights for policy 1, policy_version 930417 (0.0006) [2023-12-26 07:04:20,354][123090] Updated weights for policy 1, policy_version 930427 (0.0010) [2023-12-26 07:04:20,692][123091] Updated weights for policy 0, policy_version 937107 (0.0009) [2023-12-26 07:04:20,766][123091] Updated weights for policy 0, policy_version 937117 (0.0005) [2023-12-26 07:04:20,836][123091] Updated weights for policy 0, policy_version 937127 (0.0010) [2023-12-26 07:04:21,216][123090] Updated weights for policy 1, policy_version 930437 (0.0010) [2023-12-26 07:04:21,277][123090] Updated weights for policy 1, policy_version 930447 (0.0010) [2023-12-26 07:04:21,344][123090] Updated weights for policy 1, policy_version 930457 (0.0009) [2023-12-26 07:04:21,633][123091] Updated weights for policy 0, policy_version 937137 (0.0009) [2023-12-26 07:04:21,705][123091] Updated weights for policy 0, policy_version 937147 (0.0010) [2023-12-26 07:04:21,778][123091] Updated weights for policy 0, policy_version 937157 (0.0009) [2023-12-26 07:04:21,837][123091] Updated weights for policy 0, policy_version 937167 (0.0010) [2023-12-26 07:04:22,162][123090] Updated weights for policy 1, policy_version 930467 (0.0009) [2023-12-26 07:04:22,215][123090] Updated weights for policy 1, policy_version 930477 (0.0010) [2023-12-26 07:04:22,288][123090] Updated weights for policy 1, policy_version 930487 (0.0007) [2023-12-26 07:04:22,711][123091] Updated weights for policy 0, policy_version 937177 (0.0007) [2023-12-26 07:04:22,763][123091] Updated weights for policy 0, policy_version 937187 (0.0011) [2023-12-26 07:04:22,826][123091] Updated weights for policy 0, policy_version 937197 (0.0011) [2023-12-26 07:04:23,108][123090] Updated weights for policy 1, policy_version 930497 (0.0009) [2023-12-26 07:04:23,170][123090] Updated weights for policy 1, policy_version 930507 (0.0005) [2023-12-26 07:04:23,242][123090] Updated weights for policy 1, policy_version 930517 (0.0005) [2023-12-26 07:04:23,305][123090] Updated weights for policy 1, policy_version 930527 (0.0007) [2023-12-26 07:04:23,646][123091] Updated weights for policy 0, policy_version 937207 (0.0011) [2023-12-26 07:04:23,700][123091] Updated weights for policy 0, policy_version 937217 (0.0010) [2023-12-26 07:04:23,765][123091] Updated weights for policy 0, policy_version 937227 (0.0010) [2023-12-26 07:04:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 478142464. Throughput: 0: 9088.6, 1: 8858.2. Samples: 478125184. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:23,785][121949] Avg episode reward: [(0, '6301.964'), (1, '5788.119')] [2023-12-26 07:04:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000930528_238215168.pth... [2023-12-26 07:04:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000929504_237953024.pth [2023-12-26 07:04:23,797][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000937232_239935488.pth... [2023-12-26 07:04:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000936144_239656960.pth [2023-12-26 07:04:23,977][123090] Updated weights for policy 1, policy_version 930537 (0.0005) [2023-12-26 07:04:24,033][123090] Updated weights for policy 1, policy_version 930547 (0.0005) [2023-12-26 07:04:24,089][123090] Updated weights for policy 1, policy_version 930557 (0.0005) [2023-12-26 07:04:24,541][123091] Updated weights for policy 0, policy_version 937237 (0.0010) [2023-12-26 07:04:24,610][123091] Updated weights for policy 0, policy_version 937247 (0.0010) [2023-12-26 07:04:24,674][123091] Updated weights for policy 0, policy_version 937257 (0.0010) [2023-12-26 07:04:24,764][123090] Updated weights for policy 1, policy_version 930567 (0.0006) [2023-12-26 07:04:24,822][123090] Updated weights for policy 1, policy_version 930577 (0.0010) [2023-12-26 07:04:24,874][123090] Updated weights for policy 1, policy_version 930587 (0.0010) [2023-12-26 07:04:25,468][123091] Updated weights for policy 0, policy_version 937267 (0.0009) [2023-12-26 07:04:25,528][123091] Updated weights for policy 0, policy_version 937277 (0.0009) [2023-12-26 07:04:25,579][123090] Updated weights for policy 1, policy_version 930597 (0.0008) [2023-12-26 07:04:25,581][123091] Updated weights for policy 0, policy_version 937287 (0.0007) [2023-12-26 07:04:25,627][123090] Updated weights for policy 1, policy_version 930607 (0.0010) [2023-12-26 07:04:25,678][123090] Updated weights for policy 1, policy_version 930617 (0.0010) [2023-12-26 07:04:26,401][123090] Updated weights for policy 1, policy_version 930627 (0.0005) [2023-12-26 07:04:26,470][123090] Updated weights for policy 1, policy_version 930637 (0.0005) [2023-12-26 07:04:26,491][123091] Updated weights for policy 0, policy_version 937297 (0.0006) [2023-12-26 07:04:26,522][123090] Updated weights for policy 1, policy_version 930647 (0.0008) [2023-12-26 07:04:26,556][123091] Updated weights for policy 0, policy_version 937307 (0.0007) [2023-12-26 07:04:26,622][123091] Updated weights for policy 0, policy_version 937317 (0.0010) [2023-12-26 07:04:26,684][123091] Updated weights for policy 0, policy_version 937327 (0.0009) [2023-12-26 07:04:27,199][123090] Updated weights for policy 1, policy_version 930657 (0.0009) [2023-12-26 07:04:27,253][123090] Updated weights for policy 1, policy_version 930667 (0.0005) [2023-12-26 07:04:27,300][123090] Updated weights for policy 1, policy_version 930677 (0.0006) [2023-12-26 07:04:27,349][123090] Updated weights for policy 1, policy_version 930687 (0.0006) [2023-12-26 07:04:27,558][123091] Updated weights for policy 0, policy_version 937337 (0.0010) [2023-12-26 07:04:27,620][123091] Updated weights for policy 0, policy_version 937347 (0.0009) [2023-12-26 07:04:27,684][123091] Updated weights for policy 0, policy_version 937357 (0.0009) [2023-12-26 07:04:28,143][123090] Updated weights for policy 1, policy_version 930698 (0.0009) [2023-12-26 07:04:28,189][123090] Updated weights for policy 1, policy_version 930708 (0.0008) [2023-12-26 07:04:28,236][123090] Updated weights for policy 1, policy_version 930718 (0.0009) [2023-12-26 07:04:28,479][123091] Updated weights for policy 0, policy_version 937367 (0.0009) [2023-12-26 07:04:28,539][123091] Updated weights for policy 0, policy_version 937377 (0.0009) [2023-12-26 07:04:28,591][123091] Updated weights for policy 0, policy_version 937387 (0.0010) [2023-12-26 07:04:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 478240768. Throughput: 0: 9065.1, 1: 8998.5. Samples: 478233748. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:28,785][121949] Avg episode reward: [(0, '6259.507'), (1, '5650.706')] [2023-12-26 07:04:29,050][123090] Updated weights for policy 1, policy_version 930728 (0.0010) [2023-12-26 07:04:29,115][123090] Updated weights for policy 1, policy_version 930738 (0.0009) [2023-12-26 07:04:29,178][123090] Updated weights for policy 1, policy_version 930748 (0.0009) [2023-12-26 07:04:29,457][123091] Updated weights for policy 0, policy_version 937397 (0.0009) [2023-12-26 07:04:29,516][123091] Updated weights for policy 0, policy_version 937407 (0.0010) [2023-12-26 07:04:29,579][123091] Updated weights for policy 0, policy_version 937417 (0.0010) [2023-12-26 07:04:30,040][123090] Updated weights for policy 1, policy_version 930758 (0.0010) [2023-12-26 07:04:30,107][123090] Updated weights for policy 1, policy_version 930768 (0.0009) [2023-12-26 07:04:30,173][123090] Updated weights for policy 1, policy_version 930778 (0.0010) [2023-12-26 07:04:30,414][123091] Updated weights for policy 0, policy_version 937427 (0.0010) [2023-12-26 07:04:30,474][123091] Updated weights for policy 0, policy_version 937437 (0.0010) [2023-12-26 07:04:30,526][123091] Updated weights for policy 0, policy_version 937447 (0.0009) [2023-12-26 07:04:30,878][123090] Updated weights for policy 1, policy_version 930788 (0.0008) [2023-12-26 07:04:30,927][123090] Updated weights for policy 1, policy_version 930798 (0.0005) [2023-12-26 07:04:30,985][123090] Updated weights for policy 1, policy_version 930808 (0.0005) [2023-12-26 07:04:31,319][123091] Updated weights for policy 0, policy_version 937457 (0.0009) [2023-12-26 07:04:31,387][123091] Updated weights for policy 0, policy_version 937467 (0.0009) [2023-12-26 07:04:31,454][123091] Updated weights for policy 0, policy_version 937477 (0.0007) [2023-12-26 07:04:31,521][123091] Updated weights for policy 0, policy_version 937487 (0.0007) [2023-12-26 07:04:31,821][123090] Updated weights for policy 1, policy_version 930818 (0.0009) [2023-12-26 07:04:31,873][123090] Updated weights for policy 1, policy_version 930828 (0.0008) [2023-12-26 07:04:31,934][123090] Updated weights for policy 1, policy_version 930838 (0.0009) [2023-12-26 07:04:31,998][123090] Updated weights for policy 1, policy_version 930848 (0.0009) [2023-12-26 07:04:32,309][123091] Updated weights for policy 0, policy_version 937497 (0.0011) [2023-12-26 07:04:32,378][123091] Updated weights for policy 0, policy_version 937507 (0.0011) [2023-12-26 07:04:32,437][123091] Updated weights for policy 0, policy_version 937517 (0.0010) [2023-12-26 07:04:32,831][123090] Updated weights for policy 1, policy_version 930858 (0.0008) [2023-12-26 07:04:32,887][123090] Updated weights for policy 1, policy_version 930868 (0.0010) [2023-12-26 07:04:32,942][123090] Updated weights for policy 1, policy_version 930878 (0.0010) [2023-12-26 07:04:33,238][123091] Updated weights for policy 0, policy_version 937527 (0.0010) [2023-12-26 07:04:33,292][123091] Updated weights for policy 0, policy_version 937537 (0.0010) [2023-12-26 07:04:33,353][123091] Updated weights for policy 0, policy_version 937547 (0.0010) [2023-12-26 07:04:33,739][123090] Updated weights for policy 1, policy_version 930888 (0.0006) [2023-12-26 07:04:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 478322688. Throughput: 0: 9000.0, 1: 8930.2. Samples: 478337972. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:33,784][121949] Avg episode reward: [(0, '6168.766'), (1, '5627.629')] [2023-12-26 07:04:33,801][123090] Updated weights for policy 1, policy_version 930898 (0.0005) [2023-12-26 07:04:33,866][123090] Updated weights for policy 1, policy_version 930908 (0.0005) [2023-12-26 07:04:34,183][123091] Updated weights for policy 0, policy_version 937557 (0.0010) [2023-12-26 07:04:34,241][123091] Updated weights for policy 0, policy_version 937567 (0.0010) [2023-12-26 07:04:34,303][123091] Updated weights for policy 0, policy_version 937577 (0.0010) [2023-12-26 07:04:34,640][123090] Updated weights for policy 1, policy_version 930918 (0.0009) [2023-12-26 07:04:34,701][123090] Updated weights for policy 1, policy_version 930928 (0.0011) [2023-12-26 07:04:34,757][123090] Updated weights for policy 1, policy_version 930938 (0.0010) [2023-12-26 07:04:35,064][123091] Updated weights for policy 0, policy_version 937587 (0.0009) [2023-12-26 07:04:35,126][123091] Updated weights for policy 0, policy_version 937597 (0.0009) [2023-12-26 07:04:35,189][123091] Updated weights for policy 0, policy_version 937607 (0.0010) [2023-12-26 07:04:35,567][123090] Updated weights for policy 1, policy_version 930948 (0.0010) [2023-12-26 07:04:35,618][123090] Updated weights for policy 1, policy_version 930958 (0.0010) [2023-12-26 07:04:35,666][123090] Updated weights for policy 1, policy_version 930968 (0.0005) [2023-12-26 07:04:35,989][123091] Updated weights for policy 0, policy_version 937617 (0.0010) [2023-12-26 07:04:36,054][123091] Updated weights for policy 0, policy_version 937627 (0.0011) [2023-12-26 07:04:36,133][123091] Updated weights for policy 0, policy_version 937637 (0.0011) [2023-12-26 07:04:36,197][123091] Updated weights for policy 0, policy_version 937647 (0.0010) [2023-12-26 07:04:36,534][123090] Updated weights for policy 1, policy_version 930978 (0.0010) [2023-12-26 07:04:36,607][123090] Updated weights for policy 1, policy_version 930988 (0.0007) [2023-12-26 07:04:36,681][123090] Updated weights for policy 1, policy_version 930998 (0.0009) [2023-12-26 07:04:36,743][123090] Updated weights for policy 1, policy_version 931008 (0.0007) [2023-12-26 07:04:37,012][123091] Updated weights for policy 0, policy_version 937657 (0.0011) [2023-12-26 07:04:37,078][123091] Updated weights for policy 0, policy_version 937667 (0.0010) [2023-12-26 07:04:37,127][123091] Updated weights for policy 0, policy_version 937677 (0.0008) [2023-12-26 07:04:37,336][123090] Updated weights for policy 1, policy_version 931018 (0.0005) [2023-12-26 07:04:37,409][123090] Updated weights for policy 1, policy_version 931028 (0.0005) [2023-12-26 07:04:37,480][123090] Updated weights for policy 1, policy_version 931038 (0.0006) [2023-12-26 07:04:37,947][123091] Updated weights for policy 0, policy_version 937687 (0.0010) [2023-12-26 07:04:37,998][123091] Updated weights for policy 0, policy_version 937697 (0.0011) [2023-12-26 07:04:38,054][123091] Updated weights for policy 0, policy_version 937707 (0.0010) [2023-12-26 07:04:38,114][123090] Updated weights for policy 1, policy_version 931048 (0.0006) [2023-12-26 07:04:38,172][123090] Updated weights for policy 1, policy_version 931058 (0.0005) [2023-12-26 07:04:38,227][123090] Updated weights for policy 1, policy_version 931068 (0.0005) [2023-12-26 07:04:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 478412800. Throughput: 0: 8994.8, 1: 8969.7. Samples: 478391012. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:38,785][121949] Avg episode reward: [(0, '6215.979'), (1, '5790.354')] [2023-12-26 07:04:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000931072_238354432.pth... [2023-12-26 07:04:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000930016_238084096.pth [2023-12-26 07:04:38,828][123091] Updated weights for policy 0, policy_version 937717 (0.0010) [2023-12-26 07:04:38,894][123091] Updated weights for policy 0, policy_version 937727 (0.0010) [2023-12-26 07:04:38,959][123091] Updated weights for policy 0, policy_version 937737 (0.0010) [2023-12-26 07:04:39,005][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000937744_240066560.pth... [2023-12-26 07:04:39,009][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000936688_239796224.pth [2023-12-26 07:04:39,012][123090] Updated weights for policy 1, policy_version 931078 (0.0006) [2023-12-26 07:04:39,083][123090] Updated weights for policy 1, policy_version 931088 (0.0009) [2023-12-26 07:04:39,150][123090] Updated weights for policy 1, policy_version 931098 (0.0011) [2023-12-26 07:04:39,703][123091] Updated weights for policy 0, policy_version 937747 (0.0008) [2023-12-26 07:04:39,773][123091] Updated weights for policy 0, policy_version 937757 (0.0007) [2023-12-26 07:04:39,848][123091] Updated weights for policy 0, policy_version 937767 (0.0010) [2023-12-26 07:04:39,997][123090] Updated weights for policy 1, policy_version 931108 (0.0010) [2023-12-26 07:04:40,060][123090] Updated weights for policy 1, policy_version 931118 (0.0010) [2023-12-26 07:04:40,115][123090] Updated weights for policy 1, policy_version 931128 (0.0009) [2023-12-26 07:04:40,517][123091] Updated weights for policy 0, policy_version 937777 (0.0009) [2023-12-26 07:04:40,588][123091] Updated weights for policy 0, policy_version 937787 (0.0010) [2023-12-26 07:04:40,655][123091] Updated weights for policy 0, policy_version 937797 (0.0010) [2023-12-26 07:04:40,711][123091] Updated weights for policy 0, policy_version 937807 (0.0009) [2023-12-26 07:04:40,996][123090] Updated weights for policy 1, policy_version 931138 (0.0010) [2023-12-26 07:04:41,071][123090] Updated weights for policy 1, policy_version 931148 (0.0009) [2023-12-26 07:04:41,148][123090] Updated weights for policy 1, policy_version 931158 (0.0011) [2023-12-26 07:04:41,216][123090] Updated weights for policy 1, policy_version 931168 (0.0011) [2023-12-26 07:04:41,522][123091] Updated weights for policy 0, policy_version 937817 (0.0009) [2023-12-26 07:04:41,580][123091] Updated weights for policy 0, policy_version 937827 (0.0009) [2023-12-26 07:04:41,645][123091] Updated weights for policy 0, policy_version 937837 (0.0009) [2023-12-26 07:04:42,049][123090] Updated weights for policy 1, policy_version 931178 (0.0009) [2023-12-26 07:04:42,103][123090] Updated weights for policy 1, policy_version 931188 (0.0009) [2023-12-26 07:04:42,161][123090] Updated weights for policy 1, policy_version 931198 (0.0009) [2023-12-26 07:04:42,544][123091] Updated weights for policy 0, policy_version 937847 (0.0008) [2023-12-26 07:04:42,606][123091] Updated weights for policy 0, policy_version 937857 (0.0008) [2023-12-26 07:04:42,669][123091] Updated weights for policy 0, policy_version 937867 (0.0010) [2023-12-26 07:04:43,021][123090] Updated weights for policy 1, policy_version 931208 (0.0010) [2023-12-26 07:04:43,087][123090] Updated weights for policy 1, policy_version 931218 (0.0009) [2023-12-26 07:04:43,153][123090] Updated weights for policy 1, policy_version 931228 (0.0009) [2023-12-26 07:04:43,498][123091] Updated weights for policy 0, policy_version 937877 (0.0010) [2023-12-26 07:04:43,559][123091] Updated weights for policy 0, policy_version 937887 (0.0009) [2023-12-26 07:04:43,624][123091] Updated weights for policy 0, policy_version 937897 (0.0010) [2023-12-26 07:04:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 478502912. Throughput: 0: 8948.1, 1: 8890.0. Samples: 478496252. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:43,785][121949] Avg episode reward: [(0, '6298.441'), (1, '5740.354')] [2023-12-26 07:04:43,960][123090] Updated weights for policy 1, policy_version 931238 (0.0010) [2023-12-26 07:04:44,028][123090] Updated weights for policy 1, policy_version 931248 (0.0009) [2023-12-26 07:04:44,089][123090] Updated weights for policy 1, policy_version 931258 (0.0009) [2023-12-26 07:04:44,455][123091] Updated weights for policy 0, policy_version 937907 (0.0009) [2023-12-26 07:04:44,526][123091] Updated weights for policy 0, policy_version 937917 (0.0009) [2023-12-26 07:04:44,586][123091] Updated weights for policy 0, policy_version 937927 (0.0010) [2023-12-26 07:04:44,915][123090] Updated weights for policy 1, policy_version 931268 (0.0008) [2023-12-26 07:04:44,988][123090] Updated weights for policy 1, policy_version 931278 (0.0008) [2023-12-26 07:04:45,056][123090] Updated weights for policy 1, policy_version 931288 (0.0010) [2023-12-26 07:04:45,398][123091] Updated weights for policy 0, policy_version 937937 (0.0010) [2023-12-26 07:04:45,465][123091] Updated weights for policy 0, policy_version 937947 (0.0010) [2023-12-26 07:04:45,529][123091] Updated weights for policy 0, policy_version 937957 (0.0010) [2023-12-26 07:04:45,599][123091] Updated weights for policy 0, policy_version 937967 (0.0010) [2023-12-26 07:04:45,857][123090] Updated weights for policy 1, policy_version 931298 (0.0010) [2023-12-26 07:04:45,934][123090] Updated weights for policy 1, policy_version 931308 (0.0006) [2023-12-26 07:04:46,003][123090] Updated weights for policy 1, policy_version 931318 (0.0006) [2023-12-26 07:04:46,069][123090] Updated weights for policy 1, policy_version 931328 (0.0005) [2023-12-26 07:04:46,479][123091] Updated weights for policy 0, policy_version 937977 (0.0010) [2023-12-26 07:04:46,533][123091] Updated weights for policy 0, policy_version 937987 (0.0010) [2023-12-26 07:04:46,582][123091] Updated weights for policy 0, policy_version 937997 (0.0009) [2023-12-26 07:04:46,606][123090] Updated weights for policy 1, policy_version 931338 (0.0005) [2023-12-26 07:04:46,661][123090] Updated weights for policy 1, policy_version 931348 (0.0005) [2023-12-26 07:04:46,709][123090] Updated weights for policy 1, policy_version 931358 (0.0010) [2023-12-26 07:04:47,437][123090] Updated weights for policy 1, policy_version 931368 (0.0006) [2023-12-26 07:04:47,487][123090] Updated weights for policy 1, policy_version 931378 (0.0010) [2023-12-26 07:04:47,498][123091] Updated weights for policy 0, policy_version 938007 (0.0007) [2023-12-26 07:04:47,535][123090] Updated weights for policy 1, policy_version 931388 (0.0010) [2023-12-26 07:04:47,546][123091] Updated weights for policy 0, policy_version 938017 (0.0005) [2023-12-26 07:04:47,601][123091] Updated weights for policy 0, policy_version 938027 (0.0006) [2023-12-26 07:04:48,208][123091] Updated weights for policy 0, policy_version 938037 (0.0005) [2023-12-26 07:04:48,266][123091] Updated weights for policy 0, policy_version 938047 (0.0009) [2023-12-26 07:04:48,292][123090] Updated weights for policy 1, policy_version 931398 (0.0008) [2023-12-26 07:04:48,318][123091] Updated weights for policy 0, policy_version 938057 (0.0008) [2023-12-26 07:04:48,354][123090] Updated weights for policy 1, policy_version 931408 (0.0007) [2023-12-26 07:04:48,424][123090] Updated weights for policy 1, policy_version 931418 (0.0008) [2023-12-26 07:04:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 478593024. Throughput: 0: 8881.6, 1: 8969.7. Samples: 478602436. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:48,785][121949] Avg episode reward: [(0, '6277.996'), (1, '5582.376')] [2023-12-26 07:04:49,170][123091] Updated weights for policy 0, policy_version 938067 (0.0010) [2023-12-26 07:04:49,209][123090] Updated weights for policy 1, policy_version 931428 (0.0007) [2023-12-26 07:04:49,235][123091] Updated weights for policy 0, policy_version 938077 (0.0009) [2023-12-26 07:04:49,282][123090] Updated weights for policy 1, policy_version 931438 (0.0008) [2023-12-26 07:04:49,308][123091] Updated weights for policy 0, policy_version 938087 (0.0008) [2023-12-26 07:04:49,354][123090] Updated weights for policy 1, policy_version 931448 (0.0007) [2023-12-26 07:04:50,130][123090] Updated weights for policy 1, policy_version 931458 (0.0009) [2023-12-26 07:04:50,197][123091] Updated weights for policy 0, policy_version 938097 (0.0008) [2023-12-26 07:04:50,207][123090] Updated weights for policy 1, policy_version 931468 (0.0009) [2023-12-26 07:04:50,264][123091] Updated weights for policy 0, policy_version 938107 (0.0008) [2023-12-26 07:04:50,271][123090] Updated weights for policy 1, policy_version 931478 (0.0007) [2023-12-26 07:04:50,325][123091] Updated weights for policy 0, policy_version 938117 (0.0009) [2023-12-26 07:04:50,332][123090] Updated weights for policy 1, policy_version 931488 (0.0005) [2023-12-26 07:04:50,394][123091] Updated weights for policy 0, policy_version 938127 (0.0010) [2023-12-26 07:04:51,098][123090] Updated weights for policy 1, policy_version 931498 (0.0011) [2023-12-26 07:04:51,166][123090] Updated weights for policy 1, policy_version 931508 (0.0008) [2023-12-26 07:04:51,225][123090] Updated weights for policy 1, policy_version 931518 (0.0008) [2023-12-26 07:04:51,252][123091] Updated weights for policy 0, policy_version 938137 (0.0008) [2023-12-26 07:04:51,318][123091] Updated weights for policy 0, policy_version 938147 (0.0009) [2023-12-26 07:04:51,393][123091] Updated weights for policy 0, policy_version 938157 (0.0010) [2023-12-26 07:04:52,031][123090] Updated weights for policy 1, policy_version 931528 (0.0009) [2023-12-26 07:04:52,098][123090] Updated weights for policy 1, policy_version 931538 (0.0010) [2023-12-26 07:04:52,158][123090] Updated weights for policy 1, policy_version 931548 (0.0009) [2023-12-26 07:04:52,238][123091] Updated weights for policy 0, policy_version 938167 (0.0010) [2023-12-26 07:04:52,302][123091] Updated weights for policy 0, policy_version 938177 (0.0009) [2023-12-26 07:04:52,356][123091] Updated weights for policy 0, policy_version 938187 (0.0007) [2023-12-26 07:04:53,044][123090] Updated weights for policy 1, policy_version 931558 (0.0009) [2023-12-26 07:04:53,109][123090] Updated weights for policy 1, policy_version 931568 (0.0009) [2023-12-26 07:04:53,147][123091] Updated weights for policy 0, policy_version 938197 (0.0008) [2023-12-26 07:04:53,177][123090] Updated weights for policy 1, policy_version 931578 (0.0008) [2023-12-26 07:04:53,205][123091] Updated weights for policy 0, policy_version 938207 (0.0009) [2023-12-26 07:04:53,253][123091] Updated weights for policy 0, policy_version 938217 (0.0009) [2023-12-26 07:04:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 478674944. Throughput: 0: 8776.8, 1: 8987.4. Samples: 478654208. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 07:04:53,785][121949] Avg episode reward: [(0, '6210.902'), (1, '5611.562')] [2023-12-26 07:04:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000938224_240189440.pth... [2023-12-26 07:04:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000931584_238485504.pth... [2023-12-26 07:04:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000937232_239935488.pth [2023-12-26 07:04:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000930528_238215168.pth [2023-12-26 07:04:53,991][123090] Updated weights for policy 1, policy_version 931588 (0.0009) [2023-12-26 07:04:54,055][123090] Updated weights for policy 1, policy_version 931598 (0.0009) [2023-12-26 07:04:54,090][123091] Updated weights for policy 0, policy_version 938227 (0.0009) [2023-12-26 07:04:54,118][123090] Updated weights for policy 1, policy_version 931608 (0.0010) [2023-12-26 07:04:54,154][123091] Updated weights for policy 0, policy_version 938237 (0.0010) [2023-12-26 07:04:54,223][123091] Updated weights for policy 0, policy_version 938247 (0.0011) [2023-12-26 07:04:54,953][123091] Updated weights for policy 0, policy_version 938257 (0.0011) [2023-12-26 07:04:54,957][123090] Updated weights for policy 1, policy_version 931618 (0.0007) [2023-12-26 07:04:55,013][123091] Updated weights for policy 0, policy_version 938267 (0.0010) [2023-12-26 07:04:55,023][123090] Updated weights for policy 1, policy_version 931628 (0.0011) [2023-12-26 07:04:55,068][123091] Updated weights for policy 0, policy_version 938277 (0.0010) [2023-12-26 07:04:55,086][123090] Updated weights for policy 1, policy_version 931638 (0.0010) [2023-12-26 07:04:55,127][123091] Updated weights for policy 0, policy_version 938287 (0.0010) [2023-12-26 07:04:55,140][123090] Updated weights for policy 1, policy_version 931648 (0.0010) [2023-12-26 07:04:55,804][123090] Updated weights for policy 1, policy_version 931658 (0.0005) [2023-12-26 07:04:55,863][123090] Updated weights for policy 1, policy_version 931668 (0.0008) [2023-12-26 07:04:55,927][123090] Updated weights for policy 1, policy_version 931678 (0.0011) [2023-12-26 07:04:55,953][123091] Updated weights for policy 0, policy_version 938297 (0.0010) [2023-12-26 07:04:56,016][123091] Updated weights for policy 0, policy_version 938307 (0.0010) [2023-12-26 07:04:56,083][123091] Updated weights for policy 0, policy_version 938317 (0.0011) [2023-12-26 07:04:56,713][123090] Updated weights for policy 1, policy_version 931688 (0.0010) [2023-12-26 07:04:56,766][123090] Updated weights for policy 1, policy_version 931698 (0.0008) [2023-12-26 07:04:56,798][123091] Updated weights for policy 0, policy_version 938327 (0.0007) [2023-12-26 07:04:56,826][123090] Updated weights for policy 1, policy_version 931708 (0.0009) [2023-12-26 07:04:56,858][123091] Updated weights for policy 0, policy_version 938337 (0.0005) [2023-12-26 07:04:56,909][123091] Updated weights for policy 0, policy_version 938347 (0.0005) [2023-12-26 07:04:57,521][123091] Updated weights for policy 0, policy_version 938357 (0.0006) [2023-12-26 07:04:57,577][123091] Updated weights for policy 0, policy_version 938367 (0.0005) [2023-12-26 07:04:57,626][123091] Updated weights for policy 0, policy_version 938377 (0.0005) [2023-12-26 07:04:57,650][123090] Updated weights for policy 1, policy_version 931718 (0.0007) [2023-12-26 07:04:57,696][123090] Updated weights for policy 1, policy_version 931728 (0.0005) [2023-12-26 07:04:57,745][123090] Updated weights for policy 1, policy_version 931738 (0.0008) [2023-12-26 07:04:58,500][123091] Updated weights for policy 0, policy_version 938387 (0.0008) [2023-12-26 07:04:58,567][123091] Updated weights for policy 0, policy_version 938397 (0.0009) [2023-12-26 07:04:58,568][123090] Updated weights for policy 1, policy_version 931748 (0.0010) [2023-12-26 07:04:58,629][123091] Updated weights for policy 0, policy_version 938407 (0.0008) [2023-12-26 07:04:58,635][123090] Updated weights for policy 1, policy_version 931758 (0.0008) [2023-12-26 07:04:58,701][123090] Updated weights for policy 1, policy_version 931768 (0.0009) [2023-12-26 07:04:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 478773248. Throughput: 0: 8784.7, 1: 8994.1. Samples: 478761004. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:04:58,785][121949] Avg episode reward: [(0, '6148.192'), (1, '5691.599')] [2023-12-26 07:04:59,504][123091] Updated weights for policy 0, policy_version 938417 (0.0008) [2023-12-26 07:04:59,530][123090] Updated weights for policy 1, policy_version 931778 (0.0011) [2023-12-26 07:04:59,561][123091] Updated weights for policy 0, policy_version 938427 (0.0005) [2023-12-26 07:04:59,584][123090] Updated weights for policy 1, policy_version 931788 (0.0005) [2023-12-26 07:04:59,620][123091] Updated weights for policy 0, policy_version 938437 (0.0005) [2023-12-26 07:04:59,641][123090] Updated weights for policy 1, policy_version 931798 (0.0005) [2023-12-26 07:04:59,687][123091] Updated weights for policy 0, policy_version 938447 (0.0005) [2023-12-26 07:04:59,707][123090] Updated weights for policy 1, policy_version 931808 (0.0005) [2023-12-26 07:05:00,415][123091] Updated weights for policy 0, policy_version 938457 (0.0010) [2023-12-26 07:05:00,444][123090] Updated weights for policy 1, policy_version 931818 (0.0007) [2023-12-26 07:05:00,467][123091] Updated weights for policy 0, policy_version 938467 (0.0010) [2023-12-26 07:05:00,494][123090] Updated weights for policy 1, policy_version 931828 (0.0005) [2023-12-26 07:05:00,523][123091] Updated weights for policy 0, policy_version 938477 (0.0010) [2023-12-26 07:05:00,544][123090] Updated weights for policy 1, policy_version 931838 (0.0005) [2023-12-26 07:05:01,387][123091] Updated weights for policy 0, policy_version 938487 (0.0011) [2023-12-26 07:05:01,395][123090] Updated weights for policy 1, policy_version 931848 (0.0008) [2023-12-26 07:05:01,455][123091] Updated weights for policy 0, policy_version 938497 (0.0011) [2023-12-26 07:05:01,464][123090] Updated weights for policy 1, policy_version 931858 (0.0006) [2023-12-26 07:05:01,526][123091] Updated weights for policy 0, policy_version 938507 (0.0011) [2023-12-26 07:05:01,538][123090] Updated weights for policy 1, policy_version 931868 (0.0006) [2023-12-26 07:05:02,238][123091] Updated weights for policy 0, policy_version 938517 (0.0010) [2023-12-26 07:05:02,307][123091] Updated weights for policy 0, policy_version 938527 (0.0009) [2023-12-26 07:05:02,341][123090] Updated weights for policy 1, policy_version 931878 (0.0006) [2023-12-26 07:05:02,371][123091] Updated weights for policy 0, policy_version 938537 (0.0009) [2023-12-26 07:05:02,412][123090] Updated weights for policy 1, policy_version 931888 (0.0009) [2023-12-26 07:05:02,468][123090] Updated weights for policy 1, policy_version 931898 (0.0007) [2023-12-26 07:05:03,089][123091] Updated weights for policy 0, policy_version 938547 (0.0007) [2023-12-26 07:05:03,151][123091] Updated weights for policy 0, policy_version 938557 (0.0008) [2023-12-26 07:05:03,205][123090] Updated weights for policy 1, policy_version 931908 (0.0007) [2023-12-26 07:05:03,213][123091] Updated weights for policy 0, policy_version 938567 (0.0008) [2023-12-26 07:05:03,256][123090] Updated weights for policy 1, policy_version 931918 (0.0008) [2023-12-26 07:05:03,304][123090] Updated weights for policy 1, policy_version 931928 (0.0005) [2023-12-26 07:05:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 478855168. Throughput: 0: 8718.9, 1: 8986.1. Samples: 478867832. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:03,785][121949] Avg episode reward: [(0, '6100.051'), (1, '5612.500')] [2023-12-26 07:05:03,964][123090] Updated weights for policy 1, policy_version 931938 (0.0009) [2023-12-26 07:05:04,014][123091] Updated weights for policy 0, policy_version 938577 (0.0007) [2023-12-26 07:05:04,020][123090] Updated weights for policy 1, policy_version 931948 (0.0010) [2023-12-26 07:05:04,069][123091] Updated weights for policy 0, policy_version 938587 (0.0005) [2023-12-26 07:05:04,085][123090] Updated weights for policy 1, policy_version 931958 (0.0008) [2023-12-26 07:05:04,127][123091] Updated weights for policy 0, policy_version 938597 (0.0006) [2023-12-26 07:05:04,144][123090] Updated weights for policy 1, policy_version 931968 (0.0008) [2023-12-26 07:05:04,183][123091] Updated weights for policy 0, policy_version 938607 (0.0010) [2023-12-26 07:05:04,931][123091] Updated weights for policy 0, policy_version 938617 (0.0010) [2023-12-26 07:05:04,995][123091] Updated weights for policy 0, policy_version 938627 (0.0007) [2023-12-26 07:05:05,049][123090] Updated weights for policy 1, policy_version 931978 (0.0010) [2023-12-26 07:05:05,055][123091] Updated weights for policy 0, policy_version 938637 (0.0008) [2023-12-26 07:05:05,103][123090] Updated weights for policy 1, policy_version 931988 (0.0008) [2023-12-26 07:05:05,157][123090] Updated weights for policy 1, policy_version 931998 (0.0007) [2023-12-26 07:05:05,778][123091] Updated weights for policy 0, policy_version 938647 (0.0006) [2023-12-26 07:05:05,826][123091] Updated weights for policy 0, policy_version 938657 (0.0006) [2023-12-26 07:05:05,878][123091] Updated weights for policy 0, policy_version 938667 (0.0009) [2023-12-26 07:05:05,963][123090] Updated weights for policy 1, policy_version 932008 (0.0008) [2023-12-26 07:05:06,026][123090] Updated weights for policy 1, policy_version 932018 (0.0009) [2023-12-26 07:05:06,082][123090] Updated weights for policy 1, policy_version 932028 (0.0009) [2023-12-26 07:05:06,700][123091] Updated weights for policy 0, policy_version 938677 (0.0009) [2023-12-26 07:05:06,764][123091] Updated weights for policy 0, policy_version 938687 (0.0010) [2023-12-26 07:05:06,813][123091] Updated weights for policy 0, policy_version 938697 (0.0009) [2023-12-26 07:05:06,934][123090] Updated weights for policy 1, policy_version 932038 (0.0010) [2023-12-26 07:05:06,986][123090] Updated weights for policy 1, policy_version 932048 (0.0010) [2023-12-26 07:05:07,040][123090] Updated weights for policy 1, policy_version 932058 (0.0010) [2023-12-26 07:05:07,642][123091] Updated weights for policy 0, policy_version 938707 (0.0008) [2023-12-26 07:05:07,717][123091] Updated weights for policy 0, policy_version 938717 (0.0007) [2023-12-26 07:05:07,775][123091] Updated weights for policy 0, policy_version 938727 (0.0011) [2023-12-26 07:05:07,863][123090] Updated weights for policy 1, policy_version 932068 (0.0009) [2023-12-26 07:05:07,916][123090] Updated weights for policy 1, policy_version 932078 (0.0005) [2023-12-26 07:05:07,976][123090] Updated weights for policy 1, policy_version 932088 (0.0006) [2023-12-26 07:05:08,507][123091] Updated weights for policy 0, policy_version 938737 (0.0010) [2023-12-26 07:05:08,569][123091] Updated weights for policy 0, policy_version 938747 (0.0011) [2023-12-26 07:05:08,627][123091] Updated weights for policy 0, policy_version 938757 (0.0010) [2023-12-26 07:05:08,694][123091] Updated weights for policy 0, policy_version 938767 (0.0011) [2023-12-26 07:05:08,782][123090] Updated weights for policy 1, policy_version 932098 (0.0010) [2023-12-26 07:05:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 478945280. Throughput: 0: 8716.3, 1: 8964.4. Samples: 478920812. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:08,785][121949] Avg episode reward: [(0, '6048.202'), (1, '5561.943')] [2023-12-26 07:05:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000938768_240328704.pth... [2023-12-26 07:05:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000937744_240066560.pth [2023-12-26 07:05:08,845][123090] Updated weights for policy 1, policy_version 932108 (0.0010) [2023-12-26 07:05:08,912][123090] Updated weights for policy 1, policy_version 932118 (0.0010) [2023-12-26 07:05:08,975][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000932128_238624768.pth... [2023-12-26 07:05:08,978][123090] Updated weights for policy 1, policy_version 932128 (0.0010) [2023-12-26 07:05:08,980][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000931072_238354432.pth [2023-12-26 07:05:09,549][123091] Updated weights for policy 0, policy_version 938777 (0.0010) [2023-12-26 07:05:09,618][123091] Updated weights for policy 0, policy_version 938787 (0.0010) [2023-12-26 07:05:09,681][123091] Updated weights for policy 0, policy_version 938797 (0.0008) [2023-12-26 07:05:09,788][123090] Updated weights for policy 1, policy_version 932138 (0.0009) [2023-12-26 07:05:09,846][123090] Updated weights for policy 1, policy_version 932148 (0.0009) [2023-12-26 07:05:09,911][123090] Updated weights for policy 1, policy_version 932158 (0.0009) [2023-12-26 07:05:10,517][123091] Updated weights for policy 0, policy_version 938807 (0.0011) [2023-12-26 07:05:10,569][123091] Updated weights for policy 0, policy_version 938817 (0.0011) [2023-12-26 07:05:10,628][123090] Updated weights for policy 1, policy_version 932168 (0.0006) [2023-12-26 07:05:10,632][123091] Updated weights for policy 0, policy_version 938827 (0.0011) [2023-12-26 07:05:10,693][123090] Updated weights for policy 1, policy_version 932178 (0.0005) [2023-12-26 07:05:10,754][123090] Updated weights for policy 1, policy_version 932188 (0.0005) [2023-12-26 07:05:11,478][123091] Updated weights for policy 0, policy_version 938837 (0.0008) [2023-12-26 07:05:11,532][123090] Updated weights for policy 1, policy_version 932198 (0.0007) [2023-12-26 07:05:11,548][123091] Updated weights for policy 0, policy_version 938847 (0.0006) [2023-12-26 07:05:11,602][123090] Updated weights for policy 1, policy_version 932208 (0.0008) [2023-12-26 07:05:11,614][123091] Updated weights for policy 0, policy_version 938857 (0.0007) [2023-12-26 07:05:11,686][123090] Updated weights for policy 1, policy_version 932218 (0.0007) [2023-12-26 07:05:12,422][123091] Updated weights for policy 0, policy_version 938867 (0.0008) [2023-12-26 07:05:12,482][123091] Updated weights for policy 0, policy_version 938877 (0.0008) [2023-12-26 07:05:12,498][123090] Updated weights for policy 1, policy_version 932228 (0.0007) [2023-12-26 07:05:12,533][123091] Updated weights for policy 0, policy_version 938887 (0.0007) [2023-12-26 07:05:12,568][123090] Updated weights for policy 1, policy_version 932238 (0.0007) [2023-12-26 07:05:12,626][123090] Updated weights for policy 1, policy_version 932248 (0.0009) [2023-12-26 07:05:13,341][123091] Updated weights for policy 0, policy_version 938897 (0.0005) [2023-12-26 07:05:13,398][123091] Updated weights for policy 0, policy_version 938907 (0.0005) [2023-12-26 07:05:13,450][123091] Updated weights for policy 0, policy_version 938917 (0.0005) [2023-12-26 07:05:13,471][123090] Updated weights for policy 1, policy_version 932258 (0.0009) [2023-12-26 07:05:13,505][123091] Updated weights for policy 0, policy_version 938927 (0.0006) [2023-12-26 07:05:13,526][123090] Updated weights for policy 1, policy_version 932268 (0.0008) [2023-12-26 07:05:13,579][123090] Updated weights for policy 1, policy_version 932278 (0.0009) [2023-12-26 07:05:13,655][123090] Updated weights for policy 1, policy_version 932288 (0.0010) [2023-12-26 07:05:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 479035392. Throughput: 0: 8738.5, 1: 8860.1. Samples: 479025684. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:13,785][121949] Avg episode reward: [(0, '6184.791'), (1, '5539.314')] [2023-12-26 07:05:14,240][123091] Updated weights for policy 0, policy_version 938937 (0.0005) [2023-12-26 07:05:14,305][123091] Updated weights for policy 0, policy_version 938947 (0.0007) [2023-12-26 07:05:14,373][123091] Updated weights for policy 0, policy_version 938957 (0.0009) [2023-12-26 07:05:14,542][123090] Updated weights for policy 1, policy_version 932298 (0.0009) [2023-12-26 07:05:14,610][123090] Updated weights for policy 1, policy_version 932308 (0.0009) [2023-12-26 07:05:14,664][123090] Updated weights for policy 1, policy_version 932318 (0.0010) [2023-12-26 07:05:15,037][123091] Updated weights for policy 0, policy_version 938967 (0.0009) [2023-12-26 07:05:15,096][123091] Updated weights for policy 0, policy_version 938977 (0.0010) [2023-12-26 07:05:15,156][123091] Updated weights for policy 0, policy_version 938987 (0.0009) [2023-12-26 07:05:15,520][123090] Updated weights for policy 1, policy_version 932328 (0.0009) [2023-12-26 07:05:15,576][123090] Updated weights for policy 1, policy_version 932338 (0.0009) [2023-12-26 07:05:15,628][123090] Updated weights for policy 1, policy_version 932348 (0.0010) [2023-12-26 07:05:15,975][123091] Updated weights for policy 0, policy_version 938997 (0.0010) [2023-12-26 07:05:16,043][123091] Updated weights for policy 0, policy_version 939007 (0.0010) [2023-12-26 07:05:16,102][123091] Updated weights for policy 0, policy_version 939017 (0.0009) [2023-12-26 07:05:16,527][123090] Updated weights for policy 1, policy_version 932358 (0.0009) [2023-12-26 07:05:16,579][123090] Updated weights for policy 1, policy_version 932369 (0.0010) [2023-12-26 07:05:16,632][123090] Updated weights for policy 1, policy_version 932380 (0.0010) [2023-12-26 07:05:16,761][123091] Updated weights for policy 0, policy_version 939027 (0.0006) [2023-12-26 07:05:16,818][123091] Updated weights for policy 0, policy_version 939037 (0.0010) [2023-12-26 07:05:16,879][123091] Updated weights for policy 0, policy_version 939047 (0.0007) [2023-12-26 07:05:17,525][123090] Updated weights for policy 1, policy_version 932391 (0.0010) [2023-12-26 07:05:17,587][123090] Updated weights for policy 1, policy_version 932401 (0.0009) [2023-12-26 07:05:17,658][123090] Updated weights for policy 1, policy_version 932411 (0.0008) [2023-12-26 07:05:17,679][123091] Updated weights for policy 0, policy_version 939057 (0.0005) [2023-12-26 07:05:17,740][123091] Updated weights for policy 0, policy_version 939067 (0.0005) [2023-12-26 07:05:17,795][123091] Updated weights for policy 0, policy_version 939077 (0.0005) [2023-12-26 07:05:17,851][123091] Updated weights for policy 0, policy_version 939087 (0.0005) [2023-12-26 07:05:18,536][123090] Updated weights for policy 1, policy_version 932421 (0.0010) [2023-12-26 07:05:18,541][123091] Updated weights for policy 0, policy_version 939097 (0.0007) [2023-12-26 07:05:18,597][123091] Updated weights for policy 0, policy_version 939107 (0.0011) [2023-12-26 07:05:18,605][123090] Updated weights for policy 1, policy_version 932431 (0.0011) [2023-12-26 07:05:18,647][123091] Updated weights for policy 0, policy_version 939117 (0.0010) [2023-12-26 07:05:18,665][123090] Updated weights for policy 1, policy_version 932441 (0.0010) [2023-12-26 07:05:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 479125504. Throughput: 0: 8859.0, 1: 8783.5. Samples: 479131888. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:18,785][121949] Avg episode reward: [(0, '6257.313'), (1, '5445.263')] [2023-12-26 07:05:19,431][123090] Updated weights for policy 1, policy_version 932451 (0.0010) [2023-12-26 07:05:19,500][123090] Updated weights for policy 1, policy_version 932461 (0.0009) [2023-12-26 07:05:19,509][123091] Updated weights for policy 0, policy_version 939127 (0.0009) [2023-12-26 07:05:19,563][123090] Updated weights for policy 1, policy_version 932471 (0.0009) [2023-12-26 07:05:19,566][123091] Updated weights for policy 0, policy_version 939137 (0.0008) [2023-12-26 07:05:19,625][123091] Updated weights for policy 0, policy_version 939147 (0.0008) [2023-12-26 07:05:20,396][123090] Updated weights for policy 1, policy_version 932481 (0.0009) [2023-12-26 07:05:20,459][123090] Updated weights for policy 1, policy_version 932491 (0.0009) [2023-12-26 07:05:20,459][123091] Updated weights for policy 0, policy_version 939157 (0.0008) [2023-12-26 07:05:20,514][123090] Updated weights for policy 1, policy_version 932501 (0.0005) [2023-12-26 07:05:20,528][123091] Updated weights for policy 0, policy_version 939167 (0.0010) [2023-12-26 07:05:20,578][123090] Updated weights for policy 1, policy_version 932511 (0.0007) [2023-12-26 07:05:20,603][123091] Updated weights for policy 0, policy_version 939177 (0.0009) [2023-12-26 07:05:21,302][123091] Updated weights for policy 0, policy_version 939187 (0.0009) [2023-12-26 07:05:21,381][123091] Updated weights for policy 0, policy_version 939197 (0.0008) [2023-12-26 07:05:21,385][123090] Updated weights for policy 1, policy_version 932521 (0.0008) [2023-12-26 07:05:21,450][123090] Updated weights for policy 1, policy_version 932531 (0.0006) [2023-12-26 07:05:21,454][123091] Updated weights for policy 0, policy_version 939207 (0.0008) [2023-12-26 07:05:21,508][123090] Updated weights for policy 1, policy_version 932541 (0.0005) [2023-12-26 07:05:22,173][123091] Updated weights for policy 0, policy_version 939217 (0.0008) [2023-12-26 07:05:22,235][123091] Updated weights for policy 0, policy_version 939227 (0.0010) [2023-12-26 07:05:22,302][123091] Updated weights for policy 0, policy_version 939237 (0.0008) [2023-12-26 07:05:22,316][123090] Updated weights for policy 1, policy_version 932551 (0.0007) [2023-12-26 07:05:22,374][123091] Updated weights for policy 0, policy_version 939247 (0.0007) [2023-12-26 07:05:22,393][123090] Updated weights for policy 1, policy_version 932561 (0.0008) [2023-12-26 07:05:22,467][123090] Updated weights for policy 1, policy_version 932571 (0.0008) [2023-12-26 07:05:23,186][123091] Updated weights for policy 0, policy_version 939257 (0.0009) [2023-12-26 07:05:23,239][123091] Updated weights for policy 0, policy_version 939267 (0.0009) [2023-12-26 07:05:23,284][123090] Updated weights for policy 1, policy_version 932581 (0.0009) [2023-12-26 07:05:23,287][123091] Updated weights for policy 0, policy_version 939277 (0.0008) [2023-12-26 07:05:23,348][123090] Updated weights for policy 1, policy_version 932591 (0.0011) [2023-12-26 07:05:23,420][123090] Updated weights for policy 1, policy_version 932601 (0.0010) [2023-12-26 07:05:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 479207424. Throughput: 0: 8858.4, 1: 8768.5. Samples: 479184220. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:23,785][121949] Avg episode reward: [(0, '6249.886'), (1, '5458.251')] [2023-12-26 07:05:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000932608_238747648.pth... [2023-12-26 07:05:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000939280_240459776.pth... [2023-12-26 07:05:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000931584_238485504.pth [2023-12-26 07:05:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000938224_240189440.pth [2023-12-26 07:05:24,010][123090] Updated weights for policy 1, policy_version 932611 (0.0006) [2023-12-26 07:05:24,084][123090] Updated weights for policy 1, policy_version 932621 (0.0005) [2023-12-26 07:05:24,153][123090] Updated weights for policy 1, policy_version 932631 (0.0008) [2023-12-26 07:05:24,193][123091] Updated weights for policy 0, policy_version 939287 (0.0009) [2023-12-26 07:05:24,247][123091] Updated weights for policy 0, policy_version 939297 (0.0008) [2023-12-26 07:05:24,296][123091] Updated weights for policy 0, policy_version 939307 (0.0009) [2023-12-26 07:05:24,792][123090] Updated weights for policy 1, policy_version 932641 (0.0010) [2023-12-26 07:05:24,842][123090] Updated weights for policy 1, policy_version 932651 (0.0005) [2023-12-26 07:05:24,890][123090] Updated weights for policy 1, policy_version 932661 (0.0005) [2023-12-26 07:05:24,941][123090] Updated weights for policy 1, policy_version 932671 (0.0005) [2023-12-26 07:05:25,223][123091] Updated weights for policy 0, policy_version 939317 (0.0009) [2023-12-26 07:05:25,279][123091] Updated weights for policy 0, policy_version 939327 (0.0009) [2023-12-26 07:05:25,333][123091] Updated weights for policy 0, policy_version 939337 (0.0009) [2023-12-26 07:05:25,584][123090] Updated weights for policy 1, policy_version 932681 (0.0010) [2023-12-26 07:05:25,638][123090] Updated weights for policy 1, policy_version 932691 (0.0010) [2023-12-26 07:05:25,700][123090] Updated weights for policy 1, policy_version 932701 (0.0010) [2023-12-26 07:05:26,215][123091] Updated weights for policy 0, policy_version 939347 (0.0010) [2023-12-26 07:05:26,286][123091] Updated weights for policy 0, policy_version 939357 (0.0010) [2023-12-26 07:05:26,359][123091] Updated weights for policy 0, policy_version 939367 (0.0009) [2023-12-26 07:05:26,436][123090] Updated weights for policy 1, policy_version 932711 (0.0006) [2023-12-26 07:05:26,491][123090] Updated weights for policy 1, policy_version 932721 (0.0005) [2023-12-26 07:05:26,554][123090] Updated weights for policy 1, policy_version 932731 (0.0005) [2023-12-26 07:05:27,234][123091] Updated weights for policy 0, policy_version 939377 (0.0009) [2023-12-26 07:05:27,300][123091] Updated weights for policy 0, policy_version 939387 (0.0008) [2023-12-26 07:05:27,329][123090] Updated weights for policy 1, policy_version 932741 (0.0006) [2023-12-26 07:05:27,360][123091] Updated weights for policy 0, policy_version 939397 (0.0009) [2023-12-26 07:05:27,378][123090] Updated weights for policy 1, policy_version 932751 (0.0006) [2023-12-26 07:05:27,413][123091] Updated weights for policy 0, policy_version 939407 (0.0009) [2023-12-26 07:05:27,431][123090] Updated weights for policy 1, policy_version 932761 (0.0006) [2023-12-26 07:05:28,076][123090] Updated weights for policy 1, policy_version 932771 (0.0006) [2023-12-26 07:05:28,080][123091] Updated weights for policy 0, policy_version 939417 (0.0006) [2023-12-26 07:05:28,131][123090] Updated weights for policy 1, policy_version 932781 (0.0007) [2023-12-26 07:05:28,148][123091] Updated weights for policy 0, policy_version 939427 (0.0006) [2023-12-26 07:05:28,177][123090] Updated weights for policy 1, policy_version 932791 (0.0007) [2023-12-26 07:05:28,215][123091] Updated weights for policy 0, policy_version 939437 (0.0005) [2023-12-26 07:05:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 479297536. Throughput: 0: 8799.9, 1: 8881.3. Samples: 479291904. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:28,784][121949] Avg episode reward: [(0, '6248.381'), (1, '5482.005')] [2023-12-26 07:05:28,866][123090] Updated weights for policy 1, policy_version 932801 (0.0006) [2023-12-26 07:05:28,898][123091] Updated weights for policy 0, policy_version 939447 (0.0006) [2023-12-26 07:05:28,923][123090] Updated weights for policy 1, policy_version 932811 (0.0009) [2023-12-26 07:05:28,950][123091] Updated weights for policy 0, policy_version 939457 (0.0005) [2023-12-26 07:05:28,977][123090] Updated weights for policy 1, policy_version 932821 (0.0009) [2023-12-26 07:05:29,013][123091] Updated weights for policy 0, policy_version 939467 (0.0010) [2023-12-26 07:05:29,033][123090] Updated weights for policy 1, policy_version 932831 (0.0007) [2023-12-26 07:05:29,674][123091] Updated weights for policy 0, policy_version 939477 (0.0006) [2023-12-26 07:05:29,745][123091] Updated weights for policy 0, policy_version 939487 (0.0005) [2023-12-26 07:05:29,818][123091] Updated weights for policy 0, policy_version 939497 (0.0006) [2023-12-26 07:05:29,834][123090] Updated weights for policy 1, policy_version 932841 (0.0007) [2023-12-26 07:05:29,895][123090] Updated weights for policy 1, policy_version 932851 (0.0010) [2023-12-26 07:05:29,970][123090] Updated weights for policy 1, policy_version 932861 (0.0009) [2023-12-26 07:05:30,563][123091] Updated weights for policy 0, policy_version 939507 (0.0009) [2023-12-26 07:05:30,616][123091] Updated weights for policy 0, policy_version 939517 (0.0009) [2023-12-26 07:05:30,665][123091] Updated weights for policy 0, policy_version 939528 (0.0009) [2023-12-26 07:05:30,724][123090] Updated weights for policy 1, policy_version 932871 (0.0006) [2023-12-26 07:05:30,778][123090] Updated weights for policy 1, policy_version 932881 (0.0005) [2023-12-26 07:05:30,827][123090] Updated weights for policy 1, policy_version 932891 (0.0005) [2023-12-26 07:05:31,580][123091] Updated weights for policy 0, policy_version 939538 (0.0010) [2023-12-26 07:05:31,620][123090] Updated weights for policy 1, policy_version 932901 (0.0007) [2023-12-26 07:05:31,639][123091] Updated weights for policy 0, policy_version 939548 (0.0008) [2023-12-26 07:05:31,684][123090] Updated weights for policy 1, policy_version 932911 (0.0009) [2023-12-26 07:05:31,691][123091] Updated weights for policy 0, policy_version 939558 (0.0007) [2023-12-26 07:05:31,747][123090] Updated weights for policy 1, policy_version 932921 (0.0009) [2023-12-26 07:05:31,751][123091] Updated weights for policy 0, policy_version 939568 (0.0009) [2023-12-26 07:05:32,485][123090] Updated weights for policy 1, policy_version 932931 (0.0008) [2023-12-26 07:05:32,552][123090] Updated weights for policy 1, policy_version 932941 (0.0009) [2023-12-26 07:05:32,605][123090] Updated weights for policy 1, policy_version 932951 (0.0010) [2023-12-26 07:05:32,704][123091] Updated weights for policy 0, policy_version 939578 (0.0010) [2023-12-26 07:05:32,767][123091] Updated weights for policy 0, policy_version 939588 (0.0010) [2023-12-26 07:05:32,823][123091] Updated weights for policy 0, policy_version 939598 (0.0010) [2023-12-26 07:05:33,444][123090] Updated weights for policy 1, policy_version 932961 (0.0010) [2023-12-26 07:05:33,517][123090] Updated weights for policy 1, policy_version 932971 (0.0010) [2023-12-26 07:05:33,588][123090] Updated weights for policy 1, policy_version 932981 (0.0010) [2023-12-26 07:05:33,637][123091] Updated weights for policy 0, policy_version 939608 (0.0010) [2023-12-26 07:05:33,653][123090] Updated weights for policy 1, policy_version 932991 (0.0010) [2023-12-26 07:05:33,696][123091] Updated weights for policy 0, policy_version 939618 (0.0011) [2023-12-26 07:05:33,765][123091] Updated weights for policy 0, policy_version 939628 (0.0005) [2023-12-26 07:05:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 479387648. Throughput: 0: 8854.9, 1: 8904.5. Samples: 479401604. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:33,785][121949] Avg episode reward: [(0, '6177.533'), (1, '5348.627')] [2023-12-26 07:05:34,426][123091] Updated weights for policy 0, policy_version 939638 (0.0008) [2023-12-26 07:05:34,483][123091] Updated weights for policy 0, policy_version 939648 (0.0011) [2023-12-26 07:05:34,499][123090] Updated weights for policy 1, policy_version 933001 (0.0008) [2023-12-26 07:05:34,547][123091] Updated weights for policy 0, policy_version 939658 (0.0011) [2023-12-26 07:05:34,559][123090] Updated weights for policy 1, policy_version 933011 (0.0007) [2023-12-26 07:05:34,618][123090] Updated weights for policy 1, policy_version 933021 (0.0008) [2023-12-26 07:05:35,379][123091] Updated weights for policy 0, policy_version 939668 (0.0011) [2023-12-26 07:05:35,428][123090] Updated weights for policy 1, policy_version 933031 (0.0007) [2023-12-26 07:05:35,438][123091] Updated weights for policy 0, policy_version 939678 (0.0011) [2023-12-26 07:05:35,480][123090] Updated weights for policy 1, policy_version 933041 (0.0007) [2023-12-26 07:05:35,497][123091] Updated weights for policy 0, policy_version 939688 (0.0011) [2023-12-26 07:05:35,531][123090] Updated weights for policy 1, policy_version 933051 (0.0008) [2023-12-26 07:05:36,241][123090] Updated weights for policy 1, policy_version 933061 (0.0009) [2023-12-26 07:05:36,299][123090] Updated weights for policy 1, policy_version 933071 (0.0009) [2023-12-26 07:05:36,355][123090] Updated weights for policy 1, policy_version 933081 (0.0007) [2023-12-26 07:05:36,367][123091] Updated weights for policy 0, policy_version 939698 (0.0011) [2023-12-26 07:05:36,426][123091] Updated weights for policy 0, policy_version 939708 (0.0009) [2023-12-26 07:05:36,481][123091] Updated weights for policy 0, policy_version 939718 (0.0010) [2023-12-26 07:05:36,535][123091] Updated weights for policy 0, policy_version 939728 (0.0010) [2023-12-26 07:05:37,081][123090] Updated weights for policy 1, policy_version 933091 (0.0006) [2023-12-26 07:05:37,130][123090] Updated weights for policy 1, policy_version 933101 (0.0009) [2023-12-26 07:05:37,183][123090] Updated weights for policy 1, policy_version 933111 (0.0010) [2023-12-26 07:05:37,441][123091] Updated weights for policy 0, policy_version 939738 (0.0010) [2023-12-26 07:05:37,492][123091] Updated weights for policy 0, policy_version 939748 (0.0009) [2023-12-26 07:05:37,543][123091] Updated weights for policy 0, policy_version 939758 (0.0010) [2023-12-26 07:05:38,070][123090] Updated weights for policy 1, policy_version 933121 (0.0009) [2023-12-26 07:05:38,128][123090] Updated weights for policy 1, policy_version 933131 (0.0010) [2023-12-26 07:05:38,177][123090] Updated weights for policy 1, policy_version 933141 (0.0008) [2023-12-26 07:05:38,228][123090] Updated weights for policy 1, policy_version 933151 (0.0005) [2023-12-26 07:05:38,373][123091] Updated weights for policy 0, policy_version 939768 (0.0010) [2023-12-26 07:05:38,440][123091] Updated weights for policy 0, policy_version 939778 (0.0010) [2023-12-26 07:05:38,509][123091] Updated weights for policy 0, policy_version 939788 (0.0009) [2023-12-26 07:05:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 479477760. Throughput: 0: 8890.0, 1: 8883.0. Samples: 479453996. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:38,785][121949] Avg episode reward: [(0, '6101.717'), (1, '5355.690')] [2023-12-26 07:05:38,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000939792_240590848.pth... [2023-12-26 07:05:38,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000933152_238886912.pth... [2023-12-26 07:05:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000938768_240328704.pth [2023-12-26 07:05:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000932128_238624768.pth [2023-12-26 07:05:38,997][123090] Updated weights for policy 1, policy_version 933161 (0.0007) [2023-12-26 07:05:39,071][123090] Updated weights for policy 1, policy_version 933171 (0.0005) [2023-12-26 07:05:39,149][123090] Updated weights for policy 1, policy_version 933181 (0.0005) [2023-12-26 07:05:39,149][123091] Updated weights for policy 0, policy_version 939798 (0.0006) [2023-12-26 07:05:39,200][123091] Updated weights for policy 0, policy_version 939808 (0.0010) [2023-12-26 07:05:39,268][123091] Updated weights for policy 0, policy_version 939818 (0.0011) [2023-12-26 07:05:39,942][123090] Updated weights for policy 1, policy_version 933191 (0.0008) [2023-12-26 07:05:40,006][123090] Updated weights for policy 1, policy_version 933201 (0.0009) [2023-12-26 07:05:40,051][123091] Updated weights for policy 0, policy_version 939828 (0.0009) [2023-12-26 07:05:40,078][123090] Updated weights for policy 1, policy_version 933211 (0.0009) [2023-12-26 07:05:40,111][123091] Updated weights for policy 0, policy_version 939838 (0.0006) [2023-12-26 07:05:40,182][123091] Updated weights for policy 0, policy_version 939848 (0.0006) [2023-12-26 07:05:40,888][123091] Updated weights for policy 0, policy_version 939858 (0.0006) [2023-12-26 07:05:40,945][123090] Updated weights for policy 1, policy_version 933221 (0.0009) [2023-12-26 07:05:40,958][123091] Updated weights for policy 0, policy_version 939868 (0.0005) [2023-12-26 07:05:41,013][123090] Updated weights for policy 1, policy_version 933231 (0.0008) [2023-12-26 07:05:41,029][123091] Updated weights for policy 0, policy_version 939878 (0.0006) [2023-12-26 07:05:41,082][123090] Updated weights for policy 1, policy_version 933241 (0.0009) [2023-12-26 07:05:41,102][123091] Updated weights for policy 0, policy_version 939888 (0.0006) [2023-12-26 07:05:41,907][123091] Updated weights for policy 0, policy_version 939898 (0.0006) [2023-12-26 07:05:41,951][123090] Updated weights for policy 1, policy_version 933251 (0.0009) [2023-12-26 07:05:41,977][123091] Updated weights for policy 0, policy_version 939908 (0.0005) [2023-12-26 07:05:42,021][123090] Updated weights for policy 1, policy_version 933261 (0.0009) [2023-12-26 07:05:42,050][123091] Updated weights for policy 0, policy_version 939918 (0.0006) [2023-12-26 07:05:42,094][123090] Updated weights for policy 1, policy_version 933271 (0.0009) [2023-12-26 07:05:42,798][123091] Updated weights for policy 0, policy_version 939928 (0.0007) [2023-12-26 07:05:42,862][123091] Updated weights for policy 0, policy_version 939938 (0.0009) [2023-12-26 07:05:42,915][123090] Updated weights for policy 1, policy_version 933281 (0.0009) [2023-12-26 07:05:42,926][123091] Updated weights for policy 0, policy_version 939948 (0.0009) [2023-12-26 07:05:42,974][123090] Updated weights for policy 1, policy_version 933291 (0.0010) [2023-12-26 07:05:43,040][123090] Updated weights for policy 1, policy_version 933301 (0.0010) [2023-12-26 07:05:43,111][123090] Updated weights for policy 1, policy_version 933311 (0.0011) [2023-12-26 07:05:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 479559680. Throughput: 0: 8877.6, 1: 8851.6. Samples: 479558816. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:43,785][121949] Avg episode reward: [(0, '6014.932'), (1, '5468.055')] [2023-12-26 07:05:43,792][123090] Updated weights for policy 1, policy_version 933321 (0.0006) [2023-12-26 07:05:43,808][123091] Updated weights for policy 0, policy_version 939958 (0.0008) [2023-12-26 07:05:43,851][123090] Updated weights for policy 1, policy_version 933331 (0.0005) [2023-12-26 07:05:43,871][123091] Updated weights for policy 0, policy_version 939968 (0.0009) [2023-12-26 07:05:43,905][123090] Updated weights for policy 1, policy_version 933341 (0.0005) [2023-12-26 07:05:43,942][123091] Updated weights for policy 0, policy_version 939978 (0.0005) [2023-12-26 07:05:44,619][123090] Updated weights for policy 1, policy_version 933351 (0.0005) [2023-12-26 07:05:44,665][123090] Updated weights for policy 1, policy_version 933361 (0.0005) [2023-12-26 07:05:44,712][123090] Updated weights for policy 1, policy_version 933371 (0.0005) [2023-12-26 07:05:44,821][123091] Updated weights for policy 0, policy_version 939988 (0.0007) [2023-12-26 07:05:44,880][123091] Updated weights for policy 0, policy_version 939998 (0.0011) [2023-12-26 07:05:44,946][123091] Updated weights for policy 0, policy_version 940008 (0.0010) [2023-12-26 07:05:45,430][123090] Updated weights for policy 1, policy_version 933381 (0.0005) [2023-12-26 07:05:45,485][123090] Updated weights for policy 1, policy_version 933391 (0.0005) [2023-12-26 07:05:45,555][123090] Updated weights for policy 1, policy_version 933401 (0.0005) [2023-12-26 07:05:45,888][123091] Updated weights for policy 0, policy_version 940018 (0.0009) [2023-12-26 07:05:45,941][123091] Updated weights for policy 0, policy_version 940028 (0.0010) [2023-12-26 07:05:45,997][123091] Updated weights for policy 0, policy_version 940040 (0.0011) [2023-12-26 07:05:46,217][123090] Updated weights for policy 1, policy_version 933411 (0.0006) [2023-12-26 07:05:46,281][123090] Updated weights for policy 1, policy_version 933421 (0.0006) [2023-12-26 07:05:46,338][123090] Updated weights for policy 1, policy_version 933431 (0.0006) [2023-12-26 07:05:46,840][123091] Updated weights for policy 0, policy_version 940052 (0.0011) [2023-12-26 07:05:46,903][123091] Updated weights for policy 0, policy_version 940062 (0.0009) [2023-12-26 07:05:46,955][123091] Updated weights for policy 0, policy_version 940072 (0.0009) [2023-12-26 07:05:47,089][123090] Updated weights for policy 1, policy_version 933441 (0.0006) [2023-12-26 07:05:47,137][123090] Updated weights for policy 1, policy_version 933451 (0.0010) [2023-12-26 07:05:47,186][123090] Updated weights for policy 1, policy_version 933461 (0.0010) [2023-12-26 07:05:47,238][123090] Updated weights for policy 1, policy_version 933471 (0.0010) [2023-12-26 07:05:47,663][123091] Updated weights for policy 0, policy_version 940082 (0.0007) [2023-12-26 07:05:47,717][123091] Updated weights for policy 0, policy_version 940092 (0.0010) [2023-12-26 07:05:47,780][123091] Updated weights for policy 0, policy_version 940102 (0.0010) [2023-12-26 07:05:47,839][123091] Updated weights for policy 0, policy_version 940112 (0.0010) [2023-12-26 07:05:48,105][123090] Updated weights for policy 1, policy_version 933481 (0.0010) [2023-12-26 07:05:48,167][123090] Updated weights for policy 1, policy_version 933491 (0.0010) [2023-12-26 07:05:48,230][123090] Updated weights for policy 1, policy_version 933501 (0.0010) [2023-12-26 07:05:48,626][123091] Updated weights for policy 0, policy_version 940122 (0.0010) [2023-12-26 07:05:48,679][123091] Updated weights for policy 0, policy_version 940132 (0.0010) [2023-12-26 07:05:48,735][123091] Updated weights for policy 0, policy_version 940142 (0.0009) [2023-12-26 07:05:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 479657984. Throughput: 0: 8823.7, 1: 8925.6. Samples: 479666552. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:48,784][121949] Avg episode reward: [(0, '6103.946'), (1, '5250.281')] [2023-12-26 07:05:49,055][123090] Updated weights for policy 1, policy_version 933511 (0.0011) [2023-12-26 07:05:49,125][123090] Updated weights for policy 1, policy_version 933521 (0.0010) [2023-12-26 07:05:49,194][123090] Updated weights for policy 1, policy_version 933531 (0.0010) [2023-12-26 07:05:49,587][123091] Updated weights for policy 0, policy_version 940152 (0.0009) [2023-12-26 07:05:49,653][123091] Updated weights for policy 0, policy_version 940162 (0.0010) [2023-12-26 07:05:49,720][123091] Updated weights for policy 0, policy_version 940172 (0.0009) [2023-12-26 07:05:49,971][123090] Updated weights for policy 1, policy_version 933541 (0.0010) [2023-12-26 07:05:50,037][123090] Updated weights for policy 1, policy_version 933551 (0.0009) [2023-12-26 07:05:50,110][123090] Updated weights for policy 1, policy_version 933561 (0.0006) [2023-12-26 07:05:50,635][123091] Updated weights for policy 0, policy_version 940182 (0.0010) [2023-12-26 07:05:50,690][123091] Updated weights for policy 0, policy_version 940192 (0.0010) [2023-12-26 07:05:50,747][123091] Updated weights for policy 0, policy_version 940202 (0.0009) [2023-12-26 07:05:50,870][123090] Updated weights for policy 1, policy_version 933571 (0.0006) [2023-12-26 07:05:50,938][123090] Updated weights for policy 1, policy_version 933581 (0.0006) [2023-12-26 07:05:51,008][123090] Updated weights for policy 1, policy_version 933591 (0.0009) [2023-12-26 07:05:51,639][123091] Updated weights for policy 0, policy_version 940212 (0.0010) [2023-12-26 07:05:51,702][123091] Updated weights for policy 0, policy_version 940222 (0.0010) [2023-12-26 07:05:51,766][123091] Updated weights for policy 0, policy_version 940232 (0.0010) [2023-12-26 07:05:51,808][123090] Updated weights for policy 1, policy_version 933601 (0.0009) [2023-12-26 07:05:51,875][123090] Updated weights for policy 1, policy_version 933611 (0.0009) [2023-12-26 07:05:51,936][123090] Updated weights for policy 1, policy_version 933621 (0.0009) [2023-12-26 07:05:51,998][123090] Updated weights for policy 1, policy_version 933631 (0.0009) [2023-12-26 07:05:52,607][123091] Updated weights for policy 0, policy_version 940242 (0.0009) [2023-12-26 07:05:52,657][123091] Updated weights for policy 0, policy_version 940252 (0.0009) [2023-12-26 07:05:52,743][123091] Updated weights for policy 0, policy_version 940262 (0.0009) [2023-12-26 07:05:52,807][123091] Updated weights for policy 0, policy_version 940272 (0.0010) [2023-12-26 07:05:52,851][123090] Updated weights for policy 1, policy_version 933641 (0.0010) [2023-12-26 07:05:52,913][123090] Updated weights for policy 1, policy_version 933651 (0.0009) [2023-12-26 07:05:52,975][123090] Updated weights for policy 1, policy_version 933661 (0.0009) [2023-12-26 07:05:53,510][123091] Updated weights for policy 0, policy_version 940282 (0.0007) [2023-12-26 07:05:53,571][123091] Updated weights for policy 0, policy_version 940292 (0.0006) [2023-12-26 07:05:53,621][123091] Updated weights for policy 0, policy_version 940302 (0.0010) [2023-12-26 07:05:53,733][123090] Updated weights for policy 1, policy_version 933671 (0.0009) [2023-12-26 07:05:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 479739904. Throughput: 0: 8757.3, 1: 8949.3. Samples: 479717612. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:53,785][121949] Avg episode reward: [(0, '5963.467'), (1, '5109.908')] [2023-12-26 07:05:53,786][123090] Updated weights for policy 1, policy_version 933681 (0.0009) [2023-12-26 07:05:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000940304_240721920.pth... [2023-12-26 07:05:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000939280_240459776.pth [2023-12-26 07:05:53,836][123090] Updated weights for policy 1, policy_version 933691 (0.0009) [2023-12-26 07:05:53,863][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000933696_239026176.pth... [2023-12-26 07:05:53,867][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000932608_238747648.pth [2023-12-26 07:05:54,428][123091] Updated weights for policy 0, policy_version 940312 (0.0008) [2023-12-26 07:05:54,493][123091] Updated weights for policy 0, policy_version 940322 (0.0005) [2023-12-26 07:05:54,565][123091] Updated weights for policy 0, policy_version 940332 (0.0005) [2023-12-26 07:05:54,680][123090] Updated weights for policy 1, policy_version 933701 (0.0010) [2023-12-26 07:05:54,733][123090] Updated weights for policy 1, policy_version 933711 (0.0010) [2023-12-26 07:05:54,793][123090] Updated weights for policy 1, policy_version 933721 (0.0009) [2023-12-26 07:05:55,245][123091] Updated weights for policy 0, policy_version 940342 (0.0005) [2023-12-26 07:05:55,324][123091] Updated weights for policy 0, policy_version 940352 (0.0006) [2023-12-26 07:05:55,394][123091] Updated weights for policy 0, policy_version 940362 (0.0009) [2023-12-26 07:05:55,590][123090] Updated weights for policy 1, policy_version 933731 (0.0009) [2023-12-26 07:05:55,640][123090] Updated weights for policy 1, policy_version 933741 (0.0005) [2023-12-26 07:05:55,695][123090] Updated weights for policy 1, policy_version 933751 (0.0005) [2023-12-26 07:05:56,240][123091] Updated weights for policy 0, policy_version 940372 (0.0010) [2023-12-26 07:05:56,290][123091] Updated weights for policy 0, policy_version 940382 (0.0009) [2023-12-26 07:05:56,341][123091] Updated weights for policy 0, policy_version 940392 (0.0010) [2023-12-26 07:05:56,358][123090] Updated weights for policy 1, policy_version 933761 (0.0006) [2023-12-26 07:05:56,419][123090] Updated weights for policy 1, policy_version 933771 (0.0009) [2023-12-26 07:05:56,472][123090] Updated weights for policy 1, policy_version 933781 (0.0010) [2023-12-26 07:05:56,523][123090] Updated weights for policy 1, policy_version 933791 (0.0009) [2023-12-26 07:05:57,098][123091] Updated weights for policy 0, policy_version 940402 (0.0009) [2023-12-26 07:05:57,152][123091] Updated weights for policy 0, policy_version 940414 (0.0010) [2023-12-26 07:05:57,196][123091] Updated weights for policy 0, policy_version 940424 (0.0005) [2023-12-26 07:05:57,280][123090] Updated weights for policy 1, policy_version 933801 (0.0006) [2023-12-26 07:05:57,349][123090] Updated weights for policy 1, policy_version 933811 (0.0008) [2023-12-26 07:05:57,422][123090] Updated weights for policy 1, policy_version 933821 (0.0005) [2023-12-26 07:05:57,958][123091] Updated weights for policy 0, policy_version 940434 (0.0006) [2023-12-26 07:05:58,024][123091] Updated weights for policy 0, policy_version 940444 (0.0009) [2023-12-26 07:05:58,074][123090] Updated weights for policy 1, policy_version 933831 (0.0007) [2023-12-26 07:05:58,091][123091] Updated weights for policy 0, policy_version 940454 (0.0008) [2023-12-26 07:05:58,142][123090] Updated weights for policy 1, policy_version 933841 (0.0006) [2023-12-26 07:05:58,149][123091] Updated weights for policy 0, policy_version 940464 (0.0010) [2023-12-26 07:05:58,202][123090] Updated weights for policy 1, policy_version 933851 (0.0008) [2023-12-26 07:05:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 479830016. Throughput: 0: 8822.7, 1: 8978.3. Samples: 479826728. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:05:58,785][121949] Avg episode reward: [(0, '6066.186'), (1, '5243.174')] [2023-12-26 07:05:59,046][123091] Updated weights for policy 0, policy_version 940474 (0.0007) [2023-12-26 07:05:59,111][123091] Updated weights for policy 0, policy_version 940484 (0.0007) [2023-12-26 07:05:59,116][123090] Updated weights for policy 1, policy_version 933861 (0.0010) [2023-12-26 07:05:59,168][123091] Updated weights for policy 0, policy_version 940494 (0.0007) [2023-12-26 07:05:59,184][123090] Updated weights for policy 1, policy_version 933871 (0.0007) [2023-12-26 07:05:59,257][123090] Updated weights for policy 1, policy_version 933881 (0.0009) [2023-12-26 07:05:59,983][123091] Updated weights for policy 0, policy_version 940504 (0.0010) [2023-12-26 07:06:00,051][123091] Updated weights for policy 0, policy_version 940514 (0.0011) [2023-12-26 07:06:00,062][123090] Updated weights for policy 1, policy_version 933891 (0.0007) [2023-12-26 07:06:00,111][123091] Updated weights for policy 0, policy_version 940524 (0.0010) [2023-12-26 07:06:00,129][123090] Updated weights for policy 1, policy_version 933901 (0.0007) [2023-12-26 07:06:00,199][123090] Updated weights for policy 1, policy_version 933911 (0.0008) [2023-12-26 07:06:00,865][123091] Updated weights for policy 0, policy_version 940534 (0.0007) [2023-12-26 07:06:00,926][123091] Updated weights for policy 0, policy_version 940544 (0.0005) [2023-12-26 07:06:00,985][123091] Updated weights for policy 0, policy_version 940554 (0.0008) [2023-12-26 07:06:01,001][123090] Updated weights for policy 1, policy_version 933921 (0.0008) [2023-12-26 07:06:01,070][123090] Updated weights for policy 1, policy_version 933931 (0.0008) [2023-12-26 07:06:01,140][123090] Updated weights for policy 1, policy_version 933941 (0.0007) [2023-12-26 07:06:01,214][123090] Updated weights for policy 1, policy_version 933951 (0.0006) [2023-12-26 07:06:01,727][123091] Updated weights for policy 0, policy_version 940564 (0.0008) [2023-12-26 07:06:01,788][123091] Updated weights for policy 0, policy_version 940574 (0.0009) [2023-12-26 07:06:01,845][123091] Updated weights for policy 0, policy_version 940584 (0.0009) [2023-12-26 07:06:02,019][123090] Updated weights for policy 1, policy_version 933961 (0.0009) [2023-12-26 07:06:02,077][123090] Updated weights for policy 1, policy_version 933971 (0.0010) [2023-12-26 07:06:02,131][123090] Updated weights for policy 1, policy_version 933981 (0.0010) [2023-12-26 07:06:02,573][123091] Updated weights for policy 0, policy_version 940594 (0.0008) [2023-12-26 07:06:02,626][123091] Updated weights for policy 0, policy_version 940604 (0.0005) [2023-12-26 07:06:02,695][123091] Updated weights for policy 0, policy_version 940614 (0.0007) [2023-12-26 07:06:02,754][123091] Updated weights for policy 0, policy_version 940624 (0.0008) [2023-12-26 07:06:03,012][123090] Updated weights for policy 1, policy_version 933991 (0.0008) [2023-12-26 07:06:03,075][123090] Updated weights for policy 1, policy_version 934001 (0.0007) [2023-12-26 07:06:03,129][123090] Updated weights for policy 1, policy_version 934011 (0.0006) [2023-12-26 07:06:03,621][123091] Updated weights for policy 0, policy_version 940634 (0.0009) [2023-12-26 07:06:03,685][123091] Updated weights for policy 0, policy_version 940644 (0.0009) [2023-12-26 07:06:03,749][123091] Updated weights for policy 0, policy_version 940654 (0.0009) [2023-12-26 07:06:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 479920128. Throughput: 0: 8715.9, 1: 9028.4. Samples: 479930380. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:03,785][121949] Avg episode reward: [(0, '6209.006'), (1, '5521.494')] [2023-12-26 07:06:03,806][123090] Updated weights for policy 1, policy_version 934021 (0.0006) [2023-12-26 07:06:03,874][123090] Updated weights for policy 1, policy_version 934031 (0.0009) [2023-12-26 07:06:03,930][123090] Updated weights for policy 1, policy_version 934041 (0.0007) [2023-12-26 07:06:04,660][123091] Updated weights for policy 0, policy_version 940664 (0.0010) [2023-12-26 07:06:04,676][123090] Updated weights for policy 1, policy_version 934051 (0.0008) [2023-12-26 07:06:04,710][123091] Updated weights for policy 0, policy_version 940674 (0.0007) [2023-12-26 07:06:04,741][123090] Updated weights for policy 1, policy_version 934061 (0.0010) [2023-12-26 07:06:04,754][123091] Updated weights for policy 0, policy_version 940684 (0.0006) [2023-12-26 07:06:04,804][123090] Updated weights for policy 1, policy_version 934071 (0.0009) [2023-12-26 07:06:05,603][123090] Updated weights for policy 1, policy_version 934081 (0.0009) [2023-12-26 07:06:05,621][123091] Updated weights for policy 0, policy_version 940694 (0.0010) [2023-12-26 07:06:05,670][123090] Updated weights for policy 1, policy_version 934091 (0.0006) [2023-12-26 07:06:05,682][123091] Updated weights for policy 0, policy_version 940704 (0.0008) [2023-12-26 07:06:05,734][123090] Updated weights for policy 1, policy_version 934101 (0.0008) [2023-12-26 07:06:05,745][123091] Updated weights for policy 0, policy_version 940714 (0.0009) [2023-12-26 07:06:05,797][123090] Updated weights for policy 1, policy_version 934111 (0.0008) [2023-12-26 07:06:06,570][123090] Updated weights for policy 1, policy_version 934121 (0.0006) [2023-12-26 07:06:06,577][123091] Updated weights for policy 0, policy_version 940724 (0.0009) [2023-12-26 07:06:06,640][123090] Updated weights for policy 1, policy_version 934131 (0.0008) [2023-12-26 07:06:06,647][123091] Updated weights for policy 0, policy_version 940734 (0.0006) [2023-12-26 07:06:06,704][123090] Updated weights for policy 1, policy_version 934141 (0.0008) [2023-12-26 07:06:06,707][123091] Updated weights for policy 0, policy_version 940744 (0.0006) [2023-12-26 07:06:07,458][123090] Updated weights for policy 1, policy_version 934151 (0.0008) [2023-12-26 07:06:07,512][123090] Updated weights for policy 1, policy_version 934161 (0.0009) [2023-12-26 07:06:07,528][123091] Updated weights for policy 0, policy_version 940754 (0.0008) [2023-12-26 07:06:07,566][123090] Updated weights for policy 1, policy_version 934171 (0.0007) [2023-12-26 07:06:07,581][123091] Updated weights for policy 0, policy_version 940764 (0.0010) [2023-12-26 07:06:07,637][123091] Updated weights for policy 0, policy_version 940775 (0.0008) [2023-12-26 07:06:08,427][123090] Updated weights for policy 1, policy_version 934181 (0.0008) [2023-12-26 07:06:08,452][123091] Updated weights for policy 0, policy_version 940785 (0.0010) [2023-12-26 07:06:08,485][123090] Updated weights for policy 1, policy_version 934191 (0.0005) [2023-12-26 07:06:08,519][123091] Updated weights for policy 0, policy_version 940795 (0.0011) [2023-12-26 07:06:08,546][123090] Updated weights for policy 1, policy_version 934201 (0.0006) [2023-12-26 07:06:08,568][123091] Updated weights for policy 0, policy_version 940805 (0.0009) [2023-12-26 07:06:08,622][123091] Updated weights for policy 0, policy_version 940815 (0.0010) [2023-12-26 07:06:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 480010240. Throughput: 0: 8682.2, 1: 9052.3. Samples: 479982272. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:08,785][121949] Avg episode reward: [(0, '6130.121'), (1, '5507.482')] [2023-12-26 07:06:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000940816_240852992.pth... [2023-12-26 07:06:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000934208_239157248.pth... [2023-12-26 07:06:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000939792_240590848.pth [2023-12-26 07:06:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000933152_238886912.pth [2023-12-26 07:06:09,290][123090] Updated weights for policy 1, policy_version 934211 (0.0007) [2023-12-26 07:06:09,359][123090] Updated weights for policy 1, policy_version 934221 (0.0010) [2023-12-26 07:06:09,431][123090] Updated weights for policy 1, policy_version 934231 (0.0010) [2023-12-26 07:06:09,516][123091] Updated weights for policy 0, policy_version 940825 (0.0008) [2023-12-26 07:06:09,575][123091] Updated weights for policy 0, policy_version 940835 (0.0009) [2023-12-26 07:06:09,635][123091] Updated weights for policy 0, policy_version 940845 (0.0009) [2023-12-26 07:06:10,233][123090] Updated weights for policy 1, policy_version 934241 (0.0010) [2023-12-26 07:06:10,285][123090] Updated weights for policy 1, policy_version 934251 (0.0010) [2023-12-26 07:06:10,352][123090] Updated weights for policy 1, policy_version 934261 (0.0009) [2023-12-26 07:06:10,416][123090] Updated weights for policy 1, policy_version 934271 (0.0009) [2023-12-26 07:06:10,496][123091] Updated weights for policy 0, policy_version 940855 (0.0006) [2023-12-26 07:06:10,565][123091] Updated weights for policy 0, policy_version 940865 (0.0007) [2023-12-26 07:06:10,613][123091] Updated weights for policy 0, policy_version 940875 (0.0011) [2023-12-26 07:06:11,338][123091] Updated weights for policy 0, policy_version 940885 (0.0013) [2023-12-26 07:06:11,338][123090] Updated weights for policy 1, policy_version 934281 (0.0009) [2023-12-26 07:06:11,399][123091] Updated weights for policy 0, policy_version 940895 (0.0010) [2023-12-26 07:06:11,411][123090] Updated weights for policy 1, policy_version 934291 (0.0009) [2023-12-26 07:06:11,458][123091] Updated weights for policy 0, policy_version 940905 (0.0006) [2023-12-26 07:06:11,478][123090] Updated weights for policy 1, policy_version 934301 (0.0009) [2023-12-26 07:06:12,291][123091] Updated weights for policy 0, policy_version 940915 (0.0008) [2023-12-26 07:06:12,335][123090] Updated weights for policy 1, policy_version 934311 (0.0010) [2023-12-26 07:06:12,358][123091] Updated weights for policy 0, policy_version 940925 (0.0009) [2023-12-26 07:06:12,404][123090] Updated weights for policy 1, policy_version 934321 (0.0008) [2023-12-26 07:06:12,431][123091] Updated weights for policy 0, policy_version 940935 (0.0009) [2023-12-26 07:06:12,470][123090] Updated weights for policy 1, policy_version 934331 (0.0005) [2023-12-26 07:06:13,254][123090] Updated weights for policy 1, policy_version 934341 (0.0008) [2023-12-26 07:06:13,267][123091] Updated weights for policy 0, policy_version 940945 (0.0009) [2023-12-26 07:06:13,316][123090] Updated weights for policy 1, policy_version 934351 (0.0008) [2023-12-26 07:06:13,323][123091] Updated weights for policy 0, policy_version 940955 (0.0009) [2023-12-26 07:06:13,381][123090] Updated weights for policy 1, policy_version 934361 (0.0009) [2023-12-26 07:06:13,386][123091] Updated weights for policy 0, policy_version 940965 (0.0007) [2023-12-26 07:06:13,450][123091] Updated weights for policy 0, policy_version 940975 (0.0009) [2023-12-26 07:06:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 480092160. Throughput: 0: 8705.0, 1: 8896.6. Samples: 480083980. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:13,785][121949] Avg episode reward: [(0, '6128.443'), (1, '5493.982')] [2023-12-26 07:06:14,120][123090] Updated weights for policy 1, policy_version 934371 (0.0009) [2023-12-26 07:06:14,192][123090] Updated weights for policy 1, policy_version 934381 (0.0005) [2023-12-26 07:06:14,257][123090] Updated weights for policy 1, policy_version 934391 (0.0006) [2023-12-26 07:06:14,265][123091] Updated weights for policy 0, policy_version 940985 (0.0006) [2023-12-26 07:06:14,322][123091] Updated weights for policy 0, policy_version 940995 (0.0009) [2023-12-26 07:06:14,375][123091] Updated weights for policy 0, policy_version 941005 (0.0010) [2023-12-26 07:06:15,020][123090] Updated weights for policy 1, policy_version 934401 (0.0006) [2023-12-26 07:06:15,087][123090] Updated weights for policy 1, policy_version 934411 (0.0009) [2023-12-26 07:06:15,142][123090] Updated weights for policy 1, policy_version 934421 (0.0006) [2023-12-26 07:06:15,204][123090] Updated weights for policy 1, policy_version 934431 (0.0007) [2023-12-26 07:06:15,222][123091] Updated weights for policy 0, policy_version 941015 (0.0009) [2023-12-26 07:06:15,291][123091] Updated weights for policy 0, policy_version 941025 (0.0010) [2023-12-26 07:06:15,349][123091] Updated weights for policy 0, policy_version 941035 (0.0010) [2023-12-26 07:06:15,995][123090] Updated weights for policy 1, policy_version 934441 (0.0009) [2023-12-26 07:06:16,047][123090] Updated weights for policy 1, policy_version 934451 (0.0009) [2023-12-26 07:06:16,099][123090] Updated weights for policy 1, policy_version 934461 (0.0009) [2023-12-26 07:06:16,142][123091] Updated weights for policy 0, policy_version 941045 (0.0008) [2023-12-26 07:06:16,197][123091] Updated weights for policy 0, policy_version 941055 (0.0005) [2023-12-26 07:06:16,253][123091] Updated weights for policy 0, policy_version 941065 (0.0005) [2023-12-26 07:06:16,916][123090] Updated weights for policy 1, policy_version 934471 (0.0007) [2023-12-26 07:06:16,922][123091] Updated weights for policy 0, policy_version 941075 (0.0005) [2023-12-26 07:06:16,983][123090] Updated weights for policy 1, policy_version 934481 (0.0007) [2023-12-26 07:06:16,990][123091] Updated weights for policy 0, policy_version 941085 (0.0006) [2023-12-26 07:06:17,053][123090] Updated weights for policy 1, policy_version 934491 (0.0008) [2023-12-26 07:06:17,055][123091] Updated weights for policy 0, policy_version 941095 (0.0006) [2023-12-26 07:06:17,776][123090] Updated weights for policy 1, policy_version 934501 (0.0007) [2023-12-26 07:06:17,793][123091] Updated weights for policy 0, policy_version 941105 (0.0006) [2023-12-26 07:06:17,841][123090] Updated weights for policy 1, policy_version 934511 (0.0007) [2023-12-26 07:06:17,858][123091] Updated weights for policy 0, policy_version 941115 (0.0011) [2023-12-26 07:06:17,903][123090] Updated weights for policy 1, policy_version 934521 (0.0007) [2023-12-26 07:06:17,921][123091] Updated weights for policy 0, policy_version 941125 (0.0011) [2023-12-26 07:06:17,986][123091] Updated weights for policy 0, policy_version 941135 (0.0011) [2023-12-26 07:06:18,662][123090] Updated weights for policy 1, policy_version 934531 (0.0008) [2023-12-26 07:06:18,726][123090] Updated weights for policy 1, policy_version 934541 (0.0011) [2023-12-26 07:06:18,755][123091] Updated weights for policy 0, policy_version 941145 (0.0011) [2023-12-26 07:06:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 480174080. Throughput: 0: 8714.3, 1: 8879.7. Samples: 480193336. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:18,785][121949] Avg episode reward: [(0, '6204.756'), (1, '5497.114')] [2023-12-26 07:06:18,790][123090] Updated weights for policy 1, policy_version 934551 (0.0011) [2023-12-26 07:06:18,822][123091] Updated weights for policy 0, policy_version 941155 (0.0011) [2023-12-26 07:06:18,889][123091] Updated weights for policy 0, policy_version 941165 (0.0011) [2023-12-26 07:06:19,490][123090] Updated weights for policy 1, policy_version 934561 (0.0011) [2023-12-26 07:06:19,553][123090] Updated weights for policy 1, policy_version 934571 (0.0010) [2023-12-26 07:06:19,616][123090] Updated weights for policy 1, policy_version 934581 (0.0010) [2023-12-26 07:06:19,668][123090] Updated weights for policy 1, policy_version 934591 (0.0010) [2023-12-26 07:06:19,759][123091] Updated weights for policy 0, policy_version 941175 (0.0011) [2023-12-26 07:06:19,832][123091] Updated weights for policy 0, policy_version 941185 (0.0011) [2023-12-26 07:06:19,894][123091] Updated weights for policy 0, policy_version 941195 (0.0008) [2023-12-26 07:06:20,463][123090] Updated weights for policy 1, policy_version 934601 (0.0010) [2023-12-26 07:06:20,513][123090] Updated weights for policy 1, policy_version 934611 (0.0009) [2023-12-26 07:06:20,581][123090] Updated weights for policy 1, policy_version 934622 (0.0010) [2023-12-26 07:06:20,711][123091] Updated weights for policy 0, policy_version 941205 (0.0009) [2023-12-26 07:06:20,780][123091] Updated weights for policy 0, policy_version 941215 (0.0010) [2023-12-26 07:06:20,853][123091] Updated weights for policy 0, policy_version 941225 (0.0007) [2023-12-26 07:06:21,500][123090] Updated weights for policy 1, policy_version 934632 (0.0009) [2023-12-26 07:06:21,557][123090] Updated weights for policy 1, policy_version 934642 (0.0009) [2023-12-26 07:06:21,628][123090] Updated weights for policy 1, policy_version 934652 (0.0009) [2023-12-26 07:06:21,638][123091] Updated weights for policy 0, policy_version 941235 (0.0007) [2023-12-26 07:06:21,704][123091] Updated weights for policy 0, policy_version 941245 (0.0008) [2023-12-26 07:06:21,770][123091] Updated weights for policy 0, policy_version 941255 (0.0007) [2023-12-26 07:06:22,348][123090] Updated weights for policy 1, policy_version 934662 (0.0008) [2023-12-26 07:06:22,418][123090] Updated weights for policy 1, policy_version 934672 (0.0010) [2023-12-26 07:06:22,433][123091] Updated weights for policy 0, policy_version 941265 (0.0006) [2023-12-26 07:06:22,480][123090] Updated weights for policy 1, policy_version 934682 (0.0009) [2023-12-26 07:06:22,500][123091] Updated weights for policy 0, policy_version 941275 (0.0010) [2023-12-26 07:06:22,567][123091] Updated weights for policy 0, policy_version 941285 (0.0006) [2023-12-26 07:06:22,631][123091] Updated weights for policy 0, policy_version 941295 (0.0009) [2023-12-26 07:06:23,316][123090] Updated weights for policy 1, policy_version 934692 (0.0010) [2023-12-26 07:06:23,377][123090] Updated weights for policy 1, policy_version 934702 (0.0010) [2023-12-26 07:06:23,418][123091] Updated weights for policy 0, policy_version 941305 (0.0007) [2023-12-26 07:06:23,436][123090] Updated weights for policy 1, policy_version 934712 (0.0008) [2023-12-26 07:06:23,472][123091] Updated weights for policy 0, policy_version 941315 (0.0006) [2023-12-26 07:06:23,542][123091] Updated weights for policy 0, policy_version 941325 (0.0011) [2023-12-26 07:06:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 480272384. Throughput: 0: 8711.3, 1: 8876.7. Samples: 480245452. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:23,784][121949] Avg episode reward: [(0, '6239.034'), (1, '5518.014')] [2023-12-26 07:06:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000941328_240984064.pth... [2023-12-26 07:06:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000934720_239288320.pth... [2023-12-26 07:06:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000940304_240721920.pth [2023-12-26 07:06:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000933696_239026176.pth [2023-12-26 07:06:24,257][123090] Updated weights for policy 1, policy_version 934722 (0.0008) [2023-12-26 07:06:24,308][123090] Updated weights for policy 1, policy_version 934732 (0.0005) [2023-12-26 07:06:24,354][123091] Updated weights for policy 0, policy_version 941335 (0.0009) [2023-12-26 07:06:24,375][123090] Updated weights for policy 1, policy_version 934742 (0.0006) [2023-12-26 07:06:24,420][123091] Updated weights for policy 0, policy_version 941345 (0.0008) [2023-12-26 07:06:24,437][123090] Updated weights for policy 1, policy_version 934752 (0.0006) [2023-12-26 07:06:24,490][123091] Updated weights for policy 0, policy_version 941355 (0.0010) [2023-12-26 07:06:25,122][123090] Updated weights for policy 1, policy_version 934762 (0.0005) [2023-12-26 07:06:25,177][123090] Updated weights for policy 1, policy_version 934772 (0.0005) [2023-12-26 07:06:25,236][123090] Updated weights for policy 1, policy_version 934782 (0.0005) [2023-12-26 07:06:25,319][123091] Updated weights for policy 0, policy_version 941365 (0.0008) [2023-12-26 07:06:25,367][123091] Updated weights for policy 0, policy_version 941375 (0.0005) [2023-12-26 07:06:25,422][123091] Updated weights for policy 0, policy_version 941385 (0.0005) [2023-12-26 07:06:25,978][123090] Updated weights for policy 1, policy_version 934792 (0.0010) [2023-12-26 07:06:26,038][123090] Updated weights for policy 1, policy_version 934802 (0.0010) [2023-12-26 07:06:26,107][123091] Updated weights for policy 0, policy_version 941395 (0.0006) [2023-12-26 07:06:26,109][123090] Updated weights for policy 1, policy_version 934812 (0.0009) [2023-12-26 07:06:26,171][123091] Updated weights for policy 0, policy_version 941405 (0.0005) [2023-12-26 07:06:26,231][123091] Updated weights for policy 0, policy_version 941415 (0.0005) [2023-12-26 07:06:26,835][123091] Updated weights for policy 0, policy_version 941425 (0.0006) [2023-12-26 07:06:26,903][123091] Updated weights for policy 0, policy_version 941435 (0.0008) [2023-12-26 07:06:26,922][123090] Updated weights for policy 1, policy_version 934822 (0.0007) [2023-12-26 07:06:26,951][123091] Updated weights for policy 0, policy_version 941445 (0.0010) [2023-12-26 07:06:26,975][123090] Updated weights for policy 1, policy_version 934832 (0.0005) [2023-12-26 07:06:26,998][123091] Updated weights for policy 0, policy_version 941455 (0.0010) [2023-12-26 07:06:27,029][123090] Updated weights for policy 1, policy_version 934842 (0.0006) [2023-12-26 07:06:27,716][123091] Updated weights for policy 0, policy_version 941465 (0.0007) [2023-12-26 07:06:27,767][123091] Updated weights for policy 0, policy_version 941475 (0.0010) [2023-12-26 07:06:27,802][123090] Updated weights for policy 1, policy_version 934852 (0.0008) [2023-12-26 07:06:27,829][123091] Updated weights for policy 0, policy_version 941485 (0.0011) [2023-12-26 07:06:27,857][123090] Updated weights for policy 1, policy_version 934862 (0.0005) [2023-12-26 07:06:27,907][123090] Updated weights for policy 1, policy_version 934872 (0.0008) [2023-12-26 07:06:28,604][123091] Updated weights for policy 0, policy_version 941495 (0.0007) [2023-12-26 07:06:28,667][123091] Updated weights for policy 0, policy_version 941505 (0.0006) [2023-12-26 07:06:28,718][123090] Updated weights for policy 1, policy_version 934882 (0.0010) [2023-12-26 07:06:28,731][123091] Updated weights for policy 0, policy_version 941515 (0.0006) [2023-12-26 07:06:28,774][123090] Updated weights for policy 1, policy_version 934892 (0.0010) [2023-12-26 07:06:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 480362496. Throughput: 0: 8759.8, 1: 8959.0. Samples: 480356164. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:28,785][121949] Avg episode reward: [(0, '6306.729'), (1, '5185.333')] [2023-12-26 07:06:28,833][123090] Updated weights for policy 1, policy_version 934902 (0.0010) [2023-12-26 07:06:28,885][123090] Updated weights for policy 1, policy_version 934912 (0.0010) [2023-12-26 07:06:29,471][123091] Updated weights for policy 0, policy_version 941525 (0.0006) [2023-12-26 07:06:29,531][123091] Updated weights for policy 0, policy_version 941535 (0.0005) [2023-12-26 07:06:29,591][123091] Updated weights for policy 0, policy_version 941545 (0.0007) [2023-12-26 07:06:29,724][123090] Updated weights for policy 1, policy_version 934922 (0.0010) [2023-12-26 07:06:29,787][123090] Updated weights for policy 1, policy_version 934932 (0.0010) [2023-12-26 07:06:29,852][123090] Updated weights for policy 1, policy_version 934942 (0.0010) [2023-12-26 07:06:30,400][123091] Updated weights for policy 0, policy_version 941555 (0.0009) [2023-12-26 07:06:30,448][123091] Updated weights for policy 0, policy_version 941565 (0.0008) [2023-12-26 07:06:30,501][123091] Updated weights for policy 0, policy_version 941575 (0.0010) [2023-12-26 07:06:30,616][123090] Updated weights for policy 1, policy_version 934952 (0.0010) [2023-12-26 07:06:30,686][123090] Updated weights for policy 1, policy_version 934962 (0.0008) [2023-12-26 07:06:30,756][123090] Updated weights for policy 1, policy_version 934972 (0.0008) [2023-12-26 07:06:31,377][123091] Updated weights for policy 0, policy_version 941585 (0.0009) [2023-12-26 07:06:31,443][123091] Updated weights for policy 0, policy_version 941595 (0.0009) [2023-12-26 07:06:31,461][123090] Updated weights for policy 1, policy_version 934982 (0.0009) [2023-12-26 07:06:31,500][123091] Updated weights for policy 0, policy_version 941605 (0.0008) [2023-12-26 07:06:31,511][123090] Updated weights for policy 1, policy_version 934992 (0.0007) [2023-12-26 07:06:31,551][123091] Updated weights for policy 0, policy_version 941615 (0.0007) [2023-12-26 07:06:31,560][123090] Updated weights for policy 1, policy_version 935002 (0.0009) [2023-12-26 07:06:32,321][123091] Updated weights for policy 0, policy_version 941625 (0.0007) [2023-12-26 07:06:32,384][123091] Updated weights for policy 0, policy_version 941635 (0.0007) [2023-12-26 07:06:32,441][123091] Updated weights for policy 0, policy_version 941645 (0.0008) [2023-12-26 07:06:32,443][123090] Updated weights for policy 1, policy_version 935012 (0.0008) [2023-12-26 07:06:32,503][123090] Updated weights for policy 1, policy_version 935022 (0.0008) [2023-12-26 07:06:32,571][123090] Updated weights for policy 1, policy_version 935032 (0.0010) [2023-12-26 07:06:33,196][123091] Updated weights for policy 0, policy_version 941655 (0.0009) [2023-12-26 07:06:33,253][123091] Updated weights for policy 0, policy_version 941665 (0.0009) [2023-12-26 07:06:33,306][123091] Updated weights for policy 0, policy_version 941675 (0.0009) [2023-12-26 07:06:33,413][123090] Updated weights for policy 1, policy_version 935042 (0.0010) [2023-12-26 07:06:33,477][123090] Updated weights for policy 1, policy_version 935052 (0.0009) [2023-12-26 07:06:33,533][123090] Updated weights for policy 1, policy_version 935063 (0.0010) [2023-12-26 07:06:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 480452608. Throughput: 0: 8833.2, 1: 8838.7. Samples: 480461792. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:33,785][121949] Avg episode reward: [(0, '6319.112'), (1, '5228.009')] [2023-12-26 07:06:33,888][123091] Updated weights for policy 0, policy_version 941685 (0.0009) [2023-12-26 07:06:33,944][123091] Updated weights for policy 0, policy_version 941695 (0.0010) [2023-12-26 07:06:33,992][123091] Updated weights for policy 0, policy_version 941705 (0.0010) [2023-12-26 07:06:34,435][123090] Updated weights for policy 1, policy_version 935073 (0.0009) [2023-12-26 07:06:34,520][123090] Updated weights for policy 1, policy_version 935083 (0.0009) [2023-12-26 07:06:34,591][123090] Updated weights for policy 1, policy_version 935093 (0.0007) [2023-12-26 07:06:34,658][123090] Updated weights for policy 1, policy_version 935103 (0.0009) [2023-12-26 07:06:34,785][123091] Updated weights for policy 0, policy_version 941715 (0.0009) [2023-12-26 07:06:34,857][123091] Updated weights for policy 0, policy_version 941725 (0.0009) [2023-12-26 07:06:34,926][123091] Updated weights for policy 0, policy_version 941735 (0.0006) [2023-12-26 07:06:35,491][123090] Updated weights for policy 1, policy_version 935113 (0.0010) [2023-12-26 07:06:35,559][123090] Updated weights for policy 1, policy_version 935123 (0.0009) [2023-12-26 07:06:35,588][123091] Updated weights for policy 0, policy_version 941745 (0.0011) [2023-12-26 07:06:35,617][123090] Updated weights for policy 1, policy_version 935133 (0.0009) [2023-12-26 07:06:35,648][123091] Updated weights for policy 0, policy_version 941755 (0.0011) [2023-12-26 07:06:35,705][123091] Updated weights for policy 0, policy_version 941765 (0.0011) [2023-12-26 07:06:35,769][123091] Updated weights for policy 0, policy_version 941775 (0.0011) [2023-12-26 07:06:36,540][123090] Updated weights for policy 1, policy_version 935143 (0.0007) [2023-12-26 07:06:36,545][123091] Updated weights for policy 0, policy_version 941785 (0.0009) [2023-12-26 07:06:36,602][123090] Updated weights for policy 1, policy_version 935153 (0.0009) [2023-12-26 07:06:36,612][123091] Updated weights for policy 0, policy_version 941795 (0.0006) [2023-12-26 07:06:36,659][123090] Updated weights for policy 1, policy_version 935163 (0.0009) [2023-12-26 07:06:36,668][123091] Updated weights for policy 0, policy_version 941805 (0.0005) [2023-12-26 07:06:37,331][123090] Updated weights for policy 1, policy_version 935173 (0.0008) [2023-12-26 07:06:37,399][123090] Updated weights for policy 1, policy_version 935183 (0.0009) [2023-12-26 07:06:37,403][123091] Updated weights for policy 0, policy_version 941815 (0.0008) [2023-12-26 07:06:37,456][123090] Updated weights for policy 1, policy_version 935193 (0.0007) [2023-12-26 07:06:37,461][123091] Updated weights for policy 0, policy_version 941825 (0.0010) [2023-12-26 07:06:37,520][123091] Updated weights for policy 0, policy_version 941835 (0.0010) [2023-12-26 07:06:38,294][123090] Updated weights for policy 1, policy_version 935203 (0.0008) [2023-12-26 07:06:38,360][123091] Updated weights for policy 0, policy_version 941845 (0.0011) [2023-12-26 07:06:38,362][123090] Updated weights for policy 1, policy_version 935213 (0.0009) [2023-12-26 07:06:38,419][123091] Updated weights for policy 0, policy_version 941855 (0.0011) [2023-12-26 07:06:38,423][123090] Updated weights for policy 1, policy_version 935223 (0.0007) [2023-12-26 07:06:38,479][123091] Updated weights for policy 0, policy_version 941865 (0.0005) [2023-12-26 07:06:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 480542720. Throughput: 0: 8931.7, 1: 8782.1. Samples: 480514728. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:38,785][121949] Avg episode reward: [(0, '6289.105'), (1, '5356.690')] [2023-12-26 07:06:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000941872_241123328.pth... [2023-12-26 07:06:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000935232_239419392.pth... [2023-12-26 07:06:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000940816_240852992.pth [2023-12-26 07:06:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000934208_239157248.pth [2023-12-26 07:06:39,194][123091] Updated weights for policy 0, policy_version 941875 (0.0005) [2023-12-26 07:06:39,271][123091] Updated weights for policy 0, policy_version 941885 (0.0010) [2023-12-26 07:06:39,308][123090] Updated weights for policy 1, policy_version 935233 (0.0008) [2023-12-26 07:06:39,335][123091] Updated weights for policy 0, policy_version 941895 (0.0011) [2023-12-26 07:06:39,375][123090] Updated weights for policy 1, policy_version 935243 (0.0009) [2023-12-26 07:06:39,443][123090] Updated weights for policy 1, policy_version 935253 (0.0009) [2023-12-26 07:06:39,491][123090] Updated weights for policy 1, policy_version 935263 (0.0009) [2023-12-26 07:06:40,141][123091] Updated weights for policy 0, policy_version 941905 (0.0010) [2023-12-26 07:06:40,202][123091] Updated weights for policy 0, policy_version 941915 (0.0011) [2023-12-26 07:06:40,267][123091] Updated weights for policy 0, policy_version 941925 (0.0011) [2023-12-26 07:06:40,331][123091] Updated weights for policy 0, policy_version 941935 (0.0011) [2023-12-26 07:06:40,358][123090] Updated weights for policy 1, policy_version 935273 (0.0008) [2023-12-26 07:06:40,413][123090] Updated weights for policy 1, policy_version 935283 (0.0009) [2023-12-26 07:06:40,465][123090] Updated weights for policy 1, policy_version 935293 (0.0008) [2023-12-26 07:06:41,089][123091] Updated weights for policy 0, policy_version 941945 (0.0010) [2023-12-26 07:06:41,154][123091] Updated weights for policy 0, policy_version 941955 (0.0009) [2023-12-26 07:06:41,221][123091] Updated weights for policy 0, policy_version 941966 (0.0010) [2023-12-26 07:06:41,354][123090] Updated weights for policy 1, policy_version 935303 (0.0009) [2023-12-26 07:06:41,420][123090] Updated weights for policy 1, policy_version 935313 (0.0010) [2023-12-26 07:06:41,485][123090] Updated weights for policy 1, policy_version 935323 (0.0009) [2023-12-26 07:06:42,003][123091] Updated weights for policy 0, policy_version 941976 (0.0009) [2023-12-26 07:06:42,058][123091] Updated weights for policy 0, policy_version 941986 (0.0011) [2023-12-26 07:06:42,120][123091] Updated weights for policy 0, policy_version 941996 (0.0009) [2023-12-26 07:06:42,354][123090] Updated weights for policy 1, policy_version 935333 (0.0010) [2023-12-26 07:06:42,422][123090] Updated weights for policy 1, policy_version 935343 (0.0009) [2023-12-26 07:06:42,480][123090] Updated weights for policy 1, policy_version 935353 (0.0010) [2023-12-26 07:06:42,957][123091] Updated weights for policy 0, policy_version 942006 (0.0009) [2023-12-26 07:06:43,017][123091] Updated weights for policy 0, policy_version 942016 (0.0009) [2023-12-26 07:06:43,067][123091] Updated weights for policy 0, policy_version 942026 (0.0009) [2023-12-26 07:06:43,316][123090] Updated weights for policy 1, policy_version 935363 (0.0010) [2023-12-26 07:06:43,384][123090] Updated weights for policy 1, policy_version 935373 (0.0008) [2023-12-26 07:06:43,435][123090] Updated weights for policy 1, policy_version 935383 (0.0009) [2023-12-26 07:06:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 480624640. Throughput: 0: 8906.5, 1: 8681.8. Samples: 480618200. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:43,785][121949] Avg episode reward: [(0, '6188.402'), (1, '5283.068')] [2023-12-26 07:06:43,911][123091] Updated weights for policy 0, policy_version 942036 (0.0009) [2023-12-26 07:06:43,961][123091] Updated weights for policy 0, policy_version 942046 (0.0009) [2023-12-26 07:06:44,015][123091] Updated weights for policy 0, policy_version 942057 (0.0010) [2023-12-26 07:06:44,283][123090] Updated weights for policy 1, policy_version 935393 (0.0009) [2023-12-26 07:06:44,341][123090] Updated weights for policy 1, policy_version 935403 (0.0010) [2023-12-26 07:06:44,394][123090] Updated weights for policy 1, policy_version 935413 (0.0010) [2023-12-26 07:06:44,448][123090] Updated weights for policy 1, policy_version 935424 (0.0010) [2023-12-26 07:06:44,776][123091] Updated weights for policy 0, policy_version 942067 (0.0008) [2023-12-26 07:06:44,836][123091] Updated weights for policy 0, policy_version 942077 (0.0006) [2023-12-26 07:06:44,890][123091] Updated weights for policy 0, policy_version 942087 (0.0009) [2023-12-26 07:06:45,319][123090] Updated weights for policy 1, policy_version 935434 (0.0010) [2023-12-26 07:06:45,386][123090] Updated weights for policy 1, policy_version 935444 (0.0009) [2023-12-26 07:06:45,453][123090] Updated weights for policy 1, policy_version 935454 (0.0009) [2023-12-26 07:06:45,674][123091] Updated weights for policy 0, policy_version 942097 (0.0009) [2023-12-26 07:06:45,721][123091] Updated weights for policy 0, policy_version 942107 (0.0006) [2023-12-26 07:06:45,775][123091] Updated weights for policy 0, policy_version 942117 (0.0010) [2023-12-26 07:06:45,850][123091] Updated weights for policy 0, policy_version 942127 (0.0010) [2023-12-26 07:06:46,150][123090] Updated weights for policy 1, policy_version 935464 (0.0006) [2023-12-26 07:06:46,228][123090] Updated weights for policy 1, policy_version 935474 (0.0005) [2023-12-26 07:06:46,295][123090] Updated weights for policy 1, policy_version 935484 (0.0008) [2023-12-26 07:06:46,740][123091] Updated weights for policy 0, policy_version 942137 (0.0009) [2023-12-26 07:06:46,800][123091] Updated weights for policy 0, policy_version 942149 (0.0011) [2023-12-26 07:06:46,855][123091] Updated weights for policy 0, policy_version 942160 (0.0010) [2023-12-26 07:06:46,913][123090] Updated weights for policy 1, policy_version 935494 (0.0006) [2023-12-26 07:06:46,958][123090] Updated weights for policy 1, policy_version 935504 (0.0005) [2023-12-26 07:06:47,005][123090] Updated weights for policy 1, policy_version 935514 (0.0008) [2023-12-26 07:06:47,664][123091] Updated weights for policy 0, policy_version 942170 (0.0005) [2023-12-26 07:06:47,720][123091] Updated weights for policy 0, policy_version 942180 (0.0006) [2023-12-26 07:06:47,773][123091] Updated weights for policy 0, policy_version 942190 (0.0006) [2023-12-26 07:06:47,801][123090] Updated weights for policy 1, policy_version 935524 (0.0008) [2023-12-26 07:06:47,860][123090] Updated weights for policy 1, policy_version 935534 (0.0005) [2023-12-26 07:06:47,928][123090] Updated weights for policy 1, policy_version 935544 (0.0005) [2023-12-26 07:06:48,553][123091] Updated weights for policy 0, policy_version 942200 (0.0010) [2023-12-26 07:06:48,606][123091] Updated weights for policy 0, policy_version 942210 (0.0010) [2023-12-26 07:06:48,660][123091] Updated weights for policy 0, policy_version 942220 (0.0010) [2023-12-26 07:06:48,700][123090] Updated weights for policy 1, policy_version 935554 (0.0006) [2023-12-26 07:06:48,763][123090] Updated weights for policy 1, policy_version 935564 (0.0009) [2023-12-26 07:06:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 480714752. Throughput: 0: 8925.8, 1: 8764.3. Samples: 480726436. Policy #0 lag: (min: 6.0, avg: 21.3, max: 38.0) [2023-12-26 07:06:48,785][121949] Avg episode reward: [(0, '6050.976'), (1, '5295.790')] [2023-12-26 07:06:48,820][123090] Updated weights for policy 1, policy_version 935574 (0.0008) [2023-12-26 07:06:48,882][123090] Updated weights for policy 1, policy_version 935584 (0.0009) [2023-12-26 07:06:49,595][123091] Updated weights for policy 0, policy_version 942230 (0.0010) [2023-12-26 07:06:49,627][123090] Updated weights for policy 1, policy_version 935594 (0.0008) [2023-12-26 07:06:49,656][123091] Updated weights for policy 0, policy_version 942240 (0.0008) [2023-12-26 07:06:49,691][123090] Updated weights for policy 1, policy_version 935604 (0.0008) [2023-12-26 07:06:49,720][123091] Updated weights for policy 0, policy_version 942250 (0.0007) [2023-12-26 07:06:49,740][123090] Updated weights for policy 1, policy_version 935614 (0.0008) [2023-12-26 07:06:50,526][123091] Updated weights for policy 0, policy_version 942260 (0.0007) [2023-12-26 07:06:50,587][123090] Updated weights for policy 1, policy_version 935624 (0.0008) [2023-12-26 07:06:50,598][123091] Updated weights for policy 0, policy_version 942270 (0.0007) [2023-12-26 07:06:50,658][123090] Updated weights for policy 1, policy_version 935634 (0.0008) [2023-12-26 07:06:50,665][123091] Updated weights for policy 0, policy_version 942280 (0.0009) [2023-12-26 07:06:50,726][123090] Updated weights for policy 1, policy_version 935644 (0.0009) [2023-12-26 07:06:51,472][123091] Updated weights for policy 0, policy_version 942290 (0.0010) [2023-12-26 07:06:51,531][123091] Updated weights for policy 0, policy_version 942300 (0.0008) [2023-12-26 07:06:51,572][123090] Updated weights for policy 1, policy_version 935654 (0.0007) [2023-12-26 07:06:51,597][123091] Updated weights for policy 0, policy_version 942310 (0.0008) [2023-12-26 07:06:51,640][123090] Updated weights for policy 1, policy_version 935664 (0.0009) [2023-12-26 07:06:51,667][123091] Updated weights for policy 0, policy_version 942320 (0.0008) [2023-12-26 07:06:51,701][123090] Updated weights for policy 1, policy_version 935674 (0.0009) [2023-12-26 07:06:52,474][123090] Updated weights for policy 1, policy_version 935684 (0.0009) [2023-12-26 07:06:52,481][123091] Updated weights for policy 0, policy_version 942330 (0.0009) [2023-12-26 07:06:52,529][123090] Updated weights for policy 1, policy_version 935694 (0.0008) [2023-12-26 07:06:52,544][123091] Updated weights for policy 0, policy_version 942340 (0.0008) [2023-12-26 07:06:52,588][123090] Updated weights for policy 1, policy_version 935704 (0.0007) [2023-12-26 07:06:52,597][123091] Updated weights for policy 0, policy_version 942350 (0.0008) [2023-12-26 07:06:53,357][123090] Updated weights for policy 1, policy_version 935714 (0.0008) [2023-12-26 07:06:53,422][123090] Updated weights for policy 1, policy_version 935724 (0.0009) [2023-12-26 07:06:53,464][123091] Updated weights for policy 0, policy_version 942360 (0.0008) [2023-12-26 07:06:53,480][123090] Updated weights for policy 1, policy_version 935734 (0.0008) [2023-12-26 07:06:53,516][123091] Updated weights for policy 0, policy_version 942370 (0.0007) [2023-12-26 07:06:53,545][123090] Updated weights for policy 1, policy_version 935744 (0.0008) [2023-12-26 07:06:53,565][123091] Updated weights for policy 0, policy_version 942380 (0.0009) [2023-12-26 07:06:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 480804864. Throughput: 0: 8938.2, 1: 8752.4. Samples: 480778344. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:06:53,784][121949] Avg episode reward: [(0, '6007.857'), (1, '5240.530')] [2023-12-26 07:06:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000942384_241254400.pth... [2023-12-26 07:06:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000935744_239550464.pth... [2023-12-26 07:06:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000941328_240984064.pth [2023-12-26 07:06:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000934720_239288320.pth [2023-12-26 07:06:54,306][123090] Updated weights for policy 1, policy_version 935754 (0.0005) [2023-12-26 07:06:54,381][123090] Updated weights for policy 1, policy_version 935764 (0.0006) [2023-12-26 07:06:54,440][123090] Updated weights for policy 1, policy_version 935774 (0.0010) [2023-12-26 07:06:54,460][123091] Updated weights for policy 0, policy_version 942390 (0.0008) [2023-12-26 07:06:54,521][123091] Updated weights for policy 0, policy_version 942400 (0.0009) [2023-12-26 07:06:54,573][123091] Updated weights for policy 0, policy_version 942410 (0.0009) [2023-12-26 07:06:55,207][123090] Updated weights for policy 1, policy_version 935784 (0.0010) [2023-12-26 07:06:55,262][123090] Updated weights for policy 1, policy_version 935794 (0.0010) [2023-12-26 07:06:55,316][123090] Updated weights for policy 1, policy_version 935804 (0.0010) [2023-12-26 07:06:55,400][123091] Updated weights for policy 0, policy_version 942420 (0.0007) [2023-12-26 07:06:55,448][123091] Updated weights for policy 0, policy_version 942430 (0.0007) [2023-12-26 07:06:55,500][123091] Updated weights for policy 0, policy_version 942440 (0.0009) [2023-12-26 07:06:56,087][123090] Updated weights for policy 1, policy_version 935814 (0.0008) [2023-12-26 07:06:56,146][123090] Updated weights for policy 1, policy_version 935824 (0.0010) [2023-12-26 07:06:56,217][123090] Updated weights for policy 1, policy_version 935834 (0.0010) [2023-12-26 07:06:56,266][123091] Updated weights for policy 0, policy_version 942450 (0.0006) [2023-12-26 07:06:56,333][123091] Updated weights for policy 0, policy_version 942460 (0.0010) [2023-12-26 07:06:56,389][123091] Updated weights for policy 0, policy_version 942470 (0.0008) [2023-12-26 07:06:56,449][123091] Updated weights for policy 0, policy_version 942480 (0.0010) [2023-12-26 07:06:56,873][123090] Updated weights for policy 1, policy_version 935844 (0.0008) [2023-12-26 07:06:56,921][123090] Updated weights for policy 1, policy_version 935854 (0.0005) [2023-12-26 07:06:56,971][123090] Updated weights for policy 1, policy_version 935864 (0.0005) [2023-12-26 07:06:57,127][123091] Updated weights for policy 0, policy_version 942490 (0.0005) [2023-12-26 07:06:57,175][123091] Updated weights for policy 0, policy_version 942500 (0.0005) [2023-12-26 07:06:57,221][123091] Updated weights for policy 0, policy_version 942510 (0.0005) [2023-12-26 07:06:57,742][123090] Updated weights for policy 1, policy_version 935874 (0.0005) [2023-12-26 07:06:57,799][123090] Updated weights for policy 1, policy_version 935884 (0.0006) [2023-12-26 07:06:57,849][123090] Updated weights for policy 1, policy_version 935894 (0.0005) [2023-12-26 07:06:57,899][123090] Updated weights for policy 1, policy_version 935904 (0.0006) [2023-12-26 07:06:57,956][123091] Updated weights for policy 0, policy_version 942520 (0.0005) [2023-12-26 07:06:58,000][123091] Updated weights for policy 0, policy_version 942530 (0.0006) [2023-12-26 07:06:58,074][123091] Updated weights for policy 0, policy_version 942540 (0.0008) [2023-12-26 07:06:58,608][123090] Updated weights for policy 1, policy_version 935914 (0.0009) [2023-12-26 07:06:58,683][123090] Updated weights for policy 1, policy_version 935924 (0.0007) [2023-12-26 07:06:58,755][123090] Updated weights for policy 1, policy_version 935934 (0.0008) [2023-12-26 07:06:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 480894976. Throughput: 0: 8978.8, 1: 8861.7. Samples: 480886804. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:06:58,785][121949] Avg episode reward: [(0, '6152.632'), (1, '5057.768')] [2023-12-26 07:06:58,935][123091] Updated weights for policy 0, policy_version 942550 (0.0009) [2023-12-26 07:06:58,996][123091] Updated weights for policy 0, policy_version 942560 (0.0008) [2023-12-26 07:06:59,063][123091] Updated weights for policy 0, policy_version 942571 (0.0009) [2023-12-26 07:06:59,497][123090] Updated weights for policy 1, policy_version 935944 (0.0005) [2023-12-26 07:06:59,560][123090] Updated weights for policy 1, policy_version 935954 (0.0005) [2023-12-26 07:06:59,620][123090] Updated weights for policy 1, policy_version 935964 (0.0005) [2023-12-26 07:06:59,939][123091] Updated weights for policy 0, policy_version 942581 (0.0008) [2023-12-26 07:06:59,993][123091] Updated weights for policy 0, policy_version 942591 (0.0005) [2023-12-26 07:07:00,048][123091] Updated weights for policy 0, policy_version 942601 (0.0006) [2023-12-26 07:07:00,313][123090] Updated weights for policy 1, policy_version 935974 (0.0008) [2023-12-26 07:07:00,365][123090] Updated weights for policy 1, policy_version 935985 (0.0010) [2023-12-26 07:07:00,417][123090] Updated weights for policy 1, policy_version 935995 (0.0009) [2023-12-26 07:07:00,683][123091] Updated weights for policy 0, policy_version 942611 (0.0005) [2023-12-26 07:07:00,743][123091] Updated weights for policy 0, policy_version 942621 (0.0005) [2023-12-26 07:07:00,797][123091] Updated weights for policy 0, policy_version 942631 (0.0005) [2023-12-26 07:07:01,246][123090] Updated weights for policy 1, policy_version 936005 (0.0009) [2023-12-26 07:07:01,308][123090] Updated weights for policy 1, policy_version 936015 (0.0009) [2023-12-26 07:07:01,382][123090] Updated weights for policy 1, policy_version 936025 (0.0009) [2023-12-26 07:07:01,542][123091] Updated weights for policy 0, policy_version 942641 (0.0006) [2023-12-26 07:07:01,589][123091] Updated weights for policy 0, policy_version 942651 (0.0010) [2023-12-26 07:07:01,646][123091] Updated weights for policy 0, policy_version 942661 (0.0010) [2023-12-26 07:07:01,701][123091] Updated weights for policy 0, policy_version 942671 (0.0010) [2023-12-26 07:07:02,196][123090] Updated weights for policy 1, policy_version 936035 (0.0007) [2023-12-26 07:07:02,260][123090] Updated weights for policy 1, policy_version 936045 (0.0009) [2023-12-26 07:07:02,309][123090] Updated weights for policy 1, policy_version 936055 (0.0009) [2023-12-26 07:07:02,526][123091] Updated weights for policy 0, policy_version 942681 (0.0010) [2023-12-26 07:07:02,587][123091] Updated weights for policy 0, policy_version 942691 (0.0010) [2023-12-26 07:07:02,653][123091] Updated weights for policy 0, policy_version 942701 (0.0010) [2023-12-26 07:07:03,064][123090] Updated weights for policy 1, policy_version 936065 (0.0009) [2023-12-26 07:07:03,115][123090] Updated weights for policy 1, policy_version 936075 (0.0010) [2023-12-26 07:07:03,158][123090] Updated weights for policy 1, policy_version 936085 (0.0010) [2023-12-26 07:07:03,210][123090] Updated weights for policy 1, policy_version 936095 (0.0010) [2023-12-26 07:07:03,399][123091] Updated weights for policy 0, policy_version 942711 (0.0009) [2023-12-26 07:07:03,446][123091] Updated weights for policy 0, policy_version 942721 (0.0007) [2023-12-26 07:07:03,493][123091] Updated weights for policy 0, policy_version 942731 (0.0010) [2023-12-26 07:07:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 480985088. Throughput: 0: 8976.5, 1: 8847.5. Samples: 480995416. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:03,785][121949] Avg episode reward: [(0, '6122.745'), (1, '5007.619')] [2023-12-26 07:07:04,072][123090] Updated weights for policy 1, policy_version 936105 (0.0007) [2023-12-26 07:07:04,136][123090] Updated weights for policy 1, policy_version 936115 (0.0005) [2023-12-26 07:07:04,202][123090] Updated weights for policy 1, policy_version 936125 (0.0006) [2023-12-26 07:07:04,326][123091] Updated weights for policy 0, policy_version 942741 (0.0009) [2023-12-26 07:07:04,392][123091] Updated weights for policy 0, policy_version 942751 (0.0010) [2023-12-26 07:07:04,457][123091] Updated weights for policy 0, policy_version 942761 (0.0009) [2023-12-26 07:07:04,940][123090] Updated weights for policy 1, policy_version 936135 (0.0008) [2023-12-26 07:07:05,005][123090] Updated weights for policy 1, policy_version 936145 (0.0010) [2023-12-26 07:07:05,072][123090] Updated weights for policy 1, policy_version 936156 (0.0009) [2023-12-26 07:07:05,288][123091] Updated weights for policy 0, policy_version 942771 (0.0009) [2023-12-26 07:07:05,356][123091] Updated weights for policy 0, policy_version 942781 (0.0010) [2023-12-26 07:07:05,421][123091] Updated weights for policy 0, policy_version 942791 (0.0010) [2023-12-26 07:07:05,824][123090] Updated weights for policy 1, policy_version 936166 (0.0010) [2023-12-26 07:07:05,892][123090] Updated weights for policy 1, policy_version 936176 (0.0009) [2023-12-26 07:07:05,964][123090] Updated weights for policy 1, policy_version 936186 (0.0009) [2023-12-26 07:07:06,260][123091] Updated weights for policy 0, policy_version 942801 (0.0008) [2023-12-26 07:07:06,323][123091] Updated weights for policy 0, policy_version 942811 (0.0010) [2023-12-26 07:07:06,388][123091] Updated weights for policy 0, policy_version 942821 (0.0010) [2023-12-26 07:07:06,454][123091] Updated weights for policy 0, policy_version 942831 (0.0009) [2023-12-26 07:07:06,768][123090] Updated weights for policy 1, policy_version 936196 (0.0010) [2023-12-26 07:07:06,817][123090] Updated weights for policy 1, policy_version 936206 (0.0009) [2023-12-26 07:07:06,865][123090] Updated weights for policy 1, policy_version 936216 (0.0009) [2023-12-26 07:07:07,266][123091] Updated weights for policy 0, policy_version 942841 (0.0006) [2023-12-26 07:07:07,326][123091] Updated weights for policy 0, policy_version 942851 (0.0005) [2023-12-26 07:07:07,394][123091] Updated weights for policy 0, policy_version 942861 (0.0006) [2023-12-26 07:07:07,724][123090] Updated weights for policy 1, policy_version 936226 (0.0008) [2023-12-26 07:07:07,790][123090] Updated weights for policy 1, policy_version 936236 (0.0005) [2023-12-26 07:07:07,856][123090] Updated weights for policy 1, policy_version 936246 (0.0005) [2023-12-26 07:07:07,913][123090] Updated weights for policy 1, policy_version 936256 (0.0006) [2023-12-26 07:07:08,220][123091] Updated weights for policy 0, policy_version 942871 (0.0009) [2023-12-26 07:07:08,291][123091] Updated weights for policy 0, policy_version 942881 (0.0010) [2023-12-26 07:07:08,349][123091] Updated weights for policy 0, policy_version 942891 (0.0009) [2023-12-26 07:07:08,523][123090] Updated weights for policy 1, policy_version 936266 (0.0009) [2023-12-26 07:07:08,592][123090] Updated weights for policy 1, policy_version 936276 (0.0007) [2023-12-26 07:07:08,647][123090] Updated weights for policy 1, policy_version 936286 (0.0005) [2023-12-26 07:07:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 481075200. Throughput: 0: 8959.7, 1: 8846.8. Samples: 481046748. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:08,785][121949] Avg episode reward: [(0, '6136.690'), (1, '5037.385')] [2023-12-26 07:07:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000942896_241385472.pth... [2023-12-26 07:07:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000936288_239689728.pth... [2023-12-26 07:07:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000941872_241123328.pth [2023-12-26 07:07:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000935232_239419392.pth [2023-12-26 07:07:09,234][123091] Updated weights for policy 0, policy_version 942901 (0.0009) [2023-12-26 07:07:09,294][123091] Updated weights for policy 0, policy_version 942911 (0.0009) [2023-12-26 07:07:09,359][123091] Updated weights for policy 0, policy_version 942921 (0.0010) [2023-12-26 07:07:09,425][123090] Updated weights for policy 1, policy_version 936296 (0.0008) [2023-12-26 07:07:09,488][123090] Updated weights for policy 1, policy_version 936306 (0.0008) [2023-12-26 07:07:09,544][123090] Updated weights for policy 1, policy_version 936316 (0.0008) [2023-12-26 07:07:10,231][123091] Updated weights for policy 0, policy_version 942931 (0.0008) [2023-12-26 07:07:10,303][123091] Updated weights for policy 0, policy_version 942941 (0.0009) [2023-12-26 07:07:10,367][123091] Updated weights for policy 0, policy_version 942951 (0.0008) [2023-12-26 07:07:10,382][123090] Updated weights for policy 1, policy_version 936326 (0.0010) [2023-12-26 07:07:10,441][123090] Updated weights for policy 1, policy_version 936336 (0.0009) [2023-12-26 07:07:10,497][123090] Updated weights for policy 1, policy_version 936346 (0.0010) [2023-12-26 07:07:11,059][123091] Updated weights for policy 0, policy_version 942961 (0.0008) [2023-12-26 07:07:11,124][123091] Updated weights for policy 0, policy_version 942971 (0.0008) [2023-12-26 07:07:11,204][123091] Updated weights for policy 0, policy_version 942981 (0.0008) [2023-12-26 07:07:11,273][123091] Updated weights for policy 0, policy_version 942991 (0.0008) [2023-12-26 07:07:11,333][123090] Updated weights for policy 1, policy_version 936356 (0.0011) [2023-12-26 07:07:11,404][123090] Updated weights for policy 1, policy_version 936366 (0.0010) [2023-12-26 07:07:11,468][123090] Updated weights for policy 1, policy_version 936376 (0.0010) [2023-12-26 07:07:12,056][123091] Updated weights for policy 0, policy_version 943001 (0.0007) [2023-12-26 07:07:12,118][123091] Updated weights for policy 0, policy_version 943011 (0.0010) [2023-12-26 07:07:12,175][123091] Updated weights for policy 0, policy_version 943021 (0.0009) [2023-12-26 07:07:12,367][123090] Updated weights for policy 1, policy_version 936386 (0.0010) [2023-12-26 07:07:12,441][123090] Updated weights for policy 1, policy_version 936396 (0.0010) [2023-12-26 07:07:12,501][123090] Updated weights for policy 1, policy_version 936406 (0.0010) [2023-12-26 07:07:12,554][123090] Updated weights for policy 1, policy_version 936416 (0.0009) [2023-12-26 07:07:13,012][123091] Updated weights for policy 0, policy_version 943031 (0.0010) [2023-12-26 07:07:13,063][123091] Updated weights for policy 0, policy_version 943041 (0.0006) [2023-12-26 07:07:13,116][123091] Updated weights for policy 0, policy_version 943051 (0.0005) [2023-12-26 07:07:13,426][123090] Updated weights for policy 1, policy_version 936426 (0.0010) [2023-12-26 07:07:13,497][123090] Updated weights for policy 1, policy_version 936436 (0.0009) [2023-12-26 07:07:13,569][123090] Updated weights for policy 1, policy_version 936446 (0.0009) [2023-12-26 07:07:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 481157120. Throughput: 0: 8860.1, 1: 8808.3. Samples: 481151240. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:13,785][121949] Avg episode reward: [(0, '6156.115'), (1, '5345.296')] [2023-12-26 07:07:13,827][123091] Updated weights for policy 0, policy_version 943061 (0.0008) [2023-12-26 07:07:13,872][123091] Updated weights for policy 0, policy_version 943071 (0.0005) [2023-12-26 07:07:13,924][123091] Updated weights for policy 0, policy_version 943081 (0.0005) [2023-12-26 07:07:14,434][123090] Updated weights for policy 1, policy_version 936456 (0.0010) [2023-12-26 07:07:14,495][123090] Updated weights for policy 1, policy_version 936466 (0.0009) [2023-12-26 07:07:14,555][123090] Updated weights for policy 1, policy_version 936477 (0.0009) [2023-12-26 07:07:14,607][123091] Updated weights for policy 0, policy_version 943091 (0.0005) [2023-12-26 07:07:14,657][123091] Updated weights for policy 0, policy_version 943101 (0.0006) [2023-12-26 07:07:14,714][123091] Updated weights for policy 0, policy_version 943111 (0.0005) [2023-12-26 07:07:15,443][123090] Updated weights for policy 1, policy_version 936487 (0.0008) [2023-12-26 07:07:15,465][123091] Updated weights for policy 0, policy_version 943121 (0.0006) [2023-12-26 07:07:15,512][123090] Updated weights for policy 1, policy_version 936497 (0.0007) [2023-12-26 07:07:15,522][123091] Updated weights for policy 0, policy_version 943131 (0.0009) [2023-12-26 07:07:15,587][123090] Updated weights for policy 1, policy_version 936507 (0.0006) [2023-12-26 07:07:15,587][123091] Updated weights for policy 0, policy_version 943141 (0.0009) [2023-12-26 07:07:15,656][123091] Updated weights for policy 0, policy_version 943151 (0.0010) [2023-12-26 07:07:16,308][123090] Updated weights for policy 1, policy_version 936517 (0.0007) [2023-12-26 07:07:16,365][123090] Updated weights for policy 1, policy_version 936527 (0.0009) [2023-12-26 07:07:16,432][123090] Updated weights for policy 1, policy_version 936537 (0.0009) [2023-12-26 07:07:16,481][123091] Updated weights for policy 0, policy_version 943161 (0.0009) [2023-12-26 07:07:16,545][123091] Updated weights for policy 0, policy_version 943171 (0.0009) [2023-12-26 07:07:16,607][123091] Updated weights for policy 0, policy_version 943181 (0.0010) [2023-12-26 07:07:17,260][123090] Updated weights for policy 1, policy_version 936547 (0.0008) [2023-12-26 07:07:17,310][123090] Updated weights for policy 1, policy_version 936557 (0.0009) [2023-12-26 07:07:17,363][123090] Updated weights for policy 1, policy_version 936568 (0.0009) [2023-12-26 07:07:17,408][123091] Updated weights for policy 0, policy_version 943191 (0.0006) [2023-12-26 07:07:17,454][123091] Updated weights for policy 0, policy_version 943201 (0.0005) [2023-12-26 07:07:17,509][123091] Updated weights for policy 0, policy_version 943211 (0.0005) [2023-12-26 07:07:18,183][123091] Updated weights for policy 0, policy_version 943221 (0.0008) [2023-12-26 07:07:18,231][123091] Updated weights for policy 0, policy_version 943231 (0.0006) [2023-12-26 07:07:18,278][123091] Updated weights for policy 0, policy_version 943241 (0.0005) [2023-12-26 07:07:18,279][123090] Updated weights for policy 1, policy_version 936578 (0.0009) [2023-12-26 07:07:18,334][123090] Updated weights for policy 1, policy_version 936588 (0.0009) [2023-12-26 07:07:18,399][123090] Updated weights for policy 1, policy_version 936598 (0.0009) [2023-12-26 07:07:18,471][123090] Updated weights for policy 1, policy_version 936608 (0.0009) [2023-12-26 07:07:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 481247232. Throughput: 0: 8911.0, 1: 8764.6. Samples: 481257196. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:18,785][121949] Avg episode reward: [(0, '6110.908'), (1, '5328.748')] [2023-12-26 07:07:19,065][123091] Updated weights for policy 0, policy_version 943251 (0.0007) [2023-12-26 07:07:19,117][123091] Updated weights for policy 0, policy_version 943261 (0.0009) [2023-12-26 07:07:19,175][123091] Updated weights for policy 0, policy_version 943271 (0.0009) [2023-12-26 07:07:19,309][123090] Updated weights for policy 1, policy_version 936618 (0.0008) [2023-12-26 07:07:19,381][123090] Updated weights for policy 1, policy_version 936628 (0.0009) [2023-12-26 07:07:19,446][123090] Updated weights for policy 1, policy_version 936638 (0.0009) [2023-12-26 07:07:19,981][123091] Updated weights for policy 0, policy_version 943281 (0.0009) [2023-12-26 07:07:20,048][123091] Updated weights for policy 0, policy_version 943291 (0.0006) [2023-12-26 07:07:20,119][123091] Updated weights for policy 0, policy_version 943301 (0.0007) [2023-12-26 07:07:20,188][123091] Updated weights for policy 0, policy_version 943311 (0.0009) [2023-12-26 07:07:20,355][123090] Updated weights for policy 1, policy_version 936648 (0.0009) [2023-12-26 07:07:20,429][123090] Updated weights for policy 1, policy_version 936658 (0.0010) [2023-12-26 07:07:20,497][123090] Updated weights for policy 1, policy_version 936668 (0.0009) [2023-12-26 07:07:21,015][123091] Updated weights for policy 0, policy_version 943321 (0.0006) [2023-12-26 07:07:21,090][123091] Updated weights for policy 0, policy_version 943331 (0.0010) [2023-12-26 07:07:21,160][123091] Updated weights for policy 0, policy_version 943341 (0.0010) [2023-12-26 07:07:21,374][123090] Updated weights for policy 1, policy_version 936678 (0.0009) [2023-12-26 07:07:21,439][123090] Updated weights for policy 1, policy_version 936688 (0.0010) [2023-12-26 07:07:21,502][123090] Updated weights for policy 1, policy_version 936698 (0.0009) [2023-12-26 07:07:21,993][123091] Updated weights for policy 0, policy_version 943351 (0.0010) [2023-12-26 07:07:22,051][123091] Updated weights for policy 0, policy_version 943361 (0.0010) [2023-12-26 07:07:22,109][123091] Updated weights for policy 0, policy_version 943371 (0.0010) [2023-12-26 07:07:22,355][123090] Updated weights for policy 1, policy_version 936708 (0.0010) [2023-12-26 07:07:22,422][123090] Updated weights for policy 1, policy_version 936718 (0.0010) [2023-12-26 07:07:22,493][123090] Updated weights for policy 1, policy_version 936728 (0.0009) [2023-12-26 07:07:22,923][123091] Updated weights for policy 0, policy_version 943381 (0.0010) [2023-12-26 07:07:22,980][123091] Updated weights for policy 0, policy_version 943391 (0.0009) [2023-12-26 07:07:23,037][123091] Updated weights for policy 0, policy_version 943401 (0.0008) [2023-12-26 07:07:23,359][123090] Updated weights for policy 1, policy_version 936738 (0.0010) [2023-12-26 07:07:23,408][123090] Updated weights for policy 1, policy_version 936748 (0.0009) [2023-12-26 07:07:23,462][123090] Updated weights for policy 1, policy_version 936758 (0.0009) [2023-12-26 07:07:23,510][123090] Updated weights for policy 1, policy_version 936768 (0.0009) [2023-12-26 07:07:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 481329152. Throughput: 0: 8849.1, 1: 8763.4. Samples: 481307288. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:23,785][121949] Avg episode reward: [(0, '6208.462'), (1, '5253.059')] [2023-12-26 07:07:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000943408_241516544.pth... [2023-12-26 07:07:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000936768_239812608.pth... [2023-12-26 07:07:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000942384_241254400.pth [2023-12-26 07:07:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000935744_239550464.pth [2023-12-26 07:07:23,879][123091] Updated weights for policy 0, policy_version 943411 (0.0010) [2023-12-26 07:07:23,934][123091] Updated weights for policy 0, policy_version 943421 (0.0009) [2023-12-26 07:07:23,987][123091] Updated weights for policy 0, policy_version 943431 (0.0010) [2023-12-26 07:07:24,371][123090] Updated weights for policy 1, policy_version 936778 (0.0010) [2023-12-26 07:07:24,432][123090] Updated weights for policy 1, policy_version 936788 (0.0009) [2023-12-26 07:07:24,481][123090] Updated weights for policy 1, policy_version 936798 (0.0009) [2023-12-26 07:07:24,819][123091] Updated weights for policy 0, policy_version 943441 (0.0010) [2023-12-26 07:07:24,871][123091] Updated weights for policy 0, policy_version 943451 (0.0009) [2023-12-26 07:07:24,921][123091] Updated weights for policy 0, policy_version 943461 (0.0009) [2023-12-26 07:07:24,986][123091] Updated weights for policy 0, policy_version 943471 (0.0010) [2023-12-26 07:07:25,327][123090] Updated weights for policy 1, policy_version 936808 (0.0009) [2023-12-26 07:07:25,397][123090] Updated weights for policy 1, policy_version 936818 (0.0010) [2023-12-26 07:07:25,461][123090] Updated weights for policy 1, policy_version 936828 (0.0009) [2023-12-26 07:07:25,808][123091] Updated weights for policy 0, policy_version 943481 (0.0009) [2023-12-26 07:07:25,857][123091] Updated weights for policy 0, policy_version 943491 (0.0009) [2023-12-26 07:07:25,908][123091] Updated weights for policy 0, policy_version 943501 (0.0008) [2023-12-26 07:07:26,332][123090] Updated weights for policy 1, policy_version 936838 (0.0009) [2023-12-26 07:07:26,386][123090] Updated weights for policy 1, policy_version 936848 (0.0009) [2023-12-26 07:07:26,440][123090] Updated weights for policy 1, policy_version 936858 (0.0009) [2023-12-26 07:07:26,687][123091] Updated weights for policy 0, policy_version 943511 (0.0008) [2023-12-26 07:07:26,749][123091] Updated weights for policy 0, policy_version 943521 (0.0009) [2023-12-26 07:07:26,805][123091] Updated weights for policy 0, policy_version 943531 (0.0010) [2023-12-26 07:07:27,303][123090] Updated weights for policy 1, policy_version 936868 (0.0010) [2023-12-26 07:07:27,363][123090] Updated weights for policy 1, policy_version 936878 (0.0009) [2023-12-26 07:07:27,430][123090] Updated weights for policy 1, policy_version 936888 (0.0009) [2023-12-26 07:07:27,624][123091] Updated weights for policy 0, policy_version 943541 (0.0009) [2023-12-26 07:07:27,690][123091] Updated weights for policy 0, policy_version 943551 (0.0010) [2023-12-26 07:07:27,758][123091] Updated weights for policy 0, policy_version 943561 (0.0009) [2023-12-26 07:07:28,244][123090] Updated weights for policy 1, policy_version 936898 (0.0007) [2023-12-26 07:07:28,309][123090] Updated weights for policy 1, policy_version 936908 (0.0010) [2023-12-26 07:07:28,376][123090] Updated weights for policy 1, policy_version 936918 (0.0009) [2023-12-26 07:07:28,442][123090] Updated weights for policy 1, policy_version 936928 (0.0009) [2023-12-26 07:07:28,560][123091] Updated weights for policy 0, policy_version 943571 (0.0009) [2023-12-26 07:07:28,618][123091] Updated weights for policy 0, policy_version 943581 (0.0009) [2023-12-26 07:07:28,676][123091] Updated weights for policy 0, policy_version 943591 (0.0010) [2023-12-26 07:07:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 481419264. Throughput: 0: 8827.7, 1: 8758.6. Samples: 481409580. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:28,785][121949] Avg episode reward: [(0, '6266.628'), (1, '5243.646')] [2023-12-26 07:07:29,181][123090] Updated weights for policy 1, policy_version 936938 (0.0005) [2023-12-26 07:07:29,244][123090] Updated weights for policy 1, policy_version 936948 (0.0006) [2023-12-26 07:07:29,304][123090] Updated weights for policy 1, policy_version 936958 (0.0010) [2023-12-26 07:07:29,598][123091] Updated weights for policy 0, policy_version 943601 (0.0010) [2023-12-26 07:07:29,656][123091] Updated weights for policy 0, policy_version 943611 (0.0010) [2023-12-26 07:07:29,724][123091] Updated weights for policy 0, policy_version 943621 (0.0009) [2023-12-26 07:07:29,777][123091] Updated weights for policy 0, policy_version 943631 (0.0009) [2023-12-26 07:07:30,020][123090] Updated weights for policy 1, policy_version 936968 (0.0006) [2023-12-26 07:07:30,089][123090] Updated weights for policy 1, policy_version 936978 (0.0008) [2023-12-26 07:07:30,144][123090] Updated weights for policy 1, policy_version 936988 (0.0010) [2023-12-26 07:07:30,684][123091] Updated weights for policy 0, policy_version 943641 (0.0009) [2023-12-26 07:07:30,740][123091] Updated weights for policy 0, policy_version 943652 (0.0009) [2023-12-26 07:07:30,796][123091] Updated weights for policy 0, policy_version 943662 (0.0010) [2023-12-26 07:07:30,810][123090] Updated weights for policy 1, policy_version 936998 (0.0007) [2023-12-26 07:07:30,867][123090] Updated weights for policy 1, policy_version 937008 (0.0006) [2023-12-26 07:07:30,924][123090] Updated weights for policy 1, policy_version 937018 (0.0006) [2023-12-26 07:07:31,626][123090] Updated weights for policy 1, policy_version 937028 (0.0007) [2023-12-26 07:07:31,682][123090] Updated weights for policy 1, policy_version 937038 (0.0010) [2023-12-26 07:07:31,731][123091] Updated weights for policy 0, policy_version 943672 (0.0009) [2023-12-26 07:07:31,751][123090] Updated weights for policy 1, policy_version 937048 (0.0010) [2023-12-26 07:07:31,800][123091] Updated weights for policy 0, policy_version 943682 (0.0008) [2023-12-26 07:07:31,871][123091] Updated weights for policy 0, policy_version 943692 (0.0008) [2023-12-26 07:07:32,531][123090] Updated weights for policy 1, policy_version 937058 (0.0010) [2023-12-26 07:07:32,594][123090] Updated weights for policy 1, policy_version 937068 (0.0010) [2023-12-26 07:07:32,647][123091] Updated weights for policy 0, policy_version 943702 (0.0009) [2023-12-26 07:07:32,656][123090] Updated weights for policy 1, policy_version 937078 (0.0010) [2023-12-26 07:07:32,703][123091] Updated weights for policy 0, policy_version 943712 (0.0005) [2023-12-26 07:07:32,723][123090] Updated weights for policy 1, policy_version 937088 (0.0010) [2023-12-26 07:07:32,768][123091] Updated weights for policy 0, policy_version 943722 (0.0008) [2023-12-26 07:07:33,403][123091] Updated weights for policy 0, policy_version 943732 (0.0006) [2023-12-26 07:07:33,435][123090] Updated weights for policy 1, policy_version 937098 (0.0005) [2023-12-26 07:07:33,465][123091] Updated weights for policy 0, policy_version 943742 (0.0006) [2023-12-26 07:07:33,500][123090] Updated weights for policy 1, policy_version 937108 (0.0005) [2023-12-26 07:07:33,533][123091] Updated weights for policy 0, policy_version 943752 (0.0008) [2023-12-26 07:07:33,554][123090] Updated weights for policy 1, policy_version 937118 (0.0005) [2023-12-26 07:07:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 481509376. Throughput: 0: 8777.2, 1: 8820.7. Samples: 481518344. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:33,785][121949] Avg episode reward: [(0, '6268.390'), (1, '5279.152')] [2023-12-26 07:07:34,289][123091] Updated weights for policy 0, policy_version 943762 (0.0008) [2023-12-26 07:07:34,325][123090] Updated weights for policy 1, policy_version 937128 (0.0010) [2023-12-26 07:07:34,348][123091] Updated weights for policy 0, policy_version 943772 (0.0008) [2023-12-26 07:07:34,392][123090] Updated weights for policy 1, policy_version 937138 (0.0010) [2023-12-26 07:07:34,410][123091] Updated weights for policy 0, policy_version 943782 (0.0007) [2023-12-26 07:07:34,456][123090] Updated weights for policy 1, policy_version 937148 (0.0011) [2023-12-26 07:07:34,475][123091] Updated weights for policy 0, policy_version 943792 (0.0006) [2023-12-26 07:07:35,118][123091] Updated weights for policy 0, policy_version 943802 (0.0005) [2023-12-26 07:07:35,173][123091] Updated weights for policy 0, policy_version 943812 (0.0005) [2023-12-26 07:07:35,220][123091] Updated weights for policy 0, policy_version 943822 (0.0005) [2023-12-26 07:07:35,268][123090] Updated weights for policy 1, policy_version 937158 (0.0010) [2023-12-26 07:07:35,326][123090] Updated weights for policy 1, policy_version 937168 (0.0010) [2023-12-26 07:07:35,400][123090] Updated weights for policy 1, policy_version 937178 (0.0010) [2023-12-26 07:07:35,885][123091] Updated weights for policy 0, policy_version 943832 (0.0005) [2023-12-26 07:07:35,956][123091] Updated weights for policy 0, policy_version 943842 (0.0006) [2023-12-26 07:07:36,016][123091] Updated weights for policy 0, policy_version 943852 (0.0011) [2023-12-26 07:07:36,244][123090] Updated weights for policy 1, policy_version 937188 (0.0010) [2023-12-26 07:07:36,309][123090] Updated weights for policy 1, policy_version 937198 (0.0009) [2023-12-26 07:07:36,369][123090] Updated weights for policy 1, policy_version 937208 (0.0009) [2023-12-26 07:07:36,737][123091] Updated weights for policy 0, policy_version 943862 (0.0010) [2023-12-26 07:07:36,790][123091] Updated weights for policy 0, policy_version 943872 (0.0008) [2023-12-26 07:07:36,839][123091] Updated weights for policy 0, policy_version 943882 (0.0009) [2023-12-26 07:07:37,194][123090] Updated weights for policy 1, policy_version 937218 (0.0009) [2023-12-26 07:07:37,253][123090] Updated weights for policy 1, policy_version 937228 (0.0010) [2023-12-26 07:07:37,321][123090] Updated weights for policy 1, policy_version 937238 (0.0007) [2023-12-26 07:07:37,378][123090] Updated weights for policy 1, policy_version 937248 (0.0007) [2023-12-26 07:07:37,715][123091] Updated weights for policy 0, policy_version 943892 (0.0007) [2023-12-26 07:07:37,791][123091] Updated weights for policy 0, policy_version 943902 (0.0006) [2023-12-26 07:07:37,858][123091] Updated weights for policy 0, policy_version 943912 (0.0006) [2023-12-26 07:07:38,165][123090] Updated weights for policy 1, policy_version 937258 (0.0009) [2023-12-26 07:07:38,221][123090] Updated weights for policy 1, policy_version 937268 (0.0010) [2023-12-26 07:07:38,276][123090] Updated weights for policy 1, policy_version 937278 (0.0009) [2023-12-26 07:07:38,604][123091] Updated weights for policy 0, policy_version 943922 (0.0008) [2023-12-26 07:07:38,672][123091] Updated weights for policy 0, policy_version 943932 (0.0010) [2023-12-26 07:07:38,736][123091] Updated weights for policy 0, policy_version 943942 (0.0009) [2023-12-26 07:07:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 481591296. Throughput: 0: 8879.2, 1: 8790.4. Samples: 481573476. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:38,785][121949] Avg episode reward: [(0, '6186.677'), (1, '5403.445')] [2023-12-26 07:07:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000937280_239943680.pth... [2023-12-26 07:07:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000943952_241655808.pth... [2023-12-26 07:07:38,792][123091] Updated weights for policy 0, policy_version 943952 (0.0009) [2023-12-26 07:07:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000936288_239689728.pth [2023-12-26 07:07:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000942896_241385472.pth [2023-12-26 07:07:39,140][123090] Updated weights for policy 1, policy_version 937288 (0.0009) [2023-12-26 07:07:39,203][123090] Updated weights for policy 1, policy_version 937298 (0.0009) [2023-12-26 07:07:39,273][123090] Updated weights for policy 1, policy_version 937308 (0.0009) [2023-12-26 07:07:39,638][123091] Updated weights for policy 0, policy_version 943962 (0.0010) [2023-12-26 07:07:39,698][123091] Updated weights for policy 0, policy_version 943972 (0.0009) [2023-12-26 07:07:39,760][123091] Updated weights for policy 0, policy_version 943982 (0.0009) [2023-12-26 07:07:40,154][123090] Updated weights for policy 1, policy_version 937318 (0.0009) [2023-12-26 07:07:40,210][123090] Updated weights for policy 1, policy_version 937328 (0.0008) [2023-12-26 07:07:40,272][123090] Updated weights for policy 1, policy_version 937338 (0.0010) [2023-12-26 07:07:40,583][123091] Updated weights for policy 0, policy_version 943992 (0.0009) [2023-12-26 07:07:40,632][123091] Updated weights for policy 0, policy_version 944002 (0.0009) [2023-12-26 07:07:40,683][123091] Updated weights for policy 0, policy_version 944012 (0.0010) [2023-12-26 07:07:41,110][123090] Updated weights for policy 1, policy_version 937348 (0.0008) [2023-12-26 07:07:41,186][123090] Updated weights for policy 1, policy_version 937358 (0.0009) [2023-12-26 07:07:41,244][123090] Updated weights for policy 1, policy_version 937368 (0.0009) [2023-12-26 07:07:41,514][123091] Updated weights for policy 0, policy_version 944023 (0.0010) [2023-12-26 07:07:41,576][123091] Updated weights for policy 0, policy_version 944033 (0.0010) [2023-12-26 07:07:41,648][123091] Updated weights for policy 0, policy_version 944043 (0.0009) [2023-12-26 07:07:42,082][123090] Updated weights for policy 1, policy_version 937378 (0.0009) [2023-12-26 07:07:42,134][123090] Updated weights for policy 1, policy_version 937388 (0.0008) [2023-12-26 07:07:42,191][123090] Updated weights for policy 1, policy_version 937398 (0.0009) [2023-12-26 07:07:42,243][123090] Updated weights for policy 1, policy_version 937408 (0.0008) [2023-12-26 07:07:42,465][123091] Updated weights for policy 0, policy_version 944053 (0.0009) [2023-12-26 07:07:42,534][123091] Updated weights for policy 0, policy_version 944063 (0.0007) [2023-12-26 07:07:42,599][123091] Updated weights for policy 0, policy_version 944073 (0.0010) [2023-12-26 07:07:43,207][123090] Updated weights for policy 1, policy_version 937418 (0.0010) [2023-12-26 07:07:43,274][123090] Updated weights for policy 1, policy_version 937428 (0.0010) [2023-12-26 07:07:43,312][123091] Updated weights for policy 0, policy_version 944083 (0.0009) [2023-12-26 07:07:43,340][123090] Updated weights for policy 1, policy_version 937438 (0.0011) [2023-12-26 07:07:43,363][123091] Updated weights for policy 0, policy_version 944093 (0.0005) [2023-12-26 07:07:43,422][123091] Updated weights for policy 0, policy_version 944103 (0.0005) [2023-12-26 07:07:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 481681408. Throughput: 0: 8834.9, 1: 8670.8. Samples: 481674556. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:43,785][121949] Avg episode reward: [(0, '6105.994'), (1, '5300.317')] [2023-12-26 07:07:44,165][123091] Updated weights for policy 0, policy_version 944113 (0.0008) [2023-12-26 07:07:44,209][123090] Updated weights for policy 1, policy_version 937448 (0.0009) [2023-12-26 07:07:44,221][123091] Updated weights for policy 0, policy_version 944123 (0.0005) [2023-12-26 07:07:44,265][123090] Updated weights for policy 1, policy_version 937458 (0.0009) [2023-12-26 07:07:44,276][123091] Updated weights for policy 0, policy_version 944133 (0.0007) [2023-12-26 07:07:44,315][123090] Updated weights for policy 1, policy_version 937468 (0.0007) [2023-12-26 07:07:44,334][123091] Updated weights for policy 0, policy_version 944143 (0.0010) [2023-12-26 07:07:45,066][123090] Updated weights for policy 1, policy_version 937478 (0.0009) [2023-12-26 07:07:45,130][123090] Updated weights for policy 1, policy_version 937488 (0.0011) [2023-12-26 07:07:45,145][123091] Updated weights for policy 0, policy_version 944153 (0.0011) [2023-12-26 07:07:45,182][123090] Updated weights for policy 1, policy_version 937498 (0.0009) [2023-12-26 07:07:45,210][123091] Updated weights for policy 0, policy_version 944163 (0.0011) [2023-12-26 07:07:45,277][123091] Updated weights for policy 0, policy_version 944173 (0.0011) [2023-12-26 07:07:46,031][123090] Updated weights for policy 1, policy_version 937508 (0.0010) [2023-12-26 07:07:46,091][123091] Updated weights for policy 0, policy_version 944183 (0.0011) [2023-12-26 07:07:46,094][123090] Updated weights for policy 1, policy_version 937518 (0.0006) [2023-12-26 07:07:46,147][123091] Updated weights for policy 0, policy_version 944193 (0.0011) [2023-12-26 07:07:46,158][123090] Updated weights for policy 1, policy_version 937528 (0.0006) [2023-12-26 07:07:46,202][123091] Updated weights for policy 0, policy_version 944203 (0.0010) [2023-12-26 07:07:46,989][123090] Updated weights for policy 1, policy_version 937538 (0.0007) [2023-12-26 07:07:47,044][123091] Updated weights for policy 0, policy_version 944213 (0.0010) [2023-12-26 07:07:47,059][123090] Updated weights for policy 1, policy_version 937548 (0.0008) [2023-12-26 07:07:47,099][123091] Updated weights for policy 0, policy_version 944223 (0.0010) [2023-12-26 07:07:47,118][123090] Updated weights for policy 1, policy_version 937558 (0.0006) [2023-12-26 07:07:47,161][123091] Updated weights for policy 0, policy_version 944233 (0.0010) [2023-12-26 07:07:47,173][123090] Updated weights for policy 1, policy_version 937568 (0.0007) [2023-12-26 07:07:47,904][123091] Updated weights for policy 0, policy_version 944243 (0.0010) [2023-12-26 07:07:47,942][123090] Updated weights for policy 1, policy_version 937578 (0.0010) [2023-12-26 07:07:47,964][123091] Updated weights for policy 0, policy_version 944253 (0.0011) [2023-12-26 07:07:48,003][123090] Updated weights for policy 1, policy_version 937588 (0.0009) [2023-12-26 07:07:48,020][123091] Updated weights for policy 0, policy_version 944263 (0.0010) [2023-12-26 07:07:48,062][123090] Updated weights for policy 1, policy_version 937598 (0.0005) [2023-12-26 07:07:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 481763328. Throughput: 0: 8824.3, 1: 8617.6. Samples: 481780300. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:48,785][121949] Avg episode reward: [(0, '6003.491'), (1, '5183.273')] [2023-12-26 07:07:48,789][123090] Updated weights for policy 1, policy_version 937608 (0.0007) [2023-12-26 07:07:48,852][123090] Updated weights for policy 1, policy_version 937618 (0.0008) [2023-12-26 07:07:48,855][123091] Updated weights for policy 0, policy_version 944273 (0.0011) [2023-12-26 07:07:48,901][123090] Updated weights for policy 1, policy_version 937628 (0.0008) [2023-12-26 07:07:48,918][123091] Updated weights for policy 0, policy_version 944283 (0.0011) [2023-12-26 07:07:48,981][123091] Updated weights for policy 0, policy_version 944293 (0.0011) [2023-12-26 07:07:49,044][123091] Updated weights for policy 0, policy_version 944303 (0.0011) [2023-12-26 07:07:49,661][123090] Updated weights for policy 1, policy_version 937638 (0.0007) [2023-12-26 07:07:49,724][123090] Updated weights for policy 1, policy_version 937648 (0.0007) [2023-12-26 07:07:49,784][123090] Updated weights for policy 1, policy_version 937658 (0.0009) [2023-12-26 07:07:49,874][123091] Updated weights for policy 0, policy_version 944313 (0.0012) [2023-12-26 07:07:49,950][123091] Updated weights for policy 0, policy_version 944323 (0.0009) [2023-12-26 07:07:50,020][123091] Updated weights for policy 0, policy_version 944333 (0.0009) [2023-12-26 07:07:50,578][123090] Updated weights for policy 1, policy_version 937668 (0.0014) [2023-12-26 07:07:50,643][123090] Updated weights for policy 1, policy_version 937678 (0.0007) [2023-12-26 07:07:50,708][123090] Updated weights for policy 1, policy_version 937688 (0.0005) [2023-12-26 07:07:50,848][123091] Updated weights for policy 0, policy_version 944343 (0.0010) [2023-12-26 07:07:50,902][123091] Updated weights for policy 0, policy_version 944353 (0.0010) [2023-12-26 07:07:50,958][123091] Updated weights for policy 0, policy_version 944363 (0.0010) [2023-12-26 07:07:51,456][123090] Updated weights for policy 1, policy_version 937698 (0.0005) [2023-12-26 07:07:51,529][123090] Updated weights for policy 1, policy_version 937708 (0.0007) [2023-12-26 07:07:51,598][123090] Updated weights for policy 1, policy_version 937718 (0.0009) [2023-12-26 07:07:51,662][123090] Updated weights for policy 1, policy_version 937728 (0.0008) [2023-12-26 07:07:51,834][123091] Updated weights for policy 0, policy_version 944373 (0.0010) [2023-12-26 07:07:51,900][123091] Updated weights for policy 0, policy_version 944383 (0.0010) [2023-12-26 07:07:51,968][123091] Updated weights for policy 0, policy_version 944393 (0.0010) [2023-12-26 07:07:52,493][123090] Updated weights for policy 1, policy_version 937738 (0.0010) [2023-12-26 07:07:52,543][123090] Updated weights for policy 1, policy_version 937748 (0.0009) [2023-12-26 07:07:52,609][123090] Updated weights for policy 1, policy_version 937758 (0.0009) [2023-12-26 07:07:52,828][123091] Updated weights for policy 0, policy_version 944403 (0.0011) [2023-12-26 07:07:52,889][123091] Updated weights for policy 0, policy_version 944413 (0.0009) [2023-12-26 07:07:52,956][123091] Updated weights for policy 0, policy_version 944423 (0.0009) [2023-12-26 07:07:53,425][123090] Updated weights for policy 1, policy_version 937768 (0.0009) [2023-12-26 07:07:53,492][123090] Updated weights for policy 1, policy_version 937778 (0.0006) [2023-12-26 07:07:53,564][123090] Updated weights for policy 1, policy_version 937788 (0.0005) [2023-12-26 07:07:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 481853440. Throughput: 0: 8817.8, 1: 8630.5. Samples: 481831920. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:53,785][121949] Avg episode reward: [(0, '6036.799'), (1, '5067.910')] [2023-12-26 07:07:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000937792_240074752.pth... [2023-12-26 07:07:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000944432_241778688.pth... [2023-12-26 07:07:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000936768_239812608.pth [2023-12-26 07:07:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000943408_241516544.pth [2023-12-26 07:07:53,832][123091] Updated weights for policy 0, policy_version 944433 (0.0009) [2023-12-26 07:07:53,889][123091] Updated weights for policy 0, policy_version 944443 (0.0010) [2023-12-26 07:07:53,946][123091] Updated weights for policy 0, policy_version 944453 (0.0009) [2023-12-26 07:07:54,008][123091] Updated weights for policy 0, policy_version 944464 (0.0010) [2023-12-26 07:07:54,227][123090] Updated weights for policy 1, policy_version 937798 (0.0005) [2023-12-26 07:07:54,274][123090] Updated weights for policy 1, policy_version 937808 (0.0005) [2023-12-26 07:07:54,328][123090] Updated weights for policy 1, policy_version 937818 (0.0005) [2023-12-26 07:07:54,872][123091] Updated weights for policy 0, policy_version 944474 (0.0010) [2023-12-26 07:07:54,930][123091] Updated weights for policy 0, policy_version 944484 (0.0010) [2023-12-26 07:07:54,986][123091] Updated weights for policy 0, policy_version 944494 (0.0009) [2023-12-26 07:07:55,050][123090] Updated weights for policy 1, policy_version 937828 (0.0006) [2023-12-26 07:07:55,109][123090] Updated weights for policy 1, policy_version 937838 (0.0008) [2023-12-26 07:07:55,166][123090] Updated weights for policy 1, policy_version 937848 (0.0009) [2023-12-26 07:07:55,885][123091] Updated weights for policy 0, policy_version 944504 (0.0010) [2023-12-26 07:07:55,905][123090] Updated weights for policy 1, policy_version 937858 (0.0008) [2023-12-26 07:07:55,934][123091] Updated weights for policy 0, policy_version 944514 (0.0008) [2023-12-26 07:07:55,963][123090] Updated weights for policy 1, policy_version 937868 (0.0006) [2023-12-26 07:07:55,985][123091] Updated weights for policy 0, policy_version 944524 (0.0009) [2023-12-26 07:07:56,027][123090] Updated weights for policy 1, policy_version 937878 (0.0005) [2023-12-26 07:07:56,075][123090] Updated weights for policy 1, policy_version 937888 (0.0005) [2023-12-26 07:07:56,726][123091] Updated weights for policy 0, policy_version 944534 (0.0006) [2023-12-26 07:07:56,794][123091] Updated weights for policy 0, policy_version 944544 (0.0007) [2023-12-26 07:07:56,841][123090] Updated weights for policy 1, policy_version 937898 (0.0005) [2023-12-26 07:07:56,843][123091] Updated weights for policy 0, policy_version 944554 (0.0005) [2023-12-26 07:07:56,893][123090] Updated weights for policy 1, policy_version 937908 (0.0008) [2023-12-26 07:07:56,951][123090] Updated weights for policy 1, policy_version 937918 (0.0010) [2023-12-26 07:07:57,480][123091] Updated weights for policy 0, policy_version 944564 (0.0008) [2023-12-26 07:07:57,538][123091] Updated weights for policy 0, policy_version 944574 (0.0010) [2023-12-26 07:07:57,597][123091] Updated weights for policy 0, policy_version 944584 (0.0010) [2023-12-26 07:07:57,727][123090] Updated weights for policy 1, policy_version 937928 (0.0007) [2023-12-26 07:07:57,783][123090] Updated weights for policy 1, policy_version 937938 (0.0005) [2023-12-26 07:07:57,845][123090] Updated weights for policy 1, policy_version 937948 (0.0006) [2023-12-26 07:07:58,468][123091] Updated weights for policy 0, policy_version 944594 (0.0010) [2023-12-26 07:07:58,533][123091] Updated weights for policy 0, policy_version 944604 (0.0010) [2023-12-26 07:07:58,592][123091] Updated weights for policy 0, policy_version 944614 (0.0010) [2023-12-26 07:07:58,615][123090] Updated weights for policy 1, policy_version 937958 (0.0007) [2023-12-26 07:07:58,661][123091] Updated weights for policy 0, policy_version 944624 (0.0006) [2023-12-26 07:07:58,693][123090] Updated weights for policy 1, policy_version 937968 (0.0010) [2023-12-26 07:07:58,762][123090] Updated weights for policy 1, policy_version 937978 (0.0009) [2023-12-26 07:07:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 481943552. Throughput: 0: 8815.5, 1: 8700.4. Samples: 481939456. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:07:58,785][121949] Avg episode reward: [(0, '6127.737'), (1, '5109.104')] [2023-12-26 07:07:59,542][123091] Updated weights for policy 0, policy_version 944634 (0.0007) [2023-12-26 07:07:59,547][123090] Updated weights for policy 1, policy_version 937988 (0.0008) [2023-12-26 07:07:59,601][123091] Updated weights for policy 0, policy_version 944644 (0.0005) [2023-12-26 07:07:59,613][123090] Updated weights for policy 1, policy_version 937998 (0.0005) [2023-12-26 07:07:59,668][123091] Updated weights for policy 0, policy_version 944654 (0.0008) [2023-12-26 07:07:59,679][123090] Updated weights for policy 1, policy_version 938008 (0.0005) [2023-12-26 07:08:00,405][123091] Updated weights for policy 0, policy_version 944664 (0.0007) [2023-12-26 07:08:00,434][123090] Updated weights for policy 1, policy_version 938018 (0.0006) [2023-12-26 07:08:00,466][123091] Updated weights for policy 0, policy_version 944674 (0.0007) [2023-12-26 07:08:00,494][123090] Updated weights for policy 1, policy_version 938028 (0.0010) [2023-12-26 07:08:00,522][123091] Updated weights for policy 0, policy_version 944684 (0.0006) [2023-12-26 07:08:00,541][123090] Updated weights for policy 1, policy_version 938038 (0.0010) [2023-12-26 07:08:00,597][123090] Updated weights for policy 1, policy_version 938048 (0.0010) [2023-12-26 07:08:01,351][123091] Updated weights for policy 0, policy_version 944694 (0.0008) [2023-12-26 07:08:01,355][123090] Updated weights for policy 1, policy_version 938058 (0.0006) [2023-12-26 07:08:01,419][123091] Updated weights for policy 0, policy_version 944704 (0.0010) [2023-12-26 07:08:01,424][123090] Updated weights for policy 1, policy_version 938068 (0.0006) [2023-12-26 07:08:01,491][123091] Updated weights for policy 0, policy_version 944714 (0.0007) [2023-12-26 07:08:01,499][123090] Updated weights for policy 1, policy_version 938078 (0.0005) [2023-12-26 07:08:02,176][123090] Updated weights for policy 1, policy_version 938088 (0.0006) [2023-12-26 07:08:02,189][123091] Updated weights for policy 0, policy_version 944724 (0.0006) [2023-12-26 07:08:02,247][123090] Updated weights for policy 1, policy_version 938098 (0.0010) [2023-12-26 07:08:02,250][123091] Updated weights for policy 0, policy_version 944734 (0.0008) [2023-12-26 07:08:02,310][123091] Updated weights for policy 0, policy_version 944744 (0.0008) [2023-12-26 07:08:02,310][123090] Updated weights for policy 1, policy_version 938108 (0.0011) [2023-12-26 07:08:03,101][123091] Updated weights for policy 0, policy_version 944754 (0.0006) [2023-12-26 07:08:03,121][123090] Updated weights for policy 1, policy_version 938118 (0.0010) [2023-12-26 07:08:03,161][123091] Updated weights for policy 0, policy_version 944764 (0.0008) [2023-12-26 07:08:03,169][123090] Updated weights for policy 1, policy_version 938128 (0.0010) [2023-12-26 07:08:03,223][123090] Updated weights for policy 1, policy_version 938138 (0.0010) [2023-12-26 07:08:03,226][123091] Updated weights for policy 0, policy_version 944774 (0.0009) [2023-12-26 07:08:03,274][123091] Updated weights for policy 0, policy_version 944784 (0.0008) [2023-12-26 07:08:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 482033664. Throughput: 0: 8722.6, 1: 8812.0. Samples: 482046248. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:03,785][121949] Avg episode reward: [(0, '6117.170'), (1, '5191.260')] [2023-12-26 07:08:03,933][123090] Updated weights for policy 1, policy_version 938148 (0.0008) [2023-12-26 07:08:03,988][123090] Updated weights for policy 1, policy_version 938158 (0.0005) [2023-12-26 07:08:04,043][123090] Updated weights for policy 1, policy_version 938168 (0.0006) [2023-12-26 07:08:04,114][123091] Updated weights for policy 0, policy_version 944794 (0.0009) [2023-12-26 07:08:04,180][123091] Updated weights for policy 0, policy_version 944804 (0.0009) [2023-12-26 07:08:04,240][123091] Updated weights for policy 0, policy_version 944814 (0.0009) [2023-12-26 07:08:04,801][123090] Updated weights for policy 1, policy_version 938178 (0.0006) [2023-12-26 07:08:04,872][123090] Updated weights for policy 1, policy_version 938188 (0.0005) [2023-12-26 07:08:04,941][123090] Updated weights for policy 1, policy_version 938198 (0.0005) [2023-12-26 07:08:05,009][123090] Updated weights for policy 1, policy_version 938208 (0.0006) [2023-12-26 07:08:05,133][123091] Updated weights for policy 0, policy_version 944824 (0.0009) [2023-12-26 07:08:05,184][123091] Updated weights for policy 0, policy_version 944834 (0.0008) [2023-12-26 07:08:05,243][123091] Updated weights for policy 0, policy_version 944844 (0.0009) [2023-12-26 07:08:05,719][123090] Updated weights for policy 1, policy_version 938218 (0.0009) [2023-12-26 07:08:05,771][123090] Updated weights for policy 1, policy_version 938229 (0.0009) [2023-12-26 07:08:05,824][123090] Updated weights for policy 1, policy_version 938240 (0.0010) [2023-12-26 07:08:06,080][123091] Updated weights for policy 0, policy_version 944854 (0.0009) [2023-12-26 07:08:06,146][123091] Updated weights for policy 0, policy_version 944864 (0.0010) [2023-12-26 07:08:06,207][123091] Updated weights for policy 0, policy_version 944874 (0.0008) [2023-12-26 07:08:06,666][123090] Updated weights for policy 1, policy_version 938250 (0.0009) [2023-12-26 07:08:06,716][123090] Updated weights for policy 1, policy_version 938260 (0.0009) [2023-12-26 07:08:06,779][123090] Updated weights for policy 1, policy_version 938270 (0.0010) [2023-12-26 07:08:07,128][123091] Updated weights for policy 0, policy_version 944884 (0.0010) [2023-12-26 07:08:07,197][123091] Updated weights for policy 0, policy_version 944894 (0.0009) [2023-12-26 07:08:07,265][123091] Updated weights for policy 0, policy_version 944904 (0.0009) [2023-12-26 07:08:07,644][123090] Updated weights for policy 1, policy_version 938280 (0.0009) [2023-12-26 07:08:07,722][123090] Updated weights for policy 1, policy_version 938290 (0.0008) [2023-12-26 07:08:07,780][123090] Updated weights for policy 1, policy_version 938300 (0.0008) [2023-12-26 07:08:08,085][123091] Updated weights for policy 0, policy_version 944914 (0.0008) [2023-12-26 07:08:08,145][123091] Updated weights for policy 0, policy_version 944924 (0.0006) [2023-12-26 07:08:08,207][123091] Updated weights for policy 0, policy_version 944934 (0.0005) [2023-12-26 07:08:08,258][123091] Updated weights for policy 0, policy_version 944944 (0.0005) [2023-12-26 07:08:08,670][123090] Updated weights for policy 1, policy_version 938310 (0.0009) [2023-12-26 07:08:08,730][123090] Updated weights for policy 1, policy_version 938320 (0.0010) [2023-12-26 07:08:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 482115584. Throughput: 0: 8695.7, 1: 8892.2. Samples: 482098748. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:08,785][121949] Avg episode reward: [(0, '6089.621'), (1, '5200.744')] [2023-12-26 07:08:08,789][123090] Updated weights for policy 1, policy_version 938330 (0.0010) [2023-12-26 07:08:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000944944_241909760.pth... [2023-12-26 07:08:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000943952_241655808.pth [2023-12-26 07:08:08,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000938336_240214016.pth... [2023-12-26 07:08:08,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000937280_239943680.pth [2023-12-26 07:08:08,896][123091] Updated weights for policy 0, policy_version 944954 (0.0006) [2023-12-26 07:08:08,963][123091] Updated weights for policy 0, policy_version 944964 (0.0006) [2023-12-26 07:08:09,027][123091] Updated weights for policy 0, policy_version 944974 (0.0006) [2023-12-26 07:08:09,699][123090] Updated weights for policy 1, policy_version 938340 (0.0009) [2023-12-26 07:08:09,756][123090] Updated weights for policy 1, policy_version 938350 (0.0008) [2023-12-26 07:08:09,774][123091] Updated weights for policy 0, policy_version 944984 (0.0008) [2023-12-26 07:08:09,821][123090] Updated weights for policy 1, policy_version 938360 (0.0010) [2023-12-26 07:08:09,841][123091] Updated weights for policy 0, policy_version 944994 (0.0007) [2023-12-26 07:08:09,915][123091] Updated weights for policy 0, policy_version 945004 (0.0009) [2023-12-26 07:08:10,712][123090] Updated weights for policy 1, policy_version 938370 (0.0007) [2023-12-26 07:08:10,736][123091] Updated weights for policy 0, policy_version 945014 (0.0010) [2023-12-26 07:08:10,774][123090] Updated weights for policy 1, policy_version 938380 (0.0007) [2023-12-26 07:08:10,799][123091] Updated weights for policy 0, policy_version 945024 (0.0009) [2023-12-26 07:08:10,826][123090] Updated weights for policy 1, policy_version 938390 (0.0008) [2023-12-26 07:08:10,851][123091] Updated weights for policy 0, policy_version 945034 (0.0009) [2023-12-26 07:08:10,886][123090] Updated weights for policy 1, policy_version 938400 (0.0007) [2023-12-26 07:08:11,755][123091] Updated weights for policy 0, policy_version 945044 (0.0009) [2023-12-26 07:08:11,816][123090] Updated weights for policy 1, policy_version 938410 (0.0007) [2023-12-26 07:08:11,821][123091] Updated weights for policy 0, policy_version 945054 (0.0008) [2023-12-26 07:08:11,881][123090] Updated weights for policy 1, policy_version 938420 (0.0008) [2023-12-26 07:08:11,890][123091] Updated weights for policy 0, policy_version 945064 (0.0008) [2023-12-26 07:08:11,952][123090] Updated weights for policy 1, policy_version 938430 (0.0010) [2023-12-26 07:08:12,709][123091] Updated weights for policy 0, policy_version 945074 (0.0007) [2023-12-26 07:08:12,767][123091] Updated weights for policy 0, policy_version 945084 (0.0009) [2023-12-26 07:08:12,801][123090] Updated weights for policy 1, policy_version 938440 (0.0007) [2023-12-26 07:08:12,825][123091] Updated weights for policy 0, policy_version 945094 (0.0009) [2023-12-26 07:08:12,865][123090] Updated weights for policy 1, policy_version 938450 (0.0008) [2023-12-26 07:08:12,895][123091] Updated weights for policy 0, policy_version 945104 (0.0009) [2023-12-26 07:08:12,921][123090] Updated weights for policy 1, policy_version 938460 (0.0010) [2023-12-26 07:08:13,571][123091] Updated weights for policy 0, policy_version 945114 (0.0005) [2023-12-26 07:08:13,618][123091] Updated weights for policy 0, policy_version 945124 (0.0005) [2023-12-26 07:08:13,663][123091] Updated weights for policy 0, policy_version 945134 (0.0005) [2023-12-26 07:08:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 482205696. Throughput: 0: 8720.1, 1: 8844.5. Samples: 482199988. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:13,785][121949] Avg episode reward: [(0, '6098.841'), (1, '5222.145')] [2023-12-26 07:08:13,832][123090] Updated weights for policy 1, policy_version 938470 (0.0010) [2023-12-26 07:08:13,887][123090] Updated weights for policy 1, policy_version 938481 (0.0010) [2023-12-26 07:08:13,942][123090] Updated weights for policy 1, policy_version 938491 (0.0009) [2023-12-26 07:08:14,416][123091] Updated weights for policy 0, policy_version 945144 (0.0005) [2023-12-26 07:08:14,482][123091] Updated weights for policy 0, policy_version 945154 (0.0007) [2023-12-26 07:08:14,541][123091] Updated weights for policy 0, policy_version 945164 (0.0009) [2023-12-26 07:08:14,711][123090] Updated weights for policy 1, policy_version 938501 (0.0008) [2023-12-26 07:08:14,771][123090] Updated weights for policy 1, policy_version 938511 (0.0006) [2023-12-26 07:08:14,838][123090] Updated weights for policy 1, policy_version 938521 (0.0010) [2023-12-26 07:08:15,228][123091] Updated weights for policy 0, policy_version 945174 (0.0006) [2023-12-26 07:08:15,293][123091] Updated weights for policy 0, policy_version 945184 (0.0005) [2023-12-26 07:08:15,360][123091] Updated weights for policy 0, policy_version 945194 (0.0006) [2023-12-26 07:08:15,595][123090] Updated weights for policy 1, policy_version 938531 (0.0009) [2023-12-26 07:08:15,642][123090] Updated weights for policy 1, policy_version 938541 (0.0005) [2023-12-26 07:08:15,688][123090] Updated weights for policy 1, policy_version 938551 (0.0005) [2023-12-26 07:08:16,029][123091] Updated weights for policy 0, policy_version 945204 (0.0007) [2023-12-26 07:08:16,083][123091] Updated weights for policy 0, policy_version 945214 (0.0009) [2023-12-26 07:08:16,137][123091] Updated weights for policy 0, policy_version 945224 (0.0009) [2023-12-26 07:08:16,512][123090] Updated weights for policy 1, policy_version 938562 (0.0008) [2023-12-26 07:08:16,568][123090] Updated weights for policy 1, policy_version 938572 (0.0010) [2023-12-26 07:08:16,618][123090] Updated weights for policy 1, policy_version 938582 (0.0010) [2023-12-26 07:08:16,983][123091] Updated weights for policy 0, policy_version 945235 (0.0010) [2023-12-26 07:08:17,043][123091] Updated weights for policy 0, policy_version 945245 (0.0010) [2023-12-26 07:08:17,101][123091] Updated weights for policy 0, policy_version 945255 (0.0009) [2023-12-26 07:08:17,445][123090] Updated weights for policy 1, policy_version 938593 (0.0009) [2023-12-26 07:08:17,493][123090] Updated weights for policy 1, policy_version 938603 (0.0005) [2023-12-26 07:08:17,539][123090] Updated weights for policy 1, policy_version 938613 (0.0005) [2023-12-26 07:08:17,598][123090] Updated weights for policy 1, policy_version 938623 (0.0005) [2023-12-26 07:08:17,896][123091] Updated weights for policy 0, policy_version 945265 (0.0009) [2023-12-26 07:08:17,952][123091] Updated weights for policy 0, policy_version 945275 (0.0009) [2023-12-26 07:08:18,001][123091] Updated weights for policy 0, policy_version 945285 (0.0009) [2023-12-26 07:08:18,054][123091] Updated weights for policy 0, policy_version 945295 (0.0011) [2023-12-26 07:08:18,291][123090] Updated weights for policy 1, policy_version 938633 (0.0005) [2023-12-26 07:08:18,368][123090] Updated weights for policy 1, policy_version 938643 (0.0009) [2023-12-26 07:08:18,425][123090] Updated weights for policy 1, policy_version 938653 (0.0009) [2023-12-26 07:08:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 482295808. Throughput: 0: 8824.6, 1: 8740.5. Samples: 482308776. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:18,785][121949] Avg episode reward: [(0, '6074.853'), (1, '5380.038')] [2023-12-26 07:08:18,874][123091] Updated weights for policy 0, policy_version 945305 (0.0006) [2023-12-26 07:08:18,946][123091] Updated weights for policy 0, policy_version 945315 (0.0005) [2023-12-26 07:08:19,000][123091] Updated weights for policy 0, policy_version 945325 (0.0005) [2023-12-26 07:08:19,192][123090] Updated weights for policy 1, policy_version 938663 (0.0009) [2023-12-26 07:08:19,255][123090] Updated weights for policy 1, policy_version 938673 (0.0009) [2023-12-26 07:08:19,314][123090] Updated weights for policy 1, policy_version 938683 (0.0009) [2023-12-26 07:08:19,752][123091] Updated weights for policy 0, policy_version 945335 (0.0009) [2023-12-26 07:08:19,807][123091] Updated weights for policy 0, policy_version 945345 (0.0011) [2023-12-26 07:08:19,879][123091] Updated weights for policy 0, policy_version 945355 (0.0010) [2023-12-26 07:08:20,103][123090] Updated weights for policy 1, policy_version 938693 (0.0008) [2023-12-26 07:08:20,162][123090] Updated weights for policy 1, policy_version 938703 (0.0009) [2023-12-26 07:08:20,228][123090] Updated weights for policy 1, policy_version 938713 (0.0009) [2023-12-26 07:08:20,710][123091] Updated weights for policy 0, policy_version 945365 (0.0011) [2023-12-26 07:08:20,767][123091] Updated weights for policy 0, policy_version 945375 (0.0011) [2023-12-26 07:08:20,839][123091] Updated weights for policy 0, policy_version 945385 (0.0011) [2023-12-26 07:08:21,093][123090] Updated weights for policy 1, policy_version 938723 (0.0009) [2023-12-26 07:08:21,160][123090] Updated weights for policy 1, policy_version 938733 (0.0009) [2023-12-26 07:08:21,229][123090] Updated weights for policy 1, policy_version 938743 (0.0009) [2023-12-26 07:08:21,696][123091] Updated weights for policy 0, policy_version 945395 (0.0010) [2023-12-26 07:08:21,764][123091] Updated weights for policy 0, policy_version 945405 (0.0006) [2023-12-26 07:08:21,840][123091] Updated weights for policy 0, policy_version 945415 (0.0006) [2023-12-26 07:08:22,130][123090] Updated weights for policy 1, policy_version 938753 (0.0009) [2023-12-26 07:08:22,195][123090] Updated weights for policy 1, policy_version 938763 (0.0010) [2023-12-26 07:08:22,252][123090] Updated weights for policy 1, policy_version 938773 (0.0010) [2023-12-26 07:08:22,318][123090] Updated weights for policy 1, policy_version 938783 (0.0013) [2023-12-26 07:08:22,548][123091] Updated weights for policy 0, policy_version 945425 (0.0006) [2023-12-26 07:08:22,624][123091] Updated weights for policy 0, policy_version 945435 (0.0005) [2023-12-26 07:08:22,684][123091] Updated weights for policy 0, policy_version 945445 (0.0008) [2023-12-26 07:08:22,737][123091] Updated weights for policy 0, policy_version 945455 (0.0010) [2023-12-26 07:08:23,260][123090] Updated weights for policy 1, policy_version 938793 (0.0009) [2023-12-26 07:08:23,324][123090] Updated weights for policy 1, policy_version 938803 (0.0010) [2023-12-26 07:08:23,399][123090] Updated weights for policy 1, policy_version 938813 (0.0008) [2023-12-26 07:08:23,543][123091] Updated weights for policy 0, policy_version 945465 (0.0006) [2023-12-26 07:08:23,599][123091] Updated weights for policy 0, policy_version 945475 (0.0005) [2023-12-26 07:08:23,652][123091] Updated weights for policy 0, policy_version 945485 (0.0007) [2023-12-26 07:08:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 482385920. Throughput: 0: 8748.0, 1: 8740.9. Samples: 482360484. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:23,786][121949] Avg episode reward: [(0, '6045.322'), (1, '5555.111')] [2023-12-26 07:08:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000945488_242049024.pth... [2023-12-26 07:08:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000938816_240336896.pth... [2023-12-26 07:08:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000937792_240074752.pth [2023-12-26 07:08:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000944432_241778688.pth [2023-12-26 07:08:24,182][123090] Updated weights for policy 1, policy_version 938823 (0.0009) [2023-12-26 07:08:24,243][123090] Updated weights for policy 1, policy_version 938833 (0.0009) [2023-12-26 07:08:24,311][123090] Updated weights for policy 1, policy_version 938843 (0.0007) [2023-12-26 07:08:24,442][123091] Updated weights for policy 0, policy_version 945495 (0.0006) [2023-12-26 07:08:24,497][123091] Updated weights for policy 0, policy_version 945505 (0.0005) [2023-12-26 07:08:24,552][123091] Updated weights for policy 0, policy_version 945515 (0.0010) [2023-12-26 07:08:25,164][123090] Updated weights for policy 1, policy_version 938853 (0.0007) [2023-12-26 07:08:25,225][123090] Updated weights for policy 1, policy_version 938863 (0.0008) [2023-12-26 07:08:25,277][123090] Updated weights for policy 1, policy_version 938873 (0.0009) [2023-12-26 07:08:25,288][123091] Updated weights for policy 0, policy_version 945525 (0.0010) [2023-12-26 07:08:25,344][123091] Updated weights for policy 0, policy_version 945535 (0.0009) [2023-12-26 07:08:25,400][123091] Updated weights for policy 0, policy_version 945545 (0.0009) [2023-12-26 07:08:26,123][123090] Updated weights for policy 1, policy_version 938883 (0.0008) [2023-12-26 07:08:26,180][123090] Updated weights for policy 1, policy_version 938893 (0.0009) [2023-12-26 07:08:26,226][123091] Updated weights for policy 0, policy_version 945555 (0.0009) [2023-12-26 07:08:26,240][123090] Updated weights for policy 1, policy_version 938903 (0.0009) [2023-12-26 07:08:26,287][123091] Updated weights for policy 0, policy_version 945565 (0.0007) [2023-12-26 07:08:26,358][123091] Updated weights for policy 0, policy_version 945575 (0.0010) [2023-12-26 07:08:27,025][123091] Updated weights for policy 0, policy_version 945585 (0.0009) [2023-12-26 07:08:27,088][123091] Updated weights for policy 0, policy_version 945595 (0.0005) [2023-12-26 07:08:27,148][123091] Updated weights for policy 0, policy_version 945605 (0.0009) [2023-12-26 07:08:27,150][123090] Updated weights for policy 1, policy_version 938913 (0.0008) [2023-12-26 07:08:27,199][123091] Updated weights for policy 0, policy_version 945616 (0.0007) [2023-12-26 07:08:27,211][123090] Updated weights for policy 1, policy_version 938923 (0.0009) [2023-12-26 07:08:27,266][123090] Updated weights for policy 1, policy_version 938933 (0.0009) [2023-12-26 07:08:27,335][123090] Updated weights for policy 1, policy_version 938943 (0.0009) [2023-12-26 07:08:28,027][123091] Updated weights for policy 0, policy_version 945626 (0.0011) [2023-12-26 07:08:28,081][123091] Updated weights for policy 0, policy_version 945636 (0.0010) [2023-12-26 07:08:28,135][123090] Updated weights for policy 1, policy_version 938953 (0.0008) [2023-12-26 07:08:28,140][123091] Updated weights for policy 0, policy_version 945646 (0.0009) [2023-12-26 07:08:28,214][123090] Updated weights for policy 1, policy_version 938963 (0.0010) [2023-12-26 07:08:28,286][123090] Updated weights for policy 1, policy_version 938973 (0.0010) [2023-12-26 07:08:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 482467840. Throughput: 0: 8837.3, 1: 8721.7. Samples: 482464708. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:28,784][121949] Avg episode reward: [(0, '6090.466'), (1, '5281.672')] [2023-12-26 07:08:28,897][123091] Updated weights for policy 0, policy_version 945656 (0.0010) [2023-12-26 07:08:28,954][123091] Updated weights for policy 0, policy_version 945666 (0.0009) [2023-12-26 07:08:29,021][123091] Updated weights for policy 0, policy_version 945676 (0.0005) [2023-12-26 07:08:29,129][123090] Updated weights for policy 1, policy_version 938983 (0.0010) [2023-12-26 07:08:29,184][123090] Updated weights for policy 1, policy_version 938993 (0.0011) [2023-12-26 07:08:29,248][123090] Updated weights for policy 1, policy_version 939004 (0.0010) [2023-12-26 07:08:29,712][123091] Updated weights for policy 0, policy_version 945686 (0.0005) [2023-12-26 07:08:29,775][123091] Updated weights for policy 0, policy_version 945696 (0.0005) [2023-12-26 07:08:29,845][123091] Updated weights for policy 0, policy_version 945706 (0.0007) [2023-12-26 07:08:30,156][123090] Updated weights for policy 1, policy_version 939014 (0.0009) [2023-12-26 07:08:30,230][123090] Updated weights for policy 1, policy_version 939024 (0.0009) [2023-12-26 07:08:30,299][123090] Updated weights for policy 1, policy_version 939034 (0.0009) [2023-12-26 07:08:30,495][123091] Updated weights for policy 0, policy_version 945716 (0.0006) [2023-12-26 07:08:30,558][123091] Updated weights for policy 0, policy_version 945726 (0.0006) [2023-12-26 07:08:30,621][123091] Updated weights for policy 0, policy_version 945736 (0.0005) [2023-12-26 07:08:31,172][123090] Updated weights for policy 1, policy_version 939044 (0.0009) [2023-12-26 07:08:31,235][123090] Updated weights for policy 1, policy_version 939054 (0.0009) [2023-12-26 07:08:31,236][123091] Updated weights for policy 0, policy_version 945746 (0.0008) [2023-12-26 07:08:31,297][123090] Updated weights for policy 1, policy_version 939064 (0.0009) [2023-12-26 07:08:31,298][123091] Updated weights for policy 0, policy_version 945756 (0.0007) [2023-12-26 07:08:31,359][123091] Updated weights for policy 0, policy_version 945766 (0.0007) [2023-12-26 07:08:31,428][123091] Updated weights for policy 0, policy_version 945776 (0.0007) [2023-12-26 07:08:32,110][123090] Updated weights for policy 1, policy_version 939074 (0.0008) [2023-12-26 07:08:32,177][123090] Updated weights for policy 1, policy_version 939084 (0.0008) [2023-12-26 07:08:32,206][123091] Updated weights for policy 0, policy_version 945786 (0.0009) [2023-12-26 07:08:32,244][123090] Updated weights for policy 1, policy_version 939094 (0.0008) [2023-12-26 07:08:32,273][123091] Updated weights for policy 0, policy_version 945796 (0.0009) [2023-12-26 07:08:32,312][123090] Updated weights for policy 1, policy_version 939104 (0.0006) [2023-12-26 07:08:32,334][123091] Updated weights for policy 0, policy_version 945806 (0.0006) [2023-12-26 07:08:33,094][123091] Updated weights for policy 0, policy_version 945816 (0.0009) [2023-12-26 07:08:33,113][123090] Updated weights for policy 1, policy_version 939114 (0.0006) [2023-12-26 07:08:33,148][123091] Updated weights for policy 0, policy_version 945826 (0.0008) [2023-12-26 07:08:33,172][123090] Updated weights for policy 1, policy_version 939124 (0.0007) [2023-12-26 07:08:33,192][123091] Updated weights for policy 0, policy_version 945836 (0.0009) [2023-12-26 07:08:33,217][123090] Updated weights for policy 1, policy_version 939134 (0.0006) [2023-12-26 07:08:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 482557952. Throughput: 0: 8893.9, 1: 8693.5. Samples: 482571732. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:33,784][121949] Avg episode reward: [(0, '6225.131'), (1, '5020.787')] [2023-12-26 07:08:34,032][123090] Updated weights for policy 1, policy_version 939144 (0.0009) [2023-12-26 07:08:34,033][123091] Updated weights for policy 0, policy_version 945846 (0.0008) [2023-12-26 07:08:34,079][123091] Updated weights for policy 0, policy_version 945856 (0.0008) [2023-12-26 07:08:34,089][123090] Updated weights for policy 1, policy_version 939154 (0.0007) [2023-12-26 07:08:34,128][123091] Updated weights for policy 0, policy_version 945866 (0.0008) [2023-12-26 07:08:34,151][123090] Updated weights for policy 1, policy_version 939164 (0.0007) [2023-12-26 07:08:34,921][123091] Updated weights for policy 0, policy_version 945876 (0.0009) [2023-12-26 07:08:34,978][123091] Updated weights for policy 0, policy_version 945886 (0.0010) [2023-12-26 07:08:35,025][123090] Updated weights for policy 1, policy_version 939174 (0.0009) [2023-12-26 07:08:35,032][123091] Updated weights for policy 0, policy_version 945896 (0.0009) [2023-12-26 07:08:35,088][123090] Updated weights for policy 1, policy_version 939184 (0.0009) [2023-12-26 07:08:35,142][123090] Updated weights for policy 1, policy_version 939194 (0.0010) [2023-12-26 07:08:35,814][123090] Updated weights for policy 1, policy_version 939204 (0.0007) [2023-12-26 07:08:35,876][123090] Updated weights for policy 1, policy_version 939214 (0.0007) [2023-12-26 07:08:35,895][123091] Updated weights for policy 0, policy_version 945906 (0.0007) [2023-12-26 07:08:35,931][123090] Updated weights for policy 1, policy_version 939224 (0.0010) [2023-12-26 07:08:35,947][123091] Updated weights for policy 0, policy_version 945916 (0.0006) [2023-12-26 07:08:36,008][123091] Updated weights for policy 0, policy_version 945926 (0.0008) [2023-12-26 07:08:36,078][123091] Updated weights for policy 0, policy_version 945936 (0.0010) [2023-12-26 07:08:36,757][123090] Updated weights for policy 1, policy_version 939234 (0.0011) [2023-12-26 07:08:36,821][123090] Updated weights for policy 1, policy_version 939244 (0.0011) [2023-12-26 07:08:36,887][123090] Updated weights for policy 1, policy_version 939254 (0.0011) [2023-12-26 07:08:36,942][123091] Updated weights for policy 0, policy_version 945946 (0.0011) [2023-12-26 07:08:36,944][123090] Updated weights for policy 1, policy_version 939264 (0.0011) [2023-12-26 07:08:37,012][123091] Updated weights for policy 0, policy_version 945956 (0.0011) [2023-12-26 07:08:37,084][123091] Updated weights for policy 0, policy_version 945966 (0.0011) [2023-12-26 07:08:37,774][123090] Updated weights for policy 1, policy_version 939274 (0.0006) [2023-12-26 07:08:37,804][123091] Updated weights for policy 0, policy_version 945976 (0.0010) [2023-12-26 07:08:37,834][123090] Updated weights for policy 1, policy_version 939284 (0.0006) [2023-12-26 07:08:37,861][123091] Updated weights for policy 0, policy_version 945986 (0.0008) [2023-12-26 07:08:37,883][123090] Updated weights for policy 1, policy_version 939294 (0.0010) [2023-12-26 07:08:37,913][123091] Updated weights for policy 0, policy_version 945996 (0.0005) [2023-12-26 07:08:38,705][123091] Updated weights for policy 0, policy_version 946006 (0.0006) [2023-12-26 07:08:38,732][123090] Updated weights for policy 1, policy_version 939304 (0.0011) [2023-12-26 07:08:38,770][123091] Updated weights for policy 0, policy_version 946016 (0.0006) [2023-12-26 07:08:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 482639872. Throughput: 0: 8911.6, 1: 8683.5. Samples: 482623704. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:38,785][121949] Avg episode reward: [(0, '6015.934'), (1, '5069.124')] [2023-12-26 07:08:38,802][123090] Updated weights for policy 1, policy_version 939314 (0.0009) [2023-12-26 07:08:38,821][123091] Updated weights for policy 0, policy_version 946026 (0.0010) [2023-12-26 07:08:38,856][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000946032_242188288.pth... [2023-12-26 07:08:38,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000944944_241909760.pth [2023-12-26 07:08:38,865][123090] Updated weights for policy 1, policy_version 939324 (0.0009) [2023-12-26 07:08:38,887][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000939328_240467968.pth... [2023-12-26 07:08:38,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000938336_240214016.pth [2023-12-26 07:08:39,678][123091] Updated weights for policy 0, policy_version 946036 (0.0009) [2023-12-26 07:08:39,695][123090] Updated weights for policy 1, policy_version 939334 (0.0010) [2023-12-26 07:08:39,734][123091] Updated weights for policy 0, policy_version 946046 (0.0007) [2023-12-26 07:08:39,760][123090] Updated weights for policy 1, policy_version 939344 (0.0011) [2023-12-26 07:08:39,798][123091] Updated weights for policy 0, policy_version 946056 (0.0006) [2023-12-26 07:08:39,827][123090] Updated weights for policy 1, policy_version 939354 (0.0011) [2023-12-26 07:08:40,545][123091] Updated weights for policy 0, policy_version 946066 (0.0007) [2023-12-26 07:08:40,609][123091] Updated weights for policy 0, policy_version 946076 (0.0006) [2023-12-26 07:08:40,654][123090] Updated weights for policy 1, policy_version 939364 (0.0011) [2023-12-26 07:08:40,672][123091] Updated weights for policy 0, policy_version 946086 (0.0005) [2023-12-26 07:08:40,718][123090] Updated weights for policy 1, policy_version 939374 (0.0011) [2023-12-26 07:08:40,737][123091] Updated weights for policy 0, policy_version 946096 (0.0006) [2023-12-26 07:08:40,773][123090] Updated weights for policy 1, policy_version 939384 (0.0010) [2023-12-26 07:08:41,553][123091] Updated weights for policy 0, policy_version 946106 (0.0008) [2023-12-26 07:08:41,582][123090] Updated weights for policy 1, policy_version 939394 (0.0011) [2023-12-26 07:08:41,623][123091] Updated weights for policy 0, policy_version 946116 (0.0007) [2023-12-26 07:08:41,652][123090] Updated weights for policy 1, policy_version 939404 (0.0007) [2023-12-26 07:08:41,690][123091] Updated weights for policy 0, policy_version 946126 (0.0009) [2023-12-26 07:08:41,721][123090] Updated weights for policy 1, policy_version 939414 (0.0009) [2023-12-26 07:08:41,795][123090] Updated weights for policy 1, policy_version 939424 (0.0010) [2023-12-26 07:08:42,532][123090] Updated weights for policy 1, policy_version 939434 (0.0009) [2023-12-26 07:08:42,554][123091] Updated weights for policy 0, policy_version 946136 (0.0008) [2023-12-26 07:08:42,592][123090] Updated weights for policy 1, policy_version 939444 (0.0006) [2023-12-26 07:08:42,614][123091] Updated weights for policy 0, policy_version 946146 (0.0008) [2023-12-26 07:08:42,647][123090] Updated weights for policy 1, policy_version 939454 (0.0007) [2023-12-26 07:08:42,675][123091] Updated weights for policy 0, policy_version 946156 (0.0009) [2023-12-26 07:08:43,441][123090] Updated weights for policy 1, policy_version 939464 (0.0005) [2023-12-26 07:08:43,491][123090] Updated weights for policy 1, policy_version 939474 (0.0005) [2023-12-26 07:08:43,549][123090] Updated weights for policy 1, policy_version 939484 (0.0006) [2023-12-26 07:08:43,563][123091] Updated weights for policy 0, policy_version 946166 (0.0008) [2023-12-26 07:08:43,623][123091] Updated weights for policy 0, policy_version 946176 (0.0010) [2023-12-26 07:08:43,684][123091] Updated weights for policy 0, policy_version 946186 (0.0010) [2023-12-26 07:08:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 482738176. Throughput: 0: 8919.2, 1: 8576.3. Samples: 482726752. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:43,784][121949] Avg episode reward: [(0, '6010.476'), (1, '4983.146')] [2023-12-26 07:08:44,217][123090] Updated weights for policy 1, policy_version 939494 (0.0005) [2023-12-26 07:08:44,268][123090] Updated weights for policy 1, policy_version 939504 (0.0005) [2023-12-26 07:08:44,321][123090] Updated weights for policy 1, policy_version 939514 (0.0005) [2023-12-26 07:08:44,593][123091] Updated weights for policy 0, policy_version 946197 (0.0009) [2023-12-26 07:08:44,645][123091] Updated weights for policy 0, policy_version 946207 (0.0009) [2023-12-26 07:08:44,706][123091] Updated weights for policy 0, policy_version 946217 (0.0009) [2023-12-26 07:08:45,077][123090] Updated weights for policy 1, policy_version 939524 (0.0007) [2023-12-26 07:08:45,128][123090] Updated weights for policy 1, policy_version 939534 (0.0009) [2023-12-26 07:08:45,178][123090] Updated weights for policy 1, policy_version 939544 (0.0008) [2023-12-26 07:08:45,560][123091] Updated weights for policy 0, policy_version 946227 (0.0009) [2023-12-26 07:08:45,622][123091] Updated weights for policy 0, policy_version 946237 (0.0009) [2023-12-26 07:08:45,680][123091] Updated weights for policy 0, policy_version 946247 (0.0010) [2023-12-26 07:08:46,020][123090] Updated weights for policy 1, policy_version 939554 (0.0009) [2023-12-26 07:08:46,070][123090] Updated weights for policy 1, policy_version 939564 (0.0009) [2023-12-26 07:08:46,119][123090] Updated weights for policy 1, policy_version 939575 (0.0009) [2023-12-26 07:08:46,512][123091] Updated weights for policy 0, policy_version 946257 (0.0010) [2023-12-26 07:08:46,568][123091] Updated weights for policy 0, policy_version 946267 (0.0010) [2023-12-26 07:08:46,632][123091] Updated weights for policy 0, policy_version 946277 (0.0010) [2023-12-26 07:08:46,700][123091] Updated weights for policy 0, policy_version 946287 (0.0009) [2023-12-26 07:08:46,988][123090] Updated weights for policy 1, policy_version 939585 (0.0009) [2023-12-26 07:08:47,056][123090] Updated weights for policy 1, policy_version 939595 (0.0008) [2023-12-26 07:08:47,120][123090] Updated weights for policy 1, policy_version 939605 (0.0009) [2023-12-26 07:08:47,176][123090] Updated weights for policy 1, policy_version 939615 (0.0010) [2023-12-26 07:08:47,496][123091] Updated weights for policy 0, policy_version 946297 (0.0009) [2023-12-26 07:08:47,545][123091] Updated weights for policy 0, policy_version 946307 (0.0009) [2023-12-26 07:08:47,594][123091] Updated weights for policy 0, policy_version 946317 (0.0009) [2023-12-26 07:08:47,998][123090] Updated weights for policy 1, policy_version 939625 (0.0008) [2023-12-26 07:08:48,061][123090] Updated weights for policy 1, policy_version 939635 (0.0010) [2023-12-26 07:08:48,124][123090] Updated weights for policy 1, policy_version 939645 (0.0006) [2023-12-26 07:08:48,460][123091] Updated weights for policy 0, policy_version 946328 (0.0009) [2023-12-26 07:08:48,512][123091] Updated weights for policy 0, policy_version 946338 (0.0010) [2023-12-26 07:08:48,565][123091] Updated weights for policy 0, policy_version 946348 (0.0010) [2023-12-26 07:08:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 482820096. Throughput: 0: 8863.2, 1: 8565.6. Samples: 482830544. Policy #0 lag: (min: 10.0, avg: 23.4, max: 42.0) [2023-12-26 07:08:48,785][121949] Avg episode reward: [(0, '6071.768'), (1, '5065.865')] [2023-12-26 07:08:48,861][123090] Updated weights for policy 1, policy_version 939655 (0.0008) [2023-12-26 07:08:48,922][123090] Updated weights for policy 1, policy_version 939665 (0.0008) [2023-12-26 07:08:48,983][123090] Updated weights for policy 1, policy_version 939675 (0.0009) [2023-12-26 07:08:49,445][123091] Updated weights for policy 0, policy_version 946358 (0.0010) [2023-12-26 07:08:49,518][123091] Updated weights for policy 0, policy_version 946368 (0.0010) [2023-12-26 07:08:49,583][123091] Updated weights for policy 0, policy_version 946378 (0.0009) [2023-12-26 07:08:49,851][123090] Updated weights for policy 1, policy_version 939685 (0.0009) [2023-12-26 07:08:49,912][123090] Updated weights for policy 1, policy_version 939696 (0.0010) [2023-12-26 07:08:49,968][123090] Updated weights for policy 1, policy_version 939706 (0.0009) [2023-12-26 07:08:50,420][123091] Updated weights for policy 0, policy_version 946388 (0.0009) [2023-12-26 07:08:50,470][123091] Updated weights for policy 0, policy_version 946398 (0.0010) [2023-12-26 07:08:50,521][123091] Updated weights for policy 0, policy_version 946408 (0.0009) [2023-12-26 07:08:50,844][123090] Updated weights for policy 1, policy_version 939716 (0.0009) [2023-12-26 07:08:50,907][123090] Updated weights for policy 1, policy_version 939726 (0.0008) [2023-12-26 07:08:50,966][123090] Updated weights for policy 1, policy_version 939736 (0.0009) [2023-12-26 07:08:51,367][123091] Updated weights for policy 0, policy_version 946418 (0.0009) [2023-12-26 07:08:51,423][123091] Updated weights for policy 0, policy_version 946428 (0.0009) [2023-12-26 07:08:51,485][123091] Updated weights for policy 0, policy_version 946438 (0.0009) [2023-12-26 07:08:51,543][123091] Updated weights for policy 0, policy_version 946448 (0.0011) [2023-12-26 07:08:51,850][123090] Updated weights for policy 1, policy_version 939746 (0.0009) [2023-12-26 07:08:51,915][123090] Updated weights for policy 1, policy_version 939756 (0.0009) [2023-12-26 07:08:51,982][123090] Updated weights for policy 1, policy_version 939766 (0.0007) [2023-12-26 07:08:52,047][123090] Updated weights for policy 1, policy_version 939776 (0.0009) [2023-12-26 07:08:52,400][123091] Updated weights for policy 0, policy_version 946458 (0.0011) [2023-12-26 07:08:52,453][123091] Updated weights for policy 0, policy_version 946468 (0.0011) [2023-12-26 07:08:52,505][123091] Updated weights for policy 0, policy_version 946478 (0.0011) [2023-12-26 07:08:52,863][123090] Updated weights for policy 1, policy_version 939786 (0.0009) [2023-12-26 07:08:52,920][123090] Updated weights for policy 1, policy_version 939796 (0.0009) [2023-12-26 07:08:52,973][123090] Updated weights for policy 1, policy_version 939806 (0.0009) [2023-12-26 07:08:53,330][123091] Updated weights for policy 0, policy_version 946488 (0.0010) [2023-12-26 07:08:53,377][123091] Updated weights for policy 0, policy_version 946498 (0.0010) [2023-12-26 07:08:53,428][123091] Updated weights for policy 0, policy_version 946508 (0.0010) [2023-12-26 07:08:53,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 482902016. Throughput: 0: 8879.3, 1: 8503.1. Samples: 482880952. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:08:53,785][121949] Avg episode reward: [(0, '6186.159'), (1, '5189.851')] [2023-12-26 07:08:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000946512_242311168.pth... [2023-12-26 07:08:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000945488_242049024.pth [2023-12-26 07:08:53,804][123090] Updated weights for policy 1, policy_version 939816 (0.0009) [2023-12-26 07:08:53,876][123090] Updated weights for policy 1, policy_version 939826 (0.0009) [2023-12-26 07:08:53,941][123090] Updated weights for policy 1, policy_version 939836 (0.0009) [2023-12-26 07:08:53,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000939840_240599040.pth... [2023-12-26 07:08:53,978][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000938816_240336896.pth [2023-12-26 07:08:54,292][123091] Updated weights for policy 0, policy_version 946518 (0.0010) [2023-12-26 07:08:54,363][123091] Updated weights for policy 0, policy_version 946528 (0.0011) [2023-12-26 07:08:54,427][123091] Updated weights for policy 0, policy_version 946538 (0.0011) [2023-12-26 07:08:54,760][123090] Updated weights for policy 1, policy_version 939846 (0.0009) [2023-12-26 07:08:54,809][123090] Updated weights for policy 1, policy_version 939856 (0.0009) [2023-12-26 07:08:54,861][123090] Updated weights for policy 1, policy_version 939866 (0.0009) [2023-12-26 07:08:55,241][123091] Updated weights for policy 0, policy_version 946548 (0.0010) [2023-12-26 07:08:55,296][123091] Updated weights for policy 0, policy_version 946558 (0.0010) [2023-12-26 07:08:55,345][123091] Updated weights for policy 0, policy_version 946568 (0.0011) [2023-12-26 07:08:55,721][123090] Updated weights for policy 1, policy_version 939876 (0.0009) [2023-12-26 07:08:55,784][123090] Updated weights for policy 1, policy_version 939886 (0.0009) [2023-12-26 07:08:55,852][123090] Updated weights for policy 1, policy_version 939896 (0.0009) [2023-12-26 07:08:56,132][123091] Updated weights for policy 0, policy_version 946578 (0.0009) [2023-12-26 07:08:56,186][123091] Updated weights for policy 0, policy_version 946588 (0.0009) [2023-12-26 07:08:56,237][123091] Updated weights for policy 0, policy_version 946599 (0.0009) [2023-12-26 07:08:56,701][123090] Updated weights for policy 1, policy_version 939906 (0.0009) [2023-12-26 07:08:56,758][123090] Updated weights for policy 1, policy_version 939916 (0.0006) [2023-12-26 07:08:56,804][123090] Updated weights for policy 1, policy_version 939926 (0.0005) [2023-12-26 07:08:56,856][123090] Updated weights for policy 1, policy_version 939936 (0.0005) [2023-12-26 07:08:57,093][123091] Updated weights for policy 0, policy_version 946609 (0.0009) [2023-12-26 07:08:57,158][123091] Updated weights for policy 0, policy_version 946619 (0.0005) [2023-12-26 07:08:57,221][123091] Updated weights for policy 0, policy_version 946629 (0.0005) [2023-12-26 07:08:57,292][123091] Updated weights for policy 0, policy_version 946639 (0.0005) [2023-12-26 07:08:57,625][123090] Updated weights for policy 1, policy_version 939946 (0.0005) [2023-12-26 07:08:57,677][123090] Updated weights for policy 1, policy_version 939956 (0.0005) [2023-12-26 07:08:57,740][123090] Updated weights for policy 1, policy_version 939966 (0.0006) [2023-12-26 07:08:58,103][123091] Updated weights for policy 0, policy_version 946649 (0.0008) [2023-12-26 07:08:58,166][123091] Updated weights for policy 0, policy_version 946659 (0.0010) [2023-12-26 07:08:58,231][123091] Updated weights for policy 0, policy_version 946669 (0.0010) [2023-12-26 07:08:58,467][123090] Updated weights for policy 1, policy_version 939976 (0.0006) [2023-12-26 07:08:58,540][123090] Updated weights for policy 1, policy_version 939986 (0.0006) [2023-12-26 07:08:58,609][123090] Updated weights for policy 1, policy_version 939996 (0.0006) [2023-12-26 07:08:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 482992128. Throughput: 0: 8862.0, 1: 8593.3. Samples: 482985472. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:08:58,785][121949] Avg episode reward: [(0, '6092.016'), (1, '5442.611')] [2023-12-26 07:08:59,243][123091] Updated weights for policy 0, policy_version 946679 (0.0009) [2023-12-26 07:08:59,307][123091] Updated weights for policy 0, policy_version 946689 (0.0008) [2023-12-26 07:08:59,377][123091] Updated weights for policy 0, policy_version 946699 (0.0008) [2023-12-26 07:08:59,397][123090] Updated weights for policy 1, policy_version 940006 (0.0007) [2023-12-26 07:08:59,460][123090] Updated weights for policy 1, policy_version 940016 (0.0005) [2023-12-26 07:08:59,528][123090] Updated weights for policy 1, policy_version 940026 (0.0005) [2023-12-26 07:09:00,107][123091] Updated weights for policy 0, policy_version 946709 (0.0008) [2023-12-26 07:09:00,162][123091] Updated weights for policy 0, policy_version 946719 (0.0008) [2023-12-26 07:09:00,219][123091] Updated weights for policy 0, policy_version 946729 (0.0007) [2023-12-26 07:09:00,236][123090] Updated weights for policy 1, policy_version 940036 (0.0007) [2023-12-26 07:09:00,301][123090] Updated weights for policy 1, policy_version 940046 (0.0010) [2023-12-26 07:09:00,363][123090] Updated weights for policy 1, policy_version 940056 (0.0008) [2023-12-26 07:09:00,990][123090] Updated weights for policy 1, policy_version 940066 (0.0006) [2023-12-26 07:09:01,061][123090] Updated weights for policy 1, policy_version 940076 (0.0006) [2023-12-26 07:09:01,094][123091] Updated weights for policy 0, policy_version 946739 (0.0007) [2023-12-26 07:09:01,132][123090] Updated weights for policy 1, policy_version 940086 (0.0009) [2023-12-26 07:09:01,170][123091] Updated weights for policy 0, policy_version 946749 (0.0007) [2023-12-26 07:09:01,202][123090] Updated weights for policy 1, policy_version 940096 (0.0009) [2023-12-26 07:09:01,245][123091] Updated weights for policy 0, policy_version 946759 (0.0006) [2023-12-26 07:09:01,968][123091] Updated weights for policy 0, policy_version 946769 (0.0008) [2023-12-26 07:09:01,971][123090] Updated weights for policy 1, policy_version 940106 (0.0008) [2023-12-26 07:09:02,029][123091] Updated weights for policy 0, policy_version 946779 (0.0006) [2023-12-26 07:09:02,035][123090] Updated weights for policy 1, policy_version 940116 (0.0008) [2023-12-26 07:09:02,088][123090] Updated weights for policy 1, policy_version 940126 (0.0009) [2023-12-26 07:09:02,091][123091] Updated weights for policy 0, policy_version 946789 (0.0005) [2023-12-26 07:09:02,149][123091] Updated weights for policy 0, policy_version 946799 (0.0008) [2023-12-26 07:09:02,838][123091] Updated weights for policy 0, policy_version 946809 (0.0009) [2023-12-26 07:09:02,893][123091] Updated weights for policy 0, policy_version 946819 (0.0009) [2023-12-26 07:09:02,957][123091] Updated weights for policy 0, policy_version 946829 (0.0009) [2023-12-26 07:09:02,981][123090] Updated weights for policy 1, policy_version 940136 (0.0007) [2023-12-26 07:09:03,032][123090] Updated weights for policy 1, policy_version 940146 (0.0009) [2023-12-26 07:09:03,084][123090] Updated weights for policy 1, policy_version 940156 (0.0009) [2023-12-26 07:09:03,748][123091] Updated weights for policy 0, policy_version 946839 (0.0009) [2023-12-26 07:09:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 483074048. Throughput: 0: 8774.4, 1: 8608.7. Samples: 483091016. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:03,785][121949] Avg episode reward: [(0, '6049.932'), (1, '5449.998')] [2023-12-26 07:09:03,803][123091] Updated weights for policy 0, policy_version 946851 (0.0011) [2023-12-26 07:09:03,857][123090] Updated weights for policy 1, policy_version 940166 (0.0009) [2023-12-26 07:09:03,873][123091] Updated weights for policy 0, policy_version 946861 (0.0009) [2023-12-26 07:09:03,920][123090] Updated weights for policy 1, policy_version 940176 (0.0007) [2023-12-26 07:09:03,992][123090] Updated weights for policy 1, policy_version 940186 (0.0010) [2023-12-26 07:09:04,574][123091] Updated weights for policy 0, policy_version 946871 (0.0006) [2023-12-26 07:09:04,630][123091] Updated weights for policy 0, policy_version 946881 (0.0006) [2023-12-26 07:09:04,672][123090] Updated weights for policy 1, policy_version 940196 (0.0007) [2023-12-26 07:09:04,685][123091] Updated weights for policy 0, policy_version 946891 (0.0006) [2023-12-26 07:09:04,743][123090] Updated weights for policy 1, policy_version 940206 (0.0010) [2023-12-26 07:09:04,819][123090] Updated weights for policy 1, policy_version 940216 (0.0009) [2023-12-26 07:09:05,346][123091] Updated weights for policy 0, policy_version 946901 (0.0008) [2023-12-26 07:09:05,397][123091] Updated weights for policy 0, policy_version 946911 (0.0011) [2023-12-26 07:09:05,445][123091] Updated weights for policy 0, policy_version 946921 (0.0008) [2023-12-26 07:09:05,678][123090] Updated weights for policy 1, policy_version 940226 (0.0009) [2023-12-26 07:09:05,740][123090] Updated weights for policy 1, policy_version 940236 (0.0009) [2023-12-26 07:09:05,796][123090] Updated weights for policy 1, policy_version 940246 (0.0009) [2023-12-26 07:09:05,846][123090] Updated weights for policy 1, policy_version 940256 (0.0009) [2023-12-26 07:09:06,165][123091] Updated weights for policy 0, policy_version 946931 (0.0007) [2023-12-26 07:09:06,238][123091] Updated weights for policy 0, policy_version 946941 (0.0005) [2023-12-26 07:09:06,313][123091] Updated weights for policy 0, policy_version 946951 (0.0006) [2023-12-26 07:09:06,758][123090] Updated weights for policy 1, policy_version 940266 (0.0009) [2023-12-26 07:09:06,811][123090] Updated weights for policy 1, policy_version 940276 (0.0008) [2023-12-26 07:09:06,872][123090] Updated weights for policy 1, policy_version 940286 (0.0006) [2023-12-26 07:09:07,122][123091] Updated weights for policy 0, policy_version 946961 (0.0010) [2023-12-26 07:09:07,176][123091] Updated weights for policy 0, policy_version 946971 (0.0008) [2023-12-26 07:09:07,230][123091] Updated weights for policy 0, policy_version 946981 (0.0008) [2023-12-26 07:09:07,292][123091] Updated weights for policy 0, policy_version 946991 (0.0008) [2023-12-26 07:09:07,717][123090] Updated weights for policy 1, policy_version 940296 (0.0010) [2023-12-26 07:09:07,791][123090] Updated weights for policy 1, policy_version 940306 (0.0010) [2023-12-26 07:09:07,858][123090] Updated weights for policy 1, policy_version 940316 (0.0010) [2023-12-26 07:09:08,097][123091] Updated weights for policy 0, policy_version 947001 (0.0010) [2023-12-26 07:09:08,160][123091] Updated weights for policy 0, policy_version 947011 (0.0010) [2023-12-26 07:09:08,210][123091] Updated weights for policy 0, policy_version 947021 (0.0009) [2023-12-26 07:09:08,710][123090] Updated weights for policy 1, policy_version 940326 (0.0010) [2023-12-26 07:09:08,777][123090] Updated weights for policy 1, policy_version 940336 (0.0010) [2023-12-26 07:09:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 483164160. Throughput: 0: 8838.5, 1: 8629.1. Samples: 483146524. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:08,785][121949] Avg episode reward: [(0, '5858.830'), (1, '5257.967')] [2023-12-26 07:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000947024_242442240.pth... [2023-12-26 07:09:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000946032_242188288.pth [2023-12-26 07:09:08,839][123090] Updated weights for policy 1, policy_version 940346 (0.0009) [2023-12-26 07:09:08,876][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000940352_240730112.pth... [2023-12-26 07:09:08,880][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000939328_240467968.pth [2023-12-26 07:09:09,017][123091] Updated weights for policy 0, policy_version 947031 (0.0009) [2023-12-26 07:09:09,075][123091] Updated weights for policy 0, policy_version 947041 (0.0010) [2023-12-26 07:09:09,135][123091] Updated weights for policy 0, policy_version 947051 (0.0009) [2023-12-26 07:09:09,609][123090] Updated weights for policy 1, policy_version 940356 (0.0009) [2023-12-26 07:09:09,664][123090] Updated weights for policy 1, policy_version 940366 (0.0009) [2023-12-26 07:09:09,728][123090] Updated weights for policy 1, policy_version 940376 (0.0007) [2023-12-26 07:09:10,020][123091] Updated weights for policy 0, policy_version 947061 (0.0010) [2023-12-26 07:09:10,085][123091] Updated weights for policy 0, policy_version 947071 (0.0011) [2023-12-26 07:09:10,160][123091] Updated weights for policy 0, policy_version 947081 (0.0011) [2023-12-26 07:09:10,540][123090] Updated weights for policy 1, policy_version 940386 (0.0009) [2023-12-26 07:09:10,589][123090] Updated weights for policy 1, policy_version 940396 (0.0010) [2023-12-26 07:09:10,637][123090] Updated weights for policy 1, policy_version 940406 (0.0010) [2023-12-26 07:09:10,689][123090] Updated weights for policy 1, policy_version 940416 (0.0010) [2023-12-26 07:09:10,971][123091] Updated weights for policy 0, policy_version 947091 (0.0011) [2023-12-26 07:09:11,048][123091] Updated weights for policy 0, policy_version 947101 (0.0010) [2023-12-26 07:09:11,110][123091] Updated weights for policy 0, policy_version 947111 (0.0011) [2023-12-26 07:09:11,558][123090] Updated weights for policy 1, policy_version 940426 (0.0008) [2023-12-26 07:09:11,625][123090] Updated weights for policy 1, policy_version 940436 (0.0009) [2023-12-26 07:09:11,690][123090] Updated weights for policy 1, policy_version 940446 (0.0010) [2023-12-26 07:09:11,967][123091] Updated weights for policy 0, policy_version 947121 (0.0010) [2023-12-26 07:09:12,016][123091] Updated weights for policy 0, policy_version 947131 (0.0009) [2023-12-26 07:09:12,074][123091] Updated weights for policy 0, policy_version 947141 (0.0009) [2023-12-26 07:09:12,127][123091] Updated weights for policy 0, policy_version 947151 (0.0009) [2023-12-26 07:09:12,552][123090] Updated weights for policy 1, policy_version 940456 (0.0011) [2023-12-26 07:09:12,601][123090] Updated weights for policy 1, policy_version 940466 (0.0010) [2023-12-26 07:09:12,656][123090] Updated weights for policy 1, policy_version 940476 (0.0010) [2023-12-26 07:09:12,994][123091] Updated weights for policy 0, policy_version 947161 (0.0009) [2023-12-26 07:09:13,046][123091] Updated weights for policy 0, policy_version 947171 (0.0009) [2023-12-26 07:09:13,095][123091] Updated weights for policy 0, policy_version 947181 (0.0009) [2023-12-26 07:09:13,503][123090] Updated weights for policy 1, policy_version 940486 (0.0011) [2023-12-26 07:09:13,558][123090] Updated weights for policy 1, policy_version 940496 (0.0010) [2023-12-26 07:09:13,613][123090] Updated weights for policy 1, policy_version 940507 (0.0010) [2023-12-26 07:09:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 483254272. Throughput: 0: 8731.9, 1: 8663.7. Samples: 483247512. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:13,785][121949] Avg episode reward: [(0, '5973.759'), (1, '5205.933')] [2023-12-26 07:09:13,941][123091] Updated weights for policy 0, policy_version 947191 (0.0007) [2023-12-26 07:09:14,015][123091] Updated weights for policy 0, policy_version 947201 (0.0005) [2023-12-26 07:09:14,088][123091] Updated weights for policy 0, policy_version 947211 (0.0005) [2023-12-26 07:09:14,464][123090] Updated weights for policy 1, policy_version 940517 (0.0010) [2023-12-26 07:09:14,517][123090] Updated weights for policy 1, policy_version 940527 (0.0009) [2023-12-26 07:09:14,574][123090] Updated weights for policy 1, policy_version 940537 (0.0009) [2023-12-26 07:09:14,809][123091] Updated weights for policy 0, policy_version 947221 (0.0008) [2023-12-26 07:09:14,878][123091] Updated weights for policy 0, policy_version 947231 (0.0010) [2023-12-26 07:09:14,946][123091] Updated weights for policy 0, policy_version 947241 (0.0010) [2023-12-26 07:09:15,468][123090] Updated weights for policy 1, policy_version 940547 (0.0010) [2023-12-26 07:09:15,537][123090] Updated weights for policy 1, policy_version 940557 (0.0009) [2023-12-26 07:09:15,603][123090] Updated weights for policy 1, policy_version 940567 (0.0009) [2023-12-26 07:09:15,620][123091] Updated weights for policy 0, policy_version 947251 (0.0010) [2023-12-26 07:09:15,680][123091] Updated weights for policy 0, policy_version 947261 (0.0009) [2023-12-26 07:09:15,728][123091] Updated weights for policy 0, policy_version 947271 (0.0010) [2023-12-26 07:09:16,412][123090] Updated weights for policy 1, policy_version 940577 (0.0007) [2023-12-26 07:09:16,466][123090] Updated weights for policy 1, policy_version 940587 (0.0005) [2023-12-26 07:09:16,537][123090] Updated weights for policy 1, policy_version 940597 (0.0008) [2023-12-26 07:09:16,551][123091] Updated weights for policy 0, policy_version 947281 (0.0010) [2023-12-26 07:09:16,600][123090] Updated weights for policy 1, policy_version 940607 (0.0010) [2023-12-26 07:09:16,604][123091] Updated weights for policy 0, policy_version 947291 (0.0011) [2023-12-26 07:09:16,663][123091] Updated weights for policy 0, policy_version 947301 (0.0011) [2023-12-26 07:09:16,730][123091] Updated weights for policy 0, policy_version 947311 (0.0009) [2023-12-26 07:09:17,269][123090] Updated weights for policy 1, policy_version 940617 (0.0010) [2023-12-26 07:09:17,332][123090] Updated weights for policy 1, policy_version 940627 (0.0010) [2023-12-26 07:09:17,385][123090] Updated weights for policy 1, policy_version 940637 (0.0010) [2023-12-26 07:09:17,480][123091] Updated weights for policy 0, policy_version 947321 (0.0010) [2023-12-26 07:09:17,536][123091] Updated weights for policy 0, policy_version 947331 (0.0010) [2023-12-26 07:09:17,599][123091] Updated weights for policy 0, policy_version 947341 (0.0011) [2023-12-26 07:09:18,237][123090] Updated weights for policy 1, policy_version 940647 (0.0009) [2023-12-26 07:09:18,285][123090] Updated weights for policy 1, policy_version 940657 (0.0009) [2023-12-26 07:09:18,355][123090] Updated weights for policy 1, policy_version 940667 (0.0009) [2023-12-26 07:09:18,413][123091] Updated weights for policy 0, policy_version 947351 (0.0007) [2023-12-26 07:09:18,462][123091] Updated weights for policy 0, policy_version 947361 (0.0006) [2023-12-26 07:09:18,532][123091] Updated weights for policy 0, policy_version 947371 (0.0006) [2023-12-26 07:09:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 483344384. Throughput: 0: 8686.4, 1: 8681.9. Samples: 483353308. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:18,785][121949] Avg episode reward: [(0, '6040.409'), (1, '5264.651')] [2023-12-26 07:09:19,239][123090] Updated weights for policy 1, policy_version 940677 (0.0009) [2023-12-26 07:09:19,302][123090] Updated weights for policy 1, policy_version 940687 (0.0010) [2023-12-26 07:09:19,320][123091] Updated weights for policy 0, policy_version 947381 (0.0007) [2023-12-26 07:09:19,372][123090] Updated weights for policy 1, policy_version 940697 (0.0009) [2023-12-26 07:09:19,391][123091] Updated weights for policy 0, policy_version 947391 (0.0009) [2023-12-26 07:09:19,455][123091] Updated weights for policy 0, policy_version 947402 (0.0010) [2023-12-26 07:09:20,221][123090] Updated weights for policy 1, policy_version 940707 (0.0008) [2023-12-26 07:09:20,282][123090] Updated weights for policy 1, policy_version 940717 (0.0010) [2023-12-26 07:09:20,309][123091] Updated weights for policy 0, policy_version 947412 (0.0010) [2023-12-26 07:09:20,337][123090] Updated weights for policy 1, policy_version 940727 (0.0009) [2023-12-26 07:09:20,361][123091] Updated weights for policy 0, policy_version 947422 (0.0008) [2023-12-26 07:09:20,416][123091] Updated weights for policy 0, policy_version 947432 (0.0006) [2023-12-26 07:09:21,184][123090] Updated weights for policy 1, policy_version 940737 (0.0008) [2023-12-26 07:09:21,241][123090] Updated weights for policy 1, policy_version 940747 (0.0009) [2023-12-26 07:09:21,252][123091] Updated weights for policy 0, policy_version 947442 (0.0009) [2023-12-26 07:09:21,300][123090] Updated weights for policy 1, policy_version 940757 (0.0007) [2023-12-26 07:09:21,315][123091] Updated weights for policy 0, policy_version 947452 (0.0009) [2023-12-26 07:09:21,360][123090] Updated weights for policy 1, policy_version 940767 (0.0008) [2023-12-26 07:09:21,383][123091] Updated weights for policy 0, policy_version 947462 (0.0009) [2023-12-26 07:09:21,438][123091] Updated weights for policy 0, policy_version 947472 (0.0010) [2023-12-26 07:09:22,191][123090] Updated weights for policy 1, policy_version 940777 (0.0009) [2023-12-26 07:09:22,255][123090] Updated weights for policy 1, policy_version 940787 (0.0009) [2023-12-26 07:09:22,321][123090] Updated weights for policy 1, policy_version 940797 (0.0008) [2023-12-26 07:09:22,326][123091] Updated weights for policy 0, policy_version 947482 (0.0009) [2023-12-26 07:09:22,394][123091] Updated weights for policy 0, policy_version 947492 (0.0010) [2023-12-26 07:09:22,459][123091] Updated weights for policy 0, policy_version 947502 (0.0009) [2023-12-26 07:09:23,162][123090] Updated weights for policy 1, policy_version 940807 (0.0009) [2023-12-26 07:09:23,225][123090] Updated weights for policy 1, policy_version 940817 (0.0009) [2023-12-26 07:09:23,286][123090] Updated weights for policy 1, policy_version 940827 (0.0007) [2023-12-26 07:09:23,297][123091] Updated weights for policy 0, policy_version 947512 (0.0010) [2023-12-26 07:09:23,350][123091] Updated weights for policy 0, policy_version 947522 (0.0010) [2023-12-26 07:09:23,419][123091] Updated weights for policy 0, policy_version 947532 (0.0008) [2023-12-26 07:09:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 483426304. Throughput: 0: 8672.9, 1: 8651.1. Samples: 483403284. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:23,785][121949] Avg episode reward: [(0, '6099.049'), (1, '5512.201')] [2023-12-26 07:09:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000947536_242573312.pth... [2023-12-26 07:09:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000940832_240852992.pth... [2023-12-26 07:09:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000939840_240599040.pth [2023-12-26 07:09:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000946512_242311168.pth [2023-12-26 07:09:24,012][123090] Updated weights for policy 1, policy_version 940837 (0.0007) [2023-12-26 07:09:24,079][123090] Updated weights for policy 1, policy_version 940847 (0.0009) [2023-12-26 07:09:24,134][123090] Updated weights for policy 1, policy_version 940857 (0.0009) [2023-12-26 07:09:24,243][123091] Updated weights for policy 0, policy_version 947542 (0.0009) [2023-12-26 07:09:24,314][123091] Updated weights for policy 0, policy_version 947552 (0.0011) [2023-12-26 07:09:24,381][123091] Updated weights for policy 0, policy_version 947562 (0.0011) [2023-12-26 07:09:24,992][123090] Updated weights for policy 1, policy_version 940867 (0.0009) [2023-12-26 07:09:25,057][123090] Updated weights for policy 1, policy_version 940877 (0.0010) [2023-12-26 07:09:25,117][123091] Updated weights for policy 0, policy_version 947572 (0.0007) [2023-12-26 07:09:25,118][123090] Updated weights for policy 1, policy_version 940887 (0.0007) [2023-12-26 07:09:25,184][123091] Updated weights for policy 0, policy_version 947582 (0.0011) [2023-12-26 07:09:25,251][123091] Updated weights for policy 0, policy_version 947592 (0.0011) [2023-12-26 07:09:25,927][123091] Updated weights for policy 0, policy_version 947602 (0.0009) [2023-12-26 07:09:25,985][123091] Updated weights for policy 0, policy_version 947612 (0.0005) [2023-12-26 07:09:26,023][123090] Updated weights for policy 1, policy_version 940897 (0.0008) [2023-12-26 07:09:26,045][123091] Updated weights for policy 0, policy_version 947622 (0.0005) [2023-12-26 07:09:26,080][123090] Updated weights for policy 1, policy_version 940907 (0.0009) [2023-12-26 07:09:26,098][123091] Updated weights for policy 0, policy_version 947632 (0.0005) [2023-12-26 07:09:26,154][123090] Updated weights for policy 1, policy_version 940917 (0.0010) [2023-12-26 07:09:26,210][123090] Updated weights for policy 1, policy_version 940927 (0.0010) [2023-12-26 07:09:26,797][123091] Updated weights for policy 0, policy_version 947642 (0.0006) [2023-12-26 07:09:26,851][123091] Updated weights for policy 0, policy_version 947652 (0.0005) [2023-12-26 07:09:26,910][123091] Updated weights for policy 0, policy_version 947662 (0.0005) [2023-12-26 07:09:27,120][123090] Updated weights for policy 1, policy_version 940937 (0.0006) [2023-12-26 07:09:27,179][123090] Updated weights for policy 1, policy_version 940947 (0.0005) [2023-12-26 07:09:27,242][123090] Updated weights for policy 1, policy_version 940957 (0.0008) [2023-12-26 07:09:27,649][123091] Updated weights for policy 0, policy_version 947672 (0.0005) [2023-12-26 07:09:27,723][123091] Updated weights for policy 0, policy_version 947682 (0.0006) [2023-12-26 07:09:27,781][123091] Updated weights for policy 0, policy_version 947692 (0.0009) [2023-12-26 07:09:28,095][123090] Updated weights for policy 1, policy_version 940967 (0.0009) [2023-12-26 07:09:28,146][123090] Updated weights for policy 1, policy_version 940977 (0.0008) [2023-12-26 07:09:28,206][123090] Updated weights for policy 1, policy_version 940987 (0.0009) [2023-12-26 07:09:28,459][123091] Updated weights for policy 0, policy_version 947702 (0.0008) [2023-12-26 07:09:28,506][123091] Updated weights for policy 0, policy_version 947712 (0.0010) [2023-12-26 07:09:28,579][123091] Updated weights for policy 0, policy_version 947722 (0.0011) [2023-12-26 07:09:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 483516416. Throughput: 0: 8744.7, 1: 8632.5. Samples: 483508728. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:28,785][121949] Avg episode reward: [(0, '6016.496'), (1, '5562.855')] [2023-12-26 07:09:29,063][123090] Updated weights for policy 1, policy_version 940997 (0.0009) [2023-12-26 07:09:29,115][123090] Updated weights for policy 1, policy_version 941007 (0.0009) [2023-12-26 07:09:29,162][123090] Updated weights for policy 1, policy_version 941017 (0.0009) [2023-12-26 07:09:29,404][123091] Updated weights for policy 0, policy_version 947732 (0.0011) [2023-12-26 07:09:29,466][123091] Updated weights for policy 0, policy_version 947742 (0.0010) [2023-12-26 07:09:29,513][123091] Updated weights for policy 0, policy_version 947752 (0.0010) [2023-12-26 07:09:30,061][123090] Updated weights for policy 1, policy_version 941027 (0.0007) [2023-12-26 07:09:30,131][123090] Updated weights for policy 1, policy_version 941037 (0.0006) [2023-12-26 07:09:30,178][123090] Updated weights for policy 1, policy_version 941047 (0.0005) [2023-12-26 07:09:30,316][123091] Updated weights for policy 0, policy_version 947762 (0.0010) [2023-12-26 07:09:30,371][123091] Updated weights for policy 0, policy_version 947772 (0.0011) [2023-12-26 07:09:30,438][123091] Updated weights for policy 0, policy_version 947782 (0.0011) [2023-12-26 07:09:30,503][123091] Updated weights for policy 0, policy_version 947792 (0.0011) [2023-12-26 07:09:30,957][123090] Updated weights for policy 1, policy_version 941057 (0.0007) [2023-12-26 07:09:31,034][123090] Updated weights for policy 1, policy_version 941067 (0.0009) [2023-12-26 07:09:31,097][123090] Updated weights for policy 1, policy_version 941077 (0.0008) [2023-12-26 07:09:31,164][123090] Updated weights for policy 1, policy_version 941087 (0.0009) [2023-12-26 07:09:31,306][123091] Updated weights for policy 0, policy_version 947802 (0.0008) [2023-12-26 07:09:31,379][123091] Updated weights for policy 0, policy_version 947812 (0.0010) [2023-12-26 07:09:31,441][123091] Updated weights for policy 0, policy_version 947822 (0.0009) [2023-12-26 07:09:31,980][123090] Updated weights for policy 1, policy_version 941097 (0.0009) [2023-12-26 07:09:32,041][123090] Updated weights for policy 1, policy_version 941107 (0.0009) [2023-12-26 07:09:32,109][123090] Updated weights for policy 1, policy_version 941117 (0.0010) [2023-12-26 07:09:32,309][123091] Updated weights for policy 0, policy_version 947832 (0.0010) [2023-12-26 07:09:32,375][123091] Updated weights for policy 0, policy_version 947842 (0.0010) [2023-12-26 07:09:32,432][123091] Updated weights for policy 0, policy_version 947852 (0.0010) [2023-12-26 07:09:32,943][123090] Updated weights for policy 1, policy_version 941127 (0.0009) [2023-12-26 07:09:32,998][123090] Updated weights for policy 1, policy_version 941137 (0.0009) [2023-12-26 07:09:33,048][123090] Updated weights for policy 1, policy_version 941147 (0.0009) [2023-12-26 07:09:33,155][123091] Updated weights for policy 0, policy_version 947862 (0.0010) [2023-12-26 07:09:33,203][123091] Updated weights for policy 0, policy_version 947872 (0.0008) [2023-12-26 07:09:33,252][123091] Updated weights for policy 0, policy_version 947882 (0.0009) [2023-12-26 07:09:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 483598336. Throughput: 0: 8806.5, 1: 8556.2. Samples: 483611864. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:33,784][121949] Avg episode reward: [(0, '5923.304'), (1, '5286.286')] [2023-12-26 07:09:33,884][123090] Updated weights for policy 1, policy_version 941157 (0.0010) [2023-12-26 07:09:33,960][123090] Updated weights for policy 1, policy_version 941167 (0.0010) [2023-12-26 07:09:34,017][123090] Updated weights for policy 1, policy_version 941177 (0.0010) [2023-12-26 07:09:34,047][123091] Updated weights for policy 0, policy_version 947892 (0.0007) [2023-12-26 07:09:34,109][123091] Updated weights for policy 0, policy_version 947902 (0.0006) [2023-12-26 07:09:34,174][123091] Updated weights for policy 0, policy_version 947912 (0.0009) [2023-12-26 07:09:34,891][123090] Updated weights for policy 1, policy_version 941187 (0.0009) [2023-12-26 07:09:34,926][123091] Updated weights for policy 0, policy_version 947922 (0.0008) [2023-12-26 07:09:34,953][123090] Updated weights for policy 1, policy_version 941197 (0.0008) [2023-12-26 07:09:34,978][123091] Updated weights for policy 0, policy_version 947932 (0.0006) [2023-12-26 07:09:35,015][123090] Updated weights for policy 1, policy_version 941207 (0.0009) [2023-12-26 07:09:35,046][123091] Updated weights for policy 0, policy_version 947942 (0.0005) [2023-12-26 07:09:35,115][123091] Updated weights for policy 0, policy_version 947952 (0.0005) [2023-12-26 07:09:35,738][123091] Updated weights for policy 0, policy_version 947962 (0.0005) [2023-12-26 07:09:35,793][123091] Updated weights for policy 0, policy_version 947972 (0.0009) [2023-12-26 07:09:35,857][123091] Updated weights for policy 0, policy_version 947982 (0.0009) [2023-12-26 07:09:35,907][123090] Updated weights for policy 1, policy_version 941217 (0.0009) [2023-12-26 07:09:35,958][123090] Updated weights for policy 1, policy_version 941227 (0.0008) [2023-12-26 07:09:36,021][123090] Updated weights for policy 1, policy_version 941237 (0.0009) [2023-12-26 07:09:36,073][123090] Updated weights for policy 1, policy_version 941247 (0.0008) [2023-12-26 07:09:36,572][123091] Updated weights for policy 0, policy_version 947992 (0.0011) [2023-12-26 07:09:36,629][123091] Updated weights for policy 0, policy_version 948002 (0.0010) [2023-12-26 07:09:36,688][123091] Updated weights for policy 0, policy_version 948012 (0.0010) [2023-12-26 07:09:36,984][123090] Updated weights for policy 1, policy_version 941257 (0.0009) [2023-12-26 07:09:37,047][123090] Updated weights for policy 1, policy_version 941267 (0.0009) [2023-12-26 07:09:37,113][123090] Updated weights for policy 1, policy_version 941277 (0.0010) [2023-12-26 07:09:37,437][123091] Updated weights for policy 0, policy_version 948022 (0.0010) [2023-12-26 07:09:37,503][123091] Updated weights for policy 0, policy_version 948032 (0.0010) [2023-12-26 07:09:37,565][123091] Updated weights for policy 0, policy_version 948042 (0.0006) [2023-12-26 07:09:38,015][123090] Updated weights for policy 1, policy_version 941287 (0.0010) [2023-12-26 07:09:38,078][123090] Updated weights for policy 1, policy_version 941297 (0.0010) [2023-12-26 07:09:38,133][123090] Updated weights for policy 1, policy_version 941307 (0.0010) [2023-12-26 07:09:38,287][123091] Updated weights for policy 0, policy_version 948052 (0.0007) [2023-12-26 07:09:38,361][123091] Updated weights for policy 0, policy_version 948062 (0.0009) [2023-12-26 07:09:38,420][123091] Updated weights for policy 0, policy_version 948072 (0.0009) [2023-12-26 07:09:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 483688448. Throughput: 0: 8890.9, 1: 8538.1. Samples: 483665260. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:38,785][121949] Avg episode reward: [(0, '6076.214'), (1, '5282.129')] [2023-12-26 07:09:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000948080_242712576.pth... [2023-12-26 07:09:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000941312_240975872.pth... [2023-12-26 07:09:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000947024_242442240.pth [2023-12-26 07:09:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000940352_240730112.pth [2023-12-26 07:09:39,028][123090] Updated weights for policy 1, policy_version 941317 (0.0009) [2023-12-26 07:09:39,089][123090] Updated weights for policy 1, policy_version 941327 (0.0009) [2023-12-26 07:09:39,147][123090] Updated weights for policy 1, policy_version 941337 (0.0008) [2023-12-26 07:09:39,259][123091] Updated weights for policy 0, policy_version 948082 (0.0010) [2023-12-26 07:09:39,315][123091] Updated weights for policy 0, policy_version 948092 (0.0010) [2023-12-26 07:09:39,384][123091] Updated weights for policy 0, policy_version 948102 (0.0009) [2023-12-26 07:09:39,453][123091] Updated weights for policy 0, policy_version 948112 (0.0009) [2023-12-26 07:09:39,990][123090] Updated weights for policy 1, policy_version 941347 (0.0007) [2023-12-26 07:09:40,052][123090] Updated weights for policy 1, policy_version 941357 (0.0009) [2023-12-26 07:09:40,117][123090] Updated weights for policy 1, policy_version 941367 (0.0009) [2023-12-26 07:09:40,303][123091] Updated weights for policy 0, policy_version 948122 (0.0011) [2023-12-26 07:09:40,364][123091] Updated weights for policy 0, policy_version 948132 (0.0009) [2023-12-26 07:09:40,418][123091] Updated weights for policy 0, policy_version 948142 (0.0010) [2023-12-26 07:09:40,923][123090] Updated weights for policy 1, policy_version 941377 (0.0009) [2023-12-26 07:09:40,987][123090] Updated weights for policy 1, policy_version 941387 (0.0010) [2023-12-26 07:09:41,055][123090] Updated weights for policy 1, policy_version 941397 (0.0010) [2023-12-26 07:09:41,118][123090] Updated weights for policy 1, policy_version 941407 (0.0009) [2023-12-26 07:09:41,337][123091] Updated weights for policy 0, policy_version 948152 (0.0009) [2023-12-26 07:09:41,406][123091] Updated weights for policy 0, policy_version 948162 (0.0008) [2023-12-26 07:09:41,463][123091] Updated weights for policy 0, policy_version 948172 (0.0010) [2023-12-26 07:09:41,984][123090] Updated weights for policy 1, policy_version 941417 (0.0009) [2023-12-26 07:09:42,044][123090] Updated weights for policy 1, policy_version 941427 (0.0009) [2023-12-26 07:09:42,104][123090] Updated weights for policy 1, policy_version 941437 (0.0009) [2023-12-26 07:09:42,302][123091] Updated weights for policy 0, policy_version 948182 (0.0010) [2023-12-26 07:09:42,362][123091] Updated weights for policy 0, policy_version 948192 (0.0010) [2023-12-26 07:09:42,417][123091] Updated weights for policy 0, policy_version 948202 (0.0010) [2023-12-26 07:09:42,972][123090] Updated weights for policy 1, policy_version 941447 (0.0009) [2023-12-26 07:09:43,045][123090] Updated weights for policy 1, policy_version 941457 (0.0010) [2023-12-26 07:09:43,106][123090] Updated weights for policy 1, policy_version 941467 (0.0009) [2023-12-26 07:09:43,258][123091] Updated weights for policy 0, policy_version 948212 (0.0010) [2023-12-26 07:09:43,313][123091] Updated weights for policy 0, policy_version 948223 (0.0008) [2023-12-26 07:09:43,372][123091] Updated weights for policy 0, policy_version 948233 (0.0009) [2023-12-26 07:09:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17550.3). Total num frames: 483770368. Throughput: 0: 8862.7, 1: 8474.8. Samples: 483765660. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:43,785][121949] Avg episode reward: [(0, '6220.801'), (1, '5262.929')] [2023-12-26 07:09:43,953][123090] Updated weights for policy 1, policy_version 941477 (0.0009) [2023-12-26 07:09:44,029][123090] Updated weights for policy 1, policy_version 941487 (0.0010) [2023-12-26 07:09:44,105][123090] Updated weights for policy 1, policy_version 941497 (0.0010) [2023-12-26 07:09:44,134][123091] Updated weights for policy 0, policy_version 948243 (0.0008) [2023-12-26 07:09:44,186][123091] Updated weights for policy 0, policy_version 948253 (0.0005) [2023-12-26 07:09:44,235][123091] Updated weights for policy 0, policy_version 948263 (0.0005) [2023-12-26 07:09:44,879][123090] Updated weights for policy 1, policy_version 941507 (0.0009) [2023-12-26 07:09:44,933][123091] Updated weights for policy 0, policy_version 948273 (0.0005) [2023-12-26 07:09:44,950][123090] Updated weights for policy 1, policy_version 941517 (0.0009) [2023-12-26 07:09:44,990][123091] Updated weights for policy 0, policy_version 948283 (0.0008) [2023-12-26 07:09:45,015][123090] Updated weights for policy 1, policy_version 941527 (0.0006) [2023-12-26 07:09:45,054][123091] Updated weights for policy 0, policy_version 948293 (0.0009) [2023-12-26 07:09:45,111][123091] Updated weights for policy 0, policy_version 948303 (0.0010) [2023-12-26 07:09:45,852][123090] Updated weights for policy 1, policy_version 941537 (0.0007) [2023-12-26 07:09:45,912][123090] Updated weights for policy 1, policy_version 941547 (0.0008) [2023-12-26 07:09:45,951][123091] Updated weights for policy 0, policy_version 948313 (0.0010) [2023-12-26 07:09:45,976][123090] Updated weights for policy 1, policy_version 941557 (0.0007) [2023-12-26 07:09:45,999][123091] Updated weights for policy 0, policy_version 948323 (0.0010) [2023-12-26 07:09:46,032][123090] Updated weights for policy 1, policy_version 941567 (0.0005) [2023-12-26 07:09:46,047][123091] Updated weights for policy 0, policy_version 948333 (0.0010) [2023-12-26 07:09:46,746][123091] Updated weights for policy 0, policy_version 948343 (0.0007) [2023-12-26 07:09:46,807][123091] Updated weights for policy 0, policy_version 948353 (0.0006) [2023-12-26 07:09:46,868][123091] Updated weights for policy 0, policy_version 948363 (0.0005) [2023-12-26 07:09:46,934][123090] Updated weights for policy 1, policy_version 941577 (0.0009) [2023-12-26 07:09:46,997][123090] Updated weights for policy 1, policy_version 941587 (0.0010) [2023-12-26 07:09:47,053][123090] Updated weights for policy 1, policy_version 941597 (0.0010) [2023-12-26 07:09:47,536][123091] Updated weights for policy 0, policy_version 948373 (0.0007) [2023-12-26 07:09:47,589][123091] Updated weights for policy 0, policy_version 948383 (0.0009) [2023-12-26 07:09:47,642][123091] Updated weights for policy 0, policy_version 948393 (0.0009) [2023-12-26 07:09:47,940][123090] Updated weights for policy 1, policy_version 941607 (0.0010) [2023-12-26 07:09:48,002][123090] Updated weights for policy 1, policy_version 941617 (0.0010) [2023-12-26 07:09:48,065][123090] Updated weights for policy 1, policy_version 941627 (0.0010) [2023-12-26 07:09:48,446][123091] Updated weights for policy 0, policy_version 948403 (0.0010) [2023-12-26 07:09:48,515][123091] Updated weights for policy 0, policy_version 948413 (0.0009) [2023-12-26 07:09:48,581][123091] Updated weights for policy 0, policy_version 948423 (0.0009) [2023-12-26 07:09:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 483860480. Throughput: 0: 8968.4, 1: 8376.7. Samples: 483871544. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:48,784][121949] Avg episode reward: [(0, '6229.656'), (1, '5307.455')] [2023-12-26 07:09:48,943][123090] Updated weights for policy 1, policy_version 941637 (0.0009) [2023-12-26 07:09:49,001][123090] Updated weights for policy 1, policy_version 941647 (0.0009) [2023-12-26 07:09:49,065][123090] Updated weights for policy 1, policy_version 941657 (0.0009) [2023-12-26 07:09:49,387][123091] Updated weights for policy 0, policy_version 948433 (0.0009) [2023-12-26 07:09:49,444][123091] Updated weights for policy 0, policy_version 948443 (0.0008) [2023-12-26 07:09:49,488][123091] Updated weights for policy 0, policy_version 948453 (0.0008) [2023-12-26 07:09:49,541][123091] Updated weights for policy 0, policy_version 948463 (0.0006) [2023-12-26 07:09:49,909][123090] Updated weights for policy 1, policy_version 941667 (0.0008) [2023-12-26 07:09:49,981][123090] Updated weights for policy 1, policy_version 941677 (0.0009) [2023-12-26 07:09:50,049][123090] Updated weights for policy 1, policy_version 941687 (0.0009) [2023-12-26 07:09:50,288][123091] Updated weights for policy 0, policy_version 948473 (0.0005) [2023-12-26 07:09:50,345][123091] Updated weights for policy 0, policy_version 948483 (0.0007) [2023-12-26 07:09:50,411][123091] Updated weights for policy 0, policy_version 948493 (0.0011) [2023-12-26 07:09:50,905][123090] Updated weights for policy 1, policy_version 941697 (0.0008) [2023-12-26 07:09:50,967][123090] Updated weights for policy 1, policy_version 941707 (0.0006) [2023-12-26 07:09:51,026][123090] Updated weights for policy 1, policy_version 941717 (0.0006) [2023-12-26 07:09:51,089][123091] Updated weights for policy 0, policy_version 948503 (0.0011) [2023-12-26 07:09:51,090][123090] Updated weights for policy 1, policy_version 941727 (0.0008) [2023-12-26 07:09:51,161][123091] Updated weights for policy 0, policy_version 948513 (0.0011) [2023-12-26 07:09:51,223][123091] Updated weights for policy 0, policy_version 948523 (0.0011) [2023-12-26 07:09:51,814][123090] Updated weights for policy 1, policy_version 941737 (0.0005) [2023-12-26 07:09:51,882][123090] Updated weights for policy 1, policy_version 941747 (0.0005) [2023-12-26 07:09:51,946][123090] Updated weights for policy 1, policy_version 941757 (0.0005) [2023-12-26 07:09:51,996][123091] Updated weights for policy 0, policy_version 948533 (0.0006) [2023-12-26 07:09:52,056][123091] Updated weights for policy 0, policy_version 948543 (0.0006) [2023-12-26 07:09:52,115][123091] Updated weights for policy 0, policy_version 948553 (0.0007) [2023-12-26 07:09:52,697][123090] Updated weights for policy 1, policy_version 941767 (0.0009) [2023-12-26 07:09:52,744][123091] Updated weights for policy 0, policy_version 948563 (0.0005) [2023-12-26 07:09:52,753][123090] Updated weights for policy 1, policy_version 941777 (0.0009) [2023-12-26 07:09:52,799][123090] Updated weights for policy 1, policy_version 941787 (0.0007) [2023-12-26 07:09:52,799][123091] Updated weights for policy 0, policy_version 948573 (0.0008) [2023-12-26 07:09:52,857][123091] Updated weights for policy 0, policy_version 948583 (0.0008) [2023-12-26 07:09:53,510][123090] Updated weights for policy 1, policy_version 941797 (0.0007) [2023-12-26 07:09:53,563][123090] Updated weights for policy 1, policy_version 941807 (0.0005) [2023-12-26 07:09:53,620][123090] Updated weights for policy 1, policy_version 941817 (0.0006) [2023-12-26 07:09:53,643][123091] Updated weights for policy 0, policy_version 948593 (0.0006) [2023-12-26 07:09:53,694][123091] Updated weights for policy 0, policy_version 948603 (0.0010) [2023-12-26 07:09:53,747][123091] Updated weights for policy 0, policy_version 948613 (0.0011) [2023-12-26 07:09:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 483950592. Throughput: 0: 8934.3, 1: 8359.8. Samples: 483924760. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:53,786][121949] Avg episode reward: [(0, '6134.746'), (1, '5169.586')] [2023-12-26 07:09:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000941824_241106944.pth... [2023-12-26 07:09:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000940832_240852992.pth [2023-12-26 07:09:53,799][123091] Updated weights for policy 0, policy_version 948623 (0.0010) [2023-12-26 07:09:53,800][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000948624_242851840.pth... [2023-12-26 07:09:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000947536_242573312.pth [2023-12-26 07:09:54,270][123090] Updated weights for policy 1, policy_version 941827 (0.0007) [2023-12-26 07:09:54,329][123090] Updated weights for policy 1, policy_version 941837 (0.0006) [2023-12-26 07:09:54,382][123090] Updated weights for policy 1, policy_version 941847 (0.0005) [2023-12-26 07:09:54,634][123091] Updated weights for policy 0, policy_version 948633 (0.0011) [2023-12-26 07:09:54,697][123091] Updated weights for policy 0, policy_version 948643 (0.0010) [2023-12-26 07:09:54,756][123091] Updated weights for policy 0, policy_version 948653 (0.0011) [2023-12-26 07:09:55,063][123090] Updated weights for policy 1, policy_version 941857 (0.0005) [2023-12-26 07:09:55,127][123090] Updated weights for policy 1, policy_version 941867 (0.0009) [2023-12-26 07:09:55,182][123090] Updated weights for policy 1, policy_version 941877 (0.0010) [2023-12-26 07:09:55,233][123090] Updated weights for policy 1, policy_version 941887 (0.0010) [2023-12-26 07:09:55,582][123091] Updated weights for policy 0, policy_version 948663 (0.0010) [2023-12-26 07:09:55,648][123091] Updated weights for policy 0, policy_version 948673 (0.0010) [2023-12-26 07:09:55,714][123091] Updated weights for policy 0, policy_version 948683 (0.0011) [2023-12-26 07:09:56,014][123090] Updated weights for policy 1, policy_version 941897 (0.0010) [2023-12-26 07:09:56,077][123090] Updated weights for policy 1, policy_version 941907 (0.0010) [2023-12-26 07:09:56,148][123090] Updated weights for policy 1, policy_version 941917 (0.0007) [2023-12-26 07:09:56,521][123091] Updated weights for policy 0, policy_version 948693 (0.0011) [2023-12-26 07:09:56,585][123091] Updated weights for policy 0, policy_version 948703 (0.0011) [2023-12-26 07:09:56,648][123091] Updated weights for policy 0, policy_version 948713 (0.0011) [2023-12-26 07:09:56,834][123090] Updated weights for policy 1, policy_version 941927 (0.0005) [2023-12-26 07:09:56,890][123090] Updated weights for policy 1, policy_version 941937 (0.0005) [2023-12-26 07:09:56,943][123090] Updated weights for policy 1, policy_version 941947 (0.0005) [2023-12-26 07:09:57,457][123091] Updated weights for policy 0, policy_version 948723 (0.0011) [2023-12-26 07:09:57,507][123091] Updated weights for policy 0, policy_version 948733 (0.0010) [2023-12-26 07:09:57,557][123091] Updated weights for policy 0, policy_version 948743 (0.0010) [2023-12-26 07:09:57,664][123090] Updated weights for policy 1, policy_version 941957 (0.0005) [2023-12-26 07:09:57,737][123090] Updated weights for policy 1, policy_version 941967 (0.0005) [2023-12-26 07:09:57,810][123090] Updated weights for policy 1, policy_version 941977 (0.0005) [2023-12-26 07:09:58,382][123091] Updated weights for policy 0, policy_version 948753 (0.0010) [2023-12-26 07:09:58,450][123091] Updated weights for policy 0, policy_version 948763 (0.0011) [2023-12-26 07:09:58,474][123090] Updated weights for policy 1, policy_version 941987 (0.0006) [2023-12-26 07:09:58,521][123091] Updated weights for policy 0, policy_version 948773 (0.0010) [2023-12-26 07:09:58,538][123090] Updated weights for policy 1, policy_version 941997 (0.0008) [2023-12-26 07:09:58,587][123091] Updated weights for policy 0, policy_version 948783 (0.0011) [2023-12-26 07:09:58,606][123090] Updated weights for policy 1, policy_version 942007 (0.0008) [2023-12-26 07:09:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 484048896. Throughput: 0: 9010.2, 1: 8542.1. Samples: 484037364. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:09:58,785][121949] Avg episode reward: [(0, '6055.694'), (1, '5346.848')] [2023-12-26 07:09:59,431][123090] Updated weights for policy 1, policy_version 942017 (0.0007) [2023-12-26 07:09:59,451][123091] Updated weights for policy 0, policy_version 948793 (0.0009) [2023-12-26 07:09:59,485][123090] Updated weights for policy 1, policy_version 942027 (0.0008) [2023-12-26 07:09:59,510][123091] Updated weights for policy 0, policy_version 948803 (0.0008) [2023-12-26 07:09:59,537][123090] Updated weights for policy 1, policy_version 942037 (0.0008) [2023-12-26 07:09:59,561][123091] Updated weights for policy 0, policy_version 948813 (0.0009) [2023-12-26 07:09:59,586][123090] Updated weights for policy 1, policy_version 942047 (0.0009) [2023-12-26 07:10:00,417][123091] Updated weights for policy 0, policy_version 948823 (0.0006) [2023-12-26 07:10:00,485][123091] Updated weights for policy 0, policy_version 948833 (0.0007) [2023-12-26 07:10:00,487][123090] Updated weights for policy 1, policy_version 942057 (0.0008) [2023-12-26 07:10:00,546][123091] Updated weights for policy 0, policy_version 948843 (0.0007) [2023-12-26 07:10:00,549][123090] Updated weights for policy 1, policy_version 942067 (0.0008) [2023-12-26 07:10:00,601][123090] Updated weights for policy 1, policy_version 942077 (0.0009) [2023-12-26 07:10:01,266][123091] Updated weights for policy 0, policy_version 948853 (0.0007) [2023-12-26 07:10:01,334][123091] Updated weights for policy 0, policy_version 948863 (0.0009) [2023-12-26 07:10:01,397][123091] Updated weights for policy 0, policy_version 948873 (0.0009) [2023-12-26 07:10:01,479][123090] Updated weights for policy 1, policy_version 942087 (0.0010) [2023-12-26 07:10:01,531][123090] Updated weights for policy 1, policy_version 942097 (0.0009) [2023-12-26 07:10:01,581][123090] Updated weights for policy 1, policy_version 942107 (0.0009) [2023-12-26 07:10:02,112][123091] Updated weights for policy 0, policy_version 948883 (0.0009) [2023-12-26 07:10:02,179][123091] Updated weights for policy 0, policy_version 948893 (0.0010) [2023-12-26 07:10:02,246][123091] Updated weights for policy 0, policy_version 948903 (0.0010) [2023-12-26 07:10:02,457][123090] Updated weights for policy 1, policy_version 942117 (0.0009) [2023-12-26 07:10:02,530][123090] Updated weights for policy 1, policy_version 942127 (0.0010) [2023-12-26 07:10:02,607][123090] Updated weights for policy 1, policy_version 942137 (0.0009) [2023-12-26 07:10:03,094][123091] Updated weights for policy 0, policy_version 948913 (0.0010) [2023-12-26 07:10:03,159][123091] Updated weights for policy 0, policy_version 948923 (0.0009) [2023-12-26 07:10:03,231][123091] Updated weights for policy 0, policy_version 948933 (0.0009) [2023-12-26 07:10:03,281][123091] Updated weights for policy 0, policy_version 948943 (0.0009) [2023-12-26 07:10:03,413][123090] Updated weights for policy 1, policy_version 942147 (0.0008) [2023-12-26 07:10:03,475][123090] Updated weights for policy 1, policy_version 942157 (0.0010) [2023-12-26 07:10:03,531][123090] Updated weights for policy 1, policy_version 942167 (0.0009) [2023-12-26 07:10:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 484130816. Throughput: 0: 8992.7, 1: 8521.9. Samples: 484141464. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:03,785][121949] Avg episode reward: [(0, '6083.100'), (1, '5375.608')] [2023-12-26 07:10:03,891][123091] Updated weights for policy 0, policy_version 948953 (0.0011) [2023-12-26 07:10:03,943][123091] Updated weights for policy 0, policy_version 948963 (0.0011) [2023-12-26 07:10:04,006][123091] Updated weights for policy 0, policy_version 948973 (0.0011) [2023-12-26 07:10:04,414][123090] Updated weights for policy 1, policy_version 942178 (0.0010) [2023-12-26 07:10:04,469][123090] Updated weights for policy 1, policy_version 942188 (0.0009) [2023-12-26 07:10:04,521][123090] Updated weights for policy 1, policy_version 942198 (0.0009) [2023-12-26 07:10:04,568][123090] Updated weights for policy 1, policy_version 942208 (0.0008) [2023-12-26 07:10:04,832][123091] Updated weights for policy 0, policy_version 948983 (0.0011) [2023-12-26 07:10:04,876][123091] Updated weights for policy 0, policy_version 948993 (0.0010) [2023-12-26 07:10:04,927][123091] Updated weights for policy 0, policy_version 949003 (0.0008) [2023-12-26 07:10:05,483][123090] Updated weights for policy 1, policy_version 942220 (0.0011) [2023-12-26 07:10:05,543][123090] Updated weights for policy 1, policy_version 942230 (0.0010) [2023-12-26 07:10:05,599][123090] Updated weights for policy 1, policy_version 942240 (0.0009) [2023-12-26 07:10:05,607][123091] Updated weights for policy 0, policy_version 949013 (0.0005) [2023-12-26 07:10:05,666][123091] Updated weights for policy 0, policy_version 949023 (0.0005) [2023-12-26 07:10:05,712][123091] Updated weights for policy 0, policy_version 949033 (0.0005) [2023-12-26 07:10:06,323][123091] Updated weights for policy 0, policy_version 949043 (0.0007) [2023-12-26 07:10:06,378][123091] Updated weights for policy 0, policy_version 949053 (0.0011) [2023-12-26 07:10:06,446][123091] Updated weights for policy 0, policy_version 949063 (0.0010) [2023-12-26 07:10:06,541][123090] Updated weights for policy 1, policy_version 942250 (0.0008) [2023-12-26 07:10:06,606][123090] Updated weights for policy 1, policy_version 942260 (0.0009) [2023-12-26 07:10:06,674][123090] Updated weights for policy 1, policy_version 942270 (0.0008) [2023-12-26 07:10:07,260][123091] Updated weights for policy 0, policy_version 949073 (0.0010) [2023-12-26 07:10:07,325][123091] Updated weights for policy 0, policy_version 949083 (0.0010) [2023-12-26 07:10:07,391][123091] Updated weights for policy 0, policy_version 949093 (0.0011) [2023-12-26 07:10:07,453][123090] Updated weights for policy 1, policy_version 942280 (0.0008) [2023-12-26 07:10:07,459][123091] Updated weights for policy 0, policy_version 949103 (0.0009) [2023-12-26 07:10:07,517][123090] Updated weights for policy 1, policy_version 942290 (0.0006) [2023-12-26 07:10:07,595][123090] Updated weights for policy 1, policy_version 942300 (0.0007) [2023-12-26 07:10:08,235][123091] Updated weights for policy 0, policy_version 949113 (0.0006) [2023-12-26 07:10:08,306][123091] Updated weights for policy 0, policy_version 949123 (0.0011) [2023-12-26 07:10:08,328][123090] Updated weights for policy 1, policy_version 942310 (0.0011) [2023-12-26 07:10:08,374][123091] Updated weights for policy 0, policy_version 949133 (0.0013) [2023-12-26 07:10:08,394][123090] Updated weights for policy 1, policy_version 942320 (0.0010) [2023-12-26 07:10:08,462][123090] Updated weights for policy 1, policy_version 942330 (0.0006) [2023-12-26 07:10:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 484220928. Throughput: 0: 9087.6, 1: 8505.2. Samples: 484194956. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:08,785][121949] Avg episode reward: [(0, '6155.839'), (1, '5171.028')] [2023-12-26 07:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000949136_242982912.pth... [2023-12-26 07:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000942336_241238016.pth... [2023-12-26 07:10:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000948080_242712576.pth [2023-12-26 07:10:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000941312_240975872.pth [2023-12-26 07:10:09,126][123091] Updated weights for policy 0, policy_version 949143 (0.0007) [2023-12-26 07:10:09,183][123090] Updated weights for policy 1, policy_version 942340 (0.0008) [2023-12-26 07:10:09,186][123091] Updated weights for policy 0, policy_version 949153 (0.0005) [2023-12-26 07:10:09,251][123090] Updated weights for policy 1, policy_version 942350 (0.0011) [2023-12-26 07:10:09,263][123091] Updated weights for policy 0, policy_version 949163 (0.0009) [2023-12-26 07:10:09,315][123090] Updated weights for policy 1, policy_version 942360 (0.0011) [2023-12-26 07:10:10,061][123091] Updated weights for policy 0, policy_version 949173 (0.0009) [2023-12-26 07:10:10,109][123091] Updated weights for policy 0, policy_version 949183 (0.0010) [2023-12-26 07:10:10,161][123091] Updated weights for policy 0, policy_version 949193 (0.0010) [2023-12-26 07:10:10,181][123090] Updated weights for policy 1, policy_version 942370 (0.0010) [2023-12-26 07:10:10,233][123090] Updated weights for policy 1, policy_version 942380 (0.0009) [2023-12-26 07:10:10,283][123090] Updated weights for policy 1, policy_version 942390 (0.0009) [2023-12-26 07:10:10,348][123090] Updated weights for policy 1, policy_version 942400 (0.0008) [2023-12-26 07:10:11,005][123091] Updated weights for policy 0, policy_version 949203 (0.0009) [2023-12-26 07:10:11,065][123091] Updated weights for policy 0, policy_version 949213 (0.0011) [2023-12-26 07:10:11,126][123091] Updated weights for policy 0, policy_version 949223 (0.0006) [2023-12-26 07:10:11,188][123090] Updated weights for policy 1, policy_version 942410 (0.0009) [2023-12-26 07:10:11,260][123090] Updated weights for policy 1, policy_version 942420 (0.0011) [2023-12-26 07:10:11,320][123090] Updated weights for policy 1, policy_version 942430 (0.0011) [2023-12-26 07:10:11,954][123091] Updated weights for policy 0, policy_version 949233 (0.0011) [2023-12-26 07:10:12,017][123091] Updated weights for policy 0, policy_version 949243 (0.0011) [2023-12-26 07:10:12,074][123091] Updated weights for policy 0, policy_version 949253 (0.0011) [2023-12-26 07:10:12,138][123091] Updated weights for policy 0, policy_version 949263 (0.0011) [2023-12-26 07:10:12,190][123090] Updated weights for policy 1, policy_version 942440 (0.0011) [2023-12-26 07:10:12,258][123090] Updated weights for policy 1, policy_version 942450 (0.0011) [2023-12-26 07:10:12,325][123090] Updated weights for policy 1, policy_version 942460 (0.0010) [2023-12-26 07:10:12,859][123091] Updated weights for policy 0, policy_version 949273 (0.0006) [2023-12-26 07:10:12,920][123091] Updated weights for policy 0, policy_version 949283 (0.0006) [2023-12-26 07:10:12,978][123091] Updated weights for policy 0, policy_version 949293 (0.0010) [2023-12-26 07:10:13,144][123090] Updated weights for policy 1, policy_version 942470 (0.0009) [2023-12-26 07:10:13,214][123090] Updated weights for policy 1, policy_version 942480 (0.0010) [2023-12-26 07:10:13,273][123090] Updated weights for policy 1, policy_version 942490 (0.0010) [2023-12-26 07:10:13,643][123091] Updated weights for policy 0, policy_version 949303 (0.0008) [2023-12-26 07:10:13,694][123091] Updated weights for policy 0, policy_version 949313 (0.0010) [2023-12-26 07:10:13,753][123091] Updated weights for policy 0, policy_version 949323 (0.0006) [2023-12-26 07:10:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 484302848. Throughput: 0: 9027.8, 1: 8547.6. Samples: 484299624. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:13,785][121949] Avg episode reward: [(0, '6164.075'), (1, '5120.847')] [2023-12-26 07:10:14,051][123090] Updated weights for policy 1, policy_version 942500 (0.0010) [2023-12-26 07:10:14,117][123090] Updated weights for policy 1, policy_version 942510 (0.0010) [2023-12-26 07:10:14,180][123090] Updated weights for policy 1, policy_version 942520 (0.0010) [2023-12-26 07:10:14,434][123091] Updated weights for policy 0, policy_version 949333 (0.0005) [2023-12-26 07:10:14,484][123091] Updated weights for policy 0, policy_version 949343 (0.0005) [2023-12-26 07:10:14,528][123091] Updated weights for policy 0, policy_version 949353 (0.0005) [2023-12-26 07:10:14,958][123090] Updated weights for policy 1, policy_version 942530 (0.0010) [2023-12-26 07:10:15,019][123090] Updated weights for policy 1, policy_version 942540 (0.0011) [2023-12-26 07:10:15,075][123090] Updated weights for policy 1, policy_version 942550 (0.0011) [2023-12-26 07:10:15,128][123090] Updated weights for policy 1, policy_version 942560 (0.0010) [2023-12-26 07:10:15,285][123091] Updated weights for policy 0, policy_version 949363 (0.0005) [2023-12-26 07:10:15,338][123091] Updated weights for policy 0, policy_version 949373 (0.0005) [2023-12-26 07:10:15,393][123091] Updated weights for policy 0, policy_version 949383 (0.0005) [2023-12-26 07:10:15,990][123090] Updated weights for policy 1, policy_version 942570 (0.0011) [2023-12-26 07:10:16,056][123090] Updated weights for policy 1, policy_version 942580 (0.0010) [2023-12-26 07:10:16,119][123090] Updated weights for policy 1, policy_version 942590 (0.0010) [2023-12-26 07:10:16,130][123091] Updated weights for policy 0, policy_version 949393 (0.0006) [2023-12-26 07:10:16,184][123091] Updated weights for policy 0, policy_version 949403 (0.0010) [2023-12-26 07:10:16,232][123091] Updated weights for policy 0, policy_version 949413 (0.0010) [2023-12-26 07:10:16,279][123091] Updated weights for policy 0, policy_version 949423 (0.0010) [2023-12-26 07:10:16,928][123090] Updated weights for policy 1, policy_version 942600 (0.0009) [2023-12-26 07:10:16,994][123090] Updated weights for policy 1, policy_version 942610 (0.0011) [2023-12-26 07:10:17,054][123090] Updated weights for policy 1, policy_version 942620 (0.0010) [2023-12-26 07:10:17,132][123091] Updated weights for policy 0, policy_version 949433 (0.0010) [2023-12-26 07:10:17,187][123091] Updated weights for policy 0, policy_version 949444 (0.0010) [2023-12-26 07:10:17,245][123091] Updated weights for policy 0, policy_version 949455 (0.0010) [2023-12-26 07:10:17,733][123090] Updated weights for policy 1, policy_version 942630 (0.0007) [2023-12-26 07:10:17,801][123090] Updated weights for policy 1, policy_version 942640 (0.0011) [2023-12-26 07:10:17,862][123090] Updated weights for policy 1, policy_version 942650 (0.0008) [2023-12-26 07:10:18,141][123091] Updated weights for policy 0, policy_version 949465 (0.0009) [2023-12-26 07:10:18,194][123091] Updated weights for policy 0, policy_version 949475 (0.0007) [2023-12-26 07:10:18,243][123091] Updated weights for policy 0, policy_version 949485 (0.0005) [2023-12-26 07:10:18,619][123090] Updated weights for policy 1, policy_version 942660 (0.0005) [2023-12-26 07:10:18,684][123090] Updated weights for policy 1, policy_version 942670 (0.0005) [2023-12-26 07:10:18,756][123090] Updated weights for policy 1, policy_version 942680 (0.0007) [2023-12-26 07:10:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 484392960. Throughput: 0: 9121.3, 1: 8611.2. Samples: 484409828. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:18,785][121949] Avg episode reward: [(0, '6171.163'), (1, '5121.705')] [2023-12-26 07:10:18,934][123091] Updated weights for policy 0, policy_version 949495 (0.0007) [2023-12-26 07:10:18,983][123091] Updated weights for policy 0, policy_version 949505 (0.0005) [2023-12-26 07:10:19,037][123091] Updated weights for policy 0, policy_version 949515 (0.0005) [2023-12-26 07:10:19,564][123090] Updated weights for policy 1, policy_version 942690 (0.0010) [2023-12-26 07:10:19,621][123090] Updated weights for policy 1, policy_version 942700 (0.0010) [2023-12-26 07:10:19,683][123090] Updated weights for policy 1, policy_version 942710 (0.0009) [2023-12-26 07:10:19,753][123090] Updated weights for policy 1, policy_version 942720 (0.0007) [2023-12-26 07:10:19,770][123091] Updated weights for policy 0, policy_version 949525 (0.0008) [2023-12-26 07:10:19,844][123091] Updated weights for policy 0, policy_version 949535 (0.0009) [2023-12-26 07:10:19,913][123091] Updated weights for policy 0, policy_version 949545 (0.0009) [2023-12-26 07:10:20,586][123090] Updated weights for policy 1, policy_version 942730 (0.0007) [2023-12-26 07:10:20,647][123090] Updated weights for policy 1, policy_version 942740 (0.0009) [2023-12-26 07:10:20,705][123090] Updated weights for policy 1, policy_version 942750 (0.0010) [2023-12-26 07:10:20,759][123091] Updated weights for policy 0, policy_version 949555 (0.0010) [2023-12-26 07:10:20,817][123091] Updated weights for policy 0, policy_version 949565 (0.0006) [2023-12-26 07:10:20,878][123091] Updated weights for policy 0, policy_version 949575 (0.0006) [2023-12-26 07:10:21,553][123090] Updated weights for policy 1, policy_version 942760 (0.0009) [2023-12-26 07:10:21,623][123090] Updated weights for policy 1, policy_version 942770 (0.0008) [2023-12-26 07:10:21,654][123091] Updated weights for policy 0, policy_version 949585 (0.0006) [2023-12-26 07:10:21,687][123090] Updated weights for policy 1, policy_version 942780 (0.0008) [2023-12-26 07:10:21,721][123091] Updated weights for policy 0, policy_version 949595 (0.0009) [2023-12-26 07:10:21,787][123091] Updated weights for policy 0, policy_version 949605 (0.0008) [2023-12-26 07:10:21,853][123091] Updated weights for policy 0, policy_version 949615 (0.0006) [2023-12-26 07:10:22,549][123090] Updated weights for policy 1, policy_version 942790 (0.0008) [2023-12-26 07:10:22,550][123091] Updated weights for policy 0, policy_version 949625 (0.0007) [2023-12-26 07:10:22,614][123091] Updated weights for policy 0, policy_version 949635 (0.0010) [2023-12-26 07:10:22,618][123090] Updated weights for policy 1, policy_version 942800 (0.0006) [2023-12-26 07:10:22,684][123090] Updated weights for policy 1, policy_version 942810 (0.0005) [2023-12-26 07:10:22,686][123091] Updated weights for policy 0, policy_version 949645 (0.0009) [2023-12-26 07:10:23,374][123091] Updated weights for policy 0, policy_version 949655 (0.0008) [2023-12-26 07:10:23,430][123091] Updated weights for policy 0, policy_version 949665 (0.0009) [2023-12-26 07:10:23,470][123090] Updated weights for policy 1, policy_version 942820 (0.0007) [2023-12-26 07:10:23,483][123091] Updated weights for policy 0, policy_version 949675 (0.0010) [2023-12-26 07:10:23,521][123090] Updated weights for policy 1, policy_version 942830 (0.0009) [2023-12-26 07:10:23,578][123090] Updated weights for policy 1, policy_version 942841 (0.0009) [2023-12-26 07:10:23,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 484491264. Throughput: 0: 9092.6, 1: 8633.1. Samples: 484462912. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:23,784][121949] Avg episode reward: [(0, '6184.625'), (1, '5326.774')] [2023-12-26 07:10:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000942848_241369088.pth... [2023-12-26 07:10:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000949680_243122176.pth... [2023-12-26 07:10:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000941824_241106944.pth [2023-12-26 07:10:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000948624_242851840.pth [2023-12-26 07:10:24,264][123091] Updated weights for policy 0, policy_version 949685 (0.0007) [2023-12-26 07:10:24,309][123091] Updated weights for policy 0, policy_version 949695 (0.0005) [2023-12-26 07:10:24,369][123091] Updated weights for policy 0, policy_version 949705 (0.0005) [2023-12-26 07:10:24,377][123090] Updated weights for policy 1, policy_version 942851 (0.0009) [2023-12-26 07:10:24,440][123090] Updated weights for policy 1, policy_version 942861 (0.0009) [2023-12-26 07:10:24,506][123090] Updated weights for policy 1, policy_version 942871 (0.0007) [2023-12-26 07:10:25,140][123091] Updated weights for policy 0, policy_version 949715 (0.0007) [2023-12-26 07:10:25,200][123091] Updated weights for policy 0, policy_version 949725 (0.0005) [2023-12-26 07:10:25,270][123091] Updated weights for policy 0, policy_version 949735 (0.0005) [2023-12-26 07:10:25,309][123090] Updated weights for policy 1, policy_version 942881 (0.0009) [2023-12-26 07:10:25,377][123090] Updated weights for policy 1, policy_version 942891 (0.0009) [2023-12-26 07:10:25,443][123090] Updated weights for policy 1, policy_version 942901 (0.0008) [2023-12-26 07:10:25,495][123090] Updated weights for policy 1, policy_version 942911 (0.0010) [2023-12-26 07:10:26,000][123091] Updated weights for policy 0, policy_version 949745 (0.0006) [2023-12-26 07:10:26,051][123091] Updated weights for policy 0, policy_version 949755 (0.0009) [2023-12-26 07:10:26,110][123091] Updated weights for policy 0, policy_version 949765 (0.0009) [2023-12-26 07:10:26,163][123091] Updated weights for policy 0, policy_version 949775 (0.0009) [2023-12-26 07:10:26,300][123090] Updated weights for policy 1, policy_version 942921 (0.0009) [2023-12-26 07:10:26,355][123090] Updated weights for policy 1, policy_version 942931 (0.0009) [2023-12-26 07:10:26,413][123090] Updated weights for policy 1, policy_version 942941 (0.0010) [2023-12-26 07:10:26,983][123091] Updated weights for policy 0, policy_version 949785 (0.0009) [2023-12-26 07:10:27,031][123091] Updated weights for policy 0, policy_version 949795 (0.0009) [2023-12-26 07:10:27,089][123091] Updated weights for policy 0, policy_version 949805 (0.0008) [2023-12-26 07:10:27,243][123090] Updated weights for policy 1, policy_version 942951 (0.0007) [2023-12-26 07:10:27,299][123090] Updated weights for policy 1, policy_version 942961 (0.0006) [2023-12-26 07:10:27,361][123090] Updated weights for policy 1, policy_version 942971 (0.0010) [2023-12-26 07:10:27,979][123090] Updated weights for policy 1, policy_version 942981 (0.0009) [2023-12-26 07:10:27,989][123091] Updated weights for policy 0, policy_version 949815 (0.0009) [2023-12-26 07:10:28,034][123090] Updated weights for policy 1, policy_version 942991 (0.0005) [2023-12-26 07:10:28,054][123091] Updated weights for policy 0, policy_version 949825 (0.0008) [2023-12-26 07:10:28,105][123090] Updated weights for policy 1, policy_version 943001 (0.0005) [2023-12-26 07:10:28,129][123091] Updated weights for policy 0, policy_version 949835 (0.0008) [2023-12-26 07:10:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 484573184. Throughput: 0: 9157.9, 1: 8708.8. Samples: 484569660. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:28,784][121949] Avg episode reward: [(0, '6289.640'), (1, '5466.759')] [2023-12-26 07:10:28,840][123090] Updated weights for policy 1, policy_version 943011 (0.0006) [2023-12-26 07:10:28,849][123091] Updated weights for policy 0, policy_version 949845 (0.0008) [2023-12-26 07:10:28,900][123090] Updated weights for policy 1, policy_version 943021 (0.0008) [2023-12-26 07:10:28,920][123091] Updated weights for policy 0, policy_version 949855 (0.0006) [2023-12-26 07:10:28,965][123090] Updated weights for policy 1, policy_version 943031 (0.0009) [2023-12-26 07:10:28,981][123091] Updated weights for policy 0, policy_version 949865 (0.0007) [2023-12-26 07:10:29,737][123091] Updated weights for policy 0, policy_version 949875 (0.0010) [2023-12-26 07:10:29,788][123090] Updated weights for policy 1, policy_version 943041 (0.0009) [2023-12-26 07:10:29,793][123091] Updated weights for policy 0, policy_version 949885 (0.0009) [2023-12-26 07:10:29,853][123091] Updated weights for policy 0, policy_version 949895 (0.0008) [2023-12-26 07:10:29,856][123090] Updated weights for policy 1, policy_version 943051 (0.0008) [2023-12-26 07:10:29,919][123090] Updated weights for policy 1, policy_version 943061 (0.0008) [2023-12-26 07:10:29,984][123090] Updated weights for policy 1, policy_version 943071 (0.0009) [2023-12-26 07:10:30,660][123091] Updated weights for policy 0, policy_version 949905 (0.0009) [2023-12-26 07:10:30,728][123091] Updated weights for policy 0, policy_version 949915 (0.0006) [2023-12-26 07:10:30,792][123091] Updated weights for policy 0, policy_version 949925 (0.0009) [2023-12-26 07:10:30,838][123090] Updated weights for policy 1, policy_version 943081 (0.0010) [2023-12-26 07:10:30,848][123091] Updated weights for policy 0, policy_version 949935 (0.0005) [2023-12-26 07:10:30,890][123090] Updated weights for policy 1, policy_version 943091 (0.0010) [2023-12-26 07:10:30,942][123090] Updated weights for policy 1, policy_version 943101 (0.0010) [2023-12-26 07:10:31,605][123091] Updated weights for policy 0, policy_version 949945 (0.0009) [2023-12-26 07:10:31,663][123091] Updated weights for policy 0, policy_version 949955 (0.0008) [2023-12-26 07:10:31,729][123091] Updated weights for policy 0, policy_version 949965 (0.0007) [2023-12-26 07:10:31,803][123090] Updated weights for policy 1, policy_version 943111 (0.0010) [2023-12-26 07:10:31,869][123090] Updated weights for policy 1, policy_version 943121 (0.0010) [2023-12-26 07:10:31,917][123090] Updated weights for policy 1, policy_version 943131 (0.0010) [2023-12-26 07:10:32,395][123091] Updated weights for policy 0, policy_version 949975 (0.0006) [2023-12-26 07:10:32,443][123091] Updated weights for policy 0, policy_version 949985 (0.0005) [2023-12-26 07:10:32,499][123091] Updated weights for policy 0, policy_version 949995 (0.0009) [2023-12-26 07:10:32,753][123090] Updated weights for policy 1, policy_version 943141 (0.0009) [2023-12-26 07:10:32,799][123090] Updated weights for policy 1, policy_version 943151 (0.0006) [2023-12-26 07:10:32,857][123090] Updated weights for policy 1, policy_version 943161 (0.0008) [2023-12-26 07:10:33,378][123091] Updated weights for policy 0, policy_version 950005 (0.0009) [2023-12-26 07:10:33,440][123091] Updated weights for policy 0, policy_version 950015 (0.0008) [2023-12-26 07:10:33,505][123091] Updated weights for policy 0, policy_version 950025 (0.0007) [2023-12-26 07:10:33,651][123090] Updated weights for policy 1, policy_version 943171 (0.0010) [2023-12-26 07:10:33,710][123090] Updated weights for policy 1, policy_version 943181 (0.0010) [2023-12-26 07:10:33,769][123090] Updated weights for policy 1, policy_version 943191 (0.0010) [2023-12-26 07:10:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 484663296. Throughput: 0: 9109.3, 1: 8779.3. Samples: 484676532. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:33,784][121949] Avg episode reward: [(0, '6258.596'), (1, '5515.986')] [2023-12-26 07:10:34,183][123091] Updated weights for policy 0, policy_version 950035 (0.0009) [2023-12-26 07:10:34,243][123091] Updated weights for policy 0, policy_version 950045 (0.0006) [2023-12-26 07:10:34,310][123091] Updated weights for policy 0, policy_version 950055 (0.0008) [2023-12-26 07:10:34,627][123090] Updated weights for policy 1, policy_version 943201 (0.0010) [2023-12-26 07:10:34,691][123090] Updated weights for policy 1, policy_version 943211 (0.0011) [2023-12-26 07:10:34,757][123090] Updated weights for policy 1, policy_version 943221 (0.0010) [2023-12-26 07:10:34,820][123090] Updated weights for policy 1, policy_version 943231 (0.0010) [2023-12-26 07:10:35,070][123091] Updated weights for policy 0, policy_version 950065 (0.0008) [2023-12-26 07:10:35,117][123091] Updated weights for policy 0, policy_version 950075 (0.0005) [2023-12-26 07:10:35,163][123091] Updated weights for policy 0, policy_version 950085 (0.0005) [2023-12-26 07:10:35,218][123091] Updated weights for policy 0, policy_version 950095 (0.0005) [2023-12-26 07:10:35,643][123090] Updated weights for policy 1, policy_version 943241 (0.0010) [2023-12-26 07:10:35,709][123090] Updated weights for policy 1, policy_version 943251 (0.0010) [2023-12-26 07:10:35,771][123090] Updated weights for policy 1, policy_version 943261 (0.0010) [2023-12-26 07:10:35,946][123091] Updated weights for policy 0, policy_version 950105 (0.0009) [2023-12-26 07:10:35,995][123091] Updated weights for policy 0, policy_version 950115 (0.0005) [2023-12-26 07:10:36,041][123091] Updated weights for policy 0, policy_version 950125 (0.0005) [2023-12-26 07:10:36,545][123090] Updated weights for policy 1, policy_version 943271 (0.0010) [2023-12-26 07:10:36,609][123090] Updated weights for policy 1, policy_version 943281 (0.0011) [2023-12-26 07:10:36,672][123090] Updated weights for policy 1, policy_version 943291 (0.0011) [2023-12-26 07:10:36,771][123091] Updated weights for policy 0, policy_version 950135 (0.0005) [2023-12-26 07:10:36,835][123091] Updated weights for policy 0, policy_version 950145 (0.0005) [2023-12-26 07:10:36,912][123091] Updated weights for policy 0, policy_version 950155 (0.0006) [2023-12-26 07:10:37,510][123090] Updated weights for policy 1, policy_version 943301 (0.0010) [2023-12-26 07:10:37,578][123090] Updated weights for policy 1, policy_version 943311 (0.0011) [2023-12-26 07:10:37,583][123091] Updated weights for policy 0, policy_version 950165 (0.0006) [2023-12-26 07:10:37,641][123090] Updated weights for policy 1, policy_version 943321 (0.0010) [2023-12-26 07:10:37,644][123091] Updated weights for policy 0, policy_version 950175 (0.0006) [2023-12-26 07:10:37,708][123091] Updated weights for policy 0, policy_version 950185 (0.0006) [2023-12-26 07:10:38,377][123091] Updated weights for policy 0, policy_version 950195 (0.0007) [2023-12-26 07:10:38,432][123091] Updated weights for policy 0, policy_version 950205 (0.0007) [2023-12-26 07:10:38,445][123090] Updated weights for policy 1, policy_version 943331 (0.0010) [2023-12-26 07:10:38,503][123091] Updated weights for policy 0, policy_version 950215 (0.0006) [2023-12-26 07:10:38,507][123090] Updated weights for policy 1, policy_version 943341 (0.0007) [2023-12-26 07:10:38,571][123090] Updated weights for policy 1, policy_version 943351 (0.0011) [2023-12-26 07:10:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 484761600. Throughput: 0: 9143.2, 1: 8794.1. Samples: 484731932. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:38,785][121949] Avg episode reward: [(0, '6099.290'), (1, '5453.226')] [2023-12-26 07:10:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000950224_243261440.pth... [2023-12-26 07:10:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000943360_241500160.pth... [2023-12-26 07:10:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000949136_242982912.pth [2023-12-26 07:10:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000942336_241238016.pth [2023-12-26 07:10:39,261][123091] Updated weights for policy 0, policy_version 950225 (0.0009) [2023-12-26 07:10:39,317][123091] Updated weights for policy 0, policy_version 950235 (0.0010) [2023-12-26 07:10:39,386][123091] Updated weights for policy 0, policy_version 950245 (0.0010) [2023-12-26 07:10:39,400][123090] Updated weights for policy 1, policy_version 943361 (0.0011) [2023-12-26 07:10:39,447][123091] Updated weights for policy 0, policy_version 950255 (0.0011) [2023-12-26 07:10:39,468][123090] Updated weights for policy 1, policy_version 943371 (0.0007) [2023-12-26 07:10:39,545][123090] Updated weights for policy 1, policy_version 943381 (0.0011) [2023-12-26 07:10:39,615][123090] Updated weights for policy 1, policy_version 943391 (0.0010) [2023-12-26 07:10:40,203][123091] Updated weights for policy 0, policy_version 950265 (0.0006) [2023-12-26 07:10:40,266][123091] Updated weights for policy 0, policy_version 950275 (0.0011) [2023-12-26 07:10:40,319][123091] Updated weights for policy 0, policy_version 950285 (0.0011) [2023-12-26 07:10:40,425][123090] Updated weights for policy 1, policy_version 943401 (0.0007) [2023-12-26 07:10:40,496][123090] Updated weights for policy 1, policy_version 943411 (0.0006) [2023-12-26 07:10:40,572][123090] Updated weights for policy 1, policy_version 943421 (0.0006) [2023-12-26 07:10:41,052][123091] Updated weights for policy 0, policy_version 950295 (0.0008) [2023-12-26 07:10:41,126][123091] Updated weights for policy 0, policy_version 950305 (0.0007) [2023-12-26 07:10:41,199][123091] Updated weights for policy 0, policy_version 950315 (0.0008) [2023-12-26 07:10:41,204][123090] Updated weights for policy 1, policy_version 943431 (0.0007) [2023-12-26 07:10:41,279][123090] Updated weights for policy 1, policy_version 943441 (0.0008) [2023-12-26 07:10:41,350][123090] Updated weights for policy 1, policy_version 943451 (0.0010) [2023-12-26 07:10:42,059][123091] Updated weights for policy 0, policy_version 950325 (0.0010) [2023-12-26 07:10:42,110][123091] Updated weights for policy 0, policy_version 950335 (0.0010) [2023-12-26 07:10:42,152][123090] Updated weights for policy 1, policy_version 943461 (0.0008) [2023-12-26 07:10:42,158][123091] Updated weights for policy 0, policy_version 950345 (0.0010) [2023-12-26 07:10:42,200][123090] Updated weights for policy 1, policy_version 943471 (0.0008) [2023-12-26 07:10:42,260][123090] Updated weights for policy 1, policy_version 943481 (0.0009) [2023-12-26 07:10:42,973][123091] Updated weights for policy 0, policy_version 950355 (0.0010) [2023-12-26 07:10:43,039][123091] Updated weights for policy 0, policy_version 950365 (0.0007) [2023-12-26 07:10:43,084][123091] Updated weights for policy 0, policy_version 950375 (0.0005) [2023-12-26 07:10:43,164][123090] Updated weights for policy 1, policy_version 943491 (0.0008) [2023-12-26 07:10:43,235][123090] Updated weights for policy 1, policy_version 943501 (0.0009) [2023-12-26 07:10:43,307][123090] Updated weights for policy 1, policy_version 943511 (0.0007) [2023-12-26 07:10:43,782][123091] Updated weights for policy 0, policy_version 950385 (0.0008) [2023-12-26 07:10:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17578.1). Total num frames: 484843520. Throughput: 0: 9189.9, 1: 8638.2. Samples: 484839628. Policy #0 lag: (min: 31.0, avg: 31.4, max: 51.0) [2023-12-26 07:10:43,784][121949] Avg episode reward: [(0, '6130.497'), (1, '5386.475')] [2023-12-26 07:10:43,833][123091] Updated weights for policy 0, policy_version 950395 (0.0005) [2023-12-26 07:10:43,891][123091] Updated weights for policy 0, policy_version 950405 (0.0005) [2023-12-26 07:10:43,942][123090] Updated weights for policy 1, policy_version 943521 (0.0005) [2023-12-26 07:10:43,952][123091] Updated weights for policy 0, policy_version 950415 (0.0006) [2023-12-26 07:10:43,996][123090] Updated weights for policy 1, policy_version 943531 (0.0005) [2023-12-26 07:10:44,042][123090] Updated weights for policy 1, policy_version 943541 (0.0005) [2023-12-26 07:10:44,088][123090] Updated weights for policy 1, policy_version 943551 (0.0005) [2023-12-26 07:10:44,594][123091] Updated weights for policy 0, policy_version 950425 (0.0010) [2023-12-26 07:10:44,646][123091] Updated weights for policy 0, policy_version 950435 (0.0009) [2023-12-26 07:10:44,701][123091] Updated weights for policy 0, policy_version 950445 (0.0009) [2023-12-26 07:10:44,759][123090] Updated weights for policy 1, policy_version 943561 (0.0008) [2023-12-26 07:10:44,828][123090] Updated weights for policy 1, policy_version 943571 (0.0009) [2023-12-26 07:10:44,890][123090] Updated weights for policy 1, policy_version 943581 (0.0010) [2023-12-26 07:10:45,565][123091] Updated weights for policy 0, policy_version 950455 (0.0010) [2023-12-26 07:10:45,619][123091] Updated weights for policy 0, policy_version 950466 (0.0009) [2023-12-26 07:10:45,671][123091] Updated weights for policy 0, policy_version 950476 (0.0009) [2023-12-26 07:10:45,741][123090] Updated weights for policy 1, policy_version 943592 (0.0011) [2023-12-26 07:10:45,795][123090] Updated weights for policy 1, policy_version 943602 (0.0009) [2023-12-26 07:10:45,845][123090] Updated weights for policy 1, policy_version 943612 (0.0009) [2023-12-26 07:10:46,581][123090] Updated weights for policy 1, policy_version 943622 (0.0008) [2023-12-26 07:10:46,584][123091] Updated weights for policy 0, policy_version 950486 (0.0009) [2023-12-26 07:10:46,647][123090] Updated weights for policy 1, policy_version 943632 (0.0009) [2023-12-26 07:10:46,649][123091] Updated weights for policy 0, policy_version 950496 (0.0007) [2023-12-26 07:10:46,699][123091] Updated weights for policy 0, policy_version 950506 (0.0009) [2023-12-26 07:10:46,712][123090] Updated weights for policy 1, policy_version 943642 (0.0006) [2023-12-26 07:10:47,516][123090] Updated weights for policy 1, policy_version 943652 (0.0010) [2023-12-26 07:10:47,536][123091] Updated weights for policy 0, policy_version 950516 (0.0008) [2023-12-26 07:10:47,582][123090] Updated weights for policy 1, policy_version 943662 (0.0007) [2023-12-26 07:10:47,587][123091] Updated weights for policy 0, policy_version 950526 (0.0009) [2023-12-26 07:10:47,641][123090] Updated weights for policy 1, policy_version 943672 (0.0006) [2023-12-26 07:10:47,652][123091] Updated weights for policy 0, policy_version 950536 (0.0010) [2023-12-26 07:10:48,349][123091] Updated weights for policy 0, policy_version 950546 (0.0008) [2023-12-26 07:10:48,417][123091] Updated weights for policy 0, policy_version 950556 (0.0011) [2023-12-26 07:10:48,477][123091] Updated weights for policy 0, policy_version 950566 (0.0011) [2023-12-26 07:10:48,517][123090] Updated weights for policy 1, policy_version 943682 (0.0008) [2023-12-26 07:10:48,545][123091] Updated weights for policy 0, policy_version 950576 (0.0011) [2023-12-26 07:10:48,581][123090] Updated weights for policy 1, policy_version 943692 (0.0008) [2023-12-26 07:10:48,647][123090] Updated weights for policy 1, policy_version 943702 (0.0009) [2023-12-26 07:10:48,713][123090] Updated weights for policy 1, policy_version 943712 (0.0009) [2023-12-26 07:10:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 484941824. Throughput: 0: 9202.0, 1: 8726.1. Samples: 484948232. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:10:48,785][121949] Avg episode reward: [(0, '6189.652'), (1, '5476.935')] [2023-12-26 07:10:49,366][123091] Updated weights for policy 0, policy_version 950586 (0.0008) [2023-12-26 07:10:49,439][123091] Updated weights for policy 0, policy_version 950596 (0.0006) [2023-12-26 07:10:49,494][123091] Updated weights for policy 0, policy_version 950606 (0.0009) [2023-12-26 07:10:49,546][123090] Updated weights for policy 1, policy_version 943722 (0.0008) [2023-12-26 07:10:49,612][123090] Updated weights for policy 1, policy_version 943732 (0.0005) [2023-12-26 07:10:49,675][123090] Updated weights for policy 1, policy_version 943742 (0.0006) [2023-12-26 07:10:50,300][123091] Updated weights for policy 0, policy_version 950616 (0.0008) [2023-12-26 07:10:50,370][123091] Updated weights for policy 0, policy_version 950626 (0.0011) [2023-12-26 07:10:50,422][123091] Updated weights for policy 0, policy_version 950636 (0.0010) [2023-12-26 07:10:50,433][123090] Updated weights for policy 1, policy_version 943752 (0.0006) [2023-12-26 07:10:50,495][123090] Updated weights for policy 1, policy_version 943762 (0.0010) [2023-12-26 07:10:50,555][123090] Updated weights for policy 1, policy_version 943772 (0.0007) [2023-12-26 07:10:51,096][123091] Updated weights for policy 0, policy_version 950646 (0.0008) [2023-12-26 07:10:51,161][123091] Updated weights for policy 0, policy_version 950656 (0.0010) [2023-12-26 07:10:51,225][123091] Updated weights for policy 0, policy_version 950666 (0.0007) [2023-12-26 07:10:51,306][123090] Updated weights for policy 1, policy_version 943782 (0.0009) [2023-12-26 07:10:51,367][123090] Updated weights for policy 1, policy_version 943792 (0.0009) [2023-12-26 07:10:51,433][123090] Updated weights for policy 1, policy_version 943802 (0.0009) [2023-12-26 07:10:52,035][123091] Updated weights for policy 0, policy_version 950676 (0.0008) [2023-12-26 07:10:52,085][123091] Updated weights for policy 0, policy_version 950686 (0.0008) [2023-12-26 07:10:52,138][123091] Updated weights for policy 0, policy_version 950696 (0.0005) [2023-12-26 07:10:52,374][123090] Updated weights for policy 1, policy_version 943812 (0.0009) [2023-12-26 07:10:52,437][123090] Updated weights for policy 1, policy_version 943822 (0.0009) [2023-12-26 07:10:52,497][123090] Updated weights for policy 1, policy_version 943832 (0.0009) [2023-12-26 07:10:52,890][123091] Updated weights for policy 0, policy_version 950706 (0.0006) [2023-12-26 07:10:52,952][123091] Updated weights for policy 0, policy_version 950716 (0.0011) [2023-12-26 07:10:53,012][123091] Updated weights for policy 0, policy_version 950726 (0.0011) [2023-12-26 07:10:53,070][123091] Updated weights for policy 0, policy_version 950736 (0.0010) [2023-12-26 07:10:53,367][123090] Updated weights for policy 1, policy_version 943842 (0.0009) [2023-12-26 07:10:53,419][123090] Updated weights for policy 1, policy_version 943852 (0.0005) [2023-12-26 07:10:53,473][123090] Updated weights for policy 1, policy_version 943862 (0.0005) [2023-12-26 07:10:53,524][123090] Updated weights for policy 1, policy_version 943872 (0.0005) [2023-12-26 07:10:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.9, 300 sec: 17605.8). Total num frames: 485023744. Throughput: 0: 9152.5, 1: 8759.9. Samples: 485001016. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:10:53,786][121949] Avg episode reward: [(0, '6167.089'), (1, '5750.232')] [2023-12-26 07:10:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000950736_243392512.pth... [2023-12-26 07:10:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000943872_241631232.pth... [2023-12-26 07:10:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000942848_241369088.pth [2023-12-26 07:10:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000949680_243122176.pth [2023-12-26 07:10:53,891][123091] Updated weights for policy 0, policy_version 950746 (0.0010) [2023-12-26 07:10:53,955][123091] Updated weights for policy 0, policy_version 950756 (0.0010) [2023-12-26 07:10:54,013][123091] Updated weights for policy 0, policy_version 950767 (0.0009) [2023-12-26 07:10:54,218][123090] Updated weights for policy 1, policy_version 943882 (0.0010) [2023-12-26 07:10:54,276][123090] Updated weights for policy 1, policy_version 943892 (0.0008) [2023-12-26 07:10:54,335][123090] Updated weights for policy 1, policy_version 943902 (0.0010) [2023-12-26 07:10:54,752][123091] Updated weights for policy 0, policy_version 950777 (0.0009) [2023-12-26 07:10:54,803][123091] Updated weights for policy 0, policy_version 950787 (0.0009) [2023-12-26 07:10:54,851][123091] Updated weights for policy 0, policy_version 950797 (0.0009) [2023-12-26 07:10:55,234][123090] Updated weights for policy 1, policy_version 943912 (0.0010) [2023-12-26 07:10:55,287][123090] Updated weights for policy 1, policy_version 943922 (0.0009) [2023-12-26 07:10:55,344][123090] Updated weights for policy 1, policy_version 943932 (0.0008) [2023-12-26 07:10:55,741][123091] Updated weights for policy 0, policy_version 950807 (0.0009) [2023-12-26 07:10:55,790][123091] Updated weights for policy 0, policy_version 950817 (0.0010) [2023-12-26 07:10:55,841][123091] Updated weights for policy 0, policy_version 950827 (0.0009) [2023-12-26 07:10:56,132][123090] Updated weights for policy 1, policy_version 943942 (0.0010) [2023-12-26 07:10:56,188][123090] Updated weights for policy 1, policy_version 943953 (0.0010) [2023-12-26 07:10:56,247][123090] Updated weights for policy 1, policy_version 943963 (0.0010) [2023-12-26 07:10:56,651][123091] Updated weights for policy 0, policy_version 950837 (0.0010) [2023-12-26 07:10:56,705][123091] Updated weights for policy 0, policy_version 950847 (0.0009) [2023-12-26 07:10:56,765][123091] Updated weights for policy 0, policy_version 950857 (0.0009) [2023-12-26 07:10:57,006][123090] Updated weights for policy 1, policy_version 943974 (0.0009) [2023-12-26 07:10:57,050][123090] Updated weights for policy 1, policy_version 943984 (0.0010) [2023-12-26 07:10:57,109][123090] Updated weights for policy 1, policy_version 943994 (0.0010) [2023-12-26 07:10:57,534][123091] Updated weights for policy 0, policy_version 950867 (0.0008) [2023-12-26 07:10:57,582][123091] Updated weights for policy 0, policy_version 950877 (0.0005) [2023-12-26 07:10:57,628][123091] Updated weights for policy 0, policy_version 950887 (0.0005) [2023-12-26 07:10:57,941][123090] Updated weights for policy 1, policy_version 944004 (0.0008) [2023-12-26 07:10:57,990][123090] Updated weights for policy 1, policy_version 944014 (0.0005) [2023-12-26 07:10:58,059][123090] Updated weights for policy 1, policy_version 944024 (0.0007) [2023-12-26 07:10:58,354][123091] Updated weights for policy 0, policy_version 950897 (0.0005) [2023-12-26 07:10:58,423][123091] Updated weights for policy 0, policy_version 950907 (0.0009) [2023-12-26 07:10:58,497][123091] Updated weights for policy 0, policy_version 950917 (0.0008) [2023-12-26 07:10:58,569][123091] Updated weights for policy 0, policy_version 950927 (0.0008) [2023-12-26 07:10:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 485113856. Throughput: 0: 9199.5, 1: 8778.4. Samples: 485108628. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:10:58,785][121949] Avg episode reward: [(0, '6051.619'), (1, '5702.279')] [2023-12-26 07:10:58,937][123090] Updated weights for policy 1, policy_version 944034 (0.0007) [2023-12-26 07:10:59,006][123090] Updated weights for policy 1, policy_version 944044 (0.0008) [2023-12-26 07:10:59,078][123090] Updated weights for policy 1, policy_version 944054 (0.0010) [2023-12-26 07:10:59,141][123090] Updated weights for policy 1, policy_version 944064 (0.0009) [2023-12-26 07:10:59,432][123091] Updated weights for policy 0, policy_version 950937 (0.0008) [2023-12-26 07:10:59,503][123091] Updated weights for policy 0, policy_version 950947 (0.0009) [2023-12-26 07:10:59,567][123091] Updated weights for policy 0, policy_version 950957 (0.0010) [2023-12-26 07:10:59,995][123090] Updated weights for policy 1, policy_version 944074 (0.0008) [2023-12-26 07:11:00,050][123090] Updated weights for policy 1, policy_version 944084 (0.0009) [2023-12-26 07:11:00,115][123090] Updated weights for policy 1, policy_version 944094 (0.0008) [2023-12-26 07:11:00,263][123091] Updated weights for policy 0, policy_version 950967 (0.0010) [2023-12-26 07:11:00,330][123091] Updated weights for policy 0, policy_version 950977 (0.0011) [2023-12-26 07:11:00,397][123091] Updated weights for policy 0, policy_version 950987 (0.0011) [2023-12-26 07:11:00,789][123090] Updated weights for policy 1, policy_version 944104 (0.0006) [2023-12-26 07:11:00,835][123090] Updated weights for policy 1, policy_version 944114 (0.0005) [2023-12-26 07:11:00,880][123090] Updated weights for policy 1, policy_version 944124 (0.0005) [2023-12-26 07:11:01,115][123091] Updated weights for policy 0, policy_version 950997 (0.0010) [2023-12-26 07:11:01,177][123091] Updated weights for policy 0, policy_version 951007 (0.0009) [2023-12-26 07:11:01,233][123091] Updated weights for policy 0, policy_version 951017 (0.0009) [2023-12-26 07:11:01,637][123090] Updated weights for policy 1, policy_version 944134 (0.0007) [2023-12-26 07:11:01,710][123090] Updated weights for policy 1, policy_version 944144 (0.0006) [2023-12-26 07:11:01,781][123090] Updated weights for policy 1, policy_version 944154 (0.0010) [2023-12-26 07:11:02,053][123091] Updated weights for policy 0, policy_version 951027 (0.0009) [2023-12-26 07:11:02,110][123091] Updated weights for policy 0, policy_version 951037 (0.0006) [2023-12-26 07:11:02,163][123091] Updated weights for policy 0, policy_version 951047 (0.0006) [2023-12-26 07:11:02,551][123090] Updated weights for policy 1, policy_version 944164 (0.0008) [2023-12-26 07:11:02,621][123090] Updated weights for policy 1, policy_version 944174 (0.0005) [2023-12-26 07:11:02,688][123090] Updated weights for policy 1, policy_version 944184 (0.0005) [2023-12-26 07:11:03,042][123091] Updated weights for policy 0, policy_version 951057 (0.0009) [2023-12-26 07:11:03,100][123091] Updated weights for policy 0, policy_version 951067 (0.0005) [2023-12-26 07:11:03,148][123091] Updated weights for policy 0, policy_version 951077 (0.0005) [2023-12-26 07:11:03,205][123091] Updated weights for policy 0, policy_version 951087 (0.0007) [2023-12-26 07:11:03,348][123090] Updated weights for policy 1, policy_version 944194 (0.0007) [2023-12-26 07:11:03,402][123090] Updated weights for policy 1, policy_version 944204 (0.0010) [2023-12-26 07:11:03,456][123090] Updated weights for policy 1, policy_version 944214 (0.0010) [2023-12-26 07:11:03,507][123090] Updated weights for policy 1, policy_version 944224 (0.0010) [2023-12-26 07:11:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17605.9). Total num frames: 485203968. Throughput: 0: 9124.4, 1: 8785.8. Samples: 485215788. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:03,785][121949] Avg episode reward: [(0, '6195.204'), (1, '5452.699')] [2023-12-26 07:11:04,053][123091] Updated weights for policy 0, policy_version 951097 (0.0009) [2023-12-26 07:11:04,122][123091] Updated weights for policy 0, policy_version 951107 (0.0009) [2023-12-26 07:11:04,193][123091] Updated weights for policy 0, policy_version 951117 (0.0010) [2023-12-26 07:11:04,383][123090] Updated weights for policy 1, policy_version 944234 (0.0011) [2023-12-26 07:11:04,447][123090] Updated weights for policy 1, policy_version 944244 (0.0011) [2023-12-26 07:11:04,515][123090] Updated weights for policy 1, policy_version 944254 (0.0011) [2023-12-26 07:11:04,974][123091] Updated weights for policy 0, policy_version 951127 (0.0009) [2023-12-26 07:11:05,041][123091] Updated weights for policy 0, policy_version 951137 (0.0009) [2023-12-26 07:11:05,102][123091] Updated weights for policy 0, policy_version 951147 (0.0009) [2023-12-26 07:11:05,324][123090] Updated weights for policy 1, policy_version 944264 (0.0011) [2023-12-26 07:11:05,375][123090] Updated weights for policy 1, policy_version 944274 (0.0010) [2023-12-26 07:11:05,434][123090] Updated weights for policy 1, policy_version 944284 (0.0009) [2023-12-26 07:11:05,929][123091] Updated weights for policy 0, policy_version 951157 (0.0009) [2023-12-26 07:11:05,979][123091] Updated weights for policy 0, policy_version 951167 (0.0006) [2023-12-26 07:11:06,026][123091] Updated weights for policy 0, policy_version 951177 (0.0005) [2023-12-26 07:11:06,178][123090] Updated weights for policy 1, policy_version 944294 (0.0007) [2023-12-26 07:11:06,247][123090] Updated weights for policy 1, policy_version 944304 (0.0010) [2023-12-26 07:11:06,300][123090] Updated weights for policy 1, policy_version 944314 (0.0010) [2023-12-26 07:11:06,858][123091] Updated weights for policy 0, policy_version 951187 (0.0006) [2023-12-26 07:11:06,918][123091] Updated weights for policy 0, policy_version 951197 (0.0006) [2023-12-26 07:11:06,987][123091] Updated weights for policy 0, policy_version 951207 (0.0005) [2023-12-26 07:11:07,125][123090] Updated weights for policy 1, policy_version 944324 (0.0009) [2023-12-26 07:11:07,185][123090] Updated weights for policy 1, policy_version 944334 (0.0005) [2023-12-26 07:11:07,240][123090] Updated weights for policy 1, policy_version 944344 (0.0006) [2023-12-26 07:11:07,741][123091] Updated weights for policy 0, policy_version 951217 (0.0006) [2023-12-26 07:11:07,813][123091] Updated weights for policy 0, policy_version 951227 (0.0009) [2023-12-26 07:11:07,876][123091] Updated weights for policy 0, policy_version 951237 (0.0007) [2023-12-26 07:11:07,918][123090] Updated weights for policy 1, policy_version 944354 (0.0010) [2023-12-26 07:11:07,935][123091] Updated weights for policy 0, policy_version 951247 (0.0009) [2023-12-26 07:11:07,983][123090] Updated weights for policy 1, policy_version 944364 (0.0009) [2023-12-26 07:11:08,056][123090] Updated weights for policy 1, policy_version 944374 (0.0006) [2023-12-26 07:11:08,125][123090] Updated weights for policy 1, policy_version 944384 (0.0006) [2023-12-26 07:11:08,695][123091] Updated weights for policy 0, policy_version 951257 (0.0009) [2023-12-26 07:11:08,756][123091] Updated weights for policy 0, policy_version 951267 (0.0008) [2023-12-26 07:11:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 485285888. Throughput: 0: 9075.9, 1: 8810.6. Samples: 485267804. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:08,785][121949] Avg episode reward: [(0, '6252.404'), (1, '5377.230')] [2023-12-26 07:11:08,819][123091] Updated weights for policy 0, policy_version 951277 (0.0008) [2023-12-26 07:11:08,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000951280_243531776.pth... [2023-12-26 07:11:08,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000950224_243261440.pth [2023-12-26 07:11:08,854][123090] Updated weights for policy 1, policy_version 944394 (0.0011) [2023-12-26 07:11:08,918][123090] Updated weights for policy 1, policy_version 944404 (0.0010) [2023-12-26 07:11:08,975][123090] Updated weights for policy 1, policy_version 944414 (0.0006) [2023-12-26 07:11:08,986][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000944416_241770496.pth... [2023-12-26 07:11:08,989][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000943360_241500160.pth [2023-12-26 07:11:09,623][123091] Updated weights for policy 0, policy_version 951287 (0.0009) [2023-12-26 07:11:09,684][123091] Updated weights for policy 0, policy_version 951297 (0.0009) [2023-12-26 07:11:09,749][123091] Updated weights for policy 0, policy_version 951307 (0.0009) [2023-12-26 07:11:09,783][123090] Updated weights for policy 1, policy_version 944424 (0.0008) [2023-12-26 07:11:09,852][123090] Updated weights for policy 1, policy_version 944434 (0.0009) [2023-12-26 07:11:09,922][123090] Updated weights for policy 1, policy_version 944444 (0.0009) [2023-12-26 07:11:10,571][123091] Updated weights for policy 0, policy_version 951317 (0.0009) [2023-12-26 07:11:10,642][123091] Updated weights for policy 0, policy_version 951327 (0.0010) [2023-12-26 07:11:10,666][123090] Updated weights for policy 1, policy_version 944454 (0.0007) [2023-12-26 07:11:10,699][123091] Updated weights for policy 0, policy_version 951337 (0.0008) [2023-12-26 07:11:10,728][123090] Updated weights for policy 1, policy_version 944464 (0.0010) [2023-12-26 07:11:10,782][123090] Updated weights for policy 1, policy_version 944474 (0.0005) [2023-12-26 07:11:11,521][123091] Updated weights for policy 0, policy_version 951347 (0.0008) [2023-12-26 07:11:11,576][123091] Updated weights for policy 0, policy_version 951357 (0.0010) [2023-12-26 07:11:11,621][123090] Updated weights for policy 1, policy_version 944484 (0.0006) [2023-12-26 07:11:11,657][123091] Updated weights for policy 0, policy_version 951367 (0.0008) [2023-12-26 07:11:11,691][123090] Updated weights for policy 1, policy_version 944494 (0.0007) [2023-12-26 07:11:11,766][123090] Updated weights for policy 1, policy_version 944504 (0.0010) [2023-12-26 07:11:12,349][123091] Updated weights for policy 0, policy_version 951377 (0.0009) [2023-12-26 07:11:12,419][123091] Updated weights for policy 0, policy_version 951387 (0.0008) [2023-12-26 07:11:12,476][123091] Updated weights for policy 0, policy_version 951397 (0.0010) [2023-12-26 07:11:12,531][123091] Updated weights for policy 0, policy_version 951407 (0.0010) [2023-12-26 07:11:12,585][123090] Updated weights for policy 1, policy_version 944514 (0.0010) [2023-12-26 07:11:12,644][123090] Updated weights for policy 1, policy_version 944524 (0.0009) [2023-12-26 07:11:12,698][123090] Updated weights for policy 1, policy_version 944535 (0.0010) [2023-12-26 07:11:13,350][123091] Updated weights for policy 0, policy_version 951417 (0.0009) [2023-12-26 07:11:13,410][123091] Updated weights for policy 0, policy_version 951427 (0.0009) [2023-12-26 07:11:13,463][123091] Updated weights for policy 0, policy_version 951438 (0.0010) [2023-12-26 07:11:13,537][123090] Updated weights for policy 1, policy_version 944545 (0.0010) [2023-12-26 07:11:13,609][123090] Updated weights for policy 1, policy_version 944555 (0.0006) [2023-12-26 07:11:13,685][123090] Updated weights for policy 1, policy_version 944565 (0.0005) [2023-12-26 07:11:13,764][123090] Updated weights for policy 1, policy_version 944575 (0.0005) [2023-12-26 07:11:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 485384192. Throughput: 0: 9037.4, 1: 8848.3. Samples: 485374520. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:13,785][121949] Avg episode reward: [(0, '6206.502'), (1, '5417.803')] [2023-12-26 07:11:14,358][123090] Updated weights for policy 1, policy_version 944585 (0.0006) [2023-12-26 07:11:14,364][123091] Updated weights for policy 0, policy_version 951448 (0.0009) [2023-12-26 07:11:14,410][123091] Updated weights for policy 0, policy_version 951458 (0.0008) [2023-12-26 07:11:14,419][123090] Updated weights for policy 1, policy_version 944595 (0.0007) [2023-12-26 07:11:14,459][123091] Updated weights for policy 0, policy_version 951468 (0.0008) [2023-12-26 07:11:14,478][123090] Updated weights for policy 1, policy_version 944605 (0.0005) [2023-12-26 07:11:15,206][123090] Updated weights for policy 1, policy_version 944615 (0.0007) [2023-12-26 07:11:15,280][123090] Updated weights for policy 1, policy_version 944625 (0.0008) [2023-12-26 07:11:15,354][123090] Updated weights for policy 1, policy_version 944635 (0.0008) [2023-12-26 07:11:15,362][123091] Updated weights for policy 0, policy_version 951478 (0.0008) [2023-12-26 07:11:15,436][123091] Updated weights for policy 0, policy_version 951488 (0.0008) [2023-12-26 07:11:15,496][123091] Updated weights for policy 0, policy_version 951498 (0.0010) [2023-12-26 07:11:15,894][123090] Updated weights for policy 1, policy_version 944645 (0.0007) [2023-12-26 07:11:15,952][123090] Updated weights for policy 1, policy_version 944655 (0.0005) [2023-12-26 07:11:16,026][123090] Updated weights for policy 1, policy_version 944665 (0.0005) [2023-12-26 07:11:16,363][123091] Updated weights for policy 0, policy_version 951508 (0.0008) [2023-12-26 07:11:16,410][123091] Updated weights for policy 0, policy_version 951518 (0.0009) [2023-12-26 07:11:16,466][123091] Updated weights for policy 0, policy_version 951528 (0.0009) [2023-12-26 07:11:16,764][123090] Updated weights for policy 1, policy_version 944675 (0.0009) [2023-12-26 07:11:16,826][123090] Updated weights for policy 1, policy_version 944685 (0.0005) [2023-12-26 07:11:16,872][123090] Updated weights for policy 1, policy_version 944695 (0.0005) [2023-12-26 07:11:17,353][123091] Updated weights for policy 0, policy_version 951538 (0.0009) [2023-12-26 07:11:17,410][123091] Updated weights for policy 0, policy_version 951548 (0.0010) [2023-12-26 07:11:17,471][123091] Updated weights for policy 0, policy_version 951558 (0.0009) [2023-12-26 07:11:17,523][123090] Updated weights for policy 1, policy_version 944705 (0.0005) [2023-12-26 07:11:17,543][123091] Updated weights for policy 0, policy_version 951568 (0.0008) [2023-12-26 07:11:17,574][123090] Updated weights for policy 1, policy_version 944715 (0.0005) [2023-12-26 07:11:17,628][123090] Updated weights for policy 1, policy_version 944725 (0.0005) [2023-12-26 07:11:17,674][123090] Updated weights for policy 1, policy_version 944735 (0.0005) [2023-12-26 07:11:18,343][123091] Updated weights for policy 0, policy_version 951578 (0.0010) [2023-12-26 07:11:18,406][123091] Updated weights for policy 0, policy_version 951588 (0.0009) [2023-12-26 07:11:18,461][123090] Updated weights for policy 1, policy_version 944745 (0.0008) [2023-12-26 07:11:18,464][123091] Updated weights for policy 0, policy_version 951598 (0.0007) [2023-12-26 07:11:18,525][123090] Updated weights for policy 1, policy_version 944755 (0.0009) [2023-12-26 07:11:18,593][123090] Updated weights for policy 1, policy_version 944765 (0.0009) [2023-12-26 07:11:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 485474304. Throughput: 0: 8940.8, 1: 8977.3. Samples: 485482848. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:18,785][121949] Avg episode reward: [(0, '6160.560'), (1, '5395.703')] [2023-12-26 07:11:19,321][123091] Updated weights for policy 0, policy_version 951608 (0.0009) [2023-12-26 07:11:19,389][123091] Updated weights for policy 0, policy_version 951618 (0.0009) [2023-12-26 07:11:19,398][123090] Updated weights for policy 1, policy_version 944775 (0.0007) [2023-12-26 07:11:19,448][123091] Updated weights for policy 0, policy_version 951628 (0.0008) [2023-12-26 07:11:19,455][123090] Updated weights for policy 1, policy_version 944785 (0.0007) [2023-12-26 07:11:19,524][123090] Updated weights for policy 1, policy_version 944795 (0.0010) [2023-12-26 07:11:20,260][123091] Updated weights for policy 0, policy_version 951638 (0.0007) [2023-12-26 07:11:20,335][123091] Updated weights for policy 0, policy_version 951648 (0.0008) [2023-12-26 07:11:20,343][123090] Updated weights for policy 1, policy_version 944805 (0.0010) [2023-12-26 07:11:20,403][123091] Updated weights for policy 0, policy_version 951658 (0.0006) [2023-12-26 07:11:20,408][123090] Updated weights for policy 1, policy_version 944815 (0.0008) [2023-12-26 07:11:20,471][123090] Updated weights for policy 1, policy_version 944825 (0.0008) [2023-12-26 07:11:21,147][123091] Updated weights for policy 0, policy_version 951668 (0.0008) [2023-12-26 07:11:21,202][123091] Updated weights for policy 0, policy_version 951678 (0.0006) [2023-12-26 07:11:21,204][123090] Updated weights for policy 1, policy_version 944835 (0.0007) [2023-12-26 07:11:21,264][123091] Updated weights for policy 0, policy_version 951688 (0.0007) [2023-12-26 07:11:21,269][123090] Updated weights for policy 1, policy_version 944845 (0.0011) [2023-12-26 07:11:21,333][123090] Updated weights for policy 1, policy_version 944855 (0.0008) [2023-12-26 07:11:22,057][123091] Updated weights for policy 0, policy_version 951698 (0.0010) [2023-12-26 07:11:22,107][123090] Updated weights for policy 1, policy_version 944865 (0.0007) [2023-12-26 07:11:22,120][123091] Updated weights for policy 0, policy_version 951708 (0.0009) [2023-12-26 07:11:22,172][123090] Updated weights for policy 1, policy_version 944875 (0.0006) [2023-12-26 07:11:22,180][123091] Updated weights for policy 0, policy_version 951718 (0.0008) [2023-12-26 07:11:22,237][123090] Updated weights for policy 1, policy_version 944885 (0.0007) [2023-12-26 07:11:22,246][123091] Updated weights for policy 0, policy_version 951728 (0.0009) [2023-12-26 07:11:22,306][123090] Updated weights for policy 1, policy_version 944895 (0.0008) [2023-12-26 07:11:23,041][123090] Updated weights for policy 1, policy_version 944905 (0.0006) [2023-12-26 07:11:23,105][123091] Updated weights for policy 0, policy_version 951738 (0.0008) [2023-12-26 07:11:23,113][123090] Updated weights for policy 1, policy_version 944915 (0.0008) [2023-12-26 07:11:23,165][123091] Updated weights for policy 0, policy_version 951748 (0.0006) [2023-12-26 07:11:23,183][123090] Updated weights for policy 1, policy_version 944925 (0.0010) [2023-12-26 07:11:23,228][123091] Updated weights for policy 0, policy_version 951758 (0.0010) [2023-12-26 07:11:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 485556224. Throughput: 0: 8872.1, 1: 8985.5. Samples: 485535524. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:23,785][121949] Avg episode reward: [(0, '6195.287'), (1, '5461.923')] [2023-12-26 07:11:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000951760_243654656.pth... [2023-12-26 07:11:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000944928_241901568.pth... [2023-12-26 07:11:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000950736_243392512.pth [2023-12-26 07:11:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000943872_241631232.pth [2023-12-26 07:11:23,997][123090] Updated weights for policy 1, policy_version 944935 (0.0010) [2023-12-26 07:11:24,057][123090] Updated weights for policy 1, policy_version 944945 (0.0010) [2023-12-26 07:11:24,099][123091] Updated weights for policy 0, policy_version 951768 (0.0008) [2023-12-26 07:11:24,119][123090] Updated weights for policy 1, policy_version 944955 (0.0009) [2023-12-26 07:11:24,163][123091] Updated weights for policy 0, policy_version 951778 (0.0009) [2023-12-26 07:11:24,231][123091] Updated weights for policy 0, policy_version 951788 (0.0009) [2023-12-26 07:11:24,874][123090] Updated weights for policy 1, policy_version 944965 (0.0006) [2023-12-26 07:11:24,938][123090] Updated weights for policy 1, policy_version 944975 (0.0005) [2023-12-26 07:11:25,013][123090] Updated weights for policy 1, policy_version 944985 (0.0006) [2023-12-26 07:11:25,034][123091] Updated weights for policy 0, policy_version 951798 (0.0009) [2023-12-26 07:11:25,090][123091] Updated weights for policy 0, policy_version 951808 (0.0010) [2023-12-26 07:11:25,147][123091] Updated weights for policy 0, policy_version 951818 (0.0010) [2023-12-26 07:11:25,654][123090] Updated weights for policy 1, policy_version 944995 (0.0010) [2023-12-26 07:11:25,709][123090] Updated weights for policy 1, policy_version 945005 (0.0009) [2023-12-26 07:11:25,771][123090] Updated weights for policy 1, policy_version 945015 (0.0009) [2023-12-26 07:11:25,969][123091] Updated weights for policy 0, policy_version 951828 (0.0010) [2023-12-26 07:11:26,028][123091] Updated weights for policy 0, policy_version 951838 (0.0009) [2023-12-26 07:11:26,083][123091] Updated weights for policy 0, policy_version 951848 (0.0011) [2023-12-26 07:11:26,481][123090] Updated weights for policy 1, policy_version 945025 (0.0009) [2023-12-26 07:11:26,538][123090] Updated weights for policy 1, policy_version 945035 (0.0005) [2023-12-26 07:11:26,584][123090] Updated weights for policy 1, policy_version 945045 (0.0005) [2023-12-26 07:11:26,629][123090] Updated weights for policy 1, policy_version 945055 (0.0005) [2023-12-26 07:11:26,983][123091] Updated weights for policy 0, policy_version 951858 (0.0008) [2023-12-26 07:11:27,059][123091] Updated weights for policy 0, policy_version 951868 (0.0007) [2023-12-26 07:11:27,133][123091] Updated weights for policy 0, policy_version 951878 (0.0011) [2023-12-26 07:11:27,194][123091] Updated weights for policy 0, policy_version 951888 (0.0010) [2023-12-26 07:11:27,371][123090] Updated weights for policy 1, policy_version 945065 (0.0010) [2023-12-26 07:11:27,433][123090] Updated weights for policy 1, policy_version 945075 (0.0010) [2023-12-26 07:11:27,499][123090] Updated weights for policy 1, policy_version 945085 (0.0010) [2023-12-26 07:11:27,945][123091] Updated weights for policy 0, policy_version 951898 (0.0005) [2023-12-26 07:11:28,005][123091] Updated weights for policy 0, policy_version 951908 (0.0006) [2023-12-26 07:11:28,056][123091] Updated weights for policy 0, policy_version 951918 (0.0010) [2023-12-26 07:11:28,318][123090] Updated weights for policy 1, policy_version 945095 (0.0010) [2023-12-26 07:11:28,391][123090] Updated weights for policy 1, policy_version 945105 (0.0011) [2023-12-26 07:11:28,464][123090] Updated weights for policy 1, policy_version 945115 (0.0006) [2023-12-26 07:11:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17605.9). Total num frames: 485646336. Throughput: 0: 8755.1, 1: 9081.6. Samples: 485642280. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:28,785][121949] Avg episode reward: [(0, '6202.694'), (1, '5450.695')] [2023-12-26 07:11:28,830][123091] Updated weights for policy 0, policy_version 951928 (0.0008) [2023-12-26 07:11:28,883][123091] Updated weights for policy 0, policy_version 951938 (0.0009) [2023-12-26 07:11:28,946][123091] Updated weights for policy 0, policy_version 951948 (0.0009) [2023-12-26 07:11:29,218][123090] Updated weights for policy 1, policy_version 945125 (0.0011) [2023-12-26 07:11:29,285][123090] Updated weights for policy 1, policy_version 945135 (0.0011) [2023-12-26 07:11:29,347][123090] Updated weights for policy 1, policy_version 945145 (0.0011) [2023-12-26 07:11:29,768][123091] Updated weights for policy 0, policy_version 951958 (0.0007) [2023-12-26 07:11:29,817][123091] Updated weights for policy 0, policy_version 951968 (0.0006) [2023-12-26 07:11:29,886][123091] Updated weights for policy 0, policy_version 951978 (0.0007) [2023-12-26 07:11:30,238][123090] Updated weights for policy 1, policy_version 945155 (0.0009) [2023-12-26 07:11:30,301][123090] Updated weights for policy 1, policy_version 945165 (0.0010) [2023-12-26 07:11:30,363][123090] Updated weights for policy 1, policy_version 945175 (0.0009) [2023-12-26 07:11:30,606][123091] Updated weights for policy 0, policy_version 951988 (0.0011) [2023-12-26 07:11:30,660][123091] Updated weights for policy 0, policy_version 951998 (0.0010) [2023-12-26 07:11:30,711][123091] Updated weights for policy 0, policy_version 952008 (0.0010) [2023-12-26 07:11:31,159][123090] Updated weights for policy 1, policy_version 945185 (0.0010) [2023-12-26 07:11:31,219][123090] Updated weights for policy 1, policy_version 945195 (0.0006) [2023-12-26 07:11:31,291][123090] Updated weights for policy 1, policy_version 945205 (0.0009) [2023-12-26 07:11:31,356][123090] Updated weights for policy 1, policy_version 945215 (0.0011) [2023-12-26 07:11:31,524][123091] Updated weights for policy 0, policy_version 952018 (0.0010) [2023-12-26 07:11:31,593][123091] Updated weights for policy 0, policy_version 952028 (0.0009) [2023-12-26 07:11:31,654][123091] Updated weights for policy 0, policy_version 952038 (0.0008) [2023-12-26 07:11:31,714][123091] Updated weights for policy 0, policy_version 952048 (0.0007) [2023-12-26 07:11:32,073][123090] Updated weights for policy 1, policy_version 945225 (0.0005) [2023-12-26 07:11:32,122][123090] Updated weights for policy 1, policy_version 945235 (0.0005) [2023-12-26 07:11:32,167][123090] Updated weights for policy 1, policy_version 945245 (0.0005) [2023-12-26 07:11:32,568][123091] Updated weights for policy 0, policy_version 952058 (0.0009) [2023-12-26 07:11:32,623][123091] Updated weights for policy 0, policy_version 952068 (0.0009) [2023-12-26 07:11:32,672][123091] Updated weights for policy 0, policy_version 952078 (0.0010) [2023-12-26 07:11:32,975][123090] Updated weights for policy 1, policy_version 945255 (0.0009) [2023-12-26 07:11:33,029][123090] Updated weights for policy 1, policy_version 945265 (0.0010) [2023-12-26 07:11:33,080][123090] Updated weights for policy 1, policy_version 945276 (0.0010) [2023-12-26 07:11:33,444][123091] Updated weights for policy 0, policy_version 952088 (0.0009) [2023-12-26 07:11:33,496][123091] Updated weights for policy 0, policy_version 952098 (0.0009) [2023-12-26 07:11:33,558][123091] Updated weights for policy 0, policy_version 952108 (0.0008) [2023-12-26 07:11:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 485736448. Throughput: 0: 8742.2, 1: 9024.9. Samples: 485747752. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:33,784][121949] Avg episode reward: [(0, '6142.179'), (1, '5385.906')] [2023-12-26 07:11:33,912][123090] Updated weights for policy 1, policy_version 945286 (0.0009) [2023-12-26 07:11:33,979][123090] Updated weights for policy 1, policy_version 945296 (0.0007) [2023-12-26 07:11:34,042][123090] Updated weights for policy 1, policy_version 945306 (0.0008) [2023-12-26 07:11:34,362][123091] Updated weights for policy 0, policy_version 952118 (0.0009) [2023-12-26 07:11:34,432][123091] Updated weights for policy 0, policy_version 952128 (0.0009) [2023-12-26 07:11:34,502][123091] Updated weights for policy 0, policy_version 952138 (0.0010) [2023-12-26 07:11:34,758][123090] Updated weights for policy 1, policy_version 945316 (0.0009) [2023-12-26 07:11:34,827][123090] Updated weights for policy 1, policy_version 945326 (0.0009) [2023-12-26 07:11:34,892][123090] Updated weights for policy 1, policy_version 945336 (0.0009) [2023-12-26 07:11:35,346][123091] Updated weights for policy 0, policy_version 952148 (0.0009) [2023-12-26 07:11:35,394][123091] Updated weights for policy 0, policy_version 952158 (0.0005) [2023-12-26 07:11:35,454][123091] Updated weights for policy 0, policy_version 952168 (0.0005) [2023-12-26 07:11:35,723][123090] Updated weights for policy 1, policy_version 945346 (0.0008) [2023-12-26 07:11:35,797][123090] Updated weights for policy 1, policy_version 945356 (0.0006) [2023-12-26 07:11:35,870][123090] Updated weights for policy 1, policy_version 945366 (0.0005) [2023-12-26 07:11:35,935][123090] Updated weights for policy 1, policy_version 945376 (0.0006) [2023-12-26 07:11:36,278][123091] Updated weights for policy 0, policy_version 952178 (0.0006) [2023-12-26 07:11:36,345][123091] Updated weights for policy 0, policy_version 952188 (0.0006) [2023-12-26 07:11:36,413][123091] Updated weights for policy 0, policy_version 952198 (0.0006) [2023-12-26 07:11:36,478][123091] Updated weights for policy 0, policy_version 952208 (0.0006) [2023-12-26 07:11:36,601][123090] Updated weights for policy 1, policy_version 945386 (0.0006) [2023-12-26 07:11:36,662][123090] Updated weights for policy 1, policy_version 945396 (0.0005) [2023-12-26 07:11:36,732][123090] Updated weights for policy 1, policy_version 945406 (0.0008) [2023-12-26 07:11:37,239][123091] Updated weights for policy 0, policy_version 952218 (0.0009) [2023-12-26 07:11:37,292][123091] Updated weights for policy 0, policy_version 952228 (0.0009) [2023-12-26 07:11:37,377][123091] Updated weights for policy 0, policy_version 952238 (0.0009) [2023-12-26 07:11:37,514][123090] Updated weights for policy 1, policy_version 945416 (0.0006) [2023-12-26 07:11:37,582][123090] Updated weights for policy 1, policy_version 945426 (0.0006) [2023-12-26 07:11:37,641][123090] Updated weights for policy 1, policy_version 945436 (0.0010) [2023-12-26 07:11:38,246][123091] Updated weights for policy 0, policy_version 952248 (0.0009) [2023-12-26 07:11:38,306][123091] Updated weights for policy 0, policy_version 952258 (0.0009) [2023-12-26 07:11:38,371][123091] Updated weights for policy 0, policy_version 952268 (0.0010) [2023-12-26 07:11:38,424][123090] Updated weights for policy 1, policy_version 945446 (0.0009) [2023-12-26 07:11:38,485][123090] Updated weights for policy 1, policy_version 945456 (0.0007) [2023-12-26 07:11:38,556][123090] Updated weights for policy 1, policy_version 945466 (0.0011) [2023-12-26 07:11:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 485826560. Throughput: 0: 8726.8, 1: 9070.0. Samples: 485801868. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:38,785][121949] Avg episode reward: [(0, '6104.801'), (1, '5440.814')] [2023-12-26 07:11:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000945472_242040832.pth... [2023-12-26 07:11:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000952272_243785728.pth... [2023-12-26 07:11:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000944416_241770496.pth [2023-12-26 07:11:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000951280_243531776.pth [2023-12-26 07:11:39,225][123091] Updated weights for policy 0, policy_version 952278 (0.0009) [2023-12-26 07:11:39,292][123091] Updated weights for policy 0, policy_version 952288 (0.0009) [2023-12-26 07:11:39,331][123090] Updated weights for policy 1, policy_version 945476 (0.0011) [2023-12-26 07:11:39,364][123091] Updated weights for policy 0, policy_version 952298 (0.0008) [2023-12-26 07:11:39,407][123090] Updated weights for policy 1, policy_version 945486 (0.0010) [2023-12-26 07:11:39,466][123090] Updated weights for policy 1, policy_version 945496 (0.0006) [2023-12-26 07:11:40,133][123091] Updated weights for policy 0, policy_version 952308 (0.0008) [2023-12-26 07:11:40,196][123091] Updated weights for policy 0, policy_version 952318 (0.0008) [2023-12-26 07:11:40,244][123090] Updated weights for policy 1, policy_version 945506 (0.0007) [2023-12-26 07:11:40,257][123091] Updated weights for policy 0, policy_version 952328 (0.0008) [2023-12-26 07:11:40,317][123090] Updated weights for policy 1, policy_version 945516 (0.0007) [2023-12-26 07:11:40,385][123090] Updated weights for policy 1, policy_version 945526 (0.0010) [2023-12-26 07:11:40,451][123090] Updated weights for policy 1, policy_version 945536 (0.0009) [2023-12-26 07:11:41,004][123091] Updated weights for policy 0, policy_version 952338 (0.0006) [2023-12-26 07:11:41,077][123091] Updated weights for policy 0, policy_version 952348 (0.0007) [2023-12-26 07:11:41,154][123091] Updated weights for policy 0, policy_version 952358 (0.0008) [2023-12-26 07:11:41,208][123091] Updated weights for policy 0, policy_version 952368 (0.0009) [2023-12-26 07:11:41,313][123090] Updated weights for policy 1, policy_version 945546 (0.0008) [2023-12-26 07:11:41,388][123090] Updated weights for policy 1, policy_version 945556 (0.0009) [2023-12-26 07:11:41,460][123090] Updated weights for policy 1, policy_version 945566 (0.0010) [2023-12-26 07:11:42,060][123091] Updated weights for policy 0, policy_version 952378 (0.0010) [2023-12-26 07:11:42,116][123091] Updated weights for policy 0, policy_version 952389 (0.0011) [2023-12-26 07:11:42,169][123091] Updated weights for policy 0, policy_version 952399 (0.0010) [2023-12-26 07:11:42,293][123090] Updated weights for policy 1, policy_version 945576 (0.0009) [2023-12-26 07:11:42,355][123090] Updated weights for policy 1, policy_version 945586 (0.0009) [2023-12-26 07:11:42,417][123090] Updated weights for policy 1, policy_version 945596 (0.0009) [2023-12-26 07:11:43,031][123091] Updated weights for policy 0, policy_version 952409 (0.0009) [2023-12-26 07:11:43,091][123091] Updated weights for policy 0, policy_version 952419 (0.0009) [2023-12-26 07:11:43,142][123091] Updated weights for policy 0, policy_version 952429 (0.0009) [2023-12-26 07:11:43,259][123090] Updated weights for policy 1, policy_version 945606 (0.0010) [2023-12-26 07:11:43,322][123090] Updated weights for policy 1, policy_version 945616 (0.0009) [2023-12-26 07:11:43,380][123090] Updated weights for policy 1, policy_version 945626 (0.0009) [2023-12-26 07:11:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 485908480. Throughput: 0: 8636.4, 1: 9031.8. Samples: 485903700. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:43,785][121949] Avg episode reward: [(0, '6167.129'), (1, '5271.130')] [2023-12-26 07:11:43,907][123091] Updated weights for policy 0, policy_version 952439 (0.0007) [2023-12-26 07:11:43,959][123091] Updated weights for policy 0, policy_version 952449 (0.0005) [2023-12-26 07:11:44,005][123091] Updated weights for policy 0, policy_version 952459 (0.0005) [2023-12-26 07:11:44,273][123090] Updated weights for policy 1, policy_version 945636 (0.0010) [2023-12-26 07:11:44,330][123090] Updated weights for policy 1, policy_version 945646 (0.0013) [2023-12-26 07:11:44,387][123090] Updated weights for policy 1, policy_version 945656 (0.0009) [2023-12-26 07:11:44,737][123091] Updated weights for policy 0, policy_version 952469 (0.0005) [2023-12-26 07:11:44,796][123091] Updated weights for policy 0, policy_version 952479 (0.0008) [2023-12-26 07:11:44,852][123091] Updated weights for policy 0, policy_version 952489 (0.0008) [2023-12-26 07:11:45,299][123090] Updated weights for policy 1, policy_version 945666 (0.0009) [2023-12-26 07:11:45,365][123090] Updated weights for policy 1, policy_version 945676 (0.0010) [2023-12-26 07:11:45,431][123090] Updated weights for policy 1, policy_version 945686 (0.0008) [2023-12-26 07:11:45,496][123090] Updated weights for policy 1, policy_version 945696 (0.0010) [2023-12-26 07:11:45,650][123091] Updated weights for policy 0, policy_version 952499 (0.0008) [2023-12-26 07:11:45,700][123091] Updated weights for policy 0, policy_version 952509 (0.0008) [2023-12-26 07:11:45,749][123091] Updated weights for policy 0, policy_version 952519 (0.0009) [2023-12-26 07:11:46,338][123090] Updated weights for policy 1, policy_version 945706 (0.0008) [2023-12-26 07:11:46,390][123090] Updated weights for policy 1, policy_version 945716 (0.0009) [2023-12-26 07:11:46,442][123090] Updated weights for policy 1, policy_version 945726 (0.0008) [2023-12-26 07:11:46,571][123091] Updated weights for policy 0, policy_version 952530 (0.0009) [2023-12-26 07:11:46,637][123091] Updated weights for policy 0, policy_version 952540 (0.0008) [2023-12-26 07:11:46,699][123091] Updated weights for policy 0, policy_version 952550 (0.0010) [2023-12-26 07:11:46,746][123091] Updated weights for policy 0, policy_version 952560 (0.0009) [2023-12-26 07:11:47,206][123090] Updated weights for policy 1, policy_version 945736 (0.0008) [2023-12-26 07:11:47,270][123090] Updated weights for policy 1, policy_version 945746 (0.0005) [2023-12-26 07:11:47,337][123090] Updated weights for policy 1, policy_version 945756 (0.0005) [2023-12-26 07:11:47,597][123091] Updated weights for policy 0, policy_version 952570 (0.0010) [2023-12-26 07:11:47,650][123091] Updated weights for policy 0, policy_version 952580 (0.0010) [2023-12-26 07:11:47,706][123091] Updated weights for policy 0, policy_version 952590 (0.0009) [2023-12-26 07:11:48,069][123090] Updated weights for policy 1, policy_version 945766 (0.0008) [2023-12-26 07:11:48,121][123090] Updated weights for policy 1, policy_version 945776 (0.0009) [2023-12-26 07:11:48,180][123090] Updated weights for policy 1, policy_version 945786 (0.0010) [2023-12-26 07:11:48,567][123091] Updated weights for policy 0, policy_version 952600 (0.0009) [2023-12-26 07:11:48,621][123091] Updated weights for policy 0, policy_version 952611 (0.0009) [2023-12-26 07:11:48,671][123091] Updated weights for policy 0, policy_version 952621 (0.0009) [2023-12-26 07:11:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 485998592. Throughput: 0: 8627.6, 1: 8972.1. Samples: 486007772. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:48,785][121949] Avg episode reward: [(0, '6219.884'), (1, '5291.584')] [2023-12-26 07:11:49,008][123090] Updated weights for policy 1, policy_version 945796 (0.0010) [2023-12-26 07:11:49,077][123090] Updated weights for policy 1, policy_version 945806 (0.0010) [2023-12-26 07:11:49,140][123090] Updated weights for policy 1, policy_version 945816 (0.0010) [2023-12-26 07:11:49,542][123091] Updated weights for policy 0, policy_version 952631 (0.0009) [2023-12-26 07:11:49,602][123091] Updated weights for policy 0, policy_version 952641 (0.0010) [2023-12-26 07:11:49,668][123091] Updated weights for policy 0, policy_version 952651 (0.0008) [2023-12-26 07:11:49,935][123090] Updated weights for policy 1, policy_version 945826 (0.0010) [2023-12-26 07:11:49,994][123090] Updated weights for policy 1, policy_version 945836 (0.0008) [2023-12-26 07:11:50,047][123090] Updated weights for policy 1, policy_version 945846 (0.0008) [2023-12-26 07:11:50,121][123090] Updated weights for policy 1, policy_version 945856 (0.0008) [2023-12-26 07:11:50,547][123091] Updated weights for policy 0, policy_version 952661 (0.0009) [2023-12-26 07:11:50,614][123091] Updated weights for policy 0, policy_version 952671 (0.0009) [2023-12-26 07:11:50,683][123091] Updated weights for policy 0, policy_version 952681 (0.0009) [2023-12-26 07:11:50,877][123090] Updated weights for policy 1, policy_version 945866 (0.0008) [2023-12-26 07:11:50,921][123090] Updated weights for policy 1, policy_version 945876 (0.0008) [2023-12-26 07:11:50,969][123090] Updated weights for policy 1, policy_version 945886 (0.0008) [2023-12-26 07:11:51,614][123091] Updated weights for policy 0, policy_version 952691 (0.0009) [2023-12-26 07:11:51,681][123091] Updated weights for policy 0, policy_version 952701 (0.0009) [2023-12-26 07:11:51,766][123091] Updated weights for policy 0, policy_version 952711 (0.0010) [2023-12-26 07:11:51,891][123090] Updated weights for policy 1, policy_version 945896 (0.0009) [2023-12-26 07:11:51,948][123090] Updated weights for policy 1, policy_version 945906 (0.0009) [2023-12-26 07:11:52,012][123090] Updated weights for policy 1, policy_version 945916 (0.0009) [2023-12-26 07:11:52,395][123091] Updated weights for policy 0, policy_version 952721 (0.0009) [2023-12-26 07:11:52,466][123091] Updated weights for policy 0, policy_version 952731 (0.0008) [2023-12-26 07:11:52,520][123091] Updated weights for policy 0, policy_version 952741 (0.0009) [2023-12-26 07:11:52,575][123091] Updated weights for policy 0, policy_version 952751 (0.0009) [2023-12-26 07:11:52,890][123090] Updated weights for policy 1, policy_version 945926 (0.0009) [2023-12-26 07:11:52,947][123090] Updated weights for policy 1, policy_version 945936 (0.0009) [2023-12-26 07:11:53,014][123090] Updated weights for policy 1, policy_version 945946 (0.0009) [2023-12-26 07:11:53,411][123091] Updated weights for policy 0, policy_version 952761 (0.0009) [2023-12-26 07:11:53,466][123091] Updated weights for policy 0, policy_version 952771 (0.0012) [2023-12-26 07:11:53,525][123091] Updated weights for policy 0, policy_version 952781 (0.0010) [2023-12-26 07:11:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 486080512. Throughput: 0: 8599.4, 1: 8966.9. Samples: 486058288. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:53,785][121949] Avg episode reward: [(0, '6291.560'), (1, '5361.889')] [2023-12-26 07:11:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000952784_243916800.pth... [2023-12-26 07:11:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000951760_243654656.pth [2023-12-26 07:11:53,818][123090] Updated weights for policy 1, policy_version 945956 (0.0009) [2023-12-26 07:11:53,890][123090] Updated weights for policy 1, policy_version 945966 (0.0008) [2023-12-26 07:11:53,954][123090] Updated weights for policy 1, policy_version 945976 (0.0008) [2023-12-26 07:11:54,001][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000945984_242171904.pth... [2023-12-26 07:11:54,006][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000944928_241901568.pth [2023-12-26 07:11:54,330][123091] Updated weights for policy 0, policy_version 952791 (0.0007) [2023-12-26 07:11:54,381][123091] Updated weights for policy 0, policy_version 952801 (0.0005) [2023-12-26 07:11:54,426][123091] Updated weights for policy 0, policy_version 952811 (0.0005) [2023-12-26 07:11:54,663][123090] Updated weights for policy 1, policy_version 945986 (0.0008) [2023-12-26 07:11:54,720][123090] Updated weights for policy 1, policy_version 945996 (0.0009) [2023-12-26 07:11:54,771][123090] Updated weights for policy 1, policy_version 946006 (0.0008) [2023-12-26 07:11:54,820][123090] Updated weights for policy 1, policy_version 946016 (0.0009) [2023-12-26 07:11:55,232][123091] Updated weights for policy 0, policy_version 952821 (0.0009) [2023-12-26 07:11:55,286][123091] Updated weights for policy 0, policy_version 952831 (0.0009) [2023-12-26 07:11:55,353][123091] Updated weights for policy 0, policy_version 952841 (0.0009) [2023-12-26 07:11:55,624][123090] Updated weights for policy 1, policy_version 946026 (0.0009) [2023-12-26 07:11:55,672][123090] Updated weights for policy 1, policy_version 946036 (0.0009) [2023-12-26 07:11:55,735][123090] Updated weights for policy 1, policy_version 946046 (0.0005) [2023-12-26 07:11:56,155][123091] Updated weights for policy 0, policy_version 952851 (0.0011) [2023-12-26 07:11:56,205][123091] Updated weights for policy 0, policy_version 952861 (0.0010) [2023-12-26 07:11:56,270][123091] Updated weights for policy 0, policy_version 952871 (0.0011) [2023-12-26 07:11:56,545][123090] Updated weights for policy 1, policy_version 946056 (0.0009) [2023-12-26 07:11:56,602][123090] Updated weights for policy 1, policy_version 946066 (0.0008) [2023-12-26 07:11:56,651][123090] Updated weights for policy 1, policy_version 946076 (0.0009) [2023-12-26 07:11:57,100][123091] Updated weights for policy 0, policy_version 952881 (0.0010) [2023-12-26 07:11:57,153][123091] Updated weights for policy 0, policy_version 952891 (0.0010) [2023-12-26 07:11:57,200][123091] Updated weights for policy 0, policy_version 952901 (0.0010) [2023-12-26 07:11:57,255][123091] Updated weights for policy 0, policy_version 952911 (0.0010) [2023-12-26 07:11:57,404][123090] Updated weights for policy 1, policy_version 946086 (0.0006) [2023-12-26 07:11:57,453][123090] Updated weights for policy 1, policy_version 946096 (0.0005) [2023-12-26 07:11:57,517][123090] Updated weights for policy 1, policy_version 946106 (0.0005) [2023-12-26 07:11:57,986][123091] Updated weights for policy 0, policy_version 952921 (0.0010) [2023-12-26 07:11:58,057][123091] Updated weights for policy 0, policy_version 952931 (0.0008) [2023-12-26 07:11:58,109][123091] Updated weights for policy 0, policy_version 952941 (0.0008) [2023-12-26 07:11:58,210][123090] Updated weights for policy 1, policy_version 946116 (0.0007) [2023-12-26 07:11:58,269][123090] Updated weights for policy 1, policy_version 946126 (0.0009) [2023-12-26 07:11:58,326][123090] Updated weights for policy 1, policy_version 946136 (0.0009) [2023-12-26 07:11:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 486170624. Throughput: 0: 8608.0, 1: 8950.2. Samples: 486164640. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:11:58,785][121949] Avg episode reward: [(0, '6265.479'), (1, '5561.515')] [2023-12-26 07:11:58,932][123091] Updated weights for policy 0, policy_version 952951 (0.0010) [2023-12-26 07:11:58,998][123091] Updated weights for policy 0, policy_version 952961 (0.0011) [2023-12-26 07:11:59,062][123091] Updated weights for policy 0, policy_version 952971 (0.0011) [2023-12-26 07:11:59,252][123090] Updated weights for policy 1, policy_version 946146 (0.0010) [2023-12-26 07:11:59,322][123090] Updated weights for policy 1, policy_version 946156 (0.0009) [2023-12-26 07:11:59,388][123090] Updated weights for policy 1, policy_version 946166 (0.0011) [2023-12-26 07:11:59,455][123090] Updated weights for policy 1, policy_version 946176 (0.0011) [2023-12-26 07:11:59,888][123091] Updated weights for policy 0, policy_version 952981 (0.0009) [2023-12-26 07:11:59,954][123091] Updated weights for policy 0, policy_version 952991 (0.0008) [2023-12-26 07:12:00,019][123091] Updated weights for policy 0, policy_version 953001 (0.0008) [2023-12-26 07:12:00,284][123090] Updated weights for policy 1, policy_version 946186 (0.0006) [2023-12-26 07:12:00,356][123090] Updated weights for policy 1, policy_version 946196 (0.0009) [2023-12-26 07:12:00,422][123090] Updated weights for policy 1, policy_version 946206 (0.0010) [2023-12-26 07:12:00,743][123091] Updated weights for policy 0, policy_version 953011 (0.0009) [2023-12-26 07:12:00,791][123091] Updated weights for policy 0, policy_version 953021 (0.0005) [2023-12-26 07:12:00,841][123091] Updated weights for policy 0, policy_version 953031 (0.0005) [2023-12-26 07:12:01,119][123090] Updated weights for policy 1, policy_version 946216 (0.0007) [2023-12-26 07:12:01,184][123090] Updated weights for policy 1, policy_version 946226 (0.0009) [2023-12-26 07:12:01,243][123090] Updated weights for policy 1, policy_version 946236 (0.0010) [2023-12-26 07:12:01,483][123091] Updated weights for policy 0, policy_version 953041 (0.0006) [2023-12-26 07:12:01,530][123091] Updated weights for policy 0, policy_version 953051 (0.0010) [2023-12-26 07:12:01,581][123091] Updated weights for policy 0, policy_version 953061 (0.0010) [2023-12-26 07:12:01,640][123091] Updated weights for policy 0, policy_version 953071 (0.0011) [2023-12-26 07:12:02,044][123090] Updated weights for policy 1, policy_version 946246 (0.0010) [2023-12-26 07:12:02,108][123090] Updated weights for policy 1, policy_version 946256 (0.0009) [2023-12-26 07:12:02,181][123090] Updated weights for policy 1, policy_version 946266 (0.0009) [2023-12-26 07:12:02,416][123091] Updated weights for policy 0, policy_version 953081 (0.0010) [2023-12-26 07:12:02,473][123091] Updated weights for policy 0, policy_version 953091 (0.0010) [2023-12-26 07:12:02,524][123091] Updated weights for policy 0, policy_version 953101 (0.0009) [2023-12-26 07:12:02,998][123090] Updated weights for policy 1, policy_version 946276 (0.0010) [2023-12-26 07:12:03,070][123090] Updated weights for policy 1, policy_version 946286 (0.0008) [2023-12-26 07:12:03,137][123090] Updated weights for policy 1, policy_version 946296 (0.0009) [2023-12-26 07:12:03,374][123091] Updated weights for policy 0, policy_version 953111 (0.0009) [2023-12-26 07:12:03,432][123091] Updated weights for policy 0, policy_version 953121 (0.0009) [2023-12-26 07:12:03,500][123091] Updated weights for policy 0, policy_version 953131 (0.0009) [2023-12-26 07:12:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 486260736. Throughput: 0: 8708.5, 1: 8814.2. Samples: 486271372. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:03,785][121949] Avg episode reward: [(0, '6209.281'), (1, '5566.214')] [2023-12-26 07:12:03,939][123090] Updated weights for policy 1, policy_version 946306 (0.0009) [2023-12-26 07:12:04,008][123090] Updated weights for policy 1, policy_version 946316 (0.0009) [2023-12-26 07:12:04,082][123090] Updated weights for policy 1, policy_version 946326 (0.0010) [2023-12-26 07:12:04,153][123090] Updated weights for policy 1, policy_version 946336 (0.0009) [2023-12-26 07:12:04,346][123091] Updated weights for policy 0, policy_version 953141 (0.0009) [2023-12-26 07:12:04,411][123091] Updated weights for policy 0, policy_version 953151 (0.0009) [2023-12-26 07:12:04,471][123091] Updated weights for policy 0, policy_version 953161 (0.0009) [2023-12-26 07:12:04,927][123090] Updated weights for policy 1, policy_version 946346 (0.0008) [2023-12-26 07:12:04,977][123090] Updated weights for policy 1, policy_version 946356 (0.0005) [2023-12-26 07:12:05,029][123090] Updated weights for policy 1, policy_version 946366 (0.0006) [2023-12-26 07:12:05,366][123091] Updated weights for policy 0, policy_version 953171 (0.0010) [2023-12-26 07:12:05,433][123091] Updated weights for policy 0, policy_version 953181 (0.0010) [2023-12-26 07:12:05,497][123091] Updated weights for policy 0, policy_version 953191 (0.0006) [2023-12-26 07:12:05,674][123090] Updated weights for policy 1, policy_version 946376 (0.0009) [2023-12-26 07:12:05,731][123090] Updated weights for policy 1, policy_version 946386 (0.0009) [2023-12-26 07:12:05,801][123090] Updated weights for policy 1, policy_version 946396 (0.0010) [2023-12-26 07:12:06,339][123091] Updated weights for policy 0, policy_version 953201 (0.0009) [2023-12-26 07:12:06,402][123091] Updated weights for policy 0, policy_version 953211 (0.0010) [2023-12-26 07:12:06,461][123091] Updated weights for policy 0, policy_version 953221 (0.0010) [2023-12-26 07:12:06,521][123091] Updated weights for policy 0, policy_version 953231 (0.0010) [2023-12-26 07:12:06,566][123090] Updated weights for policy 1, policy_version 946406 (0.0010) [2023-12-26 07:12:06,633][123090] Updated weights for policy 1, policy_version 946416 (0.0009) [2023-12-26 07:12:06,696][123090] Updated weights for policy 1, policy_version 946426 (0.0009) [2023-12-26 07:12:07,365][123091] Updated weights for policy 0, policy_version 953241 (0.0009) [2023-12-26 07:12:07,425][123091] Updated weights for policy 0, policy_version 953251 (0.0009) [2023-12-26 07:12:07,493][123091] Updated weights for policy 0, policy_version 953261 (0.0010) [2023-12-26 07:12:07,514][123090] Updated weights for policy 1, policy_version 946436 (0.0006) [2023-12-26 07:12:07,572][123090] Updated weights for policy 1, policy_version 946446 (0.0009) [2023-12-26 07:12:07,632][123090] Updated weights for policy 1, policy_version 946456 (0.0009) [2023-12-26 07:12:08,282][123091] Updated weights for policy 0, policy_version 953271 (0.0010) [2023-12-26 07:12:08,332][123090] Updated weights for policy 1, policy_version 946466 (0.0010) [2023-12-26 07:12:08,343][123091] Updated weights for policy 0, policy_version 953281 (0.0009) [2023-12-26 07:12:08,391][123090] Updated weights for policy 1, policy_version 946476 (0.0008) [2023-12-26 07:12:08,416][123091] Updated weights for policy 0, policy_version 953291 (0.0007) [2023-12-26 07:12:08,443][123090] Updated weights for policy 1, policy_version 946486 (0.0008) [2023-12-26 07:12:08,510][123090] Updated weights for policy 1, policy_version 946496 (0.0008) [2023-12-26 07:12:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 486350848. Throughput: 0: 8673.1, 1: 8847.0. Samples: 486323928. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:08,785][121949] Avg episode reward: [(0, '6133.230'), (1, '5498.133')] [2023-12-26 07:12:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000953296_244047872.pth... [2023-12-26 07:12:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000946496_242302976.pth... [2023-12-26 07:12:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000952272_243785728.pth [2023-12-26 07:12:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000945472_242040832.pth [2023-12-26 07:12:09,233][123091] Updated weights for policy 0, policy_version 953301 (0.0008) [2023-12-26 07:12:09,301][123091] Updated weights for policy 0, policy_version 953311 (0.0011) [2023-12-26 07:12:09,333][123090] Updated weights for policy 1, policy_version 946506 (0.0006) [2023-12-26 07:12:09,370][123091] Updated weights for policy 0, policy_version 953321 (0.0011) [2023-12-26 07:12:09,409][123090] Updated weights for policy 1, policy_version 946516 (0.0012) [2023-12-26 07:12:09,466][123090] Updated weights for policy 1, policy_version 946526 (0.0007) [2023-12-26 07:12:10,112][123091] Updated weights for policy 0, policy_version 953331 (0.0009) [2023-12-26 07:12:10,184][123091] Updated weights for policy 0, policy_version 953341 (0.0009) [2023-12-26 07:12:10,247][123091] Updated weights for policy 0, policy_version 953351 (0.0009) [2023-12-26 07:12:10,281][123090] Updated weights for policy 1, policy_version 946536 (0.0010) [2023-12-26 07:12:10,352][123090] Updated weights for policy 1, policy_version 946546 (0.0011) [2023-12-26 07:12:10,419][123090] Updated weights for policy 1, policy_version 946556 (0.0011) [2023-12-26 07:12:11,032][123091] Updated weights for policy 0, policy_version 953361 (0.0008) [2023-12-26 07:12:11,104][123091] Updated weights for policy 0, policy_version 953371 (0.0009) [2023-12-26 07:12:11,170][123091] Updated weights for policy 0, policy_version 953381 (0.0009) [2023-12-26 07:12:11,220][123090] Updated weights for policy 1, policy_version 946566 (0.0009) [2023-12-26 07:12:11,240][123091] Updated weights for policy 0, policy_version 953391 (0.0007) [2023-12-26 07:12:11,288][123090] Updated weights for policy 1, policy_version 946576 (0.0011) [2023-12-26 07:12:11,360][123090] Updated weights for policy 1, policy_version 946586 (0.0009) [2023-12-26 07:12:12,100][123091] Updated weights for policy 0, policy_version 953401 (0.0009) [2023-12-26 07:12:12,174][123091] Updated weights for policy 0, policy_version 953411 (0.0009) [2023-12-26 07:12:12,192][123090] Updated weights for policy 1, policy_version 946596 (0.0009) [2023-12-26 07:12:12,232][123091] Updated weights for policy 0, policy_version 953421 (0.0009) [2023-12-26 07:12:12,256][123090] Updated weights for policy 1, policy_version 946606 (0.0009) [2023-12-26 07:12:12,324][123090] Updated weights for policy 1, policy_version 946616 (0.0009) [2023-12-26 07:12:13,052][123091] Updated weights for policy 0, policy_version 953431 (0.0008) [2023-12-26 07:12:13,099][123091] Updated weights for policy 0, policy_version 953441 (0.0010) [2023-12-26 07:12:13,120][123090] Updated weights for policy 1, policy_version 946626 (0.0009) [2023-12-26 07:12:13,147][123091] Updated weights for policy 0, policy_version 953451 (0.0010) [2023-12-26 07:12:13,168][123090] Updated weights for policy 1, policy_version 946636 (0.0005) [2023-12-26 07:12:13,225][123090] Updated weights for policy 1, policy_version 946646 (0.0005) [2023-12-26 07:12:13,280][123090] Updated weights for policy 1, policy_version 946656 (0.0005) [2023-12-26 07:12:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 486432768. Throughput: 0: 8706.2, 1: 8744.3. Samples: 486427556. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:13,785][121949] Avg episode reward: [(0, '6230.683'), (1, '5605.042')] [2023-12-26 07:12:13,939][123091] Updated weights for policy 0, policy_version 953461 (0.0011) [2023-12-26 07:12:13,981][123090] Updated weights for policy 1, policy_version 946666 (0.0005) [2023-12-26 07:12:13,997][123091] Updated weights for policy 0, policy_version 953471 (0.0008) [2023-12-26 07:12:14,047][123091] Updated weights for policy 0, policy_version 953481 (0.0006) [2023-12-26 07:12:14,048][123090] Updated weights for policy 1, policy_version 946676 (0.0005) [2023-12-26 07:12:14,120][123090] Updated weights for policy 1, policy_version 946686 (0.0005) [2023-12-26 07:12:14,731][123091] Updated weights for policy 0, policy_version 953491 (0.0005) [2023-12-26 07:12:14,744][123090] Updated weights for policy 1, policy_version 946696 (0.0005) [2023-12-26 07:12:14,794][123091] Updated weights for policy 0, policy_version 953501 (0.0007) [2023-12-26 07:12:14,810][123090] Updated weights for policy 1, policy_version 946706 (0.0005) [2023-12-26 07:12:14,844][123091] Updated weights for policy 0, policy_version 953511 (0.0009) [2023-12-26 07:12:14,864][123090] Updated weights for policy 1, policy_version 946716 (0.0006) [2023-12-26 07:12:15,550][123090] Updated weights for policy 1, policy_version 946726 (0.0006) [2023-12-26 07:12:15,606][123090] Updated weights for policy 1, policy_version 946736 (0.0005) [2023-12-26 07:12:15,673][123090] Updated weights for policy 1, policy_version 946746 (0.0006) [2023-12-26 07:12:15,772][123091] Updated weights for policy 0, policy_version 953521 (0.0010) [2023-12-26 07:12:15,831][123091] Updated weights for policy 0, policy_version 953531 (0.0008) [2023-12-26 07:12:15,885][123091] Updated weights for policy 0, policy_version 953542 (0.0010) [2023-12-26 07:12:15,956][123091] Updated weights for policy 0, policy_version 953552 (0.0010) [2023-12-26 07:12:16,392][123090] Updated weights for policy 1, policy_version 946756 (0.0011) [2023-12-26 07:12:16,451][123090] Updated weights for policy 1, policy_version 946766 (0.0011) [2023-12-26 07:12:16,504][123090] Updated weights for policy 1, policy_version 946776 (0.0010) [2023-12-26 07:12:16,807][123091] Updated weights for policy 0, policy_version 953562 (0.0010) [2023-12-26 07:12:16,858][123091] Updated weights for policy 0, policy_version 953572 (0.0010) [2023-12-26 07:12:16,916][123091] Updated weights for policy 0, policy_version 953582 (0.0009) [2023-12-26 07:12:17,286][123090] Updated weights for policy 1, policy_version 946786 (0.0009) [2023-12-26 07:12:17,336][123090] Updated weights for policy 1, policy_version 946796 (0.0006) [2023-12-26 07:12:17,387][123090] Updated weights for policy 1, policy_version 946806 (0.0006) [2023-12-26 07:12:17,432][123090] Updated weights for policy 1, policy_version 946816 (0.0005) [2023-12-26 07:12:17,765][123091] Updated weights for policy 0, policy_version 953592 (0.0006) [2023-12-26 07:12:17,819][123091] Updated weights for policy 0, policy_version 953602 (0.0005) [2023-12-26 07:12:17,874][123091] Updated weights for policy 0, policy_version 953612 (0.0005) [2023-12-26 07:12:18,152][123090] Updated weights for policy 1, policy_version 946826 (0.0005) [2023-12-26 07:12:18,215][123090] Updated weights for policy 1, policy_version 946836 (0.0005) [2023-12-26 07:12:18,272][123090] Updated weights for policy 1, policy_version 946846 (0.0006) [2023-12-26 07:12:18,604][123091] Updated weights for policy 0, policy_version 953622 (0.0008) [2023-12-26 07:12:18,666][123091] Updated weights for policy 0, policy_version 953632 (0.0009) [2023-12-26 07:12:18,728][123091] Updated weights for policy 0, policy_version 953642 (0.0008) [2023-12-26 07:12:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 486531072. Throughput: 0: 8703.9, 1: 8899.4. Samples: 486539900. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:18,784][121949] Avg episode reward: [(0, '6206.414'), (1, '5656.386')] [2023-12-26 07:12:19,013][123090] Updated weights for policy 1, policy_version 946856 (0.0010) [2023-12-26 07:12:19,076][123090] Updated weights for policy 1, policy_version 946866 (0.0010) [2023-12-26 07:12:19,128][123090] Updated weights for policy 1, policy_version 946876 (0.0010) [2023-12-26 07:12:19,564][123091] Updated weights for policy 0, policy_version 953652 (0.0009) [2023-12-26 07:12:19,631][123091] Updated weights for policy 0, policy_version 953662 (0.0010) [2023-12-26 07:12:19,702][123091] Updated weights for policy 0, policy_version 953672 (0.0009) [2023-12-26 07:12:19,997][123090] Updated weights for policy 1, policy_version 946886 (0.0009) [2023-12-26 07:12:20,050][123090] Updated weights for policy 1, policy_version 946896 (0.0008) [2023-12-26 07:12:20,098][123090] Updated weights for policy 1, policy_version 946906 (0.0008) [2023-12-26 07:12:20,461][123091] Updated weights for policy 0, policy_version 953682 (0.0010) [2023-12-26 07:12:20,530][123091] Updated weights for policy 0, policy_version 953692 (0.0006) [2023-12-26 07:12:20,600][123091] Updated weights for policy 0, policy_version 953702 (0.0011) [2023-12-26 07:12:20,661][123091] Updated weights for policy 0, policy_version 953712 (0.0007) [2023-12-26 07:12:20,908][123090] Updated weights for policy 1, policy_version 946916 (0.0009) [2023-12-26 07:12:20,969][123090] Updated weights for policy 1, policy_version 946926 (0.0010) [2023-12-26 07:12:21,026][123090] Updated weights for policy 1, policy_version 946936 (0.0010) [2023-12-26 07:12:21,429][123091] Updated weights for policy 0, policy_version 953722 (0.0009) [2023-12-26 07:12:21,486][123091] Updated weights for policy 0, policy_version 953732 (0.0009) [2023-12-26 07:12:21,536][123091] Updated weights for policy 0, policy_version 953742 (0.0009) [2023-12-26 07:12:21,916][123090] Updated weights for policy 1, policy_version 946946 (0.0010) [2023-12-26 07:12:21,982][123090] Updated weights for policy 1, policy_version 946956 (0.0009) [2023-12-26 07:12:22,051][123090] Updated weights for policy 1, policy_version 946966 (0.0006) [2023-12-26 07:12:22,119][123090] Updated weights for policy 1, policy_version 946976 (0.0006) [2023-12-26 07:12:22,475][123091] Updated weights for policy 0, policy_version 953752 (0.0010) [2023-12-26 07:12:22,540][123091] Updated weights for policy 0, policy_version 953762 (0.0010) [2023-12-26 07:12:22,602][123091] Updated weights for policy 0, policy_version 953772 (0.0009) [2023-12-26 07:12:22,837][123090] Updated weights for policy 1, policy_version 946986 (0.0005) [2023-12-26 07:12:22,903][123090] Updated weights for policy 1, policy_version 946996 (0.0005) [2023-12-26 07:12:22,976][123090] Updated weights for policy 1, policy_version 947006 (0.0006) [2023-12-26 07:12:23,458][123091] Updated weights for policy 0, policy_version 953782 (0.0010) [2023-12-26 07:12:23,525][123091] Updated weights for policy 0, policy_version 953792 (0.0010) [2023-12-26 07:12:23,580][123091] Updated weights for policy 0, policy_version 953802 (0.0010) [2023-12-26 07:12:23,693][123090] Updated weights for policy 1, policy_version 947016 (0.0009) [2023-12-26 07:12:23,751][123090] Updated weights for policy 1, policy_version 947026 (0.0009) [2023-12-26 07:12:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 486612992. Throughput: 0: 8694.3, 1: 8850.7. Samples: 486591392. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:23,785][121949] Avg episode reward: [(0, '6207.976'), (1, '5515.036')] [2023-12-26 07:12:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000953808_244178944.pth... [2023-12-26 07:12:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000952784_243916800.pth [2023-12-26 07:12:23,812][123090] Updated weights for policy 1, policy_version 947036 (0.0009) [2023-12-26 07:12:23,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000947040_242442240.pth... [2023-12-26 07:12:23,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000945984_242171904.pth [2023-12-26 07:12:24,508][123091] Updated weights for policy 0, policy_version 953812 (0.0009) [2023-12-26 07:12:24,561][123091] Updated weights for policy 0, policy_version 953822 (0.0010) [2023-12-26 07:12:24,613][123090] Updated weights for policy 1, policy_version 947046 (0.0008) [2023-12-26 07:12:24,617][123091] Updated weights for policy 0, policy_version 953832 (0.0009) [2023-12-26 07:12:24,663][123090] Updated weights for policy 1, policy_version 947056 (0.0007) [2023-12-26 07:12:24,712][123090] Updated weights for policy 1, policy_version 947066 (0.0009) [2023-12-26 07:12:25,486][123091] Updated weights for policy 0, policy_version 953842 (0.0009) [2023-12-26 07:12:25,511][123090] Updated weights for policy 1, policy_version 947076 (0.0008) [2023-12-26 07:12:25,536][123091] Updated weights for policy 0, policy_version 953852 (0.0007) [2023-12-26 07:12:25,577][123090] Updated weights for policy 1, policy_version 947086 (0.0008) [2023-12-26 07:12:25,604][123091] Updated weights for policy 0, policy_version 953862 (0.0010) [2023-12-26 07:12:25,642][123090] Updated weights for policy 1, policy_version 947096 (0.0007) [2023-12-26 07:12:25,650][123091] Updated weights for policy 0, policy_version 953872 (0.0009) [2023-12-26 07:12:26,364][123090] Updated weights for policy 1, policy_version 947106 (0.0009) [2023-12-26 07:12:26,416][123090] Updated weights for policy 1, policy_version 947116 (0.0006) [2023-12-26 07:12:26,478][123090] Updated weights for policy 1, policy_version 947126 (0.0006) [2023-12-26 07:12:26,538][123091] Updated weights for policy 0, policy_version 953882 (0.0010) [2023-12-26 07:12:26,545][123090] Updated weights for policy 1, policy_version 947136 (0.0005) [2023-12-26 07:12:26,595][123091] Updated weights for policy 0, policy_version 953892 (0.0009) [2023-12-26 07:12:26,646][123091] Updated weights for policy 0, policy_version 953902 (0.0008) [2023-12-26 07:12:27,182][123090] Updated weights for policy 1, policy_version 947146 (0.0009) [2023-12-26 07:12:27,231][123090] Updated weights for policy 1, policy_version 947156 (0.0009) [2023-12-26 07:12:27,279][123090] Updated weights for policy 1, policy_version 947167 (0.0009) [2023-12-26 07:12:27,496][123091] Updated weights for policy 0, policy_version 953912 (0.0010) [2023-12-26 07:12:27,557][123091] Updated weights for policy 0, policy_version 953922 (0.0010) [2023-12-26 07:12:27,616][123091] Updated weights for policy 0, policy_version 953932 (0.0009) [2023-12-26 07:12:28,098][123090] Updated weights for policy 1, policy_version 947177 (0.0009) [2023-12-26 07:12:28,150][123090] Updated weights for policy 1, policy_version 947187 (0.0009) [2023-12-26 07:12:28,202][123090] Updated weights for policy 1, policy_version 947197 (0.0009) [2023-12-26 07:12:28,464][123091] Updated weights for policy 0, policy_version 953943 (0.0010) [2023-12-26 07:12:28,531][123091] Updated weights for policy 0, policy_version 953953 (0.0009) [2023-12-26 07:12:28,589][123091] Updated weights for policy 0, policy_version 953963 (0.0008) [2023-12-26 07:12:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 486703104. Throughput: 0: 8650.0, 1: 8950.0. Samples: 486695696. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:28,785][121949] Avg episode reward: [(0, '6215.250'), (1, '5480.494')] [2023-12-26 07:12:29,018][123090] Updated weights for policy 1, policy_version 947207 (0.0009) [2023-12-26 07:12:29,073][123090] Updated weights for policy 1, policy_version 947217 (0.0009) [2023-12-26 07:12:29,136][123090] Updated weights for policy 1, policy_version 947227 (0.0009) [2023-12-26 07:12:29,389][123091] Updated weights for policy 0, policy_version 953973 (0.0009) [2023-12-26 07:12:29,455][123091] Updated weights for policy 0, policy_version 953983 (0.0005) [2023-12-26 07:12:29,512][123091] Updated weights for policy 0, policy_version 953993 (0.0005) [2023-12-26 07:12:30,025][123090] Updated weights for policy 1, policy_version 947237 (0.0009) [2023-12-26 07:12:30,082][123090] Updated weights for policy 1, policy_version 947247 (0.0009) [2023-12-26 07:12:30,139][123090] Updated weights for policy 1, policy_version 947257 (0.0010) [2023-12-26 07:12:30,201][123091] Updated weights for policy 0, policy_version 954003 (0.0005) [2023-12-26 07:12:30,269][123091] Updated weights for policy 0, policy_version 954013 (0.0005) [2023-12-26 07:12:30,334][123091] Updated weights for policy 0, policy_version 954023 (0.0005) [2023-12-26 07:12:31,013][123091] Updated weights for policy 0, policy_version 954033 (0.0006) [2023-12-26 07:12:31,014][123090] Updated weights for policy 1, policy_version 947267 (0.0010) [2023-12-26 07:12:31,078][123091] Updated weights for policy 0, policy_version 954043 (0.0008) [2023-12-26 07:12:31,078][123090] Updated weights for policy 1, policy_version 947277 (0.0008) [2023-12-26 07:12:31,137][123091] Updated weights for policy 0, policy_version 954053 (0.0008) [2023-12-26 07:12:31,147][123090] Updated weights for policy 1, policy_version 947287 (0.0008) [2023-12-26 07:12:31,194][123091] Updated weights for policy 0, policy_version 954063 (0.0007) [2023-12-26 07:12:32,014][123090] Updated weights for policy 1, policy_version 947297 (0.0010) [2023-12-26 07:12:32,023][123091] Updated weights for policy 0, policy_version 954073 (0.0010) [2023-12-26 07:12:32,065][123090] Updated weights for policy 1, policy_version 947307 (0.0008) [2023-12-26 07:12:32,078][123091] Updated weights for policy 0, policy_version 954083 (0.0010) [2023-12-26 07:12:32,120][123090] Updated weights for policy 1, policy_version 947317 (0.0006) [2023-12-26 07:12:32,130][123091] Updated weights for policy 0, policy_version 954093 (0.0010) [2023-12-26 07:12:32,182][123090] Updated weights for policy 1, policy_version 947327 (0.0007) [2023-12-26 07:12:32,981][123091] Updated weights for policy 0, policy_version 954103 (0.0011) [2023-12-26 07:12:33,040][123091] Updated weights for policy 0, policy_version 954113 (0.0010) [2023-12-26 07:12:33,042][123090] Updated weights for policy 1, policy_version 947337 (0.0008) [2023-12-26 07:12:33,083][123091] Updated weights for policy 0, policy_version 954123 (0.0010) [2023-12-26 07:12:33,094][123090] Updated weights for policy 1, policy_version 947347 (0.0005) [2023-12-26 07:12:33,156][123090] Updated weights for policy 1, policy_version 947357 (0.0008) [2023-12-26 07:12:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 486785024. Throughput: 0: 8653.7, 1: 8930.5. Samples: 486799060. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:33,785][121949] Avg episode reward: [(0, '6114.096'), (1, '5555.940')] [2023-12-26 07:12:33,929][123091] Updated weights for policy 0, policy_version 954133 (0.0010) [2023-12-26 07:12:33,988][123091] Updated weights for policy 0, policy_version 954143 (0.0011) [2023-12-26 07:12:33,999][123090] Updated weights for policy 1, policy_version 947367 (0.0007) [2023-12-26 07:12:34,043][123091] Updated weights for policy 0, policy_version 954153 (0.0010) [2023-12-26 07:12:34,058][123090] Updated weights for policy 1, policy_version 947377 (0.0006) [2023-12-26 07:12:34,109][123090] Updated weights for policy 1, policy_version 947387 (0.0009) [2023-12-26 07:12:34,828][123091] Updated weights for policy 0, policy_version 954163 (0.0010) [2023-12-26 07:12:34,894][123091] Updated weights for policy 0, policy_version 954173 (0.0010) [2023-12-26 07:12:34,958][123090] Updated weights for policy 1, policy_version 947397 (0.0009) [2023-12-26 07:12:34,958][123091] Updated weights for policy 0, policy_version 954183 (0.0009) [2023-12-26 07:12:35,016][123090] Updated weights for policy 1, policy_version 947407 (0.0009) [2023-12-26 07:12:35,094][123090] Updated weights for policy 1, policy_version 947417 (0.0009) [2023-12-26 07:12:35,622][123091] Updated weights for policy 0, policy_version 954193 (0.0007) [2023-12-26 07:12:35,683][123091] Updated weights for policy 0, policy_version 954203 (0.0005) [2023-12-26 07:12:35,744][123091] Updated weights for policy 0, policy_version 954213 (0.0005) [2023-12-26 07:12:35,798][123091] Updated weights for policy 0, policy_version 954223 (0.0005) [2023-12-26 07:12:35,982][123090] Updated weights for policy 1, policy_version 947427 (0.0010) [2023-12-26 07:12:36,035][123090] Updated weights for policy 1, policy_version 947437 (0.0009) [2023-12-26 07:12:36,099][123090] Updated weights for policy 1, policy_version 947447 (0.0008) [2023-12-26 07:12:36,547][123091] Updated weights for policy 0, policy_version 954233 (0.0009) [2023-12-26 07:12:36,601][123091] Updated weights for policy 0, policy_version 954244 (0.0009) [2023-12-26 07:12:36,661][123091] Updated weights for policy 0, policy_version 954254 (0.0008) [2023-12-26 07:12:37,010][123090] Updated weights for policy 1, policy_version 947457 (0.0009) [2023-12-26 07:12:37,071][123090] Updated weights for policy 1, policy_version 947467 (0.0006) [2023-12-26 07:12:37,133][123090] Updated weights for policy 1, policy_version 947477 (0.0005) [2023-12-26 07:12:37,199][123090] Updated weights for policy 1, policy_version 947487 (0.0005) [2023-12-26 07:12:37,458][123091] Updated weights for policy 0, policy_version 954264 (0.0006) [2023-12-26 07:12:37,509][123091] Updated weights for policy 0, policy_version 954274 (0.0006) [2023-12-26 07:12:37,558][123091] Updated weights for policy 0, policy_version 954284 (0.0006) [2023-12-26 07:12:37,866][123090] Updated weights for policy 1, policy_version 947497 (0.0009) [2023-12-26 07:12:37,929][123090] Updated weights for policy 1, policy_version 947507 (0.0010) [2023-12-26 07:12:37,992][123090] Updated weights for policy 1, policy_version 947517 (0.0010) [2023-12-26 07:12:38,311][123091] Updated weights for policy 0, policy_version 954294 (0.0008) [2023-12-26 07:12:38,394][123091] Updated weights for policy 0, policy_version 954304 (0.0011) [2023-12-26 07:12:38,443][123091] Updated weights for policy 0, policy_version 954314 (0.0011) [2023-12-26 07:12:38,776][123090] Updated weights for policy 1, policy_version 947527 (0.0008) [2023-12-26 07:12:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 486875136. Throughput: 0: 8729.7, 1: 8894.8. Samples: 486851388. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:38,785][121949] Avg episode reward: [(0, '6141.962'), (1, '5566.174')] [2023-12-26 07:12:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000954320_244310016.pth... [2023-12-26 07:12:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000953296_244047872.pth [2023-12-26 07:12:38,839][123090] Updated weights for policy 1, policy_version 947537 (0.0009) [2023-12-26 07:12:38,896][123090] Updated weights for policy 1, policy_version 947547 (0.0009) [2023-12-26 07:12:38,919][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000947552_242573312.pth... [2023-12-26 07:12:38,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000946496_242302976.pth [2023-12-26 07:12:39,312][123091] Updated weights for policy 0, policy_version 954324 (0.0009) [2023-12-26 07:12:39,389][123091] Updated weights for policy 0, policy_version 954334 (0.0011) [2023-12-26 07:12:39,458][123091] Updated weights for policy 0, policy_version 954344 (0.0010) [2023-12-26 07:12:39,740][123090] Updated weights for policy 1, policy_version 947557 (0.0009) [2023-12-26 07:12:39,797][123090] Updated weights for policy 1, policy_version 947567 (0.0009) [2023-12-26 07:12:39,869][123090] Updated weights for policy 1, policy_version 947577 (0.0007) [2023-12-26 07:12:40,283][123091] Updated weights for policy 0, policy_version 954354 (0.0011) [2023-12-26 07:12:40,349][123091] Updated weights for policy 0, policy_version 954364 (0.0011) [2023-12-26 07:12:40,402][123091] Updated weights for policy 0, policy_version 954374 (0.0010) [2023-12-26 07:12:40,468][123091] Updated weights for policy 0, policy_version 954384 (0.0006) [2023-12-26 07:12:40,643][123090] Updated weights for policy 1, policy_version 947587 (0.0007) [2023-12-26 07:12:40,700][123090] Updated weights for policy 1, policy_version 947597 (0.0009) [2023-12-26 07:12:40,755][123090] Updated weights for policy 1, policy_version 947607 (0.0008) [2023-12-26 07:12:41,278][123091] Updated weights for policy 0, policy_version 954394 (0.0011) [2023-12-26 07:12:41,348][123091] Updated weights for policy 0, policy_version 954404 (0.0013) [2023-12-26 07:12:41,421][123091] Updated weights for policy 0, policy_version 954414 (0.0011) [2023-12-26 07:12:41,570][123090] Updated weights for policy 1, policy_version 947617 (0.0006) [2023-12-26 07:12:41,641][123090] Updated weights for policy 1, policy_version 947627 (0.0009) [2023-12-26 07:12:41,703][123090] Updated weights for policy 1, policy_version 947637 (0.0009) [2023-12-26 07:12:41,767][123090] Updated weights for policy 1, policy_version 947647 (0.0009) [2023-12-26 07:12:42,253][123091] Updated weights for policy 0, policy_version 954424 (0.0010) [2023-12-26 07:12:42,321][123091] Updated weights for policy 0, policy_version 954434 (0.0011) [2023-12-26 07:12:42,394][123091] Updated weights for policy 0, policy_version 954444 (0.0011) [2023-12-26 07:12:42,618][123090] Updated weights for policy 1, policy_version 947657 (0.0009) [2023-12-26 07:12:42,672][123090] Updated weights for policy 1, policy_version 947667 (0.0007) [2023-12-26 07:12:42,723][123090] Updated weights for policy 1, policy_version 947677 (0.0005) [2023-12-26 07:12:43,208][123091] Updated weights for policy 0, policy_version 954454 (0.0010) [2023-12-26 07:12:43,252][123091] Updated weights for policy 0, policy_version 954464 (0.0010) [2023-12-26 07:12:43,298][123091] Updated weights for policy 0, policy_version 954474 (0.0010) [2023-12-26 07:12:43,570][123090] Updated weights for policy 1, policy_version 947687 (0.0005) [2023-12-26 07:12:43,635][123090] Updated weights for policy 1, policy_version 947697 (0.0005) [2023-12-26 07:12:43,710][123090] Updated weights for policy 1, policy_version 947707 (0.0005) [2023-12-26 07:12:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 486965248. Throughput: 0: 8716.0, 1: 8885.9. Samples: 486956728. Policy #0 lag: (min: 18.0, avg: 25.1, max: 50.0) [2023-12-26 07:12:43,785][121949] Avg episode reward: [(0, '6230.079'), (1, '5526.980')] [2023-12-26 07:12:44,020][123091] Updated weights for policy 0, policy_version 954484 (0.0008) [2023-12-26 07:12:44,083][123091] Updated weights for policy 0, policy_version 954494 (0.0006) [2023-12-26 07:12:44,147][123091] Updated weights for policy 0, policy_version 954504 (0.0005) [2023-12-26 07:12:44,361][123090] Updated weights for policy 1, policy_version 947717 (0.0007) [2023-12-26 07:12:44,425][123090] Updated weights for policy 1, policy_version 947727 (0.0007) [2023-12-26 07:12:44,494][123090] Updated weights for policy 1, policy_version 947737 (0.0006) [2023-12-26 07:12:44,782][123091] Updated weights for policy 0, policy_version 954514 (0.0006) [2023-12-26 07:12:44,847][123091] Updated weights for policy 0, policy_version 954524 (0.0007) [2023-12-26 07:12:44,916][123091] Updated weights for policy 0, policy_version 954534 (0.0006) [2023-12-26 07:12:44,990][123091] Updated weights for policy 0, policy_version 954544 (0.0009) [2023-12-26 07:12:45,142][123090] Updated weights for policy 1, policy_version 947747 (0.0007) [2023-12-26 07:12:45,213][123090] Updated weights for policy 1, policy_version 947757 (0.0011) [2023-12-26 07:12:45,280][123090] Updated weights for policy 1, policy_version 947767 (0.0011) [2023-12-26 07:12:45,720][123091] Updated weights for policy 0, policy_version 954554 (0.0006) [2023-12-26 07:12:45,790][123091] Updated weights for policy 0, policy_version 954564 (0.0005) [2023-12-26 07:12:45,851][123091] Updated weights for policy 0, policy_version 954574 (0.0010) [2023-12-26 07:12:46,101][123090] Updated weights for policy 1, policy_version 947777 (0.0011) [2023-12-26 07:12:46,152][123090] Updated weights for policy 1, policy_version 947787 (0.0010) [2023-12-26 07:12:46,218][123090] Updated weights for policy 1, policy_version 947797 (0.0011) [2023-12-26 07:12:46,281][123090] Updated weights for policy 1, policy_version 947807 (0.0010) [2023-12-26 07:12:46,562][123091] Updated weights for policy 0, policy_version 954584 (0.0006) [2023-12-26 07:12:46,617][123091] Updated weights for policy 0, policy_version 954594 (0.0006) [2023-12-26 07:12:46,669][123091] Updated weights for policy 0, policy_version 954604 (0.0010) [2023-12-26 07:12:47,066][123090] Updated weights for policy 1, policy_version 947817 (0.0007) [2023-12-26 07:12:47,141][123090] Updated weights for policy 1, policy_version 947827 (0.0006) [2023-12-26 07:12:47,205][123090] Updated weights for policy 1, policy_version 947837 (0.0005) [2023-12-26 07:12:47,395][123091] Updated weights for policy 0, policy_version 954614 (0.0011) [2023-12-26 07:12:47,447][123091] Updated weights for policy 0, policy_version 954624 (0.0010) [2023-12-26 07:12:47,495][123091] Updated weights for policy 0, policy_version 954634 (0.0010) [2023-12-26 07:12:47,894][123090] Updated weights for policy 1, policy_version 947847 (0.0009) [2023-12-26 07:12:47,956][123090] Updated weights for policy 1, policy_version 947857 (0.0010) [2023-12-26 07:12:48,026][123090] Updated weights for policy 1, policy_version 947867 (0.0011) [2023-12-26 07:12:48,351][123091] Updated weights for policy 0, policy_version 954644 (0.0011) [2023-12-26 07:12:48,417][123091] Updated weights for policy 0, policy_version 954654 (0.0011) [2023-12-26 07:12:48,477][123091] Updated weights for policy 0, policy_version 954664 (0.0010) [2023-12-26 07:12:48,754][123090] Updated weights for policy 1, policy_version 947877 (0.0008) [2023-12-26 07:12:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 487055360. Throughput: 0: 8762.4, 1: 8973.1. Samples: 487069468. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:12:48,785][121949] Avg episode reward: [(0, '6244.187'), (1, '5651.612')] [2023-12-26 07:12:48,825][123090] Updated weights for policy 1, policy_version 947887 (0.0010) [2023-12-26 07:12:48,888][123090] Updated weights for policy 1, policy_version 947897 (0.0010) [2023-12-26 07:12:49,274][123091] Updated weights for policy 0, policy_version 954674 (0.0011) [2023-12-26 07:12:49,349][123091] Updated weights for policy 0, policy_version 954684 (0.0009) [2023-12-26 07:12:49,420][123091] Updated weights for policy 0, policy_version 954694 (0.0009) [2023-12-26 07:12:49,484][123091] Updated weights for policy 0, policy_version 954704 (0.0009) [2023-12-26 07:12:49,663][123090] Updated weights for policy 1, policy_version 947907 (0.0009) [2023-12-26 07:12:49,721][123090] Updated weights for policy 1, policy_version 947917 (0.0010) [2023-12-26 07:12:49,775][123090] Updated weights for policy 1, policy_version 947927 (0.0010) [2023-12-26 07:12:50,198][123091] Updated weights for policy 0, policy_version 954714 (0.0008) [2023-12-26 07:12:50,253][123091] Updated weights for policy 0, policy_version 954724 (0.0008) [2023-12-26 07:12:50,318][123091] Updated weights for policy 0, policy_version 954734 (0.0008) [2023-12-26 07:12:50,563][123090] Updated weights for policy 1, policy_version 947937 (0.0009) [2023-12-26 07:12:50,635][123090] Updated weights for policy 1, policy_version 947947 (0.0008) [2023-12-26 07:12:50,704][123090] Updated weights for policy 1, policy_version 947957 (0.0008) [2023-12-26 07:12:50,770][123090] Updated weights for policy 1, policy_version 947967 (0.0008) [2023-12-26 07:12:51,113][123091] Updated weights for policy 0, policy_version 954744 (0.0006) [2023-12-26 07:12:51,185][123091] Updated weights for policy 0, policy_version 954754 (0.0007) [2023-12-26 07:12:51,257][123091] Updated weights for policy 0, policy_version 954764 (0.0006) [2023-12-26 07:12:51,526][123090] Updated weights for policy 1, policy_version 947977 (0.0008) [2023-12-26 07:12:51,588][123090] Updated weights for policy 1, policy_version 947987 (0.0008) [2023-12-26 07:12:51,659][123090] Updated weights for policy 1, policy_version 947997 (0.0008) [2023-12-26 07:12:51,969][123091] Updated weights for policy 0, policy_version 954774 (0.0006) [2023-12-26 07:12:52,027][123091] Updated weights for policy 0, policy_version 954784 (0.0006) [2023-12-26 07:12:52,104][123091] Updated weights for policy 0, policy_version 954794 (0.0007) [2023-12-26 07:12:52,488][123090] Updated weights for policy 1, policy_version 948007 (0.0008) [2023-12-26 07:12:52,541][123090] Updated weights for policy 1, policy_version 948017 (0.0010) [2023-12-26 07:12:52,594][123090] Updated weights for policy 1, policy_version 948027 (0.0010) [2023-12-26 07:12:52,788][123091] Updated weights for policy 0, policy_version 954804 (0.0006) [2023-12-26 07:12:52,854][123091] Updated weights for policy 0, policy_version 954814 (0.0005) [2023-12-26 07:12:52,926][123091] Updated weights for policy 0, policy_version 954824 (0.0005) [2023-12-26 07:12:53,523][123090] Updated weights for policy 1, policy_version 948037 (0.0009) [2023-12-26 07:12:53,562][123091] Updated weights for policy 0, policy_version 954834 (0.0008) [2023-12-26 07:12:53,586][123090] Updated weights for policy 1, policy_version 948047 (0.0009) [2023-12-26 07:12:53,632][123091] Updated weights for policy 0, policy_version 954844 (0.0006) [2023-12-26 07:12:53,647][123090] Updated weights for policy 1, policy_version 948057 (0.0010) [2023-12-26 07:12:53,701][123091] Updated weights for policy 0, policy_version 954854 (0.0005) [2023-12-26 07:12:53,770][123091] Updated weights for policy 0, policy_version 954864 (0.0006) [2023-12-26 07:12:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 487153664. Throughput: 0: 8813.5, 1: 8939.7. Samples: 487122824. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:12:53,785][121949] Avg episode reward: [(0, '6180.169'), (1, '5579.696')] [2023-12-26 07:12:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000948064_242704384.pth... [2023-12-26 07:12:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000954864_244449280.pth... [2023-12-26 07:12:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000947040_242442240.pth [2023-12-26 07:12:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000953808_244178944.pth [2023-12-26 07:12:54,381][123091] Updated weights for policy 0, policy_version 954874 (0.0005) [2023-12-26 07:12:54,429][123091] Updated weights for policy 0, policy_version 954884 (0.0005) [2023-12-26 07:12:54,488][123091] Updated weights for policy 0, policy_version 954894 (0.0006) [2023-12-26 07:12:54,568][123090] Updated weights for policy 1, policy_version 948067 (0.0009) [2023-12-26 07:12:54,624][123090] Updated weights for policy 1, policy_version 948077 (0.0010) [2023-12-26 07:12:54,686][123090] Updated weights for policy 1, policy_version 948087 (0.0010) [2023-12-26 07:12:55,193][123091] Updated weights for policy 0, policy_version 954904 (0.0009) [2023-12-26 07:12:55,245][123091] Updated weights for policy 0, policy_version 954914 (0.0010) [2023-12-26 07:12:55,315][123091] Updated weights for policy 0, policy_version 954924 (0.0011) [2023-12-26 07:12:55,483][123090] Updated weights for policy 1, policy_version 948097 (0.0009) [2023-12-26 07:12:55,556][123090] Updated weights for policy 1, policy_version 948107 (0.0008) [2023-12-26 07:12:55,618][123090] Updated weights for policy 1, policy_version 948117 (0.0008) [2023-12-26 07:12:55,687][123090] Updated weights for policy 1, policy_version 948127 (0.0006) [2023-12-26 07:12:56,047][123091] Updated weights for policy 0, policy_version 954934 (0.0007) [2023-12-26 07:12:56,101][123091] Updated weights for policy 0, policy_version 954944 (0.0005) [2023-12-26 07:12:56,148][123091] Updated weights for policy 0, policy_version 954954 (0.0005) [2023-12-26 07:12:56,337][123090] Updated weights for policy 1, policy_version 948137 (0.0009) [2023-12-26 07:12:56,390][123090] Updated weights for policy 1, policy_version 948148 (0.0010) [2023-12-26 07:12:56,443][123090] Updated weights for policy 1, policy_version 948158 (0.0005) [2023-12-26 07:12:56,859][123091] Updated weights for policy 0, policy_version 954964 (0.0007) [2023-12-26 07:12:56,920][123091] Updated weights for policy 0, policy_version 954974 (0.0010) [2023-12-26 07:12:56,968][123091] Updated weights for policy 0, policy_version 954985 (0.0005) [2023-12-26 07:12:57,110][123090] Updated weights for policy 1, policy_version 948168 (0.0006) [2023-12-26 07:12:57,181][123090] Updated weights for policy 1, policy_version 948178 (0.0005) [2023-12-26 07:12:57,259][123090] Updated weights for policy 1, policy_version 948188 (0.0005) [2023-12-26 07:12:57,665][123091] Updated weights for policy 0, policy_version 954995 (0.0006) [2023-12-26 07:12:57,734][123091] Updated weights for policy 0, policy_version 955005 (0.0008) [2023-12-26 07:12:57,796][123091] Updated weights for policy 0, policy_version 955015 (0.0010) [2023-12-26 07:12:57,883][123090] Updated weights for policy 1, policy_version 948198 (0.0005) [2023-12-26 07:12:57,948][123090] Updated weights for policy 1, policy_version 948208 (0.0005) [2023-12-26 07:12:58,002][123090] Updated weights for policy 1, policy_version 948218 (0.0005) [2023-12-26 07:12:58,605][123091] Updated weights for policy 0, policy_version 955025 (0.0010) [2023-12-26 07:12:58,664][123091] Updated weights for policy 0, policy_version 955035 (0.0008) [2023-12-26 07:12:58,745][123091] Updated weights for policy 0, policy_version 955045 (0.0008) [2023-12-26 07:12:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 487235584. Throughput: 0: 8993.0, 1: 8975.5. Samples: 487236136. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:12:58,785][121949] Avg episode reward: [(0, '6208.052'), (1, '5459.605')] [2023-12-26 07:12:58,796][123090] Updated weights for policy 1, policy_version 948228 (0.0009) [2023-12-26 07:12:58,832][123091] Updated weights for policy 0, policy_version 955056 (0.0008) [2023-12-26 07:12:58,874][123090] Updated weights for policy 1, policy_version 948238 (0.0008) [2023-12-26 07:12:58,949][123090] Updated weights for policy 1, policy_version 948248 (0.0008) [2023-12-26 07:12:59,720][123091] Updated weights for policy 0, policy_version 955066 (0.0009) [2023-12-26 07:12:59,781][123091] Updated weights for policy 0, policy_version 955076 (0.0009) [2023-12-26 07:12:59,782][123090] Updated weights for policy 1, policy_version 948258 (0.0010) [2023-12-26 07:12:59,830][123091] Updated weights for policy 0, policy_version 955086 (0.0007) [2023-12-26 07:12:59,842][123090] Updated weights for policy 1, policy_version 948268 (0.0009) [2023-12-26 07:12:59,899][123090] Updated weights for policy 1, policy_version 948278 (0.0008) [2023-12-26 07:12:59,967][123090] Updated weights for policy 1, policy_version 948288 (0.0008) [2023-12-26 07:13:00,596][123091] Updated weights for policy 0, policy_version 955096 (0.0008) [2023-12-26 07:13:00,653][123091] Updated weights for policy 0, policy_version 955106 (0.0008) [2023-12-26 07:13:00,682][123090] Updated weights for policy 1, policy_version 948298 (0.0009) [2023-12-26 07:13:00,700][123091] Updated weights for policy 0, policy_version 955116 (0.0009) [2023-12-26 07:13:00,733][123090] Updated weights for policy 1, policy_version 948308 (0.0005) [2023-12-26 07:13:00,786][123090] Updated weights for policy 1, policy_version 948318 (0.0005) [2023-12-26 07:13:01,427][123091] Updated weights for policy 0, policy_version 955126 (0.0008) [2023-12-26 07:13:01,484][123091] Updated weights for policy 0, policy_version 955136 (0.0009) [2023-12-26 07:13:01,537][123091] Updated weights for policy 0, policy_version 955146 (0.0008) [2023-12-26 07:13:01,549][123090] Updated weights for policy 1, policy_version 948328 (0.0007) [2023-12-26 07:13:01,602][123090] Updated weights for policy 1, policy_version 948338 (0.0009) [2023-12-26 07:13:01,669][123090] Updated weights for policy 1, policy_version 948348 (0.0007) [2023-12-26 07:13:02,326][123091] Updated weights for policy 0, policy_version 955156 (0.0007) [2023-12-26 07:13:02,393][123091] Updated weights for policy 0, policy_version 955166 (0.0009) [2023-12-26 07:13:02,441][123091] Updated weights for policy 0, policy_version 955176 (0.0009) [2023-12-26 07:13:02,521][123090] Updated weights for policy 1, policy_version 948358 (0.0008) [2023-12-26 07:13:02,577][123090] Updated weights for policy 1, policy_version 948368 (0.0009) [2023-12-26 07:13:02,636][123090] Updated weights for policy 1, policy_version 948378 (0.0010) [2023-12-26 07:13:03,193][123091] Updated weights for policy 0, policy_version 955186 (0.0009) [2023-12-26 07:13:03,245][123091] Updated weights for policy 0, policy_version 955197 (0.0009) [2023-12-26 07:13:03,294][123091] Updated weights for policy 0, policy_version 955207 (0.0009) [2023-12-26 07:13:03,493][123090] Updated weights for policy 1, policy_version 948388 (0.0009) [2023-12-26 07:13:03,549][123090] Updated weights for policy 1, policy_version 948398 (0.0009) [2023-12-26 07:13:03,600][123090] Updated weights for policy 1, policy_version 948408 (0.0009) [2023-12-26 07:13:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 487333888. Throughput: 0: 8984.4, 1: 8842.2. Samples: 487342100. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:03,785][121949] Avg episode reward: [(0, '6249.282'), (1, '5645.294')] [2023-12-26 07:13:04,128][123091] Updated weights for policy 0, policy_version 955217 (0.0009) [2023-12-26 07:13:04,195][123091] Updated weights for policy 0, policy_version 955227 (0.0008) [2023-12-26 07:13:04,254][123091] Updated weights for policy 0, policy_version 955237 (0.0009) [2023-12-26 07:13:04,316][123091] Updated weights for policy 0, policy_version 955247 (0.0008) [2023-12-26 07:13:04,470][123090] Updated weights for policy 1, policy_version 948418 (0.0009) [2023-12-26 07:13:04,522][123090] Updated weights for policy 1, policy_version 948428 (0.0009) [2023-12-26 07:13:04,582][123090] Updated weights for policy 1, policy_version 948438 (0.0009) [2023-12-26 07:13:04,650][123090] Updated weights for policy 1, policy_version 948448 (0.0009) [2023-12-26 07:13:05,069][123091] Updated weights for policy 0, policy_version 955257 (0.0007) [2023-12-26 07:13:05,117][123091] Updated weights for policy 0, policy_version 955267 (0.0008) [2023-12-26 07:13:05,161][123091] Updated weights for policy 0, policy_version 955277 (0.0007) [2023-12-26 07:13:05,519][123090] Updated weights for policy 1, policy_version 948458 (0.0010) [2023-12-26 07:13:05,573][123090] Updated weights for policy 1, policy_version 948468 (0.0010) [2023-12-26 07:13:05,639][123090] Updated weights for policy 1, policy_version 948478 (0.0010) [2023-12-26 07:13:05,802][123091] Updated weights for policy 0, policy_version 955287 (0.0005) [2023-12-26 07:13:05,854][123091] Updated weights for policy 0, policy_version 955297 (0.0005) [2023-12-26 07:13:05,900][123091] Updated weights for policy 0, policy_version 955307 (0.0009) [2023-12-26 07:13:06,408][123090] Updated weights for policy 1, policy_version 948488 (0.0010) [2023-12-26 07:13:06,476][123090] Updated weights for policy 1, policy_version 948498 (0.0010) [2023-12-26 07:13:06,542][123090] Updated weights for policy 1, policy_version 948508 (0.0009) [2023-12-26 07:13:06,673][123091] Updated weights for policy 0, policy_version 955317 (0.0010) [2023-12-26 07:13:06,745][123091] Updated weights for policy 0, policy_version 955327 (0.0011) [2023-12-26 07:13:06,818][123091] Updated weights for policy 0, policy_version 955337 (0.0011) [2023-12-26 07:13:07,372][123090] Updated weights for policy 1, policy_version 948518 (0.0010) [2023-12-26 07:13:07,423][123090] Updated weights for policy 1, policy_version 948528 (0.0009) [2023-12-26 07:13:07,483][123090] Updated weights for policy 1, policy_version 948538 (0.0010) [2023-12-26 07:13:07,535][123091] Updated weights for policy 0, policy_version 955347 (0.0007) [2023-12-26 07:13:07,588][123091] Updated weights for policy 0, policy_version 955357 (0.0006) [2023-12-26 07:13:07,640][123091] Updated weights for policy 0, policy_version 955367 (0.0008) [2023-12-26 07:13:08,379][123090] Updated weights for policy 1, policy_version 948548 (0.0009) [2023-12-26 07:13:08,391][123091] Updated weights for policy 0, policy_version 955377 (0.0010) [2023-12-26 07:13:08,441][123090] Updated weights for policy 1, policy_version 948558 (0.0009) [2023-12-26 07:13:08,450][123091] Updated weights for policy 0, policy_version 955387 (0.0008) [2023-12-26 07:13:08,502][123091] Updated weights for policy 0, policy_version 955397 (0.0008) [2023-12-26 07:13:08,506][123090] Updated weights for policy 1, policy_version 948568 (0.0009) [2023-12-26 07:13:08,570][123091] Updated weights for policy 0, policy_version 955407 (0.0011) [2023-12-26 07:13:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 487424000. Throughput: 0: 9062.7, 1: 8828.2. Samples: 487396488. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:08,785][121949] Avg episode reward: [(0, '6193.780'), (1, '5688.995')] [2023-12-26 07:13:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000955408_244588544.pth... [2023-12-26 07:13:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000948576_242835456.pth... [2023-12-26 07:13:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000954320_244310016.pth [2023-12-26 07:13:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000947552_242573312.pth [2023-12-26 07:13:09,360][123091] Updated weights for policy 0, policy_version 955417 (0.0009) [2023-12-26 07:13:09,421][123090] Updated weights for policy 1, policy_version 948578 (0.0010) [2023-12-26 07:13:09,435][123091] Updated weights for policy 0, policy_version 955427 (0.0009) [2023-12-26 07:13:09,487][123090] Updated weights for policy 1, policy_version 948588 (0.0010) [2023-12-26 07:13:09,499][123091] Updated weights for policy 0, policy_version 955437 (0.0009) [2023-12-26 07:13:09,552][123090] Updated weights for policy 1, policy_version 948598 (0.0010) [2023-12-26 07:13:09,618][123090] Updated weights for policy 1, policy_version 948608 (0.0010) [2023-12-26 07:13:10,351][123091] Updated weights for policy 0, policy_version 955447 (0.0009) [2023-12-26 07:13:10,402][123091] Updated weights for policy 0, policy_version 955457 (0.0009) [2023-12-26 07:13:10,466][123091] Updated weights for policy 0, policy_version 955467 (0.0010) [2023-12-26 07:13:10,480][123090] Updated weights for policy 1, policy_version 948618 (0.0008) [2023-12-26 07:13:10,537][123090] Updated weights for policy 1, policy_version 948628 (0.0006) [2023-12-26 07:13:10,606][123090] Updated weights for policy 1, policy_version 948638 (0.0009) [2023-12-26 07:13:11,294][123091] Updated weights for policy 0, policy_version 955477 (0.0007) [2023-12-26 07:13:11,369][123091] Updated weights for policy 0, policy_version 955487 (0.0008) [2023-12-26 07:13:11,427][123090] Updated weights for policy 1, policy_version 948648 (0.0009) [2023-12-26 07:13:11,437][123091] Updated weights for policy 0, policy_version 955497 (0.0007) [2023-12-26 07:13:11,480][123090] Updated weights for policy 1, policy_version 948658 (0.0009) [2023-12-26 07:13:11,529][123090] Updated weights for policy 1, policy_version 948668 (0.0009) [2023-12-26 07:13:12,189][123091] Updated weights for policy 0, policy_version 955507 (0.0008) [2023-12-26 07:13:12,241][123091] Updated weights for policy 0, policy_version 955517 (0.0011) [2023-12-26 07:13:12,314][123091] Updated weights for policy 0, policy_version 955527 (0.0009) [2023-12-26 07:13:12,436][123090] Updated weights for policy 1, policy_version 948678 (0.0009) [2023-12-26 07:13:12,502][123090] Updated weights for policy 1, policy_version 948688 (0.0009) [2023-12-26 07:13:12,575][123090] Updated weights for policy 1, policy_version 948698 (0.0009) [2023-12-26 07:13:13,125][123091] Updated weights for policy 0, policy_version 955537 (0.0010) [2023-12-26 07:13:13,195][123091] Updated weights for policy 0, policy_version 955547 (0.0011) [2023-12-26 07:13:13,255][123091] Updated weights for policy 0, policy_version 955557 (0.0009) [2023-12-26 07:13:13,307][123091] Updated weights for policy 0, policy_version 955567 (0.0010) [2023-12-26 07:13:13,457][123090] Updated weights for policy 1, policy_version 948708 (0.0010) [2023-12-26 07:13:13,512][123090] Updated weights for policy 1, policy_version 948718 (0.0009) [2023-12-26 07:13:13,572][123090] Updated weights for policy 1, policy_version 948728 (0.0005) [2023-12-26 07:13:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 487505920. Throughput: 0: 9157.3, 1: 8679.1. Samples: 487498336. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:13,785][121949] Avg episode reward: [(0, '6042.858'), (1, '5748.919')] [2023-12-26 07:13:14,092][123091] Updated weights for policy 0, policy_version 955577 (0.0010) [2023-12-26 07:13:14,154][123091] Updated weights for policy 0, policy_version 955587 (0.0011) [2023-12-26 07:13:14,209][123091] Updated weights for policy 0, policy_version 955599 (0.0010) [2023-12-26 07:13:14,304][123090] Updated weights for policy 1, policy_version 948738 (0.0008) [2023-12-26 07:13:14,370][123090] Updated weights for policy 1, policy_version 948748 (0.0005) [2023-12-26 07:13:14,431][123090] Updated weights for policy 1, policy_version 948758 (0.0007) [2023-12-26 07:13:14,483][123090] Updated weights for policy 1, policy_version 948768 (0.0006) [2023-12-26 07:13:15,092][123091] Updated weights for policy 0, policy_version 955609 (0.0011) [2023-12-26 07:13:15,164][123091] Updated weights for policy 0, policy_version 955619 (0.0011) [2023-12-26 07:13:15,227][123091] Updated weights for policy 0, policy_version 955629 (0.0011) [2023-12-26 07:13:15,237][123090] Updated weights for policy 1, policy_version 948778 (0.0011) [2023-12-26 07:13:15,300][123090] Updated weights for policy 1, policy_version 948788 (0.0009) [2023-12-26 07:13:15,363][123090] Updated weights for policy 1, policy_version 948798 (0.0011) [2023-12-26 07:13:16,038][123091] Updated weights for policy 0, policy_version 955639 (0.0010) [2023-12-26 07:13:16,086][123091] Updated weights for policy 0, policy_version 955649 (0.0010) [2023-12-26 07:13:16,152][123091] Updated weights for policy 0, policy_version 955659 (0.0010) [2023-12-26 07:13:16,164][123090] Updated weights for policy 1, policy_version 948808 (0.0011) [2023-12-26 07:13:16,215][123090] Updated weights for policy 1, policy_version 948818 (0.0010) [2023-12-26 07:13:16,262][123090] Updated weights for policy 1, policy_version 948828 (0.0010) [2023-12-26 07:13:16,972][123091] Updated weights for policy 0, policy_version 955669 (0.0010) [2023-12-26 07:13:17,027][123091] Updated weights for policy 0, policy_version 955679 (0.0010) [2023-12-26 07:13:17,064][123090] Updated weights for policy 1, policy_version 948838 (0.0010) [2023-12-26 07:13:17,085][123091] Updated weights for policy 0, policy_version 955689 (0.0010) [2023-12-26 07:13:17,123][123090] Updated weights for policy 1, policy_version 948848 (0.0010) [2023-12-26 07:13:17,189][123090] Updated weights for policy 1, policy_version 948858 (0.0010) [2023-12-26 07:13:17,905][123091] Updated weights for policy 0, policy_version 955699 (0.0011) [2023-12-26 07:13:17,956][123091] Updated weights for policy 0, policy_version 955709 (0.0010) [2023-12-26 07:13:17,977][123090] Updated weights for policy 1, policy_version 948868 (0.0009) [2023-12-26 07:13:18,012][123091] Updated weights for policy 0, policy_version 955719 (0.0010) [2023-12-26 07:13:18,025][123090] Updated weights for policy 1, policy_version 948878 (0.0008) [2023-12-26 07:13:18,075][123090] Updated weights for policy 1, policy_version 948888 (0.0008) [2023-12-26 07:13:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 487587840. Throughput: 0: 9131.4, 1: 8733.1. Samples: 487602960. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:18,785][121949] Avg episode reward: [(0, '6061.027'), (1, '5718.428')] [2023-12-26 07:13:18,858][123091] Updated weights for policy 0, policy_version 955729 (0.0011) [2023-12-26 07:13:18,917][123091] Updated weights for policy 0, policy_version 955739 (0.0011) [2023-12-26 07:13:18,938][123090] Updated weights for policy 1, policy_version 948898 (0.0008) [2023-12-26 07:13:18,980][123091] Updated weights for policy 0, policy_version 955749 (0.0011) [2023-12-26 07:13:19,004][123090] Updated weights for policy 1, policy_version 948908 (0.0008) [2023-12-26 07:13:19,045][123091] Updated weights for policy 0, policy_version 955759 (0.0011) [2023-12-26 07:13:19,067][123090] Updated weights for policy 1, policy_version 948918 (0.0007) [2023-12-26 07:13:19,135][123090] Updated weights for policy 1, policy_version 948928 (0.0009) [2023-12-26 07:13:19,870][123091] Updated weights for policy 0, policy_version 955769 (0.0010) [2023-12-26 07:13:19,927][123091] Updated weights for policy 0, policy_version 955779 (0.0011) [2023-12-26 07:13:19,982][123090] Updated weights for policy 1, policy_version 948938 (0.0008) [2023-12-26 07:13:19,995][123091] Updated weights for policy 0, policy_version 955789 (0.0009) [2023-12-26 07:13:20,049][123090] Updated weights for policy 1, policy_version 948948 (0.0008) [2023-12-26 07:13:20,105][123090] Updated weights for policy 1, policy_version 948958 (0.0008) [2023-12-26 07:13:20,814][123090] Updated weights for policy 1, policy_version 948968 (0.0007) [2023-12-26 07:13:20,844][123091] Updated weights for policy 0, policy_version 955799 (0.0006) [2023-12-26 07:13:20,869][123090] Updated weights for policy 1, policy_version 948978 (0.0007) [2023-12-26 07:13:20,912][123091] Updated weights for policy 0, policy_version 955809 (0.0008) [2023-12-26 07:13:20,942][123090] Updated weights for policy 1, policy_version 948988 (0.0006) [2023-12-26 07:13:20,975][123091] Updated weights for policy 0, policy_version 955819 (0.0011) [2023-12-26 07:13:21,734][123090] Updated weights for policy 1, policy_version 948998 (0.0008) [2023-12-26 07:13:21,776][123091] Updated weights for policy 0, policy_version 955829 (0.0010) [2023-12-26 07:13:21,798][123090] Updated weights for policy 1, policy_version 949008 (0.0008) [2023-12-26 07:13:21,840][123091] Updated weights for policy 0, policy_version 955839 (0.0008) [2023-12-26 07:13:21,858][123090] Updated weights for policy 1, policy_version 949018 (0.0008) [2023-12-26 07:13:21,906][123091] Updated weights for policy 0, policy_version 955849 (0.0008) [2023-12-26 07:13:22,549][123091] Updated weights for policy 0, policy_version 955859 (0.0006) [2023-12-26 07:13:22,618][123090] Updated weights for policy 1, policy_version 949028 (0.0006) [2023-12-26 07:13:22,619][123091] Updated weights for policy 0, policy_version 955869 (0.0010) [2023-12-26 07:13:22,674][123090] Updated weights for policy 1, policy_version 949038 (0.0007) [2023-12-26 07:13:22,679][123091] Updated weights for policy 0, policy_version 955879 (0.0011) [2023-12-26 07:13:22,725][123090] Updated weights for policy 1, policy_version 949048 (0.0008) [2023-12-26 07:13:23,444][123091] Updated weights for policy 0, policy_version 955889 (0.0010) [2023-12-26 07:13:23,506][123091] Updated weights for policy 0, policy_version 955899 (0.0008) [2023-12-26 07:13:23,564][123091] Updated weights for policy 0, policy_version 955909 (0.0009) [2023-12-26 07:13:23,608][123090] Updated weights for policy 1, policy_version 949058 (0.0008) [2023-12-26 07:13:23,619][123091] Updated weights for policy 0, policy_version 955919 (0.0009) [2023-12-26 07:13:23,661][123090] Updated weights for policy 1, policy_version 949068 (0.0008) [2023-12-26 07:13:23,713][123090] Updated weights for policy 1, policy_version 949078 (0.0009) [2023-12-26 07:13:23,768][123090] Updated weights for policy 1, policy_version 949088 (0.0006) [2023-12-26 07:13:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 487686144. Throughput: 0: 9076.0, 1: 8790.3. Samples: 487655372. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:23,785][121949] Avg episode reward: [(0, '6163.248'), (1, '5545.134')] [2023-12-26 07:13:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000955920_244719616.pth... [2023-12-26 07:13:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000949088_242966528.pth... [2023-12-26 07:13:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000948064_242704384.pth [2023-12-26 07:13:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000954864_244449280.pth [2023-12-26 07:13:24,314][123091] Updated weights for policy 0, policy_version 955929 (0.0006) [2023-12-26 07:13:24,380][123091] Updated weights for policy 0, policy_version 955939 (0.0006) [2023-12-26 07:13:24,451][123091] Updated weights for policy 0, policy_version 955949 (0.0007) [2023-12-26 07:13:24,643][123090] Updated weights for policy 1, policy_version 949098 (0.0009) [2023-12-26 07:13:24,695][123090] Updated weights for policy 1, policy_version 949108 (0.0009) [2023-12-26 07:13:24,755][123090] Updated weights for policy 1, policy_version 949118 (0.0009) [2023-12-26 07:13:25,202][123091] Updated weights for policy 0, policy_version 955959 (0.0005) [2023-12-26 07:13:25,258][123091] Updated weights for policy 0, policy_version 955969 (0.0006) [2023-12-26 07:13:25,310][123091] Updated weights for policy 0, policy_version 955979 (0.0005) [2023-12-26 07:13:25,634][123090] Updated weights for policy 1, policy_version 949128 (0.0009) [2023-12-26 07:13:25,687][123090] Updated weights for policy 1, policy_version 949138 (0.0005) [2023-12-26 07:13:25,735][123090] Updated weights for policy 1, policy_version 949148 (0.0005) [2023-12-26 07:13:26,036][123091] Updated weights for policy 0, policy_version 955989 (0.0005) [2023-12-26 07:13:26,090][123091] Updated weights for policy 0, policy_version 955999 (0.0005) [2023-12-26 07:13:26,150][123091] Updated weights for policy 0, policy_version 956009 (0.0005) [2023-12-26 07:13:26,491][123090] Updated weights for policy 1, policy_version 949158 (0.0007) [2023-12-26 07:13:26,559][123090] Updated weights for policy 1, policy_version 949168 (0.0005) [2023-12-26 07:13:26,630][123090] Updated weights for policy 1, policy_version 949178 (0.0005) [2023-12-26 07:13:26,766][123091] Updated weights for policy 0, policy_version 956019 (0.0005) [2023-12-26 07:13:26,823][123091] Updated weights for policy 0, policy_version 956029 (0.0005) [2023-12-26 07:13:26,884][123091] Updated weights for policy 0, policy_version 956039 (0.0007) [2023-12-26 07:13:27,314][123090] Updated weights for policy 1, policy_version 949188 (0.0005) [2023-12-26 07:13:27,370][123090] Updated weights for policy 1, policy_version 949198 (0.0005) [2023-12-26 07:13:27,440][123090] Updated weights for policy 1, policy_version 949208 (0.0005) [2023-12-26 07:13:27,753][123091] Updated weights for policy 0, policy_version 956049 (0.0010) [2023-12-26 07:13:27,817][123091] Updated weights for policy 0, policy_version 956059 (0.0009) [2023-12-26 07:13:27,876][123091] Updated weights for policy 0, policy_version 956069 (0.0005) [2023-12-26 07:13:27,927][123091] Updated weights for policy 0, policy_version 956079 (0.0005) [2023-12-26 07:13:28,065][123090] Updated weights for policy 1, policy_version 949218 (0.0005) [2023-12-26 07:13:28,118][123090] Updated weights for policy 1, policy_version 949228 (0.0006) [2023-12-26 07:13:28,168][123090] Updated weights for policy 1, policy_version 949238 (0.0005) [2023-12-26 07:13:28,215][123090] Updated weights for policy 1, policy_version 949248 (0.0005) [2023-12-26 07:13:28,667][123091] Updated weights for policy 0, policy_version 956089 (0.0009) [2023-12-26 07:13:28,721][123091] Updated weights for policy 0, policy_version 956100 (0.0010) [2023-12-26 07:13:28,775][123091] Updated weights for policy 0, policy_version 956111 (0.0010) [2023-12-26 07:13:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 487776256. Throughput: 0: 9171.5, 1: 8800.1. Samples: 487765448. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:28,784][121949] Avg episode reward: [(0, '6126.317'), (1, '5262.104')] [2023-12-26 07:13:28,945][123090] Updated weights for policy 1, policy_version 949258 (0.0009) [2023-12-26 07:13:29,007][123090] Updated weights for policy 1, policy_version 949268 (0.0008) [2023-12-26 07:13:29,075][123090] Updated weights for policy 1, policy_version 949278 (0.0009) [2023-12-26 07:13:29,663][123091] Updated weights for policy 0, policy_version 956121 (0.0011) [2023-12-26 07:13:29,728][123091] Updated weights for policy 0, policy_version 956131 (0.0011) [2023-12-26 07:13:29,790][123091] Updated weights for policy 0, policy_version 956141 (0.0011) [2023-12-26 07:13:29,862][123090] Updated weights for policy 1, policy_version 949288 (0.0007) [2023-12-26 07:13:29,924][123090] Updated weights for policy 1, policy_version 949298 (0.0006) [2023-12-26 07:13:29,989][123090] Updated weights for policy 1, policy_version 949308 (0.0009) [2023-12-26 07:13:30,594][123091] Updated weights for policy 0, policy_version 956151 (0.0011) [2023-12-26 07:13:30,655][123091] Updated weights for policy 0, policy_version 956161 (0.0008) [2023-12-26 07:13:30,709][123091] Updated weights for policy 0, policy_version 956171 (0.0006) [2023-12-26 07:13:30,802][123090] Updated weights for policy 1, policy_version 949318 (0.0009) [2023-12-26 07:13:30,857][123090] Updated weights for policy 1, policy_version 949328 (0.0009) [2023-12-26 07:13:30,908][123090] Updated weights for policy 1, policy_version 949338 (0.0009) [2023-12-26 07:13:31,522][123091] Updated weights for policy 0, policy_version 956181 (0.0008) [2023-12-26 07:13:31,569][123091] Updated weights for policy 0, policy_version 956191 (0.0010) [2023-12-26 07:13:31,629][123091] Updated weights for policy 0, policy_version 956201 (0.0011) [2023-12-26 07:13:31,808][123090] Updated weights for policy 1, policy_version 949348 (0.0009) [2023-12-26 07:13:31,863][123090] Updated weights for policy 1, policy_version 949358 (0.0010) [2023-12-26 07:13:31,919][123090] Updated weights for policy 1, policy_version 949368 (0.0010) [2023-12-26 07:13:32,398][123091] Updated weights for policy 0, policy_version 956211 (0.0011) [2023-12-26 07:13:32,468][123091] Updated weights for policy 0, policy_version 956221 (0.0011) [2023-12-26 07:13:32,537][123091] Updated weights for policy 0, policy_version 956231 (0.0010) [2023-12-26 07:13:32,782][123090] Updated weights for policy 1, policy_version 949378 (0.0010) [2023-12-26 07:13:32,839][123090] Updated weights for policy 1, policy_version 949388 (0.0008) [2023-12-26 07:13:32,897][123090] Updated weights for policy 1, policy_version 949398 (0.0007) [2023-12-26 07:13:32,951][123090] Updated weights for policy 1, policy_version 949408 (0.0009) [2023-12-26 07:13:33,329][123091] Updated weights for policy 0, policy_version 956241 (0.0010) [2023-12-26 07:13:33,393][123091] Updated weights for policy 0, policy_version 956251 (0.0007) [2023-12-26 07:13:33,446][123091] Updated weights for policy 0, policy_version 956261 (0.0005) [2023-12-26 07:13:33,499][123091] Updated weights for policy 0, policy_version 956271 (0.0006) [2023-12-26 07:13:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 487858176. Throughput: 0: 9094.6, 1: 8732.6. Samples: 487871696. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:33,785][121949] Avg episode reward: [(0, '6068.903'), (1, '5384.162')] [2023-12-26 07:13:33,796][123090] Updated weights for policy 1, policy_version 949418 (0.0009) [2023-12-26 07:13:33,868][123090] Updated weights for policy 1, policy_version 949428 (0.0009) [2023-12-26 07:13:33,939][123090] Updated weights for policy 1, policy_version 949438 (0.0008) [2023-12-26 07:13:34,278][123091] Updated weights for policy 0, policy_version 956281 (0.0010) [2023-12-26 07:13:34,329][123091] Updated weights for policy 0, policy_version 956291 (0.0010) [2023-12-26 07:13:34,392][123091] Updated weights for policy 0, policy_version 956301 (0.0011) [2023-12-26 07:13:34,759][123090] Updated weights for policy 1, policy_version 949448 (0.0009) [2023-12-26 07:13:34,819][123090] Updated weights for policy 1, policy_version 949458 (0.0008) [2023-12-26 07:13:34,882][123090] Updated weights for policy 1, policy_version 949468 (0.0009) [2023-12-26 07:13:35,234][123091] Updated weights for policy 0, policy_version 956311 (0.0010) [2023-12-26 07:13:35,282][123091] Updated weights for policy 0, policy_version 956321 (0.0008) [2023-12-26 07:13:35,352][123091] Updated weights for policy 0, policy_version 956331 (0.0009) [2023-12-26 07:13:35,716][123090] Updated weights for policy 1, policy_version 949478 (0.0009) [2023-12-26 07:13:35,784][123090] Updated weights for policy 1, policy_version 949488 (0.0010) [2023-12-26 07:13:35,842][123090] Updated weights for policy 1, policy_version 949498 (0.0009) [2023-12-26 07:13:36,181][123091] Updated weights for policy 0, policy_version 956341 (0.0010) [2023-12-26 07:13:36,252][123091] Updated weights for policy 0, policy_version 956351 (0.0006) [2023-12-26 07:13:36,323][123091] Updated weights for policy 0, policy_version 956361 (0.0010) [2023-12-26 07:13:36,663][123090] Updated weights for policy 1, policy_version 949508 (0.0008) [2023-12-26 07:13:36,738][123090] Updated weights for policy 1, policy_version 949518 (0.0007) [2023-12-26 07:13:36,798][123090] Updated weights for policy 1, policy_version 949528 (0.0008) [2023-12-26 07:13:37,129][123091] Updated weights for policy 0, policy_version 956371 (0.0011) [2023-12-26 07:13:37,191][123091] Updated weights for policy 0, policy_version 956381 (0.0010) [2023-12-26 07:13:37,266][123091] Updated weights for policy 0, policy_version 956391 (0.0006) [2023-12-26 07:13:37,608][123090] Updated weights for policy 1, policy_version 949538 (0.0008) [2023-12-26 07:13:37,669][123090] Updated weights for policy 1, policy_version 949548 (0.0006) [2023-12-26 07:13:37,729][123090] Updated weights for policy 1, policy_version 949558 (0.0007) [2023-12-26 07:13:37,794][123090] Updated weights for policy 1, policy_version 949568 (0.0009) [2023-12-26 07:13:38,049][123091] Updated weights for policy 0, policy_version 956401 (0.0010) [2023-12-26 07:13:38,103][123091] Updated weights for policy 0, policy_version 956411 (0.0010) [2023-12-26 07:13:38,158][123091] Updated weights for policy 0, policy_version 956421 (0.0011) [2023-12-26 07:13:38,214][123091] Updated weights for policy 0, policy_version 956431 (0.0010) [2023-12-26 07:13:38,571][123090] Updated weights for policy 1, policy_version 949578 (0.0009) [2023-12-26 07:13:38,636][123090] Updated weights for policy 1, policy_version 949588 (0.0009) [2023-12-26 07:13:38,699][123090] Updated weights for policy 1, policy_version 949598 (0.0008) [2023-12-26 07:13:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 487948288. Throughput: 0: 9066.9, 1: 8703.3. Samples: 487922480. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:38,785][121949] Avg episode reward: [(0, '6201.985'), (1, '5604.855')] [2023-12-26 07:13:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000956432_244850688.pth... [2023-12-26 07:13:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000949600_243097600.pth... [2023-12-26 07:13:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000955408_244588544.pth [2023-12-26 07:13:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000948576_242835456.pth [2023-12-26 07:13:39,068][123091] Updated weights for policy 0, policy_version 956441 (0.0010) [2023-12-26 07:13:39,134][123091] Updated weights for policy 0, policy_version 956451 (0.0011) [2023-12-26 07:13:39,198][123091] Updated weights for policy 0, policy_version 956461 (0.0011) [2023-12-26 07:13:39,529][123090] Updated weights for policy 1, policy_version 949608 (0.0006) [2023-12-26 07:13:39,606][123090] Updated weights for policy 1, policy_version 949618 (0.0006) [2023-12-26 07:13:39,678][123090] Updated weights for policy 1, policy_version 949628 (0.0009) [2023-12-26 07:13:40,017][123091] Updated weights for policy 0, policy_version 956471 (0.0010) [2023-12-26 07:13:40,069][123091] Updated weights for policy 0, policy_version 956481 (0.0005) [2023-12-26 07:13:40,119][123091] Updated weights for policy 0, policy_version 956491 (0.0006) [2023-12-26 07:13:40,440][123090] Updated weights for policy 1, policy_version 949638 (0.0009) [2023-12-26 07:13:40,497][123090] Updated weights for policy 1, policy_version 949648 (0.0009) [2023-12-26 07:13:40,557][123090] Updated weights for policy 1, policy_version 949658 (0.0009) [2023-12-26 07:13:40,881][123091] Updated weights for policy 0, policy_version 956501 (0.0006) [2023-12-26 07:13:40,926][123091] Updated weights for policy 0, policy_version 956511 (0.0005) [2023-12-26 07:13:40,992][123091] Updated weights for policy 0, policy_version 956521 (0.0005) [2023-12-26 07:13:41,488][123090] Updated weights for policy 1, policy_version 949668 (0.0009) [2023-12-26 07:13:41,558][123090] Updated weights for policy 1, policy_version 949678 (0.0010) [2023-12-26 07:13:41,628][123090] Updated weights for policy 1, policy_version 949688 (0.0009) [2023-12-26 07:13:41,778][123091] Updated weights for policy 0, policy_version 956531 (0.0008) [2023-12-26 07:13:41,842][123091] Updated weights for policy 0, policy_version 956541 (0.0011) [2023-12-26 07:13:41,905][123091] Updated weights for policy 0, policy_version 956551 (0.0011) [2023-12-26 07:13:42,491][123090] Updated weights for policy 1, policy_version 949698 (0.0009) [2023-12-26 07:13:42,549][123090] Updated weights for policy 1, policy_version 949708 (0.0008) [2023-12-26 07:13:42,598][123090] Updated weights for policy 1, policy_version 949718 (0.0008) [2023-12-26 07:13:42,660][123090] Updated weights for policy 1, policy_version 949728 (0.0008) [2023-12-26 07:13:42,742][123091] Updated weights for policy 0, policy_version 956561 (0.0010) [2023-12-26 07:13:42,815][123091] Updated weights for policy 0, policy_version 956571 (0.0008) [2023-12-26 07:13:42,864][123091] Updated weights for policy 0, policy_version 956581 (0.0010) [2023-12-26 07:13:42,908][123091] Updated weights for policy 0, policy_version 956591 (0.0011) [2023-12-26 07:13:43,365][123090] Updated weights for policy 1, policy_version 949738 (0.0010) [2023-12-26 07:13:43,434][123090] Updated weights for policy 1, policy_version 949748 (0.0010) [2023-12-26 07:13:43,489][123090] Updated weights for policy 1, policy_version 949758 (0.0010) [2023-12-26 07:13:43,692][123091] Updated weights for policy 0, policy_version 956601 (0.0006) [2023-12-26 07:13:43,738][123091] Updated weights for policy 0, policy_version 956611 (0.0005) [2023-12-26 07:13:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 488030208. Throughput: 0: 8906.9, 1: 8634.7. Samples: 488025504. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:43,784][121949] Avg episode reward: [(0, '6217.375'), (1, '5587.284')] [2023-12-26 07:13:43,788][123091] Updated weights for policy 0, policy_version 956621 (0.0006) [2023-12-26 07:13:44,305][123090] Updated weights for policy 1, policy_version 949768 (0.0006) [2023-12-26 07:13:44,382][123090] Updated weights for policy 1, policy_version 949778 (0.0007) [2023-12-26 07:13:44,446][123090] Updated weights for policy 1, policy_version 949788 (0.0011) [2023-12-26 07:13:44,553][123091] Updated weights for policy 0, policy_version 956631 (0.0009) [2023-12-26 07:13:44,615][123091] Updated weights for policy 0, policy_version 956641 (0.0011) [2023-12-26 07:13:44,673][123091] Updated weights for policy 0, policy_version 956651 (0.0010) [2023-12-26 07:13:45,147][123090] Updated weights for policy 1, policy_version 949798 (0.0008) [2023-12-26 07:13:45,227][123090] Updated weights for policy 1, policy_version 949808 (0.0009) [2023-12-26 07:13:45,298][123090] Updated weights for policy 1, policy_version 949818 (0.0009) [2023-12-26 07:13:45,444][123091] Updated weights for policy 0, policy_version 956661 (0.0009) [2023-12-26 07:13:45,508][123091] Updated weights for policy 0, policy_version 956671 (0.0008) [2023-12-26 07:13:45,574][123091] Updated weights for policy 0, policy_version 956681 (0.0008) [2023-12-26 07:13:46,032][123090] Updated weights for policy 1, policy_version 949828 (0.0009) [2023-12-26 07:13:46,092][123090] Updated weights for policy 1, policy_version 949838 (0.0009) [2023-12-26 07:13:46,151][123090] Updated weights for policy 1, policy_version 949848 (0.0010) [2023-12-26 07:13:46,254][123091] Updated weights for policy 0, policy_version 956691 (0.0008) [2023-12-26 07:13:46,305][123091] Updated weights for policy 0, policy_version 956701 (0.0005) [2023-12-26 07:13:46,357][123091] Updated weights for policy 0, policy_version 956711 (0.0006) [2023-12-26 07:13:46,992][123090] Updated weights for policy 1, policy_version 949858 (0.0009) [2023-12-26 07:13:47,046][123090] Updated weights for policy 1, policy_version 949868 (0.0009) [2023-12-26 07:13:47,089][123091] Updated weights for policy 0, policy_version 956721 (0.0006) [2023-12-26 07:13:47,098][123090] Updated weights for policy 1, policy_version 949878 (0.0009) [2023-12-26 07:13:47,146][123091] Updated weights for policy 0, policy_version 956731 (0.0006) [2023-12-26 07:13:47,146][123090] Updated weights for policy 1, policy_version 949888 (0.0009) [2023-12-26 07:13:47,204][123091] Updated weights for policy 0, policy_version 956741 (0.0005) [2023-12-26 07:13:47,255][123091] Updated weights for policy 0, policy_version 956751 (0.0005) [2023-12-26 07:13:47,994][123091] Updated weights for policy 0, policy_version 956761 (0.0005) [2023-12-26 07:13:48,052][123090] Updated weights for policy 1, policy_version 949898 (0.0009) [2023-12-26 07:13:48,057][123091] Updated weights for policy 0, policy_version 956771 (0.0005) [2023-12-26 07:13:48,100][123090] Updated weights for policy 1, policy_version 949908 (0.0008) [2023-12-26 07:13:48,113][123091] Updated weights for policy 0, policy_version 956781 (0.0005) [2023-12-26 07:13:48,159][123090] Updated weights for policy 1, policy_version 949918 (0.0010) [2023-12-26 07:13:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 488120320. Throughput: 0: 8991.8, 1: 8623.8. Samples: 488134804. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:48,785][121949] Avg episode reward: [(0, '6185.053'), (1, '5646.229')] [2023-12-26 07:13:48,846][123091] Updated weights for policy 0, policy_version 956791 (0.0009) [2023-12-26 07:13:48,907][123091] Updated weights for policy 0, policy_version 956801 (0.0010) [2023-12-26 07:13:48,982][123091] Updated weights for policy 0, policy_version 956811 (0.0009) [2023-12-26 07:13:49,034][123090] Updated weights for policy 1, policy_version 949928 (0.0009) [2023-12-26 07:13:49,086][123090] Updated weights for policy 1, policy_version 949938 (0.0010) [2023-12-26 07:13:49,140][123090] Updated weights for policy 1, policy_version 949948 (0.0010) [2023-12-26 07:13:49,790][123091] Updated weights for policy 0, policy_version 956821 (0.0010) [2023-12-26 07:13:49,846][123091] Updated weights for policy 0, policy_version 956831 (0.0009) [2023-12-26 07:13:49,910][123091] Updated weights for policy 0, policy_version 956841 (0.0009) [2023-12-26 07:13:50,068][123090] Updated weights for policy 1, policy_version 949958 (0.0007) [2023-12-26 07:13:50,121][123090] Updated weights for policy 1, policy_version 949968 (0.0009) [2023-12-26 07:13:50,178][123090] Updated weights for policy 1, policy_version 949978 (0.0010) [2023-12-26 07:13:50,750][123091] Updated weights for policy 0, policy_version 956851 (0.0008) [2023-12-26 07:13:50,816][123091] Updated weights for policy 0, policy_version 956861 (0.0008) [2023-12-26 07:13:50,883][123091] Updated weights for policy 0, policy_version 956871 (0.0010) [2023-12-26 07:13:51,006][123090] Updated weights for policy 1, policy_version 949988 (0.0010) [2023-12-26 07:13:51,079][123090] Updated weights for policy 1, policy_version 949998 (0.0008) [2023-12-26 07:13:51,145][123090] Updated weights for policy 1, policy_version 950008 (0.0009) [2023-12-26 07:13:51,667][123091] Updated weights for policy 0, policy_version 956881 (0.0011) [2023-12-26 07:13:51,730][123091] Updated weights for policy 0, policy_version 956891 (0.0009) [2023-12-26 07:13:51,807][123091] Updated weights for policy 0, policy_version 956901 (0.0008) [2023-12-26 07:13:51,873][123091] Updated weights for policy 0, policy_version 956911 (0.0008) [2023-12-26 07:13:51,976][123090] Updated weights for policy 1, policy_version 950018 (0.0008) [2023-12-26 07:13:52,033][123090] Updated weights for policy 1, policy_version 950028 (0.0009) [2023-12-26 07:13:52,098][123090] Updated weights for policy 1, policy_version 950038 (0.0009) [2023-12-26 07:13:52,160][123090] Updated weights for policy 1, policy_version 950048 (0.0010) [2023-12-26 07:13:52,680][123091] Updated weights for policy 0, policy_version 956921 (0.0009) [2023-12-26 07:13:52,741][123091] Updated weights for policy 0, policy_version 956931 (0.0009) [2023-12-26 07:13:52,805][123091] Updated weights for policy 0, policy_version 956941 (0.0010) [2023-12-26 07:13:52,961][123090] Updated weights for policy 1, policy_version 950058 (0.0009) [2023-12-26 07:13:53,027][123090] Updated weights for policy 1, policy_version 950068 (0.0008) [2023-12-26 07:13:53,087][123090] Updated weights for policy 1, policy_version 950078 (0.0006) [2023-12-26 07:13:53,548][123091] Updated weights for policy 0, policy_version 956951 (0.0010) [2023-12-26 07:13:53,603][123091] Updated weights for policy 0, policy_version 956961 (0.0006) [2023-12-26 07:13:53,671][123091] Updated weights for policy 0, policy_version 956971 (0.0005) [2023-12-26 07:13:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 488210432. Throughput: 0: 8907.7, 1: 8630.8. Samples: 488185724. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:53,785][121949] Avg episode reward: [(0, '6130.540'), (1, '5749.504')] [2023-12-26 07:13:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000950080_243220480.pth... [2023-12-26 07:13:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000956976_244989952.pth... [2023-12-26 07:13:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000949088_242966528.pth [2023-12-26 07:13:53,797][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000950080_243220480.pth [2023-12-26 07:13:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000955920_244719616.pth [2023-12-26 07:13:53,799][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000956976_244989952.pth [2023-12-26 07:13:53,946][123090] Updated weights for policy 1, policy_version 950088 (0.0010) [2023-12-26 07:13:54,001][123090] Updated weights for policy 1, policy_version 950098 (0.0009) [2023-12-26 07:13:54,048][123090] Updated weights for policy 1, policy_version 950108 (0.0008) [2023-12-26 07:13:54,324][123091] Updated weights for policy 0, policy_version 956981 (0.0008) [2023-12-26 07:13:54,387][123091] Updated weights for policy 0, policy_version 956991 (0.0011) [2023-12-26 07:13:54,454][123091] Updated weights for policy 0, policy_version 957001 (0.0011) [2023-12-26 07:13:54,953][123090] Updated weights for policy 1, policy_version 950118 (0.0009) [2023-12-26 07:13:55,007][123090] Updated weights for policy 1, policy_version 950128 (0.0010) [2023-12-26 07:13:55,066][123090] Updated weights for policy 1, policy_version 950138 (0.0010) [2023-12-26 07:13:55,149][123091] Updated weights for policy 0, policy_version 957011 (0.0009) [2023-12-26 07:13:55,214][123091] Updated weights for policy 0, policy_version 957021 (0.0006) [2023-12-26 07:13:55,272][123091] Updated weights for policy 0, policy_version 957031 (0.0006) [2023-12-26 07:13:55,830][123090] Updated weights for policy 1, policy_version 950148 (0.0008) [2023-12-26 07:13:55,887][123090] Updated weights for policy 1, policy_version 950158 (0.0005) [2023-12-26 07:13:55,944][123090] Updated weights for policy 1, policy_version 950168 (0.0005) [2023-12-26 07:13:56,063][123091] Updated weights for policy 0, policy_version 957041 (0.0006) [2023-12-26 07:13:56,120][123091] Updated weights for policy 0, policy_version 957051 (0.0010) [2023-12-26 07:13:56,173][123091] Updated weights for policy 0, policy_version 957061 (0.0009) [2023-12-26 07:13:56,216][123091] Updated weights for policy 0, policy_version 957071 (0.0006) [2023-12-26 07:13:56,601][123090] Updated weights for policy 1, policy_version 950178 (0.0005) [2023-12-26 07:13:56,663][123090] Updated weights for policy 1, policy_version 950188 (0.0007) [2023-12-26 07:13:56,725][123090] Updated weights for policy 1, policy_version 950198 (0.0010) [2023-12-26 07:13:56,773][123090] Updated weights for policy 1, policy_version 950208 (0.0010) [2023-12-26 07:13:56,929][123091] Updated weights for policy 0, policy_version 957081 (0.0005) [2023-12-26 07:13:56,981][123091] Updated weights for policy 0, policy_version 957091 (0.0005) [2023-12-26 07:13:57,031][123091] Updated weights for policy 0, policy_version 957101 (0.0005) [2023-12-26 07:13:57,464][123090] Updated weights for policy 1, policy_version 950218 (0.0005) [2023-12-26 07:13:57,518][123090] Updated weights for policy 1, policy_version 950228 (0.0005) [2023-12-26 07:13:57,582][123090] Updated weights for policy 1, policy_version 950238 (0.0005) [2023-12-26 07:13:57,809][123091] Updated weights for policy 0, policy_version 957111 (0.0009) [2023-12-26 07:13:57,873][123091] Updated weights for policy 0, policy_version 957121 (0.0010) [2023-12-26 07:13:57,941][123091] Updated weights for policy 0, policy_version 957131 (0.0009) [2023-12-26 07:13:58,348][123090] Updated weights for policy 1, policy_version 950248 (0.0009) [2023-12-26 07:13:58,420][123090] Updated weights for policy 1, policy_version 950258 (0.0009) [2023-12-26 07:13:58,485][123090] Updated weights for policy 1, policy_version 950268 (0.0008) [2023-12-26 07:13:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 488300544. Throughput: 0: 8980.4, 1: 8750.0. Samples: 488296200. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:13:58,785][121949] Avg episode reward: [(0, '6145.645'), (1, '5349.529')] [2023-12-26 07:13:58,926][123091] Updated weights for policy 0, policy_version 957141 (0.0009) [2023-12-26 07:13:58,995][123091] Updated weights for policy 0, policy_version 957151 (0.0009) [2023-12-26 07:13:59,068][123091] Updated weights for policy 0, policy_version 957161 (0.0010) [2023-12-26 07:13:59,339][123090] Updated weights for policy 1, policy_version 950278 (0.0009) [2023-12-26 07:13:59,403][123090] Updated weights for policy 1, policy_version 950288 (0.0009) [2023-12-26 07:13:59,456][123090] Updated weights for policy 1, policy_version 950298 (0.0010) [2023-12-26 07:13:59,835][123091] Updated weights for policy 0, policy_version 957171 (0.0010) [2023-12-26 07:13:59,896][123091] Updated weights for policy 0, policy_version 957181 (0.0010) [2023-12-26 07:13:59,965][123091] Updated weights for policy 0, policy_version 957191 (0.0009) [2023-12-26 07:14:00,333][123090] Updated weights for policy 1, policy_version 950308 (0.0010) [2023-12-26 07:14:00,381][123090] Updated weights for policy 1, policy_version 950318 (0.0009) [2023-12-26 07:14:00,433][123090] Updated weights for policy 1, policy_version 950329 (0.0010) [2023-12-26 07:14:00,800][123091] Updated weights for policy 0, policy_version 957201 (0.0009) [2023-12-26 07:14:00,848][123091] Updated weights for policy 0, policy_version 957211 (0.0009) [2023-12-26 07:14:00,903][123091] Updated weights for policy 0, policy_version 957221 (0.0009) [2023-12-26 07:14:00,952][123091] Updated weights for policy 0, policy_version 957231 (0.0009) [2023-12-26 07:14:01,313][123090] Updated weights for policy 1, policy_version 950339 (0.0009) [2023-12-26 07:14:01,375][123090] Updated weights for policy 1, policy_version 950349 (0.0008) [2023-12-26 07:14:01,439][123090] Updated weights for policy 1, policy_version 950359 (0.0008) [2023-12-26 07:14:01,744][123091] Updated weights for policy 0, policy_version 957241 (0.0009) [2023-12-26 07:14:01,801][123091] Updated weights for policy 0, policy_version 957251 (0.0009) [2023-12-26 07:14:01,868][123091] Updated weights for policy 0, policy_version 957261 (0.0009) [2023-12-26 07:14:02,200][123090] Updated weights for policy 1, policy_version 950369 (0.0008) [2023-12-26 07:14:02,266][123090] Updated weights for policy 1, policy_version 950379 (0.0010) [2023-12-26 07:14:02,322][123090] Updated weights for policy 1, policy_version 950389 (0.0008) [2023-12-26 07:14:02,392][123090] Updated weights for policy 1, policy_version 950399 (0.0010) [2023-12-26 07:14:02,729][123091] Updated weights for policy 0, policy_version 957271 (0.0009) [2023-12-26 07:14:02,794][123091] Updated weights for policy 0, policy_version 957281 (0.0009) [2023-12-26 07:14:02,861][123091] Updated weights for policy 0, policy_version 957291 (0.0010) [2023-12-26 07:14:03,146][123090] Updated weights for policy 1, policy_version 950409 (0.0009) [2023-12-26 07:14:03,213][123090] Updated weights for policy 1, policy_version 950419 (0.0009) [2023-12-26 07:14:03,275][123090] Updated weights for policy 1, policy_version 950429 (0.0009) [2023-12-26 07:14:03,754][123091] Updated weights for policy 0, policy_version 957301 (0.0009) [2023-12-26 07:14:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 488382464. Throughput: 0: 8943.4, 1: 8731.8. Samples: 488398344. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:03,785][121949] Avg episode reward: [(0, '6269.047'), (1, '5272.102')] [2023-12-26 07:14:03,825][123091] Updated weights for policy 0, policy_version 957311 (0.0009) [2023-12-26 07:14:03,893][123091] Updated weights for policy 0, policy_version 957321 (0.0009) [2023-12-26 07:14:04,032][123090] Updated weights for policy 1, policy_version 950439 (0.0009) [2023-12-26 07:14:04,084][123090] Updated weights for policy 1, policy_version 950449 (0.0010) [2023-12-26 07:14:04,155][123090] Updated weights for policy 1, policy_version 950459 (0.0010) [2023-12-26 07:14:04,719][123091] Updated weights for policy 0, policy_version 957331 (0.0009) [2023-12-26 07:14:04,785][123091] Updated weights for policy 0, policy_version 957341 (0.0009) [2023-12-26 07:14:04,851][123091] Updated weights for policy 0, policy_version 957351 (0.0009) [2023-12-26 07:14:05,015][123090] Updated weights for policy 1, policy_version 950469 (0.0010) [2023-12-26 07:14:05,063][123090] Updated weights for policy 1, policy_version 950479 (0.0010) [2023-12-26 07:14:05,125][123090] Updated weights for policy 1, policy_version 950489 (0.0010) [2023-12-26 07:14:05,514][123091] Updated weights for policy 0, policy_version 957361 (0.0009) [2023-12-26 07:14:05,565][123091] Updated weights for policy 0, policy_version 957371 (0.0005) [2023-12-26 07:14:05,610][123091] Updated weights for policy 0, policy_version 957381 (0.0005) [2023-12-26 07:14:05,656][123091] Updated weights for policy 0, policy_version 957391 (0.0005) [2023-12-26 07:14:05,823][123090] Updated weights for policy 1, policy_version 950499 (0.0009) [2023-12-26 07:14:05,870][123090] Updated weights for policy 1, policy_version 950509 (0.0005) [2023-12-26 07:14:05,921][123090] Updated weights for policy 1, policy_version 950519 (0.0005) [2023-12-26 07:14:06,390][123091] Updated weights for policy 0, policy_version 957401 (0.0006) [2023-12-26 07:14:06,467][123091] Updated weights for policy 0, policy_version 957411 (0.0006) [2023-12-26 07:14:06,537][123091] Updated weights for policy 0, policy_version 957421 (0.0009) [2023-12-26 07:14:06,646][123090] Updated weights for policy 1, policy_version 950529 (0.0005) [2023-12-26 07:14:06,716][123090] Updated weights for policy 1, policy_version 950539 (0.0009) [2023-12-26 07:14:06,784][123090] Updated weights for policy 1, policy_version 950549 (0.0010) [2023-12-26 07:14:06,848][123090] Updated weights for policy 1, policy_version 950559 (0.0010) [2023-12-26 07:14:07,265][123091] Updated weights for policy 0, policy_version 957431 (0.0009) [2023-12-26 07:14:07,319][123091] Updated weights for policy 0, policy_version 957441 (0.0010) [2023-12-26 07:14:07,382][123091] Updated weights for policy 0, policy_version 957451 (0.0010) [2023-12-26 07:14:07,619][123090] Updated weights for policy 1, policy_version 950569 (0.0009) [2023-12-26 07:14:07,681][123090] Updated weights for policy 1, policy_version 950579 (0.0009) [2023-12-26 07:14:07,737][123090] Updated weights for policy 1, policy_version 950589 (0.0010) [2023-12-26 07:14:08,232][123091] Updated weights for policy 0, policy_version 957461 (0.0008) [2023-12-26 07:14:08,301][123091] Updated weights for policy 0, policy_version 957471 (0.0007) [2023-12-26 07:14:08,377][123091] Updated weights for policy 0, policy_version 957481 (0.0008) [2023-12-26 07:14:08,392][123090] Updated weights for policy 1, policy_version 950599 (0.0009) [2023-12-26 07:14:08,467][123090] Updated weights for policy 1, policy_version 950609 (0.0013) [2023-12-26 07:14:08,535][123090] Updated weights for policy 1, policy_version 950619 (0.0010) [2023-12-26 07:14:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 488480768. Throughput: 0: 8988.3, 1: 8762.3. Samples: 488454152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:08,785][121949] Avg episode reward: [(0, '6261.490'), (1, '5389.335')] [2023-12-26 07:14:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000957488_245121024.pth... [2023-12-26 07:14:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000950624_243359744.pth... [2023-12-26 07:14:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000956432_244850688.pth [2023-12-26 07:14:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000949600_243097600.pth [2023-12-26 07:14:09,038][123091] Updated weights for policy 0, policy_version 957491 (0.0006) [2023-12-26 07:14:09,095][123091] Updated weights for policy 0, policy_version 957501 (0.0005) [2023-12-26 07:14:09,141][123091] Updated weights for policy 0, policy_version 957511 (0.0005) [2023-12-26 07:14:09,269][123090] Updated weights for policy 1, policy_version 950629 (0.0013) [2023-12-26 07:14:09,342][123090] Updated weights for policy 1, policy_version 950639 (0.0009) [2023-12-26 07:14:09,412][123090] Updated weights for policy 1, policy_version 950649 (0.0010) [2023-12-26 07:14:09,944][123091] Updated weights for policy 0, policy_version 957521 (0.0006) [2023-12-26 07:14:09,997][123091] Updated weights for policy 0, policy_version 957531 (0.0009) [2023-12-26 07:14:10,060][123091] Updated weights for policy 0, policy_version 957541 (0.0010) [2023-12-26 07:14:10,119][123091] Updated weights for policy 0, policy_version 957551 (0.0010) [2023-12-26 07:14:10,222][123090] Updated weights for policy 1, policy_version 950659 (0.0009) [2023-12-26 07:14:10,292][123090] Updated weights for policy 1, policy_version 950669 (0.0005) [2023-12-26 07:14:10,368][123090] Updated weights for policy 1, policy_version 950679 (0.0005) [2023-12-26 07:14:10,961][123091] Updated weights for policy 0, policy_version 957561 (0.0009) [2023-12-26 07:14:11,009][123091] Updated weights for policy 0, policy_version 957571 (0.0009) [2023-12-26 07:14:11,048][123090] Updated weights for policy 1, policy_version 950689 (0.0005) [2023-12-26 07:14:11,074][123091] Updated weights for policy 0, policy_version 957581 (0.0010) [2023-12-26 07:14:11,115][123090] Updated weights for policy 1, policy_version 950699 (0.0009) [2023-12-26 07:14:11,190][123090] Updated weights for policy 1, policy_version 950709 (0.0008) [2023-12-26 07:14:11,261][123090] Updated weights for policy 1, policy_version 950719 (0.0006) [2023-12-26 07:14:11,948][123091] Updated weights for policy 0, policy_version 957591 (0.0009) [2023-12-26 07:14:12,000][123091] Updated weights for policy 0, policy_version 957601 (0.0011) [2023-12-26 07:14:12,057][123091] Updated weights for policy 0, policy_version 957611 (0.0009) [2023-12-26 07:14:12,070][123090] Updated weights for policy 1, policy_version 950729 (0.0010) [2023-12-26 07:14:12,134][123090] Updated weights for policy 1, policy_version 950739 (0.0011) [2023-12-26 07:14:12,194][123090] Updated weights for policy 1, policy_version 950749 (0.0010) [2023-12-26 07:14:12,863][123091] Updated weights for policy 0, policy_version 957621 (0.0006) [2023-12-26 07:14:12,930][123091] Updated weights for policy 0, policy_version 957631 (0.0010) [2023-12-26 07:14:12,986][123091] Updated weights for policy 0, policy_version 957641 (0.0011) [2023-12-26 07:14:13,033][123090] Updated weights for policy 1, policy_version 950759 (0.0008) [2023-12-26 07:14:13,081][123090] Updated weights for policy 1, policy_version 950769 (0.0009) [2023-12-26 07:14:13,132][123090] Updated weights for policy 1, policy_version 950779 (0.0006) [2023-12-26 07:14:13,767][123091] Updated weights for policy 0, policy_version 957651 (0.0009) [2023-12-26 07:14:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 488562688. Throughput: 0: 8887.8, 1: 8783.1. Samples: 488560640. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:13,784][121949] Avg episode reward: [(0, '6227.863'), (1, '5425.656')] [2023-12-26 07:14:13,829][123091] Updated weights for policy 0, policy_version 957661 (0.0007) [2023-12-26 07:14:13,847][123090] Updated weights for policy 1, policy_version 950789 (0.0006) [2023-12-26 07:14:13,895][123090] Updated weights for policy 1, policy_version 950799 (0.0010) [2023-12-26 07:14:13,895][123091] Updated weights for policy 0, policy_version 957671 (0.0005) [2023-12-26 07:14:13,953][123090] Updated weights for policy 1, policy_version 950809 (0.0010) [2023-12-26 07:14:14,558][123091] Updated weights for policy 0, policy_version 957681 (0.0008) [2023-12-26 07:14:14,615][123091] Updated weights for policy 0, policy_version 957691 (0.0009) [2023-12-26 07:14:14,673][123091] Updated weights for policy 0, policy_version 957701 (0.0010) [2023-12-26 07:14:14,732][123090] Updated weights for policy 1, policy_version 950819 (0.0009) [2023-12-26 07:14:14,749][123091] Updated weights for policy 0, policy_version 957711 (0.0009) [2023-12-26 07:14:14,794][123090] Updated weights for policy 1, policy_version 950829 (0.0009) [2023-12-26 07:14:14,858][123090] Updated weights for policy 1, policy_version 950839 (0.0011) [2023-12-26 07:14:15,554][123090] Updated weights for policy 1, policy_version 950849 (0.0010) [2023-12-26 07:14:15,594][123091] Updated weights for policy 0, policy_version 957721 (0.0009) [2023-12-26 07:14:15,608][123090] Updated weights for policy 1, policy_version 950859 (0.0007) [2023-12-26 07:14:15,645][123091] Updated weights for policy 0, policy_version 957731 (0.0010) [2023-12-26 07:14:15,660][123090] Updated weights for policy 1, policy_version 950869 (0.0009) [2023-12-26 07:14:15,699][123091] Updated weights for policy 0, policy_version 957741 (0.0009) [2023-12-26 07:14:15,723][123090] Updated weights for policy 1, policy_version 950879 (0.0006) [2023-12-26 07:14:16,471][123090] Updated weights for policy 1, policy_version 950889 (0.0006) [2023-12-26 07:14:16,525][123090] Updated weights for policy 1, policy_version 950899 (0.0010) [2023-12-26 07:14:16,587][123090] Updated weights for policy 1, policy_version 950909 (0.0007) [2023-12-26 07:14:16,614][123091] Updated weights for policy 0, policy_version 957751 (0.0009) [2023-12-26 07:14:16,681][123091] Updated weights for policy 0, policy_version 957761 (0.0010) [2023-12-26 07:14:16,749][123091] Updated weights for policy 0, policy_version 957771 (0.0010) [2023-12-26 07:14:17,307][123090] Updated weights for policy 1, policy_version 950919 (0.0006) [2023-12-26 07:14:17,369][123090] Updated weights for policy 1, policy_version 950929 (0.0006) [2023-12-26 07:14:17,430][123090] Updated weights for policy 1, policy_version 950939 (0.0009) [2023-12-26 07:14:17,613][123091] Updated weights for policy 0, policy_version 957781 (0.0007) [2023-12-26 07:14:17,675][123091] Updated weights for policy 0, policy_version 957791 (0.0005) [2023-12-26 07:14:17,751][123091] Updated weights for policy 0, policy_version 957801 (0.0006) [2023-12-26 07:14:18,192][123090] Updated weights for policy 1, policy_version 950949 (0.0008) [2023-12-26 07:14:18,251][123090] Updated weights for policy 1, policy_version 950959 (0.0009) [2023-12-26 07:14:18,316][123090] Updated weights for policy 1, policy_version 950969 (0.0009) [2023-12-26 07:14:18,466][123091] Updated weights for policy 0, policy_version 957811 (0.0009) [2023-12-26 07:14:18,527][123091] Updated weights for policy 0, policy_version 957821 (0.0008) [2023-12-26 07:14:18,599][123091] Updated weights for policy 0, policy_version 957831 (0.0005) [2023-12-26 07:14:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 488660992. Throughput: 0: 8893.0, 1: 8843.4. Samples: 488669832. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:18,785][121949] Avg episode reward: [(0, '6111.428'), (1, '5630.729')] [2023-12-26 07:14:19,156][123090] Updated weights for policy 1, policy_version 950979 (0.0009) [2023-12-26 07:14:19,219][123090] Updated weights for policy 1, policy_version 950990 (0.0009) [2023-12-26 07:14:19,286][123090] Updated weights for policy 1, policy_version 951000 (0.0008) [2023-12-26 07:14:19,305][123091] Updated weights for policy 0, policy_version 957841 (0.0006) [2023-12-26 07:14:19,385][123091] Updated weights for policy 0, policy_version 957851 (0.0009) [2023-12-26 07:14:19,447][123091] Updated weights for policy 0, policy_version 957861 (0.0010) [2023-12-26 07:14:19,509][123091] Updated weights for policy 0, policy_version 957871 (0.0009) [2023-12-26 07:14:19,976][123090] Updated weights for policy 1, policy_version 951010 (0.0007) [2023-12-26 07:14:20,051][123090] Updated weights for policy 1, policy_version 951020 (0.0008) [2023-12-26 07:14:20,118][123090] Updated weights for policy 1, policy_version 951030 (0.0008) [2023-12-26 07:14:20,170][123090] Updated weights for policy 1, policy_version 951040 (0.0008) [2023-12-26 07:14:20,429][123091] Updated weights for policy 0, policy_version 957881 (0.0009) [2023-12-26 07:14:20,501][123091] Updated weights for policy 0, policy_version 957891 (0.0009) [2023-12-26 07:14:20,563][123091] Updated weights for policy 0, policy_version 957901 (0.0009) [2023-12-26 07:14:20,998][123090] Updated weights for policy 1, policy_version 951050 (0.0011) [2023-12-26 07:14:21,073][123090] Updated weights for policy 1, policy_version 951060 (0.0010) [2023-12-26 07:14:21,142][123090] Updated weights for policy 1, policy_version 951070 (0.0010) [2023-12-26 07:14:21,427][123091] Updated weights for policy 0, policy_version 957911 (0.0010) [2023-12-26 07:14:21,496][123091] Updated weights for policy 0, policy_version 957921 (0.0010) [2023-12-26 07:14:21,553][123091] Updated weights for policy 0, policy_version 957931 (0.0009) [2023-12-26 07:14:21,960][123090] Updated weights for policy 1, policy_version 951080 (0.0008) [2023-12-26 07:14:22,033][123090] Updated weights for policy 1, policy_version 951090 (0.0008) [2023-12-26 07:14:22,100][123090] Updated weights for policy 1, policy_version 951100 (0.0009) [2023-12-26 07:14:22,447][123091] Updated weights for policy 0, policy_version 957941 (0.0010) [2023-12-26 07:14:22,503][123091] Updated weights for policy 0, policy_version 957951 (0.0011) [2023-12-26 07:14:22,555][123091] Updated weights for policy 0, policy_version 957961 (0.0010) [2023-12-26 07:14:22,878][123090] Updated weights for policy 1, policy_version 951110 (0.0009) [2023-12-26 07:14:22,951][123090] Updated weights for policy 1, policy_version 951120 (0.0010) [2023-12-26 07:14:23,019][123090] Updated weights for policy 1, policy_version 951130 (0.0007) [2023-12-26 07:14:23,241][123091] Updated weights for policy 0, policy_version 957971 (0.0009) [2023-12-26 07:14:23,304][123091] Updated weights for policy 0, policy_version 957981 (0.0006) [2023-12-26 07:14:23,356][123091] Updated weights for policy 0, policy_version 957991 (0.0005) [2023-12-26 07:14:23,739][123090] Updated weights for policy 1, policy_version 951140 (0.0006) [2023-12-26 07:14:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 488742912. Throughput: 0: 8888.6, 1: 8873.5. Samples: 488721772. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:23,784][121949] Avg episode reward: [(0, '5892.312'), (1, '5647.750')] [2023-12-26 07:14:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000958000_245252096.pth... [2023-12-26 07:14:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000956976_244989952.pth [2023-12-26 07:14:23,804][123090] Updated weights for policy 1, policy_version 951151 (0.0007) [2023-12-26 07:14:23,874][123090] Updated weights for policy 1, policy_version 951161 (0.0005) [2023-12-26 07:14:23,921][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000951168_243499008.pth... [2023-12-26 07:14:23,926][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000950080_243220480.pth [2023-12-26 07:14:24,071][123091] Updated weights for policy 0, policy_version 958001 (0.0006) [2023-12-26 07:14:24,120][123091] Updated weights for policy 0, policy_version 958011 (0.0009) [2023-12-26 07:14:24,176][123091] Updated weights for policy 0, policy_version 958023 (0.0011) [2023-12-26 07:14:24,559][123090] Updated weights for policy 1, policy_version 951171 (0.0006) [2023-12-26 07:14:24,606][123090] Updated weights for policy 1, policy_version 951181 (0.0005) [2023-12-26 07:14:24,667][123090] Updated weights for policy 1, policy_version 951191 (0.0006) [2023-12-26 07:14:25,004][123091] Updated weights for policy 0, policy_version 958033 (0.0010) [2023-12-26 07:14:25,072][123091] Updated weights for policy 0, policy_version 958043 (0.0011) [2023-12-26 07:14:25,131][123091] Updated weights for policy 0, policy_version 958053 (0.0011) [2023-12-26 07:14:25,197][123091] Updated weights for policy 0, policy_version 958063 (0.0010) [2023-12-26 07:14:25,477][123090] Updated weights for policy 1, policy_version 951201 (0.0011) [2023-12-26 07:14:25,540][123090] Updated weights for policy 1, policy_version 951211 (0.0010) [2023-12-26 07:14:25,605][123090] Updated weights for policy 1, policy_version 951221 (0.0005) [2023-12-26 07:14:25,677][123090] Updated weights for policy 1, policy_version 951231 (0.0005) [2023-12-26 07:14:26,001][123091] Updated weights for policy 0, policy_version 958073 (0.0011) [2023-12-26 07:14:26,048][123091] Updated weights for policy 0, policy_version 958083 (0.0010) [2023-12-26 07:14:26,095][123091] Updated weights for policy 0, policy_version 958093 (0.0010) [2023-12-26 07:14:26,375][123090] Updated weights for policy 1, policy_version 951241 (0.0010) [2023-12-26 07:14:26,439][123090] Updated weights for policy 1, policy_version 951251 (0.0010) [2023-12-26 07:14:26,498][123090] Updated weights for policy 1, policy_version 951261 (0.0010) [2023-12-26 07:14:26,926][123091] Updated weights for policy 0, policy_version 958103 (0.0010) [2023-12-26 07:14:26,976][123091] Updated weights for policy 0, policy_version 958113 (0.0010) [2023-12-26 07:14:27,024][123091] Updated weights for policy 0, policy_version 958123 (0.0010) [2023-12-26 07:14:27,301][123090] Updated weights for policy 1, policy_version 951271 (0.0009) [2023-12-26 07:14:27,365][123090] Updated weights for policy 1, policy_version 951281 (0.0007) [2023-12-26 07:14:27,422][123090] Updated weights for policy 1, policy_version 951291 (0.0006) [2023-12-26 07:14:27,723][123091] Updated weights for policy 0, policy_version 958133 (0.0007) [2023-12-26 07:14:27,768][123091] Updated weights for policy 0, policy_version 958143 (0.0005) [2023-12-26 07:14:27,826][123091] Updated weights for policy 0, policy_version 958153 (0.0005) [2023-12-26 07:14:28,089][123090] Updated weights for policy 1, policy_version 951301 (0.0008) [2023-12-26 07:14:28,158][123090] Updated weights for policy 1, policy_version 951311 (0.0006) [2023-12-26 07:14:28,229][123090] Updated weights for policy 1, policy_version 951321 (0.0007) [2023-12-26 07:14:28,562][123091] Updated weights for policy 0, policy_version 958163 (0.0007) [2023-12-26 07:14:28,635][123091] Updated weights for policy 0, policy_version 958173 (0.0011) [2023-12-26 07:14:28,701][123091] Updated weights for policy 0, policy_version 958183 (0.0010) [2023-12-26 07:14:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 488841216. Throughput: 0: 8926.4, 1: 8986.6. Samples: 488831588. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:28,785][121949] Avg episode reward: [(0, '5813.830'), (1, '5542.811')] [2023-12-26 07:14:28,923][123090] Updated weights for policy 1, policy_version 951331 (0.0007) [2023-12-26 07:14:28,986][123090] Updated weights for policy 1, policy_version 951341 (0.0005) [2023-12-26 07:14:29,041][123090] Updated weights for policy 1, policy_version 951351 (0.0006) [2023-12-26 07:14:29,558][123091] Updated weights for policy 0, policy_version 958193 (0.0010) [2023-12-26 07:14:29,620][123091] Updated weights for policy 0, policy_version 958203 (0.0006) [2023-12-26 07:14:29,675][123091] Updated weights for policy 0, policy_version 958213 (0.0005) [2023-12-26 07:14:29,733][123091] Updated weights for policy 0, policy_version 958223 (0.0009) [2023-12-26 07:14:29,800][123090] Updated weights for policy 1, policy_version 951361 (0.0006) [2023-12-26 07:14:29,867][123090] Updated weights for policy 1, policy_version 951371 (0.0010) [2023-12-26 07:14:29,937][123090] Updated weights for policy 1, policy_version 951381 (0.0010) [2023-12-26 07:14:30,002][123090] Updated weights for policy 1, policy_version 951391 (0.0009) [2023-12-26 07:14:30,567][123091] Updated weights for policy 0, policy_version 958233 (0.0009) [2023-12-26 07:14:30,635][123091] Updated weights for policy 0, policy_version 958243 (0.0009) [2023-12-26 07:14:30,699][123091] Updated weights for policy 0, policy_version 958253 (0.0009) [2023-12-26 07:14:30,831][123090] Updated weights for policy 1, policy_version 951401 (0.0010) [2023-12-26 07:14:30,891][123090] Updated weights for policy 1, policy_version 951411 (0.0009) [2023-12-26 07:14:30,947][123090] Updated weights for policy 1, policy_version 951421 (0.0009) [2023-12-26 07:14:31,509][123091] Updated weights for policy 0, policy_version 958263 (0.0010) [2023-12-26 07:14:31,560][123091] Updated weights for policy 0, policy_version 958273 (0.0009) [2023-12-26 07:14:31,625][123091] Updated weights for policy 0, policy_version 958283 (0.0010) [2023-12-26 07:14:31,780][123090] Updated weights for policy 1, policy_version 951431 (0.0006) [2023-12-26 07:14:31,839][123090] Updated weights for policy 1, policy_version 951441 (0.0005) [2023-12-26 07:14:31,897][123090] Updated weights for policy 1, policy_version 951451 (0.0005) [2023-12-26 07:14:32,542][123091] Updated weights for policy 0, policy_version 958293 (0.0008) [2023-12-26 07:14:32,569][123090] Updated weights for policy 1, policy_version 951461 (0.0005) [2023-12-26 07:14:32,616][123091] Updated weights for policy 0, policy_version 958303 (0.0007) [2023-12-26 07:14:32,625][123090] Updated weights for policy 1, policy_version 951471 (0.0005) [2023-12-26 07:14:32,678][123091] Updated weights for policy 0, policy_version 958313 (0.0008) [2023-12-26 07:14:32,680][123090] Updated weights for policy 1, policy_version 951481 (0.0009) [2023-12-26 07:14:33,460][123091] Updated weights for policy 0, policy_version 958323 (0.0008) [2023-12-26 07:14:33,485][123090] Updated weights for policy 1, policy_version 951491 (0.0010) [2023-12-26 07:14:33,517][123091] Updated weights for policy 0, policy_version 958333 (0.0007) [2023-12-26 07:14:33,546][123090] Updated weights for policy 1, policy_version 951501 (0.0010) [2023-12-26 07:14:33,578][123091] Updated weights for policy 0, policy_version 958343 (0.0006) [2023-12-26 07:14:33,609][123090] Updated weights for policy 1, policy_version 951511 (0.0010) [2023-12-26 07:14:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 488931328. Throughput: 0: 8812.9, 1: 9043.6. Samples: 488938348. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:33,785][121949] Avg episode reward: [(0, '5917.781'), (1, '5562.074')] [2023-12-26 07:14:34,249][123091] Updated weights for policy 0, policy_version 958353 (0.0007) [2023-12-26 07:14:34,329][123091] Updated weights for policy 0, policy_version 958363 (0.0009) [2023-12-26 07:14:34,336][123090] Updated weights for policy 1, policy_version 951521 (0.0010) [2023-12-26 07:14:34,400][123091] Updated weights for policy 0, policy_version 958373 (0.0009) [2023-12-26 07:14:34,404][123090] Updated weights for policy 1, policy_version 951531 (0.0007) [2023-12-26 07:14:34,466][123091] Updated weights for policy 0, policy_version 958383 (0.0009) [2023-12-26 07:14:34,471][123090] Updated weights for policy 1, policy_version 951541 (0.0007) [2023-12-26 07:14:34,541][123090] Updated weights for policy 1, policy_version 951551 (0.0005) [2023-12-26 07:14:35,258][123090] Updated weights for policy 1, policy_version 951561 (0.0007) [2023-12-26 07:14:35,309][123090] Updated weights for policy 1, policy_version 951571 (0.0007) [2023-12-26 07:14:35,327][123091] Updated weights for policy 0, policy_version 958393 (0.0009) [2023-12-26 07:14:35,366][123090] Updated weights for policy 1, policy_version 951581 (0.0007) [2023-12-26 07:14:35,383][123091] Updated weights for policy 0, policy_version 958403 (0.0010) [2023-12-26 07:14:35,434][123091] Updated weights for policy 0, policy_version 958413 (0.0010) [2023-12-26 07:14:36,159][123090] Updated weights for policy 1, policy_version 951591 (0.0009) [2023-12-26 07:14:36,215][123090] Updated weights for policy 1, policy_version 951601 (0.0009) [2023-12-26 07:14:36,266][123090] Updated weights for policy 1, policy_version 951611 (0.0009) [2023-12-26 07:14:36,275][123091] Updated weights for policy 0, policy_version 958423 (0.0006) [2023-12-26 07:14:36,341][123091] Updated weights for policy 0, policy_version 958433 (0.0006) [2023-12-26 07:14:36,409][123091] Updated weights for policy 0, policy_version 958443 (0.0005) [2023-12-26 07:14:37,147][123091] Updated weights for policy 0, policy_version 958453 (0.0008) [2023-12-26 07:14:37,167][123090] Updated weights for policy 1, policy_version 951621 (0.0008) [2023-12-26 07:14:37,207][123091] Updated weights for policy 0, policy_version 958463 (0.0011) [2023-12-26 07:14:37,220][123090] Updated weights for policy 1, policy_version 951631 (0.0008) [2023-12-26 07:14:37,262][123091] Updated weights for policy 0, policy_version 958473 (0.0011) [2023-12-26 07:14:37,282][123090] Updated weights for policy 1, policy_version 951641 (0.0008) [2023-12-26 07:14:38,001][123091] Updated weights for policy 0, policy_version 958483 (0.0009) [2023-12-26 07:14:38,073][123091] Updated weights for policy 0, policy_version 958493 (0.0005) [2023-12-26 07:14:38,132][123090] Updated weights for policy 1, policy_version 951651 (0.0006) [2023-12-26 07:14:38,138][123091] Updated weights for policy 0, policy_version 958503 (0.0005) [2023-12-26 07:14:38,201][123090] Updated weights for policy 1, policy_version 951661 (0.0005) [2023-12-26 07:14:38,262][123090] Updated weights for policy 1, policy_version 951671 (0.0008) [2023-12-26 07:14:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 489013248. Throughput: 0: 8836.2, 1: 9085.9. Samples: 488992220. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:14:38,785][121949] Avg episode reward: [(0, '6102.270'), (1, '5796.562')] [2023-12-26 07:14:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000958512_245383168.pth... [2023-12-26 07:14:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000951680_243630080.pth... [2023-12-26 07:14:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000957488_245121024.pth [2023-12-26 07:14:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000950624_243359744.pth [2023-12-26 07:14:38,901][123091] Updated weights for policy 0, policy_version 958513 (0.0006) [2023-12-26 07:14:38,963][123091] Updated weights for policy 0, policy_version 958523 (0.0011) [2023-12-26 07:14:38,965][123090] Updated weights for policy 1, policy_version 951681 (0.0010) [2023-12-26 07:14:39,019][123091] Updated weights for policy 0, policy_version 958533 (0.0011) [2023-12-26 07:14:39,030][123090] Updated weights for policy 1, policy_version 951691 (0.0011) [2023-12-26 07:14:39,072][123091] Updated weights for policy 0, policy_version 958543 (0.0011) [2023-12-26 07:14:39,089][123090] Updated weights for policy 1, policy_version 951701 (0.0006) [2023-12-26 07:14:39,160][123090] Updated weights for policy 1, policy_version 951711 (0.0006) [2023-12-26 07:14:39,946][123091] Updated weights for policy 0, policy_version 958553 (0.0009) [2023-12-26 07:14:39,989][123090] Updated weights for policy 1, policy_version 951721 (0.0008) [2023-12-26 07:14:40,009][123091] Updated weights for policy 0, policy_version 958563 (0.0009) [2023-12-26 07:14:40,048][123090] Updated weights for policy 1, policy_version 951731 (0.0008) [2023-12-26 07:14:40,070][123091] Updated weights for policy 0, policy_version 958573 (0.0009) [2023-12-26 07:14:40,102][123090] Updated weights for policy 1, policy_version 951741 (0.0005) [2023-12-26 07:14:40,751][123091] Updated weights for policy 0, policy_version 958584 (0.0010) [2023-12-26 07:14:40,801][123091] Updated weights for policy 0, policy_version 958594 (0.0009) [2023-12-26 07:14:40,852][123091] Updated weights for policy 0, policy_version 958604 (0.0010) [2023-12-26 07:14:40,899][123090] Updated weights for policy 1, policy_version 951751 (0.0008) [2023-12-26 07:14:40,962][123090] Updated weights for policy 1, policy_version 951761 (0.0010) [2023-12-26 07:14:41,024][123090] Updated weights for policy 1, policy_version 951771 (0.0010) [2023-12-26 07:14:41,758][123091] Updated weights for policy 0, policy_version 958614 (0.0008) [2023-12-26 07:14:41,828][123091] Updated weights for policy 0, policy_version 958624 (0.0007) [2023-12-26 07:14:41,876][123090] Updated weights for policy 1, policy_version 951781 (0.0010) [2023-12-26 07:14:41,891][123091] Updated weights for policy 0, policy_version 958634 (0.0010) [2023-12-26 07:14:41,937][123090] Updated weights for policy 1, policy_version 951791 (0.0011) [2023-12-26 07:14:42,008][123090] Updated weights for policy 1, policy_version 951801 (0.0011) [2023-12-26 07:14:42,714][123091] Updated weights for policy 0, policy_version 958644 (0.0008) [2023-12-26 07:14:42,781][123091] Updated weights for policy 0, policy_version 958654 (0.0009) [2023-12-26 07:14:42,833][123091] Updated weights for policy 0, policy_version 958664 (0.0008) [2023-12-26 07:14:42,846][123090] Updated weights for policy 1, policy_version 951811 (0.0011) [2023-12-26 07:14:42,905][123090] Updated weights for policy 1, policy_version 951821 (0.0010) [2023-12-26 07:14:42,963][123090] Updated weights for policy 1, policy_version 951831 (0.0008) [2023-12-26 07:14:43,637][123091] Updated weights for policy 0, policy_version 958674 (0.0009) [2023-12-26 07:14:43,698][123091] Updated weights for policy 0, policy_version 958684 (0.0009) [2023-12-26 07:14:43,742][123090] Updated weights for policy 1, policy_version 951841 (0.0010) [2023-12-26 07:14:43,750][123091] Updated weights for policy 0, policy_version 958694 (0.0008) [2023-12-26 07:14:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 489095168. Throughput: 0: 8762.5, 1: 9025.0. Samples: 489096636. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:14:43,785][121949] Avg episode reward: [(0, '6069.609'), (1, '5864.424')] [2023-12-26 07:14:43,796][123090] Updated weights for policy 1, policy_version 951851 (0.0005) [2023-12-26 07:14:43,801][123091] Updated weights for policy 0, policy_version 958704 (0.0010) [2023-12-26 07:14:43,865][123090] Updated weights for policy 1, policy_version 951861 (0.0005) [2023-12-26 07:14:43,930][123090] Updated weights for policy 1, policy_version 951871 (0.0005) [2023-12-26 07:14:44,558][123091] Updated weights for policy 0, policy_version 958714 (0.0010) [2023-12-26 07:14:44,616][123091] Updated weights for policy 0, policy_version 958724 (0.0010) [2023-12-26 07:14:44,641][123090] Updated weights for policy 1, policy_version 951881 (0.0008) [2023-12-26 07:14:44,663][123091] Updated weights for policy 0, policy_version 958734 (0.0010) [2023-12-26 07:14:44,706][123090] Updated weights for policy 1, policy_version 951891 (0.0008) [2023-12-26 07:14:44,775][123090] Updated weights for policy 1, policy_version 951901 (0.0008) [2023-12-26 07:14:45,465][123091] Updated weights for policy 0, policy_version 958744 (0.0009) [2023-12-26 07:14:45,529][123091] Updated weights for policy 0, policy_version 958754 (0.0008) [2023-12-26 07:14:45,600][123091] Updated weights for policy 0, policy_version 958764 (0.0006) [2023-12-26 07:14:45,633][123090] Updated weights for policy 1, policy_version 951911 (0.0006) [2023-12-26 07:14:45,696][123090] Updated weights for policy 1, policy_version 951921 (0.0005) [2023-12-26 07:14:45,770][123090] Updated weights for policy 1, policy_version 951931 (0.0005) [2023-12-26 07:14:46,232][123091] Updated weights for policy 0, policy_version 958774 (0.0005) [2023-12-26 07:14:46,289][123091] Updated weights for policy 0, policy_version 958784 (0.0005) [2023-12-26 07:14:46,345][123091] Updated weights for policy 0, policy_version 958794 (0.0005) [2023-12-26 07:14:46,384][123090] Updated weights for policy 1, policy_version 951941 (0.0007) [2023-12-26 07:14:46,443][123090] Updated weights for policy 1, policy_version 951951 (0.0010) [2023-12-26 07:14:46,500][123090] Updated weights for policy 1, policy_version 951961 (0.0010) [2023-12-26 07:14:47,031][123091] Updated weights for policy 0, policy_version 958804 (0.0005) [2023-12-26 07:14:47,091][123091] Updated weights for policy 0, policy_version 958814 (0.0005) [2023-12-26 07:14:47,147][123091] Updated weights for policy 0, policy_version 958824 (0.0005) [2023-12-26 07:14:47,382][123090] Updated weights for policy 1, policy_version 951971 (0.0009) [2023-12-26 07:14:47,442][123090] Updated weights for policy 1, policy_version 951981 (0.0010) [2023-12-26 07:14:47,512][123090] Updated weights for policy 1, policy_version 951991 (0.0006) [2023-12-26 07:14:47,793][123091] Updated weights for policy 0, policy_version 958834 (0.0005) [2023-12-26 07:14:47,840][123091] Updated weights for policy 0, policy_version 958844 (0.0006) [2023-12-26 07:14:47,885][123091] Updated weights for policy 0, policy_version 958854 (0.0006) [2023-12-26 07:14:47,938][123091] Updated weights for policy 0, policy_version 958864 (0.0005) [2023-12-26 07:14:48,204][123090] Updated weights for policy 1, policy_version 952001 (0.0005) [2023-12-26 07:14:48,274][123090] Updated weights for policy 1, policy_version 952011 (0.0005) [2023-12-26 07:14:48,342][123090] Updated weights for policy 1, policy_version 952021 (0.0007) [2023-12-26 07:14:48,410][123090] Updated weights for policy 1, policy_version 952031 (0.0009) [2023-12-26 07:14:48,659][123091] Updated weights for policy 0, policy_version 958874 (0.0010) [2023-12-26 07:14:48,715][123091] Updated weights for policy 0, policy_version 958884 (0.0009) [2023-12-26 07:14:48,776][123091] Updated weights for policy 0, policy_version 958894 (0.0010) [2023-12-26 07:14:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 489193472. Throughput: 0: 8944.0, 1: 9083.5. Samples: 489209580. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:14:48,785][121949] Avg episode reward: [(0, '6152.013'), (1, '5771.594')] [2023-12-26 07:14:49,200][123090] Updated weights for policy 1, policy_version 952041 (0.0010) [2023-12-26 07:14:49,270][123090] Updated weights for policy 1, policy_version 952051 (0.0008) [2023-12-26 07:14:49,337][123090] Updated weights for policy 1, policy_version 952061 (0.0006) [2023-12-26 07:14:49,595][123091] Updated weights for policy 0, policy_version 958904 (0.0010) [2023-12-26 07:14:49,659][123091] Updated weights for policy 0, policy_version 958915 (0.0010) [2023-12-26 07:14:49,726][123091] Updated weights for policy 0, policy_version 958925 (0.0009) [2023-12-26 07:14:50,100][123090] Updated weights for policy 1, policy_version 952071 (0.0009) [2023-12-26 07:14:50,160][123090] Updated weights for policy 1, policy_version 952081 (0.0009) [2023-12-26 07:14:50,221][123090] Updated weights for policy 1, policy_version 952091 (0.0009) [2023-12-26 07:14:50,542][123091] Updated weights for policy 0, policy_version 958935 (0.0007) [2023-12-26 07:14:50,603][123091] Updated weights for policy 0, policy_version 958945 (0.0007) [2023-12-26 07:14:50,652][123091] Updated weights for policy 0, policy_version 958955 (0.0006) [2023-12-26 07:14:51,139][123090] Updated weights for policy 1, policy_version 952101 (0.0010) [2023-12-26 07:14:51,200][123090] Updated weights for policy 1, policy_version 952111 (0.0010) [2023-12-26 07:14:51,262][123090] Updated weights for policy 1, policy_version 952121 (0.0010) [2023-12-26 07:14:51,457][123091] Updated weights for policy 0, policy_version 958965 (0.0009) [2023-12-26 07:14:51,517][123091] Updated weights for policy 0, policy_version 958975 (0.0011) [2023-12-26 07:14:51,581][123091] Updated weights for policy 0, policy_version 958985 (0.0011) [2023-12-26 07:14:52,022][123090] Updated weights for policy 1, policy_version 952131 (0.0010) [2023-12-26 07:14:52,084][123090] Updated weights for policy 1, policy_version 952141 (0.0010) [2023-12-26 07:14:52,147][123090] Updated weights for policy 1, policy_version 952151 (0.0008) [2023-12-26 07:14:52,380][123091] Updated weights for policy 0, policy_version 958995 (0.0009) [2023-12-26 07:14:52,447][123091] Updated weights for policy 0, policy_version 959005 (0.0011) [2023-12-26 07:14:52,506][123091] Updated weights for policy 0, policy_version 959015 (0.0010) [2023-12-26 07:14:53,001][123090] Updated weights for policy 1, policy_version 952161 (0.0008) [2023-12-26 07:14:53,060][123090] Updated weights for policy 1, policy_version 952171 (0.0010) [2023-12-26 07:14:53,138][123090] Updated weights for policy 1, policy_version 952181 (0.0011) [2023-12-26 07:14:53,200][123091] Updated weights for policy 0, policy_version 959025 (0.0009) [2023-12-26 07:14:53,204][123090] Updated weights for policy 1, policy_version 952191 (0.0008) [2023-12-26 07:14:53,268][123091] Updated weights for policy 0, policy_version 959035 (0.0006) [2023-12-26 07:14:53,337][123091] Updated weights for policy 0, policy_version 959045 (0.0005) [2023-12-26 07:14:53,398][123091] Updated weights for policy 0, policy_version 959055 (0.0007) [2023-12-26 07:14:53,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 489283584. Throughput: 0: 8906.7, 1: 9010.3. Samples: 489260416. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:14:53,785][121949] Avg episode reward: [(0, '6102.269'), (1, '5792.654')] [2023-12-26 07:14:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000959056_245522432.pth... [2023-12-26 07:14:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000952192_243761152.pth... [2023-12-26 07:14:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000958000_245252096.pth [2023-12-26 07:14:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000951168_243499008.pth [2023-12-26 07:14:53,873][123090] Updated weights for policy 1, policy_version 952201 (0.0005) [2023-12-26 07:14:53,930][123090] Updated weights for policy 1, policy_version 952211 (0.0005) [2023-12-26 07:14:53,986][123090] Updated weights for policy 1, policy_version 952221 (0.0005) [2023-12-26 07:14:54,074][123091] Updated weights for policy 0, policy_version 959065 (0.0005) [2023-12-26 07:14:54,139][123091] Updated weights for policy 0, policy_version 959075 (0.0006) [2023-12-26 07:14:54,197][123091] Updated weights for policy 0, policy_version 959085 (0.0006) [2023-12-26 07:14:54,747][123090] Updated weights for policy 1, policy_version 952231 (0.0008) [2023-12-26 07:14:54,811][123090] Updated weights for policy 1, policy_version 952241 (0.0006) [2023-12-26 07:14:54,826][123091] Updated weights for policy 0, policy_version 959095 (0.0008) [2023-12-26 07:14:54,874][123090] Updated weights for policy 1, policy_version 952251 (0.0005) [2023-12-26 07:14:54,886][123091] Updated weights for policy 0, policy_version 959105 (0.0009) [2023-12-26 07:14:54,946][123091] Updated weights for policy 0, policy_version 959115 (0.0009) [2023-12-26 07:14:55,679][123090] Updated weights for policy 1, policy_version 952261 (0.0008) [2023-12-26 07:14:55,726][123090] Updated weights for policy 1, policy_version 952271 (0.0006) [2023-12-26 07:14:55,775][123090] Updated weights for policy 1, policy_version 952281 (0.0007) [2023-12-26 07:14:55,832][123091] Updated weights for policy 0, policy_version 959125 (0.0010) [2023-12-26 07:14:55,884][123091] Updated weights for policy 0, policy_version 959135 (0.0009) [2023-12-26 07:14:55,947][123091] Updated weights for policy 0, policy_version 959145 (0.0009) [2023-12-26 07:14:56,540][123090] Updated weights for policy 1, policy_version 952291 (0.0009) [2023-12-26 07:14:56,591][123090] Updated weights for policy 1, policy_version 952301 (0.0005) [2023-12-26 07:14:56,635][123091] Updated weights for policy 0, policy_version 959155 (0.0008) [2023-12-26 07:14:56,643][123090] Updated weights for policy 1, policy_version 952311 (0.0005) [2023-12-26 07:14:56,698][123091] Updated weights for policy 0, policy_version 959165 (0.0008) [2023-12-26 07:14:56,756][123091] Updated weights for policy 0, policy_version 959175 (0.0010) [2023-12-26 07:14:57,253][123090] Updated weights for policy 1, policy_version 952321 (0.0005) [2023-12-26 07:14:57,323][123090] Updated weights for policy 1, policy_version 952331 (0.0005) [2023-12-26 07:14:57,379][123090] Updated weights for policy 1, policy_version 952341 (0.0005) [2023-12-26 07:14:57,433][123090] Updated weights for policy 1, policy_version 952351 (0.0005) [2023-12-26 07:14:57,671][123091] Updated weights for policy 0, policy_version 959185 (0.0010) [2023-12-26 07:14:57,737][123091] Updated weights for policy 0, policy_version 959195 (0.0010) [2023-12-26 07:14:57,799][123091] Updated weights for policy 0, policy_version 959205 (0.0010) [2023-12-26 07:14:57,872][123091] Updated weights for policy 0, policy_version 959215 (0.0010) [2023-12-26 07:14:58,031][123090] Updated weights for policy 1, policy_version 952361 (0.0006) [2023-12-26 07:14:58,103][123090] Updated weights for policy 1, policy_version 952371 (0.0008) [2023-12-26 07:14:58,167][123090] Updated weights for policy 1, policy_version 952381 (0.0007) [2023-12-26 07:14:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 489373696. Throughput: 0: 8987.5, 1: 9076.5. Samples: 489373520. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:14:58,784][121949] Avg episode reward: [(0, '5937.878'), (1, '5847.498')] [2023-12-26 07:14:58,801][123091] Updated weights for policy 0, policy_version 959225 (0.0010) [2023-12-26 07:14:58,870][123091] Updated weights for policy 0, policy_version 959235 (0.0009) [2023-12-26 07:14:58,939][123091] Updated weights for policy 0, policy_version 959245 (0.0009) [2023-12-26 07:14:59,059][123090] Updated weights for policy 1, policy_version 952391 (0.0009) [2023-12-26 07:14:59,114][123090] Updated weights for policy 1, policy_version 952401 (0.0010) [2023-12-26 07:14:59,166][123090] Updated weights for policy 1, policy_version 952411 (0.0010) [2023-12-26 07:14:59,733][123091] Updated weights for policy 0, policy_version 959255 (0.0007) [2023-12-26 07:14:59,799][123091] Updated weights for policy 0, policy_version 959265 (0.0005) [2023-12-26 07:14:59,869][123091] Updated weights for policy 0, policy_version 959275 (0.0013) [2023-12-26 07:14:59,991][123090] Updated weights for policy 1, policy_version 952421 (0.0010) [2023-12-26 07:15:00,056][123090] Updated weights for policy 1, policy_version 952431 (0.0009) [2023-12-26 07:15:00,124][123090] Updated weights for policy 1, policy_version 952441 (0.0009) [2023-12-26 07:15:00,530][123091] Updated weights for policy 0, policy_version 959285 (0.0008) [2023-12-26 07:15:00,600][123091] Updated weights for policy 0, policy_version 959295 (0.0008) [2023-12-26 07:15:00,654][123091] Updated weights for policy 0, policy_version 959305 (0.0010) [2023-12-26 07:15:00,896][123090] Updated weights for policy 1, policy_version 952451 (0.0009) [2023-12-26 07:15:00,951][123090] Updated weights for policy 1, policy_version 952461 (0.0010) [2023-12-26 07:15:01,013][123090] Updated weights for policy 1, policy_version 952471 (0.0010) [2023-12-26 07:15:01,521][123091] Updated weights for policy 0, policy_version 959315 (0.0009) [2023-12-26 07:15:01,574][123091] Updated weights for policy 0, policy_version 959325 (0.0009) [2023-12-26 07:15:01,628][123091] Updated weights for policy 0, policy_version 959335 (0.0009) [2023-12-26 07:15:01,861][123090] Updated weights for policy 1, policy_version 952481 (0.0011) [2023-12-26 07:15:01,929][123090] Updated weights for policy 1, policy_version 952491 (0.0011) [2023-12-26 07:15:01,988][123090] Updated weights for policy 1, policy_version 952501 (0.0010) [2023-12-26 07:15:02,060][123090] Updated weights for policy 1, policy_version 952511 (0.0011) [2023-12-26 07:15:02,392][123091] Updated weights for policy 0, policy_version 959345 (0.0009) [2023-12-26 07:15:02,458][123091] Updated weights for policy 0, policy_version 959355 (0.0006) [2023-12-26 07:15:02,533][123091] Updated weights for policy 0, policy_version 959365 (0.0006) [2023-12-26 07:15:02,585][123091] Updated weights for policy 0, policy_version 959375 (0.0006) [2023-12-26 07:15:02,819][123090] Updated weights for policy 1, policy_version 952521 (0.0011) [2023-12-26 07:15:02,871][123090] Updated weights for policy 1, policy_version 952531 (0.0010) [2023-12-26 07:15:02,926][123090] Updated weights for policy 1, policy_version 952541 (0.0010) [2023-12-26 07:15:03,238][123091] Updated weights for policy 0, policy_version 959385 (0.0005) [2023-12-26 07:15:03,284][123091] Updated weights for policy 0, policy_version 959395 (0.0005) [2023-12-26 07:15:03,331][123091] Updated weights for policy 0, policy_version 959405 (0.0006) [2023-12-26 07:15:03,751][123090] Updated weights for policy 1, policy_version 952551 (0.0010) [2023-12-26 07:15:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 489463808. Throughput: 0: 8994.1, 1: 8995.6. Samples: 489479364. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:03,785][121949] Avg episode reward: [(0, '6005.888'), (1, '5835.519')] [2023-12-26 07:15:03,807][123090] Updated weights for policy 1, policy_version 952561 (0.0006) [2023-12-26 07:15:03,876][123090] Updated weights for policy 1, policy_version 952571 (0.0006) [2023-12-26 07:15:04,072][123091] Updated weights for policy 0, policy_version 959415 (0.0007) [2023-12-26 07:15:04,155][123091] Updated weights for policy 0, policy_version 959425 (0.0007) [2023-12-26 07:15:04,219][123091] Updated weights for policy 0, policy_version 959435 (0.0009) [2023-12-26 07:15:04,676][123090] Updated weights for policy 1, policy_version 952581 (0.0005) [2023-12-26 07:15:04,725][123090] Updated weights for policy 1, policy_version 952591 (0.0005) [2023-12-26 07:15:04,771][123090] Updated weights for policy 1, policy_version 952601 (0.0006) [2023-12-26 07:15:04,892][123091] Updated weights for policy 0, policy_version 959445 (0.0005) [2023-12-26 07:15:04,946][123091] Updated weights for policy 0, policy_version 959455 (0.0008) [2023-12-26 07:15:05,002][123091] Updated weights for policy 0, policy_version 959465 (0.0010) [2023-12-26 07:15:05,575][123090] Updated weights for policy 1, policy_version 952611 (0.0009) [2023-12-26 07:15:05,643][123090] Updated weights for policy 1, policy_version 952621 (0.0010) [2023-12-26 07:15:05,712][123090] Updated weights for policy 1, policy_version 952631 (0.0011) [2023-12-26 07:15:05,784][123091] Updated weights for policy 0, policy_version 959475 (0.0011) [2023-12-26 07:15:05,853][123091] Updated weights for policy 0, policy_version 959485 (0.0011) [2023-12-26 07:15:05,910][123091] Updated weights for policy 0, policy_version 959495 (0.0011) [2023-12-26 07:15:06,576][123090] Updated weights for policy 1, policy_version 952641 (0.0011) [2023-12-26 07:15:06,646][123090] Updated weights for policy 1, policy_version 952651 (0.0011) [2023-12-26 07:15:06,711][123090] Updated weights for policy 1, policy_version 952661 (0.0010) [2023-12-26 07:15:06,760][123091] Updated weights for policy 0, policy_version 959505 (0.0010) [2023-12-26 07:15:06,777][123090] Updated weights for policy 1, policy_version 952671 (0.0011) [2023-12-26 07:15:06,832][123091] Updated weights for policy 0, policy_version 959515 (0.0006) [2023-12-26 07:15:06,914][123091] Updated weights for policy 0, policy_version 959525 (0.0006) [2023-12-26 07:15:06,990][123091] Updated weights for policy 0, policy_version 959535 (0.0009) [2023-12-26 07:15:07,570][123090] Updated weights for policy 1, policy_version 952681 (0.0011) [2023-12-26 07:15:07,635][123090] Updated weights for policy 1, policy_version 952691 (0.0010) [2023-12-26 07:15:07,705][123090] Updated weights for policy 1, policy_version 952701 (0.0006) [2023-12-26 07:15:07,720][123091] Updated weights for policy 0, policy_version 959545 (0.0010) [2023-12-26 07:15:07,781][123091] Updated weights for policy 0, policy_version 959555 (0.0005) [2023-12-26 07:15:07,841][123091] Updated weights for policy 0, policy_version 959565 (0.0010) [2023-12-26 07:15:08,547][123090] Updated weights for policy 1, policy_version 952711 (0.0010) [2023-12-26 07:15:08,577][123091] Updated weights for policy 0, policy_version 959576 (0.0009) [2023-12-26 07:15:08,608][123090] Updated weights for policy 1, policy_version 952721 (0.0010) [2023-12-26 07:15:08,632][123091] Updated weights for policy 0, policy_version 959586 (0.0008) [2023-12-26 07:15:08,676][123090] Updated weights for policy 1, policy_version 952731 (0.0009) [2023-12-26 07:15:08,699][123091] Updated weights for policy 0, policy_version 959596 (0.0009) [2023-12-26 07:15:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 489562112. Throughput: 0: 9046.1, 1: 8981.1. Samples: 489533000. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:08,785][121949] Avg episode reward: [(0, '6179.154'), (1, '5567.270')] [2023-12-26 07:15:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000959600_245661696.pth... [2023-12-26 07:15:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000952736_243900416.pth... [2023-12-26 07:15:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000951680_243630080.pth [2023-12-26 07:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000958512_245383168.pth [2023-12-26 07:15:09,540][123090] Updated weights for policy 1, policy_version 952741 (0.0010) [2023-12-26 07:15:09,614][123090] Updated weights for policy 1, policy_version 952751 (0.0009) [2023-12-26 07:15:09,647][123091] Updated weights for policy 0, policy_version 959606 (0.0009) [2023-12-26 07:15:09,685][123090] Updated weights for policy 1, policy_version 952761 (0.0009) [2023-12-26 07:15:09,719][123091] Updated weights for policy 0, policy_version 959616 (0.0009) [2023-12-26 07:15:09,791][123091] Updated weights for policy 0, policy_version 959626 (0.0009) [2023-12-26 07:15:10,494][123090] Updated weights for policy 1, policy_version 952771 (0.0009) [2023-12-26 07:15:10,568][123090] Updated weights for policy 1, policy_version 952781 (0.0008) [2023-12-26 07:15:10,622][123091] Updated weights for policy 0, policy_version 959636 (0.0008) [2023-12-26 07:15:10,631][123090] Updated weights for policy 1, policy_version 952791 (0.0009) [2023-12-26 07:15:10,690][123091] Updated weights for policy 0, policy_version 959646 (0.0008) [2023-12-26 07:15:10,754][123091] Updated weights for policy 0, policy_version 959656 (0.0008) [2023-12-26 07:15:11,481][123090] Updated weights for policy 1, policy_version 952801 (0.0008) [2023-12-26 07:15:11,551][123090] Updated weights for policy 1, policy_version 952811 (0.0008) [2023-12-26 07:15:11,616][123091] Updated weights for policy 0, policy_version 959666 (0.0007) [2023-12-26 07:15:11,626][123090] Updated weights for policy 1, policy_version 952821 (0.0007) [2023-12-26 07:15:11,692][123091] Updated weights for policy 0, policy_version 959676 (0.0009) [2023-12-26 07:15:11,707][123090] Updated weights for policy 1, policy_version 952831 (0.0008) [2023-12-26 07:15:11,770][123091] Updated weights for policy 0, policy_version 959686 (0.0008) [2023-12-26 07:15:11,842][123091] Updated weights for policy 0, policy_version 959696 (0.0006) [2023-12-26 07:15:12,591][123090] Updated weights for policy 1, policy_version 952841 (0.0009) [2023-12-26 07:15:12,658][123090] Updated weights for policy 1, policy_version 952851 (0.0009) [2023-12-26 07:15:12,694][123091] Updated weights for policy 0, policy_version 959706 (0.0008) [2023-12-26 07:15:12,729][123090] Updated weights for policy 1, policy_version 952861 (0.0007) [2023-12-26 07:15:12,764][123091] Updated weights for policy 0, policy_version 959716 (0.0009) [2023-12-26 07:15:12,823][123091] Updated weights for policy 0, policy_version 959726 (0.0009) [2023-12-26 07:15:13,412][123090] Updated weights for policy 1, policy_version 952871 (0.0007) [2023-12-26 07:15:13,463][123090] Updated weights for policy 1, policy_version 952881 (0.0005) [2023-12-26 07:15:13,517][123090] Updated weights for policy 1, policy_version 952891 (0.0005) [2023-12-26 07:15:13,647][123091] Updated weights for policy 0, policy_version 959736 (0.0006) [2023-12-26 07:15:13,701][123091] Updated weights for policy 0, policy_version 959746 (0.0005) [2023-12-26 07:15:13,763][123091] Updated weights for policy 0, policy_version 959756 (0.0008) [2023-12-26 07:15:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 489635840. Throughput: 0: 8951.4, 1: 8850.2. Samples: 489632660. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:13,785][121949] Avg episode reward: [(0, '6270.393'), (1, '5605.839')] [2023-12-26 07:15:14,245][123090] Updated weights for policy 1, policy_version 952901 (0.0005) [2023-12-26 07:15:14,303][123090] Updated weights for policy 1, policy_version 952911 (0.0005) [2023-12-26 07:15:14,372][123090] Updated weights for policy 1, policy_version 952921 (0.0006) [2023-12-26 07:15:14,627][123091] Updated weights for policy 0, policy_version 959766 (0.0009) [2023-12-26 07:15:14,687][123091] Updated weights for policy 0, policy_version 959776 (0.0009) [2023-12-26 07:15:14,753][123091] Updated weights for policy 0, policy_version 959786 (0.0009) [2023-12-26 07:15:15,135][123090] Updated weights for policy 1, policy_version 952931 (0.0006) [2023-12-26 07:15:15,205][123090] Updated weights for policy 1, policy_version 952941 (0.0008) [2023-12-26 07:15:15,276][123090] Updated weights for policy 1, policy_version 952951 (0.0007) [2023-12-26 07:15:15,595][123091] Updated weights for policy 0, policy_version 959796 (0.0009) [2023-12-26 07:15:15,664][123091] Updated weights for policy 0, policy_version 959806 (0.0008) [2023-12-26 07:15:15,735][123091] Updated weights for policy 0, policy_version 959816 (0.0009) [2023-12-26 07:15:16,099][123090] Updated weights for policy 1, policy_version 952961 (0.0007) [2023-12-26 07:15:16,166][123090] Updated weights for policy 1, policy_version 952971 (0.0009) [2023-12-26 07:15:16,240][123090] Updated weights for policy 1, policy_version 952981 (0.0008) [2023-12-26 07:15:16,311][123090] Updated weights for policy 1, policy_version 952991 (0.0008) [2023-12-26 07:15:16,534][123091] Updated weights for policy 0, policy_version 959826 (0.0010) [2023-12-26 07:15:16,595][123091] Updated weights for policy 0, policy_version 959836 (0.0010) [2023-12-26 07:15:16,674][123091] Updated weights for policy 0, policy_version 959846 (0.0006) [2023-12-26 07:15:16,747][123091] Updated weights for policy 0, policy_version 959856 (0.0006) [2023-12-26 07:15:17,157][123090] Updated weights for policy 1, policy_version 953001 (0.0006) [2023-12-26 07:15:17,216][123090] Updated weights for policy 1, policy_version 953011 (0.0005) [2023-12-26 07:15:17,279][123090] Updated weights for policy 1, policy_version 953021 (0.0005) [2023-12-26 07:15:17,470][123091] Updated weights for policy 0, policy_version 959866 (0.0007) [2023-12-26 07:15:17,533][123091] Updated weights for policy 0, policy_version 959876 (0.0006) [2023-12-26 07:15:17,596][123091] Updated weights for policy 0, policy_version 959886 (0.0007) [2023-12-26 07:15:17,990][123090] Updated weights for policy 1, policy_version 953031 (0.0005) [2023-12-26 07:15:18,055][123090] Updated weights for policy 1, policy_version 953041 (0.0007) [2023-12-26 07:15:18,127][123090] Updated weights for policy 1, policy_version 953051 (0.0009) [2023-12-26 07:15:18,244][123091] Updated weights for policy 0, policy_version 959896 (0.0008) [2023-12-26 07:15:18,293][123091] Updated weights for policy 0, policy_version 959906 (0.0009) [2023-12-26 07:15:18,364][123091] Updated weights for policy 0, policy_version 959916 (0.0008) [2023-12-26 07:15:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 489725952. Throughput: 0: 8979.9, 1: 8840.6. Samples: 489740272. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:18,784][121949] Avg episode reward: [(0, '6189.543'), (1, '5764.021')] [2023-12-26 07:15:18,955][123090] Updated weights for policy 1, policy_version 953061 (0.0008) [2023-12-26 07:15:19,007][123090] Updated weights for policy 1, policy_version 953071 (0.0010) [2023-12-26 07:15:19,063][123090] Updated weights for policy 1, policy_version 953081 (0.0010) [2023-12-26 07:15:19,187][123091] Updated weights for policy 0, policy_version 959926 (0.0009) [2023-12-26 07:15:19,247][123091] Updated weights for policy 0, policy_version 959936 (0.0009) [2023-12-26 07:15:19,301][123091] Updated weights for policy 0, policy_version 959946 (0.0009) [2023-12-26 07:15:19,934][123090] Updated weights for policy 1, policy_version 953091 (0.0010) [2023-12-26 07:15:19,998][123090] Updated weights for policy 1, policy_version 953101 (0.0009) [2023-12-26 07:15:20,066][123090] Updated weights for policy 1, policy_version 953111 (0.0010) [2023-12-26 07:15:20,185][123091] Updated weights for policy 0, policy_version 959956 (0.0009) [2023-12-26 07:15:20,249][123091] Updated weights for policy 0, policy_version 959966 (0.0010) [2023-12-26 07:15:20,312][123091] Updated weights for policy 0, policy_version 959976 (0.0009) [2023-12-26 07:15:20,894][123090] Updated weights for policy 1, policy_version 953121 (0.0010) [2023-12-26 07:15:20,966][123090] Updated weights for policy 1, policy_version 953131 (0.0007) [2023-12-26 07:15:21,038][123090] Updated weights for policy 1, policy_version 953141 (0.0010) [2023-12-26 07:15:21,110][123090] Updated weights for policy 1, policy_version 953151 (0.0007) [2023-12-26 07:15:21,190][123091] Updated weights for policy 0, policy_version 959986 (0.0009) [2023-12-26 07:15:21,253][123091] Updated weights for policy 0, policy_version 959996 (0.0009) [2023-12-26 07:15:21,326][123091] Updated weights for policy 0, policy_version 960006 (0.0009) [2023-12-26 07:15:21,403][123091] Updated weights for policy 0, policy_version 960016 (0.0009) [2023-12-26 07:15:21,974][123090] Updated weights for policy 1, policy_version 953161 (0.0007) [2023-12-26 07:15:22,044][123090] Updated weights for policy 1, policy_version 953171 (0.0008) [2023-12-26 07:15:22,113][123090] Updated weights for policy 1, policy_version 953181 (0.0009) [2023-12-26 07:15:22,238][123091] Updated weights for policy 0, policy_version 960026 (0.0011) [2023-12-26 07:15:22,310][123091] Updated weights for policy 0, policy_version 960036 (0.0010) [2023-12-26 07:15:22,378][123091] Updated weights for policy 0, policy_version 960046 (0.0010) [2023-12-26 07:15:22,904][123090] Updated weights for policy 1, policy_version 953191 (0.0009) [2023-12-26 07:15:22,972][123090] Updated weights for policy 1, policy_version 953201 (0.0010) [2023-12-26 07:15:23,041][123090] Updated weights for policy 1, policy_version 953211 (0.0010) [2023-12-26 07:15:23,206][123091] Updated weights for policy 0, policy_version 960056 (0.0011) [2023-12-26 07:15:23,271][123091] Updated weights for policy 0, policy_version 960066 (0.0010) [2023-12-26 07:15:23,341][123091] Updated weights for policy 0, policy_version 960076 (0.0010) [2023-12-26 07:15:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 489807872. Throughput: 0: 8931.2, 1: 8789.2. Samples: 489789636. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:23,785][121949] Avg episode reward: [(0, '6204.471'), (1, '5878.049')] [2023-12-26 07:15:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000960080_245784576.pth... [2023-12-26 07:15:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000953216_244023296.pth... [2023-12-26 07:15:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000959056_245522432.pth [2023-12-26 07:15:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000952192_243761152.pth [2023-12-26 07:15:23,922][123090] Updated weights for policy 1, policy_version 953221 (0.0009) [2023-12-26 07:15:23,978][123090] Updated weights for policy 1, policy_version 953231 (0.0009) [2023-12-26 07:15:24,037][123090] Updated weights for policy 1, policy_version 953241 (0.0008) [2023-12-26 07:15:24,081][123091] Updated weights for policy 0, policy_version 960086 (0.0010) [2023-12-26 07:15:24,132][123091] Updated weights for policy 0, policy_version 960096 (0.0010) [2023-12-26 07:15:24,179][123091] Updated weights for policy 0, policy_version 960106 (0.0010) [2023-12-26 07:15:24,926][123091] Updated weights for policy 0, policy_version 960116 (0.0008) [2023-12-26 07:15:24,932][123090] Updated weights for policy 1, policy_version 953251 (0.0009) [2023-12-26 07:15:24,972][123091] Updated weights for policy 0, policy_version 960126 (0.0005) [2023-12-26 07:15:24,990][123090] Updated weights for policy 1, policy_version 953261 (0.0008) [2023-12-26 07:15:25,024][123091] Updated weights for policy 0, policy_version 960136 (0.0006) [2023-12-26 07:15:25,060][123090] Updated weights for policy 1, policy_version 953271 (0.0009) [2023-12-26 07:15:25,852][123091] Updated weights for policy 0, policy_version 960146 (0.0007) [2023-12-26 07:15:25,871][123090] Updated weights for policy 1, policy_version 953281 (0.0009) [2023-12-26 07:15:25,912][123091] Updated weights for policy 0, policy_version 960156 (0.0008) [2023-12-26 07:15:25,932][123090] Updated weights for policy 1, policy_version 953291 (0.0007) [2023-12-26 07:15:25,971][123091] Updated weights for policy 0, policy_version 960166 (0.0008) [2023-12-26 07:15:25,996][123090] Updated weights for policy 1, policy_version 953301 (0.0006) [2023-12-26 07:15:26,034][123091] Updated weights for policy 0, policy_version 960176 (0.0007) [2023-12-26 07:15:26,061][123090] Updated weights for policy 1, policy_version 953311 (0.0009) [2023-12-26 07:15:26,872][123091] Updated weights for policy 0, policy_version 960186 (0.0009) [2023-12-26 07:15:26,874][123090] Updated weights for policy 1, policy_version 953321 (0.0008) [2023-12-26 07:15:26,927][123090] Updated weights for policy 1, policy_version 953331 (0.0008) [2023-12-26 07:15:26,934][123091] Updated weights for policy 0, policy_version 960196 (0.0009) [2023-12-26 07:15:26,982][123091] Updated weights for policy 0, policy_version 960206 (0.0007) [2023-12-26 07:15:26,984][123090] Updated weights for policy 1, policy_version 953341 (0.0008) [2023-12-26 07:15:27,700][123090] Updated weights for policy 1, policy_version 953351 (0.0010) [2023-12-26 07:15:27,749][123090] Updated weights for policy 1, policy_version 953361 (0.0009) [2023-12-26 07:15:27,808][123090] Updated weights for policy 1, policy_version 953371 (0.0009) [2023-12-26 07:15:27,820][123091] Updated weights for policy 0, policy_version 960216 (0.0006) [2023-12-26 07:15:27,878][123091] Updated weights for policy 0, policy_version 960226 (0.0008) [2023-12-26 07:15:27,941][123091] Updated weights for policy 0, policy_version 960236 (0.0009) [2023-12-26 07:15:28,652][123090] Updated weights for policy 1, policy_version 953381 (0.0010) [2023-12-26 07:15:28,706][123090] Updated weights for policy 1, policy_version 953391 (0.0010) [2023-12-26 07:15:28,731][123091] Updated weights for policy 0, policy_version 960246 (0.0006) [2023-12-26 07:15:28,760][123090] Updated weights for policy 1, policy_version 953401 (0.0009) [2023-12-26 07:15:28,780][123091] Updated weights for policy 0, policy_version 960256 (0.0007) [2023-12-26 07:15:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 489889792. Throughput: 0: 8901.6, 1: 8777.9. Samples: 489892212. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:28,785][121949] Avg episode reward: [(0, '6259.959'), (1, '5830.056')] [2023-12-26 07:15:28,836][123091] Updated weights for policy 0, policy_version 960266 (0.0010) [2023-12-26 07:15:29,601][123090] Updated weights for policy 1, policy_version 953411 (0.0007) [2023-12-26 07:15:29,661][123090] Updated weights for policy 1, policy_version 953421 (0.0006) [2023-12-26 07:15:29,696][123091] Updated weights for policy 0, policy_version 960276 (0.0010) [2023-12-26 07:15:29,719][123090] Updated weights for policy 1, policy_version 953431 (0.0006) [2023-12-26 07:15:29,751][123091] Updated weights for policy 0, policy_version 960286 (0.0006) [2023-12-26 07:15:29,811][123091] Updated weights for policy 0, policy_version 960296 (0.0006) [2023-12-26 07:15:30,522][123090] Updated weights for policy 1, policy_version 953441 (0.0006) [2023-12-26 07:15:30,581][123090] Updated weights for policy 1, policy_version 953451 (0.0010) [2023-12-26 07:15:30,620][123091] Updated weights for policy 0, policy_version 960306 (0.0008) [2023-12-26 07:15:30,629][123090] Updated weights for policy 1, policy_version 953461 (0.0010) [2023-12-26 07:15:30,667][123091] Updated weights for policy 0, policy_version 960316 (0.0007) [2023-12-26 07:15:30,677][123090] Updated weights for policy 1, policy_version 953471 (0.0010) [2023-12-26 07:15:30,729][123091] Updated weights for policy 0, policy_version 960326 (0.0008) [2023-12-26 07:15:30,792][123091] Updated weights for policy 0, policy_version 960336 (0.0008) [2023-12-26 07:15:31,500][123090] Updated weights for policy 1, policy_version 953481 (0.0006) [2023-12-26 07:15:31,565][123090] Updated weights for policy 1, policy_version 953491 (0.0008) [2023-12-26 07:15:31,607][123091] Updated weights for policy 0, policy_version 960346 (0.0008) [2023-12-26 07:15:31,627][123090] Updated weights for policy 1, policy_version 953501 (0.0007) [2023-12-26 07:15:31,680][123091] Updated weights for policy 0, policy_version 960356 (0.0008) [2023-12-26 07:15:31,754][123091] Updated weights for policy 0, policy_version 960366 (0.0008) [2023-12-26 07:15:32,486][123090] Updated weights for policy 1, policy_version 953511 (0.0010) [2023-12-26 07:15:32,493][123091] Updated weights for policy 0, policy_version 960376 (0.0009) [2023-12-26 07:15:32,547][123090] Updated weights for policy 1, policy_version 953521 (0.0009) [2023-12-26 07:15:32,560][123091] Updated weights for policy 0, policy_version 960386 (0.0008) [2023-12-26 07:15:32,611][123090] Updated weights for policy 1, policy_version 953531 (0.0010) [2023-12-26 07:15:32,623][123091] Updated weights for policy 0, policy_version 960396 (0.0010) [2023-12-26 07:15:33,309][123090] Updated weights for policy 1, policy_version 953541 (0.0008) [2023-12-26 07:15:33,363][123090] Updated weights for policy 1, policy_version 953551 (0.0005) [2023-12-26 07:15:33,416][123090] Updated weights for policy 1, policy_version 953561 (0.0005) [2023-12-26 07:15:33,421][123091] Updated weights for policy 0, policy_version 960406 (0.0008) [2023-12-26 07:15:33,480][123091] Updated weights for policy 0, policy_version 960416 (0.0009) [2023-12-26 07:15:33,538][123091] Updated weights for policy 0, policy_version 960426 (0.0010) [2023-12-26 07:15:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 489988096. Throughput: 0: 8768.7, 1: 8739.0. Samples: 489997428. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:33,785][121949] Avg episode reward: [(0, '6176.605'), (1, '5771.478')] [2023-12-26 07:15:34,071][123090] Updated weights for policy 1, policy_version 953571 (0.0005) [2023-12-26 07:15:34,136][123090] Updated weights for policy 1, policy_version 953581 (0.0008) [2023-12-26 07:15:34,208][123090] Updated weights for policy 1, policy_version 953591 (0.0007) [2023-12-26 07:15:34,404][123091] Updated weights for policy 0, policy_version 960436 (0.0008) [2023-12-26 07:15:34,473][123091] Updated weights for policy 0, policy_version 960446 (0.0006) [2023-12-26 07:15:34,544][123091] Updated weights for policy 0, policy_version 960456 (0.0007) [2023-12-26 07:15:35,071][123090] Updated weights for policy 1, policy_version 953601 (0.0010) [2023-12-26 07:15:35,137][123090] Updated weights for policy 1, policy_version 953611 (0.0005) [2023-12-26 07:15:35,162][123091] Updated weights for policy 0, policy_version 960466 (0.0007) [2023-12-26 07:15:35,210][123090] Updated weights for policy 1, policy_version 953621 (0.0005) [2023-12-26 07:15:35,220][123091] Updated weights for policy 0, policy_version 960476 (0.0007) [2023-12-26 07:15:35,267][123091] Updated weights for policy 0, policy_version 960486 (0.0007) [2023-12-26 07:15:35,275][123090] Updated weights for policy 1, policy_version 953631 (0.0005) [2023-12-26 07:15:35,315][123091] Updated weights for policy 0, policy_version 960496 (0.0005) [2023-12-26 07:15:35,983][123091] Updated weights for policy 0, policy_version 960506 (0.0006) [2023-12-26 07:15:36,007][123090] Updated weights for policy 1, policy_version 953641 (0.0009) [2023-12-26 07:15:36,032][123091] Updated weights for policy 0, policy_version 960516 (0.0007) [2023-12-26 07:15:36,073][123090] Updated weights for policy 1, policy_version 953651 (0.0009) [2023-12-26 07:15:36,085][123091] Updated weights for policy 0, policy_version 960526 (0.0006) [2023-12-26 07:15:36,135][123090] Updated weights for policy 1, policy_version 953661 (0.0009) [2023-12-26 07:15:36,859][123091] Updated weights for policy 0, policy_version 960536 (0.0010) [2023-12-26 07:15:36,926][123091] Updated weights for policy 0, policy_version 960546 (0.0011) [2023-12-26 07:15:36,969][123090] Updated weights for policy 1, policy_version 953671 (0.0008) [2023-12-26 07:15:36,996][123091] Updated weights for policy 0, policy_version 960556 (0.0011) [2023-12-26 07:15:37,038][123090] Updated weights for policy 1, policy_version 953681 (0.0007) [2023-12-26 07:15:37,107][123090] Updated weights for policy 1, policy_version 953691 (0.0009) [2023-12-26 07:15:37,697][123091] Updated weights for policy 0, policy_version 960566 (0.0012) [2023-12-26 07:15:37,754][123091] Updated weights for policy 0, policy_version 960576 (0.0011) [2023-12-26 07:15:37,806][123091] Updated weights for policy 0, policy_version 960586 (0.0011) [2023-12-26 07:15:37,970][123090] Updated weights for policy 1, policy_version 953701 (0.0009) [2023-12-26 07:15:38,028][123090] Updated weights for policy 1, policy_version 953711 (0.0009) [2023-12-26 07:15:38,077][123090] Updated weights for policy 1, policy_version 953721 (0.0009) [2023-12-26 07:15:38,584][123091] Updated weights for policy 0, policy_version 960596 (0.0010) [2023-12-26 07:15:38,643][123091] Updated weights for policy 0, policy_version 960606 (0.0010) [2023-12-26 07:15:38,706][123091] Updated weights for policy 0, policy_version 960616 (0.0010) [2023-12-26 07:15:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 490078208. Throughput: 0: 8843.1, 1: 8772.1. Samples: 490053100. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:38,785][121949] Avg episode reward: [(0, '6192.973'), (1, '5813.292')] [2023-12-26 07:15:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000960624_245923840.pth... [2023-12-26 07:15:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000953728_244154368.pth... [2023-12-26 07:15:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000959600_245661696.pth [2023-12-26 07:15:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000952736_243900416.pth [2023-12-26 07:15:38,947][123090] Updated weights for policy 1, policy_version 953731 (0.0009) [2023-12-26 07:15:38,998][123090] Updated weights for policy 1, policy_version 953741 (0.0009) [2023-12-26 07:15:39,065][123090] Updated weights for policy 1, policy_version 953751 (0.0009) [2023-12-26 07:15:39,567][123091] Updated weights for policy 0, policy_version 960626 (0.0009) [2023-12-26 07:15:39,638][123091] Updated weights for policy 0, policy_version 960636 (0.0010) [2023-12-26 07:15:39,707][123091] Updated weights for policy 0, policy_version 960646 (0.0010) [2023-12-26 07:15:39,778][123091] Updated weights for policy 0, policy_version 960656 (0.0010) [2023-12-26 07:15:39,929][123090] Updated weights for policy 1, policy_version 953761 (0.0009) [2023-12-26 07:15:40,009][123090] Updated weights for policy 1, policy_version 953771 (0.0007) [2023-12-26 07:15:40,073][123090] Updated weights for policy 1, policy_version 953782 (0.0008) [2023-12-26 07:15:40,130][123090] Updated weights for policy 1, policy_version 953792 (0.0010) [2023-12-26 07:15:40,663][123091] Updated weights for policy 0, policy_version 960666 (0.0009) [2023-12-26 07:15:40,721][123091] Updated weights for policy 0, policy_version 960676 (0.0009) [2023-12-26 07:15:40,771][123091] Updated weights for policy 0, policy_version 960686 (0.0009) [2023-12-26 07:15:40,956][123090] Updated weights for policy 1, policy_version 953802 (0.0010) [2023-12-26 07:15:41,005][123090] Updated weights for policy 1, policy_version 953812 (0.0009) [2023-12-26 07:15:41,069][123090] Updated weights for policy 1, policy_version 953822 (0.0010) [2023-12-26 07:15:41,584][123091] Updated weights for policy 0, policy_version 960696 (0.0010) [2023-12-26 07:15:41,656][123091] Updated weights for policy 0, policy_version 960706 (0.0010) [2023-12-26 07:15:41,726][123091] Updated weights for policy 0, policy_version 960716 (0.0010) [2023-12-26 07:15:41,979][123090] Updated weights for policy 1, policy_version 953832 (0.0010) [2023-12-26 07:15:42,031][123090] Updated weights for policy 1, policy_version 953842 (0.0010) [2023-12-26 07:15:42,087][123090] Updated weights for policy 1, policy_version 953852 (0.0008) [2023-12-26 07:15:42,588][123091] Updated weights for policy 0, policy_version 960726 (0.0006) [2023-12-26 07:15:42,656][123091] Updated weights for policy 0, policy_version 960736 (0.0005) [2023-12-26 07:15:42,726][123091] Updated weights for policy 0, policy_version 960746 (0.0006) [2023-12-26 07:15:42,943][123090] Updated weights for policy 1, policy_version 953862 (0.0009) [2023-12-26 07:15:43,003][123090] Updated weights for policy 1, policy_version 953872 (0.0011) [2023-12-26 07:15:43,070][123090] Updated weights for policy 1, policy_version 953882 (0.0010) [2023-12-26 07:15:43,412][123091] Updated weights for policy 0, policy_version 960756 (0.0007) [2023-12-26 07:15:43,476][123091] Updated weights for policy 0, policy_version 960766 (0.0009) [2023-12-26 07:15:43,539][123091] Updated weights for policy 0, policy_version 960776 (0.0008) [2023-12-26 07:15:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 490160128. Throughput: 0: 8754.5, 1: 8597.2. Samples: 490154352. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:43,785][121949] Avg episode reward: [(0, '6189.026'), (1, '5806.421')] [2023-12-26 07:15:43,875][123090] Updated weights for policy 1, policy_version 953892 (0.0010) [2023-12-26 07:15:43,931][123090] Updated weights for policy 1, policy_version 953902 (0.0010) [2023-12-26 07:15:43,978][123090] Updated weights for policy 1, policy_version 953912 (0.0010) [2023-12-26 07:15:44,379][123091] Updated weights for policy 0, policy_version 960786 (0.0009) [2023-12-26 07:15:44,439][123091] Updated weights for policy 0, policy_version 960796 (0.0009) [2023-12-26 07:15:44,506][123091] Updated weights for policy 0, policy_version 960806 (0.0009) [2023-12-26 07:15:44,557][123091] Updated weights for policy 0, policy_version 960816 (0.0009) [2023-12-26 07:15:44,804][123090] Updated weights for policy 1, policy_version 953922 (0.0010) [2023-12-26 07:15:44,866][123090] Updated weights for policy 1, policy_version 953932 (0.0010) [2023-12-26 07:15:44,919][123090] Updated weights for policy 1, policy_version 953942 (0.0009) [2023-12-26 07:15:44,979][123090] Updated weights for policy 1, policy_version 953952 (0.0009) [2023-12-26 07:15:45,433][123091] Updated weights for policy 0, policy_version 960826 (0.0010) [2023-12-26 07:15:45,496][123091] Updated weights for policy 0, policy_version 960836 (0.0009) [2023-12-26 07:15:45,556][123091] Updated weights for policy 0, policy_version 960846 (0.0009) [2023-12-26 07:15:45,783][123090] Updated weights for policy 1, policy_version 953962 (0.0005) [2023-12-26 07:15:45,831][123090] Updated weights for policy 1, policy_version 953972 (0.0005) [2023-12-26 07:15:45,876][123090] Updated weights for policy 1, policy_version 953982 (0.0005) [2023-12-26 07:15:46,447][123091] Updated weights for policy 0, policy_version 960856 (0.0010) [2023-12-26 07:15:46,503][123091] Updated weights for policy 0, policy_version 960866 (0.0010) [2023-12-26 07:15:46,573][123091] Updated weights for policy 0, policy_version 960876 (0.0009) [2023-12-26 07:15:46,590][123090] Updated weights for policy 1, policy_version 953992 (0.0005) [2023-12-26 07:15:46,647][123090] Updated weights for policy 1, policy_version 954002 (0.0005) [2023-12-26 07:15:46,699][123090] Updated weights for policy 1, policy_version 954012 (0.0005) [2023-12-26 07:15:47,441][123090] Updated weights for policy 1, policy_version 954022 (0.0007) [2023-12-26 07:15:47,449][123091] Updated weights for policy 0, policy_version 960886 (0.0009) [2023-12-26 07:15:47,495][123091] Updated weights for policy 0, policy_version 960896 (0.0009) [2023-12-26 07:15:47,509][123090] Updated weights for policy 1, policy_version 954032 (0.0009) [2023-12-26 07:15:47,542][123091] Updated weights for policy 0, policy_version 960906 (0.0009) [2023-12-26 07:15:47,573][123090] Updated weights for policy 1, policy_version 954042 (0.0008) [2023-12-26 07:15:48,391][123090] Updated weights for policy 1, policy_version 954052 (0.0008) [2023-12-26 07:15:48,402][123091] Updated weights for policy 0, policy_version 960916 (0.0008) [2023-12-26 07:15:48,454][123090] Updated weights for policy 1, policy_version 954062 (0.0008) [2023-12-26 07:15:48,469][123091] Updated weights for policy 0, policy_version 960926 (0.0008) [2023-12-26 07:15:48,514][123090] Updated weights for policy 1, policy_version 954072 (0.0009) [2023-12-26 07:15:48,522][123091] Updated weights for policy 0, policy_version 960936 (0.0008) [2023-12-26 07:15:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 490250240. Throughput: 0: 8680.3, 1: 8628.8. Samples: 490258272. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:48,785][121949] Avg episode reward: [(0, '6225.105'), (1, '5789.650')] [2023-12-26 07:15:49,349][123091] Updated weights for policy 0, policy_version 960946 (0.0010) [2023-12-26 07:15:49,357][123090] Updated weights for policy 1, policy_version 954082 (0.0007) [2023-12-26 07:15:49,424][123091] Updated weights for policy 0, policy_version 960956 (0.0010) [2023-12-26 07:15:49,430][123090] Updated weights for policy 1, policy_version 954092 (0.0008) [2023-12-26 07:15:49,492][123091] Updated weights for policy 0, policy_version 960966 (0.0006) [2023-12-26 07:15:49,504][123090] Updated weights for policy 1, policy_version 954102 (0.0007) [2023-12-26 07:15:49,554][123091] Updated weights for policy 0, policy_version 960976 (0.0008) [2023-12-26 07:15:49,570][123090] Updated weights for policy 1, policy_version 954112 (0.0008) [2023-12-26 07:15:50,362][123091] Updated weights for policy 0, policy_version 960986 (0.0010) [2023-12-26 07:15:50,394][123090] Updated weights for policy 1, policy_version 954122 (0.0007) [2023-12-26 07:15:50,421][123091] Updated weights for policy 0, policy_version 960996 (0.0010) [2023-12-26 07:15:50,454][123090] Updated weights for policy 1, policy_version 954132 (0.0008) [2023-12-26 07:15:50,475][123091] Updated weights for policy 0, policy_version 961006 (0.0008) [2023-12-26 07:15:50,519][123090] Updated weights for policy 1, policy_version 954142 (0.0009) [2023-12-26 07:15:51,308][123090] Updated weights for policy 1, policy_version 954152 (0.0008) [2023-12-26 07:15:51,335][123091] Updated weights for policy 0, policy_version 961016 (0.0008) [2023-12-26 07:15:51,378][123090] Updated weights for policy 1, policy_version 954162 (0.0008) [2023-12-26 07:15:51,412][123091] Updated weights for policy 0, policy_version 961026 (0.0008) [2023-12-26 07:15:51,447][123090] Updated weights for policy 1, policy_version 954172 (0.0008) [2023-12-26 07:15:51,482][123091] Updated weights for policy 0, policy_version 961036 (0.0011) [2023-12-26 07:15:52,289][123090] Updated weights for policy 1, policy_version 954182 (0.0009) [2023-12-26 07:15:52,305][123091] Updated weights for policy 0, policy_version 961046 (0.0010) [2023-12-26 07:15:52,355][123090] Updated weights for policy 1, policy_version 954192 (0.0007) [2023-12-26 07:15:52,365][123091] Updated weights for policy 0, policy_version 961056 (0.0011) [2023-12-26 07:15:52,424][123090] Updated weights for policy 1, policy_version 954202 (0.0007) [2023-12-26 07:15:52,434][123091] Updated weights for policy 0, policy_version 961066 (0.0011) [2023-12-26 07:15:53,079][123090] Updated weights for policy 1, policy_version 954212 (0.0008) [2023-12-26 07:15:53,137][123090] Updated weights for policy 1, policy_version 954222 (0.0009) [2023-12-26 07:15:53,188][123091] Updated weights for policy 0, policy_version 961076 (0.0009) [2023-12-26 07:15:53,198][123090] Updated weights for policy 1, policy_version 954232 (0.0009) [2023-12-26 07:15:53,247][123091] Updated weights for policy 0, policy_version 961086 (0.0006) [2023-12-26 07:15:53,317][123091] Updated weights for policy 0, policy_version 961096 (0.0007) [2023-12-26 07:15:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 490332160. Throughput: 0: 8623.5, 1: 8616.1. Samples: 490308784. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:53,785][121949] Avg episode reward: [(0, '6201.300'), (1, '5847.056')] [2023-12-26 07:15:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000954240_244285440.pth... [2023-12-26 07:15:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000961104_246046720.pth... [2023-12-26 07:15:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000953216_244023296.pth [2023-12-26 07:15:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000960080_245784576.pth [2023-12-26 07:15:54,057][123090] Updated weights for policy 1, policy_version 954242 (0.0008) [2023-12-26 07:15:54,093][123091] Updated weights for policy 0, policy_version 961106 (0.0011) [2023-12-26 07:15:54,126][123090] Updated weights for policy 1, policy_version 954252 (0.0007) [2023-12-26 07:15:54,152][123091] Updated weights for policy 0, policy_version 961116 (0.0008) [2023-12-26 07:15:54,187][123090] Updated weights for policy 1, policy_version 954262 (0.0009) [2023-12-26 07:15:54,205][123091] Updated weights for policy 0, policy_version 961126 (0.0005) [2023-12-26 07:15:54,252][123090] Updated weights for policy 1, policy_version 954272 (0.0008) [2023-12-26 07:15:54,260][123091] Updated weights for policy 0, policy_version 961136 (0.0006) [2023-12-26 07:15:54,863][123091] Updated weights for policy 0, policy_version 961146 (0.0005) [2023-12-26 07:15:54,906][123091] Updated weights for policy 0, policy_version 961156 (0.0005) [2023-12-26 07:15:54,957][123091] Updated weights for policy 0, policy_version 961166 (0.0010) [2023-12-26 07:15:55,152][123090] Updated weights for policy 1, policy_version 954282 (0.0010) [2023-12-26 07:15:55,209][123090] Updated weights for policy 1, policy_version 954292 (0.0009) [2023-12-26 07:15:55,271][123090] Updated weights for policy 1, policy_version 954302 (0.0008) [2023-12-26 07:15:55,782][123091] Updated weights for policy 0, policy_version 961176 (0.0006) [2023-12-26 07:15:55,840][123091] Updated weights for policy 0, policy_version 961186 (0.0010) [2023-12-26 07:15:55,906][123091] Updated weights for policy 0, policy_version 961196 (0.0011) [2023-12-26 07:15:56,131][123090] Updated weights for policy 1, policy_version 954312 (0.0009) [2023-12-26 07:15:56,179][123090] Updated weights for policy 1, policy_version 954322 (0.0009) [2023-12-26 07:15:56,228][123090] Updated weights for policy 1, policy_version 954332 (0.0007) [2023-12-26 07:15:56,712][123091] Updated weights for policy 0, policy_version 961206 (0.0010) [2023-12-26 07:15:56,777][123091] Updated weights for policy 0, policy_version 961216 (0.0010) [2023-12-26 07:15:56,835][123091] Updated weights for policy 0, policy_version 961226 (0.0010) [2023-12-26 07:15:57,001][123090] Updated weights for policy 1, policy_version 954342 (0.0007) [2023-12-26 07:15:57,050][123090] Updated weights for policy 1, policy_version 954352 (0.0009) [2023-12-26 07:15:57,098][123090] Updated weights for policy 1, policy_version 954362 (0.0009) [2023-12-26 07:15:57,568][123091] Updated weights for policy 0, policy_version 961236 (0.0010) [2023-12-26 07:15:57,620][123091] Updated weights for policy 0, policy_version 961246 (0.0005) [2023-12-26 07:15:57,674][123091] Updated weights for policy 0, policy_version 961256 (0.0005) [2023-12-26 07:15:57,843][123090] Updated weights for policy 1, policy_version 954372 (0.0007) [2023-12-26 07:15:57,889][123090] Updated weights for policy 1, policy_version 954382 (0.0005) [2023-12-26 07:15:57,949][123090] Updated weights for policy 1, policy_version 954392 (0.0005) [2023-12-26 07:15:58,523][123091] Updated weights for policy 0, policy_version 961266 (0.0006) [2023-12-26 07:15:58,593][123091] Updated weights for policy 0, policy_version 961276 (0.0009) [2023-12-26 07:15:58,660][123091] Updated weights for policy 0, policy_version 961286 (0.0008) [2023-12-26 07:15:58,682][123090] Updated weights for policy 1, policy_version 954402 (0.0006) [2023-12-26 07:15:58,728][123091] Updated weights for policy 0, policy_version 961296 (0.0009) [2023-12-26 07:15:58,752][123090] Updated weights for policy 1, policy_version 954412 (0.0008) [2023-12-26 07:15:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 490422272. Throughput: 0: 8731.4, 1: 8689.0. Samples: 490416580. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:15:58,785][121949] Avg episode reward: [(0, '6140.693'), (1, '5863.667')] [2023-12-26 07:15:58,826][123090] Updated weights for policy 1, policy_version 954422 (0.0008) [2023-12-26 07:15:58,897][123090] Updated weights for policy 1, policy_version 954432 (0.0010) [2023-12-26 07:15:59,592][123091] Updated weights for policy 0, policy_version 961306 (0.0009) [2023-12-26 07:15:59,651][123091] Updated weights for policy 0, policy_version 961316 (0.0009) [2023-12-26 07:15:59,721][123091] Updated weights for policy 0, policy_version 961326 (0.0010) [2023-12-26 07:15:59,760][123090] Updated weights for policy 1, policy_version 954442 (0.0009) [2023-12-26 07:15:59,832][123090] Updated weights for policy 1, policy_version 954452 (0.0010) [2023-12-26 07:15:59,888][123090] Updated weights for policy 1, policy_version 954462 (0.0008) [2023-12-26 07:16:00,525][123091] Updated weights for policy 0, policy_version 961336 (0.0006) [2023-12-26 07:16:00,596][123091] Updated weights for policy 0, policy_version 961346 (0.0005) [2023-12-26 07:16:00,666][123091] Updated weights for policy 0, policy_version 961356 (0.0006) [2023-12-26 07:16:00,712][123090] Updated weights for policy 1, policy_version 954472 (0.0006) [2023-12-26 07:16:00,776][123090] Updated weights for policy 1, policy_version 954482 (0.0005) [2023-12-26 07:16:00,846][123090] Updated weights for policy 1, policy_version 954492 (0.0005) [2023-12-26 07:16:01,326][123091] Updated weights for policy 0, policy_version 961366 (0.0008) [2023-12-26 07:16:01,394][123091] Updated weights for policy 0, policy_version 961376 (0.0009) [2023-12-26 07:16:01,460][123091] Updated weights for policy 0, policy_version 961386 (0.0008) [2023-12-26 07:16:01,504][123090] Updated weights for policy 1, policy_version 954502 (0.0006) [2023-12-26 07:16:01,572][123090] Updated weights for policy 1, policy_version 954512 (0.0005) [2023-12-26 07:16:01,647][123090] Updated weights for policy 1, policy_version 954522 (0.0007) [2023-12-26 07:16:02,329][123090] Updated weights for policy 1, policy_version 954532 (0.0007) [2023-12-26 07:16:02,354][123091] Updated weights for policy 0, policy_version 961396 (0.0009) [2023-12-26 07:16:02,394][123090] Updated weights for policy 1, policy_version 954542 (0.0008) [2023-12-26 07:16:02,413][123091] Updated weights for policy 0, policy_version 961406 (0.0009) [2023-12-26 07:16:02,447][123090] Updated weights for policy 1, policy_version 954552 (0.0009) [2023-12-26 07:16:02,462][123091] Updated weights for policy 0, policy_version 961416 (0.0009) [2023-12-26 07:16:03,135][123091] Updated weights for policy 0, policy_version 961426 (0.0008) [2023-12-26 07:16:03,182][123091] Updated weights for policy 0, policy_version 961436 (0.0007) [2023-12-26 07:16:03,197][123090] Updated weights for policy 1, policy_version 954562 (0.0009) [2023-12-26 07:16:03,242][123091] Updated weights for policy 0, policy_version 961446 (0.0011) [2023-12-26 07:16:03,256][123090] Updated weights for policy 1, policy_version 954572 (0.0010) [2023-12-26 07:16:03,300][123091] Updated weights for policy 0, policy_version 961456 (0.0010) [2023-12-26 07:16:03,308][123090] Updated weights for policy 1, policy_version 954582 (0.0010) [2023-12-26 07:16:03,356][123090] Updated weights for policy 1, policy_version 954592 (0.0010) [2023-12-26 07:16:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 490512384. Throughput: 0: 8739.5, 1: 8664.3. Samples: 490523448. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:03,785][121949] Avg episode reward: [(0, '6242.094'), (1, '5924.846')] [2023-12-26 07:16:04,130][123091] Updated weights for policy 0, policy_version 961466 (0.0009) [2023-12-26 07:16:04,189][123091] Updated weights for policy 0, policy_version 961476 (0.0006) [2023-12-26 07:16:04,195][123090] Updated weights for policy 1, policy_version 954602 (0.0011) [2023-12-26 07:16:04,256][123091] Updated weights for policy 0, policy_version 961486 (0.0008) [2023-12-26 07:16:04,264][123090] Updated weights for policy 1, policy_version 954612 (0.0011) [2023-12-26 07:16:04,329][123090] Updated weights for policy 1, policy_version 954622 (0.0008) [2023-12-26 07:16:05,018][123091] Updated weights for policy 0, policy_version 961496 (0.0008) [2023-12-26 07:16:05,074][123091] Updated weights for policy 0, policy_version 961506 (0.0010) [2023-12-26 07:16:05,133][123091] Updated weights for policy 0, policy_version 961518 (0.0011) [2023-12-26 07:16:05,191][123090] Updated weights for policy 1, policy_version 954632 (0.0006) [2023-12-26 07:16:05,245][123090] Updated weights for policy 1, policy_version 954642 (0.0009) [2023-12-26 07:16:05,300][123090] Updated weights for policy 1, policy_version 954652 (0.0009) [2023-12-26 07:16:05,893][123091] Updated weights for policy 0, policy_version 961528 (0.0006) [2023-12-26 07:16:05,938][123091] Updated weights for policy 0, policy_version 961538 (0.0005) [2023-12-26 07:16:06,001][123091] Updated weights for policy 0, policy_version 961548 (0.0006) [2023-12-26 07:16:06,043][123090] Updated weights for policy 1, policy_version 954662 (0.0007) [2023-12-26 07:16:06,101][123090] Updated weights for policy 1, policy_version 954672 (0.0006) [2023-12-26 07:16:06,165][123090] Updated weights for policy 1, policy_version 954682 (0.0010) [2023-12-26 07:16:06,724][123091] Updated weights for policy 0, policy_version 961558 (0.0011) [2023-12-26 07:16:06,795][123091] Updated weights for policy 0, policy_version 961568 (0.0011) [2023-12-26 07:16:06,856][123090] Updated weights for policy 1, policy_version 954692 (0.0009) [2023-12-26 07:16:06,858][123091] Updated weights for policy 0, policy_version 961578 (0.0011) [2023-12-26 07:16:06,921][123090] Updated weights for policy 1, policy_version 954702 (0.0006) [2023-12-26 07:16:06,989][123090] Updated weights for policy 1, policy_version 954712 (0.0008) [2023-12-26 07:16:07,615][123091] Updated weights for policy 0, policy_version 961588 (0.0011) [2023-12-26 07:16:07,665][123091] Updated weights for policy 0, policy_version 961598 (0.0010) [2023-12-26 07:16:07,720][123091] Updated weights for policy 0, policy_version 961608 (0.0010) [2023-12-26 07:16:07,776][123090] Updated weights for policy 1, policy_version 954722 (0.0010) [2023-12-26 07:16:07,825][123090] Updated weights for policy 1, policy_version 954732 (0.0009) [2023-12-26 07:16:07,873][123090] Updated weights for policy 1, policy_version 954742 (0.0009) [2023-12-26 07:16:07,925][123090] Updated weights for policy 1, policy_version 954752 (0.0005) [2023-12-26 07:16:08,439][123091] Updated weights for policy 0, policy_version 961618 (0.0009) [2023-12-26 07:16:08,495][123091] Updated weights for policy 0, policy_version 961628 (0.0006) [2023-12-26 07:16:08,555][123091] Updated weights for policy 0, policy_version 961638 (0.0005) [2023-12-26 07:16:08,620][123091] Updated weights for policy 0, policy_version 961648 (0.0009) [2023-12-26 07:16:08,666][123090] Updated weights for policy 1, policy_version 954762 (0.0008) [2023-12-26 07:16:08,734][123090] Updated weights for policy 1, policy_version 954772 (0.0010) [2023-12-26 07:16:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 490602496. Throughput: 0: 8804.9, 1: 8718.7. Samples: 490578196. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:08,785][121949] Avg episode reward: [(0, '6234.906'), (1, '5954.866')] [2023-12-26 07:16:08,786][123090] Updated weights for policy 1, policy_version 954782 (0.0008) [2023-12-26 07:16:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000961648_246185984.pth... [2023-12-26 07:16:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000960624_245923840.pth [2023-12-26 07:16:08,798][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000954784_244424704.pth... [2023-12-26 07:16:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000953728_244154368.pth [2023-12-26 07:16:09,343][123091] Updated weights for policy 0, policy_version 961658 (0.0010) [2023-12-26 07:16:09,418][123091] Updated weights for policy 0, policy_version 961668 (0.0009) [2023-12-26 07:16:09,491][123091] Updated weights for policy 0, policy_version 961678 (0.0008) [2023-12-26 07:16:09,692][123090] Updated weights for policy 1, policy_version 954792 (0.0009) [2023-12-26 07:16:09,761][123090] Updated weights for policy 1, policy_version 954802 (0.0007) [2023-12-26 07:16:09,829][123090] Updated weights for policy 1, policy_version 954812 (0.0009) [2023-12-26 07:16:10,396][123091] Updated weights for policy 0, policy_version 961688 (0.0009) [2023-12-26 07:16:10,459][123091] Updated weights for policy 0, policy_version 961698 (0.0010) [2023-12-26 07:16:10,515][123091] Updated weights for policy 0, policy_version 961708 (0.0009) [2023-12-26 07:16:10,633][123090] Updated weights for policy 1, policy_version 954822 (0.0010) [2023-12-26 07:16:10,711][123090] Updated weights for policy 1, policy_version 954832 (0.0009) [2023-12-26 07:16:10,772][123090] Updated weights for policy 1, policy_version 954842 (0.0010) [2023-12-26 07:16:11,392][123091] Updated weights for policy 0, policy_version 961718 (0.0008) [2023-12-26 07:16:11,454][123091] Updated weights for policy 0, policy_version 961728 (0.0007) [2023-12-26 07:16:11,521][123091] Updated weights for policy 0, policy_version 961738 (0.0009) [2023-12-26 07:16:11,575][123090] Updated weights for policy 1, policy_version 954852 (0.0008) [2023-12-26 07:16:11,644][123090] Updated weights for policy 1, policy_version 954862 (0.0007) [2023-12-26 07:16:11,706][123090] Updated weights for policy 1, policy_version 954872 (0.0007) [2023-12-26 07:16:12,412][123091] Updated weights for policy 0, policy_version 961748 (0.0010) [2023-12-26 07:16:12,464][123091] Updated weights for policy 0, policy_version 961758 (0.0010) [2023-12-26 07:16:12,492][123090] Updated weights for policy 1, policy_version 954882 (0.0009) [2023-12-26 07:16:12,525][123091] Updated weights for policy 0, policy_version 961768 (0.0008) [2023-12-26 07:16:12,560][123090] Updated weights for policy 1, policy_version 954892 (0.0008) [2023-12-26 07:16:12,624][123090] Updated weights for policy 1, policy_version 954902 (0.0009) [2023-12-26 07:16:12,676][123090] Updated weights for policy 1, policy_version 954912 (0.0009) [2023-12-26 07:16:13,382][123091] Updated weights for policy 0, policy_version 961778 (0.0007) [2023-12-26 07:16:13,430][123091] Updated weights for policy 0, policy_version 961788 (0.0009) [2023-12-26 07:16:13,476][123091] Updated weights for policy 0, policy_version 961798 (0.0007) [2023-12-26 07:16:13,491][123090] Updated weights for policy 1, policy_version 954922 (0.0010) [2023-12-26 07:16:13,533][123091] Updated weights for policy 0, policy_version 961808 (0.0008) [2023-12-26 07:16:13,550][123090] Updated weights for policy 1, policy_version 954932 (0.0009) [2023-12-26 07:16:13,616][123090] Updated weights for policy 1, policy_version 954942 (0.0008) [2023-12-26 07:16:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 490692608. Throughput: 0: 8812.9, 1: 8743.1. Samples: 490682232. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:13,785][121949] Avg episode reward: [(0, '6199.507'), (1, '5946.772')] [2023-12-26 07:16:14,312][123091] Updated weights for policy 0, policy_version 961818 (0.0009) [2023-12-26 07:16:14,364][123091] Updated weights for policy 0, policy_version 961828 (0.0009) [2023-12-26 07:16:14,419][123091] Updated weights for policy 0, policy_version 961838 (0.0009) [2023-12-26 07:16:14,478][123090] Updated weights for policy 1, policy_version 954952 (0.0008) [2023-12-26 07:16:14,536][123090] Updated weights for policy 1, policy_version 954962 (0.0009) [2023-12-26 07:16:14,599][123090] Updated weights for policy 1, policy_version 954972 (0.0009) [2023-12-26 07:16:15,319][123091] Updated weights for policy 0, policy_version 961848 (0.0009) [2023-12-26 07:16:15,345][123090] Updated weights for policy 1, policy_version 954982 (0.0009) [2023-12-26 07:16:15,382][123091] Updated weights for policy 0, policy_version 961858 (0.0009) [2023-12-26 07:16:15,399][123090] Updated weights for policy 1, policy_version 954992 (0.0008) [2023-12-26 07:16:15,450][123091] Updated weights for policy 0, policy_version 961868 (0.0009) [2023-12-26 07:16:15,457][123090] Updated weights for policy 1, policy_version 955002 (0.0009) [2023-12-26 07:16:16,208][123091] Updated weights for policy 0, policy_version 961878 (0.0008) [2023-12-26 07:16:16,273][123091] Updated weights for policy 0, policy_version 961888 (0.0008) [2023-12-26 07:16:16,301][123090] Updated weights for policy 1, policy_version 955012 (0.0009) [2023-12-26 07:16:16,349][123091] Updated weights for policy 0, policy_version 961898 (0.0007) [2023-12-26 07:16:16,358][123090] Updated weights for policy 1, policy_version 955022 (0.0010) [2023-12-26 07:16:16,421][123090] Updated weights for policy 1, policy_version 955032 (0.0010) [2023-12-26 07:16:16,918][123091] Updated weights for policy 0, policy_version 961908 (0.0005) [2023-12-26 07:16:16,988][123091] Updated weights for policy 0, policy_version 961918 (0.0005) [2023-12-26 07:16:17,055][123091] Updated weights for policy 0, policy_version 961928 (0.0005) [2023-12-26 07:16:17,191][123090] Updated weights for policy 1, policy_version 955042 (0.0010) [2023-12-26 07:16:17,246][123090] Updated weights for policy 1, policy_version 955052 (0.0010) [2023-12-26 07:16:17,308][123090] Updated weights for policy 1, policy_version 955062 (0.0007) [2023-12-26 07:16:17,372][123090] Updated weights for policy 1, policy_version 955072 (0.0005) [2023-12-26 07:16:17,598][123091] Updated weights for policy 0, policy_version 961938 (0.0005) [2023-12-26 07:16:17,662][123091] Updated weights for policy 0, policy_version 961948 (0.0005) [2023-12-26 07:16:17,736][123091] Updated weights for policy 0, policy_version 961958 (0.0005) [2023-12-26 07:16:17,786][123091] Updated weights for policy 0, policy_version 961968 (0.0009) [2023-12-26 07:16:18,158][123090] Updated weights for policy 1, policy_version 955082 (0.0005) [2023-12-26 07:16:18,210][123090] Updated weights for policy 1, policy_version 955092 (0.0005) [2023-12-26 07:16:18,269][123090] Updated weights for policy 1, policy_version 955102 (0.0008) [2023-12-26 07:16:18,518][123091] Updated weights for policy 0, policy_version 961978 (0.0011) [2023-12-26 07:16:18,583][123091] Updated weights for policy 0, policy_version 961988 (0.0011) [2023-12-26 07:16:18,647][123091] Updated weights for policy 0, policy_version 961998 (0.0011) [2023-12-26 07:16:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 490782720. Throughput: 0: 8906.9, 1: 8742.8. Samples: 490791668. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:18,785][121949] Avg episode reward: [(0, '6100.897'), (1, '5904.724')] [2023-12-26 07:16:19,042][123090] Updated weights for policy 1, policy_version 955112 (0.0010) [2023-12-26 07:16:19,090][123090] Updated weights for policy 1, policy_version 955122 (0.0010) [2023-12-26 07:16:19,140][123090] Updated weights for policy 1, policy_version 955132 (0.0007) [2023-12-26 07:16:19,495][123091] Updated weights for policy 0, policy_version 962008 (0.0011) [2023-12-26 07:16:19,558][123091] Updated weights for policy 0, policy_version 962018 (0.0011) [2023-12-26 07:16:19,621][123091] Updated weights for policy 0, policy_version 962028 (0.0011) [2023-12-26 07:16:19,988][123090] Updated weights for policy 1, policy_version 955142 (0.0009) [2023-12-26 07:16:20,049][123090] Updated weights for policy 1, policy_version 955152 (0.0011) [2023-12-26 07:16:20,107][123090] Updated weights for policy 1, policy_version 955162 (0.0011) [2023-12-26 07:16:20,425][123091] Updated weights for policy 0, policy_version 962038 (0.0011) [2023-12-26 07:16:20,494][123091] Updated weights for policy 0, policy_version 962048 (0.0011) [2023-12-26 07:16:20,568][123091] Updated weights for policy 0, policy_version 962058 (0.0011) [2023-12-26 07:16:20,954][123090] Updated weights for policy 1, policy_version 955172 (0.0011) [2023-12-26 07:16:21,010][123090] Updated weights for policy 1, policy_version 955182 (0.0010) [2023-12-26 07:16:21,070][123090] Updated weights for policy 1, policy_version 955192 (0.0011) [2023-12-26 07:16:21,407][123091] Updated weights for policy 0, policy_version 962068 (0.0009) [2023-12-26 07:16:21,476][123091] Updated weights for policy 0, policy_version 962078 (0.0007) [2023-12-26 07:16:21,553][123091] Updated weights for policy 0, policy_version 962088 (0.0009) [2023-12-26 07:16:21,958][123090] Updated weights for policy 1, policy_version 955202 (0.0010) [2023-12-26 07:16:22,020][123090] Updated weights for policy 1, policy_version 955212 (0.0008) [2023-12-26 07:16:22,081][123090] Updated weights for policy 1, policy_version 955222 (0.0009) [2023-12-26 07:16:22,136][123090] Updated weights for policy 1, policy_version 955232 (0.0009) [2023-12-26 07:16:22,267][123091] Updated weights for policy 0, policy_version 962098 (0.0009) [2023-12-26 07:16:22,320][123091] Updated weights for policy 0, policy_version 962108 (0.0006) [2023-12-26 07:16:22,383][123091] Updated weights for policy 0, policy_version 962118 (0.0008) [2023-12-26 07:16:22,452][123091] Updated weights for policy 0, policy_version 962128 (0.0008) [2023-12-26 07:16:22,926][123090] Updated weights for policy 1, policy_version 955242 (0.0005) [2023-12-26 07:16:22,977][123090] Updated weights for policy 1, policy_version 955252 (0.0005) [2023-12-26 07:16:23,038][123090] Updated weights for policy 1, policy_version 955262 (0.0006) [2023-12-26 07:16:23,167][123091] Updated weights for policy 0, policy_version 962138 (0.0006) [2023-12-26 07:16:23,215][123091] Updated weights for policy 0, policy_version 962148 (0.0008) [2023-12-26 07:16:23,272][123091] Updated weights for policy 0, policy_version 962158 (0.0005) [2023-12-26 07:16:23,703][123090] Updated weights for policy 1, policy_version 955272 (0.0009) [2023-12-26 07:16:23,755][123090] Updated weights for policy 1, policy_version 955282 (0.0009) [2023-12-26 07:16:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 490864640. Throughput: 0: 8818.0, 1: 8718.8. Samples: 490842256. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:23,785][121949] Avg episode reward: [(0, '6044.076'), (1, '5885.921')] [2023-12-26 07:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000962160_246317056.pth... [2023-12-26 07:16:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000961104_246046720.pth [2023-12-26 07:16:23,814][123090] Updated weights for policy 1, policy_version 955292 (0.0010) [2023-12-26 07:16:23,839][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000955296_244555776.pth... [2023-12-26 07:16:23,844][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000954240_244285440.pth [2023-12-26 07:16:24,003][123091] Updated weights for policy 0, policy_version 962168 (0.0005) [2023-12-26 07:16:24,050][123091] Updated weights for policy 0, policy_version 962178 (0.0006) [2023-12-26 07:16:24,101][123091] Updated weights for policy 0, policy_version 962188 (0.0007) [2023-12-26 07:16:24,731][123090] Updated weights for policy 1, policy_version 955302 (0.0009) [2023-12-26 07:16:24,791][123090] Updated weights for policy 1, policy_version 955312 (0.0009) [2023-12-26 07:16:24,849][123090] Updated weights for policy 1, policy_version 955322 (0.0007) [2023-12-26 07:16:24,886][123091] Updated weights for policy 0, policy_version 962198 (0.0009) [2023-12-26 07:16:24,944][123091] Updated weights for policy 0, policy_version 962208 (0.0010) [2023-12-26 07:16:25,007][123091] Updated weights for policy 0, policy_version 962218 (0.0010) [2023-12-26 07:16:25,672][123090] Updated weights for policy 1, policy_version 955332 (0.0006) [2023-12-26 07:16:25,731][123090] Updated weights for policy 1, policy_version 955342 (0.0005) [2023-12-26 07:16:25,781][123090] Updated weights for policy 1, policy_version 955352 (0.0005) [2023-12-26 07:16:25,837][123091] Updated weights for policy 0, policy_version 962228 (0.0010) [2023-12-26 07:16:25,901][123091] Updated weights for policy 0, policy_version 962238 (0.0011) [2023-12-26 07:16:25,952][123091] Updated weights for policy 0, policy_version 962248 (0.0010) [2023-12-26 07:16:26,585][123090] Updated weights for policy 1, policy_version 955362 (0.0008) [2023-12-26 07:16:26,652][123090] Updated weights for policy 1, policy_version 955372 (0.0009) [2023-12-26 07:16:26,712][123090] Updated weights for policy 1, policy_version 955382 (0.0009) [2023-12-26 07:16:26,765][123090] Updated weights for policy 1, policy_version 955392 (0.0008) [2023-12-26 07:16:26,771][123091] Updated weights for policy 0, policy_version 962258 (0.0011) [2023-12-26 07:16:26,826][123091] Updated weights for policy 0, policy_version 962268 (0.0010) [2023-12-26 07:16:26,874][123091] Updated weights for policy 0, policy_version 962278 (0.0010) [2023-12-26 07:16:26,928][123091] Updated weights for policy 0, policy_version 962288 (0.0010) [2023-12-26 07:16:27,555][123090] Updated weights for policy 1, policy_version 955402 (0.0005) [2023-12-26 07:16:27,623][123090] Updated weights for policy 1, policy_version 955412 (0.0005) [2023-12-26 07:16:27,678][123090] Updated weights for policy 1, policy_version 955422 (0.0005) [2023-12-26 07:16:27,704][123091] Updated weights for policy 0, policy_version 962298 (0.0005) [2023-12-26 07:16:27,771][123091] Updated weights for policy 0, policy_version 962308 (0.0007) [2023-12-26 07:16:27,832][123091] Updated weights for policy 0, policy_version 962318 (0.0005) [2023-12-26 07:16:28,341][123090] Updated weights for policy 1, policy_version 955432 (0.0007) [2023-12-26 07:16:28,393][123090] Updated weights for policy 1, policy_version 955442 (0.0008) [2023-12-26 07:16:28,419][123091] Updated weights for policy 0, policy_version 962328 (0.0006) [2023-12-26 07:16:28,463][123090] Updated weights for policy 1, policy_version 955452 (0.0008) [2023-12-26 07:16:28,474][123091] Updated weights for policy 0, policy_version 962338 (0.0006) [2023-12-26 07:16:28,534][123091] Updated weights for policy 0, policy_version 962348 (0.0007) [2023-12-26 07:16:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 490962944. Throughput: 0: 8891.5, 1: 8806.2. Samples: 490950744. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:28,784][121949] Avg episode reward: [(0, '6078.651'), (1, '5665.041')] [2023-12-26 07:16:29,276][123090] Updated weights for policy 1, policy_version 955462 (0.0008) [2023-12-26 07:16:29,341][123090] Updated weights for policy 1, policy_version 955472 (0.0008) [2023-12-26 07:16:29,341][123091] Updated weights for policy 0, policy_version 962358 (0.0011) [2023-12-26 07:16:29,396][123091] Updated weights for policy 0, policy_version 962368 (0.0010) [2023-12-26 07:16:29,403][123090] Updated weights for policy 1, policy_version 955482 (0.0008) [2023-12-26 07:16:29,451][123091] Updated weights for policy 0, policy_version 962378 (0.0010) [2023-12-26 07:16:30,248][123090] Updated weights for policy 1, policy_version 955492 (0.0007) [2023-12-26 07:16:30,287][123091] Updated weights for policy 0, policy_version 962388 (0.0010) [2023-12-26 07:16:30,306][123090] Updated weights for policy 1, policy_version 955502 (0.0007) [2023-12-26 07:16:30,350][123091] Updated weights for policy 0, policy_version 962398 (0.0011) [2023-12-26 07:16:30,366][123090] Updated weights for policy 1, policy_version 955512 (0.0007) [2023-12-26 07:16:30,408][123091] Updated weights for policy 0, policy_version 962408 (0.0010) [2023-12-26 07:16:31,109][123090] Updated weights for policy 1, policy_version 955522 (0.0007) [2023-12-26 07:16:31,180][123090] Updated weights for policy 1, policy_version 955532 (0.0007) [2023-12-26 07:16:31,251][123091] Updated weights for policy 0, policy_version 962418 (0.0010) [2023-12-26 07:16:31,256][123090] Updated weights for policy 1, policy_version 955542 (0.0006) [2023-12-26 07:16:31,314][123091] Updated weights for policy 0, policy_version 962428 (0.0011) [2023-12-26 07:16:31,325][123090] Updated weights for policy 1, policy_version 955552 (0.0006) [2023-12-26 07:16:31,384][123091] Updated weights for policy 0, policy_version 962438 (0.0010) [2023-12-26 07:16:31,446][123091] Updated weights for policy 0, policy_version 962448 (0.0008) [2023-12-26 07:16:32,134][123090] Updated weights for policy 1, policy_version 955562 (0.0010) [2023-12-26 07:16:32,181][123090] Updated weights for policy 1, policy_version 955572 (0.0008) [2023-12-26 07:16:32,191][123091] Updated weights for policy 0, policy_version 962458 (0.0007) [2023-12-26 07:16:32,239][123090] Updated weights for policy 1, policy_version 955582 (0.0007) [2023-12-26 07:16:32,253][123091] Updated weights for policy 0, policy_version 962468 (0.0009) [2023-12-26 07:16:32,317][123091] Updated weights for policy 0, policy_version 962478 (0.0010) [2023-12-26 07:16:33,015][123090] Updated weights for policy 1, policy_version 955592 (0.0006) [2023-12-26 07:16:33,068][123090] Updated weights for policy 1, policy_version 955602 (0.0009) [2023-12-26 07:16:33,114][123091] Updated weights for policy 0, policy_version 962488 (0.0009) [2023-12-26 07:16:33,117][123090] Updated weights for policy 1, policy_version 955612 (0.0006) [2023-12-26 07:16:33,169][123091] Updated weights for policy 0, policy_version 962498 (0.0010) [2023-12-26 07:16:33,223][123091] Updated weights for policy 0, policy_version 962508 (0.0009) [2023-12-26 07:16:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 491044864. Throughput: 0: 8979.6, 1: 8807.5. Samples: 491058696. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:33,785][121949] Avg episode reward: [(0, '6159.669'), (1, '5664.142')] [2023-12-26 07:16:33,917][123090] Updated weights for policy 1, policy_version 955622 (0.0008) [2023-12-26 07:16:33,963][123090] Updated weights for policy 1, policy_version 955632 (0.0009) [2023-12-26 07:16:33,984][123091] Updated weights for policy 0, policy_version 962518 (0.0010) [2023-12-26 07:16:34,025][123090] Updated weights for policy 1, policy_version 955642 (0.0009) [2023-12-26 07:16:34,032][123091] Updated weights for policy 0, policy_version 962528 (0.0010) [2023-12-26 07:16:34,090][123091] Updated weights for policy 0, policy_version 962538 (0.0010) [2023-12-26 07:16:34,873][123090] Updated weights for policy 1, policy_version 955652 (0.0007) [2023-12-26 07:16:34,920][123090] Updated weights for policy 1, policy_version 955662 (0.0008) [2023-12-26 07:16:34,936][123091] Updated weights for policy 0, policy_version 962548 (0.0010) [2023-12-26 07:16:34,980][123090] Updated weights for policy 1, policy_version 955672 (0.0009) [2023-12-26 07:16:34,984][123091] Updated weights for policy 0, policy_version 962558 (0.0010) [2023-12-26 07:16:35,036][123091] Updated weights for policy 0, policy_version 962568 (0.0011) [2023-12-26 07:16:35,817][123090] Updated weights for policy 1, policy_version 955682 (0.0008) [2023-12-26 07:16:35,868][123091] Updated weights for policy 0, policy_version 962578 (0.0010) [2023-12-26 07:16:35,880][123090] Updated weights for policy 1, policy_version 955692 (0.0007) [2023-12-26 07:16:35,928][123091] Updated weights for policy 0, policy_version 962588 (0.0011) [2023-12-26 07:16:35,940][123090] Updated weights for policy 1, policy_version 955702 (0.0006) [2023-12-26 07:16:35,994][123090] Updated weights for policy 1, policy_version 955712 (0.0008) [2023-12-26 07:16:35,996][123091] Updated weights for policy 0, policy_version 962598 (0.0011) [2023-12-26 07:16:36,052][123091] Updated weights for policy 0, policy_version 962608 (0.0011) [2023-12-26 07:16:36,847][123090] Updated weights for policy 1, policy_version 955722 (0.0008) [2023-12-26 07:16:36,883][123091] Updated weights for policy 0, policy_version 962618 (0.0011) [2023-12-26 07:16:36,911][123090] Updated weights for policy 1, policy_version 955732 (0.0006) [2023-12-26 07:16:36,935][123091] Updated weights for policy 0, policy_version 962628 (0.0010) [2023-12-26 07:16:36,976][123090] Updated weights for policy 1, policy_version 955742 (0.0006) [2023-12-26 07:16:36,998][123091] Updated weights for policy 0, policy_version 962638 (0.0010) [2023-12-26 07:16:37,800][123090] Updated weights for policy 1, policy_version 955752 (0.0009) [2023-12-26 07:16:37,841][123091] Updated weights for policy 0, policy_version 962648 (0.0010) [2023-12-26 07:16:37,860][123090] Updated weights for policy 1, policy_version 955762 (0.0007) [2023-12-26 07:16:37,907][123091] Updated weights for policy 0, policy_version 962658 (0.0011) [2023-12-26 07:16:37,927][123090] Updated weights for policy 1, policy_version 955772 (0.0006) [2023-12-26 07:16:37,971][123091] Updated weights for policy 0, policy_version 962668 (0.0011) [2023-12-26 07:16:38,754][123090] Updated weights for policy 1, policy_version 955782 (0.0007) [2023-12-26 07:16:38,760][123091] Updated weights for policy 0, policy_version 962678 (0.0011) [2023-12-26 07:16:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 491126784. Throughput: 0: 8988.2, 1: 8815.3. Samples: 491109940. Policy #0 lag: (min: 2.0, avg: 13.1, max: 34.0) [2023-12-26 07:16:38,784][121949] Avg episode reward: [(0, '6142.544'), (1, '5768.790')] [2023-12-26 07:16:38,816][123091] Updated weights for policy 0, policy_version 962688 (0.0010) [2023-12-26 07:16:38,819][123090] Updated weights for policy 1, policy_version 955792 (0.0006) [2023-12-26 07:16:38,873][123091] Updated weights for policy 0, policy_version 962698 (0.0011) [2023-12-26 07:16:38,875][123090] Updated weights for policy 1, policy_version 955802 (0.0006) [2023-12-26 07:16:38,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000962704_246456320.pth... [2023-12-26 07:16:38,904][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000961648_246185984.pth [2023-12-26 07:16:38,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000955808_244686848.pth... [2023-12-26 07:16:38,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000954784_244424704.pth [2023-12-26 07:16:39,708][123091] Updated weights for policy 0, policy_version 962708 (0.0010) [2023-12-26 07:16:39,743][123090] Updated weights for policy 1, policy_version 955812 (0.0007) [2023-12-26 07:16:39,768][123091] Updated weights for policy 0, policy_version 962718 (0.0009) [2023-12-26 07:16:39,813][123090] Updated weights for policy 1, policy_version 955822 (0.0010) [2023-12-26 07:16:39,833][123091] Updated weights for policy 0, policy_version 962728 (0.0007) [2023-12-26 07:16:39,890][123090] Updated weights for policy 1, policy_version 955832 (0.0008) [2023-12-26 07:16:40,664][123090] Updated weights for policy 1, policy_version 955842 (0.0007) [2023-12-26 07:16:40,707][123091] Updated weights for policy 0, policy_version 962738 (0.0007) [2023-12-26 07:16:40,714][123090] Updated weights for policy 1, policy_version 955853 (0.0010) [2023-12-26 07:16:40,769][123091] Updated weights for policy 0, policy_version 962748 (0.0009) [2023-12-26 07:16:40,774][123090] Updated weights for policy 1, policy_version 955863 (0.0010) [2023-12-26 07:16:40,833][123091] Updated weights for policy 0, policy_version 962758 (0.0009) [2023-12-26 07:16:40,895][123091] Updated weights for policy 0, policy_version 962768 (0.0009) [2023-12-26 07:16:41,639][123090] Updated weights for policy 1, policy_version 955873 (0.0007) [2023-12-26 07:16:41,708][123090] Updated weights for policy 1, policy_version 955883 (0.0008) [2023-12-26 07:16:41,768][123090] Updated weights for policy 1, policy_version 955893 (0.0008) [2023-12-26 07:16:41,784][123091] Updated weights for policy 0, policy_version 962778 (0.0009) [2023-12-26 07:16:41,837][123090] Updated weights for policy 1, policy_version 955903 (0.0008) [2023-12-26 07:16:41,851][123091] Updated weights for policy 0, policy_version 962788 (0.0007) [2023-12-26 07:16:41,918][123091] Updated weights for policy 0, policy_version 962798 (0.0010) [2023-12-26 07:16:42,671][123090] Updated weights for policy 1, policy_version 955913 (0.0009) [2023-12-26 07:16:42,723][123091] Updated weights for policy 0, policy_version 962808 (0.0008) [2023-12-26 07:16:42,725][123090] Updated weights for policy 1, policy_version 955923 (0.0008) [2023-12-26 07:16:42,772][123091] Updated weights for policy 0, policy_version 962818 (0.0007) [2023-12-26 07:16:42,777][123090] Updated weights for policy 1, policy_version 955933 (0.0007) [2023-12-26 07:16:42,824][123091] Updated weights for policy 0, policy_version 962828 (0.0010) [2023-12-26 07:16:43,618][123090] Updated weights for policy 1, policy_version 955943 (0.0009) [2023-12-26 07:16:43,667][123091] Updated weights for policy 0, policy_version 962838 (0.0008) [2023-12-26 07:16:43,679][123090] Updated weights for policy 1, policy_version 955953 (0.0009) [2023-12-26 07:16:43,712][123091] Updated weights for policy 0, policy_version 962848 (0.0008) [2023-12-26 07:16:43,739][123090] Updated weights for policy 1, policy_version 955963 (0.0008) [2023-12-26 07:16:43,759][123091] Updated weights for policy 0, policy_version 962858 (0.0009) [2023-12-26 07:16:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 491216896. Throughput: 0: 8884.5, 1: 8768.9. Samples: 491210984. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:16:43,785][121949] Avg episode reward: [(0, '6070.926'), (1, '5940.202')] [2023-12-26 07:16:44,579][123091] Updated weights for policy 0, policy_version 962868 (0.0008) [2023-12-26 07:16:44,580][123090] Updated weights for policy 1, policy_version 955973 (0.0008) [2023-12-26 07:16:44,631][123091] Updated weights for policy 0, policy_version 962878 (0.0006) [2023-12-26 07:16:44,634][123090] Updated weights for policy 1, policy_version 955983 (0.0008) [2023-12-26 07:16:44,682][123091] Updated weights for policy 0, policy_version 962888 (0.0005) [2023-12-26 07:16:44,700][123090] Updated weights for policy 1, policy_version 955993 (0.0009) [2023-12-26 07:16:45,471][123091] Updated weights for policy 0, policy_version 962898 (0.0006) [2023-12-26 07:16:45,533][123091] Updated weights for policy 0, policy_version 962908 (0.0010) [2023-12-26 07:16:45,571][123090] Updated weights for policy 1, policy_version 956003 (0.0009) [2023-12-26 07:16:45,596][123091] Updated weights for policy 0, policy_version 962918 (0.0010) [2023-12-26 07:16:45,625][123090] Updated weights for policy 1, policy_version 956013 (0.0008) [2023-12-26 07:16:45,658][123091] Updated weights for policy 0, policy_version 962928 (0.0010) [2023-12-26 07:16:45,687][123090] Updated weights for policy 1, policy_version 956023 (0.0010) [2023-12-26 07:16:46,430][123090] Updated weights for policy 1, policy_version 956033 (0.0007) [2023-12-26 07:16:46,473][123091] Updated weights for policy 0, policy_version 962938 (0.0011) [2023-12-26 07:16:46,495][123090] Updated weights for policy 1, policy_version 956043 (0.0010) [2023-12-26 07:16:46,525][123091] Updated weights for policy 0, policy_version 962948 (0.0011) [2023-12-26 07:16:46,561][123090] Updated weights for policy 1, policy_version 956053 (0.0005) [2023-12-26 07:16:46,582][123091] Updated weights for policy 0, policy_version 962958 (0.0011) [2023-12-26 07:16:46,626][123090] Updated weights for policy 1, policy_version 956063 (0.0010) [2023-12-26 07:16:47,401][123090] Updated weights for policy 1, policy_version 956073 (0.0006) [2023-12-26 07:16:47,421][123091] Updated weights for policy 0, policy_version 962968 (0.0010) [2023-12-26 07:16:47,462][123090] Updated weights for policy 1, policy_version 956083 (0.0006) [2023-12-26 07:16:47,472][123091] Updated weights for policy 0, policy_version 962978 (0.0010) [2023-12-26 07:16:47,517][123090] Updated weights for policy 1, policy_version 956093 (0.0005) [2023-12-26 07:16:47,523][123091] Updated weights for policy 0, policy_version 962988 (0.0010) [2023-12-26 07:16:48,319][123091] Updated weights for policy 0, policy_version 962998 (0.0009) [2023-12-26 07:16:48,367][123090] Updated weights for policy 1, policy_version 956103 (0.0006) [2023-12-26 07:16:48,391][123091] Updated weights for policy 0, policy_version 963008 (0.0010) [2023-12-26 07:16:48,430][123090] Updated weights for policy 1, policy_version 956113 (0.0008) [2023-12-26 07:16:48,451][123091] Updated weights for policy 0, policy_version 963018 (0.0007) [2023-12-26 07:16:48,490][123090] Updated weights for policy 1, policy_version 956123 (0.0008) [2023-12-26 07:16:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 491307008. Throughput: 0: 8883.4, 1: 8726.6. Samples: 491315896. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:16:48,785][121949] Avg episode reward: [(0, '6052.350'), (1, '5959.020')] [2023-12-26 07:16:49,267][123091] Updated weights for policy 0, policy_version 963028 (0.0009) [2023-12-26 07:16:49,323][123090] Updated weights for policy 1, policy_version 956134 (0.0009) [2023-12-26 07:16:49,338][123091] Updated weights for policy 0, policy_version 963038 (0.0006) [2023-12-26 07:16:49,389][123090] Updated weights for policy 1, policy_version 956144 (0.0009) [2023-12-26 07:16:49,415][123091] Updated weights for policy 0, policy_version 963048 (0.0009) [2023-12-26 07:16:49,445][123090] Updated weights for policy 1, policy_version 956154 (0.0008) [2023-12-26 07:16:50,234][123091] Updated weights for policy 0, policy_version 963058 (0.0008) [2023-12-26 07:16:50,250][123090] Updated weights for policy 1, policy_version 956164 (0.0009) [2023-12-26 07:16:50,290][123091] Updated weights for policy 0, policy_version 963068 (0.0005) [2023-12-26 07:16:50,314][123090] Updated weights for policy 1, policy_version 956174 (0.0008) [2023-12-26 07:16:50,356][123091] Updated weights for policy 0, policy_version 963078 (0.0007) [2023-12-26 07:16:50,376][123090] Updated weights for policy 1, policy_version 956184 (0.0007) [2023-12-26 07:16:50,415][123091] Updated weights for policy 0, policy_version 963088 (0.0009) [2023-12-26 07:16:51,140][123091] Updated weights for policy 0, policy_version 963098 (0.0010) [2023-12-26 07:16:51,206][123091] Updated weights for policy 0, policy_version 963108 (0.0009) [2023-12-26 07:16:51,224][123090] Updated weights for policy 1, policy_version 956194 (0.0007) [2023-12-26 07:16:51,275][123091] Updated weights for policy 0, policy_version 963118 (0.0009) [2023-12-26 07:16:51,297][123090] Updated weights for policy 1, policy_version 956204 (0.0009) [2023-12-26 07:16:51,366][123090] Updated weights for policy 1, policy_version 956214 (0.0010) [2023-12-26 07:16:51,421][123090] Updated weights for policy 1, policy_version 956224 (0.0006) [2023-12-26 07:16:52,142][123090] Updated weights for policy 1, policy_version 956234 (0.0005) [2023-12-26 07:16:52,151][123091] Updated weights for policy 0, policy_version 963128 (0.0009) [2023-12-26 07:16:52,195][123090] Updated weights for policy 1, policy_version 956244 (0.0008) [2023-12-26 07:16:52,213][123091] Updated weights for policy 0, policy_version 963138 (0.0009) [2023-12-26 07:16:52,251][123090] Updated weights for policy 1, policy_version 956254 (0.0009) [2023-12-26 07:16:52,290][123091] Updated weights for policy 0, policy_version 963148 (0.0007) [2023-12-26 07:16:53,062][123091] Updated weights for policy 0, policy_version 963158 (0.0006) [2023-12-26 07:16:53,118][123091] Updated weights for policy 0, policy_version 963168 (0.0005) [2023-12-26 07:16:53,136][123090] Updated weights for policy 1, policy_version 956264 (0.0009) [2023-12-26 07:16:53,171][123091] Updated weights for policy 0, policy_version 963178 (0.0006) [2023-12-26 07:16:53,205][123090] Updated weights for policy 1, policy_version 956274 (0.0008) [2023-12-26 07:16:53,258][123090] Updated weights for policy 1, policy_version 956284 (0.0010) [2023-12-26 07:16:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 491388928. Throughput: 0: 8850.8, 1: 8694.0. Samples: 491367716. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:16:53,785][121949] Avg episode reward: [(0, '6093.076'), (1, '5884.407')] [2023-12-26 07:16:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000956288_244809728.pth... [2023-12-26 07:16:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000955296_244555776.pth [2023-12-26 07:16:53,815][123091] Updated weights for policy 0, policy_version 963188 (0.0005) [2023-12-26 07:16:53,870][123091] Updated weights for policy 0, policy_version 963198 (0.0005) [2023-12-26 07:16:53,916][123091] Updated weights for policy 0, policy_version 963208 (0.0005) [2023-12-26 07:16:53,953][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000963216_246587392.pth... [2023-12-26 07:16:53,956][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000962160_246317056.pth [2023-12-26 07:16:54,000][123090] Updated weights for policy 1, policy_version 956294 (0.0007) [2023-12-26 07:16:54,057][123090] Updated weights for policy 1, policy_version 956304 (0.0005) [2023-12-26 07:16:54,127][123090] Updated weights for policy 1, policy_version 956314 (0.0005) [2023-12-26 07:16:54,640][123091] Updated weights for policy 0, policy_version 963218 (0.0006) [2023-12-26 07:16:54,692][123091] Updated weights for policy 0, policy_version 963228 (0.0010) [2023-12-26 07:16:54,759][123091] Updated weights for policy 0, policy_version 963238 (0.0009) [2023-12-26 07:16:54,796][123090] Updated weights for policy 1, policy_version 956324 (0.0005) [2023-12-26 07:16:54,822][123091] Updated weights for policy 0, policy_version 963248 (0.0009) [2023-12-26 07:16:54,849][123090] Updated weights for policy 1, policy_version 956334 (0.0006) [2023-12-26 07:16:54,900][123090] Updated weights for policy 1, policy_version 956344 (0.0006) [2023-12-26 07:16:55,609][123091] Updated weights for policy 0, policy_version 963258 (0.0005) [2023-12-26 07:16:55,610][123090] Updated weights for policy 1, policy_version 956354 (0.0008) [2023-12-26 07:16:55,656][123091] Updated weights for policy 0, policy_version 963268 (0.0005) [2023-12-26 07:16:55,681][123090] Updated weights for policy 1, policy_version 956364 (0.0005) [2023-12-26 07:16:55,710][123091] Updated weights for policy 0, policy_version 963278 (0.0008) [2023-12-26 07:16:55,742][123090] Updated weights for policy 1, policy_version 956374 (0.0005) [2023-12-26 07:16:55,795][123090] Updated weights for policy 1, policy_version 956384 (0.0005) [2023-12-26 07:16:56,458][123091] Updated weights for policy 0, policy_version 963288 (0.0006) [2023-12-26 07:16:56,510][123091] Updated weights for policy 0, policy_version 963298 (0.0006) [2023-12-26 07:16:56,544][123090] Updated weights for policy 1, policy_version 956394 (0.0007) [2023-12-26 07:16:56,564][123091] Updated weights for policy 0, policy_version 963308 (0.0011) [2023-12-26 07:16:56,620][123090] Updated weights for policy 1, policy_version 956404 (0.0005) [2023-12-26 07:16:56,674][123090] Updated weights for policy 1, policy_version 956414 (0.0006) [2023-12-26 07:16:57,356][123090] Updated weights for policy 1, policy_version 956424 (0.0007) [2023-12-26 07:16:57,405][123091] Updated weights for policy 0, policy_version 963318 (0.0007) [2023-12-26 07:16:57,419][123090] Updated weights for policy 1, policy_version 956434 (0.0005) [2023-12-26 07:16:57,451][123091] Updated weights for policy 0, policy_version 963328 (0.0005) [2023-12-26 07:16:57,484][123090] Updated weights for policy 1, policy_version 956444 (0.0005) [2023-12-26 07:16:57,504][123091] Updated weights for policy 0, policy_version 963338 (0.0005) [2023-12-26 07:16:58,067][123090] Updated weights for policy 1, policy_version 956454 (0.0008) [2023-12-26 07:16:58,130][123090] Updated weights for policy 1, policy_version 956464 (0.0010) [2023-12-26 07:16:58,184][123090] Updated weights for policy 1, policy_version 956474 (0.0009) [2023-12-26 07:16:58,290][123091] Updated weights for policy 0, policy_version 963348 (0.0005) [2023-12-26 07:16:58,361][123091] Updated weights for policy 0, policy_version 963358 (0.0007) [2023-12-26 07:16:58,424][123091] Updated weights for policy 0, policy_version 963368 (0.0008) [2023-12-26 07:16:58,787][121949] Fps is (10 sec: 18017.1, 60 sec: 17748.5, 300 sec: 17716.8). Total num frames: 491487232. Throughput: 0: 8917.4, 1: 8809.6. Samples: 491480000. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:16:58,788][121949] Avg episode reward: [(0, '5962.225'), (1, '5837.251')] [2023-12-26 07:16:59,107][123090] Updated weights for policy 1, policy_version 956484 (0.0008) [2023-12-26 07:16:59,168][123090] Updated weights for policy 1, policy_version 956494 (0.0009) [2023-12-26 07:16:59,230][123090] Updated weights for policy 1, policy_version 956504 (0.0010) [2023-12-26 07:16:59,363][123091] Updated weights for policy 0, policy_version 963378 (0.0009) [2023-12-26 07:16:59,433][123091] Updated weights for policy 0, policy_version 963388 (0.0007) [2023-12-26 07:16:59,496][123091] Updated weights for policy 0, policy_version 963398 (0.0009) [2023-12-26 07:16:59,551][123091] Updated weights for policy 0, policy_version 963408 (0.0010) [2023-12-26 07:17:00,072][123090] Updated weights for policy 1, policy_version 956514 (0.0010) [2023-12-26 07:17:00,124][123090] Updated weights for policy 1, policy_version 956524 (0.0010) [2023-12-26 07:17:00,179][123090] Updated weights for policy 1, policy_version 956534 (0.0008) [2023-12-26 07:17:00,229][123090] Updated weights for policy 1, policy_version 956544 (0.0009) [2023-12-26 07:17:00,320][123091] Updated weights for policy 0, policy_version 963418 (0.0010) [2023-12-26 07:17:00,378][123091] Updated weights for policy 0, policy_version 963429 (0.0010) [2023-12-26 07:17:00,432][123091] Updated weights for policy 0, policy_version 963439 (0.0009) [2023-12-26 07:17:01,000][123090] Updated weights for policy 1, policy_version 956554 (0.0005) [2023-12-26 07:17:01,063][123090] Updated weights for policy 1, policy_version 956564 (0.0006) [2023-12-26 07:17:01,135][123090] Updated weights for policy 1, policy_version 956574 (0.0007) [2023-12-26 07:17:01,351][123091] Updated weights for policy 0, policy_version 963449 (0.0010) [2023-12-26 07:17:01,416][123091] Updated weights for policy 0, policy_version 963459 (0.0008) [2023-12-26 07:17:01,477][123091] Updated weights for policy 0, policy_version 963469 (0.0007) [2023-12-26 07:17:01,953][123090] Updated weights for policy 1, policy_version 956584 (0.0007) [2023-12-26 07:17:02,009][123090] Updated weights for policy 1, policy_version 956594 (0.0006) [2023-12-26 07:17:02,075][123090] Updated weights for policy 1, policy_version 956604 (0.0010) [2023-12-26 07:17:02,309][123091] Updated weights for policy 0, policy_version 963479 (0.0009) [2023-12-26 07:17:02,380][123091] Updated weights for policy 0, policy_version 963489 (0.0009) [2023-12-26 07:17:02,453][123091] Updated weights for policy 0, policy_version 963499 (0.0010) [2023-12-26 07:17:02,810][123090] Updated weights for policy 1, policy_version 956614 (0.0005) [2023-12-26 07:17:02,881][123090] Updated weights for policy 1, policy_version 956624 (0.0005) [2023-12-26 07:17:02,939][123090] Updated weights for policy 1, policy_version 956634 (0.0005) [2023-12-26 07:17:03,353][123091] Updated weights for policy 0, policy_version 963509 (0.0010) [2023-12-26 07:17:03,407][123091] Updated weights for policy 0, policy_version 963520 (0.0010) [2023-12-26 07:17:03,468][123091] Updated weights for policy 0, policy_version 963530 (0.0010) [2023-12-26 07:17:03,593][123090] Updated weights for policy 1, policy_version 956644 (0.0005) [2023-12-26 07:17:03,653][123090] Updated weights for policy 1, policy_version 956654 (0.0006) [2023-12-26 07:17:03,708][123090] Updated weights for policy 1, policy_version 956665 (0.0008) [2023-12-26 07:17:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 491577344. Throughput: 0: 8762.3, 1: 8839.2. Samples: 491583736. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:03,785][121949] Avg episode reward: [(0, '6098.351'), (1, '5960.344')] [2023-12-26 07:17:04,274][123091] Updated weights for policy 0, policy_version 963540 (0.0009) [2023-12-26 07:17:04,332][123091] Updated weights for policy 0, policy_version 963550 (0.0009) [2023-12-26 07:17:04,384][123091] Updated weights for policy 0, policy_version 963560 (0.0008) [2023-12-26 07:17:04,518][123090] Updated weights for policy 1, policy_version 956675 (0.0010) [2023-12-26 07:17:04,582][123090] Updated weights for policy 1, policy_version 956685 (0.0011) [2023-12-26 07:17:04,634][123090] Updated weights for policy 1, policy_version 956695 (0.0010) [2023-12-26 07:17:05,099][123091] Updated weights for policy 0, policy_version 963570 (0.0008) [2023-12-26 07:17:05,150][123091] Updated weights for policy 0, policy_version 963580 (0.0005) [2023-12-26 07:17:05,215][123091] Updated weights for policy 0, policy_version 963590 (0.0005) [2023-12-26 07:17:05,274][123091] Updated weights for policy 0, policy_version 963600 (0.0006) [2023-12-26 07:17:05,393][123090] Updated weights for policy 1, policy_version 956705 (0.0010) [2023-12-26 07:17:05,451][123090] Updated weights for policy 1, policy_version 956715 (0.0005) [2023-12-26 07:17:05,511][123090] Updated weights for policy 1, policy_version 956725 (0.0009) [2023-12-26 07:17:05,577][123090] Updated weights for policy 1, policy_version 956735 (0.0007) [2023-12-26 07:17:05,997][123091] Updated weights for policy 0, policy_version 963610 (0.0010) [2023-12-26 07:17:06,062][123091] Updated weights for policy 0, policy_version 963620 (0.0007) [2023-12-26 07:17:06,133][123091] Updated weights for policy 0, policy_version 963630 (0.0007) [2023-12-26 07:17:06,285][123090] Updated weights for policy 1, policy_version 956745 (0.0009) [2023-12-26 07:17:06,359][123090] Updated weights for policy 1, policy_version 956755 (0.0009) [2023-12-26 07:17:06,432][123090] Updated weights for policy 1, policy_version 956765 (0.0009) [2023-12-26 07:17:06,815][123091] Updated weights for policy 0, policy_version 963640 (0.0006) [2023-12-26 07:17:06,889][123091] Updated weights for policy 0, policy_version 963650 (0.0009) [2023-12-26 07:17:06,954][123091] Updated weights for policy 0, policy_version 963660 (0.0009) [2023-12-26 07:17:07,170][123090] Updated weights for policy 1, policy_version 956775 (0.0008) [2023-12-26 07:17:07,233][123090] Updated weights for policy 1, policy_version 956785 (0.0011) [2023-12-26 07:17:07,285][123090] Updated weights for policy 1, policy_version 956795 (0.0007) [2023-12-26 07:17:07,772][123091] Updated weights for policy 0, policy_version 963670 (0.0007) [2023-12-26 07:17:07,845][123091] Updated weights for policy 0, policy_version 963680 (0.0006) [2023-12-26 07:17:07,897][123091] Updated weights for policy 0, policy_version 963690 (0.0006) [2023-12-26 07:17:07,995][123090] Updated weights for policy 1, policy_version 956805 (0.0006) [2023-12-26 07:17:08,059][123090] Updated weights for policy 1, policy_version 956815 (0.0011) [2023-12-26 07:17:08,118][123090] Updated weights for policy 1, policy_version 956825 (0.0010) [2023-12-26 07:17:08,602][123091] Updated weights for policy 0, policy_version 963700 (0.0007) [2023-12-26 07:17:08,663][123091] Updated weights for policy 0, policy_version 963710 (0.0009) [2023-12-26 07:17:08,728][123091] Updated weights for policy 0, policy_version 963720 (0.0009) [2023-12-26 07:17:08,784][121949] Fps is (10 sec: 18027.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 491667456. Throughput: 0: 8846.2, 1: 8889.1. Samples: 491640340. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:08,785][121949] Avg episode reward: [(0, '6077.666'), (1, '5870.196')] [2023-12-26 07:17:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000956832_244948992.pth... [2023-12-26 07:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000963728_246718464.pth... [2023-12-26 07:17:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000955808_244686848.pth [2023-12-26 07:17:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000962704_246456320.pth [2023-12-26 07:17:08,908][123090] Updated weights for policy 1, policy_version 956835 (0.0010) [2023-12-26 07:17:08,964][123090] Updated weights for policy 1, policy_version 956845 (0.0010) [2023-12-26 07:17:09,020][123090] Updated weights for policy 1, policy_version 956855 (0.0011) [2023-12-26 07:17:09,595][123091] Updated weights for policy 0, policy_version 963730 (0.0009) [2023-12-26 07:17:09,659][123091] Updated weights for policy 0, policy_version 963740 (0.0009) [2023-12-26 07:17:09,722][123091] Updated weights for policy 0, policy_version 963750 (0.0009) [2023-12-26 07:17:09,786][123091] Updated weights for policy 0, policy_version 963760 (0.0009) [2023-12-26 07:17:09,848][123090] Updated weights for policy 1, policy_version 956865 (0.0011) [2023-12-26 07:17:09,916][123090] Updated weights for policy 1, policy_version 956875 (0.0010) [2023-12-26 07:17:09,982][123090] Updated weights for policy 1, policy_version 956885 (0.0010) [2023-12-26 07:17:10,047][123090] Updated weights for policy 1, policy_version 956895 (0.0009) [2023-12-26 07:17:10,555][123091] Updated weights for policy 0, policy_version 963770 (0.0010) [2023-12-26 07:17:10,624][123091] Updated weights for policy 0, policy_version 963780 (0.0010) [2023-12-26 07:17:10,695][123091] Updated weights for policy 0, policy_version 963790 (0.0010) [2023-12-26 07:17:10,943][123090] Updated weights for policy 1, policy_version 956905 (0.0010) [2023-12-26 07:17:10,996][123090] Updated weights for policy 1, policy_version 956915 (0.0011) [2023-12-26 07:17:11,066][123090] Updated weights for policy 1, policy_version 956925 (0.0009) [2023-12-26 07:17:11,493][123091] Updated weights for policy 0, policy_version 963800 (0.0010) [2023-12-26 07:17:11,562][123091] Updated weights for policy 0, policy_version 963810 (0.0009) [2023-12-26 07:17:11,645][123091] Updated weights for policy 0, policy_version 963820 (0.0010) [2023-12-26 07:17:11,944][123090] Updated weights for policy 1, policy_version 956935 (0.0009) [2023-12-26 07:17:12,007][123090] Updated weights for policy 1, policy_version 956945 (0.0010) [2023-12-26 07:17:12,079][123090] Updated weights for policy 1, policy_version 956955 (0.0009) [2023-12-26 07:17:12,502][123091] Updated weights for policy 0, policy_version 963830 (0.0010) [2023-12-26 07:17:12,564][123091] Updated weights for policy 0, policy_version 963840 (0.0009) [2023-12-26 07:17:12,633][123091] Updated weights for policy 0, policy_version 963850 (0.0010) [2023-12-26 07:17:12,905][123090] Updated weights for policy 1, policy_version 956965 (0.0008) [2023-12-26 07:17:12,966][123090] Updated weights for policy 1, policy_version 956975 (0.0008) [2023-12-26 07:17:13,031][123090] Updated weights for policy 1, policy_version 956985 (0.0009) [2023-12-26 07:17:13,403][123091] Updated weights for policy 0, policy_version 963860 (0.0007) [2023-12-26 07:17:13,478][123091] Updated weights for policy 0, policy_version 963870 (0.0005) [2023-12-26 07:17:13,539][123091] Updated weights for policy 0, policy_version 963880 (0.0008) [2023-12-26 07:17:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 491749376. Throughput: 0: 8767.9, 1: 8845.4. Samples: 491743344. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:13,784][121949] Avg episode reward: [(0, '5988.127'), (1, '5807.674')] [2023-12-26 07:17:13,846][123090] Updated weights for policy 1, policy_version 956995 (0.0010) [2023-12-26 07:17:13,896][123090] Updated weights for policy 1, policy_version 957005 (0.0009) [2023-12-26 07:17:13,953][123090] Updated weights for policy 1, policy_version 957015 (0.0009) [2023-12-26 07:17:14,362][123091] Updated weights for policy 0, policy_version 963890 (0.0009) [2023-12-26 07:17:14,411][123091] Updated weights for policy 0, policy_version 963900 (0.0009) [2023-12-26 07:17:14,462][123091] Updated weights for policy 0, policy_version 963910 (0.0009) [2023-12-26 07:17:14,509][123091] Updated weights for policy 0, policy_version 963920 (0.0007) [2023-12-26 07:17:14,780][123090] Updated weights for policy 1, policy_version 957025 (0.0008) [2023-12-26 07:17:14,848][123090] Updated weights for policy 1, policy_version 957035 (0.0009) [2023-12-26 07:17:14,909][123090] Updated weights for policy 1, policy_version 957045 (0.0006) [2023-12-26 07:17:14,965][123090] Updated weights for policy 1, policy_version 957055 (0.0009) [2023-12-26 07:17:15,348][123091] Updated weights for policy 0, policy_version 963930 (0.0009) [2023-12-26 07:17:15,411][123091] Updated weights for policy 0, policy_version 963940 (0.0009) [2023-12-26 07:17:15,474][123091] Updated weights for policy 0, policy_version 963951 (0.0010) [2023-12-26 07:17:15,776][123090] Updated weights for policy 1, policy_version 957065 (0.0009) [2023-12-26 07:17:15,834][123090] Updated weights for policy 1, policy_version 957075 (0.0009) [2023-12-26 07:17:15,898][123090] Updated weights for policy 1, policy_version 957085 (0.0009) [2023-12-26 07:17:16,288][123091] Updated weights for policy 0, policy_version 963961 (0.0010) [2023-12-26 07:17:16,334][123091] Updated weights for policy 0, policy_version 963971 (0.0009) [2023-12-26 07:17:16,394][123091] Updated weights for policy 0, policy_version 963981 (0.0009) [2023-12-26 07:17:16,733][123090] Updated weights for policy 1, policy_version 957095 (0.0009) [2023-12-26 07:17:16,793][123090] Updated weights for policy 1, policy_version 957105 (0.0009) [2023-12-26 07:17:16,851][123090] Updated weights for policy 1, policy_version 957115 (0.0009) [2023-12-26 07:17:17,246][123091] Updated weights for policy 0, policy_version 963991 (0.0009) [2023-12-26 07:17:17,308][123091] Updated weights for policy 0, policy_version 964001 (0.0009) [2023-12-26 07:17:17,375][123091] Updated weights for policy 0, policy_version 964011 (0.0009) [2023-12-26 07:17:17,691][123090] Updated weights for policy 1, policy_version 957125 (0.0009) [2023-12-26 07:17:17,747][123090] Updated weights for policy 1, policy_version 957135 (0.0009) [2023-12-26 07:17:17,802][123090] Updated weights for policy 1, policy_version 957145 (0.0008) [2023-12-26 07:17:18,201][123091] Updated weights for policy 0, policy_version 964021 (0.0010) [2023-12-26 07:17:18,272][123091] Updated weights for policy 0, policy_version 964031 (0.0008) [2023-12-26 07:17:18,328][123091] Updated weights for policy 0, policy_version 964041 (0.0009) [2023-12-26 07:17:18,707][123090] Updated weights for policy 1, policy_version 957155 (0.0010) [2023-12-26 07:17:18,759][123090] Updated weights for policy 1, policy_version 957165 (0.0008) [2023-12-26 07:17:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 491831296. Throughput: 0: 8719.3, 1: 8788.2. Samples: 491846532. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:18,785][121949] Avg episode reward: [(0, '6067.724'), (1, '5878.087')] [2023-12-26 07:17:18,823][123090] Updated weights for policy 1, policy_version 957175 (0.0009) [2023-12-26 07:17:19,097][123091] Updated weights for policy 0, policy_version 964051 (0.0007) [2023-12-26 07:17:19,144][123091] Updated weights for policy 0, policy_version 964061 (0.0005) [2023-12-26 07:17:19,199][123091] Updated weights for policy 0, policy_version 964071 (0.0005) [2023-12-26 07:17:19,721][123090] Updated weights for policy 1, policy_version 957185 (0.0009) [2023-12-26 07:17:19,790][123090] Updated weights for policy 1, policy_version 957195 (0.0009) [2023-12-26 07:17:19,855][123090] Updated weights for policy 1, policy_version 957205 (0.0009) [2023-12-26 07:17:19,920][123090] Updated weights for policy 1, policy_version 957215 (0.0009) [2023-12-26 07:17:20,031][123091] Updated weights for policy 0, policy_version 964081 (0.0008) [2023-12-26 07:17:20,092][123091] Updated weights for policy 0, policy_version 964091 (0.0007) [2023-12-26 07:17:20,163][123091] Updated weights for policy 0, policy_version 964101 (0.0009) [2023-12-26 07:17:20,227][123091] Updated weights for policy 0, policy_version 964111 (0.0006) [2023-12-26 07:17:20,718][123090] Updated weights for policy 1, policy_version 957225 (0.0009) [2023-12-26 07:17:20,788][123090] Updated weights for policy 1, policy_version 957235 (0.0010) [2023-12-26 07:17:20,854][123090] Updated weights for policy 1, policy_version 957245 (0.0009) [2023-12-26 07:17:20,921][123091] Updated weights for policy 0, policy_version 964121 (0.0008) [2023-12-26 07:17:20,988][123091] Updated weights for policy 0, policy_version 964131 (0.0008) [2023-12-26 07:17:21,062][123091] Updated weights for policy 0, policy_version 964141 (0.0008) [2023-12-26 07:17:21,731][123090] Updated weights for policy 1, policy_version 957255 (0.0010) [2023-12-26 07:17:21,803][123090] Updated weights for policy 1, policy_version 957265 (0.0010) [2023-12-26 07:17:21,860][123091] Updated weights for policy 0, policy_version 964151 (0.0009) [2023-12-26 07:17:21,869][123090] Updated weights for policy 1, policy_version 957275 (0.0007) [2023-12-26 07:17:21,925][123091] Updated weights for policy 0, policy_version 964161 (0.0008) [2023-12-26 07:17:21,988][123091] Updated weights for policy 0, policy_version 964171 (0.0009) [2023-12-26 07:17:22,620][123090] Updated weights for policy 1, policy_version 957285 (0.0006) [2023-12-26 07:17:22,679][123090] Updated weights for policy 1, policy_version 957295 (0.0008) [2023-12-26 07:17:22,743][123090] Updated weights for policy 1, policy_version 957305 (0.0010) [2023-12-26 07:17:22,885][123091] Updated weights for policy 0, policy_version 964181 (0.0010) [2023-12-26 07:17:22,955][123091] Updated weights for policy 0, policy_version 964191 (0.0009) [2023-12-26 07:17:23,025][123091] Updated weights for policy 0, policy_version 964201 (0.0008) [2023-12-26 07:17:23,545][123090] Updated weights for policy 1, policy_version 957315 (0.0010) [2023-12-26 07:17:23,601][123090] Updated weights for policy 1, policy_version 957325 (0.0010) [2023-12-26 07:17:23,659][123090] Updated weights for policy 1, policy_version 957335 (0.0010) [2023-12-26 07:17:23,710][123091] Updated weights for policy 0, policy_version 964211 (0.0008) [2023-12-26 07:17:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 491921408. Throughput: 0: 8756.1, 1: 8764.0. Samples: 491898344. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:23,785][121949] Avg episode reward: [(0, '6176.065'), (1, '5856.085')] [2023-12-26 07:17:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000957344_245080064.pth... [2023-12-26 07:17:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000956288_244809728.pth [2023-12-26 07:17:23,803][123091] Updated weights for policy 0, policy_version 964221 (0.0010) [2023-12-26 07:17:23,862][123091] Updated weights for policy 0, policy_version 964231 (0.0010) [2023-12-26 07:17:23,911][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000964240_246849536.pth... [2023-12-26 07:17:23,915][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000963216_246587392.pth [2023-12-26 07:17:24,428][123090] Updated weights for policy 1, policy_version 957345 (0.0008) [2023-12-26 07:17:24,484][123090] Updated weights for policy 1, policy_version 957355 (0.0005) [2023-12-26 07:17:24,520][123091] Updated weights for policy 0, policy_version 964241 (0.0010) [2023-12-26 07:17:24,542][123090] Updated weights for policy 1, policy_version 957365 (0.0010) [2023-12-26 07:17:24,589][123091] Updated weights for policy 0, policy_version 964251 (0.0005) [2023-12-26 07:17:24,612][123090] Updated weights for policy 1, policy_version 957375 (0.0007) [2023-12-26 07:17:24,654][123091] Updated weights for policy 0, policy_version 964261 (0.0005) [2023-12-26 07:17:24,733][123091] Updated weights for policy 0, policy_version 964271 (0.0005) [2023-12-26 07:17:25,290][123090] Updated weights for policy 1, policy_version 957385 (0.0005) [2023-12-26 07:17:25,340][123090] Updated weights for policy 1, policy_version 957395 (0.0005) [2023-12-26 07:17:25,371][123091] Updated weights for policy 0, policy_version 964281 (0.0009) [2023-12-26 07:17:25,390][123090] Updated weights for policy 1, policy_version 957405 (0.0005) [2023-12-26 07:17:25,426][123091] Updated weights for policy 0, policy_version 964291 (0.0009) [2023-12-26 07:17:25,488][123091] Updated weights for policy 0, policy_version 964303 (0.0010) [2023-12-26 07:17:26,041][123090] Updated weights for policy 1, policy_version 957415 (0.0007) [2023-12-26 07:17:26,091][123090] Updated weights for policy 1, policy_version 957425 (0.0009) [2023-12-26 07:17:26,147][123090] Updated weights for policy 1, policy_version 957435 (0.0009) [2023-12-26 07:17:26,412][123091] Updated weights for policy 0, policy_version 964313 (0.0010) [2023-12-26 07:17:26,469][123091] Updated weights for policy 0, policy_version 964323 (0.0009) [2023-12-26 07:17:26,529][123091] Updated weights for policy 0, policy_version 964333 (0.0009) [2023-12-26 07:17:26,992][123090] Updated weights for policy 1, policy_version 957445 (0.0007) [2023-12-26 07:17:27,061][123090] Updated weights for policy 1, policy_version 957455 (0.0005) [2023-12-26 07:17:27,130][123090] Updated weights for policy 1, policy_version 957465 (0.0005) [2023-12-26 07:17:27,370][123091] Updated weights for policy 0, policy_version 964343 (0.0010) [2023-12-26 07:17:27,424][123091] Updated weights for policy 0, policy_version 964353 (0.0009) [2023-12-26 07:17:27,472][123091] Updated weights for policy 0, policy_version 964363 (0.0008) [2023-12-26 07:17:27,840][123090] Updated weights for policy 1, policy_version 957475 (0.0007) [2023-12-26 07:17:27,889][123090] Updated weights for policy 1, policy_version 957485 (0.0008) [2023-12-26 07:17:27,940][123090] Updated weights for policy 1, policy_version 957495 (0.0005) [2023-12-26 07:17:28,336][123091] Updated weights for policy 0, policy_version 964373 (0.0009) [2023-12-26 07:17:28,403][123091] Updated weights for policy 0, policy_version 964383 (0.0009) [2023-12-26 07:17:28,479][123091] Updated weights for policy 0, policy_version 964393 (0.0009) [2023-12-26 07:17:28,527][123090] Updated weights for policy 1, policy_version 957505 (0.0005) [2023-12-26 07:17:28,591][123090] Updated weights for policy 1, policy_version 957515 (0.0006) [2023-12-26 07:17:28,640][123090] Updated weights for policy 1, policy_version 957525 (0.0006) [2023-12-26 07:17:28,718][123090] Updated weights for policy 1, policy_version 957535 (0.0006) [2023-12-26 07:17:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 492019712. Throughput: 0: 8817.4, 1: 8893.4. Samples: 492007972. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:28,784][121949] Avg episode reward: [(0, '6149.274'), (1, '5837.256')] [2023-12-26 07:17:29,306][123091] Updated weights for policy 0, policy_version 964403 (0.0009) [2023-12-26 07:17:29,367][123091] Updated weights for policy 0, policy_version 964413 (0.0009) [2023-12-26 07:17:29,434][123091] Updated weights for policy 0, policy_version 964423 (0.0009) [2023-12-26 07:17:29,436][123090] Updated weights for policy 1, policy_version 957545 (0.0010) [2023-12-26 07:17:29,485][123090] Updated weights for policy 1, policy_version 957555 (0.0010) [2023-12-26 07:17:29,540][123090] Updated weights for policy 1, policy_version 957565 (0.0010) [2023-12-26 07:17:30,287][123091] Updated weights for policy 0, policy_version 964433 (0.0008) [2023-12-26 07:17:30,338][123091] Updated weights for policy 0, policy_version 964443 (0.0010) [2023-12-26 07:17:30,374][123090] Updated weights for policy 1, policy_version 957575 (0.0010) [2023-12-26 07:17:30,396][123091] Updated weights for policy 0, policy_version 964453 (0.0006) [2023-12-26 07:17:30,420][123090] Updated weights for policy 1, policy_version 957585 (0.0009) [2023-12-26 07:17:30,454][123091] Updated weights for policy 0, policy_version 964463 (0.0008) [2023-12-26 07:17:30,473][123090] Updated weights for policy 1, policy_version 957595 (0.0010) [2023-12-26 07:17:31,284][123090] Updated weights for policy 1, policy_version 957605 (0.0010) [2023-12-26 07:17:31,324][123091] Updated weights for policy 0, policy_version 964473 (0.0007) [2023-12-26 07:17:31,342][123090] Updated weights for policy 1, policy_version 957615 (0.0010) [2023-12-26 07:17:31,386][123091] Updated weights for policy 0, policy_version 964483 (0.0009) [2023-12-26 07:17:31,405][123090] Updated weights for policy 1, policy_version 957625 (0.0009) [2023-12-26 07:17:31,450][123091] Updated weights for policy 0, policy_version 964493 (0.0009) [2023-12-26 07:17:32,182][123090] Updated weights for policy 1, policy_version 957635 (0.0005) [2023-12-26 07:17:32,237][123090] Updated weights for policy 1, policy_version 957645 (0.0005) [2023-12-26 07:17:32,301][123090] Updated weights for policy 1, policy_version 957655 (0.0006) [2023-12-26 07:17:32,302][123091] Updated weights for policy 0, policy_version 964503 (0.0010) [2023-12-26 07:17:32,366][123091] Updated weights for policy 0, policy_version 964513 (0.0008) [2023-12-26 07:17:32,432][123091] Updated weights for policy 0, policy_version 964523 (0.0010) [2023-12-26 07:17:32,965][123090] Updated weights for policy 1, policy_version 957665 (0.0006) [2023-12-26 07:17:33,016][123090] Updated weights for policy 1, policy_version 957675 (0.0005) [2023-12-26 07:17:33,064][123090] Updated weights for policy 1, policy_version 957685 (0.0005) [2023-12-26 07:17:33,110][123090] Updated weights for policy 1, policy_version 957695 (0.0005) [2023-12-26 07:17:33,366][123091] Updated weights for policy 0, policy_version 964533 (0.0010) [2023-12-26 07:17:33,427][123091] Updated weights for policy 0, policy_version 964543 (0.0010) [2023-12-26 07:17:33,490][123091] Updated weights for policy 0, policy_version 964553 (0.0009) [2023-12-26 07:17:33,755][123090] Updated weights for policy 1, policy_version 957705 (0.0006) [2023-12-26 07:17:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 492101632. Throughput: 0: 8721.0, 1: 9044.6. Samples: 492115348. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:33,784][121949] Avg episode reward: [(0, '6008.853'), (1, '5779.922')] [2023-12-26 07:17:33,807][123090] Updated weights for policy 1, policy_version 957715 (0.0005) [2023-12-26 07:17:33,854][123090] Updated weights for policy 1, policy_version 957725 (0.0006) [2023-12-26 07:17:34,377][123091] Updated weights for policy 0, policy_version 964563 (0.0010) [2023-12-26 07:17:34,449][123091] Updated weights for policy 0, policy_version 964573 (0.0010) [2023-12-26 07:17:34,509][123091] Updated weights for policy 0, policy_version 964583 (0.0010) [2023-12-26 07:17:34,552][123090] Updated weights for policy 1, policy_version 957735 (0.0007) [2023-12-26 07:17:34,603][123090] Updated weights for policy 1, policy_version 957745 (0.0006) [2023-12-26 07:17:34,666][123090] Updated weights for policy 1, policy_version 957755 (0.0005) [2023-12-26 07:17:35,361][123090] Updated weights for policy 1, policy_version 957765 (0.0005) [2023-12-26 07:17:35,392][123091] Updated weights for policy 0, policy_version 964593 (0.0008) [2023-12-26 07:17:35,409][123090] Updated weights for policy 1, policy_version 957775 (0.0006) [2023-12-26 07:17:35,459][123091] Updated weights for policy 0, policy_version 964603 (0.0008) [2023-12-26 07:17:35,460][123090] Updated weights for policy 1, policy_version 957785 (0.0006) [2023-12-26 07:17:35,517][123091] Updated weights for policy 0, policy_version 964613 (0.0009) [2023-12-26 07:17:35,576][123091] Updated weights for policy 0, policy_version 964624 (0.0010) [2023-12-26 07:17:36,202][123090] Updated weights for policy 1, policy_version 957795 (0.0007) [2023-12-26 07:17:36,261][123090] Updated weights for policy 1, policy_version 957805 (0.0008) [2023-12-26 07:17:36,318][123090] Updated weights for policy 1, policy_version 957815 (0.0005) [2023-12-26 07:17:36,480][123091] Updated weights for policy 0, policy_version 964634 (0.0009) [2023-12-26 07:17:36,548][123091] Updated weights for policy 0, policy_version 964644 (0.0009) [2023-12-26 07:17:36,615][123091] Updated weights for policy 0, policy_version 964654 (0.0010) [2023-12-26 07:17:37,099][123090] Updated weights for policy 1, policy_version 957825 (0.0005) [2023-12-26 07:17:37,161][123090] Updated weights for policy 1, policy_version 957835 (0.0005) [2023-12-26 07:17:37,243][123090] Updated weights for policy 1, policy_version 957845 (0.0005) [2023-12-26 07:17:37,316][123090] Updated weights for policy 1, policy_version 957855 (0.0007) [2023-12-26 07:17:37,446][123091] Updated weights for policy 0, policy_version 964664 (0.0008) [2023-12-26 07:17:37,501][123091] Updated weights for policy 0, policy_version 964674 (0.0009) [2023-12-26 07:17:37,557][123091] Updated weights for policy 0, policy_version 964684 (0.0009) [2023-12-26 07:17:37,896][123090] Updated weights for policy 1, policy_version 957865 (0.0010) [2023-12-26 07:17:37,961][123090] Updated weights for policy 1, policy_version 957875 (0.0009) [2023-12-26 07:17:38,009][123090] Updated weights for policy 1, policy_version 957885 (0.0009) [2023-12-26 07:17:38,413][123091] Updated weights for policy 0, policy_version 964694 (0.0007) [2023-12-26 07:17:38,474][123091] Updated weights for policy 0, policy_version 964704 (0.0005) [2023-12-26 07:17:38,540][123091] Updated weights for policy 0, policy_version 964714 (0.0005) [2023-12-26 07:17:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 492191744. Throughput: 0: 8676.8, 1: 9125.4. Samples: 492168816. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:38,785][121949] Avg episode reward: [(0, '6138.653'), (1, '5904.167')] [2023-12-26 07:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000964720_246972416.pth... [2023-12-26 07:17:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000957888_245219328.pth... [2023-12-26 07:17:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000963728_246718464.pth [2023-12-26 07:17:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000956832_244948992.pth [2023-12-26 07:17:38,904][123090] Updated weights for policy 1, policy_version 957895 (0.0010) [2023-12-26 07:17:38,974][123090] Updated weights for policy 1, policy_version 957905 (0.0008) [2023-12-26 07:17:39,039][123090] Updated weights for policy 1, policy_version 957915 (0.0006) [2023-12-26 07:17:39,208][123091] Updated weights for policy 0, policy_version 964724 (0.0007) [2023-12-26 07:17:39,280][123091] Updated weights for policy 0, policy_version 964734 (0.0010) [2023-12-26 07:17:39,343][123091] Updated weights for policy 0, policy_version 964744 (0.0010) [2023-12-26 07:17:39,846][123090] Updated weights for policy 1, policy_version 957925 (0.0009) [2023-12-26 07:17:39,914][123090] Updated weights for policy 1, policy_version 957935 (0.0009) [2023-12-26 07:17:39,985][123090] Updated weights for policy 1, policy_version 957945 (0.0010) [2023-12-26 07:17:40,231][123091] Updated weights for policy 0, policy_version 964754 (0.0010) [2023-12-26 07:17:40,288][123091] Updated weights for policy 0, policy_version 964764 (0.0009) [2023-12-26 07:17:40,357][123091] Updated weights for policy 0, policy_version 964774 (0.0009) [2023-12-26 07:17:40,410][123091] Updated weights for policy 0, policy_version 964784 (0.0010) [2023-12-26 07:17:40,782][123090] Updated weights for policy 1, policy_version 957955 (0.0010) [2023-12-26 07:17:40,834][123090] Updated weights for policy 1, policy_version 957965 (0.0009) [2023-12-26 07:17:40,892][123090] Updated weights for policy 1, policy_version 957975 (0.0010) [2023-12-26 07:17:41,287][123091] Updated weights for policy 0, policy_version 964794 (0.0010) [2023-12-26 07:17:41,360][123091] Updated weights for policy 0, policy_version 964804 (0.0010) [2023-12-26 07:17:41,425][123091] Updated weights for policy 0, policy_version 964814 (0.0009) [2023-12-26 07:17:41,767][123090] Updated weights for policy 1, policy_version 957985 (0.0009) [2023-12-26 07:17:41,831][123090] Updated weights for policy 1, policy_version 957995 (0.0009) [2023-12-26 07:17:41,899][123090] Updated weights for policy 1, policy_version 958005 (0.0009) [2023-12-26 07:17:41,955][123090] Updated weights for policy 1, policy_version 958015 (0.0010) [2023-12-26 07:17:42,300][123091] Updated weights for policy 0, policy_version 964824 (0.0010) [2023-12-26 07:17:42,364][123091] Updated weights for policy 0, policy_version 964834 (0.0009) [2023-12-26 07:17:42,428][123091] Updated weights for policy 0, policy_version 964844 (0.0008) [2023-12-26 07:17:42,809][123090] Updated weights for policy 1, policy_version 958025 (0.0010) [2023-12-26 07:17:42,865][123090] Updated weights for policy 1, policy_version 958035 (0.0009) [2023-12-26 07:17:42,927][123090] Updated weights for policy 1, policy_version 958045 (0.0009) [2023-12-26 07:17:43,280][123091] Updated weights for policy 0, policy_version 964854 (0.0009) [2023-12-26 07:17:43,332][123091] Updated weights for policy 0, policy_version 964864 (0.0010) [2023-12-26 07:17:43,387][123091] Updated weights for policy 0, policy_version 964874 (0.0009) [2023-12-26 07:17:43,768][123090] Updated weights for policy 1, policy_version 958055 (0.0009) [2023-12-26 07:17:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 492273664. Throughput: 0: 8568.9, 1: 8995.4. Samples: 492270340. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:43,784][121949] Avg episode reward: [(0, '6214.783'), (1, '6005.541')] [2023-12-26 07:17:43,820][123090] Updated weights for policy 1, policy_version 958065 (0.0009) [2023-12-26 07:17:43,870][123090] Updated weights for policy 1, policy_version 958075 (0.0009) [2023-12-26 07:17:44,226][123091] Updated weights for policy 0, policy_version 964884 (0.0010) [2023-12-26 07:17:44,284][123091] Updated weights for policy 0, policy_version 964894 (0.0009) [2023-12-26 07:17:44,342][123091] Updated weights for policy 0, policy_version 964905 (0.0010) [2023-12-26 07:17:44,727][123090] Updated weights for policy 1, policy_version 958085 (0.0010) [2023-12-26 07:17:44,801][123090] Updated weights for policy 1, policy_version 958095 (0.0009) [2023-12-26 07:17:44,864][123090] Updated weights for policy 1, policy_version 958105 (0.0009) [2023-12-26 07:17:45,185][123091] Updated weights for policy 0, policy_version 964915 (0.0010) [2023-12-26 07:17:45,240][123091] Updated weights for policy 0, policy_version 964925 (0.0011) [2023-12-26 07:17:45,306][123091] Updated weights for policy 0, policy_version 964935 (0.0009) [2023-12-26 07:17:45,710][123090] Updated weights for policy 1, policy_version 958115 (0.0009) [2023-12-26 07:17:45,776][123090] Updated weights for policy 1, policy_version 958125 (0.0010) [2023-12-26 07:17:45,849][123090] Updated weights for policy 1, policy_version 958135 (0.0009) [2023-12-26 07:17:46,054][123091] Updated weights for policy 0, policy_version 964945 (0.0009) [2023-12-26 07:17:46,114][123091] Updated weights for policy 0, policy_version 964955 (0.0011) [2023-12-26 07:17:46,172][123091] Updated weights for policy 0, policy_version 964965 (0.0010) [2023-12-26 07:17:46,230][123091] Updated weights for policy 0, policy_version 964975 (0.0010) [2023-12-26 07:17:46,718][123090] Updated weights for policy 1, policy_version 958145 (0.0009) [2023-12-26 07:17:46,774][123090] Updated weights for policy 1, policy_version 958155 (0.0008) [2023-12-26 07:17:46,830][123090] Updated weights for policy 1, policy_version 958165 (0.0008) [2023-12-26 07:17:46,903][123090] Updated weights for policy 1, policy_version 958175 (0.0005) [2023-12-26 07:17:47,053][123091] Updated weights for policy 0, policy_version 964985 (0.0010) [2023-12-26 07:17:47,114][123091] Updated weights for policy 0, policy_version 964995 (0.0008) [2023-12-26 07:17:47,179][123091] Updated weights for policy 0, policy_version 965005 (0.0009) [2023-12-26 07:17:47,568][123090] Updated weights for policy 1, policy_version 958185 (0.0009) [2023-12-26 07:17:47,622][123090] Updated weights for policy 1, policy_version 958195 (0.0009) [2023-12-26 07:17:47,676][123090] Updated weights for policy 1, policy_version 958206 (0.0010) [2023-12-26 07:17:47,876][123091] Updated weights for policy 0, policy_version 965015 (0.0010) [2023-12-26 07:17:47,939][123091] Updated weights for policy 0, policy_version 965025 (0.0009) [2023-12-26 07:17:48,009][123091] Updated weights for policy 0, policy_version 965035 (0.0011) [2023-12-26 07:17:48,585][123090] Updated weights for policy 1, policy_version 958216 (0.0009) [2023-12-26 07:17:48,641][123090] Updated weights for policy 1, policy_version 958227 (0.0010) [2023-12-26 07:17:48,696][123090] Updated weights for policy 1, policy_version 958238 (0.0010) [2023-12-26 07:17:48,704][123091] Updated weights for policy 0, policy_version 965045 (0.0008) [2023-12-26 07:17:48,759][123091] Updated weights for policy 0, policy_version 965055 (0.0006) [2023-12-26 07:17:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 492363776. Throughput: 0: 8677.8, 1: 8924.8. Samples: 492375852. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:48,785][121949] Avg episode reward: [(0, '6231.960'), (1, '5916.665')] [2023-12-26 07:17:48,819][123091] Updated weights for policy 0, policy_version 965065 (0.0006) [2023-12-26 07:17:49,574][123091] Updated weights for policy 0, policy_version 965075 (0.0007) [2023-12-26 07:17:49,630][123090] Updated weights for policy 1, policy_version 958248 (0.0008) [2023-12-26 07:17:49,644][123091] Updated weights for policy 0, policy_version 965085 (0.0009) [2023-12-26 07:17:49,686][123090] Updated weights for policy 1, policy_version 958258 (0.0009) [2023-12-26 07:17:49,706][123091] Updated weights for policy 0, policy_version 965095 (0.0009) [2023-12-26 07:17:49,743][123090] Updated weights for policy 1, policy_version 958268 (0.0007) [2023-12-26 07:17:50,454][123091] Updated weights for policy 0, policy_version 965105 (0.0007) [2023-12-26 07:17:50,508][123091] Updated weights for policy 0, policy_version 965115 (0.0010) [2023-12-26 07:17:50,556][123091] Updated weights for policy 0, policy_version 965125 (0.0008) [2023-12-26 07:17:50,579][123090] Updated weights for policy 1, policy_version 958278 (0.0008) [2023-12-26 07:17:50,619][123091] Updated weights for policy 0, policy_version 965135 (0.0010) [2023-12-26 07:17:50,644][123090] Updated weights for policy 1, policy_version 958288 (0.0008) [2023-12-26 07:17:50,712][123090] Updated weights for policy 1, policy_version 958298 (0.0009) [2023-12-26 07:17:51,475][123091] Updated weights for policy 0, policy_version 965145 (0.0010) [2023-12-26 07:17:51,535][123091] Updated weights for policy 0, policy_version 965155 (0.0010) [2023-12-26 07:17:51,550][123090] Updated weights for policy 1, policy_version 958308 (0.0009) [2023-12-26 07:17:51,598][123091] Updated weights for policy 0, policy_version 965165 (0.0009) [2023-12-26 07:17:51,602][123090] Updated weights for policy 1, policy_version 958318 (0.0007) [2023-12-26 07:17:51,676][123090] Updated weights for policy 1, policy_version 958328 (0.0009) [2023-12-26 07:17:52,406][123091] Updated weights for policy 0, policy_version 965175 (0.0009) [2023-12-26 07:17:52,464][123091] Updated weights for policy 0, policy_version 965186 (0.0009) [2023-12-26 07:17:52,514][123091] Updated weights for policy 0, policy_version 965196 (0.0010) [2023-12-26 07:17:52,548][123090] Updated weights for policy 1, policy_version 958338 (0.0009) [2023-12-26 07:17:52,614][123090] Updated weights for policy 1, policy_version 958348 (0.0009) [2023-12-26 07:17:52,683][123090] Updated weights for policy 1, policy_version 958358 (0.0010) [2023-12-26 07:17:52,754][123090] Updated weights for policy 1, policy_version 958368 (0.0010) [2023-12-26 07:17:53,410][123091] Updated weights for policy 0, policy_version 965206 (0.0008) [2023-12-26 07:17:53,434][123090] Updated weights for policy 1, policy_version 958378 (0.0009) [2023-12-26 07:17:53,471][123091] Updated weights for policy 0, policy_version 965216 (0.0007) [2023-12-26 07:17:53,493][123090] Updated weights for policy 1, policy_version 958388 (0.0009) [2023-12-26 07:17:53,533][123091] Updated weights for policy 0, policy_version 965226 (0.0008) [2023-12-26 07:17:53,543][123090] Updated weights for policy 1, policy_version 958398 (0.0010) [2023-12-26 07:17:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 492453888. Throughput: 0: 8619.3, 1: 8864.7. Samples: 492427120. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:53,785][121949] Avg episode reward: [(0, '6102.170'), (1, '5878.308')] [2023-12-26 07:17:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000958400_245350400.pth... [2023-12-26 07:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000965232_247103488.pth... [2023-12-26 07:17:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000957344_245080064.pth [2023-12-26 07:17:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000964240_246849536.pth [2023-12-26 07:17:54,223][123091] Updated weights for policy 0, policy_version 965236 (0.0008) [2023-12-26 07:17:54,290][123091] Updated weights for policy 0, policy_version 965246 (0.0008) [2023-12-26 07:17:54,364][123091] Updated weights for policy 0, policy_version 965256 (0.0009) [2023-12-26 07:17:54,396][123090] Updated weights for policy 1, policy_version 958408 (0.0008) [2023-12-26 07:17:54,448][123090] Updated weights for policy 1, policy_version 958418 (0.0009) [2023-12-26 07:17:54,503][123090] Updated weights for policy 1, policy_version 958429 (0.0010) [2023-12-26 07:17:55,109][123091] Updated weights for policy 0, policy_version 965266 (0.0007) [2023-12-26 07:17:55,160][123091] Updated weights for policy 0, policy_version 965276 (0.0009) [2023-12-26 07:17:55,208][123091] Updated weights for policy 0, policy_version 965286 (0.0008) [2023-12-26 07:17:55,272][123091] Updated weights for policy 0, policy_version 965296 (0.0009) [2023-12-26 07:17:55,370][123090] Updated weights for policy 1, policy_version 958439 (0.0010) [2023-12-26 07:17:55,422][123090] Updated weights for policy 1, policy_version 958449 (0.0010) [2023-12-26 07:17:55,475][123090] Updated weights for policy 1, policy_version 958459 (0.0010) [2023-12-26 07:17:56,029][123091] Updated weights for policy 0, policy_version 965306 (0.0008) [2023-12-26 07:17:56,076][123091] Updated weights for policy 0, policy_version 965316 (0.0009) [2023-12-26 07:17:56,124][123091] Updated weights for policy 0, policy_version 965326 (0.0009) [2023-12-26 07:17:56,328][123090] Updated weights for policy 1, policy_version 958469 (0.0010) [2023-12-26 07:17:56,390][123090] Updated weights for policy 1, policy_version 958479 (0.0010) [2023-12-26 07:17:56,449][123090] Updated weights for policy 1, policy_version 958489 (0.0010) [2023-12-26 07:17:56,978][123091] Updated weights for policy 0, policy_version 965336 (0.0009) [2023-12-26 07:17:57,025][123091] Updated weights for policy 0, policy_version 965346 (0.0009) [2023-12-26 07:17:57,073][123091] Updated weights for policy 0, policy_version 965356 (0.0009) [2023-12-26 07:17:57,214][123090] Updated weights for policy 1, policy_version 958499 (0.0010) [2023-12-26 07:17:57,286][123090] Updated weights for policy 1, policy_version 958509 (0.0009) [2023-12-26 07:17:57,355][123090] Updated weights for policy 1, policy_version 958519 (0.0009) [2023-12-26 07:17:57,838][123091] Updated weights for policy 0, policy_version 965366 (0.0007) [2023-12-26 07:17:57,893][123091] Updated weights for policy 0, policy_version 965376 (0.0005) [2023-12-26 07:17:57,942][123091] Updated weights for policy 0, policy_version 965386 (0.0005) [2023-12-26 07:17:58,198][123090] Updated weights for policy 1, policy_version 958529 (0.0009) [2023-12-26 07:17:58,261][123090] Updated weights for policy 1, policy_version 958539 (0.0010) [2023-12-26 07:17:58,319][123090] Updated weights for policy 1, policy_version 958549 (0.0010) [2023-12-26 07:17:58,394][123090] Updated weights for policy 1, policy_version 958559 (0.0010) [2023-12-26 07:17:58,715][123091] Updated weights for policy 0, policy_version 965396 (0.0007) [2023-12-26 07:17:58,786][121949] Fps is (10 sec: 17200.0, 60 sec: 17476.6, 300 sec: 17633.5). Total num frames: 492535808. Throughput: 0: 8672.4, 1: 8868.7. Samples: 492532728. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:17:58,787][121949] Avg episode reward: [(0, '6159.981'), (1, '5907.375')] [2023-12-26 07:17:58,795][123091] Updated weights for policy 0, policy_version 965406 (0.0009) [2023-12-26 07:17:58,878][123091] Updated weights for policy 0, policy_version 965416 (0.0016) [2023-12-26 07:17:59,215][123090] Updated weights for policy 1, policy_version 958569 (0.0009) [2023-12-26 07:17:59,290][123090] Updated weights for policy 1, policy_version 958579 (0.0009) [2023-12-26 07:17:59,365][123090] Updated weights for policy 1, policy_version 958589 (0.0010) [2023-12-26 07:17:59,688][123091] Updated weights for policy 0, policy_version 965426 (0.0010) [2023-12-26 07:17:59,770][123091] Updated weights for policy 0, policy_version 965436 (0.0009) [2023-12-26 07:17:59,839][123091] Updated weights for policy 0, policy_version 965446 (0.0009) [2023-12-26 07:17:59,904][123091] Updated weights for policy 0, policy_version 965456 (0.0009) [2023-12-26 07:18:00,124][123090] Updated weights for policy 1, policy_version 958599 (0.0007) [2023-12-26 07:18:00,193][123090] Updated weights for policy 1, policy_version 958609 (0.0005) [2023-12-26 07:18:00,244][123090] Updated weights for policy 1, policy_version 958619 (0.0005) [2023-12-26 07:18:00,612][123091] Updated weights for policy 0, policy_version 965466 (0.0005) [2023-12-26 07:18:00,681][123091] Updated weights for policy 0, policy_version 965476 (0.0006) [2023-12-26 07:18:00,748][123091] Updated weights for policy 0, policy_version 965486 (0.0005) [2023-12-26 07:18:00,901][123090] Updated weights for policy 1, policy_version 958629 (0.0005) [2023-12-26 07:18:00,947][123090] Updated weights for policy 1, policy_version 958639 (0.0005) [2023-12-26 07:18:00,995][123090] Updated weights for policy 1, policy_version 958649 (0.0005) [2023-12-26 07:18:01,433][123091] Updated weights for policy 0, policy_version 965496 (0.0006) [2023-12-26 07:18:01,491][123091] Updated weights for policy 0, policy_version 965506 (0.0005) [2023-12-26 07:18:01,549][123091] Updated weights for policy 0, policy_version 965516 (0.0005) [2023-12-26 07:18:01,857][123090] Updated weights for policy 1, policy_version 958659 (0.0007) [2023-12-26 07:18:01,906][123090] Updated weights for policy 1, policy_version 958669 (0.0010) [2023-12-26 07:18:01,963][123090] Updated weights for policy 1, policy_version 958679 (0.0009) [2023-12-26 07:18:02,308][123091] Updated weights for policy 0, policy_version 965526 (0.0008) [2023-12-26 07:18:02,371][123091] Updated weights for policy 0, policy_version 965536 (0.0010) [2023-12-26 07:18:02,433][123091] Updated weights for policy 0, policy_version 965546 (0.0009) [2023-12-26 07:18:02,682][123090] Updated weights for policy 1, policy_version 958689 (0.0010) [2023-12-26 07:18:02,737][123090] Updated weights for policy 1, policy_version 958699 (0.0005) [2023-12-26 07:18:02,799][123090] Updated weights for policy 1, policy_version 958709 (0.0009) [2023-12-26 07:18:02,862][123090] Updated weights for policy 1, policy_version 958719 (0.0010) [2023-12-26 07:18:03,322][123091] Updated weights for policy 0, policy_version 965556 (0.0010) [2023-12-26 07:18:03,374][123091] Updated weights for policy 0, policy_version 965566 (0.0006) [2023-12-26 07:18:03,425][123091] Updated weights for policy 0, policy_version 965576 (0.0005) [2023-12-26 07:18:03,543][123090] Updated weights for policy 1, policy_version 958729 (0.0006) [2023-12-26 07:18:03,599][123090] Updated weights for policy 1, policy_version 958739 (0.0006) [2023-12-26 07:18:03,663][123090] Updated weights for policy 1, policy_version 958749 (0.0006) [2023-12-26 07:18:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 492634112. Throughput: 0: 8730.3, 1: 8951.1. Samples: 492642196. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:03,784][121949] Avg episode reward: [(0, '6245.257'), (1, '5967.340')] [2023-12-26 07:18:04,037][123091] Updated weights for policy 0, policy_version 965586 (0.0005) [2023-12-26 07:18:04,102][123091] Updated weights for policy 0, policy_version 965596 (0.0006) [2023-12-26 07:18:04,174][123091] Updated weights for policy 0, policy_version 965606 (0.0006) [2023-12-26 07:18:04,247][123091] Updated weights for policy 0, policy_version 965616 (0.0006) [2023-12-26 07:18:04,454][123090] Updated weights for policy 1, policy_version 958759 (0.0005) [2023-12-26 07:18:04,519][123090] Updated weights for policy 1, policy_version 958770 (0.0008) [2023-12-26 07:18:04,575][123090] Updated weights for policy 1, policy_version 958780 (0.0010) [2023-12-26 07:18:04,914][123091] Updated weights for policy 0, policy_version 965626 (0.0010) [2023-12-26 07:18:04,976][123091] Updated weights for policy 0, policy_version 965636 (0.0010) [2023-12-26 07:18:05,040][123091] Updated weights for policy 0, policy_version 965646 (0.0010) [2023-12-26 07:18:05,371][123090] Updated weights for policy 1, policy_version 958790 (0.0008) [2023-12-26 07:18:05,420][123090] Updated weights for policy 1, policy_version 958800 (0.0006) [2023-12-26 07:18:05,472][123090] Updated weights for policy 1, policy_version 958810 (0.0005) [2023-12-26 07:18:05,710][123091] Updated weights for policy 0, policy_version 965656 (0.0005) [2023-12-26 07:18:05,755][123091] Updated weights for policy 0, policy_version 965666 (0.0008) [2023-12-26 07:18:05,807][123091] Updated weights for policy 0, policy_version 965676 (0.0010) [2023-12-26 07:18:06,141][123090] Updated weights for policy 1, policy_version 958820 (0.0006) [2023-12-26 07:18:06,206][123090] Updated weights for policy 1, policy_version 958830 (0.0009) [2023-12-26 07:18:06,263][123090] Updated weights for policy 1, policy_version 958840 (0.0009) [2023-12-26 07:18:06,651][123091] Updated weights for policy 0, policy_version 965686 (0.0011) [2023-12-26 07:18:06,711][123091] Updated weights for policy 0, policy_version 965696 (0.0010) [2023-12-26 07:18:06,774][123091] Updated weights for policy 0, policy_version 965706 (0.0010) [2023-12-26 07:18:07,065][123090] Updated weights for policy 1, policy_version 958850 (0.0009) [2023-12-26 07:18:07,128][123090] Updated weights for policy 1, policy_version 958860 (0.0010) [2023-12-26 07:18:07,186][123090] Updated weights for policy 1, policy_version 958870 (0.0009) [2023-12-26 07:18:07,242][123090] Updated weights for policy 1, policy_version 958880 (0.0010) [2023-12-26 07:18:07,552][123091] Updated weights for policy 0, policy_version 965716 (0.0008) [2023-12-26 07:18:07,607][123091] Updated weights for policy 0, policy_version 965726 (0.0005) [2023-12-26 07:18:07,660][123091] Updated weights for policy 0, policy_version 965736 (0.0005) [2023-12-26 07:18:08,078][123090] Updated weights for policy 1, policy_version 958890 (0.0009) [2023-12-26 07:18:08,149][123090] Updated weights for policy 1, policy_version 958900 (0.0008) [2023-12-26 07:18:08,209][123090] Updated weights for policy 1, policy_version 958910 (0.0009) [2023-12-26 07:18:08,457][123091] Updated weights for policy 0, policy_version 965746 (0.0006) [2023-12-26 07:18:08,520][123091] Updated weights for policy 0, policy_version 965756 (0.0005) [2023-12-26 07:18:08,598][123091] Updated weights for policy 0, policy_version 965766 (0.0007) [2023-12-26 07:18:08,666][123091] Updated weights for policy 0, policy_version 965776 (0.0010) [2023-12-26 07:18:08,784][121949] Fps is (10 sec: 18844.5, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 492724224. Throughput: 0: 8769.1, 1: 9022.9. Samples: 492698988. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:08,786][121949] Avg episode reward: [(0, '6117.379'), (1, '5764.628')] [2023-12-26 07:18:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000965776_247242752.pth... [2023-12-26 07:18:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000958912_245481472.pth... [2023-12-26 07:18:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000964720_246972416.pth [2023-12-26 07:18:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000957888_245219328.pth [2023-12-26 07:18:09,032][123090] Updated weights for policy 1, policy_version 958920 (0.0009) [2023-12-26 07:18:09,097][123090] Updated weights for policy 1, policy_version 958930 (0.0009) [2023-12-26 07:18:09,146][123090] Updated weights for policy 1, policy_version 958940 (0.0009) [2023-12-26 07:18:09,470][123091] Updated weights for policy 0, policy_version 965786 (0.0010) [2023-12-26 07:18:09,537][123091] Updated weights for policy 0, policy_version 965796 (0.0010) [2023-12-26 07:18:09,606][123091] Updated weights for policy 0, policy_version 965806 (0.0010) [2023-12-26 07:18:10,033][123090] Updated weights for policy 1, policy_version 958950 (0.0010) [2023-12-26 07:18:10,093][123090] Updated weights for policy 1, policy_version 958960 (0.0009) [2023-12-26 07:18:10,162][123090] Updated weights for policy 1, policy_version 958970 (0.0009) [2023-12-26 07:18:10,420][123091] Updated weights for policy 0, policy_version 965816 (0.0009) [2023-12-26 07:18:10,476][123091] Updated weights for policy 0, policy_version 965826 (0.0009) [2023-12-26 07:18:10,547][123091] Updated weights for policy 0, policy_version 965836 (0.0009) [2023-12-26 07:18:11,002][123090] Updated weights for policy 1, policy_version 958980 (0.0010) [2023-12-26 07:18:11,073][123090] Updated weights for policy 1, policy_version 958990 (0.0010) [2023-12-26 07:18:11,145][123090] Updated weights for policy 1, policy_version 959000 (0.0010) [2023-12-26 07:18:11,454][123091] Updated weights for policy 0, policy_version 965846 (0.0009) [2023-12-26 07:18:11,520][123091] Updated weights for policy 0, policy_version 965856 (0.0009) [2023-12-26 07:18:11,581][123091] Updated weights for policy 0, policy_version 965866 (0.0008) [2023-12-26 07:18:12,030][123090] Updated weights for policy 1, policy_version 959010 (0.0011) [2023-12-26 07:18:12,095][123090] Updated weights for policy 1, policy_version 959020 (0.0009) [2023-12-26 07:18:12,164][123090] Updated weights for policy 1, policy_version 959030 (0.0009) [2023-12-26 07:18:12,229][123090] Updated weights for policy 1, policy_version 959040 (0.0009) [2023-12-26 07:18:12,441][123091] Updated weights for policy 0, policy_version 965876 (0.0009) [2023-12-26 07:18:12,502][123091] Updated weights for policy 0, policy_version 965886 (0.0010) [2023-12-26 07:18:12,556][123091] Updated weights for policy 0, policy_version 965896 (0.0010) [2023-12-26 07:18:13,087][123090] Updated weights for policy 1, policy_version 959050 (0.0009) [2023-12-26 07:18:13,148][123090] Updated weights for policy 1, policy_version 959060 (0.0009) [2023-12-26 07:18:13,208][123090] Updated weights for policy 1, policy_version 959070 (0.0009) [2023-12-26 07:18:13,255][123091] Updated weights for policy 0, policy_version 965906 (0.0007) [2023-12-26 07:18:13,308][123091] Updated weights for policy 0, policy_version 965916 (0.0010) [2023-12-26 07:18:13,364][123091] Updated weights for policy 0, policy_version 965926 (0.0009) [2023-12-26 07:18:13,421][123091] Updated weights for policy 0, policy_version 965936 (0.0009) [2023-12-26 07:18:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 492806144. Throughput: 0: 8726.6, 1: 8880.2. Samples: 492800276. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:13,785][121949] Avg episode reward: [(0, '5882.991'), (1, '5752.526')] [2023-12-26 07:18:13,998][123090] Updated weights for policy 1, policy_version 959080 (0.0007) [2023-12-26 07:18:14,066][123090] Updated weights for policy 1, policy_version 959090 (0.0009) [2023-12-26 07:18:14,133][123090] Updated weights for policy 1, policy_version 959100 (0.0009) [2023-12-26 07:18:14,305][123091] Updated weights for policy 0, policy_version 965946 (0.0007) [2023-12-26 07:18:14,361][123091] Updated weights for policy 0, policy_version 965956 (0.0008) [2023-12-26 07:18:14,414][123091] Updated weights for policy 0, policy_version 965966 (0.0009) [2023-12-26 07:18:14,938][123090] Updated weights for policy 1, policy_version 959110 (0.0010) [2023-12-26 07:18:15,015][123090] Updated weights for policy 1, policy_version 959120 (0.0010) [2023-12-26 07:18:15,066][123090] Updated weights for policy 1, policy_version 959130 (0.0010) [2023-12-26 07:18:15,189][123091] Updated weights for policy 0, policy_version 965976 (0.0010) [2023-12-26 07:18:15,249][123091] Updated weights for policy 0, policy_version 965986 (0.0009) [2023-12-26 07:18:15,320][123091] Updated weights for policy 0, policy_version 965996 (0.0010) [2023-12-26 07:18:15,888][123090] Updated weights for policy 1, policy_version 959140 (0.0009) [2023-12-26 07:18:15,952][123090] Updated weights for policy 1, policy_version 959150 (0.0008) [2023-12-26 07:18:16,010][123090] Updated weights for policy 1, policy_version 959160 (0.0007) [2023-12-26 07:18:16,129][123091] Updated weights for policy 0, policy_version 966006 (0.0007) [2023-12-26 07:18:16,186][123091] Updated weights for policy 0, policy_version 966016 (0.0005) [2023-12-26 07:18:16,233][123091] Updated weights for policy 0, policy_version 966026 (0.0005) [2023-12-26 07:18:16,859][123090] Updated weights for policy 1, policy_version 959170 (0.0009) [2023-12-26 07:18:16,911][123090] Updated weights for policy 1, policy_version 959180 (0.0010) [2023-12-26 07:18:16,965][123090] Updated weights for policy 1, policy_version 959190 (0.0010) [2023-12-26 07:18:17,009][123090] Updated weights for policy 1, policy_version 959200 (0.0010) [2023-12-26 07:18:17,012][123091] Updated weights for policy 0, policy_version 966036 (0.0005) [2023-12-26 07:18:17,070][123091] Updated weights for policy 0, policy_version 966046 (0.0008) [2023-12-26 07:18:17,129][123091] Updated weights for policy 0, policy_version 966056 (0.0009) [2023-12-26 07:18:17,861][123090] Updated weights for policy 1, policy_version 959210 (0.0010) [2023-12-26 07:18:17,907][123090] Updated weights for policy 1, policy_version 959220 (0.0010) [2023-12-26 07:18:17,951][123091] Updated weights for policy 0, policy_version 966066 (0.0008) [2023-12-26 07:18:17,962][123090] Updated weights for policy 1, policy_version 959230 (0.0009) [2023-12-26 07:18:18,002][123091] Updated weights for policy 0, policy_version 966076 (0.0009) [2023-12-26 07:18:18,061][123091] Updated weights for policy 0, policy_version 966086 (0.0009) [2023-12-26 07:18:18,121][123091] Updated weights for policy 0, policy_version 966096 (0.0010) [2023-12-26 07:18:18,754][123090] Updated weights for policy 1, policy_version 959240 (0.0006) [2023-12-26 07:18:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 492888064. Throughput: 0: 8813.7, 1: 8723.8. Samples: 492904536. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:18,785][121949] Avg episode reward: [(0, '5865.902'), (1, '5833.700')] [2023-12-26 07:18:18,805][123090] Updated weights for policy 1, policy_version 959250 (0.0005) [2023-12-26 07:18:18,854][123090] Updated weights for policy 1, policy_version 959260 (0.0005) [2023-12-26 07:18:19,004][123091] Updated weights for policy 0, policy_version 966106 (0.0009) [2023-12-26 07:18:19,052][123091] Updated weights for policy 0, policy_version 966116 (0.0009) [2023-12-26 07:18:19,101][123091] Updated weights for policy 0, policy_version 966126 (0.0008) [2023-12-26 07:18:19,708][123090] Updated weights for policy 1, policy_version 959270 (0.0010) [2023-12-26 07:18:19,780][123090] Updated weights for policy 1, policy_version 959280 (0.0011) [2023-12-26 07:18:19,854][123090] Updated weights for policy 1, policy_version 959290 (0.0011) [2023-12-26 07:18:20,025][123091] Updated weights for policy 0, policy_version 966136 (0.0010) [2023-12-26 07:18:20,091][123091] Updated weights for policy 0, policy_version 966146 (0.0009) [2023-12-26 07:18:20,153][123091] Updated weights for policy 0, policy_version 966156 (0.0009) [2023-12-26 07:18:20,664][123090] Updated weights for policy 1, policy_version 959300 (0.0011) [2023-12-26 07:18:20,722][123090] Updated weights for policy 1, policy_version 959310 (0.0008) [2023-12-26 07:18:20,789][123090] Updated weights for policy 1, policy_version 959320 (0.0008) [2023-12-26 07:18:20,947][123091] Updated weights for policy 0, policy_version 966166 (0.0007) [2023-12-26 07:18:21,021][123091] Updated weights for policy 0, policy_version 966176 (0.0006) [2023-12-26 07:18:21,090][123091] Updated weights for policy 0, policy_version 966186 (0.0007) [2023-12-26 07:18:21,582][123090] Updated weights for policy 1, policy_version 959330 (0.0009) [2023-12-26 07:18:21,655][123090] Updated weights for policy 1, policy_version 959340 (0.0007) [2023-12-26 07:18:21,727][123090] Updated weights for policy 1, policy_version 959350 (0.0008) [2023-12-26 07:18:21,794][123090] Updated weights for policy 1, policy_version 959360 (0.0009) [2023-12-26 07:18:21,869][123091] Updated weights for policy 0, policy_version 966196 (0.0008) [2023-12-26 07:18:21,941][123091] Updated weights for policy 0, policy_version 966206 (0.0010) [2023-12-26 07:18:22,008][123091] Updated weights for policy 0, policy_version 966216 (0.0010) [2023-12-26 07:18:22,664][123090] Updated weights for policy 1, policy_version 959370 (0.0009) [2023-12-26 07:18:22,734][123090] Updated weights for policy 1, policy_version 959380 (0.0008) [2023-12-26 07:18:22,793][123091] Updated weights for policy 0, policy_version 966226 (0.0009) [2023-12-26 07:18:22,804][123090] Updated weights for policy 1, policy_version 959390 (0.0007) [2023-12-26 07:18:22,856][123091] Updated weights for policy 0, policy_version 966236 (0.0007) [2023-12-26 07:18:22,920][123091] Updated weights for policy 0, policy_version 966246 (0.0005) [2023-12-26 07:18:22,989][123091] Updated weights for policy 0, policy_version 966256 (0.0007) [2023-12-26 07:18:23,589][123090] Updated weights for policy 1, policy_version 959400 (0.0008) [2023-12-26 07:18:23,653][123090] Updated weights for policy 1, policy_version 959410 (0.0009) [2023-12-26 07:18:23,715][123090] Updated weights for policy 1, policy_version 959420 (0.0009) [2023-12-26 07:18:23,731][123091] Updated weights for policy 0, policy_version 966266 (0.0007) [2023-12-26 07:18:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 492978176. Throughput: 0: 8846.5, 1: 8647.0. Samples: 492956024. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:23,785][121949] Avg episode reward: [(0, '5900.170'), (1, '5753.571')] [2023-12-26 07:18:23,793][123091] Updated weights for policy 0, policy_version 966276 (0.0008) [2023-12-26 07:18:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000959424_245612544.pth... [2023-12-26 07:18:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000958400_245350400.pth [2023-12-26 07:18:23,850][123091] Updated weights for policy 0, policy_version 966286 (0.0009) [2023-12-26 07:18:23,861][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000966288_247373824.pth... [2023-12-26 07:18:23,866][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000965232_247103488.pth [2023-12-26 07:18:24,510][123090] Updated weights for policy 1, policy_version 959430 (0.0009) [2023-12-26 07:18:24,573][123090] Updated weights for policy 1, policy_version 959440 (0.0010) [2023-12-26 07:18:24,636][123090] Updated weights for policy 1, policy_version 959450 (0.0010) [2023-12-26 07:18:24,688][123091] Updated weights for policy 0, policy_version 966296 (0.0010) [2023-12-26 07:18:24,748][123091] Updated weights for policy 0, policy_version 966306 (0.0009) [2023-12-26 07:18:24,804][123091] Updated weights for policy 0, policy_version 966316 (0.0009) [2023-12-26 07:18:25,229][123090] Updated weights for policy 1, policy_version 959460 (0.0006) [2023-12-26 07:18:25,298][123090] Updated weights for policy 1, policy_version 959470 (0.0006) [2023-12-26 07:18:25,352][123090] Updated weights for policy 1, policy_version 959480 (0.0007) [2023-12-26 07:18:25,695][123091] Updated weights for policy 0, policy_version 966326 (0.0008) [2023-12-26 07:18:25,754][123091] Updated weights for policy 0, policy_version 966336 (0.0008) [2023-12-26 07:18:25,810][123091] Updated weights for policy 0, policy_version 966346 (0.0009) [2023-12-26 07:18:26,074][123090] Updated weights for policy 1, policy_version 959490 (0.0009) [2023-12-26 07:18:26,131][123090] Updated weights for policy 1, policy_version 959500 (0.0005) [2023-12-26 07:18:26,179][123090] Updated weights for policy 1, policy_version 959510 (0.0005) [2023-12-26 07:18:26,228][123090] Updated weights for policy 1, policy_version 959520 (0.0008) [2023-12-26 07:18:26,590][123091] Updated weights for policy 0, policy_version 966356 (0.0008) [2023-12-26 07:18:26,651][123091] Updated weights for policy 0, policy_version 966366 (0.0005) [2023-12-26 07:18:26,710][123091] Updated weights for policy 0, policy_version 966376 (0.0005) [2023-12-26 07:18:27,022][123090] Updated weights for policy 1, policy_version 959530 (0.0010) [2023-12-26 07:18:27,090][123090] Updated weights for policy 1, policy_version 959540 (0.0011) [2023-12-26 07:18:27,154][123090] Updated weights for policy 1, policy_version 959550 (0.0010) [2023-12-26 07:18:27,419][123091] Updated weights for policy 0, policy_version 966386 (0.0005) [2023-12-26 07:18:27,471][123091] Updated weights for policy 0, policy_version 966396 (0.0005) [2023-12-26 07:18:27,521][123091] Updated weights for policy 0, policy_version 966406 (0.0005) [2023-12-26 07:18:27,578][123091] Updated weights for policy 0, policy_version 966416 (0.0005) [2023-12-26 07:18:27,979][123090] Updated weights for policy 1, policy_version 959560 (0.0011) [2023-12-26 07:18:28,033][123090] Updated weights for policy 1, policy_version 959570 (0.0010) [2023-12-26 07:18:28,086][123090] Updated weights for policy 1, policy_version 959580 (0.0010) [2023-12-26 07:18:28,239][123091] Updated weights for policy 0, policy_version 966426 (0.0005) [2023-12-26 07:18:28,285][123091] Updated weights for policy 0, policy_version 966436 (0.0005) [2023-12-26 07:18:28,338][123091] Updated weights for policy 0, policy_version 966446 (0.0006) [2023-12-26 07:18:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 493068288. Throughput: 0: 8907.7, 1: 8700.8. Samples: 493062724. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:28,785][121949] Avg episode reward: [(0, '5976.431'), (1, '5705.473')] [2023-12-26 07:18:28,908][123090] Updated weights for policy 1, policy_version 959590 (0.0010) [2023-12-26 07:18:28,959][123090] Updated weights for policy 1, policy_version 959600 (0.0010) [2023-12-26 07:18:29,022][123090] Updated weights for policy 1, policy_version 959610 (0.0011) [2023-12-26 07:18:29,118][123091] Updated weights for policy 0, policy_version 966456 (0.0007) [2023-12-26 07:18:29,170][123091] Updated weights for policy 0, policy_version 966466 (0.0008) [2023-12-26 07:18:29,228][123091] Updated weights for policy 0, policy_version 966476 (0.0008) [2023-12-26 07:18:29,763][123090] Updated weights for policy 1, policy_version 959620 (0.0010) [2023-12-26 07:18:29,830][123090] Updated weights for policy 1, policy_version 959630 (0.0011) [2023-12-26 07:18:29,897][123090] Updated weights for policy 1, policy_version 959640 (0.0011) [2023-12-26 07:18:30,064][123091] Updated weights for policy 0, policy_version 966486 (0.0009) [2023-12-26 07:18:30,125][123091] Updated weights for policy 0, policy_version 966496 (0.0005) [2023-12-26 07:18:30,174][123091] Updated weights for policy 0, policy_version 966506 (0.0009) [2023-12-26 07:18:30,721][123090] Updated weights for policy 1, policy_version 959650 (0.0010) [2023-12-26 07:18:30,780][123090] Updated weights for policy 1, policy_version 959660 (0.0010) [2023-12-26 07:18:30,835][123090] Updated weights for policy 1, policy_version 959670 (0.0010) [2023-12-26 07:18:30,890][123090] Updated weights for policy 1, policy_version 959680 (0.0010) [2023-12-26 07:18:30,946][123091] Updated weights for policy 0, policy_version 966516 (0.0007) [2023-12-26 07:18:31,010][123091] Updated weights for policy 0, policy_version 966526 (0.0005) [2023-12-26 07:18:31,073][123091] Updated weights for policy 0, policy_version 966536 (0.0008) [2023-12-26 07:18:31,665][123090] Updated weights for policy 1, policy_version 959690 (0.0007) [2023-12-26 07:18:31,736][123090] Updated weights for policy 1, policy_version 959700 (0.0008) [2023-12-26 07:18:31,797][123090] Updated weights for policy 1, policy_version 959710 (0.0009) [2023-12-26 07:18:31,882][123091] Updated weights for policy 0, policy_version 966546 (0.0010) [2023-12-26 07:18:31,952][123091] Updated weights for policy 0, policy_version 966556 (0.0006) [2023-12-26 07:18:32,017][123091] Updated weights for policy 0, policy_version 966566 (0.0006) [2023-12-26 07:18:32,079][123091] Updated weights for policy 0, policy_version 966576 (0.0006) [2023-12-26 07:18:32,494][123090] Updated weights for policy 1, policy_version 959720 (0.0010) [2023-12-26 07:18:32,560][123090] Updated weights for policy 1, policy_version 959730 (0.0010) [2023-12-26 07:18:32,610][123090] Updated weights for policy 1, policy_version 959740 (0.0009) [2023-12-26 07:18:32,804][123091] Updated weights for policy 0, policy_version 966586 (0.0010) [2023-12-26 07:18:32,870][123091] Updated weights for policy 0, policy_version 966596 (0.0010) [2023-12-26 07:18:32,932][123091] Updated weights for policy 0, policy_version 966606 (0.0010) [2023-12-26 07:18:33,433][123090] Updated weights for policy 1, policy_version 959750 (0.0006) [2023-12-26 07:18:33,511][123090] Updated weights for policy 1, policy_version 959760 (0.0005) [2023-12-26 07:18:33,573][123090] Updated weights for policy 1, policy_version 959770 (0.0005) [2023-12-26 07:18:33,746][123091] Updated weights for policy 0, policy_version 966616 (0.0009) [2023-12-26 07:18:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 493158400. Throughput: 0: 8908.7, 1: 8758.5. Samples: 493170876. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 07:18:33,785][121949] Avg episode reward: [(0, '5972.067'), (1, '5565.141')] [2023-12-26 07:18:33,799][123091] Updated weights for policy 0, policy_version 966626 (0.0008) [2023-12-26 07:18:33,858][123091] Updated weights for policy 0, policy_version 966636 (0.0011) [2023-12-26 07:18:34,291][123090] Updated weights for policy 1, policy_version 959780 (0.0009) [2023-12-26 07:18:34,346][123090] Updated weights for policy 1, policy_version 959790 (0.0010) [2023-12-26 07:18:34,408][123090] Updated weights for policy 1, policy_version 959800 (0.0009) [2023-12-26 07:18:34,639][123091] Updated weights for policy 0, policy_version 966646 (0.0010) [2023-12-26 07:18:34,699][123091] Updated weights for policy 0, policy_version 966656 (0.0009) [2023-12-26 07:18:34,752][123091] Updated weights for policy 0, policy_version 966666 (0.0010) [2023-12-26 07:18:35,268][123090] Updated weights for policy 1, policy_version 959810 (0.0010) [2023-12-26 07:18:35,328][123090] Updated weights for policy 1, policy_version 959820 (0.0010) [2023-12-26 07:18:35,394][123090] Updated weights for policy 1, policy_version 959830 (0.0009) [2023-12-26 07:18:35,451][123090] Updated weights for policy 1, policy_version 959840 (0.0009) [2023-12-26 07:18:35,572][123091] Updated weights for policy 0, policy_version 966676 (0.0010) [2023-12-26 07:18:35,633][123091] Updated weights for policy 0, policy_version 966686 (0.0010) [2023-12-26 07:18:35,687][123091] Updated weights for policy 0, policy_version 966696 (0.0009) [2023-12-26 07:18:36,295][123090] Updated weights for policy 1, policy_version 959850 (0.0010) [2023-12-26 07:18:36,360][123090] Updated weights for policy 1, policy_version 959860 (0.0009) [2023-12-26 07:18:36,420][123090] Updated weights for policy 1, policy_version 959870 (0.0010) [2023-12-26 07:18:36,517][123091] Updated weights for policy 0, policy_version 966706 (0.0007) [2023-12-26 07:18:36,581][123091] Updated weights for policy 0, policy_version 966716 (0.0010) [2023-12-26 07:18:36,648][123091] Updated weights for policy 0, policy_version 966726 (0.0009) [2023-12-26 07:18:36,713][123091] Updated weights for policy 0, policy_version 966736 (0.0009) [2023-12-26 07:18:37,255][123090] Updated weights for policy 1, policy_version 959880 (0.0006) [2023-12-26 07:18:37,325][123090] Updated weights for policy 1, policy_version 959890 (0.0007) [2023-12-26 07:18:37,386][123090] Updated weights for policy 1, policy_version 959900 (0.0010) [2023-12-26 07:18:37,568][123091] Updated weights for policy 0, policy_version 966746 (0.0010) [2023-12-26 07:18:37,623][123091] Updated weights for policy 0, policy_version 966756 (0.0009) [2023-12-26 07:18:37,689][123091] Updated weights for policy 0, policy_version 966766 (0.0008) [2023-12-26 07:18:38,164][123090] Updated weights for policy 1, policy_version 959910 (0.0009) [2023-12-26 07:18:38,216][123090] Updated weights for policy 1, policy_version 959920 (0.0009) [2023-12-26 07:18:38,276][123090] Updated weights for policy 1, policy_version 959930 (0.0009) [2023-12-26 07:18:38,564][123091] Updated weights for policy 0, policy_version 966776 (0.0009) [2023-12-26 07:18:38,620][123091] Updated weights for policy 0, policy_version 966786 (0.0009) [2023-12-26 07:18:38,680][123091] Updated weights for policy 0, policy_version 966796 (0.0010) [2023-12-26 07:18:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 493248512. Throughput: 0: 8902.7, 1: 8768.7. Samples: 493222332. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:18:38,785][121949] Avg episode reward: [(0, '6023.740'), (1, '5556.643')] [2023-12-26 07:18:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000966800_247504896.pth... [2023-12-26 07:18:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000959936_245743616.pth... [2023-12-26 07:18:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000965776_247242752.pth [2023-12-26 07:18:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000958912_245481472.pth [2023-12-26 07:18:39,124][123090] Updated weights for policy 1, policy_version 959940 (0.0008) [2023-12-26 07:18:39,177][123090] Updated weights for policy 1, policy_version 959950 (0.0010) [2023-12-26 07:18:39,239][123090] Updated weights for policy 1, policy_version 959960 (0.0009) [2023-12-26 07:18:39,548][123091] Updated weights for policy 0, policy_version 966806 (0.0009) [2023-12-26 07:18:39,604][123091] Updated weights for policy 0, policy_version 966816 (0.0009) [2023-12-26 07:18:39,678][123091] Updated weights for policy 0, policy_version 966826 (0.0007) [2023-12-26 07:18:40,047][123090] Updated weights for policy 1, policy_version 959970 (0.0009) [2023-12-26 07:18:40,121][123090] Updated weights for policy 1, policy_version 959980 (0.0011) [2023-12-26 07:18:40,184][123090] Updated weights for policy 1, policy_version 959990 (0.0009) [2023-12-26 07:18:40,231][123090] Updated weights for policy 1, policy_version 960000 (0.0008) [2023-12-26 07:18:40,488][123091] Updated weights for policy 0, policy_version 966836 (0.0008) [2023-12-26 07:18:40,551][123091] Updated weights for policy 0, policy_version 966846 (0.0011) [2023-12-26 07:18:40,604][123091] Updated weights for policy 0, policy_version 966856 (0.0010) [2023-12-26 07:18:41,091][123090] Updated weights for policy 1, policy_version 960010 (0.0008) [2023-12-26 07:18:41,162][123090] Updated weights for policy 1, policy_version 960020 (0.0008) [2023-12-26 07:18:41,230][123090] Updated weights for policy 1, policy_version 960030 (0.0007) [2023-12-26 07:18:41,342][123091] Updated weights for policy 0, policy_version 966866 (0.0006) [2023-12-26 07:18:41,417][123091] Updated weights for policy 0, policy_version 966876 (0.0011) [2023-12-26 07:18:41,484][123091] Updated weights for policy 0, policy_version 966886 (0.0010) [2023-12-26 07:18:41,540][123091] Updated weights for policy 0, policy_version 966896 (0.0011) [2023-12-26 07:18:41,977][123090] Updated weights for policy 1, policy_version 960040 (0.0008) [2023-12-26 07:18:42,043][123090] Updated weights for policy 1, policy_version 960050 (0.0010) [2023-12-26 07:18:42,104][123090] Updated weights for policy 1, policy_version 960060 (0.0009) [2023-12-26 07:18:42,371][123091] Updated weights for policy 0, policy_version 966906 (0.0010) [2023-12-26 07:18:42,428][123091] Updated weights for policy 0, policy_version 966916 (0.0010) [2023-12-26 07:18:42,483][123091] Updated weights for policy 0, policy_version 966926 (0.0010) [2023-12-26 07:18:42,892][123090] Updated weights for policy 1, policy_version 960070 (0.0008) [2023-12-26 07:18:42,946][123090] Updated weights for policy 1, policy_version 960080 (0.0009) [2023-12-26 07:18:42,996][123090] Updated weights for policy 1, policy_version 960090 (0.0006) [2023-12-26 07:18:43,302][123091] Updated weights for policy 0, policy_version 966937 (0.0010) [2023-12-26 07:18:43,352][123091] Updated weights for policy 0, policy_version 966947 (0.0005) [2023-12-26 07:18:43,398][123091] Updated weights for policy 0, policy_version 966957 (0.0005) [2023-12-26 07:18:43,688][123090] Updated weights for policy 1, policy_version 960100 (0.0006) [2023-12-26 07:18:43,735][123090] Updated weights for policy 1, policy_version 960110 (0.0005) [2023-12-26 07:18:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 493330432. Throughput: 0: 8828.9, 1: 8781.1. Samples: 493325144. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:18:43,785][121949] Avg episode reward: [(0, '5912.736'), (1, '5465.512')] [2023-12-26 07:18:43,789][123090] Updated weights for policy 1, policy_version 960120 (0.0006) [2023-12-26 07:18:44,096][123091] Updated weights for policy 0, policy_version 966967 (0.0009) [2023-12-26 07:18:44,163][123091] Updated weights for policy 0, policy_version 966977 (0.0010) [2023-12-26 07:18:44,230][123091] Updated weights for policy 0, policy_version 966987 (0.0007) [2023-12-26 07:18:44,539][123090] Updated weights for policy 1, policy_version 960130 (0.0005) [2023-12-26 07:18:44,601][123090] Updated weights for policy 1, policy_version 960140 (0.0005) [2023-12-26 07:18:44,652][123090] Updated weights for policy 1, policy_version 960150 (0.0005) [2023-12-26 07:18:44,705][123090] Updated weights for policy 1, policy_version 960160 (0.0006) [2023-12-26 07:18:45,037][123091] Updated weights for policy 0, policy_version 966997 (0.0008) [2023-12-26 07:18:45,104][123091] Updated weights for policy 0, policy_version 967007 (0.0011) [2023-12-26 07:18:45,171][123091] Updated weights for policy 0, policy_version 967017 (0.0011) [2023-12-26 07:18:45,513][123090] Updated weights for policy 1, policy_version 960170 (0.0010) [2023-12-26 07:18:45,576][123090] Updated weights for policy 1, policy_version 960180 (0.0010) [2023-12-26 07:18:45,640][123090] Updated weights for policy 1, policy_version 960190 (0.0010) [2023-12-26 07:18:45,919][123091] Updated weights for policy 0, policy_version 967027 (0.0009) [2023-12-26 07:18:45,986][123091] Updated weights for policy 0, policy_version 967037 (0.0006) [2023-12-26 07:18:46,056][123091] Updated weights for policy 0, policy_version 967047 (0.0006) [2023-12-26 07:18:46,469][123090] Updated weights for policy 1, policy_version 960200 (0.0007) [2023-12-26 07:18:46,529][123090] Updated weights for policy 1, policy_version 960210 (0.0005) [2023-12-26 07:18:46,592][123090] Updated weights for policy 1, policy_version 960220 (0.0005) [2023-12-26 07:18:46,692][123091] Updated weights for policy 0, policy_version 967057 (0.0009) [2023-12-26 07:18:46,760][123091] Updated weights for policy 0, policy_version 967067 (0.0005) [2023-12-26 07:18:46,815][123091] Updated weights for policy 0, policy_version 967077 (0.0005) [2023-12-26 07:18:46,876][123091] Updated weights for policy 0, policy_version 967087 (0.0005) [2023-12-26 07:18:47,235][123090] Updated weights for policy 1, policy_version 960230 (0.0005) [2023-12-26 07:18:47,285][123090] Updated weights for policy 1, policy_version 960240 (0.0005) [2023-12-26 07:18:47,333][123090] Updated weights for policy 1, policy_version 960250 (0.0009) [2023-12-26 07:18:47,510][123091] Updated weights for policy 0, policy_version 967097 (0.0008) [2023-12-26 07:18:47,566][123091] Updated weights for policy 0, policy_version 967107 (0.0009) [2023-12-26 07:18:47,629][123091] Updated weights for policy 0, policy_version 967117 (0.0009) [2023-12-26 07:18:48,151][123090] Updated weights for policy 1, policy_version 960260 (0.0010) [2023-12-26 07:18:48,214][123090] Updated weights for policy 1, policy_version 960270 (0.0010) [2023-12-26 07:18:48,290][123090] Updated weights for policy 1, policy_version 960280 (0.0006) [2023-12-26 07:18:48,468][123091] Updated weights for policy 0, policy_version 967127 (0.0009) [2023-12-26 07:18:48,528][123091] Updated weights for policy 0, policy_version 967137 (0.0009) [2023-12-26 07:18:48,587][123091] Updated weights for policy 0, policy_version 967147 (0.0009) [2023-12-26 07:18:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 493428736. Throughput: 0: 8860.5, 1: 8810.4. Samples: 493437388. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:18:48,784][121949] Avg episode reward: [(0, '5893.119'), (1, '5642.033')] [2023-12-26 07:18:49,055][123090] Updated weights for policy 1, policy_version 960290 (0.0011) [2023-12-26 07:18:49,108][123090] Updated weights for policy 1, policy_version 960300 (0.0009) [2023-12-26 07:18:49,159][123090] Updated weights for policy 1, policy_version 960310 (0.0008) [2023-12-26 07:18:49,211][123090] Updated weights for policy 1, policy_version 960320 (0.0009) [2023-12-26 07:18:49,441][123091] Updated weights for policy 0, policy_version 967157 (0.0008) [2023-12-26 07:18:49,503][123091] Updated weights for policy 0, policy_version 967167 (0.0008) [2023-12-26 07:18:49,571][123091] Updated weights for policy 0, policy_version 967177 (0.0007) [2023-12-26 07:18:49,991][123090] Updated weights for policy 1, policy_version 960330 (0.0009) [2023-12-26 07:18:50,052][123090] Updated weights for policy 1, policy_version 960340 (0.0008) [2023-12-26 07:18:50,116][123090] Updated weights for policy 1, policy_version 960350 (0.0009) [2023-12-26 07:18:50,457][123091] Updated weights for policy 0, policy_version 967187 (0.0008) [2023-12-26 07:18:50,511][123091] Updated weights for policy 0, policy_version 967197 (0.0010) [2023-12-26 07:18:50,564][123091] Updated weights for policy 0, policy_version 967207 (0.0010) [2023-12-26 07:18:50,929][123090] Updated weights for policy 1, policy_version 960360 (0.0009) [2023-12-26 07:18:50,982][123090] Updated weights for policy 1, policy_version 960370 (0.0010) [2023-12-26 07:18:51,045][123090] Updated weights for policy 1, policy_version 960380 (0.0009) [2023-12-26 07:18:51,387][123091] Updated weights for policy 0, policy_version 967217 (0.0011) [2023-12-26 07:18:51,450][123091] Updated weights for policy 0, policy_version 967227 (0.0011) [2023-12-26 07:18:51,520][123091] Updated weights for policy 0, policy_version 967237 (0.0011) [2023-12-26 07:18:51,579][123091] Updated weights for policy 0, policy_version 967247 (0.0011) [2023-12-26 07:18:51,912][123090] Updated weights for policy 1, policy_version 960390 (0.0009) [2023-12-26 07:18:51,960][123090] Updated weights for policy 1, policy_version 960400 (0.0009) [2023-12-26 07:18:52,008][123090] Updated weights for policy 1, policy_version 960410 (0.0009) [2023-12-26 07:18:52,410][123091] Updated weights for policy 0, policy_version 967257 (0.0011) [2023-12-26 07:18:52,474][123091] Updated weights for policy 0, policy_version 967267 (0.0010) [2023-12-26 07:18:52,526][123091] Updated weights for policy 0, policy_version 967277 (0.0011) [2023-12-26 07:18:52,879][123090] Updated weights for policy 1, policy_version 960420 (0.0009) [2023-12-26 07:18:52,938][123090] Updated weights for policy 1, policy_version 960430 (0.0008) [2023-12-26 07:18:53,005][123090] Updated weights for policy 1, policy_version 960440 (0.0009) [2023-12-26 07:18:53,348][123091] Updated weights for policy 0, policy_version 967287 (0.0008) [2023-12-26 07:18:53,404][123091] Updated weights for policy 0, policy_version 967297 (0.0005) [2023-12-26 07:18:53,461][123091] Updated weights for policy 0, policy_version 967307 (0.0005) [2023-12-26 07:18:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 493510656. Throughput: 0: 8788.2, 1: 8791.6. Samples: 493490076. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:18:53,785][121949] Avg episode reward: [(0, '5948.215'), (1, '5852.158')] [2023-12-26 07:18:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000967312_247635968.pth... [2023-12-26 07:18:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000960448_245874688.pth... [2023-12-26 07:18:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000966288_247373824.pth [2023-12-26 07:18:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000959424_245612544.pth [2023-12-26 07:18:53,896][123090] Updated weights for policy 1, policy_version 960450 (0.0008) [2023-12-26 07:18:53,958][123090] Updated weights for policy 1, policy_version 960460 (0.0009) [2023-12-26 07:18:54,021][123090] Updated weights for policy 1, policy_version 960470 (0.0008) [2023-12-26 07:18:54,087][123090] Updated weights for policy 1, policy_version 960480 (0.0008) [2023-12-26 07:18:54,154][123091] Updated weights for policy 0, policy_version 967317 (0.0008) [2023-12-26 07:18:54,213][123091] Updated weights for policy 0, policy_version 967327 (0.0010) [2023-12-26 07:18:54,272][123091] Updated weights for policy 0, policy_version 967337 (0.0010) [2023-12-26 07:18:54,711][123090] Updated weights for policy 1, policy_version 960490 (0.0007) [2023-12-26 07:18:54,770][123090] Updated weights for policy 1, policy_version 960500 (0.0005) [2023-12-26 07:18:54,824][123090] Updated weights for policy 1, policy_version 960510 (0.0005) [2023-12-26 07:18:55,095][123091] Updated weights for policy 0, policy_version 967347 (0.0011) [2023-12-26 07:18:55,146][123091] Updated weights for policy 0, policy_version 967357 (0.0010) [2023-12-26 07:18:55,190][123091] Updated weights for policy 0, policy_version 967367 (0.0010) [2023-12-26 07:18:55,538][123090] Updated weights for policy 1, policy_version 960520 (0.0008) [2023-12-26 07:18:55,604][123090] Updated weights for policy 1, policy_version 960530 (0.0009) [2023-12-26 07:18:55,654][123090] Updated weights for policy 1, policy_version 960540 (0.0009) [2023-12-26 07:18:55,951][123091] Updated weights for policy 0, policy_version 967377 (0.0010) [2023-12-26 07:18:56,014][123091] Updated weights for policy 0, policy_version 967387 (0.0008) [2023-12-26 07:18:56,079][123091] Updated weights for policy 0, policy_version 967397 (0.0006) [2023-12-26 07:18:56,145][123091] Updated weights for policy 0, policy_version 967407 (0.0005) [2023-12-26 07:18:56,545][123090] Updated weights for policy 1, policy_version 960551 (0.0010) [2023-12-26 07:18:56,594][123090] Updated weights for policy 1, policy_version 960561 (0.0009) [2023-12-26 07:18:56,647][123090] Updated weights for policy 1, policy_version 960571 (0.0009) [2023-12-26 07:18:56,762][123091] Updated weights for policy 0, policy_version 967417 (0.0010) [2023-12-26 07:18:56,823][123091] Updated weights for policy 0, policy_version 967427 (0.0010) [2023-12-26 07:18:56,883][123091] Updated weights for policy 0, policy_version 967437 (0.0010) [2023-12-26 07:18:57,567][123090] Updated weights for policy 1, policy_version 960581 (0.0007) [2023-12-26 07:18:57,586][123091] Updated weights for policy 0, policy_version 967447 (0.0007) [2023-12-26 07:18:57,632][123091] Updated weights for policy 0, policy_version 967457 (0.0009) [2023-12-26 07:18:57,633][123090] Updated weights for policy 1, policy_version 960591 (0.0005) [2023-12-26 07:18:57,680][123090] Updated weights for policy 1, policy_version 960601 (0.0006) [2023-12-26 07:18:57,687][123091] Updated weights for policy 0, policy_version 967467 (0.0010) [2023-12-26 07:18:58,433][123090] Updated weights for policy 1, policy_version 960611 (0.0006) [2023-12-26 07:18:58,512][123090] Updated weights for policy 1, policy_version 960621 (0.0008) [2023-12-26 07:18:58,533][123091] Updated weights for policy 0, policy_version 967477 (0.0009) [2023-12-26 07:18:58,577][123090] Updated weights for policy 1, policy_version 960631 (0.0008) [2023-12-26 07:18:58,601][123091] Updated weights for policy 0, policy_version 967487 (0.0007) [2023-12-26 07:18:58,673][123091] Updated weights for policy 0, policy_version 967497 (0.0007) [2023-12-26 07:18:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.4, 300 sec: 17716.9). Total num frames: 493608960. Throughput: 0: 8886.8, 1: 8827.1. Samples: 493597404. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:18:58,785][121949] Avg episode reward: [(0, '5897.403'), (1, '5758.424')] [2023-12-26 07:18:59,463][123090] Updated weights for policy 1, policy_version 960641 (0.0009) [2023-12-26 07:18:59,518][123091] Updated weights for policy 0, policy_version 967507 (0.0008) [2023-12-26 07:18:59,531][123090] Updated weights for policy 1, policy_version 960651 (0.0007) [2023-12-26 07:18:59,587][123091] Updated weights for policy 0, policy_version 967517 (0.0006) [2023-12-26 07:18:59,611][123090] Updated weights for policy 1, policy_version 960661 (0.0005) [2023-12-26 07:18:59,653][123091] Updated weights for policy 0, policy_version 967527 (0.0006) [2023-12-26 07:18:59,680][123090] Updated weights for policy 1, policy_version 960671 (0.0007) [2023-12-26 07:19:00,324][123091] Updated weights for policy 0, policy_version 967537 (0.0006) [2023-12-26 07:19:00,387][123091] Updated weights for policy 0, policy_version 967547 (0.0010) [2023-12-26 07:19:00,446][123091] Updated weights for policy 0, policy_version 967557 (0.0008) [2023-12-26 07:19:00,479][123090] Updated weights for policy 1, policy_version 960681 (0.0008) [2023-12-26 07:19:00,505][123091] Updated weights for policy 0, policy_version 967567 (0.0009) [2023-12-26 07:19:00,537][123090] Updated weights for policy 1, policy_version 960691 (0.0009) [2023-12-26 07:19:00,584][123090] Updated weights for policy 1, policy_version 960701 (0.0008) [2023-12-26 07:19:01,311][123091] Updated weights for policy 0, policy_version 967577 (0.0007) [2023-12-26 07:19:01,379][123091] Updated weights for policy 0, policy_version 967587 (0.0010) [2023-12-26 07:19:01,446][123091] Updated weights for policy 0, policy_version 967597 (0.0009) [2023-12-26 07:19:01,488][123090] Updated weights for policy 1, policy_version 960712 (0.0009) [2023-12-26 07:19:01,552][123090] Updated weights for policy 1, policy_version 960722 (0.0008) [2023-12-26 07:19:01,627][123090] Updated weights for policy 1, policy_version 960732 (0.0009) [2023-12-26 07:19:02,195][123091] Updated weights for policy 0, policy_version 967607 (0.0006) [2023-12-26 07:19:02,262][123091] Updated weights for policy 0, policy_version 967617 (0.0007) [2023-12-26 07:19:02,335][123091] Updated weights for policy 0, policy_version 967627 (0.0010) [2023-12-26 07:19:02,477][123090] Updated weights for policy 1, policy_version 960742 (0.0010) [2023-12-26 07:19:02,530][123090] Updated weights for policy 1, policy_version 960752 (0.0009) [2023-12-26 07:19:02,590][123090] Updated weights for policy 1, policy_version 960762 (0.0008) [2023-12-26 07:19:03,121][123091] Updated weights for policy 0, policy_version 967637 (0.0007) [2023-12-26 07:19:03,178][123091] Updated weights for policy 0, policy_version 967647 (0.0005) [2023-12-26 07:19:03,232][123091] Updated weights for policy 0, policy_version 967657 (0.0005) [2023-12-26 07:19:03,471][123090] Updated weights for policy 1, policy_version 960772 (0.0009) [2023-12-26 07:19:03,533][123090] Updated weights for policy 1, policy_version 960782 (0.0009) [2023-12-26 07:19:03,596][123090] Updated weights for policy 1, policy_version 960792 (0.0010) [2023-12-26 07:19:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 493690880. Throughput: 0: 8909.0, 1: 8786.5. Samples: 493700832. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:03,785][121949] Avg episode reward: [(0, '5915.093'), (1, '5634.254')] [2023-12-26 07:19:03,935][123091] Updated weights for policy 0, policy_version 967667 (0.0007) [2023-12-26 07:19:03,983][123091] Updated weights for policy 0, policy_version 967677 (0.0011) [2023-12-26 07:19:04,031][123091] Updated weights for policy 0, policy_version 967687 (0.0010) [2023-12-26 07:19:04,489][123090] Updated weights for policy 1, policy_version 960802 (0.0009) [2023-12-26 07:19:04,556][123090] Updated weights for policy 1, policy_version 960812 (0.0008) [2023-12-26 07:19:04,619][123090] Updated weights for policy 1, policy_version 960822 (0.0008) [2023-12-26 07:19:04,667][123090] Updated weights for policy 1, policy_version 960832 (0.0008) [2023-12-26 07:19:04,889][123091] Updated weights for policy 0, policy_version 967697 (0.0011) [2023-12-26 07:19:04,944][123091] Updated weights for policy 0, policy_version 967707 (0.0009) [2023-12-26 07:19:04,995][123091] Updated weights for policy 0, policy_version 967717 (0.0009) [2023-12-26 07:19:05,042][123091] Updated weights for policy 0, policy_version 967727 (0.0010) [2023-12-26 07:19:05,446][123090] Updated weights for policy 1, policy_version 960842 (0.0009) [2023-12-26 07:19:05,494][123090] Updated weights for policy 1, policy_version 960852 (0.0009) [2023-12-26 07:19:05,544][123090] Updated weights for policy 1, policy_version 960862 (0.0009) [2023-12-26 07:19:05,861][123091] Updated weights for policy 0, policy_version 967737 (0.0009) [2023-12-26 07:19:05,927][123091] Updated weights for policy 0, policy_version 967747 (0.0009) [2023-12-26 07:19:05,989][123091] Updated weights for policy 0, policy_version 967757 (0.0010) [2023-12-26 07:19:06,347][123090] Updated weights for policy 1, policy_version 960872 (0.0010) [2023-12-26 07:19:06,414][123090] Updated weights for policy 1, policy_version 960882 (0.0009) [2023-12-26 07:19:06,482][123090] Updated weights for policy 1, policy_version 960892 (0.0009) [2023-12-26 07:19:06,842][123091] Updated weights for policy 0, policy_version 967767 (0.0010) [2023-12-26 07:19:06,894][123091] Updated weights for policy 0, policy_version 967777 (0.0010) [2023-12-26 07:19:06,945][123091] Updated weights for policy 0, policy_version 967787 (0.0010) [2023-12-26 07:19:07,336][123090] Updated weights for policy 1, policy_version 960902 (0.0009) [2023-12-26 07:19:07,390][123090] Updated weights for policy 1, policy_version 960912 (0.0009) [2023-12-26 07:19:07,443][123090] Updated weights for policy 1, policy_version 960922 (0.0009) [2023-12-26 07:19:07,670][123091] Updated weights for policy 0, policy_version 967797 (0.0008) [2023-12-26 07:19:07,726][123091] Updated weights for policy 0, policy_version 967807 (0.0005) [2023-12-26 07:19:07,793][123091] Updated weights for policy 0, policy_version 967817 (0.0005) [2023-12-26 07:19:08,350][123090] Updated weights for policy 1, policy_version 960932 (0.0009) [2023-12-26 07:19:08,427][123090] Updated weights for policy 1, policy_version 960942 (0.0006) [2023-12-26 07:19:08,496][123090] Updated weights for policy 1, policy_version 960952 (0.0009) [2023-12-26 07:19:08,497][123091] Updated weights for policy 0, policy_version 967827 (0.0007) [2023-12-26 07:19:08,559][123091] Updated weights for policy 0, policy_version 967837 (0.0007) [2023-12-26 07:19:08,609][123091] Updated weights for policy 0, policy_version 967847 (0.0005) [2023-12-26 07:19:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 493780992. Throughput: 0: 8924.2, 1: 8783.9. Samples: 493752884. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:08,785][121949] Avg episode reward: [(0, '5958.857'), (1, '5539.223')] [2023-12-26 07:19:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000967856_247775232.pth... [2023-12-26 07:19:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000960960_246005760.pth... [2023-12-26 07:19:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000966800_247504896.pth [2023-12-26 07:19:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000959936_245743616.pth [2023-12-26 07:19:09,327][123091] Updated weights for policy 0, policy_version 967857 (0.0005) [2023-12-26 07:19:09,340][123090] Updated weights for policy 1, policy_version 960962 (0.0009) [2023-12-26 07:19:09,409][123091] Updated weights for policy 0, policy_version 967867 (0.0008) [2023-12-26 07:19:09,426][123090] Updated weights for policy 1, policy_version 960972 (0.0009) [2023-12-26 07:19:09,483][123091] Updated weights for policy 0, policy_version 967877 (0.0007) [2023-12-26 07:19:09,492][123090] Updated weights for policy 1, policy_version 960982 (0.0008) [2023-12-26 07:19:09,554][123091] Updated weights for policy 0, policy_version 967887 (0.0010) [2023-12-26 07:19:09,557][123090] Updated weights for policy 1, policy_version 960992 (0.0006) [2023-12-26 07:19:10,330][123091] Updated weights for policy 0, policy_version 967897 (0.0006) [2023-12-26 07:19:10,397][123091] Updated weights for policy 0, policy_version 967907 (0.0006) [2023-12-26 07:19:10,445][123090] Updated weights for policy 1, policy_version 961002 (0.0009) [2023-12-26 07:19:10,461][123091] Updated weights for policy 0, policy_version 967917 (0.0006) [2023-12-26 07:19:10,508][123090] Updated weights for policy 1, policy_version 961012 (0.0009) [2023-12-26 07:19:10,569][123090] Updated weights for policy 1, policy_version 961022 (0.0009) [2023-12-26 07:19:11,120][123091] Updated weights for policy 0, policy_version 967927 (0.0007) [2023-12-26 07:19:11,191][123091] Updated weights for policy 0, policy_version 967937 (0.0009) [2023-12-26 07:19:11,261][123091] Updated weights for policy 0, policy_version 967947 (0.0009) [2023-12-26 07:19:11,507][123090] Updated weights for policy 1, policy_version 961032 (0.0006) [2023-12-26 07:19:11,561][123090] Updated weights for policy 1, policy_version 961042 (0.0006) [2023-12-26 07:19:11,634][123090] Updated weights for policy 1, policy_version 961052 (0.0007) [2023-12-26 07:19:12,085][123091] Updated weights for policy 0, policy_version 967957 (0.0010) [2023-12-26 07:19:12,137][123091] Updated weights for policy 0, policy_version 967967 (0.0005) [2023-12-26 07:19:12,188][123091] Updated weights for policy 0, policy_version 967977 (0.0005) [2023-12-26 07:19:12,489][123090] Updated weights for policy 1, policy_version 961062 (0.0008) [2023-12-26 07:19:12,564][123090] Updated weights for policy 1, policy_version 961072 (0.0009) [2023-12-26 07:19:12,633][123090] Updated weights for policy 1, policy_version 961082 (0.0007) [2023-12-26 07:19:12,864][123091] Updated weights for policy 0, policy_version 967987 (0.0007) [2023-12-26 07:19:12,921][123091] Updated weights for policy 0, policy_version 967997 (0.0006) [2023-12-26 07:19:12,980][123091] Updated weights for policy 0, policy_version 968007 (0.0006) [2023-12-26 07:19:13,362][123090] Updated weights for policy 1, policy_version 961092 (0.0008) [2023-12-26 07:19:13,416][123090] Updated weights for policy 1, policy_version 961102 (0.0010) [2023-12-26 07:19:13,478][123090] Updated weights for policy 1, policy_version 961112 (0.0010) [2023-12-26 07:19:13,612][123091] Updated weights for policy 0, policy_version 968017 (0.0006) [2023-12-26 07:19:13,688][123091] Updated weights for policy 0, policy_version 968027 (0.0005) [2023-12-26 07:19:13,764][123091] Updated weights for policy 0, policy_version 968037 (0.0006) [2023-12-26 07:19:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 493862912. Throughput: 0: 9013.7, 1: 8649.7. Samples: 493857584. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:13,785][121949] Avg episode reward: [(0, '5921.029'), (1, '5430.997')] [2023-12-26 07:19:13,831][123091] Updated weights for policy 0, policy_version 968047 (0.0005) [2023-12-26 07:19:14,252][123090] Updated weights for policy 1, policy_version 961123 (0.0010) [2023-12-26 07:19:14,314][123090] Updated weights for policy 1, policy_version 961133 (0.0010) [2023-12-26 07:19:14,380][123090] Updated weights for policy 1, policy_version 961143 (0.0010) [2023-12-26 07:19:14,464][123091] Updated weights for policy 0, policy_version 968057 (0.0006) [2023-12-26 07:19:14,530][123091] Updated weights for policy 0, policy_version 968067 (0.0005) [2023-12-26 07:19:14,597][123091] Updated weights for policy 0, policy_version 968077 (0.0006) [2023-12-26 07:19:15,219][123090] Updated weights for policy 1, policy_version 961153 (0.0010) [2023-12-26 07:19:15,292][123090] Updated weights for policy 1, policy_version 961163 (0.0009) [2023-12-26 07:19:15,364][123090] Updated weights for policy 1, policy_version 961173 (0.0010) [2023-12-26 07:19:15,365][123091] Updated weights for policy 0, policy_version 968087 (0.0009) [2023-12-26 07:19:15,429][123090] Updated weights for policy 1, policy_version 961183 (0.0011) [2023-12-26 07:19:15,429][123091] Updated weights for policy 0, policy_version 968097 (0.0011) [2023-12-26 07:19:15,490][123091] Updated weights for policy 0, policy_version 968107 (0.0008) [2023-12-26 07:19:16,145][123091] Updated weights for policy 0, policy_version 968117 (0.0008) [2023-12-26 07:19:16,208][123091] Updated weights for policy 0, policy_version 968127 (0.0007) [2023-12-26 07:19:16,213][123090] Updated weights for policy 1, policy_version 961193 (0.0006) [2023-12-26 07:19:16,271][123090] Updated weights for policy 1, policy_version 961203 (0.0006) [2023-12-26 07:19:16,280][123091] Updated weights for policy 0, policy_version 968137 (0.0005) [2023-12-26 07:19:16,334][123090] Updated weights for policy 1, policy_version 961213 (0.0006) [2023-12-26 07:19:16,980][123090] Updated weights for policy 1, policy_version 961223 (0.0006) [2023-12-26 07:19:17,029][123091] Updated weights for policy 0, policy_version 968147 (0.0006) [2023-12-26 07:19:17,037][123090] Updated weights for policy 1, policy_version 961233 (0.0010) [2023-12-26 07:19:17,086][123090] Updated weights for policy 1, policy_version 961243 (0.0007) [2023-12-26 07:19:17,089][123091] Updated weights for policy 0, policy_version 968157 (0.0007) [2023-12-26 07:19:17,148][123091] Updated weights for policy 0, policy_version 968167 (0.0009) [2023-12-26 07:19:17,802][123090] Updated weights for policy 1, policy_version 961253 (0.0008) [2023-12-26 07:19:17,849][123090] Updated weights for policy 1, policy_version 961263 (0.0010) [2023-12-26 07:19:17,900][123090] Updated weights for policy 1, policy_version 961273 (0.0010) [2023-12-26 07:19:17,917][123091] Updated weights for policy 0, policy_version 968177 (0.0010) [2023-12-26 07:19:17,978][123091] Updated weights for policy 0, policy_version 968187 (0.0010) [2023-12-26 07:19:18,041][123091] Updated weights for policy 0, policy_version 968197 (0.0009) [2023-12-26 07:19:18,100][123091] Updated weights for policy 0, policy_version 968207 (0.0009) [2023-12-26 07:19:18,633][123090] Updated weights for policy 1, policy_version 961283 (0.0009) [2023-12-26 07:19:18,700][123090] Updated weights for policy 1, policy_version 961293 (0.0005) [2023-12-26 07:19:18,750][123090] Updated weights for policy 1, policy_version 961303 (0.0005) [2023-12-26 07:19:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 493953024. Throughput: 0: 9078.0, 1: 8706.0. Samples: 493971160. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:18,784][121949] Avg episode reward: [(0, '5872.015'), (1, '5508.507')] [2023-12-26 07:19:18,950][123091] Updated weights for policy 0, policy_version 968217 (0.0010) [2023-12-26 07:19:19,011][123091] Updated weights for policy 0, policy_version 968227 (0.0009) [2023-12-26 07:19:19,073][123091] Updated weights for policy 0, policy_version 968237 (0.0009) [2023-12-26 07:19:19,437][123090] Updated weights for policy 1, policy_version 961313 (0.0007) [2023-12-26 07:19:19,501][123090] Updated weights for policy 1, policy_version 961323 (0.0010) [2023-12-26 07:19:19,569][123090] Updated weights for policy 1, policy_version 961333 (0.0011) [2023-12-26 07:19:19,622][123090] Updated weights for policy 1, policy_version 961343 (0.0010) [2023-12-26 07:19:19,963][123091] Updated weights for policy 0, policy_version 968247 (0.0010) [2023-12-26 07:19:20,034][123091] Updated weights for policy 0, policy_version 968257 (0.0009) [2023-12-26 07:19:20,100][123091] Updated weights for policy 0, policy_version 968267 (0.0009) [2023-12-26 07:19:20,469][123090] Updated weights for policy 1, policy_version 961353 (0.0011) [2023-12-26 07:19:20,529][123090] Updated weights for policy 1, policy_version 961363 (0.0010) [2023-12-26 07:19:20,595][123090] Updated weights for policy 1, policy_version 961373 (0.0010) [2023-12-26 07:19:20,941][123091] Updated weights for policy 0, policy_version 968277 (0.0010) [2023-12-26 07:19:21,011][123091] Updated weights for policy 0, policy_version 968287 (0.0009) [2023-12-26 07:19:21,071][123091] Updated weights for policy 0, policy_version 968297 (0.0009) [2023-12-26 07:19:21,465][123090] Updated weights for policy 1, policy_version 961383 (0.0009) [2023-12-26 07:19:21,533][123090] Updated weights for policy 1, policy_version 961393 (0.0008) [2023-12-26 07:19:21,597][123090] Updated weights for policy 1, policy_version 961403 (0.0007) [2023-12-26 07:19:21,955][123091] Updated weights for policy 0, policy_version 968307 (0.0010) [2023-12-26 07:19:22,014][123091] Updated weights for policy 0, policy_version 968317 (0.0009) [2023-12-26 07:19:22,085][123091] Updated weights for policy 0, policy_version 968327 (0.0009) [2023-12-26 07:19:22,518][123090] Updated weights for policy 1, policy_version 961413 (0.0009) [2023-12-26 07:19:22,583][123090] Updated weights for policy 1, policy_version 961423 (0.0009) [2023-12-26 07:19:22,652][123090] Updated weights for policy 1, policy_version 961433 (0.0006) [2023-12-26 07:19:22,987][123091] Updated weights for policy 0, policy_version 968337 (0.0009) [2023-12-26 07:19:23,044][123091] Updated weights for policy 0, policy_version 968347 (0.0009) [2023-12-26 07:19:23,092][123091] Updated weights for policy 0, policy_version 968357 (0.0009) [2023-12-26 07:19:23,147][123091] Updated weights for policy 0, policy_version 968367 (0.0009) [2023-12-26 07:19:23,417][123090] Updated weights for policy 1, policy_version 961443 (0.0007) [2023-12-26 07:19:23,473][123090] Updated weights for policy 1, policy_version 961453 (0.0010) [2023-12-26 07:19:23,530][123090] Updated weights for policy 1, policy_version 961463 (0.0009) [2023-12-26 07:19:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 494043136. Throughput: 0: 9037.0, 1: 8718.1. Samples: 494021316. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:23,785][121949] Avg episode reward: [(0, '5873.085'), (1, '5535.270')] [2023-12-26 07:19:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000968368_247906304.pth... [2023-12-26 07:19:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000961472_246136832.pth... [2023-12-26 07:19:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000967312_247635968.pth [2023-12-26 07:19:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000960448_245874688.pth [2023-12-26 07:19:23,963][123091] Updated weights for policy 0, policy_version 968377 (0.0009) [2023-12-26 07:19:24,020][123091] Updated weights for policy 0, policy_version 968387 (0.0009) [2023-12-26 07:19:24,085][123091] Updated weights for policy 0, policy_version 968397 (0.0010) [2023-12-26 07:19:24,356][123090] Updated weights for policy 1, policy_version 961473 (0.0010) [2023-12-26 07:19:24,422][123090] Updated weights for policy 1, policy_version 961483 (0.0010) [2023-12-26 07:19:24,481][123090] Updated weights for policy 1, policy_version 961493 (0.0010) [2023-12-26 07:19:24,547][123090] Updated weights for policy 1, policy_version 961503 (0.0010) [2023-12-26 07:19:24,944][123091] Updated weights for policy 0, policy_version 968407 (0.0010) [2023-12-26 07:19:25,002][123091] Updated weights for policy 0, policy_version 968417 (0.0008) [2023-12-26 07:19:25,059][123091] Updated weights for policy 0, policy_version 968427 (0.0006) [2023-12-26 07:19:25,336][123090] Updated weights for policy 1, policy_version 961513 (0.0010) [2023-12-26 07:19:25,409][123090] Updated weights for policy 1, policy_version 961523 (0.0010) [2023-12-26 07:19:25,479][123090] Updated weights for policy 1, policy_version 961533 (0.0010) [2023-12-26 07:19:25,758][123091] Updated weights for policy 0, policy_version 968437 (0.0008) [2023-12-26 07:19:25,813][123091] Updated weights for policy 0, policy_version 968447 (0.0010) [2023-12-26 07:19:25,873][123091] Updated weights for policy 0, policy_version 968457 (0.0007) [2023-12-26 07:19:26,266][123090] Updated weights for policy 1, policy_version 961543 (0.0010) [2023-12-26 07:19:26,331][123090] Updated weights for policy 1, policy_version 961553 (0.0010) [2023-12-26 07:19:26,393][123090] Updated weights for policy 1, policy_version 961563 (0.0010) [2023-12-26 07:19:26,583][123091] Updated weights for policy 0, policy_version 968467 (0.0007) [2023-12-26 07:19:26,642][123091] Updated weights for policy 0, policy_version 968477 (0.0010) [2023-12-26 07:19:26,709][123091] Updated weights for policy 0, policy_version 968487 (0.0011) [2023-12-26 07:19:27,152][123090] Updated weights for policy 1, policy_version 961573 (0.0010) [2023-12-26 07:19:27,221][123090] Updated weights for policy 1, policy_version 961583 (0.0010) [2023-12-26 07:19:27,274][123090] Updated weights for policy 1, policy_version 961593 (0.0010) [2023-12-26 07:19:27,494][123091] Updated weights for policy 0, policy_version 968497 (0.0011) [2023-12-26 07:19:27,556][123091] Updated weights for policy 0, policy_version 968507 (0.0011) [2023-12-26 07:19:27,602][123091] Updated weights for policy 0, policy_version 968517 (0.0010) [2023-12-26 07:19:27,650][123091] Updated weights for policy 0, policy_version 968527 (0.0010) [2023-12-26 07:19:27,983][123090] Updated weights for policy 1, policy_version 961603 (0.0009) [2023-12-26 07:19:28,046][123090] Updated weights for policy 1, policy_version 961613 (0.0006) [2023-12-26 07:19:28,113][123090] Updated weights for policy 1, policy_version 961623 (0.0010) [2023-12-26 07:19:28,487][123091] Updated weights for policy 0, policy_version 968537 (0.0010) [2023-12-26 07:19:28,534][123091] Updated weights for policy 0, policy_version 968547 (0.0010) [2023-12-26 07:19:28,585][123091] Updated weights for policy 0, policy_version 968557 (0.0010) [2023-12-26 07:19:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 494133248. Throughput: 0: 9085.0, 1: 8718.8. Samples: 494126316. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:28,785][121949] Avg episode reward: [(0, '6133.728'), (1, '5609.340')] [2023-12-26 07:19:28,900][123090] Updated weights for policy 1, policy_version 961633 (0.0010) [2023-12-26 07:19:28,962][123090] Updated weights for policy 1, policy_version 961643 (0.0010) [2023-12-26 07:19:29,030][123090] Updated weights for policy 1, policy_version 961653 (0.0010) [2023-12-26 07:19:29,095][123090] Updated weights for policy 1, policy_version 961663 (0.0010) [2023-12-26 07:19:29,423][123091] Updated weights for policy 0, policy_version 968567 (0.0007) [2023-12-26 07:19:29,484][123091] Updated weights for policy 0, policy_version 968577 (0.0006) [2023-12-26 07:19:29,545][123091] Updated weights for policy 0, policy_version 968587 (0.0005) [2023-12-26 07:19:29,851][123090] Updated weights for policy 1, policy_version 961673 (0.0009) [2023-12-26 07:19:29,917][123090] Updated weights for policy 1, policy_version 961683 (0.0009) [2023-12-26 07:19:29,986][123090] Updated weights for policy 1, policy_version 961693 (0.0006) [2023-12-26 07:19:30,204][123091] Updated weights for policy 0, policy_version 968597 (0.0005) [2023-12-26 07:19:30,262][123091] Updated weights for policy 0, policy_version 968607 (0.0006) [2023-12-26 07:19:30,316][123091] Updated weights for policy 0, policy_version 968617 (0.0006) [2023-12-26 07:19:30,682][123090] Updated weights for policy 1, policy_version 961703 (0.0009) [2023-12-26 07:19:30,746][123090] Updated weights for policy 1, policy_version 961713 (0.0007) [2023-12-26 07:19:30,800][123090] Updated weights for policy 1, policy_version 961723 (0.0005) [2023-12-26 07:19:31,076][123091] Updated weights for policy 0, policy_version 968627 (0.0007) [2023-12-26 07:19:31,144][123091] Updated weights for policy 0, policy_version 968637 (0.0009) [2023-12-26 07:19:31,220][123091] Updated weights for policy 0, policy_version 968647 (0.0008) [2023-12-26 07:19:31,534][123090] Updated weights for policy 1, policy_version 961733 (0.0005) [2023-12-26 07:19:31,581][123090] Updated weights for policy 1, policy_version 961743 (0.0005) [2023-12-26 07:19:31,646][123090] Updated weights for policy 1, policy_version 961753 (0.0007) [2023-12-26 07:19:32,060][123091] Updated weights for policy 0, policy_version 968657 (0.0008) [2023-12-26 07:19:32,135][123091] Updated weights for policy 0, policy_version 968667 (0.0006) [2023-12-26 07:19:32,195][123091] Updated weights for policy 0, policy_version 968677 (0.0005) [2023-12-26 07:19:32,248][123091] Updated weights for policy 0, policy_version 968687 (0.0006) [2023-12-26 07:19:32,333][123090] Updated weights for policy 1, policy_version 961763 (0.0005) [2023-12-26 07:19:32,395][123090] Updated weights for policy 1, policy_version 961773 (0.0009) [2023-12-26 07:19:32,449][123090] Updated weights for policy 1, policy_version 961783 (0.0008) [2023-12-26 07:19:32,996][123091] Updated weights for policy 0, policy_version 968697 (0.0008) [2023-12-26 07:19:33,048][123091] Updated weights for policy 0, policy_version 968707 (0.0005) [2023-12-26 07:19:33,110][123091] Updated weights for policy 0, policy_version 968717 (0.0005) [2023-12-26 07:19:33,115][123090] Updated weights for policy 1, policy_version 961793 (0.0006) [2023-12-26 07:19:33,175][123090] Updated weights for policy 1, policy_version 961804 (0.0010) [2023-12-26 07:19:33,229][123090] Updated weights for policy 1, policy_version 961815 (0.0010) [2023-12-26 07:19:33,686][123091] Updated weights for policy 0, policy_version 968727 (0.0005) [2023-12-26 07:19:33,732][123091] Updated weights for policy 0, policy_version 968737 (0.0005) [2023-12-26 07:19:33,781][123091] Updated weights for policy 0, policy_version 968747 (0.0005) [2023-12-26 07:19:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 494223360. Throughput: 0: 9068.2, 1: 8746.1. Samples: 494239032. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:33,785][121949] Avg episode reward: [(0, '6016.055'), (1, '5503.176')] [2023-12-26 07:19:33,969][123090] Updated weights for policy 1, policy_version 961826 (0.0009) [2023-12-26 07:19:34,025][123090] Updated weights for policy 1, policy_version 961836 (0.0005) [2023-12-26 07:19:34,081][123090] Updated weights for policy 1, policy_version 961846 (0.0005) [2023-12-26 07:19:34,141][123090] Updated weights for policy 1, policy_version 961856 (0.0006) [2023-12-26 07:19:34,488][123091] Updated weights for policy 0, policy_version 968757 (0.0007) [2023-12-26 07:19:34,537][123091] Updated weights for policy 0, policy_version 968767 (0.0006) [2023-12-26 07:19:34,596][123091] Updated weights for policy 0, policy_version 968777 (0.0005) [2023-12-26 07:19:34,846][123090] Updated weights for policy 1, policy_version 961866 (0.0005) [2023-12-26 07:19:34,921][123090] Updated weights for policy 1, policy_version 961876 (0.0005) [2023-12-26 07:19:34,991][123090] Updated weights for policy 1, policy_version 961886 (0.0006) [2023-12-26 07:19:35,401][123091] Updated weights for policy 0, policy_version 968787 (0.0007) [2023-12-26 07:19:35,448][123091] Updated weights for policy 0, policy_version 968797 (0.0010) [2023-12-26 07:19:35,495][123091] Updated weights for policy 0, policy_version 968807 (0.0010) [2023-12-26 07:19:35,633][123090] Updated weights for policy 1, policy_version 961896 (0.0005) [2023-12-26 07:19:35,687][123090] Updated weights for policy 1, policy_version 961906 (0.0005) [2023-12-26 07:19:35,746][123090] Updated weights for policy 1, policy_version 961916 (0.0005) [2023-12-26 07:19:36,357][123091] Updated weights for policy 0, policy_version 968817 (0.0010) [2023-12-26 07:19:36,417][123091] Updated weights for policy 0, policy_version 968827 (0.0011) [2023-12-26 07:19:36,437][123090] Updated weights for policy 1, policy_version 961926 (0.0009) [2023-12-26 07:19:36,469][123091] Updated weights for policy 0, policy_version 968837 (0.0010) [2023-12-26 07:19:36,501][123090] Updated weights for policy 1, policy_version 961936 (0.0011) [2023-12-26 07:19:36,522][123091] Updated weights for policy 0, policy_version 968847 (0.0011) [2023-12-26 07:19:36,565][123090] Updated weights for policy 1, policy_version 961946 (0.0011) [2023-12-26 07:19:37,389][123090] Updated weights for policy 1, policy_version 961956 (0.0008) [2023-12-26 07:19:37,396][123091] Updated weights for policy 0, policy_version 968857 (0.0011) [2023-12-26 07:19:37,463][123091] Updated weights for policy 0, policy_version 968867 (0.0011) [2023-12-26 07:19:37,464][123090] Updated weights for policy 1, policy_version 961966 (0.0006) [2023-12-26 07:19:37,520][123091] Updated weights for policy 0, policy_version 968877 (0.0011) [2023-12-26 07:19:37,530][123090] Updated weights for policy 1, policy_version 961976 (0.0006) [2023-12-26 07:19:38,241][123090] Updated weights for policy 1, policy_version 961986 (0.0006) [2023-12-26 07:19:38,294][123090] Updated weights for policy 1, policy_version 961996 (0.0010) [2023-12-26 07:19:38,332][123091] Updated weights for policy 0, policy_version 968887 (0.0011) [2023-12-26 07:19:38,362][123090] Updated weights for policy 1, policy_version 962006 (0.0011) [2023-12-26 07:19:38,399][123091] Updated weights for policy 0, policy_version 968897 (0.0010) [2023-12-26 07:19:38,422][123090] Updated weights for policy 1, policy_version 962016 (0.0010) [2023-12-26 07:19:38,465][123091] Updated weights for policy 0, policy_version 968907 (0.0011) [2023-12-26 07:19:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 494321664. Throughput: 0: 9105.0, 1: 8823.0. Samples: 494296832. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:38,785][121949] Avg episode reward: [(0, '6065.556'), (1, '5581.772')] [2023-12-26 07:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000968912_248045568.pth... [2023-12-26 07:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000962016_246276096.pth... [2023-12-26 07:19:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000967856_247775232.pth [2023-12-26 07:19:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000960960_246005760.pth [2023-12-26 07:19:39,219][123090] Updated weights for policy 1, policy_version 962026 (0.0007) [2023-12-26 07:19:39,260][123091] Updated weights for policy 0, policy_version 968917 (0.0013) [2023-12-26 07:19:39,286][123090] Updated weights for policy 1, policy_version 962036 (0.0011) [2023-12-26 07:19:39,318][123091] Updated weights for policy 0, policy_version 968927 (0.0011) [2023-12-26 07:19:39,354][123090] Updated weights for policy 1, policy_version 962047 (0.0008) [2023-12-26 07:19:39,384][123091] Updated weights for policy 0, policy_version 968937 (0.0010) [2023-12-26 07:19:40,179][123090] Updated weights for policy 1, policy_version 962057 (0.0009) [2023-12-26 07:19:40,224][123091] Updated weights for policy 0, policy_version 968947 (0.0011) [2023-12-26 07:19:40,239][123090] Updated weights for policy 1, policy_version 962067 (0.0010) [2023-12-26 07:19:40,276][123091] Updated weights for policy 0, policy_version 968957 (0.0010) [2023-12-26 07:19:40,288][123090] Updated weights for policy 1, policy_version 962077 (0.0006) [2023-12-26 07:19:40,335][123091] Updated weights for policy 0, policy_version 968967 (0.0010) [2023-12-26 07:19:41,099][123091] Updated weights for policy 0, policy_version 968977 (0.0011) [2023-12-26 07:19:41,181][123091] Updated weights for policy 0, policy_version 968987 (0.0010) [2023-12-26 07:19:41,217][123090] Updated weights for policy 1, policy_version 962087 (0.0008) [2023-12-26 07:19:41,241][123091] Updated weights for policy 0, policy_version 968997 (0.0011) [2023-12-26 07:19:41,284][123090] Updated weights for policy 1, policy_version 962097 (0.0009) [2023-12-26 07:19:41,299][123091] Updated weights for policy 0, policy_version 969007 (0.0011) [2023-12-26 07:19:41,354][123090] Updated weights for policy 1, policy_version 962107 (0.0008) [2023-12-26 07:19:42,137][123090] Updated weights for policy 1, policy_version 962117 (0.0006) [2023-12-26 07:19:42,196][123091] Updated weights for policy 0, policy_version 969017 (0.0011) [2023-12-26 07:19:42,198][123090] Updated weights for policy 1, policy_version 962127 (0.0009) [2023-12-26 07:19:42,256][123091] Updated weights for policy 0, policy_version 969027 (0.0011) [2023-12-26 07:19:42,263][123090] Updated weights for policy 1, policy_version 962137 (0.0007) [2023-12-26 07:19:42,322][123091] Updated weights for policy 0, policy_version 969037 (0.0011) [2023-12-26 07:19:42,990][123091] Updated weights for policy 0, policy_version 969047 (0.0007) [2023-12-26 07:19:43,037][123091] Updated weights for policy 0, policy_version 969057 (0.0005) [2023-12-26 07:19:43,089][123091] Updated weights for policy 0, policy_version 969067 (0.0007) [2023-12-26 07:19:43,148][123090] Updated weights for policy 1, policy_version 962147 (0.0008) [2023-12-26 07:19:43,207][123090] Updated weights for policy 1, policy_version 962157 (0.0009) [2023-12-26 07:19:43,272][123090] Updated weights for policy 1, policy_version 962167 (0.0009) [2023-12-26 07:19:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 494403584. Throughput: 0: 9020.7, 1: 8811.1. Samples: 494399836. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:43,784][121949] Avg episode reward: [(0, '5982.158'), (1, '5614.770')] [2023-12-26 07:19:43,835][123091] Updated weights for policy 0, policy_version 969077 (0.0007) [2023-12-26 07:19:43,898][123091] Updated weights for policy 0, policy_version 969087 (0.0009) [2023-12-26 07:19:43,961][123091] Updated weights for policy 0, policy_version 969097 (0.0010) [2023-12-26 07:19:44,133][123090] Updated weights for policy 1, policy_version 962177 (0.0009) [2023-12-26 07:19:44,189][123090] Updated weights for policy 1, policy_version 962187 (0.0009) [2023-12-26 07:19:44,245][123090] Updated weights for policy 1, policy_version 962197 (0.0010) [2023-12-26 07:19:44,302][123090] Updated weights for policy 1, policy_version 962207 (0.0010) [2023-12-26 07:19:44,759][123091] Updated weights for policy 0, policy_version 969107 (0.0009) [2023-12-26 07:19:44,822][123091] Updated weights for policy 0, policy_version 969117 (0.0007) [2023-12-26 07:19:44,877][123091] Updated weights for policy 0, policy_version 969127 (0.0008) [2023-12-26 07:19:45,122][123090] Updated weights for policy 1, policy_version 962217 (0.0009) [2023-12-26 07:19:45,182][123090] Updated weights for policy 1, policy_version 962227 (0.0009) [2023-12-26 07:19:45,242][123090] Updated weights for policy 1, policy_version 962237 (0.0009) [2023-12-26 07:19:45,633][123091] Updated weights for policy 0, policy_version 969137 (0.0009) [2023-12-26 07:19:45,688][123091] Updated weights for policy 0, policy_version 969147 (0.0006) [2023-12-26 07:19:45,748][123091] Updated weights for policy 0, policy_version 969157 (0.0008) [2023-12-26 07:19:45,813][123091] Updated weights for policy 0, policy_version 969167 (0.0009) [2023-12-26 07:19:46,091][123090] Updated weights for policy 1, policy_version 962247 (0.0009) [2023-12-26 07:19:46,154][123090] Updated weights for policy 1, policy_version 962257 (0.0009) [2023-12-26 07:19:46,202][123090] Updated weights for policy 1, policy_version 962267 (0.0007) [2023-12-26 07:19:46,668][123091] Updated weights for policy 0, policy_version 969177 (0.0009) [2023-12-26 07:19:46,732][123091] Updated weights for policy 0, policy_version 969187 (0.0010) [2023-12-26 07:19:46,781][123091] Updated weights for policy 0, policy_version 969197 (0.0009) [2023-12-26 07:19:46,993][123090] Updated weights for policy 1, policy_version 962277 (0.0008) [2023-12-26 07:19:47,047][123090] Updated weights for policy 1, policy_version 962287 (0.0009) [2023-12-26 07:19:47,104][123090] Updated weights for policy 1, policy_version 962297 (0.0009) [2023-12-26 07:19:47,614][123091] Updated weights for policy 0, policy_version 969207 (0.0008) [2023-12-26 07:19:47,672][123091] Updated weights for policy 0, policy_version 969217 (0.0008) [2023-12-26 07:19:47,724][123091] Updated weights for policy 0, policy_version 969227 (0.0010) [2023-12-26 07:19:47,968][123090] Updated weights for policy 1, policy_version 962307 (0.0009) [2023-12-26 07:19:48,027][123090] Updated weights for policy 1, policy_version 962317 (0.0009) [2023-12-26 07:19:48,097][123090] Updated weights for policy 1, policy_version 962327 (0.0010) [2023-12-26 07:19:48,458][123091] Updated weights for policy 0, policy_version 969237 (0.0009) [2023-12-26 07:19:48,531][123091] Updated weights for policy 0, policy_version 969247 (0.0008) [2023-12-26 07:19:48,596][123091] Updated weights for policy 0, policy_version 969257 (0.0008) [2023-12-26 07:19:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 494493696. Throughput: 0: 9032.9, 1: 8834.1. Samples: 494504848. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:48,786][121949] Avg episode reward: [(0, '5954.236'), (1, '5449.943')] [2023-12-26 07:19:49,028][123090] Updated weights for policy 1, policy_version 962337 (0.0010) [2023-12-26 07:19:49,097][123090] Updated weights for policy 1, policy_version 962347 (0.0009) [2023-12-26 07:19:49,170][123090] Updated weights for policy 1, policy_version 962357 (0.0010) [2023-12-26 07:19:49,247][123090] Updated weights for policy 1, policy_version 962367 (0.0010) [2023-12-26 07:19:49,288][123091] Updated weights for policy 0, policy_version 969267 (0.0009) [2023-12-26 07:19:49,358][123091] Updated weights for policy 0, policy_version 969277 (0.0010) [2023-12-26 07:19:49,421][123091] Updated weights for policy 0, policy_version 969287 (0.0011) [2023-12-26 07:19:50,076][123090] Updated weights for policy 1, policy_version 962377 (0.0011) [2023-12-26 07:19:50,131][123090] Updated weights for policy 1, policy_version 962387 (0.0008) [2023-12-26 07:19:50,192][123090] Updated weights for policy 1, policy_version 962397 (0.0009) [2023-12-26 07:19:50,264][123091] Updated weights for policy 0, policy_version 969297 (0.0011) [2023-12-26 07:19:50,327][123091] Updated weights for policy 0, policy_version 969307 (0.0011) [2023-12-26 07:19:50,386][123091] Updated weights for policy 0, policy_version 969317 (0.0011) [2023-12-26 07:19:50,453][123091] Updated weights for policy 0, policy_version 969327 (0.0011) [2023-12-26 07:19:51,020][123090] Updated weights for policy 1, policy_version 962407 (0.0009) [2023-12-26 07:19:51,094][123090] Updated weights for policy 1, policy_version 962417 (0.0008) [2023-12-26 07:19:51,160][123090] Updated weights for policy 1, policy_version 962427 (0.0009) [2023-12-26 07:19:51,290][123091] Updated weights for policy 0, policy_version 969337 (0.0013) [2023-12-26 07:19:51,351][123091] Updated weights for policy 0, policy_version 969347 (0.0012) [2023-12-26 07:19:51,414][123091] Updated weights for policy 0, policy_version 969357 (0.0010) [2023-12-26 07:19:51,996][123090] Updated weights for policy 1, policy_version 962437 (0.0009) [2023-12-26 07:19:52,048][123090] Updated weights for policy 1, policy_version 962447 (0.0006) [2023-12-26 07:19:52,119][123090] Updated weights for policy 1, policy_version 962457 (0.0007) [2023-12-26 07:19:52,147][123091] Updated weights for policy 0, policy_version 969367 (0.0007) [2023-12-26 07:19:52,210][123091] Updated weights for policy 0, policy_version 969377 (0.0006) [2023-12-26 07:19:52,278][123091] Updated weights for policy 0, policy_version 969387 (0.0007) [2023-12-26 07:19:52,819][123090] Updated weights for policy 1, policy_version 962467 (0.0006) [2023-12-26 07:19:52,894][123090] Updated weights for policy 1, policy_version 962477 (0.0005) [2023-12-26 07:19:52,955][123090] Updated weights for policy 1, policy_version 962487 (0.0005) [2023-12-26 07:19:53,055][123091] Updated weights for policy 0, policy_version 969397 (0.0009) [2023-12-26 07:19:53,124][123091] Updated weights for policy 0, policy_version 969407 (0.0009) [2023-12-26 07:19:53,199][123091] Updated weights for policy 0, policy_version 969417 (0.0009) [2023-12-26 07:19:53,574][123090] Updated weights for policy 1, policy_version 962497 (0.0006) [2023-12-26 07:19:53,638][123090] Updated weights for policy 1, policy_version 962507 (0.0009) [2023-12-26 07:19:53,699][123090] Updated weights for policy 1, policy_version 962517 (0.0006) [2023-12-26 07:19:53,757][123090] Updated weights for policy 1, policy_version 962527 (0.0005) [2023-12-26 07:19:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 494583808. Throughput: 0: 9041.3, 1: 8799.8. Samples: 494555736. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:53,785][121949] Avg episode reward: [(0, '6055.375'), (1, '5390.328')] [2023-12-26 07:19:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000969424_248176640.pth... [2023-12-26 07:19:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000962528_246407168.pth... [2023-12-26 07:19:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000961472_246136832.pth [2023-12-26 07:19:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000968368_247906304.pth [2023-12-26 07:19:54,061][123091] Updated weights for policy 0, policy_version 969427 (0.0009) [2023-12-26 07:19:54,122][123091] Updated weights for policy 0, policy_version 969437 (0.0009) [2023-12-26 07:19:54,187][123091] Updated weights for policy 0, policy_version 969447 (0.0009) [2023-12-26 07:19:54,434][123090] Updated weights for policy 1, policy_version 962537 (0.0005) [2023-12-26 07:19:54,489][123090] Updated weights for policy 1, policy_version 962547 (0.0005) [2023-12-26 07:19:54,561][123090] Updated weights for policy 1, policy_version 962557 (0.0005) [2023-12-26 07:19:54,894][123091] Updated weights for policy 0, policy_version 969457 (0.0009) [2023-12-26 07:19:54,946][123091] Updated weights for policy 0, policy_version 969467 (0.0009) [2023-12-26 07:19:54,998][123091] Updated weights for policy 0, policy_version 969477 (0.0009) [2023-12-26 07:19:55,058][123091] Updated weights for policy 0, policy_version 969487 (0.0009) [2023-12-26 07:19:55,344][123090] Updated weights for policy 1, policy_version 962567 (0.0009) [2023-12-26 07:19:55,407][123090] Updated weights for policy 1, policy_version 962577 (0.0010) [2023-12-26 07:19:55,470][123090] Updated weights for policy 1, policy_version 962587 (0.0010) [2023-12-26 07:19:55,787][123091] Updated weights for policy 0, policy_version 969497 (0.0006) [2023-12-26 07:19:55,831][123091] Updated weights for policy 0, policy_version 969507 (0.0005) [2023-12-26 07:19:55,877][123091] Updated weights for policy 0, policy_version 969517 (0.0005) [2023-12-26 07:19:56,283][123090] Updated weights for policy 1, policy_version 962597 (0.0010) [2023-12-26 07:19:56,334][123090] Updated weights for policy 1, policy_version 962607 (0.0010) [2023-12-26 07:19:56,385][123090] Updated weights for policy 1, policy_version 962617 (0.0010) [2023-12-26 07:19:56,684][123091] Updated weights for policy 0, policy_version 969527 (0.0005) [2023-12-26 07:19:56,740][123091] Updated weights for policy 0, policy_version 969537 (0.0009) [2023-12-26 07:19:56,801][123091] Updated weights for policy 0, policy_version 969547 (0.0005) [2023-12-26 07:19:57,224][123090] Updated weights for policy 1, policy_version 962627 (0.0010) [2023-12-26 07:19:57,275][123090] Updated weights for policy 1, policy_version 962637 (0.0010) [2023-12-26 07:19:57,338][123090] Updated weights for policy 1, policy_version 962647 (0.0010) [2023-12-26 07:19:57,571][123091] Updated weights for policy 0, policy_version 969557 (0.0008) [2023-12-26 07:19:57,619][123091] Updated weights for policy 0, policy_version 969567 (0.0010) [2023-12-26 07:19:57,688][123091] Updated weights for policy 0, policy_version 969577 (0.0010) [2023-12-26 07:19:58,152][123090] Updated weights for policy 1, policy_version 962657 (0.0009) [2023-12-26 07:19:58,226][123090] Updated weights for policy 1, policy_version 962667 (0.0011) [2023-12-26 07:19:58,292][123090] Updated weights for policy 1, policy_version 962677 (0.0011) [2023-12-26 07:19:58,369][123090] Updated weights for policy 1, policy_version 962687 (0.0010) [2023-12-26 07:19:58,552][123091] Updated weights for policy 0, policy_version 969587 (0.0009) [2023-12-26 07:19:58,625][123091] Updated weights for policy 0, policy_version 969597 (0.0007) [2023-12-26 07:19:58,692][123091] Updated weights for policy 0, policy_version 969607 (0.0007) [2023-12-26 07:19:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 494673920. Throughput: 0: 8988.4, 1: 8968.9. Samples: 494665660. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:19:58,784][121949] Avg episode reward: [(0, '6113.375'), (1, '5377.151')] [2023-12-26 07:19:59,272][123090] Updated weights for policy 1, policy_version 962697 (0.0010) [2023-12-26 07:19:59,334][123090] Updated weights for policy 1, policy_version 962707 (0.0009) [2023-12-26 07:19:59,399][123090] Updated weights for policy 1, policy_version 962717 (0.0009) [2023-12-26 07:19:59,462][123091] Updated weights for policy 0, policy_version 969617 (0.0008) [2023-12-26 07:19:59,519][123091] Updated weights for policy 0, policy_version 969627 (0.0008) [2023-12-26 07:19:59,574][123091] Updated weights for policy 0, policy_version 969637 (0.0007) [2023-12-26 07:19:59,630][123091] Updated weights for policy 0, policy_version 969647 (0.0007) [2023-12-26 07:20:00,242][123090] Updated weights for policy 1, policy_version 962727 (0.0009) [2023-12-26 07:20:00,301][123090] Updated weights for policy 1, policy_version 962737 (0.0009) [2023-12-26 07:20:00,352][123090] Updated weights for policy 1, policy_version 962747 (0.0009) [2023-12-26 07:20:00,399][123091] Updated weights for policy 0, policy_version 969657 (0.0006) [2023-12-26 07:20:00,453][123091] Updated weights for policy 0, policy_version 969667 (0.0005) [2023-12-26 07:20:00,500][123091] Updated weights for policy 0, policy_version 969677 (0.0005) [2023-12-26 07:20:01,172][123091] Updated weights for policy 0, policy_version 969687 (0.0007) [2023-12-26 07:20:01,240][123091] Updated weights for policy 0, policy_version 969697 (0.0006) [2023-12-26 07:20:01,292][123090] Updated weights for policy 1, policy_version 962757 (0.0009) [2023-12-26 07:20:01,308][123091] Updated weights for policy 0, policy_version 969707 (0.0008) [2023-12-26 07:20:01,354][123090] Updated weights for policy 1, policy_version 962767 (0.0010) [2023-12-26 07:20:01,424][123090] Updated weights for policy 1, policy_version 962777 (0.0007) [2023-12-26 07:20:02,118][123091] Updated weights for policy 0, policy_version 969717 (0.0008) [2023-12-26 07:20:02,174][123091] Updated weights for policy 0, policy_version 969727 (0.0009) [2023-12-26 07:20:02,233][123091] Updated weights for policy 0, policy_version 969737 (0.0010) [2023-12-26 07:20:02,248][123090] Updated weights for policy 1, policy_version 962787 (0.0008) [2023-12-26 07:20:02,314][123090] Updated weights for policy 1, policy_version 962797 (0.0007) [2023-12-26 07:20:02,376][123090] Updated weights for policy 1, policy_version 962807 (0.0008) [2023-12-26 07:20:02,983][123091] Updated weights for policy 0, policy_version 969747 (0.0006) [2023-12-26 07:20:03,038][123091] Updated weights for policy 0, policy_version 969757 (0.0009) [2023-12-26 07:20:03,087][123091] Updated weights for policy 0, policy_version 969767 (0.0009) [2023-12-26 07:20:03,212][123090] Updated weights for policy 1, policy_version 962817 (0.0009) [2023-12-26 07:20:03,260][123090] Updated weights for policy 1, policy_version 962827 (0.0009) [2023-12-26 07:20:03,308][123090] Updated weights for policy 1, policy_version 962837 (0.0009) [2023-12-26 07:20:03,361][123090] Updated weights for policy 1, policy_version 962847 (0.0009) [2023-12-26 07:20:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 494755840. Throughput: 0: 8910.0, 1: 8819.4. Samples: 494768980. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:03,785][121949] Avg episode reward: [(0, '6091.974'), (1, '5535.906')] [2023-12-26 07:20:03,900][123091] Updated weights for policy 0, policy_version 969777 (0.0008) [2023-12-26 07:20:03,970][123091] Updated weights for policy 0, policy_version 969787 (0.0007) [2023-12-26 07:20:04,036][123091] Updated weights for policy 0, policy_version 969797 (0.0009) [2023-12-26 07:20:04,098][123091] Updated weights for policy 0, policy_version 969807 (0.0009) [2023-12-26 07:20:04,255][123090] Updated weights for policy 1, policy_version 962857 (0.0009) [2023-12-26 07:20:04,314][123090] Updated weights for policy 1, policy_version 962867 (0.0009) [2023-12-26 07:20:04,367][123090] Updated weights for policy 1, policy_version 962877 (0.0009) [2023-12-26 07:20:04,885][123091] Updated weights for policy 0, policy_version 969817 (0.0010) [2023-12-26 07:20:04,944][123091] Updated weights for policy 0, policy_version 969827 (0.0009) [2023-12-26 07:20:05,010][123091] Updated weights for policy 0, policy_version 969837 (0.0009) [2023-12-26 07:20:05,146][123090] Updated weights for policy 1, policy_version 962887 (0.0006) [2023-12-26 07:20:05,210][123090] Updated weights for policy 1, policy_version 962897 (0.0005) [2023-12-26 07:20:05,275][123090] Updated weights for policy 1, policy_version 962907 (0.0005) [2023-12-26 07:20:05,866][123091] Updated weights for policy 0, policy_version 969847 (0.0011) [2023-12-26 07:20:05,919][123091] Updated weights for policy 0, policy_version 969857 (0.0010) [2023-12-26 07:20:05,974][123091] Updated weights for policy 0, policy_version 969867 (0.0010) [2023-12-26 07:20:06,038][123090] Updated weights for policy 1, policy_version 962917 (0.0007) [2023-12-26 07:20:06,091][123090] Updated weights for policy 1, policy_version 962927 (0.0009) [2023-12-26 07:20:06,158][123090] Updated weights for policy 1, policy_version 962937 (0.0010) [2023-12-26 07:20:06,775][123091] Updated weights for policy 0, policy_version 969877 (0.0010) [2023-12-26 07:20:06,844][123091] Updated weights for policy 0, policy_version 969887 (0.0008) [2023-12-26 07:20:06,910][123091] Updated weights for policy 0, policy_version 969897 (0.0008) [2023-12-26 07:20:07,013][123090] Updated weights for policy 1, policy_version 962947 (0.0011) [2023-12-26 07:20:07,064][123090] Updated weights for policy 1, policy_version 962957 (0.0008) [2023-12-26 07:20:07,132][123090] Updated weights for policy 1, policy_version 962967 (0.0005) [2023-12-26 07:20:07,673][123091] Updated weights for policy 0, policy_version 969907 (0.0008) [2023-12-26 07:20:07,732][123091] Updated weights for policy 0, policy_version 969917 (0.0010) [2023-12-26 07:20:07,791][123091] Updated weights for policy 0, policy_version 969927 (0.0010) [2023-12-26 07:20:07,800][123090] Updated weights for policy 1, policy_version 962977 (0.0005) [2023-12-26 07:20:07,851][123090] Updated weights for policy 1, policy_version 962987 (0.0005) [2023-12-26 07:20:07,899][123090] Updated weights for policy 1, policy_version 962997 (0.0005) [2023-12-26 07:20:07,943][123090] Updated weights for policy 1, policy_version 963007 (0.0005) [2023-12-26 07:20:08,681][123091] Updated weights for policy 0, policy_version 969937 (0.0009) [2023-12-26 07:20:08,732][123090] Updated weights for policy 1, policy_version 963017 (0.0006) [2023-12-26 07:20:08,747][123091] Updated weights for policy 0, policy_version 969947 (0.0010) [2023-12-26 07:20:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 494837760. Throughput: 0: 8949.3, 1: 8825.6. Samples: 494821184. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:08,784][121949] Avg episode reward: [(0, '6012.612'), (1, '5612.208')] [2023-12-26 07:20:08,795][123090] Updated weights for policy 1, policy_version 963027 (0.0009) [2023-12-26 07:20:08,808][123091] Updated weights for policy 0, policy_version 969957 (0.0009) [2023-12-26 07:20:08,854][123090] Updated weights for policy 1, policy_version 963037 (0.0010) [2023-12-26 07:20:08,868][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000963040_246538240.pth... [2023-12-26 07:20:08,871][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000962016_246276096.pth [2023-12-26 07:20:08,875][123091] Updated weights for policy 0, policy_version 969967 (0.0006) [2023-12-26 07:20:08,880][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000969968_248315904.pth... [2023-12-26 07:20:08,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000968912_248045568.pth [2023-12-26 07:20:09,721][123090] Updated weights for policy 1, policy_version 963047 (0.0008) [2023-12-26 07:20:09,723][123091] Updated weights for policy 0, policy_version 969977 (0.0009) [2023-12-26 07:20:09,788][123090] Updated weights for policy 1, policy_version 963057 (0.0009) [2023-12-26 07:20:09,791][123091] Updated weights for policy 0, policy_version 969987 (0.0008) [2023-12-26 07:20:09,858][123090] Updated weights for policy 1, policy_version 963067 (0.0009) [2023-12-26 07:20:09,860][123091] Updated weights for policy 0, policy_version 969997 (0.0009) [2023-12-26 07:20:10,672][123090] Updated weights for policy 1, policy_version 963077 (0.0007) [2023-12-26 07:20:10,704][123091] Updated weights for policy 0, policy_version 970007 (0.0008) [2023-12-26 07:20:10,728][123090] Updated weights for policy 1, policy_version 963087 (0.0010) [2023-12-26 07:20:10,769][123091] Updated weights for policy 0, policy_version 970017 (0.0008) [2023-12-26 07:20:10,792][123090] Updated weights for policy 1, policy_version 963097 (0.0011) [2023-12-26 07:20:10,829][123091] Updated weights for policy 0, policy_version 970027 (0.0006) [2023-12-26 07:20:11,519][123090] Updated weights for policy 1, policy_version 963107 (0.0010) [2023-12-26 07:20:11,577][123090] Updated weights for policy 1, policy_version 963117 (0.0009) [2023-12-26 07:20:11,636][123090] Updated weights for policy 1, policy_version 963127 (0.0009) [2023-12-26 07:20:11,696][123091] Updated weights for policy 0, policy_version 970037 (0.0010) [2023-12-26 07:20:11,771][123091] Updated weights for policy 0, policy_version 970047 (0.0010) [2023-12-26 07:20:11,839][123091] Updated weights for policy 0, policy_version 970057 (0.0011) [2023-12-26 07:20:12,516][123090] Updated weights for policy 1, policy_version 963137 (0.0009) [2023-12-26 07:20:12,571][123090] Updated weights for policy 1, policy_version 963147 (0.0010) [2023-12-26 07:20:12,626][123090] Updated weights for policy 1, policy_version 963157 (0.0010) [2023-12-26 07:20:12,644][123091] Updated weights for policy 0, policy_version 970067 (0.0011) [2023-12-26 07:20:12,684][123090] Updated weights for policy 1, policy_version 963167 (0.0007) [2023-12-26 07:20:12,708][123091] Updated weights for policy 0, policy_version 970077 (0.0007) [2023-12-26 07:20:12,771][123091] Updated weights for policy 0, policy_version 970087 (0.0006) [2023-12-26 07:20:13,521][123091] Updated weights for policy 0, policy_version 970097 (0.0007) [2023-12-26 07:20:13,574][123091] Updated weights for policy 0, policy_version 970107 (0.0010) [2023-12-26 07:20:13,606][123090] Updated weights for policy 1, policy_version 963177 (0.0009) [2023-12-26 07:20:13,629][123091] Updated weights for policy 0, policy_version 970117 (0.0010) [2023-12-26 07:20:13,666][123090] Updated weights for policy 1, policy_version 963187 (0.0007) [2023-12-26 07:20:13,691][123091] Updated weights for policy 0, policy_version 970127 (0.0011) [2023-12-26 07:20:13,734][123090] Updated weights for policy 1, policy_version 963197 (0.0009) [2023-12-26 07:20:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 494936064. Throughput: 0: 8895.7, 1: 8836.2. Samples: 494924252. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:13,785][121949] Avg episode reward: [(0, '6047.629'), (1, '5678.453')] [2023-12-26 07:20:14,451][123091] Updated weights for policy 0, policy_version 970137 (0.0010) [2023-12-26 07:20:14,515][123091] Updated weights for policy 0, policy_version 970147 (0.0009) [2023-12-26 07:20:14,562][123091] Updated weights for policy 0, policy_version 970157 (0.0009) [2023-12-26 07:20:14,596][123090] Updated weights for policy 1, policy_version 963207 (0.0009) [2023-12-26 07:20:14,650][123090] Updated weights for policy 1, policy_version 963218 (0.0010) [2023-12-26 07:20:14,705][123090] Updated weights for policy 1, policy_version 963230 (0.0010) [2023-12-26 07:20:15,283][123091] Updated weights for policy 0, policy_version 970167 (0.0009) [2023-12-26 07:20:15,350][123091] Updated weights for policy 0, policy_version 970177 (0.0010) [2023-12-26 07:20:15,411][123091] Updated weights for policy 0, policy_version 970187 (0.0009) [2023-12-26 07:20:15,597][123090] Updated weights for policy 1, policy_version 963241 (0.0010) [2023-12-26 07:20:15,648][123090] Updated weights for policy 1, policy_version 963251 (0.0009) [2023-12-26 07:20:15,701][123090] Updated weights for policy 1, policy_version 963261 (0.0009) [2023-12-26 07:20:16,215][123091] Updated weights for policy 0, policy_version 970197 (0.0010) [2023-12-26 07:20:16,293][123091] Updated weights for policy 0, policy_version 970207 (0.0010) [2023-12-26 07:20:16,356][123091] Updated weights for policy 0, policy_version 970217 (0.0009) [2023-12-26 07:20:16,521][123090] Updated weights for policy 1, policy_version 963271 (0.0010) [2023-12-26 07:20:16,584][123090] Updated weights for policy 1, policy_version 963281 (0.0010) [2023-12-26 07:20:16,644][123090] Updated weights for policy 1, policy_version 963291 (0.0010) [2023-12-26 07:20:17,170][123091] Updated weights for policy 0, policy_version 970227 (0.0010) [2023-12-26 07:20:17,233][123091] Updated weights for policy 0, policy_version 970237 (0.0008) [2023-12-26 07:20:17,296][123091] Updated weights for policy 0, policy_version 970247 (0.0009) [2023-12-26 07:20:17,494][123090] Updated weights for policy 1, policy_version 963301 (0.0010) [2023-12-26 07:20:17,546][123090] Updated weights for policy 1, policy_version 963311 (0.0009) [2023-12-26 07:20:17,598][123090] Updated weights for policy 1, policy_version 963321 (0.0009) [2023-12-26 07:20:18,128][123091] Updated weights for policy 0, policy_version 970257 (0.0009) [2023-12-26 07:20:18,201][123091] Updated weights for policy 0, policy_version 970267 (0.0010) [2023-12-26 07:20:18,267][123091] Updated weights for policy 0, policy_version 970277 (0.0010) [2023-12-26 07:20:18,336][123091] Updated weights for policy 0, policy_version 970287 (0.0009) [2023-12-26 07:20:18,452][123090] Updated weights for policy 1, policy_version 963331 (0.0010) [2023-12-26 07:20:18,516][123090] Updated weights for policy 1, policy_version 963341 (0.0010) [2023-12-26 07:20:18,571][123090] Updated weights for policy 1, policy_version 963351 (0.0009) [2023-12-26 07:20:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 495017984. Throughput: 0: 8839.8, 1: 8658.8. Samples: 495026472. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:18,785][121949] Avg episode reward: [(0, '6100.982'), (1, '5779.794')] [2023-12-26 07:20:19,158][123091] Updated weights for policy 0, policy_version 970297 (0.0010) [2023-12-26 07:20:19,220][123091] Updated weights for policy 0, policy_version 970307 (0.0009) [2023-12-26 07:20:19,278][123091] Updated weights for policy 0, policy_version 970317 (0.0010) [2023-12-26 07:20:19,436][123090] Updated weights for policy 1, policy_version 963361 (0.0009) [2023-12-26 07:20:19,506][123090] Updated weights for policy 1, policy_version 963371 (0.0008) [2023-12-26 07:20:19,578][123090] Updated weights for policy 1, policy_version 963381 (0.0010) [2023-12-26 07:20:19,646][123090] Updated weights for policy 1, policy_version 963391 (0.0011) [2023-12-26 07:20:20,125][123091] Updated weights for policy 0, policy_version 970327 (0.0009) [2023-12-26 07:20:20,192][123091] Updated weights for policy 0, policy_version 970337 (0.0009) [2023-12-26 07:20:20,254][123091] Updated weights for policy 0, policy_version 970347 (0.0010) [2023-12-26 07:20:20,405][123090] Updated weights for policy 1, policy_version 963401 (0.0009) [2023-12-26 07:20:20,462][123090] Updated weights for policy 1, policy_version 963411 (0.0009) [2023-12-26 07:20:20,522][123090] Updated weights for policy 1, policy_version 963421 (0.0009) [2023-12-26 07:20:21,165][123091] Updated weights for policy 0, policy_version 970357 (0.0010) [2023-12-26 07:20:21,233][123091] Updated weights for policy 0, policy_version 970367 (0.0009) [2023-12-26 07:20:21,300][123091] Updated weights for policy 0, policy_version 970377 (0.0011) [2023-12-26 07:20:21,334][123090] Updated weights for policy 1, policy_version 963431 (0.0008) [2023-12-26 07:20:21,413][123090] Updated weights for policy 1, policy_version 963441 (0.0008) [2023-12-26 07:20:21,480][123090] Updated weights for policy 1, policy_version 963451 (0.0008) [2023-12-26 07:20:22,200][123091] Updated weights for policy 0, policy_version 970387 (0.0010) [2023-12-26 07:20:22,220][123090] Updated weights for policy 1, policy_version 963461 (0.0007) [2023-12-26 07:20:22,263][123091] Updated weights for policy 0, policy_version 970397 (0.0010) [2023-12-26 07:20:22,279][123090] Updated weights for policy 1, policy_version 963471 (0.0008) [2023-12-26 07:20:22,319][123091] Updated weights for policy 0, policy_version 970407 (0.0007) [2023-12-26 07:20:22,344][123090] Updated weights for policy 1, policy_version 963481 (0.0008) [2023-12-26 07:20:23,062][123090] Updated weights for policy 1, policy_version 963491 (0.0009) [2023-12-26 07:20:23,126][123091] Updated weights for policy 0, policy_version 970417 (0.0008) [2023-12-26 07:20:23,127][123090] Updated weights for policy 1, policy_version 963501 (0.0011) [2023-12-26 07:20:23,184][123090] Updated weights for policy 1, policy_version 963511 (0.0011) [2023-12-26 07:20:23,188][123091] Updated weights for policy 0, policy_version 970427 (0.0007) [2023-12-26 07:20:23,248][123091] Updated weights for policy 0, policy_version 970437 (0.0005) [2023-12-26 07:20:23,301][123091] Updated weights for policy 0, policy_version 970447 (0.0007) [2023-12-26 07:20:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 495099904. Throughput: 0: 8772.0, 1: 8571.0. Samples: 495077268. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:23,786][121949] Avg episode reward: [(0, '6032.321'), (1, '5652.688')] [2023-12-26 07:20:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000970448_248438784.pth... [2023-12-26 07:20:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000963520_246661120.pth... [2023-12-26 07:20:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000969424_248176640.pth [2023-12-26 07:20:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000962528_246407168.pth [2023-12-26 07:20:23,951][123090] Updated weights for policy 1, policy_version 963521 (0.0010) [2023-12-26 07:20:23,990][123091] Updated weights for policy 0, policy_version 970457 (0.0007) [2023-12-26 07:20:24,027][123090] Updated weights for policy 1, policy_version 963531 (0.0005) [2023-12-26 07:20:24,051][123091] Updated weights for policy 0, policy_version 970467 (0.0005) [2023-12-26 07:20:24,080][123090] Updated weights for policy 1, policy_version 963541 (0.0005) [2023-12-26 07:20:24,126][123091] Updated weights for policy 0, policy_version 970477 (0.0006) [2023-12-26 07:20:24,132][123090] Updated weights for policy 1, policy_version 963551 (0.0005) [2023-12-26 07:20:24,820][123090] Updated weights for policy 1, policy_version 963561 (0.0008) [2023-12-26 07:20:24,877][123090] Updated weights for policy 1, policy_version 963571 (0.0009) [2023-12-26 07:20:24,912][123091] Updated weights for policy 0, policy_version 970487 (0.0008) [2023-12-26 07:20:24,939][123090] Updated weights for policy 1, policy_version 963581 (0.0009) [2023-12-26 07:20:24,976][123091] Updated weights for policy 0, policy_version 970497 (0.0005) [2023-12-26 07:20:25,044][123091] Updated weights for policy 0, policy_version 970507 (0.0005) [2023-12-26 07:20:25,735][123090] Updated weights for policy 1, policy_version 963591 (0.0008) [2023-12-26 07:20:25,755][123091] Updated weights for policy 0, policy_version 970517 (0.0008) [2023-12-26 07:20:25,813][123090] Updated weights for policy 1, policy_version 963601 (0.0005) [2023-12-26 07:20:25,824][123091] Updated weights for policy 0, policy_version 970527 (0.0010) [2023-12-26 07:20:25,889][123090] Updated weights for policy 1, policy_version 963611 (0.0005) [2023-12-26 07:20:25,901][123091] Updated weights for policy 0, policy_version 970537 (0.0010) [2023-12-26 07:20:26,577][123090] Updated weights for policy 1, policy_version 963621 (0.0008) [2023-12-26 07:20:26,633][123090] Updated weights for policy 1, policy_version 963631 (0.0010) [2023-12-26 07:20:26,678][123091] Updated weights for policy 0, policy_version 970547 (0.0011) [2023-12-26 07:20:26,683][123090] Updated weights for policy 1, policy_version 963641 (0.0010) [2023-12-26 07:20:26,726][123091] Updated weights for policy 0, policy_version 970557 (0.0010) [2023-12-26 07:20:26,777][123091] Updated weights for policy 0, policy_version 970567 (0.0010) [2023-12-26 07:20:27,387][123090] Updated weights for policy 1, policy_version 963651 (0.0009) [2023-12-26 07:20:27,439][123090] Updated weights for policy 1, policy_version 963661 (0.0005) [2023-12-26 07:20:27,507][123090] Updated weights for policy 1, policy_version 963671 (0.0005) [2023-12-26 07:20:27,619][123091] Updated weights for policy 0, policy_version 970577 (0.0010) [2023-12-26 07:20:27,666][123091] Updated weights for policy 0, policy_version 970587 (0.0010) [2023-12-26 07:20:27,713][123091] Updated weights for policy 0, policy_version 970597 (0.0010) [2023-12-26 07:20:27,771][123091] Updated weights for policy 0, policy_version 970607 (0.0010) [2023-12-26 07:20:28,207][123090] Updated weights for policy 1, policy_version 963681 (0.0009) [2023-12-26 07:20:28,271][123090] Updated weights for policy 1, policy_version 963691 (0.0006) [2023-12-26 07:20:28,340][123090] Updated weights for policy 1, policy_version 963701 (0.0006) [2023-12-26 07:20:28,400][123090] Updated weights for policy 1, policy_version 963711 (0.0009) [2023-12-26 07:20:28,549][123091] Updated weights for policy 0, policy_version 970617 (0.0009) [2023-12-26 07:20:28,600][123091] Updated weights for policy 0, policy_version 970628 (0.0010) [2023-12-26 07:20:28,656][123091] Updated weights for policy 0, policy_version 970638 (0.0009) [2023-12-26 07:20:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 495198208. Throughput: 0: 8813.3, 1: 8703.8. Samples: 495188108. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:28,784][121949] Avg episode reward: [(0, '5922.604'), (1, '5656.334')] [2023-12-26 07:20:29,081][123090] Updated weights for policy 1, policy_version 963721 (0.0013) [2023-12-26 07:20:29,141][123090] Updated weights for policy 1, policy_version 963731 (0.0010) [2023-12-26 07:20:29,210][123090] Updated weights for policy 1, policy_version 963741 (0.0006) [2023-12-26 07:20:29,488][123091] Updated weights for policy 0, policy_version 970648 (0.0009) [2023-12-26 07:20:29,555][123091] Updated weights for policy 0, policy_version 970658 (0.0008) [2023-12-26 07:20:29,622][123091] Updated weights for policy 0, policy_version 970668 (0.0009) [2023-12-26 07:20:30,017][123090] Updated weights for policy 1, policy_version 963751 (0.0007) [2023-12-26 07:20:30,068][123090] Updated weights for policy 1, policy_version 963761 (0.0006) [2023-12-26 07:20:30,123][123090] Updated weights for policy 1, policy_version 963771 (0.0007) [2023-12-26 07:20:30,458][123091] Updated weights for policy 0, policy_version 970678 (0.0010) [2023-12-26 07:20:30,512][123091] Updated weights for policy 0, policy_version 970688 (0.0010) [2023-12-26 07:20:30,566][123091] Updated weights for policy 0, policy_version 970698 (0.0010) [2023-12-26 07:20:30,949][123090] Updated weights for policy 1, policy_version 963781 (0.0010) [2023-12-26 07:20:31,019][123090] Updated weights for policy 1, policy_version 963791 (0.0010) [2023-12-26 07:20:31,088][123090] Updated weights for policy 1, policy_version 963801 (0.0007) [2023-12-26 07:20:31,384][123091] Updated weights for policy 0, policy_version 970708 (0.0010) [2023-12-26 07:20:31,446][123091] Updated weights for policy 0, policy_version 970718 (0.0009) [2023-12-26 07:20:31,499][123091] Updated weights for policy 0, policy_version 970728 (0.0009) [2023-12-26 07:20:31,883][123090] Updated weights for policy 1, policy_version 963811 (0.0008) [2023-12-26 07:20:31,935][123090] Updated weights for policy 1, policy_version 963821 (0.0006) [2023-12-26 07:20:31,984][123090] Updated weights for policy 1, policy_version 963831 (0.0009) [2023-12-26 07:20:32,273][123091] Updated weights for policy 0, policy_version 970739 (0.0008) [2023-12-26 07:20:32,330][123091] Updated weights for policy 0, policy_version 970749 (0.0006) [2023-12-26 07:20:32,399][123091] Updated weights for policy 0, policy_version 970759 (0.0008) [2023-12-26 07:20:32,666][123090] Updated weights for policy 1, policy_version 963841 (0.0008) [2023-12-26 07:20:32,730][123090] Updated weights for policy 1, policy_version 963851 (0.0005) [2023-12-26 07:20:32,795][123090] Updated weights for policy 1, policy_version 963861 (0.0005) [2023-12-26 07:20:32,851][123090] Updated weights for policy 1, policy_version 963871 (0.0005) [2023-12-26 07:20:33,201][123091] Updated weights for policy 0, policy_version 970769 (0.0010) [2023-12-26 07:20:33,266][123091] Updated weights for policy 0, policy_version 970779 (0.0009) [2023-12-26 07:20:33,326][123091] Updated weights for policy 0, policy_version 970789 (0.0007) [2023-12-26 07:20:33,390][123091] Updated weights for policy 0, policy_version 970799 (0.0005) [2023-12-26 07:20:33,623][123090] Updated weights for policy 1, policy_version 963881 (0.0009) [2023-12-26 07:20:33,686][123090] Updated weights for policy 1, policy_version 963891 (0.0010) [2023-12-26 07:20:33,749][123090] Updated weights for policy 1, policy_version 963901 (0.0010) [2023-12-26 07:20:33,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 495288320. Throughput: 0: 8789.1, 1: 8807.8. Samples: 495296704. Policy #0 lag: (min: 14.0, avg: 14.7, max: 38.0) [2023-12-26 07:20:33,785][121949] Avg episode reward: [(0, '6128.185'), (1, '5798.043')] [2023-12-26 07:20:34,067][123091] Updated weights for policy 0, policy_version 970809 (0.0010) [2023-12-26 07:20:34,127][123091] Updated weights for policy 0, policy_version 970819 (0.0011) [2023-12-26 07:20:34,190][123091] Updated weights for policy 0, policy_version 970829 (0.0010) [2023-12-26 07:20:34,546][123090] Updated weights for policy 1, policy_version 963911 (0.0009) [2023-12-26 07:20:34,606][123090] Updated weights for policy 1, policy_version 963921 (0.0008) [2023-12-26 07:20:34,660][123090] Updated weights for policy 1, policy_version 963931 (0.0009) [2023-12-26 07:20:35,031][123091] Updated weights for policy 0, policy_version 970839 (0.0012) [2023-12-26 07:20:35,083][123091] Updated weights for policy 0, policy_version 970849 (0.0010) [2023-12-26 07:20:35,131][123091] Updated weights for policy 0, policy_version 970859 (0.0010) [2023-12-26 07:20:35,492][123090] Updated weights for policy 1, policy_version 963941 (0.0009) [2023-12-26 07:20:35,539][123090] Updated weights for policy 1, policy_version 963951 (0.0008) [2023-12-26 07:20:35,587][123090] Updated weights for policy 1, policy_version 963961 (0.0009) [2023-12-26 07:20:35,971][123091] Updated weights for policy 0, policy_version 970869 (0.0010) [2023-12-26 07:20:36,023][123091] Updated weights for policy 0, policy_version 970879 (0.0011) [2023-12-26 07:20:36,071][123091] Updated weights for policy 0, policy_version 970889 (0.0010) [2023-12-26 07:20:36,488][123090] Updated weights for policy 1, policy_version 963971 (0.0009) [2023-12-26 07:20:36,543][123090] Updated weights for policy 1, policy_version 963981 (0.0010) [2023-12-26 07:20:36,602][123090] Updated weights for policy 1, policy_version 963991 (0.0009) [2023-12-26 07:20:36,831][123091] Updated weights for policy 0, policy_version 970899 (0.0011) [2023-12-26 07:20:36,891][123091] Updated weights for policy 0, policy_version 970909 (0.0011) [2023-12-26 07:20:36,946][123091] Updated weights for policy 0, policy_version 970919 (0.0011) [2023-12-26 07:20:37,359][123090] Updated weights for policy 1, policy_version 964001 (0.0010) [2023-12-26 07:20:37,411][123090] Updated weights for policy 1, policy_version 964011 (0.0008) [2023-12-26 07:20:37,474][123090] Updated weights for policy 1, policy_version 964021 (0.0006) [2023-12-26 07:20:37,525][123090] Updated weights for policy 1, policy_version 964031 (0.0005) [2023-12-26 07:20:37,779][123091] Updated weights for policy 0, policy_version 970929 (0.0011) [2023-12-26 07:20:37,846][123091] Updated weights for policy 0, policy_version 970939 (0.0011) [2023-12-26 07:20:37,913][123091] Updated weights for policy 0, policy_version 970949 (0.0010) [2023-12-26 07:20:37,970][123091] Updated weights for policy 0, policy_version 970959 (0.0010) [2023-12-26 07:20:38,240][123090] Updated weights for policy 1, policy_version 964041 (0.0005) [2023-12-26 07:20:38,290][123090] Updated weights for policy 1, policy_version 964051 (0.0008) [2023-12-26 07:20:38,350][123090] Updated weights for policy 1, policy_version 964061 (0.0009) [2023-12-26 07:20:38,747][123091] Updated weights for policy 0, policy_version 970969 (0.0006) [2023-12-26 07:20:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 495370240. Throughput: 0: 8797.8, 1: 8827.4. Samples: 495348868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:20:38,784][121949] Avg episode reward: [(0, '6149.500'), (1, '5743.666')] [2023-12-26 07:20:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000964064_246800384.pth... [2023-12-26 07:20:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000963040_246538240.pth [2023-12-26 07:20:38,810][123091] Updated weights for policy 0, policy_version 970979 (0.0007) [2023-12-26 07:20:38,885][123091] Updated weights for policy 0, policy_version 970989 (0.0008) [2023-12-26 07:20:38,905][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000970992_248578048.pth... [2023-12-26 07:20:38,910][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000969968_248315904.pth [2023-12-26 07:20:39,205][123090] Updated weights for policy 1, policy_version 964071 (0.0007) [2023-12-26 07:20:39,271][123090] Updated weights for policy 1, policy_version 964081 (0.0008) [2023-12-26 07:20:39,334][123090] Updated weights for policy 1, policy_version 964091 (0.0008) [2023-12-26 07:20:39,624][123091] Updated weights for policy 0, policy_version 970999 (0.0009) [2023-12-26 07:20:39,675][123091] Updated weights for policy 0, policy_version 971009 (0.0009) [2023-12-26 07:20:39,727][123091] Updated weights for policy 0, policy_version 971019 (0.0009) [2023-12-26 07:20:40,174][123090] Updated weights for policy 1, policy_version 964101 (0.0009) [2023-12-26 07:20:40,241][123090] Updated weights for policy 1, policy_version 964111 (0.0009) [2023-12-26 07:20:40,303][123090] Updated weights for policy 1, policy_version 964121 (0.0007) [2023-12-26 07:20:40,587][123091] Updated weights for policy 0, policy_version 971029 (0.0007) [2023-12-26 07:20:40,643][123091] Updated weights for policy 0, policy_version 971039 (0.0005) [2023-12-26 07:20:40,703][123091] Updated weights for policy 0, policy_version 971049 (0.0005) [2023-12-26 07:20:41,148][123090] Updated weights for policy 1, policy_version 964131 (0.0008) [2023-12-26 07:20:41,224][123090] Updated weights for policy 1, policy_version 964141 (0.0007) [2023-12-26 07:20:41,286][123090] Updated weights for policy 1, policy_version 964151 (0.0008) [2023-12-26 07:20:41,602][123091] Updated weights for policy 0, policy_version 971059 (0.0008) [2023-12-26 07:20:41,674][123091] Updated weights for policy 0, policy_version 971069 (0.0009) [2023-12-26 07:20:41,750][123091] Updated weights for policy 0, policy_version 971079 (0.0009) [2023-12-26 07:20:42,028][123090] Updated weights for policy 1, policy_version 964161 (0.0010) [2023-12-26 07:20:42,090][123090] Updated weights for policy 1, policy_version 964171 (0.0006) [2023-12-26 07:20:42,160][123090] Updated weights for policy 1, policy_version 964181 (0.0005) [2023-12-26 07:20:42,223][123090] Updated weights for policy 1, policy_version 964191 (0.0005) [2023-12-26 07:20:42,633][123091] Updated weights for policy 0, policy_version 971089 (0.0009) [2023-12-26 07:20:42,700][123091] Updated weights for policy 0, policy_version 971099 (0.0009) [2023-12-26 07:20:42,763][123091] Updated weights for policy 0, policy_version 971109 (0.0010) [2023-12-26 07:20:42,828][123091] Updated weights for policy 0, policy_version 971119 (0.0009) [2023-12-26 07:20:42,935][123090] Updated weights for policy 1, policy_version 964201 (0.0010) [2023-12-26 07:20:43,002][123090] Updated weights for policy 1, policy_version 964211 (0.0010) [2023-12-26 07:20:43,062][123090] Updated weights for policy 1, policy_version 964221 (0.0011) [2023-12-26 07:20:43,696][123091] Updated weights for policy 0, policy_version 971129 (0.0010) [2023-12-26 07:20:43,750][123091] Updated weights for policy 0, policy_version 971139 (0.0010) [2023-12-26 07:20:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 495452160. Throughput: 0: 8733.5, 1: 8787.4. Samples: 495454100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:20:43,784][121949] Avg episode reward: [(0, '5954.768'), (1, '5611.589')] [2023-12-26 07:20:43,806][123091] Updated weights for policy 0, policy_version 971150 (0.0010) [2023-12-26 07:20:43,837][123090] Updated weights for policy 1, policy_version 964231 (0.0007) [2023-12-26 07:20:43,894][123090] Updated weights for policy 1, policy_version 964241 (0.0007) [2023-12-26 07:20:43,949][123090] Updated weights for policy 1, policy_version 964251 (0.0010) [2023-12-26 07:20:44,601][123090] Updated weights for policy 1, policy_version 964261 (0.0008) [2023-12-26 07:20:44,657][123090] Updated weights for policy 1, policy_version 964271 (0.0011) [2023-12-26 07:20:44,705][123090] Updated weights for policy 1, policy_version 964281 (0.0010) [2023-12-26 07:20:44,707][123091] Updated weights for policy 0, policy_version 971160 (0.0006) [2023-12-26 07:20:44,762][123091] Updated weights for policy 0, policy_version 971170 (0.0007) [2023-12-26 07:20:44,834][123091] Updated weights for policy 0, policy_version 971180 (0.0009) [2023-12-26 07:20:45,563][123090] Updated weights for policy 1, policy_version 964291 (0.0010) [2023-12-26 07:20:45,583][123091] Updated weights for policy 0, policy_version 971190 (0.0007) [2023-12-26 07:20:45,619][123090] Updated weights for policy 1, policy_version 964301 (0.0010) [2023-12-26 07:20:45,642][123091] Updated weights for policy 0, policy_version 971200 (0.0005) [2023-12-26 07:20:45,681][123090] Updated weights for policy 1, policy_version 964311 (0.0010) [2023-12-26 07:20:45,700][123091] Updated weights for policy 0, policy_version 971210 (0.0005) [2023-12-26 07:20:46,317][123091] Updated weights for policy 0, policy_version 971220 (0.0005) [2023-12-26 07:20:46,387][123091] Updated weights for policy 0, policy_version 971230 (0.0007) [2023-12-26 07:20:46,450][123091] Updated weights for policy 0, policy_version 971240 (0.0009) [2023-12-26 07:20:46,470][123090] Updated weights for policy 1, policy_version 964321 (0.0010) [2023-12-26 07:20:46,543][123090] Updated weights for policy 1, policy_version 964331 (0.0009) [2023-12-26 07:20:46,605][123090] Updated weights for policy 1, policy_version 964342 (0.0009) [2023-12-26 07:20:46,675][123090] Updated weights for policy 1, policy_version 964352 (0.0005) [2023-12-26 07:20:47,182][123091] Updated weights for policy 0, policy_version 971250 (0.0008) [2023-12-26 07:20:47,248][123091] Updated weights for policy 0, policy_version 971260 (0.0009) [2023-12-26 07:20:47,317][123091] Updated weights for policy 0, policy_version 971270 (0.0008) [2023-12-26 07:20:47,393][123091] Updated weights for policy 0, policy_version 971280 (0.0006) [2023-12-26 07:20:47,526][123090] Updated weights for policy 1, policy_version 964362 (0.0010) [2023-12-26 07:20:47,601][123090] Updated weights for policy 1, policy_version 964372 (0.0010) [2023-12-26 07:20:47,675][123090] Updated weights for policy 1, policy_version 964382 (0.0010) [2023-12-26 07:20:47,937][123091] Updated weights for policy 0, policy_version 971290 (0.0008) [2023-12-26 07:20:47,997][123091] Updated weights for policy 0, policy_version 971300 (0.0009) [2023-12-26 07:20:48,063][123091] Updated weights for policy 0, policy_version 971310 (0.0009) [2023-12-26 07:20:48,546][123090] Updated weights for policy 1, policy_version 964392 (0.0008) [2023-12-26 07:20:48,607][123090] Updated weights for policy 1, policy_version 964402 (0.0005) [2023-12-26 07:20:48,658][123090] Updated weights for policy 1, policy_version 964412 (0.0005) [2023-12-26 07:20:48,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 495550464. Throughput: 0: 8744.3, 1: 8860.2. Samples: 495561188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:20:48,785][121949] Avg episode reward: [(0, '5956.874'), (1, '5483.094')] [2023-12-26 07:20:48,929][123091] Updated weights for policy 0, policy_version 971320 (0.0007) [2023-12-26 07:20:48,987][123091] Updated weights for policy 0, policy_version 971330 (0.0011) [2023-12-26 07:20:49,046][123091] Updated weights for policy 0, policy_version 971340 (0.0010) [2023-12-26 07:20:49,416][123090] Updated weights for policy 1, policy_version 964422 (0.0008) [2023-12-26 07:20:49,486][123090] Updated weights for policy 1, policy_version 964432 (0.0009) [2023-12-26 07:20:49,556][123090] Updated weights for policy 1, policy_version 964442 (0.0009) [2023-12-26 07:20:49,911][123091] Updated weights for policy 0, policy_version 971350 (0.0011) [2023-12-26 07:20:49,978][123091] Updated weights for policy 0, policy_version 971360 (0.0011) [2023-12-26 07:20:50,041][123091] Updated weights for policy 0, policy_version 971370 (0.0010) [2023-12-26 07:20:50,362][123090] Updated weights for policy 1, policy_version 964452 (0.0007) [2023-12-26 07:20:50,418][123090] Updated weights for policy 1, policy_version 964462 (0.0006) [2023-12-26 07:20:50,477][123090] Updated weights for policy 1, policy_version 964472 (0.0005) [2023-12-26 07:20:50,891][123091] Updated weights for policy 0, policy_version 971380 (0.0011) [2023-12-26 07:20:50,961][123091] Updated weights for policy 0, policy_version 971390 (0.0009) [2023-12-26 07:20:51,027][123091] Updated weights for policy 0, policy_version 971400 (0.0006) [2023-12-26 07:20:51,311][123090] Updated weights for policy 1, policy_version 964482 (0.0006) [2023-12-26 07:20:51,377][123090] Updated weights for policy 1, policy_version 964492 (0.0008) [2023-12-26 07:20:51,433][123090] Updated weights for policy 1, policy_version 964502 (0.0008) [2023-12-26 07:20:51,477][123090] Updated weights for policy 1, policy_version 964512 (0.0009) [2023-12-26 07:20:51,829][123091] Updated weights for policy 0, policy_version 971410 (0.0008) [2023-12-26 07:20:51,888][123091] Updated weights for policy 0, policy_version 971420 (0.0011) [2023-12-26 07:20:51,952][123091] Updated weights for policy 0, policy_version 971430 (0.0011) [2023-12-26 07:20:52,015][123091] Updated weights for policy 0, policy_version 971440 (0.0011) [2023-12-26 07:20:52,343][123090] Updated weights for policy 1, policy_version 964522 (0.0010) [2023-12-26 07:20:52,403][123090] Updated weights for policy 1, policy_version 964532 (0.0010) [2023-12-26 07:20:52,450][123090] Updated weights for policy 1, policy_version 964542 (0.0010) [2023-12-26 07:20:52,752][123091] Updated weights for policy 0, policy_version 971450 (0.0011) [2023-12-26 07:20:52,803][123091] Updated weights for policy 0, policy_version 971460 (0.0010) [2023-12-26 07:20:52,861][123091] Updated weights for policy 0, policy_version 971470 (0.0010) [2023-12-26 07:20:53,315][123090] Updated weights for policy 1, policy_version 964552 (0.0010) [2023-12-26 07:20:53,363][123090] Updated weights for policy 1, policy_version 964562 (0.0010) [2023-12-26 07:20:53,419][123090] Updated weights for policy 1, policy_version 964572 (0.0010) [2023-12-26 07:20:53,688][123091] Updated weights for policy 0, policy_version 971480 (0.0009) [2023-12-26 07:20:53,749][123091] Updated weights for policy 0, policy_version 971490 (0.0009) [2023-12-26 07:20:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 495632384. Throughput: 0: 8723.4, 1: 8847.4. Samples: 495611876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:20:53,785][121949] Avg episode reward: [(0, '6019.825'), (1, '5676.091')] [2023-12-26 07:20:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000964576_246931456.pth... [2023-12-26 07:20:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000963520_246661120.pth [2023-12-26 07:20:53,806][123091] Updated weights for policy 0, policy_version 971500 (0.0010) [2023-12-26 07:20:53,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000971504_248709120.pth... [2023-12-26 07:20:53,831][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000970448_248438784.pth [2023-12-26 07:20:54,242][123090] Updated weights for policy 1, policy_version 964582 (0.0010) [2023-12-26 07:20:54,309][123090] Updated weights for policy 1, policy_version 964592 (0.0010) [2023-12-26 07:20:54,374][123090] Updated weights for policy 1, policy_version 964602 (0.0010) [2023-12-26 07:20:54,594][123091] Updated weights for policy 0, policy_version 971510 (0.0009) [2023-12-26 07:20:54,654][123091] Updated weights for policy 0, policy_version 971520 (0.0009) [2023-12-26 07:20:54,709][123091] Updated weights for policy 0, policy_version 971530 (0.0008) [2023-12-26 07:20:55,162][123090] Updated weights for policy 1, policy_version 964612 (0.0008) [2023-12-26 07:20:55,230][123090] Updated weights for policy 1, policy_version 964622 (0.0005) [2023-12-26 07:20:55,294][123090] Updated weights for policy 1, policy_version 964632 (0.0008) [2023-12-26 07:20:55,579][123091] Updated weights for policy 0, policy_version 971540 (0.0009) [2023-12-26 07:20:55,643][123091] Updated weights for policy 0, policy_version 971550 (0.0009) [2023-12-26 07:20:55,714][123091] Updated weights for policy 0, policy_version 971560 (0.0009) [2023-12-26 07:20:56,009][123090] Updated weights for policy 1, policy_version 964642 (0.0009) [2023-12-26 07:20:56,080][123090] Updated weights for policy 1, policy_version 964652 (0.0009) [2023-12-26 07:20:56,137][123090] Updated weights for policy 1, policy_version 964662 (0.0010) [2023-12-26 07:20:56,195][123090] Updated weights for policy 1, policy_version 964672 (0.0010) [2023-12-26 07:20:56,560][123091] Updated weights for policy 0, policy_version 971570 (0.0009) [2023-12-26 07:20:56,608][123091] Updated weights for policy 0, policy_version 971580 (0.0009) [2023-12-26 07:20:56,660][123091] Updated weights for policy 0, policy_version 971590 (0.0009) [2023-12-26 07:20:56,708][123091] Updated weights for policy 0, policy_version 971600 (0.0008) [2023-12-26 07:20:56,968][123090] Updated weights for policy 1, policy_version 964682 (0.0005) [2023-12-26 07:20:57,014][123090] Updated weights for policy 1, policy_version 964692 (0.0005) [2023-12-26 07:20:57,067][123090] Updated weights for policy 1, policy_version 964702 (0.0005) [2023-12-26 07:20:57,631][123091] Updated weights for policy 0, policy_version 971611 (0.0010) [2023-12-26 07:20:57,702][123091] Updated weights for policy 0, policy_version 971621 (0.0009) [2023-12-26 07:20:57,733][123090] Updated weights for policy 1, policy_version 964712 (0.0005) [2023-12-26 07:20:57,763][123091] Updated weights for policy 0, policy_version 971631 (0.0010) [2023-12-26 07:20:57,781][123090] Updated weights for policy 1, policy_version 964722 (0.0005) [2023-12-26 07:20:57,827][123090] Updated weights for policy 1, policy_version 964732 (0.0005) [2023-12-26 07:20:58,622][123090] Updated weights for policy 1, policy_version 964742 (0.0007) [2023-12-26 07:20:58,689][123090] Updated weights for policy 1, policy_version 964752 (0.0009) [2023-12-26 07:20:58,695][123091] Updated weights for policy 0, policy_version 971641 (0.0009) [2023-12-26 07:20:58,748][123090] Updated weights for policy 1, policy_version 964762 (0.0009) [2023-12-26 07:20:58,763][123091] Updated weights for policy 0, policy_version 971651 (0.0009) [2023-12-26 07:20:58,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 495714304. Throughput: 0: 8734.3, 1: 8892.7. Samples: 495717464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:20:58,785][121949] Avg episode reward: [(0, '6153.101'), (1, '5858.900')] [2023-12-26 07:20:58,824][123091] Updated weights for policy 0, policy_version 971661 (0.0009) [2023-12-26 07:20:59,615][123090] Updated weights for policy 1, policy_version 964772 (0.0009) [2023-12-26 07:20:59,641][123091] Updated weights for policy 0, policy_version 971671 (0.0007) [2023-12-26 07:20:59,676][123090] Updated weights for policy 1, policy_version 964782 (0.0008) [2023-12-26 07:20:59,691][123091] Updated weights for policy 0, policy_version 971681 (0.0005) [2023-12-26 07:20:59,740][123091] Updated weights for policy 0, policy_version 971691 (0.0006) [2023-12-26 07:20:59,740][123090] Updated weights for policy 1, policy_version 964792 (0.0008) [2023-12-26 07:21:00,519][123090] Updated weights for policy 1, policy_version 964802 (0.0008) [2023-12-26 07:21:00,538][123091] Updated weights for policy 0, policy_version 971701 (0.0008) [2023-12-26 07:21:00,574][123090] Updated weights for policy 1, policy_version 964812 (0.0006) [2023-12-26 07:21:00,605][123091] Updated weights for policy 0, policy_version 971711 (0.0006) [2023-12-26 07:21:00,627][123090] Updated weights for policy 1, policy_version 964822 (0.0010) [2023-12-26 07:21:00,668][123091] Updated weights for policy 0, policy_version 971721 (0.0006) [2023-12-26 07:21:00,682][123090] Updated weights for policy 1, policy_version 964832 (0.0010) [2023-12-26 07:21:01,348][123091] Updated weights for policy 0, policy_version 971731 (0.0009) [2023-12-26 07:21:01,412][123091] Updated weights for policy 0, policy_version 971741 (0.0008) [2023-12-26 07:21:01,413][123090] Updated weights for policy 1, policy_version 964842 (0.0009) [2023-12-26 07:21:01,456][123091] Updated weights for policy 0, policy_version 971751 (0.0008) [2023-12-26 07:21:01,472][123090] Updated weights for policy 1, policy_version 964852 (0.0010) [2023-12-26 07:21:01,523][123090] Updated weights for policy 1, policy_version 964862 (0.0010) [2023-12-26 07:21:02,257][123091] Updated weights for policy 0, policy_version 971761 (0.0008) [2023-12-26 07:21:02,325][123091] Updated weights for policy 0, policy_version 971771 (0.0009) [2023-12-26 07:21:02,351][123090] Updated weights for policy 1, policy_version 964872 (0.0011) [2023-12-26 07:21:02,392][123091] Updated weights for policy 0, policy_version 971781 (0.0007) [2023-12-26 07:21:02,414][123090] Updated weights for policy 1, policy_version 964882 (0.0009) [2023-12-26 07:21:02,452][123091] Updated weights for policy 0, policy_version 971791 (0.0006) [2023-12-26 07:21:02,474][123090] Updated weights for policy 1, policy_version 964892 (0.0010) [2023-12-26 07:21:03,100][123091] Updated weights for policy 0, policy_version 971801 (0.0007) [2023-12-26 07:21:03,153][123091] Updated weights for policy 0, policy_version 971811 (0.0009) [2023-12-26 07:21:03,202][123090] Updated weights for policy 1, policy_version 964902 (0.0010) [2023-12-26 07:21:03,214][123091] Updated weights for policy 0, policy_version 971821 (0.0007) [2023-12-26 07:21:03,277][123090] Updated weights for policy 1, policy_version 964912 (0.0009) [2023-12-26 07:21:03,349][123090] Updated weights for policy 1, policy_version 964922 (0.0010) [2023-12-26 07:21:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 495812608. Throughput: 0: 8768.8, 1: 8985.6. Samples: 495825416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:03,785][121949] Avg episode reward: [(0, '6180.121'), (1, '5604.574')] [2023-12-26 07:21:04,047][123091] Updated weights for policy 0, policy_version 971831 (0.0008) [2023-12-26 07:21:04,093][123090] Updated weights for policy 1, policy_version 964932 (0.0007) [2023-12-26 07:21:04,120][123091] Updated weights for policy 0, policy_version 971841 (0.0007) [2023-12-26 07:21:04,156][123090] Updated weights for policy 1, policy_version 964942 (0.0006) [2023-12-26 07:21:04,191][123091] Updated weights for policy 0, policy_version 971851 (0.0009) [2023-12-26 07:21:04,224][123090] Updated weights for policy 1, policy_version 964952 (0.0007) [2023-12-26 07:21:04,868][123090] Updated weights for policy 1, policy_version 964962 (0.0006) [2023-12-26 07:21:04,929][123090] Updated weights for policy 1, policy_version 964972 (0.0005) [2023-12-26 07:21:04,991][123090] Updated weights for policy 1, policy_version 964982 (0.0009) [2023-12-26 07:21:05,020][123091] Updated weights for policy 0, policy_version 971861 (0.0009) [2023-12-26 07:21:05,049][123090] Updated weights for policy 1, policy_version 964992 (0.0008) [2023-12-26 07:21:05,073][123091] Updated weights for policy 0, policy_version 971871 (0.0008) [2023-12-26 07:21:05,135][123091] Updated weights for policy 0, policy_version 971881 (0.0009) [2023-12-26 07:21:05,810][123090] Updated weights for policy 1, policy_version 965002 (0.0010) [2023-12-26 07:21:05,876][123090] Updated weights for policy 1, policy_version 965012 (0.0010) [2023-12-26 07:21:05,942][123090] Updated weights for policy 1, policy_version 965022 (0.0010) [2023-12-26 07:21:05,981][123091] Updated weights for policy 0, policy_version 971891 (0.0009) [2023-12-26 07:21:06,044][123091] Updated weights for policy 0, policy_version 971901 (0.0005) [2023-12-26 07:21:06,092][123091] Updated weights for policy 0, policy_version 971911 (0.0006) [2023-12-26 07:21:06,762][123090] Updated weights for policy 1, policy_version 965032 (0.0009) [2023-12-26 07:21:06,831][123090] Updated weights for policy 1, policy_version 965042 (0.0009) [2023-12-26 07:21:06,893][123091] Updated weights for policy 0, policy_version 971921 (0.0009) [2023-12-26 07:21:06,895][123090] Updated weights for policy 1, policy_version 965052 (0.0009) [2023-12-26 07:21:06,945][123091] Updated weights for policy 0, policy_version 971931 (0.0010) [2023-12-26 07:21:07,000][123091] Updated weights for policy 0, policy_version 971941 (0.0011) [2023-12-26 07:21:07,060][123091] Updated weights for policy 0, policy_version 971951 (0.0011) [2023-12-26 07:21:07,686][123090] Updated weights for policy 1, policy_version 965062 (0.0009) [2023-12-26 07:21:07,746][123090] Updated weights for policy 1, policy_version 965072 (0.0010) [2023-12-26 07:21:07,807][123090] Updated weights for policy 1, policy_version 965082 (0.0010) [2023-12-26 07:21:07,857][123091] Updated weights for policy 0, policy_version 971961 (0.0006) [2023-12-26 07:21:07,912][123091] Updated weights for policy 0, policy_version 971971 (0.0005) [2023-12-26 07:21:07,981][123091] Updated weights for policy 0, policy_version 971981 (0.0005) [2023-12-26 07:21:08,588][123091] Updated weights for policy 0, policy_version 971991 (0.0006) [2023-12-26 07:21:08,653][123091] Updated weights for policy 0, policy_version 972001 (0.0008) [2023-12-26 07:21:08,711][123090] Updated weights for policy 1, policy_version 965092 (0.0009) [2023-12-26 07:21:08,713][123091] Updated weights for policy 0, policy_version 972011 (0.0008) [2023-12-26 07:21:08,770][123090] Updated weights for policy 1, policy_version 965102 (0.0010) [2023-12-26 07:21:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 495902720. Throughput: 0: 8796.0, 1: 9014.9. Samples: 495878752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:08,785][121949] Avg episode reward: [(0, '6100.118'), (1, '5654.084')] [2023-12-26 07:21:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000972016_248840192.pth... [2023-12-26 07:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000970992_248578048.pth [2023-12-26 07:21:08,819][123090] Updated weights for policy 1, policy_version 965112 (0.0009) [2023-12-26 07:21:08,873][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000965120_247070720.pth... [2023-12-26 07:21:08,877][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000964064_246800384.pth [2023-12-26 07:21:09,542][123090] Updated weights for policy 1, policy_version 965122 (0.0009) [2023-12-26 07:21:09,582][123091] Updated weights for policy 0, policy_version 972021 (0.0006) [2023-12-26 07:21:09,594][123090] Updated weights for policy 1, policy_version 965132 (0.0009) [2023-12-26 07:21:09,644][123091] Updated weights for policy 0, policy_version 972031 (0.0008) [2023-12-26 07:21:09,650][123090] Updated weights for policy 1, policy_version 965142 (0.0008) [2023-12-26 07:21:09,700][123090] Updated weights for policy 1, policy_version 965152 (0.0008) [2023-12-26 07:21:09,702][123091] Updated weights for policy 0, policy_version 972041 (0.0008) [2023-12-26 07:21:10,554][123091] Updated weights for policy 0, policy_version 972051 (0.0010) [2023-12-26 07:21:10,562][123090] Updated weights for policy 1, policy_version 965162 (0.0007) [2023-12-26 07:21:10,605][123091] Updated weights for policy 0, policy_version 972062 (0.0009) [2023-12-26 07:21:10,628][123090] Updated weights for policy 1, policy_version 965172 (0.0005) [2023-12-26 07:21:10,658][123091] Updated weights for policy 0, policy_version 972072 (0.0009) [2023-12-26 07:21:10,684][123090] Updated weights for policy 1, policy_version 965182 (0.0005) [2023-12-26 07:21:11,507][123090] Updated weights for policy 1, policy_version 965192 (0.0008) [2023-12-26 07:21:11,550][123091] Updated weights for policy 0, policy_version 972082 (0.0008) [2023-12-26 07:21:11,571][123090] Updated weights for policy 1, policy_version 965202 (0.0009) [2023-12-26 07:21:11,604][123091] Updated weights for policy 0, policy_version 972092 (0.0009) [2023-12-26 07:21:11,639][123090] Updated weights for policy 1, policy_version 965212 (0.0008) [2023-12-26 07:21:11,671][123091] Updated weights for policy 0, policy_version 972102 (0.0009) [2023-12-26 07:21:11,734][123091] Updated weights for policy 0, policy_version 972112 (0.0009) [2023-12-26 07:21:12,497][123091] Updated weights for policy 0, policy_version 972122 (0.0010) [2023-12-26 07:21:12,525][123090] Updated weights for policy 1, policy_version 965222 (0.0007) [2023-12-26 07:21:12,559][123091] Updated weights for policy 0, policy_version 972132 (0.0011) [2023-12-26 07:21:12,583][123090] Updated weights for policy 1, policy_version 965232 (0.0006) [2023-12-26 07:21:12,615][123091] Updated weights for policy 0, policy_version 972142 (0.0009) [2023-12-26 07:21:12,641][123090] Updated weights for policy 1, policy_version 965242 (0.0006) [2023-12-26 07:21:13,306][123091] Updated weights for policy 0, policy_version 972152 (0.0006) [2023-12-26 07:21:13,376][123091] Updated weights for policy 0, policy_version 972162 (0.0007) [2023-12-26 07:21:13,397][123090] Updated weights for policy 1, policy_version 965252 (0.0007) [2023-12-26 07:21:13,437][123091] Updated weights for policy 0, policy_version 972172 (0.0006) [2023-12-26 07:21:13,462][123090] Updated weights for policy 1, policy_version 965262 (0.0010) [2023-12-26 07:21:13,539][123090] Updated weights for policy 1, policy_version 965272 (0.0011) [2023-12-26 07:21:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 495992832. Throughput: 0: 8765.3, 1: 8880.5. Samples: 495982172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:13,785][121949] Avg episode reward: [(0, '6046.980'), (1, '5786.137')] [2023-12-26 07:21:14,192][123091] Updated weights for policy 0, policy_version 972182 (0.0008) [2023-12-26 07:21:14,205][123090] Updated weights for policy 1, policy_version 965282 (0.0006) [2023-12-26 07:21:14,258][123091] Updated weights for policy 0, policy_version 972192 (0.0010) [2023-12-26 07:21:14,271][123090] Updated weights for policy 1, policy_version 965292 (0.0006) [2023-12-26 07:21:14,324][123091] Updated weights for policy 0, policy_version 972202 (0.0009) [2023-12-26 07:21:14,333][123090] Updated weights for policy 1, policy_version 965302 (0.0006) [2023-12-26 07:21:14,391][123090] Updated weights for policy 1, policy_version 965312 (0.0006) [2023-12-26 07:21:15,023][123091] Updated weights for policy 0, policy_version 972212 (0.0008) [2023-12-26 07:21:15,072][123090] Updated weights for policy 1, policy_version 965322 (0.0008) [2023-12-26 07:21:15,092][123091] Updated weights for policy 0, policy_version 972222 (0.0006) [2023-12-26 07:21:15,132][123090] Updated weights for policy 1, policy_version 965332 (0.0010) [2023-12-26 07:21:15,149][123091] Updated weights for policy 0, policy_version 972232 (0.0007) [2023-12-26 07:21:15,191][123090] Updated weights for policy 1, policy_version 965342 (0.0008) [2023-12-26 07:21:15,957][123091] Updated weights for policy 0, policy_version 972242 (0.0009) [2023-12-26 07:21:16,023][123091] Updated weights for policy 0, policy_version 972252 (0.0009) [2023-12-26 07:21:16,042][123090] Updated weights for policy 1, policy_version 965352 (0.0009) [2023-12-26 07:21:16,076][123091] Updated weights for policy 0, policy_version 972262 (0.0007) [2023-12-26 07:21:16,095][123090] Updated weights for policy 1, policy_version 965362 (0.0009) [2023-12-26 07:21:16,132][123091] Updated weights for policy 0, policy_version 972272 (0.0009) [2023-12-26 07:21:16,145][123090] Updated weights for policy 1, policy_version 965372 (0.0007) [2023-12-26 07:21:16,958][123091] Updated weights for policy 0, policy_version 972282 (0.0009) [2023-12-26 07:21:16,992][123090] Updated weights for policy 1, policy_version 965382 (0.0007) [2023-12-26 07:21:17,020][123091] Updated weights for policy 0, policy_version 972292 (0.0008) [2023-12-26 07:21:17,056][123090] Updated weights for policy 1, policy_version 965392 (0.0010) [2023-12-26 07:21:17,082][123091] Updated weights for policy 0, policy_version 972302 (0.0008) [2023-12-26 07:21:17,113][123090] Updated weights for policy 1, policy_version 965402 (0.0007) [2023-12-26 07:21:17,845][123091] Updated weights for policy 0, policy_version 972312 (0.0006) [2023-12-26 07:21:17,912][123091] Updated weights for policy 0, policy_version 972322 (0.0005) [2023-12-26 07:21:17,923][123090] Updated weights for policy 1, policy_version 965412 (0.0009) [2023-12-26 07:21:17,975][123091] Updated weights for policy 0, policy_version 972332 (0.0007) [2023-12-26 07:21:17,978][123090] Updated weights for policy 1, policy_version 965422 (0.0008) [2023-12-26 07:21:18,030][123090] Updated weights for policy 1, policy_version 965432 (0.0008) [2023-12-26 07:21:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 496074752. Throughput: 0: 8797.3, 1: 8861.0. Samples: 496091332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:18,785][121949] Avg episode reward: [(0, '6111.317'), (1, '5660.734')] [2023-12-26 07:21:18,792][123090] Updated weights for policy 1, policy_version 965442 (0.0010) [2023-12-26 07:21:18,810][123091] Updated weights for policy 0, policy_version 972342 (0.0009) [2023-12-26 07:21:18,860][123090] Updated weights for policy 1, policy_version 965452 (0.0006) [2023-12-26 07:21:18,875][123091] Updated weights for policy 0, policy_version 972352 (0.0010) [2023-12-26 07:21:18,924][123090] Updated weights for policy 1, policy_version 965462 (0.0007) [2023-12-26 07:21:18,938][123091] Updated weights for policy 0, policy_version 972362 (0.0009) [2023-12-26 07:21:18,991][123090] Updated weights for policy 1, policy_version 965472 (0.0007) [2023-12-26 07:21:19,675][123091] Updated weights for policy 0, policy_version 972372 (0.0008) [2023-12-26 07:21:19,739][123091] Updated weights for policy 0, policy_version 972382 (0.0007) [2023-12-26 07:21:19,761][123090] Updated weights for policy 1, policy_version 965482 (0.0009) [2023-12-26 07:21:19,795][123091] Updated weights for policy 0, policy_version 972392 (0.0007) [2023-12-26 07:21:19,825][123090] Updated weights for policy 1, policy_version 965492 (0.0010) [2023-12-26 07:21:19,892][123090] Updated weights for policy 1, policy_version 965502 (0.0009) [2023-12-26 07:21:20,561][123091] Updated weights for policy 0, policy_version 972402 (0.0009) [2023-12-26 07:21:20,631][123091] Updated weights for policy 0, policy_version 972412 (0.0010) [2023-12-26 07:21:20,680][123091] Updated weights for policy 0, policy_version 972422 (0.0009) [2023-12-26 07:21:20,730][123091] Updated weights for policy 0, policy_version 972432 (0.0010) [2023-12-26 07:21:20,771][123090] Updated weights for policy 1, policy_version 965512 (0.0009) [2023-12-26 07:21:20,826][123090] Updated weights for policy 1, policy_version 965522 (0.0009) [2023-12-26 07:21:20,878][123090] Updated weights for policy 1, policy_version 965532 (0.0008) [2023-12-26 07:21:21,612][123091] Updated weights for policy 0, policy_version 972442 (0.0009) [2023-12-26 07:21:21,689][123091] Updated weights for policy 0, policy_version 972452 (0.0010) [2023-12-26 07:21:21,759][123091] Updated weights for policy 0, policy_version 972462 (0.0009) [2023-12-26 07:21:21,823][123090] Updated weights for policy 1, policy_version 965542 (0.0010) [2023-12-26 07:21:21,893][123090] Updated weights for policy 1, policy_version 965552 (0.0011) [2023-12-26 07:21:21,967][123090] Updated weights for policy 1, policy_version 965562 (0.0011) [2023-12-26 07:21:22,650][123091] Updated weights for policy 0, policy_version 972472 (0.0009) [2023-12-26 07:21:22,710][123091] Updated weights for policy 0, policy_version 972482 (0.0009) [2023-12-26 07:21:22,774][123090] Updated weights for policy 1, policy_version 965572 (0.0010) [2023-12-26 07:21:22,777][123091] Updated weights for policy 0, policy_version 972492 (0.0008) [2023-12-26 07:21:22,826][123090] Updated weights for policy 1, policy_version 965582 (0.0008) [2023-12-26 07:21:22,878][123090] Updated weights for policy 1, policy_version 965592 (0.0008) [2023-12-26 07:21:23,628][123090] Updated weights for policy 1, policy_version 965602 (0.0008) [2023-12-26 07:21:23,663][123091] Updated weights for policy 0, policy_version 972502 (0.0008) [2023-12-26 07:21:23,681][123090] Updated weights for policy 1, policy_version 965612 (0.0005) [2023-12-26 07:21:23,726][123091] Updated weights for policy 0, policy_version 972512 (0.0011) [2023-12-26 07:21:23,744][123090] Updated weights for policy 1, policy_version 965622 (0.0006) [2023-12-26 07:21:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 496156672. Throughput: 0: 8777.6, 1: 8861.2. Samples: 496142616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:23,785][121949] Avg episode reward: [(0, '6125.150'), (1, '5680.736')] [2023-12-26 07:21:23,790][123091] Updated weights for policy 0, policy_version 972522 (0.0011) [2023-12-26 07:21:23,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000965632_247201792.pth... [2023-12-26 07:21:23,811][123090] Updated weights for policy 1, policy_version 965632 (0.0005) [2023-12-26 07:21:23,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000964576_246931456.pth [2023-12-26 07:21:23,824][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000972528_248971264.pth... [2023-12-26 07:21:23,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000971504_248709120.pth [2023-12-26 07:21:24,542][123091] Updated weights for policy 0, policy_version 972532 (0.0009) [2023-12-26 07:21:24,560][123090] Updated weights for policy 1, policy_version 965642 (0.0011) [2023-12-26 07:21:24,600][123091] Updated weights for policy 0, policy_version 972542 (0.0006) [2023-12-26 07:21:24,624][123090] Updated weights for policy 1, policy_version 965652 (0.0010) [2023-12-26 07:21:24,659][123091] Updated weights for policy 0, policy_version 972552 (0.0005) [2023-12-26 07:21:24,686][123090] Updated weights for policy 1, policy_version 965662 (0.0010) [2023-12-26 07:21:25,432][123091] Updated weights for policy 0, policy_version 972562 (0.0007) [2023-12-26 07:21:25,487][123091] Updated weights for policy 0, policy_version 972572 (0.0010) [2023-12-26 07:21:25,500][123090] Updated weights for policy 1, policy_version 965672 (0.0010) [2023-12-26 07:21:25,543][123091] Updated weights for policy 0, policy_version 972582 (0.0010) [2023-12-26 07:21:25,562][123090] Updated weights for policy 1, policy_version 965682 (0.0007) [2023-12-26 07:21:25,611][123091] Updated weights for policy 0, policy_version 972592 (0.0009) [2023-12-26 07:21:25,629][123090] Updated weights for policy 1, policy_version 965692 (0.0005) [2023-12-26 07:21:26,293][123090] Updated weights for policy 1, policy_version 965702 (0.0005) [2023-12-26 07:21:26,345][123090] Updated weights for policy 1, policy_version 965712 (0.0007) [2023-12-26 07:21:26,353][123091] Updated weights for policy 0, policy_version 972602 (0.0008) [2023-12-26 07:21:26,403][123090] Updated weights for policy 1, policy_version 965722 (0.0009) [2023-12-26 07:21:26,405][123091] Updated weights for policy 0, policy_version 972612 (0.0007) [2023-12-26 07:21:26,468][123091] Updated weights for policy 0, policy_version 972622 (0.0009) [2023-12-26 07:21:27,236][123090] Updated weights for policy 1, policy_version 965732 (0.0007) [2023-12-26 07:21:27,270][123091] Updated weights for policy 0, policy_version 972632 (0.0006) [2023-12-26 07:21:27,296][123090] Updated weights for policy 1, policy_version 965742 (0.0007) [2023-12-26 07:21:27,329][123091] Updated weights for policy 0, policy_version 972642 (0.0008) [2023-12-26 07:21:27,354][123090] Updated weights for policy 1, policy_version 965752 (0.0007) [2023-12-26 07:21:27,378][123091] Updated weights for policy 0, policy_version 972652 (0.0009) [2023-12-26 07:21:28,162][123090] Updated weights for policy 1, policy_version 965762 (0.0009) [2023-12-26 07:21:28,191][123091] Updated weights for policy 0, policy_version 972662 (0.0009) [2023-12-26 07:21:28,225][123090] Updated weights for policy 1, policy_version 965772 (0.0007) [2023-12-26 07:21:28,244][123091] Updated weights for policy 0, policy_version 972673 (0.0008) [2023-12-26 07:21:28,279][123090] Updated weights for policy 1, policy_version 965782 (0.0005) [2023-12-26 07:21:28,302][123091] Updated weights for policy 0, policy_version 972683 (0.0009) [2023-12-26 07:21:28,339][123090] Updated weights for policy 1, policy_version 965792 (0.0008) [2023-12-26 07:21:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 496254976. Throughput: 0: 8792.4, 1: 8865.3. Samples: 496248700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:28,785][121949] Avg episode reward: [(0, '6030.730'), (1, '5911.732')] [2023-12-26 07:21:29,133][123091] Updated weights for policy 0, policy_version 972693 (0.0007) [2023-12-26 07:21:29,135][123090] Updated weights for policy 1, policy_version 965802 (0.0009) [2023-12-26 07:21:29,188][123091] Updated weights for policy 0, policy_version 972703 (0.0007) [2023-12-26 07:21:29,198][123090] Updated weights for policy 1, policy_version 965812 (0.0010) [2023-12-26 07:21:29,250][123091] Updated weights for policy 0, policy_version 972713 (0.0008) [2023-12-26 07:21:29,264][123090] Updated weights for policy 1, policy_version 965822 (0.0010) [2023-12-26 07:21:29,936][123091] Updated weights for policy 0, policy_version 972723 (0.0008) [2023-12-26 07:21:29,951][123090] Updated weights for policy 1, policy_version 965832 (0.0007) [2023-12-26 07:21:29,997][123091] Updated weights for policy 0, policy_version 972733 (0.0007) [2023-12-26 07:21:30,015][123090] Updated weights for policy 1, policy_version 965842 (0.0009) [2023-12-26 07:21:30,056][123091] Updated weights for policy 0, policy_version 972743 (0.0007) [2023-12-26 07:21:30,075][123090] Updated weights for policy 1, policy_version 965852 (0.0009) [2023-12-26 07:21:30,875][123091] Updated weights for policy 0, policy_version 972753 (0.0008) [2023-12-26 07:21:30,891][123090] Updated weights for policy 1, policy_version 965862 (0.0007) [2023-12-26 07:21:30,930][123091] Updated weights for policy 0, policy_version 972763 (0.0010) [2023-12-26 07:21:30,943][123090] Updated weights for policy 1, policy_version 965872 (0.0005) [2023-12-26 07:21:30,977][123091] Updated weights for policy 0, policy_version 972773 (0.0010) [2023-12-26 07:21:30,997][123090] Updated weights for policy 1, policy_version 965882 (0.0005) [2023-12-26 07:21:31,040][123091] Updated weights for policy 0, policy_version 972783 (0.0011) [2023-12-26 07:21:31,830][123091] Updated weights for policy 0, policy_version 972793 (0.0006) [2023-12-26 07:21:31,841][123090] Updated weights for policy 1, policy_version 965892 (0.0007) [2023-12-26 07:21:31,875][123091] Updated weights for policy 0, policy_version 972803 (0.0006) [2023-12-26 07:21:31,910][123090] Updated weights for policy 1, policy_version 965902 (0.0005) [2023-12-26 07:21:31,946][123091] Updated weights for policy 0, policy_version 972813 (0.0007) [2023-12-26 07:21:31,971][123090] Updated weights for policy 1, policy_version 965912 (0.0006) [2023-12-26 07:21:32,726][123090] Updated weights for policy 1, policy_version 965922 (0.0007) [2023-12-26 07:21:32,760][123091] Updated weights for policy 0, policy_version 972823 (0.0009) [2023-12-26 07:21:32,785][123090] Updated weights for policy 1, policy_version 965932 (0.0006) [2023-12-26 07:21:32,822][123091] Updated weights for policy 0, policy_version 972833 (0.0011) [2023-12-26 07:21:32,844][123090] Updated weights for policy 1, policy_version 965942 (0.0010) [2023-12-26 07:21:32,887][123091] Updated weights for policy 0, policy_version 972843 (0.0010) [2023-12-26 07:21:32,894][123090] Updated weights for policy 1, policy_version 965952 (0.0008) [2023-12-26 07:21:33,677][123090] Updated weights for policy 1, policy_version 965962 (0.0008) [2023-12-26 07:21:33,699][123091] Updated weights for policy 0, policy_version 972853 (0.0011) [2023-12-26 07:21:33,728][123090] Updated weights for policy 1, policy_version 965972 (0.0009) [2023-12-26 07:21:33,759][123091] Updated weights for policy 0, policy_version 972863 (0.0009) [2023-12-26 07:21:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 496336896. Throughput: 0: 8766.7, 1: 8897.4. Samples: 496356068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:33,785][121949] Avg episode reward: [(0, '5911.334'), (1, '5863.167')] [2023-12-26 07:21:33,790][123090] Updated weights for policy 1, policy_version 965982 (0.0008) [2023-12-26 07:21:33,814][123091] Updated weights for policy 0, policy_version 972873 (0.0005) [2023-12-26 07:21:34,523][123090] Updated weights for policy 1, policy_version 965992 (0.0009) [2023-12-26 07:21:34,554][123091] Updated weights for policy 0, policy_version 972883 (0.0006) [2023-12-26 07:21:34,581][123090] Updated weights for policy 1, policy_version 966002 (0.0006) [2023-12-26 07:21:34,610][123091] Updated weights for policy 0, policy_version 972893 (0.0009) [2023-12-26 07:21:34,640][123090] Updated weights for policy 1, policy_version 966012 (0.0007) [2023-12-26 07:21:34,669][123091] Updated weights for policy 0, policy_version 972903 (0.0009) [2023-12-26 07:21:35,335][123090] Updated weights for policy 1, policy_version 966022 (0.0006) [2023-12-26 07:21:35,397][123090] Updated weights for policy 1, policy_version 966032 (0.0005) [2023-12-26 07:21:35,405][123091] Updated weights for policy 0, policy_version 972913 (0.0009) [2023-12-26 07:21:35,455][123090] Updated weights for policy 1, policy_version 966042 (0.0009) [2023-12-26 07:21:35,466][123091] Updated weights for policy 0, policy_version 972923 (0.0005) [2023-12-26 07:21:35,519][123091] Updated weights for policy 0, policy_version 972933 (0.0005) [2023-12-26 07:21:35,573][123091] Updated weights for policy 0, policy_version 972943 (0.0005) [2023-12-26 07:21:36,197][123090] Updated weights for policy 1, policy_version 966052 (0.0009) [2023-12-26 07:21:36,251][123090] Updated weights for policy 1, policy_version 966062 (0.0009) [2023-12-26 07:21:36,304][123090] Updated weights for policy 1, policy_version 966072 (0.0009) [2023-12-26 07:21:36,358][123091] Updated weights for policy 0, policy_version 972953 (0.0009) [2023-12-26 07:21:36,424][123091] Updated weights for policy 0, policy_version 972963 (0.0009) [2023-12-26 07:21:36,489][123091] Updated weights for policy 0, policy_version 972973 (0.0009) [2023-12-26 07:21:37,169][123090] Updated weights for policy 1, policy_version 966082 (0.0009) [2023-12-26 07:21:37,234][123090] Updated weights for policy 1, policy_version 966092 (0.0009) [2023-12-26 07:21:37,297][123090] Updated weights for policy 1, policy_version 966102 (0.0009) [2023-12-26 07:21:37,321][123091] Updated weights for policy 0, policy_version 972983 (0.0009) [2023-12-26 07:21:37,362][123090] Updated weights for policy 1, policy_version 966112 (0.0008) [2023-12-26 07:21:37,371][123091] Updated weights for policy 0, policy_version 972993 (0.0008) [2023-12-26 07:21:37,424][123091] Updated weights for policy 0, policy_version 973003 (0.0009) [2023-12-26 07:21:38,059][123090] Updated weights for policy 1, policy_version 966122 (0.0009) [2023-12-26 07:21:38,123][123090] Updated weights for policy 1, policy_version 966132 (0.0005) [2023-12-26 07:21:38,192][123090] Updated weights for policy 1, policy_version 966142 (0.0005) [2023-12-26 07:21:38,289][123091] Updated weights for policy 0, policy_version 973013 (0.0010) [2023-12-26 07:21:38,344][123091] Updated weights for policy 0, policy_version 973023 (0.0011) [2023-12-26 07:21:38,414][123091] Updated weights for policy 0, policy_version 973033 (0.0011) [2023-12-26 07:21:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 496435200. Throughput: 0: 8824.7, 1: 8946.8. Samples: 496411592. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:38,785][121949] Avg episode reward: [(0, '5970.734'), (1, '5756.755')] [2023-12-26 07:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000973040_249102336.pth... [2023-12-26 07:21:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000966144_247332864.pth... [2023-12-26 07:21:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000972016_248840192.pth [2023-12-26 07:21:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000965120_247070720.pth [2023-12-26 07:21:38,937][123090] Updated weights for policy 1, policy_version 966152 (0.0009) [2023-12-26 07:21:39,011][123090] Updated weights for policy 1, policy_version 966162 (0.0010) [2023-12-26 07:21:39,084][123090] Updated weights for policy 1, policy_version 966172 (0.0010) [2023-12-26 07:21:39,182][123091] Updated weights for policy 0, policy_version 973043 (0.0009) [2023-12-26 07:21:39,248][123091] Updated weights for policy 0, policy_version 973053 (0.0009) [2023-12-26 07:21:39,317][123091] Updated weights for policy 0, policy_version 973063 (0.0008) [2023-12-26 07:21:39,888][123090] Updated weights for policy 1, policy_version 966182 (0.0010) [2023-12-26 07:21:39,954][123090] Updated weights for policy 1, policy_version 966192 (0.0011) [2023-12-26 07:21:40,018][123090] Updated weights for policy 1, policy_version 966202 (0.0011) [2023-12-26 07:21:40,161][123091] Updated weights for policy 0, policy_version 973073 (0.0009) [2023-12-26 07:21:40,226][123091] Updated weights for policy 0, policy_version 973083 (0.0006) [2023-12-26 07:21:40,298][123091] Updated weights for policy 0, policy_version 973093 (0.0005) [2023-12-26 07:21:40,368][123091] Updated weights for policy 0, policy_version 973103 (0.0007) [2023-12-26 07:21:40,792][123090] Updated weights for policy 1, policy_version 966212 (0.0008) [2023-12-26 07:21:40,839][123090] Updated weights for policy 1, policy_version 966222 (0.0005) [2023-12-26 07:21:40,888][123090] Updated weights for policy 1, policy_version 966232 (0.0005) [2023-12-26 07:21:40,998][123091] Updated weights for policy 0, policy_version 973113 (0.0009) [2023-12-26 07:21:41,071][123091] Updated weights for policy 0, policy_version 973123 (0.0010) [2023-12-26 07:21:41,151][123091] Updated weights for policy 0, policy_version 973133 (0.0010) [2023-12-26 07:21:41,668][123090] Updated weights for policy 1, policy_version 966242 (0.0006) [2023-12-26 07:21:41,744][123090] Updated weights for policy 1, policy_version 966252 (0.0007) [2023-12-26 07:21:41,813][123090] Updated weights for policy 1, policy_version 966262 (0.0010) [2023-12-26 07:21:41,877][123090] Updated weights for policy 1, policy_version 966272 (0.0011) [2023-12-26 07:21:42,038][123091] Updated weights for policy 0, policy_version 973143 (0.0009) [2023-12-26 07:21:42,100][123091] Updated weights for policy 0, policy_version 973153 (0.0009) [2023-12-26 07:21:42,165][123091] Updated weights for policy 0, policy_version 973163 (0.0009) [2023-12-26 07:21:42,730][123090] Updated weights for policy 1, policy_version 966282 (0.0011) [2023-12-26 07:21:42,797][123090] Updated weights for policy 1, policy_version 966292 (0.0011) [2023-12-26 07:21:42,862][123090] Updated weights for policy 1, policy_version 966302 (0.0006) [2023-12-26 07:21:43,017][123091] Updated weights for policy 0, policy_version 973173 (0.0009) [2023-12-26 07:21:43,071][123091] Updated weights for policy 0, policy_version 973183 (0.0009) [2023-12-26 07:21:43,118][123091] Updated weights for policy 0, policy_version 973193 (0.0008) [2023-12-26 07:21:43,540][123090] Updated weights for policy 1, policy_version 966312 (0.0009) [2023-12-26 07:21:43,595][123090] Updated weights for policy 1, policy_version 966322 (0.0010) [2023-12-26 07:21:43,652][123090] Updated weights for policy 1, policy_version 966332 (0.0009) [2023-12-26 07:21:43,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 496525312. Throughput: 0: 8853.8, 1: 8925.2. Samples: 496517524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:43,785][121949] Avg episode reward: [(0, '6073.757'), (1, '5821.326')] [2023-12-26 07:21:44,039][123091] Updated weights for policy 0, policy_version 973204 (0.0010) [2023-12-26 07:21:44,088][123091] Updated weights for policy 0, policy_version 973214 (0.0009) [2023-12-26 07:21:44,141][123091] Updated weights for policy 0, policy_version 973224 (0.0009) [2023-12-26 07:21:44,395][123090] Updated weights for policy 1, policy_version 966342 (0.0006) [2023-12-26 07:21:44,439][123090] Updated weights for policy 1, policy_version 966352 (0.0005) [2023-12-26 07:21:44,486][123090] Updated weights for policy 1, policy_version 966362 (0.0005) [2023-12-26 07:21:45,060][123091] Updated weights for policy 0, policy_version 973234 (0.0009) [2023-12-26 07:21:45,133][123091] Updated weights for policy 0, policy_version 973244 (0.0010) [2023-12-26 07:21:45,199][123091] Updated weights for policy 0, policy_version 973254 (0.0010) [2023-12-26 07:21:45,260][123091] Updated weights for policy 0, policy_version 973264 (0.0009) [2023-12-26 07:21:45,271][123090] Updated weights for policy 1, policy_version 966372 (0.0007) [2023-12-26 07:21:45,332][123090] Updated weights for policy 1, policy_version 966382 (0.0009) [2023-12-26 07:21:45,385][123090] Updated weights for policy 1, policy_version 966392 (0.0009) [2023-12-26 07:21:45,989][123091] Updated weights for policy 0, policy_version 973274 (0.0005) [2023-12-26 07:21:46,051][123091] Updated weights for policy 0, policy_version 973284 (0.0006) [2023-12-26 07:21:46,114][123091] Updated weights for policy 0, policy_version 973294 (0.0007) [2023-12-26 07:21:46,232][123090] Updated weights for policy 1, policy_version 966402 (0.0010) [2023-12-26 07:21:46,306][123090] Updated weights for policy 1, policy_version 966412 (0.0010) [2023-12-26 07:21:46,372][123090] Updated weights for policy 1, policy_version 966422 (0.0010) [2023-12-26 07:21:46,434][123090] Updated weights for policy 1, policy_version 966432 (0.0010) [2023-12-26 07:21:46,835][123091] Updated weights for policy 0, policy_version 973304 (0.0006) [2023-12-26 07:21:46,901][123091] Updated weights for policy 0, policy_version 973314 (0.0008) [2023-12-26 07:21:46,952][123091] Updated weights for policy 0, policy_version 973324 (0.0009) [2023-12-26 07:21:47,221][123090] Updated weights for policy 1, policy_version 966442 (0.0005) [2023-12-26 07:21:47,277][123090] Updated weights for policy 1, policy_version 966452 (0.0005) [2023-12-26 07:21:47,334][123090] Updated weights for policy 1, policy_version 966462 (0.0005) [2023-12-26 07:21:47,814][123091] Updated weights for policy 0, policy_version 973334 (0.0009) [2023-12-26 07:21:47,874][123091] Updated weights for policy 0, policy_version 973344 (0.0009) [2023-12-26 07:21:47,932][123091] Updated weights for policy 0, policy_version 973354 (0.0009) [2023-12-26 07:21:48,060][123090] Updated weights for policy 1, policy_version 966472 (0.0009) [2023-12-26 07:21:48,126][123090] Updated weights for policy 1, policy_version 966482 (0.0011) [2023-12-26 07:21:48,195][123090] Updated weights for policy 1, policy_version 966492 (0.0011) [2023-12-26 07:21:48,780][123091] Updated weights for policy 0, policy_version 973364 (0.0009) [2023-12-26 07:21:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 496607232. Throughput: 0: 8787.6, 1: 8950.3. Samples: 496623624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:48,785][121949] Avg episode reward: [(0, '6081.398'), (1, '5817.486')] [2023-12-26 07:21:48,855][123091] Updated weights for policy 0, policy_version 973374 (0.0008) [2023-12-26 07:21:48,926][123091] Updated weights for policy 0, policy_version 973384 (0.0010) [2023-12-26 07:21:49,016][123090] Updated weights for policy 1, policy_version 966502 (0.0010) [2023-12-26 07:21:49,084][123090] Updated weights for policy 1, policy_version 966512 (0.0009) [2023-12-26 07:21:49,138][123090] Updated weights for policy 1, policy_version 966522 (0.0008) [2023-12-26 07:21:49,686][123091] Updated weights for policy 0, policy_version 973394 (0.0009) [2023-12-26 07:21:49,738][123091] Updated weights for policy 0, policy_version 973404 (0.0005) [2023-12-26 07:21:49,790][123091] Updated weights for policy 0, policy_version 973414 (0.0008) [2023-12-26 07:21:49,928][123090] Updated weights for policy 1, policy_version 966532 (0.0007) [2023-12-26 07:21:49,986][123090] Updated weights for policy 1, policy_version 966542 (0.0009) [2023-12-26 07:21:50,041][123090] Updated weights for policy 1, policy_version 966552 (0.0009) [2023-12-26 07:21:50,630][123091] Updated weights for policy 0, policy_version 973425 (0.0009) [2023-12-26 07:21:50,692][123091] Updated weights for policy 0, policy_version 973435 (0.0010) [2023-12-26 07:21:50,753][123091] Updated weights for policy 0, policy_version 973445 (0.0009) [2023-12-26 07:21:50,791][123090] Updated weights for policy 1, policy_version 966562 (0.0008) [2023-12-26 07:21:50,811][123091] Updated weights for policy 0, policy_version 973455 (0.0010) [2023-12-26 07:21:50,851][123090] Updated weights for policy 1, policy_version 966572 (0.0008) [2023-12-26 07:21:50,916][123090] Updated weights for policy 1, policy_version 966582 (0.0009) [2023-12-26 07:21:50,979][123090] Updated weights for policy 1, policy_version 966592 (0.0009) [2023-12-26 07:21:51,681][123091] Updated weights for policy 0, policy_version 973465 (0.0009) [2023-12-26 07:21:51,749][123091] Updated weights for policy 0, policy_version 973475 (0.0008) [2023-12-26 07:21:51,805][123091] Updated weights for policy 0, policy_version 973485 (0.0008) [2023-12-26 07:21:51,806][123090] Updated weights for policy 1, policy_version 966602 (0.0006) [2023-12-26 07:21:51,873][123090] Updated weights for policy 1, policy_version 966612 (0.0006) [2023-12-26 07:21:51,943][123090] Updated weights for policy 1, policy_version 966622 (0.0005) [2023-12-26 07:21:52,557][123091] Updated weights for policy 0, policy_version 973495 (0.0009) [2023-12-26 07:21:52,617][123091] Updated weights for policy 0, policy_version 973505 (0.0009) [2023-12-26 07:21:52,690][123091] Updated weights for policy 0, policy_version 973515 (0.0009) [2023-12-26 07:21:52,729][123090] Updated weights for policy 1, policy_version 966632 (0.0008) [2023-12-26 07:21:52,789][123090] Updated weights for policy 1, policy_version 966642 (0.0010) [2023-12-26 07:21:52,854][123090] Updated weights for policy 1, policy_version 966652 (0.0010) [2023-12-26 07:21:53,380][123091] Updated weights for policy 0, policy_version 973525 (0.0007) [2023-12-26 07:21:53,441][123091] Updated weights for policy 0, policy_version 973535 (0.0006) [2023-12-26 07:21:53,497][123091] Updated weights for policy 0, policy_version 973545 (0.0009) [2023-12-26 07:21:53,707][123090] Updated weights for policy 1, policy_version 966662 (0.0009) [2023-12-26 07:21:53,770][123090] Updated weights for policy 1, policy_version 966672 (0.0009) [2023-12-26 07:21:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.6). Total num frames: 496697344. Throughput: 0: 8788.1, 1: 8926.1. Samples: 496675896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:53,785][121949] Avg episode reward: [(0, '5965.710'), (1, '5803.728')] [2023-12-26 07:21:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000973552_249233408.pth... [2023-12-26 07:21:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000972528_248971264.pth [2023-12-26 07:21:53,838][123090] Updated weights for policy 1, policy_version 966682 (0.0010) [2023-12-26 07:21:53,871][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000966688_247472128.pth... [2023-12-26 07:21:53,876][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000965632_247201792.pth [2023-12-26 07:21:54,295][123091] Updated weights for policy 0, policy_version 973555 (0.0010) [2023-12-26 07:21:54,360][123091] Updated weights for policy 0, policy_version 973565 (0.0010) [2023-12-26 07:21:54,425][123091] Updated weights for policy 0, policy_version 973575 (0.0009) [2023-12-26 07:21:54,674][123090] Updated weights for policy 1, policy_version 966692 (0.0010) [2023-12-26 07:21:54,720][123090] Updated weights for policy 1, policy_version 966702 (0.0008) [2023-12-26 07:21:54,770][123090] Updated weights for policy 1, policy_version 966712 (0.0009) [2023-12-26 07:21:55,266][123091] Updated weights for policy 0, policy_version 973585 (0.0009) [2023-12-26 07:21:55,317][123091] Updated weights for policy 0, policy_version 973595 (0.0008) [2023-12-26 07:21:55,369][123091] Updated weights for policy 0, policy_version 973605 (0.0009) [2023-12-26 07:21:55,428][123091] Updated weights for policy 0, policy_version 973615 (0.0009) [2023-12-26 07:21:55,603][123090] Updated weights for policy 1, policy_version 966722 (0.0010) [2023-12-26 07:21:55,659][123090] Updated weights for policy 1, policy_version 966732 (0.0008) [2023-12-26 07:21:55,716][123090] Updated weights for policy 1, policy_version 966742 (0.0009) [2023-12-26 07:21:55,784][123090] Updated weights for policy 1, policy_version 966752 (0.0009) [2023-12-26 07:21:56,267][123091] Updated weights for policy 0, policy_version 973625 (0.0010) [2023-12-26 07:21:56,331][123091] Updated weights for policy 0, policy_version 973635 (0.0010) [2023-12-26 07:21:56,395][123091] Updated weights for policy 0, policy_version 973645 (0.0009) [2023-12-26 07:21:56,624][123090] Updated weights for policy 1, policy_version 966762 (0.0010) [2023-12-26 07:21:56,690][123090] Updated weights for policy 1, policy_version 966772 (0.0009) [2023-12-26 07:21:56,754][123090] Updated weights for policy 1, policy_version 966782 (0.0009) [2023-12-26 07:21:57,206][123091] Updated weights for policy 0, policy_version 973655 (0.0009) [2023-12-26 07:21:57,256][123091] Updated weights for policy 0, policy_version 973665 (0.0009) [2023-12-26 07:21:57,308][123091] Updated weights for policy 0, policy_version 973675 (0.0008) [2023-12-26 07:21:57,594][123090] Updated weights for policy 1, policy_version 966792 (0.0008) [2023-12-26 07:21:57,661][123090] Updated weights for policy 1, policy_version 966802 (0.0009) [2023-12-26 07:21:57,726][123090] Updated weights for policy 1, policy_version 966812 (0.0010) [2023-12-26 07:21:58,063][123091] Updated weights for policy 0, policy_version 973685 (0.0010) [2023-12-26 07:21:58,123][123091] Updated weights for policy 0, policy_version 973695 (0.0009) [2023-12-26 07:21:58,177][123091] Updated weights for policy 0, policy_version 973705 (0.0008) [2023-12-26 07:21:58,582][123090] Updated weights for policy 1, policy_version 966822 (0.0009) [2023-12-26 07:21:58,652][123090] Updated weights for policy 1, policy_version 966832 (0.0010) [2023-12-26 07:21:58,708][123090] Updated weights for policy 1, policy_version 966842 (0.0010) [2023-12-26 07:21:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 496787456. Throughput: 0: 8795.8, 1: 8920.7. Samples: 496779416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:21:58,785][121949] Avg episode reward: [(0, '5858.506'), (1, '5798.946')] [2023-12-26 07:21:59,085][123091] Updated weights for policy 0, policy_version 973715 (0.0009) [2023-12-26 07:21:59,149][123091] Updated weights for policy 0, policy_version 973725 (0.0011) [2023-12-26 07:21:59,220][123091] Updated weights for policy 0, policy_version 973735 (0.0010) [2023-12-26 07:21:59,516][123090] Updated weights for policy 1, policy_version 966852 (0.0007) [2023-12-26 07:21:59,589][123090] Updated weights for policy 1, policy_version 966862 (0.0005) [2023-12-26 07:21:59,660][123090] Updated weights for policy 1, policy_version 966872 (0.0005) [2023-12-26 07:22:00,086][123091] Updated weights for policy 0, policy_version 973745 (0.0011) [2023-12-26 07:22:00,140][123091] Updated weights for policy 0, policy_version 973755 (0.0006) [2023-12-26 07:22:00,202][123091] Updated weights for policy 0, policy_version 973765 (0.0008) [2023-12-26 07:22:00,266][123091] Updated weights for policy 0, policy_version 973775 (0.0010) [2023-12-26 07:22:00,338][123090] Updated weights for policy 1, policy_version 966882 (0.0008) [2023-12-26 07:22:00,394][123090] Updated weights for policy 1, policy_version 966892 (0.0005) [2023-12-26 07:22:00,441][123090] Updated weights for policy 1, policy_version 966902 (0.0005) [2023-12-26 07:22:00,488][123090] Updated weights for policy 1, policy_version 966912 (0.0005) [2023-12-26 07:22:01,085][123091] Updated weights for policy 0, policy_version 973785 (0.0009) [2023-12-26 07:22:01,152][123091] Updated weights for policy 0, policy_version 973795 (0.0007) [2023-12-26 07:22:01,186][123090] Updated weights for policy 1, policy_version 966922 (0.0010) [2023-12-26 07:22:01,217][123091] Updated weights for policy 0, policy_version 973805 (0.0010) [2023-12-26 07:22:01,241][123090] Updated weights for policy 1, policy_version 966932 (0.0010) [2023-12-26 07:22:01,312][123090] Updated weights for policy 1, policy_version 966942 (0.0010) [2023-12-26 07:22:02,020][123091] Updated weights for policy 0, policy_version 973815 (0.0011) [2023-12-26 07:22:02,084][123091] Updated weights for policy 0, policy_version 973825 (0.0011) [2023-12-26 07:22:02,116][123090] Updated weights for policy 1, policy_version 966952 (0.0009) [2023-12-26 07:22:02,147][123091] Updated weights for policy 0, policy_version 973835 (0.0011) [2023-12-26 07:22:02,167][123090] Updated weights for policy 1, policy_version 966962 (0.0006) [2023-12-26 07:22:02,217][123090] Updated weights for policy 1, policy_version 966972 (0.0005) [2023-12-26 07:22:02,872][123091] Updated weights for policy 0, policy_version 973845 (0.0010) [2023-12-26 07:22:02,924][123090] Updated weights for policy 1, policy_version 966982 (0.0006) [2023-12-26 07:22:02,931][123091] Updated weights for policy 0, policy_version 973855 (0.0011) [2023-12-26 07:22:02,989][123090] Updated weights for policy 1, policy_version 966992 (0.0008) [2023-12-26 07:22:02,993][123091] Updated weights for policy 0, policy_version 973865 (0.0010) [2023-12-26 07:22:03,042][123090] Updated weights for policy 1, policy_version 967002 (0.0008) [2023-12-26 07:22:03,697][123090] Updated weights for policy 1, policy_version 967012 (0.0005) [2023-12-26 07:22:03,747][123090] Updated weights for policy 1, policy_version 967022 (0.0005) [2023-12-26 07:22:03,778][123091] Updated weights for policy 0, policy_version 973875 (0.0009) [2023-12-26 07:22:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 496869376. Throughput: 0: 8738.0, 1: 8958.4. Samples: 496887672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:03,785][121949] Avg episode reward: [(0, '5967.810'), (1, '5883.897')] [2023-12-26 07:22:03,805][123090] Updated weights for policy 1, policy_version 967032 (0.0005) [2023-12-26 07:22:03,834][123091] Updated weights for policy 0, policy_version 973885 (0.0010) [2023-12-26 07:22:03,899][123091] Updated weights for policy 0, policy_version 973895 (0.0010) [2023-12-26 07:22:04,638][123090] Updated weights for policy 1, policy_version 967042 (0.0008) [2023-12-26 07:22:04,709][123090] Updated weights for policy 1, policy_version 967052 (0.0010) [2023-12-26 07:22:04,713][123091] Updated weights for policy 0, policy_version 973905 (0.0010) [2023-12-26 07:22:04,772][123090] Updated weights for policy 1, policy_version 967062 (0.0011) [2023-12-26 07:22:04,780][123091] Updated weights for policy 0, policy_version 973915 (0.0010) [2023-12-26 07:22:04,835][123090] Updated weights for policy 1, policy_version 967072 (0.0011) [2023-12-26 07:22:04,839][123091] Updated weights for policy 0, policy_version 973925 (0.0010) [2023-12-26 07:22:04,886][123091] Updated weights for policy 0, policy_version 973935 (0.0010) [2023-12-26 07:22:05,574][123090] Updated weights for policy 1, policy_version 967082 (0.0010) [2023-12-26 07:22:05,637][123090] Updated weights for policy 1, policy_version 967092 (0.0010) [2023-12-26 07:22:05,684][123091] Updated weights for policy 0, policy_version 973945 (0.0010) [2023-12-26 07:22:05,707][123090] Updated weights for policy 1, policy_version 967102 (0.0010) [2023-12-26 07:22:05,731][123091] Updated weights for policy 0, policy_version 973955 (0.0010) [2023-12-26 07:22:05,778][123091] Updated weights for policy 0, policy_version 973965 (0.0006) [2023-12-26 07:22:06,466][123090] Updated weights for policy 1, policy_version 967112 (0.0010) [2023-12-26 07:22:06,530][123090] Updated weights for policy 1, policy_version 967122 (0.0010) [2023-12-26 07:22:06,561][123091] Updated weights for policy 0, policy_version 973975 (0.0009) [2023-12-26 07:22:06,598][123090] Updated weights for policy 1, policy_version 967132 (0.0011) [2023-12-26 07:22:06,622][123091] Updated weights for policy 0, policy_version 973985 (0.0010) [2023-12-26 07:22:06,685][123091] Updated weights for policy 0, policy_version 973995 (0.0011) [2023-12-26 07:22:07,434][123090] Updated weights for policy 1, policy_version 967142 (0.0011) [2023-12-26 07:22:07,503][123090] Updated weights for policy 1, policy_version 967152 (0.0010) [2023-12-26 07:22:07,506][123091] Updated weights for policy 0, policy_version 974005 (0.0008) [2023-12-26 07:22:07,554][123091] Updated weights for policy 0, policy_version 974015 (0.0008) [2023-12-26 07:22:07,572][123090] Updated weights for policy 1, policy_version 967162 (0.0010) [2023-12-26 07:22:07,619][123091] Updated weights for policy 0, policy_version 974025 (0.0008) [2023-12-26 07:22:08,329][123090] Updated weights for policy 1, policy_version 967172 (0.0008) [2023-12-26 07:22:08,371][123091] Updated weights for policy 0, policy_version 974035 (0.0008) [2023-12-26 07:22:08,396][123090] Updated weights for policy 1, policy_version 967182 (0.0009) [2023-12-26 07:22:08,437][123091] Updated weights for policy 0, policy_version 974045 (0.0006) [2023-12-26 07:22:08,460][123090] Updated weights for policy 1, policy_version 967192 (0.0009) [2023-12-26 07:22:08,507][123091] Updated weights for policy 0, policy_version 974055 (0.0009) [2023-12-26 07:22:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 496967680. Throughput: 0: 8762.1, 1: 8989.2. Samples: 496941428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:08,785][121949] Avg episode reward: [(0, '6193.205'), (1, '5925.325')] [2023-12-26 07:22:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000974064_249364480.pth... [2023-12-26 07:22:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000967200_247603200.pth... [2023-12-26 07:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000966144_247332864.pth [2023-12-26 07:22:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000973040_249102336.pth [2023-12-26 07:22:09,193][123090] Updated weights for policy 1, policy_version 967202 (0.0007) [2023-12-26 07:22:09,209][123091] Updated weights for policy 0, policy_version 974065 (0.0010) [2023-12-26 07:22:09,261][123090] Updated weights for policy 1, policy_version 967212 (0.0010) [2023-12-26 07:22:09,276][123091] Updated weights for policy 0, policy_version 974075 (0.0009) [2023-12-26 07:22:09,314][123090] Updated weights for policy 1, policy_version 967222 (0.0010) [2023-12-26 07:22:09,344][123091] Updated weights for policy 0, policy_version 974085 (0.0008) [2023-12-26 07:22:09,387][123090] Updated weights for policy 1, policy_version 967232 (0.0011) [2023-12-26 07:22:09,417][123091] Updated weights for policy 0, policy_version 974095 (0.0008) [2023-12-26 07:22:10,211][123091] Updated weights for policy 0, policy_version 974105 (0.0007) [2023-12-26 07:22:10,219][123090] Updated weights for policy 1, policy_version 967242 (0.0008) [2023-12-26 07:22:10,283][123091] Updated weights for policy 0, policy_version 974115 (0.0008) [2023-12-26 07:22:10,288][123090] Updated weights for policy 1, policy_version 967252 (0.0011) [2023-12-26 07:22:10,344][123091] Updated weights for policy 0, policy_version 974125 (0.0010) [2023-12-26 07:22:10,355][123090] Updated weights for policy 1, policy_version 967262 (0.0010) [2023-12-26 07:22:11,149][123090] Updated weights for policy 1, policy_version 967272 (0.0010) [2023-12-26 07:22:11,178][123091] Updated weights for policy 0, policy_version 974135 (0.0009) [2023-12-26 07:22:11,212][123090] Updated weights for policy 1, policy_version 967282 (0.0010) [2023-12-26 07:22:11,244][123091] Updated weights for policy 0, policy_version 974145 (0.0008) [2023-12-26 07:22:11,281][123090] Updated weights for policy 1, policy_version 967292 (0.0010) [2023-12-26 07:22:11,316][123091] Updated weights for policy 0, policy_version 974155 (0.0009) [2023-12-26 07:22:12,067][123091] Updated weights for policy 0, policy_version 974165 (0.0009) [2023-12-26 07:22:12,115][123091] Updated weights for policy 0, policy_version 974175 (0.0009) [2023-12-26 07:22:12,162][123091] Updated weights for policy 0, policy_version 974185 (0.0008) [2023-12-26 07:22:12,162][123090] Updated weights for policy 1, policy_version 967302 (0.0010) [2023-12-26 07:22:12,225][123090] Updated weights for policy 1, policy_version 967312 (0.0010) [2023-12-26 07:22:12,293][123090] Updated weights for policy 1, policy_version 967322 (0.0011) [2023-12-26 07:22:13,060][123091] Updated weights for policy 0, policy_version 974195 (0.0009) [2023-12-26 07:22:13,111][123090] Updated weights for policy 1, policy_version 967332 (0.0011) [2023-12-26 07:22:13,127][123091] Updated weights for policy 0, policy_version 974205 (0.0007) [2023-12-26 07:22:13,167][123090] Updated weights for policy 1, policy_version 967342 (0.0010) [2023-12-26 07:22:13,183][123091] Updated weights for policy 0, policy_version 974215 (0.0007) [2023-12-26 07:22:13,229][123090] Updated weights for policy 1, policy_version 967352 (0.0010) [2023-12-26 07:22:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 497049600. Throughput: 0: 8771.7, 1: 8932.4. Samples: 497045388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:13,784][121949] Avg episode reward: [(0, '6168.840'), (1, '5935.963')] [2023-12-26 07:22:13,996][123091] Updated weights for policy 0, policy_version 974225 (0.0010) [2023-12-26 07:22:14,060][123090] Updated weights for policy 1, policy_version 967362 (0.0011) [2023-12-26 07:22:14,063][123091] Updated weights for policy 0, policy_version 974235 (0.0008) [2023-12-26 07:22:14,119][123090] Updated weights for policy 1, policy_version 967372 (0.0010) [2023-12-26 07:22:14,130][123091] Updated weights for policy 0, policy_version 974245 (0.0007) [2023-12-26 07:22:14,178][123090] Updated weights for policy 1, policy_version 967382 (0.0010) [2023-12-26 07:22:14,187][123091] Updated weights for policy 0, policy_version 974255 (0.0008) [2023-12-26 07:22:14,229][123090] Updated weights for policy 1, policy_version 967392 (0.0010) [2023-12-26 07:22:15,023][123091] Updated weights for policy 0, policy_version 974265 (0.0009) [2023-12-26 07:22:15,084][123091] Updated weights for policy 0, policy_version 974275 (0.0008) [2023-12-26 07:22:15,127][123090] Updated weights for policy 1, policy_version 967402 (0.0011) [2023-12-26 07:22:15,140][123091] Updated weights for policy 0, policy_version 974285 (0.0010) [2023-12-26 07:22:15,191][123090] Updated weights for policy 1, policy_version 967412 (0.0010) [2023-12-26 07:22:15,254][123090] Updated weights for policy 1, policy_version 967422 (0.0010) [2023-12-26 07:22:15,987][123091] Updated weights for policy 0, policy_version 974295 (0.0009) [2023-12-26 07:22:16,042][123091] Updated weights for policy 0, policy_version 974305 (0.0009) [2023-12-26 07:22:16,075][123090] Updated weights for policy 1, policy_version 967432 (0.0010) [2023-12-26 07:22:16,104][123091] Updated weights for policy 0, policy_version 974315 (0.0007) [2023-12-26 07:22:16,123][123090] Updated weights for policy 1, policy_version 967442 (0.0010) [2023-12-26 07:22:16,171][123090] Updated weights for policy 1, policy_version 967452 (0.0010) [2023-12-26 07:22:16,925][123091] Updated weights for policy 0, policy_version 974325 (0.0007) [2023-12-26 07:22:16,972][123091] Updated weights for policy 0, policy_version 974335 (0.0009) [2023-12-26 07:22:17,009][123090] Updated weights for policy 1, policy_version 967462 (0.0010) [2023-12-26 07:22:17,028][123091] Updated weights for policy 0, policy_version 974345 (0.0006) [2023-12-26 07:22:17,072][123090] Updated weights for policy 1, policy_version 967472 (0.0010) [2023-12-26 07:22:17,123][123090] Updated weights for policy 1, policy_version 967482 (0.0010) [2023-12-26 07:22:17,863][123091] Updated weights for policy 0, policy_version 974355 (0.0007) [2023-12-26 07:22:17,910][123091] Updated weights for policy 0, policy_version 974365 (0.0009) [2023-12-26 07:22:17,953][123090] Updated weights for policy 1, policy_version 967492 (0.0010) [2023-12-26 07:22:17,968][123091] Updated weights for policy 0, policy_version 974375 (0.0007) [2023-12-26 07:22:18,020][123090] Updated weights for policy 1, policy_version 967502 (0.0010) [2023-12-26 07:22:18,071][123090] Updated weights for policy 1, policy_version 967512 (0.0010) [2023-12-26 07:22:18,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 497131520. Throughput: 0: 8722.8, 1: 8869.8. Samples: 497147740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:18,785][121949] Avg episode reward: [(0, '6144.320'), (1, '5887.069')] [2023-12-26 07:22:18,818][123091] Updated weights for policy 0, policy_version 974385 (0.0007) [2023-12-26 07:22:18,882][123091] Updated weights for policy 0, policy_version 974395 (0.0009) [2023-12-26 07:22:18,889][123090] Updated weights for policy 1, policy_version 967522 (0.0010) [2023-12-26 07:22:18,945][123090] Updated weights for policy 1, policy_version 967532 (0.0010) [2023-12-26 07:22:18,952][123091] Updated weights for policy 0, policy_version 974405 (0.0009) [2023-12-26 07:22:19,006][123090] Updated weights for policy 1, policy_version 967542 (0.0010) [2023-12-26 07:22:19,017][123091] Updated weights for policy 0, policy_version 974415 (0.0006) [2023-12-26 07:22:19,058][123090] Updated weights for policy 1, policy_version 967552 (0.0010) [2023-12-26 07:22:19,854][123091] Updated weights for policy 0, policy_version 974425 (0.0008) [2023-12-26 07:22:19,927][123091] Updated weights for policy 0, policy_version 974435 (0.0009) [2023-12-26 07:22:19,935][123090] Updated weights for policy 1, policy_version 967562 (0.0009) [2023-12-26 07:22:19,995][123091] Updated weights for policy 0, policy_version 974445 (0.0010) [2023-12-26 07:22:20,001][123090] Updated weights for policy 1, policy_version 967572 (0.0008) [2023-12-26 07:22:20,072][123090] Updated weights for policy 1, policy_version 967582 (0.0009) [2023-12-26 07:22:20,824][123091] Updated weights for policy 0, policy_version 974455 (0.0010) [2023-12-26 07:22:20,893][123091] Updated weights for policy 0, policy_version 974465 (0.0009) [2023-12-26 07:22:20,931][123090] Updated weights for policy 1, policy_version 967592 (0.0009) [2023-12-26 07:22:20,960][123091] Updated weights for policy 0, policy_version 974475 (0.0007) [2023-12-26 07:22:20,986][123090] Updated weights for policy 1, policy_version 967602 (0.0008) [2023-12-26 07:22:21,050][123090] Updated weights for policy 1, policy_version 967612 (0.0009) [2023-12-26 07:22:21,749][123091] Updated weights for policy 0, policy_version 974485 (0.0009) [2023-12-26 07:22:21,807][123091] Updated weights for policy 0, policy_version 974495 (0.0009) [2023-12-26 07:22:21,863][123091] Updated weights for policy 0, policy_version 974505 (0.0010) [2023-12-26 07:22:21,968][123090] Updated weights for policy 1, policy_version 967622 (0.0009) [2023-12-26 07:22:22,035][123090] Updated weights for policy 1, policy_version 967632 (0.0008) [2023-12-26 07:22:22,103][123090] Updated weights for policy 1, policy_version 967642 (0.0010) [2023-12-26 07:22:22,736][123091] Updated weights for policy 0, policy_version 974515 (0.0009) [2023-12-26 07:22:22,798][123091] Updated weights for policy 0, policy_version 974525 (0.0009) [2023-12-26 07:22:22,847][123091] Updated weights for policy 0, policy_version 974535 (0.0009) [2023-12-26 07:22:22,934][123090] Updated weights for policy 1, policy_version 967652 (0.0008) [2023-12-26 07:22:22,996][123090] Updated weights for policy 1, policy_version 967662 (0.0010) [2023-12-26 07:22:23,048][123090] Updated weights for policy 1, policy_version 967672 (0.0010) [2023-12-26 07:22:23,702][123091] Updated weights for policy 0, policy_version 974545 (0.0010) [2023-12-26 07:22:23,772][123091] Updated weights for policy 0, policy_version 974555 (0.0010) [2023-12-26 07:22:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 497213440. Throughput: 0: 8669.8, 1: 8794.5. Samples: 497197484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:23,784][121949] Avg episode reward: [(0, '6197.402'), (1, '5883.946')] [2023-12-26 07:22:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000967680_247726080.pth... [2023-12-26 07:22:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000966688_247472128.pth [2023-12-26 07:22:23,836][123091] Updated weights for policy 0, policy_version 974565 (0.0007) [2023-12-26 07:22:23,896][123090] Updated weights for policy 1, policy_version 967682 (0.0009) [2023-12-26 07:22:23,900][123091] Updated weights for policy 0, policy_version 974575 (0.0006) [2023-12-26 07:22:23,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000974576_249495552.pth... [2023-12-26 07:22:23,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000973552_249233408.pth [2023-12-26 07:22:23,963][123090] Updated weights for policy 1, policy_version 967692 (0.0005) [2023-12-26 07:22:24,034][123090] Updated weights for policy 1, policy_version 967702 (0.0005) [2023-12-26 07:22:24,109][123090] Updated weights for policy 1, policy_version 967712 (0.0005) [2023-12-26 07:22:24,617][123091] Updated weights for policy 0, policy_version 974585 (0.0006) [2023-12-26 07:22:24,686][123091] Updated weights for policy 0, policy_version 974595 (0.0006) [2023-12-26 07:22:24,741][123091] Updated weights for policy 0, policy_version 974605 (0.0005) [2023-12-26 07:22:24,806][123090] Updated weights for policy 1, policy_version 967722 (0.0005) [2023-12-26 07:22:24,877][123090] Updated weights for policy 1, policy_version 967732 (0.0005) [2023-12-26 07:22:24,954][123090] Updated weights for policy 1, policy_version 967742 (0.0005) [2023-12-26 07:22:25,365][123091] Updated weights for policy 0, policy_version 974615 (0.0007) [2023-12-26 07:22:25,426][123091] Updated weights for policy 0, policy_version 974625 (0.0009) [2023-12-26 07:22:25,479][123091] Updated weights for policy 0, policy_version 974635 (0.0009) [2023-12-26 07:22:25,670][123090] Updated weights for policy 1, policy_version 967752 (0.0009) [2023-12-26 07:22:25,729][123090] Updated weights for policy 1, policy_version 967762 (0.0010) [2023-12-26 07:22:25,789][123090] Updated weights for policy 1, policy_version 967772 (0.0010) [2023-12-26 07:22:26,327][123091] Updated weights for policy 0, policy_version 974645 (0.0009) [2023-12-26 07:22:26,381][123091] Updated weights for policy 0, policy_version 974655 (0.0010) [2023-12-26 07:22:26,439][123091] Updated weights for policy 0, policy_version 974665 (0.0011) [2023-12-26 07:22:26,490][123090] Updated weights for policy 1, policy_version 967782 (0.0008) [2023-12-26 07:22:26,537][123090] Updated weights for policy 1, policy_version 967792 (0.0005) [2023-12-26 07:22:26,585][123090] Updated weights for policy 1, policy_version 967802 (0.0010) [2023-12-26 07:22:27,274][123091] Updated weights for policy 0, policy_version 974675 (0.0009) [2023-12-26 07:22:27,330][123091] Updated weights for policy 0, policy_version 974685 (0.0006) [2023-12-26 07:22:27,376][123090] Updated weights for policy 1, policy_version 967812 (0.0010) [2023-12-26 07:22:27,389][123091] Updated weights for policy 0, policy_version 974695 (0.0010) [2023-12-26 07:22:27,434][123090] Updated weights for policy 1, policy_version 967822 (0.0010) [2023-12-26 07:22:27,492][123090] Updated weights for policy 1, policy_version 967832 (0.0010) [2023-12-26 07:22:28,101][123091] Updated weights for policy 0, policy_version 974705 (0.0006) [2023-12-26 07:22:28,168][123091] Updated weights for policy 0, policy_version 974715 (0.0009) [2023-12-26 07:22:28,220][123091] Updated weights for policy 0, policy_version 974725 (0.0008) [2023-12-26 07:22:28,273][123091] Updated weights for policy 0, policy_version 974735 (0.0010) [2023-12-26 07:22:28,313][123090] Updated weights for policy 1, policy_version 967842 (0.0010) [2023-12-26 07:22:28,377][123090] Updated weights for policy 1, policy_version 967852 (0.0010) [2023-12-26 07:22:28,440][123090] Updated weights for policy 1, policy_version 967862 (0.0009) [2023-12-26 07:22:28,507][123090] Updated weights for policy 1, policy_version 967872 (0.0006) [2023-12-26 07:22:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 497311744. Throughput: 0: 8689.5, 1: 8802.9. Samples: 497304676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:28,785][121949] Avg episode reward: [(0, '6256.848'), (1, '5777.534')] [2023-12-26 07:22:29,099][123091] Updated weights for policy 0, policy_version 974745 (0.0011) [2023-12-26 07:22:29,153][123091] Updated weights for policy 0, policy_version 974755 (0.0010) [2023-12-26 07:22:29,211][123090] Updated weights for policy 1, policy_version 967882 (0.0010) [2023-12-26 07:22:29,220][123091] Updated weights for policy 0, policy_version 974765 (0.0011) [2023-12-26 07:22:29,272][123090] Updated weights for policy 1, policy_version 967892 (0.0010) [2023-12-26 07:22:29,327][123090] Updated weights for policy 1, policy_version 967902 (0.0010) [2023-12-26 07:22:30,089][123091] Updated weights for policy 0, policy_version 974775 (0.0010) [2023-12-26 07:22:30,140][123091] Updated weights for policy 0, policy_version 974785 (0.0010) [2023-12-26 07:22:30,188][123091] Updated weights for policy 0, policy_version 974795 (0.0010) [2023-12-26 07:22:30,191][123090] Updated weights for policy 1, policy_version 967912 (0.0006) [2023-12-26 07:22:30,257][123090] Updated weights for policy 1, policy_version 967922 (0.0005) [2023-12-26 07:22:30,320][123090] Updated weights for policy 1, policy_version 967932 (0.0005) [2023-12-26 07:22:30,990][123090] Updated weights for policy 1, policy_version 967942 (0.0005) [2023-12-26 07:22:31,040][123091] Updated weights for policy 0, policy_version 974805 (0.0011) [2023-12-26 07:22:31,061][123090] Updated weights for policy 1, policy_version 967952 (0.0007) [2023-12-26 07:22:31,103][123091] Updated weights for policy 0, policy_version 974815 (0.0011) [2023-12-26 07:22:31,127][123090] Updated weights for policy 1, policy_version 967962 (0.0008) [2023-12-26 07:22:31,170][123091] Updated weights for policy 0, policy_version 974825 (0.0010) [2023-12-26 07:22:31,835][123090] Updated weights for policy 1, policy_version 967972 (0.0008) [2023-12-26 07:22:31,889][123090] Updated weights for policy 1, policy_version 967982 (0.0007) [2023-12-26 07:22:31,949][123090] Updated weights for policy 1, policy_version 967992 (0.0005) [2023-12-26 07:22:31,957][123091] Updated weights for policy 0, policy_version 974835 (0.0010) [2023-12-26 07:22:32,020][123091] Updated weights for policy 0, policy_version 974845 (0.0011) [2023-12-26 07:22:32,094][123091] Updated weights for policy 0, policy_version 974855 (0.0011) [2023-12-26 07:22:32,643][123090] Updated weights for policy 1, policy_version 968002 (0.0006) [2023-12-26 07:22:32,698][123090] Updated weights for policy 1, policy_version 968012 (0.0008) [2023-12-26 07:22:32,769][123090] Updated weights for policy 1, policy_version 968022 (0.0009) [2023-12-26 07:22:32,827][123090] Updated weights for policy 1, policy_version 968032 (0.0008) [2023-12-26 07:22:32,882][123091] Updated weights for policy 0, policy_version 974865 (0.0010) [2023-12-26 07:22:32,928][123091] Updated weights for policy 0, policy_version 974875 (0.0010) [2023-12-26 07:22:32,978][123091] Updated weights for policy 0, policy_version 974885 (0.0010) [2023-12-26 07:22:33,029][123091] Updated weights for policy 0, policy_version 974895 (0.0010) [2023-12-26 07:22:33,587][123090] Updated weights for policy 1, policy_version 968042 (0.0010) [2023-12-26 07:22:33,643][123090] Updated weights for policy 1, policy_version 968052 (0.0010) [2023-12-26 07:22:33,695][123090] Updated weights for policy 1, policy_version 968062 (0.0008) [2023-12-26 07:22:33,781][123091] Updated weights for policy 0, policy_version 974905 (0.0010) [2023-12-26 07:22:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 497401856. Throughput: 0: 8733.7, 1: 8814.5. Samples: 497413292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:22:33,785][121949] Avg episode reward: [(0, '6221.487'), (1, '5881.833')] [2023-12-26 07:22:33,846][123091] Updated weights for policy 0, policy_version 974915 (0.0010) [2023-12-26 07:22:33,903][123091] Updated weights for policy 0, policy_version 974925 (0.0010) [2023-12-26 07:22:34,564][123090] Updated weights for policy 1, policy_version 968072 (0.0009) [2023-12-26 07:22:34,633][123090] Updated weights for policy 1, policy_version 968082 (0.0009) [2023-12-26 07:22:34,705][123090] Updated weights for policy 1, policy_version 968092 (0.0010) [2023-12-26 07:22:34,717][123091] Updated weights for policy 0, policy_version 974935 (0.0008) [2023-12-26 07:22:34,788][123091] Updated weights for policy 0, policy_version 974945 (0.0010) [2023-12-26 07:22:34,852][123091] Updated weights for policy 0, policy_version 974955 (0.0009) [2023-12-26 07:22:35,515][123090] Updated weights for policy 1, policy_version 968102 (0.0009) [2023-12-26 07:22:35,568][123090] Updated weights for policy 1, policy_version 968112 (0.0009) [2023-12-26 07:22:35,626][123090] Updated weights for policy 1, policy_version 968122 (0.0009) [2023-12-26 07:22:35,673][123091] Updated weights for policy 0, policy_version 974965 (0.0007) [2023-12-26 07:22:35,730][123091] Updated weights for policy 0, policy_version 974975 (0.0005) [2023-12-26 07:22:35,778][123091] Updated weights for policy 0, policy_version 974985 (0.0008) [2023-12-26 07:22:36,514][123090] Updated weights for policy 1, policy_version 968132 (0.0007) [2023-12-26 07:22:36,537][123091] Updated weights for policy 0, policy_version 974995 (0.0009) [2023-12-26 07:22:36,579][123090] Updated weights for policy 1, policy_version 968142 (0.0005) [2023-12-26 07:22:36,610][123091] Updated weights for policy 0, policy_version 975005 (0.0010) [2023-12-26 07:22:36,652][123090] Updated weights for policy 1, policy_version 968152 (0.0006) [2023-12-26 07:22:36,678][123091] Updated weights for policy 0, policy_version 975015 (0.0011) [2023-12-26 07:22:37,346][123090] Updated weights for policy 1, policy_version 968162 (0.0008) [2023-12-26 07:22:37,397][123090] Updated weights for policy 1, policy_version 968172 (0.0005) [2023-12-26 07:22:37,454][123090] Updated weights for policy 1, policy_version 968182 (0.0005) [2023-12-26 07:22:37,487][123091] Updated weights for policy 0, policy_version 975025 (0.0010) [2023-12-26 07:22:37,508][123090] Updated weights for policy 1, policy_version 968192 (0.0005) [2023-12-26 07:22:37,543][123091] Updated weights for policy 0, policy_version 975035 (0.0010) [2023-12-26 07:22:37,590][123091] Updated weights for policy 0, policy_version 975045 (0.0010) [2023-12-26 07:22:37,643][123091] Updated weights for policy 0, policy_version 975055 (0.0010) [2023-12-26 07:22:38,181][123090] Updated weights for policy 1, policy_version 968202 (0.0008) [2023-12-26 07:22:38,248][123090] Updated weights for policy 1, policy_version 968212 (0.0008) [2023-12-26 07:22:38,300][123090] Updated weights for policy 1, policy_version 968222 (0.0007) [2023-12-26 07:22:38,402][123091] Updated weights for policy 0, policy_version 975065 (0.0010) [2023-12-26 07:22:38,468][123091] Updated weights for policy 0, policy_version 975075 (0.0010) [2023-12-26 07:22:38,536][123091] Updated weights for policy 0, policy_version 975085 (0.0010) [2023-12-26 07:22:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 497491968. Throughput: 0: 8753.1, 1: 8782.2. Samples: 497464984. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:22:38,785][121949] Avg episode reward: [(0, '6166.513'), (1, '5956.228')] [2023-12-26 07:22:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000975088_249626624.pth... [2023-12-26 07:22:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000968224_247865344.pth... [2023-12-26 07:22:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000967200_247603200.pth [2023-12-26 07:22:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000974064_249364480.pth [2023-12-26 07:22:39,115][123090] Updated weights for policy 1, policy_version 968232 (0.0010) [2023-12-26 07:22:39,179][123090] Updated weights for policy 1, policy_version 968242 (0.0010) [2023-12-26 07:22:39,251][123090] Updated weights for policy 1, policy_version 968252 (0.0011) [2023-12-26 07:22:39,341][123091] Updated weights for policy 0, policy_version 975095 (0.0008) [2023-12-26 07:22:39,411][123091] Updated weights for policy 0, policy_version 975105 (0.0008) [2023-12-26 07:22:39,478][123091] Updated weights for policy 0, policy_version 975115 (0.0009) [2023-12-26 07:22:40,037][123090] Updated weights for policy 1, policy_version 968262 (0.0011) [2023-12-26 07:22:40,088][123090] Updated weights for policy 1, policy_version 968272 (0.0009) [2023-12-26 07:22:40,137][123090] Updated weights for policy 1, policy_version 968282 (0.0006) [2023-12-26 07:22:40,242][123091] Updated weights for policy 0, policy_version 975125 (0.0008) [2023-12-26 07:22:40,305][123091] Updated weights for policy 0, policy_version 975135 (0.0006) [2023-12-26 07:22:40,355][123091] Updated weights for policy 0, policy_version 975145 (0.0006) [2023-12-26 07:22:40,932][123090] Updated weights for policy 1, policy_version 968292 (0.0009) [2023-12-26 07:22:40,994][123090] Updated weights for policy 1, policy_version 968302 (0.0010) [2023-12-26 07:22:41,063][123090] Updated weights for policy 1, policy_version 968312 (0.0009) [2023-12-26 07:22:41,168][123091] Updated weights for policy 0, policy_version 975155 (0.0009) [2023-12-26 07:22:41,232][123091] Updated weights for policy 0, policy_version 975165 (0.0010) [2023-12-26 07:22:41,302][123091] Updated weights for policy 0, policy_version 975175 (0.0011) [2023-12-26 07:22:41,971][123090] Updated weights for policy 1, policy_version 968322 (0.0010) [2023-12-26 07:22:42,021][123090] Updated weights for policy 1, policy_version 968332 (0.0009) [2023-12-26 07:22:42,081][123090] Updated weights for policy 1, policy_version 968342 (0.0009) [2023-12-26 07:22:42,145][123090] Updated weights for policy 1, policy_version 968352 (0.0009) [2023-12-26 07:22:42,147][123091] Updated weights for policy 0, policy_version 975185 (0.0009) [2023-12-26 07:22:42,206][123091] Updated weights for policy 0, policy_version 975195 (0.0010) [2023-12-26 07:22:42,270][123091] Updated weights for policy 0, policy_version 975205 (0.0011) [2023-12-26 07:22:42,336][123091] Updated weights for policy 0, policy_version 975215 (0.0011) [2023-12-26 07:22:42,921][123090] Updated weights for policy 1, policy_version 968362 (0.0005) [2023-12-26 07:22:42,993][123090] Updated weights for policy 1, policy_version 968372 (0.0005) [2023-12-26 07:22:43,064][123090] Updated weights for policy 1, policy_version 968382 (0.0006) [2023-12-26 07:22:43,133][123091] Updated weights for policy 0, policy_version 975225 (0.0010) [2023-12-26 07:22:43,196][123091] Updated weights for policy 0, policy_version 975235 (0.0011) [2023-12-26 07:22:43,263][123091] Updated weights for policy 0, policy_version 975245 (0.0011) [2023-12-26 07:22:43,700][123090] Updated weights for policy 1, policy_version 968392 (0.0008) [2023-12-26 07:22:43,768][123090] Updated weights for policy 1, policy_version 968402 (0.0007) [2023-12-26 07:22:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 497573888. Throughput: 0: 8742.9, 1: 8840.3. Samples: 497570660. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:22:43,784][121949] Avg episode reward: [(0, '6091.391'), (1, '5938.283')] [2023-12-26 07:22:43,823][123090] Updated weights for policy 1, policy_version 968412 (0.0005) [2023-12-26 07:22:43,947][123091] Updated weights for policy 0, policy_version 975255 (0.0008) [2023-12-26 07:22:44,001][123091] Updated weights for policy 0, policy_version 975265 (0.0010) [2023-12-26 07:22:44,053][123091] Updated weights for policy 0, policy_version 975275 (0.0010) [2023-12-26 07:22:44,559][123090] Updated weights for policy 1, policy_version 968422 (0.0007) [2023-12-26 07:22:44,619][123090] Updated weights for policy 1, policy_version 968432 (0.0009) [2023-12-26 07:22:44,670][123090] Updated weights for policy 1, policy_version 968442 (0.0007) [2023-12-26 07:22:44,861][123091] Updated weights for policy 0, policy_version 975285 (0.0008) [2023-12-26 07:22:44,934][123091] Updated weights for policy 0, policy_version 975295 (0.0006) [2023-12-26 07:22:44,999][123091] Updated weights for policy 0, policy_version 975305 (0.0009) [2023-12-26 07:22:45,518][123090] Updated weights for policy 1, policy_version 968452 (0.0010) [2023-12-26 07:22:45,567][123090] Updated weights for policy 1, policy_version 968462 (0.0009) [2023-12-26 07:22:45,626][123090] Updated weights for policy 1, policy_version 968472 (0.0010) [2023-12-26 07:22:45,725][123091] Updated weights for policy 0, policy_version 975315 (0.0010) [2023-12-26 07:22:45,772][123091] Updated weights for policy 0, policy_version 975325 (0.0009) [2023-12-26 07:22:45,819][123091] Updated weights for policy 0, policy_version 975335 (0.0009) [2023-12-26 07:22:46,473][123090] Updated weights for policy 1, policy_version 968482 (0.0008) [2023-12-26 07:22:46,537][123090] Updated weights for policy 1, policy_version 968492 (0.0009) [2023-12-26 07:22:46,604][123090] Updated weights for policy 1, policy_version 968502 (0.0010) [2023-12-26 07:22:46,625][123091] Updated weights for policy 0, policy_version 975346 (0.0007) [2023-12-26 07:22:46,669][123090] Updated weights for policy 1, policy_version 968512 (0.0008) [2023-12-26 07:22:46,699][123091] Updated weights for policy 0, policy_version 975356 (0.0007) [2023-12-26 07:22:46,756][123091] Updated weights for policy 0, policy_version 975366 (0.0007) [2023-12-26 07:22:46,822][123091] Updated weights for policy 0, policy_version 975376 (0.0005) [2023-12-26 07:22:47,524][123090] Updated weights for policy 1, policy_version 968522 (0.0009) [2023-12-26 07:22:47,535][123091] Updated weights for policy 0, policy_version 975386 (0.0008) [2023-12-26 07:22:47,581][123090] Updated weights for policy 1, policy_version 968532 (0.0008) [2023-12-26 07:22:47,599][123091] Updated weights for policy 0, policy_version 975396 (0.0009) [2023-12-26 07:22:47,643][123090] Updated weights for policy 1, policy_version 968542 (0.0007) [2023-12-26 07:22:47,660][123091] Updated weights for policy 0, policy_version 975406 (0.0009) [2023-12-26 07:22:48,417][123091] Updated weights for policy 0, policy_version 975416 (0.0009) [2023-12-26 07:22:48,474][123091] Updated weights for policy 0, policy_version 975426 (0.0008) [2023-12-26 07:22:48,494][123090] Updated weights for policy 1, policy_version 968552 (0.0009) [2023-12-26 07:22:48,538][123091] Updated weights for policy 0, policy_version 975436 (0.0009) [2023-12-26 07:22:48,554][123090] Updated weights for policy 1, policy_version 968562 (0.0007) [2023-12-26 07:22:48,618][123090] Updated weights for policy 1, policy_version 968572 (0.0009) [2023-12-26 07:22:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 497672192. Throughput: 0: 8800.7, 1: 8768.2. Samples: 497678272. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:22:48,785][121949] Avg episode reward: [(0, '6099.758'), (1, '5916.195')] [2023-12-26 07:22:49,353][123091] Updated weights for policy 0, policy_version 975446 (0.0009) [2023-12-26 07:22:49,421][123091] Updated weights for policy 0, policy_version 975456 (0.0007) [2023-12-26 07:22:49,459][123090] Updated weights for policy 1, policy_version 968582 (0.0007) [2023-12-26 07:22:49,488][123091] Updated weights for policy 0, policy_version 975466 (0.0010) [2023-12-26 07:22:49,528][123090] Updated weights for policy 1, policy_version 968592 (0.0008) [2023-12-26 07:22:49,603][123090] Updated weights for policy 1, policy_version 968602 (0.0009) [2023-12-26 07:22:50,326][123091] Updated weights for policy 0, policy_version 975476 (0.0009) [2023-12-26 07:22:50,381][123091] Updated weights for policy 0, policy_version 975486 (0.0010) [2023-12-26 07:22:50,423][123090] Updated weights for policy 1, policy_version 968612 (0.0008) [2023-12-26 07:22:50,429][123091] Updated weights for policy 0, policy_version 975496 (0.0008) [2023-12-26 07:22:50,469][123090] Updated weights for policy 1, policy_version 968622 (0.0005) [2023-12-26 07:22:50,521][123090] Updated weights for policy 1, policy_version 968632 (0.0009) [2023-12-26 07:22:51,187][123091] Updated weights for policy 0, policy_version 975506 (0.0009) [2023-12-26 07:22:51,255][123091] Updated weights for policy 0, policy_version 975516 (0.0009) [2023-12-26 07:22:51,309][123091] Updated weights for policy 0, policy_version 975526 (0.0009) [2023-12-26 07:22:51,370][123091] Updated weights for policy 0, policy_version 975536 (0.0010) [2023-12-26 07:22:51,444][123090] Updated weights for policy 1, policy_version 968642 (0.0010) [2023-12-26 07:22:51,511][123090] Updated weights for policy 1, policy_version 968652 (0.0011) [2023-12-26 07:22:51,578][123090] Updated weights for policy 1, policy_version 968662 (0.0009) [2023-12-26 07:22:51,651][123090] Updated weights for policy 1, policy_version 968672 (0.0010) [2023-12-26 07:22:52,174][123091] Updated weights for policy 0, policy_version 975546 (0.0009) [2023-12-26 07:22:52,225][123091] Updated weights for policy 0, policy_version 975556 (0.0009) [2023-12-26 07:22:52,289][123091] Updated weights for policy 0, policy_version 975566 (0.0007) [2023-12-26 07:22:52,434][123090] Updated weights for policy 1, policy_version 968682 (0.0008) [2023-12-26 07:22:52,495][123090] Updated weights for policy 1, policy_version 968692 (0.0009) [2023-12-26 07:22:52,553][123090] Updated weights for policy 1, policy_version 968702 (0.0006) [2023-12-26 07:22:53,062][123091] Updated weights for policy 0, policy_version 975576 (0.0008) [2023-12-26 07:22:53,108][123091] Updated weights for policy 0, policy_version 975586 (0.0010) [2023-12-26 07:22:53,169][123091] Updated weights for policy 0, policy_version 975596 (0.0010) [2023-12-26 07:22:53,341][123090] Updated weights for policy 1, policy_version 968712 (0.0009) [2023-12-26 07:22:53,398][123090] Updated weights for policy 1, policy_version 968722 (0.0010) [2023-12-26 07:22:53,483][123090] Updated weights for policy 1, policy_version 968732 (0.0010) [2023-12-26 07:22:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17689.3). Total num frames: 497754112. Throughput: 0: 8784.5, 1: 8720.0. Samples: 497729132. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:22:53,784][121949] Avg episode reward: [(0, '6238.564'), (1, '5938.234')] [2023-12-26 07:22:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000975600_249757696.pth... [2023-12-26 07:22:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000968736_247996416.pth... [2023-12-26 07:22:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000967680_247726080.pth [2023-12-26 07:22:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000974576_249495552.pth [2023-12-26 07:22:53,903][123091] Updated weights for policy 0, policy_version 975606 (0.0007) [2023-12-26 07:22:53,969][123091] Updated weights for policy 0, policy_version 975616 (0.0006) [2023-12-26 07:22:54,040][123091] Updated weights for policy 0, policy_version 975626 (0.0009) [2023-12-26 07:22:54,326][123090] Updated weights for policy 1, policy_version 968742 (0.0010) [2023-12-26 07:22:54,386][123090] Updated weights for policy 1, policy_version 968752 (0.0009) [2023-12-26 07:22:54,459][123090] Updated weights for policy 1, policy_version 968762 (0.0007) [2023-12-26 07:22:54,841][123091] Updated weights for policy 0, policy_version 975636 (0.0009) [2023-12-26 07:22:54,899][123091] Updated weights for policy 0, policy_version 975647 (0.0010) [2023-12-26 07:22:54,964][123091] Updated weights for policy 0, policy_version 975657 (0.0010) [2023-12-26 07:22:55,223][123090] Updated weights for policy 1, policy_version 968772 (0.0006) [2023-12-26 07:22:55,294][123090] Updated weights for policy 1, policy_version 968782 (0.0005) [2023-12-26 07:22:55,363][123090] Updated weights for policy 1, policy_version 968792 (0.0005) [2023-12-26 07:22:55,771][123091] Updated weights for policy 0, policy_version 975667 (0.0009) [2023-12-26 07:22:55,850][123091] Updated weights for policy 0, policy_version 975677 (0.0010) [2023-12-26 07:22:55,910][123091] Updated weights for policy 0, policy_version 975687 (0.0010) [2023-12-26 07:22:56,015][123090] Updated weights for policy 1, policy_version 968802 (0.0006) [2023-12-26 07:22:56,084][123090] Updated weights for policy 1, policy_version 968812 (0.0010) [2023-12-26 07:22:56,143][123090] Updated weights for policy 1, policy_version 968822 (0.0009) [2023-12-26 07:22:56,195][123090] Updated weights for policy 1, policy_version 968832 (0.0010) [2023-12-26 07:22:56,753][123091] Updated weights for policy 0, policy_version 975697 (0.0009) [2023-12-26 07:22:56,815][123091] Updated weights for policy 0, policy_version 975707 (0.0010) [2023-12-26 07:22:56,863][123091] Updated weights for policy 0, policy_version 975717 (0.0009) [2023-12-26 07:22:56,915][123091] Updated weights for policy 0, policy_version 975727 (0.0009) [2023-12-26 07:22:56,968][123090] Updated weights for policy 1, policy_version 968842 (0.0006) [2023-12-26 07:22:57,035][123090] Updated weights for policy 1, policy_version 968852 (0.0007) [2023-12-26 07:22:57,092][123090] Updated weights for policy 1, policy_version 968862 (0.0009) [2023-12-26 07:22:57,761][123091] Updated weights for policy 0, policy_version 975737 (0.0009) [2023-12-26 07:22:57,814][123091] Updated weights for policy 0, policy_version 975747 (0.0009) [2023-12-26 07:22:57,875][123091] Updated weights for policy 0, policy_version 975757 (0.0009) [2023-12-26 07:22:57,907][123090] Updated weights for policy 1, policy_version 968872 (0.0008) [2023-12-26 07:22:57,962][123090] Updated weights for policy 1, policy_version 968882 (0.0009) [2023-12-26 07:22:58,011][123090] Updated weights for policy 1, policy_version 968892 (0.0008) [2023-12-26 07:22:58,768][123091] Updated weights for policy 0, policy_version 975767 (0.0009) [2023-12-26 07:22:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 497836032. Throughput: 0: 8787.8, 1: 8782.5. Samples: 497836056. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:22:58,785][121949] Avg episode reward: [(0, '6037.101'), (1, '6015.775')] [2023-12-26 07:22:58,834][123091] Updated weights for policy 0, policy_version 975777 (0.0009) [2023-12-26 07:22:58,843][123090] Updated weights for policy 1, policy_version 968902 (0.0007) [2023-12-26 07:22:58,890][123090] Updated weights for policy 1, policy_version 968912 (0.0008) [2023-12-26 07:22:58,895][123091] Updated weights for policy 0, policy_version 975787 (0.0009) [2023-12-26 07:22:58,944][123090] Updated weights for policy 1, policy_version 968922 (0.0009) [2023-12-26 07:22:59,748][123091] Updated weights for policy 0, policy_version 975797 (0.0008) [2023-12-26 07:22:59,774][123090] Updated weights for policy 1, policy_version 968932 (0.0008) [2023-12-26 07:22:59,806][123091] Updated weights for policy 0, policy_version 975807 (0.0010) [2023-12-26 07:22:59,840][123090] Updated weights for policy 1, policy_version 968942 (0.0007) [2023-12-26 07:22:59,869][123091] Updated weights for policy 0, policy_version 975817 (0.0009) [2023-12-26 07:22:59,895][123090] Updated weights for policy 1, policy_version 968952 (0.0006) [2023-12-26 07:23:00,565][123090] Updated weights for policy 1, policy_version 968962 (0.0006) [2023-12-26 07:23:00,623][123090] Updated weights for policy 1, policy_version 968972 (0.0005) [2023-12-26 07:23:00,684][123090] Updated weights for policy 1, policy_version 968982 (0.0005) [2023-12-26 07:23:00,729][123091] Updated weights for policy 0, policy_version 975827 (0.0008) [2023-12-26 07:23:00,754][123090] Updated weights for policy 1, policy_version 968992 (0.0006) [2023-12-26 07:23:00,789][123091] Updated weights for policy 0, policy_version 975837 (0.0009) [2023-12-26 07:23:00,842][123091] Updated weights for policy 0, policy_version 975847 (0.0009) [2023-12-26 07:23:01,536][123090] Updated weights for policy 1, policy_version 969002 (0.0005) [2023-12-26 07:23:01,605][123090] Updated weights for policy 1, policy_version 969012 (0.0006) [2023-12-26 07:23:01,677][123090] Updated weights for policy 1, policy_version 969022 (0.0009) [2023-12-26 07:23:01,689][123091] Updated weights for policy 0, policy_version 975857 (0.0008) [2023-12-26 07:23:01,759][123091] Updated weights for policy 0, policy_version 975867 (0.0009) [2023-12-26 07:23:01,828][123091] Updated weights for policy 0, policy_version 975877 (0.0006) [2023-12-26 07:23:01,897][123091] Updated weights for policy 0, policy_version 975887 (0.0008) [2023-12-26 07:23:02,509][123090] Updated weights for policy 1, policy_version 969032 (0.0009) [2023-12-26 07:23:02,572][123090] Updated weights for policy 1, policy_version 969042 (0.0010) [2023-12-26 07:23:02,619][123091] Updated weights for policy 0, policy_version 975897 (0.0009) [2023-12-26 07:23:02,634][123090] Updated weights for policy 1, policy_version 969052 (0.0009) [2023-12-26 07:23:02,681][123091] Updated weights for policy 0, policy_version 975907 (0.0008) [2023-12-26 07:23:02,747][123091] Updated weights for policy 0, policy_version 975917 (0.0009) [2023-12-26 07:23:03,462][123090] Updated weights for policy 1, policy_version 969062 (0.0009) [2023-12-26 07:23:03,516][123090] Updated weights for policy 1, policy_version 969072 (0.0008) [2023-12-26 07:23:03,551][123091] Updated weights for policy 0, policy_version 975927 (0.0008) [2023-12-26 07:23:03,577][123090] Updated weights for policy 1, policy_version 969082 (0.0009) [2023-12-26 07:23:03,608][123091] Updated weights for policy 0, policy_version 975937 (0.0007) [2023-12-26 07:23:03,656][123091] Updated weights for policy 0, policy_version 975947 (0.0009) [2023-12-26 07:23:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 497934336. Throughput: 0: 8782.7, 1: 8830.5. Samples: 497940332. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:03,785][121949] Avg episode reward: [(0, '5926.449'), (1, '6042.943')] [2023-12-26 07:23:04,390][123090] Updated weights for policy 1, policy_version 969092 (0.0010) [2023-12-26 07:23:04,403][123091] Updated weights for policy 0, policy_version 975957 (0.0008) [2023-12-26 07:23:04,450][123090] Updated weights for policy 1, policy_version 969102 (0.0010) [2023-12-26 07:23:04,457][123091] Updated weights for policy 0, policy_version 975967 (0.0008) [2023-12-26 07:23:04,512][123091] Updated weights for policy 0, policy_version 975977 (0.0009) [2023-12-26 07:23:04,513][123090] Updated weights for policy 1, policy_version 969112 (0.0010) [2023-12-26 07:23:05,221][123090] Updated weights for policy 1, policy_version 969122 (0.0010) [2023-12-26 07:23:05,268][123090] Updated weights for policy 1, policy_version 969132 (0.0010) [2023-12-26 07:23:05,322][123090] Updated weights for policy 1, policy_version 969142 (0.0010) [2023-12-26 07:23:05,324][123091] Updated weights for policy 0, policy_version 975987 (0.0006) [2023-12-26 07:23:05,377][123090] Updated weights for policy 1, policy_version 969152 (0.0010) [2023-12-26 07:23:05,381][123091] Updated weights for policy 0, policy_version 975997 (0.0005) [2023-12-26 07:23:05,449][123091] Updated weights for policy 0, policy_version 976007 (0.0005) [2023-12-26 07:23:06,010][123090] Updated weights for policy 1, policy_version 969162 (0.0005) [2023-12-26 07:23:06,063][123090] Updated weights for policy 1, policy_version 969172 (0.0005) [2023-12-26 07:23:06,126][123090] Updated weights for policy 1, policy_version 969182 (0.0007) [2023-12-26 07:23:06,161][123091] Updated weights for policy 0, policy_version 976017 (0.0005) [2023-12-26 07:23:06,218][123091] Updated weights for policy 0, policy_version 976027 (0.0010) [2023-12-26 07:23:06,275][123091] Updated weights for policy 0, policy_version 976037 (0.0011) [2023-12-26 07:23:06,342][123091] Updated weights for policy 0, policy_version 976047 (0.0011) [2023-12-26 07:23:06,877][123090] Updated weights for policy 1, policy_version 969192 (0.0009) [2023-12-26 07:23:06,941][123090] Updated weights for policy 1, policy_version 969202 (0.0009) [2023-12-26 07:23:07,004][123090] Updated weights for policy 1, policy_version 969212 (0.0007) [2023-12-26 07:23:07,112][123091] Updated weights for policy 0, policy_version 976057 (0.0006) [2023-12-26 07:23:07,163][123091] Updated weights for policy 0, policy_version 976067 (0.0006) [2023-12-26 07:23:07,219][123091] Updated weights for policy 0, policy_version 976077 (0.0005) [2023-12-26 07:23:07,840][123090] Updated weights for policy 1, policy_version 969222 (0.0008) [2023-12-26 07:23:07,904][123091] Updated weights for policy 0, policy_version 976087 (0.0006) [2023-12-26 07:23:07,915][123090] Updated weights for policy 1, policy_version 969232 (0.0010) [2023-12-26 07:23:07,956][123091] Updated weights for policy 0, policy_version 976097 (0.0005) [2023-12-26 07:23:07,990][123090] Updated weights for policy 1, policy_version 969242 (0.0010) [2023-12-26 07:23:08,012][123091] Updated weights for policy 0, policy_version 976107 (0.0005) [2023-12-26 07:23:08,768][123090] Updated weights for policy 1, policy_version 969252 (0.0009) [2023-12-26 07:23:08,784][123091] Updated weights for policy 0, policy_version 976117 (0.0007) [2023-12-26 07:23:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 498016256. Throughput: 0: 8832.2, 1: 8922.8. Samples: 497996460. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:08,785][121949] Avg episode reward: [(0, '6138.947'), (1, '6040.137')] [2023-12-26 07:23:08,840][123090] Updated weights for policy 1, policy_version 969262 (0.0008) [2023-12-26 07:23:08,847][123091] Updated weights for policy 0, policy_version 976127 (0.0008) [2023-12-26 07:23:08,909][123090] Updated weights for policy 1, policy_version 969272 (0.0006) [2023-12-26 07:23:08,911][123091] Updated weights for policy 0, policy_version 976137 (0.0011) [2023-12-26 07:23:08,955][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000976144_249896960.pth... [2023-12-26 07:23:08,958][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000975088_249626624.pth [2023-12-26 07:23:08,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000969280_248135680.pth... [2023-12-26 07:23:08,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000968224_247865344.pth [2023-12-26 07:23:09,676][123090] Updated weights for policy 1, policy_version 969282 (0.0006) [2023-12-26 07:23:09,691][123091] Updated weights for policy 0, policy_version 976147 (0.0010) [2023-12-26 07:23:09,738][123090] Updated weights for policy 1, policy_version 969292 (0.0006) [2023-12-26 07:23:09,752][123091] Updated weights for policy 0, policy_version 976157 (0.0009) [2023-12-26 07:23:09,803][123090] Updated weights for policy 1, policy_version 969302 (0.0009) [2023-12-26 07:23:09,810][123091] Updated weights for policy 0, policy_version 976167 (0.0008) [2023-12-26 07:23:09,861][123090] Updated weights for policy 1, policy_version 969312 (0.0008) [2023-12-26 07:23:10,602][123090] Updated weights for policy 1, policy_version 969322 (0.0010) [2023-12-26 07:23:10,654][123090] Updated weights for policy 1, policy_version 969332 (0.0010) [2023-12-26 07:23:10,707][123091] Updated weights for policy 0, policy_version 976177 (0.0009) [2023-12-26 07:23:10,712][123090] Updated weights for policy 1, policy_version 969342 (0.0009) [2023-12-26 07:23:10,807][123091] Updated weights for policy 0, policy_version 976187 (0.0007) [2023-12-26 07:23:10,881][123091] Updated weights for policy 0, policy_version 976197 (0.0005) [2023-12-26 07:23:10,956][123091] Updated weights for policy 0, policy_version 976207 (0.0005) [2023-12-26 07:23:11,542][123090] Updated weights for policy 1, policy_version 969352 (0.0008) [2023-12-26 07:23:11,570][123091] Updated weights for policy 0, policy_version 976217 (0.0005) [2023-12-26 07:23:11,602][123090] Updated weights for policy 1, policy_version 969362 (0.0006) [2023-12-26 07:23:11,636][123091] Updated weights for policy 0, policy_version 976227 (0.0007) [2023-12-26 07:23:11,672][123090] Updated weights for policy 1, policy_version 969372 (0.0009) [2023-12-26 07:23:11,696][123091] Updated weights for policy 0, policy_version 976237 (0.0011) [2023-12-26 07:23:12,479][123090] Updated weights for policy 1, policy_version 969382 (0.0011) [2023-12-26 07:23:12,546][123090] Updated weights for policy 1, policy_version 969392 (0.0011) [2023-12-26 07:23:12,574][123091] Updated weights for policy 0, policy_version 976247 (0.0008) [2023-12-26 07:23:12,610][123090] Updated weights for policy 1, policy_version 969402 (0.0011) [2023-12-26 07:23:12,640][123091] Updated weights for policy 0, policy_version 976257 (0.0007) [2023-12-26 07:23:12,703][123091] Updated weights for policy 0, policy_version 976267 (0.0009) [2023-12-26 07:23:13,434][123091] Updated weights for policy 0, policy_version 976277 (0.0007) [2023-12-26 07:23:13,434][123090] Updated weights for policy 1, policy_version 969412 (0.0009) [2023-12-26 07:23:13,487][123090] Updated weights for policy 1, policy_version 969422 (0.0010) [2023-12-26 07:23:13,488][123091] Updated weights for policy 0, policy_version 976287 (0.0006) [2023-12-26 07:23:13,542][123090] Updated weights for policy 1, policy_version 969432 (0.0010) [2023-12-26 07:23:13,553][123091] Updated weights for policy 0, policy_version 976297 (0.0005) [2023-12-26 07:23:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 498114560. Throughput: 0: 8862.3, 1: 8895.5. Samples: 498103776. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:13,785][121949] Avg episode reward: [(0, '6169.085'), (1, '5991.581')] [2023-12-26 07:23:14,227][123091] Updated weights for policy 0, policy_version 976307 (0.0006) [2023-12-26 07:23:14,287][123091] Updated weights for policy 0, policy_version 976317 (0.0005) [2023-12-26 07:23:14,347][123091] Updated weights for policy 0, policy_version 976327 (0.0005) [2023-12-26 07:23:14,374][123090] Updated weights for policy 1, policy_version 969442 (0.0010) [2023-12-26 07:23:14,425][123090] Updated weights for policy 1, policy_version 969452 (0.0010) [2023-12-26 07:23:14,496][123090] Updated weights for policy 1, policy_version 969462 (0.0010) [2023-12-26 07:23:14,560][123090] Updated weights for policy 1, policy_version 969472 (0.0011) [2023-12-26 07:23:15,114][123091] Updated weights for policy 0, policy_version 976337 (0.0006) [2023-12-26 07:23:15,178][123091] Updated weights for policy 0, policy_version 976347 (0.0011) [2023-12-26 07:23:15,262][123091] Updated weights for policy 0, policy_version 976357 (0.0011) [2023-12-26 07:23:15,330][123091] Updated weights for policy 0, policy_version 976367 (0.0011) [2023-12-26 07:23:15,364][123090] Updated weights for policy 1, policy_version 969482 (0.0008) [2023-12-26 07:23:15,432][123090] Updated weights for policy 1, policy_version 969492 (0.0008) [2023-12-26 07:23:15,498][123090] Updated weights for policy 1, policy_version 969502 (0.0009) [2023-12-26 07:23:16,075][123091] Updated weights for policy 0, policy_version 976377 (0.0006) [2023-12-26 07:23:16,136][123091] Updated weights for policy 0, policy_version 976387 (0.0005) [2023-12-26 07:23:16,194][123091] Updated weights for policy 0, policy_version 976397 (0.0005) [2023-12-26 07:23:16,364][123090] Updated weights for policy 1, policy_version 969512 (0.0010) [2023-12-26 07:23:16,444][123090] Updated weights for policy 1, policy_version 969522 (0.0010) [2023-12-26 07:23:16,500][123090] Updated weights for policy 1, policy_version 969533 (0.0009) [2023-12-26 07:23:16,839][123091] Updated weights for policy 0, policy_version 976408 (0.0009) [2023-12-26 07:23:16,892][123091] Updated weights for policy 0, policy_version 976418 (0.0009) [2023-12-26 07:23:16,946][123091] Updated weights for policy 0, policy_version 976428 (0.0010) [2023-12-26 07:23:17,258][123090] Updated weights for policy 1, policy_version 969543 (0.0007) [2023-12-26 07:23:17,314][123090] Updated weights for policy 1, policy_version 969553 (0.0006) [2023-12-26 07:23:17,368][123090] Updated weights for policy 1, policy_version 969563 (0.0009) [2023-12-26 07:23:17,792][123091] Updated weights for policy 0, policy_version 976438 (0.0010) [2023-12-26 07:23:17,847][123091] Updated weights for policy 0, policy_version 976448 (0.0010) [2023-12-26 07:23:17,894][123091] Updated weights for policy 0, policy_version 976458 (0.0010) [2023-12-26 07:23:18,133][123090] Updated weights for policy 1, policy_version 969573 (0.0008) [2023-12-26 07:23:18,204][123090] Updated weights for policy 1, policy_version 969583 (0.0005) [2023-12-26 07:23:18,276][123090] Updated weights for policy 1, policy_version 969593 (0.0006) [2023-12-26 07:23:18,763][123091] Updated weights for policy 0, policy_version 976468 (0.0008) [2023-12-26 07:23:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 498196480. Throughput: 0: 8923.2, 1: 8841.0. Samples: 498212680. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:18,785][121949] Avg episode reward: [(0, '6161.157'), (1, '5990.255')] [2023-12-26 07:23:18,825][123091] Updated weights for policy 0, policy_version 976478 (0.0005) [2023-12-26 07:23:18,891][123091] Updated weights for policy 0, policy_version 976488 (0.0007) [2023-12-26 07:23:19,031][123090] Updated weights for policy 1, policy_version 969603 (0.0006) [2023-12-26 07:23:19,100][123090] Updated weights for policy 1, policy_version 969613 (0.0007) [2023-12-26 07:23:19,162][123090] Updated weights for policy 1, policy_version 969623 (0.0006) [2023-12-26 07:23:19,688][123091] Updated weights for policy 0, policy_version 976498 (0.0009) [2023-12-26 07:23:19,741][123091] Updated weights for policy 0, policy_version 976508 (0.0010) [2023-12-26 07:23:19,790][123091] Updated weights for policy 0, policy_version 976518 (0.0008) [2023-12-26 07:23:19,854][123091] Updated weights for policy 0, policy_version 976528 (0.0009) [2023-12-26 07:23:19,959][123090] Updated weights for policy 1, policy_version 969633 (0.0009) [2023-12-26 07:23:20,019][123090] Updated weights for policy 1, policy_version 969643 (0.0009) [2023-12-26 07:23:20,085][123090] Updated weights for policy 1, policy_version 969653 (0.0009) [2023-12-26 07:23:20,151][123090] Updated weights for policy 1, policy_version 969663 (0.0009) [2023-12-26 07:23:20,715][123091] Updated weights for policy 0, policy_version 976538 (0.0008) [2023-12-26 07:23:20,791][123091] Updated weights for policy 0, policy_version 976548 (0.0009) [2023-12-26 07:23:20,853][123091] Updated weights for policy 0, policy_version 976558 (0.0007) [2023-12-26 07:23:20,989][123090] Updated weights for policy 1, policy_version 969673 (0.0010) [2023-12-26 07:23:21,060][123090] Updated weights for policy 1, policy_version 969683 (0.0010) [2023-12-26 07:23:21,133][123090] Updated weights for policy 1, policy_version 969693 (0.0010) [2023-12-26 07:23:21,591][123091] Updated weights for policy 0, policy_version 976568 (0.0007) [2023-12-26 07:23:21,668][123091] Updated weights for policy 0, policy_version 976578 (0.0009) [2023-12-26 07:23:21,731][123091] Updated weights for policy 0, policy_version 976588 (0.0010) [2023-12-26 07:23:21,917][123090] Updated weights for policy 1, policy_version 969703 (0.0010) [2023-12-26 07:23:21,980][123090] Updated weights for policy 1, policy_version 969713 (0.0011) [2023-12-26 07:23:22,051][123090] Updated weights for policy 1, policy_version 969723 (0.0011) [2023-12-26 07:23:22,426][123091] Updated weights for policy 0, policy_version 976598 (0.0009) [2023-12-26 07:23:22,492][123091] Updated weights for policy 0, policy_version 976608 (0.0009) [2023-12-26 07:23:22,560][123091] Updated weights for policy 0, policy_version 976618 (0.0009) [2023-12-26 07:23:22,881][123090] Updated weights for policy 1, policy_version 969733 (0.0011) [2023-12-26 07:23:22,949][123090] Updated weights for policy 1, policy_version 969743 (0.0011) [2023-12-26 07:23:23,017][123090] Updated weights for policy 1, policy_version 969753 (0.0011) [2023-12-26 07:23:23,378][123091] Updated weights for policy 0, policy_version 976628 (0.0009) [2023-12-26 07:23:23,423][123091] Updated weights for policy 0, policy_version 976638 (0.0008) [2023-12-26 07:23:23,472][123091] Updated weights for policy 0, policy_version 976648 (0.0005) [2023-12-26 07:23:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 498286592. Throughput: 0: 8920.0, 1: 8842.9. Samples: 498264316. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:23,785][121949] Avg episode reward: [(0, '6293.036'), (1, '6039.100')] [2023-12-26 07:23:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000976656_250028032.pth... [2023-12-26 07:23:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000975600_249757696.pth [2023-12-26 07:23:23,799][123090] Updated weights for policy 1, policy_version 969763 (0.0009) [2023-12-26 07:23:23,868][123090] Updated weights for policy 1, policy_version 969773 (0.0005) [2023-12-26 07:23:23,944][123090] Updated weights for policy 1, policy_version 969783 (0.0005) [2023-12-26 07:23:24,011][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000969792_248266752.pth... [2023-12-26 07:23:24,016][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000968736_247996416.pth [2023-12-26 07:23:24,250][123091] Updated weights for policy 0, policy_version 976658 (0.0008) [2023-12-26 07:23:24,313][123091] Updated weights for policy 0, policy_version 976668 (0.0010) [2023-12-26 07:23:24,372][123091] Updated weights for policy 0, policy_version 976678 (0.0011) [2023-12-26 07:23:24,435][123091] Updated weights for policy 0, policy_version 976688 (0.0011) [2023-12-26 07:23:24,659][123090] Updated weights for policy 1, policy_version 969793 (0.0005) [2023-12-26 07:23:24,711][123090] Updated weights for policy 1, policy_version 969803 (0.0005) [2023-12-26 07:23:24,760][123090] Updated weights for policy 1, policy_version 969813 (0.0005) [2023-12-26 07:23:24,820][123090] Updated weights for policy 1, policy_version 969823 (0.0010) [2023-12-26 07:23:25,265][123091] Updated weights for policy 0, policy_version 976698 (0.0005) [2023-12-26 07:23:25,314][123091] Updated weights for policy 0, policy_version 976708 (0.0005) [2023-12-26 07:23:25,359][123091] Updated weights for policy 0, policy_version 976718 (0.0005) [2023-12-26 07:23:25,642][123090] Updated weights for policy 1, policy_version 969833 (0.0010) [2023-12-26 07:23:25,693][123090] Updated weights for policy 1, policy_version 969843 (0.0010) [2023-12-26 07:23:25,739][123090] Updated weights for policy 1, policy_version 969853 (0.0010) [2023-12-26 07:23:26,080][123091] Updated weights for policy 0, policy_version 976728 (0.0005) [2023-12-26 07:23:26,144][123091] Updated weights for policy 0, policy_version 976738 (0.0008) [2023-12-26 07:23:26,198][123091] Updated weights for policy 0, policy_version 976748 (0.0010) [2023-12-26 07:23:26,579][123090] Updated weights for policy 1, policy_version 969863 (0.0007) [2023-12-26 07:23:26,638][123090] Updated weights for policy 1, policy_version 969873 (0.0005) [2023-12-26 07:23:26,698][123090] Updated weights for policy 1, policy_version 969883 (0.0005) [2023-12-26 07:23:26,972][123091] Updated weights for policy 0, policy_version 976758 (0.0010) [2023-12-26 07:23:27,026][123091] Updated weights for policy 0, policy_version 976768 (0.0010) [2023-12-26 07:23:27,072][123091] Updated weights for policy 0, policy_version 976778 (0.0010) [2023-12-26 07:23:27,392][123090] Updated weights for policy 1, policy_version 969893 (0.0005) [2023-12-26 07:23:27,463][123090] Updated weights for policy 1, policy_version 969904 (0.0006) [2023-12-26 07:23:27,533][123090] Updated weights for policy 1, policy_version 969914 (0.0006) [2023-12-26 07:23:27,818][123091] Updated weights for policy 0, policy_version 976788 (0.0010) [2023-12-26 07:23:27,884][123091] Updated weights for policy 0, policy_version 976798 (0.0008) [2023-12-26 07:23:27,955][123091] Updated weights for policy 0, policy_version 976808 (0.0011) [2023-12-26 07:23:28,250][123090] Updated weights for policy 1, policy_version 969924 (0.0009) [2023-12-26 07:23:28,312][123090] Updated weights for policy 1, policy_version 969934 (0.0010) [2023-12-26 07:23:28,379][123090] Updated weights for policy 1, policy_version 969944 (0.0010) [2023-12-26 07:23:28,720][123091] Updated weights for policy 0, policy_version 976818 (0.0010) [2023-12-26 07:23:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 498376704. Throughput: 0: 8969.0, 1: 8849.6. Samples: 498372496. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:28,785][121949] Avg episode reward: [(0, '6225.115'), (1, '5970.154')] [2023-12-26 07:23:28,791][123091] Updated weights for policy 0, policy_version 976828 (0.0007) [2023-12-26 07:23:28,857][123091] Updated weights for policy 0, policy_version 976838 (0.0009) [2023-12-26 07:23:28,918][123091] Updated weights for policy 0, policy_version 976848 (0.0009) [2023-12-26 07:23:29,186][123090] Updated weights for policy 1, policy_version 969954 (0.0010) [2023-12-26 07:23:29,252][123090] Updated weights for policy 1, policy_version 969964 (0.0009) [2023-12-26 07:23:29,307][123090] Updated weights for policy 1, policy_version 969974 (0.0010) [2023-12-26 07:23:29,368][123090] Updated weights for policy 1, policy_version 969984 (0.0010) [2023-12-26 07:23:29,728][123091] Updated weights for policy 0, policy_version 976858 (0.0009) [2023-12-26 07:23:29,780][123091] Updated weights for policy 0, policy_version 976868 (0.0009) [2023-12-26 07:23:29,840][123091] Updated weights for policy 0, policy_version 976878 (0.0008) [2023-12-26 07:23:30,211][123090] Updated weights for policy 1, policy_version 969994 (0.0010) [2023-12-26 07:23:30,263][123090] Updated weights for policy 1, policy_version 970004 (0.0010) [2023-12-26 07:23:30,318][123090] Updated weights for policy 1, policy_version 970014 (0.0010) [2023-12-26 07:23:30,694][123091] Updated weights for policy 0, policy_version 976888 (0.0009) [2023-12-26 07:23:30,750][123091] Updated weights for policy 0, policy_version 976898 (0.0009) [2023-12-26 07:23:30,804][123091] Updated weights for policy 0, policy_version 976908 (0.0010) [2023-12-26 07:23:31,156][123090] Updated weights for policy 1, policy_version 970024 (0.0008) [2023-12-26 07:23:31,217][123090] Updated weights for policy 1, policy_version 970034 (0.0009) [2023-12-26 07:23:31,279][123090] Updated weights for policy 1, policy_version 970044 (0.0009) [2023-12-26 07:23:31,680][123091] Updated weights for policy 0, policy_version 976918 (0.0009) [2023-12-26 07:23:31,746][123091] Updated weights for policy 0, policy_version 976928 (0.0010) [2023-12-26 07:23:31,793][123091] Updated weights for policy 0, policy_version 976938 (0.0005) [2023-12-26 07:23:32,018][123090] Updated weights for policy 1, policy_version 970054 (0.0009) [2023-12-26 07:23:32,080][123090] Updated weights for policy 1, policy_version 970064 (0.0008) [2023-12-26 07:23:32,145][123090] Updated weights for policy 1, policy_version 970074 (0.0008) [2023-12-26 07:23:32,581][123091] Updated weights for policy 0, policy_version 976948 (0.0006) [2023-12-26 07:23:32,652][123091] Updated weights for policy 0, policy_version 976958 (0.0005) [2023-12-26 07:23:32,725][123091] Updated weights for policy 0, policy_version 976968 (0.0008) [2023-12-26 07:23:32,915][123090] Updated weights for policy 1, policy_version 970084 (0.0007) [2023-12-26 07:23:32,968][123090] Updated weights for policy 1, policy_version 970094 (0.0006) [2023-12-26 07:23:33,023][123090] Updated weights for policy 1, policy_version 970104 (0.0006) [2023-12-26 07:23:33,424][123091] Updated weights for policy 0, policy_version 976978 (0.0009) [2023-12-26 07:23:33,470][123091] Updated weights for policy 0, policy_version 976988 (0.0005) [2023-12-26 07:23:33,515][123091] Updated weights for policy 0, policy_version 976998 (0.0005) [2023-12-26 07:23:33,573][123091] Updated weights for policy 0, policy_version 977008 (0.0007) [2023-12-26 07:23:33,735][123090] Updated weights for policy 1, policy_version 970114 (0.0005) [2023-12-26 07:23:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 498466816. Throughput: 0: 8926.5, 1: 8883.1. Samples: 498479704. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:33,785][121949] Avg episode reward: [(0, '6100.665'), (1, '5974.972')] [2023-12-26 07:23:33,795][123090] Updated weights for policy 1, policy_version 970124 (0.0005) [2023-12-26 07:23:33,849][123090] Updated weights for policy 1, policy_version 970134 (0.0005) [2023-12-26 07:23:33,897][123090] Updated weights for policy 1, policy_version 970144 (0.0010) [2023-12-26 07:23:34,367][123091] Updated weights for policy 0, policy_version 977018 (0.0009) [2023-12-26 07:23:34,426][123091] Updated weights for policy 0, policy_version 977028 (0.0009) [2023-12-26 07:23:34,492][123091] Updated weights for policy 0, policy_version 977038 (0.0010) [2023-12-26 07:23:34,699][123090] Updated weights for policy 1, policy_version 970154 (0.0009) [2023-12-26 07:23:34,759][123090] Updated weights for policy 1, policy_version 970164 (0.0005) [2023-12-26 07:23:34,824][123090] Updated weights for policy 1, policy_version 970174 (0.0005) [2023-12-26 07:23:35,399][123091] Updated weights for policy 0, policy_version 977048 (0.0009) [2023-12-26 07:23:35,465][123091] Updated weights for policy 0, policy_version 977058 (0.0009) [2023-12-26 07:23:35,519][123090] Updated weights for policy 1, policy_version 970184 (0.0009) [2023-12-26 07:23:35,527][123091] Updated weights for policy 0, policy_version 977068 (0.0006) [2023-12-26 07:23:35,582][123090] Updated weights for policy 1, policy_version 970194 (0.0010) [2023-12-26 07:23:35,644][123090] Updated weights for policy 1, policy_version 970204 (0.0010) [2023-12-26 07:23:36,350][123091] Updated weights for policy 0, policy_version 977078 (0.0008) [2023-12-26 07:23:36,412][123091] Updated weights for policy 0, policy_version 977088 (0.0009) [2023-12-26 07:23:36,472][123090] Updated weights for policy 1, policy_version 970214 (0.0011) [2023-12-26 07:23:36,475][123091] Updated weights for policy 0, policy_version 977098 (0.0007) [2023-12-26 07:23:36,540][123090] Updated weights for policy 1, policy_version 970224 (0.0011) [2023-12-26 07:23:36,611][123090] Updated weights for policy 1, policy_version 970234 (0.0011) [2023-12-26 07:23:37,326][123091] Updated weights for policy 0, policy_version 977108 (0.0007) [2023-12-26 07:23:37,390][123091] Updated weights for policy 0, policy_version 977118 (0.0009) [2023-12-26 07:23:37,430][123090] Updated weights for policy 1, policy_version 970244 (0.0010) [2023-12-26 07:23:37,444][123091] Updated weights for policy 0, policy_version 977128 (0.0009) [2023-12-26 07:23:37,495][123090] Updated weights for policy 1, policy_version 970254 (0.0009) [2023-12-26 07:23:37,564][123090] Updated weights for policy 1, policy_version 970264 (0.0006) [2023-12-26 07:23:38,246][123090] Updated weights for policy 1, policy_version 970274 (0.0006) [2023-12-26 07:23:38,290][123091] Updated weights for policy 0, policy_version 977138 (0.0009) [2023-12-26 07:23:38,313][123090] Updated weights for policy 1, policy_version 970284 (0.0009) [2023-12-26 07:23:38,348][123091] Updated weights for policy 0, policy_version 977148 (0.0009) [2023-12-26 07:23:38,378][123090] Updated weights for policy 1, policy_version 970294 (0.0007) [2023-12-26 07:23:38,412][123091] Updated weights for policy 0, policy_version 977158 (0.0010) [2023-12-26 07:23:38,437][123090] Updated weights for policy 1, policy_version 970304 (0.0007) [2023-12-26 07:23:38,468][123091] Updated weights for policy 0, policy_version 977168 (0.0009) [2023-12-26 07:23:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 498556928. Throughput: 0: 8891.6, 1: 8948.2. Samples: 498531924. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:38,785][121949] Avg episode reward: [(0, '6050.147'), (1, '6045.581')] [2023-12-26 07:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000970304_248397824.pth... [2023-12-26 07:23:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000977168_250159104.pth... [2023-12-26 07:23:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000969280_248135680.pth [2023-12-26 07:23:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000976144_249896960.pth [2023-12-26 07:23:39,213][123091] Updated weights for policy 0, policy_version 977178 (0.0007) [2023-12-26 07:23:39,281][123091] Updated weights for policy 0, policy_version 977188 (0.0008) [2023-12-26 07:23:39,324][123090] Updated weights for policy 1, policy_version 970314 (0.0009) [2023-12-26 07:23:39,345][123091] Updated weights for policy 0, policy_version 977198 (0.0007) [2023-12-26 07:23:39,413][123090] Updated weights for policy 1, policy_version 970324 (0.0010) [2023-12-26 07:23:39,486][123090] Updated weights for policy 1, policy_version 970334 (0.0010) [2023-12-26 07:23:40,120][123091] Updated weights for policy 0, policy_version 977208 (0.0006) [2023-12-26 07:23:40,187][123091] Updated weights for policy 0, policy_version 977218 (0.0006) [2023-12-26 07:23:40,253][123091] Updated weights for policy 0, policy_version 977228 (0.0006) [2023-12-26 07:23:40,318][123090] Updated weights for policy 1, policy_version 970344 (0.0009) [2023-12-26 07:23:40,387][123090] Updated weights for policy 1, policy_version 970354 (0.0010) [2023-12-26 07:23:40,462][123090] Updated weights for policy 1, policy_version 970364 (0.0009) [2023-12-26 07:23:41,001][123091] Updated weights for policy 0, policy_version 977238 (0.0006) [2023-12-26 07:23:41,077][123091] Updated weights for policy 0, policy_version 977248 (0.0009) [2023-12-26 07:23:41,140][123091] Updated weights for policy 0, policy_version 977258 (0.0011) [2023-12-26 07:23:41,329][123090] Updated weights for policy 1, policy_version 970374 (0.0006) [2023-12-26 07:23:41,408][123090] Updated weights for policy 1, policy_version 970384 (0.0008) [2023-12-26 07:23:41,468][123090] Updated weights for policy 1, policy_version 970394 (0.0008) [2023-12-26 07:23:41,953][123091] Updated weights for policy 0, policy_version 977268 (0.0011) [2023-12-26 07:23:42,005][123091] Updated weights for policy 0, policy_version 977278 (0.0010) [2023-12-26 07:23:42,054][123091] Updated weights for policy 0, policy_version 977288 (0.0010) [2023-12-26 07:23:42,206][123090] Updated weights for policy 1, policy_version 970404 (0.0008) [2023-12-26 07:23:42,276][123090] Updated weights for policy 1, policy_version 970414 (0.0009) [2023-12-26 07:23:42,345][123090] Updated weights for policy 1, policy_version 970424 (0.0011) [2023-12-26 07:23:42,855][123091] Updated weights for policy 0, policy_version 977298 (0.0009) [2023-12-26 07:23:42,926][123091] Updated weights for policy 0, policy_version 977308 (0.0005) [2023-12-26 07:23:42,986][123091] Updated weights for policy 0, policy_version 977318 (0.0005) [2023-12-26 07:23:43,043][123091] Updated weights for policy 0, policy_version 977328 (0.0005) [2023-12-26 07:23:43,114][123090] Updated weights for policy 1, policy_version 970434 (0.0011) [2023-12-26 07:23:43,170][123090] Updated weights for policy 1, policy_version 970445 (0.0010) [2023-12-26 07:23:43,221][123090] Updated weights for policy 1, policy_version 970455 (0.0005) [2023-12-26 07:23:43,712][123091] Updated weights for policy 0, policy_version 977338 (0.0005) [2023-12-26 07:23:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 498638848. Throughput: 0: 8897.8, 1: 8883.1. Samples: 498636192. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:43,784][121949] Avg episode reward: [(0, '5959.975'), (1, '6042.812')] [2023-12-26 07:23:43,788][123091] Updated weights for policy 0, policy_version 977348 (0.0005) [2023-12-26 07:23:43,860][123091] Updated weights for policy 0, policy_version 977358 (0.0005) [2023-12-26 07:23:43,907][123090] Updated weights for policy 1, policy_version 970465 (0.0005) [2023-12-26 07:23:43,964][123090] Updated weights for policy 1, policy_version 970475 (0.0005) [2023-12-26 07:23:44,017][123090] Updated weights for policy 1, policy_version 970485 (0.0005) [2023-12-26 07:23:44,072][123090] Updated weights for policy 1, policy_version 970495 (0.0005) [2023-12-26 07:23:44,529][123091] Updated weights for policy 0, policy_version 977368 (0.0006) [2023-12-26 07:23:44,589][123091] Updated weights for policy 0, policy_version 977378 (0.0007) [2023-12-26 07:23:44,635][123091] Updated weights for policy 0, policy_version 977388 (0.0007) [2023-12-26 07:23:44,778][123090] Updated weights for policy 1, policy_version 970505 (0.0009) [2023-12-26 07:23:44,853][123090] Updated weights for policy 1, policy_version 970515 (0.0009) [2023-12-26 07:23:44,921][123090] Updated weights for policy 1, policy_version 970525 (0.0009) [2023-12-26 07:23:45,444][123091] Updated weights for policy 0, policy_version 977398 (0.0008) [2023-12-26 07:23:45,497][123091] Updated weights for policy 0, policy_version 977408 (0.0010) [2023-12-26 07:23:45,558][123091] Updated weights for policy 0, policy_version 977418 (0.0009) [2023-12-26 07:23:45,786][123090] Updated weights for policy 1, policy_version 970535 (0.0009) [2023-12-26 07:23:45,844][123090] Updated weights for policy 1, policy_version 970545 (0.0009) [2023-12-26 07:23:45,898][123090] Updated weights for policy 1, policy_version 970555 (0.0009) [2023-12-26 07:23:46,383][123091] Updated weights for policy 0, policy_version 977428 (0.0010) [2023-12-26 07:23:46,445][123091] Updated weights for policy 0, policy_version 977438 (0.0010) [2023-12-26 07:23:46,516][123091] Updated weights for policy 0, policy_version 977448 (0.0010) [2023-12-26 07:23:46,706][123090] Updated weights for policy 1, policy_version 970565 (0.0010) [2023-12-26 07:23:46,773][123090] Updated weights for policy 1, policy_version 970575 (0.0010) [2023-12-26 07:23:46,825][123090] Updated weights for policy 1, policy_version 970585 (0.0010) [2023-12-26 07:23:47,206][123091] Updated weights for policy 0, policy_version 977458 (0.0009) [2023-12-26 07:23:47,260][123091] Updated weights for policy 0, policy_version 977468 (0.0005) [2023-12-26 07:23:47,312][123091] Updated weights for policy 0, policy_version 977478 (0.0005) [2023-12-26 07:23:47,369][123091] Updated weights for policy 0, policy_version 977488 (0.0007) [2023-12-26 07:23:47,631][123090] Updated weights for policy 1, policy_version 970595 (0.0010) [2023-12-26 07:23:47,694][123090] Updated weights for policy 1, policy_version 970605 (0.0010) [2023-12-26 07:23:47,761][123090] Updated weights for policy 1, policy_version 970615 (0.0011) [2023-12-26 07:23:48,037][123091] Updated weights for policy 0, policy_version 977498 (0.0008) [2023-12-26 07:23:48,103][123091] Updated weights for policy 0, policy_version 977508 (0.0008) [2023-12-26 07:23:48,166][123091] Updated weights for policy 0, policy_version 977518 (0.0008) [2023-12-26 07:23:48,467][123090] Updated weights for policy 1, policy_version 970625 (0.0010) [2023-12-26 07:23:48,541][123090] Updated weights for policy 1, policy_version 970635 (0.0007) [2023-12-26 07:23:48,613][123090] Updated weights for policy 1, policy_version 970645 (0.0008) [2023-12-26 07:23:48,685][123090] Updated weights for policy 1, policy_version 970655 (0.0007) [2023-12-26 07:23:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 498737152. Throughput: 0: 9063.9, 1: 8916.0. Samples: 498749428. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:48,785][121949] Avg episode reward: [(0, '6105.474'), (1, '6043.100')] [2023-12-26 07:23:48,848][123091] Updated weights for policy 0, policy_version 977528 (0.0006) [2023-12-26 07:23:48,900][123091] Updated weights for policy 0, policy_version 977538 (0.0005) [2023-12-26 07:23:48,962][123091] Updated weights for policy 0, policy_version 977548 (0.0009) [2023-12-26 07:23:49,437][123090] Updated weights for policy 1, policy_version 970665 (0.0006) [2023-12-26 07:23:49,511][123090] Updated weights for policy 1, policy_version 970675 (0.0005) [2023-12-26 07:23:49,577][123090] Updated weights for policy 1, policy_version 970685 (0.0008) [2023-12-26 07:23:49,736][123091] Updated weights for policy 0, policy_version 977558 (0.0008) [2023-12-26 07:23:49,804][123091] Updated weights for policy 0, policy_version 977568 (0.0007) [2023-12-26 07:23:49,865][123091] Updated weights for policy 0, policy_version 977578 (0.0009) [2023-12-26 07:23:50,356][123090] Updated weights for policy 1, policy_version 970695 (0.0009) [2023-12-26 07:23:50,422][123090] Updated weights for policy 1, policy_version 970705 (0.0009) [2023-12-26 07:23:50,480][123090] Updated weights for policy 1, policy_version 970715 (0.0008) [2023-12-26 07:23:50,701][123091] Updated weights for policy 0, policy_version 977588 (0.0011) [2023-12-26 07:23:50,767][123091] Updated weights for policy 0, policy_version 977598 (0.0011) [2023-12-26 07:23:50,836][123091] Updated weights for policy 0, policy_version 977608 (0.0008) [2023-12-26 07:23:51,294][123090] Updated weights for policy 1, policy_version 970725 (0.0007) [2023-12-26 07:23:51,365][123090] Updated weights for policy 1, policy_version 970735 (0.0009) [2023-12-26 07:23:51,433][123090] Updated weights for policy 1, policy_version 970745 (0.0009) [2023-12-26 07:23:51,686][123091] Updated weights for policy 0, policy_version 977618 (0.0009) [2023-12-26 07:23:51,758][123091] Updated weights for policy 0, policy_version 977628 (0.0009) [2023-12-26 07:23:51,816][123091] Updated weights for policy 0, policy_version 977638 (0.0009) [2023-12-26 07:23:51,870][123091] Updated weights for policy 0, policy_version 977648 (0.0009) [2023-12-26 07:23:52,213][123090] Updated weights for policy 1, policy_version 970755 (0.0008) [2023-12-26 07:23:52,274][123090] Updated weights for policy 1, policy_version 970765 (0.0009) [2023-12-26 07:23:52,337][123090] Updated weights for policy 1, policy_version 970775 (0.0008) [2023-12-26 07:23:52,661][123091] Updated weights for policy 0, policy_version 977658 (0.0007) [2023-12-26 07:23:52,723][123091] Updated weights for policy 0, policy_version 977668 (0.0009) [2023-12-26 07:23:52,796][123091] Updated weights for policy 0, policy_version 977678 (0.0009) [2023-12-26 07:23:53,149][123090] Updated weights for policy 1, policy_version 970785 (0.0008) [2023-12-26 07:23:53,207][123090] Updated weights for policy 1, policy_version 970795 (0.0009) [2023-12-26 07:23:53,272][123090] Updated weights for policy 1, policy_version 970805 (0.0008) [2023-12-26 07:23:53,336][123090] Updated weights for policy 1, policy_version 970815 (0.0009) [2023-12-26 07:23:53,555][123091] Updated weights for policy 0, policy_version 977688 (0.0006) [2023-12-26 07:23:53,619][123091] Updated weights for policy 0, policy_version 977698 (0.0005) [2023-12-26 07:23:53,673][123091] Updated weights for policy 0, policy_version 977708 (0.0005) [2023-12-26 07:23:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 498827264. Throughput: 0: 9022.7, 1: 8860.2. Samples: 498801196. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:53,785][121949] Avg episode reward: [(0, '5946.973'), (1, '5996.865')] [2023-12-26 07:23:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000977712_250298368.pth... [2023-12-26 07:23:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000970816_248528896.pth... [2023-12-26 07:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000969792_248266752.pth [2023-12-26 07:23:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000976656_250028032.pth [2023-12-26 07:23:54,043][123090] Updated weights for policy 1, policy_version 970825 (0.0008) [2023-12-26 07:23:54,111][123090] Updated weights for policy 1, policy_version 970835 (0.0005) [2023-12-26 07:23:54,178][123090] Updated weights for policy 1, policy_version 970845 (0.0005) [2023-12-26 07:23:54,299][123091] Updated weights for policy 0, policy_version 977718 (0.0005) [2023-12-26 07:23:54,363][123091] Updated weights for policy 0, policy_version 977728 (0.0005) [2023-12-26 07:23:54,429][123091] Updated weights for policy 0, policy_version 977738 (0.0006) [2023-12-26 07:23:54,926][123090] Updated weights for policy 1, policy_version 970855 (0.0009) [2023-12-26 07:23:55,001][123090] Updated weights for policy 1, policy_version 970865 (0.0006) [2023-12-26 07:23:55,072][123090] Updated weights for policy 1, policy_version 970875 (0.0006) [2023-12-26 07:23:55,205][123091] Updated weights for policy 0, policy_version 977748 (0.0008) [2023-12-26 07:23:55,276][123091] Updated weights for policy 0, policy_version 977758 (0.0010) [2023-12-26 07:23:55,333][123091] Updated weights for policy 0, policy_version 977768 (0.0009) [2023-12-26 07:23:55,744][123090] Updated weights for policy 1, policy_version 970885 (0.0007) [2023-12-26 07:23:55,819][123090] Updated weights for policy 1, policy_version 970895 (0.0008) [2023-12-26 07:23:55,892][123090] Updated weights for policy 1, policy_version 970905 (0.0008) [2023-12-26 07:23:56,234][123091] Updated weights for policy 0, policy_version 977778 (0.0009) [2023-12-26 07:23:56,285][123091] Updated weights for policy 0, policy_version 977788 (0.0009) [2023-12-26 07:23:56,340][123091] Updated weights for policy 0, policy_version 977798 (0.0010) [2023-12-26 07:23:56,394][123091] Updated weights for policy 0, policy_version 977808 (0.0009) [2023-12-26 07:23:56,562][123090] Updated weights for policy 1, policy_version 970915 (0.0007) [2023-12-26 07:23:56,609][123090] Updated weights for policy 1, policy_version 970925 (0.0010) [2023-12-26 07:23:56,660][123090] Updated weights for policy 1, policy_version 970935 (0.0010) [2023-12-26 07:23:57,100][123091] Updated weights for policy 0, policy_version 977818 (0.0006) [2023-12-26 07:23:57,160][123091] Updated weights for policy 0, policy_version 977828 (0.0005) [2023-12-26 07:23:57,228][123091] Updated weights for policy 0, policy_version 977838 (0.0006) [2023-12-26 07:23:57,474][123090] Updated weights for policy 1, policy_version 970945 (0.0010) [2023-12-26 07:23:57,543][123090] Updated weights for policy 1, policy_version 970955 (0.0005) [2023-12-26 07:23:57,592][123090] Updated weights for policy 1, policy_version 970965 (0.0005) [2023-12-26 07:23:57,652][123090] Updated weights for policy 1, policy_version 970975 (0.0005) [2023-12-26 07:23:57,882][123091] Updated weights for policy 0, policy_version 977848 (0.0006) [2023-12-26 07:23:57,931][123091] Updated weights for policy 0, policy_version 977858 (0.0005) [2023-12-26 07:23:57,976][123091] Updated weights for policy 0, policy_version 977868 (0.0005) [2023-12-26 07:23:58,351][123090] Updated weights for policy 1, policy_version 970985 (0.0008) [2023-12-26 07:23:58,416][123090] Updated weights for policy 1, policy_version 970995 (0.0008) [2023-12-26 07:23:58,478][123090] Updated weights for policy 1, policy_version 971005 (0.0009) [2023-12-26 07:23:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 498917376. Throughput: 0: 9044.7, 1: 8927.7. Samples: 498912536. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:23:58,785][121949] Avg episode reward: [(0, '6013.771'), (1, '5977.399')] [2023-12-26 07:23:58,814][123091] Updated weights for policy 0, policy_version 977878 (0.0009) [2023-12-26 07:23:58,887][123091] Updated weights for policy 0, policy_version 977888 (0.0011) [2023-12-26 07:23:58,950][123091] Updated weights for policy 0, policy_version 977898 (0.0011) [2023-12-26 07:23:59,293][123090] Updated weights for policy 1, policy_version 971015 (0.0010) [2023-12-26 07:23:59,376][123090] Updated weights for policy 1, policy_version 971025 (0.0010) [2023-12-26 07:23:59,436][123090] Updated weights for policy 1, policy_version 971035 (0.0007) [2023-12-26 07:23:59,691][123091] Updated weights for policy 0, policy_version 977908 (0.0011) [2023-12-26 07:23:59,743][123091] Updated weights for policy 0, policy_version 977918 (0.0011) [2023-12-26 07:23:59,799][123091] Updated weights for policy 0, policy_version 977928 (0.0011) [2023-12-26 07:24:00,275][123090] Updated weights for policy 1, policy_version 971045 (0.0010) [2023-12-26 07:24:00,331][123090] Updated weights for policy 1, policy_version 971055 (0.0010) [2023-12-26 07:24:00,383][123090] Updated weights for policy 1, policy_version 971065 (0.0010) [2023-12-26 07:24:00,552][123091] Updated weights for policy 0, policy_version 977938 (0.0011) [2023-12-26 07:24:00,608][123091] Updated weights for policy 0, policy_version 977948 (0.0010) [2023-12-26 07:24:00,663][123091] Updated weights for policy 0, policy_version 977958 (0.0010) [2023-12-26 07:24:00,740][123091] Updated weights for policy 0, policy_version 977968 (0.0005) [2023-12-26 07:24:01,163][123090] Updated weights for policy 1, policy_version 971075 (0.0010) [2023-12-26 07:24:01,222][123090] Updated weights for policy 1, policy_version 971085 (0.0008) [2023-12-26 07:24:01,280][123090] Updated weights for policy 1, policy_version 971095 (0.0008) [2023-12-26 07:24:01,464][123091] Updated weights for policy 0, policy_version 977978 (0.0010) [2023-12-26 07:24:01,521][123091] Updated weights for policy 0, policy_version 977988 (0.0010) [2023-12-26 07:24:01,582][123091] Updated weights for policy 0, policy_version 977998 (0.0010) [2023-12-26 07:24:02,156][123090] Updated weights for policy 1, policy_version 971105 (0.0008) [2023-12-26 07:24:02,208][123090] Updated weights for policy 1, policy_version 971115 (0.0008) [2023-12-26 07:24:02,258][123090] Updated weights for policy 1, policy_version 971125 (0.0009) [2023-12-26 07:24:02,328][123090] Updated weights for policy 1, policy_version 971135 (0.0009) [2023-12-26 07:24:02,344][123091] Updated weights for policy 0, policy_version 978008 (0.0011) [2023-12-26 07:24:02,402][123091] Updated weights for policy 0, policy_version 978018 (0.0008) [2023-12-26 07:24:02,449][123091] Updated weights for policy 0, policy_version 978028 (0.0005) [2023-12-26 07:24:03,207][123091] Updated weights for policy 0, policy_version 978038 (0.0005) [2023-12-26 07:24:03,222][123090] Updated weights for policy 1, policy_version 971145 (0.0009) [2023-12-26 07:24:03,263][123091] Updated weights for policy 0, policy_version 978048 (0.0005) [2023-12-26 07:24:03,275][123090] Updated weights for policy 1, policy_version 971155 (0.0009) [2023-12-26 07:24:03,312][123091] Updated weights for policy 0, policy_version 978058 (0.0005) [2023-12-26 07:24:03,323][123090] Updated weights for policy 1, policy_version 971165 (0.0008) [2023-12-26 07:24:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 499007488. Throughput: 0: 9054.5, 1: 8882.0. Samples: 499019824. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:03,785][121949] Avg episode reward: [(0, '6110.383'), (1, '6025.257')] [2023-12-26 07:24:03,935][123091] Updated weights for policy 0, policy_version 978068 (0.0007) [2023-12-26 07:24:04,003][123091] Updated weights for policy 0, policy_version 978078 (0.0020) [2023-12-26 07:24:04,061][123091] Updated weights for policy 0, policy_version 978088 (0.0007) [2023-12-26 07:24:04,249][123090] Updated weights for policy 1, policy_version 971175 (0.0008) [2023-12-26 07:24:04,315][123090] Updated weights for policy 1, policy_version 971185 (0.0009) [2023-12-26 07:24:04,387][123090] Updated weights for policy 1, policy_version 971195 (0.0010) [2023-12-26 07:24:04,867][123091] Updated weights for policy 0, policy_version 978098 (0.0009) [2023-12-26 07:24:04,910][123091] Updated weights for policy 0, policy_version 978108 (0.0010) [2023-12-26 07:24:04,970][123091] Updated weights for policy 0, policy_version 978118 (0.0007) [2023-12-26 07:24:05,041][123091] Updated weights for policy 0, policy_version 978128 (0.0006) [2023-12-26 07:24:05,126][123090] Updated weights for policy 1, policy_version 971205 (0.0007) [2023-12-26 07:24:05,174][123090] Updated weights for policy 1, policy_version 971215 (0.0005) [2023-12-26 07:24:05,226][123090] Updated weights for policy 1, policy_version 971225 (0.0005) [2023-12-26 07:24:05,707][123091] Updated weights for policy 0, policy_version 978138 (0.0005) [2023-12-26 07:24:05,761][123091] Updated weights for policy 0, policy_version 978148 (0.0005) [2023-12-26 07:24:05,818][123091] Updated weights for policy 0, policy_version 978158 (0.0007) [2023-12-26 07:24:06,029][123090] Updated weights for policy 1, policy_version 971235 (0.0006) [2023-12-26 07:24:06,082][123090] Updated weights for policy 1, policy_version 971245 (0.0009) [2023-12-26 07:24:06,146][123090] Updated weights for policy 1, policy_version 971255 (0.0009) [2023-12-26 07:24:06,579][123091] Updated weights for policy 0, policy_version 978168 (0.0011) [2023-12-26 07:24:06,651][123091] Updated weights for policy 0, policy_version 978178 (0.0011) [2023-12-26 07:24:06,722][123091] Updated weights for policy 0, policy_version 978188 (0.0011) [2023-12-26 07:24:07,004][123090] Updated weights for policy 1, policy_version 971265 (0.0009) [2023-12-26 07:24:07,065][123090] Updated weights for policy 1, policy_version 971275 (0.0009) [2023-12-26 07:24:07,132][123090] Updated weights for policy 1, policy_version 971285 (0.0008) [2023-12-26 07:24:07,193][123090] Updated weights for policy 1, policy_version 971295 (0.0009) [2023-12-26 07:24:07,504][123091] Updated weights for policy 0, policy_version 978198 (0.0010) [2023-12-26 07:24:07,555][123091] Updated weights for policy 0, policy_version 978208 (0.0010) [2023-12-26 07:24:07,607][123091] Updated weights for policy 0, policy_version 978218 (0.0010) [2023-12-26 07:24:07,995][123090] Updated weights for policy 1, policy_version 971305 (0.0005) [2023-12-26 07:24:08,053][123090] Updated weights for policy 1, policy_version 971315 (0.0008) [2023-12-26 07:24:08,105][123090] Updated weights for policy 1, policy_version 971325 (0.0008) [2023-12-26 07:24:08,458][123091] Updated weights for policy 0, policy_version 978228 (0.0011) [2023-12-26 07:24:08,522][123091] Updated weights for policy 0, policy_version 978238 (0.0011) [2023-12-26 07:24:08,581][123091] Updated weights for policy 0, policy_version 978248 (0.0011) [2023-12-26 07:24:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 499097600. Throughput: 0: 9099.7, 1: 8903.4. Samples: 499074452. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:08,785][121949] Avg episode reward: [(0, '5962.750'), (1, '6004.551')] [2023-12-26 07:24:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000978256_250437632.pth... [2023-12-26 07:24:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000971328_248659968.pth... [2023-12-26 07:24:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000977168_250159104.pth [2023-12-26 07:24:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000970304_248397824.pth [2023-12-26 07:24:08,887][123090] Updated weights for policy 1, policy_version 971335 (0.0009) [2023-12-26 07:24:08,951][123090] Updated weights for policy 1, policy_version 971345 (0.0008) [2023-12-26 07:24:09,004][123090] Updated weights for policy 1, policy_version 971355 (0.0009) [2023-12-26 07:24:09,431][123091] Updated weights for policy 0, policy_version 978258 (0.0010) [2023-12-26 07:24:09,497][123091] Updated weights for policy 0, policy_version 978268 (0.0008) [2023-12-26 07:24:09,545][123091] Updated weights for policy 0, policy_version 978278 (0.0008) [2023-12-26 07:24:09,602][123091] Updated weights for policy 0, policy_version 978288 (0.0008) [2023-12-26 07:24:09,840][123090] Updated weights for policy 1, policy_version 971365 (0.0009) [2023-12-26 07:24:09,904][123090] Updated weights for policy 1, policy_version 971375 (0.0009) [2023-12-26 07:24:09,973][123090] Updated weights for policy 1, policy_version 971385 (0.0009) [2023-12-26 07:24:10,418][123091] Updated weights for policy 0, policy_version 978298 (0.0007) [2023-12-26 07:24:10,483][123091] Updated weights for policy 0, policy_version 978308 (0.0009) [2023-12-26 07:24:10,549][123091] Updated weights for policy 0, policy_version 978318 (0.0006) [2023-12-26 07:24:10,864][123090] Updated weights for policy 1, policy_version 971395 (0.0010) [2023-12-26 07:24:10,922][123090] Updated weights for policy 1, policy_version 971406 (0.0010) [2023-12-26 07:24:10,981][123090] Updated weights for policy 1, policy_version 971416 (0.0009) [2023-12-26 07:24:11,254][123091] Updated weights for policy 0, policy_version 978328 (0.0008) [2023-12-26 07:24:11,321][123091] Updated weights for policy 0, policy_version 978338 (0.0008) [2023-12-26 07:24:11,393][123091] Updated weights for policy 0, policy_version 978348 (0.0008) [2023-12-26 07:24:11,963][123090] Updated weights for policy 1, policy_version 971427 (0.0010) [2023-12-26 07:24:12,023][123090] Updated weights for policy 1, policy_version 971437 (0.0010) [2023-12-26 07:24:12,084][123090] Updated weights for policy 1, policy_version 971447 (0.0009) [2023-12-26 07:24:12,118][123091] Updated weights for policy 0, policy_version 978358 (0.0008) [2023-12-26 07:24:12,176][123091] Updated weights for policy 0, policy_version 978368 (0.0009) [2023-12-26 07:24:12,231][123091] Updated weights for policy 0, policy_version 978379 (0.0011) [2023-12-26 07:24:12,914][123090] Updated weights for policy 1, policy_version 971457 (0.0009) [2023-12-26 07:24:12,969][123090] Updated weights for policy 1, policy_version 971467 (0.0009) [2023-12-26 07:24:13,023][123090] Updated weights for policy 1, policy_version 971477 (0.0008) [2023-12-26 07:24:13,074][123090] Updated weights for policy 1, policy_version 971487 (0.0009) [2023-12-26 07:24:13,096][123091] Updated weights for policy 0, policy_version 978389 (0.0010) [2023-12-26 07:24:13,160][123091] Updated weights for policy 0, policy_version 978399 (0.0009) [2023-12-26 07:24:13,226][123091] Updated weights for policy 0, policy_version 978409 (0.0010) [2023-12-26 07:24:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 499179520. Throughput: 0: 9050.7, 1: 8817.2. Samples: 499176556. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:13,785][121949] Avg episode reward: [(0, '6010.773'), (1, '6001.838')] [2023-12-26 07:24:13,830][123090] Updated weights for policy 1, policy_version 971497 (0.0007) [2023-12-26 07:24:13,880][123090] Updated weights for policy 1, policy_version 971508 (0.0010) [2023-12-26 07:24:13,927][123090] Updated weights for policy 1, policy_version 971518 (0.0010) [2023-12-26 07:24:14,062][123091] Updated weights for policy 0, policy_version 978419 (0.0009) [2023-12-26 07:24:14,112][123091] Updated weights for policy 0, policy_version 978429 (0.0009) [2023-12-26 07:24:14,160][123091] Updated weights for policy 0, policy_version 978439 (0.0009) [2023-12-26 07:24:14,784][123090] Updated weights for policy 1, policy_version 971528 (0.0010) [2023-12-26 07:24:14,846][123090] Updated weights for policy 1, policy_version 971538 (0.0009) [2023-12-26 07:24:14,916][123090] Updated weights for policy 1, policy_version 971548 (0.0009) [2023-12-26 07:24:14,988][123091] Updated weights for policy 0, policy_version 978449 (0.0009) [2023-12-26 07:24:15,052][123091] Updated weights for policy 0, policy_version 978459 (0.0011) [2023-12-26 07:24:15,112][123091] Updated weights for policy 0, policy_version 978469 (0.0011) [2023-12-26 07:24:15,168][123091] Updated weights for policy 0, policy_version 978479 (0.0011) [2023-12-26 07:24:15,697][123090] Updated weights for policy 1, policy_version 971558 (0.0009) [2023-12-26 07:24:15,758][123090] Updated weights for policy 1, policy_version 971568 (0.0009) [2023-12-26 07:24:15,822][123090] Updated weights for policy 1, policy_version 971578 (0.0009) [2023-12-26 07:24:16,005][123091] Updated weights for policy 0, policy_version 978489 (0.0011) [2023-12-26 07:24:16,064][123091] Updated weights for policy 0, policy_version 978499 (0.0011) [2023-12-26 07:24:16,122][123091] Updated weights for policy 0, policy_version 978509 (0.0011) [2023-12-26 07:24:16,707][123090] Updated weights for policy 1, policy_version 971588 (0.0010) [2023-12-26 07:24:16,763][123090] Updated weights for policy 1, policy_version 971598 (0.0008) [2023-12-26 07:24:16,831][123090] Updated weights for policy 1, policy_version 971608 (0.0006) [2023-12-26 07:24:16,855][123091] Updated weights for policy 0, policy_version 978519 (0.0007) [2023-12-26 07:24:16,919][123091] Updated weights for policy 0, policy_version 978529 (0.0005) [2023-12-26 07:24:16,971][123091] Updated weights for policy 0, policy_version 978539 (0.0005) [2023-12-26 07:24:17,523][123090] Updated weights for policy 1, policy_version 971618 (0.0005) [2023-12-26 07:24:17,574][123090] Updated weights for policy 1, policy_version 971628 (0.0005) [2023-12-26 07:24:17,622][123090] Updated weights for policy 1, policy_version 971638 (0.0005) [2023-12-26 07:24:17,668][123090] Updated weights for policy 1, policy_version 971648 (0.0005) [2023-12-26 07:24:17,785][123091] Updated weights for policy 0, policy_version 978549 (0.0007) [2023-12-26 07:24:17,856][123091] Updated weights for policy 0, policy_version 978559 (0.0010) [2023-12-26 07:24:17,917][123091] Updated weights for policy 0, policy_version 978569 (0.0009) [2023-12-26 07:24:18,392][123090] Updated weights for policy 1, policy_version 971658 (0.0009) [2023-12-26 07:24:18,445][123090] Updated weights for policy 1, policy_version 971668 (0.0011) [2023-12-26 07:24:18,511][123090] Updated weights for policy 1, policy_version 971678 (0.0010) [2023-12-26 07:24:18,755][123091] Updated weights for policy 0, policy_version 978579 (0.0008) [2023-12-26 07:24:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 499269632. Throughput: 0: 9042.3, 1: 8809.1. Samples: 499283016. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:18,785][121949] Avg episode reward: [(0, '5961.743'), (1, '6005.240')] [2023-12-26 07:24:18,807][123091] Updated weights for policy 0, policy_version 978589 (0.0009) [2023-12-26 07:24:18,868][123091] Updated weights for policy 0, policy_version 978599 (0.0009) [2023-12-26 07:24:19,281][123090] Updated weights for policy 1, policy_version 971688 (0.0009) [2023-12-26 07:24:19,340][123090] Updated weights for policy 1, policy_version 971698 (0.0007) [2023-12-26 07:24:19,405][123090] Updated weights for policy 1, policy_version 971708 (0.0010) [2023-12-26 07:24:19,758][123091] Updated weights for policy 0, policy_version 978609 (0.0008) [2023-12-26 07:24:19,829][123091] Updated weights for policy 0, policy_version 978619 (0.0009) [2023-12-26 07:24:19,901][123091] Updated weights for policy 0, policy_version 978629 (0.0009) [2023-12-26 07:24:19,970][123091] Updated weights for policy 0, policy_version 978639 (0.0009) [2023-12-26 07:24:20,243][123090] Updated weights for policy 1, policy_version 971718 (0.0009) [2023-12-26 07:24:20,299][123090] Updated weights for policy 1, policy_version 971728 (0.0009) [2023-12-26 07:24:20,349][123090] Updated weights for policy 1, policy_version 971738 (0.0009) [2023-12-26 07:24:20,812][123091] Updated weights for policy 0, policy_version 978649 (0.0009) [2023-12-26 07:24:20,868][123091] Updated weights for policy 0, policy_version 978659 (0.0009) [2023-12-26 07:24:20,926][123091] Updated weights for policy 0, policy_version 978669 (0.0009) [2023-12-26 07:24:21,212][123090] Updated weights for policy 1, policy_version 971748 (0.0009) [2023-12-26 07:24:21,280][123090] Updated weights for policy 1, policy_version 971758 (0.0009) [2023-12-26 07:24:21,350][123090] Updated weights for policy 1, policy_version 971768 (0.0008) [2023-12-26 07:24:21,801][123091] Updated weights for policy 0, policy_version 978679 (0.0008) [2023-12-26 07:24:21,874][123091] Updated weights for policy 0, policy_version 978689 (0.0009) [2023-12-26 07:24:21,939][123091] Updated weights for policy 0, policy_version 978699 (0.0009) [2023-12-26 07:24:22,188][123090] Updated weights for policy 1, policy_version 971778 (0.0008) [2023-12-26 07:24:22,260][123090] Updated weights for policy 1, policy_version 971788 (0.0007) [2023-12-26 07:24:22,322][123090] Updated weights for policy 1, policy_version 971798 (0.0010) [2023-12-26 07:24:22,385][123090] Updated weights for policy 1, policy_version 971808 (0.0009) [2023-12-26 07:24:22,740][123091] Updated weights for policy 0, policy_version 978709 (0.0008) [2023-12-26 07:24:22,796][123091] Updated weights for policy 0, policy_version 978719 (0.0009) [2023-12-26 07:24:22,850][123091] Updated weights for policy 0, policy_version 978729 (0.0010) [2023-12-26 07:24:23,052][123090] Updated weights for policy 1, policy_version 971818 (0.0005) [2023-12-26 07:24:23,132][123090] Updated weights for policy 1, policy_version 971828 (0.0006) [2023-12-26 07:24:23,206][123090] Updated weights for policy 1, policy_version 971838 (0.0005) [2023-12-26 07:24:23,629][123091] Updated weights for policy 0, policy_version 978739 (0.0009) [2023-12-26 07:24:23,682][123091] Updated weights for policy 0, policy_version 978750 (0.0010) [2023-12-26 07:24:23,739][123091] Updated weights for policy 0, policy_version 978760 (0.0010) [2023-12-26 07:24:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 499359744. Throughput: 0: 9034.4, 1: 8764.6. Samples: 499332876. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:23,784][121949] Avg episode reward: [(0, '6069.616'), (1, '6009.306')] [2023-12-26 07:24:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000971840_248791040.pth... [2023-12-26 07:24:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000978768_250568704.pth... [2023-12-26 07:24:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000970816_248528896.pth [2023-12-26 07:24:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000977712_250298368.pth [2023-12-26 07:24:23,877][123090] Updated weights for policy 1, policy_version 971848 (0.0005) [2023-12-26 07:24:23,924][123090] Updated weights for policy 1, policy_version 971858 (0.0005) [2023-12-26 07:24:23,984][123090] Updated weights for policy 1, policy_version 971868 (0.0005) [2023-12-26 07:24:24,567][123091] Updated weights for policy 0, policy_version 978770 (0.0009) [2023-12-26 07:24:24,625][123091] Updated weights for policy 0, policy_version 978780 (0.0005) [2023-12-26 07:24:24,693][123091] Updated weights for policy 0, policy_version 978790 (0.0005) [2023-12-26 07:24:24,759][123091] Updated weights for policy 0, policy_version 978800 (0.0005) [2023-12-26 07:24:24,780][123090] Updated weights for policy 1, policy_version 971878 (0.0009) [2023-12-26 07:24:24,827][123090] Updated weights for policy 1, policy_version 971888 (0.0010) [2023-12-26 07:24:24,886][123090] Updated weights for policy 1, policy_version 971898 (0.0010) [2023-12-26 07:24:25,342][123091] Updated weights for policy 0, policy_version 978810 (0.0006) [2023-12-26 07:24:25,410][123091] Updated weights for policy 0, policy_version 978820 (0.0005) [2023-12-26 07:24:25,474][123091] Updated weights for policy 0, policy_version 978830 (0.0005) [2023-12-26 07:24:25,617][123090] Updated weights for policy 1, policy_version 971908 (0.0006) [2023-12-26 07:24:25,670][123090] Updated weights for policy 1, policy_version 971918 (0.0010) [2023-12-26 07:24:25,718][123090] Updated weights for policy 1, policy_version 971928 (0.0010) [2023-12-26 07:24:26,132][123091] Updated weights for policy 0, policy_version 978840 (0.0008) [2023-12-26 07:24:26,195][123091] Updated weights for policy 0, policy_version 978850 (0.0009) [2023-12-26 07:24:26,259][123091] Updated weights for policy 0, policy_version 978860 (0.0009) [2023-12-26 07:24:26,549][123090] Updated weights for policy 1, policy_version 971938 (0.0010) [2023-12-26 07:24:26,611][123090] Updated weights for policy 1, policy_version 971948 (0.0010) [2023-12-26 07:24:26,672][123090] Updated weights for policy 1, policy_version 971958 (0.0010) [2023-12-26 07:24:26,729][123090] Updated weights for policy 1, policy_version 971968 (0.0010) [2023-12-26 07:24:27,092][123091] Updated weights for policy 0, policy_version 978870 (0.0009) [2023-12-26 07:24:27,151][123091] Updated weights for policy 0, policy_version 978880 (0.0010) [2023-12-26 07:24:27,214][123091] Updated weights for policy 0, policy_version 978890 (0.0009) [2023-12-26 07:24:27,521][123090] Updated weights for policy 1, policy_version 971978 (0.0010) [2023-12-26 07:24:27,582][123090] Updated weights for policy 1, policy_version 971988 (0.0010) [2023-12-26 07:24:27,638][123090] Updated weights for policy 1, policy_version 971998 (0.0010) [2023-12-26 07:24:28,053][123091] Updated weights for policy 0, policy_version 978900 (0.0009) [2023-12-26 07:24:28,100][123091] Updated weights for policy 0, policy_version 978910 (0.0009) [2023-12-26 07:24:28,156][123091] Updated weights for policy 0, policy_version 978920 (0.0009) [2023-12-26 07:24:28,452][123090] Updated weights for policy 1, policy_version 972008 (0.0010) [2023-12-26 07:24:28,511][123090] Updated weights for policy 1, policy_version 972018 (0.0010) [2023-12-26 07:24:28,574][123090] Updated weights for policy 1, policy_version 972028 (0.0010) [2023-12-26 07:24:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 499449856. Throughput: 0: 9063.3, 1: 8856.2. Samples: 499442568. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:28,785][121949] Avg episode reward: [(0, '6116.906'), (1, '6019.504')] [2023-12-26 07:24:29,019][123091] Updated weights for policy 0, policy_version 978930 (0.0009) [2023-12-26 07:24:29,084][123091] Updated weights for policy 0, policy_version 978940 (0.0010) [2023-12-26 07:24:29,146][123091] Updated weights for policy 0, policy_version 978950 (0.0010) [2023-12-26 07:24:29,208][123091] Updated weights for policy 0, policy_version 978960 (0.0010) [2023-12-26 07:24:29,389][123090] Updated weights for policy 1, policy_version 972038 (0.0011) [2023-12-26 07:24:29,442][123090] Updated weights for policy 1, policy_version 972048 (0.0010) [2023-12-26 07:24:29,497][123090] Updated weights for policy 1, policy_version 972058 (0.0010) [2023-12-26 07:24:30,044][123091] Updated weights for policy 0, policy_version 978970 (0.0011) [2023-12-26 07:24:30,116][123091] Updated weights for policy 0, policy_version 978980 (0.0011) [2023-12-26 07:24:30,182][123091] Updated weights for policy 0, policy_version 978990 (0.0011) [2023-12-26 07:24:30,317][123090] Updated weights for policy 1, policy_version 972068 (0.0008) [2023-12-26 07:24:30,391][123090] Updated weights for policy 1, policy_version 972078 (0.0006) [2023-12-26 07:24:30,451][123090] Updated weights for policy 1, policy_version 972088 (0.0009) [2023-12-26 07:24:30,990][123091] Updated weights for policy 0, policy_version 979000 (0.0011) [2023-12-26 07:24:31,054][123091] Updated weights for policy 0, policy_version 979010 (0.0011) [2023-12-26 07:24:31,125][123091] Updated weights for policy 0, policy_version 979020 (0.0011) [2023-12-26 07:24:31,196][123090] Updated weights for policy 1, policy_version 972098 (0.0009) [2023-12-26 07:24:31,262][123090] Updated weights for policy 1, policy_version 972108 (0.0009) [2023-12-26 07:24:31,326][123090] Updated weights for policy 1, policy_version 972118 (0.0009) [2023-12-26 07:24:31,401][123090] Updated weights for policy 1, policy_version 972128 (0.0008) [2023-12-26 07:24:31,974][123091] Updated weights for policy 0, policy_version 979030 (0.0011) [2023-12-26 07:24:32,038][123091] Updated weights for policy 0, policy_version 979040 (0.0011) [2023-12-26 07:24:32,103][123091] Updated weights for policy 0, policy_version 979050 (0.0011) [2023-12-26 07:24:32,255][123090] Updated weights for policy 1, policy_version 972138 (0.0009) [2023-12-26 07:24:32,319][123090] Updated weights for policy 1, policy_version 972148 (0.0009) [2023-12-26 07:24:32,385][123090] Updated weights for policy 1, policy_version 972158 (0.0008) [2023-12-26 07:24:32,930][123091] Updated weights for policy 0, policy_version 979060 (0.0009) [2023-12-26 07:24:32,992][123091] Updated weights for policy 0, policy_version 979070 (0.0010) [2023-12-26 07:24:33,055][123091] Updated weights for policy 0, policy_version 979080 (0.0011) [2023-12-26 07:24:33,200][123090] Updated weights for policy 1, policy_version 972168 (0.0009) [2023-12-26 07:24:33,247][123090] Updated weights for policy 1, policy_version 972178 (0.0008) [2023-12-26 07:24:33,301][123090] Updated weights for policy 1, policy_version 972188 (0.0005) [2023-12-26 07:24:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 499531776. Throughput: 0: 8893.4, 1: 8798.1. Samples: 499545544. Policy #0 lag: (min: 23.0, avg: 28.1, max: 55.0) [2023-12-26 07:24:33,785][121949] Avg episode reward: [(0, '6175.400'), (1, '5969.670')] [2023-12-26 07:24:33,819][123091] Updated weights for policy 0, policy_version 979090 (0.0010) [2023-12-26 07:24:33,884][123091] Updated weights for policy 0, policy_version 979100 (0.0008) [2023-12-26 07:24:33,939][123091] Updated weights for policy 0, policy_version 979110 (0.0006) [2023-12-26 07:24:34,003][123091] Updated weights for policy 0, policy_version 979120 (0.0005) [2023-12-26 07:24:34,141][123090] Updated weights for policy 1, policy_version 972198 (0.0008) [2023-12-26 07:24:34,200][123090] Updated weights for policy 1, policy_version 972208 (0.0010) [2023-12-26 07:24:34,255][123090] Updated weights for policy 1, policy_version 972218 (0.0009) [2023-12-26 07:24:34,733][123091] Updated weights for policy 0, policy_version 979130 (0.0010) [2023-12-26 07:24:34,783][123091] Updated weights for policy 0, policy_version 979140 (0.0009) [2023-12-26 07:24:34,843][123091] Updated weights for policy 0, policy_version 979150 (0.0009) [2023-12-26 07:24:35,100][123090] Updated weights for policy 1, policy_version 972228 (0.0008) [2023-12-26 07:24:35,166][123090] Updated weights for policy 1, policy_version 972238 (0.0008) [2023-12-26 07:24:35,237][123090] Updated weights for policy 1, policy_version 972248 (0.0010) [2023-12-26 07:24:35,568][123091] Updated weights for policy 0, policy_version 979160 (0.0006) [2023-12-26 07:24:35,613][123091] Updated weights for policy 0, policy_version 979170 (0.0005) [2023-12-26 07:24:35,661][123091] Updated weights for policy 0, policy_version 979180 (0.0006) [2023-12-26 07:24:35,970][123090] Updated weights for policy 1, policy_version 972258 (0.0009) [2023-12-26 07:24:36,049][123090] Updated weights for policy 1, policy_version 972268 (0.0005) [2023-12-26 07:24:36,111][123090] Updated weights for policy 1, policy_version 972278 (0.0006) [2023-12-26 07:24:36,173][123090] Updated weights for policy 1, policy_version 972288 (0.0006) [2023-12-26 07:24:36,537][123091] Updated weights for policy 0, policy_version 979190 (0.0010) [2023-12-26 07:24:36,597][123091] Updated weights for policy 0, policy_version 979200 (0.0010) [2023-12-26 07:24:36,664][123091] Updated weights for policy 0, policy_version 979210 (0.0009) [2023-12-26 07:24:36,877][123090] Updated weights for policy 1, policy_version 972298 (0.0010) [2023-12-26 07:24:36,930][123090] Updated weights for policy 1, policy_version 972308 (0.0010) [2023-12-26 07:24:36,981][123090] Updated weights for policy 1, policy_version 972318 (0.0009) [2023-12-26 07:24:37,504][123091] Updated weights for policy 0, policy_version 979220 (0.0009) [2023-12-26 07:24:37,555][123091] Updated weights for policy 0, policy_version 979230 (0.0010) [2023-12-26 07:24:37,611][123091] Updated weights for policy 0, policy_version 979240 (0.0009) [2023-12-26 07:24:37,827][123090] Updated weights for policy 1, policy_version 972328 (0.0009) [2023-12-26 07:24:37,892][123090] Updated weights for policy 1, policy_version 972338 (0.0009) [2023-12-26 07:24:37,949][123090] Updated weights for policy 1, policy_version 972348 (0.0010) [2023-12-26 07:24:38,457][123091] Updated weights for policy 0, policy_version 979250 (0.0010) [2023-12-26 07:24:38,528][123091] Updated weights for policy 0, policy_version 979260 (0.0007) [2023-12-26 07:24:38,591][123091] Updated weights for policy 0, policy_version 979270 (0.0008) [2023-12-26 07:24:38,657][123091] Updated weights for policy 0, policy_version 979280 (0.0008) [2023-12-26 07:24:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 499621888. Throughput: 0: 8934.5, 1: 8813.8. Samples: 499599868. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:24:38,785][121949] Avg episode reward: [(0, '6166.799'), (1, '5969.976')] [2023-12-26 07:24:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000979280_250699776.pth... [2023-12-26 07:24:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000972352_248922112.pth... [2023-12-26 07:24:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000978256_250437632.pth [2023-12-26 07:24:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000971328_248659968.pth [2023-12-26 07:24:38,860][123090] Updated weights for policy 1, policy_version 972358 (0.0010) [2023-12-26 07:24:38,922][123090] Updated weights for policy 1, policy_version 972368 (0.0010) [2023-12-26 07:24:38,984][123090] Updated weights for policy 1, policy_version 972378 (0.0010) [2023-12-26 07:24:39,386][123091] Updated weights for policy 0, policy_version 979290 (0.0009) [2023-12-26 07:24:39,459][123091] Updated weights for policy 0, policy_version 979300 (0.0008) [2023-12-26 07:24:39,528][123091] Updated weights for policy 0, policy_version 979310 (0.0006) [2023-12-26 07:24:39,898][123090] Updated weights for policy 1, policy_version 972388 (0.0008) [2023-12-26 07:24:39,970][123090] Updated weights for policy 1, policy_version 972398 (0.0009) [2023-12-26 07:24:40,035][123090] Updated weights for policy 1, policy_version 972408 (0.0007) [2023-12-26 07:24:40,308][123091] Updated weights for policy 0, policy_version 979320 (0.0010) [2023-12-26 07:24:40,373][123091] Updated weights for policy 0, policy_version 979330 (0.0006) [2023-12-26 07:24:40,431][123091] Updated weights for policy 0, policy_version 979340 (0.0007) [2023-12-26 07:24:40,813][123090] Updated weights for policy 1, policy_version 972418 (0.0007) [2023-12-26 07:24:40,862][123090] Updated weights for policy 1, policy_version 972428 (0.0007) [2023-12-26 07:24:40,914][123090] Updated weights for policy 1, policy_version 972438 (0.0005) [2023-12-26 07:24:40,972][123090] Updated weights for policy 1, policy_version 972448 (0.0005) [2023-12-26 07:24:41,138][123091] Updated weights for policy 0, policy_version 979350 (0.0010) [2023-12-26 07:24:41,204][123091] Updated weights for policy 0, policy_version 979360 (0.0009) [2023-12-26 07:24:41,269][123091] Updated weights for policy 0, policy_version 979370 (0.0009) [2023-12-26 07:24:41,824][123090] Updated weights for policy 1, policy_version 972458 (0.0006) [2023-12-26 07:24:41,881][123090] Updated weights for policy 1, policy_version 972468 (0.0009) [2023-12-26 07:24:41,933][123090] Updated weights for policy 1, policy_version 972478 (0.0008) [2023-12-26 07:24:42,131][123091] Updated weights for policy 0, policy_version 979380 (0.0008) [2023-12-26 07:24:42,195][123091] Updated weights for policy 0, policy_version 979390 (0.0005) [2023-12-26 07:24:42,263][123091] Updated weights for policy 0, policy_version 979400 (0.0006) [2023-12-26 07:24:42,791][123090] Updated weights for policy 1, policy_version 972488 (0.0008) [2023-12-26 07:24:42,858][123090] Updated weights for policy 1, policy_version 972498 (0.0010) [2023-12-26 07:24:42,917][123090] Updated weights for policy 1, policy_version 972508 (0.0008) [2023-12-26 07:24:42,987][123091] Updated weights for policy 0, policy_version 979410 (0.0007) [2023-12-26 07:24:43,060][123091] Updated weights for policy 0, policy_version 979420 (0.0008) [2023-12-26 07:24:43,129][123091] Updated weights for policy 0, policy_version 979430 (0.0010) [2023-12-26 07:24:43,204][123091] Updated weights for policy 0, policy_version 979440 (0.0010) [2023-12-26 07:24:43,622][123090] Updated weights for policy 1, policy_version 972518 (0.0008) [2023-12-26 07:24:43,679][123090] Updated weights for policy 1, policy_version 972528 (0.0009) [2023-12-26 07:24:43,738][123090] Updated weights for policy 1, policy_version 972538 (0.0009) [2023-12-26 07:24:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 499712000. Throughput: 0: 8889.2, 1: 8688.6. Samples: 499703536. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:24:43,784][121949] Avg episode reward: [(0, '6235.198'), (1, '5975.546')] [2023-12-26 07:24:43,968][123091] Updated weights for policy 0, policy_version 979450 (0.0005) [2023-12-26 07:24:44,033][123091] Updated weights for policy 0, policy_version 979460 (0.0005) [2023-12-26 07:24:44,086][123091] Updated weights for policy 0, policy_version 979470 (0.0005) [2023-12-26 07:24:44,527][123090] Updated weights for policy 1, policy_version 972548 (0.0007) [2023-12-26 07:24:44,589][123090] Updated weights for policy 1, policy_version 972558 (0.0010) [2023-12-26 07:24:44,659][123090] Updated weights for policy 1, policy_version 972568 (0.0010) [2023-12-26 07:24:44,732][123091] Updated weights for policy 0, policy_version 979480 (0.0005) [2023-12-26 07:24:44,803][123091] Updated weights for policy 0, policy_version 979490 (0.0007) [2023-12-26 07:24:44,852][123091] Updated weights for policy 0, policy_version 979500 (0.0005) [2023-12-26 07:24:45,512][123090] Updated weights for policy 1, policy_version 972578 (0.0009) [2023-12-26 07:24:45,556][123091] Updated weights for policy 0, policy_version 979510 (0.0008) [2023-12-26 07:24:45,569][123090] Updated weights for policy 1, policy_version 972588 (0.0005) [2023-12-26 07:24:45,616][123091] Updated weights for policy 0, policy_version 979520 (0.0011) [2023-12-26 07:24:45,627][123090] Updated weights for policy 1, policy_version 972598 (0.0008) [2023-12-26 07:24:45,678][123091] Updated weights for policy 0, policy_version 979530 (0.0011) [2023-12-26 07:24:45,683][123090] Updated weights for policy 1, policy_version 972608 (0.0005) [2023-12-26 07:24:46,347][123090] Updated weights for policy 1, policy_version 972618 (0.0006) [2023-12-26 07:24:46,409][123090] Updated weights for policy 1, policy_version 972628 (0.0005) [2023-12-26 07:24:46,457][123090] Updated weights for policy 1, policy_version 972638 (0.0007) [2023-12-26 07:24:46,464][123091] Updated weights for policy 0, policy_version 979540 (0.0008) [2023-12-26 07:24:46,516][123091] Updated weights for policy 0, policy_version 979550 (0.0005) [2023-12-26 07:24:46,566][123091] Updated weights for policy 0, policy_version 979560 (0.0005) [2023-12-26 07:24:47,240][123091] Updated weights for policy 0, policy_version 979570 (0.0005) [2023-12-26 07:24:47,280][123090] Updated weights for policy 1, policy_version 972648 (0.0009) [2023-12-26 07:24:47,299][123091] Updated weights for policy 0, policy_version 979580 (0.0005) [2023-12-26 07:24:47,346][123090] Updated weights for policy 1, policy_version 972658 (0.0009) [2023-12-26 07:24:47,353][123091] Updated weights for policy 0, policy_version 979590 (0.0005) [2023-12-26 07:24:47,408][123091] Updated weights for policy 0, policy_version 979600 (0.0005) [2023-12-26 07:24:47,411][123090] Updated weights for policy 1, policy_version 972668 (0.0009) [2023-12-26 07:24:48,163][123091] Updated weights for policy 0, policy_version 979610 (0.0011) [2023-12-26 07:24:48,227][123091] Updated weights for policy 0, policy_version 979620 (0.0011) [2023-12-26 07:24:48,284][123090] Updated weights for policy 1, policy_version 972678 (0.0007) [2023-12-26 07:24:48,295][123091] Updated weights for policy 0, policy_version 979630 (0.0011) [2023-12-26 07:24:48,359][123090] Updated weights for policy 1, policy_version 972688 (0.0007) [2023-12-26 07:24:48,422][123090] Updated weights for policy 1, policy_version 972698 (0.0007) [2023-12-26 07:24:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 499802112. Throughput: 0: 8899.3, 1: 8747.8. Samples: 499813944. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:24:48,785][121949] Avg episode reward: [(0, '6196.081'), (1, '5938.382')] [2023-12-26 07:24:49,136][123091] Updated weights for policy 0, policy_version 979640 (0.0007) [2023-12-26 07:24:49,209][123091] Updated weights for policy 0, policy_version 979650 (0.0007) [2023-12-26 07:24:49,243][123090] Updated weights for policy 1, policy_version 972708 (0.0009) [2023-12-26 07:24:49,277][123091] Updated weights for policy 0, policy_version 979660 (0.0009) [2023-12-26 07:24:49,310][123090] Updated weights for policy 1, policy_version 972718 (0.0008) [2023-12-26 07:24:49,375][123090] Updated weights for policy 1, policy_version 972728 (0.0010) [2023-12-26 07:24:50,096][123091] Updated weights for policy 0, policy_version 979670 (0.0011) [2023-12-26 07:24:50,120][123090] Updated weights for policy 1, policy_version 972738 (0.0008) [2023-12-26 07:24:50,147][123091] Updated weights for policy 0, policy_version 979680 (0.0010) [2023-12-26 07:24:50,184][123090] Updated weights for policy 1, policy_version 972748 (0.0006) [2023-12-26 07:24:50,206][123091] Updated weights for policy 0, policy_version 979690 (0.0010) [2023-12-26 07:24:50,246][123090] Updated weights for policy 1, policy_version 972758 (0.0007) [2023-12-26 07:24:50,312][123090] Updated weights for policy 1, policy_version 972768 (0.0010) [2023-12-26 07:24:50,940][123091] Updated weights for policy 0, policy_version 979700 (0.0008) [2023-12-26 07:24:51,002][123091] Updated weights for policy 0, policy_version 979710 (0.0010) [2023-12-26 07:24:51,067][123091] Updated weights for policy 0, policy_version 979720 (0.0009) [2023-12-26 07:24:51,109][123090] Updated weights for policy 1, policy_version 972778 (0.0009) [2023-12-26 07:24:51,180][123090] Updated weights for policy 1, policy_version 972788 (0.0010) [2023-12-26 07:24:51,245][123090] Updated weights for policy 1, policy_version 972798 (0.0010) [2023-12-26 07:24:51,859][123091] Updated weights for policy 0, policy_version 979730 (0.0007) [2023-12-26 07:24:51,933][123091] Updated weights for policy 0, policy_version 979740 (0.0007) [2023-12-26 07:24:52,005][123091] Updated weights for policy 0, policy_version 979750 (0.0006) [2023-12-26 07:24:52,075][123091] Updated weights for policy 0, policy_version 979760 (0.0006) [2023-12-26 07:24:52,145][123090] Updated weights for policy 1, policy_version 972808 (0.0010) [2023-12-26 07:24:52,199][123090] Updated weights for policy 1, policy_version 972818 (0.0010) [2023-12-26 07:24:52,261][123090] Updated weights for policy 1, policy_version 972829 (0.0010) [2023-12-26 07:24:52,724][123091] Updated weights for policy 0, policy_version 979770 (0.0010) [2023-12-26 07:24:52,788][123091] Updated weights for policy 0, policy_version 979780 (0.0009) [2023-12-26 07:24:52,860][123091] Updated weights for policy 0, policy_version 979790 (0.0009) [2023-12-26 07:24:53,051][123090] Updated weights for policy 1, policy_version 972839 (0.0007) [2023-12-26 07:24:53,121][123090] Updated weights for policy 1, policy_version 972849 (0.0006) [2023-12-26 07:24:53,194][123090] Updated weights for policy 1, policy_version 972859 (0.0005) [2023-12-26 07:24:53,684][123091] Updated weights for policy 0, policy_version 979800 (0.0011) [2023-12-26 07:24:53,737][123091] Updated weights for policy 0, policy_version 979810 (0.0008) [2023-12-26 07:24:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 499884032. Throughput: 0: 8862.1, 1: 8729.8. Samples: 499866088. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:24:53,785][121949] Avg episode reward: [(0, '6088.040'), (1, '5987.705')] [2023-12-26 07:24:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000972864_249053184.pth... [2023-12-26 07:24:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000971840_248791040.pth [2023-12-26 07:24:53,797][123091] Updated weights for policy 0, policy_version 979820 (0.0005) [2023-12-26 07:24:53,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000979824_250839040.pth... [2023-12-26 07:24:53,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000978768_250568704.pth [2023-12-26 07:24:53,907][123090] Updated weights for policy 1, policy_version 972869 (0.0007) [2023-12-26 07:24:53,966][123090] Updated weights for policy 1, policy_version 972879 (0.0006) [2023-12-26 07:24:54,024][123090] Updated weights for policy 1, policy_version 972889 (0.0005) [2023-12-26 07:24:54,592][123091] Updated weights for policy 0, policy_version 979830 (0.0009) [2023-12-26 07:24:54,647][123091] Updated weights for policy 0, policy_version 979840 (0.0010) [2023-12-26 07:24:54,706][123091] Updated weights for policy 0, policy_version 979850 (0.0011) [2023-12-26 07:24:54,748][123090] Updated weights for policy 1, policy_version 972899 (0.0007) [2023-12-26 07:24:54,806][123090] Updated weights for policy 1, policy_version 972909 (0.0007) [2023-12-26 07:24:54,853][123090] Updated weights for policy 1, policy_version 972919 (0.0009) [2023-12-26 07:24:55,550][123091] Updated weights for policy 0, policy_version 979860 (0.0011) [2023-12-26 07:24:55,608][123091] Updated weights for policy 0, policy_version 979870 (0.0011) [2023-12-26 07:24:55,618][123090] Updated weights for policy 1, policy_version 972929 (0.0009) [2023-12-26 07:24:55,666][123091] Updated weights for policy 0, policy_version 979880 (0.0011) [2023-12-26 07:24:55,677][123090] Updated weights for policy 1, policy_version 972939 (0.0010) [2023-12-26 07:24:55,739][123090] Updated weights for policy 1, policy_version 972949 (0.0010) [2023-12-26 07:24:55,802][123090] Updated weights for policy 1, policy_version 972959 (0.0010) [2023-12-26 07:24:56,494][123091] Updated weights for policy 0, policy_version 979890 (0.0010) [2023-12-26 07:24:56,544][123091] Updated weights for policy 0, policy_version 979900 (0.0010) [2023-12-26 07:24:56,592][123091] Updated weights for policy 0, policy_version 979910 (0.0009) [2023-12-26 07:24:56,625][123090] Updated weights for policy 1, policy_version 972969 (0.0010) [2023-12-26 07:24:56,645][123091] Updated weights for policy 0, policy_version 979920 (0.0005) [2023-12-26 07:24:56,687][123090] Updated weights for policy 1, policy_version 972979 (0.0010) [2023-12-26 07:24:56,733][123090] Updated weights for policy 1, policy_version 972989 (0.0010) [2023-12-26 07:24:57,469][123091] Updated weights for policy 0, policy_version 979930 (0.0010) [2023-12-26 07:24:57,524][123091] Updated weights for policy 0, policy_version 979940 (0.0010) [2023-12-26 07:24:57,536][123090] Updated weights for policy 1, policy_version 972999 (0.0007) [2023-12-26 07:24:57,571][123091] Updated weights for policy 0, policy_version 979950 (0.0010) [2023-12-26 07:24:57,589][123090] Updated weights for policy 1, policy_version 973009 (0.0005) [2023-12-26 07:24:57,644][123090] Updated weights for policy 1, policy_version 973019 (0.0005) [2023-12-26 07:24:58,388][123090] Updated weights for policy 1, policy_version 973029 (0.0006) [2023-12-26 07:24:58,421][123091] Updated weights for policy 0, policy_version 979960 (0.0009) [2023-12-26 07:24:58,454][123090] Updated weights for policy 1, policy_version 973039 (0.0008) [2023-12-26 07:24:58,494][123091] Updated weights for policy 0, policy_version 979970 (0.0010) [2023-12-26 07:24:58,522][123090] Updated weights for policy 1, policy_version 973049 (0.0008) [2023-12-26 07:24:58,562][123091] Updated weights for policy 0, policy_version 979980 (0.0011) [2023-12-26 07:24:58,785][121949] Fps is (10 sec: 18020.7, 60 sec: 17749.0, 300 sec: 17716.9). Total num frames: 499982336. Throughput: 0: 8872.8, 1: 8811.0. Samples: 499972344. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:24:58,786][121949] Avg episode reward: [(0, '6002.210'), (1, '5965.083')] [2023-12-26 07:24:59,436][123090] Updated weights for policy 1, policy_version 973059 (0.0009) [2023-12-26 07:24:59,460][123091] Updated weights for policy 0, policy_version 979990 (0.0011) [2023-12-26 07:24:59,484][123090] Updated weights for policy 1, policy_version 973069 (0.0005) [2023-12-26 07:24:59,512][123091] Updated weights for policy 0, policy_version 980000 (0.0010) [2023-12-26 07:24:59,537][123090] Updated weights for policy 1, policy_version 973079 (0.0007) [2023-12-26 07:24:59,568][123091] Updated weights for policy 0, policy_version 980010 (0.0010) [2023-12-26 07:25:00,416][123091] Updated weights for policy 0, policy_version 980020 (0.0010) [2023-12-26 07:25:00,425][123090] Updated weights for policy 1, policy_version 973089 (0.0007) [2023-12-26 07:25:00,472][123091] Updated weights for policy 0, policy_version 980030 (0.0007) [2023-12-26 07:25:00,496][123090] Updated weights for policy 1, policy_version 973099 (0.0008) [2023-12-26 07:25:00,539][123091] Updated weights for policy 0, policy_version 980040 (0.0010) [2023-12-26 07:25:00,553][123090] Updated weights for policy 1, policy_version 973109 (0.0010) [2023-12-26 07:25:00,610][123090] Updated weights for policy 1, policy_version 973119 (0.0011) [2023-12-26 07:25:01,383][123090] Updated weights for policy 1, policy_version 973129 (0.0008) [2023-12-26 07:25:01,399][123091] Updated weights for policy 0, policy_version 980050 (0.0011) [2023-12-26 07:25:01,448][123090] Updated weights for policy 1, policy_version 973139 (0.0005) [2023-12-26 07:25:01,463][123091] Updated weights for policy 0, policy_version 980060 (0.0009) [2023-12-26 07:25:01,506][123090] Updated weights for policy 1, policy_version 973149 (0.0005) [2023-12-26 07:25:01,531][123091] Updated weights for policy 0, policy_version 980070 (0.0009) [2023-12-26 07:25:01,593][123091] Updated weights for policy 0, policy_version 980080 (0.0010) [2023-12-26 07:25:02,241][123090] Updated weights for policy 1, policy_version 973159 (0.0006) [2023-12-26 07:25:02,295][123090] Updated weights for policy 1, policy_version 973169 (0.0006) [2023-12-26 07:25:02,351][123090] Updated weights for policy 1, policy_version 973179 (0.0005) [2023-12-26 07:25:02,471][123091] Updated weights for policy 0, policy_version 980090 (0.0010) [2023-12-26 07:25:02,519][123091] Updated weights for policy 0, policy_version 980100 (0.0010) [2023-12-26 07:25:02,562][123091] Updated weights for policy 0, policy_version 980110 (0.0010) [2023-12-26 07:25:02,982][123090] Updated weights for policy 1, policy_version 973189 (0.0008) [2023-12-26 07:25:03,052][123090] Updated weights for policy 1, policy_version 973199 (0.0010) [2023-12-26 07:25:03,117][123090] Updated weights for policy 1, policy_version 973209 (0.0009) [2023-12-26 07:25:03,374][123091] Updated weights for policy 0, policy_version 980120 (0.0010) [2023-12-26 07:25:03,428][123091] Updated weights for policy 0, policy_version 980130 (0.0007) [2023-12-26 07:25:03,483][123091] Updated weights for policy 0, policy_version 980140 (0.0005) [2023-12-26 07:25:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 500064256. Throughput: 0: 8821.9, 1: 8808.0. Samples: 500076360. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:03,784][121949] Avg episode reward: [(0, '5966.860'), (1, '5937.071')] [2023-12-26 07:25:04,005][123090] Updated weights for policy 1, policy_version 973219 (0.0009) [2023-12-26 07:25:04,076][123090] Updated weights for policy 1, policy_version 973229 (0.0010) [2023-12-26 07:25:04,151][123090] Updated weights for policy 1, policy_version 973239 (0.0008) [2023-12-26 07:25:04,169][123091] Updated weights for policy 0, policy_version 980150 (0.0007) [2023-12-26 07:25:04,239][123091] Updated weights for policy 0, policy_version 980160 (0.0009) [2023-12-26 07:25:04,307][123091] Updated weights for policy 0, policy_version 980170 (0.0008) [2023-12-26 07:25:04,964][123090] Updated weights for policy 1, policy_version 973249 (0.0008) [2023-12-26 07:25:05,016][123090] Updated weights for policy 1, policy_version 973259 (0.0007) [2023-12-26 07:25:05,086][123090] Updated weights for policy 1, policy_version 973269 (0.0006) [2023-12-26 07:25:05,128][123091] Updated weights for policy 0, policy_version 980180 (0.0009) [2023-12-26 07:25:05,144][123090] Updated weights for policy 1, policy_version 973279 (0.0006) [2023-12-26 07:25:05,189][123091] Updated weights for policy 0, policy_version 980190 (0.0010) [2023-12-26 07:25:05,242][123091] Updated weights for policy 0, policy_version 980200 (0.0009) [2023-12-26 07:25:05,802][123090] Updated weights for policy 1, policy_version 973289 (0.0005) [2023-12-26 07:25:05,850][123090] Updated weights for policy 1, policy_version 973299 (0.0005) [2023-12-26 07:25:05,910][123090] Updated weights for policy 1, policy_version 973309 (0.0009) [2023-12-26 07:25:06,011][123091] Updated weights for policy 0, policy_version 980210 (0.0009) [2023-12-26 07:25:06,068][123091] Updated weights for policy 0, policy_version 980220 (0.0005) [2023-12-26 07:25:06,131][123091] Updated weights for policy 0, policy_version 980230 (0.0007) [2023-12-26 07:25:06,186][123091] Updated weights for policy 0, policy_version 980240 (0.0008) [2023-12-26 07:25:06,719][123090] Updated weights for policy 1, policy_version 973319 (0.0005) [2023-12-26 07:25:06,787][123090] Updated weights for policy 1, policy_version 973329 (0.0009) [2023-12-26 07:25:06,847][123090] Updated weights for policy 1, policy_version 973339 (0.0005) [2023-12-26 07:25:07,050][123091] Updated weights for policy 0, policy_version 980250 (0.0008) [2023-12-26 07:25:07,121][123091] Updated weights for policy 0, policy_version 980260 (0.0005) [2023-12-26 07:25:07,194][123091] Updated weights for policy 0, policy_version 980270 (0.0005) [2023-12-26 07:25:07,536][123090] Updated weights for policy 1, policy_version 973349 (0.0008) [2023-12-26 07:25:07,584][123090] Updated weights for policy 1, policy_version 973359 (0.0010) [2023-12-26 07:25:07,632][123090] Updated weights for policy 1, policy_version 973369 (0.0008) [2023-12-26 07:25:07,808][123091] Updated weights for policy 0, policy_version 980280 (0.0005) [2023-12-26 07:25:07,862][123091] Updated weights for policy 0, policy_version 980290 (0.0005) [2023-12-26 07:25:07,917][123091] Updated weights for policy 0, policy_version 980300 (0.0005) [2023-12-26 07:25:08,519][123090] Updated weights for policy 1, policy_version 973379 (0.0010) [2023-12-26 07:25:08,583][123090] Updated weights for policy 1, policy_version 973389 (0.0009) [2023-12-26 07:25:08,648][123090] Updated weights for policy 1, policy_version 973399 (0.0009) [2023-12-26 07:25:08,658][123091] Updated weights for policy 0, policy_version 980310 (0.0007) [2023-12-26 07:25:08,723][123091] Updated weights for policy 0, policy_version 980320 (0.0010) [2023-12-26 07:25:08,784][121949] Fps is (10 sec: 17204.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 500154368. Throughput: 0: 8878.7, 1: 8840.4. Samples: 500130240. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:08,785][121949] Avg episode reward: [(0, '6215.527'), (1, '5946.850')] [2023-12-26 07:25:08,787][123091] Updated weights for policy 0, policy_version 980330 (0.0009) [2023-12-26 07:25:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000973408_249192448.pth... [2023-12-26 07:25:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000972352_248922112.pth [2023-12-26 07:25:08,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000980336_250970112.pth... [2023-12-26 07:25:08,832][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000979280_250699776.pth [2023-12-26 07:25:09,502][123090] Updated weights for policy 1, policy_version 973409 (0.0007) [2023-12-26 07:25:09,542][123091] Updated weights for policy 0, policy_version 980340 (0.0006) [2023-12-26 07:25:09,568][123090] Updated weights for policy 1, policy_version 973419 (0.0010) [2023-12-26 07:25:09,608][123091] Updated weights for policy 0, policy_version 980350 (0.0008) [2023-12-26 07:25:09,631][123090] Updated weights for policy 1, policy_version 973429 (0.0010) [2023-12-26 07:25:09,666][123091] Updated weights for policy 0, policy_version 980360 (0.0007) [2023-12-26 07:25:09,686][123090] Updated weights for policy 1, policy_version 973439 (0.0009) [2023-12-26 07:25:10,488][123091] Updated weights for policy 0, policy_version 980370 (0.0008) [2023-12-26 07:25:10,549][123091] Updated weights for policy 0, policy_version 980380 (0.0006) [2023-12-26 07:25:10,573][123090] Updated weights for policy 1, policy_version 973449 (0.0008) [2023-12-26 07:25:10,605][123091] Updated weights for policy 0, policy_version 980390 (0.0008) [2023-12-26 07:25:10,636][123090] Updated weights for policy 1, policy_version 973459 (0.0008) [2023-12-26 07:25:10,658][123091] Updated weights for policy 0, policy_version 980400 (0.0006) [2023-12-26 07:25:10,692][123090] Updated weights for policy 1, policy_version 973469 (0.0009) [2023-12-26 07:25:11,426][123091] Updated weights for policy 0, policy_version 980410 (0.0010) [2023-12-26 07:25:11,481][123091] Updated weights for policy 0, policy_version 980420 (0.0010) [2023-12-26 07:25:11,526][123090] Updated weights for policy 1, policy_version 973479 (0.0008) [2023-12-26 07:25:11,540][123091] Updated weights for policy 0, policy_version 980430 (0.0009) [2023-12-26 07:25:11,596][123090] Updated weights for policy 1, policy_version 973489 (0.0009) [2023-12-26 07:25:11,669][123090] Updated weights for policy 1, policy_version 973499 (0.0010) [2023-12-26 07:25:12,409][123090] Updated weights for policy 1, policy_version 973509 (0.0007) [2023-12-26 07:25:12,455][123091] Updated weights for policy 0, policy_version 980440 (0.0009) [2023-12-26 07:25:12,457][123090] Updated weights for policy 1, policy_version 973519 (0.0009) [2023-12-26 07:25:12,516][123091] Updated weights for policy 0, policy_version 980450 (0.0009) [2023-12-26 07:25:12,519][123090] Updated weights for policy 1, policy_version 973529 (0.0008) [2023-12-26 07:25:12,568][123091] Updated weights for policy 0, policy_version 980460 (0.0009) [2023-12-26 07:25:13,243][123090] Updated weights for policy 1, policy_version 973539 (0.0007) [2023-12-26 07:25:13,303][123090] Updated weights for policy 1, policy_version 973549 (0.0005) [2023-12-26 07:25:13,356][123090] Updated weights for policy 1, policy_version 973559 (0.0005) [2023-12-26 07:25:13,427][123091] Updated weights for policy 0, policy_version 980470 (0.0007) [2023-12-26 07:25:13,483][123091] Updated weights for policy 0, policy_version 980480 (0.0008) [2023-12-26 07:25:13,553][123091] Updated weights for policy 0, policy_version 980490 (0.0011) [2023-12-26 07:25:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 500244480. Throughput: 0: 8857.8, 1: 8757.2. Samples: 500235248. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:13,785][121949] Avg episode reward: [(0, '6147.406'), (1, '5769.931')] [2023-12-26 07:25:14,150][123090] Updated weights for policy 1, policy_version 973569 (0.0007) [2023-12-26 07:25:14,205][123090] Updated weights for policy 1, policy_version 973579 (0.0008) [2023-12-26 07:25:14,266][123090] Updated weights for policy 1, policy_version 973589 (0.0007) [2023-12-26 07:25:14,334][123090] Updated weights for policy 1, policy_version 973599 (0.0008) [2023-12-26 07:25:14,360][123091] Updated weights for policy 0, policy_version 980500 (0.0011) [2023-12-26 07:25:14,422][123091] Updated weights for policy 0, policy_version 980510 (0.0011) [2023-12-26 07:25:14,484][123091] Updated weights for policy 0, policy_version 980520 (0.0011) [2023-12-26 07:25:15,105][123090] Updated weights for policy 1, policy_version 973609 (0.0010) [2023-12-26 07:25:15,162][123090] Updated weights for policy 1, policy_version 973619 (0.0010) [2023-12-26 07:25:15,219][123090] Updated weights for policy 1, policy_version 973629 (0.0009) [2023-12-26 07:25:15,229][123091] Updated weights for policy 0, policy_version 980530 (0.0009) [2023-12-26 07:25:15,303][123091] Updated weights for policy 0, policy_version 980540 (0.0010) [2023-12-26 07:25:15,374][123091] Updated weights for policy 0, policy_version 980550 (0.0011) [2023-12-26 07:25:15,444][123091] Updated weights for policy 0, policy_version 980560 (0.0011) [2023-12-26 07:25:16,007][123090] Updated weights for policy 1, policy_version 973639 (0.0009) [2023-12-26 07:25:16,070][123090] Updated weights for policy 1, policy_version 973649 (0.0010) [2023-12-26 07:25:16,137][123090] Updated weights for policy 1, policy_version 973659 (0.0011) [2023-12-26 07:25:16,171][123091] Updated weights for policy 0, policy_version 980570 (0.0008) [2023-12-26 07:25:16,221][123091] Updated weights for policy 0, policy_version 980580 (0.0008) [2023-12-26 07:25:16,268][123091] Updated weights for policy 0, policy_version 980590 (0.0008) [2023-12-26 07:25:16,950][123091] Updated weights for policy 0, policy_version 980600 (0.0005) [2023-12-26 07:25:16,961][123090] Updated weights for policy 1, policy_version 973669 (0.0010) [2023-12-26 07:25:17,006][123091] Updated weights for policy 0, policy_version 980610 (0.0005) [2023-12-26 07:25:17,012][123090] Updated weights for policy 1, policy_version 973679 (0.0010) [2023-12-26 07:25:17,065][123091] Updated weights for policy 0, policy_version 980620 (0.0006) [2023-12-26 07:25:17,067][123090] Updated weights for policy 1, policy_version 973689 (0.0010) [2023-12-26 07:25:17,719][123091] Updated weights for policy 0, policy_version 980630 (0.0007) [2023-12-26 07:25:17,764][123091] Updated weights for policy 0, policy_version 980640 (0.0005) [2023-12-26 07:25:17,812][123091] Updated weights for policy 0, policy_version 980650 (0.0005) [2023-12-26 07:25:17,899][123090] Updated weights for policy 1, policy_version 973699 (0.0010) [2023-12-26 07:25:17,953][123090] Updated weights for policy 1, policy_version 973709 (0.0010) [2023-12-26 07:25:18,001][123090] Updated weights for policy 1, policy_version 973719 (0.0010) [2023-12-26 07:25:18,532][123091] Updated weights for policy 0, policy_version 980660 (0.0007) [2023-12-26 07:25:18,603][123091] Updated weights for policy 0, policy_version 980670 (0.0011) [2023-12-26 07:25:18,667][123091] Updated weights for policy 0, policy_version 980680 (0.0009) [2023-12-26 07:25:18,732][123090] Updated weights for policy 1, policy_version 973729 (0.0010) [2023-12-26 07:25:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 500334592. Throughput: 0: 8996.7, 1: 8807.6. Samples: 500346740. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:18,785][121949] Avg episode reward: [(0, '5979.840'), (1, '5568.651')] [2023-12-26 07:25:18,806][123090] Updated weights for policy 1, policy_version 973739 (0.0006) [2023-12-26 07:25:18,881][123090] Updated weights for policy 1, policy_version 973749 (0.0010) [2023-12-26 07:25:18,934][123090] Updated weights for policy 1, policy_version 973759 (0.0008) [2023-12-26 07:25:19,460][123091] Updated weights for policy 0, policy_version 980690 (0.0007) [2023-12-26 07:25:19,531][123091] Updated weights for policy 0, policy_version 980700 (0.0009) [2023-12-26 07:25:19,590][123091] Updated weights for policy 0, policy_version 980710 (0.0010) [2023-12-26 07:25:19,615][123090] Updated weights for policy 1, policy_version 973769 (0.0008) [2023-12-26 07:25:19,648][123091] Updated weights for policy 0, policy_version 980720 (0.0008) [2023-12-26 07:25:19,680][123090] Updated weights for policy 1, policy_version 973779 (0.0011) [2023-12-26 07:25:19,743][123090] Updated weights for policy 1, policy_version 973789 (0.0011) [2023-12-26 07:25:20,531][123091] Updated weights for policy 0, policy_version 980730 (0.0008) [2023-12-26 07:25:20,582][123090] Updated weights for policy 1, policy_version 973799 (0.0011) [2023-12-26 07:25:20,593][123091] Updated weights for policy 0, policy_version 980740 (0.0009) [2023-12-26 07:25:20,650][123090] Updated weights for policy 1, policy_version 973809 (0.0011) [2023-12-26 07:25:20,661][123091] Updated weights for policy 0, policy_version 980750 (0.0006) [2023-12-26 07:25:20,710][123090] Updated weights for policy 1, policy_version 973819 (0.0011) [2023-12-26 07:25:21,526][123091] Updated weights for policy 0, policy_version 980760 (0.0008) [2023-12-26 07:25:21,540][123090] Updated weights for policy 1, policy_version 973829 (0.0009) [2023-12-26 07:25:21,586][123091] Updated weights for policy 0, policy_version 980770 (0.0008) [2023-12-26 07:25:21,602][123090] Updated weights for policy 1, policy_version 973839 (0.0008) [2023-12-26 07:25:21,671][123091] Updated weights for policy 0, policy_version 980780 (0.0008) [2023-12-26 07:25:21,674][123090] Updated weights for policy 1, policy_version 973849 (0.0009) [2023-12-26 07:25:22,502][123091] Updated weights for policy 0, policy_version 980790 (0.0010) [2023-12-26 07:25:22,547][123090] Updated weights for policy 1, policy_version 973859 (0.0009) [2023-12-26 07:25:22,559][123091] Updated weights for policy 0, policy_version 980800 (0.0008) [2023-12-26 07:25:22,610][123091] Updated weights for policy 0, policy_version 980810 (0.0009) [2023-12-26 07:25:22,611][123090] Updated weights for policy 1, policy_version 973869 (0.0009) [2023-12-26 07:25:22,671][123090] Updated weights for policy 1, policy_version 973879 (0.0009) [2023-12-26 07:25:23,471][123091] Updated weights for policy 0, policy_version 980820 (0.0008) [2023-12-26 07:25:23,519][123090] Updated weights for policy 1, policy_version 973889 (0.0008) [2023-12-26 07:25:23,530][123091] Updated weights for policy 0, policy_version 980830 (0.0010) [2023-12-26 07:25:23,575][123090] Updated weights for policy 1, policy_version 973899 (0.0008) [2023-12-26 07:25:23,581][123091] Updated weights for policy 0, policy_version 980840 (0.0009) [2023-12-26 07:25:23,634][123090] Updated weights for policy 1, policy_version 973909 (0.0008) [2023-12-26 07:25:23,703][123090] Updated weights for policy 1, policy_version 973919 (0.0009) [2023-12-26 07:25:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 500424704. Throughput: 0: 8933.4, 1: 8795.3. Samples: 500397656. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:23,785][121949] Avg episode reward: [(0, '6049.284'), (1, '5589.607')] [2023-12-26 07:25:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000980848_251101184.pth... [2023-12-26 07:25:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000973920_249323520.pth... [2023-12-26 07:25:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000972864_249053184.pth [2023-12-26 07:25:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000979824_250839040.pth [2023-12-26 07:25:24,444][123091] Updated weights for policy 0, policy_version 980850 (0.0009) [2023-12-26 07:25:24,504][123091] Updated weights for policy 0, policy_version 980860 (0.0009) [2023-12-26 07:25:24,504][123090] Updated weights for policy 1, policy_version 973929 (0.0006) [2023-12-26 07:25:24,561][123090] Updated weights for policy 1, policy_version 973939 (0.0006) [2023-12-26 07:25:24,566][123091] Updated weights for policy 0, policy_version 980870 (0.0010) [2023-12-26 07:25:24,612][123091] Updated weights for policy 0, policy_version 980880 (0.0008) [2023-12-26 07:25:24,621][123090] Updated weights for policy 1, policy_version 973949 (0.0007) [2023-12-26 07:25:25,429][123090] Updated weights for policy 1, policy_version 973959 (0.0009) [2023-12-26 07:25:25,465][123091] Updated weights for policy 0, policy_version 980890 (0.0010) [2023-12-26 07:25:25,487][123090] Updated weights for policy 1, policy_version 973969 (0.0007) [2023-12-26 07:25:25,525][123091] Updated weights for policy 0, policy_version 980900 (0.0006) [2023-12-26 07:25:25,550][123090] Updated weights for policy 1, policy_version 973979 (0.0008) [2023-12-26 07:25:25,582][123091] Updated weights for policy 0, policy_version 980910 (0.0007) [2023-12-26 07:25:26,206][123090] Updated weights for policy 1, policy_version 973989 (0.0010) [2023-12-26 07:25:26,253][123090] Updated weights for policy 1, policy_version 973999 (0.0010) [2023-12-26 07:25:26,310][123090] Updated weights for policy 1, policy_version 974009 (0.0010) [2023-12-26 07:25:26,453][123091] Updated weights for policy 0, policy_version 980920 (0.0010) [2023-12-26 07:25:26,508][123091] Updated weights for policy 0, policy_version 980930 (0.0010) [2023-12-26 07:25:26,562][123091] Updated weights for policy 0, policy_version 980940 (0.0010) [2023-12-26 07:25:27,020][123090] Updated weights for policy 1, policy_version 974019 (0.0006) [2023-12-26 07:25:27,074][123090] Updated weights for policy 1, policy_version 974029 (0.0008) [2023-12-26 07:25:27,121][123090] Updated weights for policy 1, policy_version 974039 (0.0010) [2023-12-26 07:25:27,494][123091] Updated weights for policy 0, policy_version 980950 (0.0010) [2023-12-26 07:25:27,546][123091] Updated weights for policy 0, policy_version 980960 (0.0009) [2023-12-26 07:25:27,598][123091] Updated weights for policy 0, policy_version 980971 (0.0010) [2023-12-26 07:25:27,813][123090] Updated weights for policy 1, policy_version 974049 (0.0010) [2023-12-26 07:25:27,874][123090] Updated weights for policy 1, policy_version 974059 (0.0005) [2023-12-26 07:25:27,941][123090] Updated weights for policy 1, policy_version 974069 (0.0005) [2023-12-26 07:25:28,001][123090] Updated weights for policy 1, policy_version 974079 (0.0005) [2023-12-26 07:25:28,555][123091] Updated weights for policy 0, policy_version 980982 (0.0010) [2023-12-26 07:25:28,612][123091] Updated weights for policy 0, policy_version 980992 (0.0009) [2023-12-26 07:25:28,661][123090] Updated weights for policy 1, policy_version 974089 (0.0005) [2023-12-26 07:25:28,672][123091] Updated weights for policy 0, policy_version 981002 (0.0009) [2023-12-26 07:25:28,735][123090] Updated weights for policy 1, policy_version 974099 (0.0006) [2023-12-26 07:25:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 500506624. Throughput: 0: 8845.7, 1: 8883.0. Samples: 500501328. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:28,784][121949] Avg episode reward: [(0, '6055.017'), (1, '5702.535')] [2023-12-26 07:25:28,786][123090] Updated weights for policy 1, policy_version 974109 (0.0010) [2023-12-26 07:25:29,557][123090] Updated weights for policy 1, policy_version 974119 (0.0006) [2023-12-26 07:25:29,559][123091] Updated weights for policy 0, policy_version 981012 (0.0009) [2023-12-26 07:25:29,612][123091] Updated weights for policy 0, policy_version 981022 (0.0008) [2023-12-26 07:25:29,615][123090] Updated weights for policy 1, policy_version 974129 (0.0005) [2023-12-26 07:25:29,677][123090] Updated weights for policy 1, policy_version 974139 (0.0005) [2023-12-26 07:25:29,678][123091] Updated weights for policy 0, policy_version 981032 (0.0008) [2023-12-26 07:25:30,441][123090] Updated weights for policy 1, policy_version 974149 (0.0008) [2023-12-26 07:25:30,508][123090] Updated weights for policy 1, policy_version 974159 (0.0010) [2023-12-26 07:25:30,575][123091] Updated weights for policy 0, policy_version 981042 (0.0009) [2023-12-26 07:25:30,575][123090] Updated weights for policy 1, policy_version 974169 (0.0011) [2023-12-26 07:25:30,642][123091] Updated weights for policy 0, policy_version 981052 (0.0008) [2023-12-26 07:25:30,708][123091] Updated weights for policy 0, policy_version 981062 (0.0009) [2023-12-26 07:25:30,771][123091] Updated weights for policy 0, policy_version 981072 (0.0008) [2023-12-26 07:25:31,248][123090] Updated weights for policy 1, policy_version 974179 (0.0011) [2023-12-26 07:25:31,315][123090] Updated weights for policy 1, policy_version 974189 (0.0011) [2023-12-26 07:25:31,391][123090] Updated weights for policy 1, policy_version 974199 (0.0011) [2023-12-26 07:25:31,511][123091] Updated weights for policy 0, policy_version 981082 (0.0009) [2023-12-26 07:25:31,563][123091] Updated weights for policy 0, policy_version 981092 (0.0009) [2023-12-26 07:25:31,620][123091] Updated weights for policy 0, policy_version 981102 (0.0009) [2023-12-26 07:25:32,248][123090] Updated weights for policy 1, policy_version 974209 (0.0011) [2023-12-26 07:25:32,301][123090] Updated weights for policy 1, policy_version 974219 (0.0010) [2023-12-26 07:25:32,368][123090] Updated weights for policy 1, policy_version 974229 (0.0011) [2023-12-26 07:25:32,369][123091] Updated weights for policy 0, policy_version 981112 (0.0009) [2023-12-26 07:25:32,432][123090] Updated weights for policy 1, policy_version 974239 (0.0007) [2023-12-26 07:25:32,435][123091] Updated weights for policy 0, policy_version 981122 (0.0009) [2023-12-26 07:25:32,499][123091] Updated weights for policy 0, policy_version 981132 (0.0010) [2023-12-26 07:25:33,067][123090] Updated weights for policy 1, policy_version 974249 (0.0005) [2023-12-26 07:25:33,123][123090] Updated weights for policy 1, policy_version 974259 (0.0006) [2023-12-26 07:25:33,178][123090] Updated weights for policy 1, policy_version 974269 (0.0010) [2023-12-26 07:25:33,361][123091] Updated weights for policy 0, policy_version 981142 (0.0009) [2023-12-26 07:25:33,421][123091] Updated weights for policy 0, policy_version 981152 (0.0009) [2023-12-26 07:25:33,469][123091] Updated weights for policy 0, policy_version 981162 (0.0009) [2023-12-26 07:25:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 500596736. Throughput: 0: 8704.4, 1: 8958.7. Samples: 500608788. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:33,785][121949] Avg episode reward: [(0, '6141.286'), (1, '5596.369')] [2023-12-26 07:25:33,943][123090] Updated weights for policy 1, policy_version 974279 (0.0009) [2023-12-26 07:25:33,998][123090] Updated weights for policy 1, policy_version 974289 (0.0005) [2023-12-26 07:25:34,052][123090] Updated weights for policy 1, policy_version 974299 (0.0005) [2023-12-26 07:25:34,334][123091] Updated weights for policy 0, policy_version 981172 (0.0009) [2023-12-26 07:25:34,406][123091] Updated weights for policy 0, policy_version 981182 (0.0009) [2023-12-26 07:25:34,474][123091] Updated weights for policy 0, policy_version 981192 (0.0009) [2023-12-26 07:25:34,794][123090] Updated weights for policy 1, policy_version 974309 (0.0007) [2023-12-26 07:25:34,859][123090] Updated weights for policy 1, policy_version 974319 (0.0009) [2023-12-26 07:25:34,926][123090] Updated weights for policy 1, policy_version 974329 (0.0009) [2023-12-26 07:25:35,238][123091] Updated weights for policy 0, policy_version 981202 (0.0008) [2023-12-26 07:25:35,308][123091] Updated weights for policy 0, policy_version 981212 (0.0010) [2023-12-26 07:25:35,376][123091] Updated weights for policy 0, policy_version 981222 (0.0010) [2023-12-26 07:25:35,431][123091] Updated weights for policy 0, policy_version 981232 (0.0010) [2023-12-26 07:25:35,702][123090] Updated weights for policy 1, policy_version 974339 (0.0009) [2023-12-26 07:25:35,754][123090] Updated weights for policy 1, policy_version 974349 (0.0009) [2023-12-26 07:25:35,820][123090] Updated weights for policy 1, policy_version 974359 (0.0008) [2023-12-26 07:25:36,266][123091] Updated weights for policy 0, policy_version 981242 (0.0010) [2023-12-26 07:25:36,332][123091] Updated weights for policy 0, policy_version 981252 (0.0007) [2023-12-26 07:25:36,398][123091] Updated weights for policy 0, policy_version 981262 (0.0009) [2023-12-26 07:25:36,703][123090] Updated weights for policy 1, policy_version 974369 (0.0009) [2023-12-26 07:25:36,782][123090] Updated weights for policy 1, policy_version 974379 (0.0006) [2023-12-26 07:25:36,853][123090] Updated weights for policy 1, policy_version 974389 (0.0007) [2023-12-26 07:25:36,922][123090] Updated weights for policy 1, policy_version 974399 (0.0006) [2023-12-26 07:25:37,100][123091] Updated weights for policy 0, policy_version 981272 (0.0006) [2023-12-26 07:25:37,151][123091] Updated weights for policy 0, policy_version 981282 (0.0005) [2023-12-26 07:25:37,219][123091] Updated weights for policy 0, policy_version 981292 (0.0005) [2023-12-26 07:25:37,646][123090] Updated weights for policy 1, policy_version 974409 (0.0005) [2023-12-26 07:25:37,724][123090] Updated weights for policy 1, policy_version 974419 (0.0006) [2023-12-26 07:25:37,782][123090] Updated weights for policy 1, policy_version 974429 (0.0005) [2023-12-26 07:25:37,915][123091] Updated weights for policy 0, policy_version 981302 (0.0007) [2023-12-26 07:25:37,983][123091] Updated weights for policy 0, policy_version 981312 (0.0010) [2023-12-26 07:25:38,038][123091] Updated weights for policy 0, policy_version 981322 (0.0009) [2023-12-26 07:25:38,425][123090] Updated weights for policy 1, policy_version 974439 (0.0007) [2023-12-26 07:25:38,494][123090] Updated weights for policy 1, policy_version 974449 (0.0006) [2023-12-26 07:25:38,557][123090] Updated weights for policy 1, policy_version 974459 (0.0007) [2023-12-26 07:25:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 500686848. Throughput: 0: 8678.7, 1: 8979.3. Samples: 500660696. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:38,785][121949] Avg episode reward: [(0, '6116.183'), (1, '5583.491')] [2023-12-26 07:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000981328_251224064.pth... [2023-12-26 07:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000974464_249462784.pth... [2023-12-26 07:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000980336_250970112.pth [2023-12-26 07:25:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000973408_249192448.pth [2023-12-26 07:25:38,949][123091] Updated weights for policy 0, policy_version 981333 (0.0010) [2023-12-26 07:25:39,013][123091] Updated weights for policy 0, policy_version 981343 (0.0009) [2023-12-26 07:25:39,079][123091] Updated weights for policy 0, policy_version 981353 (0.0010) [2023-12-26 07:25:39,224][123090] Updated weights for policy 1, policy_version 974469 (0.0007) [2023-12-26 07:25:39,290][123090] Updated weights for policy 1, policy_version 974479 (0.0007) [2023-12-26 07:25:39,367][123090] Updated weights for policy 1, policy_version 974489 (0.0007) [2023-12-26 07:25:39,872][123091] Updated weights for policy 0, policy_version 981363 (0.0009) [2023-12-26 07:25:39,944][123091] Updated weights for policy 0, policy_version 981373 (0.0007) [2023-12-26 07:25:40,009][123091] Updated weights for policy 0, policy_version 981383 (0.0009) [2023-12-26 07:25:40,082][123090] Updated weights for policy 1, policy_version 974499 (0.0009) [2023-12-26 07:25:40,153][123090] Updated weights for policy 1, policy_version 974509 (0.0009) [2023-12-26 07:25:40,221][123090] Updated weights for policy 1, policy_version 974519 (0.0010) [2023-12-26 07:25:40,717][123091] Updated weights for policy 0, policy_version 981393 (0.0009) [2023-12-26 07:25:40,771][123091] Updated weights for policy 0, policy_version 981403 (0.0009) [2023-12-26 07:25:40,819][123091] Updated weights for policy 0, policy_version 981413 (0.0009) [2023-12-26 07:25:40,872][123091] Updated weights for policy 0, policy_version 981423 (0.0010) [2023-12-26 07:25:41,059][123090] Updated weights for policy 1, policy_version 974529 (0.0010) [2023-12-26 07:25:41,126][123090] Updated weights for policy 1, policy_version 974539 (0.0009) [2023-12-26 07:25:41,203][123090] Updated weights for policy 1, policy_version 974549 (0.0010) [2023-12-26 07:25:41,267][123090] Updated weights for policy 1, policy_version 974559 (0.0010) [2023-12-26 07:25:41,707][123091] Updated weights for policy 0, policy_version 981433 (0.0009) [2023-12-26 07:25:41,776][123091] Updated weights for policy 0, policy_version 981443 (0.0009) [2023-12-26 07:25:41,827][123091] Updated weights for policy 0, policy_version 981453 (0.0009) [2023-12-26 07:25:42,138][123090] Updated weights for policy 1, policy_version 974569 (0.0006) [2023-12-26 07:25:42,200][123090] Updated weights for policy 1, policy_version 974579 (0.0008) [2023-12-26 07:25:42,263][123090] Updated weights for policy 1, policy_version 974589 (0.0010) [2023-12-26 07:25:42,661][123091] Updated weights for policy 0, policy_version 981463 (0.0009) [2023-12-26 07:25:42,726][123091] Updated weights for policy 0, policy_version 981473 (0.0009) [2023-12-26 07:25:42,780][123091] Updated weights for policy 0, policy_version 981483 (0.0009) [2023-12-26 07:25:43,059][123090] Updated weights for policy 1, policy_version 974599 (0.0005) [2023-12-26 07:25:43,124][123090] Updated weights for policy 1, policy_version 974609 (0.0008) [2023-12-26 07:25:43,184][123090] Updated weights for policy 1, policy_version 974619 (0.0009) [2023-12-26 07:25:43,603][123091] Updated weights for policy 0, policy_version 981493 (0.0009) [2023-12-26 07:25:43,659][123091] Updated weights for policy 0, policy_version 981503 (0.0008) [2023-12-26 07:25:43,713][123091] Updated weights for policy 0, policy_version 981513 (0.0010) [2023-12-26 07:25:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 500776960. Throughput: 0: 8688.0, 1: 9015.4. Samples: 500768980. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:43,785][121949] Avg episode reward: [(0, '6035.400'), (1, '5684.775')] [2023-12-26 07:25:44,021][123090] Updated weights for policy 1, policy_version 974629 (0.0009) [2023-12-26 07:25:44,078][123090] Updated weights for policy 1, policy_version 974639 (0.0009) [2023-12-26 07:25:44,132][123090] Updated weights for policy 1, policy_version 974649 (0.0008) [2023-12-26 07:25:44,589][123091] Updated weights for policy 0, policy_version 981523 (0.0010) [2023-12-26 07:25:44,647][123091] Updated weights for policy 0, policy_version 981534 (0.0011) [2023-12-26 07:25:44,704][123091] Updated weights for policy 0, policy_version 981544 (0.0010) [2023-12-26 07:25:44,762][123090] Updated weights for policy 1, policy_version 974659 (0.0008) [2023-12-26 07:25:44,837][123090] Updated weights for policy 1, policy_version 974669 (0.0008) [2023-12-26 07:25:44,904][123090] Updated weights for policy 1, policy_version 974679 (0.0008) [2023-12-26 07:25:45,507][123091] Updated weights for policy 0, policy_version 981555 (0.0008) [2023-12-26 07:25:45,568][123091] Updated weights for policy 0, policy_version 981565 (0.0006) [2023-12-26 07:25:45,621][123091] Updated weights for policy 0, policy_version 981575 (0.0006) [2023-12-26 07:25:45,746][123090] Updated weights for policy 1, policy_version 974689 (0.0009) [2023-12-26 07:25:45,821][123090] Updated weights for policy 1, policy_version 974699 (0.0009) [2023-12-26 07:25:45,890][123090] Updated weights for policy 1, policy_version 974709 (0.0009) [2023-12-26 07:25:45,957][123090] Updated weights for policy 1, policy_version 974719 (0.0010) [2023-12-26 07:25:46,403][123091] Updated weights for policy 0, policy_version 981585 (0.0007) [2023-12-26 07:25:46,466][123091] Updated weights for policy 0, policy_version 981595 (0.0009) [2023-12-26 07:25:46,526][123091] Updated weights for policy 0, policy_version 981605 (0.0010) [2023-12-26 07:25:46,581][123091] Updated weights for policy 0, policy_version 981615 (0.0010) [2023-12-26 07:25:46,758][123090] Updated weights for policy 1, policy_version 974729 (0.0009) [2023-12-26 07:25:46,806][123090] Updated weights for policy 1, policy_version 974739 (0.0009) [2023-12-26 07:25:46,859][123090] Updated weights for policy 1, policy_version 974750 (0.0010) [2023-12-26 07:25:47,314][123091] Updated weights for policy 0, policy_version 981625 (0.0007) [2023-12-26 07:25:47,379][123091] Updated weights for policy 0, policy_version 981635 (0.0006) [2023-12-26 07:25:47,449][123091] Updated weights for policy 0, policy_version 981645 (0.0005) [2023-12-26 07:25:47,732][123090] Updated weights for policy 1, policy_version 974760 (0.0009) [2023-12-26 07:25:47,780][123090] Updated weights for policy 1, policy_version 974770 (0.0008) [2023-12-26 07:25:47,827][123090] Updated weights for policy 1, policy_version 974780 (0.0008) [2023-12-26 07:25:48,106][123091] Updated weights for policy 0, policy_version 981655 (0.0009) [2023-12-26 07:25:48,161][123091] Updated weights for policy 0, policy_version 981665 (0.0010) [2023-12-26 07:25:48,208][123091] Updated weights for policy 0, policy_version 981675 (0.0010) [2023-12-26 07:25:48,667][123090] Updated weights for policy 1, policy_version 974790 (0.0009) [2023-12-26 07:25:48,731][123090] Updated weights for policy 1, policy_version 974800 (0.0010) [2023-12-26 07:25:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 500858880. Throughput: 0: 8773.4, 1: 8970.3. Samples: 500874828. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:48,785][121949] Avg episode reward: [(0, '6168.563'), (1, '5574.327')] [2023-12-26 07:25:48,797][123090] Updated weights for policy 1, policy_version 974810 (0.0009) [2023-12-26 07:25:49,045][123091] Updated weights for policy 0, policy_version 981685 (0.0010) [2023-12-26 07:25:49,097][123091] Updated weights for policy 0, policy_version 981695 (0.0009) [2023-12-26 07:25:49,144][123091] Updated weights for policy 0, policy_version 981705 (0.0008) [2023-12-26 07:25:49,642][123090] Updated weights for policy 1, policy_version 974820 (0.0009) [2023-12-26 07:25:49,705][123090] Updated weights for policy 1, policy_version 974830 (0.0009) [2023-12-26 07:25:49,766][123090] Updated weights for policy 1, policy_version 974840 (0.0008) [2023-12-26 07:25:50,056][123091] Updated weights for policy 0, policy_version 981715 (0.0010) [2023-12-26 07:25:50,119][123091] Updated weights for policy 0, policy_version 981725 (0.0008) [2023-12-26 07:25:50,184][123091] Updated weights for policy 0, policy_version 981735 (0.0008) [2023-12-26 07:25:50,525][123090] Updated weights for policy 1, policy_version 974850 (0.0009) [2023-12-26 07:25:50,593][123090] Updated weights for policy 1, policy_version 974860 (0.0010) [2023-12-26 07:25:50,650][123090] Updated weights for policy 1, policy_version 974870 (0.0010) [2023-12-26 07:25:50,715][123090] Updated weights for policy 1, policy_version 974880 (0.0011) [2023-12-26 07:25:50,967][123091] Updated weights for policy 0, policy_version 981745 (0.0009) [2023-12-26 07:25:51,021][123091] Updated weights for policy 0, policy_version 981755 (0.0008) [2023-12-26 07:25:51,086][123091] Updated weights for policy 0, policy_version 981765 (0.0008) [2023-12-26 07:25:51,157][123091] Updated weights for policy 0, policy_version 981775 (0.0009) [2023-12-26 07:25:51,581][123090] Updated weights for policy 1, policy_version 974890 (0.0009) [2023-12-26 07:25:51,646][123090] Updated weights for policy 1, policy_version 974900 (0.0008) [2023-12-26 07:25:51,728][123090] Updated weights for policy 1, policy_version 974910 (0.0008) [2023-12-26 07:25:52,032][123091] Updated weights for policy 0, policy_version 981785 (0.0010) [2023-12-26 07:25:52,086][123091] Updated weights for policy 0, policy_version 981795 (0.0010) [2023-12-26 07:25:52,153][123091] Updated weights for policy 0, policy_version 981805 (0.0008) [2023-12-26 07:25:52,520][123090] Updated weights for policy 1, policy_version 974920 (0.0008) [2023-12-26 07:25:52,572][123090] Updated weights for policy 1, policy_version 974930 (0.0009) [2023-12-26 07:25:52,621][123090] Updated weights for policy 1, policy_version 974940 (0.0009) [2023-12-26 07:25:52,859][123091] Updated weights for policy 0, policy_version 981815 (0.0008) [2023-12-26 07:25:52,916][123091] Updated weights for policy 0, policy_version 981825 (0.0009) [2023-12-26 07:25:52,968][123091] Updated weights for policy 0, policy_version 981835 (0.0009) [2023-12-26 07:25:53,419][123090] Updated weights for policy 1, policy_version 974950 (0.0007) [2023-12-26 07:25:53,487][123090] Updated weights for policy 1, policy_version 974960 (0.0006) [2023-12-26 07:25:53,565][123090] Updated weights for policy 1, policy_version 974970 (0.0005) [2023-12-26 07:25:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 500948992. Throughput: 0: 8744.8, 1: 8929.9. Samples: 500925600. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:53,785][121949] Avg episode reward: [(0, '6128.863'), (1, '5555.666')] [2023-12-26 07:25:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000981840_251355136.pth... [2023-12-26 07:25:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000974976_249593856.pth... [2023-12-26 07:25:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000980848_251101184.pth [2023-12-26 07:25:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000973920_249323520.pth [2023-12-26 07:25:53,854][123091] Updated weights for policy 0, policy_version 981845 (0.0009) [2023-12-26 07:25:53,902][123091] Updated weights for policy 0, policy_version 981855 (0.0009) [2023-12-26 07:25:53,967][123091] Updated weights for policy 0, policy_version 981865 (0.0009) [2023-12-26 07:25:54,318][123090] Updated weights for policy 1, policy_version 974980 (0.0008) [2023-12-26 07:25:54,378][123090] Updated weights for policy 1, policy_version 974990 (0.0010) [2023-12-26 07:25:54,441][123090] Updated weights for policy 1, policy_version 975000 (0.0010) [2023-12-26 07:25:54,790][123091] Updated weights for policy 0, policy_version 981875 (0.0008) [2023-12-26 07:25:54,861][123091] Updated weights for policy 0, policy_version 981885 (0.0005) [2023-12-26 07:25:54,932][123091] Updated weights for policy 0, policy_version 981895 (0.0005) [2023-12-26 07:25:55,276][123090] Updated weights for policy 1, policy_version 975010 (0.0010) [2023-12-26 07:25:55,335][123090] Updated weights for policy 1, policy_version 975020 (0.0010) [2023-12-26 07:25:55,397][123090] Updated weights for policy 1, policy_version 975030 (0.0010) [2023-12-26 07:25:55,460][123090] Updated weights for policy 1, policy_version 975040 (0.0010) [2023-12-26 07:25:55,568][123091] Updated weights for policy 0, policy_version 981905 (0.0006) [2023-12-26 07:25:55,629][123091] Updated weights for policy 0, policy_version 981915 (0.0009) [2023-12-26 07:25:55,685][123091] Updated weights for policy 0, policy_version 981925 (0.0010) [2023-12-26 07:25:55,749][123091] Updated weights for policy 0, policy_version 981935 (0.0010) [2023-12-26 07:25:56,191][123090] Updated weights for policy 1, policy_version 975050 (0.0005) [2023-12-26 07:25:56,244][123090] Updated weights for policy 1, policy_version 975060 (0.0005) [2023-12-26 07:25:56,294][123090] Updated weights for policy 1, policy_version 975070 (0.0006) [2023-12-26 07:25:56,478][123091] Updated weights for policy 0, policy_version 981945 (0.0006) [2023-12-26 07:25:56,525][123091] Updated weights for policy 0, policy_version 981955 (0.0006) [2023-12-26 07:25:56,570][123091] Updated weights for policy 0, policy_version 981965 (0.0007) [2023-12-26 07:25:57,044][123090] Updated weights for policy 1, policy_version 975080 (0.0006) [2023-12-26 07:25:57,093][123090] Updated weights for policy 1, policy_version 975090 (0.0005) [2023-12-26 07:25:57,148][123090] Updated weights for policy 1, policy_version 975100 (0.0005) [2023-12-26 07:25:57,311][123091] Updated weights for policy 0, policy_version 981975 (0.0006) [2023-12-26 07:25:57,371][123091] Updated weights for policy 0, policy_version 981985 (0.0006) [2023-12-26 07:25:57,419][123091] Updated weights for policy 0, policy_version 981995 (0.0006) [2023-12-26 07:25:57,804][123090] Updated weights for policy 1, policy_version 975110 (0.0005) [2023-12-26 07:25:57,857][123090] Updated weights for policy 1, policy_version 975120 (0.0005) [2023-12-26 07:25:57,910][123090] Updated weights for policy 1, policy_version 975130 (0.0005) [2023-12-26 07:25:58,067][123091] Updated weights for policy 0, policy_version 982005 (0.0008) [2023-12-26 07:25:58,130][123091] Updated weights for policy 0, policy_version 982015 (0.0011) [2023-12-26 07:25:58,191][123091] Updated weights for policy 0, policy_version 982025 (0.0011) [2023-12-26 07:25:58,635][123090] Updated weights for policy 1, policy_version 975140 (0.0006) [2023-12-26 07:25:58,705][123090] Updated weights for policy 1, policy_version 975150 (0.0006) [2023-12-26 07:25:58,772][123090] Updated weights for policy 1, policy_version 975160 (0.0009) [2023-12-26 07:25:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17613.1, 300 sec: 17716.9). Total num frames: 501039104. Throughput: 0: 8780.2, 1: 9010.4. Samples: 501035820. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:25:58,784][121949] Avg episode reward: [(0, '6079.831'), (1, '5720.020')] [2023-12-26 07:25:59,052][123091] Updated weights for policy 0, policy_version 982035 (0.0010) [2023-12-26 07:25:59,113][123091] Updated weights for policy 0, policy_version 982045 (0.0010) [2023-12-26 07:25:59,163][123091] Updated weights for policy 0, policy_version 982055 (0.0010) [2023-12-26 07:25:59,587][123090] Updated weights for policy 1, policy_version 975170 (0.0010) [2023-12-26 07:25:59,644][123090] Updated weights for policy 1, policy_version 975180 (0.0009) [2023-12-26 07:25:59,700][123090] Updated weights for policy 1, policy_version 975190 (0.0008) [2023-12-26 07:25:59,757][123090] Updated weights for policy 1, policy_version 975200 (0.0007) [2023-12-26 07:25:59,974][123091] Updated weights for policy 0, policy_version 982065 (0.0010) [2023-12-26 07:26:00,038][123091] Updated weights for policy 0, policy_version 982075 (0.0010) [2023-12-26 07:26:00,103][123091] Updated weights for policy 0, policy_version 982085 (0.0010) [2023-12-26 07:26:00,164][123091] Updated weights for policy 0, policy_version 982095 (0.0009) [2023-12-26 07:26:00,433][123090] Updated weights for policy 1, policy_version 975210 (0.0010) [2023-12-26 07:26:00,487][123090] Updated weights for policy 1, policy_version 975220 (0.0010) [2023-12-26 07:26:00,543][123090] Updated weights for policy 1, policy_version 975230 (0.0009) [2023-12-26 07:26:00,872][123091] Updated weights for policy 0, policy_version 982105 (0.0006) [2023-12-26 07:26:00,938][123091] Updated weights for policy 0, policy_version 982115 (0.0008) [2023-12-26 07:26:01,005][123091] Updated weights for policy 0, policy_version 982125 (0.0009) [2023-12-26 07:26:01,481][123090] Updated weights for policy 1, policy_version 975240 (0.0010) [2023-12-26 07:26:01,542][123090] Updated weights for policy 1, policy_version 975250 (0.0010) [2023-12-26 07:26:01,610][123090] Updated weights for policy 1, policy_version 975260 (0.0009) [2023-12-26 07:26:01,787][123091] Updated weights for policy 0, policy_version 982135 (0.0010) [2023-12-26 07:26:01,850][123091] Updated weights for policy 0, policy_version 982145 (0.0011) [2023-12-26 07:26:01,913][123091] Updated weights for policy 0, policy_version 982155 (0.0010) [2023-12-26 07:26:02,476][123090] Updated weights for policy 1, policy_version 975270 (0.0009) [2023-12-26 07:26:02,545][123090] Updated weights for policy 1, policy_version 975280 (0.0009) [2023-12-26 07:26:02,610][123090] Updated weights for policy 1, policy_version 975290 (0.0009) [2023-12-26 07:26:02,738][123091] Updated weights for policy 0, policy_version 982165 (0.0011) [2023-12-26 07:26:02,840][123091] Updated weights for policy 0, policy_version 982175 (0.0010) [2023-12-26 07:26:02,903][123091] Updated weights for policy 0, policy_version 982185 (0.0006) [2023-12-26 07:26:03,467][123091] Updated weights for policy 0, policy_version 982195 (0.0005) [2023-12-26 07:26:03,488][123090] Updated weights for policy 1, policy_version 975300 (0.0009) [2023-12-26 07:26:03,518][123091] Updated weights for policy 0, policy_version 982205 (0.0005) [2023-12-26 07:26:03,538][123090] Updated weights for policy 1, policy_version 975310 (0.0008) [2023-12-26 07:26:03,564][123091] Updated weights for policy 0, policy_version 982215 (0.0005) [2023-12-26 07:26:03,598][123090] Updated weights for policy 1, policy_version 975320 (0.0008) [2023-12-26 07:26:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 501137408. Throughput: 0: 8736.6, 1: 8946.7. Samples: 501142488. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:03,784][121949] Avg episode reward: [(0, '6187.456'), (1, '5782.545')] [2023-12-26 07:26:04,346][123091] Updated weights for policy 0, policy_version 982225 (0.0006) [2023-12-26 07:26:04,407][123091] Updated weights for policy 0, policy_version 982235 (0.0009) [2023-12-26 07:26:04,469][123091] Updated weights for policy 0, policy_version 982245 (0.0009) [2023-12-26 07:26:04,504][123090] Updated weights for policy 1, policy_version 975330 (0.0010) [2023-12-26 07:26:04,533][123091] Updated weights for policy 0, policy_version 982255 (0.0008) [2023-12-26 07:26:04,571][123090] Updated weights for policy 1, policy_version 975340 (0.0011) [2023-12-26 07:26:04,631][123090] Updated weights for policy 1, policy_version 975350 (0.0010) [2023-12-26 07:26:04,690][123090] Updated weights for policy 1, policy_version 975360 (0.0010) [2023-12-26 07:26:05,332][123091] Updated weights for policy 0, policy_version 982265 (0.0011) [2023-12-26 07:26:05,376][123091] Updated weights for policy 0, policy_version 982275 (0.0010) [2023-12-26 07:26:05,430][123091] Updated weights for policy 0, policy_version 982285 (0.0010) [2023-12-26 07:26:05,487][123090] Updated weights for policy 1, policy_version 975370 (0.0007) [2023-12-26 07:26:05,565][123090] Updated weights for policy 1, policy_version 975380 (0.0010) [2023-12-26 07:26:05,635][123090] Updated weights for policy 1, policy_version 975390 (0.0010) [2023-12-26 07:26:06,113][123091] Updated weights for policy 0, policy_version 982295 (0.0006) [2023-12-26 07:26:06,186][123091] Updated weights for policy 0, policy_version 982305 (0.0008) [2023-12-26 07:26:06,242][123091] Updated weights for policy 0, policy_version 982315 (0.0008) [2023-12-26 07:26:06,415][123090] Updated weights for policy 1, policy_version 975400 (0.0011) [2023-12-26 07:26:06,484][123090] Updated weights for policy 1, policy_version 975410 (0.0011) [2023-12-26 07:26:06,544][123090] Updated weights for policy 1, policy_version 975420 (0.0011) [2023-12-26 07:26:07,018][123091] Updated weights for policy 0, policy_version 982325 (0.0007) [2023-12-26 07:26:07,081][123091] Updated weights for policy 0, policy_version 982335 (0.0005) [2023-12-26 07:26:07,154][123091] Updated weights for policy 0, policy_version 982345 (0.0008) [2023-12-26 07:26:07,392][123090] Updated weights for policy 1, policy_version 975430 (0.0011) [2023-12-26 07:26:07,459][123090] Updated weights for policy 1, policy_version 975440 (0.0010) [2023-12-26 07:26:07,523][123090] Updated weights for policy 1, policy_version 975450 (0.0011) [2023-12-26 07:26:07,935][123091] Updated weights for policy 0, policy_version 982355 (0.0007) [2023-12-26 07:26:07,999][123091] Updated weights for policy 0, policy_version 982365 (0.0009) [2023-12-26 07:26:08,058][123091] Updated weights for policy 0, policy_version 982375 (0.0009) [2023-12-26 07:26:08,373][123090] Updated weights for policy 1, policy_version 975460 (0.0011) [2023-12-26 07:26:08,438][123090] Updated weights for policy 1, policy_version 975470 (0.0011) [2023-12-26 07:26:08,493][123090] Updated weights for policy 1, policy_version 975480 (0.0010) [2023-12-26 07:26:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 501219328. Throughput: 0: 8813.3, 1: 8931.6. Samples: 501196176. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:08,785][121949] Avg episode reward: [(0, '6065.236'), (1, '5832.553')] [2023-12-26 07:26:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000975488_249724928.pth... [2023-12-26 07:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000982384_251494400.pth... [2023-12-26 07:26:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000974464_249462784.pth [2023-12-26 07:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000981328_251224064.pth [2023-12-26 07:26:08,837][123091] Updated weights for policy 0, policy_version 982385 (0.0008) [2023-12-26 07:26:08,905][123091] Updated weights for policy 0, policy_version 982395 (0.0009) [2023-12-26 07:26:08,967][123091] Updated weights for policy 0, policy_version 982405 (0.0010) [2023-12-26 07:26:09,021][123091] Updated weights for policy 0, policy_version 982415 (0.0010) [2023-12-26 07:26:09,228][123090] Updated weights for policy 1, policy_version 975490 (0.0010) [2023-12-26 07:26:09,329][123090] Updated weights for policy 1, policy_version 975500 (0.0011) [2023-12-26 07:26:09,396][123090] Updated weights for policy 1, policy_version 975510 (0.0015) [2023-12-26 07:26:09,462][123090] Updated weights for policy 1, policy_version 975520 (0.0008) [2023-12-26 07:26:09,936][123091] Updated weights for policy 0, policy_version 982425 (0.0010) [2023-12-26 07:26:10,014][123091] Updated weights for policy 0, policy_version 982435 (0.0008) [2023-12-26 07:26:10,070][123091] Updated weights for policy 0, policy_version 982445 (0.0010) [2023-12-26 07:26:10,215][123090] Updated weights for policy 1, policy_version 975530 (0.0010) [2023-12-26 07:26:10,275][123090] Updated weights for policy 1, policy_version 975540 (0.0009) [2023-12-26 07:26:10,340][123090] Updated weights for policy 1, policy_version 975550 (0.0009) [2023-12-26 07:26:10,909][123091] Updated weights for policy 0, policy_version 982455 (0.0009) [2023-12-26 07:26:10,959][123091] Updated weights for policy 0, policy_version 982465 (0.0010) [2023-12-26 07:26:11,014][123091] Updated weights for policy 0, policy_version 982475 (0.0006) [2023-12-26 07:26:11,184][123090] Updated weights for policy 1, policy_version 975560 (0.0009) [2023-12-26 07:26:11,250][123090] Updated weights for policy 1, policy_version 975570 (0.0009) [2023-12-26 07:26:11,311][123090] Updated weights for policy 1, policy_version 975581 (0.0010) [2023-12-26 07:26:11,844][123091] Updated weights for policy 0, policy_version 982485 (0.0006) [2023-12-26 07:26:11,903][123091] Updated weights for policy 0, policy_version 982495 (0.0006) [2023-12-26 07:26:11,961][123091] Updated weights for policy 0, policy_version 982505 (0.0005) [2023-12-26 07:26:12,228][123090] Updated weights for policy 1, policy_version 975591 (0.0010) [2023-12-26 07:26:12,299][123090] Updated weights for policy 1, policy_version 975601 (0.0009) [2023-12-26 07:26:12,373][123090] Updated weights for policy 1, policy_version 975611 (0.0009) [2023-12-26 07:26:12,695][123091] Updated weights for policy 0, policy_version 982515 (0.0007) [2023-12-26 07:26:12,749][123091] Updated weights for policy 0, policy_version 982525 (0.0005) [2023-12-26 07:26:12,807][123091] Updated weights for policy 0, policy_version 982535 (0.0006) [2023-12-26 07:26:13,106][123090] Updated weights for policy 1, policy_version 975621 (0.0007) [2023-12-26 07:26:13,155][123090] Updated weights for policy 1, policy_version 975631 (0.0005) [2023-12-26 07:26:13,202][123090] Updated weights for policy 1, policy_version 975641 (0.0005) [2023-12-26 07:26:13,517][123091] Updated weights for policy 0, policy_version 982545 (0.0006) [2023-12-26 07:26:13,584][123091] Updated weights for policy 0, policy_version 982555 (0.0009) [2023-12-26 07:26:13,653][123091] Updated weights for policy 0, policy_version 982565 (0.0010) [2023-12-26 07:26:13,711][123091] Updated weights for policy 0, policy_version 982575 (0.0010) [2023-12-26 07:26:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 501309440. Throughput: 0: 8886.7, 1: 8858.3. Samples: 501299856. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:13,785][121949] Avg episode reward: [(0, '6038.572'), (1, '5842.532')] [2023-12-26 07:26:13,844][123090] Updated weights for policy 1, policy_version 975651 (0.0006) [2023-12-26 07:26:13,895][123090] Updated weights for policy 1, policy_version 975661 (0.0009) [2023-12-26 07:26:13,943][123090] Updated weights for policy 1, policy_version 975671 (0.0007) [2023-12-26 07:26:14,432][123091] Updated weights for policy 0, policy_version 982585 (0.0010) [2023-12-26 07:26:14,487][123091] Updated weights for policy 0, policy_version 982595 (0.0010) [2023-12-26 07:26:14,561][123091] Updated weights for policy 0, policy_version 982605 (0.0011) [2023-12-26 07:26:14,767][123090] Updated weights for policy 1, policy_version 975681 (0.0006) [2023-12-26 07:26:14,842][123090] Updated weights for policy 1, policy_version 975691 (0.0009) [2023-12-26 07:26:14,911][123090] Updated weights for policy 1, policy_version 975701 (0.0010) [2023-12-26 07:26:14,976][123090] Updated weights for policy 1, policy_version 975711 (0.0010) [2023-12-26 07:26:15,350][123091] Updated weights for policy 0, policy_version 982615 (0.0009) [2023-12-26 07:26:15,403][123091] Updated weights for policy 0, policy_version 982626 (0.0010) [2023-12-26 07:26:15,452][123091] Updated weights for policy 0, policy_version 982636 (0.0009) [2023-12-26 07:26:15,836][123090] Updated weights for policy 1, policy_version 975721 (0.0010) [2023-12-26 07:26:15,887][123090] Updated weights for policy 1, policy_version 975731 (0.0010) [2023-12-26 07:26:15,938][123090] Updated weights for policy 1, policy_version 975741 (0.0008) [2023-12-26 07:26:16,273][123091] Updated weights for policy 0, policy_version 982647 (0.0011) [2023-12-26 07:26:16,338][123091] Updated weights for policy 0, policy_version 982658 (0.0009) [2023-12-26 07:26:16,399][123091] Updated weights for policy 0, policy_version 982668 (0.0009) [2023-12-26 07:26:16,767][123090] Updated weights for policy 1, policy_version 975751 (0.0007) [2023-12-26 07:26:16,829][123090] Updated weights for policy 1, policy_version 975761 (0.0005) [2023-12-26 07:26:16,890][123090] Updated weights for policy 1, policy_version 975771 (0.0005) [2023-12-26 07:26:17,188][123091] Updated weights for policy 0, policy_version 982678 (0.0009) [2023-12-26 07:26:17,245][123091] Updated weights for policy 0, policy_version 982688 (0.0009) [2023-12-26 07:26:17,303][123091] Updated weights for policy 0, policy_version 982698 (0.0010) [2023-12-26 07:26:17,604][123090] Updated weights for policy 1, policy_version 975781 (0.0007) [2023-12-26 07:26:17,668][123090] Updated weights for policy 1, policy_version 975791 (0.0008) [2023-12-26 07:26:17,727][123090] Updated weights for policy 1, policy_version 975801 (0.0008) [2023-12-26 07:26:18,105][123091] Updated weights for policy 0, policy_version 982709 (0.0011) [2023-12-26 07:26:18,165][123091] Updated weights for policy 0, policy_version 982719 (0.0010) [2023-12-26 07:26:18,225][123091] Updated weights for policy 0, policy_version 982729 (0.0010) [2023-12-26 07:26:18,557][123090] Updated weights for policy 1, policy_version 975811 (0.0009) [2023-12-26 07:26:18,625][123090] Updated weights for policy 1, policy_version 975821 (0.0010) [2023-12-26 07:26:18,693][123090] Updated weights for policy 1, policy_version 975831 (0.0009) [2023-12-26 07:26:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 501399552. Throughput: 0: 8965.9, 1: 8802.2. Samples: 501408352. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:18,785][121949] Avg episode reward: [(0, '5832.652'), (1, '5750.220')] [2023-12-26 07:26:19,058][123091] Updated weights for policy 0, policy_version 982739 (0.0010) [2023-12-26 07:26:19,121][123091] Updated weights for policy 0, policy_version 982749 (0.0009) [2023-12-26 07:26:19,188][123091] Updated weights for policy 0, policy_version 982759 (0.0009) [2023-12-26 07:26:19,516][123090] Updated weights for policy 1, policy_version 975841 (0.0009) [2023-12-26 07:26:19,563][123090] Updated weights for policy 1, policy_version 975851 (0.0005) [2023-12-26 07:26:19,621][123090] Updated weights for policy 1, policy_version 975861 (0.0005) [2023-12-26 07:26:19,686][123090] Updated weights for policy 1, policy_version 975871 (0.0007) [2023-12-26 07:26:20,076][123091] Updated weights for policy 0, policy_version 982769 (0.0010) [2023-12-26 07:26:20,141][123091] Updated weights for policy 0, policy_version 982779 (0.0010) [2023-12-26 07:26:20,210][123091] Updated weights for policy 0, policy_version 982789 (0.0010) [2023-12-26 07:26:20,282][123091] Updated weights for policy 0, policy_version 982799 (0.0009) [2023-12-26 07:26:20,424][123090] Updated weights for policy 1, policy_version 975881 (0.0009) [2023-12-26 07:26:20,484][123090] Updated weights for policy 1, policy_version 975891 (0.0009) [2023-12-26 07:26:20,544][123090] Updated weights for policy 1, policy_version 975901 (0.0010) [2023-12-26 07:26:21,164][123091] Updated weights for policy 0, policy_version 982809 (0.0009) [2023-12-26 07:26:21,236][123091] Updated weights for policy 0, policy_version 982819 (0.0009) [2023-12-26 07:26:21,302][123091] Updated weights for policy 0, policy_version 982829 (0.0010) [2023-12-26 07:26:21,377][123090] Updated weights for policy 1, policy_version 975911 (0.0008) [2023-12-26 07:26:21,445][123090] Updated weights for policy 1, policy_version 975921 (0.0008) [2023-12-26 07:26:21,503][123090] Updated weights for policy 1, policy_version 975931 (0.0008) [2023-12-26 07:26:22,179][123091] Updated weights for policy 0, policy_version 982839 (0.0010) [2023-12-26 07:26:22,246][123091] Updated weights for policy 0, policy_version 982849 (0.0009) [2023-12-26 07:26:22,308][123090] Updated weights for policy 1, policy_version 975941 (0.0011) [2023-12-26 07:26:22,313][123091] Updated weights for policy 0, policy_version 982859 (0.0009) [2023-12-26 07:26:22,375][123090] Updated weights for policy 1, policy_version 975951 (0.0010) [2023-12-26 07:26:22,436][123090] Updated weights for policy 1, policy_version 975961 (0.0007) [2023-12-26 07:26:23,110][123091] Updated weights for policy 0, policy_version 982869 (0.0008) [2023-12-26 07:26:23,163][123091] Updated weights for policy 0, policy_version 982879 (0.0009) [2023-12-26 07:26:23,212][123091] Updated weights for policy 0, policy_version 982889 (0.0008) [2023-12-26 07:26:23,213][123090] Updated weights for policy 1, policy_version 975971 (0.0009) [2023-12-26 07:26:23,261][123090] Updated weights for policy 1, policy_version 975981 (0.0010) [2023-12-26 07:26:23,325][123090] Updated weights for policy 1, policy_version 975991 (0.0011) [2023-12-26 07:26:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 501481472. Throughput: 0: 8935.4, 1: 8797.9. Samples: 501458696. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:23,785][121949] Avg episode reward: [(0, '5908.929'), (1, '5708.964')] [2023-12-26 07:26:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000982896_251625472.pth... [2023-12-26 07:26:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000976000_249856000.pth... [2023-12-26 07:26:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000981840_251355136.pth [2023-12-26 07:26:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000974976_249593856.pth [2023-12-26 07:26:24,079][123091] Updated weights for policy 0, policy_version 982899 (0.0007) [2023-12-26 07:26:24,147][123091] Updated weights for policy 0, policy_version 982909 (0.0009) [2023-12-26 07:26:24,165][123090] Updated weights for policy 1, policy_version 976001 (0.0010) [2023-12-26 07:26:24,205][123091] Updated weights for policy 0, policy_version 982919 (0.0008) [2023-12-26 07:26:24,232][123090] Updated weights for policy 1, policy_version 976011 (0.0010) [2023-12-26 07:26:24,286][123090] Updated weights for policy 1, policy_version 976021 (0.0010) [2023-12-26 07:26:24,343][123090] Updated weights for policy 1, policy_version 976031 (0.0010) [2023-12-26 07:26:25,036][123091] Updated weights for policy 0, policy_version 982929 (0.0007) [2023-12-26 07:26:25,102][123091] Updated weights for policy 0, policy_version 982939 (0.0009) [2023-12-26 07:26:25,158][123091] Updated weights for policy 0, policy_version 982949 (0.0007) [2023-12-26 07:26:25,172][123090] Updated weights for policy 1, policy_version 976041 (0.0010) [2023-12-26 07:26:25,215][123091] Updated weights for policy 0, policy_version 982959 (0.0007) [2023-12-26 07:26:25,224][123090] Updated weights for policy 1, policy_version 976051 (0.0010) [2023-12-26 07:26:25,272][123090] Updated weights for policy 1, policy_version 976061 (0.0010) [2023-12-26 07:26:26,054][123091] Updated weights for policy 0, policy_version 982969 (0.0006) [2023-12-26 07:26:26,109][123091] Updated weights for policy 0, policy_version 982979 (0.0008) [2023-12-26 07:26:26,119][123090] Updated weights for policy 1, policy_version 976071 (0.0010) [2023-12-26 07:26:26,160][123091] Updated weights for policy 0, policy_version 982989 (0.0005) [2023-12-26 07:26:26,171][123090] Updated weights for policy 1, policy_version 976081 (0.0010) [2023-12-26 07:26:26,223][123090] Updated weights for policy 1, policy_version 976091 (0.0010) [2023-12-26 07:26:26,770][123091] Updated weights for policy 0, policy_version 982999 (0.0009) [2023-12-26 07:26:26,817][123091] Updated weights for policy 0, policy_version 983009 (0.0010) [2023-12-26 07:26:26,864][123091] Updated weights for policy 0, policy_version 983019 (0.0010) [2023-12-26 07:26:26,919][123090] Updated weights for policy 1, policy_version 976101 (0.0006) [2023-12-26 07:26:26,973][123090] Updated weights for policy 1, policy_version 976111 (0.0005) [2023-12-26 07:26:27,026][123090] Updated weights for policy 1, policy_version 976121 (0.0005) [2023-12-26 07:26:27,616][123091] Updated weights for policy 0, policy_version 983029 (0.0010) [2023-12-26 07:26:27,668][123091] Updated weights for policy 0, policy_version 983039 (0.0007) [2023-12-26 07:26:27,719][123091] Updated weights for policy 0, policy_version 983049 (0.0006) [2023-12-26 07:26:27,769][123090] Updated weights for policy 1, policy_version 976131 (0.0007) [2023-12-26 07:26:27,831][123090] Updated weights for policy 1, policy_version 976141 (0.0010) [2023-12-26 07:26:27,885][123090] Updated weights for policy 1, policy_version 976151 (0.0010) [2023-12-26 07:26:28,468][123091] Updated weights for policy 0, policy_version 983059 (0.0007) [2023-12-26 07:26:28,534][123091] Updated weights for policy 0, policy_version 983069 (0.0011) [2023-12-26 07:26:28,586][123091] Updated weights for policy 0, policy_version 983079 (0.0010) [2023-12-26 07:26:28,681][123090] Updated weights for policy 1, policy_version 976161 (0.0010) [2023-12-26 07:26:28,754][123090] Updated weights for policy 1, policy_version 976171 (0.0006) [2023-12-26 07:26:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 501571584. Throughput: 0: 8924.1, 1: 8776.7. Samples: 501565508. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:28,784][121949] Avg episode reward: [(0, '6050.283'), (1, '5700.246')] [2023-12-26 07:26:28,812][123090] Updated weights for policy 1, policy_version 976181 (0.0005) [2023-12-26 07:26:28,874][123090] Updated weights for policy 1, policy_version 976191 (0.0005) [2023-12-26 07:26:29,369][123091] Updated weights for policy 0, policy_version 983089 (0.0010) [2023-12-26 07:26:29,434][123091] Updated weights for policy 0, policy_version 983099 (0.0009) [2023-12-26 07:26:29,495][123091] Updated weights for policy 0, policy_version 983109 (0.0009) [2023-12-26 07:26:29,548][123091] Updated weights for policy 0, policy_version 983119 (0.0009) [2023-12-26 07:26:29,605][123090] Updated weights for policy 1, policy_version 976201 (0.0009) [2023-12-26 07:26:29,669][123090] Updated weights for policy 1, policy_version 976211 (0.0009) [2023-12-26 07:26:29,733][123090] Updated weights for policy 1, policy_version 976221 (0.0009) [2023-12-26 07:26:30,358][123091] Updated weights for policy 0, policy_version 983129 (0.0010) [2023-12-26 07:26:30,409][123091] Updated weights for policy 0, policy_version 983139 (0.0010) [2023-12-26 07:26:30,463][123091] Updated weights for policy 0, policy_version 983149 (0.0011) [2023-12-26 07:26:30,572][123090] Updated weights for policy 1, policy_version 976231 (0.0009) [2023-12-26 07:26:30,621][123090] Updated weights for policy 1, policy_version 976241 (0.0009) [2023-12-26 07:26:30,668][123090] Updated weights for policy 1, policy_version 976251 (0.0009) [2023-12-26 07:26:31,295][123091] Updated weights for policy 0, policy_version 983159 (0.0008) [2023-12-26 07:26:31,367][123091] Updated weights for policy 0, policy_version 983169 (0.0011) [2023-12-26 07:26:31,427][123091] Updated weights for policy 0, policy_version 983179 (0.0011) [2023-12-26 07:26:31,481][123090] Updated weights for policy 1, policy_version 976261 (0.0008) [2023-12-26 07:26:31,538][123090] Updated weights for policy 1, policy_version 976271 (0.0009) [2023-12-26 07:26:31,592][123090] Updated weights for policy 1, policy_version 976281 (0.0009) [2023-12-26 07:26:32,261][123091] Updated weights for policy 0, policy_version 983189 (0.0010) [2023-12-26 07:26:32,318][123091] Updated weights for policy 0, policy_version 983199 (0.0010) [2023-12-26 07:26:32,378][123091] Updated weights for policy 0, policy_version 983209 (0.0009) [2023-12-26 07:26:32,459][123090] Updated weights for policy 1, policy_version 976291 (0.0009) [2023-12-26 07:26:32,524][123090] Updated weights for policy 1, policy_version 976301 (0.0010) [2023-12-26 07:26:32,579][123090] Updated weights for policy 1, policy_version 976311 (0.0009) [2023-12-26 07:26:33,263][123090] Updated weights for policy 1, policy_version 976321 (0.0009) [2023-12-26 07:26:33,271][123091] Updated weights for policy 0, policy_version 983219 (0.0009) [2023-12-26 07:26:33,321][123090] Updated weights for policy 1, policy_version 976331 (0.0005) [2023-12-26 07:26:33,333][123091] Updated weights for policy 0, policy_version 983229 (0.0008) [2023-12-26 07:26:33,374][123090] Updated weights for policy 1, policy_version 976341 (0.0008) [2023-12-26 07:26:33,386][123091] Updated weights for policy 0, policy_version 983239 (0.0009) [2023-12-26 07:26:33,423][123090] Updated weights for policy 1, policy_version 976351 (0.0009) [2023-12-26 07:26:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 501661696. Throughput: 0: 8891.7, 1: 8806.4. Samples: 501671244. Policy #0 lag: (min: 31.0, avg: 31.1, max: 38.0) [2023-12-26 07:26:33,784][121949] Avg episode reward: [(0, '6016.058'), (1, '5758.433')] [2023-12-26 07:26:34,190][123090] Updated weights for policy 1, policy_version 976361 (0.0008) [2023-12-26 07:26:34,230][123091] Updated weights for policy 0, policy_version 983249 (0.0007) [2023-12-26 07:26:34,252][123090] Updated weights for policy 1, policy_version 976371 (0.0006) [2023-12-26 07:26:34,292][123091] Updated weights for policy 0, policy_version 983259 (0.0007) [2023-12-26 07:26:34,315][123090] Updated weights for policy 1, policy_version 976381 (0.0010) [2023-12-26 07:26:34,355][123091] Updated weights for policy 0, policy_version 983269 (0.0006) [2023-12-26 07:26:34,412][123091] Updated weights for policy 0, policy_version 983279 (0.0010) [2023-12-26 07:26:35,077][123090] Updated weights for policy 1, policy_version 976391 (0.0009) [2023-12-26 07:26:35,128][123090] Updated weights for policy 1, policy_version 976401 (0.0010) [2023-12-26 07:26:35,194][123090] Updated weights for policy 1, policy_version 976411 (0.0010) [2023-12-26 07:26:35,224][123091] Updated weights for policy 0, policy_version 983289 (0.0006) [2023-12-26 07:26:35,273][123091] Updated weights for policy 0, policy_version 983299 (0.0005) [2023-12-26 07:26:35,325][123091] Updated weights for policy 0, policy_version 983309 (0.0005) [2023-12-26 07:26:35,930][123090] Updated weights for policy 1, policy_version 976421 (0.0009) [2023-12-26 07:26:35,988][123090] Updated weights for policy 1, policy_version 976431 (0.0010) [2023-12-26 07:26:36,040][123090] Updated weights for policy 1, policy_version 976441 (0.0010) [2023-12-26 07:26:36,040][123091] Updated weights for policy 0, policy_version 983319 (0.0009) [2023-12-26 07:26:36,084][123091] Updated weights for policy 0, policy_version 983329 (0.0010) [2023-12-26 07:26:36,150][123091] Updated weights for policy 0, policy_version 983339 (0.0009) [2023-12-26 07:26:36,814][123090] Updated weights for policy 1, policy_version 976451 (0.0009) [2023-12-26 07:26:36,874][123090] Updated weights for policy 1, policy_version 976461 (0.0005) [2023-12-26 07:26:36,937][123090] Updated weights for policy 1, policy_version 976471 (0.0005) [2023-12-26 07:26:37,031][123091] Updated weights for policy 0, policy_version 983349 (0.0011) [2023-12-26 07:26:37,098][123091] Updated weights for policy 0, policy_version 983359 (0.0011) [2023-12-26 07:26:37,156][123091] Updated weights for policy 0, policy_version 983369 (0.0010) [2023-12-26 07:26:37,627][123090] Updated weights for policy 1, policy_version 976481 (0.0006) [2023-12-26 07:26:37,690][123090] Updated weights for policy 1, policy_version 976491 (0.0005) [2023-12-26 07:26:37,752][123090] Updated weights for policy 1, policy_version 976501 (0.0005) [2023-12-26 07:26:37,827][123090] Updated weights for policy 1, policy_version 976511 (0.0009) [2023-12-26 07:26:37,971][123091] Updated weights for policy 0, policy_version 983379 (0.0011) [2023-12-26 07:26:38,035][123091] Updated weights for policy 0, policy_version 983389 (0.0011) [2023-12-26 07:26:38,105][123091] Updated weights for policy 0, policy_version 983399 (0.0011) [2023-12-26 07:26:38,607][123090] Updated weights for policy 1, policy_version 976521 (0.0006) [2023-12-26 07:26:38,672][123090] Updated weights for policy 1, policy_version 976531 (0.0005) [2023-12-26 07:26:38,744][123090] Updated weights for policy 1, policy_version 976541 (0.0005) [2023-12-26 07:26:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 501751808. Throughput: 0: 8914.2, 1: 8864.3. Samples: 501725636. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:26:38,785][121949] Avg episode reward: [(0, '6165.351'), (1, '5844.563')] [2023-12-26 07:26:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000983408_251756544.pth... [2023-12-26 07:26:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000976544_249995264.pth... [2023-12-26 07:26:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000982384_251494400.pth [2023-12-26 07:26:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000975488_249724928.pth [2023-12-26 07:26:38,936][123091] Updated weights for policy 0, policy_version 983409 (0.0011) [2023-12-26 07:26:39,007][123091] Updated weights for policy 0, policy_version 983419 (0.0011) [2023-12-26 07:26:39,075][123091] Updated weights for policy 0, policy_version 983429 (0.0011) [2023-12-26 07:26:39,130][123091] Updated weights for policy 0, policy_version 983439 (0.0011) [2023-12-26 07:26:39,458][123090] Updated weights for policy 1, policy_version 976551 (0.0008) [2023-12-26 07:26:39,533][123090] Updated weights for policy 1, policy_version 976561 (0.0009) [2023-12-26 07:26:39,595][123090] Updated weights for policy 1, policy_version 976571 (0.0009) [2023-12-26 07:26:40,001][123091] Updated weights for policy 0, policy_version 983449 (0.0008) [2023-12-26 07:26:40,072][123091] Updated weights for policy 0, policy_version 983459 (0.0008) [2023-12-26 07:26:40,144][123091] Updated weights for policy 0, policy_version 983469 (0.0008) [2023-12-26 07:26:40,408][123090] Updated weights for policy 1, policy_version 976581 (0.0009) [2023-12-26 07:26:40,477][123090] Updated weights for policy 1, policy_version 976591 (0.0009) [2023-12-26 07:26:40,537][123090] Updated weights for policy 1, policy_version 976601 (0.0010) [2023-12-26 07:26:40,810][123091] Updated weights for policy 0, policy_version 983479 (0.0009) [2023-12-26 07:26:40,867][123091] Updated weights for policy 0, policy_version 983489 (0.0009) [2023-12-26 07:26:40,940][123091] Updated weights for policy 0, policy_version 983499 (0.0008) [2023-12-26 07:26:41,370][123090] Updated weights for policy 1, policy_version 976611 (0.0010) [2023-12-26 07:26:41,437][123090] Updated weights for policy 1, policy_version 976621 (0.0009) [2023-12-26 07:26:41,492][123090] Updated weights for policy 1, policy_version 976631 (0.0009) [2023-12-26 07:26:41,764][123091] Updated weights for policy 0, policy_version 983509 (0.0008) [2023-12-26 07:26:41,832][123091] Updated weights for policy 0, policy_version 983519 (0.0009) [2023-12-26 07:26:41,901][123091] Updated weights for policy 0, policy_version 983529 (0.0009) [2023-12-26 07:26:42,316][123090] Updated weights for policy 1, policy_version 976641 (0.0008) [2023-12-26 07:26:42,392][123090] Updated weights for policy 1, policy_version 976651 (0.0006) [2023-12-26 07:26:42,464][123090] Updated weights for policy 1, policy_version 976661 (0.0006) [2023-12-26 07:26:42,535][123090] Updated weights for policy 1, policy_version 976671 (0.0005) [2023-12-26 07:26:42,774][123091] Updated weights for policy 0, policy_version 983539 (0.0010) [2023-12-26 07:26:42,832][123091] Updated weights for policy 0, policy_version 983549 (0.0005) [2023-12-26 07:26:42,889][123091] Updated weights for policy 0, policy_version 983559 (0.0005) [2023-12-26 07:26:43,120][123090] Updated weights for policy 1, policy_version 976681 (0.0005) [2023-12-26 07:26:43,176][123090] Updated weights for policy 1, policy_version 976691 (0.0005) [2023-12-26 07:26:43,230][123090] Updated weights for policy 1, policy_version 976701 (0.0005) [2023-12-26 07:26:43,462][123091] Updated weights for policy 0, policy_version 983569 (0.0005) [2023-12-26 07:26:43,521][123091] Updated weights for policy 0, policy_version 983579 (0.0007) [2023-12-26 07:26:43,571][123091] Updated weights for policy 0, policy_version 983589 (0.0005) [2023-12-26 07:26:43,616][123091] Updated weights for policy 0, policy_version 983599 (0.0005) [2023-12-26 07:26:43,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 501841920. Throughput: 0: 8829.2, 1: 8856.1. Samples: 501831664. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:26:43,786][121949] Avg episode reward: [(0, '6098.513'), (1, '5786.739')] [2023-12-26 07:26:43,913][123090] Updated weights for policy 1, policy_version 976711 (0.0005) [2023-12-26 07:26:43,961][123090] Updated weights for policy 1, policy_version 976721 (0.0005) [2023-12-26 07:26:44,014][123090] Updated weights for policy 1, policy_version 976731 (0.0006) [2023-12-26 07:26:44,283][123091] Updated weights for policy 0, policy_version 983609 (0.0005) [2023-12-26 07:26:44,345][123091] Updated weights for policy 0, policy_version 983619 (0.0006) [2023-12-26 07:26:44,403][123091] Updated weights for policy 0, policy_version 983629 (0.0005) [2023-12-26 07:26:44,750][123090] Updated weights for policy 1, policy_version 976741 (0.0008) [2023-12-26 07:26:44,816][123090] Updated weights for policy 1, policy_version 976751 (0.0010) [2023-12-26 07:26:44,872][123090] Updated weights for policy 1, policy_version 976761 (0.0008) [2023-12-26 07:26:45,114][123091] Updated weights for policy 0, policy_version 983639 (0.0010) [2023-12-26 07:26:45,170][123091] Updated weights for policy 0, policy_version 983649 (0.0008) [2023-12-26 07:26:45,241][123091] Updated weights for policy 0, policy_version 983659 (0.0005) [2023-12-26 07:26:45,612][123090] Updated weights for policy 1, policy_version 976771 (0.0006) [2023-12-26 07:26:45,685][123090] Updated weights for policy 1, policy_version 976781 (0.0006) [2023-12-26 07:26:45,759][123090] Updated weights for policy 1, policy_version 976791 (0.0005) [2023-12-26 07:26:45,956][123091] Updated weights for policy 0, policy_version 983669 (0.0008) [2023-12-26 07:26:46,019][123091] Updated weights for policy 0, policy_version 983679 (0.0009) [2023-12-26 07:26:46,078][123091] Updated weights for policy 0, policy_version 983689 (0.0009) [2023-12-26 07:26:46,497][123090] Updated weights for policy 1, policy_version 976801 (0.0006) [2023-12-26 07:26:46,561][123090] Updated weights for policy 1, policy_version 976811 (0.0010) [2023-12-26 07:26:46,615][123090] Updated weights for policy 1, policy_version 976821 (0.0009) [2023-12-26 07:26:46,679][123090] Updated weights for policy 1, policy_version 976831 (0.0009) [2023-12-26 07:26:46,817][123091] Updated weights for policy 0, policy_version 983699 (0.0008) [2023-12-26 07:26:46,882][123091] Updated weights for policy 0, policy_version 983709 (0.0005) [2023-12-26 07:26:46,944][123091] Updated weights for policy 0, policy_version 983719 (0.0005) [2023-12-26 07:26:47,434][123090] Updated weights for policy 1, policy_version 976841 (0.0005) [2023-12-26 07:26:47,503][123090] Updated weights for policy 1, policy_version 976851 (0.0005) [2023-12-26 07:26:47,568][123090] Updated weights for policy 1, policy_version 976861 (0.0007) [2023-12-26 07:26:47,738][123091] Updated weights for policy 0, policy_version 983729 (0.0008) [2023-12-26 07:26:47,804][123091] Updated weights for policy 0, policy_version 983739 (0.0010) [2023-12-26 07:26:47,854][123091] Updated weights for policy 0, policy_version 983749 (0.0010) [2023-12-26 07:26:47,898][123091] Updated weights for policy 0, policy_version 983759 (0.0010) [2023-12-26 07:26:48,293][123090] Updated weights for policy 1, policy_version 976871 (0.0006) [2023-12-26 07:26:48,363][123090] Updated weights for policy 1, policy_version 976881 (0.0007) [2023-12-26 07:26:48,419][123090] Updated weights for policy 1, policy_version 976891 (0.0009) [2023-12-26 07:26:48,714][123091] Updated weights for policy 0, policy_version 983769 (0.0010) [2023-12-26 07:26:48,769][123091] Updated weights for policy 0, policy_version 983779 (0.0010) [2023-12-26 07:26:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 501932032. Throughput: 0: 8875.6, 1: 8979.9. Samples: 501945984. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:26:48,785][121949] Avg episode reward: [(0, '6174.090'), (1, '5716.063')] [2023-12-26 07:26:48,832][123091] Updated weights for policy 0, policy_version 983789 (0.0011) [2023-12-26 07:26:49,192][123090] Updated weights for policy 1, policy_version 976901 (0.0009) [2023-12-26 07:26:49,260][123090] Updated weights for policy 1, policy_version 976911 (0.0007) [2023-12-26 07:26:49,328][123090] Updated weights for policy 1, policy_version 976921 (0.0006) [2023-12-26 07:26:49,660][123091] Updated weights for policy 0, policy_version 983799 (0.0010) [2023-12-26 07:26:49,725][123091] Updated weights for policy 0, policy_version 983809 (0.0010) [2023-12-26 07:26:49,791][123091] Updated weights for policy 0, policy_version 983819 (0.0011) [2023-12-26 07:26:50,135][123090] Updated weights for policy 1, policy_version 976931 (0.0009) [2023-12-26 07:26:50,204][123090] Updated weights for policy 1, policy_version 976941 (0.0009) [2023-12-26 07:26:50,265][123090] Updated weights for policy 1, policy_version 976951 (0.0009) [2023-12-26 07:26:50,602][123091] Updated weights for policy 0, policy_version 983829 (0.0009) [2023-12-26 07:26:50,666][123091] Updated weights for policy 0, policy_version 983839 (0.0011) [2023-12-26 07:26:50,722][123091] Updated weights for policy 0, policy_version 983849 (0.0011) [2023-12-26 07:26:51,129][123090] Updated weights for policy 1, policy_version 976961 (0.0008) [2023-12-26 07:26:51,197][123090] Updated weights for policy 1, policy_version 976971 (0.0010) [2023-12-26 07:26:51,262][123090] Updated weights for policy 1, policy_version 976981 (0.0009) [2023-12-26 07:26:51,320][123090] Updated weights for policy 1, policy_version 976991 (0.0009) [2023-12-26 07:26:51,514][123091] Updated weights for policy 0, policy_version 983859 (0.0011) [2023-12-26 07:26:51,567][123091] Updated weights for policy 0, policy_version 983869 (0.0010) [2023-12-26 07:26:51,626][123091] Updated weights for policy 0, policy_version 983879 (0.0010) [2023-12-26 07:26:52,131][123090] Updated weights for policy 1, policy_version 977001 (0.0006) [2023-12-26 07:26:52,196][123090] Updated weights for policy 1, policy_version 977011 (0.0005) [2023-12-26 07:26:52,250][123090] Updated weights for policy 1, policy_version 977021 (0.0006) [2023-12-26 07:26:52,464][123091] Updated weights for policy 0, policy_version 983889 (0.0007) [2023-12-26 07:26:52,515][123091] Updated weights for policy 0, policy_version 983899 (0.0010) [2023-12-26 07:26:52,573][123091] Updated weights for policy 0, policy_version 983909 (0.0010) [2023-12-26 07:26:52,626][123091] Updated weights for policy 0, policy_version 983920 (0.0010) [2023-12-26 07:26:52,935][123090] Updated weights for policy 1, policy_version 977031 (0.0009) [2023-12-26 07:26:52,994][123090] Updated weights for policy 1, policy_version 977041 (0.0009) [2023-12-26 07:26:53,048][123090] Updated weights for policy 1, policy_version 977051 (0.0010) [2023-12-26 07:26:53,439][123091] Updated weights for policy 0, policy_version 983930 (0.0008) [2023-12-26 07:26:53,498][123091] Updated weights for policy 0, policy_version 983940 (0.0005) [2023-12-26 07:26:53,555][123091] Updated weights for policy 0, policy_version 983950 (0.0005) [2023-12-26 07:26:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 502022144. Throughput: 0: 8824.6, 1: 8968.7. Samples: 501996880. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:26:53,785][121949] Avg episode reward: [(0, '6267.416'), (1, '5788.712')] [2023-12-26 07:26:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000983952_251895808.pth... [2023-12-26 07:26:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000977056_250126336.pth... [2023-12-26 07:26:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000976000_249856000.pth [2023-12-26 07:26:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000982896_251625472.pth [2023-12-26 07:26:53,931][123090] Updated weights for policy 1, policy_version 977061 (0.0009) [2023-12-26 07:26:53,988][123090] Updated weights for policy 1, policy_version 977071 (0.0009) [2023-12-26 07:26:54,036][123090] Updated weights for policy 1, policy_version 977081 (0.0009) [2023-12-26 07:26:54,310][123091] Updated weights for policy 0, policy_version 983960 (0.0009) [2023-12-26 07:26:54,372][123091] Updated weights for policy 0, policy_version 983970 (0.0010) [2023-12-26 07:26:54,423][123091] Updated weights for policy 0, policy_version 983980 (0.0009) [2023-12-26 07:26:54,877][123090] Updated weights for policy 1, policy_version 977091 (0.0009) [2023-12-26 07:26:54,931][123090] Updated weights for policy 1, policy_version 977101 (0.0006) [2023-12-26 07:26:54,988][123090] Updated weights for policy 1, policy_version 977111 (0.0010) [2023-12-26 07:26:55,295][123091] Updated weights for policy 0, policy_version 983990 (0.0010) [2023-12-26 07:26:55,361][123091] Updated weights for policy 0, policy_version 984000 (0.0010) [2023-12-26 07:26:55,424][123091] Updated weights for policy 0, policy_version 984010 (0.0010) [2023-12-26 07:26:55,657][123090] Updated weights for policy 1, policy_version 977121 (0.0009) [2023-12-26 07:26:55,726][123090] Updated weights for policy 1, policy_version 977131 (0.0009) [2023-12-26 07:26:55,779][123090] Updated weights for policy 1, policy_version 977141 (0.0008) [2023-12-26 07:26:55,835][123090] Updated weights for policy 1, policy_version 977151 (0.0005) [2023-12-26 07:26:56,243][123091] Updated weights for policy 0, policy_version 984020 (0.0009) [2023-12-26 07:26:56,298][123091] Updated weights for policy 0, policy_version 984030 (0.0009) [2023-12-26 07:26:56,354][123091] Updated weights for policy 0, policy_version 984041 (0.0009) [2023-12-26 07:26:56,607][123090] Updated weights for policy 1, policy_version 977161 (0.0010) [2023-12-26 07:26:56,654][123090] Updated weights for policy 1, policy_version 977171 (0.0010) [2023-12-26 07:26:56,705][123090] Updated weights for policy 1, policy_version 977181 (0.0010) [2023-12-26 07:26:57,017][123091] Updated weights for policy 0, policy_version 984051 (0.0007) [2023-12-26 07:26:57,065][123091] Updated weights for policy 0, policy_version 984061 (0.0005) [2023-12-26 07:26:57,116][123091] Updated weights for policy 0, policy_version 984071 (0.0005) [2023-12-26 07:26:57,533][123090] Updated weights for policy 1, policy_version 977191 (0.0007) [2023-12-26 07:26:57,581][123090] Updated weights for policy 1, policy_version 977201 (0.0005) [2023-12-26 07:26:57,636][123090] Updated weights for policy 1, policy_version 977211 (0.0005) [2023-12-26 07:26:57,943][123091] Updated weights for policy 0, policy_version 984081 (0.0006) [2023-12-26 07:26:58,008][123091] Updated weights for policy 0, policy_version 984091 (0.0009) [2023-12-26 07:26:58,075][123091] Updated weights for policy 0, policy_version 984101 (0.0009) [2023-12-26 07:26:58,139][123091] Updated weights for policy 0, policy_version 984111 (0.0009) [2023-12-26 07:26:58,357][123090] Updated weights for policy 1, policy_version 977221 (0.0007) [2023-12-26 07:26:58,433][123090] Updated weights for policy 1, policy_version 977231 (0.0008) [2023-12-26 07:26:58,497][123090] Updated weights for policy 1, policy_version 977241 (0.0006) [2023-12-26 07:26:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 502112256. Throughput: 0: 8862.1, 1: 9032.4. Samples: 502105108. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:26:58,785][121949] Avg episode reward: [(0, '6166.498'), (1, '5836.438')] [2023-12-26 07:26:59,008][123091] Updated weights for policy 0, policy_version 984121 (0.0008) [2023-12-26 07:26:59,063][123091] Updated weights for policy 0, policy_version 984131 (0.0008) [2023-12-26 07:26:59,121][123091] Updated weights for policy 0, policy_version 984141 (0.0008) [2023-12-26 07:26:59,327][123090] Updated weights for policy 1, policy_version 977251 (0.0007) [2023-12-26 07:26:59,394][123090] Updated weights for policy 1, policy_version 977261 (0.0008) [2023-12-26 07:26:59,461][123090] Updated weights for policy 1, policy_version 977271 (0.0009) [2023-12-26 07:26:59,926][123091] Updated weights for policy 0, policy_version 984151 (0.0008) [2023-12-26 07:26:59,988][123091] Updated weights for policy 0, policy_version 984161 (0.0010) [2023-12-26 07:27:00,043][123091] Updated weights for policy 0, policy_version 984171 (0.0009) [2023-12-26 07:27:00,228][123090] Updated weights for policy 1, policy_version 977281 (0.0009) [2023-12-26 07:27:00,299][123090] Updated weights for policy 1, policy_version 977291 (0.0010) [2023-12-26 07:27:00,366][123090] Updated weights for policy 1, policy_version 977301 (0.0009) [2023-12-26 07:27:00,432][123090] Updated weights for policy 1, policy_version 977311 (0.0009) [2023-12-26 07:27:00,890][123091] Updated weights for policy 0, policy_version 984181 (0.0009) [2023-12-26 07:27:00,953][123091] Updated weights for policy 0, policy_version 984191 (0.0009) [2023-12-26 07:27:01,021][123091] Updated weights for policy 0, policy_version 984201 (0.0009) [2023-12-26 07:27:01,187][123090] Updated weights for policy 1, policy_version 977321 (0.0009) [2023-12-26 07:27:01,258][123090] Updated weights for policy 1, policy_version 977331 (0.0010) [2023-12-26 07:27:01,318][123090] Updated weights for policy 1, policy_version 977341 (0.0010) [2023-12-26 07:27:01,836][123091] Updated weights for policy 0, policy_version 984211 (0.0010) [2023-12-26 07:27:01,880][123091] Updated weights for policy 0, policy_version 984221 (0.0008) [2023-12-26 07:27:01,935][123091] Updated weights for policy 0, policy_version 984231 (0.0006) [2023-12-26 07:27:02,195][123090] Updated weights for policy 1, policy_version 977351 (0.0007) [2023-12-26 07:27:02,246][123090] Updated weights for policy 1, policy_version 977361 (0.0008) [2023-12-26 07:27:02,306][123090] Updated weights for policy 1, policy_version 977371 (0.0009) [2023-12-26 07:27:02,770][123091] Updated weights for policy 0, policy_version 984241 (0.0009) [2023-12-26 07:27:02,833][123091] Updated weights for policy 0, policy_version 984251 (0.0010) [2023-12-26 07:27:02,887][123091] Updated weights for policy 0, policy_version 984261 (0.0008) [2023-12-26 07:27:02,938][123091] Updated weights for policy 0, policy_version 984271 (0.0010) [2023-12-26 07:27:03,108][123090] Updated weights for policy 1, policy_version 977381 (0.0010) [2023-12-26 07:27:03,166][123090] Updated weights for policy 1, policy_version 977391 (0.0009) [2023-12-26 07:27:03,222][123090] Updated weights for policy 1, policy_version 977401 (0.0009) [2023-12-26 07:27:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 502194176. Throughput: 0: 8774.1, 1: 9015.0. Samples: 502208860. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:03,785][121949] Avg episode reward: [(0, '6231.216'), (1, '5858.351')] [2023-12-26 07:27:03,829][123091] Updated weights for policy 0, policy_version 984281 (0.0009) [2023-12-26 07:27:03,874][123090] Updated weights for policy 1, policy_version 977411 (0.0009) [2023-12-26 07:27:03,898][123091] Updated weights for policy 0, policy_version 984291 (0.0009) [2023-12-26 07:27:03,932][123090] Updated weights for policy 1, policy_version 977421 (0.0007) [2023-12-26 07:27:03,963][123091] Updated weights for policy 0, policy_version 984301 (0.0009) [2023-12-26 07:27:03,997][123090] Updated weights for policy 1, policy_version 977431 (0.0008) [2023-12-26 07:27:04,755][123091] Updated weights for policy 0, policy_version 984311 (0.0006) [2023-12-26 07:27:04,801][123091] Updated weights for policy 0, policy_version 984321 (0.0005) [2023-12-26 07:27:04,845][123090] Updated weights for policy 1, policy_version 977441 (0.0009) [2023-12-26 07:27:04,853][123091] Updated weights for policy 0, policy_version 984331 (0.0006) [2023-12-26 07:27:04,900][123090] Updated weights for policy 1, policy_version 977451 (0.0005) [2023-12-26 07:27:04,950][123090] Updated weights for policy 1, policy_version 977461 (0.0005) [2023-12-26 07:27:05,026][123090] Updated weights for policy 1, policy_version 977471 (0.0008) [2023-12-26 07:27:05,511][123091] Updated weights for policy 0, policy_version 984341 (0.0006) [2023-12-26 07:27:05,588][123091] Updated weights for policy 0, policy_version 984351 (0.0006) [2023-12-26 07:27:05,657][123091] Updated weights for policy 0, policy_version 984361 (0.0009) [2023-12-26 07:27:05,802][123090] Updated weights for policy 1, policy_version 977481 (0.0006) [2023-12-26 07:27:05,856][123090] Updated weights for policy 1, policy_version 977491 (0.0008) [2023-12-26 07:27:05,922][123090] Updated weights for policy 1, policy_version 977501 (0.0005) [2023-12-26 07:27:06,462][123091] Updated weights for policy 0, policy_version 984371 (0.0010) [2023-12-26 07:27:06,526][123091] Updated weights for policy 0, policy_version 984381 (0.0010) [2023-12-26 07:27:06,587][123091] Updated weights for policy 0, policy_version 984391 (0.0007) [2023-12-26 07:27:06,658][123090] Updated weights for policy 1, policy_version 977511 (0.0009) [2023-12-26 07:27:06,715][123090] Updated weights for policy 1, policy_version 977521 (0.0009) [2023-12-26 07:27:06,775][123090] Updated weights for policy 1, policy_version 977531 (0.0010) [2023-12-26 07:27:07,397][123091] Updated weights for policy 0, policy_version 984401 (0.0008) [2023-12-26 07:27:07,453][123091] Updated weights for policy 0, policy_version 984411 (0.0005) [2023-12-26 07:27:07,516][123091] Updated weights for policy 0, policy_version 984421 (0.0007) [2023-12-26 07:27:07,577][123091] Updated weights for policy 0, policy_version 984431 (0.0006) [2023-12-26 07:27:07,600][123090] Updated weights for policy 1, policy_version 977541 (0.0008) [2023-12-26 07:27:07,676][123090] Updated weights for policy 1, policy_version 977551 (0.0008) [2023-12-26 07:27:07,753][123090] Updated weights for policy 1, policy_version 977561 (0.0005) [2023-12-26 07:27:08,306][123091] Updated weights for policy 0, policy_version 984441 (0.0010) [2023-12-26 07:27:08,372][123091] Updated weights for policy 0, policy_version 984451 (0.0010) [2023-12-26 07:27:08,430][123090] Updated weights for policy 1, policy_version 977571 (0.0006) [2023-12-26 07:27:08,438][123091] Updated weights for policy 0, policy_version 984461 (0.0008) [2023-12-26 07:27:08,489][123090] Updated weights for policy 1, policy_version 977581 (0.0009) [2023-12-26 07:27:08,541][123090] Updated weights for policy 1, policy_version 977591 (0.0009) [2023-12-26 07:27:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 502292480. Throughput: 0: 8839.2, 1: 9040.3. Samples: 502263272. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:08,785][121949] Avg episode reward: [(0, '6118.576'), (1, '5844.594')] [2023-12-26 07:27:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000984464_252026880.pth... [2023-12-26 07:27:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000977600_250265600.pth... [2023-12-26 07:27:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000983408_251756544.pth [2023-12-26 07:27:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000976544_249995264.pth [2023-12-26 07:27:09,224][123091] Updated weights for policy 0, policy_version 984471 (0.0007) [2023-12-26 07:27:09,287][123091] Updated weights for policy 0, policy_version 984481 (0.0008) [2023-12-26 07:27:09,354][123091] Updated weights for policy 0, policy_version 984491 (0.0008) [2023-12-26 07:27:09,444][123090] Updated weights for policy 1, policy_version 977601 (0.0009) [2023-12-26 07:27:09,518][123090] Updated weights for policy 1, policy_version 977611 (0.0006) [2023-12-26 07:27:09,588][123090] Updated weights for policy 1, policy_version 977621 (0.0007) [2023-12-26 07:27:09,659][123090] Updated weights for policy 1, policy_version 977631 (0.0007) [2023-12-26 07:27:10,181][123091] Updated weights for policy 0, policy_version 984501 (0.0009) [2023-12-26 07:27:10,240][123091] Updated weights for policy 0, policy_version 984511 (0.0011) [2023-12-26 07:27:10,297][123091] Updated weights for policy 0, policy_version 984521 (0.0011) [2023-12-26 07:27:10,357][123090] Updated weights for policy 1, policy_version 977641 (0.0007) [2023-12-26 07:27:10,429][123090] Updated weights for policy 1, policy_version 977651 (0.0009) [2023-12-26 07:27:10,495][123090] Updated weights for policy 1, policy_version 977661 (0.0007) [2023-12-26 07:27:11,139][123091] Updated weights for policy 0, policy_version 984531 (0.0011) [2023-12-26 07:27:11,209][123091] Updated weights for policy 0, policy_version 984541 (0.0010) [2023-12-26 07:27:11,281][123091] Updated weights for policy 0, policy_version 984551 (0.0009) [2023-12-26 07:27:11,304][123090] Updated weights for policy 1, policy_version 977671 (0.0008) [2023-12-26 07:27:11,369][123090] Updated weights for policy 1, policy_version 977681 (0.0009) [2023-12-26 07:27:11,437][123090] Updated weights for policy 1, policy_version 977691 (0.0010) [2023-12-26 07:27:12,177][123090] Updated weights for policy 1, policy_version 977701 (0.0005) [2023-12-26 07:27:12,203][123091] Updated weights for policy 0, policy_version 984561 (0.0006) [2023-12-26 07:27:12,243][123090] Updated weights for policy 1, policy_version 977711 (0.0005) [2023-12-26 07:27:12,261][123091] Updated weights for policy 0, policy_version 984571 (0.0006) [2023-12-26 07:27:12,314][123090] Updated weights for policy 1, policy_version 977721 (0.0009) [2023-12-26 07:27:12,327][123091] Updated weights for policy 0, policy_version 984581 (0.0008) [2023-12-26 07:27:12,398][123091] Updated weights for policy 0, policy_version 984591 (0.0007) [2023-12-26 07:27:13,069][123090] Updated weights for policy 1, policy_version 977731 (0.0010) [2023-12-26 07:27:13,124][123091] Updated weights for policy 0, policy_version 984601 (0.0010) [2023-12-26 07:27:13,128][123090] Updated weights for policy 1, policy_version 977741 (0.0010) [2023-12-26 07:27:13,188][123091] Updated weights for policy 0, policy_version 984611 (0.0006) [2023-12-26 07:27:13,190][123090] Updated weights for policy 1, policy_version 977751 (0.0010) [2023-12-26 07:27:13,244][123091] Updated weights for policy 0, policy_version 984621 (0.0006) [2023-12-26 07:27:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 502374400. Throughput: 0: 8836.4, 1: 9040.3. Samples: 502369956. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:13,785][121949] Avg episode reward: [(0, '6163.168'), (1, '5849.996')] [2023-12-26 07:27:14,020][123090] Updated weights for policy 1, policy_version 977761 (0.0010) [2023-12-26 07:27:14,044][123091] Updated weights for policy 0, policy_version 984631 (0.0008) [2023-12-26 07:27:14,075][123090] Updated weights for policy 1, policy_version 977771 (0.0010) [2023-12-26 07:27:14,096][123091] Updated weights for policy 0, policy_version 984641 (0.0008) [2023-12-26 07:27:14,127][123090] Updated weights for policy 1, policy_version 977781 (0.0010) [2023-12-26 07:27:14,142][123091] Updated weights for policy 0, policy_version 984651 (0.0009) [2023-12-26 07:27:14,184][123090] Updated weights for policy 1, policy_version 977791 (0.0010) [2023-12-26 07:27:14,981][123090] Updated weights for policy 1, policy_version 977801 (0.0008) [2023-12-26 07:27:15,002][123091] Updated weights for policy 0, policy_version 984661 (0.0006) [2023-12-26 07:27:15,041][123090] Updated weights for policy 1, policy_version 977811 (0.0008) [2023-12-26 07:27:15,061][123091] Updated weights for policy 0, policy_version 984671 (0.0007) [2023-12-26 07:27:15,101][123090] Updated weights for policy 1, policy_version 977821 (0.0008) [2023-12-26 07:27:15,122][123091] Updated weights for policy 0, policy_version 984681 (0.0006) [2023-12-26 07:27:15,911][123090] Updated weights for policy 1, policy_version 977831 (0.0007) [2023-12-26 07:27:15,974][123090] Updated weights for policy 1, policy_version 977841 (0.0009) [2023-12-26 07:27:15,992][123091] Updated weights for policy 0, policy_version 984691 (0.0009) [2023-12-26 07:27:16,021][123090] Updated weights for policy 1, policy_version 977851 (0.0008) [2023-12-26 07:27:16,042][123091] Updated weights for policy 0, policy_version 984701 (0.0008) [2023-12-26 07:27:16,093][123091] Updated weights for policy 0, policy_version 984711 (0.0010) [2023-12-26 07:27:16,852][123090] Updated weights for policy 1, policy_version 977861 (0.0007) [2023-12-26 07:27:16,906][123091] Updated weights for policy 0, policy_version 984721 (0.0009) [2023-12-26 07:27:16,907][123090] Updated weights for policy 1, policy_version 977871 (0.0010) [2023-12-26 07:27:16,967][123091] Updated weights for policy 0, policy_version 984731 (0.0010) [2023-12-26 07:27:16,974][123090] Updated weights for policy 1, policy_version 977881 (0.0011) [2023-12-26 07:27:17,016][123091] Updated weights for policy 0, policy_version 984741 (0.0006) [2023-12-26 07:27:17,074][123091] Updated weights for policy 0, policy_version 984751 (0.0009) [2023-12-26 07:27:17,774][123090] Updated weights for policy 1, policy_version 977891 (0.0010) [2023-12-26 07:27:17,841][123090] Updated weights for policy 1, policy_version 977901 (0.0010) [2023-12-26 07:27:17,863][123091] Updated weights for policy 0, policy_version 984761 (0.0008) [2023-12-26 07:27:17,903][123090] Updated weights for policy 1, policy_version 977911 (0.0010) [2023-12-26 07:27:17,915][123091] Updated weights for policy 0, policy_version 984771 (0.0006) [2023-12-26 07:27:17,980][123091] Updated weights for policy 0, policy_version 984781 (0.0005) [2023-12-26 07:27:18,621][123090] Updated weights for policy 1, policy_version 977921 (0.0010) [2023-12-26 07:27:18,683][123090] Updated weights for policy 1, policy_version 977931 (0.0010) [2023-12-26 07:27:18,739][123090] Updated weights for policy 1, policy_version 977941 (0.0010) [2023-12-26 07:27:18,775][123091] Updated weights for policy 0, policy_version 984791 (0.0005) [2023-12-26 07:27:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 502456320. Throughput: 0: 8825.1, 1: 9027.6. Samples: 502474612. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:18,785][121949] Avg episode reward: [(0, '6210.817'), (1, '5882.435')] [2023-12-26 07:27:18,795][123090] Updated weights for policy 1, policy_version 977951 (0.0011) [2023-12-26 07:27:18,841][123091] Updated weights for policy 0, policy_version 984801 (0.0005) [2023-12-26 07:27:18,900][123091] Updated weights for policy 0, policy_version 984811 (0.0005) [2023-12-26 07:27:19,631][123090] Updated weights for policy 1, policy_version 977961 (0.0006) [2023-12-26 07:27:19,687][123091] Updated weights for policy 0, policy_version 984821 (0.0007) [2023-12-26 07:27:19,689][123090] Updated weights for policy 1, policy_version 977971 (0.0011) [2023-12-26 07:27:19,749][123090] Updated weights for policy 1, policy_version 977981 (0.0010) [2023-12-26 07:27:19,751][123091] Updated weights for policy 0, policy_version 984831 (0.0006) [2023-12-26 07:27:19,823][123091] Updated weights for policy 0, policy_version 984841 (0.0008) [2023-12-26 07:27:20,537][123090] Updated weights for policy 1, policy_version 977991 (0.0007) [2023-12-26 07:27:20,608][123090] Updated weights for policy 1, policy_version 978001 (0.0007) [2023-12-26 07:27:20,657][123091] Updated weights for policy 0, policy_version 984851 (0.0008) [2023-12-26 07:27:20,673][123090] Updated weights for policy 1, policy_version 978011 (0.0005) [2023-12-26 07:27:20,730][123091] Updated weights for policy 0, policy_version 984861 (0.0010) [2023-12-26 07:27:20,796][123091] Updated weights for policy 0, policy_version 984871 (0.0009) [2023-12-26 07:27:21,466][123090] Updated weights for policy 1, policy_version 978021 (0.0007) [2023-12-26 07:27:21,524][123090] Updated weights for policy 1, policy_version 978031 (0.0008) [2023-12-26 07:27:21,575][123090] Updated weights for policy 1, policy_version 978041 (0.0008) [2023-12-26 07:27:21,641][123091] Updated weights for policy 0, policy_version 984881 (0.0010) [2023-12-26 07:27:21,702][123091] Updated weights for policy 0, policy_version 984891 (0.0007) [2023-12-26 07:27:21,777][123091] Updated weights for policy 0, policy_version 984901 (0.0010) [2023-12-26 07:27:21,842][123091] Updated weights for policy 0, policy_version 984911 (0.0010) [2023-12-26 07:27:22,479][123090] Updated weights for policy 1, policy_version 978052 (0.0009) [2023-12-26 07:27:22,551][123090] Updated weights for policy 1, policy_version 978062 (0.0007) [2023-12-26 07:27:22,618][123090] Updated weights for policy 1, policy_version 978072 (0.0008) [2023-12-26 07:27:22,664][123091] Updated weights for policy 0, policy_version 984921 (0.0006) [2023-12-26 07:27:22,731][123091] Updated weights for policy 0, policy_version 984931 (0.0007) [2023-12-26 07:27:22,802][123091] Updated weights for policy 0, policy_version 984941 (0.0009) [2023-12-26 07:27:23,383][123090] Updated weights for policy 1, policy_version 978082 (0.0008) [2023-12-26 07:27:23,449][123090] Updated weights for policy 1, policy_version 978092 (0.0009) [2023-12-26 07:27:23,517][123090] Updated weights for policy 1, policy_version 978102 (0.0006) [2023-12-26 07:27:23,582][123090] Updated weights for policy 1, policy_version 978112 (0.0005) [2023-12-26 07:27:23,621][123091] Updated weights for policy 0, policy_version 984951 (0.0010) [2023-12-26 07:27:23,675][123091] Updated weights for policy 0, policy_version 984961 (0.0010) [2023-12-26 07:27:23,733][123091] Updated weights for policy 0, policy_version 984971 (0.0010) [2023-12-26 07:27:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 502554624. Throughput: 0: 8786.7, 1: 8990.0. Samples: 502525584. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:23,785][121949] Avg episode reward: [(0, '6089.662'), (1, '5866.339')] [2023-12-26 07:27:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000984976_252157952.pth... [2023-12-26 07:27:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000978112_250396672.pth... [2023-12-26 07:27:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000977056_250126336.pth [2023-12-26 07:27:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000983952_251895808.pth [2023-12-26 07:27:24,301][123090] Updated weights for policy 1, policy_version 978122 (0.0010) [2023-12-26 07:27:24,364][123090] Updated weights for policy 1, policy_version 978132 (0.0010) [2023-12-26 07:27:24,430][123090] Updated weights for policy 1, policy_version 978142 (0.0010) [2023-12-26 07:27:24,605][123091] Updated weights for policy 0, policy_version 984981 (0.0008) [2023-12-26 07:27:24,673][123091] Updated weights for policy 0, policy_version 984991 (0.0005) [2023-12-26 07:27:24,743][123091] Updated weights for policy 0, policy_version 985001 (0.0006) [2023-12-26 07:27:25,227][123090] Updated weights for policy 1, policy_version 978152 (0.0011) [2023-12-26 07:27:25,274][123090] Updated weights for policy 1, policy_version 978162 (0.0010) [2023-12-26 07:27:25,328][123090] Updated weights for policy 1, policy_version 978172 (0.0010) [2023-12-26 07:27:25,472][123091] Updated weights for policy 0, policy_version 985011 (0.0008) [2023-12-26 07:27:25,532][123091] Updated weights for policy 0, policy_version 985021 (0.0007) [2023-12-26 07:27:25,597][123091] Updated weights for policy 0, policy_version 985031 (0.0005) [2023-12-26 07:27:26,045][123090] Updated weights for policy 1, policy_version 978182 (0.0010) [2023-12-26 07:27:26,105][123090] Updated weights for policy 1, policy_version 978192 (0.0010) [2023-12-26 07:27:26,168][123091] Updated weights for policy 0, policy_version 985041 (0.0005) [2023-12-26 07:27:26,169][123090] Updated weights for policy 1, policy_version 978202 (0.0010) [2023-12-26 07:27:26,234][123091] Updated weights for policy 0, policy_version 985051 (0.0007) [2023-12-26 07:27:26,302][123091] Updated weights for policy 0, policy_version 985061 (0.0009) [2023-12-26 07:27:26,366][123091] Updated weights for policy 0, policy_version 985071 (0.0009) [2023-12-26 07:27:26,950][123090] Updated weights for policy 1, policy_version 978212 (0.0010) [2023-12-26 07:27:26,997][123090] Updated weights for policy 1, policy_version 978222 (0.0010) [2023-12-26 07:27:27,048][123090] Updated weights for policy 1, policy_version 978232 (0.0010) [2023-12-26 07:27:27,196][123091] Updated weights for policy 0, policy_version 985081 (0.0010) [2023-12-26 07:27:27,255][123091] Updated weights for policy 0, policy_version 985091 (0.0011) [2023-12-26 07:27:27,314][123091] Updated weights for policy 0, policy_version 985101 (0.0010) [2023-12-26 07:27:27,852][123090] Updated weights for policy 1, policy_version 978242 (0.0009) [2023-12-26 07:27:27,901][123090] Updated weights for policy 1, policy_version 978252 (0.0005) [2023-12-26 07:27:27,944][123090] Updated weights for policy 1, policy_version 978262 (0.0005) [2023-12-26 07:27:27,990][123090] Updated weights for policy 1, policy_version 978272 (0.0005) [2023-12-26 07:27:28,108][123091] Updated weights for policy 0, policy_version 985111 (0.0007) [2023-12-26 07:27:28,175][123091] Updated weights for policy 0, policy_version 985121 (0.0006) [2023-12-26 07:27:28,238][123091] Updated weights for policy 0, policy_version 985131 (0.0005) [2023-12-26 07:27:28,776][123090] Updated weights for policy 1, policy_version 978282 (0.0006) [2023-12-26 07:27:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 502636544. Throughput: 0: 8831.7, 1: 8980.5. Samples: 502633208. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:28,785][121949] Avg episode reward: [(0, '5984.208'), (1, '5795.377')] [2023-12-26 07:27:28,847][123090] Updated weights for policy 1, policy_version 978292 (0.0007) [2023-12-26 07:27:28,916][123090] Updated weights for policy 1, policy_version 978302 (0.0008) [2023-12-26 07:27:28,941][123091] Updated weights for policy 0, policy_version 985141 (0.0006) [2023-12-26 07:27:29,011][123091] Updated weights for policy 0, policy_version 985151 (0.0005) [2023-12-26 07:27:29,068][123091] Updated weights for policy 0, policy_version 985161 (0.0005) [2023-12-26 07:27:29,667][123090] Updated weights for policy 1, policy_version 978312 (0.0006) [2023-12-26 07:27:29,692][123091] Updated weights for policy 0, policy_version 985171 (0.0006) [2023-12-26 07:27:29,721][123090] Updated weights for policy 1, policy_version 978322 (0.0005) [2023-12-26 07:27:29,753][123091] Updated weights for policy 0, policy_version 985181 (0.0005) [2023-12-26 07:27:29,781][123090] Updated weights for policy 1, policy_version 978332 (0.0005) [2023-12-26 07:27:29,818][123091] Updated weights for policy 0, policy_version 985191 (0.0010) [2023-12-26 07:27:30,482][123090] Updated weights for policy 1, policy_version 978342 (0.0006) [2023-12-26 07:27:30,538][123090] Updated weights for policy 1, policy_version 978352 (0.0005) [2023-12-26 07:27:30,586][123090] Updated weights for policy 1, policy_version 978362 (0.0005) [2023-12-26 07:27:30,642][123091] Updated weights for policy 0, policy_version 985201 (0.0010) [2023-12-26 07:27:30,696][123091] Updated weights for policy 0, policy_version 985211 (0.0010) [2023-12-26 07:27:30,750][123091] Updated weights for policy 0, policy_version 985221 (0.0006) [2023-12-26 07:27:30,808][123091] Updated weights for policy 0, policy_version 985231 (0.0009) [2023-12-26 07:27:31,305][123090] Updated weights for policy 1, policy_version 978372 (0.0006) [2023-12-26 07:27:31,380][123090] Updated weights for policy 1, policy_version 978382 (0.0008) [2023-12-26 07:27:31,443][123090] Updated weights for policy 1, policy_version 978392 (0.0008) [2023-12-26 07:27:31,610][123091] Updated weights for policy 0, policy_version 985241 (0.0007) [2023-12-26 07:27:31,679][123091] Updated weights for policy 0, policy_version 985251 (0.0009) [2023-12-26 07:27:31,747][123091] Updated weights for policy 0, policy_version 985261 (0.0010) [2023-12-26 07:27:32,210][123090] Updated weights for policy 1, policy_version 978402 (0.0009) [2023-12-26 07:27:32,271][123090] Updated weights for policy 1, policy_version 978412 (0.0010) [2023-12-26 07:27:32,326][123090] Updated weights for policy 1, policy_version 978422 (0.0010) [2023-12-26 07:27:32,393][123090] Updated weights for policy 1, policy_version 978432 (0.0010) [2023-12-26 07:27:32,456][123091] Updated weights for policy 0, policy_version 985271 (0.0006) [2023-12-26 07:27:32,527][123091] Updated weights for policy 0, policy_version 985281 (0.0005) [2023-12-26 07:27:32,589][123091] Updated weights for policy 0, policy_version 985291 (0.0009) [2023-12-26 07:27:33,207][123091] Updated weights for policy 0, policy_version 985301 (0.0006) [2023-12-26 07:27:33,231][123090] Updated weights for policy 1, policy_version 978442 (0.0005) [2023-12-26 07:27:33,254][123091] Updated weights for policy 0, policy_version 985311 (0.0005) [2023-12-26 07:27:33,295][123090] Updated weights for policy 1, policy_version 978452 (0.0005) [2023-12-26 07:27:33,307][123091] Updated weights for policy 0, policy_version 985321 (0.0006) [2023-12-26 07:27:33,353][123090] Updated weights for policy 1, policy_version 978462 (0.0005) [2023-12-26 07:27:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 502734848. Throughput: 0: 8833.1, 1: 8948.3. Samples: 502746152. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:33,785][121949] Avg episode reward: [(0, '6027.551'), (1, '5805.852')] [2023-12-26 07:27:34,066][123090] Updated weights for policy 1, policy_version 978472 (0.0008) [2023-12-26 07:27:34,130][123090] Updated weights for policy 1, policy_version 978482 (0.0009) [2023-12-26 07:27:34,147][123091] Updated weights for policy 0, policy_version 985332 (0.0009) [2023-12-26 07:27:34,194][123090] Updated weights for policy 1, policy_version 978492 (0.0007) [2023-12-26 07:27:34,205][123091] Updated weights for policy 0, policy_version 985342 (0.0010) [2023-12-26 07:27:34,264][123091] Updated weights for policy 0, policy_version 985352 (0.0010) [2023-12-26 07:27:34,993][123090] Updated weights for policy 1, policy_version 978502 (0.0008) [2023-12-26 07:27:35,048][123090] Updated weights for policy 1, policy_version 978512 (0.0009) [2023-12-26 07:27:35,090][123091] Updated weights for policy 0, policy_version 985363 (0.0009) [2023-12-26 07:27:35,101][123090] Updated weights for policy 1, policy_version 978522 (0.0009) [2023-12-26 07:27:35,149][123091] Updated weights for policy 0, policy_version 985373 (0.0005) [2023-12-26 07:27:35,202][123091] Updated weights for policy 0, policy_version 985383 (0.0005) [2023-12-26 07:27:35,880][123090] Updated weights for policy 1, policy_version 978532 (0.0009) [2023-12-26 07:27:35,931][123091] Updated weights for policy 0, policy_version 985393 (0.0005) [2023-12-26 07:27:35,932][123090] Updated weights for policy 1, policy_version 978543 (0.0010) [2023-12-26 07:27:35,983][123091] Updated weights for policy 0, policy_version 985403 (0.0005) [2023-12-26 07:27:35,986][123090] Updated weights for policy 1, policy_version 978553 (0.0009) [2023-12-26 07:27:36,047][123091] Updated weights for policy 0, policy_version 985413 (0.0005) [2023-12-26 07:27:36,096][123091] Updated weights for policy 0, policy_version 985423 (0.0005) [2023-12-26 07:27:36,818][123091] Updated weights for policy 0, policy_version 985433 (0.0008) [2023-12-26 07:27:36,867][123090] Updated weights for policy 1, policy_version 978563 (0.0009) [2023-12-26 07:27:36,874][123091] Updated weights for policy 0, policy_version 985443 (0.0009) [2023-12-26 07:27:36,930][123091] Updated weights for policy 0, policy_version 985453 (0.0007) [2023-12-26 07:27:36,935][123090] Updated weights for policy 1, policy_version 978573 (0.0008) [2023-12-26 07:27:36,995][123090] Updated weights for policy 1, policy_version 978583 (0.0009) [2023-12-26 07:27:37,748][123091] Updated weights for policy 0, policy_version 985463 (0.0008) [2023-12-26 07:27:37,808][123091] Updated weights for policy 0, policy_version 985473 (0.0006) [2023-12-26 07:27:37,841][123090] Updated weights for policy 1, policy_version 978593 (0.0009) [2023-12-26 07:27:37,866][123091] Updated weights for policy 0, policy_version 985484 (0.0009) [2023-12-26 07:27:37,896][123090] Updated weights for policy 1, policy_version 978603 (0.0005) [2023-12-26 07:27:37,946][123090] Updated weights for policy 1, policy_version 978613 (0.0009) [2023-12-26 07:27:37,998][123090] Updated weights for policy 1, policy_version 978623 (0.0008) [2023-12-26 07:27:38,593][123091] Updated weights for policy 0, policy_version 985494 (0.0010) [2023-12-26 07:27:38,651][123091] Updated weights for policy 0, policy_version 985504 (0.0011) [2023-12-26 07:27:38,717][123091] Updated weights for policy 0, policy_version 985514 (0.0011) [2023-12-26 07:27:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 502824960. Throughput: 0: 8883.3, 1: 8963.2. Samples: 502799972. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:38,785][121949] Avg episode reward: [(0, '6150.281'), (1, '5821.336')] [2023-12-26 07:27:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000978624_250527744.pth... [2023-12-26 07:27:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000985520_252297216.pth... [2023-12-26 07:27:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000984464_252026880.pth [2023-12-26 07:27:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000977600_250265600.pth [2023-12-26 07:27:38,897][123090] Updated weights for policy 1, policy_version 978633 (0.0009) [2023-12-26 07:27:38,964][123090] Updated weights for policy 1, policy_version 978643 (0.0010) [2023-12-26 07:27:39,017][123090] Updated weights for policy 1, policy_version 978653 (0.0008) [2023-12-26 07:27:39,502][123091] Updated weights for policy 0, policy_version 985524 (0.0011) [2023-12-26 07:27:39,565][123091] Updated weights for policy 0, policy_version 985534 (0.0011) [2023-12-26 07:27:39,630][123091] Updated weights for policy 0, policy_version 985544 (0.0011) [2023-12-26 07:27:39,890][123090] Updated weights for policy 1, policy_version 978663 (0.0009) [2023-12-26 07:27:39,957][123090] Updated weights for policy 1, policy_version 978673 (0.0009) [2023-12-26 07:27:40,027][123090] Updated weights for policy 1, policy_version 978683 (0.0010) [2023-12-26 07:27:40,391][123091] Updated weights for policy 0, policy_version 985554 (0.0010) [2023-12-26 07:27:40,441][123091] Updated weights for policy 0, policy_version 985564 (0.0005) [2023-12-26 07:27:40,494][123091] Updated weights for policy 0, policy_version 985574 (0.0006) [2023-12-26 07:27:40,543][123091] Updated weights for policy 0, policy_version 985584 (0.0006) [2023-12-26 07:27:40,896][123090] Updated weights for policy 1, policy_version 978693 (0.0007) [2023-12-26 07:27:40,949][123090] Updated weights for policy 1, policy_version 978703 (0.0005) [2023-12-26 07:27:41,002][123090] Updated weights for policy 1, policy_version 978713 (0.0005) [2023-12-26 07:27:41,329][123091] Updated weights for policy 0, policy_version 985594 (0.0010) [2023-12-26 07:27:41,402][123091] Updated weights for policy 0, policy_version 985604 (0.0009) [2023-12-26 07:27:41,469][123091] Updated weights for policy 0, policy_version 985614 (0.0009) [2023-12-26 07:27:41,804][123090] Updated weights for policy 1, policy_version 978723 (0.0007) [2023-12-26 07:27:41,863][123090] Updated weights for policy 1, policy_version 978733 (0.0006) [2023-12-26 07:27:41,925][123090] Updated weights for policy 1, policy_version 978743 (0.0006) [2023-12-26 07:27:42,396][123091] Updated weights for policy 0, policy_version 985624 (0.0009) [2023-12-26 07:27:42,465][123091] Updated weights for policy 0, policy_version 985634 (0.0009) [2023-12-26 07:27:42,525][123091] Updated weights for policy 0, policy_version 985644 (0.0009) [2023-12-26 07:27:42,772][123090] Updated weights for policy 1, policy_version 978753 (0.0009) [2023-12-26 07:27:42,842][123090] Updated weights for policy 1, policy_version 978763 (0.0006) [2023-12-26 07:27:42,919][123090] Updated weights for policy 1, policy_version 978773 (0.0006) [2023-12-26 07:27:42,987][123090] Updated weights for policy 1, policy_version 978783 (0.0010) [2023-12-26 07:27:43,388][123091] Updated weights for policy 0, policy_version 985654 (0.0009) [2023-12-26 07:27:43,436][123091] Updated weights for policy 0, policy_version 985664 (0.0009) [2023-12-26 07:27:43,495][123091] Updated weights for policy 0, policy_version 985674 (0.0009) [2023-12-26 07:27:43,756][123090] Updated weights for policy 1, policy_version 978793 (0.0010) [2023-12-26 07:27:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 502906880. Throughput: 0: 8838.4, 1: 8876.1. Samples: 502902260. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:43,785][121949] Avg episode reward: [(0, '6212.929'), (1, '5766.772')] [2023-12-26 07:27:43,815][123090] Updated weights for policy 1, policy_version 978803 (0.0010) [2023-12-26 07:27:43,881][123090] Updated weights for policy 1, policy_version 978813 (0.0010) [2023-12-26 07:27:44,355][123091] Updated weights for policy 0, policy_version 985684 (0.0009) [2023-12-26 07:27:44,403][123091] Updated weights for policy 0, policy_version 985694 (0.0008) [2023-12-26 07:27:44,459][123091] Updated weights for policy 0, policy_version 985704 (0.0009) [2023-12-26 07:27:44,695][123090] Updated weights for policy 1, policy_version 978823 (0.0010) [2023-12-26 07:27:44,743][123090] Updated weights for policy 1, policy_version 978833 (0.0010) [2023-12-26 07:27:44,809][123090] Updated weights for policy 1, policy_version 978843 (0.0010) [2023-12-26 07:27:45,290][123091] Updated weights for policy 0, policy_version 985714 (0.0009) [2023-12-26 07:27:45,358][123091] Updated weights for policy 0, policy_version 985724 (0.0010) [2023-12-26 07:27:45,417][123091] Updated weights for policy 0, policy_version 985734 (0.0010) [2023-12-26 07:27:45,468][123091] Updated weights for policy 0, policy_version 985744 (0.0009) [2023-12-26 07:27:45,612][123090] Updated weights for policy 1, policy_version 978853 (0.0008) [2023-12-26 07:27:45,675][123090] Updated weights for policy 1, policy_version 978863 (0.0006) [2023-12-26 07:27:45,736][123090] Updated weights for policy 1, policy_version 978873 (0.0008) [2023-12-26 07:27:46,367][123091] Updated weights for policy 0, policy_version 985754 (0.0010) [2023-12-26 07:27:46,381][123090] Updated weights for policy 1, policy_version 978883 (0.0007) [2023-12-26 07:27:46,419][123091] Updated weights for policy 0, policy_version 985764 (0.0008) [2023-12-26 07:27:46,430][123090] Updated weights for policy 1, policy_version 978893 (0.0007) [2023-12-26 07:27:46,473][123091] Updated weights for policy 0, policy_version 985774 (0.0008) [2023-12-26 07:27:46,475][123090] Updated weights for policy 1, policy_version 978903 (0.0008) [2023-12-26 07:27:47,290][123090] Updated weights for policy 1, policy_version 978913 (0.0009) [2023-12-26 07:27:47,324][123091] Updated weights for policy 0, policy_version 985784 (0.0007) [2023-12-26 07:27:47,350][123090] Updated weights for policy 1, policy_version 978923 (0.0011) [2023-12-26 07:27:47,387][123091] Updated weights for policy 0, policy_version 985794 (0.0009) [2023-12-26 07:27:47,412][123090] Updated weights for policy 1, policy_version 978933 (0.0010) [2023-12-26 07:27:47,433][123091] Updated weights for policy 0, policy_version 985804 (0.0007) [2023-12-26 07:27:47,471][123090] Updated weights for policy 1, policy_version 978943 (0.0010) [2023-12-26 07:27:48,268][123090] Updated weights for policy 1, policy_version 978953 (0.0008) [2023-12-26 07:27:48,273][123091] Updated weights for policy 0, policy_version 985814 (0.0010) [2023-12-26 07:27:48,332][123090] Updated weights for policy 1, policy_version 978963 (0.0010) [2023-12-26 07:27:48,337][123091] Updated weights for policy 0, policy_version 985824 (0.0011) [2023-12-26 07:27:48,400][123090] Updated weights for policy 1, policy_version 978973 (0.0009) [2023-12-26 07:27:48,404][123091] Updated weights for policy 0, policy_version 985834 (0.0011) [2023-12-26 07:27:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 502996992. Throughput: 0: 8837.4, 1: 8879.2. Samples: 503006108. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:48,785][121949] Avg episode reward: [(0, '6243.366'), (1, '5791.145')] [2023-12-26 07:27:49,135][123090] Updated weights for policy 1, policy_version 978983 (0.0009) [2023-12-26 07:27:49,195][123090] Updated weights for policy 1, policy_version 978993 (0.0006) [2023-12-26 07:27:49,231][123091] Updated weights for policy 0, policy_version 985844 (0.0010) [2023-12-26 07:27:49,264][123090] Updated weights for policy 1, policy_version 979003 (0.0009) [2023-12-26 07:27:49,289][123091] Updated weights for policy 0, policy_version 985854 (0.0010) [2023-12-26 07:27:49,350][123091] Updated weights for policy 0, policy_version 985864 (0.0010) [2023-12-26 07:27:50,029][123090] Updated weights for policy 1, policy_version 979013 (0.0008) [2023-12-26 07:27:50,094][123090] Updated weights for policy 1, policy_version 979023 (0.0006) [2023-12-26 07:27:50,163][123090] Updated weights for policy 1, policy_version 979033 (0.0007) [2023-12-26 07:27:50,224][123091] Updated weights for policy 0, policy_version 985874 (0.0009) [2023-12-26 07:27:50,291][123091] Updated weights for policy 0, policy_version 985884 (0.0005) [2023-12-26 07:27:50,357][123091] Updated weights for policy 0, policy_version 985894 (0.0008) [2023-12-26 07:27:50,423][123091] Updated weights for policy 0, policy_version 985904 (0.0010) [2023-12-26 07:27:50,917][123090] Updated weights for policy 1, policy_version 979043 (0.0008) [2023-12-26 07:27:50,963][123090] Updated weights for policy 1, policy_version 979053 (0.0005) [2023-12-26 07:27:51,025][123090] Updated weights for policy 1, policy_version 979063 (0.0006) [2023-12-26 07:27:51,285][123091] Updated weights for policy 0, policy_version 985914 (0.0009) [2023-12-26 07:27:51,336][123091] Updated weights for policy 0, policy_version 985924 (0.0009) [2023-12-26 07:27:51,404][123091] Updated weights for policy 0, policy_version 985934 (0.0009) [2023-12-26 07:27:51,844][123090] Updated weights for policy 1, policy_version 979073 (0.0006) [2023-12-26 07:27:51,911][123090] Updated weights for policy 1, policy_version 979083 (0.0008) [2023-12-26 07:27:51,979][123090] Updated weights for policy 1, policy_version 979093 (0.0010) [2023-12-26 07:27:52,045][123090] Updated weights for policy 1, policy_version 979103 (0.0009) [2023-12-26 07:27:52,224][123091] Updated weights for policy 0, policy_version 985944 (0.0006) [2023-12-26 07:27:52,291][123091] Updated weights for policy 0, policy_version 985954 (0.0006) [2023-12-26 07:27:52,355][123091] Updated weights for policy 0, policy_version 985964 (0.0009) [2023-12-26 07:27:52,874][123090] Updated weights for policy 1, policy_version 979113 (0.0010) [2023-12-26 07:27:52,944][123090] Updated weights for policy 1, policy_version 979123 (0.0010) [2023-12-26 07:27:53,010][123090] Updated weights for policy 1, policy_version 979133 (0.0010) [2023-12-26 07:27:53,134][123091] Updated weights for policy 0, policy_version 985974 (0.0009) [2023-12-26 07:27:53,201][123091] Updated weights for policy 0, policy_version 985984 (0.0006) [2023-12-26 07:27:53,257][123091] Updated weights for policy 0, policy_version 985994 (0.0006) [2023-12-26 07:27:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 503078912. Throughput: 0: 8785.1, 1: 8894.9. Samples: 503058868. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:53,785][121949] Avg episode reward: [(0, '6330.419'), (1, '5862.173')] [2023-12-26 07:27:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000986000_252420096.pth... [2023-12-26 07:27:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000979136_250658816.pth... [2023-12-26 07:27:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000978112_250396672.pth [2023-12-26 07:27:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000984976_252157952.pth [2023-12-26 07:27:53,868][123090] Updated weights for policy 1, policy_version 979143 (0.0009) [2023-12-26 07:27:53,925][123090] Updated weights for policy 1, policy_version 979153 (0.0009) [2023-12-26 07:27:53,979][123091] Updated weights for policy 0, policy_version 986004 (0.0006) [2023-12-26 07:27:53,981][123090] Updated weights for policy 1, policy_version 979163 (0.0009) [2023-12-26 07:27:54,030][123091] Updated weights for policy 0, policy_version 986014 (0.0008) [2023-12-26 07:27:54,092][123091] Updated weights for policy 0, policy_version 986024 (0.0009) [2023-12-26 07:27:54,719][123090] Updated weights for policy 1, policy_version 979173 (0.0007) [2023-12-26 07:27:54,773][123090] Updated weights for policy 1, policy_version 979183 (0.0008) [2023-12-26 07:27:54,843][123090] Updated weights for policy 1, policy_version 979193 (0.0006) [2023-12-26 07:27:55,008][123091] Updated weights for policy 0, policy_version 986034 (0.0008) [2023-12-26 07:27:55,066][123091] Updated weights for policy 0, policy_version 986044 (0.0009) [2023-12-26 07:27:55,127][123091] Updated weights for policy 0, policy_version 986054 (0.0006) [2023-12-26 07:27:55,181][123091] Updated weights for policy 0, policy_version 986064 (0.0005) [2023-12-26 07:27:55,562][123090] Updated weights for policy 1, policy_version 979203 (0.0006) [2023-12-26 07:27:55,618][123090] Updated weights for policy 1, policy_version 979213 (0.0005) [2023-12-26 07:27:55,676][123090] Updated weights for policy 1, policy_version 979223 (0.0005) [2023-12-26 07:27:55,949][123091] Updated weights for policy 0, policy_version 986074 (0.0009) [2023-12-26 07:27:56,012][123091] Updated weights for policy 0, policy_version 986084 (0.0005) [2023-12-26 07:27:56,067][123091] Updated weights for policy 0, policy_version 986094 (0.0005) [2023-12-26 07:27:56,473][123090] Updated weights for policy 1, policy_version 979233 (0.0006) [2023-12-26 07:27:56,538][123090] Updated weights for policy 1, policy_version 979243 (0.0009) [2023-12-26 07:27:56,598][123090] Updated weights for policy 1, policy_version 979253 (0.0010) [2023-12-26 07:27:56,659][123090] Updated weights for policy 1, policy_version 979263 (0.0008) [2023-12-26 07:27:56,710][123091] Updated weights for policy 0, policy_version 986104 (0.0010) [2023-12-26 07:27:56,766][123091] Updated weights for policy 0, policy_version 986114 (0.0010) [2023-12-26 07:27:56,833][123091] Updated weights for policy 0, policy_version 986124 (0.0006) [2023-12-26 07:27:57,465][123091] Updated weights for policy 0, policy_version 986134 (0.0005) [2023-12-26 07:27:57,521][123091] Updated weights for policy 0, policy_version 986144 (0.0005) [2023-12-26 07:27:57,549][123090] Updated weights for policy 1, policy_version 979273 (0.0009) [2023-12-26 07:27:57,568][123091] Updated weights for policy 0, policy_version 986154 (0.0008) [2023-12-26 07:27:57,608][123090] Updated weights for policy 1, policy_version 979283 (0.0008) [2023-12-26 07:27:57,668][123090] Updated weights for policy 1, policy_version 979293 (0.0009) [2023-12-26 07:27:58,361][123091] Updated weights for policy 0, policy_version 986164 (0.0008) [2023-12-26 07:27:58,428][123091] Updated weights for policy 0, policy_version 986174 (0.0006) [2023-12-26 07:27:58,497][123091] Updated weights for policy 0, policy_version 986184 (0.0007) [2023-12-26 07:27:58,600][123090] Updated weights for policy 1, policy_version 979303 (0.0008) [2023-12-26 07:27:58,662][123090] Updated weights for policy 1, policy_version 979313 (0.0010) [2023-12-26 07:27:58,730][123090] Updated weights for policy 1, policy_version 979323 (0.0009) [2023-12-26 07:27:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 503177216. Throughput: 0: 8858.9, 1: 8845.7. Samples: 503166664. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:27:58,784][121949] Avg episode reward: [(0, '6270.086'), (1, '5794.565')] [2023-12-26 07:27:59,337][123091] Updated weights for policy 0, policy_version 986194 (0.0008) [2023-12-26 07:27:59,412][123091] Updated weights for policy 0, policy_version 986204 (0.0010) [2023-12-26 07:27:59,464][123091] Updated weights for policy 0, policy_version 986214 (0.0009) [2023-12-26 07:27:59,526][123091] Updated weights for policy 0, policy_version 986224 (0.0009) [2023-12-26 07:27:59,530][123090] Updated weights for policy 1, policy_version 979333 (0.0008) [2023-12-26 07:27:59,595][123090] Updated weights for policy 1, policy_version 979343 (0.0005) [2023-12-26 07:27:59,663][123090] Updated weights for policy 1, policy_version 979353 (0.0008) [2023-12-26 07:28:00,366][123090] Updated weights for policy 1, policy_version 979363 (0.0010) [2023-12-26 07:28:00,403][123091] Updated weights for policy 0, policy_version 986234 (0.0008) [2023-12-26 07:28:00,430][123090] Updated weights for policy 1, policy_version 979373 (0.0008) [2023-12-26 07:28:00,457][123091] Updated weights for policy 0, policy_version 986244 (0.0008) [2023-12-26 07:28:00,492][123090] Updated weights for policy 1, policy_version 979383 (0.0009) [2023-12-26 07:28:00,526][123091] Updated weights for policy 0, policy_version 986254 (0.0008) [2023-12-26 07:28:01,286][123090] Updated weights for policy 1, policy_version 979393 (0.0008) [2023-12-26 07:28:01,343][123091] Updated weights for policy 0, policy_version 986264 (0.0008) [2023-12-26 07:28:01,347][123090] Updated weights for policy 1, policy_version 979403 (0.0009) [2023-12-26 07:28:01,406][123090] Updated weights for policy 1, policy_version 979413 (0.0008) [2023-12-26 07:28:01,411][123091] Updated weights for policy 0, policy_version 986274 (0.0008) [2023-12-26 07:28:01,463][123090] Updated weights for policy 1, policy_version 979423 (0.0009) [2023-12-26 07:28:01,479][123091] Updated weights for policy 0, policy_version 986284 (0.0008) [2023-12-26 07:28:02,293][123090] Updated weights for policy 1, policy_version 979433 (0.0010) [2023-12-26 07:28:02,351][123091] Updated weights for policy 0, policy_version 986294 (0.0009) [2023-12-26 07:28:02,358][123090] Updated weights for policy 1, policy_version 979443 (0.0007) [2023-12-26 07:28:02,410][123091] Updated weights for policy 0, policy_version 986304 (0.0010) [2023-12-26 07:28:02,424][123090] Updated weights for policy 1, policy_version 979453 (0.0005) [2023-12-26 07:28:02,466][123091] Updated weights for policy 0, policy_version 986314 (0.0008) [2023-12-26 07:28:03,189][123090] Updated weights for policy 1, policy_version 979463 (0.0009) [2023-12-26 07:28:03,239][123090] Updated weights for policy 1, policy_version 979473 (0.0009) [2023-12-26 07:28:03,292][123090] Updated weights for policy 1, policy_version 979484 (0.0010) [2023-12-26 07:28:03,316][123091] Updated weights for policy 0, policy_version 986324 (0.0008) [2023-12-26 07:28:03,374][123091] Updated weights for policy 0, policy_version 986334 (0.0005) [2023-12-26 07:28:03,423][123091] Updated weights for policy 0, policy_version 986344 (0.0007) [2023-12-26 07:28:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 503259136. Throughput: 0: 8840.7, 1: 8829.3. Samples: 503269764. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:03,785][121949] Avg episode reward: [(0, '6127.603'), (1, '5814.775')] [2023-12-26 07:28:04,142][123091] Updated weights for policy 0, policy_version 986354 (0.0007) [2023-12-26 07:28:04,156][123090] Updated weights for policy 1, policy_version 979494 (0.0010) [2023-12-26 07:28:04,207][123091] Updated weights for policy 0, policy_version 986364 (0.0006) [2023-12-26 07:28:04,221][123090] Updated weights for policy 1, policy_version 979504 (0.0011) [2023-12-26 07:28:04,274][123091] Updated weights for policy 0, policy_version 986374 (0.0008) [2023-12-26 07:28:04,286][123090] Updated weights for policy 1, policy_version 979514 (0.0011) [2023-12-26 07:28:04,342][123091] Updated weights for policy 0, policy_version 986384 (0.0009) [2023-12-26 07:28:05,086][123090] Updated weights for policy 1, policy_version 979524 (0.0011) [2023-12-26 07:28:05,151][123090] Updated weights for policy 1, policy_version 979534 (0.0009) [2023-12-26 07:28:05,174][123091] Updated weights for policy 0, policy_version 986394 (0.0008) [2023-12-26 07:28:05,212][123090] Updated weights for policy 1, policy_version 979544 (0.0006) [2023-12-26 07:28:05,238][123091] Updated weights for policy 0, policy_version 986404 (0.0008) [2023-12-26 07:28:05,300][123091] Updated weights for policy 0, policy_version 986414 (0.0009) [2023-12-26 07:28:05,910][123090] Updated weights for policy 1, policy_version 979554 (0.0006) [2023-12-26 07:28:05,973][123090] Updated weights for policy 1, policy_version 979564 (0.0010) [2023-12-26 07:28:06,024][123090] Updated weights for policy 1, policy_version 979574 (0.0010) [2023-12-26 07:28:06,082][123090] Updated weights for policy 1, policy_version 979584 (0.0008) [2023-12-26 07:28:06,187][123091] Updated weights for policy 0, policy_version 986424 (0.0010) [2023-12-26 07:28:06,253][123091] Updated weights for policy 0, policy_version 986434 (0.0009) [2023-12-26 07:28:06,316][123091] Updated weights for policy 0, policy_version 986444 (0.0010) [2023-12-26 07:28:06,815][123090] Updated weights for policy 1, policy_version 979594 (0.0007) [2023-12-26 07:28:06,875][123090] Updated weights for policy 1, policy_version 979604 (0.0011) [2023-12-26 07:28:06,943][123090] Updated weights for policy 1, policy_version 979614 (0.0011) [2023-12-26 07:28:07,210][123091] Updated weights for policy 0, policy_version 986454 (0.0009) [2023-12-26 07:28:07,270][123091] Updated weights for policy 0, policy_version 986464 (0.0008) [2023-12-26 07:28:07,333][123091] Updated weights for policy 0, policy_version 986474 (0.0009) [2023-12-26 07:28:07,754][123090] Updated weights for policy 1, policy_version 979624 (0.0007) [2023-12-26 07:28:07,807][123090] Updated weights for policy 1, policy_version 979634 (0.0005) [2023-12-26 07:28:07,865][123090] Updated weights for policy 1, policy_version 979644 (0.0005) [2023-12-26 07:28:08,200][123091] Updated weights for policy 0, policy_version 986484 (0.0009) [2023-12-26 07:28:08,268][123091] Updated weights for policy 0, policy_version 986494 (0.0010) [2023-12-26 07:28:08,342][123091] Updated weights for policy 0, policy_version 986504 (0.0010) [2023-12-26 07:28:08,555][123090] Updated weights for policy 1, policy_version 979654 (0.0008) [2023-12-26 07:28:08,606][123090] Updated weights for policy 1, policy_version 979664 (0.0009) [2023-12-26 07:28:08,663][123090] Updated weights for policy 1, policy_version 979674 (0.0009) [2023-12-26 07:28:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 503349248. Throughput: 0: 8836.2, 1: 8878.0. Samples: 503322724. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:08,785][121949] Avg episode reward: [(0, '5996.875'), (1, '5947.596')] [2023-12-26 07:28:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000986512_252551168.pth... [2023-12-26 07:28:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000979680_250798080.pth... [2023-12-26 07:28:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000985520_252297216.pth [2023-12-26 07:28:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000978624_250527744.pth [2023-12-26 07:28:09,188][123091] Updated weights for policy 0, policy_version 986514 (0.0010) [2023-12-26 07:28:09,260][123091] Updated weights for policy 0, policy_version 986524 (0.0008) [2023-12-26 07:28:09,326][123091] Updated weights for policy 0, policy_version 986534 (0.0006) [2023-12-26 07:28:09,398][123091] Updated weights for policy 0, policy_version 986544 (0.0009) [2023-12-26 07:28:09,534][123090] Updated weights for policy 1, policy_version 979684 (0.0009) [2023-12-26 07:28:09,593][123090] Updated weights for policy 1, policy_version 979694 (0.0009) [2023-12-26 07:28:09,651][123090] Updated weights for policy 1, policy_version 979704 (0.0009) [2023-12-26 07:28:10,181][123091] Updated weights for policy 0, policy_version 986554 (0.0006) [2023-12-26 07:28:10,256][123091] Updated weights for policy 0, policy_version 986564 (0.0006) [2023-12-26 07:28:10,318][123091] Updated weights for policy 0, policy_version 986574 (0.0011) [2023-12-26 07:28:10,533][123090] Updated weights for policy 1, policy_version 979714 (0.0009) [2023-12-26 07:28:10,594][123090] Updated weights for policy 1, policy_version 979724 (0.0009) [2023-12-26 07:28:10,660][123090] Updated weights for policy 1, policy_version 979734 (0.0009) [2023-12-26 07:28:10,723][123090] Updated weights for policy 1, policy_version 979744 (0.0005) [2023-12-26 07:28:11,093][123091] Updated weights for policy 0, policy_version 986584 (0.0011) [2023-12-26 07:28:11,164][123091] Updated weights for policy 0, policy_version 986594 (0.0011) [2023-12-26 07:28:11,233][123091] Updated weights for policy 0, policy_version 986604 (0.0010) [2023-12-26 07:28:11,569][123090] Updated weights for policy 1, policy_version 979754 (0.0009) [2023-12-26 07:28:11,631][123090] Updated weights for policy 1, policy_version 979764 (0.0009) [2023-12-26 07:28:11,701][123090] Updated weights for policy 1, policy_version 979774 (0.0009) [2023-12-26 07:28:12,084][123091] Updated weights for policy 0, policy_version 986614 (0.0009) [2023-12-26 07:28:12,144][123091] Updated weights for policy 0, policy_version 986624 (0.0008) [2023-12-26 07:28:12,212][123091] Updated weights for policy 0, policy_version 986634 (0.0006) [2023-12-26 07:28:12,579][123090] Updated weights for policy 1, policy_version 979784 (0.0008) [2023-12-26 07:28:12,648][123090] Updated weights for policy 1, policy_version 979794 (0.0009) [2023-12-26 07:28:12,722][123090] Updated weights for policy 1, policy_version 979804 (0.0009) [2023-12-26 07:28:13,009][123091] Updated weights for policy 0, policy_version 986644 (0.0007) [2023-12-26 07:28:13,063][123091] Updated weights for policy 0, policy_version 986654 (0.0005) [2023-12-26 07:28:13,121][123091] Updated weights for policy 0, policy_version 986664 (0.0005) [2023-12-26 07:28:13,514][123090] Updated weights for policy 1, policy_version 979814 (0.0010) [2023-12-26 07:28:13,576][123090] Updated weights for policy 1, policy_version 979824 (0.0010) [2023-12-26 07:28:13,643][123090] Updated weights for policy 1, policy_version 979834 (0.0010) [2023-12-26 07:28:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 503431168. Throughput: 0: 8777.2, 1: 8813.4. Samples: 503424788. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:13,785][121949] Avg episode reward: [(0, '6134.519'), (1, '5971.714')] [2023-12-26 07:28:13,794][123091] Updated weights for policy 0, policy_version 986674 (0.0006) [2023-12-26 07:28:13,843][123091] Updated weights for policy 0, policy_version 986684 (0.0009) [2023-12-26 07:28:13,897][123091] Updated weights for policy 0, policy_version 986694 (0.0008) [2023-12-26 07:28:13,956][123091] Updated weights for policy 0, policy_version 986704 (0.0009) [2023-12-26 07:28:14,342][123090] Updated weights for policy 1, policy_version 979844 (0.0008) [2023-12-26 07:28:14,401][123090] Updated weights for policy 1, policy_version 979854 (0.0005) [2023-12-26 07:28:14,459][123090] Updated weights for policy 1, policy_version 979864 (0.0009) [2023-12-26 07:28:14,725][123091] Updated weights for policy 0, policy_version 986714 (0.0009) [2023-12-26 07:28:14,797][123091] Updated weights for policy 0, policy_version 986724 (0.0010) [2023-12-26 07:28:14,862][123091] Updated weights for policy 0, policy_version 986734 (0.0011) [2023-12-26 07:28:15,195][123090] Updated weights for policy 1, policy_version 979874 (0.0008) [2023-12-26 07:28:15,263][123090] Updated weights for policy 1, policy_version 979884 (0.0011) [2023-12-26 07:28:15,329][123090] Updated weights for policy 1, policy_version 979894 (0.0010) [2023-12-26 07:28:15,403][123090] Updated weights for policy 1, policy_version 979904 (0.0011) [2023-12-26 07:28:15,569][123091] Updated weights for policy 0, policy_version 986744 (0.0006) [2023-12-26 07:28:15,625][123091] Updated weights for policy 0, policy_version 986754 (0.0007) [2023-12-26 07:28:15,670][123091] Updated weights for policy 0, policy_version 986764 (0.0005) [2023-12-26 07:28:16,140][123090] Updated weights for policy 1, policy_version 979914 (0.0005) [2023-12-26 07:28:16,201][123090] Updated weights for policy 1, policy_version 979924 (0.0005) [2023-12-26 07:28:16,270][123090] Updated weights for policy 1, policy_version 979934 (0.0008) [2023-12-26 07:28:16,390][123091] Updated weights for policy 0, policy_version 986774 (0.0008) [2023-12-26 07:28:16,446][123091] Updated weights for policy 0, policy_version 986784 (0.0009) [2023-12-26 07:28:16,502][123091] Updated weights for policy 0, policy_version 986794 (0.0009) [2023-12-26 07:28:16,978][123090] Updated weights for policy 1, policy_version 979944 (0.0006) [2023-12-26 07:28:17,039][123090] Updated weights for policy 1, policy_version 979954 (0.0006) [2023-12-26 07:28:17,108][123090] Updated weights for policy 1, policy_version 979964 (0.0008) [2023-12-26 07:28:17,317][123091] Updated weights for policy 0, policy_version 986804 (0.0010) [2023-12-26 07:28:17,383][123091] Updated weights for policy 0, policy_version 986814 (0.0011) [2023-12-26 07:28:17,462][123091] Updated weights for policy 0, policy_version 986824 (0.0011) [2023-12-26 07:28:17,774][123090] Updated weights for policy 1, policy_version 979974 (0.0007) [2023-12-26 07:28:17,833][123090] Updated weights for policy 1, policy_version 979984 (0.0006) [2023-12-26 07:28:17,892][123090] Updated weights for policy 1, policy_version 979994 (0.0006) [2023-12-26 07:28:18,185][123091] Updated weights for policy 0, policy_version 986834 (0.0010) [2023-12-26 07:28:18,238][123091] Updated weights for policy 0, policy_version 986844 (0.0008) [2023-12-26 07:28:18,304][123091] Updated weights for policy 0, policy_version 986854 (0.0010) [2023-12-26 07:28:18,373][123091] Updated weights for policy 0, policy_version 986864 (0.0011) [2023-12-26 07:28:18,586][123090] Updated weights for policy 1, policy_version 980004 (0.0006) [2023-12-26 07:28:18,649][123090] Updated weights for policy 1, policy_version 980014 (0.0010) [2023-12-26 07:28:18,712][123090] Updated weights for policy 1, policy_version 980024 (0.0010) [2023-12-26 07:28:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 503529472. Throughput: 0: 8755.9, 1: 8844.4. Samples: 503538164. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:18,784][121949] Avg episode reward: [(0, '6290.980'), (1, '5940.587')] [2023-12-26 07:28:19,164][123091] Updated weights for policy 0, policy_version 986874 (0.0005) [2023-12-26 07:28:19,227][123091] Updated weights for policy 0, policy_version 986884 (0.0006) [2023-12-26 07:28:19,277][123091] Updated weights for policy 0, policy_version 986894 (0.0008) [2023-12-26 07:28:19,494][123090] Updated weights for policy 1, policy_version 980034 (0.0010) [2023-12-26 07:28:19,548][123090] Updated weights for policy 1, policy_version 980044 (0.0008) [2023-12-26 07:28:19,611][123090] Updated weights for policy 1, policy_version 980054 (0.0006) [2023-12-26 07:28:19,690][123090] Updated weights for policy 1, policy_version 980064 (0.0005) [2023-12-26 07:28:20,002][123091] Updated weights for policy 0, policy_version 986904 (0.0010) [2023-12-26 07:28:20,071][123091] Updated weights for policy 0, policy_version 986914 (0.0011) [2023-12-26 07:28:20,136][123091] Updated weights for policy 0, policy_version 986924 (0.0010) [2023-12-26 07:28:20,449][123090] Updated weights for policy 1, policy_version 980074 (0.0009) [2023-12-26 07:28:20,498][123090] Updated weights for policy 1, policy_version 980084 (0.0009) [2023-12-26 07:28:20,567][123090] Updated weights for policy 1, policy_version 980094 (0.0006) [2023-12-26 07:28:21,026][123091] Updated weights for policy 0, policy_version 986934 (0.0010) [2023-12-26 07:28:21,095][123091] Updated weights for policy 0, policy_version 986944 (0.0009) [2023-12-26 07:28:21,169][123091] Updated weights for policy 0, policy_version 986954 (0.0010) [2023-12-26 07:28:21,324][123090] Updated weights for policy 1, policy_version 980104 (0.0010) [2023-12-26 07:28:21,400][123090] Updated weights for policy 1, policy_version 980114 (0.0009) [2023-12-26 07:28:21,462][123090] Updated weights for policy 1, policy_version 980124 (0.0009) [2023-12-26 07:28:21,972][123091] Updated weights for policy 0, policy_version 986964 (0.0008) [2023-12-26 07:28:22,037][123091] Updated weights for policy 0, policy_version 986974 (0.0006) [2023-12-26 07:28:22,111][123091] Updated weights for policy 0, policy_version 986984 (0.0010) [2023-12-26 07:28:22,363][123090] Updated weights for policy 1, policy_version 980134 (0.0010) [2023-12-26 07:28:22,428][123090] Updated weights for policy 1, policy_version 980144 (0.0010) [2023-12-26 07:28:22,495][123090] Updated weights for policy 1, policy_version 980154 (0.0009) [2023-12-26 07:28:22,833][123091] Updated weights for policy 0, policy_version 986994 (0.0009) [2023-12-26 07:28:22,896][123091] Updated weights for policy 0, policy_version 987004 (0.0006) [2023-12-26 07:28:22,957][123091] Updated weights for policy 0, policy_version 987014 (0.0005) [2023-12-26 07:28:23,012][123091] Updated weights for policy 0, policy_version 987024 (0.0005) [2023-12-26 07:28:23,400][123090] Updated weights for policy 1, policy_version 980164 (0.0009) [2023-12-26 07:28:23,455][123090] Updated weights for policy 1, policy_version 980174 (0.0008) [2023-12-26 07:28:23,511][123090] Updated weights for policy 1, policy_version 980184 (0.0009) [2023-12-26 07:28:23,743][123091] Updated weights for policy 0, policy_version 987034 (0.0009) [2023-12-26 07:28:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 503611392. Throughput: 0: 8705.1, 1: 8847.4. Samples: 503589832. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:23,785][121949] Avg episode reward: [(0, '6133.041'), (1, '5989.331')] [2023-12-26 07:28:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000980192_250929152.pth... [2023-12-26 07:28:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000979136_250658816.pth [2023-12-26 07:28:23,803][123091] Updated weights for policy 0, policy_version 987044 (0.0010) [2023-12-26 07:28:23,863][123091] Updated weights for policy 0, policy_version 987054 (0.0009) [2023-12-26 07:28:23,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000987056_252690432.pth... [2023-12-26 07:28:23,878][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000986000_252420096.pth [2023-12-26 07:28:24,354][123090] Updated weights for policy 1, policy_version 980194 (0.0009) [2023-12-26 07:28:24,425][123090] Updated weights for policy 1, policy_version 980204 (0.0009) [2023-12-26 07:28:24,493][123090] Updated weights for policy 1, policy_version 980214 (0.0009) [2023-12-26 07:28:24,563][123090] Updated weights for policy 1, policy_version 980224 (0.0009) [2023-12-26 07:28:24,675][123091] Updated weights for policy 0, policy_version 987064 (0.0009) [2023-12-26 07:28:24,724][123091] Updated weights for policy 0, policy_version 987074 (0.0009) [2023-12-26 07:28:24,777][123091] Updated weights for policy 0, policy_version 987084 (0.0009) [2023-12-26 07:28:25,369][123090] Updated weights for policy 1, policy_version 980234 (0.0009) [2023-12-26 07:28:25,422][123090] Updated weights for policy 1, policy_version 980244 (0.0007) [2023-12-26 07:28:25,473][123090] Updated weights for policy 1, policy_version 980254 (0.0009) [2023-12-26 07:28:25,632][123091] Updated weights for policy 0, policy_version 987094 (0.0009) [2023-12-26 07:28:25,691][123091] Updated weights for policy 0, policy_version 987104 (0.0009) [2023-12-26 07:28:25,750][123091] Updated weights for policy 0, policy_version 987114 (0.0009) [2023-12-26 07:28:26,303][123090] Updated weights for policy 1, policy_version 980264 (0.0009) [2023-12-26 07:28:26,372][123090] Updated weights for policy 1, policy_version 980274 (0.0010) [2023-12-26 07:28:26,434][123090] Updated weights for policy 1, policy_version 980284 (0.0010) [2023-12-26 07:28:26,581][123091] Updated weights for policy 0, policy_version 987124 (0.0009) [2023-12-26 07:28:26,638][123091] Updated weights for policy 0, policy_version 987134 (0.0009) [2023-12-26 07:28:26,705][123091] Updated weights for policy 0, policy_version 987144 (0.0010) [2023-12-26 07:28:27,242][123090] Updated weights for policy 1, policy_version 980294 (0.0010) [2023-12-26 07:28:27,298][123090] Updated weights for policy 1, policy_version 980304 (0.0007) [2023-12-26 07:28:27,363][123090] Updated weights for policy 1, policy_version 980314 (0.0009) [2023-12-26 07:28:27,546][123091] Updated weights for policy 0, policy_version 987154 (0.0010) [2023-12-26 07:28:27,600][123091] Updated weights for policy 0, policy_version 987164 (0.0009) [2023-12-26 07:28:27,654][123091] Updated weights for policy 0, policy_version 987174 (0.0009) [2023-12-26 07:28:27,709][123091] Updated weights for policy 0, policy_version 987184 (0.0008) [2023-12-26 07:28:28,140][123090] Updated weights for policy 1, policy_version 980324 (0.0009) [2023-12-26 07:28:28,200][123090] Updated weights for policy 1, policy_version 980334 (0.0008) [2023-12-26 07:28:28,273][123090] Updated weights for policy 1, policy_version 980344 (0.0008) [2023-12-26 07:28:28,605][123091] Updated weights for policy 0, policy_version 987194 (0.0010) [2023-12-26 07:28:28,659][123091] Updated weights for policy 0, policy_version 987204 (0.0010) [2023-12-26 07:28:28,712][123091] Updated weights for policy 0, policy_version 987214 (0.0010) [2023-12-26 07:28:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 503701504. Throughput: 0: 8730.6, 1: 8850.8. Samples: 503693424. Policy #0 lag: (min: 3.0, avg: 9.3, max: 35.0) [2023-12-26 07:28:28,785][121949] Avg episode reward: [(0, '6093.826'), (1, '5967.362')] [2023-12-26 07:28:29,007][123090] Updated weights for policy 1, policy_version 980354 (0.0009) [2023-12-26 07:28:29,068][123090] Updated weights for policy 1, policy_version 980364 (0.0010) [2023-12-26 07:28:29,119][123090] Updated weights for policy 1, policy_version 980374 (0.0010) [2023-12-26 07:28:29,182][123090] Updated weights for policy 1, policy_version 980384 (0.0008) [2023-12-26 07:28:29,567][123091] Updated weights for policy 0, policy_version 987224 (0.0009) [2023-12-26 07:28:29,622][123091] Updated weights for policy 0, policy_version 987234 (0.0010) [2023-12-26 07:28:29,690][123091] Updated weights for policy 0, policy_version 987244 (0.0008) [2023-12-26 07:28:29,984][123090] Updated weights for policy 1, policy_version 980394 (0.0011) [2023-12-26 07:28:30,036][123090] Updated weights for policy 1, policy_version 980404 (0.0010) [2023-12-26 07:28:30,084][123090] Updated weights for policy 1, policy_version 980414 (0.0010) [2023-12-26 07:28:30,522][123091] Updated weights for policy 0, policy_version 987254 (0.0009) [2023-12-26 07:28:30,585][123091] Updated weights for policy 0, policy_version 987264 (0.0009) [2023-12-26 07:28:30,643][123091] Updated weights for policy 0, policy_version 987274 (0.0009) [2023-12-26 07:28:30,877][123090] Updated weights for policy 1, policy_version 980424 (0.0006) [2023-12-26 07:28:30,923][123090] Updated weights for policy 1, policy_version 980434 (0.0005) [2023-12-26 07:28:30,976][123090] Updated weights for policy 1, policy_version 980444 (0.0008) [2023-12-26 07:28:31,533][123091] Updated weights for policy 0, policy_version 987284 (0.0009) [2023-12-26 07:28:31,580][123091] Updated weights for policy 0, policy_version 987294 (0.0008) [2023-12-26 07:28:31,637][123091] Updated weights for policy 0, policy_version 987304 (0.0008) [2023-12-26 07:28:31,802][123090] Updated weights for policy 1, policy_version 980454 (0.0007) [2023-12-26 07:28:31,861][123090] Updated weights for policy 1, policy_version 980464 (0.0009) [2023-12-26 07:28:31,917][123090] Updated weights for policy 1, policy_version 980474 (0.0006) [2023-12-26 07:28:32,517][123091] Updated weights for policy 0, policy_version 987314 (0.0006) [2023-12-26 07:28:32,548][123090] Updated weights for policy 1, policy_version 980484 (0.0005) [2023-12-26 07:28:32,584][123091] Updated weights for policy 0, policy_version 987324 (0.0008) [2023-12-26 07:28:32,612][123090] Updated weights for policy 1, policy_version 980494 (0.0005) [2023-12-26 07:28:32,654][123091] Updated weights for policy 0, policy_version 987334 (0.0008) [2023-12-26 07:28:32,682][123090] Updated weights for policy 1, policy_version 980504 (0.0005) [2023-12-26 07:28:32,719][123091] Updated weights for policy 0, policy_version 987344 (0.0009) [2023-12-26 07:28:33,404][123090] Updated weights for policy 1, policy_version 980514 (0.0008) [2023-12-26 07:28:33,459][123090] Updated weights for policy 1, policy_version 980524 (0.0010) [2023-12-26 07:28:33,509][123090] Updated weights for policy 1, policy_version 980534 (0.0008) [2023-12-26 07:28:33,560][123090] Updated weights for policy 1, policy_version 980544 (0.0005) [2023-12-26 07:28:33,584][123091] Updated weights for policy 0, policy_version 987354 (0.0010) [2023-12-26 07:28:33,647][123091] Updated weights for policy 0, policy_version 987364 (0.0010) [2023-12-26 07:28:33,710][123091] Updated weights for policy 0, policy_version 987374 (0.0010) [2023-12-26 07:28:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 503791616. Throughput: 0: 8701.9, 1: 8905.6. Samples: 503798444. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:33,785][121949] Avg episode reward: [(0, '6095.006'), (1, '5927.337')] [2023-12-26 07:28:34,234][123090] Updated weights for policy 1, policy_version 980554 (0.0010) [2023-12-26 07:28:34,286][123090] Updated weights for policy 1, policy_version 980564 (0.0009) [2023-12-26 07:28:34,346][123090] Updated weights for policy 1, policy_version 980574 (0.0009) [2023-12-26 07:28:34,607][123091] Updated weights for policy 0, policy_version 987384 (0.0010) [2023-12-26 07:28:34,677][123091] Updated weights for policy 0, policy_version 987394 (0.0009) [2023-12-26 07:28:34,747][123091] Updated weights for policy 0, policy_version 987404 (0.0009) [2023-12-26 07:28:35,223][123090] Updated weights for policy 1, policy_version 980584 (0.0009) [2023-12-26 07:28:35,281][123090] Updated weights for policy 1, policy_version 980594 (0.0009) [2023-12-26 07:28:35,337][123090] Updated weights for policy 1, policy_version 980604 (0.0009) [2023-12-26 07:28:35,575][123091] Updated weights for policy 0, policy_version 987414 (0.0009) [2023-12-26 07:28:35,635][123091] Updated weights for policy 0, policy_version 987424 (0.0009) [2023-12-26 07:28:35,689][123091] Updated weights for policy 0, policy_version 987434 (0.0008) [2023-12-26 07:28:36,090][123090] Updated weights for policy 1, policy_version 980614 (0.0007) [2023-12-26 07:28:36,160][123090] Updated weights for policy 1, policy_version 980624 (0.0007) [2023-12-26 07:28:36,227][123090] Updated weights for policy 1, policy_version 980634 (0.0008) [2023-12-26 07:28:36,549][123091] Updated weights for policy 0, policy_version 987444 (0.0010) [2023-12-26 07:28:36,610][123091] Updated weights for policy 0, policy_version 987454 (0.0008) [2023-12-26 07:28:36,679][123091] Updated weights for policy 0, policy_version 987464 (0.0005) [2023-12-26 07:28:37,003][123090] Updated weights for policy 1, policy_version 980644 (0.0008) [2023-12-26 07:28:37,053][123090] Updated weights for policy 1, policy_version 980654 (0.0005) [2023-12-26 07:28:37,101][123090] Updated weights for policy 1, policy_version 980664 (0.0005) [2023-12-26 07:28:37,258][123091] Updated weights for policy 0, policy_version 987474 (0.0005) [2023-12-26 07:28:37,325][123091] Updated weights for policy 0, policy_version 987484 (0.0007) [2023-12-26 07:28:37,390][123091] Updated weights for policy 0, policy_version 987494 (0.0006) [2023-12-26 07:28:37,444][123091] Updated weights for policy 0, policy_version 987504 (0.0005) [2023-12-26 07:28:37,863][123090] Updated weights for policy 1, policy_version 980674 (0.0006) [2023-12-26 07:28:37,916][123090] Updated weights for policy 1, policy_version 980684 (0.0009) [2023-12-26 07:28:37,976][123090] Updated weights for policy 1, policy_version 980694 (0.0009) [2023-12-26 07:28:38,037][123090] Updated weights for policy 1, policy_version 980704 (0.0012) [2023-12-26 07:28:38,210][123091] Updated weights for policy 0, policy_version 987514 (0.0011) [2023-12-26 07:28:38,261][123091] Updated weights for policy 0, policy_version 987524 (0.0010) [2023-12-26 07:28:38,317][123091] Updated weights for policy 0, policy_version 987534 (0.0011) [2023-12-26 07:28:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 503873536. Throughput: 0: 8701.3, 1: 8885.4. Samples: 503850272. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:38,786][121949] Avg episode reward: [(0, '6034.590'), (1, '5920.274')] [2023-12-26 07:28:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000987536_252813312.pth... [2023-12-26 07:28:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000980704_251060224.pth... [2023-12-26 07:28:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000986512_252551168.pth [2023-12-26 07:28:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000979680_250798080.pth [2023-12-26 07:28:38,896][123090] Updated weights for policy 1, policy_version 980714 (0.0010) [2023-12-26 07:28:38,956][123090] Updated weights for policy 1, policy_version 980724 (0.0009) [2023-12-26 07:28:39,008][123090] Updated weights for policy 1, policy_version 980734 (0.0009) [2023-12-26 07:28:39,166][123091] Updated weights for policy 0, policy_version 987544 (0.0010) [2023-12-26 07:28:39,229][123091] Updated weights for policy 0, policy_version 987554 (0.0007) [2023-12-26 07:28:39,298][123091] Updated weights for policy 0, policy_version 987564 (0.0010) [2023-12-26 07:28:39,862][123090] Updated weights for policy 1, policy_version 980744 (0.0009) [2023-12-26 07:28:39,923][123090] Updated weights for policy 1, policy_version 980754 (0.0007) [2023-12-26 07:28:39,984][123090] Updated weights for policy 1, policy_version 980764 (0.0006) [2023-12-26 07:28:40,221][123091] Updated weights for policy 0, policy_version 987574 (0.0006) [2023-12-26 07:28:40,294][123091] Updated weights for policy 0, policy_version 987584 (0.0006) [2023-12-26 07:28:40,357][123091] Updated weights for policy 0, policy_version 987594 (0.0009) [2023-12-26 07:28:40,730][123090] Updated weights for policy 1, policy_version 980774 (0.0008) [2023-12-26 07:28:40,778][123090] Updated weights for policy 1, policy_version 980784 (0.0010) [2023-12-26 07:28:40,829][123090] Updated weights for policy 1, policy_version 980794 (0.0010) [2023-12-26 07:28:41,105][123091] Updated weights for policy 0, policy_version 987604 (0.0009) [2023-12-26 07:28:41,175][123091] Updated weights for policy 0, policy_version 987614 (0.0009) [2023-12-26 07:28:41,230][123091] Updated weights for policy 0, policy_version 987624 (0.0010) [2023-12-26 07:28:41,686][123090] Updated weights for policy 1, policy_version 980804 (0.0010) [2023-12-26 07:28:41,751][123090] Updated weights for policy 1, policy_version 980814 (0.0008) [2023-12-26 07:28:41,824][123090] Updated weights for policy 1, policy_version 980824 (0.0008) [2023-12-26 07:28:42,017][123091] Updated weights for policy 0, policy_version 987634 (0.0009) [2023-12-26 07:28:42,068][123091] Updated weights for policy 0, policy_version 987644 (0.0009) [2023-12-26 07:28:42,120][123091] Updated weights for policy 0, policy_version 987654 (0.0009) [2023-12-26 07:28:42,178][123091] Updated weights for policy 0, policy_version 987664 (0.0009) [2023-12-26 07:28:42,633][123090] Updated weights for policy 1, policy_version 980834 (0.0008) [2023-12-26 07:28:42,681][123090] Updated weights for policy 1, policy_version 980844 (0.0005) [2023-12-26 07:28:42,733][123090] Updated weights for policy 1, policy_version 980854 (0.0005) [2023-12-26 07:28:42,783][123090] Updated weights for policy 1, policy_version 980864 (0.0005) [2023-12-26 07:28:43,097][123091] Updated weights for policy 0, policy_version 987674 (0.0006) [2023-12-26 07:28:43,170][123091] Updated weights for policy 0, policy_version 987684 (0.0005) [2023-12-26 07:28:43,239][123091] Updated weights for policy 0, policy_version 987694 (0.0005) [2023-12-26 07:28:43,615][123090] Updated weights for policy 1, policy_version 980874 (0.0010) [2023-12-26 07:28:43,669][123090] Updated weights for policy 1, policy_version 980884 (0.0010) [2023-12-26 07:28:43,728][123090] Updated weights for policy 1, policy_version 980894 (0.0009) [2023-12-26 07:28:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 503963648. Throughput: 0: 8622.4, 1: 8896.9. Samples: 503955032. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:43,784][121949] Avg episode reward: [(0, '6120.092'), (1, '5918.753')] [2023-12-26 07:28:43,943][123091] Updated weights for policy 0, policy_version 987704 (0.0008) [2023-12-26 07:28:43,998][123091] Updated weights for policy 0, policy_version 987714 (0.0009) [2023-12-26 07:28:44,052][123091] Updated weights for policy 0, policy_version 987724 (0.0007) [2023-12-26 07:28:44,566][123090] Updated weights for policy 1, policy_version 980905 (0.0007) [2023-12-26 07:28:44,614][123090] Updated weights for policy 1, policy_version 980915 (0.0009) [2023-12-26 07:28:44,674][123090] Updated weights for policy 1, policy_version 980925 (0.0010) [2023-12-26 07:28:44,911][123091] Updated weights for policy 0, policy_version 987734 (0.0010) [2023-12-26 07:28:44,975][123091] Updated weights for policy 0, policy_version 987745 (0.0010) [2023-12-26 07:28:45,039][123091] Updated weights for policy 0, policy_version 987755 (0.0010) [2023-12-26 07:28:45,542][123090] Updated weights for policy 1, policy_version 980935 (0.0009) [2023-12-26 07:28:45,590][123090] Updated weights for policy 1, policy_version 980945 (0.0009) [2023-12-26 07:28:45,640][123090] Updated weights for policy 1, policy_version 980955 (0.0009) [2023-12-26 07:28:45,913][123091] Updated weights for policy 0, policy_version 987765 (0.0009) [2023-12-26 07:28:45,988][123091] Updated weights for policy 0, policy_version 987775 (0.0010) [2023-12-26 07:28:46,060][123091] Updated weights for policy 0, policy_version 987785 (0.0010) [2023-12-26 07:28:46,409][123090] Updated weights for policy 1, policy_version 980965 (0.0008) [2023-12-26 07:28:46,481][123090] Updated weights for policy 1, policy_version 980975 (0.0008) [2023-12-26 07:28:46,545][123090] Updated weights for policy 1, policy_version 980985 (0.0008) [2023-12-26 07:28:46,821][123091] Updated weights for policy 0, policy_version 987795 (0.0008) [2023-12-26 07:28:46,871][123091] Updated weights for policy 0, policy_version 987805 (0.0005) [2023-12-26 07:28:46,921][123091] Updated weights for policy 0, policy_version 987815 (0.0005) [2023-12-26 07:28:47,240][123090] Updated weights for policy 1, policy_version 980995 (0.0008) [2023-12-26 07:28:47,316][123090] Updated weights for policy 1, policy_version 981005 (0.0008) [2023-12-26 07:28:47,383][123090] Updated weights for policy 1, policy_version 981015 (0.0006) [2023-12-26 07:28:47,621][123091] Updated weights for policy 0, policy_version 987825 (0.0005) [2023-12-26 07:28:47,673][123091] Updated weights for policy 0, policy_version 987835 (0.0005) [2023-12-26 07:28:47,729][123091] Updated weights for policy 0, policy_version 987845 (0.0006) [2023-12-26 07:28:47,787][123091] Updated weights for policy 0, policy_version 987855 (0.0006) [2023-12-26 07:28:48,079][123090] Updated weights for policy 1, policy_version 981025 (0.0006) [2023-12-26 07:28:48,133][123090] Updated weights for policy 1, policy_version 981035 (0.0005) [2023-12-26 07:28:48,179][123090] Updated weights for policy 1, policy_version 981045 (0.0005) [2023-12-26 07:28:48,224][123090] Updated weights for policy 1, policy_version 981055 (0.0007) [2023-12-26 07:28:48,538][123091] Updated weights for policy 0, policy_version 987865 (0.0009) [2023-12-26 07:28:48,608][123091] Updated weights for policy 0, policy_version 987876 (0.0010) [2023-12-26 07:28:48,667][123091] Updated weights for policy 0, policy_version 987886 (0.0010) [2023-12-26 07:28:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 504053760. Throughput: 0: 8698.5, 1: 8966.2. Samples: 504064676. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:48,785][121949] Avg episode reward: [(0, '6291.270'), (1, '5979.131')] [2023-12-26 07:28:48,953][123090] Updated weights for policy 1, policy_version 981065 (0.0006) [2023-12-26 07:28:49,000][123090] Updated weights for policy 1, policy_version 981075 (0.0007) [2023-12-26 07:28:49,050][123090] Updated weights for policy 1, policy_version 981085 (0.0008) [2023-12-26 07:28:49,478][123091] Updated weights for policy 0, policy_version 987896 (0.0010) [2023-12-26 07:28:49,538][123091] Updated weights for policy 0, policy_version 987906 (0.0011) [2023-12-26 07:28:49,594][123091] Updated weights for policy 0, policy_version 987916 (0.0010) [2023-12-26 07:28:49,832][123090] Updated weights for policy 1, policy_version 981095 (0.0008) [2023-12-26 07:28:49,893][123090] Updated weights for policy 1, policy_version 981105 (0.0009) [2023-12-26 07:28:49,959][123090] Updated weights for policy 1, policy_version 981115 (0.0009) [2023-12-26 07:28:50,416][123091] Updated weights for policy 0, policy_version 987926 (0.0007) [2023-12-26 07:28:50,488][123091] Updated weights for policy 0, policy_version 987936 (0.0005) [2023-12-26 07:28:50,554][123091] Updated weights for policy 0, policy_version 987946 (0.0008) [2023-12-26 07:28:50,731][123090] Updated weights for policy 1, policy_version 981125 (0.0008) [2023-12-26 07:28:50,795][123090] Updated weights for policy 1, policy_version 981135 (0.0009) [2023-12-26 07:28:50,863][123090] Updated weights for policy 1, policy_version 981145 (0.0010) [2023-12-26 07:28:51,304][123091] Updated weights for policy 0, policy_version 987956 (0.0007) [2023-12-26 07:28:51,377][123091] Updated weights for policy 0, policy_version 987966 (0.0010) [2023-12-26 07:28:51,443][123091] Updated weights for policy 0, policy_version 987976 (0.0010) [2023-12-26 07:28:51,677][123090] Updated weights for policy 1, policy_version 981155 (0.0010) [2023-12-26 07:28:51,749][123090] Updated weights for policy 1, policy_version 981165 (0.0008) [2023-12-26 07:28:51,810][123090] Updated weights for policy 1, policy_version 981175 (0.0008) [2023-12-26 07:28:52,305][123091] Updated weights for policy 0, policy_version 987986 (0.0010) [2023-12-26 07:28:52,370][123091] Updated weights for policy 0, policy_version 987996 (0.0009) [2023-12-26 07:28:52,427][123091] Updated weights for policy 0, policy_version 988006 (0.0009) [2023-12-26 07:28:52,489][123091] Updated weights for policy 0, policy_version 988016 (0.0010) [2023-12-26 07:28:52,610][123090] Updated weights for policy 1, policy_version 981185 (0.0009) [2023-12-26 07:28:52,659][123090] Updated weights for policy 1, policy_version 981195 (0.0009) [2023-12-26 07:28:52,709][123090] Updated weights for policy 1, policy_version 981205 (0.0009) [2023-12-26 07:28:52,760][123090] Updated weights for policy 1, policy_version 981215 (0.0006) [2023-12-26 07:28:53,343][123091] Updated weights for policy 0, policy_version 988026 (0.0006) [2023-12-26 07:28:53,401][123091] Updated weights for policy 0, policy_version 988036 (0.0009) [2023-12-26 07:28:53,461][123091] Updated weights for policy 0, policy_version 988046 (0.0009) [2023-12-26 07:28:53,611][123090] Updated weights for policy 1, policy_version 981225 (0.0009) [2023-12-26 07:28:53,672][123090] Updated weights for policy 1, policy_version 981235 (0.0008) [2023-12-26 07:28:53,737][123090] Updated weights for policy 1, policy_version 981245 (0.0008) [2023-12-26 07:28:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 504143872. Throughput: 0: 8720.8, 1: 8925.6. Samples: 504116820. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:53,785][121949] Avg episode reward: [(0, '6270.719'), (1, '5933.088')] [2023-12-26 07:28:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000981248_251199488.pth... [2023-12-26 07:28:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000988048_252944384.pth... [2023-12-26 07:28:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000980192_250929152.pth [2023-12-26 07:28:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000987056_252690432.pth [2023-12-26 07:28:54,287][123091] Updated weights for policy 0, policy_version 988056 (0.0009) [2023-12-26 07:28:54,350][123091] Updated weights for policy 0, policy_version 988066 (0.0009) [2023-12-26 07:28:54,403][123091] Updated weights for policy 0, policy_version 988076 (0.0008) [2023-12-26 07:28:54,581][123090] Updated weights for policy 1, policy_version 981255 (0.0010) [2023-12-26 07:28:54,633][123090] Updated weights for policy 1, policy_version 981265 (0.0010) [2023-12-26 07:28:54,697][123090] Updated weights for policy 1, policy_version 981275 (0.0006) [2023-12-26 07:28:55,300][123091] Updated weights for policy 0, policy_version 988086 (0.0010) [2023-12-26 07:28:55,361][123091] Updated weights for policy 0, policy_version 988096 (0.0009) [2023-12-26 07:28:55,395][123090] Updated weights for policy 1, policy_version 981285 (0.0009) [2023-12-26 07:28:55,423][123091] Updated weights for policy 0, policy_version 988106 (0.0008) [2023-12-26 07:28:55,442][123090] Updated weights for policy 1, policy_version 981295 (0.0009) [2023-12-26 07:28:55,493][123090] Updated weights for policy 1, policy_version 981305 (0.0010) [2023-12-26 07:28:56,201][123090] Updated weights for policy 1, policy_version 981315 (0.0010) [2023-12-26 07:28:56,253][123090] Updated weights for policy 1, policy_version 981325 (0.0010) [2023-12-26 07:28:56,289][123091] Updated weights for policy 0, policy_version 988116 (0.0007) [2023-12-26 07:28:56,315][123090] Updated weights for policy 1, policy_version 981335 (0.0009) [2023-12-26 07:28:56,344][123091] Updated weights for policy 0, policy_version 988126 (0.0008) [2023-12-26 07:28:56,398][123091] Updated weights for policy 0, policy_version 988136 (0.0008) [2023-12-26 07:28:57,080][123090] Updated weights for policy 1, policy_version 981345 (0.0010) [2023-12-26 07:28:57,139][123090] Updated weights for policy 1, policy_version 981355 (0.0010) [2023-12-26 07:28:57,203][123090] Updated weights for policy 1, policy_version 981365 (0.0009) [2023-12-26 07:28:57,259][123090] Updated weights for policy 1, policy_version 981375 (0.0007) [2023-12-26 07:28:57,274][123091] Updated weights for policy 0, policy_version 988146 (0.0009) [2023-12-26 07:28:57,334][123091] Updated weights for policy 0, policy_version 988156 (0.0010) [2023-12-26 07:28:57,412][123091] Updated weights for policy 0, policy_version 988166 (0.0009) [2023-12-26 07:28:57,479][123091] Updated weights for policy 0, policy_version 988176 (0.0010) [2023-12-26 07:28:58,067][123090] Updated weights for policy 1, policy_version 981385 (0.0009) [2023-12-26 07:28:58,136][123090] Updated weights for policy 1, policy_version 981395 (0.0010) [2023-12-26 07:28:58,194][123090] Updated weights for policy 1, policy_version 981405 (0.0009) [2023-12-26 07:28:58,361][123091] Updated weights for policy 0, policy_version 988186 (0.0008) [2023-12-26 07:28:58,427][123091] Updated weights for policy 0, policy_version 988196 (0.0009) [2023-12-26 07:28:58,487][123091] Updated weights for policy 0, policy_version 988206 (0.0010) [2023-12-26 07:28:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 504225792. Throughput: 0: 8691.9, 1: 9004.5. Samples: 504221124. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:28:58,785][121949] Avg episode reward: [(0, '6174.672'), (1, '5930.655')] [2023-12-26 07:28:59,139][123090] Updated weights for policy 1, policy_version 981415 (0.0008) [2023-12-26 07:28:59,209][123090] Updated weights for policy 1, policy_version 981425 (0.0007) [2023-12-26 07:28:59,277][123090] Updated weights for policy 1, policy_version 981435 (0.0008) [2023-12-26 07:28:59,404][123091] Updated weights for policy 0, policy_version 988216 (0.0010) [2023-12-26 07:28:59,455][123091] Updated weights for policy 0, policy_version 988226 (0.0006) [2023-12-26 07:28:59,515][123091] Updated weights for policy 0, policy_version 988236 (0.0006) [2023-12-26 07:29:00,026][123090] Updated weights for policy 1, policy_version 981445 (0.0009) [2023-12-26 07:29:00,073][123090] Updated weights for policy 1, policy_version 981455 (0.0008) [2023-12-26 07:29:00,129][123090] Updated weights for policy 1, policy_version 981465 (0.0006) [2023-12-26 07:29:00,291][123091] Updated weights for policy 0, policy_version 988246 (0.0006) [2023-12-26 07:29:00,362][123091] Updated weights for policy 0, policy_version 988256 (0.0005) [2023-12-26 07:29:00,432][123091] Updated weights for policy 0, policy_version 988266 (0.0008) [2023-12-26 07:29:00,788][123090] Updated weights for policy 1, policy_version 981475 (0.0006) [2023-12-26 07:29:00,866][123090] Updated weights for policy 1, policy_version 981485 (0.0005) [2023-12-26 07:29:00,927][123090] Updated weights for policy 1, policy_version 981495 (0.0005) [2023-12-26 07:29:01,098][123091] Updated weights for policy 0, policy_version 988276 (0.0008) [2023-12-26 07:29:01,169][123091] Updated weights for policy 0, policy_version 988286 (0.0008) [2023-12-26 07:29:01,238][123091] Updated weights for policy 0, policy_version 988296 (0.0008) [2023-12-26 07:29:01,641][123090] Updated weights for policy 1, policy_version 981505 (0.0006) [2023-12-26 07:29:01,706][123090] Updated weights for policy 1, policy_version 981515 (0.0007) [2023-12-26 07:29:01,767][123090] Updated weights for policy 1, policy_version 981525 (0.0009) [2023-12-26 07:29:01,830][123090] Updated weights for policy 1, policy_version 981535 (0.0008) [2023-12-26 07:29:01,974][123091] Updated weights for policy 0, policy_version 988306 (0.0009) [2023-12-26 07:29:02,031][123091] Updated weights for policy 0, policy_version 988316 (0.0009) [2023-12-26 07:29:02,083][123091] Updated weights for policy 0, policy_version 988326 (0.0010) [2023-12-26 07:29:02,145][123091] Updated weights for policy 0, policy_version 988336 (0.0010) [2023-12-26 07:29:02,688][123090] Updated weights for policy 1, policy_version 981545 (0.0007) [2023-12-26 07:29:02,744][123090] Updated weights for policy 1, policy_version 981555 (0.0009) [2023-12-26 07:29:02,809][123090] Updated weights for policy 1, policy_version 981565 (0.0010) [2023-12-26 07:29:02,922][123091] Updated weights for policy 0, policy_version 988346 (0.0010) [2023-12-26 07:29:02,982][123091] Updated weights for policy 0, policy_version 988356 (0.0009) [2023-12-26 07:29:03,051][123091] Updated weights for policy 0, policy_version 988366 (0.0008) [2023-12-26 07:29:03,588][123090] Updated weights for policy 1, policy_version 981575 (0.0009) [2023-12-26 07:29:03,642][123090] Updated weights for policy 1, policy_version 981585 (0.0007) [2023-12-26 07:29:03,696][123090] Updated weights for policy 1, policy_version 981595 (0.0005) [2023-12-26 07:29:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 504315904. Throughput: 0: 8624.0, 1: 8928.3. Samples: 504328016. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:03,784][121949] Avg episode reward: [(0, '6123.308'), (1, '6008.236')] [2023-12-26 07:29:03,845][123091] Updated weights for policy 0, policy_version 988376 (0.0009) [2023-12-26 07:29:03,908][123091] Updated weights for policy 0, policy_version 988386 (0.0010) [2023-12-26 07:29:03,974][123091] Updated weights for policy 0, policy_version 988396 (0.0010) [2023-12-26 07:29:04,444][123090] Updated weights for policy 1, policy_version 981605 (0.0007) [2023-12-26 07:29:04,500][123090] Updated weights for policy 1, policy_version 981615 (0.0009) [2023-12-26 07:29:04,552][123090] Updated weights for policy 1, policy_version 981625 (0.0009) [2023-12-26 07:29:04,836][123091] Updated weights for policy 0, policy_version 988406 (0.0009) [2023-12-26 07:29:04,900][123091] Updated weights for policy 0, policy_version 988416 (0.0006) [2023-12-26 07:29:04,951][123091] Updated weights for policy 0, policy_version 988426 (0.0005) [2023-12-26 07:29:05,345][123090] Updated weights for policy 1, policy_version 981635 (0.0008) [2023-12-26 07:29:05,409][123090] Updated weights for policy 1, policy_version 981645 (0.0006) [2023-12-26 07:29:05,464][123090] Updated weights for policy 1, policy_version 981655 (0.0005) [2023-12-26 07:29:05,648][123091] Updated weights for policy 0, policy_version 988436 (0.0005) [2023-12-26 07:29:05,703][123091] Updated weights for policy 0, policy_version 988446 (0.0005) [2023-12-26 07:29:05,770][123091] Updated weights for policy 0, policy_version 988456 (0.0006) [2023-12-26 07:29:06,110][123090] Updated weights for policy 1, policy_version 981665 (0.0006) [2023-12-26 07:29:06,177][123090] Updated weights for policy 1, policy_version 981675 (0.0007) [2023-12-26 07:29:06,233][123090] Updated weights for policy 1, policy_version 981685 (0.0005) [2023-12-26 07:29:06,305][123090] Updated weights for policy 1, policy_version 981695 (0.0006) [2023-12-26 07:29:06,441][123091] Updated weights for policy 0, policy_version 988466 (0.0009) [2023-12-26 07:29:06,497][123091] Updated weights for policy 0, policy_version 988476 (0.0010) [2023-12-26 07:29:06,544][123091] Updated weights for policy 0, policy_version 988486 (0.0005) [2023-12-26 07:29:06,595][123091] Updated weights for policy 0, policy_version 988496 (0.0005) [2023-12-26 07:29:06,959][123090] Updated weights for policy 1, policy_version 981705 (0.0008) [2023-12-26 07:29:07,023][123090] Updated weights for policy 1, policy_version 981715 (0.0006) [2023-12-26 07:29:07,086][123090] Updated weights for policy 1, policy_version 981725 (0.0006) [2023-12-26 07:29:07,361][123091] Updated weights for policy 0, policy_version 988506 (0.0011) [2023-12-26 07:29:07,420][123091] Updated weights for policy 0, policy_version 988516 (0.0011) [2023-12-26 07:29:07,487][123091] Updated weights for policy 0, policy_version 988526 (0.0011) [2023-12-26 07:29:07,850][123090] Updated weights for policy 1, policy_version 981735 (0.0008) [2023-12-26 07:29:07,912][123090] Updated weights for policy 1, policy_version 981745 (0.0007) [2023-12-26 07:29:07,982][123090] Updated weights for policy 1, policy_version 981755 (0.0007) [2023-12-26 07:29:08,279][123091] Updated weights for policy 0, policy_version 988536 (0.0011) [2023-12-26 07:29:08,330][123091] Updated weights for policy 0, policy_version 988546 (0.0010) [2023-12-26 07:29:08,397][123091] Updated weights for policy 0, policy_version 988556 (0.0010) [2023-12-26 07:29:08,728][123090] Updated weights for policy 1, policy_version 981765 (0.0008) [2023-12-26 07:29:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 504406016. Throughput: 0: 8674.4, 1: 8992.3. Samples: 504384832. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:08,785][121949] Avg episode reward: [(0, '6042.364'), (1, '6014.754')] [2023-12-26 07:29:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000988560_253075456.pth... [2023-12-26 07:29:08,792][123090] Updated weights for policy 1, policy_version 981775 (0.0008) [2023-12-26 07:29:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000987536_252813312.pth [2023-12-26 07:29:08,860][123090] Updated weights for policy 1, policy_version 981785 (0.0008) [2023-12-26 07:29:08,907][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000981792_251338752.pth... [2023-12-26 07:29:08,912][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000980704_251060224.pth [2023-12-26 07:29:09,158][123091] Updated weights for policy 0, policy_version 988566 (0.0007) [2023-12-26 07:29:09,233][123091] Updated weights for policy 0, policy_version 988576 (0.0006) [2023-12-26 07:29:09,304][123091] Updated weights for policy 0, policy_version 988586 (0.0008) [2023-12-26 07:29:09,534][123090] Updated weights for policy 1, policy_version 981795 (0.0009) [2023-12-26 07:29:09,596][123090] Updated weights for policy 1, policy_version 981805 (0.0009) [2023-12-26 07:29:09,661][123090] Updated weights for policy 1, policy_version 981815 (0.0009) [2023-12-26 07:29:10,089][123091] Updated weights for policy 0, policy_version 988596 (0.0010) [2023-12-26 07:29:10,152][123091] Updated weights for policy 0, policy_version 988606 (0.0011) [2023-12-26 07:29:10,218][123091] Updated weights for policy 0, policy_version 988616 (0.0008) [2023-12-26 07:29:10,497][123090] Updated weights for policy 1, policy_version 981825 (0.0009) [2023-12-26 07:29:10,570][123090] Updated weights for policy 1, policy_version 981835 (0.0008) [2023-12-26 07:29:10,634][123090] Updated weights for policy 1, policy_version 981845 (0.0005) [2023-12-26 07:29:10,691][123090] Updated weights for policy 1, policy_version 981855 (0.0005) [2023-12-26 07:29:10,916][123091] Updated weights for policy 0, policy_version 988626 (0.0008) [2023-12-26 07:29:10,975][123091] Updated weights for policy 0, policy_version 988636 (0.0009) [2023-12-26 07:29:11,042][123091] Updated weights for policy 0, policy_version 988646 (0.0011) [2023-12-26 07:29:11,110][123091] Updated weights for policy 0, policy_version 988656 (0.0011) [2023-12-26 07:29:11,407][123090] Updated weights for policy 1, policy_version 981865 (0.0008) [2023-12-26 07:29:11,463][123090] Updated weights for policy 1, policy_version 981875 (0.0010) [2023-12-26 07:29:11,534][123090] Updated weights for policy 1, policy_version 981885 (0.0011) [2023-12-26 07:29:11,930][123091] Updated weights for policy 0, policy_version 988666 (0.0008) [2023-12-26 07:29:11,982][123091] Updated weights for policy 0, policy_version 988676 (0.0008) [2023-12-26 07:29:12,038][123091] Updated weights for policy 0, policy_version 988686 (0.0008) [2023-12-26 07:29:12,384][123090] Updated weights for policy 1, policy_version 981895 (0.0009) [2023-12-26 07:29:12,453][123090] Updated weights for policy 1, policy_version 981905 (0.0005) [2023-12-26 07:29:12,525][123090] Updated weights for policy 1, policy_version 981915 (0.0009) [2023-12-26 07:29:12,777][123091] Updated weights for policy 0, policy_version 988696 (0.0006) [2023-12-26 07:29:12,841][123091] Updated weights for policy 0, policy_version 988706 (0.0006) [2023-12-26 07:29:12,912][123091] Updated weights for policy 0, policy_version 988716 (0.0006) [2023-12-26 07:29:13,303][123090] Updated weights for policy 1, policy_version 981925 (0.0011) [2023-12-26 07:29:13,351][123090] Updated weights for policy 1, policy_version 981935 (0.0009) [2023-12-26 07:29:13,417][123090] Updated weights for policy 1, policy_version 981945 (0.0005) [2023-12-26 07:29:13,567][123091] Updated weights for policy 0, policy_version 988726 (0.0006) [2023-12-26 07:29:13,633][123091] Updated weights for policy 0, policy_version 988736 (0.0005) [2023-12-26 07:29:13,694][123091] Updated weights for policy 0, policy_version 988746 (0.0005) [2023-12-26 07:29:13,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 504504320. Throughput: 0: 8678.8, 1: 9074.5. Samples: 504492320. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:13,784][121949] Avg episode reward: [(0, '6086.098'), (1, '6014.333')] [2023-12-26 07:29:14,122][123090] Updated weights for policy 1, policy_version 981955 (0.0005) [2023-12-26 07:29:14,187][123090] Updated weights for policy 1, policy_version 981965 (0.0005) [2023-12-26 07:29:14,248][123090] Updated weights for policy 1, policy_version 981975 (0.0006) [2023-12-26 07:29:14,352][123091] Updated weights for policy 0, policy_version 988756 (0.0007) [2023-12-26 07:29:14,405][123091] Updated weights for policy 0, policy_version 988767 (0.0010) [2023-12-26 07:29:14,460][123091] Updated weights for policy 0, policy_version 988777 (0.0010) [2023-12-26 07:29:14,870][123090] Updated weights for policy 1, policy_version 981985 (0.0006) [2023-12-26 07:29:14,935][123090] Updated weights for policy 1, policy_version 981995 (0.0011) [2023-12-26 07:29:14,989][123090] Updated weights for policy 1, policy_version 982005 (0.0009) [2023-12-26 07:29:15,062][123090] Updated weights for policy 1, policy_version 982015 (0.0011) [2023-12-26 07:29:15,235][123091] Updated weights for policy 0, policy_version 988787 (0.0010) [2023-12-26 07:29:15,299][123091] Updated weights for policy 0, policy_version 988797 (0.0011) [2023-12-26 07:29:15,368][123091] Updated weights for policy 0, policy_version 988807 (0.0011) [2023-12-26 07:29:15,860][123090] Updated weights for policy 1, policy_version 982025 (0.0006) [2023-12-26 07:29:15,907][123090] Updated weights for policy 1, policy_version 982035 (0.0007) [2023-12-26 07:29:15,972][123090] Updated weights for policy 1, policy_version 982045 (0.0005) [2023-12-26 07:29:16,190][123091] Updated weights for policy 0, policy_version 988817 (0.0011) [2023-12-26 07:29:16,253][123091] Updated weights for policy 0, policy_version 988827 (0.0011) [2023-12-26 07:29:16,312][123091] Updated weights for policy 0, policy_version 988837 (0.0010) [2023-12-26 07:29:16,366][123091] Updated weights for policy 0, policy_version 988847 (0.0010) [2023-12-26 07:29:16,638][123090] Updated weights for policy 1, policy_version 982055 (0.0005) [2023-12-26 07:29:16,699][123090] Updated weights for policy 1, policy_version 982065 (0.0005) [2023-12-26 07:29:16,761][123090] Updated weights for policy 1, policy_version 982075 (0.0008) [2023-12-26 07:29:17,183][123091] Updated weights for policy 0, policy_version 988857 (0.0011) [2023-12-26 07:29:17,246][123091] Updated weights for policy 0, policy_version 988867 (0.0011) [2023-12-26 07:29:17,293][123091] Updated weights for policy 0, policy_version 988877 (0.0010) [2023-12-26 07:29:17,571][123090] Updated weights for policy 1, policy_version 982085 (0.0008) [2023-12-26 07:29:17,648][123090] Updated weights for policy 1, policy_version 982095 (0.0007) [2023-12-26 07:29:17,727][123090] Updated weights for policy 1, policy_version 982105 (0.0005) [2023-12-26 07:29:18,082][123091] Updated weights for policy 0, policy_version 988887 (0.0008) [2023-12-26 07:29:18,148][123091] Updated weights for policy 0, policy_version 988897 (0.0008) [2023-12-26 07:29:18,220][123091] Updated weights for policy 0, policy_version 988907 (0.0007) [2023-12-26 07:29:18,400][123090] Updated weights for policy 1, policy_version 982115 (0.0006) [2023-12-26 07:29:18,462][123090] Updated weights for policy 1, policy_version 982125 (0.0006) [2023-12-26 07:29:18,532][123090] Updated weights for policy 1, policy_version 982135 (0.0009) [2023-12-26 07:29:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 504594432. Throughput: 0: 8818.3, 1: 9090.7. Samples: 504604352. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:18,785][121949] Avg episode reward: [(0, '6269.480'), (1, '6014.313')] [2023-12-26 07:29:18,993][123091] Updated weights for policy 0, policy_version 988917 (0.0008) [2023-12-26 07:29:19,046][123091] Updated weights for policy 0, policy_version 988927 (0.0006) [2023-12-26 07:29:19,114][123091] Updated weights for policy 0, policy_version 988937 (0.0005) [2023-12-26 07:29:19,343][123090] Updated weights for policy 1, policy_version 982145 (0.0011) [2023-12-26 07:29:19,402][123090] Updated weights for policy 1, policy_version 982155 (0.0010) [2023-12-26 07:29:19,458][123090] Updated weights for policy 1, policy_version 982165 (0.0010) [2023-12-26 07:29:19,525][123090] Updated weights for policy 1, policy_version 982175 (0.0010) [2023-12-26 07:29:19,923][123091] Updated weights for policy 0, policy_version 988947 (0.0007) [2023-12-26 07:29:19,994][123091] Updated weights for policy 0, policy_version 988957 (0.0011) [2023-12-26 07:29:20,062][123091] Updated weights for policy 0, policy_version 988967 (0.0010) [2023-12-26 07:29:20,359][123090] Updated weights for policy 1, policy_version 982185 (0.0006) [2023-12-26 07:29:20,418][123090] Updated weights for policy 1, policy_version 982195 (0.0005) [2023-12-26 07:29:20,484][123090] Updated weights for policy 1, policy_version 982205 (0.0005) [2023-12-26 07:29:20,852][123091] Updated weights for policy 0, policy_version 988977 (0.0008) [2023-12-26 07:29:20,917][123091] Updated weights for policy 0, policy_version 988987 (0.0007) [2023-12-26 07:29:20,985][123091] Updated weights for policy 0, policy_version 988997 (0.0006) [2023-12-26 07:29:21,055][123091] Updated weights for policy 0, policy_version 989007 (0.0007) [2023-12-26 07:29:21,293][123090] Updated weights for policy 1, policy_version 982215 (0.0009) [2023-12-26 07:29:21,368][123090] Updated weights for policy 1, policy_version 982225 (0.0010) [2023-12-26 07:29:21,442][123090] Updated weights for policy 1, policy_version 982235 (0.0010) [2023-12-26 07:29:21,851][123091] Updated weights for policy 0, policy_version 989017 (0.0007) [2023-12-26 07:29:21,925][123091] Updated weights for policy 0, policy_version 989027 (0.0006) [2023-12-26 07:29:21,997][123091] Updated weights for policy 0, policy_version 989037 (0.0006) [2023-12-26 07:29:22,170][123090] Updated weights for policy 1, policy_version 982245 (0.0010) [2023-12-26 07:29:22,245][123090] Updated weights for policy 1, policy_version 982255 (0.0010) [2023-12-26 07:29:22,317][123090] Updated weights for policy 1, policy_version 982265 (0.0010) [2023-12-26 07:29:22,693][123091] Updated weights for policy 0, policy_version 989047 (0.0008) [2023-12-26 07:29:22,752][123091] Updated weights for policy 0, policy_version 989057 (0.0009) [2023-12-26 07:29:22,805][123091] Updated weights for policy 0, policy_version 989067 (0.0009) [2023-12-26 07:29:23,168][123090] Updated weights for policy 1, policy_version 982275 (0.0009) [2023-12-26 07:29:23,239][123090] Updated weights for policy 1, policy_version 982285 (0.0009) [2023-12-26 07:29:23,317][123090] Updated weights for policy 1, policy_version 982295 (0.0010) [2023-12-26 07:29:23,650][123091] Updated weights for policy 0, policy_version 989077 (0.0009) [2023-12-26 07:29:23,717][123091] Updated weights for policy 0, policy_version 989087 (0.0010) [2023-12-26 07:29:23,783][123091] Updated weights for policy 0, policy_version 989097 (0.0010) [2023-12-26 07:29:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 504676352. Throughput: 0: 8868.6, 1: 9061.6. Samples: 504657124. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:23,785][121949] Avg episode reward: [(0, '6141.542'), (1, '6008.538')] [2023-12-26 07:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000982304_251469824.pth... [2023-12-26 07:29:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000981248_251199488.pth [2023-12-26 07:29:23,828][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000989104_253214720.pth... [2023-12-26 07:29:23,834][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000988048_252944384.pth [2023-12-26 07:29:23,988][123090] Updated weights for policy 1, policy_version 982305 (0.0007) [2023-12-26 07:29:24,047][123090] Updated weights for policy 1, policy_version 982315 (0.0005) [2023-12-26 07:29:24,117][123090] Updated weights for policy 1, policy_version 982325 (0.0005) [2023-12-26 07:29:24,183][123090] Updated weights for policy 1, policy_version 982335 (0.0005) [2023-12-26 07:29:24,685][123091] Updated weights for policy 0, policy_version 989107 (0.0009) [2023-12-26 07:29:24,747][123091] Updated weights for policy 0, policy_version 989117 (0.0005) [2023-12-26 07:29:24,806][123091] Updated weights for policy 0, policy_version 989127 (0.0005) [2023-12-26 07:29:24,891][123090] Updated weights for policy 1, policy_version 982345 (0.0010) [2023-12-26 07:29:24,952][123090] Updated weights for policy 1, policy_version 982355 (0.0010) [2023-12-26 07:29:25,019][123090] Updated weights for policy 1, policy_version 982365 (0.0010) [2023-12-26 07:29:25,497][123091] Updated weights for policy 0, policy_version 989137 (0.0005) [2023-12-26 07:29:25,556][123091] Updated weights for policy 0, policy_version 989147 (0.0009) [2023-12-26 07:29:25,615][123091] Updated weights for policy 0, policy_version 989157 (0.0009) [2023-12-26 07:29:25,673][123091] Updated weights for policy 0, policy_version 989167 (0.0009) [2023-12-26 07:29:25,828][123090] Updated weights for policy 1, policy_version 982375 (0.0009) [2023-12-26 07:29:25,874][123090] Updated weights for policy 1, policy_version 982385 (0.0010) [2023-12-26 07:29:25,928][123090] Updated weights for policy 1, policy_version 982395 (0.0010) [2023-12-26 07:29:26,410][123091] Updated weights for policy 0, policy_version 989177 (0.0006) [2023-12-26 07:29:26,476][123091] Updated weights for policy 0, policy_version 989187 (0.0007) [2023-12-26 07:29:26,540][123091] Updated weights for policy 0, policy_version 989197 (0.0009) [2023-12-26 07:29:26,757][123090] Updated weights for policy 1, policy_version 982405 (0.0010) [2023-12-26 07:29:26,819][123090] Updated weights for policy 1, policy_version 982415 (0.0010) [2023-12-26 07:29:26,867][123090] Updated weights for policy 1, policy_version 982425 (0.0010) [2023-12-26 07:29:27,259][123091] Updated weights for policy 0, policy_version 989207 (0.0007) [2023-12-26 07:29:27,323][123091] Updated weights for policy 0, policy_version 989217 (0.0007) [2023-12-26 07:29:27,377][123091] Updated weights for policy 0, policy_version 989227 (0.0010) [2023-12-26 07:29:27,605][123090] Updated weights for policy 1, policy_version 982435 (0.0009) [2023-12-26 07:29:27,662][123090] Updated weights for policy 1, policy_version 982445 (0.0005) [2023-12-26 07:29:27,731][123090] Updated weights for policy 1, policy_version 982455 (0.0009) [2023-12-26 07:29:28,096][123091] Updated weights for policy 0, policy_version 989237 (0.0007) [2023-12-26 07:29:28,152][123091] Updated weights for policy 0, policy_version 989247 (0.0006) [2023-12-26 07:29:28,215][123091] Updated weights for policy 0, policy_version 989257 (0.0005) [2023-12-26 07:29:28,483][123090] Updated weights for policy 1, policy_version 982465 (0.0010) [2023-12-26 07:29:28,542][123090] Updated weights for policy 1, policy_version 982475 (0.0010) [2023-12-26 07:29:28,602][123090] Updated weights for policy 1, policy_version 982485 (0.0009) [2023-12-26 07:29:28,664][123090] Updated weights for policy 1, policy_version 982495 (0.0010) [2023-12-26 07:29:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 504774656. Throughput: 0: 8903.3, 1: 9114.6. Samples: 504765836. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:28,785][121949] Avg episode reward: [(0, '6057.754'), (1, '5997.321')] [2023-12-26 07:29:28,978][123091] Updated weights for policy 0, policy_version 989267 (0.0009) [2023-12-26 07:29:29,048][123091] Updated weights for policy 0, policy_version 989277 (0.0011) [2023-12-26 07:29:29,118][123091] Updated weights for policy 0, policy_version 989287 (0.0011) [2023-12-26 07:29:29,508][123090] Updated weights for policy 1, policy_version 982505 (0.0011) [2023-12-26 07:29:29,571][123090] Updated weights for policy 1, policy_version 982515 (0.0010) [2023-12-26 07:29:29,644][123090] Updated weights for policy 1, policy_version 982525 (0.0010) [2023-12-26 07:29:29,827][123091] Updated weights for policy 0, policy_version 989297 (0.0010) [2023-12-26 07:29:29,899][123091] Updated weights for policy 0, policy_version 989307 (0.0007) [2023-12-26 07:29:29,969][123091] Updated weights for policy 0, policy_version 989317 (0.0007) [2023-12-26 07:29:30,034][123091] Updated weights for policy 0, policy_version 989327 (0.0009) [2023-12-26 07:29:30,390][123090] Updated weights for policy 1, policy_version 982535 (0.0009) [2023-12-26 07:29:30,442][123090] Updated weights for policy 1, policy_version 982545 (0.0009) [2023-12-26 07:29:30,512][123090] Updated weights for policy 1, policy_version 982555 (0.0009) [2023-12-26 07:29:30,803][123091] Updated weights for policy 0, policy_version 989337 (0.0009) [2023-12-26 07:29:30,853][123091] Updated weights for policy 0, policy_version 989347 (0.0009) [2023-12-26 07:29:30,909][123091] Updated weights for policy 0, policy_version 989357 (0.0010) [2023-12-26 07:29:31,323][123090] Updated weights for policy 1, policy_version 982565 (0.0010) [2023-12-26 07:29:31,399][123090] Updated weights for policy 1, policy_version 982575 (0.0010) [2023-12-26 07:29:31,455][123090] Updated weights for policy 1, policy_version 982585 (0.0010) [2023-12-26 07:29:31,754][123091] Updated weights for policy 0, policy_version 989367 (0.0010) [2023-12-26 07:29:31,824][123091] Updated weights for policy 0, policy_version 989377 (0.0010) [2023-12-26 07:29:31,883][123091] Updated weights for policy 0, policy_version 989387 (0.0009) [2023-12-26 07:29:32,341][123090] Updated weights for policy 1, policy_version 982595 (0.0010) [2023-12-26 07:29:32,403][123090] Updated weights for policy 1, policy_version 982605 (0.0010) [2023-12-26 07:29:32,459][123090] Updated weights for policy 1, policy_version 982615 (0.0009) [2023-12-26 07:29:32,604][123091] Updated weights for policy 0, policy_version 989397 (0.0009) [2023-12-26 07:29:32,656][123091] Updated weights for policy 0, policy_version 989407 (0.0008) [2023-12-26 07:29:32,724][123091] Updated weights for policy 0, policy_version 989417 (0.0008) [2023-12-26 07:29:33,230][123090] Updated weights for policy 1, policy_version 982625 (0.0009) [2023-12-26 07:29:33,300][123090] Updated weights for policy 1, policy_version 982635 (0.0005) [2023-12-26 07:29:33,355][123090] Updated weights for policy 1, policy_version 982645 (0.0005) [2023-12-26 07:29:33,403][123090] Updated weights for policy 1, policy_version 982655 (0.0006) [2023-12-26 07:29:33,539][123091] Updated weights for policy 0, policy_version 989427 (0.0008) [2023-12-26 07:29:33,597][123091] Updated weights for policy 0, policy_version 989437 (0.0005) [2023-12-26 07:29:33,644][123091] Updated weights for policy 0, policy_version 989447 (0.0005) [2023-12-26 07:29:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 504864768. Throughput: 0: 8893.6, 1: 9062.8. Samples: 504872716. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:33,785][121949] Avg episode reward: [(0, '6149.341'), (1, '5976.464')] [2023-12-26 07:29:34,091][123090] Updated weights for policy 1, policy_version 982665 (0.0010) [2023-12-26 07:29:34,158][123090] Updated weights for policy 1, policy_version 982675 (0.0010) [2023-12-26 07:29:34,228][123090] Updated weights for policy 1, policy_version 982685 (0.0010) [2023-12-26 07:29:34,348][123091] Updated weights for policy 0, policy_version 989457 (0.0005) [2023-12-26 07:29:34,407][123091] Updated weights for policy 0, policy_version 989467 (0.0010) [2023-12-26 07:29:34,476][123091] Updated weights for policy 0, policy_version 989477 (0.0005) [2023-12-26 07:29:34,548][123091] Updated weights for policy 0, policy_version 989487 (0.0006) [2023-12-26 07:29:35,087][123090] Updated weights for policy 1, policy_version 982695 (0.0009) [2023-12-26 07:29:35,147][123090] Updated weights for policy 1, policy_version 982705 (0.0009) [2023-12-26 07:29:35,200][123090] Updated weights for policy 1, policy_version 982715 (0.0010) [2023-12-26 07:29:35,330][123091] Updated weights for policy 0, policy_version 989497 (0.0009) [2023-12-26 07:29:35,393][123091] Updated weights for policy 0, policy_version 989507 (0.0010) [2023-12-26 07:29:35,453][123091] Updated weights for policy 0, policy_version 989517 (0.0009) [2023-12-26 07:29:36,037][123090] Updated weights for policy 1, policy_version 982725 (0.0010) [2023-12-26 07:29:36,094][123090] Updated weights for policy 1, policy_version 982735 (0.0009) [2023-12-26 07:29:36,161][123090] Updated weights for policy 1, policy_version 982745 (0.0009) [2023-12-26 07:29:36,286][123091] Updated weights for policy 0, policy_version 989527 (0.0008) [2023-12-26 07:29:36,354][123091] Updated weights for policy 0, policy_version 989537 (0.0008) [2023-12-26 07:29:36,411][123091] Updated weights for policy 0, policy_version 989547 (0.0008) [2023-12-26 07:29:37,040][123090] Updated weights for policy 1, policy_version 982755 (0.0009) [2023-12-26 07:29:37,094][123090] Updated weights for policy 1, policy_version 982765 (0.0010) [2023-12-26 07:29:37,134][123091] Updated weights for policy 0, policy_version 989557 (0.0007) [2023-12-26 07:29:37,156][123090] Updated weights for policy 1, policy_version 982775 (0.0010) [2023-12-26 07:29:37,197][123091] Updated weights for policy 0, policy_version 989567 (0.0005) [2023-12-26 07:29:37,265][123091] Updated weights for policy 0, policy_version 989577 (0.0006) [2023-12-26 07:29:37,852][123091] Updated weights for policy 0, policy_version 989587 (0.0005) [2023-12-26 07:29:37,922][123091] Updated weights for policy 0, policy_version 989597 (0.0006) [2023-12-26 07:29:37,993][123091] Updated weights for policy 0, policy_version 989607 (0.0006) [2023-12-26 07:29:38,060][123090] Updated weights for policy 1, policy_version 982785 (0.0009) [2023-12-26 07:29:38,126][123090] Updated weights for policy 1, policy_version 982795 (0.0009) [2023-12-26 07:29:38,182][123090] Updated weights for policy 1, policy_version 982805 (0.0009) [2023-12-26 07:29:38,239][123090] Updated weights for policy 1, policy_version 982815 (0.0007) [2023-12-26 07:29:38,746][123091] Updated weights for policy 0, policy_version 989617 (0.0006) [2023-12-26 07:29:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 504946688. Throughput: 0: 8933.9, 1: 9039.8. Samples: 504925632. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:38,785][121949] Avg episode reward: [(0, '6130.093'), (1, '5958.134')] [2023-12-26 07:29:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000982816_251600896.pth... [2023-12-26 07:29:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000981792_251338752.pth [2023-12-26 07:29:38,801][123091] Updated weights for policy 0, policy_version 989627 (0.0008) [2023-12-26 07:29:38,859][123091] Updated weights for policy 0, policy_version 989637 (0.0008) [2023-12-26 07:29:38,922][123091] Updated weights for policy 0, policy_version 989647 (0.0011) [2023-12-26 07:29:38,928][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000989648_253353984.pth... [2023-12-26 07:29:38,932][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000988560_253075456.pth [2023-12-26 07:29:39,138][123090] Updated weights for policy 1, policy_version 982825 (0.0008) [2023-12-26 07:29:39,202][123090] Updated weights for policy 1, policy_version 982835 (0.0009) [2023-12-26 07:29:39,269][123090] Updated weights for policy 1, policy_version 982845 (0.0009) [2023-12-26 07:29:39,780][123091] Updated weights for policy 0, policy_version 989657 (0.0009) [2023-12-26 07:29:39,848][123091] Updated weights for policy 0, policy_version 989667 (0.0009) [2023-12-26 07:29:39,922][123091] Updated weights for policy 0, policy_version 989677 (0.0009) [2023-12-26 07:29:40,168][123090] Updated weights for policy 1, policy_version 982855 (0.0009) [2023-12-26 07:29:40,229][123090] Updated weights for policy 1, policy_version 982865 (0.0009) [2023-12-26 07:29:40,291][123090] Updated weights for policy 1, policy_version 982875 (0.0009) [2023-12-26 07:29:40,753][123091] Updated weights for policy 0, policy_version 989687 (0.0007) [2023-12-26 07:29:40,809][123091] Updated weights for policy 0, policy_version 989697 (0.0009) [2023-12-26 07:29:40,865][123091] Updated weights for policy 0, policy_version 989707 (0.0009) [2023-12-26 07:29:41,119][123090] Updated weights for policy 1, policy_version 982885 (0.0010) [2023-12-26 07:29:41,183][123090] Updated weights for policy 1, policy_version 982895 (0.0006) [2023-12-26 07:29:41,251][123090] Updated weights for policy 1, policy_version 982905 (0.0008) [2023-12-26 07:29:41,749][123091] Updated weights for policy 0, policy_version 989717 (0.0010) [2023-12-26 07:29:41,813][123091] Updated weights for policy 0, policy_version 989727 (0.0011) [2023-12-26 07:29:41,876][123091] Updated weights for policy 0, policy_version 989737 (0.0011) [2023-12-26 07:29:42,076][123090] Updated weights for policy 1, policy_version 982915 (0.0009) [2023-12-26 07:29:42,141][123090] Updated weights for policy 1, policy_version 982925 (0.0009) [2023-12-26 07:29:42,209][123090] Updated weights for policy 1, policy_version 982935 (0.0009) [2023-12-26 07:29:42,703][123091] Updated weights for policy 0, policy_version 989747 (0.0009) [2023-12-26 07:29:42,764][123091] Updated weights for policy 0, policy_version 989757 (0.0007) [2023-12-26 07:29:42,830][123091] Updated weights for policy 0, policy_version 989767 (0.0008) [2023-12-26 07:29:43,074][123090] Updated weights for policy 1, policy_version 982945 (0.0009) [2023-12-26 07:29:43,126][123090] Updated weights for policy 1, policy_version 982955 (0.0009) [2023-12-26 07:29:43,178][123090] Updated weights for policy 1, policy_version 982965 (0.0009) [2023-12-26 07:29:43,235][123090] Updated weights for policy 1, policy_version 982975 (0.0009) [2023-12-26 07:29:43,637][123091] Updated weights for policy 0, policy_version 989777 (0.0008) [2023-12-26 07:29:43,695][123091] Updated weights for policy 0, policy_version 989787 (0.0006) [2023-12-26 07:29:43,743][123091] Updated weights for policy 0, policy_version 989797 (0.0005) [2023-12-26 07:29:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 505028608. Throughput: 0: 9017.4, 1: 8899.1. Samples: 505027368. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:43,784][121949] Avg episode reward: [(0, '6118.232'), (1, '5828.717')] [2023-12-26 07:29:43,787][123091] Updated weights for policy 0, policy_version 989807 (0.0005) [2023-12-26 07:29:43,998][123090] Updated weights for policy 1, policy_version 982985 (0.0006) [2023-12-26 07:29:44,063][123090] Updated weights for policy 1, policy_version 982995 (0.0005) [2023-12-26 07:29:44,128][123090] Updated weights for policy 1, policy_version 983005 (0.0005) [2023-12-26 07:29:44,538][123091] Updated weights for policy 0, policy_version 989817 (0.0008) [2023-12-26 07:29:44,601][123091] Updated weights for policy 0, policy_version 989827 (0.0009) [2023-12-26 07:29:44,660][123091] Updated weights for policy 0, policy_version 989837 (0.0005) [2023-12-26 07:29:44,835][123090] Updated weights for policy 1, policy_version 983015 (0.0008) [2023-12-26 07:29:44,904][123090] Updated weights for policy 1, policy_version 983025 (0.0009) [2023-12-26 07:29:44,966][123090] Updated weights for policy 1, policy_version 983035 (0.0010) [2023-12-26 07:29:45,302][123091] Updated weights for policy 0, policy_version 989847 (0.0005) [2023-12-26 07:29:45,353][123091] Updated weights for policy 0, policy_version 989857 (0.0005) [2023-12-26 07:29:45,401][123091] Updated weights for policy 0, policy_version 989867 (0.0006) [2023-12-26 07:29:45,807][123090] Updated weights for policy 1, policy_version 983045 (0.0010) [2023-12-26 07:29:45,866][123090] Updated weights for policy 1, policy_version 983055 (0.0010) [2023-12-26 07:29:45,910][123090] Updated weights for policy 1, policy_version 983065 (0.0010) [2023-12-26 07:29:46,136][123091] Updated weights for policy 0, policy_version 989877 (0.0007) [2023-12-26 07:29:46,187][123091] Updated weights for policy 0, policy_version 989887 (0.0008) [2023-12-26 07:29:46,235][123091] Updated weights for policy 0, policy_version 989897 (0.0009) [2023-12-26 07:29:46,716][123090] Updated weights for policy 1, policy_version 983075 (0.0010) [2023-12-26 07:29:46,771][123090] Updated weights for policy 1, policy_version 983085 (0.0010) [2023-12-26 07:29:46,819][123090] Updated weights for policy 1, policy_version 983095 (0.0010) [2023-12-26 07:29:47,053][123091] Updated weights for policy 0, policy_version 989907 (0.0008) [2023-12-26 07:29:47,120][123091] Updated weights for policy 0, policy_version 989917 (0.0005) [2023-12-26 07:29:47,167][123091] Updated weights for policy 0, policy_version 989927 (0.0005) [2023-12-26 07:29:47,683][123090] Updated weights for policy 1, policy_version 983105 (0.0010) [2023-12-26 07:29:47,760][123090] Updated weights for policy 1, policy_version 983115 (0.0006) [2023-12-26 07:29:47,770][123091] Updated weights for policy 0, policy_version 989937 (0.0005) [2023-12-26 07:29:47,822][123091] Updated weights for policy 0, policy_version 989947 (0.0005) [2023-12-26 07:29:47,823][123090] Updated weights for policy 1, policy_version 983125 (0.0008) [2023-12-26 07:29:47,884][123091] Updated weights for policy 0, policy_version 989957 (0.0007) [2023-12-26 07:29:47,894][123090] Updated weights for policy 1, policy_version 983135 (0.0009) [2023-12-26 07:29:47,951][123091] Updated weights for policy 0, policy_version 989967 (0.0009) [2023-12-26 07:29:48,670][123091] Updated weights for policy 0, policy_version 989977 (0.0006) [2023-12-26 07:29:48,738][123091] Updated weights for policy 0, policy_version 989987 (0.0007) [2023-12-26 07:29:48,772][123090] Updated weights for policy 1, policy_version 983145 (0.0008) [2023-12-26 07:29:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 505118720. Throughput: 0: 9134.2, 1: 8866.1. Samples: 505138028. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:48,784][121949] Avg episode reward: [(0, '6144.488'), (1, '5674.826')] [2023-12-26 07:29:48,804][123091] Updated weights for policy 0, policy_version 989997 (0.0006) [2023-12-26 07:29:48,827][123090] Updated weights for policy 1, policy_version 983155 (0.0009) [2023-12-26 07:29:48,880][123090] Updated weights for policy 1, policy_version 983165 (0.0010) [2023-12-26 07:29:49,452][123091] Updated weights for policy 0, policy_version 990007 (0.0008) [2023-12-26 07:29:49,521][123091] Updated weights for policy 0, policy_version 990017 (0.0005) [2023-12-26 07:29:49,589][123091] Updated weights for policy 0, policy_version 990027 (0.0010) [2023-12-26 07:29:49,806][123090] Updated weights for policy 1, policy_version 983175 (0.0009) [2023-12-26 07:29:49,867][123090] Updated weights for policy 1, policy_version 983185 (0.0009) [2023-12-26 07:29:49,932][123090] Updated weights for policy 1, policy_version 983195 (0.0009) [2023-12-26 07:29:50,379][123091] Updated weights for policy 0, policy_version 990037 (0.0010) [2023-12-26 07:29:50,449][123091] Updated weights for policy 0, policy_version 990047 (0.0011) [2023-12-26 07:29:50,513][123091] Updated weights for policy 0, policy_version 990057 (0.0009) [2023-12-26 07:29:50,747][123090] Updated weights for policy 1, policy_version 983205 (0.0010) [2023-12-26 07:29:50,814][123090] Updated weights for policy 1, policy_version 983215 (0.0008) [2023-12-26 07:29:50,890][123090] Updated weights for policy 1, policy_version 983225 (0.0005) [2023-12-26 07:29:51,221][123091] Updated weights for policy 0, policy_version 990067 (0.0007) [2023-12-26 07:29:51,288][123091] Updated weights for policy 0, policy_version 990077 (0.0010) [2023-12-26 07:29:51,358][123091] Updated weights for policy 0, policy_version 990087 (0.0009) [2023-12-26 07:29:51,689][123090] Updated weights for policy 1, policy_version 983235 (0.0006) [2023-12-26 07:29:51,759][123090] Updated weights for policy 1, policy_version 983245 (0.0009) [2023-12-26 07:29:51,814][123090] Updated weights for policy 1, policy_version 983255 (0.0009) [2023-12-26 07:29:52,099][123091] Updated weights for policy 0, policy_version 990097 (0.0010) [2023-12-26 07:29:52,166][123091] Updated weights for policy 0, policy_version 990107 (0.0011) [2023-12-26 07:29:52,228][123091] Updated weights for policy 0, policy_version 990117 (0.0010) [2023-12-26 07:29:52,298][123091] Updated weights for policy 0, policy_version 990127 (0.0011) [2023-12-26 07:29:52,683][123090] Updated weights for policy 1, policy_version 983265 (0.0010) [2023-12-26 07:29:52,745][123090] Updated weights for policy 1, policy_version 983275 (0.0010) [2023-12-26 07:29:52,807][123090] Updated weights for policy 1, policy_version 983285 (0.0009) [2023-12-26 07:29:52,859][123090] Updated weights for policy 1, policy_version 983295 (0.0009) [2023-12-26 07:29:53,044][123091] Updated weights for policy 0, policy_version 990137 (0.0006) [2023-12-26 07:29:53,104][123091] Updated weights for policy 0, policy_version 990147 (0.0005) [2023-12-26 07:29:53,172][123091] Updated weights for policy 0, policy_version 990157 (0.0005) [2023-12-26 07:29:53,732][123090] Updated weights for policy 1, policy_version 983305 (0.0010) [2023-12-26 07:29:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 505208832. Throughput: 0: 9123.1, 1: 8787.3. Samples: 505190800. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:53,785][121949] Avg episode reward: [(0, '6149.682'), (1, '5680.738')] [2023-12-26 07:29:53,785][123091] Updated weights for policy 0, policy_version 990167 (0.0005) [2023-12-26 07:29:53,796][123090] Updated weights for policy 1, policy_version 983315 (0.0010) [2023-12-26 07:29:53,848][123091] Updated weights for policy 0, policy_version 990177 (0.0005) [2023-12-26 07:29:53,855][123090] Updated weights for policy 1, policy_version 983325 (0.0009) [2023-12-26 07:29:53,867][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000983328_251731968.pth... [2023-12-26 07:29:53,870][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000982304_251469824.pth [2023-12-26 07:29:53,900][123091] Updated weights for policy 0, policy_version 990187 (0.0005) [2023-12-26 07:29:53,930][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000990192_253493248.pth... [2023-12-26 07:29:53,935][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000989104_253214720.pth [2023-12-26 07:29:54,529][123091] Updated weights for policy 0, policy_version 990197 (0.0008) [2023-12-26 07:29:54,584][123091] Updated weights for policy 0, policy_version 990207 (0.0010) [2023-12-26 07:29:54,647][123091] Updated weights for policy 0, policy_version 990218 (0.0010) [2023-12-26 07:29:54,715][123090] Updated weights for policy 1, policy_version 983335 (0.0008) [2023-12-26 07:29:54,768][123090] Updated weights for policy 1, policy_version 983345 (0.0009) [2023-12-26 07:29:54,817][123090] Updated weights for policy 1, policy_version 983355 (0.0008) [2023-12-26 07:29:55,475][123091] Updated weights for policy 0, policy_version 990228 (0.0008) [2023-12-26 07:29:55,538][123091] Updated weights for policy 0, policy_version 990238 (0.0006) [2023-12-26 07:29:55,598][123091] Updated weights for policy 0, policy_version 990248 (0.0005) [2023-12-26 07:29:55,696][123090] Updated weights for policy 1, policy_version 983365 (0.0009) [2023-12-26 07:29:55,753][123090] Updated weights for policy 1, policy_version 983375 (0.0009) [2023-12-26 07:29:55,806][123090] Updated weights for policy 1, policy_version 983385 (0.0010) [2023-12-26 07:29:56,299][123091] Updated weights for policy 0, policy_version 990258 (0.0005) [2023-12-26 07:29:56,355][123091] Updated weights for policy 0, policy_version 990268 (0.0005) [2023-12-26 07:29:56,423][123091] Updated weights for policy 0, policy_version 990278 (0.0005) [2023-12-26 07:29:56,475][123091] Updated weights for policy 0, policy_version 990288 (0.0005) [2023-12-26 07:29:56,720][123090] Updated weights for policy 1, policy_version 983396 (0.0010) [2023-12-26 07:29:56,774][123090] Updated weights for policy 1, policy_version 983407 (0.0010) [2023-12-26 07:29:56,828][123090] Updated weights for policy 1, policy_version 983418 (0.0010) [2023-12-26 07:29:57,104][123091] Updated weights for policy 0, policy_version 990298 (0.0005) [2023-12-26 07:29:57,158][123091] Updated weights for policy 0, policy_version 990308 (0.0005) [2023-12-26 07:29:57,203][123091] Updated weights for policy 0, policy_version 990318 (0.0005) [2023-12-26 07:29:57,669][123090] Updated weights for policy 1, policy_version 983429 (0.0010) [2023-12-26 07:29:57,727][123090] Updated weights for policy 1, policy_version 983441 (0.0010) [2023-12-26 07:29:57,795][123090] Updated weights for policy 1, policy_version 983451 (0.0010) [2023-12-26 07:29:57,901][123091] Updated weights for policy 0, policy_version 990328 (0.0006) [2023-12-26 07:29:57,953][123091] Updated weights for policy 0, policy_version 990338 (0.0009) [2023-12-26 07:29:58,004][123091] Updated weights for policy 0, policy_version 990348 (0.0009) [2023-12-26 07:29:58,695][123090] Updated weights for policy 1, policy_version 983461 (0.0009) [2023-12-26 07:29:58,766][123090] Updated weights for policy 1, policy_version 983471 (0.0009) [2023-12-26 07:29:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 505298944. Throughput: 0: 9265.2, 1: 8692.1. Samples: 505300400. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:29:58,785][121949] Avg episode reward: [(0, '6221.035'), (1, '5787.100')] [2023-12-26 07:29:58,828][123090] Updated weights for policy 1, policy_version 983481 (0.0009) [2023-12-26 07:29:58,872][123091] Updated weights for policy 0, policy_version 990358 (0.0008) [2023-12-26 07:29:58,926][123091] Updated weights for policy 0, policy_version 990368 (0.0009) [2023-12-26 07:29:58,974][123091] Updated weights for policy 0, policy_version 990378 (0.0009) [2023-12-26 07:29:59,698][123090] Updated weights for policy 1, policy_version 983491 (0.0009) [2023-12-26 07:29:59,747][123090] Updated weights for policy 1, policy_version 983501 (0.0009) [2023-12-26 07:29:59,821][123090] Updated weights for policy 1, policy_version 983511 (0.0009) [2023-12-26 07:29:59,858][123091] Updated weights for policy 0, policy_version 990388 (0.0009) [2023-12-26 07:29:59,925][123091] Updated weights for policy 0, policy_version 990398 (0.0009) [2023-12-26 07:29:59,997][123091] Updated weights for policy 0, policy_version 990408 (0.0009) [2023-12-26 07:30:00,683][123090] Updated weights for policy 1, policy_version 983521 (0.0008) [2023-12-26 07:30:00,736][123090] Updated weights for policy 1, policy_version 983531 (0.0009) [2023-12-26 07:30:00,762][123091] Updated weights for policy 0, policy_version 990418 (0.0010) [2023-12-26 07:30:00,787][123090] Updated weights for policy 1, policy_version 983541 (0.0007) [2023-12-26 07:30:00,817][123091] Updated weights for policy 0, policy_version 990428 (0.0010) [2023-12-26 07:30:00,833][123090] Updated weights for policy 1, policy_version 983551 (0.0007) [2023-12-26 07:30:00,867][123091] Updated weights for policy 0, policy_version 990438 (0.0010) [2023-12-26 07:30:00,925][123091] Updated weights for policy 0, policy_version 990448 (0.0010) [2023-12-26 07:30:01,675][123091] Updated weights for policy 0, policy_version 990458 (0.0010) [2023-12-26 07:30:01,741][123090] Updated weights for policy 1, policy_version 983561 (0.0009) [2023-12-26 07:30:01,748][123091] Updated weights for policy 0, policy_version 990468 (0.0009) [2023-12-26 07:30:01,802][123090] Updated weights for policy 1, policy_version 983571 (0.0007) [2023-12-26 07:30:01,808][123091] Updated weights for policy 0, policy_version 990478 (0.0010) [2023-12-26 07:30:01,859][123090] Updated weights for policy 1, policy_version 983581 (0.0009) [2023-12-26 07:30:02,574][123091] Updated weights for policy 0, policy_version 990488 (0.0010) [2023-12-26 07:30:02,644][123091] Updated weights for policy 0, policy_version 990498 (0.0009) [2023-12-26 07:30:02,700][123090] Updated weights for policy 1, policy_version 983591 (0.0007) [2023-12-26 07:30:02,709][123091] Updated weights for policy 0, policy_version 990508 (0.0009) [2023-12-26 07:30:02,757][123090] Updated weights for policy 1, policy_version 983601 (0.0010) [2023-12-26 07:30:02,820][123090] Updated weights for policy 1, policy_version 983611 (0.0009) [2023-12-26 07:30:03,479][123091] Updated weights for policy 0, policy_version 990518 (0.0007) [2023-12-26 07:30:03,545][123091] Updated weights for policy 0, policy_version 990528 (0.0007) [2023-12-26 07:30:03,603][123090] Updated weights for policy 1, policy_version 983621 (0.0009) [2023-12-26 07:30:03,611][123091] Updated weights for policy 0, policy_version 990538 (0.0008) [2023-12-26 07:30:03,662][123090] Updated weights for policy 1, policy_version 983631 (0.0007) [2023-12-26 07:30:03,720][123090] Updated weights for policy 1, policy_version 983641 (0.0009) [2023-12-26 07:30:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 505397248. Throughput: 0: 9218.8, 1: 8528.0. Samples: 505402956. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:03,785][121949] Avg episode reward: [(0, '6151.251'), (1, '5768.788')] [2023-12-26 07:30:04,334][123091] Updated weights for policy 0, policy_version 990548 (0.0008) [2023-12-26 07:30:04,405][123091] Updated weights for policy 0, policy_version 990558 (0.0010) [2023-12-26 07:30:04,469][123090] Updated weights for policy 1, policy_version 983651 (0.0010) [2023-12-26 07:30:04,470][123091] Updated weights for policy 0, policy_version 990568 (0.0009) [2023-12-26 07:30:04,531][123090] Updated weights for policy 1, policy_version 983661 (0.0006) [2023-12-26 07:30:04,604][123090] Updated weights for policy 1, policy_version 983671 (0.0005) [2023-12-26 07:30:05,131][123091] Updated weights for policy 0, policy_version 990578 (0.0006) [2023-12-26 07:30:05,199][123091] Updated weights for policy 0, policy_version 990588 (0.0005) [2023-12-26 07:30:05,264][123091] Updated weights for policy 0, policy_version 990598 (0.0009) [2023-12-26 07:30:05,279][123090] Updated weights for policy 1, policy_version 983681 (0.0005) [2023-12-26 07:30:05,323][123091] Updated weights for policy 0, policy_version 990608 (0.0007) [2023-12-26 07:30:05,343][123090] Updated weights for policy 1, policy_version 983691 (0.0006) [2023-12-26 07:30:05,406][123090] Updated weights for policy 1, policy_version 983701 (0.0005) [2023-12-26 07:30:05,457][123090] Updated weights for policy 1, policy_version 983711 (0.0005) [2023-12-26 07:30:06,012][123091] Updated weights for policy 0, policy_version 990618 (0.0006) [2023-12-26 07:30:06,071][123091] Updated weights for policy 0, policy_version 990628 (0.0006) [2023-12-26 07:30:06,135][123091] Updated weights for policy 0, policy_version 990638 (0.0008) [2023-12-26 07:30:06,297][123090] Updated weights for policy 1, policy_version 983721 (0.0006) [2023-12-26 07:30:06,361][123090] Updated weights for policy 1, policy_version 983731 (0.0008) [2023-12-26 07:30:06,430][123090] Updated weights for policy 1, policy_version 983741 (0.0011) [2023-12-26 07:30:06,923][123091] Updated weights for policy 0, policy_version 990648 (0.0011) [2023-12-26 07:30:06,988][123091] Updated weights for policy 0, policy_version 990658 (0.0011) [2023-12-26 07:30:07,054][123091] Updated weights for policy 0, policy_version 990668 (0.0011) [2023-12-26 07:30:07,234][123090] Updated weights for policy 1, policy_version 983751 (0.0009) [2023-12-26 07:30:07,302][123090] Updated weights for policy 1, policy_version 983761 (0.0009) [2023-12-26 07:30:07,355][123090] Updated weights for policy 1, policy_version 983771 (0.0011) [2023-12-26 07:30:07,812][123091] Updated weights for policy 0, policy_version 990678 (0.0007) [2023-12-26 07:30:07,860][123091] Updated weights for policy 0, policy_version 990688 (0.0007) [2023-12-26 07:30:07,920][123091] Updated weights for policy 0, policy_version 990698 (0.0007) [2023-12-26 07:30:08,051][123090] Updated weights for policy 1, policy_version 983781 (0.0010) [2023-12-26 07:30:08,116][123090] Updated weights for policy 1, policy_version 983791 (0.0010) [2023-12-26 07:30:08,184][123090] Updated weights for policy 1, policy_version 983801 (0.0009) [2023-12-26 07:30:08,753][123091] Updated weights for policy 0, policy_version 990708 (0.0008) [2023-12-26 07:30:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 505479168. Throughput: 0: 9264.6, 1: 8565.3. Samples: 505459468. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:08,785][121949] Avg episode reward: [(0, '6245.641'), (1, '5863.856')] [2023-12-26 07:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000983808_251854848.pth... [2023-12-26 07:30:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000982816_251600896.pth [2023-12-26 07:30:08,824][123091] Updated weights for policy 0, policy_version 990718 (0.0010) [2023-12-26 07:30:08,884][123091] Updated weights for policy 0, policy_version 990728 (0.0010) [2023-12-26 07:30:08,929][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000990736_253632512.pth... [2023-12-26 07:30:08,932][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000989648_253353984.pth [2023-12-26 07:30:08,943][123090] Updated weights for policy 1, policy_version 983811 (0.0011) [2023-12-26 07:30:09,007][123090] Updated weights for policy 1, policy_version 983821 (0.0011) [2023-12-26 07:30:09,072][123090] Updated weights for policy 1, policy_version 983831 (0.0011) [2023-12-26 07:30:09,719][123091] Updated weights for policy 0, policy_version 990738 (0.0009) [2023-12-26 07:30:09,785][123091] Updated weights for policy 0, policy_version 990748 (0.0009) [2023-12-26 07:30:09,852][123091] Updated weights for policy 0, policy_version 990758 (0.0009) [2023-12-26 07:30:09,921][123091] Updated weights for policy 0, policy_version 990768 (0.0009) [2023-12-26 07:30:09,959][123090] Updated weights for policy 1, policy_version 983841 (0.0011) [2023-12-26 07:30:10,033][123090] Updated weights for policy 1, policy_version 983851 (0.0011) [2023-12-26 07:30:10,101][123090] Updated weights for policy 1, policy_version 983861 (0.0011) [2023-12-26 07:30:10,181][123090] Updated weights for policy 1, policy_version 983871 (0.0010) [2023-12-26 07:30:10,770][123091] Updated weights for policy 0, policy_version 990778 (0.0010) [2023-12-26 07:30:10,827][123091] Updated weights for policy 0, policy_version 990788 (0.0009) [2023-12-26 07:30:10,881][123091] Updated weights for policy 0, policy_version 990798 (0.0009) [2023-12-26 07:30:10,999][123090] Updated weights for policy 1, policy_version 983881 (0.0010) [2023-12-26 07:30:11,079][123090] Updated weights for policy 1, policy_version 983891 (0.0007) [2023-12-26 07:30:11,146][123090] Updated weights for policy 1, policy_version 983901 (0.0007) [2023-12-26 07:30:11,794][123091] Updated weights for policy 0, policy_version 990808 (0.0010) [2023-12-26 07:30:11,850][123091] Updated weights for policy 0, policy_version 990818 (0.0010) [2023-12-26 07:30:11,909][123091] Updated weights for policy 0, policy_version 990828 (0.0011) [2023-12-26 07:30:11,976][123090] Updated weights for policy 1, policy_version 983911 (0.0009) [2023-12-26 07:30:12,038][123090] Updated weights for policy 1, policy_version 983921 (0.0009) [2023-12-26 07:30:12,104][123090] Updated weights for policy 1, policy_version 983931 (0.0009) [2023-12-26 07:30:12,834][123091] Updated weights for policy 0, policy_version 990838 (0.0011) [2023-12-26 07:30:12,893][123091] Updated weights for policy 0, policy_version 990848 (0.0011) [2023-12-26 07:30:12,948][123091] Updated weights for policy 0, policy_version 990858 (0.0007) [2023-12-26 07:30:13,017][123090] Updated weights for policy 1, policy_version 983941 (0.0010) [2023-12-26 07:30:13,073][123090] Updated weights for policy 1, policy_version 983951 (0.0010) [2023-12-26 07:30:13,128][123090] Updated weights for policy 1, policy_version 983961 (0.0010) [2023-12-26 07:30:13,609][123091] Updated weights for policy 0, policy_version 990868 (0.0005) [2023-12-26 07:30:13,676][123091] Updated weights for policy 0, policy_version 990878 (0.0008) [2023-12-26 07:30:13,734][123091] Updated weights for policy 0, policy_version 990888 (0.0008) [2023-12-26 07:30:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 505569280. Throughput: 0: 9179.3, 1: 8483.5. Samples: 505560660. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:13,784][121949] Avg episode reward: [(0, '6218.203'), (1, '5861.839')] [2023-12-26 07:30:13,960][123090] Updated weights for policy 1, policy_version 983971 (0.0009) [2023-12-26 07:30:14,007][123090] Updated weights for policy 1, policy_version 983981 (0.0005) [2023-12-26 07:30:14,055][123090] Updated weights for policy 1, policy_version 983991 (0.0005) [2023-12-26 07:30:14,425][123091] Updated weights for policy 0, policy_version 990898 (0.0007) [2023-12-26 07:30:14,488][123091] Updated weights for policy 0, policy_version 990908 (0.0006) [2023-12-26 07:30:14,544][123091] Updated weights for policy 0, policy_version 990918 (0.0007) [2023-12-26 07:30:14,594][123091] Updated weights for policy 0, policy_version 990928 (0.0006) [2023-12-26 07:30:14,848][123090] Updated weights for policy 1, policy_version 984001 (0.0006) [2023-12-26 07:30:14,908][123090] Updated weights for policy 1, policy_version 984011 (0.0010) [2023-12-26 07:30:14,981][123090] Updated weights for policy 1, policy_version 984021 (0.0011) [2023-12-26 07:30:15,051][123090] Updated weights for policy 1, policy_version 984031 (0.0011) [2023-12-26 07:30:15,397][123091] Updated weights for policy 0, policy_version 990938 (0.0006) [2023-12-26 07:30:15,465][123091] Updated weights for policy 0, policy_version 990948 (0.0008) [2023-12-26 07:30:15,533][123091] Updated weights for policy 0, policy_version 990958 (0.0006) [2023-12-26 07:30:15,892][123090] Updated weights for policy 1, policy_version 984041 (0.0011) [2023-12-26 07:30:15,945][123090] Updated weights for policy 1, policy_version 984051 (0.0011) [2023-12-26 07:30:15,994][123090] Updated weights for policy 1, policy_version 984061 (0.0011) [2023-12-26 07:30:16,324][123091] Updated weights for policy 0, policy_version 990968 (0.0006) [2023-12-26 07:30:16,387][123091] Updated weights for policy 0, policy_version 990978 (0.0006) [2023-12-26 07:30:16,444][123091] Updated weights for policy 0, policy_version 990988 (0.0006) [2023-12-26 07:30:16,800][123090] Updated weights for policy 1, policy_version 984071 (0.0011) [2023-12-26 07:30:16,857][123090] Updated weights for policy 1, policy_version 984081 (0.0011) [2023-12-26 07:30:16,913][123090] Updated weights for policy 1, policy_version 984091 (0.0011) [2023-12-26 07:30:17,225][123091] Updated weights for policy 0, policy_version 990998 (0.0008) [2023-12-26 07:30:17,285][123091] Updated weights for policy 0, policy_version 991008 (0.0009) [2023-12-26 07:30:17,358][123091] Updated weights for policy 0, policy_version 991018 (0.0005) [2023-12-26 07:30:17,779][123090] Updated weights for policy 1, policy_version 984101 (0.0008) [2023-12-26 07:30:17,847][123090] Updated weights for policy 1, policy_version 984111 (0.0005) [2023-12-26 07:30:17,919][123090] Updated weights for policy 1, policy_version 984121 (0.0005) [2023-12-26 07:30:18,065][123091] Updated weights for policy 0, policy_version 991028 (0.0008) [2023-12-26 07:30:18,128][123091] Updated weights for policy 0, policy_version 991038 (0.0009) [2023-12-26 07:30:18,193][123091] Updated weights for policy 0, policy_version 991048 (0.0010) [2023-12-26 07:30:18,714][123090] Updated weights for policy 1, policy_version 984131 (0.0007) [2023-12-26 07:30:18,776][123090] Updated weights for policy 1, policy_version 984141 (0.0010) [2023-12-26 07:30:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 505651200. Throughput: 0: 9197.3, 1: 8465.2. Samples: 505667524. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:18,784][121949] Avg episode reward: [(0, '6040.129'), (1, '5687.191')] [2023-12-26 07:30:18,839][123090] Updated weights for policy 1, policy_version 984151 (0.0010) [2023-12-26 07:30:19,046][123091] Updated weights for policy 0, policy_version 991058 (0.0010) [2023-12-26 07:30:19,106][123091] Updated weights for policy 0, policy_version 991068 (0.0009) [2023-12-26 07:30:19,166][123091] Updated weights for policy 0, policy_version 991078 (0.0010) [2023-12-26 07:30:19,233][123091] Updated weights for policy 0, policy_version 991088 (0.0010) [2023-12-26 07:30:19,665][123090] Updated weights for policy 1, policy_version 984161 (0.0011) [2023-12-26 07:30:19,720][123090] Updated weights for policy 1, policy_version 984171 (0.0010) [2023-12-26 07:30:19,778][123090] Updated weights for policy 1, policy_version 984181 (0.0010) [2023-12-26 07:30:19,845][123090] Updated weights for policy 1, policy_version 984191 (0.0009) [2023-12-26 07:30:20,068][123091] Updated weights for policy 0, policy_version 991098 (0.0009) [2023-12-26 07:30:20,134][123091] Updated weights for policy 0, policy_version 991108 (0.0009) [2023-12-26 07:30:20,185][123091] Updated weights for policy 0, policy_version 991118 (0.0009) [2023-12-26 07:30:20,681][123090] Updated weights for policy 1, policy_version 984201 (0.0010) [2023-12-26 07:30:20,753][123090] Updated weights for policy 1, policy_version 984211 (0.0007) [2023-12-26 07:30:20,821][123090] Updated weights for policy 1, policy_version 984221 (0.0009) [2023-12-26 07:30:21,127][123091] Updated weights for policy 0, policy_version 991128 (0.0010) [2023-12-26 07:30:21,194][123091] Updated weights for policy 0, policy_version 991138 (0.0010) [2023-12-26 07:30:21,261][123091] Updated weights for policy 0, policy_version 991148 (0.0009) [2023-12-26 07:30:21,688][123090] Updated weights for policy 1, policy_version 984231 (0.0009) [2023-12-26 07:30:21,762][123090] Updated weights for policy 1, policy_version 984241 (0.0010) [2023-12-26 07:30:21,826][123090] Updated weights for policy 1, policy_version 984251 (0.0009) [2023-12-26 07:30:22,128][123091] Updated weights for policy 0, policy_version 991158 (0.0010) [2023-12-26 07:30:22,182][123091] Updated weights for policy 0, policy_version 991168 (0.0009) [2023-12-26 07:30:22,234][123091] Updated weights for policy 0, policy_version 991178 (0.0010) [2023-12-26 07:30:22,681][123090] Updated weights for policy 1, policy_version 984261 (0.0010) [2023-12-26 07:30:22,747][123090] Updated weights for policy 1, policy_version 984271 (0.0009) [2023-12-26 07:30:22,799][123090] Updated weights for policy 1, policy_version 984281 (0.0009) [2023-12-26 07:30:23,025][123091] Updated weights for policy 0, policy_version 991188 (0.0010) [2023-12-26 07:30:23,079][123091] Updated weights for policy 0, policy_version 991198 (0.0010) [2023-12-26 07:30:23,137][123091] Updated weights for policy 0, policy_version 991208 (0.0010) [2023-12-26 07:30:23,595][123090] Updated weights for policy 1, policy_version 984291 (0.0010) [2023-12-26 07:30:23,662][123090] Updated weights for policy 1, policy_version 984301 (0.0008) [2023-12-26 07:30:23,733][123090] Updated weights for policy 1, policy_version 984311 (0.0005) [2023-12-26 07:30:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 505733120. Throughput: 0: 9126.6, 1: 8457.3. Samples: 505716908. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:23,785][121949] Avg episode reward: [(0, '6003.504'), (1, '5748.510')] [2023-12-26 07:30:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000991216_253755392.pth... [2023-12-26 07:30:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000984320_251985920.pth... [2023-12-26 07:30:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000983328_251731968.pth [2023-12-26 07:30:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000990192_253493248.pth [2023-12-26 07:30:23,993][123091] Updated weights for policy 0, policy_version 991218 (0.0009) [2023-12-26 07:30:24,049][123091] Updated weights for policy 0, policy_version 991228 (0.0009) [2023-12-26 07:30:24,109][123091] Updated weights for policy 0, policy_version 991238 (0.0009) [2023-12-26 07:30:24,170][123091] Updated weights for policy 0, policy_version 991248 (0.0009) [2023-12-26 07:30:24,481][123090] Updated weights for policy 1, policy_version 984321 (0.0007) [2023-12-26 07:30:24,539][123090] Updated weights for policy 1, policy_version 984331 (0.0009) [2023-12-26 07:30:24,602][123090] Updated weights for policy 1, policy_version 984341 (0.0009) [2023-12-26 07:30:24,652][123090] Updated weights for policy 1, policy_version 984351 (0.0009) [2023-12-26 07:30:25,004][123091] Updated weights for policy 0, policy_version 991258 (0.0006) [2023-12-26 07:30:25,058][123091] Updated weights for policy 0, policy_version 991268 (0.0005) [2023-12-26 07:30:25,114][123091] Updated weights for policy 0, policy_version 991278 (0.0005) [2023-12-26 07:30:25,542][123090] Updated weights for policy 1, policy_version 984361 (0.0009) [2023-12-26 07:30:25,603][123090] Updated weights for policy 1, policy_version 984371 (0.0010) [2023-12-26 07:30:25,659][123090] Updated weights for policy 1, policy_version 984381 (0.0009) [2023-12-26 07:30:25,824][123091] Updated weights for policy 0, policy_version 991288 (0.0009) [2023-12-26 07:30:25,882][123091] Updated weights for policy 0, policy_version 991298 (0.0010) [2023-12-26 07:30:25,939][123091] Updated weights for policy 0, policy_version 991308 (0.0010) [2023-12-26 07:30:26,393][123090] Updated weights for policy 1, policy_version 984391 (0.0009) [2023-12-26 07:30:26,461][123090] Updated weights for policy 1, policy_version 984401 (0.0009) [2023-12-26 07:30:26,519][123090] Updated weights for policy 1, policy_version 984411 (0.0009) [2023-12-26 07:30:26,791][123091] Updated weights for policy 0, policy_version 991318 (0.0009) [2023-12-26 07:30:26,852][123091] Updated weights for policy 0, policy_version 991328 (0.0010) [2023-12-26 07:30:26,915][123091] Updated weights for policy 0, policy_version 991338 (0.0010) [2023-12-26 07:30:27,299][123090] Updated weights for policy 1, policy_version 984421 (0.0010) [2023-12-26 07:30:27,358][123090] Updated weights for policy 1, policy_version 984431 (0.0009) [2023-12-26 07:30:27,415][123090] Updated weights for policy 1, policy_version 984441 (0.0008) [2023-12-26 07:30:27,787][123091] Updated weights for policy 0, policy_version 991348 (0.0009) [2023-12-26 07:30:27,849][123091] Updated weights for policy 0, policy_version 991358 (0.0009) [2023-12-26 07:30:27,906][123091] Updated weights for policy 0, policy_version 991368 (0.0009) [2023-12-26 07:30:28,142][123090] Updated weights for policy 1, policy_version 984451 (0.0009) [2023-12-26 07:30:28,214][123090] Updated weights for policy 1, policy_version 984461 (0.0009) [2023-12-26 07:30:28,280][123090] Updated weights for policy 1, policy_version 984471 (0.0009) [2023-12-26 07:30:28,685][123091] Updated weights for policy 0, policy_version 991378 (0.0009) [2023-12-26 07:30:28,741][123091] Updated weights for policy 0, policy_version 991388 (0.0010) [2023-12-26 07:30:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 505823232. Throughput: 0: 9098.2, 1: 8535.7. Samples: 505820896. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 07:30:28,785][121949] Avg episode reward: [(0, '5909.427'), (1, '5857.424')] [2023-12-26 07:30:28,804][123091] Updated weights for policy 0, policy_version 991398 (0.0010) [2023-12-26 07:30:28,863][123091] Updated weights for policy 0, policy_version 991408 (0.0010) [2023-12-26 07:30:29,076][123090] Updated weights for policy 1, policy_version 984481 (0.0009) [2023-12-26 07:30:29,140][123090] Updated weights for policy 1, policy_version 984491 (0.0009) [2023-12-26 07:30:29,206][123090] Updated weights for policy 1, policy_version 984501 (0.0008) [2023-12-26 07:30:29,276][123090] Updated weights for policy 1, policy_version 984511 (0.0009) [2023-12-26 07:30:29,688][123091] Updated weights for policy 0, policy_version 991418 (0.0010) [2023-12-26 07:30:29,752][123091] Updated weights for policy 0, policy_version 991428 (0.0010) [2023-12-26 07:30:29,818][123091] Updated weights for policy 0, policy_version 991438 (0.0011) [2023-12-26 07:30:30,158][123090] Updated weights for policy 1, policy_version 984521 (0.0008) [2023-12-26 07:30:30,221][123090] Updated weights for policy 1, policy_version 984531 (0.0007) [2023-12-26 07:30:30,277][123090] Updated weights for policy 1, policy_version 984541 (0.0006) [2023-12-26 07:30:30,569][123091] Updated weights for policy 0, policy_version 991448 (0.0010) [2023-12-26 07:30:30,632][123091] Updated weights for policy 0, policy_version 991458 (0.0010) [2023-12-26 07:30:30,704][123091] Updated weights for policy 0, policy_version 991468 (0.0006) [2023-12-26 07:30:30,969][123090] Updated weights for policy 1, policy_version 984551 (0.0005) [2023-12-26 07:30:31,030][123090] Updated weights for policy 1, policy_version 984561 (0.0006) [2023-12-26 07:30:31,092][123090] Updated weights for policy 1, policy_version 984571 (0.0009) [2023-12-26 07:30:31,501][123091] Updated weights for policy 0, policy_version 991478 (0.0005) [2023-12-26 07:30:31,552][123091] Updated weights for policy 0, policy_version 991488 (0.0005) [2023-12-26 07:30:31,607][123091] Updated weights for policy 0, policy_version 991498 (0.0005) [2023-12-26 07:30:31,898][123090] Updated weights for policy 1, policy_version 984581 (0.0010) [2023-12-26 07:30:31,971][123090] Updated weights for policy 1, policy_version 984591 (0.0010) [2023-12-26 07:30:32,018][123090] Updated weights for policy 1, policy_version 984601 (0.0010) [2023-12-26 07:30:32,361][123091] Updated weights for policy 0, policy_version 991508 (0.0008) [2023-12-26 07:30:32,424][123091] Updated weights for policy 0, policy_version 991518 (0.0009) [2023-12-26 07:30:32,488][123091] Updated weights for policy 0, policy_version 991528 (0.0011) [2023-12-26 07:30:32,870][123090] Updated weights for policy 1, policy_version 984611 (0.0009) [2023-12-26 07:30:32,926][123090] Updated weights for policy 1, policy_version 984621 (0.0005) [2023-12-26 07:30:32,981][123090] Updated weights for policy 1, policy_version 984631 (0.0005) [2023-12-26 07:30:33,238][123091] Updated weights for policy 0, policy_version 991538 (0.0010) [2023-12-26 07:30:33,307][123091] Updated weights for policy 0, policy_version 991548 (0.0007) [2023-12-26 07:30:33,365][123091] Updated weights for policy 0, policy_version 991558 (0.0005) [2023-12-26 07:30:33,438][123091] Updated weights for policy 0, policy_version 991568 (0.0008) [2023-12-26 07:30:33,743][123090] Updated weights for policy 1, policy_version 984641 (0.0006) [2023-12-26 07:30:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 505913344. Throughput: 0: 9006.0, 1: 8568.1. Samples: 505928864. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:33,785][121949] Avg episode reward: [(0, '5946.225'), (1, '5958.777')] [2023-12-26 07:30:33,805][123090] Updated weights for policy 1, policy_version 984651 (0.0010) [2023-12-26 07:30:33,864][123090] Updated weights for policy 1, policy_version 984661 (0.0010) [2023-12-26 07:30:33,930][123090] Updated weights for policy 1, policy_version 984671 (0.0010) [2023-12-26 07:30:34,087][123091] Updated weights for policy 0, policy_version 991578 (0.0005) [2023-12-26 07:30:34,147][123091] Updated weights for policy 0, policy_version 991588 (0.0006) [2023-12-26 07:30:34,207][123091] Updated weights for policy 0, policy_version 991598 (0.0009) [2023-12-26 07:30:34,731][123090] Updated weights for policy 1, policy_version 984681 (0.0010) [2023-12-26 07:30:34,789][123090] Updated weights for policy 1, policy_version 984691 (0.0010) [2023-12-26 07:30:34,845][123090] Updated weights for policy 1, policy_version 984701 (0.0010) [2023-12-26 07:30:35,041][123091] Updated weights for policy 0, policy_version 991608 (0.0009) [2023-12-26 07:30:35,096][123091] Updated weights for policy 0, policy_version 991618 (0.0009) [2023-12-26 07:30:35,154][123091] Updated weights for policy 0, policy_version 991628 (0.0010) [2023-12-26 07:30:35,569][123090] Updated weights for policy 1, policy_version 984711 (0.0007) [2023-12-26 07:30:35,626][123090] Updated weights for policy 1, policy_version 984721 (0.0006) [2023-12-26 07:30:35,682][123090] Updated weights for policy 1, policy_version 984731 (0.0006) [2023-12-26 07:30:35,891][123091] Updated weights for policy 0, policy_version 991638 (0.0007) [2023-12-26 07:30:35,948][123091] Updated weights for policy 0, policy_version 991648 (0.0005) [2023-12-26 07:30:36,006][123091] Updated weights for policy 0, policy_version 991658 (0.0005) [2023-12-26 07:30:36,450][123090] Updated weights for policy 1, policy_version 984741 (0.0008) [2023-12-26 07:30:36,511][123090] Updated weights for policy 1, policy_version 984751 (0.0009) [2023-12-26 07:30:36,571][123090] Updated weights for policy 1, policy_version 984761 (0.0009) [2023-12-26 07:30:36,665][123091] Updated weights for policy 0, policy_version 991668 (0.0007) [2023-12-26 07:30:36,709][123091] Updated weights for policy 0, policy_version 991678 (0.0010) [2023-12-26 07:30:36,758][123091] Updated weights for policy 0, policy_version 991688 (0.0010) [2023-12-26 07:30:37,456][123090] Updated weights for policy 1, policy_version 984771 (0.0010) [2023-12-26 07:30:37,459][123091] Updated weights for policy 0, policy_version 991698 (0.0009) [2023-12-26 07:30:37,512][123090] Updated weights for policy 1, policy_version 984781 (0.0009) [2023-12-26 07:30:37,525][123091] Updated weights for policy 0, policy_version 991708 (0.0009) [2023-12-26 07:30:37,575][123090] Updated weights for policy 1, policy_version 984791 (0.0008) [2023-12-26 07:30:37,589][123091] Updated weights for policy 0, policy_version 991718 (0.0011) [2023-12-26 07:30:37,659][123091] Updated weights for policy 0, policy_version 991728 (0.0011) [2023-12-26 07:30:38,339][123090] Updated weights for policy 1, policy_version 984801 (0.0007) [2023-12-26 07:30:38,388][123091] Updated weights for policy 0, policy_version 991738 (0.0008) [2023-12-26 07:30:38,401][123090] Updated weights for policy 1, policy_version 984811 (0.0007) [2023-12-26 07:30:38,441][123091] Updated weights for policy 0, policy_version 991748 (0.0008) [2023-12-26 07:30:38,467][123090] Updated weights for policy 1, policy_version 984821 (0.0006) [2023-12-26 07:30:38,505][123091] Updated weights for policy 0, policy_version 991758 (0.0008) [2023-12-26 07:30:38,527][123090] Updated weights for policy 1, policy_version 984831 (0.0007) [2023-12-26 07:30:38,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 506011648. Throughput: 0: 9035.1, 1: 8593.2. Samples: 505984076. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:38,785][121949] Avg episode reward: [(0, '6135.183'), (1, '5956.451')] [2023-12-26 07:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000991760_253894656.pth... [2023-12-26 07:30:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000984832_252116992.pth... [2023-12-26 07:30:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000990736_253632512.pth [2023-12-26 07:30:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000983808_251854848.pth [2023-12-26 07:30:39,229][123091] Updated weights for policy 0, policy_version 991768 (0.0007) [2023-12-26 07:30:39,299][123091] Updated weights for policy 0, policy_version 991778 (0.0011) [2023-12-26 07:30:39,311][123090] Updated weights for policy 1, policy_version 984841 (0.0010) [2023-12-26 07:30:39,370][123091] Updated weights for policy 0, policy_version 991788 (0.0009) [2023-12-26 07:30:39,394][123090] Updated weights for policy 1, policy_version 984851 (0.0009) [2023-12-26 07:30:39,468][123090] Updated weights for policy 1, policy_version 984861 (0.0009) [2023-12-26 07:30:40,211][123091] Updated weights for policy 0, policy_version 991798 (0.0010) [2023-12-26 07:30:40,277][123091] Updated weights for policy 0, policy_version 991808 (0.0009) [2023-12-26 07:30:40,339][123091] Updated weights for policy 0, policy_version 991818 (0.0009) [2023-12-26 07:30:40,344][123090] Updated weights for policy 1, policy_version 984871 (0.0009) [2023-12-26 07:30:40,404][123090] Updated weights for policy 1, policy_version 984881 (0.0008) [2023-12-26 07:30:40,466][123090] Updated weights for policy 1, policy_version 984891 (0.0011) [2023-12-26 07:30:41,099][123091] Updated weights for policy 0, policy_version 991828 (0.0009) [2023-12-26 07:30:41,163][123091] Updated weights for policy 0, policy_version 991838 (0.0008) [2023-12-26 07:30:41,232][123091] Updated weights for policy 0, policy_version 991848 (0.0008) [2023-12-26 07:30:41,247][123090] Updated weights for policy 1, policy_version 984901 (0.0009) [2023-12-26 07:30:41,324][123090] Updated weights for policy 1, policy_version 984911 (0.0006) [2023-12-26 07:30:41,400][123090] Updated weights for policy 1, policy_version 984921 (0.0010) [2023-12-26 07:30:42,093][123091] Updated weights for policy 0, policy_version 991858 (0.0009) [2023-12-26 07:30:42,158][123091] Updated weights for policy 0, policy_version 991868 (0.0009) [2023-12-26 07:30:42,164][123090] Updated weights for policy 1, policy_version 984931 (0.0011) [2023-12-26 07:30:42,218][123091] Updated weights for policy 0, policy_version 991878 (0.0009) [2023-12-26 07:30:42,219][123090] Updated weights for policy 1, policy_version 984941 (0.0007) [2023-12-26 07:30:42,277][123090] Updated weights for policy 1, policy_version 984951 (0.0008) [2023-12-26 07:30:42,280][123091] Updated weights for policy 0, policy_version 991888 (0.0009) [2023-12-26 07:30:43,091][123090] Updated weights for policy 1, policy_version 984961 (0.0010) [2023-12-26 07:30:43,142][123090] Updated weights for policy 1, policy_version 984972 (0.0008) [2023-12-26 07:30:43,178][123091] Updated weights for policy 0, policy_version 991898 (0.0010) [2023-12-26 07:30:43,198][123090] Updated weights for policy 1, policy_version 984982 (0.0007) [2023-12-26 07:30:43,243][123091] Updated weights for policy 0, policy_version 991908 (0.0009) [2023-12-26 07:30:43,253][123090] Updated weights for policy 1, policy_version 984992 (0.0007) [2023-12-26 07:30:43,304][123091] Updated weights for policy 0, policy_version 991918 (0.0009) [2023-12-26 07:30:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 506093568. Throughput: 0: 8876.1, 1: 8646.6. Samples: 506088920. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:43,785][121949] Avg episode reward: [(0, '6202.527'), (1, '5913.641')] [2023-12-26 07:30:44,064][123090] Updated weights for policy 1, policy_version 985002 (0.0006) [2023-12-26 07:30:44,137][123091] Updated weights for policy 0, policy_version 991928 (0.0007) [2023-12-26 07:30:44,139][123090] Updated weights for policy 1, policy_version 985012 (0.0009) [2023-12-26 07:30:44,201][123090] Updated weights for policy 1, policy_version 985022 (0.0007) [2023-12-26 07:30:44,202][123091] Updated weights for policy 0, policy_version 991938 (0.0010) [2023-12-26 07:30:44,267][123091] Updated weights for policy 0, policy_version 991948 (0.0010) [2023-12-26 07:30:44,934][123091] Updated weights for policy 0, policy_version 991958 (0.0008) [2023-12-26 07:30:44,994][123091] Updated weights for policy 0, policy_version 991968 (0.0007) [2023-12-26 07:30:45,046][123090] Updated weights for policy 1, policy_version 985032 (0.0007) [2023-12-26 07:30:45,057][123091] Updated weights for policy 0, policy_version 991978 (0.0011) [2023-12-26 07:30:45,116][123090] Updated weights for policy 1, policy_version 985042 (0.0007) [2023-12-26 07:30:45,180][123090] Updated weights for policy 1, policy_version 985052 (0.0009) [2023-12-26 07:30:45,856][123091] Updated weights for policy 0, policy_version 991988 (0.0011) [2023-12-26 07:30:45,859][123090] Updated weights for policy 1, policy_version 985062 (0.0008) [2023-12-26 07:30:45,911][123091] Updated weights for policy 0, policy_version 991998 (0.0010) [2023-12-26 07:30:45,926][123090] Updated weights for policy 1, policy_version 985072 (0.0008) [2023-12-26 07:30:45,962][123091] Updated weights for policy 0, policy_version 992008 (0.0010) [2023-12-26 07:30:45,998][123090] Updated weights for policy 1, policy_version 985082 (0.0006) [2023-12-26 07:30:46,701][123090] Updated weights for policy 1, policy_version 985092 (0.0007) [2023-12-26 07:30:46,762][123090] Updated weights for policy 1, policy_version 985103 (0.0012) [2023-12-26 07:30:46,782][123091] Updated weights for policy 0, policy_version 992018 (0.0009) [2023-12-26 07:30:46,823][123090] Updated weights for policy 1, policy_version 985113 (0.0011) [2023-12-26 07:30:46,839][123091] Updated weights for policy 0, policy_version 992028 (0.0006) [2023-12-26 07:30:46,899][123091] Updated weights for policy 0, policy_version 992038 (0.0008) [2023-12-26 07:30:46,961][123091] Updated weights for policy 0, policy_version 992048 (0.0010) [2023-12-26 07:30:47,603][123090] Updated weights for policy 1, policy_version 985123 (0.0010) [2023-12-26 07:30:47,612][123091] Updated weights for policy 0, policy_version 992058 (0.0006) [2023-12-26 07:30:47,664][123090] Updated weights for policy 1, policy_version 985133 (0.0008) [2023-12-26 07:30:47,675][123091] Updated weights for policy 0, policy_version 992068 (0.0011) [2023-12-26 07:30:47,729][123090] Updated weights for policy 1, policy_version 985143 (0.0006) [2023-12-26 07:30:47,731][123091] Updated weights for policy 0, policy_version 992078 (0.0011) [2023-12-26 07:30:48,475][123091] Updated weights for policy 0, policy_version 992088 (0.0008) [2023-12-26 07:30:48,513][123090] Updated weights for policy 1, policy_version 985153 (0.0008) [2023-12-26 07:30:48,534][123091] Updated weights for policy 0, policy_version 992098 (0.0006) [2023-12-26 07:30:48,562][123090] Updated weights for policy 1, policy_version 985163 (0.0009) [2023-12-26 07:30:48,607][123091] Updated weights for policy 0, policy_version 992108 (0.0006) [2023-12-26 07:30:48,614][123090] Updated weights for policy 1, policy_version 985173 (0.0009) [2023-12-26 07:30:48,690][123090] Updated weights for policy 1, policy_version 985183 (0.0009) [2023-12-26 07:30:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 506191872. Throughput: 0: 8931.7, 1: 8746.9. Samples: 506198496. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:48,785][121949] Avg episode reward: [(0, '6172.255'), (1, '5976.125')] [2023-12-26 07:30:49,182][123091] Updated weights for policy 0, policy_version 992118 (0.0007) [2023-12-26 07:30:49,238][123091] Updated weights for policy 0, policy_version 992128 (0.0010) [2023-12-26 07:30:49,297][123091] Updated weights for policy 0, policy_version 992138 (0.0009) [2023-12-26 07:30:49,585][123090] Updated weights for policy 1, policy_version 985193 (0.0009) [2023-12-26 07:30:49,651][123090] Updated weights for policy 1, policy_version 985203 (0.0009) [2023-12-26 07:30:49,712][123090] Updated weights for policy 1, policy_version 985213 (0.0007) [2023-12-26 07:30:50,119][123091] Updated weights for policy 0, policy_version 992148 (0.0009) [2023-12-26 07:30:50,184][123091] Updated weights for policy 0, policy_version 992158 (0.0008) [2023-12-26 07:30:50,243][123091] Updated weights for policy 0, policy_version 992168 (0.0006) [2023-12-26 07:30:50,538][123090] Updated weights for policy 1, policy_version 985223 (0.0008) [2023-12-26 07:30:50,604][123090] Updated weights for policy 1, policy_version 985233 (0.0009) [2023-12-26 07:30:50,662][123090] Updated weights for policy 1, policy_version 985243 (0.0009) [2023-12-26 07:30:50,995][123091] Updated weights for policy 0, policy_version 992178 (0.0006) [2023-12-26 07:30:51,060][123091] Updated weights for policy 0, policy_version 992188 (0.0010) [2023-12-26 07:30:51,125][123091] Updated weights for policy 0, policy_version 992198 (0.0010) [2023-12-26 07:30:51,197][123091] Updated weights for policy 0, policy_version 992208 (0.0010) [2023-12-26 07:30:51,508][123090] Updated weights for policy 1, policy_version 985253 (0.0009) [2023-12-26 07:30:51,575][123090] Updated weights for policy 1, policy_version 985263 (0.0009) [2023-12-26 07:30:51,644][123090] Updated weights for policy 1, policy_version 985273 (0.0008) [2023-12-26 07:30:52,133][123091] Updated weights for policy 0, policy_version 992218 (0.0009) [2023-12-26 07:30:52,186][123091] Updated weights for policy 0, policy_version 992228 (0.0009) [2023-12-26 07:30:52,248][123091] Updated weights for policy 0, policy_version 992238 (0.0009) [2023-12-26 07:30:52,498][123090] Updated weights for policy 1, policy_version 985283 (0.0007) [2023-12-26 07:30:52,557][123090] Updated weights for policy 1, policy_version 985293 (0.0006) [2023-12-26 07:30:52,619][123090] Updated weights for policy 1, policy_version 985303 (0.0006) [2023-12-26 07:30:53,076][123091] Updated weights for policy 0, policy_version 992248 (0.0010) [2023-12-26 07:30:53,136][123091] Updated weights for policy 0, policy_version 992258 (0.0011) [2023-12-26 07:30:53,187][123091] Updated weights for policy 0, policy_version 992268 (0.0010) [2023-12-26 07:30:53,434][123090] Updated weights for policy 1, policy_version 985313 (0.0011) [2023-12-26 07:30:53,499][123090] Updated weights for policy 1, policy_version 985323 (0.0009) [2023-12-26 07:30:53,562][123090] Updated weights for policy 1, policy_version 985333 (0.0010) [2023-12-26 07:30:53,618][123090] Updated weights for policy 1, policy_version 985343 (0.0010) [2023-12-26 07:30:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 506273792. Throughput: 0: 8883.0, 1: 8691.4. Samples: 506250316. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:53,785][121949] Avg episode reward: [(0, '6232.493'), (1, '5948.194')] [2023-12-26 07:30:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000985344_252248064.pth... [2023-12-26 07:30:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000992272_254025728.pth... [2023-12-26 07:30:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000984320_251985920.pth [2023-12-26 07:30:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000991216_253755392.pth [2023-12-26 07:30:53,928][123091] Updated weights for policy 0, policy_version 992278 (0.0008) [2023-12-26 07:30:53,983][123091] Updated weights for policy 0, policy_version 992288 (0.0008) [2023-12-26 07:30:54,041][123091] Updated weights for policy 0, policy_version 992298 (0.0005) [2023-12-26 07:30:54,460][123090] Updated weights for policy 1, policy_version 985353 (0.0009) [2023-12-26 07:30:54,525][123090] Updated weights for policy 1, policy_version 985363 (0.0009) [2023-12-26 07:30:54,588][123090] Updated weights for policy 1, policy_version 985373 (0.0009) [2023-12-26 07:30:54,751][123091] Updated weights for policy 0, policy_version 992308 (0.0007) [2023-12-26 07:30:54,809][123091] Updated weights for policy 0, policy_version 992318 (0.0010) [2023-12-26 07:30:54,876][123091] Updated weights for policy 0, policy_version 992328 (0.0009) [2023-12-26 07:30:55,359][123090] Updated weights for policy 1, policy_version 985383 (0.0010) [2023-12-26 07:30:55,403][123090] Updated weights for policy 1, policy_version 985393 (0.0009) [2023-12-26 07:30:55,458][123090] Updated weights for policy 1, policy_version 985403 (0.0010) [2023-12-26 07:30:55,562][123091] Updated weights for policy 0, policy_version 992338 (0.0006) [2023-12-26 07:30:55,614][123091] Updated weights for policy 0, policy_version 992348 (0.0005) [2023-12-26 07:30:55,678][123091] Updated weights for policy 0, policy_version 992358 (0.0005) [2023-12-26 07:30:55,738][123091] Updated weights for policy 0, policy_version 992368 (0.0011) [2023-12-26 07:30:56,168][123090] Updated weights for policy 1, policy_version 985413 (0.0009) [2023-12-26 07:30:56,238][123090] Updated weights for policy 1, policy_version 985423 (0.0010) [2023-12-26 07:30:56,290][123090] Updated weights for policy 1, policy_version 985433 (0.0010) [2023-12-26 07:30:56,524][123091] Updated weights for policy 0, policy_version 992378 (0.0010) [2023-12-26 07:30:56,579][123091] Updated weights for policy 0, policy_version 992388 (0.0010) [2023-12-26 07:30:56,637][123091] Updated weights for policy 0, policy_version 992398 (0.0010) [2023-12-26 07:30:57,043][123090] Updated weights for policy 1, policy_version 985443 (0.0009) [2023-12-26 07:30:57,093][123090] Updated weights for policy 1, policy_version 985453 (0.0005) [2023-12-26 07:30:57,164][123090] Updated weights for policy 1, policy_version 985463 (0.0005) [2023-12-26 07:30:57,474][123091] Updated weights for policy 0, policy_version 992408 (0.0011) [2023-12-26 07:30:57,543][123091] Updated weights for policy 0, policy_version 992418 (0.0007) [2023-12-26 07:30:57,609][123091] Updated weights for policy 0, policy_version 992428 (0.0005) [2023-12-26 07:30:57,828][123090] Updated weights for policy 1, policy_version 985473 (0.0006) [2023-12-26 07:30:57,893][123090] Updated weights for policy 1, policy_version 985483 (0.0010) [2023-12-26 07:30:57,962][123090] Updated weights for policy 1, policy_version 985493 (0.0010) [2023-12-26 07:30:58,025][123090] Updated weights for policy 1, policy_version 985503 (0.0009) [2023-12-26 07:30:58,292][123091] Updated weights for policy 0, policy_version 992438 (0.0007) [2023-12-26 07:30:58,364][123091] Updated weights for policy 0, policy_version 992448 (0.0008) [2023-12-26 07:30:58,430][123091] Updated weights for policy 0, policy_version 992458 (0.0008) [2023-12-26 07:30:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 506363904. Throughput: 0: 8975.9, 1: 8765.1. Samples: 506359008. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:30:58,785][121949] Avg episode reward: [(0, '6093.980'), (1, '5959.533')] [2023-12-26 07:30:58,799][123090] Updated weights for policy 1, policy_version 985513 (0.0007) [2023-12-26 07:30:58,884][123090] Updated weights for policy 1, policy_version 985523 (0.0011) [2023-12-26 07:30:58,955][123090] Updated weights for policy 1, policy_version 985533 (0.0010) [2023-12-26 07:30:59,233][123091] Updated weights for policy 0, policy_version 992468 (0.0008) [2023-12-26 07:30:59,302][123091] Updated weights for policy 0, policy_version 992478 (0.0008) [2023-12-26 07:30:59,369][123091] Updated weights for policy 0, policy_version 992488 (0.0009) [2023-12-26 07:30:59,745][123090] Updated weights for policy 1, policy_version 985543 (0.0010) [2023-12-26 07:30:59,810][123090] Updated weights for policy 1, policy_version 985553 (0.0009) [2023-12-26 07:30:59,880][123090] Updated weights for policy 1, policy_version 985563 (0.0009) [2023-12-26 07:31:00,215][123091] Updated weights for policy 0, policy_version 992498 (0.0009) [2023-12-26 07:31:00,276][123091] Updated weights for policy 0, policy_version 992508 (0.0006) [2023-12-26 07:31:00,348][123091] Updated weights for policy 0, policy_version 992518 (0.0009) [2023-12-26 07:31:00,410][123091] Updated weights for policy 0, policy_version 992528 (0.0009) [2023-12-26 07:31:00,741][123090] Updated weights for policy 1, policy_version 985573 (0.0010) [2023-12-26 07:31:00,804][123090] Updated weights for policy 1, policy_version 985583 (0.0010) [2023-12-26 07:31:00,862][123090] Updated weights for policy 1, policy_version 985593 (0.0010) [2023-12-26 07:31:01,213][123091] Updated weights for policy 0, policy_version 992538 (0.0008) [2023-12-26 07:31:01,271][123091] Updated weights for policy 0, policy_version 992548 (0.0009) [2023-12-26 07:31:01,322][123091] Updated weights for policy 0, policy_version 992558 (0.0009) [2023-12-26 07:31:01,646][123090] Updated weights for policy 1, policy_version 985603 (0.0010) [2023-12-26 07:31:01,713][123090] Updated weights for policy 1, policy_version 985613 (0.0009) [2023-12-26 07:31:01,783][123090] Updated weights for policy 1, policy_version 985623 (0.0009) [2023-12-26 07:31:02,117][123091] Updated weights for policy 0, policy_version 992568 (0.0010) [2023-12-26 07:31:02,183][123091] Updated weights for policy 0, policy_version 992578 (0.0011) [2023-12-26 07:31:02,234][123091] Updated weights for policy 0, policy_version 992588 (0.0010) [2023-12-26 07:31:02,631][123090] Updated weights for policy 1, policy_version 985633 (0.0009) [2023-12-26 07:31:02,687][123090] Updated weights for policy 1, policy_version 985643 (0.0008) [2023-12-26 07:31:02,748][123090] Updated weights for policy 1, policy_version 985653 (0.0008) [2023-12-26 07:31:02,798][123090] Updated weights for policy 1, policy_version 985663 (0.0006) [2023-12-26 07:31:03,034][123091] Updated weights for policy 0, policy_version 992598 (0.0008) [2023-12-26 07:31:03,093][123091] Updated weights for policy 0, policy_version 992608 (0.0010) [2023-12-26 07:31:03,155][123091] Updated weights for policy 0, policy_version 992618 (0.0010) [2023-12-26 07:31:03,475][123090] Updated weights for policy 1, policy_version 985673 (0.0009) [2023-12-26 07:31:03,534][123090] Updated weights for policy 1, policy_version 985683 (0.0009) [2023-12-26 07:31:03,599][123090] Updated weights for policy 1, policy_version 985693 (0.0009) [2023-12-26 07:31:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 506454016. Throughput: 0: 8930.9, 1: 8763.5. Samples: 506463772. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:03,785][121949] Avg episode reward: [(0, '6097.643'), (1, '5963.882')] [2023-12-26 07:31:03,942][123091] Updated weights for policy 0, policy_version 992628 (0.0010) [2023-12-26 07:31:04,013][123091] Updated weights for policy 0, policy_version 992638 (0.0008) [2023-12-26 07:31:04,081][123091] Updated weights for policy 0, policy_version 992648 (0.0007) [2023-12-26 07:31:04,500][123090] Updated weights for policy 1, policy_version 985703 (0.0008) [2023-12-26 07:31:04,572][123090] Updated weights for policy 1, policy_version 985713 (0.0009) [2023-12-26 07:31:04,627][123090] Updated weights for policy 1, policy_version 985723 (0.0009) [2023-12-26 07:31:04,878][123091] Updated weights for policy 0, policy_version 992658 (0.0007) [2023-12-26 07:31:04,922][123091] Updated weights for policy 0, policy_version 992668 (0.0010) [2023-12-26 07:31:04,970][123091] Updated weights for policy 0, policy_version 992678 (0.0010) [2023-12-26 07:31:05,025][123091] Updated weights for policy 0, policy_version 992688 (0.0010) [2023-12-26 07:31:05,466][123090] Updated weights for policy 1, policy_version 985733 (0.0008) [2023-12-26 07:31:05,514][123090] Updated weights for policy 1, policy_version 985743 (0.0008) [2023-12-26 07:31:05,574][123090] Updated weights for policy 1, policy_version 985753 (0.0008) [2023-12-26 07:31:05,887][123091] Updated weights for policy 0, policy_version 992698 (0.0010) [2023-12-26 07:31:05,939][123091] Updated weights for policy 0, policy_version 992708 (0.0010) [2023-12-26 07:31:05,986][123091] Updated weights for policy 0, policy_version 992718 (0.0010) [2023-12-26 07:31:06,395][123090] Updated weights for policy 1, policy_version 985763 (0.0009) [2023-12-26 07:31:06,450][123090] Updated weights for policy 1, policy_version 985773 (0.0010) [2023-12-26 07:31:06,503][123090] Updated weights for policy 1, policy_version 985783 (0.0010) [2023-12-26 07:31:06,851][123091] Updated weights for policy 0, policy_version 992728 (0.0007) [2023-12-26 07:31:06,906][123091] Updated weights for policy 0, policy_version 992738 (0.0006) [2023-12-26 07:31:06,977][123091] Updated weights for policy 0, policy_version 992748 (0.0005) [2023-12-26 07:31:07,268][123090] Updated weights for policy 1, policy_version 985793 (0.0010) [2023-12-26 07:31:07,338][123090] Updated weights for policy 1, policy_version 985803 (0.0010) [2023-12-26 07:31:07,396][123090] Updated weights for policy 1, policy_version 985813 (0.0008) [2023-12-26 07:31:07,454][123090] Updated weights for policy 1, policy_version 985823 (0.0005) [2023-12-26 07:31:07,704][123091] Updated weights for policy 0, policy_version 992758 (0.0009) [2023-12-26 07:31:07,768][123091] Updated weights for policy 0, policy_version 992768 (0.0011) [2023-12-26 07:31:07,841][123091] Updated weights for policy 0, policy_version 992778 (0.0011) [2023-12-26 07:31:08,136][123090] Updated weights for policy 1, policy_version 985833 (0.0010) [2023-12-26 07:31:08,198][123090] Updated weights for policy 1, policy_version 985843 (0.0011) [2023-12-26 07:31:08,257][123090] Updated weights for policy 1, policy_version 985853 (0.0010) [2023-12-26 07:31:08,570][123091] Updated weights for policy 0, policy_version 992788 (0.0011) [2023-12-26 07:31:08,641][123091] Updated weights for policy 0, policy_version 992798 (0.0011) [2023-12-26 07:31:08,705][123091] Updated weights for policy 0, policy_version 992808 (0.0011) [2023-12-26 07:31:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 506544128. Throughput: 0: 8969.0, 1: 8782.4. Samples: 506515720. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:08,785][121949] Avg episode reward: [(0, '6040.547'), (1, '5992.329')] [2023-12-26 07:31:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000992816_254164992.pth... [2023-12-26 07:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000985856_252379136.pth... [2023-12-26 07:31:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000991760_253894656.pth [2023-12-26 07:31:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000984832_252116992.pth [2023-12-26 07:31:09,121][123090] Updated weights for policy 1, policy_version 985863 (0.0010) [2023-12-26 07:31:09,176][123090] Updated weights for policy 1, policy_version 985875 (0.0011) [2023-12-26 07:31:09,237][123090] Updated weights for policy 1, policy_version 985885 (0.0009) [2023-12-26 07:31:09,454][123091] Updated weights for policy 0, policy_version 992818 (0.0010) [2023-12-26 07:31:09,511][123091] Updated weights for policy 0, policy_version 992828 (0.0010) [2023-12-26 07:31:09,571][123091] Updated weights for policy 0, policy_version 992838 (0.0009) [2023-12-26 07:31:09,641][123091] Updated weights for policy 0, policy_version 992848 (0.0010) [2023-12-26 07:31:10,184][123090] Updated weights for policy 1, policy_version 985895 (0.0010) [2023-12-26 07:31:10,245][123090] Updated weights for policy 1, policy_version 985905 (0.0009) [2023-12-26 07:31:10,303][123090] Updated weights for policy 1, policy_version 985915 (0.0009) [2023-12-26 07:31:10,505][123091] Updated weights for policy 0, policy_version 992858 (0.0010) [2023-12-26 07:31:10,569][123091] Updated weights for policy 0, policy_version 992868 (0.0010) [2023-12-26 07:31:10,634][123091] Updated weights for policy 0, policy_version 992878 (0.0010) [2023-12-26 07:31:11,134][123090] Updated weights for policy 1, policy_version 985925 (0.0009) [2023-12-26 07:31:11,204][123090] Updated weights for policy 1, policy_version 985935 (0.0010) [2023-12-26 07:31:11,277][123090] Updated weights for policy 1, policy_version 985945 (0.0010) [2023-12-26 07:31:11,494][123091] Updated weights for policy 0, policy_version 992888 (0.0009) [2023-12-26 07:31:11,560][123091] Updated weights for policy 0, policy_version 992898 (0.0008) [2023-12-26 07:31:11,628][123091] Updated weights for policy 0, policy_version 992908 (0.0009) [2023-12-26 07:31:12,154][123090] Updated weights for policy 1, policy_version 985955 (0.0010) [2023-12-26 07:31:12,217][123090] Updated weights for policy 1, policy_version 985965 (0.0010) [2023-12-26 07:31:12,267][123091] Updated weights for policy 0, policy_version 992918 (0.0008) [2023-12-26 07:31:12,285][123090] Updated weights for policy 1, policy_version 985975 (0.0011) [2023-12-26 07:31:12,336][123091] Updated weights for policy 0, policy_version 992928 (0.0007) [2023-12-26 07:31:12,404][123091] Updated weights for policy 0, policy_version 992938 (0.0009) [2023-12-26 07:31:13,102][123090] Updated weights for policy 1, policy_version 985985 (0.0011) [2023-12-26 07:31:13,149][123090] Updated weights for policy 1, policy_version 985995 (0.0010) [2023-12-26 07:31:13,192][123090] Updated weights for policy 1, policy_version 986005 (0.0010) [2023-12-26 07:31:13,230][123091] Updated weights for policy 0, policy_version 992948 (0.0009) [2023-12-26 07:31:13,239][123090] Updated weights for policy 1, policy_version 986015 (0.0010) [2023-12-26 07:31:13,284][123091] Updated weights for policy 0, policy_version 992958 (0.0008) [2023-12-26 07:31:13,340][123091] Updated weights for policy 0, policy_version 992968 (0.0009) [2023-12-26 07:31:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 506626048. Throughput: 0: 8997.2, 1: 8757.6. Samples: 506619860. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:13,785][121949] Avg episode reward: [(0, '6053.229'), (1, '6023.726')] [2023-12-26 07:31:14,005][123090] Updated weights for policy 1, policy_version 986025 (0.0010) [2023-12-26 07:31:14,074][123090] Updated weights for policy 1, policy_version 986035 (0.0010) [2023-12-26 07:31:14,139][123090] Updated weights for policy 1, policy_version 986045 (0.0010) [2023-12-26 07:31:14,178][123091] Updated weights for policy 0, policy_version 992978 (0.0010) [2023-12-26 07:31:14,238][123091] Updated weights for policy 0, policy_version 992988 (0.0008) [2023-12-26 07:31:14,287][123091] Updated weights for policy 0, policy_version 992998 (0.0009) [2023-12-26 07:31:14,335][123091] Updated weights for policy 0, policy_version 993008 (0.0008) [2023-12-26 07:31:14,970][123090] Updated weights for policy 1, policy_version 986055 (0.0010) [2023-12-26 07:31:15,038][123090] Updated weights for policy 1, policy_version 986065 (0.0011) [2023-12-26 07:31:15,105][123090] Updated weights for policy 1, policy_version 986075 (0.0011) [2023-12-26 07:31:15,111][123091] Updated weights for policy 0, policy_version 993018 (0.0010) [2023-12-26 07:31:15,178][123091] Updated weights for policy 0, policy_version 993028 (0.0008) [2023-12-26 07:31:15,240][123091] Updated weights for policy 0, policy_version 993038 (0.0010) [2023-12-26 07:31:15,761][123090] Updated weights for policy 1, policy_version 986085 (0.0010) [2023-12-26 07:31:15,828][123090] Updated weights for policy 1, policy_version 986095 (0.0010) [2023-12-26 07:31:15,894][123090] Updated weights for policy 1, policy_version 986105 (0.0010) [2023-12-26 07:31:16,024][123091] Updated weights for policy 0, policy_version 993048 (0.0006) [2023-12-26 07:31:16,082][123091] Updated weights for policy 0, policy_version 993058 (0.0007) [2023-12-26 07:31:16,130][123091] Updated weights for policy 0, policy_version 993068 (0.0006) [2023-12-26 07:31:16,691][123090] Updated weights for policy 1, policy_version 986115 (0.0010) [2023-12-26 07:31:16,743][123090] Updated weights for policy 1, policy_version 986125 (0.0010) [2023-12-26 07:31:16,803][123090] Updated weights for policy 1, policy_version 986135 (0.0010) [2023-12-26 07:31:16,834][123091] Updated weights for policy 0, policy_version 993078 (0.0010) [2023-12-26 07:31:16,907][123091] Updated weights for policy 0, policy_version 993088 (0.0011) [2023-12-26 07:31:16,968][123091] Updated weights for policy 0, policy_version 993098 (0.0011) [2023-12-26 07:31:17,535][123090] Updated weights for policy 1, policy_version 986145 (0.0010) [2023-12-26 07:31:17,591][123090] Updated weights for policy 1, policy_version 986155 (0.0005) [2023-12-26 07:31:17,645][123090] Updated weights for policy 1, policy_version 986165 (0.0005) [2023-12-26 07:31:17,699][123090] Updated weights for policy 1, policy_version 986175 (0.0009) [2023-12-26 07:31:17,783][123091] Updated weights for policy 0, policy_version 993108 (0.0006) [2023-12-26 07:31:17,844][123091] Updated weights for policy 0, policy_version 993118 (0.0008) [2023-12-26 07:31:17,896][123091] Updated weights for policy 0, policy_version 993128 (0.0006) [2023-12-26 07:31:18,437][123090] Updated weights for policy 1, policy_version 986185 (0.0008) [2023-12-26 07:31:18,506][123090] Updated weights for policy 1, policy_version 986195 (0.0008) [2023-12-26 07:31:18,571][123090] Updated weights for policy 1, policy_version 986205 (0.0008) [2023-12-26 07:31:18,641][123091] Updated weights for policy 0, policy_version 993138 (0.0007) [2023-12-26 07:31:18,705][123091] Updated weights for policy 0, policy_version 993148 (0.0007) [2023-12-26 07:31:18,767][123091] Updated weights for policy 0, policy_version 993158 (0.0009) [2023-12-26 07:31:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 506716160. Throughput: 0: 9001.3, 1: 8781.7. Samples: 506729100. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:18,785][121949] Avg episode reward: [(0, '6173.915'), (1, '5989.346')] [2023-12-26 07:31:18,823][123091] Updated weights for policy 0, policy_version 993168 (0.0006) [2023-12-26 07:31:19,266][123090] Updated weights for policy 1, policy_version 986215 (0.0007) [2023-12-26 07:31:19,339][123090] Updated weights for policy 1, policy_version 986225 (0.0006) [2023-12-26 07:31:19,411][123090] Updated weights for policy 1, policy_version 986235 (0.0007) [2023-12-26 07:31:19,534][123091] Updated weights for policy 0, policy_version 993178 (0.0008) [2023-12-26 07:31:19,593][123091] Updated weights for policy 0, policy_version 993188 (0.0008) [2023-12-26 07:31:19,663][123091] Updated weights for policy 0, policy_version 993198 (0.0008) [2023-12-26 07:31:20,167][123090] Updated weights for policy 1, policy_version 986245 (0.0007) [2023-12-26 07:31:20,240][123090] Updated weights for policy 1, policy_version 986256 (0.0009) [2023-12-26 07:31:20,302][123090] Updated weights for policy 1, policy_version 986266 (0.0009) [2023-12-26 07:31:20,476][123091] Updated weights for policy 0, policy_version 993208 (0.0009) [2023-12-26 07:31:20,543][123091] Updated weights for policy 0, policy_version 993218 (0.0006) [2023-12-26 07:31:20,614][123091] Updated weights for policy 0, policy_version 993228 (0.0007) [2023-12-26 07:31:21,127][123090] Updated weights for policy 1, policy_version 986276 (0.0009) [2023-12-26 07:31:21,198][123090] Updated weights for policy 1, policy_version 986286 (0.0011) [2023-12-26 07:31:21,259][123090] Updated weights for policy 1, policy_version 986296 (0.0011) [2023-12-26 07:31:21,314][123091] Updated weights for policy 0, policy_version 993238 (0.0007) [2023-12-26 07:31:21,380][123091] Updated weights for policy 0, policy_version 993248 (0.0009) [2023-12-26 07:31:21,438][123091] Updated weights for policy 0, policy_version 993258 (0.0009) [2023-12-26 07:31:22,085][123090] Updated weights for policy 1, policy_version 986306 (0.0011) [2023-12-26 07:31:22,160][123090] Updated weights for policy 1, policy_version 986316 (0.0010) [2023-12-26 07:31:22,232][123090] Updated weights for policy 1, policy_version 986326 (0.0009) [2023-12-26 07:31:22,267][123091] Updated weights for policy 0, policy_version 993268 (0.0008) [2023-12-26 07:31:22,305][123090] Updated weights for policy 1, policy_version 986336 (0.0009) [2023-12-26 07:31:22,336][123091] Updated weights for policy 0, policy_version 993278 (0.0009) [2023-12-26 07:31:22,404][123091] Updated weights for policy 0, policy_version 993288 (0.0009) [2023-12-26 07:31:23,112][123090] Updated weights for policy 1, policy_version 986346 (0.0010) [2023-12-26 07:31:23,176][123090] Updated weights for policy 1, policy_version 986356 (0.0011) [2023-12-26 07:31:23,240][123090] Updated weights for policy 1, policy_version 986366 (0.0011) [2023-12-26 07:31:23,251][123091] Updated weights for policy 0, policy_version 993298 (0.0009) [2023-12-26 07:31:23,299][123091] Updated weights for policy 0, policy_version 993308 (0.0008) [2023-12-26 07:31:23,347][123091] Updated weights for policy 0, policy_version 993318 (0.0009) [2023-12-26 07:31:23,407][123091] Updated weights for policy 0, policy_version 993328 (0.0009) [2023-12-26 07:31:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 506806272. Throughput: 0: 8953.0, 1: 8790.1. Samples: 506782516. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:23,785][121949] Avg episode reward: [(0, '6304.544'), (1, '5938.356')] [2023-12-26 07:31:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000993328_254296064.pth... [2023-12-26 07:31:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000986368_252510208.pth... [2023-12-26 07:31:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000992272_254025728.pth [2023-12-26 07:31:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000985344_252248064.pth [2023-12-26 07:31:24,076][123090] Updated weights for policy 1, policy_version 986376 (0.0009) [2023-12-26 07:31:24,140][123090] Updated weights for policy 1, policy_version 986386 (0.0009) [2023-12-26 07:31:24,192][123090] Updated weights for policy 1, policy_version 986396 (0.0009) [2023-12-26 07:31:24,279][123091] Updated weights for policy 0, policy_version 993338 (0.0009) [2023-12-26 07:31:24,347][123091] Updated weights for policy 0, policy_version 993348 (0.0010) [2023-12-26 07:31:24,407][123091] Updated weights for policy 0, policy_version 993358 (0.0009) [2023-12-26 07:31:24,914][123090] Updated weights for policy 1, policy_version 986406 (0.0007) [2023-12-26 07:31:24,963][123090] Updated weights for policy 1, policy_version 986416 (0.0005) [2023-12-26 07:31:25,014][123090] Updated weights for policy 1, policy_version 986426 (0.0005) [2023-12-26 07:31:25,180][123091] Updated weights for policy 0, policy_version 993368 (0.0010) [2023-12-26 07:31:25,251][123091] Updated weights for policy 0, policy_version 993378 (0.0009) [2023-12-26 07:31:25,322][123091] Updated weights for policy 0, policy_version 993388 (0.0005) [2023-12-26 07:31:25,701][123090] Updated weights for policy 1, policy_version 986436 (0.0006) [2023-12-26 07:31:25,770][123090] Updated weights for policy 1, policy_version 986446 (0.0009) [2023-12-26 07:31:25,834][123090] Updated weights for policy 1, policy_version 986456 (0.0008) [2023-12-26 07:31:26,048][123091] Updated weights for policy 0, policy_version 993398 (0.0008) [2023-12-26 07:31:26,108][123091] Updated weights for policy 0, policy_version 993408 (0.0010) [2023-12-26 07:31:26,153][123091] Updated weights for policy 0, policy_version 993418 (0.0009) [2023-12-26 07:31:26,542][123090] Updated weights for policy 1, policy_version 986466 (0.0006) [2023-12-26 07:31:26,613][123090] Updated weights for policy 1, policy_version 986476 (0.0010) [2023-12-26 07:31:26,679][123090] Updated weights for policy 1, policy_version 986486 (0.0009) [2023-12-26 07:31:26,742][123090] Updated weights for policy 1, policy_version 986496 (0.0005) [2023-12-26 07:31:26,943][123091] Updated weights for policy 0, policy_version 993428 (0.0007) [2023-12-26 07:31:27,003][123091] Updated weights for policy 0, policy_version 993438 (0.0009) [2023-12-26 07:31:27,060][123091] Updated weights for policy 0, policy_version 993448 (0.0009) [2023-12-26 07:31:27,402][123090] Updated weights for policy 1, policy_version 986506 (0.0006) [2023-12-26 07:31:27,461][123090] Updated weights for policy 1, policy_version 986516 (0.0006) [2023-12-26 07:31:27,519][123090] Updated weights for policy 1, policy_version 986526 (0.0005) [2023-12-26 07:31:27,948][123091] Updated weights for policy 0, policy_version 993458 (0.0009) [2023-12-26 07:31:28,002][123091] Updated weights for policy 0, policy_version 993468 (0.0005) [2023-12-26 07:31:28,067][123091] Updated weights for policy 0, policy_version 993478 (0.0007) [2023-12-26 07:31:28,127][123091] Updated weights for policy 0, policy_version 993488 (0.0007) [2023-12-26 07:31:28,216][123090] Updated weights for policy 1, policy_version 986536 (0.0005) [2023-12-26 07:31:28,275][123090] Updated weights for policy 1, policy_version 986546 (0.0005) [2023-12-26 07:31:28,341][123090] Updated weights for policy 1, policy_version 986556 (0.0008) [2023-12-26 07:31:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 506896384. Throughput: 0: 8941.0, 1: 8887.9. Samples: 506891224. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:28,786][121949] Avg episode reward: [(0, '6263.405'), (1, '5986.886')] [2023-12-26 07:31:28,858][123091] Updated weights for policy 0, policy_version 993498 (0.0007) [2023-12-26 07:31:28,905][123091] Updated weights for policy 0, policy_version 993508 (0.0005) [2023-12-26 07:31:28,966][123091] Updated weights for policy 0, policy_version 993518 (0.0007) [2023-12-26 07:31:29,130][123090] Updated weights for policy 1, policy_version 986566 (0.0010) [2023-12-26 07:31:29,196][123090] Updated weights for policy 1, policy_version 986576 (0.0010) [2023-12-26 07:31:29,271][123090] Updated weights for policy 1, policy_version 986586 (0.0010) [2023-12-26 07:31:29,700][123091] Updated weights for policy 0, policy_version 993528 (0.0009) [2023-12-26 07:31:29,757][123091] Updated weights for policy 0, policy_version 993538 (0.0009) [2023-12-26 07:31:29,824][123091] Updated weights for policy 0, policy_version 993548 (0.0009) [2023-12-26 07:31:30,145][123090] Updated weights for policy 1, policy_version 986596 (0.0009) [2023-12-26 07:31:30,194][123090] Updated weights for policy 1, policy_version 986606 (0.0009) [2023-12-26 07:31:30,251][123090] Updated weights for policy 1, policy_version 986616 (0.0008) [2023-12-26 07:31:30,681][123091] Updated weights for policy 0, policy_version 993558 (0.0009) [2023-12-26 07:31:30,745][123091] Updated weights for policy 0, policy_version 993568 (0.0010) [2023-12-26 07:31:30,806][123091] Updated weights for policy 0, policy_version 993578 (0.0009) [2023-12-26 07:31:31,133][123090] Updated weights for policy 1, policy_version 986626 (0.0010) [2023-12-26 07:31:31,200][123090] Updated weights for policy 1, policy_version 986636 (0.0009) [2023-12-26 07:31:31,258][123090] Updated weights for policy 1, policy_version 986646 (0.0008) [2023-12-26 07:31:31,328][123090] Updated weights for policy 1, policy_version 986656 (0.0006) [2023-12-26 07:31:31,622][123091] Updated weights for policy 0, policy_version 993588 (0.0007) [2023-12-26 07:31:31,687][123091] Updated weights for policy 0, policy_version 993598 (0.0006) [2023-12-26 07:31:31,761][123091] Updated weights for policy 0, policy_version 993608 (0.0007) [2023-12-26 07:31:32,142][123090] Updated weights for policy 1, policy_version 986666 (0.0009) [2023-12-26 07:31:32,202][123090] Updated weights for policy 1, policy_version 986676 (0.0009) [2023-12-26 07:31:32,263][123090] Updated weights for policy 1, policy_version 986686 (0.0008) [2023-12-26 07:31:32,532][123091] Updated weights for policy 0, policy_version 993618 (0.0006) [2023-12-26 07:31:32,606][123091] Updated weights for policy 0, policy_version 993629 (0.0010) [2023-12-26 07:31:32,653][123091] Updated weights for policy 0, policy_version 993639 (0.0009) [2023-12-26 07:31:33,050][123090] Updated weights for policy 1, policy_version 986696 (0.0006) [2023-12-26 07:31:33,109][123090] Updated weights for policy 1, policy_version 986706 (0.0007) [2023-12-26 07:31:33,163][123090] Updated weights for policy 1, policy_version 986716 (0.0010) [2023-12-26 07:31:33,429][123091] Updated weights for policy 0, policy_version 993649 (0.0009) [2023-12-26 07:31:33,476][123091] Updated weights for policy 0, policy_version 993659 (0.0009) [2023-12-26 07:31:33,522][123091] Updated weights for policy 0, policy_version 993669 (0.0008) [2023-12-26 07:31:33,578][123091] Updated weights for policy 0, policy_version 993680 (0.0009) [2023-12-26 07:31:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 506986496. Throughput: 0: 8903.7, 1: 8834.8. Samples: 506996728. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:33,785][121949] Avg episode reward: [(0, '6276.928'), (1, '5960.253')] [2023-12-26 07:31:34,008][123090] Updated weights for policy 1, policy_version 986726 (0.0010) [2023-12-26 07:31:34,071][123090] Updated weights for policy 1, policy_version 986736 (0.0009) [2023-12-26 07:31:34,137][123090] Updated weights for policy 1, policy_version 986746 (0.0009) [2023-12-26 07:31:34,436][123091] Updated weights for policy 0, policy_version 993690 (0.0010) [2023-12-26 07:31:34,500][123091] Updated weights for policy 0, policy_version 993700 (0.0009) [2023-12-26 07:31:34,566][123091] Updated weights for policy 0, policy_version 993710 (0.0009) [2023-12-26 07:31:34,976][123090] Updated weights for policy 1, policy_version 986756 (0.0009) [2023-12-26 07:31:35,031][123090] Updated weights for policy 1, policy_version 986766 (0.0010) [2023-12-26 07:31:35,087][123090] Updated weights for policy 1, policy_version 986776 (0.0009) [2023-12-26 07:31:35,392][123091] Updated weights for policy 0, policy_version 993720 (0.0010) [2023-12-26 07:31:35,452][123091] Updated weights for policy 0, policy_version 993730 (0.0009) [2023-12-26 07:31:35,505][123091] Updated weights for policy 0, policy_version 993740 (0.0009) [2023-12-26 07:31:35,898][123090] Updated weights for policy 1, policy_version 986786 (0.0009) [2023-12-26 07:31:35,954][123090] Updated weights for policy 1, policy_version 986796 (0.0008) [2023-12-26 07:31:36,000][123090] Updated weights for policy 1, policy_version 986806 (0.0005) [2023-12-26 07:31:36,056][123090] Updated weights for policy 1, policy_version 986816 (0.0005) [2023-12-26 07:31:36,400][123091] Updated weights for policy 0, policy_version 993750 (0.0009) [2023-12-26 07:31:36,455][123091] Updated weights for policy 0, policy_version 993760 (0.0009) [2023-12-26 07:31:36,506][123091] Updated weights for policy 0, policy_version 993770 (0.0010) [2023-12-26 07:31:36,829][123090] Updated weights for policy 1, policy_version 986826 (0.0006) [2023-12-26 07:31:36,887][123090] Updated weights for policy 1, policy_version 986836 (0.0006) [2023-12-26 07:31:36,954][123090] Updated weights for policy 1, policy_version 986846 (0.0010) [2023-12-26 07:31:37,377][123091] Updated weights for policy 0, policy_version 993780 (0.0008) [2023-12-26 07:31:37,445][123091] Updated weights for policy 0, policy_version 993790 (0.0005) [2023-12-26 07:31:37,510][123091] Updated weights for policy 0, policy_version 993800 (0.0005) [2023-12-26 07:31:37,756][123090] Updated weights for policy 1, policy_version 986856 (0.0010) [2023-12-26 07:31:37,819][123090] Updated weights for policy 1, policy_version 986866 (0.0010) [2023-12-26 07:31:37,884][123090] Updated weights for policy 1, policy_version 986876 (0.0010) [2023-12-26 07:31:38,129][123091] Updated weights for policy 0, policy_version 993810 (0.0008) [2023-12-26 07:31:38,182][123091] Updated weights for policy 0, policy_version 993820 (0.0009) [2023-12-26 07:31:38,234][123091] Updated weights for policy 0, policy_version 993830 (0.0010) [2023-12-26 07:31:38,288][123091] Updated weights for policy 0, policy_version 993840 (0.0010) [2023-12-26 07:31:38,700][123090] Updated weights for policy 1, policy_version 986886 (0.0010) [2023-12-26 07:31:38,755][123090] Updated weights for policy 1, policy_version 986896 (0.0009) [2023-12-26 07:31:38,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 507068416. Throughput: 0: 8864.2, 1: 8859.1. Samples: 507047864. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:38,785][121949] Avg episode reward: [(0, '6213.895'), (1, '5937.789')] [2023-12-26 07:31:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000993840_254427136.pth... [2023-12-26 07:31:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000992816_254164992.pth [2023-12-26 07:31:38,815][123090] Updated weights for policy 1, policy_version 986906 (0.0010) [2023-12-26 07:31:38,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000986912_252649472.pth... [2023-12-26 07:31:38,853][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000985856_252379136.pth [2023-12-26 07:31:39,123][123091] Updated weights for policy 0, policy_version 993850 (0.0009) [2023-12-26 07:31:39,174][123091] Updated weights for policy 0, policy_version 993861 (0.0010) [2023-12-26 07:31:39,231][123091] Updated weights for policy 0, policy_version 993872 (0.0009) [2023-12-26 07:31:39,536][123090] Updated weights for policy 1, policy_version 986916 (0.0008) [2023-12-26 07:31:39,602][123090] Updated weights for policy 1, policy_version 986926 (0.0009) [2023-12-26 07:31:39,670][123090] Updated weights for policy 1, policy_version 986936 (0.0010) [2023-12-26 07:31:40,127][123091] Updated weights for policy 0, policy_version 993882 (0.0011) [2023-12-26 07:31:40,184][123091] Updated weights for policy 0, policy_version 993892 (0.0011) [2023-12-26 07:31:40,240][123091] Updated weights for policy 0, policy_version 993902 (0.0011) [2023-12-26 07:31:40,451][123090] Updated weights for policy 1, policy_version 986946 (0.0009) [2023-12-26 07:31:40,533][123090] Updated weights for policy 1, policy_version 986956 (0.0006) [2023-12-26 07:31:40,610][123090] Updated weights for policy 1, policy_version 986966 (0.0006) [2023-12-26 07:31:40,682][123090] Updated weights for policy 1, policy_version 986976 (0.0005) [2023-12-26 07:31:41,071][123091] Updated weights for policy 0, policy_version 993912 (0.0009) [2023-12-26 07:31:41,147][123091] Updated weights for policy 0, policy_version 993922 (0.0007) [2023-12-26 07:31:41,215][123091] Updated weights for policy 0, policy_version 993932 (0.0010) [2023-12-26 07:31:41,384][123090] Updated weights for policy 1, policy_version 986986 (0.0009) [2023-12-26 07:31:41,447][123090] Updated weights for policy 1, policy_version 986996 (0.0008) [2023-12-26 07:31:41,500][123090] Updated weights for policy 1, policy_version 987006 (0.0009) [2023-12-26 07:31:41,990][123091] Updated weights for policy 0, policy_version 993942 (0.0008) [2023-12-26 07:31:42,059][123091] Updated weights for policy 0, policy_version 993952 (0.0005) [2023-12-26 07:31:42,131][123091] Updated weights for policy 0, policy_version 993962 (0.0005) [2023-12-26 07:31:42,321][123090] Updated weights for policy 1, policy_version 987016 (0.0007) [2023-12-26 07:31:42,397][123090] Updated weights for policy 1, policy_version 987026 (0.0008) [2023-12-26 07:31:42,466][123090] Updated weights for policy 1, policy_version 987036 (0.0011) [2023-12-26 07:31:42,878][123091] Updated weights for policy 0, policy_version 993972 (0.0007) [2023-12-26 07:31:42,935][123091] Updated weights for policy 0, policy_version 993982 (0.0009) [2023-12-26 07:31:42,997][123091] Updated weights for policy 0, policy_version 993992 (0.0010) [2023-12-26 07:31:43,256][123090] Updated weights for policy 1, policy_version 987046 (0.0011) [2023-12-26 07:31:43,318][123090] Updated weights for policy 1, policy_version 987056 (0.0010) [2023-12-26 07:31:43,388][123090] Updated weights for policy 1, policy_version 987066 (0.0010) [2023-12-26 07:31:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 507158528. Throughput: 0: 8845.2, 1: 8837.8. Samples: 507154748. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:43,785][121949] Avg episode reward: [(0, '6163.996'), (1, '5931.843')] [2023-12-26 07:31:43,837][123091] Updated weights for policy 0, policy_version 994002 (0.0009) [2023-12-26 07:31:43,885][123091] Updated weights for policy 0, policy_version 994012 (0.0009) [2023-12-26 07:31:43,938][123091] Updated weights for policy 0, policy_version 994022 (0.0010) [2023-12-26 07:31:43,991][123091] Updated weights for policy 0, policy_version 994032 (0.0009) [2023-12-26 07:31:44,191][123090] Updated weights for policy 1, policy_version 987076 (0.0010) [2023-12-26 07:31:44,239][123090] Updated weights for policy 1, policy_version 987086 (0.0010) [2023-12-26 07:31:44,287][123090] Updated weights for policy 1, policy_version 987096 (0.0010) [2023-12-26 07:31:44,827][123091] Updated weights for policy 0, policy_version 994042 (0.0008) [2023-12-26 07:31:44,879][123091] Updated weights for policy 0, policy_version 994052 (0.0008) [2023-12-26 07:31:44,923][123091] Updated weights for policy 0, policy_version 994062 (0.0008) [2023-12-26 07:31:45,154][123090] Updated weights for policy 1, policy_version 987106 (0.0010) [2023-12-26 07:31:45,221][123090] Updated weights for policy 1, policy_version 987116 (0.0009) [2023-12-26 07:31:45,292][123090] Updated weights for policy 1, policy_version 987126 (0.0010) [2023-12-26 07:31:45,354][123090] Updated weights for policy 1, policy_version 987136 (0.0010) [2023-12-26 07:31:45,764][123091] Updated weights for policy 0, policy_version 994072 (0.0010) [2023-12-26 07:31:45,816][123091] Updated weights for policy 0, policy_version 994083 (0.0010) [2023-12-26 07:31:45,869][123091] Updated weights for policy 0, policy_version 994093 (0.0010) [2023-12-26 07:31:46,195][123090] Updated weights for policy 1, policy_version 987146 (0.0009) [2023-12-26 07:31:46,267][123090] Updated weights for policy 1, policy_version 987156 (0.0009) [2023-12-26 07:31:46,339][123090] Updated weights for policy 1, policy_version 987166 (0.0009) [2023-12-26 07:31:46,619][123091] Updated weights for policy 0, policy_version 994103 (0.0006) [2023-12-26 07:31:46,678][123091] Updated weights for policy 0, policy_version 994113 (0.0005) [2023-12-26 07:31:46,732][123091] Updated weights for policy 0, policy_version 994123 (0.0005) [2023-12-26 07:31:47,133][123090] Updated weights for policy 1, policy_version 987176 (0.0006) [2023-12-26 07:31:47,179][123090] Updated weights for policy 1, policy_version 987186 (0.0005) [2023-12-26 07:31:47,237][123090] Updated weights for policy 1, policy_version 987196 (0.0008) [2023-12-26 07:31:47,299][123091] Updated weights for policy 0, policy_version 994133 (0.0005) [2023-12-26 07:31:47,355][123091] Updated weights for policy 0, policy_version 994143 (0.0005) [2023-12-26 07:31:47,453][123091] Updated weights for policy 0, policy_version 994153 (0.0005) [2023-12-26 07:31:48,060][123090] Updated weights for policy 1, policy_version 987206 (0.0009) [2023-12-26 07:31:48,118][123090] Updated weights for policy 1, policy_version 987217 (0.0009) [2023-12-26 07:31:48,141][123091] Updated weights for policy 0, policy_version 994163 (0.0007) [2023-12-26 07:31:48,173][123090] Updated weights for policy 1, policy_version 987227 (0.0008) [2023-12-26 07:31:48,200][123091] Updated weights for policy 0, policy_version 994173 (0.0008) [2023-12-26 07:31:48,270][123091] Updated weights for policy 0, policy_version 994184 (0.0009) [2023-12-26 07:31:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 507248640. Throughput: 0: 8880.0, 1: 8837.1. Samples: 507261040. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:48,785][121949] Avg episode reward: [(0, '6213.603'), (1, '6020.855')] [2023-12-26 07:31:48,953][123090] Updated weights for policy 1, policy_version 987237 (0.0008) [2023-12-26 07:31:49,009][123090] Updated weights for policy 1, policy_version 987247 (0.0009) [2023-12-26 07:31:49,075][123090] Updated weights for policy 1, policy_version 987257 (0.0009) [2023-12-26 07:31:49,145][123091] Updated weights for policy 0, policy_version 994194 (0.0009) [2023-12-26 07:31:49,215][123091] Updated weights for policy 0, policy_version 994204 (0.0008) [2023-12-26 07:31:49,276][123091] Updated weights for policy 0, policy_version 994214 (0.0010) [2023-12-26 07:31:49,336][123091] Updated weights for policy 0, policy_version 994224 (0.0010) [2023-12-26 07:31:49,968][123090] Updated weights for policy 1, policy_version 987267 (0.0009) [2023-12-26 07:31:50,031][123090] Updated weights for policy 1, policy_version 987277 (0.0009) [2023-12-26 07:31:50,060][123091] Updated weights for policy 0, policy_version 994234 (0.0008) [2023-12-26 07:31:50,086][123090] Updated weights for policy 1, policy_version 987287 (0.0009) [2023-12-26 07:31:50,125][123091] Updated weights for policy 0, policy_version 994244 (0.0008) [2023-12-26 07:31:50,193][123091] Updated weights for policy 0, policy_version 994254 (0.0008) [2023-12-26 07:31:50,833][123091] Updated weights for policy 0, policy_version 994264 (0.0006) [2023-12-26 07:31:50,898][123091] Updated weights for policy 0, policy_version 994274 (0.0006) [2023-12-26 07:31:50,968][123091] Updated weights for policy 0, policy_version 994284 (0.0005) [2023-12-26 07:31:51,015][123090] Updated weights for policy 1, policy_version 987297 (0.0008) [2023-12-26 07:31:51,072][123090] Updated weights for policy 1, policy_version 987307 (0.0009) [2023-12-26 07:31:51,132][123090] Updated weights for policy 1, policy_version 987317 (0.0009) [2023-12-26 07:31:51,193][123090] Updated weights for policy 1, policy_version 987327 (0.0009) [2023-12-26 07:31:51,689][123091] Updated weights for policy 0, policy_version 994294 (0.0008) [2023-12-26 07:31:51,759][123091] Updated weights for policy 0, policy_version 994304 (0.0008) [2023-12-26 07:31:51,817][123091] Updated weights for policy 0, policy_version 994314 (0.0007) [2023-12-26 07:31:52,112][123090] Updated weights for policy 1, policy_version 987337 (0.0009) [2023-12-26 07:31:52,170][123090] Updated weights for policy 1, policy_version 987347 (0.0008) [2023-12-26 07:31:52,223][123090] Updated weights for policy 1, policy_version 987357 (0.0009) [2023-12-26 07:31:52,633][123091] Updated weights for policy 0, policy_version 994324 (0.0008) [2023-12-26 07:31:52,697][123091] Updated weights for policy 0, policy_version 994334 (0.0009) [2023-12-26 07:31:52,757][123091] Updated weights for policy 0, policy_version 994344 (0.0005) [2023-12-26 07:31:53,052][123090] Updated weights for policy 1, policy_version 987367 (0.0007) [2023-12-26 07:31:53,119][123090] Updated weights for policy 1, policy_version 987377 (0.0007) [2023-12-26 07:31:53,189][123090] Updated weights for policy 1, policy_version 987387 (0.0009) [2023-12-26 07:31:53,515][123091] Updated weights for policy 0, policy_version 994354 (0.0006) [2023-12-26 07:31:53,571][123091] Updated weights for policy 0, policy_version 994364 (0.0005) [2023-12-26 07:31:53,619][123091] Updated weights for policy 0, policy_version 994374 (0.0010) [2023-12-26 07:31:53,666][123091] Updated weights for policy 0, policy_version 994384 (0.0009) [2023-12-26 07:31:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 507338752. Throughput: 0: 8934.7, 1: 8798.0. Samples: 507313692. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:53,785][121949] Avg episode reward: [(0, '6292.256'), (1, '5988.536')] [2023-12-26 07:31:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000987392_252772352.pth... [2023-12-26 07:31:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000994384_254566400.pth... [2023-12-26 07:31:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000986368_252510208.pth [2023-12-26 07:31:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000993328_254296064.pth [2023-12-26 07:31:53,892][123090] Updated weights for policy 1, policy_version 987397 (0.0009) [2023-12-26 07:31:53,953][123090] Updated weights for policy 1, policy_version 987407 (0.0008) [2023-12-26 07:31:54,017][123090] Updated weights for policy 1, policy_version 987417 (0.0009) [2023-12-26 07:31:54,482][123091] Updated weights for policy 0, policy_version 994394 (0.0005) [2023-12-26 07:31:54,532][123091] Updated weights for policy 0, policy_version 994404 (0.0008) [2023-12-26 07:31:54,581][123091] Updated weights for policy 0, policy_version 994414 (0.0007) [2023-12-26 07:31:54,831][123090] Updated weights for policy 1, policy_version 987427 (0.0009) [2023-12-26 07:31:54,895][123090] Updated weights for policy 1, policy_version 987437 (0.0008) [2023-12-26 07:31:54,966][123090] Updated weights for policy 1, policy_version 987447 (0.0009) [2023-12-26 07:31:55,290][123091] Updated weights for policy 0, policy_version 994424 (0.0005) [2023-12-26 07:31:55,346][123091] Updated weights for policy 0, policy_version 994434 (0.0005) [2023-12-26 07:31:55,398][123091] Updated weights for policy 0, policy_version 994444 (0.0005) [2023-12-26 07:31:55,881][123090] Updated weights for policy 1, policy_version 987457 (0.0009) [2023-12-26 07:31:55,948][123090] Updated weights for policy 1, policy_version 987467 (0.0010) [2023-12-26 07:31:56,007][123090] Updated weights for policy 1, policy_version 987477 (0.0010) [2023-12-26 07:31:56,077][123091] Updated weights for policy 0, policy_version 994454 (0.0005) [2023-12-26 07:31:56,078][123090] Updated weights for policy 1, policy_version 987487 (0.0010) [2023-12-26 07:31:56,138][123091] Updated weights for policy 0, policy_version 994464 (0.0005) [2023-12-26 07:31:56,200][123091] Updated weights for policy 0, policy_version 994474 (0.0005) [2023-12-26 07:31:56,748][123090] Updated weights for policy 1, policy_version 987497 (0.0006) [2023-12-26 07:31:56,795][123090] Updated weights for policy 1, policy_version 987507 (0.0005) [2023-12-26 07:31:56,845][123091] Updated weights for policy 0, policy_version 994484 (0.0005) [2023-12-26 07:31:56,855][123090] Updated weights for policy 1, policy_version 987517 (0.0005) [2023-12-26 07:31:56,896][123091] Updated weights for policy 0, policy_version 994494 (0.0007) [2023-12-26 07:31:56,954][123091] Updated weights for policy 0, policy_version 994504 (0.0008) [2023-12-26 07:31:57,654][123091] Updated weights for policy 0, policy_version 994514 (0.0009) [2023-12-26 07:31:57,681][123090] Updated weights for policy 1, policy_version 987527 (0.0008) [2023-12-26 07:31:57,702][123091] Updated weights for policy 0, policy_version 994524 (0.0005) [2023-12-26 07:31:57,744][123090] Updated weights for policy 1, policy_version 987537 (0.0009) [2023-12-26 07:31:57,756][123091] Updated weights for policy 0, policy_version 994534 (0.0005) [2023-12-26 07:31:57,792][123090] Updated weights for policy 1, policy_version 987547 (0.0008) [2023-12-26 07:31:57,812][123091] Updated weights for policy 0, policy_version 994544 (0.0005) [2023-12-26 07:31:58,419][123091] Updated weights for policy 0, policy_version 994554 (0.0012) [2023-12-26 07:31:58,485][123091] Updated weights for policy 0, policy_version 994564 (0.0008) [2023-12-26 07:31:58,550][123091] Updated weights for policy 0, policy_version 994574 (0.0009) [2023-12-26 07:31:58,751][123090] Updated weights for policy 1, policy_version 987557 (0.0009) [2023-12-26 07:31:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 507428864. Throughput: 0: 9056.1, 1: 8818.7. Samples: 507424224. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:31:58,785][121949] Avg episode reward: [(0, '6205.179'), (1, '5872.201')] [2023-12-26 07:31:58,814][123090] Updated weights for policy 1, policy_version 987567 (0.0008) [2023-12-26 07:31:58,883][123090] Updated weights for policy 1, policy_version 987577 (0.0006) [2023-12-26 07:31:59,348][123091] Updated weights for policy 0, policy_version 994584 (0.0009) [2023-12-26 07:31:59,412][123091] Updated weights for policy 0, policy_version 994594 (0.0009) [2023-12-26 07:31:59,483][123091] Updated weights for policy 0, policy_version 994604 (0.0010) [2023-12-26 07:31:59,605][123090] Updated weights for policy 1, policy_version 987587 (0.0006) [2023-12-26 07:31:59,664][123090] Updated weights for policy 1, policy_version 987597 (0.0005) [2023-12-26 07:31:59,719][123090] Updated weights for policy 1, policy_version 987607 (0.0005) [2023-12-26 07:32:00,291][123091] Updated weights for policy 0, policy_version 994614 (0.0010) [2023-12-26 07:32:00,350][123091] Updated weights for policy 0, policy_version 994624 (0.0010) [2023-12-26 07:32:00,402][123091] Updated weights for policy 0, policy_version 994634 (0.0009) [2023-12-26 07:32:00,405][123090] Updated weights for policy 1, policy_version 987617 (0.0005) [2023-12-26 07:32:00,462][123090] Updated weights for policy 1, policy_version 987627 (0.0009) [2023-12-26 07:32:00,513][123090] Updated weights for policy 1, policy_version 987637 (0.0009) [2023-12-26 07:32:00,566][123090] Updated weights for policy 1, policy_version 987647 (0.0009) [2023-12-26 07:32:01,209][123091] Updated weights for policy 0, policy_version 994644 (0.0009) [2023-12-26 07:32:01,266][123091] Updated weights for policy 0, policy_version 994654 (0.0010) [2023-12-26 07:32:01,320][123090] Updated weights for policy 1, policy_version 987657 (0.0008) [2023-12-26 07:32:01,334][123091] Updated weights for policy 0, policy_version 994664 (0.0009) [2023-12-26 07:32:01,397][123090] Updated weights for policy 1, policy_version 987667 (0.0009) [2023-12-26 07:32:01,455][123090] Updated weights for policy 1, policy_version 987677 (0.0010) [2023-12-26 07:32:02,165][123091] Updated weights for policy 0, policy_version 994674 (0.0008) [2023-12-26 07:32:02,235][123091] Updated weights for policy 0, policy_version 994684 (0.0009) [2023-12-26 07:32:02,301][123091] Updated weights for policy 0, policy_version 994694 (0.0009) [2023-12-26 07:32:02,306][123090] Updated weights for policy 1, policy_version 987687 (0.0007) [2023-12-26 07:32:02,372][123091] Updated weights for policy 0, policy_version 994704 (0.0008) [2023-12-26 07:32:02,379][123090] Updated weights for policy 1, policy_version 987697 (0.0008) [2023-12-26 07:32:02,436][123090] Updated weights for policy 1, policy_version 987707 (0.0007) [2023-12-26 07:32:03,083][123091] Updated weights for policy 0, policy_version 994714 (0.0006) [2023-12-26 07:32:03,155][123091] Updated weights for policy 0, policy_version 994724 (0.0005) [2023-12-26 07:32:03,185][123090] Updated weights for policy 1, policy_version 987717 (0.0009) [2023-12-26 07:32:03,210][123091] Updated weights for policy 0, policy_version 994734 (0.0005) [2023-12-26 07:32:03,246][123090] Updated weights for policy 1, policy_version 987727 (0.0005) [2023-12-26 07:32:03,307][123090] Updated weights for policy 1, policy_version 987737 (0.0006) [2023-12-26 07:32:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 507518976. Throughput: 0: 9040.1, 1: 8811.0. Samples: 507532400. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:03,785][121949] Avg episode reward: [(0, '6175.578'), (1, '5720.955')] [2023-12-26 07:32:03,899][123090] Updated weights for policy 1, policy_version 987747 (0.0006) [2023-12-26 07:32:03,958][123091] Updated weights for policy 0, policy_version 994744 (0.0007) [2023-12-26 07:32:03,961][123090] Updated weights for policy 1, policy_version 987757 (0.0010) [2023-12-26 07:32:04,012][123091] Updated weights for policy 0, policy_version 994754 (0.0006) [2023-12-26 07:32:04,016][123090] Updated weights for policy 1, policy_version 987767 (0.0009) [2023-12-26 07:32:04,077][123091] Updated weights for policy 0, policy_version 994764 (0.0009) [2023-12-26 07:32:04,793][123090] Updated weights for policy 1, policy_version 987777 (0.0008) [2023-12-26 07:32:04,851][123090] Updated weights for policy 1, policy_version 987787 (0.0010) [2023-12-26 07:32:04,922][123090] Updated weights for policy 1, policy_version 987797 (0.0007) [2023-12-26 07:32:04,940][123091] Updated weights for policy 0, policy_version 994774 (0.0009) [2023-12-26 07:32:04,989][123090] Updated weights for policy 1, policy_version 987807 (0.0010) [2023-12-26 07:32:05,008][123091] Updated weights for policy 0, policy_version 994784 (0.0006) [2023-12-26 07:32:05,076][123091] Updated weights for policy 0, policy_version 994794 (0.0006) [2023-12-26 07:32:05,659][123090] Updated weights for policy 1, policy_version 987817 (0.0007) [2023-12-26 07:32:05,722][123091] Updated weights for policy 0, policy_version 994804 (0.0006) [2023-12-26 07:32:05,737][123090] Updated weights for policy 1, policy_version 987827 (0.0005) [2023-12-26 07:32:05,777][123091] Updated weights for policy 0, policy_version 994814 (0.0005) [2023-12-26 07:32:05,816][123090] Updated weights for policy 1, policy_version 987837 (0.0008) [2023-12-26 07:32:05,838][123091] Updated weights for policy 0, policy_version 994824 (0.0005) [2023-12-26 07:32:06,518][123091] Updated weights for policy 0, policy_version 994834 (0.0005) [2023-12-26 07:32:06,570][123090] Updated weights for policy 1, policy_version 987847 (0.0008) [2023-12-26 07:32:06,584][123091] Updated weights for policy 0, policy_version 994844 (0.0006) [2023-12-26 07:32:06,627][123090] Updated weights for policy 1, policy_version 987857 (0.0008) [2023-12-26 07:32:06,643][123091] Updated weights for policy 0, policy_version 994854 (0.0010) [2023-12-26 07:32:06,677][123090] Updated weights for policy 1, policy_version 987867 (0.0008) [2023-12-26 07:32:06,691][123091] Updated weights for policy 0, policy_version 994864 (0.0010) [2023-12-26 07:32:07,501][123090] Updated weights for policy 1, policy_version 987877 (0.0008) [2023-12-26 07:32:07,511][123091] Updated weights for policy 0, policy_version 994874 (0.0011) [2023-12-26 07:32:07,564][123090] Updated weights for policy 1, policy_version 987887 (0.0008) [2023-12-26 07:32:07,574][123091] Updated weights for policy 0, policy_version 994884 (0.0010) [2023-12-26 07:32:07,629][123090] Updated weights for policy 1, policy_version 987897 (0.0006) [2023-12-26 07:32:07,631][123091] Updated weights for policy 0, policy_version 994894 (0.0011) [2023-12-26 07:32:08,454][123090] Updated weights for policy 1, policy_version 987907 (0.0007) [2023-12-26 07:32:08,473][123091] Updated weights for policy 0, policy_version 994904 (0.0011) [2023-12-26 07:32:08,510][123090] Updated weights for policy 1, policy_version 987917 (0.0007) [2023-12-26 07:32:08,528][123091] Updated weights for policy 0, policy_version 994914 (0.0011) [2023-12-26 07:32:08,565][123090] Updated weights for policy 1, policy_version 987927 (0.0008) [2023-12-26 07:32:08,583][123091] Updated weights for policy 0, policy_version 994924 (0.0010) [2023-12-26 07:32:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 507617280. Throughput: 0: 9083.5, 1: 8846.1. Samples: 507589352. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:08,785][121949] Avg episode reward: [(0, '6122.886'), (1, '5812.744')] [2023-12-26 07:32:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000994928_254705664.pth... [2023-12-26 07:32:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000987936_252911616.pth... [2023-12-26 07:32:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000993840_254427136.pth [2023-12-26 07:32:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000986912_252649472.pth [2023-12-26 07:32:09,435][123090] Updated weights for policy 1, policy_version 987937 (0.0007) [2023-12-26 07:32:09,444][123091] Updated weights for policy 0, policy_version 994934 (0.0011) [2023-12-26 07:32:09,499][123090] Updated weights for policy 1, policy_version 987947 (0.0009) [2023-12-26 07:32:09,501][123091] Updated weights for policy 0, policy_version 994944 (0.0011) [2023-12-26 07:32:09,557][123091] Updated weights for policy 0, policy_version 994954 (0.0011) [2023-12-26 07:32:09,560][123090] Updated weights for policy 1, policy_version 987957 (0.0007) [2023-12-26 07:32:09,618][123090] Updated weights for policy 1, policy_version 987967 (0.0007) [2023-12-26 07:32:10,406][123091] Updated weights for policy 0, policy_version 994964 (0.0011) [2023-12-26 07:32:10,463][123090] Updated weights for policy 1, policy_version 987977 (0.0007) [2023-12-26 07:32:10,468][123091] Updated weights for policy 0, policy_version 994974 (0.0011) [2023-12-26 07:32:10,522][123090] Updated weights for policy 1, policy_version 987987 (0.0006) [2023-12-26 07:32:10,528][123091] Updated weights for policy 0, policy_version 994984 (0.0011) [2023-12-26 07:32:10,577][123090] Updated weights for policy 1, policy_version 987997 (0.0006) [2023-12-26 07:32:11,333][123091] Updated weights for policy 0, policy_version 994994 (0.0010) [2023-12-26 07:32:11,418][123091] Updated weights for policy 0, policy_version 995004 (0.0009) [2023-12-26 07:32:11,451][123090] Updated weights for policy 1, policy_version 988007 (0.0008) [2023-12-26 07:32:11,488][123091] Updated weights for policy 0, policy_version 995014 (0.0008) [2023-12-26 07:32:11,516][123090] Updated weights for policy 1, policy_version 988017 (0.0007) [2023-12-26 07:32:11,555][123091] Updated weights for policy 0, policy_version 995024 (0.0009) [2023-12-26 07:32:11,578][123090] Updated weights for policy 1, policy_version 988027 (0.0007) [2023-12-26 07:32:12,389][123091] Updated weights for policy 0, policy_version 995034 (0.0010) [2023-12-26 07:32:12,402][123090] Updated weights for policy 1, policy_version 988037 (0.0009) [2023-12-26 07:32:12,456][123091] Updated weights for policy 0, policy_version 995044 (0.0006) [2023-12-26 07:32:12,462][123090] Updated weights for policy 1, policy_version 988047 (0.0008) [2023-12-26 07:32:12,521][123091] Updated weights for policy 0, policy_version 995054 (0.0006) [2023-12-26 07:32:12,531][123090] Updated weights for policy 1, policy_version 988057 (0.0009) [2023-12-26 07:32:13,283][123091] Updated weights for policy 0, policy_version 995064 (0.0008) [2023-12-26 07:32:13,310][123090] Updated weights for policy 1, policy_version 988067 (0.0008) [2023-12-26 07:32:13,356][123091] Updated weights for policy 0, policy_version 995074 (0.0009) [2023-12-26 07:32:13,374][123090] Updated weights for policy 1, policy_version 988077 (0.0006) [2023-12-26 07:32:13,406][123091] Updated weights for policy 0, policy_version 995085 (0.0008) [2023-12-26 07:32:13,439][123090] Updated weights for policy 1, policy_version 988087 (0.0009) [2023-12-26 07:32:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 507699200. Throughput: 0: 9050.7, 1: 8701.7. Samples: 507690076. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:13,785][121949] Avg episode reward: [(0, '6082.254'), (1, '5817.176')] [2023-12-26 07:32:14,226][123090] Updated weights for policy 1, policy_version 988097 (0.0009) [2023-12-26 07:32:14,256][123091] Updated weights for policy 0, policy_version 995095 (0.0009) [2023-12-26 07:32:14,290][123090] Updated weights for policy 1, policy_version 988107 (0.0007) [2023-12-26 07:32:14,316][123091] Updated weights for policy 0, policy_version 995105 (0.0008) [2023-12-26 07:32:14,352][123090] Updated weights for policy 1, policy_version 988117 (0.0006) [2023-12-26 07:32:14,380][123091] Updated weights for policy 0, policy_version 995115 (0.0007) [2023-12-26 07:32:14,411][123090] Updated weights for policy 1, policy_version 988127 (0.0007) [2023-12-26 07:32:15,133][123090] Updated weights for policy 1, policy_version 988137 (0.0009) [2023-12-26 07:32:15,205][123090] Updated weights for policy 1, policy_version 988147 (0.0009) [2023-12-26 07:32:15,207][123091] Updated weights for policy 0, policy_version 995125 (0.0006) [2023-12-26 07:32:15,268][123090] Updated weights for policy 1, policy_version 988157 (0.0009) [2023-12-26 07:32:15,271][123091] Updated weights for policy 0, policy_version 995135 (0.0007) [2023-12-26 07:32:15,319][123091] Updated weights for policy 0, policy_version 995145 (0.0008) [2023-12-26 07:32:16,085][123091] Updated weights for policy 0, policy_version 995155 (0.0009) [2023-12-26 07:32:16,102][123090] Updated weights for policy 1, policy_version 988167 (0.0007) [2023-12-26 07:32:16,134][123091] Updated weights for policy 0, policy_version 995165 (0.0010) [2023-12-26 07:32:16,166][123090] Updated weights for policy 1, policy_version 988177 (0.0005) [2023-12-26 07:32:16,178][123091] Updated weights for policy 0, policy_version 995175 (0.0010) [2023-12-26 07:32:16,241][123090] Updated weights for policy 1, policy_version 988187 (0.0005) [2023-12-26 07:32:16,857][123091] Updated weights for policy 0, policy_version 995185 (0.0009) [2023-12-26 07:32:16,913][123091] Updated weights for policy 0, policy_version 995195 (0.0005) [2023-12-26 07:32:16,967][123091] Updated weights for policy 0, policy_version 995205 (0.0005) [2023-12-26 07:32:16,974][123090] Updated weights for policy 1, policy_version 988197 (0.0008) [2023-12-26 07:32:17,012][123091] Updated weights for policy 0, policy_version 995215 (0.0005) [2023-12-26 07:32:17,034][123090] Updated weights for policy 1, policy_version 988207 (0.0010) [2023-12-26 07:32:17,092][123090] Updated weights for policy 1, policy_version 988217 (0.0010) [2023-12-26 07:32:17,708][123091] Updated weights for policy 0, policy_version 995225 (0.0010) [2023-12-26 07:32:17,763][123091] Updated weights for policy 0, policy_version 995235 (0.0010) [2023-12-26 07:32:17,825][123091] Updated weights for policy 0, policy_version 995245 (0.0010) [2023-12-26 07:32:17,912][123090] Updated weights for policy 1, policy_version 988227 (0.0010) [2023-12-26 07:32:17,966][123090] Updated weights for policy 1, policy_version 988237 (0.0010) [2023-12-26 07:32:18,021][123090] Updated weights for policy 1, policy_version 988247 (0.0010) [2023-12-26 07:32:18,675][123091] Updated weights for policy 0, policy_version 995255 (0.0011) [2023-12-26 07:32:18,745][123091] Updated weights for policy 0, policy_version 995265 (0.0011) [2023-12-26 07:32:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 507781120. Throughput: 0: 9072.7, 1: 8762.8. Samples: 507799324. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:18,785][121949] Avg episode reward: [(0, '6192.498'), (1, '5879.113')] [2023-12-26 07:32:18,808][123091] Updated weights for policy 0, policy_version 995275 (0.0011) [2023-12-26 07:32:18,880][123090] Updated weights for policy 1, policy_version 988257 (0.0011) [2023-12-26 07:32:18,951][123090] Updated weights for policy 1, policy_version 988267 (0.0011) [2023-12-26 07:32:19,023][123090] Updated weights for policy 1, policy_version 988277 (0.0007) [2023-12-26 07:32:19,089][123090] Updated weights for policy 1, policy_version 988287 (0.0009) [2023-12-26 07:32:19,623][123091] Updated weights for policy 0, policy_version 995285 (0.0011) [2023-12-26 07:32:19,683][123091] Updated weights for policy 0, policy_version 995295 (0.0011) [2023-12-26 07:32:19,747][123091] Updated weights for policy 0, policy_version 995305 (0.0011) [2023-12-26 07:32:19,845][123090] Updated weights for policy 1, policy_version 988297 (0.0010) [2023-12-26 07:32:19,916][123090] Updated weights for policy 1, policy_version 988307 (0.0010) [2023-12-26 07:32:19,984][123090] Updated weights for policy 1, policy_version 988317 (0.0009) [2023-12-26 07:32:20,611][123091] Updated weights for policy 0, policy_version 995315 (0.0011) [2023-12-26 07:32:20,675][123091] Updated weights for policy 0, policy_version 995325 (0.0010) [2023-12-26 07:32:20,742][123091] Updated weights for policy 0, policy_version 995335 (0.0010) [2023-12-26 07:32:20,834][123090] Updated weights for policy 1, policy_version 988327 (0.0009) [2023-12-26 07:32:20,885][123090] Updated weights for policy 1, policy_version 988337 (0.0010) [2023-12-26 07:32:20,939][123090] Updated weights for policy 1, policy_version 988347 (0.0010) [2023-12-26 07:32:21,563][123091] Updated weights for policy 0, policy_version 995345 (0.0010) [2023-12-26 07:32:21,613][123091] Updated weights for policy 0, policy_version 995355 (0.0010) [2023-12-26 07:32:21,678][123091] Updated weights for policy 0, policy_version 995365 (0.0010) [2023-12-26 07:32:21,747][123091] Updated weights for policy 0, policy_version 995375 (0.0009) [2023-12-26 07:32:21,821][123090] Updated weights for policy 1, policy_version 988357 (0.0009) [2023-12-26 07:32:21,874][123090] Updated weights for policy 1, policy_version 988367 (0.0009) [2023-12-26 07:32:21,936][123090] Updated weights for policy 1, policy_version 988377 (0.0010) [2023-12-26 07:32:22,563][123091] Updated weights for policy 0, policy_version 995385 (0.0010) [2023-12-26 07:32:22,614][123091] Updated weights for policy 0, policy_version 995395 (0.0010) [2023-12-26 07:32:22,661][123091] Updated weights for policy 0, policy_version 995405 (0.0010) [2023-12-26 07:32:22,806][123090] Updated weights for policy 1, policy_version 988387 (0.0009) [2023-12-26 07:32:22,880][123090] Updated weights for policy 1, policy_version 988397 (0.0011) [2023-12-26 07:32:22,938][123090] Updated weights for policy 1, policy_version 988407 (0.0010) [2023-12-26 07:32:23,494][123091] Updated weights for policy 0, policy_version 995415 (0.0009) [2023-12-26 07:32:23,555][123091] Updated weights for policy 0, policy_version 995425 (0.0009) [2023-12-26 07:32:23,624][123091] Updated weights for policy 0, policy_version 995435 (0.0007) [2023-12-26 07:32:23,752][123090] Updated weights for policy 1, policy_version 988417 (0.0010) [2023-12-26 07:32:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 507871232. Throughput: 0: 9073.9, 1: 8737.8. Samples: 507849396. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:23,785][121949] Avg episode reward: [(0, '6181.966'), (1, '5965.780')] [2023-12-26 07:32:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000995440_254836736.pth... [2023-12-26 07:32:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000994384_254566400.pth [2023-12-26 07:32:23,821][123090] Updated weights for policy 1, policy_version 988427 (0.0008) [2023-12-26 07:32:23,875][123090] Updated weights for policy 1, policy_version 988437 (0.0010) [2023-12-26 07:32:23,938][123090] Updated weights for policy 1, policy_version 988447 (0.0010) [2023-12-26 07:32:23,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000988448_253042688.pth... [2023-12-26 07:32:23,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000987392_252772352.pth [2023-12-26 07:32:24,257][123091] Updated weights for policy 0, policy_version 995445 (0.0005) [2023-12-26 07:32:24,318][123091] Updated weights for policy 0, policy_version 995455 (0.0008) [2023-12-26 07:32:24,383][123091] Updated weights for policy 0, policy_version 995465 (0.0007) [2023-12-26 07:32:24,676][123090] Updated weights for policy 1, policy_version 988457 (0.0010) [2023-12-26 07:32:24,720][123090] Updated weights for policy 1, policy_version 988467 (0.0010) [2023-12-26 07:32:24,780][123090] Updated weights for policy 1, policy_version 988477 (0.0010) [2023-12-26 07:32:25,065][123091] Updated weights for policy 0, policy_version 995475 (0.0007) [2023-12-26 07:32:25,115][123091] Updated weights for policy 0, policy_version 995485 (0.0005) [2023-12-26 07:32:25,170][123091] Updated weights for policy 0, policy_version 995495 (0.0005) [2023-12-26 07:32:25,512][123090] Updated weights for policy 1, policy_version 988487 (0.0010) [2023-12-26 07:32:25,566][123090] Updated weights for policy 1, policy_version 988497 (0.0010) [2023-12-26 07:32:25,614][123090] Updated weights for policy 1, policy_version 988507 (0.0010) [2023-12-26 07:32:25,955][123091] Updated weights for policy 0, policy_version 995505 (0.0006) [2023-12-26 07:32:26,017][123091] Updated weights for policy 0, policy_version 995515 (0.0011) [2023-12-26 07:32:26,072][123091] Updated weights for policy 0, policy_version 995525 (0.0011) [2023-12-26 07:32:26,138][123091] Updated weights for policy 0, policy_version 995535 (0.0011) [2023-12-26 07:32:26,409][123090] Updated weights for policy 1, policy_version 988517 (0.0010) [2023-12-26 07:32:26,461][123090] Updated weights for policy 1, policy_version 988527 (0.0010) [2023-12-26 07:32:26,525][123090] Updated weights for policy 1, policy_version 988537 (0.0011) [2023-12-26 07:32:26,854][123091] Updated weights for policy 0, policy_version 995545 (0.0006) [2023-12-26 07:32:26,908][123091] Updated weights for policy 0, policy_version 995555 (0.0006) [2023-12-26 07:32:26,955][123091] Updated weights for policy 0, policy_version 995565 (0.0005) [2023-12-26 07:32:27,356][123090] Updated weights for policy 1, policy_version 988547 (0.0010) [2023-12-26 07:32:27,407][123090] Updated weights for policy 1, policy_version 988557 (0.0010) [2023-12-26 07:32:27,462][123090] Updated weights for policy 1, policy_version 988567 (0.0010) [2023-12-26 07:32:27,646][123091] Updated weights for policy 0, policy_version 995575 (0.0006) [2023-12-26 07:32:27,704][123091] Updated weights for policy 0, policy_version 995585 (0.0008) [2023-12-26 07:32:27,752][123091] Updated weights for policy 0, policy_version 995595 (0.0009) [2023-12-26 07:32:28,294][123090] Updated weights for policy 1, policy_version 988577 (0.0010) [2023-12-26 07:32:28,365][123090] Updated weights for policy 1, policy_version 988587 (0.0009) [2023-12-26 07:32:28,431][123090] Updated weights for policy 1, policy_version 988597 (0.0008) [2023-12-26 07:32:28,497][123090] Updated weights for policy 1, policy_version 988607 (0.0008) [2023-12-26 07:32:28,588][123091] Updated weights for policy 0, policy_version 995605 (0.0009) [2023-12-26 07:32:28,646][123091] Updated weights for policy 0, policy_version 995615 (0.0010) [2023-12-26 07:32:28,714][123091] Updated weights for policy 0, policy_version 995625 (0.0010) [2023-12-26 07:32:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 507969536. Throughput: 0: 9139.6, 1: 8723.2. Samples: 507958572. Policy #0 lag: (min: 34.0, avg: 54.0, max: 56.0) [2023-12-26 07:32:28,785][121949] Avg episode reward: [(0, '6205.604'), (1, '5975.339')] [2023-12-26 07:32:29,217][123090] Updated weights for policy 1, policy_version 988617 (0.0010) [2023-12-26 07:32:29,289][123090] Updated weights for policy 1, policy_version 988627 (0.0010) [2023-12-26 07:32:29,357][123090] Updated weights for policy 1, policy_version 988637 (0.0011) [2023-12-26 07:32:29,624][123091] Updated weights for policy 0, policy_version 995635 (0.0009) [2023-12-26 07:32:29,688][123091] Updated weights for policy 0, policy_version 995645 (0.0009) [2023-12-26 07:32:29,754][123091] Updated weights for policy 0, policy_version 995655 (0.0008) [2023-12-26 07:32:30,145][123090] Updated weights for policy 1, policy_version 988647 (0.0009) [2023-12-26 07:32:30,203][123090] Updated weights for policy 1, policy_version 988657 (0.0005) [2023-12-26 07:32:30,258][123090] Updated weights for policy 1, policy_version 988667 (0.0005) [2023-12-26 07:32:30,653][123091] Updated weights for policy 0, policy_version 995665 (0.0009) [2023-12-26 07:32:30,709][123091] Updated weights for policy 0, policy_version 995675 (0.0009) [2023-12-26 07:32:30,768][123091] Updated weights for policy 0, policy_version 995685 (0.0008) [2023-12-26 07:32:30,831][123091] Updated weights for policy 0, policy_version 995695 (0.0009) [2023-12-26 07:32:30,983][123090] Updated weights for policy 1, policy_version 988677 (0.0008) [2023-12-26 07:32:31,040][123090] Updated weights for policy 1, policy_version 988687 (0.0010) [2023-12-26 07:32:31,095][123090] Updated weights for policy 1, policy_version 988697 (0.0010) [2023-12-26 07:32:31,696][123091] Updated weights for policy 0, policy_version 995705 (0.0009) [2023-12-26 07:32:31,768][123091] Updated weights for policy 0, policy_version 995715 (0.0008) [2023-12-26 07:32:31,833][123091] Updated weights for policy 0, policy_version 995725 (0.0009) [2023-12-26 07:32:31,922][123090] Updated weights for policy 1, policy_version 988707 (0.0009) [2023-12-26 07:32:31,977][123090] Updated weights for policy 1, policy_version 988717 (0.0010) [2023-12-26 07:32:32,034][123090] Updated weights for policy 1, policy_version 988727 (0.0008) [2023-12-26 07:32:32,579][123091] Updated weights for policy 0, policy_version 995735 (0.0006) [2023-12-26 07:32:32,644][123091] Updated weights for policy 0, policy_version 995745 (0.0009) [2023-12-26 07:32:32,706][123091] Updated weights for policy 0, policy_version 995755 (0.0009) [2023-12-26 07:32:32,853][123090] Updated weights for policy 1, policy_version 988737 (0.0006) [2023-12-26 07:32:32,916][123090] Updated weights for policy 1, policy_version 988747 (0.0011) [2023-12-26 07:32:32,963][123090] Updated weights for policy 1, policy_version 988757 (0.0010) [2023-12-26 07:32:33,016][123090] Updated weights for policy 1, policy_version 988767 (0.0010) [2023-12-26 07:32:33,534][123091] Updated weights for policy 0, policy_version 995765 (0.0008) [2023-12-26 07:32:33,597][123091] Updated weights for policy 0, policy_version 995775 (0.0009) [2023-12-26 07:32:33,644][123091] Updated weights for policy 0, policy_version 995785 (0.0008) [2023-12-26 07:32:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 508051456. Throughput: 0: 9035.0, 1: 8769.7. Samples: 508062252. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:33,785][121949] Avg episode reward: [(0, '6327.628'), (1, '5982.469')] [2023-12-26 07:32:33,871][123090] Updated weights for policy 1, policy_version 988777 (0.0010) [2023-12-26 07:32:33,922][123090] Updated weights for policy 1, policy_version 988787 (0.0010) [2023-12-26 07:32:33,973][123090] Updated weights for policy 1, policy_version 988797 (0.0010) [2023-12-26 07:32:34,391][123091] Updated weights for policy 0, policy_version 995795 (0.0009) [2023-12-26 07:32:34,451][123091] Updated weights for policy 0, policy_version 995805 (0.0006) [2023-12-26 07:32:34,518][123091] Updated weights for policy 0, policy_version 995815 (0.0005) [2023-12-26 07:32:34,807][123090] Updated weights for policy 1, policy_version 988807 (0.0007) [2023-12-26 07:32:34,856][123090] Updated weights for policy 1, policy_version 988817 (0.0007) [2023-12-26 07:32:34,902][123090] Updated weights for policy 1, policy_version 988827 (0.0008) [2023-12-26 07:32:35,273][123091] Updated weights for policy 0, policy_version 995825 (0.0008) [2023-12-26 07:32:35,341][123091] Updated weights for policy 0, policy_version 995835 (0.0010) [2023-12-26 07:32:35,391][123091] Updated weights for policy 0, policy_version 995846 (0.0009) [2023-12-26 07:32:35,452][123091] Updated weights for policy 0, policy_version 995856 (0.0006) [2023-12-26 07:32:35,676][123090] Updated weights for policy 1, policy_version 988837 (0.0009) [2023-12-26 07:32:35,723][123090] Updated weights for policy 1, policy_version 988847 (0.0010) [2023-12-26 07:32:35,776][123090] Updated weights for policy 1, policy_version 988857 (0.0005) [2023-12-26 07:32:36,316][123091] Updated weights for policy 0, policy_version 995866 (0.0010) [2023-12-26 07:32:36,377][123091] Updated weights for policy 0, policy_version 995876 (0.0009) [2023-12-26 07:32:36,448][123091] Updated weights for policy 0, policy_version 995886 (0.0010) [2023-12-26 07:32:36,529][123090] Updated weights for policy 1, policy_version 988867 (0.0007) [2023-12-26 07:32:36,593][123090] Updated weights for policy 1, policy_version 988877 (0.0010) [2023-12-26 07:32:36,659][123090] Updated weights for policy 1, policy_version 988887 (0.0010) [2023-12-26 07:32:37,273][123091] Updated weights for policy 0, policy_version 995896 (0.0010) [2023-12-26 07:32:37,325][123091] Updated weights for policy 0, policy_version 995906 (0.0005) [2023-12-26 07:32:37,376][123090] Updated weights for policy 1, policy_version 988897 (0.0010) [2023-12-26 07:32:37,384][123091] Updated weights for policy 0, policy_version 995916 (0.0005) [2023-12-26 07:32:37,436][123090] Updated weights for policy 1, policy_version 988907 (0.0005) [2023-12-26 07:32:37,495][123090] Updated weights for policy 1, policy_version 988917 (0.0005) [2023-12-26 07:32:37,542][123090] Updated weights for policy 1, policy_version 988927 (0.0005) [2023-12-26 07:32:38,111][123091] Updated weights for policy 0, policy_version 995926 (0.0005) [2023-12-26 07:32:38,165][123091] Updated weights for policy 0, policy_version 995936 (0.0005) [2023-12-26 07:32:38,188][123090] Updated weights for policy 1, policy_version 988937 (0.0005) [2023-12-26 07:32:38,216][123091] Updated weights for policy 0, policy_version 995946 (0.0007) [2023-12-26 07:32:38,251][123090] Updated weights for policy 1, policy_version 988947 (0.0005) [2023-12-26 07:32:38,315][123090] Updated weights for policy 1, policy_version 988957 (0.0008) [2023-12-26 07:32:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 508141568. Throughput: 0: 8995.5, 1: 8850.9. Samples: 508116776. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:38,785][121949] Avg episode reward: [(0, '6182.431'), (1, '5965.081')] [2023-12-26 07:32:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000995952_254967808.pth... [2023-12-26 07:32:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000988960_253173760.pth... [2023-12-26 07:32:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000994928_254705664.pth [2023-12-26 07:32:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000987936_252911616.pth [2023-12-26 07:32:38,974][123091] Updated weights for policy 0, policy_version 995956 (0.0006) [2023-12-26 07:32:39,042][123091] Updated weights for policy 0, policy_version 995966 (0.0005) [2023-12-26 07:32:39,089][123090] Updated weights for policy 1, policy_version 988967 (0.0010) [2023-12-26 07:32:39,108][123091] Updated weights for policy 0, policy_version 995976 (0.0008) [2023-12-26 07:32:39,144][123090] Updated weights for policy 1, policy_version 988977 (0.0010) [2023-12-26 07:32:39,203][123090] Updated weights for policy 1, policy_version 988987 (0.0010) [2023-12-26 07:32:39,837][123091] Updated weights for policy 0, policy_version 995986 (0.0006) [2023-12-26 07:32:39,910][123091] Updated weights for policy 0, policy_version 995996 (0.0008) [2023-12-26 07:32:39,982][123091] Updated weights for policy 0, policy_version 996006 (0.0008) [2023-12-26 07:32:40,049][123091] Updated weights for policy 0, policy_version 996016 (0.0008) [2023-12-26 07:32:40,136][123090] Updated weights for policy 1, policy_version 988997 (0.0010) [2023-12-26 07:32:40,195][123090] Updated weights for policy 1, policy_version 989007 (0.0009) [2023-12-26 07:32:40,257][123090] Updated weights for policy 1, policy_version 989017 (0.0009) [2023-12-26 07:32:40,900][123091] Updated weights for policy 0, policy_version 996026 (0.0008) [2023-12-26 07:32:40,939][123090] Updated weights for policy 1, policy_version 989027 (0.0008) [2023-12-26 07:32:40,963][123091] Updated weights for policy 0, policy_version 996036 (0.0010) [2023-12-26 07:32:40,996][123090] Updated weights for policy 1, policy_version 989037 (0.0006) [2023-12-26 07:32:41,033][123091] Updated weights for policy 0, policy_version 996046 (0.0008) [2023-12-26 07:32:41,065][123090] Updated weights for policy 1, policy_version 989047 (0.0007) [2023-12-26 07:32:41,850][123090] Updated weights for policy 1, policy_version 989057 (0.0007) [2023-12-26 07:32:41,912][123090] Updated weights for policy 1, policy_version 989067 (0.0005) [2023-12-26 07:32:41,948][123091] Updated weights for policy 0, policy_version 996056 (0.0009) [2023-12-26 07:32:41,964][123090] Updated weights for policy 1, policy_version 989077 (0.0006) [2023-12-26 07:32:42,010][123091] Updated weights for policy 0, policy_version 996066 (0.0009) [2023-12-26 07:32:42,026][123090] Updated weights for policy 1, policy_version 989087 (0.0006) [2023-12-26 07:32:42,078][123091] Updated weights for policy 0, policy_version 996076 (0.0009) [2023-12-26 07:32:42,825][123090] Updated weights for policy 1, policy_version 989097 (0.0009) [2023-12-26 07:32:42,882][123090] Updated weights for policy 1, policy_version 989107 (0.0009) [2023-12-26 07:32:42,923][123091] Updated weights for policy 0, policy_version 996086 (0.0009) [2023-12-26 07:32:42,944][123090] Updated weights for policy 1, policy_version 989117 (0.0010) [2023-12-26 07:32:42,987][123091] Updated weights for policy 0, policy_version 996096 (0.0009) [2023-12-26 07:32:43,051][123091] Updated weights for policy 0, policy_version 996106 (0.0008) [2023-12-26 07:32:43,743][123090] Updated weights for policy 1, policy_version 989127 (0.0010) [2023-12-26 07:32:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 508223488. Throughput: 0: 8873.7, 1: 8897.1. Samples: 508223908. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:43,785][121949] Avg episode reward: [(0, '5968.030'), (1, '5965.179')] [2023-12-26 07:32:43,804][123090] Updated weights for policy 1, policy_version 989137 (0.0010) [2023-12-26 07:32:43,853][123090] Updated weights for policy 1, policy_version 989147 (0.0009) [2023-12-26 07:32:43,899][123091] Updated weights for policy 0, policy_version 996116 (0.0009) [2023-12-26 07:32:43,944][123091] Updated weights for policy 0, policy_version 996126 (0.0007) [2023-12-26 07:32:43,999][123091] Updated weights for policy 0, policy_version 996136 (0.0005) [2023-12-26 07:32:44,711][123090] Updated weights for policy 1, policy_version 989157 (0.0010) [2023-12-26 07:32:44,792][123090] Updated weights for policy 1, policy_version 989167 (0.0009) [2023-12-26 07:32:44,796][123091] Updated weights for policy 0, policy_version 996146 (0.0006) [2023-12-26 07:32:44,852][123090] Updated weights for policy 1, policy_version 989177 (0.0007) [2023-12-26 07:32:44,861][123091] Updated weights for policy 0, policy_version 996156 (0.0007) [2023-12-26 07:32:44,925][123091] Updated weights for policy 0, policy_version 996166 (0.0008) [2023-12-26 07:32:44,996][123091] Updated weights for policy 0, policy_version 996176 (0.0008) [2023-12-26 07:32:45,681][123090] Updated weights for policy 1, policy_version 989187 (0.0008) [2023-12-26 07:32:45,755][123090] Updated weights for policy 1, policy_version 989197 (0.0006) [2023-12-26 07:32:45,783][123091] Updated weights for policy 0, policy_version 996186 (0.0011) [2023-12-26 07:32:45,805][123090] Updated weights for policy 1, policy_version 989207 (0.0007) [2023-12-26 07:32:45,834][123091] Updated weights for policy 0, policy_version 996196 (0.0010) [2023-12-26 07:32:45,900][123091] Updated weights for policy 0, policy_version 996206 (0.0010) [2023-12-26 07:32:46,419][123090] Updated weights for policy 1, policy_version 989217 (0.0009) [2023-12-26 07:32:46,468][123090] Updated weights for policy 1, policy_version 989227 (0.0005) [2023-12-26 07:32:46,532][123090] Updated weights for policy 1, policy_version 989237 (0.0005) [2023-12-26 07:32:46,602][123090] Updated weights for policy 1, policy_version 989247 (0.0007) [2023-12-26 07:32:46,652][123091] Updated weights for policy 0, policy_version 996216 (0.0010) [2023-12-26 07:32:46,708][123091] Updated weights for policy 0, policy_version 996226 (0.0009) [2023-12-26 07:32:46,763][123091] Updated weights for policy 0, policy_version 996236 (0.0010) [2023-12-26 07:32:47,300][123090] Updated weights for policy 1, policy_version 989257 (0.0006) [2023-12-26 07:32:47,358][123090] Updated weights for policy 1, policy_version 989267 (0.0005) [2023-12-26 07:32:47,403][123090] Updated weights for policy 1, policy_version 989277 (0.0005) [2023-12-26 07:32:47,656][123091] Updated weights for policy 0, policy_version 996246 (0.0010) [2023-12-26 07:32:47,721][123091] Updated weights for policy 0, policy_version 996256 (0.0010) [2023-12-26 07:32:47,784][123091] Updated weights for policy 0, policy_version 996266 (0.0009) [2023-12-26 07:32:48,117][123090] Updated weights for policy 1, policy_version 989287 (0.0005) [2023-12-26 07:32:48,165][123090] Updated weights for policy 1, policy_version 989297 (0.0005) [2023-12-26 07:32:48,228][123090] Updated weights for policy 1, policy_version 989307 (0.0005) [2023-12-26 07:32:48,544][123091] Updated weights for policy 0, policy_version 996276 (0.0010) [2023-12-26 07:32:48,612][123091] Updated weights for policy 0, policy_version 996286 (0.0011) [2023-12-26 07:32:48,675][123091] Updated weights for policy 0, policy_version 996296 (0.0011) [2023-12-26 07:32:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 508321792. Throughput: 0: 8844.9, 1: 8929.0. Samples: 508332224. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:48,785][121949] Avg episode reward: [(0, '5975.723'), (1, '5929.697')] [2023-12-26 07:32:48,936][123090] Updated weights for policy 1, policy_version 989317 (0.0007) [2023-12-26 07:32:48,995][123090] Updated weights for policy 1, policy_version 989327 (0.0010) [2023-12-26 07:32:49,051][123090] Updated weights for policy 1, policy_version 989337 (0.0010) [2023-12-26 07:32:49,326][123091] Updated weights for policy 0, policy_version 996306 (0.0010) [2023-12-26 07:32:49,393][123091] Updated weights for policy 0, policy_version 996316 (0.0009) [2023-12-26 07:32:49,463][123091] Updated weights for policy 0, policy_version 996326 (0.0011) [2023-12-26 07:32:49,537][123091] Updated weights for policy 0, policy_version 996336 (0.0011) [2023-12-26 07:32:49,869][123090] Updated weights for policy 1, policy_version 989347 (0.0009) [2023-12-26 07:32:49,949][123090] Updated weights for policy 1, policy_version 989357 (0.0009) [2023-12-26 07:32:50,025][123090] Updated weights for policy 1, policy_version 989367 (0.0010) [2023-12-26 07:32:50,371][123091] Updated weights for policy 0, policy_version 996346 (0.0009) [2023-12-26 07:32:50,449][123091] Updated weights for policy 0, policy_version 996356 (0.0006) [2023-12-26 07:32:50,508][123091] Updated weights for policy 0, policy_version 996366 (0.0010) [2023-12-26 07:32:50,874][123090] Updated weights for policy 1, policy_version 989377 (0.0009) [2023-12-26 07:32:50,943][123090] Updated weights for policy 1, policy_version 989387 (0.0010) [2023-12-26 07:32:51,014][123090] Updated weights for policy 1, policy_version 989397 (0.0009) [2023-12-26 07:32:51,080][123090] Updated weights for policy 1, policy_version 989407 (0.0009) [2023-12-26 07:32:51,328][123091] Updated weights for policy 0, policy_version 996376 (0.0010) [2023-12-26 07:32:51,394][123091] Updated weights for policy 0, policy_version 996386 (0.0010) [2023-12-26 07:32:51,448][123091] Updated weights for policy 0, policy_version 996396 (0.0009) [2023-12-26 07:32:51,914][123090] Updated weights for policy 1, policy_version 989417 (0.0009) [2023-12-26 07:32:51,973][123090] Updated weights for policy 1, policy_version 989427 (0.0010) [2023-12-26 07:32:52,028][123090] Updated weights for policy 1, policy_version 989437 (0.0009) [2023-12-26 07:32:52,229][123091] Updated weights for policy 0, policy_version 996406 (0.0007) [2023-12-26 07:32:52,292][123091] Updated weights for policy 0, policy_version 996416 (0.0007) [2023-12-26 07:32:52,361][123091] Updated weights for policy 0, policy_version 996426 (0.0010) [2023-12-26 07:32:52,866][123090] Updated weights for policy 1, policy_version 989447 (0.0006) [2023-12-26 07:32:52,935][123090] Updated weights for policy 1, policy_version 989457 (0.0008) [2023-12-26 07:32:53,005][123090] Updated weights for policy 1, policy_version 989467 (0.0010) [2023-12-26 07:32:53,188][123091] Updated weights for policy 0, policy_version 996436 (0.0010) [2023-12-26 07:32:53,248][123091] Updated weights for policy 0, policy_version 996446 (0.0008) [2023-12-26 07:32:53,307][123091] Updated weights for policy 0, policy_version 996456 (0.0009) [2023-12-26 07:32:53,764][123090] Updated weights for policy 1, policy_version 989477 (0.0010) [2023-12-26 07:32:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 508403712. Throughput: 0: 8780.1, 1: 8858.6. Samples: 508383092. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:53,785][121949] Avg episode reward: [(0, '6105.699'), (1, '5966.263')] [2023-12-26 07:32:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000996464_255098880.pth... [2023-12-26 07:32:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000995440_254836736.pth [2023-12-26 07:32:53,825][123090] Updated weights for policy 1, policy_version 989487 (0.0007) [2023-12-26 07:32:53,889][123090] Updated weights for policy 1, policy_version 989497 (0.0005) [2023-12-26 07:32:53,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000989504_253313024.pth... [2023-12-26 07:32:53,934][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000988448_253042688.pth [2023-12-26 07:32:54,180][123091] Updated weights for policy 0, policy_version 996466 (0.0009) [2023-12-26 07:32:54,260][123091] Updated weights for policy 0, policy_version 996476 (0.0009) [2023-12-26 07:32:54,325][123091] Updated weights for policy 0, policy_version 996486 (0.0009) [2023-12-26 07:32:54,393][123091] Updated weights for policy 0, policy_version 996496 (0.0007) [2023-12-26 07:32:54,616][123090] Updated weights for policy 1, policy_version 989507 (0.0006) [2023-12-26 07:32:54,670][123090] Updated weights for policy 1, policy_version 989517 (0.0010) [2023-12-26 07:32:54,722][123090] Updated weights for policy 1, policy_version 989527 (0.0009) [2023-12-26 07:32:55,193][123091] Updated weights for policy 0, policy_version 996506 (0.0010) [2023-12-26 07:32:55,252][123091] Updated weights for policy 0, policy_version 996516 (0.0010) [2023-12-26 07:32:55,306][123091] Updated weights for policy 0, policy_version 996526 (0.0010) [2023-12-26 07:32:55,489][123090] Updated weights for policy 1, policy_version 989537 (0.0009) [2023-12-26 07:32:55,555][123090] Updated weights for policy 1, policy_version 989547 (0.0009) [2023-12-26 07:32:55,614][123090] Updated weights for policy 1, policy_version 989557 (0.0009) [2023-12-26 07:32:55,661][123090] Updated weights for policy 1, policy_version 989567 (0.0008) [2023-12-26 07:32:56,165][123091] Updated weights for policy 0, policy_version 996536 (0.0006) [2023-12-26 07:32:56,223][123091] Updated weights for policy 0, policy_version 996546 (0.0006) [2023-12-26 07:32:56,270][123091] Updated weights for policy 0, policy_version 996556 (0.0005) [2023-12-26 07:32:56,379][123090] Updated weights for policy 1, policy_version 989577 (0.0006) [2023-12-26 07:32:56,444][123090] Updated weights for policy 1, policy_version 989587 (0.0006) [2023-12-26 07:32:56,492][123090] Updated weights for policy 1, policy_version 989597 (0.0005) [2023-12-26 07:32:57,040][123091] Updated weights for policy 0, policy_version 996566 (0.0010) [2023-12-26 07:32:57,095][123091] Updated weights for policy 0, policy_version 996576 (0.0010) [2023-12-26 07:32:57,105][123090] Updated weights for policy 1, policy_version 989607 (0.0005) [2023-12-26 07:32:57,156][123091] Updated weights for policy 0, policy_version 996586 (0.0005) [2023-12-26 07:32:57,156][123090] Updated weights for policy 1, policy_version 989617 (0.0005) [2023-12-26 07:32:57,231][123090] Updated weights for policy 1, policy_version 989627 (0.0005) [2023-12-26 07:32:57,812][123091] Updated weights for policy 0, policy_version 996596 (0.0006) [2023-12-26 07:32:57,860][123091] Updated weights for policy 0, policy_version 996606 (0.0005) [2023-12-26 07:32:57,922][123091] Updated weights for policy 0, policy_version 996616 (0.0005) [2023-12-26 07:32:57,938][123090] Updated weights for policy 1, policy_version 989637 (0.0008) [2023-12-26 07:32:58,016][123090] Updated weights for policy 1, policy_version 989647 (0.0006) [2023-12-26 07:32:58,087][123090] Updated weights for policy 1, policy_version 989657 (0.0006) [2023-12-26 07:32:58,774][123091] Updated weights for policy 0, policy_version 996626 (0.0007) [2023-12-26 07:32:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 508493824. Throughput: 0: 8813.2, 1: 9014.0. Samples: 508492300. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:32:58,785][121949] Avg episode reward: [(0, '6147.188'), (1, '5948.132')] [2023-12-26 07:32:58,843][123091] Updated weights for policy 0, policy_version 996636 (0.0010) [2023-12-26 07:32:58,884][123090] Updated weights for policy 1, policy_version 989667 (0.0007) [2023-12-26 07:32:58,911][123091] Updated weights for policy 0, policy_version 996646 (0.0010) [2023-12-26 07:32:58,950][123090] Updated weights for policy 1, policy_version 989677 (0.0008) [2023-12-26 07:32:58,971][123091] Updated weights for policy 0, policy_version 996656 (0.0009) [2023-12-26 07:32:59,008][123090] Updated weights for policy 1, policy_version 989687 (0.0008) [2023-12-26 07:32:59,775][123090] Updated weights for policy 1, policy_version 989697 (0.0008) [2023-12-26 07:32:59,775][123091] Updated weights for policy 0, policy_version 996666 (0.0011) [2023-12-26 07:32:59,839][123091] Updated weights for policy 0, policy_version 996676 (0.0012) [2023-12-26 07:32:59,844][123090] Updated weights for policy 1, policy_version 989707 (0.0009) [2023-12-26 07:32:59,903][123091] Updated weights for policy 0, policy_version 996686 (0.0006) [2023-12-26 07:32:59,917][123090] Updated weights for policy 1, policy_version 989717 (0.0006) [2023-12-26 07:32:59,987][123090] Updated weights for policy 1, policy_version 989727 (0.0011) [2023-12-26 07:33:00,702][123091] Updated weights for policy 0, policy_version 996696 (0.0010) [2023-12-26 07:33:00,721][123090] Updated weights for policy 1, policy_version 989737 (0.0006) [2023-12-26 07:33:00,754][123091] Updated weights for policy 0, policy_version 996706 (0.0010) [2023-12-26 07:33:00,765][123090] Updated weights for policy 1, policy_version 989747 (0.0005) [2023-12-26 07:33:00,801][123091] Updated weights for policy 0, policy_version 996716 (0.0010) [2023-12-26 07:33:00,820][123090] Updated weights for policy 1, policy_version 989757 (0.0005) [2023-12-26 07:33:01,641][123090] Updated weights for policy 1, policy_version 989767 (0.0009) [2023-12-26 07:33:01,662][123091] Updated weights for policy 0, policy_version 996726 (0.0009) [2023-12-26 07:33:01,706][123090] Updated weights for policy 1, policy_version 989777 (0.0011) [2023-12-26 07:33:01,731][123091] Updated weights for policy 0, policy_version 996736 (0.0007) [2023-12-26 07:33:01,774][123090] Updated weights for policy 1, policy_version 989787 (0.0011) [2023-12-26 07:33:01,781][123091] Updated weights for policy 0, policy_version 996746 (0.0008) [2023-12-26 07:33:02,583][123090] Updated weights for policy 1, policy_version 989797 (0.0010) [2023-12-26 07:33:02,636][123091] Updated weights for policy 0, policy_version 996756 (0.0007) [2023-12-26 07:33:02,650][123090] Updated weights for policy 1, policy_version 989807 (0.0011) [2023-12-26 07:33:02,697][123091] Updated weights for policy 0, policy_version 996766 (0.0007) [2023-12-26 07:33:02,714][123090] Updated weights for policy 1, policy_version 989817 (0.0011) [2023-12-26 07:33:02,764][123091] Updated weights for policy 0, policy_version 996776 (0.0011) [2023-12-26 07:33:03,521][123090] Updated weights for policy 1, policy_version 989827 (0.0010) [2023-12-26 07:33:03,571][123090] Updated weights for policy 1, policy_version 989837 (0.0007) [2023-12-26 07:33:03,579][123091] Updated weights for policy 0, policy_version 996786 (0.0009) [2023-12-26 07:33:03,623][123090] Updated weights for policy 1, policy_version 989847 (0.0007) [2023-12-26 07:33:03,639][123091] Updated weights for policy 0, policy_version 996797 (0.0009) [2023-12-26 07:33:03,694][123091] Updated weights for policy 0, policy_version 996808 (0.0009) [2023-12-26 07:33:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 508592128. Throughput: 0: 8735.4, 1: 8990.6. Samples: 508596992. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:03,785][121949] Avg episode reward: [(0, '6230.254'), (1, '5918.443')] [2023-12-26 07:33:04,323][123090] Updated weights for policy 1, policy_version 989857 (0.0006) [2023-12-26 07:33:04,386][123090] Updated weights for policy 1, policy_version 989867 (0.0009) [2023-12-26 07:33:04,437][123090] Updated weights for policy 1, policy_version 989877 (0.0009) [2023-12-26 07:33:04,492][123090] Updated weights for policy 1, policy_version 989887 (0.0010) [2023-12-26 07:33:04,561][123091] Updated weights for policy 0, policy_version 996818 (0.0009) [2023-12-26 07:33:04,627][123091] Updated weights for policy 0, policy_version 996828 (0.0011) [2023-12-26 07:33:04,675][123091] Updated weights for policy 0, policy_version 996838 (0.0010) [2023-12-26 07:33:04,738][123091] Updated weights for policy 0, policy_version 996848 (0.0010) [2023-12-26 07:33:05,407][123091] Updated weights for policy 0, policy_version 996858 (0.0005) [2023-12-26 07:33:05,442][123090] Updated weights for policy 1, policy_version 989897 (0.0009) [2023-12-26 07:33:05,453][123091] Updated weights for policy 0, policy_version 996868 (0.0007) [2023-12-26 07:33:05,499][123090] Updated weights for policy 1, policy_version 989907 (0.0008) [2023-12-26 07:33:05,516][123091] Updated weights for policy 0, policy_version 996878 (0.0005) [2023-12-26 07:33:05,565][123090] Updated weights for policy 1, policy_version 989917 (0.0008) [2023-12-26 07:33:06,314][123090] Updated weights for policy 1, policy_version 989927 (0.0009) [2023-12-26 07:33:06,376][123091] Updated weights for policy 0, policy_version 996888 (0.0008) [2023-12-26 07:33:06,383][123090] Updated weights for policy 1, policy_version 989937 (0.0009) [2023-12-26 07:33:06,433][123091] Updated weights for policy 0, policy_version 996898 (0.0009) [2023-12-26 07:33:06,445][123090] Updated weights for policy 1, policy_version 989947 (0.0009) [2023-12-26 07:33:06,490][123091] Updated weights for policy 0, policy_version 996908 (0.0009) [2023-12-26 07:33:07,215][123090] Updated weights for policy 1, policy_version 989957 (0.0007) [2023-12-26 07:33:07,278][123090] Updated weights for policy 1, policy_version 989967 (0.0007) [2023-12-26 07:33:07,294][123091] Updated weights for policy 0, policy_version 996918 (0.0010) [2023-12-26 07:33:07,331][123090] Updated weights for policy 1, policy_version 989977 (0.0007) [2023-12-26 07:33:07,342][123091] Updated weights for policy 0, policy_version 996928 (0.0010) [2023-12-26 07:33:07,397][123091] Updated weights for policy 0, policy_version 996938 (0.0006) [2023-12-26 07:33:08,155][123090] Updated weights for policy 1, policy_version 989987 (0.0007) [2023-12-26 07:33:08,196][123091] Updated weights for policy 0, policy_version 996948 (0.0006) [2023-12-26 07:33:08,203][123090] Updated weights for policy 1, policy_version 989997 (0.0005) [2023-12-26 07:33:08,248][123090] Updated weights for policy 1, policy_version 990007 (0.0006) [2023-12-26 07:33:08,262][123091] Updated weights for policy 0, policy_version 996958 (0.0010) [2023-12-26 07:33:08,334][123091] Updated weights for policy 0, policy_version 996968 (0.0009) [2023-12-26 07:33:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 508674048. Throughput: 0: 8762.9, 1: 9015.4. Samples: 508649420. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:08,785][121949] Avg episode reward: [(0, '6266.197'), (1, '5796.804')] [2023-12-26 07:33:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000996976_255229952.pth... [2023-12-26 07:33:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000990016_253444096.pth... [2023-12-26 07:33:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000988960_253173760.pth [2023-12-26 07:33:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000995952_254967808.pth [2023-12-26 07:33:08,952][123090] Updated weights for policy 1, policy_version 990017 (0.0006) [2023-12-26 07:33:09,028][123090] Updated weights for policy 1, policy_version 990027 (0.0005) [2023-12-26 07:33:09,092][123091] Updated weights for policy 0, policy_version 996978 (0.0008) [2023-12-26 07:33:09,100][123090] Updated weights for policy 1, policy_version 990037 (0.0005) [2023-12-26 07:33:09,150][123091] Updated weights for policy 0, policy_version 996988 (0.0005) [2023-12-26 07:33:09,166][123090] Updated weights for policy 1, policy_version 990047 (0.0007) [2023-12-26 07:33:09,203][123091] Updated weights for policy 0, policy_version 996998 (0.0005) [2023-12-26 07:33:09,267][123091] Updated weights for policy 0, policy_version 997008 (0.0008) [2023-12-26 07:33:09,826][123090] Updated weights for policy 1, policy_version 990057 (0.0010) [2023-12-26 07:33:09,899][123090] Updated weights for policy 1, policy_version 990067 (0.0009) [2023-12-26 07:33:09,965][123090] Updated weights for policy 1, policy_version 990077 (0.0009) [2023-12-26 07:33:09,994][123091] Updated weights for policy 0, policy_version 997018 (0.0009) [2023-12-26 07:33:10,048][123091] Updated weights for policy 0, policy_version 997028 (0.0009) [2023-12-26 07:33:10,115][123091] Updated weights for policy 0, policy_version 997038 (0.0009) [2023-12-26 07:33:10,804][123090] Updated weights for policy 1, policy_version 990087 (0.0010) [2023-12-26 07:33:10,871][123090] Updated weights for policy 1, policy_version 990097 (0.0011) [2023-12-26 07:33:10,927][123090] Updated weights for policy 1, policy_version 990107 (0.0010) [2023-12-26 07:33:10,965][123091] Updated weights for policy 0, policy_version 997048 (0.0008) [2023-12-26 07:33:11,024][123091] Updated weights for policy 0, policy_version 997058 (0.0008) [2023-12-26 07:33:11,096][123091] Updated weights for policy 0, policy_version 997068 (0.0009) [2023-12-26 07:33:11,803][123090] Updated weights for policy 1, policy_version 990117 (0.0008) [2023-12-26 07:33:11,856][123090] Updated weights for policy 1, policy_version 990127 (0.0010) [2023-12-26 07:33:11,919][123090] Updated weights for policy 1, policy_version 990137 (0.0009) [2023-12-26 07:33:11,978][123091] Updated weights for policy 0, policy_version 997078 (0.0008) [2023-12-26 07:33:12,032][123091] Updated weights for policy 0, policy_version 997088 (0.0010) [2023-12-26 07:33:12,095][123091] Updated weights for policy 0, policy_version 997098 (0.0009) [2023-12-26 07:33:12,795][123090] Updated weights for policy 1, policy_version 990147 (0.0009) [2023-12-26 07:33:12,869][123090] Updated weights for policy 1, policy_version 990157 (0.0010) [2023-12-26 07:33:12,924][123090] Updated weights for policy 1, policy_version 990167 (0.0010) [2023-12-26 07:33:12,934][123091] Updated weights for policy 0, policy_version 997108 (0.0010) [2023-12-26 07:33:12,986][123091] Updated weights for policy 0, policy_version 997118 (0.0008) [2023-12-26 07:33:13,052][123091] Updated weights for policy 0, policy_version 997128 (0.0008) [2023-12-26 07:33:13,723][123090] Updated weights for policy 1, policy_version 990177 (0.0009) [2023-12-26 07:33:13,784][123090] Updated weights for policy 1, policy_version 990187 (0.0009) [2023-12-26 07:33:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 508755968. Throughput: 0: 8690.5, 1: 9021.8. Samples: 508755624. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:13,785][121949] Avg episode reward: [(0, '6388.990'), (1, '5869.441')] [2023-12-26 07:33:13,842][123090] Updated weights for policy 1, policy_version 990197 (0.0007) [2023-12-26 07:33:13,874][123091] Updated weights for policy 0, policy_version 997138 (0.0008) [2023-12-26 07:33:13,909][123090] Updated weights for policy 1, policy_version 990207 (0.0005) [2023-12-26 07:33:13,932][123091] Updated weights for policy 0, policy_version 997148 (0.0007) [2023-12-26 07:33:14,002][123091] Updated weights for policy 0, policy_version 997158 (0.0011) [2023-12-26 07:33:14,069][123091] Updated weights for policy 0, policy_version 997168 (0.0011) [2023-12-26 07:33:14,628][123090] Updated weights for policy 1, policy_version 990217 (0.0006) [2023-12-26 07:33:14,692][123090] Updated weights for policy 1, policy_version 990227 (0.0007) [2023-12-26 07:33:14,745][123090] Updated weights for policy 1, policy_version 990237 (0.0005) [2023-12-26 07:33:14,788][123091] Updated weights for policy 0, policy_version 997178 (0.0007) [2023-12-26 07:33:14,859][123091] Updated weights for policy 0, policy_version 997188 (0.0007) [2023-12-26 07:33:14,927][123091] Updated weights for policy 0, policy_version 997198 (0.0008) [2023-12-26 07:33:15,451][123090] Updated weights for policy 1, policy_version 990247 (0.0010) [2023-12-26 07:33:15,513][123090] Updated weights for policy 1, policy_version 990257 (0.0006) [2023-12-26 07:33:15,581][123090] Updated weights for policy 1, policy_version 990267 (0.0008) [2023-12-26 07:33:15,730][123091] Updated weights for policy 0, policy_version 997208 (0.0009) [2023-12-26 07:33:15,785][123091] Updated weights for policy 0, policy_version 997218 (0.0007) [2023-12-26 07:33:15,857][123091] Updated weights for policy 0, policy_version 997228 (0.0006) [2023-12-26 07:33:16,193][123090] Updated weights for policy 1, policy_version 990277 (0.0008) [2023-12-26 07:33:16,251][123090] Updated weights for policy 1, policy_version 990287 (0.0007) [2023-12-26 07:33:16,306][123090] Updated weights for policy 1, policy_version 990297 (0.0006) [2023-12-26 07:33:16,645][123091] Updated weights for policy 0, policy_version 997238 (0.0009) [2023-12-26 07:33:16,696][123091] Updated weights for policy 0, policy_version 997248 (0.0010) [2023-12-26 07:33:16,751][123091] Updated weights for policy 0, policy_version 997258 (0.0010) [2023-12-26 07:33:16,931][123090] Updated weights for policy 1, policy_version 990307 (0.0006) [2023-12-26 07:33:16,991][123090] Updated weights for policy 1, policy_version 990317 (0.0005) [2023-12-26 07:33:17,053][123090] Updated weights for policy 1, policy_version 990327 (0.0005) [2023-12-26 07:33:17,429][123091] Updated weights for policy 0, policy_version 997268 (0.0008) [2023-12-26 07:33:17,498][123091] Updated weights for policy 0, policy_version 997278 (0.0005) [2023-12-26 07:33:17,558][123091] Updated weights for policy 0, policy_version 997288 (0.0008) [2023-12-26 07:33:17,721][123090] Updated weights for policy 1, policy_version 990337 (0.0005) [2023-12-26 07:33:17,786][123090] Updated weights for policy 1, policy_version 990347 (0.0009) [2023-12-26 07:33:17,848][123090] Updated weights for policy 1, policy_version 990357 (0.0010) [2023-12-26 07:33:17,891][123090] Updated weights for policy 1, policy_version 990367 (0.0010) [2023-12-26 07:33:18,383][123091] Updated weights for policy 0, policy_version 997298 (0.0008) [2023-12-26 07:33:18,444][123091] Updated weights for policy 0, policy_version 997308 (0.0006) [2023-12-26 07:33:18,496][123091] Updated weights for policy 0, policy_version 997318 (0.0005) [2023-12-26 07:33:18,560][123091] Updated weights for policy 0, policy_version 997328 (0.0006) [2023-12-26 07:33:18,702][123090] Updated weights for policy 1, policy_version 990377 (0.0011) [2023-12-26 07:33:18,769][123090] Updated weights for policy 1, policy_version 990387 (0.0010) [2023-12-26 07:33:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 508854272. Throughput: 0: 8788.8, 1: 9113.6. Samples: 508867852. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:18,784][121949] Avg episode reward: [(0, '6360.462'), (1, '5852.487')] [2023-12-26 07:33:18,835][123090] Updated weights for policy 1, policy_version 990397 (0.0010) [2023-12-26 07:33:19,325][123091] Updated weights for policy 0, policy_version 997338 (0.0009) [2023-12-26 07:33:19,391][123091] Updated weights for policy 0, policy_version 997348 (0.0010) [2023-12-26 07:33:19,435][123091] Updated weights for policy 0, policy_version 997358 (0.0010) [2023-12-26 07:33:19,714][123090] Updated weights for policy 1, policy_version 990407 (0.0010) [2023-12-26 07:33:19,791][123090] Updated weights for policy 1, policy_version 990417 (0.0011) [2023-12-26 07:33:19,859][123090] Updated weights for policy 1, policy_version 990427 (0.0010) [2023-12-26 07:33:20,302][123091] Updated weights for policy 0, policy_version 997368 (0.0011) [2023-12-26 07:33:20,357][123091] Updated weights for policy 0, policy_version 997378 (0.0010) [2023-12-26 07:33:20,413][123091] Updated weights for policy 0, policy_version 997388 (0.0011) [2023-12-26 07:33:20,579][123090] Updated weights for policy 1, policy_version 990437 (0.0007) [2023-12-26 07:33:20,647][123090] Updated weights for policy 1, policy_version 990447 (0.0009) [2023-12-26 07:33:20,710][123090] Updated weights for policy 1, policy_version 990457 (0.0007) [2023-12-26 07:33:21,275][123091] Updated weights for policy 0, policy_version 997398 (0.0011) [2023-12-26 07:33:21,339][123091] Updated weights for policy 0, policy_version 997408 (0.0011) [2023-12-26 07:33:21,413][123091] Updated weights for policy 0, policy_version 997418 (0.0011) [2023-12-26 07:33:21,433][123090] Updated weights for policy 1, policy_version 990467 (0.0006) [2023-12-26 07:33:21,499][123090] Updated weights for policy 1, policy_version 990477 (0.0005) [2023-12-26 07:33:21,563][123090] Updated weights for policy 1, policy_version 990487 (0.0005) [2023-12-26 07:33:22,274][123091] Updated weights for policy 0, policy_version 997428 (0.0011) [2023-12-26 07:33:22,334][123091] Updated weights for policy 0, policy_version 997438 (0.0011) [2023-12-26 07:33:22,337][123090] Updated weights for policy 1, policy_version 990497 (0.0006) [2023-12-26 07:33:22,400][123091] Updated weights for policy 0, policy_version 997448 (0.0010) [2023-12-26 07:33:22,403][123090] Updated weights for policy 1, policy_version 990507 (0.0007) [2023-12-26 07:33:22,469][123090] Updated weights for policy 1, policy_version 990517 (0.0007) [2023-12-26 07:33:22,543][123090] Updated weights for policy 1, policy_version 990527 (0.0009) [2023-12-26 07:33:23,153][123091] Updated weights for policy 0, policy_version 997458 (0.0010) [2023-12-26 07:33:23,228][123091] Updated weights for policy 0, policy_version 997468 (0.0008) [2023-12-26 07:33:23,295][123091] Updated weights for policy 0, policy_version 997478 (0.0011) [2023-12-26 07:33:23,362][123091] Updated weights for policy 0, policy_version 997488 (0.0010) [2023-12-26 07:33:23,384][123090] Updated weights for policy 1, policy_version 990537 (0.0007) [2023-12-26 07:33:23,435][123090] Updated weights for policy 1, policy_version 990547 (0.0007) [2023-12-26 07:33:23,495][123090] Updated weights for policy 1, policy_version 990557 (0.0009) [2023-12-26 07:33:23,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 508944384. Throughput: 0: 8755.1, 1: 9089.8. Samples: 508919800. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:23,785][121949] Avg episode reward: [(0, '6248.102'), (1, '5818.178')] [2023-12-26 07:33:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000997488_255361024.pth... [2023-12-26 07:33:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000990560_253583360.pth... [2023-12-26 07:33:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000989504_253313024.pth [2023-12-26 07:33:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000996464_255098880.pth [2023-12-26 07:33:24,109][123091] Updated weights for policy 0, policy_version 997498 (0.0010) [2023-12-26 07:33:24,172][123091] Updated weights for policy 0, policy_version 997508 (0.0011) [2023-12-26 07:33:24,237][123091] Updated weights for policy 0, policy_version 997518 (0.0010) [2023-12-26 07:33:24,322][123090] Updated weights for policy 1, policy_version 990567 (0.0009) [2023-12-26 07:33:24,374][123090] Updated weights for policy 1, policy_version 990577 (0.0009) [2023-12-26 07:33:24,426][123090] Updated weights for policy 1, policy_version 990587 (0.0008) [2023-12-26 07:33:25,070][123091] Updated weights for policy 0, policy_version 997528 (0.0011) [2023-12-26 07:33:25,124][123091] Updated weights for policy 0, policy_version 997538 (0.0010) [2023-12-26 07:33:25,172][123091] Updated weights for policy 0, policy_version 997548 (0.0010) [2023-12-26 07:33:25,272][123090] Updated weights for policy 1, policy_version 990597 (0.0009) [2023-12-26 07:33:25,332][123090] Updated weights for policy 1, policy_version 990607 (0.0009) [2023-12-26 07:33:25,393][123090] Updated weights for policy 1, policy_version 990617 (0.0009) [2023-12-26 07:33:25,928][123091] Updated weights for policy 0, policy_version 997558 (0.0007) [2023-12-26 07:33:25,985][123091] Updated weights for policy 0, policy_version 997568 (0.0009) [2023-12-26 07:33:26,051][123091] Updated weights for policy 0, policy_version 997578 (0.0010) [2023-12-26 07:33:26,233][123090] Updated weights for policy 1, policy_version 990627 (0.0008) [2023-12-26 07:33:26,288][123090] Updated weights for policy 1, policy_version 990637 (0.0005) [2023-12-26 07:33:26,337][123090] Updated weights for policy 1, policy_version 990647 (0.0005) [2023-12-26 07:33:26,755][123091] Updated weights for policy 0, policy_version 997588 (0.0008) [2023-12-26 07:33:26,804][123091] Updated weights for policy 0, policy_version 997598 (0.0007) [2023-12-26 07:33:26,854][123091] Updated weights for policy 0, policy_version 997608 (0.0010) [2023-12-26 07:33:27,047][123090] Updated weights for policy 1, policy_version 990657 (0.0005) [2023-12-26 07:33:27,102][123090] Updated weights for policy 1, policy_version 990667 (0.0005) [2023-12-26 07:33:27,151][123090] Updated weights for policy 1, policy_version 990677 (0.0005) [2023-12-26 07:33:27,203][123090] Updated weights for policy 1, policy_version 990687 (0.0005) [2023-12-26 07:33:27,595][123091] Updated weights for policy 0, policy_version 997618 (0.0010) [2023-12-26 07:33:27,664][123091] Updated weights for policy 0, policy_version 997628 (0.0010) [2023-12-26 07:33:27,730][123091] Updated weights for policy 0, policy_version 997638 (0.0010) [2023-12-26 07:33:27,790][123091] Updated weights for policy 0, policy_version 997648 (0.0010) [2023-12-26 07:33:27,971][123090] Updated weights for policy 1, policy_version 990697 (0.0009) [2023-12-26 07:33:28,034][123090] Updated weights for policy 1, policy_version 990707 (0.0008) [2023-12-26 07:33:28,085][123090] Updated weights for policy 1, policy_version 990717 (0.0008) [2023-12-26 07:33:28,584][123091] Updated weights for policy 0, policy_version 997658 (0.0010) [2023-12-26 07:33:28,642][123091] Updated weights for policy 0, policy_version 997668 (0.0009) [2023-12-26 07:33:28,697][123091] Updated weights for policy 0, policy_version 997678 (0.0009) [2023-12-26 07:33:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 509034496. Throughput: 0: 8789.7, 1: 9069.5. Samples: 509027572. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:28,785][121949] Avg episode reward: [(0, '6221.255'), (1, '5916.531')] [2023-12-26 07:33:28,865][123090] Updated weights for policy 1, policy_version 990727 (0.0009) [2023-12-26 07:33:28,912][123090] Updated weights for policy 1, policy_version 990737 (0.0009) [2023-12-26 07:33:28,961][123090] Updated weights for policy 1, policy_version 990747 (0.0008) [2023-12-26 07:33:29,498][123091] Updated weights for policy 0, policy_version 997688 (0.0009) [2023-12-26 07:33:29,549][123091] Updated weights for policy 0, policy_version 997698 (0.0008) [2023-12-26 07:33:29,608][123091] Updated weights for policy 0, policy_version 997708 (0.0008) [2023-12-26 07:33:29,875][123090] Updated weights for policy 1, policy_version 990757 (0.0010) [2023-12-26 07:33:29,943][123090] Updated weights for policy 1, policy_version 990767 (0.0010) [2023-12-26 07:33:30,011][123090] Updated weights for policy 1, policy_version 990777 (0.0009) [2023-12-26 07:33:30,432][123091] Updated weights for policy 0, policy_version 997718 (0.0009) [2023-12-26 07:33:30,480][123091] Updated weights for policy 0, policy_version 997728 (0.0009) [2023-12-26 07:33:30,532][123091] Updated weights for policy 0, policy_version 997738 (0.0010) [2023-12-26 07:33:30,863][123090] Updated weights for policy 1, policy_version 990787 (0.0009) [2023-12-26 07:33:30,925][123090] Updated weights for policy 1, policy_version 990797 (0.0006) [2023-12-26 07:33:30,994][123090] Updated weights for policy 1, policy_version 990807 (0.0005) [2023-12-26 07:33:31,444][123091] Updated weights for policy 0, policy_version 997748 (0.0009) [2023-12-26 07:33:31,519][123091] Updated weights for policy 0, policy_version 997758 (0.0009) [2023-12-26 07:33:31,588][123091] Updated weights for policy 0, policy_version 997768 (0.0008) [2023-12-26 07:33:31,783][123090] Updated weights for policy 1, policy_version 990817 (0.0008) [2023-12-26 07:33:31,842][123090] Updated weights for policy 1, policy_version 990827 (0.0007) [2023-12-26 07:33:31,910][123090] Updated weights for policy 1, policy_version 990837 (0.0005) [2023-12-26 07:33:31,986][123090] Updated weights for policy 1, policy_version 990847 (0.0006) [2023-12-26 07:33:32,305][123091] Updated weights for policy 0, policy_version 997778 (0.0009) [2023-12-26 07:33:32,373][123091] Updated weights for policy 0, policy_version 997788 (0.0007) [2023-12-26 07:33:32,434][123091] Updated weights for policy 0, policy_version 997798 (0.0007) [2023-12-26 07:33:32,497][123091] Updated weights for policy 0, policy_version 997808 (0.0008) [2023-12-26 07:33:32,681][123090] Updated weights for policy 1, policy_version 990857 (0.0008) [2023-12-26 07:33:32,737][123090] Updated weights for policy 1, policy_version 990867 (0.0009) [2023-12-26 07:33:32,796][123090] Updated weights for policy 1, policy_version 990877 (0.0009) [2023-12-26 07:33:33,293][123091] Updated weights for policy 0, policy_version 997818 (0.0010) [2023-12-26 07:33:33,350][123091] Updated weights for policy 0, policy_version 997828 (0.0009) [2023-12-26 07:33:33,402][123091] Updated weights for policy 0, policy_version 997838 (0.0009) [2023-12-26 07:33:33,575][123090] Updated weights for policy 1, policy_version 990887 (0.0010) [2023-12-26 07:33:33,638][123090] Updated weights for policy 1, policy_version 990897 (0.0010) [2023-12-26 07:33:33,697][123090] Updated weights for policy 1, policy_version 990907 (0.0008) [2023-12-26 07:33:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 509124608. Throughput: 0: 8771.9, 1: 9000.4. Samples: 509131976. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:33,785][121949] Avg episode reward: [(0, '6180.814'), (1, '5937.081')] [2023-12-26 07:33:34,313][123091] Updated weights for policy 0, policy_version 997848 (0.0009) [2023-12-26 07:33:34,325][123090] Updated weights for policy 1, policy_version 990917 (0.0008) [2023-12-26 07:33:34,374][123091] Updated weights for policy 0, policy_version 997858 (0.0008) [2023-12-26 07:33:34,385][123090] Updated weights for policy 1, policy_version 990927 (0.0010) [2023-12-26 07:33:34,434][123091] Updated weights for policy 0, policy_version 997868 (0.0006) [2023-12-26 07:33:34,445][123090] Updated weights for policy 1, policy_version 990937 (0.0011) [2023-12-26 07:33:35,218][123090] Updated weights for policy 1, policy_version 990947 (0.0010) [2023-12-26 07:33:35,265][123090] Updated weights for policy 1, policy_version 990957 (0.0005) [2023-12-26 07:33:35,275][123091] Updated weights for policy 0, policy_version 997878 (0.0005) [2023-12-26 07:33:35,323][123090] Updated weights for policy 1, policy_version 990967 (0.0005) [2023-12-26 07:33:35,346][123091] Updated weights for policy 0, policy_version 997888 (0.0005) [2023-12-26 07:33:35,420][123091] Updated weights for policy 0, policy_version 997898 (0.0005) [2023-12-26 07:33:36,055][123090] Updated weights for policy 1, policy_version 990977 (0.0006) [2023-12-26 07:33:36,112][123091] Updated weights for policy 0, policy_version 997908 (0.0007) [2023-12-26 07:33:36,117][123090] Updated weights for policy 1, policy_version 990987 (0.0010) [2023-12-26 07:33:36,181][123091] Updated weights for policy 0, policy_version 997918 (0.0010) [2023-12-26 07:33:36,189][123090] Updated weights for policy 1, policy_version 990997 (0.0011) [2023-12-26 07:33:36,238][123091] Updated weights for policy 0, policy_version 997928 (0.0008) [2023-12-26 07:33:36,256][123090] Updated weights for policy 1, policy_version 991007 (0.0011) [2023-12-26 07:33:37,076][123090] Updated weights for policy 1, policy_version 991017 (0.0010) [2023-12-26 07:33:37,094][123091] Updated weights for policy 0, policy_version 997938 (0.0009) [2023-12-26 07:33:37,140][123090] Updated weights for policy 1, policy_version 991027 (0.0010) [2023-12-26 07:33:37,155][123091] Updated weights for policy 0, policy_version 997948 (0.0006) [2023-12-26 07:33:37,202][123090] Updated weights for policy 1, policy_version 991037 (0.0007) [2023-12-26 07:33:37,219][123091] Updated weights for policy 0, policy_version 997958 (0.0008) [2023-12-26 07:33:37,281][123091] Updated weights for policy 0, policy_version 997968 (0.0009) [2023-12-26 07:33:37,985][123090] Updated weights for policy 1, policy_version 991047 (0.0007) [2023-12-26 07:33:38,044][123091] Updated weights for policy 0, policy_version 997978 (0.0006) [2023-12-26 07:33:38,050][123090] Updated weights for policy 1, policy_version 991057 (0.0009) [2023-12-26 07:33:38,113][123091] Updated weights for policy 0, policy_version 997988 (0.0009) [2023-12-26 07:33:38,115][123090] Updated weights for policy 1, policy_version 991067 (0.0006) [2023-12-26 07:33:38,173][123091] Updated weights for policy 0, policy_version 997998 (0.0009) [2023-12-26 07:33:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 509206528. Throughput: 0: 8780.5, 1: 9080.2. Samples: 509186820. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:38,785][121949] Avg episode reward: [(0, '6173.773'), (1, '5890.231')] [2023-12-26 07:33:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000998000_255492096.pth... [2023-12-26 07:33:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000991072_253714432.pth... [2023-12-26 07:33:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000990016_253444096.pth [2023-12-26 07:33:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000996976_255229952.pth [2023-12-26 07:33:38,872][123090] Updated weights for policy 1, policy_version 991077 (0.0008) [2023-12-26 07:33:38,931][123090] Updated weights for policy 1, policy_version 991087 (0.0009) [2023-12-26 07:33:38,978][123091] Updated weights for policy 0, policy_version 998008 (0.0010) [2023-12-26 07:33:38,993][123090] Updated weights for policy 1, policy_version 991097 (0.0006) [2023-12-26 07:33:39,039][123091] Updated weights for policy 0, policy_version 998018 (0.0009) [2023-12-26 07:33:39,096][123091] Updated weights for policy 0, policy_version 998028 (0.0009) [2023-12-26 07:33:39,775][123090] Updated weights for policy 1, policy_version 991107 (0.0007) [2023-12-26 07:33:39,847][123090] Updated weights for policy 1, policy_version 991117 (0.0009) [2023-12-26 07:33:39,916][123090] Updated weights for policy 1, policy_version 991127 (0.0010) [2023-12-26 07:33:39,996][123091] Updated weights for policy 0, policy_version 998038 (0.0008) [2023-12-26 07:33:40,062][123091] Updated weights for policy 0, policy_version 998048 (0.0010) [2023-12-26 07:33:40,138][123091] Updated weights for policy 0, policy_version 998058 (0.0010) [2023-12-26 07:33:40,705][123090] Updated weights for policy 1, policy_version 991137 (0.0010) [2023-12-26 07:33:40,767][123090] Updated weights for policy 1, policy_version 991147 (0.0009) [2023-12-26 07:33:40,828][123090] Updated weights for policy 1, policy_version 991157 (0.0009) [2023-12-26 07:33:40,888][123090] Updated weights for policy 1, policy_version 991167 (0.0010) [2023-12-26 07:33:40,949][123091] Updated weights for policy 0, policy_version 998068 (0.0009) [2023-12-26 07:33:41,023][123091] Updated weights for policy 0, policy_version 998078 (0.0010) [2023-12-26 07:33:41,089][123091] Updated weights for policy 0, policy_version 998088 (0.0010) [2023-12-26 07:33:41,792][123090] Updated weights for policy 1, policy_version 991177 (0.0008) [2023-12-26 07:33:41,848][123090] Updated weights for policy 1, policy_version 991187 (0.0008) [2023-12-26 07:33:41,908][123090] Updated weights for policy 1, policy_version 991197 (0.0008) [2023-12-26 07:33:41,964][123091] Updated weights for policy 0, policy_version 998098 (0.0009) [2023-12-26 07:33:42,027][123091] Updated weights for policy 0, policy_version 998108 (0.0010) [2023-12-26 07:33:42,090][123091] Updated weights for policy 0, policy_version 998118 (0.0010) [2023-12-26 07:33:42,157][123091] Updated weights for policy 0, policy_version 998128 (0.0010) [2023-12-26 07:33:42,817][123090] Updated weights for policy 1, policy_version 991207 (0.0009) [2023-12-26 07:33:42,879][123090] Updated weights for policy 1, policy_version 991217 (0.0009) [2023-12-26 07:33:42,940][123090] Updated weights for policy 1, policy_version 991227 (0.0008) [2023-12-26 07:33:42,971][123091] Updated weights for policy 0, policy_version 998138 (0.0011) [2023-12-26 07:33:43,033][123091] Updated weights for policy 0, policy_version 998148 (0.0010) [2023-12-26 07:33:43,099][123091] Updated weights for policy 0, policy_version 998158 (0.0011) [2023-12-26 07:33:43,762][123090] Updated weights for policy 1, policy_version 991237 (0.0009) [2023-12-26 07:33:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 509288448. Throughput: 0: 8724.4, 1: 8963.9. Samples: 509288272. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:43,785][121949] Avg episode reward: [(0, '6271.801'), (1, '5897.252')] [2023-12-26 07:33:43,823][123090] Updated weights for policy 1, policy_version 991247 (0.0009) [2023-12-26 07:33:43,883][123090] Updated weights for policy 1, policy_version 991257 (0.0008) [2023-12-26 07:33:43,920][123091] Updated weights for policy 0, policy_version 998168 (0.0010) [2023-12-26 07:33:43,994][123091] Updated weights for policy 0, policy_version 998178 (0.0011) [2023-12-26 07:33:44,070][123091] Updated weights for policy 0, policy_version 998188 (0.0011) [2023-12-26 07:33:44,596][123090] Updated weights for policy 1, policy_version 991267 (0.0008) [2023-12-26 07:33:44,664][123090] Updated weights for policy 1, policy_version 991277 (0.0005) [2023-12-26 07:33:44,734][123090] Updated weights for policy 1, policy_version 991287 (0.0007) [2023-12-26 07:33:44,885][123091] Updated weights for policy 0, policy_version 998198 (0.0010) [2023-12-26 07:33:44,941][123091] Updated weights for policy 0, policy_version 998209 (0.0010) [2023-12-26 07:33:44,996][123091] Updated weights for policy 0, policy_version 998219 (0.0010) [2023-12-26 07:33:45,437][123090] Updated weights for policy 1, policy_version 991297 (0.0008) [2023-12-26 07:33:45,501][123090] Updated weights for policy 1, policy_version 991307 (0.0009) [2023-12-26 07:33:45,562][123090] Updated weights for policy 1, policy_version 991317 (0.0009) [2023-12-26 07:33:45,624][123090] Updated weights for policy 1, policy_version 991327 (0.0010) [2023-12-26 07:33:45,879][123091] Updated weights for policy 0, policy_version 998229 (0.0009) [2023-12-26 07:33:45,933][123091] Updated weights for policy 0, policy_version 998239 (0.0009) [2023-12-26 07:33:45,984][123091] Updated weights for policy 0, policy_version 998249 (0.0010) [2023-12-26 07:33:46,377][123090] Updated weights for policy 1, policy_version 991337 (0.0010) [2023-12-26 07:33:46,432][123090] Updated weights for policy 1, policy_version 991347 (0.0010) [2023-12-26 07:33:46,488][123090] Updated weights for policy 1, policy_version 991357 (0.0009) [2023-12-26 07:33:46,743][123091] Updated weights for policy 0, policy_version 998259 (0.0010) [2023-12-26 07:33:46,804][123091] Updated weights for policy 0, policy_version 998269 (0.0010) [2023-12-26 07:33:46,862][123091] Updated weights for policy 0, policy_version 998279 (0.0010) [2023-12-26 07:33:47,267][123090] Updated weights for policy 1, policy_version 991367 (0.0006) [2023-12-26 07:33:47,313][123090] Updated weights for policy 1, policy_version 991377 (0.0005) [2023-12-26 07:33:47,361][123090] Updated weights for policy 1, policy_version 991387 (0.0005) [2023-12-26 07:33:47,683][123091] Updated weights for policy 0, policy_version 998289 (0.0010) [2023-12-26 07:33:47,738][123091] Updated weights for policy 0, policy_version 998299 (0.0010) [2023-12-26 07:33:47,781][123091] Updated weights for policy 0, policy_version 998309 (0.0010) [2023-12-26 07:33:47,829][123091] Updated weights for policy 0, policy_version 998319 (0.0010) [2023-12-26 07:33:48,049][123090] Updated weights for policy 1, policy_version 991397 (0.0005) [2023-12-26 07:33:48,101][123090] Updated weights for policy 1, policy_version 991407 (0.0005) [2023-12-26 07:33:48,155][123090] Updated weights for policy 1, policy_version 991417 (0.0010) [2023-12-26 07:33:48,684][123091] Updated weights for policy 0, policy_version 998329 (0.0011) [2023-12-26 07:33:48,736][123091] Updated weights for policy 0, policy_version 998339 (0.0010) [2023-12-26 07:33:48,783][123091] Updated weights for policy 0, policy_version 998349 (0.0010) [2023-12-26 07:33:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 509378560. Throughput: 0: 8729.5, 1: 9006.2. Samples: 509395100. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:48,785][121949] Avg episode reward: [(0, '6309.464'), (1, '5861.024')] [2023-12-26 07:33:48,883][123090] Updated weights for policy 1, policy_version 991427 (0.0005) [2023-12-26 07:33:48,955][123090] Updated weights for policy 1, policy_version 991437 (0.0008) [2023-12-26 07:33:49,013][123090] Updated weights for policy 1, policy_version 991447 (0.0006) [2023-12-26 07:33:49,527][123091] Updated weights for policy 0, policy_version 998359 (0.0008) [2023-12-26 07:33:49,589][123091] Updated weights for policy 0, policy_version 998369 (0.0009) [2023-12-26 07:33:49,653][123091] Updated weights for policy 0, policy_version 998379 (0.0010) [2023-12-26 07:33:49,793][123090] Updated weights for policy 1, policy_version 991457 (0.0006) [2023-12-26 07:33:49,862][123090] Updated weights for policy 1, policy_version 991467 (0.0008) [2023-12-26 07:33:49,936][123090] Updated weights for policy 1, policy_version 991477 (0.0008) [2023-12-26 07:33:50,006][123090] Updated weights for policy 1, policy_version 991487 (0.0009) [2023-12-26 07:33:50,517][123091] Updated weights for policy 0, policy_version 998389 (0.0010) [2023-12-26 07:33:50,581][123091] Updated weights for policy 0, policy_version 998399 (0.0009) [2023-12-26 07:33:50,640][123091] Updated weights for policy 0, policy_version 998409 (0.0008) [2023-12-26 07:33:50,783][123090] Updated weights for policy 1, policy_version 991497 (0.0010) [2023-12-26 07:33:50,838][123090] Updated weights for policy 1, policy_version 991507 (0.0008) [2023-12-26 07:33:50,896][123090] Updated weights for policy 1, policy_version 991517 (0.0009) [2023-12-26 07:33:51,463][123091] Updated weights for policy 0, policy_version 998419 (0.0009) [2023-12-26 07:33:51,522][123091] Updated weights for policy 0, policy_version 998429 (0.0010) [2023-12-26 07:33:51,574][123091] Updated weights for policy 0, policy_version 998439 (0.0008) [2023-12-26 07:33:51,698][123090] Updated weights for policy 1, policy_version 991527 (0.0010) [2023-12-26 07:33:51,769][123090] Updated weights for policy 1, policy_version 991537 (0.0007) [2023-12-26 07:33:51,829][123090] Updated weights for policy 1, policy_version 991547 (0.0005) [2023-12-26 07:33:52,447][123091] Updated weights for policy 0, policy_version 998449 (0.0009) [2023-12-26 07:33:52,498][123091] Updated weights for policy 0, policy_version 998460 (0.0010) [2023-12-26 07:33:52,550][123091] Updated weights for policy 0, policy_version 998470 (0.0008) [2023-12-26 07:33:52,605][123090] Updated weights for policy 1, policy_version 991557 (0.0006) [2023-12-26 07:33:52,615][123091] Updated weights for policy 0, policy_version 998480 (0.0009) [2023-12-26 07:33:52,675][123090] Updated weights for policy 1, policy_version 991567 (0.0008) [2023-12-26 07:33:52,738][123090] Updated weights for policy 1, policy_version 991577 (0.0009) [2023-12-26 07:33:53,496][123091] Updated weights for policy 0, policy_version 998490 (0.0009) [2023-12-26 07:33:53,500][123090] Updated weights for policy 1, policy_version 991587 (0.0009) [2023-12-26 07:33:53,550][123091] Updated weights for policy 0, policy_version 998500 (0.0009) [2023-12-26 07:33:53,560][123090] Updated weights for policy 1, policy_version 991597 (0.0008) [2023-12-26 07:33:53,601][123091] Updated weights for policy 0, policy_version 998510 (0.0009) [2023-12-26 07:33:53,626][123090] Updated weights for policy 1, policy_version 991607 (0.0005) [2023-12-26 07:33:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 509476864. Throughput: 0: 8719.5, 1: 9026.4. Samples: 509447984. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:53,785][121949] Avg episode reward: [(0, '6193.598'), (1, '5892.102')] [2023-12-26 07:33:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000998512_255623168.pth... [2023-12-26 07:33:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000991616_253853696.pth... [2023-12-26 07:33:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000997488_255361024.pth [2023-12-26 07:33:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000990560_253583360.pth [2023-12-26 07:33:53,799][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_000998512_255623168.pth [2023-12-26 07:33:53,800][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_000991616_253853696.pth [2023-12-26 07:33:54,347][123091] Updated weights for policy 0, policy_version 998520 (0.0006) [2023-12-26 07:33:54,367][123090] Updated weights for policy 1, policy_version 991617 (0.0009) [2023-12-26 07:33:54,398][123091] Updated weights for policy 0, policy_version 998530 (0.0007) [2023-12-26 07:33:54,428][123090] Updated weights for policy 1, policy_version 991627 (0.0005) [2023-12-26 07:33:54,458][123091] Updated weights for policy 0, policy_version 998540 (0.0009) [2023-12-26 07:33:54,489][123090] Updated weights for policy 1, policy_version 991637 (0.0010) [2023-12-26 07:33:54,539][123090] Updated weights for policy 1, policy_version 991647 (0.0009) [2023-12-26 07:33:55,230][123091] Updated weights for policy 0, policy_version 998550 (0.0006) [2023-12-26 07:33:55,282][123091] Updated weights for policy 0, policy_version 998560 (0.0005) [2023-12-26 07:33:55,327][123090] Updated weights for policy 1, policy_version 991657 (0.0010) [2023-12-26 07:33:55,339][123091] Updated weights for policy 0, policy_version 998570 (0.0005) [2023-12-26 07:33:55,391][123090] Updated weights for policy 1, policy_version 991667 (0.0010) [2023-12-26 07:33:55,456][123090] Updated weights for policy 1, policy_version 991677 (0.0010) [2023-12-26 07:33:56,007][123091] Updated weights for policy 0, policy_version 998580 (0.0005) [2023-12-26 07:33:56,055][123091] Updated weights for policy 0, policy_version 998590 (0.0006) [2023-12-26 07:33:56,101][123091] Updated weights for policy 0, policy_version 998600 (0.0005) [2023-12-26 07:33:56,179][123090] Updated weights for policy 1, policy_version 991687 (0.0007) [2023-12-26 07:33:56,255][123090] Updated weights for policy 1, policy_version 991697 (0.0005) [2023-12-26 07:33:56,321][123090] Updated weights for policy 1, policy_version 991707 (0.0009) [2023-12-26 07:33:56,753][123091] Updated weights for policy 0, policy_version 998610 (0.0006) [2023-12-26 07:33:56,809][123091] Updated weights for policy 0, policy_version 998620 (0.0006) [2023-12-26 07:33:56,856][123091] Updated weights for policy 0, policy_version 998630 (0.0005) [2023-12-26 07:33:56,914][123091] Updated weights for policy 0, policy_version 998640 (0.0005) [2023-12-26 07:33:57,151][123090] Updated weights for policy 1, policy_version 991717 (0.0008) [2023-12-26 07:33:57,211][123090] Updated weights for policy 1, policy_version 991727 (0.0005) [2023-12-26 07:33:57,266][123090] Updated weights for policy 1, policy_version 991737 (0.0005) [2023-12-26 07:33:57,615][123091] Updated weights for policy 0, policy_version 998650 (0.0010) [2023-12-26 07:33:57,662][123091] Updated weights for policy 0, policy_version 998660 (0.0010) [2023-12-26 07:33:57,713][123091] Updated weights for policy 0, policy_version 998670 (0.0010) [2023-12-26 07:33:58,054][123090] Updated weights for policy 1, policy_version 991747 (0.0006) [2023-12-26 07:33:58,122][123090] Updated weights for policy 1, policy_version 991757 (0.0008) [2023-12-26 07:33:58,184][123090] Updated weights for policy 1, policy_version 991767 (0.0007) [2023-12-26 07:33:58,620][123091] Updated weights for policy 0, policy_version 998680 (0.0010) [2023-12-26 07:33:58,690][123091] Updated weights for policy 0, policy_version 998690 (0.0009) [2023-12-26 07:33:58,769][123091] Updated weights for policy 0, policy_version 998700 (0.0009) [2023-12-26 07:33:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 509558784. Throughput: 0: 8801.1, 1: 9046.4. Samples: 509558760. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:33:58,785][121949] Avg episode reward: [(0, '6002.239'), (1, '5966.936')] [2023-12-26 07:33:58,984][123090] Updated weights for policy 1, policy_version 991777 (0.0008) [2023-12-26 07:33:59,050][123090] Updated weights for policy 1, policy_version 991787 (0.0010) [2023-12-26 07:33:59,117][123090] Updated weights for policy 1, policy_version 991797 (0.0009) [2023-12-26 07:33:59,186][123090] Updated weights for policy 1, policy_version 991807 (0.0010) [2023-12-26 07:33:59,723][123091] Updated weights for policy 0, policy_version 998710 (0.0006) [2023-12-26 07:33:59,779][123091] Updated weights for policy 0, policy_version 998720 (0.0006) [2023-12-26 07:33:59,844][123091] Updated weights for policy 0, policy_version 998730 (0.0010) [2023-12-26 07:33:59,911][123090] Updated weights for policy 1, policy_version 991817 (0.0007) [2023-12-26 07:33:59,983][123090] Updated weights for policy 1, policy_version 991827 (0.0008) [2023-12-26 07:34:00,045][123090] Updated weights for policy 1, policy_version 991837 (0.0008) [2023-12-26 07:34:00,722][123091] Updated weights for policy 0, policy_version 998740 (0.0008) [2023-12-26 07:34:00,755][123090] Updated weights for policy 1, policy_version 991847 (0.0007) [2023-12-26 07:34:00,775][123091] Updated weights for policy 0, policy_version 998750 (0.0009) [2023-12-26 07:34:00,813][123090] Updated weights for policy 1, policy_version 991857 (0.0006) [2023-12-26 07:34:00,828][123091] Updated weights for policy 0, policy_version 998760 (0.0008) [2023-12-26 07:34:00,874][123090] Updated weights for policy 1, policy_version 991867 (0.0009) [2023-12-26 07:34:01,687][123091] Updated weights for policy 0, policy_version 998770 (0.0010) [2023-12-26 07:34:01,716][123090] Updated weights for policy 1, policy_version 991877 (0.0009) [2023-12-26 07:34:01,755][123091] Updated weights for policy 0, policy_version 998780 (0.0007) [2023-12-26 07:34:01,771][123090] Updated weights for policy 1, policy_version 991887 (0.0009) [2023-12-26 07:34:01,815][123091] Updated weights for policy 0, policy_version 998790 (0.0009) [2023-12-26 07:34:01,833][123090] Updated weights for policy 1, policy_version 991897 (0.0007) [2023-12-26 07:34:01,879][123091] Updated weights for policy 0, policy_version 998800 (0.0008) [2023-12-26 07:34:02,664][123091] Updated weights for policy 0, policy_version 998810 (0.0007) [2023-12-26 07:34:02,685][123090] Updated weights for policy 1, policy_version 991907 (0.0008) [2023-12-26 07:34:02,722][123091] Updated weights for policy 0, policy_version 998820 (0.0009) [2023-12-26 07:34:02,742][123090] Updated weights for policy 1, policy_version 991917 (0.0008) [2023-12-26 07:34:02,779][123091] Updated weights for policy 0, policy_version 998830 (0.0010) [2023-12-26 07:34:02,800][123090] Updated weights for policy 1, policy_version 991927 (0.0007) [2023-12-26 07:34:03,502][123091] Updated weights for policy 0, policy_version 998840 (0.0005) [2023-12-26 07:34:03,549][123091] Updated weights for policy 0, policy_version 998850 (0.0005) [2023-12-26 07:34:03,582][123090] Updated weights for policy 1, policy_version 991937 (0.0009) [2023-12-26 07:34:03,603][123091] Updated weights for policy 0, policy_version 998860 (0.0007) [2023-12-26 07:34:03,652][123090] Updated weights for policy 1, policy_version 991947 (0.0006) [2023-12-26 07:34:03,715][123090] Updated weights for policy 1, policy_version 991957 (0.0006) [2023-12-26 07:34:03,765][123090] Updated weights for policy 1, policy_version 991967 (0.0009) [2023-12-26 07:34:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 509657088. Throughput: 0: 8725.9, 1: 8946.8. Samples: 509663124. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:03,785][121949] Avg episode reward: [(0, '5983.319'), (1, '5966.651')] [2023-12-26 07:34:04,330][123091] Updated weights for policy 0, policy_version 998870 (0.0011) [2023-12-26 07:34:04,387][123091] Updated weights for policy 0, policy_version 998880 (0.0011) [2023-12-26 07:34:04,440][123091] Updated weights for policy 0, policy_version 998890 (0.0011) [2023-12-26 07:34:04,545][123090] Updated weights for policy 1, policy_version 991977 (0.0006) [2023-12-26 07:34:04,617][123090] Updated weights for policy 1, policy_version 991987 (0.0005) [2023-12-26 07:34:04,690][123090] Updated weights for policy 1, policy_version 991997 (0.0006) [2023-12-26 07:34:05,303][123091] Updated weights for policy 0, policy_version 998900 (0.0011) [2023-12-26 07:34:05,326][123090] Updated weights for policy 1, policy_version 992007 (0.0005) [2023-12-26 07:34:05,352][123091] Updated weights for policy 0, policy_version 998910 (0.0006) [2023-12-26 07:34:05,384][123090] Updated weights for policy 1, policy_version 992017 (0.0006) [2023-12-26 07:34:05,397][123091] Updated weights for policy 0, policy_version 998920 (0.0006) [2023-12-26 07:34:05,436][123090] Updated weights for policy 1, policy_version 992027 (0.0007) [2023-12-26 07:34:06,177][123090] Updated weights for policy 1, policy_version 992037 (0.0010) [2023-12-26 07:34:06,213][123091] Updated weights for policy 0, policy_version 998930 (0.0006) [2023-12-26 07:34:06,244][123090] Updated weights for policy 1, policy_version 992047 (0.0011) [2023-12-26 07:34:06,277][123091] Updated weights for policy 0, policy_version 998940 (0.0005) [2023-12-26 07:34:06,308][123090] Updated weights for policy 1, policy_version 992057 (0.0011) [2023-12-26 07:34:06,347][123091] Updated weights for policy 0, policy_version 998950 (0.0006) [2023-12-26 07:34:06,417][123091] Updated weights for policy 0, policy_version 998960 (0.0008) [2023-12-26 07:34:07,037][123090] Updated weights for policy 1, policy_version 992067 (0.0009) [2023-12-26 07:34:07,087][123090] Updated weights for policy 1, policy_version 992077 (0.0005) [2023-12-26 07:34:07,145][123090] Updated weights for policy 1, policy_version 992087 (0.0006) [2023-12-26 07:34:07,263][123091] Updated weights for policy 0, policy_version 998970 (0.0009) [2023-12-26 07:34:07,332][123091] Updated weights for policy 0, policy_version 998980 (0.0009) [2023-12-26 07:34:07,389][123091] Updated weights for policy 0, policy_version 998990 (0.0008) [2023-12-26 07:34:07,975][123090] Updated weights for policy 1, policy_version 992098 (0.0010) [2023-12-26 07:34:08,031][123091] Updated weights for policy 0, policy_version 999000 (0.0006) [2023-12-26 07:34:08,046][123090] Updated weights for policy 1, policy_version 992108 (0.0010) [2023-12-26 07:34:08,084][123091] Updated weights for policy 0, policy_version 999010 (0.0009) [2023-12-26 07:34:08,116][123090] Updated weights for policy 1, policy_version 992118 (0.0010) [2023-12-26 07:34:08,131][123091] Updated weights for policy 0, policy_version 999020 (0.0005) [2023-12-26 07:34:08,171][123090] Updated weights for policy 1, policy_version 992128 (0.0010) [2023-12-26 07:34:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 509739008. Throughput: 0: 8739.8, 1: 8982.4. Samples: 509717296. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:08,785][121949] Avg episode reward: [(0, '6075.225'), (1, '5982.091')] [2023-12-26 07:34:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000999024_255754240.pth... [2023-12-26 07:34:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000992128_253984768.pth... [2023-12-26 07:34:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000991072_253714432.pth [2023-12-26 07:34:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000998000_255492096.pth [2023-12-26 07:34:08,873][123091] Updated weights for policy 0, policy_version 999030 (0.0007) [2023-12-26 07:34:08,929][123091] Updated weights for policy 0, policy_version 999040 (0.0009) [2023-12-26 07:34:08,950][123090] Updated weights for policy 1, policy_version 992138 (0.0008) [2023-12-26 07:34:08,981][123091] Updated weights for policy 0, policy_version 999050 (0.0008) [2023-12-26 07:34:09,005][123090] Updated weights for policy 1, policy_version 992148 (0.0007) [2023-12-26 07:34:09,058][123090] Updated weights for policy 1, policy_version 992158 (0.0009) [2023-12-26 07:34:09,891][123091] Updated weights for policy 0, policy_version 999060 (0.0007) [2023-12-26 07:34:09,950][123090] Updated weights for policy 1, policy_version 992168 (0.0007) [2023-12-26 07:34:09,962][123091] Updated weights for policy 0, policy_version 999070 (0.0010) [2023-12-26 07:34:10,026][123090] Updated weights for policy 1, policy_version 992178 (0.0007) [2023-12-26 07:34:10,033][123091] Updated weights for policy 0, policy_version 999080 (0.0007) [2023-12-26 07:34:10,088][123090] Updated weights for policy 1, policy_version 992188 (0.0008) [2023-12-26 07:34:10,812][123091] Updated weights for policy 0, policy_version 999090 (0.0009) [2023-12-26 07:34:10,867][123091] Updated weights for policy 0, policy_version 999100 (0.0006) [2023-12-26 07:34:10,902][123090] Updated weights for policy 1, policy_version 992199 (0.0010) [2023-12-26 07:34:10,917][123091] Updated weights for policy 0, policy_version 999110 (0.0005) [2023-12-26 07:34:10,955][123090] Updated weights for policy 1, policy_version 992209 (0.0006) [2023-12-26 07:34:10,978][123091] Updated weights for policy 0, policy_version 999120 (0.0010) [2023-12-26 07:34:11,019][123090] Updated weights for policy 1, policy_version 992219 (0.0007) [2023-12-26 07:34:11,820][123091] Updated weights for policy 0, policy_version 999130 (0.0006) [2023-12-26 07:34:11,857][123090] Updated weights for policy 1, policy_version 992229 (0.0008) [2023-12-26 07:34:11,886][123091] Updated weights for policy 0, policy_version 999140 (0.0008) [2023-12-26 07:34:11,923][123090] Updated weights for policy 1, policy_version 992239 (0.0007) [2023-12-26 07:34:11,948][123091] Updated weights for policy 0, policy_version 999150 (0.0006) [2023-12-26 07:34:11,984][123090] Updated weights for policy 1, policy_version 992249 (0.0009) [2023-12-26 07:34:12,719][123091] Updated weights for policy 0, policy_version 999160 (0.0009) [2023-12-26 07:34:12,776][123091] Updated weights for policy 0, policy_version 999170 (0.0009) [2023-12-26 07:34:12,830][123091] Updated weights for policy 0, policy_version 999180 (0.0009) [2023-12-26 07:34:12,850][123090] Updated weights for policy 1, policy_version 992259 (0.0010) [2023-12-26 07:34:12,910][123090] Updated weights for policy 1, policy_version 992269 (0.0009) [2023-12-26 07:34:12,972][123090] Updated weights for policy 1, policy_version 992279 (0.0009) [2023-12-26 07:34:13,566][123091] Updated weights for policy 0, policy_version 999190 (0.0007) [2023-12-26 07:34:13,621][123091] Updated weights for policy 0, policy_version 999200 (0.0005) [2023-12-26 07:34:13,670][123091] Updated weights for policy 0, policy_version 999210 (0.0005) [2023-12-26 07:34:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 509829120. Throughput: 0: 8694.6, 1: 8960.1. Samples: 509822032. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:13,784][121949] Avg episode reward: [(0, '6078.516'), (1, '5973.572')] [2023-12-26 07:34:13,791][123090] Updated weights for policy 1, policy_version 992289 (0.0008) [2023-12-26 07:34:13,865][123090] Updated weights for policy 1, policy_version 992299 (0.0006) [2023-12-26 07:34:13,934][123090] Updated weights for policy 1, policy_version 992309 (0.0009) [2023-12-26 07:34:14,002][123090] Updated weights for policy 1, policy_version 992319 (0.0009) [2023-12-26 07:34:14,378][123091] Updated weights for policy 0, policy_version 999220 (0.0005) [2023-12-26 07:34:14,428][123091] Updated weights for policy 0, policy_version 999230 (0.0005) [2023-12-26 07:34:14,475][123091] Updated weights for policy 0, policy_version 999240 (0.0005) [2023-12-26 07:34:14,742][123090] Updated weights for policy 1, policy_version 992329 (0.0005) [2023-12-26 07:34:14,814][123090] Updated weights for policy 1, policy_version 992339 (0.0008) [2023-12-26 07:34:14,885][123090] Updated weights for policy 1, policy_version 992349 (0.0010) [2023-12-26 07:34:15,296][123091] Updated weights for policy 0, policy_version 999250 (0.0006) [2023-12-26 07:34:15,359][123091] Updated weights for policy 0, policy_version 999260 (0.0009) [2023-12-26 07:34:15,421][123091] Updated weights for policy 0, policy_version 999270 (0.0006) [2023-12-26 07:34:15,492][123091] Updated weights for policy 0, policy_version 999280 (0.0007) [2023-12-26 07:34:15,710][123090] Updated weights for policy 1, policy_version 992359 (0.0010) [2023-12-26 07:34:15,767][123090] Updated weights for policy 1, policy_version 992369 (0.0010) [2023-12-26 07:34:15,830][123090] Updated weights for policy 1, policy_version 992379 (0.0010) [2023-12-26 07:34:16,190][123091] Updated weights for policy 0, policy_version 999290 (0.0005) [2023-12-26 07:34:16,246][123091] Updated weights for policy 0, policy_version 999300 (0.0005) [2023-12-26 07:34:16,303][123091] Updated weights for policy 0, policy_version 999310 (0.0008) [2023-12-26 07:34:16,710][123090] Updated weights for policy 1, policy_version 992389 (0.0009) [2023-12-26 07:34:16,772][123090] Updated weights for policy 1, policy_version 992399 (0.0008) [2023-12-26 07:34:16,830][123090] Updated weights for policy 1, policy_version 992409 (0.0009) [2023-12-26 07:34:17,102][123091] Updated weights for policy 0, policy_version 999320 (0.0010) [2023-12-26 07:34:17,167][123091] Updated weights for policy 0, policy_version 999330 (0.0010) [2023-12-26 07:34:17,215][123091] Updated weights for policy 0, policy_version 999340 (0.0009) [2023-12-26 07:34:17,661][123090] Updated weights for policy 1, policy_version 992419 (0.0010) [2023-12-26 07:34:17,727][123090] Updated weights for policy 1, policy_version 992429 (0.0007) [2023-12-26 07:34:17,778][123090] Updated weights for policy 1, policy_version 992439 (0.0009) [2023-12-26 07:34:18,024][123091] Updated weights for policy 0, policy_version 999350 (0.0007) [2023-12-26 07:34:18,081][123091] Updated weights for policy 0, policy_version 999360 (0.0006) [2023-12-26 07:34:18,146][123091] Updated weights for policy 0, policy_version 999370 (0.0006) [2023-12-26 07:34:18,658][123090] Updated weights for policy 1, policy_version 992449 (0.0009) [2023-12-26 07:34:18,715][123090] Updated weights for policy 1, policy_version 992459 (0.0008) [2023-12-26 07:34:18,764][123090] Updated weights for policy 1, policy_version 992469 (0.0006) [2023-12-26 07:34:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 509911040. Throughput: 0: 8800.3, 1: 8911.0. Samples: 509928988. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:18,785][121949] Avg episode reward: [(0, '6133.067'), (1, '5974.678')] [2023-12-26 07:34:18,819][123090] Updated weights for policy 1, policy_version 992479 (0.0009) [2023-12-26 07:34:18,862][123091] Updated weights for policy 0, policy_version 999380 (0.0008) [2023-12-26 07:34:18,918][123091] Updated weights for policy 0, policy_version 999390 (0.0011) [2023-12-26 07:34:18,992][123091] Updated weights for policy 0, policy_version 999400 (0.0011) [2023-12-26 07:34:19,724][123090] Updated weights for policy 1, policy_version 992489 (0.0011) [2023-12-26 07:34:19,792][123090] Updated weights for policy 1, policy_version 992499 (0.0009) [2023-12-26 07:34:19,822][123091] Updated weights for policy 0, policy_version 999410 (0.0010) [2023-12-26 07:34:19,858][123090] Updated weights for policy 1, policy_version 992509 (0.0010) [2023-12-26 07:34:19,884][123091] Updated weights for policy 0, policy_version 999420 (0.0013) [2023-12-26 07:34:19,946][123091] Updated weights for policy 0, policy_version 999430 (0.0011) [2023-12-26 07:34:20,011][123091] Updated weights for policy 0, policy_version 999440 (0.0011) [2023-12-26 07:34:20,679][123090] Updated weights for policy 1, policy_version 992519 (0.0010) [2023-12-26 07:34:20,741][123090] Updated weights for policy 1, policy_version 992529 (0.0011) [2023-12-26 07:34:20,800][123090] Updated weights for policy 1, policy_version 992539 (0.0011) [2023-12-26 07:34:20,860][123091] Updated weights for policy 0, policy_version 999450 (0.0011) [2023-12-26 07:34:20,928][123091] Updated weights for policy 0, policy_version 999460 (0.0011) [2023-12-26 07:34:20,984][123091] Updated weights for policy 0, policy_version 999470 (0.0011) [2023-12-26 07:34:21,675][123090] Updated weights for policy 1, policy_version 992549 (0.0010) [2023-12-26 07:34:21,742][123090] Updated weights for policy 1, policy_version 992559 (0.0010) [2023-12-26 07:34:21,801][123090] Updated weights for policy 1, policy_version 992569 (0.0010) [2023-12-26 07:34:21,867][123091] Updated weights for policy 0, policy_version 999480 (0.0009) [2023-12-26 07:34:21,931][123091] Updated weights for policy 0, policy_version 999490 (0.0010) [2023-12-26 07:34:21,989][123091] Updated weights for policy 0, policy_version 999500 (0.0010) [2023-12-26 07:34:22,704][123090] Updated weights for policy 1, policy_version 992579 (0.0009) [2023-12-26 07:34:22,779][123090] Updated weights for policy 1, policy_version 992589 (0.0009) [2023-12-26 07:34:22,802][123091] Updated weights for policy 0, policy_version 999510 (0.0010) [2023-12-26 07:34:22,830][123090] Updated weights for policy 1, policy_version 992599 (0.0008) [2023-12-26 07:34:22,867][123091] Updated weights for policy 0, policy_version 999520 (0.0009) [2023-12-26 07:34:22,930][123091] Updated weights for policy 0, policy_version 999530 (0.0009) [2023-12-26 07:34:23,661][123090] Updated weights for policy 1, policy_version 992609 (0.0006) [2023-12-26 07:34:23,718][123090] Updated weights for policy 1, policy_version 992619 (0.0009) [2023-12-26 07:34:23,736][123091] Updated weights for policy 0, policy_version 999540 (0.0008) [2023-12-26 07:34:23,766][123090] Updated weights for policy 1, policy_version 992629 (0.0009) [2023-12-26 07:34:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 509992960. Throughput: 0: 8772.4, 1: 8820.7. Samples: 509978508. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:23,785][121949] Avg episode reward: [(0, '6087.093'), (1, '5989.082')] [2023-12-26 07:34:23,789][123091] Updated weights for policy 0, policy_version 999550 (0.0005) [2023-12-26 07:34:23,826][123090] Updated weights for policy 1, policy_version 992639 (0.0009) [2023-12-26 07:34:23,828][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000992640_254115840.pth... [2023-12-26 07:34:23,833][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000991616_253853696.pth [2023-12-26 07:34:23,846][123091] Updated weights for policy 0, policy_version 999560 (0.0005) [2023-12-26 07:34:23,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000999568_255893504.pth... [2023-12-26 07:34:23,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000998512_255623168.pth [2023-12-26 07:34:24,573][123091] Updated weights for policy 0, policy_version 999570 (0.0006) [2023-12-26 07:34:24,621][123091] Updated weights for policy 0, policy_version 999580 (0.0005) [2023-12-26 07:34:24,667][123091] Updated weights for policy 0, policy_version 999590 (0.0005) [2023-12-26 07:34:24,718][123091] Updated weights for policy 0, policy_version 999600 (0.0005) [2023-12-26 07:34:24,751][123090] Updated weights for policy 1, policy_version 992649 (0.0009) [2023-12-26 07:34:24,814][123090] Updated weights for policy 1, policy_version 992660 (0.0009) [2023-12-26 07:34:24,885][123090] Updated weights for policy 1, policy_version 992670 (0.0006) [2023-12-26 07:34:25,479][123091] Updated weights for policy 0, policy_version 999610 (0.0007) [2023-12-26 07:34:25,535][123091] Updated weights for policy 0, policy_version 999620 (0.0005) [2023-12-26 07:34:25,585][123090] Updated weights for policy 1, policy_version 992680 (0.0007) [2023-12-26 07:34:25,598][123091] Updated weights for policy 0, policy_version 999630 (0.0005) [2023-12-26 07:34:25,642][123090] Updated weights for policy 1, policy_version 992690 (0.0007) [2023-12-26 07:34:25,700][123090] Updated weights for policy 1, policy_version 992700 (0.0006) [2023-12-26 07:34:26,184][123091] Updated weights for policy 0, policy_version 999640 (0.0008) [2023-12-26 07:34:26,239][123091] Updated weights for policy 0, policy_version 999650 (0.0009) [2023-12-26 07:34:26,312][123091] Updated weights for policy 0, policy_version 999660 (0.0005) [2023-12-26 07:34:26,437][123090] Updated weights for policy 1, policy_version 992710 (0.0006) [2023-12-26 07:34:26,512][123090] Updated weights for policy 1, policy_version 992720 (0.0005) [2023-12-26 07:34:26,576][123090] Updated weights for policy 1, policy_version 992730 (0.0006) [2023-12-26 07:34:26,972][123091] Updated weights for policy 0, policy_version 999670 (0.0005) [2023-12-26 07:34:27,025][123091] Updated weights for policy 0, policy_version 999680 (0.0005) [2023-12-26 07:34:27,078][123091] Updated weights for policy 0, policy_version 999690 (0.0005) [2023-12-26 07:34:27,352][123090] Updated weights for policy 1, policy_version 992740 (0.0007) [2023-12-26 07:34:27,402][123090] Updated weights for policy 1, policy_version 992750 (0.0009) [2023-12-26 07:34:27,458][123090] Updated weights for policy 1, policy_version 992760 (0.0009) [2023-12-26 07:34:27,833][123091] Updated weights for policy 0, policy_version 999700 (0.0005) [2023-12-26 07:34:27,884][123091] Updated weights for policy 0, policy_version 999710 (0.0005) [2023-12-26 07:34:27,936][123091] Updated weights for policy 0, policy_version 999720 (0.0005) [2023-12-26 07:34:28,106][123090] Updated weights for policy 1, policy_version 992770 (0.0007) [2023-12-26 07:34:28,153][123090] Updated weights for policy 1, policy_version 992780 (0.0010) [2023-12-26 07:34:28,196][123090] Updated weights for policy 1, policy_version 992790 (0.0010) [2023-12-26 07:34:28,251][123090] Updated weights for policy 1, policy_version 992800 (0.0010) [2023-12-26 07:34:28,560][123091] Updated weights for policy 0, policy_version 999730 (0.0005) [2023-12-26 07:34:28,627][123091] Updated weights for policy 0, policy_version 999740 (0.0007) [2023-12-26 07:34:28,689][123091] Updated weights for policy 0, policy_version 999750 (0.0008) [2023-12-26 07:34:28,764][123091] Updated weights for policy 0, policy_version 999760 (0.0005) [2023-12-26 07:34:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 510099456. Throughput: 0: 8937.1, 1: 8833.7. Samples: 510087960. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:28,785][121949] Avg episode reward: [(0, '6075.376'), (1, '6025.064')] [2023-12-26 07:34:29,029][123090] Updated weights for policy 1, policy_version 992810 (0.0005) [2023-12-26 07:34:29,083][123090] Updated weights for policy 1, policy_version 992820 (0.0005) [2023-12-26 07:34:29,149][123090] Updated weights for policy 1, policy_version 992830 (0.0005) [2023-12-26 07:34:29,522][123091] Updated weights for policy 0, policy_version 999770 (0.0006) [2023-12-26 07:34:29,577][123091] Updated weights for policy 0, policy_version 999780 (0.0006) [2023-12-26 07:34:29,635][123091] Updated weights for policy 0, policy_version 999790 (0.0006) [2023-12-26 07:34:29,949][123090] Updated weights for policy 1, policy_version 992840 (0.0008) [2023-12-26 07:34:30,013][123090] Updated weights for policy 1, policy_version 992850 (0.0010) [2023-12-26 07:34:30,078][123090] Updated weights for policy 1, policy_version 992860 (0.0010) [2023-12-26 07:34:30,357][123091] Updated weights for policy 0, policy_version 999800 (0.0009) [2023-12-26 07:34:30,405][123091] Updated weights for policy 0, policy_version 999810 (0.0010) [2023-12-26 07:34:30,459][123091] Updated weights for policy 0, policy_version 999820 (0.0010) [2023-12-26 07:34:30,811][123090] Updated weights for policy 1, policy_version 992870 (0.0009) [2023-12-26 07:34:30,877][123090] Updated weights for policy 1, policy_version 992880 (0.0010) [2023-12-26 07:34:30,947][123090] Updated weights for policy 1, policy_version 992890 (0.0010) [2023-12-26 07:34:31,336][123091] Updated weights for policy 0, policy_version 999830 (0.0009) [2023-12-26 07:34:31,402][123091] Updated weights for policy 0, policy_version 999840 (0.0010) [2023-12-26 07:34:31,455][123091] Updated weights for policy 0, policy_version 999850 (0.0009) [2023-12-26 07:34:31,764][123090] Updated weights for policy 1, policy_version 992900 (0.0010) [2023-12-26 07:34:31,818][123090] Updated weights for policy 1, policy_version 992910 (0.0009) [2023-12-26 07:34:31,871][123090] Updated weights for policy 1, policy_version 992920 (0.0009) [2023-12-26 07:34:32,244][123091] Updated weights for policy 0, policy_version 999860 (0.0008) [2023-12-26 07:34:32,312][123091] Updated weights for policy 0, policy_version 999870 (0.0010) [2023-12-26 07:34:32,383][123091] Updated weights for policy 0, policy_version 999880 (0.0009) [2023-12-26 07:34:32,698][123090] Updated weights for policy 1, policy_version 992930 (0.0009) [2023-12-26 07:34:32,753][123090] Updated weights for policy 1, policy_version 992940 (0.0010) [2023-12-26 07:34:32,805][123090] Updated weights for policy 1, policy_version 992950 (0.0010) [2023-12-26 07:34:32,856][123090] Updated weights for policy 1, policy_version 992960 (0.0008) [2023-12-26 07:34:33,122][123091] Updated weights for policy 0, policy_version 999890 (0.0009) [2023-12-26 07:34:33,185][123091] Updated weights for policy 0, policy_version 999900 (0.0008) [2023-12-26 07:34:33,242][123091] Updated weights for policy 0, policy_version 999910 (0.0009) [2023-12-26 07:34:33,291][123091] Updated weights for policy 0, policy_version 999920 (0.0009) [2023-12-26 07:34:33,616][123090] Updated weights for policy 1, policy_version 992970 (0.0005) [2023-12-26 07:34:33,668][123090] Updated weights for policy 1, policy_version 992980 (0.0005) [2023-12-26 07:34:33,733][123090] Updated weights for policy 1, policy_version 992990 (0.0005) [2023-12-26 07:34:33,784][121949] Fps is (10 sec: 19660.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 510189568. Throughput: 0: 9001.7, 1: 8829.8. Samples: 510197516. Policy #0 lag: (min: 30.0, avg: 35.7, max: 62.0) [2023-12-26 07:34:33,785][121949] Avg episode reward: [(0, '6134.173'), (1, '6023.960')] [2023-12-26 07:34:34,237][123091] Updated weights for policy 0, policy_version 999930 (0.0009) [2023-12-26 07:34:34,305][123091] Updated weights for policy 0, policy_version 999940 (0.0009) [2023-12-26 07:34:34,369][123091] Updated weights for policy 0, policy_version 999950 (0.0008) [2023-12-26 07:34:34,433][123090] Updated weights for policy 1, policy_version 993000 (0.0008) [2023-12-26 07:34:34,502][123090] Updated weights for policy 1, policy_version 993010 (0.0009) [2023-12-26 07:34:34,566][123090] Updated weights for policy 1, policy_version 993020 (0.0008) [2023-12-26 07:34:35,239][123091] Updated weights for policy 0, policy_version 999961 (0.0010) [2023-12-26 07:34:35,266][123090] Updated weights for policy 1, policy_version 993030 (0.0006) [2023-12-26 07:34:35,287][123091] Updated weights for policy 0, policy_version 999971 (0.0009) [2023-12-26 07:34:35,329][123090] Updated weights for policy 1, policy_version 993040 (0.0006) [2023-12-26 07:34:35,356][123091] Updated weights for policy 0, policy_version 999982 (0.0008) [2023-12-26 07:34:35,388][123090] Updated weights for policy 1, policy_version 993050 (0.0007) [2023-12-26 07:34:36,190][123090] Updated weights for policy 1, policy_version 993060 (0.0006) [2023-12-26 07:34:36,243][123091] Updated weights for policy 0, policy_version 999992 (0.0010) [2023-12-26 07:34:36,251][123090] Updated weights for policy 1, policy_version 993070 (0.0006) [2023-12-26 07:34:36,316][123091] Updated weights for policy 0, policy_version 1000002 (0.0010) [2023-12-26 07:34:36,323][123090] Updated weights for policy 1, policy_version 993080 (0.0006) [2023-12-26 07:34:36,386][123091] Updated weights for policy 0, policy_version 1000012 (0.0008) [2023-12-26 07:34:37,105][123090] Updated weights for policy 1, policy_version 993090 (0.0006) [2023-12-26 07:34:37,160][123090] Updated weights for policy 1, policy_version 993100 (0.0006) [2023-12-26 07:34:37,181][123091] Updated weights for policy 0, policy_version 1000022 (0.0007) [2023-12-26 07:34:37,225][123090] Updated weights for policy 1, policy_version 993110 (0.0007) [2023-12-26 07:34:37,239][123091] Updated weights for policy 0, policy_version 1000032 (0.0005) [2023-12-26 07:34:37,292][123090] Updated weights for policy 1, policy_version 993120 (0.0009) [2023-12-26 07:34:37,296][123091] Updated weights for policy 0, policy_version 1000042 (0.0006) [2023-12-26 07:34:38,033][123091] Updated weights for policy 0, policy_version 1000052 (0.0008) [2023-12-26 07:34:38,094][123091] Updated weights for policy 0, policy_version 1000062 (0.0006) [2023-12-26 07:34:38,146][123090] Updated weights for policy 1, policy_version 993130 (0.0010) [2023-12-26 07:34:38,160][123091] Updated weights for policy 0, policy_version 1000072 (0.0006) [2023-12-26 07:34:38,203][123090] Updated weights for policy 1, policy_version 993140 (0.0008) [2023-12-26 07:34:38,253][123090] Updated weights for policy 1, policy_version 993150 (0.0009) [2023-12-26 07:34:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 510271488. Throughput: 0: 8961.3, 1: 8846.3. Samples: 510249324. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:34:38,785][121949] Avg episode reward: [(0, '6178.933'), (1, '5987.333')] [2023-12-26 07:34:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001000080_256024576.pth... [2023-12-26 07:34:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000993152_254246912.pth... [2023-12-26 07:34:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000999024_255754240.pth [2023-12-26 07:34:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000992128_253984768.pth [2023-12-26 07:34:38,880][123091] Updated weights for policy 0, policy_version 1000082 (0.0006) [2023-12-26 07:34:38,932][123091] Updated weights for policy 0, policy_version 1000092 (0.0009) [2023-12-26 07:34:38,992][123091] Updated weights for policy 0, policy_version 1000102 (0.0009) [2023-12-26 07:34:39,054][123091] Updated weights for policy 0, policy_version 1000112 (0.0009) [2023-12-26 07:34:39,148][123090] Updated weights for policy 1, policy_version 993160 (0.0009) [2023-12-26 07:34:39,196][123090] Updated weights for policy 1, policy_version 993170 (0.0009) [2023-12-26 07:34:39,255][123090] Updated weights for policy 1, policy_version 993180 (0.0008) [2023-12-26 07:34:39,963][123091] Updated weights for policy 0, policy_version 1000122 (0.0010) [2023-12-26 07:34:40,022][123091] Updated weights for policy 0, policy_version 1000132 (0.0010) [2023-12-26 07:34:40,107][123091] Updated weights for policy 0, policy_version 1000142 (0.0010) [2023-12-26 07:34:40,111][123090] Updated weights for policy 1, policy_version 993190 (0.0007) [2023-12-26 07:34:40,172][123090] Updated weights for policy 1, policy_version 993200 (0.0007) [2023-12-26 07:34:40,238][123090] Updated weights for policy 1, policy_version 993210 (0.0006) [2023-12-26 07:34:40,965][123091] Updated weights for policy 0, policy_version 1000152 (0.0010) [2023-12-26 07:34:40,972][123090] Updated weights for policy 1, policy_version 993220 (0.0007) [2023-12-26 07:34:41,020][123091] Updated weights for policy 0, policy_version 1000162 (0.0010) [2023-12-26 07:34:41,032][123090] Updated weights for policy 1, policy_version 993230 (0.0007) [2023-12-26 07:34:41,087][123091] Updated weights for policy 0, policy_version 1000172 (0.0011) [2023-12-26 07:34:41,094][123090] Updated weights for policy 1, policy_version 993240 (0.0008) [2023-12-26 07:34:41,966][123091] Updated weights for policy 0, policy_version 1000182 (0.0011) [2023-12-26 07:34:41,982][123090] Updated weights for policy 1, policy_version 993250 (0.0008) [2023-12-26 07:34:42,025][123091] Updated weights for policy 0, policy_version 1000192 (0.0006) [2023-12-26 07:34:42,052][123090] Updated weights for policy 1, policy_version 993260 (0.0008) [2023-12-26 07:34:42,092][123091] Updated weights for policy 0, policy_version 1000202 (0.0006) [2023-12-26 07:34:42,115][123090] Updated weights for policy 1, policy_version 993270 (0.0010) [2023-12-26 07:34:42,164][123090] Updated weights for policy 1, policy_version 993280 (0.0008) [2023-12-26 07:34:42,878][123091] Updated weights for policy 0, policy_version 1000212 (0.0007) [2023-12-26 07:34:42,941][123090] Updated weights for policy 1, policy_version 993290 (0.0005) [2023-12-26 07:34:42,943][123091] Updated weights for policy 0, policy_version 1000222 (0.0009) [2023-12-26 07:34:42,993][123090] Updated weights for policy 1, policy_version 993300 (0.0005) [2023-12-26 07:34:43,004][123091] Updated weights for policy 0, policy_version 1000232 (0.0009) [2023-12-26 07:34:43,053][123090] Updated weights for policy 1, policy_version 993310 (0.0007) [2023-12-26 07:34:43,759][123090] Updated weights for policy 1, policy_version 993320 (0.0006) [2023-12-26 07:34:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 510353408. Throughput: 0: 8853.9, 1: 8779.0. Samples: 510352240. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:34:43,785][121949] Avg episode reward: [(0, '6174.975'), (1, '5983.311')] [2023-12-26 07:34:43,817][123090] Updated weights for policy 1, policy_version 993330 (0.0010) [2023-12-26 07:34:43,862][123090] Updated weights for policy 1, policy_version 993340 (0.0010) [2023-12-26 07:34:43,868][123091] Updated weights for policy 0, policy_version 1000242 (0.0008) [2023-12-26 07:34:43,919][123091] Updated weights for policy 0, policy_version 1000252 (0.0005) [2023-12-26 07:34:43,969][123091] Updated weights for policy 0, policy_version 1000262 (0.0007) [2023-12-26 07:34:44,018][123091] Updated weights for policy 0, policy_version 1000272 (0.0009) [2023-12-26 07:34:44,688][123090] Updated weights for policy 1, policy_version 993350 (0.0010) [2023-12-26 07:34:44,748][123090] Updated weights for policy 1, policy_version 993360 (0.0010) [2023-12-26 07:34:44,811][123090] Updated weights for policy 1, policy_version 993370 (0.0010) [2023-12-26 07:34:44,818][123091] Updated weights for policy 0, policy_version 1000283 (0.0011) [2023-12-26 07:34:44,887][123091] Updated weights for policy 0, policy_version 1000293 (0.0011) [2023-12-26 07:34:44,951][123091] Updated weights for policy 0, policy_version 1000303 (0.0011) [2023-12-26 07:34:45,511][123090] Updated weights for policy 1, policy_version 993380 (0.0008) [2023-12-26 07:34:45,589][123090] Updated weights for policy 1, policy_version 993390 (0.0006) [2023-12-26 07:34:45,654][123090] Updated weights for policy 1, policy_version 993400 (0.0005) [2023-12-26 07:34:45,795][123091] Updated weights for policy 0, policy_version 1000313 (0.0006) [2023-12-26 07:34:45,851][123091] Updated weights for policy 0, policy_version 1000323 (0.0005) [2023-12-26 07:34:45,906][123091] Updated weights for policy 0, policy_version 1000333 (0.0005) [2023-12-26 07:34:46,319][123090] Updated weights for policy 1, policy_version 993410 (0.0006) [2023-12-26 07:34:46,363][123090] Updated weights for policy 1, policy_version 993420 (0.0010) [2023-12-26 07:34:46,419][123090] Updated weights for policy 1, policy_version 993430 (0.0010) [2023-12-26 07:34:46,467][123090] Updated weights for policy 1, policy_version 993440 (0.0010) [2023-12-26 07:34:46,564][123091] Updated weights for policy 0, policy_version 1000343 (0.0008) [2023-12-26 07:34:46,624][123091] Updated weights for policy 0, policy_version 1000353 (0.0009) [2023-12-26 07:34:46,676][123091] Updated weights for policy 0, policy_version 1000363 (0.0009) [2023-12-26 07:34:47,332][123090] Updated weights for policy 1, policy_version 993450 (0.0010) [2023-12-26 07:34:47,394][123090] Updated weights for policy 1, policy_version 993460 (0.0010) [2023-12-26 07:34:47,446][123090] Updated weights for policy 1, policy_version 993470 (0.0010) [2023-12-26 07:34:47,524][123091] Updated weights for policy 0, policy_version 1000373 (0.0008) [2023-12-26 07:34:47,586][123091] Updated weights for policy 0, policy_version 1000383 (0.0008) [2023-12-26 07:34:47,646][123091] Updated weights for policy 0, policy_version 1000393 (0.0009) [2023-12-26 07:34:48,286][123090] Updated weights for policy 1, policy_version 993480 (0.0010) [2023-12-26 07:34:48,336][123090] Updated weights for policy 1, policy_version 993490 (0.0010) [2023-12-26 07:34:48,368][123091] Updated weights for policy 0, policy_version 1000403 (0.0009) [2023-12-26 07:34:48,398][123090] Updated weights for policy 1, policy_version 993500 (0.0010) [2023-12-26 07:34:48,430][123091] Updated weights for policy 0, policy_version 1000413 (0.0010) [2023-12-26 07:34:48,492][123091] Updated weights for policy 0, policy_version 1000423 (0.0010) [2023-12-26 07:34:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 510451712. Throughput: 0: 8911.2, 1: 8803.1. Samples: 510460268. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:34:48,785][121949] Avg episode reward: [(0, '6090.744'), (1, '6009.034')] [2023-12-26 07:34:49,176][123091] Updated weights for policy 0, policy_version 1000433 (0.0011) [2023-12-26 07:34:49,243][123091] Updated weights for policy 0, policy_version 1000443 (0.0010) [2023-12-26 07:34:49,267][123090] Updated weights for policy 1, policy_version 993510 (0.0011) [2023-12-26 07:34:49,304][123091] Updated weights for policy 0, policy_version 1000453 (0.0006) [2023-12-26 07:34:49,334][123090] Updated weights for policy 1, policy_version 993520 (0.0011) [2023-12-26 07:34:49,379][123091] Updated weights for policy 0, policy_version 1000463 (0.0011) [2023-12-26 07:34:49,404][123090] Updated weights for policy 1, policy_version 993530 (0.0011) [2023-12-26 07:34:50,187][123091] Updated weights for policy 0, policy_version 1000473 (0.0007) [2023-12-26 07:34:50,250][123090] Updated weights for policy 1, policy_version 993540 (0.0010) [2023-12-26 07:34:50,252][123091] Updated weights for policy 0, policy_version 1000483 (0.0006) [2023-12-26 07:34:50,320][123090] Updated weights for policy 1, policy_version 993550 (0.0006) [2023-12-26 07:34:50,322][123091] Updated weights for policy 0, policy_version 1000493 (0.0005) [2023-12-26 07:34:50,391][123090] Updated weights for policy 1, policy_version 993560 (0.0005) [2023-12-26 07:34:51,091][123091] Updated weights for policy 0, policy_version 1000503 (0.0009) [2023-12-26 07:34:51,136][123090] Updated weights for policy 1, policy_version 993570 (0.0008) [2023-12-26 07:34:51,156][123091] Updated weights for policy 0, policy_version 1000513 (0.0011) [2023-12-26 07:34:51,191][123090] Updated weights for policy 1, policy_version 993580 (0.0010) [2023-12-26 07:34:51,205][123091] Updated weights for policy 0, policy_version 1000523 (0.0010) [2023-12-26 07:34:51,248][123090] Updated weights for policy 1, policy_version 993590 (0.0010) [2023-12-26 07:34:51,300][123090] Updated weights for policy 1, policy_version 993600 (0.0010) [2023-12-26 07:34:52,045][123091] Updated weights for policy 0, policy_version 1000533 (0.0010) [2023-12-26 07:34:52,099][123091] Updated weights for policy 0, policy_version 1000543 (0.0007) [2023-12-26 07:34:52,109][123090] Updated weights for policy 1, policy_version 993610 (0.0008) [2023-12-26 07:34:52,150][123091] Updated weights for policy 0, policy_version 1000553 (0.0008) [2023-12-26 07:34:52,170][123090] Updated weights for policy 1, policy_version 993620 (0.0007) [2023-12-26 07:34:52,225][123090] Updated weights for policy 1, policy_version 993630 (0.0005) [2023-12-26 07:34:52,984][123090] Updated weights for policy 1, policy_version 993640 (0.0008) [2023-12-26 07:34:53,038][123091] Updated weights for policy 0, policy_version 1000563 (0.0007) [2023-12-26 07:34:53,047][123090] Updated weights for policy 1, policy_version 993650 (0.0010) [2023-12-26 07:34:53,094][123091] Updated weights for policy 0, policy_version 1000573 (0.0005) [2023-12-26 07:34:53,112][123090] Updated weights for policy 1, policy_version 993660 (0.0008) [2023-12-26 07:34:53,149][123091] Updated weights for policy 0, policy_version 1000583 (0.0005) [2023-12-26 07:34:53,754][123090] Updated weights for policy 1, policy_version 993670 (0.0007) [2023-12-26 07:34:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 510533632. Throughput: 0: 8940.3, 1: 8767.5. Samples: 510514144. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:34:53,785][121949] Avg episode reward: [(0, '6202.412'), (1, '5975.246')] [2023-12-26 07:34:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001000592_256155648.pth... [2023-12-26 07:34:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_000999568_255893504.pth [2023-12-26 07:34:53,817][123090] Updated weights for policy 1, policy_version 993680 (0.0005) [2023-12-26 07:34:53,821][123091] Updated weights for policy 0, policy_version 1000593 (0.0005) [2023-12-26 07:34:53,879][123091] Updated weights for policy 0, policy_version 1000603 (0.0005) [2023-12-26 07:34:53,888][123090] Updated weights for policy 1, policy_version 993690 (0.0005) [2023-12-26 07:34:53,928][123091] Updated weights for policy 0, policy_version 1000613 (0.0005) [2023-12-26 07:34:53,933][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000993696_254386176.pth... [2023-12-26 07:34:53,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000992640_254115840.pth [2023-12-26 07:34:53,979][123091] Updated weights for policy 0, policy_version 1000623 (0.0006) [2023-12-26 07:34:54,561][123090] Updated weights for policy 1, policy_version 993700 (0.0007) [2023-12-26 07:34:54,608][123090] Updated weights for policy 1, policy_version 993710 (0.0010) [2023-12-26 07:34:54,660][123090] Updated weights for policy 1, policy_version 993720 (0.0010) [2023-12-26 07:34:54,831][123091] Updated weights for policy 0, policy_version 1000633 (0.0006) [2023-12-26 07:34:54,895][123091] Updated weights for policy 0, policy_version 1000643 (0.0005) [2023-12-26 07:34:54,965][123091] Updated weights for policy 0, policy_version 1000653 (0.0006) [2023-12-26 07:34:55,509][123090] Updated weights for policy 1, policy_version 993730 (0.0010) [2023-12-26 07:34:55,549][123091] Updated weights for policy 0, policy_version 1000663 (0.0006) [2023-12-26 07:34:55,571][123090] Updated weights for policy 1, policy_version 993740 (0.0010) [2023-12-26 07:34:55,607][123091] Updated weights for policy 0, policy_version 1000673 (0.0006) [2023-12-26 07:34:55,626][123090] Updated weights for policy 1, policy_version 993750 (0.0010) [2023-12-26 07:34:55,668][123091] Updated weights for policy 0, policy_version 1000683 (0.0005) [2023-12-26 07:34:55,682][123090] Updated weights for policy 1, policy_version 993760 (0.0010) [2023-12-26 07:34:56,394][123091] Updated weights for policy 0, policy_version 1000693 (0.0007) [2023-12-26 07:34:56,450][123090] Updated weights for policy 1, policy_version 993770 (0.0005) [2023-12-26 07:34:56,460][123091] Updated weights for policy 0, policy_version 1000703 (0.0008) [2023-12-26 07:34:56,504][123090] Updated weights for policy 1, policy_version 993780 (0.0005) [2023-12-26 07:34:56,530][123091] Updated weights for policy 0, policy_version 1000713 (0.0008) [2023-12-26 07:34:56,570][123090] Updated weights for policy 1, policy_version 993790 (0.0005) [2023-12-26 07:34:57,174][123091] Updated weights for policy 0, policy_version 1000723 (0.0008) [2023-12-26 07:34:57,212][123090] Updated weights for policy 1, policy_version 993800 (0.0009) [2023-12-26 07:34:57,223][123091] Updated weights for policy 0, policy_version 1000733 (0.0006) [2023-12-26 07:34:57,264][123090] Updated weights for policy 1, policy_version 993810 (0.0010) [2023-12-26 07:34:57,276][123091] Updated weights for policy 0, policy_version 1000743 (0.0005) [2023-12-26 07:34:57,321][123090] Updated weights for policy 1, policy_version 993820 (0.0008) [2023-12-26 07:34:58,019][123091] Updated weights for policy 0, policy_version 1000753 (0.0008) [2023-12-26 07:34:58,084][123091] Updated weights for policy 0, policy_version 1000763 (0.0010) [2023-12-26 07:34:58,152][123091] Updated weights for policy 0, policy_version 1000773 (0.0009) [2023-12-26 07:34:58,153][123090] Updated weights for policy 1, policy_version 993830 (0.0008) [2023-12-26 07:34:58,220][123091] Updated weights for policy 0, policy_version 1000783 (0.0009) [2023-12-26 07:34:58,224][123090] Updated weights for policy 1, policy_version 993840 (0.0009) [2023-12-26 07:34:58,291][123090] Updated weights for policy 1, policy_version 993850 (0.0008) [2023-12-26 07:34:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 510631936. Throughput: 0: 9040.6, 1: 8860.8. Samples: 510627596. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:34:58,785][121949] Avg episode reward: [(0, '6250.455'), (1, '5928.263')] [2023-12-26 07:34:59,052][123090] Updated weights for policy 1, policy_version 993860 (0.0009) [2023-12-26 07:34:59,104][123090] Updated weights for policy 1, policy_version 993870 (0.0009) [2023-12-26 07:34:59,162][123090] Updated weights for policy 1, policy_version 993880 (0.0009) [2023-12-26 07:34:59,179][123091] Updated weights for policy 0, policy_version 1000793 (0.0007) [2023-12-26 07:34:59,234][123091] Updated weights for policy 0, policy_version 1000803 (0.0008) [2023-12-26 07:34:59,294][123091] Updated weights for policy 0, policy_version 1000813 (0.0010) [2023-12-26 07:35:00,022][123090] Updated weights for policy 1, policy_version 993890 (0.0009) [2023-12-26 07:35:00,090][123090] Updated weights for policy 1, policy_version 993900 (0.0006) [2023-12-26 07:35:00,103][123091] Updated weights for policy 0, policy_version 1000823 (0.0008) [2023-12-26 07:35:00,149][123090] Updated weights for policy 1, policy_version 993910 (0.0007) [2023-12-26 07:35:00,164][123091] Updated weights for policy 0, policy_version 1000833 (0.0007) [2023-12-26 07:35:00,213][123090] Updated weights for policy 1, policy_version 993920 (0.0007) [2023-12-26 07:35:00,232][123091] Updated weights for policy 0, policy_version 1000843 (0.0009) [2023-12-26 07:35:00,962][123090] Updated weights for policy 1, policy_version 993930 (0.0010) [2023-12-26 07:35:01,021][123090] Updated weights for policy 1, policy_version 993940 (0.0010) [2023-12-26 07:35:01,024][123091] Updated weights for policy 0, policy_version 1000853 (0.0008) [2023-12-26 07:35:01,084][123090] Updated weights for policy 1, policy_version 993950 (0.0011) [2023-12-26 07:35:01,086][123091] Updated weights for policy 0, policy_version 1000863 (0.0008) [2023-12-26 07:35:01,151][123091] Updated weights for policy 0, policy_version 1000873 (0.0008) [2023-12-26 07:35:01,941][123090] Updated weights for policy 1, policy_version 993960 (0.0009) [2023-12-26 07:35:01,989][123091] Updated weights for policy 0, policy_version 1000883 (0.0008) [2023-12-26 07:35:02,010][123090] Updated weights for policy 1, policy_version 993970 (0.0008) [2023-12-26 07:35:02,039][123091] Updated weights for policy 0, policy_version 1000893 (0.0009) [2023-12-26 07:35:02,075][123090] Updated weights for policy 1, policy_version 993980 (0.0008) [2023-12-26 07:35:02,095][123091] Updated weights for policy 0, policy_version 1000903 (0.0007) [2023-12-26 07:35:02,859][123090] Updated weights for policy 1, policy_version 993990 (0.0009) [2023-12-26 07:35:02,920][123090] Updated weights for policy 1, policy_version 994000 (0.0008) [2023-12-26 07:35:02,957][123091] Updated weights for policy 0, policy_version 1000913 (0.0008) [2023-12-26 07:35:02,977][123090] Updated weights for policy 1, policy_version 994010 (0.0008) [2023-12-26 07:35:03,004][123091] Updated weights for policy 0, policy_version 1000923 (0.0008) [2023-12-26 07:35:03,059][123091] Updated weights for policy 0, policy_version 1000933 (0.0010) [2023-12-26 07:35:03,116][123091] Updated weights for policy 0, policy_version 1000943 (0.0008) [2023-12-26 07:35:03,736][123090] Updated weights for policy 1, policy_version 994020 (0.0008) [2023-12-26 07:35:03,785][123090] Updated weights for policy 1, policy_version 994030 (0.0009) [2023-12-26 07:35:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 510713856. Throughput: 0: 8910.4, 1: 8913.1. Samples: 510731048. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:03,786][121949] Avg episode reward: [(0, '6158.220'), (1, '5964.720')] [2023-12-26 07:35:03,834][123090] Updated weights for policy 1, policy_version 994040 (0.0009) [2023-12-26 07:35:03,959][123091] Updated weights for policy 0, policy_version 1000953 (0.0009) [2023-12-26 07:35:04,013][123091] Updated weights for policy 0, policy_version 1000963 (0.0009) [2023-12-26 07:35:04,068][123091] Updated weights for policy 0, policy_version 1000973 (0.0010) [2023-12-26 07:35:04,598][123090] Updated weights for policy 1, policy_version 994050 (0.0009) [2023-12-26 07:35:04,662][123090] Updated weights for policy 1, policy_version 994060 (0.0009) [2023-12-26 07:35:04,729][123090] Updated weights for policy 1, policy_version 994070 (0.0005) [2023-12-26 07:35:04,801][123090] Updated weights for policy 1, policy_version 994080 (0.0006) [2023-12-26 07:35:05,007][123091] Updated weights for policy 0, policy_version 1000983 (0.0010) [2023-12-26 07:35:05,073][123091] Updated weights for policy 0, policy_version 1000993 (0.0007) [2023-12-26 07:35:05,135][123091] Updated weights for policy 0, policy_version 1001003 (0.0010) [2023-12-26 07:35:05,481][123090] Updated weights for policy 1, policy_version 994090 (0.0009) [2023-12-26 07:35:05,545][123090] Updated weights for policy 1, policy_version 994100 (0.0009) [2023-12-26 07:35:05,617][123090] Updated weights for policy 1, policy_version 994110 (0.0010) [2023-12-26 07:35:06,009][123091] Updated weights for policy 0, policy_version 1001013 (0.0009) [2023-12-26 07:35:06,069][123091] Updated weights for policy 0, policy_version 1001023 (0.0009) [2023-12-26 07:35:06,126][123091] Updated weights for policy 0, policy_version 1001033 (0.0009) [2023-12-26 07:35:06,460][123090] Updated weights for policy 1, policy_version 994120 (0.0009) [2023-12-26 07:35:06,530][123090] Updated weights for policy 1, policy_version 994130 (0.0009) [2023-12-26 07:35:06,600][123090] Updated weights for policy 1, policy_version 994140 (0.0010) [2023-12-26 07:35:07,008][123091] Updated weights for policy 0, policy_version 1001043 (0.0010) [2023-12-26 07:35:07,075][123091] Updated weights for policy 0, policy_version 1001053 (0.0011) [2023-12-26 07:35:07,133][123091] Updated weights for policy 0, policy_version 1001063 (0.0010) [2023-12-26 07:35:07,305][123090] Updated weights for policy 1, policy_version 994150 (0.0009) [2023-12-26 07:35:07,366][123090] Updated weights for policy 1, policy_version 994160 (0.0008) [2023-12-26 07:35:07,429][123090] Updated weights for policy 1, policy_version 994170 (0.0009) [2023-12-26 07:35:07,886][123091] Updated weights for policy 0, policy_version 1001073 (0.0010) [2023-12-26 07:35:07,956][123091] Updated weights for policy 0, policy_version 1001083 (0.0010) [2023-12-26 07:35:08,025][123091] Updated weights for policy 0, policy_version 1001093 (0.0010) [2023-12-26 07:35:08,085][123091] Updated weights for policy 0, policy_version 1001103 (0.0010) [2023-12-26 07:35:08,303][123090] Updated weights for policy 1, policy_version 994180 (0.0008) [2023-12-26 07:35:08,370][123090] Updated weights for policy 1, policy_version 994190 (0.0009) [2023-12-26 07:35:08,423][123090] Updated weights for policy 1, policy_version 994200 (0.0009) [2023-12-26 07:35:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 510803968. Throughput: 0: 8902.4, 1: 8959.0. Samples: 510782272. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:08,785][121949] Avg episode reward: [(0, '6080.639'), (1, '6009.502')] [2023-12-26 07:35:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000994208_254517248.pth... [2023-12-26 07:35:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000993152_254246912.pth [2023-12-26 07:35:08,836][123091] Updated weights for policy 0, policy_version 1001113 (0.0007) [2023-12-26 07:35:08,896][123091] Updated weights for policy 0, policy_version 1001123 (0.0005) [2023-12-26 07:35:08,957][123091] Updated weights for policy 0, policy_version 1001133 (0.0007) [2023-12-26 07:35:08,976][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001001136_256294912.pth... [2023-12-26 07:35:08,981][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001000080_256024576.pth [2023-12-26 07:35:09,302][123090] Updated weights for policy 1, policy_version 994210 (0.0009) [2023-12-26 07:35:09,367][123090] Updated weights for policy 1, policy_version 994220 (0.0009) [2023-12-26 07:35:09,425][123090] Updated weights for policy 1, policy_version 994230 (0.0008) [2023-12-26 07:35:09,477][123090] Updated weights for policy 1, policy_version 994240 (0.0008) [2023-12-26 07:35:09,753][123091] Updated weights for policy 0, policy_version 1001143 (0.0011) [2023-12-26 07:35:09,816][123091] Updated weights for policy 0, policy_version 1001153 (0.0010) [2023-12-26 07:35:09,880][123091] Updated weights for policy 0, policy_version 1001163 (0.0010) [2023-12-26 07:35:10,394][123090] Updated weights for policy 1, policy_version 994250 (0.0010) [2023-12-26 07:35:10,471][123090] Updated weights for policy 1, policy_version 994260 (0.0010) [2023-12-26 07:35:10,544][123090] Updated weights for policy 1, policy_version 994270 (0.0009) [2023-12-26 07:35:10,585][123091] Updated weights for policy 0, policy_version 1001173 (0.0010) [2023-12-26 07:35:10,646][123091] Updated weights for policy 0, policy_version 1001183 (0.0010) [2023-12-26 07:35:10,723][123091] Updated weights for policy 0, policy_version 1001193 (0.0005) [2023-12-26 07:35:11,417][123091] Updated weights for policy 0, policy_version 1001203 (0.0006) [2023-12-26 07:35:11,433][123090] Updated weights for policy 1, policy_version 994280 (0.0008) [2023-12-26 07:35:11,485][123091] Updated weights for policy 0, policy_version 1001213 (0.0006) [2023-12-26 07:35:11,500][123090] Updated weights for policy 1, policy_version 994290 (0.0006) [2023-12-26 07:35:11,549][123091] Updated weights for policy 0, policy_version 1001223 (0.0006) [2023-12-26 07:35:11,560][123090] Updated weights for policy 1, policy_version 994300 (0.0009) [2023-12-26 07:35:12,259][123091] Updated weights for policy 0, policy_version 1001233 (0.0009) [2023-12-26 07:35:12,324][123091] Updated weights for policy 0, policy_version 1001243 (0.0010) [2023-12-26 07:35:12,386][123091] Updated weights for policy 0, policy_version 1001253 (0.0007) [2023-12-26 07:35:12,440][123090] Updated weights for policy 1, policy_version 994310 (0.0008) [2023-12-26 07:35:12,454][123091] Updated weights for policy 0, policy_version 1001263 (0.0008) [2023-12-26 07:35:12,511][123090] Updated weights for policy 1, policy_version 994320 (0.0009) [2023-12-26 07:35:12,576][123090] Updated weights for policy 1, policy_version 994330 (0.0008) [2023-12-26 07:35:13,268][123091] Updated weights for policy 0, policy_version 1001273 (0.0010) [2023-12-26 07:35:13,326][123091] Updated weights for policy 0, policy_version 1001283 (0.0010) [2023-12-26 07:35:13,387][123091] Updated weights for policy 0, policy_version 1001294 (0.0010) [2023-12-26 07:35:13,404][123090] Updated weights for policy 1, policy_version 994340 (0.0007) [2023-12-26 07:35:13,462][123090] Updated weights for policy 1, policy_version 994350 (0.0009) [2023-12-26 07:35:13,521][123090] Updated weights for policy 1, policy_version 994360 (0.0008) [2023-12-26 07:35:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 510894080. Throughput: 0: 8836.2, 1: 8889.6. Samples: 510885620. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:13,785][121949] Avg episode reward: [(0, '6094.311'), (1, '6023.076')] [2023-12-26 07:35:14,112][123091] Updated weights for policy 0, policy_version 1001304 (0.0006) [2023-12-26 07:35:14,166][123091] Updated weights for policy 0, policy_version 1001314 (0.0005) [2023-12-26 07:35:14,218][123091] Updated weights for policy 0, policy_version 1001324 (0.0005) [2023-12-26 07:35:14,334][123090] Updated weights for policy 1, policy_version 994370 (0.0009) [2023-12-26 07:35:14,404][123090] Updated weights for policy 1, policy_version 994380 (0.0010) [2023-12-26 07:35:14,463][123090] Updated weights for policy 1, policy_version 994390 (0.0009) [2023-12-26 07:35:14,530][123090] Updated weights for policy 1, policy_version 994400 (0.0009) [2023-12-26 07:35:15,002][123091] Updated weights for policy 0, policy_version 1001334 (0.0008) [2023-12-26 07:35:15,066][123091] Updated weights for policy 0, policy_version 1001344 (0.0011) [2023-12-26 07:35:15,125][123091] Updated weights for policy 0, policy_version 1001354 (0.0010) [2023-12-26 07:35:15,356][123090] Updated weights for policy 1, policy_version 994410 (0.0009) [2023-12-26 07:35:15,417][123090] Updated weights for policy 1, policy_version 994420 (0.0009) [2023-12-26 07:35:15,474][123090] Updated weights for policy 1, policy_version 994430 (0.0007) [2023-12-26 07:35:15,959][123091] Updated weights for policy 0, policy_version 1001364 (0.0011) [2023-12-26 07:35:16,023][123091] Updated weights for policy 0, policy_version 1001374 (0.0007) [2023-12-26 07:35:16,090][123091] Updated weights for policy 0, policy_version 1001384 (0.0005) [2023-12-26 07:35:16,183][123090] Updated weights for policy 1, policy_version 994440 (0.0006) [2023-12-26 07:35:16,254][123090] Updated weights for policy 1, policy_version 994450 (0.0006) [2023-12-26 07:35:16,327][123090] Updated weights for policy 1, policy_version 994460 (0.0005) [2023-12-26 07:35:16,868][123091] Updated weights for policy 0, policy_version 1001394 (0.0009) [2023-12-26 07:35:16,915][123091] Updated weights for policy 0, policy_version 1001404 (0.0010) [2023-12-26 07:35:16,967][123091] Updated weights for policy 0, policy_version 1001414 (0.0010) [2023-12-26 07:35:16,992][123090] Updated weights for policy 1, policy_version 994470 (0.0007) [2023-12-26 07:35:17,015][123091] Updated weights for policy 0, policy_version 1001424 (0.0010) [2023-12-26 07:35:17,047][123090] Updated weights for policy 1, policy_version 994480 (0.0009) [2023-12-26 07:35:17,107][123090] Updated weights for policy 1, policy_version 994490 (0.0009) [2023-12-26 07:35:17,836][123090] Updated weights for policy 1, policy_version 994500 (0.0008) [2023-12-26 07:35:17,838][123091] Updated weights for policy 0, policy_version 1001434 (0.0010) [2023-12-26 07:35:17,888][123091] Updated weights for policy 0, policy_version 1001444 (0.0008) [2023-12-26 07:35:17,900][123090] Updated weights for policy 1, policy_version 994510 (0.0008) [2023-12-26 07:35:17,939][123091] Updated weights for policy 0, policy_version 1001454 (0.0006) [2023-12-26 07:35:17,961][123090] Updated weights for policy 1, policy_version 994520 (0.0005) [2023-12-26 07:35:18,733][123091] Updated weights for policy 0, policy_version 1001464 (0.0006) [2023-12-26 07:35:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 510976000. Throughput: 0: 8842.5, 1: 8876.6. Samples: 510994872. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:18,784][121949] Avg episode reward: [(0, '6179.672'), (1, '6005.108')] [2023-12-26 07:35:18,789][123091] Updated weights for policy 0, policy_version 1001474 (0.0005) [2023-12-26 07:35:18,804][123090] Updated weights for policy 1, policy_version 994530 (0.0006) [2023-12-26 07:35:18,851][123091] Updated weights for policy 0, policy_version 1001484 (0.0007) [2023-12-26 07:35:18,862][123090] Updated weights for policy 1, policy_version 994540 (0.0008) [2023-12-26 07:35:18,915][123090] Updated weights for policy 1, policy_version 994550 (0.0008) [2023-12-26 07:35:19,635][123091] Updated weights for policy 0, policy_version 1001494 (0.0009) [2023-12-26 07:35:19,696][123091] Updated weights for policy 0, policy_version 1001504 (0.0009) [2023-12-26 07:35:19,766][123091] Updated weights for policy 0, policy_version 1001514 (0.0010) [2023-12-26 07:35:19,776][123090] Updated weights for policy 1, policy_version 994561 (0.0009) [2023-12-26 07:35:19,850][123090] Updated weights for policy 1, policy_version 994571 (0.0006) [2023-12-26 07:35:19,909][123090] Updated weights for policy 1, policy_version 994581 (0.0008) [2023-12-26 07:35:19,978][123090] Updated weights for policy 1, policy_version 994591 (0.0008) [2023-12-26 07:35:20,610][123091] Updated weights for policy 0, policy_version 1001524 (0.0007) [2023-12-26 07:35:20,673][123091] Updated weights for policy 0, policy_version 1001534 (0.0009) [2023-12-26 07:35:20,745][123091] Updated weights for policy 0, policy_version 1001544 (0.0009) [2023-12-26 07:35:20,782][123090] Updated weights for policy 1, policy_version 994601 (0.0009) [2023-12-26 07:35:20,843][123090] Updated weights for policy 1, policy_version 994611 (0.0009) [2023-12-26 07:35:20,910][123090] Updated weights for policy 1, policy_version 994621 (0.0009) [2023-12-26 07:35:21,526][123091] Updated weights for policy 0, policy_version 1001554 (0.0008) [2023-12-26 07:35:21,574][123091] Updated weights for policy 0, policy_version 1001564 (0.0006) [2023-12-26 07:35:21,633][123091] Updated weights for policy 0, policy_version 1001574 (0.0007) [2023-12-26 07:35:21,702][123091] Updated weights for policy 0, policy_version 1001584 (0.0007) [2023-12-26 07:35:21,825][123090] Updated weights for policy 1, policy_version 994631 (0.0010) [2023-12-26 07:35:21,883][123090] Updated weights for policy 1, policy_version 994641 (0.0009) [2023-12-26 07:35:21,951][123090] Updated weights for policy 1, policy_version 994651 (0.0009) [2023-12-26 07:35:22,477][123091] Updated weights for policy 0, policy_version 1001594 (0.0010) [2023-12-26 07:35:22,544][123091] Updated weights for policy 0, policy_version 1001604 (0.0010) [2023-12-26 07:35:22,603][123091] Updated weights for policy 0, policy_version 1001614 (0.0010) [2023-12-26 07:35:22,793][123090] Updated weights for policy 1, policy_version 994661 (0.0010) [2023-12-26 07:35:22,844][123090] Updated weights for policy 1, policy_version 994671 (0.0010) [2023-12-26 07:35:22,898][123090] Updated weights for policy 1, policy_version 994681 (0.0010) [2023-12-26 07:35:23,329][123091] Updated weights for policy 0, policy_version 1001624 (0.0006) [2023-12-26 07:35:23,385][123091] Updated weights for policy 0, policy_version 1001634 (0.0005) [2023-12-26 07:35:23,452][123091] Updated weights for policy 0, policy_version 1001644 (0.0010) [2023-12-26 07:35:23,766][123090] Updated weights for policy 1, policy_version 994691 (0.0008) [2023-12-26 07:35:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 511066112. Throughput: 0: 8890.0, 1: 8805.2. Samples: 511045612. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:23,785][121949] Avg episode reward: [(0, '6035.046'), (1, '6005.318')] [2023-12-26 07:35:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001001648_256425984.pth... [2023-12-26 07:35:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001000592_256155648.pth [2023-12-26 07:35:23,813][123090] Updated weights for policy 1, policy_version 994701 (0.0005) [2023-12-26 07:35:23,861][123090] Updated weights for policy 1, policy_version 994711 (0.0005) [2023-12-26 07:35:23,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000994720_254648320.pth... [2023-12-26 07:35:23,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000993696_254386176.pth [2023-12-26 07:35:24,133][123091] Updated weights for policy 0, policy_version 1001654 (0.0010) [2023-12-26 07:35:24,200][123091] Updated weights for policy 0, policy_version 1001664 (0.0007) [2023-12-26 07:35:24,259][123091] Updated weights for policy 0, policy_version 1001674 (0.0005) [2023-12-26 07:35:24,651][123090] Updated weights for policy 1, policy_version 994721 (0.0006) [2023-12-26 07:35:24,708][123090] Updated weights for policy 1, policy_version 994731 (0.0010) [2023-12-26 07:35:24,762][123090] Updated weights for policy 1, policy_version 994741 (0.0010) [2023-12-26 07:35:24,817][123090] Updated weights for policy 1, policy_version 994751 (0.0010) [2023-12-26 07:35:24,880][123091] Updated weights for policy 0, policy_version 1001684 (0.0005) [2023-12-26 07:35:24,942][123091] Updated weights for policy 0, policy_version 1001694 (0.0005) [2023-12-26 07:35:25,014][123091] Updated weights for policy 0, policy_version 1001704 (0.0006) [2023-12-26 07:35:25,627][123091] Updated weights for policy 0, policy_version 1001714 (0.0006) [2023-12-26 07:35:25,684][123091] Updated weights for policy 0, policy_version 1001724 (0.0007) [2023-12-26 07:35:25,750][123091] Updated weights for policy 0, policy_version 1001734 (0.0010) [2023-12-26 07:35:25,769][123090] Updated weights for policy 1, policy_version 994761 (0.0007) [2023-12-26 07:35:25,812][123091] Updated weights for policy 0, policy_version 1001744 (0.0010) [2023-12-26 07:35:25,834][123090] Updated weights for policy 1, policy_version 994771 (0.0008) [2023-12-26 07:35:25,893][123090] Updated weights for policy 1, policy_version 994781 (0.0009) [2023-12-26 07:35:26,508][123091] Updated weights for policy 0, policy_version 1001754 (0.0009) [2023-12-26 07:35:26,576][123091] Updated weights for policy 0, policy_version 1001764 (0.0010) [2023-12-26 07:35:26,633][123091] Updated weights for policy 0, policy_version 1001774 (0.0010) [2023-12-26 07:35:26,781][123090] Updated weights for policy 1, policy_version 994791 (0.0007) [2023-12-26 07:35:26,833][123090] Updated weights for policy 1, policy_version 994801 (0.0005) [2023-12-26 07:35:26,887][123090] Updated weights for policy 1, policy_version 994811 (0.0005) [2023-12-26 07:35:27,411][123091] Updated weights for policy 0, policy_version 1001784 (0.0008) [2023-12-26 07:35:27,465][123091] Updated weights for policy 0, policy_version 1001794 (0.0005) [2023-12-26 07:35:27,513][123091] Updated weights for policy 0, policy_version 1001804 (0.0005) [2023-12-26 07:35:27,663][123090] Updated weights for policy 1, policy_version 994821 (0.0007) [2023-12-26 07:35:27,728][123090] Updated weights for policy 1, policy_version 994831 (0.0009) [2023-12-26 07:35:27,789][123090] Updated weights for policy 1, policy_version 994841 (0.0009) [2023-12-26 07:35:28,246][123091] Updated weights for policy 0, policy_version 1001814 (0.0006) [2023-12-26 07:35:28,314][123091] Updated weights for policy 0, policy_version 1001824 (0.0008) [2023-12-26 07:35:28,382][123091] Updated weights for policy 0, policy_version 1001834 (0.0010) [2023-12-26 07:35:28,683][123090] Updated weights for policy 1, policy_version 994851 (0.0009) [2023-12-26 07:35:28,745][123090] Updated weights for policy 1, policy_version 994861 (0.0009) [2023-12-26 07:35:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 511156224. Throughput: 0: 9025.1, 1: 8790.3. Samples: 511153932. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:28,785][121949] Avg episode reward: [(0, '6080.609'), (1, '6042.297')] [2023-12-26 07:35:28,810][123090] Updated weights for policy 1, policy_version 994871 (0.0009) [2023-12-26 07:35:29,037][123091] Updated weights for policy 0, policy_version 1001844 (0.0006) [2023-12-26 07:35:29,089][123091] Updated weights for policy 0, policy_version 1001854 (0.0005) [2023-12-26 07:35:29,154][123091] Updated weights for policy 0, policy_version 1001864 (0.0007) [2023-12-26 07:35:29,663][123090] Updated weights for policy 1, policy_version 994881 (0.0009) [2023-12-26 07:35:29,719][123090] Updated weights for policy 1, policy_version 994891 (0.0009) [2023-12-26 07:35:29,777][123090] Updated weights for policy 1, policy_version 994901 (0.0009) [2023-12-26 07:35:29,832][123090] Updated weights for policy 1, policy_version 994911 (0.0008) [2023-12-26 07:35:29,954][123091] Updated weights for policy 0, policy_version 1001874 (0.0009) [2023-12-26 07:35:30,017][123091] Updated weights for policy 0, policy_version 1001884 (0.0008) [2023-12-26 07:35:30,079][123091] Updated weights for policy 0, policy_version 1001894 (0.0010) [2023-12-26 07:35:30,137][123091] Updated weights for policy 0, policy_version 1001904 (0.0010) [2023-12-26 07:35:30,647][123090] Updated weights for policy 1, policy_version 994921 (0.0009) [2023-12-26 07:35:30,700][123090] Updated weights for policy 1, policy_version 994931 (0.0009) [2023-12-26 07:35:30,752][123090] Updated weights for policy 1, policy_version 994941 (0.0009) [2023-12-26 07:35:30,846][123091] Updated weights for policy 0, policy_version 1001914 (0.0005) [2023-12-26 07:35:30,896][123091] Updated weights for policy 0, policy_version 1001924 (0.0007) [2023-12-26 07:35:30,948][123091] Updated weights for policy 0, policy_version 1001934 (0.0009) [2023-12-26 07:35:31,540][123090] Updated weights for policy 1, policy_version 994951 (0.0006) [2023-12-26 07:35:31,599][123090] Updated weights for policy 1, policy_version 994961 (0.0008) [2023-12-26 07:35:31,661][123090] Updated weights for policy 1, policy_version 994971 (0.0008) [2023-12-26 07:35:31,765][123091] Updated weights for policy 0, policy_version 1001944 (0.0009) [2023-12-26 07:35:31,815][123091] Updated weights for policy 0, policy_version 1001954 (0.0010) [2023-12-26 07:35:31,865][123091] Updated weights for policy 0, policy_version 1001964 (0.0009) [2023-12-26 07:35:32,489][123090] Updated weights for policy 1, policy_version 994981 (0.0005) [2023-12-26 07:35:32,570][123090] Updated weights for policy 1, policy_version 994991 (0.0006) [2023-12-26 07:35:32,650][123090] Updated weights for policy 1, policy_version 995001 (0.0006) [2023-12-26 07:35:32,734][123091] Updated weights for policy 0, policy_version 1001975 (0.0010) [2023-12-26 07:35:32,790][123091] Updated weights for policy 0, policy_version 1001985 (0.0010) [2023-12-26 07:35:32,849][123091] Updated weights for policy 0, policy_version 1001995 (0.0009) [2023-12-26 07:35:33,389][123090] Updated weights for policy 1, policy_version 995011 (0.0010) [2023-12-26 07:35:33,442][123090] Updated weights for policy 1, policy_version 995021 (0.0008) [2023-12-26 07:35:33,497][123090] Updated weights for policy 1, policy_version 995031 (0.0008) [2023-12-26 07:35:33,661][123091] Updated weights for policy 0, policy_version 1002005 (0.0009) [2023-12-26 07:35:33,714][123091] Updated weights for policy 0, policy_version 1002015 (0.0009) [2023-12-26 07:35:33,762][123091] Updated weights for policy 0, policy_version 1002025 (0.0009) [2023-12-26 07:35:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 511246336. Throughput: 0: 9061.2, 1: 8716.6. Samples: 511260272. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:33,785][121949] Avg episode reward: [(0, '6161.011'), (1, '6049.572')] [2023-12-26 07:35:34,374][123090] Updated weights for policy 1, policy_version 995041 (0.0009) [2023-12-26 07:35:34,424][123090] Updated weights for policy 1, policy_version 995051 (0.0009) [2023-12-26 07:35:34,480][123090] Updated weights for policy 1, policy_version 995061 (0.0007) [2023-12-26 07:35:34,540][123090] Updated weights for policy 1, policy_version 995071 (0.0006) [2023-12-26 07:35:34,559][123091] Updated weights for policy 0, policy_version 1002036 (0.0009) [2023-12-26 07:35:34,621][123091] Updated weights for policy 0, policy_version 1002046 (0.0009) [2023-12-26 07:35:34,684][123091] Updated weights for policy 0, policy_version 1002056 (0.0010) [2023-12-26 07:35:35,377][123090] Updated weights for policy 1, policy_version 995081 (0.0008) [2023-12-26 07:35:35,428][123090] Updated weights for policy 1, policy_version 995091 (0.0009) [2023-12-26 07:35:35,478][123090] Updated weights for policy 1, policy_version 995101 (0.0009) [2023-12-26 07:35:35,530][123091] Updated weights for policy 0, policy_version 1002066 (0.0009) [2023-12-26 07:35:35,587][123091] Updated weights for policy 0, policy_version 1002076 (0.0010) [2023-12-26 07:35:35,644][123091] Updated weights for policy 0, policy_version 1002086 (0.0010) [2023-12-26 07:35:35,697][123091] Updated weights for policy 0, policy_version 1002096 (0.0009) [2023-12-26 07:35:36,343][123090] Updated weights for policy 1, policy_version 995111 (0.0010) [2023-12-26 07:35:36,411][123090] Updated weights for policy 1, policy_version 995121 (0.0010) [2023-12-26 07:35:36,480][123090] Updated weights for policy 1, policy_version 995131 (0.0009) [2023-12-26 07:35:36,558][123091] Updated weights for policy 0, policy_version 1002106 (0.0009) [2023-12-26 07:35:36,617][123091] Updated weights for policy 0, policy_version 1002116 (0.0010) [2023-12-26 07:35:36,676][123091] Updated weights for policy 0, policy_version 1002126 (0.0009) [2023-12-26 07:35:37,319][123090] Updated weights for policy 1, policy_version 995141 (0.0010) [2023-12-26 07:35:37,386][123090] Updated weights for policy 1, policy_version 995151 (0.0010) [2023-12-26 07:35:37,414][123091] Updated weights for policy 0, policy_version 1002136 (0.0006) [2023-12-26 07:35:37,443][123090] Updated weights for policy 1, policy_version 995161 (0.0010) [2023-12-26 07:35:37,482][123091] Updated weights for policy 0, policy_version 1002146 (0.0006) [2023-12-26 07:35:37,532][123091] Updated weights for policy 0, policy_version 1002156 (0.0009) [2023-12-26 07:35:38,302][123090] Updated weights for policy 1, policy_version 995171 (0.0009) [2023-12-26 07:35:38,333][123091] Updated weights for policy 0, policy_version 1002166 (0.0008) [2023-12-26 07:35:38,368][123090] Updated weights for policy 1, policy_version 995181 (0.0008) [2023-12-26 07:35:38,401][123091] Updated weights for policy 0, policy_version 1002176 (0.0011) [2023-12-26 07:35:38,417][123090] Updated weights for policy 1, policy_version 995191 (0.0006) [2023-12-26 07:35:38,459][123091] Updated weights for policy 0, policy_version 1002186 (0.0011) [2023-12-26 07:35:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 511336448. Throughput: 0: 9023.5, 1: 8678.8. Samples: 511310744. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:38,785][121949] Avg episode reward: [(0, '6143.906'), (1, '6031.833')] [2023-12-26 07:35:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001002192_256565248.pth... [2023-12-26 07:35:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000995200_254771200.pth... [2023-12-26 07:35:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000994208_254517248.pth [2023-12-26 07:35:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001001136_256294912.pth [2023-12-26 07:35:39,108][123091] Updated weights for policy 0, policy_version 1002196 (0.0009) [2023-12-26 07:35:39,166][123091] Updated weights for policy 0, policy_version 1002206 (0.0005) [2023-12-26 07:35:39,234][123091] Updated weights for policy 0, policy_version 1002216 (0.0006) [2023-12-26 07:35:39,320][123090] Updated weights for policy 1, policy_version 995201 (0.0007) [2023-12-26 07:35:39,388][123090] Updated weights for policy 1, policy_version 995211 (0.0010) [2023-12-26 07:35:39,456][123090] Updated weights for policy 1, policy_version 995221 (0.0009) [2023-12-26 07:35:39,518][123090] Updated weights for policy 1, policy_version 995231 (0.0009) [2023-12-26 07:35:40,059][123091] Updated weights for policy 0, policy_version 1002226 (0.0009) [2023-12-26 07:35:40,114][123091] Updated weights for policy 0, policy_version 1002236 (0.0010) [2023-12-26 07:35:40,168][123091] Updated weights for policy 0, policy_version 1002246 (0.0010) [2023-12-26 07:35:40,238][123091] Updated weights for policy 0, policy_version 1002256 (0.0009) [2023-12-26 07:35:40,363][123090] Updated weights for policy 1, policy_version 995241 (0.0010) [2023-12-26 07:35:40,417][123090] Updated weights for policy 1, policy_version 995251 (0.0010) [2023-12-26 07:35:40,472][123090] Updated weights for policy 1, policy_version 995261 (0.0010) [2023-12-26 07:35:40,974][123091] Updated weights for policy 0, policy_version 1002266 (0.0005) [2023-12-26 07:35:41,052][123091] Updated weights for policy 0, policy_version 1002276 (0.0008) [2023-12-26 07:35:41,118][123091] Updated weights for policy 0, policy_version 1002286 (0.0010) [2023-12-26 07:35:41,389][123090] Updated weights for policy 1, policy_version 995271 (0.0009) [2023-12-26 07:35:41,455][123090] Updated weights for policy 1, policy_version 995281 (0.0010) [2023-12-26 07:35:41,527][123090] Updated weights for policy 1, policy_version 995291 (0.0010) [2023-12-26 07:35:41,905][123091] Updated weights for policy 0, policy_version 1002296 (0.0010) [2023-12-26 07:35:41,964][123091] Updated weights for policy 0, policy_version 1002306 (0.0010) [2023-12-26 07:35:42,034][123091] Updated weights for policy 0, policy_version 1002316 (0.0010) [2023-12-26 07:35:42,395][123090] Updated weights for policy 1, policy_version 995301 (0.0009) [2023-12-26 07:35:42,464][123090] Updated weights for policy 1, policy_version 995311 (0.0009) [2023-12-26 07:35:42,532][123090] Updated weights for policy 1, policy_version 995321 (0.0010) [2023-12-26 07:35:42,849][123091] Updated weights for policy 0, policy_version 1002326 (0.0007) [2023-12-26 07:35:42,903][123091] Updated weights for policy 0, policy_version 1002336 (0.0005) [2023-12-26 07:35:42,951][123091] Updated weights for policy 0, policy_version 1002346 (0.0005) [2023-12-26 07:35:43,377][123090] Updated weights for policy 1, policy_version 995331 (0.0009) [2023-12-26 07:35:43,429][123090] Updated weights for policy 1, policy_version 995341 (0.0005) [2023-12-26 07:35:43,478][123090] Updated weights for policy 1, policy_version 995351 (0.0005) [2023-12-26 07:35:43,645][123091] Updated weights for policy 0, policy_version 1002356 (0.0006) [2023-12-26 07:35:43,711][123091] Updated weights for policy 0, policy_version 1002366 (0.0005) [2023-12-26 07:35:43,769][123091] Updated weights for policy 0, policy_version 1002376 (0.0005) [2023-12-26 07:35:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 511418368. Throughput: 0: 8953.1, 1: 8509.4. Samples: 511413404. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:43,785][121949] Avg episode reward: [(0, '6132.370'), (1, '6021.358')] [2023-12-26 07:35:44,243][123090] Updated weights for policy 1, policy_version 995361 (0.0006) [2023-12-26 07:35:44,302][123090] Updated weights for policy 1, policy_version 995371 (0.0010) [2023-12-26 07:35:44,358][123090] Updated weights for policy 1, policy_version 995381 (0.0010) [2023-12-26 07:35:44,418][123090] Updated weights for policy 1, policy_version 995391 (0.0009) [2023-12-26 07:35:44,464][123091] Updated weights for policy 0, policy_version 1002386 (0.0006) [2023-12-26 07:35:44,520][123091] Updated weights for policy 0, policy_version 1002396 (0.0010) [2023-12-26 07:35:44,574][123091] Updated weights for policy 0, policy_version 1002406 (0.0009) [2023-12-26 07:35:44,633][123091] Updated weights for policy 0, policy_version 1002416 (0.0010) [2023-12-26 07:35:45,291][123090] Updated weights for policy 1, policy_version 995401 (0.0009) [2023-12-26 07:35:45,358][123090] Updated weights for policy 1, policy_version 995411 (0.0009) [2023-12-26 07:35:45,422][123090] Updated weights for policy 1, policy_version 995421 (0.0009) [2023-12-26 07:35:45,509][123091] Updated weights for policy 0, policy_version 1002426 (0.0011) [2023-12-26 07:35:45,580][123091] Updated weights for policy 0, policy_version 1002436 (0.0010) [2023-12-26 07:35:45,643][123091] Updated weights for policy 0, policy_version 1002446 (0.0010) [2023-12-26 07:35:46,144][123090] Updated weights for policy 1, policy_version 995431 (0.0007) [2023-12-26 07:35:46,194][123090] Updated weights for policy 1, policy_version 995441 (0.0005) [2023-12-26 07:35:46,251][123090] Updated weights for policy 1, policy_version 995451 (0.0006) [2023-12-26 07:35:46,433][123091] Updated weights for policy 0, policy_version 1002456 (0.0011) [2023-12-26 07:35:46,491][123091] Updated weights for policy 0, policy_version 1002466 (0.0010) [2023-12-26 07:35:46,542][123091] Updated weights for policy 0, policy_version 1002476 (0.0010) [2023-12-26 07:35:46,949][123090] Updated weights for policy 1, policy_version 995461 (0.0006) [2023-12-26 07:35:47,013][123090] Updated weights for policy 1, policy_version 995471 (0.0005) [2023-12-26 07:35:47,071][123090] Updated weights for policy 1, policy_version 995481 (0.0010) [2023-12-26 07:35:47,317][123091] Updated weights for policy 0, policy_version 1002486 (0.0010) [2023-12-26 07:35:47,384][123091] Updated weights for policy 0, policy_version 1002496 (0.0009) [2023-12-26 07:35:47,450][123091] Updated weights for policy 0, policy_version 1002506 (0.0006) [2023-12-26 07:35:47,860][123090] Updated weights for policy 1, policy_version 995491 (0.0009) [2023-12-26 07:35:47,933][123090] Updated weights for policy 1, policy_version 995501 (0.0006) [2023-12-26 07:35:48,010][123090] Updated weights for policy 1, policy_version 995511 (0.0006) [2023-12-26 07:35:48,071][123091] Updated weights for policy 0, policy_version 1002516 (0.0005) [2023-12-26 07:35:48,146][123091] Updated weights for policy 0, policy_version 1002526 (0.0006) [2023-12-26 07:35:48,208][123091] Updated weights for policy 0, policy_version 1002536 (0.0010) [2023-12-26 07:35:48,649][123090] Updated weights for policy 1, policy_version 995521 (0.0005) [2023-12-26 07:35:48,705][123090] Updated weights for policy 1, policy_version 995531 (0.0005) [2023-12-26 07:35:48,759][123090] Updated weights for policy 1, policy_version 995541 (0.0006) [2023-12-26 07:35:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 511508480. Throughput: 0: 9080.1, 1: 8562.5. Samples: 511524956. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:48,785][121949] Avg episode reward: [(0, '6214.253'), (1, '6036.234')] [2023-12-26 07:35:48,817][123090] Updated weights for policy 1, policy_version 995551 (0.0007) [2023-12-26 07:35:49,040][123091] Updated weights for policy 0, policy_version 1002546 (0.0009) [2023-12-26 07:35:49,107][123091] Updated weights for policy 0, policy_version 1002556 (0.0008) [2023-12-26 07:35:49,176][123091] Updated weights for policy 0, policy_version 1002566 (0.0008) [2023-12-26 07:35:49,239][123091] Updated weights for policy 0, policy_version 1002576 (0.0008) [2023-12-26 07:35:49,525][123090] Updated weights for policy 1, policy_version 995561 (0.0010) [2023-12-26 07:35:49,577][123090] Updated weights for policy 1, policy_version 995571 (0.0010) [2023-12-26 07:35:49,636][123090] Updated weights for policy 1, policy_version 995581 (0.0010) [2023-12-26 07:35:50,036][123091] Updated weights for policy 0, policy_version 1002586 (0.0009) [2023-12-26 07:35:50,093][123091] Updated weights for policy 0, policy_version 1002596 (0.0009) [2023-12-26 07:35:50,155][123091] Updated weights for policy 0, policy_version 1002606 (0.0009) [2023-12-26 07:35:50,493][123090] Updated weights for policy 1, policy_version 995591 (0.0010) [2023-12-26 07:35:50,544][123090] Updated weights for policy 1, policy_version 995601 (0.0010) [2023-12-26 07:35:50,610][123090] Updated weights for policy 1, policy_version 995611 (0.0011) [2023-12-26 07:35:51,000][123091] Updated weights for policy 0, policy_version 1002616 (0.0010) [2023-12-26 07:35:51,066][123091] Updated weights for policy 0, policy_version 1002626 (0.0008) [2023-12-26 07:35:51,133][123091] Updated weights for policy 0, policy_version 1002636 (0.0008) [2023-12-26 07:35:51,428][123090] Updated weights for policy 1, policy_version 995621 (0.0010) [2023-12-26 07:35:51,492][123090] Updated weights for policy 1, policy_version 995631 (0.0009) [2023-12-26 07:35:51,555][123090] Updated weights for policy 1, policy_version 995641 (0.0010) [2023-12-26 07:35:51,950][123091] Updated weights for policy 0, policy_version 1002646 (0.0007) [2023-12-26 07:35:52,011][123091] Updated weights for policy 0, policy_version 1002656 (0.0008) [2023-12-26 07:35:52,067][123091] Updated weights for policy 0, policy_version 1002666 (0.0008) [2023-12-26 07:35:52,371][123090] Updated weights for policy 1, policy_version 995651 (0.0006) [2023-12-26 07:35:52,436][123090] Updated weights for policy 1, policy_version 995661 (0.0009) [2023-12-26 07:35:52,505][123090] Updated weights for policy 1, policy_version 995671 (0.0009) [2023-12-26 07:35:52,882][123091] Updated weights for policy 0, policy_version 1002676 (0.0009) [2023-12-26 07:35:52,948][123091] Updated weights for policy 0, policy_version 1002686 (0.0010) [2023-12-26 07:35:53,001][123091] Updated weights for policy 0, policy_version 1002696 (0.0010) [2023-12-26 07:35:53,267][123090] Updated weights for policy 1, policy_version 995681 (0.0009) [2023-12-26 07:35:53,332][123090] Updated weights for policy 1, policy_version 995691 (0.0005) [2023-12-26 07:35:53,396][123090] Updated weights for policy 1, policy_version 995701 (0.0005) [2023-12-26 07:35:53,457][123090] Updated weights for policy 1, policy_version 995711 (0.0005) [2023-12-26 07:35:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 511598592. Throughput: 0: 9093.4, 1: 8547.9. Samples: 511576136. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:53,785][121949] Avg episode reward: [(0, '6169.020'), (1, '5988.295')] [2023-12-26 07:35:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001002704_256696320.pth... [2023-12-26 07:35:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000995712_254902272.pth... [2023-12-26 07:35:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001001648_256425984.pth [2023-12-26 07:35:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000994720_254648320.pth [2023-12-26 07:35:53,915][123091] Updated weights for policy 0, policy_version 1002706 (0.0010) [2023-12-26 07:35:53,980][123091] Updated weights for policy 0, policy_version 1002716 (0.0010) [2023-12-26 07:35:54,046][123091] Updated weights for policy 0, policy_version 1002726 (0.0010) [2023-12-26 07:35:54,046][123090] Updated weights for policy 1, policy_version 995721 (0.0010) [2023-12-26 07:35:54,113][123091] Updated weights for policy 0, policy_version 1002736 (0.0011) [2023-12-26 07:35:54,114][123090] Updated weights for policy 1, policy_version 995731 (0.0006) [2023-12-26 07:35:54,181][123090] Updated weights for policy 1, policy_version 995741 (0.0005) [2023-12-26 07:35:54,808][123090] Updated weights for policy 1, policy_version 995751 (0.0005) [2023-12-26 07:35:54,867][123090] Updated weights for policy 1, policy_version 995761 (0.0006) [2023-12-26 07:35:54,867][123091] Updated weights for policy 0, policy_version 1002746 (0.0008) [2023-12-26 07:35:54,915][123090] Updated weights for policy 1, policy_version 995771 (0.0007) [2023-12-26 07:35:54,915][123091] Updated weights for policy 0, policy_version 1002756 (0.0010) [2023-12-26 07:35:54,982][123091] Updated weights for policy 0, policy_version 1002766 (0.0011) [2023-12-26 07:35:55,701][123090] Updated weights for policy 1, policy_version 995781 (0.0009) [2023-12-26 07:35:55,749][123090] Updated weights for policy 1, policy_version 995791 (0.0008) [2023-12-26 07:35:55,798][123090] Updated weights for policy 1, policy_version 995801 (0.0009) [2023-12-26 07:35:55,817][123091] Updated weights for policy 0, policy_version 1002776 (0.0008) [2023-12-26 07:35:55,880][123091] Updated weights for policy 0, policy_version 1002786 (0.0009) [2023-12-26 07:35:55,928][123091] Updated weights for policy 0, policy_version 1002796 (0.0010) [2023-12-26 07:35:56,531][123090] Updated weights for policy 1, policy_version 995811 (0.0007) [2023-12-26 07:35:56,602][123090] Updated weights for policy 1, policy_version 995821 (0.0009) [2023-12-26 07:35:56,672][123090] Updated weights for policy 1, policy_version 995831 (0.0008) [2023-12-26 07:35:56,703][123091] Updated weights for policy 0, policy_version 1002806 (0.0008) [2023-12-26 07:35:56,757][123091] Updated weights for policy 0, policy_version 1002816 (0.0006) [2023-12-26 07:35:56,814][123091] Updated weights for policy 0, policy_version 1002826 (0.0005) [2023-12-26 07:35:57,511][123091] Updated weights for policy 0, policy_version 1002836 (0.0007) [2023-12-26 07:35:57,550][123090] Updated weights for policy 1, policy_version 995841 (0.0009) [2023-12-26 07:35:57,565][123091] Updated weights for policy 0, policy_version 1002846 (0.0009) [2023-12-26 07:35:57,603][123090] Updated weights for policy 1, policy_version 995851 (0.0007) [2023-12-26 07:35:57,619][123091] Updated weights for policy 0, policy_version 1002856 (0.0009) [2023-12-26 07:35:57,660][123090] Updated weights for policy 1, policy_version 995861 (0.0005) [2023-12-26 07:35:57,722][123090] Updated weights for policy 1, policy_version 995871 (0.0005) [2023-12-26 07:35:58,413][123091] Updated weights for policy 0, policy_version 1002866 (0.0007) [2023-12-26 07:35:58,485][123090] Updated weights for policy 1, policy_version 995881 (0.0008) [2023-12-26 07:35:58,492][123091] Updated weights for policy 0, policy_version 1002878 (0.0008) [2023-12-26 07:35:58,551][123090] Updated weights for policy 1, policy_version 995891 (0.0008) [2023-12-26 07:35:58,557][123091] Updated weights for policy 0, policy_version 1002888 (0.0010) [2023-12-26 07:35:58,617][123090] Updated weights for policy 1, policy_version 995901 (0.0008) [2023-12-26 07:35:58,784][121949] Fps is (10 sec: 18840.6, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 511696896. Throughput: 0: 9069.7, 1: 8697.9. Samples: 511685168. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:35:58,785][121949] Avg episode reward: [(0, '6007.062'), (1, '5922.854')] [2023-12-26 07:35:59,401][123091] Updated weights for policy 0, policy_version 1002898 (0.0011) [2023-12-26 07:35:59,473][123091] Updated weights for policy 0, policy_version 1002908 (0.0009) [2023-12-26 07:35:59,485][123090] Updated weights for policy 1, policy_version 995911 (0.0006) [2023-12-26 07:35:59,542][123091] Updated weights for policy 0, policy_version 1002918 (0.0010) [2023-12-26 07:35:59,549][123090] Updated weights for policy 1, policy_version 995921 (0.0005) [2023-12-26 07:35:59,602][123091] Updated weights for policy 0, policy_version 1002928 (0.0009) [2023-12-26 07:35:59,618][123090] Updated weights for policy 1, policy_version 995931 (0.0005) [2023-12-26 07:36:00,397][123090] Updated weights for policy 1, policy_version 995941 (0.0006) [2023-12-26 07:36:00,403][123091] Updated weights for policy 0, policy_version 1002938 (0.0010) [2023-12-26 07:36:00,451][123091] Updated weights for policy 0, policy_version 1002948 (0.0006) [2023-12-26 07:36:00,457][123090] Updated weights for policy 1, policy_version 995951 (0.0009) [2023-12-26 07:36:00,510][123091] Updated weights for policy 0, policy_version 1002958 (0.0008) [2023-12-26 07:36:00,514][123090] Updated weights for policy 1, policy_version 995961 (0.0009) [2023-12-26 07:36:01,330][123091] Updated weights for policy 0, policy_version 1002968 (0.0006) [2023-12-26 07:36:01,360][123090] Updated weights for policy 1, policy_version 995971 (0.0009) [2023-12-26 07:36:01,407][123091] Updated weights for policy 0, policy_version 1002978 (0.0008) [2023-12-26 07:36:01,431][123090] Updated weights for policy 1, policy_version 995981 (0.0007) [2023-12-26 07:36:01,472][123091] Updated weights for policy 0, policy_version 1002988 (0.0008) [2023-12-26 07:36:01,496][123090] Updated weights for policy 1, policy_version 995991 (0.0008) [2023-12-26 07:36:02,229][123091] Updated weights for policy 0, policy_version 1002998 (0.0009) [2023-12-26 07:36:02,299][123091] Updated weights for policy 0, policy_version 1003008 (0.0010) [2023-12-26 07:36:02,300][123090] Updated weights for policy 1, policy_version 996001 (0.0008) [2023-12-26 07:36:02,366][123090] Updated weights for policy 1, policy_version 996011 (0.0008) [2023-12-26 07:36:02,368][123091] Updated weights for policy 0, policy_version 1003018 (0.0008) [2023-12-26 07:36:02,425][123090] Updated weights for policy 1, policy_version 996021 (0.0010) [2023-12-26 07:36:02,487][123090] Updated weights for policy 1, policy_version 996031 (0.0008) [2023-12-26 07:36:03,152][123091] Updated weights for policy 0, policy_version 1003028 (0.0006) [2023-12-26 07:36:03,174][123090] Updated weights for policy 1, policy_version 996041 (0.0005) [2023-12-26 07:36:03,216][123091] Updated weights for policy 0, policy_version 1003038 (0.0006) [2023-12-26 07:36:03,220][123090] Updated weights for policy 1, policy_version 996051 (0.0007) [2023-12-26 07:36:03,268][123090] Updated weights for policy 1, policy_version 996061 (0.0005) [2023-12-26 07:36:03,275][123091] Updated weights for policy 0, policy_version 1003048 (0.0006) [2023-12-26 07:36:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 511778816. Throughput: 0: 9021.0, 1: 8681.4. Samples: 511791484. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:03,785][121949] Avg episode reward: [(0, '6035.539'), (1, '5934.357')] [2023-12-26 07:36:04,014][123091] Updated weights for policy 0, policy_version 1003058 (0.0007) [2023-12-26 07:36:04,038][123090] Updated weights for policy 1, policy_version 996071 (0.0007) [2023-12-26 07:36:04,076][123091] Updated weights for policy 0, policy_version 1003068 (0.0007) [2023-12-26 07:36:04,101][123090] Updated weights for policy 1, policy_version 996081 (0.0008) [2023-12-26 07:36:04,138][123091] Updated weights for policy 0, policy_version 1003078 (0.0008) [2023-12-26 07:36:04,160][123090] Updated weights for policy 1, policy_version 996091 (0.0008) [2023-12-26 07:36:04,200][123091] Updated weights for policy 0, policy_version 1003088 (0.0006) [2023-12-26 07:36:04,961][123091] Updated weights for policy 0, policy_version 1003098 (0.0009) [2023-12-26 07:36:04,991][123090] Updated weights for policy 1, policy_version 996101 (0.0008) [2023-12-26 07:36:05,019][123091] Updated weights for policy 0, policy_version 1003108 (0.0010) [2023-12-26 07:36:05,048][123090] Updated weights for policy 1, policy_version 996111 (0.0008) [2023-12-26 07:36:05,072][123091] Updated weights for policy 0, policy_version 1003118 (0.0008) [2023-12-26 07:36:05,098][123090] Updated weights for policy 1, policy_version 996121 (0.0009) [2023-12-26 07:36:05,873][123090] Updated weights for policy 1, policy_version 996132 (0.0009) [2023-12-26 07:36:05,934][123090] Updated weights for policy 1, policy_version 996142 (0.0009) [2023-12-26 07:36:05,949][123091] Updated weights for policy 0, policy_version 1003128 (0.0009) [2023-12-26 07:36:05,985][123090] Updated weights for policy 1, policy_version 996152 (0.0005) [2023-12-26 07:36:06,005][123091] Updated weights for policy 0, policy_version 1003138 (0.0008) [2023-12-26 07:36:06,056][123091] Updated weights for policy 0, policy_version 1003148 (0.0009) [2023-12-26 07:36:06,793][123090] Updated weights for policy 1, policy_version 996162 (0.0005) [2023-12-26 07:36:06,868][123090] Updated weights for policy 1, policy_version 996172 (0.0006) [2023-12-26 07:36:06,944][123090] Updated weights for policy 1, policy_version 996182 (0.0009) [2023-12-26 07:36:06,963][123091] Updated weights for policy 0, policy_version 1003158 (0.0008) [2023-12-26 07:36:07,013][123090] Updated weights for policy 1, policy_version 996192 (0.0009) [2023-12-26 07:36:07,032][123091] Updated weights for policy 0, policy_version 1003168 (0.0007) [2023-12-26 07:36:07,100][123091] Updated weights for policy 0, policy_version 1003178 (0.0011) [2023-12-26 07:36:07,793][123091] Updated weights for policy 0, policy_version 1003188 (0.0008) [2023-12-26 07:36:07,813][123090] Updated weights for policy 1, policy_version 996202 (0.0011) [2023-12-26 07:36:07,860][123091] Updated weights for policy 0, policy_version 1003198 (0.0005) [2023-12-26 07:36:07,865][123090] Updated weights for policy 1, policy_version 996212 (0.0010) [2023-12-26 07:36:07,917][123090] Updated weights for policy 1, policy_version 996222 (0.0010) [2023-12-26 07:36:07,922][123091] Updated weights for policy 0, policy_version 1003208 (0.0005) [2023-12-26 07:36:08,618][123091] Updated weights for policy 0, policy_version 1003218 (0.0006) [2023-12-26 07:36:08,659][123090] Updated weights for policy 1, policy_version 996232 (0.0008) [2023-12-26 07:36:08,681][123091] Updated weights for policy 0, policy_version 1003228 (0.0011) [2023-12-26 07:36:08,724][123090] Updated weights for policy 1, policy_version 996242 (0.0006) [2023-12-26 07:36:08,749][123091] Updated weights for policy 0, policy_version 1003238 (0.0011) [2023-12-26 07:36:08,784][121949] Fps is (10 sec: 16384.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 511860736. Throughput: 0: 9002.5, 1: 8736.3. Samples: 511843856. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:08,785][121949] Avg episode reward: [(0, '5930.522'), (1, '5900.595')] [2023-12-26 07:36:08,792][123090] Updated weights for policy 1, policy_version 996252 (0.0006) [2023-12-26 07:36:08,802][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001003248_256835584.pth... [2023-12-26 07:36:08,805][123091] Updated weights for policy 0, policy_version 1003248 (0.0011) [2023-12-26 07:36:08,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001002192_256565248.pth [2023-12-26 07:36:08,816][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000996256_255041536.pth... [2023-12-26 07:36:08,819][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000995200_254771200.pth [2023-12-26 07:36:09,496][123090] Updated weights for policy 1, policy_version 996262 (0.0006) [2023-12-26 07:36:09,556][123091] Updated weights for policy 0, policy_version 1003258 (0.0011) [2023-12-26 07:36:09,564][123090] Updated weights for policy 1, policy_version 996272 (0.0007) [2023-12-26 07:36:09,615][123091] Updated weights for policy 0, policy_version 1003268 (0.0011) [2023-12-26 07:36:09,636][123090] Updated weights for policy 1, policy_version 996282 (0.0011) [2023-12-26 07:36:09,679][123091] Updated weights for policy 0, policy_version 1003278 (0.0011) [2023-12-26 07:36:10,442][123090] Updated weights for policy 1, policy_version 996292 (0.0011) [2023-12-26 07:36:10,506][123090] Updated weights for policy 1, policy_version 996302 (0.0010) [2023-12-26 07:36:10,511][123091] Updated weights for policy 0, policy_version 1003288 (0.0011) [2023-12-26 07:36:10,570][123091] Updated weights for policy 0, policy_version 1003298 (0.0010) [2023-12-26 07:36:10,573][123090] Updated weights for policy 1, policy_version 996312 (0.0008) [2023-12-26 07:36:10,625][123091] Updated weights for policy 0, policy_version 1003308 (0.0011) [2023-12-26 07:36:11,242][123090] Updated weights for policy 1, policy_version 996322 (0.0006) [2023-12-26 07:36:11,316][123090] Updated weights for policy 1, policy_version 996332 (0.0008) [2023-12-26 07:36:11,394][123090] Updated weights for policy 1, policy_version 996342 (0.0008) [2023-12-26 07:36:11,454][123090] Updated weights for policy 1, policy_version 996352 (0.0008) [2023-12-26 07:36:11,486][123091] Updated weights for policy 0, policy_version 1003318 (0.0009) [2023-12-26 07:36:11,558][123091] Updated weights for policy 0, policy_version 1003328 (0.0011) [2023-12-26 07:36:11,630][123091] Updated weights for policy 0, policy_version 1003338 (0.0016) [2023-12-26 07:36:12,233][123090] Updated weights for policy 1, policy_version 996362 (0.0005) [2023-12-26 07:36:12,305][123090] Updated weights for policy 1, policy_version 996372 (0.0008) [2023-12-26 07:36:12,383][123090] Updated weights for policy 1, policy_version 996382 (0.0008) [2023-12-26 07:36:12,451][123091] Updated weights for policy 0, policy_version 1003348 (0.0009) [2023-12-26 07:36:12,509][123091] Updated weights for policy 0, policy_version 1003358 (0.0010) [2023-12-26 07:36:12,560][123091] Updated weights for policy 0, policy_version 1003368 (0.0010) [2023-12-26 07:36:13,157][123090] Updated weights for policy 1, policy_version 996393 (0.0010) [2023-12-26 07:36:13,211][123090] Updated weights for policy 1, policy_version 996403 (0.0010) [2023-12-26 07:36:13,263][123090] Updated weights for policy 1, policy_version 996413 (0.0009) [2023-12-26 07:36:13,404][123091] Updated weights for policy 0, policy_version 1003378 (0.0009) [2023-12-26 07:36:13,454][123091] Updated weights for policy 0, policy_version 1003388 (0.0009) [2023-12-26 07:36:13,503][123091] Updated weights for policy 0, policy_version 1003398 (0.0010) [2023-12-26 07:36:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 511959040. Throughput: 0: 8899.4, 1: 8821.4. Samples: 511951368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:13,785][121949] Avg episode reward: [(0, '6062.328'), (1, '5877.158')] [2023-12-26 07:36:14,098][123090] Updated weights for policy 1, policy_version 996423 (0.0006) [2023-12-26 07:36:14,157][123090] Updated weights for policy 1, policy_version 996433 (0.0005) [2023-12-26 07:36:14,212][123090] Updated weights for policy 1, policy_version 996443 (0.0009) [2023-12-26 07:36:14,377][123091] Updated weights for policy 0, policy_version 1003409 (0.0009) [2023-12-26 07:36:14,438][123091] Updated weights for policy 0, policy_version 1003419 (0.0008) [2023-12-26 07:36:14,499][123091] Updated weights for policy 0, policy_version 1003429 (0.0008) [2023-12-26 07:36:14,554][123091] Updated weights for policy 0, policy_version 1003439 (0.0005) [2023-12-26 07:36:14,993][123090] Updated weights for policy 1, policy_version 996453 (0.0007) [2023-12-26 07:36:15,067][123090] Updated weights for policy 1, policy_version 996463 (0.0009) [2023-12-26 07:36:15,127][123090] Updated weights for policy 1, policy_version 996473 (0.0009) [2023-12-26 07:36:15,408][123091] Updated weights for policy 0, policy_version 1003449 (0.0010) [2023-12-26 07:36:15,468][123091] Updated weights for policy 0, policy_version 1003459 (0.0010) [2023-12-26 07:36:15,526][123091] Updated weights for policy 0, policy_version 1003469 (0.0010) [2023-12-26 07:36:15,894][123090] Updated weights for policy 1, policy_version 996483 (0.0008) [2023-12-26 07:36:15,949][123090] Updated weights for policy 1, policy_version 996493 (0.0005) [2023-12-26 07:36:16,003][123090] Updated weights for policy 1, policy_version 996503 (0.0005) [2023-12-26 07:36:16,332][123091] Updated weights for policy 0, policy_version 1003479 (0.0009) [2023-12-26 07:36:16,396][123091] Updated weights for policy 0, policy_version 1003489 (0.0008) [2023-12-26 07:36:16,463][123091] Updated weights for policy 0, policy_version 1003499 (0.0008) [2023-12-26 07:36:16,663][123090] Updated weights for policy 1, policy_version 996513 (0.0006) [2023-12-26 07:36:16,725][123090] Updated weights for policy 1, policy_version 996523 (0.0010) [2023-12-26 07:36:16,773][123090] Updated weights for policy 1, policy_version 996533 (0.0010) [2023-12-26 07:36:16,828][123090] Updated weights for policy 1, policy_version 996543 (0.0010) [2023-12-26 07:36:17,218][123091] Updated weights for policy 0, policy_version 1003509 (0.0009) [2023-12-26 07:36:17,273][123091] Updated weights for policy 0, policy_version 1003519 (0.0009) [2023-12-26 07:36:17,326][123091] Updated weights for policy 0, policy_version 1003529 (0.0009) [2023-12-26 07:36:17,565][123090] Updated weights for policy 1, policy_version 996553 (0.0010) [2023-12-26 07:36:17,613][123090] Updated weights for policy 1, policy_version 996563 (0.0010) [2023-12-26 07:36:17,656][123090] Updated weights for policy 1, policy_version 996573 (0.0010) [2023-12-26 07:36:17,985][123091] Updated weights for policy 0, policy_version 1003539 (0.0007) [2023-12-26 07:36:18,048][123091] Updated weights for policy 0, policy_version 1003549 (0.0006) [2023-12-26 07:36:18,117][123091] Updated weights for policy 0, policy_version 1003559 (0.0009) [2023-12-26 07:36:18,371][123090] Updated weights for policy 1, policy_version 996583 (0.0009) [2023-12-26 07:36:18,419][123090] Updated weights for policy 1, policy_version 996593 (0.0010) [2023-12-26 07:36:18,471][123090] Updated weights for policy 1, policy_version 996603 (0.0010) [2023-12-26 07:36:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 512049152. Throughput: 0: 8874.3, 1: 8905.6. Samples: 512060368. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:18,784][121949] Avg episode reward: [(0, '6109.962'), (1, '5936.205')] [2023-12-26 07:36:18,897][123091] Updated weights for policy 0, policy_version 1003569 (0.0009) [2023-12-26 07:36:18,956][123091] Updated weights for policy 0, policy_version 1003579 (0.0009) [2023-12-26 07:36:19,016][123091] Updated weights for policy 0, policy_version 1003589 (0.0009) [2023-12-26 07:36:19,068][123091] Updated weights for policy 0, policy_version 1003599 (0.0009) [2023-12-26 07:36:19,244][123090] Updated weights for policy 1, policy_version 996613 (0.0009) [2023-12-26 07:36:19,303][123090] Updated weights for policy 1, policy_version 996623 (0.0008) [2023-12-26 07:36:19,369][123090] Updated weights for policy 1, policy_version 996633 (0.0008) [2023-12-26 07:36:19,912][123091] Updated weights for policy 0, policy_version 1003609 (0.0008) [2023-12-26 07:36:19,976][123091] Updated weights for policy 0, policy_version 1003619 (0.0008) [2023-12-26 07:36:20,044][123091] Updated weights for policy 0, policy_version 1003629 (0.0008) [2023-12-26 07:36:20,212][123090] Updated weights for policy 1, policy_version 996643 (0.0008) [2023-12-26 07:36:20,279][123090] Updated weights for policy 1, policy_version 996653 (0.0010) [2023-12-26 07:36:20,346][123090] Updated weights for policy 1, policy_version 996663 (0.0010) [2023-12-26 07:36:20,840][123091] Updated weights for policy 0, policy_version 1003639 (0.0009) [2023-12-26 07:36:20,904][123091] Updated weights for policy 0, policy_version 1003649 (0.0010) [2023-12-26 07:36:20,961][123091] Updated weights for policy 0, policy_version 1003659 (0.0008) [2023-12-26 07:36:21,215][123090] Updated weights for policy 1, policy_version 996673 (0.0009) [2023-12-26 07:36:21,294][123090] Updated weights for policy 1, policy_version 996683 (0.0009) [2023-12-26 07:36:21,373][123090] Updated weights for policy 1, policy_version 996693 (0.0009) [2023-12-26 07:36:21,448][123090] Updated weights for policy 1, policy_version 996703 (0.0009) [2023-12-26 07:36:21,799][123091] Updated weights for policy 0, policy_version 1003669 (0.0008) [2023-12-26 07:36:21,866][123091] Updated weights for policy 0, policy_version 1003679 (0.0010) [2023-12-26 07:36:21,935][123091] Updated weights for policy 0, policy_version 1003689 (0.0009) [2023-12-26 07:36:22,295][123090] Updated weights for policy 1, policy_version 996713 (0.0009) [2023-12-26 07:36:22,356][123090] Updated weights for policy 1, policy_version 996723 (0.0010) [2023-12-26 07:36:22,421][123090] Updated weights for policy 1, policy_version 996733 (0.0009) [2023-12-26 07:36:22,733][123091] Updated weights for policy 0, policy_version 1003699 (0.0010) [2023-12-26 07:36:22,806][123091] Updated weights for policy 0, policy_version 1003709 (0.0009) [2023-12-26 07:36:22,872][123091] Updated weights for policy 0, policy_version 1003719 (0.0010) [2023-12-26 07:36:23,275][123090] Updated weights for policy 1, policy_version 996743 (0.0010) [2023-12-26 07:36:23,331][123090] Updated weights for policy 1, policy_version 996754 (0.0010) [2023-12-26 07:36:23,388][123090] Updated weights for policy 1, policy_version 996764 (0.0009) [2023-12-26 07:36:23,681][123091] Updated weights for policy 0, policy_version 1003729 (0.0009) [2023-12-26 07:36:23,743][123091] Updated weights for policy 0, policy_version 1003739 (0.0011) [2023-12-26 07:36:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 512131072. Throughput: 0: 8874.6, 1: 8915.4. Samples: 512111292. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:23,785][121949] Avg episode reward: [(0, '6097.972'), (1, '6011.469')] [2023-12-26 07:36:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000996768_255172608.pth... [2023-12-26 07:36:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000995712_254902272.pth [2023-12-26 07:36:23,806][123091] Updated weights for policy 0, policy_version 1003749 (0.0010) [2023-12-26 07:36:23,868][123091] Updated weights for policy 0, policy_version 1003759 (0.0011) [2023-12-26 07:36:23,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001003760_256966656.pth... [2023-12-26 07:36:23,879][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001002704_256696320.pth [2023-12-26 07:36:24,238][123090] Updated weights for policy 1, policy_version 996774 (0.0009) [2023-12-26 07:36:24,298][123090] Updated weights for policy 1, policy_version 996784 (0.0009) [2023-12-26 07:36:24,359][123090] Updated weights for policy 1, policy_version 996794 (0.0009) [2023-12-26 07:36:24,661][123091] Updated weights for policy 0, policy_version 1003769 (0.0006) [2023-12-26 07:36:24,726][123091] Updated weights for policy 0, policy_version 1003779 (0.0006) [2023-12-26 07:36:24,774][123091] Updated weights for policy 0, policy_version 1003789 (0.0010) [2023-12-26 07:36:25,251][123090] Updated weights for policy 1, policy_version 996804 (0.0009) [2023-12-26 07:36:25,319][123090] Updated weights for policy 1, policy_version 996814 (0.0009) [2023-12-26 07:36:25,382][123090] Updated weights for policy 1, policy_version 996824 (0.0009) [2023-12-26 07:36:25,407][123091] Updated weights for policy 0, policy_version 1003799 (0.0007) [2023-12-26 07:36:25,468][123091] Updated weights for policy 0, policy_version 1003809 (0.0010) [2023-12-26 07:36:25,522][123091] Updated weights for policy 0, policy_version 1003819 (0.0010) [2023-12-26 07:36:26,191][123091] Updated weights for policy 0, policy_version 1003829 (0.0008) [2023-12-26 07:36:26,255][123091] Updated weights for policy 0, policy_version 1003839 (0.0005) [2023-12-26 07:36:26,261][123090] Updated weights for policy 1, policy_version 996834 (0.0009) [2023-12-26 07:36:26,320][123091] Updated weights for policy 0, policy_version 1003849 (0.0005) [2023-12-26 07:36:26,323][123090] Updated weights for policy 1, policy_version 996844 (0.0009) [2023-12-26 07:36:26,376][123090] Updated weights for policy 1, policy_version 996854 (0.0008) [2023-12-26 07:36:27,012][123091] Updated weights for policy 0, policy_version 1003859 (0.0007) [2023-12-26 07:36:27,064][123091] Updated weights for policy 0, policy_version 1003869 (0.0009) [2023-12-26 07:36:27,117][123091] Updated weights for policy 0, policy_version 1003879 (0.0009) [2023-12-26 07:36:27,180][123090] Updated weights for policy 1, policy_version 996865 (0.0009) [2023-12-26 07:36:27,240][123090] Updated weights for policy 1, policy_version 996875 (0.0005) [2023-12-26 07:36:27,308][123090] Updated weights for policy 1, policy_version 996885 (0.0007) [2023-12-26 07:36:27,363][123090] Updated weights for policy 1, policy_version 996895 (0.0009) [2023-12-26 07:36:27,974][123091] Updated weights for policy 0, policy_version 1003889 (0.0010) [2023-12-26 07:36:28,034][123091] Updated weights for policy 0, policy_version 1003899 (0.0009) [2023-12-26 07:36:28,090][123091] Updated weights for policy 0, policy_version 1003909 (0.0009) [2023-12-26 07:36:28,143][123090] Updated weights for policy 1, policy_version 996905 (0.0006) [2023-12-26 07:36:28,144][123091] Updated weights for policy 0, policy_version 1003919 (0.0009) [2023-12-26 07:36:28,202][123090] Updated weights for policy 1, policy_version 996915 (0.0005) [2023-12-26 07:36:28,253][123090] Updated weights for policy 1, policy_version 996925 (0.0005) [2023-12-26 07:36:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 512221184. Throughput: 0: 8903.3, 1: 8959.4. Samples: 512217224. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:28,785][121949] Avg episode reward: [(0, '6159.257'), (1, '6006.471')] [2023-12-26 07:36:28,984][123090] Updated weights for policy 1, policy_version 996935 (0.0008) [2023-12-26 07:36:29,040][123091] Updated weights for policy 0, policy_version 1003929 (0.0006) [2023-12-26 07:36:29,053][123090] Updated weights for policy 1, policy_version 996945 (0.0009) [2023-12-26 07:36:29,096][123091] Updated weights for policy 0, policy_version 1003939 (0.0005) [2023-12-26 07:36:29,114][123090] Updated weights for policy 1, policy_version 996955 (0.0008) [2023-12-26 07:36:29,154][123091] Updated weights for policy 0, policy_version 1003949 (0.0005) [2023-12-26 07:36:29,921][123091] Updated weights for policy 0, policy_version 1003959 (0.0009) [2023-12-26 07:36:29,960][123090] Updated weights for policy 1, policy_version 996965 (0.0009) [2023-12-26 07:36:29,975][123091] Updated weights for policy 0, policy_version 1003969 (0.0009) [2023-12-26 07:36:30,011][123090] Updated weights for policy 1, policy_version 996975 (0.0007) [2023-12-26 07:36:30,032][123091] Updated weights for policy 0, policy_version 1003979 (0.0008) [2023-12-26 07:36:30,065][123090] Updated weights for policy 1, policy_version 996985 (0.0008) [2023-12-26 07:36:30,838][123091] Updated weights for policy 0, policy_version 1003989 (0.0009) [2023-12-26 07:36:30,888][123090] Updated weights for policy 1, policy_version 996995 (0.0008) [2023-12-26 07:36:30,898][123091] Updated weights for policy 0, policy_version 1004000 (0.0010) [2023-12-26 07:36:30,954][123090] Updated weights for policy 1, policy_version 997005 (0.0006) [2023-12-26 07:36:30,954][123091] Updated weights for policy 0, policy_version 1004010 (0.0008) [2023-12-26 07:36:31,017][123090] Updated weights for policy 1, policy_version 997015 (0.0008) [2023-12-26 07:36:31,737][123091] Updated weights for policy 0, policy_version 1004020 (0.0008) [2023-12-26 07:36:31,801][123091] Updated weights for policy 0, policy_version 1004030 (0.0008) [2023-12-26 07:36:31,857][123090] Updated weights for policy 1, policy_version 997025 (0.0008) [2023-12-26 07:36:31,867][123091] Updated weights for policy 0, policy_version 1004040 (0.0010) [2023-12-26 07:36:31,906][123090] Updated weights for policy 1, policy_version 997035 (0.0005) [2023-12-26 07:36:31,968][123090] Updated weights for policy 1, policy_version 997045 (0.0006) [2023-12-26 07:36:32,017][123090] Updated weights for policy 1, policy_version 997055 (0.0008) [2023-12-26 07:36:32,711][123091] Updated weights for policy 0, policy_version 1004050 (0.0009) [2023-12-26 07:36:32,744][123090] Updated weights for policy 1, policy_version 997065 (0.0006) [2023-12-26 07:36:32,766][123091] Updated weights for policy 0, policy_version 1004060 (0.0010) [2023-12-26 07:36:32,799][123090] Updated weights for policy 1, policy_version 997075 (0.0006) [2023-12-26 07:36:32,818][123091] Updated weights for policy 0, policy_version 1004070 (0.0010) [2023-12-26 07:36:32,864][123090] Updated weights for policy 1, policy_version 997085 (0.0006) [2023-12-26 07:36:32,870][123091] Updated weights for policy 0, policy_version 1004080 (0.0010) [2023-12-26 07:36:33,646][123090] Updated weights for policy 1, policy_version 997095 (0.0009) [2023-12-26 07:36:33,697][123091] Updated weights for policy 0, policy_version 1004090 (0.0005) [2023-12-26 07:36:33,708][123090] Updated weights for policy 1, policy_version 997105 (0.0010) [2023-12-26 07:36:33,745][123091] Updated weights for policy 0, policy_version 1004100 (0.0005) [2023-12-26 07:36:33,771][123090] Updated weights for policy 1, policy_version 997115 (0.0010) [2023-12-26 07:36:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 512303104. Throughput: 0: 8810.7, 1: 8930.4. Samples: 512323304. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 07:36:33,785][121949] Avg episode reward: [(0, '6191.286'), (1, '5969.657')] [2023-12-26 07:36:33,792][123091] Updated weights for policy 0, policy_version 1004110 (0.0005) [2023-12-26 07:36:34,499][123091] Updated weights for policy 0, policy_version 1004120 (0.0008) [2023-12-26 07:36:34,518][123090] Updated weights for policy 1, policy_version 997125 (0.0008) [2023-12-26 07:36:34,571][123091] Updated weights for policy 0, policy_version 1004130 (0.0007) [2023-12-26 07:36:34,582][123090] Updated weights for policy 1, policy_version 997135 (0.0010) [2023-12-26 07:36:34,628][123091] Updated weights for policy 0, policy_version 1004140 (0.0011) [2023-12-26 07:36:34,634][123090] Updated weights for policy 1, policy_version 997145 (0.0010) [2023-12-26 07:36:35,308][123090] Updated weights for policy 1, policy_version 997155 (0.0009) [2023-12-26 07:36:35,326][123091] Updated weights for policy 0, policy_version 1004150 (0.0009) [2023-12-26 07:36:35,355][123090] Updated weights for policy 1, policy_version 997165 (0.0005) [2023-12-26 07:36:35,377][123091] Updated weights for policy 0, policy_version 1004160 (0.0006) [2023-12-26 07:36:35,417][123090] Updated weights for policy 1, policy_version 997175 (0.0005) [2023-12-26 07:36:35,429][123091] Updated weights for policy 0, policy_version 1004170 (0.0005) [2023-12-26 07:36:36,043][123090] Updated weights for policy 1, policy_version 997185 (0.0005) [2023-12-26 07:36:36,106][123090] Updated weights for policy 1, policy_version 997195 (0.0006) [2023-12-26 07:36:36,174][123090] Updated weights for policy 1, policy_version 997205 (0.0010) [2023-12-26 07:36:36,183][123091] Updated weights for policy 0, policy_version 1004180 (0.0006) [2023-12-26 07:36:36,237][123090] Updated weights for policy 1, policy_version 997215 (0.0008) [2023-12-26 07:36:36,248][123091] Updated weights for policy 0, policy_version 1004190 (0.0010) [2023-12-26 07:36:36,308][123091] Updated weights for policy 0, policy_version 1004200 (0.0010) [2023-12-26 07:36:37,076][123090] Updated weights for policy 1, policy_version 997225 (0.0009) [2023-12-26 07:36:37,127][123091] Updated weights for policy 0, policy_version 1004210 (0.0008) [2023-12-26 07:36:37,135][123090] Updated weights for policy 1, policy_version 997235 (0.0009) [2023-12-26 07:36:37,194][123090] Updated weights for policy 1, policy_version 997245 (0.0008) [2023-12-26 07:36:37,195][123091] Updated weights for policy 0, policy_version 1004220 (0.0010) [2023-12-26 07:36:37,252][123091] Updated weights for policy 0, policy_version 1004230 (0.0010) [2023-12-26 07:36:37,314][123091] Updated weights for policy 0, policy_version 1004240 (0.0010) [2023-12-26 07:36:38,065][123090] Updated weights for policy 1, policy_version 997255 (0.0009) [2023-12-26 07:36:38,116][123090] Updated weights for policy 1, policy_version 997265 (0.0008) [2023-12-26 07:36:38,123][123091] Updated weights for policy 0, policy_version 1004250 (0.0008) [2023-12-26 07:36:38,169][123090] Updated weights for policy 1, policy_version 997275 (0.0006) [2023-12-26 07:36:38,184][123091] Updated weights for policy 0, policy_version 1004260 (0.0010) [2023-12-26 07:36:38,249][123091] Updated weights for policy 0, policy_version 1004270 (0.0008) [2023-12-26 07:36:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 512401408. Throughput: 0: 8894.0, 1: 8991.1. Samples: 512380960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:36:38,785][121949] Avg episode reward: [(0, '6237.273'), (1, '5876.223')] [2023-12-26 07:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001004272_257097728.pth... [2023-12-26 07:36:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000997280_255303680.pth... [2023-12-26 07:36:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000996256_255041536.pth [2023-12-26 07:36:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001003248_256835584.pth [2023-12-26 07:36:38,966][123090] Updated weights for policy 1, policy_version 997285 (0.0008) [2023-12-26 07:36:39,036][123090] Updated weights for policy 1, policy_version 997295 (0.0008) [2023-12-26 07:36:39,066][123091] Updated weights for policy 0, policy_version 1004280 (0.0010) [2023-12-26 07:36:39,099][123090] Updated weights for policy 1, policy_version 997305 (0.0006) [2023-12-26 07:36:39,118][123091] Updated weights for policy 0, policy_version 1004291 (0.0010) [2023-12-26 07:36:39,173][123091] Updated weights for policy 0, policy_version 1004301 (0.0010) [2023-12-26 07:36:39,963][123090] Updated weights for policy 1, policy_version 997315 (0.0008) [2023-12-26 07:36:40,025][123090] Updated weights for policy 1, policy_version 997325 (0.0011) [2023-12-26 07:36:40,080][123091] Updated weights for policy 0, policy_version 1004311 (0.0008) [2023-12-26 07:36:40,086][123090] Updated weights for policy 1, policy_version 997335 (0.0011) [2023-12-26 07:36:40,143][123091] Updated weights for policy 0, policy_version 1004321 (0.0006) [2023-12-26 07:36:40,206][123091] Updated weights for policy 0, policy_version 1004331 (0.0009) [2023-12-26 07:36:40,923][123090] Updated weights for policy 1, policy_version 997345 (0.0011) [2023-12-26 07:36:40,993][123090] Updated weights for policy 1, policy_version 997355 (0.0010) [2023-12-26 07:36:41,070][123090] Updated weights for policy 1, policy_version 997365 (0.0011) [2023-12-26 07:36:41,071][123091] Updated weights for policy 0, policy_version 1004341 (0.0009) [2023-12-26 07:36:41,130][123090] Updated weights for policy 1, policy_version 997375 (0.0011) [2023-12-26 07:36:41,133][123091] Updated weights for policy 0, policy_version 1004351 (0.0006) [2023-12-26 07:36:41,210][123091] Updated weights for policy 0, policy_version 1004361 (0.0009) [2023-12-26 07:36:41,947][123090] Updated weights for policy 1, policy_version 997385 (0.0011) [2023-12-26 07:36:41,990][123091] Updated weights for policy 0, policy_version 1004371 (0.0010) [2023-12-26 07:36:42,019][123090] Updated weights for policy 1, policy_version 997395 (0.0011) [2023-12-26 07:36:42,054][123091] Updated weights for policy 0, policy_version 1004381 (0.0008) [2023-12-26 07:36:42,084][123090] Updated weights for policy 1, policy_version 997405 (0.0011) [2023-12-26 07:36:42,104][123091] Updated weights for policy 0, policy_version 1004391 (0.0009) [2023-12-26 07:36:42,840][123090] Updated weights for policy 1, policy_version 997415 (0.0010) [2023-12-26 07:36:42,854][123091] Updated weights for policy 0, policy_version 1004401 (0.0009) [2023-12-26 07:36:42,897][123090] Updated weights for policy 1, policy_version 997425 (0.0010) [2023-12-26 07:36:42,913][123091] Updated weights for policy 0, policy_version 1004411 (0.0006) [2023-12-26 07:36:42,953][123090] Updated weights for policy 1, policy_version 997435 (0.0011) [2023-12-26 07:36:42,970][123091] Updated weights for policy 0, policy_version 1004421 (0.0009) [2023-12-26 07:36:43,023][123091] Updated weights for policy 0, policy_version 1004431 (0.0009) [2023-12-26 07:36:43,681][123090] Updated weights for policy 1, policy_version 997445 (0.0008) [2023-12-26 07:36:43,751][123090] Updated weights for policy 1, policy_version 997455 (0.0005) [2023-12-26 07:36:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 512483328. Throughput: 0: 8845.9, 1: 8877.9. Samples: 512482728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:36:43,785][121949] Avg episode reward: [(0, '6193.428'), (1, '5807.425')] [2023-12-26 07:36:43,828][123090] Updated weights for policy 1, policy_version 997465 (0.0005) [2023-12-26 07:36:43,951][123091] Updated weights for policy 0, policy_version 1004441 (0.0010) [2023-12-26 07:36:44,005][123091] Updated weights for policy 0, policy_version 1004451 (0.0010) [2023-12-26 07:36:44,060][123091] Updated weights for policy 0, policy_version 1004461 (0.0010) [2023-12-26 07:36:44,374][123090] Updated weights for policy 1, policy_version 997475 (0.0006) [2023-12-26 07:36:44,424][123090] Updated weights for policy 1, policy_version 997485 (0.0010) [2023-12-26 07:36:44,476][123090] Updated weights for policy 1, policy_version 997495 (0.0010) [2023-12-26 07:36:45,002][123091] Updated weights for policy 0, policy_version 1004471 (0.0007) [2023-12-26 07:36:45,076][123091] Updated weights for policy 0, policy_version 1004481 (0.0006) [2023-12-26 07:36:45,149][123091] Updated weights for policy 0, policy_version 1004491 (0.0006) [2023-12-26 07:36:45,282][123090] Updated weights for policy 1, policy_version 997505 (0.0010) [2023-12-26 07:36:45,343][123090] Updated weights for policy 1, policy_version 997515 (0.0011) [2023-12-26 07:36:45,403][123090] Updated weights for policy 1, policy_version 997525 (0.0011) [2023-12-26 07:36:45,462][123090] Updated weights for policy 1, policy_version 997535 (0.0010) [2023-12-26 07:36:45,818][123091] Updated weights for policy 0, policy_version 1004501 (0.0008) [2023-12-26 07:36:45,876][123091] Updated weights for policy 0, policy_version 1004511 (0.0005) [2023-12-26 07:36:45,927][123091] Updated weights for policy 0, policy_version 1004521 (0.0005) [2023-12-26 07:36:46,296][123090] Updated weights for policy 1, policy_version 997545 (0.0010) [2023-12-26 07:36:46,351][123090] Updated weights for policy 1, policy_version 997555 (0.0010) [2023-12-26 07:36:46,400][123090] Updated weights for policy 1, policy_version 997565 (0.0008) [2023-12-26 07:36:46,654][123091] Updated weights for policy 0, policy_version 1004531 (0.0005) [2023-12-26 07:36:46,722][123091] Updated weights for policy 0, policy_version 1004541 (0.0005) [2023-12-26 07:36:46,791][123091] Updated weights for policy 0, policy_version 1004551 (0.0005) [2023-12-26 07:36:47,060][123090] Updated weights for policy 1, policy_version 997575 (0.0005) [2023-12-26 07:36:47,113][123090] Updated weights for policy 1, policy_version 997585 (0.0006) [2023-12-26 07:36:47,162][123090] Updated weights for policy 1, policy_version 997595 (0.0005) [2023-12-26 07:36:47,474][123091] Updated weights for policy 0, policy_version 1004561 (0.0005) [2023-12-26 07:36:47,528][123091] Updated weights for policy 0, policy_version 1004571 (0.0005) [2023-12-26 07:36:47,589][123091] Updated weights for policy 0, policy_version 1004581 (0.0007) [2023-12-26 07:36:47,647][123091] Updated weights for policy 0, policy_version 1004591 (0.0010) [2023-12-26 07:36:47,839][123090] Updated weights for policy 1, policy_version 997605 (0.0005) [2023-12-26 07:36:47,892][123090] Updated weights for policy 1, policy_version 997615 (0.0005) [2023-12-26 07:36:47,939][123090] Updated weights for policy 1, policy_version 997625 (0.0006) [2023-12-26 07:36:48,551][123091] Updated weights for policy 0, policy_version 1004601 (0.0010) [2023-12-26 07:36:48,605][123091] Updated weights for policy 0, policy_version 1004611 (0.0008) [2023-12-26 07:36:48,616][123090] Updated weights for policy 1, policy_version 997635 (0.0006) [2023-12-26 07:36:48,669][123091] Updated weights for policy 0, policy_version 1004621 (0.0009) [2023-12-26 07:36:48,687][123090] Updated weights for policy 1, policy_version 997645 (0.0006) [2023-12-26 07:36:48,746][123090] Updated weights for policy 1, policy_version 997655 (0.0010) [2023-12-26 07:36:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 512581632. Throughput: 0: 8836.8, 1: 8992.6. Samples: 512593804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:36:48,785][121949] Avg episode reward: [(0, '6120.522'), (1, '5893.246')] [2023-12-26 07:36:49,475][123090] Updated weights for policy 1, policy_version 997665 (0.0010) [2023-12-26 07:36:49,534][123091] Updated weights for policy 0, policy_version 1004631 (0.0011) [2023-12-26 07:36:49,535][123090] Updated weights for policy 1, policy_version 997675 (0.0010) [2023-12-26 07:36:49,594][123090] Updated weights for policy 1, policy_version 997685 (0.0010) [2023-12-26 07:36:49,597][123091] Updated weights for policy 0, policy_version 1004641 (0.0010) [2023-12-26 07:36:49,653][123091] Updated weights for policy 0, policy_version 1004651 (0.0010) [2023-12-26 07:36:49,657][123090] Updated weights for policy 1, policy_version 997695 (0.0010) [2023-12-26 07:36:50,457][123091] Updated weights for policy 0, policy_version 1004661 (0.0009) [2023-12-26 07:36:50,462][123090] Updated weights for policy 1, policy_version 997705 (0.0010) [2023-12-26 07:36:50,519][123091] Updated weights for policy 0, policy_version 1004671 (0.0005) [2023-12-26 07:36:50,529][123090] Updated weights for policy 1, policy_version 997715 (0.0010) [2023-12-26 07:36:50,584][123091] Updated weights for policy 0, policy_version 1004681 (0.0007) [2023-12-26 07:36:50,588][123090] Updated weights for policy 1, policy_version 997725 (0.0012) [2023-12-26 07:36:51,362][123091] Updated weights for policy 0, policy_version 1004691 (0.0008) [2023-12-26 07:36:51,427][123091] Updated weights for policy 0, policy_version 1004701 (0.0008) [2023-12-26 07:36:51,431][123090] Updated weights for policy 1, policy_version 997735 (0.0010) [2023-12-26 07:36:51,485][123091] Updated weights for policy 0, policy_version 1004711 (0.0006) [2023-12-26 07:36:51,487][123090] Updated weights for policy 1, policy_version 997745 (0.0010) [2023-12-26 07:36:51,557][123090] Updated weights for policy 1, policy_version 997755 (0.0009) [2023-12-26 07:36:52,280][123091] Updated weights for policy 0, policy_version 1004721 (0.0008) [2023-12-26 07:36:52,342][123091] Updated weights for policy 0, policy_version 1004731 (0.0009) [2023-12-26 07:36:52,411][123091] Updated weights for policy 0, policy_version 1004741 (0.0009) [2023-12-26 07:36:52,424][123090] Updated weights for policy 1, policy_version 997765 (0.0008) [2023-12-26 07:36:52,475][123091] Updated weights for policy 0, policy_version 1004751 (0.0006) [2023-12-26 07:36:52,488][123090] Updated weights for policy 1, policy_version 997775 (0.0009) [2023-12-26 07:36:52,540][123090] Updated weights for policy 1, policy_version 997785 (0.0010) [2023-12-26 07:36:53,228][123091] Updated weights for policy 0, policy_version 1004761 (0.0006) [2023-12-26 07:36:53,288][123091] Updated weights for policy 0, policy_version 1004771 (0.0006) [2023-12-26 07:36:53,321][123090] Updated weights for policy 1, policy_version 997795 (0.0010) [2023-12-26 07:36:53,350][123091] Updated weights for policy 0, policy_version 1004781 (0.0007) [2023-12-26 07:36:53,384][123090] Updated weights for policy 1, policy_version 997805 (0.0010) [2023-12-26 07:36:53,439][123090] Updated weights for policy 1, policy_version 997815 (0.0010) [2023-12-26 07:36:53,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 512671744. Throughput: 0: 8859.4, 1: 8980.2. Samples: 512646636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:36:53,785][121949] Avg episode reward: [(0, '6075.151'), (1, '5943.231')] [2023-12-26 07:36:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001004784_257228800.pth... [2023-12-26 07:36:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000997824_255442944.pth... [2023-12-26 07:36:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000996768_255172608.pth [2023-12-26 07:36:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001003760_256966656.pth [2023-12-26 07:36:54,103][123091] Updated weights for policy 0, policy_version 1004791 (0.0009) [2023-12-26 07:36:54,158][123091] Updated weights for policy 0, policy_version 1004801 (0.0009) [2023-12-26 07:36:54,221][123091] Updated weights for policy 0, policy_version 1004811 (0.0009) [2023-12-26 07:36:54,264][123090] Updated weights for policy 1, policy_version 997825 (0.0010) [2023-12-26 07:36:54,334][123090] Updated weights for policy 1, policy_version 997835 (0.0005) [2023-12-26 07:36:54,410][123090] Updated weights for policy 1, policy_version 997845 (0.0005) [2023-12-26 07:36:54,461][123090] Updated weights for policy 1, policy_version 997855 (0.0005) [2023-12-26 07:36:55,110][123090] Updated weights for policy 1, policy_version 997865 (0.0010) [2023-12-26 07:36:55,132][123091] Updated weights for policy 0, policy_version 1004821 (0.0008) [2023-12-26 07:36:55,177][123090] Updated weights for policy 1, policy_version 997875 (0.0010) [2023-12-26 07:36:55,187][123091] Updated weights for policy 0, policy_version 1004831 (0.0006) [2023-12-26 07:36:55,236][123090] Updated weights for policy 1, policy_version 997885 (0.0010) [2023-12-26 07:36:55,238][123091] Updated weights for policy 0, policy_version 1004841 (0.0006) [2023-12-26 07:36:55,917][123091] Updated weights for policy 0, policy_version 1004851 (0.0006) [2023-12-26 07:36:55,919][123090] Updated weights for policy 1, policy_version 997895 (0.0007) [2023-12-26 07:36:55,972][123091] Updated weights for policy 0, policy_version 1004861 (0.0007) [2023-12-26 07:36:55,978][123090] Updated weights for policy 1, policy_version 997905 (0.0005) [2023-12-26 07:36:56,027][123091] Updated weights for policy 0, policy_version 1004871 (0.0005) [2023-12-26 07:36:56,042][123090] Updated weights for policy 1, policy_version 997915 (0.0005) [2023-12-26 07:36:56,693][123090] Updated weights for policy 1, policy_version 997925 (0.0005) [2023-12-26 07:36:56,759][123090] Updated weights for policy 1, policy_version 997935 (0.0009) [2023-12-26 07:36:56,783][123091] Updated weights for policy 0, policy_version 1004881 (0.0006) [2023-12-26 07:36:56,814][123090] Updated weights for policy 1, policy_version 997945 (0.0010) [2023-12-26 07:36:56,831][123091] Updated weights for policy 0, policy_version 1004891 (0.0010) [2023-12-26 07:36:56,880][123091] Updated weights for policy 0, policy_version 1004901 (0.0008) [2023-12-26 07:36:56,927][123091] Updated weights for policy 0, policy_version 1004911 (0.0008) [2023-12-26 07:36:57,617][123090] Updated weights for policy 1, policy_version 997955 (0.0010) [2023-12-26 07:36:57,663][123090] Updated weights for policy 1, policy_version 997965 (0.0010) [2023-12-26 07:36:57,706][123090] Updated weights for policy 1, policy_version 997975 (0.0010) [2023-12-26 07:36:57,772][123091] Updated weights for policy 0, policy_version 1004921 (0.0009) [2023-12-26 07:36:57,829][123091] Updated weights for policy 0, policy_version 1004931 (0.0010) [2023-12-26 07:36:57,882][123091] Updated weights for policy 0, policy_version 1004942 (0.0010) [2023-12-26 07:36:58,481][123090] Updated weights for policy 1, policy_version 997985 (0.0006) [2023-12-26 07:36:58,556][123090] Updated weights for policy 1, policy_version 997995 (0.0006) [2023-12-26 07:36:58,631][123090] Updated weights for policy 1, policy_version 998005 (0.0009) [2023-12-26 07:36:58,704][123090] Updated weights for policy 1, policy_version 998015 (0.0010) [2023-12-26 07:36:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 512761856. Throughput: 0: 8877.6, 1: 9027.2. Samples: 512757084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:36:58,785][121949] Avg episode reward: [(0, '6161.436'), (1, '5941.299')] [2023-12-26 07:36:58,825][123091] Updated weights for policy 0, policy_version 1004952 (0.0009) [2023-12-26 07:36:58,900][123091] Updated weights for policy 0, policy_version 1004962 (0.0008) [2023-12-26 07:36:58,974][123091] Updated weights for policy 0, policy_version 1004972 (0.0008) [2023-12-26 07:36:59,559][123090] Updated weights for policy 1, policy_version 998025 (0.0006) [2023-12-26 07:36:59,628][123090] Updated weights for policy 1, policy_version 998035 (0.0006) [2023-12-26 07:36:59,684][123090] Updated weights for policy 1, policy_version 998045 (0.0005) [2023-12-26 07:36:59,731][123091] Updated weights for policy 0, policy_version 1004982 (0.0007) [2023-12-26 07:36:59,796][123091] Updated weights for policy 0, policy_version 1004992 (0.0007) [2023-12-26 07:36:59,858][123091] Updated weights for policy 0, policy_version 1005002 (0.0008) [2023-12-26 07:37:00,424][123090] Updated weights for policy 1, policy_version 998055 (0.0005) [2023-12-26 07:37:00,492][123090] Updated weights for policy 1, policy_version 998065 (0.0005) [2023-12-26 07:37:00,551][123090] Updated weights for policy 1, policy_version 998075 (0.0005) [2023-12-26 07:37:00,599][123091] Updated weights for policy 0, policy_version 1005012 (0.0006) [2023-12-26 07:37:00,658][123091] Updated weights for policy 0, policy_version 1005022 (0.0010) [2023-12-26 07:37:00,710][123091] Updated weights for policy 0, policy_version 1005032 (0.0007) [2023-12-26 07:37:01,230][123090] Updated weights for policy 1, policy_version 998085 (0.0007) [2023-12-26 07:37:01,294][123090] Updated weights for policy 1, policy_version 998095 (0.0009) [2023-12-26 07:37:01,359][123090] Updated weights for policy 1, policy_version 998105 (0.0010) [2023-12-26 07:37:01,413][123091] Updated weights for policy 0, policy_version 1005042 (0.0006) [2023-12-26 07:37:01,482][123091] Updated weights for policy 0, policy_version 1005052 (0.0006) [2023-12-26 07:37:01,549][123091] Updated weights for policy 0, policy_version 1005062 (0.0005) [2023-12-26 07:37:01,617][123091] Updated weights for policy 0, policy_version 1005072 (0.0006) [2023-12-26 07:37:02,210][123090] Updated weights for policy 1, policy_version 998115 (0.0009) [2023-12-26 07:37:02,281][123090] Updated weights for policy 1, policy_version 998125 (0.0009) [2023-12-26 07:37:02,348][123090] Updated weights for policy 1, policy_version 998135 (0.0009) [2023-12-26 07:37:02,406][123091] Updated weights for policy 0, policy_version 1005082 (0.0009) [2023-12-26 07:37:02,464][123091] Updated weights for policy 0, policy_version 1005092 (0.0009) [2023-12-26 07:37:02,520][123091] Updated weights for policy 0, policy_version 1005102 (0.0009) [2023-12-26 07:37:03,158][123090] Updated weights for policy 1, policy_version 998145 (0.0009) [2023-12-26 07:37:03,225][123090] Updated weights for policy 1, policy_version 998155 (0.0009) [2023-12-26 07:37:03,286][123090] Updated weights for policy 1, policy_version 998165 (0.0006) [2023-12-26 07:37:03,354][123091] Updated weights for policy 0, policy_version 1005112 (0.0007) [2023-12-26 07:37:03,357][123090] Updated weights for policy 1, policy_version 998175 (0.0006) [2023-12-26 07:37:03,423][123091] Updated weights for policy 0, policy_version 1005122 (0.0006) [2023-12-26 07:37:03,494][123091] Updated weights for policy 0, policy_version 1005132 (0.0006) [2023-12-26 07:37:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 512851968. Throughput: 0: 8862.9, 1: 8993.5. Samples: 512863908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:03,785][121949] Avg episode reward: [(0, '6097.750'), (1, '5956.966')] [2023-12-26 07:37:03,966][123090] Updated weights for policy 1, policy_version 998185 (0.0008) [2023-12-26 07:37:04,029][123090] Updated weights for policy 1, policy_version 998195 (0.0008) [2023-12-26 07:37:04,087][123090] Updated weights for policy 1, policy_version 998205 (0.0008) [2023-12-26 07:37:04,148][123091] Updated weights for policy 0, policy_version 1005142 (0.0008) [2023-12-26 07:37:04,203][123091] Updated weights for policy 0, policy_version 1005152 (0.0009) [2023-12-26 07:37:04,272][123091] Updated weights for policy 0, policy_version 1005162 (0.0009) [2023-12-26 07:37:04,928][123090] Updated weights for policy 1, policy_version 998215 (0.0010) [2023-12-26 07:37:04,998][123090] Updated weights for policy 1, policy_version 998225 (0.0010) [2023-12-26 07:37:05,068][123090] Updated weights for policy 1, policy_version 998235 (0.0006) [2023-12-26 07:37:05,122][123091] Updated weights for policy 0, policy_version 1005172 (0.0009) [2023-12-26 07:37:05,175][123091] Updated weights for policy 0, policy_version 1005182 (0.0010) [2023-12-26 07:37:05,228][123091] Updated weights for policy 0, policy_version 1005192 (0.0010) [2023-12-26 07:37:05,854][123090] Updated weights for policy 1, policy_version 998245 (0.0006) [2023-12-26 07:37:05,930][123090] Updated weights for policy 1, policy_version 998255 (0.0006) [2023-12-26 07:37:05,945][123091] Updated weights for policy 0, policy_version 1005202 (0.0008) [2023-12-26 07:37:05,996][123091] Updated weights for policy 0, policy_version 1005212 (0.0008) [2023-12-26 07:37:05,997][123090] Updated weights for policy 1, policy_version 998265 (0.0010) [2023-12-26 07:37:06,052][123091] Updated weights for policy 0, policy_version 1005222 (0.0010) [2023-12-26 07:37:06,100][123091] Updated weights for policy 0, policy_version 1005232 (0.0010) [2023-12-26 07:37:06,745][123090] Updated weights for policy 1, policy_version 998275 (0.0010) [2023-12-26 07:37:06,817][123090] Updated weights for policy 1, policy_version 998285 (0.0008) [2023-12-26 07:37:06,891][123090] Updated weights for policy 1, policy_version 998295 (0.0006) [2023-12-26 07:37:07,051][123091] Updated weights for policy 0, policy_version 1005242 (0.0010) [2023-12-26 07:37:07,119][123091] Updated weights for policy 0, policy_version 1005252 (0.0010) [2023-12-26 07:37:07,183][123091] Updated weights for policy 0, policy_version 1005262 (0.0010) [2023-12-26 07:37:07,547][123090] Updated weights for policy 1, policy_version 998305 (0.0006) [2023-12-26 07:37:07,599][123090] Updated weights for policy 1, policy_version 998315 (0.0005) [2023-12-26 07:37:07,647][123090] Updated weights for policy 1, policy_version 998325 (0.0005) [2023-12-26 07:37:07,696][123090] Updated weights for policy 1, policy_version 998335 (0.0005) [2023-12-26 07:37:07,999][123091] Updated weights for policy 0, policy_version 1005272 (0.0007) [2023-12-26 07:37:08,073][123091] Updated weights for policy 0, policy_version 1005282 (0.0006) [2023-12-26 07:37:08,140][123091] Updated weights for policy 0, policy_version 1005292 (0.0009) [2023-12-26 07:37:08,510][123090] Updated weights for policy 1, policy_version 998345 (0.0009) [2023-12-26 07:37:08,577][123090] Updated weights for policy 1, policy_version 998355 (0.0009) [2023-12-26 07:37:08,646][123090] Updated weights for policy 1, policy_version 998365 (0.0009) [2023-12-26 07:37:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 512942080. Throughput: 0: 8892.1, 1: 9038.4. Samples: 512918164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:08,784][121949] Avg episode reward: [(0, '6063.232'), (1, '5935.971')] [2023-12-26 07:37:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001005296_257359872.pth... [2023-12-26 07:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000998368_255582208.pth... [2023-12-26 07:37:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001004272_257097728.pth [2023-12-26 07:37:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000997280_255303680.pth [2023-12-26 07:37:08,912][123091] Updated weights for policy 0, policy_version 1005302 (0.0011) [2023-12-26 07:37:08,976][123091] Updated weights for policy 0, policy_version 1005312 (0.0011) [2023-12-26 07:37:09,047][123091] Updated weights for policy 0, policy_version 1005322 (0.0011) [2023-12-26 07:37:09,422][123090] Updated weights for policy 1, policy_version 998375 (0.0009) [2023-12-26 07:37:09,486][123090] Updated weights for policy 1, policy_version 998385 (0.0009) [2023-12-26 07:37:09,546][123090] Updated weights for policy 1, policy_version 998395 (0.0009) [2023-12-26 07:37:09,874][123091] Updated weights for policy 0, policy_version 1005332 (0.0011) [2023-12-26 07:37:09,940][123091] Updated weights for policy 0, policy_version 1005342 (0.0011) [2023-12-26 07:37:10,002][123091] Updated weights for policy 0, policy_version 1005352 (0.0011) [2023-12-26 07:37:10,412][123090] Updated weights for policy 1, policy_version 998405 (0.0007) [2023-12-26 07:37:10,479][123090] Updated weights for policy 1, policy_version 998415 (0.0006) [2023-12-26 07:37:10,537][123090] Updated weights for policy 1, policy_version 998425 (0.0009) [2023-12-26 07:37:10,772][123091] Updated weights for policy 0, policy_version 1005362 (0.0006) [2023-12-26 07:37:10,824][123091] Updated weights for policy 0, policy_version 1005372 (0.0009) [2023-12-26 07:37:10,876][123091] Updated weights for policy 0, policy_version 1005382 (0.0010) [2023-12-26 07:37:10,940][123091] Updated weights for policy 0, policy_version 1005392 (0.0009) [2023-12-26 07:37:11,389][123090] Updated weights for policy 1, policy_version 998435 (0.0009) [2023-12-26 07:37:11,453][123090] Updated weights for policy 1, policy_version 998445 (0.0008) [2023-12-26 07:37:11,527][123090] Updated weights for policy 1, policy_version 998455 (0.0008) [2023-12-26 07:37:11,842][123091] Updated weights for policy 0, policy_version 1005402 (0.0010) [2023-12-26 07:37:11,910][123091] Updated weights for policy 0, policy_version 1005412 (0.0010) [2023-12-26 07:37:11,972][123091] Updated weights for policy 0, policy_version 1005422 (0.0009) [2023-12-26 07:37:12,361][123090] Updated weights for policy 1, policy_version 998465 (0.0008) [2023-12-26 07:37:12,420][123090] Updated weights for policy 1, policy_version 998475 (0.0009) [2023-12-26 07:37:12,481][123090] Updated weights for policy 1, policy_version 998485 (0.0010) [2023-12-26 07:37:12,535][123090] Updated weights for policy 1, policy_version 998495 (0.0007) [2023-12-26 07:37:12,812][123091] Updated weights for policy 0, policy_version 1005432 (0.0006) [2023-12-26 07:37:12,867][123091] Updated weights for policy 0, policy_version 1005442 (0.0009) [2023-12-26 07:37:12,936][123091] Updated weights for policy 0, policy_version 1005452 (0.0009) [2023-12-26 07:37:13,382][123090] Updated weights for policy 1, policy_version 998505 (0.0009) [2023-12-26 07:37:13,431][123090] Updated weights for policy 1, policy_version 998515 (0.0009) [2023-12-26 07:37:13,479][123090] Updated weights for policy 1, policy_version 998525 (0.0009) [2023-12-26 07:37:13,742][123091] Updated weights for policy 0, policy_version 1005463 (0.0011) [2023-12-26 07:37:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 513024000. Throughput: 0: 8789.0, 1: 9069.4. Samples: 513020852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:13,785][121949] Avg episode reward: [(0, '6127.770'), (1, '5912.782')] [2023-12-26 07:37:13,790][123091] Updated weights for policy 0, policy_version 1005473 (0.0010) [2023-12-26 07:37:13,849][123091] Updated weights for policy 0, policy_version 1005483 (0.0009) [2023-12-26 07:37:14,333][123090] Updated weights for policy 1, policy_version 998535 (0.0009) [2023-12-26 07:37:14,387][123090] Updated weights for policy 1, policy_version 998545 (0.0009) [2023-12-26 07:37:14,449][123090] Updated weights for policy 1, policy_version 998555 (0.0009) [2023-12-26 07:37:14,701][123091] Updated weights for policy 0, policy_version 1005494 (0.0009) [2023-12-26 07:37:14,767][123091] Updated weights for policy 0, policy_version 1005504 (0.0010) [2023-12-26 07:37:14,839][123091] Updated weights for policy 0, policy_version 1005514 (0.0007) [2023-12-26 07:37:15,232][123090] Updated weights for policy 1, policy_version 998566 (0.0010) [2023-12-26 07:37:15,295][123090] Updated weights for policy 1, policy_version 998576 (0.0009) [2023-12-26 07:37:15,361][123090] Updated weights for policy 1, policy_version 998586 (0.0010) [2023-12-26 07:37:15,635][123091] Updated weights for policy 0, policy_version 1005524 (0.0008) [2023-12-26 07:37:15,698][123091] Updated weights for policy 0, policy_version 1005534 (0.0008) [2023-12-26 07:37:15,761][123091] Updated weights for policy 0, policy_version 1005544 (0.0005) [2023-12-26 07:37:16,261][123090] Updated weights for policy 1, policy_version 998596 (0.0008) [2023-12-26 07:37:16,321][123090] Updated weights for policy 1, policy_version 998606 (0.0005) [2023-12-26 07:37:16,380][123090] Updated weights for policy 1, policy_version 998616 (0.0005) [2023-12-26 07:37:16,513][123091] Updated weights for policy 0, policy_version 1005554 (0.0006) [2023-12-26 07:37:16,570][123091] Updated weights for policy 0, policy_version 1005564 (0.0010) [2023-12-26 07:37:16,625][123091] Updated weights for policy 0, policy_version 1005574 (0.0008) [2023-12-26 07:37:16,680][123091] Updated weights for policy 0, policy_version 1005584 (0.0009) [2023-12-26 07:37:17,068][123090] Updated weights for policy 1, policy_version 998626 (0.0006) [2023-12-26 07:37:17,138][123090] Updated weights for policy 1, policy_version 998636 (0.0009) [2023-12-26 07:37:17,196][123090] Updated weights for policy 1, policy_version 998646 (0.0010) [2023-12-26 07:37:17,244][123090] Updated weights for policy 1, policy_version 998656 (0.0009) [2023-12-26 07:37:17,480][123091] Updated weights for policy 0, policy_version 1005594 (0.0005) [2023-12-26 07:37:17,552][123091] Updated weights for policy 0, policy_version 1005604 (0.0005) [2023-12-26 07:37:17,614][123091] Updated weights for policy 0, policy_version 1005614 (0.0005) [2023-12-26 07:37:18,099][123090] Updated weights for policy 1, policy_version 998666 (0.0010) [2023-12-26 07:37:18,162][123090] Updated weights for policy 1, policy_version 998676 (0.0008) [2023-12-26 07:37:18,228][123090] Updated weights for policy 1, policy_version 998686 (0.0010) [2023-12-26 07:37:18,357][123091] Updated weights for policy 0, policy_version 1005624 (0.0009) [2023-12-26 07:37:18,410][123091] Updated weights for policy 0, policy_version 1005635 (0.0009) [2023-12-26 07:37:18,461][123091] Updated weights for policy 0, policy_version 1005645 (0.0009) [2023-12-26 07:37:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 513114112. Throughput: 0: 8824.1, 1: 9005.7. Samples: 513125652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:18,785][121949] Avg episode reward: [(0, '6224.955'), (1, '5965.267')] [2023-12-26 07:37:19,053][123090] Updated weights for policy 1, policy_version 998696 (0.0009) [2023-12-26 07:37:19,117][123090] Updated weights for policy 1, policy_version 998706 (0.0009) [2023-12-26 07:37:19,174][123090] Updated weights for policy 1, policy_version 998716 (0.0009) [2023-12-26 07:37:19,306][123091] Updated weights for policy 0, policy_version 1005655 (0.0009) [2023-12-26 07:37:19,363][123091] Updated weights for policy 0, policy_version 1005665 (0.0009) [2023-12-26 07:37:19,432][123091] Updated weights for policy 0, policy_version 1005675 (0.0009) [2023-12-26 07:37:20,070][123090] Updated weights for policy 1, policy_version 998726 (0.0009) [2023-12-26 07:37:20,139][123090] Updated weights for policy 1, policy_version 998736 (0.0009) [2023-12-26 07:37:20,210][123090] Updated weights for policy 1, policy_version 998746 (0.0009) [2023-12-26 07:37:20,285][123091] Updated weights for policy 0, policy_version 1005685 (0.0010) [2023-12-26 07:37:20,341][123091] Updated weights for policy 0, policy_version 1005695 (0.0009) [2023-12-26 07:37:20,404][123091] Updated weights for policy 0, policy_version 1005705 (0.0010) [2023-12-26 07:37:21,000][123090] Updated weights for policy 1, policy_version 998756 (0.0008) [2023-12-26 07:37:21,069][123090] Updated weights for policy 1, policy_version 998766 (0.0006) [2023-12-26 07:37:21,143][123090] Updated weights for policy 1, policy_version 998776 (0.0009) [2023-12-26 07:37:21,275][123091] Updated weights for policy 0, policy_version 1005715 (0.0009) [2023-12-26 07:37:21,340][123091] Updated weights for policy 0, policy_version 1005725 (0.0010) [2023-12-26 07:37:21,416][123091] Updated weights for policy 0, policy_version 1005735 (0.0009) [2023-12-26 07:37:21,899][123090] Updated weights for policy 1, policy_version 998786 (0.0009) [2023-12-26 07:37:21,959][123090] Updated weights for policy 1, policy_version 998796 (0.0009) [2023-12-26 07:37:22,011][123090] Updated weights for policy 1, policy_version 998806 (0.0009) [2023-12-26 07:37:22,075][123090] Updated weights for policy 1, policy_version 998816 (0.0010) [2023-12-26 07:37:22,106][123091] Updated weights for policy 0, policy_version 1005745 (0.0008) [2023-12-26 07:37:22,175][123091] Updated weights for policy 0, policy_version 1005755 (0.0006) [2023-12-26 07:37:22,233][123091] Updated weights for policy 0, policy_version 1005765 (0.0009) [2023-12-26 07:37:22,300][123091] Updated weights for policy 0, policy_version 1005775 (0.0009) [2023-12-26 07:37:22,950][123090] Updated weights for policy 1, policy_version 998826 (0.0009) [2023-12-26 07:37:23,005][123090] Updated weights for policy 1, policy_version 998836 (0.0009) [2023-12-26 07:37:23,065][123091] Updated weights for policy 0, policy_version 1005785 (0.0006) [2023-12-26 07:37:23,065][123090] Updated weights for policy 1, policy_version 998846 (0.0009) [2023-12-26 07:37:23,122][123091] Updated weights for policy 0, policy_version 1005795 (0.0006) [2023-12-26 07:37:23,173][123091] Updated weights for policy 0, policy_version 1005805 (0.0009) [2023-12-26 07:37:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 513196032. Throughput: 0: 8732.5, 1: 8935.3. Samples: 513176008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:23,785][121949] Avg episode reward: [(0, '6149.539'), (1, '5924.401')] [2023-12-26 07:37:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001005808_257490944.pth... [2023-12-26 07:37:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000998848_255705088.pth... [2023-12-26 07:37:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001004784_257228800.pth [2023-12-26 07:37:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000997824_255442944.pth [2023-12-26 07:37:23,903][123090] Updated weights for policy 1, policy_version 998856 (0.0008) [2023-12-26 07:37:23,959][123090] Updated weights for policy 1, policy_version 998866 (0.0009) [2023-12-26 07:37:23,988][123091] Updated weights for policy 0, policy_version 1005815 (0.0009) [2023-12-26 07:37:24,021][123090] Updated weights for policy 1, policy_version 998876 (0.0007) [2023-12-26 07:37:24,044][123091] Updated weights for policy 0, policy_version 1005825 (0.0010) [2023-12-26 07:37:24,106][123091] Updated weights for policy 0, policy_version 1005835 (0.0010) [2023-12-26 07:37:24,827][123090] Updated weights for policy 1, policy_version 998886 (0.0009) [2023-12-26 07:37:24,876][123090] Updated weights for policy 1, policy_version 998896 (0.0009) [2023-12-26 07:37:24,925][123090] Updated weights for policy 1, policy_version 998906 (0.0009) [2023-12-26 07:37:24,957][123091] Updated weights for policy 0, policy_version 1005845 (0.0009) [2023-12-26 07:37:25,019][123091] Updated weights for policy 0, policy_version 1005855 (0.0010) [2023-12-26 07:37:25,079][123091] Updated weights for policy 0, policy_version 1005865 (0.0010) [2023-12-26 07:37:25,790][123090] Updated weights for policy 1, policy_version 998916 (0.0009) [2023-12-26 07:37:25,855][123090] Updated weights for policy 1, policy_version 998926 (0.0009) [2023-12-26 07:37:25,912][123091] Updated weights for policy 0, policy_version 1005875 (0.0009) [2023-12-26 07:37:25,923][123090] Updated weights for policy 1, policy_version 998936 (0.0009) [2023-12-26 07:37:25,968][123091] Updated weights for policy 0, policy_version 1005885 (0.0009) [2023-12-26 07:37:26,032][123091] Updated weights for policy 0, policy_version 1005895 (0.0009) [2023-12-26 07:37:26,737][123090] Updated weights for policy 1, policy_version 998946 (0.0008) [2023-12-26 07:37:26,799][123090] Updated weights for policy 1, policy_version 998956 (0.0010) [2023-12-26 07:37:26,852][123091] Updated weights for policy 0, policy_version 1005905 (0.0009) [2023-12-26 07:37:26,858][123090] Updated weights for policy 1, policy_version 998966 (0.0010) [2023-12-26 07:37:26,912][123091] Updated weights for policy 0, policy_version 1005915 (0.0006) [2023-12-26 07:37:26,925][123090] Updated weights for policy 1, policy_version 998976 (0.0010) [2023-12-26 07:37:26,964][123091] Updated weights for policy 0, policy_version 1005925 (0.0009) [2023-12-26 07:37:27,020][123091] Updated weights for policy 0, policy_version 1005935 (0.0009) [2023-12-26 07:37:27,728][123090] Updated weights for policy 1, policy_version 998986 (0.0010) [2023-12-26 07:37:27,782][123090] Updated weights for policy 1, policy_version 998996 (0.0010) [2023-12-26 07:37:27,848][123090] Updated weights for policy 1, policy_version 999006 (0.0010) [2023-12-26 07:37:27,869][123091] Updated weights for policy 0, policy_version 1005945 (0.0008) [2023-12-26 07:37:27,923][123091] Updated weights for policy 0, policy_version 1005955 (0.0009) [2023-12-26 07:37:27,978][123091] Updated weights for policy 0, policy_version 1005965 (0.0008) [2023-12-26 07:37:28,669][123090] Updated weights for policy 1, policy_version 999016 (0.0010) [2023-12-26 07:37:28,728][123090] Updated weights for policy 1, policy_version 999026 (0.0010) [2023-12-26 07:37:28,779][123090] Updated weights for policy 1, policy_version 999036 (0.0010) [2023-12-26 07:37:28,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 513277952. Throughput: 0: 8755.3, 1: 8936.5. Samples: 513278856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:28,784][121949] Avg episode reward: [(0, '6124.387'), (1, '5971.712')] [2023-12-26 07:37:28,808][123091] Updated weights for policy 0, policy_version 1005975 (0.0007) [2023-12-26 07:37:28,855][123091] Updated weights for policy 0, policy_version 1005985 (0.0008) [2023-12-26 07:37:28,906][123091] Updated weights for policy 0, policy_version 1005995 (0.0008) [2023-12-26 07:37:29,628][123090] Updated weights for policy 1, policy_version 999046 (0.0010) [2023-12-26 07:37:29,683][123090] Updated weights for policy 1, policy_version 999056 (0.0010) [2023-12-26 07:37:29,735][123090] Updated weights for policy 1, policy_version 999066 (0.0010) [2023-12-26 07:37:29,772][123091] Updated weights for policy 0, policy_version 1006005 (0.0009) [2023-12-26 07:37:29,835][123091] Updated weights for policy 0, policy_version 1006015 (0.0008) [2023-12-26 07:37:29,906][123091] Updated weights for policy 0, policy_version 1006025 (0.0009) [2023-12-26 07:37:30,599][123090] Updated weights for policy 1, policy_version 999076 (0.0009) [2023-12-26 07:37:30,648][123090] Updated weights for policy 1, policy_version 999086 (0.0009) [2023-12-26 07:37:30,714][123090] Updated weights for policy 1, policy_version 999097 (0.0010) [2023-12-26 07:37:30,755][123091] Updated weights for policy 0, policy_version 1006035 (0.0008) [2023-12-26 07:37:30,822][123091] Updated weights for policy 0, policy_version 1006045 (0.0005) [2023-12-26 07:37:30,891][123091] Updated weights for policy 0, policy_version 1006055 (0.0005) [2023-12-26 07:37:31,528][123090] Updated weights for policy 1, policy_version 999107 (0.0008) [2023-12-26 07:37:31,598][123090] Updated weights for policy 1, policy_version 999117 (0.0005) [2023-12-26 07:37:31,641][123091] Updated weights for policy 0, policy_version 1006065 (0.0005) [2023-12-26 07:37:31,667][123090] Updated weights for policy 1, policy_version 999127 (0.0007) [2023-12-26 07:37:31,698][123091] Updated weights for policy 0, policy_version 1006075 (0.0008) [2023-12-26 07:37:31,763][123091] Updated weights for policy 0, policy_version 1006085 (0.0008) [2023-12-26 07:37:31,818][123091] Updated weights for policy 0, policy_version 1006095 (0.0008) [2023-12-26 07:37:32,371][123090] Updated weights for policy 1, policy_version 999137 (0.0008) [2023-12-26 07:37:32,427][123090] Updated weights for policy 1, policy_version 999147 (0.0008) [2023-12-26 07:37:32,479][123090] Updated weights for policy 1, policy_version 999157 (0.0009) [2023-12-26 07:37:32,535][123090] Updated weights for policy 1, policy_version 999167 (0.0009) [2023-12-26 07:37:32,648][123091] Updated weights for policy 0, policy_version 1006105 (0.0010) [2023-12-26 07:37:32,711][123091] Updated weights for policy 0, policy_version 1006115 (0.0011) [2023-12-26 07:37:32,758][123091] Updated weights for policy 0, policy_version 1006125 (0.0010) [2023-12-26 07:37:33,295][123090] Updated weights for policy 1, policy_version 999177 (0.0005) [2023-12-26 07:37:33,344][123090] Updated weights for policy 1, policy_version 999187 (0.0005) [2023-12-26 07:37:33,394][123090] Updated weights for policy 1, policy_version 999197 (0.0005) [2023-12-26 07:37:33,605][123091] Updated weights for policy 0, policy_version 1006135 (0.0010) [2023-12-26 07:37:33,666][123091] Updated weights for policy 0, policy_version 1006145 (0.0010) [2023-12-26 07:37:33,731][123091] Updated weights for policy 0, policy_version 1006155 (0.0010) [2023-12-26 07:37:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 513376256. Throughput: 0: 8751.3, 1: 8819.7. Samples: 513384500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:33,784][121949] Avg episode reward: [(0, '6171.366'), (1, '5962.317')] [2023-12-26 07:37:34,120][123090] Updated weights for policy 1, policy_version 999207 (0.0007) [2023-12-26 07:37:34,182][123090] Updated weights for policy 1, policy_version 999217 (0.0008) [2023-12-26 07:37:34,243][123090] Updated weights for policy 1, policy_version 999227 (0.0009) [2023-12-26 07:37:34,508][123091] Updated weights for policy 0, policy_version 1006165 (0.0010) [2023-12-26 07:37:34,580][123091] Updated weights for policy 0, policy_version 1006175 (0.0006) [2023-12-26 07:37:34,641][123091] Updated weights for policy 0, policy_version 1006185 (0.0005) [2023-12-26 07:37:35,129][123090] Updated weights for policy 1, policy_version 999237 (0.0010) [2023-12-26 07:37:35,206][123090] Updated weights for policy 1, policy_version 999247 (0.0010) [2023-12-26 07:37:35,276][123091] Updated weights for policy 0, policy_version 1006195 (0.0005) [2023-12-26 07:37:35,284][123090] Updated weights for policy 1, policy_version 999257 (0.0010) [2023-12-26 07:37:35,325][123091] Updated weights for policy 0, policy_version 1006205 (0.0005) [2023-12-26 07:37:35,381][123091] Updated weights for policy 0, policy_version 1006215 (0.0005) [2023-12-26 07:37:36,066][123090] Updated weights for policy 1, policy_version 999267 (0.0010) [2023-12-26 07:37:36,117][123091] Updated weights for policy 0, policy_version 1006225 (0.0006) [2023-12-26 07:37:36,134][123090] Updated weights for policy 1, policy_version 999277 (0.0010) [2023-12-26 07:37:36,182][123091] Updated weights for policy 0, policy_version 1006235 (0.0010) [2023-12-26 07:37:36,196][123090] Updated weights for policy 1, policy_version 999287 (0.0013) [2023-12-26 07:37:36,246][123091] Updated weights for policy 0, policy_version 1006245 (0.0007) [2023-12-26 07:37:36,315][123091] Updated weights for policy 0, policy_version 1006255 (0.0009) [2023-12-26 07:37:37,032][123090] Updated weights for policy 1, policy_version 999297 (0.0011) [2023-12-26 07:37:37,093][123090] Updated weights for policy 1, policy_version 999307 (0.0011) [2023-12-26 07:37:37,138][123091] Updated weights for policy 0, policy_version 1006265 (0.0010) [2023-12-26 07:37:37,158][123090] Updated weights for policy 1, policy_version 999317 (0.0009) [2023-12-26 07:37:37,202][123091] Updated weights for policy 0, policy_version 1006275 (0.0011) [2023-12-26 07:37:37,231][123090] Updated weights for policy 1, policy_version 999327 (0.0005) [2023-12-26 07:37:37,269][123091] Updated weights for policy 0, policy_version 1006285 (0.0011) [2023-12-26 07:37:37,903][123090] Updated weights for policy 1, policy_version 999337 (0.0010) [2023-12-26 07:37:37,963][123090] Updated weights for policy 1, policy_version 999347 (0.0010) [2023-12-26 07:37:38,020][123090] Updated weights for policy 1, policy_version 999357 (0.0010) [2023-12-26 07:37:38,079][123091] Updated weights for policy 0, policy_version 1006295 (0.0011) [2023-12-26 07:37:38,139][123091] Updated weights for policy 0, policy_version 1006305 (0.0011) [2023-12-26 07:37:38,201][123091] Updated weights for policy 0, policy_version 1006315 (0.0006) [2023-12-26 07:37:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 513458176. Throughput: 0: 8779.9, 1: 8801.2. Samples: 513437788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:38,785][121949] Avg episode reward: [(0, '6287.243'), (1, '5997.807')] [2023-12-26 07:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000999360_255836160.pth... [2023-12-26 07:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001006320_257622016.pth... [2023-12-26 07:37:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001005296_257359872.pth [2023-12-26 07:37:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000998368_255582208.pth [2023-12-26 07:37:38,899][123090] Updated weights for policy 1, policy_version 999367 (0.0010) [2023-12-26 07:37:38,971][123090] Updated weights for policy 1, policy_version 999377 (0.0009) [2023-12-26 07:37:39,031][123091] Updated weights for policy 0, policy_version 1006325 (0.0008) [2023-12-26 07:37:39,041][123090] Updated weights for policy 1, policy_version 999387 (0.0008) [2023-12-26 07:37:39,092][123091] Updated weights for policy 0, policy_version 1006335 (0.0006) [2023-12-26 07:37:39,164][123091] Updated weights for policy 0, policy_version 1006345 (0.0006) [2023-12-26 07:37:39,808][123090] Updated weights for policy 1, policy_version 999397 (0.0008) [2023-12-26 07:37:39,879][123090] Updated weights for policy 1, policy_version 999407 (0.0008) [2023-12-26 07:37:39,933][123090] Updated weights for policy 1, policy_version 999417 (0.0009) [2023-12-26 07:37:39,961][123091] Updated weights for policy 0, policy_version 1006355 (0.0007) [2023-12-26 07:37:40,032][123091] Updated weights for policy 0, policy_version 1006365 (0.0010) [2023-12-26 07:37:40,100][123091] Updated weights for policy 0, policy_version 1006375 (0.0011) [2023-12-26 07:37:40,759][123091] Updated weights for policy 0, policy_version 1006385 (0.0010) [2023-12-26 07:37:40,808][123090] Updated weights for policy 1, policy_version 999427 (0.0008) [2023-12-26 07:37:40,829][123091] Updated weights for policy 0, policy_version 1006395 (0.0009) [2023-12-26 07:37:40,867][123090] Updated weights for policy 1, policy_version 999437 (0.0007) [2023-12-26 07:37:40,887][123091] Updated weights for policy 0, policy_version 1006405 (0.0007) [2023-12-26 07:37:40,932][123090] Updated weights for policy 1, policy_version 999447 (0.0010) [2023-12-26 07:37:40,949][123091] Updated weights for policy 0, policy_version 1006415 (0.0009) [2023-12-26 07:37:41,794][123091] Updated weights for policy 0, policy_version 1006425 (0.0009) [2023-12-26 07:37:41,823][123090] Updated weights for policy 1, policy_version 999457 (0.0008) [2023-12-26 07:37:41,850][123091] Updated weights for policy 0, policy_version 1006435 (0.0008) [2023-12-26 07:37:41,890][123090] Updated weights for policy 1, policy_version 999467 (0.0007) [2023-12-26 07:37:41,905][123091] Updated weights for policy 0, policy_version 1006445 (0.0008) [2023-12-26 07:37:41,953][123090] Updated weights for policy 1, policy_version 999477 (0.0007) [2023-12-26 07:37:42,013][123090] Updated weights for policy 1, policy_version 999487 (0.0010) [2023-12-26 07:37:42,697][123091] Updated weights for policy 0, policy_version 1006455 (0.0006) [2023-12-26 07:37:42,750][123091] Updated weights for policy 0, policy_version 1006465 (0.0005) [2023-12-26 07:37:42,814][123091] Updated weights for policy 0, policy_version 1006475 (0.0006) [2023-12-26 07:37:42,886][123090] Updated weights for policy 1, policy_version 999497 (0.0010) [2023-12-26 07:37:42,941][123090] Updated weights for policy 1, policy_version 999507 (0.0009) [2023-12-26 07:37:43,007][123090] Updated weights for policy 1, policy_version 999517 (0.0009) [2023-12-26 07:37:43,603][123091] Updated weights for policy 0, policy_version 1006485 (0.0009) [2023-12-26 07:37:43,663][123091] Updated weights for policy 0, policy_version 1006495 (0.0008) [2023-12-26 07:37:43,728][123091] Updated weights for policy 0, policy_version 1006505 (0.0008) [2023-12-26 07:37:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 513548288. Throughput: 0: 8740.1, 1: 8672.3. Samples: 513540640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:43,785][121949] Avg episode reward: [(0, '6332.301'), (1, '6001.533')] [2023-12-26 07:37:43,876][123090] Updated weights for policy 1, policy_version 999527 (0.0009) [2023-12-26 07:37:43,935][123090] Updated weights for policy 1, policy_version 999537 (0.0010) [2023-12-26 07:37:43,994][123090] Updated weights for policy 1, policy_version 999547 (0.0010) [2023-12-26 07:37:44,493][123091] Updated weights for policy 0, policy_version 1006515 (0.0007) [2023-12-26 07:37:44,547][123091] Updated weights for policy 0, policy_version 1006525 (0.0005) [2023-12-26 07:37:44,612][123091] Updated weights for policy 0, policy_version 1006535 (0.0009) [2023-12-26 07:37:44,849][123090] Updated weights for policy 1, policy_version 999557 (0.0010) [2023-12-26 07:37:44,916][123090] Updated weights for policy 1, policy_version 999567 (0.0008) [2023-12-26 07:37:44,988][123090] Updated weights for policy 1, policy_version 999577 (0.0010) [2023-12-26 07:37:45,402][123091] Updated weights for policy 0, policy_version 1006545 (0.0009) [2023-12-26 07:37:45,463][123091] Updated weights for policy 0, policy_version 1006555 (0.0007) [2023-12-26 07:37:45,520][123091] Updated weights for policy 0, policy_version 1006565 (0.0010) [2023-12-26 07:37:45,572][123091] Updated weights for policy 0, policy_version 1006575 (0.0009) [2023-12-26 07:37:45,874][123090] Updated weights for policy 1, policy_version 999587 (0.0010) [2023-12-26 07:37:45,936][123090] Updated weights for policy 1, policy_version 999597 (0.0009) [2023-12-26 07:37:46,004][123090] Updated weights for policy 1, policy_version 999607 (0.0010) [2023-12-26 07:37:46,409][123091] Updated weights for policy 0, policy_version 1006585 (0.0006) [2023-12-26 07:37:46,459][123091] Updated weights for policy 0, policy_version 1006595 (0.0008) [2023-12-26 07:37:46,513][123091] Updated weights for policy 0, policy_version 1006605 (0.0009) [2023-12-26 07:37:46,861][123090] Updated weights for policy 1, policy_version 999617 (0.0009) [2023-12-26 07:37:46,912][123090] Updated weights for policy 1, policy_version 999627 (0.0009) [2023-12-26 07:37:46,964][123090] Updated weights for policy 1, policy_version 999637 (0.0009) [2023-12-26 07:37:47,017][123090] Updated weights for policy 1, policy_version 999647 (0.0009) [2023-12-26 07:37:47,363][123091] Updated weights for policy 0, policy_version 1006615 (0.0009) [2023-12-26 07:37:47,425][123091] Updated weights for policy 0, policy_version 1006625 (0.0008) [2023-12-26 07:37:47,490][123091] Updated weights for policy 0, policy_version 1006635 (0.0008) [2023-12-26 07:37:47,887][123090] Updated weights for policy 1, policy_version 999657 (0.0009) [2023-12-26 07:37:47,939][123090] Updated weights for policy 1, policy_version 999667 (0.0009) [2023-12-26 07:37:47,986][123090] Updated weights for policy 1, policy_version 999677 (0.0006) [2023-12-26 07:37:48,226][123091] Updated weights for policy 0, policy_version 1006645 (0.0008) [2023-12-26 07:37:48,289][123091] Updated weights for policy 0, policy_version 1006655 (0.0006) [2023-12-26 07:37:48,352][123091] Updated weights for policy 0, policy_version 1006665 (0.0007) [2023-12-26 07:37:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 513630208. Throughput: 0: 8755.8, 1: 8583.6. Samples: 513644176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:48,784][121949] Avg episode reward: [(0, '6327.946'), (1, '5993.234')] [2023-12-26 07:37:48,837][123090] Updated weights for policy 1, policy_version 999687 (0.0008) [2023-12-26 07:37:48,890][123090] Updated weights for policy 1, policy_version 999697 (0.0009) [2023-12-26 07:37:48,943][123090] Updated weights for policy 1, policy_version 999707 (0.0009) [2023-12-26 07:37:49,108][123091] Updated weights for policy 0, policy_version 1006675 (0.0009) [2023-12-26 07:37:49,159][123091] Updated weights for policy 0, policy_version 1006685 (0.0010) [2023-12-26 07:37:49,206][123091] Updated weights for policy 0, policy_version 1006695 (0.0010) [2023-12-26 07:37:49,743][123090] Updated weights for policy 1, policy_version 999717 (0.0009) [2023-12-26 07:37:49,798][123090] Updated weights for policy 1, policy_version 999727 (0.0010) [2023-12-26 07:37:49,866][123090] Updated weights for policy 1, policy_version 999737 (0.0011) [2023-12-26 07:37:50,092][123091] Updated weights for policy 0, policy_version 1006705 (0.0011) [2023-12-26 07:37:50,147][123091] Updated weights for policy 0, policy_version 1006715 (0.0010) [2023-12-26 07:37:50,199][123091] Updated weights for policy 0, policy_version 1006725 (0.0010) [2023-12-26 07:37:50,272][123091] Updated weights for policy 0, policy_version 1006735 (0.0011) [2023-12-26 07:37:50,620][123090] Updated weights for policy 1, policy_version 999747 (0.0010) [2023-12-26 07:37:50,672][123090] Updated weights for policy 1, policy_version 999757 (0.0011) [2023-12-26 07:37:50,740][123090] Updated weights for policy 1, policy_version 999767 (0.0011) [2023-12-26 07:37:51,110][123091] Updated weights for policy 0, policy_version 1006745 (0.0010) [2023-12-26 07:37:51,173][123091] Updated weights for policy 0, policy_version 1006755 (0.0009) [2023-12-26 07:37:51,226][123091] Updated weights for policy 0, policy_version 1006765 (0.0009) [2023-12-26 07:37:51,608][123090] Updated weights for policy 1, policy_version 999777 (0.0010) [2023-12-26 07:37:51,674][123090] Updated weights for policy 1, policy_version 999787 (0.0009) [2023-12-26 07:37:51,746][123090] Updated weights for policy 1, policy_version 999797 (0.0010) [2023-12-26 07:37:51,813][123090] Updated weights for policy 1, policy_version 999807 (0.0009) [2023-12-26 07:37:52,068][123091] Updated weights for policy 0, policy_version 1006775 (0.0010) [2023-12-26 07:37:52,132][123091] Updated weights for policy 0, policy_version 1006785 (0.0011) [2023-12-26 07:37:52,195][123091] Updated weights for policy 0, policy_version 1006795 (0.0011) [2023-12-26 07:37:52,627][123090] Updated weights for policy 1, policy_version 999817 (0.0008) [2023-12-26 07:37:52,699][123090] Updated weights for policy 1, policy_version 999827 (0.0007) [2023-12-26 07:37:52,770][123090] Updated weights for policy 1, policy_version 999837 (0.0007) [2023-12-26 07:37:52,971][123091] Updated weights for policy 0, policy_version 1006805 (0.0011) [2023-12-26 07:37:53,019][123091] Updated weights for policy 0, policy_version 1006815 (0.0010) [2023-12-26 07:37:53,077][123091] Updated weights for policy 0, policy_version 1006825 (0.0010) [2023-12-26 07:37:53,528][123090] Updated weights for policy 1, policy_version 999847 (0.0009) [2023-12-26 07:37:53,580][123090] Updated weights for policy 1, policy_version 999857 (0.0010) [2023-12-26 07:37:53,631][123090] Updated weights for policy 1, policy_version 999867 (0.0010) [2023-12-26 07:37:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 513720320. Throughput: 0: 8714.5, 1: 8568.8. Samples: 513695920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:53,785][121949] Avg episode reward: [(0, '6232.618'), (1, '5873.374')] [2023-12-26 07:37:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001006832_257753088.pth... [2023-12-26 07:37:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000999872_255967232.pth... [2023-12-26 07:37:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001005808_257490944.pth [2023-12-26 07:37:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000998848_255705088.pth [2023-12-26 07:37:53,870][123091] Updated weights for policy 0, policy_version 1006835 (0.0010) [2023-12-26 07:37:53,927][123091] Updated weights for policy 0, policy_version 1006845 (0.0010) [2023-12-26 07:37:53,978][123091] Updated weights for policy 0, policy_version 1006855 (0.0010) [2023-12-26 07:37:54,479][123090] Updated weights for policy 1, policy_version 999877 (0.0009) [2023-12-26 07:37:54,539][123090] Updated weights for policy 1, policy_version 999887 (0.0009) [2023-12-26 07:37:54,601][123090] Updated weights for policy 1, policy_version 999897 (0.0009) [2023-12-26 07:37:54,823][123091] Updated weights for policy 0, policy_version 1006865 (0.0010) [2023-12-26 07:37:54,873][123091] Updated weights for policy 0, policy_version 1006875 (0.0010) [2023-12-26 07:37:54,917][123091] Updated weights for policy 0, policy_version 1006885 (0.0010) [2023-12-26 07:37:54,974][123091] Updated weights for policy 0, policy_version 1006895 (0.0010) [2023-12-26 07:37:55,446][123090] Updated weights for policy 1, policy_version 999907 (0.0008) [2023-12-26 07:37:55,501][123090] Updated weights for policy 1, policy_version 999917 (0.0008) [2023-12-26 07:37:55,549][123090] Updated weights for policy 1, policy_version 999927 (0.0008) [2023-12-26 07:37:55,818][123091] Updated weights for policy 0, policy_version 1006905 (0.0011) [2023-12-26 07:37:55,884][123091] Updated weights for policy 0, policy_version 1006915 (0.0011) [2023-12-26 07:37:55,951][123091] Updated weights for policy 0, policy_version 1006925 (0.0009) [2023-12-26 07:37:56,298][123090] Updated weights for policy 1, policy_version 999937 (0.0008) [2023-12-26 07:37:56,363][123090] Updated weights for policy 1, policy_version 999947 (0.0005) [2023-12-26 07:37:56,410][123090] Updated weights for policy 1, policy_version 999957 (0.0005) [2023-12-26 07:37:56,456][123090] Updated weights for policy 1, policy_version 999967 (0.0005) [2023-12-26 07:37:56,635][123091] Updated weights for policy 0, policy_version 1006935 (0.0006) [2023-12-26 07:37:56,681][123091] Updated weights for policy 0, policy_version 1006945 (0.0005) [2023-12-26 07:37:56,729][123091] Updated weights for policy 0, policy_version 1006955 (0.0005) [2023-12-26 07:37:57,149][123090] Updated weights for policy 1, policy_version 999977 (0.0005) [2023-12-26 07:37:57,206][123090] Updated weights for policy 1, policy_version 999987 (0.0005) [2023-12-26 07:37:57,261][123090] Updated weights for policy 1, policy_version 999997 (0.0005) [2023-12-26 07:37:57,495][123091] Updated weights for policy 0, policy_version 1006965 (0.0005) [2023-12-26 07:37:57,560][123091] Updated weights for policy 0, policy_version 1006975 (0.0008) [2023-12-26 07:37:57,607][123091] Updated weights for policy 0, policy_version 1006985 (0.0010) [2023-12-26 07:37:57,955][123090] Updated weights for policy 1, policy_version 1000007 (0.0005) [2023-12-26 07:37:58,023][123090] Updated weights for policy 1, policy_version 1000017 (0.0006) [2023-12-26 07:37:58,083][123090] Updated weights for policy 1, policy_version 1000027 (0.0008) [2023-12-26 07:37:58,455][123091] Updated weights for policy 0, policy_version 1006995 (0.0010) [2023-12-26 07:37:58,521][123091] Updated weights for policy 0, policy_version 1007005 (0.0009) [2023-12-26 07:37:58,583][123091] Updated weights for policy 0, policy_version 1007015 (0.0008) [2023-12-26 07:37:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 513810432. Throughput: 0: 8797.1, 1: 8628.1. Samples: 513804984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:37:58,785][121949] Avg episode reward: [(0, '6135.114'), (1, '5916.518')] [2023-12-26 07:37:58,898][123090] Updated weights for policy 1, policy_version 1000037 (0.0009) [2023-12-26 07:37:58,956][123090] Updated weights for policy 1, policy_version 1000047 (0.0010) [2023-12-26 07:37:59,022][123090] Updated weights for policy 1, policy_version 1000057 (0.0010) [2023-12-26 07:37:59,445][123091] Updated weights for policy 0, policy_version 1007025 (0.0008) [2023-12-26 07:37:59,501][123091] Updated weights for policy 0, policy_version 1007035 (0.0009) [2023-12-26 07:37:59,556][123091] Updated weights for policy 0, policy_version 1007045 (0.0009) [2023-12-26 07:37:59,605][123091] Updated weights for policy 0, policy_version 1007055 (0.0009) [2023-12-26 07:37:59,870][123090] Updated weights for policy 1, policy_version 1000067 (0.0010) [2023-12-26 07:37:59,933][123090] Updated weights for policy 1, policy_version 1000077 (0.0010) [2023-12-26 07:37:59,996][123090] Updated weights for policy 1, policy_version 1000087 (0.0010) [2023-12-26 07:38:00,417][123091] Updated weights for policy 0, policy_version 1007065 (0.0009) [2023-12-26 07:38:00,469][123091] Updated weights for policy 0, policy_version 1007075 (0.0009) [2023-12-26 07:38:00,529][123091] Updated weights for policy 0, policy_version 1007085 (0.0008) [2023-12-26 07:38:00,822][123090] Updated weights for policy 1, policy_version 1000097 (0.0011) [2023-12-26 07:38:00,876][123090] Updated weights for policy 1, policy_version 1000107 (0.0005) [2023-12-26 07:38:00,921][123090] Updated weights for policy 1, policy_version 1000117 (0.0005) [2023-12-26 07:38:00,969][123090] Updated weights for policy 1, policy_version 1000127 (0.0005) [2023-12-26 07:38:01,361][123091] Updated weights for policy 0, policy_version 1007095 (0.0009) [2023-12-26 07:38:01,429][123091] Updated weights for policy 0, policy_version 1007105 (0.0010) [2023-12-26 07:38:01,497][123091] Updated weights for policy 0, policy_version 1007115 (0.0006) [2023-12-26 07:38:01,781][123090] Updated weights for policy 1, policy_version 1000137 (0.0006) [2023-12-26 07:38:01,856][123090] Updated weights for policy 1, policy_version 1000147 (0.0005) [2023-12-26 07:38:01,923][123090] Updated weights for policy 1, policy_version 1000157 (0.0008) [2023-12-26 07:38:02,270][123091] Updated weights for policy 0, policy_version 1007125 (0.0007) [2023-12-26 07:38:02,329][123091] Updated weights for policy 0, policy_version 1007135 (0.0009) [2023-12-26 07:38:02,397][123091] Updated weights for policy 0, policy_version 1007145 (0.0008) [2023-12-26 07:38:02,684][123090] Updated weights for policy 1, policy_version 1000167 (0.0008) [2023-12-26 07:38:02,730][123090] Updated weights for policy 1, policy_version 1000177 (0.0008) [2023-12-26 07:38:02,786][123090] Updated weights for policy 1, policy_version 1000187 (0.0010) [2023-12-26 07:38:03,192][123091] Updated weights for policy 0, policy_version 1007155 (0.0008) [2023-12-26 07:38:03,267][123091] Updated weights for policy 0, policy_version 1007165 (0.0010) [2023-12-26 07:38:03,322][123091] Updated weights for policy 0, policy_version 1007175 (0.0009) [2023-12-26 07:38:03,506][123090] Updated weights for policy 1, policy_version 1000197 (0.0010) [2023-12-26 07:38:03,558][123090] Updated weights for policy 1, policy_version 1000207 (0.0009) [2023-12-26 07:38:03,610][123090] Updated weights for policy 1, policy_version 1000219 (0.0008) [2023-12-26 07:38:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 513900544. Throughput: 0: 8738.8, 1: 8670.7. Samples: 513909076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:03,785][121949] Avg episode reward: [(0, '6117.185'), (1, '5983.285')] [2023-12-26 07:38:04,173][123091] Updated weights for policy 0, policy_version 1007185 (0.0009) [2023-12-26 07:38:04,231][123091] Updated weights for policy 0, policy_version 1007195 (0.0009) [2023-12-26 07:38:04,286][123091] Updated weights for policy 0, policy_version 1007205 (0.0010) [2023-12-26 07:38:04,324][123090] Updated weights for policy 1, policy_version 1000229 (0.0006) [2023-12-26 07:38:04,338][123091] Updated weights for policy 0, policy_version 1007215 (0.0010) [2023-12-26 07:38:04,383][123090] Updated weights for policy 1, policy_version 1000239 (0.0008) [2023-12-26 07:38:04,433][123090] Updated weights for policy 1, policy_version 1000249 (0.0009) [2023-12-26 07:38:05,186][123091] Updated weights for policy 0, policy_version 1007225 (0.0006) [2023-12-26 07:38:05,236][123091] Updated weights for policy 0, policy_version 1007235 (0.0005) [2023-12-26 07:38:05,285][123090] Updated weights for policy 1, policy_version 1000259 (0.0009) [2023-12-26 07:38:05,298][123091] Updated weights for policy 0, policy_version 1007245 (0.0005) [2023-12-26 07:38:05,343][123090] Updated weights for policy 1, policy_version 1000269 (0.0009) [2023-12-26 07:38:05,400][123090] Updated weights for policy 1, policy_version 1000279 (0.0009) [2023-12-26 07:38:06,094][123091] Updated weights for policy 0, policy_version 1007255 (0.0010) [2023-12-26 07:38:06,108][123090] Updated weights for policy 1, policy_version 1000289 (0.0009) [2023-12-26 07:38:06,165][123091] Updated weights for policy 0, policy_version 1007265 (0.0009) [2023-12-26 07:38:06,174][123090] Updated weights for policy 1, policy_version 1000299 (0.0006) [2023-12-26 07:38:06,237][123091] Updated weights for policy 0, policy_version 1007275 (0.0008) [2023-12-26 07:38:06,240][123090] Updated weights for policy 1, policy_version 1000309 (0.0007) [2023-12-26 07:38:06,302][123090] Updated weights for policy 1, policy_version 1000319 (0.0006) [2023-12-26 07:38:06,975][123091] Updated weights for policy 0, policy_version 1007285 (0.0008) [2023-12-26 07:38:07,023][123091] Updated weights for policy 0, policy_version 1007295 (0.0007) [2023-12-26 07:38:07,070][123091] Updated weights for policy 0, policy_version 1007305 (0.0005) [2023-12-26 07:38:07,071][123090] Updated weights for policy 1, policy_version 1000329 (0.0008) [2023-12-26 07:38:07,126][123090] Updated weights for policy 1, policy_version 1000339 (0.0010) [2023-12-26 07:38:07,178][123090] Updated weights for policy 1, policy_version 1000349 (0.0009) [2023-12-26 07:38:07,850][123091] Updated weights for policy 0, policy_version 1007315 (0.0007) [2023-12-26 07:38:07,906][123091] Updated weights for policy 0, policy_version 1007325 (0.0009) [2023-12-26 07:38:07,969][123091] Updated weights for policy 0, policy_version 1007335 (0.0009) [2023-12-26 07:38:08,072][123090] Updated weights for policy 1, policy_version 1000359 (0.0009) [2023-12-26 07:38:08,123][123090] Updated weights for policy 1, policy_version 1000370 (0.0011) [2023-12-26 07:38:08,167][123090] Updated weights for policy 1, policy_version 1000380 (0.0010) [2023-12-26 07:38:08,652][123091] Updated weights for policy 0, policy_version 1007345 (0.0009) [2023-12-26 07:38:08,715][123091] Updated weights for policy 0, policy_version 1007355 (0.0007) [2023-12-26 07:38:08,777][123091] Updated weights for policy 0, policy_version 1007365 (0.0007) [2023-12-26 07:38:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 513982464. Throughput: 0: 8762.8, 1: 8719.5. Samples: 513962712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:08,785][121949] Avg episode reward: [(0, '6157.892'), (1, '5935.602')] [2023-12-26 07:38:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001000384_256098304.pth... [2023-12-26 07:38:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000999360_255836160.pth [2023-12-26 07:38:08,841][123091] Updated weights for policy 0, policy_version 1007375 (0.0009) [2023-12-26 07:38:08,846][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001007376_257892352.pth... [2023-12-26 07:38:08,850][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001006320_257622016.pth [2023-12-26 07:38:09,052][123090] Updated weights for policy 1, policy_version 1000390 (0.0011) [2023-12-26 07:38:09,116][123090] Updated weights for policy 1, policy_version 1000400 (0.0011) [2023-12-26 07:38:09,180][123090] Updated weights for policy 1, policy_version 1000410 (0.0011) [2023-12-26 07:38:09,697][123091] Updated weights for policy 0, policy_version 1007385 (0.0010) [2023-12-26 07:38:09,769][123091] Updated weights for policy 0, policy_version 1007395 (0.0010) [2023-12-26 07:38:09,842][123091] Updated weights for policy 0, policy_version 1007405 (0.0008) [2023-12-26 07:38:10,060][123090] Updated weights for policy 1, policy_version 1000420 (0.0010) [2023-12-26 07:38:10,128][123090] Updated weights for policy 1, policy_version 1000430 (0.0009) [2023-12-26 07:38:10,181][123090] Updated weights for policy 1, policy_version 1000440 (0.0010) [2023-12-26 07:38:10,641][123091] Updated weights for policy 0, policy_version 1007415 (0.0009) [2023-12-26 07:38:10,693][123091] Updated weights for policy 0, policy_version 1007426 (0.0010) [2023-12-26 07:38:10,752][123091] Updated weights for policy 0, policy_version 1007437 (0.0010) [2023-12-26 07:38:11,033][123090] Updated weights for policy 1, policy_version 1000450 (0.0009) [2023-12-26 07:38:11,094][123090] Updated weights for policy 1, policy_version 1000460 (0.0009) [2023-12-26 07:38:11,168][123090] Updated weights for policy 1, policy_version 1000470 (0.0009) [2023-12-26 07:38:11,233][123090] Updated weights for policy 1, policy_version 1000480 (0.0010) [2023-12-26 07:38:11,629][123091] Updated weights for policy 0, policy_version 1007447 (0.0009) [2023-12-26 07:38:11,697][123091] Updated weights for policy 0, policy_version 1007457 (0.0010) [2023-12-26 07:38:11,765][123091] Updated weights for policy 0, policy_version 1007467 (0.0009) [2023-12-26 07:38:12,127][123090] Updated weights for policy 1, policy_version 1000491 (0.0011) [2023-12-26 07:38:12,188][123090] Updated weights for policy 1, policy_version 1000501 (0.0010) [2023-12-26 07:38:12,244][123090] Updated weights for policy 1, policy_version 1000511 (0.0010) [2023-12-26 07:38:12,539][123091] Updated weights for policy 0, policy_version 1007477 (0.0009) [2023-12-26 07:38:12,609][123091] Updated weights for policy 0, policy_version 1007487 (0.0010) [2023-12-26 07:38:12,672][123091] Updated weights for policy 0, policy_version 1007497 (0.0009) [2023-12-26 07:38:13,113][123090] Updated weights for policy 1, policy_version 1000521 (0.0009) [2023-12-26 07:38:13,177][123090] Updated weights for policy 1, policy_version 1000531 (0.0009) [2023-12-26 07:38:13,238][123090] Updated weights for policy 1, policy_version 1000541 (0.0009) [2023-12-26 07:38:13,506][123091] Updated weights for policy 0, policy_version 1007507 (0.0010) [2023-12-26 07:38:13,567][123091] Updated weights for policy 0, policy_version 1007517 (0.0009) [2023-12-26 07:38:13,630][123091] Updated weights for policy 0, policy_version 1007527 (0.0009) [2023-12-26 07:38:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 514072576. Throughput: 0: 8791.6, 1: 8669.1. Samples: 514064588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:13,784][121949] Avg episode reward: [(0, '6253.510'), (1, '5907.047')] [2023-12-26 07:38:14,094][123090] Updated weights for policy 1, policy_version 1000551 (0.0010) [2023-12-26 07:38:14,160][123090] Updated weights for policy 1, policy_version 1000561 (0.0009) [2023-12-26 07:38:14,209][123090] Updated weights for policy 1, policy_version 1000571 (0.0009) [2023-12-26 07:38:14,318][123091] Updated weights for policy 0, policy_version 1007537 (0.0010) [2023-12-26 07:38:14,381][123091] Updated weights for policy 0, policy_version 1007547 (0.0009) [2023-12-26 07:38:14,438][123091] Updated weights for policy 0, policy_version 1007557 (0.0009) [2023-12-26 07:38:14,493][123091] Updated weights for policy 0, policy_version 1007567 (0.0010) [2023-12-26 07:38:15,145][123090] Updated weights for policy 1, policy_version 1000581 (0.0010) [2023-12-26 07:38:15,214][123090] Updated weights for policy 1, policy_version 1000591 (0.0009) [2023-12-26 07:38:15,268][123090] Updated weights for policy 1, policy_version 1000601 (0.0009) [2023-12-26 07:38:15,326][123091] Updated weights for policy 0, policy_version 1007577 (0.0010) [2023-12-26 07:38:15,385][123091] Updated weights for policy 0, policy_version 1007587 (0.0009) [2023-12-26 07:38:15,459][123091] Updated weights for policy 0, policy_version 1007597 (0.0006) [2023-12-26 07:38:16,124][123091] Updated weights for policy 0, policy_version 1007607 (0.0006) [2023-12-26 07:38:16,178][123091] Updated weights for policy 0, policy_version 1007617 (0.0007) [2023-12-26 07:38:16,188][123090] Updated weights for policy 1, policy_version 1000611 (0.0010) [2023-12-26 07:38:16,228][123091] Updated weights for policy 0, policy_version 1007627 (0.0008) [2023-12-26 07:38:16,251][123090] Updated weights for policy 1, policy_version 1000621 (0.0010) [2023-12-26 07:38:16,302][123090] Updated weights for policy 1, policy_version 1000631 (0.0008) [2023-12-26 07:38:17,022][123091] Updated weights for policy 0, policy_version 1007637 (0.0009) [2023-12-26 07:38:17,082][123091] Updated weights for policy 0, policy_version 1007647 (0.0010) [2023-12-26 07:38:17,135][123091] Updated weights for policy 0, policy_version 1007657 (0.0009) [2023-12-26 07:38:17,158][123090] Updated weights for policy 1, policy_version 1000641 (0.0009) [2023-12-26 07:38:17,211][123090] Updated weights for policy 1, policy_version 1000651 (0.0005) [2023-12-26 07:38:17,272][123090] Updated weights for policy 1, policy_version 1000661 (0.0010) [2023-12-26 07:38:17,339][123090] Updated weights for policy 1, policy_version 1000671 (0.0010) [2023-12-26 07:38:17,879][123091] Updated weights for policy 0, policy_version 1007667 (0.0007) [2023-12-26 07:38:17,928][123091] Updated weights for policy 0, policy_version 1007677 (0.0005) [2023-12-26 07:38:17,987][123091] Updated weights for policy 0, policy_version 1007687 (0.0005) [2023-12-26 07:38:18,230][123090] Updated weights for policy 1, policy_version 1000681 (0.0006) [2023-12-26 07:38:18,296][123090] Updated weights for policy 1, policy_version 1000691 (0.0005) [2023-12-26 07:38:18,368][123090] Updated weights for policy 1, policy_version 1000701 (0.0008) [2023-12-26 07:38:18,687][123091] Updated weights for policy 0, policy_version 1007697 (0.0007) [2023-12-26 07:38:18,751][123091] Updated weights for policy 0, policy_version 1007707 (0.0010) [2023-12-26 07:38:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 514154496. Throughput: 0: 8890.1, 1: 8572.2. Samples: 514170304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:18,785][121949] Avg episode reward: [(0, '6268.270'), (1, '5942.332')] [2023-12-26 07:38:18,818][123091] Updated weights for policy 0, policy_version 1007717 (0.0010) [2023-12-26 07:38:18,885][123091] Updated weights for policy 0, policy_version 1007727 (0.0010) [2023-12-26 07:38:19,073][123090] Updated weights for policy 1, policy_version 1000711 (0.0007) [2023-12-26 07:38:19,144][123090] Updated weights for policy 1, policy_version 1000721 (0.0006) [2023-12-26 07:38:19,223][123090] Updated weights for policy 1, policy_version 1000731 (0.0006) [2023-12-26 07:38:19,754][123091] Updated weights for policy 0, policy_version 1007737 (0.0009) [2023-12-26 07:38:19,814][123091] Updated weights for policy 0, policy_version 1007747 (0.0010) [2023-12-26 07:38:19,887][123091] Updated weights for policy 0, policy_version 1007757 (0.0010) [2023-12-26 07:38:19,888][123090] Updated weights for policy 1, policy_version 1000741 (0.0007) [2023-12-26 07:38:19,955][123090] Updated weights for policy 1, policy_version 1000751 (0.0009) [2023-12-26 07:38:20,007][123090] Updated weights for policy 1, policy_version 1000761 (0.0010) [2023-12-26 07:38:20,591][123091] Updated weights for policy 0, policy_version 1007767 (0.0008) [2023-12-26 07:38:20,660][123091] Updated weights for policy 0, policy_version 1007777 (0.0006) [2023-12-26 07:38:20,730][123091] Updated weights for policy 0, policy_version 1007787 (0.0005) [2023-12-26 07:38:20,831][123090] Updated weights for policy 1, policy_version 1000771 (0.0006) [2023-12-26 07:38:20,900][123090] Updated weights for policy 1, policy_version 1000781 (0.0006) [2023-12-26 07:38:20,965][123090] Updated weights for policy 1, policy_version 1000791 (0.0006) [2023-12-26 07:38:21,440][123091] Updated weights for policy 0, policy_version 1007797 (0.0007) [2023-12-26 07:38:21,514][123091] Updated weights for policy 0, policy_version 1007807 (0.0009) [2023-12-26 07:38:21,582][123091] Updated weights for policy 0, policy_version 1007817 (0.0009) [2023-12-26 07:38:21,737][123090] Updated weights for policy 1, policy_version 1000801 (0.0006) [2023-12-26 07:38:21,800][123090] Updated weights for policy 1, policy_version 1000811 (0.0008) [2023-12-26 07:38:21,863][123090] Updated weights for policy 1, policy_version 1000821 (0.0006) [2023-12-26 07:38:21,934][123090] Updated weights for policy 1, policy_version 1000831 (0.0008) [2023-12-26 07:38:22,389][123091] Updated weights for policy 0, policy_version 1007827 (0.0010) [2023-12-26 07:38:22,450][123091] Updated weights for policy 0, policy_version 1007837 (0.0010) [2023-12-26 07:38:22,511][123091] Updated weights for policy 0, policy_version 1007847 (0.0010) [2023-12-26 07:38:22,747][123090] Updated weights for policy 1, policy_version 1000841 (0.0009) [2023-12-26 07:38:22,818][123090] Updated weights for policy 1, policy_version 1000851 (0.0010) [2023-12-26 07:38:22,888][123090] Updated weights for policy 1, policy_version 1000861 (0.0009) [2023-12-26 07:38:23,350][123091] Updated weights for policy 0, policy_version 1007857 (0.0010) [2023-12-26 07:38:23,399][123091] Updated weights for policy 0, policy_version 1007867 (0.0009) [2023-12-26 07:38:23,467][123091] Updated weights for policy 0, policy_version 1007877 (0.0009) [2023-12-26 07:38:23,532][123091] Updated weights for policy 0, policy_version 1007887 (0.0010) [2023-12-26 07:38:23,697][123090] Updated weights for policy 1, policy_version 1000871 (0.0007) [2023-12-26 07:38:23,757][123090] Updated weights for policy 1, policy_version 1000881 (0.0005) [2023-12-26 07:38:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 514244608. Throughput: 0: 8852.7, 1: 8619.7. Samples: 514224044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:23,785][121949] Avg episode reward: [(0, '6159.854'), (1, '5846.766')] [2023-12-26 07:38:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001007888_258023424.pth... [2023-12-26 07:38:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001006832_257753088.pth [2023-12-26 07:38:23,808][123090] Updated weights for policy 1, policy_version 1000891 (0.0005) [2023-12-26 07:38:23,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001000896_256229376.pth... [2023-12-26 07:38:23,838][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_000999872_255967232.pth [2023-12-26 07:38:24,335][123091] Updated weights for policy 0, policy_version 1007897 (0.0006) [2023-12-26 07:38:24,388][123091] Updated weights for policy 0, policy_version 1007907 (0.0005) [2023-12-26 07:38:24,461][123091] Updated weights for policy 0, policy_version 1007917 (0.0005) [2023-12-26 07:38:24,516][123090] Updated weights for policy 1, policy_version 1000901 (0.0006) [2023-12-26 07:38:24,576][123090] Updated weights for policy 1, policy_version 1000911 (0.0005) [2023-12-26 07:38:24,636][123090] Updated weights for policy 1, policy_version 1000921 (0.0005) [2023-12-26 07:38:25,091][123091] Updated weights for policy 0, policy_version 1007927 (0.0005) [2023-12-26 07:38:25,152][123091] Updated weights for policy 0, policy_version 1007937 (0.0005) [2023-12-26 07:38:25,199][123091] Updated weights for policy 0, policy_version 1007947 (0.0005) [2023-12-26 07:38:25,386][123090] Updated weights for policy 1, policy_version 1000931 (0.0007) [2023-12-26 07:38:25,440][123090] Updated weights for policy 1, policy_version 1000941 (0.0009) [2023-12-26 07:38:25,498][123090] Updated weights for policy 1, policy_version 1000951 (0.0010) [2023-12-26 07:38:25,909][123091] Updated weights for policy 0, policy_version 1007957 (0.0006) [2023-12-26 07:38:25,970][123091] Updated weights for policy 0, policy_version 1007967 (0.0007) [2023-12-26 07:38:26,028][123091] Updated weights for policy 0, policy_version 1007977 (0.0010) [2023-12-26 07:38:26,167][123090] Updated weights for policy 1, policy_version 1000961 (0.0009) [2023-12-26 07:38:26,222][123090] Updated weights for policy 1, policy_version 1000971 (0.0010) [2023-12-26 07:38:26,266][123090] Updated weights for policy 1, policy_version 1000981 (0.0010) [2023-12-26 07:38:26,335][123090] Updated weights for policy 1, policy_version 1000991 (0.0010) [2023-12-26 07:38:26,832][123091] Updated weights for policy 0, policy_version 1007987 (0.0009) [2023-12-26 07:38:26,880][123091] Updated weights for policy 0, policy_version 1007997 (0.0009) [2023-12-26 07:38:26,928][123091] Updated weights for policy 0, policy_version 1008007 (0.0009) [2023-12-26 07:38:27,170][123090] Updated weights for policy 1, policy_version 1001001 (0.0010) [2023-12-26 07:38:27,235][123090] Updated weights for policy 1, policy_version 1001011 (0.0010) [2023-12-26 07:38:27,303][123090] Updated weights for policy 1, policy_version 1001021 (0.0010) [2023-12-26 07:38:27,708][123091] Updated weights for policy 0, policy_version 1008017 (0.0008) [2023-12-26 07:38:27,764][123091] Updated weights for policy 0, policy_version 1008027 (0.0009) [2023-12-26 07:38:27,825][123091] Updated weights for policy 0, policy_version 1008037 (0.0010) [2023-12-26 07:38:27,883][123091] Updated weights for policy 0, policy_version 1008048 (0.0010) [2023-12-26 07:38:27,993][123090] Updated weights for policy 1, policy_version 1001031 (0.0006) [2023-12-26 07:38:28,044][123090] Updated weights for policy 1, policy_version 1001041 (0.0005) [2023-12-26 07:38:28,090][123090] Updated weights for policy 1, policy_version 1001051 (0.0005) [2023-12-26 07:38:28,778][123091] Updated weights for policy 0, policy_version 1008058 (0.0009) [2023-12-26 07:38:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 514334720. Throughput: 0: 8936.4, 1: 8706.2. Samples: 514334552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:28,785][121949] Avg episode reward: [(0, '6130.089'), (1, '5885.375')] [2023-12-26 07:38:28,835][123090] Updated weights for policy 1, policy_version 1001061 (0.0008) [2023-12-26 07:38:28,839][123091] Updated weights for policy 0, policy_version 1008068 (0.0009) [2023-12-26 07:38:28,896][123090] Updated weights for policy 1, policy_version 1001071 (0.0008) [2023-12-26 07:38:28,904][123091] Updated weights for policy 0, policy_version 1008078 (0.0010) [2023-12-26 07:38:28,961][123090] Updated weights for policy 1, policy_version 1001081 (0.0009) [2023-12-26 07:38:29,718][123091] Updated weights for policy 0, policy_version 1008088 (0.0009) [2023-12-26 07:38:29,788][123091] Updated weights for policy 0, policy_version 1008098 (0.0010) [2023-12-26 07:38:29,804][123090] Updated weights for policy 1, policy_version 1001091 (0.0009) [2023-12-26 07:38:29,856][123091] Updated weights for policy 0, policy_version 1008108 (0.0008) [2023-12-26 07:38:29,867][123090] Updated weights for policy 1, policy_version 1001101 (0.0009) [2023-12-26 07:38:29,917][123090] Updated weights for policy 1, policy_version 1001111 (0.0007) [2023-12-26 07:38:30,698][123090] Updated weights for policy 1, policy_version 1001121 (0.0009) [2023-12-26 07:38:30,699][123091] Updated weights for policy 0, policy_version 1008118 (0.0010) [2023-12-26 07:38:30,758][123091] Updated weights for policy 0, policy_version 1008128 (0.0010) [2023-12-26 07:38:30,761][123090] Updated weights for policy 1, policy_version 1001131 (0.0006) [2023-12-26 07:38:30,813][123091] Updated weights for policy 0, policy_version 1008138 (0.0008) [2023-12-26 07:38:30,823][123090] Updated weights for policy 1, policy_version 1001141 (0.0010) [2023-12-26 07:38:30,887][123090] Updated weights for policy 1, policy_version 1001151 (0.0009) [2023-12-26 07:38:31,614][123091] Updated weights for policy 0, policy_version 1008148 (0.0008) [2023-12-26 07:38:31,678][123091] Updated weights for policy 0, policy_version 1008158 (0.0009) [2023-12-26 07:38:31,738][123090] Updated weights for policy 1, policy_version 1001161 (0.0008) [2023-12-26 07:38:31,741][123091] Updated weights for policy 0, policy_version 1008168 (0.0009) [2023-12-26 07:38:31,796][123090] Updated weights for policy 1, policy_version 1001171 (0.0008) [2023-12-26 07:38:31,853][123090] Updated weights for policy 1, policy_version 1001181 (0.0009) [2023-12-26 07:38:32,600][123090] Updated weights for policy 1, policy_version 1001191 (0.0008) [2023-12-26 07:38:32,615][123091] Updated weights for policy 0, policy_version 1008178 (0.0008) [2023-12-26 07:38:32,648][123090] Updated weights for policy 1, policy_version 1001201 (0.0009) [2023-12-26 07:38:32,669][123091] Updated weights for policy 0, policy_version 1008188 (0.0008) [2023-12-26 07:38:32,712][123090] Updated weights for policy 1, policy_version 1001211 (0.0011) [2023-12-26 07:38:32,725][123091] Updated weights for policy 0, policy_version 1008198 (0.0011) [2023-12-26 07:38:32,781][123091] Updated weights for policy 0, policy_version 1008208 (0.0011) [2023-12-26 07:38:33,423][123090] Updated weights for policy 1, policy_version 1001221 (0.0009) [2023-12-26 07:38:33,478][123090] Updated weights for policy 1, policy_version 1001231 (0.0008) [2023-12-26 07:38:33,525][123090] Updated weights for policy 1, policy_version 1001241 (0.0009) [2023-12-26 07:38:33,564][123091] Updated weights for policy 0, policy_version 1008218 (0.0011) [2023-12-26 07:38:33,622][123091] Updated weights for policy 0, policy_version 1008228 (0.0010) [2023-12-26 07:38:33,676][123091] Updated weights for policy 0, policy_version 1008238 (0.0010) [2023-12-26 07:38:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 514433024. Throughput: 0: 8869.9, 1: 8810.2. Samples: 514439780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 07:38:33,785][121949] Avg episode reward: [(0, '6163.052'), (1, '5878.133')] [2023-12-26 07:38:34,328][123090] Updated weights for policy 1, policy_version 1001251 (0.0006) [2023-12-26 07:38:34,389][123090] Updated weights for policy 1, policy_version 1001261 (0.0008) [2023-12-26 07:38:34,451][123090] Updated weights for policy 1, policy_version 1001271 (0.0008) [2023-12-26 07:38:34,479][123091] Updated weights for policy 0, policy_version 1008248 (0.0010) [2023-12-26 07:38:34,539][123091] Updated weights for policy 0, policy_version 1008258 (0.0011) [2023-12-26 07:38:34,602][123091] Updated weights for policy 0, policy_version 1008268 (0.0011) [2023-12-26 07:38:35,239][123090] Updated weights for policy 1, policy_version 1001281 (0.0008) [2023-12-26 07:38:35,294][123090] Updated weights for policy 1, policy_version 1001291 (0.0008) [2023-12-26 07:38:35,349][123090] Updated weights for policy 1, policy_version 1001301 (0.0008) [2023-12-26 07:38:35,404][123090] Updated weights for policy 1, policy_version 1001311 (0.0008) [2023-12-26 07:38:35,410][123091] Updated weights for policy 0, policy_version 1008278 (0.0011) [2023-12-26 07:38:35,462][123091] Updated weights for policy 0, policy_version 1008288 (0.0010) [2023-12-26 07:38:35,512][123091] Updated weights for policy 0, policy_version 1008298 (0.0010) [2023-12-26 07:38:36,312][123090] Updated weights for policy 1, policy_version 1001321 (0.0009) [2023-12-26 07:38:36,332][123091] Updated weights for policy 0, policy_version 1008308 (0.0010) [2023-12-26 07:38:36,376][123090] Updated weights for policy 1, policy_version 1001331 (0.0006) [2023-12-26 07:38:36,398][123091] Updated weights for policy 0, policy_version 1008318 (0.0008) [2023-12-26 07:38:36,441][123090] Updated weights for policy 1, policy_version 1001341 (0.0007) [2023-12-26 07:38:36,462][123091] Updated weights for policy 0, policy_version 1008328 (0.0008) [2023-12-26 07:38:37,162][123091] Updated weights for policy 0, policy_version 1008338 (0.0008) [2023-12-26 07:38:37,193][123090] Updated weights for policy 1, policy_version 1001351 (0.0010) [2023-12-26 07:38:37,226][123091] Updated weights for policy 0, policy_version 1008348 (0.0007) [2023-12-26 07:38:37,266][123090] Updated weights for policy 1, policy_version 1001361 (0.0010) [2023-12-26 07:38:37,287][123091] Updated weights for policy 0, policy_version 1008358 (0.0009) [2023-12-26 07:38:37,316][123090] Updated weights for policy 1, policy_version 1001371 (0.0006) [2023-12-26 07:38:37,340][123091] Updated weights for policy 0, policy_version 1008368 (0.0011) [2023-12-26 07:38:38,185][123090] Updated weights for policy 1, policy_version 1001381 (0.0007) [2023-12-26 07:38:38,197][123091] Updated weights for policy 0, policy_version 1008378 (0.0010) [2023-12-26 07:38:38,243][123090] Updated weights for policy 1, policy_version 1001391 (0.0007) [2023-12-26 07:38:38,260][123091] Updated weights for policy 0, policy_version 1008388 (0.0010) [2023-12-26 07:38:38,302][123090] Updated weights for policy 1, policy_version 1001401 (0.0007) [2023-12-26 07:38:38,313][123091] Updated weights for policy 0, policy_version 1008398 (0.0011) [2023-12-26 07:38:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 514514944. Throughput: 0: 8891.4, 1: 8795.5. Samples: 514491828. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:38:38,785][121949] Avg episode reward: [(0, '6107.631'), (1, '5867.245')] [2023-12-26 07:38:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001008400_258154496.pth... [2023-12-26 07:38:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001001408_256360448.pth... [2023-12-26 07:38:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001007376_257892352.pth [2023-12-26 07:38:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001000384_256098304.pth [2023-12-26 07:38:39,147][123091] Updated weights for policy 0, policy_version 1008408 (0.0011) [2023-12-26 07:38:39,149][123090] Updated weights for policy 1, policy_version 1001411 (0.0007) [2023-12-26 07:38:39,198][123091] Updated weights for policy 0, policy_version 1008418 (0.0010) [2023-12-26 07:38:39,201][123090] Updated weights for policy 1, policy_version 1001421 (0.0005) [2023-12-26 07:38:39,263][123091] Updated weights for policy 0, policy_version 1008428 (0.0011) [2023-12-26 07:38:39,269][123090] Updated weights for policy 1, policy_version 1001431 (0.0008) [2023-12-26 07:38:40,143][123091] Updated weights for policy 0, policy_version 1008438 (0.0010) [2023-12-26 07:38:40,183][123090] Updated weights for policy 1, policy_version 1001441 (0.0008) [2023-12-26 07:38:40,200][123091] Updated weights for policy 0, policy_version 1008448 (0.0009) [2023-12-26 07:38:40,246][123090] Updated weights for policy 1, policy_version 1001451 (0.0008) [2023-12-26 07:38:40,261][123091] Updated weights for policy 0, policy_version 1008458 (0.0009) [2023-12-26 07:38:40,310][123090] Updated weights for policy 1, policy_version 1001461 (0.0007) [2023-12-26 07:38:40,374][123090] Updated weights for policy 1, policy_version 1001471 (0.0009) [2023-12-26 07:38:41,121][123091] Updated weights for policy 0, policy_version 1008468 (0.0010) [2023-12-26 07:38:41,185][123091] Updated weights for policy 0, policy_version 1008478 (0.0007) [2023-12-26 07:38:41,208][123090] Updated weights for policy 1, policy_version 1001481 (0.0008) [2023-12-26 07:38:41,253][123091] Updated weights for policy 0, policy_version 1008488 (0.0007) [2023-12-26 07:38:41,279][123090] Updated weights for policy 1, policy_version 1001491 (0.0008) [2023-12-26 07:38:41,350][123090] Updated weights for policy 1, policy_version 1001501 (0.0008) [2023-12-26 07:38:42,082][123091] Updated weights for policy 0, policy_version 1008498 (0.0007) [2023-12-26 07:38:42,146][123091] Updated weights for policy 0, policy_version 1008508 (0.0009) [2023-12-26 07:38:42,170][123090] Updated weights for policy 1, policy_version 1001511 (0.0010) [2023-12-26 07:38:42,199][123091] Updated weights for policy 0, policy_version 1008518 (0.0008) [2023-12-26 07:38:42,221][123090] Updated weights for policy 1, policy_version 1001521 (0.0010) [2023-12-26 07:38:42,261][123091] Updated weights for policy 0, policy_version 1008528 (0.0008) [2023-12-26 07:38:42,285][123090] Updated weights for policy 1, policy_version 1001531 (0.0009) [2023-12-26 07:38:43,009][123091] Updated weights for policy 0, policy_version 1008538 (0.0010) [2023-12-26 07:38:43,069][123091] Updated weights for policy 0, policy_version 1008548 (0.0008) [2023-12-26 07:38:43,127][123091] Updated weights for policy 0, policy_version 1008558 (0.0006) [2023-12-26 07:38:43,153][123090] Updated weights for policy 1, policy_version 1001541 (0.0010) [2023-12-26 07:38:43,219][123090] Updated weights for policy 1, policy_version 1001551 (0.0010) [2023-12-26 07:38:43,286][123090] Updated weights for policy 1, policy_version 1001561 (0.0010) [2023-12-26 07:38:43,698][123091] Updated weights for policy 0, policy_version 1008568 (0.0006) [2023-12-26 07:38:43,771][123091] Updated weights for policy 0, policy_version 1008578 (0.0005) [2023-12-26 07:38:43,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 514596864. Throughput: 0: 8824.2, 1: 8694.0. Samples: 514593308. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:38:43,785][121949] Avg episode reward: [(0, '6256.527'), (1, '5790.686')] [2023-12-26 07:38:43,844][123091] Updated weights for policy 0, policy_version 1008588 (0.0006) [2023-12-26 07:38:44,089][123090] Updated weights for policy 1, policy_version 1001571 (0.0011) [2023-12-26 07:38:44,141][123090] Updated weights for policy 1, policy_version 1001581 (0.0010) [2023-12-26 07:38:44,205][123090] Updated weights for policy 1, policy_version 1001591 (0.0010) [2023-12-26 07:38:44,470][123091] Updated weights for policy 0, policy_version 1008598 (0.0008) [2023-12-26 07:38:44,520][123091] Updated weights for policy 0, policy_version 1008608 (0.0010) [2023-12-26 07:38:44,581][123091] Updated weights for policy 0, policy_version 1008618 (0.0007) [2023-12-26 07:38:44,798][123090] Updated weights for policy 1, policy_version 1001601 (0.0008) [2023-12-26 07:38:44,859][123090] Updated weights for policy 1, policy_version 1001611 (0.0010) [2023-12-26 07:38:44,919][123090] Updated weights for policy 1, policy_version 1001621 (0.0008) [2023-12-26 07:38:44,983][123090] Updated weights for policy 1, policy_version 1001631 (0.0008) [2023-12-26 07:38:45,347][123091] Updated weights for policy 0, policy_version 1008628 (0.0006) [2023-12-26 07:38:45,398][123091] Updated weights for policy 0, policy_version 1008638 (0.0006) [2023-12-26 07:38:45,451][123091] Updated weights for policy 0, policy_version 1008648 (0.0006) [2023-12-26 07:38:45,776][123090] Updated weights for policy 1, policy_version 1001641 (0.0009) [2023-12-26 07:38:45,840][123090] Updated weights for policy 1, policy_version 1001651 (0.0008) [2023-12-26 07:38:45,908][123090] Updated weights for policy 1, policy_version 1001661 (0.0005) [2023-12-26 07:38:46,145][123091] Updated weights for policy 0, policy_version 1008658 (0.0007) [2023-12-26 07:38:46,208][123091] Updated weights for policy 0, policy_version 1008668 (0.0011) [2023-12-26 07:38:46,265][123091] Updated weights for policy 0, policy_version 1008678 (0.0010) [2023-12-26 07:38:46,313][123091] Updated weights for policy 0, policy_version 1008688 (0.0005) [2023-12-26 07:38:46,661][123090] Updated weights for policy 1, policy_version 1001671 (0.0007) [2023-12-26 07:38:46,711][123090] Updated weights for policy 1, policy_version 1001681 (0.0009) [2023-12-26 07:38:46,760][123090] Updated weights for policy 1, policy_version 1001691 (0.0009) [2023-12-26 07:38:47,019][123091] Updated weights for policy 0, policy_version 1008698 (0.0005) [2023-12-26 07:38:47,079][123091] Updated weights for policy 0, policy_version 1008708 (0.0005) [2023-12-26 07:38:47,145][123091] Updated weights for policy 0, policy_version 1008718 (0.0006) [2023-12-26 07:38:47,529][123090] Updated weights for policy 1, policy_version 1001701 (0.0010) [2023-12-26 07:38:47,584][123090] Updated weights for policy 1, policy_version 1001711 (0.0010) [2023-12-26 07:38:47,636][123090] Updated weights for policy 1, policy_version 1001721 (0.0009) [2023-12-26 07:38:47,815][123091] Updated weights for policy 0, policy_version 1008728 (0.0010) [2023-12-26 07:38:47,866][123091] Updated weights for policy 0, policy_version 1008738 (0.0010) [2023-12-26 07:38:47,914][123091] Updated weights for policy 0, policy_version 1008748 (0.0010) [2023-12-26 07:38:48,543][123090] Updated weights for policy 1, policy_version 1001731 (0.0008) [2023-12-26 07:38:48,609][123090] Updated weights for policy 1, policy_version 1001741 (0.0009) [2023-12-26 07:38:48,679][123090] Updated weights for policy 1, policy_version 1001751 (0.0009) [2023-12-26 07:38:48,707][123091] Updated weights for policy 0, policy_version 1008758 (0.0010) [2023-12-26 07:38:48,773][123091] Updated weights for policy 0, policy_version 1008768 (0.0010) [2023-12-26 07:38:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 514695168. Throughput: 0: 9011.0, 1: 8710.9. Samples: 514706564. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:38:48,785][121949] Avg episode reward: [(0, '6290.727'), (1, '5768.368')] [2023-12-26 07:38:48,839][123091] Updated weights for policy 0, policy_version 1008778 (0.0011) [2023-12-26 07:38:49,501][123090] Updated weights for policy 1, policy_version 1001761 (0.0007) [2023-12-26 07:38:49,575][123090] Updated weights for policy 1, policy_version 1001771 (0.0010) [2023-12-26 07:38:49,581][123091] Updated weights for policy 0, policy_version 1008788 (0.0010) [2023-12-26 07:38:49,638][123090] Updated weights for policy 1, policy_version 1001781 (0.0011) [2023-12-26 07:38:49,641][123091] Updated weights for policy 0, policy_version 1008798 (0.0006) [2023-12-26 07:38:49,704][123090] Updated weights for policy 1, policy_version 1001791 (0.0010) [2023-12-26 07:38:49,711][123091] Updated weights for policy 0, policy_version 1008808 (0.0005) [2023-12-26 07:38:50,470][123091] Updated weights for policy 0, policy_version 1008818 (0.0008) [2023-12-26 07:38:50,476][123090] Updated weights for policy 1, policy_version 1001801 (0.0006) [2023-12-26 07:38:50,525][123090] Updated weights for policy 1, policy_version 1001811 (0.0007) [2023-12-26 07:38:50,538][123091] Updated weights for policy 0, policy_version 1008828 (0.0009) [2023-12-26 07:38:50,587][123090] Updated weights for policy 1, policy_version 1001821 (0.0007) [2023-12-26 07:38:50,608][123091] Updated weights for policy 0, policy_version 1008838 (0.0009) [2023-12-26 07:38:50,664][123091] Updated weights for policy 0, policy_version 1008848 (0.0009) [2023-12-26 07:38:51,338][123090] Updated weights for policy 1, policy_version 1001831 (0.0008) [2023-12-26 07:38:51,412][123090] Updated weights for policy 1, policy_version 1001841 (0.0008) [2023-12-26 07:38:51,471][123090] Updated weights for policy 1, policy_version 1001851 (0.0005) [2023-12-26 07:38:51,533][123091] Updated weights for policy 0, policy_version 1008858 (0.0006) [2023-12-26 07:38:51,589][123091] Updated weights for policy 0, policy_version 1008868 (0.0006) [2023-12-26 07:38:51,656][123091] Updated weights for policy 0, policy_version 1008878 (0.0008) [2023-12-26 07:38:52,311][123090] Updated weights for policy 1, policy_version 1001861 (0.0007) [2023-12-26 07:38:52,372][123091] Updated weights for policy 0, policy_version 1008888 (0.0009) [2023-12-26 07:38:52,378][123090] Updated weights for policy 1, policy_version 1001871 (0.0008) [2023-12-26 07:38:52,442][123090] Updated weights for policy 1, policy_version 1001881 (0.0006) [2023-12-26 07:38:52,443][123091] Updated weights for policy 0, policy_version 1008898 (0.0011) [2023-12-26 07:38:52,512][123091] Updated weights for policy 0, policy_version 1008908 (0.0010) [2023-12-26 07:38:53,250][123091] Updated weights for policy 0, policy_version 1008918 (0.0007) [2023-12-26 07:38:53,261][123090] Updated weights for policy 1, policy_version 1001891 (0.0006) [2023-12-26 07:38:53,311][123091] Updated weights for policy 0, policy_version 1008928 (0.0005) [2023-12-26 07:38:53,328][123090] Updated weights for policy 1, policy_version 1001901 (0.0006) [2023-12-26 07:38:53,377][123091] Updated weights for policy 0, policy_version 1008938 (0.0005) [2023-12-26 07:38:53,377][123090] Updated weights for policy 1, policy_version 1001911 (0.0005) [2023-12-26 07:38:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 514785280. Throughput: 0: 9024.8, 1: 8698.6. Samples: 514760264. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:38:53,785][121949] Avg episode reward: [(0, '6305.632'), (1, '5873.032')] [2023-12-26 07:38:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001008944_258293760.pth... [2023-12-26 07:38:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001001920_256491520.pth... [2023-12-26 07:38:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001007888_258023424.pth [2023-12-26 07:38:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001000896_256229376.pth [2023-12-26 07:38:53,966][123091] Updated weights for policy 0, policy_version 1008948 (0.0005) [2023-12-26 07:38:54,034][123090] Updated weights for policy 1, policy_version 1001921 (0.0005) [2023-12-26 07:38:54,038][123091] Updated weights for policy 0, policy_version 1008958 (0.0005) [2023-12-26 07:38:54,085][123090] Updated weights for policy 1, policy_version 1001931 (0.0008) [2023-12-26 07:38:54,087][123091] Updated weights for policy 0, policy_version 1008968 (0.0005) [2023-12-26 07:38:54,134][123090] Updated weights for policy 1, policy_version 1001941 (0.0009) [2023-12-26 07:38:54,189][123090] Updated weights for policy 1, policy_version 1001951 (0.0010) [2023-12-26 07:38:54,773][123091] Updated weights for policy 0, policy_version 1008978 (0.0006) [2023-12-26 07:38:54,828][123091] Updated weights for policy 0, policy_version 1008988 (0.0009) [2023-12-26 07:38:54,871][123091] Updated weights for policy 0, policy_version 1008998 (0.0007) [2023-12-26 07:38:54,920][123091] Updated weights for policy 0, policy_version 1009008 (0.0008) [2023-12-26 07:38:55,110][123090] Updated weights for policy 1, policy_version 1001961 (0.0006) [2023-12-26 07:38:55,166][123090] Updated weights for policy 1, policy_version 1001971 (0.0005) [2023-12-26 07:38:55,238][123090] Updated weights for policy 1, policy_version 1001981 (0.0005) [2023-12-26 07:38:55,672][123091] Updated weights for policy 0, policy_version 1009018 (0.0006) [2023-12-26 07:38:55,727][123091] Updated weights for policy 0, policy_version 1009028 (0.0010) [2023-12-26 07:38:55,781][123091] Updated weights for policy 0, policy_version 1009038 (0.0010) [2023-12-26 07:38:55,873][123090] Updated weights for policy 1, policy_version 1001991 (0.0005) [2023-12-26 07:38:55,931][123090] Updated weights for policy 1, policy_version 1002001 (0.0005) [2023-12-26 07:38:55,978][123090] Updated weights for policy 1, policy_version 1002011 (0.0005) [2023-12-26 07:38:56,507][123091] Updated weights for policy 0, policy_version 1009048 (0.0006) [2023-12-26 07:38:56,569][123091] Updated weights for policy 0, policy_version 1009058 (0.0005) [2023-12-26 07:38:56,625][123091] Updated weights for policy 0, policy_version 1009068 (0.0010) [2023-12-26 07:38:56,705][123090] Updated weights for policy 1, policy_version 1002021 (0.0008) [2023-12-26 07:38:56,763][123090] Updated weights for policy 1, policy_version 1002031 (0.0010) [2023-12-26 07:38:56,816][123090] Updated weights for policy 1, policy_version 1002041 (0.0010) [2023-12-26 07:38:57,261][123091] Updated weights for policy 0, policy_version 1009078 (0.0007) [2023-12-26 07:38:57,321][123091] Updated weights for policy 0, policy_version 1009088 (0.0008) [2023-12-26 07:38:57,369][123091] Updated weights for policy 0, policy_version 1009098 (0.0010) [2023-12-26 07:38:57,715][123090] Updated weights for policy 1, policy_version 1002051 (0.0009) [2023-12-26 07:38:57,762][123090] Updated weights for policy 1, policy_version 1002061 (0.0008) [2023-12-26 07:38:57,810][123090] Updated weights for policy 1, policy_version 1002071 (0.0009) [2023-12-26 07:38:58,142][123091] Updated weights for policy 0, policy_version 1009108 (0.0009) [2023-12-26 07:38:58,212][123091] Updated weights for policy 0, policy_version 1009118 (0.0008) [2023-12-26 07:38:58,274][123091] Updated weights for policy 0, policy_version 1009128 (0.0007) [2023-12-26 07:38:58,762][123090] Updated weights for policy 1, policy_version 1002081 (0.0010) [2023-12-26 07:38:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 514875392. Throughput: 0: 9157.4, 1: 8817.4. Samples: 514873456. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:38:58,785][121949] Avg episode reward: [(0, '6327.488'), (1, '6008.696')] [2023-12-26 07:38:58,829][123090] Updated weights for policy 1, policy_version 1002091 (0.0008) [2023-12-26 07:38:58,894][123090] Updated weights for policy 1, policy_version 1002101 (0.0008) [2023-12-26 07:38:58,963][123090] Updated weights for policy 1, policy_version 1002111 (0.0008) [2023-12-26 07:38:59,130][123091] Updated weights for policy 0, policy_version 1009138 (0.0009) [2023-12-26 07:38:59,195][123091] Updated weights for policy 0, policy_version 1009148 (0.0010) [2023-12-26 07:38:59,269][123091] Updated weights for policy 0, policy_version 1009158 (0.0009) [2023-12-26 07:38:59,361][123091] Updated weights for policy 0, policy_version 1009168 (0.0009) [2023-12-26 07:38:59,779][123090] Updated weights for policy 1, policy_version 1002121 (0.0006) [2023-12-26 07:38:59,848][123090] Updated weights for policy 1, policy_version 1002131 (0.0008) [2023-12-26 07:38:59,908][123090] Updated weights for policy 1, policy_version 1002141 (0.0010) [2023-12-26 07:39:00,227][123091] Updated weights for policy 0, policy_version 1009178 (0.0009) [2023-12-26 07:39:00,284][123091] Updated weights for policy 0, policy_version 1009188 (0.0005) [2023-12-26 07:39:00,359][123091] Updated weights for policy 0, policy_version 1009198 (0.0005) [2023-12-26 07:39:00,626][123090] Updated weights for policy 1, policy_version 1002151 (0.0007) [2023-12-26 07:39:00,684][123090] Updated weights for policy 1, policy_version 1002161 (0.0005) [2023-12-26 07:39:00,751][123090] Updated weights for policy 1, policy_version 1002171 (0.0005) [2023-12-26 07:39:01,086][123091] Updated weights for policy 0, policy_version 1009208 (0.0008) [2023-12-26 07:39:01,142][123091] Updated weights for policy 0, policy_version 1009218 (0.0009) [2023-12-26 07:39:01,206][123091] Updated weights for policy 0, policy_version 1009228 (0.0009) [2023-12-26 07:39:01,539][123090] Updated weights for policy 1, policy_version 1002181 (0.0008) [2023-12-26 07:39:01,604][123090] Updated weights for policy 1, policy_version 1002192 (0.0010) [2023-12-26 07:39:01,674][123090] Updated weights for policy 1, policy_version 1002202 (0.0009) [2023-12-26 07:39:01,955][123091] Updated weights for policy 0, policy_version 1009238 (0.0008) [2023-12-26 07:39:02,003][123091] Updated weights for policy 0, policy_version 1009248 (0.0008) [2023-12-26 07:39:02,057][123091] Updated weights for policy 0, policy_version 1009258 (0.0008) [2023-12-26 07:39:02,404][123090] Updated weights for policy 1, policy_version 1002212 (0.0008) [2023-12-26 07:39:02,467][123090] Updated weights for policy 1, policy_version 1002222 (0.0009) [2023-12-26 07:39:02,516][123090] Updated weights for policy 1, policy_version 1002232 (0.0008) [2023-12-26 07:39:02,848][123091] Updated weights for policy 0, policy_version 1009268 (0.0007) [2023-12-26 07:39:02,911][123091] Updated weights for policy 0, policy_version 1009278 (0.0006) [2023-12-26 07:39:02,967][123091] Updated weights for policy 0, policy_version 1009288 (0.0006) [2023-12-26 07:39:03,374][123090] Updated weights for policy 1, policy_version 1002242 (0.0010) [2023-12-26 07:39:03,441][123090] Updated weights for policy 1, policy_version 1002252 (0.0010) [2023-12-26 07:39:03,511][123090] Updated weights for policy 1, policy_version 1002262 (0.0009) [2023-12-26 07:39:03,577][123090] Updated weights for policy 1, policy_version 1002272 (0.0010) [2023-12-26 07:39:03,633][123091] Updated weights for policy 0, policy_version 1009298 (0.0006) [2023-12-26 07:39:03,686][123091] Updated weights for policy 0, policy_version 1009308 (0.0006) [2023-12-26 07:39:03,754][123091] Updated weights for policy 0, policy_version 1009318 (0.0009) [2023-12-26 07:39:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 514965504. Throughput: 0: 9106.2, 1: 8861.6. Samples: 514978860. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:03,785][121949] Avg episode reward: [(0, '6265.926'), (1, '6041.373')] [2023-12-26 07:39:03,816][123091] Updated weights for policy 0, policy_version 1009328 (0.0010) [2023-12-26 07:39:04,427][123090] Updated weights for policy 1, policy_version 1002282 (0.0009) [2023-12-26 07:39:04,480][123090] Updated weights for policy 1, policy_version 1002292 (0.0009) [2023-12-26 07:39:04,534][123090] Updated weights for policy 1, policy_version 1002302 (0.0009) [2023-12-26 07:39:04,644][123091] Updated weights for policy 0, policy_version 1009338 (0.0010) [2023-12-26 07:39:04,690][123091] Updated weights for policy 0, policy_version 1009348 (0.0008) [2023-12-26 07:39:04,743][123091] Updated weights for policy 0, policy_version 1009358 (0.0009) [2023-12-26 07:39:05,426][123090] Updated weights for policy 1, policy_version 1002312 (0.0010) [2023-12-26 07:39:05,438][123091] Updated weights for policy 0, policy_version 1009368 (0.0006) [2023-12-26 07:39:05,487][123090] Updated weights for policy 1, policy_version 1002322 (0.0008) [2023-12-26 07:39:05,494][123091] Updated weights for policy 0, policy_version 1009378 (0.0008) [2023-12-26 07:39:05,546][123090] Updated weights for policy 1, policy_version 1002332 (0.0009) [2023-12-26 07:39:05,550][123091] Updated weights for policy 0, policy_version 1009388 (0.0006) [2023-12-26 07:39:06,258][123091] Updated weights for policy 0, policy_version 1009398 (0.0007) [2023-12-26 07:39:06,320][123091] Updated weights for policy 0, policy_version 1009408 (0.0008) [2023-12-26 07:39:06,384][123091] Updated weights for policy 0, policy_version 1009418 (0.0006) [2023-12-26 07:39:06,395][123090] Updated weights for policy 1, policy_version 1002342 (0.0007) [2023-12-26 07:39:06,453][123090] Updated weights for policy 1, policy_version 1002352 (0.0006) [2023-12-26 07:39:06,510][123090] Updated weights for policy 1, policy_version 1002362 (0.0005) [2023-12-26 07:39:07,051][123091] Updated weights for policy 0, policy_version 1009428 (0.0006) [2023-12-26 07:39:07,109][123091] Updated weights for policy 0, policy_version 1009438 (0.0006) [2023-12-26 07:39:07,162][123091] Updated weights for policy 0, policy_version 1009448 (0.0006) [2023-12-26 07:39:07,215][123090] Updated weights for policy 1, policy_version 1002372 (0.0006) [2023-12-26 07:39:07,284][123090] Updated weights for policy 1, policy_version 1002382 (0.0009) [2023-12-26 07:39:07,340][123090] Updated weights for policy 1, policy_version 1002392 (0.0009) [2023-12-26 07:39:07,803][123091] Updated weights for policy 0, policy_version 1009458 (0.0009) [2023-12-26 07:39:07,855][123091] Updated weights for policy 0, policy_version 1009468 (0.0005) [2023-12-26 07:39:07,909][123091] Updated weights for policy 0, policy_version 1009478 (0.0007) [2023-12-26 07:39:07,959][123091] Updated weights for policy 0, policy_version 1009488 (0.0009) [2023-12-26 07:39:08,205][123090] Updated weights for policy 1, policy_version 1002402 (0.0008) [2023-12-26 07:39:08,278][123090] Updated weights for policy 1, policy_version 1002412 (0.0006) [2023-12-26 07:39:08,344][123090] Updated weights for policy 1, policy_version 1002422 (0.0007) [2023-12-26 07:39:08,411][123090] Updated weights for policy 1, policy_version 1002432 (0.0009) [2023-12-26 07:39:08,769][123091] Updated weights for policy 0, policy_version 1009499 (0.0009) [2023-12-26 07:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 515055616. Throughput: 0: 9160.2, 1: 8814.6. Samples: 515032912. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:08,785][121949] Avg episode reward: [(0, '6218.771'), (1, '5976.243')] [2023-12-26 07:39:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001002432_256622592.pth... [2023-12-26 07:39:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001001408_256360448.pth [2023-12-26 07:39:08,832][123091] Updated weights for policy 0, policy_version 1009510 (0.0011) [2023-12-26 07:39:08,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001009520_258441216.pth... [2023-12-26 07:39:08,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001008400_258154496.pth [2023-12-26 07:39:09,202][123090] Updated weights for policy 1, policy_version 1002442 (0.0009) [2023-12-26 07:39:09,276][123090] Updated weights for policy 1, policy_version 1002452 (0.0009) [2023-12-26 07:39:09,354][123090] Updated weights for policy 1, policy_version 1002464 (0.0010) [2023-12-26 07:39:09,685][123091] Updated weights for policy 0, policy_version 1009521 (0.0010) [2023-12-26 07:39:09,742][123091] Updated weights for policy 0, policy_version 1009531 (0.0009) [2023-12-26 07:39:09,806][123091] Updated weights for policy 0, policy_version 1009541 (0.0007) [2023-12-26 07:39:09,877][123091] Updated weights for policy 0, policy_version 1009551 (0.0010) [2023-12-26 07:39:10,199][123090] Updated weights for policy 1, policy_version 1002474 (0.0008) [2023-12-26 07:39:10,266][123090] Updated weights for policy 1, policy_version 1002484 (0.0009) [2023-12-26 07:39:10,338][123090] Updated weights for policy 1, policy_version 1002494 (0.0009) [2023-12-26 07:39:10,616][123091] Updated weights for policy 0, policy_version 1009561 (0.0006) [2023-12-26 07:39:10,687][123091] Updated weights for policy 0, policy_version 1009571 (0.0009) [2023-12-26 07:39:10,745][123091] Updated weights for policy 0, policy_version 1009581 (0.0008) [2023-12-26 07:39:11,191][123090] Updated weights for policy 1, policy_version 1002504 (0.0008) [2023-12-26 07:39:11,265][123090] Updated weights for policy 1, policy_version 1002514 (0.0009) [2023-12-26 07:39:11,333][123090] Updated weights for policy 1, policy_version 1002524 (0.0017) [2023-12-26 07:39:11,544][123091] Updated weights for policy 0, policy_version 1009591 (0.0008) [2023-12-26 07:39:11,618][123091] Updated weights for policy 0, policy_version 1009601 (0.0009) [2023-12-26 07:39:11,682][123091] Updated weights for policy 0, policy_version 1009611 (0.0010) [2023-12-26 07:39:12,167][123090] Updated weights for policy 1, policy_version 1002534 (0.0009) [2023-12-26 07:39:12,235][123090] Updated weights for policy 1, policy_version 1002544 (0.0010) [2023-12-26 07:39:12,303][123090] Updated weights for policy 1, policy_version 1002554 (0.0009) [2023-12-26 07:39:12,486][123091] Updated weights for policy 0, policy_version 1009621 (0.0009) [2023-12-26 07:39:12,544][123091] Updated weights for policy 0, policy_version 1009631 (0.0008) [2023-12-26 07:39:12,607][123091] Updated weights for policy 0, policy_version 1009641 (0.0008) [2023-12-26 07:39:13,116][123090] Updated weights for policy 1, policy_version 1002564 (0.0009) [2023-12-26 07:39:13,163][123090] Updated weights for policy 1, policy_version 1002574 (0.0008) [2023-12-26 07:39:13,209][123090] Updated weights for policy 1, policy_version 1002584 (0.0010) [2023-12-26 07:39:13,433][123091] Updated weights for policy 0, policy_version 1009651 (0.0009) [2023-12-26 07:39:13,487][123091] Updated weights for policy 0, policy_version 1009661 (0.0008) [2023-12-26 07:39:13,551][123091] Updated weights for policy 0, policy_version 1009671 (0.0005) [2023-12-26 07:39:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 515145728. Throughput: 0: 9120.3, 1: 8733.2. Samples: 515137960. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:13,785][121949] Avg episode reward: [(0, '6175.374'), (1, '5955.407')] [2023-12-26 07:39:14,017][123090] Updated weights for policy 1, policy_version 1002594 (0.0010) [2023-12-26 07:39:14,069][123090] Updated weights for policy 1, policy_version 1002604 (0.0010) [2023-12-26 07:39:14,127][123090] Updated weights for policy 1, policy_version 1002614 (0.0010) [2023-12-26 07:39:14,196][123090] Updated weights for policy 1, policy_version 1002624 (0.0010) [2023-12-26 07:39:14,250][123091] Updated weights for policy 0, policy_version 1009681 (0.0006) [2023-12-26 07:39:14,307][123091] Updated weights for policy 0, policy_version 1009691 (0.0006) [2023-12-26 07:39:14,361][123091] Updated weights for policy 0, policy_version 1009701 (0.0006) [2023-12-26 07:39:14,422][123091] Updated weights for policy 0, policy_version 1009711 (0.0006) [2023-12-26 07:39:14,826][123090] Updated weights for policy 1, policy_version 1002634 (0.0007) [2023-12-26 07:39:14,875][123090] Updated weights for policy 1, policy_version 1002644 (0.0005) [2023-12-26 07:39:14,937][123090] Updated weights for policy 1, policy_version 1002654 (0.0006) [2023-12-26 07:39:15,213][123091] Updated weights for policy 0, policy_version 1009721 (0.0010) [2023-12-26 07:39:15,273][123091] Updated weights for policy 0, policy_version 1009731 (0.0011) [2023-12-26 07:39:15,325][123091] Updated weights for policy 0, policy_version 1009741 (0.0011) [2023-12-26 07:39:15,764][123090] Updated weights for policy 1, policy_version 1002664 (0.0010) [2023-12-26 07:39:15,830][123090] Updated weights for policy 1, policy_version 1002674 (0.0010) [2023-12-26 07:39:15,896][123090] Updated weights for policy 1, policy_version 1002684 (0.0010) [2023-12-26 07:39:16,164][123091] Updated weights for policy 0, policy_version 1009751 (0.0011) [2023-12-26 07:39:16,234][123091] Updated weights for policy 0, policy_version 1009761 (0.0006) [2023-12-26 07:39:16,308][123091] Updated weights for policy 0, policy_version 1009771 (0.0005) [2023-12-26 07:39:16,697][123090] Updated weights for policy 1, policy_version 1002694 (0.0010) [2023-12-26 07:39:16,764][123090] Updated weights for policy 1, policy_version 1002704 (0.0005) [2023-12-26 07:39:16,826][123090] Updated weights for policy 1, policy_version 1002714 (0.0005) [2023-12-26 07:39:16,913][123091] Updated weights for policy 0, policy_version 1009781 (0.0005) [2023-12-26 07:39:16,967][123091] Updated weights for policy 0, policy_version 1009791 (0.0006) [2023-12-26 07:39:17,028][123091] Updated weights for policy 0, policy_version 1009801 (0.0005) [2023-12-26 07:39:17,442][123090] Updated weights for policy 1, policy_version 1002724 (0.0005) [2023-12-26 07:39:17,493][123090] Updated weights for policy 1, policy_version 1002734 (0.0005) [2023-12-26 07:39:17,541][123090] Updated weights for policy 1, policy_version 1002744 (0.0005) [2023-12-26 07:39:17,679][123091] Updated weights for policy 0, policy_version 1009811 (0.0007) [2023-12-26 07:39:17,731][123091] Updated weights for policy 0, policy_version 1009821 (0.0010) [2023-12-26 07:39:17,782][123091] Updated weights for policy 0, policy_version 1009831 (0.0010) [2023-12-26 07:39:18,291][123090] Updated weights for policy 1, policy_version 1002754 (0.0006) [2023-12-26 07:39:18,362][123090] Updated weights for policy 1, policy_version 1002764 (0.0009) [2023-12-26 07:39:18,425][123090] Updated weights for policy 1, policy_version 1002774 (0.0009) [2023-12-26 07:39:18,479][123090] Updated weights for policy 1, policy_version 1002784 (0.0009) [2023-12-26 07:39:18,659][123091] Updated weights for policy 0, policy_version 1009841 (0.0010) [2023-12-26 07:39:18,718][123091] Updated weights for policy 0, policy_version 1009851 (0.0010) [2023-12-26 07:39:18,777][123091] Updated weights for policy 0, policy_version 1009861 (0.0010) [2023-12-26 07:39:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 515235840. Throughput: 0: 9234.6, 1: 8764.8. Samples: 515249760. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:18,786][121949] Avg episode reward: [(0, '6299.445'), (1, '6001.571')] [2023-12-26 07:39:18,841][123091] Updated weights for policy 0, policy_version 1009871 (0.0011) [2023-12-26 07:39:19,332][123090] Updated weights for policy 1, policy_version 1002794 (0.0009) [2023-12-26 07:39:19,403][123090] Updated weights for policy 1, policy_version 1002804 (0.0009) [2023-12-26 07:39:19,464][123090] Updated weights for policy 1, policy_version 1002814 (0.0009) [2023-12-26 07:39:19,681][123091] Updated weights for policy 0, policy_version 1009881 (0.0011) [2023-12-26 07:39:19,744][123091] Updated weights for policy 0, policy_version 1009891 (0.0011) [2023-12-26 07:39:19,821][123091] Updated weights for policy 0, policy_version 1009901 (0.0010) [2023-12-26 07:39:20,311][123090] Updated weights for policy 1, policy_version 1002824 (0.0010) [2023-12-26 07:39:20,360][123090] Updated weights for policy 1, policy_version 1002834 (0.0010) [2023-12-26 07:39:20,424][123090] Updated weights for policy 1, policy_version 1002844 (0.0010) [2023-12-26 07:39:20,639][123091] Updated weights for policy 0, policy_version 1009911 (0.0009) [2023-12-26 07:39:20,700][123091] Updated weights for policy 0, policy_version 1009921 (0.0008) [2023-12-26 07:39:20,764][123091] Updated weights for policy 0, policy_version 1009931 (0.0010) [2023-12-26 07:39:21,277][123090] Updated weights for policy 1, policy_version 1002854 (0.0008) [2023-12-26 07:39:21,347][123090] Updated weights for policy 1, policy_version 1002864 (0.0009) [2023-12-26 07:39:21,416][123090] Updated weights for policy 1, policy_version 1002874 (0.0009) [2023-12-26 07:39:21,546][123091] Updated weights for policy 0, policy_version 1009941 (0.0010) [2023-12-26 07:39:21,612][123091] Updated weights for policy 0, policy_version 1009951 (0.0008) [2023-12-26 07:39:21,678][123091] Updated weights for policy 0, policy_version 1009961 (0.0010) [2023-12-26 07:39:22,264][123090] Updated weights for policy 1, policy_version 1002884 (0.0009) [2023-12-26 07:39:22,334][123090] Updated weights for policy 1, policy_version 1002894 (0.0009) [2023-12-26 07:39:22,402][123090] Updated weights for policy 1, policy_version 1002904 (0.0009) [2023-12-26 07:39:22,476][123091] Updated weights for policy 0, policy_version 1009971 (0.0010) [2023-12-26 07:39:22,532][123091] Updated weights for policy 0, policy_version 1009981 (0.0009) [2023-12-26 07:39:22,594][123091] Updated weights for policy 0, policy_version 1009991 (0.0008) [2023-12-26 07:39:23,266][123090] Updated weights for policy 1, policy_version 1002914 (0.0009) [2023-12-26 07:39:23,329][123090] Updated weights for policy 1, policy_version 1002924 (0.0009) [2023-12-26 07:39:23,393][123090] Updated weights for policy 1, policy_version 1002934 (0.0010) [2023-12-26 07:39:23,394][123091] Updated weights for policy 0, policy_version 1010001 (0.0006) [2023-12-26 07:39:23,453][123091] Updated weights for policy 0, policy_version 1010011 (0.0007) [2023-12-26 07:39:23,458][123090] Updated weights for policy 1, policy_version 1002944 (0.0009) [2023-12-26 07:39:23,510][123091] Updated weights for policy 0, policy_version 1010021 (0.0009) [2023-12-26 07:39:23,561][123091] Updated weights for policy 0, policy_version 1010031 (0.0005) [2023-12-26 07:39:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 515325952. Throughput: 0: 9221.3, 1: 8740.5. Samples: 515300112. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:23,785][121949] Avg episode reward: [(0, '6315.248'), (1, '6029.732')] [2023-12-26 07:39:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001010032_258572288.pth... [2023-12-26 07:39:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001002944_256753664.pth... [2023-12-26 07:39:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001001920_256491520.pth [2023-12-26 07:39:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001008944_258293760.pth [2023-12-26 07:39:24,277][123091] Updated weights for policy 0, policy_version 1010041 (0.0006) [2023-12-26 07:39:24,331][123091] Updated weights for policy 0, policy_version 1010051 (0.0005) [2023-12-26 07:39:24,338][123090] Updated weights for policy 1, policy_version 1002954 (0.0009) [2023-12-26 07:39:24,398][123091] Updated weights for policy 0, policy_version 1010061 (0.0008) [2023-12-26 07:39:24,405][123090] Updated weights for policy 1, policy_version 1002964 (0.0008) [2023-12-26 07:39:24,468][123090] Updated weights for policy 1, policy_version 1002974 (0.0010) [2023-12-26 07:39:25,074][123091] Updated weights for policy 0, policy_version 1010071 (0.0009) [2023-12-26 07:39:25,132][123091] Updated weights for policy 0, policy_version 1010081 (0.0009) [2023-12-26 07:39:25,193][123091] Updated weights for policy 0, policy_version 1010091 (0.0010) [2023-12-26 07:39:25,310][123090] Updated weights for policy 1, policy_version 1002984 (0.0010) [2023-12-26 07:39:25,372][123090] Updated weights for policy 1, policy_version 1002994 (0.0008) [2023-12-26 07:39:25,426][123090] Updated weights for policy 1, policy_version 1003004 (0.0008) [2023-12-26 07:39:25,987][123091] Updated weights for policy 0, policy_version 1010101 (0.0008) [2023-12-26 07:39:26,044][123091] Updated weights for policy 0, policy_version 1010111 (0.0005) [2023-12-26 07:39:26,095][123091] Updated weights for policy 0, policy_version 1010121 (0.0005) [2023-12-26 07:39:26,173][123090] Updated weights for policy 1, policy_version 1003014 (0.0007) [2023-12-26 07:39:26,228][123090] Updated weights for policy 1, policy_version 1003024 (0.0005) [2023-12-26 07:39:26,290][123090] Updated weights for policy 1, policy_version 1003034 (0.0005) [2023-12-26 07:39:26,860][123091] Updated weights for policy 0, policy_version 1010131 (0.0005) [2023-12-26 07:39:26,914][123091] Updated weights for policy 0, policy_version 1010141 (0.0005) [2023-12-26 07:39:26,971][123091] Updated weights for policy 0, policy_version 1010151 (0.0007) [2023-12-26 07:39:27,080][123090] Updated weights for policy 1, policy_version 1003044 (0.0008) [2023-12-26 07:39:27,140][123090] Updated weights for policy 1, policy_version 1003054 (0.0009) [2023-12-26 07:39:27,193][123090] Updated weights for policy 1, policy_version 1003064 (0.0009) [2023-12-26 07:39:27,785][123091] Updated weights for policy 0, policy_version 1010161 (0.0010) [2023-12-26 07:39:27,842][123091] Updated weights for policy 0, policy_version 1010171 (0.0009) [2023-12-26 07:39:27,888][123091] Updated weights for policy 0, policy_version 1010181 (0.0009) [2023-12-26 07:39:27,939][123091] Updated weights for policy 0, policy_version 1010191 (0.0009) [2023-12-26 07:39:27,980][123090] Updated weights for policy 1, policy_version 1003074 (0.0009) [2023-12-26 07:39:28,038][123090] Updated weights for policy 1, policy_version 1003084 (0.0009) [2023-12-26 07:39:28,083][123090] Updated weights for policy 1, policy_version 1003094 (0.0006) [2023-12-26 07:39:28,128][123090] Updated weights for policy 1, policy_version 1003104 (0.0005) [2023-12-26 07:39:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 515407872. Throughput: 0: 9318.3, 1: 8766.9. Samples: 515407136. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:28,785][121949] Avg episode reward: [(0, '6223.626'), (1, '6020.080')] [2023-12-26 07:39:28,804][123091] Updated weights for policy 0, policy_version 1010201 (0.0009) [2023-12-26 07:39:28,850][123090] Updated weights for policy 1, policy_version 1003114 (0.0006) [2023-12-26 07:39:28,860][123091] Updated weights for policy 0, policy_version 1010211 (0.0009) [2023-12-26 07:39:28,909][123090] Updated weights for policy 1, policy_version 1003124 (0.0007) [2023-12-26 07:39:28,916][123091] Updated weights for policy 0, policy_version 1010221 (0.0009) [2023-12-26 07:39:28,964][123090] Updated weights for policy 1, policy_version 1003134 (0.0007) [2023-12-26 07:39:29,751][123090] Updated weights for policy 1, policy_version 1003144 (0.0009) [2023-12-26 07:39:29,771][123091] Updated weights for policy 0, policy_version 1010231 (0.0009) [2023-12-26 07:39:29,812][123090] Updated weights for policy 1, policy_version 1003154 (0.0006) [2023-12-26 07:39:29,829][123091] Updated weights for policy 0, policy_version 1010241 (0.0009) [2023-12-26 07:39:29,875][123090] Updated weights for policy 1, policy_version 1003164 (0.0007) [2023-12-26 07:39:29,896][123091] Updated weights for policy 0, policy_version 1010251 (0.0009) [2023-12-26 07:39:30,597][123090] Updated weights for policy 1, policy_version 1003174 (0.0008) [2023-12-26 07:39:30,661][123090] Updated weights for policy 1, policy_version 1003184 (0.0009) [2023-12-26 07:39:30,692][123091] Updated weights for policy 0, policy_version 1010261 (0.0008) [2023-12-26 07:39:30,718][123090] Updated weights for policy 1, policy_version 1003194 (0.0006) [2023-12-26 07:39:30,746][123091] Updated weights for policy 0, policy_version 1010271 (0.0009) [2023-12-26 07:39:30,804][123091] Updated weights for policy 0, policy_version 1010281 (0.0010) [2023-12-26 07:39:31,478][123090] Updated weights for policy 1, policy_version 1003204 (0.0005) [2023-12-26 07:39:31,540][123090] Updated weights for policy 1, policy_version 1003214 (0.0008) [2023-12-26 07:39:31,594][123090] Updated weights for policy 1, policy_version 1003224 (0.0010) [2023-12-26 07:39:31,717][123091] Updated weights for policy 0, policy_version 1010291 (0.0010) [2023-12-26 07:39:31,782][123091] Updated weights for policy 0, policy_version 1010301 (0.0009) [2023-12-26 07:39:31,841][123091] Updated weights for policy 0, policy_version 1010311 (0.0009) [2023-12-26 07:39:32,427][123090] Updated weights for policy 1, policy_version 1003234 (0.0010) [2023-12-26 07:39:32,479][123090] Updated weights for policy 1, policy_version 1003244 (0.0009) [2023-12-26 07:39:32,537][123090] Updated weights for policy 1, policy_version 1003254 (0.0009) [2023-12-26 07:39:32,591][123090] Updated weights for policy 1, policy_version 1003264 (0.0010) [2023-12-26 07:39:32,624][123091] Updated weights for policy 0, policy_version 1010322 (0.0011) [2023-12-26 07:39:32,686][123091] Updated weights for policy 0, policy_version 1010332 (0.0010) [2023-12-26 07:39:32,752][123091] Updated weights for policy 0, policy_version 1010342 (0.0010) [2023-12-26 07:39:32,821][123091] Updated weights for policy 0, policy_version 1010352 (0.0010) [2023-12-26 07:39:33,457][123090] Updated weights for policy 1, policy_version 1003274 (0.0005) [2023-12-26 07:39:33,507][123090] Updated weights for policy 1, policy_version 1003284 (0.0005) [2023-12-26 07:39:33,552][123090] Updated weights for policy 1, policy_version 1003294 (0.0005) [2023-12-26 07:39:33,606][123091] Updated weights for policy 0, policy_version 1010362 (0.0010) [2023-12-26 07:39:33,668][123091] Updated weights for policy 0, policy_version 1010372 (0.0010) [2023-12-26 07:39:33,718][123091] Updated weights for policy 0, policy_version 1010382 (0.0010) [2023-12-26 07:39:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 515506176. Throughput: 0: 9128.9, 1: 8791.8. Samples: 515512996. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:33,785][121949] Avg episode reward: [(0, '6264.864'), (1, '6016.866')] [2023-12-26 07:39:34,292][123090] Updated weights for policy 1, policy_version 1003304 (0.0008) [2023-12-26 07:39:34,365][123090] Updated weights for policy 1, policy_version 1003314 (0.0009) [2023-12-26 07:39:34,429][123090] Updated weights for policy 1, policy_version 1003324 (0.0010) [2023-12-26 07:39:34,544][123091] Updated weights for policy 0, policy_version 1010392 (0.0011) [2023-12-26 07:39:34,599][123091] Updated weights for policy 0, policy_version 1010402 (0.0011) [2023-12-26 07:39:34,652][123091] Updated weights for policy 0, policy_version 1010412 (0.0010) [2023-12-26 07:39:35,149][123090] Updated weights for policy 1, policy_version 1003334 (0.0007) [2023-12-26 07:39:35,209][123090] Updated weights for policy 1, policy_version 1003344 (0.0005) [2023-12-26 07:39:35,274][123090] Updated weights for policy 1, policy_version 1003354 (0.0008) [2023-12-26 07:39:35,491][123091] Updated weights for policy 0, policy_version 1010422 (0.0011) [2023-12-26 07:39:35,560][123091] Updated weights for policy 0, policy_version 1010432 (0.0011) [2023-12-26 07:39:35,614][123091] Updated weights for policy 0, policy_version 1010442 (0.0010) [2023-12-26 07:39:36,072][123090] Updated weights for policy 1, policy_version 1003364 (0.0007) [2023-12-26 07:39:36,138][123090] Updated weights for policy 1, policy_version 1003374 (0.0009) [2023-12-26 07:39:36,192][123090] Updated weights for policy 1, policy_version 1003384 (0.0010) [2023-12-26 07:39:36,365][123091] Updated weights for policy 0, policy_version 1010452 (0.0009) [2023-12-26 07:39:36,422][123091] Updated weights for policy 0, policy_version 1010462 (0.0010) [2023-12-26 07:39:36,486][123091] Updated weights for policy 0, policy_version 1010472 (0.0011) [2023-12-26 07:39:36,975][123090] Updated weights for policy 1, policy_version 1003394 (0.0010) [2023-12-26 07:39:37,040][123090] Updated weights for policy 1, policy_version 1003404 (0.0009) [2023-12-26 07:39:37,104][123090] Updated weights for policy 1, policy_version 1003414 (0.0009) [2023-12-26 07:39:37,160][123090] Updated weights for policy 1, policy_version 1003424 (0.0009) [2023-12-26 07:39:37,301][123091] Updated weights for policy 0, policy_version 1010482 (0.0011) [2023-12-26 07:39:37,360][123091] Updated weights for policy 0, policy_version 1010492 (0.0011) [2023-12-26 07:39:37,427][123091] Updated weights for policy 0, policy_version 1010502 (0.0011) [2023-12-26 07:39:37,482][123091] Updated weights for policy 0, policy_version 1010512 (0.0011) [2023-12-26 07:39:37,990][123090] Updated weights for policy 1, policy_version 1003434 (0.0009) [2023-12-26 07:39:38,058][123090] Updated weights for policy 1, policy_version 1003444 (0.0009) [2023-12-26 07:39:38,122][123090] Updated weights for policy 1, policy_version 1003454 (0.0009) [2023-12-26 07:39:38,318][123091] Updated weights for policy 0, policy_version 1010522 (0.0011) [2023-12-26 07:39:38,384][123091] Updated weights for policy 0, policy_version 1010532 (0.0011) [2023-12-26 07:39:38,456][123091] Updated weights for policy 0, policy_version 1010542 (0.0011) [2023-12-26 07:39:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 515588096. Throughput: 0: 9125.2, 1: 8778.0. Samples: 515565904. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:38,785][121949] Avg episode reward: [(0, '6248.982'), (1, '5892.516')] [2023-12-26 07:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001010544_258703360.pth... [2023-12-26 07:39:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001003456_256884736.pth... [2023-12-26 07:39:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001002432_256622592.pth [2023-12-26 07:39:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001009520_258441216.pth [2023-12-26 07:39:38,971][123090] Updated weights for policy 1, policy_version 1003464 (0.0006) [2023-12-26 07:39:39,042][123090] Updated weights for policy 1, policy_version 1003474 (0.0006) [2023-12-26 07:39:39,090][123090] Updated weights for policy 1, policy_version 1003484 (0.0005) [2023-12-26 07:39:39,286][123091] Updated weights for policy 0, policy_version 1010552 (0.0011) [2023-12-26 07:39:39,356][123091] Updated weights for policy 0, policy_version 1010562 (0.0011) [2023-12-26 07:39:39,427][123091] Updated weights for policy 0, policy_version 1010572 (0.0010) [2023-12-26 07:39:39,792][123090] Updated weights for policy 1, policy_version 1003494 (0.0006) [2023-12-26 07:39:39,858][123090] Updated weights for policy 1, policy_version 1003504 (0.0011) [2023-12-26 07:39:39,916][123090] Updated weights for policy 1, policy_version 1003514 (0.0011) [2023-12-26 07:39:40,214][123091] Updated weights for policy 0, policy_version 1010582 (0.0007) [2023-12-26 07:39:40,285][123091] Updated weights for policy 0, policy_version 1010592 (0.0010) [2023-12-26 07:39:40,348][123091] Updated weights for policy 0, policy_version 1010602 (0.0011) [2023-12-26 07:39:40,697][123090] Updated weights for policy 1, policy_version 1003524 (0.0009) [2023-12-26 07:39:40,759][123090] Updated weights for policy 1, policy_version 1003534 (0.0005) [2023-12-26 07:39:40,820][123090] Updated weights for policy 1, policy_version 1003544 (0.0005) [2023-12-26 07:39:41,127][123091] Updated weights for policy 0, policy_version 1010612 (0.0009) [2023-12-26 07:39:41,200][123091] Updated weights for policy 0, policy_version 1010622 (0.0007) [2023-12-26 07:39:41,270][123091] Updated weights for policy 0, policy_version 1010632 (0.0010) [2023-12-26 07:39:41,617][123090] Updated weights for policy 1, policy_version 1003554 (0.0005) [2023-12-26 07:39:41,688][123090] Updated weights for policy 1, policy_version 1003564 (0.0008) [2023-12-26 07:39:41,760][123090] Updated weights for policy 1, policy_version 1003574 (0.0008) [2023-12-26 07:39:41,827][123090] Updated weights for policy 1, policy_version 1003584 (0.0009) [2023-12-26 07:39:42,114][123091] Updated weights for policy 0, policy_version 1010642 (0.0010) [2023-12-26 07:39:42,182][123091] Updated weights for policy 0, policy_version 1010652 (0.0009) [2023-12-26 07:39:42,258][123091] Updated weights for policy 0, policy_version 1010662 (0.0007) [2023-12-26 07:39:42,333][123091] Updated weights for policy 0, policy_version 1010672 (0.0008) [2023-12-26 07:39:42,647][123090] Updated weights for policy 1, policy_version 1003594 (0.0010) [2023-12-26 07:39:42,701][123090] Updated weights for policy 1, policy_version 1003605 (0.0010) [2023-12-26 07:39:42,760][123090] Updated weights for policy 1, policy_version 1003615 (0.0009) [2023-12-26 07:39:43,093][123091] Updated weights for policy 0, policy_version 1010682 (0.0010) [2023-12-26 07:39:43,147][123091] Updated weights for policy 0, policy_version 1010692 (0.0010) [2023-12-26 07:39:43,206][123091] Updated weights for policy 0, policy_version 1010702 (0.0009) [2023-12-26 07:39:43,575][123090] Updated weights for policy 1, policy_version 1003625 (0.0010) [2023-12-26 07:39:43,623][123090] Updated weights for policy 1, policy_version 1003635 (0.0010) [2023-12-26 07:39:43,679][123090] Updated weights for policy 1, policy_version 1003645 (0.0006) [2023-12-26 07:39:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 515678208. Throughput: 0: 8945.7, 1: 8765.2. Samples: 515670444. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:43,784][121949] Avg episode reward: [(0, '6253.834'), (1, '5907.792')] [2023-12-26 07:39:44,103][123091] Updated weights for policy 0, policy_version 1010712 (0.0009) [2023-12-26 07:39:44,166][123091] Updated weights for policy 0, policy_version 1010722 (0.0010) [2023-12-26 07:39:44,218][123091] Updated weights for policy 0, policy_version 1010732 (0.0010) [2023-12-26 07:39:44,388][123090] Updated weights for policy 1, policy_version 1003655 (0.0009) [2023-12-26 07:39:44,452][123090] Updated weights for policy 1, policy_version 1003665 (0.0011) [2023-12-26 07:39:44,519][123090] Updated weights for policy 1, policy_version 1003675 (0.0010) [2023-12-26 07:39:45,111][123091] Updated weights for policy 0, policy_version 1010742 (0.0010) [2023-12-26 07:39:45,169][123091] Updated weights for policy 0, policy_version 1010752 (0.0010) [2023-12-26 07:39:45,225][123091] Updated weights for policy 0, policy_version 1010762 (0.0010) [2023-12-26 07:39:45,233][123090] Updated weights for policy 1, policy_version 1003685 (0.0008) [2023-12-26 07:39:45,297][123090] Updated weights for policy 1, policy_version 1003695 (0.0007) [2023-12-26 07:39:45,365][123090] Updated weights for policy 1, policy_version 1003705 (0.0011) [2023-12-26 07:39:46,052][123090] Updated weights for policy 1, policy_version 1003715 (0.0011) [2023-12-26 07:39:46,107][123090] Updated weights for policy 1, policy_version 1003725 (0.0010) [2023-12-26 07:39:46,131][123091] Updated weights for policy 0, policy_version 1010772 (0.0009) [2023-12-26 07:39:46,160][123090] Updated weights for policy 1, policy_version 1003735 (0.0009) [2023-12-26 07:39:46,190][123091] Updated weights for policy 0, policy_version 1010782 (0.0009) [2023-12-26 07:39:46,256][123091] Updated weights for policy 0, policy_version 1010792 (0.0009) [2023-12-26 07:39:46,952][123090] Updated weights for policy 1, policy_version 1003745 (0.0006) [2023-12-26 07:39:47,018][123090] Updated weights for policy 1, policy_version 1003755 (0.0009) [2023-12-26 07:39:47,081][123090] Updated weights for policy 1, policy_version 1003765 (0.0009) [2023-12-26 07:39:47,113][123091] Updated weights for policy 0, policy_version 1010802 (0.0009) [2023-12-26 07:39:47,141][123090] Updated weights for policy 1, policy_version 1003775 (0.0010) [2023-12-26 07:39:47,171][123091] Updated weights for policy 0, policy_version 1010812 (0.0008) [2023-12-26 07:39:47,237][123091] Updated weights for policy 0, policy_version 1010822 (0.0009) [2023-12-26 07:39:47,291][123091] Updated weights for policy 0, policy_version 1010832 (0.0007) [2023-12-26 07:39:47,879][123090] Updated weights for policy 1, policy_version 1003785 (0.0006) [2023-12-26 07:39:47,936][123090] Updated weights for policy 1, policy_version 1003795 (0.0006) [2023-12-26 07:39:47,991][123090] Updated weights for policy 1, policy_version 1003805 (0.0008) [2023-12-26 07:39:48,046][123091] Updated weights for policy 0, policy_version 1010842 (0.0006) [2023-12-26 07:39:48,125][123091] Updated weights for policy 0, policy_version 1010852 (0.0007) [2023-12-26 07:39:48,192][123091] Updated weights for policy 0, policy_version 1010862 (0.0005) [2023-12-26 07:39:48,691][123090] Updated weights for policy 1, policy_version 1003815 (0.0010) [2023-12-26 07:39:48,763][123090] Updated weights for policy 1, policy_version 1003825 (0.0009) [2023-12-26 07:39:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 515760128. Throughput: 0: 8871.1, 1: 8883.7. Samples: 515777820. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:48,784][121949] Avg episode reward: [(0, '6149.065'), (1, '5720.654')] [2023-12-26 07:39:48,836][123090] Updated weights for policy 1, policy_version 1003835 (0.0008) [2023-12-26 07:39:48,931][123091] Updated weights for policy 0, policy_version 1010872 (0.0010) [2023-12-26 07:39:48,994][123091] Updated weights for policy 0, policy_version 1010882 (0.0007) [2023-12-26 07:39:49,043][123091] Updated weights for policy 0, policy_version 1010892 (0.0006) [2023-12-26 07:39:49,635][123090] Updated weights for policy 1, policy_version 1003845 (0.0009) [2023-12-26 07:39:49,683][123090] Updated weights for policy 1, policy_version 1003855 (0.0010) [2023-12-26 07:39:49,732][123090] Updated weights for policy 1, policy_version 1003865 (0.0010) [2023-12-26 07:39:49,862][123091] Updated weights for policy 0, policy_version 1010902 (0.0007) [2023-12-26 07:39:49,921][123091] Updated weights for policy 0, policy_version 1010912 (0.0008) [2023-12-26 07:39:49,993][123091] Updated weights for policy 0, policy_version 1010922 (0.0008) [2023-12-26 07:39:50,516][123090] Updated weights for policy 1, policy_version 1003875 (0.0006) [2023-12-26 07:39:50,592][123090] Updated weights for policy 1, policy_version 1003885 (0.0008) [2023-12-26 07:39:50,667][123090] Updated weights for policy 1, policy_version 1003895 (0.0011) [2023-12-26 07:39:50,844][123091] Updated weights for policy 0, policy_version 1010932 (0.0009) [2023-12-26 07:39:50,914][123091] Updated weights for policy 0, policy_version 1010942 (0.0009) [2023-12-26 07:39:50,987][123091] Updated weights for policy 0, policy_version 1010952 (0.0009) [2023-12-26 07:39:51,473][123090] Updated weights for policy 1, policy_version 1003905 (0.0010) [2023-12-26 07:39:51,536][123090] Updated weights for policy 1, policy_version 1003915 (0.0010) [2023-12-26 07:39:51,600][123090] Updated weights for policy 1, policy_version 1003925 (0.0009) [2023-12-26 07:39:51,673][123090] Updated weights for policy 1, policy_version 1003935 (0.0010) [2023-12-26 07:39:51,832][123091] Updated weights for policy 0, policy_version 1010962 (0.0009) [2023-12-26 07:39:51,881][123091] Updated weights for policy 0, policy_version 1010972 (0.0009) [2023-12-26 07:39:51,938][123091] Updated weights for policy 0, policy_version 1010982 (0.0009) [2023-12-26 07:39:51,998][123091] Updated weights for policy 0, policy_version 1010992 (0.0009) [2023-12-26 07:39:52,568][123090] Updated weights for policy 1, policy_version 1003945 (0.0010) [2023-12-26 07:39:52,622][123090] Updated weights for policy 1, policy_version 1003955 (0.0010) [2023-12-26 07:39:52,683][123090] Updated weights for policy 1, policy_version 1003965 (0.0009) [2023-12-26 07:39:52,741][123091] Updated weights for policy 0, policy_version 1011002 (0.0010) [2023-12-26 07:39:52,796][123091] Updated weights for policy 0, policy_version 1011012 (0.0010) [2023-12-26 07:39:52,848][123091] Updated weights for policy 0, policy_version 1011022 (0.0011) [2023-12-26 07:39:53,567][123090] Updated weights for policy 1, policy_version 1003975 (0.0009) [2023-12-26 07:39:53,634][123090] Updated weights for policy 1, policy_version 1003985 (0.0009) [2023-12-26 07:39:53,637][123091] Updated weights for policy 0, policy_version 1011032 (0.0007) [2023-12-26 07:39:53,694][123090] Updated weights for policy 1, policy_version 1003995 (0.0006) [2023-12-26 07:39:53,698][123091] Updated weights for policy 0, policy_version 1011042 (0.0006) [2023-12-26 07:39:53,754][123091] Updated weights for policy 0, policy_version 1011052 (0.0009) [2023-12-26 07:39:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 515858432. Throughput: 0: 8800.1, 1: 8880.7. Samples: 515828548. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:53,785][121949] Avg episode reward: [(0, '6248.941'), (1, '5515.764')] [2023-12-26 07:39:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001011056_258834432.pth... [2023-12-26 07:39:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001004000_257024000.pth... [2023-12-26 07:39:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001010032_258572288.pth [2023-12-26 07:39:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001002944_256753664.pth [2023-12-26 07:39:54,458][123090] Updated weights for policy 1, policy_version 1004005 (0.0009) [2023-12-26 07:39:54,525][123090] Updated weights for policy 1, policy_version 1004015 (0.0010) [2023-12-26 07:39:54,572][123090] Updated weights for policy 1, policy_version 1004025 (0.0010) [2023-12-26 07:39:54,607][123091] Updated weights for policy 0, policy_version 1011063 (0.0009) [2023-12-26 07:39:54,654][123091] Updated weights for policy 0, policy_version 1011073 (0.0008) [2023-12-26 07:39:54,713][123091] Updated weights for policy 0, policy_version 1011083 (0.0009) [2023-12-26 07:39:55,394][123090] Updated weights for policy 1, policy_version 1004035 (0.0010) [2023-12-26 07:39:55,447][123090] Updated weights for policy 1, policy_version 1004045 (0.0009) [2023-12-26 07:39:55,498][123090] Updated weights for policy 1, policy_version 1004055 (0.0010) [2023-12-26 07:39:55,550][123091] Updated weights for policy 0, policy_version 1011093 (0.0007) [2023-12-26 07:39:55,600][123091] Updated weights for policy 0, policy_version 1011103 (0.0009) [2023-12-26 07:39:55,652][123091] Updated weights for policy 0, policy_version 1011113 (0.0008) [2023-12-26 07:39:56,329][123090] Updated weights for policy 1, policy_version 1004065 (0.0010) [2023-12-26 07:39:56,380][123090] Updated weights for policy 1, policy_version 1004075 (0.0010) [2023-12-26 07:39:56,435][123090] Updated weights for policy 1, policy_version 1004085 (0.0010) [2023-12-26 07:39:56,497][123091] Updated weights for policy 0, policy_version 1011123 (0.0009) [2023-12-26 07:39:56,501][123090] Updated weights for policy 1, policy_version 1004095 (0.0010) [2023-12-26 07:39:56,559][123091] Updated weights for policy 0, policy_version 1011133 (0.0009) [2023-12-26 07:39:56,610][123091] Updated weights for policy 0, policy_version 1011143 (0.0009) [2023-12-26 07:39:57,237][123090] Updated weights for policy 1, policy_version 1004105 (0.0006) [2023-12-26 07:39:57,292][123090] Updated weights for policy 1, policy_version 1004115 (0.0005) [2023-12-26 07:39:57,350][123090] Updated weights for policy 1, policy_version 1004125 (0.0005) [2023-12-26 07:39:57,432][123091] Updated weights for policy 0, policy_version 1011153 (0.0009) [2023-12-26 07:39:57,488][123091] Updated weights for policy 0, policy_version 1011163 (0.0005) [2023-12-26 07:39:57,534][123091] Updated weights for policy 0, policy_version 1011173 (0.0005) [2023-12-26 07:39:57,578][123091] Updated weights for policy 0, policy_version 1011183 (0.0005) [2023-12-26 07:39:58,042][123090] Updated weights for policy 1, policy_version 1004135 (0.0007) [2023-12-26 07:39:58,114][123090] Updated weights for policy 1, policy_version 1004145 (0.0008) [2023-12-26 07:39:58,184][123090] Updated weights for policy 1, policy_version 1004155 (0.0008) [2023-12-26 07:39:58,273][123091] Updated weights for policy 0, policy_version 1011193 (0.0005) [2023-12-26 07:39:58,349][123091] Updated weights for policy 0, policy_version 1011203 (0.0007) [2023-12-26 07:39:58,414][123091] Updated weights for policy 0, policy_version 1011213 (0.0008) [2023-12-26 07:39:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 515940352. Throughput: 0: 8766.6, 1: 8915.0. Samples: 515933632. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:39:58,785][121949] Avg episode reward: [(0, '6397.592'), (1, '5612.391')] [2023-12-26 07:39:58,944][123090] Updated weights for policy 1, policy_version 1004165 (0.0008) [2023-12-26 07:39:59,000][123090] Updated weights for policy 1, policy_version 1004175 (0.0008) [2023-12-26 07:39:59,054][123090] Updated weights for policy 1, policy_version 1004185 (0.0006) [2023-12-26 07:39:59,111][123091] Updated weights for policy 0, policy_version 1011223 (0.0009) [2023-12-26 07:39:59,164][123091] Updated weights for policy 0, policy_version 1011233 (0.0010) [2023-12-26 07:39:59,218][123091] Updated weights for policy 0, policy_version 1011244 (0.0010) [2023-12-26 07:39:59,814][123090] Updated weights for policy 1, policy_version 1004195 (0.0006) [2023-12-26 07:39:59,881][123090] Updated weights for policy 1, policy_version 1004205 (0.0010) [2023-12-26 07:39:59,949][123090] Updated weights for policy 1, policy_version 1004215 (0.0011) [2023-12-26 07:40:00,062][123091] Updated weights for policy 0, policy_version 1011254 (0.0007) [2023-12-26 07:40:00,127][123091] Updated weights for policy 0, policy_version 1011264 (0.0005) [2023-12-26 07:40:00,200][123091] Updated weights for policy 0, policy_version 1011274 (0.0010) [2023-12-26 07:40:00,752][123090] Updated weights for policy 1, policy_version 1004225 (0.0010) [2023-12-26 07:40:00,806][123090] Updated weights for policy 1, policy_version 1004235 (0.0005) [2023-12-26 07:40:00,878][123090] Updated weights for policy 1, policy_version 1004245 (0.0008) [2023-12-26 07:40:00,888][123091] Updated weights for policy 0, policy_version 1011284 (0.0008) [2023-12-26 07:40:00,938][123091] Updated weights for policy 0, policy_version 1011294 (0.0005) [2023-12-26 07:40:00,945][123090] Updated weights for policy 1, policy_version 1004255 (0.0009) [2023-12-26 07:40:00,987][123091] Updated weights for policy 0, policy_version 1011304 (0.0007) [2023-12-26 07:40:01,775][123090] Updated weights for policy 1, policy_version 1004265 (0.0008) [2023-12-26 07:40:01,780][123091] Updated weights for policy 0, policy_version 1011314 (0.0009) [2023-12-26 07:40:01,829][123090] Updated weights for policy 1, policy_version 1004275 (0.0007) [2023-12-26 07:40:01,846][123091] Updated weights for policy 0, policy_version 1011324 (0.0008) [2023-12-26 07:40:01,895][123090] Updated weights for policy 1, policy_version 1004285 (0.0005) [2023-12-26 07:40:01,909][123091] Updated weights for policy 0, policy_version 1011334 (0.0006) [2023-12-26 07:40:01,960][123091] Updated weights for policy 0, policy_version 1011344 (0.0005) [2023-12-26 07:40:02,609][123090] Updated weights for policy 1, policy_version 1004295 (0.0009) [2023-12-26 07:40:02,664][123090] Updated weights for policy 1, policy_version 1004305 (0.0009) [2023-12-26 07:40:02,672][123091] Updated weights for policy 0, policy_version 1011354 (0.0007) [2023-12-26 07:40:02,727][123090] Updated weights for policy 1, policy_version 1004315 (0.0009) [2023-12-26 07:40:02,741][123091] Updated weights for policy 0, policy_version 1011364 (0.0007) [2023-12-26 07:40:02,798][123091] Updated weights for policy 0, policy_version 1011374 (0.0008) [2023-12-26 07:40:03,530][123090] Updated weights for policy 1, policy_version 1004325 (0.0008) [2023-12-26 07:40:03,543][123091] Updated weights for policy 0, policy_version 1011384 (0.0007) [2023-12-26 07:40:03,586][123090] Updated weights for policy 1, policy_version 1004335 (0.0009) [2023-12-26 07:40:03,602][123091] Updated weights for policy 0, policy_version 1011394 (0.0006) [2023-12-26 07:40:03,646][123090] Updated weights for policy 1, policy_version 1004346 (0.0010) [2023-12-26 07:40:03,659][123091] Updated weights for policy 0, policy_version 1011404 (0.0006) [2023-12-26 07:40:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 516038656. Throughput: 0: 8768.2, 1: 8893.0. Samples: 516044504. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:03,784][121949] Avg episode reward: [(0, '6395.222'), (1, '5643.478')] [2023-12-26 07:40:04,364][123090] Updated weights for policy 1, policy_version 1004356 (0.0007) [2023-12-26 07:40:04,392][123091] Updated weights for policy 0, policy_version 1011414 (0.0007) [2023-12-26 07:40:04,437][123090] Updated weights for policy 1, policy_version 1004366 (0.0008) [2023-12-26 07:40:04,464][123091] Updated weights for policy 0, policy_version 1011424 (0.0009) [2023-12-26 07:40:04,501][123090] Updated weights for policy 1, policy_version 1004376 (0.0010) [2023-12-26 07:40:04,514][123091] Updated weights for policy 0, policy_version 1011434 (0.0008) [2023-12-26 07:40:05,205][123091] Updated weights for policy 0, policy_version 1011444 (0.0006) [2023-12-26 07:40:05,213][123090] Updated weights for policy 1, policy_version 1004386 (0.0009) [2023-12-26 07:40:05,251][123091] Updated weights for policy 0, policy_version 1011454 (0.0005) [2023-12-26 07:40:05,270][123090] Updated weights for policy 1, policy_version 1004396 (0.0005) [2023-12-26 07:40:05,293][123091] Updated weights for policy 0, policy_version 1011464 (0.0006) [2023-12-26 07:40:05,328][123090] Updated weights for policy 1, policy_version 1004406 (0.0005) [2023-12-26 07:40:05,398][123090] Updated weights for policy 1, policy_version 1004416 (0.0005) [2023-12-26 07:40:05,919][123091] Updated weights for policy 0, policy_version 1011474 (0.0006) [2023-12-26 07:40:05,992][123091] Updated weights for policy 0, policy_version 1011484 (0.0006) [2023-12-26 07:40:06,054][123091] Updated weights for policy 0, policy_version 1011494 (0.0005) [2023-12-26 07:40:06,064][123090] Updated weights for policy 1, policy_version 1004426 (0.0005) [2023-12-26 07:40:06,119][123091] Updated weights for policy 0, policy_version 1011504 (0.0008) [2023-12-26 07:40:06,148][123090] Updated weights for policy 1, policy_version 1004436 (0.0009) [2023-12-26 07:40:06,208][123090] Updated weights for policy 1, policy_version 1004446 (0.0008) [2023-12-26 07:40:06,755][123091] Updated weights for policy 0, policy_version 1011514 (0.0006) [2023-12-26 07:40:06,819][123091] Updated weights for policy 0, policy_version 1011524 (0.0009) [2023-12-26 07:40:06,867][123091] Updated weights for policy 0, policy_version 1011534 (0.0008) [2023-12-26 07:40:06,930][123090] Updated weights for policy 1, policy_version 1004456 (0.0008) [2023-12-26 07:40:06,987][123090] Updated weights for policy 1, policy_version 1004466 (0.0005) [2023-12-26 07:40:07,054][123090] Updated weights for policy 1, policy_version 1004476 (0.0005) [2023-12-26 07:40:07,650][123091] Updated weights for policy 0, policy_version 1011544 (0.0006) [2023-12-26 07:40:07,707][123091] Updated weights for policy 0, policy_version 1011554 (0.0006) [2023-12-26 07:40:07,713][123090] Updated weights for policy 1, policy_version 1004486 (0.0005) [2023-12-26 07:40:07,760][123091] Updated weights for policy 0, policy_version 1011564 (0.0007) [2023-12-26 07:40:07,779][123090] Updated weights for policy 1, policy_version 1004496 (0.0008) [2023-12-26 07:40:07,850][123090] Updated weights for policy 1, policy_version 1004506 (0.0011) [2023-12-26 07:40:08,502][123091] Updated weights for policy 0, policy_version 1011574 (0.0006) [2023-12-26 07:40:08,576][123091] Updated weights for policy 0, policy_version 1011584 (0.0007) [2023-12-26 07:40:08,638][123090] Updated weights for policy 1, policy_version 1004516 (0.0011) [2023-12-26 07:40:08,642][123091] Updated weights for policy 0, policy_version 1011594 (0.0009) [2023-12-26 07:40:08,689][123090] Updated weights for policy 1, policy_version 1004526 (0.0009) [2023-12-26 07:40:08,739][123090] Updated weights for policy 1, policy_version 1004536 (0.0009) [2023-12-26 07:40:08,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 516136960. Throughput: 0: 8877.0, 1: 8998.4. Samples: 516104504. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:08,785][121949] Avg episode reward: [(0, '6299.961'), (1, '5654.155')] [2023-12-26 07:40:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001004544_257163264.pth... [2023-12-26 07:40:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001011600_258973696.pth... [2023-12-26 07:40:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001003456_256884736.pth [2023-12-26 07:40:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001010544_258703360.pth [2023-12-26 07:40:09,370][123091] Updated weights for policy 0, policy_version 1011604 (0.0008) [2023-12-26 07:40:09,446][123091] Updated weights for policy 0, policy_version 1011614 (0.0009) [2023-12-26 07:40:09,518][123091] Updated weights for policy 0, policy_version 1011624 (0.0010) [2023-12-26 07:40:09,605][123090] Updated weights for policy 1, policy_version 1004546 (0.0008) [2023-12-26 07:40:09,661][123090] Updated weights for policy 1, policy_version 1004556 (0.0005) [2023-12-26 07:40:09,709][123090] Updated weights for policy 1, policy_version 1004566 (0.0005) [2023-12-26 07:40:09,762][123090] Updated weights for policy 1, policy_version 1004576 (0.0005) [2023-12-26 07:40:10,421][123091] Updated weights for policy 0, policy_version 1011634 (0.0010) [2023-12-26 07:40:10,489][123091] Updated weights for policy 0, policy_version 1011644 (0.0009) [2023-12-26 07:40:10,514][123090] Updated weights for policy 1, policy_version 1004586 (0.0007) [2023-12-26 07:40:10,553][123091] Updated weights for policy 0, policy_version 1011654 (0.0008) [2023-12-26 07:40:10,562][123090] Updated weights for policy 1, policy_version 1004596 (0.0007) [2023-12-26 07:40:10,620][123091] Updated weights for policy 0, policy_version 1011664 (0.0011) [2023-12-26 07:40:10,623][123090] Updated weights for policy 1, policy_version 1004606 (0.0007) [2023-12-26 07:40:11,379][123090] Updated weights for policy 1, policy_version 1004616 (0.0009) [2023-12-26 07:40:11,433][123091] Updated weights for policy 0, policy_version 1011674 (0.0010) [2023-12-26 07:40:11,451][123090] Updated weights for policy 1, policy_version 1004626 (0.0008) [2023-12-26 07:40:11,493][123091] Updated weights for policy 0, policy_version 1011684 (0.0011) [2023-12-26 07:40:11,517][123090] Updated weights for policy 1, policy_version 1004636 (0.0007) [2023-12-26 07:40:11,551][123091] Updated weights for policy 0, policy_version 1011694 (0.0011) [2023-12-26 07:40:12,340][123090] Updated weights for policy 1, policy_version 1004646 (0.0009) [2023-12-26 07:40:12,406][123090] Updated weights for policy 1, policy_version 1004656 (0.0009) [2023-12-26 07:40:12,438][123091] Updated weights for policy 0, policy_version 1011704 (0.0010) [2023-12-26 07:40:12,467][123090] Updated weights for policy 1, policy_version 1004666 (0.0008) [2023-12-26 07:40:12,509][123091] Updated weights for policy 0, policy_version 1011714 (0.0009) [2023-12-26 07:40:12,559][123091] Updated weights for policy 0, policy_version 1011724 (0.0006) [2023-12-26 07:40:13,253][123090] Updated weights for policy 1, policy_version 1004676 (0.0007) [2023-12-26 07:40:13,309][123091] Updated weights for policy 0, policy_version 1011734 (0.0005) [2023-12-26 07:40:13,319][123090] Updated weights for policy 1, policy_version 1004686 (0.0008) [2023-12-26 07:40:13,369][123091] Updated weights for policy 0, policy_version 1011744 (0.0005) [2023-12-26 07:40:13,372][123090] Updated weights for policy 1, policy_version 1004696 (0.0009) [2023-12-26 07:40:13,432][123091] Updated weights for policy 0, policy_version 1011754 (0.0006) [2023-12-26 07:40:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 516218880. Throughput: 0: 8801.2, 1: 9056.0. Samples: 516210712. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:13,785][121949] Avg episode reward: [(0, '6227.476'), (1, '5731.091')] [2023-12-26 07:40:14,104][123091] Updated weights for policy 0, policy_version 1011764 (0.0007) [2023-12-26 07:40:14,166][123091] Updated weights for policy 0, policy_version 1011774 (0.0010) [2023-12-26 07:40:14,221][123091] Updated weights for policy 0, policy_version 1011784 (0.0010) [2023-12-26 07:40:14,223][123090] Updated weights for policy 1, policy_version 1004706 (0.0008) [2023-12-26 07:40:14,284][123090] Updated weights for policy 1, policy_version 1004716 (0.0006) [2023-12-26 07:40:14,340][123090] Updated weights for policy 1, policy_version 1004726 (0.0008) [2023-12-26 07:40:14,391][123090] Updated weights for policy 1, policy_version 1004736 (0.0009) [2023-12-26 07:40:14,988][123091] Updated weights for policy 0, policy_version 1011794 (0.0010) [2023-12-26 07:40:15,052][123091] Updated weights for policy 0, policy_version 1011804 (0.0009) [2023-12-26 07:40:15,116][123091] Updated weights for policy 0, policy_version 1011814 (0.0009) [2023-12-26 07:40:15,173][123091] Updated weights for policy 0, policy_version 1011824 (0.0009) [2023-12-26 07:40:15,245][123090] Updated weights for policy 1, policy_version 1004746 (0.0009) [2023-12-26 07:40:15,302][123090] Updated weights for policy 1, policy_version 1004756 (0.0009) [2023-12-26 07:40:15,353][123090] Updated weights for policy 1, policy_version 1004766 (0.0008) [2023-12-26 07:40:16,046][123091] Updated weights for policy 0, policy_version 1011834 (0.0010) [2023-12-26 07:40:16,077][123090] Updated weights for policy 1, policy_version 1004776 (0.0006) [2023-12-26 07:40:16,097][123091] Updated weights for policy 0, policy_version 1011844 (0.0007) [2023-12-26 07:40:16,140][123090] Updated weights for policy 1, policy_version 1004786 (0.0006) [2023-12-26 07:40:16,153][123091] Updated weights for policy 0, policy_version 1011854 (0.0006) [2023-12-26 07:40:16,190][123090] Updated weights for policy 1, policy_version 1004796 (0.0006) [2023-12-26 07:40:16,879][123091] Updated weights for policy 0, policy_version 1011864 (0.0006) [2023-12-26 07:40:16,906][123090] Updated weights for policy 1, policy_version 1004806 (0.0008) [2023-12-26 07:40:16,930][123091] Updated weights for policy 0, policy_version 1011874 (0.0006) [2023-12-26 07:40:16,958][123090] Updated weights for policy 1, policy_version 1004816 (0.0010) [2023-12-26 07:40:16,982][123091] Updated weights for policy 0, policy_version 1011884 (0.0005) [2023-12-26 07:40:17,011][123090] Updated weights for policy 1, policy_version 1004826 (0.0006) [2023-12-26 07:40:17,655][123090] Updated weights for policy 1, policy_version 1004836 (0.0007) [2023-12-26 07:40:17,721][123090] Updated weights for policy 1, policy_version 1004846 (0.0010) [2023-12-26 07:40:17,776][123090] Updated weights for policy 1, policy_version 1004856 (0.0010) [2023-12-26 07:40:17,825][123091] Updated weights for policy 0, policy_version 1011894 (0.0007) [2023-12-26 07:40:17,873][123091] Updated weights for policy 0, policy_version 1011904 (0.0009) [2023-12-26 07:40:17,928][123091] Updated weights for policy 0, policy_version 1011914 (0.0008) [2023-12-26 07:40:18,609][123090] Updated weights for policy 1, policy_version 1004866 (0.0010) [2023-12-26 07:40:18,673][123090] Updated weights for policy 1, policy_version 1004876 (0.0010) [2023-12-26 07:40:18,727][123090] Updated weights for policy 1, policy_version 1004886 (0.0010) [2023-12-26 07:40:18,779][123090] Updated weights for policy 1, policy_version 1004896 (0.0010) [2023-12-26 07:40:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 516308992. Throughput: 0: 8875.4, 1: 9048.3. Samples: 516319560. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:18,785][121949] Avg episode reward: [(0, '6242.036'), (1, '5482.348')] [2023-12-26 07:40:18,785][123091] Updated weights for policy 0, policy_version 1011924 (0.0008) [2023-12-26 07:40:18,849][123091] Updated weights for policy 0, policy_version 1011934 (0.0009) [2023-12-26 07:40:18,902][123091] Updated weights for policy 0, policy_version 1011944 (0.0009) [2023-12-26 07:40:19,610][123090] Updated weights for policy 1, policy_version 1004906 (0.0011) [2023-12-26 07:40:19,681][123090] Updated weights for policy 1, policy_version 1004916 (0.0006) [2023-12-26 07:40:19,750][123090] Updated weights for policy 1, policy_version 1004926 (0.0007) [2023-12-26 07:40:19,761][123091] Updated weights for policy 0, policy_version 1011954 (0.0009) [2023-12-26 07:40:19,824][123091] Updated weights for policy 0, policy_version 1011964 (0.0008) [2023-12-26 07:40:19,895][123091] Updated weights for policy 0, policy_version 1011974 (0.0008) [2023-12-26 07:40:19,967][123091] Updated weights for policy 0, policy_version 1011984 (0.0008) [2023-12-26 07:40:20,585][123090] Updated weights for policy 1, policy_version 1004936 (0.0010) [2023-12-26 07:40:20,655][123090] Updated weights for policy 1, policy_version 1004946 (0.0009) [2023-12-26 07:40:20,722][123090] Updated weights for policy 1, policy_version 1004956 (0.0009) [2023-12-26 07:40:20,801][123091] Updated weights for policy 0, policy_version 1011994 (0.0010) [2023-12-26 07:40:20,867][123091] Updated weights for policy 0, policy_version 1012004 (0.0010) [2023-12-26 07:40:20,935][123091] Updated weights for policy 0, policy_version 1012014 (0.0009) [2023-12-26 07:40:21,677][123090] Updated weights for policy 1, policy_version 1004966 (0.0010) [2023-12-26 07:40:21,754][123090] Updated weights for policy 1, policy_version 1004976 (0.0010) [2023-12-26 07:40:21,824][123090] Updated weights for policy 1, policy_version 1004986 (0.0011) [2023-12-26 07:40:21,841][123091] Updated weights for policy 0, policy_version 1012024 (0.0008) [2023-12-26 07:40:21,900][123091] Updated weights for policy 0, policy_version 1012034 (0.0009) [2023-12-26 07:40:21,957][123091] Updated weights for policy 0, policy_version 1012044 (0.0010) [2023-12-26 07:40:22,636][123090] Updated weights for policy 1, policy_version 1004996 (0.0009) [2023-12-26 07:40:22,706][123090] Updated weights for policy 1, policy_version 1005006 (0.0009) [2023-12-26 07:40:22,782][123090] Updated weights for policy 1, policy_version 1005016 (0.0009) [2023-12-26 07:40:22,797][123091] Updated weights for policy 0, policy_version 1012054 (0.0009) [2023-12-26 07:40:22,864][123091] Updated weights for policy 0, policy_version 1012064 (0.0009) [2023-12-26 07:40:22,916][123091] Updated weights for policy 0, policy_version 1012074 (0.0010) [2023-12-26 07:40:23,506][123090] Updated weights for policy 1, policy_version 1005026 (0.0008) [2023-12-26 07:40:23,561][123090] Updated weights for policy 1, policy_version 1005036 (0.0006) [2023-12-26 07:40:23,611][123090] Updated weights for policy 1, policy_version 1005046 (0.0005) [2023-12-26 07:40:23,672][123090] Updated weights for policy 1, policy_version 1005056 (0.0005) [2023-12-26 07:40:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 516390912. Throughput: 0: 8845.1, 1: 9001.2. Samples: 516368988. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:23,785][121949] Avg episode reward: [(0, '6225.960'), (1, '5314.953')] [2023-12-26 07:40:23,789][123091] Updated weights for policy 0, policy_version 1012084 (0.0009) [2023-12-26 07:40:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001005056_257294336.pth... [2023-12-26 07:40:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001004000_257024000.pth [2023-12-26 07:40:23,852][123091] Updated weights for policy 0, policy_version 1012094 (0.0010) [2023-12-26 07:40:23,907][123091] Updated weights for policy 0, policy_version 1012104 (0.0010) [2023-12-26 07:40:23,960][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001012112_259104768.pth... [2023-12-26 07:40:23,964][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001011056_258834432.pth [2023-12-26 07:40:24,424][123090] Updated weights for policy 1, policy_version 1005066 (0.0010) [2023-12-26 07:40:24,493][123090] Updated weights for policy 1, policy_version 1005076 (0.0008) [2023-12-26 07:40:24,559][123090] Updated weights for policy 1, policy_version 1005086 (0.0009) [2023-12-26 07:40:24,650][123091] Updated weights for policy 0, policy_version 1012114 (0.0009) [2023-12-26 07:40:24,739][123091] Updated weights for policy 0, policy_version 1012124 (0.0009) [2023-12-26 07:40:24,809][123091] Updated weights for policy 0, policy_version 1012134 (0.0009) [2023-12-26 07:40:24,879][123091] Updated weights for policy 0, policy_version 1012144 (0.0010) [2023-12-26 07:40:25,414][123090] Updated weights for policy 1, policy_version 1005096 (0.0009) [2023-12-26 07:40:25,480][123090] Updated weights for policy 1, policy_version 1005106 (0.0010) [2023-12-26 07:40:25,551][123090] Updated weights for policy 1, policy_version 1005116 (0.0010) [2023-12-26 07:40:25,636][123091] Updated weights for policy 0, policy_version 1012154 (0.0008) [2023-12-26 07:40:25,694][123091] Updated weights for policy 0, policy_version 1012164 (0.0009) [2023-12-26 07:40:25,768][123091] Updated weights for policy 0, policy_version 1012174 (0.0009) [2023-12-26 07:40:26,262][123090] Updated weights for policy 1, policy_version 1005126 (0.0007) [2023-12-26 07:40:26,316][123090] Updated weights for policy 1, policy_version 1005136 (0.0005) [2023-12-26 07:40:26,360][123090] Updated weights for policy 1, policy_version 1005146 (0.0005) [2023-12-26 07:40:26,615][123091] Updated weights for policy 0, policy_version 1012184 (0.0009) [2023-12-26 07:40:26,678][123091] Updated weights for policy 0, policy_version 1012194 (0.0009) [2023-12-26 07:40:26,741][123091] Updated weights for policy 0, policy_version 1012204 (0.0009) [2023-12-26 07:40:27,045][123090] Updated weights for policy 1, policy_version 1005156 (0.0006) [2023-12-26 07:40:27,099][123090] Updated weights for policy 1, policy_version 1005166 (0.0005) [2023-12-26 07:40:27,151][123090] Updated weights for policy 1, policy_version 1005176 (0.0005) [2023-12-26 07:40:27,585][123091] Updated weights for policy 0, policy_version 1012214 (0.0009) [2023-12-26 07:40:27,634][123091] Updated weights for policy 0, policy_version 1012224 (0.0009) [2023-12-26 07:40:27,685][123091] Updated weights for policy 0, policy_version 1012234 (0.0009) [2023-12-26 07:40:27,889][123090] Updated weights for policy 1, policy_version 1005186 (0.0006) [2023-12-26 07:40:27,947][123090] Updated weights for policy 1, policy_version 1005196 (0.0009) [2023-12-26 07:40:28,004][123090] Updated weights for policy 1, policy_version 1005206 (0.0009) [2023-12-26 07:40:28,059][123090] Updated weights for policy 1, policy_version 1005216 (0.0009) [2023-12-26 07:40:28,477][123091] Updated weights for policy 0, policy_version 1012244 (0.0009) [2023-12-26 07:40:28,540][123091] Updated weights for policy 0, policy_version 1012254 (0.0011) [2023-12-26 07:40:28,599][123091] Updated weights for policy 0, policy_version 1012264 (0.0010) [2023-12-26 07:40:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 516481024. Throughput: 0: 8834.3, 1: 9019.7. Samples: 516473876. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:28,785][121949] Avg episode reward: [(0, '6219.817'), (1, '5545.006')] [2023-12-26 07:40:28,809][123090] Updated weights for policy 1, policy_version 1005226 (0.0008) [2023-12-26 07:40:28,875][123090] Updated weights for policy 1, policy_version 1005236 (0.0009) [2023-12-26 07:40:28,935][123090] Updated weights for policy 1, policy_version 1005246 (0.0009) [2023-12-26 07:40:29,410][123091] Updated weights for policy 0, policy_version 1012274 (0.0011) [2023-12-26 07:40:29,468][123091] Updated weights for policy 0, policy_version 1012284 (0.0010) [2023-12-26 07:40:29,529][123091] Updated weights for policy 0, policy_version 1012294 (0.0010) [2023-12-26 07:40:29,589][123091] Updated weights for policy 0, policy_version 1012304 (0.0008) [2023-12-26 07:40:29,721][123090] Updated weights for policy 1, policy_version 1005256 (0.0009) [2023-12-26 07:40:29,781][123090] Updated weights for policy 1, policy_version 1005266 (0.0009) [2023-12-26 07:40:29,837][123090] Updated weights for policy 1, policy_version 1005276 (0.0009) [2023-12-26 07:40:30,256][123091] Updated weights for policy 0, policy_version 1012314 (0.0009) [2023-12-26 07:40:30,310][123091] Updated weights for policy 0, policy_version 1012324 (0.0009) [2023-12-26 07:40:30,366][123091] Updated weights for policy 0, policy_version 1012334 (0.0009) [2023-12-26 07:40:30,676][123090] Updated weights for policy 1, policy_version 1005286 (0.0007) [2023-12-26 07:40:30,747][123090] Updated weights for policy 1, policy_version 1005296 (0.0009) [2023-12-26 07:40:30,817][123090] Updated weights for policy 1, policy_version 1005306 (0.0009) [2023-12-26 07:40:31,243][123091] Updated weights for policy 0, policy_version 1012344 (0.0009) [2023-12-26 07:40:31,320][123091] Updated weights for policy 0, policy_version 1012354 (0.0009) [2023-12-26 07:40:31,389][123091] Updated weights for policy 0, policy_version 1012364 (0.0009) [2023-12-26 07:40:31,609][123090] Updated weights for policy 1, policy_version 1005316 (0.0008) [2023-12-26 07:40:31,671][123090] Updated weights for policy 1, policy_version 1005326 (0.0009) [2023-12-26 07:40:31,729][123090] Updated weights for policy 1, policy_version 1005336 (0.0009) [2023-12-26 07:40:32,229][123091] Updated weights for policy 0, policy_version 1012374 (0.0006) [2023-12-26 07:40:32,294][123091] Updated weights for policy 0, policy_version 1012384 (0.0006) [2023-12-26 07:40:32,366][123091] Updated weights for policy 0, policy_version 1012394 (0.0007) [2023-12-26 07:40:32,602][123090] Updated weights for policy 1, policy_version 1005346 (0.0008) [2023-12-26 07:40:32,655][123090] Updated weights for policy 1, policy_version 1005356 (0.0009) [2023-12-26 07:40:32,716][123090] Updated weights for policy 1, policy_version 1005366 (0.0009) [2023-12-26 07:40:32,780][123090] Updated weights for policy 1, policy_version 1005376 (0.0007) [2023-12-26 07:40:33,098][123091] Updated weights for policy 0, policy_version 1012404 (0.0007) [2023-12-26 07:40:33,149][123091] Updated weights for policy 0, policy_version 1012414 (0.0009) [2023-12-26 07:40:33,206][123091] Updated weights for policy 0, policy_version 1012424 (0.0009) [2023-12-26 07:40:33,537][123090] Updated weights for policy 1, policy_version 1005386 (0.0009) [2023-12-26 07:40:33,584][123090] Updated weights for policy 1, policy_version 1005396 (0.0009) [2023-12-26 07:40:33,632][123090] Updated weights for policy 1, policy_version 1005407 (0.0009) [2023-12-26 07:40:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 516571136. Throughput: 0: 8900.9, 1: 8930.3. Samples: 516580228. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 07:40:33,785][121949] Avg episode reward: [(0, '6293.767'), (1, '5587.113')] [2023-12-26 07:40:34,025][123091] Updated weights for policy 0, policy_version 1012434 (0.0009) [2023-12-26 07:40:34,071][123091] Updated weights for policy 0, policy_version 1012444 (0.0008) [2023-12-26 07:40:34,131][123091] Updated weights for policy 0, policy_version 1012454 (0.0009) [2023-12-26 07:40:34,192][123091] Updated weights for policy 0, policy_version 1012464 (0.0009) [2023-12-26 07:40:34,531][123090] Updated weights for policy 1, policy_version 1005417 (0.0010) [2023-12-26 07:40:34,586][123090] Updated weights for policy 1, policy_version 1005427 (0.0008) [2023-12-26 07:40:34,655][123090] Updated weights for policy 1, policy_version 1005437 (0.0009) [2023-12-26 07:40:35,026][123091] Updated weights for policy 0, policy_version 1012475 (0.0010) [2023-12-26 07:40:35,077][123091] Updated weights for policy 0, policy_version 1012485 (0.0010) [2023-12-26 07:40:35,134][123091] Updated weights for policy 0, policy_version 1012495 (0.0009) [2023-12-26 07:40:35,492][123090] Updated weights for policy 1, policy_version 1005447 (0.0010) [2023-12-26 07:40:35,556][123090] Updated weights for policy 1, policy_version 1005457 (0.0009) [2023-12-26 07:40:35,628][123090] Updated weights for policy 1, policy_version 1005467 (0.0009) [2023-12-26 07:40:35,788][123091] Updated weights for policy 0, policy_version 1012505 (0.0010) [2023-12-26 07:40:35,847][123091] Updated weights for policy 0, policy_version 1012515 (0.0009) [2023-12-26 07:40:35,904][123091] Updated weights for policy 0, policy_version 1012525 (0.0010) [2023-12-26 07:40:36,485][123090] Updated weights for policy 1, policy_version 1005477 (0.0008) [2023-12-26 07:40:36,550][123090] Updated weights for policy 1, policy_version 1005487 (0.0008) [2023-12-26 07:40:36,621][123090] Updated weights for policy 1, policy_version 1005497 (0.0008) [2023-12-26 07:40:36,650][123091] Updated weights for policy 0, policy_version 1012535 (0.0010) [2023-12-26 07:40:36,700][123091] Updated weights for policy 0, policy_version 1012545 (0.0009) [2023-12-26 07:40:36,750][123091] Updated weights for policy 0, policy_version 1012555 (0.0009) [2023-12-26 07:40:37,441][123090] Updated weights for policy 1, policy_version 1005507 (0.0007) [2023-12-26 07:40:37,510][123090] Updated weights for policy 1, policy_version 1005517 (0.0009) [2023-12-26 07:40:37,558][123091] Updated weights for policy 0, policy_version 1012565 (0.0008) [2023-12-26 07:40:37,571][123090] Updated weights for policy 1, policy_version 1005527 (0.0009) [2023-12-26 07:40:37,617][123091] Updated weights for policy 0, policy_version 1012575 (0.0010) [2023-12-26 07:40:37,673][123091] Updated weights for policy 0, policy_version 1012585 (0.0011) [2023-12-26 07:40:38,438][123090] Updated weights for policy 1, policy_version 1005537 (0.0009) [2023-12-26 07:40:38,456][123091] Updated weights for policy 0, policy_version 1012595 (0.0009) [2023-12-26 07:40:38,492][123090] Updated weights for policy 1, policy_version 1005547 (0.0009) [2023-12-26 07:40:38,510][123091] Updated weights for policy 0, policy_version 1012605 (0.0005) [2023-12-26 07:40:38,547][123090] Updated weights for policy 1, policy_version 1005557 (0.0008) [2023-12-26 07:40:38,575][123091] Updated weights for policy 0, policy_version 1012615 (0.0009) [2023-12-26 07:40:38,618][123090] Updated weights for policy 1, policy_version 1005567 (0.0009) [2023-12-26 07:40:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 516661248. Throughput: 0: 8941.4, 1: 8926.0. Samples: 516632576. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:40:38,785][121949] Avg episode reward: [(0, '6322.493'), (1, '5595.845')] [2023-12-26 07:40:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001012624_259235840.pth... [2023-12-26 07:40:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001005568_257425408.pth... [2023-12-26 07:40:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001011600_258973696.pth [2023-12-26 07:40:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001004544_257163264.pth [2023-12-26 07:40:39,401][123091] Updated weights for policy 0, policy_version 1012625 (0.0010) [2023-12-26 07:40:39,466][123091] Updated weights for policy 0, policy_version 1012635 (0.0010) [2023-12-26 07:40:39,468][123090] Updated weights for policy 1, policy_version 1005577 (0.0008) [2023-12-26 07:40:39,522][123091] Updated weights for policy 0, policy_version 1012645 (0.0011) [2023-12-26 07:40:39,538][123090] Updated weights for policy 1, policy_version 1005587 (0.0008) [2023-12-26 07:40:39,578][123091] Updated weights for policy 0, policy_version 1012655 (0.0011) [2023-12-26 07:40:39,608][123090] Updated weights for policy 1, policy_version 1005597 (0.0008) [2023-12-26 07:40:40,420][123090] Updated weights for policy 1, policy_version 1005607 (0.0008) [2023-12-26 07:40:40,429][123091] Updated weights for policy 0, policy_version 1012665 (0.0011) [2023-12-26 07:40:40,490][123090] Updated weights for policy 1, policy_version 1005617 (0.0007) [2023-12-26 07:40:40,491][123091] Updated weights for policy 0, policy_version 1012675 (0.0007) [2023-12-26 07:40:40,552][123091] Updated weights for policy 0, policy_version 1012685 (0.0005) [2023-12-26 07:40:40,553][123090] Updated weights for policy 1, policy_version 1005627 (0.0009) [2023-12-26 07:40:41,377][123090] Updated weights for policy 1, policy_version 1005637 (0.0008) [2023-12-26 07:40:41,388][123091] Updated weights for policy 0, policy_version 1012695 (0.0009) [2023-12-26 07:40:41,434][123090] Updated weights for policy 1, policy_version 1005647 (0.0006) [2023-12-26 07:40:41,445][123091] Updated weights for policy 0, policy_version 1012705 (0.0011) [2023-12-26 07:40:41,491][123090] Updated weights for policy 1, policy_version 1005657 (0.0007) [2023-12-26 07:40:41,519][123091] Updated weights for policy 0, policy_version 1012715 (0.0013) [2023-12-26 07:40:42,286][123091] Updated weights for policy 0, policy_version 1012725 (0.0009) [2023-12-26 07:40:42,337][123090] Updated weights for policy 1, policy_version 1005667 (0.0008) [2023-12-26 07:40:42,348][123091] Updated weights for policy 0, policy_version 1012735 (0.0009) [2023-12-26 07:40:42,406][123090] Updated weights for policy 1, policy_version 1005677 (0.0008) [2023-12-26 07:40:42,418][123091] Updated weights for policy 0, policy_version 1012745 (0.0009) [2023-12-26 07:40:42,475][123090] Updated weights for policy 1, policy_version 1005687 (0.0009) [2023-12-26 07:40:43,233][123090] Updated weights for policy 1, policy_version 1005697 (0.0010) [2023-12-26 07:40:43,278][123091] Updated weights for policy 0, policy_version 1012755 (0.0008) [2023-12-26 07:40:43,289][123090] Updated weights for policy 1, policy_version 1005707 (0.0009) [2023-12-26 07:40:43,331][123091] Updated weights for policy 0, policy_version 1012765 (0.0007) [2023-12-26 07:40:43,346][123090] Updated weights for policy 1, policy_version 1005717 (0.0010) [2023-12-26 07:40:43,392][123091] Updated weights for policy 0, policy_version 1012775 (0.0009) [2023-12-26 07:40:43,408][123090] Updated weights for policy 1, policy_version 1005727 (0.0007) [2023-12-26 07:40:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 516743168. Throughput: 0: 8922.3, 1: 8875.4. Samples: 516734536. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:40:43,786][121949] Avg episode reward: [(0, '6348.103'), (1, '5788.650')] [2023-12-26 07:40:44,158][123091] Updated weights for policy 0, policy_version 1012785 (0.0009) [2023-12-26 07:40:44,211][123091] Updated weights for policy 0, policy_version 1012795 (0.0009) [2023-12-26 07:40:44,261][123090] Updated weights for policy 1, policy_version 1005737 (0.0008) [2023-12-26 07:40:44,282][123091] Updated weights for policy 0, policy_version 1012805 (0.0008) [2023-12-26 07:40:44,320][123090] Updated weights for policy 1, policy_version 1005747 (0.0006) [2023-12-26 07:40:44,347][123091] Updated weights for policy 0, policy_version 1012815 (0.0010) [2023-12-26 07:40:44,368][123090] Updated weights for policy 1, policy_version 1005757 (0.0006) [2023-12-26 07:40:45,128][123091] Updated weights for policy 0, policy_version 1012825 (0.0006) [2023-12-26 07:40:45,207][123091] Updated weights for policy 0, policy_version 1012835 (0.0006) [2023-12-26 07:40:45,255][123090] Updated weights for policy 1, policy_version 1005767 (0.0007) [2023-12-26 07:40:45,269][123091] Updated weights for policy 0, policy_version 1012845 (0.0009) [2023-12-26 07:40:45,325][123090] Updated weights for policy 1, policy_version 1005777 (0.0008) [2023-12-26 07:40:45,389][123090] Updated weights for policy 1, policy_version 1005787 (0.0009) [2023-12-26 07:40:45,968][123091] Updated weights for policy 0, policy_version 1012855 (0.0006) [2023-12-26 07:40:46,022][123091] Updated weights for policy 0, policy_version 1012865 (0.0005) [2023-12-26 07:40:46,079][123091] Updated weights for policy 0, policy_version 1012875 (0.0005) [2023-12-26 07:40:46,131][123090] Updated weights for policy 1, policy_version 1005797 (0.0007) [2023-12-26 07:40:46,179][123090] Updated weights for policy 1, policy_version 1005807 (0.0005) [2023-12-26 07:40:46,234][123090] Updated weights for policy 1, policy_version 1005817 (0.0005) [2023-12-26 07:40:46,715][123091] Updated weights for policy 0, policy_version 1012885 (0.0006) [2023-12-26 07:40:46,773][123091] Updated weights for policy 0, policy_version 1012895 (0.0007) [2023-12-26 07:40:46,831][123091] Updated weights for policy 0, policy_version 1012905 (0.0005) [2023-12-26 07:40:47,067][123090] Updated weights for policy 1, policy_version 1005827 (0.0007) [2023-12-26 07:40:47,128][123090] Updated weights for policy 1, policy_version 1005838 (0.0009) [2023-12-26 07:40:47,193][123090] Updated weights for policy 1, policy_version 1005848 (0.0009) [2023-12-26 07:40:47,595][123091] Updated weights for policy 0, policy_version 1012915 (0.0007) [2023-12-26 07:40:47,661][123091] Updated weights for policy 0, policy_version 1012925 (0.0009) [2023-12-26 07:40:47,722][123091] Updated weights for policy 0, policy_version 1012935 (0.0011) [2023-12-26 07:40:47,938][123090] Updated weights for policy 1, policy_version 1005858 (0.0009) [2023-12-26 07:40:47,998][123090] Updated weights for policy 1, policy_version 1005868 (0.0009) [2023-12-26 07:40:48,054][123090] Updated weights for policy 1, policy_version 1005878 (0.0009) [2023-12-26 07:40:48,111][123090] Updated weights for policy 1, policy_version 1005888 (0.0010) [2023-12-26 07:40:48,376][123091] Updated weights for policy 0, policy_version 1012946 (0.0009) [2023-12-26 07:40:48,443][123091] Updated weights for policy 0, policy_version 1012956 (0.0010) [2023-12-26 07:40:48,505][123091] Updated weights for policy 0, policy_version 1012966 (0.0009) [2023-12-26 07:40:48,572][123091] Updated weights for policy 0, policy_version 1012976 (0.0009) [2023-12-26 07:40:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 516833280. Throughput: 0: 8940.7, 1: 8829.3. Samples: 516844156. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:40:48,785][121949] Avg episode reward: [(0, '6395.546'), (1, '5941.788')] [2023-12-26 07:40:48,959][123090] Updated weights for policy 1, policy_version 1005898 (0.0010) [2023-12-26 07:40:49,022][123090] Updated weights for policy 1, policy_version 1005908 (0.0009) [2023-12-26 07:40:49,085][123090] Updated weights for policy 1, policy_version 1005918 (0.0009) [2023-12-26 07:40:49,399][123091] Updated weights for policy 0, policy_version 1012986 (0.0010) [2023-12-26 07:40:49,461][123091] Updated weights for policy 0, policy_version 1012996 (0.0010) [2023-12-26 07:40:49,523][123091] Updated weights for policy 0, policy_version 1013006 (0.0011) [2023-12-26 07:40:49,953][123090] Updated weights for policy 1, policy_version 1005928 (0.0009) [2023-12-26 07:40:50,017][123090] Updated weights for policy 1, policy_version 1005938 (0.0009) [2023-12-26 07:40:50,082][123090] Updated weights for policy 1, policy_version 1005948 (0.0009) [2023-12-26 07:40:50,342][123091] Updated weights for policy 0, policy_version 1013016 (0.0011) [2023-12-26 07:40:50,399][123091] Updated weights for policy 0, policy_version 1013026 (0.0011) [2023-12-26 07:40:50,463][123091] Updated weights for policy 0, policy_version 1013036 (0.0011) [2023-12-26 07:40:50,917][123090] Updated weights for policy 1, policy_version 1005958 (0.0009) [2023-12-26 07:40:50,977][123090] Updated weights for policy 1, policy_version 1005968 (0.0009) [2023-12-26 07:40:51,032][123090] Updated weights for policy 1, policy_version 1005978 (0.0008) [2023-12-26 07:40:51,304][123091] Updated weights for policy 0, policy_version 1013046 (0.0008) [2023-12-26 07:40:51,375][123091] Updated weights for policy 0, policy_version 1013056 (0.0009) [2023-12-26 07:40:51,432][123091] Updated weights for policy 0, policy_version 1013066 (0.0010) [2023-12-26 07:40:51,867][123090] Updated weights for policy 1, policy_version 1005988 (0.0009) [2023-12-26 07:40:51,932][123090] Updated weights for policy 1, policy_version 1005998 (0.0010) [2023-12-26 07:40:52,004][123090] Updated weights for policy 1, policy_version 1006008 (0.0009) [2023-12-26 07:40:52,214][123091] Updated weights for policy 0, policy_version 1013076 (0.0010) [2023-12-26 07:40:52,279][123091] Updated weights for policy 0, policy_version 1013086 (0.0009) [2023-12-26 07:40:52,348][123091] Updated weights for policy 0, policy_version 1013096 (0.0010) [2023-12-26 07:40:52,889][123090] Updated weights for policy 1, policy_version 1006018 (0.0009) [2023-12-26 07:40:52,953][123090] Updated weights for policy 1, policy_version 1006028 (0.0009) [2023-12-26 07:40:53,014][123090] Updated weights for policy 1, policy_version 1006038 (0.0009) [2023-12-26 07:40:53,066][123090] Updated weights for policy 1, policy_version 1006048 (0.0009) [2023-12-26 07:40:53,089][123091] Updated weights for policy 0, policy_version 1013106 (0.0011) [2023-12-26 07:40:53,141][123091] Updated weights for policy 0, policy_version 1013116 (0.0011) [2023-12-26 07:40:53,204][123091] Updated weights for policy 0, policy_version 1013126 (0.0009) [2023-12-26 07:40:53,260][123091] Updated weights for policy 0, policy_version 1013136 (0.0005) [2023-12-26 07:40:53,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 516915200. Throughput: 0: 8830.9, 1: 8734.9. Samples: 516894968. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:40:53,785][121949] Avg episode reward: [(0, '6414.946'), (1, '5975.997')] [2023-12-26 07:40:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001006048_257548288.pth... [2023-12-26 07:40:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001013136_259366912.pth... [2023-12-26 07:40:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001005056_257294336.pth [2023-12-26 07:40:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001012112_259104768.pth [2023-12-26 07:40:53,971][123090] Updated weights for policy 1, policy_version 1006058 (0.0008) [2023-12-26 07:40:53,995][123091] Updated weights for policy 0, policy_version 1013146 (0.0011) [2023-12-26 07:40:54,036][123090] Updated weights for policy 1, policy_version 1006068 (0.0006) [2023-12-26 07:40:54,054][123091] Updated weights for policy 0, policy_version 1013156 (0.0009) [2023-12-26 07:40:54,101][123090] Updated weights for policy 1, policy_version 1006078 (0.0010) [2023-12-26 07:40:54,120][123091] Updated weights for policy 0, policy_version 1013166 (0.0006) [2023-12-26 07:40:54,883][123091] Updated weights for policy 0, policy_version 1013176 (0.0005) [2023-12-26 07:40:54,936][123091] Updated weights for policy 0, policy_version 1013186 (0.0005) [2023-12-26 07:40:54,961][123090] Updated weights for policy 1, policy_version 1006088 (0.0010) [2023-12-26 07:40:55,009][123091] Updated weights for policy 0, policy_version 1013196 (0.0006) [2023-12-26 07:40:55,021][123090] Updated weights for policy 1, policy_version 1006098 (0.0009) [2023-12-26 07:40:55,070][123090] Updated weights for policy 1, policy_version 1006108 (0.0007) [2023-12-26 07:40:55,681][123091] Updated weights for policy 0, policy_version 1013206 (0.0005) [2023-12-26 07:40:55,747][123091] Updated weights for policy 0, policy_version 1013216 (0.0005) [2023-12-26 07:40:55,818][123091] Updated weights for policy 0, policy_version 1013226 (0.0005) [2023-12-26 07:40:55,910][123090] Updated weights for policy 1, policy_version 1006118 (0.0008) [2023-12-26 07:40:55,968][123090] Updated weights for policy 1, policy_version 1006128 (0.0010) [2023-12-26 07:40:56,030][123090] Updated weights for policy 1, policy_version 1006138 (0.0010) [2023-12-26 07:40:56,404][123091] Updated weights for policy 0, policy_version 1013236 (0.0006) [2023-12-26 07:40:56,452][123091] Updated weights for policy 0, policy_version 1013246 (0.0005) [2023-12-26 07:40:56,512][123091] Updated weights for policy 0, policy_version 1013256 (0.0005) [2023-12-26 07:40:56,931][123090] Updated weights for policy 1, policy_version 1006148 (0.0010) [2023-12-26 07:40:56,983][123090] Updated weights for policy 1, policy_version 1006158 (0.0009) [2023-12-26 07:40:57,035][123090] Updated weights for policy 1, policy_version 1006168 (0.0006) [2023-12-26 07:40:57,174][123091] Updated weights for policy 0, policy_version 1013266 (0.0007) [2023-12-26 07:40:57,232][123091] Updated weights for policy 0, policy_version 1013276 (0.0005) [2023-12-26 07:40:57,289][123091] Updated weights for policy 0, policy_version 1013286 (0.0005) [2023-12-26 07:40:57,360][123091] Updated weights for policy 0, policy_version 1013296 (0.0007) [2023-12-26 07:40:57,810][123090] Updated weights for policy 1, policy_version 1006178 (0.0006) [2023-12-26 07:40:57,868][123090] Updated weights for policy 1, policy_version 1006188 (0.0010) [2023-12-26 07:40:57,924][123090] Updated weights for policy 1, policy_version 1006198 (0.0010) [2023-12-26 07:40:57,975][123090] Updated weights for policy 1, policy_version 1006208 (0.0009) [2023-12-26 07:40:58,104][123091] Updated weights for policy 0, policy_version 1013306 (0.0010) [2023-12-26 07:40:58,166][123091] Updated weights for policy 0, policy_version 1013316 (0.0010) [2023-12-26 07:40:58,215][123091] Updated weights for policy 0, policy_version 1013326 (0.0009) [2023-12-26 07:40:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 517005312. Throughput: 0: 8976.3, 1: 8624.1. Samples: 517002728. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:40:58,785][121949] Avg episode reward: [(0, '6365.264'), (1, '5940.799')] [2023-12-26 07:40:58,901][123090] Updated weights for policy 1, policy_version 1006218 (0.0010) [2023-12-26 07:40:58,961][123090] Updated weights for policy 1, policy_version 1006228 (0.0009) [2023-12-26 07:40:59,008][123090] Updated weights for policy 1, policy_version 1006238 (0.0009) [2023-12-26 07:40:59,073][123091] Updated weights for policy 0, policy_version 1013336 (0.0008) [2023-12-26 07:40:59,120][123091] Updated weights for policy 0, policy_version 1013346 (0.0009) [2023-12-26 07:40:59,174][123091] Updated weights for policy 0, policy_version 1013356 (0.0010) [2023-12-26 07:40:59,846][123090] Updated weights for policy 1, policy_version 1006248 (0.0009) [2023-12-26 07:40:59,914][123090] Updated weights for policy 1, policy_version 1006258 (0.0010) [2023-12-26 07:40:59,981][123091] Updated weights for policy 0, policy_version 1013366 (0.0007) [2023-12-26 07:40:59,981][123090] Updated weights for policy 1, policy_version 1006268 (0.0007) [2023-12-26 07:41:00,036][123091] Updated weights for policy 0, policy_version 1013376 (0.0007) [2023-12-26 07:41:00,097][123091] Updated weights for policy 0, policy_version 1013386 (0.0008) [2023-12-26 07:41:00,831][123091] Updated weights for policy 0, policy_version 1013396 (0.0008) [2023-12-26 07:41:00,854][123090] Updated weights for policy 1, policy_version 1006278 (0.0009) [2023-12-26 07:41:00,878][123091] Updated weights for policy 0, policy_version 1013406 (0.0005) [2023-12-26 07:41:00,907][123090] Updated weights for policy 1, policy_version 1006288 (0.0009) [2023-12-26 07:41:00,923][123091] Updated weights for policy 0, policy_version 1013416 (0.0005) [2023-12-26 07:41:00,959][123090] Updated weights for policy 1, policy_version 1006298 (0.0008) [2023-12-26 07:41:01,607][123091] Updated weights for policy 0, policy_version 1013426 (0.0006) [2023-12-26 07:41:01,670][123091] Updated weights for policy 0, policy_version 1013436 (0.0010) [2023-12-26 07:41:01,738][123091] Updated weights for policy 0, policy_version 1013446 (0.0008) [2023-12-26 07:41:01,802][123091] Updated weights for policy 0, policy_version 1013456 (0.0010) [2023-12-26 07:41:01,848][123090] Updated weights for policy 1, policy_version 1006308 (0.0009) [2023-12-26 07:41:01,909][123090] Updated weights for policy 1, policy_version 1006318 (0.0009) [2023-12-26 07:41:01,973][123090] Updated weights for policy 1, policy_version 1006328 (0.0008) [2023-12-26 07:41:02,634][123091] Updated weights for policy 0, policy_version 1013466 (0.0011) [2023-12-26 07:41:02,696][123091] Updated weights for policy 0, policy_version 1013476 (0.0010) [2023-12-26 07:41:02,761][123090] Updated weights for policy 1, policy_version 1006338 (0.0009) [2023-12-26 07:41:02,762][123091] Updated weights for policy 0, policy_version 1013486 (0.0011) [2023-12-26 07:41:02,821][123090] Updated weights for policy 1, policy_version 1006348 (0.0010) [2023-12-26 07:41:02,884][123090] Updated weights for policy 1, policy_version 1006358 (0.0010) [2023-12-26 07:41:02,947][123090] Updated weights for policy 1, policy_version 1006368 (0.0010) [2023-12-26 07:41:03,482][123091] Updated weights for policy 0, policy_version 1013496 (0.0007) [2023-12-26 07:41:03,535][123091] Updated weights for policy 0, policy_version 1013506 (0.0005) [2023-12-26 07:41:03,586][123091] Updated weights for policy 0, policy_version 1013516 (0.0005) [2023-12-26 07:41:03,773][123090] Updated weights for policy 1, policy_version 1006378 (0.0006) [2023-12-26 07:41:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 517095424. Throughput: 0: 8982.9, 1: 8521.2. Samples: 517107244. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:03,785][121949] Avg episode reward: [(0, '6338.886'), (1, '5932.205')] [2023-12-26 07:41:03,830][123090] Updated weights for policy 1, policy_version 1006388 (0.0005) [2023-12-26 07:41:03,895][123090] Updated weights for policy 1, policy_version 1006398 (0.0007) [2023-12-26 07:41:04,430][123091] Updated weights for policy 0, policy_version 1013526 (0.0009) [2023-12-26 07:41:04,478][123091] Updated weights for policy 0, policy_version 1013536 (0.0011) [2023-12-26 07:41:04,534][123091] Updated weights for policy 0, policy_version 1013546 (0.0010) [2023-12-26 07:41:04,597][123090] Updated weights for policy 1, policy_version 1006408 (0.0006) [2023-12-26 07:41:04,664][123090] Updated weights for policy 1, policy_version 1006418 (0.0005) [2023-12-26 07:41:04,715][123090] Updated weights for policy 1, policy_version 1006428 (0.0006) [2023-12-26 07:41:05,280][123091] Updated weights for policy 0, policy_version 1013556 (0.0011) [2023-12-26 07:41:05,323][123091] Updated weights for policy 0, policy_version 1013566 (0.0010) [2023-12-26 07:41:05,377][123091] Updated weights for policy 0, policy_version 1013576 (0.0010) [2023-12-26 07:41:05,404][123090] Updated weights for policy 1, policy_version 1006438 (0.0005) [2023-12-26 07:41:05,451][123090] Updated weights for policy 1, policy_version 1006448 (0.0005) [2023-12-26 07:41:05,497][123090] Updated weights for policy 1, policy_version 1006458 (0.0005) [2023-12-26 07:41:06,222][123091] Updated weights for policy 0, policy_version 1013586 (0.0011) [2023-12-26 07:41:06,256][123090] Updated weights for policy 1, policy_version 1006469 (0.0008) [2023-12-26 07:41:06,274][123091] Updated weights for policy 0, policy_version 1013596 (0.0011) [2023-12-26 07:41:06,316][123090] Updated weights for policy 1, policy_version 1006479 (0.0007) [2023-12-26 07:41:06,322][123091] Updated weights for policy 0, policy_version 1013606 (0.0010) [2023-12-26 07:41:06,377][123090] Updated weights for policy 1, policy_version 1006489 (0.0005) [2023-12-26 07:41:06,382][123091] Updated weights for policy 0, policy_version 1013616 (0.0011) [2023-12-26 07:41:07,113][123091] Updated weights for policy 0, policy_version 1013626 (0.0010) [2023-12-26 07:41:07,168][123091] Updated weights for policy 0, policy_version 1013636 (0.0010) [2023-12-26 07:41:07,219][123091] Updated weights for policy 0, policy_version 1013646 (0.0010) [2023-12-26 07:41:07,235][123090] Updated weights for policy 1, policy_version 1006499 (0.0008) [2023-12-26 07:41:07,301][123090] Updated weights for policy 1, policy_version 1006509 (0.0009) [2023-12-26 07:41:07,365][123090] Updated weights for policy 1, policy_version 1006519 (0.0009) [2023-12-26 07:41:08,010][123091] Updated weights for policy 0, policy_version 1013656 (0.0009) [2023-12-26 07:41:08,063][123091] Updated weights for policy 0, policy_version 1013666 (0.0009) [2023-12-26 07:41:08,118][123091] Updated weights for policy 0, policy_version 1013676 (0.0010) [2023-12-26 07:41:08,210][123090] Updated weights for policy 1, policy_version 1006529 (0.0009) [2023-12-26 07:41:08,264][123090] Updated weights for policy 1, policy_version 1006539 (0.0008) [2023-12-26 07:41:08,312][123090] Updated weights for policy 1, policy_version 1006549 (0.0010) [2023-12-26 07:41:08,383][123090] Updated weights for policy 1, policy_version 1006559 (0.0011) [2023-12-26 07:41:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 517185536. Throughput: 0: 9021.3, 1: 8628.3. Samples: 517163216. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:08,785][121949] Avg episode reward: [(0, '6297.608'), (1, '5935.563')] [2023-12-26 07:41:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001013680_259506176.pth... [2023-12-26 07:41:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001006560_257679360.pth... [2023-12-26 07:41:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001005568_257425408.pth [2023-12-26 07:41:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001012624_259235840.pth [2023-12-26 07:41:08,988][123091] Updated weights for policy 0, policy_version 1013687 (0.0007) [2023-12-26 07:41:09,056][123091] Updated weights for policy 0, policy_version 1013697 (0.0006) [2023-12-26 07:41:09,106][123091] Updated weights for policy 0, policy_version 1013707 (0.0006) [2023-12-26 07:41:09,170][123090] Updated weights for policy 1, policy_version 1006569 (0.0006) [2023-12-26 07:41:09,239][123090] Updated weights for policy 1, policy_version 1006579 (0.0008) [2023-12-26 07:41:09,296][123090] Updated weights for policy 1, policy_version 1006589 (0.0010) [2023-12-26 07:41:09,952][123091] Updated weights for policy 0, policy_version 1013717 (0.0008) [2023-12-26 07:41:10,026][123091] Updated weights for policy 0, policy_version 1013727 (0.0009) [2023-12-26 07:41:10,081][123090] Updated weights for policy 1, policy_version 1006599 (0.0007) [2023-12-26 07:41:10,091][123091] Updated weights for policy 0, policy_version 1013737 (0.0009) [2023-12-26 07:41:10,151][123090] Updated weights for policy 1, policy_version 1006609 (0.0008) [2023-12-26 07:41:10,215][123090] Updated weights for policy 1, policy_version 1006619 (0.0011) [2023-12-26 07:41:10,928][123090] Updated weights for policy 1, policy_version 1006629 (0.0008) [2023-12-26 07:41:10,964][123091] Updated weights for policy 0, policy_version 1013747 (0.0008) [2023-12-26 07:41:11,000][123090] Updated weights for policy 1, policy_version 1006639 (0.0005) [2023-12-26 07:41:11,041][123091] Updated weights for policy 0, policy_version 1013757 (0.0008) [2023-12-26 07:41:11,076][123090] Updated weights for policy 1, policy_version 1006649 (0.0008) [2023-12-26 07:41:11,109][123091] Updated weights for policy 0, policy_version 1013767 (0.0008) [2023-12-26 07:41:11,873][123090] Updated weights for policy 1, policy_version 1006659 (0.0009) [2023-12-26 07:41:11,934][123090] Updated weights for policy 1, policy_version 1006669 (0.0009) [2023-12-26 07:41:11,954][123091] Updated weights for policy 0, policy_version 1013777 (0.0009) [2023-12-26 07:41:11,994][123090] Updated weights for policy 1, policy_version 1006679 (0.0010) [2023-12-26 07:41:12,012][123091] Updated weights for policy 0, policy_version 1013787 (0.0009) [2023-12-26 07:41:12,062][123091] Updated weights for policy 0, policy_version 1013797 (0.0007) [2023-12-26 07:41:12,115][123091] Updated weights for policy 0, policy_version 1013807 (0.0008) [2023-12-26 07:41:12,844][123090] Updated weights for policy 1, policy_version 1006689 (0.0010) [2023-12-26 07:41:12,896][123090] Updated weights for policy 1, policy_version 1006699 (0.0009) [2023-12-26 07:41:12,960][123090] Updated weights for policy 1, policy_version 1006709 (0.0010) [2023-12-26 07:41:13,002][123091] Updated weights for policy 0, policy_version 1013817 (0.0008) [2023-12-26 07:41:13,020][123090] Updated weights for policy 1, policy_version 1006719 (0.0009) [2023-12-26 07:41:13,059][123091] Updated weights for policy 0, policy_version 1013827 (0.0008) [2023-12-26 07:41:13,109][123091] Updated weights for policy 0, policy_version 1013837 (0.0010) [2023-12-26 07:41:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 517267456. Throughput: 0: 9028.3, 1: 8566.9. Samples: 517265664. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:13,785][121949] Avg episode reward: [(0, '6274.636'), (1, '5741.725')] [2023-12-26 07:41:13,833][123090] Updated weights for policy 1, policy_version 1006729 (0.0006) [2023-12-26 07:41:13,909][123090] Updated weights for policy 1, policy_version 1006739 (0.0006) [2023-12-26 07:41:13,933][123091] Updated weights for policy 0, policy_version 1013847 (0.0009) [2023-12-26 07:41:13,973][123090] Updated weights for policy 1, policy_version 1006749 (0.0005) [2023-12-26 07:41:13,998][123091] Updated weights for policy 0, policy_version 1013857 (0.0009) [2023-12-26 07:41:14,051][123091] Updated weights for policy 0, policy_version 1013867 (0.0009) [2023-12-26 07:41:14,676][123090] Updated weights for policy 1, policy_version 1006759 (0.0007) [2023-12-26 07:41:14,734][123090] Updated weights for policy 1, policy_version 1006769 (0.0007) [2023-12-26 07:41:14,809][123090] Updated weights for policy 1, policy_version 1006779 (0.0008) [2023-12-26 07:41:14,909][123091] Updated weights for policy 0, policy_version 1013877 (0.0008) [2023-12-26 07:41:14,977][123091] Updated weights for policy 0, policy_version 1013887 (0.0009) [2023-12-26 07:41:15,043][123091] Updated weights for policy 0, policy_version 1013897 (0.0010) [2023-12-26 07:41:15,573][123090] Updated weights for policy 1, policy_version 1006789 (0.0008) [2023-12-26 07:41:15,625][123090] Updated weights for policy 1, policy_version 1006799 (0.0005) [2023-12-26 07:41:15,681][123090] Updated weights for policy 1, policy_version 1006809 (0.0005) [2023-12-26 07:41:15,948][123091] Updated weights for policy 0, policy_version 1013907 (0.0009) [2023-12-26 07:41:16,005][123091] Updated weights for policy 0, policy_version 1013917 (0.0009) [2023-12-26 07:41:16,061][123091] Updated weights for policy 0, policy_version 1013927 (0.0010) [2023-12-26 07:41:16,345][123090] Updated weights for policy 1, policy_version 1006819 (0.0005) [2023-12-26 07:41:16,404][123090] Updated weights for policy 1, policy_version 1006829 (0.0005) [2023-12-26 07:41:16,469][123090] Updated weights for policy 1, policy_version 1006839 (0.0005) [2023-12-26 07:41:16,894][123091] Updated weights for policy 0, policy_version 1013937 (0.0010) [2023-12-26 07:41:16,947][123091] Updated weights for policy 0, policy_version 1013947 (0.0010) [2023-12-26 07:41:17,000][123091] Updated weights for policy 0, policy_version 1013957 (0.0009) [2023-12-26 07:41:17,058][123091] Updated weights for policy 0, policy_version 1013967 (0.0010) [2023-12-26 07:41:17,148][123090] Updated weights for policy 1, policy_version 1006849 (0.0006) [2023-12-26 07:41:17,212][123090] Updated weights for policy 1, policy_version 1006859 (0.0009) [2023-12-26 07:41:17,274][123090] Updated weights for policy 1, policy_version 1006869 (0.0010) [2023-12-26 07:41:17,336][123090] Updated weights for policy 1, policy_version 1006879 (0.0010) [2023-12-26 07:41:17,924][123091] Updated weights for policy 0, policy_version 1013977 (0.0009) [2023-12-26 07:41:17,988][123091] Updated weights for policy 0, policy_version 1013987 (0.0010) [2023-12-26 07:41:18,057][123091] Updated weights for policy 0, policy_version 1013997 (0.0009) [2023-12-26 07:41:18,087][123090] Updated weights for policy 1, policy_version 1006889 (0.0006) [2023-12-26 07:41:18,153][123090] Updated weights for policy 1, policy_version 1006899 (0.0009) [2023-12-26 07:41:18,216][123090] Updated weights for policy 1, policy_version 1006909 (0.0010) [2023-12-26 07:41:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 517357568. Throughput: 0: 8948.7, 1: 8648.6. Samples: 517372108. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:18,785][121949] Avg episode reward: [(0, '6340.900'), (1, '5654.712')] [2023-12-26 07:41:18,898][123091] Updated weights for policy 0, policy_version 1014007 (0.0009) [2023-12-26 07:41:18,950][123091] Updated weights for policy 0, policy_version 1014017 (0.0009) [2023-12-26 07:41:19,010][123091] Updated weights for policy 0, policy_version 1014027 (0.0010) [2023-12-26 07:41:19,026][123090] Updated weights for policy 1, policy_version 1006919 (0.0007) [2023-12-26 07:41:19,091][123090] Updated weights for policy 1, policy_version 1006929 (0.0005) [2023-12-26 07:41:19,157][123090] Updated weights for policy 1, policy_version 1006939 (0.0005) [2023-12-26 07:41:19,849][123090] Updated weights for policy 1, policy_version 1006949 (0.0006) [2023-12-26 07:41:19,912][123091] Updated weights for policy 0, policy_version 1014037 (0.0008) [2023-12-26 07:41:19,918][123090] Updated weights for policy 1, policy_version 1006959 (0.0010) [2023-12-26 07:41:19,984][123091] Updated weights for policy 0, policy_version 1014047 (0.0008) [2023-12-26 07:41:19,985][123090] Updated weights for policy 1, policy_version 1006969 (0.0010) [2023-12-26 07:41:20,050][123091] Updated weights for policy 0, policy_version 1014057 (0.0007) [2023-12-26 07:41:20,730][123090] Updated weights for policy 1, policy_version 1006979 (0.0010) [2023-12-26 07:41:20,793][123090] Updated weights for policy 1, policy_version 1006989 (0.0009) [2023-12-26 07:41:20,856][123090] Updated weights for policy 1, policy_version 1006999 (0.0009) [2023-12-26 07:41:20,942][123091] Updated weights for policy 0, policy_version 1014067 (0.0009) [2023-12-26 07:41:20,997][123091] Updated weights for policy 0, policy_version 1014077 (0.0009) [2023-12-26 07:41:21,068][123091] Updated weights for policy 0, policy_version 1014087 (0.0009) [2023-12-26 07:41:21,723][123090] Updated weights for policy 1, policy_version 1007009 (0.0008) [2023-12-26 07:41:21,790][123090] Updated weights for policy 1, policy_version 1007019 (0.0008) [2023-12-26 07:41:21,854][123090] Updated weights for policy 1, policy_version 1007029 (0.0007) [2023-12-26 07:41:21,916][123090] Updated weights for policy 1, policy_version 1007039 (0.0006) [2023-12-26 07:41:21,970][123091] Updated weights for policy 0, policy_version 1014097 (0.0009) [2023-12-26 07:41:22,024][123091] Updated weights for policy 0, policy_version 1014108 (0.0010) [2023-12-26 07:41:22,087][123091] Updated weights for policy 0, policy_version 1014118 (0.0005) [2023-12-26 07:41:22,148][123091] Updated weights for policy 0, policy_version 1014128 (0.0006) [2023-12-26 07:41:22,627][123090] Updated weights for policy 1, policy_version 1007049 (0.0008) [2023-12-26 07:41:22,702][123090] Updated weights for policy 1, policy_version 1007059 (0.0011) [2023-12-26 07:41:22,777][123090] Updated weights for policy 1, policy_version 1007069 (0.0011) [2023-12-26 07:41:22,858][123091] Updated weights for policy 0, policy_version 1014138 (0.0009) [2023-12-26 07:41:22,926][123091] Updated weights for policy 0, policy_version 1014148 (0.0009) [2023-12-26 07:41:22,995][123091] Updated weights for policy 0, policy_version 1014158 (0.0009) [2023-12-26 07:41:23,562][123090] Updated weights for policy 1, policy_version 1007079 (0.0011) [2023-12-26 07:41:23,609][123090] Updated weights for policy 1, policy_version 1007089 (0.0007) [2023-12-26 07:41:23,655][123090] Updated weights for policy 1, policy_version 1007099 (0.0005) [2023-12-26 07:41:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 517447680. Throughput: 0: 8876.2, 1: 8685.3. Samples: 517422840. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:23,785][121949] Avg episode reward: [(0, '6299.882'), (1, '5747.478')] [2023-12-26 07:41:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001007104_257818624.pth... [2023-12-26 07:41:23,791][123091] Updated weights for policy 0, policy_version 1014168 (0.0009) [2023-12-26 07:41:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001006048_257548288.pth [2023-12-26 07:41:23,844][123091] Updated weights for policy 0, policy_version 1014178 (0.0008) [2023-12-26 07:41:23,905][123091] Updated weights for policy 0, policy_version 1014188 (0.0009) [2023-12-26 07:41:23,925][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001014192_259637248.pth... [2023-12-26 07:41:23,928][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001013136_259366912.pth [2023-12-26 07:41:24,477][123090] Updated weights for policy 1, policy_version 1007109 (0.0007) [2023-12-26 07:41:24,547][123090] Updated weights for policy 1, policy_version 1007119 (0.0007) [2023-12-26 07:41:24,613][123090] Updated weights for policy 1, policy_version 1007129 (0.0007) [2023-12-26 07:41:24,745][123091] Updated weights for policy 0, policy_version 1014198 (0.0009) [2023-12-26 07:41:24,818][123091] Updated weights for policy 0, policy_version 1014208 (0.0009) [2023-12-26 07:41:24,895][123091] Updated weights for policy 0, policy_version 1014218 (0.0009) [2023-12-26 07:41:25,374][123090] Updated weights for policy 1, policy_version 1007139 (0.0009) [2023-12-26 07:41:25,428][123090] Updated weights for policy 1, policy_version 1007149 (0.0005) [2023-12-26 07:41:25,482][123090] Updated weights for policy 1, policy_version 1007159 (0.0005) [2023-12-26 07:41:25,719][123091] Updated weights for policy 0, policy_version 1014228 (0.0009) [2023-12-26 07:41:25,767][123091] Updated weights for policy 0, policy_version 1014238 (0.0009) [2023-12-26 07:41:25,827][123091] Updated weights for policy 0, policy_version 1014248 (0.0009) [2023-12-26 07:41:26,262][123090] Updated weights for policy 1, policy_version 1007169 (0.0006) [2023-12-26 07:41:26,330][123090] Updated weights for policy 1, policy_version 1007179 (0.0005) [2023-12-26 07:41:26,382][123090] Updated weights for policy 1, policy_version 1007189 (0.0005) [2023-12-26 07:41:26,440][123090] Updated weights for policy 1, policy_version 1007199 (0.0005) [2023-12-26 07:41:26,672][123091] Updated weights for policy 0, policy_version 1014258 (0.0009) [2023-12-26 07:41:26,740][123091] Updated weights for policy 0, policy_version 1014268 (0.0010) [2023-12-26 07:41:26,805][123091] Updated weights for policy 0, policy_version 1014278 (0.0009) [2023-12-26 07:41:26,884][123091] Updated weights for policy 0, policy_version 1014288 (0.0010) [2023-12-26 07:41:27,049][123090] Updated weights for policy 1, policy_version 1007209 (0.0005) [2023-12-26 07:41:27,096][123090] Updated weights for policy 1, policy_version 1007219 (0.0005) [2023-12-26 07:41:27,146][123090] Updated weights for policy 1, policy_version 1007229 (0.0005) [2023-12-26 07:41:27,672][123091] Updated weights for policy 0, policy_version 1014298 (0.0005) [2023-12-26 07:41:27,749][123091] Updated weights for policy 0, policy_version 1014308 (0.0006) [2023-12-26 07:41:27,775][123090] Updated weights for policy 1, policy_version 1007239 (0.0005) [2023-12-26 07:41:27,809][123091] Updated weights for policy 0, policy_version 1014318 (0.0008) [2023-12-26 07:41:27,839][123090] Updated weights for policy 1, policy_version 1007249 (0.0006) [2023-12-26 07:41:27,901][123090] Updated weights for policy 1, policy_version 1007259 (0.0008) [2023-12-26 07:41:28,449][123091] Updated weights for policy 0, policy_version 1014328 (0.0006) [2023-12-26 07:41:28,526][123091] Updated weights for policy 0, policy_version 1014338 (0.0005) [2023-12-26 07:41:28,591][123091] Updated weights for policy 0, policy_version 1014348 (0.0005) [2023-12-26 07:41:28,633][123090] Updated weights for policy 1, policy_version 1007269 (0.0007) [2023-12-26 07:41:28,701][123090] Updated weights for policy 1, policy_version 1007279 (0.0005) [2023-12-26 07:41:28,776][123090] Updated weights for policy 1, policy_version 1007289 (0.0008) [2023-12-26 07:41:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 517537792. Throughput: 0: 8872.4, 1: 8836.6. Samples: 517531436. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:28,784][121949] Avg episode reward: [(0, '6329.821'), (1, '5673.435')] [2023-12-26 07:41:29,350][123091] Updated weights for policy 0, policy_version 1014358 (0.0007) [2023-12-26 07:41:29,415][123091] Updated weights for policy 0, policy_version 1014368 (0.0009) [2023-12-26 07:41:29,486][123091] Updated weights for policy 0, policy_version 1014378 (0.0009) [2023-12-26 07:41:29,525][123090] Updated weights for policy 1, policy_version 1007299 (0.0008) [2023-12-26 07:41:29,579][123090] Updated weights for policy 1, policy_version 1007309 (0.0006) [2023-12-26 07:41:29,646][123090] Updated weights for policy 1, policy_version 1007319 (0.0008) [2023-12-26 07:41:30,284][123091] Updated weights for policy 0, policy_version 1014388 (0.0008) [2023-12-26 07:41:30,349][123091] Updated weights for policy 0, policy_version 1014398 (0.0010) [2023-12-26 07:41:30,396][123091] Updated weights for policy 0, policy_version 1014408 (0.0010) [2023-12-26 07:41:30,415][123090] Updated weights for policy 1, policy_version 1007329 (0.0008) [2023-12-26 07:41:30,477][123090] Updated weights for policy 1, policy_version 1007339 (0.0010) [2023-12-26 07:41:30,539][123090] Updated weights for policy 1, policy_version 1007349 (0.0010) [2023-12-26 07:41:30,590][123090] Updated weights for policy 1, policy_version 1007359 (0.0010) [2023-12-26 07:41:31,134][123091] Updated weights for policy 0, policy_version 1014418 (0.0010) [2023-12-26 07:41:31,194][123091] Updated weights for policy 0, policy_version 1014429 (0.0010) [2023-12-26 07:41:31,245][123091] Updated weights for policy 0, policy_version 1014439 (0.0010) [2023-12-26 07:41:31,370][123090] Updated weights for policy 1, policy_version 1007369 (0.0011) [2023-12-26 07:41:31,430][123090] Updated weights for policy 1, policy_version 1007379 (0.0010) [2023-12-26 07:41:31,504][123090] Updated weights for policy 1, policy_version 1007389 (0.0010) [2023-12-26 07:41:32,193][123091] Updated weights for policy 0, policy_version 1014449 (0.0009) [2023-12-26 07:41:32,197][123090] Updated weights for policy 1, policy_version 1007399 (0.0009) [2023-12-26 07:41:32,252][123090] Updated weights for policy 1, policy_version 1007409 (0.0010) [2023-12-26 07:41:32,259][123091] Updated weights for policy 0, policy_version 1014459 (0.0009) [2023-12-26 07:41:32,312][123090] Updated weights for policy 1, policy_version 1007419 (0.0010) [2023-12-26 07:41:32,319][123091] Updated weights for policy 0, policy_version 1014469 (0.0006) [2023-12-26 07:41:32,388][123091] Updated weights for policy 0, policy_version 1014479 (0.0009) [2023-12-26 07:41:33,039][123090] Updated weights for policy 1, policy_version 1007429 (0.0008) [2023-12-26 07:41:33,088][123090] Updated weights for policy 1, policy_version 1007439 (0.0008) [2023-12-26 07:41:33,137][123090] Updated weights for policy 1, policy_version 1007449 (0.0010) [2023-12-26 07:41:33,246][123091] Updated weights for policy 0, policy_version 1014489 (0.0010) [2023-12-26 07:41:33,311][123091] Updated weights for policy 0, policy_version 1014499 (0.0009) [2023-12-26 07:41:33,372][123091] Updated weights for policy 0, policy_version 1014509 (0.0009) [2023-12-26 07:41:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 517627904. Throughput: 0: 8772.6, 1: 8939.8. Samples: 517641216. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:33,784][121949] Avg episode reward: [(0, '6486.828'), (1, '5619.314')] [2023-12-26 07:41:33,886][123090] Updated weights for policy 1, policy_version 1007459 (0.0006) [2023-12-26 07:41:33,932][123090] Updated weights for policy 1, policy_version 1007469 (0.0009) [2023-12-26 07:41:33,978][123090] Updated weights for policy 1, policy_version 1007479 (0.0008) [2023-12-26 07:41:34,200][123091] Updated weights for policy 0, policy_version 1014519 (0.0011) [2023-12-26 07:41:34,260][123091] Updated weights for policy 0, policy_version 1014529 (0.0010) [2023-12-26 07:41:34,328][123091] Updated weights for policy 0, policy_version 1014539 (0.0010) [2023-12-26 07:41:34,840][123090] Updated weights for policy 1, policy_version 1007489 (0.0009) [2023-12-26 07:41:34,905][123090] Updated weights for policy 1, policy_version 1007499 (0.0009) [2023-12-26 07:41:34,953][123090] Updated weights for policy 1, policy_version 1007509 (0.0009) [2023-12-26 07:41:35,003][123090] Updated weights for policy 1, policy_version 1007519 (0.0009) [2023-12-26 07:41:35,144][123091] Updated weights for policy 0, policy_version 1014549 (0.0007) [2023-12-26 07:41:35,200][123091] Updated weights for policy 0, policy_version 1014559 (0.0005) [2023-12-26 07:41:35,249][123091] Updated weights for policy 0, policy_version 1014569 (0.0009) [2023-12-26 07:41:35,869][123090] Updated weights for policy 1, policy_version 1007529 (0.0009) [2023-12-26 07:41:35,922][123090] Updated weights for policy 1, policy_version 1007539 (0.0010) [2023-12-26 07:41:35,975][123090] Updated weights for policy 1, policy_version 1007549 (0.0010) [2023-12-26 07:41:36,023][123091] Updated weights for policy 0, policy_version 1014579 (0.0009) [2023-12-26 07:41:36,088][123091] Updated weights for policy 0, policy_version 1014589 (0.0005) [2023-12-26 07:41:36,159][123091] Updated weights for policy 0, policy_version 1014599 (0.0007) [2023-12-26 07:41:36,892][123090] Updated weights for policy 1, policy_version 1007559 (0.0008) [2023-12-26 07:41:36,937][123091] Updated weights for policy 0, policy_version 1014609 (0.0006) [2023-12-26 07:41:36,953][123090] Updated weights for policy 1, policy_version 1007569 (0.0009) [2023-12-26 07:41:36,988][123091] Updated weights for policy 0, policy_version 1014619 (0.0010) [2023-12-26 07:41:37,012][123090] Updated weights for policy 1, policy_version 1007579 (0.0008) [2023-12-26 07:41:37,039][123091] Updated weights for policy 0, policy_version 1014629 (0.0011) [2023-12-26 07:41:37,107][123091] Updated weights for policy 0, policy_version 1014639 (0.0011) [2023-12-26 07:41:37,798][123091] Updated weights for policy 0, policy_version 1014649 (0.0006) [2023-12-26 07:41:37,867][123091] Updated weights for policy 0, policy_version 1014659 (0.0005) [2023-12-26 07:41:37,883][123090] Updated weights for policy 1, policy_version 1007589 (0.0008) [2023-12-26 07:41:37,929][123091] Updated weights for policy 0, policy_version 1014669 (0.0008) [2023-12-26 07:41:37,938][123090] Updated weights for policy 1, policy_version 1007599 (0.0009) [2023-12-26 07:41:38,006][123090] Updated weights for policy 1, policy_version 1007609 (0.0008) [2023-12-26 07:41:38,579][123091] Updated weights for policy 0, policy_version 1014679 (0.0010) [2023-12-26 07:41:38,629][123091] Updated weights for policy 0, policy_version 1014689 (0.0009) [2023-12-26 07:41:38,679][123091] Updated weights for policy 0, policy_version 1014699 (0.0010) [2023-12-26 07:41:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 517718016. Throughput: 0: 8813.6, 1: 8926.1. Samples: 517693256. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:38,785][121949] Avg episode reward: [(0, '6387.194'), (1, '5437.834')] [2023-12-26 07:41:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001014704_259768320.pth... [2023-12-26 07:41:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001007616_257949696.pth... [2023-12-26 07:41:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001006560_257679360.pth [2023-12-26 07:41:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001013680_259506176.pth [2023-12-26 07:41:38,868][123090] Updated weights for policy 1, policy_version 1007619 (0.0009) [2023-12-26 07:41:38,934][123090] Updated weights for policy 1, policy_version 1007629 (0.0009) [2023-12-26 07:41:39,004][123090] Updated weights for policy 1, policy_version 1007639 (0.0009) [2023-12-26 07:41:39,556][123091] Updated weights for policy 0, policy_version 1014710 (0.0010) [2023-12-26 07:41:39,621][123091] Updated weights for policy 0, policy_version 1014720 (0.0010) [2023-12-26 07:41:39,691][123091] Updated weights for policy 0, policy_version 1014730 (0.0010) [2023-12-26 07:41:39,872][123090] Updated weights for policy 1, policy_version 1007649 (0.0009) [2023-12-26 07:41:39,933][123090] Updated weights for policy 1, policy_version 1007659 (0.0008) [2023-12-26 07:41:40,000][123090] Updated weights for policy 1, policy_version 1007669 (0.0009) [2023-12-26 07:41:40,054][123090] Updated weights for policy 1, policy_version 1007679 (0.0009) [2023-12-26 07:41:40,450][123091] Updated weights for policy 0, policy_version 1014740 (0.0007) [2023-12-26 07:41:40,507][123091] Updated weights for policy 0, policy_version 1014750 (0.0005) [2023-12-26 07:41:40,577][123091] Updated weights for policy 0, policy_version 1014760 (0.0009) [2023-12-26 07:41:40,907][123090] Updated weights for policy 1, policy_version 1007689 (0.0009) [2023-12-26 07:41:40,958][123090] Updated weights for policy 1, policy_version 1007699 (0.0008) [2023-12-26 07:41:41,006][123090] Updated weights for policy 1, policy_version 1007709 (0.0008) [2023-12-26 07:41:41,461][123091] Updated weights for policy 0, policy_version 1014770 (0.0010) [2023-12-26 07:41:41,523][123091] Updated weights for policy 0, policy_version 1014780 (0.0009) [2023-12-26 07:41:41,579][123091] Updated weights for policy 0, policy_version 1014790 (0.0010) [2023-12-26 07:41:41,648][123091] Updated weights for policy 0, policy_version 1014800 (0.0009) [2023-12-26 07:41:41,907][123090] Updated weights for policy 1, policy_version 1007719 (0.0009) [2023-12-26 07:41:41,970][123090] Updated weights for policy 1, policy_version 1007729 (0.0010) [2023-12-26 07:41:42,035][123090] Updated weights for policy 1, policy_version 1007739 (0.0009) [2023-12-26 07:41:42,534][123091] Updated weights for policy 0, policy_version 1014810 (0.0010) [2023-12-26 07:41:42,598][123091] Updated weights for policy 0, policy_version 1014820 (0.0010) [2023-12-26 07:41:42,671][123091] Updated weights for policy 0, policy_version 1014830 (0.0010) [2023-12-26 07:41:42,874][123090] Updated weights for policy 1, policy_version 1007749 (0.0009) [2023-12-26 07:41:42,924][123090] Updated weights for policy 1, policy_version 1007759 (0.0009) [2023-12-26 07:41:42,982][123090] Updated weights for policy 1, policy_version 1007770 (0.0010) [2023-12-26 07:41:43,405][123091] Updated weights for policy 0, policy_version 1014840 (0.0010) [2023-12-26 07:41:43,463][123091] Updated weights for policy 0, policy_version 1014851 (0.0010) [2023-12-26 07:41:43,516][123091] Updated weights for policy 0, policy_version 1014861 (0.0010) [2023-12-26 07:41:43,752][123090] Updated weights for policy 1, policy_version 1007780 (0.0007) [2023-12-26 07:41:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 517799936. Throughput: 0: 8674.4, 1: 8930.6. Samples: 517794952. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:43,784][121949] Avg episode reward: [(0, '6383.404'), (1, '5406.460')] [2023-12-26 07:41:43,806][123090] Updated weights for policy 1, policy_version 1007790 (0.0005) [2023-12-26 07:41:43,859][123090] Updated weights for policy 1, policy_version 1007800 (0.0005) [2023-12-26 07:41:44,451][123090] Updated weights for policy 1, policy_version 1007810 (0.0005) [2023-12-26 07:41:44,462][123091] Updated weights for policy 0, policy_version 1014871 (0.0009) [2023-12-26 07:41:44,505][123090] Updated weights for policy 1, policy_version 1007820 (0.0006) [2023-12-26 07:41:44,513][123091] Updated weights for policy 0, policy_version 1014881 (0.0008) [2023-12-26 07:41:44,569][123090] Updated weights for policy 1, policy_version 1007830 (0.0010) [2023-12-26 07:41:44,574][123091] Updated weights for policy 0, policy_version 1014891 (0.0010) [2023-12-26 07:41:44,632][123090] Updated weights for policy 1, policy_version 1007840 (0.0010) [2023-12-26 07:41:45,419][123090] Updated weights for policy 1, policy_version 1007850 (0.0005) [2023-12-26 07:41:45,436][123091] Updated weights for policy 0, policy_version 1014901 (0.0009) [2023-12-26 07:41:45,485][123090] Updated weights for policy 1, policy_version 1007860 (0.0008) [2023-12-26 07:41:45,508][123091] Updated weights for policy 0, policy_version 1014911 (0.0009) [2023-12-26 07:41:45,553][123090] Updated weights for policy 1, policy_version 1007870 (0.0009) [2023-12-26 07:41:45,573][123091] Updated weights for policy 0, policy_version 1014921 (0.0009) [2023-12-26 07:41:46,328][123091] Updated weights for policy 0, policy_version 1014931 (0.0010) [2023-12-26 07:41:46,340][123090] Updated weights for policy 1, policy_version 1007880 (0.0006) [2023-12-26 07:41:46,392][123091] Updated weights for policy 0, policy_version 1014941 (0.0009) [2023-12-26 07:41:46,393][123090] Updated weights for policy 1, policy_version 1007890 (0.0005) [2023-12-26 07:41:46,447][123090] Updated weights for policy 1, policy_version 1007900 (0.0005) [2023-12-26 07:41:46,450][123091] Updated weights for policy 0, policy_version 1014951 (0.0009) [2023-12-26 07:41:47,055][123090] Updated weights for policy 1, policy_version 1007910 (0.0005) [2023-12-26 07:41:47,109][123090] Updated weights for policy 1, policy_version 1007920 (0.0005) [2023-12-26 07:41:47,169][123090] Updated weights for policy 1, policy_version 1007930 (0.0005) [2023-12-26 07:41:47,370][123091] Updated weights for policy 0, policy_version 1014961 (0.0010) [2023-12-26 07:41:47,428][123091] Updated weights for policy 0, policy_version 1014971 (0.0010) [2023-12-26 07:41:47,484][123091] Updated weights for policy 0, policy_version 1014981 (0.0008) [2023-12-26 07:41:47,541][123091] Updated weights for policy 0, policy_version 1014991 (0.0010) [2023-12-26 07:41:47,866][123090] Updated weights for policy 1, policy_version 1007940 (0.0006) [2023-12-26 07:41:47,913][123090] Updated weights for policy 1, policy_version 1007950 (0.0010) [2023-12-26 07:41:47,959][123090] Updated weights for policy 1, policy_version 1007960 (0.0005) [2023-12-26 07:41:48,290][123091] Updated weights for policy 0, policy_version 1015001 (0.0009) [2023-12-26 07:41:48,346][123091] Updated weights for policy 0, policy_version 1015012 (0.0010) [2023-12-26 07:41:48,403][123091] Updated weights for policy 0, policy_version 1015022 (0.0010) [2023-12-26 07:41:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 517890048. Throughput: 0: 8594.7, 1: 9095.1. Samples: 517903284. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:48,785][121949] Avg episode reward: [(0, '6320.083'), (1, '5388.350')] [2023-12-26 07:41:48,795][123090] Updated weights for policy 1, policy_version 1007970 (0.0007) [2023-12-26 07:41:48,860][123090] Updated weights for policy 1, policy_version 1007980 (0.0011) [2023-12-26 07:41:48,923][123090] Updated weights for policy 1, policy_version 1007990 (0.0011) [2023-12-26 07:41:48,994][123090] Updated weights for policy 1, policy_version 1008000 (0.0011) [2023-12-26 07:41:49,264][123091] Updated weights for policy 0, policy_version 1015032 (0.0008) [2023-12-26 07:41:49,329][123091] Updated weights for policy 0, policy_version 1015042 (0.0008) [2023-12-26 07:41:49,391][123091] Updated weights for policy 0, policy_version 1015052 (0.0010) [2023-12-26 07:41:49,761][123090] Updated weights for policy 1, policy_version 1008010 (0.0010) [2023-12-26 07:41:49,811][123090] Updated weights for policy 1, policy_version 1008020 (0.0006) [2023-12-26 07:41:49,886][123090] Updated weights for policy 1, policy_version 1008030 (0.0007) [2023-12-26 07:41:50,181][123091] Updated weights for policy 0, policy_version 1015062 (0.0011) [2023-12-26 07:41:50,229][123091] Updated weights for policy 0, policy_version 1015072 (0.0010) [2023-12-26 07:41:50,292][123091] Updated weights for policy 0, policy_version 1015082 (0.0010) [2023-12-26 07:41:50,704][123090] Updated weights for policy 1, policy_version 1008040 (0.0006) [2023-12-26 07:41:50,758][123090] Updated weights for policy 1, policy_version 1008050 (0.0005) [2023-12-26 07:41:50,806][123090] Updated weights for policy 1, policy_version 1008060 (0.0006) [2023-12-26 07:41:50,971][123091] Updated weights for policy 0, policy_version 1015092 (0.0009) [2023-12-26 07:41:51,037][123091] Updated weights for policy 0, policy_version 1015102 (0.0008) [2023-12-26 07:41:51,105][123091] Updated weights for policy 0, policy_version 1015112 (0.0011) [2023-12-26 07:41:51,645][123090] Updated weights for policy 1, policy_version 1008070 (0.0008) [2023-12-26 07:41:51,717][123090] Updated weights for policy 1, policy_version 1008080 (0.0008) [2023-12-26 07:41:51,797][123090] Updated weights for policy 1, policy_version 1008090 (0.0010) [2023-12-26 07:41:51,902][123091] Updated weights for policy 0, policy_version 1015122 (0.0011) [2023-12-26 07:41:51,969][123091] Updated weights for policy 0, policy_version 1015132 (0.0006) [2023-12-26 07:41:52,037][123091] Updated weights for policy 0, policy_version 1015142 (0.0009) [2023-12-26 07:41:52,100][123091] Updated weights for policy 0, policy_version 1015152 (0.0011) [2023-12-26 07:41:52,602][123090] Updated weights for policy 1, policy_version 1008100 (0.0006) [2023-12-26 07:41:52,659][123090] Updated weights for policy 1, policy_version 1008110 (0.0005) [2023-12-26 07:41:52,730][123090] Updated weights for policy 1, policy_version 1008120 (0.0005) [2023-12-26 07:41:52,824][123091] Updated weights for policy 0, policy_version 1015162 (0.0007) [2023-12-26 07:41:52,884][123091] Updated weights for policy 0, policy_version 1015172 (0.0011) [2023-12-26 07:41:52,939][123091] Updated weights for policy 0, policy_version 1015182 (0.0010) [2023-12-26 07:41:53,458][123090] Updated weights for policy 1, policy_version 1008130 (0.0006) [2023-12-26 07:41:53,522][123090] Updated weights for policy 1, policy_version 1008140 (0.0009) [2023-12-26 07:41:53,570][123090] Updated weights for policy 1, policy_version 1008150 (0.0009) [2023-12-26 07:41:53,622][123090] Updated weights for policy 1, policy_version 1008160 (0.0009) [2023-12-26 07:41:53,764][123091] Updated weights for policy 0, policy_version 1015192 (0.0010) [2023-12-26 07:41:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 517980160. Throughput: 0: 8604.7, 1: 9026.7. Samples: 517956632. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:53,785][121949] Avg episode reward: [(0, '6274.444'), (1, '5070.753')] [2023-12-26 07:41:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001008160_258088960.pth... [2023-12-26 07:41:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001007104_257818624.pth [2023-12-26 07:41:53,827][123091] Updated weights for policy 0, policy_version 1015202 (0.0010) [2023-12-26 07:41:53,882][123091] Updated weights for policy 0, policy_version 1015212 (0.0010) [2023-12-26 07:41:53,904][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001015216_259899392.pth... [2023-12-26 07:41:53,907][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001014192_259637248.pth [2023-12-26 07:41:54,383][123090] Updated weights for policy 1, policy_version 1008170 (0.0006) [2023-12-26 07:41:54,462][123090] Updated weights for policy 1, policy_version 1008180 (0.0005) [2023-12-26 07:41:54,537][123090] Updated weights for policy 1, policy_version 1008190 (0.0006) [2023-12-26 07:41:54,658][123091] Updated weights for policy 0, policy_version 1015222 (0.0007) [2023-12-26 07:41:54,707][123091] Updated weights for policy 0, policy_version 1015232 (0.0006) [2023-12-26 07:41:54,764][123091] Updated weights for policy 0, policy_version 1015242 (0.0005) [2023-12-26 07:41:55,276][123090] Updated weights for policy 1, policy_version 1008200 (0.0008) [2023-12-26 07:41:55,338][123090] Updated weights for policy 1, policy_version 1008210 (0.0009) [2023-12-26 07:41:55,398][123090] Updated weights for policy 1, policy_version 1008220 (0.0009) [2023-12-26 07:41:55,486][123091] Updated weights for policy 0, policy_version 1015252 (0.0008) [2023-12-26 07:41:55,548][123091] Updated weights for policy 0, policy_version 1015262 (0.0010) [2023-12-26 07:41:55,613][123091] Updated weights for policy 0, policy_version 1015272 (0.0010) [2023-12-26 07:41:56,228][123090] Updated weights for policy 1, policy_version 1008230 (0.0009) [2023-12-26 07:41:56,292][123090] Updated weights for policy 1, policy_version 1008240 (0.0009) [2023-12-26 07:41:56,356][123090] Updated weights for policy 1, policy_version 1008250 (0.0009) [2023-12-26 07:41:56,442][123091] Updated weights for policy 0, policy_version 1015282 (0.0011) [2023-12-26 07:41:56,504][123091] Updated weights for policy 0, policy_version 1015292 (0.0011) [2023-12-26 07:41:56,571][123091] Updated weights for policy 0, policy_version 1015302 (0.0011) [2023-12-26 07:41:56,627][123091] Updated weights for policy 0, policy_version 1015312 (0.0011) [2023-12-26 07:41:57,185][123090] Updated weights for policy 1, policy_version 1008260 (0.0009) [2023-12-26 07:41:57,240][123090] Updated weights for policy 1, policy_version 1008270 (0.0008) [2023-12-26 07:41:57,310][123090] Updated weights for policy 1, policy_version 1008280 (0.0009) [2023-12-26 07:41:57,392][123091] Updated weights for policy 0, policy_version 1015322 (0.0010) [2023-12-26 07:41:57,439][123091] Updated weights for policy 0, policy_version 1015332 (0.0010) [2023-12-26 07:41:57,483][123091] Updated weights for policy 0, policy_version 1015342 (0.0010) [2023-12-26 07:41:58,079][123090] Updated weights for policy 1, policy_version 1008290 (0.0008) [2023-12-26 07:41:58,139][123090] Updated weights for policy 1, policy_version 1008300 (0.0008) [2023-12-26 07:41:58,202][123090] Updated weights for policy 1, policy_version 1008310 (0.0006) [2023-12-26 07:41:58,279][123090] Updated weights for policy 1, policy_version 1008320 (0.0006) [2023-12-26 07:41:58,350][123091] Updated weights for policy 0, policy_version 1015352 (0.0009) [2023-12-26 07:41:58,421][123091] Updated weights for policy 0, policy_version 1015362 (0.0010) [2023-12-26 07:41:58,495][123091] Updated weights for policy 0, policy_version 1015372 (0.0010) [2023-12-26 07:41:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 518070272. Throughput: 0: 8681.5, 1: 9047.5. Samples: 518063468. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:41:58,785][121949] Avg episode reward: [(0, '6295.949'), (1, '5034.942')] [2023-12-26 07:41:59,149][123090] Updated weights for policy 1, policy_version 1008330 (0.0009) [2023-12-26 07:41:59,209][123090] Updated weights for policy 1, policy_version 1008340 (0.0009) [2023-12-26 07:41:59,270][123091] Updated weights for policy 0, policy_version 1015382 (0.0009) [2023-12-26 07:41:59,282][123090] Updated weights for policy 1, policy_version 1008350 (0.0008) [2023-12-26 07:41:59,337][123091] Updated weights for policy 0, policy_version 1015392 (0.0006) [2023-12-26 07:41:59,404][123091] Updated weights for policy 0, policy_version 1015402 (0.0009) [2023-12-26 07:42:00,107][123091] Updated weights for policy 0, policy_version 1015412 (0.0007) [2023-12-26 07:42:00,172][123091] Updated weights for policy 0, policy_version 1015422 (0.0005) [2023-12-26 07:42:00,177][123090] Updated weights for policy 1, policy_version 1008360 (0.0006) [2023-12-26 07:42:00,238][123091] Updated weights for policy 0, policy_version 1015432 (0.0006) [2023-12-26 07:42:00,250][123090] Updated weights for policy 1, policy_version 1008370 (0.0005) [2023-12-26 07:42:00,318][123090] Updated weights for policy 1, policy_version 1008380 (0.0008) [2023-12-26 07:42:00,998][123091] Updated weights for policy 0, policy_version 1015442 (0.0006) [2023-12-26 07:42:01,063][123091] Updated weights for policy 0, policy_version 1015452 (0.0011) [2023-12-26 07:42:01,116][123090] Updated weights for policy 1, policy_version 1008390 (0.0009) [2023-12-26 07:42:01,127][123091] Updated weights for policy 0, policy_version 1015462 (0.0006) [2023-12-26 07:42:01,191][123090] Updated weights for policy 1, policy_version 1008400 (0.0007) [2023-12-26 07:42:01,202][123091] Updated weights for policy 0, policy_version 1015472 (0.0006) [2023-12-26 07:42:01,261][123090] Updated weights for policy 1, policy_version 1008410 (0.0009) [2023-12-26 07:42:01,920][123091] Updated weights for policy 0, policy_version 1015482 (0.0009) [2023-12-26 07:42:01,981][123091] Updated weights for policy 0, policy_version 1015492 (0.0005) [2023-12-26 07:42:02,034][123090] Updated weights for policy 1, policy_version 1008420 (0.0007) [2023-12-26 07:42:02,040][123091] Updated weights for policy 0, policy_version 1015502 (0.0005) [2023-12-26 07:42:02,086][123090] Updated weights for policy 1, policy_version 1008430 (0.0005) [2023-12-26 07:42:02,145][123090] Updated weights for policy 1, policy_version 1008440 (0.0005) [2023-12-26 07:42:02,711][123091] Updated weights for policy 0, policy_version 1015512 (0.0006) [2023-12-26 07:42:02,766][123091] Updated weights for policy 0, policy_version 1015522 (0.0005) [2023-12-26 07:42:02,821][123091] Updated weights for policy 0, policy_version 1015532 (0.0007) [2023-12-26 07:42:02,919][123090] Updated weights for policy 1, policy_version 1008450 (0.0006) [2023-12-26 07:42:02,970][123090] Updated weights for policy 1, policy_version 1008460 (0.0009) [2023-12-26 07:42:03,018][123090] Updated weights for policy 1, policy_version 1008470 (0.0009) [2023-12-26 07:42:03,074][123090] Updated weights for policy 1, policy_version 1008480 (0.0009) [2023-12-26 07:42:03,608][123091] Updated weights for policy 0, policy_version 1015542 (0.0009) [2023-12-26 07:42:03,677][123091] Updated weights for policy 0, policy_version 1015552 (0.0010) [2023-12-26 07:42:03,733][123091] Updated weights for policy 0, policy_version 1015562 (0.0009) [2023-12-26 07:42:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 518160384. Throughput: 0: 8788.7, 1: 8941.5. Samples: 518169964. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:03,784][121949] Avg episode reward: [(0, '6279.477'), (1, '5299.418')] [2023-12-26 07:42:03,922][123090] Updated weights for policy 1, policy_version 1008490 (0.0009) [2023-12-26 07:42:03,990][123090] Updated weights for policy 1, policy_version 1008500 (0.0009) [2023-12-26 07:42:04,057][123090] Updated weights for policy 1, policy_version 1008510 (0.0009) [2023-12-26 07:42:04,594][123091] Updated weights for policy 0, policy_version 1015572 (0.0010) [2023-12-26 07:42:04,650][123091] Updated weights for policy 0, policy_version 1015582 (0.0009) [2023-12-26 07:42:04,703][123091] Updated weights for policy 0, policy_version 1015592 (0.0009) [2023-12-26 07:42:04,842][123090] Updated weights for policy 1, policy_version 1008520 (0.0009) [2023-12-26 07:42:04,895][123090] Updated weights for policy 1, policy_version 1008530 (0.0009) [2023-12-26 07:42:04,963][123090] Updated weights for policy 1, policy_version 1008540 (0.0009) [2023-12-26 07:42:05,549][123091] Updated weights for policy 0, policy_version 1015602 (0.0009) [2023-12-26 07:42:05,606][123091] Updated weights for policy 0, policy_version 1015612 (0.0009) [2023-12-26 07:42:05,665][123091] Updated weights for policy 0, policy_version 1015622 (0.0009) [2023-12-26 07:42:05,724][123091] Updated weights for policy 0, policy_version 1015632 (0.0009) [2023-12-26 07:42:05,795][123090] Updated weights for policy 1, policy_version 1008550 (0.0010) [2023-12-26 07:42:05,856][123090] Updated weights for policy 1, policy_version 1008560 (0.0009) [2023-12-26 07:42:05,916][123090] Updated weights for policy 1, policy_version 1008570 (0.0009) [2023-12-26 07:42:06,587][123091] Updated weights for policy 0, policy_version 1015642 (0.0011) [2023-12-26 07:42:06,652][123091] Updated weights for policy 0, policy_version 1015652 (0.0011) [2023-12-26 07:42:06,724][123091] Updated weights for policy 0, policy_version 1015662 (0.0011) [2023-12-26 07:42:06,759][123090] Updated weights for policy 1, policy_version 1008580 (0.0010) [2023-12-26 07:42:06,813][123090] Updated weights for policy 1, policy_version 1008590 (0.0009) [2023-12-26 07:42:06,862][123090] Updated weights for policy 1, policy_version 1008600 (0.0009) [2023-12-26 07:42:07,500][123091] Updated weights for policy 0, policy_version 1015672 (0.0006) [2023-12-26 07:42:07,560][123091] Updated weights for policy 0, policy_version 1015682 (0.0005) [2023-12-26 07:42:07,615][123091] Updated weights for policy 0, policy_version 1015692 (0.0005) [2023-12-26 07:42:07,762][123090] Updated weights for policy 1, policy_version 1008610 (0.0009) [2023-12-26 07:42:07,827][123090] Updated weights for policy 1, policy_version 1008620 (0.0008) [2023-12-26 07:42:07,894][123090] Updated weights for policy 1, policy_version 1008630 (0.0008) [2023-12-26 07:42:07,963][123090] Updated weights for policy 1, policy_version 1008640 (0.0005) [2023-12-26 07:42:08,390][123091] Updated weights for policy 0, policy_version 1015702 (0.0008) [2023-12-26 07:42:08,441][123091] Updated weights for policy 0, policy_version 1015712 (0.0008) [2023-12-26 07:42:08,497][123091] Updated weights for policy 0, policy_version 1015722 (0.0005) [2023-12-26 07:42:08,738][123090] Updated weights for policy 1, policy_version 1008650 (0.0010) [2023-12-26 07:42:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 518242304. Throughput: 0: 8821.1, 1: 8915.6. Samples: 518220988. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:08,785][121949] Avg episode reward: [(0, '6259.938'), (1, '5446.995')] [2023-12-26 07:42:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001015728_260030464.pth... [2023-12-26 07:42:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001014704_259768320.pth [2023-12-26 07:42:08,808][123090] Updated weights for policy 1, policy_version 1008660 (0.0009) [2023-12-26 07:42:08,874][123090] Updated weights for policy 1, policy_version 1008670 (0.0009) [2023-12-26 07:42:08,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001008672_258220032.pth... [2023-12-26 07:42:08,890][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001007616_257949696.pth [2023-12-26 07:42:09,179][123091] Updated weights for policy 0, policy_version 1015732 (0.0007) [2023-12-26 07:42:09,243][123091] Updated weights for policy 0, policy_version 1015742 (0.0011) [2023-12-26 07:42:09,298][123091] Updated weights for policy 0, policy_version 1015752 (0.0010) [2023-12-26 07:42:09,750][123090] Updated weights for policy 1, policy_version 1008680 (0.0009) [2023-12-26 07:42:09,815][123090] Updated weights for policy 1, policy_version 1008690 (0.0009) [2023-12-26 07:42:09,884][123090] Updated weights for policy 1, policy_version 1008700 (0.0011) [2023-12-26 07:42:10,082][123091] Updated weights for policy 0, policy_version 1015762 (0.0006) [2023-12-26 07:42:10,147][123091] Updated weights for policy 0, policy_version 1015772 (0.0006) [2023-12-26 07:42:10,203][123091] Updated weights for policy 0, policy_version 1015782 (0.0006) [2023-12-26 07:42:10,262][123091] Updated weights for policy 0, policy_version 1015792 (0.0005) [2023-12-26 07:42:10,739][123090] Updated weights for policy 1, policy_version 1008710 (0.0011) [2023-12-26 07:42:10,810][123090] Updated weights for policy 1, policy_version 1008720 (0.0010) [2023-12-26 07:42:10,882][123090] Updated weights for policy 1, policy_version 1008730 (0.0011) [2023-12-26 07:42:10,972][123091] Updated weights for policy 0, policy_version 1015802 (0.0011) [2023-12-26 07:42:11,036][123091] Updated weights for policy 0, policy_version 1015812 (0.0011) [2023-12-26 07:42:11,100][123091] Updated weights for policy 0, policy_version 1015822 (0.0007) [2023-12-26 07:42:11,705][123090] Updated weights for policy 1, policy_version 1008740 (0.0010) [2023-12-26 07:42:11,764][123090] Updated weights for policy 1, policy_version 1008750 (0.0010) [2023-12-26 07:42:11,825][123090] Updated weights for policy 1, policy_version 1008760 (0.0010) [2023-12-26 07:42:11,996][123091] Updated weights for policy 0, policy_version 1015832 (0.0009) [2023-12-26 07:42:12,050][123091] Updated weights for policy 0, policy_version 1015842 (0.0009) [2023-12-26 07:42:12,111][123091] Updated weights for policy 0, policy_version 1015852 (0.0009) [2023-12-26 07:42:12,778][123090] Updated weights for policy 1, policy_version 1008770 (0.0010) [2023-12-26 07:42:12,833][123090] Updated weights for policy 1, policy_version 1008780 (0.0009) [2023-12-26 07:42:12,891][123090] Updated weights for policy 1, policy_version 1008790 (0.0009) [2023-12-26 07:42:12,944][123091] Updated weights for policy 0, policy_version 1015862 (0.0009) [2023-12-26 07:42:12,953][123090] Updated weights for policy 1, policy_version 1008800 (0.0009) [2023-12-26 07:42:13,005][123091] Updated weights for policy 0, policy_version 1015872 (0.0010) [2023-12-26 07:42:13,067][123091] Updated weights for policy 0, policy_version 1015882 (0.0010) [2023-12-26 07:42:13,767][123090] Updated weights for policy 1, policy_version 1008810 (0.0010) [2023-12-26 07:42:13,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 518324224. Throughput: 0: 8861.2, 1: 8749.5. Samples: 518323920. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:13,785][121949] Avg episode reward: [(0, '6215.403'), (1, '5393.021')] [2023-12-26 07:42:13,800][123091] Updated weights for policy 0, policy_version 1015892 (0.0008) [2023-12-26 07:42:13,824][123090] Updated weights for policy 1, policy_version 1008820 (0.0009) [2023-12-26 07:42:13,854][123091] Updated weights for policy 0, policy_version 1015902 (0.0006) [2023-12-26 07:42:13,877][123090] Updated weights for policy 1, policy_version 1008830 (0.0009) [2023-12-26 07:42:13,907][123091] Updated weights for policy 0, policy_version 1015912 (0.0006) [2023-12-26 07:42:14,713][123091] Updated weights for policy 0, policy_version 1015922 (0.0009) [2023-12-26 07:42:14,740][123090] Updated weights for policy 1, policy_version 1008840 (0.0010) [2023-12-26 07:42:14,784][123091] Updated weights for policy 0, policy_version 1015932 (0.0007) [2023-12-26 07:42:14,809][123090] Updated weights for policy 1, policy_version 1008850 (0.0011) [2023-12-26 07:42:14,850][123091] Updated weights for policy 0, policy_version 1015942 (0.0009) [2023-12-26 07:42:14,872][123090] Updated weights for policy 1, policy_version 1008860 (0.0010) [2023-12-26 07:42:14,915][123091] Updated weights for policy 0, policy_version 1015952 (0.0009) [2023-12-26 07:42:15,659][123091] Updated weights for policy 0, policy_version 1015962 (0.0006) [2023-12-26 07:42:15,709][123090] Updated weights for policy 1, policy_version 1008870 (0.0011) [2023-12-26 07:42:15,717][123091] Updated weights for policy 0, policy_version 1015972 (0.0005) [2023-12-26 07:42:15,764][123090] Updated weights for policy 1, policy_version 1008880 (0.0010) [2023-12-26 07:42:15,782][123091] Updated weights for policy 0, policy_version 1015982 (0.0006) [2023-12-26 07:42:15,828][123090] Updated weights for policy 1, policy_version 1008890 (0.0011) [2023-12-26 07:42:16,486][123091] Updated weights for policy 0, policy_version 1015992 (0.0006) [2023-12-26 07:42:16,544][123091] Updated weights for policy 0, policy_version 1016002 (0.0006) [2023-12-26 07:42:16,595][123091] Updated weights for policy 0, policy_version 1016012 (0.0005) [2023-12-26 07:42:16,664][123090] Updated weights for policy 1, policy_version 1008900 (0.0011) [2023-12-26 07:42:16,734][123090] Updated weights for policy 1, policy_version 1008910 (0.0010) [2023-12-26 07:42:16,804][123090] Updated weights for policy 1, policy_version 1008920 (0.0010) [2023-12-26 07:42:17,218][123091] Updated weights for policy 0, policy_version 1016022 (0.0005) [2023-12-26 07:42:17,278][123091] Updated weights for policy 0, policy_version 1016032 (0.0005) [2023-12-26 07:42:17,345][123091] Updated weights for policy 0, policy_version 1016042 (0.0007) [2023-12-26 07:42:17,612][123090] Updated weights for policy 1, policy_version 1008930 (0.0010) [2023-12-26 07:42:17,667][123090] Updated weights for policy 1, policy_version 1008940 (0.0010) [2023-12-26 07:42:17,734][123090] Updated weights for policy 1, policy_version 1008950 (0.0010) [2023-12-26 07:42:17,789][123090] Updated weights for policy 1, policy_version 1008960 (0.0010) [2023-12-26 07:42:18,018][123091] Updated weights for policy 0, policy_version 1016052 (0.0010) [2023-12-26 07:42:18,080][123091] Updated weights for policy 0, policy_version 1016062 (0.0006) [2023-12-26 07:42:18,136][123091] Updated weights for policy 0, policy_version 1016072 (0.0005) [2023-12-26 07:42:18,631][123090] Updated weights for policy 1, policy_version 1008970 (0.0006) [2023-12-26 07:42:18,695][123090] Updated weights for policy 1, policy_version 1008980 (0.0005) [2023-12-26 07:42:18,763][123090] Updated weights for policy 1, policy_version 1008990 (0.0006) [2023-12-26 07:42:18,777][123091] Updated weights for policy 0, policy_version 1016082 (0.0005) [2023-12-26 07:42:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 518422528. Throughput: 0: 8989.4, 1: 8608.2. Samples: 518433108. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:18,785][121949] Avg episode reward: [(0, '6234.050'), (1, '5321.853')] [2023-12-26 07:42:18,847][123091] Updated weights for policy 0, policy_version 1016092 (0.0006) [2023-12-26 07:42:18,918][123091] Updated weights for policy 0, policy_version 1016102 (0.0011) [2023-12-26 07:42:18,989][123091] Updated weights for policy 0, policy_version 1016112 (0.0008) [2023-12-26 07:42:19,461][123090] Updated weights for policy 1, policy_version 1009000 (0.0006) [2023-12-26 07:42:19,529][123090] Updated weights for policy 1, policy_version 1009010 (0.0008) [2023-12-26 07:42:19,593][123090] Updated weights for policy 1, policy_version 1009020 (0.0010) [2023-12-26 07:42:19,698][123091] Updated weights for policy 0, policy_version 1016122 (0.0007) [2023-12-26 07:42:19,764][123091] Updated weights for policy 0, policy_version 1016132 (0.0005) [2023-12-26 07:42:19,835][123091] Updated weights for policy 0, policy_version 1016142 (0.0007) [2023-12-26 07:42:20,353][123090] Updated weights for policy 1, policy_version 1009030 (0.0008) [2023-12-26 07:42:20,423][123090] Updated weights for policy 1, policy_version 1009040 (0.0006) [2023-12-26 07:42:20,503][123090] Updated weights for policy 1, policy_version 1009050 (0.0006) [2023-12-26 07:42:20,600][123091] Updated weights for policy 0, policy_version 1016152 (0.0007) [2023-12-26 07:42:20,661][123091] Updated weights for policy 0, policy_version 1016162 (0.0009) [2023-12-26 07:42:20,720][123091] Updated weights for policy 0, policy_version 1016172 (0.0009) [2023-12-26 07:42:21,290][123090] Updated weights for policy 1, policy_version 1009060 (0.0009) [2023-12-26 07:42:21,360][123090] Updated weights for policy 1, policy_version 1009070 (0.0009) [2023-12-26 07:42:21,426][123090] Updated weights for policy 1, policy_version 1009080 (0.0009) [2023-12-26 07:42:21,574][123091] Updated weights for policy 0, policy_version 1016182 (0.0008) [2023-12-26 07:42:21,647][123091] Updated weights for policy 0, policy_version 1016192 (0.0009) [2023-12-26 07:42:21,720][123091] Updated weights for policy 0, policy_version 1016202 (0.0011) [2023-12-26 07:42:22,357][123090] Updated weights for policy 1, policy_version 1009090 (0.0009) [2023-12-26 07:42:22,426][123090] Updated weights for policy 1, policy_version 1009100 (0.0008) [2023-12-26 07:42:22,478][123090] Updated weights for policy 1, policy_version 1009110 (0.0008) [2023-12-26 07:42:22,516][123091] Updated weights for policy 0, policy_version 1016212 (0.0009) [2023-12-26 07:42:22,534][123090] Updated weights for policy 1, policy_version 1009120 (0.0008) [2023-12-26 07:42:22,578][123091] Updated weights for policy 0, policy_version 1016222 (0.0009) [2023-12-26 07:42:22,634][123091] Updated weights for policy 0, policy_version 1016232 (0.0009) [2023-12-26 07:42:23,364][123090] Updated weights for policy 1, policy_version 1009130 (0.0010) [2023-12-26 07:42:23,419][123090] Updated weights for policy 1, policy_version 1009140 (0.0009) [2023-12-26 07:42:23,439][123091] Updated weights for policy 0, policy_version 1016242 (0.0010) [2023-12-26 07:42:23,482][123090] Updated weights for policy 1, policy_version 1009150 (0.0008) [2023-12-26 07:42:23,485][123091] Updated weights for policy 0, policy_version 1016252 (0.0008) [2023-12-26 07:42:23,533][123091] Updated weights for policy 0, policy_version 1016262 (0.0010) [2023-12-26 07:42:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 518512640. Throughput: 0: 8989.0, 1: 8658.6. Samples: 518487396. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:23,785][121949] Avg episode reward: [(0, '6280.969'), (1, '5432.340')] [2023-12-26 07:42:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001016272_260169728.pth... [2023-12-26 07:42:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001009152_258342912.pth... [2023-12-26 07:42:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001015216_259899392.pth [2023-12-26 07:42:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001008160_258088960.pth [2023-12-26 07:42:24,255][123091] Updated weights for policy 0, policy_version 1016273 (0.0009) [2023-12-26 07:42:24,321][123091] Updated weights for policy 0, policy_version 1016283 (0.0005) [2023-12-26 07:42:24,374][123091] Updated weights for policy 0, policy_version 1016293 (0.0006) [2023-12-26 07:42:24,377][123090] Updated weights for policy 1, policy_version 1009160 (0.0009) [2023-12-26 07:42:24,424][123090] Updated weights for policy 1, policy_version 1009170 (0.0007) [2023-12-26 07:42:24,425][123091] Updated weights for policy 0, policy_version 1016303 (0.0008) [2023-12-26 07:42:24,492][123090] Updated weights for policy 1, policy_version 1009180 (0.0008) [2023-12-26 07:42:25,147][123091] Updated weights for policy 0, policy_version 1016313 (0.0006) [2023-12-26 07:42:25,195][123091] Updated weights for policy 0, policy_version 1016323 (0.0007) [2023-12-26 07:42:25,246][123091] Updated weights for policy 0, policy_version 1016333 (0.0005) [2023-12-26 07:42:25,364][123090] Updated weights for policy 1, policy_version 1009190 (0.0009) [2023-12-26 07:42:25,422][123090] Updated weights for policy 1, policy_version 1009200 (0.0009) [2023-12-26 07:42:25,472][123090] Updated weights for policy 1, policy_version 1009210 (0.0009) [2023-12-26 07:42:25,921][123091] Updated weights for policy 0, policy_version 1016343 (0.0007) [2023-12-26 07:42:25,968][123091] Updated weights for policy 0, policy_version 1016353 (0.0005) [2023-12-26 07:42:26,014][123091] Updated weights for policy 0, policy_version 1016363 (0.0005) [2023-12-26 07:42:26,313][123090] Updated weights for policy 1, policy_version 1009220 (0.0010) [2023-12-26 07:42:26,368][123090] Updated weights for policy 1, policy_version 1009230 (0.0009) [2023-12-26 07:42:26,429][123090] Updated weights for policy 1, policy_version 1009240 (0.0010) [2023-12-26 07:42:26,843][123091] Updated weights for policy 0, policy_version 1016373 (0.0008) [2023-12-26 07:42:26,894][123091] Updated weights for policy 0, policy_version 1016383 (0.0010) [2023-12-26 07:42:26,942][123091] Updated weights for policy 0, policy_version 1016393 (0.0008) [2023-12-26 07:42:27,262][123090] Updated weights for policy 1, policy_version 1009250 (0.0010) [2023-12-26 07:42:27,328][123090] Updated weights for policy 1, policy_version 1009260 (0.0009) [2023-12-26 07:42:27,397][123090] Updated weights for policy 1, policy_version 1009270 (0.0007) [2023-12-26 07:42:27,468][123090] Updated weights for policy 1, policy_version 1009280 (0.0008) [2023-12-26 07:42:27,667][123091] Updated weights for policy 0, policy_version 1016403 (0.0006) [2023-12-26 07:42:27,716][123091] Updated weights for policy 0, policy_version 1016413 (0.0009) [2023-12-26 07:42:27,774][123091] Updated weights for policy 0, policy_version 1016423 (0.0009) [2023-12-26 07:42:28,304][123090] Updated weights for policy 1, policy_version 1009290 (0.0007) [2023-12-26 07:42:28,363][123090] Updated weights for policy 1, policy_version 1009300 (0.0009) [2023-12-26 07:42:28,421][123090] Updated weights for policy 1, policy_version 1009310 (0.0010) [2023-12-26 07:42:28,521][123091] Updated weights for policy 0, policy_version 1016433 (0.0008) [2023-12-26 07:42:28,585][123091] Updated weights for policy 0, policy_version 1016443 (0.0009) [2023-12-26 07:42:28,642][123091] Updated weights for policy 0, policy_version 1016453 (0.0010) [2023-12-26 07:42:28,711][123091] Updated weights for policy 0, policy_version 1016463 (0.0009) [2023-12-26 07:42:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 518602752. Throughput: 0: 9084.0, 1: 8674.6. Samples: 518594088. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:28,785][121949] Avg episode reward: [(0, '6289.040'), (1, '5607.806')] [2023-12-26 07:42:29,101][123090] Updated weights for policy 1, policy_version 1009320 (0.0009) [2023-12-26 07:42:29,160][123090] Updated weights for policy 1, policy_version 1009330 (0.0009) [2023-12-26 07:42:29,224][123090] Updated weights for policy 1, policy_version 1009340 (0.0008) [2023-12-26 07:42:29,576][123091] Updated weights for policy 0, policy_version 1016473 (0.0009) [2023-12-26 07:42:29,635][123091] Updated weights for policy 0, policy_version 1016483 (0.0009) [2023-12-26 07:42:29,687][123091] Updated weights for policy 0, policy_version 1016493 (0.0009) [2023-12-26 07:42:30,010][123090] Updated weights for policy 1, policy_version 1009350 (0.0006) [2023-12-26 07:42:30,071][123090] Updated weights for policy 1, policy_version 1009360 (0.0005) [2023-12-26 07:42:30,136][123090] Updated weights for policy 1, policy_version 1009370 (0.0006) [2023-12-26 07:42:30,566][123091] Updated weights for policy 0, policy_version 1016503 (0.0010) [2023-12-26 07:42:30,619][123091] Updated weights for policy 0, policy_version 1016513 (0.0008) [2023-12-26 07:42:30,665][123091] Updated weights for policy 0, policy_version 1016523 (0.0008) [2023-12-26 07:42:30,853][123090] Updated weights for policy 1, policy_version 1009380 (0.0008) [2023-12-26 07:42:30,905][123090] Updated weights for policy 1, policy_version 1009390 (0.0009) [2023-12-26 07:42:30,951][123090] Updated weights for policy 1, policy_version 1009400 (0.0007) [2023-12-26 07:42:31,527][123091] Updated weights for policy 0, policy_version 1016533 (0.0009) [2023-12-26 07:42:31,576][123091] Updated weights for policy 0, policy_version 1016543 (0.0009) [2023-12-26 07:42:31,637][123091] Updated weights for policy 0, policy_version 1016553 (0.0009) [2023-12-26 07:42:31,802][123090] Updated weights for policy 1, policy_version 1009410 (0.0008) [2023-12-26 07:42:31,853][123090] Updated weights for policy 1, policy_version 1009421 (0.0009) [2023-12-26 07:42:31,905][123090] Updated weights for policy 1, policy_version 1009431 (0.0009) [2023-12-26 07:42:32,494][123091] Updated weights for policy 0, policy_version 1016563 (0.0009) [2023-12-26 07:42:32,565][123091] Updated weights for policy 0, policy_version 1016573 (0.0010) [2023-12-26 07:42:32,615][123091] Updated weights for policy 0, policy_version 1016583 (0.0009) [2023-12-26 07:42:32,760][123090] Updated weights for policy 1, policy_version 1009441 (0.0009) [2023-12-26 07:42:32,816][123090] Updated weights for policy 1, policy_version 1009451 (0.0010) [2023-12-26 07:42:32,874][123090] Updated weights for policy 1, policy_version 1009461 (0.0009) [2023-12-26 07:42:32,930][123090] Updated weights for policy 1, policy_version 1009471 (0.0009) [2023-12-26 07:42:33,444][123091] Updated weights for policy 0, policy_version 1016593 (0.0009) [2023-12-26 07:42:33,501][123091] Updated weights for policy 0, policy_version 1016603 (0.0010) [2023-12-26 07:42:33,552][123091] Updated weights for policy 0, policy_version 1016613 (0.0010) [2023-12-26 07:42:33,620][123091] Updated weights for policy 0, policy_version 1016623 (0.0008) [2023-12-26 07:42:33,706][123090] Updated weights for policy 1, policy_version 1009481 (0.0009) [2023-12-26 07:42:33,763][123090] Updated weights for policy 1, policy_version 1009491 (0.0009) [2023-12-26 07:42:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 518684672. Throughput: 0: 9075.4, 1: 8579.5. Samples: 518697752. Policy #0 lag: (min: 31.0, avg: 32.2, max: 63.0) [2023-12-26 07:42:33,784][121949] Avg episode reward: [(0, '6259.490'), (1, '5742.940')] [2023-12-26 07:42:33,813][123090] Updated weights for policy 1, policy_version 1009501 (0.0009) [2023-12-26 07:42:34,257][123091] Updated weights for policy 0, policy_version 1016633 (0.0009) [2023-12-26 07:42:34,324][123091] Updated weights for policy 0, policy_version 1016643 (0.0009) [2023-12-26 07:42:34,388][123091] Updated weights for policy 0, policy_version 1016653 (0.0010) [2023-12-26 07:42:34,679][123090] Updated weights for policy 1, policy_version 1009511 (0.0010) [2023-12-26 07:42:34,746][123090] Updated weights for policy 1, policy_version 1009521 (0.0008) [2023-12-26 07:42:34,817][123090] Updated weights for policy 1, policy_version 1009531 (0.0006) [2023-12-26 07:42:35,243][123091] Updated weights for policy 0, policy_version 1016663 (0.0010) [2023-12-26 07:42:35,293][123091] Updated weights for policy 0, policy_version 1016673 (0.0009) [2023-12-26 07:42:35,352][123091] Updated weights for policy 0, policy_version 1016683 (0.0009) [2023-12-26 07:42:35,568][123090] Updated weights for policy 1, policy_version 1009541 (0.0008) [2023-12-26 07:42:35,637][123090] Updated weights for policy 1, policy_version 1009551 (0.0005) [2023-12-26 07:42:35,701][123090] Updated weights for policy 1, policy_version 1009561 (0.0005) [2023-12-26 07:42:36,296][123091] Updated weights for policy 0, policy_version 1016693 (0.0010) [2023-12-26 07:42:36,369][123091] Updated weights for policy 0, policy_version 1016703 (0.0010) [2023-12-26 07:42:36,371][123090] Updated weights for policy 1, policy_version 1009571 (0.0005) [2023-12-26 07:42:36,422][123091] Updated weights for policy 0, policy_version 1016713 (0.0009) [2023-12-26 07:42:36,436][123090] Updated weights for policy 1, policy_version 1009581 (0.0007) [2023-12-26 07:42:36,507][123090] Updated weights for policy 1, policy_version 1009591 (0.0011) [2023-12-26 07:42:37,201][123091] Updated weights for policy 0, policy_version 1016723 (0.0009) [2023-12-26 07:42:37,261][123091] Updated weights for policy 0, policy_version 1016733 (0.0009) [2023-12-26 07:42:37,298][123090] Updated weights for policy 1, policy_version 1009601 (0.0010) [2023-12-26 07:42:37,309][123091] Updated weights for policy 0, policy_version 1016743 (0.0008) [2023-12-26 07:42:37,350][123090] Updated weights for policy 1, policy_version 1009611 (0.0010) [2023-12-26 07:42:37,401][123090] Updated weights for policy 1, policy_version 1009621 (0.0010) [2023-12-26 07:42:37,468][123090] Updated weights for policy 1, policy_version 1009631 (0.0010) [2023-12-26 07:42:38,116][123091] Updated weights for policy 0, policy_version 1016753 (0.0007) [2023-12-26 07:42:38,175][123091] Updated weights for policy 0, policy_version 1016763 (0.0009) [2023-12-26 07:42:38,236][123091] Updated weights for policy 0, policy_version 1016773 (0.0009) [2023-12-26 07:42:38,269][123090] Updated weights for policy 1, policy_version 1009641 (0.0006) [2023-12-26 07:42:38,291][123091] Updated weights for policy 0, policy_version 1016783 (0.0008) [2023-12-26 07:42:38,335][123090] Updated weights for policy 1, policy_version 1009651 (0.0008) [2023-12-26 07:42:38,405][123090] Updated weights for policy 1, policy_version 1009661 (0.0007) [2023-12-26 07:42:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 518774784. Throughput: 0: 9030.2, 1: 8609.3. Samples: 518750404. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:42:38,785][121949] Avg episode reward: [(0, '6251.118'), (1, '5784.107')] [2023-12-26 07:42:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001009664_258473984.pth... [2023-12-26 07:42:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001016784_260300800.pth... [2023-12-26 07:42:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001008672_258220032.pth [2023-12-26 07:42:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001015728_260030464.pth [2023-12-26 07:42:39,163][123091] Updated weights for policy 0, policy_version 1016793 (0.0010) [2023-12-26 07:42:39,196][123090] Updated weights for policy 1, policy_version 1009671 (0.0007) [2023-12-26 07:42:39,219][123091] Updated weights for policy 0, policy_version 1016803 (0.0008) [2023-12-26 07:42:39,267][123090] Updated weights for policy 1, policy_version 1009681 (0.0009) [2023-12-26 07:42:39,282][123091] Updated weights for policy 0, policy_version 1016813 (0.0006) [2023-12-26 07:42:39,331][123090] Updated weights for policy 1, policy_version 1009691 (0.0009) [2023-12-26 07:42:40,072][123091] Updated weights for policy 0, policy_version 1016823 (0.0007) [2023-12-26 07:42:40,124][123091] Updated weights for policy 0, policy_version 1016833 (0.0008) [2023-12-26 07:42:40,183][123091] Updated weights for policy 0, policy_version 1016843 (0.0008) [2023-12-26 07:42:40,199][123090] Updated weights for policy 1, policy_version 1009701 (0.0008) [2023-12-26 07:42:40,268][123090] Updated weights for policy 1, policy_version 1009711 (0.0008) [2023-12-26 07:42:40,328][123090] Updated weights for policy 1, policy_version 1009721 (0.0009) [2023-12-26 07:42:40,894][123091] Updated weights for policy 0, policy_version 1016853 (0.0007) [2023-12-26 07:42:40,961][123091] Updated weights for policy 0, policy_version 1016863 (0.0011) [2023-12-26 07:42:41,034][123091] Updated weights for policy 0, policy_version 1016873 (0.0010) [2023-12-26 07:42:41,239][123090] Updated weights for policy 1, policy_version 1009731 (0.0009) [2023-12-26 07:42:41,300][123090] Updated weights for policy 1, policy_version 1009741 (0.0009) [2023-12-26 07:42:41,358][123090] Updated weights for policy 1, policy_version 1009751 (0.0009) [2023-12-26 07:42:41,838][123091] Updated weights for policy 0, policy_version 1016883 (0.0009) [2023-12-26 07:42:41,904][123091] Updated weights for policy 0, policy_version 1016893 (0.0006) [2023-12-26 07:42:41,968][123091] Updated weights for policy 0, policy_version 1016903 (0.0008) [2023-12-26 07:42:42,259][123090] Updated weights for policy 1, policy_version 1009761 (0.0010) [2023-12-26 07:42:42,332][123090] Updated weights for policy 1, policy_version 1009772 (0.0010) [2023-12-26 07:42:42,406][123090] Updated weights for policy 1, policy_version 1009782 (0.0009) [2023-12-26 07:42:42,472][123090] Updated weights for policy 1, policy_version 1009792 (0.0010) [2023-12-26 07:42:42,749][123091] Updated weights for policy 0, policy_version 1016913 (0.0010) [2023-12-26 07:42:42,817][123091] Updated weights for policy 0, policy_version 1016923 (0.0007) [2023-12-26 07:42:42,888][123091] Updated weights for policy 0, policy_version 1016933 (0.0007) [2023-12-26 07:42:42,955][123091] Updated weights for policy 0, policy_version 1016943 (0.0009) [2023-12-26 07:42:43,325][123090] Updated weights for policy 1, policy_version 1009802 (0.0009) [2023-12-26 07:42:43,375][123090] Updated weights for policy 1, policy_version 1009812 (0.0009) [2023-12-26 07:42:43,441][123090] Updated weights for policy 1, policy_version 1009822 (0.0010) [2023-12-26 07:42:43,678][123091] Updated weights for policy 0, policy_version 1016953 (0.0006) [2023-12-26 07:42:43,739][123091] Updated weights for policy 0, policy_version 1016963 (0.0005) [2023-12-26 07:42:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 518856704. Throughput: 0: 9018.6, 1: 8544.6. Samples: 518853812. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:42:43,785][121949] Avg episode reward: [(0, '6326.438'), (1, '5875.697')] [2023-12-26 07:42:43,807][123091] Updated weights for policy 0, policy_version 1016973 (0.0005) [2023-12-26 07:42:44,366][123090] Updated weights for policy 1, policy_version 1009832 (0.0009) [2023-12-26 07:42:44,417][123090] Updated weights for policy 1, policy_version 1009842 (0.0007) [2023-12-26 07:42:44,424][123091] Updated weights for policy 0, policy_version 1016983 (0.0008) [2023-12-26 07:42:44,471][123090] Updated weights for policy 1, policy_version 1009852 (0.0005) [2023-12-26 07:42:44,484][123091] Updated weights for policy 0, policy_version 1016994 (0.0010) [2023-12-26 07:42:44,547][123091] Updated weights for policy 0, policy_version 1017004 (0.0010) [2023-12-26 07:42:45,252][123091] Updated weights for policy 0, policy_version 1017014 (0.0006) [2023-12-26 07:42:45,254][123090] Updated weights for policy 1, policy_version 1009862 (0.0008) [2023-12-26 07:42:45,317][123091] Updated weights for policy 0, policy_version 1017024 (0.0010) [2023-12-26 07:42:45,320][123090] Updated weights for policy 1, policy_version 1009872 (0.0008) [2023-12-26 07:42:45,370][123091] Updated weights for policy 0, policy_version 1017034 (0.0010) [2023-12-26 07:42:45,382][123090] Updated weights for policy 1, policy_version 1009882 (0.0008) [2023-12-26 07:42:46,128][123091] Updated weights for policy 0, policy_version 1017044 (0.0009) [2023-12-26 07:42:46,182][123091] Updated weights for policy 0, policy_version 1017054 (0.0005) [2023-12-26 07:42:46,249][123090] Updated weights for policy 1, policy_version 1009892 (0.0009) [2023-12-26 07:42:46,253][123091] Updated weights for policy 0, policy_version 1017064 (0.0006) [2023-12-26 07:42:46,313][123090] Updated weights for policy 1, policy_version 1009902 (0.0009) [2023-12-26 07:42:46,371][123090] Updated weights for policy 1, policy_version 1009912 (0.0009) [2023-12-26 07:42:46,959][123091] Updated weights for policy 0, policy_version 1017074 (0.0006) [2023-12-26 07:42:47,026][123091] Updated weights for policy 0, policy_version 1017084 (0.0010) [2023-12-26 07:42:47,098][123091] Updated weights for policy 0, policy_version 1017094 (0.0010) [2023-12-26 07:42:47,168][123091] Updated weights for policy 0, policy_version 1017104 (0.0010) [2023-12-26 07:42:47,206][123090] Updated weights for policy 1, policy_version 1009922 (0.0009) [2023-12-26 07:42:47,253][123090] Updated weights for policy 1, policy_version 1009932 (0.0008) [2023-12-26 07:42:47,301][123090] Updated weights for policy 1, policy_version 1009942 (0.0008) [2023-12-26 07:42:47,349][123090] Updated weights for policy 1, policy_version 1009952 (0.0008) [2023-12-26 07:42:47,904][123091] Updated weights for policy 0, policy_version 1017114 (0.0011) [2023-12-26 07:42:47,961][123091] Updated weights for policy 0, policy_version 1017124 (0.0008) [2023-12-26 07:42:48,031][123091] Updated weights for policy 0, policy_version 1017134 (0.0005) [2023-12-26 07:42:48,244][123090] Updated weights for policy 1, policy_version 1009962 (0.0010) [2023-12-26 07:42:48,299][123090] Updated weights for policy 1, policy_version 1009972 (0.0010) [2023-12-26 07:42:48,364][123090] Updated weights for policy 1, policy_version 1009982 (0.0009) [2023-12-26 07:42:48,711][123091] Updated weights for policy 0, policy_version 1017144 (0.0006) [2023-12-26 07:42:48,774][123091] Updated weights for policy 0, policy_version 1017154 (0.0009) [2023-12-26 07:42:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 518946816. Throughput: 0: 9084.0, 1: 8506.3. Samples: 518961528. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:42:48,785][121949] Avg episode reward: [(0, '6410.409'), (1, '5834.330')] [2023-12-26 07:42:48,841][123091] Updated weights for policy 0, policy_version 1017164 (0.0010) [2023-12-26 07:42:49,287][123090] Updated weights for policy 1, policy_version 1009992 (0.0009) [2023-12-26 07:42:49,353][123090] Updated weights for policy 1, policy_version 1010002 (0.0008) [2023-12-26 07:42:49,418][123090] Updated weights for policy 1, policy_version 1010012 (0.0009) [2023-12-26 07:42:49,488][123091] Updated weights for policy 0, policy_version 1017174 (0.0011) [2023-12-26 07:42:49,543][123091] Updated weights for policy 0, policy_version 1017184 (0.0011) [2023-12-26 07:42:49,606][123091] Updated weights for policy 0, policy_version 1017194 (0.0011) [2023-12-26 07:42:50,269][123090] Updated weights for policy 1, policy_version 1010022 (0.0009) [2023-12-26 07:42:50,332][123090] Updated weights for policy 1, policy_version 1010032 (0.0009) [2023-12-26 07:42:50,395][123090] Updated weights for policy 1, policy_version 1010042 (0.0009) [2023-12-26 07:42:50,421][123091] Updated weights for policy 0, policy_version 1017204 (0.0009) [2023-12-26 07:42:50,479][123091] Updated weights for policy 0, policy_version 1017214 (0.0005) [2023-12-26 07:42:50,539][123091] Updated weights for policy 0, policy_version 1017224 (0.0005) [2023-12-26 07:42:51,268][123090] Updated weights for policy 1, policy_version 1010052 (0.0009) [2023-12-26 07:42:51,295][123091] Updated weights for policy 0, policy_version 1017234 (0.0008) [2023-12-26 07:42:51,338][123090] Updated weights for policy 1, policy_version 1010062 (0.0009) [2023-12-26 07:42:51,368][123091] Updated weights for policy 0, policy_version 1017244 (0.0008) [2023-12-26 07:42:51,405][123090] Updated weights for policy 1, policy_version 1010072 (0.0006) [2023-12-26 07:42:51,435][123091] Updated weights for policy 0, policy_version 1017254 (0.0008) [2023-12-26 07:42:51,496][123091] Updated weights for policy 0, policy_version 1017264 (0.0008) [2023-12-26 07:42:52,168][123090] Updated weights for policy 1, policy_version 1010082 (0.0006) [2023-12-26 07:42:52,221][123090] Updated weights for policy 1, policy_version 1010092 (0.0010) [2023-12-26 07:42:52,277][123090] Updated weights for policy 1, policy_version 1010102 (0.0009) [2023-12-26 07:42:52,316][123091] Updated weights for policy 0, policy_version 1017274 (0.0008) [2023-12-26 07:42:52,330][123090] Updated weights for policy 1, policy_version 1010112 (0.0009) [2023-12-26 07:42:52,386][123091] Updated weights for policy 0, policy_version 1017284 (0.0009) [2023-12-26 07:42:52,456][123091] Updated weights for policy 0, policy_version 1017294 (0.0009) [2023-12-26 07:42:53,230][123090] Updated weights for policy 1, policy_version 1010122 (0.0008) [2023-12-26 07:42:53,246][123091] Updated weights for policy 0, policy_version 1017304 (0.0006) [2023-12-26 07:42:53,293][123090] Updated weights for policy 1, policy_version 1010132 (0.0009) [2023-12-26 07:42:53,302][123091] Updated weights for policy 0, policy_version 1017314 (0.0005) [2023-12-26 07:42:53,353][123090] Updated weights for policy 1, policy_version 1010142 (0.0009) [2023-12-26 07:42:53,361][123091] Updated weights for policy 0, policy_version 1017324 (0.0005) [2023-12-26 07:42:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 519036928. Throughput: 0: 9127.7, 1: 8476.6. Samples: 519013184. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:42:53,785][121949] Avg episode reward: [(0, '6430.022'), (1, '5878.721')] [2023-12-26 07:42:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001017328_260440064.pth... [2023-12-26 07:42:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001010144_258596864.pth... [2023-12-26 07:42:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001016272_260169728.pth [2023-12-26 07:42:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001009152_258342912.pth [2023-12-26 07:42:54,156][123091] Updated weights for policy 0, policy_version 1017334 (0.0009) [2023-12-26 07:42:54,202][123090] Updated weights for policy 1, policy_version 1010152 (0.0008) [2023-12-26 07:42:54,211][123091] Updated weights for policy 0, policy_version 1017344 (0.0007) [2023-12-26 07:42:54,258][123090] Updated weights for policy 1, policy_version 1010162 (0.0008) [2023-12-26 07:42:54,265][123091] Updated weights for policy 0, policy_version 1017354 (0.0007) [2023-12-26 07:42:54,311][123090] Updated weights for policy 1, policy_version 1010172 (0.0007) [2023-12-26 07:42:55,107][123091] Updated weights for policy 0, policy_version 1017364 (0.0009) [2023-12-26 07:42:55,127][123090] Updated weights for policy 1, policy_version 1010182 (0.0009) [2023-12-26 07:42:55,172][123091] Updated weights for policy 0, policy_version 1017374 (0.0009) [2023-12-26 07:42:55,192][123090] Updated weights for policy 1, policy_version 1010192 (0.0007) [2023-12-26 07:42:55,239][123091] Updated weights for policy 0, policy_version 1017384 (0.0008) [2023-12-26 07:42:55,257][123090] Updated weights for policy 1, policy_version 1010202 (0.0009) [2023-12-26 07:42:56,001][123090] Updated weights for policy 1, policy_version 1010212 (0.0007) [2023-12-26 07:42:56,028][123091] Updated weights for policy 0, policy_version 1017394 (0.0009) [2023-12-26 07:42:56,049][123090] Updated weights for policy 1, policy_version 1010222 (0.0007) [2023-12-26 07:42:56,076][123091] Updated weights for policy 0, policy_version 1017404 (0.0010) [2023-12-26 07:42:56,094][123090] Updated weights for policy 1, policy_version 1010232 (0.0005) [2023-12-26 07:42:56,135][123091] Updated weights for policy 0, policy_version 1017414 (0.0010) [2023-12-26 07:42:56,188][123091] Updated weights for policy 0, policy_version 1017424 (0.0010) [2023-12-26 07:42:56,884][123090] Updated weights for policy 1, policy_version 1010242 (0.0005) [2023-12-26 07:42:56,927][123091] Updated weights for policy 0, policy_version 1017434 (0.0005) [2023-12-26 07:42:56,949][123090] Updated weights for policy 1, policy_version 1010252 (0.0005) [2023-12-26 07:42:56,987][123091] Updated weights for policy 0, policy_version 1017444 (0.0008) [2023-12-26 07:42:57,013][123090] Updated weights for policy 1, policy_version 1010262 (0.0005) [2023-12-26 07:42:57,045][123091] Updated weights for policy 0, policy_version 1017454 (0.0007) [2023-12-26 07:42:57,074][123090] Updated weights for policy 1, policy_version 1010272 (0.0005) [2023-12-26 07:42:57,713][123090] Updated weights for policy 1, policy_version 1010282 (0.0008) [2023-12-26 07:42:57,736][123091] Updated weights for policy 0, policy_version 1017464 (0.0006) [2023-12-26 07:42:57,773][123090] Updated weights for policy 1, policy_version 1010292 (0.0008) [2023-12-26 07:42:57,796][123091] Updated weights for policy 0, policy_version 1017474 (0.0005) [2023-12-26 07:42:57,827][123090] Updated weights for policy 1, policy_version 1010302 (0.0008) [2023-12-26 07:42:57,853][123091] Updated weights for policy 0, policy_version 1017484 (0.0006) [2023-12-26 07:42:58,627][123091] Updated weights for policy 0, policy_version 1017494 (0.0007) [2023-12-26 07:42:58,698][123090] Updated weights for policy 1, policy_version 1010312 (0.0008) [2023-12-26 07:42:58,723][123091] Updated weights for policy 0, policy_version 1017504 (0.0007) [2023-12-26 07:42:58,766][123090] Updated weights for policy 1, policy_version 1010322 (0.0008) [2023-12-26 07:42:58,780][123091] Updated weights for policy 0, policy_version 1017514 (0.0008) [2023-12-26 07:42:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 519118848. Throughput: 0: 9138.2, 1: 8577.3. Samples: 519121116. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:42:58,785][121949] Avg episode reward: [(0, '6335.976'), (1, '5920.422')] [2023-12-26 07:42:58,849][123090] Updated weights for policy 1, policy_version 1010332 (0.0009) [2023-12-26 07:42:59,629][123091] Updated weights for policy 0, policy_version 1017524 (0.0010) [2023-12-26 07:42:59,689][123091] Updated weights for policy 0, policy_version 1017534 (0.0006) [2023-12-26 07:42:59,715][123090] Updated weights for policy 1, policy_version 1010342 (0.0007) [2023-12-26 07:42:59,763][123091] Updated weights for policy 0, policy_version 1017544 (0.0005) [2023-12-26 07:42:59,766][123090] Updated weights for policy 1, policy_version 1010352 (0.0005) [2023-12-26 07:42:59,830][123090] Updated weights for policy 1, policy_version 1010362 (0.0007) [2023-12-26 07:43:00,579][123091] Updated weights for policy 0, policy_version 1017554 (0.0008) [2023-12-26 07:43:00,632][123091] Updated weights for policy 0, policy_version 1017565 (0.0009) [2023-12-26 07:43:00,654][123090] Updated weights for policy 1, policy_version 1010372 (0.0009) [2023-12-26 07:43:00,691][123091] Updated weights for policy 0, policy_version 1017575 (0.0008) [2023-12-26 07:43:00,703][123090] Updated weights for policy 1, policy_version 1010382 (0.0008) [2023-12-26 07:43:00,758][123090] Updated weights for policy 1, policy_version 1010392 (0.0007) [2023-12-26 07:43:01,457][123091] Updated weights for policy 0, policy_version 1017585 (0.0008) [2023-12-26 07:43:01,520][123091] Updated weights for policy 0, policy_version 1017595 (0.0005) [2023-12-26 07:43:01,553][123090] Updated weights for policy 1, policy_version 1010402 (0.0006) [2023-12-26 07:43:01,581][123091] Updated weights for policy 0, policy_version 1017605 (0.0005) [2023-12-26 07:43:01,622][123090] Updated weights for policy 1, policy_version 1010412 (0.0009) [2023-12-26 07:43:01,652][123091] Updated weights for policy 0, policy_version 1017615 (0.0007) [2023-12-26 07:43:01,689][123090] Updated weights for policy 1, policy_version 1010422 (0.0007) [2023-12-26 07:43:01,762][123090] Updated weights for policy 1, policy_version 1010432 (0.0009) [2023-12-26 07:43:02,427][123091] Updated weights for policy 0, policy_version 1017625 (0.0009) [2023-12-26 07:43:02,492][123091] Updated weights for policy 0, policy_version 1017635 (0.0009) [2023-12-26 07:43:02,541][123091] Updated weights for policy 0, policy_version 1017645 (0.0008) [2023-12-26 07:43:02,541][123090] Updated weights for policy 1, policy_version 1010442 (0.0008) [2023-12-26 07:43:02,604][123090] Updated weights for policy 1, policy_version 1010452 (0.0008) [2023-12-26 07:43:02,679][123090] Updated weights for policy 1, policy_version 1010462 (0.0010) [2023-12-26 07:43:03,273][123091] Updated weights for policy 0, policy_version 1017655 (0.0010) [2023-12-26 07:43:03,330][123091] Updated weights for policy 0, policy_version 1017666 (0.0010) [2023-12-26 07:43:03,383][123091] Updated weights for policy 0, policy_version 1017676 (0.0010) [2023-12-26 07:43:03,449][123090] Updated weights for policy 1, policy_version 1010472 (0.0008) [2023-12-26 07:43:03,497][123090] Updated weights for policy 1, policy_version 1010482 (0.0008) [2023-12-26 07:43:03,557][123090] Updated weights for policy 1, policy_version 1010492 (0.0009) [2023-12-26 07:43:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 519217152. Throughput: 0: 9022.1, 1: 8596.2. Samples: 519225932. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:03,785][121949] Avg episode reward: [(0, '6180.780'), (1, '5943.263')] [2023-12-26 07:43:04,270][123091] Updated weights for policy 0, policy_version 1017687 (0.0009) [2023-12-26 07:43:04,323][123091] Updated weights for policy 0, policy_version 1017697 (0.0010) [2023-12-26 07:43:04,371][123090] Updated weights for policy 1, policy_version 1010502 (0.0010) [2023-12-26 07:43:04,389][123091] Updated weights for policy 0, policy_version 1017707 (0.0008) [2023-12-26 07:43:04,437][123090] Updated weights for policy 1, policy_version 1010512 (0.0008) [2023-12-26 07:43:04,504][123090] Updated weights for policy 1, policy_version 1010522 (0.0010) [2023-12-26 07:43:05,224][123091] Updated weights for policy 0, policy_version 1017717 (0.0009) [2023-12-26 07:43:05,282][123091] Updated weights for policy 0, policy_version 1017727 (0.0009) [2023-12-26 07:43:05,319][123090] Updated weights for policy 1, policy_version 1010532 (0.0008) [2023-12-26 07:43:05,335][123091] Updated weights for policy 0, policy_version 1017737 (0.0010) [2023-12-26 07:43:05,368][123090] Updated weights for policy 1, policy_version 1010542 (0.0008) [2023-12-26 07:43:05,428][123090] Updated weights for policy 1, policy_version 1010553 (0.0010) [2023-12-26 07:43:06,127][123091] Updated weights for policy 0, policy_version 1017747 (0.0008) [2023-12-26 07:43:06,189][123091] Updated weights for policy 0, policy_version 1017757 (0.0006) [2023-12-26 07:43:06,244][123091] Updated weights for policy 0, policy_version 1017767 (0.0007) [2023-12-26 07:43:06,312][123090] Updated weights for policy 1, policy_version 1010563 (0.0010) [2023-12-26 07:43:06,366][123090] Updated weights for policy 1, policy_version 1010573 (0.0009) [2023-12-26 07:43:06,428][123090] Updated weights for policy 1, policy_version 1010583 (0.0010) [2023-12-26 07:43:07,097][123091] Updated weights for policy 0, policy_version 1017777 (0.0009) [2023-12-26 07:43:07,162][123091] Updated weights for policy 0, policy_version 1017787 (0.0008) [2023-12-26 07:43:07,189][123090] Updated weights for policy 1, policy_version 1010593 (0.0007) [2023-12-26 07:43:07,229][123091] Updated weights for policy 0, policy_version 1017797 (0.0009) [2023-12-26 07:43:07,245][123090] Updated weights for policy 1, policy_version 1010603 (0.0009) [2023-12-26 07:43:07,292][123091] Updated weights for policy 0, policy_version 1017807 (0.0008) [2023-12-26 07:43:07,307][123090] Updated weights for policy 1, policy_version 1010613 (0.0008) [2023-12-26 07:43:07,358][123090] Updated weights for policy 1, policy_version 1010623 (0.0009) [2023-12-26 07:43:08,053][123090] Updated weights for policy 1, policy_version 1010633 (0.0009) [2023-12-26 07:43:08,106][123090] Updated weights for policy 1, policy_version 1010643 (0.0009) [2023-12-26 07:43:08,133][123091] Updated weights for policy 0, policy_version 1017817 (0.0008) [2023-12-26 07:43:08,153][123090] Updated weights for policy 1, policy_version 1010653 (0.0008) [2023-12-26 07:43:08,196][123091] Updated weights for policy 0, policy_version 1017827 (0.0009) [2023-12-26 07:43:08,261][123091] Updated weights for policy 0, policy_version 1017837 (0.0009) [2023-12-26 07:43:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 519299072. Throughput: 0: 8994.7, 1: 8569.6. Samples: 519277792. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:08,785][121949] Avg episode reward: [(0, '6087.141'), (1, '5932.545')] [2023-12-26 07:43:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001017840_260571136.pth... [2023-12-26 07:43:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001010656_258727936.pth... [2023-12-26 07:43:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001016784_260300800.pth [2023-12-26 07:43:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001009664_258473984.pth [2023-12-26 07:43:09,016][123090] Updated weights for policy 1, policy_version 1010663 (0.0008) [2023-12-26 07:43:09,078][123090] Updated weights for policy 1, policy_version 1010673 (0.0009) [2023-12-26 07:43:09,102][123091] Updated weights for policy 0, policy_version 1017847 (0.0009) [2023-12-26 07:43:09,126][123090] Updated weights for policy 1, policy_version 1010683 (0.0008) [2023-12-26 07:43:09,160][123091] Updated weights for policy 0, policy_version 1017857 (0.0008) [2023-12-26 07:43:09,229][123091] Updated weights for policy 0, policy_version 1017867 (0.0010) [2023-12-26 07:43:09,991][123090] Updated weights for policy 1, policy_version 1010693 (0.0009) [2023-12-26 07:43:10,061][123090] Updated weights for policy 1, policy_version 1010703 (0.0009) [2023-12-26 07:43:10,089][123091] Updated weights for policy 0, policy_version 1017877 (0.0008) [2023-12-26 07:43:10,124][123090] Updated weights for policy 1, policy_version 1010713 (0.0006) [2023-12-26 07:43:10,143][123091] Updated weights for policy 0, policy_version 1017887 (0.0009) [2023-12-26 07:43:10,208][123091] Updated weights for policy 0, policy_version 1017897 (0.0009) [2023-12-26 07:43:10,803][123090] Updated weights for policy 1, policy_version 1010723 (0.0007) [2023-12-26 07:43:10,875][123090] Updated weights for policy 1, policy_version 1010733 (0.0010) [2023-12-26 07:43:10,934][123091] Updated weights for policy 0, policy_version 1017907 (0.0008) [2023-12-26 07:43:10,955][123090] Updated weights for policy 1, policy_version 1010743 (0.0009) [2023-12-26 07:43:10,992][123091] Updated weights for policy 0, policy_version 1017917 (0.0007) [2023-12-26 07:43:11,065][123091] Updated weights for policy 0, policy_version 1017927 (0.0009) [2023-12-26 07:43:11,712][123090] Updated weights for policy 1, policy_version 1010753 (0.0008) [2023-12-26 07:43:11,786][123090] Updated weights for policy 1, policy_version 1010763 (0.0008) [2023-12-26 07:43:11,845][123090] Updated weights for policy 1, policy_version 1010773 (0.0006) [2023-12-26 07:43:11,901][123090] Updated weights for policy 1, policy_version 1010783 (0.0008) [2023-12-26 07:43:11,922][123091] Updated weights for policy 0, policy_version 1017937 (0.0009) [2023-12-26 07:43:11,977][123091] Updated weights for policy 0, policy_version 1017947 (0.0009) [2023-12-26 07:43:12,044][123091] Updated weights for policy 0, policy_version 1017957 (0.0010) [2023-12-26 07:43:12,113][123091] Updated weights for policy 0, policy_version 1017967 (0.0010) [2023-12-26 07:43:12,652][123090] Updated weights for policy 1, policy_version 1010793 (0.0007) [2023-12-26 07:43:12,707][123090] Updated weights for policy 1, policy_version 1010803 (0.0005) [2023-12-26 07:43:12,766][123090] Updated weights for policy 1, policy_version 1010813 (0.0006) [2023-12-26 07:43:13,035][123091] Updated weights for policy 0, policy_version 1017977 (0.0010) [2023-12-26 07:43:13,095][123091] Updated weights for policy 0, policy_version 1017987 (0.0009) [2023-12-26 07:43:13,164][123091] Updated weights for policy 0, policy_version 1017997 (0.0010) [2023-12-26 07:43:13,495][123090] Updated weights for policy 1, policy_version 1010823 (0.0008) [2023-12-26 07:43:13,553][123090] Updated weights for policy 1, policy_version 1010833 (0.0009) [2023-12-26 07:43:13,612][123090] Updated weights for policy 1, policy_version 1010843 (0.0010) [2023-12-26 07:43:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 519389184. Throughput: 0: 8849.4, 1: 8672.0. Samples: 519382552. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:13,785][121949] Avg episode reward: [(0, '6210.315'), (1, '5876.379')] [2023-12-26 07:43:13,977][123091] Updated weights for policy 0, policy_version 1018007 (0.0010) [2023-12-26 07:43:14,027][123091] Updated weights for policy 0, policy_version 1018017 (0.0009) [2023-12-26 07:43:14,076][123091] Updated weights for policy 0, policy_version 1018027 (0.0009) [2023-12-26 07:43:14,403][123090] Updated weights for policy 1, policy_version 1010853 (0.0009) [2023-12-26 07:43:14,468][123090] Updated weights for policy 1, policy_version 1010863 (0.0009) [2023-12-26 07:43:14,529][123090] Updated weights for policy 1, policy_version 1010873 (0.0009) [2023-12-26 07:43:14,906][123091] Updated weights for policy 0, policy_version 1018037 (0.0010) [2023-12-26 07:43:14,957][123091] Updated weights for policy 0, policy_version 1018047 (0.0010) [2023-12-26 07:43:15,024][123091] Updated weights for policy 0, policy_version 1018057 (0.0010) [2023-12-26 07:43:15,373][123090] Updated weights for policy 1, policy_version 1010883 (0.0009) [2023-12-26 07:43:15,430][123090] Updated weights for policy 1, policy_version 1010893 (0.0009) [2023-12-26 07:43:15,497][123090] Updated weights for policy 1, policy_version 1010903 (0.0009) [2023-12-26 07:43:15,886][123091] Updated weights for policy 0, policy_version 1018067 (0.0010) [2023-12-26 07:43:15,946][123091] Updated weights for policy 0, policy_version 1018077 (0.0009) [2023-12-26 07:43:16,016][123091] Updated weights for policy 0, policy_version 1018087 (0.0009) [2023-12-26 07:43:16,357][123090] Updated weights for policy 1, policy_version 1010913 (0.0009) [2023-12-26 07:43:16,417][123090] Updated weights for policy 1, policy_version 1010923 (0.0008) [2023-12-26 07:43:16,469][123090] Updated weights for policy 1, policy_version 1010933 (0.0010) [2023-12-26 07:43:16,517][123090] Updated weights for policy 1, policy_version 1010943 (0.0010) [2023-12-26 07:43:16,846][123091] Updated weights for policy 0, policy_version 1018097 (0.0010) [2023-12-26 07:43:16,915][123091] Updated weights for policy 0, policy_version 1018107 (0.0010) [2023-12-26 07:43:16,993][123091] Updated weights for policy 0, policy_version 1018117 (0.0010) [2023-12-26 07:43:17,047][123091] Updated weights for policy 0, policy_version 1018127 (0.0009) [2023-12-26 07:43:17,295][123090] Updated weights for policy 1, policy_version 1010953 (0.0009) [2023-12-26 07:43:17,349][123090] Updated weights for policy 1, policy_version 1010963 (0.0009) [2023-12-26 07:43:17,403][123090] Updated weights for policy 1, policy_version 1010973 (0.0009) [2023-12-26 07:43:17,841][123091] Updated weights for policy 0, policy_version 1018137 (0.0009) [2023-12-26 07:43:17,911][123091] Updated weights for policy 0, policy_version 1018147 (0.0007) [2023-12-26 07:43:17,969][123091] Updated weights for policy 0, policy_version 1018157 (0.0006) [2023-12-26 07:43:18,161][123090] Updated weights for policy 1, policy_version 1010983 (0.0006) [2023-12-26 07:43:18,237][123090] Updated weights for policy 1, policy_version 1010993 (0.0005) [2023-12-26 07:43:18,312][123090] Updated weights for policy 1, policy_version 1011003 (0.0006) [2023-12-26 07:43:18,703][123091] Updated weights for policy 0, policy_version 1018167 (0.0005) [2023-12-26 07:43:18,771][123091] Updated weights for policy 0, policy_version 1018177 (0.0005) [2023-12-26 07:43:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 519471104. Throughput: 0: 8870.9, 1: 8684.5. Samples: 519487748. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:18,785][121949] Avg episode reward: [(0, '6336.361'), (1, '5749.871')] [2023-12-26 07:43:18,840][123091] Updated weights for policy 0, policy_version 1018187 (0.0006) [2023-12-26 07:43:19,002][123090] Updated weights for policy 1, policy_version 1011013 (0.0010) [2023-12-26 07:43:19,062][123090] Updated weights for policy 1, policy_version 1011023 (0.0010) [2023-12-26 07:43:19,110][123090] Updated weights for policy 1, policy_version 1011033 (0.0010) [2023-12-26 07:43:19,584][123091] Updated weights for policy 0, policy_version 1018197 (0.0010) [2023-12-26 07:43:19,646][123091] Updated weights for policy 0, policy_version 1018207 (0.0009) [2023-12-26 07:43:19,716][123091] Updated weights for policy 0, policy_version 1018217 (0.0009) [2023-12-26 07:43:19,968][123090] Updated weights for policy 1, policy_version 1011043 (0.0010) [2023-12-26 07:43:20,030][123090] Updated weights for policy 1, policy_version 1011053 (0.0009) [2023-12-26 07:43:20,093][123090] Updated weights for policy 1, policy_version 1011063 (0.0009) [2023-12-26 07:43:20,574][123091] Updated weights for policy 0, policy_version 1018227 (0.0008) [2023-12-26 07:43:20,640][123091] Updated weights for policy 0, policy_version 1018237 (0.0008) [2023-12-26 07:43:20,692][123091] Updated weights for policy 0, policy_version 1018247 (0.0008) [2023-12-26 07:43:20,956][123090] Updated weights for policy 1, policy_version 1011073 (0.0009) [2023-12-26 07:43:21,025][123090] Updated weights for policy 1, policy_version 1011083 (0.0014) [2023-12-26 07:43:21,080][123090] Updated weights for policy 1, policy_version 1011093 (0.0010) [2023-12-26 07:43:21,133][123090] Updated weights for policy 1, policy_version 1011103 (0.0010) [2023-12-26 07:43:21,480][123091] Updated weights for policy 0, policy_version 1018257 (0.0009) [2023-12-26 07:43:21,545][123091] Updated weights for policy 0, policy_version 1018267 (0.0011) [2023-12-26 07:43:21,603][123091] Updated weights for policy 0, policy_version 1018277 (0.0009) [2023-12-26 07:43:21,675][123091] Updated weights for policy 0, policy_version 1018287 (0.0008) [2023-12-26 07:43:21,925][123090] Updated weights for policy 1, policy_version 1011113 (0.0011) [2023-12-26 07:43:21,990][123090] Updated weights for policy 1, policy_version 1011123 (0.0011) [2023-12-26 07:43:22,043][123090] Updated weights for policy 1, policy_version 1011133 (0.0011) [2023-12-26 07:43:22,465][123091] Updated weights for policy 0, policy_version 1018297 (0.0010) [2023-12-26 07:43:22,532][123091] Updated weights for policy 0, policy_version 1018307 (0.0011) [2023-12-26 07:43:22,599][123091] Updated weights for policy 0, policy_version 1018317 (0.0011) [2023-12-26 07:43:22,851][123090] Updated weights for policy 1, policy_version 1011143 (0.0007) [2023-12-26 07:43:22,914][123090] Updated weights for policy 1, policy_version 1011153 (0.0006) [2023-12-26 07:43:22,980][123090] Updated weights for policy 1, policy_version 1011163 (0.0010) [2023-12-26 07:43:23,414][123091] Updated weights for policy 0, policy_version 1018327 (0.0011) [2023-12-26 07:43:23,474][123091] Updated weights for policy 0, policy_version 1018337 (0.0011) [2023-12-26 07:43:23,533][123091] Updated weights for policy 0, policy_version 1018347 (0.0009) [2023-12-26 07:43:23,741][123090] Updated weights for policy 1, policy_version 1011173 (0.0010) [2023-12-26 07:43:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 519561216. Throughput: 0: 8892.5, 1: 8635.7. Samples: 519539172. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:23,785][121949] Avg episode reward: [(0, '6328.531'), (1, '5581.475')] [2023-12-26 07:43:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001018352_260702208.pth... [2023-12-26 07:43:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001017328_260440064.pth [2023-12-26 07:43:23,802][123090] Updated weights for policy 1, policy_version 1011183 (0.0008) [2023-12-26 07:43:23,869][123090] Updated weights for policy 1, policy_version 1011193 (0.0009) [2023-12-26 07:43:23,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001011200_258867200.pth... [2023-12-26 07:43:23,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001010144_258596864.pth [2023-12-26 07:43:24,342][123091] Updated weights for policy 0, policy_version 1018357 (0.0010) [2023-12-26 07:43:24,394][123091] Updated weights for policy 0, policy_version 1018368 (0.0010) [2023-12-26 07:43:24,446][123091] Updated weights for policy 0, policy_version 1018378 (0.0010) [2023-12-26 07:43:24,706][123090] Updated weights for policy 1, policy_version 1011203 (0.0009) [2023-12-26 07:43:24,761][123090] Updated weights for policy 1, policy_version 1011213 (0.0009) [2023-12-26 07:43:24,814][123090] Updated weights for policy 1, policy_version 1011223 (0.0008) [2023-12-26 07:43:25,236][123091] Updated weights for policy 0, policy_version 1018388 (0.0008) [2023-12-26 07:43:25,296][123091] Updated weights for policy 0, policy_version 1018398 (0.0005) [2023-12-26 07:43:25,357][123091] Updated weights for policy 0, policy_version 1018408 (0.0007) [2023-12-26 07:43:25,728][123090] Updated weights for policy 1, policy_version 1011233 (0.0010) [2023-12-26 07:43:25,794][123090] Updated weights for policy 1, policy_version 1011243 (0.0010) [2023-12-26 07:43:25,847][123090] Updated weights for policy 1, policy_version 1011253 (0.0010) [2023-12-26 07:43:25,902][123090] Updated weights for policy 1, policy_version 1011263 (0.0010) [2023-12-26 07:43:25,999][123091] Updated weights for policy 0, policy_version 1018418 (0.0007) [2023-12-26 07:43:26,052][123091] Updated weights for policy 0, policy_version 1018428 (0.0005) [2023-12-26 07:43:26,100][123091] Updated weights for policy 0, policy_version 1018438 (0.0005) [2023-12-26 07:43:26,155][123091] Updated weights for policy 0, policy_version 1018448 (0.0005) [2023-12-26 07:43:26,795][123091] Updated weights for policy 0, policy_version 1018458 (0.0005) [2023-12-26 07:43:26,833][123090] Updated weights for policy 1, policy_version 1011273 (0.0008) [2023-12-26 07:43:26,864][123091] Updated weights for policy 0, policy_version 1018468 (0.0005) [2023-12-26 07:43:26,881][123090] Updated weights for policy 1, policy_version 1011283 (0.0008) [2023-12-26 07:43:26,923][123091] Updated weights for policy 0, policy_version 1018478 (0.0006) [2023-12-26 07:43:26,939][123090] Updated weights for policy 1, policy_version 1011293 (0.0009) [2023-12-26 07:43:27,451][123091] Updated weights for policy 0, policy_version 1018488 (0.0007) [2023-12-26 07:43:27,506][123091] Updated weights for policy 0, policy_version 1018498 (0.0009) [2023-12-26 07:43:27,552][123091] Updated weights for policy 0, policy_version 1018508 (0.0008) [2023-12-26 07:43:27,874][123090] Updated weights for policy 1, policy_version 1011303 (0.0010) [2023-12-26 07:43:27,932][123090] Updated weights for policy 1, policy_version 1011313 (0.0010) [2023-12-26 07:43:27,988][123090] Updated weights for policy 1, policy_version 1011323 (0.0009) [2023-12-26 07:43:28,277][123091] Updated weights for policy 0, policy_version 1018518 (0.0008) [2023-12-26 07:43:28,338][123091] Updated weights for policy 0, policy_version 1018528 (0.0010) [2023-12-26 07:43:28,397][123091] Updated weights for policy 0, policy_version 1018538 (0.0010) [2023-12-26 07:43:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 519651328. Throughput: 0: 8970.3, 1: 8641.4. Samples: 519646340. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:28,784][121949] Avg episode reward: [(0, '6291.530'), (1, '5541.294')] [2023-12-26 07:43:28,821][123090] Updated weights for policy 1, policy_version 1011333 (0.0010) [2023-12-26 07:43:28,880][123090] Updated weights for policy 1, policy_version 1011343 (0.0008) [2023-12-26 07:43:28,941][123090] Updated weights for policy 1, policy_version 1011353 (0.0009) [2023-12-26 07:43:29,110][123091] Updated weights for policy 0, policy_version 1018548 (0.0010) [2023-12-26 07:43:29,162][123091] Updated weights for policy 0, policy_version 1018559 (0.0009) [2023-12-26 07:43:29,216][123091] Updated weights for policy 0, policy_version 1018569 (0.0009) [2023-12-26 07:43:29,779][123090] Updated weights for policy 1, policy_version 1011363 (0.0010) [2023-12-26 07:43:29,844][123090] Updated weights for policy 1, policy_version 1011373 (0.0009) [2023-12-26 07:43:29,897][123090] Updated weights for policy 1, policy_version 1011383 (0.0009) [2023-12-26 07:43:30,079][123091] Updated weights for policy 0, policy_version 1018579 (0.0008) [2023-12-26 07:43:30,144][123091] Updated weights for policy 0, policy_version 1018589 (0.0009) [2023-12-26 07:43:30,207][123091] Updated weights for policy 0, policy_version 1018599 (0.0009) [2023-12-26 07:43:30,787][123090] Updated weights for policy 1, policy_version 1011393 (0.0009) [2023-12-26 07:43:30,846][123090] Updated weights for policy 1, policy_version 1011403 (0.0007) [2023-12-26 07:43:30,903][123090] Updated weights for policy 1, policy_version 1011413 (0.0005) [2023-12-26 07:43:30,930][123091] Updated weights for policy 0, policy_version 1018609 (0.0006) [2023-12-26 07:43:30,957][123090] Updated weights for policy 1, policy_version 1011423 (0.0005) [2023-12-26 07:43:30,996][123091] Updated weights for policy 0, policy_version 1018619 (0.0006) [2023-12-26 07:43:31,061][123091] Updated weights for policy 0, policy_version 1018629 (0.0007) [2023-12-26 07:43:31,131][123091] Updated weights for policy 0, policy_version 1018639 (0.0010) [2023-12-26 07:43:31,695][123090] Updated weights for policy 1, policy_version 1011433 (0.0009) [2023-12-26 07:43:31,759][123090] Updated weights for policy 1, policy_version 1011443 (0.0008) [2023-12-26 07:43:31,817][123090] Updated weights for policy 1, policy_version 1011453 (0.0009) [2023-12-26 07:43:31,919][123091] Updated weights for policy 0, policy_version 1018649 (0.0010) [2023-12-26 07:43:31,972][123091] Updated weights for policy 0, policy_version 1018660 (0.0011) [2023-12-26 07:43:32,024][123091] Updated weights for policy 0, policy_version 1018670 (0.0009) [2023-12-26 07:43:32,660][123090] Updated weights for policy 1, policy_version 1011463 (0.0009) [2023-12-26 07:43:32,719][123090] Updated weights for policy 1, policy_version 1011473 (0.0009) [2023-12-26 07:43:32,782][123090] Updated weights for policy 1, policy_version 1011483 (0.0010) [2023-12-26 07:43:32,850][123091] Updated weights for policy 0, policy_version 1018680 (0.0008) [2023-12-26 07:43:32,908][123091] Updated weights for policy 0, policy_version 1018690 (0.0009) [2023-12-26 07:43:32,963][123091] Updated weights for policy 0, policy_version 1018700 (0.0009) [2023-12-26 07:43:33,578][123090] Updated weights for policy 1, policy_version 1011493 (0.0008) [2023-12-26 07:43:33,629][123090] Updated weights for policy 1, policy_version 1011503 (0.0006) [2023-12-26 07:43:33,679][123090] Updated weights for policy 1, policy_version 1011513 (0.0009) [2023-12-26 07:43:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 519741440. Throughput: 0: 8894.5, 1: 8672.7. Samples: 519752056. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:33,785][121949] Avg episode reward: [(0, '6182.833'), (1, '5656.842')] [2023-12-26 07:43:33,811][123091] Updated weights for policy 0, policy_version 1018710 (0.0009) [2023-12-26 07:43:33,875][123091] Updated weights for policy 0, policy_version 1018720 (0.0009) [2023-12-26 07:43:33,939][123091] Updated weights for policy 0, policy_version 1018730 (0.0010) [2023-12-26 07:43:34,517][123090] Updated weights for policy 1, policy_version 1011523 (0.0010) [2023-12-26 07:43:34,574][123090] Updated weights for policy 1, policy_version 1011533 (0.0009) [2023-12-26 07:43:34,625][123090] Updated weights for policy 1, policy_version 1011543 (0.0009) [2023-12-26 07:43:34,725][123091] Updated weights for policy 0, policy_version 1018740 (0.0010) [2023-12-26 07:43:34,781][123091] Updated weights for policy 0, policy_version 1018750 (0.0009) [2023-12-26 07:43:34,842][123091] Updated weights for policy 0, policy_version 1018760 (0.0009) [2023-12-26 07:43:35,509][123090] Updated weights for policy 1, policy_version 1011553 (0.0009) [2023-12-26 07:43:35,574][123090] Updated weights for policy 1, policy_version 1011563 (0.0009) [2023-12-26 07:43:35,608][123091] Updated weights for policy 0, policy_version 1018770 (0.0009) [2023-12-26 07:43:35,629][123090] Updated weights for policy 1, policy_version 1011573 (0.0007) [2023-12-26 07:43:35,658][123091] Updated weights for policy 0, policy_version 1018780 (0.0008) [2023-12-26 07:43:35,678][123090] Updated weights for policy 1, policy_version 1011583 (0.0008) [2023-12-26 07:43:35,715][123091] Updated weights for policy 0, policy_version 1018790 (0.0007) [2023-12-26 07:43:35,764][123091] Updated weights for policy 0, policy_version 1018800 (0.0009) [2023-12-26 07:43:36,468][123090] Updated weights for policy 1, policy_version 1011593 (0.0005) [2023-12-26 07:43:36,522][123090] Updated weights for policy 1, policy_version 1011603 (0.0005) [2023-12-26 07:43:36,577][123090] Updated weights for policy 1, policy_version 1011613 (0.0005) [2023-12-26 07:43:36,637][123091] Updated weights for policy 0, policy_version 1018810 (0.0008) [2023-12-26 07:43:36,706][123091] Updated weights for policy 0, policy_version 1018820 (0.0010) [2023-12-26 07:43:36,766][123091] Updated weights for policy 0, policy_version 1018830 (0.0009) [2023-12-26 07:43:37,325][123090] Updated weights for policy 1, policy_version 1011623 (0.0007) [2023-12-26 07:43:37,374][123090] Updated weights for policy 1, policy_version 1011633 (0.0009) [2023-12-26 07:43:37,422][123090] Updated weights for policy 1, policy_version 1011643 (0.0009) [2023-12-26 07:43:37,532][123091] Updated weights for policy 0, policy_version 1018840 (0.0010) [2023-12-26 07:43:37,591][123091] Updated weights for policy 0, policy_version 1018850 (0.0011) [2023-12-26 07:43:37,647][123091] Updated weights for policy 0, policy_version 1018860 (0.0011) [2023-12-26 07:43:38,292][123090] Updated weights for policy 1, policy_version 1011653 (0.0008) [2023-12-26 07:43:38,359][123090] Updated weights for policy 1, policy_version 1011663 (0.0007) [2023-12-26 07:43:38,410][123090] Updated weights for policy 1, policy_version 1011673 (0.0008) [2023-12-26 07:43:38,481][123091] Updated weights for policy 0, policy_version 1018870 (0.0011) [2023-12-26 07:43:38,540][123091] Updated weights for policy 0, policy_version 1018880 (0.0011) [2023-12-26 07:43:38,596][123091] Updated weights for policy 0, policy_version 1018890 (0.0011) [2023-12-26 07:43:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 519831552. Throughput: 0: 8877.1, 1: 8708.5. Samples: 519804536. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:38,785][121949] Avg episode reward: [(0, '6085.408'), (1, '5788.286')] [2023-12-26 07:43:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001018896_260841472.pth... [2023-12-26 07:43:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001011680_258990080.pth... [2023-12-26 07:43:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001010656_258727936.pth [2023-12-26 07:43:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001017840_260571136.pth [2023-12-26 07:43:39,099][123090] Updated weights for policy 1, policy_version 1011683 (0.0007) [2023-12-26 07:43:39,153][123090] Updated weights for policy 1, policy_version 1011693 (0.0005) [2023-12-26 07:43:39,228][123090] Updated weights for policy 1, policy_version 1011703 (0.0006) [2023-12-26 07:43:39,465][123091] Updated weights for policy 0, policy_version 1018900 (0.0007) [2023-12-26 07:43:39,532][123091] Updated weights for policy 0, policy_version 1018910 (0.0006) [2023-12-26 07:43:39,606][123091] Updated weights for policy 0, policy_version 1018920 (0.0007) [2023-12-26 07:43:40,028][123090] Updated weights for policy 1, policy_version 1011713 (0.0007) [2023-12-26 07:43:40,081][123090] Updated weights for policy 1, policy_version 1011723 (0.0010) [2023-12-26 07:43:40,143][123090] Updated weights for policy 1, policy_version 1011733 (0.0011) [2023-12-26 07:43:40,210][123090] Updated weights for policy 1, policy_version 1011743 (0.0011) [2023-12-26 07:43:40,428][123091] Updated weights for policy 0, policy_version 1018930 (0.0009) [2023-12-26 07:43:40,493][123091] Updated weights for policy 0, policy_version 1018940 (0.0009) [2023-12-26 07:43:40,546][123091] Updated weights for policy 0, policy_version 1018950 (0.0009) [2023-12-26 07:43:40,598][123091] Updated weights for policy 0, policy_version 1018960 (0.0009) [2023-12-26 07:43:41,059][123090] Updated weights for policy 1, policy_version 1011753 (0.0011) [2023-12-26 07:43:41,123][123090] Updated weights for policy 1, policy_version 1011763 (0.0010) [2023-12-26 07:43:41,199][123090] Updated weights for policy 1, policy_version 1011773 (0.0011) [2023-12-26 07:43:41,416][123091] Updated weights for policy 0, policy_version 1018970 (0.0010) [2023-12-26 07:43:41,472][123091] Updated weights for policy 0, policy_version 1018980 (0.0011) [2023-12-26 07:43:41,528][123091] Updated weights for policy 0, policy_version 1018990 (0.0011) [2023-12-26 07:43:42,070][123090] Updated weights for policy 1, policy_version 1011783 (0.0009) [2023-12-26 07:43:42,136][123090] Updated weights for policy 1, policy_version 1011793 (0.0007) [2023-12-26 07:43:42,185][123090] Updated weights for policy 1, policy_version 1011803 (0.0005) [2023-12-26 07:43:42,404][123091] Updated weights for policy 0, policy_version 1019000 (0.0011) [2023-12-26 07:43:42,459][123091] Updated weights for policy 0, policy_version 1019010 (0.0011) [2023-12-26 07:43:42,503][123091] Updated weights for policy 0, policy_version 1019020 (0.0010) [2023-12-26 07:43:43,008][123090] Updated weights for policy 1, policy_version 1011813 (0.0008) [2023-12-26 07:43:43,063][123090] Updated weights for policy 1, policy_version 1011823 (0.0010) [2023-12-26 07:43:43,119][123090] Updated weights for policy 1, policy_version 1011833 (0.0009) [2023-12-26 07:43:43,264][123091] Updated weights for policy 0, policy_version 1019030 (0.0010) [2023-12-26 07:43:43,310][123091] Updated weights for policy 0, policy_version 1019040 (0.0010) [2023-12-26 07:43:43,358][123091] Updated weights for policy 0, policy_version 1019050 (0.0010) [2023-12-26 07:43:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 519913472. Throughput: 0: 8805.2, 1: 8675.8. Samples: 519907756. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:43,784][121949] Avg episode reward: [(0, '6083.941'), (1, '5688.968')] [2023-12-26 07:43:43,949][123090] Updated weights for policy 1, policy_version 1011843 (0.0006) [2023-12-26 07:43:43,960][123091] Updated weights for policy 0, policy_version 1019060 (0.0009) [2023-12-26 07:43:44,003][123090] Updated weights for policy 1, policy_version 1011853 (0.0007) [2023-12-26 07:43:44,024][123091] Updated weights for policy 0, policy_version 1019070 (0.0011) [2023-12-26 07:43:44,061][123090] Updated weights for policy 1, policy_version 1011863 (0.0006) [2023-12-26 07:43:44,095][123091] Updated weights for policy 0, policy_version 1019080 (0.0011) [2023-12-26 07:43:44,735][123090] Updated weights for policy 1, policy_version 1011873 (0.0006) [2023-12-26 07:43:44,808][123091] Updated weights for policy 0, policy_version 1019090 (0.0010) [2023-12-26 07:43:44,812][123090] Updated weights for policy 1, policy_version 1011883 (0.0008) [2023-12-26 07:43:44,877][123091] Updated weights for policy 0, policy_version 1019100 (0.0011) [2023-12-26 07:43:44,883][123090] Updated weights for policy 1, policy_version 1011893 (0.0008) [2023-12-26 07:43:44,937][123091] Updated weights for policy 0, policy_version 1019110 (0.0011) [2023-12-26 07:43:44,953][123090] Updated weights for policy 1, policy_version 1011903 (0.0008) [2023-12-26 07:43:45,001][123091] Updated weights for policy 0, policy_version 1019120 (0.0011) [2023-12-26 07:43:45,726][123090] Updated weights for policy 1, policy_version 1011913 (0.0010) [2023-12-26 07:43:45,778][123090] Updated weights for policy 1, policy_version 1011923 (0.0010) [2023-12-26 07:43:45,841][123090] Updated weights for policy 1, policy_version 1011933 (0.0010) [2023-12-26 07:43:45,841][123091] Updated weights for policy 0, policy_version 1019130 (0.0009) [2023-12-26 07:43:45,897][123091] Updated weights for policy 0, policy_version 1019140 (0.0010) [2023-12-26 07:43:45,956][123091] Updated weights for policy 0, policy_version 1019150 (0.0011) [2023-12-26 07:43:46,621][123090] Updated weights for policy 1, policy_version 1011943 (0.0010) [2023-12-26 07:43:46,684][123090] Updated weights for policy 1, policy_version 1011953 (0.0010) [2023-12-26 07:43:46,745][123091] Updated weights for policy 0, policy_version 1019160 (0.0007) [2023-12-26 07:43:46,754][123090] Updated weights for policy 1, policy_version 1011963 (0.0010) [2023-12-26 07:43:46,797][123091] Updated weights for policy 0, policy_version 1019170 (0.0006) [2023-12-26 07:43:46,849][123091] Updated weights for policy 0, policy_version 1019180 (0.0006) [2023-12-26 07:43:47,529][123091] Updated weights for policy 0, policy_version 1019190 (0.0005) [2023-12-26 07:43:47,561][123090] Updated weights for policy 1, policy_version 1011973 (0.0010) [2023-12-26 07:43:47,590][123091] Updated weights for policy 0, policy_version 1019200 (0.0005) [2023-12-26 07:43:47,627][123090] Updated weights for policy 1, policy_version 1011983 (0.0010) [2023-12-26 07:43:47,653][123091] Updated weights for policy 0, policy_version 1019210 (0.0005) [2023-12-26 07:43:47,686][123090] Updated weights for policy 1, policy_version 1011993 (0.0010) [2023-12-26 07:43:48,257][123091] Updated weights for policy 0, policy_version 1019220 (0.0007) [2023-12-26 07:43:48,323][123091] Updated weights for policy 0, policy_version 1019230 (0.0011) [2023-12-26 07:43:48,398][123091] Updated weights for policy 0, policy_version 1019240 (0.0011) [2023-12-26 07:43:48,477][123090] Updated weights for policy 1, policy_version 1012003 (0.0010) [2023-12-26 07:43:48,534][123090] Updated weights for policy 1, policy_version 1012013 (0.0009) [2023-12-26 07:43:48,601][123090] Updated weights for policy 1, policy_version 1012023 (0.0009) [2023-12-26 07:43:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 520011776. Throughput: 0: 8913.4, 1: 8701.4. Samples: 520018600. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:48,785][121949] Avg episode reward: [(0, '6159.403'), (1, '5746.347')] [2023-12-26 07:43:49,203][123091] Updated weights for policy 0, policy_version 1019250 (0.0010) [2023-12-26 07:43:49,273][123091] Updated weights for policy 0, policy_version 1019260 (0.0010) [2023-12-26 07:43:49,344][123091] Updated weights for policy 0, policy_version 1019270 (0.0009) [2023-12-26 07:43:49,407][123091] Updated weights for policy 0, policy_version 1019280 (0.0008) [2023-12-26 07:43:49,540][123090] Updated weights for policy 1, policy_version 1012033 (0.0009) [2023-12-26 07:43:49,599][123090] Updated weights for policy 1, policy_version 1012043 (0.0010) [2023-12-26 07:43:49,654][123090] Updated weights for policy 1, policy_version 1012053 (0.0010) [2023-12-26 07:43:49,711][123090] Updated weights for policy 1, policy_version 1012063 (0.0010) [2023-12-26 07:43:50,083][123091] Updated weights for policy 0, policy_version 1019290 (0.0006) [2023-12-26 07:43:50,156][123091] Updated weights for policy 0, policy_version 1019300 (0.0006) [2023-12-26 07:43:50,223][123091] Updated weights for policy 0, policy_version 1019310 (0.0007) [2023-12-26 07:43:50,625][123090] Updated weights for policy 1, policy_version 1012073 (0.0010) [2023-12-26 07:43:50,686][123090] Updated weights for policy 1, policy_version 1012083 (0.0009) [2023-12-26 07:43:50,751][123090] Updated weights for policy 1, policy_version 1012093 (0.0006) [2023-12-26 07:43:50,998][123091] Updated weights for policy 0, policy_version 1019320 (0.0011) [2023-12-26 07:43:51,063][123091] Updated weights for policy 0, policy_version 1019330 (0.0011) [2023-12-26 07:43:51,127][123091] Updated weights for policy 0, policy_version 1019340 (0.0007) [2023-12-26 07:43:51,555][123090] Updated weights for policy 1, policy_version 1012103 (0.0009) [2023-12-26 07:43:51,615][123090] Updated weights for policy 1, policy_version 1012113 (0.0011) [2023-12-26 07:43:51,687][123090] Updated weights for policy 1, policy_version 1012123 (0.0011) [2023-12-26 07:43:51,912][123091] Updated weights for policy 0, policy_version 1019350 (0.0008) [2023-12-26 07:43:51,975][123091] Updated weights for policy 0, policy_version 1019360 (0.0008) [2023-12-26 07:43:52,044][123091] Updated weights for policy 0, policy_version 1019370 (0.0008) [2023-12-26 07:43:52,515][123090] Updated weights for policy 1, policy_version 1012133 (0.0008) [2023-12-26 07:43:52,580][123090] Updated weights for policy 1, policy_version 1012143 (0.0009) [2023-12-26 07:43:52,645][123090] Updated weights for policy 1, policy_version 1012153 (0.0010) [2023-12-26 07:43:52,787][123091] Updated weights for policy 0, policy_version 1019380 (0.0009) [2023-12-26 07:43:52,840][123091] Updated weights for policy 0, policy_version 1019390 (0.0010) [2023-12-26 07:43:52,893][123091] Updated weights for policy 0, policy_version 1019400 (0.0010) [2023-12-26 07:43:53,438][123090] Updated weights for policy 1, policy_version 1012163 (0.0010) [2023-12-26 07:43:53,497][123090] Updated weights for policy 1, policy_version 1012173 (0.0010) [2023-12-26 07:43:53,570][123090] Updated weights for policy 1, policy_version 1012183 (0.0010) [2023-12-26 07:43:53,727][123091] Updated weights for policy 0, policy_version 1019410 (0.0010) [2023-12-26 07:43:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 520093696. Throughput: 0: 8943.1, 1: 8672.9. Samples: 520070512. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:53,785][121949] Avg episode reward: [(0, '6144.706'), (1, '5784.591')] [2023-12-26 07:43:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001012192_259121152.pth... [2023-12-26 07:43:53,793][123091] Updated weights for policy 0, policy_version 1019420 (0.0006) [2023-12-26 07:43:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001011200_258867200.pth [2023-12-26 07:43:53,863][123091] Updated weights for policy 0, policy_version 1019430 (0.0005) [2023-12-26 07:43:53,929][123091] Updated weights for policy 0, policy_version 1019440 (0.0005) [2023-12-26 07:43:53,929][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001019440_260980736.pth... [2023-12-26 07:43:53,934][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001018352_260702208.pth [2023-12-26 07:43:54,276][123090] Updated weights for policy 1, policy_version 1012193 (0.0009) [2023-12-26 07:43:54,344][123090] Updated weights for policy 1, policy_version 1012203 (0.0010) [2023-12-26 07:43:54,415][123090] Updated weights for policy 1, policy_version 1012213 (0.0010) [2023-12-26 07:43:54,473][123090] Updated weights for policy 1, policy_version 1012223 (0.0010) [2023-12-26 07:43:54,536][123091] Updated weights for policy 0, policy_version 1019450 (0.0011) [2023-12-26 07:43:54,599][123091] Updated weights for policy 0, policy_version 1019460 (0.0011) [2023-12-26 07:43:54,660][123091] Updated weights for policy 0, policy_version 1019470 (0.0010) [2023-12-26 07:43:55,266][123090] Updated weights for policy 1, policy_version 1012233 (0.0009) [2023-12-26 07:43:55,332][123091] Updated weights for policy 0, policy_version 1019480 (0.0008) [2023-12-26 07:43:55,337][123090] Updated weights for policy 1, policy_version 1012243 (0.0008) [2023-12-26 07:43:55,398][123091] Updated weights for policy 0, policy_version 1019490 (0.0008) [2023-12-26 07:43:55,402][123090] Updated weights for policy 1, policy_version 1012253 (0.0009) [2023-12-26 07:43:55,463][123091] Updated weights for policy 0, policy_version 1019500 (0.0008) [2023-12-26 07:43:56,164][123090] Updated weights for policy 1, policy_version 1012263 (0.0010) [2023-12-26 07:43:56,214][123090] Updated weights for policy 1, policy_version 1012273 (0.0010) [2023-12-26 07:43:56,265][123091] Updated weights for policy 0, policy_version 1019510 (0.0009) [2023-12-26 07:43:56,276][123090] Updated weights for policy 1, policy_version 1012283 (0.0010) [2023-12-26 07:43:56,316][123091] Updated weights for policy 0, policy_version 1019520 (0.0010) [2023-12-26 07:43:56,371][123091] Updated weights for policy 0, policy_version 1019530 (0.0010) [2023-12-26 07:43:57,093][123090] Updated weights for policy 1, policy_version 1012293 (0.0010) [2023-12-26 07:43:57,160][123090] Updated weights for policy 1, policy_version 1012303 (0.0010) [2023-12-26 07:43:57,166][123091] Updated weights for policy 0, policy_version 1019540 (0.0009) [2023-12-26 07:43:57,207][123090] Updated weights for policy 1, policy_version 1012313 (0.0010) [2023-12-26 07:43:57,220][123091] Updated weights for policy 0, policy_version 1019550 (0.0006) [2023-12-26 07:43:57,273][123091] Updated weights for policy 0, policy_version 1019560 (0.0005) [2023-12-26 07:43:58,004][123090] Updated weights for policy 1, policy_version 1012323 (0.0010) [2023-12-26 07:43:58,071][123090] Updated weights for policy 1, policy_version 1012333 (0.0008) [2023-12-26 07:43:58,104][123091] Updated weights for policy 0, policy_version 1019570 (0.0007) [2023-12-26 07:43:58,130][123090] Updated weights for policy 1, policy_version 1012343 (0.0009) [2023-12-26 07:43:58,160][123091] Updated weights for policy 0, policy_version 1019580 (0.0008) [2023-12-26 07:43:58,230][123091] Updated weights for policy 0, policy_version 1019590 (0.0009) [2023-12-26 07:43:58,299][123091] Updated weights for policy 0, policy_version 1019600 (0.0009) [2023-12-26 07:43:58,789][121949] Fps is (10 sec: 17195.3, 60 sec: 17748.0, 300 sec: 17688.9). Total num frames: 520183808. Throughput: 0: 9054.0, 1: 8653.0. Samples: 520179448. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:43:58,790][121949] Avg episode reward: [(0, '6213.851'), (1, '5760.757')] [2023-12-26 07:43:58,936][123090] Updated weights for policy 1, policy_version 1012353 (0.0008) [2023-12-26 07:43:59,009][123090] Updated weights for policy 1, policy_version 1012363 (0.0008) [2023-12-26 07:43:59,074][123090] Updated weights for policy 1, policy_version 1012373 (0.0008) [2023-12-26 07:43:59,138][123090] Updated weights for policy 1, policy_version 1012383 (0.0007) [2023-12-26 07:43:59,302][123091] Updated weights for policy 0, policy_version 1019610 (0.0006) [2023-12-26 07:43:59,374][123091] Updated weights for policy 0, policy_version 1019620 (0.0010) [2023-12-26 07:43:59,440][123091] Updated weights for policy 0, policy_version 1019630 (0.0010) [2023-12-26 07:43:59,935][123090] Updated weights for policy 1, policy_version 1012393 (0.0009) [2023-12-26 07:44:00,006][123090] Updated weights for policy 1, policy_version 1012403 (0.0009) [2023-12-26 07:44:00,065][123090] Updated weights for policy 1, policy_version 1012413 (0.0009) [2023-12-26 07:44:00,225][123091] Updated weights for policy 0, policy_version 1019640 (0.0006) [2023-12-26 07:44:00,270][123091] Updated weights for policy 0, policy_version 1019650 (0.0005) [2023-12-26 07:44:00,327][123091] Updated weights for policy 0, policy_version 1019660 (0.0005) [2023-12-26 07:44:00,805][123090] Updated weights for policy 1, policy_version 1012423 (0.0007) [2023-12-26 07:44:00,859][123090] Updated weights for policy 1, policy_version 1012433 (0.0005) [2023-12-26 07:44:00,916][123090] Updated weights for policy 1, policy_version 1012443 (0.0005) [2023-12-26 07:44:00,980][123091] Updated weights for policy 0, policy_version 1019670 (0.0006) [2023-12-26 07:44:01,030][123091] Updated weights for policy 0, policy_version 1019680 (0.0006) [2023-12-26 07:44:01,089][123091] Updated weights for policy 0, policy_version 1019690 (0.0007) [2023-12-26 07:44:01,679][123090] Updated weights for policy 1, policy_version 1012453 (0.0006) [2023-12-26 07:44:01,745][123090] Updated weights for policy 1, policy_version 1012463 (0.0009) [2023-12-26 07:44:01,798][123090] Updated weights for policy 1, policy_version 1012473 (0.0005) [2023-12-26 07:44:01,961][123091] Updated weights for policy 0, policy_version 1019700 (0.0008) [2023-12-26 07:44:02,024][123091] Updated weights for policy 0, policy_version 1019710 (0.0009) [2023-12-26 07:44:02,077][123091] Updated weights for policy 0, policy_version 1019720 (0.0010) [2023-12-26 07:44:02,605][123090] Updated weights for policy 1, policy_version 1012483 (0.0007) [2023-12-26 07:44:02,662][123090] Updated weights for policy 1, policy_version 1012493 (0.0010) [2023-12-26 07:44:02,713][123090] Updated weights for policy 1, policy_version 1012503 (0.0009) [2023-12-26 07:44:02,924][123091] Updated weights for policy 0, policy_version 1019730 (0.0010) [2023-12-26 07:44:02,990][123091] Updated weights for policy 0, policy_version 1019740 (0.0011) [2023-12-26 07:44:03,052][123091] Updated weights for policy 0, policy_version 1019750 (0.0010) [2023-12-26 07:44:03,103][123091] Updated weights for policy 0, policy_version 1019760 (0.0010) [2023-12-26 07:44:03,578][123090] Updated weights for policy 1, policy_version 1012513 (0.0009) [2023-12-26 07:44:03,630][123090] Updated weights for policy 1, policy_version 1012523 (0.0009) [2023-12-26 07:44:03,687][123090] Updated weights for policy 1, policy_version 1012534 (0.0010) [2023-12-26 07:44:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 520273920. Throughput: 0: 9076.4, 1: 8627.7. Samples: 520284428. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:03,785][121949] Avg episode reward: [(0, '6321.580'), (1, '5814.081')] [2023-12-26 07:44:03,866][123091] Updated weights for policy 0, policy_version 1019770 (0.0007) [2023-12-26 07:44:03,931][123091] Updated weights for policy 0, policy_version 1019780 (0.0008) [2023-12-26 07:44:04,000][123091] Updated weights for policy 0, policy_version 1019790 (0.0008) [2023-12-26 07:44:04,575][123090] Updated weights for policy 1, policy_version 1012545 (0.0010) [2023-12-26 07:44:04,637][123090] Updated weights for policy 1, policy_version 1012555 (0.0010) [2023-12-26 07:44:04,703][123090] Updated weights for policy 1, policy_version 1012565 (0.0010) [2023-12-26 07:44:04,742][123091] Updated weights for policy 0, policy_version 1019800 (0.0010) [2023-12-26 07:44:04,755][123090] Updated weights for policy 1, policy_version 1012575 (0.0010) [2023-12-26 07:44:04,789][123091] Updated weights for policy 0, policy_version 1019810 (0.0010) [2023-12-26 07:44:04,848][123091] Updated weights for policy 0, policy_version 1019820 (0.0010) [2023-12-26 07:44:05,588][123090] Updated weights for policy 1, policy_version 1012585 (0.0010) [2023-12-26 07:44:05,657][123090] Updated weights for policy 1, policy_version 1012595 (0.0010) [2023-12-26 07:44:05,659][123091] Updated weights for policy 0, policy_version 1019830 (0.0007) [2023-12-26 07:44:05,711][123091] Updated weights for policy 0, policy_version 1019840 (0.0006) [2023-12-26 07:44:05,720][123090] Updated weights for policy 1, policy_version 1012605 (0.0010) [2023-12-26 07:44:05,759][123091] Updated weights for policy 0, policy_version 1019850 (0.0005) [2023-12-26 07:44:06,445][123091] Updated weights for policy 0, policy_version 1019860 (0.0007) [2023-12-26 07:44:06,477][123090] Updated weights for policy 1, policy_version 1012615 (0.0007) [2023-12-26 07:44:06,511][123091] Updated weights for policy 0, policy_version 1019870 (0.0011) [2023-12-26 07:44:06,530][123090] Updated weights for policy 1, policy_version 1012625 (0.0008) [2023-12-26 07:44:06,578][123091] Updated weights for policy 0, policy_version 1019880 (0.0010) [2023-12-26 07:44:06,587][123090] Updated weights for policy 1, policy_version 1012635 (0.0011) [2023-12-26 07:44:07,271][123091] Updated weights for policy 0, policy_version 1019890 (0.0009) [2023-12-26 07:44:07,325][123091] Updated weights for policy 0, policy_version 1019900 (0.0007) [2023-12-26 07:44:07,380][123091] Updated weights for policy 0, policy_version 1019910 (0.0010) [2023-12-26 07:44:07,432][123091] Updated weights for policy 0, policy_version 1019920 (0.0010) [2023-12-26 07:44:07,434][123090] Updated weights for policy 1, policy_version 1012645 (0.0011) [2023-12-26 07:44:07,490][123090] Updated weights for policy 1, policy_version 1012655 (0.0010) [2023-12-26 07:44:07,549][123090] Updated weights for policy 1, policy_version 1012665 (0.0010) [2023-12-26 07:44:08,187][123091] Updated weights for policy 0, policy_version 1019930 (0.0006) [2023-12-26 07:44:08,253][123091] Updated weights for policy 0, policy_version 1019940 (0.0005) [2023-12-26 07:44:08,327][123091] Updated weights for policy 0, policy_version 1019950 (0.0006) [2023-12-26 07:44:08,397][123090] Updated weights for policy 1, policy_version 1012675 (0.0009) [2023-12-26 07:44:08,465][123090] Updated weights for policy 1, policy_version 1012685 (0.0005) [2023-12-26 07:44:08,520][123090] Updated weights for policy 1, policy_version 1012695 (0.0005) [2023-12-26 07:44:08,784][121949] Fps is (10 sec: 18030.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 520364032. Throughput: 0: 9117.3, 1: 8636.9. Samples: 520338112. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:08,785][121949] Avg episode reward: [(0, '6366.442'), (1, '5891.548')] [2023-12-26 07:44:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001019952_261111808.pth... [2023-12-26 07:44:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001012704_259252224.pth... [2023-12-26 07:44:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001011680_258990080.pth [2023-12-26 07:44:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001018896_260841472.pth [2023-12-26 07:44:09,018][123091] Updated weights for policy 0, policy_version 1019960 (0.0007) [2023-12-26 07:44:09,079][123091] Updated weights for policy 0, policy_version 1019970 (0.0007) [2023-12-26 07:44:09,146][123091] Updated weights for policy 0, policy_version 1019980 (0.0007) [2023-12-26 07:44:09,311][123090] Updated weights for policy 1, policy_version 1012705 (0.0010) [2023-12-26 07:44:09,384][123090] Updated weights for policy 1, policy_version 1012715 (0.0009) [2023-12-26 07:44:09,451][123090] Updated weights for policy 1, policy_version 1012725 (0.0007) [2023-12-26 07:44:09,513][123090] Updated weights for policy 1, policy_version 1012735 (0.0009) [2023-12-26 07:44:09,819][123091] Updated weights for policy 0, policy_version 1019990 (0.0006) [2023-12-26 07:44:09,894][123091] Updated weights for policy 0, policy_version 1020000 (0.0009) [2023-12-26 07:44:09,959][123091] Updated weights for policy 0, policy_version 1020010 (0.0011) [2023-12-26 07:44:10,342][123090] Updated weights for policy 1, policy_version 1012745 (0.0009) [2023-12-26 07:44:10,411][123090] Updated weights for policy 1, policy_version 1012755 (0.0010) [2023-12-26 07:44:10,475][123090] Updated weights for policy 1, policy_version 1012765 (0.0010) [2023-12-26 07:44:10,753][123091] Updated weights for policy 0, policy_version 1020020 (0.0008) [2023-12-26 07:44:10,822][123091] Updated weights for policy 0, policy_version 1020030 (0.0009) [2023-12-26 07:44:10,892][123091] Updated weights for policy 0, policy_version 1020040 (0.0010) [2023-12-26 07:44:11,288][123090] Updated weights for policy 1, policy_version 1012775 (0.0009) [2023-12-26 07:44:11,357][123090] Updated weights for policy 1, policy_version 1012785 (0.0009) [2023-12-26 07:44:11,431][123090] Updated weights for policy 1, policy_version 1012796 (0.0010) [2023-12-26 07:44:11,710][123091] Updated weights for policy 0, policy_version 1020050 (0.0008) [2023-12-26 07:44:11,782][123091] Updated weights for policy 0, policy_version 1020060 (0.0008) [2023-12-26 07:44:11,842][123091] Updated weights for policy 0, policy_version 1020070 (0.0007) [2023-12-26 07:44:11,904][123091] Updated weights for policy 0, policy_version 1020080 (0.0006) [2023-12-26 07:44:12,312][123090] Updated weights for policy 1, policy_version 1012806 (0.0009) [2023-12-26 07:44:12,372][123090] Updated weights for policy 1, policy_version 1012816 (0.0009) [2023-12-26 07:44:12,443][123090] Updated weights for policy 1, policy_version 1012826 (0.0008) [2023-12-26 07:44:12,634][123091] Updated weights for policy 0, policy_version 1020090 (0.0008) [2023-12-26 07:44:12,680][123091] Updated weights for policy 0, policy_version 1020100 (0.0008) [2023-12-26 07:44:12,729][123091] Updated weights for policy 0, policy_version 1020110 (0.0009) [2023-12-26 07:44:13,276][123090] Updated weights for policy 1, policy_version 1012836 (0.0008) [2023-12-26 07:44:13,323][123090] Updated weights for policy 1, policy_version 1012846 (0.0008) [2023-12-26 07:44:13,371][123090] Updated weights for policy 1, policy_version 1012856 (0.0008) [2023-12-26 07:44:13,505][123091] Updated weights for policy 0, policy_version 1020120 (0.0006) [2023-12-26 07:44:13,560][123091] Updated weights for policy 0, policy_version 1020130 (0.0005) [2023-12-26 07:44:13,606][123091] Updated weights for policy 0, policy_version 1020140 (0.0005) [2023-12-26 07:44:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 520454144. Throughput: 0: 9075.9, 1: 8655.8. Samples: 520444268. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:13,785][121949] Avg episode reward: [(0, '6196.185'), (1, '5825.814')] [2023-12-26 07:44:14,186][123090] Updated weights for policy 1, policy_version 1012867 (0.0009) [2023-12-26 07:44:14,245][123090] Updated weights for policy 1, policy_version 1012877 (0.0009) [2023-12-26 07:44:14,262][123091] Updated weights for policy 0, policy_version 1020150 (0.0007) [2023-12-26 07:44:14,296][123090] Updated weights for policy 1, policy_version 1012887 (0.0008) [2023-12-26 07:44:14,318][123091] Updated weights for policy 0, policy_version 1020160 (0.0009) [2023-12-26 07:44:14,365][123091] Updated weights for policy 0, policy_version 1020170 (0.0007) [2023-12-26 07:44:15,134][123091] Updated weights for policy 0, policy_version 1020180 (0.0007) [2023-12-26 07:44:15,162][123090] Updated weights for policy 1, policy_version 1012897 (0.0008) [2023-12-26 07:44:15,195][123091] Updated weights for policy 0, policy_version 1020190 (0.0008) [2023-12-26 07:44:15,232][123090] Updated weights for policy 1, policy_version 1012907 (0.0010) [2023-12-26 07:44:15,261][123091] Updated weights for policy 0, policy_version 1020200 (0.0008) [2023-12-26 07:44:15,296][123090] Updated weights for policy 1, policy_version 1012917 (0.0008) [2023-12-26 07:44:15,365][123090] Updated weights for policy 1, policy_version 1012927 (0.0010) [2023-12-26 07:44:15,953][123091] Updated weights for policy 0, policy_version 1020210 (0.0007) [2023-12-26 07:44:16,012][123091] Updated weights for policy 0, policy_version 1020220 (0.0005) [2023-12-26 07:44:16,073][123091] Updated weights for policy 0, policy_version 1020230 (0.0005) [2023-12-26 07:44:16,141][123091] Updated weights for policy 0, policy_version 1020240 (0.0006) [2023-12-26 07:44:16,248][123090] Updated weights for policy 1, policy_version 1012937 (0.0010) [2023-12-26 07:44:16,311][123090] Updated weights for policy 1, policy_version 1012947 (0.0010) [2023-12-26 07:44:16,366][123090] Updated weights for policy 1, policy_version 1012959 (0.0010) [2023-12-26 07:44:16,790][123091] Updated weights for policy 0, policy_version 1020250 (0.0005) [2023-12-26 07:44:16,842][123091] Updated weights for policy 0, policy_version 1020260 (0.0005) [2023-12-26 07:44:16,904][123091] Updated weights for policy 0, policy_version 1020270 (0.0005) [2023-12-26 07:44:17,176][123090] Updated weights for policy 1, policy_version 1012969 (0.0006) [2023-12-26 07:44:17,223][123090] Updated weights for policy 1, policy_version 1012979 (0.0005) [2023-12-26 07:44:17,276][123090] Updated weights for policy 1, policy_version 1012989 (0.0007) [2023-12-26 07:44:17,562][123091] Updated weights for policy 0, policy_version 1020280 (0.0008) [2023-12-26 07:44:17,619][123091] Updated weights for policy 0, policy_version 1020290 (0.0009) [2023-12-26 07:44:17,676][123091] Updated weights for policy 0, policy_version 1020300 (0.0009) [2023-12-26 07:44:18,057][123090] Updated weights for policy 1, policy_version 1012999 (0.0009) [2023-12-26 07:44:18,116][123090] Updated weights for policy 1, policy_version 1013009 (0.0010) [2023-12-26 07:44:18,183][123090] Updated weights for policy 1, policy_version 1013019 (0.0010) [2023-12-26 07:44:18,539][123091] Updated weights for policy 0, policy_version 1020310 (0.0009) [2023-12-26 07:44:18,603][123091] Updated weights for policy 0, policy_version 1020320 (0.0009) [2023-12-26 07:44:18,668][123091] Updated weights for policy 0, policy_version 1020330 (0.0009) [2023-12-26 07:44:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 520544256. Throughput: 0: 9165.9, 1: 8665.2. Samples: 520554452. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:18,785][121949] Avg episode reward: [(0, '6234.732'), (1, '5793.348')] [2023-12-26 07:44:19,021][123090] Updated weights for policy 1, policy_version 1013029 (0.0010) [2023-12-26 07:44:19,073][123090] Updated weights for policy 1, policy_version 1013039 (0.0010) [2023-12-26 07:44:19,124][123090] Updated weights for policy 1, policy_version 1013049 (0.0010) [2023-12-26 07:44:19,475][123091] Updated weights for policy 0, policy_version 1020340 (0.0009) [2023-12-26 07:44:19,545][123091] Updated weights for policy 0, policy_version 1020350 (0.0009) [2023-12-26 07:44:19,602][123091] Updated weights for policy 0, policy_version 1020360 (0.0009) [2023-12-26 07:44:19,974][123090] Updated weights for policy 1, policy_version 1013059 (0.0010) [2023-12-26 07:44:20,036][123090] Updated weights for policy 1, policy_version 1013069 (0.0010) [2023-12-26 07:44:20,097][123090] Updated weights for policy 1, policy_version 1013079 (0.0005) [2023-12-26 07:44:20,305][123091] Updated weights for policy 0, policy_version 1020370 (0.0006) [2023-12-26 07:44:20,371][123091] Updated weights for policy 0, policy_version 1020380 (0.0010) [2023-12-26 07:44:20,451][123091] Updated weights for policy 0, policy_version 1020390 (0.0010) [2023-12-26 07:44:20,515][123091] Updated weights for policy 0, policy_version 1020400 (0.0010) [2023-12-26 07:44:20,883][123090] Updated weights for policy 1, policy_version 1013089 (0.0006) [2023-12-26 07:44:20,938][123090] Updated weights for policy 1, policy_version 1013099 (0.0008) [2023-12-26 07:44:20,999][123090] Updated weights for policy 1, policy_version 1013109 (0.0011) [2023-12-26 07:44:21,064][123090] Updated weights for policy 1, policy_version 1013119 (0.0010) [2023-12-26 07:44:21,339][123091] Updated weights for policy 0, policy_version 1020410 (0.0006) [2023-12-26 07:44:21,404][123091] Updated weights for policy 0, policy_version 1020420 (0.0008) [2023-12-26 07:44:21,468][123091] Updated weights for policy 0, policy_version 1020430 (0.0007) [2023-12-26 07:44:21,950][123090] Updated weights for policy 1, policy_version 1013129 (0.0010) [2023-12-26 07:44:22,018][123090] Updated weights for policy 1, policy_version 1013139 (0.0010) [2023-12-26 07:44:22,084][123090] Updated weights for policy 1, policy_version 1013149 (0.0010) [2023-12-26 07:44:22,246][123091] Updated weights for policy 0, policy_version 1020440 (0.0009) [2023-12-26 07:44:22,304][123091] Updated weights for policy 0, policy_version 1020450 (0.0010) [2023-12-26 07:44:22,368][123091] Updated weights for policy 0, policy_version 1020460 (0.0010) [2023-12-26 07:44:22,866][123090] Updated weights for policy 1, policy_version 1013159 (0.0008) [2023-12-26 07:44:22,934][123090] Updated weights for policy 1, policy_version 1013169 (0.0009) [2023-12-26 07:44:23,002][123090] Updated weights for policy 1, policy_version 1013179 (0.0010) [2023-12-26 07:44:23,207][123091] Updated weights for policy 0, policy_version 1020470 (0.0010) [2023-12-26 07:44:23,251][123091] Updated weights for policy 0, policy_version 1020480 (0.0010) [2023-12-26 07:44:23,311][123091] Updated weights for policy 0, policy_version 1020490 (0.0009) [2023-12-26 07:44:23,777][123090] Updated weights for policy 1, policy_version 1013189 (0.0009) [2023-12-26 07:44:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 520626176. Throughput: 0: 9167.3, 1: 8652.9. Samples: 520606444. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:23,785][121949] Avg episode reward: [(0, '6180.896'), (1, '5953.753')] [2023-12-26 07:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001020496_261251072.pth... [2023-12-26 07:44:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001019440_260980736.pth [2023-12-26 07:44:23,832][123090] Updated weights for policy 1, policy_version 1013199 (0.0006) [2023-12-26 07:44:23,892][123090] Updated weights for policy 1, policy_version 1013209 (0.0005) [2023-12-26 07:44:23,927][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001013216_259383296.pth... [2023-12-26 07:44:23,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001012192_259121152.pth [2023-12-26 07:44:24,079][123091] Updated weights for policy 0, policy_version 1020500 (0.0008) [2023-12-26 07:44:24,136][123091] Updated weights for policy 0, policy_version 1020510 (0.0009) [2023-12-26 07:44:24,192][123091] Updated weights for policy 0, policy_version 1020521 (0.0010) [2023-12-26 07:44:24,512][123090] Updated weights for policy 1, policy_version 1013219 (0.0005) [2023-12-26 07:44:24,576][123090] Updated weights for policy 1, policy_version 1013229 (0.0008) [2023-12-26 07:44:24,640][123090] Updated weights for policy 1, policy_version 1013239 (0.0009) [2023-12-26 07:44:25,056][123091] Updated weights for policy 0, policy_version 1020531 (0.0008) [2023-12-26 07:44:25,108][123091] Updated weights for policy 0, policy_version 1020541 (0.0005) [2023-12-26 07:44:25,159][123091] Updated weights for policy 0, policy_version 1020551 (0.0005) [2023-12-26 07:44:25,483][123090] Updated weights for policy 1, policy_version 1013249 (0.0008) [2023-12-26 07:44:25,549][123090] Updated weights for policy 1, policy_version 1013259 (0.0008) [2023-12-26 07:44:25,608][123090] Updated weights for policy 1, policy_version 1013269 (0.0010) [2023-12-26 07:44:25,676][123090] Updated weights for policy 1, policy_version 1013279 (0.0011) [2023-12-26 07:44:25,890][123091] Updated weights for policy 0, policy_version 1020561 (0.0006) [2023-12-26 07:44:25,953][123091] Updated weights for policy 0, policy_version 1020571 (0.0008) [2023-12-26 07:44:26,018][123091] Updated weights for policy 0, policy_version 1020581 (0.0009) [2023-12-26 07:44:26,079][123091] Updated weights for policy 0, policy_version 1020591 (0.0009) [2023-12-26 07:44:26,447][123090] Updated weights for policy 1, policy_version 1013289 (0.0006) [2023-12-26 07:44:26,497][123090] Updated weights for policy 1, policy_version 1013299 (0.0005) [2023-12-26 07:44:26,547][123090] Updated weights for policy 1, policy_version 1013309 (0.0006) [2023-12-26 07:44:26,899][123091] Updated weights for policy 0, policy_version 1020601 (0.0006) [2023-12-26 07:44:26,965][123091] Updated weights for policy 0, policy_version 1020611 (0.0005) [2023-12-26 07:44:27,025][123091] Updated weights for policy 0, policy_version 1020621 (0.0005) [2023-12-26 07:44:27,411][123090] Updated weights for policy 1, policy_version 1013320 (0.0007) [2023-12-26 07:44:27,456][123090] Updated weights for policy 1, policy_version 1013330 (0.0005) [2023-12-26 07:44:27,505][123090] Updated weights for policy 1, policy_version 1013340 (0.0005) [2023-12-26 07:44:27,733][123091] Updated weights for policy 0, policy_version 1020631 (0.0008) [2023-12-26 07:44:27,800][123091] Updated weights for policy 0, policy_version 1020641 (0.0009) [2023-12-26 07:44:27,864][123091] Updated weights for policy 0, policy_version 1020651 (0.0009) [2023-12-26 07:44:28,170][123090] Updated weights for policy 1, policy_version 1013350 (0.0005) [2023-12-26 07:44:28,223][123090] Updated weights for policy 1, policy_version 1013360 (0.0005) [2023-12-26 07:44:28,283][123090] Updated weights for policy 1, policy_version 1013370 (0.0005) [2023-12-26 07:44:28,726][123091] Updated weights for policy 0, policy_version 1020661 (0.0009) [2023-12-26 07:44:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 520716288. Throughput: 0: 9234.8, 1: 8679.2. Samples: 520713884. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:28,785][121949] Avg episode reward: [(0, '6090.757'), (1, '5955.561')] [2023-12-26 07:44:28,791][123091] Updated weights for policy 0, policy_version 1020671 (0.0010) [2023-12-26 07:44:28,855][123091] Updated weights for policy 0, policy_version 1020681 (0.0009) [2023-12-26 07:44:29,064][123090] Updated weights for policy 1, policy_version 1013380 (0.0008) [2023-12-26 07:44:29,118][123090] Updated weights for policy 1, policy_version 1013390 (0.0009) [2023-12-26 07:44:29,178][123090] Updated weights for policy 1, policy_version 1013400 (0.0009) [2023-12-26 07:44:29,691][123091] Updated weights for policy 0, policy_version 1020691 (0.0009) [2023-12-26 07:44:29,755][123091] Updated weights for policy 0, policy_version 1020701 (0.0008) [2023-12-26 07:44:29,815][123091] Updated weights for policy 0, policy_version 1020711 (0.0009) [2023-12-26 07:44:30,028][123090] Updated weights for policy 1, policy_version 1013410 (0.0009) [2023-12-26 07:44:30,083][123090] Updated weights for policy 1, policy_version 1013420 (0.0009) [2023-12-26 07:44:30,141][123090] Updated weights for policy 1, policy_version 1013430 (0.0008) [2023-12-26 07:44:30,200][123090] Updated weights for policy 1, policy_version 1013440 (0.0010) [2023-12-26 07:44:30,527][123091] Updated weights for policy 0, policy_version 1020721 (0.0009) [2023-12-26 07:44:30,575][123091] Updated weights for policy 0, policy_version 1020731 (0.0009) [2023-12-26 07:44:30,625][123091] Updated weights for policy 0, policy_version 1020742 (0.0009) [2023-12-26 07:44:30,681][123091] Updated weights for policy 0, policy_version 1020752 (0.0009) [2023-12-26 07:44:31,029][123090] Updated weights for policy 1, policy_version 1013450 (0.0006) [2023-12-26 07:44:31,099][123090] Updated weights for policy 1, policy_version 1013460 (0.0008) [2023-12-26 07:44:31,165][123090] Updated weights for policy 1, policy_version 1013470 (0.0009) [2023-12-26 07:44:31,606][123091] Updated weights for policy 0, policy_version 1020762 (0.0009) [2023-12-26 07:44:31,667][123091] Updated weights for policy 0, policy_version 1020772 (0.0009) [2023-12-26 07:44:31,726][123091] Updated weights for policy 0, policy_version 1020782 (0.0009) [2023-12-26 07:44:31,915][123090] Updated weights for policy 1, policy_version 1013480 (0.0006) [2023-12-26 07:44:31,981][123090] Updated weights for policy 1, policy_version 1013491 (0.0006) [2023-12-26 07:44:32,031][123090] Updated weights for policy 1, policy_version 1013501 (0.0009) [2023-12-26 07:44:32,613][123091] Updated weights for policy 0, policy_version 1020792 (0.0009) [2023-12-26 07:44:32,671][123091] Updated weights for policy 0, policy_version 1020803 (0.0010) [2023-12-26 07:44:32,716][123090] Updated weights for policy 1, policy_version 1013511 (0.0008) [2023-12-26 07:44:32,722][123091] Updated weights for policy 0, policy_version 1020813 (0.0008) [2023-12-26 07:44:32,774][123090] Updated weights for policy 1, policy_version 1013521 (0.0009) [2023-12-26 07:44:32,833][123090] Updated weights for policy 1, policy_version 1013531 (0.0009) [2023-12-26 07:44:33,552][123090] Updated weights for policy 1, policy_version 1013541 (0.0009) [2023-12-26 07:44:33,614][123090] Updated weights for policy 1, policy_version 1013551 (0.0010) [2023-12-26 07:44:33,618][123091] Updated weights for policy 0, policy_version 1020823 (0.0007) [2023-12-26 07:44:33,672][123091] Updated weights for policy 0, policy_version 1020833 (0.0008) [2023-12-26 07:44:33,680][123090] Updated weights for policy 1, policy_version 1013561 (0.0010) [2023-12-26 07:44:33,721][123091] Updated weights for policy 0, policy_version 1020843 (0.0008) [2023-12-26 07:44:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 520814592. Throughput: 0: 9059.3, 1: 8756.6. Samples: 520820316. Policy #0 lag: (min: 11.0, avg: 16.6, max: 43.0) [2023-12-26 07:44:33,785][121949] Avg episode reward: [(0, '6126.525'), (1, '5969.037')] [2023-12-26 07:44:34,488][123090] Updated weights for policy 1, policy_version 1013571 (0.0010) [2023-12-26 07:44:34,552][123090] Updated weights for policy 1, policy_version 1013581 (0.0010) [2023-12-26 07:44:34,620][123090] Updated weights for policy 1, policy_version 1013591 (0.0010) [2023-12-26 07:44:34,628][123091] Updated weights for policy 0, policy_version 1020853 (0.0008) [2023-12-26 07:44:34,694][123091] Updated weights for policy 0, policy_version 1020863 (0.0009) [2023-12-26 07:44:34,755][123091] Updated weights for policy 0, policy_version 1020873 (0.0009) [2023-12-26 07:44:35,412][123090] Updated weights for policy 1, policy_version 1013601 (0.0010) [2023-12-26 07:44:35,435][123091] Updated weights for policy 0, policy_version 1020883 (0.0008) [2023-12-26 07:44:35,481][123090] Updated weights for policy 1, policy_version 1013611 (0.0006) [2023-12-26 07:44:35,508][123091] Updated weights for policy 0, policy_version 1020893 (0.0005) [2023-12-26 07:44:35,530][123090] Updated weights for policy 1, policy_version 1013621 (0.0006) [2023-12-26 07:44:35,580][123091] Updated weights for policy 0, policy_version 1020903 (0.0005) [2023-12-26 07:44:35,595][123090] Updated weights for policy 1, policy_version 1013631 (0.0005) [2023-12-26 07:44:36,172][123091] Updated weights for policy 0, policy_version 1020913 (0.0006) [2023-12-26 07:44:36,224][123091] Updated weights for policy 0, policy_version 1020923 (0.0007) [2023-12-26 07:44:36,277][123091] Updated weights for policy 0, policy_version 1020933 (0.0006) [2023-12-26 07:44:36,333][123091] Updated weights for policy 0, policy_version 1020943 (0.0006) [2023-12-26 07:44:36,389][123090] Updated weights for policy 1, policy_version 1013641 (0.0010) [2023-12-26 07:44:36,465][123090] Updated weights for policy 1, policy_version 1013651 (0.0011) [2023-12-26 07:44:36,529][123090] Updated weights for policy 1, policy_version 1013661 (0.0011) [2023-12-26 07:44:37,001][123091] Updated weights for policy 0, policy_version 1020953 (0.0006) [2023-12-26 07:44:37,063][123091] Updated weights for policy 0, policy_version 1020963 (0.0006) [2023-12-26 07:44:37,112][123091] Updated weights for policy 0, policy_version 1020973 (0.0005) [2023-12-26 07:44:37,304][123090] Updated weights for policy 1, policy_version 1013671 (0.0010) [2023-12-26 07:44:37,360][123090] Updated weights for policy 1, policy_version 1013681 (0.0010) [2023-12-26 07:44:37,416][123090] Updated weights for policy 1, policy_version 1013691 (0.0010) [2023-12-26 07:44:37,733][123091] Updated weights for policy 0, policy_version 1020983 (0.0006) [2023-12-26 07:44:37,790][123091] Updated weights for policy 0, policy_version 1020993 (0.0006) [2023-12-26 07:44:37,849][123091] Updated weights for policy 0, policy_version 1021003 (0.0007) [2023-12-26 07:44:38,153][123090] Updated weights for policy 1, policy_version 1013701 (0.0010) [2023-12-26 07:44:38,229][123090] Updated weights for policy 1, policy_version 1013711 (0.0010) [2023-12-26 07:44:38,295][123090] Updated weights for policy 1, policy_version 1013721 (0.0005) [2023-12-26 07:44:38,627][123091] Updated weights for policy 0, policy_version 1021013 (0.0008) [2023-12-26 07:44:38,686][123091] Updated weights for policy 0, policy_version 1021023 (0.0011) [2023-12-26 07:44:38,749][123091] Updated weights for policy 0, policy_version 1021033 (0.0011) [2023-12-26 07:44:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 520896512. Throughput: 0: 9085.6, 1: 8792.0. Samples: 520875004. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:44:38,785][121949] Avg episode reward: [(0, '6097.447'), (1, '6025.837')] [2023-12-26 07:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001021040_261390336.pth... [2023-12-26 07:44:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001013728_259514368.pth... [2023-12-26 07:44:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001019952_261111808.pth [2023-12-26 07:44:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001012704_259252224.pth [2023-12-26 07:44:39,103][123090] Updated weights for policy 1, policy_version 1013731 (0.0008) [2023-12-26 07:44:39,170][123090] Updated weights for policy 1, policy_version 1013741 (0.0011) [2023-12-26 07:44:39,235][123090] Updated weights for policy 1, policy_version 1013751 (0.0010) [2023-12-26 07:44:39,586][123091] Updated weights for policy 0, policy_version 1021043 (0.0009) [2023-12-26 07:44:39,656][123091] Updated weights for policy 0, policy_version 1021053 (0.0006) [2023-12-26 07:44:39,729][123091] Updated weights for policy 0, policy_version 1021063 (0.0008) [2023-12-26 07:44:40,068][123090] Updated weights for policy 1, policy_version 1013761 (0.0010) [2023-12-26 07:44:40,132][123090] Updated weights for policy 1, policy_version 1013771 (0.0009) [2023-12-26 07:44:40,200][123090] Updated weights for policy 1, policy_version 1013781 (0.0011) [2023-12-26 07:44:40,265][123090] Updated weights for policy 1, policy_version 1013791 (0.0011) [2023-12-26 07:44:40,489][123091] Updated weights for policy 0, policy_version 1021073 (0.0006) [2023-12-26 07:44:40,539][123091] Updated weights for policy 0, policy_version 1021083 (0.0006) [2023-12-26 07:44:40,606][123091] Updated weights for policy 0, policy_version 1021093 (0.0007) [2023-12-26 07:44:40,676][123091] Updated weights for policy 0, policy_version 1021103 (0.0008) [2023-12-26 07:44:41,072][123090] Updated weights for policy 1, policy_version 1013801 (0.0010) [2023-12-26 07:44:41,139][123090] Updated weights for policy 1, policy_version 1013811 (0.0010) [2023-12-26 07:44:41,215][123090] Updated weights for policy 1, policy_version 1013821 (0.0010) [2023-12-26 07:44:41,516][123091] Updated weights for policy 0, policy_version 1021113 (0.0010) [2023-12-26 07:44:41,584][123091] Updated weights for policy 0, policy_version 1021123 (0.0009) [2023-12-26 07:44:41,655][123091] Updated weights for policy 0, policy_version 1021133 (0.0009) [2023-12-26 07:44:42,030][123090] Updated weights for policy 1, policy_version 1013831 (0.0008) [2023-12-26 07:44:42,094][123090] Updated weights for policy 1, policy_version 1013841 (0.0010) [2023-12-26 07:44:42,158][123090] Updated weights for policy 1, policy_version 1013851 (0.0011) [2023-12-26 07:44:42,528][123091] Updated weights for policy 0, policy_version 1021143 (0.0010) [2023-12-26 07:44:42,596][123091] Updated weights for policy 0, policy_version 1021153 (0.0010) [2023-12-26 07:44:42,666][123091] Updated weights for policy 0, policy_version 1021163 (0.0010) [2023-12-26 07:44:42,928][123090] Updated weights for policy 1, policy_version 1013861 (0.0010) [2023-12-26 07:44:42,987][123090] Updated weights for policy 1, policy_version 1013871 (0.0010) [2023-12-26 07:44:43,039][123090] Updated weights for policy 1, policy_version 1013881 (0.0010) [2023-12-26 07:44:43,538][123091] Updated weights for policy 0, policy_version 1021173 (0.0010) [2023-12-26 07:44:43,597][123091] Updated weights for policy 0, policy_version 1021183 (0.0010) [2023-12-26 07:44:43,674][123091] Updated weights for policy 0, policy_version 1021193 (0.0009) [2023-12-26 07:44:43,684][123090] Updated weights for policy 1, policy_version 1013891 (0.0009) [2023-12-26 07:44:43,756][123090] Updated weights for policy 1, policy_version 1013901 (0.0005) [2023-12-26 07:44:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 520986624. Throughput: 0: 9052.2, 1: 8758.1. Samples: 520980832. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:44:43,785][121949] Avg episode reward: [(0, '6104.224'), (1, '6034.987')] [2023-12-26 07:44:43,831][123090] Updated weights for policy 1, policy_version 1013911 (0.0005) [2023-12-26 07:44:44,506][123090] Updated weights for policy 1, policy_version 1013921 (0.0006) [2023-12-26 07:44:44,562][123091] Updated weights for policy 0, policy_version 1021203 (0.0009) [2023-12-26 07:44:44,572][123090] Updated weights for policy 1, policy_version 1013931 (0.0008) [2023-12-26 07:44:44,623][123091] Updated weights for policy 0, policy_version 1021213 (0.0007) [2023-12-26 07:44:44,640][123090] Updated weights for policy 1, policy_version 1013941 (0.0009) [2023-12-26 07:44:44,686][123091] Updated weights for policy 0, policy_version 1021223 (0.0009) [2023-12-26 07:44:44,704][123090] Updated weights for policy 1, policy_version 1013951 (0.0008) [2023-12-26 07:44:45,428][123090] Updated weights for policy 1, policy_version 1013961 (0.0009) [2023-12-26 07:44:45,482][123090] Updated weights for policy 1, policy_version 1013971 (0.0009) [2023-12-26 07:44:45,499][123091] Updated weights for policy 0, policy_version 1021233 (0.0010) [2023-12-26 07:44:45,532][123090] Updated weights for policy 1, policy_version 1013981 (0.0007) [2023-12-26 07:44:45,554][123091] Updated weights for policy 0, policy_version 1021243 (0.0010) [2023-12-26 07:44:45,613][123091] Updated weights for policy 0, policy_version 1021253 (0.0010) [2023-12-26 07:44:45,680][123091] Updated weights for policy 0, policy_version 1021263 (0.0010) [2023-12-26 07:44:46,334][123090] Updated weights for policy 1, policy_version 1013991 (0.0007) [2023-12-26 07:44:46,381][123090] Updated weights for policy 1, policy_version 1014001 (0.0005) [2023-12-26 07:44:46,427][123090] Updated weights for policy 1, policy_version 1014011 (0.0005) [2023-12-26 07:44:46,564][123091] Updated weights for policy 0, policy_version 1021273 (0.0010) [2023-12-26 07:44:46,619][123091] Updated weights for policy 0, policy_version 1021283 (0.0010) [2023-12-26 07:44:46,681][123091] Updated weights for policy 0, policy_version 1021293 (0.0009) [2023-12-26 07:44:47,126][123090] Updated weights for policy 1, policy_version 1014021 (0.0005) [2023-12-26 07:44:47,197][123090] Updated weights for policy 1, policy_version 1014031 (0.0005) [2023-12-26 07:44:47,267][123090] Updated weights for policy 1, policy_version 1014041 (0.0005) [2023-12-26 07:44:47,576][123091] Updated weights for policy 0, policy_version 1021303 (0.0009) [2023-12-26 07:44:47,630][123091] Updated weights for policy 0, policy_version 1021313 (0.0010) [2023-12-26 07:44:47,682][123091] Updated weights for policy 0, policy_version 1021323 (0.0009) [2023-12-26 07:44:47,771][123090] Updated weights for policy 1, policy_version 1014051 (0.0006) [2023-12-26 07:44:47,822][123090] Updated weights for policy 1, policy_version 1014062 (0.0008) [2023-12-26 07:44:47,871][123090] Updated weights for policy 1, policy_version 1014072 (0.0009) [2023-12-26 07:44:48,559][123091] Updated weights for policy 0, policy_version 1021333 (0.0009) [2023-12-26 07:44:48,625][123091] Updated weights for policy 0, policy_version 1021343 (0.0010) [2023-12-26 07:44:48,692][123091] Updated weights for policy 0, policy_version 1021353 (0.0009) [2023-12-26 07:44:48,735][123090] Updated weights for policy 1, policy_version 1014082 (0.0008) [2023-12-26 07:44:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 521076736. Throughput: 0: 8968.6, 1: 8872.1. Samples: 521087260. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:44:48,784][121949] Avg episode reward: [(0, '6189.047'), (1, '6037.382')] [2023-12-26 07:44:48,796][123090] Updated weights for policy 1, policy_version 1014092 (0.0006) [2023-12-26 07:44:48,865][123090] Updated weights for policy 1, policy_version 1014102 (0.0006) [2023-12-26 07:44:48,940][123090] Updated weights for policy 1, policy_version 1014112 (0.0006) [2023-12-26 07:44:49,573][123091] Updated weights for policy 0, policy_version 1021363 (0.0009) [2023-12-26 07:44:49,642][123091] Updated weights for policy 0, policy_version 1021373 (0.0009) [2023-12-26 07:44:49,651][123090] Updated weights for policy 1, policy_version 1014122 (0.0006) [2023-12-26 07:44:49,707][123091] Updated weights for policy 0, policy_version 1021383 (0.0009) [2023-12-26 07:44:49,728][123090] Updated weights for policy 1, policy_version 1014132 (0.0005) [2023-12-26 07:44:49,784][123090] Updated weights for policy 1, policy_version 1014142 (0.0005) [2023-12-26 07:44:50,556][123091] Updated weights for policy 0, policy_version 1021393 (0.0009) [2023-12-26 07:44:50,573][123090] Updated weights for policy 1, policy_version 1014152 (0.0006) [2023-12-26 07:44:50,619][123091] Updated weights for policy 0, policy_version 1021403 (0.0009) [2023-12-26 07:44:50,637][123090] Updated weights for policy 1, policy_version 1014162 (0.0007) [2023-12-26 07:44:50,686][123091] Updated weights for policy 0, policy_version 1021413 (0.0010) [2023-12-26 07:44:50,698][123090] Updated weights for policy 1, policy_version 1014172 (0.0005) [2023-12-26 07:44:50,746][123091] Updated weights for policy 0, policy_version 1021423 (0.0010) [2023-12-26 07:44:51,424][123090] Updated weights for policy 1, policy_version 1014182 (0.0008) [2023-12-26 07:44:51,482][123090] Updated weights for policy 1, policy_version 1014192 (0.0009) [2023-12-26 07:44:51,542][123090] Updated weights for policy 1, policy_version 1014202 (0.0010) [2023-12-26 07:44:51,647][123091] Updated weights for policy 0, policy_version 1021433 (0.0009) [2023-12-26 07:44:51,711][123091] Updated weights for policy 0, policy_version 1021443 (0.0006) [2023-12-26 07:44:51,786][123091] Updated weights for policy 0, policy_version 1021453 (0.0009) [2023-12-26 07:44:52,417][123090] Updated weights for policy 1, policy_version 1014212 (0.0009) [2023-12-26 07:44:52,473][123090] Updated weights for policy 1, policy_version 1014222 (0.0009) [2023-12-26 07:44:52,535][123090] Updated weights for policy 1, policy_version 1014232 (0.0009) [2023-12-26 07:44:52,554][123091] Updated weights for policy 0, policy_version 1021463 (0.0009) [2023-12-26 07:44:52,604][123091] Updated weights for policy 0, policy_version 1021473 (0.0008) [2023-12-26 07:44:52,656][123091] Updated weights for policy 0, policy_version 1021483 (0.0009) [2023-12-26 07:44:53,344][123090] Updated weights for policy 1, policy_version 1014242 (0.0008) [2023-12-26 07:44:53,402][123090] Updated weights for policy 1, policy_version 1014252 (0.0009) [2023-12-26 07:44:53,455][123090] Updated weights for policy 1, policy_version 1014262 (0.0007) [2023-12-26 07:44:53,520][123090] Updated weights for policy 1, policy_version 1014272 (0.0006) [2023-12-26 07:44:53,535][123091] Updated weights for policy 0, policy_version 1021493 (0.0009) [2023-12-26 07:44:53,601][123091] Updated weights for policy 0, policy_version 1021503 (0.0010) [2023-12-26 07:44:53,655][123091] Updated weights for policy 0, policy_version 1021513 (0.0010) [2023-12-26 07:44:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 521166848. Throughput: 0: 8885.3, 1: 8911.6. Samples: 521138968. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:44:53,785][121949] Avg episode reward: [(0, '6237.410'), (1, '6036.561')] [2023-12-26 07:44:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001021520_261513216.pth... [2023-12-26 07:44:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001014272_259653632.pth... [2023-12-26 07:44:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001020496_261251072.pth [2023-12-26 07:44:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001013216_259383296.pth [2023-12-26 07:44:54,305][123090] Updated weights for policy 1, policy_version 1014282 (0.0005) [2023-12-26 07:44:54,370][123090] Updated weights for policy 1, policy_version 1014292 (0.0007) [2023-12-26 07:44:54,431][123091] Updated weights for policy 0, policy_version 1021523 (0.0009) [2023-12-26 07:44:54,442][123090] Updated weights for policy 1, policy_version 1014302 (0.0006) [2023-12-26 07:44:54,482][123091] Updated weights for policy 0, policy_version 1021533 (0.0005) [2023-12-26 07:44:54,551][123091] Updated weights for policy 0, policy_version 1021543 (0.0009) [2023-12-26 07:44:55,141][123090] Updated weights for policy 1, policy_version 1014312 (0.0007) [2023-12-26 07:44:55,198][123090] Updated weights for policy 1, policy_version 1014322 (0.0009) [2023-12-26 07:44:55,251][123090] Updated weights for policy 1, policy_version 1014332 (0.0009) [2023-12-26 07:44:55,366][123091] Updated weights for policy 0, policy_version 1021553 (0.0010) [2023-12-26 07:44:55,430][123091] Updated weights for policy 0, policy_version 1021563 (0.0011) [2023-12-26 07:44:55,474][123091] Updated weights for policy 0, policy_version 1021573 (0.0010) [2023-12-26 07:44:55,526][123091] Updated weights for policy 0, policy_version 1021583 (0.0010) [2023-12-26 07:44:56,013][123090] Updated weights for policy 1, policy_version 1014342 (0.0008) [2023-12-26 07:44:56,067][123090] Updated weights for policy 1, policy_version 1014352 (0.0006) [2023-12-26 07:44:56,126][123090] Updated weights for policy 1, policy_version 1014362 (0.0005) [2023-12-26 07:44:56,369][123091] Updated weights for policy 0, policy_version 1021593 (0.0010) [2023-12-26 07:44:56,414][123091] Updated weights for policy 0, policy_version 1021603 (0.0010) [2023-12-26 07:44:56,461][123091] Updated weights for policy 0, policy_version 1021613 (0.0010) [2023-12-26 07:44:56,912][123090] Updated weights for policy 1, policy_version 1014372 (0.0007) [2023-12-26 07:44:56,970][123090] Updated weights for policy 1, policy_version 1014382 (0.0010) [2023-12-26 07:44:57,029][123090] Updated weights for policy 1, policy_version 1014392 (0.0010) [2023-12-26 07:44:57,318][123091] Updated weights for policy 0, policy_version 1021623 (0.0011) [2023-12-26 07:44:57,379][123091] Updated weights for policy 0, policy_version 1021633 (0.0010) [2023-12-26 07:44:57,437][123091] Updated weights for policy 0, policy_version 1021643 (0.0010) [2023-12-26 07:44:57,784][123090] Updated weights for policy 1, policy_version 1014402 (0.0009) [2023-12-26 07:44:57,840][123090] Updated weights for policy 1, policy_version 1014412 (0.0007) [2023-12-26 07:44:57,897][123090] Updated weights for policy 1, policy_version 1014422 (0.0010) [2023-12-26 07:44:57,948][123090] Updated weights for policy 1, policy_version 1014432 (0.0010) [2023-12-26 07:44:58,238][123091] Updated weights for policy 0, policy_version 1021653 (0.0009) [2023-12-26 07:44:58,300][123091] Updated weights for policy 0, policy_version 1021663 (0.0008) [2023-12-26 07:44:58,366][123091] Updated weights for policy 0, policy_version 1021673 (0.0008) [2023-12-26 07:44:58,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17750.6, 300 sec: 17661.4). Total num frames: 521248768. Throughput: 0: 8797.8, 1: 8998.1. Samples: 521245088. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:44:58,785][121949] Avg episode reward: [(0, '6326.733'), (1, '6039.531')] [2023-12-26 07:44:58,858][123090] Updated weights for policy 1, policy_version 1014442 (0.0011) [2023-12-26 07:44:58,925][123090] Updated weights for policy 1, policy_version 1014452 (0.0008) [2023-12-26 07:44:58,991][123090] Updated weights for policy 1, policy_version 1014462 (0.0007) [2023-12-26 07:44:59,212][123091] Updated weights for policy 0, policy_version 1021683 (0.0009) [2023-12-26 07:44:59,282][123091] Updated weights for policy 0, policy_version 1021693 (0.0010) [2023-12-26 07:44:59,341][123091] Updated weights for policy 0, policy_version 1021703 (0.0009) [2023-12-26 07:44:59,781][123090] Updated weights for policy 1, policy_version 1014472 (0.0009) [2023-12-26 07:44:59,848][123090] Updated weights for policy 1, policy_version 1014482 (0.0011) [2023-12-26 07:44:59,915][123090] Updated weights for policy 1, policy_version 1014492 (0.0010) [2023-12-26 07:45:00,167][123091] Updated weights for policy 0, policy_version 1021713 (0.0009) [2023-12-26 07:45:00,231][123091] Updated weights for policy 0, policy_version 1021723 (0.0009) [2023-12-26 07:45:00,300][123091] Updated weights for policy 0, policy_version 1021733 (0.0008) [2023-12-26 07:45:00,361][123091] Updated weights for policy 0, policy_version 1021743 (0.0006) [2023-12-26 07:45:00,711][123090] Updated weights for policy 1, policy_version 1014502 (0.0007) [2023-12-26 07:45:00,768][123090] Updated weights for policy 1, policy_version 1014512 (0.0006) [2023-12-26 07:45:00,840][123090] Updated weights for policy 1, policy_version 1014522 (0.0005) [2023-12-26 07:45:01,101][123091] Updated weights for policy 0, policy_version 1021753 (0.0009) [2023-12-26 07:45:01,166][123091] Updated weights for policy 0, policy_version 1021763 (0.0011) [2023-12-26 07:45:01,221][123091] Updated weights for policy 0, policy_version 1021773 (0.0010) [2023-12-26 07:45:01,597][123090] Updated weights for policy 1, policy_version 1014532 (0.0007) [2023-12-26 07:45:01,667][123090] Updated weights for policy 1, policy_version 1014543 (0.0011) [2023-12-26 07:45:01,734][123090] Updated weights for policy 1, policy_version 1014553 (0.0010) [2023-12-26 07:45:01,997][123091] Updated weights for policy 0, policy_version 1021783 (0.0011) [2023-12-26 07:45:02,056][123091] Updated weights for policy 0, policy_version 1021793 (0.0009) [2023-12-26 07:45:02,110][123091] Updated weights for policy 0, policy_version 1021804 (0.0010) [2023-12-26 07:45:02,486][123090] Updated weights for policy 1, policy_version 1014563 (0.0007) [2023-12-26 07:45:02,549][123090] Updated weights for policy 1, policy_version 1014573 (0.0008) [2023-12-26 07:45:02,604][123090] Updated weights for policy 1, policy_version 1014583 (0.0010) [2023-12-26 07:45:02,873][123091] Updated weights for policy 0, policy_version 1021814 (0.0007) [2023-12-26 07:45:02,918][123091] Updated weights for policy 0, policy_version 1021824 (0.0005) [2023-12-26 07:45:02,966][123091] Updated weights for policy 0, policy_version 1021834 (0.0005) [2023-12-26 07:45:03,344][123090] Updated weights for policy 1, policy_version 1014593 (0.0010) [2023-12-26 07:45:03,395][123090] Updated weights for policy 1, policy_version 1014603 (0.0010) [2023-12-26 07:45:03,452][123090] Updated weights for policy 1, policy_version 1014613 (0.0010) [2023-12-26 07:45:03,510][123090] Updated weights for policy 1, policy_version 1014623 (0.0010) [2023-12-26 07:45:03,751][123091] Updated weights for policy 0, policy_version 1021844 (0.0007) [2023-12-26 07:45:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 521338880. Throughput: 0: 8687.7, 1: 9044.2. Samples: 521352384. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:03,785][121949] Avg episode reward: [(0, '6325.170'), (1, '6044.636')] [2023-12-26 07:45:03,825][123091] Updated weights for policy 0, policy_version 1021854 (0.0011) [2023-12-26 07:45:03,893][123091] Updated weights for policy 0, policy_version 1021864 (0.0010) [2023-12-26 07:45:04,332][123090] Updated weights for policy 1, policy_version 1014633 (0.0010) [2023-12-26 07:45:04,393][123090] Updated weights for policy 1, policy_version 1014643 (0.0010) [2023-12-26 07:45:04,445][123090] Updated weights for policy 1, policy_version 1014653 (0.0010) [2023-12-26 07:45:04,693][123091] Updated weights for policy 0, policy_version 1021874 (0.0009) [2023-12-26 07:45:04,760][123091] Updated weights for policy 0, policy_version 1021884 (0.0006) [2023-12-26 07:45:04,817][123091] Updated weights for policy 0, policy_version 1021894 (0.0008) [2023-12-26 07:45:04,868][123091] Updated weights for policy 0, policy_version 1021904 (0.0009) [2023-12-26 07:45:05,286][123090] Updated weights for policy 1, policy_version 1014663 (0.0010) [2023-12-26 07:45:05,338][123090] Updated weights for policy 1, policy_version 1014673 (0.0010) [2023-12-26 07:45:05,404][123090] Updated weights for policy 1, policy_version 1014683 (0.0010) [2023-12-26 07:45:05,675][123091] Updated weights for policy 0, policy_version 1021914 (0.0009) [2023-12-26 07:45:05,736][123091] Updated weights for policy 0, policy_version 1021924 (0.0009) [2023-12-26 07:45:05,793][123091] Updated weights for policy 0, policy_version 1021934 (0.0009) [2023-12-26 07:45:06,268][123090] Updated weights for policy 1, policy_version 1014693 (0.0011) [2023-12-26 07:45:06,336][123090] Updated weights for policy 1, policy_version 1014703 (0.0011) [2023-12-26 07:45:06,401][123090] Updated weights for policy 1, policy_version 1014713 (0.0011) [2023-12-26 07:45:06,658][123091] Updated weights for policy 0, policy_version 1021944 (0.0009) [2023-12-26 07:45:06,726][123091] Updated weights for policy 0, policy_version 1021954 (0.0008) [2023-12-26 07:45:06,790][123091] Updated weights for policy 0, policy_version 1021964 (0.0009) [2023-12-26 07:45:07,240][123090] Updated weights for policy 1, policy_version 1014723 (0.0011) [2023-12-26 07:45:07,304][123090] Updated weights for policy 1, policy_version 1014733 (0.0011) [2023-12-26 07:45:07,360][123090] Updated weights for policy 1, policy_version 1014743 (0.0010) [2023-12-26 07:45:07,493][123091] Updated weights for policy 0, policy_version 1021974 (0.0006) [2023-12-26 07:45:07,538][123091] Updated weights for policy 0, policy_version 1021984 (0.0005) [2023-12-26 07:45:07,588][123091] Updated weights for policy 0, policy_version 1021994 (0.0007) [2023-12-26 07:45:08,159][123090] Updated weights for policy 1, policy_version 1014753 (0.0010) [2023-12-26 07:45:08,228][123090] Updated weights for policy 1, policy_version 1014763 (0.0008) [2023-12-26 07:45:08,300][123090] Updated weights for policy 1, policy_version 1014773 (0.0007) [2023-12-26 07:45:08,315][123091] Updated weights for policy 0, policy_version 1022004 (0.0008) [2023-12-26 07:45:08,372][123090] Updated weights for policy 1, policy_version 1014783 (0.0008) [2023-12-26 07:45:08,379][123091] Updated weights for policy 0, policy_version 1022014 (0.0010) [2023-12-26 07:45:08,441][123091] Updated weights for policy 0, policy_version 1022024 (0.0009) [2023-12-26 07:45:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 521428992. Throughput: 0: 8665.6, 1: 9043.4. Samples: 521403356. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:08,786][121949] Avg episode reward: [(0, '6191.273'), (1, '6044.206')] [2023-12-26 07:45:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001022032_261644288.pth... [2023-12-26 07:45:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001014784_259784704.pth... [2023-12-26 07:45:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001021040_261390336.pth [2023-12-26 07:45:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001013728_259514368.pth [2023-12-26 07:45:08,974][123090] Updated weights for policy 1, policy_version 1014793 (0.0006) [2023-12-26 07:45:09,029][123090] Updated weights for policy 1, policy_version 1014803 (0.0006) [2023-12-26 07:45:09,081][123090] Updated weights for policy 1, policy_version 1014813 (0.0005) [2023-12-26 07:45:09,286][123091] Updated weights for policy 0, policy_version 1022034 (0.0009) [2023-12-26 07:45:09,356][123091] Updated weights for policy 0, policy_version 1022044 (0.0008) [2023-12-26 07:45:09,430][123091] Updated weights for policy 0, policy_version 1022054 (0.0008) [2023-12-26 07:45:09,497][123091] Updated weights for policy 0, policy_version 1022064 (0.0011) [2023-12-26 07:45:09,867][123090] Updated weights for policy 1, policy_version 1014823 (0.0008) [2023-12-26 07:45:09,941][123090] Updated weights for policy 1, policy_version 1014833 (0.0011) [2023-12-26 07:45:10,009][123090] Updated weights for policy 1, policy_version 1014843 (0.0011) [2023-12-26 07:45:10,299][123091] Updated weights for policy 0, policy_version 1022074 (0.0011) [2023-12-26 07:45:10,363][123091] Updated weights for policy 0, policy_version 1022084 (0.0011) [2023-12-26 07:45:10,418][123091] Updated weights for policy 0, policy_version 1022094 (0.0009) [2023-12-26 07:45:10,776][123090] Updated weights for policy 1, policy_version 1014853 (0.0009) [2023-12-26 07:45:10,833][123090] Updated weights for policy 1, policy_version 1014863 (0.0011) [2023-12-26 07:45:10,891][123090] Updated weights for policy 1, policy_version 1014873 (0.0011) [2023-12-26 07:45:11,267][123091] Updated weights for policy 0, policy_version 1022104 (0.0009) [2023-12-26 07:45:11,343][123091] Updated weights for policy 0, policy_version 1022114 (0.0009) [2023-12-26 07:45:11,409][123091] Updated weights for policy 0, policy_version 1022124 (0.0009) [2023-12-26 07:45:11,752][123090] Updated weights for policy 1, policy_version 1014883 (0.0010) [2023-12-26 07:45:11,818][123090] Updated weights for policy 1, policy_version 1014893 (0.0008) [2023-12-26 07:45:11,881][123090] Updated weights for policy 1, policy_version 1014903 (0.0008) [2023-12-26 07:45:12,313][123091] Updated weights for policy 0, policy_version 1022134 (0.0009) [2023-12-26 07:45:12,389][123091] Updated weights for policy 0, policy_version 1022144 (0.0009) [2023-12-26 07:45:12,457][123091] Updated weights for policy 0, policy_version 1022154 (0.0009) [2023-12-26 07:45:12,704][123090] Updated weights for policy 1, policy_version 1014913 (0.0008) [2023-12-26 07:45:12,772][123090] Updated weights for policy 1, policy_version 1014923 (0.0010) [2023-12-26 07:45:12,842][123090] Updated weights for policy 1, policy_version 1014933 (0.0010) [2023-12-26 07:45:12,904][123090] Updated weights for policy 1, policy_version 1014943 (0.0010) [2023-12-26 07:45:13,243][123091] Updated weights for policy 0, policy_version 1022164 (0.0008) [2023-12-26 07:45:13,300][123091] Updated weights for policy 0, policy_version 1022174 (0.0005) [2023-12-26 07:45:13,359][123091] Updated weights for policy 0, policy_version 1022184 (0.0006) [2023-12-26 07:45:13,774][123090] Updated weights for policy 1, policy_version 1014953 (0.0010) [2023-12-26 07:45:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 521510912. Throughput: 0: 8617.9, 1: 9033.8. Samples: 521508208. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:13,785][121949] Avg episode reward: [(0, '6186.808'), (1, '6040.322')] [2023-12-26 07:45:13,844][123090] Updated weights for policy 1, policy_version 1014963 (0.0009) [2023-12-26 07:45:13,910][123090] Updated weights for policy 1, policy_version 1014973 (0.0009) [2023-12-26 07:45:14,129][123091] Updated weights for policy 0, policy_version 1022194 (0.0006) [2023-12-26 07:45:14,189][123091] Updated weights for policy 0, policy_version 1022204 (0.0009) [2023-12-26 07:45:14,244][123091] Updated weights for policy 0, policy_version 1022214 (0.0009) [2023-12-26 07:45:14,309][123091] Updated weights for policy 0, policy_version 1022224 (0.0009) [2023-12-26 07:45:14,684][123090] Updated weights for policy 1, policy_version 1014983 (0.0006) [2023-12-26 07:45:14,749][123090] Updated weights for policy 1, policy_version 1014993 (0.0005) [2023-12-26 07:45:14,830][123090] Updated weights for policy 1, policy_version 1015003 (0.0008) [2023-12-26 07:45:15,213][123091] Updated weights for policy 0, policy_version 1022234 (0.0008) [2023-12-26 07:45:15,288][123091] Updated weights for policy 0, policy_version 1022244 (0.0006) [2023-12-26 07:45:15,363][123091] Updated weights for policy 0, policy_version 1022254 (0.0006) [2023-12-26 07:45:15,563][123090] Updated weights for policy 1, policy_version 1015013 (0.0006) [2023-12-26 07:45:15,631][123090] Updated weights for policy 1, policy_version 1015023 (0.0007) [2023-12-26 07:45:15,698][123090] Updated weights for policy 1, policy_version 1015033 (0.0010) [2023-12-26 07:45:16,048][123091] Updated weights for policy 0, policy_version 1022264 (0.0006) [2023-12-26 07:45:16,097][123091] Updated weights for policy 0, policy_version 1022274 (0.0006) [2023-12-26 07:45:16,147][123091] Updated weights for policy 0, policy_version 1022284 (0.0007) [2023-12-26 07:45:16,496][123090] Updated weights for policy 1, policy_version 1015043 (0.0010) [2023-12-26 07:45:16,564][123090] Updated weights for policy 1, policy_version 1015053 (0.0008) [2023-12-26 07:45:16,618][123090] Updated weights for policy 1, policy_version 1015063 (0.0009) [2023-12-26 07:45:16,885][123091] Updated weights for policy 0, policy_version 1022294 (0.0006) [2023-12-26 07:45:16,946][123091] Updated weights for policy 0, policy_version 1022304 (0.0007) [2023-12-26 07:45:17,013][123091] Updated weights for policy 0, policy_version 1022314 (0.0008) [2023-12-26 07:45:17,426][123090] Updated weights for policy 1, policy_version 1015073 (0.0011) [2023-12-26 07:45:17,487][123090] Updated weights for policy 1, policy_version 1015083 (0.0010) [2023-12-26 07:45:17,543][123090] Updated weights for policy 1, policy_version 1015094 (0.0011) [2023-12-26 07:45:17,729][123091] Updated weights for policy 0, policy_version 1022324 (0.0009) [2023-12-26 07:45:17,798][123091] Updated weights for policy 0, policy_version 1022334 (0.0006) [2023-12-26 07:45:17,850][123091] Updated weights for policy 0, policy_version 1022344 (0.0011) [2023-12-26 07:45:18,476][123090] Updated weights for policy 1, policy_version 1015105 (0.0010) [2023-12-26 07:45:18,536][123090] Updated weights for policy 1, policy_version 1015115 (0.0008) [2023-12-26 07:45:18,587][123090] Updated weights for policy 1, policy_version 1015125 (0.0009) [2023-12-26 07:45:18,604][123091] Updated weights for policy 0, policy_version 1022354 (0.0007) [2023-12-26 07:45:18,649][123090] Updated weights for policy 1, policy_version 1015135 (0.0008) [2023-12-26 07:45:18,668][123091] Updated weights for policy 0, policy_version 1022364 (0.0010) [2023-12-26 07:45:18,736][123091] Updated weights for policy 0, policy_version 1022374 (0.0011) [2023-12-26 07:45:18,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 521601024. Throughput: 0: 8737.6, 1: 8922.3. Samples: 521615012. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:18,785][121949] Avg episode reward: [(0, '6310.619'), (1, '6042.973')] [2023-12-26 07:45:18,800][123091] Updated weights for policy 0, policy_version 1022384 (0.0011) [2023-12-26 07:45:19,552][123090] Updated weights for policy 1, policy_version 1015145 (0.0009) [2023-12-26 07:45:19,601][123091] Updated weights for policy 0, policy_version 1022394 (0.0007) [2023-12-26 07:45:19,620][123090] Updated weights for policy 1, policy_version 1015155 (0.0008) [2023-12-26 07:45:19,670][123091] Updated weights for policy 0, policy_version 1022404 (0.0006) [2023-12-26 07:45:19,685][123090] Updated weights for policy 1, policy_version 1015165 (0.0009) [2023-12-26 07:45:19,734][123091] Updated weights for policy 0, policy_version 1022414 (0.0008) [2023-12-26 07:45:20,552][123090] Updated weights for policy 1, policy_version 1015175 (0.0007) [2023-12-26 07:45:20,569][123091] Updated weights for policy 0, policy_version 1022424 (0.0008) [2023-12-26 07:45:20,629][123090] Updated weights for policy 1, policy_version 1015185 (0.0010) [2023-12-26 07:45:20,638][123091] Updated weights for policy 0, policy_version 1022434 (0.0008) [2023-12-26 07:45:20,697][123090] Updated weights for policy 1, policy_version 1015195 (0.0009) [2023-12-26 07:45:20,702][123091] Updated weights for policy 0, policy_version 1022444 (0.0009) [2023-12-26 07:45:21,537][123090] Updated weights for policy 1, policy_version 1015205 (0.0008) [2023-12-26 07:45:21,556][123091] Updated weights for policy 0, policy_version 1022454 (0.0009) [2023-12-26 07:45:21,585][123090] Updated weights for policy 1, policy_version 1015215 (0.0008) [2023-12-26 07:45:21,603][123091] Updated weights for policy 0, policy_version 1022464 (0.0007) [2023-12-26 07:45:21,646][123090] Updated weights for policy 1, policy_version 1015225 (0.0010) [2023-12-26 07:45:21,674][123091] Updated weights for policy 0, policy_version 1022474 (0.0009) [2023-12-26 07:45:22,508][123091] Updated weights for policy 0, policy_version 1022484 (0.0010) [2023-12-26 07:45:22,529][123090] Updated weights for policy 1, policy_version 1015235 (0.0006) [2023-12-26 07:45:22,574][123091] Updated weights for policy 0, policy_version 1022494 (0.0008) [2023-12-26 07:45:22,578][123090] Updated weights for policy 1, policy_version 1015245 (0.0009) [2023-12-26 07:45:22,625][123091] Updated weights for policy 0, policy_version 1022504 (0.0010) [2023-12-26 07:45:22,628][123090] Updated weights for policy 1, policy_version 1015255 (0.0006) [2023-12-26 07:45:23,473][123091] Updated weights for policy 0, policy_version 1022514 (0.0007) [2023-12-26 07:45:23,506][123090] Updated weights for policy 1, policy_version 1015265 (0.0008) [2023-12-26 07:45:23,528][123091] Updated weights for policy 0, policy_version 1022524 (0.0010) [2023-12-26 07:45:23,558][123090] Updated weights for policy 1, policy_version 1015275 (0.0009) [2023-12-26 07:45:23,583][123091] Updated weights for policy 0, policy_version 1022534 (0.0010) [2023-12-26 07:45:23,615][123090] Updated weights for policy 1, policy_version 1015285 (0.0007) [2023-12-26 07:45:23,637][123091] Updated weights for policy 0, policy_version 1022544 (0.0010) [2023-12-26 07:45:23,671][123090] Updated weights for policy 1, policy_version 1015295 (0.0008) [2023-12-26 07:45:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 521691136. Throughput: 0: 8650.9, 1: 8888.3. Samples: 521664268. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:23,785][121949] Avg episode reward: [(0, '6239.491'), (1, '6050.502')] [2023-12-26 07:45:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001015296_259915776.pth... [2023-12-26 07:45:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001022544_261775360.pth... [2023-12-26 07:45:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001014272_259653632.pth [2023-12-26 07:45:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001021520_261513216.pth [2023-12-26 07:45:24,344][123091] Updated weights for policy 0, policy_version 1022554 (0.0006) [2023-12-26 07:45:24,412][123091] Updated weights for policy 0, policy_version 1022564 (0.0007) [2023-12-26 07:45:24,469][123090] Updated weights for policy 1, policy_version 1015305 (0.0008) [2023-12-26 07:45:24,481][123091] Updated weights for policy 0, policy_version 1022574 (0.0008) [2023-12-26 07:45:24,525][123090] Updated weights for policy 1, policy_version 1015315 (0.0008) [2023-12-26 07:45:24,600][123090] Updated weights for policy 1, policy_version 1015325 (0.0005) [2023-12-26 07:45:25,152][123091] Updated weights for policy 0, policy_version 1022584 (0.0006) [2023-12-26 07:45:25,211][123091] Updated weights for policy 0, policy_version 1022594 (0.0006) [2023-12-26 07:45:25,230][123090] Updated weights for policy 1, policy_version 1015335 (0.0007) [2023-12-26 07:45:25,256][123091] Updated weights for policy 0, policy_version 1022604 (0.0005) [2023-12-26 07:45:25,293][123090] Updated weights for policy 1, policy_version 1015345 (0.0005) [2023-12-26 07:45:25,350][123090] Updated weights for policy 1, policy_version 1015355 (0.0005) [2023-12-26 07:45:25,870][123091] Updated weights for policy 0, policy_version 1022614 (0.0005) [2023-12-26 07:45:25,923][123091] Updated weights for policy 0, policy_version 1022624 (0.0005) [2023-12-26 07:45:25,978][123091] Updated weights for policy 0, policy_version 1022634 (0.0005) [2023-12-26 07:45:26,043][123090] Updated weights for policy 1, policy_version 1015365 (0.0009) [2023-12-26 07:45:26,105][123090] Updated weights for policy 1, policy_version 1015375 (0.0010) [2023-12-26 07:45:26,176][123090] Updated weights for policy 1, policy_version 1015385 (0.0011) [2023-12-26 07:45:26,787][123091] Updated weights for policy 0, policy_version 1022644 (0.0007) [2023-12-26 07:45:26,857][123091] Updated weights for policy 0, policy_version 1022654 (0.0011) [2023-12-26 07:45:26,923][123091] Updated weights for policy 0, policy_version 1022664 (0.0011) [2023-12-26 07:45:26,952][123090] Updated weights for policy 1, policy_version 1015395 (0.0011) [2023-12-26 07:45:27,003][123090] Updated weights for policy 1, policy_version 1015405 (0.0010) [2023-12-26 07:45:27,056][123090] Updated weights for policy 1, policy_version 1015415 (0.0010) [2023-12-26 07:45:27,530][123091] Updated weights for policy 0, policy_version 1022674 (0.0009) [2023-12-26 07:45:27,586][123091] Updated weights for policy 0, policy_version 1022684 (0.0005) [2023-12-26 07:45:27,634][123091] Updated weights for policy 0, policy_version 1022694 (0.0009) [2023-12-26 07:45:27,694][123091] Updated weights for policy 0, policy_version 1022704 (0.0005) [2023-12-26 07:45:27,791][123090] Updated weights for policy 1, policy_version 1015425 (0.0010) [2023-12-26 07:45:27,854][123090] Updated weights for policy 1, policy_version 1015435 (0.0011) [2023-12-26 07:45:27,908][123090] Updated weights for policy 1, policy_version 1015445 (0.0009) [2023-12-26 07:45:27,959][123090] Updated weights for policy 1, policy_version 1015455 (0.0009) [2023-12-26 07:45:28,412][123091] Updated weights for policy 0, policy_version 1022714 (0.0010) [2023-12-26 07:45:28,471][123091] Updated weights for policy 0, policy_version 1022724 (0.0010) [2023-12-26 07:45:28,527][123091] Updated weights for policy 0, policy_version 1022734 (0.0009) [2023-12-26 07:45:28,721][123090] Updated weights for policy 1, policy_version 1015465 (0.0006) [2023-12-26 07:45:28,783][123090] Updated weights for policy 1, policy_version 1015475 (0.0005) [2023-12-26 07:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 521781248. Throughput: 0: 8731.7, 1: 8939.0. Samples: 521776012. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:28,784][121949] Avg episode reward: [(0, '6298.522'), (1, '6047.569')] [2023-12-26 07:45:28,847][123090] Updated weights for policy 1, policy_version 1015485 (0.0006) [2023-12-26 07:45:29,400][123091] Updated weights for policy 0, policy_version 1022744 (0.0010) [2023-12-26 07:45:29,457][123091] Updated weights for policy 0, policy_version 1022754 (0.0010) [2023-12-26 07:45:29,516][123091] Updated weights for policy 0, policy_version 1022764 (0.0010) [2023-12-26 07:45:29,576][123090] Updated weights for policy 1, policy_version 1015495 (0.0008) [2023-12-26 07:45:29,631][123090] Updated weights for policy 1, policy_version 1015505 (0.0008) [2023-12-26 07:45:29,678][123090] Updated weights for policy 1, policy_version 1015515 (0.0009) [2023-12-26 07:45:30,366][123091] Updated weights for policy 0, policy_version 1022775 (0.0011) [2023-12-26 07:45:30,421][123091] Updated weights for policy 0, policy_version 1022785 (0.0010) [2023-12-26 07:45:30,488][123091] Updated weights for policy 0, policy_version 1022795 (0.0011) [2023-12-26 07:45:30,559][123090] Updated weights for policy 1, policy_version 1015525 (0.0009) [2023-12-26 07:45:30,621][123090] Updated weights for policy 1, policy_version 1015535 (0.0008) [2023-12-26 07:45:30,683][123090] Updated weights for policy 1, policy_version 1015545 (0.0009) [2023-12-26 07:45:31,310][123091] Updated weights for policy 0, policy_version 1022805 (0.0011) [2023-12-26 07:45:31,378][123091] Updated weights for policy 0, policy_version 1022815 (0.0011) [2023-12-26 07:45:31,435][123091] Updated weights for policy 0, policy_version 1022825 (0.0010) [2023-12-26 07:45:31,494][123090] Updated weights for policy 1, policy_version 1015555 (0.0008) [2023-12-26 07:45:31,549][123090] Updated weights for policy 1, policy_version 1015565 (0.0005) [2023-12-26 07:45:31,610][123090] Updated weights for policy 1, policy_version 1015575 (0.0005) [2023-12-26 07:45:32,273][123091] Updated weights for policy 0, policy_version 1022835 (0.0010) [2023-12-26 07:45:32,328][123091] Updated weights for policy 0, policy_version 1022845 (0.0011) [2023-12-26 07:45:32,395][123091] Updated weights for policy 0, policy_version 1022855 (0.0009) [2023-12-26 07:45:32,399][123090] Updated weights for policy 1, policy_version 1015585 (0.0010) [2023-12-26 07:45:32,462][123090] Updated weights for policy 1, policy_version 1015595 (0.0008) [2023-12-26 07:45:32,514][123090] Updated weights for policy 1, policy_version 1015605 (0.0010) [2023-12-26 07:45:32,559][123090] Updated weights for policy 1, policy_version 1015615 (0.0010) [2023-12-26 07:45:33,100][123091] Updated weights for policy 0, policy_version 1022865 (0.0009) [2023-12-26 07:45:33,156][123091] Updated weights for policy 0, policy_version 1022875 (0.0005) [2023-12-26 07:45:33,208][123091] Updated weights for policy 0, policy_version 1022885 (0.0005) [2023-12-26 07:45:33,253][123091] Updated weights for policy 0, policy_version 1022895 (0.0005) [2023-12-26 07:45:33,346][123090] Updated weights for policy 1, policy_version 1015625 (0.0010) [2023-12-26 07:45:33,401][123090] Updated weights for policy 1, policy_version 1015635 (0.0010) [2023-12-26 07:45:33,459][123090] Updated weights for policy 1, policy_version 1015645 (0.0010) [2023-12-26 07:45:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 521871360. Throughput: 0: 8837.9, 1: 8846.3. Samples: 521883052. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:33,785][121949] Avg episode reward: [(0, '6331.504'), (1, '6047.711')] [2023-12-26 07:45:33,962][123091] Updated weights for policy 0, policy_version 1022905 (0.0009) [2023-12-26 07:45:34,009][123091] Updated weights for policy 0, policy_version 1022915 (0.0009) [2023-12-26 07:45:34,065][123091] Updated weights for policy 0, policy_version 1022925 (0.0006) [2023-12-26 07:45:34,202][123090] Updated weights for policy 1, policy_version 1015655 (0.0009) [2023-12-26 07:45:34,266][123090] Updated weights for policy 1, policy_version 1015665 (0.0006) [2023-12-26 07:45:34,339][123090] Updated weights for policy 1, policy_version 1015675 (0.0007) [2023-12-26 07:45:34,901][123091] Updated weights for policy 0, policy_version 1022935 (0.0008) [2023-12-26 07:45:34,952][123091] Updated weights for policy 0, policy_version 1022945 (0.0009) [2023-12-26 07:45:35,020][123091] Updated weights for policy 0, policy_version 1022955 (0.0010) [2023-12-26 07:45:35,127][123090] Updated weights for policy 1, policy_version 1015685 (0.0009) [2023-12-26 07:45:35,176][123090] Updated weights for policy 1, policy_version 1015695 (0.0007) [2023-12-26 07:45:35,225][123090] Updated weights for policy 1, policy_version 1015705 (0.0005) [2023-12-26 07:45:35,896][123091] Updated weights for policy 0, policy_version 1022965 (0.0006) [2023-12-26 07:45:35,970][123090] Updated weights for policy 1, policy_version 1015715 (0.0007) [2023-12-26 07:45:35,970][123091] Updated weights for policy 0, policy_version 1022975 (0.0005) [2023-12-26 07:45:36,020][123091] Updated weights for policy 0, policy_version 1022985 (0.0005) [2023-12-26 07:45:36,021][123090] Updated weights for policy 1, policy_version 1015725 (0.0005) [2023-12-26 07:45:36,086][123090] Updated weights for policy 1, policy_version 1015735 (0.0006) [2023-12-26 07:45:36,743][123091] Updated weights for policy 0, policy_version 1022995 (0.0005) [2023-12-26 07:45:36,800][123091] Updated weights for policy 0, policy_version 1023005 (0.0007) [2023-12-26 07:45:36,858][123091] Updated weights for policy 0, policy_version 1023015 (0.0010) [2023-12-26 07:45:36,935][123090] Updated weights for policy 1, policy_version 1015745 (0.0009) [2023-12-26 07:45:36,998][123090] Updated weights for policy 1, policy_version 1015755 (0.0008) [2023-12-26 07:45:37,060][123090] Updated weights for policy 1, policy_version 1015765 (0.0009) [2023-12-26 07:45:37,117][123090] Updated weights for policy 1, policy_version 1015775 (0.0010) [2023-12-26 07:45:37,612][123091] Updated weights for policy 0, policy_version 1023025 (0.0009) [2023-12-26 07:45:37,679][123091] Updated weights for policy 0, policy_version 1023035 (0.0008) [2023-12-26 07:45:37,750][123091] Updated weights for policy 0, policy_version 1023045 (0.0007) [2023-12-26 07:45:37,814][123091] Updated weights for policy 0, policy_version 1023055 (0.0007) [2023-12-26 07:45:38,000][123090] Updated weights for policy 1, policy_version 1015785 (0.0009) [2023-12-26 07:45:38,063][123090] Updated weights for policy 1, policy_version 1015795 (0.0009) [2023-12-26 07:45:38,134][123090] Updated weights for policy 1, policy_version 1015805 (0.0009) [2023-12-26 07:45:38,519][123091] Updated weights for policy 0, policy_version 1023065 (0.0010) [2023-12-26 07:45:38,573][123091] Updated weights for policy 0, policy_version 1023075 (0.0009) [2023-12-26 07:45:38,626][123091] Updated weights for policy 0, policy_version 1023085 (0.0007) [2023-12-26 07:45:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 521961472. Throughput: 0: 8888.9, 1: 8833.7. Samples: 521936484. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:38,785][121949] Avg episode reward: [(0, '6290.487'), (1, '6051.795')] [2023-12-26 07:45:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001023088_261914624.pth... [2023-12-26 07:45:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001015808_260046848.pth... [2023-12-26 07:45:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001022032_261644288.pth [2023-12-26 07:45:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001014784_259784704.pth [2023-12-26 07:45:39,003][123090] Updated weights for policy 1, policy_version 1015815 (0.0009) [2023-12-26 07:45:39,064][123090] Updated weights for policy 1, policy_version 1015825 (0.0009) [2023-12-26 07:45:39,127][123090] Updated weights for policy 1, policy_version 1015835 (0.0008) [2023-12-26 07:45:39,483][123091] Updated weights for policy 0, policy_version 1023095 (0.0009) [2023-12-26 07:45:39,549][123091] Updated weights for policy 0, policy_version 1023105 (0.0006) [2023-12-26 07:45:39,609][123091] Updated weights for policy 0, policy_version 1023115 (0.0005) [2023-12-26 07:45:40,036][123090] Updated weights for policy 1, policy_version 1015845 (0.0009) [2023-12-26 07:45:40,093][123090] Updated weights for policy 1, policy_version 1015855 (0.0009) [2023-12-26 07:45:40,163][123090] Updated weights for policy 1, policy_version 1015865 (0.0009) [2023-12-26 07:45:40,390][123091] Updated weights for policy 0, policy_version 1023125 (0.0010) [2023-12-26 07:45:40,451][123091] Updated weights for policy 0, policy_version 1023135 (0.0011) [2023-12-26 07:45:40,511][123091] Updated weights for policy 0, policy_version 1023145 (0.0011) [2023-12-26 07:45:41,013][123090] Updated weights for policy 1, policy_version 1015875 (0.0009) [2023-12-26 07:45:41,079][123090] Updated weights for policy 1, policy_version 1015885 (0.0010) [2023-12-26 07:45:41,149][123090] Updated weights for policy 1, policy_version 1015895 (0.0010) [2023-12-26 07:45:41,336][123091] Updated weights for policy 0, policy_version 1023155 (0.0010) [2023-12-26 07:45:41,403][123091] Updated weights for policy 0, policy_version 1023165 (0.0009) [2023-12-26 07:45:41,460][123091] Updated weights for policy 0, policy_version 1023175 (0.0011) [2023-12-26 07:45:42,020][123090] Updated weights for policy 1, policy_version 1015905 (0.0009) [2023-12-26 07:45:42,093][123090] Updated weights for policy 1, policy_version 1015915 (0.0009) [2023-12-26 07:45:42,154][123090] Updated weights for policy 1, policy_version 1015925 (0.0011) [2023-12-26 07:45:42,219][123090] Updated weights for policy 1, policy_version 1015935 (0.0011) [2023-12-26 07:45:42,320][123091] Updated weights for policy 0, policy_version 1023185 (0.0011) [2023-12-26 07:45:42,395][123091] Updated weights for policy 0, policy_version 1023195 (0.0008) [2023-12-26 07:45:42,462][123091] Updated weights for policy 0, policy_version 1023205 (0.0006) [2023-12-26 07:45:42,532][123091] Updated weights for policy 0, policy_version 1023215 (0.0006) [2023-12-26 07:45:43,116][123090] Updated weights for policy 1, policy_version 1015945 (0.0009) [2023-12-26 07:45:43,164][123090] Updated weights for policy 1, policy_version 1015955 (0.0009) [2023-12-26 07:45:43,213][123090] Updated weights for policy 1, policy_version 1015965 (0.0009) [2023-12-26 07:45:43,245][123091] Updated weights for policy 0, policy_version 1023225 (0.0010) [2023-12-26 07:45:43,307][123091] Updated weights for policy 0, policy_version 1023235 (0.0010) [2023-12-26 07:45:43,361][123091] Updated weights for policy 0, policy_version 1023245 (0.0010) [2023-12-26 07:45:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 522043392. Throughput: 0: 8920.4, 1: 8701.7. Samples: 522038072. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:43,784][121949] Avg episode reward: [(0, '6234.835'), (1, '6050.174')] [2023-12-26 07:45:44,043][123090] Updated weights for policy 1, policy_version 1015975 (0.0009) [2023-12-26 07:45:44,091][123090] Updated weights for policy 1, policy_version 1015985 (0.0010) [2023-12-26 07:45:44,147][123090] Updated weights for policy 1, policy_version 1015995 (0.0010) [2023-12-26 07:45:44,156][123091] Updated weights for policy 0, policy_version 1023255 (0.0007) [2023-12-26 07:45:44,203][123091] Updated weights for policy 0, policy_version 1023265 (0.0006) [2023-12-26 07:45:44,258][123091] Updated weights for policy 0, policy_version 1023275 (0.0006) [2023-12-26 07:45:45,022][123090] Updated weights for policy 1, policy_version 1016005 (0.0010) [2023-12-26 07:45:45,031][123091] Updated weights for policy 0, policy_version 1023285 (0.0007) [2023-12-26 07:45:45,080][123090] Updated weights for policy 1, policy_version 1016015 (0.0009) [2023-12-26 07:45:45,085][123091] Updated weights for policy 0, policy_version 1023295 (0.0008) [2023-12-26 07:45:45,132][123091] Updated weights for policy 0, policy_version 1023305 (0.0008) [2023-12-26 07:45:45,142][123090] Updated weights for policy 1, policy_version 1016025 (0.0010) [2023-12-26 07:45:45,925][123091] Updated weights for policy 0, policy_version 1023315 (0.0008) [2023-12-26 07:45:45,952][123090] Updated weights for policy 1, policy_version 1016035 (0.0008) [2023-12-26 07:45:45,985][123091] Updated weights for policy 0, policy_version 1023325 (0.0007) [2023-12-26 07:45:46,015][123090] Updated weights for policy 1, policy_version 1016045 (0.0008) [2023-12-26 07:45:46,038][123091] Updated weights for policy 0, policy_version 1023335 (0.0009) [2023-12-26 07:45:46,073][123090] Updated weights for policy 1, policy_version 1016055 (0.0008) [2023-12-26 07:45:46,807][123090] Updated weights for policy 1, policy_version 1016065 (0.0009) [2023-12-26 07:45:46,861][123091] Updated weights for policy 0, policy_version 1023345 (0.0006) [2023-12-26 07:45:46,871][123090] Updated weights for policy 1, policy_version 1016075 (0.0009) [2023-12-26 07:45:46,916][123091] Updated weights for policy 0, policy_version 1023355 (0.0010) [2023-12-26 07:45:46,927][123090] Updated weights for policy 1, policy_version 1016085 (0.0007) [2023-12-26 07:45:46,978][123091] Updated weights for policy 0, policy_version 1023365 (0.0009) [2023-12-26 07:45:46,980][123090] Updated weights for policy 1, policy_version 1016095 (0.0006) [2023-12-26 07:45:47,038][123091] Updated weights for policy 0, policy_version 1023375 (0.0006) [2023-12-26 07:45:47,778][123090] Updated weights for policy 1, policy_version 1016105 (0.0010) [2023-12-26 07:45:47,804][123091] Updated weights for policy 0, policy_version 1023385 (0.0010) [2023-12-26 07:45:47,830][123090] Updated weights for policy 1, policy_version 1016115 (0.0010) [2023-12-26 07:45:47,856][123091] Updated weights for policy 0, policy_version 1023395 (0.0010) [2023-12-26 07:45:47,882][123090] Updated weights for policy 1, policy_version 1016125 (0.0010) [2023-12-26 07:45:47,911][123091] Updated weights for policy 0, policy_version 1023405 (0.0010) [2023-12-26 07:45:48,624][123090] Updated weights for policy 1, policy_version 1016135 (0.0009) [2023-12-26 07:45:48,690][123090] Updated weights for policy 1, policy_version 1016145 (0.0008) [2023-12-26 07:45:48,746][123091] Updated weights for policy 0, policy_version 1023415 (0.0011) [2023-12-26 07:45:48,761][123090] Updated weights for policy 1, policy_version 1016155 (0.0009) [2023-12-26 07:45:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 522125312. Throughput: 0: 8926.9, 1: 8692.1. Samples: 522145240. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:48,785][121949] Avg episode reward: [(0, '6312.141'), (1, '6050.902')] [2023-12-26 07:45:48,813][123091] Updated weights for policy 0, policy_version 1023425 (0.0011) [2023-12-26 07:45:48,883][123091] Updated weights for policy 0, policy_version 1023435 (0.0011) [2023-12-26 07:45:49,561][123090] Updated weights for policy 1, policy_version 1016165 (0.0006) [2023-12-26 07:45:49,623][123090] Updated weights for policy 1, policy_version 1016175 (0.0008) [2023-12-26 07:45:49,673][123090] Updated weights for policy 1, policy_version 1016185 (0.0006) [2023-12-26 07:45:49,730][123091] Updated weights for policy 0, policy_version 1023445 (0.0011) [2023-12-26 07:45:49,793][123091] Updated weights for policy 0, policy_version 1023455 (0.0009) [2023-12-26 07:45:49,866][123091] Updated weights for policy 0, policy_version 1023465 (0.0008) [2023-12-26 07:45:50,526][123090] Updated weights for policy 1, policy_version 1016195 (0.0007) [2023-12-26 07:45:50,589][123091] Updated weights for policy 0, policy_version 1023475 (0.0008) [2023-12-26 07:45:50,591][123090] Updated weights for policy 1, policy_version 1016205 (0.0010) [2023-12-26 07:45:50,651][123091] Updated weights for policy 0, policy_version 1023485 (0.0007) [2023-12-26 07:45:50,655][123090] Updated weights for policy 1, policy_version 1016215 (0.0009) [2023-12-26 07:45:50,714][123091] Updated weights for policy 0, policy_version 1023495 (0.0007) [2023-12-26 07:45:51,508][123090] Updated weights for policy 1, policy_version 1016225 (0.0009) [2023-12-26 07:45:51,567][123090] Updated weights for policy 1, policy_version 1016235 (0.0005) [2023-12-26 07:45:51,580][123091] Updated weights for policy 0, policy_version 1023505 (0.0010) [2023-12-26 07:45:51,636][123090] Updated weights for policy 1, policy_version 1016245 (0.0007) [2023-12-26 07:45:51,641][123091] Updated weights for policy 0, policy_version 1023515 (0.0008) [2023-12-26 07:45:51,701][123090] Updated weights for policy 1, policy_version 1016255 (0.0009) [2023-12-26 07:45:51,703][123091] Updated weights for policy 0, policy_version 1023525 (0.0007) [2023-12-26 07:45:51,773][123091] Updated weights for policy 0, policy_version 1023535 (0.0009) [2023-12-26 07:45:52,470][123090] Updated weights for policy 1, policy_version 1016265 (0.0009) [2023-12-26 07:45:52,535][123090] Updated weights for policy 1, policy_version 1016275 (0.0010) [2023-12-26 07:45:52,592][123090] Updated weights for policy 1, policy_version 1016285 (0.0010) [2023-12-26 07:45:52,627][123091] Updated weights for policy 0, policy_version 1023545 (0.0009) [2023-12-26 07:45:52,681][123091] Updated weights for policy 0, policy_version 1023555 (0.0010) [2023-12-26 07:45:52,732][123091] Updated weights for policy 0, policy_version 1023565 (0.0010) [2023-12-26 07:45:53,359][123090] Updated weights for policy 1, policy_version 1016295 (0.0009) [2023-12-26 07:45:53,406][123090] Updated weights for policy 1, policy_version 1016305 (0.0009) [2023-12-26 07:45:53,457][123090] Updated weights for policy 1, policy_version 1016315 (0.0008) [2023-12-26 07:45:53,625][123091] Updated weights for policy 0, policy_version 1023576 (0.0011) [2023-12-26 07:45:53,673][123091] Updated weights for policy 0, policy_version 1023586 (0.0010) [2023-12-26 07:45:53,731][123091] Updated weights for policy 0, policy_version 1023596 (0.0010) [2023-12-26 07:45:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 522223616. Throughput: 0: 8931.5, 1: 8693.5. Samples: 522196476. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:53,785][121949] Avg episode reward: [(0, '6248.475'), (1, '6028.466')] [2023-12-26 07:45:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001023600_262045696.pth... [2023-12-26 07:45:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001016320_260177920.pth... [2023-12-26 07:45:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001022544_261775360.pth [2023-12-26 07:45:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001015296_259915776.pth [2023-12-26 07:45:54,307][123090] Updated weights for policy 1, policy_version 1016325 (0.0007) [2023-12-26 07:45:54,366][123090] Updated weights for policy 1, policy_version 1016335 (0.0009) [2023-12-26 07:45:54,417][123090] Updated weights for policy 1, policy_version 1016345 (0.0009) [2023-12-26 07:45:54,443][123091] Updated weights for policy 0, policy_version 1023606 (0.0007) [2023-12-26 07:45:54,515][123091] Updated weights for policy 0, policy_version 1023616 (0.0005) [2023-12-26 07:45:54,580][123091] Updated weights for policy 0, policy_version 1023626 (0.0010) [2023-12-26 07:45:55,088][123090] Updated weights for policy 1, policy_version 1016355 (0.0007) [2023-12-26 07:45:55,136][123090] Updated weights for policy 1, policy_version 1016365 (0.0010) [2023-12-26 07:45:55,184][123090] Updated weights for policy 1, policy_version 1016375 (0.0010) [2023-12-26 07:45:55,361][123091] Updated weights for policy 0, policy_version 1023636 (0.0010) [2023-12-26 07:45:55,418][123091] Updated weights for policy 0, policy_version 1023646 (0.0010) [2023-12-26 07:45:55,472][123091] Updated weights for policy 0, policy_version 1023656 (0.0010) [2023-12-26 07:45:55,831][123090] Updated weights for policy 1, policy_version 1016385 (0.0007) [2023-12-26 07:45:55,879][123090] Updated weights for policy 1, policy_version 1016395 (0.0005) [2023-12-26 07:45:55,926][123090] Updated weights for policy 1, policy_version 1016405 (0.0005) [2023-12-26 07:45:55,973][123090] Updated weights for policy 1, policy_version 1016415 (0.0005) [2023-12-26 07:45:56,240][123091] Updated weights for policy 0, policy_version 1023666 (0.0008) [2023-12-26 07:45:56,289][123091] Updated weights for policy 0, policy_version 1023676 (0.0005) [2023-12-26 07:45:56,341][123091] Updated weights for policy 0, policy_version 1023686 (0.0005) [2023-12-26 07:45:56,407][123091] Updated weights for policy 0, policy_version 1023696 (0.0007) [2023-12-26 07:45:56,795][123090] Updated weights for policy 1, policy_version 1016425 (0.0008) [2023-12-26 07:45:56,850][123090] Updated weights for policy 1, policy_version 1016435 (0.0009) [2023-12-26 07:45:56,904][123090] Updated weights for policy 1, policy_version 1016445 (0.0009) [2023-12-26 07:45:57,110][123091] Updated weights for policy 0, policy_version 1023706 (0.0006) [2023-12-26 07:45:57,181][123091] Updated weights for policy 0, policy_version 1023716 (0.0006) [2023-12-26 07:45:57,255][123091] Updated weights for policy 0, policy_version 1023726 (0.0005) [2023-12-26 07:45:57,752][123090] Updated weights for policy 1, policy_version 1016455 (0.0009) [2023-12-26 07:45:57,809][123090] Updated weights for policy 1, policy_version 1016465 (0.0009) [2023-12-26 07:45:57,849][123091] Updated weights for policy 0, policy_version 1023736 (0.0010) [2023-12-26 07:45:57,869][123090] Updated weights for policy 1, policy_version 1016475 (0.0006) [2023-12-26 07:45:57,911][123091] Updated weights for policy 0, policy_version 1023746 (0.0011) [2023-12-26 07:45:57,959][123091] Updated weights for policy 0, policy_version 1023756 (0.0010) [2023-12-26 07:45:58,713][123090] Updated weights for policy 1, policy_version 1016485 (0.0009) [2023-12-26 07:45:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 522305536. Throughput: 0: 9002.2, 1: 8726.9. Samples: 522306020. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:45:58,785][121949] Avg episode reward: [(0, '6167.878'), (1, '6030.981')] [2023-12-26 07:45:58,792][123090] Updated weights for policy 1, policy_version 1016495 (0.0009) [2023-12-26 07:45:58,844][123090] Updated weights for policy 1, policy_version 1016505 (0.0010) [2023-12-26 07:45:58,913][123091] Updated weights for policy 0, policy_version 1023766 (0.0010) [2023-12-26 07:45:58,983][123091] Updated weights for policy 0, policy_version 1023776 (0.0011) [2023-12-26 07:45:59,047][123091] Updated weights for policy 0, policy_version 1023786 (0.0011) [2023-12-26 07:45:59,693][123090] Updated weights for policy 1, policy_version 1016515 (0.0010) [2023-12-26 07:45:59,745][123090] Updated weights for policy 1, policy_version 1016525 (0.0010) [2023-12-26 07:45:59,761][123091] Updated weights for policy 0, policy_version 1023796 (0.0009) [2023-12-26 07:45:59,804][123090] Updated weights for policy 1, policy_version 1016535 (0.0010) [2023-12-26 07:45:59,838][123091] Updated weights for policy 0, policy_version 1023806 (0.0010) [2023-12-26 07:45:59,902][123091] Updated weights for policy 0, policy_version 1023816 (0.0011) [2023-12-26 07:46:00,640][123090] Updated weights for policy 1, policy_version 1016545 (0.0011) [2023-12-26 07:46:00,690][123091] Updated weights for policy 0, policy_version 1023826 (0.0011) [2023-12-26 07:46:00,702][123090] Updated weights for policy 1, policy_version 1016555 (0.0007) [2023-12-26 07:46:00,745][123091] Updated weights for policy 0, policy_version 1023836 (0.0010) [2023-12-26 07:46:00,752][123090] Updated weights for policy 1, policy_version 1016565 (0.0005) [2023-12-26 07:46:00,800][123091] Updated weights for policy 0, policy_version 1023846 (0.0010) [2023-12-26 07:46:00,803][123090] Updated weights for policy 1, policy_version 1016575 (0.0006) [2023-12-26 07:46:00,850][123091] Updated weights for policy 0, policy_version 1023856 (0.0010) [2023-12-26 07:46:01,556][123090] Updated weights for policy 1, policy_version 1016585 (0.0005) [2023-12-26 07:46:01,587][123091] Updated weights for policy 0, policy_version 1023866 (0.0005) [2023-12-26 07:46:01,604][123090] Updated weights for policy 1, policy_version 1016595 (0.0005) [2023-12-26 07:46:01,656][123091] Updated weights for policy 0, policy_version 1023876 (0.0010) [2023-12-26 07:46:01,666][123090] Updated weights for policy 1, policy_version 1016605 (0.0008) [2023-12-26 07:46:01,721][123091] Updated weights for policy 0, policy_version 1023886 (0.0006) [2023-12-26 07:46:02,397][123091] Updated weights for policy 0, policy_version 1023896 (0.0010) [2023-12-26 07:46:02,444][123090] Updated weights for policy 1, policy_version 1016615 (0.0009) [2023-12-26 07:46:02,448][123091] Updated weights for policy 0, policy_version 1023906 (0.0010) [2023-12-26 07:46:02,497][123091] Updated weights for policy 0, policy_version 1023916 (0.0008) [2023-12-26 07:46:02,507][123090] Updated weights for policy 1, policy_version 1016625 (0.0010) [2023-12-26 07:46:02,570][123090] Updated weights for policy 1, policy_version 1016635 (0.0010) [2023-12-26 07:46:03,255][123090] Updated weights for policy 1, policy_version 1016645 (0.0009) [2023-12-26 07:46:03,304][123090] Updated weights for policy 1, policy_version 1016655 (0.0006) [2023-12-26 07:46:03,308][123091] Updated weights for policy 0, policy_version 1023926 (0.0009) [2023-12-26 07:46:03,354][123090] Updated weights for policy 1, policy_version 1016665 (0.0006) [2023-12-26 07:46:03,370][123091] Updated weights for policy 0, policy_version 1023936 (0.0007) [2023-12-26 07:46:03,430][123091] Updated weights for policy 0, policy_version 1023946 (0.0006) [2023-12-26 07:46:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 522403840. Throughput: 0: 8971.8, 1: 8774.1. Samples: 522413580. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:03,784][121949] Avg episode reward: [(0, '6243.807'), (1, '6049.250')] [2023-12-26 07:46:04,064][123090] Updated weights for policy 1, policy_version 1016675 (0.0007) [2023-12-26 07:46:04,134][123090] Updated weights for policy 1, policy_version 1016685 (0.0011) [2023-12-26 07:46:04,209][123090] Updated weights for policy 1, policy_version 1016695 (0.0011) [2023-12-26 07:46:04,209][123091] Updated weights for policy 0, policy_version 1023956 (0.0008) [2023-12-26 07:46:04,272][123091] Updated weights for policy 0, policy_version 1023966 (0.0008) [2023-12-26 07:46:04,332][123091] Updated weights for policy 0, policy_version 1023976 (0.0009) [2023-12-26 07:46:05,010][123090] Updated weights for policy 1, policy_version 1016705 (0.0011) [2023-12-26 07:46:05,076][123090] Updated weights for policy 1, policy_version 1016715 (0.0010) [2023-12-26 07:46:05,129][123090] Updated weights for policy 1, policy_version 1016725 (0.0005) [2023-12-26 07:46:05,139][123091] Updated weights for policy 0, policy_version 1023986 (0.0009) [2023-12-26 07:46:05,187][123091] Updated weights for policy 0, policy_version 1023996 (0.0008) [2023-12-26 07:46:05,191][123090] Updated weights for policy 1, policy_version 1016735 (0.0005) [2023-12-26 07:46:05,237][123091] Updated weights for policy 0, policy_version 1024006 (0.0008) [2023-12-26 07:46:05,299][123091] Updated weights for policy 0, policy_version 1024016 (0.0005) [2023-12-26 07:46:05,965][123091] Updated weights for policy 0, policy_version 1024026 (0.0008) [2023-12-26 07:46:05,968][123090] Updated weights for policy 1, policy_version 1016745 (0.0010) [2023-12-26 07:46:06,017][123091] Updated weights for policy 0, policy_version 1024036 (0.0005) [2023-12-26 07:46:06,026][123090] Updated weights for policy 1, policy_version 1016755 (0.0010) [2023-12-26 07:46:06,072][123091] Updated weights for policy 0, policy_version 1024046 (0.0006) [2023-12-26 07:46:06,079][123090] Updated weights for policy 1, policy_version 1016765 (0.0009) [2023-12-26 07:46:06,816][123090] Updated weights for policy 1, policy_version 1016775 (0.0009) [2023-12-26 07:46:06,850][123091] Updated weights for policy 0, policy_version 1024056 (0.0007) [2023-12-26 07:46:06,869][123090] Updated weights for policy 1, policy_version 1016785 (0.0010) [2023-12-26 07:46:06,901][123091] Updated weights for policy 0, policy_version 1024066 (0.0005) [2023-12-26 07:46:06,920][123090] Updated weights for policy 1, policy_version 1016795 (0.0010) [2023-12-26 07:46:06,959][123091] Updated weights for policy 0, policy_version 1024076 (0.0007) [2023-12-26 07:46:07,616][123090] Updated weights for policy 1, policy_version 1016805 (0.0008) [2023-12-26 07:46:07,689][123090] Updated weights for policy 1, policy_version 1016815 (0.0005) [2023-12-26 07:46:07,759][123090] Updated weights for policy 1, policy_version 1016825 (0.0006) [2023-12-26 07:46:07,788][123091] Updated weights for policy 0, policy_version 1024086 (0.0010) [2023-12-26 07:46:07,868][123091] Updated weights for policy 0, policy_version 1024096 (0.0009) [2023-12-26 07:46:07,922][123091] Updated weights for policy 0, policy_version 1024106 (0.0011) [2023-12-26 07:46:08,483][123090] Updated weights for policy 1, policy_version 1016835 (0.0008) [2023-12-26 07:46:08,542][123090] Updated weights for policy 1, policy_version 1016845 (0.0008) [2023-12-26 07:46:08,611][123090] Updated weights for policy 1, policy_version 1016855 (0.0009) [2023-12-26 07:46:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.5, 300 sec: 17716.9). Total num frames: 522493952. Throughput: 0: 9045.1, 1: 8853.0. Samples: 522469680. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:08,785][121949] Avg episode reward: [(0, '6329.342'), (1, '6016.351')] [2023-12-26 07:46:08,788][123091] Updated weights for policy 0, policy_version 1024116 (0.0009) [2023-12-26 07:46:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001016864_260317184.pth... [2023-12-26 07:46:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001015808_260046848.pth [2023-12-26 07:46:08,856][123091] Updated weights for policy 0, policy_version 1024126 (0.0009) [2023-12-26 07:46:08,925][123091] Updated weights for policy 0, policy_version 1024136 (0.0009) [2023-12-26 07:46:08,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001024144_262184960.pth... [2023-12-26 07:46:08,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001023088_261914624.pth [2023-12-26 07:46:09,394][123090] Updated weights for policy 1, policy_version 1016865 (0.0009) [2023-12-26 07:46:09,470][123090] Updated weights for policy 1, policy_version 1016875 (0.0007) [2023-12-26 07:46:09,544][123090] Updated weights for policy 1, policy_version 1016885 (0.0008) [2023-12-26 07:46:09,618][123090] Updated weights for policy 1, policy_version 1016895 (0.0008) [2023-12-26 07:46:09,760][123091] Updated weights for policy 0, policy_version 1024146 (0.0008) [2023-12-26 07:46:09,837][123091] Updated weights for policy 0, policy_version 1024156 (0.0007) [2023-12-26 07:46:09,906][123091] Updated weights for policy 0, policy_version 1024166 (0.0008) [2023-12-26 07:46:09,975][123091] Updated weights for policy 0, policy_version 1024176 (0.0009) [2023-12-26 07:46:10,374][123090] Updated weights for policy 1, policy_version 1016905 (0.0006) [2023-12-26 07:46:10,447][123090] Updated weights for policy 1, policy_version 1016915 (0.0006) [2023-12-26 07:46:10,515][123090] Updated weights for policy 1, policy_version 1016925 (0.0009) [2023-12-26 07:46:10,668][123091] Updated weights for policy 0, policy_version 1024186 (0.0009) [2023-12-26 07:46:10,723][123091] Updated weights for policy 0, policy_version 1024196 (0.0010) [2023-12-26 07:46:10,775][123091] Updated weights for policy 0, policy_version 1024206 (0.0009) [2023-12-26 07:46:11,344][123090] Updated weights for policy 1, policy_version 1016935 (0.0009) [2023-12-26 07:46:11,408][123090] Updated weights for policy 1, policy_version 1016945 (0.0009) [2023-12-26 07:46:11,476][123090] Updated weights for policy 1, policy_version 1016955 (0.0008) [2023-12-26 07:46:11,627][123091] Updated weights for policy 0, policy_version 1024216 (0.0009) [2023-12-26 07:46:11,693][123091] Updated weights for policy 0, policy_version 1024226 (0.0009) [2023-12-26 07:46:11,767][123091] Updated weights for policy 0, policy_version 1024236 (0.0006) [2023-12-26 07:46:12,399][123090] Updated weights for policy 1, policy_version 1016965 (0.0009) [2023-12-26 07:46:12,463][123090] Updated weights for policy 1, policy_version 1016975 (0.0009) [2023-12-26 07:46:12,525][123091] Updated weights for policy 0, policy_version 1024246 (0.0009) [2023-12-26 07:46:12,528][123090] Updated weights for policy 1, policy_version 1016985 (0.0009) [2023-12-26 07:46:12,576][123091] Updated weights for policy 0, policy_version 1024256 (0.0010) [2023-12-26 07:46:12,624][123091] Updated weights for policy 0, policy_version 1024266 (0.0006) [2023-12-26 07:46:13,365][123090] Updated weights for policy 1, policy_version 1016995 (0.0008) [2023-12-26 07:46:13,417][123090] Updated weights for policy 1, policy_version 1017005 (0.0009) [2023-12-26 07:46:13,445][123091] Updated weights for policy 0, policy_version 1024276 (0.0010) [2023-12-26 07:46:13,465][123090] Updated weights for policy 1, policy_version 1017016 (0.0008) [2023-12-26 07:46:13,504][123091] Updated weights for policy 0, policy_version 1024286 (0.0006) [2023-12-26 07:46:13,564][123091] Updated weights for policy 0, policy_version 1024296 (0.0009) [2023-12-26 07:46:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 522584064. Throughput: 0: 8930.9, 1: 8822.8. Samples: 522574932. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:13,785][121949] Avg episode reward: [(0, '6320.018'), (1, '6023.293')] [2023-12-26 07:46:14,343][123091] Updated weights for policy 0, policy_version 1024306 (0.0009) [2023-12-26 07:46:14,362][123090] Updated weights for policy 1, policy_version 1017026 (0.0009) [2023-12-26 07:46:14,406][123091] Updated weights for policy 0, policy_version 1024316 (0.0006) [2023-12-26 07:46:14,416][123090] Updated weights for policy 1, policy_version 1017036 (0.0009) [2023-12-26 07:46:14,467][123091] Updated weights for policy 0, policy_version 1024326 (0.0007) [2023-12-26 07:46:14,467][123090] Updated weights for policy 1, policy_version 1017046 (0.0009) [2023-12-26 07:46:14,521][123091] Updated weights for policy 0, policy_version 1024336 (0.0010) [2023-12-26 07:46:14,528][123090] Updated weights for policy 1, policy_version 1017056 (0.0006) [2023-12-26 07:46:15,289][123090] Updated weights for policy 1, policy_version 1017066 (0.0007) [2023-12-26 07:46:15,341][123091] Updated weights for policy 0, policy_version 1024346 (0.0010) [2023-12-26 07:46:15,344][123090] Updated weights for policy 1, policy_version 1017076 (0.0008) [2023-12-26 07:46:15,400][123090] Updated weights for policy 1, policy_version 1017086 (0.0007) [2023-12-26 07:46:15,405][123091] Updated weights for policy 0, policy_version 1024356 (0.0011) [2023-12-26 07:46:15,462][123091] Updated weights for policy 0, policy_version 1024366 (0.0011) [2023-12-26 07:46:16,143][123091] Updated weights for policy 0, policy_version 1024376 (0.0006) [2023-12-26 07:46:16,210][123091] Updated weights for policy 0, policy_version 1024386 (0.0005) [2023-12-26 07:46:16,262][123091] Updated weights for policy 0, policy_version 1024396 (0.0005) [2023-12-26 07:46:16,265][123090] Updated weights for policy 1, policy_version 1017096 (0.0008) [2023-12-26 07:46:16,326][123090] Updated weights for policy 1, policy_version 1017106 (0.0010) [2023-12-26 07:46:16,395][123090] Updated weights for policy 1, policy_version 1017116 (0.0008) [2023-12-26 07:46:16,896][123091] Updated weights for policy 0, policy_version 1024406 (0.0005) [2023-12-26 07:46:16,947][123091] Updated weights for policy 0, policy_version 1024416 (0.0005) [2023-12-26 07:46:17,010][123091] Updated weights for policy 0, policy_version 1024426 (0.0005) [2023-12-26 07:46:17,146][123090] Updated weights for policy 1, policy_version 1017126 (0.0008) [2023-12-26 07:46:17,208][123090] Updated weights for policy 1, policy_version 1017136 (0.0005) [2023-12-26 07:46:17,277][123090] Updated weights for policy 1, policy_version 1017146 (0.0005) [2023-12-26 07:46:17,715][123091] Updated weights for policy 0, policy_version 1024436 (0.0007) [2023-12-26 07:46:17,777][123091] Updated weights for policy 0, policy_version 1024447 (0.0010) [2023-12-26 07:46:17,844][123091] Updated weights for policy 0, policy_version 1024457 (0.0010) [2023-12-26 07:46:17,948][123090] Updated weights for policy 1, policy_version 1017156 (0.0007) [2023-12-26 07:46:17,995][123090] Updated weights for policy 1, policy_version 1017166 (0.0009) [2023-12-26 07:46:18,048][123090] Updated weights for policy 1, policy_version 1017176 (0.0009) [2023-12-26 07:46:18,702][123091] Updated weights for policy 0, policy_version 1024467 (0.0010) [2023-12-26 07:46:18,760][123091] Updated weights for policy 0, policy_version 1024477 (0.0009) [2023-12-26 07:46:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 522665984. Throughput: 0: 8989.7, 1: 8817.5. Samples: 522684372. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:18,784][121949] Avg episode reward: [(0, '6268.762'), (1, '6012.030')] [2023-12-26 07:46:18,824][123091] Updated weights for policy 0, policy_version 1024487 (0.0009) [2023-12-26 07:46:18,930][123090] Updated weights for policy 1, policy_version 1017186 (0.0009) [2023-12-26 07:46:18,996][123090] Updated weights for policy 1, policy_version 1017196 (0.0005) [2023-12-26 07:46:19,063][123090] Updated weights for policy 1, policy_version 1017206 (0.0008) [2023-12-26 07:46:19,118][123090] Updated weights for policy 1, policy_version 1017216 (0.0010) [2023-12-26 07:46:19,644][123091] Updated weights for policy 0, policy_version 1024497 (0.0009) [2023-12-26 07:46:19,693][123091] Updated weights for policy 0, policy_version 1024507 (0.0009) [2023-12-26 07:46:19,761][123091] Updated weights for policy 0, policy_version 1024517 (0.0010) [2023-12-26 07:46:19,830][123091] Updated weights for policy 0, policy_version 1024527 (0.0008) [2023-12-26 07:46:19,938][123090] Updated weights for policy 1, policy_version 1017226 (0.0010) [2023-12-26 07:46:20,008][123090] Updated weights for policy 1, policy_version 1017236 (0.0010) [2023-12-26 07:46:20,069][123090] Updated weights for policy 1, policy_version 1017246 (0.0010) [2023-12-26 07:46:20,732][123091] Updated weights for policy 0, policy_version 1024537 (0.0009) [2023-12-26 07:46:20,766][123090] Updated weights for policy 1, policy_version 1017256 (0.0008) [2023-12-26 07:46:20,803][123091] Updated weights for policy 0, policy_version 1024547 (0.0009) [2023-12-26 07:46:20,832][123090] Updated weights for policy 1, policy_version 1017266 (0.0006) [2023-12-26 07:46:20,875][123091] Updated weights for policy 0, policy_version 1024557 (0.0009) [2023-12-26 07:46:20,900][123090] Updated weights for policy 1, policy_version 1017276 (0.0005) [2023-12-26 07:46:21,690][123090] Updated weights for policy 1, policy_version 1017286 (0.0008) [2023-12-26 07:46:21,721][123091] Updated weights for policy 0, policy_version 1024567 (0.0008) [2023-12-26 07:46:21,756][123090] Updated weights for policy 1, policy_version 1017296 (0.0010) [2023-12-26 07:46:21,794][123091] Updated weights for policy 0, policy_version 1024577 (0.0007) [2023-12-26 07:46:21,813][123090] Updated weights for policy 1, policy_version 1017306 (0.0008) [2023-12-26 07:46:21,856][123091] Updated weights for policy 0, policy_version 1024587 (0.0006) [2023-12-26 07:46:22,663][123090] Updated weights for policy 1, policy_version 1017316 (0.0009) [2023-12-26 07:46:22,700][123091] Updated weights for policy 0, policy_version 1024597 (0.0007) [2023-12-26 07:46:22,731][123090] Updated weights for policy 1, policy_version 1017326 (0.0011) [2023-12-26 07:46:22,759][123091] Updated weights for policy 0, policy_version 1024607 (0.0007) [2023-12-26 07:46:22,798][123090] Updated weights for policy 1, policy_version 1017336 (0.0011) [2023-12-26 07:46:22,823][123091] Updated weights for policy 0, policy_version 1024617 (0.0007) [2023-12-26 07:46:23,512][123091] Updated weights for policy 0, policy_version 1024627 (0.0008) [2023-12-26 07:46:23,575][123091] Updated weights for policy 0, policy_version 1024637 (0.0005) [2023-12-26 07:46:23,610][123090] Updated weights for policy 1, policy_version 1017346 (0.0011) [2023-12-26 07:46:23,627][123091] Updated weights for policy 0, policy_version 1024647 (0.0005) [2023-12-26 07:46:23,677][123090] Updated weights for policy 1, policy_version 1017356 (0.0006) [2023-12-26 07:46:23,731][123090] Updated weights for policy 1, policy_version 1017366 (0.0005) [2023-12-26 07:46:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 522756096. Throughput: 0: 8951.0, 1: 8796.2. Samples: 522735108. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:23,785][121949] Avg episode reward: [(0, '6293.603'), (1, '6007.790')] [2023-12-26 07:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001024656_262316032.pth... [2023-12-26 07:46:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001017376_260448256.pth... [2023-12-26 07:46:23,793][123090] Updated weights for policy 1, policy_version 1017376 (0.0005) [2023-12-26 07:46:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001016320_260177920.pth [2023-12-26 07:46:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001023600_262045696.pth [2023-12-26 07:46:24,285][123091] Updated weights for policy 0, policy_version 1024657 (0.0005) [2023-12-26 07:46:24,353][123091] Updated weights for policy 0, policy_version 1024667 (0.0005) [2023-12-26 07:46:24,408][123091] Updated weights for policy 0, policy_version 1024677 (0.0005) [2023-12-26 07:46:24,413][123090] Updated weights for policy 1, policy_version 1017386 (0.0005) [2023-12-26 07:46:24,463][123090] Updated weights for policy 1, policy_version 1017396 (0.0005) [2023-12-26 07:46:24,464][123091] Updated weights for policy 0, policy_version 1024687 (0.0006) [2023-12-26 07:46:24,512][123090] Updated weights for policy 1, policy_version 1017406 (0.0006) [2023-12-26 07:46:25,145][123091] Updated weights for policy 0, policy_version 1024697 (0.0005) [2023-12-26 07:46:25,203][123091] Updated weights for policy 0, policy_version 1024707 (0.0005) [2023-12-26 07:46:25,234][123090] Updated weights for policy 1, policy_version 1017416 (0.0006) [2023-12-26 07:46:25,273][123091] Updated weights for policy 0, policy_version 1024717 (0.0009) [2023-12-26 07:46:25,292][123090] Updated weights for policy 1, policy_version 1017426 (0.0006) [2023-12-26 07:46:25,363][123090] Updated weights for policy 1, policy_version 1017436 (0.0008) [2023-12-26 07:46:26,048][123090] Updated weights for policy 1, policy_version 1017446 (0.0008) [2023-12-26 07:46:26,055][123091] Updated weights for policy 0, policy_version 1024727 (0.0008) [2023-12-26 07:46:26,101][123090] Updated weights for policy 1, policy_version 1017456 (0.0008) [2023-12-26 07:46:26,108][123091] Updated weights for policy 0, policy_version 1024737 (0.0007) [2023-12-26 07:46:26,152][123090] Updated weights for policy 1, policy_version 1017466 (0.0008) [2023-12-26 07:46:26,165][123091] Updated weights for policy 0, policy_version 1024747 (0.0007) [2023-12-26 07:46:27,002][123090] Updated weights for policy 1, policy_version 1017476 (0.0010) [2023-12-26 07:46:27,010][123091] Updated weights for policy 0, policy_version 1024757 (0.0007) [2023-12-26 07:46:27,064][123091] Updated weights for policy 0, policy_version 1024767 (0.0007) [2023-12-26 07:46:27,068][123090] Updated weights for policy 1, policy_version 1017486 (0.0009) [2023-12-26 07:46:27,125][123091] Updated weights for policy 0, policy_version 1024777 (0.0005) [2023-12-26 07:46:27,133][123090] Updated weights for policy 1, policy_version 1017496 (0.0009) [2023-12-26 07:46:27,840][123091] Updated weights for policy 0, policy_version 1024787 (0.0005) [2023-12-26 07:46:27,907][123091] Updated weights for policy 0, policy_version 1024797 (0.0008) [2023-12-26 07:46:27,975][123091] Updated weights for policy 0, policy_version 1024807 (0.0006) [2023-12-26 07:46:28,003][123090] Updated weights for policy 1, policy_version 1017506 (0.0010) [2023-12-26 07:46:28,052][123090] Updated weights for policy 1, policy_version 1017516 (0.0006) [2023-12-26 07:46:28,106][123090] Updated weights for policy 1, policy_version 1017526 (0.0005) [2023-12-26 07:46:28,157][123090] Updated weights for policy 1, policy_version 1017536 (0.0005) [2023-12-26 07:46:28,609][123091] Updated weights for policy 0, policy_version 1024817 (0.0009) [2023-12-26 07:46:28,660][123091] Updated weights for policy 0, policy_version 1024827 (0.0005) [2023-12-26 07:46:28,722][123091] Updated weights for policy 0, policy_version 1024837 (0.0006) [2023-12-26 07:46:28,784][123091] Updated weights for policy 0, policy_version 1024847 (0.0006) [2023-12-26 07:46:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 522846208. Throughput: 0: 8992.0, 1: 8939.3. Samples: 522844988. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:28,785][121949] Avg episode reward: [(0, '6073.526'), (1, '6009.472')] [2023-12-26 07:46:28,877][123090] Updated weights for policy 1, policy_version 1017546 (0.0009) [2023-12-26 07:46:28,939][123090] Updated weights for policy 1, policy_version 1017556 (0.0010) [2023-12-26 07:46:29,006][123090] Updated weights for policy 1, policy_version 1017566 (0.0008) [2023-12-26 07:46:29,405][123091] Updated weights for policy 0, policy_version 1024857 (0.0006) [2023-12-26 07:46:29,477][123091] Updated weights for policy 0, policy_version 1024868 (0.0007) [2023-12-26 07:46:29,533][123091] Updated weights for policy 0, policy_version 1024878 (0.0009) [2023-12-26 07:46:29,897][123090] Updated weights for policy 1, policy_version 1017576 (0.0009) [2023-12-26 07:46:29,973][123090] Updated weights for policy 1, policy_version 1017586 (0.0008) [2023-12-26 07:46:30,036][123090] Updated weights for policy 1, policy_version 1017596 (0.0010) [2023-12-26 07:46:30,354][123091] Updated weights for policy 0, policy_version 1024888 (0.0010) [2023-12-26 07:46:30,409][123091] Updated weights for policy 0, policy_version 1024898 (0.0010) [2023-12-26 07:46:30,455][123091] Updated weights for policy 0, policy_version 1024908 (0.0010) [2023-12-26 07:46:30,896][123090] Updated weights for policy 1, policy_version 1017606 (0.0010) [2023-12-26 07:46:30,953][123090] Updated weights for policy 1, policy_version 1017616 (0.0010) [2023-12-26 07:46:31,017][123090] Updated weights for policy 1, policy_version 1017626 (0.0009) [2023-12-26 07:46:31,292][123091] Updated weights for policy 0, policy_version 1024918 (0.0007) [2023-12-26 07:46:31,358][123091] Updated weights for policy 0, policy_version 1024928 (0.0008) [2023-12-26 07:46:31,418][123091] Updated weights for policy 0, policy_version 1024938 (0.0011) [2023-12-26 07:46:31,856][123090] Updated weights for policy 1, policy_version 1017636 (0.0008) [2023-12-26 07:46:31,904][123090] Updated weights for policy 1, policy_version 1017646 (0.0008) [2023-12-26 07:46:31,963][123090] Updated weights for policy 1, policy_version 1017656 (0.0009) [2023-12-26 07:46:32,233][123091] Updated weights for policy 0, policy_version 1024948 (0.0011) [2023-12-26 07:46:32,297][123091] Updated weights for policy 0, policy_version 1024958 (0.0013) [2023-12-26 07:46:32,342][123091] Updated weights for policy 0, policy_version 1024968 (0.0010) [2023-12-26 07:46:32,763][123090] Updated weights for policy 1, policy_version 1017666 (0.0008) [2023-12-26 07:46:32,821][123090] Updated weights for policy 1, policy_version 1017676 (0.0009) [2023-12-26 07:46:32,895][123090] Updated weights for policy 1, policy_version 1017686 (0.0009) [2023-12-26 07:46:33,102][123091] Updated weights for policy 0, policy_version 1024978 (0.0009) [2023-12-26 07:46:33,170][123091] Updated weights for policy 0, policy_version 1024988 (0.0005) [2023-12-26 07:46:33,240][123091] Updated weights for policy 0, policy_version 1024998 (0.0005) [2023-12-26 07:46:33,299][123091] Updated weights for policy 0, policy_version 1025008 (0.0005) [2023-12-26 07:46:33,645][123090] Updated weights for policy 1, policy_version 1017697 (0.0009) [2023-12-26 07:46:33,707][123090] Updated weights for policy 1, policy_version 1017707 (0.0010) [2023-12-26 07:46:33,774][123090] Updated weights for policy 1, policy_version 1017717 (0.0009) [2023-12-26 07:46:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 522936320. Throughput: 0: 9033.2, 1: 8902.5. Samples: 522952348. Policy #0 lag: (min: 31.0, avg: 36.4, max: 63.0) [2023-12-26 07:46:33,785][121949] Avg episode reward: [(0, '6081.567'), (1, '6003.946')] [2023-12-26 07:46:33,839][123090] Updated weights for policy 1, policy_version 1017727 (0.0009) [2023-12-26 07:46:34,029][123091] Updated weights for policy 0, policy_version 1025018 (0.0006) [2023-12-26 07:46:34,088][123091] Updated weights for policy 0, policy_version 1025028 (0.0005) [2023-12-26 07:46:34,146][123091] Updated weights for policy 0, policy_version 1025038 (0.0006) [2023-12-26 07:46:34,580][123090] Updated weights for policy 1, policy_version 1017737 (0.0006) [2023-12-26 07:46:34,641][123090] Updated weights for policy 1, policy_version 1017747 (0.0006) [2023-12-26 07:46:34,708][123090] Updated weights for policy 1, policy_version 1017757 (0.0005) [2023-12-26 07:46:34,862][123091] Updated weights for policy 0, policy_version 1025048 (0.0006) [2023-12-26 07:46:34,931][123091] Updated weights for policy 0, policy_version 1025058 (0.0007) [2023-12-26 07:46:34,992][123091] Updated weights for policy 0, policy_version 1025068 (0.0010) [2023-12-26 07:46:35,467][123090] Updated weights for policy 1, policy_version 1017767 (0.0008) [2023-12-26 07:46:35,531][123090] Updated weights for policy 1, policy_version 1017777 (0.0009) [2023-12-26 07:46:35,598][123090] Updated weights for policy 1, policy_version 1017787 (0.0009) [2023-12-26 07:46:35,726][123091] Updated weights for policy 0, policy_version 1025078 (0.0007) [2023-12-26 07:46:35,782][123091] Updated weights for policy 0, policy_version 1025088 (0.0005) [2023-12-26 07:46:35,840][123091] Updated weights for policy 0, policy_version 1025098 (0.0006) [2023-12-26 07:46:36,495][123090] Updated weights for policy 1, policy_version 1017797 (0.0009) [2023-12-26 07:46:36,551][123090] Updated weights for policy 1, policy_version 1017807 (0.0010) [2023-12-26 07:46:36,563][123091] Updated weights for policy 0, policy_version 1025108 (0.0006) [2023-12-26 07:46:36,607][123090] Updated weights for policy 1, policy_version 1017817 (0.0008) [2023-12-26 07:46:36,628][123091] Updated weights for policy 0, policy_version 1025118 (0.0006) [2023-12-26 07:46:36,696][123091] Updated weights for policy 0, policy_version 1025128 (0.0006) [2023-12-26 07:46:37,423][123091] Updated weights for policy 0, policy_version 1025138 (0.0005) [2023-12-26 07:46:37,485][123091] Updated weights for policy 0, policy_version 1025148 (0.0005) [2023-12-26 07:46:37,523][123090] Updated weights for policy 1, policy_version 1017827 (0.0009) [2023-12-26 07:46:37,540][123091] Updated weights for policy 0, policy_version 1025158 (0.0005) [2023-12-26 07:46:37,586][123090] Updated weights for policy 1, policy_version 1017837 (0.0009) [2023-12-26 07:46:37,588][123091] Updated weights for policy 0, policy_version 1025168 (0.0005) [2023-12-26 07:46:37,648][123090] Updated weights for policy 1, policy_version 1017847 (0.0010) [2023-12-26 07:46:38,317][123091] Updated weights for policy 0, policy_version 1025178 (0.0010) [2023-12-26 07:46:38,375][123091] Updated weights for policy 0, policy_version 1025188 (0.0008) [2023-12-26 07:46:38,449][123091] Updated weights for policy 0, policy_version 1025198 (0.0006) [2023-12-26 07:46:38,518][123090] Updated weights for policy 1, policy_version 1017857 (0.0010) [2023-12-26 07:46:38,584][123090] Updated weights for policy 1, policy_version 1017867 (0.0010) [2023-12-26 07:46:38,651][123090] Updated weights for policy 1, policy_version 1017877 (0.0010) [2023-12-26 07:46:38,713][123090] Updated weights for policy 1, policy_version 1017887 (0.0010) [2023-12-26 07:46:38,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 523034624. Throughput: 0: 9104.8, 1: 8908.1. Samples: 523007056. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:46:38,784][121949] Avg episode reward: [(0, '6216.205'), (1, '6023.536')] [2023-12-26 07:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001025200_262455296.pth... [2023-12-26 07:46:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001017888_260579328.pth... [2023-12-26 07:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001024144_262184960.pth [2023-12-26 07:46:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001016864_260317184.pth [2023-12-26 07:46:39,166][123091] Updated weights for policy 0, policy_version 1025208 (0.0008) [2023-12-26 07:46:39,230][123091] Updated weights for policy 0, policy_version 1025218 (0.0010) [2023-12-26 07:46:39,282][123091] Updated weights for policy 0, policy_version 1025228 (0.0010) [2023-12-26 07:46:39,595][123090] Updated weights for policy 1, policy_version 1017897 (0.0009) [2023-12-26 07:46:39,660][123090] Updated weights for policy 1, policy_version 1017907 (0.0009) [2023-12-26 07:46:39,713][123090] Updated weights for policy 1, policy_version 1017917 (0.0009) [2023-12-26 07:46:40,127][123091] Updated weights for policy 0, policy_version 1025238 (0.0008) [2023-12-26 07:46:40,201][123091] Updated weights for policy 0, policy_version 1025248 (0.0005) [2023-12-26 07:46:40,285][123091] Updated weights for policy 0, policy_version 1025258 (0.0006) [2023-12-26 07:46:40,519][123090] Updated weights for policy 1, policy_version 1017927 (0.0008) [2023-12-26 07:46:40,580][123090] Updated weights for policy 1, policy_version 1017937 (0.0009) [2023-12-26 07:46:40,642][123090] Updated weights for policy 1, policy_version 1017947 (0.0009) [2023-12-26 07:46:40,993][123091] Updated weights for policy 0, policy_version 1025268 (0.0009) [2023-12-26 07:46:41,061][123091] Updated weights for policy 0, policy_version 1025278 (0.0007) [2023-12-26 07:46:41,119][123091] Updated weights for policy 0, policy_version 1025288 (0.0011) [2023-12-26 07:46:41,565][123090] Updated weights for policy 1, policy_version 1017957 (0.0010) [2023-12-26 07:46:41,635][123090] Updated weights for policy 1, policy_version 1017967 (0.0009) [2023-12-26 07:46:41,700][123090] Updated weights for policy 1, policy_version 1017977 (0.0009) [2023-12-26 07:46:41,938][123091] Updated weights for policy 0, policy_version 1025298 (0.0008) [2023-12-26 07:46:41,984][123091] Updated weights for policy 0, policy_version 1025308 (0.0005) [2023-12-26 07:46:42,035][123091] Updated weights for policy 0, policy_version 1025318 (0.0010) [2023-12-26 07:46:42,093][123091] Updated weights for policy 0, policy_version 1025328 (0.0009) [2023-12-26 07:46:42,622][123090] Updated weights for policy 1, policy_version 1017987 (0.0009) [2023-12-26 07:46:42,680][123090] Updated weights for policy 1, policy_version 1017997 (0.0009) [2023-12-26 07:46:42,744][123090] Updated weights for policy 1, policy_version 1018007 (0.0010) [2023-12-26 07:46:42,892][123091] Updated weights for policy 0, policy_version 1025338 (0.0011) [2023-12-26 07:46:42,954][123091] Updated weights for policy 0, policy_version 1025348 (0.0007) [2023-12-26 07:46:43,024][123091] Updated weights for policy 0, policy_version 1025358 (0.0006) [2023-12-26 07:46:43,553][123090] Updated weights for policy 1, policy_version 1018017 (0.0008) [2023-12-26 07:46:43,619][123090] Updated weights for policy 1, policy_version 1018027 (0.0005) [2023-12-26 07:46:43,679][123090] Updated weights for policy 1, policy_version 1018037 (0.0005) [2023-12-26 07:46:43,737][123090] Updated weights for policy 1, policy_version 1018047 (0.0007) [2023-12-26 07:46:43,757][123091] Updated weights for policy 0, policy_version 1025368 (0.0005) [2023-12-26 07:46:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 523116544. Throughput: 0: 9102.1, 1: 8762.5. Samples: 523109928. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:46:43,784][121949] Avg episode reward: [(0, '6271.193'), (1, '5971.549')] [2023-12-26 07:46:43,818][123091] Updated weights for policy 0, policy_version 1025378 (0.0009) [2023-12-26 07:46:43,876][123091] Updated weights for policy 0, policy_version 1025388 (0.0010) [2023-12-26 07:46:44,399][123090] Updated weights for policy 1, policy_version 1018057 (0.0009) [2023-12-26 07:46:44,456][123090] Updated weights for policy 1, policy_version 1018067 (0.0009) [2023-12-26 07:46:44,520][123090] Updated weights for policy 1, policy_version 1018077 (0.0011) [2023-12-26 07:46:44,623][123091] Updated weights for policy 0, policy_version 1025398 (0.0010) [2023-12-26 07:46:44,683][123091] Updated weights for policy 0, policy_version 1025408 (0.0009) [2023-12-26 07:46:44,737][123091] Updated weights for policy 0, policy_version 1025418 (0.0010) [2023-12-26 07:46:45,322][123090] Updated weights for policy 1, policy_version 1018087 (0.0010) [2023-12-26 07:46:45,386][123090] Updated weights for policy 1, policy_version 1018097 (0.0009) [2023-12-26 07:46:45,448][123090] Updated weights for policy 1, policy_version 1018107 (0.0009) [2023-12-26 07:46:45,614][123091] Updated weights for policy 0, policy_version 1025428 (0.0009) [2023-12-26 07:46:45,670][123091] Updated weights for policy 0, policy_version 1025438 (0.0009) [2023-12-26 07:46:45,730][123091] Updated weights for policy 0, policy_version 1025448 (0.0008) [2023-12-26 07:46:46,178][123090] Updated weights for policy 1, policy_version 1018117 (0.0009) [2023-12-26 07:46:46,245][123090] Updated weights for policy 1, policy_version 1018127 (0.0008) [2023-12-26 07:46:46,314][123090] Updated weights for policy 1, policy_version 1018137 (0.0005) [2023-12-26 07:46:46,603][123091] Updated weights for policy 0, policy_version 1025458 (0.0009) [2023-12-26 07:46:46,666][123091] Updated weights for policy 0, policy_version 1025468 (0.0009) [2023-12-26 07:46:46,718][123091] Updated weights for policy 0, policy_version 1025478 (0.0009) [2023-12-26 07:46:46,774][123091] Updated weights for policy 0, policy_version 1025488 (0.0010) [2023-12-26 07:46:46,980][123090] Updated weights for policy 1, policy_version 1018147 (0.0007) [2023-12-26 07:46:47,026][123090] Updated weights for policy 1, policy_version 1018157 (0.0009) [2023-12-26 07:46:47,081][123090] Updated weights for policy 1, policy_version 1018167 (0.0010) [2023-12-26 07:46:47,604][123091] Updated weights for policy 0, policy_version 1025498 (0.0011) [2023-12-26 07:46:47,664][123091] Updated weights for policy 0, policy_version 1025508 (0.0011) [2023-12-26 07:46:47,724][123091] Updated weights for policy 0, policy_version 1025518 (0.0011) [2023-12-26 07:46:47,762][123090] Updated weights for policy 1, policy_version 1018177 (0.0007) [2023-12-26 07:46:47,821][123090] Updated weights for policy 1, policy_version 1018187 (0.0005) [2023-12-26 07:46:47,887][123090] Updated weights for policy 1, policy_version 1018197 (0.0006) [2023-12-26 07:46:47,944][123090] Updated weights for policy 1, policy_version 1018207 (0.0005) [2023-12-26 07:46:48,447][123091] Updated weights for policy 0, policy_version 1025528 (0.0008) [2023-12-26 07:46:48,518][123091] Updated weights for policy 0, policy_version 1025538 (0.0011) [2023-12-26 07:46:48,588][123091] Updated weights for policy 0, policy_version 1025548 (0.0008) [2023-12-26 07:46:48,640][123090] Updated weights for policy 1, policy_version 1018217 (0.0010) [2023-12-26 07:46:48,723][123090] Updated weights for policy 1, policy_version 1018227 (0.0011) [2023-12-26 07:46:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 523206656. Throughput: 0: 9083.6, 1: 8844.4. Samples: 523220344. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:46:48,785][121949] Avg episode reward: [(0, '6305.744'), (1, '5984.328')] [2023-12-26 07:46:48,785][123090] Updated weights for policy 1, policy_version 1018237 (0.0007) [2023-12-26 07:46:49,288][123091] Updated weights for policy 0, policy_version 1025558 (0.0007) [2023-12-26 07:46:49,353][123091] Updated weights for policy 0, policy_version 1025568 (0.0007) [2023-12-26 07:46:49,414][123091] Updated weights for policy 0, policy_version 1025578 (0.0011) [2023-12-26 07:46:49,474][123090] Updated weights for policy 1, policy_version 1018247 (0.0009) [2023-12-26 07:46:49,537][123090] Updated weights for policy 1, policy_version 1018257 (0.0010) [2023-12-26 07:46:49,600][123090] Updated weights for policy 1, policy_version 1018267 (0.0010) [2023-12-26 07:46:50,252][123091] Updated weights for policy 0, policy_version 1025588 (0.0010) [2023-12-26 07:46:50,322][123091] Updated weights for policy 0, policy_version 1025598 (0.0011) [2023-12-26 07:46:50,393][123091] Updated weights for policy 0, policy_version 1025608 (0.0011) [2023-12-26 07:46:50,427][123090] Updated weights for policy 1, policy_version 1018277 (0.0008) [2023-12-26 07:46:50,496][123090] Updated weights for policy 1, policy_version 1018287 (0.0009) [2023-12-26 07:46:50,568][123090] Updated weights for policy 1, policy_version 1018297 (0.0010) [2023-12-26 07:46:51,198][123091] Updated weights for policy 0, policy_version 1025618 (0.0009) [2023-12-26 07:46:51,272][123091] Updated weights for policy 0, policy_version 1025628 (0.0011) [2023-12-26 07:46:51,330][123090] Updated weights for policy 1, policy_version 1018307 (0.0008) [2023-12-26 07:46:51,344][123091] Updated weights for policy 0, policy_version 1025638 (0.0013) [2023-12-26 07:46:51,398][123090] Updated weights for policy 1, policy_version 1018317 (0.0010) [2023-12-26 07:46:51,410][123091] Updated weights for policy 0, policy_version 1025648 (0.0007) [2023-12-26 07:46:51,452][123090] Updated weights for policy 1, policy_version 1018327 (0.0009) [2023-12-26 07:46:52,194][123091] Updated weights for policy 0, policy_version 1025658 (0.0009) [2023-12-26 07:46:52,251][123091] Updated weights for policy 0, policy_version 1025668 (0.0008) [2023-12-26 07:46:52,309][123091] Updated weights for policy 0, policy_version 1025678 (0.0010) [2023-12-26 07:46:52,330][123090] Updated weights for policy 1, policy_version 1018337 (0.0010) [2023-12-26 07:46:52,391][123090] Updated weights for policy 1, policy_version 1018347 (0.0010) [2023-12-26 07:46:52,460][123090] Updated weights for policy 1, policy_version 1018357 (0.0009) [2023-12-26 07:46:52,527][123090] Updated weights for policy 1, policy_version 1018367 (0.0008) [2023-12-26 07:46:53,221][123091] Updated weights for policy 0, policy_version 1025688 (0.0010) [2023-12-26 07:46:53,235][123090] Updated weights for policy 1, policy_version 1018377 (0.0005) [2023-12-26 07:46:53,275][123091] Updated weights for policy 0, policy_version 1025699 (0.0008) [2023-12-26 07:46:53,297][123090] Updated weights for policy 1, policy_version 1018387 (0.0008) [2023-12-26 07:46:53,327][123091] Updated weights for policy 0, policy_version 1025709 (0.0010) [2023-12-26 07:46:53,352][123090] Updated weights for policy 1, policy_version 1018397 (0.0008) [2023-12-26 07:46:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 523296768. Throughput: 0: 9051.1, 1: 8808.1. Samples: 523273344. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:46:53,785][121949] Avg episode reward: [(0, '6213.996'), (1, '6062.544')] [2023-12-26 07:46:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001018400_260710400.pth... [2023-12-26 07:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001025712_262586368.pth... [2023-12-26 07:46:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001017376_260448256.pth [2023-12-26 07:46:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001024656_262316032.pth [2023-12-26 07:46:54,043][123091] Updated weights for policy 0, policy_version 1025719 (0.0007) [2023-12-26 07:46:54,100][123091] Updated weights for policy 0, policy_version 1025729 (0.0007) [2023-12-26 07:46:54,155][123091] Updated weights for policy 0, policy_version 1025739 (0.0005) [2023-12-26 07:46:54,201][123090] Updated weights for policy 1, policy_version 1018407 (0.0010) [2023-12-26 07:46:54,262][123090] Updated weights for policy 1, policy_version 1018418 (0.0010) [2023-12-26 07:46:54,325][123090] Updated weights for policy 1, policy_version 1018429 (0.0010) [2023-12-26 07:46:54,867][123091] Updated weights for policy 0, policy_version 1025749 (0.0007) [2023-12-26 07:46:54,918][123091] Updated weights for policy 0, policy_version 1025759 (0.0009) [2023-12-26 07:46:54,978][123091] Updated weights for policy 0, policy_version 1025769 (0.0010) [2023-12-26 07:46:55,221][123090] Updated weights for policy 1, policy_version 1018439 (0.0009) [2023-12-26 07:46:55,273][123090] Updated weights for policy 1, policy_version 1018449 (0.0009) [2023-12-26 07:46:55,323][123090] Updated weights for policy 1, policy_version 1018459 (0.0009) [2023-12-26 07:46:55,769][123091] Updated weights for policy 0, policy_version 1025779 (0.0008) [2023-12-26 07:46:55,820][123091] Updated weights for policy 0, policy_version 1025789 (0.0011) [2023-12-26 07:46:55,871][123091] Updated weights for policy 0, policy_version 1025799 (0.0006) [2023-12-26 07:46:56,166][123090] Updated weights for policy 1, policy_version 1018469 (0.0007) [2023-12-26 07:46:56,216][123090] Updated weights for policy 1, policy_version 1018479 (0.0005) [2023-12-26 07:46:56,277][123090] Updated weights for policy 1, policy_version 1018489 (0.0008) [2023-12-26 07:46:56,677][123091] Updated weights for policy 0, policy_version 1025809 (0.0006) [2023-12-26 07:46:56,728][123091] Updated weights for policy 0, policy_version 1025819 (0.0010) [2023-12-26 07:46:56,789][123091] Updated weights for policy 0, policy_version 1025829 (0.0010) [2023-12-26 07:46:56,855][123091] Updated weights for policy 0, policy_version 1025839 (0.0011) [2023-12-26 07:46:57,107][123090] Updated weights for policy 1, policy_version 1018499 (0.0009) [2023-12-26 07:46:57,169][123090] Updated weights for policy 1, policy_version 1018509 (0.0009) [2023-12-26 07:46:57,229][123090] Updated weights for policy 1, policy_version 1018519 (0.0009) [2023-12-26 07:46:57,648][123091] Updated weights for policy 0, policy_version 1025849 (0.0010) [2023-12-26 07:46:57,704][123091] Updated weights for policy 0, policy_version 1025859 (0.0009) [2023-12-26 07:46:57,757][123091] Updated weights for policy 0, policy_version 1025869 (0.0009) [2023-12-26 07:46:58,092][123090] Updated weights for policy 1, policy_version 1018529 (0.0009) [2023-12-26 07:46:58,153][123090] Updated weights for policy 1, policy_version 1018539 (0.0010) [2023-12-26 07:46:58,219][123090] Updated weights for policy 1, policy_version 1018549 (0.0010) [2023-12-26 07:46:58,288][123090] Updated weights for policy 1, policy_version 1018559 (0.0009) [2023-12-26 07:46:58,575][123091] Updated weights for policy 0, policy_version 1025879 (0.0010) [2023-12-26 07:46:58,637][123091] Updated weights for policy 0, policy_version 1025889 (0.0009) [2023-12-26 07:46:58,714][123091] Updated weights for policy 0, policy_version 1025899 (0.0009) [2023-12-26 07:46:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 523386880. Throughput: 0: 9091.4, 1: 8771.0. Samples: 523378744. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:46:58,785][121949] Avg episode reward: [(0, '6177.504'), (1, '6002.807')] [2023-12-26 07:46:59,247][123090] Updated weights for policy 1, policy_version 1018569 (0.0009) [2023-12-26 07:46:59,319][123090] Updated weights for policy 1, policy_version 1018579 (0.0009) [2023-12-26 07:46:59,384][123090] Updated weights for policy 1, policy_version 1018589 (0.0007) [2023-12-26 07:46:59,601][123091] Updated weights for policy 0, policy_version 1025909 (0.0007) [2023-12-26 07:46:59,663][123091] Updated weights for policy 0, policy_version 1025919 (0.0005) [2023-12-26 07:46:59,723][123091] Updated weights for policy 0, policy_version 1025929 (0.0005) [2023-12-26 07:47:00,177][123090] Updated weights for policy 1, policy_version 1018599 (0.0008) [2023-12-26 07:47:00,230][123090] Updated weights for policy 1, policy_version 1018609 (0.0009) [2023-12-26 07:47:00,284][123090] Updated weights for policy 1, policy_version 1018619 (0.0007) [2023-12-26 07:47:00,452][123091] Updated weights for policy 0, policy_version 1025939 (0.0007) [2023-12-26 07:47:00,495][123091] Updated weights for policy 0, policy_version 1025949 (0.0010) [2023-12-26 07:47:00,542][123091] Updated weights for policy 0, policy_version 1025959 (0.0010) [2023-12-26 07:47:00,989][123090] Updated weights for policy 1, policy_version 1018629 (0.0005) [2023-12-26 07:47:01,060][123090] Updated weights for policy 1, policy_version 1018640 (0.0007) [2023-12-26 07:47:01,135][123090] Updated weights for policy 1, policy_version 1018650 (0.0008) [2023-12-26 07:47:01,298][123091] Updated weights for policy 0, policy_version 1025969 (0.0010) [2023-12-26 07:47:01,362][123091] Updated weights for policy 0, policy_version 1025979 (0.0009) [2023-12-26 07:47:01,428][123091] Updated weights for policy 0, policy_version 1025989 (0.0009) [2023-12-26 07:47:01,500][123091] Updated weights for policy 0, policy_version 1025999 (0.0005) [2023-12-26 07:47:01,983][123090] Updated weights for policy 1, policy_version 1018660 (0.0008) [2023-12-26 07:47:02,042][123090] Updated weights for policy 1, policy_version 1018670 (0.0005) [2023-12-26 07:47:02,105][123090] Updated weights for policy 1, policy_version 1018680 (0.0005) [2023-12-26 07:47:02,195][123091] Updated weights for policy 0, policy_version 1026009 (0.0006) [2023-12-26 07:47:02,268][123091] Updated weights for policy 0, policy_version 1026019 (0.0008) [2023-12-26 07:47:02,340][123091] Updated weights for policy 0, policy_version 1026029 (0.0011) [2023-12-26 07:47:02,777][123090] Updated weights for policy 1, policy_version 1018690 (0.0007) [2023-12-26 07:47:02,831][123090] Updated weights for policy 1, policy_version 1018700 (0.0005) [2023-12-26 07:47:02,890][123090] Updated weights for policy 1, policy_version 1018710 (0.0005) [2023-12-26 07:47:02,939][123090] Updated weights for policy 1, policy_version 1018720 (0.0005) [2023-12-26 07:47:03,126][123091] Updated weights for policy 0, policy_version 1026039 (0.0011) [2023-12-26 07:47:03,178][123091] Updated weights for policy 0, policy_version 1026049 (0.0010) [2023-12-26 07:47:03,235][123091] Updated weights for policy 0, policy_version 1026059 (0.0010) [2023-12-26 07:47:03,705][123090] Updated weights for policy 1, policy_version 1018730 (0.0010) [2023-12-26 07:47:03,759][123090] Updated weights for policy 1, policy_version 1018740 (0.0010) [2023-12-26 07:47:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 523468800. Throughput: 0: 9026.0, 1: 8765.0. Samples: 523484972. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:03,785][121949] Avg episode reward: [(0, '6254.729'), (1, '6007.132')] [2023-12-26 07:47:03,822][123090] Updated weights for policy 1, policy_version 1018750 (0.0010) [2023-12-26 07:47:04,074][123091] Updated weights for policy 0, policy_version 1026069 (0.0010) [2023-12-26 07:47:04,130][123091] Updated weights for policy 0, policy_version 1026079 (0.0010) [2023-12-26 07:47:04,198][123091] Updated weights for policy 0, policy_version 1026089 (0.0011) [2023-12-26 07:47:04,686][123090] Updated weights for policy 1, policy_version 1018760 (0.0010) [2023-12-26 07:47:04,751][123090] Updated weights for policy 1, policy_version 1018770 (0.0007) [2023-12-26 07:47:04,802][123090] Updated weights for policy 1, policy_version 1018780 (0.0005) [2023-12-26 07:47:05,031][123091] Updated weights for policy 0, policy_version 1026099 (0.0011) [2023-12-26 07:47:05,093][123091] Updated weights for policy 0, policy_version 1026109 (0.0010) [2023-12-26 07:47:05,157][123091] Updated weights for policy 0, policy_version 1026119 (0.0010) [2023-12-26 07:47:05,484][123090] Updated weights for policy 1, policy_version 1018790 (0.0008) [2023-12-26 07:47:05,554][123090] Updated weights for policy 1, policy_version 1018800 (0.0010) [2023-12-26 07:47:05,619][123090] Updated weights for policy 1, policy_version 1018810 (0.0010) [2023-12-26 07:47:05,971][123091] Updated weights for policy 0, policy_version 1026129 (0.0011) [2023-12-26 07:47:06,029][123091] Updated weights for policy 0, policy_version 1026139 (0.0010) [2023-12-26 07:47:06,088][123091] Updated weights for policy 0, policy_version 1026149 (0.0010) [2023-12-26 07:47:06,150][123091] Updated weights for policy 0, policy_version 1026159 (0.0010) [2023-12-26 07:47:06,454][123090] Updated weights for policy 1, policy_version 1018820 (0.0010) [2023-12-26 07:47:06,522][123090] Updated weights for policy 1, policy_version 1018830 (0.0011) [2023-12-26 07:47:06,591][123090] Updated weights for policy 1, policy_version 1018840 (0.0009) [2023-12-26 07:47:06,928][123091] Updated weights for policy 0, policy_version 1026169 (0.0006) [2023-12-26 07:47:06,979][123091] Updated weights for policy 0, policy_version 1026179 (0.0005) [2023-12-26 07:47:07,036][123091] Updated weights for policy 0, policy_version 1026189 (0.0005) [2023-12-26 07:47:07,324][123090] Updated weights for policy 1, policy_version 1018850 (0.0007) [2023-12-26 07:47:07,379][123090] Updated weights for policy 1, policy_version 1018860 (0.0010) [2023-12-26 07:47:07,426][123090] Updated weights for policy 1, policy_version 1018870 (0.0010) [2023-12-26 07:47:07,473][123090] Updated weights for policy 1, policy_version 1018880 (0.0010) [2023-12-26 07:47:07,638][123091] Updated weights for policy 0, policy_version 1026199 (0.0005) [2023-12-26 07:47:07,683][123091] Updated weights for policy 0, policy_version 1026209 (0.0005) [2023-12-26 07:47:07,744][123091] Updated weights for policy 0, policy_version 1026219 (0.0005) [2023-12-26 07:47:08,292][123090] Updated weights for policy 1, policy_version 1018890 (0.0005) [2023-12-26 07:47:08,364][123090] Updated weights for policy 1, policy_version 1018900 (0.0007) [2023-12-26 07:47:08,423][123090] Updated weights for policy 1, policy_version 1018910 (0.0005) [2023-12-26 07:47:08,429][123091] Updated weights for policy 0, policy_version 1026229 (0.0007) [2023-12-26 07:47:08,488][123091] Updated weights for policy 0, policy_version 1026239 (0.0008) [2023-12-26 07:47:08,553][123091] Updated weights for policy 0, policy_version 1026249 (0.0008) [2023-12-26 07:47:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 523567104. Throughput: 0: 9045.1, 1: 8780.0. Samples: 523537232. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:08,785][121949] Avg episode reward: [(0, '6235.155'), (1, '6019.370')] [2023-12-26 07:47:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001026256_262725632.pth... [2023-12-26 07:47:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001018912_260841472.pth... [2023-12-26 07:47:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001025200_262455296.pth [2023-12-26 07:47:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001017888_260579328.pth [2023-12-26 07:47:09,187][123090] Updated weights for policy 1, policy_version 1018920 (0.0009) [2023-12-26 07:47:09,263][123091] Updated weights for policy 0, policy_version 1026259 (0.0009) [2023-12-26 07:47:09,264][123090] Updated weights for policy 1, policy_version 1018930 (0.0008) [2023-12-26 07:47:09,328][123091] Updated weights for policy 0, policy_version 1026269 (0.0009) [2023-12-26 07:47:09,333][123090] Updated weights for policy 1, policy_version 1018940 (0.0009) [2023-12-26 07:47:09,396][123091] Updated weights for policy 0, policy_version 1026279 (0.0009) [2023-12-26 07:47:10,169][123090] Updated weights for policy 1, policy_version 1018950 (0.0007) [2023-12-26 07:47:10,176][123091] Updated weights for policy 0, policy_version 1026289 (0.0009) [2023-12-26 07:47:10,235][123090] Updated weights for policy 1, policy_version 1018960 (0.0006) [2023-12-26 07:47:10,243][123091] Updated weights for policy 0, policy_version 1026299 (0.0008) [2023-12-26 07:47:10,287][123090] Updated weights for policy 1, policy_version 1018970 (0.0006) [2023-12-26 07:47:10,309][123091] Updated weights for policy 0, policy_version 1026309 (0.0008) [2023-12-26 07:47:10,374][123091] Updated weights for policy 0, policy_version 1026319 (0.0010) [2023-12-26 07:47:10,957][123090] Updated weights for policy 1, policy_version 1018980 (0.0006) [2023-12-26 07:47:11,014][123090] Updated weights for policy 1, policy_version 1018990 (0.0005) [2023-12-26 07:47:11,083][123090] Updated weights for policy 1, policy_version 1019000 (0.0008) [2023-12-26 07:47:11,140][123091] Updated weights for policy 0, policy_version 1026329 (0.0008) [2023-12-26 07:47:11,208][123091] Updated weights for policy 0, policy_version 1026339 (0.0007) [2023-12-26 07:47:11,284][123091] Updated weights for policy 0, policy_version 1026349 (0.0007) [2023-12-26 07:47:11,912][123090] Updated weights for policy 1, policy_version 1019010 (0.0006) [2023-12-26 07:47:11,981][123090] Updated weights for policy 1, policy_version 1019020 (0.0008) [2023-12-26 07:47:12,045][123090] Updated weights for policy 1, policy_version 1019030 (0.0009) [2023-12-26 07:47:12,091][123091] Updated weights for policy 0, policy_version 1026359 (0.0008) [2023-12-26 07:47:12,104][123090] Updated weights for policy 1, policy_version 1019040 (0.0007) [2023-12-26 07:47:12,153][123091] Updated weights for policy 0, policy_version 1026369 (0.0010) [2023-12-26 07:47:12,212][123091] Updated weights for policy 0, policy_version 1026379 (0.0010) [2023-12-26 07:47:12,901][123090] Updated weights for policy 1, policy_version 1019050 (0.0008) [2023-12-26 07:47:12,971][123090] Updated weights for policy 1, policy_version 1019060 (0.0006) [2023-12-26 07:47:13,037][123090] Updated weights for policy 1, policy_version 1019070 (0.0006) [2023-12-26 07:47:13,143][123091] Updated weights for policy 0, policy_version 1026389 (0.0010) [2023-12-26 07:47:13,209][123091] Updated weights for policy 0, policy_version 1026399 (0.0010) [2023-12-26 07:47:13,276][123091] Updated weights for policy 0, policy_version 1026409 (0.0010) [2023-12-26 07:47:13,671][123090] Updated weights for policy 1, policy_version 1019080 (0.0005) [2023-12-26 07:47:13,734][123090] Updated weights for policy 1, policy_version 1019090 (0.0005) [2023-12-26 07:47:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 523649024. Throughput: 0: 9048.6, 1: 8749.2. Samples: 523645888. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:13,785][121949] Avg episode reward: [(0, '6318.831'), (1, '6018.399')] [2023-12-26 07:47:13,796][123090] Updated weights for policy 1, policy_version 1019100 (0.0005) [2023-12-26 07:47:14,185][123091] Updated weights for policy 0, policy_version 1026419 (0.0010) [2023-12-26 07:47:14,235][123091] Updated weights for policy 0, policy_version 1026429 (0.0009) [2023-12-26 07:47:14,292][123091] Updated weights for policy 0, policy_version 1026439 (0.0010) [2023-12-26 07:47:14,496][123090] Updated weights for policy 1, policy_version 1019110 (0.0007) [2023-12-26 07:47:14,551][123090] Updated weights for policy 1, policy_version 1019120 (0.0009) [2023-12-26 07:47:14,600][123090] Updated weights for policy 1, policy_version 1019130 (0.0009) [2023-12-26 07:47:15,149][123091] Updated weights for policy 0, policy_version 1026449 (0.0009) [2023-12-26 07:47:15,228][123091] Updated weights for policy 0, policy_version 1026459 (0.0006) [2023-12-26 07:47:15,307][123091] Updated weights for policy 0, policy_version 1026469 (0.0006) [2023-12-26 07:47:15,374][123091] Updated weights for policy 0, policy_version 1026479 (0.0009) [2023-12-26 07:47:15,412][123090] Updated weights for policy 1, policy_version 1019140 (0.0010) [2023-12-26 07:47:15,480][123090] Updated weights for policy 1, policy_version 1019150 (0.0010) [2023-12-26 07:47:15,545][123090] Updated weights for policy 1, policy_version 1019160 (0.0009) [2023-12-26 07:47:16,039][123091] Updated weights for policy 0, policy_version 1026489 (0.0008) [2023-12-26 07:47:16,104][123091] Updated weights for policy 0, policy_version 1026499 (0.0010) [2023-12-26 07:47:16,150][123091] Updated weights for policy 0, policy_version 1026509 (0.0005) [2023-12-26 07:47:16,447][123090] Updated weights for policy 1, policy_version 1019170 (0.0009) [2023-12-26 07:47:16,512][123090] Updated weights for policy 1, policy_version 1019180 (0.0009) [2023-12-26 07:47:16,576][123090] Updated weights for policy 1, policy_version 1019190 (0.0009) [2023-12-26 07:47:16,639][123090] Updated weights for policy 1, policy_version 1019200 (0.0006) [2023-12-26 07:47:16,852][123091] Updated weights for policy 0, policy_version 1026519 (0.0005) [2023-12-26 07:47:16,918][123091] Updated weights for policy 0, policy_version 1026529 (0.0005) [2023-12-26 07:47:16,981][123091] Updated weights for policy 0, policy_version 1026539 (0.0007) [2023-12-26 07:47:17,361][123090] Updated weights for policy 1, policy_version 1019210 (0.0009) [2023-12-26 07:47:17,432][123090] Updated weights for policy 1, policy_version 1019220 (0.0005) [2023-12-26 07:47:17,498][123090] Updated weights for policy 1, policy_version 1019230 (0.0005) [2023-12-26 07:47:17,772][123091] Updated weights for policy 0, policy_version 1026549 (0.0011) [2023-12-26 07:47:17,831][123091] Updated weights for policy 0, policy_version 1026559 (0.0011) [2023-12-26 07:47:17,882][123091] Updated weights for policy 0, policy_version 1026569 (0.0010) [2023-12-26 07:47:18,210][123090] Updated weights for policy 1, policy_version 1019240 (0.0008) [2023-12-26 07:47:18,280][123090] Updated weights for policy 1, policy_version 1019250 (0.0010) [2023-12-26 07:47:18,352][123090] Updated weights for policy 1, policy_version 1019260 (0.0010) [2023-12-26 07:47:18,634][123091] Updated weights for policy 0, policy_version 1026579 (0.0011) [2023-12-26 07:47:18,690][123091] Updated weights for policy 0, policy_version 1026589 (0.0008) [2023-12-26 07:47:18,754][123091] Updated weights for policy 0, policy_version 1026599 (0.0005) [2023-12-26 07:47:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 523739136. Throughput: 0: 9004.6, 1: 8817.3. Samples: 523754328. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:18,785][121949] Avg episode reward: [(0, '6391.667'), (1, '6067.587')] [2023-12-26 07:47:19,202][123090] Updated weights for policy 1, policy_version 1019270 (0.0010) [2023-12-26 07:47:19,287][123090] Updated weights for policy 1, policy_version 1019280 (0.0009) [2023-12-26 07:47:19,352][123090] Updated weights for policy 1, policy_version 1019290 (0.0009) [2023-12-26 07:47:19,595][123091] Updated weights for policy 0, policy_version 1026610 (0.0008) [2023-12-26 07:47:19,666][123091] Updated weights for policy 0, policy_version 1026620 (0.0011) [2023-12-26 07:47:19,736][123091] Updated weights for policy 0, policy_version 1026630 (0.0011) [2023-12-26 07:47:19,803][123091] Updated weights for policy 0, policy_version 1026640 (0.0010) [2023-12-26 07:47:20,185][123090] Updated weights for policy 1, policy_version 1019300 (0.0007) [2023-12-26 07:47:20,251][123090] Updated weights for policy 1, policy_version 1019310 (0.0009) [2023-12-26 07:47:20,320][123090] Updated weights for policy 1, policy_version 1019320 (0.0010) [2023-12-26 07:47:20,566][123091] Updated weights for policy 0, policy_version 1026650 (0.0009) [2023-12-26 07:47:20,639][123091] Updated weights for policy 0, policy_version 1026660 (0.0009) [2023-12-26 07:47:20,703][123091] Updated weights for policy 0, policy_version 1026670 (0.0009) [2023-12-26 07:47:21,081][123090] Updated weights for policy 1, policy_version 1019330 (0.0010) [2023-12-26 07:47:21,152][123090] Updated weights for policy 1, policy_version 1019340 (0.0007) [2023-12-26 07:47:21,219][123090] Updated weights for policy 1, policy_version 1019350 (0.0007) [2023-12-26 07:47:21,285][123090] Updated weights for policy 1, policy_version 1019360 (0.0008) [2023-12-26 07:47:21,538][123091] Updated weights for policy 0, policy_version 1026680 (0.0009) [2023-12-26 07:47:21,602][123091] Updated weights for policy 0, policy_version 1026690 (0.0009) [2023-12-26 07:47:21,671][123091] Updated weights for policy 0, policy_version 1026700 (0.0010) [2023-12-26 07:47:22,058][123090] Updated weights for policy 1, policy_version 1019370 (0.0010) [2023-12-26 07:47:22,125][123090] Updated weights for policy 1, policy_version 1019380 (0.0008) [2023-12-26 07:47:22,196][123090] Updated weights for policy 1, policy_version 1019390 (0.0010) [2023-12-26 07:47:22,554][123091] Updated weights for policy 0, policy_version 1026710 (0.0009) [2023-12-26 07:47:22,606][123091] Updated weights for policy 0, policy_version 1026720 (0.0009) [2023-12-26 07:47:22,666][123091] Updated weights for policy 0, policy_version 1026730 (0.0010) [2023-12-26 07:47:22,990][123090] Updated weights for policy 1, policy_version 1019400 (0.0010) [2023-12-26 07:47:23,050][123090] Updated weights for policy 1, policy_version 1019410 (0.0009) [2023-12-26 07:47:23,122][123090] Updated weights for policy 1, policy_version 1019420 (0.0009) [2023-12-26 07:47:23,546][123091] Updated weights for policy 0, policy_version 1026740 (0.0009) [2023-12-26 07:47:23,600][123091] Updated weights for policy 0, policy_version 1026750 (0.0009) [2023-12-26 07:47:23,654][123091] Updated weights for policy 0, policy_version 1026760 (0.0009) [2023-12-26 07:47:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 523829248. Throughput: 0: 8929.1, 1: 8814.7. Samples: 523805532. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:23,785][121949] Avg episode reward: [(0, '6411.706'), (1, '6074.303')] [2023-12-26 07:47:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001026768_262856704.pth... [2023-12-26 07:47:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001019424_260972544.pth... [2023-12-26 07:47:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001025712_262586368.pth [2023-12-26 07:47:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001018400_260710400.pth [2023-12-26 07:47:23,910][123090] Updated weights for policy 1, policy_version 1019430 (0.0009) [2023-12-26 07:47:23,962][123090] Updated weights for policy 1, policy_version 1019440 (0.0009) [2023-12-26 07:47:24,016][123090] Updated weights for policy 1, policy_version 1019450 (0.0009) [2023-12-26 07:47:24,417][123091] Updated weights for policy 0, policy_version 1026770 (0.0009) [2023-12-26 07:47:24,480][123091] Updated weights for policy 0, policy_version 1026780 (0.0005) [2023-12-26 07:47:24,542][123091] Updated weights for policy 0, policy_version 1026790 (0.0006) [2023-12-26 07:47:24,596][123091] Updated weights for policy 0, policy_version 1026800 (0.0009) [2023-12-26 07:47:24,930][123090] Updated weights for policy 1, policy_version 1019460 (0.0009) [2023-12-26 07:47:25,002][123090] Updated weights for policy 1, policy_version 1019470 (0.0010) [2023-12-26 07:47:25,068][123090] Updated weights for policy 1, policy_version 1019480 (0.0010) [2023-12-26 07:47:25,282][123091] Updated weights for policy 0, policy_version 1026810 (0.0006) [2023-12-26 07:47:25,344][123091] Updated weights for policy 0, policy_version 1026820 (0.0005) [2023-12-26 07:47:25,407][123091] Updated weights for policy 0, policy_version 1026830 (0.0005) [2023-12-26 07:47:25,879][123090] Updated weights for policy 1, policy_version 1019490 (0.0009) [2023-12-26 07:47:25,950][123090] Updated weights for policy 1, policy_version 1019500 (0.0010) [2023-12-26 07:47:26,003][123090] Updated weights for policy 1, policy_version 1019510 (0.0006) [2023-12-26 07:47:26,060][123090] Updated weights for policy 1, policy_version 1019520 (0.0005) [2023-12-26 07:47:26,073][123091] Updated weights for policy 0, policy_version 1026840 (0.0007) [2023-12-26 07:47:26,124][123091] Updated weights for policy 0, policy_version 1026850 (0.0010) [2023-12-26 07:47:26,167][123091] Updated weights for policy 0, policy_version 1026860 (0.0010) [2023-12-26 07:47:26,858][123090] Updated weights for policy 1, policy_version 1019530 (0.0009) [2023-12-26 07:47:26,906][123091] Updated weights for policy 0, policy_version 1026870 (0.0006) [2023-12-26 07:47:26,907][123090] Updated weights for policy 1, policy_version 1019540 (0.0009) [2023-12-26 07:47:26,963][123091] Updated weights for policy 0, policy_version 1026880 (0.0005) [2023-12-26 07:47:26,968][123090] Updated weights for policy 1, policy_version 1019550 (0.0009) [2023-12-26 07:47:27,012][123091] Updated weights for policy 0, policy_version 1026890 (0.0005) [2023-12-26 07:47:27,703][123091] Updated weights for policy 0, policy_version 1026900 (0.0007) [2023-12-26 07:47:27,751][123091] Updated weights for policy 0, policy_version 1026910 (0.0010) [2023-12-26 07:47:27,798][123091] Updated weights for policy 0, policy_version 1026920 (0.0010) [2023-12-26 07:47:27,851][123090] Updated weights for policy 1, policy_version 1019560 (0.0009) [2023-12-26 07:47:27,898][123090] Updated weights for policy 1, policy_version 1019570 (0.0008) [2023-12-26 07:47:27,946][123090] Updated weights for policy 1, policy_version 1019580 (0.0008) [2023-12-26 07:47:28,647][123091] Updated weights for policy 0, policy_version 1026930 (0.0010) [2023-12-26 07:47:28,711][123091] Updated weights for policy 0, policy_version 1026940 (0.0011) [2023-12-26 07:47:28,776][123091] Updated weights for policy 0, policy_version 1026950 (0.0011) [2023-12-26 07:47:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 523911168. Throughput: 0: 8959.1, 1: 8876.6. Samples: 523912536. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:28,785][123090] Updated weights for policy 1, policy_version 1019590 (0.0010) [2023-12-26 07:47:28,785][121949] Avg episode reward: [(0, '6343.553'), (1, '6076.419')] [2023-12-26 07:47:28,841][123091] Updated weights for policy 0, policy_version 1026960 (0.0011) [2023-12-26 07:47:28,850][123090] Updated weights for policy 1, policy_version 1019600 (0.0011) [2023-12-26 07:47:28,910][123090] Updated weights for policy 1, policy_version 1019610 (0.0010) [2023-12-26 07:47:29,673][123091] Updated weights for policy 0, policy_version 1026970 (0.0011) [2023-12-26 07:47:29,728][123091] Updated weights for policy 0, policy_version 1026980 (0.0010) [2023-12-26 07:47:29,765][123090] Updated weights for policy 1, policy_version 1019620 (0.0009) [2023-12-26 07:47:29,783][123091] Updated weights for policy 0, policy_version 1026990 (0.0010) [2023-12-26 07:47:29,827][123090] Updated weights for policy 1, policy_version 1019630 (0.0006) [2023-12-26 07:47:29,903][123090] Updated weights for policy 1, policy_version 1019640 (0.0010) [2023-12-26 07:47:30,548][123091] Updated weights for policy 0, policy_version 1027000 (0.0006) [2023-12-26 07:47:30,604][123091] Updated weights for policy 0, policy_version 1027010 (0.0005) [2023-12-26 07:47:30,660][123091] Updated weights for policy 0, policy_version 1027020 (0.0005) [2023-12-26 07:47:30,722][123090] Updated weights for policy 1, policy_version 1019650 (0.0011) [2023-12-26 07:47:30,784][123090] Updated weights for policy 1, policy_version 1019660 (0.0010) [2023-12-26 07:47:30,840][123090] Updated weights for policy 1, policy_version 1019670 (0.0010) [2023-12-26 07:47:30,903][123090] Updated weights for policy 1, policy_version 1019680 (0.0010) [2023-12-26 07:47:31,346][123091] Updated weights for policy 0, policy_version 1027030 (0.0006) [2023-12-26 07:47:31,417][123091] Updated weights for policy 0, policy_version 1027040 (0.0009) [2023-12-26 07:47:31,468][123091] Updated weights for policy 0, policy_version 1027050 (0.0010) [2023-12-26 07:47:31,680][123090] Updated weights for policy 1, policy_version 1019690 (0.0009) [2023-12-26 07:47:31,748][123090] Updated weights for policy 1, policy_version 1019700 (0.0010) [2023-12-26 07:47:31,801][123090] Updated weights for policy 1, policy_version 1019710 (0.0009) [2023-12-26 07:47:32,240][123091] Updated weights for policy 0, policy_version 1027060 (0.0008) [2023-12-26 07:47:32,303][123091] Updated weights for policy 0, policy_version 1027070 (0.0009) [2023-12-26 07:47:32,371][123091] Updated weights for policy 0, policy_version 1027080 (0.0009) [2023-12-26 07:47:32,590][123090] Updated weights for policy 1, policy_version 1019720 (0.0007) [2023-12-26 07:47:32,654][123090] Updated weights for policy 1, policy_version 1019730 (0.0007) [2023-12-26 07:47:32,727][123090] Updated weights for policy 1, policy_version 1019740 (0.0007) [2023-12-26 07:47:33,116][123091] Updated weights for policy 0, policy_version 1027090 (0.0009) [2023-12-26 07:47:33,195][123091] Updated weights for policy 0, policy_version 1027100 (0.0005) [2023-12-26 07:47:33,248][123091] Updated weights for policy 0, policy_version 1027110 (0.0005) [2023-12-26 07:47:33,293][123091] Updated weights for policy 0, policy_version 1027120 (0.0005) [2023-12-26 07:47:33,417][123090] Updated weights for policy 1, policy_version 1019750 (0.0006) [2023-12-26 07:47:33,477][123090] Updated weights for policy 1, policy_version 1019760 (0.0005) [2023-12-26 07:47:33,528][123090] Updated weights for policy 1, policy_version 1019770 (0.0005) [2023-12-26 07:47:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 524009472. Throughput: 0: 9004.1, 1: 8793.8. Samples: 524021248. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:33,785][121949] Avg episode reward: [(0, '6353.267'), (1, '6035.986')] [2023-12-26 07:47:33,921][123091] Updated weights for policy 0, policy_version 1027130 (0.0005) [2023-12-26 07:47:33,968][123091] Updated weights for policy 0, policy_version 1027140 (0.0005) [2023-12-26 07:47:34,026][123091] Updated weights for policy 0, policy_version 1027150 (0.0005) [2023-12-26 07:47:34,217][123090] Updated weights for policy 1, policy_version 1019780 (0.0006) [2023-12-26 07:47:34,283][123090] Updated weights for policy 1, policy_version 1019790 (0.0006) [2023-12-26 07:47:34,348][123090] Updated weights for policy 1, policy_version 1019800 (0.0009) [2023-12-26 07:47:34,801][123091] Updated weights for policy 0, policy_version 1027160 (0.0009) [2023-12-26 07:47:34,864][123091] Updated weights for policy 0, policy_version 1027170 (0.0010) [2023-12-26 07:47:34,912][123091] Updated weights for policy 0, policy_version 1027180 (0.0010) [2023-12-26 07:47:35,106][123090] Updated weights for policy 1, policy_version 1019810 (0.0006) [2023-12-26 07:47:35,165][123090] Updated weights for policy 1, policy_version 1019820 (0.0005) [2023-12-26 07:47:35,222][123090] Updated weights for policy 1, policy_version 1019830 (0.0005) [2023-12-26 07:47:35,276][123090] Updated weights for policy 1, policy_version 1019840 (0.0005) [2023-12-26 07:47:35,755][123091] Updated weights for policy 0, policy_version 1027190 (0.0009) [2023-12-26 07:47:35,818][123091] Updated weights for policy 0, policy_version 1027200 (0.0005) [2023-12-26 07:47:35,887][123091] Updated weights for policy 0, policy_version 1027210 (0.0005) [2023-12-26 07:47:35,978][123090] Updated weights for policy 1, policy_version 1019850 (0.0005) [2023-12-26 07:47:36,047][123090] Updated weights for policy 1, policy_version 1019860 (0.0009) [2023-12-26 07:47:36,104][123090] Updated weights for policy 1, policy_version 1019871 (0.0010) [2023-12-26 07:47:36,636][123091] Updated weights for policy 0, policy_version 1027220 (0.0007) [2023-12-26 07:47:36,688][123091] Updated weights for policy 0, policy_version 1027230 (0.0009) [2023-12-26 07:47:36,749][123091] Updated weights for policy 0, policy_version 1027240 (0.0009) [2023-12-26 07:47:36,803][123090] Updated weights for policy 1, policy_version 1019881 (0.0009) [2023-12-26 07:47:36,870][123090] Updated weights for policy 1, policy_version 1019891 (0.0010) [2023-12-26 07:47:36,937][123090] Updated weights for policy 1, policy_version 1019901 (0.0010) [2023-12-26 07:47:37,654][123090] Updated weights for policy 1, policy_version 1019911 (0.0008) [2023-12-26 07:47:37,670][123091] Updated weights for policy 0, policy_version 1027250 (0.0007) [2023-12-26 07:47:37,716][123090] Updated weights for policy 1, policy_version 1019921 (0.0009) [2023-12-26 07:47:37,733][123091] Updated weights for policy 0, policy_version 1027260 (0.0007) [2023-12-26 07:47:37,776][123090] Updated weights for policy 1, policy_version 1019931 (0.0009) [2023-12-26 07:47:37,796][123091] Updated weights for policy 0, policy_version 1027270 (0.0009) [2023-12-26 07:47:37,864][123091] Updated weights for policy 0, policy_version 1027280 (0.0009) [2023-12-26 07:47:38,586][123090] Updated weights for policy 1, policy_version 1019941 (0.0008) [2023-12-26 07:47:38,635][123090] Updated weights for policy 1, policy_version 1019951 (0.0009) [2023-12-26 07:47:38,687][123090] Updated weights for policy 1, policy_version 1019961 (0.0009) [2023-12-26 07:47:38,714][123091] Updated weights for policy 0, policy_version 1027290 (0.0010) [2023-12-26 07:47:38,781][123091] Updated weights for policy 0, policy_version 1027300 (0.0009) [2023-12-26 07:47:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 524099584. Throughput: 0: 9020.1, 1: 8845.4. Samples: 524077292. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:38,785][121949] Avg episode reward: [(0, '6352.799'), (1, '6037.284')] [2023-12-26 07:47:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001019968_261111808.pth... [2023-12-26 07:47:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001018912_260841472.pth [2023-12-26 07:47:38,852][123091] Updated weights for policy 0, policy_version 1027310 (0.0010) [2023-12-26 07:47:38,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001027312_262995968.pth... [2023-12-26 07:47:38,867][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001026256_262725632.pth [2023-12-26 07:47:39,553][123090] Updated weights for policy 1, policy_version 1019971 (0.0009) [2023-12-26 07:47:39,621][123090] Updated weights for policy 1, policy_version 1019981 (0.0009) [2023-12-26 07:47:39,637][123091] Updated weights for policy 0, policy_version 1027320 (0.0007) [2023-12-26 07:47:39,682][123090] Updated weights for policy 1, policy_version 1019991 (0.0009) [2023-12-26 07:47:39,707][123091] Updated weights for policy 0, policy_version 1027330 (0.0008) [2023-12-26 07:47:39,775][123091] Updated weights for policy 0, policy_version 1027340 (0.0009) [2023-12-26 07:47:40,536][123090] Updated weights for policy 1, policy_version 1020001 (0.0008) [2023-12-26 07:47:40,565][123091] Updated weights for policy 0, policy_version 1027350 (0.0007) [2023-12-26 07:47:40,589][123090] Updated weights for policy 1, policy_version 1020011 (0.0005) [2023-12-26 07:47:40,623][123091] Updated weights for policy 0, policy_version 1027360 (0.0007) [2023-12-26 07:47:40,639][123090] Updated weights for policy 1, policy_version 1020021 (0.0005) [2023-12-26 07:47:40,688][123091] Updated weights for policy 0, policy_version 1027370 (0.0006) [2023-12-26 07:47:40,697][123090] Updated weights for policy 1, policy_version 1020031 (0.0006) [2023-12-26 07:47:41,404][123090] Updated weights for policy 1, policy_version 1020041 (0.0008) [2023-12-26 07:47:41,475][123090] Updated weights for policy 1, policy_version 1020051 (0.0008) [2023-12-26 07:47:41,542][123090] Updated weights for policy 1, policy_version 1020061 (0.0008) [2023-12-26 07:47:41,577][123091] Updated weights for policy 0, policy_version 1027380 (0.0009) [2023-12-26 07:47:41,647][123091] Updated weights for policy 0, policy_version 1027390 (0.0010) [2023-12-26 07:47:41,711][123091] Updated weights for policy 0, policy_version 1027400 (0.0007) [2023-12-26 07:47:42,289][123090] Updated weights for policy 1, policy_version 1020071 (0.0009) [2023-12-26 07:47:42,364][123090] Updated weights for policy 1, policy_version 1020081 (0.0009) [2023-12-26 07:47:42,436][123090] Updated weights for policy 1, policy_version 1020091 (0.0009) [2023-12-26 07:47:42,564][123091] Updated weights for policy 0, policy_version 1027410 (0.0009) [2023-12-26 07:47:42,628][123091] Updated weights for policy 0, policy_version 1027420 (0.0008) [2023-12-26 07:47:42,692][123091] Updated weights for policy 0, policy_version 1027430 (0.0006) [2023-12-26 07:47:42,757][123091] Updated weights for policy 0, policy_version 1027440 (0.0005) [2023-12-26 07:47:43,308][123090] Updated weights for policy 1, policy_version 1020101 (0.0008) [2023-12-26 07:47:43,378][123090] Updated weights for policy 1, policy_version 1020111 (0.0007) [2023-12-26 07:47:43,444][123090] Updated weights for policy 1, policy_version 1020121 (0.0005) [2023-12-26 07:47:43,491][123091] Updated weights for policy 0, policy_version 1027450 (0.0011) [2023-12-26 07:47:43,549][123091] Updated weights for policy 0, policy_version 1027460 (0.0010) [2023-12-26 07:47:43,601][123091] Updated weights for policy 0, policy_version 1027470 (0.0011) [2023-12-26 07:47:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 524189696. Throughput: 0: 8920.2, 1: 8887.4. Samples: 524180084. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:43,785][121949] Avg episode reward: [(0, '6356.259'), (1, '6080.667')] [2023-12-26 07:47:44,170][123090] Updated weights for policy 1, policy_version 1020131 (0.0006) [2023-12-26 07:47:44,223][123090] Updated weights for policy 1, policy_version 1020141 (0.0010) [2023-12-26 07:47:44,277][123091] Updated weights for policy 0, policy_version 1027480 (0.0006) [2023-12-26 07:47:44,282][123090] Updated weights for policy 1, policy_version 1020151 (0.0008) [2023-12-26 07:47:44,336][123091] Updated weights for policy 0, policy_version 1027490 (0.0007) [2023-12-26 07:47:44,402][123091] Updated weights for policy 0, policy_version 1027500 (0.0011) [2023-12-26 07:47:45,153][123090] Updated weights for policy 1, policy_version 1020161 (0.0008) [2023-12-26 07:47:45,218][123090] Updated weights for policy 1, policy_version 1020171 (0.0011) [2023-12-26 07:47:45,226][123091] Updated weights for policy 0, policy_version 1027510 (0.0011) [2023-12-26 07:47:45,282][123090] Updated weights for policy 1, policy_version 1020181 (0.0011) [2023-12-26 07:47:45,291][123091] Updated weights for policy 0, policy_version 1027520 (0.0011) [2023-12-26 07:47:45,343][123090] Updated weights for policy 1, policy_version 1020191 (0.0011) [2023-12-26 07:47:45,354][123091] Updated weights for policy 0, policy_version 1027530 (0.0011) [2023-12-26 07:47:46,122][123090] Updated weights for policy 1, policy_version 1020201 (0.0006) [2023-12-26 07:47:46,174][123091] Updated weights for policy 0, policy_version 1027540 (0.0009) [2023-12-26 07:47:46,177][123090] Updated weights for policy 1, policy_version 1020211 (0.0005) [2023-12-26 07:47:46,234][123091] Updated weights for policy 0, policy_version 1027550 (0.0009) [2023-12-26 07:47:46,241][123090] Updated weights for policy 1, policy_version 1020221 (0.0006) [2023-12-26 07:47:46,300][123091] Updated weights for policy 0, policy_version 1027560 (0.0010) [2023-12-26 07:47:46,918][123090] Updated weights for policy 1, policy_version 1020231 (0.0005) [2023-12-26 07:47:46,973][123090] Updated weights for policy 1, policy_version 1020241 (0.0005) [2023-12-26 07:47:47,022][123090] Updated weights for policy 1, policy_version 1020251 (0.0005) [2023-12-26 07:47:47,029][123091] Updated weights for policy 0, policy_version 1027570 (0.0009) [2023-12-26 07:47:47,085][123091] Updated weights for policy 0, policy_version 1027580 (0.0005) [2023-12-26 07:47:47,157][123091] Updated weights for policy 0, policy_version 1027590 (0.0005) [2023-12-26 07:47:47,205][123091] Updated weights for policy 0, policy_version 1027600 (0.0006) [2023-12-26 07:47:47,769][123090] Updated weights for policy 1, policy_version 1020261 (0.0008) [2023-12-26 07:47:47,817][123090] Updated weights for policy 1, policy_version 1020271 (0.0010) [2023-12-26 07:47:47,868][123090] Updated weights for policy 1, policy_version 1020281 (0.0010) [2023-12-26 07:47:47,901][123091] Updated weights for policy 0, policy_version 1027610 (0.0006) [2023-12-26 07:47:47,966][123091] Updated weights for policy 0, policy_version 1027620 (0.0007) [2023-12-26 07:47:48,030][123091] Updated weights for policy 0, policy_version 1027630 (0.0009) [2023-12-26 07:47:48,737][123090] Updated weights for policy 1, policy_version 1020291 (0.0010) [2023-12-26 07:47:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 524271616. Throughput: 0: 8972.5, 1: 8906.1. Samples: 524289504. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:48,785][121949] Avg episode reward: [(0, '6337.547'), (1, '6076.754')] [2023-12-26 07:47:48,786][123090] Updated weights for policy 1, policy_version 1020301 (0.0010) [2023-12-26 07:47:48,805][123091] Updated weights for policy 0, policy_version 1027640 (0.0008) [2023-12-26 07:47:48,834][123090] Updated weights for policy 1, policy_version 1020311 (0.0010) [2023-12-26 07:47:48,867][123091] Updated weights for policy 0, policy_version 1027650 (0.0007) [2023-12-26 07:47:48,925][123091] Updated weights for policy 0, policy_version 1027660 (0.0008) [2023-12-26 07:47:49,676][123090] Updated weights for policy 1, policy_version 1020321 (0.0010) [2023-12-26 07:47:49,740][123091] Updated weights for policy 0, policy_version 1027670 (0.0009) [2023-12-26 07:47:49,746][123090] Updated weights for policy 1, policy_version 1020331 (0.0008) [2023-12-26 07:47:49,793][123091] Updated weights for policy 0, policy_version 1027680 (0.0007) [2023-12-26 07:47:49,817][123090] Updated weights for policy 1, policy_version 1020341 (0.0009) [2023-12-26 07:47:49,860][123091] Updated weights for policy 0, policy_version 1027690 (0.0008) [2023-12-26 07:47:49,883][123090] Updated weights for policy 1, policy_version 1020351 (0.0009) [2023-12-26 07:47:50,655][123091] Updated weights for policy 0, policy_version 1027700 (0.0008) [2023-12-26 07:47:50,679][123090] Updated weights for policy 1, policy_version 1020361 (0.0010) [2023-12-26 07:47:50,716][123091] Updated weights for policy 0, policy_version 1027710 (0.0006) [2023-12-26 07:47:50,738][123090] Updated weights for policy 1, policy_version 1020371 (0.0010) [2023-12-26 07:47:50,782][123091] Updated weights for policy 0, policy_version 1027720 (0.0007) [2023-12-26 07:47:50,805][123090] Updated weights for policy 1, policy_version 1020381 (0.0006) [2023-12-26 07:47:51,595][123091] Updated weights for policy 0, policy_version 1027730 (0.0006) [2023-12-26 07:47:51,642][123090] Updated weights for policy 1, policy_version 1020391 (0.0008) [2023-12-26 07:47:51,664][123091] Updated weights for policy 0, policy_version 1027740 (0.0007) [2023-12-26 07:47:51,712][123090] Updated weights for policy 1, policy_version 1020401 (0.0008) [2023-12-26 07:47:51,744][123091] Updated weights for policy 0, policy_version 1027750 (0.0009) [2023-12-26 07:47:51,782][123090] Updated weights for policy 1, policy_version 1020411 (0.0009) [2023-12-26 07:47:51,807][123091] Updated weights for policy 0, policy_version 1027760 (0.0007) [2023-12-26 07:47:52,560][123091] Updated weights for policy 0, policy_version 1027770 (0.0006) [2023-12-26 07:47:52,570][123090] Updated weights for policy 1, policy_version 1020421 (0.0010) [2023-12-26 07:47:52,617][123091] Updated weights for policy 0, policy_version 1027780 (0.0006) [2023-12-26 07:47:52,630][123090] Updated weights for policy 1, policy_version 1020431 (0.0010) [2023-12-26 07:47:52,680][123091] Updated weights for policy 0, policy_version 1027790 (0.0006) [2023-12-26 07:47:52,690][123090] Updated weights for policy 1, policy_version 1020441 (0.0010) [2023-12-26 07:47:53,372][123090] Updated weights for policy 1, policy_version 1020451 (0.0009) [2023-12-26 07:47:53,383][123091] Updated weights for policy 0, policy_version 1027800 (0.0010) [2023-12-26 07:47:53,427][123091] Updated weights for policy 0, policy_version 1027810 (0.0010) [2023-12-26 07:47:53,444][123090] Updated weights for policy 1, policy_version 1020461 (0.0006) [2023-12-26 07:47:53,482][123091] Updated weights for policy 0, policy_version 1027820 (0.0010) [2023-12-26 07:47:53,506][123090] Updated weights for policy 1, policy_version 1020471 (0.0010) [2023-12-26 07:47:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 524369920. Throughput: 0: 8986.9, 1: 8884.7. Samples: 524341460. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:53,785][121949] Avg episode reward: [(0, '6323.308'), (1, '6079.283')] [2023-12-26 07:47:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001020480_261242880.pth... [2023-12-26 07:47:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001027824_263127040.pth... [2023-12-26 07:47:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001019424_260972544.pth [2023-12-26 07:47:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001026768_262856704.pth [2023-12-26 07:47:54,154][123091] Updated weights for policy 0, policy_version 1027830 (0.0008) [2023-12-26 07:47:54,215][123091] Updated weights for policy 0, policy_version 1027840 (0.0009) [2023-12-26 07:47:54,264][123091] Updated weights for policy 0, policy_version 1027850 (0.0007) [2023-12-26 07:47:54,319][123090] Updated weights for policy 1, policy_version 1020481 (0.0010) [2023-12-26 07:47:54,381][123090] Updated weights for policy 1, policy_version 1020491 (0.0005) [2023-12-26 07:47:54,439][123090] Updated weights for policy 1, policy_version 1020501 (0.0005) [2023-12-26 07:47:54,514][123090] Updated weights for policy 1, policy_version 1020511 (0.0006) [2023-12-26 07:47:55,074][123091] Updated weights for policy 0, policy_version 1027860 (0.0007) [2023-12-26 07:47:55,142][123091] Updated weights for policy 0, policy_version 1027870 (0.0009) [2023-12-26 07:47:55,197][123091] Updated weights for policy 0, policy_version 1027880 (0.0009) [2023-12-26 07:47:55,254][123090] Updated weights for policy 1, policy_version 1020521 (0.0010) [2023-12-26 07:47:55,314][123090] Updated weights for policy 1, policy_version 1020531 (0.0011) [2023-12-26 07:47:55,379][123090] Updated weights for policy 1, policy_version 1020541 (0.0010) [2023-12-26 07:47:56,040][123090] Updated weights for policy 1, policy_version 1020551 (0.0006) [2023-12-26 07:47:56,061][123091] Updated weights for policy 0, policy_version 1027890 (0.0008) [2023-12-26 07:47:56,106][123090] Updated weights for policy 1, policy_version 1020561 (0.0005) [2023-12-26 07:47:56,117][123091] Updated weights for policy 0, policy_version 1027900 (0.0005) [2023-12-26 07:47:56,168][123090] Updated weights for policy 1, policy_version 1020571 (0.0005) [2023-12-26 07:47:56,171][123091] Updated weights for policy 0, policy_version 1027910 (0.0005) [2023-12-26 07:47:56,232][123091] Updated weights for policy 0, policy_version 1027920 (0.0005) [2023-12-26 07:47:56,822][123090] Updated weights for policy 1, policy_version 1020581 (0.0005) [2023-12-26 07:47:56,883][123090] Updated weights for policy 1, policy_version 1020591 (0.0005) [2023-12-26 07:47:56,892][123091] Updated weights for policy 0, policy_version 1027930 (0.0009) [2023-12-26 07:47:56,937][123090] Updated weights for policy 1, policy_version 1020601 (0.0005) [2023-12-26 07:47:56,953][123091] Updated weights for policy 0, policy_version 1027940 (0.0008) [2023-12-26 07:47:57,012][123091] Updated weights for policy 0, policy_version 1027950 (0.0009) [2023-12-26 07:47:57,565][123090] Updated weights for policy 1, policy_version 1020611 (0.0005) [2023-12-26 07:47:57,635][123090] Updated weights for policy 1, policy_version 1020621 (0.0006) [2023-12-26 07:47:57,695][123090] Updated weights for policy 1, policy_version 1020631 (0.0010) [2023-12-26 07:47:57,780][123091] Updated weights for policy 0, policy_version 1027960 (0.0008) [2023-12-26 07:47:57,828][123091] Updated weights for policy 0, policy_version 1027970 (0.0009) [2023-12-26 07:47:57,880][123091] Updated weights for policy 0, policy_version 1027980 (0.0008) [2023-12-26 07:47:58,516][123090] Updated weights for policy 1, policy_version 1020641 (0.0010) [2023-12-26 07:47:58,584][123090] Updated weights for policy 1, policy_version 1020651 (0.0011) [2023-12-26 07:47:58,651][123090] Updated weights for policy 1, policy_version 1020661 (0.0011) [2023-12-26 07:47:58,717][123090] Updated weights for policy 1, policy_version 1020671 (0.0011) [2023-12-26 07:47:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 524460032. Throughput: 0: 8982.4, 1: 8979.0. Samples: 524454152. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:47:58,785][121949] Avg episode reward: [(0, '6226.868'), (1, '6084.834')] [2023-12-26 07:47:58,811][123091] Updated weights for policy 0, policy_version 1027991 (0.0008) [2023-12-26 07:47:58,861][123091] Updated weights for policy 0, policy_version 1028001 (0.0005) [2023-12-26 07:47:58,920][123091] Updated weights for policy 0, policy_version 1028011 (0.0007) [2023-12-26 07:47:59,571][123090] Updated weights for policy 1, policy_version 1020681 (0.0008) [2023-12-26 07:47:59,640][123090] Updated weights for policy 1, policy_version 1020691 (0.0009) [2023-12-26 07:47:59,714][123090] Updated weights for policy 1, policy_version 1020701 (0.0009) [2023-12-26 07:47:59,738][123091] Updated weights for policy 0, policy_version 1028021 (0.0009) [2023-12-26 07:47:59,795][123091] Updated weights for policy 0, policy_version 1028031 (0.0011) [2023-12-26 07:47:59,863][123091] Updated weights for policy 0, policy_version 1028041 (0.0007) [2023-12-26 07:48:00,516][123091] Updated weights for policy 0, policy_version 1028051 (0.0007) [2023-12-26 07:48:00,572][123091] Updated weights for policy 0, policy_version 1028061 (0.0010) [2023-12-26 07:48:00,588][123090] Updated weights for policy 1, policy_version 1020711 (0.0005) [2023-12-26 07:48:00,633][123091] Updated weights for policy 0, policy_version 1028071 (0.0011) [2023-12-26 07:48:00,634][123090] Updated weights for policy 1, policy_version 1020721 (0.0009) [2023-12-26 07:48:00,682][123090] Updated weights for policy 1, policy_version 1020731 (0.0007) [2023-12-26 07:48:01,451][123091] Updated weights for policy 0, policy_version 1028081 (0.0010) [2023-12-26 07:48:01,516][123091] Updated weights for policy 0, policy_version 1028091 (0.0006) [2023-12-26 07:48:01,521][123090] Updated weights for policy 1, policy_version 1020741 (0.0010) [2023-12-26 07:48:01,580][123090] Updated weights for policy 1, policy_version 1020751 (0.0010) [2023-12-26 07:48:01,584][123091] Updated weights for policy 0, policy_version 1028101 (0.0005) [2023-12-26 07:48:01,640][123091] Updated weights for policy 0, policy_version 1028111 (0.0008) [2023-12-26 07:48:01,642][123090] Updated weights for policy 1, policy_version 1020761 (0.0010) [2023-12-26 07:48:02,351][123091] Updated weights for policy 0, policy_version 1028121 (0.0010) [2023-12-26 07:48:02,412][123090] Updated weights for policy 1, policy_version 1020771 (0.0010) [2023-12-26 07:48:02,419][123091] Updated weights for policy 0, policy_version 1028131 (0.0011) [2023-12-26 07:48:02,479][123090] Updated weights for policy 1, policy_version 1020781 (0.0010) [2023-12-26 07:48:02,483][123091] Updated weights for policy 0, policy_version 1028141 (0.0011) [2023-12-26 07:48:02,548][123090] Updated weights for policy 1, policy_version 1020791 (0.0010) [2023-12-26 07:48:03,219][123091] Updated weights for policy 0, policy_version 1028151 (0.0007) [2023-12-26 07:48:03,233][123090] Updated weights for policy 1, policy_version 1020801 (0.0010) [2023-12-26 07:48:03,264][123091] Updated weights for policy 0, policy_version 1028161 (0.0005) [2023-12-26 07:48:03,309][123090] Updated weights for policy 1, policy_version 1020811 (0.0005) [2023-12-26 07:48:03,311][123091] Updated weights for policy 0, policy_version 1028171 (0.0006) [2023-12-26 07:48:03,370][123090] Updated weights for policy 1, policy_version 1020821 (0.0005) [2023-12-26 07:48:03,431][123090] Updated weights for policy 1, policy_version 1020831 (0.0010) [2023-12-26 07:48:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 524550144. Throughput: 0: 9006.2, 1: 8933.3. Samples: 524561608. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:03,784][121949] Avg episode reward: [(0, '6285.155'), (1, '6058.730')] [2023-12-26 07:48:04,080][123091] Updated weights for policy 0, policy_version 1028181 (0.0010) [2023-12-26 07:48:04,081][123090] Updated weights for policy 1, policy_version 1020841 (0.0010) [2023-12-26 07:48:04,140][123091] Updated weights for policy 0, policy_version 1028191 (0.0010) [2023-12-26 07:48:04,148][123090] Updated weights for policy 1, policy_version 1020851 (0.0011) [2023-12-26 07:48:04,207][123091] Updated weights for policy 0, policy_version 1028201 (0.0010) [2023-12-26 07:48:04,208][123090] Updated weights for policy 1, policy_version 1020861 (0.0010) [2023-12-26 07:48:04,935][123091] Updated weights for policy 0, policy_version 1028211 (0.0009) [2023-12-26 07:48:05,006][123091] Updated weights for policy 0, policy_version 1028221 (0.0006) [2023-12-26 07:48:05,034][123090] Updated weights for policy 1, policy_version 1020871 (0.0010) [2023-12-26 07:48:05,067][123091] Updated weights for policy 0, policy_version 1028231 (0.0006) [2023-12-26 07:48:05,085][123090] Updated weights for policy 1, policy_version 1020881 (0.0010) [2023-12-26 07:48:05,137][123090] Updated weights for policy 1, policy_version 1020891 (0.0010) [2023-12-26 07:48:05,725][123091] Updated weights for policy 0, policy_version 1028241 (0.0005) [2023-12-26 07:48:05,777][123091] Updated weights for policy 0, policy_version 1028251 (0.0005) [2023-12-26 07:48:05,837][123091] Updated weights for policy 0, policy_version 1028261 (0.0007) [2023-12-26 07:48:05,891][123091] Updated weights for policy 0, policy_version 1028271 (0.0006) [2023-12-26 07:48:05,929][123090] Updated weights for policy 1, policy_version 1020901 (0.0010) [2023-12-26 07:48:05,990][123090] Updated weights for policy 1, policy_version 1020911 (0.0006) [2023-12-26 07:48:06,070][123090] Updated weights for policy 1, policy_version 1020921 (0.0009) [2023-12-26 07:48:06,604][123091] Updated weights for policy 0, policy_version 1028281 (0.0010) [2023-12-26 07:48:06,674][123091] Updated weights for policy 0, policy_version 1028291 (0.0010) [2023-12-26 07:48:06,744][123091] Updated weights for policy 0, policy_version 1028301 (0.0010) [2023-12-26 07:48:06,851][123090] Updated weights for policy 1, policy_version 1020931 (0.0010) [2023-12-26 07:48:06,906][123090] Updated weights for policy 1, policy_version 1020941 (0.0010) [2023-12-26 07:48:06,975][123090] Updated weights for policy 1, policy_version 1020951 (0.0006) [2023-12-26 07:48:07,547][123091] Updated weights for policy 0, policy_version 1028311 (0.0010) [2023-12-26 07:48:07,601][123091] Updated weights for policy 0, policy_version 1028321 (0.0010) [2023-12-26 07:48:07,640][123090] Updated weights for policy 1, policy_version 1020961 (0.0005) [2023-12-26 07:48:07,659][123091] Updated weights for policy 0, policy_version 1028331 (0.0010) [2023-12-26 07:48:07,703][123090] Updated weights for policy 1, policy_version 1020971 (0.0005) [2023-12-26 07:48:07,779][123090] Updated weights for policy 1, policy_version 1020981 (0.0005) [2023-12-26 07:48:07,847][123090] Updated weights for policy 1, policy_version 1020991 (0.0005) [2023-12-26 07:48:08,366][123091] Updated weights for policy 0, policy_version 1028341 (0.0009) [2023-12-26 07:48:08,429][123091] Updated weights for policy 0, policy_version 1028351 (0.0007) [2023-12-26 07:48:08,493][123091] Updated weights for policy 0, policy_version 1028361 (0.0005) [2023-12-26 07:48:08,592][123090] Updated weights for policy 1, policy_version 1021001 (0.0010) [2023-12-26 07:48:08,654][123090] Updated weights for policy 1, policy_version 1021011 (0.0010) [2023-12-26 07:48:08,725][123090] Updated weights for policy 1, policy_version 1021021 (0.0010) [2023-12-26 07:48:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 524648448. Throughput: 0: 9080.0, 1: 8955.9. Samples: 524617148. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:08,785][121949] Avg episode reward: [(0, '6273.455'), (1, '6050.935')] [2023-12-26 07:48:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001028368_263266304.pth... [2023-12-26 07:48:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001021024_261382144.pth... [2023-12-26 07:48:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001027312_262995968.pth [2023-12-26 07:48:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001019968_261111808.pth [2023-12-26 07:48:09,265][123091] Updated weights for policy 0, policy_version 1028371 (0.0008) [2023-12-26 07:48:09,331][123091] Updated weights for policy 0, policy_version 1028381 (0.0009) [2023-12-26 07:48:09,399][123091] Updated weights for policy 0, policy_version 1028391 (0.0010) [2023-12-26 07:48:09,441][123090] Updated weights for policy 1, policy_version 1021031 (0.0010) [2023-12-26 07:48:09,493][123090] Updated weights for policy 1, policy_version 1021041 (0.0006) [2023-12-26 07:48:09,553][123090] Updated weights for policy 1, policy_version 1021051 (0.0005) [2023-12-26 07:48:10,312][123091] Updated weights for policy 0, policy_version 1028401 (0.0009) [2023-12-26 07:48:10,334][123090] Updated weights for policy 1, policy_version 1021061 (0.0007) [2023-12-26 07:48:10,371][123091] Updated weights for policy 0, policy_version 1028411 (0.0008) [2023-12-26 07:48:10,399][123090] Updated weights for policy 1, policy_version 1021071 (0.0009) [2023-12-26 07:48:10,434][123091] Updated weights for policy 0, policy_version 1028421 (0.0007) [2023-12-26 07:48:10,463][123090] Updated weights for policy 1, policy_version 1021081 (0.0008) [2023-12-26 07:48:10,495][123091] Updated weights for policy 0, policy_version 1028431 (0.0008) [2023-12-26 07:48:11,206][123090] Updated weights for policy 1, policy_version 1021091 (0.0008) [2023-12-26 07:48:11,250][123091] Updated weights for policy 0, policy_version 1028441 (0.0008) [2023-12-26 07:48:11,273][123090] Updated weights for policy 1, policy_version 1021101 (0.0007) [2023-12-26 07:48:11,325][123091] Updated weights for policy 0, policy_version 1028451 (0.0009) [2023-12-26 07:48:11,341][123090] Updated weights for policy 1, policy_version 1021111 (0.0008) [2023-12-26 07:48:11,391][123091] Updated weights for policy 0, policy_version 1028461 (0.0008) [2023-12-26 07:48:12,079][123090] Updated weights for policy 1, policy_version 1021121 (0.0007) [2023-12-26 07:48:12,149][123090] Updated weights for policy 1, policy_version 1021131 (0.0007) [2023-12-26 07:48:12,178][123091] Updated weights for policy 0, policy_version 1028471 (0.0008) [2023-12-26 07:48:12,206][123090] Updated weights for policy 1, policy_version 1021141 (0.0007) [2023-12-26 07:48:12,233][123091] Updated weights for policy 0, policy_version 1028481 (0.0008) [2023-12-26 07:48:12,270][123090] Updated weights for policy 1, policy_version 1021151 (0.0006) [2023-12-26 07:48:12,292][123091] Updated weights for policy 0, policy_version 1028491 (0.0008) [2023-12-26 07:48:12,991][123090] Updated weights for policy 1, policy_version 1021161 (0.0005) [2023-12-26 07:48:13,052][123090] Updated weights for policy 1, policy_version 1021171 (0.0005) [2023-12-26 07:48:13,055][123091] Updated weights for policy 0, policy_version 1028501 (0.0007) [2023-12-26 07:48:13,112][123090] Updated weights for policy 1, policy_version 1021181 (0.0005) [2023-12-26 07:48:13,115][123091] Updated weights for policy 0, policy_version 1028511 (0.0005) [2023-12-26 07:48:13,174][123091] Updated weights for policy 0, policy_version 1028521 (0.0005) [2023-12-26 07:48:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 524730368. Throughput: 0: 9005.3, 1: 9070.8. Samples: 524725960. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:13,784][121949] Avg episode reward: [(0, '6220.491'), (1, '6047.716')] [2023-12-26 07:48:13,841][123091] Updated weights for policy 0, policy_version 1028531 (0.0007) [2023-12-26 07:48:13,898][123091] Updated weights for policy 0, policy_version 1028541 (0.0008) [2023-12-26 07:48:13,915][123090] Updated weights for policy 1, policy_version 1021191 (0.0007) [2023-12-26 07:48:13,958][123091] Updated weights for policy 0, policy_version 1028551 (0.0010) [2023-12-26 07:48:13,981][123090] Updated weights for policy 1, policy_version 1021201 (0.0009) [2023-12-26 07:48:14,045][123090] Updated weights for policy 1, policy_version 1021212 (0.0009) [2023-12-26 07:48:14,789][123091] Updated weights for policy 0, policy_version 1028561 (0.0008) [2023-12-26 07:48:14,847][123091] Updated weights for policy 0, policy_version 1028571 (0.0010) [2023-12-26 07:48:14,901][123090] Updated weights for policy 1, policy_version 1021222 (0.0010) [2023-12-26 07:48:14,909][123091] Updated weights for policy 0, policy_version 1028581 (0.0007) [2023-12-26 07:48:14,958][123090] Updated weights for policy 1, policy_version 1021232 (0.0009) [2023-12-26 07:48:14,959][123091] Updated weights for policy 0, policy_version 1028591 (0.0009) [2023-12-26 07:48:15,030][123090] Updated weights for policy 1, policy_version 1021243 (0.0009) [2023-12-26 07:48:15,761][123091] Updated weights for policy 0, policy_version 1028601 (0.0006) [2023-12-26 07:48:15,809][123091] Updated weights for policy 0, policy_version 1028611 (0.0005) [2023-12-26 07:48:15,888][123091] Updated weights for policy 0, policy_version 1028621 (0.0006) [2023-12-26 07:48:15,899][123090] Updated weights for policy 1, policy_version 1021253 (0.0010) [2023-12-26 07:48:15,959][123090] Updated weights for policy 1, policy_version 1021263 (0.0010) [2023-12-26 07:48:16,007][123090] Updated weights for policy 1, policy_version 1021273 (0.0010) [2023-12-26 07:48:16,626][123091] Updated weights for policy 0, policy_version 1028631 (0.0009) [2023-12-26 07:48:16,685][123091] Updated weights for policy 0, policy_version 1028641 (0.0011) [2023-12-26 07:48:16,747][123091] Updated weights for policy 0, policy_version 1028651 (0.0010) [2023-12-26 07:48:16,821][123090] Updated weights for policy 1, policy_version 1021283 (0.0006) [2023-12-26 07:48:16,889][123090] Updated weights for policy 1, policy_version 1021293 (0.0009) [2023-12-26 07:48:16,956][123090] Updated weights for policy 1, policy_version 1021303 (0.0008) [2023-12-26 07:48:17,536][123091] Updated weights for policy 0, policy_version 1028661 (0.0010) [2023-12-26 07:48:17,596][123091] Updated weights for policy 0, policy_version 1028671 (0.0009) [2023-12-26 07:48:17,653][123091] Updated weights for policy 0, policy_version 1028681 (0.0010) [2023-12-26 07:48:17,775][123090] Updated weights for policy 1, policy_version 1021313 (0.0009) [2023-12-26 07:48:17,828][123090] Updated weights for policy 1, policy_version 1021323 (0.0009) [2023-12-26 07:48:17,888][123090] Updated weights for policy 1, policy_version 1021333 (0.0010) [2023-12-26 07:48:17,941][123090] Updated weights for policy 1, policy_version 1021344 (0.0010) [2023-12-26 07:48:18,462][123091] Updated weights for policy 0, policy_version 1028691 (0.0010) [2023-12-26 07:48:18,532][123091] Updated weights for policy 0, policy_version 1028701 (0.0007) [2023-12-26 07:48:18,605][123091] Updated weights for policy 0, policy_version 1028711 (0.0006) [2023-12-26 07:48:18,731][123090] Updated weights for policy 1, policy_version 1021354 (0.0005) [2023-12-26 07:48:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 524820480. Throughput: 0: 9004.6, 1: 9040.3. Samples: 524833268. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:18,785][121949] Avg episode reward: [(0, '6160.310'), (1, '6048.666')] [2023-12-26 07:48:18,807][123090] Updated weights for policy 1, policy_version 1021364 (0.0005) [2023-12-26 07:48:18,881][123090] Updated weights for policy 1, policy_version 1021374 (0.0007) [2023-12-26 07:48:19,236][123091] Updated weights for policy 0, policy_version 1028721 (0.0006) [2023-12-26 07:48:19,296][123091] Updated weights for policy 0, policy_version 1028731 (0.0008) [2023-12-26 07:48:19,364][123091] Updated weights for policy 0, policy_version 1028741 (0.0008) [2023-12-26 07:48:19,430][123091] Updated weights for policy 0, policy_version 1028751 (0.0008) [2023-12-26 07:48:19,560][123090] Updated weights for policy 1, policy_version 1021384 (0.0009) [2023-12-26 07:48:19,624][123090] Updated weights for policy 1, policy_version 1021394 (0.0009) [2023-12-26 07:48:19,689][123090] Updated weights for policy 1, policy_version 1021404 (0.0009) [2023-12-26 07:48:20,263][123091] Updated weights for policy 0, policy_version 1028761 (0.0010) [2023-12-26 07:48:20,327][123091] Updated weights for policy 0, policy_version 1028771 (0.0011) [2023-12-26 07:48:20,386][123091] Updated weights for policy 0, policy_version 1028781 (0.0009) [2023-12-26 07:48:20,542][123090] Updated weights for policy 1, policy_version 1021414 (0.0009) [2023-12-26 07:48:20,601][123090] Updated weights for policy 1, policy_version 1021424 (0.0010) [2023-12-26 07:48:20,660][123090] Updated weights for policy 1, policy_version 1021434 (0.0009) [2023-12-26 07:48:21,266][123091] Updated weights for policy 0, policy_version 1028791 (0.0010) [2023-12-26 07:48:21,322][123091] Updated weights for policy 0, policy_version 1028801 (0.0009) [2023-12-26 07:48:21,395][123091] Updated weights for policy 0, policy_version 1028811 (0.0010) [2023-12-26 07:48:21,571][123090] Updated weights for policy 1, policy_version 1021444 (0.0009) [2023-12-26 07:48:21,641][123090] Updated weights for policy 1, policy_version 1021454 (0.0008) [2023-12-26 07:48:21,706][123090] Updated weights for policy 1, policy_version 1021464 (0.0008) [2023-12-26 07:48:22,321][123091] Updated weights for policy 0, policy_version 1028821 (0.0009) [2023-12-26 07:48:22,388][123091] Updated weights for policy 0, policy_version 1028831 (0.0009) [2023-12-26 07:48:22,455][123090] Updated weights for policy 1, policy_version 1021474 (0.0009) [2023-12-26 07:48:22,458][123091] Updated weights for policy 0, policy_version 1028841 (0.0008) [2023-12-26 07:48:22,519][123090] Updated weights for policy 1, policy_version 1021484 (0.0007) [2023-12-26 07:48:22,576][123090] Updated weights for policy 1, policy_version 1021494 (0.0006) [2023-12-26 07:48:22,637][123090] Updated weights for policy 1, policy_version 1021504 (0.0008) [2023-12-26 07:48:23,297][123091] Updated weights for policy 0, policy_version 1028851 (0.0008) [2023-12-26 07:48:23,362][123091] Updated weights for policy 0, policy_version 1028861 (0.0005) [2023-12-26 07:48:23,431][123091] Updated weights for policy 0, policy_version 1028871 (0.0007) [2023-12-26 07:48:23,465][123090] Updated weights for policy 1, policy_version 1021514 (0.0005) [2023-12-26 07:48:23,522][123090] Updated weights for policy 1, policy_version 1021524 (0.0005) [2023-12-26 07:48:23,578][123090] Updated weights for policy 1, policy_version 1021534 (0.0005) [2023-12-26 07:48:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 524910592. Throughput: 0: 8975.6, 1: 8976.6. Samples: 524885140. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:23,785][121949] Avg episode reward: [(0, '6223.607'), (1, '6067.892')] [2023-12-26 07:48:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001028880_263397376.pth... [2023-12-26 07:48:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001021536_261513216.pth... [2023-12-26 07:48:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001027824_263127040.pth [2023-12-26 07:48:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001020480_261242880.pth [2023-12-26 07:48:24,126][123091] Updated weights for policy 0, policy_version 1028881 (0.0007) [2023-12-26 07:48:24,193][123091] Updated weights for policy 0, policy_version 1028891 (0.0006) [2023-12-26 07:48:24,252][123091] Updated weights for policy 0, policy_version 1028901 (0.0006) [2023-12-26 07:48:24,280][123090] Updated weights for policy 1, policy_version 1021544 (0.0009) [2023-12-26 07:48:24,313][123091] Updated weights for policy 0, policy_version 1028911 (0.0009) [2023-12-26 07:48:24,338][123090] Updated weights for policy 1, policy_version 1021554 (0.0007) [2023-12-26 07:48:24,402][123090] Updated weights for policy 1, policy_version 1021564 (0.0005) [2023-12-26 07:48:25,043][123090] Updated weights for policy 1, policy_version 1021574 (0.0007) [2023-12-26 07:48:25,098][123090] Updated weights for policy 1, policy_version 1021584 (0.0010) [2023-12-26 07:48:25,149][123090] Updated weights for policy 1, policy_version 1021594 (0.0010) [2023-12-26 07:48:25,160][123091] Updated weights for policy 0, policy_version 1028921 (0.0006) [2023-12-26 07:48:25,218][123091] Updated weights for policy 0, policy_version 1028931 (0.0008) [2023-12-26 07:48:25,279][123091] Updated weights for policy 0, policy_version 1028941 (0.0009) [2023-12-26 07:48:25,974][123090] Updated weights for policy 1, policy_version 1021604 (0.0010) [2023-12-26 07:48:26,041][123090] Updated weights for policy 1, policy_version 1021614 (0.0011) [2023-12-26 07:48:26,065][123091] Updated weights for policy 0, policy_version 1028951 (0.0006) [2023-12-26 07:48:26,100][123090] Updated weights for policy 1, policy_version 1021624 (0.0010) [2023-12-26 07:48:26,115][123091] Updated weights for policy 0, policy_version 1028961 (0.0006) [2023-12-26 07:48:26,176][123091] Updated weights for policy 0, policy_version 1028971 (0.0007) [2023-12-26 07:48:26,834][123090] Updated weights for policy 1, policy_version 1021634 (0.0009) [2023-12-26 07:48:26,904][123090] Updated weights for policy 1, policy_version 1021644 (0.0009) [2023-12-26 07:48:26,954][123091] Updated weights for policy 0, policy_version 1028981 (0.0010) [2023-12-26 07:48:26,968][123090] Updated weights for policy 1, policy_version 1021654 (0.0011) [2023-12-26 07:48:27,005][123091] Updated weights for policy 0, policy_version 1028991 (0.0008) [2023-12-26 07:48:27,035][123090] Updated weights for policy 1, policy_version 1021664 (0.0011) [2023-12-26 07:48:27,063][123091] Updated weights for policy 0, policy_version 1029001 (0.0008) [2023-12-26 07:48:27,707][123091] Updated weights for policy 0, policy_version 1029011 (0.0009) [2023-12-26 07:48:27,734][123090] Updated weights for policy 1, policy_version 1021674 (0.0010) [2023-12-26 07:48:27,755][123091] Updated weights for policy 0, policy_version 1029021 (0.0007) [2023-12-26 07:48:27,793][123090] Updated weights for policy 1, policy_version 1021684 (0.0010) [2023-12-26 07:48:27,811][123091] Updated weights for policy 0, policy_version 1029031 (0.0005) [2023-12-26 07:48:27,850][123090] Updated weights for policy 1, policy_version 1021694 (0.0010) [2023-12-26 07:48:28,526][123091] Updated weights for policy 0, policy_version 1029041 (0.0005) [2023-12-26 07:48:28,574][123091] Updated weights for policy 0, policy_version 1029051 (0.0009) [2023-12-26 07:48:28,623][123091] Updated weights for policy 0, policy_version 1029061 (0.0009) [2023-12-26 07:48:28,664][123090] Updated weights for policy 1, policy_version 1021704 (0.0009) [2023-12-26 07:48:28,667][123091] Updated weights for policy 0, policy_version 1029071 (0.0007) [2023-12-26 07:48:28,711][123090] Updated weights for policy 1, policy_version 1021714 (0.0009) [2023-12-26 07:48:28,763][123090] Updated weights for policy 1, policy_version 1021725 (0.0010) [2023-12-26 07:48:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18295.4, 300 sec: 17855.8). Total num frames: 525008896. Throughput: 0: 9069.6, 1: 9038.7. Samples: 524994956. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:28,785][121949] Avg episode reward: [(0, '6246.144'), (1, '6070.762')] [2023-12-26 07:48:29,415][123091] Updated weights for policy 0, policy_version 1029081 (0.0010) [2023-12-26 07:48:29,466][123091] Updated weights for policy 0, policy_version 1029091 (0.0005) [2023-12-26 07:48:29,536][123091] Updated weights for policy 0, policy_version 1029101 (0.0006) [2023-12-26 07:48:29,608][123090] Updated weights for policy 1, policy_version 1021735 (0.0009) [2023-12-26 07:48:29,662][123090] Updated weights for policy 1, policy_version 1021745 (0.0009) [2023-12-26 07:48:29,711][123090] Updated weights for policy 1, policy_version 1021755 (0.0009) [2023-12-26 07:48:30,361][123091] Updated weights for policy 0, policy_version 1029111 (0.0008) [2023-12-26 07:48:30,424][123091] Updated weights for policy 0, policy_version 1029121 (0.0011) [2023-12-26 07:48:30,479][123091] Updated weights for policy 0, policy_version 1029131 (0.0010) [2023-12-26 07:48:30,526][123090] Updated weights for policy 1, policy_version 1021765 (0.0007) [2023-12-26 07:48:30,581][123090] Updated weights for policy 1, policy_version 1021775 (0.0006) [2023-12-26 07:48:30,633][123090] Updated weights for policy 1, policy_version 1021785 (0.0006) [2023-12-26 07:48:31,295][123091] Updated weights for policy 0, policy_version 1029141 (0.0011) [2023-12-26 07:48:31,301][123090] Updated weights for policy 1, policy_version 1021795 (0.0007) [2023-12-26 07:48:31,354][123091] Updated weights for policy 0, policy_version 1029151 (0.0010) [2023-12-26 07:48:31,366][123090] Updated weights for policy 1, policy_version 1021805 (0.0008) [2023-12-26 07:48:31,424][123091] Updated weights for policy 0, policy_version 1029161 (0.0010) [2023-12-26 07:48:31,430][123090] Updated weights for policy 1, policy_version 1021815 (0.0010) [2023-12-26 07:48:32,183][123090] Updated weights for policy 1, policy_version 1021825 (0.0009) [2023-12-26 07:48:32,250][123091] Updated weights for policy 0, policy_version 1029171 (0.0008) [2023-12-26 07:48:32,250][123090] Updated weights for policy 1, policy_version 1021835 (0.0011) [2023-12-26 07:48:32,310][123091] Updated weights for policy 0, policy_version 1029181 (0.0008) [2023-12-26 07:48:32,316][123090] Updated weights for policy 1, policy_version 1021845 (0.0010) [2023-12-26 07:48:32,377][123091] Updated weights for policy 0, policy_version 1029191 (0.0008) [2023-12-26 07:48:32,383][123090] Updated weights for policy 1, policy_version 1021855 (0.0010) [2023-12-26 07:48:33,117][123090] Updated weights for policy 1, policy_version 1021865 (0.0006) [2023-12-26 07:48:33,173][123090] Updated weights for policy 1, policy_version 1021875 (0.0005) [2023-12-26 07:48:33,200][123091] Updated weights for policy 0, policy_version 1029201 (0.0008) [2023-12-26 07:48:33,230][123090] Updated weights for policy 1, policy_version 1021885 (0.0007) [2023-12-26 07:48:33,264][123091] Updated weights for policy 0, policy_version 1029211 (0.0005) [2023-12-26 07:48:33,330][123091] Updated weights for policy 0, policy_version 1029221 (0.0005) [2023-12-26 07:48:33,397][123091] Updated weights for policy 0, policy_version 1029231 (0.0005) [2023-12-26 07:48:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 525090816. Throughput: 0: 9035.9, 1: 9069.2. Samples: 525104236. Policy #0 lag: (min: 4.0, avg: 19.5, max: 36.0) [2023-12-26 07:48:33,785][121949] Avg episode reward: [(0, '6201.034'), (1, '6071.408')] [2023-12-26 07:48:33,900][123090] Updated weights for policy 1, policy_version 1021895 (0.0007) [2023-12-26 07:48:33,956][123090] Updated weights for policy 1, policy_version 1021905 (0.0006) [2023-12-26 07:48:34,007][123090] Updated weights for policy 1, policy_version 1021915 (0.0007) [2023-12-26 07:48:34,047][123091] Updated weights for policy 0, policy_version 1029241 (0.0005) [2023-12-26 07:48:34,095][123091] Updated weights for policy 0, policy_version 1029251 (0.0005) [2023-12-26 07:48:34,149][123091] Updated weights for policy 0, policy_version 1029261 (0.0006) [2023-12-26 07:48:34,714][123090] Updated weights for policy 1, policy_version 1021925 (0.0008) [2023-12-26 07:48:34,780][123090] Updated weights for policy 1, policy_version 1021935 (0.0010) [2023-12-26 07:48:34,839][123090] Updated weights for policy 1, policy_version 1021945 (0.0010) [2023-12-26 07:48:34,960][123091] Updated weights for policy 0, policy_version 1029271 (0.0008) [2023-12-26 07:48:35,034][123091] Updated weights for policy 0, policy_version 1029281 (0.0006) [2023-12-26 07:48:35,095][123091] Updated weights for policy 0, policy_version 1029291 (0.0005) [2023-12-26 07:48:35,630][123090] Updated weights for policy 1, policy_version 1021955 (0.0009) [2023-12-26 07:48:35,699][123090] Updated weights for policy 1, policy_version 1021965 (0.0005) [2023-12-26 07:48:35,731][123091] Updated weights for policy 0, policy_version 1029301 (0.0008) [2023-12-26 07:48:35,759][123090] Updated weights for policy 1, policy_version 1021975 (0.0007) [2023-12-26 07:48:35,781][123091] Updated weights for policy 0, policy_version 1029311 (0.0010) [2023-12-26 07:48:35,829][123091] Updated weights for policy 0, policy_version 1029321 (0.0010) [2023-12-26 07:48:36,434][123090] Updated weights for policy 1, policy_version 1021985 (0.0008) [2023-12-26 07:48:36,500][123090] Updated weights for policy 1, policy_version 1021995 (0.0006) [2023-12-26 07:48:36,563][123090] Updated weights for policy 1, policy_version 1022005 (0.0008) [2023-12-26 07:48:36,589][123091] Updated weights for policy 0, policy_version 1029331 (0.0010) [2023-12-26 07:48:36,627][123090] Updated weights for policy 1, policy_version 1022015 (0.0008) [2023-12-26 07:48:36,659][123091] Updated weights for policy 0, policy_version 1029341 (0.0010) [2023-12-26 07:48:36,730][123091] Updated weights for policy 0, policy_version 1029351 (0.0010) [2023-12-26 07:48:37,452][123090] Updated weights for policy 1, policy_version 1022025 (0.0008) [2023-12-26 07:48:37,510][123090] Updated weights for policy 1, policy_version 1022035 (0.0009) [2023-12-26 07:48:37,546][123091] Updated weights for policy 0, policy_version 1029361 (0.0011) [2023-12-26 07:48:37,562][123090] Updated weights for policy 1, policy_version 1022045 (0.0008) [2023-12-26 07:48:37,614][123091] Updated weights for policy 0, policy_version 1029371 (0.0011) [2023-12-26 07:48:37,673][123091] Updated weights for policy 0, policy_version 1029381 (0.0011) [2023-12-26 07:48:37,748][123091] Updated weights for policy 0, policy_version 1029391 (0.0011) [2023-12-26 07:48:38,423][123090] Updated weights for policy 1, policy_version 1022055 (0.0010) [2023-12-26 07:48:38,471][123090] Updated weights for policy 1, policy_version 1022065 (0.0010) [2023-12-26 07:48:38,519][123090] Updated weights for policy 1, policy_version 1022075 (0.0010) [2023-12-26 07:48:38,532][123091] Updated weights for policy 0, policy_version 1029401 (0.0008) [2023-12-26 07:48:38,592][123091] Updated weights for policy 0, policy_version 1029411 (0.0007) [2023-12-26 07:48:38,645][123091] Updated weights for policy 0, policy_version 1029421 (0.0006) [2023-12-26 07:48:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18159.0, 300 sec: 17883.5). Total num frames: 525189120. Throughput: 0: 9101.8, 1: 9128.4. Samples: 525161812. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:48:38,785][121949] Avg episode reward: [(0, '6142.783'), (1, '6038.919')] [2023-12-26 07:48:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001029424_263536640.pth... [2023-12-26 07:48:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001022080_261652480.pth... [2023-12-26 07:48:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001028368_263266304.pth [2023-12-26 07:48:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001021024_261382144.pth [2023-12-26 07:48:39,339][123090] Updated weights for policy 1, policy_version 1022085 (0.0010) [2023-12-26 07:48:39,424][123090] Updated weights for policy 1, policy_version 1022095 (0.0009) [2023-12-26 07:48:39,438][123091] Updated weights for policy 0, policy_version 1029431 (0.0008) [2023-12-26 07:48:39,490][123090] Updated weights for policy 1, policy_version 1022105 (0.0006) [2023-12-26 07:48:39,496][123091] Updated weights for policy 0, policy_version 1029441 (0.0010) [2023-12-26 07:48:39,551][123091] Updated weights for policy 0, policy_version 1029451 (0.0007) [2023-12-26 07:48:40,327][123090] Updated weights for policy 1, policy_version 1022115 (0.0010) [2023-12-26 07:48:40,401][123090] Updated weights for policy 1, policy_version 1022125 (0.0007) [2023-12-26 07:48:40,449][123091] Updated weights for policy 0, policy_version 1029461 (0.0010) [2023-12-26 07:48:40,470][123090] Updated weights for policy 1, policy_version 1022135 (0.0006) [2023-12-26 07:48:40,509][123091] Updated weights for policy 0, policy_version 1029471 (0.0011) [2023-12-26 07:48:40,581][123091] Updated weights for policy 0, policy_version 1029481 (0.0010) [2023-12-26 07:48:41,097][123090] Updated weights for policy 1, policy_version 1022145 (0.0007) [2023-12-26 07:48:41,162][123090] Updated weights for policy 1, policy_version 1022155 (0.0010) [2023-12-26 07:48:41,233][123090] Updated weights for policy 1, policy_version 1022165 (0.0006) [2023-12-26 07:48:41,306][123090] Updated weights for policy 1, policy_version 1022175 (0.0009) [2023-12-26 07:48:41,332][123091] Updated weights for policy 0, policy_version 1029491 (0.0010) [2023-12-26 07:48:41,404][123091] Updated weights for policy 0, policy_version 1029501 (0.0009) [2023-12-26 07:48:41,469][123091] Updated weights for policy 0, policy_version 1029511 (0.0006) [2023-12-26 07:48:42,094][123090] Updated weights for policy 1, policy_version 1022185 (0.0008) [2023-12-26 07:48:42,148][123090] Updated weights for policy 1, policy_version 1022195 (0.0006) [2023-12-26 07:48:42,206][123090] Updated weights for policy 1, policy_version 1022205 (0.0005) [2023-12-26 07:48:42,338][123091] Updated weights for policy 0, policy_version 1029521 (0.0007) [2023-12-26 07:48:42,419][123091] Updated weights for policy 0, policy_version 1029531 (0.0010) [2023-12-26 07:48:42,482][123091] Updated weights for policy 0, policy_version 1029541 (0.0010) [2023-12-26 07:48:42,548][123091] Updated weights for policy 0, policy_version 1029551 (0.0010) [2023-12-26 07:48:42,932][123090] Updated weights for policy 1, policy_version 1022215 (0.0008) [2023-12-26 07:48:42,999][123090] Updated weights for policy 1, policy_version 1022225 (0.0009) [2023-12-26 07:48:43,064][123090] Updated weights for policy 1, policy_version 1022235 (0.0010) [2023-12-26 07:48:43,427][123091] Updated weights for policy 0, policy_version 1029561 (0.0009) [2023-12-26 07:48:43,492][123091] Updated weights for policy 0, policy_version 1029571 (0.0010) [2023-12-26 07:48:43,558][123091] Updated weights for policy 0, policy_version 1029581 (0.0010) [2023-12-26 07:48:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 525271040. Throughput: 0: 9009.8, 1: 9018.8. Samples: 525265436. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:48:43,785][121949] Avg episode reward: [(0, '6152.263'), (1, '6038.574')] [2023-12-26 07:48:43,887][123090] Updated weights for policy 1, policy_version 1022245 (0.0009) [2023-12-26 07:48:43,960][123090] Updated weights for policy 1, policy_version 1022255 (0.0010) [2023-12-26 07:48:44,021][123090] Updated weights for policy 1, policy_version 1022265 (0.0009) [2023-12-26 07:48:44,230][123091] Updated weights for policy 0, policy_version 1029591 (0.0006) [2023-12-26 07:48:44,291][123091] Updated weights for policy 0, policy_version 1029601 (0.0005) [2023-12-26 07:48:44,363][123091] Updated weights for policy 0, policy_version 1029611 (0.0008) [2023-12-26 07:48:44,781][123090] Updated weights for policy 1, policy_version 1022275 (0.0009) [2023-12-26 07:48:44,849][123090] Updated weights for policy 1, policy_version 1022285 (0.0008) [2023-12-26 07:48:44,906][123090] Updated weights for policy 1, policy_version 1022295 (0.0009) [2023-12-26 07:48:45,128][123091] Updated weights for policy 0, policy_version 1029621 (0.0008) [2023-12-26 07:48:45,201][123091] Updated weights for policy 0, policy_version 1029631 (0.0006) [2023-12-26 07:48:45,264][123091] Updated weights for policy 0, policy_version 1029641 (0.0009) [2023-12-26 07:48:45,755][123090] Updated weights for policy 1, policy_version 1022305 (0.0010) [2023-12-26 07:48:45,807][123090] Updated weights for policy 1, policy_version 1022315 (0.0009) [2023-12-26 07:48:45,863][123090] Updated weights for policy 1, policy_version 1022325 (0.0008) [2023-12-26 07:48:45,915][123090] Updated weights for policy 1, policy_version 1022335 (0.0009) [2023-12-26 07:48:46,039][123091] Updated weights for policy 0, policy_version 1029651 (0.0010) [2023-12-26 07:48:46,087][123091] Updated weights for policy 0, policy_version 1029661 (0.0010) [2023-12-26 07:48:46,153][123091] Updated weights for policy 0, policy_version 1029671 (0.0010) [2023-12-26 07:48:46,740][123090] Updated weights for policy 1, policy_version 1022345 (0.0008) [2023-12-26 07:48:46,798][123090] Updated weights for policy 1, policy_version 1022355 (0.0008) [2023-12-26 07:48:46,851][123090] Updated weights for policy 1, policy_version 1022365 (0.0005) [2023-12-26 07:48:46,961][123091] Updated weights for policy 0, policy_version 1029681 (0.0010) [2023-12-26 07:48:47,031][123091] Updated weights for policy 0, policy_version 1029691 (0.0007) [2023-12-26 07:48:47,093][123091] Updated weights for policy 0, policy_version 1029701 (0.0010) [2023-12-26 07:48:47,152][123091] Updated weights for policy 0, policy_version 1029711 (0.0011) [2023-12-26 07:48:47,622][123090] Updated weights for policy 1, policy_version 1022375 (0.0005) [2023-12-26 07:48:47,683][123090] Updated weights for policy 1, policy_version 1022385 (0.0005) [2023-12-26 07:48:47,739][123090] Updated weights for policy 1, policy_version 1022395 (0.0007) [2023-12-26 07:48:47,916][123091] Updated weights for policy 0, policy_version 1029721 (0.0010) [2023-12-26 07:48:47,968][123091] Updated weights for policy 0, policy_version 1029731 (0.0010) [2023-12-26 07:48:48,020][123091] Updated weights for policy 0, policy_version 1029741 (0.0011) [2023-12-26 07:48:48,552][123090] Updated weights for policy 1, policy_version 1022405 (0.0009) [2023-12-26 07:48:48,613][123090] Updated weights for policy 1, policy_version 1022415 (0.0009) [2023-12-26 07:48:48,671][123090] Updated weights for policy 1, policy_version 1022425 (0.0009) [2023-12-26 07:48:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 525361152. Throughput: 0: 8985.1, 1: 9026.4. Samples: 525372124. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:48:48,785][121949] Avg episode reward: [(0, '6274.362'), (1, '6074.175')] [2023-12-26 07:48:48,867][123091] Updated weights for policy 0, policy_version 1029751 (0.0011) [2023-12-26 07:48:48,934][123091] Updated weights for policy 0, policy_version 1029761 (0.0011) [2023-12-26 07:48:49,005][123091] Updated weights for policy 0, policy_version 1029771 (0.0011) [2023-12-26 07:48:49,479][123090] Updated weights for policy 1, policy_version 1022435 (0.0008) [2023-12-26 07:48:49,548][123090] Updated weights for policy 1, policy_version 1022445 (0.0006) [2023-12-26 07:48:49,605][123090] Updated weights for policy 1, policy_version 1022455 (0.0010) [2023-12-26 07:48:49,823][123091] Updated weights for policy 0, policy_version 1029781 (0.0009) [2023-12-26 07:48:49,898][123091] Updated weights for policy 0, policy_version 1029791 (0.0011) [2023-12-26 07:48:49,966][123091] Updated weights for policy 0, policy_version 1029801 (0.0008) [2023-12-26 07:48:50,308][123090] Updated weights for policy 1, policy_version 1022465 (0.0010) [2023-12-26 07:48:50,372][123090] Updated weights for policy 1, policy_version 1022475 (0.0006) [2023-12-26 07:48:50,432][123090] Updated weights for policy 1, policy_version 1022485 (0.0006) [2023-12-26 07:48:50,506][123090] Updated weights for policy 1, policy_version 1022495 (0.0007) [2023-12-26 07:48:50,668][123091] Updated weights for policy 0, policy_version 1029811 (0.0006) [2023-12-26 07:48:50,738][123091] Updated weights for policy 0, policy_version 1029821 (0.0006) [2023-12-26 07:48:50,796][123091] Updated weights for policy 0, policy_version 1029831 (0.0006) [2023-12-26 07:48:51,356][123090] Updated weights for policy 1, policy_version 1022505 (0.0007) [2023-12-26 07:48:51,424][123090] Updated weights for policy 1, policy_version 1022515 (0.0008) [2023-12-26 07:48:51,481][123090] Updated weights for policy 1, policy_version 1022525 (0.0009) [2023-12-26 07:48:51,544][123091] Updated weights for policy 0, policy_version 1029841 (0.0006) [2023-12-26 07:48:51,609][123091] Updated weights for policy 0, policy_version 1029851 (0.0006) [2023-12-26 07:48:51,673][123091] Updated weights for policy 0, policy_version 1029861 (0.0008) [2023-12-26 07:48:51,746][123091] Updated weights for policy 0, policy_version 1029871 (0.0011) [2023-12-26 07:48:52,330][123090] Updated weights for policy 1, policy_version 1022535 (0.0009) [2023-12-26 07:48:52,397][123090] Updated weights for policy 1, policy_version 1022545 (0.0009) [2023-12-26 07:48:52,463][123090] Updated weights for policy 1, policy_version 1022555 (0.0009) [2023-12-26 07:48:52,543][123091] Updated weights for policy 0, policy_version 1029881 (0.0006) [2023-12-26 07:48:52,620][123091] Updated weights for policy 0, policy_version 1029891 (0.0006) [2023-12-26 07:48:52,684][123091] Updated weights for policy 0, policy_version 1029901 (0.0005) [2023-12-26 07:48:53,216][123090] Updated weights for policy 1, policy_version 1022565 (0.0009) [2023-12-26 07:48:53,282][123090] Updated weights for policy 1, policy_version 1022575 (0.0009) [2023-12-26 07:48:53,315][123091] Updated weights for policy 0, policy_version 1029911 (0.0008) [2023-12-26 07:48:53,341][123090] Updated weights for policy 1, policy_version 1022585 (0.0008) [2023-12-26 07:48:53,384][123091] Updated weights for policy 0, policy_version 1029921 (0.0009) [2023-12-26 07:48:53,443][123091] Updated weights for policy 0, policy_version 1029931 (0.0009) [2023-12-26 07:48:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17856.0). Total num frames: 525451264. Throughput: 0: 8946.6, 1: 9013.5. Samples: 525425352. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:48:53,785][121949] Avg episode reward: [(0, '6279.572'), (1, '6081.056')] [2023-12-26 07:48:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001022592_261783552.pth... [2023-12-26 07:48:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001029936_263667712.pth... [2023-12-26 07:48:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001021536_261513216.pth [2023-12-26 07:48:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001028880_263397376.pth [2023-12-26 07:48:54,032][123090] Updated weights for policy 1, policy_version 1022595 (0.0007) [2023-12-26 07:48:54,087][123090] Updated weights for policy 1, policy_version 1022605 (0.0006) [2023-12-26 07:48:54,121][123091] Updated weights for policy 0, policy_version 1029941 (0.0008) [2023-12-26 07:48:54,145][123090] Updated weights for policy 1, policy_version 1022615 (0.0005) [2023-12-26 07:48:54,193][123091] Updated weights for policy 0, policy_version 1029951 (0.0006) [2023-12-26 07:48:54,251][123091] Updated weights for policy 0, policy_version 1029961 (0.0007) [2023-12-26 07:48:54,871][123091] Updated weights for policy 0, policy_version 1029971 (0.0006) [2023-12-26 07:48:54,931][123091] Updated weights for policy 0, policy_version 1029981 (0.0006) [2023-12-26 07:48:54,985][123091] Updated weights for policy 0, policy_version 1029991 (0.0005) [2023-12-26 07:48:55,021][123090] Updated weights for policy 1, policy_version 1022625 (0.0006) [2023-12-26 07:48:55,093][123090] Updated weights for policy 1, policy_version 1022635 (0.0008) [2023-12-26 07:48:55,158][123090] Updated weights for policy 1, policy_version 1022645 (0.0009) [2023-12-26 07:48:55,221][123090] Updated weights for policy 1, policy_version 1022655 (0.0010) [2023-12-26 07:48:55,760][123091] Updated weights for policy 0, policy_version 1030001 (0.0006) [2023-12-26 07:48:55,817][123091] Updated weights for policy 0, policy_version 1030011 (0.0010) [2023-12-26 07:48:55,877][123091] Updated weights for policy 0, policy_version 1030021 (0.0010) [2023-12-26 07:48:55,940][123091] Updated weights for policy 0, policy_version 1030031 (0.0011) [2023-12-26 07:48:55,992][123090] Updated weights for policy 1, policy_version 1022665 (0.0006) [2023-12-26 07:48:56,037][123090] Updated weights for policy 1, policy_version 1022675 (0.0005) [2023-12-26 07:48:56,083][123090] Updated weights for policy 1, policy_version 1022685 (0.0008) [2023-12-26 07:48:56,635][123091] Updated weights for policy 0, policy_version 1030041 (0.0006) [2023-12-26 07:48:56,684][123091] Updated weights for policy 0, policy_version 1030051 (0.0005) [2023-12-26 07:48:56,731][123091] Updated weights for policy 0, policy_version 1030061 (0.0005) [2023-12-26 07:48:56,780][123090] Updated weights for policy 1, policy_version 1022695 (0.0005) [2023-12-26 07:48:56,829][123090] Updated weights for policy 1, policy_version 1022705 (0.0005) [2023-12-26 07:48:56,878][123090] Updated weights for policy 1, policy_version 1022715 (0.0005) [2023-12-26 07:48:57,410][123091] Updated weights for policy 0, policy_version 1030071 (0.0009) [2023-12-26 07:48:57,463][123091] Updated weights for policy 0, policy_version 1030081 (0.0010) [2023-12-26 07:48:57,537][123091] Updated weights for policy 0, policy_version 1030091 (0.0005) [2023-12-26 07:48:57,568][123090] Updated weights for policy 1, policy_version 1022725 (0.0005) [2023-12-26 07:48:57,621][123090] Updated weights for policy 1, policy_version 1022735 (0.0005) [2023-12-26 07:48:57,667][123090] Updated weights for policy 1, policy_version 1022745 (0.0005) [2023-12-26 07:48:58,230][123091] Updated weights for policy 0, policy_version 1030101 (0.0007) [2023-12-26 07:48:58,298][123091] Updated weights for policy 0, policy_version 1030111 (0.0010) [2023-12-26 07:48:58,369][123091] Updated weights for policy 0, policy_version 1030121 (0.0010) [2023-12-26 07:48:58,446][123090] Updated weights for policy 1, policy_version 1022755 (0.0006) [2023-12-26 07:48:58,516][123090] Updated weights for policy 1, policy_version 1022765 (0.0009) [2023-12-26 07:48:58,595][123090] Updated weights for policy 1, policy_version 1022775 (0.0008) [2023-12-26 07:48:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 525549568. Throughput: 0: 9062.9, 1: 9013.8. Samples: 525539412. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:48:58,785][121949] Avg episode reward: [(0, '6167.627'), (1, '6047.326')] [2023-12-26 07:48:59,163][123091] Updated weights for policy 0, policy_version 1030131 (0.0009) [2023-12-26 07:48:59,231][123091] Updated weights for policy 0, policy_version 1030141 (0.0008) [2023-12-26 07:48:59,291][123091] Updated weights for policy 0, policy_version 1030151 (0.0009) [2023-12-26 07:48:59,392][123090] Updated weights for policy 1, policy_version 1022785 (0.0007) [2023-12-26 07:48:59,439][123090] Updated weights for policy 1, policy_version 1022795 (0.0008) [2023-12-26 07:48:59,500][123090] Updated weights for policy 1, policy_version 1022805 (0.0008) [2023-12-26 07:48:59,574][123090] Updated weights for policy 1, policy_version 1022815 (0.0006) [2023-12-26 07:49:00,047][123091] Updated weights for policy 0, policy_version 1030161 (0.0009) [2023-12-26 07:49:00,107][123091] Updated weights for policy 0, policy_version 1030171 (0.0009) [2023-12-26 07:49:00,166][123091] Updated weights for policy 0, policy_version 1030181 (0.0010) [2023-12-26 07:49:00,228][123091] Updated weights for policy 0, policy_version 1030191 (0.0009) [2023-12-26 07:49:00,298][123090] Updated weights for policy 1, policy_version 1022825 (0.0009) [2023-12-26 07:49:00,349][123090] Updated weights for policy 1, policy_version 1022835 (0.0009) [2023-12-26 07:49:00,415][123090] Updated weights for policy 1, policy_version 1022845 (0.0008) [2023-12-26 07:49:01,074][123091] Updated weights for policy 0, policy_version 1030201 (0.0010) [2023-12-26 07:49:01,134][123091] Updated weights for policy 0, policy_version 1030211 (0.0010) [2023-12-26 07:49:01,198][123090] Updated weights for policy 1, policy_version 1022855 (0.0006) [2023-12-26 07:49:01,201][123091] Updated weights for policy 0, policy_version 1030221 (0.0008) [2023-12-26 07:49:01,269][123090] Updated weights for policy 1, policy_version 1022865 (0.0008) [2023-12-26 07:49:01,333][123090] Updated weights for policy 1, policy_version 1022875 (0.0009) [2023-12-26 07:49:02,019][123091] Updated weights for policy 0, policy_version 1030231 (0.0010) [2023-12-26 07:49:02,075][123091] Updated weights for policy 0, policy_version 1030241 (0.0008) [2023-12-26 07:49:02,144][123091] Updated weights for policy 0, policy_version 1030251 (0.0010) [2023-12-26 07:49:02,180][123090] Updated weights for policy 1, policy_version 1022885 (0.0007) [2023-12-26 07:49:02,252][123090] Updated weights for policy 1, policy_version 1022895 (0.0006) [2023-12-26 07:49:02,319][123090] Updated weights for policy 1, policy_version 1022905 (0.0010) [2023-12-26 07:49:03,003][123091] Updated weights for policy 0, policy_version 1030261 (0.0010) [2023-12-26 07:49:03,047][123090] Updated weights for policy 1, policy_version 1022915 (0.0009) [2023-12-26 07:49:03,061][123091] Updated weights for policy 0, policy_version 1030271 (0.0007) [2023-12-26 07:49:03,123][123091] Updated weights for policy 0, policy_version 1030281 (0.0006) [2023-12-26 07:49:03,124][123090] Updated weights for policy 1, policy_version 1022925 (0.0005) [2023-12-26 07:49:03,197][123090] Updated weights for policy 1, policy_version 1022935 (0.0005) [2023-12-26 07:49:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 525631488. Throughput: 0: 9005.1, 1: 9073.5. Samples: 525646808. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:03,785][121949] Avg episode reward: [(0, '6097.467'), (1, '5962.252')] [2023-12-26 07:49:03,872][123090] Updated weights for policy 1, policy_version 1022945 (0.0006) [2023-12-26 07:49:03,930][123090] Updated weights for policy 1, policy_version 1022955 (0.0009) [2023-12-26 07:49:03,954][123091] Updated weights for policy 0, policy_version 1030291 (0.0007) [2023-12-26 07:49:03,991][123090] Updated weights for policy 1, policy_version 1022965 (0.0008) [2023-12-26 07:49:04,022][123091] Updated weights for policy 0, policy_version 1030301 (0.0008) [2023-12-26 07:49:04,048][123090] Updated weights for policy 1, policy_version 1022975 (0.0009) [2023-12-26 07:49:04,088][123091] Updated weights for policy 0, policy_version 1030311 (0.0009) [2023-12-26 07:49:04,905][123090] Updated weights for policy 1, policy_version 1022985 (0.0010) [2023-12-26 07:49:04,928][123091] Updated weights for policy 0, policy_version 1030321 (0.0009) [2023-12-26 07:49:04,954][123090] Updated weights for policy 1, policy_version 1022995 (0.0010) [2023-12-26 07:49:04,985][123091] Updated weights for policy 0, policy_version 1030331 (0.0007) [2023-12-26 07:49:05,000][123090] Updated weights for policy 1, policy_version 1023005 (0.0006) [2023-12-26 07:49:05,046][123091] Updated weights for policy 0, policy_version 1030341 (0.0009) [2023-12-26 07:49:05,091][123091] Updated weights for policy 0, policy_version 1030351 (0.0008) [2023-12-26 07:49:05,838][123090] Updated weights for policy 1, policy_version 1023015 (0.0008) [2023-12-26 07:49:05,901][123090] Updated weights for policy 1, policy_version 1023025 (0.0009) [2023-12-26 07:49:05,930][123091] Updated weights for policy 0, policy_version 1030361 (0.0008) [2023-12-26 07:49:05,964][123090] Updated weights for policy 1, policy_version 1023035 (0.0007) [2023-12-26 07:49:05,987][123091] Updated weights for policy 0, policy_version 1030371 (0.0010) [2023-12-26 07:49:06,037][123091] Updated weights for policy 0, policy_version 1030382 (0.0010) [2023-12-26 07:49:06,830][123091] Updated weights for policy 0, policy_version 1030392 (0.0008) [2023-12-26 07:49:06,836][123090] Updated weights for policy 1, policy_version 1023045 (0.0007) [2023-12-26 07:49:06,898][123091] Updated weights for policy 0, policy_version 1030402 (0.0009) [2023-12-26 07:49:06,901][123090] Updated weights for policy 1, policy_version 1023055 (0.0007) [2023-12-26 07:49:06,951][123090] Updated weights for policy 1, policy_version 1023065 (0.0009) [2023-12-26 07:49:06,955][123091] Updated weights for policy 0, policy_version 1030412 (0.0009) [2023-12-26 07:49:07,758][123091] Updated weights for policy 0, policy_version 1030422 (0.0009) [2023-12-26 07:49:07,773][123090] Updated weights for policy 1, policy_version 1023075 (0.0008) [2023-12-26 07:49:07,822][123091] Updated weights for policy 0, policy_version 1030432 (0.0007) [2023-12-26 07:49:07,838][123090] Updated weights for policy 1, policy_version 1023085 (0.0006) [2023-12-26 07:49:07,884][123091] Updated weights for policy 0, policy_version 1030442 (0.0009) [2023-12-26 07:49:07,888][123090] Updated weights for policy 1, policy_version 1023095 (0.0005) [2023-12-26 07:49:08,630][123090] Updated weights for policy 1, policy_version 1023105 (0.0006) [2023-12-26 07:49:08,678][123090] Updated weights for policy 1, policy_version 1023115 (0.0009) [2023-12-26 07:49:08,734][123090] Updated weights for policy 1, policy_version 1023125 (0.0008) [2023-12-26 07:49:08,747][123091] Updated weights for policy 0, policy_version 1030452 (0.0009) [2023-12-26 07:49:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 525713408. Throughput: 0: 9010.1, 1: 9059.2. Samples: 525698260. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:08,785][121949] Avg episode reward: [(0, '6204.528'), (1, '5917.674')] [2023-12-26 07:49:08,796][123090] Updated weights for policy 1, policy_version 1023135 (0.0007) [2023-12-26 07:49:08,801][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001023136_261922816.pth... [2023-12-26 07:49:08,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001022080_261652480.pth [2023-12-26 07:49:08,808][123091] Updated weights for policy 0, policy_version 1030462 (0.0009) [2023-12-26 07:49:08,864][123091] Updated weights for policy 0, policy_version 1030472 (0.0010) [2023-12-26 07:49:08,905][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001030480_263806976.pth... [2023-12-26 07:49:08,909][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001029424_263536640.pth [2023-12-26 07:49:09,631][123090] Updated weights for policy 1, policy_version 1023145 (0.0010) [2023-12-26 07:49:09,680][123090] Updated weights for policy 1, policy_version 1023155 (0.0010) [2023-12-26 07:49:09,740][123090] Updated weights for policy 1, policy_version 1023165 (0.0005) [2023-12-26 07:49:09,741][123091] Updated weights for policy 0, policy_version 1030482 (0.0010) [2023-12-26 07:49:09,805][123091] Updated weights for policy 0, policy_version 1030492 (0.0009) [2023-12-26 07:49:09,871][123091] Updated weights for policy 0, policy_version 1030502 (0.0008) [2023-12-26 07:49:09,930][123091] Updated weights for policy 0, policy_version 1030512 (0.0009) [2023-12-26 07:49:10,547][123090] Updated weights for policy 1, policy_version 1023175 (0.0010) [2023-12-26 07:49:10,614][123090] Updated weights for policy 1, policy_version 1023185 (0.0011) [2023-12-26 07:49:10,678][123090] Updated weights for policy 1, policy_version 1023195 (0.0011) [2023-12-26 07:49:10,785][123091] Updated weights for policy 0, policy_version 1030522 (0.0008) [2023-12-26 07:49:10,852][123091] Updated weights for policy 0, policy_version 1030532 (0.0008) [2023-12-26 07:49:10,904][123091] Updated weights for policy 0, policy_version 1030542 (0.0009) [2023-12-26 07:49:11,575][123090] Updated weights for policy 1, policy_version 1023205 (0.0009) [2023-12-26 07:49:11,638][123090] Updated weights for policy 1, policy_version 1023215 (0.0008) [2023-12-26 07:49:11,709][123090] Updated weights for policy 1, policy_version 1023225 (0.0008) [2023-12-26 07:49:11,749][123091] Updated weights for policy 0, policy_version 1030552 (0.0009) [2023-12-26 07:49:11,802][123091] Updated weights for policy 0, policy_version 1030562 (0.0009) [2023-12-26 07:49:11,854][123091] Updated weights for policy 0, policy_version 1030572 (0.0009) [2023-12-26 07:49:12,414][123090] Updated weights for policy 1, policy_version 1023235 (0.0010) [2023-12-26 07:49:12,482][123090] Updated weights for policy 1, policy_version 1023245 (0.0011) [2023-12-26 07:49:12,541][123090] Updated weights for policy 1, policy_version 1023255 (0.0010) [2023-12-26 07:49:12,762][123091] Updated weights for policy 0, policy_version 1030582 (0.0007) [2023-12-26 07:49:12,843][123091] Updated weights for policy 0, policy_version 1030592 (0.0005) [2023-12-26 07:49:12,919][123091] Updated weights for policy 0, policy_version 1030602 (0.0007) [2023-12-26 07:49:13,238][123090] Updated weights for policy 1, policy_version 1023265 (0.0010) [2023-12-26 07:49:13,305][123090] Updated weights for policy 1, policy_version 1023275 (0.0009) [2023-12-26 07:49:13,368][123090] Updated weights for policy 1, policy_version 1023285 (0.0010) [2023-12-26 07:49:13,431][123090] Updated weights for policy 1, policy_version 1023295 (0.0010) [2023-12-26 07:49:13,669][123091] Updated weights for policy 0, policy_version 1030612 (0.0007) [2023-12-26 07:49:13,721][123091] Updated weights for policy 0, policy_version 1030622 (0.0009) [2023-12-26 07:49:13,770][123091] Updated weights for policy 0, policy_version 1030632 (0.0009) [2023-12-26 07:49:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 525803520. Throughput: 0: 8915.9, 1: 8971.6. Samples: 525799892. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:13,785][121949] Avg episode reward: [(0, '6222.300'), (1, '5910.934')] [2023-12-26 07:49:14,258][123090] Updated weights for policy 1, policy_version 1023305 (0.0010) [2023-12-26 07:49:14,325][123090] Updated weights for policy 1, policy_version 1023315 (0.0010) [2023-12-26 07:49:14,388][123090] Updated weights for policy 1, policy_version 1023325 (0.0010) [2023-12-26 07:49:14,607][123091] Updated weights for policy 0, policy_version 1030642 (0.0009) [2023-12-26 07:49:14,655][123091] Updated weights for policy 0, policy_version 1030652 (0.0009) [2023-12-26 07:49:14,716][123091] Updated weights for policy 0, policy_version 1030662 (0.0010) [2023-12-26 07:49:14,778][123091] Updated weights for policy 0, policy_version 1030672 (0.0011) [2023-12-26 07:49:15,126][123090] Updated weights for policy 1, policy_version 1023335 (0.0007) [2023-12-26 07:49:15,180][123090] Updated weights for policy 1, policy_version 1023345 (0.0006) [2023-12-26 07:49:15,247][123090] Updated weights for policy 1, policy_version 1023355 (0.0006) [2023-12-26 07:49:15,578][123091] Updated weights for policy 0, policy_version 1030682 (0.0005) [2023-12-26 07:49:15,655][123091] Updated weights for policy 0, policy_version 1030692 (0.0007) [2023-12-26 07:49:15,720][123091] Updated weights for policy 0, policy_version 1030702 (0.0006) [2023-12-26 07:49:15,984][123090] Updated weights for policy 1, policy_version 1023365 (0.0006) [2023-12-26 07:49:16,049][123090] Updated weights for policy 1, policy_version 1023375 (0.0007) [2023-12-26 07:49:16,104][123090] Updated weights for policy 1, policy_version 1023385 (0.0010) [2023-12-26 07:49:16,347][123091] Updated weights for policy 0, policy_version 1030712 (0.0008) [2023-12-26 07:49:16,399][123091] Updated weights for policy 0, policy_version 1030723 (0.0010) [2023-12-26 07:49:16,453][123091] Updated weights for policy 0, policy_version 1030733 (0.0010) [2023-12-26 07:49:16,832][123090] Updated weights for policy 1, policy_version 1023395 (0.0009) [2023-12-26 07:49:16,885][123090] Updated weights for policy 1, policy_version 1023405 (0.0005) [2023-12-26 07:49:16,931][123090] Updated weights for policy 1, policy_version 1023415 (0.0005) [2023-12-26 07:49:17,270][123091] Updated weights for policy 0, policy_version 1030743 (0.0011) [2023-12-26 07:49:17,332][123091] Updated weights for policy 0, policy_version 1030753 (0.0011) [2023-12-26 07:49:17,394][123091] Updated weights for policy 0, policy_version 1030763 (0.0010) [2023-12-26 07:49:17,596][123090] Updated weights for policy 1, policy_version 1023425 (0.0005) [2023-12-26 07:49:17,667][123090] Updated weights for policy 1, policy_version 1023435 (0.0005) [2023-12-26 07:49:17,723][123090] Updated weights for policy 1, policy_version 1023445 (0.0005) [2023-12-26 07:49:17,790][123090] Updated weights for policy 1, policy_version 1023455 (0.0005) [2023-12-26 07:49:18,210][123091] Updated weights for policy 0, policy_version 1030773 (0.0010) [2023-12-26 07:49:18,276][123091] Updated weights for policy 0, policy_version 1030783 (0.0011) [2023-12-26 07:49:18,341][123091] Updated weights for policy 0, policy_version 1030793 (0.0010) [2023-12-26 07:49:18,425][123090] Updated weights for policy 1, policy_version 1023465 (0.0009) [2023-12-26 07:49:18,492][123090] Updated weights for policy 1, policy_version 1023475 (0.0010) [2023-12-26 07:49:18,563][123090] Updated weights for policy 1, policy_version 1023485 (0.0007) [2023-12-26 07:49:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 525901824. Throughput: 0: 8923.6, 1: 9018.8. Samples: 525911640. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:18,785][121949] Avg episode reward: [(0, '6163.699'), (1, '5926.273')] [2023-12-26 07:49:19,024][123091] Updated weights for policy 0, policy_version 1030803 (0.0009) [2023-12-26 07:49:19,077][123091] Updated weights for policy 0, policy_version 1030813 (0.0006) [2023-12-26 07:49:19,127][123091] Updated weights for policy 0, policy_version 1030823 (0.0006) [2023-12-26 07:49:19,304][123090] Updated weights for policy 1, policy_version 1023495 (0.0011) [2023-12-26 07:49:19,376][123090] Updated weights for policy 1, policy_version 1023505 (0.0011) [2023-12-26 07:49:19,448][123090] Updated weights for policy 1, policy_version 1023515 (0.0007) [2023-12-26 07:49:19,967][123091] Updated weights for policy 0, policy_version 1030833 (0.0007) [2023-12-26 07:49:20,035][123091] Updated weights for policy 0, policy_version 1030843 (0.0007) [2023-12-26 07:49:20,105][123091] Updated weights for policy 0, policy_version 1030853 (0.0007) [2023-12-26 07:49:20,175][123091] Updated weights for policy 0, policy_version 1030863 (0.0006) [2023-12-26 07:49:20,312][123090] Updated weights for policy 1, policy_version 1023525 (0.0008) [2023-12-26 07:49:20,384][123090] Updated weights for policy 1, policy_version 1023535 (0.0009) [2023-12-26 07:49:20,443][123090] Updated weights for policy 1, policy_version 1023545 (0.0010) [2023-12-26 07:49:20,954][123091] Updated weights for policy 0, policy_version 1030873 (0.0008) [2023-12-26 07:49:21,023][123091] Updated weights for policy 0, policy_version 1030883 (0.0007) [2023-12-26 07:49:21,085][123091] Updated weights for policy 0, policy_version 1030893 (0.0009) [2023-12-26 07:49:21,379][123090] Updated weights for policy 1, policy_version 1023555 (0.0009) [2023-12-26 07:49:21,467][123090] Updated weights for policy 1, policy_version 1023565 (0.0007) [2023-12-26 07:49:21,522][123090] Updated weights for policy 1, policy_version 1023575 (0.0006) [2023-12-26 07:49:21,881][123091] Updated weights for policy 0, policy_version 1030903 (0.0010) [2023-12-26 07:49:21,934][123091] Updated weights for policy 0, policy_version 1030913 (0.0009) [2023-12-26 07:49:21,991][123091] Updated weights for policy 0, policy_version 1030923 (0.0010) [2023-12-26 07:49:22,240][123090] Updated weights for policy 1, policy_version 1023585 (0.0009) [2023-12-26 07:49:22,325][123090] Updated weights for policy 1, policy_version 1023595 (0.0010) [2023-12-26 07:49:22,390][123090] Updated weights for policy 1, policy_version 1023605 (0.0010) [2023-12-26 07:49:22,457][123090] Updated weights for policy 1, policy_version 1023615 (0.0009) [2023-12-26 07:49:22,867][123091] Updated weights for policy 0, policy_version 1030933 (0.0008) [2023-12-26 07:49:22,926][123091] Updated weights for policy 0, policy_version 1030943 (0.0005) [2023-12-26 07:49:22,989][123091] Updated weights for policy 0, policy_version 1030954 (0.0008) [2023-12-26 07:49:23,216][123090] Updated weights for policy 1, policy_version 1023625 (0.0005) [2023-12-26 07:49:23,288][123090] Updated weights for policy 1, policy_version 1023635 (0.0005) [2023-12-26 07:49:23,355][123090] Updated weights for policy 1, policy_version 1023645 (0.0008) [2023-12-26 07:49:23,784][123091] Updated weights for policy 0, policy_version 1030964 (0.0009) [2023-12-26 07:49:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 525983744. Throughput: 0: 8864.8, 1: 8940.9. Samples: 525963068. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:23,785][121949] Avg episode reward: [(0, '6124.091'), (1, '5924.583')] [2023-12-26 07:49:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001023648_262053888.pth... [2023-12-26 07:49:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001022592_261783552.pth [2023-12-26 07:49:23,837][123091] Updated weights for policy 0, policy_version 1030974 (0.0010) [2023-12-26 07:49:23,891][123091] Updated weights for policy 0, policy_version 1030985 (0.0010) [2023-12-26 07:49:23,926][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001030992_263938048.pth... [2023-12-26 07:49:23,930][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001029936_263667712.pth [2023-12-26 07:49:24,065][123090] Updated weights for policy 1, policy_version 1023655 (0.0009) [2023-12-26 07:49:24,132][123090] Updated weights for policy 1, policy_version 1023665 (0.0009) [2023-12-26 07:49:24,189][123090] Updated weights for policy 1, policy_version 1023675 (0.0010) [2023-12-26 07:49:24,750][123091] Updated weights for policy 0, policy_version 1030995 (0.0009) [2023-12-26 07:49:24,808][123091] Updated weights for policy 0, policy_version 1031006 (0.0010) [2023-12-26 07:49:24,863][123091] Updated weights for policy 0, policy_version 1031016 (0.0010) [2023-12-26 07:49:24,967][123090] Updated weights for policy 1, policy_version 1023685 (0.0006) [2023-12-26 07:49:25,031][123090] Updated weights for policy 1, policy_version 1023695 (0.0008) [2023-12-26 07:49:25,091][123090] Updated weights for policy 1, policy_version 1023705 (0.0010) [2023-12-26 07:49:25,778][123091] Updated weights for policy 0, policy_version 1031027 (0.0009) [2023-12-26 07:49:25,784][123090] Updated weights for policy 1, policy_version 1023715 (0.0010) [2023-12-26 07:49:25,831][123090] Updated weights for policy 1, policy_version 1023725 (0.0010) [2023-12-26 07:49:25,838][123091] Updated weights for policy 0, policy_version 1031037 (0.0007) [2023-12-26 07:49:25,882][123090] Updated weights for policy 1, policy_version 1023735 (0.0010) [2023-12-26 07:49:25,885][123091] Updated weights for policy 0, policy_version 1031047 (0.0006) [2023-12-26 07:49:26,654][123091] Updated weights for policy 0, policy_version 1031057 (0.0008) [2023-12-26 07:49:26,721][123091] Updated weights for policy 0, policy_version 1031067 (0.0009) [2023-12-26 07:49:26,724][123090] Updated weights for policy 1, policy_version 1023745 (0.0010) [2023-12-26 07:49:26,770][123091] Updated weights for policy 0, policy_version 1031077 (0.0005) [2023-12-26 07:49:26,775][123090] Updated weights for policy 1, policy_version 1023755 (0.0010) [2023-12-26 07:49:26,830][123091] Updated weights for policy 0, policy_version 1031087 (0.0005) [2023-12-26 07:49:26,842][123090] Updated weights for policy 1, policy_version 1023765 (0.0010) [2023-12-26 07:49:26,915][123090] Updated weights for policy 1, policy_version 1023775 (0.0010) [2023-12-26 07:49:27,548][123091] Updated weights for policy 0, policy_version 1031097 (0.0008) [2023-12-26 07:49:27,606][123091] Updated weights for policy 0, policy_version 1031107 (0.0005) [2023-12-26 07:49:27,670][123091] Updated weights for policy 0, policy_version 1031117 (0.0005) [2023-12-26 07:49:27,718][123090] Updated weights for policy 1, policy_version 1023785 (0.0010) [2023-12-26 07:49:27,783][123090] Updated weights for policy 1, policy_version 1023795 (0.0010) [2023-12-26 07:49:27,845][123090] Updated weights for policy 1, policy_version 1023805 (0.0010) [2023-12-26 07:49:28,498][123091] Updated weights for policy 0, policy_version 1031127 (0.0008) [2023-12-26 07:49:28,568][123091] Updated weights for policy 0, policy_version 1031137 (0.0008) [2023-12-26 07:49:28,574][123090] Updated weights for policy 1, policy_version 1023815 (0.0010) [2023-12-26 07:49:28,631][123091] Updated weights for policy 0, policy_version 1031147 (0.0006) [2023-12-26 07:49:28,636][123090] Updated weights for policy 1, policy_version 1023825 (0.0010) [2023-12-26 07:49:28,699][123090] Updated weights for policy 1, policy_version 1023835 (0.0010) [2023-12-26 07:49:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 526082048. Throughput: 0: 8882.9, 1: 8991.0. Samples: 526069764. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:28,784][121949] Avg episode reward: [(0, '6150.913'), (1, '6024.199')] [2023-12-26 07:49:29,406][123091] Updated weights for policy 0, policy_version 1031157 (0.0007) [2023-12-26 07:49:29,469][123091] Updated weights for policy 0, policy_version 1031167 (0.0006) [2023-12-26 07:49:29,517][123090] Updated weights for policy 1, policy_version 1023845 (0.0010) [2023-12-26 07:49:29,525][123091] Updated weights for policy 0, policy_version 1031177 (0.0005) [2023-12-26 07:49:29,576][123090] Updated weights for policy 1, policy_version 1023855 (0.0009) [2023-12-26 07:49:29,634][123090] Updated weights for policy 1, policy_version 1023865 (0.0009) [2023-12-26 07:49:30,231][123091] Updated weights for policy 0, policy_version 1031187 (0.0006) [2023-12-26 07:49:30,283][123091] Updated weights for policy 0, policy_version 1031197 (0.0009) [2023-12-26 07:49:30,350][123091] Updated weights for policy 0, policy_version 1031207 (0.0009) [2023-12-26 07:49:30,372][123090] Updated weights for policy 1, policy_version 1023876 (0.0008) [2023-12-26 07:49:30,435][123090] Updated weights for policy 1, policy_version 1023886 (0.0007) [2023-12-26 07:49:30,492][123090] Updated weights for policy 1, policy_version 1023896 (0.0005) [2023-12-26 07:49:31,135][123091] Updated weights for policy 0, policy_version 1031217 (0.0009) [2023-12-26 07:49:31,195][123091] Updated weights for policy 0, policy_version 1031227 (0.0009) [2023-12-26 07:49:31,212][123090] Updated weights for policy 1, policy_version 1023906 (0.0006) [2023-12-26 07:49:31,259][123091] Updated weights for policy 0, policy_version 1031237 (0.0008) [2023-12-26 07:49:31,277][123090] Updated weights for policy 1, policy_version 1023916 (0.0010) [2023-12-26 07:49:31,322][123091] Updated weights for policy 0, policy_version 1031247 (0.0007) [2023-12-26 07:49:31,345][123090] Updated weights for policy 1, policy_version 1023926 (0.0011) [2023-12-26 07:49:31,415][123090] Updated weights for policy 1, policy_version 1023936 (0.0011) [2023-12-26 07:49:32,192][123091] Updated weights for policy 0, policy_version 1031257 (0.0008) [2023-12-26 07:49:32,241][123091] Updated weights for policy 0, policy_version 1031267 (0.0007) [2023-12-26 07:49:32,251][123090] Updated weights for policy 1, policy_version 1023946 (0.0010) [2023-12-26 07:49:32,300][123091] Updated weights for policy 0, policy_version 1031277 (0.0007) [2023-12-26 07:49:32,307][123090] Updated weights for policy 1, policy_version 1023956 (0.0010) [2023-12-26 07:49:32,370][123090] Updated weights for policy 1, policy_version 1023966 (0.0012) [2023-12-26 07:49:32,936][123091] Updated weights for policy 0, policy_version 1031287 (0.0005) [2023-12-26 07:49:32,994][123091] Updated weights for policy 0, policy_version 1031297 (0.0005) [2023-12-26 07:49:33,044][123091] Updated weights for policy 0, policy_version 1031307 (0.0005) [2023-12-26 07:49:33,172][123090] Updated weights for policy 1, policy_version 1023976 (0.0009) [2023-12-26 07:49:33,225][123090] Updated weights for policy 1, policy_version 1023987 (0.0010) [2023-12-26 07:49:33,278][123090] Updated weights for policy 1, policy_version 1023997 (0.0009) [2023-12-26 07:49:33,704][123091] Updated weights for policy 0, policy_version 1031317 (0.0007) [2023-12-26 07:49:33,768][123091] Updated weights for policy 0, policy_version 1031327 (0.0010) [2023-12-26 07:49:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 526163968. Throughput: 0: 8928.6, 1: 9001.0. Samples: 526178960. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:33,785][121949] Avg episode reward: [(0, '6203.143'), (1, '5937.533')] [2023-12-26 07:49:33,837][123091] Updated weights for policy 0, policy_version 1031337 (0.0009) [2023-12-26 07:49:34,106][123090] Updated weights for policy 1, policy_version 1024007 (0.0009) [2023-12-26 07:49:34,165][123090] Updated weights for policy 1, policy_version 1024017 (0.0009) [2023-12-26 07:49:34,216][123090] Updated weights for policy 1, policy_version 1024027 (0.0010) [2023-12-26 07:49:34,686][123091] Updated weights for policy 0, policy_version 1031347 (0.0008) [2023-12-26 07:49:34,755][123091] Updated weights for policy 0, policy_version 1031357 (0.0006) [2023-12-26 07:49:34,820][123091] Updated weights for policy 0, policy_version 1031367 (0.0007) [2023-12-26 07:49:35,079][123090] Updated weights for policy 1, policy_version 1024037 (0.0007) [2023-12-26 07:49:35,129][123090] Updated weights for policy 1, policy_version 1024047 (0.0005) [2023-12-26 07:49:35,174][123090] Updated weights for policy 1, policy_version 1024057 (0.0005) [2023-12-26 07:49:35,515][123091] Updated weights for policy 0, policy_version 1031377 (0.0006) [2023-12-26 07:49:35,588][123091] Updated weights for policy 0, policy_version 1031387 (0.0007) [2023-12-26 07:49:35,656][123091] Updated weights for policy 0, policy_version 1031397 (0.0005) [2023-12-26 07:49:35,726][123091] Updated weights for policy 0, policy_version 1031407 (0.0006) [2023-12-26 07:49:35,936][123090] Updated weights for policy 1, policy_version 1024067 (0.0007) [2023-12-26 07:49:36,003][123090] Updated weights for policy 1, policy_version 1024077 (0.0010) [2023-12-26 07:49:36,073][123090] Updated weights for policy 1, policy_version 1024087 (0.0010) [2023-12-26 07:49:36,406][123091] Updated weights for policy 0, policy_version 1031417 (0.0009) [2023-12-26 07:49:36,482][123091] Updated weights for policy 0, policy_version 1031427 (0.0010) [2023-12-26 07:49:36,553][123091] Updated weights for policy 0, policy_version 1031437 (0.0008) [2023-12-26 07:49:36,823][123090] Updated weights for policy 1, policy_version 1024097 (0.0009) [2023-12-26 07:49:36,898][123090] Updated weights for policy 1, policy_version 1024107 (0.0005) [2023-12-26 07:49:36,959][123090] Updated weights for policy 1, policy_version 1024117 (0.0006) [2023-12-26 07:49:37,019][123090] Updated weights for policy 1, policy_version 1024127 (0.0007) [2023-12-26 07:49:37,399][123091] Updated weights for policy 0, policy_version 1031447 (0.0010) [2023-12-26 07:49:37,466][123091] Updated weights for policy 0, policy_version 1031457 (0.0009) [2023-12-26 07:49:37,540][123091] Updated weights for policy 0, policy_version 1031467 (0.0009) [2023-12-26 07:49:37,770][123090] Updated weights for policy 1, policy_version 1024137 (0.0009) [2023-12-26 07:49:37,829][123090] Updated weights for policy 1, policy_version 1024147 (0.0010) [2023-12-26 07:49:37,886][123090] Updated weights for policy 1, policy_version 1024157 (0.0010) [2023-12-26 07:49:38,291][123091] Updated weights for policy 0, policy_version 1031477 (0.0008) [2023-12-26 07:49:38,351][123091] Updated weights for policy 0, policy_version 1031487 (0.0010) [2023-12-26 07:49:38,416][123091] Updated weights for policy 0, policy_version 1031497 (0.0008) [2023-12-26 07:49:38,734][123090] Updated weights for policy 1, policy_version 1024167 (0.0008) [2023-12-26 07:49:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 526254080. Throughput: 0: 8933.3, 1: 9020.5. Samples: 526233268. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:38,784][121949] Avg episode reward: [(0, '6216.335'), (1, '5899.917')] [2023-12-26 07:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001031504_264069120.pth... [2023-12-26 07:49:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001030480_263806976.pth [2023-12-26 07:49:38,796][123090] Updated weights for policy 1, policy_version 1024179 (0.0010) [2023-12-26 07:49:38,853][123090] Updated weights for policy 1, policy_version 1024189 (0.0007) [2023-12-26 07:49:38,868][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001024192_262193152.pth... [2023-12-26 07:49:38,871][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001023136_261922816.pth [2023-12-26 07:49:39,141][123091] Updated weights for policy 0, policy_version 1031507 (0.0009) [2023-12-26 07:49:39,193][123091] Updated weights for policy 0, policy_version 1031517 (0.0005) [2023-12-26 07:49:39,253][123091] Updated weights for policy 0, policy_version 1031527 (0.0009) [2023-12-26 07:49:39,702][123090] Updated weights for policy 1, policy_version 1024199 (0.0010) [2023-12-26 07:49:39,760][123090] Updated weights for policy 1, policy_version 1024209 (0.0008) [2023-12-26 07:49:39,835][123090] Updated weights for policy 1, policy_version 1024219 (0.0008) [2023-12-26 07:49:40,133][123091] Updated weights for policy 0, policy_version 1031537 (0.0010) [2023-12-26 07:49:40,192][123091] Updated weights for policy 0, policy_version 1031547 (0.0009) [2023-12-26 07:49:40,248][123091] Updated weights for policy 0, policy_version 1031557 (0.0009) [2023-12-26 07:49:40,306][123091] Updated weights for policy 0, policy_version 1031567 (0.0009) [2023-12-26 07:49:40,683][123090] Updated weights for policy 1, policy_version 1024229 (0.0009) [2023-12-26 07:49:40,752][123090] Updated weights for policy 1, policy_version 1024239 (0.0009) [2023-12-26 07:49:40,817][123090] Updated weights for policy 1, policy_version 1024249 (0.0010) [2023-12-26 07:49:41,155][123091] Updated weights for policy 0, policy_version 1031577 (0.0008) [2023-12-26 07:49:41,223][123091] Updated weights for policy 0, policy_version 1031587 (0.0009) [2023-12-26 07:49:41,296][123091] Updated weights for policy 0, policy_version 1031597 (0.0009) [2023-12-26 07:49:41,629][123090] Updated weights for policy 1, policy_version 1024259 (0.0007) [2023-12-26 07:49:41,698][123090] Updated weights for policy 1, policy_version 1024269 (0.0010) [2023-12-26 07:49:41,765][123090] Updated weights for policy 1, policy_version 1024279 (0.0010) [2023-12-26 07:49:42,122][123091] Updated weights for policy 0, policy_version 1031607 (0.0011) [2023-12-26 07:49:42,188][123091] Updated weights for policy 0, policy_version 1031617 (0.0010) [2023-12-26 07:49:42,258][123091] Updated weights for policy 0, policy_version 1031627 (0.0006) [2023-12-26 07:49:42,701][123090] Updated weights for policy 1, policy_version 1024289 (0.0010) [2023-12-26 07:49:42,765][123090] Updated weights for policy 1, policy_version 1024299 (0.0009) [2023-12-26 07:49:42,829][123090] Updated weights for policy 1, policy_version 1024309 (0.0009) [2023-12-26 07:49:42,892][123091] Updated weights for policy 0, policy_version 1031637 (0.0006) [2023-12-26 07:49:42,894][123090] Updated weights for policy 1, policy_version 1024319 (0.0009) [2023-12-26 07:49:42,947][123091] Updated weights for policy 0, policy_version 1031648 (0.0006) [2023-12-26 07:49:43,001][123091] Updated weights for policy 0, policy_version 1031658 (0.0009) [2023-12-26 07:49:43,632][123090] Updated weights for policy 1, policy_version 1024329 (0.0008) [2023-12-26 07:49:43,694][123090] Updated weights for policy 1, policy_version 1024339 (0.0009) [2023-12-26 07:49:43,764][123090] Updated weights for policy 1, policy_version 1024349 (0.0009) [2023-12-26 07:49:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 526344192. Throughput: 0: 8807.3, 1: 8903.4. Samples: 526336392. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:43,785][121949] Avg episode reward: [(0, '6301.024'), (1, '5870.896')] [2023-12-26 07:49:43,883][123091] Updated weights for policy 0, policy_version 1031668 (0.0009) [2023-12-26 07:49:43,933][123091] Updated weights for policy 0, policy_version 1031679 (0.0009) [2023-12-26 07:49:43,987][123091] Updated weights for policy 0, policy_version 1031690 (0.0009) [2023-12-26 07:49:44,609][123090] Updated weights for policy 1, policy_version 1024359 (0.0009) [2023-12-26 07:49:44,660][123090] Updated weights for policy 1, policy_version 1024369 (0.0009) [2023-12-26 07:49:44,720][123090] Updated weights for policy 1, policy_version 1024379 (0.0009) [2023-12-26 07:49:44,738][123091] Updated weights for policy 0, policy_version 1031700 (0.0009) [2023-12-26 07:49:44,806][123091] Updated weights for policy 0, policy_version 1031710 (0.0009) [2023-12-26 07:49:44,869][123091] Updated weights for policy 0, policy_version 1031720 (0.0010) [2023-12-26 07:49:45,583][123090] Updated weights for policy 1, policy_version 1024389 (0.0008) [2023-12-26 07:49:45,645][123090] Updated weights for policy 1, policy_version 1024399 (0.0010) [2023-12-26 07:49:45,697][123091] Updated weights for policy 0, policy_version 1031730 (0.0009) [2023-12-26 07:49:45,703][123090] Updated weights for policy 1, policy_version 1024409 (0.0009) [2023-12-26 07:49:45,746][123091] Updated weights for policy 0, policy_version 1031740 (0.0007) [2023-12-26 07:49:45,796][123091] Updated weights for policy 0, policy_version 1031750 (0.0009) [2023-12-26 07:49:45,849][123091] Updated weights for policy 0, policy_version 1031760 (0.0009) [2023-12-26 07:49:46,532][123090] Updated weights for policy 1, policy_version 1024419 (0.0009) [2023-12-26 07:49:46,596][123090] Updated weights for policy 1, policy_version 1024429 (0.0009) [2023-12-26 07:49:46,646][123090] Updated weights for policy 1, policy_version 1024440 (0.0009) [2023-12-26 07:49:46,674][123091] Updated weights for policy 0, policy_version 1031770 (0.0005) [2023-12-26 07:49:46,731][123091] Updated weights for policy 0, policy_version 1031780 (0.0007) [2023-12-26 07:49:46,796][123091] Updated weights for policy 0, policy_version 1031790 (0.0010) [2023-12-26 07:49:47,425][123090] Updated weights for policy 1, policy_version 1024450 (0.0009) [2023-12-26 07:49:47,472][123091] Updated weights for policy 0, policy_version 1031800 (0.0007) [2023-12-26 07:49:47,479][123090] Updated weights for policy 1, policy_version 1024460 (0.0010) [2023-12-26 07:49:47,518][123091] Updated weights for policy 0, policy_version 1031810 (0.0005) [2023-12-26 07:49:47,533][123090] Updated weights for policy 1, policy_version 1024470 (0.0009) [2023-12-26 07:49:47,567][123091] Updated weights for policy 0, policy_version 1031820 (0.0007) [2023-12-26 07:49:47,595][123090] Updated weights for policy 1, policy_version 1024480 (0.0008) [2023-12-26 07:49:48,306][123091] Updated weights for policy 0, policy_version 1031830 (0.0008) [2023-12-26 07:49:48,354][123090] Updated weights for policy 1, policy_version 1024490 (0.0007) [2023-12-26 07:49:48,370][123091] Updated weights for policy 0, policy_version 1031840 (0.0008) [2023-12-26 07:49:48,415][123090] Updated weights for policy 1, policy_version 1024500 (0.0011) [2023-12-26 07:49:48,437][123091] Updated weights for policy 0, policy_version 1031850 (0.0010) [2023-12-26 07:49:48,467][123090] Updated weights for policy 1, policy_version 1024510 (0.0010) [2023-12-26 07:49:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 526434304. Throughput: 0: 8859.8, 1: 8850.8. Samples: 526443784. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:48,785][121949] Avg episode reward: [(0, '6337.587'), (1, '5813.285')] [2023-12-26 07:49:49,151][123091] Updated weights for policy 0, policy_version 1031860 (0.0008) [2023-12-26 07:49:49,218][123091] Updated weights for policy 0, policy_version 1031870 (0.0006) [2023-12-26 07:49:49,282][123090] Updated weights for policy 1, policy_version 1024520 (0.0008) [2023-12-26 07:49:49,288][123091] Updated weights for policy 0, policy_version 1031880 (0.0008) [2023-12-26 07:49:49,349][123090] Updated weights for policy 1, policy_version 1024530 (0.0007) [2023-12-26 07:49:49,421][123090] Updated weights for policy 1, policy_version 1024540 (0.0009) [2023-12-26 07:49:49,956][123091] Updated weights for policy 0, policy_version 1031890 (0.0008) [2023-12-26 07:49:50,021][123091] Updated weights for policy 0, policy_version 1031900 (0.0007) [2023-12-26 07:49:50,088][123091] Updated weights for policy 0, policy_version 1031910 (0.0006) [2023-12-26 07:49:50,156][123091] Updated weights for policy 0, policy_version 1031920 (0.0005) [2023-12-26 07:49:50,277][123090] Updated weights for policy 1, policy_version 1024550 (0.0010) [2023-12-26 07:49:50,339][123090] Updated weights for policy 1, policy_version 1024560 (0.0010) [2023-12-26 07:49:50,401][123090] Updated weights for policy 1, policy_version 1024570 (0.0009) [2023-12-26 07:49:50,860][123091] Updated weights for policy 0, policy_version 1031930 (0.0008) [2023-12-26 07:49:50,919][123091] Updated weights for policy 0, policy_version 1031940 (0.0006) [2023-12-26 07:49:50,976][123091] Updated weights for policy 0, policy_version 1031950 (0.0006) [2023-12-26 07:49:51,252][123090] Updated weights for policy 1, policy_version 1024580 (0.0007) [2023-12-26 07:49:51,330][123090] Updated weights for policy 1, policy_version 1024590 (0.0006) [2023-12-26 07:49:51,408][123090] Updated weights for policy 1, policy_version 1024600 (0.0008) [2023-12-26 07:49:51,857][123091] Updated weights for policy 0, policy_version 1031960 (0.0007) [2023-12-26 07:49:51,929][123091] Updated weights for policy 0, policy_version 1031970 (0.0006) [2023-12-26 07:49:52,005][123091] Updated weights for policy 0, policy_version 1031980 (0.0007) [2023-12-26 07:49:52,186][123090] Updated weights for policy 1, policy_version 1024610 (0.0010) [2023-12-26 07:49:52,236][123090] Updated weights for policy 1, policy_version 1024620 (0.0009) [2023-12-26 07:49:52,303][123090] Updated weights for policy 1, policy_version 1024630 (0.0007) [2023-12-26 07:49:52,379][123090] Updated weights for policy 1, policy_version 1024640 (0.0008) [2023-12-26 07:49:52,757][123091] Updated weights for policy 0, policy_version 1031990 (0.0009) [2023-12-26 07:49:52,828][123091] Updated weights for policy 0, policy_version 1032000 (0.0009) [2023-12-26 07:49:52,900][123091] Updated weights for policy 0, policy_version 1032010 (0.0008) [2023-12-26 07:49:53,161][123090] Updated weights for policy 1, policy_version 1024650 (0.0005) [2023-12-26 07:49:53,208][123090] Updated weights for policy 1, policy_version 1024660 (0.0005) [2023-12-26 07:49:53,282][123090] Updated weights for policy 1, policy_version 1024670 (0.0005) [2023-12-26 07:49:53,616][123091] Updated weights for policy 0, policy_version 1032020 (0.0009) [2023-12-26 07:49:53,681][123091] Updated weights for policy 0, policy_version 1032030 (0.0008) [2023-12-26 07:49:53,738][123091] Updated weights for policy 0, policy_version 1032040 (0.0009) [2023-12-26 07:49:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 526524416. Throughput: 0: 8904.9, 1: 8842.6. Samples: 526496904. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:53,786][121949] Avg episode reward: [(0, '6254.053'), (1, '5786.906')] [2023-12-26 07:49:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001032048_264208384.pth... [2023-12-26 07:49:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001024672_262316032.pth... [2023-12-26 07:49:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001030992_263938048.pth [2023-12-26 07:49:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001023648_262053888.pth [2023-12-26 07:49:53,976][123090] Updated weights for policy 1, policy_version 1024680 (0.0009) [2023-12-26 07:49:54,036][123090] Updated weights for policy 1, policy_version 1024690 (0.0009) [2023-12-26 07:49:54,098][123090] Updated weights for policy 1, policy_version 1024700 (0.0010) [2023-12-26 07:49:54,566][123091] Updated weights for policy 0, policy_version 1032050 (0.0009) [2023-12-26 07:49:54,639][123091] Updated weights for policy 0, policy_version 1032060 (0.0010) [2023-12-26 07:49:54,711][123091] Updated weights for policy 0, policy_version 1032070 (0.0009) [2023-12-26 07:49:54,774][123091] Updated weights for policy 0, policy_version 1032080 (0.0009) [2023-12-26 07:49:54,856][123090] Updated weights for policy 1, policy_version 1024710 (0.0010) [2023-12-26 07:49:54,919][123090] Updated weights for policy 1, policy_version 1024720 (0.0009) [2023-12-26 07:49:54,990][123090] Updated weights for policy 1, policy_version 1024730 (0.0009) [2023-12-26 07:49:55,560][123091] Updated weights for policy 0, policy_version 1032090 (0.0009) [2023-12-26 07:49:55,627][123091] Updated weights for policy 0, policy_version 1032100 (0.0009) [2023-12-26 07:49:55,693][123091] Updated weights for policy 0, policy_version 1032110 (0.0010) [2023-12-26 07:49:55,858][123090] Updated weights for policy 1, policy_version 1024740 (0.0009) [2023-12-26 07:49:55,912][123090] Updated weights for policy 1, policy_version 1024750 (0.0005) [2023-12-26 07:49:55,959][123090] Updated weights for policy 1, policy_version 1024760 (0.0005) [2023-12-26 07:49:56,488][123091] Updated weights for policy 0, policy_version 1032120 (0.0010) [2023-12-26 07:49:56,546][123091] Updated weights for policy 0, policy_version 1032130 (0.0009) [2023-12-26 07:49:56,612][123091] Updated weights for policy 0, policy_version 1032140 (0.0011) [2023-12-26 07:49:56,678][123090] Updated weights for policy 1, policy_version 1024771 (0.0007) [2023-12-26 07:49:56,740][123090] Updated weights for policy 1, policy_version 1024781 (0.0006) [2023-12-26 07:49:56,810][123090] Updated weights for policy 1, policy_version 1024791 (0.0006) [2023-12-26 07:49:57,313][123091] Updated weights for policy 0, policy_version 1032150 (0.0007) [2023-12-26 07:49:57,385][123091] Updated weights for policy 0, policy_version 1032160 (0.0006) [2023-12-26 07:49:57,457][123091] Updated weights for policy 0, policy_version 1032170 (0.0005) [2023-12-26 07:49:57,459][123090] Updated weights for policy 1, policy_version 1024801 (0.0005) [2023-12-26 07:49:57,511][123090] Updated weights for policy 1, policy_version 1024811 (0.0005) [2023-12-26 07:49:57,565][123090] Updated weights for policy 1, policy_version 1024821 (0.0005) [2023-12-26 07:49:57,627][123090] Updated weights for policy 1, policy_version 1024831 (0.0006) [2023-12-26 07:49:58,086][123091] Updated weights for policy 0, policy_version 1032180 (0.0006) [2023-12-26 07:49:58,158][123091] Updated weights for policy 0, policy_version 1032190 (0.0007) [2023-12-26 07:49:58,223][123091] Updated weights for policy 0, policy_version 1032200 (0.0010) [2023-12-26 07:49:58,353][123090] Updated weights for policy 1, policy_version 1024841 (0.0012) [2023-12-26 07:49:58,416][123090] Updated weights for policy 1, policy_version 1024851 (0.0008) [2023-12-26 07:49:58,488][123090] Updated weights for policy 1, policy_version 1024861 (0.0007) [2023-12-26 07:49:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 526614528. Throughput: 0: 9012.3, 1: 8922.8. Samples: 526606972. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:49:58,785][121949] Avg episode reward: [(0, '6085.554'), (1, '5818.966')] [2023-12-26 07:49:59,021][123091] Updated weights for policy 0, policy_version 1032210 (0.0010) [2023-12-26 07:49:59,084][123091] Updated weights for policy 0, policy_version 1032220 (0.0009) [2023-12-26 07:49:59,139][123091] Updated weights for policy 0, policy_version 1032230 (0.0009) [2023-12-26 07:49:59,198][123091] Updated weights for policy 0, policy_version 1032240 (0.0009) [2023-12-26 07:49:59,344][123090] Updated weights for policy 1, policy_version 1024871 (0.0010) [2023-12-26 07:49:59,410][123090] Updated weights for policy 1, policy_version 1024881 (0.0010) [2023-12-26 07:49:59,464][123090] Updated weights for policy 1, policy_version 1024891 (0.0006) [2023-12-26 07:50:00,044][123091] Updated weights for policy 0, policy_version 1032251 (0.0007) [2023-12-26 07:50:00,093][123091] Updated weights for policy 0, policy_version 1032261 (0.0009) [2023-12-26 07:50:00,160][123091] Updated weights for policy 0, policy_version 1032271 (0.0009) [2023-12-26 07:50:00,212][123090] Updated weights for policy 1, policy_version 1024901 (0.0007) [2023-12-26 07:50:00,269][123090] Updated weights for policy 1, policy_version 1024911 (0.0009) [2023-12-26 07:50:00,317][123090] Updated weights for policy 1, policy_version 1024921 (0.0009) [2023-12-26 07:50:00,974][123090] Updated weights for policy 1, policy_version 1024931 (0.0006) [2023-12-26 07:50:01,006][123091] Updated weights for policy 0, policy_version 1032281 (0.0006) [2023-12-26 07:50:01,038][123090] Updated weights for policy 1, policy_version 1024941 (0.0006) [2023-12-26 07:50:01,072][123091] Updated weights for policy 0, policy_version 1032291 (0.0009) [2023-12-26 07:50:01,098][123090] Updated weights for policy 1, policy_version 1024951 (0.0007) [2023-12-26 07:50:01,128][123091] Updated weights for policy 0, policy_version 1032301 (0.0007) [2023-12-26 07:50:01,907][123090] Updated weights for policy 1, policy_version 1024961 (0.0008) [2023-12-26 07:50:01,968][123090] Updated weights for policy 1, policy_version 1024971 (0.0009) [2023-12-26 07:50:01,975][123091] Updated weights for policy 0, policy_version 1032311 (0.0007) [2023-12-26 07:50:02,037][123090] Updated weights for policy 1, policy_version 1024981 (0.0011) [2023-12-26 07:50:02,040][123091] Updated weights for policy 0, policy_version 1032321 (0.0007) [2023-12-26 07:50:02,103][123090] Updated weights for policy 1, policy_version 1024991 (0.0009) [2023-12-26 07:50:02,109][123091] Updated weights for policy 0, policy_version 1032331 (0.0008) [2023-12-26 07:50:02,778][123090] Updated weights for policy 1, policy_version 1025001 (0.0005) [2023-12-26 07:50:02,836][123090] Updated weights for policy 1, policy_version 1025011 (0.0005) [2023-12-26 07:50:02,901][123090] Updated weights for policy 1, policy_version 1025021 (0.0005) [2023-12-26 07:50:03,000][123091] Updated weights for policy 0, policy_version 1032341 (0.0008) [2023-12-26 07:50:03,055][123091] Updated weights for policy 0, policy_version 1032351 (0.0006) [2023-12-26 07:50:03,099][123091] Updated weights for policy 0, policy_version 1032361 (0.0005) [2023-12-26 07:50:03,570][123090] Updated weights for policy 1, policy_version 1025031 (0.0007) [2023-12-26 07:50:03,639][123090] Updated weights for policy 1, policy_version 1025041 (0.0005) [2023-12-26 07:50:03,701][123090] Updated weights for policy 1, policy_version 1025051 (0.0005) [2023-12-26 07:50:03,757][123091] Updated weights for policy 0, policy_version 1032371 (0.0005) [2023-12-26 07:50:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 526704640. Throughput: 0: 8981.9, 1: 8911.0. Samples: 526716824. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:03,785][121949] Avg episode reward: [(0, '6051.082'), (1, '5779.215')] [2023-12-26 07:50:03,805][123091] Updated weights for policy 0, policy_version 1032381 (0.0005) [2023-12-26 07:50:03,864][123091] Updated weights for policy 0, policy_version 1032391 (0.0007) [2023-12-26 07:50:04,353][123090] Updated weights for policy 1, policy_version 1025061 (0.0005) [2023-12-26 07:50:04,414][123090] Updated weights for policy 1, policy_version 1025071 (0.0005) [2023-12-26 07:50:04,471][123090] Updated weights for policy 1, policy_version 1025081 (0.0006) [2023-12-26 07:50:04,620][123091] Updated weights for policy 0, policy_version 1032401 (0.0007) [2023-12-26 07:50:04,683][123091] Updated weights for policy 0, policy_version 1032411 (0.0011) [2023-12-26 07:50:04,742][123091] Updated weights for policy 0, policy_version 1032421 (0.0011) [2023-12-26 07:50:04,805][123091] Updated weights for policy 0, policy_version 1032431 (0.0011) [2023-12-26 07:50:05,224][123090] Updated weights for policy 1, policy_version 1025091 (0.0008) [2023-12-26 07:50:05,287][123090] Updated weights for policy 1, policy_version 1025101 (0.0011) [2023-12-26 07:50:05,354][123090] Updated weights for policy 1, policy_version 1025111 (0.0011) [2023-12-26 07:50:05,658][123091] Updated weights for policy 0, policy_version 1032441 (0.0009) [2023-12-26 07:50:05,721][123091] Updated weights for policy 0, policy_version 1032451 (0.0009) [2023-12-26 07:50:05,784][123091] Updated weights for policy 0, policy_version 1032461 (0.0008) [2023-12-26 07:50:06,162][123090] Updated weights for policy 1, policy_version 1025121 (0.0010) [2023-12-26 07:50:06,226][123090] Updated weights for policy 1, policy_version 1025131 (0.0011) [2023-12-26 07:50:06,279][123090] Updated weights for policy 1, policy_version 1025141 (0.0011) [2023-12-26 07:50:06,331][123090] Updated weights for policy 1, policy_version 1025151 (0.0011) [2023-12-26 07:50:06,612][123091] Updated weights for policy 0, policy_version 1032471 (0.0010) [2023-12-26 07:50:06,678][123091] Updated weights for policy 0, policy_version 1032481 (0.0008) [2023-12-26 07:50:06,739][123091] Updated weights for policy 0, policy_version 1032491 (0.0009) [2023-12-26 07:50:07,188][123090] Updated weights for policy 1, policy_version 1025161 (0.0007) [2023-12-26 07:50:07,254][123090] Updated weights for policy 1, policy_version 1025171 (0.0010) [2023-12-26 07:50:07,325][123090] Updated weights for policy 1, policy_version 1025181 (0.0011) [2023-12-26 07:50:07,494][123091] Updated weights for policy 0, policy_version 1032501 (0.0007) [2023-12-26 07:50:07,549][123091] Updated weights for policy 0, policy_version 1032511 (0.0006) [2023-12-26 07:50:07,598][123091] Updated weights for policy 0, policy_version 1032521 (0.0010) [2023-12-26 07:50:08,076][123090] Updated weights for policy 1, policy_version 1025191 (0.0011) [2023-12-26 07:50:08,135][123090] Updated weights for policy 1, policy_version 1025201 (0.0010) [2023-12-26 07:50:08,193][123090] Updated weights for policy 1, policy_version 1025211 (0.0010) [2023-12-26 07:50:08,335][123091] Updated weights for policy 0, policy_version 1032531 (0.0010) [2023-12-26 07:50:08,406][123091] Updated weights for policy 0, policy_version 1032541 (0.0008) [2023-12-26 07:50:08,467][123091] Updated weights for policy 0, policy_version 1032551 (0.0009) [2023-12-26 07:50:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 526794752. Throughput: 0: 8979.5, 1: 8964.5. Samples: 526770548. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:08,785][121949] Avg episode reward: [(0, '6127.093'), (1, '5944.391')] [2023-12-26 07:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001025216_262455296.pth... [2023-12-26 07:50:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001032560_264339456.pth... [2023-12-26 07:50:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001024192_262193152.pth [2023-12-26 07:50:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001031504_264069120.pth [2023-12-26 07:50:08,869][123090] Updated weights for policy 1, policy_version 1025221 (0.0008) [2023-12-26 07:50:08,923][123090] Updated weights for policy 1, policy_version 1025231 (0.0010) [2023-12-26 07:50:08,972][123090] Updated weights for policy 1, policy_version 1025241 (0.0010) [2023-12-26 07:50:09,329][123091] Updated weights for policy 0, policy_version 1032561 (0.0010) [2023-12-26 07:50:09,399][123091] Updated weights for policy 0, policy_version 1032571 (0.0013) [2023-12-26 07:50:09,467][123091] Updated weights for policy 0, policy_version 1032581 (0.0009) [2023-12-26 07:50:09,531][123091] Updated weights for policy 0, policy_version 1032591 (0.0009) [2023-12-26 07:50:09,730][123090] Updated weights for policy 1, policy_version 1025251 (0.0010) [2023-12-26 07:50:09,794][123090] Updated weights for policy 1, policy_version 1025261 (0.0011) [2023-12-26 07:50:09,864][123090] Updated weights for policy 1, policy_version 1025271 (0.0011) [2023-12-26 07:50:10,322][123091] Updated weights for policy 0, policy_version 1032601 (0.0010) [2023-12-26 07:50:10,388][123091] Updated weights for policy 0, policy_version 1032611 (0.0011) [2023-12-26 07:50:10,455][123091] Updated weights for policy 0, policy_version 1032621 (0.0011) [2023-12-26 07:50:10,725][123090] Updated weights for policy 1, policy_version 1025281 (0.0010) [2023-12-26 07:50:10,791][123090] Updated weights for policy 1, policy_version 1025291 (0.0011) [2023-12-26 07:50:10,859][123090] Updated weights for policy 1, policy_version 1025301 (0.0010) [2023-12-26 07:50:10,922][123090] Updated weights for policy 1, policy_version 1025311 (0.0010) [2023-12-26 07:50:11,302][123091] Updated weights for policy 0, policy_version 1032631 (0.0009) [2023-12-26 07:50:11,371][123091] Updated weights for policy 0, policy_version 1032641 (0.0009) [2023-12-26 07:50:11,436][123091] Updated weights for policy 0, policy_version 1032651 (0.0010) [2023-12-26 07:50:11,809][123090] Updated weights for policy 1, policy_version 1025321 (0.0006) [2023-12-26 07:50:11,884][123090] Updated weights for policy 1, policy_version 1025331 (0.0006) [2023-12-26 07:50:11,956][123090] Updated weights for policy 1, policy_version 1025341 (0.0005) [2023-12-26 07:50:12,322][123091] Updated weights for policy 0, policy_version 1032662 (0.0009) [2023-12-26 07:50:12,391][123091] Updated weights for policy 0, policy_version 1032672 (0.0009) [2023-12-26 07:50:12,447][123091] Updated weights for policy 0, policy_version 1032682 (0.0008) [2023-12-26 07:50:12,722][123090] Updated weights for policy 1, policy_version 1025351 (0.0009) [2023-12-26 07:50:12,777][123090] Updated weights for policy 1, policy_version 1025361 (0.0010) [2023-12-26 07:50:12,843][123090] Updated weights for policy 1, policy_version 1025371 (0.0009) [2023-12-26 07:50:13,290][123091] Updated weights for policy 0, policy_version 1032692 (0.0009) [2023-12-26 07:50:13,358][123091] Updated weights for policy 0, policy_version 1032702 (0.0009) [2023-12-26 07:50:13,422][123091] Updated weights for policy 0, policy_version 1032712 (0.0009) [2023-12-26 07:50:13,665][123090] Updated weights for policy 1, policy_version 1025381 (0.0007) [2023-12-26 07:50:13,747][123090] Updated weights for policy 1, policy_version 1025391 (0.0006) [2023-12-26 07:50:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 526876672. Throughput: 0: 8969.7, 1: 8917.5. Samples: 526874688. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:13,785][121949] Avg episode reward: [(0, '6171.639'), (1, '6039.321')] [2023-12-26 07:50:13,826][123090] Updated weights for policy 1, policy_version 1025401 (0.0005) [2023-12-26 07:50:14,050][123091] Updated weights for policy 0, policy_version 1032723 (0.0009) [2023-12-26 07:50:14,106][123091] Updated weights for policy 0, policy_version 1032733 (0.0008) [2023-12-26 07:50:14,170][123091] Updated weights for policy 0, policy_version 1032743 (0.0009) [2023-12-26 07:50:14,458][123090] Updated weights for policy 1, policy_version 1025411 (0.0010) [2023-12-26 07:50:14,523][123090] Updated weights for policy 1, policy_version 1025421 (0.0006) [2023-12-26 07:50:14,582][123090] Updated weights for policy 1, policy_version 1025431 (0.0005) [2023-12-26 07:50:14,966][123091] Updated weights for policy 0, policy_version 1032753 (0.0006) [2023-12-26 07:50:15,033][123091] Updated weights for policy 0, policy_version 1032763 (0.0010) [2023-12-26 07:50:15,096][123091] Updated weights for policy 0, policy_version 1032773 (0.0009) [2023-12-26 07:50:15,155][123091] Updated weights for policy 0, policy_version 1032783 (0.0010) [2023-12-26 07:50:15,301][123090] Updated weights for policy 1, policy_version 1025441 (0.0006) [2023-12-26 07:50:15,370][123090] Updated weights for policy 1, policy_version 1025451 (0.0008) [2023-12-26 07:50:15,426][123090] Updated weights for policy 1, policy_version 1025461 (0.0008) [2023-12-26 07:50:15,498][123090] Updated weights for policy 1, policy_version 1025471 (0.0008) [2023-12-26 07:50:16,025][123091] Updated weights for policy 0, policy_version 1032793 (0.0009) [2023-12-26 07:50:16,073][123091] Updated weights for policy 0, policy_version 1032803 (0.0009) [2023-12-26 07:50:16,122][123091] Updated weights for policy 0, policy_version 1032813 (0.0009) [2023-12-26 07:50:16,281][123090] Updated weights for policy 1, policy_version 1025481 (0.0010) [2023-12-26 07:50:16,336][123090] Updated weights for policy 1, policy_version 1025491 (0.0010) [2023-12-26 07:50:16,398][123090] Updated weights for policy 1, policy_version 1025501 (0.0010) [2023-12-26 07:50:16,830][123091] Updated weights for policy 0, policy_version 1032823 (0.0006) [2023-12-26 07:50:16,889][123091] Updated weights for policy 0, policy_version 1032833 (0.0007) [2023-12-26 07:50:16,955][123091] Updated weights for policy 0, policy_version 1032843 (0.0005) [2023-12-26 07:50:17,155][123090] Updated weights for policy 1, policy_version 1025511 (0.0007) [2023-12-26 07:50:17,206][123090] Updated weights for policy 1, policy_version 1025521 (0.0005) [2023-12-26 07:50:17,258][123090] Updated weights for policy 1, policy_version 1025531 (0.0005) [2023-12-26 07:50:17,615][123091] Updated weights for policy 0, policy_version 1032853 (0.0005) [2023-12-26 07:50:17,682][123091] Updated weights for policy 0, policy_version 1032863 (0.0005) [2023-12-26 07:50:17,750][123091] Updated weights for policy 0, policy_version 1032873 (0.0005) [2023-12-26 07:50:17,928][123090] Updated weights for policy 1, policy_version 1025541 (0.0005) [2023-12-26 07:50:18,000][123090] Updated weights for policy 1, policy_version 1025551 (0.0006) [2023-12-26 07:50:18,052][123090] Updated weights for policy 1, policy_version 1025561 (0.0009) [2023-12-26 07:50:18,439][123091] Updated weights for policy 0, policy_version 1032883 (0.0007) [2023-12-26 07:50:18,499][123091] Updated weights for policy 0, policy_version 1032893 (0.0009) [2023-12-26 07:50:18,555][123091] Updated weights for policy 0, policy_version 1032903 (0.0009) [2023-12-26 07:50:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 526974976. Throughput: 0: 8961.3, 1: 8974.9. Samples: 526986084. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:18,785][121949] Avg episode reward: [(0, '6137.790'), (1, '6003.455')] [2023-12-26 07:50:18,837][123090] Updated weights for policy 1, policy_version 1025571 (0.0008) [2023-12-26 07:50:18,900][123090] Updated weights for policy 1, policy_version 1025581 (0.0006) [2023-12-26 07:50:18,958][123090] Updated weights for policy 1, policy_version 1025591 (0.0006) [2023-12-26 07:50:19,463][123091] Updated weights for policy 0, policy_version 1032913 (0.0009) [2023-12-26 07:50:19,524][123091] Updated weights for policy 0, policy_version 1032923 (0.0010) [2023-12-26 07:50:19,588][123091] Updated weights for policy 0, policy_version 1032933 (0.0010) [2023-12-26 07:50:19,654][123091] Updated weights for policy 0, policy_version 1032943 (0.0009) [2023-12-26 07:50:19,704][123090] Updated weights for policy 1, policy_version 1025601 (0.0006) [2023-12-26 07:50:19,765][123090] Updated weights for policy 1, policy_version 1025611 (0.0009) [2023-12-26 07:50:19,828][123090] Updated weights for policy 1, policy_version 1025621 (0.0009) [2023-12-26 07:50:19,894][123090] Updated weights for policy 1, policy_version 1025631 (0.0009) [2023-12-26 07:50:20,527][123091] Updated weights for policy 0, policy_version 1032953 (0.0010) [2023-12-26 07:50:20,596][123091] Updated weights for policy 0, policy_version 1032963 (0.0010) [2023-12-26 07:50:20,659][123091] Updated weights for policy 0, policy_version 1032973 (0.0010) [2023-12-26 07:50:20,746][123090] Updated weights for policy 1, policy_version 1025641 (0.0010) [2023-12-26 07:50:20,811][123090] Updated weights for policy 1, policy_version 1025651 (0.0010) [2023-12-26 07:50:20,871][123090] Updated weights for policy 1, policy_version 1025661 (0.0010) [2023-12-26 07:50:21,531][123091] Updated weights for policy 0, policy_version 1032983 (0.0010) [2023-12-26 07:50:21,598][123091] Updated weights for policy 0, policy_version 1032993 (0.0009) [2023-12-26 07:50:21,668][123091] Updated weights for policy 0, policy_version 1033003 (0.0008) [2023-12-26 07:50:21,728][123090] Updated weights for policy 1, policy_version 1025671 (0.0009) [2023-12-26 07:50:21,795][123090] Updated weights for policy 1, policy_version 1025681 (0.0008) [2023-12-26 07:50:21,860][123090] Updated weights for policy 1, policy_version 1025691 (0.0009) [2023-12-26 07:50:22,456][123091] Updated weights for policy 0, policy_version 1033013 (0.0007) [2023-12-26 07:50:22,520][123091] Updated weights for policy 0, policy_version 1033023 (0.0008) [2023-12-26 07:50:22,591][123091] Updated weights for policy 0, policy_version 1033033 (0.0008) [2023-12-26 07:50:22,701][123090] Updated weights for policy 1, policy_version 1025701 (0.0007) [2023-12-26 07:50:22,770][123090] Updated weights for policy 1, policy_version 1025711 (0.0007) [2023-12-26 07:50:22,836][123090] Updated weights for policy 1, policy_version 1025721 (0.0011) [2023-12-26 07:50:23,352][123091] Updated weights for policy 0, policy_version 1033043 (0.0008) [2023-12-26 07:50:23,411][123091] Updated weights for policy 0, policy_version 1033053 (0.0010) [2023-12-26 07:50:23,467][123091] Updated weights for policy 0, policy_version 1033063 (0.0011) [2023-12-26 07:50:23,654][123090] Updated weights for policy 1, policy_version 1025731 (0.0011) [2023-12-26 07:50:23,710][123090] Updated weights for policy 1, policy_version 1025741 (0.0011) [2023-12-26 07:50:23,759][123090] Updated weights for policy 1, policy_version 1025751 (0.0010) [2023-12-26 07:50:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 527056896. Throughput: 0: 8893.9, 1: 8952.3. Samples: 527036352. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:23,785][121949] Avg episode reward: [(0, '6110.571'), (1, '6033.754')] [2023-12-26 07:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001033072_264470528.pth... [2023-12-26 07:50:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001032048_264208384.pth [2023-12-26 07:50:23,804][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001025760_262594560.pth... [2023-12-26 07:50:23,807][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001024672_262316032.pth [2023-12-26 07:50:24,231][123091] Updated weights for policy 0, policy_version 1033073 (0.0011) [2023-12-26 07:50:24,291][123091] Updated weights for policy 0, policy_version 1033083 (0.0007) [2023-12-26 07:50:24,352][123091] Updated weights for policy 0, policy_version 1033093 (0.0006) [2023-12-26 07:50:24,409][123091] Updated weights for policy 0, policy_version 1033103 (0.0006) [2023-12-26 07:50:24,613][123090] Updated weights for policy 1, policy_version 1025761 (0.0010) [2023-12-26 07:50:24,670][123090] Updated weights for policy 1, policy_version 1025771 (0.0009) [2023-12-26 07:50:24,718][123090] Updated weights for policy 1, policy_version 1025781 (0.0010) [2023-12-26 07:50:24,777][123090] Updated weights for policy 1, policy_version 1025791 (0.0010) [2023-12-26 07:50:25,138][123091] Updated weights for policy 0, policy_version 1033113 (0.0010) [2023-12-26 07:50:25,206][123091] Updated weights for policy 0, policy_version 1033123 (0.0011) [2023-12-26 07:50:25,270][123091] Updated weights for policy 0, policy_version 1033133 (0.0011) [2023-12-26 07:50:25,543][123090] Updated weights for policy 1, policy_version 1025801 (0.0006) [2023-12-26 07:50:25,606][123090] Updated weights for policy 1, policy_version 1025811 (0.0005) [2023-12-26 07:50:25,664][123090] Updated weights for policy 1, policy_version 1025821 (0.0008) [2023-12-26 07:50:26,014][123091] Updated weights for policy 0, policy_version 1033143 (0.0007) [2023-12-26 07:50:26,077][123091] Updated weights for policy 0, policy_version 1033153 (0.0005) [2023-12-26 07:50:26,141][123091] Updated weights for policy 0, policy_version 1033163 (0.0005) [2023-12-26 07:50:26,347][123090] Updated weights for policy 1, policy_version 1025831 (0.0008) [2023-12-26 07:50:26,406][123090] Updated weights for policy 1, policy_version 1025841 (0.0010) [2023-12-26 07:50:26,457][123090] Updated weights for policy 1, policy_version 1025851 (0.0010) [2023-12-26 07:50:26,772][123091] Updated weights for policy 0, policy_version 1033173 (0.0005) [2023-12-26 07:50:26,827][123091] Updated weights for policy 0, policy_version 1033183 (0.0009) [2023-12-26 07:50:26,881][123091] Updated weights for policy 0, policy_version 1033193 (0.0010) [2023-12-26 07:50:27,288][123090] Updated weights for policy 1, policy_version 1025861 (0.0010) [2023-12-26 07:50:27,354][123090] Updated weights for policy 1, policy_version 1025871 (0.0010) [2023-12-26 07:50:27,406][123090] Updated weights for policy 1, policy_version 1025881 (0.0010) [2023-12-26 07:50:27,589][123091] Updated weights for policy 0, policy_version 1033203 (0.0009) [2023-12-26 07:50:27,640][123091] Updated weights for policy 0, policy_version 1033213 (0.0005) [2023-12-26 07:50:27,695][123091] Updated weights for policy 0, policy_version 1033223 (0.0005) [2023-12-26 07:50:28,218][123090] Updated weights for policy 1, policy_version 1025891 (0.0010) [2023-12-26 07:50:28,269][123090] Updated weights for policy 1, policy_version 1025901 (0.0010) [2023-12-26 07:50:28,319][123090] Updated weights for policy 1, policy_version 1025911 (0.0010) [2023-12-26 07:50:28,449][123091] Updated weights for policy 0, policy_version 1033233 (0.0010) [2023-12-26 07:50:28,509][123091] Updated weights for policy 0, policy_version 1033243 (0.0011) [2023-12-26 07:50:28,576][123091] Updated weights for policy 0, policy_version 1033253 (0.0011) [2023-12-26 07:50:28,642][123091] Updated weights for policy 0, policy_version 1033263 (0.0010) [2023-12-26 07:50:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 527155200. Throughput: 0: 9006.3, 1: 8993.2. Samples: 527146372. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:28,785][121949] Avg episode reward: [(0, '6151.958'), (1, '6070.373')] [2023-12-26 07:50:29,129][123090] Updated weights for policy 1, policy_version 1025921 (0.0010) [2023-12-26 07:50:29,197][123090] Updated weights for policy 1, policy_version 1025931 (0.0006) [2023-12-26 07:50:29,262][123090] Updated weights for policy 1, policy_version 1025941 (0.0007) [2023-12-26 07:50:29,316][123090] Updated weights for policy 1, policy_version 1025951 (0.0005) [2023-12-26 07:50:29,482][123091] Updated weights for policy 0, policy_version 1033273 (0.0011) [2023-12-26 07:50:29,533][123091] Updated weights for policy 0, policy_version 1033283 (0.0010) [2023-12-26 07:50:29,588][123091] Updated weights for policy 0, policy_version 1033293 (0.0010) [2023-12-26 07:50:30,064][123090] Updated weights for policy 1, policy_version 1025961 (0.0009) [2023-12-26 07:50:30,131][123090] Updated weights for policy 1, policy_version 1025971 (0.0008) [2023-12-26 07:50:30,190][123090] Updated weights for policy 1, policy_version 1025981 (0.0009) [2023-12-26 07:50:30,422][123091] Updated weights for policy 0, policy_version 1033303 (0.0010) [2023-12-26 07:50:30,474][123091] Updated weights for policy 0, policy_version 1033313 (0.0010) [2023-12-26 07:50:30,528][123091] Updated weights for policy 0, policy_version 1033323 (0.0010) [2023-12-26 07:50:31,034][123090] Updated weights for policy 1, policy_version 1025991 (0.0009) [2023-12-26 07:50:31,098][123090] Updated weights for policy 1, policy_version 1026001 (0.0009) [2023-12-26 07:50:31,167][123090] Updated weights for policy 1, policy_version 1026011 (0.0009) [2023-12-26 07:50:31,317][123091] Updated weights for policy 0, policy_version 1033333 (0.0008) [2023-12-26 07:50:31,389][123091] Updated weights for policy 0, policy_version 1033343 (0.0008) [2023-12-26 07:50:31,455][123091] Updated weights for policy 0, policy_version 1033353 (0.0010) [2023-12-26 07:50:31,940][123090] Updated weights for policy 1, policy_version 1026021 (0.0009) [2023-12-26 07:50:32,007][123090] Updated weights for policy 1, policy_version 1026031 (0.0008) [2023-12-26 07:50:32,082][123090] Updated weights for policy 1, policy_version 1026041 (0.0005) [2023-12-26 07:50:32,252][123091] Updated weights for policy 0, policy_version 1033363 (0.0010) [2023-12-26 07:50:32,304][123091] Updated weights for policy 0, policy_version 1033373 (0.0005) [2023-12-26 07:50:32,370][123091] Updated weights for policy 0, policy_version 1033383 (0.0011) [2023-12-26 07:50:32,817][123090] Updated weights for policy 1, policy_version 1026051 (0.0006) [2023-12-26 07:50:32,888][123090] Updated weights for policy 1, policy_version 1026061 (0.0008) [2023-12-26 07:50:32,946][123090] Updated weights for policy 1, policy_version 1026071 (0.0008) [2023-12-26 07:50:33,198][123091] Updated weights for policy 0, policy_version 1033393 (0.0011) [2023-12-26 07:50:33,249][123091] Updated weights for policy 0, policy_version 1033403 (0.0009) [2023-12-26 07:50:33,301][123091] Updated weights for policy 0, policy_version 1033413 (0.0010) [2023-12-26 07:50:33,351][123091] Updated weights for policy 0, policy_version 1033423 (0.0009) [2023-12-26 07:50:33,743][123090] Updated weights for policy 1, policy_version 1026081 (0.0009) [2023-12-26 07:50:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 527237120. Throughput: 0: 8937.4, 1: 9000.1. Samples: 527250972. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:33,785][121949] Avg episode reward: [(0, '6150.146'), (1, '6036.794')] [2023-12-26 07:50:33,802][123090] Updated weights for policy 1, policy_version 1026091 (0.0010) [2023-12-26 07:50:33,860][123090] Updated weights for policy 1, policy_version 1026101 (0.0009) [2023-12-26 07:50:33,911][123090] Updated weights for policy 1, policy_version 1026111 (0.0009) [2023-12-26 07:50:34,171][123091] Updated weights for policy 0, policy_version 1033433 (0.0009) [2023-12-26 07:50:34,225][123091] Updated weights for policy 0, policy_version 1033443 (0.0008) [2023-12-26 07:50:34,283][123091] Updated weights for policy 0, policy_version 1033453 (0.0008) [2023-12-26 07:50:34,674][123090] Updated weights for policy 1, policy_version 1026121 (0.0009) [2023-12-26 07:50:34,727][123090] Updated weights for policy 1, policy_version 1026131 (0.0009) [2023-12-26 07:50:34,784][123090] Updated weights for policy 1, policy_version 1026141 (0.0008) [2023-12-26 07:50:35,061][123091] Updated weights for policy 0, policy_version 1033463 (0.0006) [2023-12-26 07:50:35,114][123091] Updated weights for policy 0, policy_version 1033473 (0.0005) [2023-12-26 07:50:35,163][123091] Updated weights for policy 0, policy_version 1033483 (0.0005) [2023-12-26 07:50:35,742][123090] Updated weights for policy 1, policy_version 1026151 (0.0010) [2023-12-26 07:50:35,796][123090] Updated weights for policy 1, policy_version 1026161 (0.0010) [2023-12-26 07:50:35,822][123091] Updated weights for policy 0, policy_version 1033493 (0.0005) [2023-12-26 07:50:35,854][123090] Updated weights for policy 1, policy_version 1026171 (0.0009) [2023-12-26 07:50:35,876][123091] Updated weights for policy 0, policy_version 1033503 (0.0005) [2023-12-26 07:50:35,934][123091] Updated weights for policy 0, policy_version 1033513 (0.0005) [2023-12-26 07:50:36,678][123090] Updated weights for policy 1, policy_version 1026181 (0.0009) [2023-12-26 07:50:36,731][123090] Updated weights for policy 1, policy_version 1026191 (0.0009) [2023-12-26 07:50:36,741][123091] Updated weights for policy 0, policy_version 1033523 (0.0010) [2023-12-26 07:50:36,790][123090] Updated weights for policy 1, policy_version 1026201 (0.0006) [2023-12-26 07:50:36,805][123091] Updated weights for policy 0, policy_version 1033533 (0.0011) [2023-12-26 07:50:36,872][123091] Updated weights for policy 0, policy_version 1033543 (0.0011) [2023-12-26 07:50:37,631][123090] Updated weights for policy 1, policy_version 1026211 (0.0008) [2023-12-26 07:50:37,685][123091] Updated weights for policy 0, policy_version 1033553 (0.0011) [2023-12-26 07:50:37,690][123090] Updated weights for policy 1, policy_version 1026221 (0.0009) [2023-12-26 07:50:37,745][123090] Updated weights for policy 1, policy_version 1026231 (0.0006) [2023-12-26 07:50:37,748][123091] Updated weights for policy 0, policy_version 1033563 (0.0011) [2023-12-26 07:50:37,809][123091] Updated weights for policy 0, policy_version 1033573 (0.0011) [2023-12-26 07:50:37,864][123091] Updated weights for policy 0, policy_version 1033583 (0.0011) [2023-12-26 07:50:38,446][123090] Updated weights for policy 1, policy_version 1026241 (0.0006) [2023-12-26 07:50:38,498][123090] Updated weights for policy 1, policy_version 1026251 (0.0010) [2023-12-26 07:50:38,554][123090] Updated weights for policy 1, policy_version 1026261 (0.0011) [2023-12-26 07:50:38,606][123090] Updated weights for policy 1, policy_version 1026271 (0.0010) [2023-12-26 07:50:38,713][123091] Updated weights for policy 0, policy_version 1033593 (0.0011) [2023-12-26 07:50:38,765][123091] Updated weights for policy 0, policy_version 1033603 (0.0011) [2023-12-26 07:50:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 527327232. Throughput: 0: 8949.5, 1: 9010.4. Samples: 527305100. Policy #0 lag: (min: 22.0, avg: 27.5, max: 54.0) [2023-12-26 07:50:38,785][121949] Avg episode reward: [(0, '6211.956'), (1, '6034.524')] [2023-12-26 07:50:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001026272_262725632.pth... [2023-12-26 07:50:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001025216_262455296.pth [2023-12-26 07:50:38,816][123091] Updated weights for policy 0, policy_version 1033613 (0.0010) [2023-12-26 07:50:38,833][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001033616_264609792.pth... [2023-12-26 07:50:38,836][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001032560_264339456.pth [2023-12-26 07:50:39,379][123090] Updated weights for policy 1, policy_version 1026281 (0.0012) [2023-12-26 07:50:39,448][123090] Updated weights for policy 1, policy_version 1026291 (0.0010) [2023-12-26 07:50:39,497][123090] Updated weights for policy 1, policy_version 1026301 (0.0010) [2023-12-26 07:50:39,663][123091] Updated weights for policy 0, policy_version 1033623 (0.0009) [2023-12-26 07:50:39,730][123091] Updated weights for policy 0, policy_version 1033633 (0.0008) [2023-12-26 07:50:39,787][123091] Updated weights for policy 0, policy_version 1033643 (0.0009) [2023-12-26 07:50:40,287][123090] Updated weights for policy 1, policy_version 1026311 (0.0007) [2023-12-26 07:50:40,344][123090] Updated weights for policy 1, policy_version 1026321 (0.0006) [2023-12-26 07:50:40,393][123090] Updated weights for policy 1, policy_version 1026331 (0.0009) [2023-12-26 07:50:40,676][123091] Updated weights for policy 0, policy_version 1033653 (0.0009) [2023-12-26 07:50:40,728][123091] Updated weights for policy 0, policy_version 1033663 (0.0009) [2023-12-26 07:50:40,785][123091] Updated weights for policy 0, policy_version 1033673 (0.0009) [2023-12-26 07:50:41,197][123090] Updated weights for policy 1, policy_version 1026341 (0.0010) [2023-12-26 07:50:41,265][123090] Updated weights for policy 1, policy_version 1026351 (0.0011) [2023-12-26 07:50:41,329][123090] Updated weights for policy 1, policy_version 1026361 (0.0011) [2023-12-26 07:50:41,649][123091] Updated weights for policy 0, policy_version 1033683 (0.0007) [2023-12-26 07:50:41,713][123091] Updated weights for policy 0, policy_version 1033693 (0.0008) [2023-12-26 07:50:41,781][123091] Updated weights for policy 0, policy_version 1033703 (0.0008) [2023-12-26 07:50:42,177][123090] Updated weights for policy 1, policy_version 1026371 (0.0009) [2023-12-26 07:50:42,251][123090] Updated weights for policy 1, policy_version 1026381 (0.0006) [2023-12-26 07:50:42,319][123090] Updated weights for policy 1, policy_version 1026391 (0.0010) [2023-12-26 07:50:42,523][123091] Updated weights for policy 0, policy_version 1033713 (0.0009) [2023-12-26 07:50:42,581][123091] Updated weights for policy 0, policy_version 1033723 (0.0006) [2023-12-26 07:50:42,652][123091] Updated weights for policy 0, policy_version 1033733 (0.0006) [2023-12-26 07:50:42,726][123091] Updated weights for policy 0, policy_version 1033743 (0.0006) [2023-12-26 07:50:42,939][123090] Updated weights for policy 1, policy_version 1026401 (0.0008) [2023-12-26 07:50:43,012][123090] Updated weights for policy 1, policy_version 1026411 (0.0005) [2023-12-26 07:50:43,069][123090] Updated weights for policy 1, policy_version 1026421 (0.0005) [2023-12-26 07:50:43,127][123090] Updated weights for policy 1, policy_version 1026431 (0.0006) [2023-12-26 07:50:43,430][123091] Updated weights for policy 0, policy_version 1033753 (0.0008) [2023-12-26 07:50:43,486][123091] Updated weights for policy 0, policy_version 1033763 (0.0005) [2023-12-26 07:50:43,542][123091] Updated weights for policy 0, policy_version 1033773 (0.0005) [2023-12-26 07:50:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 527417344. Throughput: 0: 8872.6, 1: 8970.3. Samples: 527409904. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:50:43,784][121949] Avg episode reward: [(0, '6253.251'), (1, '6070.232')] [2023-12-26 07:50:43,844][123090] Updated weights for policy 1, policy_version 1026441 (0.0007) [2023-12-26 07:50:43,914][123090] Updated weights for policy 1, policy_version 1026451 (0.0008) [2023-12-26 07:50:43,978][123090] Updated weights for policy 1, policy_version 1026461 (0.0009) [2023-12-26 07:50:44,270][123091] Updated weights for policy 0, policy_version 1033783 (0.0005) [2023-12-26 07:50:44,339][123091] Updated weights for policy 0, policy_version 1033793 (0.0005) [2023-12-26 07:50:44,413][123091] Updated weights for policy 0, policy_version 1033803 (0.0007) [2023-12-26 07:50:44,808][123090] Updated weights for policy 1, policy_version 1026471 (0.0010) [2023-12-26 07:50:44,863][123090] Updated weights for policy 1, policy_version 1026481 (0.0007) [2023-12-26 07:50:44,929][123090] Updated weights for policy 1, policy_version 1026491 (0.0006) [2023-12-26 07:50:45,163][123091] Updated weights for policy 0, policy_version 1033813 (0.0007) [2023-12-26 07:50:45,215][123091] Updated weights for policy 0, policy_version 1033823 (0.0008) [2023-12-26 07:50:45,267][123091] Updated weights for policy 0, policy_version 1033833 (0.0010) [2023-12-26 07:50:45,784][123090] Updated weights for policy 1, policy_version 1026501 (0.0007) [2023-12-26 07:50:45,851][123090] Updated weights for policy 1, policy_version 1026511 (0.0006) [2023-12-26 07:50:45,909][123090] Updated weights for policy 1, policy_version 1026521 (0.0005) [2023-12-26 07:50:46,104][123091] Updated weights for policy 0, policy_version 1033843 (0.0009) [2023-12-26 07:50:46,158][123091] Updated weights for policy 0, policy_version 1033853 (0.0009) [2023-12-26 07:50:46,210][123091] Updated weights for policy 0, policy_version 1033863 (0.0005) [2023-12-26 07:50:46,538][123090] Updated weights for policy 1, policy_version 1026531 (0.0005) [2023-12-26 07:50:46,610][123090] Updated weights for policy 1, policy_version 1026541 (0.0005) [2023-12-26 07:50:46,669][123090] Updated weights for policy 1, policy_version 1026551 (0.0005) [2023-12-26 07:50:46,918][123091] Updated weights for policy 0, policy_version 1033873 (0.0005) [2023-12-26 07:50:46,973][123091] Updated weights for policy 0, policy_version 1033883 (0.0005) [2023-12-26 07:50:47,021][123091] Updated weights for policy 0, policy_version 1033893 (0.0005) [2023-12-26 07:50:47,075][123091] Updated weights for policy 0, policy_version 1033903 (0.0005) [2023-12-26 07:50:47,425][123090] Updated weights for policy 1, policy_version 1026561 (0.0007) [2023-12-26 07:50:47,473][123090] Updated weights for policy 1, policy_version 1026571 (0.0005) [2023-12-26 07:50:47,522][123090] Updated weights for policy 1, policy_version 1026581 (0.0006) [2023-12-26 07:50:47,573][123090] Updated weights for policy 1, policy_version 1026591 (0.0006) [2023-12-26 07:50:47,702][123091] Updated weights for policy 0, policy_version 1033913 (0.0007) [2023-12-26 07:50:47,750][123091] Updated weights for policy 0, policy_version 1033923 (0.0010) [2023-12-26 07:50:47,794][123091] Updated weights for policy 0, policy_version 1033933 (0.0010) [2023-12-26 07:50:48,223][123090] Updated weights for policy 1, policy_version 1026601 (0.0010) [2023-12-26 07:50:48,278][123090] Updated weights for policy 1, policy_version 1026611 (0.0010) [2023-12-26 07:50:48,346][123090] Updated weights for policy 1, policy_version 1026621 (0.0011) [2023-12-26 07:50:48,521][123091] Updated weights for policy 0, policy_version 1033943 (0.0011) [2023-12-26 07:50:48,577][123091] Updated weights for policy 0, policy_version 1033953 (0.0011) [2023-12-26 07:50:48,638][123091] Updated weights for policy 0, policy_version 1033963 (0.0011) [2023-12-26 07:50:48,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 527515648. Throughput: 0: 8968.5, 1: 8966.7. Samples: 527523904. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:50:48,784][121949] Avg episode reward: [(0, '6272.344'), (1, '6018.669')] [2023-12-26 07:50:49,121][123090] Updated weights for policy 1, policy_version 1026631 (0.0010) [2023-12-26 07:50:49,184][123090] Updated weights for policy 1, policy_version 1026641 (0.0010) [2023-12-26 07:50:49,248][123090] Updated weights for policy 1, policy_version 1026651 (0.0011) [2023-12-26 07:50:49,430][123091] Updated weights for policy 0, policy_version 1033973 (0.0010) [2023-12-26 07:50:49,487][123091] Updated weights for policy 0, policy_version 1033983 (0.0007) [2023-12-26 07:50:49,549][123091] Updated weights for policy 0, policy_version 1033993 (0.0008) [2023-12-26 07:50:50,099][123090] Updated weights for policy 1, policy_version 1026661 (0.0010) [2023-12-26 07:50:50,177][123090] Updated weights for policy 1, policy_version 1026671 (0.0010) [2023-12-26 07:50:50,239][123090] Updated weights for policy 1, policy_version 1026681 (0.0010) [2023-12-26 07:50:50,376][123091] Updated weights for policy 0, policy_version 1034003 (0.0010) [2023-12-26 07:50:50,425][123091] Updated weights for policy 0, policy_version 1034013 (0.0005) [2023-12-26 07:50:50,470][123091] Updated weights for policy 0, policy_version 1034023 (0.0005) [2023-12-26 07:50:51,049][123090] Updated weights for policy 1, policy_version 1026691 (0.0010) [2023-12-26 07:50:51,119][123090] Updated weights for policy 1, policy_version 1026701 (0.0008) [2023-12-26 07:50:51,175][123090] Updated weights for policy 1, policy_version 1026711 (0.0008) [2023-12-26 07:50:51,281][123091] Updated weights for policy 0, policy_version 1034033 (0.0005) [2023-12-26 07:50:51,333][123091] Updated weights for policy 0, policy_version 1034043 (0.0006) [2023-12-26 07:50:51,401][123091] Updated weights for policy 0, policy_version 1034053 (0.0007) [2023-12-26 07:50:51,459][123091] Updated weights for policy 0, policy_version 1034063 (0.0006) [2023-12-26 07:50:51,994][123090] Updated weights for policy 1, policy_version 1026721 (0.0008) [2023-12-26 07:50:52,058][123090] Updated weights for policy 1, policy_version 1026731 (0.0011) [2023-12-26 07:50:52,122][123090] Updated weights for policy 1, policy_version 1026741 (0.0010) [2023-12-26 07:50:52,193][123090] Updated weights for policy 1, policy_version 1026751 (0.0011) [2023-12-26 07:50:52,261][123091] Updated weights for policy 0, policy_version 1034073 (0.0006) [2023-12-26 07:50:52,320][123091] Updated weights for policy 0, policy_version 1034083 (0.0006) [2023-12-26 07:50:52,392][123091] Updated weights for policy 0, policy_version 1034093 (0.0009) [2023-12-26 07:50:53,032][123090] Updated weights for policy 1, policy_version 1026761 (0.0011) [2023-12-26 07:50:53,097][123090] Updated weights for policy 1, policy_version 1026771 (0.0011) [2023-12-26 07:50:53,132][123091] Updated weights for policy 0, policy_version 1034103 (0.0009) [2023-12-26 07:50:53,157][123090] Updated weights for policy 1, policy_version 1026781 (0.0011) [2023-12-26 07:50:53,195][123091] Updated weights for policy 0, policy_version 1034113 (0.0012) [2023-12-26 07:50:53,261][123091] Updated weights for policy 0, policy_version 1034123 (0.0009) [2023-12-26 07:50:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 527597568. Throughput: 0: 8975.6, 1: 8936.5. Samples: 527576592. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:50:53,785][121949] Avg episode reward: [(0, '6184.045'), (1, '5941.070')] [2023-12-26 07:50:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001034128_264740864.pth... [2023-12-26 07:50:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001026784_262856704.pth... [2023-12-26 07:50:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001025760_262594560.pth [2023-12-26 07:50:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001033072_264470528.pth [2023-12-26 07:50:53,962][123090] Updated weights for policy 1, policy_version 1026791 (0.0007) [2023-12-26 07:50:54,027][123090] Updated weights for policy 1, policy_version 1026801 (0.0008) [2023-12-26 07:50:54,047][123091] Updated weights for policy 0, policy_version 1034133 (0.0010) [2023-12-26 07:50:54,087][123090] Updated weights for policy 1, policy_version 1026811 (0.0010) [2023-12-26 07:50:54,107][123091] Updated weights for policy 0, policy_version 1034143 (0.0011) [2023-12-26 07:50:54,165][123091] Updated weights for policy 0, policy_version 1034153 (0.0011) [2023-12-26 07:50:54,898][123090] Updated weights for policy 1, policy_version 1026821 (0.0009) [2023-12-26 07:50:54,958][123090] Updated weights for policy 1, policy_version 1026831 (0.0008) [2023-12-26 07:50:54,994][123091] Updated weights for policy 0, policy_version 1034163 (0.0011) [2023-12-26 07:50:55,027][123090] Updated weights for policy 1, policy_version 1026841 (0.0009) [2023-12-26 07:50:55,058][123091] Updated weights for policy 0, policy_version 1034173 (0.0007) [2023-12-26 07:50:55,121][123091] Updated weights for policy 0, policy_version 1034183 (0.0006) [2023-12-26 07:50:55,783][123090] Updated weights for policy 1, policy_version 1026851 (0.0008) [2023-12-26 07:50:55,836][123090] Updated weights for policy 1, policy_version 1026861 (0.0005) [2023-12-26 07:50:55,866][123091] Updated weights for policy 0, policy_version 1034193 (0.0009) [2023-12-26 07:50:55,895][123090] Updated weights for policy 1, policy_version 1026871 (0.0005) [2023-12-26 07:50:55,913][123091] Updated weights for policy 0, policy_version 1034203 (0.0010) [2023-12-26 07:50:55,974][123091] Updated weights for policy 0, policy_version 1034213 (0.0010) [2023-12-26 07:50:56,029][123091] Updated weights for policy 0, policy_version 1034223 (0.0007) [2023-12-26 07:50:56,630][123090] Updated weights for policy 1, policy_version 1026881 (0.0007) [2023-12-26 07:50:56,690][123090] Updated weights for policy 1, policy_version 1026891 (0.0009) [2023-12-26 07:50:56,699][123091] Updated weights for policy 0, policy_version 1034233 (0.0007) [2023-12-26 07:50:56,743][123090] Updated weights for policy 1, policy_version 1026901 (0.0008) [2023-12-26 07:50:56,762][123091] Updated weights for policy 0, policy_version 1034243 (0.0005) [2023-12-26 07:50:56,796][123090] Updated weights for policy 1, policy_version 1026911 (0.0007) [2023-12-26 07:50:56,811][123091] Updated weights for policy 0, policy_version 1034253 (0.0006) [2023-12-26 07:50:57,451][123091] Updated weights for policy 0, policy_version 1034263 (0.0009) [2023-12-26 07:50:57,463][123090] Updated weights for policy 1, policy_version 1026921 (0.0006) [2023-12-26 07:50:57,499][123091] Updated weights for policy 0, policy_version 1034273 (0.0010) [2023-12-26 07:50:57,506][123090] Updated weights for policy 1, policy_version 1026931 (0.0005) [2023-12-26 07:50:57,542][123091] Updated weights for policy 0, policy_version 1034283 (0.0010) [2023-12-26 07:50:57,553][123090] Updated weights for policy 1, policy_version 1026941 (0.0005) [2023-12-26 07:50:58,311][123091] Updated weights for policy 0, policy_version 1034293 (0.0008) [2023-12-26 07:50:58,394][123091] Updated weights for policy 0, policy_version 1034303 (0.0008) [2023-12-26 07:50:58,428][123090] Updated weights for policy 1, policy_version 1026951 (0.0007) [2023-12-26 07:50:58,459][123091] Updated weights for policy 0, policy_version 1034313 (0.0008) [2023-12-26 07:50:58,496][123090] Updated weights for policy 1, policy_version 1026961 (0.0008) [2023-12-26 07:50:58,559][123090] Updated weights for policy 1, policy_version 1026971 (0.0008) [2023-12-26 07:50:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 527695872. Throughput: 0: 9077.4, 1: 8952.5. Samples: 527686036. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:50:58,785][121949] Avg episode reward: [(0, '6238.683'), (1, '5942.962')] [2023-12-26 07:50:59,408][123091] Updated weights for policy 0, policy_version 1034323 (0.0008) [2023-12-26 07:50:59,461][123090] Updated weights for policy 1, policy_version 1026981 (0.0007) [2023-12-26 07:50:59,463][123091] Updated weights for policy 0, policy_version 1034333 (0.0008) [2023-12-26 07:50:59,521][123090] Updated weights for policy 1, policy_version 1026991 (0.0006) [2023-12-26 07:50:59,528][123091] Updated weights for policy 0, policy_version 1034343 (0.0008) [2023-12-26 07:50:59,577][123090] Updated weights for policy 1, policy_version 1027001 (0.0006) [2023-12-26 07:51:00,289][123091] Updated weights for policy 0, policy_version 1034353 (0.0009) [2023-12-26 07:51:00,342][123090] Updated weights for policy 1, policy_version 1027011 (0.0007) [2023-12-26 07:51:00,352][123091] Updated weights for policy 0, policy_version 1034363 (0.0009) [2023-12-26 07:51:00,398][123090] Updated weights for policy 1, policy_version 1027021 (0.0008) [2023-12-26 07:51:00,409][123091] Updated weights for policy 0, policy_version 1034373 (0.0010) [2023-12-26 07:51:00,456][123091] Updated weights for policy 0, policy_version 1034383 (0.0006) [2023-12-26 07:51:00,456][123090] Updated weights for policy 1, policy_version 1027031 (0.0009) [2023-12-26 07:51:01,246][123090] Updated weights for policy 1, policy_version 1027041 (0.0009) [2023-12-26 07:51:01,301][123090] Updated weights for policy 1, policy_version 1027051 (0.0007) [2023-12-26 07:51:01,307][123091] Updated weights for policy 0, policy_version 1034393 (0.0008) [2023-12-26 07:51:01,366][123090] Updated weights for policy 1, policy_version 1027061 (0.0008) [2023-12-26 07:51:01,372][123091] Updated weights for policy 0, policy_version 1034403 (0.0008) [2023-12-26 07:51:01,424][123090] Updated weights for policy 1, policy_version 1027071 (0.0008) [2023-12-26 07:51:01,438][123091] Updated weights for policy 0, policy_version 1034413 (0.0008) [2023-12-26 07:51:02,238][123091] Updated weights for policy 0, policy_version 1034423 (0.0009) [2023-12-26 07:51:02,304][123091] Updated weights for policy 0, policy_version 1034433 (0.0008) [2023-12-26 07:51:02,315][123090] Updated weights for policy 1, policy_version 1027081 (0.0008) [2023-12-26 07:51:02,370][123091] Updated weights for policy 0, policy_version 1034443 (0.0008) [2023-12-26 07:51:02,374][123090] Updated weights for policy 1, policy_version 1027091 (0.0008) [2023-12-26 07:51:02,432][123090] Updated weights for policy 1, policy_version 1027101 (0.0009) [2023-12-26 07:51:03,076][123091] Updated weights for policy 0, policy_version 1034453 (0.0007) [2023-12-26 07:51:03,134][123091] Updated weights for policy 0, policy_version 1034463 (0.0006) [2023-12-26 07:51:03,188][123091] Updated weights for policy 0, policy_version 1034473 (0.0006) [2023-12-26 07:51:03,228][123090] Updated weights for policy 1, policy_version 1027111 (0.0010) [2023-12-26 07:51:03,292][123090] Updated weights for policy 1, policy_version 1027121 (0.0011) [2023-12-26 07:51:03,353][123090] Updated weights for policy 1, policy_version 1027131 (0.0009) [2023-12-26 07:51:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 527777792. Throughput: 0: 9042.9, 1: 8866.7. Samples: 527792016. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:03,785][121949] Avg episode reward: [(0, '6246.105'), (1, '5958.904')] [2023-12-26 07:51:03,809][123091] Updated weights for policy 0, policy_version 1034483 (0.0005) [2023-12-26 07:51:03,875][123091] Updated weights for policy 0, policy_version 1034493 (0.0009) [2023-12-26 07:51:03,938][123091] Updated weights for policy 0, policy_version 1034503 (0.0011) [2023-12-26 07:51:04,098][123090] Updated weights for policy 1, policy_version 1027141 (0.0008) [2023-12-26 07:51:04,167][123090] Updated weights for policy 1, policy_version 1027151 (0.0010) [2023-12-26 07:51:04,234][123090] Updated weights for policy 1, policy_version 1027161 (0.0009) [2023-12-26 07:51:04,727][123091] Updated weights for policy 0, policy_version 1034513 (0.0011) [2023-12-26 07:51:04,777][123091] Updated weights for policy 0, policy_version 1034523 (0.0010) [2023-12-26 07:51:04,840][123091] Updated weights for policy 0, policy_version 1034533 (0.0006) [2023-12-26 07:51:04,899][123091] Updated weights for policy 0, policy_version 1034543 (0.0005) [2023-12-26 07:51:05,000][123090] Updated weights for policy 1, policy_version 1027171 (0.0009) [2023-12-26 07:51:05,061][123090] Updated weights for policy 1, policy_version 1027181 (0.0009) [2023-12-26 07:51:05,113][123090] Updated weights for policy 1, policy_version 1027191 (0.0008) [2023-12-26 07:51:05,592][123091] Updated weights for policy 0, policy_version 1034553 (0.0010) [2023-12-26 07:51:05,649][123091] Updated weights for policy 0, policy_version 1034563 (0.0009) [2023-12-26 07:51:05,719][123091] Updated weights for policy 0, policy_version 1034573 (0.0005) [2023-12-26 07:51:06,000][123090] Updated weights for policy 1, policy_version 1027201 (0.0008) [2023-12-26 07:51:06,070][123090] Updated weights for policy 1, policy_version 1027211 (0.0010) [2023-12-26 07:51:06,139][123090] Updated weights for policy 1, policy_version 1027221 (0.0008) [2023-12-26 07:51:06,198][123090] Updated weights for policy 1, policy_version 1027231 (0.0010) [2023-12-26 07:51:06,373][123091] Updated weights for policy 0, policy_version 1034583 (0.0006) [2023-12-26 07:51:06,440][123091] Updated weights for policy 0, policy_version 1034593 (0.0006) [2023-12-26 07:51:06,508][123091] Updated weights for policy 0, policy_version 1034603 (0.0008) [2023-12-26 07:51:07,052][123090] Updated weights for policy 1, policy_version 1027241 (0.0009) [2023-12-26 07:51:07,106][123090] Updated weights for policy 1, policy_version 1027251 (0.0009) [2023-12-26 07:51:07,163][123090] Updated weights for policy 1, policy_version 1027261 (0.0009) [2023-12-26 07:51:07,271][123091] Updated weights for policy 0, policy_version 1034613 (0.0011) [2023-12-26 07:51:07,323][123091] Updated weights for policy 0, policy_version 1034623 (0.0010) [2023-12-26 07:51:07,372][123091] Updated weights for policy 0, policy_version 1034633 (0.0010) [2023-12-26 07:51:07,828][123090] Updated weights for policy 1, policy_version 1027271 (0.0007) [2023-12-26 07:51:07,881][123090] Updated weights for policy 1, policy_version 1027281 (0.0005) [2023-12-26 07:51:07,958][123090] Updated weights for policy 1, policy_version 1027291 (0.0005) [2023-12-26 07:51:08,222][123091] Updated weights for policy 0, policy_version 1034643 (0.0010) [2023-12-26 07:51:08,268][123091] Updated weights for policy 0, policy_version 1034653 (0.0005) [2023-12-26 07:51:08,315][123091] Updated weights for policy 0, policy_version 1034663 (0.0007) [2023-12-26 07:51:08,664][123090] Updated weights for policy 1, policy_version 1027301 (0.0006) [2023-12-26 07:51:08,734][123090] Updated weights for policy 1, policy_version 1027311 (0.0005) [2023-12-26 07:51:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 527867904. Throughput: 0: 9134.1, 1: 8855.2. Samples: 527845872. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:08,785][121949] Avg episode reward: [(0, '6220.241'), (1, '5991.687')] [2023-12-26 07:51:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001034672_264880128.pth... [2023-12-26 07:51:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001033616_264609792.pth [2023-12-26 07:51:08,810][123090] Updated weights for policy 1, policy_version 1027321 (0.0007) [2023-12-26 07:51:08,851][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001027328_262995968.pth... [2023-12-26 07:51:08,856][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001026272_262725632.pth [2023-12-26 07:51:09,146][123091] Updated weights for policy 0, policy_version 1034673 (0.0010) [2023-12-26 07:51:09,194][123091] Updated weights for policy 0, policy_version 1034683 (0.0010) [2023-12-26 07:51:09,260][123091] Updated weights for policy 0, policy_version 1034693 (0.0009) [2023-12-26 07:51:09,315][123091] Updated weights for policy 0, policy_version 1034703 (0.0006) [2023-12-26 07:51:09,602][123090] Updated weights for policy 1, policy_version 1027331 (0.0008) [2023-12-26 07:51:09,671][123090] Updated weights for policy 1, policy_version 1027341 (0.0008) [2023-12-26 07:51:09,735][123090] Updated weights for policy 1, policy_version 1027351 (0.0009) [2023-12-26 07:51:10,162][123091] Updated weights for policy 0, policy_version 1034713 (0.0010) [2023-12-26 07:51:10,216][123091] Updated weights for policy 0, policy_version 1034723 (0.0009) [2023-12-26 07:51:10,273][123091] Updated weights for policy 0, policy_version 1034733 (0.0009) [2023-12-26 07:51:10,538][123090] Updated weights for policy 1, policy_version 1027361 (0.0008) [2023-12-26 07:51:10,603][123090] Updated weights for policy 1, policy_version 1027371 (0.0005) [2023-12-26 07:51:10,665][123090] Updated weights for policy 1, policy_version 1027381 (0.0005) [2023-12-26 07:51:10,725][123090] Updated weights for policy 1, policy_version 1027391 (0.0008) [2023-12-26 07:51:11,171][123091] Updated weights for policy 0, policy_version 1034743 (0.0010) [2023-12-26 07:51:11,222][123091] Updated weights for policy 0, policy_version 1034753 (0.0010) [2023-12-26 07:51:11,290][123091] Updated weights for policy 0, policy_version 1034763 (0.0011) [2023-12-26 07:51:11,552][123090] Updated weights for policy 1, policy_version 1027401 (0.0007) [2023-12-26 07:51:11,623][123090] Updated weights for policy 1, policy_version 1027411 (0.0007) [2023-12-26 07:51:11,698][123090] Updated weights for policy 1, policy_version 1027421 (0.0007) [2023-12-26 07:51:12,120][123091] Updated weights for policy 0, policy_version 1034773 (0.0010) [2023-12-26 07:51:12,174][123091] Updated weights for policy 0, policy_version 1034783 (0.0010) [2023-12-26 07:51:12,231][123091] Updated weights for policy 0, policy_version 1034793 (0.0008) [2023-12-26 07:51:12,449][123090] Updated weights for policy 1, policy_version 1027431 (0.0010) [2023-12-26 07:51:12,519][123090] Updated weights for policy 1, policy_version 1027441 (0.0010) [2023-12-26 07:51:12,583][123090] Updated weights for policy 1, policy_version 1027451 (0.0009) [2023-12-26 07:51:13,077][123091] Updated weights for policy 0, policy_version 1034803 (0.0010) [2023-12-26 07:51:13,146][123091] Updated weights for policy 0, policy_version 1034813 (0.0010) [2023-12-26 07:51:13,198][123091] Updated weights for policy 0, policy_version 1034823 (0.0010) [2023-12-26 07:51:13,410][123090] Updated weights for policy 1, policy_version 1027462 (0.0010) [2023-12-26 07:51:13,473][123090] Updated weights for policy 1, policy_version 1027472 (0.0009) [2023-12-26 07:51:13,539][123090] Updated weights for policy 1, policy_version 1027482 (0.0008) [2023-12-26 07:51:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 527958016. Throughput: 0: 8993.8, 1: 8871.2. Samples: 527950296. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:13,784][121949] Avg episode reward: [(0, '6163.614'), (1, '6006.382')] [2023-12-26 07:51:14,058][123091] Updated weights for policy 0, policy_version 1034834 (0.0010) [2023-12-26 07:51:14,121][123091] Updated weights for policy 0, policy_version 1034844 (0.0009) [2023-12-26 07:51:14,187][123091] Updated weights for policy 0, policy_version 1034854 (0.0011) [2023-12-26 07:51:14,246][123091] Updated weights for policy 0, policy_version 1034864 (0.0011) [2023-12-26 07:51:14,319][123090] Updated weights for policy 1, policy_version 1027492 (0.0008) [2023-12-26 07:51:14,382][123090] Updated weights for policy 1, policy_version 1027502 (0.0009) [2023-12-26 07:51:14,442][123090] Updated weights for policy 1, policy_version 1027512 (0.0010) [2023-12-26 07:51:15,096][123091] Updated weights for policy 0, policy_version 1034874 (0.0011) [2023-12-26 07:51:15,157][123091] Updated weights for policy 0, policy_version 1034884 (0.0011) [2023-12-26 07:51:15,188][123090] Updated weights for policy 1, policy_version 1027522 (0.0010) [2023-12-26 07:51:15,218][123091] Updated weights for policy 0, policy_version 1034894 (0.0011) [2023-12-26 07:51:15,256][123090] Updated weights for policy 1, policy_version 1027532 (0.0007) [2023-12-26 07:51:15,312][123090] Updated weights for policy 1, policy_version 1027542 (0.0007) [2023-12-26 07:51:15,386][123090] Updated weights for policy 1, policy_version 1027552 (0.0005) [2023-12-26 07:51:15,905][123091] Updated weights for policy 0, policy_version 1034904 (0.0010) [2023-12-26 07:51:15,952][123091] Updated weights for policy 0, policy_version 1034914 (0.0010) [2023-12-26 07:51:16,007][123091] Updated weights for policy 0, policy_version 1034924 (0.0010) [2023-12-26 07:51:16,177][123090] Updated weights for policy 1, policy_version 1027562 (0.0011) [2023-12-26 07:51:16,229][123090] Updated weights for policy 1, policy_version 1027572 (0.0010) [2023-12-26 07:51:16,277][123090] Updated weights for policy 1, policy_version 1027582 (0.0010) [2023-12-26 07:51:16,719][123091] Updated weights for policy 0, policy_version 1034934 (0.0007) [2023-12-26 07:51:16,777][123091] Updated weights for policy 0, policy_version 1034944 (0.0005) [2023-12-26 07:51:16,828][123091] Updated weights for policy 0, policy_version 1034954 (0.0005) [2023-12-26 07:51:17,128][123090] Updated weights for policy 1, policy_version 1027592 (0.0006) [2023-12-26 07:51:17,180][123090] Updated weights for policy 1, policy_version 1027602 (0.0005) [2023-12-26 07:51:17,231][123090] Updated weights for policy 1, policy_version 1027612 (0.0005) [2023-12-26 07:51:17,490][123091] Updated weights for policy 0, policy_version 1034964 (0.0005) [2023-12-26 07:51:17,542][123091] Updated weights for policy 0, policy_version 1034974 (0.0005) [2023-12-26 07:51:17,597][123091] Updated weights for policy 0, policy_version 1034984 (0.0005) [2023-12-26 07:51:17,885][123090] Updated weights for policy 1, policy_version 1027622 (0.0005) [2023-12-26 07:51:17,932][123090] Updated weights for policy 1, policy_version 1027632 (0.0005) [2023-12-26 07:51:17,978][123090] Updated weights for policy 1, policy_version 1027642 (0.0005) [2023-12-26 07:51:18,226][123091] Updated weights for policy 0, policy_version 1034994 (0.0006) [2023-12-26 07:51:18,273][123091] Updated weights for policy 0, policy_version 1035004 (0.0010) [2023-12-26 07:51:18,336][123091] Updated weights for policy 0, policy_version 1035014 (0.0011) [2023-12-26 07:51:18,399][123091] Updated weights for policy 0, policy_version 1035024 (0.0011) [2023-12-26 07:51:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 528048128. Throughput: 0: 9105.7, 1: 8915.5. Samples: 528061928. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:18,785][123090] Updated weights for policy 1, policy_version 1027652 (0.0007) [2023-12-26 07:51:18,785][121949] Avg episode reward: [(0, '6140.466'), (1, '5870.964')] [2023-12-26 07:51:18,848][123090] Updated weights for policy 1, policy_version 1027662 (0.0010) [2023-12-26 07:51:18,910][123090] Updated weights for policy 1, policy_version 1027672 (0.0010) [2023-12-26 07:51:19,164][123091] Updated weights for policy 0, policy_version 1035034 (0.0011) [2023-12-26 07:51:19,239][123091] Updated weights for policy 0, policy_version 1035044 (0.0011) [2023-12-26 07:51:19,311][123091] Updated weights for policy 0, policy_version 1035054 (0.0011) [2023-12-26 07:51:19,716][123090] Updated weights for policy 1, policy_version 1027682 (0.0010) [2023-12-26 07:51:19,771][123090] Updated weights for policy 1, policy_version 1027692 (0.0009) [2023-12-26 07:51:19,839][123090] Updated weights for policy 1, policy_version 1027702 (0.0007) [2023-12-26 07:51:19,903][123090] Updated weights for policy 1, policy_version 1027712 (0.0009) [2023-12-26 07:51:20,100][123091] Updated weights for policy 0, policy_version 1035064 (0.0007) [2023-12-26 07:51:20,152][123091] Updated weights for policy 0, policy_version 1035074 (0.0006) [2023-12-26 07:51:20,217][123091] Updated weights for policy 0, policy_version 1035084 (0.0006) [2023-12-26 07:51:20,737][123090] Updated weights for policy 1, policy_version 1027722 (0.0010) [2023-12-26 07:51:20,804][123090] Updated weights for policy 1, policy_version 1027732 (0.0009) [2023-12-26 07:51:20,870][123090] Updated weights for policy 1, policy_version 1027742 (0.0009) [2023-12-26 07:51:20,930][123091] Updated weights for policy 0, policy_version 1035094 (0.0009) [2023-12-26 07:51:20,998][123091] Updated weights for policy 0, policy_version 1035104 (0.0006) [2023-12-26 07:51:21,072][123091] Updated weights for policy 0, policy_version 1035114 (0.0010) [2023-12-26 07:51:21,822][123090] Updated weights for policy 1, policy_version 1027752 (0.0009) [2023-12-26 07:51:21,837][123091] Updated weights for policy 0, policy_version 1035124 (0.0010) [2023-12-26 07:51:21,889][123090] Updated weights for policy 1, policy_version 1027762 (0.0008) [2023-12-26 07:51:21,893][123091] Updated weights for policy 0, policy_version 1035134 (0.0009) [2023-12-26 07:51:21,959][123090] Updated weights for policy 1, policy_version 1027772 (0.0010) [2023-12-26 07:51:21,961][123091] Updated weights for policy 0, policy_version 1035144 (0.0006) [2023-12-26 07:51:22,696][123091] Updated weights for policy 0, policy_version 1035154 (0.0008) [2023-12-26 07:51:22,767][123091] Updated weights for policy 0, policy_version 1035164 (0.0006) [2023-12-26 07:51:22,825][123090] Updated weights for policy 1, policy_version 1027782 (0.0010) [2023-12-26 07:51:22,834][123091] Updated weights for policy 0, policy_version 1035174 (0.0007) [2023-12-26 07:51:22,893][123090] Updated weights for policy 1, policy_version 1027792 (0.0010) [2023-12-26 07:51:22,896][123091] Updated weights for policy 0, policy_version 1035184 (0.0008) [2023-12-26 07:51:22,956][123090] Updated weights for policy 1, policy_version 1027802 (0.0009) [2023-12-26 07:51:23,583][123091] Updated weights for policy 0, policy_version 1035194 (0.0009) [2023-12-26 07:51:23,640][123091] Updated weights for policy 0, policy_version 1035204 (0.0009) [2023-12-26 07:51:23,689][123091] Updated weights for policy 0, policy_version 1035214 (0.0009) [2023-12-26 07:51:23,702][123090] Updated weights for policy 1, policy_version 1027812 (0.0008) [2023-12-26 07:51:23,770][123090] Updated weights for policy 1, policy_version 1027822 (0.0008) [2023-12-26 07:51:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 528138240. Throughput: 0: 9093.7, 1: 8896.0. Samples: 528114636. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:23,785][121949] Avg episode reward: [(0, '6089.941'), (1, '5659.065')] [2023-12-26 07:51:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001035216_265019392.pth... [2023-12-26 07:51:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001034128_264740864.pth [2023-12-26 07:51:23,840][123090] Updated weights for policy 1, policy_version 1027832 (0.0005) [2023-12-26 07:51:23,889][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001027840_263127040.pth... [2023-12-26 07:51:23,895][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001026784_262856704.pth [2023-12-26 07:51:24,510][123091] Updated weights for policy 0, policy_version 1035224 (0.0009) [2023-12-26 07:51:24,555][123090] Updated weights for policy 1, policy_version 1027842 (0.0005) [2023-12-26 07:51:24,582][123091] Updated weights for policy 0, policy_version 1035235 (0.0010) [2023-12-26 07:51:24,603][123090] Updated weights for policy 1, policy_version 1027852 (0.0006) [2023-12-26 07:51:24,631][123091] Updated weights for policy 0, policy_version 1035245 (0.0006) [2023-12-26 07:51:24,656][123090] Updated weights for policy 1, policy_version 1027862 (0.0009) [2023-12-26 07:51:24,705][123090] Updated weights for policy 1, policy_version 1027872 (0.0009) [2023-12-26 07:51:25,437][123091] Updated weights for policy 0, policy_version 1035255 (0.0006) [2023-12-26 07:51:25,487][123091] Updated weights for policy 0, policy_version 1035265 (0.0007) [2023-12-26 07:51:25,496][123090] Updated weights for policy 1, policy_version 1027882 (0.0009) [2023-12-26 07:51:25,535][123091] Updated weights for policy 0, policy_version 1035275 (0.0007) [2023-12-26 07:51:25,552][123090] Updated weights for policy 1, policy_version 1027892 (0.0010) [2023-12-26 07:51:25,617][123090] Updated weights for policy 1, policy_version 1027902 (0.0009) [2023-12-26 07:51:26,376][123091] Updated weights for policy 0, policy_version 1035285 (0.0009) [2023-12-26 07:51:26,438][123091] Updated weights for policy 0, policy_version 1035295 (0.0009) [2023-12-26 07:51:26,464][123090] Updated weights for policy 1, policy_version 1027912 (0.0010) [2023-12-26 07:51:26,502][123091] Updated weights for policy 0, policy_version 1035305 (0.0011) [2023-12-26 07:51:26,524][123090] Updated weights for policy 1, policy_version 1027922 (0.0011) [2023-12-26 07:51:26,568][123090] Updated weights for policy 1, policy_version 1027932 (0.0010) [2023-12-26 07:51:27,297][123091] Updated weights for policy 0, policy_version 1035315 (0.0010) [2023-12-26 07:51:27,347][123090] Updated weights for policy 1, policy_version 1027942 (0.0010) [2023-12-26 07:51:27,353][123091] Updated weights for policy 0, policy_version 1035325 (0.0007) [2023-12-26 07:51:27,406][123091] Updated weights for policy 0, policy_version 1035335 (0.0006) [2023-12-26 07:51:27,408][123090] Updated weights for policy 1, policy_version 1027952 (0.0007) [2023-12-26 07:51:27,465][123090] Updated weights for policy 1, policy_version 1027962 (0.0010) [2023-12-26 07:51:28,162][123090] Updated weights for policy 1, policy_version 1027972 (0.0006) [2023-12-26 07:51:28,218][123091] Updated weights for policy 0, policy_version 1035345 (0.0009) [2023-12-26 07:51:28,231][123090] Updated weights for policy 1, policy_version 1027982 (0.0009) [2023-12-26 07:51:28,280][123091] Updated weights for policy 0, policy_version 1035355 (0.0010) [2023-12-26 07:51:28,286][123090] Updated weights for policy 1, policy_version 1027992 (0.0010) [2023-12-26 07:51:28,346][123091] Updated weights for policy 0, policy_version 1035365 (0.0011) [2023-12-26 07:51:28,413][123091] Updated weights for policy 0, policy_version 1035375 (0.0010) [2023-12-26 07:51:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 528228352. Throughput: 0: 9147.0, 1: 8875.5. Samples: 528220916. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:28,785][121949] Avg episode reward: [(0, '6063.938'), (1, '5525.284')] [2023-12-26 07:51:29,003][123090] Updated weights for policy 1, policy_version 1028002 (0.0008) [2023-12-26 07:51:29,061][123090] Updated weights for policy 1, policy_version 1028012 (0.0005) [2023-12-26 07:51:29,110][123090] Updated weights for policy 1, policy_version 1028022 (0.0005) [2023-12-26 07:51:29,172][123090] Updated weights for policy 1, policy_version 1028032 (0.0007) [2023-12-26 07:51:29,229][123091] Updated weights for policy 0, policy_version 1035385 (0.0011) [2023-12-26 07:51:29,283][123091] Updated weights for policy 0, policy_version 1035395 (0.0010) [2023-12-26 07:51:29,353][123091] Updated weights for policy 0, policy_version 1035405 (0.0009) [2023-12-26 07:51:29,980][123090] Updated weights for policy 1, policy_version 1028042 (0.0009) [2023-12-26 07:51:30,055][123090] Updated weights for policy 1, policy_version 1028052 (0.0009) [2023-12-26 07:51:30,126][123090] Updated weights for policy 1, policy_version 1028062 (0.0009) [2023-12-26 07:51:30,180][123091] Updated weights for policy 0, policy_version 1035415 (0.0010) [2023-12-26 07:51:30,243][123091] Updated weights for policy 0, policy_version 1035425 (0.0011) [2023-12-26 07:51:30,298][123091] Updated weights for policy 0, policy_version 1035435 (0.0011) [2023-12-26 07:51:30,933][123090] Updated weights for policy 1, policy_version 1028072 (0.0009) [2023-12-26 07:51:30,981][123090] Updated weights for policy 1, policy_version 1028082 (0.0009) [2023-12-26 07:51:31,035][123090] Updated weights for policy 1, policy_version 1028092 (0.0009) [2023-12-26 07:51:31,131][123091] Updated weights for policy 0, policy_version 1035445 (0.0010) [2023-12-26 07:51:31,199][123091] Updated weights for policy 0, policy_version 1035455 (0.0009) [2023-12-26 07:51:31,260][123091] Updated weights for policy 0, policy_version 1035465 (0.0009) [2023-12-26 07:51:31,887][123090] Updated weights for policy 1, policy_version 1028102 (0.0008) [2023-12-26 07:51:31,952][123090] Updated weights for policy 1, policy_version 1028112 (0.0009) [2023-12-26 07:51:32,009][123090] Updated weights for policy 1, policy_version 1028122 (0.0009) [2023-12-26 07:51:32,111][123091] Updated weights for policy 0, policy_version 1035475 (0.0009) [2023-12-26 07:51:32,162][123091] Updated weights for policy 0, policy_version 1035485 (0.0010) [2023-12-26 07:51:32,223][123091] Updated weights for policy 0, policy_version 1035495 (0.0009) [2023-12-26 07:51:32,776][123090] Updated weights for policy 1, policy_version 1028132 (0.0009) [2023-12-26 07:51:32,839][123090] Updated weights for policy 1, policy_version 1028142 (0.0010) [2023-12-26 07:51:32,911][123091] Updated weights for policy 0, policy_version 1035505 (0.0010) [2023-12-26 07:51:32,913][123090] Updated weights for policy 1, policy_version 1028152 (0.0010) [2023-12-26 07:51:32,966][123091] Updated weights for policy 0, policy_version 1035515 (0.0005) [2023-12-26 07:51:33,023][123091] Updated weights for policy 0, policy_version 1035525 (0.0007) [2023-12-26 07:51:33,085][123091] Updated weights for policy 0, policy_version 1035535 (0.0010) [2023-12-26 07:51:33,709][123090] Updated weights for policy 1, policy_version 1028162 (0.0010) [2023-12-26 07:51:33,771][123090] Updated weights for policy 1, policy_version 1028172 (0.0009) [2023-12-26 07:51:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 528310272. Throughput: 0: 9041.4, 1: 8822.8. Samples: 528327796. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:33,784][121949] Avg episode reward: [(0, '6103.426'), (1, '5508.229')] [2023-12-26 07:51:33,831][123090] Updated weights for policy 1, policy_version 1028182 (0.0008) [2023-12-26 07:51:33,854][123091] Updated weights for policy 0, policy_version 1035545 (0.0011) [2023-12-26 07:51:33,892][123090] Updated weights for policy 1, policy_version 1028192 (0.0007) [2023-12-26 07:51:33,898][123091] Updated weights for policy 0, policy_version 1035555 (0.0010) [2023-12-26 07:51:33,950][123091] Updated weights for policy 0, policy_version 1035565 (0.0010) [2023-12-26 07:51:34,725][123090] Updated weights for policy 1, policy_version 1028202 (0.0009) [2023-12-26 07:51:34,773][123090] Updated weights for policy 1, policy_version 1028212 (0.0009) [2023-12-26 07:51:34,828][123091] Updated weights for policy 0, policy_version 1035575 (0.0011) [2023-12-26 07:51:34,835][123090] Updated weights for policy 1, policy_version 1028222 (0.0009) [2023-12-26 07:51:34,883][123091] Updated weights for policy 0, policy_version 1035585 (0.0010) [2023-12-26 07:51:34,941][123091] Updated weights for policy 0, policy_version 1035595 (0.0010) [2023-12-26 07:51:35,677][123090] Updated weights for policy 1, policy_version 1028232 (0.0009) [2023-12-26 07:51:35,739][123090] Updated weights for policy 1, policy_version 1028242 (0.0009) [2023-12-26 07:51:35,763][123091] Updated weights for policy 0, policy_version 1035605 (0.0011) [2023-12-26 07:51:35,799][123090] Updated weights for policy 1, policy_version 1028252 (0.0006) [2023-12-26 07:51:35,822][123091] Updated weights for policy 0, policy_version 1035615 (0.0010) [2023-12-26 07:51:35,885][123091] Updated weights for policy 0, policy_version 1035625 (0.0011) [2023-12-26 07:51:36,619][123090] Updated weights for policy 1, policy_version 1028262 (0.0008) [2023-12-26 07:51:36,675][123090] Updated weights for policy 1, policy_version 1028272 (0.0010) [2023-12-26 07:51:36,708][123091] Updated weights for policy 0, policy_version 1035635 (0.0010) [2023-12-26 07:51:36,743][123090] Updated weights for policy 1, policy_version 1028282 (0.0011) [2023-12-26 07:51:36,775][123091] Updated weights for policy 0, policy_version 1035645 (0.0006) [2023-12-26 07:51:36,836][123091] Updated weights for policy 0, policy_version 1035655 (0.0006) [2023-12-26 07:51:37,489][123090] Updated weights for policy 1, policy_version 1028292 (0.0010) [2023-12-26 07:51:37,530][123091] Updated weights for policy 0, policy_version 1035665 (0.0007) [2023-12-26 07:51:37,557][123090] Updated weights for policy 1, policy_version 1028302 (0.0010) [2023-12-26 07:51:37,592][123091] Updated weights for policy 0, policy_version 1035675 (0.0006) [2023-12-26 07:51:37,619][123090] Updated weights for policy 1, policy_version 1028312 (0.0010) [2023-12-26 07:51:37,656][123091] Updated weights for policy 0, policy_version 1035685 (0.0006) [2023-12-26 07:51:37,714][123091] Updated weights for policy 0, policy_version 1035695 (0.0005) [2023-12-26 07:51:38,351][123091] Updated weights for policy 0, policy_version 1035705 (0.0006) [2023-12-26 07:51:38,364][123090] Updated weights for policy 1, policy_version 1028322 (0.0010) [2023-12-26 07:51:38,416][123091] Updated weights for policy 0, policy_version 1035715 (0.0006) [2023-12-26 07:51:38,432][123090] Updated weights for policy 1, policy_version 1028332 (0.0008) [2023-12-26 07:51:38,466][123091] Updated weights for policy 0, policy_version 1035725 (0.0005) [2023-12-26 07:51:38,500][123090] Updated weights for policy 1, policy_version 1028342 (0.0008) [2023-12-26 07:51:38,576][123090] Updated weights for policy 1, policy_version 1028352 (0.0010) [2023-12-26 07:51:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 528408576. Throughput: 0: 9016.8, 1: 8812.7. Samples: 528378920. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:38,785][121949] Avg episode reward: [(0, '6081.248'), (1, '5625.361')] [2023-12-26 07:51:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001035728_265150464.pth... [2023-12-26 07:51:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001028352_263258112.pth... [2023-12-26 07:51:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001027328_262995968.pth [2023-12-26 07:51:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001034672_264880128.pth [2023-12-26 07:51:39,142][123091] Updated weights for policy 0, policy_version 1035735 (0.0005) [2023-12-26 07:51:39,219][123091] Updated weights for policy 0, policy_version 1035745 (0.0006) [2023-12-26 07:51:39,220][123090] Updated weights for policy 1, policy_version 1028362 (0.0006) [2023-12-26 07:51:39,291][123091] Updated weights for policy 0, policy_version 1035755 (0.0009) [2023-12-26 07:51:39,296][123090] Updated weights for policy 1, policy_version 1028372 (0.0010) [2023-12-26 07:51:39,362][123090] Updated weights for policy 1, policy_version 1028382 (0.0009) [2023-12-26 07:51:40,021][123091] Updated weights for policy 0, policy_version 1035765 (0.0007) [2023-12-26 07:51:40,089][123091] Updated weights for policy 0, policy_version 1035775 (0.0007) [2023-12-26 07:51:40,157][123091] Updated weights for policy 0, policy_version 1035785 (0.0011) [2023-12-26 07:51:40,203][123090] Updated weights for policy 1, policy_version 1028392 (0.0009) [2023-12-26 07:51:40,273][123090] Updated weights for policy 1, policy_version 1028402 (0.0006) [2023-12-26 07:51:40,349][123090] Updated weights for policy 1, policy_version 1028412 (0.0007) [2023-12-26 07:51:40,873][123091] Updated weights for policy 0, policy_version 1035795 (0.0009) [2023-12-26 07:51:40,943][123091] Updated weights for policy 0, policy_version 1035805 (0.0005) [2023-12-26 07:51:41,007][123091] Updated weights for policy 0, policy_version 1035815 (0.0005) [2023-12-26 07:51:41,060][123090] Updated weights for policy 1, policy_version 1028422 (0.0009) [2023-12-26 07:51:41,121][123090] Updated weights for policy 1, policy_version 1028433 (0.0007) [2023-12-26 07:51:41,185][123090] Updated weights for policy 1, policy_version 1028443 (0.0009) [2023-12-26 07:51:41,788][123091] Updated weights for policy 0, policy_version 1035825 (0.0008) [2023-12-26 07:51:41,857][123091] Updated weights for policy 0, policy_version 1035835 (0.0006) [2023-12-26 07:51:41,933][123091] Updated weights for policy 0, policy_version 1035845 (0.0006) [2023-12-26 07:51:41,994][123090] Updated weights for policy 1, policy_version 1028453 (0.0009) [2023-12-26 07:51:42,005][123091] Updated weights for policy 0, policy_version 1035855 (0.0005) [2023-12-26 07:51:42,064][123090] Updated weights for policy 1, policy_version 1028463 (0.0010) [2023-12-26 07:51:42,130][123090] Updated weights for policy 1, policy_version 1028473 (0.0010) [2023-12-26 07:51:42,726][123091] Updated weights for policy 0, policy_version 1035865 (0.0006) [2023-12-26 07:51:42,803][123091] Updated weights for policy 0, policy_version 1035875 (0.0006) [2023-12-26 07:51:42,872][123091] Updated weights for policy 0, policy_version 1035885 (0.0007) [2023-12-26 07:51:42,887][123090] Updated weights for policy 1, policy_version 1028483 (0.0009) [2023-12-26 07:51:42,952][123090] Updated weights for policy 1, policy_version 1028493 (0.0009) [2023-12-26 07:51:43,018][123090] Updated weights for policy 1, policy_version 1028503 (0.0008) [2023-12-26 07:51:43,463][123091] Updated weights for policy 0, policy_version 1035895 (0.0006) [2023-12-26 07:51:43,517][123091] Updated weights for policy 0, policy_version 1035905 (0.0005) [2023-12-26 07:51:43,575][123091] Updated weights for policy 0, policy_version 1035915 (0.0005) [2023-12-26 07:51:43,719][123090] Updated weights for policy 1, policy_version 1028513 (0.0006) [2023-12-26 07:51:43,777][123090] Updated weights for policy 1, policy_version 1028524 (0.0009) [2023-12-26 07:51:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 528498688. Throughput: 0: 9055.5, 1: 8827.5. Samples: 528490768. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:43,784][121949] Avg episode reward: [(0, '6195.000'), (1, '5630.481')] [2023-12-26 07:51:43,828][123090] Updated weights for policy 1, policy_version 1028534 (0.0009) [2023-12-26 07:51:43,888][123090] Updated weights for policy 1, policy_version 1028544 (0.0009) [2023-12-26 07:51:44,326][123091] Updated weights for policy 0, policy_version 1035925 (0.0008) [2023-12-26 07:51:44,389][123091] Updated weights for policy 0, policy_version 1035935 (0.0008) [2023-12-26 07:51:44,449][123091] Updated weights for policy 0, policy_version 1035945 (0.0009) [2023-12-26 07:51:44,736][123090] Updated weights for policy 1, policy_version 1028554 (0.0010) [2023-12-26 07:51:44,797][123090] Updated weights for policy 1, policy_version 1028564 (0.0010) [2023-12-26 07:51:44,867][123090] Updated weights for policy 1, policy_version 1028574 (0.0007) [2023-12-26 07:51:45,335][123091] Updated weights for policy 0, policy_version 1035955 (0.0010) [2023-12-26 07:51:45,390][123091] Updated weights for policy 0, policy_version 1035965 (0.0010) [2023-12-26 07:51:45,445][123091] Updated weights for policy 0, policy_version 1035975 (0.0010) [2023-12-26 07:51:45,586][123090] Updated weights for policy 1, policy_version 1028584 (0.0010) [2023-12-26 07:51:45,651][123090] Updated weights for policy 1, policy_version 1028594 (0.0009) [2023-12-26 07:51:45,717][123090] Updated weights for policy 1, policy_version 1028604 (0.0009) [2023-12-26 07:51:46,339][123091] Updated weights for policy 0, policy_version 1035986 (0.0010) [2023-12-26 07:51:46,411][123091] Updated weights for policy 0, policy_version 1035996 (0.0005) [2023-12-26 07:51:46,483][123091] Updated weights for policy 0, policy_version 1036006 (0.0005) [2023-12-26 07:51:46,529][123090] Updated weights for policy 1, policy_version 1028614 (0.0010) [2023-12-26 07:51:46,556][123091] Updated weights for policy 0, policy_version 1036016 (0.0005) [2023-12-26 07:51:46,589][123090] Updated weights for policy 1, policy_version 1028624 (0.0010) [2023-12-26 07:51:46,652][123090] Updated weights for policy 1, policy_version 1028634 (0.0010) [2023-12-26 07:51:47,233][123091] Updated weights for policy 0, policy_version 1036026 (0.0010) [2023-12-26 07:51:47,284][123091] Updated weights for policy 0, policy_version 1036036 (0.0010) [2023-12-26 07:51:47,339][123091] Updated weights for policy 0, policy_version 1036046 (0.0011) [2023-12-26 07:51:47,450][123090] Updated weights for policy 1, policy_version 1028644 (0.0010) [2023-12-26 07:51:47,498][123090] Updated weights for policy 1, policy_version 1028654 (0.0010) [2023-12-26 07:51:47,552][123090] Updated weights for policy 1, policy_version 1028664 (0.0010) [2023-12-26 07:51:48,050][123091] Updated weights for policy 0, policy_version 1036056 (0.0005) [2023-12-26 07:51:48,108][123091] Updated weights for policy 0, policy_version 1036066 (0.0005) [2023-12-26 07:51:48,187][123091] Updated weights for policy 0, policy_version 1036076 (0.0005) [2023-12-26 07:51:48,402][123090] Updated weights for policy 1, policy_version 1028674 (0.0010) [2023-12-26 07:51:48,470][123090] Updated weights for policy 1, policy_version 1028684 (0.0009) [2023-12-26 07:51:48,535][123090] Updated weights for policy 1, policy_version 1028694 (0.0009) [2023-12-26 07:51:48,597][123090] Updated weights for policy 1, policy_version 1028704 (0.0009) [2023-12-26 07:51:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17939.1). Total num frames: 528588800. Throughput: 0: 9080.2, 1: 8862.5. Samples: 528599444. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:48,785][121949] Avg episode reward: [(0, '6211.083'), (1, '5605.065')] [2023-12-26 07:51:48,893][123091] Updated weights for policy 0, policy_version 1036086 (0.0008) [2023-12-26 07:51:48,947][123091] Updated weights for policy 0, policy_version 1036096 (0.0010) [2023-12-26 07:51:49,012][123091] Updated weights for policy 0, policy_version 1036106 (0.0010) [2023-12-26 07:51:49,424][123090] Updated weights for policy 1, policy_version 1028714 (0.0009) [2023-12-26 07:51:49,479][123090] Updated weights for policy 1, policy_version 1028724 (0.0008) [2023-12-26 07:51:49,531][123090] Updated weights for policy 1, policy_version 1028734 (0.0008) [2023-12-26 07:51:49,820][123091] Updated weights for policy 0, policy_version 1036116 (0.0010) [2023-12-26 07:51:49,883][123091] Updated weights for policy 0, policy_version 1036126 (0.0009) [2023-12-26 07:51:49,945][123091] Updated weights for policy 0, policy_version 1036136 (0.0009) [2023-12-26 07:51:50,345][123090] Updated weights for policy 1, policy_version 1028744 (0.0010) [2023-12-26 07:51:50,412][123090] Updated weights for policy 1, policy_version 1028754 (0.0009) [2023-12-26 07:51:50,468][123090] Updated weights for policy 1, policy_version 1028764 (0.0009) [2023-12-26 07:51:50,764][123091] Updated weights for policy 0, policy_version 1036146 (0.0009) [2023-12-26 07:51:50,826][123091] Updated weights for policy 0, policy_version 1036156 (0.0009) [2023-12-26 07:51:50,889][123091] Updated weights for policy 0, policy_version 1036166 (0.0009) [2023-12-26 07:51:50,944][123091] Updated weights for policy 0, policy_version 1036176 (0.0009) [2023-12-26 07:51:51,353][123090] Updated weights for policy 1, policy_version 1028774 (0.0007) [2023-12-26 07:51:51,428][123090] Updated weights for policy 1, policy_version 1028784 (0.0010) [2023-12-26 07:51:51,484][123090] Updated weights for policy 1, policy_version 1028794 (0.0010) [2023-12-26 07:51:51,790][123091] Updated weights for policy 0, policy_version 1036186 (0.0008) [2023-12-26 07:51:51,855][123091] Updated weights for policy 0, policy_version 1036196 (0.0009) [2023-12-26 07:51:51,920][123091] Updated weights for policy 0, policy_version 1036206 (0.0009) [2023-12-26 07:51:52,321][123090] Updated weights for policy 1, policy_version 1028804 (0.0011) [2023-12-26 07:51:52,390][123090] Updated weights for policy 1, policy_version 1028814 (0.0011) [2023-12-26 07:51:52,463][123090] Updated weights for policy 1, policy_version 1028824 (0.0011) [2023-12-26 07:51:52,680][123091] Updated weights for policy 0, policy_version 1036216 (0.0009) [2023-12-26 07:51:52,743][123091] Updated weights for policy 0, policy_version 1036226 (0.0008) [2023-12-26 07:51:52,818][123091] Updated weights for policy 0, policy_version 1036236 (0.0005) [2023-12-26 07:51:53,301][123090] Updated weights for policy 1, policy_version 1028834 (0.0010) [2023-12-26 07:51:53,349][123090] Updated weights for policy 1, policy_version 1028844 (0.0009) [2023-12-26 07:51:53,398][123090] Updated weights for policy 1, policy_version 1028854 (0.0009) [2023-12-26 07:51:53,449][123090] Updated weights for policy 1, policy_version 1028864 (0.0009) [2023-12-26 07:51:53,573][123091] Updated weights for policy 0, policy_version 1036246 (0.0005) [2023-12-26 07:51:53,650][123091] Updated weights for policy 0, policy_version 1036256 (0.0005) [2023-12-26 07:51:53,714][123091] Updated weights for policy 0, policy_version 1036266 (0.0008) [2023-12-26 07:51:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 528678912. Throughput: 0: 9033.6, 1: 8854.5. Samples: 528650836. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:53,785][121949] Avg episode reward: [(0, '6157.506'), (1, '5700.893')] [2023-12-26 07:51:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001036272_265289728.pth... [2023-12-26 07:51:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001028864_263389184.pth... [2023-12-26 07:51:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001035216_265019392.pth [2023-12-26 07:51:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001027840_263127040.pth [2023-12-26 07:51:54,252][123090] Updated weights for policy 1, policy_version 1028874 (0.0008) [2023-12-26 07:51:54,307][123090] Updated weights for policy 1, policy_version 1028884 (0.0007) [2023-12-26 07:51:54,369][123090] Updated weights for policy 1, policy_version 1028894 (0.0005) [2023-12-26 07:51:54,371][123091] Updated weights for policy 0, policy_version 1036276 (0.0009) [2023-12-26 07:51:54,442][123091] Updated weights for policy 0, policy_version 1036286 (0.0010) [2023-12-26 07:51:54,512][123091] Updated weights for policy 0, policy_version 1036296 (0.0011) [2023-12-26 07:51:55,196][123090] Updated weights for policy 1, policy_version 1028904 (0.0008) [2023-12-26 07:51:55,268][123090] Updated weights for policy 1, policy_version 1028914 (0.0009) [2023-12-26 07:51:55,308][123091] Updated weights for policy 0, policy_version 1036306 (0.0011) [2023-12-26 07:51:55,331][123090] Updated weights for policy 1, policy_version 1028924 (0.0009) [2023-12-26 07:51:55,371][123091] Updated weights for policy 0, policy_version 1036316 (0.0011) [2023-12-26 07:51:55,426][123091] Updated weights for policy 0, policy_version 1036326 (0.0010) [2023-12-26 07:51:55,488][123091] Updated weights for policy 0, policy_version 1036336 (0.0010) [2023-12-26 07:51:56,042][123090] Updated weights for policy 1, policy_version 1028934 (0.0006) [2023-12-26 07:51:56,097][123090] Updated weights for policy 1, policy_version 1028944 (0.0005) [2023-12-26 07:51:56,147][123090] Updated weights for policy 1, policy_version 1028954 (0.0005) [2023-12-26 07:51:56,320][123091] Updated weights for policy 0, policy_version 1036346 (0.0010) [2023-12-26 07:51:56,385][123091] Updated weights for policy 0, policy_version 1036356 (0.0010) [2023-12-26 07:51:56,437][123091] Updated weights for policy 0, policy_version 1036366 (0.0008) [2023-12-26 07:51:56,788][123090] Updated weights for policy 1, policy_version 1028964 (0.0005) [2023-12-26 07:51:56,857][123090] Updated weights for policy 1, policy_version 1028974 (0.0005) [2023-12-26 07:51:56,928][123090] Updated weights for policy 1, policy_version 1028984 (0.0009) [2023-12-26 07:51:57,109][123091] Updated weights for policy 0, policy_version 1036376 (0.0009) [2023-12-26 07:51:57,169][123091] Updated weights for policy 0, policy_version 1036386 (0.0009) [2023-12-26 07:51:57,226][123091] Updated weights for policy 0, policy_version 1036396 (0.0009) [2023-12-26 07:51:57,733][123090] Updated weights for policy 1, policy_version 1028994 (0.0010) [2023-12-26 07:51:57,780][123090] Updated weights for policy 1, policy_version 1029004 (0.0009) [2023-12-26 07:51:57,842][123090] Updated weights for policy 1, policy_version 1029014 (0.0009) [2023-12-26 07:51:57,898][123090] Updated weights for policy 1, policy_version 1029024 (0.0009) [2023-12-26 07:51:58,006][123091] Updated weights for policy 0, policy_version 1036406 (0.0007) [2023-12-26 07:51:58,079][123091] Updated weights for policy 0, policy_version 1036416 (0.0010) [2023-12-26 07:51:58,145][123091] Updated weights for policy 0, policy_version 1036426 (0.0011) [2023-12-26 07:51:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17939.1). Total num frames: 528760832. Throughput: 0: 9118.0, 1: 8869.0. Samples: 528759712. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:51:58,785][121949] Avg episode reward: [(0, '6235.454'), (1, '5652.982')] [2023-12-26 07:51:58,900][123090] Updated weights for policy 1, policy_version 1029034 (0.0012) [2023-12-26 07:51:58,971][123090] Updated weights for policy 1, policy_version 1029044 (0.0008) [2023-12-26 07:51:59,033][123091] Updated weights for policy 0, policy_version 1036436 (0.0011) [2023-12-26 07:51:59,034][123090] Updated weights for policy 1, policy_version 1029054 (0.0008) [2023-12-26 07:51:59,095][123091] Updated weights for policy 0, policy_version 1036446 (0.0011) [2023-12-26 07:51:59,159][123091] Updated weights for policy 0, policy_version 1036456 (0.0011) [2023-12-26 07:51:59,870][123090] Updated weights for policy 1, policy_version 1029064 (0.0010) [2023-12-26 07:51:59,932][123090] Updated weights for policy 1, policy_version 1029074 (0.0011) [2023-12-26 07:51:59,939][123091] Updated weights for policy 0, policy_version 1036466 (0.0007) [2023-12-26 07:51:59,996][123091] Updated weights for policy 0, policy_version 1036476 (0.0006) [2023-12-26 07:51:59,998][123090] Updated weights for policy 1, policy_version 1029084 (0.0010) [2023-12-26 07:52:00,059][123091] Updated weights for policy 0, policy_version 1036486 (0.0008) [2023-12-26 07:52:00,115][123091] Updated weights for policy 0, policy_version 1036496 (0.0009) [2023-12-26 07:52:00,791][123090] Updated weights for policy 1, policy_version 1029094 (0.0007) [2023-12-26 07:52:00,831][123091] Updated weights for policy 0, policy_version 1036506 (0.0006) [2023-12-26 07:52:00,850][123090] Updated weights for policy 1, policy_version 1029104 (0.0006) [2023-12-26 07:52:00,880][123091] Updated weights for policy 0, policy_version 1036516 (0.0005) [2023-12-26 07:52:00,905][123090] Updated weights for policy 1, policy_version 1029114 (0.0005) [2023-12-26 07:52:00,934][123091] Updated weights for policy 0, policy_version 1036526 (0.0006) [2023-12-26 07:52:01,669][123090] Updated weights for policy 1, policy_version 1029124 (0.0007) [2023-12-26 07:52:01,735][123090] Updated weights for policy 1, policy_version 1029134 (0.0010) [2023-12-26 07:52:01,755][123091] Updated weights for policy 0, policy_version 1036536 (0.0007) [2023-12-26 07:52:01,785][123090] Updated weights for policy 1, policy_version 1029144 (0.0008) [2023-12-26 07:52:01,807][123091] Updated weights for policy 0, policy_version 1036546 (0.0008) [2023-12-26 07:52:01,863][123091] Updated weights for policy 0, policy_version 1036556 (0.0010) [2023-12-26 07:52:02,588][123090] Updated weights for policy 1, policy_version 1029154 (0.0008) [2023-12-26 07:52:02,639][123090] Updated weights for policy 1, policy_version 1029164 (0.0009) [2023-12-26 07:52:02,696][123090] Updated weights for policy 1, policy_version 1029174 (0.0009) [2023-12-26 07:52:02,736][123091] Updated weights for policy 0, policy_version 1036566 (0.0009) [2023-12-26 07:52:02,750][123090] Updated weights for policy 1, policy_version 1029184 (0.0008) [2023-12-26 07:52:02,794][123091] Updated weights for policy 0, policy_version 1036576 (0.0008) [2023-12-26 07:52:02,857][123091] Updated weights for policy 0, policy_version 1036586 (0.0010) [2023-12-26 07:52:03,565][123090] Updated weights for policy 1, policy_version 1029194 (0.0008) [2023-12-26 07:52:03,620][123090] Updated weights for policy 1, policy_version 1029204 (0.0010) [2023-12-26 07:52:03,659][123091] Updated weights for policy 0, policy_version 1036596 (0.0007) [2023-12-26 07:52:03,673][123090] Updated weights for policy 1, policy_version 1029214 (0.0006) [2023-12-26 07:52:03,713][123091] Updated weights for policy 0, policy_version 1036606 (0.0007) [2023-12-26 07:52:03,767][123091] Updated weights for policy 0, policy_version 1036617 (0.0010) [2023-12-26 07:52:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 528850944. Throughput: 0: 9016.8, 1: 8796.4. Samples: 528863524. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:03,786][121949] Avg episode reward: [(0, '6245.953'), (1, '5658.233')] [2023-12-26 07:52:04,414][123090] Updated weights for policy 1, policy_version 1029224 (0.0010) [2023-12-26 07:52:04,474][123090] Updated weights for policy 1, policy_version 1029234 (0.0011) [2023-12-26 07:52:04,535][123090] Updated weights for policy 1, policy_version 1029244 (0.0010) [2023-12-26 07:52:04,636][123091] Updated weights for policy 0, policy_version 1036628 (0.0010) [2023-12-26 07:52:04,692][123091] Updated weights for policy 0, policy_version 1036638 (0.0009) [2023-12-26 07:52:04,757][123091] Updated weights for policy 0, policy_version 1036648 (0.0009) [2023-12-26 07:52:05,296][123090] Updated weights for policy 1, policy_version 1029254 (0.0007) [2023-12-26 07:52:05,359][123090] Updated weights for policy 1, policy_version 1029264 (0.0005) [2023-12-26 07:52:05,421][123090] Updated weights for policy 1, policy_version 1029274 (0.0005) [2023-12-26 07:52:05,645][123091] Updated weights for policy 0, policy_version 1036658 (0.0009) [2023-12-26 07:52:05,693][123091] Updated weights for policy 0, policy_version 1036668 (0.0009) [2023-12-26 07:52:05,744][123091] Updated weights for policy 0, policy_version 1036678 (0.0009) [2023-12-26 07:52:05,803][123091] Updated weights for policy 0, policy_version 1036688 (0.0009) [2023-12-26 07:52:06,122][123090] Updated weights for policy 1, policy_version 1029284 (0.0006) [2023-12-26 07:52:06,180][123090] Updated weights for policy 1, policy_version 1029294 (0.0007) [2023-12-26 07:52:06,251][123090] Updated weights for policy 1, policy_version 1029304 (0.0007) [2023-12-26 07:52:06,688][123091] Updated weights for policy 0, policy_version 1036698 (0.0009) [2023-12-26 07:52:06,741][123091] Updated weights for policy 0, policy_version 1036708 (0.0009) [2023-12-26 07:52:06,802][123091] Updated weights for policy 0, policy_version 1036718 (0.0009) [2023-12-26 07:52:07,083][123090] Updated weights for policy 1, policy_version 1029314 (0.0010) [2023-12-26 07:52:07,134][123090] Updated weights for policy 1, policy_version 1029324 (0.0005) [2023-12-26 07:52:07,194][123090] Updated weights for policy 1, policy_version 1029334 (0.0005) [2023-12-26 07:52:07,262][123090] Updated weights for policy 1, policy_version 1029344 (0.0007) [2023-12-26 07:52:07,665][123091] Updated weights for policy 0, policy_version 1036728 (0.0009) [2023-12-26 07:52:07,719][123091] Updated weights for policy 0, policy_version 1036738 (0.0009) [2023-12-26 07:52:07,774][123091] Updated weights for policy 0, policy_version 1036748 (0.0009) [2023-12-26 07:52:07,940][123090] Updated weights for policy 1, policy_version 1029354 (0.0009) [2023-12-26 07:52:07,993][123090] Updated weights for policy 1, policy_version 1029364 (0.0009) [2023-12-26 07:52:08,049][123090] Updated weights for policy 1, policy_version 1029374 (0.0005) [2023-12-26 07:52:08,701][123091] Updated weights for policy 0, policy_version 1036758 (0.0009) [2023-12-26 07:52:08,714][123090] Updated weights for policy 1, policy_version 1029384 (0.0008) [2023-12-26 07:52:08,761][123091] Updated weights for policy 0, policy_version 1036768 (0.0009) [2023-12-26 07:52:08,781][123090] Updated weights for policy 1, policy_version 1029394 (0.0006) [2023-12-26 07:52:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17911.3). Total num frames: 528932864. Throughput: 0: 8934.5, 1: 8875.7. Samples: 528916092. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:08,785][121949] Avg episode reward: [(0, '6140.416'), (1, '5644.650')] [2023-12-26 07:52:08,829][123091] Updated weights for policy 0, policy_version 1036778 (0.0008) [2023-12-26 07:52:08,848][123090] Updated weights for policy 1, policy_version 1029404 (0.0009) [2023-12-26 07:52:08,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001036784_265420800.pth... [2023-12-26 07:52:08,869][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001035728_265150464.pth [2023-12-26 07:52:08,873][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001029408_263528448.pth... [2023-12-26 07:52:08,878][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001028352_263258112.pth [2023-12-26 07:52:09,664][123090] Updated weights for policy 1, policy_version 1029414 (0.0009) [2023-12-26 07:52:09,685][123091] Updated weights for policy 0, policy_version 1036788 (0.0008) [2023-12-26 07:52:09,730][123090] Updated weights for policy 1, policy_version 1029424 (0.0006) [2023-12-26 07:52:09,745][123091] Updated weights for policy 0, policy_version 1036798 (0.0009) [2023-12-26 07:52:09,800][123090] Updated weights for policy 1, policy_version 1029434 (0.0005) [2023-12-26 07:52:09,807][123091] Updated weights for policy 0, policy_version 1036808 (0.0009) [2023-12-26 07:52:10,606][123090] Updated weights for policy 1, policy_version 1029444 (0.0009) [2023-12-26 07:52:10,675][123090] Updated weights for policy 1, policy_version 1029454 (0.0008) [2023-12-26 07:52:10,689][123091] Updated weights for policy 0, policy_version 1036818 (0.0010) [2023-12-26 07:52:10,748][123090] Updated weights for policy 1, policy_version 1029464 (0.0005) [2023-12-26 07:52:10,748][123091] Updated weights for policy 0, policy_version 1036828 (0.0010) [2023-12-26 07:52:10,811][123091] Updated weights for policy 0, policy_version 1036838 (0.0010) [2023-12-26 07:52:10,875][123091] Updated weights for policy 0, policy_version 1036848 (0.0010) [2023-12-26 07:52:11,476][123090] Updated weights for policy 1, policy_version 1029474 (0.0005) [2023-12-26 07:52:11,541][123090] Updated weights for policy 1, policy_version 1029484 (0.0005) [2023-12-26 07:52:11,612][123090] Updated weights for policy 1, policy_version 1029494 (0.0006) [2023-12-26 07:52:11,681][123090] Updated weights for policy 1, policy_version 1029504 (0.0009) [2023-12-26 07:52:11,813][123091] Updated weights for policy 0, policy_version 1036858 (0.0010) [2023-12-26 07:52:11,888][123091] Updated weights for policy 0, policy_version 1036868 (0.0009) [2023-12-26 07:52:11,965][123091] Updated weights for policy 0, policy_version 1036878 (0.0010) [2023-12-26 07:52:12,470][123090] Updated weights for policy 1, policy_version 1029514 (0.0009) [2023-12-26 07:52:12,527][123090] Updated weights for policy 1, policy_version 1029524 (0.0009) [2023-12-26 07:52:12,594][123090] Updated weights for policy 1, policy_version 1029534 (0.0009) [2023-12-26 07:52:12,815][123091] Updated weights for policy 0, policy_version 1036888 (0.0006) [2023-12-26 07:52:12,882][123091] Updated weights for policy 0, policy_version 1036898 (0.0005) [2023-12-26 07:52:12,955][123091] Updated weights for policy 0, policy_version 1036908 (0.0006) [2023-12-26 07:52:13,408][123090] Updated weights for policy 1, policy_version 1029544 (0.0006) [2023-12-26 07:52:13,467][123090] Updated weights for policy 1, policy_version 1029554 (0.0005) [2023-12-26 07:52:13,532][123090] Updated weights for policy 1, policy_version 1029564 (0.0005) [2023-12-26 07:52:13,602][123091] Updated weights for policy 0, policy_version 1036918 (0.0008) [2023-12-26 07:52:13,658][123091] Updated weights for policy 0, policy_version 1036928 (0.0009) [2023-12-26 07:52:13,705][123091] Updated weights for policy 0, policy_version 1036938 (0.0007) [2023-12-26 07:52:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17939.1). Total num frames: 529031168. Throughput: 0: 8818.9, 1: 8911.1. Samples: 529018768. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:13,785][121949] Avg episode reward: [(0, '6062.553'), (1, '5716.895')] [2023-12-26 07:52:14,325][123090] Updated weights for policy 1, policy_version 1029574 (0.0008) [2023-12-26 07:52:14,389][123090] Updated weights for policy 1, policy_version 1029584 (0.0008) [2023-12-26 07:52:14,392][123091] Updated weights for policy 0, policy_version 1036948 (0.0006) [2023-12-26 07:52:14,453][123090] Updated weights for policy 1, policy_version 1029594 (0.0005) [2023-12-26 07:52:14,463][123091] Updated weights for policy 0, policy_version 1036958 (0.0008) [2023-12-26 07:52:14,521][123091] Updated weights for policy 0, policy_version 1036968 (0.0007) [2023-12-26 07:52:15,195][123091] Updated weights for policy 0, policy_version 1036978 (0.0007) [2023-12-26 07:52:15,221][123090] Updated weights for policy 1, policy_version 1029604 (0.0007) [2023-12-26 07:52:15,251][123091] Updated weights for policy 0, policy_version 1036988 (0.0008) [2023-12-26 07:52:15,285][123090] Updated weights for policy 1, policy_version 1029614 (0.0007) [2023-12-26 07:52:15,307][123091] Updated weights for policy 0, policy_version 1036998 (0.0006) [2023-12-26 07:52:15,355][123090] Updated weights for policy 1, policy_version 1029624 (0.0009) [2023-12-26 07:52:15,362][123091] Updated weights for policy 0, policy_version 1037008 (0.0006) [2023-12-26 07:52:16,006][123091] Updated weights for policy 0, policy_version 1037018 (0.0009) [2023-12-26 07:52:16,066][123091] Updated weights for policy 0, policy_version 1037028 (0.0009) [2023-12-26 07:52:16,135][123091] Updated weights for policy 0, policy_version 1037038 (0.0007) [2023-12-26 07:52:16,232][123090] Updated weights for policy 1, policy_version 1029634 (0.0009) [2023-12-26 07:52:16,285][123090] Updated weights for policy 1, policy_version 1029644 (0.0009) [2023-12-26 07:52:16,348][123090] Updated weights for policy 1, policy_version 1029654 (0.0009) [2023-12-26 07:52:16,412][123090] Updated weights for policy 1, policy_version 1029664 (0.0010) [2023-12-26 07:52:16,931][123091] Updated weights for policy 0, policy_version 1037048 (0.0009) [2023-12-26 07:52:16,985][123091] Updated weights for policy 0, policy_version 1037058 (0.0009) [2023-12-26 07:52:17,037][123091] Updated weights for policy 0, policy_version 1037068 (0.0011) [2023-12-26 07:52:17,225][123090] Updated weights for policy 1, policy_version 1029674 (0.0005) [2023-12-26 07:52:17,291][123090] Updated weights for policy 1, policy_version 1029684 (0.0005) [2023-12-26 07:52:17,348][123090] Updated weights for policy 1, policy_version 1029694 (0.0005) [2023-12-26 07:52:17,735][123091] Updated weights for policy 0, policy_version 1037078 (0.0009) [2023-12-26 07:52:17,790][123091] Updated weights for policy 0, policy_version 1037089 (0.0010) [2023-12-26 07:52:17,845][123091] Updated weights for policy 0, policy_version 1037099 (0.0009) [2023-12-26 07:52:18,021][123090] Updated weights for policy 1, policy_version 1029704 (0.0008) [2023-12-26 07:52:18,074][123090] Updated weights for policy 1, policy_version 1029714 (0.0009) [2023-12-26 07:52:18,126][123090] Updated weights for policy 1, policy_version 1029724 (0.0008) [2023-12-26 07:52:18,723][123091] Updated weights for policy 0, policy_version 1037109 (0.0010) [2023-12-26 07:52:18,774][123091] Updated weights for policy 0, policy_version 1037119 (0.0009) [2023-12-26 07:52:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17911.3). Total num frames: 529113088. Throughput: 0: 8942.8, 1: 8888.7. Samples: 529130216. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:18,785][121949] Avg episode reward: [(0, '6047.864'), (1, '6004.084')] [2023-12-26 07:52:18,829][123091] Updated weights for policy 0, policy_version 1037130 (0.0010) [2023-12-26 07:52:18,915][123090] Updated weights for policy 1, policy_version 1029734 (0.0007) [2023-12-26 07:52:18,981][123090] Updated weights for policy 1, policy_version 1029744 (0.0005) [2023-12-26 07:52:19,054][123090] Updated weights for policy 1, policy_version 1029754 (0.0005) [2023-12-26 07:52:19,600][123091] Updated weights for policy 0, policy_version 1037141 (0.0010) [2023-12-26 07:52:19,666][123091] Updated weights for policy 0, policy_version 1037151 (0.0009) [2023-12-26 07:52:19,727][123091] Updated weights for policy 0, policy_version 1037161 (0.0008) [2023-12-26 07:52:19,799][123090] Updated weights for policy 1, policy_version 1029764 (0.0008) [2023-12-26 07:52:19,864][123090] Updated weights for policy 1, policy_version 1029774 (0.0009) [2023-12-26 07:52:19,933][123090] Updated weights for policy 1, policy_version 1029784 (0.0011) [2023-12-26 07:52:20,517][123091] Updated weights for policy 0, policy_version 1037171 (0.0008) [2023-12-26 07:52:20,587][123091] Updated weights for policy 0, policy_version 1037181 (0.0007) [2023-12-26 07:52:20,661][123091] Updated weights for policy 0, policy_version 1037191 (0.0009) [2023-12-26 07:52:20,766][123090] Updated weights for policy 1, policy_version 1029794 (0.0010) [2023-12-26 07:52:20,828][123090] Updated weights for policy 1, policy_version 1029804 (0.0009) [2023-12-26 07:52:20,882][123090] Updated weights for policy 1, policy_version 1029814 (0.0009) [2023-12-26 07:52:21,466][123091] Updated weights for policy 0, policy_version 1037201 (0.0010) [2023-12-26 07:52:21,535][123091] Updated weights for policy 0, policy_version 1037211 (0.0010) [2023-12-26 07:52:21,606][123091] Updated weights for policy 0, policy_version 1037221 (0.0010) [2023-12-26 07:52:21,670][123091] Updated weights for policy 0, policy_version 1037231 (0.0010) [2023-12-26 07:52:21,768][123090] Updated weights for policy 1, policy_version 1029825 (0.0009) [2023-12-26 07:52:21,822][123090] Updated weights for policy 1, policy_version 1029835 (0.0009) [2023-12-26 07:52:21,877][123090] Updated weights for policy 1, policy_version 1029845 (0.0010) [2023-12-26 07:52:21,928][123090] Updated weights for policy 1, policy_version 1029855 (0.0010) [2023-12-26 07:52:22,531][123091] Updated weights for policy 0, policy_version 1037241 (0.0009) [2023-12-26 07:52:22,597][123091] Updated weights for policy 0, policy_version 1037251 (0.0008) [2023-12-26 07:52:22,664][123091] Updated weights for policy 0, policy_version 1037261 (0.0008) [2023-12-26 07:52:22,736][123090] Updated weights for policy 1, policy_version 1029865 (0.0006) [2023-12-26 07:52:22,807][123090] Updated weights for policy 1, policy_version 1029875 (0.0007) [2023-12-26 07:52:22,866][123090] Updated weights for policy 1, policy_version 1029885 (0.0009) [2023-12-26 07:52:23,361][123091] Updated weights for policy 0, policy_version 1037271 (0.0006) [2023-12-26 07:52:23,411][123091] Updated weights for policy 0, policy_version 1037281 (0.0006) [2023-12-26 07:52:23,472][123091] Updated weights for policy 0, policy_version 1037291 (0.0005) [2023-12-26 07:52:23,670][123090] Updated weights for policy 1, policy_version 1029895 (0.0010) [2023-12-26 07:52:23,739][123090] Updated weights for policy 1, policy_version 1029905 (0.0009) [2023-12-26 07:52:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17939.1). Total num frames: 529203200. Throughput: 0: 8951.0, 1: 8897.8. Samples: 529182116. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:23,785][121949] Avg episode reward: [(0, '6141.587'), (1, '5851.815')] [2023-12-26 07:52:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001037296_265551872.pth... [2023-12-26 07:52:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001036272_265289728.pth [2023-12-26 07:52:23,815][123090] Updated weights for policy 1, policy_version 1029915 (0.0005) [2023-12-26 07:52:23,852][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001029920_263659520.pth... [2023-12-26 07:52:23,855][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001028864_263389184.pth [2023-12-26 07:52:24,178][123091] Updated weights for policy 0, policy_version 1037301 (0.0006) [2023-12-26 07:52:24,232][123091] Updated weights for policy 0, policy_version 1037311 (0.0006) [2023-12-26 07:52:24,299][123091] Updated weights for policy 0, policy_version 1037321 (0.0005) [2023-12-26 07:52:24,452][123090] Updated weights for policy 1, policy_version 1029925 (0.0009) [2023-12-26 07:52:24,525][123090] Updated weights for policy 1, policy_version 1029935 (0.0007) [2023-12-26 07:52:24,588][123090] Updated weights for policy 1, policy_version 1029945 (0.0007) [2023-12-26 07:52:25,065][123091] Updated weights for policy 0, policy_version 1037331 (0.0005) [2023-12-26 07:52:25,127][123091] Updated weights for policy 0, policy_version 1037341 (0.0005) [2023-12-26 07:52:25,196][123091] Updated weights for policy 0, policy_version 1037351 (0.0008) [2023-12-26 07:52:25,234][123090] Updated weights for policy 1, policy_version 1029955 (0.0006) [2023-12-26 07:52:25,302][123090] Updated weights for policy 1, policy_version 1029965 (0.0006) [2023-12-26 07:52:25,361][123090] Updated weights for policy 1, policy_version 1029975 (0.0006) [2023-12-26 07:52:25,892][123091] Updated weights for policy 0, policy_version 1037361 (0.0008) [2023-12-26 07:52:25,941][123091] Updated weights for policy 0, policy_version 1037371 (0.0005) [2023-12-26 07:52:25,992][123091] Updated weights for policy 0, policy_version 1037381 (0.0010) [2023-12-26 07:52:26,062][123091] Updated weights for policy 0, policy_version 1037391 (0.0011) [2023-12-26 07:52:26,091][123090] Updated weights for policy 1, policy_version 1029985 (0.0006) [2023-12-26 07:52:26,151][123090] Updated weights for policy 1, policy_version 1029996 (0.0007) [2023-12-26 07:52:26,202][123090] Updated weights for policy 1, policy_version 1030006 (0.0005) [2023-12-26 07:52:26,267][123090] Updated weights for policy 1, policy_version 1030016 (0.0008) [2023-12-26 07:52:26,869][123091] Updated weights for policy 0, policy_version 1037401 (0.0010) [2023-12-26 07:52:26,916][123091] Updated weights for policy 0, policy_version 1037411 (0.0010) [2023-12-26 07:52:26,960][123091] Updated weights for policy 0, policy_version 1037421 (0.0010) [2023-12-26 07:52:27,023][123090] Updated weights for policy 1, policy_version 1030026 (0.0007) [2023-12-26 07:52:27,070][123090] Updated weights for policy 1, policy_version 1030036 (0.0010) [2023-12-26 07:52:27,117][123090] Updated weights for policy 1, policy_version 1030046 (0.0010) [2023-12-26 07:52:27,730][123091] Updated weights for policy 0, policy_version 1037431 (0.0007) [2023-12-26 07:52:27,796][123091] Updated weights for policy 0, policy_version 1037441 (0.0005) [2023-12-26 07:52:27,816][123090] Updated weights for policy 1, policy_version 1030056 (0.0008) [2023-12-26 07:52:27,864][123091] Updated weights for policy 0, policy_version 1037451 (0.0006) [2023-12-26 07:52:27,866][123090] Updated weights for policy 1, policy_version 1030066 (0.0007) [2023-12-26 07:52:27,925][123090] Updated weights for policy 1, policy_version 1030076 (0.0006) [2023-12-26 07:52:28,476][123091] Updated weights for policy 0, policy_version 1037461 (0.0008) [2023-12-26 07:52:28,535][123091] Updated weights for policy 0, policy_version 1037471 (0.0008) [2023-12-26 07:52:28,608][123091] Updated weights for policy 0, policy_version 1037481 (0.0008) [2023-12-26 07:52:28,637][123090] Updated weights for policy 1, policy_version 1030086 (0.0006) [2023-12-26 07:52:28,709][123090] Updated weights for policy 1, policy_version 1030096 (0.0005) [2023-12-26 07:52:28,780][123090] Updated weights for policy 1, policy_version 1030106 (0.0006) [2023-12-26 07:52:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 529301504. Throughput: 0: 8904.4, 1: 8942.3. Samples: 529293872. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:28,785][121949] Avg episode reward: [(0, '6169.790'), (1, '5846.135')] [2023-12-26 07:52:29,392][123091] Updated weights for policy 0, policy_version 1037491 (0.0008) [2023-12-26 07:52:29,455][123091] Updated weights for policy 0, policy_version 1037501 (0.0006) [2023-12-26 07:52:29,465][123090] Updated weights for policy 1, policy_version 1030116 (0.0007) [2023-12-26 07:52:29,516][123091] Updated weights for policy 0, policy_version 1037511 (0.0005) [2023-12-26 07:52:29,528][123090] Updated weights for policy 1, policy_version 1030126 (0.0010) [2023-12-26 07:52:29,591][123090] Updated weights for policy 1, policy_version 1030136 (0.0010) [2023-12-26 07:52:30,256][123091] Updated weights for policy 0, policy_version 1037521 (0.0005) [2023-12-26 07:52:30,320][123091] Updated weights for policy 0, policy_version 1037531 (0.0005) [2023-12-26 07:52:30,356][123090] Updated weights for policy 1, policy_version 1030146 (0.0008) [2023-12-26 07:52:30,389][123091] Updated weights for policy 0, policy_version 1037541 (0.0005) [2023-12-26 07:52:30,419][123090] Updated weights for policy 1, policy_version 1030156 (0.0010) [2023-12-26 07:52:30,451][123091] Updated weights for policy 0, policy_version 1037551 (0.0005) [2023-12-26 07:52:30,489][123090] Updated weights for policy 1, policy_version 1030166 (0.0010) [2023-12-26 07:52:30,540][123090] Updated weights for policy 1, policy_version 1030176 (0.0010) [2023-12-26 07:52:31,101][123091] Updated weights for policy 0, policy_version 1037561 (0.0009) [2023-12-26 07:52:31,163][123091] Updated weights for policy 0, policy_version 1037571 (0.0009) [2023-12-26 07:52:31,215][123091] Updated weights for policy 0, policy_version 1037581 (0.0009) [2023-12-26 07:52:31,361][123090] Updated weights for policy 1, policy_version 1030186 (0.0010) [2023-12-26 07:52:31,426][123090] Updated weights for policy 1, policy_version 1030196 (0.0010) [2023-12-26 07:52:31,484][123090] Updated weights for policy 1, policy_version 1030206 (0.0010) [2023-12-26 07:52:32,008][123091] Updated weights for policy 0, policy_version 1037591 (0.0009) [2023-12-26 07:52:32,065][123091] Updated weights for policy 0, policy_version 1037601 (0.0009) [2023-12-26 07:52:32,129][123091] Updated weights for policy 0, policy_version 1037611 (0.0009) [2023-12-26 07:52:32,326][123090] Updated weights for policy 1, policy_version 1030216 (0.0007) [2023-12-26 07:52:32,391][123090] Updated weights for policy 1, policy_version 1030226 (0.0010) [2023-12-26 07:52:32,443][123090] Updated weights for policy 1, policy_version 1030236 (0.0010) [2023-12-26 07:52:33,009][123091] Updated weights for policy 0, policy_version 1037621 (0.0010) [2023-12-26 07:52:33,064][123091] Updated weights for policy 0, policy_version 1037631 (0.0010) [2023-12-26 07:52:33,112][123091] Updated weights for policy 0, policy_version 1037641 (0.0010) [2023-12-26 07:52:33,146][123090] Updated weights for policy 1, policy_version 1030246 (0.0010) [2023-12-26 07:52:33,205][123090] Updated weights for policy 1, policy_version 1030256 (0.0010) [2023-12-26 07:52:33,266][123090] Updated weights for policy 1, policy_version 1030266 (0.0010) [2023-12-26 07:52:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.3, 300 sec: 17939.1). Total num frames: 529391616. Throughput: 0: 8924.9, 1: 8998.8. Samples: 529406008. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:33,785][121949] Avg episode reward: [(0, '6238.775'), (1, '5966.744')] [2023-12-26 07:52:33,925][123090] Updated weights for policy 1, policy_version 1030276 (0.0008) [2023-12-26 07:52:33,972][123091] Updated weights for policy 0, policy_version 1037651 (0.0010) [2023-12-26 07:52:33,982][123090] Updated weights for policy 1, policy_version 1030286 (0.0005) [2023-12-26 07:52:34,024][123091] Updated weights for policy 0, policy_version 1037661 (0.0010) [2023-12-26 07:52:34,031][123090] Updated weights for policy 1, policy_version 1030296 (0.0005) [2023-12-26 07:52:34,083][123091] Updated weights for policy 0, policy_version 1037671 (0.0010) [2023-12-26 07:52:34,779][123090] Updated weights for policy 1, policy_version 1030306 (0.0006) [2023-12-26 07:52:34,822][123091] Updated weights for policy 0, policy_version 1037681 (0.0008) [2023-12-26 07:52:34,843][123090] Updated weights for policy 1, policy_version 1030316 (0.0011) [2023-12-26 07:52:34,885][123091] Updated weights for policy 0, policy_version 1037691 (0.0006) [2023-12-26 07:52:34,908][123090] Updated weights for policy 1, policy_version 1030326 (0.0008) [2023-12-26 07:52:34,957][123091] Updated weights for policy 0, policy_version 1037701 (0.0006) [2023-12-26 07:52:34,980][123090] Updated weights for policy 1, policy_version 1030336 (0.0008) [2023-12-26 07:52:35,024][123091] Updated weights for policy 0, policy_version 1037711 (0.0008) [2023-12-26 07:52:35,749][123090] Updated weights for policy 1, policy_version 1030346 (0.0009) [2023-12-26 07:52:35,817][123090] Updated weights for policy 1, policy_version 1030356 (0.0006) [2023-12-26 07:52:35,819][123091] Updated weights for policy 0, policy_version 1037721 (0.0011) [2023-12-26 07:52:35,887][123091] Updated weights for policy 0, policy_version 1037731 (0.0011) [2023-12-26 07:52:35,888][123090] Updated weights for policy 1, policy_version 1030366 (0.0006) [2023-12-26 07:52:35,943][123091] Updated weights for policy 0, policy_version 1037741 (0.0009) [2023-12-26 07:52:36,604][123090] Updated weights for policy 1, policy_version 1030376 (0.0008) [2023-12-26 07:52:36,665][123090] Updated weights for policy 1, policy_version 1030386 (0.0008) [2023-12-26 07:52:36,726][123090] Updated weights for policy 1, policy_version 1030396 (0.0008) [2023-12-26 07:52:36,774][123091] Updated weights for policy 0, policy_version 1037751 (0.0010) [2023-12-26 07:52:36,829][123091] Updated weights for policy 0, policy_version 1037761 (0.0010) [2023-12-26 07:52:36,881][123091] Updated weights for policy 0, policy_version 1037771 (0.0011) [2023-12-26 07:52:37,367][123090] Updated weights for policy 1, policy_version 1030406 (0.0006) [2023-12-26 07:52:37,426][123090] Updated weights for policy 1, policy_version 1030416 (0.0005) [2023-12-26 07:52:37,484][123090] Updated weights for policy 1, policy_version 1030427 (0.0008) [2023-12-26 07:52:37,720][123091] Updated weights for policy 0, policy_version 1037781 (0.0011) [2023-12-26 07:52:37,769][123091] Updated weights for policy 0, policy_version 1037791 (0.0010) [2023-12-26 07:52:37,817][123091] Updated weights for policy 0, policy_version 1037801 (0.0010) [2023-12-26 07:52:38,258][123090] Updated weights for policy 1, policy_version 1030437 (0.0009) [2023-12-26 07:52:38,321][123090] Updated weights for policy 1, policy_version 1030447 (0.0008) [2023-12-26 07:52:38,387][123090] Updated weights for policy 1, policy_version 1030457 (0.0010) [2023-12-26 07:52:38,626][123091] Updated weights for policy 0, policy_version 1037811 (0.0009) [2023-12-26 07:52:38,679][123091] Updated weights for policy 0, policy_version 1037821 (0.0009) [2023-12-26 07:52:38,742][123091] Updated weights for policy 0, policy_version 1037831 (0.0010) [2023-12-26 07:52:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 529481728. Throughput: 0: 8918.8, 1: 9072.1. Samples: 529460420. Policy #0 lag: (min: 31.0, avg: 38.7, max: 63.0) [2023-12-26 07:52:38,784][121949] Avg episode reward: [(0, '6325.853'), (1, '5845.146')] [2023-12-26 07:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001037840_265691136.pth... [2023-12-26 07:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001030464_263798784.pth... [2023-12-26 07:52:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001036784_265420800.pth [2023-12-26 07:52:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001029408_263528448.pth [2023-12-26 07:52:39,269][123090] Updated weights for policy 1, policy_version 1030467 (0.0010) [2023-12-26 07:52:39,339][123090] Updated weights for policy 1, policy_version 1030477 (0.0012) [2023-12-26 07:52:39,412][123090] Updated weights for policy 1, policy_version 1030487 (0.0010) [2023-12-26 07:52:39,569][123091] Updated weights for policy 0, policy_version 1037841 (0.0010) [2023-12-26 07:52:39,635][123091] Updated weights for policy 0, policy_version 1037851 (0.0009) [2023-12-26 07:52:39,705][123091] Updated weights for policy 0, policy_version 1037861 (0.0009) [2023-12-26 07:52:39,775][123091] Updated weights for policy 0, policy_version 1037871 (0.0009) [2023-12-26 07:52:40,231][123090] Updated weights for policy 1, policy_version 1030497 (0.0010) [2023-12-26 07:52:40,304][123090] Updated weights for policy 1, policy_version 1030507 (0.0005) [2023-12-26 07:52:40,373][123090] Updated weights for policy 1, policy_version 1030517 (0.0011) [2023-12-26 07:52:40,445][123090] Updated weights for policy 1, policy_version 1030527 (0.0008) [2023-12-26 07:52:40,580][123091] Updated weights for policy 0, policy_version 1037881 (0.0011) [2023-12-26 07:52:40,629][123091] Updated weights for policy 0, policy_version 1037891 (0.0011) [2023-12-26 07:52:40,689][123091] Updated weights for policy 0, policy_version 1037901 (0.0011) [2023-12-26 07:52:41,231][123090] Updated weights for policy 1, policy_version 1030537 (0.0009) [2023-12-26 07:52:41,299][123090] Updated weights for policy 1, policy_version 1030547 (0.0009) [2023-12-26 07:52:41,377][123090] Updated weights for policy 1, policy_version 1030557 (0.0009) [2023-12-26 07:52:41,534][123091] Updated weights for policy 0, policy_version 1037911 (0.0009) [2023-12-26 07:52:41,586][123091] Updated weights for policy 0, policy_version 1037921 (0.0008) [2023-12-26 07:52:41,650][123091] Updated weights for policy 0, policy_version 1037931 (0.0008) [2023-12-26 07:52:42,182][123090] Updated weights for policy 1, policy_version 1030567 (0.0007) [2023-12-26 07:52:42,235][123090] Updated weights for policy 1, policy_version 1030577 (0.0009) [2023-12-26 07:52:42,297][123090] Updated weights for policy 1, policy_version 1030587 (0.0009) [2023-12-26 07:52:42,440][123091] Updated weights for policy 0, policy_version 1037941 (0.0007) [2023-12-26 07:52:42,506][123091] Updated weights for policy 0, policy_version 1037951 (0.0006) [2023-12-26 07:52:42,565][123091] Updated weights for policy 0, policy_version 1037961 (0.0005) [2023-12-26 07:52:43,157][123091] Updated weights for policy 0, policy_version 1037971 (0.0005) [2023-12-26 07:52:43,204][123091] Updated weights for policy 0, policy_version 1037981 (0.0005) [2023-12-26 07:52:43,206][123090] Updated weights for policy 1, policy_version 1030597 (0.0008) [2023-12-26 07:52:43,253][123091] Updated weights for policy 0, policy_version 1037991 (0.0005) [2023-12-26 07:52:43,256][123090] Updated weights for policy 1, policy_version 1030607 (0.0008) [2023-12-26 07:52:43,306][123090] Updated weights for policy 1, policy_version 1030617 (0.0009) [2023-12-26 07:52:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17966.9). Total num frames: 529571840. Throughput: 0: 8852.0, 1: 9033.2. Samples: 529564544. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:52:43,784][121949] Avg episode reward: [(0, '6354.744'), (1, '5895.875')] [2023-12-26 07:52:43,910][123091] Updated weights for policy 0, policy_version 1038001 (0.0005) [2023-12-26 07:52:43,958][123091] Updated weights for policy 0, policy_version 1038011 (0.0005) [2023-12-26 07:52:44,013][123091] Updated weights for policy 0, policy_version 1038021 (0.0005) [2023-12-26 07:52:44,080][123091] Updated weights for policy 0, policy_version 1038031 (0.0005) [2023-12-26 07:52:44,082][123090] Updated weights for policy 1, policy_version 1030627 (0.0008) [2023-12-26 07:52:44,135][123090] Updated weights for policy 1, policy_version 1030637 (0.0006) [2023-12-26 07:52:44,185][123090] Updated weights for policy 1, policy_version 1030647 (0.0007) [2023-12-26 07:52:44,884][123091] Updated weights for policy 0, policy_version 1038041 (0.0009) [2023-12-26 07:52:44,956][123091] Updated weights for policy 0, policy_version 1038051 (0.0008) [2023-12-26 07:52:44,991][123090] Updated weights for policy 1, policy_version 1030657 (0.0006) [2023-12-26 07:52:45,020][123091] Updated weights for policy 0, policy_version 1038061 (0.0008) [2023-12-26 07:52:45,051][123090] Updated weights for policy 1, policy_version 1030667 (0.0010) [2023-12-26 07:52:45,106][123090] Updated weights for policy 1, policy_version 1030677 (0.0010) [2023-12-26 07:52:45,172][123090] Updated weights for policy 1, policy_version 1030687 (0.0005) [2023-12-26 07:52:45,876][123090] Updated weights for policy 1, policy_version 1030697 (0.0010) [2023-12-26 07:52:45,934][123091] Updated weights for policy 0, policy_version 1038071 (0.0008) [2023-12-26 07:52:45,941][123090] Updated weights for policy 1, policy_version 1030707 (0.0009) [2023-12-26 07:52:45,995][123091] Updated weights for policy 0, policy_version 1038081 (0.0009) [2023-12-26 07:52:46,003][123090] Updated weights for policy 1, policy_version 1030717 (0.0006) [2023-12-26 07:52:46,056][123091] Updated weights for policy 0, policy_version 1038091 (0.0009) [2023-12-26 07:52:46,666][123090] Updated weights for policy 1, policy_version 1030727 (0.0007) [2023-12-26 07:52:46,714][123090] Updated weights for policy 1, policy_version 1030737 (0.0005) [2023-12-26 07:52:46,772][123090] Updated weights for policy 1, policy_version 1030747 (0.0005) [2023-12-26 07:52:46,912][123091] Updated weights for policy 0, policy_version 1038101 (0.0011) [2023-12-26 07:52:46,981][123091] Updated weights for policy 0, policy_version 1038111 (0.0010) [2023-12-26 07:52:47,033][123091] Updated weights for policy 0, policy_version 1038121 (0.0010) [2023-12-26 07:52:47,484][123090] Updated weights for policy 1, policy_version 1030757 (0.0006) [2023-12-26 07:52:47,541][123090] Updated weights for policy 1, policy_version 1030767 (0.0005) [2023-12-26 07:52:47,600][123090] Updated weights for policy 1, policy_version 1030777 (0.0005) [2023-12-26 07:52:47,847][123091] Updated weights for policy 0, policy_version 1038131 (0.0010) [2023-12-26 07:52:47,906][123091] Updated weights for policy 0, policy_version 1038141 (0.0010) [2023-12-26 07:52:47,983][123091] Updated weights for policy 0, policy_version 1038151 (0.0011) [2023-12-26 07:52:48,246][123090] Updated weights for policy 1, policy_version 1030787 (0.0008) [2023-12-26 07:52:48,311][123090] Updated weights for policy 1, policy_version 1030797 (0.0005) [2023-12-26 07:52:48,384][123090] Updated weights for policy 1, policy_version 1030807 (0.0008) [2023-12-26 07:52:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 529661952. Throughput: 0: 8874.3, 1: 9163.5. Samples: 529675220. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:52:48,784][121949] Avg episode reward: [(0, '6184.466'), (1, '5765.756')] [2023-12-26 07:52:48,787][123091] Updated weights for policy 0, policy_version 1038161 (0.0011) [2023-12-26 07:52:48,857][123091] Updated weights for policy 0, policy_version 1038171 (0.0011) [2023-12-26 07:52:48,922][123091] Updated weights for policy 0, policy_version 1038181 (0.0010) [2023-12-26 07:52:48,982][123091] Updated weights for policy 0, policy_version 1038191 (0.0011) [2023-12-26 07:52:49,068][123090] Updated weights for policy 1, policy_version 1030817 (0.0008) [2023-12-26 07:52:49,138][123090] Updated weights for policy 1, policy_version 1030827 (0.0006) [2023-12-26 07:52:49,205][123090] Updated weights for policy 1, policy_version 1030837 (0.0005) [2023-12-26 07:52:49,274][123090] Updated weights for policy 1, policy_version 1030847 (0.0007) [2023-12-26 07:52:49,813][123091] Updated weights for policy 0, policy_version 1038201 (0.0011) [2023-12-26 07:52:49,881][123091] Updated weights for policy 0, policy_version 1038211 (0.0011) [2023-12-26 07:52:49,940][123090] Updated weights for policy 1, policy_version 1030857 (0.0011) [2023-12-26 07:52:49,964][123091] Updated weights for policy 0, policy_version 1038221 (0.0011) [2023-12-26 07:52:49,989][123090] Updated weights for policy 1, policy_version 1030867 (0.0010) [2023-12-26 07:52:50,040][123090] Updated weights for policy 1, policy_version 1030877 (0.0010) [2023-12-26 07:52:50,768][123091] Updated weights for policy 0, policy_version 1038231 (0.0011) [2023-12-26 07:52:50,827][123091] Updated weights for policy 0, policy_version 1038241 (0.0011) [2023-12-26 07:52:50,879][123091] Updated weights for policy 0, policy_version 1038251 (0.0010) [2023-12-26 07:52:50,890][123090] Updated weights for policy 1, policy_version 1030887 (0.0010) [2023-12-26 07:52:50,946][123090] Updated weights for policy 1, policy_version 1030897 (0.0010) [2023-12-26 07:52:51,009][123090] Updated weights for policy 1, policy_version 1030907 (0.0013) [2023-12-26 07:52:51,734][123091] Updated weights for policy 0, policy_version 1038261 (0.0010) [2023-12-26 07:52:51,804][123091] Updated weights for policy 0, policy_version 1038271 (0.0006) [2023-12-26 07:52:51,876][123091] Updated weights for policy 0, policy_version 1038281 (0.0006) [2023-12-26 07:52:51,905][123090] Updated weights for policy 1, policy_version 1030917 (0.0010) [2023-12-26 07:52:51,970][123090] Updated weights for policy 1, policy_version 1030927 (0.0009) [2023-12-26 07:52:52,031][123090] Updated weights for policy 1, policy_version 1030937 (0.0010) [2023-12-26 07:52:52,607][123091] Updated weights for policy 0, policy_version 1038291 (0.0007) [2023-12-26 07:52:52,667][123091] Updated weights for policy 0, policy_version 1038301 (0.0009) [2023-12-26 07:52:52,734][123091] Updated weights for policy 0, policy_version 1038311 (0.0007) [2023-12-26 07:52:52,899][123090] Updated weights for policy 1, policy_version 1030947 (0.0009) [2023-12-26 07:52:52,951][123090] Updated weights for policy 1, policy_version 1030957 (0.0005) [2023-12-26 07:52:52,996][123090] Updated weights for policy 1, policy_version 1030967 (0.0005) [2023-12-26 07:52:53,342][123091] Updated weights for policy 0, policy_version 1038321 (0.0005) [2023-12-26 07:52:53,393][123091] Updated weights for policy 0, policy_version 1038331 (0.0005) [2023-12-26 07:52:53,468][123091] Updated weights for policy 0, policy_version 1038341 (0.0005) [2023-12-26 07:52:53,541][123091] Updated weights for policy 0, policy_version 1038351 (0.0005) [2023-12-26 07:52:53,647][123090] Updated weights for policy 1, policy_version 1030977 (0.0005) [2023-12-26 07:52:53,701][123090] Updated weights for policy 1, policy_version 1030987 (0.0005) [2023-12-26 07:52:53,749][123090] Updated weights for policy 1, policy_version 1030997 (0.0006) [2023-12-26 07:52:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17886.0, 300 sec: 17939.1). Total num frames: 529752064. Throughput: 0: 8890.1, 1: 9148.5. Samples: 529727832. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:52:53,785][121949] Avg episode reward: [(0, '6117.958'), (1, '5736.362')] [2023-12-26 07:52:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001038352_265822208.pth... [2023-12-26 07:52:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001037296_265551872.pth [2023-12-26 07:52:53,803][123090] Updated weights for policy 1, policy_version 1031007 (0.0010) [2023-12-26 07:52:53,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001031008_263938048.pth... [2023-12-26 07:52:53,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001029920_263659520.pth [2023-12-26 07:52:54,234][123091] Updated weights for policy 0, policy_version 1038361 (0.0010) [2023-12-26 07:52:54,288][123091] Updated weights for policy 0, policy_version 1038371 (0.0010) [2023-12-26 07:52:54,335][123091] Updated weights for policy 0, policy_version 1038381 (0.0009) [2023-12-26 07:52:54,540][123090] Updated weights for policy 1, policy_version 1031017 (0.0010) [2023-12-26 07:52:54,593][123090] Updated weights for policy 1, policy_version 1031027 (0.0008) [2023-12-26 07:52:54,653][123090] Updated weights for policy 1, policy_version 1031037 (0.0009) [2023-12-26 07:52:55,169][123091] Updated weights for policy 0, policy_version 1038391 (0.0007) [2023-12-26 07:52:55,242][123091] Updated weights for policy 0, policy_version 1038401 (0.0005) [2023-12-26 07:52:55,315][123091] Updated weights for policy 0, policy_version 1038411 (0.0005) [2023-12-26 07:52:55,541][123090] Updated weights for policy 1, policy_version 1031047 (0.0008) [2023-12-26 07:52:55,610][123090] Updated weights for policy 1, policy_version 1031057 (0.0009) [2023-12-26 07:52:55,674][123090] Updated weights for policy 1, policy_version 1031067 (0.0010) [2023-12-26 07:52:55,973][123091] Updated weights for policy 0, policy_version 1038422 (0.0008) [2023-12-26 07:52:56,034][123091] Updated weights for policy 0, policy_version 1038433 (0.0010) [2023-12-26 07:52:56,088][123091] Updated weights for policy 0, policy_version 1038443 (0.0011) [2023-12-26 07:52:56,380][123090] Updated weights for policy 1, policy_version 1031077 (0.0008) [2023-12-26 07:52:56,457][123090] Updated weights for policy 1, policy_version 1031087 (0.0006) [2023-12-26 07:52:56,532][123090] Updated weights for policy 1, policy_version 1031097 (0.0005) [2023-12-26 07:52:56,866][123091] Updated weights for policy 0, policy_version 1038453 (0.0008) [2023-12-26 07:52:56,914][123091] Updated weights for policy 0, policy_version 1038463 (0.0005) [2023-12-26 07:52:56,967][123091] Updated weights for policy 0, policy_version 1038473 (0.0007) [2023-12-26 07:52:57,138][123090] Updated weights for policy 1, policy_version 1031107 (0.0005) [2023-12-26 07:52:57,186][123090] Updated weights for policy 1, policy_version 1031117 (0.0005) [2023-12-26 07:52:57,248][123090] Updated weights for policy 1, policy_version 1031127 (0.0005) [2023-12-26 07:52:57,667][123091] Updated weights for policy 0, policy_version 1038483 (0.0005) [2023-12-26 07:52:57,736][123091] Updated weights for policy 0, policy_version 1038493 (0.0009) [2023-12-26 07:52:57,804][123091] Updated weights for policy 0, policy_version 1038503 (0.0010) [2023-12-26 07:52:57,933][123090] Updated weights for policy 1, policy_version 1031137 (0.0005) [2023-12-26 07:52:57,981][123090] Updated weights for policy 1, policy_version 1031147 (0.0005) [2023-12-26 07:52:58,039][123090] Updated weights for policy 1, policy_version 1031157 (0.0006) [2023-12-26 07:52:58,104][123090] Updated weights for policy 1, policy_version 1031167 (0.0008) [2023-12-26 07:52:58,723][123091] Updated weights for policy 0, policy_version 1038513 (0.0009) [2023-12-26 07:52:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 529842176. Throughput: 0: 9125.9, 1: 9188.4. Samples: 529842908. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:52:58,785][121949] Avg episode reward: [(0, '6245.596'), (1, '5908.956')] [2023-12-26 07:52:58,808][123091] Updated weights for policy 0, policy_version 1038523 (0.0007) [2023-12-26 07:52:58,879][123091] Updated weights for policy 0, policy_version 1038533 (0.0008) [2023-12-26 07:52:58,944][123091] Updated weights for policy 0, policy_version 1038543 (0.0006) [2023-12-26 07:52:58,955][123090] Updated weights for policy 1, policy_version 1031177 (0.0010) [2023-12-26 07:52:59,025][123090] Updated weights for policy 1, policy_version 1031187 (0.0013) [2023-12-26 07:52:59,085][123090] Updated weights for policy 1, policy_version 1031197 (0.0010) [2023-12-26 07:52:59,714][123091] Updated weights for policy 0, policy_version 1038553 (0.0007) [2023-12-26 07:52:59,771][123091] Updated weights for policy 0, policy_version 1038563 (0.0006) [2023-12-26 07:52:59,836][123091] Updated weights for policy 0, policy_version 1038573 (0.0009) [2023-12-26 07:52:59,912][123090] Updated weights for policy 1, policy_version 1031207 (0.0008) [2023-12-26 07:52:59,980][123090] Updated weights for policy 1, policy_version 1031217 (0.0006) [2023-12-26 07:53:00,041][123090] Updated weights for policy 1, policy_version 1031227 (0.0006) [2023-12-26 07:53:00,621][123091] Updated weights for policy 0, policy_version 1038583 (0.0010) [2023-12-26 07:53:00,673][123091] Updated weights for policy 0, policy_version 1038593 (0.0011) [2023-12-26 07:53:00,707][123090] Updated weights for policy 1, policy_version 1031237 (0.0007) [2023-12-26 07:53:00,735][123091] Updated weights for policy 0, policy_version 1038603 (0.0011) [2023-12-26 07:53:00,776][123090] Updated weights for policy 1, policy_version 1031247 (0.0005) [2023-12-26 07:53:00,852][123090] Updated weights for policy 1, policy_version 1031257 (0.0005) [2023-12-26 07:53:01,491][123090] Updated weights for policy 1, policy_version 1031267 (0.0007) [2023-12-26 07:53:01,497][123091] Updated weights for policy 0, policy_version 1038613 (0.0008) [2023-12-26 07:53:01,556][123090] Updated weights for policy 1, policy_version 1031277 (0.0010) [2023-12-26 07:53:01,562][123091] Updated weights for policy 0, policy_version 1038623 (0.0010) [2023-12-26 07:53:01,613][123090] Updated weights for policy 1, policy_version 1031287 (0.0010) [2023-12-26 07:53:01,621][123091] Updated weights for policy 0, policy_version 1038633 (0.0007) [2023-12-26 07:53:02,446][123090] Updated weights for policy 1, policy_version 1031297 (0.0010) [2023-12-26 07:53:02,459][123091] Updated weights for policy 0, policy_version 1038643 (0.0007) [2023-12-26 07:53:02,509][123090] Updated weights for policy 1, policy_version 1031307 (0.0009) [2023-12-26 07:53:02,519][123091] Updated weights for policy 0, policy_version 1038653 (0.0009) [2023-12-26 07:53:02,573][123090] Updated weights for policy 1, policy_version 1031317 (0.0009) [2023-12-26 07:53:02,580][123091] Updated weights for policy 0, policy_version 1038663 (0.0007) [2023-12-26 07:53:02,638][123090] Updated weights for policy 1, policy_version 1031327 (0.0008) [2023-12-26 07:53:03,318][123091] Updated weights for policy 0, policy_version 1038673 (0.0009) [2023-12-26 07:53:03,366][123091] Updated weights for policy 0, policy_version 1038683 (0.0005) [2023-12-26 07:53:03,411][123091] Updated weights for policy 0, policy_version 1038693 (0.0007) [2023-12-26 07:53:03,460][123091] Updated weights for policy 0, policy_version 1038703 (0.0008) [2023-12-26 07:53:03,508][123090] Updated weights for policy 1, policy_version 1031337 (0.0009) [2023-12-26 07:53:03,572][123090] Updated weights for policy 1, policy_version 1031347 (0.0009) [2023-12-26 07:53:03,631][123090] Updated weights for policy 1, policy_version 1031357 (0.0011) [2023-12-26 07:53:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18159.0, 300 sec: 17939.1). Total num frames: 529940480. Throughput: 0: 8997.5, 1: 9178.8. Samples: 529948152. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:03,784][121949] Avg episode reward: [(0, '6213.230'), (1, '5756.881')] [2023-12-26 07:53:04,229][123091] Updated weights for policy 0, policy_version 1038713 (0.0006) [2023-12-26 07:53:04,292][123091] Updated weights for policy 0, policy_version 1038723 (0.0008) [2023-12-26 07:53:04,356][123091] Updated weights for policy 0, policy_version 1038733 (0.0008) [2023-12-26 07:53:04,486][123090] Updated weights for policy 1, policy_version 1031367 (0.0010) [2023-12-26 07:53:04,536][123090] Updated weights for policy 1, policy_version 1031377 (0.0009) [2023-12-26 07:53:04,590][123090] Updated weights for policy 1, policy_version 1031387 (0.0009) [2023-12-26 07:53:05,047][123091] Updated weights for policy 0, policy_version 1038743 (0.0010) [2023-12-26 07:53:05,098][123091] Updated weights for policy 0, policy_version 1038753 (0.0010) [2023-12-26 07:53:05,150][123091] Updated weights for policy 0, policy_version 1038763 (0.0011) [2023-12-26 07:53:05,503][123090] Updated weights for policy 1, policy_version 1031397 (0.0010) [2023-12-26 07:53:05,563][123090] Updated weights for policy 1, policy_version 1031407 (0.0010) [2023-12-26 07:53:05,617][123090] Updated weights for policy 1, policy_version 1031417 (0.0010) [2023-12-26 07:53:05,873][123091] Updated weights for policy 0, policy_version 1038773 (0.0008) [2023-12-26 07:53:05,941][123091] Updated weights for policy 0, policy_version 1038783 (0.0006) [2023-12-26 07:53:05,997][123091] Updated weights for policy 0, policy_version 1038793 (0.0009) [2023-12-26 07:53:06,561][123090] Updated weights for policy 1, policy_version 1031428 (0.0010) [2023-12-26 07:53:06,624][123090] Updated weights for policy 1, policy_version 1031438 (0.0008) [2023-12-26 07:53:06,631][123091] Updated weights for policy 0, policy_version 1038803 (0.0010) [2023-12-26 07:53:06,694][123091] Updated weights for policy 0, policy_version 1038813 (0.0010) [2023-12-26 07:53:06,697][123090] Updated weights for policy 1, policy_version 1031448 (0.0007) [2023-12-26 07:53:06,761][123091] Updated weights for policy 0, policy_version 1038823 (0.0009) [2023-12-26 07:53:07,395][123090] Updated weights for policy 1, policy_version 1031458 (0.0010) [2023-12-26 07:53:07,455][123090] Updated weights for policy 1, policy_version 1031468 (0.0009) [2023-12-26 07:53:07,505][123091] Updated weights for policy 0, policy_version 1038833 (0.0006) [2023-12-26 07:53:07,520][123090] Updated weights for policy 1, policy_version 1031478 (0.0009) [2023-12-26 07:53:07,571][123091] Updated weights for policy 0, policy_version 1038843 (0.0005) [2023-12-26 07:53:07,590][123090] Updated weights for policy 1, policy_version 1031488 (0.0009) [2023-12-26 07:53:07,638][123091] Updated weights for policy 0, policy_version 1038853 (0.0005) [2023-12-26 07:53:07,704][123091] Updated weights for policy 0, policy_version 1038863 (0.0009) [2023-12-26 07:53:08,396][123091] Updated weights for policy 0, policy_version 1038873 (0.0007) [2023-12-26 07:53:08,427][123090] Updated weights for policy 1, policy_version 1031498 (0.0010) [2023-12-26 07:53:08,460][123091] Updated weights for policy 0, policy_version 1038883 (0.0005) [2023-12-26 07:53:08,489][123090] Updated weights for policy 1, policy_version 1031508 (0.0008) [2023-12-26 07:53:08,521][123091] Updated weights for policy 0, policy_version 1038893 (0.0005) [2023-12-26 07:53:08,549][123090] Updated weights for policy 1, policy_version 1031518 (0.0008) [2023-12-26 07:53:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18295.5, 300 sec: 17966.9). Total num frames: 530030592. Throughput: 0: 9080.9, 1: 9133.3. Samples: 530001752. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:08,785][121949] Avg episode reward: [(0, '6226.759'), (1, '5717.328')] [2023-12-26 07:53:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001038896_265961472.pth... [2023-12-26 07:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001031520_264069120.pth... [2023-12-26 07:53:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001037840_265691136.pth [2023-12-26 07:53:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001030464_263798784.pth [2023-12-26 07:53:09,311][123091] Updated weights for policy 0, policy_version 1038903 (0.0009) [2023-12-26 07:53:09,341][123090] Updated weights for policy 1, policy_version 1031528 (0.0008) [2023-12-26 07:53:09,373][123091] Updated weights for policy 0, policy_version 1038913 (0.0010) [2023-12-26 07:53:09,415][123090] Updated weights for policy 1, policy_version 1031538 (0.0008) [2023-12-26 07:53:09,446][123091] Updated weights for policy 0, policy_version 1038923 (0.0011) [2023-12-26 07:53:09,474][123090] Updated weights for policy 1, policy_version 1031548 (0.0006) [2023-12-26 07:53:10,252][123091] Updated weights for policy 0, policy_version 1038933 (0.0008) [2023-12-26 07:53:10,290][123090] Updated weights for policy 1, policy_version 1031558 (0.0008) [2023-12-26 07:53:10,323][123091] Updated weights for policy 0, policy_version 1038943 (0.0005) [2023-12-26 07:53:10,354][123090] Updated weights for policy 1, policy_version 1031568 (0.0008) [2023-12-26 07:53:10,378][123091] Updated weights for policy 0, policy_version 1038953 (0.0011) [2023-12-26 07:53:10,407][123090] Updated weights for policy 1, policy_version 1031578 (0.0007) [2023-12-26 07:53:11,047][123091] Updated weights for policy 0, policy_version 1038963 (0.0010) [2023-12-26 07:53:11,111][123091] Updated weights for policy 0, policy_version 1038973 (0.0010) [2023-12-26 07:53:11,180][123091] Updated weights for policy 0, policy_version 1038983 (0.0010) [2023-12-26 07:53:11,316][123090] Updated weights for policy 1, policy_version 1031588 (0.0009) [2023-12-26 07:53:11,386][123090] Updated weights for policy 1, policy_version 1031598 (0.0009) [2023-12-26 07:53:11,454][123090] Updated weights for policy 1, policy_version 1031608 (0.0009) [2023-12-26 07:53:12,017][123091] Updated weights for policy 0, policy_version 1038993 (0.0009) [2023-12-26 07:53:12,087][123091] Updated weights for policy 0, policy_version 1039003 (0.0008) [2023-12-26 07:53:12,160][123091] Updated weights for policy 0, policy_version 1039013 (0.0006) [2023-12-26 07:53:12,230][123091] Updated weights for policy 0, policy_version 1039023 (0.0011) [2023-12-26 07:53:12,310][123090] Updated weights for policy 1, policy_version 1031618 (0.0008) [2023-12-26 07:53:12,380][123090] Updated weights for policy 1, policy_version 1031628 (0.0009) [2023-12-26 07:53:12,443][123090] Updated weights for policy 1, policy_version 1031638 (0.0008) [2023-12-26 07:53:12,500][123090] Updated weights for policy 1, policy_version 1031648 (0.0005) [2023-12-26 07:53:13,038][123091] Updated weights for policy 0, policy_version 1039033 (0.0006) [2023-12-26 07:53:13,089][123091] Updated weights for policy 0, policy_version 1039043 (0.0005) [2023-12-26 07:53:13,161][123091] Updated weights for policy 0, policy_version 1039053 (0.0006) [2023-12-26 07:53:13,212][123090] Updated weights for policy 1, policy_version 1031658 (0.0008) [2023-12-26 07:53:13,272][123090] Updated weights for policy 1, policy_version 1031668 (0.0008) [2023-12-26 07:53:13,327][123090] Updated weights for policy 1, policy_version 1031678 (0.0005) [2023-12-26 07:53:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.5, 300 sec: 17939.1). Total num frames: 530112512. Throughput: 0: 9053.0, 1: 9043.3. Samples: 530108204. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:13,784][121949] Avg episode reward: [(0, '6280.219'), (1, '5778.719')] [2023-12-26 07:53:13,879][123091] Updated weights for policy 0, policy_version 1039064 (0.0008) [2023-12-26 07:53:13,927][123091] Updated weights for policy 0, policy_version 1039074 (0.0009) [2023-12-26 07:53:13,980][123091] Updated weights for policy 0, policy_version 1039084 (0.0009) [2023-12-26 07:53:14,041][123090] Updated weights for policy 1, policy_version 1031688 (0.0008) [2023-12-26 07:53:14,114][123090] Updated weights for policy 1, policy_version 1031698 (0.0010) [2023-12-26 07:53:14,176][123090] Updated weights for policy 1, policy_version 1031708 (0.0010) [2023-12-26 07:53:14,780][123091] Updated weights for policy 0, policy_version 1039094 (0.0008) [2023-12-26 07:53:14,846][123091] Updated weights for policy 0, policy_version 1039104 (0.0006) [2023-12-26 07:53:14,896][123091] Updated weights for policy 0, policy_version 1039114 (0.0005) [2023-12-26 07:53:15,003][123090] Updated weights for policy 1, policy_version 1031718 (0.0010) [2023-12-26 07:53:15,076][123090] Updated weights for policy 1, policy_version 1031728 (0.0010) [2023-12-26 07:53:15,150][123090] Updated weights for policy 1, policy_version 1031738 (0.0010) [2023-12-26 07:53:15,627][123091] Updated weights for policy 0, policy_version 1039124 (0.0007) [2023-12-26 07:53:15,689][123091] Updated weights for policy 0, policy_version 1039134 (0.0009) [2023-12-26 07:53:15,738][123091] Updated weights for policy 0, policy_version 1039144 (0.0009) [2023-12-26 07:53:15,961][123090] Updated weights for policy 1, policy_version 1031748 (0.0010) [2023-12-26 07:53:16,028][123090] Updated weights for policy 1, policy_version 1031758 (0.0011) [2023-12-26 07:53:16,085][123090] Updated weights for policy 1, policy_version 1031768 (0.0011) [2023-12-26 07:53:16,575][123091] Updated weights for policy 0, policy_version 1039154 (0.0009) [2023-12-26 07:53:16,645][123091] Updated weights for policy 0, policy_version 1039164 (0.0008) [2023-12-26 07:53:16,705][123091] Updated weights for policy 0, policy_version 1039174 (0.0005) [2023-12-26 07:53:16,760][123091] Updated weights for policy 0, policy_version 1039184 (0.0009) [2023-12-26 07:53:16,806][123090] Updated weights for policy 1, policy_version 1031778 (0.0009) [2023-12-26 07:53:16,870][123090] Updated weights for policy 1, policy_version 1031788 (0.0005) [2023-12-26 07:53:16,937][123090] Updated weights for policy 1, policy_version 1031798 (0.0005) [2023-12-26 07:53:17,010][123090] Updated weights for policy 1, policy_version 1031808 (0.0005) [2023-12-26 07:53:17,438][123091] Updated weights for policy 0, policy_version 1039194 (0.0005) [2023-12-26 07:53:17,497][123091] Updated weights for policy 0, policy_version 1039204 (0.0008) [2023-12-26 07:53:17,552][123091] Updated weights for policy 0, policy_version 1039214 (0.0009) [2023-12-26 07:53:17,643][123090] Updated weights for policy 1, policy_version 1031818 (0.0010) [2023-12-26 07:53:17,695][123090] Updated weights for policy 1, policy_version 1031828 (0.0010) [2023-12-26 07:53:17,755][123090] Updated weights for policy 1, policy_version 1031838 (0.0010) [2023-12-26 07:53:18,236][123091] Updated weights for policy 0, policy_version 1039224 (0.0007) [2023-12-26 07:53:18,286][123091] Updated weights for policy 0, policy_version 1039235 (0.0009) [2023-12-26 07:53:18,336][123091] Updated weights for policy 0, policy_version 1039245 (0.0006) [2023-12-26 07:53:18,516][123090] Updated weights for policy 1, policy_version 1031848 (0.0006) [2023-12-26 07:53:18,580][123090] Updated weights for policy 1, policy_version 1031858 (0.0005) [2023-12-26 07:53:18,644][123090] Updated weights for policy 1, policy_version 1031868 (0.0005) [2023-12-26 07:53:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18295.5, 300 sec: 17966.9). Total num frames: 530210816. Throughput: 0: 9065.6, 1: 9029.4. Samples: 530220280. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:18,785][121949] Avg episode reward: [(0, '6163.020'), (1, '5822.169')] [2023-12-26 07:53:19,170][123091] Updated weights for policy 0, policy_version 1039255 (0.0010) [2023-12-26 07:53:19,227][123091] Updated weights for policy 0, policy_version 1039265 (0.0009) [2023-12-26 07:53:19,288][123090] Updated weights for policy 1, policy_version 1031878 (0.0007) [2023-12-26 07:53:19,296][123091] Updated weights for policy 0, policy_version 1039275 (0.0008) [2023-12-26 07:53:19,365][123090] Updated weights for policy 1, policy_version 1031888 (0.0011) [2023-12-26 07:53:19,432][123090] Updated weights for policy 1, policy_version 1031898 (0.0010) [2023-12-26 07:53:20,048][123091] Updated weights for policy 0, policy_version 1039285 (0.0006) [2023-12-26 07:53:20,112][123091] Updated weights for policy 0, policy_version 1039295 (0.0006) [2023-12-26 07:53:20,182][123091] Updated weights for policy 0, policy_version 1039305 (0.0007) [2023-12-26 07:53:20,258][123090] Updated weights for policy 1, policy_version 1031908 (0.0009) [2023-12-26 07:53:20,332][123090] Updated weights for policy 1, policy_version 1031918 (0.0006) [2023-12-26 07:53:20,397][123090] Updated weights for policy 1, policy_version 1031928 (0.0008) [2023-12-26 07:53:21,013][123091] Updated weights for policy 0, policy_version 1039315 (0.0010) [2023-12-26 07:53:21,084][123091] Updated weights for policy 0, policy_version 1039325 (0.0009) [2023-12-26 07:53:21,090][123090] Updated weights for policy 1, policy_version 1031938 (0.0006) [2023-12-26 07:53:21,153][123091] Updated weights for policy 0, policy_version 1039335 (0.0007) [2023-12-26 07:53:21,157][123090] Updated weights for policy 1, policy_version 1031948 (0.0008) [2023-12-26 07:53:21,224][123090] Updated weights for policy 1, policy_version 1031958 (0.0008) [2023-12-26 07:53:21,292][123090] Updated weights for policy 1, policy_version 1031968 (0.0008) [2023-12-26 07:53:21,961][123091] Updated weights for policy 0, policy_version 1039345 (0.0008) [2023-12-26 07:53:22,026][123091] Updated weights for policy 0, policy_version 1039355 (0.0008) [2023-12-26 07:53:22,090][123091] Updated weights for policy 0, policy_version 1039365 (0.0008) [2023-12-26 07:53:22,113][123090] Updated weights for policy 1, policy_version 1031978 (0.0011) [2023-12-26 07:53:22,149][123091] Updated weights for policy 0, policy_version 1039375 (0.0008) [2023-12-26 07:53:22,180][123090] Updated weights for policy 1, policy_version 1031988 (0.0008) [2023-12-26 07:53:22,254][123090] Updated weights for policy 1, policy_version 1031998 (0.0006) [2023-12-26 07:53:22,932][123091] Updated weights for policy 0, policy_version 1039385 (0.0009) [2023-12-26 07:53:22,989][123091] Updated weights for policy 0, policy_version 1039395 (0.0009) [2023-12-26 07:53:23,037][123090] Updated weights for policy 1, policy_version 1032008 (0.0010) [2023-12-26 07:53:23,040][123091] Updated weights for policy 0, policy_version 1039405 (0.0007) [2023-12-26 07:53:23,100][123090] Updated weights for policy 1, policy_version 1032018 (0.0011) [2023-12-26 07:53:23,165][123090] Updated weights for policy 1, policy_version 1032028 (0.0011) [2023-12-26 07:53:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 530292736. Throughput: 0: 9055.1, 1: 8997.5. Samples: 530272788. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:23,785][121949] Avg episode reward: [(0, '6226.603'), (1, '5876.683')] [2023-12-26 07:53:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001032032_264200192.pth... [2023-12-26 07:53:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001039408_266092544.pth... [2023-12-26 07:53:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001031008_263938048.pth [2023-12-26 07:53:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001038352_265822208.pth [2023-12-26 07:53:23,907][123090] Updated weights for policy 1, policy_version 1032038 (0.0008) [2023-12-26 07:53:23,944][123091] Updated weights for policy 0, policy_version 1039415 (0.0008) [2023-12-26 07:53:23,968][123090] Updated weights for policy 1, policy_version 1032048 (0.0006) [2023-12-26 07:53:23,998][123091] Updated weights for policy 0, policy_version 1039425 (0.0009) [2023-12-26 07:53:24,020][123090] Updated weights for policy 1, policy_version 1032058 (0.0007) [2023-12-26 07:53:24,041][123091] Updated weights for policy 0, policy_version 1039435 (0.0009) [2023-12-26 07:53:24,834][123090] Updated weights for policy 1, policy_version 1032068 (0.0010) [2023-12-26 07:53:24,878][123090] Updated weights for policy 1, policy_version 1032078 (0.0010) [2023-12-26 07:53:24,887][123091] Updated weights for policy 0, policy_version 1039445 (0.0007) [2023-12-26 07:53:24,929][123090] Updated weights for policy 1, policy_version 1032088 (0.0010) [2023-12-26 07:53:24,945][123091] Updated weights for policy 0, policy_version 1039455 (0.0008) [2023-12-26 07:53:24,992][123091] Updated weights for policy 0, policy_version 1039465 (0.0007) [2023-12-26 07:53:25,723][123090] Updated weights for policy 1, policy_version 1032098 (0.0010) [2023-12-26 07:53:25,782][123090] Updated weights for policy 1, policy_version 1032108 (0.0009) [2023-12-26 07:53:25,808][123091] Updated weights for policy 0, policy_version 1039475 (0.0008) [2023-12-26 07:53:25,832][123090] Updated weights for policy 1, policy_version 1032118 (0.0007) [2023-12-26 07:53:25,867][123091] Updated weights for policy 0, policy_version 1039485 (0.0010) [2023-12-26 07:53:25,898][123090] Updated weights for policy 1, policy_version 1032128 (0.0009) [2023-12-26 07:53:25,918][123091] Updated weights for policy 0, policy_version 1039495 (0.0009) [2023-12-26 07:53:26,643][123091] Updated weights for policy 0, policy_version 1039505 (0.0009) [2023-12-26 07:53:26,695][123091] Updated weights for policy 0, policy_version 1039515 (0.0005) [2023-12-26 07:53:26,759][123091] Updated weights for policy 0, policy_version 1039525 (0.0009) [2023-12-26 07:53:26,782][123090] Updated weights for policy 1, policy_version 1032138 (0.0008) [2023-12-26 07:53:26,826][123091] Updated weights for policy 0, policy_version 1039535 (0.0011) [2023-12-26 07:53:26,830][123090] Updated weights for policy 1, policy_version 1032148 (0.0007) [2023-12-26 07:53:26,878][123090] Updated weights for policy 1, policy_version 1032158 (0.0008) [2023-12-26 07:53:27,626][123091] Updated weights for policy 0, policy_version 1039545 (0.0009) [2023-12-26 07:53:27,651][123090] Updated weights for policy 1, policy_version 1032168 (0.0008) [2023-12-26 07:53:27,669][123091] Updated weights for policy 0, policy_version 1039555 (0.0007) [2023-12-26 07:53:27,711][123090] Updated weights for policy 1, policy_version 1032178 (0.0008) [2023-12-26 07:53:27,724][123091] Updated weights for policy 0, policy_version 1039565 (0.0005) [2023-12-26 07:53:27,773][123090] Updated weights for policy 1, policy_version 1032188 (0.0009) [2023-12-26 07:53:28,485][123091] Updated weights for policy 0, policy_version 1039575 (0.0008) [2023-12-26 07:53:28,537][123091] Updated weights for policy 0, policy_version 1039585 (0.0007) [2023-12-26 07:53:28,593][123091] Updated weights for policy 0, policy_version 1039595 (0.0009) [2023-12-26 07:53:28,595][123090] Updated weights for policy 1, policy_version 1032198 (0.0008) [2023-12-26 07:53:28,657][123090] Updated weights for policy 1, policy_version 1032208 (0.0009) [2023-12-26 07:53:28,726][123090] Updated weights for policy 1, policy_version 1032218 (0.0009) [2023-12-26 07:53:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17966.9). Total num frames: 530391040. Throughput: 0: 9067.7, 1: 9018.4. Samples: 530378420. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:28,785][121949] Avg episode reward: [(0, '6188.092'), (1, '5883.612')] [2023-12-26 07:53:29,411][123091] Updated weights for policy 0, policy_version 1039605 (0.0009) [2023-12-26 07:53:29,460][123091] Updated weights for policy 0, policy_version 1039615 (0.0009) [2023-12-26 07:53:29,515][123091] Updated weights for policy 0, policy_version 1039625 (0.0008) [2023-12-26 07:53:29,560][123090] Updated weights for policy 1, policy_version 1032228 (0.0008) [2023-12-26 07:53:29,630][123090] Updated weights for policy 1, policy_version 1032238 (0.0009) [2023-12-26 07:53:29,681][123090] Updated weights for policy 1, policy_version 1032248 (0.0009) [2023-12-26 07:53:30,369][123091] Updated weights for policy 0, policy_version 1039635 (0.0009) [2023-12-26 07:53:30,430][123091] Updated weights for policy 0, policy_version 1039645 (0.0008) [2023-12-26 07:53:30,490][123091] Updated weights for policy 0, policy_version 1039655 (0.0007) [2023-12-26 07:53:30,555][123090] Updated weights for policy 1, policy_version 1032258 (0.0009) [2023-12-26 07:53:30,606][123090] Updated weights for policy 1, policy_version 1032268 (0.0007) [2023-12-26 07:53:30,672][123090] Updated weights for policy 1, policy_version 1032278 (0.0008) [2023-12-26 07:53:30,736][123090] Updated weights for policy 1, policy_version 1032288 (0.0007) [2023-12-26 07:53:31,226][123091] Updated weights for policy 0, policy_version 1039665 (0.0006) [2023-12-26 07:53:31,293][123091] Updated weights for policy 0, policy_version 1039675 (0.0007) [2023-12-26 07:53:31,367][123091] Updated weights for policy 0, policy_version 1039685 (0.0009) [2023-12-26 07:53:31,430][123091] Updated weights for policy 0, policy_version 1039695 (0.0007) [2023-12-26 07:53:31,491][123090] Updated weights for policy 1, policy_version 1032298 (0.0010) [2023-12-26 07:53:31,546][123090] Updated weights for policy 1, policy_version 1032309 (0.0011) [2023-12-26 07:53:31,597][123090] Updated weights for policy 1, policy_version 1032319 (0.0009) [2023-12-26 07:53:32,136][123091] Updated weights for policy 0, policy_version 1039705 (0.0009) [2023-12-26 07:53:32,200][123091] Updated weights for policy 0, policy_version 1039715 (0.0009) [2023-12-26 07:53:32,272][123091] Updated weights for policy 0, policy_version 1039725 (0.0010) [2023-12-26 07:53:32,474][123090] Updated weights for policy 1, policy_version 1032329 (0.0010) [2023-12-26 07:53:32,530][123090] Updated weights for policy 1, policy_version 1032339 (0.0010) [2023-12-26 07:53:32,593][123090] Updated weights for policy 1, policy_version 1032349 (0.0010) [2023-12-26 07:53:33,101][123091] Updated weights for policy 0, policy_version 1039735 (0.0009) [2023-12-26 07:53:33,148][123091] Updated weights for policy 0, policy_version 1039745 (0.0008) [2023-12-26 07:53:33,209][123091] Updated weights for policy 0, policy_version 1039755 (0.0010) [2023-12-26 07:53:33,367][123090] Updated weights for policy 1, policy_version 1032359 (0.0007) [2023-12-26 07:53:33,440][123090] Updated weights for policy 1, policy_version 1032369 (0.0005) [2023-12-26 07:53:33,495][123090] Updated weights for policy 1, policy_version 1032379 (0.0005) [2023-12-26 07:53:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 530472960. Throughput: 0: 9056.6, 1: 8894.5. Samples: 530483020. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:33,785][121949] Avg episode reward: [(0, '6076.058'), (1, '5819.065')] [2023-12-26 07:53:34,111][123091] Updated weights for policy 0, policy_version 1039766 (0.0010) [2023-12-26 07:53:34,168][123090] Updated weights for policy 1, policy_version 1032389 (0.0009) [2023-12-26 07:53:34,175][123091] Updated weights for policy 0, policy_version 1039776 (0.0008) [2023-12-26 07:53:34,228][123091] Updated weights for policy 0, policy_version 1039786 (0.0006) [2023-12-26 07:53:34,233][123090] Updated weights for policy 1, policy_version 1032399 (0.0008) [2023-12-26 07:53:34,303][123090] Updated weights for policy 1, policy_version 1032409 (0.0008) [2023-12-26 07:53:34,983][123091] Updated weights for policy 0, policy_version 1039796 (0.0008) [2023-12-26 07:53:35,040][123091] Updated weights for policy 0, policy_version 1039806 (0.0009) [2023-12-26 07:53:35,088][123091] Updated weights for policy 0, policy_version 1039816 (0.0008) [2023-12-26 07:53:35,108][123090] Updated weights for policy 1, policy_version 1032419 (0.0009) [2023-12-26 07:53:35,178][123090] Updated weights for policy 1, policy_version 1032429 (0.0011) [2023-12-26 07:53:35,236][123090] Updated weights for policy 1, policy_version 1032439 (0.0010) [2023-12-26 07:53:35,818][123091] Updated weights for policy 0, policy_version 1039826 (0.0007) [2023-12-26 07:53:35,878][123091] Updated weights for policy 0, policy_version 1039837 (0.0009) [2023-12-26 07:53:35,933][123090] Updated weights for policy 1, policy_version 1032449 (0.0010) [2023-12-26 07:53:35,941][123091] Updated weights for policy 0, policy_version 1039847 (0.0010) [2023-12-26 07:53:35,984][123090] Updated weights for policy 1, policy_version 1032459 (0.0007) [2023-12-26 07:53:36,040][123090] Updated weights for policy 1, policy_version 1032469 (0.0009) [2023-12-26 07:53:36,100][123090] Updated weights for policy 1, policy_version 1032479 (0.0009) [2023-12-26 07:53:36,744][123091] Updated weights for policy 0, policy_version 1039857 (0.0008) [2023-12-26 07:53:36,817][123091] Updated weights for policy 0, policy_version 1039867 (0.0011) [2023-12-26 07:53:36,874][123091] Updated weights for policy 0, policy_version 1039877 (0.0011) [2023-12-26 07:53:36,922][123091] Updated weights for policy 0, policy_version 1039887 (0.0010) [2023-12-26 07:53:36,983][123090] Updated weights for policy 1, policy_version 1032489 (0.0009) [2023-12-26 07:53:37,036][123090] Updated weights for policy 1, policy_version 1032499 (0.0009) [2023-12-26 07:53:37,085][123090] Updated weights for policy 1, policy_version 1032509 (0.0009) [2023-12-26 07:53:37,697][123091] Updated weights for policy 0, policy_version 1039897 (0.0006) [2023-12-26 07:53:37,775][123091] Updated weights for policy 0, policy_version 1039907 (0.0005) [2023-12-26 07:53:37,845][123091] Updated weights for policy 0, policy_version 1039917 (0.0005) [2023-12-26 07:53:37,845][123090] Updated weights for policy 1, policy_version 1032519 (0.0009) [2023-12-26 07:53:37,917][123090] Updated weights for policy 1, policy_version 1032529 (0.0009) [2023-12-26 07:53:37,990][123090] Updated weights for policy 1, policy_version 1032539 (0.0009) [2023-12-26 07:53:38,626][123091] Updated weights for policy 0, policy_version 1039927 (0.0011) [2023-12-26 07:53:38,685][123091] Updated weights for policy 0, policy_version 1039937 (0.0011) [2023-12-26 07:53:38,730][123090] Updated weights for policy 1, policy_version 1032549 (0.0009) [2023-12-26 07:53:38,741][123091] Updated weights for policy 0, policy_version 1039947 (0.0010) [2023-12-26 07:53:38,783][123090] Updated weights for policy 1, policy_version 1032559 (0.0006) [2023-12-26 07:53:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.3, 300 sec: 17939.1). Total num frames: 530563072. Throughput: 0: 9106.3, 1: 8900.1. Samples: 530538120. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:38,785][121949] Avg episode reward: [(0, '6061.936'), (1, '5889.498')] [2023-12-26 07:53:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001039952_266231808.pth... [2023-12-26 07:53:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001038896_265961472.pth [2023-12-26 07:53:38,840][123090] Updated weights for policy 1, policy_version 1032569 (0.0009) [2023-12-26 07:53:38,881][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001032576_264339456.pth... [2023-12-26 07:53:38,884][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001031520_264069120.pth [2023-12-26 07:53:39,571][123091] Updated weights for policy 0, policy_version 1039957 (0.0008) [2023-12-26 07:53:39,620][123091] Updated weights for policy 0, policy_version 1039967 (0.0006) [2023-12-26 07:53:39,681][123091] Updated weights for policy 0, policy_version 1039977 (0.0005) [2023-12-26 07:53:39,689][123090] Updated weights for policy 1, policy_version 1032579 (0.0010) [2023-12-26 07:53:39,749][123090] Updated weights for policy 1, policy_version 1032589 (0.0010) [2023-12-26 07:53:39,805][123090] Updated weights for policy 1, policy_version 1032599 (0.0011) [2023-12-26 07:53:40,483][123091] Updated weights for policy 0, policy_version 1039987 (0.0007) [2023-12-26 07:53:40,533][123091] Updated weights for policy 0, policy_version 1039997 (0.0009) [2023-12-26 07:53:40,582][123091] Updated weights for policy 0, policy_version 1040007 (0.0008) [2023-12-26 07:53:40,656][123090] Updated weights for policy 1, policy_version 1032609 (0.0011) [2023-12-26 07:53:40,712][123090] Updated weights for policy 1, policy_version 1032619 (0.0011) [2023-12-26 07:53:40,763][123090] Updated weights for policy 1, policy_version 1032629 (0.0010) [2023-12-26 07:53:40,830][123090] Updated weights for policy 1, policy_version 1032639 (0.0011) [2023-12-26 07:53:41,426][123091] Updated weights for policy 0, policy_version 1040017 (0.0009) [2023-12-26 07:53:41,486][123091] Updated weights for policy 0, policy_version 1040027 (0.0010) [2023-12-26 07:53:41,549][123091] Updated weights for policy 0, policy_version 1040037 (0.0011) [2023-12-26 07:53:41,613][123091] Updated weights for policy 0, policy_version 1040047 (0.0010) [2023-12-26 07:53:41,657][123090] Updated weights for policy 1, policy_version 1032649 (0.0009) [2023-12-26 07:53:41,721][123090] Updated weights for policy 1, policy_version 1032659 (0.0009) [2023-12-26 07:53:41,783][123090] Updated weights for policy 1, policy_version 1032669 (0.0008) [2023-12-26 07:53:42,470][123091] Updated weights for policy 0, policy_version 1040057 (0.0011) [2023-12-26 07:53:42,526][123091] Updated weights for policy 0, policy_version 1040067 (0.0011) [2023-12-26 07:53:42,589][123091] Updated weights for policy 0, policy_version 1040077 (0.0011) [2023-12-26 07:53:42,647][123090] Updated weights for policy 1, policy_version 1032679 (0.0009) [2023-12-26 07:53:42,715][123090] Updated weights for policy 1, policy_version 1032689 (0.0008) [2023-12-26 07:53:42,785][123090] Updated weights for policy 1, policy_version 1032699 (0.0009) [2023-12-26 07:53:43,379][123091] Updated weights for policy 0, policy_version 1040087 (0.0007) [2023-12-26 07:53:43,426][123091] Updated weights for policy 0, policy_version 1040097 (0.0005) [2023-12-26 07:53:43,475][123091] Updated weights for policy 0, policy_version 1040107 (0.0005) [2023-12-26 07:53:43,623][123090] Updated weights for policy 1, policy_version 1032709 (0.0009) [2023-12-26 07:53:43,676][123090] Updated weights for policy 1, policy_version 1032719 (0.0007) [2023-12-26 07:53:43,745][123090] Updated weights for policy 1, policy_version 1032729 (0.0005) [2023-12-26 07:53:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 530644992. Throughput: 0: 8965.2, 1: 8802.0. Samples: 530642432. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:43,785][121949] Avg episode reward: [(0, '6064.507'), (1, '5949.176')] [2023-12-26 07:53:44,100][123091] Updated weights for policy 0, policy_version 1040117 (0.0006) [2023-12-26 07:53:44,157][123091] Updated weights for policy 0, policy_version 1040127 (0.0006) [2023-12-26 07:53:44,215][123091] Updated weights for policy 0, policy_version 1040137 (0.0006) [2023-12-26 07:53:44,519][123090] Updated weights for policy 1, policy_version 1032739 (0.0007) [2023-12-26 07:53:44,601][123090] Updated weights for policy 1, policy_version 1032749 (0.0010) [2023-12-26 07:53:44,672][123090] Updated weights for policy 1, policy_version 1032759 (0.0010) [2023-12-26 07:53:44,931][123091] Updated weights for policy 0, policy_version 1040147 (0.0007) [2023-12-26 07:53:44,996][123091] Updated weights for policy 0, policy_version 1040157 (0.0009) [2023-12-26 07:53:45,052][123091] Updated weights for policy 0, policy_version 1040167 (0.0009) [2023-12-26 07:53:45,510][123090] Updated weights for policy 1, policy_version 1032769 (0.0009) [2023-12-26 07:53:45,578][123090] Updated weights for policy 1, policy_version 1032779 (0.0010) [2023-12-26 07:53:45,640][123090] Updated weights for policy 1, policy_version 1032789 (0.0010) [2023-12-26 07:53:45,703][123090] Updated weights for policy 1, policy_version 1032799 (0.0009) [2023-12-26 07:53:45,845][123091] Updated weights for policy 0, policy_version 1040177 (0.0009) [2023-12-26 07:53:45,916][123091] Updated weights for policy 0, policy_version 1040187 (0.0010) [2023-12-26 07:53:45,985][123091] Updated weights for policy 0, policy_version 1040197 (0.0009) [2023-12-26 07:53:46,053][123091] Updated weights for policy 0, policy_version 1040207 (0.0009) [2023-12-26 07:53:46,533][123090] Updated weights for policy 1, policy_version 1032809 (0.0010) [2023-12-26 07:53:46,590][123090] Updated weights for policy 1, policy_version 1032819 (0.0009) [2023-12-26 07:53:46,647][123090] Updated weights for policy 1, policy_version 1032829 (0.0009) [2023-12-26 07:53:46,813][123091] Updated weights for policy 0, policy_version 1040218 (0.0010) [2023-12-26 07:53:46,863][123091] Updated weights for policy 0, policy_version 1040228 (0.0009) [2023-12-26 07:53:46,916][123091] Updated weights for policy 0, policy_version 1040238 (0.0009) [2023-12-26 07:53:47,431][123090] Updated weights for policy 1, policy_version 1032839 (0.0007) [2023-12-26 07:53:47,486][123090] Updated weights for policy 1, policy_version 1032849 (0.0006) [2023-12-26 07:53:47,533][123090] Updated weights for policy 1, policy_version 1032859 (0.0009) [2023-12-26 07:53:47,776][123091] Updated weights for policy 0, policy_version 1040248 (0.0009) [2023-12-26 07:53:47,823][123091] Updated weights for policy 0, policy_version 1040258 (0.0009) [2023-12-26 07:53:47,873][123091] Updated weights for policy 0, policy_version 1040268 (0.0010) [2023-12-26 07:53:48,331][123090] Updated weights for policy 1, policy_version 1032869 (0.0008) [2023-12-26 07:53:48,394][123090] Updated weights for policy 1, policy_version 1032879 (0.0009) [2023-12-26 07:53:48,462][123090] Updated weights for policy 1, policy_version 1032889 (0.0010) [2023-12-26 07:53:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 530735104. Throughput: 0: 9007.4, 1: 8765.0. Samples: 530747912. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:48,785][121949] Avg episode reward: [(0, '6065.589'), (1, '5800.972')] [2023-12-26 07:53:48,787][123091] Updated weights for policy 0, policy_version 1040278 (0.0009) [2023-12-26 07:53:48,837][123091] Updated weights for policy 0, policy_version 1040288 (0.0009) [2023-12-26 07:53:48,890][123091] Updated weights for policy 0, policy_version 1040298 (0.0009) [2023-12-26 07:53:49,246][123090] Updated weights for policy 1, policy_version 1032899 (0.0009) [2023-12-26 07:53:49,317][123090] Updated weights for policy 1, policy_version 1032909 (0.0007) [2023-12-26 07:53:49,391][123090] Updated weights for policy 1, policy_version 1032919 (0.0008) [2023-12-26 07:53:49,829][123091] Updated weights for policy 0, policy_version 1040308 (0.0009) [2023-12-26 07:53:49,901][123091] Updated weights for policy 0, policy_version 1040318 (0.0010) [2023-12-26 07:53:49,979][123091] Updated weights for policy 0, policy_version 1040328 (0.0009) [2023-12-26 07:53:50,107][123090] Updated weights for policy 1, policy_version 1032929 (0.0008) [2023-12-26 07:53:50,173][123090] Updated weights for policy 1, policy_version 1032939 (0.0008) [2023-12-26 07:53:50,236][123090] Updated weights for policy 1, policy_version 1032949 (0.0009) [2023-12-26 07:53:50,296][123090] Updated weights for policy 1, policy_version 1032959 (0.0009) [2023-12-26 07:53:50,828][123091] Updated weights for policy 0, policy_version 1040338 (0.0009) [2023-12-26 07:53:50,884][123091] Updated weights for policy 0, policy_version 1040348 (0.0009) [2023-12-26 07:53:50,943][123091] Updated weights for policy 0, policy_version 1040358 (0.0010) [2023-12-26 07:53:51,000][123091] Updated weights for policy 0, policy_version 1040368 (0.0010) [2023-12-26 07:53:51,083][123090] Updated weights for policy 1, policy_version 1032969 (0.0008) [2023-12-26 07:53:51,146][123090] Updated weights for policy 1, policy_version 1032979 (0.0008) [2023-12-26 07:53:51,220][123090] Updated weights for policy 1, policy_version 1032989 (0.0006) [2023-12-26 07:53:51,793][123091] Updated weights for policy 0, policy_version 1040378 (0.0007) [2023-12-26 07:53:51,854][123091] Updated weights for policy 0, policy_version 1040388 (0.0005) [2023-12-26 07:53:51,911][123091] Updated weights for policy 0, policy_version 1040398 (0.0007) [2023-12-26 07:53:51,994][123090] Updated weights for policy 1, policy_version 1032999 (0.0007) [2023-12-26 07:53:52,052][123090] Updated weights for policy 1, policy_version 1033009 (0.0005) [2023-12-26 07:53:52,115][123090] Updated weights for policy 1, policy_version 1033019 (0.0006) [2023-12-26 07:53:52,687][123091] Updated weights for policy 0, policy_version 1040408 (0.0005) [2023-12-26 07:53:52,751][123091] Updated weights for policy 0, policy_version 1040418 (0.0006) [2023-12-26 07:53:52,813][123091] Updated weights for policy 0, policy_version 1040428 (0.0007) [2023-12-26 07:53:52,818][123090] Updated weights for policy 1, policy_version 1033029 (0.0007) [2023-12-26 07:53:52,881][123090] Updated weights for policy 1, policy_version 1033039 (0.0006) [2023-12-26 07:53:52,929][123090] Updated weights for policy 1, policy_version 1033049 (0.0007) [2023-12-26 07:53:53,575][123091] Updated weights for policy 0, policy_version 1040438 (0.0008) [2023-12-26 07:53:53,603][123090] Updated weights for policy 1, policy_version 1033059 (0.0008) [2023-12-26 07:53:53,637][123091] Updated weights for policy 0, policy_version 1040448 (0.0010) [2023-12-26 07:53:53,650][123090] Updated weights for policy 1, policy_version 1033069 (0.0005) [2023-12-26 07:53:53,696][123090] Updated weights for policy 1, policy_version 1033079 (0.0005) [2023-12-26 07:53:53,711][123091] Updated weights for policy 0, policy_version 1040458 (0.0010) [2023-12-26 07:53:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 530833408. Throughput: 0: 8886.7, 1: 8852.6. Samples: 530800024. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:53,785][121949] Avg episode reward: [(0, '6114.547'), (1, '5669.934')] [2023-12-26 07:53:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001033088_264470528.pth... [2023-12-26 07:53:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001040464_266362880.pth... [2023-12-26 07:53:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001032032_264200192.pth [2023-12-26 07:53:53,796][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001033088_264470528.pth [2023-12-26 07:53:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001039408_266092544.pth [2023-12-26 07:53:53,803][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001040464_266362880.pth [2023-12-26 07:53:54,369][123090] Updated weights for policy 1, policy_version 1033089 (0.0005) [2023-12-26 07:53:54,443][123090] Updated weights for policy 1, policy_version 1033099 (0.0005) [2023-12-26 07:53:54,496][123091] Updated weights for policy 0, policy_version 1040468 (0.0009) [2023-12-26 07:53:54,498][123090] Updated weights for policy 1, policy_version 1033109 (0.0005) [2023-12-26 07:53:54,547][123090] Updated weights for policy 1, policy_version 1033119 (0.0006) [2023-12-26 07:53:54,555][123091] Updated weights for policy 0, policy_version 1040478 (0.0010) [2023-12-26 07:53:54,608][123091] Updated weights for policy 0, policy_version 1040488 (0.0010) [2023-12-26 07:53:55,297][123090] Updated weights for policy 1, policy_version 1033129 (0.0008) [2023-12-26 07:53:55,358][123090] Updated weights for policy 1, policy_version 1033139 (0.0009) [2023-12-26 07:53:55,408][123090] Updated weights for policy 1, policy_version 1033149 (0.0009) [2023-12-26 07:53:55,428][123091] Updated weights for policy 0, policy_version 1040498 (0.0010) [2023-12-26 07:53:55,483][123091] Updated weights for policy 0, policy_version 1040508 (0.0005) [2023-12-26 07:53:55,539][123091] Updated weights for policy 0, policy_version 1040518 (0.0005) [2023-12-26 07:53:55,594][123091] Updated weights for policy 0, policy_version 1040528 (0.0006) [2023-12-26 07:53:56,233][123090] Updated weights for policy 1, policy_version 1033159 (0.0006) [2023-12-26 07:53:56,282][123090] Updated weights for policy 1, policy_version 1033169 (0.0005) [2023-12-26 07:53:56,318][123091] Updated weights for policy 0, policy_version 1040538 (0.0008) [2023-12-26 07:53:56,338][123090] Updated weights for policy 1, policy_version 1033179 (0.0009) [2023-12-26 07:53:56,379][123091] Updated weights for policy 0, policy_version 1040548 (0.0008) [2023-12-26 07:53:56,432][123091] Updated weights for policy 0, policy_version 1040558 (0.0009) [2023-12-26 07:53:57,074][123090] Updated weights for policy 1, policy_version 1033189 (0.0008) [2023-12-26 07:53:57,129][123091] Updated weights for policy 0, policy_version 1040568 (0.0009) [2023-12-26 07:53:57,136][123090] Updated weights for policy 1, policy_version 1033199 (0.0007) [2023-12-26 07:53:57,179][123091] Updated weights for policy 0, policy_version 1040578 (0.0009) [2023-12-26 07:53:57,187][123090] Updated weights for policy 1, policy_version 1033209 (0.0005) [2023-12-26 07:53:57,236][123091] Updated weights for policy 0, policy_version 1040588 (0.0009) [2023-12-26 07:53:57,854][123090] Updated weights for policy 1, policy_version 1033219 (0.0005) [2023-12-26 07:53:57,910][123090] Updated weights for policy 1, policy_version 1033229 (0.0005) [2023-12-26 07:53:57,967][123090] Updated weights for policy 1, policy_version 1033239 (0.0006) [2023-12-26 07:53:58,141][123091] Updated weights for policy 0, policy_version 1040598 (0.0007) [2023-12-26 07:53:58,205][123091] Updated weights for policy 0, policy_version 1040608 (0.0007) [2023-12-26 07:53:58,277][123091] Updated weights for policy 0, policy_version 1040618 (0.0007) [2023-12-26 07:53:58,747][123090] Updated weights for policy 1, policy_version 1033249 (0.0007) [2023-12-26 07:53:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 17885.3, 300 sec: 17911.2). Total num frames: 530915328. Throughput: 0: 8882.3, 1: 8961.9. Samples: 530911224. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:53:58,787][121949] Avg episode reward: [(0, '5941.330'), (1, '5732.627')] [2023-12-26 07:53:58,815][123090] Updated weights for policy 1, policy_version 1033259 (0.0007) [2023-12-26 07:53:58,884][123090] Updated weights for policy 1, policy_version 1033269 (0.0007) [2023-12-26 07:53:58,960][123090] Updated weights for policy 1, policy_version 1033279 (0.0008) [2023-12-26 07:53:59,125][123091] Updated weights for policy 0, policy_version 1040628 (0.0006) [2023-12-26 07:53:59,190][123091] Updated weights for policy 0, policy_version 1040638 (0.0006) [2023-12-26 07:53:59,261][123091] Updated weights for policy 0, policy_version 1040648 (0.0008) [2023-12-26 07:53:59,818][123090] Updated weights for policy 1, policy_version 1033289 (0.0009) [2023-12-26 07:53:59,879][123090] Updated weights for policy 1, policy_version 1033299 (0.0009) [2023-12-26 07:53:59,953][123090] Updated weights for policy 1, policy_version 1033309 (0.0009) [2023-12-26 07:54:00,082][123091] Updated weights for policy 0, policy_version 1040658 (0.0010) [2023-12-26 07:54:00,144][123091] Updated weights for policy 0, policy_version 1040668 (0.0010) [2023-12-26 07:54:00,210][123091] Updated weights for policy 0, policy_version 1040678 (0.0010) [2023-12-26 07:54:00,271][123091] Updated weights for policy 0, policy_version 1040688 (0.0010) [2023-12-26 07:54:00,721][123090] Updated weights for policy 1, policy_version 1033319 (0.0011) [2023-12-26 07:54:00,776][123090] Updated weights for policy 1, policy_version 1033329 (0.0008) [2023-12-26 07:54:00,838][123090] Updated weights for policy 1, policy_version 1033339 (0.0009) [2023-12-26 07:54:01,110][123091] Updated weights for policy 0, policy_version 1040698 (0.0008) [2023-12-26 07:54:01,183][123091] Updated weights for policy 0, policy_version 1040708 (0.0007) [2023-12-26 07:54:01,249][123091] Updated weights for policy 0, policy_version 1040718 (0.0008) [2023-12-26 07:54:01,751][123090] Updated weights for policy 1, policy_version 1033349 (0.0009) [2023-12-26 07:54:01,823][123090] Updated weights for policy 1, policy_version 1033359 (0.0008) [2023-12-26 07:54:01,884][123090] Updated weights for policy 1, policy_version 1033369 (0.0009) [2023-12-26 07:54:01,968][123091] Updated weights for policy 0, policy_version 1040728 (0.0009) [2023-12-26 07:54:02,038][123091] Updated weights for policy 0, policy_version 1040739 (0.0010) [2023-12-26 07:54:02,093][123091] Updated weights for policy 0, policy_version 1040749 (0.0009) [2023-12-26 07:54:02,644][123090] Updated weights for policy 1, policy_version 1033379 (0.0009) [2023-12-26 07:54:02,696][123090] Updated weights for policy 1, policy_version 1033389 (0.0005) [2023-12-26 07:54:02,752][123090] Updated weights for policy 1, policy_version 1033399 (0.0006) [2023-12-26 07:54:02,951][123091] Updated weights for policy 0, policy_version 1040759 (0.0007) [2023-12-26 07:54:03,014][123091] Updated weights for policy 0, policy_version 1040769 (0.0006) [2023-12-26 07:54:03,087][123091] Updated weights for policy 0, policy_version 1040779 (0.0006) [2023-12-26 07:54:03,595][123090] Updated weights for policy 1, policy_version 1033409 (0.0008) [2023-12-26 07:54:03,646][123090] Updated weights for policy 1, policy_version 1033419 (0.0009) [2023-12-26 07:54:03,699][123090] Updated weights for policy 1, policy_version 1033429 (0.0009) [2023-12-26 07:54:03,760][123090] Updated weights for policy 1, policy_version 1033439 (0.0009) [2023-12-26 07:54:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 531005440. Throughput: 0: 8771.0, 1: 8876.5. Samples: 531014420. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:03,785][121949] Avg episode reward: [(0, '6038.181'), (1, '5563.846')] [2023-12-26 07:54:03,810][123091] Updated weights for policy 0, policy_version 1040789 (0.0008) [2023-12-26 07:54:03,868][123091] Updated weights for policy 0, policy_version 1040799 (0.0009) [2023-12-26 07:54:03,930][123091] Updated weights for policy 0, policy_version 1040809 (0.0008) [2023-12-26 07:54:04,557][123090] Updated weights for policy 1, policy_version 1033449 (0.0006) [2023-12-26 07:54:04,625][123090] Updated weights for policy 1, policy_version 1033459 (0.0005) [2023-12-26 07:54:04,689][123090] Updated weights for policy 1, policy_version 1033469 (0.0005) [2023-12-26 07:54:04,761][123091] Updated weights for policy 0, policy_version 1040819 (0.0007) [2023-12-26 07:54:04,816][123091] Updated weights for policy 0, policy_version 1040829 (0.0011) [2023-12-26 07:54:04,868][123091] Updated weights for policy 0, policy_version 1040839 (0.0010) [2023-12-26 07:54:05,436][123090] Updated weights for policy 1, policy_version 1033479 (0.0005) [2023-12-26 07:54:05,491][123090] Updated weights for policy 1, policy_version 1033489 (0.0005) [2023-12-26 07:54:05,546][123090] Updated weights for policy 1, policy_version 1033499 (0.0005) [2023-12-26 07:54:05,732][123091] Updated weights for policy 0, policy_version 1040849 (0.0009) [2023-12-26 07:54:05,790][123091] Updated weights for policy 0, policy_version 1040859 (0.0010) [2023-12-26 07:54:05,853][123091] Updated weights for policy 0, policy_version 1040869 (0.0009) [2023-12-26 07:54:05,909][123091] Updated weights for policy 0, policy_version 1040879 (0.0010) [2023-12-26 07:54:06,164][123090] Updated weights for policy 1, policy_version 1033509 (0.0006) [2023-12-26 07:54:06,232][123090] Updated weights for policy 1, policy_version 1033519 (0.0006) [2023-12-26 07:54:06,306][123090] Updated weights for policy 1, policy_version 1033529 (0.0010) [2023-12-26 07:54:06,860][123091] Updated weights for policy 0, policy_version 1040889 (0.0009) [2023-12-26 07:54:06,929][123091] Updated weights for policy 0, policy_version 1040899 (0.0009) [2023-12-26 07:54:06,990][123091] Updated weights for policy 0, policy_version 1040909 (0.0009) [2023-12-26 07:54:07,093][123090] Updated weights for policy 1, policy_version 1033539 (0.0010) [2023-12-26 07:54:07,169][123090] Updated weights for policy 1, policy_version 1033549 (0.0009) [2023-12-26 07:54:07,238][123090] Updated weights for policy 1, policy_version 1033559 (0.0010) [2023-12-26 07:54:07,831][123091] Updated weights for policy 0, policy_version 1040919 (0.0010) [2023-12-26 07:54:07,895][123091] Updated weights for policy 0, policy_version 1040930 (0.0011) [2023-12-26 07:54:07,948][123091] Updated weights for policy 0, policy_version 1040940 (0.0010) [2023-12-26 07:54:08,056][123090] Updated weights for policy 1, policy_version 1033569 (0.0009) [2023-12-26 07:54:08,116][123090] Updated weights for policy 1, policy_version 1033579 (0.0006) [2023-12-26 07:54:08,180][123090] Updated weights for policy 1, policy_version 1033589 (0.0005) [2023-12-26 07:54:08,255][123090] Updated weights for policy 1, policy_version 1033599 (0.0005) [2023-12-26 07:54:08,772][123091] Updated weights for policy 0, policy_version 1040950 (0.0007) [2023-12-26 07:54:08,784][121949] Fps is (10 sec: 17206.2, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 531087360. Throughput: 0: 8756.0, 1: 8904.6. Samples: 531067512. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:08,785][121949] Avg episode reward: [(0, '6265.286'), (1, '5679.228')] [2023-12-26 07:54:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001033600_264601600.pth... [2023-12-26 07:54:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001032576_264339456.pth [2023-12-26 07:54:08,829][123091] Updated weights for policy 0, policy_version 1040960 (0.0006) [2023-12-26 07:54:08,901][123091] Updated weights for policy 0, policy_version 1040970 (0.0011) [2023-12-26 07:54:08,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001040976_266493952.pth... [2023-12-26 07:54:08,940][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001039952_266231808.pth [2023-12-26 07:54:09,018][123090] Updated weights for policy 1, policy_version 1033609 (0.0009) [2023-12-26 07:54:09,070][123090] Updated weights for policy 1, policy_version 1033619 (0.0008) [2023-12-26 07:54:09,130][123090] Updated weights for policy 1, policy_version 1033629 (0.0009) [2023-12-26 07:54:09,696][123091] Updated weights for policy 0, policy_version 1040980 (0.0011) [2023-12-26 07:54:09,762][123091] Updated weights for policy 0, policy_version 1040990 (0.0009) [2023-12-26 07:54:09,828][123091] Updated weights for policy 0, policy_version 1041000 (0.0010) [2023-12-26 07:54:09,985][123090] Updated weights for policy 1, policy_version 1033639 (0.0009) [2023-12-26 07:54:10,051][123090] Updated weights for policy 1, policy_version 1033649 (0.0009) [2023-12-26 07:54:10,119][123090] Updated weights for policy 1, policy_version 1033659 (0.0009) [2023-12-26 07:54:10,594][123091] Updated weights for policy 0, policy_version 1041010 (0.0009) [2023-12-26 07:54:10,655][123091] Updated weights for policy 0, policy_version 1041020 (0.0009) [2023-12-26 07:54:10,724][123091] Updated weights for policy 0, policy_version 1041030 (0.0006) [2023-12-26 07:54:10,785][123091] Updated weights for policy 0, policy_version 1041040 (0.0005) [2023-12-26 07:54:10,978][123090] Updated weights for policy 1, policy_version 1033669 (0.0010) [2023-12-26 07:54:11,038][123090] Updated weights for policy 1, policy_version 1033679 (0.0010) [2023-12-26 07:54:11,106][123090] Updated weights for policy 1, policy_version 1033689 (0.0011) [2023-12-26 07:54:11,558][123091] Updated weights for policy 0, policy_version 1041050 (0.0011) [2023-12-26 07:54:11,627][123091] Updated weights for policy 0, policy_version 1041060 (0.0010) [2023-12-26 07:54:11,705][123091] Updated weights for policy 0, policy_version 1041070 (0.0008) [2023-12-26 07:54:11,943][123090] Updated weights for policy 1, policy_version 1033699 (0.0009) [2023-12-26 07:54:11,996][123090] Updated weights for policy 1, policy_version 1033709 (0.0005) [2023-12-26 07:54:12,055][123090] Updated weights for policy 1, policy_version 1033719 (0.0005) [2023-12-26 07:54:12,491][123091] Updated weights for policy 0, policy_version 1041080 (0.0011) [2023-12-26 07:54:12,565][123091] Updated weights for policy 0, policy_version 1041090 (0.0011) [2023-12-26 07:54:12,639][123091] Updated weights for policy 0, policy_version 1041100 (0.0008) [2023-12-26 07:54:12,783][123090] Updated weights for policy 1, policy_version 1033729 (0.0006) [2023-12-26 07:54:12,831][123090] Updated weights for policy 1, policy_version 1033739 (0.0007) [2023-12-26 07:54:12,881][123090] Updated weights for policy 1, policy_version 1033749 (0.0005) [2023-12-26 07:54:12,934][123090] Updated weights for policy 1, policy_version 1033759 (0.0005) [2023-12-26 07:54:13,394][123091] Updated weights for policy 0, policy_version 1041110 (0.0009) [2023-12-26 07:54:13,441][123091] Updated weights for policy 0, policy_version 1041120 (0.0010) [2023-12-26 07:54:13,492][123091] Updated weights for policy 0, policy_version 1041130 (0.0010) [2023-12-26 07:54:13,765][123090] Updated weights for policy 1, policy_version 1033769 (0.0009) [2023-12-26 07:54:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 531177472. Throughput: 0: 8748.8, 1: 8879.9. Samples: 531171712. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:13,784][121949] Avg episode reward: [(0, '6224.453'), (1, '5725.891')] [2023-12-26 07:54:13,818][123090] Updated weights for policy 1, policy_version 1033779 (0.0010) [2023-12-26 07:54:13,880][123090] Updated weights for policy 1, policy_version 1033789 (0.0009) [2023-12-26 07:54:14,179][123091] Updated weights for policy 0, policy_version 1041140 (0.0008) [2023-12-26 07:54:14,226][123091] Updated weights for policy 0, policy_version 1041150 (0.0006) [2023-12-26 07:54:14,279][123091] Updated weights for policy 0, policy_version 1041160 (0.0005) [2023-12-26 07:54:14,673][123090] Updated weights for policy 1, policy_version 1033799 (0.0007) [2023-12-26 07:54:14,729][123090] Updated weights for policy 1, policy_version 1033809 (0.0005) [2023-12-26 07:54:14,803][123090] Updated weights for policy 1, policy_version 1033819 (0.0009) [2023-12-26 07:54:15,101][123091] Updated weights for policy 0, policy_version 1041170 (0.0006) [2023-12-26 07:54:15,161][123091] Updated weights for policy 0, policy_version 1041180 (0.0010) [2023-12-26 07:54:15,227][123091] Updated weights for policy 0, policy_version 1041190 (0.0010) [2023-12-26 07:54:15,278][123091] Updated weights for policy 0, policy_version 1041200 (0.0010) [2023-12-26 07:54:15,605][123090] Updated weights for policy 1, policy_version 1033829 (0.0009) [2023-12-26 07:54:15,662][123090] Updated weights for policy 1, policy_version 1033839 (0.0009) [2023-12-26 07:54:15,724][123090] Updated weights for policy 1, policy_version 1033849 (0.0009) [2023-12-26 07:54:16,104][123091] Updated weights for policy 0, policy_version 1041210 (0.0005) [2023-12-26 07:54:16,164][123091] Updated weights for policy 0, policy_version 1041220 (0.0007) [2023-12-26 07:54:16,224][123091] Updated weights for policy 0, policy_version 1041230 (0.0010) [2023-12-26 07:54:16,573][123090] Updated weights for policy 1, policy_version 1033859 (0.0010) [2023-12-26 07:54:16,620][123090] Updated weights for policy 1, policy_version 1033869 (0.0008) [2023-12-26 07:54:16,666][123090] Updated weights for policy 1, policy_version 1033879 (0.0005) [2023-12-26 07:54:16,993][123091] Updated weights for policy 0, policy_version 1041240 (0.0006) [2023-12-26 07:54:17,053][123091] Updated weights for policy 0, policy_version 1041250 (0.0005) [2023-12-26 07:54:17,104][123091] Updated weights for policy 0, policy_version 1041260 (0.0005) [2023-12-26 07:54:17,377][123090] Updated weights for policy 1, policy_version 1033889 (0.0006) [2023-12-26 07:54:17,440][123090] Updated weights for policy 1, policy_version 1033899 (0.0010) [2023-12-26 07:54:17,500][123090] Updated weights for policy 1, policy_version 1033909 (0.0009) [2023-12-26 07:54:17,559][123090] Updated weights for policy 1, policy_version 1033919 (0.0009) [2023-12-26 07:54:17,836][123091] Updated weights for policy 0, policy_version 1041270 (0.0006) [2023-12-26 07:54:17,894][123091] Updated weights for policy 0, policy_version 1041280 (0.0005) [2023-12-26 07:54:17,939][123091] Updated weights for policy 0, policy_version 1041290 (0.0005) [2023-12-26 07:54:18,423][123090] Updated weights for policy 1, policy_version 1033929 (0.0010) [2023-12-26 07:54:18,490][123090] Updated weights for policy 1, policy_version 1033939 (0.0010) [2023-12-26 07:54:18,561][123090] Updated weights for policy 1, policy_version 1033949 (0.0010) [2023-12-26 07:54:18,629][123091] Updated weights for policy 0, policy_version 1041300 (0.0007) [2023-12-26 07:54:18,689][123091] Updated weights for policy 0, policy_version 1041310 (0.0008) [2023-12-26 07:54:18,741][123091] Updated weights for policy 0, policy_version 1041320 (0.0009) [2023-12-26 07:54:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 531275776. Throughput: 0: 8825.9, 1: 8897.8. Samples: 531280584. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:18,785][121949] Avg episode reward: [(0, '6163.377'), (1, '5539.529')] [2023-12-26 07:54:19,386][123090] Updated weights for policy 1, policy_version 1033959 (0.0011) [2023-12-26 07:54:19,442][123090] Updated weights for policy 1, policy_version 1033969 (0.0010) [2023-12-26 07:54:19,492][123091] Updated weights for policy 0, policy_version 1041332 (0.0009) [2023-12-26 07:54:19,513][123090] Updated weights for policy 1, policy_version 1033979 (0.0009) [2023-12-26 07:54:19,556][123091] Updated weights for policy 0, policy_version 1041342 (0.0008) [2023-12-26 07:54:19,619][123091] Updated weights for policy 0, policy_version 1041352 (0.0007) [2023-12-26 07:54:20,335][123090] Updated weights for policy 1, policy_version 1033989 (0.0010) [2023-12-26 07:54:20,388][123091] Updated weights for policy 0, policy_version 1041362 (0.0005) [2023-12-26 07:54:20,398][123090] Updated weights for policy 1, policy_version 1033999 (0.0011) [2023-12-26 07:54:20,445][123091] Updated weights for policy 0, policy_version 1041372 (0.0006) [2023-12-26 07:54:20,447][123090] Updated weights for policy 1, policy_version 1034009 (0.0010) [2023-12-26 07:54:20,498][123091] Updated weights for policy 0, policy_version 1041382 (0.0010) [2023-12-26 07:54:20,558][123091] Updated weights for policy 0, policy_version 1041392 (0.0009) [2023-12-26 07:54:21,308][123090] Updated weights for policy 1, policy_version 1034019 (0.0011) [2023-12-26 07:54:21,390][123090] Updated weights for policy 1, policy_version 1034029 (0.0010) [2023-12-26 07:54:21,449][123091] Updated weights for policy 0, policy_version 1041402 (0.0008) [2023-12-26 07:54:21,460][123090] Updated weights for policy 1, policy_version 1034039 (0.0011) [2023-12-26 07:54:21,498][123091] Updated weights for policy 0, policy_version 1041412 (0.0006) [2023-12-26 07:54:21,558][123091] Updated weights for policy 0, policy_version 1041422 (0.0008) [2023-12-26 07:54:22,278][123090] Updated weights for policy 1, policy_version 1034049 (0.0010) [2023-12-26 07:54:22,344][123090] Updated weights for policy 1, policy_version 1034059 (0.0008) [2023-12-26 07:54:22,397][123090] Updated weights for policy 1, policy_version 1034069 (0.0008) [2023-12-26 07:54:22,423][123091] Updated weights for policy 0, policy_version 1041432 (0.0010) [2023-12-26 07:54:22,451][123090] Updated weights for policy 1, policy_version 1034079 (0.0009) [2023-12-26 07:54:22,483][123091] Updated weights for policy 0, policy_version 1041442 (0.0011) [2023-12-26 07:54:22,553][123091] Updated weights for policy 0, policy_version 1041452 (0.0008) [2023-12-26 07:54:23,197][123090] Updated weights for policy 1, policy_version 1034089 (0.0010) [2023-12-26 07:54:23,249][123090] Updated weights for policy 1, policy_version 1034099 (0.0010) [2023-12-26 07:54:23,289][123091] Updated weights for policy 0, policy_version 1041462 (0.0005) [2023-12-26 07:54:23,305][123090] Updated weights for policy 1, policy_version 1034109 (0.0010) [2023-12-26 07:54:23,356][123091] Updated weights for policy 0, policy_version 1041472 (0.0005) [2023-12-26 07:54:23,422][123091] Updated weights for policy 0, policy_version 1041482 (0.0005) [2023-12-26 07:54:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 531357696. Throughput: 0: 8793.0, 1: 8836.9. Samples: 531331468. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:23,785][121949] Avg episode reward: [(0, '6199.223'), (1, '5524.562')] [2023-12-26 07:54:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001034112_264732672.pth... [2023-12-26 07:54:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001041488_266625024.pth... [2023-12-26 07:54:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001040464_266362880.pth [2023-12-26 07:54:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001033088_264470528.pth [2023-12-26 07:54:24,117][123090] Updated weights for policy 1, policy_version 1034119 (0.0009) [2023-12-26 07:54:24,177][123090] Updated weights for policy 1, policy_version 1034129 (0.0009) [2023-12-26 07:54:24,225][123091] Updated weights for policy 0, policy_version 1041492 (0.0007) [2023-12-26 07:54:24,244][123090] Updated weights for policy 1, policy_version 1034139 (0.0009) [2023-12-26 07:54:24,284][123091] Updated weights for policy 0, policy_version 1041502 (0.0009) [2023-12-26 07:54:24,335][123091] Updated weights for policy 0, policy_version 1041512 (0.0009) [2023-12-26 07:54:25,036][123090] Updated weights for policy 1, policy_version 1034149 (0.0008) [2023-12-26 07:54:25,083][123090] Updated weights for policy 1, policy_version 1034159 (0.0009) [2023-12-26 07:54:25,115][123091] Updated weights for policy 0, policy_version 1041522 (0.0008) [2023-12-26 07:54:25,143][123090] Updated weights for policy 1, policy_version 1034169 (0.0008) [2023-12-26 07:54:25,168][123091] Updated weights for policy 0, policy_version 1041532 (0.0009) [2023-12-26 07:54:25,215][123091] Updated weights for policy 0, policy_version 1041542 (0.0008) [2023-12-26 07:54:25,264][123091] Updated weights for policy 0, policy_version 1041552 (0.0009) [2023-12-26 07:54:25,879][123090] Updated weights for policy 1, policy_version 1034179 (0.0009) [2023-12-26 07:54:25,929][123090] Updated weights for policy 1, policy_version 1034189 (0.0009) [2023-12-26 07:54:25,987][123090] Updated weights for policy 1, policy_version 1034199 (0.0008) [2023-12-26 07:54:26,021][123091] Updated weights for policy 0, policy_version 1041562 (0.0009) [2023-12-26 07:54:26,071][123091] Updated weights for policy 0, policy_version 1041572 (0.0008) [2023-12-26 07:54:26,123][123091] Updated weights for policy 0, policy_version 1041582 (0.0005) [2023-12-26 07:54:26,791][123090] Updated weights for policy 1, policy_version 1034209 (0.0007) [2023-12-26 07:54:26,850][123090] Updated weights for policy 1, policy_version 1034219 (0.0009) [2023-12-26 07:54:26,905][123090] Updated weights for policy 1, policy_version 1034229 (0.0009) [2023-12-26 07:54:26,955][123091] Updated weights for policy 0, policy_version 1041592 (0.0007) [2023-12-26 07:54:26,965][123090] Updated weights for policy 1, policy_version 1034239 (0.0009) [2023-12-26 07:54:27,026][123091] Updated weights for policy 0, policy_version 1041602 (0.0005) [2023-12-26 07:54:27,077][123091] Updated weights for policy 0, policy_version 1041612 (0.0006) [2023-12-26 07:54:27,797][123091] Updated weights for policy 0, policy_version 1041622 (0.0006) [2023-12-26 07:54:27,864][123091] Updated weights for policy 0, policy_version 1041632 (0.0010) [2023-12-26 07:54:27,868][123090] Updated weights for policy 1, policy_version 1034249 (0.0006) [2023-12-26 07:54:27,918][123090] Updated weights for policy 1, policy_version 1034259 (0.0008) [2023-12-26 07:54:27,930][123091] Updated weights for policy 0, policy_version 1041642 (0.0007) [2023-12-26 07:54:27,979][123090] Updated weights for policy 1, policy_version 1034269 (0.0009) [2023-12-26 07:54:28,719][123091] Updated weights for policy 0, policy_version 1041652 (0.0010) [2023-12-26 07:54:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17883.6). Total num frames: 531439616. Throughput: 0: 8861.9, 1: 8868.5. Samples: 531440300. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:28,785][121949] Avg episode reward: [(0, '6132.453'), (1, '5565.193')] [2023-12-26 07:54:28,785][123091] Updated weights for policy 0, policy_version 1041662 (0.0010) [2023-12-26 07:54:28,844][123091] Updated weights for policy 0, policy_version 1041672 (0.0011) [2023-12-26 07:54:28,847][123090] Updated weights for policy 1, policy_version 1034279 (0.0007) [2023-12-26 07:54:28,905][123090] Updated weights for policy 1, policy_version 1034289 (0.0007) [2023-12-26 07:54:28,956][123090] Updated weights for policy 1, policy_version 1034299 (0.0009) [2023-12-26 07:54:29,628][123091] Updated weights for policy 0, policy_version 1041682 (0.0010) [2023-12-26 07:54:29,684][123091] Updated weights for policy 0, policy_version 1041692 (0.0005) [2023-12-26 07:54:29,735][123091] Updated weights for policy 0, policy_version 1041702 (0.0005) [2023-12-26 07:54:29,792][123091] Updated weights for policy 0, policy_version 1041712 (0.0005) [2023-12-26 07:54:29,864][123090] Updated weights for policy 1, policy_version 1034309 (0.0010) [2023-12-26 07:54:29,935][123090] Updated weights for policy 1, policy_version 1034319 (0.0009) [2023-12-26 07:54:30,002][123090] Updated weights for policy 1, policy_version 1034329 (0.0009) [2023-12-26 07:54:30,528][123091] Updated weights for policy 0, policy_version 1041722 (0.0006) [2023-12-26 07:54:30,586][123091] Updated weights for policy 0, policy_version 1041732 (0.0005) [2023-12-26 07:54:30,648][123091] Updated weights for policy 0, policy_version 1041742 (0.0005) [2023-12-26 07:54:30,869][123090] Updated weights for policy 1, policy_version 1034339 (0.0009) [2023-12-26 07:54:30,931][123090] Updated weights for policy 1, policy_version 1034349 (0.0009) [2023-12-26 07:54:30,996][123090] Updated weights for policy 1, policy_version 1034359 (0.0009) [2023-12-26 07:54:31,220][123091] Updated weights for policy 0, policy_version 1041752 (0.0006) [2023-12-26 07:54:31,296][123091] Updated weights for policy 0, policy_version 1041762 (0.0010) [2023-12-26 07:54:31,359][123091] Updated weights for policy 0, policy_version 1041772 (0.0011) [2023-12-26 07:54:31,845][123090] Updated weights for policy 1, policy_version 1034369 (0.0008) [2023-12-26 07:54:31,910][123090] Updated weights for policy 1, policy_version 1034379 (0.0009) [2023-12-26 07:54:31,970][123090] Updated weights for policy 1, policy_version 1034389 (0.0009) [2023-12-26 07:54:32,034][123090] Updated weights for policy 1, policy_version 1034399 (0.0008) [2023-12-26 07:54:32,200][123091] Updated weights for policy 0, policy_version 1041782 (0.0010) [2023-12-26 07:54:32,251][123091] Updated weights for policy 0, policy_version 1041792 (0.0010) [2023-12-26 07:54:32,314][123091] Updated weights for policy 0, policy_version 1041802 (0.0010) [2023-12-26 07:54:32,797][123090] Updated weights for policy 1, policy_version 1034409 (0.0009) [2023-12-26 07:54:32,858][123090] Updated weights for policy 1, policy_version 1034419 (0.0009) [2023-12-26 07:54:32,910][123090] Updated weights for policy 1, policy_version 1034429 (0.0008) [2023-12-26 07:54:33,127][123091] Updated weights for policy 0, policy_version 1041812 (0.0010) [2023-12-26 07:54:33,177][123091] Updated weights for policy 0, policy_version 1041822 (0.0010) [2023-12-26 07:54:33,228][123091] Updated weights for policy 0, policy_version 1041832 (0.0010) [2023-12-26 07:54:33,778][123090] Updated weights for policy 1, policy_version 1034439 (0.0009) [2023-12-26 07:54:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 531529728. Throughput: 0: 8875.7, 1: 8850.2. Samples: 531545576. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:33,784][121949] Avg episode reward: [(0, '6177.754'), (1, '5529.089')] [2023-12-26 07:54:33,833][123090] Updated weights for policy 1, policy_version 1034449 (0.0009) [2023-12-26 07:54:33,885][123090] Updated weights for policy 1, policy_version 1034459 (0.0009) [2023-12-26 07:54:33,889][123091] Updated weights for policy 0, policy_version 1041842 (0.0009) [2023-12-26 07:54:33,935][123091] Updated weights for policy 0, policy_version 1041852 (0.0005) [2023-12-26 07:54:33,982][123091] Updated weights for policy 0, policy_version 1041862 (0.0005) [2023-12-26 07:54:34,032][123091] Updated weights for policy 0, policy_version 1041872 (0.0005) [2023-12-26 07:54:34,739][123091] Updated weights for policy 0, policy_version 1041882 (0.0006) [2023-12-26 07:54:34,803][123091] Updated weights for policy 0, policy_version 1041892 (0.0006) [2023-12-26 07:54:34,857][123090] Updated weights for policy 1, policy_version 1034469 (0.0009) [2023-12-26 07:54:34,866][123091] Updated weights for policy 0, policy_version 1041902 (0.0007) [2023-12-26 07:54:34,919][123090] Updated weights for policy 1, policy_version 1034479 (0.0010) [2023-12-26 07:54:34,988][123090] Updated weights for policy 1, policy_version 1034489 (0.0009) [2023-12-26 07:54:35,570][123091] Updated weights for policy 0, policy_version 1041912 (0.0007) [2023-12-26 07:54:35,635][123091] Updated weights for policy 0, policy_version 1041922 (0.0008) [2023-12-26 07:54:35,713][123091] Updated weights for policy 0, policy_version 1041932 (0.0008) [2023-12-26 07:54:35,851][123090] Updated weights for policy 1, policy_version 1034499 (0.0009) [2023-12-26 07:54:35,907][123090] Updated weights for policy 1, policy_version 1034509 (0.0010) [2023-12-26 07:54:35,956][123090] Updated weights for policy 1, policy_version 1034520 (0.0009) [2023-12-26 07:54:36,447][123091] Updated weights for policy 0, policy_version 1041942 (0.0007) [2023-12-26 07:54:36,505][123091] Updated weights for policy 0, policy_version 1041952 (0.0006) [2023-12-26 07:54:36,564][123091] Updated weights for policy 0, policy_version 1041962 (0.0009) [2023-12-26 07:54:36,813][123090] Updated weights for policy 1, policy_version 1034530 (0.0009) [2023-12-26 07:54:36,871][123090] Updated weights for policy 1, policy_version 1034540 (0.0011) [2023-12-26 07:54:36,941][123090] Updated weights for policy 1, policy_version 1034550 (0.0010) [2023-12-26 07:54:37,010][123090] Updated weights for policy 1, policy_version 1034560 (0.0008) [2023-12-26 07:54:37,250][123091] Updated weights for policy 0, policy_version 1041972 (0.0008) [2023-12-26 07:54:37,323][123091] Updated weights for policy 0, policy_version 1041982 (0.0009) [2023-12-26 07:54:37,380][123091] Updated weights for policy 0, policy_version 1041992 (0.0009) [2023-12-26 07:54:37,823][123090] Updated weights for policy 1, policy_version 1034570 (0.0011) [2023-12-26 07:54:37,897][123090] Updated weights for policy 1, policy_version 1034580 (0.0006) [2023-12-26 07:54:37,975][123090] Updated weights for policy 1, policy_version 1034590 (0.0006) [2023-12-26 07:54:38,262][123091] Updated weights for policy 0, policy_version 1042003 (0.0008) [2023-12-26 07:54:38,311][123091] Updated weights for policy 0, policy_version 1042013 (0.0005) [2023-12-26 07:54:38,379][123091] Updated weights for policy 0, policy_version 1042023 (0.0007) [2023-12-26 07:54:38,700][123090] Updated weights for policy 1, policy_version 1034600 (0.0005) [2023-12-26 07:54:38,755][123090] Updated weights for policy 1, policy_version 1034610 (0.0005) [2023-12-26 07:54:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 531619840. Throughput: 0: 8993.3, 1: 8766.1. Samples: 531599196. Policy #0 lag: (min: 31.0, avg: 41.9, max: 63.0) [2023-12-26 07:54:38,785][121949] Avg episode reward: [(0, '6205.604'), (1, '5660.342')] [2023-12-26 07:54:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001042032_266764288.pth... [2023-12-26 07:54:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001040976_266493952.pth [2023-12-26 07:54:38,819][123090] Updated weights for policy 1, policy_version 1034620 (0.0009) [2023-12-26 07:54:38,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001034624_264863744.pth... [2023-12-26 07:54:38,853][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001033600_264601600.pth [2023-12-26 07:54:39,115][123091] Updated weights for policy 0, policy_version 1042033 (0.0006) [2023-12-26 07:54:39,170][123091] Updated weights for policy 0, policy_version 1042044 (0.0009) [2023-12-26 07:54:39,226][123091] Updated weights for policy 0, policy_version 1042054 (0.0006) [2023-12-26 07:54:39,283][123091] Updated weights for policy 0, policy_version 1042064 (0.0008) [2023-12-26 07:54:39,568][123090] Updated weights for policy 1, policy_version 1034630 (0.0008) [2023-12-26 07:54:39,630][123090] Updated weights for policy 1, policy_version 1034640 (0.0005) [2023-12-26 07:54:39,700][123090] Updated weights for policy 1, policy_version 1034650 (0.0005) [2023-12-26 07:54:40,124][123091] Updated weights for policy 0, policy_version 1042074 (0.0009) [2023-12-26 07:54:40,186][123091] Updated weights for policy 0, policy_version 1042084 (0.0008) [2023-12-26 07:54:40,235][123091] Updated weights for policy 0, policy_version 1042094 (0.0009) [2023-12-26 07:54:40,468][123090] Updated weights for policy 1, policy_version 1034660 (0.0006) [2023-12-26 07:54:40,525][123090] Updated weights for policy 1, policy_version 1034670 (0.0005) [2023-12-26 07:54:40,596][123090] Updated weights for policy 1, policy_version 1034680 (0.0005) [2023-12-26 07:54:41,072][123091] Updated weights for policy 0, policy_version 1042104 (0.0009) [2023-12-26 07:54:41,135][123091] Updated weights for policy 0, policy_version 1042114 (0.0008) [2023-12-26 07:54:41,209][123091] Updated weights for policy 0, policy_version 1042124 (0.0008) [2023-12-26 07:54:41,396][123090] Updated weights for policy 1, policy_version 1034690 (0.0006) [2023-12-26 07:54:41,464][123090] Updated weights for policy 1, policy_version 1034700 (0.0009) [2023-12-26 07:54:41,535][123090] Updated weights for policy 1, policy_version 1034710 (0.0010) [2023-12-26 07:54:41,600][123090] Updated weights for policy 1, policy_version 1034720 (0.0009) [2023-12-26 07:54:42,060][123091] Updated weights for policy 0, policy_version 1042134 (0.0008) [2023-12-26 07:54:42,129][123091] Updated weights for policy 0, policy_version 1042144 (0.0008) [2023-12-26 07:54:42,195][123091] Updated weights for policy 0, policy_version 1042154 (0.0008) [2023-12-26 07:54:42,351][123090] Updated weights for policy 1, policy_version 1034730 (0.0008) [2023-12-26 07:54:42,427][123090] Updated weights for policy 1, policy_version 1034740 (0.0009) [2023-12-26 07:54:42,493][123090] Updated weights for policy 1, policy_version 1034750 (0.0010) [2023-12-26 07:54:42,937][123091] Updated weights for policy 0, policy_version 1042164 (0.0007) [2023-12-26 07:54:43,007][123091] Updated weights for policy 0, policy_version 1042174 (0.0009) [2023-12-26 07:54:43,076][123091] Updated weights for policy 0, policy_version 1042184 (0.0009) [2023-12-26 07:54:43,337][123090] Updated weights for policy 1, policy_version 1034760 (0.0010) [2023-12-26 07:54:43,403][123090] Updated weights for policy 1, policy_version 1034770 (0.0010) [2023-12-26 07:54:43,470][123090] Updated weights for policy 1, policy_version 1034780 (0.0010) [2023-12-26 07:54:43,718][123091] Updated weights for policy 0, policy_version 1042194 (0.0007) [2023-12-26 07:54:43,774][123091] Updated weights for policy 0, policy_version 1042204 (0.0005) [2023-12-26 07:54:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 531709952. Throughput: 0: 8963.8, 1: 8668.5. Samples: 531704644. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:54:43,784][121949] Avg episode reward: [(0, '6192.000'), (1, '5665.701')] [2023-12-26 07:54:43,818][123091] Updated weights for policy 0, policy_version 1042214 (0.0005) [2023-12-26 07:54:43,882][123091] Updated weights for policy 0, policy_version 1042224 (0.0005) [2023-12-26 07:54:44,271][123090] Updated weights for policy 1, policy_version 1034790 (0.0010) [2023-12-26 07:54:44,336][123090] Updated weights for policy 1, policy_version 1034800 (0.0010) [2023-12-26 07:54:44,406][123090] Updated weights for policy 1, policy_version 1034810 (0.0010) [2023-12-26 07:54:44,544][123091] Updated weights for policy 0, policy_version 1042234 (0.0010) [2023-12-26 07:54:44,608][123091] Updated weights for policy 0, policy_version 1042244 (0.0008) [2023-12-26 07:54:44,684][123091] Updated weights for policy 0, policy_version 1042254 (0.0005) [2023-12-26 07:54:45,156][123090] Updated weights for policy 1, policy_version 1034820 (0.0009) [2023-12-26 07:54:45,223][123090] Updated weights for policy 1, policy_version 1034830 (0.0010) [2023-12-26 07:54:45,279][123090] Updated weights for policy 1, policy_version 1034840 (0.0010) [2023-12-26 07:54:45,463][123091] Updated weights for policy 0, policy_version 1042264 (0.0009) [2023-12-26 07:54:45,528][123091] Updated weights for policy 0, policy_version 1042274 (0.0008) [2023-12-26 07:54:45,597][123091] Updated weights for policy 0, policy_version 1042284 (0.0008) [2023-12-26 07:54:46,075][123090] Updated weights for policy 1, policy_version 1034850 (0.0007) [2023-12-26 07:54:46,131][123090] Updated weights for policy 1, policy_version 1034860 (0.0011) [2023-12-26 07:54:46,191][123090] Updated weights for policy 1, policy_version 1034870 (0.0007) [2023-12-26 07:54:46,262][123090] Updated weights for policy 1, policy_version 1034880 (0.0005) [2023-12-26 07:54:46,372][123091] Updated weights for policy 0, policy_version 1042294 (0.0009) [2023-12-26 07:54:46,438][123091] Updated weights for policy 0, policy_version 1042304 (0.0010) [2023-12-26 07:54:46,497][123091] Updated weights for policy 0, policy_version 1042314 (0.0010) [2023-12-26 07:54:46,955][123090] Updated weights for policy 1, policy_version 1034890 (0.0011) [2023-12-26 07:54:47,003][123090] Updated weights for policy 1, policy_version 1034900 (0.0010) [2023-12-26 07:54:47,066][123090] Updated weights for policy 1, policy_version 1034910 (0.0010) [2023-12-26 07:54:47,309][123091] Updated weights for policy 0, policy_version 1042324 (0.0008) [2023-12-26 07:54:47,363][123091] Updated weights for policy 0, policy_version 1042334 (0.0005) [2023-12-26 07:54:47,410][123091] Updated weights for policy 0, policy_version 1042344 (0.0005) [2023-12-26 07:54:47,800][123090] Updated weights for policy 1, policy_version 1034920 (0.0007) [2023-12-26 07:54:47,870][123090] Updated weights for policy 1, policy_version 1034930 (0.0006) [2023-12-26 07:54:47,939][123090] Updated weights for policy 1, policy_version 1034940 (0.0006) [2023-12-26 07:54:48,108][123091] Updated weights for policy 0, policy_version 1042354 (0.0006) [2023-12-26 07:54:48,165][123091] Updated weights for policy 0, policy_version 1042364 (0.0010) [2023-12-26 07:54:48,219][123091] Updated weights for policy 0, policy_version 1042374 (0.0006) [2023-12-26 07:54:48,273][123091] Updated weights for policy 0, policy_version 1042384 (0.0010) [2023-12-26 07:54:48,555][123090] Updated weights for policy 1, policy_version 1034950 (0.0006) [2023-12-26 07:54:48,614][123090] Updated weights for policy 1, policy_version 1034960 (0.0006) [2023-12-26 07:54:48,684][123090] Updated weights for policy 1, policy_version 1034970 (0.0006) [2023-12-26 07:54:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 531808256. Throughput: 0: 9065.7, 1: 8761.2. Samples: 531816628. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:54:48,784][121949] Avg episode reward: [(0, '6204.773'), (1, '5634.189')] [2023-12-26 07:54:49,066][123091] Updated weights for policy 0, policy_version 1042394 (0.0010) [2023-12-26 07:54:49,120][123091] Updated weights for policy 0, policy_version 1042404 (0.0010) [2023-12-26 07:54:49,175][123091] Updated weights for policy 0, policy_version 1042414 (0.0010) [2023-12-26 07:54:49,377][123090] Updated weights for policy 1, policy_version 1034980 (0.0008) [2023-12-26 07:54:49,439][123090] Updated weights for policy 1, policy_version 1034990 (0.0010) [2023-12-26 07:54:49,507][123090] Updated weights for policy 1, policy_version 1035000 (0.0011) [2023-12-26 07:54:49,994][123091] Updated weights for policy 0, policy_version 1042424 (0.0007) [2023-12-26 07:54:50,066][123091] Updated weights for policy 0, policy_version 1042434 (0.0007) [2023-12-26 07:54:50,132][123091] Updated weights for policy 0, policy_version 1042444 (0.0010) [2023-12-26 07:54:50,281][123090] Updated weights for policy 1, policy_version 1035010 (0.0010) [2023-12-26 07:54:50,349][123090] Updated weights for policy 1, policy_version 1035020 (0.0009) [2023-12-26 07:54:50,414][123090] Updated weights for policy 1, policy_version 1035030 (0.0009) [2023-12-26 07:54:50,474][123090] Updated weights for policy 1, policy_version 1035040 (0.0008) [2023-12-26 07:54:50,931][123091] Updated weights for policy 0, policy_version 1042454 (0.0010) [2023-12-26 07:54:50,987][123091] Updated weights for policy 0, policy_version 1042464 (0.0010) [2023-12-26 07:54:51,045][123091] Updated weights for policy 0, policy_version 1042474 (0.0010) [2023-12-26 07:54:51,322][123090] Updated weights for policy 1, policy_version 1035050 (0.0010) [2023-12-26 07:54:51,389][123090] Updated weights for policy 1, policy_version 1035060 (0.0010) [2023-12-26 07:54:51,455][123090] Updated weights for policy 1, policy_version 1035070 (0.0009) [2023-12-26 07:54:51,868][123091] Updated weights for policy 0, policy_version 1042484 (0.0009) [2023-12-26 07:54:51,932][123091] Updated weights for policy 0, policy_version 1042495 (0.0006) [2023-12-26 07:54:52,006][123091] Updated weights for policy 0, policy_version 1042505 (0.0006) [2023-12-26 07:54:52,323][123090] Updated weights for policy 1, policy_version 1035080 (0.0008) [2023-12-26 07:54:52,396][123090] Updated weights for policy 1, policy_version 1035090 (0.0006) [2023-12-26 07:54:52,459][123090] Updated weights for policy 1, policy_version 1035100 (0.0006) [2023-12-26 07:54:52,857][123091] Updated weights for policy 0, policy_version 1042515 (0.0009) [2023-12-26 07:54:52,917][123091] Updated weights for policy 0, policy_version 1042525 (0.0010) [2023-12-26 07:54:52,967][123091] Updated weights for policy 0, policy_version 1042535 (0.0010) [2023-12-26 07:54:53,133][123090] Updated weights for policy 1, policy_version 1035110 (0.0005) [2023-12-26 07:54:53,186][123090] Updated weights for policy 1, policy_version 1035120 (0.0007) [2023-12-26 07:54:53,248][123090] Updated weights for policy 1, policy_version 1035130 (0.0008) [2023-12-26 07:54:53,771][123091] Updated weights for policy 0, policy_version 1042545 (0.0010) [2023-12-26 07:54:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17883.5). Total num frames: 531890176. Throughput: 0: 9111.5, 1: 8716.3. Samples: 531869760. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:54:53,785][121949] Avg episode reward: [(0, '6051.356'), (1, '5638.286')] [2023-12-26 07:54:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001035136_264994816.pth... [2023-12-26 07:54:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001034112_264732672.pth [2023-12-26 07:54:53,834][123091] Updated weights for policy 0, policy_version 1042555 (0.0005) [2023-12-26 07:54:53,887][123091] Updated weights for policy 0, policy_version 1042565 (0.0005) [2023-12-26 07:54:53,950][123091] Updated weights for policy 0, policy_version 1042575 (0.0008) [2023-12-26 07:54:53,952][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001042576_266903552.pth... [2023-12-26 07:54:53,955][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001041488_266625024.pth [2023-12-26 07:54:54,087][123090] Updated weights for policy 1, policy_version 1035140 (0.0009) [2023-12-26 07:54:54,143][123090] Updated weights for policy 1, policy_version 1035150 (0.0011) [2023-12-26 07:54:54,199][123090] Updated weights for policy 1, policy_version 1035160 (0.0006) [2023-12-26 07:54:54,769][123091] Updated weights for policy 0, policy_version 1042585 (0.0010) [2023-12-26 07:54:54,827][123091] Updated weights for policy 0, policy_version 1042596 (0.0010) [2023-12-26 07:54:54,879][123091] Updated weights for policy 0, policy_version 1042606 (0.0005) [2023-12-26 07:54:54,949][123090] Updated weights for policy 1, policy_version 1035170 (0.0007) [2023-12-26 07:54:55,009][123090] Updated weights for policy 1, policy_version 1035180 (0.0006) [2023-12-26 07:54:55,068][123090] Updated weights for policy 1, policy_version 1035190 (0.0006) [2023-12-26 07:54:55,131][123090] Updated weights for policy 1, policy_version 1035200 (0.0005) [2023-12-26 07:54:55,693][123091] Updated weights for policy 0, policy_version 1042616 (0.0007) [2023-12-26 07:54:55,733][123090] Updated weights for policy 1, policy_version 1035210 (0.0005) [2023-12-26 07:54:55,759][123091] Updated weights for policy 0, policy_version 1042626 (0.0007) [2023-12-26 07:54:55,805][123090] Updated weights for policy 1, policy_version 1035220 (0.0005) [2023-12-26 07:54:55,811][123091] Updated weights for policy 0, policy_version 1042636 (0.0008) [2023-12-26 07:54:55,866][123090] Updated weights for policy 1, policy_version 1035230 (0.0007) [2023-12-26 07:54:56,540][123091] Updated weights for policy 0, policy_version 1042646 (0.0010) [2023-12-26 07:54:56,596][123091] Updated weights for policy 0, policy_version 1042656 (0.0010) [2023-12-26 07:54:56,619][123090] Updated weights for policy 1, policy_version 1035240 (0.0006) [2023-12-26 07:54:56,651][123091] Updated weights for policy 0, policy_version 1042666 (0.0010) [2023-12-26 07:54:56,677][123090] Updated weights for policy 1, policy_version 1035250 (0.0005) [2023-12-26 07:54:56,744][123090] Updated weights for policy 1, policy_version 1035260 (0.0005) [2023-12-26 07:54:57,380][123090] Updated weights for policy 1, policy_version 1035270 (0.0008) [2023-12-26 07:54:57,427][123091] Updated weights for policy 0, policy_version 1042676 (0.0008) [2023-12-26 07:54:57,449][123090] Updated weights for policy 1, policy_version 1035280 (0.0010) [2023-12-26 07:54:57,481][123091] Updated weights for policy 0, policy_version 1042686 (0.0005) [2023-12-26 07:54:57,507][123090] Updated weights for policy 1, policy_version 1035290 (0.0010) [2023-12-26 07:54:57,536][123091] Updated weights for policy 0, policy_version 1042696 (0.0005) [2023-12-26 07:54:58,134][123091] Updated weights for policy 0, policy_version 1042706 (0.0006) [2023-12-26 07:54:58,206][123091] Updated weights for policy 0, policy_version 1042716 (0.0008) [2023-12-26 07:54:58,278][123091] Updated weights for policy 0, policy_version 1042726 (0.0007) [2023-12-26 07:54:58,294][123090] Updated weights for policy 1, policy_version 1035300 (0.0009) [2023-12-26 07:54:58,348][123091] Updated weights for policy 0, policy_version 1042736 (0.0008) [2023-12-26 07:54:58,367][123090] Updated weights for policy 1, policy_version 1035310 (0.0008) [2023-12-26 07:54:58,438][123090] Updated weights for policy 1, policy_version 1035320 (0.0009) [2023-12-26 07:54:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.4, 300 sec: 17911.3). Total num frames: 531988480. Throughput: 0: 9149.5, 1: 8820.2. Samples: 531980352. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:54:58,785][121949] Avg episode reward: [(0, '6057.161'), (1, '5429.587')] [2023-12-26 07:54:59,115][123091] Updated weights for policy 0, policy_version 1042746 (0.0011) [2023-12-26 07:54:59,162][123091] Updated weights for policy 0, policy_version 1042756 (0.0010) [2023-12-26 07:54:59,168][123090] Updated weights for policy 1, policy_version 1035330 (0.0009) [2023-12-26 07:54:59,209][123091] Updated weights for policy 0, policy_version 1042766 (0.0010) [2023-12-26 07:54:59,229][123090] Updated weights for policy 1, policy_version 1035340 (0.0006) [2023-12-26 07:54:59,299][123090] Updated weights for policy 1, policy_version 1035350 (0.0007) [2023-12-26 07:54:59,368][123090] Updated weights for policy 1, policy_version 1035360 (0.0008) [2023-12-26 07:55:00,063][123091] Updated weights for policy 0, policy_version 1042776 (0.0009) [2023-12-26 07:55:00,069][123090] Updated weights for policy 1, policy_version 1035370 (0.0008) [2023-12-26 07:55:00,125][123091] Updated weights for policy 0, policy_version 1042786 (0.0008) [2023-12-26 07:55:00,135][123090] Updated weights for policy 1, policy_version 1035380 (0.0008) [2023-12-26 07:55:00,189][123091] Updated weights for policy 0, policy_version 1042796 (0.0008) [2023-12-26 07:55:00,192][123090] Updated weights for policy 1, policy_version 1035390 (0.0008) [2023-12-26 07:55:00,887][123090] Updated weights for policy 1, policy_version 1035400 (0.0009) [2023-12-26 07:55:00,954][123090] Updated weights for policy 1, policy_version 1035410 (0.0006) [2023-12-26 07:55:00,974][123091] Updated weights for policy 0, policy_version 1042806 (0.0010) [2023-12-26 07:55:01,013][123090] Updated weights for policy 1, policy_version 1035420 (0.0010) [2023-12-26 07:55:01,029][123091] Updated weights for policy 0, policy_version 1042816 (0.0010) [2023-12-26 07:55:01,099][123091] Updated weights for policy 0, policy_version 1042826 (0.0011) [2023-12-26 07:55:01,831][123090] Updated weights for policy 1, policy_version 1035430 (0.0012) [2023-12-26 07:55:01,888][123090] Updated weights for policy 1, policy_version 1035440 (0.0009) [2023-12-26 07:55:01,936][123091] Updated weights for policy 0, policy_version 1042836 (0.0011) [2023-12-26 07:55:01,957][123090] Updated weights for policy 1, policy_version 1035450 (0.0007) [2023-12-26 07:55:02,005][123091] Updated weights for policy 0, policy_version 1042846 (0.0010) [2023-12-26 07:55:02,072][123091] Updated weights for policy 0, policy_version 1042856 (0.0008) [2023-12-26 07:55:02,768][123090] Updated weights for policy 1, policy_version 1035460 (0.0008) [2023-12-26 07:55:02,813][123091] Updated weights for policy 0, policy_version 1042866 (0.0008) [2023-12-26 07:55:02,828][123090] Updated weights for policy 1, policy_version 1035470 (0.0009) [2023-12-26 07:55:02,867][123091] Updated weights for policy 0, policy_version 1042876 (0.0009) [2023-12-26 07:55:02,880][123090] Updated weights for policy 1, policy_version 1035480 (0.0006) [2023-12-26 07:55:02,925][123091] Updated weights for policy 0, policy_version 1042886 (0.0010) [2023-12-26 07:55:02,984][123091] Updated weights for policy 0, policy_version 1042896 (0.0010) [2023-12-26 07:55:03,564][123091] Updated weights for policy 0, policy_version 1042906 (0.0007) [2023-12-26 07:55:03,608][123091] Updated weights for policy 0, policy_version 1042916 (0.0010) [2023-12-26 07:55:03,652][123091] Updated weights for policy 0, policy_version 1042926 (0.0010) [2023-12-26 07:55:03,750][123090] Updated weights for policy 1, policy_version 1035490 (0.0008) [2023-12-26 07:55:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 532078592. Throughput: 0: 9129.9, 1: 8857.2. Samples: 532090008. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:03,785][121949] Avg episode reward: [(0, '6325.351'), (1, '5414.024')] [2023-12-26 07:55:03,803][123090] Updated weights for policy 1, policy_version 1035500 (0.0009) [2023-12-26 07:55:03,862][123090] Updated weights for policy 1, policy_version 1035510 (0.0008) [2023-12-26 07:55:03,927][123090] Updated weights for policy 1, policy_version 1035520 (0.0007) [2023-12-26 07:55:04,511][123091] Updated weights for policy 0, policy_version 1042936 (0.0009) [2023-12-26 07:55:04,565][123091] Updated weights for policy 0, policy_version 1042946 (0.0009) [2023-12-26 07:55:04,628][123091] Updated weights for policy 0, policy_version 1042956 (0.0008) [2023-12-26 07:55:04,773][123090] Updated weights for policy 1, policy_version 1035530 (0.0010) [2023-12-26 07:55:04,839][123090] Updated weights for policy 1, policy_version 1035540 (0.0010) [2023-12-26 07:55:04,907][123090] Updated weights for policy 1, policy_version 1035550 (0.0010) [2023-12-26 07:55:05,461][123091] Updated weights for policy 0, policy_version 1042966 (0.0007) [2023-12-26 07:55:05,521][123091] Updated weights for policy 0, policy_version 1042976 (0.0006) [2023-12-26 07:55:05,577][123091] Updated weights for policy 0, policy_version 1042986 (0.0005) [2023-12-26 07:55:05,743][123090] Updated weights for policy 1, policy_version 1035560 (0.0010) [2023-12-26 07:55:05,797][123090] Updated weights for policy 1, policy_version 1035570 (0.0009) [2023-12-26 07:55:05,848][123090] Updated weights for policy 1, policy_version 1035580 (0.0010) [2023-12-26 07:55:06,227][123091] Updated weights for policy 0, policy_version 1042996 (0.0006) [2023-12-26 07:55:06,296][123091] Updated weights for policy 0, policy_version 1043006 (0.0009) [2023-12-26 07:55:06,368][123091] Updated weights for policy 0, policy_version 1043016 (0.0009) [2023-12-26 07:55:06,697][123090] Updated weights for policy 1, policy_version 1035590 (0.0011) [2023-12-26 07:55:06,768][123090] Updated weights for policy 1, policy_version 1035600 (0.0011) [2023-12-26 07:55:06,835][123090] Updated weights for policy 1, policy_version 1035610 (0.0011) [2023-12-26 07:55:07,181][123091] Updated weights for policy 0, policy_version 1043026 (0.0009) [2023-12-26 07:55:07,239][123091] Updated weights for policy 0, policy_version 1043036 (0.0009) [2023-12-26 07:55:07,292][123091] Updated weights for policy 0, policy_version 1043046 (0.0009) [2023-12-26 07:55:07,350][123091] Updated weights for policy 0, policy_version 1043056 (0.0009) [2023-12-26 07:55:07,640][123090] Updated weights for policy 1, policy_version 1035620 (0.0011) [2023-12-26 07:55:07,710][123090] Updated weights for policy 1, policy_version 1035630 (0.0010) [2023-12-26 07:55:07,780][123090] Updated weights for policy 1, policy_version 1035640 (0.0010) [2023-12-26 07:55:08,067][123091] Updated weights for policy 0, policy_version 1043066 (0.0006) [2023-12-26 07:55:08,121][123091] Updated weights for policy 0, policy_version 1043076 (0.0005) [2023-12-26 07:55:08,189][123091] Updated weights for policy 0, policy_version 1043086 (0.0005) [2023-12-26 07:55:08,599][123090] Updated weights for policy 1, policy_version 1035650 (0.0010) [2023-12-26 07:55:08,659][123090] Updated weights for policy 1, policy_version 1035660 (0.0009) [2023-12-26 07:55:08,715][123090] Updated weights for policy 1, policy_version 1035670 (0.0010) [2023-12-26 07:55:08,776][123090] Updated weights for policy 1, policy_version 1035680 (0.0009) [2023-12-26 07:55:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 532168704. Throughput: 0: 9145.0, 1: 8871.4. Samples: 532142204. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:08,785][121949] Avg episode reward: [(0, '6241.058'), (1, '5530.614')] [2023-12-26 07:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001043088_267034624.pth... [2023-12-26 07:55:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001035680_265134080.pth... [2023-12-26 07:55:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001042032_266764288.pth [2023-12-26 07:55:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001034624_264863744.pth [2023-12-26 07:55:08,942][123091] Updated weights for policy 0, policy_version 1043096 (0.0009) [2023-12-26 07:55:09,000][123091] Updated weights for policy 0, policy_version 1043106 (0.0008) [2023-12-26 07:55:09,049][123091] Updated weights for policy 0, policy_version 1043116 (0.0009) [2023-12-26 07:55:09,645][123090] Updated weights for policy 1, policy_version 1035690 (0.0009) [2023-12-26 07:55:09,714][123090] Updated weights for policy 1, policy_version 1035700 (0.0009) [2023-12-26 07:55:09,777][123090] Updated weights for policy 1, policy_version 1035710 (0.0010) [2023-12-26 07:55:09,896][123091] Updated weights for policy 0, policy_version 1043126 (0.0008) [2023-12-26 07:55:09,961][123091] Updated weights for policy 0, policy_version 1043136 (0.0008) [2023-12-26 07:55:10,021][123091] Updated weights for policy 0, policy_version 1043146 (0.0009) [2023-12-26 07:55:10,590][123090] Updated weights for policy 1, policy_version 1035720 (0.0009) [2023-12-26 07:55:10,640][123090] Updated weights for policy 1, policy_version 1035730 (0.0006) [2023-12-26 07:55:10,699][123090] Updated weights for policy 1, policy_version 1035740 (0.0010) [2023-12-26 07:55:10,850][123091] Updated weights for policy 0, policy_version 1043156 (0.0007) [2023-12-26 07:55:10,910][123091] Updated weights for policy 0, policy_version 1043166 (0.0011) [2023-12-26 07:55:10,970][123091] Updated weights for policy 0, policy_version 1043176 (0.0010) [2023-12-26 07:55:11,543][123090] Updated weights for policy 1, policy_version 1035750 (0.0007) [2023-12-26 07:55:11,605][123090] Updated weights for policy 1, policy_version 1035760 (0.0008) [2023-12-26 07:55:11,675][123090] Updated weights for policy 1, policy_version 1035770 (0.0009) [2023-12-26 07:55:11,912][123091] Updated weights for policy 0, policy_version 1043186 (0.0011) [2023-12-26 07:55:11,973][123091] Updated weights for policy 0, policy_version 1043196 (0.0007) [2023-12-26 07:55:12,040][123091] Updated weights for policy 0, policy_version 1043206 (0.0009) [2023-12-26 07:55:12,115][123091] Updated weights for policy 0, policy_version 1043216 (0.0005) [2023-12-26 07:55:12,335][123090] Updated weights for policy 1, policy_version 1035780 (0.0008) [2023-12-26 07:55:12,406][123090] Updated weights for policy 1, policy_version 1035790 (0.0009) [2023-12-26 07:55:12,469][123090] Updated weights for policy 1, policy_version 1035800 (0.0007) [2023-12-26 07:55:12,801][123091] Updated weights for policy 0, policy_version 1043226 (0.0010) [2023-12-26 07:55:12,845][123091] Updated weights for policy 0, policy_version 1043236 (0.0008) [2023-12-26 07:55:12,895][123091] Updated weights for policy 0, policy_version 1043246 (0.0005) [2023-12-26 07:55:13,183][123090] Updated weights for policy 1, policy_version 1035810 (0.0008) [2023-12-26 07:55:13,242][123090] Updated weights for policy 1, policy_version 1035820 (0.0010) [2023-12-26 07:55:13,301][123090] Updated weights for policy 1, policy_version 1035830 (0.0010) [2023-12-26 07:55:13,356][123090] Updated weights for policy 1, policy_version 1035840 (0.0010) [2023-12-26 07:55:13,702][123091] Updated weights for policy 0, policy_version 1043256 (0.0009) [2023-12-26 07:55:13,751][123091] Updated weights for policy 0, policy_version 1043266 (0.0010) [2023-12-26 07:55:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17883.6). Total num frames: 532250624. Throughput: 0: 9086.4, 1: 8823.8. Samples: 532246260. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:13,785][121949] Avg episode reward: [(0, '6117.710'), (1, '5511.264')] [2023-12-26 07:55:13,807][123091] Updated weights for policy 0, policy_version 1043276 (0.0009) [2023-12-26 07:55:14,118][123090] Updated weights for policy 1, policy_version 1035850 (0.0011) [2023-12-26 07:55:14,174][123090] Updated weights for policy 1, policy_version 1035860 (0.0010) [2023-12-26 07:55:14,234][123090] Updated weights for policy 1, policy_version 1035870 (0.0010) [2023-12-26 07:55:14,644][123091] Updated weights for policy 0, policy_version 1043286 (0.0009) [2023-12-26 07:55:14,707][123091] Updated weights for policy 0, policy_version 1043296 (0.0009) [2023-12-26 07:55:14,771][123091] Updated weights for policy 0, policy_version 1043306 (0.0009) [2023-12-26 07:55:15,074][123090] Updated weights for policy 1, policy_version 1035880 (0.0011) [2023-12-26 07:55:15,138][123090] Updated weights for policy 1, policy_version 1035890 (0.0011) [2023-12-26 07:55:15,198][123090] Updated weights for policy 1, policy_version 1035900 (0.0011) [2023-12-26 07:55:15,639][123091] Updated weights for policy 0, policy_version 1043316 (0.0009) [2023-12-26 07:55:15,699][123091] Updated weights for policy 0, policy_version 1043326 (0.0009) [2023-12-26 07:55:15,748][123091] Updated weights for policy 0, policy_version 1043337 (0.0009) [2023-12-26 07:55:16,021][123090] Updated weights for policy 1, policy_version 1035910 (0.0010) [2023-12-26 07:55:16,080][123090] Updated weights for policy 1, policy_version 1035920 (0.0010) [2023-12-26 07:55:16,146][123090] Updated weights for policy 1, policy_version 1035930 (0.0010) [2023-12-26 07:55:16,615][123091] Updated weights for policy 0, policy_version 1043347 (0.0009) [2023-12-26 07:55:16,665][123091] Updated weights for policy 0, policy_version 1043357 (0.0009) [2023-12-26 07:55:16,723][123091] Updated weights for policy 0, policy_version 1043367 (0.0009) [2023-12-26 07:55:16,977][123090] Updated weights for policy 1, policy_version 1035940 (0.0010) [2023-12-26 07:55:17,025][123090] Updated weights for policy 1, policy_version 1035950 (0.0010) [2023-12-26 07:55:17,076][123090] Updated weights for policy 1, policy_version 1035960 (0.0010) [2023-12-26 07:55:17,516][123091] Updated weights for policy 0, policy_version 1043377 (0.0008) [2023-12-26 07:55:17,588][123091] Updated weights for policy 0, policy_version 1043387 (0.0008) [2023-12-26 07:55:17,654][123091] Updated weights for policy 0, policy_version 1043397 (0.0011) [2023-12-26 07:55:17,713][123091] Updated weights for policy 0, policy_version 1043407 (0.0010) [2023-12-26 07:55:17,900][123090] Updated weights for policy 1, policy_version 1035970 (0.0010) [2023-12-26 07:55:17,971][123090] Updated weights for policy 1, policy_version 1035980 (0.0010) [2023-12-26 07:55:18,037][123090] Updated weights for policy 1, policy_version 1035990 (0.0009) [2023-12-26 07:55:18,093][123090] Updated weights for policy 1, policy_version 1036000 (0.0005) [2023-12-26 07:55:18,396][123091] Updated weights for policy 0, policy_version 1043417 (0.0007) [2023-12-26 07:55:18,457][123091] Updated weights for policy 0, policy_version 1043427 (0.0008) [2023-12-26 07:55:18,529][123091] Updated weights for policy 0, policy_version 1043437 (0.0009) [2023-12-26 07:55:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17911.3). Total num frames: 532340736. Throughput: 0: 9036.1, 1: 8894.4. Samples: 532352456. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:18,785][121949] Avg episode reward: [(0, '6126.135'), (1, '5236.123')] [2023-12-26 07:55:18,846][123090] Updated weights for policy 1, policy_version 1036010 (0.0010) [2023-12-26 07:55:18,902][123090] Updated weights for policy 1, policy_version 1036020 (0.0010) [2023-12-26 07:55:18,953][123090] Updated weights for policy 1, policy_version 1036030 (0.0010) [2023-12-26 07:55:19,208][123091] Updated weights for policy 0, policy_version 1043447 (0.0006) [2023-12-26 07:55:19,283][123091] Updated weights for policy 0, policy_version 1043457 (0.0010) [2023-12-26 07:55:19,356][123091] Updated weights for policy 0, policy_version 1043467 (0.0010) [2023-12-26 07:55:19,800][123090] Updated weights for policy 1, policy_version 1036040 (0.0009) [2023-12-26 07:55:19,868][123090] Updated weights for policy 1, policy_version 1036050 (0.0008) [2023-12-26 07:55:19,940][123090] Updated weights for policy 1, policy_version 1036060 (0.0009) [2023-12-26 07:55:20,160][123091] Updated weights for policy 0, policy_version 1043477 (0.0011) [2023-12-26 07:55:20,208][123091] Updated weights for policy 0, policy_version 1043487 (0.0011) [2023-12-26 07:55:20,260][123091] Updated weights for policy 0, policy_version 1043497 (0.0010) [2023-12-26 07:55:20,817][123090] Updated weights for policy 1, policy_version 1036070 (0.0009) [2023-12-26 07:55:20,878][123090] Updated weights for policy 1, policy_version 1036080 (0.0009) [2023-12-26 07:55:20,943][123090] Updated weights for policy 1, policy_version 1036090 (0.0009) [2023-12-26 07:55:21,108][123091] Updated weights for policy 0, policy_version 1043507 (0.0011) [2023-12-26 07:55:21,181][123091] Updated weights for policy 0, policy_version 1043517 (0.0011) [2023-12-26 07:55:21,248][123091] Updated weights for policy 0, policy_version 1043527 (0.0011) [2023-12-26 07:55:21,772][123090] Updated weights for policy 1, policy_version 1036100 (0.0009) [2023-12-26 07:55:21,838][123090] Updated weights for policy 1, policy_version 1036110 (0.0008) [2023-12-26 07:55:21,903][123090] Updated weights for policy 1, policy_version 1036120 (0.0007) [2023-12-26 07:55:22,099][123091] Updated weights for policy 0, policy_version 1043537 (0.0011) [2023-12-26 07:55:22,156][123091] Updated weights for policy 0, policy_version 1043547 (0.0011) [2023-12-26 07:55:22,211][123091] Updated weights for policy 0, policy_version 1043557 (0.0011) [2023-12-26 07:55:22,269][123091] Updated weights for policy 0, policy_version 1043567 (0.0011) [2023-12-26 07:55:22,716][123090] Updated weights for policy 1, policy_version 1036130 (0.0007) [2023-12-26 07:55:22,776][123090] Updated weights for policy 1, policy_version 1036140 (0.0009) [2023-12-26 07:55:22,837][123090] Updated weights for policy 1, policy_version 1036150 (0.0009) [2023-12-26 07:55:22,898][123090] Updated weights for policy 1, policy_version 1036160 (0.0009) [2023-12-26 07:55:23,118][123091] Updated weights for policy 0, policy_version 1043577 (0.0011) [2023-12-26 07:55:23,187][123091] Updated weights for policy 0, policy_version 1043587 (0.0010) [2023-12-26 07:55:23,256][123091] Updated weights for policy 0, policy_version 1043597 (0.0010) [2023-12-26 07:55:23,716][123090] Updated weights for policy 1, policy_version 1036170 (0.0005) [2023-12-26 07:55:23,771][123090] Updated weights for policy 1, policy_version 1036180 (0.0005) [2023-12-26 07:55:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 532422656. Throughput: 0: 8963.6, 1: 8921.4. Samples: 532404024. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:23,785][121949] Avg episode reward: [(0, '6070.291'), (1, '5412.244')] [2023-12-26 07:55:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001043600_267165696.pth... [2023-12-26 07:55:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001042576_266903552.pth [2023-12-26 07:55:23,822][123090] Updated weights for policy 1, policy_version 1036190 (0.0005) [2023-12-26 07:55:23,832][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001036192_265265152.pth... [2023-12-26 07:55:23,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001035136_264994816.pth [2023-12-26 07:55:24,049][123091] Updated weights for policy 0, policy_version 1043607 (0.0010) [2023-12-26 07:55:24,104][123091] Updated weights for policy 0, policy_version 1043617 (0.0010) [2023-12-26 07:55:24,155][123091] Updated weights for policy 0, policy_version 1043627 (0.0010) [2023-12-26 07:55:24,529][123090] Updated weights for policy 1, policy_version 1036200 (0.0005) [2023-12-26 07:55:24,589][123090] Updated weights for policy 1, policy_version 1036210 (0.0008) [2023-12-26 07:55:24,636][123090] Updated weights for policy 1, policy_version 1036220 (0.0006) [2023-12-26 07:55:24,985][123091] Updated weights for policy 0, policy_version 1043637 (0.0010) [2023-12-26 07:55:25,040][123091] Updated weights for policy 0, policy_version 1043647 (0.0010) [2023-12-26 07:55:25,095][123091] Updated weights for policy 0, policy_version 1043657 (0.0010) [2023-12-26 07:55:25,375][123090] Updated weights for policy 1, policy_version 1036230 (0.0008) [2023-12-26 07:55:25,423][123090] Updated weights for policy 1, policy_version 1036240 (0.0009) [2023-12-26 07:55:25,470][123090] Updated weights for policy 1, policy_version 1036250 (0.0008) [2023-12-26 07:55:25,926][123091] Updated weights for policy 0, policy_version 1043667 (0.0009) [2023-12-26 07:55:25,986][123091] Updated weights for policy 0, policy_version 1043677 (0.0005) [2023-12-26 07:55:26,054][123091] Updated weights for policy 0, policy_version 1043687 (0.0006) [2023-12-26 07:55:26,235][123090] Updated weights for policy 1, policy_version 1036260 (0.0009) [2023-12-26 07:55:26,285][123090] Updated weights for policy 1, policy_version 1036270 (0.0010) [2023-12-26 07:55:26,339][123090] Updated weights for policy 1, policy_version 1036280 (0.0010) [2023-12-26 07:55:26,894][123091] Updated weights for policy 0, policy_version 1043697 (0.0007) [2023-12-26 07:55:26,955][123091] Updated weights for policy 0, policy_version 1043707 (0.0009) [2023-12-26 07:55:27,010][123091] Updated weights for policy 0, policy_version 1043717 (0.0009) [2023-12-26 07:55:27,068][123091] Updated weights for policy 0, policy_version 1043727 (0.0007) [2023-12-26 07:55:27,077][123090] Updated weights for policy 1, policy_version 1036290 (0.0009) [2023-12-26 07:55:27,131][123090] Updated weights for policy 1, policy_version 1036300 (0.0010) [2023-12-26 07:55:27,189][123090] Updated weights for policy 1, policy_version 1036310 (0.0010) [2023-12-26 07:55:27,259][123090] Updated weights for policy 1, policy_version 1036320 (0.0010) [2023-12-26 07:55:27,861][123091] Updated weights for policy 0, policy_version 1043737 (0.0008) [2023-12-26 07:55:27,916][123091] Updated weights for policy 0, policy_version 1043747 (0.0009) [2023-12-26 07:55:27,965][123091] Updated weights for policy 0, policy_version 1043757 (0.0009) [2023-12-26 07:55:28,112][123090] Updated weights for policy 1, policy_version 1036330 (0.0010) [2023-12-26 07:55:28,165][123090] Updated weights for policy 1, policy_version 1036340 (0.0009) [2023-12-26 07:55:28,211][123090] Updated weights for policy 1, policy_version 1036350 (0.0008) [2023-12-26 07:55:28,742][123091] Updated weights for policy 0, policy_version 1043767 (0.0010) [2023-12-26 07:55:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 532512768. Throughput: 0: 8943.6, 1: 8977.3. Samples: 532511088. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:28,785][121949] Avg episode reward: [(0, '6112.051'), (1, '5568.947')] [2023-12-26 07:55:28,790][123091] Updated weights for policy 0, policy_version 1043777 (0.0009) [2023-12-26 07:55:28,842][123091] Updated weights for policy 0, policy_version 1043787 (0.0009) [2023-12-26 07:55:29,091][123090] Updated weights for policy 1, policy_version 1036360 (0.0009) [2023-12-26 07:55:29,150][123090] Updated weights for policy 1, policy_version 1036370 (0.0009) [2023-12-26 07:55:29,204][123090] Updated weights for policy 1, policy_version 1036380 (0.0009) [2023-12-26 07:55:29,643][123091] Updated weights for policy 0, policy_version 1043797 (0.0008) [2023-12-26 07:55:29,702][123091] Updated weights for policy 0, policy_version 1043807 (0.0009) [2023-12-26 07:55:29,757][123091] Updated weights for policy 0, policy_version 1043817 (0.0009) [2023-12-26 07:55:30,041][123090] Updated weights for policy 1, policy_version 1036390 (0.0009) [2023-12-26 07:55:30,112][123090] Updated weights for policy 1, policy_version 1036400 (0.0010) [2023-12-26 07:55:30,176][123090] Updated weights for policy 1, policy_version 1036410 (0.0009) [2023-12-26 07:55:30,555][123091] Updated weights for policy 0, policy_version 1043827 (0.0010) [2023-12-26 07:55:30,617][123091] Updated weights for policy 0, policy_version 1043837 (0.0010) [2023-12-26 07:55:30,675][123091] Updated weights for policy 0, policy_version 1043847 (0.0011) [2023-12-26 07:55:31,021][123090] Updated weights for policy 1, policy_version 1036420 (0.0010) [2023-12-26 07:55:31,085][123090] Updated weights for policy 1, policy_version 1036431 (0.0010) [2023-12-26 07:55:31,147][123090] Updated weights for policy 1, policy_version 1036441 (0.0009) [2023-12-26 07:55:31,524][123091] Updated weights for policy 0, policy_version 1043857 (0.0010) [2023-12-26 07:55:31,585][123091] Updated weights for policy 0, policy_version 1043867 (0.0009) [2023-12-26 07:55:31,652][123091] Updated weights for policy 0, policy_version 1043877 (0.0009) [2023-12-26 07:55:31,704][123091] Updated weights for policy 0, policy_version 1043887 (0.0009) [2023-12-26 07:55:32,022][123090] Updated weights for policy 1, policy_version 1036451 (0.0011) [2023-12-26 07:55:32,077][123090] Updated weights for policy 1, policy_version 1036461 (0.0010) [2023-12-26 07:55:32,129][123090] Updated weights for policy 1, policy_version 1036471 (0.0010) [2023-12-26 07:55:32,506][123091] Updated weights for policy 0, policy_version 1043897 (0.0006) [2023-12-26 07:55:32,559][123091] Updated weights for policy 0, policy_version 1043907 (0.0005) [2023-12-26 07:55:32,607][123091] Updated weights for policy 0, policy_version 1043917 (0.0010) [2023-12-26 07:55:32,999][123090] Updated weights for policy 1, policy_version 1036481 (0.0010) [2023-12-26 07:55:33,053][123090] Updated weights for policy 1, policy_version 1036491 (0.0010) [2023-12-26 07:55:33,105][123090] Updated weights for policy 1, policy_version 1036501 (0.0009) [2023-12-26 07:55:33,161][123090] Updated weights for policy 1, policy_version 1036511 (0.0009) [2023-12-26 07:55:33,337][123091] Updated weights for policy 0, policy_version 1043927 (0.0007) [2023-12-26 07:55:33,389][123091] Updated weights for policy 0, policy_version 1043937 (0.0005) [2023-12-26 07:55:33,435][123091] Updated weights for policy 0, policy_version 1043947 (0.0008) [2023-12-26 07:55:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 532602880. Throughput: 0: 8906.2, 1: 8831.0. Samples: 532614804. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:33,785][121949] Avg episode reward: [(0, '6104.660'), (1, '5598.163')] [2023-12-26 07:55:34,028][123090] Updated weights for policy 1, policy_version 1036521 (0.0006) [2023-12-26 07:55:34,068][123091] Updated weights for policy 0, policy_version 1043957 (0.0007) [2023-12-26 07:55:34,080][123090] Updated weights for policy 1, policy_version 1036531 (0.0005) [2023-12-26 07:55:34,118][123091] Updated weights for policy 0, policy_version 1043967 (0.0008) [2023-12-26 07:55:34,134][123090] Updated weights for policy 1, policy_version 1036541 (0.0005) [2023-12-26 07:55:34,178][123091] Updated weights for policy 0, policy_version 1043977 (0.0011) [2023-12-26 07:55:34,826][123090] Updated weights for policy 1, policy_version 1036551 (0.0008) [2023-12-26 07:55:34,896][123090] Updated weights for policy 1, policy_version 1036561 (0.0009) [2023-12-26 07:55:34,964][123090] Updated weights for policy 1, policy_version 1036571 (0.0009) [2023-12-26 07:55:34,979][123091] Updated weights for policy 0, policy_version 1043987 (0.0009) [2023-12-26 07:55:35,050][123091] Updated weights for policy 0, policy_version 1043997 (0.0010) [2023-12-26 07:55:35,117][123091] Updated weights for policy 0, policy_version 1044007 (0.0011) [2023-12-26 07:55:35,718][123090] Updated weights for policy 1, policy_version 1036581 (0.0009) [2023-12-26 07:55:35,780][123090] Updated weights for policy 1, policy_version 1036591 (0.0010) [2023-12-26 07:55:35,846][123090] Updated weights for policy 1, policy_version 1036601 (0.0006) [2023-12-26 07:55:35,884][123091] Updated weights for policy 0, policy_version 1044017 (0.0008) [2023-12-26 07:55:35,943][123091] Updated weights for policy 0, policy_version 1044027 (0.0007) [2023-12-26 07:55:35,991][123091] Updated weights for policy 0, policy_version 1044037 (0.0005) [2023-12-26 07:55:36,037][123091] Updated weights for policy 0, policy_version 1044047 (0.0005) [2023-12-26 07:55:36,674][123090] Updated weights for policy 1, policy_version 1036611 (0.0007) [2023-12-26 07:55:36,738][123090] Updated weights for policy 1, policy_version 1036621 (0.0011) [2023-12-26 07:55:36,756][123091] Updated weights for policy 0, policy_version 1044057 (0.0010) [2023-12-26 07:55:36,802][123090] Updated weights for policy 1, policy_version 1036631 (0.0011) [2023-12-26 07:55:36,822][123091] Updated weights for policy 0, policy_version 1044067 (0.0009) [2023-12-26 07:55:36,888][123091] Updated weights for policy 0, policy_version 1044077 (0.0009) [2023-12-26 07:55:37,624][123090] Updated weights for policy 1, policy_version 1036641 (0.0011) [2023-12-26 07:55:37,642][123091] Updated weights for policy 0, policy_version 1044087 (0.0011) [2023-12-26 07:55:37,684][123090] Updated weights for policy 1, policy_version 1036651 (0.0011) [2023-12-26 07:55:37,703][123091] Updated weights for policy 0, policy_version 1044097 (0.0011) [2023-12-26 07:55:37,746][123090] Updated weights for policy 1, policy_version 1036661 (0.0011) [2023-12-26 07:55:37,766][123091] Updated weights for policy 0, policy_version 1044107 (0.0008) [2023-12-26 07:55:37,810][123090] Updated weights for policy 1, policy_version 1036671 (0.0011) [2023-12-26 07:55:38,541][123091] Updated weights for policy 0, policy_version 1044117 (0.0009) [2023-12-26 07:55:38,600][123091] Updated weights for policy 0, policy_version 1044127 (0.0008) [2023-12-26 07:55:38,611][123090] Updated weights for policy 1, policy_version 1036681 (0.0006) [2023-12-26 07:55:38,666][123091] Updated weights for policy 0, policy_version 1044137 (0.0009) [2023-12-26 07:55:38,670][123090] Updated weights for policy 1, policy_version 1036691 (0.0006) [2023-12-26 07:55:38,741][123090] Updated weights for policy 1, policy_version 1036701 (0.0007) [2023-12-26 07:55:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.3, 300 sec: 17911.3). Total num frames: 532701184. Throughput: 0: 8942.4, 1: 8866.9. Samples: 532671180. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:38,785][121949] Avg episode reward: [(0, '6189.222'), (1, '5579.451')] [2023-12-26 07:55:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001044144_267304960.pth... [2023-12-26 07:55:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001036704_265396224.pth... [2023-12-26 07:55:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001043088_267034624.pth [2023-12-26 07:55:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001035680_265134080.pth [2023-12-26 07:55:39,522][123091] Updated weights for policy 0, policy_version 1044147 (0.0011) [2023-12-26 07:55:39,573][123091] Updated weights for policy 0, policy_version 1044157 (0.0010) [2023-12-26 07:55:39,599][123090] Updated weights for policy 1, policy_version 1036711 (0.0009) [2023-12-26 07:55:39,632][123091] Updated weights for policy 0, policy_version 1044167 (0.0011) [2023-12-26 07:55:39,670][123090] Updated weights for policy 1, policy_version 1036721 (0.0007) [2023-12-26 07:55:39,741][123090] Updated weights for policy 1, policy_version 1036731 (0.0008) [2023-12-26 07:55:40,490][123091] Updated weights for policy 0, policy_version 1044177 (0.0010) [2023-12-26 07:55:40,502][123090] Updated weights for policy 1, policy_version 1036741 (0.0009) [2023-12-26 07:55:40,554][123090] Updated weights for policy 1, policy_version 1036751 (0.0007) [2023-12-26 07:55:40,560][123091] Updated weights for policy 0, policy_version 1044187 (0.0006) [2023-12-26 07:55:40,613][123090] Updated weights for policy 1, policy_version 1036761 (0.0006) [2023-12-26 07:55:40,621][123091] Updated weights for policy 0, policy_version 1044197 (0.0008) [2023-12-26 07:55:40,692][123091] Updated weights for policy 0, policy_version 1044207 (0.0009) [2023-12-26 07:55:41,436][123091] Updated weights for policy 0, policy_version 1044217 (0.0009) [2023-12-26 07:55:41,451][123090] Updated weights for policy 1, policy_version 1036771 (0.0006) [2023-12-26 07:55:41,496][123091] Updated weights for policy 0, policy_version 1044227 (0.0008) [2023-12-26 07:55:41,519][123090] Updated weights for policy 1, policy_version 1036781 (0.0007) [2023-12-26 07:55:41,563][123091] Updated weights for policy 0, policy_version 1044237 (0.0008) [2023-12-26 07:55:41,584][123090] Updated weights for policy 1, policy_version 1036791 (0.0006) [2023-12-26 07:55:42,219][123091] Updated weights for policy 0, policy_version 1044247 (0.0008) [2023-12-26 07:55:42,293][123091] Updated weights for policy 0, policy_version 1044257 (0.0009) [2023-12-26 07:55:42,365][123091] Updated weights for policy 0, policy_version 1044267 (0.0009) [2023-12-26 07:55:42,413][123090] Updated weights for policy 1, policy_version 1036801 (0.0007) [2023-12-26 07:55:42,468][123090] Updated weights for policy 1, policy_version 1036811 (0.0006) [2023-12-26 07:55:42,529][123090] Updated weights for policy 1, policy_version 1036821 (0.0008) [2023-12-26 07:55:42,608][123090] Updated weights for policy 1, policy_version 1036832 (0.0006) [2023-12-26 07:55:43,256][123091] Updated weights for policy 0, policy_version 1044277 (0.0010) [2023-12-26 07:55:43,303][123090] Updated weights for policy 1, policy_version 1036842 (0.0005) [2023-12-26 07:55:43,327][123091] Updated weights for policy 0, policy_version 1044287 (0.0010) [2023-12-26 07:55:43,362][123090] Updated weights for policy 1, policy_version 1036852 (0.0006) [2023-12-26 07:55:43,384][123091] Updated weights for policy 0, policy_version 1044297 (0.0009) [2023-12-26 07:55:43,418][123090] Updated weights for policy 1, policy_version 1036862 (0.0006) [2023-12-26 07:55:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 532783104. Throughput: 0: 8928.5, 1: 8739.6. Samples: 532775420. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:43,785][121949] Avg episode reward: [(0, '6126.696'), (1, '5487.899')] [2023-12-26 07:55:44,010][123090] Updated weights for policy 1, policy_version 1036872 (0.0009) [2023-12-26 07:55:44,065][123090] Updated weights for policy 1, policy_version 1036882 (0.0005) [2023-12-26 07:55:44,120][123090] Updated weights for policy 1, policy_version 1036892 (0.0006) [2023-12-26 07:55:44,250][123091] Updated weights for policy 0, policy_version 1044307 (0.0009) [2023-12-26 07:55:44,303][123091] Updated weights for policy 0, policy_version 1044317 (0.0010) [2023-12-26 07:55:44,359][123091] Updated weights for policy 0, policy_version 1044327 (0.0010) [2023-12-26 07:55:44,929][123090] Updated weights for policy 1, policy_version 1036902 (0.0009) [2023-12-26 07:55:44,993][123090] Updated weights for policy 1, policy_version 1036912 (0.0011) [2023-12-26 07:55:45,062][123090] Updated weights for policy 1, policy_version 1036922 (0.0011) [2023-12-26 07:55:45,194][123091] Updated weights for policy 0, policy_version 1044337 (0.0008) [2023-12-26 07:55:45,243][123091] Updated weights for policy 0, policy_version 1044347 (0.0005) [2023-12-26 07:55:45,290][123091] Updated weights for policy 0, policy_version 1044357 (0.0006) [2023-12-26 07:55:45,356][123091] Updated weights for policy 0, policy_version 1044367 (0.0007) [2023-12-26 07:55:45,885][123090] Updated weights for policy 1, policy_version 1036932 (0.0011) [2023-12-26 07:55:45,961][123090] Updated weights for policy 1, policy_version 1036942 (0.0011) [2023-12-26 07:55:46,020][123090] Updated weights for policy 1, policy_version 1036952 (0.0011) [2023-12-26 07:55:46,048][123091] Updated weights for policy 0, policy_version 1044377 (0.0006) [2023-12-26 07:55:46,115][123091] Updated weights for policy 0, policy_version 1044387 (0.0007) [2023-12-26 07:55:46,183][123091] Updated weights for policy 0, policy_version 1044397 (0.0009) [2023-12-26 07:55:46,838][123090] Updated weights for policy 1, policy_version 1036962 (0.0006) [2023-12-26 07:55:46,905][123090] Updated weights for policy 1, policy_version 1036972 (0.0011) [2023-12-26 07:55:46,933][123091] Updated weights for policy 0, policy_version 1044407 (0.0007) [2023-12-26 07:55:46,961][123090] Updated weights for policy 1, policy_version 1036982 (0.0011) [2023-12-26 07:55:46,993][123091] Updated weights for policy 0, policy_version 1044417 (0.0005) [2023-12-26 07:55:47,024][123090] Updated weights for policy 1, policy_version 1036992 (0.0011) [2023-12-26 07:55:47,047][123091] Updated weights for policy 0, policy_version 1044427 (0.0008) [2023-12-26 07:55:47,701][123090] Updated weights for policy 1, policy_version 1037002 (0.0006) [2023-12-26 07:55:47,759][123090] Updated weights for policy 1, policy_version 1037012 (0.0007) [2023-12-26 07:55:47,812][123090] Updated weights for policy 1, policy_version 1037022 (0.0006) [2023-12-26 07:55:47,934][123091] Updated weights for policy 0, policy_version 1044437 (0.0007) [2023-12-26 07:55:48,010][123091] Updated weights for policy 0, policy_version 1044447 (0.0006) [2023-12-26 07:55:48,072][123091] Updated weights for policy 0, policy_version 1044457 (0.0005) [2023-12-26 07:55:48,612][123090] Updated weights for policy 1, policy_version 1037032 (0.0009) [2023-12-26 07:55:48,675][123090] Updated weights for policy 1, policy_version 1037042 (0.0010) [2023-12-26 07:55:48,739][123090] Updated weights for policy 1, policy_version 1037052 (0.0010) [2023-12-26 07:55:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 532873216. Throughput: 0: 8861.3, 1: 8783.6. Samples: 532884024. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:48,785][121949] Avg episode reward: [(0, '6091.667'), (1, '5463.792')] [2023-12-26 07:55:48,809][123091] Updated weights for policy 0, policy_version 1044467 (0.0005) [2023-12-26 07:55:48,874][123091] Updated weights for policy 0, policy_version 1044477 (0.0008) [2023-12-26 07:55:48,943][123091] Updated weights for policy 0, policy_version 1044487 (0.0009) [2023-12-26 07:55:49,562][123090] Updated weights for policy 1, policy_version 1037062 (0.0010) [2023-12-26 07:55:49,624][123090] Updated weights for policy 1, policy_version 1037072 (0.0010) [2023-12-26 07:55:49,691][123090] Updated weights for policy 1, policy_version 1037082 (0.0010) [2023-12-26 07:55:49,719][123091] Updated weights for policy 0, policy_version 1044497 (0.0008) [2023-12-26 07:55:49,782][123091] Updated weights for policy 0, policy_version 1044507 (0.0008) [2023-12-26 07:55:49,849][123091] Updated weights for policy 0, policy_version 1044517 (0.0009) [2023-12-26 07:55:49,918][123091] Updated weights for policy 0, policy_version 1044527 (0.0009) [2023-12-26 07:55:50,545][123090] Updated weights for policy 1, policy_version 1037092 (0.0010) [2023-12-26 07:55:50,617][123090] Updated weights for policy 1, policy_version 1037102 (0.0011) [2023-12-26 07:55:50,691][123090] Updated weights for policy 1, policy_version 1037112 (0.0011) [2023-12-26 07:55:50,725][123091] Updated weights for policy 0, policy_version 1044537 (0.0005) [2023-12-26 07:55:50,787][123091] Updated weights for policy 0, policy_version 1044547 (0.0005) [2023-12-26 07:55:50,857][123091] Updated weights for policy 0, policy_version 1044557 (0.0006) [2023-12-26 07:55:51,519][123090] Updated weights for policy 1, policy_version 1037122 (0.0010) [2023-12-26 07:55:51,575][123090] Updated weights for policy 1, policy_version 1037132 (0.0010) [2023-12-26 07:55:51,621][123091] Updated weights for policy 0, policy_version 1044567 (0.0009) [2023-12-26 07:55:51,638][123090] Updated weights for policy 1, policy_version 1037142 (0.0011) [2023-12-26 07:55:51,691][123091] Updated weights for policy 0, policy_version 1044577 (0.0011) [2023-12-26 07:55:51,700][123090] Updated weights for policy 1, policy_version 1037152 (0.0007) [2023-12-26 07:55:51,763][123091] Updated weights for policy 0, policy_version 1044587 (0.0011) [2023-12-26 07:55:52,482][123090] Updated weights for policy 1, policy_version 1037162 (0.0009) [2023-12-26 07:55:52,550][123090] Updated weights for policy 1, policy_version 1037172 (0.0007) [2023-12-26 07:55:52,561][123091] Updated weights for policy 0, policy_version 1044597 (0.0009) [2023-12-26 07:55:52,618][123090] Updated weights for policy 1, policy_version 1037182 (0.0009) [2023-12-26 07:55:52,629][123091] Updated weights for policy 0, policy_version 1044607 (0.0009) [2023-12-26 07:55:52,696][123091] Updated weights for policy 0, policy_version 1044617 (0.0009) [2023-12-26 07:55:53,293][123090] Updated weights for policy 1, policy_version 1037192 (0.0010) [2023-12-26 07:55:53,354][123090] Updated weights for policy 1, policy_version 1037202 (0.0010) [2023-12-26 07:55:53,420][123090] Updated weights for policy 1, policy_version 1037212 (0.0010) [2023-12-26 07:55:53,521][123091] Updated weights for policy 0, policy_version 1044627 (0.0009) [2023-12-26 07:55:53,583][123091] Updated weights for policy 0, policy_version 1044637 (0.0005) [2023-12-26 07:55:53,647][123091] Updated weights for policy 0, policy_version 1044647 (0.0005) [2023-12-26 07:55:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 532963328. Throughput: 0: 8866.0, 1: 8770.0. Samples: 532935824. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:53,784][121949] Avg episode reward: [(0, '6140.501'), (1, '5673.442')] [2023-12-26 07:55:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001044656_267436032.pth... [2023-12-26 07:55:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001037216_265527296.pth... [2023-12-26 07:55:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001043600_267165696.pth [2023-12-26 07:55:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001036192_265265152.pth [2023-12-26 07:55:54,132][123090] Updated weights for policy 1, policy_version 1037222 (0.0010) [2023-12-26 07:55:54,192][123090] Updated weights for policy 1, policy_version 1037232 (0.0007) [2023-12-26 07:55:54,255][123090] Updated weights for policy 1, policy_version 1037242 (0.0005) [2023-12-26 07:55:54,407][123091] Updated weights for policy 0, policy_version 1044657 (0.0007) [2023-12-26 07:55:54,473][123091] Updated weights for policy 0, policy_version 1044667 (0.0011) [2023-12-26 07:55:54,540][123091] Updated weights for policy 0, policy_version 1044677 (0.0011) [2023-12-26 07:55:54,605][123091] Updated weights for policy 0, policy_version 1044687 (0.0010) [2023-12-26 07:55:54,937][123090] Updated weights for policy 1, policy_version 1037252 (0.0006) [2023-12-26 07:55:55,007][123090] Updated weights for policy 1, policy_version 1037262 (0.0006) [2023-12-26 07:55:55,075][123090] Updated weights for policy 1, policy_version 1037272 (0.0005) [2023-12-26 07:55:55,363][123091] Updated weights for policy 0, policy_version 1044697 (0.0009) [2023-12-26 07:55:55,417][123091] Updated weights for policy 0, policy_version 1044707 (0.0010) [2023-12-26 07:55:55,471][123091] Updated weights for policy 0, policy_version 1044717 (0.0010) [2023-12-26 07:55:55,677][123090] Updated weights for policy 1, policy_version 1037282 (0.0005) [2023-12-26 07:55:55,736][123090] Updated weights for policy 1, policy_version 1037292 (0.0008) [2023-12-26 07:55:55,790][123090] Updated weights for policy 1, policy_version 1037302 (0.0009) [2023-12-26 07:55:55,847][123090] Updated weights for policy 1, policy_version 1037312 (0.0009) [2023-12-26 07:55:56,144][123091] Updated weights for policy 0, policy_version 1044727 (0.0007) [2023-12-26 07:55:56,191][123091] Updated weights for policy 0, policy_version 1044737 (0.0005) [2023-12-26 07:55:56,250][123091] Updated weights for policy 0, policy_version 1044747 (0.0005) [2023-12-26 07:55:56,658][123090] Updated weights for policy 1, policy_version 1037322 (0.0005) [2023-12-26 07:55:56,708][123090] Updated weights for policy 1, policy_version 1037332 (0.0005) [2023-12-26 07:55:56,761][123090] Updated weights for policy 1, policy_version 1037342 (0.0005) [2023-12-26 07:55:56,914][123091] Updated weights for policy 0, policy_version 1044757 (0.0008) [2023-12-26 07:55:56,970][123091] Updated weights for policy 0, policy_version 1044767 (0.0007) [2023-12-26 07:55:57,022][123091] Updated weights for policy 0, policy_version 1044777 (0.0005) [2023-12-26 07:55:57,462][123090] Updated weights for policy 1, policy_version 1037352 (0.0005) [2023-12-26 07:55:57,514][123090] Updated weights for policy 1, policy_version 1037362 (0.0005) [2023-12-26 07:55:57,572][123090] Updated weights for policy 1, policy_version 1037372 (0.0005) [2023-12-26 07:55:57,745][123091] Updated weights for policy 0, policy_version 1044787 (0.0007) [2023-12-26 07:55:57,796][123091] Updated weights for policy 0, policy_version 1044797 (0.0010) [2023-12-26 07:55:57,861][123091] Updated weights for policy 0, policy_version 1044807 (0.0010) [2023-12-26 07:55:58,340][123090] Updated weights for policy 1, policy_version 1037382 (0.0008) [2023-12-26 07:55:58,412][123090] Updated weights for policy 1, policy_version 1037392 (0.0008) [2023-12-26 07:55:58,484][123090] Updated weights for policy 1, policy_version 1037402 (0.0008) [2023-12-26 07:55:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 533053440. Throughput: 0: 8937.7, 1: 8914.2. Samples: 533049596. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:55:58,785][121949] Avg episode reward: [(0, '6142.284'), (1, '5808.382')] [2023-12-26 07:55:58,821][123091] Updated weights for policy 0, policy_version 1044817 (0.0010) [2023-12-26 07:55:58,886][123091] Updated weights for policy 0, policy_version 1044827 (0.0006) [2023-12-26 07:55:58,946][123091] Updated weights for policy 0, policy_version 1044837 (0.0009) [2023-12-26 07:55:59,002][123091] Updated weights for policy 0, policy_version 1044847 (0.0009) [2023-12-26 07:55:59,335][123090] Updated weights for policy 1, policy_version 1037412 (0.0008) [2023-12-26 07:55:59,400][123090] Updated weights for policy 1, policy_version 1037422 (0.0008) [2023-12-26 07:55:59,450][123090] Updated weights for policy 1, policy_version 1037432 (0.0008) [2023-12-26 07:55:59,880][123091] Updated weights for policy 0, policy_version 1044857 (0.0009) [2023-12-26 07:55:59,942][123091] Updated weights for policy 0, policy_version 1044867 (0.0008) [2023-12-26 07:56:00,011][123091] Updated weights for policy 0, policy_version 1044877 (0.0009) [2023-12-26 07:56:00,274][123090] Updated weights for policy 1, policy_version 1037442 (0.0008) [2023-12-26 07:56:00,321][123090] Updated weights for policy 1, policy_version 1037452 (0.0010) [2023-12-26 07:56:00,369][123090] Updated weights for policy 1, policy_version 1037462 (0.0010) [2023-12-26 07:56:00,427][123090] Updated weights for policy 1, policy_version 1037472 (0.0010) [2023-12-26 07:56:00,864][123091] Updated weights for policy 0, policy_version 1044887 (0.0010) [2023-12-26 07:56:00,919][123091] Updated weights for policy 0, policy_version 1044898 (0.0010) [2023-12-26 07:56:00,973][123091] Updated weights for policy 0, policy_version 1044909 (0.0010) [2023-12-26 07:56:01,187][123090] Updated weights for policy 1, policy_version 1037482 (0.0007) [2023-12-26 07:56:01,258][123090] Updated weights for policy 1, policy_version 1037492 (0.0006) [2023-12-26 07:56:01,334][123090] Updated weights for policy 1, policy_version 1037502 (0.0007) [2023-12-26 07:56:01,865][123091] Updated weights for policy 0, policy_version 1044919 (0.0010) [2023-12-26 07:56:01,924][123091] Updated weights for policy 0, policy_version 1044929 (0.0009) [2023-12-26 07:56:01,993][123091] Updated weights for policy 0, policy_version 1044939 (0.0008) [2023-12-26 07:56:02,001][123090] Updated weights for policy 1, policy_version 1037512 (0.0008) [2023-12-26 07:56:02,061][123090] Updated weights for policy 1, policy_version 1037522 (0.0008) [2023-12-26 07:56:02,126][123090] Updated weights for policy 1, policy_version 1037532 (0.0010) [2023-12-26 07:56:02,831][123091] Updated weights for policy 0, policy_version 1044949 (0.0009) [2023-12-26 07:56:02,898][123091] Updated weights for policy 0, policy_version 1044959 (0.0009) [2023-12-26 07:56:02,964][123091] Updated weights for policy 0, policy_version 1044969 (0.0009) [2023-12-26 07:56:02,965][123090] Updated weights for policy 1, policy_version 1037542 (0.0009) [2023-12-26 07:56:03,028][123090] Updated weights for policy 1, policy_version 1037552 (0.0008) [2023-12-26 07:56:03,080][123090] Updated weights for policy 1, policy_version 1037562 (0.0009) [2023-12-26 07:56:03,740][123091] Updated weights for policy 0, policy_version 1044979 (0.0007) [2023-12-26 07:56:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 533135360. Throughput: 0: 8864.7, 1: 8918.9. Samples: 533152716. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:03,784][121949] Avg episode reward: [(0, '6191.211'), (1, '5763.283')] [2023-12-26 07:56:03,790][123091] Updated weights for policy 0, policy_version 1044989 (0.0005) [2023-12-26 07:56:03,820][123090] Updated weights for policy 1, policy_version 1037572 (0.0009) [2023-12-26 07:56:03,854][123091] Updated weights for policy 0, policy_version 1044999 (0.0008) [2023-12-26 07:56:03,888][123090] Updated weights for policy 1, policy_version 1037582 (0.0008) [2023-12-26 07:56:03,950][123090] Updated weights for policy 1, policy_version 1037592 (0.0009) [2023-12-26 07:56:04,656][123091] Updated weights for policy 0, policy_version 1045009 (0.0008) [2023-12-26 07:56:04,716][123091] Updated weights for policy 0, policy_version 1045019 (0.0011) [2023-12-26 07:56:04,720][123090] Updated weights for policy 1, policy_version 1037602 (0.0010) [2023-12-26 07:56:04,778][123091] Updated weights for policy 0, policy_version 1045029 (0.0011) [2023-12-26 07:56:04,780][123090] Updated weights for policy 1, policy_version 1037612 (0.0007) [2023-12-26 07:56:04,841][123090] Updated weights for policy 1, policy_version 1037622 (0.0006) [2023-12-26 07:56:04,845][123091] Updated weights for policy 0, policy_version 1045039 (0.0011) [2023-12-26 07:56:04,890][123090] Updated weights for policy 1, policy_version 1037632 (0.0005) [2023-12-26 07:56:05,581][123090] Updated weights for policy 1, policy_version 1037642 (0.0005) [2023-12-26 07:56:05,643][123090] Updated weights for policy 1, policy_version 1037652 (0.0005) [2023-12-26 07:56:05,665][123091] Updated weights for policy 0, policy_version 1045049 (0.0010) [2023-12-26 07:56:05,704][123090] Updated weights for policy 1, policy_version 1037662 (0.0005) [2023-12-26 07:56:05,718][123091] Updated weights for policy 0, policy_version 1045059 (0.0011) [2023-12-26 07:56:05,769][123091] Updated weights for policy 0, policy_version 1045069 (0.0010) [2023-12-26 07:56:06,371][123090] Updated weights for policy 1, policy_version 1037672 (0.0010) [2023-12-26 07:56:06,435][123090] Updated weights for policy 1, policy_version 1037682 (0.0011) [2023-12-26 07:56:06,500][123090] Updated weights for policy 1, policy_version 1037692 (0.0011) [2023-12-26 07:56:06,625][123091] Updated weights for policy 0, policy_version 1045079 (0.0011) [2023-12-26 07:56:06,684][123091] Updated weights for policy 0, policy_version 1045089 (0.0011) [2023-12-26 07:56:06,737][123091] Updated weights for policy 0, policy_version 1045099 (0.0011) [2023-12-26 07:56:07,331][123090] Updated weights for policy 1, policy_version 1037702 (0.0010) [2023-12-26 07:56:07,395][123090] Updated weights for policy 1, policy_version 1037712 (0.0010) [2023-12-26 07:56:07,448][123090] Updated weights for policy 1, policy_version 1037722 (0.0010) [2023-12-26 07:56:07,454][123091] Updated weights for policy 0, policy_version 1045109 (0.0011) [2023-12-26 07:56:07,506][123091] Updated weights for policy 0, policy_version 1045119 (0.0005) [2023-12-26 07:56:07,570][123091] Updated weights for policy 0, policy_version 1045129 (0.0005) [2023-12-26 07:56:08,166][123090] Updated weights for policy 1, policy_version 1037732 (0.0008) [2023-12-26 07:56:08,237][123090] Updated weights for policy 1, policy_version 1037742 (0.0007) [2023-12-26 07:56:08,300][123090] Updated weights for policy 1, policy_version 1037752 (0.0010) [2023-12-26 07:56:08,356][123091] Updated weights for policy 0, policy_version 1045139 (0.0009) [2023-12-26 07:56:08,421][123091] Updated weights for policy 0, policy_version 1045149 (0.0009) [2023-12-26 07:56:08,488][123091] Updated weights for policy 0, policy_version 1045159 (0.0011) [2023-12-26 07:56:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 533233664. Throughput: 0: 8855.4, 1: 8983.3. Samples: 533206764. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:08,785][121949] Avg episode reward: [(0, '6122.325'), (1, '5857.275')] [2023-12-26 07:56:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001037760_265666560.pth... [2023-12-26 07:56:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001045168_267567104.pth... [2023-12-26 07:56:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001036704_265396224.pth [2023-12-26 07:56:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001044144_267304960.pth [2023-12-26 07:56:08,987][123090] Updated weights for policy 1, policy_version 1037762 (0.0008) [2023-12-26 07:56:09,045][123090] Updated weights for policy 1, policy_version 1037772 (0.0006) [2023-12-26 07:56:09,100][123090] Updated weights for policy 1, policy_version 1037782 (0.0006) [2023-12-26 07:56:09,154][123090] Updated weights for policy 1, policy_version 1037792 (0.0005) [2023-12-26 07:56:09,293][123091] Updated weights for policy 0, policy_version 1045169 (0.0011) [2023-12-26 07:56:09,356][123091] Updated weights for policy 0, policy_version 1045179 (0.0010) [2023-12-26 07:56:09,432][123091] Updated weights for policy 0, policy_version 1045189 (0.0013) [2023-12-26 07:56:09,487][123091] Updated weights for policy 0, policy_version 1045199 (0.0010) [2023-12-26 07:56:09,916][123090] Updated weights for policy 1, policy_version 1037802 (0.0008) [2023-12-26 07:56:09,990][123090] Updated weights for policy 1, policy_version 1037812 (0.0009) [2023-12-26 07:56:10,057][123090] Updated weights for policy 1, policy_version 1037822 (0.0009) [2023-12-26 07:56:10,351][123091] Updated weights for policy 0, policy_version 1045209 (0.0010) [2023-12-26 07:56:10,413][123091] Updated weights for policy 0, policy_version 1045219 (0.0009) [2023-12-26 07:56:10,480][123091] Updated weights for policy 0, policy_version 1045229 (0.0009) [2023-12-26 07:56:10,868][123090] Updated weights for policy 1, policy_version 1037832 (0.0009) [2023-12-26 07:56:10,935][123090] Updated weights for policy 1, policy_version 1037842 (0.0011) [2023-12-26 07:56:10,991][123090] Updated weights for policy 1, policy_version 1037852 (0.0009) [2023-12-26 07:56:11,364][123091] Updated weights for policy 0, policy_version 1045239 (0.0010) [2023-12-26 07:56:11,423][123091] Updated weights for policy 0, policy_version 1045249 (0.0009) [2023-12-26 07:56:11,480][123091] Updated weights for policy 0, policy_version 1045259 (0.0010) [2023-12-26 07:56:11,834][123090] Updated weights for policy 1, policy_version 1037862 (0.0008) [2023-12-26 07:56:11,902][123090] Updated weights for policy 1, policy_version 1037872 (0.0010) [2023-12-26 07:56:11,970][123090] Updated weights for policy 1, policy_version 1037882 (0.0008) [2023-12-26 07:56:12,412][123091] Updated weights for policy 0, policy_version 1045269 (0.0010) [2023-12-26 07:56:12,481][123091] Updated weights for policy 0, policy_version 1045279 (0.0009) [2023-12-26 07:56:12,551][123091] Updated weights for policy 0, policy_version 1045289 (0.0010) [2023-12-26 07:56:12,790][123090] Updated weights for policy 1, policy_version 1037892 (0.0005) [2023-12-26 07:56:12,856][123090] Updated weights for policy 1, policy_version 1037902 (0.0006) [2023-12-26 07:56:12,921][123090] Updated weights for policy 1, policy_version 1037912 (0.0009) [2023-12-26 07:56:13,386][123091] Updated weights for policy 0, policy_version 1045299 (0.0008) [2023-12-26 07:56:13,432][123091] Updated weights for policy 0, policy_version 1045309 (0.0005) [2023-12-26 07:56:13,479][123091] Updated weights for policy 0, policy_version 1045319 (0.0005) [2023-12-26 07:56:13,720][123090] Updated weights for policy 1, policy_version 1037922 (0.0008) [2023-12-26 07:56:13,775][123090] Updated weights for policy 1, policy_version 1037932 (0.0005) [2023-12-26 07:56:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 533315584. Throughput: 0: 8822.0, 1: 8965.8. Samples: 533311536. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:13,785][121949] Avg episode reward: [(0, '6023.080'), (1, '5847.089')] [2023-12-26 07:56:13,827][123090] Updated weights for policy 1, policy_version 1037942 (0.0005) [2023-12-26 07:56:13,882][123090] Updated weights for policy 1, policy_version 1037952 (0.0009) [2023-12-26 07:56:14,203][123091] Updated weights for policy 0, policy_version 1045329 (0.0006) [2023-12-26 07:56:14,268][123091] Updated weights for policy 0, policy_version 1045339 (0.0009) [2023-12-26 07:56:14,329][123091] Updated weights for policy 0, policy_version 1045349 (0.0009) [2023-12-26 07:56:14,397][123091] Updated weights for policy 0, policy_version 1045359 (0.0010) [2023-12-26 07:56:14,702][123090] Updated weights for policy 1, policy_version 1037962 (0.0010) [2023-12-26 07:56:14,760][123090] Updated weights for policy 1, policy_version 1037973 (0.0011) [2023-12-26 07:56:15,196][123091] Updated weights for policy 0, policy_version 1045369 (0.0006) [2023-12-26 07:56:15,268][123091] Updated weights for policy 0, policy_version 1045379 (0.0006) [2023-12-26 07:56:15,340][123091] Updated weights for policy 0, policy_version 1045389 (0.0006) [2023-12-26 07:56:15,633][123090] Updated weights for policy 1, policy_version 1037985 (0.0009) [2023-12-26 07:56:15,691][123090] Updated weights for policy 1, policy_version 1037995 (0.0005) [2023-12-26 07:56:15,753][123090] Updated weights for policy 1, policy_version 1038005 (0.0008) [2023-12-26 07:56:15,821][123090] Updated weights for policy 1, policy_version 1038015 (0.0007) [2023-12-26 07:56:15,988][123091] Updated weights for policy 0, policy_version 1045399 (0.0006) [2023-12-26 07:56:16,036][123091] Updated weights for policy 0, policy_version 1045409 (0.0007) [2023-12-26 07:56:16,093][123091] Updated weights for policy 0, policy_version 1045419 (0.0009) [2023-12-26 07:56:16,624][123090] Updated weights for policy 1, policy_version 1038025 (0.0010) [2023-12-26 07:56:16,688][123090] Updated weights for policy 1, policy_version 1038035 (0.0011) [2023-12-26 07:56:16,762][123090] Updated weights for policy 1, policy_version 1038045 (0.0012) [2023-12-26 07:56:16,845][123091] Updated weights for policy 0, policy_version 1045429 (0.0009) [2023-12-26 07:56:16,911][123091] Updated weights for policy 0, policy_version 1045439 (0.0009) [2023-12-26 07:56:16,981][123091] Updated weights for policy 0, policy_version 1045449 (0.0010) [2023-12-26 07:56:17,580][123090] Updated weights for policy 1, policy_version 1038055 (0.0008) [2023-12-26 07:56:17,644][123090] Updated weights for policy 1, policy_version 1038065 (0.0009) [2023-12-26 07:56:17,694][123090] Updated weights for policy 1, policy_version 1038075 (0.0009) [2023-12-26 07:56:17,797][123091] Updated weights for policy 0, policy_version 1045459 (0.0009) [2023-12-26 07:56:17,862][123091] Updated weights for policy 0, policy_version 1045469 (0.0010) [2023-12-26 07:56:17,934][123091] Updated weights for policy 0, policy_version 1045479 (0.0010) [2023-12-26 07:56:18,509][123090] Updated weights for policy 1, policy_version 1038085 (0.0010) [2023-12-26 07:56:18,570][123090] Updated weights for policy 1, policy_version 1038095 (0.0009) [2023-12-26 07:56:18,624][123090] Updated weights for policy 1, policy_version 1038105 (0.0009) [2023-12-26 07:56:18,770][123091] Updated weights for policy 0, policy_version 1045489 (0.0010) [2023-12-26 07:56:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 533405696. Throughput: 0: 8824.8, 1: 9025.0. Samples: 533418044. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:18,785][121949] Avg episode reward: [(0, '6198.975'), (1, '5852.516')] [2023-12-26 07:56:18,822][123091] Updated weights for policy 0, policy_version 1045499 (0.0009) [2023-12-26 07:56:18,885][123091] Updated weights for policy 0, policy_version 1045510 (0.0010) [2023-12-26 07:56:18,945][123091] Updated weights for policy 0, policy_version 1045520 (0.0009) [2023-12-26 07:56:19,483][123090] Updated weights for policy 1, policy_version 1038115 (0.0009) [2023-12-26 07:56:19,554][123090] Updated weights for policy 1, policy_version 1038125 (0.0010) [2023-12-26 07:56:19,607][123090] Updated weights for policy 1, policy_version 1038135 (0.0009) [2023-12-26 07:56:19,791][123091] Updated weights for policy 0, policy_version 1045530 (0.0010) [2023-12-26 07:56:19,862][123091] Updated weights for policy 0, policy_version 1045540 (0.0008) [2023-12-26 07:56:19,939][123091] Updated weights for policy 0, policy_version 1045550 (0.0007) [2023-12-26 07:56:20,520][123090] Updated weights for policy 1, policy_version 1038145 (0.0010) [2023-12-26 07:56:20,591][123090] Updated weights for policy 1, policy_version 1038155 (0.0009) [2023-12-26 07:56:20,659][123090] Updated weights for policy 1, policy_version 1038165 (0.0009) [2023-12-26 07:56:20,707][123091] Updated weights for policy 0, policy_version 1045560 (0.0007) [2023-12-26 07:56:20,728][123090] Updated weights for policy 1, policy_version 1038175 (0.0009) [2023-12-26 07:56:20,767][123091] Updated weights for policy 0, policy_version 1045570 (0.0006) [2023-12-26 07:56:20,828][123091] Updated weights for policy 0, policy_version 1045580 (0.0006) [2023-12-26 07:56:21,643][123090] Updated weights for policy 1, policy_version 1038185 (0.0010) [2023-12-26 07:56:21,652][123091] Updated weights for policy 0, policy_version 1045590 (0.0006) [2023-12-26 07:56:21,708][123090] Updated weights for policy 1, policy_version 1038195 (0.0008) [2023-12-26 07:56:21,721][123091] Updated weights for policy 0, policy_version 1045600 (0.0009) [2023-12-26 07:56:21,776][123090] Updated weights for policy 1, policy_version 1038205 (0.0008) [2023-12-26 07:56:21,783][123091] Updated weights for policy 0, policy_version 1045610 (0.0008) [2023-12-26 07:56:22,659][123091] Updated weights for policy 0, policy_version 1045620 (0.0009) [2023-12-26 07:56:22,670][123090] Updated weights for policy 1, policy_version 1038215 (0.0008) [2023-12-26 07:56:22,723][123091] Updated weights for policy 0, policy_version 1045630 (0.0011) [2023-12-26 07:56:22,741][123090] Updated weights for policy 1, policy_version 1038225 (0.0008) [2023-12-26 07:56:22,794][123091] Updated weights for policy 0, policy_version 1045640 (0.0010) [2023-12-26 07:56:22,810][123090] Updated weights for policy 1, policy_version 1038235 (0.0007) [2023-12-26 07:56:23,555][123090] Updated weights for policy 1, policy_version 1038245 (0.0006) [2023-12-26 07:56:23,609][123090] Updated weights for policy 1, policy_version 1038255 (0.0009) [2023-12-26 07:56:23,648][123091] Updated weights for policy 0, policy_version 1045650 (0.0010) [2023-12-26 07:56:23,666][123090] Updated weights for policy 1, policy_version 1038265 (0.0009) [2023-12-26 07:56:23,697][123091] Updated weights for policy 0, policy_version 1045660 (0.0009) [2023-12-26 07:56:23,753][123091] Updated weights for policy 0, policy_version 1045670 (0.0009) [2023-12-26 07:56:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 533487616. Throughput: 0: 8764.6, 1: 8942.4. Samples: 533467996. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:23,785][121949] Avg episode reward: [(0, '6228.198'), (1, '5849.126')] [2023-12-26 07:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001038272_265797632.pth... [2023-12-26 07:56:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001037216_265527296.pth [2023-12-26 07:56:23,800][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001045680_267698176.pth... [2023-12-26 07:56:23,801][123091] Updated weights for policy 0, policy_version 1045680 (0.0009) [2023-12-26 07:56:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001044656_267436032.pth [2023-12-26 07:56:24,280][123090] Updated weights for policy 1, policy_version 1038275 (0.0009) [2023-12-26 07:56:24,347][123090] Updated weights for policy 1, policy_version 1038285 (0.0005) [2023-12-26 07:56:24,416][123090] Updated weights for policy 1, policy_version 1038295 (0.0010) [2023-12-26 07:56:24,747][123091] Updated weights for policy 0, policy_version 1045690 (0.0010) [2023-12-26 07:56:24,802][123091] Updated weights for policy 0, policy_version 1045700 (0.0010) [2023-12-26 07:56:24,860][123091] Updated weights for policy 0, policy_version 1045711 (0.0010) [2023-12-26 07:56:25,019][123090] Updated weights for policy 1, policy_version 1038305 (0.0010) [2023-12-26 07:56:25,081][123090] Updated weights for policy 1, policy_version 1038315 (0.0006) [2023-12-26 07:56:25,146][123090] Updated weights for policy 1, policy_version 1038325 (0.0005) [2023-12-26 07:56:25,210][123090] Updated weights for policy 1, policy_version 1038335 (0.0005) [2023-12-26 07:56:25,777][123091] Updated weights for policy 0, policy_version 1045721 (0.0006) [2023-12-26 07:56:25,845][123091] Updated weights for policy 0, policy_version 1045731 (0.0005) [2023-12-26 07:56:25,872][123090] Updated weights for policy 1, policy_version 1038345 (0.0007) [2023-12-26 07:56:25,912][123091] Updated weights for policy 0, policy_version 1045741 (0.0008) [2023-12-26 07:56:25,937][123090] Updated weights for policy 1, policy_version 1038355 (0.0008) [2023-12-26 07:56:26,013][123090] Updated weights for policy 1, policy_version 1038365 (0.0005) [2023-12-26 07:56:26,653][123091] Updated weights for policy 0, policy_version 1045751 (0.0009) [2023-12-26 07:56:26,715][123091] Updated weights for policy 0, policy_version 1045761 (0.0009) [2023-12-26 07:56:26,765][123091] Updated weights for policy 0, policy_version 1045771 (0.0009) [2023-12-26 07:56:26,773][123090] Updated weights for policy 1, policy_version 1038375 (0.0009) [2023-12-26 07:56:26,825][123090] Updated weights for policy 1, policy_version 1038385 (0.0010) [2023-12-26 07:56:26,879][123090] Updated weights for policy 1, policy_version 1038395 (0.0008) [2023-12-26 07:56:27,528][123091] Updated weights for policy 0, policy_version 1045781 (0.0009) [2023-12-26 07:56:27,590][123091] Updated weights for policy 0, policy_version 1045791 (0.0008) [2023-12-26 07:56:27,653][123091] Updated weights for policy 0, policy_version 1045801 (0.0008) [2023-12-26 07:56:27,668][123090] Updated weights for policy 1, policy_version 1038405 (0.0008) [2023-12-26 07:56:27,727][123090] Updated weights for policy 1, policy_version 1038415 (0.0010) [2023-12-26 07:56:27,774][123090] Updated weights for policy 1, policy_version 1038425 (0.0010) [2023-12-26 07:56:28,425][123091] Updated weights for policy 0, policy_version 1045811 (0.0006) [2023-12-26 07:56:28,489][123091] Updated weights for policy 0, policy_version 1045821 (0.0007) [2023-12-26 07:56:28,555][123091] Updated weights for policy 0, policy_version 1045831 (0.0008) [2023-12-26 07:56:28,631][123090] Updated weights for policy 1, policy_version 1038435 (0.0010) [2023-12-26 07:56:28,690][123090] Updated weights for policy 1, policy_version 1038445 (0.0010) [2023-12-26 07:56:28,748][123090] Updated weights for policy 1, policy_version 1038455 (0.0010) [2023-12-26 07:56:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 533577728. Throughput: 0: 8708.2, 1: 9051.4. Samples: 533574600. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:28,784][121949] Avg episode reward: [(0, '6311.274'), (1, '5849.447')] [2023-12-26 07:56:29,200][123091] Updated weights for policy 0, policy_version 1045841 (0.0010) [2023-12-26 07:56:29,265][123091] Updated weights for policy 0, policy_version 1045851 (0.0008) [2023-12-26 07:56:29,317][123091] Updated weights for policy 0, policy_version 1045861 (0.0008) [2023-12-26 07:56:29,387][123091] Updated weights for policy 0, policy_version 1045871 (0.0008) [2023-12-26 07:56:29,599][123090] Updated weights for policy 1, policy_version 1038465 (0.0010) [2023-12-26 07:56:29,662][123090] Updated weights for policy 1, policy_version 1038475 (0.0010) [2023-12-26 07:56:29,721][123090] Updated weights for policy 1, policy_version 1038485 (0.0010) [2023-12-26 07:56:29,788][123090] Updated weights for policy 1, policy_version 1038495 (0.0011) [2023-12-26 07:56:30,096][123091] Updated weights for policy 0, policy_version 1045881 (0.0008) [2023-12-26 07:56:30,158][123091] Updated weights for policy 0, policy_version 1045891 (0.0010) [2023-12-26 07:56:30,225][123091] Updated weights for policy 0, policy_version 1045901 (0.0010) [2023-12-26 07:56:30,597][123090] Updated weights for policy 1, policy_version 1038505 (0.0006) [2023-12-26 07:56:30,660][123090] Updated weights for policy 1, policy_version 1038515 (0.0006) [2023-12-26 07:56:30,712][123090] Updated weights for policy 1, policy_version 1038525 (0.0005) [2023-12-26 07:56:30,957][123091] Updated weights for policy 0, policy_version 1045911 (0.0007) [2023-12-26 07:56:31,013][123091] Updated weights for policy 0, policy_version 1045921 (0.0005) [2023-12-26 07:56:31,086][123091] Updated weights for policy 0, policy_version 1045931 (0.0009) [2023-12-26 07:56:31,422][123090] Updated weights for policy 1, policy_version 1038536 (0.0007) [2023-12-26 07:56:31,477][123090] Updated weights for policy 1, policy_version 1038546 (0.0009) [2023-12-26 07:56:31,549][123090] Updated weights for policy 1, policy_version 1038556 (0.0010) [2023-12-26 07:56:31,887][123091] Updated weights for policy 0, policy_version 1045941 (0.0008) [2023-12-26 07:56:31,946][123091] Updated weights for policy 0, policy_version 1045951 (0.0006) [2023-12-26 07:56:32,008][123091] Updated weights for policy 0, policy_version 1045961 (0.0006) [2023-12-26 07:56:32,362][123090] Updated weights for policy 1, policy_version 1038566 (0.0007) [2023-12-26 07:56:32,424][123090] Updated weights for policy 1, policy_version 1038576 (0.0008) [2023-12-26 07:56:32,489][123090] Updated weights for policy 1, policy_version 1038586 (0.0008) [2023-12-26 07:56:32,785][123091] Updated weights for policy 0, policy_version 1045971 (0.0009) [2023-12-26 07:56:32,857][123091] Updated weights for policy 0, policy_version 1045981 (0.0011) [2023-12-26 07:56:32,929][123091] Updated weights for policy 0, policy_version 1045991 (0.0011) [2023-12-26 07:56:33,317][123090] Updated weights for policy 1, policy_version 1038596 (0.0008) [2023-12-26 07:56:33,390][123090] Updated weights for policy 1, policy_version 1038606 (0.0009) [2023-12-26 07:56:33,459][123090] Updated weights for policy 1, policy_version 1038616 (0.0009) [2023-12-26 07:56:33,739][123091] Updated weights for policy 0, policy_version 1046001 (0.0011) [2023-12-26 07:56:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 533667840. Throughput: 0: 8765.0, 1: 8970.2. Samples: 533682104. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:33,785][121949] Avg episode reward: [(0, '6296.616'), (1, '5817.862')] [2023-12-26 07:56:33,797][123091] Updated weights for policy 0, policy_version 1046011 (0.0010) [2023-12-26 07:56:33,852][123091] Updated weights for policy 0, policy_version 1046021 (0.0010) [2023-12-26 07:56:33,910][123091] Updated weights for policy 0, policy_version 1046031 (0.0010) [2023-12-26 07:56:34,209][123090] Updated weights for policy 1, policy_version 1038626 (0.0010) [2023-12-26 07:56:34,286][123090] Updated weights for policy 1, policy_version 1038636 (0.0006) [2023-12-26 07:56:34,350][123090] Updated weights for policy 1, policy_version 1038646 (0.0006) [2023-12-26 07:56:34,415][123090] Updated weights for policy 1, policy_version 1038656 (0.0009) [2023-12-26 07:56:34,704][123091] Updated weights for policy 0, policy_version 1046041 (0.0011) [2023-12-26 07:56:34,774][123091] Updated weights for policy 0, policy_version 1046051 (0.0010) [2023-12-26 07:56:34,850][123091] Updated weights for policy 0, policy_version 1046061 (0.0011) [2023-12-26 07:56:35,213][123090] Updated weights for policy 1, policy_version 1038666 (0.0009) [2023-12-26 07:56:35,282][123090] Updated weights for policy 1, policy_version 1038676 (0.0009) [2023-12-26 07:56:35,348][123090] Updated weights for policy 1, policy_version 1038686 (0.0009) [2023-12-26 07:56:35,639][123091] Updated weights for policy 0, policy_version 1046071 (0.0011) [2023-12-26 07:56:35,694][123091] Updated weights for policy 0, policy_version 1046081 (0.0011) [2023-12-26 07:56:35,757][123091] Updated weights for policy 0, policy_version 1046091 (0.0011) [2023-12-26 07:56:36,177][123090] Updated weights for policy 1, policy_version 1038696 (0.0009) [2023-12-26 07:56:36,243][123090] Updated weights for policy 1, policy_version 1038706 (0.0009) [2023-12-26 07:56:36,306][123090] Updated weights for policy 1, policy_version 1038716 (0.0009) [2023-12-26 07:56:36,614][123091] Updated weights for policy 0, policy_version 1046101 (0.0011) [2023-12-26 07:56:36,674][123091] Updated weights for policy 0, policy_version 1046111 (0.0010) [2023-12-26 07:56:36,740][123091] Updated weights for policy 0, policy_version 1046121 (0.0010) [2023-12-26 07:56:37,151][123090] Updated weights for policy 1, policy_version 1038726 (0.0009) [2023-12-26 07:56:37,221][123090] Updated weights for policy 1, policy_version 1038736 (0.0009) [2023-12-26 07:56:37,280][123090] Updated weights for policy 1, policy_version 1038746 (0.0008) [2023-12-26 07:56:37,552][123091] Updated weights for policy 0, policy_version 1046131 (0.0008) [2023-12-26 07:56:37,612][123091] Updated weights for policy 0, policy_version 1046141 (0.0011) [2023-12-26 07:56:37,679][123091] Updated weights for policy 0, policy_version 1046151 (0.0011) [2023-12-26 07:56:38,065][123090] Updated weights for policy 1, policy_version 1038756 (0.0006) [2023-12-26 07:56:38,115][123090] Updated weights for policy 1, policy_version 1038766 (0.0005) [2023-12-26 07:56:38,174][123090] Updated weights for policy 1, policy_version 1038776 (0.0008) [2023-12-26 07:56:38,512][123091] Updated weights for policy 0, policy_version 1046161 (0.0010) [2023-12-26 07:56:38,584][123091] Updated weights for policy 0, policy_version 1046171 (0.0008) [2023-12-26 07:56:38,655][123091] Updated weights for policy 0, policy_version 1046181 (0.0008) [2023-12-26 07:56:38,722][123091] Updated weights for policy 0, policy_version 1046191 (0.0008) [2023-12-26 07:56:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 533757952. Throughput: 0: 8747.0, 1: 8984.9. Samples: 533733760. Policy #0 lag: (min: 31.0, avg: 43.4, max: 63.0) [2023-12-26 07:56:38,785][121949] Avg episode reward: [(0, '6181.042'), (1, '5730.437')] [2023-12-26 07:56:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001046192_267829248.pth... [2023-12-26 07:56:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001038784_265928704.pth... [2023-12-26 07:56:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001045168_267567104.pth [2023-12-26 07:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001037760_265666560.pth [2023-12-26 07:56:39,015][123090] Updated weights for policy 1, policy_version 1038786 (0.0008) [2023-12-26 07:56:39,086][123090] Updated weights for policy 1, policy_version 1038796 (0.0006) [2023-12-26 07:56:39,157][123090] Updated weights for policy 1, policy_version 1038806 (0.0005) [2023-12-26 07:56:39,226][123090] Updated weights for policy 1, policy_version 1038816 (0.0006) [2023-12-26 07:56:39,414][123091] Updated weights for policy 0, policy_version 1046201 (0.0010) [2023-12-26 07:56:39,486][123091] Updated weights for policy 0, policy_version 1046211 (0.0010) [2023-12-26 07:56:39,548][123091] Updated weights for policy 0, policy_version 1046221 (0.0009) [2023-12-26 07:56:39,984][123090] Updated weights for policy 1, policy_version 1038826 (0.0009) [2023-12-26 07:56:40,041][123090] Updated weights for policy 1, policy_version 1038836 (0.0010) [2023-12-26 07:56:40,103][123090] Updated weights for policy 1, policy_version 1038846 (0.0010) [2023-12-26 07:56:40,343][123091] Updated weights for policy 0, policy_version 1046231 (0.0010) [2023-12-26 07:56:40,417][123091] Updated weights for policy 0, policy_version 1046241 (0.0008) [2023-12-26 07:56:40,481][123091] Updated weights for policy 0, policy_version 1046251 (0.0009) [2023-12-26 07:56:40,959][123090] Updated weights for policy 1, policy_version 1038856 (0.0006) [2023-12-26 07:56:41,029][123090] Updated weights for policy 1, policy_version 1038866 (0.0006) [2023-12-26 07:56:41,103][123090] Updated weights for policy 1, policy_version 1038876 (0.0008) [2023-12-26 07:56:41,286][123091] Updated weights for policy 0, policy_version 1046261 (0.0010) [2023-12-26 07:56:41,338][123091] Updated weights for policy 0, policy_version 1046271 (0.0010) [2023-12-26 07:56:41,415][123091] Updated weights for policy 0, policy_version 1046281 (0.0009) [2023-12-26 07:56:41,904][123090] Updated weights for policy 1, policy_version 1038886 (0.0010) [2023-12-26 07:56:41,969][123090] Updated weights for policy 1, policy_version 1038896 (0.0010) [2023-12-26 07:56:42,028][123090] Updated weights for policy 1, policy_version 1038906 (0.0010) [2023-12-26 07:56:42,213][123091] Updated weights for policy 0, policy_version 1046291 (0.0008) [2023-12-26 07:56:42,286][123091] Updated weights for policy 0, policy_version 1046301 (0.0006) [2023-12-26 07:56:42,358][123091] Updated weights for policy 0, policy_version 1046311 (0.0009) [2023-12-26 07:56:42,881][123090] Updated weights for policy 1, policy_version 1038916 (0.0008) [2023-12-26 07:56:42,953][123090] Updated weights for policy 1, policy_version 1038926 (0.0009) [2023-12-26 07:56:42,994][123091] Updated weights for policy 0, policy_version 1046321 (0.0006) [2023-12-26 07:56:43,014][123090] Updated weights for policy 1, policy_version 1038936 (0.0009) [2023-12-26 07:56:43,051][123091] Updated weights for policy 0, policy_version 1046331 (0.0010) [2023-12-26 07:56:43,100][123091] Updated weights for policy 0, policy_version 1046341 (0.0009) [2023-12-26 07:56:43,164][123091] Updated weights for policy 0, policy_version 1046351 (0.0009) [2023-12-26 07:56:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 533839872. Throughput: 0: 8677.2, 1: 8838.3. Samples: 533837796. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:56:43,785][121949] Avg episode reward: [(0, '6072.958'), (1, '5456.734')] [2023-12-26 07:56:43,834][123090] Updated weights for policy 1, policy_version 1038946 (0.0008) [2023-12-26 07:56:43,883][123090] Updated weights for policy 1, policy_version 1038956 (0.0010) [2023-12-26 07:56:43,939][123090] Updated weights for policy 1, policy_version 1038966 (0.0010) [2023-12-26 07:56:43,991][123090] Updated weights for policy 1, policy_version 1038976 (0.0010) [2023-12-26 07:56:44,008][123091] Updated weights for policy 0, policy_version 1046361 (0.0006) [2023-12-26 07:56:44,065][123091] Updated weights for policy 0, policy_version 1046371 (0.0007) [2023-12-26 07:56:44,119][123091] Updated weights for policy 0, policy_version 1046381 (0.0008) [2023-12-26 07:56:44,854][123090] Updated weights for policy 1, policy_version 1038986 (0.0009) [2023-12-26 07:56:44,859][123091] Updated weights for policy 0, policy_version 1046391 (0.0006) [2023-12-26 07:56:44,919][123090] Updated weights for policy 1, policy_version 1038996 (0.0010) [2023-12-26 07:56:44,922][123091] Updated weights for policy 0, policy_version 1046401 (0.0006) [2023-12-26 07:56:44,974][123090] Updated weights for policy 1, policy_version 1039006 (0.0010) [2023-12-26 07:56:44,980][123091] Updated weights for policy 0, policy_version 1046411 (0.0007) [2023-12-26 07:56:45,805][123091] Updated weights for policy 0, policy_version 1046421 (0.0007) [2023-12-26 07:56:45,811][123090] Updated weights for policy 1, policy_version 1039016 (0.0011) [2023-12-26 07:56:45,862][123091] Updated weights for policy 0, policy_version 1046431 (0.0007) [2023-12-26 07:56:45,867][123090] Updated weights for policy 1, policy_version 1039026 (0.0010) [2023-12-26 07:56:45,917][123091] Updated weights for policy 0, policy_version 1046441 (0.0006) [2023-12-26 07:56:45,930][123090] Updated weights for policy 1, policy_version 1039036 (0.0010) [2023-12-26 07:56:46,719][123091] Updated weights for policy 0, policy_version 1046451 (0.0006) [2023-12-26 07:56:46,751][123090] Updated weights for policy 1, policy_version 1039046 (0.0008) [2023-12-26 07:56:46,786][123091] Updated weights for policy 0, policy_version 1046461 (0.0005) [2023-12-26 07:56:46,809][123090] Updated weights for policy 1, policy_version 1039056 (0.0005) [2023-12-26 07:56:46,839][123091] Updated weights for policy 0, policy_version 1046471 (0.0005) [2023-12-26 07:56:46,865][123090] Updated weights for policy 1, policy_version 1039066 (0.0005) [2023-12-26 07:56:47,582][123090] Updated weights for policy 1, policy_version 1039076 (0.0006) [2023-12-26 07:56:47,596][123091] Updated weights for policy 0, policy_version 1046481 (0.0007) [2023-12-26 07:56:47,653][123090] Updated weights for policy 1, policy_version 1039086 (0.0005) [2023-12-26 07:56:47,668][123091] Updated weights for policy 0, policy_version 1046491 (0.0006) [2023-12-26 07:56:47,724][123090] Updated weights for policy 1, policy_version 1039096 (0.0006) [2023-12-26 07:56:47,740][123091] Updated weights for policy 0, policy_version 1046501 (0.0005) [2023-12-26 07:56:47,806][123091] Updated weights for policy 0, policy_version 1046511 (0.0006) [2023-12-26 07:56:48,333][123090] Updated weights for policy 1, policy_version 1039106 (0.0007) [2023-12-26 07:56:48,403][123090] Updated weights for policy 1, policy_version 1039116 (0.0007) [2023-12-26 07:56:48,464][123090] Updated weights for policy 1, policy_version 1039126 (0.0010) [2023-12-26 07:56:48,485][123091] Updated weights for policy 0, policy_version 1046521 (0.0008) [2023-12-26 07:56:48,533][123090] Updated weights for policy 1, policy_version 1039136 (0.0011) [2023-12-26 07:56:48,547][123091] Updated weights for policy 0, policy_version 1046531 (0.0007) [2023-12-26 07:56:48,618][123091] Updated weights for policy 0, policy_version 1046541 (0.0005) [2023-12-26 07:56:48,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 533938176. Throughput: 0: 8784.9, 1: 8830.2. Samples: 533945400. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:56:48,786][121949] Avg episode reward: [(0, '6100.449'), (1, '5400.122')] [2023-12-26 07:56:49,320][123091] Updated weights for policy 0, policy_version 1046551 (0.0006) [2023-12-26 07:56:49,336][123090] Updated weights for policy 1, policy_version 1039146 (0.0008) [2023-12-26 07:56:49,390][123091] Updated weights for policy 0, policy_version 1046561 (0.0008) [2023-12-26 07:56:49,406][123090] Updated weights for policy 1, policy_version 1039156 (0.0010) [2023-12-26 07:56:49,444][123091] Updated weights for policy 0, policy_version 1046571 (0.0009) [2023-12-26 07:56:49,477][123090] Updated weights for policy 1, policy_version 1039166 (0.0007) [2023-12-26 07:56:50,182][123090] Updated weights for policy 1, policy_version 1039176 (0.0006) [2023-12-26 07:56:50,254][123090] Updated weights for policy 1, policy_version 1039186 (0.0006) [2023-12-26 07:56:50,307][123091] Updated weights for policy 0, policy_version 1046581 (0.0008) [2023-12-26 07:56:50,319][123090] Updated weights for policy 1, policy_version 1039196 (0.0005) [2023-12-26 07:56:50,379][123091] Updated weights for policy 0, policy_version 1046591 (0.0006) [2023-12-26 07:56:50,452][123091] Updated weights for policy 0, policy_version 1046601 (0.0006) [2023-12-26 07:56:50,940][123090] Updated weights for policy 1, policy_version 1039206 (0.0009) [2023-12-26 07:56:51,012][123090] Updated weights for policy 1, policy_version 1039216 (0.0007) [2023-12-26 07:56:51,080][123090] Updated weights for policy 1, policy_version 1039226 (0.0008) [2023-12-26 07:56:51,165][123091] Updated weights for policy 0, policy_version 1046611 (0.0006) [2023-12-26 07:56:51,217][123091] Updated weights for policy 0, policy_version 1046621 (0.0008) [2023-12-26 07:56:51,284][123091] Updated weights for policy 0, policy_version 1046631 (0.0008) [2023-12-26 07:56:51,848][123090] Updated weights for policy 1, policy_version 1039236 (0.0008) [2023-12-26 07:56:51,902][123090] Updated weights for policy 1, policy_version 1039246 (0.0009) [2023-12-26 07:56:51,966][123090] Updated weights for policy 1, policy_version 1039256 (0.0010) [2023-12-26 07:56:52,174][123091] Updated weights for policy 0, policy_version 1046641 (0.0008) [2023-12-26 07:56:52,240][123091] Updated weights for policy 0, policy_version 1046651 (0.0009) [2023-12-26 07:56:52,304][123091] Updated weights for policy 0, policy_version 1046661 (0.0010) [2023-12-26 07:56:52,371][123091] Updated weights for policy 0, policy_version 1046671 (0.0009) [2023-12-26 07:56:52,810][123090] Updated weights for policy 1, policy_version 1039266 (0.0009) [2023-12-26 07:56:52,861][123090] Updated weights for policy 1, policy_version 1039276 (0.0010) [2023-12-26 07:56:52,931][123090] Updated weights for policy 1, policy_version 1039286 (0.0010) [2023-12-26 07:56:52,998][123090] Updated weights for policy 1, policy_version 1039296 (0.0010) [2023-12-26 07:56:53,216][123091] Updated weights for policy 0, policy_version 1046681 (0.0009) [2023-12-26 07:56:53,269][123091] Updated weights for policy 0, policy_version 1046692 (0.0010) [2023-12-26 07:56:53,330][123091] Updated weights for policy 0, policy_version 1046702 (0.0009) [2023-12-26 07:56:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 534020096. Throughput: 0: 8809.1, 1: 8836.4. Samples: 534000808. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:56:53,785][121949] Avg episode reward: [(0, '6076.033'), (1, '5636.879')] [2023-12-26 07:56:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001046704_267960320.pth... [2023-12-26 07:56:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001045680_267698176.pth [2023-12-26 07:56:53,832][123090] Updated weights for policy 1, policy_version 1039306 (0.0009) [2023-12-26 07:56:53,897][123090] Updated weights for policy 1, policy_version 1039316 (0.0008) [2023-12-26 07:56:53,969][123090] Updated weights for policy 1, policy_version 1039326 (0.0007) [2023-12-26 07:56:53,977][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001039328_266067968.pth... [2023-12-26 07:56:53,980][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001038272_265797632.pth [2023-12-26 07:56:54,101][123091] Updated weights for policy 0, policy_version 1046712 (0.0006) [2023-12-26 07:56:54,149][123091] Updated weights for policy 0, policy_version 1046722 (0.0005) [2023-12-26 07:56:54,206][123091] Updated weights for policy 0, policy_version 1046732 (0.0006) [2023-12-26 07:56:54,758][123090] Updated weights for policy 1, policy_version 1039336 (0.0007) [2023-12-26 07:56:54,831][123090] Updated weights for policy 1, policy_version 1039346 (0.0005) [2023-12-26 07:56:54,834][123091] Updated weights for policy 0, policy_version 1046742 (0.0005) [2023-12-26 07:56:54,886][123091] Updated weights for policy 0, policy_version 1046752 (0.0008) [2023-12-26 07:56:54,897][123090] Updated weights for policy 1, policy_version 1039356 (0.0005) [2023-12-26 07:56:54,945][123091] Updated weights for policy 0, policy_version 1046762 (0.0006) [2023-12-26 07:56:55,633][123091] Updated weights for policy 0, policy_version 1046772 (0.0008) [2023-12-26 07:56:55,676][123090] Updated weights for policy 1, policy_version 1039366 (0.0005) [2023-12-26 07:56:55,696][123091] Updated weights for policy 0, policy_version 1046782 (0.0009) [2023-12-26 07:56:55,731][123090] Updated weights for policy 1, policy_version 1039376 (0.0005) [2023-12-26 07:56:55,742][123091] Updated weights for policy 0, policy_version 1046792 (0.0008) [2023-12-26 07:56:55,800][123090] Updated weights for policy 1, policy_version 1039386 (0.0005) [2023-12-26 07:56:56,421][123090] Updated weights for policy 1, policy_version 1039396 (0.0005) [2023-12-26 07:56:56,456][123091] Updated weights for policy 0, policy_version 1046802 (0.0006) [2023-12-26 07:56:56,479][123090] Updated weights for policy 1, policy_version 1039406 (0.0005) [2023-12-26 07:56:56,514][123091] Updated weights for policy 0, policy_version 1046812 (0.0009) [2023-12-26 07:56:56,545][123090] Updated weights for policy 1, policy_version 1039416 (0.0005) [2023-12-26 07:56:56,567][123091] Updated weights for policy 0, policy_version 1046822 (0.0009) [2023-12-26 07:56:56,628][123091] Updated weights for policy 0, policy_version 1046832 (0.0009) [2023-12-26 07:56:57,336][123090] Updated weights for policy 1, policy_version 1039426 (0.0006) [2023-12-26 07:56:57,395][123090] Updated weights for policy 1, policy_version 1039436 (0.0009) [2023-12-26 07:56:57,407][123091] Updated weights for policy 0, policy_version 1046842 (0.0008) [2023-12-26 07:56:57,463][123091] Updated weights for policy 0, policy_version 1046852 (0.0005) [2023-12-26 07:56:57,464][123090] Updated weights for policy 1, policy_version 1039446 (0.0008) [2023-12-26 07:56:57,511][123090] Updated weights for policy 1, policy_version 1039456 (0.0008) [2023-12-26 07:56:57,519][123091] Updated weights for policy 0, policy_version 1046862 (0.0005) [2023-12-26 07:56:58,203][123091] Updated weights for policy 0, policy_version 1046872 (0.0007) [2023-12-26 07:56:58,213][123090] Updated weights for policy 1, policy_version 1039466 (0.0007) [2023-12-26 07:56:58,267][123091] Updated weights for policy 0, policy_version 1046882 (0.0007) [2023-12-26 07:56:58,282][123090] Updated weights for policy 1, policy_version 1039476 (0.0008) [2023-12-26 07:56:58,334][123091] Updated weights for policy 0, policy_version 1046892 (0.0008) [2023-12-26 07:56:58,345][123090] Updated weights for policy 1, policy_version 1039486 (0.0009) [2023-12-26 07:56:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 534118400. Throughput: 0: 8932.4, 1: 8815.8. Samples: 534110208. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:56:58,785][121949] Avg episode reward: [(0, '6228.046'), (1, '5353.551')] [2023-12-26 07:56:59,104][123091] Updated weights for policy 0, policy_version 1046902 (0.0008) [2023-12-26 07:56:59,163][123091] Updated weights for policy 0, policy_version 1046912 (0.0007) [2023-12-26 07:56:59,201][123090] Updated weights for policy 1, policy_version 1039496 (0.0008) [2023-12-26 07:56:59,217][123091] Updated weights for policy 0, policy_version 1046922 (0.0007) [2023-12-26 07:56:59,282][123090] Updated weights for policy 1, policy_version 1039506 (0.0008) [2023-12-26 07:56:59,340][123090] Updated weights for policy 1, policy_version 1039516 (0.0009) [2023-12-26 07:57:00,031][123091] Updated weights for policy 0, policy_version 1046932 (0.0008) [2023-12-26 07:57:00,089][123091] Updated weights for policy 0, policy_version 1046942 (0.0008) [2023-12-26 07:57:00,153][123091] Updated weights for policy 0, policy_version 1046952 (0.0008) [2023-12-26 07:57:00,207][123090] Updated weights for policy 1, policy_version 1039526 (0.0008) [2023-12-26 07:57:00,262][123090] Updated weights for policy 1, policy_version 1039537 (0.0009) [2023-12-26 07:57:00,313][123090] Updated weights for policy 1, policy_version 1039547 (0.0009) [2023-12-26 07:57:01,014][123091] Updated weights for policy 0, policy_version 1046962 (0.0008) [2023-12-26 07:57:01,055][123090] Updated weights for policy 1, policy_version 1039557 (0.0009) [2023-12-26 07:57:01,083][123091] Updated weights for policy 0, policy_version 1046972 (0.0008) [2023-12-26 07:57:01,118][123090] Updated weights for policy 1, policy_version 1039567 (0.0008) [2023-12-26 07:57:01,151][123091] Updated weights for policy 0, policy_version 1046982 (0.0007) [2023-12-26 07:57:01,183][123090] Updated weights for policy 1, policy_version 1039577 (0.0008) [2023-12-26 07:57:01,218][123091] Updated weights for policy 0, policy_version 1046992 (0.0006) [2023-12-26 07:57:01,893][123091] Updated weights for policy 0, policy_version 1047002 (0.0010) [2023-12-26 07:57:01,946][123090] Updated weights for policy 1, policy_version 1039587 (0.0008) [2023-12-26 07:57:01,959][123091] Updated weights for policy 0, policy_version 1047012 (0.0010) [2023-12-26 07:57:02,012][123090] Updated weights for policy 1, policy_version 1039597 (0.0009) [2023-12-26 07:57:02,020][123091] Updated weights for policy 0, policy_version 1047022 (0.0007) [2023-12-26 07:57:02,074][123090] Updated weights for policy 1, policy_version 1039607 (0.0010) [2023-12-26 07:57:02,871][123091] Updated weights for policy 0, policy_version 1047032 (0.0009) [2023-12-26 07:57:02,882][123090] Updated weights for policy 1, policy_version 1039617 (0.0009) [2023-12-26 07:57:02,933][123091] Updated weights for policy 0, policy_version 1047042 (0.0007) [2023-12-26 07:57:02,940][123090] Updated weights for policy 1, policy_version 1039627 (0.0006) [2023-12-26 07:57:02,990][123091] Updated weights for policy 0, policy_version 1047052 (0.0009) [2023-12-26 07:57:02,992][123090] Updated weights for policy 1, policy_version 1039637 (0.0007) [2023-12-26 07:57:03,053][123090] Updated weights for policy 1, policy_version 1039647 (0.0007) [2023-12-26 07:57:03,776][123091] Updated weights for policy 0, policy_version 1047062 (0.0007) [2023-12-26 07:57:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 534200320. Throughput: 0: 8911.0, 1: 8842.2. Samples: 534216936. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:03,784][121949] Avg episode reward: [(0, '6142.098'), (1, '5435.136')] [2023-12-26 07:57:03,833][123091] Updated weights for policy 0, policy_version 1047072 (0.0008) [2023-12-26 07:57:03,866][123090] Updated weights for policy 1, policy_version 1039657 (0.0011) [2023-12-26 07:57:03,885][123091] Updated weights for policy 0, policy_version 1047082 (0.0008) [2023-12-26 07:57:03,922][123090] Updated weights for policy 1, policy_version 1039667 (0.0010) [2023-12-26 07:57:03,981][123090] Updated weights for policy 1, policy_version 1039677 (0.0010) [2023-12-26 07:57:04,671][123091] Updated weights for policy 0, policy_version 1047092 (0.0005) [2023-12-26 07:57:04,735][123091] Updated weights for policy 0, policy_version 1047102 (0.0005) [2023-12-26 07:57:04,807][123091] Updated weights for policy 0, policy_version 1047112 (0.0006) [2023-12-26 07:57:04,826][123090] Updated weights for policy 1, policy_version 1039687 (0.0007) [2023-12-26 07:57:04,887][123090] Updated weights for policy 1, policy_version 1039697 (0.0005) [2023-12-26 07:57:04,954][123090] Updated weights for policy 1, policy_version 1039707 (0.0005) [2023-12-26 07:57:05,613][123091] Updated weights for policy 0, policy_version 1047122 (0.0006) [2023-12-26 07:57:05,668][123091] Updated weights for policy 0, policy_version 1047132 (0.0009) [2023-12-26 07:57:05,675][123090] Updated weights for policy 1, policy_version 1039717 (0.0008) [2023-12-26 07:57:05,733][123091] Updated weights for policy 0, policy_version 1047142 (0.0009) [2023-12-26 07:57:05,739][123090] Updated weights for policy 1, policy_version 1039727 (0.0005) [2023-12-26 07:57:05,796][123090] Updated weights for policy 1, policy_version 1039737 (0.0005) [2023-12-26 07:57:05,798][123091] Updated weights for policy 0, policy_version 1047152 (0.0008) [2023-12-26 07:57:06,480][123090] Updated weights for policy 1, policy_version 1039747 (0.0007) [2023-12-26 07:57:06,553][123090] Updated weights for policy 1, policy_version 1039757 (0.0011) [2023-12-26 07:57:06,587][123091] Updated weights for policy 0, policy_version 1047162 (0.0011) [2023-12-26 07:57:06,622][123090] Updated weights for policy 1, policy_version 1039767 (0.0010) [2023-12-26 07:57:06,656][123091] Updated weights for policy 0, policy_version 1047172 (0.0011) [2023-12-26 07:57:06,722][123091] Updated weights for policy 0, policy_version 1047182 (0.0011) [2023-12-26 07:57:07,336][123090] Updated weights for policy 1, policy_version 1039777 (0.0008) [2023-12-26 07:57:07,399][123090] Updated weights for policy 1, policy_version 1039787 (0.0006) [2023-12-26 07:57:07,459][123090] Updated weights for policy 1, policy_version 1039797 (0.0006) [2023-12-26 07:57:07,498][123091] Updated weights for policy 0, policy_version 1047192 (0.0010) [2023-12-26 07:57:07,509][123090] Updated weights for policy 1, policy_version 1039807 (0.0005) [2023-12-26 07:57:07,557][123091] Updated weights for policy 0, policy_version 1047202 (0.0008) [2023-12-26 07:57:07,605][123091] Updated weights for policy 0, policy_version 1047212 (0.0005) [2023-12-26 07:57:08,259][123090] Updated weights for policy 1, policy_version 1039817 (0.0010) [2023-12-26 07:57:08,308][123090] Updated weights for policy 1, policy_version 1039827 (0.0010) [2023-12-26 07:57:08,374][123090] Updated weights for policy 1, policy_version 1039837 (0.0011) [2023-12-26 07:57:08,405][123091] Updated weights for policy 0, policy_version 1047222 (0.0009) [2023-12-26 07:57:08,469][123091] Updated weights for policy 0, policy_version 1047232 (0.0011) [2023-12-26 07:57:08,527][123091] Updated weights for policy 0, policy_version 1047242 (0.0010) [2023-12-26 07:57:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 534298624. Throughput: 0: 8927.5, 1: 8939.0. Samples: 534271988. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:08,785][121949] Avg episode reward: [(0, '6083.124'), (1, '5516.047')] [2023-12-26 07:57:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001047248_268099584.pth... [2023-12-26 07:57:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001039840_266199040.pth... [2023-12-26 07:57:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001046192_267829248.pth [2023-12-26 07:57:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001038784_265928704.pth [2023-12-26 07:57:09,184][123090] Updated weights for policy 1, policy_version 1039847 (0.0007) [2023-12-26 07:57:09,251][123090] Updated weights for policy 1, policy_version 1039857 (0.0008) [2023-12-26 07:57:09,312][123090] Updated weights for policy 1, policy_version 1039867 (0.0005) [2023-12-26 07:57:09,377][123091] Updated weights for policy 0, policy_version 1047252 (0.0010) [2023-12-26 07:57:09,453][123091] Updated weights for policy 0, policy_version 1047262 (0.0010) [2023-12-26 07:57:09,525][123091] Updated weights for policy 0, policy_version 1047272 (0.0010) [2023-12-26 07:57:10,113][123090] Updated weights for policy 1, policy_version 1039877 (0.0009) [2023-12-26 07:57:10,178][123090] Updated weights for policy 1, policy_version 1039887 (0.0008) [2023-12-26 07:57:10,249][123090] Updated weights for policy 1, policy_version 1039897 (0.0011) [2023-12-26 07:57:10,381][123091] Updated weights for policy 0, policy_version 1047282 (0.0010) [2023-12-26 07:57:10,441][123091] Updated weights for policy 0, policy_version 1047292 (0.0009) [2023-12-26 07:57:10,505][123091] Updated weights for policy 0, policy_version 1047302 (0.0008) [2023-12-26 07:57:10,566][123091] Updated weights for policy 0, policy_version 1047312 (0.0009) [2023-12-26 07:57:11,083][123090] Updated weights for policy 1, policy_version 1039907 (0.0011) [2023-12-26 07:57:11,152][123090] Updated weights for policy 1, policy_version 1039917 (0.0011) [2023-12-26 07:57:11,223][123090] Updated weights for policy 1, policy_version 1039927 (0.0013) [2023-12-26 07:57:11,346][123091] Updated weights for policy 0, policy_version 1047322 (0.0006) [2023-12-26 07:57:11,429][123091] Updated weights for policy 0, policy_version 1047332 (0.0007) [2023-12-26 07:57:11,487][123091] Updated weights for policy 0, policy_version 1047342 (0.0006) [2023-12-26 07:57:12,038][123090] Updated weights for policy 1, policy_version 1039937 (0.0008) [2023-12-26 07:57:12,113][123090] Updated weights for policy 1, policy_version 1039947 (0.0010) [2023-12-26 07:57:12,177][123090] Updated weights for policy 1, policy_version 1039957 (0.0011) [2023-12-26 07:57:12,241][123090] Updated weights for policy 1, policy_version 1039967 (0.0011) [2023-12-26 07:57:12,258][123091] Updated weights for policy 0, policy_version 1047352 (0.0008) [2023-12-26 07:57:12,319][123091] Updated weights for policy 0, policy_version 1047362 (0.0009) [2023-12-26 07:57:12,385][123091] Updated weights for policy 0, policy_version 1047372 (0.0008) [2023-12-26 07:57:13,080][123091] Updated weights for policy 0, policy_version 1047382 (0.0008) [2023-12-26 07:57:13,090][123090] Updated weights for policy 1, policy_version 1039977 (0.0007) [2023-12-26 07:57:13,139][123091] Updated weights for policy 0, policy_version 1047392 (0.0005) [2023-12-26 07:57:13,146][123090] Updated weights for policy 1, policy_version 1039987 (0.0009) [2023-12-26 07:57:13,197][123090] Updated weights for policy 1, policy_version 1039997 (0.0009) [2023-12-26 07:57:13,201][123091] Updated weights for policy 0, policy_version 1047402 (0.0006) [2023-12-26 07:57:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 534380544. Throughput: 0: 8950.8, 1: 8879.1. Samples: 534376952. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:13,785][121949] Avg episode reward: [(0, '6225.402'), (1, '5505.614')] [2023-12-26 07:57:13,868][123091] Updated weights for policy 0, policy_version 1047412 (0.0005) [2023-12-26 07:57:13,924][123091] Updated weights for policy 0, policy_version 1047422 (0.0005) [2023-12-26 07:57:13,981][123091] Updated weights for policy 0, policy_version 1047432 (0.0005) [2023-12-26 07:57:14,079][123090] Updated weights for policy 1, policy_version 1040007 (0.0006) [2023-12-26 07:57:14,139][123090] Updated weights for policy 1, policy_version 1040017 (0.0005) [2023-12-26 07:57:14,213][123090] Updated weights for policy 1, policy_version 1040027 (0.0006) [2023-12-26 07:57:14,709][123091] Updated weights for policy 0, policy_version 1047442 (0.0007) [2023-12-26 07:57:14,773][123091] Updated weights for policy 0, policy_version 1047452 (0.0006) [2023-12-26 07:57:14,843][123091] Updated weights for policy 0, policy_version 1047462 (0.0007) [2023-12-26 07:57:14,851][123090] Updated weights for policy 1, policy_version 1040037 (0.0008) [2023-12-26 07:57:14,910][123091] Updated weights for policy 0, policy_version 1047472 (0.0006) [2023-12-26 07:57:14,922][123090] Updated weights for policy 1, policy_version 1040047 (0.0006) [2023-12-26 07:57:14,972][123090] Updated weights for policy 1, policy_version 1040057 (0.0007) [2023-12-26 07:57:15,554][123091] Updated weights for policy 0, policy_version 1047482 (0.0011) [2023-12-26 07:57:15,614][123091] Updated weights for policy 0, policy_version 1047492 (0.0011) [2023-12-26 07:57:15,681][123091] Updated weights for policy 0, policy_version 1047502 (0.0011) [2023-12-26 07:57:15,792][123090] Updated weights for policy 1, policy_version 1040067 (0.0011) [2023-12-26 07:57:15,854][123090] Updated weights for policy 1, policy_version 1040077 (0.0010) [2023-12-26 07:57:15,923][123090] Updated weights for policy 1, policy_version 1040087 (0.0010) [2023-12-26 07:57:16,466][123091] Updated weights for policy 0, policy_version 1047512 (0.0010) [2023-12-26 07:57:16,516][123091] Updated weights for policy 0, policy_version 1047522 (0.0010) [2023-12-26 07:57:16,571][123091] Updated weights for policy 0, policy_version 1047532 (0.0010) [2023-12-26 07:57:16,591][123090] Updated weights for policy 1, policy_version 1040097 (0.0010) [2023-12-26 07:57:16,658][123090] Updated weights for policy 1, policy_version 1040107 (0.0005) [2023-12-26 07:57:16,715][123090] Updated weights for policy 1, policy_version 1040117 (0.0007) [2023-12-26 07:57:16,770][123090] Updated weights for policy 1, policy_version 1040127 (0.0005) [2023-12-26 07:57:17,400][123091] Updated weights for policy 0, policy_version 1047542 (0.0007) [2023-12-26 07:57:17,463][123091] Updated weights for policy 0, policy_version 1047552 (0.0005) [2023-12-26 07:57:17,501][123090] Updated weights for policy 1, policy_version 1040137 (0.0010) [2023-12-26 07:57:17,521][123091] Updated weights for policy 0, policy_version 1047562 (0.0006) [2023-12-26 07:57:17,556][123090] Updated weights for policy 1, policy_version 1040147 (0.0011) [2023-12-26 07:57:17,604][123090] Updated weights for policy 1, policy_version 1040157 (0.0010) [2023-12-26 07:57:18,311][123091] Updated weights for policy 0, policy_version 1047572 (0.0010) [2023-12-26 07:57:18,356][123090] Updated weights for policy 1, policy_version 1040167 (0.0009) [2023-12-26 07:57:18,374][123091] Updated weights for policy 0, policy_version 1047582 (0.0008) [2023-12-26 07:57:18,422][123090] Updated weights for policy 1, policy_version 1040177 (0.0010) [2023-12-26 07:57:18,442][123091] Updated weights for policy 0, policy_version 1047592 (0.0006) [2023-12-26 07:57:18,485][123090] Updated weights for policy 1, policy_version 1040187 (0.0010) [2023-12-26 07:57:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 534478848. Throughput: 0: 8981.7, 1: 8934.7. Samples: 534488340. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:18,785][121949] Avg episode reward: [(0, '6217.830'), (1, '5596.335')] [2023-12-26 07:57:19,223][123091] Updated weights for policy 0, policy_version 1047602 (0.0006) [2023-12-26 07:57:19,281][123091] Updated weights for policy 0, policy_version 1047612 (0.0006) [2023-12-26 07:57:19,300][123090] Updated weights for policy 1, policy_version 1040197 (0.0011) [2023-12-26 07:57:19,335][123091] Updated weights for policy 0, policy_version 1047622 (0.0007) [2023-12-26 07:57:19,370][123090] Updated weights for policy 1, policy_version 1040207 (0.0013) [2023-12-26 07:57:19,403][123091] Updated weights for policy 0, policy_version 1047632 (0.0010) [2023-12-26 07:57:19,426][123090] Updated weights for policy 1, policy_version 1040217 (0.0010) [2023-12-26 07:57:20,241][123090] Updated weights for policy 1, policy_version 1040227 (0.0010) [2023-12-26 07:57:20,248][123091] Updated weights for policy 0, policy_version 1047642 (0.0008) [2023-12-26 07:57:20,303][123090] Updated weights for policy 1, policy_version 1040237 (0.0010) [2023-12-26 07:57:20,309][123091] Updated weights for policy 0, policy_version 1047652 (0.0006) [2023-12-26 07:57:20,369][123090] Updated weights for policy 1, policy_version 1040247 (0.0007) [2023-12-26 07:57:20,378][123091] Updated weights for policy 0, policy_version 1047662 (0.0010) [2023-12-26 07:57:21,155][123090] Updated weights for policy 1, policy_version 1040257 (0.0006) [2023-12-26 07:57:21,209][123091] Updated weights for policy 0, policy_version 1047672 (0.0007) [2023-12-26 07:57:21,219][123090] Updated weights for policy 1, policy_version 1040267 (0.0010) [2023-12-26 07:57:21,279][123091] Updated weights for policy 0, policy_version 1047682 (0.0010) [2023-12-26 07:57:21,287][123090] Updated weights for policy 1, policy_version 1040277 (0.0009) [2023-12-26 07:57:21,343][123091] Updated weights for policy 0, policy_version 1047692 (0.0008) [2023-12-26 07:57:21,353][123090] Updated weights for policy 1, policy_version 1040287 (0.0010) [2023-12-26 07:57:22,161][123091] Updated weights for policy 0, policy_version 1047702 (0.0009) [2023-12-26 07:57:22,212][123090] Updated weights for policy 1, policy_version 1040297 (0.0009) [2023-12-26 07:57:22,231][123091] Updated weights for policy 0, policy_version 1047712 (0.0009) [2023-12-26 07:57:22,279][123090] Updated weights for policy 1, policy_version 1040307 (0.0009) [2023-12-26 07:57:22,296][123091] Updated weights for policy 0, policy_version 1047722 (0.0009) [2023-12-26 07:57:22,345][123090] Updated weights for policy 1, policy_version 1040317 (0.0009) [2023-12-26 07:57:23,065][123090] Updated weights for policy 1, policy_version 1040327 (0.0007) [2023-12-26 07:57:23,119][123091] Updated weights for policy 0, policy_version 1047732 (0.0009) [2023-12-26 07:57:23,123][123090] Updated weights for policy 1, policy_version 1040337 (0.0008) [2023-12-26 07:57:23,168][123091] Updated weights for policy 0, policy_version 1047742 (0.0009) [2023-12-26 07:57:23,181][123090] Updated weights for policy 1, policy_version 1040347 (0.0009) [2023-12-26 07:57:23,217][123091] Updated weights for policy 0, policy_version 1047752 (0.0010) [2023-12-26 07:57:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 534560768. Throughput: 0: 8978.4, 1: 8926.8. Samples: 534539492. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:23,784][121949] Avg episode reward: [(0, '6192.721'), (1, '5494.333')] [2023-12-26 07:57:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001040352_266330112.pth... [2023-12-26 07:57:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001047760_268230656.pth... [2023-12-26 07:57:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001039328_266067968.pth [2023-12-26 07:57:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001046704_267960320.pth [2023-12-26 07:57:23,969][123090] Updated weights for policy 1, policy_version 1040357 (0.0009) [2023-12-26 07:57:24,020][123090] Updated weights for policy 1, policy_version 1040367 (0.0010) [2023-12-26 07:57:24,056][123091] Updated weights for policy 0, policy_version 1047762 (0.0009) [2023-12-26 07:57:24,082][123090] Updated weights for policy 1, policy_version 1040377 (0.0009) [2023-12-26 07:57:24,115][123091] Updated weights for policy 0, policy_version 1047772 (0.0007) [2023-12-26 07:57:24,172][123091] Updated weights for policy 0, policy_version 1047782 (0.0008) [2023-12-26 07:57:24,235][123091] Updated weights for policy 0, policy_version 1047792 (0.0009) [2023-12-26 07:57:24,901][123091] Updated weights for policy 0, policy_version 1047802 (0.0005) [2023-12-26 07:57:24,920][123090] Updated weights for policy 1, policy_version 1040387 (0.0010) [2023-12-26 07:57:24,959][123091] Updated weights for policy 0, policy_version 1047812 (0.0006) [2023-12-26 07:57:24,987][123090] Updated weights for policy 1, policy_version 1040397 (0.0010) [2023-12-26 07:57:25,024][123091] Updated weights for policy 0, policy_version 1047822 (0.0006) [2023-12-26 07:57:25,039][123090] Updated weights for policy 1, policy_version 1040407 (0.0010) [2023-12-26 07:57:25,814][123090] Updated weights for policy 1, policy_version 1040417 (0.0010) [2023-12-26 07:57:25,815][123091] Updated weights for policy 0, policy_version 1047832 (0.0006) [2023-12-26 07:57:25,868][123091] Updated weights for policy 0, policy_version 1047842 (0.0007) [2023-12-26 07:57:25,873][123090] Updated weights for policy 1, policy_version 1040427 (0.0010) [2023-12-26 07:57:25,918][123091] Updated weights for policy 0, policy_version 1047852 (0.0008) [2023-12-26 07:57:25,937][123090] Updated weights for policy 1, policy_version 1040437 (0.0010) [2023-12-26 07:57:26,008][123090] Updated weights for policy 1, policy_version 1040447 (0.0011) [2023-12-26 07:57:26,692][123091] Updated weights for policy 0, policy_version 1047862 (0.0008) [2023-12-26 07:57:26,747][123091] Updated weights for policy 0, policy_version 1047873 (0.0011) [2023-12-26 07:57:26,797][123091] Updated weights for policy 0, policy_version 1047883 (0.0009) [2023-12-26 07:57:26,855][123090] Updated weights for policy 1, policy_version 1040457 (0.0010) [2023-12-26 07:57:26,917][123090] Updated weights for policy 1, policy_version 1040467 (0.0009) [2023-12-26 07:57:26,975][123090] Updated weights for policy 1, policy_version 1040477 (0.0006) [2023-12-26 07:57:27,671][123091] Updated weights for policy 0, policy_version 1047893 (0.0008) [2023-12-26 07:57:27,738][123091] Updated weights for policy 0, policy_version 1047903 (0.0007) [2023-12-26 07:57:27,751][123090] Updated weights for policy 1, policy_version 1040487 (0.0008) [2023-12-26 07:57:27,793][123091] Updated weights for policy 0, policy_version 1047913 (0.0008) [2023-12-26 07:57:27,814][123090] Updated weights for policy 1, policy_version 1040497 (0.0008) [2023-12-26 07:57:27,881][123090] Updated weights for policy 1, policy_version 1040507 (0.0008) [2023-12-26 07:57:28,625][123091] Updated weights for policy 0, policy_version 1047923 (0.0009) [2023-12-26 07:57:28,650][123090] Updated weights for policy 1, policy_version 1040517 (0.0007) [2023-12-26 07:57:28,691][123091] Updated weights for policy 0, policy_version 1047933 (0.0008) [2023-12-26 07:57:28,716][123090] Updated weights for policy 1, policy_version 1040527 (0.0009) [2023-12-26 07:57:28,754][123091] Updated weights for policy 0, policy_version 1047943 (0.0010) [2023-12-26 07:57:28,779][123090] Updated weights for policy 1, policy_version 1040537 (0.0008) [2023-12-26 07:57:28,787][121949] Fps is (10 sec: 16378.9, 60 sec: 17748.4, 300 sec: 17800.1). Total num frames: 534642688. Throughput: 0: 8997.1, 1: 8961.1. Samples: 534645968. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:28,788][121949] Avg episode reward: [(0, '6209.056'), (1, '5656.370')] [2023-12-26 07:57:29,566][123091] Updated weights for policy 0, policy_version 1047953 (0.0010) [2023-12-26 07:57:29,619][123091] Updated weights for policy 0, policy_version 1047963 (0.0006) [2023-12-26 07:57:29,660][123090] Updated weights for policy 1, policy_version 1040547 (0.0009) [2023-12-26 07:57:29,676][123091] Updated weights for policy 0, policy_version 1047973 (0.0008) [2023-12-26 07:57:29,723][123090] Updated weights for policy 1, policy_version 1040557 (0.0007) [2023-12-26 07:57:29,737][123091] Updated weights for policy 0, policy_version 1047983 (0.0010) [2023-12-26 07:57:29,790][123090] Updated weights for policy 1, policy_version 1040567 (0.0009) [2023-12-26 07:57:30,523][123091] Updated weights for policy 0, policy_version 1047993 (0.0009) [2023-12-26 07:57:30,580][123091] Updated weights for policy 0, policy_version 1048003 (0.0005) [2023-12-26 07:57:30,617][123090] Updated weights for policy 1, policy_version 1040577 (0.0009) [2023-12-26 07:57:30,641][123091] Updated weights for policy 0, policy_version 1048013 (0.0008) [2023-12-26 07:57:30,674][123090] Updated weights for policy 1, policy_version 1040587 (0.0010) [2023-12-26 07:57:30,748][123090] Updated weights for policy 1, policy_version 1040597 (0.0010) [2023-12-26 07:57:30,817][123090] Updated weights for policy 1, policy_version 1040607 (0.0010) [2023-12-26 07:57:31,267][123091] Updated weights for policy 0, policy_version 1048023 (0.0007) [2023-12-26 07:57:31,335][123091] Updated weights for policy 0, policy_version 1048033 (0.0009) [2023-12-26 07:57:31,405][123091] Updated weights for policy 0, policy_version 1048043 (0.0013) [2023-12-26 07:57:31,740][123090] Updated weights for policy 1, policy_version 1040617 (0.0010) [2023-12-26 07:57:31,813][123090] Updated weights for policy 1, policy_version 1040627 (0.0010) [2023-12-26 07:57:31,889][123090] Updated weights for policy 1, policy_version 1040637 (0.0010) [2023-12-26 07:57:32,170][123091] Updated weights for policy 0, policy_version 1048053 (0.0008) [2023-12-26 07:57:32,244][123091] Updated weights for policy 0, policy_version 1048063 (0.0009) [2023-12-26 07:57:32,310][123091] Updated weights for policy 0, policy_version 1048073 (0.0006) [2023-12-26 07:57:32,713][123090] Updated weights for policy 1, policy_version 1040647 (0.0007) [2023-12-26 07:57:32,771][123090] Updated weights for policy 1, policy_version 1040657 (0.0010) [2023-12-26 07:57:32,822][123090] Updated weights for policy 1, policy_version 1040667 (0.0009) [2023-12-26 07:57:33,123][123091] Updated weights for policy 0, policy_version 1048083 (0.0009) [2023-12-26 07:57:33,184][123091] Updated weights for policy 0, policy_version 1048093 (0.0009) [2023-12-26 07:57:33,246][123091] Updated weights for policy 0, policy_version 1048103 (0.0009) [2023-12-26 07:57:33,555][123090] Updated weights for policy 1, policy_version 1040677 (0.0007) [2023-12-26 07:57:33,624][123090] Updated weights for policy 1, policy_version 1040687 (0.0005) [2023-12-26 07:57:33,698][123090] Updated weights for policy 1, policy_version 1040697 (0.0007) [2023-12-26 07:57:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 534740992. Throughput: 0: 8963.1, 1: 8903.1. Samples: 534749372. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:33,784][121949] Avg episode reward: [(0, '6251.076'), (1, '5592.887')] [2023-12-26 07:57:34,109][123091] Updated weights for policy 0, policy_version 1048113 (0.0010) [2023-12-26 07:57:34,176][123091] Updated weights for policy 0, policy_version 1048123 (0.0011) [2023-12-26 07:57:34,242][123091] Updated weights for policy 0, policy_version 1048133 (0.0011) [2023-12-26 07:57:34,303][123091] Updated weights for policy 0, policy_version 1048143 (0.0013) [2023-12-26 07:57:34,371][123090] Updated weights for policy 1, policy_version 1040707 (0.0008) [2023-12-26 07:57:34,438][123090] Updated weights for policy 1, policy_version 1040717 (0.0006) [2023-12-26 07:57:34,501][123090] Updated weights for policy 1, policy_version 1040727 (0.0006) [2023-12-26 07:57:35,072][123091] Updated weights for policy 0, policy_version 1048153 (0.0009) [2023-12-26 07:57:35,134][123091] Updated weights for policy 0, policy_version 1048163 (0.0009) [2023-12-26 07:57:35,195][123091] Updated weights for policy 0, policy_version 1048173 (0.0009) [2023-12-26 07:57:35,276][123090] Updated weights for policy 1, policy_version 1040737 (0.0006) [2023-12-26 07:57:35,336][123090] Updated weights for policy 1, policy_version 1040748 (0.0009) [2023-12-26 07:57:35,396][123090] Updated weights for policy 1, policy_version 1040758 (0.0009) [2023-12-26 07:57:35,459][123090] Updated weights for policy 1, policy_version 1040768 (0.0008) [2023-12-26 07:57:35,935][123091] Updated weights for policy 0, policy_version 1048183 (0.0010) [2023-12-26 07:57:35,992][123091] Updated weights for policy 0, policy_version 1048193 (0.0010) [2023-12-26 07:57:36,043][123091] Updated weights for policy 0, policy_version 1048203 (0.0010) [2023-12-26 07:57:36,313][123090] Updated weights for policy 1, policy_version 1040778 (0.0010) [2023-12-26 07:57:36,377][123090] Updated weights for policy 1, policy_version 1040788 (0.0009) [2023-12-26 07:57:36,434][123090] Updated weights for policy 1, policy_version 1040798 (0.0010) [2023-12-26 07:57:36,871][123091] Updated weights for policy 0, policy_version 1048213 (0.0010) [2023-12-26 07:57:36,930][123091] Updated weights for policy 0, policy_version 1048223 (0.0010) [2023-12-26 07:57:36,997][123091] Updated weights for policy 0, policy_version 1048233 (0.0008) [2023-12-26 07:57:37,297][123090] Updated weights for policy 1, policy_version 1040808 (0.0009) [2023-12-26 07:57:37,358][123090] Updated weights for policy 1, policy_version 1040818 (0.0010) [2023-12-26 07:57:37,404][123090] Updated weights for policy 1, policy_version 1040828 (0.0008) [2023-12-26 07:57:37,764][123091] Updated weights for policy 0, policy_version 1048243 (0.0010) [2023-12-26 07:57:37,815][123091] Updated weights for policy 0, policy_version 1048253 (0.0011) [2023-12-26 07:57:37,874][123091] Updated weights for policy 0, policy_version 1048263 (0.0010) [2023-12-26 07:57:38,264][123090] Updated weights for policy 1, policy_version 1040838 (0.0008) [2023-12-26 07:57:38,327][123090] Updated weights for policy 1, policy_version 1040848 (0.0009) [2023-12-26 07:57:38,402][123090] Updated weights for policy 1, policy_version 1040858 (0.0009) [2023-12-26 07:57:38,703][123091] Updated weights for policy 0, policy_version 1048273 (0.0010) [2023-12-26 07:57:38,767][123091] Updated weights for policy 0, policy_version 1048283 (0.0005) [2023-12-26 07:57:38,784][121949] Fps is (10 sec: 18028.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 534822912. Throughput: 0: 8959.6, 1: 8861.2. Samples: 534802740. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:38,785][121949] Avg episode reward: [(0, '6250.061'), (1, '5514.415')] [2023-12-26 07:57:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001040864_266461184.pth... [2023-12-26 07:57:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001039840_266199040.pth [2023-12-26 07:57:38,830][123091] Updated weights for policy 0, policy_version 1048293 (0.0005) [2023-12-26 07:57:38,885][123091] Updated weights for policy 0, policy_version 1048303 (0.0005) [2023-12-26 07:57:38,889][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001048304_268369920.pth... [2023-12-26 07:57:38,895][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001047248_268099584.pth [2023-12-26 07:57:39,233][123090] Updated weights for policy 1, policy_version 1040868 (0.0010) [2023-12-26 07:57:39,295][123090] Updated weights for policy 1, policy_version 1040878 (0.0010) [2023-12-26 07:57:39,365][123090] Updated weights for policy 1, policy_version 1040888 (0.0009) [2023-12-26 07:57:39,596][123091] Updated weights for policy 0, policy_version 1048313 (0.0007) [2023-12-26 07:57:39,653][123091] Updated weights for policy 0, policy_version 1048323 (0.0006) [2023-12-26 07:57:39,703][123091] Updated weights for policy 0, policy_version 1048333 (0.0006) [2023-12-26 07:57:40,228][123090] Updated weights for policy 1, policy_version 1040898 (0.0009) [2023-12-26 07:57:40,294][123090] Updated weights for policy 1, policy_version 1040908 (0.0009) [2023-12-26 07:57:40,349][123090] Updated weights for policy 1, policy_version 1040918 (0.0009) [2023-12-26 07:57:40,412][123090] Updated weights for policy 1, policy_version 1040928 (0.0010) [2023-12-26 07:57:40,520][123091] Updated weights for policy 0, policy_version 1048343 (0.0010) [2023-12-26 07:57:40,576][123091] Updated weights for policy 0, policy_version 1048354 (0.0010) [2023-12-26 07:57:40,638][123091] Updated weights for policy 0, policy_version 1048364 (0.0010) [2023-12-26 07:57:41,213][123090] Updated weights for policy 1, policy_version 1040938 (0.0010) [2023-12-26 07:57:41,287][123090] Updated weights for policy 1, policy_version 1040948 (0.0009) [2023-12-26 07:57:41,360][123090] Updated weights for policy 1, policy_version 1040958 (0.0009) [2023-12-26 07:57:41,554][123091] Updated weights for policy 0, policy_version 1048374 (0.0009) [2023-12-26 07:57:41,622][123091] Updated weights for policy 0, policy_version 1048384 (0.0010) [2023-12-26 07:57:41,693][123091] Updated weights for policy 0, policy_version 1048394 (0.0009) [2023-12-26 07:57:42,240][123090] Updated weights for policy 1, policy_version 1040968 (0.0010) [2023-12-26 07:57:42,307][123090] Updated weights for policy 1, policy_version 1040978 (0.0009) [2023-12-26 07:57:42,376][123090] Updated weights for policy 1, policy_version 1040988 (0.0010) [2023-12-26 07:57:42,546][123091] Updated weights for policy 0, policy_version 1048404 (0.0010) [2023-12-26 07:57:42,600][123091] Updated weights for policy 0, policy_version 1048414 (0.0009) [2023-12-26 07:57:42,658][123091] Updated weights for policy 0, policy_version 1048424 (0.0009) [2023-12-26 07:57:43,232][123090] Updated weights for policy 1, policy_version 1040998 (0.0010) [2023-12-26 07:57:43,283][123090] Updated weights for policy 1, policy_version 1041008 (0.0009) [2023-12-26 07:57:43,335][123090] Updated weights for policy 1, policy_version 1041018 (0.0006) [2023-12-26 07:57:43,511][123091] Updated weights for policy 0, policy_version 1048434 (0.0007) [2023-12-26 07:57:43,570][123091] Updated weights for policy 0, policy_version 1048444 (0.0010) [2023-12-26 07:57:43,625][123091] Updated weights for policy 0, policy_version 1048454 (0.0010) [2023-12-26 07:57:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 534913024. Throughput: 0: 8871.0, 1: 8770.6. Samples: 534904084. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:43,785][121949] Avg episode reward: [(0, '6230.609'), (1, '5463.974')] [2023-12-26 07:57:44,054][123090] Updated weights for policy 1, policy_version 1041028 (0.0006) [2023-12-26 07:57:44,123][123090] Updated weights for policy 1, policy_version 1041038 (0.0006) [2023-12-26 07:57:44,203][123090] Updated weights for policy 1, policy_version 1041048 (0.0005) [2023-12-26 07:57:44,539][123091] Updated weights for policy 0, policy_version 1048465 (0.0010) [2023-12-26 07:57:44,600][123091] Updated weights for policy 0, policy_version 1048475 (0.0009) [2023-12-26 07:57:44,654][123091] Updated weights for policy 0, policy_version 1048485 (0.0009) [2023-12-26 07:57:44,704][123091] Updated weights for policy 0, policy_version 1048495 (0.0009) [2023-12-26 07:57:44,948][123090] Updated weights for policy 1, policy_version 1041058 (0.0007) [2023-12-26 07:57:45,021][123090] Updated weights for policy 1, policy_version 1041068 (0.0011) [2023-12-26 07:57:45,094][123090] Updated weights for policy 1, policy_version 1041078 (0.0011) [2023-12-26 07:57:45,165][123090] Updated weights for policy 1, policy_version 1041088 (0.0011) [2023-12-26 07:57:45,589][123091] Updated weights for policy 0, policy_version 1048505 (0.0009) [2023-12-26 07:57:45,644][123091] Updated weights for policy 0, policy_version 1048515 (0.0009) [2023-12-26 07:57:45,694][123091] Updated weights for policy 0, policy_version 1048525 (0.0009) [2023-12-26 07:57:45,996][123090] Updated weights for policy 1, policy_version 1041098 (0.0011) [2023-12-26 07:57:46,055][123090] Updated weights for policy 1, policy_version 1041108 (0.0010) [2023-12-26 07:57:46,119][123090] Updated weights for policy 1, policy_version 1041118 (0.0011) [2023-12-26 07:57:46,557][123091] Updated weights for policy 0, policy_version 1048535 (0.0009) [2023-12-26 07:57:46,611][123091] Updated weights for policy 0, policy_version 1048545 (0.0009) [2023-12-26 07:57:46,672][123091] Updated weights for policy 0, policy_version 1048555 (0.0009) [2023-12-26 07:57:46,943][123090] Updated weights for policy 1, policy_version 1041128 (0.0007) [2023-12-26 07:57:46,990][123090] Updated weights for policy 1, policy_version 1041138 (0.0005) [2023-12-26 07:57:47,048][123090] Updated weights for policy 1, policy_version 1041148 (0.0005) [2023-12-26 07:57:47,563][123091] Updated weights for policy 0, policy_version 1048565 (0.0008) [2023-12-26 07:57:47,627][123091] Updated weights for policy 0, policy_version 1048575 (0.0006) [2023-12-26 07:57:47,678][123091] Updated weights for policy 0, policy_version 1048585 (0.0005) [2023-12-26 07:57:47,846][123090] Updated weights for policy 1, policy_version 1041158 (0.0009) [2023-12-26 07:57:47,912][123090] Updated weights for policy 1, policy_version 1041168 (0.0007) [2023-12-26 07:57:47,972][123090] Updated weights for policy 1, policy_version 1041178 (0.0005) [2023-12-26 07:57:48,364][123091] Updated weights for policy 0, policy_version 1048595 (0.0006) [2023-12-26 07:57:48,420][123091] Updated weights for policy 0, policy_version 1048605 (0.0008) [2023-12-26 07:57:48,468][123091] Updated weights for policy 0, policy_version 1048615 (0.0008) [2023-12-26 07:57:48,692][123090] Updated weights for policy 1, policy_version 1041188 (0.0007) [2023-12-26 07:57:48,755][123090] Updated weights for policy 1, policy_version 1041198 (0.0011) [2023-12-26 07:57:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 534994944. Throughput: 0: 8800.6, 1: 8777.1. Samples: 535007936. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:48,785][121949] Avg episode reward: [(0, '6073.429'), (1, '5481.066')] [2023-12-26 07:57:48,818][123090] Updated weights for policy 1, policy_version 1041208 (0.0010) [2023-12-26 07:57:49,269][123091] Updated weights for policy 0, policy_version 1048625 (0.0008) [2023-12-26 07:57:49,328][123091] Updated weights for policy 0, policy_version 1048635 (0.0009) [2023-12-26 07:57:49,395][123091] Updated weights for policy 0, policy_version 1048645 (0.0009) [2023-12-26 07:57:49,465][123091] Updated weights for policy 0, policy_version 1048655 (0.0011) [2023-12-26 07:57:49,631][123090] Updated weights for policy 1, policy_version 1041218 (0.0011) [2023-12-26 07:57:49,699][123090] Updated weights for policy 1, policy_version 1041228 (0.0011) [2023-12-26 07:57:49,766][123090] Updated weights for policy 1, policy_version 1041238 (0.0011) [2023-12-26 07:57:49,838][123090] Updated weights for policy 1, policy_version 1041248 (0.0011) [2023-12-26 07:57:50,298][123091] Updated weights for policy 0, policy_version 1048665 (0.0011) [2023-12-26 07:57:50,365][123091] Updated weights for policy 0, policy_version 1048675 (0.0011) [2023-12-26 07:57:50,428][123091] Updated weights for policy 0, policy_version 1048685 (0.0011) [2023-12-26 07:57:50,716][123090] Updated weights for policy 1, policy_version 1041258 (0.0011) [2023-12-26 07:57:50,788][123090] Updated weights for policy 1, policy_version 1041268 (0.0011) [2023-12-26 07:57:50,860][123090] Updated weights for policy 1, policy_version 1041278 (0.0011) [2023-12-26 07:57:51,231][123091] Updated weights for policy 0, policy_version 1048695 (0.0011) [2023-12-26 07:57:51,302][123091] Updated weights for policy 0, policy_version 1048705 (0.0011) [2023-12-26 07:57:51,375][123091] Updated weights for policy 0, policy_version 1048715 (0.0011) [2023-12-26 07:57:51,747][123090] Updated weights for policy 1, policy_version 1041288 (0.0011) [2023-12-26 07:57:51,800][123090] Updated weights for policy 1, policy_version 1041298 (0.0010) [2023-12-26 07:57:51,856][123090] Updated weights for policy 1, policy_version 1041308 (0.0010) [2023-12-26 07:57:52,216][123091] Updated weights for policy 0, policy_version 1048725 (0.0011) [2023-12-26 07:57:52,286][123091] Updated weights for policy 0, policy_version 1048735 (0.0011) [2023-12-26 07:57:52,352][123091] Updated weights for policy 0, policy_version 1048745 (0.0011) [2023-12-26 07:57:52,637][123090] Updated weights for policy 1, policy_version 1041318 (0.0010) [2023-12-26 07:57:52,694][123090] Updated weights for policy 1, policy_version 1041328 (0.0011) [2023-12-26 07:57:52,746][123090] Updated weights for policy 1, policy_version 1041338 (0.0010) [2023-12-26 07:57:53,136][123091] Updated weights for policy 0, policy_version 1048755 (0.0009) [2023-12-26 07:57:53,199][123091] Updated weights for policy 0, policy_version 1048765 (0.0007) [2023-12-26 07:57:53,262][123091] Updated weights for policy 0, policy_version 1048775 (0.0005) [2023-12-26 07:57:53,533][123090] Updated weights for policy 1, policy_version 1041348 (0.0010) [2023-12-26 07:57:53,590][123090] Updated weights for policy 1, policy_version 1041358 (0.0005) [2023-12-26 07:57:53,643][123090] Updated weights for policy 1, policy_version 1041368 (0.0006) [2023-12-26 07:57:53,785][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 535085056. Throughput: 0: 8786.9, 1: 8699.3. Samples: 535058876. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:53,786][121949] Avg episode reward: [(0, '5972.944'), (1, '5554.875')] [2023-12-26 07:57:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001048784_268492800.pth... [2023-12-26 07:57:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001041376_266592256.pth... [2023-12-26 07:57:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001040352_266330112.pth [2023-12-26 07:57:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001047760_268230656.pth [2023-12-26 07:57:53,964][123091] Updated weights for policy 0, policy_version 1048785 (0.0007) [2023-12-26 07:57:54,018][123091] Updated weights for policy 0, policy_version 1048795 (0.0005) [2023-12-26 07:57:54,067][123091] Updated weights for policy 0, policy_version 1048805 (0.0005) [2023-12-26 07:57:54,119][123091] Updated weights for policy 0, policy_version 1048815 (0.0005) [2023-12-26 07:57:54,317][123090] Updated weights for policy 1, policy_version 1041378 (0.0007) [2023-12-26 07:57:54,389][123090] Updated weights for policy 1, policy_version 1041388 (0.0008) [2023-12-26 07:57:54,454][123090] Updated weights for policy 1, policy_version 1041398 (0.0007) [2023-12-26 07:57:54,518][123090] Updated weights for policy 1, policy_version 1041408 (0.0010) [2023-12-26 07:57:54,874][123091] Updated weights for policy 0, policy_version 1048825 (0.0005) [2023-12-26 07:57:54,933][123091] Updated weights for policy 0, policy_version 1048835 (0.0006) [2023-12-26 07:57:54,983][123091] Updated weights for policy 0, policy_version 1048845 (0.0010) [2023-12-26 07:57:55,272][123090] Updated weights for policy 1, policy_version 1041418 (0.0009) [2023-12-26 07:57:55,329][123090] Updated weights for policy 1, policy_version 1041428 (0.0009) [2023-12-26 07:57:55,390][123090] Updated weights for policy 1, policy_version 1041438 (0.0009) [2023-12-26 07:57:55,817][123091] Updated weights for policy 0, policy_version 1048855 (0.0009) [2023-12-26 07:57:55,879][123091] Updated weights for policy 0, policy_version 1048866 (0.0010) [2023-12-26 07:57:55,937][123091] Updated weights for policy 0, policy_version 1048876 (0.0010) [2023-12-26 07:57:56,135][123090] Updated weights for policy 1, policy_version 1041448 (0.0006) [2023-12-26 07:57:56,190][123090] Updated weights for policy 1, policy_version 1041458 (0.0005) [2023-12-26 07:57:56,238][123090] Updated weights for policy 1, policy_version 1041468 (0.0005) [2023-12-26 07:57:56,643][123091] Updated weights for policy 0, policy_version 1048886 (0.0007) [2023-12-26 07:57:56,688][123091] Updated weights for policy 0, policy_version 1048896 (0.0005) [2023-12-26 07:57:56,733][123091] Updated weights for policy 0, policy_version 1048906 (0.0005) [2023-12-26 07:57:56,907][123090] Updated weights for policy 1, policy_version 1041478 (0.0005) [2023-12-26 07:57:56,961][123090] Updated weights for policy 1, policy_version 1041488 (0.0005) [2023-12-26 07:57:57,008][123090] Updated weights for policy 1, policy_version 1041498 (0.0005) [2023-12-26 07:57:57,412][123091] Updated weights for policy 0, policy_version 1048916 (0.0007) [2023-12-26 07:57:57,460][123091] Updated weights for policy 0, policy_version 1048926 (0.0005) [2023-12-26 07:57:57,514][123091] Updated weights for policy 0, policy_version 1048936 (0.0005) [2023-12-26 07:57:57,721][123090] Updated weights for policy 1, policy_version 1041508 (0.0007) [2023-12-26 07:57:57,775][123090] Updated weights for policy 1, policy_version 1041518 (0.0010) [2023-12-26 07:57:57,836][123090] Updated weights for policy 1, policy_version 1041528 (0.0009) [2023-12-26 07:57:58,302][123091] Updated weights for policy 0, policy_version 1048946 (0.0006) [2023-12-26 07:57:58,379][123091] Updated weights for policy 0, policy_version 1048956 (0.0011) [2023-12-26 07:57:58,439][123091] Updated weights for policy 0, policy_version 1048966 (0.0011) [2023-12-26 07:57:58,512][123091] Updated weights for policy 0, policy_version 1048976 (0.0010) [2023-12-26 07:57:58,720][123090] Updated weights for policy 1, policy_version 1041538 (0.0009) [2023-12-26 07:57:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 535175168. Throughput: 0: 8895.0, 1: 8798.5. Samples: 535173156. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:57:58,785][121949] Avg episode reward: [(0, '6181.929'), (1, '5415.091')] [2023-12-26 07:57:58,827][123090] Updated weights for policy 1, policy_version 1041548 (0.0009) [2023-12-26 07:57:58,901][123090] Updated weights for policy 1, policy_version 1041558 (0.0009) [2023-12-26 07:57:58,969][123090] Updated weights for policy 1, policy_version 1041568 (0.0010) [2023-12-26 07:57:59,327][123091] Updated weights for policy 0, policy_version 1048986 (0.0009) [2023-12-26 07:57:59,395][123091] Updated weights for policy 0, policy_version 1048996 (0.0011) [2023-12-26 07:57:59,464][123091] Updated weights for policy 0, policy_version 1049006 (0.0010) [2023-12-26 07:57:59,795][123090] Updated weights for policy 1, policy_version 1041578 (0.0010) [2023-12-26 07:57:59,869][123090] Updated weights for policy 1, policy_version 1041588 (0.0010) [2023-12-26 07:57:59,940][123090] Updated weights for policy 1, policy_version 1041598 (0.0010) [2023-12-26 07:58:00,282][123091] Updated weights for policy 0, policy_version 1049016 (0.0010) [2023-12-26 07:58:00,340][123091] Updated weights for policy 0, policy_version 1049026 (0.0010) [2023-12-26 07:58:00,399][123091] Updated weights for policy 0, policy_version 1049036 (0.0010) [2023-12-26 07:58:00,759][123090] Updated weights for policy 1, policy_version 1041608 (0.0009) [2023-12-26 07:58:00,821][123090] Updated weights for policy 1, policy_version 1041618 (0.0009) [2023-12-26 07:58:00,883][123090] Updated weights for policy 1, policy_version 1041628 (0.0008) [2023-12-26 07:58:01,178][123091] Updated weights for policy 0, policy_version 1049046 (0.0010) [2023-12-26 07:58:01,242][123091] Updated weights for policy 0, policy_version 1049056 (0.0009) [2023-12-26 07:58:01,292][123091] Updated weights for policy 0, policy_version 1049066 (0.0009) [2023-12-26 07:58:01,742][123090] Updated weights for policy 1, policy_version 1041638 (0.0009) [2023-12-26 07:58:01,790][123090] Updated weights for policy 1, policy_version 1041648 (0.0008) [2023-12-26 07:58:01,854][123090] Updated weights for policy 1, policy_version 1041658 (0.0009) [2023-12-26 07:58:02,138][123091] Updated weights for policy 0, policy_version 1049076 (0.0009) [2023-12-26 07:58:02,204][123091] Updated weights for policy 0, policy_version 1049086 (0.0010) [2023-12-26 07:58:02,270][123091] Updated weights for policy 0, policy_version 1049096 (0.0010) [2023-12-26 07:58:02,704][123090] Updated weights for policy 1, policy_version 1041668 (0.0009) [2023-12-26 07:58:02,769][123090] Updated weights for policy 1, policy_version 1041678 (0.0009) [2023-12-26 07:58:02,830][123090] Updated weights for policy 1, policy_version 1041688 (0.0009) [2023-12-26 07:58:03,080][123091] Updated weights for policy 0, policy_version 1049106 (0.0011) [2023-12-26 07:58:03,135][123091] Updated weights for policy 0, policy_version 1049116 (0.0010) [2023-12-26 07:58:03,194][123091] Updated weights for policy 0, policy_version 1049126 (0.0010) [2023-12-26 07:58:03,241][123091] Updated weights for policy 0, policy_version 1049136 (0.0010) [2023-12-26 07:58:03,681][123090] Updated weights for policy 1, policy_version 1041698 (0.0009) [2023-12-26 07:58:03,733][123090] Updated weights for policy 1, policy_version 1041708 (0.0009) [2023-12-26 07:58:03,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 535257088. Throughput: 0: 8784.5, 1: 8662.9. Samples: 535273476. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:03,785][121949] Avg episode reward: [(0, '6146.075'), (1, '5598.502')] [2023-12-26 07:58:03,785][123090] Updated weights for policy 1, policy_version 1041718 (0.0008) [2023-12-26 07:58:03,854][123090] Updated weights for policy 1, policy_version 1041728 (0.0009) [2023-12-26 07:58:04,087][123091] Updated weights for policy 0, policy_version 1049146 (0.0010) [2023-12-26 07:58:04,143][123091] Updated weights for policy 0, policy_version 1049156 (0.0010) [2023-12-26 07:58:04,199][123091] Updated weights for policy 0, policy_version 1049166 (0.0010) [2023-12-26 07:58:04,713][123090] Updated weights for policy 1, policy_version 1041738 (0.0009) [2023-12-26 07:58:04,766][123090] Updated weights for policy 1, policy_version 1041748 (0.0009) [2023-12-26 07:58:04,824][123090] Updated weights for policy 1, policy_version 1041758 (0.0009) [2023-12-26 07:58:05,034][123091] Updated weights for policy 0, policy_version 1049176 (0.0010) [2023-12-26 07:58:05,085][123091] Updated weights for policy 0, policy_version 1049186 (0.0010) [2023-12-26 07:58:05,135][123091] Updated weights for policy 0, policy_version 1049196 (0.0010) [2023-12-26 07:58:05,675][123090] Updated weights for policy 1, policy_version 1041768 (0.0009) [2023-12-26 07:58:05,724][123090] Updated weights for policy 1, policy_version 1041779 (0.0008) [2023-12-26 07:58:05,785][123090] Updated weights for policy 1, policy_version 1041789 (0.0009) [2023-12-26 07:58:05,978][123091] Updated weights for policy 0, policy_version 1049206 (0.0010) [2023-12-26 07:58:06,032][123091] Updated weights for policy 0, policy_version 1049216 (0.0010) [2023-12-26 07:58:06,088][123091] Updated weights for policy 0, policy_version 1049226 (0.0010) [2023-12-26 07:58:06,671][123090] Updated weights for policy 1, policy_version 1041799 (0.0009) [2023-12-26 07:58:06,732][123090] Updated weights for policy 1, policy_version 1041809 (0.0008) [2023-12-26 07:58:06,796][123090] Updated weights for policy 1, policy_version 1041819 (0.0009) [2023-12-26 07:58:06,943][123091] Updated weights for policy 0, policy_version 1049236 (0.0011) [2023-12-26 07:58:06,991][123091] Updated weights for policy 0, policy_version 1049246 (0.0010) [2023-12-26 07:58:07,046][123091] Updated weights for policy 0, policy_version 1049256 (0.0010) [2023-12-26 07:58:07,638][123090] Updated weights for policy 1, policy_version 1041829 (0.0009) [2023-12-26 07:58:07,687][123090] Updated weights for policy 1, policy_version 1041839 (0.0009) [2023-12-26 07:58:07,735][123090] Updated weights for policy 1, policy_version 1041849 (0.0008) [2023-12-26 07:58:07,875][123091] Updated weights for policy 0, policy_version 1049266 (0.0011) [2023-12-26 07:58:07,930][123091] Updated weights for policy 0, policy_version 1049276 (0.0010) [2023-12-26 07:58:07,978][123091] Updated weights for policy 0, policy_version 1049286 (0.0010) [2023-12-26 07:58:08,031][123091] Updated weights for policy 0, policy_version 1049296 (0.0011) [2023-12-26 07:58:08,513][123090] Updated weights for policy 1, policy_version 1041859 (0.0009) [2023-12-26 07:58:08,581][123090] Updated weights for policy 1, policy_version 1041869 (0.0010) [2023-12-26 07:58:08,647][123090] Updated weights for policy 1, policy_version 1041879 (0.0008) [2023-12-26 07:58:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 535347200. Throughput: 0: 8783.8, 1: 8654.1. Samples: 535324200. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:08,785][121949] Avg episode reward: [(0, '6227.210'), (1, '5583.550')] [2023-12-26 07:58:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001049296_268623872.pth... [2023-12-26 07:58:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001041888_266723328.pth... [2023-12-26 07:58:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001048304_268369920.pth [2023-12-26 07:58:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001040864_266461184.pth [2023-12-26 07:58:08,887][123091] Updated weights for policy 0, policy_version 1049306 (0.0011) [2023-12-26 07:58:08,939][123091] Updated weights for policy 0, policy_version 1049316 (0.0010) [2023-12-26 07:58:08,993][123091] Updated weights for policy 0, policy_version 1049326 (0.0008) [2023-12-26 07:58:09,357][123090] Updated weights for policy 1, policy_version 1041889 (0.0010) [2023-12-26 07:58:09,430][123090] Updated weights for policy 1, policy_version 1041899 (0.0009) [2023-12-26 07:58:09,488][123090] Updated weights for policy 1, policy_version 1041909 (0.0007) [2023-12-26 07:58:09,561][123090] Updated weights for policy 1, policy_version 1041919 (0.0005) [2023-12-26 07:58:09,771][123091] Updated weights for policy 0, policy_version 1049336 (0.0010) [2023-12-26 07:58:09,843][123091] Updated weights for policy 0, policy_version 1049346 (0.0011) [2023-12-26 07:58:09,914][123091] Updated weights for policy 0, policy_version 1049356 (0.0011) [2023-12-26 07:58:10,279][123090] Updated weights for policy 1, policy_version 1041929 (0.0007) [2023-12-26 07:58:10,343][123090] Updated weights for policy 1, policy_version 1041939 (0.0006) [2023-12-26 07:58:10,403][123090] Updated weights for policy 1, policy_version 1041949 (0.0006) [2023-12-26 07:58:10,738][123091] Updated weights for policy 0, policy_version 1049366 (0.0011) [2023-12-26 07:58:10,801][123091] Updated weights for policy 0, policy_version 1049376 (0.0011) [2023-12-26 07:58:10,864][123091] Updated weights for policy 0, policy_version 1049386 (0.0011) [2023-12-26 07:58:11,176][123090] Updated weights for policy 1, policy_version 1041959 (0.0009) [2023-12-26 07:58:11,237][123090] Updated weights for policy 1, policy_version 1041969 (0.0011) [2023-12-26 07:58:11,306][123090] Updated weights for policy 1, policy_version 1041979 (0.0011) [2023-12-26 07:58:11,726][123091] Updated weights for policy 0, policy_version 1049396 (0.0010) [2023-12-26 07:58:11,798][123091] Updated weights for policy 0, policy_version 1049406 (0.0009) [2023-12-26 07:58:11,850][123091] Updated weights for policy 0, policy_version 1049416 (0.0009) [2023-12-26 07:58:12,136][123090] Updated weights for policy 1, policy_version 1041989 (0.0010) [2023-12-26 07:58:12,203][123090] Updated weights for policy 1, policy_version 1041999 (0.0010) [2023-12-26 07:58:12,275][123090] Updated weights for policy 1, policy_version 1042009 (0.0008) [2023-12-26 07:58:12,765][123091] Updated weights for policy 0, policy_version 1049426 (0.0009) [2023-12-26 07:58:12,831][123091] Updated weights for policy 0, policy_version 1049436 (0.0010) [2023-12-26 07:58:12,904][123091] Updated weights for policy 0, policy_version 1049446 (0.0010) [2023-12-26 07:58:12,963][123091] Updated weights for policy 0, policy_version 1049456 (0.0010) [2023-12-26 07:58:13,020][123090] Updated weights for policy 1, policy_version 1042019 (0.0009) [2023-12-26 07:58:13,087][123090] Updated weights for policy 1, policy_version 1042029 (0.0005) [2023-12-26 07:58:13,134][123090] Updated weights for policy 1, policy_version 1042039 (0.0005) [2023-12-26 07:58:13,720][123090] Updated weights for policy 1, policy_version 1042049 (0.0005) [2023-12-26 07:58:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 535429120. Throughput: 0: 8713.3, 1: 8670.8. Samples: 535428192. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:13,784][121949] Avg episode reward: [(0, '6251.540'), (1, '5350.117')] [2023-12-26 07:58:13,785][123090] Updated weights for policy 1, policy_version 1042059 (0.0008) [2023-12-26 07:58:13,848][123090] Updated weights for policy 1, policy_version 1042069 (0.0010) [2023-12-26 07:58:13,886][123091] Updated weights for policy 0, policy_version 1049466 (0.0007) [2023-12-26 07:58:13,901][123090] Updated weights for policy 1, policy_version 1042079 (0.0010) [2023-12-26 07:58:13,938][123091] Updated weights for policy 0, policy_version 1049476 (0.0007) [2023-12-26 07:58:13,988][123091] Updated weights for policy 0, policy_version 1049486 (0.0010) [2023-12-26 07:58:14,736][123090] Updated weights for policy 1, policy_version 1042089 (0.0010) [2023-12-26 07:58:14,808][123090] Updated weights for policy 1, policy_version 1042099 (0.0010) [2023-12-26 07:58:14,819][123091] Updated weights for policy 0, policy_version 1049496 (0.0007) [2023-12-26 07:58:14,868][123090] Updated weights for policy 1, policy_version 1042109 (0.0011) [2023-12-26 07:58:14,881][123091] Updated weights for policy 0, policy_version 1049506 (0.0006) [2023-12-26 07:58:14,942][123091] Updated weights for policy 0, policy_version 1049516 (0.0009) [2023-12-26 07:58:15,687][123090] Updated weights for policy 1, policy_version 1042119 (0.0010) [2023-12-26 07:58:15,754][123090] Updated weights for policy 1, policy_version 1042129 (0.0011) [2023-12-26 07:58:15,791][123091] Updated weights for policy 0, policy_version 1049526 (0.0008) [2023-12-26 07:58:15,810][123090] Updated weights for policy 1, policy_version 1042139 (0.0010) [2023-12-26 07:58:15,852][123091] Updated weights for policy 0, policy_version 1049536 (0.0007) [2023-12-26 07:58:15,919][123091] Updated weights for policy 0, policy_version 1049546 (0.0008) [2023-12-26 07:58:16,560][123090] Updated weights for policy 1, policy_version 1042149 (0.0010) [2023-12-26 07:58:16,620][123090] Updated weights for policy 1, policy_version 1042159 (0.0011) [2023-12-26 07:58:16,680][123090] Updated weights for policy 1, policy_version 1042169 (0.0010) [2023-12-26 07:58:16,777][123091] Updated weights for policy 0, policy_version 1049556 (0.0009) [2023-12-26 07:58:16,834][123091] Updated weights for policy 0, policy_version 1049566 (0.0007) [2023-12-26 07:58:16,880][123091] Updated weights for policy 0, policy_version 1049576 (0.0005) [2023-12-26 07:58:17,389][123090] Updated weights for policy 1, policy_version 1042179 (0.0009) [2023-12-26 07:58:17,458][123090] Updated weights for policy 1, policy_version 1042189 (0.0008) [2023-12-26 07:58:17,504][123090] Updated weights for policy 1, policy_version 1042199 (0.0007) [2023-12-26 07:58:17,754][123091] Updated weights for policy 0, policy_version 1049587 (0.0010) [2023-12-26 07:58:17,817][123091] Updated weights for policy 0, policy_version 1049597 (0.0010) [2023-12-26 07:58:17,877][123091] Updated weights for policy 0, policy_version 1049607 (0.0009) [2023-12-26 07:58:18,265][123090] Updated weights for policy 1, policy_version 1042209 (0.0006) [2023-12-26 07:58:18,343][123090] Updated weights for policy 1, policy_version 1042219 (0.0011) [2023-12-26 07:58:18,416][123090] Updated weights for policy 1, policy_version 1042229 (0.0011) [2023-12-26 07:58:18,478][123090] Updated weights for policy 1, policy_version 1042239 (0.0007) [2023-12-26 07:58:18,741][123091] Updated weights for policy 0, policy_version 1049617 (0.0009) [2023-12-26 07:58:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 535519232. Throughput: 0: 8632.3, 1: 8785.6. Samples: 535533180. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:18,785][121949] Avg episode reward: [(0, '6191.467'), (1, '5331.975')] [2023-12-26 07:58:18,795][123091] Updated weights for policy 0, policy_version 1049627 (0.0006) [2023-12-26 07:58:18,861][123091] Updated weights for policy 0, policy_version 1049637 (0.0007) [2023-12-26 07:58:18,924][123091] Updated weights for policy 0, policy_version 1049647 (0.0011) [2023-12-26 07:58:19,138][123090] Updated weights for policy 1, policy_version 1042249 (0.0006) [2023-12-26 07:58:19,195][123090] Updated weights for policy 1, policy_version 1042259 (0.0005) [2023-12-26 07:58:19,265][123090] Updated weights for policy 1, policy_version 1042269 (0.0007) [2023-12-26 07:58:19,837][123091] Updated weights for policy 0, policy_version 1049657 (0.0010) [2023-12-26 07:58:19,905][123091] Updated weights for policy 0, policy_version 1049667 (0.0009) [2023-12-26 07:58:19,969][123091] Updated weights for policy 0, policy_version 1049677 (0.0009) [2023-12-26 07:58:20,026][123090] Updated weights for policy 1, policy_version 1042279 (0.0008) [2023-12-26 07:58:20,084][123090] Updated weights for policy 1, policy_version 1042289 (0.0006) [2023-12-26 07:58:20,146][123090] Updated weights for policy 1, policy_version 1042299 (0.0006) [2023-12-26 07:58:20,826][123091] Updated weights for policy 0, policy_version 1049687 (0.0007) [2023-12-26 07:58:20,858][123090] Updated weights for policy 1, policy_version 1042309 (0.0008) [2023-12-26 07:58:20,890][123091] Updated weights for policy 0, policy_version 1049697 (0.0007) [2023-12-26 07:58:20,927][123090] Updated weights for policy 1, policy_version 1042319 (0.0010) [2023-12-26 07:58:20,959][123091] Updated weights for policy 0, policy_version 1049707 (0.0009) [2023-12-26 07:58:20,987][123090] Updated weights for policy 1, policy_version 1042329 (0.0011) [2023-12-26 07:58:21,784][123091] Updated weights for policy 0, policy_version 1049717 (0.0007) [2023-12-26 07:58:21,808][123090] Updated weights for policy 1, policy_version 1042339 (0.0011) [2023-12-26 07:58:21,833][123091] Updated weights for policy 0, policy_version 1049727 (0.0007) [2023-12-26 07:58:21,862][123090] Updated weights for policy 1, policy_version 1042349 (0.0008) [2023-12-26 07:58:21,886][123091] Updated weights for policy 0, policy_version 1049737 (0.0008) [2023-12-26 07:58:21,915][123090] Updated weights for policy 1, policy_version 1042359 (0.0011) [2023-12-26 07:58:22,712][123091] Updated weights for policy 0, policy_version 1049747 (0.0007) [2023-12-26 07:58:22,761][123090] Updated weights for policy 1, policy_version 1042369 (0.0011) [2023-12-26 07:58:22,765][123091] Updated weights for policy 0, policy_version 1049757 (0.0009) [2023-12-26 07:58:22,823][123091] Updated weights for policy 0, policy_version 1049767 (0.0005) [2023-12-26 07:58:22,830][123090] Updated weights for policy 1, policy_version 1042379 (0.0011) [2023-12-26 07:58:22,894][123090] Updated weights for policy 1, policy_version 1042389 (0.0011) [2023-12-26 07:58:22,956][123090] Updated weights for policy 1, policy_version 1042399 (0.0011) [2023-12-26 07:58:23,642][123090] Updated weights for policy 1, policy_version 1042409 (0.0008) [2023-12-26 07:58:23,691][123091] Updated weights for policy 0, policy_version 1049777 (0.0008) [2023-12-26 07:58:23,702][123090] Updated weights for policy 1, policy_version 1042419 (0.0009) [2023-12-26 07:58:23,743][123091] Updated weights for policy 0, policy_version 1049787 (0.0010) [2023-12-26 07:58:23,750][123090] Updated weights for policy 1, policy_version 1042429 (0.0008) [2023-12-26 07:58:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 535609344. Throughput: 0: 8584.4, 1: 8807.3. Samples: 535585368. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:23,785][121949] Avg episode reward: [(0, '6241.143'), (1, '5501.567')] [2023-12-26 07:58:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001042432_266862592.pth... [2023-12-26 07:58:23,794][123091] Updated weights for policy 0, policy_version 1049797 (0.0011) [2023-12-26 07:58:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001041376_266592256.pth [2023-12-26 07:58:23,845][123091] Updated weights for policy 0, policy_version 1049807 (0.0009) [2023-12-26 07:58:23,846][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001049808_268754944.pth... [2023-12-26 07:58:23,849][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001048784_268492800.pth [2023-12-26 07:58:24,543][123090] Updated weights for policy 1, policy_version 1042439 (0.0010) [2023-12-26 07:58:24,600][123090] Updated weights for policy 1, policy_version 1042449 (0.0010) [2023-12-26 07:58:24,661][123090] Updated weights for policy 1, policy_version 1042459 (0.0009) [2023-12-26 07:58:24,722][123091] Updated weights for policy 0, policy_version 1049817 (0.0009) [2023-12-26 07:58:24,774][123091] Updated weights for policy 0, policy_version 1049827 (0.0009) [2023-12-26 07:58:24,830][123091] Updated weights for policy 0, policy_version 1049837 (0.0010) [2023-12-26 07:58:25,315][123090] Updated weights for policy 1, policy_version 1042469 (0.0005) [2023-12-26 07:58:25,384][123090] Updated weights for policy 1, policy_version 1042479 (0.0005) [2023-12-26 07:58:25,438][123090] Updated weights for policy 1, policy_version 1042489 (0.0005) [2023-12-26 07:58:25,731][123091] Updated weights for policy 0, policy_version 1049847 (0.0010) [2023-12-26 07:58:25,787][123091] Updated weights for policy 0, policy_version 1049857 (0.0010) [2023-12-26 07:58:25,850][123091] Updated weights for policy 0, policy_version 1049867 (0.0010) [2023-12-26 07:58:26,116][123090] Updated weights for policy 1, policy_version 1042499 (0.0005) [2023-12-26 07:58:26,183][123090] Updated weights for policy 1, policy_version 1042509 (0.0005) [2023-12-26 07:58:26,232][123090] Updated weights for policy 1, policy_version 1042519 (0.0005) [2023-12-26 07:58:26,731][123091] Updated weights for policy 0, policy_version 1049877 (0.0009) [2023-12-26 07:58:26,783][123091] Updated weights for policy 0, policy_version 1049887 (0.0009) [2023-12-26 07:58:26,804][123090] Updated weights for policy 1, policy_version 1042529 (0.0005) [2023-12-26 07:58:26,843][123091] Updated weights for policy 0, policy_version 1049897 (0.0008) [2023-12-26 07:58:26,857][123090] Updated weights for policy 1, policy_version 1042539 (0.0005) [2023-12-26 07:58:26,908][123090] Updated weights for policy 1, policy_version 1042549 (0.0005) [2023-12-26 07:58:26,967][123090] Updated weights for policy 1, policy_version 1042559 (0.0005) [2023-12-26 07:58:27,700][123090] Updated weights for policy 1, policy_version 1042569 (0.0009) [2023-12-26 07:58:27,718][123091] Updated weights for policy 0, policy_version 1049907 (0.0009) [2023-12-26 07:58:27,749][123090] Updated weights for policy 1, policy_version 1042579 (0.0009) [2023-12-26 07:58:27,777][123091] Updated weights for policy 0, policy_version 1049917 (0.0008) [2023-12-26 07:58:27,806][123090] Updated weights for policy 1, policy_version 1042589 (0.0007) [2023-12-26 07:58:27,832][123091] Updated weights for policy 0, policy_version 1049927 (0.0008) [2023-12-26 07:58:28,586][123091] Updated weights for policy 0, policy_version 1049937 (0.0010) [2023-12-26 07:58:28,653][123091] Updated weights for policy 0, policy_version 1049947 (0.0009) [2023-12-26 07:58:28,685][123090] Updated weights for policy 1, policy_version 1042599 (0.0009) [2023-12-26 07:58:28,716][123091] Updated weights for policy 0, policy_version 1049957 (0.0008) [2023-12-26 07:58:28,747][123090] Updated weights for policy 1, policy_version 1042609 (0.0007) [2023-12-26 07:58:28,776][123091] Updated weights for policy 0, policy_version 1049967 (0.0009) [2023-12-26 07:58:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17613.8, 300 sec: 17716.9). Total num frames: 535699456. Throughput: 0: 8539.2, 1: 9006.3. Samples: 535693628. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:28,784][121949] Avg episode reward: [(0, '6190.968'), (1, '5656.775')] [2023-12-26 07:58:28,805][123090] Updated weights for policy 1, policy_version 1042619 (0.0008) [2023-12-26 07:58:29,609][123091] Updated weights for policy 0, policy_version 1049977 (0.0009) [2023-12-26 07:58:29,634][123090] Updated weights for policy 1, policy_version 1042629 (0.0008) [2023-12-26 07:58:29,667][123091] Updated weights for policy 0, policy_version 1049987 (0.0007) [2023-12-26 07:58:29,695][123090] Updated weights for policy 1, policy_version 1042639 (0.0009) [2023-12-26 07:58:29,729][123091] Updated weights for policy 0, policy_version 1049997 (0.0008) [2023-12-26 07:58:29,754][123090] Updated weights for policy 1, policy_version 1042649 (0.0008) [2023-12-26 07:58:30,472][123091] Updated weights for policy 0, policy_version 1050007 (0.0006) [2023-12-26 07:58:30,526][123091] Updated weights for policy 0, policy_version 1050017 (0.0006) [2023-12-26 07:58:30,581][123091] Updated weights for policy 0, policy_version 1050027 (0.0005) [2023-12-26 07:58:30,619][123090] Updated weights for policy 1, policy_version 1042659 (0.0010) [2023-12-26 07:58:30,677][123090] Updated weights for policy 1, policy_version 1042669 (0.0010) [2023-12-26 07:58:30,737][123090] Updated weights for policy 1, policy_version 1042679 (0.0010) [2023-12-26 07:58:31,242][123091] Updated weights for policy 0, policy_version 1050037 (0.0006) [2023-12-26 07:58:31,304][123091] Updated weights for policy 0, policy_version 1050047 (0.0006) [2023-12-26 07:58:31,370][123091] Updated weights for policy 0, policy_version 1050057 (0.0006) [2023-12-26 07:58:31,493][123090] Updated weights for policy 1, policy_version 1042689 (0.0010) [2023-12-26 07:58:31,547][123090] Updated weights for policy 1, policy_version 1042699 (0.0008) [2023-12-26 07:58:31,594][123090] Updated weights for policy 1, policy_version 1042709 (0.0006) [2023-12-26 07:58:31,659][123090] Updated weights for policy 1, policy_version 1042719 (0.0011) [2023-12-26 07:58:32,102][123091] Updated weights for policy 0, policy_version 1050067 (0.0009) [2023-12-26 07:58:32,169][123091] Updated weights for policy 0, policy_version 1050077 (0.0007) [2023-12-26 07:58:32,240][123091] Updated weights for policy 0, policy_version 1050087 (0.0005) [2023-12-26 07:58:32,374][123090] Updated weights for policy 1, policy_version 1042729 (0.0008) [2023-12-26 07:58:32,440][123090] Updated weights for policy 1, policy_version 1042739 (0.0007) [2023-12-26 07:58:32,497][123090] Updated weights for policy 1, policy_version 1042749 (0.0006) [2023-12-26 07:58:33,027][123091] Updated weights for policy 0, policy_version 1050097 (0.0006) [2023-12-26 07:58:33,092][123091] Updated weights for policy 0, policy_version 1050107 (0.0009) [2023-12-26 07:58:33,154][123091] Updated weights for policy 0, policy_version 1050117 (0.0009) [2023-12-26 07:58:33,214][123090] Updated weights for policy 1, policy_version 1042759 (0.0008) [2023-12-26 07:58:33,214][123091] Updated weights for policy 0, policy_version 1050127 (0.0008) [2023-12-26 07:58:33,265][123090] Updated weights for policy 1, policy_version 1042769 (0.0009) [2023-12-26 07:58:33,321][123090] Updated weights for policy 1, policy_version 1042780 (0.0009) [2023-12-26 07:58:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 535789568. Throughput: 0: 8647.8, 1: 9002.8. Samples: 535802208. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:33,785][121949] Avg episode reward: [(0, '6187.544'), (1, '5441.874')] [2023-12-26 07:58:34,001][123091] Updated weights for policy 0, policy_version 1050137 (0.0006) [2023-12-26 07:58:34,064][123091] Updated weights for policy 0, policy_version 1050147 (0.0005) [2023-12-26 07:58:34,128][123091] Updated weights for policy 0, policy_version 1050157 (0.0007) [2023-12-26 07:58:34,208][123090] Updated weights for policy 1, policy_version 1042790 (0.0008) [2023-12-26 07:58:34,273][123090] Updated weights for policy 1, policy_version 1042800 (0.0006) [2023-12-26 07:58:34,343][123090] Updated weights for policy 1, policy_version 1042810 (0.0008) [2023-12-26 07:58:34,917][123091] Updated weights for policy 0, policy_version 1050167 (0.0009) [2023-12-26 07:58:34,978][123091] Updated weights for policy 0, policy_version 1050177 (0.0009) [2023-12-26 07:58:35,004][123090] Updated weights for policy 1, policy_version 1042820 (0.0007) [2023-12-26 07:58:35,040][123091] Updated weights for policy 0, policy_version 1050187 (0.0009) [2023-12-26 07:58:35,075][123090] Updated weights for policy 1, policy_version 1042830 (0.0005) [2023-12-26 07:58:35,141][123090] Updated weights for policy 1, policy_version 1042840 (0.0009) [2023-12-26 07:58:35,808][123091] Updated weights for policy 0, policy_version 1050197 (0.0010) [2023-12-26 07:58:35,870][123091] Updated weights for policy 0, policy_version 1050207 (0.0009) [2023-12-26 07:58:35,917][123090] Updated weights for policy 1, policy_version 1042850 (0.0009) [2023-12-26 07:58:35,935][123091] Updated weights for policy 0, policy_version 1050217 (0.0010) [2023-12-26 07:58:35,984][123090] Updated weights for policy 1, policy_version 1042860 (0.0009) [2023-12-26 07:58:36,038][123090] Updated weights for policy 1, policy_version 1042870 (0.0009) [2023-12-26 07:58:36,090][123090] Updated weights for policy 1, policy_version 1042880 (0.0009) [2023-12-26 07:58:36,734][123091] Updated weights for policy 0, policy_version 1050227 (0.0007) [2023-12-26 07:58:36,803][123091] Updated weights for policy 0, policy_version 1050237 (0.0010) [2023-12-26 07:58:36,866][123091] Updated weights for policy 0, policy_version 1050247 (0.0009) [2023-12-26 07:58:36,918][123090] Updated weights for policy 1, policy_version 1042890 (0.0005) [2023-12-26 07:58:36,974][123090] Updated weights for policy 1, policy_version 1042900 (0.0005) [2023-12-26 07:58:37,040][123090] Updated weights for policy 1, policy_version 1042910 (0.0005) [2023-12-26 07:58:37,740][123091] Updated weights for policy 0, policy_version 1050257 (0.0009) [2023-12-26 07:58:37,767][123090] Updated weights for policy 1, policy_version 1042920 (0.0005) [2023-12-26 07:58:37,800][123091] Updated weights for policy 0, policy_version 1050267 (0.0009) [2023-12-26 07:58:37,821][123090] Updated weights for policy 1, policy_version 1042930 (0.0005) [2023-12-26 07:58:37,863][123091] Updated weights for policy 0, policy_version 1050277 (0.0009) [2023-12-26 07:58:37,875][123090] Updated weights for policy 1, policy_version 1042940 (0.0006) [2023-12-26 07:58:37,921][123091] Updated weights for policy 0, policy_version 1050287 (0.0008) [2023-12-26 07:58:38,650][123090] Updated weights for policy 1, policy_version 1042950 (0.0009) [2023-12-26 07:58:38,695][123091] Updated weights for policy 0, policy_version 1050297 (0.0005) [2023-12-26 07:58:38,718][123090] Updated weights for policy 1, policy_version 1042960 (0.0011) [2023-12-26 07:58:38,755][123091] Updated weights for policy 0, policy_version 1050307 (0.0006) [2023-12-26 07:58:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 535871488. Throughput: 0: 8663.2, 1: 9038.9. Samples: 535855464. Policy #0 lag: (min: 5.0, avg: 15.1, max: 37.0) [2023-12-26 07:58:38,785][121949] Avg episode reward: [(0, '6147.393'), (1, '5080.720')] [2023-12-26 07:58:38,791][123090] Updated weights for policy 1, policy_version 1042970 (0.0011) [2023-12-26 07:58:38,811][123091] Updated weights for policy 0, policy_version 1050317 (0.0006) [2023-12-26 07:58:38,827][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001042976_267001856.pth... [2023-12-26 07:58:38,830][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001041888_266723328.pth [2023-12-26 07:58:38,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001050320_268886016.pth... [2023-12-26 07:58:38,835][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001049296_268623872.pth [2023-12-26 07:58:39,527][123090] Updated weights for policy 1, policy_version 1042980 (0.0008) [2023-12-26 07:58:39,595][123090] Updated weights for policy 1, policy_version 1042990 (0.0011) [2023-12-26 07:58:39,661][123090] Updated weights for policy 1, policy_version 1043000 (0.0005) [2023-12-26 07:58:39,665][123091] Updated weights for policy 0, policy_version 1050327 (0.0009) [2023-12-26 07:58:39,728][123091] Updated weights for policy 0, policy_version 1050337 (0.0009) [2023-12-26 07:58:39,792][123091] Updated weights for policy 0, policy_version 1050347 (0.0010) [2023-12-26 07:58:40,491][123090] Updated weights for policy 1, policy_version 1043010 (0.0008) [2023-12-26 07:58:40,562][123090] Updated weights for policy 1, policy_version 1043020 (0.0010) [2023-12-26 07:58:40,605][123091] Updated weights for policy 0, policy_version 1050357 (0.0007) [2023-12-26 07:58:40,628][123090] Updated weights for policy 1, policy_version 1043030 (0.0010) [2023-12-26 07:58:40,658][123091] Updated weights for policy 0, policy_version 1050367 (0.0005) [2023-12-26 07:58:40,677][123090] Updated weights for policy 1, policy_version 1043040 (0.0009) [2023-12-26 07:58:40,707][123091] Updated weights for policy 0, policy_version 1050377 (0.0005) [2023-12-26 07:58:41,316][123091] Updated weights for policy 0, policy_version 1050387 (0.0006) [2023-12-26 07:58:41,392][123091] Updated weights for policy 0, policy_version 1050397 (0.0010) [2023-12-26 07:58:41,459][123091] Updated weights for policy 0, policy_version 1050407 (0.0010) [2023-12-26 07:58:41,565][123090] Updated weights for policy 1, policy_version 1043050 (0.0010) [2023-12-26 07:58:41,634][123090] Updated weights for policy 1, policy_version 1043060 (0.0010) [2023-12-26 07:58:41,705][123090] Updated weights for policy 1, policy_version 1043070 (0.0008) [2023-12-26 07:58:42,230][123091] Updated weights for policy 0, policy_version 1050417 (0.0009) [2023-12-26 07:58:42,297][123091] Updated weights for policy 0, policy_version 1050427 (0.0008) [2023-12-26 07:58:42,361][123091] Updated weights for policy 0, policy_version 1050437 (0.0009) [2023-12-26 07:58:42,412][123091] Updated weights for policy 0, policy_version 1050447 (0.0008) [2023-12-26 07:58:42,591][123090] Updated weights for policy 1, policy_version 1043080 (0.0010) [2023-12-26 07:58:42,657][123090] Updated weights for policy 1, policy_version 1043090 (0.0008) [2023-12-26 07:58:42,727][123090] Updated weights for policy 1, policy_version 1043100 (0.0005) [2023-12-26 07:58:43,203][123091] Updated weights for policy 0, policy_version 1050457 (0.0006) [2023-12-26 07:58:43,251][123091] Updated weights for policy 0, policy_version 1050467 (0.0007) [2023-12-26 07:58:43,301][123091] Updated weights for policy 0, policy_version 1050477 (0.0009) [2023-12-26 07:58:43,541][123090] Updated weights for policy 1, policy_version 1043110 (0.0008) [2023-12-26 07:58:43,589][123090] Updated weights for policy 1, policy_version 1043120 (0.0009) [2023-12-26 07:58:43,637][123090] Updated weights for policy 1, policy_version 1043130 (0.0009) [2023-12-26 07:58:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 535969792. Throughput: 0: 8559.1, 1: 8923.4. Samples: 535959868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:58:43,784][121949] Avg episode reward: [(0, '6250.551'), (1, '5194.142')] [2023-12-26 07:58:44,130][123091] Updated weights for policy 0, policy_version 1050487 (0.0008) [2023-12-26 07:58:44,179][123091] Updated weights for policy 0, policy_version 1050497 (0.0009) [2023-12-26 07:58:44,233][123091] Updated weights for policy 0, policy_version 1050507 (0.0009) [2023-12-26 07:58:44,476][123090] Updated weights for policy 1, policy_version 1043140 (0.0008) [2023-12-26 07:58:44,544][123090] Updated weights for policy 1, policy_version 1043150 (0.0010) [2023-12-26 07:58:44,612][123090] Updated weights for policy 1, policy_version 1043160 (0.0008) [2023-12-26 07:58:45,111][123091] Updated weights for policy 0, policy_version 1050517 (0.0009) [2023-12-26 07:58:45,166][123091] Updated weights for policy 0, policy_version 1050527 (0.0010) [2023-12-26 07:58:45,227][123091] Updated weights for policy 0, policy_version 1050537 (0.0010) [2023-12-26 07:58:45,418][123090] Updated weights for policy 1, policy_version 1043170 (0.0010) [2023-12-26 07:58:45,486][123090] Updated weights for policy 1, policy_version 1043180 (0.0009) [2023-12-26 07:58:45,542][123090] Updated weights for policy 1, policy_version 1043190 (0.0009) [2023-12-26 07:58:45,597][123090] Updated weights for policy 1, policy_version 1043200 (0.0009) [2023-12-26 07:58:46,125][123091] Updated weights for policy 0, policy_version 1050547 (0.0010) [2023-12-26 07:58:46,184][123091] Updated weights for policy 0, policy_version 1050557 (0.0009) [2023-12-26 07:58:46,236][123091] Updated weights for policy 0, policy_version 1050567 (0.0009) [2023-12-26 07:58:46,334][123090] Updated weights for policy 1, policy_version 1043210 (0.0009) [2023-12-26 07:58:46,396][123090] Updated weights for policy 1, policy_version 1043220 (0.0009) [2023-12-26 07:58:46,457][123090] Updated weights for policy 1, policy_version 1043230 (0.0008) [2023-12-26 07:58:47,103][123091] Updated weights for policy 0, policy_version 1050577 (0.0009) [2023-12-26 07:58:47,145][123090] Updated weights for policy 1, policy_version 1043240 (0.0005) [2023-12-26 07:58:47,166][123091] Updated weights for policy 0, policy_version 1050587 (0.0009) [2023-12-26 07:58:47,195][123090] Updated weights for policy 1, policy_version 1043250 (0.0006) [2023-12-26 07:58:47,232][123091] Updated weights for policy 0, policy_version 1050597 (0.0010) [2023-12-26 07:58:47,244][123090] Updated weights for policy 1, policy_version 1043260 (0.0005) [2023-12-26 07:58:47,293][123091] Updated weights for policy 0, policy_version 1050607 (0.0009) [2023-12-26 07:58:47,948][123090] Updated weights for policy 1, policy_version 1043270 (0.0005) [2023-12-26 07:58:48,017][123090] Updated weights for policy 1, policy_version 1043280 (0.0007) [2023-12-26 07:58:48,090][123090] Updated weights for policy 1, policy_version 1043290 (0.0006) [2023-12-26 07:58:48,245][123091] Updated weights for policy 0, policy_version 1050617 (0.0010) [2023-12-26 07:58:48,315][123091] Updated weights for policy 0, policy_version 1050627 (0.0010) [2023-12-26 07:58:48,389][123091] Updated weights for policy 0, policy_version 1050637 (0.0009) [2023-12-26 07:58:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 536051712. Throughput: 0: 8522.3, 1: 9058.1. Samples: 536064596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:58:48,785][121949] Avg episode reward: [(0, '6384.806'), (1, '5718.723')] [2023-12-26 07:58:48,842][123090] Updated weights for policy 1, policy_version 1043300 (0.0008) [2023-12-26 07:58:48,906][123090] Updated weights for policy 1, policy_version 1043310 (0.0011) [2023-12-26 07:58:48,973][123090] Updated weights for policy 1, policy_version 1043320 (0.0011) [2023-12-26 07:58:49,178][123091] Updated weights for policy 0, policy_version 1050647 (0.0005) [2023-12-26 07:58:49,239][123091] Updated weights for policy 0, policy_version 1050657 (0.0007) [2023-12-26 07:58:49,302][123091] Updated weights for policy 0, policy_version 1050667 (0.0007) [2023-12-26 07:58:49,768][123090] Updated weights for policy 1, policy_version 1043330 (0.0010) [2023-12-26 07:58:49,825][123090] Updated weights for policy 1, policy_version 1043340 (0.0008) [2023-12-26 07:58:49,893][123090] Updated weights for policy 1, policy_version 1043350 (0.0008) [2023-12-26 07:58:49,958][123090] Updated weights for policy 1, policy_version 1043360 (0.0009) [2023-12-26 07:58:50,179][123091] Updated weights for policy 0, policy_version 1050677 (0.0009) [2023-12-26 07:58:50,242][123091] Updated weights for policy 0, policy_version 1050687 (0.0010) [2023-12-26 07:58:50,297][123091] Updated weights for policy 0, policy_version 1050698 (0.0010) [2023-12-26 07:58:50,627][123090] Updated weights for policy 1, policy_version 1043370 (0.0009) [2023-12-26 07:58:50,692][123090] Updated weights for policy 1, policy_version 1043380 (0.0010) [2023-12-26 07:58:50,758][123090] Updated weights for policy 1, policy_version 1043390 (0.0010) [2023-12-26 07:58:51,190][123091] Updated weights for policy 0, policy_version 1050708 (0.0010) [2023-12-26 07:58:51,262][123091] Updated weights for policy 0, policy_version 1050718 (0.0009) [2023-12-26 07:58:51,332][123091] Updated weights for policy 0, policy_version 1050728 (0.0010) [2023-12-26 07:58:51,580][123090] Updated weights for policy 1, policy_version 1043400 (0.0010) [2023-12-26 07:58:51,645][123090] Updated weights for policy 1, policy_version 1043410 (0.0011) [2023-12-26 07:58:51,715][123090] Updated weights for policy 1, policy_version 1043420 (0.0010) [2023-12-26 07:58:52,159][123091] Updated weights for policy 0, policy_version 1050738 (0.0009) [2023-12-26 07:58:52,216][123091] Updated weights for policy 0, policy_version 1050748 (0.0009) [2023-12-26 07:58:52,290][123091] Updated weights for policy 0, policy_version 1050758 (0.0010) [2023-12-26 07:58:52,354][123091] Updated weights for policy 0, policy_version 1050768 (0.0010) [2023-12-26 07:58:52,426][123090] Updated weights for policy 1, policy_version 1043430 (0.0008) [2023-12-26 07:58:52,488][123090] Updated weights for policy 1, policy_version 1043440 (0.0008) [2023-12-26 07:58:52,555][123090] Updated weights for policy 1, policy_version 1043450 (0.0006) [2023-12-26 07:58:53,265][123091] Updated weights for policy 0, policy_version 1050778 (0.0009) [2023-12-26 07:58:53,274][123090] Updated weights for policy 1, policy_version 1043460 (0.0005) [2023-12-26 07:58:53,323][123091] Updated weights for policy 0, policy_version 1050788 (0.0008) [2023-12-26 07:58:53,330][123090] Updated weights for policy 1, policy_version 1043470 (0.0006) [2023-12-26 07:58:53,372][123091] Updated weights for policy 0, policy_version 1050798 (0.0007) [2023-12-26 07:58:53,393][123090] Updated weights for policy 1, policy_version 1043480 (0.0008) [2023-12-26 07:58:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17717.0). Total num frames: 536141824. Throughput: 0: 8501.0, 1: 9102.6. Samples: 536116360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:58:53,785][121949] Avg episode reward: [(0, '6374.007'), (1, '5861.070')] [2023-12-26 07:58:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001043488_267132928.pth... [2023-12-26 07:58:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001050800_269008896.pth... [2023-12-26 07:58:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001042432_266862592.pth [2023-12-26 07:58:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001049808_268754944.pth [2023-12-26 07:58:54,158][123090] Updated weights for policy 1, policy_version 1043490 (0.0008) [2023-12-26 07:58:54,204][123091] Updated weights for policy 0, policy_version 1050808 (0.0009) [2023-12-26 07:58:54,209][123090] Updated weights for policy 1, policy_version 1043500 (0.0005) [2023-12-26 07:58:54,264][123091] Updated weights for policy 0, policy_version 1050818 (0.0008) [2023-12-26 07:58:54,266][123090] Updated weights for policy 1, policy_version 1043510 (0.0007) [2023-12-26 07:58:54,315][123090] Updated weights for policy 1, policy_version 1043520 (0.0007) [2023-12-26 07:58:54,317][123091] Updated weights for policy 0, policy_version 1050828 (0.0008) [2023-12-26 07:58:55,098][123090] Updated weights for policy 1, policy_version 1043530 (0.0006) [2023-12-26 07:58:55,168][123090] Updated weights for policy 1, policy_version 1043540 (0.0005) [2023-12-26 07:58:55,192][123091] Updated weights for policy 0, policy_version 1050838 (0.0010) [2023-12-26 07:58:55,235][123090] Updated weights for policy 1, policy_version 1043550 (0.0006) [2023-12-26 07:58:55,255][123091] Updated weights for policy 0, policy_version 1050848 (0.0008) [2023-12-26 07:58:55,303][123091] Updated weights for policy 0, policy_version 1050858 (0.0009) [2023-12-26 07:58:55,987][123090] Updated weights for policy 1, policy_version 1043560 (0.0010) [2023-12-26 07:58:56,058][123090] Updated weights for policy 1, policy_version 1043570 (0.0011) [2023-12-26 07:58:56,129][123090] Updated weights for policy 1, policy_version 1043580 (0.0010) [2023-12-26 07:58:56,156][123091] Updated weights for policy 0, policy_version 1050868 (0.0007) [2023-12-26 07:58:56,208][123091] Updated weights for policy 0, policy_version 1050878 (0.0009) [2023-12-26 07:58:56,272][123091] Updated weights for policy 0, policy_version 1050888 (0.0009) [2023-12-26 07:58:56,933][123090] Updated weights for policy 1, policy_version 1043590 (0.0010) [2023-12-26 07:58:56,985][123090] Updated weights for policy 1, policy_version 1043600 (0.0010) [2023-12-26 07:58:57,036][123090] Updated weights for policy 1, policy_version 1043610 (0.0010) [2023-12-26 07:58:57,104][123091] Updated weights for policy 0, policy_version 1050898 (0.0008) [2023-12-26 07:58:57,151][123091] Updated weights for policy 0, policy_version 1050908 (0.0005) [2023-12-26 07:58:57,195][123091] Updated weights for policy 0, policy_version 1050918 (0.0005) [2023-12-26 07:58:57,241][123091] Updated weights for policy 0, policy_version 1050928 (0.0005) [2023-12-26 07:58:57,855][123090] Updated weights for policy 1, policy_version 1043620 (0.0010) [2023-12-26 07:58:57,910][123090] Updated weights for policy 1, policy_version 1043630 (0.0010) [2023-12-26 07:58:57,968][123090] Updated weights for policy 1, policy_version 1043640 (0.0010) [2023-12-26 07:58:58,063][123091] Updated weights for policy 0, policy_version 1050938 (0.0008) [2023-12-26 07:58:58,131][123091] Updated weights for policy 0, policy_version 1050948 (0.0009) [2023-12-26 07:58:58,200][123091] Updated weights for policy 0, policy_version 1050958 (0.0009) [2023-12-26 07:58:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 536223744. Throughput: 0: 8498.5, 1: 9133.8. Samples: 536221648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:58:58,785][121949] Avg episode reward: [(0, '6247.264'), (1, '5716.607')] [2023-12-26 07:58:58,978][123090] Updated weights for policy 1, policy_version 1043650 (0.0010) [2023-12-26 07:58:58,996][123091] Updated weights for policy 0, policy_version 1050968 (0.0008) [2023-12-26 07:58:59,042][123090] Updated weights for policy 1, policy_version 1043660 (0.0009) [2023-12-26 07:58:59,062][123091] Updated weights for policy 0, policy_version 1050978 (0.0008) [2023-12-26 07:58:59,104][123090] Updated weights for policy 1, policy_version 1043670 (0.0009) [2023-12-26 07:58:59,123][123091] Updated weights for policy 0, policy_version 1050988 (0.0008) [2023-12-26 07:58:59,173][123090] Updated weights for policy 1, policy_version 1043680 (0.0009) [2023-12-26 07:58:59,802][123091] Updated weights for policy 0, policy_version 1050998 (0.0007) [2023-12-26 07:58:59,867][123091] Updated weights for policy 0, policy_version 1051008 (0.0010) [2023-12-26 07:58:59,929][123091] Updated weights for policy 0, policy_version 1051018 (0.0010) [2023-12-26 07:59:00,061][123090] Updated weights for policy 1, policy_version 1043690 (0.0009) [2023-12-26 07:59:00,113][123090] Updated weights for policy 1, policy_version 1043700 (0.0010) [2023-12-26 07:59:00,170][123090] Updated weights for policy 1, policy_version 1043710 (0.0010) [2023-12-26 07:59:00,723][123091] Updated weights for policy 0, policy_version 1051028 (0.0010) [2023-12-26 07:59:00,776][123091] Updated weights for policy 0, policy_version 1051038 (0.0010) [2023-12-26 07:59:00,828][123091] Updated weights for policy 0, policy_version 1051048 (0.0010) [2023-12-26 07:59:00,954][123090] Updated weights for policy 1, policy_version 1043720 (0.0006) [2023-12-26 07:59:01,004][123090] Updated weights for policy 1, policy_version 1043730 (0.0005) [2023-12-26 07:59:01,071][123090] Updated weights for policy 1, policy_version 1043740 (0.0007) [2023-12-26 07:59:01,752][123090] Updated weights for policy 1, policy_version 1043750 (0.0007) [2023-12-26 07:59:01,775][123091] Updated weights for policy 0, policy_version 1051058 (0.0009) [2023-12-26 07:59:01,825][123090] Updated weights for policy 1, policy_version 1043760 (0.0006) [2023-12-26 07:59:01,838][123091] Updated weights for policy 0, policy_version 1051068 (0.0009) [2023-12-26 07:59:01,887][123090] Updated weights for policy 1, policy_version 1043770 (0.0007) [2023-12-26 07:59:01,902][123091] Updated weights for policy 0, policy_version 1051078 (0.0008) [2023-12-26 07:59:01,958][123091] Updated weights for policy 0, policy_version 1051088 (0.0009) [2023-12-26 07:59:02,564][123090] Updated weights for policy 1, policy_version 1043780 (0.0007) [2023-12-26 07:59:02,625][123090] Updated weights for policy 1, policy_version 1043790 (0.0006) [2023-12-26 07:59:02,688][123090] Updated weights for policy 1, policy_version 1043800 (0.0005) [2023-12-26 07:59:02,868][123091] Updated weights for policy 0, policy_version 1051098 (0.0009) [2023-12-26 07:59:02,922][123091] Updated weights for policy 0, policy_version 1051108 (0.0009) [2023-12-26 07:59:02,976][123091] Updated weights for policy 0, policy_version 1051119 (0.0010) [2023-12-26 07:59:03,387][123090] Updated weights for policy 1, policy_version 1043810 (0.0006) [2023-12-26 07:59:03,455][123090] Updated weights for policy 1, policy_version 1043820 (0.0009) [2023-12-26 07:59:03,521][123090] Updated weights for policy 1, policy_version 1043830 (0.0009) [2023-12-26 07:59:03,589][123090] Updated weights for policy 1, policy_version 1043840 (0.0010) [2023-12-26 07:59:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 536313856. Throughput: 0: 8539.5, 1: 9071.8. Samples: 536325688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:03,785][121949] Avg episode reward: [(0, '6046.014'), (1, '5484.581')] [2023-12-26 07:59:03,865][123091] Updated weights for policy 0, policy_version 1051129 (0.0009) [2023-12-26 07:59:03,923][123091] Updated weights for policy 0, policy_version 1051139 (0.0009) [2023-12-26 07:59:03,973][123091] Updated weights for policy 0, policy_version 1051149 (0.0009) [2023-12-26 07:59:04,411][123090] Updated weights for policy 1, policy_version 1043850 (0.0010) [2023-12-26 07:59:04,464][123090] Updated weights for policy 1, policy_version 1043860 (0.0010) [2023-12-26 07:59:04,512][123090] Updated weights for policy 1, policy_version 1043870 (0.0010) [2023-12-26 07:59:04,782][123091] Updated weights for policy 0, policy_version 1051159 (0.0007) [2023-12-26 07:59:04,842][123091] Updated weights for policy 0, policy_version 1051169 (0.0010) [2023-12-26 07:59:04,895][123091] Updated weights for policy 0, policy_version 1051179 (0.0009) [2023-12-26 07:59:05,341][123090] Updated weights for policy 1, policy_version 1043880 (0.0010) [2023-12-26 07:59:05,410][123090] Updated weights for policy 1, policy_version 1043890 (0.0010) [2023-12-26 07:59:05,478][123090] Updated weights for policy 1, policy_version 1043900 (0.0010) [2023-12-26 07:59:05,629][123091] Updated weights for policy 0, policy_version 1051189 (0.0009) [2023-12-26 07:59:05,683][123091] Updated weights for policy 0, policy_version 1051199 (0.0010) [2023-12-26 07:59:05,745][123091] Updated weights for policy 0, policy_version 1051209 (0.0010) [2023-12-26 07:59:06,222][123090] Updated weights for policy 1, policy_version 1043910 (0.0010) [2023-12-26 07:59:06,279][123090] Updated weights for policy 1, policy_version 1043920 (0.0010) [2023-12-26 07:59:06,342][123090] Updated weights for policy 1, policy_version 1043930 (0.0005) [2023-12-26 07:59:06,624][123091] Updated weights for policy 0, policy_version 1051219 (0.0010) [2023-12-26 07:59:06,690][123091] Updated weights for policy 0, policy_version 1051229 (0.0009) [2023-12-26 07:59:06,748][123091] Updated weights for policy 0, policy_version 1051239 (0.0009) [2023-12-26 07:59:07,161][123090] Updated weights for policy 1, policy_version 1043940 (0.0005) [2023-12-26 07:59:07,212][123090] Updated weights for policy 1, policy_version 1043950 (0.0005) [2023-12-26 07:59:07,260][123090] Updated weights for policy 1, policy_version 1043960 (0.0006) [2023-12-26 07:59:07,571][123091] Updated weights for policy 0, policy_version 1051249 (0.0009) [2023-12-26 07:59:07,630][123091] Updated weights for policy 0, policy_version 1051259 (0.0010) [2023-12-26 07:59:07,697][123091] Updated weights for policy 0, policy_version 1051269 (0.0010) [2023-12-26 07:59:07,761][123091] Updated weights for policy 0, policy_version 1051279 (0.0008) [2023-12-26 07:59:07,962][123090] Updated weights for policy 1, policy_version 1043970 (0.0006) [2023-12-26 07:59:08,024][123090] Updated weights for policy 1, policy_version 1043980 (0.0010) [2023-12-26 07:59:08,094][123090] Updated weights for policy 1, policy_version 1043990 (0.0010) [2023-12-26 07:59:08,153][123090] Updated weights for policy 1, policy_version 1044000 (0.0010) [2023-12-26 07:59:08,449][123091] Updated weights for policy 0, policy_version 1051289 (0.0005) [2023-12-26 07:59:08,510][123091] Updated weights for policy 0, policy_version 1051299 (0.0006) [2023-12-26 07:59:08,578][123091] Updated weights for policy 0, policy_version 1051309 (0.0005) [2023-12-26 07:59:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 536403968. Throughput: 0: 8574.3, 1: 9053.9. Samples: 536378636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:08,785][121949] Avg episode reward: [(0, '6007.274'), (1, '5521.771')] [2023-12-26 07:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001051312_269139968.pth... [2023-12-26 07:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001044000_267264000.pth... [2023-12-26 07:59:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001042976_267001856.pth [2023-12-26 07:59:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001050320_268886016.pth [2023-12-26 07:59:08,946][123090] Updated weights for policy 1, policy_version 1044010 (0.0007) [2023-12-26 07:59:09,000][123090] Updated weights for policy 1, policy_version 1044020 (0.0007) [2023-12-26 07:59:09,051][123090] Updated weights for policy 1, policy_version 1044030 (0.0007) [2023-12-26 07:59:09,400][123091] Updated weights for policy 0, policy_version 1051319 (0.0009) [2023-12-26 07:59:09,473][123091] Updated weights for policy 0, policy_version 1051329 (0.0010) [2023-12-26 07:59:09,544][123091] Updated weights for policy 0, policy_version 1051339 (0.0010) [2023-12-26 07:59:09,895][123090] Updated weights for policy 1, policy_version 1044040 (0.0008) [2023-12-26 07:59:09,956][123090] Updated weights for policy 1, policy_version 1044050 (0.0009) [2023-12-26 07:59:10,015][123090] Updated weights for policy 1, policy_version 1044060 (0.0009) [2023-12-26 07:59:10,405][123091] Updated weights for policy 0, policy_version 1051349 (0.0008) [2023-12-26 07:59:10,455][123091] Updated weights for policy 0, policy_version 1051359 (0.0005) [2023-12-26 07:59:10,510][123091] Updated weights for policy 0, policy_version 1051369 (0.0005) [2023-12-26 07:59:10,911][123090] Updated weights for policy 1, policy_version 1044070 (0.0010) [2023-12-26 07:59:10,984][123090] Updated weights for policy 1, policy_version 1044080 (0.0007) [2023-12-26 07:59:11,059][123090] Updated weights for policy 1, policy_version 1044090 (0.0007) [2023-12-26 07:59:11,212][123091] Updated weights for policy 0, policy_version 1051379 (0.0007) [2023-12-26 07:59:11,276][123091] Updated weights for policy 0, policy_version 1051389 (0.0011) [2023-12-26 07:59:11,341][123091] Updated weights for policy 0, policy_version 1051399 (0.0011) [2023-12-26 07:59:11,843][123090] Updated weights for policy 1, policy_version 1044100 (0.0008) [2023-12-26 07:59:11,910][123090] Updated weights for policy 1, policy_version 1044110 (0.0009) [2023-12-26 07:59:11,982][123090] Updated weights for policy 1, policy_version 1044120 (0.0006) [2023-12-26 07:59:12,195][123091] Updated weights for policy 0, policy_version 1051409 (0.0010) [2023-12-26 07:59:12,256][123091] Updated weights for policy 0, policy_version 1051419 (0.0009) [2023-12-26 07:59:12,313][123091] Updated weights for policy 0, policy_version 1051429 (0.0009) [2023-12-26 07:59:12,383][123091] Updated weights for policy 0, policy_version 1051439 (0.0008) [2023-12-26 07:59:12,713][123090] Updated weights for policy 1, policy_version 1044130 (0.0006) [2023-12-26 07:59:12,761][123090] Updated weights for policy 1, policy_version 1044140 (0.0005) [2023-12-26 07:59:12,826][123090] Updated weights for policy 1, policy_version 1044150 (0.0011) [2023-12-26 07:59:12,882][123090] Updated weights for policy 1, policy_version 1044160 (0.0010) [2023-12-26 07:59:13,196][123091] Updated weights for policy 0, policy_version 1051449 (0.0009) [2023-12-26 07:59:13,246][123091] Updated weights for policy 0, policy_version 1051459 (0.0009) [2023-12-26 07:59:13,295][123091] Updated weights for policy 0, policy_version 1051469 (0.0009) [2023-12-26 07:59:13,702][123090] Updated weights for policy 1, policy_version 1044170 (0.0010) [2023-12-26 07:59:13,767][123090] Updated weights for policy 1, policy_version 1044180 (0.0009) [2023-12-26 07:59:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 536485888. Throughput: 0: 8641.6, 1: 8918.3. Samples: 536483824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:13,785][121949] Avg episode reward: [(0, '6111.155'), (1, '5560.123')] [2023-12-26 07:59:13,828][123090] Updated weights for policy 1, policy_version 1044190 (0.0010) [2023-12-26 07:59:14,171][123091] Updated weights for policy 0, policy_version 1051479 (0.0009) [2023-12-26 07:59:14,235][123091] Updated weights for policy 0, policy_version 1051489 (0.0008) [2023-12-26 07:59:14,302][123091] Updated weights for policy 0, policy_version 1051499 (0.0010) [2023-12-26 07:59:14,630][123090] Updated weights for policy 1, policy_version 1044200 (0.0010) [2023-12-26 07:59:14,704][123090] Updated weights for policy 1, policy_version 1044210 (0.0006) [2023-12-26 07:59:14,770][123090] Updated weights for policy 1, policy_version 1044220 (0.0006) [2023-12-26 07:59:15,189][123091] Updated weights for policy 0, policy_version 1051509 (0.0008) [2023-12-26 07:59:15,252][123091] Updated weights for policy 0, policy_version 1051519 (0.0009) [2023-12-26 07:59:15,317][123091] Updated weights for policy 0, policy_version 1051529 (0.0008) [2023-12-26 07:59:15,516][123090] Updated weights for policy 1, policy_version 1044230 (0.0009) [2023-12-26 07:59:15,571][123090] Updated weights for policy 1, policy_version 1044240 (0.0008) [2023-12-26 07:59:15,622][123090] Updated weights for policy 1, policy_version 1044250 (0.0005) [2023-12-26 07:59:16,124][123091] Updated weights for policy 0, policy_version 1051539 (0.0008) [2023-12-26 07:59:16,186][123091] Updated weights for policy 0, policy_version 1051549 (0.0010) [2023-12-26 07:59:16,238][123091] Updated weights for policy 0, policy_version 1051559 (0.0010) [2023-12-26 07:59:16,302][123090] Updated weights for policy 1, policy_version 1044260 (0.0007) [2023-12-26 07:59:16,360][123090] Updated weights for policy 1, policy_version 1044270 (0.0006) [2023-12-26 07:59:16,418][123090] Updated weights for policy 1, policy_version 1044280 (0.0010) [2023-12-26 07:59:17,112][123091] Updated weights for policy 0, policy_version 1051569 (0.0011) [2023-12-26 07:59:17,161][123091] Updated weights for policy 0, policy_version 1051579 (0.0009) [2023-12-26 07:59:17,218][123091] Updated weights for policy 0, policy_version 1051589 (0.0009) [2023-12-26 07:59:17,218][123090] Updated weights for policy 1, policy_version 1044290 (0.0010) [2023-12-26 07:59:17,281][123090] Updated weights for policy 1, policy_version 1044300 (0.0010) [2023-12-26 07:59:17,283][123091] Updated weights for policy 0, policy_version 1051599 (0.0008) [2023-12-26 07:59:17,343][123090] Updated weights for policy 1, policy_version 1044310 (0.0010) [2023-12-26 07:59:17,394][123090] Updated weights for policy 1, policy_version 1044320 (0.0010) [2023-12-26 07:59:18,127][123091] Updated weights for policy 0, policy_version 1051609 (0.0008) [2023-12-26 07:59:18,174][123091] Updated weights for policy 0, policy_version 1051619 (0.0008) [2023-12-26 07:59:18,215][123090] Updated weights for policy 1, policy_version 1044330 (0.0010) [2023-12-26 07:59:18,224][123091] Updated weights for policy 0, policy_version 1051629 (0.0008) [2023-12-26 07:59:18,284][123090] Updated weights for policy 1, policy_version 1044340 (0.0012) [2023-12-26 07:59:18,346][123090] Updated weights for policy 1, policy_version 1044350 (0.0008) [2023-12-26 07:59:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 536576000. Throughput: 0: 8527.4, 1: 8932.4. Samples: 536587900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:18,785][121949] Avg episode reward: [(0, '6065.891'), (1, '5485.283')] [2023-12-26 07:59:19,160][123091] Updated weights for policy 0, policy_version 1051639 (0.0008) [2023-12-26 07:59:19,193][123090] Updated weights for policy 1, policy_version 1044360 (0.0008) [2023-12-26 07:59:19,213][123091] Updated weights for policy 0, policy_version 1051649 (0.0009) [2023-12-26 07:59:19,258][123090] Updated weights for policy 1, policy_version 1044370 (0.0010) [2023-12-26 07:59:19,282][123091] Updated weights for policy 0, policy_version 1051659 (0.0009) [2023-12-26 07:59:19,320][123090] Updated weights for policy 1, policy_version 1044380 (0.0007) [2023-12-26 07:59:20,050][123091] Updated weights for policy 0, policy_version 1051669 (0.0009) [2023-12-26 07:59:20,114][123091] Updated weights for policy 0, policy_version 1051679 (0.0009) [2023-12-26 07:59:20,116][123090] Updated weights for policy 1, policy_version 1044390 (0.0009) [2023-12-26 07:59:20,177][123091] Updated weights for policy 0, policy_version 1051689 (0.0007) [2023-12-26 07:59:20,187][123090] Updated weights for policy 1, policy_version 1044400 (0.0008) [2023-12-26 07:59:20,258][123090] Updated weights for policy 1, policy_version 1044410 (0.0008) [2023-12-26 07:59:20,993][123091] Updated weights for policy 0, policy_version 1051699 (0.0007) [2023-12-26 07:59:21,064][123091] Updated weights for policy 0, policy_version 1051709 (0.0010) [2023-12-26 07:59:21,076][123090] Updated weights for policy 1, policy_version 1044420 (0.0008) [2023-12-26 07:59:21,121][123091] Updated weights for policy 0, policy_version 1051719 (0.0007) [2023-12-26 07:59:21,145][123090] Updated weights for policy 1, policy_version 1044430 (0.0010) [2023-12-26 07:59:21,214][123090] Updated weights for policy 1, policy_version 1044440 (0.0008) [2023-12-26 07:59:21,922][123091] Updated weights for policy 0, policy_version 1051729 (0.0007) [2023-12-26 07:59:21,995][123091] Updated weights for policy 0, policy_version 1051739 (0.0008) [2023-12-26 07:59:22,036][123090] Updated weights for policy 1, policy_version 1044450 (0.0009) [2023-12-26 07:59:22,062][123091] Updated weights for policy 0, policy_version 1051749 (0.0006) [2023-12-26 07:59:22,100][123090] Updated weights for policy 1, policy_version 1044460 (0.0009) [2023-12-26 07:59:22,118][123091] Updated weights for policy 0, policy_version 1051759 (0.0008) [2023-12-26 07:59:22,159][123090] Updated weights for policy 1, policy_version 1044470 (0.0009) [2023-12-26 07:59:22,213][123090] Updated weights for policy 1, policy_version 1044480 (0.0010) [2023-12-26 07:59:22,899][123091] Updated weights for policy 0, policy_version 1051769 (0.0009) [2023-12-26 07:59:22,964][123091] Updated weights for policy 0, policy_version 1051779 (0.0006) [2023-12-26 07:59:23,030][123091] Updated weights for policy 0, policy_version 1051789 (0.0006) [2023-12-26 07:59:23,107][123090] Updated weights for policy 1, policy_version 1044490 (0.0007) [2023-12-26 07:59:23,178][123090] Updated weights for policy 1, policy_version 1044500 (0.0009) [2023-12-26 07:59:23,238][123090] Updated weights for policy 1, policy_version 1044510 (0.0009) [2023-12-26 07:59:23,737][123091] Updated weights for policy 0, policy_version 1051799 (0.0006) [2023-12-26 07:59:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 536657920. Throughput: 0: 8509.0, 1: 8907.2. Samples: 536639192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:23,785][121949] Avg episode reward: [(0, '6154.228'), (1, '5473.951')] [2023-12-26 07:59:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001044512_267395072.pth... [2023-12-26 07:59:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001043488_267132928.pth [2023-12-26 07:59:23,801][123091] Updated weights for policy 0, policy_version 1051809 (0.0005) [2023-12-26 07:59:23,858][123091] Updated weights for policy 0, policy_version 1051819 (0.0005) [2023-12-26 07:59:23,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001051824_269271040.pth... [2023-12-26 07:59:23,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001050800_269008896.pth [2023-12-26 07:59:23,974][123090] Updated weights for policy 1, policy_version 1044520 (0.0006) [2023-12-26 07:59:24,033][123090] Updated weights for policy 1, policy_version 1044530 (0.0010) [2023-12-26 07:59:24,105][123090] Updated weights for policy 1, policy_version 1044540 (0.0010) [2023-12-26 07:59:24,495][123091] Updated weights for policy 0, policy_version 1051829 (0.0005) [2023-12-26 07:59:24,551][123091] Updated weights for policy 0, policy_version 1051839 (0.0005) [2023-12-26 07:59:24,615][123091] Updated weights for policy 0, policy_version 1051849 (0.0005) [2023-12-26 07:59:24,897][123090] Updated weights for policy 1, policy_version 1044550 (0.0009) [2023-12-26 07:59:24,959][123090] Updated weights for policy 1, policy_version 1044561 (0.0010) [2023-12-26 07:59:25,013][123090] Updated weights for policy 1, policy_version 1044571 (0.0009) [2023-12-26 07:59:25,280][123091] Updated weights for policy 0, policy_version 1051859 (0.0007) [2023-12-26 07:59:25,328][123091] Updated weights for policy 0, policy_version 1051869 (0.0009) [2023-12-26 07:59:25,375][123091] Updated weights for policy 0, policy_version 1051879 (0.0009) [2023-12-26 07:59:25,784][123090] Updated weights for policy 1, policy_version 1044581 (0.0010) [2023-12-26 07:59:25,849][123090] Updated weights for policy 1, policy_version 1044591 (0.0010) [2023-12-26 07:59:25,904][123090] Updated weights for policy 1, policy_version 1044601 (0.0008) [2023-12-26 07:59:26,162][123091] Updated weights for policy 0, policy_version 1051889 (0.0009) [2023-12-26 07:59:26,221][123091] Updated weights for policy 0, policy_version 1051899 (0.0005) [2023-12-26 07:59:26,292][123091] Updated weights for policy 0, policy_version 1051909 (0.0005) [2023-12-26 07:59:26,365][123091] Updated weights for policy 0, policy_version 1051919 (0.0005) [2023-12-26 07:59:26,656][123090] Updated weights for policy 1, policy_version 1044611 (0.0008) [2023-12-26 07:59:26,722][123090] Updated weights for policy 1, policy_version 1044621 (0.0005) [2023-12-26 07:59:26,774][123090] Updated weights for policy 1, policy_version 1044631 (0.0005) [2023-12-26 07:59:27,070][123091] Updated weights for policy 0, policy_version 1051929 (0.0009) [2023-12-26 07:59:27,116][123091] Updated weights for policy 0, policy_version 1051939 (0.0008) [2023-12-26 07:59:27,173][123091] Updated weights for policy 0, policy_version 1051949 (0.0009) [2023-12-26 07:59:27,485][123090] Updated weights for policy 1, policy_version 1044641 (0.0009) [2023-12-26 07:59:27,537][123090] Updated weights for policy 1, policy_version 1044651 (0.0009) [2023-12-26 07:59:27,583][123090] Updated weights for policy 1, policy_version 1044661 (0.0008) [2023-12-26 07:59:27,635][123090] Updated weights for policy 1, policy_version 1044672 (0.0010) [2023-12-26 07:59:28,045][123091] Updated weights for policy 0, policy_version 1051959 (0.0010) [2023-12-26 07:59:28,100][123091] Updated weights for policy 0, policy_version 1051969 (0.0009) [2023-12-26 07:59:28,148][123091] Updated weights for policy 0, policy_version 1051979 (0.0009) [2023-12-26 07:59:28,464][123090] Updated weights for policy 1, policy_version 1044682 (0.0010) [2023-12-26 07:59:28,516][123090] Updated weights for policy 1, policy_version 1044692 (0.0009) [2023-12-26 07:59:28,576][123090] Updated weights for policy 1, policy_version 1044702 (0.0009) [2023-12-26 07:59:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 536756224. Throughput: 0: 8630.5, 1: 8924.6. Samples: 536749848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:28,785][121949] Avg episode reward: [(0, '6165.194'), (1, '5585.037')] [2023-12-26 07:59:28,964][123091] Updated weights for policy 0, policy_version 1051990 (0.0010) [2023-12-26 07:59:29,038][123091] Updated weights for policy 0, policy_version 1052000 (0.0009) [2023-12-26 07:59:29,105][123091] Updated weights for policy 0, policy_version 1052010 (0.0009) [2023-12-26 07:59:29,305][123090] Updated weights for policy 1, policy_version 1044712 (0.0008) [2023-12-26 07:59:29,376][123090] Updated weights for policy 1, policy_version 1044722 (0.0008) [2023-12-26 07:59:29,449][123090] Updated weights for policy 1, policy_version 1044732 (0.0008) [2023-12-26 07:59:29,868][123091] Updated weights for policy 0, policy_version 1052020 (0.0008) [2023-12-26 07:59:29,932][123091] Updated weights for policy 0, policy_version 1052030 (0.0008) [2023-12-26 07:59:30,003][123091] Updated weights for policy 0, policy_version 1052040 (0.0008) [2023-12-26 07:59:30,217][123090] Updated weights for policy 1, policy_version 1044742 (0.0009) [2023-12-26 07:59:30,278][123090] Updated weights for policy 1, policy_version 1044752 (0.0010) [2023-12-26 07:59:30,344][123090] Updated weights for policy 1, policy_version 1044762 (0.0010) [2023-12-26 07:59:30,794][123091] Updated weights for policy 0, policy_version 1052050 (0.0009) [2023-12-26 07:59:30,846][123091] Updated weights for policy 0, policy_version 1052061 (0.0009) [2023-12-26 07:59:30,899][123091] Updated weights for policy 0, policy_version 1052072 (0.0011) [2023-12-26 07:59:31,068][123090] Updated weights for policy 1, policy_version 1044772 (0.0010) [2023-12-26 07:59:31,137][123090] Updated weights for policy 1, policy_version 1044782 (0.0007) [2023-12-26 07:59:31,199][123090] Updated weights for policy 1, policy_version 1044792 (0.0008) [2023-12-26 07:59:31,710][123091] Updated weights for policy 0, policy_version 1052082 (0.0010) [2023-12-26 07:59:31,782][123091] Updated weights for policy 0, policy_version 1052092 (0.0009) [2023-12-26 07:59:31,850][123091] Updated weights for policy 0, policy_version 1052102 (0.0009) [2023-12-26 07:59:31,912][123091] Updated weights for policy 0, policy_version 1052112 (0.0009) [2023-12-26 07:59:32,007][123090] Updated weights for policy 1, policy_version 1044802 (0.0008) [2023-12-26 07:59:32,067][123090] Updated weights for policy 1, policy_version 1044812 (0.0009) [2023-12-26 07:59:32,132][123090] Updated weights for policy 1, policy_version 1044822 (0.0010) [2023-12-26 07:59:32,183][123090] Updated weights for policy 1, policy_version 1044832 (0.0009) [2023-12-26 07:59:32,671][123091] Updated weights for policy 0, policy_version 1052122 (0.0005) [2023-12-26 07:59:32,730][123091] Updated weights for policy 0, policy_version 1052132 (0.0007) [2023-12-26 07:59:32,783][123091] Updated weights for policy 0, policy_version 1052142 (0.0009) [2023-12-26 07:59:33,017][123090] Updated weights for policy 1, policy_version 1044842 (0.0009) [2023-12-26 07:59:33,080][123090] Updated weights for policy 1, policy_version 1044852 (0.0007) [2023-12-26 07:59:33,135][123090] Updated weights for policy 1, policy_version 1044862 (0.0010) [2023-12-26 07:59:33,532][123091] Updated weights for policy 0, policy_version 1052152 (0.0009) [2023-12-26 07:59:33,583][123091] Updated weights for policy 0, policy_version 1052162 (0.0010) [2023-12-26 07:59:33,631][123091] Updated weights for policy 0, policy_version 1052172 (0.0010) [2023-12-26 07:59:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 536846336. Throughput: 0: 8710.8, 1: 8893.2. Samples: 536856772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:33,785][121949] Avg episode reward: [(0, '6099.757'), (1, '5427.375')] [2023-12-26 07:59:33,984][123090] Updated weights for policy 1, policy_version 1044872 (0.0005) [2023-12-26 07:59:34,045][123090] Updated weights for policy 1, policy_version 1044882 (0.0009) [2023-12-26 07:59:34,108][123090] Updated weights for policy 1, policy_version 1044892 (0.0009) [2023-12-26 07:59:34,432][123091] Updated weights for policy 0, policy_version 1052182 (0.0010) [2023-12-26 07:59:34,484][123091] Updated weights for policy 0, policy_version 1052192 (0.0010) [2023-12-26 07:59:34,550][123091] Updated weights for policy 0, policy_version 1052202 (0.0010) [2023-12-26 07:59:34,883][123090] Updated weights for policy 1, policy_version 1044902 (0.0010) [2023-12-26 07:59:34,948][123090] Updated weights for policy 1, policy_version 1044912 (0.0009) [2023-12-26 07:59:35,010][123090] Updated weights for policy 1, policy_version 1044922 (0.0009) [2023-12-26 07:59:35,383][123091] Updated weights for policy 0, policy_version 1052212 (0.0010) [2023-12-26 07:59:35,441][123091] Updated weights for policy 0, policy_version 1052222 (0.0010) [2023-12-26 07:59:35,502][123091] Updated weights for policy 0, policy_version 1052232 (0.0009) [2023-12-26 07:59:35,791][123090] Updated weights for policy 1, policy_version 1044932 (0.0009) [2023-12-26 07:59:35,870][123090] Updated weights for policy 1, policy_version 1044942 (0.0005) [2023-12-26 07:59:35,947][123090] Updated weights for policy 1, policy_version 1044952 (0.0005) [2023-12-26 07:59:36,311][123091] Updated weights for policy 0, policy_version 1052242 (0.0010) [2023-12-26 07:59:36,378][123091] Updated weights for policy 0, policy_version 1052252 (0.0010) [2023-12-26 07:59:36,445][123091] Updated weights for policy 0, policy_version 1052262 (0.0010) [2023-12-26 07:59:36,507][123091] Updated weights for policy 0, policy_version 1052272 (0.0010) [2023-12-26 07:59:36,659][123090] Updated weights for policy 1, policy_version 1044962 (0.0006) [2023-12-26 07:59:36,723][123090] Updated weights for policy 1, policy_version 1044972 (0.0009) [2023-12-26 07:59:36,777][123090] Updated weights for policy 1, policy_version 1044982 (0.0010) [2023-12-26 07:59:36,845][123090] Updated weights for policy 1, policy_version 1044992 (0.0009) [2023-12-26 07:59:37,337][123091] Updated weights for policy 0, policy_version 1052282 (0.0010) [2023-12-26 07:59:37,395][123091] Updated weights for policy 0, policy_version 1052292 (0.0010) [2023-12-26 07:59:37,445][123091] Updated weights for policy 0, policy_version 1052302 (0.0009) [2023-12-26 07:59:37,659][123090] Updated weights for policy 1, policy_version 1045002 (0.0009) [2023-12-26 07:59:37,719][123090] Updated weights for policy 1, policy_version 1045012 (0.0010) [2023-12-26 07:59:37,790][123090] Updated weights for policy 1, policy_version 1045022 (0.0010) [2023-12-26 07:59:38,302][123091] Updated weights for policy 0, policy_version 1052312 (0.0009) [2023-12-26 07:59:38,371][123091] Updated weights for policy 0, policy_version 1052322 (0.0008) [2023-12-26 07:59:38,429][123091] Updated weights for policy 0, policy_version 1052332 (0.0010) [2023-12-26 07:59:38,602][123090] Updated weights for policy 1, policy_version 1045032 (0.0009) [2023-12-26 07:59:38,653][123090] Updated weights for policy 1, policy_version 1045043 (0.0010) [2023-12-26 07:59:38,707][123090] Updated weights for policy 1, policy_version 1045053 (0.0009) [2023-12-26 07:59:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 536936448. Throughput: 0: 8729.5, 1: 8899.9. Samples: 536909684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:38,785][121949] Avg episode reward: [(0, '6104.983'), (1, '5361.397')] [2023-12-26 07:59:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001052336_269402112.pth... [2023-12-26 07:59:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001045056_267534336.pth... [2023-12-26 07:59:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001044000_267264000.pth [2023-12-26 07:59:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001051312_269139968.pth [2023-12-26 07:59:39,181][123091] Updated weights for policy 0, policy_version 1052342 (0.0007) [2023-12-26 07:59:39,245][123091] Updated weights for policy 0, policy_version 1052352 (0.0008) [2023-12-26 07:59:39,302][123091] Updated weights for policy 0, policy_version 1052362 (0.0008) [2023-12-26 07:59:39,548][123090] Updated weights for policy 1, policy_version 1045063 (0.0009) [2023-12-26 07:59:39,615][123090] Updated weights for policy 1, policy_version 1045073 (0.0008) [2023-12-26 07:59:39,678][123090] Updated weights for policy 1, policy_version 1045083 (0.0008) [2023-12-26 07:59:40,173][123091] Updated weights for policy 0, policy_version 1052372 (0.0007) [2023-12-26 07:59:40,239][123091] Updated weights for policy 0, policy_version 1052382 (0.0007) [2023-12-26 07:59:40,310][123091] Updated weights for policy 0, policy_version 1052392 (0.0009) [2023-12-26 07:59:40,461][123090] Updated weights for policy 1, policy_version 1045093 (0.0007) [2023-12-26 07:59:40,516][123090] Updated weights for policy 1, policy_version 1045103 (0.0005) [2023-12-26 07:59:40,572][123090] Updated weights for policy 1, policy_version 1045113 (0.0005) [2023-12-26 07:59:41,071][123091] Updated weights for policy 0, policy_version 1052402 (0.0010) [2023-12-26 07:59:41,145][123091] Updated weights for policy 0, policy_version 1052412 (0.0010) [2023-12-26 07:59:41,209][123091] Updated weights for policy 0, policy_version 1052422 (0.0010) [2023-12-26 07:59:41,279][123091] Updated weights for policy 0, policy_version 1052432 (0.0010) [2023-12-26 07:59:41,369][123090] Updated weights for policy 1, policy_version 1045123 (0.0006) [2023-12-26 07:59:41,440][123090] Updated weights for policy 1, policy_version 1045133 (0.0010) [2023-12-26 07:59:41,496][123090] Updated weights for policy 1, policy_version 1045143 (0.0007) [2023-12-26 07:59:42,120][123091] Updated weights for policy 0, policy_version 1052442 (0.0010) [2023-12-26 07:59:42,179][123091] Updated weights for policy 0, policy_version 1052452 (0.0009) [2023-12-26 07:59:42,243][123091] Updated weights for policy 0, policy_version 1052462 (0.0009) [2023-12-26 07:59:42,335][123090] Updated weights for policy 1, policy_version 1045153 (0.0008) [2023-12-26 07:59:42,412][123090] Updated weights for policy 1, policy_version 1045163 (0.0008) [2023-12-26 07:59:42,478][123090] Updated weights for policy 1, policy_version 1045173 (0.0008) [2023-12-26 07:59:42,544][123090] Updated weights for policy 1, policy_version 1045183 (0.0008) [2023-12-26 07:59:43,084][123091] Updated weights for policy 0, policy_version 1052472 (0.0010) [2023-12-26 07:59:43,132][123090] Updated weights for policy 1, policy_version 1045193 (0.0008) [2023-12-26 07:59:43,139][123091] Updated weights for policy 0, policy_version 1052482 (0.0009) [2023-12-26 07:59:43,192][123090] Updated weights for policy 1, policy_version 1045203 (0.0010) [2023-12-26 07:59:43,203][123091] Updated weights for policy 0, policy_version 1052492 (0.0008) [2023-12-26 07:59:43,249][123090] Updated weights for policy 1, policy_version 1045213 (0.0008) [2023-12-26 07:59:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 537018368. Throughput: 0: 8739.2, 1: 8834.3. Samples: 537012452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:43,785][121949] Avg episode reward: [(0, '6207.545'), (1, '5632.513')] [2023-12-26 07:59:44,043][123091] Updated weights for policy 0, policy_version 1052502 (0.0009) [2023-12-26 07:59:44,063][123090] Updated weights for policy 1, policy_version 1045223 (0.0008) [2023-12-26 07:59:44,108][123091] Updated weights for policy 0, policy_version 1052512 (0.0009) [2023-12-26 07:59:44,127][123090] Updated weights for policy 1, policy_version 1045233 (0.0010) [2023-12-26 07:59:44,174][123091] Updated weights for policy 0, policy_version 1052522 (0.0007) [2023-12-26 07:59:44,188][123090] Updated weights for policy 1, policy_version 1045243 (0.0010) [2023-12-26 07:59:44,967][123090] Updated weights for policy 1, policy_version 1045253 (0.0010) [2023-12-26 07:59:45,023][123091] Updated weights for policy 0, policy_version 1052532 (0.0009) [2023-12-26 07:59:45,033][123090] Updated weights for policy 1, policy_version 1045263 (0.0008) [2023-12-26 07:59:45,079][123091] Updated weights for policy 0, policy_version 1052542 (0.0009) [2023-12-26 07:59:45,096][123090] Updated weights for policy 1, policy_version 1045273 (0.0008) [2023-12-26 07:59:45,130][123091] Updated weights for policy 0, policy_version 1052552 (0.0008) [2023-12-26 07:59:45,866][123090] Updated weights for policy 1, policy_version 1045283 (0.0010) [2023-12-26 07:59:45,912][123090] Updated weights for policy 1, policy_version 1045293 (0.0009) [2023-12-26 07:59:45,961][123090] Updated weights for policy 1, policy_version 1045303 (0.0009) [2023-12-26 07:59:46,000][123091] Updated weights for policy 0, policy_version 1052562 (0.0010) [2023-12-26 07:59:46,054][123091] Updated weights for policy 0, policy_version 1052572 (0.0010) [2023-12-26 07:59:46,110][123091] Updated weights for policy 0, policy_version 1052582 (0.0009) [2023-12-26 07:59:46,169][123091] Updated weights for policy 0, policy_version 1052592 (0.0009) [2023-12-26 07:59:46,766][123090] Updated weights for policy 1, policy_version 1045313 (0.0008) [2023-12-26 07:59:46,838][123090] Updated weights for policy 1, policy_version 1045323 (0.0010) [2023-12-26 07:59:46,901][123090] Updated weights for policy 1, policy_version 1045333 (0.0010) [2023-12-26 07:59:46,950][123090] Updated weights for policy 1, policy_version 1045343 (0.0008) [2023-12-26 07:59:47,027][123091] Updated weights for policy 0, policy_version 1052602 (0.0009) [2023-12-26 07:59:47,087][123091] Updated weights for policy 0, policy_version 1052613 (0.0009) [2023-12-26 07:59:47,150][123091] Updated weights for policy 0, policy_version 1052623 (0.0009) [2023-12-26 07:59:47,678][123090] Updated weights for policy 1, policy_version 1045353 (0.0010) [2023-12-26 07:59:47,748][123090] Updated weights for policy 1, policy_version 1045363 (0.0006) [2023-12-26 07:59:47,807][123090] Updated weights for policy 1, policy_version 1045373 (0.0006) [2023-12-26 07:59:48,076][123091] Updated weights for policy 0, policy_version 1052633 (0.0010) [2023-12-26 07:59:48,133][123091] Updated weights for policy 0, policy_version 1052643 (0.0009) [2023-12-26 07:59:48,200][123091] Updated weights for policy 0, policy_version 1052653 (0.0009) [2023-12-26 07:59:48,536][123090] Updated weights for policy 1, policy_version 1045383 (0.0006) [2023-12-26 07:59:48,608][123090] Updated weights for policy 1, policy_version 1045393 (0.0008) [2023-12-26 07:59:48,667][123090] Updated weights for policy 1, policy_version 1045403 (0.0006) [2023-12-26 07:59:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 537108480. Throughput: 0: 8715.3, 1: 8901.2. Samples: 537118432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:48,785][121949] Avg episode reward: [(0, '6234.976'), (1, '5767.473')] [2023-12-26 07:59:49,073][123091] Updated weights for policy 0, policy_version 1052663 (0.0009) [2023-12-26 07:59:49,134][123091] Updated weights for policy 0, policy_version 1052673 (0.0009) [2023-12-26 07:59:49,191][123091] Updated weights for policy 0, policy_version 1052683 (0.0010) [2023-12-26 07:59:49,383][123090] Updated weights for policy 1, policy_version 1045413 (0.0008) [2023-12-26 07:59:49,443][123090] Updated weights for policy 1, policy_version 1045424 (0.0010) [2023-12-26 07:59:49,496][123090] Updated weights for policy 1, policy_version 1045434 (0.0009) [2023-12-26 07:59:50,074][123091] Updated weights for policy 0, policy_version 1052693 (0.0009) [2023-12-26 07:59:50,130][123091] Updated weights for policy 0, policy_version 1052703 (0.0010) [2023-12-26 07:59:50,186][123091] Updated weights for policy 0, policy_version 1052713 (0.0009) [2023-12-26 07:59:50,347][123090] Updated weights for policy 1, policy_version 1045444 (0.0009) [2023-12-26 07:59:50,411][123090] Updated weights for policy 1, policy_version 1045454 (0.0005) [2023-12-26 07:59:50,477][123090] Updated weights for policy 1, policy_version 1045464 (0.0008) [2023-12-26 07:59:51,125][123091] Updated weights for policy 0, policy_version 1052723 (0.0009) [2023-12-26 07:59:51,188][123091] Updated weights for policy 0, policy_version 1052733 (0.0010) [2023-12-26 07:59:51,218][123090] Updated weights for policy 1, policy_version 1045474 (0.0010) [2023-12-26 07:59:51,256][123091] Updated weights for policy 0, policy_version 1052743 (0.0007) [2023-12-26 07:59:51,281][123090] Updated weights for policy 1, policy_version 1045484 (0.0010) [2023-12-26 07:59:51,352][123090] Updated weights for policy 1, policy_version 1045494 (0.0009) [2023-12-26 07:59:51,424][123090] Updated weights for policy 1, policy_version 1045504 (0.0008) [2023-12-26 07:59:52,111][123091] Updated weights for policy 0, policy_version 1052753 (0.0007) [2023-12-26 07:59:52,180][123091] Updated weights for policy 0, policy_version 1052763 (0.0009) [2023-12-26 07:59:52,236][123091] Updated weights for policy 0, policy_version 1052773 (0.0007) [2023-12-26 07:59:52,248][123090] Updated weights for policy 1, policy_version 1045514 (0.0008) [2023-12-26 07:59:52,298][123091] Updated weights for policy 0, policy_version 1052783 (0.0011) [2023-12-26 07:59:52,313][123090] Updated weights for policy 1, policy_version 1045524 (0.0008) [2023-12-26 07:59:52,379][123090] Updated weights for policy 1, policy_version 1045534 (0.0009) [2023-12-26 07:59:52,914][123091] Updated weights for policy 0, policy_version 1052793 (0.0006) [2023-12-26 07:59:52,960][123091] Updated weights for policy 0, policy_version 1052803 (0.0005) [2023-12-26 07:59:53,031][123091] Updated weights for policy 0, policy_version 1052813 (0.0005) [2023-12-26 07:59:53,191][123090] Updated weights for policy 1, policy_version 1045544 (0.0007) [2023-12-26 07:59:53,245][123090] Updated weights for policy 1, policy_version 1045554 (0.0005) [2023-12-26 07:59:53,299][123090] Updated weights for policy 1, policy_version 1045564 (0.0005) [2023-12-26 07:59:53,713][123091] Updated weights for policy 0, policy_version 1052823 (0.0009) [2023-12-26 07:59:53,778][123091] Updated weights for policy 0, policy_version 1052833 (0.0011) [2023-12-26 07:59:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 537190400. Throughput: 0: 8660.0, 1: 8893.6. Samples: 537168548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:53,784][121949] Avg episode reward: [(0, '6224.556'), (1, '5775.348')] [2023-12-26 07:59:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001045568_267665408.pth... [2023-12-26 07:59:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001044512_267395072.pth [2023-12-26 07:59:53,837][123091] Updated weights for policy 0, policy_version 1052843 (0.0010) [2023-12-26 07:59:53,868][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001052848_269533184.pth... [2023-12-26 07:59:53,872][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001051824_269271040.pth [2023-12-26 07:59:53,994][123090] Updated weights for policy 1, policy_version 1045574 (0.0007) [2023-12-26 07:59:54,050][123090] Updated weights for policy 1, policy_version 1045584 (0.0009) [2023-12-26 07:59:54,104][123090] Updated weights for policy 1, policy_version 1045594 (0.0010) [2023-12-26 07:59:54,611][123091] Updated weights for policy 0, policy_version 1052853 (0.0010) [2023-12-26 07:59:54,672][123091] Updated weights for policy 0, policy_version 1052863 (0.0009) [2023-12-26 07:59:54,728][123091] Updated weights for policy 0, policy_version 1052873 (0.0009) [2023-12-26 07:59:54,997][123090] Updated weights for policy 1, policy_version 1045604 (0.0010) [2023-12-26 07:59:55,065][123090] Updated weights for policy 1, policy_version 1045614 (0.0009) [2023-12-26 07:59:55,146][123090] Updated weights for policy 1, policy_version 1045624 (0.0009) [2023-12-26 07:59:55,410][123091] Updated weights for policy 0, policy_version 1052883 (0.0006) [2023-12-26 07:59:55,479][123091] Updated weights for policy 0, policy_version 1052893 (0.0005) [2023-12-26 07:59:55,553][123091] Updated weights for policy 0, policy_version 1052903 (0.0005) [2023-12-26 07:59:55,968][123090] Updated weights for policy 1, policy_version 1045634 (0.0009) [2023-12-26 07:59:56,035][123090] Updated weights for policy 1, policy_version 1045644 (0.0005) [2023-12-26 07:59:56,091][123090] Updated weights for policy 1, policy_version 1045654 (0.0005) [2023-12-26 07:59:56,148][123090] Updated weights for policy 1, policy_version 1045664 (0.0005) [2023-12-26 07:59:56,233][123091] Updated weights for policy 0, policy_version 1052913 (0.0010) [2023-12-26 07:59:56,294][123091] Updated weights for policy 0, policy_version 1052923 (0.0005) [2023-12-26 07:59:56,364][123091] Updated weights for policy 0, policy_version 1052933 (0.0008) [2023-12-26 07:59:56,423][123091] Updated weights for policy 0, policy_version 1052943 (0.0011) [2023-12-26 07:59:56,786][123090] Updated weights for policy 1, policy_version 1045674 (0.0005) [2023-12-26 07:59:56,835][123090] Updated weights for policy 1, policy_version 1045684 (0.0005) [2023-12-26 07:59:56,895][123090] Updated weights for policy 1, policy_version 1045694 (0.0005) [2023-12-26 07:59:57,121][123091] Updated weights for policy 0, policy_version 1052953 (0.0006) [2023-12-26 07:59:57,185][123091] Updated weights for policy 0, policy_version 1052963 (0.0005) [2023-12-26 07:59:57,236][123091] Updated weights for policy 0, policy_version 1052973 (0.0005) [2023-12-26 07:59:57,569][123090] Updated weights for policy 1, policy_version 1045704 (0.0006) [2023-12-26 07:59:57,619][123090] Updated weights for policy 1, policy_version 1045714 (0.0008) [2023-12-26 07:59:57,676][123090] Updated weights for policy 1, policy_version 1045724 (0.0008) [2023-12-26 07:59:57,958][123091] Updated weights for policy 0, policy_version 1052983 (0.0005) [2023-12-26 07:59:58,003][123091] Updated weights for policy 0, policy_version 1052993 (0.0005) [2023-12-26 07:59:58,069][123091] Updated weights for policy 0, policy_version 1053003 (0.0010) [2023-12-26 07:59:58,574][123090] Updated weights for policy 1, policy_version 1045734 (0.0009) [2023-12-26 07:59:58,644][123090] Updated weights for policy 1, policy_version 1045744 (0.0009) [2023-12-26 07:59:58,707][123090] Updated weights for policy 1, policy_version 1045754 (0.0010) [2023-12-26 07:59:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 537288704. Throughput: 0: 8785.2, 1: 8974.6. Samples: 537283016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 07:59:58,786][121949] Avg episode reward: [(0, '6243.891'), (1, '5913.235')] [2023-12-26 07:59:58,961][123091] Updated weights for policy 0, policy_version 1053013 (0.0011) [2023-12-26 07:59:59,026][123091] Updated weights for policy 0, policy_version 1053023 (0.0010) [2023-12-26 07:59:59,083][123091] Updated weights for policy 0, policy_version 1053033 (0.0010) [2023-12-26 07:59:59,498][123090] Updated weights for policy 1, policy_version 1045764 (0.0010) [2023-12-26 07:59:59,563][123090] Updated weights for policy 1, policy_version 1045774 (0.0007) [2023-12-26 07:59:59,633][123090] Updated weights for policy 1, policy_version 1045784 (0.0005) [2023-12-26 07:59:59,964][123091] Updated weights for policy 0, policy_version 1053043 (0.0010) [2023-12-26 08:00:00,014][123091] Updated weights for policy 0, policy_version 1053053 (0.0009) [2023-12-26 08:00:00,066][123091] Updated weights for policy 0, policy_version 1053063 (0.0010) [2023-12-26 08:00:00,427][123090] Updated weights for policy 1, policy_version 1045794 (0.0008) [2023-12-26 08:00:00,483][123090] Updated weights for policy 1, policy_version 1045804 (0.0007) [2023-12-26 08:00:00,530][123090] Updated weights for policy 1, policy_version 1045814 (0.0005) [2023-12-26 08:00:00,585][123090] Updated weights for policy 1, policy_version 1045824 (0.0008) [2023-12-26 08:00:00,876][123091] Updated weights for policy 0, policy_version 1053073 (0.0009) [2023-12-26 08:00:00,924][123091] Updated weights for policy 0, policy_version 1053083 (0.0009) [2023-12-26 08:00:00,974][123091] Updated weights for policy 0, policy_version 1053094 (0.0010) [2023-12-26 08:00:01,471][123090] Updated weights for policy 1, policy_version 1045834 (0.0009) [2023-12-26 08:00:01,539][123090] Updated weights for policy 1, policy_version 1045844 (0.0009) [2023-12-26 08:00:01,603][123090] Updated weights for policy 1, policy_version 1045854 (0.0006) [2023-12-26 08:00:01,801][123091] Updated weights for policy 0, policy_version 1053105 (0.0010) [2023-12-26 08:00:01,855][123091] Updated weights for policy 0, policy_version 1053115 (0.0010) [2023-12-26 08:00:01,906][123091] Updated weights for policy 0, policy_version 1053125 (0.0009) [2023-12-26 08:00:01,954][123091] Updated weights for policy 0, policy_version 1053135 (0.0009) [2023-12-26 08:00:02,339][123090] Updated weights for policy 1, policy_version 1045864 (0.0006) [2023-12-26 08:00:02,409][123090] Updated weights for policy 1, policy_version 1045874 (0.0009) [2023-12-26 08:00:02,465][123090] Updated weights for policy 1, policy_version 1045884 (0.0009) [2023-12-26 08:00:02,851][123091] Updated weights for policy 0, policy_version 1053145 (0.0010) [2023-12-26 08:00:02,908][123091] Updated weights for policy 0, policy_version 1053155 (0.0009) [2023-12-26 08:00:02,971][123091] Updated weights for policy 0, policy_version 1053165 (0.0009) [2023-12-26 08:00:03,217][123090] Updated weights for policy 1, policy_version 1045894 (0.0007) [2023-12-26 08:00:03,273][123090] Updated weights for policy 1, policy_version 1045904 (0.0005) [2023-12-26 08:00:03,325][123090] Updated weights for policy 1, policy_version 1045914 (0.0005) [2023-12-26 08:00:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 537370624. Throughput: 0: 8791.3, 1: 8941.2. Samples: 537385864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:03,785][121949] Avg episode reward: [(0, '6139.508'), (1, '5819.496')] [2023-12-26 08:00:03,828][123091] Updated weights for policy 0, policy_version 1053175 (0.0009) [2023-12-26 08:00:03,895][123091] Updated weights for policy 0, policy_version 1053185 (0.0009) [2023-12-26 08:00:03,959][123091] Updated weights for policy 0, policy_version 1053195 (0.0009) [2023-12-26 08:00:04,107][123090] Updated weights for policy 1, policy_version 1045924 (0.0007) [2023-12-26 08:00:04,163][123090] Updated weights for policy 1, policy_version 1045934 (0.0010) [2023-12-26 08:00:04,219][123090] Updated weights for policy 1, policy_version 1045944 (0.0010) [2023-12-26 08:00:04,780][123091] Updated weights for policy 0, policy_version 1053205 (0.0009) [2023-12-26 08:00:04,841][123091] Updated weights for policy 0, policy_version 1053215 (0.0009) [2023-12-26 08:00:04,905][123091] Updated weights for policy 0, policy_version 1053225 (0.0009) [2023-12-26 08:00:05,079][123090] Updated weights for policy 1, policy_version 1045954 (0.0010) [2023-12-26 08:00:05,148][123090] Updated weights for policy 1, policy_version 1045964 (0.0010) [2023-12-26 08:00:05,217][123090] Updated weights for policy 1, policy_version 1045974 (0.0010) [2023-12-26 08:00:05,280][123090] Updated weights for policy 1, policy_version 1045984 (0.0010) [2023-12-26 08:00:05,739][123091] Updated weights for policy 0, policy_version 1053235 (0.0010) [2023-12-26 08:00:05,795][123091] Updated weights for policy 0, policy_version 1053245 (0.0009) [2023-12-26 08:00:05,846][123091] Updated weights for policy 0, policy_version 1053255 (0.0009) [2023-12-26 08:00:06,072][123090] Updated weights for policy 1, policy_version 1045994 (0.0008) [2023-12-26 08:00:06,134][123090] Updated weights for policy 1, policy_version 1046004 (0.0007) [2023-12-26 08:00:06,191][123090] Updated weights for policy 1, policy_version 1046014 (0.0008) [2023-12-26 08:00:06,704][123091] Updated weights for policy 0, policy_version 1053265 (0.0009) [2023-12-26 08:00:06,768][123091] Updated weights for policy 0, policy_version 1053275 (0.0009) [2023-12-26 08:00:06,842][123091] Updated weights for policy 0, policy_version 1053285 (0.0009) [2023-12-26 08:00:06,915][123091] Updated weights for policy 0, policy_version 1053295 (0.0009) [2023-12-26 08:00:07,019][123090] Updated weights for policy 1, policy_version 1046024 (0.0010) [2023-12-26 08:00:07,072][123090] Updated weights for policy 1, policy_version 1046034 (0.0010) [2023-12-26 08:00:07,134][123090] Updated weights for policy 1, policy_version 1046044 (0.0011) [2023-12-26 08:00:07,741][123091] Updated weights for policy 0, policy_version 1053305 (0.0010) [2023-12-26 08:00:07,794][123091] Updated weights for policy 0, policy_version 1053315 (0.0010) [2023-12-26 08:00:07,864][123091] Updated weights for policy 0, policy_version 1053325 (0.0009) [2023-12-26 08:00:08,004][123090] Updated weights for policy 1, policy_version 1046054 (0.0010) [2023-12-26 08:00:08,056][123090] Updated weights for policy 1, policy_version 1046064 (0.0009) [2023-12-26 08:00:08,118][123090] Updated weights for policy 1, policy_version 1046074 (0.0009) [2023-12-26 08:00:08,712][123091] Updated weights for policy 0, policy_version 1053335 (0.0009) [2023-12-26 08:00:08,778][123091] Updated weights for policy 0, policy_version 1053345 (0.0010) [2023-12-26 08:00:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 537452544. Throughput: 0: 8778.9, 1: 8939.7. Samples: 537436528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:08,785][121949] Avg episode reward: [(0, '6016.513'), (1, '5609.138')] [2023-12-26 08:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001046080_267796480.pth... [2023-12-26 08:00:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001045056_267534336.pth [2023-12-26 08:00:08,854][123091] Updated weights for policy 0, policy_version 1053355 (0.0010) [2023-12-26 08:00:08,887][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001053360_269664256.pth... [2023-12-26 08:00:08,887][123090] Updated weights for policy 1, policy_version 1046084 (0.0009) [2023-12-26 08:00:08,892][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001052336_269402112.pth [2023-12-26 08:00:08,952][123090] Updated weights for policy 1, policy_version 1046094 (0.0009) [2023-12-26 08:00:09,009][123090] Updated weights for policy 1, policy_version 1046104 (0.0009) [2023-12-26 08:00:09,702][123091] Updated weights for policy 0, policy_version 1053365 (0.0009) [2023-12-26 08:00:09,762][123091] Updated weights for policy 0, policy_version 1053375 (0.0010) [2023-12-26 08:00:09,840][123091] Updated weights for policy 0, policy_version 1053385 (0.0009) [2023-12-26 08:00:09,879][123090] Updated weights for policy 1, policy_version 1046114 (0.0009) [2023-12-26 08:00:09,952][123090] Updated weights for policy 1, policy_version 1046124 (0.0008) [2023-12-26 08:00:10,013][123090] Updated weights for policy 1, policy_version 1046134 (0.0010) [2023-12-26 08:00:10,081][123090] Updated weights for policy 1, policy_version 1046144 (0.0009) [2023-12-26 08:00:10,679][123091] Updated weights for policy 0, policy_version 1053395 (0.0009) [2023-12-26 08:00:10,732][123091] Updated weights for policy 0, policy_version 1053405 (0.0009) [2023-12-26 08:00:10,783][123091] Updated weights for policy 0, policy_version 1053415 (0.0010) [2023-12-26 08:00:10,924][123090] Updated weights for policy 1, policy_version 1046154 (0.0009) [2023-12-26 08:00:10,983][123090] Updated weights for policy 1, policy_version 1046164 (0.0009) [2023-12-26 08:00:11,047][123090] Updated weights for policy 1, policy_version 1046174 (0.0009) [2023-12-26 08:00:11,695][123091] Updated weights for policy 0, policy_version 1053425 (0.0011) [2023-12-26 08:00:11,759][123091] Updated weights for policy 0, policy_version 1053435 (0.0010) [2023-12-26 08:00:11,811][123091] Updated weights for policy 0, policy_version 1053445 (0.0011) [2023-12-26 08:00:11,875][123091] Updated weights for policy 0, policy_version 1053455 (0.0011) [2023-12-26 08:00:11,941][123090] Updated weights for policy 1, policy_version 1046184 (0.0009) [2023-12-26 08:00:12,002][123090] Updated weights for policy 1, policy_version 1046194 (0.0008) [2023-12-26 08:00:12,067][123090] Updated weights for policy 1, policy_version 1046204 (0.0008) [2023-12-26 08:00:12,674][123091] Updated weights for policy 0, policy_version 1053465 (0.0006) [2023-12-26 08:00:12,743][123091] Updated weights for policy 0, policy_version 1053475 (0.0007) [2023-12-26 08:00:12,811][123091] Updated weights for policy 0, policy_version 1053485 (0.0011) [2023-12-26 08:00:12,916][123090] Updated weights for policy 1, policy_version 1046214 (0.0008) [2023-12-26 08:00:12,982][123090] Updated weights for policy 1, policy_version 1046224 (0.0006) [2023-12-26 08:00:13,058][123090] Updated weights for policy 1, policy_version 1046234 (0.0006) [2023-12-26 08:00:13,588][123091] Updated weights for policy 0, policy_version 1053495 (0.0009) [2023-12-26 08:00:13,644][123091] Updated weights for policy 0, policy_version 1053505 (0.0010) [2023-12-26 08:00:13,695][123091] Updated weights for policy 0, policy_version 1053515 (0.0010) [2023-12-26 08:00:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 537542656. Throughput: 0: 8612.2, 1: 8862.0. Samples: 537536188. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:13,785][121949] Avg episode reward: [(0, '6021.607'), (1, '5592.088')] [2023-12-26 08:00:13,875][123090] Updated weights for policy 1, policy_version 1046244 (0.0008) [2023-12-26 08:00:13,924][123090] Updated weights for policy 1, policy_version 1046254 (0.0009) [2023-12-26 08:00:13,973][123090] Updated weights for policy 1, policy_version 1046264 (0.0009) [2023-12-26 08:00:14,485][123091] Updated weights for policy 0, policy_version 1053525 (0.0008) [2023-12-26 08:00:14,548][123091] Updated weights for policy 0, policy_version 1053535 (0.0011) [2023-12-26 08:00:14,604][123091] Updated weights for policy 0, policy_version 1053545 (0.0011) [2023-12-26 08:00:14,736][123090] Updated weights for policy 1, policy_version 1046274 (0.0008) [2023-12-26 08:00:14,809][123090] Updated weights for policy 1, policy_version 1046284 (0.0009) [2023-12-26 08:00:14,882][123090] Updated weights for policy 1, policy_version 1046294 (0.0010) [2023-12-26 08:00:14,947][123090] Updated weights for policy 1, policy_version 1046304 (0.0009) [2023-12-26 08:00:15,366][123091] Updated weights for policy 0, policy_version 1053555 (0.0009) [2023-12-26 08:00:15,418][123091] Updated weights for policy 0, policy_version 1053565 (0.0006) [2023-12-26 08:00:15,474][123091] Updated weights for policy 0, policy_version 1053575 (0.0006) [2023-12-26 08:00:15,907][123090] Updated weights for policy 1, policy_version 1046314 (0.0010) [2023-12-26 08:00:15,973][123090] Updated weights for policy 1, policy_version 1046324 (0.0010) [2023-12-26 08:00:16,039][123090] Updated weights for policy 1, policy_version 1046334 (0.0009) [2023-12-26 08:00:16,187][123091] Updated weights for policy 0, policy_version 1053585 (0.0006) [2023-12-26 08:00:16,253][123091] Updated weights for policy 0, policy_version 1053595 (0.0010) [2023-12-26 08:00:16,321][123091] Updated weights for policy 0, policy_version 1053605 (0.0007) [2023-12-26 08:00:16,387][123091] Updated weights for policy 0, policy_version 1053615 (0.0005) [2023-12-26 08:00:16,859][123090] Updated weights for policy 1, policy_version 1046344 (0.0010) [2023-12-26 08:00:16,912][123090] Updated weights for policy 1, policy_version 1046354 (0.0009) [2023-12-26 08:00:16,963][123090] Updated weights for policy 1, policy_version 1046364 (0.0006) [2023-12-26 08:00:17,021][123091] Updated weights for policy 0, policy_version 1053625 (0.0008) [2023-12-26 08:00:17,071][123091] Updated weights for policy 0, policy_version 1053636 (0.0009) [2023-12-26 08:00:17,123][123091] Updated weights for policy 0, policy_version 1053646 (0.0009) [2023-12-26 08:00:17,796][123090] Updated weights for policy 1, policy_version 1046374 (0.0009) [2023-12-26 08:00:17,850][123090] Updated weights for policy 1, policy_version 1046384 (0.0009) [2023-12-26 08:00:17,904][123090] Updated weights for policy 1, policy_version 1046394 (0.0010) [2023-12-26 08:00:17,971][123091] Updated weights for policy 0, policy_version 1053656 (0.0006) [2023-12-26 08:00:18,040][123091] Updated weights for policy 0, policy_version 1053666 (0.0005) [2023-12-26 08:00:18,096][123091] Updated weights for policy 0, policy_version 1053676 (0.0006) [2023-12-26 08:00:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 537624576. Throughput: 0: 8657.9, 1: 8779.1. Samples: 537641436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:18,785][121949] Avg episode reward: [(0, '6108.778'), (1, '5635.618')] [2023-12-26 08:00:18,816][123090] Updated weights for policy 1, policy_version 1046404 (0.0009) [2023-12-26 08:00:18,877][123091] Updated weights for policy 0, policy_version 1053686 (0.0008) [2023-12-26 08:00:18,889][123090] Updated weights for policy 1, policy_version 1046414 (0.0009) [2023-12-26 08:00:18,942][123091] Updated weights for policy 0, policy_version 1053696 (0.0011) [2023-12-26 08:00:18,954][123090] Updated weights for policy 1, policy_version 1046424 (0.0009) [2023-12-26 08:00:19,010][123091] Updated weights for policy 0, policy_version 1053706 (0.0009) [2023-12-26 08:00:19,683][123090] Updated weights for policy 1, policy_version 1046434 (0.0007) [2023-12-26 08:00:19,737][123090] Updated weights for policy 1, policy_version 1046444 (0.0006) [2023-12-26 08:00:19,788][123091] Updated weights for policy 0, policy_version 1053716 (0.0009) [2023-12-26 08:00:19,802][123090] Updated weights for policy 1, policy_version 1046454 (0.0007) [2023-12-26 08:00:19,850][123091] Updated weights for policy 0, policy_version 1053726 (0.0008) [2023-12-26 08:00:19,870][123090] Updated weights for policy 1, policy_version 1046464 (0.0008) [2023-12-26 08:00:19,919][123091] Updated weights for policy 0, policy_version 1053737 (0.0010) [2023-12-26 08:00:20,710][123090] Updated weights for policy 1, policy_version 1046474 (0.0010) [2023-12-26 08:00:20,779][123090] Updated weights for policy 1, policy_version 1046484 (0.0009) [2023-12-26 08:00:20,804][123091] Updated weights for policy 0, policy_version 1053747 (0.0009) [2023-12-26 08:00:20,839][123090] Updated weights for policy 1, policy_version 1046494 (0.0008) [2023-12-26 08:00:20,868][123091] Updated weights for policy 0, policy_version 1053757 (0.0008) [2023-12-26 08:00:20,925][123091] Updated weights for policy 0, policy_version 1053767 (0.0008) [2023-12-26 08:00:21,728][123091] Updated weights for policy 0, policy_version 1053777 (0.0009) [2023-12-26 08:00:21,798][123091] Updated weights for policy 0, policy_version 1053787 (0.0010) [2023-12-26 08:00:21,839][123090] Updated weights for policy 1, policy_version 1046504 (0.0009) [2023-12-26 08:00:21,866][123091] Updated weights for policy 0, policy_version 1053797 (0.0008) [2023-12-26 08:00:21,908][123090] Updated weights for policy 1, policy_version 1046514 (0.0009) [2023-12-26 08:00:21,937][123091] Updated weights for policy 0, policy_version 1053807 (0.0006) [2023-12-26 08:00:21,974][123090] Updated weights for policy 1, policy_version 1046524 (0.0009) [2023-12-26 08:00:22,750][123091] Updated weights for policy 0, policy_version 1053817 (0.0009) [2023-12-26 08:00:22,806][123091] Updated weights for policy 0, policy_version 1053827 (0.0010) [2023-12-26 08:00:22,844][123090] Updated weights for policy 1, policy_version 1046534 (0.0009) [2023-12-26 08:00:22,879][123091] Updated weights for policy 0, policy_version 1053837 (0.0009) [2023-12-26 08:00:22,910][123090] Updated weights for policy 1, policy_version 1046544 (0.0009) [2023-12-26 08:00:22,980][123090] Updated weights for policy 1, policy_version 1046554 (0.0010) [2023-12-26 08:00:23,692][123091] Updated weights for policy 0, policy_version 1053847 (0.0010) [2023-12-26 08:00:23,751][123091] Updated weights for policy 0, policy_version 1053857 (0.0009) [2023-12-26 08:00:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 537706496. Throughput: 0: 8649.0, 1: 8720.2. Samples: 537691296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:23,785][121949] Avg episode reward: [(0, '6047.330'), (1, '5554.805')] [2023-12-26 08:00:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001046560_267919360.pth... [2023-12-26 08:00:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001045568_267665408.pth [2023-12-26 08:00:23,812][123091] Updated weights for policy 0, policy_version 1053867 (0.0010) [2023-12-26 08:00:23,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001053872_269795328.pth... [2023-12-26 08:00:23,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001052848_269533184.pth [2023-12-26 08:00:23,839][123090] Updated weights for policy 1, policy_version 1046564 (0.0008) [2023-12-26 08:00:23,895][123090] Updated weights for policy 1, policy_version 1046574 (0.0010) [2023-12-26 08:00:23,956][123090] Updated weights for policy 1, policy_version 1046584 (0.0009) [2023-12-26 08:00:24,640][123091] Updated weights for policy 0, policy_version 1053877 (0.0009) [2023-12-26 08:00:24,693][123091] Updated weights for policy 0, policy_version 1053888 (0.0010) [2023-12-26 08:00:24,744][123090] Updated weights for policy 1, policy_version 1046594 (0.0008) [2023-12-26 08:00:24,745][123091] Updated weights for policy 0, policy_version 1053899 (0.0010) [2023-12-26 08:00:24,802][123090] Updated weights for policy 1, policy_version 1046604 (0.0008) [2023-12-26 08:00:24,860][123090] Updated weights for policy 1, policy_version 1046614 (0.0009) [2023-12-26 08:00:24,918][123090] Updated weights for policy 1, policy_version 1046624 (0.0006) [2023-12-26 08:00:25,601][123091] Updated weights for policy 0, policy_version 1053909 (0.0006) [2023-12-26 08:00:25,614][123090] Updated weights for policy 1, policy_version 1046634 (0.0009) [2023-12-26 08:00:25,643][123091] Updated weights for policy 0, policy_version 1053919 (0.0005) [2023-12-26 08:00:25,664][123090] Updated weights for policy 1, policy_version 1046645 (0.0009) [2023-12-26 08:00:25,689][123091] Updated weights for policy 0, policy_version 1053929 (0.0005) [2023-12-26 08:00:25,714][123090] Updated weights for policy 1, policy_version 1046655 (0.0009) [2023-12-26 08:00:26,431][123091] Updated weights for policy 0, policy_version 1053939 (0.0007) [2023-12-26 08:00:26,479][123091] Updated weights for policy 0, policy_version 1053949 (0.0009) [2023-12-26 08:00:26,528][123091] Updated weights for policy 0, policy_version 1053960 (0.0010) [2023-12-26 08:00:26,626][123090] Updated weights for policy 1, policy_version 1046665 (0.0009) [2023-12-26 08:00:26,689][123090] Updated weights for policy 1, policy_version 1046675 (0.0009) [2023-12-26 08:00:26,742][123090] Updated weights for policy 1, policy_version 1046685 (0.0009) [2023-12-26 08:00:27,350][123091] Updated weights for policy 0, policy_version 1053970 (0.0010) [2023-12-26 08:00:27,408][123091] Updated weights for policy 0, policy_version 1053980 (0.0009) [2023-12-26 08:00:27,468][123091] Updated weights for policy 0, policy_version 1053990 (0.0009) [2023-12-26 08:00:27,491][123090] Updated weights for policy 1, policy_version 1046695 (0.0008) [2023-12-26 08:00:27,521][123091] Updated weights for policy 0, policy_version 1054000 (0.0009) [2023-12-26 08:00:27,546][123090] Updated weights for policy 1, policy_version 1046705 (0.0005) [2023-12-26 08:00:27,600][123090] Updated weights for policy 1, policy_version 1046715 (0.0005) [2023-12-26 08:00:28,216][123090] Updated weights for policy 1, policy_version 1046725 (0.0005) [2023-12-26 08:00:28,290][123090] Updated weights for policy 1, policy_version 1046735 (0.0005) [2023-12-26 08:00:28,351][123090] Updated weights for policy 1, policy_version 1046745 (0.0006) [2023-12-26 08:00:28,397][123091] Updated weights for policy 0, policy_version 1054010 (0.0009) [2023-12-26 08:00:28,455][123091] Updated weights for policy 0, policy_version 1054020 (0.0010) [2023-12-26 08:00:28,509][123091] Updated weights for policy 0, policy_version 1054030 (0.0010) [2023-12-26 08:00:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 537804800. Throughput: 0: 8692.7, 1: 8712.0. Samples: 537795668. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:28,785][121949] Avg episode reward: [(0, '6113.156'), (1, '5741.689')] [2023-12-26 08:00:28,959][123090] Updated weights for policy 1, policy_version 1046755 (0.0007) [2023-12-26 08:00:29,011][123090] Updated weights for policy 1, policy_version 1046765 (0.0009) [2023-12-26 08:00:29,067][123090] Updated weights for policy 1, policy_version 1046775 (0.0009) [2023-12-26 08:00:29,347][123091] Updated weights for policy 0, policy_version 1054040 (0.0010) [2023-12-26 08:00:29,445][123091] Updated weights for policy 0, policy_version 1054050 (0.0011) [2023-12-26 08:00:29,511][123091] Updated weights for policy 0, policy_version 1054060 (0.0011) [2023-12-26 08:00:29,964][123090] Updated weights for policy 1, policy_version 1046785 (0.0010) [2023-12-26 08:00:30,025][123090] Updated weights for policy 1, policy_version 1046795 (0.0009) [2023-12-26 08:00:30,095][123090] Updated weights for policy 1, policy_version 1046805 (0.0007) [2023-12-26 08:00:30,160][123090] Updated weights for policy 1, policy_version 1046815 (0.0006) [2023-12-26 08:00:30,235][123091] Updated weights for policy 0, policy_version 1054070 (0.0009) [2023-12-26 08:00:30,294][123091] Updated weights for policy 0, policy_version 1054080 (0.0010) [2023-12-26 08:00:30,359][123091] Updated weights for policy 0, policy_version 1054090 (0.0010) [2023-12-26 08:00:30,918][123090] Updated weights for policy 1, policy_version 1046825 (0.0008) [2023-12-26 08:00:30,971][123090] Updated weights for policy 1, policy_version 1046836 (0.0010) [2023-12-26 08:00:31,027][123090] Updated weights for policy 1, policy_version 1046846 (0.0006) [2023-12-26 08:00:31,158][123091] Updated weights for policy 0, policy_version 1054100 (0.0009) [2023-12-26 08:00:31,220][123091] Updated weights for policy 0, policy_version 1054110 (0.0008) [2023-12-26 08:00:31,287][123091] Updated weights for policy 0, policy_version 1054120 (0.0007) [2023-12-26 08:00:31,862][123090] Updated weights for policy 1, policy_version 1046856 (0.0006) [2023-12-26 08:00:31,915][123090] Updated weights for policy 1, policy_version 1046866 (0.0005) [2023-12-26 08:00:31,987][123090] Updated weights for policy 1, policy_version 1046876 (0.0005) [2023-12-26 08:00:32,049][123091] Updated weights for policy 0, policy_version 1054130 (0.0007) [2023-12-26 08:00:32,108][123091] Updated weights for policy 0, policy_version 1054140 (0.0009) [2023-12-26 08:00:32,169][123091] Updated weights for policy 0, policy_version 1054150 (0.0009) [2023-12-26 08:00:32,232][123091] Updated weights for policy 0, policy_version 1054160 (0.0009) [2023-12-26 08:00:32,743][123090] Updated weights for policy 1, policy_version 1046886 (0.0006) [2023-12-26 08:00:32,795][123090] Updated weights for policy 1, policy_version 1046896 (0.0005) [2023-12-26 08:00:32,845][123090] Updated weights for policy 1, policy_version 1046906 (0.0008) [2023-12-26 08:00:33,093][123091] Updated weights for policy 0, policy_version 1054170 (0.0009) [2023-12-26 08:00:33,156][123091] Updated weights for policy 0, policy_version 1054180 (0.0009) [2023-12-26 08:00:33,217][123091] Updated weights for policy 0, policy_version 1054190 (0.0010) [2023-12-26 08:00:33,666][123090] Updated weights for policy 1, policy_version 1046916 (0.0010) [2023-12-26 08:00:33,732][123090] Updated weights for policy 1, policy_version 1046926 (0.0010) [2023-12-26 08:00:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 537886720. Throughput: 0: 8743.3, 1: 8697.1. Samples: 537903252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:33,785][121949] Avg episode reward: [(0, '6366.178'), (1, '5600.143')] [2023-12-26 08:00:33,797][123090] Updated weights for policy 1, policy_version 1046936 (0.0010) [2023-12-26 08:00:33,971][123091] Updated weights for policy 0, policy_version 1054200 (0.0008) [2023-12-26 08:00:34,040][123091] Updated weights for policy 0, policy_version 1054210 (0.0006) [2023-12-26 08:00:34,111][123091] Updated weights for policy 0, policy_version 1054220 (0.0006) [2023-12-26 08:00:34,667][123090] Updated weights for policy 1, policy_version 1046946 (0.0009) [2023-12-26 08:00:34,739][123090] Updated weights for policy 1, policy_version 1046956 (0.0007) [2023-12-26 08:00:34,792][123090] Updated weights for policy 1, policy_version 1046966 (0.0009) [2023-12-26 08:00:34,839][123090] Updated weights for policy 1, policy_version 1046976 (0.0008) [2023-12-26 08:00:34,865][123091] Updated weights for policy 0, policy_version 1054230 (0.0009) [2023-12-26 08:00:34,932][123091] Updated weights for policy 0, policy_version 1054240 (0.0009) [2023-12-26 08:00:34,996][123091] Updated weights for policy 0, policy_version 1054250 (0.0009) [2023-12-26 08:00:35,630][123091] Updated weights for policy 0, policy_version 1054260 (0.0006) [2023-12-26 08:00:35,688][123091] Updated weights for policy 0, policy_version 1054270 (0.0007) [2023-12-26 08:00:35,703][123090] Updated weights for policy 1, policy_version 1046986 (0.0009) [2023-12-26 08:00:35,736][123091] Updated weights for policy 0, policy_version 1054280 (0.0008) [2023-12-26 08:00:35,764][123090] Updated weights for policy 1, policy_version 1046996 (0.0008) [2023-12-26 08:00:35,818][123090] Updated weights for policy 1, policy_version 1047006 (0.0007) [2023-12-26 08:00:36,532][123091] Updated weights for policy 0, policy_version 1054290 (0.0011) [2023-12-26 08:00:36,600][123091] Updated weights for policy 0, policy_version 1054300 (0.0011) [2023-12-26 08:00:36,664][123091] Updated weights for policy 0, policy_version 1054310 (0.0011) [2023-12-26 08:00:36,688][123090] Updated weights for policy 1, policy_version 1047016 (0.0007) [2023-12-26 08:00:36,720][123091] Updated weights for policy 0, policy_version 1054320 (0.0011) [2023-12-26 08:00:36,751][123090] Updated weights for policy 1, policy_version 1047026 (0.0007) [2023-12-26 08:00:36,828][123090] Updated weights for policy 1, policy_version 1047036 (0.0009) [2023-12-26 08:00:37,378][123091] Updated weights for policy 0, policy_version 1054330 (0.0010) [2023-12-26 08:00:37,436][123091] Updated weights for policy 0, policy_version 1054340 (0.0006) [2023-12-26 08:00:37,497][123091] Updated weights for policy 0, policy_version 1054350 (0.0011) [2023-12-26 08:00:37,699][123090] Updated weights for policy 1, policy_version 1047046 (0.0009) [2023-12-26 08:00:37,769][123090] Updated weights for policy 1, policy_version 1047056 (0.0009) [2023-12-26 08:00:37,826][123090] Updated weights for policy 1, policy_version 1047066 (0.0008) [2023-12-26 08:00:38,198][123091] Updated weights for policy 0, policy_version 1054360 (0.0008) [2023-12-26 08:00:38,259][123091] Updated weights for policy 0, policy_version 1054370 (0.0008) [2023-12-26 08:00:38,318][123091] Updated weights for policy 0, policy_version 1054380 (0.0010) [2023-12-26 08:00:38,608][123090] Updated weights for policy 1, policy_version 1047076 (0.0009) [2023-12-26 08:00:38,656][123090] Updated weights for policy 1, policy_version 1047086 (0.0009) [2023-12-26 08:00:38,720][123090] Updated weights for policy 1, policy_version 1047096 (0.0009) [2023-12-26 08:00:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 537985024. Throughput: 0: 8837.9, 1: 8664.1. Samples: 537956140. Policy #0 lag: (min: 4.0, avg: 4.0, max: 7.0) [2023-12-26 08:00:38,785][121949] Avg episode reward: [(0, '6280.104'), (1, '5527.227')] [2023-12-26 08:00:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001054384_269926400.pth... [2023-12-26 08:00:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001047104_268058624.pth... [2023-12-26 08:00:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001046080_267796480.pth [2023-12-26 08:00:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001053360_269664256.pth [2023-12-26 08:00:39,141][123091] Updated weights for policy 0, policy_version 1054390 (0.0008) [2023-12-26 08:00:39,193][123091] Updated weights for policy 0, policy_version 1054400 (0.0005) [2023-12-26 08:00:39,259][123091] Updated weights for policy 0, policy_version 1054410 (0.0008) [2023-12-26 08:00:39,578][123090] Updated weights for policy 1, policy_version 1047106 (0.0009) [2023-12-26 08:00:39,643][123090] Updated weights for policy 1, policy_version 1047116 (0.0009) [2023-12-26 08:00:39,710][123090] Updated weights for policy 1, policy_version 1047126 (0.0009) [2023-12-26 08:00:39,776][123090] Updated weights for policy 1, policy_version 1047136 (0.0009) [2023-12-26 08:00:40,094][123091] Updated weights for policy 0, policy_version 1054420 (0.0009) [2023-12-26 08:00:40,157][123091] Updated weights for policy 0, policy_version 1054430 (0.0008) [2023-12-26 08:00:40,220][123091] Updated weights for policy 0, policy_version 1054440 (0.0008) [2023-12-26 08:00:40,644][123090] Updated weights for policy 1, policy_version 1047146 (0.0009) [2023-12-26 08:00:40,711][123090] Updated weights for policy 1, policy_version 1047156 (0.0009) [2023-12-26 08:00:40,767][123090] Updated weights for policy 1, policy_version 1047166 (0.0009) [2023-12-26 08:00:41,020][123091] Updated weights for policy 0, policy_version 1054450 (0.0009) [2023-12-26 08:00:41,086][123091] Updated weights for policy 0, policy_version 1054460 (0.0009) [2023-12-26 08:00:41,156][123091] Updated weights for policy 0, policy_version 1054470 (0.0008) [2023-12-26 08:00:41,231][123091] Updated weights for policy 0, policy_version 1054480 (0.0007) [2023-12-26 08:00:41,641][123090] Updated weights for policy 1, policy_version 1047176 (0.0007) [2023-12-26 08:00:41,707][123090] Updated weights for policy 1, policy_version 1047186 (0.0010) [2023-12-26 08:00:41,772][123090] Updated weights for policy 1, policy_version 1047196 (0.0009) [2023-12-26 08:00:42,082][123091] Updated weights for policy 0, policy_version 1054490 (0.0010) [2023-12-26 08:00:42,142][123091] Updated weights for policy 0, policy_version 1054500 (0.0011) [2023-12-26 08:00:42,209][123091] Updated weights for policy 0, policy_version 1054510 (0.0011) [2023-12-26 08:00:42,604][123090] Updated weights for policy 1, policy_version 1047206 (0.0009) [2023-12-26 08:00:42,663][123090] Updated weights for policy 1, policy_version 1047216 (0.0009) [2023-12-26 08:00:42,729][123090] Updated weights for policy 1, policy_version 1047226 (0.0009) [2023-12-26 08:00:43,051][123091] Updated weights for policy 0, policy_version 1054520 (0.0009) [2023-12-26 08:00:43,117][123091] Updated weights for policy 0, policy_version 1054530 (0.0010) [2023-12-26 08:00:43,184][123091] Updated weights for policy 0, policy_version 1054540 (0.0011) [2023-12-26 08:00:43,573][123090] Updated weights for policy 1, policy_version 1047236 (0.0010) [2023-12-26 08:00:43,619][123090] Updated weights for policy 1, policy_version 1047246 (0.0010) [2023-12-26 08:00:43,663][123090] Updated weights for policy 1, policy_version 1047256 (0.0010) [2023-12-26 08:00:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 538066944. Throughput: 0: 8716.8, 1: 8520.2. Samples: 538058680. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:00:43,784][121949] Avg episode reward: [(0, '6195.225'), (1, '5700.417')] [2023-12-26 08:00:43,972][123091] Updated weights for policy 0, policy_version 1054550 (0.0010) [2023-12-26 08:00:44,028][123091] Updated weights for policy 0, policy_version 1054560 (0.0010) [2023-12-26 08:00:44,087][123091] Updated weights for policy 0, policy_version 1054570 (0.0011) [2023-12-26 08:00:44,459][123090] Updated weights for policy 1, policy_version 1047266 (0.0009) [2023-12-26 08:00:44,507][123090] Updated weights for policy 1, policy_version 1047276 (0.0007) [2023-12-26 08:00:44,556][123090] Updated weights for policy 1, policy_version 1047286 (0.0008) [2023-12-26 08:00:44,605][123090] Updated weights for policy 1, policy_version 1047296 (0.0008) [2023-12-26 08:00:44,920][123091] Updated weights for policy 0, policy_version 1054580 (0.0011) [2023-12-26 08:00:44,982][123091] Updated weights for policy 0, policy_version 1054590 (0.0010) [2023-12-26 08:00:45,036][123091] Updated weights for policy 0, policy_version 1054600 (0.0009) [2023-12-26 08:00:45,409][123090] Updated weights for policy 1, policy_version 1047306 (0.0005) [2023-12-26 08:00:45,462][123090] Updated weights for policy 1, policy_version 1047316 (0.0005) [2023-12-26 08:00:45,514][123090] Updated weights for policy 1, policy_version 1047326 (0.0005) [2023-12-26 08:00:45,955][123091] Updated weights for policy 0, policy_version 1054610 (0.0010) [2023-12-26 08:00:46,017][123091] Updated weights for policy 0, policy_version 1054620 (0.0010) [2023-12-26 08:00:46,086][123091] Updated weights for policy 0, policy_version 1054630 (0.0010) [2023-12-26 08:00:46,158][123091] Updated weights for policy 0, policy_version 1054640 (0.0010) [2023-12-26 08:00:46,198][123090] Updated weights for policy 1, policy_version 1047336 (0.0006) [2023-12-26 08:00:46,255][123090] Updated weights for policy 1, policy_version 1047346 (0.0009) [2023-12-26 08:00:46,307][123090] Updated weights for policy 1, policy_version 1047356 (0.0009) [2023-12-26 08:00:46,932][123091] Updated weights for policy 0, policy_version 1054650 (0.0010) [2023-12-26 08:00:46,990][123091] Updated weights for policy 0, policy_version 1054660 (0.0010) [2023-12-26 08:00:47,045][123091] Updated weights for policy 0, policy_version 1054670 (0.0010) [2023-12-26 08:00:47,150][123090] Updated weights for policy 1, policy_version 1047366 (0.0008) [2023-12-26 08:00:47,202][123090] Updated weights for policy 1, policy_version 1047376 (0.0009) [2023-12-26 08:00:47,260][123090] Updated weights for policy 1, policy_version 1047386 (0.0009) [2023-12-26 08:00:47,823][123091] Updated weights for policy 0, policy_version 1054680 (0.0008) [2023-12-26 08:00:47,884][123091] Updated weights for policy 0, policy_version 1054690 (0.0005) [2023-12-26 08:00:47,929][123091] Updated weights for policy 0, policy_version 1054700 (0.0005) [2023-12-26 08:00:48,156][123090] Updated weights for policy 1, policy_version 1047396 (0.0009) [2023-12-26 08:00:48,208][123090] Updated weights for policy 1, policy_version 1047406 (0.0009) [2023-12-26 08:00:48,266][123090] Updated weights for policy 1, policy_version 1047416 (0.0009) [2023-12-26 08:00:48,659][123091] Updated weights for policy 0, policy_version 1054710 (0.0007) [2023-12-26 08:00:48,710][123091] Updated weights for policy 0, policy_version 1054720 (0.0008) [2023-12-26 08:00:48,769][123091] Updated weights for policy 0, policy_version 1054730 (0.0008) [2023-12-26 08:00:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 538148864. Throughput: 0: 8766.8, 1: 8533.9. Samples: 538164392. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:00:48,785][121949] Avg episode reward: [(0, '6207.307'), (1, '5804.415')] [2023-12-26 08:00:49,156][123090] Updated weights for policy 1, policy_version 1047427 (0.0010) [2023-12-26 08:00:49,210][123090] Updated weights for policy 1, policy_version 1047437 (0.0009) [2023-12-26 08:00:49,284][123090] Updated weights for policy 1, policy_version 1047447 (0.0010) [2023-12-26 08:00:49,576][123091] Updated weights for policy 0, policy_version 1054740 (0.0009) [2023-12-26 08:00:49,636][123091] Updated weights for policy 0, policy_version 1054750 (0.0009) [2023-12-26 08:00:49,699][123091] Updated weights for policy 0, policy_version 1054760 (0.0008) [2023-12-26 08:00:50,159][123090] Updated weights for policy 1, policy_version 1047457 (0.0008) [2023-12-26 08:00:50,217][123090] Updated weights for policy 1, policy_version 1047467 (0.0009) [2023-12-26 08:00:50,272][123090] Updated weights for policy 1, policy_version 1047477 (0.0010) [2023-12-26 08:00:50,328][123090] Updated weights for policy 1, policy_version 1047487 (0.0010) [2023-12-26 08:00:50,462][123091] Updated weights for policy 0, policy_version 1054770 (0.0008) [2023-12-26 08:00:50,519][123091] Updated weights for policy 0, policy_version 1054780 (0.0005) [2023-12-26 08:00:50,579][123091] Updated weights for policy 0, policy_version 1054790 (0.0007) [2023-12-26 08:00:50,644][123091] Updated weights for policy 0, policy_version 1054800 (0.0006) [2023-12-26 08:00:51,245][123090] Updated weights for policy 1, policy_version 1047497 (0.0009) [2023-12-26 08:00:51,308][123090] Updated weights for policy 1, policy_version 1047507 (0.0009) [2023-12-26 08:00:51,368][123090] Updated weights for policy 1, policy_version 1047517 (0.0008) [2023-12-26 08:00:51,403][123091] Updated weights for policy 0, policy_version 1054810 (0.0013) [2023-12-26 08:00:51,466][123091] Updated weights for policy 0, policy_version 1054820 (0.0011) [2023-12-26 08:00:51,529][123091] Updated weights for policy 0, policy_version 1054830 (0.0011) [2023-12-26 08:00:52,201][123090] Updated weights for policy 1, policy_version 1047527 (0.0009) [2023-12-26 08:00:52,269][123090] Updated weights for policy 1, policy_version 1047537 (0.0011) [2023-12-26 08:00:52,338][123090] Updated weights for policy 1, policy_version 1047547 (0.0011) [2023-12-26 08:00:52,366][123091] Updated weights for policy 0, policy_version 1054840 (0.0010) [2023-12-26 08:00:52,422][123091] Updated weights for policy 0, policy_version 1054850 (0.0008) [2023-12-26 08:00:52,479][123091] Updated weights for policy 0, policy_version 1054860 (0.0007) [2023-12-26 08:00:53,091][123090] Updated weights for policy 1, policy_version 1047557 (0.0007) [2023-12-26 08:00:53,156][123090] Updated weights for policy 1, policy_version 1047567 (0.0006) [2023-12-26 08:00:53,212][123090] Updated weights for policy 1, policy_version 1047577 (0.0005) [2023-12-26 08:00:53,224][123091] Updated weights for policy 0, policy_version 1054870 (0.0008) [2023-12-26 08:00:53,273][123091] Updated weights for policy 0, policy_version 1054880 (0.0008) [2023-12-26 08:00:53,327][123091] Updated weights for policy 0, policy_version 1054890 (0.0010) [2023-12-26 08:00:53,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 538238976. Throughput: 0: 8802.2, 1: 8499.8. Samples: 538215124. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:00:53,786][121949] Avg episode reward: [(0, '6188.090'), (1, '5724.216')] [2023-12-26 08:00:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001054896_270057472.pth... [2023-12-26 08:00:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001047584_268181504.pth... [2023-12-26 08:00:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001053872_269795328.pth [2023-12-26 08:00:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001046560_267919360.pth [2023-12-26 08:00:53,847][123090] Updated weights for policy 1, policy_version 1047587 (0.0009) [2023-12-26 08:00:53,898][123090] Updated weights for policy 1, policy_version 1047597 (0.0005) [2023-12-26 08:00:53,944][123090] Updated weights for policy 1, policy_version 1047607 (0.0006) [2023-12-26 08:00:54,161][123091] Updated weights for policy 0, policy_version 1054900 (0.0008) [2023-12-26 08:00:54,217][123091] Updated weights for policy 0, policy_version 1054910 (0.0005) [2023-12-26 08:00:54,277][123091] Updated weights for policy 0, policy_version 1054920 (0.0005) [2023-12-26 08:00:54,748][123090] Updated weights for policy 1, policy_version 1047617 (0.0006) [2023-12-26 08:00:54,807][123090] Updated weights for policy 1, policy_version 1047627 (0.0009) [2023-12-26 08:00:54,856][123090] Updated weights for policy 1, policy_version 1047637 (0.0009) [2023-12-26 08:00:54,904][123090] Updated weights for policy 1, policy_version 1047647 (0.0009) [2023-12-26 08:00:55,060][123091] Updated weights for policy 0, policy_version 1054930 (0.0006) [2023-12-26 08:00:55,118][123091] Updated weights for policy 0, policy_version 1054940 (0.0010) [2023-12-26 08:00:55,175][123091] Updated weights for policy 0, policy_version 1054950 (0.0009) [2023-12-26 08:00:55,225][123091] Updated weights for policy 0, policy_version 1054960 (0.0009) [2023-12-26 08:00:55,775][123090] Updated weights for policy 1, policy_version 1047657 (0.0010) [2023-12-26 08:00:55,829][123090] Updated weights for policy 1, policy_version 1047668 (0.0009) [2023-12-26 08:00:55,879][123090] Updated weights for policy 1, policy_version 1047678 (0.0006) [2023-12-26 08:00:56,086][123091] Updated weights for policy 0, policy_version 1054970 (0.0010) [2023-12-26 08:00:56,143][123091] Updated weights for policy 0, policy_version 1054980 (0.0009) [2023-12-26 08:00:56,201][123091] Updated weights for policy 0, policy_version 1054990 (0.0010) [2023-12-26 08:00:56,613][123090] Updated weights for policy 1, policy_version 1047688 (0.0006) [2023-12-26 08:00:56,666][123090] Updated weights for policy 1, policy_version 1047698 (0.0005) [2023-12-26 08:00:56,713][123090] Updated weights for policy 1, policy_version 1047708 (0.0005) [2023-12-26 08:00:56,965][123091] Updated weights for policy 0, policy_version 1055000 (0.0006) [2023-12-26 08:00:57,025][123091] Updated weights for policy 0, policy_version 1055010 (0.0006) [2023-12-26 08:00:57,082][123091] Updated weights for policy 0, policy_version 1055020 (0.0006) [2023-12-26 08:00:57,358][123090] Updated weights for policy 1, policy_version 1047718 (0.0007) [2023-12-26 08:00:57,409][123090] Updated weights for policy 1, policy_version 1047728 (0.0006) [2023-12-26 08:00:57,457][123090] Updated weights for policy 1, policy_version 1047738 (0.0005) [2023-12-26 08:00:57,717][123091] Updated weights for policy 0, policy_version 1055030 (0.0006) [2023-12-26 08:00:57,786][123091] Updated weights for policy 0, policy_version 1055040 (0.0005) [2023-12-26 08:00:57,861][123091] Updated weights for policy 0, policy_version 1055050 (0.0006) [2023-12-26 08:00:58,176][123090] Updated weights for policy 1, policy_version 1047748 (0.0007) [2023-12-26 08:00:58,244][123090] Updated weights for policy 1, policy_version 1047758 (0.0010) [2023-12-26 08:00:58,303][123090] Updated weights for policy 1, policy_version 1047768 (0.0009) [2023-12-26 08:00:58,583][123091] Updated weights for policy 0, policy_version 1055060 (0.0007) [2023-12-26 08:00:58,654][123091] Updated weights for policy 0, policy_version 1055070 (0.0008) [2023-12-26 08:00:58,720][123091] Updated weights for policy 0, policy_version 1055080 (0.0008) [2023-12-26 08:00:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 538337280. Throughput: 0: 8907.3, 1: 8659.4. Samples: 538326688. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:00:58,785][121949] Avg episode reward: [(0, '6118.215'), (1, '5686.354')] [2023-12-26 08:00:59,171][123090] Updated weights for policy 1, policy_version 1047778 (0.0007) [2023-12-26 08:00:59,229][123090] Updated weights for policy 1, policy_version 1047788 (0.0008) [2023-12-26 08:00:59,303][123090] Updated weights for policy 1, policy_version 1047798 (0.0008) [2023-12-26 08:00:59,376][123090] Updated weights for policy 1, policy_version 1047808 (0.0008) [2023-12-26 08:00:59,501][123091] Updated weights for policy 0, policy_version 1055090 (0.0010) [2023-12-26 08:00:59,568][123091] Updated weights for policy 0, policy_version 1055100 (0.0010) [2023-12-26 08:00:59,624][123091] Updated weights for policy 0, policy_version 1055110 (0.0009) [2023-12-26 08:00:59,687][123091] Updated weights for policy 0, policy_version 1055120 (0.0009) [2023-12-26 08:01:00,167][123090] Updated weights for policy 1, policy_version 1047818 (0.0005) [2023-12-26 08:01:00,235][123090] Updated weights for policy 1, policy_version 1047828 (0.0005) [2023-12-26 08:01:00,285][123090] Updated weights for policy 1, policy_version 1047838 (0.0005) [2023-12-26 08:01:00,502][123091] Updated weights for policy 0, policy_version 1055130 (0.0010) [2023-12-26 08:01:00,558][123091] Updated weights for policy 0, policy_version 1055140 (0.0010) [2023-12-26 08:01:00,618][123091] Updated weights for policy 0, policy_version 1055150 (0.0010) [2023-12-26 08:01:00,959][123090] Updated weights for policy 1, policy_version 1047848 (0.0006) [2023-12-26 08:01:01,028][123090] Updated weights for policy 1, policy_version 1047858 (0.0007) [2023-12-26 08:01:01,100][123090] Updated weights for policy 1, policy_version 1047868 (0.0007) [2023-12-26 08:01:01,522][123091] Updated weights for policy 0, policy_version 1055160 (0.0010) [2023-12-26 08:01:01,590][123091] Updated weights for policy 0, policy_version 1055170 (0.0009) [2023-12-26 08:01:01,655][123091] Updated weights for policy 0, policy_version 1055180 (0.0010) [2023-12-26 08:01:01,889][123090] Updated weights for policy 1, policy_version 1047878 (0.0009) [2023-12-26 08:01:01,938][123090] Updated weights for policy 1, policy_version 1047888 (0.0009) [2023-12-26 08:01:01,993][123090] Updated weights for policy 1, policy_version 1047898 (0.0009) [2023-12-26 08:01:02,474][123091] Updated weights for policy 0, policy_version 1055190 (0.0009) [2023-12-26 08:01:02,535][123091] Updated weights for policy 0, policy_version 1055200 (0.0009) [2023-12-26 08:01:02,590][123091] Updated weights for policy 0, policy_version 1055210 (0.0010) [2023-12-26 08:01:02,789][123090] Updated weights for policy 1, policy_version 1047908 (0.0009) [2023-12-26 08:01:02,837][123090] Updated weights for policy 1, policy_version 1047918 (0.0009) [2023-12-26 08:01:02,885][123090] Updated weights for policy 1, policy_version 1047928 (0.0009) [2023-12-26 08:01:03,477][123091] Updated weights for policy 0, policy_version 1055220 (0.0010) [2023-12-26 08:01:03,539][123091] Updated weights for policy 0, policy_version 1055230 (0.0010) [2023-12-26 08:01:03,594][123091] Updated weights for policy 0, policy_version 1055240 (0.0010) [2023-12-26 08:01:03,688][123090] Updated weights for policy 1, policy_version 1047938 (0.0008) [2023-12-26 08:01:03,742][123090] Updated weights for policy 1, policy_version 1047948 (0.0005) [2023-12-26 08:01:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 538419200. Throughput: 0: 8814.3, 1: 8762.8. Samples: 538432404. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:03,785][121949] Avg episode reward: [(0, '6209.081'), (1, '5431.743')] [2023-12-26 08:01:03,786][123090] Updated weights for policy 1, policy_version 1047958 (0.0005) [2023-12-26 08:01:03,836][123090] Updated weights for policy 1, policy_version 1047968 (0.0006) [2023-12-26 08:01:04,389][123091] Updated weights for policy 0, policy_version 1055250 (0.0011) [2023-12-26 08:01:04,454][123091] Updated weights for policy 0, policy_version 1055260 (0.0010) [2023-12-26 08:01:04,508][123091] Updated weights for policy 0, policy_version 1055270 (0.0009) [2023-12-26 08:01:04,577][123091] Updated weights for policy 0, policy_version 1055280 (0.0010) [2023-12-26 08:01:04,637][123090] Updated weights for policy 1, policy_version 1047978 (0.0009) [2023-12-26 08:01:04,695][123090] Updated weights for policy 1, policy_version 1047988 (0.0010) [2023-12-26 08:01:04,754][123090] Updated weights for policy 1, policy_version 1047998 (0.0007) [2023-12-26 08:01:05,423][123091] Updated weights for policy 0, policy_version 1055290 (0.0005) [2023-12-26 08:01:05,493][123091] Updated weights for policy 0, policy_version 1055300 (0.0008) [2023-12-26 08:01:05,510][123090] Updated weights for policy 1, policy_version 1048008 (0.0006) [2023-12-26 08:01:05,558][123091] Updated weights for policy 0, policy_version 1055310 (0.0009) [2023-12-26 08:01:05,572][123090] Updated weights for policy 1, policy_version 1048018 (0.0011) [2023-12-26 08:01:05,633][123090] Updated weights for policy 1, policy_version 1048028 (0.0009) [2023-12-26 08:01:06,277][123091] Updated weights for policy 0, policy_version 1055320 (0.0010) [2023-12-26 08:01:06,329][123091] Updated weights for policy 0, policy_version 1055330 (0.0011) [2023-12-26 08:01:06,388][123091] Updated weights for policy 0, policy_version 1055340 (0.0011) [2023-12-26 08:01:06,492][123090] Updated weights for policy 1, policy_version 1048038 (0.0009) [2023-12-26 08:01:06,566][123090] Updated weights for policy 1, policy_version 1048048 (0.0008) [2023-12-26 08:01:06,636][123090] Updated weights for policy 1, policy_version 1048058 (0.0009) [2023-12-26 08:01:07,186][123091] Updated weights for policy 0, policy_version 1055350 (0.0008) [2023-12-26 08:01:07,247][123091] Updated weights for policy 0, policy_version 1055360 (0.0005) [2023-12-26 08:01:07,316][123091] Updated weights for policy 0, policy_version 1055370 (0.0005) [2023-12-26 08:01:07,396][123090] Updated weights for policy 1, policy_version 1048068 (0.0009) [2023-12-26 08:01:07,445][123090] Updated weights for policy 1, policy_version 1048078 (0.0009) [2023-12-26 08:01:07,501][123090] Updated weights for policy 1, policy_version 1048088 (0.0008) [2023-12-26 08:01:08,053][123091] Updated weights for policy 0, policy_version 1055380 (0.0011) [2023-12-26 08:01:08,120][123091] Updated weights for policy 0, policy_version 1055390 (0.0011) [2023-12-26 08:01:08,184][123091] Updated weights for policy 0, policy_version 1055400 (0.0006) [2023-12-26 08:01:08,380][123090] Updated weights for policy 1, policy_version 1048098 (0.0008) [2023-12-26 08:01:08,448][123090] Updated weights for policy 1, policy_version 1048108 (0.0007) [2023-12-26 08:01:08,504][123090] Updated weights for policy 1, policy_version 1048118 (0.0009) [2023-12-26 08:01:08,559][123090] Updated weights for policy 1, policy_version 1048128 (0.0009) [2023-12-26 08:01:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 538509312. Throughput: 0: 8836.0, 1: 8806.0. Samples: 538485188. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:08,785][121949] Avg episode reward: [(0, '6317.275'), (1, '5458.844')] [2023-12-26 08:01:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001055408_270188544.pth... [2023-12-26 08:01:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001048128_268320768.pth... [2023-12-26 08:01:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001054384_269926400.pth [2023-12-26 08:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001047104_268058624.pth [2023-12-26 08:01:09,021][123091] Updated weights for policy 0, policy_version 1055410 (0.0007) [2023-12-26 08:01:09,091][123091] Updated weights for policy 0, policy_version 1055420 (0.0010) [2023-12-26 08:01:09,174][123091] Updated weights for policy 0, policy_version 1055430 (0.0010) [2023-12-26 08:01:09,234][123091] Updated weights for policy 0, policy_version 1055440 (0.0009) [2023-12-26 08:01:09,269][123090] Updated weights for policy 1, policy_version 1048138 (0.0008) [2023-12-26 08:01:09,320][123090] Updated weights for policy 1, policy_version 1048148 (0.0005) [2023-12-26 08:01:09,380][123090] Updated weights for policy 1, policy_version 1048158 (0.0008) [2023-12-26 08:01:10,081][123090] Updated weights for policy 1, policy_version 1048168 (0.0008) [2023-12-26 08:01:10,089][123091] Updated weights for policy 0, policy_version 1055450 (0.0009) [2023-12-26 08:01:10,142][123090] Updated weights for policy 1, policy_version 1048178 (0.0008) [2023-12-26 08:01:10,145][123091] Updated weights for policy 0, policy_version 1055460 (0.0008) [2023-12-26 08:01:10,199][123091] Updated weights for policy 0, policy_version 1055470 (0.0009) [2023-12-26 08:01:10,209][123090] Updated weights for policy 1, policy_version 1048188 (0.0009) [2023-12-26 08:01:10,903][123090] Updated weights for policy 1, policy_version 1048198 (0.0007) [2023-12-26 08:01:10,973][123090] Updated weights for policy 1, policy_version 1048208 (0.0005) [2023-12-26 08:01:11,052][123090] Updated weights for policy 1, policy_version 1048218 (0.0006) [2023-12-26 08:01:11,099][123091] Updated weights for policy 0, policy_version 1055480 (0.0008) [2023-12-26 08:01:11,170][123091] Updated weights for policy 0, policy_version 1055490 (0.0009) [2023-12-26 08:01:11,235][123091] Updated weights for policy 0, policy_version 1055500 (0.0010) [2023-12-26 08:01:11,812][123090] Updated weights for policy 1, policy_version 1048228 (0.0009) [2023-12-26 08:01:11,867][123090] Updated weights for policy 1, policy_version 1048238 (0.0010) [2023-12-26 08:01:11,922][123090] Updated weights for policy 1, policy_version 1048248 (0.0008) [2023-12-26 08:01:12,115][123091] Updated weights for policy 0, policy_version 1055510 (0.0010) [2023-12-26 08:01:12,183][123091] Updated weights for policy 0, policy_version 1055520 (0.0009) [2023-12-26 08:01:12,246][123091] Updated weights for policy 0, policy_version 1055530 (0.0009) [2023-12-26 08:01:12,790][123090] Updated weights for policy 1, policy_version 1048258 (0.0009) [2023-12-26 08:01:12,858][123090] Updated weights for policy 1, policy_version 1048268 (0.0009) [2023-12-26 08:01:12,914][123090] Updated weights for policy 1, policy_version 1048278 (0.0010) [2023-12-26 08:01:12,966][123090] Updated weights for policy 1, policy_version 1048288 (0.0009) [2023-12-26 08:01:13,025][123091] Updated weights for policy 0, policy_version 1055540 (0.0007) [2023-12-26 08:01:13,089][123091] Updated weights for policy 0, policy_version 1055550 (0.0009) [2023-12-26 08:01:13,158][123091] Updated weights for policy 0, policy_version 1055560 (0.0009) [2023-12-26 08:01:13,764][123090] Updated weights for policy 1, policy_version 1048298 (0.0009) [2023-12-26 08:01:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 538591232. Throughput: 0: 8777.5, 1: 8852.9. Samples: 538589028. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:13,784][121949] Avg episode reward: [(0, '6292.212'), (1, '5782.132')] [2023-12-26 08:01:13,820][123090] Updated weights for policy 1, policy_version 1048308 (0.0009) [2023-12-26 08:01:13,878][123090] Updated weights for policy 1, policy_version 1048318 (0.0009) [2023-12-26 08:01:14,004][123091] Updated weights for policy 0, policy_version 1055570 (0.0010) [2023-12-26 08:01:14,063][123091] Updated weights for policy 0, policy_version 1055580 (0.0009) [2023-12-26 08:01:14,127][123091] Updated weights for policy 0, policy_version 1055590 (0.0010) [2023-12-26 08:01:14,188][123091] Updated weights for policy 0, policy_version 1055600 (0.0010) [2023-12-26 08:01:14,725][123090] Updated weights for policy 1, policy_version 1048328 (0.0010) [2023-12-26 08:01:14,787][123090] Updated weights for policy 1, policy_version 1048338 (0.0009) [2023-12-26 08:01:14,848][123090] Updated weights for policy 1, policy_version 1048348 (0.0011) [2023-12-26 08:01:15,005][123091] Updated weights for policy 0, policy_version 1055610 (0.0008) [2023-12-26 08:01:15,072][123091] Updated weights for policy 0, policy_version 1055620 (0.0009) [2023-12-26 08:01:15,137][123091] Updated weights for policy 0, policy_version 1055630 (0.0009) [2023-12-26 08:01:15,650][123090] Updated weights for policy 1, policy_version 1048358 (0.0011) [2023-12-26 08:01:15,722][123090] Updated weights for policy 1, policy_version 1048368 (0.0011) [2023-12-26 08:01:15,789][123090] Updated weights for policy 1, policy_version 1048378 (0.0011) [2023-12-26 08:01:15,996][123091] Updated weights for policy 0, policy_version 1055640 (0.0009) [2023-12-26 08:01:16,055][123091] Updated weights for policy 0, policy_version 1055650 (0.0008) [2023-12-26 08:01:16,111][123091] Updated weights for policy 0, policy_version 1055660 (0.0009) [2023-12-26 08:01:16,543][123090] Updated weights for policy 1, policy_version 1048388 (0.0009) [2023-12-26 08:01:16,591][123090] Updated weights for policy 1, policy_version 1048398 (0.0006) [2023-12-26 08:01:16,644][123090] Updated weights for policy 1, policy_version 1048408 (0.0005) [2023-12-26 08:01:17,016][123091] Updated weights for policy 0, policy_version 1055671 (0.0011) [2023-12-26 08:01:17,070][123091] Updated weights for policy 0, policy_version 1055682 (0.0010) [2023-12-26 08:01:17,135][123091] Updated weights for policy 0, policy_version 1055693 (0.0010) [2023-12-26 08:01:17,289][123090] Updated weights for policy 1, policy_version 1048418 (0.0005) [2023-12-26 08:01:17,340][123090] Updated weights for policy 1, policy_version 1048428 (0.0005) [2023-12-26 08:01:17,397][123090] Updated weights for policy 1, policy_version 1048438 (0.0005) [2023-12-26 08:01:17,456][123090] Updated weights for policy 1, policy_version 1048448 (0.0006) [2023-12-26 08:01:17,958][123091] Updated weights for policy 0, policy_version 1055703 (0.0006) [2023-12-26 08:01:18,018][123091] Updated weights for policy 0, policy_version 1055713 (0.0008) [2023-12-26 08:01:18,071][123091] Updated weights for policy 0, policy_version 1055723 (0.0009) [2023-12-26 08:01:18,203][123090] Updated weights for policy 1, policy_version 1048458 (0.0010) [2023-12-26 08:01:18,251][123090] Updated weights for policy 1, policy_version 1048468 (0.0010) [2023-12-26 08:01:18,302][123090] Updated weights for policy 1, policy_version 1048478 (0.0009) [2023-12-26 08:01:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 538681344. Throughput: 0: 8748.1, 1: 8844.8. Samples: 538694928. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:18,784][121949] Avg episode reward: [(0, '6277.663'), (1, '5556.806')] [2023-12-26 08:01:18,817][123091] Updated weights for policy 0, policy_version 1055733 (0.0009) [2023-12-26 08:01:18,879][123091] Updated weights for policy 0, policy_version 1055743 (0.0009) [2023-12-26 08:01:18,944][123091] Updated weights for policy 0, policy_version 1055753 (0.0010) [2023-12-26 08:01:19,042][123090] Updated weights for policy 1, policy_version 1048488 (0.0008) [2023-12-26 08:01:19,100][123090] Updated weights for policy 1, policy_version 1048498 (0.0005) [2023-12-26 08:01:19,163][123090] Updated weights for policy 1, policy_version 1048508 (0.0005) [2023-12-26 08:01:19,770][123091] Updated weights for policy 0, policy_version 1055763 (0.0008) [2023-12-26 08:01:19,828][123091] Updated weights for policy 0, policy_version 1055773 (0.0007) [2023-12-26 08:01:19,882][123091] Updated weights for policy 0, policy_version 1055783 (0.0010) [2023-12-26 08:01:19,987][123090] Updated weights for policy 1, policy_version 1048518 (0.0009) [2023-12-26 08:01:20,046][123090] Updated weights for policy 1, policy_version 1048528 (0.0010) [2023-12-26 08:01:20,119][123090] Updated weights for policy 1, policy_version 1048538 (0.0010) [2023-12-26 08:01:20,734][123091] Updated weights for policy 0, policy_version 1055793 (0.0010) [2023-12-26 08:01:20,795][123091] Updated weights for policy 0, policy_version 1055803 (0.0011) [2023-12-26 08:01:20,848][123091] Updated weights for policy 0, policy_version 1055813 (0.0011) [2023-12-26 08:01:20,911][123091] Updated weights for policy 0, policy_version 1055823 (0.0007) [2023-12-26 08:01:20,971][123090] Updated weights for policy 1, policy_version 1048548 (0.0010) [2023-12-26 08:01:21,038][123090] Updated weights for policy 1, policy_version 1048558 (0.0010) [2023-12-26 08:01:21,102][123090] Updated weights for policy 1, policy_version 1048568 (0.0012) [2023-12-26 08:01:21,760][123091] Updated weights for policy 0, policy_version 1055833 (0.0009) [2023-12-26 08:01:21,819][123091] Updated weights for policy 0, policy_version 1055843 (0.0009) [2023-12-26 08:01:21,884][123091] Updated weights for policy 0, policy_version 1055853 (0.0008) [2023-12-26 08:01:22,020][123090] Updated weights for policy 1, policy_version 1048578 (0.0010) [2023-12-26 08:01:22,068][123090] Updated weights for policy 1, policy_version 1048588 (0.0010) [2023-12-26 08:01:22,120][123090] Updated weights for policy 1, policy_version 1048598 (0.0010) [2023-12-26 08:01:22,172][123090] Updated weights for policy 1, policy_version 1048608 (0.0010) [2023-12-26 08:01:22,738][123091] Updated weights for policy 0, policy_version 1055863 (0.0009) [2023-12-26 08:01:22,801][123091] Updated weights for policy 0, policy_version 1055873 (0.0010) [2023-12-26 08:01:22,865][123091] Updated weights for policy 0, policy_version 1055883 (0.0010) [2023-12-26 08:01:23,031][123090] Updated weights for policy 1, policy_version 1048618 (0.0009) [2023-12-26 08:01:23,094][123090] Updated weights for policy 1, policy_version 1048628 (0.0010) [2023-12-26 08:01:23,149][123090] Updated weights for policy 1, policy_version 1048638 (0.0009) [2023-12-26 08:01:23,699][123091] Updated weights for policy 0, policy_version 1055893 (0.0010) [2023-12-26 08:01:23,762][123091] Updated weights for policy 0, policy_version 1055903 (0.0010) [2023-12-26 08:01:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 538763264. Throughput: 0: 8695.6, 1: 8857.2. Samples: 538746016. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:23,785][121949] Avg episode reward: [(0, '6256.669'), (1, '5363.254')] [2023-12-26 08:01:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001048640_268451840.pth... [2023-12-26 08:01:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001047584_268181504.pth [2023-12-26 08:01:23,827][123091] Updated weights for policy 0, policy_version 1055913 (0.0010) [2023-12-26 08:01:23,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001055920_270319616.pth... [2023-12-26 08:01:23,870][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001054896_270057472.pth [2023-12-26 08:01:23,925][123090] Updated weights for policy 1, policy_version 1048648 (0.0009) [2023-12-26 08:01:23,979][123090] Updated weights for policy 1, policy_version 1048658 (0.0008) [2023-12-26 08:01:24,031][123090] Updated weights for policy 1, policy_version 1048668 (0.0008) [2023-12-26 08:01:24,658][123091] Updated weights for policy 0, policy_version 1055923 (0.0008) [2023-12-26 08:01:24,721][123091] Updated weights for policy 0, policy_version 1055933 (0.0005) [2023-12-26 08:01:24,778][123091] Updated weights for policy 0, policy_version 1055943 (0.0007) [2023-12-26 08:01:24,874][123090] Updated weights for policy 1, policy_version 1048678 (0.0008) [2023-12-26 08:01:24,931][123090] Updated weights for policy 1, policy_version 1048688 (0.0009) [2023-12-26 08:01:24,987][123090] Updated weights for policy 1, policy_version 1048698 (0.0009) [2023-12-26 08:01:25,531][123091] Updated weights for policy 0, policy_version 1055953 (0.0009) [2023-12-26 08:01:25,591][123091] Updated weights for policy 0, policy_version 1055963 (0.0009) [2023-12-26 08:01:25,654][123091] Updated weights for policy 0, policy_version 1055973 (0.0009) [2023-12-26 08:01:25,721][123091] Updated weights for policy 0, policy_version 1055983 (0.0007) [2023-12-26 08:01:25,848][123090] Updated weights for policy 1, policy_version 1048708 (0.0010) [2023-12-26 08:01:25,910][123090] Updated weights for policy 1, policy_version 1048718 (0.0010) [2023-12-26 08:01:25,965][123090] Updated weights for policy 1, policy_version 1048728 (0.0009) [2023-12-26 08:01:26,557][123091] Updated weights for policy 0, policy_version 1055993 (0.0010) [2023-12-26 08:01:26,612][123091] Updated weights for policy 0, policy_version 1056004 (0.0010) [2023-12-26 08:01:26,674][123091] Updated weights for policy 0, policy_version 1056014 (0.0010) [2023-12-26 08:01:26,760][123090] Updated weights for policy 1, policy_version 1048738 (0.0009) [2023-12-26 08:01:26,821][123090] Updated weights for policy 1, policy_version 1048748 (0.0009) [2023-12-26 08:01:26,893][123090] Updated weights for policy 1, policy_version 1048758 (0.0009) [2023-12-26 08:01:26,946][123090] Updated weights for policy 1, policy_version 1048768 (0.0009) [2023-12-26 08:01:27,519][123091] Updated weights for policy 0, policy_version 1056024 (0.0009) [2023-12-26 08:01:27,571][123091] Updated weights for policy 0, policy_version 1056034 (0.0008) [2023-12-26 08:01:27,621][123091] Updated weights for policy 0, policy_version 1056045 (0.0009) [2023-12-26 08:01:27,770][123090] Updated weights for policy 1, policy_version 1048778 (0.0009) [2023-12-26 08:01:27,824][123090] Updated weights for policy 1, policy_version 1048788 (0.0009) [2023-12-26 08:01:27,879][123090] Updated weights for policy 1, policy_version 1048798 (0.0009) [2023-12-26 08:01:28,463][123091] Updated weights for policy 0, policy_version 1056055 (0.0009) [2023-12-26 08:01:28,515][123091] Updated weights for policy 0, policy_version 1056065 (0.0009) [2023-12-26 08:01:28,566][123091] Updated weights for policy 0, policy_version 1056075 (0.0009) [2023-12-26 08:01:28,741][123090] Updated weights for policy 1, policy_version 1048808 (0.0010) [2023-12-26 08:01:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 538853376. Throughput: 0: 8646.5, 1: 8898.0. Samples: 538848184. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:28,785][121949] Avg episode reward: [(0, '6114.156'), (1, '5507.906')] [2023-12-26 08:01:28,794][123090] Updated weights for policy 1, policy_version 1048818 (0.0009) [2023-12-26 08:01:28,847][123090] Updated weights for policy 1, policy_version 1048828 (0.0009) [2023-12-26 08:01:29,430][123091] Updated weights for policy 0, policy_version 1056085 (0.0009) [2023-12-26 08:01:29,496][123091] Updated weights for policy 0, policy_version 1056095 (0.0008) [2023-12-26 08:01:29,557][123091] Updated weights for policy 0, policy_version 1056105 (0.0009) [2023-12-26 08:01:29,716][123090] Updated weights for policy 1, policy_version 1048838 (0.0009) [2023-12-26 08:01:29,764][123090] Updated weights for policy 1, policy_version 1048848 (0.0009) [2023-12-26 08:01:29,815][123090] Updated weights for policy 1, policy_version 1048858 (0.0008) [2023-12-26 08:01:30,402][123091] Updated weights for policy 0, policy_version 1056115 (0.0010) [2023-12-26 08:01:30,451][123091] Updated weights for policy 0, policy_version 1056125 (0.0009) [2023-12-26 08:01:30,499][123091] Updated weights for policy 0, policy_version 1056135 (0.0009) [2023-12-26 08:01:30,672][123090] Updated weights for policy 1, policy_version 1048868 (0.0010) [2023-12-26 08:01:30,732][123090] Updated weights for policy 1, policy_version 1048878 (0.0009) [2023-12-26 08:01:30,787][123090] Updated weights for policy 1, policy_version 1048888 (0.0009) [2023-12-26 08:01:31,431][123091] Updated weights for policy 0, policy_version 1056145 (0.0009) [2023-12-26 08:01:31,502][123091] Updated weights for policy 0, policy_version 1056155 (0.0007) [2023-12-26 08:01:31,569][123091] Updated weights for policy 0, policy_version 1056165 (0.0007) [2023-12-26 08:01:31,622][123091] Updated weights for policy 0, policy_version 1056175 (0.0007) [2023-12-26 08:01:31,655][123090] Updated weights for policy 1, policy_version 1048898 (0.0009) [2023-12-26 08:01:31,724][123090] Updated weights for policy 1, policy_version 1048908 (0.0009) [2023-12-26 08:01:31,778][123090] Updated weights for policy 1, policy_version 1048918 (0.0010) [2023-12-26 08:01:31,836][123090] Updated weights for policy 1, policy_version 1048928 (0.0010) [2023-12-26 08:01:32,327][123091] Updated weights for policy 0, policy_version 1056185 (0.0010) [2023-12-26 08:01:32,397][123091] Updated weights for policy 0, policy_version 1056195 (0.0009) [2023-12-26 08:01:32,466][123091] Updated weights for policy 0, policy_version 1056205 (0.0009) [2023-12-26 08:01:32,710][123090] Updated weights for policy 1, policy_version 1048939 (0.0010) [2023-12-26 08:01:32,764][123090] Updated weights for policy 1, policy_version 1048949 (0.0010) [2023-12-26 08:01:32,822][123090] Updated weights for policy 1, policy_version 1048959 (0.0009) [2023-12-26 08:01:33,308][123091] Updated weights for policy 0, policy_version 1056215 (0.0009) [2023-12-26 08:01:33,376][123091] Updated weights for policy 0, policy_version 1056225 (0.0009) [2023-12-26 08:01:33,440][123091] Updated weights for policy 0, policy_version 1056235 (0.0009) [2023-12-26 08:01:33,608][123090] Updated weights for policy 1, policy_version 1048969 (0.0005) [2023-12-26 08:01:33,654][123090] Updated weights for policy 1, policy_version 1048979 (0.0005) [2023-12-26 08:01:33,703][123090] Updated weights for policy 1, policy_version 1048989 (0.0005) [2023-12-26 08:01:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 538943488. Throughput: 0: 8620.2, 1: 8843.6. Samples: 538950264. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:33,785][121949] Avg episode reward: [(0, '6051.944'), (1, '5354.576')] [2023-12-26 08:01:34,226][123091] Updated weights for policy 0, policy_version 1056245 (0.0008) [2023-12-26 08:01:34,291][123091] Updated weights for policy 0, policy_version 1056255 (0.0005) [2023-12-26 08:01:34,349][123091] Updated weights for policy 0, policy_version 1056265 (0.0007) [2023-12-26 08:01:34,453][123090] Updated weights for policy 1, policy_version 1048999 (0.0007) [2023-12-26 08:01:34,520][123090] Updated weights for policy 1, policy_version 1049009 (0.0008) [2023-12-26 08:01:34,587][123090] Updated weights for policy 1, policy_version 1049019 (0.0008) [2023-12-26 08:01:35,156][123091] Updated weights for policy 0, policy_version 1056275 (0.0009) [2023-12-26 08:01:35,210][123091] Updated weights for policy 0, policy_version 1056285 (0.0010) [2023-12-26 08:01:35,268][123091] Updated weights for policy 0, policy_version 1056295 (0.0010) [2023-12-26 08:01:35,312][123090] Updated weights for policy 1, policy_version 1049029 (0.0007) [2023-12-26 08:01:35,367][123090] Updated weights for policy 1, policy_version 1049039 (0.0005) [2023-12-26 08:01:35,428][123090] Updated weights for policy 1, policy_version 1049049 (0.0005) [2023-12-26 08:01:36,076][123090] Updated weights for policy 1, policy_version 1049059 (0.0007) [2023-12-26 08:01:36,077][123091] Updated weights for policy 0, policy_version 1056305 (0.0008) [2023-12-26 08:01:36,141][123090] Updated weights for policy 1, policy_version 1049069 (0.0010) [2023-12-26 08:01:36,143][123091] Updated weights for policy 0, policy_version 1056315 (0.0007) [2023-12-26 08:01:36,201][123090] Updated weights for policy 1, policy_version 1049079 (0.0011) [2023-12-26 08:01:36,205][123091] Updated weights for policy 0, policy_version 1056325 (0.0006) [2023-12-26 08:01:36,270][123091] Updated weights for policy 0, policy_version 1056335 (0.0009) [2023-12-26 08:01:37,017][123091] Updated weights for policy 0, policy_version 1056345 (0.0006) [2023-12-26 08:01:37,032][123090] Updated weights for policy 1, policy_version 1049089 (0.0008) [2023-12-26 08:01:37,095][123091] Updated weights for policy 0, policy_version 1056355 (0.0006) [2023-12-26 08:01:37,103][123090] Updated weights for policy 1, policy_version 1049099 (0.0005) [2023-12-26 08:01:37,154][123091] Updated weights for policy 0, policy_version 1056365 (0.0007) [2023-12-26 08:01:37,169][123090] Updated weights for policy 1, policy_version 1049109 (0.0007) [2023-12-26 08:01:37,220][123090] Updated weights for policy 1, policy_version 1049119 (0.0010) [2023-12-26 08:01:37,906][123091] Updated weights for policy 0, policy_version 1056375 (0.0009) [2023-12-26 08:01:37,963][123091] Updated weights for policy 0, policy_version 1056385 (0.0009) [2023-12-26 08:01:37,982][123090] Updated weights for policy 1, policy_version 1049129 (0.0006) [2023-12-26 08:01:38,016][123091] Updated weights for policy 0, policy_version 1056395 (0.0009) [2023-12-26 08:01:38,047][123090] Updated weights for policy 1, policy_version 1049139 (0.0005) [2023-12-26 08:01:38,114][123090] Updated weights for policy 1, policy_version 1049149 (0.0007) [2023-12-26 08:01:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 539025408. Throughput: 0: 8617.5, 1: 8955.3. Samples: 539005892. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:38,785][121949] Avg episode reward: [(0, '6131.096'), (1, '5368.453')] [2023-12-26 08:01:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001049152_268582912.pth... [2023-12-26 08:01:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001056400_270442496.pth... [2023-12-26 08:01:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001055408_270188544.pth [2023-12-26 08:01:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001048128_268320768.pth [2023-12-26 08:01:38,855][123091] Updated weights for policy 0, policy_version 1056405 (0.0009) [2023-12-26 08:01:38,902][123090] Updated weights for policy 1, policy_version 1049159 (0.0009) [2023-12-26 08:01:38,917][123091] Updated weights for policy 0, policy_version 1056415 (0.0008) [2023-12-26 08:01:38,958][123090] Updated weights for policy 1, policy_version 1049169 (0.0006) [2023-12-26 08:01:38,978][123091] Updated weights for policy 0, policy_version 1056425 (0.0010) [2023-12-26 08:01:39,022][123090] Updated weights for policy 1, policy_version 1049179 (0.0006) [2023-12-26 08:01:39,796][123090] Updated weights for policy 1, policy_version 1049189 (0.0009) [2023-12-26 08:01:39,837][123091] Updated weights for policy 0, policy_version 1056435 (0.0009) [2023-12-26 08:01:39,871][123090] Updated weights for policy 1, policy_version 1049199 (0.0008) [2023-12-26 08:01:39,904][123091] Updated weights for policy 0, policy_version 1056445 (0.0009) [2023-12-26 08:01:39,935][123090] Updated weights for policy 1, policy_version 1049209 (0.0009) [2023-12-26 08:01:39,979][123091] Updated weights for policy 0, policy_version 1056455 (0.0010) [2023-12-26 08:01:40,637][123090] Updated weights for policy 1, policy_version 1049219 (0.0010) [2023-12-26 08:01:40,704][123090] Updated weights for policy 1, policy_version 1049229 (0.0009) [2023-12-26 08:01:40,771][123090] Updated weights for policy 1, policy_version 1049239 (0.0008) [2023-12-26 08:01:40,854][123091] Updated weights for policy 0, policy_version 1056465 (0.0007) [2023-12-26 08:01:40,908][123091] Updated weights for policy 0, policy_version 1056475 (0.0010) [2023-12-26 08:01:40,967][123091] Updated weights for policy 0, policy_version 1056485 (0.0010) [2023-12-26 08:01:41,019][123091] Updated weights for policy 0, policy_version 1056495 (0.0009) [2023-12-26 08:01:41,539][123090] Updated weights for policy 1, policy_version 1049249 (0.0010) [2023-12-26 08:01:41,598][123090] Updated weights for policy 1, policy_version 1049259 (0.0010) [2023-12-26 08:01:41,666][123090] Updated weights for policy 1, policy_version 1049269 (0.0007) [2023-12-26 08:01:41,731][123090] Updated weights for policy 1, policy_version 1049279 (0.0009) [2023-12-26 08:01:41,969][123091] Updated weights for policy 0, policy_version 1056505 (0.0009) [2023-12-26 08:01:42,038][123091] Updated weights for policy 0, policy_version 1056515 (0.0010) [2023-12-26 08:01:42,104][123091] Updated weights for policy 0, policy_version 1056525 (0.0009) [2023-12-26 08:01:42,577][123090] Updated weights for policy 1, policy_version 1049289 (0.0009) [2023-12-26 08:01:42,632][123090] Updated weights for policy 1, policy_version 1049299 (0.0009) [2023-12-26 08:01:42,692][123090] Updated weights for policy 1, policy_version 1049309 (0.0010) [2023-12-26 08:01:42,915][123091] Updated weights for policy 0, policy_version 1056535 (0.0010) [2023-12-26 08:01:42,985][123091] Updated weights for policy 0, policy_version 1056545 (0.0009) [2023-12-26 08:01:43,041][123091] Updated weights for policy 0, policy_version 1056555 (0.0009) [2023-12-26 08:01:43,551][123090] Updated weights for policy 1, policy_version 1049319 (0.0010) [2023-12-26 08:01:43,608][123090] Updated weights for policy 1, policy_version 1049329 (0.0009) [2023-12-26 08:01:43,663][123090] Updated weights for policy 1, policy_version 1049339 (0.0009) [2023-12-26 08:01:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 539115520. Throughput: 0: 8519.1, 1: 8870.7. Samples: 539109232. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:43,785][121949] Avg episode reward: [(0, '6087.335'), (1, '5644.489')] [2023-12-26 08:01:43,828][123091] Updated weights for policy 0, policy_version 1056565 (0.0007) [2023-12-26 08:01:43,894][123091] Updated weights for policy 0, policy_version 1056575 (0.0005) [2023-12-26 08:01:43,951][123091] Updated weights for policy 0, policy_version 1056585 (0.0006) [2023-12-26 08:01:44,553][123091] Updated weights for policy 0, policy_version 1056595 (0.0005) [2023-12-26 08:01:44,602][123090] Updated weights for policy 1, policy_version 1049349 (0.0009) [2023-12-26 08:01:44,610][123091] Updated weights for policy 0, policy_version 1056605 (0.0005) [2023-12-26 08:01:44,667][123091] Updated weights for policy 0, policy_version 1056615 (0.0007) [2023-12-26 08:01:44,668][123090] Updated weights for policy 1, policy_version 1049359 (0.0009) [2023-12-26 08:01:44,727][123090] Updated weights for policy 1, policy_version 1049369 (0.0009) [2023-12-26 08:01:45,438][123091] Updated weights for policy 0, policy_version 1056625 (0.0010) [2023-12-26 08:01:45,511][123091] Updated weights for policy 0, policy_version 1056635 (0.0006) [2023-12-26 08:01:45,573][123091] Updated weights for policy 0, policy_version 1056645 (0.0005) [2023-12-26 08:01:45,593][123090] Updated weights for policy 1, policy_version 1049379 (0.0008) [2023-12-26 08:01:45,632][123091] Updated weights for policy 0, policy_version 1056655 (0.0005) [2023-12-26 08:01:45,652][123090] Updated weights for policy 1, policy_version 1049389 (0.0008) [2023-12-26 08:01:45,706][123090] Updated weights for policy 1, policy_version 1049399 (0.0009) [2023-12-26 08:01:46,261][123091] Updated weights for policy 0, policy_version 1056665 (0.0006) [2023-12-26 08:01:46,317][123091] Updated weights for policy 0, policy_version 1056675 (0.0006) [2023-12-26 08:01:46,368][123091] Updated weights for policy 0, policy_version 1056685 (0.0005) [2023-12-26 08:01:46,664][123090] Updated weights for policy 1, policy_version 1049409 (0.0009) [2023-12-26 08:01:46,726][123090] Updated weights for policy 1, policy_version 1049419 (0.0010) [2023-12-26 08:01:46,788][123090] Updated weights for policy 1, policy_version 1049429 (0.0010) [2023-12-26 08:01:46,842][123090] Updated weights for policy 1, policy_version 1049439 (0.0010) [2023-12-26 08:01:47,034][123091] Updated weights for policy 0, policy_version 1056695 (0.0005) [2023-12-26 08:01:47,094][123091] Updated weights for policy 0, policy_version 1056705 (0.0005) [2023-12-26 08:01:47,146][123091] Updated weights for policy 0, policy_version 1056715 (0.0005) [2023-12-26 08:01:47,732][123091] Updated weights for policy 0, policy_version 1056725 (0.0007) [2023-12-26 08:01:47,786][123090] Updated weights for policy 1, policy_version 1049449 (0.0010) [2023-12-26 08:01:47,797][123091] Updated weights for policy 0, policy_version 1056735 (0.0008) [2023-12-26 08:01:47,841][123090] Updated weights for policy 1, policy_version 1049459 (0.0010) [2023-12-26 08:01:47,859][123091] Updated weights for policy 0, policy_version 1056745 (0.0008) [2023-12-26 08:01:47,892][123090] Updated weights for policy 1, policy_version 1049469 (0.0010) [2023-12-26 08:01:48,554][123091] Updated weights for policy 0, policy_version 1056755 (0.0006) [2023-12-26 08:01:48,620][123091] Updated weights for policy 0, policy_version 1056765 (0.0005) [2023-12-26 08:01:48,684][123091] Updated weights for policy 0, policy_version 1056775 (0.0007) [2023-12-26 08:01:48,695][123090] Updated weights for policy 1, policy_version 1049479 (0.0010) [2023-12-26 08:01:48,759][123090] Updated weights for policy 1, policy_version 1049489 (0.0010) [2023-12-26 08:01:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 539205632. Throughput: 0: 8737.3, 1: 8737.4. Samples: 539218768. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:48,785][121949] Avg episode reward: [(0, '6029.878'), (1, '5901.395')] [2023-12-26 08:01:48,821][123090] Updated weights for policy 1, policy_version 1049499 (0.0010) [2023-12-26 08:01:49,440][123091] Updated weights for policy 0, policy_version 1056785 (0.0006) [2023-12-26 08:01:49,507][123091] Updated weights for policy 0, policy_version 1056795 (0.0010) [2023-12-26 08:01:49,568][123091] Updated weights for policy 0, policy_version 1056805 (0.0010) [2023-12-26 08:01:49,638][123091] Updated weights for policy 0, policy_version 1056815 (0.0009) [2023-12-26 08:01:49,638][123090] Updated weights for policy 1, policy_version 1049509 (0.0009) [2023-12-26 08:01:49,699][123090] Updated weights for policy 1, policy_version 1049519 (0.0009) [2023-12-26 08:01:49,757][123090] Updated weights for policy 1, policy_version 1049529 (0.0009) [2023-12-26 08:01:50,455][123091] Updated weights for policy 0, policy_version 1056825 (0.0009) [2023-12-26 08:01:50,522][123091] Updated weights for policy 0, policy_version 1056835 (0.0010) [2023-12-26 08:01:50,587][123091] Updated weights for policy 0, policy_version 1056845 (0.0009) [2023-12-26 08:01:50,616][123090] Updated weights for policy 1, policy_version 1049539 (0.0009) [2023-12-26 08:01:50,671][123090] Updated weights for policy 1, policy_version 1049549 (0.0009) [2023-12-26 08:01:50,743][123090] Updated weights for policy 1, policy_version 1049559 (0.0009) [2023-12-26 08:01:51,404][123091] Updated weights for policy 0, policy_version 1056855 (0.0009) [2023-12-26 08:01:51,462][123091] Updated weights for policy 0, policy_version 1056865 (0.0010) [2023-12-26 08:01:51,520][123091] Updated weights for policy 0, policy_version 1056875 (0.0009) [2023-12-26 08:01:51,584][123090] Updated weights for policy 1, policy_version 1049569 (0.0009) [2023-12-26 08:01:51,649][123090] Updated weights for policy 1, policy_version 1049579 (0.0009) [2023-12-26 08:01:51,718][123090] Updated weights for policy 1, policy_version 1049589 (0.0008) [2023-12-26 08:01:51,796][123090] Updated weights for policy 1, policy_version 1049599 (0.0009) [2023-12-26 08:01:52,407][123091] Updated weights for policy 0, policy_version 1056885 (0.0009) [2023-12-26 08:01:52,475][123091] Updated weights for policy 0, policy_version 1056895 (0.0009) [2023-12-26 08:01:52,527][123091] Updated weights for policy 0, policy_version 1056905 (0.0009) [2023-12-26 08:01:52,660][123090] Updated weights for policy 1, policy_version 1049609 (0.0010) [2023-12-26 08:01:52,719][123090] Updated weights for policy 1, policy_version 1049619 (0.0010) [2023-12-26 08:01:52,775][123090] Updated weights for policy 1, policy_version 1049629 (0.0010) [2023-12-26 08:01:53,378][123091] Updated weights for policy 0, policy_version 1056915 (0.0009) [2023-12-26 08:01:53,425][123091] Updated weights for policy 0, policy_version 1056925 (0.0008) [2023-12-26 08:01:53,481][123091] Updated weights for policy 0, policy_version 1056935 (0.0009) [2023-12-26 08:01:53,613][123090] Updated weights for policy 1, policy_version 1049639 (0.0007) [2023-12-26 08:01:53,662][123090] Updated weights for policy 1, policy_version 1049649 (0.0005) [2023-12-26 08:01:53,710][123090] Updated weights for policy 1, policy_version 1049659 (0.0005) [2023-12-26 08:01:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 539295744. Throughput: 0: 8721.3, 1: 8704.4. Samples: 539269344. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:53,785][121949] Avg episode reward: [(0, '5954.033'), (1, '5841.361')] [2023-12-26 08:01:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001056944_270581760.pth... [2023-12-26 08:01:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001049664_268713984.pth... [2023-12-26 08:01:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001055920_270319616.pth [2023-12-26 08:01:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001048640_268451840.pth [2023-12-26 08:01:54,315][123091] Updated weights for policy 0, policy_version 1056945 (0.0009) [2023-12-26 08:01:54,365][123091] Updated weights for policy 0, policy_version 1056955 (0.0010) [2023-12-26 08:01:54,409][123091] Updated weights for policy 0, policy_version 1056965 (0.0009) [2023-12-26 08:01:54,434][123090] Updated weights for policy 1, policy_version 1049669 (0.0008) [2023-12-26 08:01:54,455][123091] Updated weights for policy 0, policy_version 1056975 (0.0007) [2023-12-26 08:01:54,504][123090] Updated weights for policy 1, policy_version 1049679 (0.0010) [2023-12-26 08:01:54,577][123090] Updated weights for policy 1, policy_version 1049689 (0.0009) [2023-12-26 08:01:55,180][123091] Updated weights for policy 0, policy_version 1056985 (0.0005) [2023-12-26 08:01:55,236][123091] Updated weights for policy 0, policy_version 1056995 (0.0005) [2023-12-26 08:01:55,290][123091] Updated weights for policy 0, policy_version 1057005 (0.0005) [2023-12-26 08:01:55,386][123090] Updated weights for policy 1, policy_version 1049699 (0.0010) [2023-12-26 08:01:55,448][123090] Updated weights for policy 1, policy_version 1049709 (0.0010) [2023-12-26 08:01:55,505][123090] Updated weights for policy 1, policy_version 1049719 (0.0005) [2023-12-26 08:01:56,029][123091] Updated weights for policy 0, policy_version 1057015 (0.0009) [2023-12-26 08:01:56,083][123091] Updated weights for policy 0, policy_version 1057025 (0.0010) [2023-12-26 08:01:56,136][123091] Updated weights for policy 0, policy_version 1057036 (0.0010) [2023-12-26 08:01:56,256][123090] Updated weights for policy 1, policy_version 1049729 (0.0006) [2023-12-26 08:01:56,320][123090] Updated weights for policy 1, policy_version 1049739 (0.0010) [2023-12-26 08:01:56,373][123090] Updated weights for policy 1, policy_version 1049750 (0.0010) [2023-12-26 08:01:56,970][123091] Updated weights for policy 0, policy_version 1057047 (0.0010) [2023-12-26 08:01:57,019][123091] Updated weights for policy 0, policy_version 1057057 (0.0009) [2023-12-26 08:01:57,077][123091] Updated weights for policy 0, policy_version 1057067 (0.0010) [2023-12-26 08:01:57,177][123090] Updated weights for policy 1, policy_version 1049761 (0.0009) [2023-12-26 08:01:57,228][123090] Updated weights for policy 1, policy_version 1049771 (0.0005) [2023-12-26 08:01:57,286][123090] Updated weights for policy 1, policy_version 1049781 (0.0005) [2023-12-26 08:01:57,361][123090] Updated weights for policy 1, policy_version 1049791 (0.0007) [2023-12-26 08:01:57,960][123091] Updated weights for policy 0, policy_version 1057078 (0.0011) [2023-12-26 08:01:58,020][123091] Updated weights for policy 0, policy_version 1057088 (0.0009) [2023-12-26 08:01:58,090][123091] Updated weights for policy 0, policy_version 1057098 (0.0008) [2023-12-26 08:01:58,156][123090] Updated weights for policy 1, policy_version 1049801 (0.0007) [2023-12-26 08:01:58,220][123090] Updated weights for policy 1, policy_version 1049811 (0.0007) [2023-12-26 08:01:58,290][123090] Updated weights for policy 1, policy_version 1049821 (0.0008) [2023-12-26 08:01:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 539377664. Throughput: 0: 8775.3, 1: 8687.9. Samples: 539374872. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:01:58,785][121949] Avg episode reward: [(0, '6070.454'), (1, '5672.431')] [2023-12-26 08:01:58,940][123091] Updated weights for policy 0, policy_version 1057108 (0.0008) [2023-12-26 08:01:59,004][123091] Updated weights for policy 0, policy_version 1057118 (0.0009) [2023-12-26 08:01:59,068][123091] Updated weights for policy 0, policy_version 1057128 (0.0009) [2023-12-26 08:01:59,105][123090] Updated weights for policy 1, policy_version 1049831 (0.0009) [2023-12-26 08:01:59,149][123090] Updated weights for policy 1, policy_version 1049841 (0.0010) [2023-12-26 08:01:59,199][123090] Updated weights for policy 1, policy_version 1049851 (0.0010) [2023-12-26 08:01:59,887][123091] Updated weights for policy 0, policy_version 1057138 (0.0009) [2023-12-26 08:01:59,955][123091] Updated weights for policy 0, policy_version 1057148 (0.0010) [2023-12-26 08:02:00,020][123091] Updated weights for policy 0, policy_version 1057158 (0.0009) [2023-12-26 08:02:00,036][123090] Updated weights for policy 1, policy_version 1049861 (0.0009) [2023-12-26 08:02:00,066][123091] Updated weights for policy 0, policy_version 1057168 (0.0007) [2023-12-26 08:02:00,102][123090] Updated weights for policy 1, policy_version 1049871 (0.0007) [2023-12-26 08:02:00,166][123090] Updated weights for policy 1, policy_version 1049881 (0.0005) [2023-12-26 08:02:00,837][123090] Updated weights for policy 1, policy_version 1049891 (0.0007) [2023-12-26 08:02:00,890][123090] Updated weights for policy 1, policy_version 1049901 (0.0009) [2023-12-26 08:02:00,922][123091] Updated weights for policy 0, policy_version 1057178 (0.0006) [2023-12-26 08:02:00,944][123090] Updated weights for policy 1, policy_version 1049911 (0.0005) [2023-12-26 08:02:00,971][123091] Updated weights for policy 0, policy_version 1057188 (0.0005) [2023-12-26 08:02:01,034][123091] Updated weights for policy 0, policy_version 1057198 (0.0006) [2023-12-26 08:02:01,782][123091] Updated weights for policy 0, policy_version 1057208 (0.0010) [2023-12-26 08:02:01,828][123090] Updated weights for policy 1, policy_version 1049921 (0.0006) [2023-12-26 08:02:01,849][123091] Updated weights for policy 0, policy_version 1057218 (0.0010) [2023-12-26 08:02:01,880][123090] Updated weights for policy 1, policy_version 1049931 (0.0008) [2023-12-26 08:02:01,912][123091] Updated weights for policy 0, policy_version 1057228 (0.0006) [2023-12-26 08:02:01,933][123090] Updated weights for policy 1, policy_version 1049941 (0.0009) [2023-12-26 08:02:01,986][123090] Updated weights for policy 1, policy_version 1049951 (0.0010) [2023-12-26 08:02:02,672][123091] Updated weights for policy 0, policy_version 1057238 (0.0007) [2023-12-26 08:02:02,739][123091] Updated weights for policy 0, policy_version 1057248 (0.0009) [2023-12-26 08:02:02,793][123091] Updated weights for policy 0, policy_version 1057258 (0.0009) [2023-12-26 08:02:02,855][123090] Updated weights for policy 1, policy_version 1049961 (0.0008) [2023-12-26 08:02:02,923][123090] Updated weights for policy 1, policy_version 1049971 (0.0009) [2023-12-26 08:02:02,984][123090] Updated weights for policy 1, policy_version 1049981 (0.0009) [2023-12-26 08:02:03,537][123091] Updated weights for policy 0, policy_version 1057268 (0.0006) [2023-12-26 08:02:03,595][123091] Updated weights for policy 0, policy_version 1057278 (0.0005) [2023-12-26 08:02:03,660][123091] Updated weights for policy 0, policy_version 1057288 (0.0006) [2023-12-26 08:02:03,678][123090] Updated weights for policy 1, policy_version 1049991 (0.0006) [2023-12-26 08:02:03,726][123090] Updated weights for policy 1, policy_version 1050001 (0.0006) [2023-12-26 08:02:03,777][123090] Updated weights for policy 1, policy_version 1050011 (0.0009) [2023-12-26 08:02:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 539467776. Throughput: 0: 8817.8, 1: 8636.5. Samples: 539480372. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:03,785][121949] Avg episode reward: [(0, '6086.757'), (1, '5676.203')] [2023-12-26 08:02:04,401][123091] Updated weights for policy 0, policy_version 1057298 (0.0006) [2023-12-26 08:02:04,463][123091] Updated weights for policy 0, policy_version 1057308 (0.0010) [2023-12-26 08:02:04,528][123091] Updated weights for policy 0, policy_version 1057318 (0.0009) [2023-12-26 08:02:04,551][123090] Updated weights for policy 1, policy_version 1050022 (0.0007) [2023-12-26 08:02:04,576][123091] Updated weights for policy 0, policy_version 1057328 (0.0008) [2023-12-26 08:02:04,609][123090] Updated weights for policy 1, policy_version 1050032 (0.0006) [2023-12-26 08:02:04,670][123090] Updated weights for policy 1, policy_version 1050042 (0.0005) [2023-12-26 08:02:05,320][123091] Updated weights for policy 0, policy_version 1057338 (0.0005) [2023-12-26 08:02:05,381][123091] Updated weights for policy 0, policy_version 1057348 (0.0005) [2023-12-26 08:02:05,437][123091] Updated weights for policy 0, policy_version 1057358 (0.0005) [2023-12-26 08:02:05,458][123090] Updated weights for policy 1, policy_version 1050052 (0.0007) [2023-12-26 08:02:05,527][123090] Updated weights for policy 1, policy_version 1050062 (0.0006) [2023-12-26 08:02:05,580][123090] Updated weights for policy 1, policy_version 1050072 (0.0005) [2023-12-26 08:02:06,090][123091] Updated weights for policy 0, policy_version 1057368 (0.0006) [2023-12-26 08:02:06,165][123091] Updated weights for policy 0, policy_version 1057378 (0.0008) [2023-12-26 08:02:06,234][123091] Updated weights for policy 0, policy_version 1057388 (0.0008) [2023-12-26 08:02:06,241][123090] Updated weights for policy 1, policy_version 1050082 (0.0006) [2023-12-26 08:02:06,308][123090] Updated weights for policy 1, policy_version 1050092 (0.0011) [2023-12-26 08:02:06,376][123090] Updated weights for policy 1, policy_version 1050102 (0.0011) [2023-12-26 08:02:06,445][123090] Updated weights for policy 1, policy_version 1050112 (0.0011) [2023-12-26 08:02:06,978][123091] Updated weights for policy 0, policy_version 1057398 (0.0010) [2023-12-26 08:02:07,026][123091] Updated weights for policy 0, policy_version 1057408 (0.0011) [2023-12-26 08:02:07,074][123091] Updated weights for policy 0, policy_version 1057418 (0.0011) [2023-12-26 08:02:07,210][123090] Updated weights for policy 1, policy_version 1050122 (0.0005) [2023-12-26 08:02:07,263][123090] Updated weights for policy 1, policy_version 1050132 (0.0005) [2023-12-26 08:02:07,318][123090] Updated weights for policy 1, policy_version 1050142 (0.0005) [2023-12-26 08:02:07,863][123091] Updated weights for policy 0, policy_version 1057428 (0.0009) [2023-12-26 08:02:07,928][123091] Updated weights for policy 0, policy_version 1057438 (0.0008) [2023-12-26 08:02:07,980][123091] Updated weights for policy 0, policy_version 1057448 (0.0009) [2023-12-26 08:02:08,037][123090] Updated weights for policy 1, policy_version 1050152 (0.0010) [2023-12-26 08:02:08,098][123090] Updated weights for policy 1, policy_version 1050162 (0.0007) [2023-12-26 08:02:08,159][123090] Updated weights for policy 1, policy_version 1050172 (0.0005) [2023-12-26 08:02:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 539557888. Throughput: 0: 8881.0, 1: 8692.2. Samples: 539536808. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:08,785][121949] Avg episode reward: [(0, '5993.396'), (1, '5802.605')] [2023-12-26 08:02:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001057456_270712832.pth... [2023-12-26 08:02:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001056400_270442496.pth [2023-12-26 08:02:08,838][123090] Updated weights for policy 1, policy_version 1050182 (0.0005) [2023-12-26 08:02:08,850][123091] Updated weights for policy 0, policy_version 1057458 (0.0008) [2023-12-26 08:02:08,894][123090] Updated weights for policy 1, policy_version 1050192 (0.0007) [2023-12-26 08:02:08,920][123091] Updated weights for policy 0, policy_version 1057468 (0.0007) [2023-12-26 08:02:08,950][123090] Updated weights for policy 1, policy_version 1050202 (0.0008) [2023-12-26 08:02:08,978][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001050208_268853248.pth... [2023-12-26 08:02:08,981][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001049152_268582912.pth [2023-12-26 08:02:08,988][123091] Updated weights for policy 0, policy_version 1057478 (0.0007) [2023-12-26 08:02:09,055][123091] Updated weights for policy 0, policy_version 1057488 (0.0007) [2023-12-26 08:02:09,804][123090] Updated weights for policy 1, policy_version 1050212 (0.0008) [2023-12-26 08:02:09,848][123091] Updated weights for policy 0, policy_version 1057498 (0.0007) [2023-12-26 08:02:09,868][123090] Updated weights for policy 1, policy_version 1050222 (0.0009) [2023-12-26 08:02:09,921][123091] Updated weights for policy 0, policy_version 1057508 (0.0010) [2023-12-26 08:02:09,939][123090] Updated weights for policy 1, policy_version 1050232 (0.0007) [2023-12-26 08:02:09,979][123091] Updated weights for policy 0, policy_version 1057518 (0.0011) [2023-12-26 08:02:10,722][123090] Updated weights for policy 1, policy_version 1050242 (0.0007) [2023-12-26 08:02:10,783][123091] Updated weights for policy 0, policy_version 1057528 (0.0007) [2023-12-26 08:02:10,788][123090] Updated weights for policy 1, policy_version 1050252 (0.0010) [2023-12-26 08:02:10,843][123091] Updated weights for policy 0, policy_version 1057538 (0.0008) [2023-12-26 08:02:10,846][123090] Updated weights for policy 1, policy_version 1050262 (0.0009) [2023-12-26 08:02:10,893][123091] Updated weights for policy 0, policy_version 1057548 (0.0007) [2023-12-26 08:02:10,909][123090] Updated weights for policy 1, policy_version 1050272 (0.0009) [2023-12-26 08:02:11,662][123091] Updated weights for policy 0, policy_version 1057558 (0.0006) [2023-12-26 08:02:11,686][123090] Updated weights for policy 1, policy_version 1050282 (0.0009) [2023-12-26 08:02:11,727][123091] Updated weights for policy 0, policy_version 1057568 (0.0008) [2023-12-26 08:02:11,752][123090] Updated weights for policy 1, policy_version 1050292 (0.0008) [2023-12-26 08:02:11,798][123091] Updated weights for policy 0, policy_version 1057578 (0.0009) [2023-12-26 08:02:11,819][123090] Updated weights for policy 1, policy_version 1050302 (0.0008) [2023-12-26 08:02:12,577][123091] Updated weights for policy 0, policy_version 1057588 (0.0007) [2023-12-26 08:02:12,637][123091] Updated weights for policy 0, policy_version 1057598 (0.0006) [2023-12-26 08:02:12,712][123091] Updated weights for policy 0, policy_version 1057608 (0.0008) [2023-12-26 08:02:12,742][123090] Updated weights for policy 1, policy_version 1050312 (0.0010) [2023-12-26 08:02:12,803][123090] Updated weights for policy 1, policy_version 1050322 (0.0009) [2023-12-26 08:02:12,871][123090] Updated weights for policy 1, policy_version 1050332 (0.0009) [2023-12-26 08:02:13,468][123091] Updated weights for policy 0, policy_version 1057618 (0.0007) [2023-12-26 08:02:13,535][123091] Updated weights for policy 0, policy_version 1057628 (0.0011) [2023-12-26 08:02:13,609][123091] Updated weights for policy 0, policy_version 1057638 (0.0011) [2023-12-26 08:02:13,624][123090] Updated weights for policy 1, policy_version 1050342 (0.0008) [2023-12-26 08:02:13,672][123091] Updated weights for policy 0, policy_version 1057648 (0.0010) [2023-12-26 08:02:13,679][123090] Updated weights for policy 1, policy_version 1050352 (0.0010) [2023-12-26 08:02:13,738][123090] Updated weights for policy 1, policy_version 1050362 (0.0010) [2023-12-26 08:02:13,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 539656192. Throughput: 0: 8935.1, 1: 8741.3. Samples: 539643620. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:13,785][121949] Avg episode reward: [(0, '5980.983'), (1, '5727.574')] [2023-12-26 08:02:14,278][123091] Updated weights for policy 0, policy_version 1057658 (0.0006) [2023-12-26 08:02:14,334][123091] Updated weights for policy 0, policy_version 1057668 (0.0006) [2023-12-26 08:02:14,391][123091] Updated weights for policy 0, policy_version 1057678 (0.0006) [2023-12-26 08:02:14,518][123090] Updated weights for policy 1, policy_version 1050372 (0.0008) [2023-12-26 08:02:14,582][123090] Updated weights for policy 1, policy_version 1050382 (0.0006) [2023-12-26 08:02:14,642][123090] Updated weights for policy 1, policy_version 1050392 (0.0005) [2023-12-26 08:02:15,120][123091] Updated weights for policy 0, policy_version 1057688 (0.0008) [2023-12-26 08:02:15,195][123091] Updated weights for policy 0, policy_version 1057698 (0.0008) [2023-12-26 08:02:15,262][123091] Updated weights for policy 0, policy_version 1057708 (0.0007) [2023-12-26 08:02:15,429][123090] Updated weights for policy 1, policy_version 1050402 (0.0006) [2023-12-26 08:02:15,499][123090] Updated weights for policy 1, policy_version 1050412 (0.0011) [2023-12-26 08:02:15,550][123090] Updated weights for policy 1, policy_version 1050422 (0.0010) [2023-12-26 08:02:15,607][123090] Updated weights for policy 1, policy_version 1050432 (0.0010) [2023-12-26 08:02:15,979][123091] Updated weights for policy 0, policy_version 1057718 (0.0007) [2023-12-26 08:02:16,048][123091] Updated weights for policy 0, policy_version 1057728 (0.0005) [2023-12-26 08:02:16,111][123091] Updated weights for policy 0, policy_version 1057738 (0.0005) [2023-12-26 08:02:16,442][123090] Updated weights for policy 1, policy_version 1050442 (0.0010) [2023-12-26 08:02:16,494][123090] Updated weights for policy 1, policy_version 1050452 (0.0010) [2023-12-26 08:02:16,549][123090] Updated weights for policy 1, policy_version 1050462 (0.0010) [2023-12-26 08:02:16,729][123091] Updated weights for policy 0, policy_version 1057748 (0.0007) [2023-12-26 08:02:16,784][123091] Updated weights for policy 0, policy_version 1057758 (0.0010) [2023-12-26 08:02:16,844][123091] Updated weights for policy 0, policy_version 1057768 (0.0010) [2023-12-26 08:02:17,404][123090] Updated weights for policy 1, policy_version 1050472 (0.0010) [2023-12-26 08:02:17,456][123090] Updated weights for policy 1, policy_version 1050482 (0.0010) [2023-12-26 08:02:17,508][123090] Updated weights for policy 1, policy_version 1050492 (0.0010) [2023-12-26 08:02:17,681][123091] Updated weights for policy 0, policy_version 1057778 (0.0010) [2023-12-26 08:02:17,729][123091] Updated weights for policy 0, policy_version 1057788 (0.0009) [2023-12-26 08:02:17,778][123091] Updated weights for policy 0, policy_version 1057798 (0.0009) [2023-12-26 08:02:17,827][123091] Updated weights for policy 0, policy_version 1057808 (0.0009) [2023-12-26 08:02:18,362][123090] Updated weights for policy 1, policy_version 1050502 (0.0011) [2023-12-26 08:02:18,422][123090] Updated weights for policy 1, policy_version 1050512 (0.0010) [2023-12-26 08:02:18,483][123090] Updated weights for policy 1, policy_version 1050522 (0.0011) [2023-12-26 08:02:18,703][123091] Updated weights for policy 0, policy_version 1057818 (0.0009) [2023-12-26 08:02:18,768][123091] Updated weights for policy 0, policy_version 1057828 (0.0009) [2023-12-26 08:02:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 539738112. Throughput: 0: 9040.6, 1: 8775.8. Samples: 539752000. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:18,784][121949] Avg episode reward: [(0, '6230.272'), (1, '5563.790')] [2023-12-26 08:02:18,825][123091] Updated weights for policy 0, policy_version 1057838 (0.0009) [2023-12-26 08:02:19,320][123090] Updated weights for policy 1, policy_version 1050532 (0.0011) [2023-12-26 08:02:19,395][123090] Updated weights for policy 1, policy_version 1050542 (0.0011) [2023-12-26 08:02:19,451][123090] Updated weights for policy 1, policy_version 1050552 (0.0011) [2023-12-26 08:02:19,725][123091] Updated weights for policy 0, policy_version 1057848 (0.0008) [2023-12-26 08:02:19,798][123091] Updated weights for policy 0, policy_version 1057858 (0.0009) [2023-12-26 08:02:19,871][123091] Updated weights for policy 0, policy_version 1057868 (0.0009) [2023-12-26 08:02:20,223][123090] Updated weights for policy 1, policy_version 1050562 (0.0012) [2023-12-26 08:02:20,294][123090] Updated weights for policy 1, policy_version 1050572 (0.0008) [2023-12-26 08:02:20,364][123090] Updated weights for policy 1, policy_version 1050582 (0.0010) [2023-12-26 08:02:20,428][123090] Updated weights for policy 1, policy_version 1050592 (0.0009) [2023-12-26 08:02:20,757][123091] Updated weights for policy 0, policy_version 1057878 (0.0008) [2023-12-26 08:02:20,827][123091] Updated weights for policy 0, policy_version 1057888 (0.0007) [2023-12-26 08:02:20,900][123091] Updated weights for policy 0, policy_version 1057898 (0.0007) [2023-12-26 08:02:21,222][123090] Updated weights for policy 1, policy_version 1050602 (0.0010) [2023-12-26 08:02:21,293][123090] Updated weights for policy 1, policy_version 1050612 (0.0010) [2023-12-26 08:02:21,366][123090] Updated weights for policy 1, policy_version 1050622 (0.0009) [2023-12-26 08:02:21,697][123091] Updated weights for policy 0, policy_version 1057908 (0.0008) [2023-12-26 08:02:21,769][123091] Updated weights for policy 0, policy_version 1057918 (0.0010) [2023-12-26 08:02:21,834][123091] Updated weights for policy 0, policy_version 1057928 (0.0009) [2023-12-26 08:02:22,146][123090] Updated weights for policy 1, policy_version 1050632 (0.0011) [2023-12-26 08:02:22,222][123090] Updated weights for policy 1, policy_version 1050642 (0.0011) [2023-12-26 08:02:22,298][123090] Updated weights for policy 1, policy_version 1050652 (0.0008) [2023-12-26 08:02:22,626][123091] Updated weights for policy 0, policy_version 1057938 (0.0008) [2023-12-26 08:02:22,674][123091] Updated weights for policy 0, policy_version 1057948 (0.0009) [2023-12-26 08:02:22,739][123091] Updated weights for policy 0, policy_version 1057958 (0.0009) [2023-12-26 08:02:22,800][123091] Updated weights for policy 0, policy_version 1057968 (0.0009) [2023-12-26 08:02:23,083][123090] Updated weights for policy 1, policy_version 1050662 (0.0007) [2023-12-26 08:02:23,161][123090] Updated weights for policy 1, policy_version 1050672 (0.0005) [2023-12-26 08:02:23,218][123090] Updated weights for policy 1, policy_version 1050682 (0.0006) [2023-12-26 08:02:23,713][123091] Updated weights for policy 0, policy_version 1057978 (0.0010) [2023-12-26 08:02:23,783][123091] Updated weights for policy 0, policy_version 1057988 (0.0009) [2023-12-26 08:02:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17550.5). Total num frames: 539820032. Throughput: 0: 8990.2, 1: 8721.3. Samples: 539802904. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:23,784][121949] Avg episode reward: [(0, '6245.763'), (1, '5657.552')] [2023-12-26 08:02:23,816][123090] Updated weights for policy 1, policy_version 1050692 (0.0005) [2023-12-26 08:02:23,840][123091] Updated weights for policy 0, policy_version 1057998 (0.0008) [2023-12-26 08:02:23,848][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001058000_270852096.pth... [2023-12-26 08:02:23,851][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001056944_270581760.pth [2023-12-26 08:02:23,878][123090] Updated weights for policy 1, policy_version 1050702 (0.0005) [2023-12-26 08:02:23,945][123090] Updated weights for policy 1, policy_version 1050712 (0.0005) [2023-12-26 08:02:23,995][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001050720_268984320.pth... [2023-12-26 08:02:23,999][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001049664_268713984.pth [2023-12-26 08:02:24,594][123090] Updated weights for policy 1, policy_version 1050722 (0.0005) [2023-12-26 08:02:24,649][123090] Updated weights for policy 1, policy_version 1050732 (0.0005) [2023-12-26 08:02:24,704][123090] Updated weights for policy 1, policy_version 1050742 (0.0006) [2023-12-26 08:02:24,757][123091] Updated weights for policy 0, policy_version 1058008 (0.0009) [2023-12-26 08:02:24,766][123090] Updated weights for policy 1, policy_version 1050752 (0.0005) [2023-12-26 08:02:24,808][123091] Updated weights for policy 0, policy_version 1058018 (0.0010) [2023-12-26 08:02:24,864][123091] Updated weights for policy 0, policy_version 1058028 (0.0009) [2023-12-26 08:02:25,428][123090] Updated weights for policy 1, policy_version 1050762 (0.0005) [2023-12-26 08:02:25,475][123090] Updated weights for policy 1, policy_version 1050772 (0.0005) [2023-12-26 08:02:25,527][123090] Updated weights for policy 1, policy_version 1050782 (0.0005) [2023-12-26 08:02:25,619][123091] Updated weights for policy 0, policy_version 1058038 (0.0007) [2023-12-26 08:02:25,677][123091] Updated weights for policy 0, policy_version 1058048 (0.0005) [2023-12-26 08:02:25,724][123091] Updated weights for policy 0, policy_version 1058058 (0.0005) [2023-12-26 08:02:26,185][123090] Updated weights for policy 1, policy_version 1050792 (0.0005) [2023-12-26 08:02:26,248][123090] Updated weights for policy 1, policy_version 1050802 (0.0005) [2023-12-26 08:02:26,309][123090] Updated weights for policy 1, policy_version 1050812 (0.0005) [2023-12-26 08:02:26,519][123091] Updated weights for policy 0, policy_version 1058068 (0.0007) [2023-12-26 08:02:26,584][123091] Updated weights for policy 0, policy_version 1058078 (0.0010) [2023-12-26 08:02:26,650][123091] Updated weights for policy 0, policy_version 1058088 (0.0009) [2023-12-26 08:02:26,995][123090] Updated weights for policy 1, policy_version 1050822 (0.0005) [2023-12-26 08:02:27,044][123090] Updated weights for policy 1, policy_version 1050832 (0.0005) [2023-12-26 08:02:27,098][123090] Updated weights for policy 1, policy_version 1050842 (0.0005) [2023-12-26 08:02:27,269][123091] Updated weights for policy 0, policy_version 1058098 (0.0009) [2023-12-26 08:02:27,330][123091] Updated weights for policy 0, policy_version 1058108 (0.0007) [2023-12-26 08:02:27,388][123091] Updated weights for policy 0, policy_version 1058118 (0.0005) [2023-12-26 08:02:27,430][123091] Updated weights for policy 0, policy_version 1058128 (0.0005) [2023-12-26 08:02:27,784][123090] Updated weights for policy 1, policy_version 1050852 (0.0005) [2023-12-26 08:02:27,838][123090] Updated weights for policy 1, policy_version 1050862 (0.0008) [2023-12-26 08:02:27,900][123090] Updated weights for policy 1, policy_version 1050872 (0.0010) [2023-12-26 08:02:28,159][123091] Updated weights for policy 0, policy_version 1058138 (0.0005) [2023-12-26 08:02:28,212][123091] Updated weights for policy 0, policy_version 1058148 (0.0005) [2023-12-26 08:02:28,257][123091] Updated weights for policy 0, policy_version 1058158 (0.0005) [2023-12-26 08:02:28,688][123090] Updated weights for policy 1, policy_version 1050882 (0.0010) [2023-12-26 08:02:28,741][123090] Updated weights for policy 1, policy_version 1050892 (0.0010) [2023-12-26 08:02:28,784][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.2, 300 sec: 17550.3). Total num frames: 539918336. Throughput: 0: 9054.6, 1: 8884.1. Samples: 539916480. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:28,785][121949] Avg episode reward: [(0, '6119.429'), (1, '5430.743')] [2023-12-26 08:02:28,792][123090] Updated weights for policy 1, policy_version 1050902 (0.0010) [2023-12-26 08:02:28,859][123090] Updated weights for policy 1, policy_version 1050912 (0.0010) [2023-12-26 08:02:29,039][123091] Updated weights for policy 0, policy_version 1058169 (0.0008) [2023-12-26 08:02:29,088][123091] Updated weights for policy 0, policy_version 1058179 (0.0009) [2023-12-26 08:02:29,137][123091] Updated weights for policy 0, policy_version 1058190 (0.0009) [2023-12-26 08:02:29,692][123090] Updated weights for policy 1, policy_version 1050922 (0.0008) [2023-12-26 08:02:29,756][123090] Updated weights for policy 1, policy_version 1050932 (0.0010) [2023-12-26 08:02:29,831][123090] Updated weights for policy 1, policy_version 1050942 (0.0011) [2023-12-26 08:02:29,963][123091] Updated weights for policy 0, policy_version 1058200 (0.0011) [2023-12-26 08:02:30,027][123091] Updated weights for policy 0, policy_version 1058210 (0.0011) [2023-12-26 08:02:30,089][123091] Updated weights for policy 0, policy_version 1058220 (0.0011) [2023-12-26 08:02:30,658][123090] Updated weights for policy 1, policy_version 1050952 (0.0010) [2023-12-26 08:02:30,723][123090] Updated weights for policy 1, policy_version 1050962 (0.0009) [2023-12-26 08:02:30,795][123090] Updated weights for policy 1, policy_version 1050972 (0.0009) [2023-12-26 08:02:30,844][123091] Updated weights for policy 0, policy_version 1058230 (0.0007) [2023-12-26 08:02:30,897][123091] Updated weights for policy 0, policy_version 1058240 (0.0005) [2023-12-26 08:02:30,944][123091] Updated weights for policy 0, policy_version 1058250 (0.0005) [2023-12-26 08:02:31,632][123090] Updated weights for policy 1, policy_version 1050982 (0.0009) [2023-12-26 08:02:31,643][123091] Updated weights for policy 0, policy_version 1058260 (0.0006) [2023-12-26 08:02:31,700][123090] Updated weights for policy 1, policy_version 1050992 (0.0008) [2023-12-26 08:02:31,705][123091] Updated weights for policy 0, policy_version 1058270 (0.0006) [2023-12-26 08:02:31,764][123090] Updated weights for policy 1, policy_version 1051002 (0.0010) [2023-12-26 08:02:31,771][123091] Updated weights for policy 0, policy_version 1058280 (0.0007) [2023-12-26 08:02:32,507][123090] Updated weights for policy 1, policy_version 1051013 (0.0009) [2023-12-26 08:02:32,564][123090] Updated weights for policy 1, policy_version 1051023 (0.0009) [2023-12-26 08:02:32,621][123090] Updated weights for policy 1, policy_version 1051033 (0.0009) [2023-12-26 08:02:32,624][123091] Updated weights for policy 0, policy_version 1058290 (0.0008) [2023-12-26 08:02:32,679][123091] Updated weights for policy 0, policy_version 1058300 (0.0008) [2023-12-26 08:02:32,750][123091] Updated weights for policy 0, policy_version 1058310 (0.0005) [2023-12-26 08:02:32,817][123091] Updated weights for policy 0, policy_version 1058320 (0.0005) [2023-12-26 08:02:33,469][123090] Updated weights for policy 1, policy_version 1051043 (0.0009) [2023-12-26 08:02:33,521][123090] Updated weights for policy 1, policy_version 1051053 (0.0009) [2023-12-26 08:02:33,545][123091] Updated weights for policy 0, policy_version 1058330 (0.0005) [2023-12-26 08:02:33,588][123090] Updated weights for policy 1, policy_version 1051063 (0.0009) [2023-12-26 08:02:33,597][123091] Updated weights for policy 0, policy_version 1058340 (0.0005) [2023-12-26 08:02:33,651][123091] Updated weights for policy 0, policy_version 1058350 (0.0005) [2023-12-26 08:02:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 540016640. Throughput: 0: 8938.5, 1: 8960.3. Samples: 540024216. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:33,785][121949] Avg episode reward: [(0, '6013.873'), (1, '5471.995')] [2023-12-26 08:02:34,343][123091] Updated weights for policy 0, policy_version 1058360 (0.0005) [2023-12-26 08:02:34,404][123091] Updated weights for policy 0, policy_version 1058370 (0.0006) [2023-12-26 08:02:34,466][123091] Updated weights for policy 0, policy_version 1058380 (0.0005) [2023-12-26 08:02:34,475][123090] Updated weights for policy 1, policy_version 1051073 (0.0008) [2023-12-26 08:02:34,538][123090] Updated weights for policy 1, policy_version 1051083 (0.0005) [2023-12-26 08:02:34,604][123090] Updated weights for policy 1, policy_version 1051093 (0.0005) [2023-12-26 08:02:34,657][123090] Updated weights for policy 1, policy_version 1051103 (0.0007) [2023-12-26 08:02:35,249][123091] Updated weights for policy 0, policy_version 1058390 (0.0009) [2023-12-26 08:02:35,304][123091] Updated weights for policy 0, policy_version 1058400 (0.0011) [2023-12-26 08:02:35,364][123091] Updated weights for policy 0, policy_version 1058410 (0.0008) [2023-12-26 08:02:35,450][123090] Updated weights for policy 1, policy_version 1051113 (0.0007) [2023-12-26 08:02:35,520][123090] Updated weights for policy 1, policy_version 1051123 (0.0008) [2023-12-26 08:02:35,594][123090] Updated weights for policy 1, policy_version 1051133 (0.0006) [2023-12-26 08:02:36,137][123091] Updated weights for policy 0, policy_version 1058420 (0.0007) [2023-12-26 08:02:36,199][123091] Updated weights for policy 0, policy_version 1058430 (0.0008) [2023-12-26 08:02:36,263][123091] Updated weights for policy 0, policy_version 1058440 (0.0007) [2023-12-26 08:02:36,303][123090] Updated weights for policy 1, policy_version 1051143 (0.0007) [2023-12-26 08:02:36,371][123090] Updated weights for policy 1, policy_version 1051153 (0.0008) [2023-12-26 08:02:36,445][123090] Updated weights for policy 1, policy_version 1051163 (0.0009) [2023-12-26 08:02:37,036][123091] Updated weights for policy 0, policy_version 1058450 (0.0011) [2023-12-26 08:02:37,084][123091] Updated weights for policy 0, policy_version 1058460 (0.0010) [2023-12-26 08:02:37,136][123091] Updated weights for policy 0, policy_version 1058470 (0.0010) [2023-12-26 08:02:37,192][123091] Updated weights for policy 0, policy_version 1058480 (0.0010) [2023-12-26 08:02:37,208][123090] Updated weights for policy 1, policy_version 1051173 (0.0006) [2023-12-26 08:02:37,281][123090] Updated weights for policy 1, policy_version 1051183 (0.0006) [2023-12-26 08:02:37,345][123090] Updated weights for policy 1, policy_version 1051193 (0.0009) [2023-12-26 08:02:37,932][123091] Updated weights for policy 0, policy_version 1058490 (0.0009) [2023-12-26 08:02:37,996][123091] Updated weights for policy 0, policy_version 1058501 (0.0010) [2023-12-26 08:02:38,058][123091] Updated weights for policy 0, policy_version 1058511 (0.0009) [2023-12-26 08:02:38,158][123090] Updated weights for policy 1, policy_version 1051203 (0.0010) [2023-12-26 08:02:38,229][123090] Updated weights for policy 1, policy_version 1051213 (0.0009) [2023-12-26 08:02:38,281][123090] Updated weights for policy 1, policy_version 1051223 (0.0010) [2023-12-26 08:02:38,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17885.9, 300 sec: 17578.1). Total num frames: 540098560. Throughput: 0: 8984.7, 1: 8988.9. Samples: 540078156. Policy #0 lag: (min: 31.0, avg: 37.6, max: 63.0) [2023-12-26 08:02:38,784][121949] Avg episode reward: [(0, '6112.042'), (1, '5663.315')] [2023-12-26 08:02:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001051232_269115392.pth... [2023-12-26 08:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001058512_270983168.pth... [2023-12-26 08:02:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001050208_268853248.pth [2023-12-26 08:02:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001057456_270712832.pth [2023-12-26 08:02:38,902][123091] Updated weights for policy 0, policy_version 1058521 (0.0010) [2023-12-26 08:02:38,951][123091] Updated weights for policy 0, policy_version 1058532 (0.0009) [2023-12-26 08:02:39,007][123091] Updated weights for policy 0, policy_version 1058543 (0.0010) [2023-12-26 08:02:39,128][123090] Updated weights for policy 1, policy_version 1051233 (0.0010) [2023-12-26 08:02:39,185][123090] Updated weights for policy 1, policy_version 1051243 (0.0010) [2023-12-26 08:02:39,244][123090] Updated weights for policy 1, policy_version 1051253 (0.0008) [2023-12-26 08:02:39,318][123090] Updated weights for policy 1, policy_version 1051263 (0.0007) [2023-12-26 08:02:39,936][123091] Updated weights for policy 0, policy_version 1058553 (0.0011) [2023-12-26 08:02:39,999][123091] Updated weights for policy 0, policy_version 1058563 (0.0009) [2023-12-26 08:02:40,064][123091] Updated weights for policy 0, policy_version 1058573 (0.0008) [2023-12-26 08:02:40,158][123090] Updated weights for policy 1, policy_version 1051273 (0.0008) [2023-12-26 08:02:40,227][123090] Updated weights for policy 1, policy_version 1051283 (0.0008) [2023-12-26 08:02:40,301][123090] Updated weights for policy 1, policy_version 1051293 (0.0008) [2023-12-26 08:02:40,839][123091] Updated weights for policy 0, policy_version 1058583 (0.0011) [2023-12-26 08:02:40,887][123091] Updated weights for policy 0, policy_version 1058593 (0.0010) [2023-12-26 08:02:40,934][123091] Updated weights for policy 0, policy_version 1058603 (0.0010) [2023-12-26 08:02:41,108][123090] Updated weights for policy 1, policy_version 1051303 (0.0009) [2023-12-26 08:02:41,172][123090] Updated weights for policy 1, policy_version 1051313 (0.0009) [2023-12-26 08:02:41,229][123090] Updated weights for policy 1, policy_version 1051323 (0.0008) [2023-12-26 08:02:41,802][123091] Updated weights for policy 0, policy_version 1058613 (0.0011) [2023-12-26 08:02:41,877][123091] Updated weights for policy 0, policy_version 1058623 (0.0011) [2023-12-26 08:02:41,949][123091] Updated weights for policy 0, policy_version 1058633 (0.0011) [2023-12-26 08:02:42,105][123090] Updated weights for policy 1, policy_version 1051333 (0.0009) [2023-12-26 08:02:42,176][123090] Updated weights for policy 1, policy_version 1051343 (0.0009) [2023-12-26 08:02:42,231][123090] Updated weights for policy 1, policy_version 1051353 (0.0007) [2023-12-26 08:02:42,763][123091] Updated weights for policy 0, policy_version 1058643 (0.0011) [2023-12-26 08:02:42,814][123091] Updated weights for policy 0, policy_version 1058653 (0.0010) [2023-12-26 08:02:42,865][123091] Updated weights for policy 0, policy_version 1058663 (0.0010) [2023-12-26 08:02:43,065][123090] Updated weights for policy 1, policy_version 1051363 (0.0009) [2023-12-26 08:02:43,117][123090] Updated weights for policy 1, policy_version 1051373 (0.0008) [2023-12-26 08:02:43,176][123090] Updated weights for policy 1, policy_version 1051383 (0.0009) [2023-12-26 08:02:43,665][123091] Updated weights for policy 0, policy_version 1058673 (0.0010) [2023-12-26 08:02:43,720][123091] Updated weights for policy 0, policy_version 1058683 (0.0006) [2023-12-26 08:02:43,781][123091] Updated weights for policy 0, policy_version 1058693 (0.0005) [2023-12-26 08:02:43,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 540180480. Throughput: 0: 8965.6, 1: 8928.3. Samples: 540180100. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:02:43,785][121949] Avg episode reward: [(0, '6103.708'), (1, '5528.303')] [2023-12-26 08:02:43,856][123091] Updated weights for policy 0, policy_version 1058703 (0.0005) [2023-12-26 08:02:44,028][123090] Updated weights for policy 1, policy_version 1051393 (0.0009) [2023-12-26 08:02:44,093][123090] Updated weights for policy 1, policy_version 1051403 (0.0010) [2023-12-26 08:02:44,142][123090] Updated weights for policy 1, policy_version 1051413 (0.0009) [2023-12-26 08:02:44,191][123090] Updated weights for policy 1, policy_version 1051423 (0.0009) [2023-12-26 08:02:44,610][123091] Updated weights for policy 0, policy_version 1058713 (0.0009) [2023-12-26 08:02:44,655][123091] Updated weights for policy 0, policy_version 1058723 (0.0005) [2023-12-26 08:02:44,719][123091] Updated weights for policy 0, policy_version 1058733 (0.0007) [2023-12-26 08:02:45,041][123090] Updated weights for policy 1, policy_version 1051433 (0.0010) [2023-12-26 08:02:45,110][123090] Updated weights for policy 1, policy_version 1051443 (0.0010) [2023-12-26 08:02:45,182][123090] Updated weights for policy 1, policy_version 1051453 (0.0011) [2023-12-26 08:02:45,555][123091] Updated weights for policy 0, policy_version 1058743 (0.0010) [2023-12-26 08:02:45,619][123091] Updated weights for policy 0, policy_version 1058753 (0.0010) [2023-12-26 08:02:45,687][123091] Updated weights for policy 0, policy_version 1058763 (0.0010) [2023-12-26 08:02:45,966][123090] Updated weights for policy 1, policy_version 1051463 (0.0007) [2023-12-26 08:02:46,028][123090] Updated weights for policy 1, policy_version 1051473 (0.0005) [2023-12-26 08:02:46,101][123090] Updated weights for policy 1, policy_version 1051483 (0.0005) [2023-12-26 08:02:46,470][123091] Updated weights for policy 0, policy_version 1058773 (0.0008) [2023-12-26 08:02:46,516][123091] Updated weights for policy 0, policy_version 1058783 (0.0005) [2023-12-26 08:02:46,571][123091] Updated weights for policy 0, policy_version 1058793 (0.0005) [2023-12-26 08:02:46,687][123090] Updated weights for policy 1, policy_version 1051493 (0.0005) [2023-12-26 08:02:46,734][123090] Updated weights for policy 1, policy_version 1051503 (0.0005) [2023-12-26 08:02:46,778][123090] Updated weights for policy 1, policy_version 1051513 (0.0005) [2023-12-26 08:02:47,264][123091] Updated weights for policy 0, policy_version 1058803 (0.0007) [2023-12-26 08:02:47,319][123091] Updated weights for policy 0, policy_version 1058813 (0.0006) [2023-12-26 08:02:47,387][123091] Updated weights for policy 0, policy_version 1058823 (0.0005) [2023-12-26 08:02:47,499][123090] Updated weights for policy 1, policy_version 1051523 (0.0007) [2023-12-26 08:02:47,554][123090] Updated weights for policy 1, policy_version 1051533 (0.0010) [2023-12-26 08:02:47,611][123090] Updated weights for policy 1, policy_version 1051543 (0.0010) [2023-12-26 08:02:48,011][123091] Updated weights for policy 0, policy_version 1058833 (0.0005) [2023-12-26 08:02:48,067][123091] Updated weights for policy 0, policy_version 1058843 (0.0005) [2023-12-26 08:02:48,117][123091] Updated weights for policy 0, policy_version 1058854 (0.0007) [2023-12-26 08:02:48,164][123091] Updated weights for policy 0, policy_version 1058864 (0.0005) [2023-12-26 08:02:48,396][123090] Updated weights for policy 1, policy_version 1051553 (0.0010) [2023-12-26 08:02:48,448][123090] Updated weights for policy 1, policy_version 1051563 (0.0008) [2023-12-26 08:02:48,496][123090] Updated weights for policy 1, policy_version 1051573 (0.0008) [2023-12-26 08:02:48,548][123090] Updated weights for policy 1, policy_version 1051583 (0.0008) [2023-12-26 08:02:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 540278784. Throughput: 0: 9043.6, 1: 8969.7. Samples: 540290968. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:02:48,784][121949] Avg episode reward: [(0, '6221.606'), (1, '5626.393')] [2023-12-26 08:02:48,966][123091] Updated weights for policy 0, policy_version 1058874 (0.0007) [2023-12-26 08:02:49,042][123091] Updated weights for policy 0, policy_version 1058884 (0.0005) [2023-12-26 08:02:49,099][123091] Updated weights for policy 0, policy_version 1058894 (0.0005) [2023-12-26 08:02:49,304][123090] Updated weights for policy 1, policy_version 1051593 (0.0010) [2023-12-26 08:02:49,379][123090] Updated weights for policy 1, policy_version 1051603 (0.0008) [2023-12-26 08:02:49,439][123090] Updated weights for policy 1, policy_version 1051613 (0.0009) [2023-12-26 08:02:49,842][123091] Updated weights for policy 0, policy_version 1058904 (0.0010) [2023-12-26 08:02:49,898][123091] Updated weights for policy 0, policy_version 1058914 (0.0010) [2023-12-26 08:02:49,962][123091] Updated weights for policy 0, policy_version 1058924 (0.0010) [2023-12-26 08:02:50,258][123090] Updated weights for policy 1, policy_version 1051623 (0.0008) [2023-12-26 08:02:50,318][123090] Updated weights for policy 1, policy_version 1051633 (0.0009) [2023-12-26 08:02:50,379][123090] Updated weights for policy 1, policy_version 1051643 (0.0009) [2023-12-26 08:02:50,736][123091] Updated weights for policy 0, policy_version 1058934 (0.0007) [2023-12-26 08:02:50,812][123091] Updated weights for policy 0, policy_version 1058944 (0.0007) [2023-12-26 08:02:50,874][123091] Updated weights for policy 0, policy_version 1058954 (0.0007) [2023-12-26 08:02:51,242][123090] Updated weights for policy 1, policy_version 1051653 (0.0010) [2023-12-26 08:02:51,308][123090] Updated weights for policy 1, policy_version 1051663 (0.0009) [2023-12-26 08:02:51,376][123090] Updated weights for policy 1, policy_version 1051673 (0.0010) [2023-12-26 08:02:51,550][123091] Updated weights for policy 0, policy_version 1058964 (0.0007) [2023-12-26 08:02:51,620][123091] Updated weights for policy 0, policy_version 1058974 (0.0009) [2023-12-26 08:02:51,682][123091] Updated weights for policy 0, policy_version 1058984 (0.0009) [2023-12-26 08:02:52,207][123090] Updated weights for policy 1, policy_version 1051683 (0.0010) [2023-12-26 08:02:52,287][123090] Updated weights for policy 1, policy_version 1051693 (0.0007) [2023-12-26 08:02:52,365][123090] Updated weights for policy 1, policy_version 1051703 (0.0008) [2023-12-26 08:02:52,517][123091] Updated weights for policy 0, policy_version 1058994 (0.0009) [2023-12-26 08:02:52,566][123091] Updated weights for policy 0, policy_version 1059004 (0.0005) [2023-12-26 08:02:52,614][123091] Updated weights for policy 0, policy_version 1059014 (0.0005) [2023-12-26 08:02:52,668][123091] Updated weights for policy 0, policy_version 1059024 (0.0005) [2023-12-26 08:02:53,087][123090] Updated weights for policy 1, policy_version 1051713 (0.0008) [2023-12-26 08:02:53,138][123090] Updated weights for policy 1, policy_version 1051723 (0.0010) [2023-12-26 08:02:53,185][123090] Updated weights for policy 1, policy_version 1051733 (0.0010) [2023-12-26 08:02:53,232][123090] Updated weights for policy 1, policy_version 1051743 (0.0010) [2023-12-26 08:02:53,436][123091] Updated weights for policy 0, policy_version 1059034 (0.0010) [2023-12-26 08:02:53,480][123091] Updated weights for policy 0, policy_version 1059044 (0.0010) [2023-12-26 08:02:53,523][123091] Updated weights for policy 0, policy_version 1059054 (0.0010) [2023-12-26 08:02:53,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 540368896. Throughput: 0: 9024.8, 1: 8922.5. Samples: 540344436. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:02:53,784][121949] Avg episode reward: [(0, '6240.119'), (1, '5614.274')] [2023-12-26 08:02:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001059056_271122432.pth... [2023-12-26 08:02:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001051744_269246464.pth... [2023-12-26 08:02:53,791][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001058000_270852096.pth [2023-12-26 08:02:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001050720_268984320.pth [2023-12-26 08:02:54,138][123090] Updated weights for policy 1, policy_version 1051753 (0.0009) [2023-12-26 08:02:54,200][123090] Updated weights for policy 1, policy_version 1051763 (0.0010) [2023-12-26 08:02:54,264][123090] Updated weights for policy 1, policy_version 1051773 (0.0009) [2023-12-26 08:02:54,302][123091] Updated weights for policy 0, policy_version 1059064 (0.0008) [2023-12-26 08:02:54,370][123091] Updated weights for policy 0, policy_version 1059074 (0.0011) [2023-12-26 08:02:54,425][123091] Updated weights for policy 0, policy_version 1059084 (0.0011) [2023-12-26 08:02:55,075][123090] Updated weights for policy 1, policy_version 1051783 (0.0009) [2023-12-26 08:02:55,125][123090] Updated weights for policy 1, policy_version 1051793 (0.0009) [2023-12-26 08:02:55,185][123090] Updated weights for policy 1, policy_version 1051803 (0.0008) [2023-12-26 08:02:55,247][123091] Updated weights for policy 0, policy_version 1059094 (0.0011) [2023-12-26 08:02:55,298][123091] Updated weights for policy 0, policy_version 1059104 (0.0010) [2023-12-26 08:02:55,350][123091] Updated weights for policy 0, policy_version 1059114 (0.0006) [2023-12-26 08:02:55,924][123090] Updated weights for policy 1, policy_version 1051813 (0.0007) [2023-12-26 08:02:55,975][123090] Updated weights for policy 1, policy_version 1051823 (0.0005) [2023-12-26 08:02:56,022][123090] Updated weights for policy 1, policy_version 1051833 (0.0005) [2023-12-26 08:02:56,061][123091] Updated weights for policy 0, policy_version 1059124 (0.0010) [2023-12-26 08:02:56,122][123091] Updated weights for policy 0, policy_version 1059134 (0.0009) [2023-12-26 08:02:56,173][123091] Updated weights for policy 0, policy_version 1059144 (0.0005) [2023-12-26 08:02:56,672][123090] Updated weights for policy 1, policy_version 1051843 (0.0007) [2023-12-26 08:02:56,726][123091] Updated weights for policy 0, policy_version 1059154 (0.0005) [2023-12-26 08:02:56,731][123090] Updated weights for policy 1, policy_version 1051853 (0.0007) [2023-12-26 08:02:56,779][123091] Updated weights for policy 0, policy_version 1059164 (0.0005) [2023-12-26 08:02:56,782][123090] Updated weights for policy 1, policy_version 1051863 (0.0006) [2023-12-26 08:02:56,833][123091] Updated weights for policy 0, policy_version 1059174 (0.0005) [2023-12-26 08:02:56,905][123091] Updated weights for policy 0, policy_version 1059184 (0.0005) [2023-12-26 08:02:57,508][123090] Updated weights for policy 1, policy_version 1051873 (0.0006) [2023-12-26 08:02:57,574][123090] Updated weights for policy 1, policy_version 1051883 (0.0007) [2023-12-26 08:02:57,593][123091] Updated weights for policy 0, policy_version 1059194 (0.0010) [2023-12-26 08:02:57,636][123090] Updated weights for policy 1, policy_version 1051893 (0.0005) [2023-12-26 08:02:57,644][123091] Updated weights for policy 0, policy_version 1059204 (0.0010) [2023-12-26 08:02:57,697][123090] Updated weights for policy 1, policy_version 1051903 (0.0005) [2023-12-26 08:02:57,699][123091] Updated weights for policy 0, policy_version 1059214 (0.0010) [2023-12-26 08:02:58,473][123091] Updated weights for policy 0, policy_version 1059224 (0.0008) [2023-12-26 08:02:58,479][123090] Updated weights for policy 1, policy_version 1051914 (0.0008) [2023-12-26 08:02:58,540][123091] Updated weights for policy 0, policy_version 1059234 (0.0009) [2023-12-26 08:02:58,542][123090] Updated weights for policy 1, policy_version 1051924 (0.0008) [2023-12-26 08:02:58,609][123090] Updated weights for policy 1, policy_version 1051934 (0.0008) [2023-12-26 08:02:58,609][123091] Updated weights for policy 0, policy_version 1059244 (0.0007) [2023-12-26 08:02:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18159.0, 300 sec: 17661.4). Total num frames: 540467200. Throughput: 0: 9097.2, 1: 8945.4. Samples: 540455536. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:02:58,785][121949] Avg episode reward: [(0, '6179.955'), (1, '5600.303')] [2023-12-26 08:02:59,295][123091] Updated weights for policy 0, policy_version 1059254 (0.0009) [2023-12-26 08:02:59,345][123090] Updated weights for policy 1, policy_version 1051944 (0.0007) [2023-12-26 08:02:59,358][123091] Updated weights for policy 0, policy_version 1059264 (0.0010) [2023-12-26 08:02:59,419][123090] Updated weights for policy 1, policy_version 1051954 (0.0008) [2023-12-26 08:02:59,431][123091] Updated weights for policy 0, policy_version 1059274 (0.0011) [2023-12-26 08:02:59,489][123090] Updated weights for policy 1, policy_version 1051964 (0.0005) [2023-12-26 08:03:00,216][123091] Updated weights for policy 0, policy_version 1059284 (0.0011) [2023-12-26 08:03:00,254][123090] Updated weights for policy 1, policy_version 1051974 (0.0008) [2023-12-26 08:03:00,267][123091] Updated weights for policy 0, policy_version 1059294 (0.0011) [2023-12-26 08:03:00,309][123090] Updated weights for policy 1, policy_version 1051984 (0.0006) [2023-12-26 08:03:00,319][123091] Updated weights for policy 0, policy_version 1059304 (0.0010) [2023-12-26 08:03:00,367][123090] Updated weights for policy 1, policy_version 1051994 (0.0007) [2023-12-26 08:03:01,090][123090] Updated weights for policy 1, policy_version 1052004 (0.0007) [2023-12-26 08:03:01,159][123091] Updated weights for policy 0, policy_version 1059314 (0.0011) [2023-12-26 08:03:01,162][123090] Updated weights for policy 1, policy_version 1052014 (0.0009) [2023-12-26 08:03:01,219][123091] Updated weights for policy 0, policy_version 1059324 (0.0008) [2023-12-26 08:03:01,228][123090] Updated weights for policy 1, policy_version 1052024 (0.0008) [2023-12-26 08:03:01,279][123091] Updated weights for policy 0, policy_version 1059334 (0.0006) [2023-12-26 08:03:01,332][123091] Updated weights for policy 0, policy_version 1059344 (0.0005) [2023-12-26 08:03:02,094][123090] Updated weights for policy 1, policy_version 1052034 (0.0008) [2023-12-26 08:03:02,139][123091] Updated weights for policy 0, policy_version 1059354 (0.0005) [2023-12-26 08:03:02,157][123090] Updated weights for policy 1, policy_version 1052044 (0.0007) [2023-12-26 08:03:02,211][123091] Updated weights for policy 0, policy_version 1059364 (0.0005) [2023-12-26 08:03:02,220][123090] Updated weights for policy 1, policy_version 1052054 (0.0008) [2023-12-26 08:03:02,280][123091] Updated weights for policy 0, policy_version 1059374 (0.0008) [2023-12-26 08:03:02,281][123090] Updated weights for policy 1, policy_version 1052064 (0.0008) [2023-12-26 08:03:03,019][123091] Updated weights for policy 0, policy_version 1059384 (0.0009) [2023-12-26 08:03:03,075][123091] Updated weights for policy 0, policy_version 1059394 (0.0010) [2023-12-26 08:03:03,094][123090] Updated weights for policy 1, policy_version 1052074 (0.0007) [2023-12-26 08:03:03,140][123091] Updated weights for policy 0, policy_version 1059404 (0.0010) [2023-12-26 08:03:03,151][123090] Updated weights for policy 1, policy_version 1052084 (0.0008) [2023-12-26 08:03:03,198][123090] Updated weights for policy 1, policy_version 1052094 (0.0009) [2023-12-26 08:03:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 540549120. Throughput: 0: 9063.7, 1: 8981.4. Samples: 540564032. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:03,785][121949] Avg episode reward: [(0, '6228.743'), (1, '5534.700')] [2023-12-26 08:03:03,901][123091] Updated weights for policy 0, policy_version 1059414 (0.0010) [2023-12-26 08:03:03,952][123090] Updated weights for policy 1, policy_version 1052104 (0.0009) [2023-12-26 08:03:03,970][123091] Updated weights for policy 0, policy_version 1059424 (0.0008) [2023-12-26 08:03:04,018][123090] Updated weights for policy 1, policy_version 1052114 (0.0010) [2023-12-26 08:03:04,034][123091] Updated weights for policy 0, policy_version 1059434 (0.0006) [2023-12-26 08:03:04,079][123090] Updated weights for policy 1, policy_version 1052124 (0.0011) [2023-12-26 08:03:04,875][123090] Updated weights for policy 1, policy_version 1052134 (0.0007) [2023-12-26 08:03:04,913][123091] Updated weights for policy 0, policy_version 1059444 (0.0007) [2023-12-26 08:03:04,931][123090] Updated weights for policy 1, policy_version 1052144 (0.0007) [2023-12-26 08:03:04,972][123091] Updated weights for policy 0, policy_version 1059454 (0.0007) [2023-12-26 08:03:04,979][123090] Updated weights for policy 1, policy_version 1052154 (0.0010) [2023-12-26 08:03:05,021][123091] Updated weights for policy 0, policy_version 1059464 (0.0006) [2023-12-26 08:03:05,684][123090] Updated weights for policy 1, policy_version 1052164 (0.0010) [2023-12-26 08:03:05,759][123090] Updated weights for policy 1, policy_version 1052174 (0.0010) [2023-12-26 08:03:05,759][123091] Updated weights for policy 0, policy_version 1059474 (0.0008) [2023-12-26 08:03:05,817][123090] Updated weights for policy 1, policy_version 1052184 (0.0008) [2023-12-26 08:03:05,821][123091] Updated weights for policy 0, policy_version 1059484 (0.0006) [2023-12-26 08:03:05,884][123091] Updated weights for policy 0, policy_version 1059494 (0.0008) [2023-12-26 08:03:05,944][123091] Updated weights for policy 0, policy_version 1059504 (0.0009) [2023-12-26 08:03:06,599][123090] Updated weights for policy 1, policy_version 1052194 (0.0009) [2023-12-26 08:03:06,662][123090] Updated weights for policy 1, policy_version 1052204 (0.0011) [2023-12-26 08:03:06,726][123090] Updated weights for policy 1, policy_version 1052214 (0.0011) [2023-12-26 08:03:06,755][123091] Updated weights for policy 0, policy_version 1059514 (0.0007) [2023-12-26 08:03:06,794][123090] Updated weights for policy 1, policy_version 1052224 (0.0011) [2023-12-26 08:03:06,807][123091] Updated weights for policy 0, policy_version 1059524 (0.0009) [2023-12-26 08:03:06,863][123091] Updated weights for policy 0, policy_version 1059534 (0.0007) [2023-12-26 08:03:07,551][123090] Updated weights for policy 1, policy_version 1052234 (0.0011) [2023-12-26 08:03:07,615][123090] Updated weights for policy 1, policy_version 1052244 (0.0009) [2023-12-26 08:03:07,633][123091] Updated weights for policy 0, policy_version 1059544 (0.0010) [2023-12-26 08:03:07,680][123090] Updated weights for policy 1, policy_version 1052254 (0.0005) [2023-12-26 08:03:07,685][123091] Updated weights for policy 0, policy_version 1059554 (0.0010) [2023-12-26 08:03:07,747][123091] Updated weights for policy 0, policy_version 1059564 (0.0010) [2023-12-26 08:03:08,446][123090] Updated weights for policy 1, policy_version 1052264 (0.0009) [2023-12-26 08:03:08,510][123090] Updated weights for policy 1, policy_version 1052274 (0.0011) [2023-12-26 08:03:08,566][123090] Updated weights for policy 1, policy_version 1052284 (0.0010) [2023-12-26 08:03:08,573][123091] Updated weights for policy 0, policy_version 1059574 (0.0011) [2023-12-26 08:03:08,628][123091] Updated weights for policy 0, policy_version 1059584 (0.0011) [2023-12-26 08:03:08,673][123091] Updated weights for policy 0, policy_version 1059594 (0.0010) [2023-12-26 08:03:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 540647424. Throughput: 0: 9095.5, 1: 9020.9. Samples: 540618144. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:08,785][121949] Avg episode reward: [(0, '6230.203'), (1, '5525.664')] [2023-12-26 08:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001059600_271261696.pth... [2023-12-26 08:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001052288_269385728.pth... [2023-12-26 08:03:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001051232_269115392.pth [2023-12-26 08:03:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001058512_270983168.pth [2023-12-26 08:03:09,408][123091] Updated weights for policy 0, policy_version 1059604 (0.0011) [2023-12-26 08:03:09,421][123090] Updated weights for policy 1, policy_version 1052294 (0.0009) [2023-12-26 08:03:09,472][123091] Updated weights for policy 0, policy_version 1059614 (0.0011) [2023-12-26 08:03:09,486][123090] Updated weights for policy 1, policy_version 1052304 (0.0011) [2023-12-26 08:03:09,536][123091] Updated weights for policy 0, policy_version 1059624 (0.0011) [2023-12-26 08:03:09,550][123090] Updated weights for policy 1, policy_version 1052314 (0.0011) [2023-12-26 08:03:10,309][123091] Updated weights for policy 0, policy_version 1059634 (0.0010) [2023-12-26 08:03:10,377][123091] Updated weights for policy 0, policy_version 1059644 (0.0007) [2023-12-26 08:03:10,408][123090] Updated weights for policy 1, policy_version 1052324 (0.0011) [2023-12-26 08:03:10,443][123091] Updated weights for policy 0, policy_version 1059654 (0.0007) [2023-12-26 08:03:10,481][123090] Updated weights for policy 1, policy_version 1052334 (0.0011) [2023-12-26 08:03:10,507][123091] Updated weights for policy 0, policy_version 1059664 (0.0010) [2023-12-26 08:03:10,542][123090] Updated weights for policy 1, policy_version 1052344 (0.0011) [2023-12-26 08:03:11,266][123091] Updated weights for policy 0, policy_version 1059674 (0.0008) [2023-12-26 08:03:11,328][123091] Updated weights for policy 0, policy_version 1059684 (0.0009) [2023-12-26 08:03:11,396][123091] Updated weights for policy 0, policy_version 1059694 (0.0012) [2023-12-26 08:03:11,410][123090] Updated weights for policy 1, policy_version 1052354 (0.0011) [2023-12-26 08:03:11,466][123090] Updated weights for policy 1, policy_version 1052364 (0.0009) [2023-12-26 08:03:11,531][123090] Updated weights for policy 1, policy_version 1052374 (0.0009) [2023-12-26 08:03:11,592][123090] Updated weights for policy 1, policy_version 1052384 (0.0005) [2023-12-26 08:03:12,248][123091] Updated weights for policy 0, policy_version 1059704 (0.0010) [2023-12-26 08:03:12,315][123091] Updated weights for policy 0, policy_version 1059714 (0.0010) [2023-12-26 08:03:12,383][123091] Updated weights for policy 0, policy_version 1059724 (0.0009) [2023-12-26 08:03:12,428][123090] Updated weights for policy 1, policy_version 1052394 (0.0008) [2023-12-26 08:03:12,488][123090] Updated weights for policy 1, policy_version 1052404 (0.0007) [2023-12-26 08:03:12,549][123090] Updated weights for policy 1, policy_version 1052414 (0.0008) [2023-12-26 08:03:13,250][123091] Updated weights for policy 0, policy_version 1059734 (0.0010) [2023-12-26 08:03:13,252][123090] Updated weights for policy 1, policy_version 1052424 (0.0008) [2023-12-26 08:03:13,306][123091] Updated weights for policy 0, policy_version 1059744 (0.0008) [2023-12-26 08:03:13,312][123090] Updated weights for policy 1, policy_version 1052434 (0.0008) [2023-12-26 08:03:13,365][123091] Updated weights for policy 0, policy_version 1059754 (0.0006) [2023-12-26 08:03:13,374][123090] Updated weights for policy 1, policy_version 1052444 (0.0010) [2023-12-26 08:03:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 540729344. Throughput: 0: 9084.9, 1: 8814.0. Samples: 540721920. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:13,784][121949] Avg episode reward: [(0, '6125.250'), (1, '5481.310')] [2023-12-26 08:03:14,188][123091] Updated weights for policy 0, policy_version 1059764 (0.0007) [2023-12-26 08:03:14,190][123090] Updated weights for policy 1, policy_version 1052454 (0.0010) [2023-12-26 08:03:14,252][123091] Updated weights for policy 0, policy_version 1059774 (0.0007) [2023-12-26 08:03:14,254][123090] Updated weights for policy 1, policy_version 1052464 (0.0008) [2023-12-26 08:03:14,310][123091] Updated weights for policy 0, policy_version 1059784 (0.0008) [2023-12-26 08:03:14,310][123090] Updated weights for policy 1, policy_version 1052474 (0.0008) [2023-12-26 08:03:15,107][123090] Updated weights for policy 1, policy_version 1052484 (0.0008) [2023-12-26 08:03:15,169][123090] Updated weights for policy 1, policy_version 1052494 (0.0009) [2023-12-26 08:03:15,186][123091] Updated weights for policy 0, policy_version 1059794 (0.0008) [2023-12-26 08:03:15,237][123090] Updated weights for policy 1, policy_version 1052504 (0.0007) [2023-12-26 08:03:15,251][123091] Updated weights for policy 0, policy_version 1059804 (0.0010) [2023-12-26 08:03:15,318][123091] Updated weights for policy 0, policy_version 1059814 (0.0010) [2023-12-26 08:03:15,390][123091] Updated weights for policy 0, policy_version 1059824 (0.0010) [2023-12-26 08:03:16,038][123090] Updated weights for policy 1, policy_version 1052514 (0.0007) [2023-12-26 08:03:16,099][123090] Updated weights for policy 1, policy_version 1052524 (0.0009) [2023-12-26 08:03:16,152][123090] Updated weights for policy 1, policy_version 1052534 (0.0009) [2023-12-26 08:03:16,200][123091] Updated weights for policy 0, policy_version 1059834 (0.0008) [2023-12-26 08:03:16,206][123090] Updated weights for policy 1, policy_version 1052544 (0.0008) [2023-12-26 08:03:16,258][123091] Updated weights for policy 0, policy_version 1059844 (0.0009) [2023-12-26 08:03:16,314][123091] Updated weights for policy 0, policy_version 1059854 (0.0009) [2023-12-26 08:03:17,026][123090] Updated weights for policy 1, policy_version 1052554 (0.0009) [2023-12-26 08:03:17,091][123090] Updated weights for policy 1, policy_version 1052564 (0.0008) [2023-12-26 08:03:17,152][123091] Updated weights for policy 0, policy_version 1059864 (0.0009) [2023-12-26 08:03:17,159][123090] Updated weights for policy 1, policy_version 1052574 (0.0007) [2023-12-26 08:03:17,217][123091] Updated weights for policy 0, policy_version 1059874 (0.0009) [2023-12-26 08:03:17,265][123091] Updated weights for policy 0, policy_version 1059884 (0.0009) [2023-12-26 08:03:17,972][123090] Updated weights for policy 1, policy_version 1052584 (0.0009) [2023-12-26 08:03:18,031][123090] Updated weights for policy 1, policy_version 1052594 (0.0009) [2023-12-26 08:03:18,089][123090] Updated weights for policy 1, policy_version 1052604 (0.0009) [2023-12-26 08:03:18,090][123091] Updated weights for policy 0, policy_version 1059894 (0.0007) [2023-12-26 08:03:18,145][123091] Updated weights for policy 0, policy_version 1059904 (0.0009) [2023-12-26 08:03:18,200][123091] Updated weights for policy 0, policy_version 1059914 (0.0008) [2023-12-26 08:03:18,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 540811264. Throughput: 0: 8970.0, 1: 8835.6. Samples: 540825464. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:18,784][121949] Avg episode reward: [(0, '6105.175'), (1, '5322.770')] [2023-12-26 08:03:18,912][123090] Updated weights for policy 1, policy_version 1052614 (0.0006) [2023-12-26 08:03:18,990][123090] Updated weights for policy 1, policy_version 1052624 (0.0006) [2023-12-26 08:03:19,010][123091] Updated weights for policy 0, policy_version 1059924 (0.0009) [2023-12-26 08:03:19,055][123090] Updated weights for policy 1, policy_version 1052634 (0.0008) [2023-12-26 08:03:19,066][123091] Updated weights for policy 0, policy_version 1059934 (0.0009) [2023-12-26 08:03:19,141][123091] Updated weights for policy 0, policy_version 1059944 (0.0006) [2023-12-26 08:03:19,860][123090] Updated weights for policy 1, policy_version 1052644 (0.0010) [2023-12-26 08:03:19,916][123090] Updated weights for policy 1, policy_version 1052654 (0.0010) [2023-12-26 08:03:19,951][123091] Updated weights for policy 0, policy_version 1059954 (0.0009) [2023-12-26 08:03:19,985][123090] Updated weights for policy 1, policy_version 1052664 (0.0009) [2023-12-26 08:03:20,016][123091] Updated weights for policy 0, policy_version 1059964 (0.0007) [2023-12-26 08:03:20,081][123091] Updated weights for policy 0, policy_version 1059974 (0.0009) [2023-12-26 08:03:20,142][123091] Updated weights for policy 0, policy_version 1059984 (0.0010) [2023-12-26 08:03:20,656][123090] Updated weights for policy 1, policy_version 1052674 (0.0007) [2023-12-26 08:03:20,722][123090] Updated weights for policy 1, policy_version 1052684 (0.0011) [2023-12-26 08:03:20,790][123090] Updated weights for policy 1, policy_version 1052694 (0.0010) [2023-12-26 08:03:20,850][123090] Updated weights for policy 1, policy_version 1052704 (0.0010) [2023-12-26 08:03:20,941][123091] Updated weights for policy 0, policy_version 1059994 (0.0009) [2023-12-26 08:03:21,006][123091] Updated weights for policy 0, policy_version 1060004 (0.0009) [2023-12-26 08:03:21,066][123091] Updated weights for policy 0, policy_version 1060014 (0.0009) [2023-12-26 08:03:21,708][123090] Updated weights for policy 1, policy_version 1052714 (0.0009) [2023-12-26 08:03:21,780][123090] Updated weights for policy 1, policy_version 1052724 (0.0007) [2023-12-26 08:03:21,846][123090] Updated weights for policy 1, policy_version 1052734 (0.0006) [2023-12-26 08:03:21,874][123091] Updated weights for policy 0, policy_version 1060024 (0.0008) [2023-12-26 08:03:21,926][123091] Updated weights for policy 0, policy_version 1060034 (0.0009) [2023-12-26 08:03:21,988][123091] Updated weights for policy 0, policy_version 1060044 (0.0010) [2023-12-26 08:03:22,608][123090] Updated weights for policy 1, policy_version 1052744 (0.0006) [2023-12-26 08:03:22,669][123090] Updated weights for policy 1, policy_version 1052754 (0.0006) [2023-12-26 08:03:22,736][123090] Updated weights for policy 1, policy_version 1052764 (0.0010) [2023-12-26 08:03:22,839][123091] Updated weights for policy 0, policy_version 1060054 (0.0009) [2023-12-26 08:03:22,887][123091] Updated weights for policy 0, policy_version 1060064 (0.0009) [2023-12-26 08:03:22,937][123091] Updated weights for policy 0, policy_version 1060074 (0.0009) [2023-12-26 08:03:23,543][123090] Updated weights for policy 1, policy_version 1052774 (0.0009) [2023-12-26 08:03:23,610][123090] Updated weights for policy 1, policy_version 1052784 (0.0010) [2023-12-26 08:03:23,675][123090] Updated weights for policy 1, policy_version 1052794 (0.0009) [2023-12-26 08:03:23,784][123091] Updated weights for policy 0, policy_version 1060084 (0.0009) [2023-12-26 08:03:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 540901376. Throughput: 0: 8930.4, 1: 8840.6. Samples: 540877852. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:23,785][121949] Avg episode reward: [(0, '6063.878'), (1, '5357.125')] [2023-12-26 08:03:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001052800_269516800.pth... [2023-12-26 08:03:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001051744_269246464.pth [2023-12-26 08:03:23,843][123091] Updated weights for policy 0, policy_version 1060094 (0.0009) [2023-12-26 08:03:23,896][123091] Updated weights for policy 0, policy_version 1060104 (0.0009) [2023-12-26 08:03:23,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001060112_271392768.pth... [2023-12-26 08:03:23,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001059056_271122432.pth [2023-12-26 08:03:24,496][123090] Updated weights for policy 1, policy_version 1052804 (0.0009) [2023-12-26 08:03:24,561][123090] Updated weights for policy 1, policy_version 1052814 (0.0009) [2023-12-26 08:03:24,614][123090] Updated weights for policy 1, policy_version 1052824 (0.0009) [2023-12-26 08:03:24,707][123091] Updated weights for policy 0, policy_version 1060114 (0.0009) [2023-12-26 08:03:24,768][123091] Updated weights for policy 0, policy_version 1060124 (0.0009) [2023-12-26 08:03:24,817][123091] Updated weights for policy 0, policy_version 1060135 (0.0009) [2023-12-26 08:03:25,460][123090] Updated weights for policy 1, policy_version 1052834 (0.0009) [2023-12-26 08:03:25,522][123090] Updated weights for policy 1, policy_version 1052844 (0.0009) [2023-12-26 08:03:25,597][123090] Updated weights for policy 1, policy_version 1052854 (0.0009) [2023-12-26 08:03:25,647][123091] Updated weights for policy 0, policy_version 1060145 (0.0009) [2023-12-26 08:03:25,661][123090] Updated weights for policy 1, policy_version 1052864 (0.0009) [2023-12-26 08:03:25,697][123091] Updated weights for policy 0, policy_version 1060155 (0.0009) [2023-12-26 08:03:25,750][123091] Updated weights for policy 0, policy_version 1060165 (0.0009) [2023-12-26 08:03:25,818][123091] Updated weights for policy 0, policy_version 1060175 (0.0007) [2023-12-26 08:03:26,498][123090] Updated weights for policy 1, policy_version 1052874 (0.0009) [2023-12-26 08:03:26,562][123090] Updated weights for policy 1, policy_version 1052884 (0.0009) [2023-12-26 08:03:26,625][123090] Updated weights for policy 1, policy_version 1052894 (0.0008) [2023-12-26 08:03:26,644][123091] Updated weights for policy 0, policy_version 1060185 (0.0007) [2023-12-26 08:03:26,694][123091] Updated weights for policy 0, policy_version 1060195 (0.0005) [2023-12-26 08:03:26,745][123091] Updated weights for policy 0, policy_version 1060205 (0.0005) [2023-12-26 08:03:27,439][123090] Updated weights for policy 1, policy_version 1052904 (0.0006) [2023-12-26 08:03:27,488][123090] Updated weights for policy 1, policy_version 1052914 (0.0005) [2023-12-26 08:03:27,516][123091] Updated weights for policy 0, policy_version 1060215 (0.0008) [2023-12-26 08:03:27,541][123090] Updated weights for policy 1, policy_version 1052924 (0.0005) [2023-12-26 08:03:27,569][123091] Updated weights for policy 0, policy_version 1060225 (0.0009) [2023-12-26 08:03:27,626][123091] Updated weights for policy 0, policy_version 1060235 (0.0009) [2023-12-26 08:03:28,129][123090] Updated weights for policy 1, policy_version 1052934 (0.0005) [2023-12-26 08:03:28,197][123090] Updated weights for policy 1, policy_version 1052944 (0.0005) [2023-12-26 08:03:28,271][123090] Updated weights for policy 1, policy_version 1052954 (0.0005) [2023-12-26 08:03:28,451][123091] Updated weights for policy 0, policy_version 1060245 (0.0008) [2023-12-26 08:03:28,522][123091] Updated weights for policy 0, policy_version 1060255 (0.0008) [2023-12-26 08:03:28,575][123091] Updated weights for policy 0, policy_version 1060265 (0.0009) [2023-12-26 08:03:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.0, 300 sec: 17633.6). Total num frames: 540991488. Throughput: 0: 8941.3, 1: 8870.9. Samples: 540981644. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:28,785][121949] Avg episode reward: [(0, '6061.121'), (1, '5399.679')] [2023-12-26 08:03:28,960][123090] Updated weights for policy 1, policy_version 1052964 (0.0005) [2023-12-26 08:03:29,015][123090] Updated weights for policy 1, policy_version 1052974 (0.0005) [2023-12-26 08:03:29,062][123090] Updated weights for policy 1, policy_version 1052984 (0.0005) [2023-12-26 08:03:29,422][123091] Updated weights for policy 0, policy_version 1060275 (0.0010) [2023-12-26 08:03:29,472][123091] Updated weights for policy 0, policy_version 1060285 (0.0009) [2023-12-26 08:03:29,523][123091] Updated weights for policy 0, policy_version 1060295 (0.0009) [2023-12-26 08:03:29,848][123090] Updated weights for policy 1, policy_version 1052994 (0.0009) [2023-12-26 08:03:29,917][123090] Updated weights for policy 1, policy_version 1053004 (0.0009) [2023-12-26 08:03:29,985][123090] Updated weights for policy 1, policy_version 1053014 (0.0009) [2023-12-26 08:03:30,044][123090] Updated weights for policy 1, policy_version 1053024 (0.0009) [2023-12-26 08:03:30,375][123091] Updated weights for policy 0, policy_version 1060306 (0.0010) [2023-12-26 08:03:30,432][123091] Updated weights for policy 0, policy_version 1060316 (0.0009) [2023-12-26 08:03:30,480][123091] Updated weights for policy 0, policy_version 1060326 (0.0009) [2023-12-26 08:03:30,531][123091] Updated weights for policy 0, policy_version 1060336 (0.0009) [2023-12-26 08:03:30,843][123090] Updated weights for policy 1, policy_version 1053034 (0.0009) [2023-12-26 08:03:30,896][123090] Updated weights for policy 1, policy_version 1053044 (0.0010) [2023-12-26 08:03:30,949][123090] Updated weights for policy 1, policy_version 1053055 (0.0010) [2023-12-26 08:03:31,305][123091] Updated weights for policy 0, policy_version 1060346 (0.0010) [2023-12-26 08:03:31,369][123091] Updated weights for policy 0, policy_version 1060356 (0.0009) [2023-12-26 08:03:31,442][123091] Updated weights for policy 0, policy_version 1060366 (0.0010) [2023-12-26 08:03:31,868][123090] Updated weights for policy 1, policy_version 1053065 (0.0009) [2023-12-26 08:03:31,926][123090] Updated weights for policy 1, policy_version 1053075 (0.0010) [2023-12-26 08:03:31,976][123090] Updated weights for policy 1, policy_version 1053085 (0.0009) [2023-12-26 08:03:32,285][123091] Updated weights for policy 0, policy_version 1060376 (0.0010) [2023-12-26 08:03:32,340][123091] Updated weights for policy 0, policy_version 1060386 (0.0007) [2023-12-26 08:03:32,400][123091] Updated weights for policy 0, policy_version 1060396 (0.0009) [2023-12-26 08:03:32,863][123090] Updated weights for policy 1, policy_version 1053095 (0.0010) [2023-12-26 08:03:32,918][123090] Updated weights for policy 1, policy_version 1053105 (0.0010) [2023-12-26 08:03:32,973][123090] Updated weights for policy 1, policy_version 1053117 (0.0011) [2023-12-26 08:03:33,141][123091] Updated weights for policy 0, policy_version 1060406 (0.0007) [2023-12-26 08:03:33,195][123091] Updated weights for policy 0, policy_version 1060416 (0.0005) [2023-12-26 08:03:33,260][123091] Updated weights for policy 0, policy_version 1060426 (0.0005) [2023-12-26 08:03:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 541073408. Throughput: 0: 8902.4, 1: 8824.3. Samples: 541088676. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:33,785][121949] Avg episode reward: [(0, '6116.592'), (1, '5231.056')] [2023-12-26 08:03:33,866][123091] Updated weights for policy 0, policy_version 1060436 (0.0007) [2023-12-26 08:03:33,902][123090] Updated weights for policy 1, policy_version 1053127 (0.0009) [2023-12-26 08:03:33,916][123091] Updated weights for policy 0, policy_version 1060446 (0.0009) [2023-12-26 08:03:33,951][123090] Updated weights for policy 1, policy_version 1053137 (0.0006) [2023-12-26 08:03:33,962][123091] Updated weights for policy 0, policy_version 1060456 (0.0010) [2023-12-26 08:03:34,003][123090] Updated weights for policy 1, policy_version 1053147 (0.0009) [2023-12-26 08:03:34,703][123091] Updated weights for policy 0, policy_version 1060466 (0.0007) [2023-12-26 08:03:34,756][123091] Updated weights for policy 0, policy_version 1060476 (0.0007) [2023-12-26 08:03:34,812][123091] Updated weights for policy 0, policy_version 1060486 (0.0006) [2023-12-26 08:03:34,862][123091] Updated weights for policy 0, policy_version 1060496 (0.0009) [2023-12-26 08:03:34,903][123090] Updated weights for policy 1, policy_version 1053157 (0.0009) [2023-12-26 08:03:34,957][123090] Updated weights for policy 1, policy_version 1053167 (0.0010) [2023-12-26 08:03:35,010][123090] Updated weights for policy 1, policy_version 1053177 (0.0010) [2023-12-26 08:03:35,570][123091] Updated weights for policy 0, policy_version 1060506 (0.0007) [2023-12-26 08:03:35,634][123091] Updated weights for policy 0, policy_version 1060516 (0.0005) [2023-12-26 08:03:35,709][123091] Updated weights for policy 0, policy_version 1060526 (0.0005) [2023-12-26 08:03:35,891][123090] Updated weights for policy 1, policy_version 1053187 (0.0008) [2023-12-26 08:03:35,947][123090] Updated weights for policy 1, policy_version 1053197 (0.0008) [2023-12-26 08:03:36,004][123090] Updated weights for policy 1, policy_version 1053207 (0.0009) [2023-12-26 08:03:36,466][123091] Updated weights for policy 0, policy_version 1060536 (0.0009) [2023-12-26 08:03:36,537][123091] Updated weights for policy 0, policy_version 1060546 (0.0011) [2023-12-26 08:03:36,602][123091] Updated weights for policy 0, policy_version 1060556 (0.0011) [2023-12-26 08:03:36,780][123090] Updated weights for policy 1, policy_version 1053217 (0.0010) [2023-12-26 08:03:36,828][123090] Updated weights for policy 1, policy_version 1053227 (0.0008) [2023-12-26 08:03:36,880][123090] Updated weights for policy 1, policy_version 1053237 (0.0009) [2023-12-26 08:03:36,934][123090] Updated weights for policy 1, policy_version 1053247 (0.0009) [2023-12-26 08:03:37,419][123091] Updated weights for policy 0, policy_version 1060566 (0.0010) [2023-12-26 08:03:37,478][123091] Updated weights for policy 0, policy_version 1060576 (0.0010) [2023-12-26 08:03:37,539][123091] Updated weights for policy 0, policy_version 1060586 (0.0010) [2023-12-26 08:03:37,732][123090] Updated weights for policy 1, policy_version 1053257 (0.0006) [2023-12-26 08:03:37,786][123090] Updated weights for policy 1, policy_version 1053267 (0.0005) [2023-12-26 08:03:37,843][123090] Updated weights for policy 1, policy_version 1053277 (0.0005) [2023-12-26 08:03:38,283][123091] Updated weights for policy 0, policy_version 1060596 (0.0008) [2023-12-26 08:03:38,344][123091] Updated weights for policy 0, policy_version 1060606 (0.0007) [2023-12-26 08:03:38,410][123091] Updated weights for policy 0, policy_version 1060616 (0.0009) [2023-12-26 08:03:38,673][123090] Updated weights for policy 1, policy_version 1053287 (0.0009) [2023-12-26 08:03:38,741][123090] Updated weights for policy 1, policy_version 1053297 (0.0009) [2023-12-26 08:03:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 541163520. Throughput: 0: 8914.5, 1: 8810.8. Samples: 541142076. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:38,785][121949] Avg episode reward: [(0, '6201.812'), (1, '5249.388')] [2023-12-26 08:03:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001060624_271523840.pth... [2023-12-26 08:03:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001059600_271261696.pth [2023-12-26 08:03:38,812][123090] Updated weights for policy 1, policy_version 1053307 (0.0008) [2023-12-26 08:03:38,849][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001053312_269647872.pth... [2023-12-26 08:03:38,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001052288_269385728.pth [2023-12-26 08:03:39,105][123091] Updated weights for policy 0, policy_version 1060626 (0.0008) [2023-12-26 08:03:39,158][123091] Updated weights for policy 0, policy_version 1060636 (0.0005) [2023-12-26 08:03:39,223][123091] Updated weights for policy 0, policy_version 1060646 (0.0006) [2023-12-26 08:03:39,293][123091] Updated weights for policy 0, policy_version 1060656 (0.0006) [2023-12-26 08:03:39,753][123090] Updated weights for policy 1, policy_version 1053317 (0.0008) [2023-12-26 08:03:39,819][123090] Updated weights for policy 1, policy_version 1053327 (0.0010) [2023-12-26 08:03:39,900][123090] Updated weights for policy 1, policy_version 1053337 (0.0008) [2023-12-26 08:03:40,102][123091] Updated weights for policy 0, policy_version 1060666 (0.0011) [2023-12-26 08:03:40,158][123091] Updated weights for policy 0, policy_version 1060676 (0.0011) [2023-12-26 08:03:40,210][123091] Updated weights for policy 0, policy_version 1060686 (0.0010) [2023-12-26 08:03:40,644][123090] Updated weights for policy 1, policy_version 1053347 (0.0008) [2023-12-26 08:03:40,709][123090] Updated weights for policy 1, policy_version 1053357 (0.0005) [2023-12-26 08:03:40,764][123090] Updated weights for policy 1, policy_version 1053367 (0.0005) [2023-12-26 08:03:41,005][123091] Updated weights for policy 0, policy_version 1060696 (0.0009) [2023-12-26 08:03:41,074][123091] Updated weights for policy 0, policy_version 1060706 (0.0011) [2023-12-26 08:03:41,132][123091] Updated weights for policy 0, policy_version 1060716 (0.0011) [2023-12-26 08:03:41,521][123090] Updated weights for policy 1, policy_version 1053377 (0.0006) [2023-12-26 08:03:41,580][123090] Updated weights for policy 1, policy_version 1053387 (0.0010) [2023-12-26 08:03:41,655][123090] Updated weights for policy 1, policy_version 1053397 (0.0010) [2023-12-26 08:03:41,723][123090] Updated weights for policy 1, policy_version 1053407 (0.0010) [2023-12-26 08:03:42,015][123091] Updated weights for policy 0, policy_version 1060726 (0.0010) [2023-12-26 08:03:42,085][123091] Updated weights for policy 0, policy_version 1060736 (0.0010) [2023-12-26 08:03:42,156][123091] Updated weights for policy 0, policy_version 1060746 (0.0010) [2023-12-26 08:03:42,582][123090] Updated weights for policy 1, policy_version 1053417 (0.0007) [2023-12-26 08:03:42,645][123090] Updated weights for policy 1, policy_version 1053427 (0.0008) [2023-12-26 08:03:42,718][123090] Updated weights for policy 1, policy_version 1053437 (0.0008) [2023-12-26 08:03:42,992][123091] Updated weights for policy 0, policy_version 1060756 (0.0008) [2023-12-26 08:03:43,047][123091] Updated weights for policy 0, policy_version 1060766 (0.0006) [2023-12-26 08:03:43,101][123091] Updated weights for policy 0, policy_version 1060776 (0.0005) [2023-12-26 08:03:43,522][123090] Updated weights for policy 1, policy_version 1053447 (0.0008) [2023-12-26 08:03:43,574][123090] Updated weights for policy 1, policy_version 1053457 (0.0005) [2023-12-26 08:03:43,618][123090] Updated weights for policy 1, policy_version 1053467 (0.0005) [2023-12-26 08:03:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 541253632. Throughput: 0: 8837.2, 1: 8743.9. Samples: 541246684. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:43,785][121949] Avg episode reward: [(0, '6118.591'), (1, '5112.923')] [2023-12-26 08:03:43,791][123091] Updated weights for policy 0, policy_version 1060786 (0.0006) [2023-12-26 08:03:43,847][123091] Updated weights for policy 0, policy_version 1060796 (0.0010) [2023-12-26 08:03:43,902][123091] Updated weights for policy 0, policy_version 1060808 (0.0010) [2023-12-26 08:03:44,279][123090] Updated weights for policy 1, policy_version 1053477 (0.0005) [2023-12-26 08:03:44,326][123090] Updated weights for policy 1, policy_version 1053487 (0.0008) [2023-12-26 08:03:44,378][123090] Updated weights for policy 1, policy_version 1053497 (0.0009) [2023-12-26 08:03:44,761][123091] Updated weights for policy 0, policy_version 1060818 (0.0010) [2023-12-26 08:03:44,824][123091] Updated weights for policy 0, policy_version 1060828 (0.0010) [2023-12-26 08:03:44,879][123091] Updated weights for policy 0, policy_version 1060838 (0.0010) [2023-12-26 08:03:44,935][123091] Updated weights for policy 0, policy_version 1060848 (0.0009) [2023-12-26 08:03:45,257][123090] Updated weights for policy 1, policy_version 1053507 (0.0009) [2023-12-26 08:03:45,318][123090] Updated weights for policy 1, policy_version 1053517 (0.0006) [2023-12-26 08:03:45,371][123090] Updated weights for policy 1, policy_version 1053527 (0.0009) [2023-12-26 08:03:45,709][123091] Updated weights for policy 0, policy_version 1060858 (0.0006) [2023-12-26 08:03:45,764][123091] Updated weights for policy 0, policy_version 1060868 (0.0009) [2023-12-26 08:03:45,815][123091] Updated weights for policy 0, policy_version 1060878 (0.0009) [2023-12-26 08:03:46,286][123090] Updated weights for policy 1, policy_version 1053537 (0.0010) [2023-12-26 08:03:46,343][123090] Updated weights for policy 1, policy_version 1053547 (0.0010) [2023-12-26 08:03:46,398][123090] Updated weights for policy 1, policy_version 1053557 (0.0009) [2023-12-26 08:03:46,416][123091] Updated weights for policy 0, policy_version 1060888 (0.0006) [2023-12-26 08:03:46,453][123090] Updated weights for policy 1, policy_version 1053567 (0.0006) [2023-12-26 08:03:46,467][123091] Updated weights for policy 0, policy_version 1060898 (0.0010) [2023-12-26 08:03:46,532][123091] Updated weights for policy 0, policy_version 1060908 (0.0010) [2023-12-26 08:03:47,258][123091] Updated weights for policy 0, policy_version 1060918 (0.0009) [2023-12-26 08:03:47,296][123090] Updated weights for policy 1, policy_version 1053577 (0.0007) [2023-12-26 08:03:47,318][123091] Updated weights for policy 0, policy_version 1060928 (0.0010) [2023-12-26 08:03:47,362][123090] Updated weights for policy 1, policy_version 1053587 (0.0009) [2023-12-26 08:03:47,383][123091] Updated weights for policy 0, policy_version 1060938 (0.0008) [2023-12-26 08:03:47,422][123090] Updated weights for policy 1, policy_version 1053597 (0.0008) [2023-12-26 08:03:48,052][123090] Updated weights for policy 1, policy_version 1053607 (0.0006) [2023-12-26 08:03:48,106][123090] Updated weights for policy 1, policy_version 1053617 (0.0006) [2023-12-26 08:03:48,112][123091] Updated weights for policy 0, policy_version 1060948 (0.0006) [2023-12-26 08:03:48,161][123090] Updated weights for policy 1, policy_version 1053627 (0.0006) [2023-12-26 08:03:48,170][123091] Updated weights for policy 0, policy_version 1060958 (0.0006) [2023-12-26 08:03:48,228][123091] Updated weights for policy 0, policy_version 1060968 (0.0006) [2023-12-26 08:03:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 541343744. Throughput: 0: 8893.3, 1: 8737.4. Samples: 541357416. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:48,785][121949] Avg episode reward: [(0, '6094.509'), (1, '4819.500')] [2023-12-26 08:03:48,958][123090] Updated weights for policy 1, policy_version 1053637 (0.0006) [2023-12-26 08:03:49,003][123091] Updated weights for policy 0, policy_version 1060978 (0.0005) [2023-12-26 08:03:49,023][123090] Updated weights for policy 1, policy_version 1053647 (0.0008) [2023-12-26 08:03:49,054][123091] Updated weights for policy 0, policy_version 1060988 (0.0005) [2023-12-26 08:03:49,091][123090] Updated weights for policy 1, policy_version 1053657 (0.0007) [2023-12-26 08:03:49,114][123091] Updated weights for policy 0, policy_version 1060998 (0.0006) [2023-12-26 08:03:49,178][123091] Updated weights for policy 0, policy_version 1061008 (0.0005) [2023-12-26 08:03:49,884][123091] Updated weights for policy 0, policy_version 1061018 (0.0008) [2023-12-26 08:03:49,950][123091] Updated weights for policy 0, policy_version 1061028 (0.0010) [2023-12-26 08:03:49,959][123090] Updated weights for policy 1, policy_version 1053669 (0.0007) [2023-12-26 08:03:50,014][123091] Updated weights for policy 0, policy_version 1061038 (0.0009) [2023-12-26 08:03:50,025][123090] Updated weights for policy 1, policy_version 1053679 (0.0007) [2023-12-26 08:03:50,080][123090] Updated weights for policy 1, policy_version 1053689 (0.0009) [2023-12-26 08:03:50,835][123091] Updated weights for policy 0, policy_version 1061048 (0.0010) [2023-12-26 08:03:50,898][123091] Updated weights for policy 0, policy_version 1061058 (0.0011) [2023-12-26 08:03:50,947][123090] Updated weights for policy 1, policy_version 1053699 (0.0009) [2023-12-26 08:03:50,965][123091] Updated weights for policy 0, policy_version 1061068 (0.0011) [2023-12-26 08:03:51,020][123090] Updated weights for policy 1, policy_version 1053709 (0.0006) [2023-12-26 08:03:51,084][123090] Updated weights for policy 1, policy_version 1053719 (0.0008) [2023-12-26 08:03:51,807][123091] Updated weights for policy 0, policy_version 1061078 (0.0007) [2023-12-26 08:03:51,859][123090] Updated weights for policy 1, policy_version 1053729 (0.0009) [2023-12-26 08:03:51,882][123091] Updated weights for policy 0, policy_version 1061088 (0.0005) [2023-12-26 08:03:51,922][123090] Updated weights for policy 1, policy_version 1053739 (0.0009) [2023-12-26 08:03:51,953][123091] Updated weights for policy 0, policy_version 1061098 (0.0006) [2023-12-26 08:03:51,982][123090] Updated weights for policy 1, policy_version 1053749 (0.0008) [2023-12-26 08:03:52,038][123090] Updated weights for policy 1, policy_version 1053759 (0.0009) [2023-12-26 08:03:52,732][123091] Updated weights for policy 0, policy_version 1061108 (0.0008) [2023-12-26 08:03:52,781][123091] Updated weights for policy 0, policy_version 1061118 (0.0009) [2023-12-26 08:03:52,833][123091] Updated weights for policy 0, policy_version 1061128 (0.0008) [2023-12-26 08:03:52,907][123090] Updated weights for policy 1, policy_version 1053769 (0.0010) [2023-12-26 08:03:52,977][123090] Updated weights for policy 1, policy_version 1053779 (0.0010) [2023-12-26 08:03:53,040][123090] Updated weights for policy 1, policy_version 1053789 (0.0010) [2023-12-26 08:03:53,664][123091] Updated weights for policy 0, policy_version 1061138 (0.0008) [2023-12-26 08:03:53,731][123091] Updated weights for policy 0, policy_version 1061148 (0.0005) [2023-12-26 08:03:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 541425664. Throughput: 0: 8904.1, 1: 8681.1. Samples: 541409476. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:53,784][121949] Avg episode reward: [(0, '6147.580'), (1, '4930.497')] [2023-12-26 08:03:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001053792_269770752.pth... [2023-12-26 08:03:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001052800_269516800.pth [2023-12-26 08:03:53,801][123091] Updated weights for policy 0, policy_version 1061158 (0.0005) [2023-12-26 08:03:53,863][123090] Updated weights for policy 1, policy_version 1053799 (0.0010) [2023-12-26 08:03:53,875][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001061168_271663104.pth... [2023-12-26 08:03:53,876][123091] Updated weights for policy 0, policy_version 1061168 (0.0005) [2023-12-26 08:03:53,879][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001060112_271392768.pth [2023-12-26 08:03:53,926][123090] Updated weights for policy 1, policy_version 1053809 (0.0010) [2023-12-26 08:03:53,984][123090] Updated weights for policy 1, policy_version 1053819 (0.0010) [2023-12-26 08:03:54,522][123091] Updated weights for policy 0, policy_version 1061178 (0.0010) [2023-12-26 08:03:54,587][123091] Updated weights for policy 0, policy_version 1061188 (0.0010) [2023-12-26 08:03:54,649][123091] Updated weights for policy 0, policy_version 1061198 (0.0010) [2023-12-26 08:03:54,797][123090] Updated weights for policy 1, policy_version 1053829 (0.0010) [2023-12-26 08:03:54,851][123090] Updated weights for policy 1, policy_version 1053839 (0.0010) [2023-12-26 08:03:54,910][123090] Updated weights for policy 1, policy_version 1053849 (0.0010) [2023-12-26 08:03:55,474][123091] Updated weights for policy 0, policy_version 1061208 (0.0010) [2023-12-26 08:03:55,528][123091] Updated weights for policy 0, policy_version 1061218 (0.0009) [2023-12-26 08:03:55,586][123091] Updated weights for policy 0, policy_version 1061228 (0.0005) [2023-12-26 08:03:55,672][123090] Updated weights for policy 1, policy_version 1053859 (0.0008) [2023-12-26 08:03:55,730][123090] Updated weights for policy 1, policy_version 1053869 (0.0010) [2023-12-26 08:03:55,779][123090] Updated weights for policy 1, policy_version 1053879 (0.0005) [2023-12-26 08:03:56,240][123091] Updated weights for policy 0, policy_version 1061238 (0.0006) [2023-12-26 08:03:56,288][123091] Updated weights for policy 0, policy_version 1061248 (0.0005) [2023-12-26 08:03:56,336][123091] Updated weights for policy 0, policy_version 1061258 (0.0005) [2023-12-26 08:03:56,460][123090] Updated weights for policy 1, policy_version 1053889 (0.0005) [2023-12-26 08:03:56,517][123090] Updated weights for policy 1, policy_version 1053899 (0.0005) [2023-12-26 08:03:56,575][123090] Updated weights for policy 1, policy_version 1053909 (0.0005) [2023-12-26 08:03:56,621][123090] Updated weights for policy 1, policy_version 1053919 (0.0005) [2023-12-26 08:03:56,992][123091] Updated weights for policy 0, policy_version 1061268 (0.0006) [2023-12-26 08:03:57,043][123091] Updated weights for policy 0, policy_version 1061278 (0.0005) [2023-12-26 08:03:57,110][123091] Updated weights for policy 0, policy_version 1061288 (0.0005) [2023-12-26 08:03:57,297][123090] Updated weights for policy 1, policy_version 1053929 (0.0005) [2023-12-26 08:03:57,364][123090] Updated weights for policy 1, policy_version 1053939 (0.0005) [2023-12-26 08:03:57,426][123090] Updated weights for policy 1, policy_version 1053949 (0.0005) [2023-12-26 08:03:57,749][123091] Updated weights for policy 0, policy_version 1061298 (0.0005) [2023-12-26 08:03:57,795][123091] Updated weights for policy 0, policy_version 1061308 (0.0005) [2023-12-26 08:03:57,857][123091] Updated weights for policy 0, policy_version 1061318 (0.0005) [2023-12-26 08:03:57,935][123091] Updated weights for policy 0, policy_version 1061328 (0.0005) [2023-12-26 08:03:58,076][123090] Updated weights for policy 1, policy_version 1053959 (0.0007) [2023-12-26 08:03:58,140][123090] Updated weights for policy 1, policy_version 1053969 (0.0007) [2023-12-26 08:03:58,195][123090] Updated weights for policy 1, policy_version 1053979 (0.0010) [2023-12-26 08:03:58,680][123091] Updated weights for policy 0, policy_version 1061338 (0.0008) [2023-12-26 08:03:58,743][123091] Updated weights for policy 0, policy_version 1061348 (0.0007) [2023-12-26 08:03:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 541523968. Throughput: 0: 9005.3, 1: 8762.2. Samples: 541521460. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:03:58,784][121949] Avg episode reward: [(0, '6232.419'), (1, '5096.103')] [2023-12-26 08:03:58,802][123091] Updated weights for policy 0, policy_version 1061358 (0.0008) [2023-12-26 08:03:59,033][123090] Updated weights for policy 1, policy_version 1053989 (0.0009) [2023-12-26 08:03:59,080][123090] Updated weights for policy 1, policy_version 1053999 (0.0008) [2023-12-26 08:03:59,130][123090] Updated weights for policy 1, policy_version 1054009 (0.0009) [2023-12-26 08:03:59,445][123091] Updated weights for policy 0, policy_version 1061368 (0.0006) [2023-12-26 08:03:59,520][123091] Updated weights for policy 0, policy_version 1061378 (0.0005) [2023-12-26 08:03:59,588][123091] Updated weights for policy 0, policy_version 1061388 (0.0008) [2023-12-26 08:04:00,037][123090] Updated weights for policy 1, policy_version 1054020 (0.0010) [2023-12-26 08:04:00,100][123090] Updated weights for policy 1, policy_version 1054030 (0.0009) [2023-12-26 08:04:00,156][123090] Updated weights for policy 1, policy_version 1054040 (0.0009) [2023-12-26 08:04:00,299][123091] Updated weights for policy 0, policy_version 1061398 (0.0009) [2023-12-26 08:04:00,362][123091] Updated weights for policy 0, policy_version 1061408 (0.0009) [2023-12-26 08:04:00,427][123091] Updated weights for policy 0, policy_version 1061418 (0.0010) [2023-12-26 08:04:01,027][123090] Updated weights for policy 1, policy_version 1054050 (0.0009) [2023-12-26 08:04:01,089][123090] Updated weights for policy 1, policy_version 1054060 (0.0009) [2023-12-26 08:04:01,155][123090] Updated weights for policy 1, policy_version 1054070 (0.0009) [2023-12-26 08:04:01,157][123091] Updated weights for policy 0, policy_version 1061428 (0.0009) [2023-12-26 08:04:01,207][123091] Updated weights for policy 0, policy_version 1061438 (0.0007) [2023-12-26 08:04:01,224][123090] Updated weights for policy 1, policy_version 1054080 (0.0008) [2023-12-26 08:04:01,266][123091] Updated weights for policy 0, policy_version 1061448 (0.0009) [2023-12-26 08:04:02,072][123090] Updated weights for policy 1, policy_version 1054090 (0.0006) [2023-12-26 08:04:02,131][123091] Updated weights for policy 0, policy_version 1061458 (0.0009) [2023-12-26 08:04:02,136][123090] Updated weights for policy 1, policy_version 1054100 (0.0005) [2023-12-26 08:04:02,190][123090] Updated weights for policy 1, policy_version 1054110 (0.0005) [2023-12-26 08:04:02,194][123091] Updated weights for policy 0, policy_version 1061468 (0.0009) [2023-12-26 08:04:02,254][123091] Updated weights for policy 0, policy_version 1061478 (0.0009) [2023-12-26 08:04:02,315][123091] Updated weights for policy 0, policy_version 1061488 (0.0011) [2023-12-26 08:04:02,902][123090] Updated weights for policy 1, policy_version 1054120 (0.0009) [2023-12-26 08:04:02,965][123090] Updated weights for policy 1, policy_version 1054130 (0.0009) [2023-12-26 08:04:03,015][123090] Updated weights for policy 1, policy_version 1054140 (0.0006) [2023-12-26 08:04:03,175][123091] Updated weights for policy 0, policy_version 1061498 (0.0009) [2023-12-26 08:04:03,220][123091] Updated weights for policy 0, policy_version 1061508 (0.0007) [2023-12-26 08:04:03,267][123091] Updated weights for policy 0, policy_version 1061518 (0.0005) [2023-12-26 08:04:03,759][123090] Updated weights for policy 1, policy_version 1054150 (0.0008) [2023-12-26 08:04:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 541614080. Throughput: 0: 9087.2, 1: 8772.1. Samples: 541629132. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:03,785][121949] Avg episode reward: [(0, '6155.238'), (1, '4876.687')] [2023-12-26 08:04:03,833][123090] Updated weights for policy 1, policy_version 1054160 (0.0007) [2023-12-26 08:04:03,901][123090] Updated weights for policy 1, policy_version 1054170 (0.0009) [2023-12-26 08:04:04,109][123091] Updated weights for policy 0, policy_version 1061528 (0.0008) [2023-12-26 08:04:04,187][123091] Updated weights for policy 0, policy_version 1061538 (0.0009) [2023-12-26 08:04:04,256][123091] Updated weights for policy 0, policy_version 1061548 (0.0009) [2023-12-26 08:04:04,697][123090] Updated weights for policy 1, policy_version 1054180 (0.0010) [2023-12-26 08:04:04,753][123090] Updated weights for policy 1, policy_version 1054190 (0.0009) [2023-12-26 08:04:04,805][123090] Updated weights for policy 1, policy_version 1054200 (0.0009) [2023-12-26 08:04:04,977][123091] Updated weights for policy 0, policy_version 1061558 (0.0006) [2023-12-26 08:04:05,035][123091] Updated weights for policy 0, policy_version 1061568 (0.0006) [2023-12-26 08:04:05,093][123091] Updated weights for policy 0, policy_version 1061578 (0.0005) [2023-12-26 08:04:05,702][123090] Updated weights for policy 1, policy_version 1054210 (0.0009) [2023-12-26 08:04:05,765][123090] Updated weights for policy 1, policy_version 1054220 (0.0007) [2023-12-26 08:04:05,768][123091] Updated weights for policy 0, policy_version 1061588 (0.0006) [2023-12-26 08:04:05,822][123091] Updated weights for policy 0, policy_version 1061598 (0.0009) [2023-12-26 08:04:05,832][123090] Updated weights for policy 1, policy_version 1054230 (0.0006) [2023-12-26 08:04:05,892][123091] Updated weights for policy 0, policy_version 1061608 (0.0008) [2023-12-26 08:04:05,912][123090] Updated weights for policy 1, policy_version 1054240 (0.0005) [2023-12-26 08:04:06,615][123091] Updated weights for policy 0, policy_version 1061618 (0.0008) [2023-12-26 08:04:06,682][123091] Updated weights for policy 0, policy_version 1061628 (0.0005) [2023-12-26 08:04:06,747][123091] Updated weights for policy 0, policy_version 1061638 (0.0006) [2023-12-26 08:04:06,768][123090] Updated weights for policy 1, policy_version 1054250 (0.0009) [2023-12-26 08:04:06,806][123091] Updated weights for policy 0, policy_version 1061648 (0.0006) [2023-12-26 08:04:06,830][123090] Updated weights for policy 1, policy_version 1054260 (0.0009) [2023-12-26 08:04:06,895][123090] Updated weights for policy 1, policy_version 1054270 (0.0009) [2023-12-26 08:04:07,483][123091] Updated weights for policy 0, policy_version 1061658 (0.0005) [2023-12-26 08:04:07,534][123091] Updated weights for policy 0, policy_version 1061668 (0.0010) [2023-12-26 08:04:07,605][123091] Updated weights for policy 0, policy_version 1061678 (0.0011) [2023-12-26 08:04:07,776][123090] Updated weights for policy 1, policy_version 1054280 (0.0008) [2023-12-26 08:04:07,836][123090] Updated weights for policy 1, policy_version 1054290 (0.0009) [2023-12-26 08:04:07,902][123090] Updated weights for policy 1, policy_version 1054300 (0.0008) [2023-12-26 08:04:08,356][123091] Updated weights for policy 0, policy_version 1061691 (0.0007) [2023-12-26 08:04:08,421][123091] Updated weights for policy 0, policy_version 1061701 (0.0011) [2023-12-26 08:04:08,481][123091] Updated weights for policy 0, policy_version 1061711 (0.0011) [2023-12-26 08:04:08,765][123090] Updated weights for policy 1, policy_version 1054310 (0.0010) [2023-12-26 08:04:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 541704192. Throughput: 0: 9170.3, 1: 8725.5. Samples: 541683160. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:08,784][121949] Avg episode reward: [(0, '6002.061'), (1, '4961.647')] [2023-12-26 08:04:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001061712_271802368.pth... [2023-12-26 08:04:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001060624_271523840.pth [2023-12-26 08:04:08,820][123090] Updated weights for policy 1, policy_version 1054320 (0.0010) [2023-12-26 08:04:08,872][123090] Updated weights for policy 1, policy_version 1054330 (0.0010) [2023-12-26 08:04:08,902][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001054336_269910016.pth... [2023-12-26 08:04:08,906][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001053312_269647872.pth [2023-12-26 08:04:09,286][123091] Updated weights for policy 0, policy_version 1061721 (0.0009) [2023-12-26 08:04:09,362][123091] Updated weights for policy 0, policy_version 1061731 (0.0008) [2023-12-26 08:04:09,433][123091] Updated weights for policy 0, policy_version 1061741 (0.0008) [2023-12-26 08:04:09,787][123090] Updated weights for policy 1, policy_version 1054340 (0.0011) [2023-12-26 08:04:09,849][123090] Updated weights for policy 1, policy_version 1054350 (0.0009) [2023-12-26 08:04:09,922][123090] Updated weights for policy 1, policy_version 1054360 (0.0009) [2023-12-26 08:04:10,141][123091] Updated weights for policy 0, policy_version 1061751 (0.0009) [2023-12-26 08:04:10,208][123091] Updated weights for policy 0, policy_version 1061761 (0.0011) [2023-12-26 08:04:10,276][123091] Updated weights for policy 0, policy_version 1061771 (0.0011) [2023-12-26 08:04:10,725][123090] Updated weights for policy 1, policy_version 1054370 (0.0008) [2023-12-26 08:04:10,778][123090] Updated weights for policy 1, policy_version 1054380 (0.0009) [2023-12-26 08:04:10,831][123090] Updated weights for policy 1, policy_version 1054390 (0.0008) [2023-12-26 08:04:10,885][123090] Updated weights for policy 1, policy_version 1054400 (0.0005) [2023-12-26 08:04:11,106][123091] Updated weights for policy 0, policy_version 1061781 (0.0011) [2023-12-26 08:04:11,175][123091] Updated weights for policy 0, policy_version 1061791 (0.0011) [2023-12-26 08:04:11,231][123091] Updated weights for policy 0, policy_version 1061801 (0.0011) [2023-12-26 08:04:11,779][123090] Updated weights for policy 1, policy_version 1054410 (0.0008) [2023-12-26 08:04:11,847][123090] Updated weights for policy 1, policy_version 1054420 (0.0008) [2023-12-26 08:04:11,914][123090] Updated weights for policy 1, policy_version 1054430 (0.0008) [2023-12-26 08:04:12,085][123091] Updated weights for policy 0, policy_version 1061811 (0.0011) [2023-12-26 08:04:12,155][123091] Updated weights for policy 0, policy_version 1061821 (0.0011) [2023-12-26 08:04:12,223][123091] Updated weights for policy 0, policy_version 1061831 (0.0011) [2023-12-26 08:04:12,672][123090] Updated weights for policy 1, policy_version 1054440 (0.0008) [2023-12-26 08:04:12,729][123090] Updated weights for policy 1, policy_version 1054450 (0.0009) [2023-12-26 08:04:12,802][123090] Updated weights for policy 1, policy_version 1054460 (0.0009) [2023-12-26 08:04:13,055][123091] Updated weights for policy 0, policy_version 1061841 (0.0011) [2023-12-26 08:04:13,114][123091] Updated weights for policy 0, policy_version 1061851 (0.0009) [2023-12-26 08:04:13,170][123091] Updated weights for policy 0, policy_version 1061861 (0.0009) [2023-12-26 08:04:13,227][123091] Updated weights for policy 0, policy_version 1061871 (0.0009) [2023-12-26 08:04:13,544][123090] Updated weights for policy 1, policy_version 1054470 (0.0009) [2023-12-26 08:04:13,601][123090] Updated weights for policy 1, policy_version 1054480 (0.0010) [2023-12-26 08:04:13,655][123090] Updated weights for policy 1, policy_version 1054490 (0.0010) [2023-12-26 08:04:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 541794304. Throughput: 0: 9199.5, 1: 8684.3. Samples: 541786420. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:13,785][121949] Avg episode reward: [(0, '6133.451'), (1, '5295.321')] [2023-12-26 08:04:13,919][123091] Updated weights for policy 0, policy_version 1061881 (0.0005) [2023-12-26 08:04:13,975][123091] Updated weights for policy 0, policy_version 1061891 (0.0010) [2023-12-26 08:04:14,028][123091] Updated weights for policy 0, policy_version 1061901 (0.0010) [2023-12-26 08:04:14,343][123090] Updated weights for policy 1, policy_version 1054500 (0.0009) [2023-12-26 08:04:14,411][123090] Updated weights for policy 1, policy_version 1054510 (0.0009) [2023-12-26 08:04:14,475][123090] Updated weights for policy 1, policy_version 1054520 (0.0010) [2023-12-26 08:04:14,835][123091] Updated weights for policy 0, policy_version 1061912 (0.0010) [2023-12-26 08:04:14,906][123091] Updated weights for policy 0, policy_version 1061922 (0.0010) [2023-12-26 08:04:14,968][123091] Updated weights for policy 0, policy_version 1061932 (0.0008) [2023-12-26 08:04:15,271][123090] Updated weights for policy 1, policy_version 1054530 (0.0009) [2023-12-26 08:04:15,340][123090] Updated weights for policy 1, policy_version 1054540 (0.0006) [2023-12-26 08:04:15,413][123090] Updated weights for policy 1, policy_version 1054550 (0.0008) [2023-12-26 08:04:15,487][123090] Updated weights for policy 1, policy_version 1054560 (0.0006) [2023-12-26 08:04:15,727][123091] Updated weights for policy 0, policy_version 1061942 (0.0009) [2023-12-26 08:04:15,794][123091] Updated weights for policy 0, policy_version 1061952 (0.0011) [2023-12-26 08:04:15,849][123091] Updated weights for policy 0, policy_version 1061962 (0.0010) [2023-12-26 08:04:16,160][123090] Updated weights for policy 1, policy_version 1054570 (0.0005) [2023-12-26 08:04:16,207][123090] Updated weights for policy 1, policy_version 1054580 (0.0005) [2023-12-26 08:04:16,254][123090] Updated weights for policy 1, policy_version 1054590 (0.0005) [2023-12-26 08:04:16,576][123091] Updated weights for policy 0, policy_version 1061972 (0.0008) [2023-12-26 08:04:16,632][123091] Updated weights for policy 0, policy_version 1061982 (0.0005) [2023-12-26 08:04:16,684][123091] Updated weights for policy 0, policy_version 1061992 (0.0005) [2023-12-26 08:04:17,046][123090] Updated weights for policy 1, policy_version 1054600 (0.0009) [2023-12-26 08:04:17,094][123090] Updated weights for policy 1, policy_version 1054610 (0.0010) [2023-12-26 08:04:17,164][123090] Updated weights for policy 1, policy_version 1054620 (0.0010) [2023-12-26 08:04:17,310][123091] Updated weights for policy 0, policy_version 1062002 (0.0006) [2023-12-26 08:04:17,371][123091] Updated weights for policy 0, policy_version 1062012 (0.0009) [2023-12-26 08:04:17,434][123091] Updated weights for policy 0, policy_version 1062022 (0.0009) [2023-12-26 08:04:17,494][123091] Updated weights for policy 0, policy_version 1062032 (0.0008) [2023-12-26 08:04:17,986][123090] Updated weights for policy 1, policy_version 1054630 (0.0010) [2023-12-26 08:04:18,040][123090] Updated weights for policy 1, policy_version 1054640 (0.0008) [2023-12-26 08:04:18,090][123090] Updated weights for policy 1, policy_version 1054650 (0.0005) [2023-12-26 08:04:18,370][123091] Updated weights for policy 0, policy_version 1062042 (0.0009) [2023-12-26 08:04:18,446][123091] Updated weights for policy 0, policy_version 1062052 (0.0010) [2023-12-26 08:04:18,517][123091] Updated weights for policy 0, policy_version 1062062 (0.0009) [2023-12-26 08:04:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 541884416. Throughput: 0: 9186.3, 1: 8746.2. Samples: 541895636. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:18,785][121949] Avg episode reward: [(0, '6299.440'), (1, '5607.040')] [2023-12-26 08:04:18,820][123090] Updated weights for policy 1, policy_version 1054660 (0.0007) [2023-12-26 08:04:18,869][123090] Updated weights for policy 1, policy_version 1054670 (0.0010) [2023-12-26 08:04:18,926][123090] Updated weights for policy 1, policy_version 1054680 (0.0011) [2023-12-26 08:04:19,353][123091] Updated weights for policy 0, policy_version 1062072 (0.0009) [2023-12-26 08:04:19,421][123091] Updated weights for policy 0, policy_version 1062082 (0.0008) [2023-12-26 08:04:19,490][123091] Updated weights for policy 0, policy_version 1062092 (0.0008) [2023-12-26 08:04:19,783][123090] Updated weights for policy 1, policy_version 1054690 (0.0011) [2023-12-26 08:04:19,846][123090] Updated weights for policy 1, policy_version 1054700 (0.0009) [2023-12-26 08:04:19,911][123090] Updated weights for policy 1, policy_version 1054710 (0.0009) [2023-12-26 08:04:19,977][123090] Updated weights for policy 1, policy_version 1054720 (0.0007) [2023-12-26 08:04:20,355][123091] Updated weights for policy 0, policy_version 1062102 (0.0009) [2023-12-26 08:04:20,417][123091] Updated weights for policy 0, policy_version 1062112 (0.0009) [2023-12-26 08:04:20,485][123091] Updated weights for policy 0, policy_version 1062122 (0.0009) [2023-12-26 08:04:20,816][123090] Updated weights for policy 1, policy_version 1054730 (0.0010) [2023-12-26 08:04:20,888][123090] Updated weights for policy 1, policy_version 1054740 (0.0008) [2023-12-26 08:04:20,949][123090] Updated weights for policy 1, policy_version 1054750 (0.0007) [2023-12-26 08:04:21,324][123091] Updated weights for policy 0, policy_version 1062132 (0.0010) [2023-12-26 08:04:21,393][123091] Updated weights for policy 0, policy_version 1062142 (0.0010) [2023-12-26 08:04:21,453][123091] Updated weights for policy 0, policy_version 1062152 (0.0010) [2023-12-26 08:04:21,763][123090] Updated weights for policy 1, policy_version 1054760 (0.0009) [2023-12-26 08:04:21,837][123090] Updated weights for policy 1, policy_version 1054770 (0.0006) [2023-12-26 08:04:21,909][123090] Updated weights for policy 1, policy_version 1054780 (0.0007) [2023-12-26 08:04:22,366][123091] Updated weights for policy 0, policy_version 1062162 (0.0010) [2023-12-26 08:04:22,420][123091] Updated weights for policy 0, policy_version 1062172 (0.0009) [2023-12-26 08:04:22,486][123091] Updated weights for policy 0, policy_version 1062182 (0.0009) [2023-12-26 08:04:22,553][123091] Updated weights for policy 0, policy_version 1062192 (0.0009) [2023-12-26 08:04:22,669][123090] Updated weights for policy 1, policy_version 1054790 (0.0008) [2023-12-26 08:04:22,727][123090] Updated weights for policy 1, policy_version 1054800 (0.0009) [2023-12-26 08:04:22,783][123090] Updated weights for policy 1, policy_version 1054810 (0.0009) [2023-12-26 08:04:23,377][123091] Updated weights for policy 0, policy_version 1062202 (0.0005) [2023-12-26 08:04:23,424][123091] Updated weights for policy 0, policy_version 1062212 (0.0005) [2023-12-26 08:04:23,480][123091] Updated weights for policy 0, policy_version 1062222 (0.0005) [2023-12-26 08:04:23,680][123090] Updated weights for policy 1, policy_version 1054820 (0.0010) [2023-12-26 08:04:23,733][123090] Updated weights for policy 1, policy_version 1054830 (0.0009) [2023-12-26 08:04:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 541966336. Throughput: 0: 9105.9, 1: 8752.5. Samples: 541945700. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:23,785][121949] Avg episode reward: [(0, '6291.464'), (1, '5539.380')] [2023-12-26 08:04:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001062224_271933440.pth... [2023-12-26 08:04:23,794][123090] Updated weights for policy 1, policy_version 1054840 (0.0009) [2023-12-26 08:04:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001061168_271663104.pth [2023-12-26 08:04:23,832][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001054848_270041088.pth... [2023-12-26 08:04:23,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001053792_269770752.pth [2023-12-26 08:04:24,244][123091] Updated weights for policy 0, policy_version 1062232 (0.0008) [2023-12-26 08:04:24,312][123091] Updated weights for policy 0, policy_version 1062242 (0.0010) [2023-12-26 08:04:24,369][123091] Updated weights for policy 0, policy_version 1062252 (0.0010) [2023-12-26 08:04:24,576][123090] Updated weights for policy 1, policy_version 1054850 (0.0009) [2023-12-26 08:04:24,644][123090] Updated weights for policy 1, policy_version 1054860 (0.0008) [2023-12-26 08:04:24,716][123090] Updated weights for policy 1, policy_version 1054870 (0.0008) [2023-12-26 08:04:24,784][123090] Updated weights for policy 1, policy_version 1054880 (0.0006) [2023-12-26 08:04:25,270][123091] Updated weights for policy 0, policy_version 1062262 (0.0010) [2023-12-26 08:04:25,327][123091] Updated weights for policy 0, policy_version 1062272 (0.0010) [2023-12-26 08:04:25,381][123091] Updated weights for policy 0, policy_version 1062282 (0.0010) [2023-12-26 08:04:25,472][123090] Updated weights for policy 1, policy_version 1054890 (0.0008) [2023-12-26 08:04:25,527][123090] Updated weights for policy 1, policy_version 1054900 (0.0008) [2023-12-26 08:04:25,583][123090] Updated weights for policy 1, policy_version 1054910 (0.0009) [2023-12-26 08:04:26,239][123091] Updated weights for policy 0, policy_version 1062292 (0.0008) [2023-12-26 08:04:26,287][123091] Updated weights for policy 0, policy_version 1062302 (0.0005) [2023-12-26 08:04:26,334][123091] Updated weights for policy 0, policy_version 1062312 (0.0006) [2023-12-26 08:04:26,372][123090] Updated weights for policy 1, policy_version 1054920 (0.0007) [2023-12-26 08:04:26,422][123090] Updated weights for policy 1, policy_version 1054930 (0.0005) [2023-12-26 08:04:26,478][123090] Updated weights for policy 1, policy_version 1054940 (0.0005) [2023-12-26 08:04:26,978][123091] Updated weights for policy 0, policy_version 1062322 (0.0008) [2023-12-26 08:04:27,034][123091] Updated weights for policy 0, policy_version 1062332 (0.0005) [2023-12-26 08:04:27,038][123090] Updated weights for policy 1, policy_version 1054950 (0.0005) [2023-12-26 08:04:27,081][123091] Updated weights for policy 0, policy_version 1062342 (0.0005) [2023-12-26 08:04:27,087][123090] Updated weights for policy 1, policy_version 1054960 (0.0005) [2023-12-26 08:04:27,131][123091] Updated weights for policy 0, policy_version 1062352 (0.0006) [2023-12-26 08:04:27,142][123090] Updated weights for policy 1, policy_version 1054970 (0.0005) [2023-12-26 08:04:27,838][123090] Updated weights for policy 1, policy_version 1054980 (0.0007) [2023-12-26 08:04:27,898][123090] Updated weights for policy 1, policy_version 1054990 (0.0008) [2023-12-26 08:04:27,959][123090] Updated weights for policy 1, policy_version 1055000 (0.0008) [2023-12-26 08:04:27,963][123091] Updated weights for policy 0, policy_version 1062362 (0.0006) [2023-12-26 08:04:28,016][123091] Updated weights for policy 0, policy_version 1062372 (0.0005) [2023-12-26 08:04:28,085][123091] Updated weights for policy 0, policy_version 1062382 (0.0005) [2023-12-26 08:04:28,629][123090] Updated weights for policy 1, policy_version 1055010 (0.0005) [2023-12-26 08:04:28,702][123090] Updated weights for policy 1, policy_version 1055020 (0.0008) [2023-12-26 08:04:28,761][123090] Updated weights for policy 1, policy_version 1055030 (0.0010) [2023-12-26 08:04:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 542056448. Throughput: 0: 9102.0, 1: 8845.6. Samples: 542054332. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:28,786][121949] Avg episode reward: [(0, '6249.576'), (1, '5532.614')] [2023-12-26 08:04:28,825][123090] Updated weights for policy 1, policy_version 1055040 (0.0010) [2023-12-26 08:04:28,842][123091] Updated weights for policy 0, policy_version 1062392 (0.0009) [2023-12-26 08:04:28,909][123091] Updated weights for policy 0, policy_version 1062402 (0.0009) [2023-12-26 08:04:28,981][123091] Updated weights for policy 0, policy_version 1062412 (0.0009) [2023-12-26 08:04:29,627][123090] Updated weights for policy 1, policy_version 1055050 (0.0010) [2023-12-26 08:04:29,682][123090] Updated weights for policy 1, policy_version 1055060 (0.0010) [2023-12-26 08:04:29,722][123091] Updated weights for policy 0, policy_version 1062422 (0.0006) [2023-12-26 08:04:29,744][123090] Updated weights for policy 1, policy_version 1055070 (0.0010) [2023-12-26 08:04:29,791][123091] Updated weights for policy 0, policy_version 1062432 (0.0007) [2023-12-26 08:04:29,864][123091] Updated weights for policy 0, policy_version 1062442 (0.0009) [2023-12-26 08:04:30,601][123090] Updated weights for policy 1, policy_version 1055080 (0.0007) [2023-12-26 08:04:30,605][123091] Updated weights for policy 0, policy_version 1062452 (0.0009) [2023-12-26 08:04:30,660][123090] Updated weights for policy 1, policy_version 1055090 (0.0005) [2023-12-26 08:04:30,677][123091] Updated weights for policy 0, policy_version 1062462 (0.0008) [2023-12-26 08:04:30,725][123090] Updated weights for policy 1, policy_version 1055100 (0.0005) [2023-12-26 08:04:30,748][123091] Updated weights for policy 0, policy_version 1062472 (0.0008) [2023-12-26 08:04:31,387][123090] Updated weights for policy 1, policy_version 1055110 (0.0007) [2023-12-26 08:04:31,439][123091] Updated weights for policy 0, policy_version 1062482 (0.0008) [2023-12-26 08:04:31,454][123090] Updated weights for policy 1, policy_version 1055120 (0.0010) [2023-12-26 08:04:31,490][123091] Updated weights for policy 0, policy_version 1062492 (0.0008) [2023-12-26 08:04:31,517][123090] Updated weights for policy 1, policy_version 1055130 (0.0010) [2023-12-26 08:04:31,546][123091] Updated weights for policy 0, policy_version 1062502 (0.0007) [2023-12-26 08:04:31,622][123091] Updated weights for policy 0, policy_version 1062512 (0.0006) [2023-12-26 08:04:32,346][123090] Updated weights for policy 1, policy_version 1055140 (0.0011) [2023-12-26 08:04:32,410][123090] Updated weights for policy 1, policy_version 1055150 (0.0011) [2023-12-26 08:04:32,438][123091] Updated weights for policy 0, policy_version 1062522 (0.0006) [2023-12-26 08:04:32,473][123090] Updated weights for policy 1, policy_version 1055160 (0.0010) [2023-12-26 08:04:32,495][123091] Updated weights for policy 0, policy_version 1062532 (0.0008) [2023-12-26 08:04:32,555][123091] Updated weights for policy 0, policy_version 1062542 (0.0010) [2023-12-26 08:04:33,144][123090] Updated weights for policy 1, policy_version 1055170 (0.0006) [2023-12-26 08:04:33,191][123090] Updated weights for policy 1, policy_version 1055180 (0.0005) [2023-12-26 08:04:33,238][123090] Updated weights for policy 1, policy_version 1055190 (0.0005) [2023-12-26 08:04:33,295][123090] Updated weights for policy 1, policy_version 1055200 (0.0009) [2023-12-26 08:04:33,457][123091] Updated weights for policy 0, policy_version 1062552 (0.0009) [2023-12-26 08:04:33,518][123091] Updated weights for policy 0, policy_version 1062562 (0.0010) [2023-12-26 08:04:33,581][123091] Updated weights for policy 0, policy_version 1062572 (0.0009) [2023-12-26 08:04:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 542154752. Throughput: 0: 9020.4, 1: 8893.9. Samples: 542163560. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:33,785][121949] Avg episode reward: [(0, '6239.354'), (1, '5473.511')] [2023-12-26 08:04:34,060][123090] Updated weights for policy 1, policy_version 1055210 (0.0010) [2023-12-26 08:04:34,124][123090] Updated weights for policy 1, policy_version 1055220 (0.0009) [2023-12-26 08:04:34,187][123090] Updated weights for policy 1, policy_version 1055230 (0.0008) [2023-12-26 08:04:34,455][123091] Updated weights for policy 0, policy_version 1062582 (0.0010) [2023-12-26 08:04:34,516][123091] Updated weights for policy 0, policy_version 1062592 (0.0009) [2023-12-26 08:04:34,572][123091] Updated weights for policy 0, policy_version 1062602 (0.0009) [2023-12-26 08:04:34,997][123090] Updated weights for policy 1, policy_version 1055240 (0.0009) [2023-12-26 08:04:35,049][123090] Updated weights for policy 1, policy_version 1055250 (0.0010) [2023-12-26 08:04:35,097][123090] Updated weights for policy 1, policy_version 1055260 (0.0010) [2023-12-26 08:04:35,420][123091] Updated weights for policy 0, policy_version 1062612 (0.0010) [2023-12-26 08:04:35,480][123091] Updated weights for policy 0, policy_version 1062622 (0.0009) [2023-12-26 08:04:35,536][123091] Updated weights for policy 0, policy_version 1062632 (0.0009) [2023-12-26 08:04:35,946][123090] Updated weights for policy 1, policy_version 1055270 (0.0011) [2023-12-26 08:04:35,993][123090] Updated weights for policy 1, policy_version 1055280 (0.0009) [2023-12-26 08:04:36,060][123090] Updated weights for policy 1, policy_version 1055290 (0.0009) [2023-12-26 08:04:36,420][123091] Updated weights for policy 0, policy_version 1062642 (0.0009) [2023-12-26 08:04:36,469][123091] Updated weights for policy 0, policy_version 1062652 (0.0011) [2023-12-26 08:04:36,525][123091] Updated weights for policy 0, policy_version 1062662 (0.0011) [2023-12-26 08:04:36,586][123091] Updated weights for policy 0, policy_version 1062672 (0.0011) [2023-12-26 08:04:36,872][123090] Updated weights for policy 1, policy_version 1055300 (0.0008) [2023-12-26 08:04:36,926][123090] Updated weights for policy 1, policy_version 1055310 (0.0008) [2023-12-26 08:04:36,974][123090] Updated weights for policy 1, policy_version 1055320 (0.0009) [2023-12-26 08:04:37,411][123091] Updated weights for policy 0, policy_version 1062682 (0.0011) [2023-12-26 08:04:37,469][123091] Updated weights for policy 0, policy_version 1062692 (0.0010) [2023-12-26 08:04:37,529][123091] Updated weights for policy 0, policy_version 1062702 (0.0011) [2023-12-26 08:04:37,829][123090] Updated weights for policy 1, policy_version 1055330 (0.0008) [2023-12-26 08:04:37,891][123090] Updated weights for policy 1, policy_version 1055340 (0.0010) [2023-12-26 08:04:37,957][123090] Updated weights for policy 1, policy_version 1055350 (0.0010) [2023-12-26 08:04:38,023][123090] Updated weights for policy 1, policy_version 1055360 (0.0009) [2023-12-26 08:04:38,335][123091] Updated weights for policy 0, policy_version 1062712 (0.0010) [2023-12-26 08:04:38,395][123091] Updated weights for policy 0, policy_version 1062722 (0.0010) [2023-12-26 08:04:38,460][123091] Updated weights for policy 0, policy_version 1062732 (0.0010) [2023-12-26 08:04:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 542236672. Throughput: 0: 8986.6, 1: 8902.2. Samples: 542214476. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 08:04:38,785][121949] Avg episode reward: [(0, '6227.966'), (1, '5558.505')] [2023-12-26 08:04:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001062736_272064512.pth... [2023-12-26 08:04:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001061712_271802368.pth [2023-12-26 08:04:38,869][123090] Updated weights for policy 1, policy_version 1055370 (0.0010) [2023-12-26 08:04:38,935][123090] Updated weights for policy 1, policy_version 1055380 (0.0009) [2023-12-26 08:04:38,998][123090] Updated weights for policy 1, policy_version 1055390 (0.0008) [2023-12-26 08:04:39,013][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001055392_270180352.pth... [2023-12-26 08:04:39,018][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001054336_269910016.pth [2023-12-26 08:04:39,255][123091] Updated weights for policy 0, policy_version 1062743 (0.0009) [2023-12-26 08:04:39,317][123091] Updated weights for policy 0, policy_version 1062753 (0.0008) [2023-12-26 08:04:39,376][123091] Updated weights for policy 0, policy_version 1062763 (0.0008) [2023-12-26 08:04:39,817][123090] Updated weights for policy 1, policy_version 1055400 (0.0008) [2023-12-26 08:04:39,891][123090] Updated weights for policy 1, policy_version 1055410 (0.0010) [2023-12-26 08:04:39,961][123090] Updated weights for policy 1, policy_version 1055420 (0.0010) [2023-12-26 08:04:40,225][123091] Updated weights for policy 0, policy_version 1062773 (0.0010) [2023-12-26 08:04:40,274][123091] Updated weights for policy 0, policy_version 1062783 (0.0009) [2023-12-26 08:04:40,322][123091] Updated weights for policy 0, policy_version 1062793 (0.0008) [2023-12-26 08:04:40,817][123090] Updated weights for policy 1, policy_version 1055430 (0.0009) [2023-12-26 08:04:40,886][123090] Updated weights for policy 1, policy_version 1055440 (0.0009) [2023-12-26 08:04:40,935][123090] Updated weights for policy 1, policy_version 1055450 (0.0009) [2023-12-26 08:04:41,171][123091] Updated weights for policy 0, policy_version 1062804 (0.0008) [2023-12-26 08:04:41,239][123091] Updated weights for policy 0, policy_version 1062814 (0.0011) [2023-12-26 08:04:41,302][123091] Updated weights for policy 0, policy_version 1062824 (0.0011) [2023-12-26 08:04:41,834][123090] Updated weights for policy 1, policy_version 1055460 (0.0007) [2023-12-26 08:04:41,890][123090] Updated weights for policy 1, policy_version 1055470 (0.0005) [2023-12-26 08:04:41,943][123090] Updated weights for policy 1, policy_version 1055480 (0.0005) [2023-12-26 08:04:42,122][123091] Updated weights for policy 0, policy_version 1062834 (0.0010) [2023-12-26 08:04:42,175][123091] Updated weights for policy 0, policy_version 1062844 (0.0011) [2023-12-26 08:04:42,227][123091] Updated weights for policy 0, policy_version 1062854 (0.0011) [2023-12-26 08:04:42,323][123091] Updated weights for policy 0, policy_version 1062864 (0.0011) [2023-12-26 08:04:42,752][123090] Updated weights for policy 1, policy_version 1055490 (0.0006) [2023-12-26 08:04:42,807][123090] Updated weights for policy 1, policy_version 1055500 (0.0005) [2023-12-26 08:04:42,864][123090] Updated weights for policy 1, policy_version 1055510 (0.0009) [2023-12-26 08:04:42,913][123090] Updated weights for policy 1, policy_version 1055520 (0.0008) [2023-12-26 08:04:43,160][123091] Updated weights for policy 0, policy_version 1062874 (0.0011) [2023-12-26 08:04:43,226][123091] Updated weights for policy 0, policy_version 1062884 (0.0010) [2023-12-26 08:04:43,281][123091] Updated weights for policy 0, policy_version 1062894 (0.0010) [2023-12-26 08:04:43,729][123090] Updated weights for policy 1, policy_version 1055530 (0.0005) [2023-12-26 08:04:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 542318592. Throughput: 0: 8869.5, 1: 8802.2. Samples: 542316688. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:04:43,785][121949] Avg episode reward: [(0, '6182.920'), (1, '5593.156')] [2023-12-26 08:04:43,800][123090] Updated weights for policy 1, policy_version 1055540 (0.0006) [2023-12-26 08:04:43,868][123090] Updated weights for policy 1, policy_version 1055550 (0.0005) [2023-12-26 08:04:44,105][123091] Updated weights for policy 0, policy_version 1062904 (0.0011) [2023-12-26 08:04:44,171][123091] Updated weights for policy 0, policy_version 1062914 (0.0011) [2023-12-26 08:04:44,233][123091] Updated weights for policy 0, policy_version 1062924 (0.0010) [2023-12-26 08:04:44,587][123090] Updated weights for policy 1, policy_version 1055560 (0.0008) [2023-12-26 08:04:44,654][123090] Updated weights for policy 1, policy_version 1055570 (0.0008) [2023-12-26 08:04:44,717][123090] Updated weights for policy 1, policy_version 1055580 (0.0009) [2023-12-26 08:04:45,070][123091] Updated weights for policy 0, policy_version 1062934 (0.0010) [2023-12-26 08:04:45,136][123091] Updated weights for policy 0, policy_version 1062944 (0.0011) [2023-12-26 08:04:45,200][123091] Updated weights for policy 0, policy_version 1062954 (0.0011) [2023-12-26 08:04:45,540][123090] Updated weights for policy 1, policy_version 1055590 (0.0007) [2023-12-26 08:04:45,605][123090] Updated weights for policy 1, policy_version 1055601 (0.0011) [2023-12-26 08:04:45,661][123090] Updated weights for policy 1, policy_version 1055611 (0.0010) [2023-12-26 08:04:45,970][123091] Updated weights for policy 0, policy_version 1062964 (0.0011) [2023-12-26 08:04:46,023][123091] Updated weights for policy 0, policy_version 1062974 (0.0009) [2023-12-26 08:04:46,082][123091] Updated weights for policy 0, policy_version 1062984 (0.0006) [2023-12-26 08:04:46,570][123090] Updated weights for policy 1, policy_version 1055621 (0.0010) [2023-12-26 08:04:46,622][123090] Updated weights for policy 1, policy_version 1055631 (0.0009) [2023-12-26 08:04:46,677][123090] Updated weights for policy 1, policy_version 1055641 (0.0005) [2023-12-26 08:04:46,782][123091] Updated weights for policy 0, policy_version 1062994 (0.0007) [2023-12-26 08:04:46,844][123091] Updated weights for policy 0, policy_version 1063004 (0.0010) [2023-12-26 08:04:46,910][123091] Updated weights for policy 0, policy_version 1063014 (0.0011) [2023-12-26 08:04:46,972][123091] Updated weights for policy 0, policy_version 1063024 (0.0010) [2023-12-26 08:04:47,372][123090] Updated weights for policy 1, policy_version 1055651 (0.0010) [2023-12-26 08:04:47,437][123090] Updated weights for policy 1, policy_version 1055661 (0.0010) [2023-12-26 08:04:47,496][123090] Updated weights for policy 1, policy_version 1055671 (0.0010) [2023-12-26 08:04:47,688][123091] Updated weights for policy 0, policy_version 1063034 (0.0006) [2023-12-26 08:04:47,748][123091] Updated weights for policy 0, policy_version 1063044 (0.0009) [2023-12-26 08:04:47,803][123091] Updated weights for policy 0, policy_version 1063054 (0.0007) [2023-12-26 08:04:48,223][123090] Updated weights for policy 1, policy_version 1055681 (0.0010) [2023-12-26 08:04:48,286][123090] Updated weights for policy 1, policy_version 1055691 (0.0005) [2023-12-26 08:04:48,352][123090] Updated weights for policy 1, policy_version 1055701 (0.0008) [2023-12-26 08:04:48,413][123090] Updated weights for policy 1, policy_version 1055711 (0.0009) [2023-12-26 08:04:48,615][123091] Updated weights for policy 0, policy_version 1063064 (0.0006) [2023-12-26 08:04:48,682][123091] Updated weights for policy 0, policy_version 1063074 (0.0006) [2023-12-26 08:04:48,749][123091] Updated weights for policy 0, policy_version 1063084 (0.0006) [2023-12-26 08:04:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 542416896. Throughput: 0: 8862.7, 1: 8821.6. Samples: 542424924. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:04:48,784][121949] Avg episode reward: [(0, '6063.712'), (1, '5846.357')] [2023-12-26 08:04:49,081][123090] Updated weights for policy 1, policy_version 1055721 (0.0006) [2023-12-26 08:04:49,130][123090] Updated weights for policy 1, policy_version 1055731 (0.0005) [2023-12-26 08:04:49,187][123090] Updated weights for policy 1, policy_version 1055741 (0.0005) [2023-12-26 08:04:49,559][123091] Updated weights for policy 0, policy_version 1063094 (0.0008) [2023-12-26 08:04:49,618][123091] Updated weights for policy 0, policy_version 1063104 (0.0010) [2023-12-26 08:04:49,670][123091] Updated weights for policy 0, policy_version 1063114 (0.0009) [2023-12-26 08:04:49,908][123090] Updated weights for policy 1, policy_version 1055751 (0.0008) [2023-12-26 08:04:49,974][123090] Updated weights for policy 1, policy_version 1055761 (0.0008) [2023-12-26 08:04:50,044][123090] Updated weights for policy 1, policy_version 1055771 (0.0010) [2023-12-26 08:04:50,560][123091] Updated weights for policy 0, policy_version 1063124 (0.0010) [2023-12-26 08:04:50,626][123091] Updated weights for policy 0, policy_version 1063134 (0.0009) [2023-12-26 08:04:50,681][123091] Updated weights for policy 0, policy_version 1063144 (0.0010) [2023-12-26 08:04:50,916][123090] Updated weights for policy 1, policy_version 1055781 (0.0008) [2023-12-26 08:04:50,969][123090] Updated weights for policy 1, policy_version 1055791 (0.0009) [2023-12-26 08:04:51,033][123090] Updated weights for policy 1, policy_version 1055801 (0.0009) [2023-12-26 08:04:51,560][123091] Updated weights for policy 0, policy_version 1063154 (0.0008) [2023-12-26 08:04:51,613][123091] Updated weights for policy 0, policy_version 1063164 (0.0009) [2023-12-26 08:04:51,680][123091] Updated weights for policy 0, policy_version 1063174 (0.0008) [2023-12-26 08:04:51,753][123091] Updated weights for policy 0, policy_version 1063184 (0.0009) [2023-12-26 08:04:51,911][123090] Updated weights for policy 1, policy_version 1055811 (0.0008) [2023-12-26 08:04:51,980][123090] Updated weights for policy 1, policy_version 1055821 (0.0005) [2023-12-26 08:04:52,050][123090] Updated weights for policy 1, policy_version 1055831 (0.0005) [2023-12-26 08:04:52,620][123091] Updated weights for policy 0, policy_version 1063194 (0.0009) [2023-12-26 08:04:52,680][123091] Updated weights for policy 0, policy_version 1063204 (0.0009) [2023-12-26 08:04:52,732][123091] Updated weights for policy 0, policy_version 1063214 (0.0009) [2023-12-26 08:04:52,847][123090] Updated weights for policy 1, policy_version 1055841 (0.0008) [2023-12-26 08:04:52,913][123090] Updated weights for policy 1, policy_version 1055851 (0.0010) [2023-12-26 08:04:52,972][123090] Updated weights for policy 1, policy_version 1055861 (0.0010) [2023-12-26 08:04:53,028][123090] Updated weights for policy 1, policy_version 1055871 (0.0010) [2023-12-26 08:04:53,566][123091] Updated weights for policy 0, policy_version 1063224 (0.0010) [2023-12-26 08:04:53,619][123091] Updated weights for policy 0, policy_version 1063234 (0.0010) [2023-12-26 08:04:53,677][123091] Updated weights for policy 0, policy_version 1063244 (0.0010) [2023-12-26 08:04:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 542498816. Throughput: 0: 8750.8, 1: 8882.3. Samples: 542476652. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:04:53,785][121949] Avg episode reward: [(0, '6060.060'), (1, '5774.230')] [2023-12-26 08:04:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001063248_272195584.pth... [2023-12-26 08:04:53,792][123090] Updated weights for policy 1, policy_version 1055881 (0.0006) [2023-12-26 08:04:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001062224_271933440.pth [2023-12-26 08:04:53,855][123090] Updated weights for policy 1, policy_version 1055891 (0.0008) [2023-12-26 08:04:53,923][123090] Updated weights for policy 1, policy_version 1055901 (0.0009) [2023-12-26 08:04:53,939][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001055904_270311424.pth... [2023-12-26 08:04:53,944][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001054848_270041088.pth [2023-12-26 08:04:54,563][123090] Updated weights for policy 1, policy_version 1055911 (0.0008) [2023-12-26 08:04:54,564][123091] Updated weights for policy 0, policy_version 1063254 (0.0009) [2023-12-26 08:04:54,619][123091] Updated weights for policy 0, policy_version 1063264 (0.0010) [2023-12-26 08:04:54,631][123090] Updated weights for policy 1, policy_version 1055921 (0.0005) [2023-12-26 08:04:54,667][123091] Updated weights for policy 0, policy_version 1063274 (0.0009) [2023-12-26 08:04:54,701][123090] Updated weights for policy 1, policy_version 1055931 (0.0006) [2023-12-26 08:04:55,274][123090] Updated weights for policy 1, policy_version 1055941 (0.0007) [2023-12-26 08:04:55,321][123090] Updated weights for policy 1, policy_version 1055951 (0.0005) [2023-12-26 08:04:55,377][123090] Updated weights for policy 1, policy_version 1055961 (0.0005) [2023-12-26 08:04:55,543][123091] Updated weights for policy 0, policy_version 1063284 (0.0008) [2023-12-26 08:04:55,590][123091] Updated weights for policy 0, policy_version 1063294 (0.0005) [2023-12-26 08:04:55,641][123091] Updated weights for policy 0, policy_version 1063304 (0.0005) [2023-12-26 08:04:56,060][123090] Updated weights for policy 1, policy_version 1055971 (0.0005) [2023-12-26 08:04:56,116][123090] Updated weights for policy 1, policy_version 1055981 (0.0005) [2023-12-26 08:04:56,170][123090] Updated weights for policy 1, policy_version 1055991 (0.0005) [2023-12-26 08:04:56,374][123091] Updated weights for policy 0, policy_version 1063314 (0.0006) [2023-12-26 08:04:56,432][123091] Updated weights for policy 0, policy_version 1063324 (0.0010) [2023-12-26 08:04:56,499][123091] Updated weights for policy 0, policy_version 1063334 (0.0011) [2023-12-26 08:04:56,561][123091] Updated weights for policy 0, policy_version 1063344 (0.0010) [2023-12-26 08:04:56,946][123090] Updated weights for policy 1, policy_version 1056001 (0.0008) [2023-12-26 08:04:57,005][123090] Updated weights for policy 1, policy_version 1056012 (0.0010) [2023-12-26 08:04:57,060][123090] Updated weights for policy 1, policy_version 1056024 (0.0010) [2023-12-26 08:04:57,195][123091] Updated weights for policy 0, policy_version 1063354 (0.0005) [2023-12-26 08:04:57,250][123091] Updated weights for policy 0, policy_version 1063364 (0.0005) [2023-12-26 08:04:57,295][123091] Updated weights for policy 0, policy_version 1063374 (0.0005) [2023-12-26 08:04:57,867][123090] Updated weights for policy 1, policy_version 1056034 (0.0009) [2023-12-26 08:04:57,916][123090] Updated weights for policy 1, policy_version 1056044 (0.0005) [2023-12-26 08:04:57,963][123090] Updated weights for policy 1, policy_version 1056054 (0.0005) [2023-12-26 08:04:58,012][123090] Updated weights for policy 1, policy_version 1056064 (0.0005) [2023-12-26 08:04:58,017][123091] Updated weights for policy 0, policy_version 1063384 (0.0005) [2023-12-26 08:04:58,080][123091] Updated weights for policy 0, policy_version 1063394 (0.0009) [2023-12-26 08:04:58,140][123091] Updated weights for policy 0, policy_version 1063404 (0.0010) [2023-12-26 08:04:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 542588928. Throughput: 0: 8741.1, 1: 9042.0. Samples: 542586656. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:04:58,785][121949] Avg episode reward: [(0, '6172.545'), (1, '5418.480')] [2023-12-26 08:04:58,853][123090] Updated weights for policy 1, policy_version 1056074 (0.0008) [2023-12-26 08:04:58,918][123090] Updated weights for policy 1, policy_version 1056084 (0.0007) [2023-12-26 08:04:58,982][123090] Updated weights for policy 1, policy_version 1056094 (0.0009) [2023-12-26 08:04:59,008][123091] Updated weights for policy 0, policy_version 1063414 (0.0010) [2023-12-26 08:04:59,067][123091] Updated weights for policy 0, policy_version 1063424 (0.0010) [2023-12-26 08:04:59,121][123091] Updated weights for policy 0, policy_version 1063434 (0.0010) [2023-12-26 08:04:59,805][123090] Updated weights for policy 1, policy_version 1056104 (0.0009) [2023-12-26 08:04:59,855][123091] Updated weights for policy 0, policy_version 1063444 (0.0010) [2023-12-26 08:04:59,870][123090] Updated weights for policy 1, policy_version 1056114 (0.0008) [2023-12-26 08:04:59,921][123091] Updated weights for policy 0, policy_version 1063454 (0.0006) [2023-12-26 08:04:59,940][123090] Updated weights for policy 1, policy_version 1056124 (0.0009) [2023-12-26 08:04:59,984][123091] Updated weights for policy 0, policy_version 1063464 (0.0007) [2023-12-26 08:05:00,708][123091] Updated weights for policy 0, policy_version 1063474 (0.0008) [2023-12-26 08:05:00,768][123091] Updated weights for policy 0, policy_version 1063484 (0.0008) [2023-12-26 08:05:00,787][123090] Updated weights for policy 1, policy_version 1056134 (0.0009) [2023-12-26 08:05:00,819][123091] Updated weights for policy 0, policy_version 1063494 (0.0010) [2023-12-26 08:05:00,839][123090] Updated weights for policy 1, policy_version 1056144 (0.0006) [2023-12-26 08:05:00,877][123091] Updated weights for policy 0, policy_version 1063504 (0.0010) [2023-12-26 08:05:00,889][123090] Updated weights for policy 1, policy_version 1056154 (0.0007) [2023-12-26 08:05:01,638][123091] Updated weights for policy 0, policy_version 1063514 (0.0009) [2023-12-26 08:05:01,704][123091] Updated weights for policy 0, policy_version 1063524 (0.0006) [2023-12-26 08:05:01,770][123091] Updated weights for policy 0, policy_version 1063534 (0.0008) [2023-12-26 08:05:01,796][123090] Updated weights for policy 1, policy_version 1056164 (0.0008) [2023-12-26 08:05:01,865][123090] Updated weights for policy 1, policy_version 1056174 (0.0010) [2023-12-26 08:05:01,929][123090] Updated weights for policy 1, policy_version 1056184 (0.0009) [2023-12-26 08:05:02,459][123091] Updated weights for policy 0, policy_version 1063544 (0.0010) [2023-12-26 08:05:02,519][123091] Updated weights for policy 0, policy_version 1063554 (0.0009) [2023-12-26 08:05:02,572][123091] Updated weights for policy 0, policy_version 1063564 (0.0009) [2023-12-26 08:05:02,731][123090] Updated weights for policy 1, policy_version 1056194 (0.0010) [2023-12-26 08:05:02,786][123090] Updated weights for policy 1, policy_version 1056204 (0.0008) [2023-12-26 08:05:02,842][123090] Updated weights for policy 1, policy_version 1056214 (0.0009) [2023-12-26 08:05:02,901][123090] Updated weights for policy 1, policy_version 1056224 (0.0010) [2023-12-26 08:05:03,375][123091] Updated weights for policy 0, policy_version 1063574 (0.0009) [2023-12-26 08:05:03,422][123091] Updated weights for policy 0, policy_version 1063584 (0.0008) [2023-12-26 08:05:03,471][123091] Updated weights for policy 0, policy_version 1063594 (0.0009) [2023-12-26 08:05:03,743][123090] Updated weights for policy 1, policy_version 1056234 (0.0009) [2023-12-26 08:05:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 542679040. Throughput: 0: 8750.4, 1: 8958.1. Samples: 542692520. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:03,785][121949] Avg episode reward: [(0, '6151.021'), (1, '5460.990')] [2023-12-26 08:05:03,799][123090] Updated weights for policy 1, policy_version 1056244 (0.0005) [2023-12-26 08:05:03,869][123090] Updated weights for policy 1, policy_version 1056254 (0.0007) [2023-12-26 08:05:04,346][123091] Updated weights for policy 0, policy_version 1063605 (0.0009) [2023-12-26 08:05:04,400][123091] Updated weights for policy 0, policy_version 1063615 (0.0009) [2023-12-26 08:05:04,455][123091] Updated weights for policy 0, policy_version 1063625 (0.0009) [2023-12-26 08:05:04,638][123090] Updated weights for policy 1, policy_version 1056264 (0.0008) [2023-12-26 08:05:04,705][123090] Updated weights for policy 1, policy_version 1056274 (0.0008) [2023-12-26 08:05:04,767][123090] Updated weights for policy 1, policy_version 1056284 (0.0008) [2023-12-26 08:05:05,283][123091] Updated weights for policy 0, policy_version 1063635 (0.0009) [2023-12-26 08:05:05,336][123091] Updated weights for policy 0, policy_version 1063646 (0.0010) [2023-12-26 08:05:05,393][123091] Updated weights for policy 0, policy_version 1063656 (0.0009) [2023-12-26 08:05:05,466][123090] Updated weights for policy 1, policy_version 1056294 (0.0006) [2023-12-26 08:05:05,519][123090] Updated weights for policy 1, policy_version 1056304 (0.0005) [2023-12-26 08:05:05,574][123090] Updated weights for policy 1, policy_version 1056314 (0.0005) [2023-12-26 08:05:06,166][123090] Updated weights for policy 1, policy_version 1056324 (0.0005) [2023-12-26 08:05:06,240][123090] Updated weights for policy 1, policy_version 1056334 (0.0007) [2023-12-26 08:05:06,312][123090] Updated weights for policy 1, policy_version 1056344 (0.0007) [2023-12-26 08:05:06,314][123091] Updated weights for policy 0, policy_version 1063666 (0.0010) [2023-12-26 08:05:06,379][123091] Updated weights for policy 0, policy_version 1063676 (0.0010) [2023-12-26 08:05:06,446][123091] Updated weights for policy 0, policy_version 1063686 (0.0009) [2023-12-26 08:05:06,515][123091] Updated weights for policy 0, policy_version 1063696 (0.0009) [2023-12-26 08:05:07,085][123090] Updated weights for policy 1, policy_version 1056354 (0.0007) [2023-12-26 08:05:07,138][123090] Updated weights for policy 1, policy_version 1056364 (0.0009) [2023-12-26 08:05:07,196][123090] Updated weights for policy 1, policy_version 1056374 (0.0007) [2023-12-26 08:05:07,254][123090] Updated weights for policy 1, policy_version 1056384 (0.0006) [2023-12-26 08:05:07,379][123091] Updated weights for policy 0, policy_version 1063706 (0.0010) [2023-12-26 08:05:07,438][123091] Updated weights for policy 0, policy_version 1063716 (0.0009) [2023-12-26 08:05:07,512][123091] Updated weights for policy 0, policy_version 1063726 (0.0009) [2023-12-26 08:05:08,006][123090] Updated weights for policy 1, policy_version 1056394 (0.0005) [2023-12-26 08:05:08,073][123090] Updated weights for policy 1, policy_version 1056404 (0.0008) [2023-12-26 08:05:08,121][123090] Updated weights for policy 1, policy_version 1056414 (0.0009) [2023-12-26 08:05:08,378][123091] Updated weights for policy 0, policy_version 1063736 (0.0009) [2023-12-26 08:05:08,439][123091] Updated weights for policy 0, policy_version 1063746 (0.0009) [2023-12-26 08:05:08,499][123091] Updated weights for policy 0, policy_version 1063756 (0.0010) [2023-12-26 08:05:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 542769152. Throughput: 0: 8749.2, 1: 9028.4. Samples: 542745692. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:08,784][121949] Avg episode reward: [(0, '6126.109'), (1, '5819.163')] [2023-12-26 08:05:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001056416_270442496.pth... [2023-12-26 08:05:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001063760_272326656.pth... [2023-12-26 08:05:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001055392_270180352.pth [2023-12-26 08:05:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001062736_272064512.pth [2023-12-26 08:05:08,908][123090] Updated weights for policy 1, policy_version 1056424 (0.0006) [2023-12-26 08:05:08,986][123090] Updated weights for policy 1, policy_version 1056434 (0.0007) [2023-12-26 08:05:09,038][123090] Updated weights for policy 1, policy_version 1056445 (0.0009) [2023-12-26 08:05:09,278][123091] Updated weights for policy 0, policy_version 1063766 (0.0008) [2023-12-26 08:05:09,345][123091] Updated weights for policy 0, policy_version 1063776 (0.0006) [2023-12-26 08:05:09,416][123091] Updated weights for policy 0, policy_version 1063786 (0.0009) [2023-12-26 08:05:09,872][123090] Updated weights for policy 1, policy_version 1056455 (0.0010) [2023-12-26 08:05:09,944][123090] Updated weights for policy 1, policy_version 1056465 (0.0011) [2023-12-26 08:05:10,016][123090] Updated weights for policy 1, policy_version 1056475 (0.0011) [2023-12-26 08:05:10,228][123091] Updated weights for policy 0, policy_version 1063796 (0.0008) [2023-12-26 08:05:10,299][123091] Updated weights for policy 0, policy_version 1063806 (0.0006) [2023-12-26 08:05:10,366][123091] Updated weights for policy 0, policy_version 1063816 (0.0008) [2023-12-26 08:05:10,859][123090] Updated weights for policy 1, policy_version 1056485 (0.0011) [2023-12-26 08:05:10,933][123090] Updated weights for policy 1, policy_version 1056495 (0.0010) [2023-12-26 08:05:10,993][123090] Updated weights for policy 1, policy_version 1056505 (0.0010) [2023-12-26 08:05:11,014][123091] Updated weights for policy 0, policy_version 1063826 (0.0010) [2023-12-26 08:05:11,090][123091] Updated weights for policy 0, policy_version 1063837 (0.0008) [2023-12-26 08:05:11,161][123091] Updated weights for policy 0, policy_version 1063847 (0.0010) [2023-12-26 08:05:11,861][123090] Updated weights for policy 1, policy_version 1056515 (0.0010) [2023-12-26 08:05:11,935][123090] Updated weights for policy 1, policy_version 1056525 (0.0008) [2023-12-26 08:05:12,007][123090] Updated weights for policy 1, policy_version 1056535 (0.0008) [2023-12-26 08:05:12,025][123091] Updated weights for policy 0, policy_version 1063857 (0.0010) [2023-12-26 08:05:12,093][123091] Updated weights for policy 0, policy_version 1063867 (0.0008) [2023-12-26 08:05:12,157][123091] Updated weights for policy 0, policy_version 1063877 (0.0009) [2023-12-26 08:05:12,209][123091] Updated weights for policy 0, policy_version 1063887 (0.0010) [2023-12-26 08:05:12,656][123090] Updated weights for policy 1, policy_version 1056545 (0.0008) [2023-12-26 08:05:12,729][123090] Updated weights for policy 1, policy_version 1056555 (0.0005) [2023-12-26 08:05:12,795][123090] Updated weights for policy 1, policy_version 1056565 (0.0005) [2023-12-26 08:05:12,845][123090] Updated weights for policy 1, policy_version 1056575 (0.0005) [2023-12-26 08:05:13,141][123091] Updated weights for policy 0, policy_version 1063897 (0.0010) [2023-12-26 08:05:13,213][123091] Updated weights for policy 0, policy_version 1063907 (0.0009) [2023-12-26 08:05:13,283][123091] Updated weights for policy 0, policy_version 1063917 (0.0009) [2023-12-26 08:05:13,569][123090] Updated weights for policy 1, policy_version 1056585 (0.0010) [2023-12-26 08:05:13,635][123090] Updated weights for policy 1, policy_version 1056595 (0.0010) [2023-12-26 08:05:13,697][123090] Updated weights for policy 1, policy_version 1056605 (0.0010) [2023-12-26 08:05:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 542859264. Throughput: 0: 8717.7, 1: 8955.6. Samples: 542849620. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:13,784][121949] Avg episode reward: [(0, '6179.836'), (1, '5698.901')] [2023-12-26 08:05:14,042][123091] Updated weights for policy 0, policy_version 1063927 (0.0007) [2023-12-26 08:05:14,094][123091] Updated weights for policy 0, policy_version 1063937 (0.0005) [2023-12-26 08:05:14,151][123091] Updated weights for policy 0, policy_version 1063947 (0.0005) [2023-12-26 08:05:14,514][123090] Updated weights for policy 1, policy_version 1056615 (0.0010) [2023-12-26 08:05:14,568][123090] Updated weights for policy 1, policy_version 1056625 (0.0010) [2023-12-26 08:05:14,621][123090] Updated weights for policy 1, policy_version 1056635 (0.0009) [2023-12-26 08:05:14,809][123091] Updated weights for policy 0, policy_version 1063957 (0.0007) [2023-12-26 08:05:14,885][123091] Updated weights for policy 0, policy_version 1063967 (0.0010) [2023-12-26 08:05:14,961][123091] Updated weights for policy 0, policy_version 1063977 (0.0011) [2023-12-26 08:05:15,423][123090] Updated weights for policy 1, policy_version 1056645 (0.0008) [2023-12-26 08:05:15,471][123090] Updated weights for policy 1, policy_version 1056655 (0.0010) [2023-12-26 08:05:15,535][123090] Updated weights for policy 1, policy_version 1056665 (0.0011) [2023-12-26 08:05:15,761][123091] Updated weights for policy 0, policy_version 1063987 (0.0011) [2023-12-26 08:05:15,834][123091] Updated weights for policy 0, policy_version 1063997 (0.0011) [2023-12-26 08:05:15,907][123091] Updated weights for policy 0, policy_version 1064007 (0.0011) [2023-12-26 08:05:16,306][123090] Updated weights for policy 1, policy_version 1056675 (0.0007) [2023-12-26 08:05:16,372][123090] Updated weights for policy 1, policy_version 1056685 (0.0010) [2023-12-26 08:05:16,424][123090] Updated weights for policy 1, policy_version 1056695 (0.0010) [2023-12-26 08:05:16,667][123091] Updated weights for policy 0, policy_version 1064017 (0.0010) [2023-12-26 08:05:16,729][123091] Updated weights for policy 0, policy_version 1064027 (0.0007) [2023-12-26 08:05:16,799][123091] Updated weights for policy 0, policy_version 1064037 (0.0005) [2023-12-26 08:05:16,866][123091] Updated weights for policy 0, policy_version 1064047 (0.0005) [2023-12-26 08:05:17,216][123090] Updated weights for policy 1, policy_version 1056705 (0.0010) [2023-12-26 08:05:17,269][123090] Updated weights for policy 1, policy_version 1056715 (0.0010) [2023-12-26 08:05:17,321][123090] Updated weights for policy 1, policy_version 1056725 (0.0011) [2023-12-26 08:05:17,369][123090] Updated weights for policy 1, policy_version 1056735 (0.0010) [2023-12-26 08:05:17,598][123091] Updated weights for policy 0, policy_version 1064057 (0.0008) [2023-12-26 08:05:17,661][123091] Updated weights for policy 0, policy_version 1064067 (0.0009) [2023-12-26 08:05:17,725][123091] Updated weights for policy 0, policy_version 1064077 (0.0009) [2023-12-26 08:05:18,189][123090] Updated weights for policy 1, policy_version 1056745 (0.0006) [2023-12-26 08:05:18,257][123090] Updated weights for policy 1, policy_version 1056755 (0.0005) [2023-12-26 08:05:18,328][123090] Updated weights for policy 1, policy_version 1056765 (0.0006) [2023-12-26 08:05:18,545][123091] Updated weights for policy 0, policy_version 1064087 (0.0006) [2023-12-26 08:05:18,611][123091] Updated weights for policy 0, policy_version 1064097 (0.0006) [2023-12-26 08:05:18,682][123091] Updated weights for policy 0, policy_version 1064107 (0.0006) [2023-12-26 08:05:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 542949376. Throughput: 0: 8736.8, 1: 8940.0. Samples: 542959016. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:18,785][121949] Avg episode reward: [(0, '6105.830'), (1, '5739.307')] [2023-12-26 08:05:19,038][123090] Updated weights for policy 1, policy_version 1056775 (0.0007) [2023-12-26 08:05:19,099][123090] Updated weights for policy 1, policy_version 1056785 (0.0007) [2023-12-26 08:05:19,167][123090] Updated weights for policy 1, policy_version 1056795 (0.0006) [2023-12-26 08:05:19,532][123091] Updated weights for policy 0, policy_version 1064117 (0.0010) [2023-12-26 08:05:19,590][123091] Updated weights for policy 0, policy_version 1064127 (0.0010) [2023-12-26 08:05:19,646][123091] Updated weights for policy 0, policy_version 1064137 (0.0009) [2023-12-26 08:05:19,880][123090] Updated weights for policy 1, policy_version 1056805 (0.0008) [2023-12-26 08:05:19,948][123090] Updated weights for policy 1, policy_version 1056815 (0.0008) [2023-12-26 08:05:20,020][123090] Updated weights for policy 1, policy_version 1056825 (0.0006) [2023-12-26 08:05:20,551][123091] Updated weights for policy 0, policy_version 1064147 (0.0010) [2023-12-26 08:05:20,622][123091] Updated weights for policy 0, policy_version 1064157 (0.0010) [2023-12-26 08:05:20,690][123091] Updated weights for policy 0, policy_version 1064167 (0.0010) [2023-12-26 08:05:20,792][123090] Updated weights for policy 1, policy_version 1056835 (0.0008) [2023-12-26 08:05:20,855][123090] Updated weights for policy 1, policy_version 1056845 (0.0009) [2023-12-26 08:05:20,921][123090] Updated weights for policy 1, policy_version 1056855 (0.0010) [2023-12-26 08:05:21,521][123091] Updated weights for policy 0, policy_version 1064177 (0.0010) [2023-12-26 08:05:21,586][123091] Updated weights for policy 0, policy_version 1064187 (0.0009) [2023-12-26 08:05:21,660][123091] Updated weights for policy 0, policy_version 1064197 (0.0009) [2023-12-26 08:05:21,715][123091] Updated weights for policy 0, policy_version 1064207 (0.0009) [2023-12-26 08:05:21,783][123090] Updated weights for policy 1, policy_version 1056865 (0.0010) [2023-12-26 08:05:21,847][123090] Updated weights for policy 1, policy_version 1056875 (0.0010) [2023-12-26 08:05:21,909][123090] Updated weights for policy 1, policy_version 1056885 (0.0009) [2023-12-26 08:05:21,962][123090] Updated weights for policy 1, policy_version 1056895 (0.0009) [2023-12-26 08:05:22,565][123091] Updated weights for policy 0, policy_version 1064217 (0.0011) [2023-12-26 08:05:22,634][123091] Updated weights for policy 0, policy_version 1064227 (0.0009) [2023-12-26 08:05:22,699][123091] Updated weights for policy 0, policy_version 1064237 (0.0009) [2023-12-26 08:05:22,803][123090] Updated weights for policy 1, policy_version 1056905 (0.0007) [2023-12-26 08:05:22,871][123090] Updated weights for policy 1, policy_version 1056915 (0.0009) [2023-12-26 08:05:22,946][123090] Updated weights for policy 1, policy_version 1056925 (0.0009) [2023-12-26 08:05:23,583][123090] Updated weights for policy 1, policy_version 1056935 (0.0006) [2023-12-26 08:05:23,604][123091] Updated weights for policy 0, policy_version 1064247 (0.0009) [2023-12-26 08:05:23,653][123090] Updated weights for policy 1, policy_version 1056945 (0.0005) [2023-12-26 08:05:23,668][123091] Updated weights for policy 0, policy_version 1064257 (0.0008) [2023-12-26 08:05:23,717][123090] Updated weights for policy 1, policy_version 1056955 (0.0005) [2023-12-26 08:05:23,744][123091] Updated weights for policy 0, policy_version 1064267 (0.0008) [2023-12-26 08:05:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 543039488. Throughput: 0: 8719.7, 1: 8958.1. Samples: 543009976. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:23,785][121949] Avg episode reward: [(0, '6155.640'), (1, '5798.495')] [2023-12-26 08:05:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001064272_272457728.pth... [2023-12-26 08:05:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001056960_270581760.pth... [2023-12-26 08:05:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001055904_270311424.pth [2023-12-26 08:05:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001063248_272195584.pth [2023-12-26 08:05:24,412][123091] Updated weights for policy 0, policy_version 1064277 (0.0007) [2023-12-26 08:05:24,471][123091] Updated weights for policy 0, policy_version 1064287 (0.0005) [2023-12-26 08:05:24,518][123090] Updated weights for policy 1, policy_version 1056965 (0.0009) [2023-12-26 08:05:24,533][123091] Updated weights for policy 0, policy_version 1064297 (0.0007) [2023-12-26 08:05:24,575][123090] Updated weights for policy 1, policy_version 1056975 (0.0006) [2023-12-26 08:05:24,636][123090] Updated weights for policy 1, policy_version 1056985 (0.0009) [2023-12-26 08:05:25,229][123091] Updated weights for policy 0, policy_version 1064307 (0.0008) [2023-12-26 08:05:25,279][123091] Updated weights for policy 0, policy_version 1064317 (0.0009) [2023-12-26 08:05:25,335][123091] Updated weights for policy 0, policy_version 1064327 (0.0009) [2023-12-26 08:05:25,465][123090] Updated weights for policy 1, policy_version 1056995 (0.0008) [2023-12-26 08:05:25,523][123090] Updated weights for policy 1, policy_version 1057005 (0.0008) [2023-12-26 08:05:25,593][123090] Updated weights for policy 1, policy_version 1057015 (0.0010) [2023-12-26 08:05:26,022][123091] Updated weights for policy 0, policy_version 1064337 (0.0010) [2023-12-26 08:05:26,076][123091] Updated weights for policy 0, policy_version 1064347 (0.0010) [2023-12-26 08:05:26,128][123091] Updated weights for policy 0, policy_version 1064357 (0.0009) [2023-12-26 08:05:26,199][123091] Updated weights for policy 0, policy_version 1064367 (0.0009) [2023-12-26 08:05:26,434][123090] Updated weights for policy 1, policy_version 1057025 (0.0010) [2023-12-26 08:05:26,497][123090] Updated weights for policy 1, policy_version 1057035 (0.0009) [2023-12-26 08:05:26,565][123090] Updated weights for policy 1, policy_version 1057045 (0.0009) [2023-12-26 08:05:26,631][123090] Updated weights for policy 1, policy_version 1057055 (0.0007) [2023-12-26 08:05:27,049][123091] Updated weights for policy 0, policy_version 1064377 (0.0009) [2023-12-26 08:05:27,107][123091] Updated weights for policy 0, policy_version 1064387 (0.0007) [2023-12-26 08:05:27,173][123091] Updated weights for policy 0, policy_version 1064397 (0.0009) [2023-12-26 08:05:27,357][123090] Updated weights for policy 1, policy_version 1057065 (0.0009) [2023-12-26 08:05:27,413][123090] Updated weights for policy 1, policy_version 1057075 (0.0009) [2023-12-26 08:05:27,470][123090] Updated weights for policy 1, policy_version 1057085 (0.0010) [2023-12-26 08:05:27,970][123091] Updated weights for policy 0, policy_version 1064407 (0.0010) [2023-12-26 08:05:28,037][123091] Updated weights for policy 0, policy_version 1064417 (0.0009) [2023-12-26 08:05:28,096][123091] Updated weights for policy 0, policy_version 1064427 (0.0009) [2023-12-26 08:05:28,304][123090] Updated weights for policy 1, policy_version 1057095 (0.0009) [2023-12-26 08:05:28,369][123090] Updated weights for policy 1, policy_version 1057105 (0.0010) [2023-12-26 08:05:28,420][123090] Updated weights for policy 1, policy_version 1057115 (0.0009) [2023-12-26 08:05:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.5, 300 sec: 17744.7). Total num frames: 543121408. Throughput: 0: 8754.0, 1: 9012.6. Samples: 543116184. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:28,785][121949] Avg episode reward: [(0, '6077.402'), (1, '5898.601')] [2023-12-26 08:05:28,909][123091] Updated weights for policy 0, policy_version 1064437 (0.0009) [2023-12-26 08:05:28,974][123091] Updated weights for policy 0, policy_version 1064447 (0.0010) [2023-12-26 08:05:29,039][123091] Updated weights for policy 0, policy_version 1064457 (0.0009) [2023-12-26 08:05:29,277][123090] Updated weights for policy 1, policy_version 1057125 (0.0007) [2023-12-26 08:05:29,347][123090] Updated weights for policy 1, policy_version 1057135 (0.0008) [2023-12-26 08:05:29,403][123090] Updated weights for policy 1, policy_version 1057145 (0.0009) [2023-12-26 08:05:29,820][123091] Updated weights for policy 0, policy_version 1064467 (0.0009) [2023-12-26 08:05:29,888][123091] Updated weights for policy 0, policy_version 1064477 (0.0008) [2023-12-26 08:05:29,966][123091] Updated weights for policy 0, policy_version 1064487 (0.0007) [2023-12-26 08:05:30,254][123090] Updated weights for policy 1, policy_version 1057155 (0.0009) [2023-12-26 08:05:30,326][123090] Updated weights for policy 1, policy_version 1057165 (0.0007) [2023-12-26 08:05:30,398][123090] Updated weights for policy 1, policy_version 1057175 (0.0006) [2023-12-26 08:05:30,752][123091] Updated weights for policy 0, policy_version 1064497 (0.0008) [2023-12-26 08:05:30,800][123091] Updated weights for policy 0, policy_version 1064507 (0.0009) [2023-12-26 08:05:30,866][123091] Updated weights for policy 0, policy_version 1064517 (0.0010) [2023-12-26 08:05:30,930][123091] Updated weights for policy 0, policy_version 1064527 (0.0009) [2023-12-26 08:05:31,079][123090] Updated weights for policy 1, policy_version 1057185 (0.0007) [2023-12-26 08:05:31,138][123090] Updated weights for policy 1, policy_version 1057195 (0.0009) [2023-12-26 08:05:31,200][123090] Updated weights for policy 1, policy_version 1057205 (0.0009) [2023-12-26 08:05:31,266][123090] Updated weights for policy 1, policy_version 1057215 (0.0009) [2023-12-26 08:05:31,728][123091] Updated weights for policy 0, policy_version 1064537 (0.0009) [2023-12-26 08:05:31,792][123091] Updated weights for policy 0, policy_version 1064547 (0.0009) [2023-12-26 08:05:31,848][123091] Updated weights for policy 0, policy_version 1064557 (0.0006) [2023-12-26 08:05:32,026][123090] Updated weights for policy 1, policy_version 1057225 (0.0009) [2023-12-26 08:05:32,093][123090] Updated weights for policy 1, policy_version 1057235 (0.0010) [2023-12-26 08:05:32,147][123090] Updated weights for policy 1, policy_version 1057245 (0.0010) [2023-12-26 08:05:32,643][123091] Updated weights for policy 0, policy_version 1064567 (0.0009) [2023-12-26 08:05:32,694][123091] Updated weights for policy 0, policy_version 1064577 (0.0010) [2023-12-26 08:05:32,746][123091] Updated weights for policy 0, policy_version 1064587 (0.0010) [2023-12-26 08:05:32,946][123090] Updated weights for policy 1, policy_version 1057255 (0.0008) [2023-12-26 08:05:33,003][123090] Updated weights for policy 1, policy_version 1057265 (0.0009) [2023-12-26 08:05:33,050][123090] Updated weights for policy 1, policy_version 1057275 (0.0008) [2023-12-26 08:05:33,534][123091] Updated weights for policy 0, policy_version 1064597 (0.0008) [2023-12-26 08:05:33,588][123091] Updated weights for policy 0, policy_version 1064607 (0.0005) [2023-12-26 08:05:33,637][123091] Updated weights for policy 0, policy_version 1064617 (0.0005) [2023-12-26 08:05:33,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 543211520. Throughput: 0: 8737.9, 1: 8971.1. Samples: 543221836. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:33,786][121949] Avg episode reward: [(0, '6098.920'), (1, '5906.763')] [2023-12-26 08:05:33,943][123090] Updated weights for policy 1, policy_version 1057285 (0.0008) [2023-12-26 08:05:33,995][123090] Updated weights for policy 1, policy_version 1057295 (0.0009) [2023-12-26 08:05:34,057][123090] Updated weights for policy 1, policy_version 1057305 (0.0010) [2023-12-26 08:05:34,313][123091] Updated weights for policy 0, policy_version 1064627 (0.0006) [2023-12-26 08:05:34,371][123091] Updated weights for policy 0, policy_version 1064637 (0.0009) [2023-12-26 08:05:34,431][123091] Updated weights for policy 0, policy_version 1064647 (0.0009) [2023-12-26 08:05:34,794][123090] Updated weights for policy 1, policy_version 1057315 (0.0008) [2023-12-26 08:05:34,846][123090] Updated weights for policy 1, policy_version 1057325 (0.0005) [2023-12-26 08:05:34,899][123090] Updated weights for policy 1, policy_version 1057335 (0.0006) [2023-12-26 08:05:35,258][123091] Updated weights for policy 0, policy_version 1064657 (0.0008) [2023-12-26 08:05:35,321][123091] Updated weights for policy 0, policy_version 1064667 (0.0006) [2023-12-26 08:05:35,378][123091] Updated weights for policy 0, policy_version 1064677 (0.0006) [2023-12-26 08:05:35,434][123091] Updated weights for policy 0, policy_version 1064687 (0.0007) [2023-12-26 08:05:35,658][123090] Updated weights for policy 1, policy_version 1057345 (0.0007) [2023-12-26 08:05:35,716][123090] Updated weights for policy 1, policy_version 1057355 (0.0008) [2023-12-26 08:05:35,793][123090] Updated weights for policy 1, policy_version 1057365 (0.0006) [2023-12-26 08:05:35,876][123090] Updated weights for policy 1, policy_version 1057375 (0.0006) [2023-12-26 08:05:36,068][123091] Updated weights for policy 0, policy_version 1064697 (0.0006) [2023-12-26 08:05:36,143][123091] Updated weights for policy 0, policy_version 1064707 (0.0006) [2023-12-26 08:05:36,214][123091] Updated weights for policy 0, policy_version 1064717 (0.0006) [2023-12-26 08:05:36,579][123090] Updated weights for policy 1, policy_version 1057385 (0.0009) [2023-12-26 08:05:36,655][123090] Updated weights for policy 1, policy_version 1057395 (0.0008) [2023-12-26 08:05:36,717][123090] Updated weights for policy 1, policy_version 1057405 (0.0007) [2023-12-26 08:05:36,819][123091] Updated weights for policy 0, policy_version 1064727 (0.0006) [2023-12-26 08:05:36,888][123091] Updated weights for policy 0, policy_version 1064737 (0.0007) [2023-12-26 08:05:36,939][123091] Updated weights for policy 0, policy_version 1064747 (0.0006) [2023-12-26 08:05:37,499][123090] Updated weights for policy 1, policy_version 1057415 (0.0008) [2023-12-26 08:05:37,553][123090] Updated weights for policy 1, policy_version 1057425 (0.0009) [2023-12-26 08:05:37,594][123091] Updated weights for policy 0, policy_version 1064757 (0.0007) [2023-12-26 08:05:37,601][123090] Updated weights for policy 1, policy_version 1057435 (0.0008) [2023-12-26 08:05:37,654][123091] Updated weights for policy 0, policy_version 1064767 (0.0010) [2023-12-26 08:05:37,703][123091] Updated weights for policy 0, policy_version 1064777 (0.0009) [2023-12-26 08:05:38,471][123090] Updated weights for policy 1, policy_version 1057445 (0.0008) [2023-12-26 08:05:38,525][123090] Updated weights for policy 1, policy_version 1057455 (0.0010) [2023-12-26 08:05:38,564][123091] Updated weights for policy 0, policy_version 1064787 (0.0009) [2023-12-26 08:05:38,591][123090] Updated weights for policy 1, policy_version 1057465 (0.0009) [2023-12-26 08:05:38,615][123091] Updated weights for policy 0, policy_version 1064797 (0.0009) [2023-12-26 08:05:38,664][123091] Updated weights for policy 0, policy_version 1064807 (0.0010) [2023-12-26 08:05:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 543309824. Throughput: 0: 8853.2, 1: 8964.4. Samples: 543278440. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:38,785][121949] Avg episode reward: [(0, '6247.792'), (1, '5957.837')] [2023-12-26 08:05:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001064816_272596992.pth... [2023-12-26 08:05:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001057472_270712832.pth... [2023-12-26 08:05:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001063760_272326656.pth [2023-12-26 08:05:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001056416_270442496.pth [2023-12-26 08:05:39,497][123091] Updated weights for policy 0, policy_version 1064817 (0.0010) [2023-12-26 08:05:39,506][123090] Updated weights for policy 1, policy_version 1057475 (0.0007) [2023-12-26 08:05:39,559][123091] Updated weights for policy 0, policy_version 1064827 (0.0008) [2023-12-26 08:05:39,570][123090] Updated weights for policy 1, policy_version 1057485 (0.0008) [2023-12-26 08:05:39,622][123091] Updated weights for policy 0, policy_version 1064837 (0.0009) [2023-12-26 08:05:39,637][123090] Updated weights for policy 1, policy_version 1057495 (0.0008) [2023-12-26 08:05:39,687][123091] Updated weights for policy 0, policy_version 1064847 (0.0008) [2023-12-26 08:05:40,530][123090] Updated weights for policy 1, policy_version 1057505 (0.0009) [2023-12-26 08:05:40,532][123091] Updated weights for policy 0, policy_version 1064857 (0.0009) [2023-12-26 08:05:40,588][123091] Updated weights for policy 0, policy_version 1064867 (0.0009) [2023-12-26 08:05:40,590][123090] Updated weights for policy 1, policy_version 1057515 (0.0008) [2023-12-26 08:05:40,642][123091] Updated weights for policy 0, policy_version 1064877 (0.0007) [2023-12-26 08:05:40,644][123090] Updated weights for policy 1, policy_version 1057525 (0.0008) [2023-12-26 08:05:40,708][123090] Updated weights for policy 1, policy_version 1057535 (0.0008) [2023-12-26 08:05:41,444][123091] Updated weights for policy 0, policy_version 1064887 (0.0007) [2023-12-26 08:05:41,496][123091] Updated weights for policy 0, policy_version 1064897 (0.0006) [2023-12-26 08:05:41,546][123091] Updated weights for policy 0, policy_version 1064907 (0.0008) [2023-12-26 08:05:41,581][123090] Updated weights for policy 1, policy_version 1057545 (0.0008) [2023-12-26 08:05:41,650][123090] Updated weights for policy 1, policy_version 1057555 (0.0010) [2023-12-26 08:05:41,711][123090] Updated weights for policy 1, policy_version 1057565 (0.0011) [2023-12-26 08:05:42,340][123091] Updated weights for policy 0, policy_version 1064917 (0.0012) [2023-12-26 08:05:42,414][123091] Updated weights for policy 0, policy_version 1064927 (0.0010) [2023-12-26 08:05:42,469][123091] Updated weights for policy 0, policy_version 1064937 (0.0009) [2023-12-26 08:05:42,573][123090] Updated weights for policy 1, policy_version 1057575 (0.0007) [2023-12-26 08:05:42,641][123090] Updated weights for policy 1, policy_version 1057585 (0.0006) [2023-12-26 08:05:42,711][123090] Updated weights for policy 1, policy_version 1057595 (0.0009) [2023-12-26 08:05:43,350][123091] Updated weights for policy 0, policy_version 1064947 (0.0009) [2023-12-26 08:05:43,399][123091] Updated weights for policy 0, policy_version 1064957 (0.0009) [2023-12-26 08:05:43,401][123090] Updated weights for policy 1, policy_version 1057605 (0.0007) [2023-12-26 08:05:43,450][123091] Updated weights for policy 0, policy_version 1064968 (0.0009) [2023-12-26 08:05:43,464][123090] Updated weights for policy 1, policy_version 1057615 (0.0005) [2023-12-26 08:05:43,538][123090] Updated weights for policy 1, policy_version 1057625 (0.0007) [2023-12-26 08:05:43,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 543391744. Throughput: 0: 8856.8, 1: 8799.3. Samples: 543381180. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:43,784][121949] Avg episode reward: [(0, '6368.046'), (1, '5958.783')] [2023-12-26 08:05:44,203][123090] Updated weights for policy 1, policy_version 1057636 (0.0008) [2023-12-26 08:05:44,268][123090] Updated weights for policy 1, policy_version 1057646 (0.0006) [2023-12-26 08:05:44,317][123090] Updated weights for policy 1, policy_version 1057656 (0.0006) [2023-12-26 08:05:44,367][123091] Updated weights for policy 0, policy_version 1064978 (0.0010) [2023-12-26 08:05:44,434][123091] Updated weights for policy 0, policy_version 1064988 (0.0008) [2023-12-26 08:05:44,497][123091] Updated weights for policy 0, policy_version 1064998 (0.0008) [2023-12-26 08:05:44,568][123091] Updated weights for policy 0, policy_version 1065008 (0.0010) [2023-12-26 08:05:45,073][123090] Updated weights for policy 1, policy_version 1057666 (0.0006) [2023-12-26 08:05:45,137][123090] Updated weights for policy 1, policy_version 1057676 (0.0010) [2023-12-26 08:05:45,197][123090] Updated weights for policy 1, policy_version 1057686 (0.0010) [2023-12-26 08:05:45,266][123090] Updated weights for policy 1, policy_version 1057696 (0.0010) [2023-12-26 08:05:45,377][123091] Updated weights for policy 0, policy_version 1065018 (0.0007) [2023-12-26 08:05:45,429][123091] Updated weights for policy 0, policy_version 1065028 (0.0010) [2023-12-26 08:05:45,484][123091] Updated weights for policy 0, policy_version 1065038 (0.0009) [2023-12-26 08:05:46,110][123090] Updated weights for policy 1, policy_version 1057706 (0.0010) [2023-12-26 08:05:46,166][123090] Updated weights for policy 1, policy_version 1057716 (0.0010) [2023-12-26 08:05:46,200][123091] Updated weights for policy 0, policy_version 1065048 (0.0008) [2023-12-26 08:05:46,227][123090] Updated weights for policy 1, policy_version 1057726 (0.0008) [2023-12-26 08:05:46,270][123091] Updated weights for policy 0, policy_version 1065058 (0.0005) [2023-12-26 08:05:46,323][123091] Updated weights for policy 0, policy_version 1065068 (0.0009) [2023-12-26 08:05:47,025][123090] Updated weights for policy 1, policy_version 1057736 (0.0005) [2023-12-26 08:05:47,085][123090] Updated weights for policy 1, policy_version 1057746 (0.0007) [2023-12-26 08:05:47,126][123091] Updated weights for policy 0, policy_version 1065078 (0.0007) [2023-12-26 08:05:47,148][123090] Updated weights for policy 1, policy_version 1057756 (0.0007) [2023-12-26 08:05:47,172][123091] Updated weights for policy 0, policy_version 1065088 (0.0008) [2023-12-26 08:05:47,224][123091] Updated weights for policy 0, policy_version 1065098 (0.0009) [2023-12-26 08:05:47,782][123090] Updated weights for policy 1, policy_version 1057766 (0.0006) [2023-12-26 08:05:47,840][123090] Updated weights for policy 1, policy_version 1057776 (0.0006) [2023-12-26 08:05:47,889][123090] Updated weights for policy 1, policy_version 1057786 (0.0008) [2023-12-26 08:05:48,128][123091] Updated weights for policy 0, policy_version 1065109 (0.0011) [2023-12-26 08:05:48,182][123091] Updated weights for policy 0, policy_version 1065119 (0.0010) [2023-12-26 08:05:48,230][123091] Updated weights for policy 0, policy_version 1065129 (0.0010) [2023-12-26 08:05:48,741][123090] Updated weights for policy 1, policy_version 1057796 (0.0009) [2023-12-26 08:05:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 543473664. Throughput: 0: 8791.6, 1: 8892.8. Samples: 543488316. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:48,785][121949] Avg episode reward: [(0, '6315.604'), (1, '5703.426')] [2023-12-26 08:05:48,801][123090] Updated weights for policy 1, policy_version 1057806 (0.0011) [2023-12-26 08:05:48,869][123090] Updated weights for policy 1, policy_version 1057816 (0.0010) [2023-12-26 08:05:49,046][123091] Updated weights for policy 0, policy_version 1065139 (0.0009) [2023-12-26 08:05:49,112][123091] Updated weights for policy 0, policy_version 1065149 (0.0010) [2023-12-26 08:05:49,159][123091] Updated weights for policy 0, policy_version 1065159 (0.0010) [2023-12-26 08:05:49,627][123090] Updated weights for policy 1, policy_version 1057826 (0.0010) [2023-12-26 08:05:49,697][123090] Updated weights for policy 1, policy_version 1057836 (0.0006) [2023-12-26 08:05:49,767][123090] Updated weights for policy 1, policy_version 1057846 (0.0006) [2023-12-26 08:05:49,838][123090] Updated weights for policy 1, policy_version 1057856 (0.0011) [2023-12-26 08:05:49,892][123091] Updated weights for policy 0, policy_version 1065169 (0.0010) [2023-12-26 08:05:49,960][123091] Updated weights for policy 0, policy_version 1065179 (0.0009) [2023-12-26 08:05:50,024][123091] Updated weights for policy 0, policy_version 1065189 (0.0007) [2023-12-26 08:05:50,091][123091] Updated weights for policy 0, policy_version 1065199 (0.0011) [2023-12-26 08:05:50,532][123090] Updated weights for policy 1, policy_version 1057866 (0.0005) [2023-12-26 08:05:50,604][123090] Updated weights for policy 1, policy_version 1057876 (0.0007) [2023-12-26 08:05:50,673][123090] Updated weights for policy 1, policy_version 1057886 (0.0005) [2023-12-26 08:05:50,838][123091] Updated weights for policy 0, policy_version 1065209 (0.0011) [2023-12-26 08:05:50,901][123091] Updated weights for policy 0, policy_version 1065219 (0.0010) [2023-12-26 08:05:50,953][123091] Updated weights for policy 0, policy_version 1065229 (0.0010) [2023-12-26 08:05:51,439][123090] Updated weights for policy 1, policy_version 1057896 (0.0007) [2023-12-26 08:05:51,507][123090] Updated weights for policy 1, policy_version 1057906 (0.0006) [2023-12-26 08:05:51,584][123090] Updated weights for policy 1, policy_version 1057916 (0.0008) [2023-12-26 08:05:51,809][123091] Updated weights for policy 0, policy_version 1065239 (0.0010) [2023-12-26 08:05:51,871][123091] Updated weights for policy 0, policy_version 1065249 (0.0009) [2023-12-26 08:05:51,923][123091] Updated weights for policy 0, policy_version 1065259 (0.0009) [2023-12-26 08:05:52,390][123090] Updated weights for policy 1, policy_version 1057926 (0.0009) [2023-12-26 08:05:52,452][123090] Updated weights for policy 1, policy_version 1057936 (0.0009) [2023-12-26 08:05:52,512][123090] Updated weights for policy 1, policy_version 1057946 (0.0010) [2023-12-26 08:05:52,768][123091] Updated weights for policy 0, policy_version 1065269 (0.0010) [2023-12-26 08:05:52,839][123091] Updated weights for policy 0, policy_version 1065279 (0.0010) [2023-12-26 08:05:52,903][123091] Updated weights for policy 0, policy_version 1065289 (0.0009) [2023-12-26 08:05:53,280][123090] Updated weights for policy 1, policy_version 1057956 (0.0009) [2023-12-26 08:05:53,328][123090] Updated weights for policy 1, policy_version 1057966 (0.0009) [2023-12-26 08:05:53,377][123090] Updated weights for policy 1, policy_version 1057976 (0.0009) [2023-12-26 08:05:53,726][123091] Updated weights for policy 0, policy_version 1065299 (0.0008) [2023-12-26 08:05:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 543563776. Throughput: 0: 8843.4, 1: 8869.2. Samples: 543542760. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:53,785][121949] Avg episode reward: [(0, '6241.402'), (1, '5650.993')] [2023-12-26 08:05:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001057984_270843904.pth... [2023-12-26 08:05:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001056960_270581760.pth [2023-12-26 08:05:53,794][123091] Updated weights for policy 0, policy_version 1065309 (0.0006) [2023-12-26 08:05:53,857][123091] Updated weights for policy 0, policy_version 1065319 (0.0005) [2023-12-26 08:05:53,915][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001065328_272728064.pth... [2023-12-26 08:05:53,920][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001064272_272457728.pth [2023-12-26 08:05:54,094][123090] Updated weights for policy 1, policy_version 1057986 (0.0008) [2023-12-26 08:05:54,159][123090] Updated weights for policy 1, policy_version 1057996 (0.0009) [2023-12-26 08:05:54,224][123090] Updated weights for policy 1, policy_version 1058006 (0.0008) [2023-12-26 08:05:54,289][123090] Updated weights for policy 1, policy_version 1058016 (0.0008) [2023-12-26 08:05:54,583][123091] Updated weights for policy 0, policy_version 1065329 (0.0006) [2023-12-26 08:05:54,639][123091] Updated weights for policy 0, policy_version 1065339 (0.0010) [2023-12-26 08:05:54,700][123091] Updated weights for policy 0, policy_version 1065349 (0.0009) [2023-12-26 08:05:54,759][123091] Updated weights for policy 0, policy_version 1065360 (0.0010) [2023-12-26 08:05:55,007][123090] Updated weights for policy 1, policy_version 1058026 (0.0009) [2023-12-26 08:05:55,059][123090] Updated weights for policy 1, policy_version 1058036 (0.0005) [2023-12-26 08:05:55,114][123090] Updated weights for policy 1, policy_version 1058046 (0.0005) [2023-12-26 08:05:55,626][123091] Updated weights for policy 0, policy_version 1065370 (0.0009) [2023-12-26 08:05:55,680][123091] Updated weights for policy 0, policy_version 1065381 (0.0010) [2023-12-26 08:05:55,734][123091] Updated weights for policy 0, policy_version 1065392 (0.0010) [2023-12-26 08:05:55,845][123090] Updated weights for policy 1, policy_version 1058056 (0.0005) [2023-12-26 08:05:55,898][123090] Updated weights for policy 1, policy_version 1058066 (0.0007) [2023-12-26 08:05:55,945][123090] Updated weights for policy 1, policy_version 1058076 (0.0009) [2023-12-26 08:05:56,665][123090] Updated weights for policy 1, policy_version 1058086 (0.0007) [2023-12-26 08:05:56,669][123091] Updated weights for policy 0, policy_version 1065402 (0.0009) [2023-12-26 08:05:56,713][123090] Updated weights for policy 1, policy_version 1058096 (0.0005) [2023-12-26 08:05:56,727][123091] Updated weights for policy 0, policy_version 1065412 (0.0009) [2023-12-26 08:05:56,762][123090] Updated weights for policy 1, policy_version 1058106 (0.0005) [2023-12-26 08:05:56,777][123091] Updated weights for policy 0, policy_version 1065422 (0.0008) [2023-12-26 08:05:57,435][123090] Updated weights for policy 1, policy_version 1058116 (0.0005) [2023-12-26 08:05:57,481][123090] Updated weights for policy 1, policy_version 1058126 (0.0005) [2023-12-26 08:05:57,529][123090] Updated weights for policy 1, policy_version 1058136 (0.0005) [2023-12-26 08:05:57,557][123091] Updated weights for policy 0, policy_version 1065432 (0.0009) [2023-12-26 08:05:57,617][123091] Updated weights for policy 0, policy_version 1065442 (0.0008) [2023-12-26 08:05:57,676][123091] Updated weights for policy 0, policy_version 1065452 (0.0008) [2023-12-26 08:05:58,248][123090] Updated weights for policy 1, policy_version 1058146 (0.0007) [2023-12-26 08:05:58,304][123090] Updated weights for policy 1, policy_version 1058156 (0.0008) [2023-12-26 08:05:58,389][123090] Updated weights for policy 1, policy_version 1058168 (0.0009) [2023-12-26 08:05:58,555][123091] Updated weights for policy 0, policy_version 1065462 (0.0007) [2023-12-26 08:05:58,619][123091] Updated weights for policy 0, policy_version 1065472 (0.0009) [2023-12-26 08:05:58,689][123091] Updated weights for policy 0, policy_version 1065482 (0.0009) [2023-12-26 08:05:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 543662080. Throughput: 0: 8848.9, 1: 8984.0. Samples: 543652104. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:05:58,785][121949] Avg episode reward: [(0, '6169.110'), (1, '5784.750')] [2023-12-26 08:05:59,367][123090] Updated weights for policy 1, policy_version 1058178 (0.0008) [2023-12-26 08:05:59,424][123090] Updated weights for policy 1, policy_version 1058188 (0.0009) [2023-12-26 08:05:59,488][123090] Updated weights for policy 1, policy_version 1058198 (0.0009) [2023-12-26 08:05:59,514][123091] Updated weights for policy 0, policy_version 1065492 (0.0007) [2023-12-26 08:05:59,548][123090] Updated weights for policy 1, policy_version 1058208 (0.0009) [2023-12-26 08:05:59,576][123091] Updated weights for policy 0, policy_version 1065502 (0.0009) [2023-12-26 08:05:59,641][123091] Updated weights for policy 0, policy_version 1065512 (0.0009) [2023-12-26 08:06:00,376][123090] Updated weights for policy 1, policy_version 1058218 (0.0005) [2023-12-26 08:06:00,442][123090] Updated weights for policy 1, policy_version 1058228 (0.0005) [2023-12-26 08:06:00,492][123091] Updated weights for policy 0, policy_version 1065522 (0.0009) [2023-12-26 08:06:00,510][123090] Updated weights for policy 1, policy_version 1058238 (0.0005) [2023-12-26 08:06:00,552][123091] Updated weights for policy 0, policy_version 1065532 (0.0009) [2023-12-26 08:06:00,620][123091] Updated weights for policy 0, policy_version 1065542 (0.0010) [2023-12-26 08:06:00,685][123091] Updated weights for policy 0, policy_version 1065552 (0.0010) [2023-12-26 08:06:01,169][123090] Updated weights for policy 1, policy_version 1058248 (0.0008) [2023-12-26 08:06:01,232][123090] Updated weights for policy 1, policy_version 1058258 (0.0006) [2023-12-26 08:06:01,295][123090] Updated weights for policy 1, policy_version 1058268 (0.0006) [2023-12-26 08:06:01,467][123091] Updated weights for policy 0, policy_version 1065562 (0.0010) [2023-12-26 08:06:01,524][123091] Updated weights for policy 0, policy_version 1065572 (0.0010) [2023-12-26 08:06:01,578][123091] Updated weights for policy 0, policy_version 1065582 (0.0010) [2023-12-26 08:06:02,067][123090] Updated weights for policy 1, policy_version 1058278 (0.0007) [2023-12-26 08:06:02,136][123090] Updated weights for policy 1, policy_version 1058288 (0.0009) [2023-12-26 08:06:02,195][123090] Updated weights for policy 1, policy_version 1058298 (0.0009) [2023-12-26 08:06:02,442][123091] Updated weights for policy 0, policy_version 1065592 (0.0011) [2023-12-26 08:06:02,508][123091] Updated weights for policy 0, policy_version 1065602 (0.0011) [2023-12-26 08:06:02,570][123091] Updated weights for policy 0, policy_version 1065612 (0.0011) [2023-12-26 08:06:03,042][123090] Updated weights for policy 1, policy_version 1058308 (0.0009) [2023-12-26 08:06:03,090][123090] Updated weights for policy 1, policy_version 1058318 (0.0008) [2023-12-26 08:06:03,144][123090] Updated weights for policy 1, policy_version 1058328 (0.0008) [2023-12-26 08:06:03,387][123091] Updated weights for policy 0, policy_version 1065622 (0.0010) [2023-12-26 08:06:03,434][123091] Updated weights for policy 0, policy_version 1065632 (0.0010) [2023-12-26 08:06:03,489][123091] Updated weights for policy 0, policy_version 1065642 (0.0010) [2023-12-26 08:06:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 543744000. Throughput: 0: 8756.5, 1: 8926.0. Samples: 543754728. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:03,784][121949] Avg episode reward: [(0, '6164.734'), (1, '5857.199')] [2023-12-26 08:06:03,988][123090] Updated weights for policy 1, policy_version 1058338 (0.0009) [2023-12-26 08:06:04,054][123090] Updated weights for policy 1, policy_version 1058348 (0.0009) [2023-12-26 08:06:04,118][123090] Updated weights for policy 1, policy_version 1058358 (0.0009) [2023-12-26 08:06:04,188][123090] Updated weights for policy 1, policy_version 1058368 (0.0009) [2023-12-26 08:06:04,336][123091] Updated weights for policy 0, policy_version 1065652 (0.0011) [2023-12-26 08:06:04,392][123091] Updated weights for policy 0, policy_version 1065662 (0.0011) [2023-12-26 08:06:04,455][123091] Updated weights for policy 0, policy_version 1065672 (0.0011) [2023-12-26 08:06:05,030][123090] Updated weights for policy 1, policy_version 1058378 (0.0009) [2023-12-26 08:06:05,093][123090] Updated weights for policy 1, policy_version 1058388 (0.0008) [2023-12-26 08:06:05,153][123090] Updated weights for policy 1, policy_version 1058398 (0.0009) [2023-12-26 08:06:05,288][123091] Updated weights for policy 0, policy_version 1065682 (0.0011) [2023-12-26 08:06:05,347][123091] Updated weights for policy 0, policy_version 1065692 (0.0011) [2023-12-26 08:06:05,402][123091] Updated weights for policy 0, policy_version 1065702 (0.0010) [2023-12-26 08:06:05,449][123091] Updated weights for policy 0, policy_version 1065712 (0.0010) [2023-12-26 08:06:05,994][123090] Updated weights for policy 1, policy_version 1058408 (0.0009) [2023-12-26 08:06:06,053][123090] Updated weights for policy 1, policy_version 1058418 (0.0008) [2023-12-26 08:06:06,115][123090] Updated weights for policy 1, policy_version 1058428 (0.0008) [2023-12-26 08:06:06,289][123091] Updated weights for policy 0, policy_version 1065722 (0.0010) [2023-12-26 08:06:06,345][123091] Updated weights for policy 0, policy_version 1065732 (0.0010) [2023-12-26 08:06:06,398][123091] Updated weights for policy 0, policy_version 1065742 (0.0010) [2023-12-26 08:06:06,926][123090] Updated weights for policy 1, policy_version 1058438 (0.0008) [2023-12-26 08:06:06,990][123090] Updated weights for policy 1, policy_version 1058448 (0.0010) [2023-12-26 08:06:07,060][123090] Updated weights for policy 1, policy_version 1058458 (0.0009) [2023-12-26 08:06:07,290][123091] Updated weights for policy 0, policy_version 1065752 (0.0006) [2023-12-26 08:06:07,346][123091] Updated weights for policy 0, policy_version 1065762 (0.0006) [2023-12-26 08:06:07,405][123091] Updated weights for policy 0, policy_version 1065772 (0.0005) [2023-12-26 08:06:07,977][123090] Updated weights for policy 1, policy_version 1058468 (0.0009) [2023-12-26 08:06:08,033][123091] Updated weights for policy 0, policy_version 1065782 (0.0007) [2023-12-26 08:06:08,044][123090] Updated weights for policy 1, policy_version 1058478 (0.0008) [2023-12-26 08:06:08,094][123091] Updated weights for policy 0, policy_version 1065792 (0.0009) [2023-12-26 08:06:08,106][123090] Updated weights for policy 1, policy_version 1058488 (0.0007) [2023-12-26 08:06:08,151][123091] Updated weights for policy 0, policy_version 1065802 (0.0008) [2023-12-26 08:06:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 543825920. Throughput: 0: 8784.5, 1: 8889.7. Samples: 543805316. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:08,785][121949] Avg episode reward: [(0, '6226.840'), (1, '5912.206')] [2023-12-26 08:06:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001065808_272850944.pth... [2023-12-26 08:06:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001064816_272596992.pth [2023-12-26 08:06:08,802][123090] Updated weights for policy 1, policy_version 1058498 (0.0008) [2023-12-26 08:06:08,869][123090] Updated weights for policy 1, policy_version 1058509 (0.0009) [2023-12-26 08:06:08,917][123090] Updated weights for policy 1, policy_version 1058519 (0.0009) [2023-12-26 08:06:08,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001058528_270983168.pth... [2023-12-26 08:06:08,962][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001057472_270712832.pth [2023-12-26 08:06:09,003][123091] Updated weights for policy 0, policy_version 1065812 (0.0010) [2023-12-26 08:06:09,065][123091] Updated weights for policy 0, policy_version 1065822 (0.0010) [2023-12-26 08:06:09,120][123091] Updated weights for policy 0, policy_version 1065832 (0.0010) [2023-12-26 08:06:09,797][123090] Updated weights for policy 1, policy_version 1058529 (0.0009) [2023-12-26 08:06:09,866][123090] Updated weights for policy 1, policy_version 1058539 (0.0010) [2023-12-26 08:06:09,941][123090] Updated weights for policy 1, policy_version 1058549 (0.0009) [2023-12-26 08:06:09,959][123091] Updated weights for policy 0, policy_version 1065842 (0.0010) [2023-12-26 08:06:10,003][123090] Updated weights for policy 1, policy_version 1058559 (0.0008) [2023-12-26 08:06:10,023][123091] Updated weights for policy 0, policy_version 1065852 (0.0008) [2023-12-26 08:06:10,081][123091] Updated weights for policy 0, policy_version 1065862 (0.0010) [2023-12-26 08:06:10,136][123091] Updated weights for policy 0, policy_version 1065872 (0.0007) [2023-12-26 08:06:10,894][123090] Updated weights for policy 1, policy_version 1058569 (0.0009) [2023-12-26 08:06:10,952][123090] Updated weights for policy 1, policy_version 1058579 (0.0010) [2023-12-26 08:06:10,994][123091] Updated weights for policy 0, policy_version 1065882 (0.0007) [2023-12-26 08:06:11,017][123090] Updated weights for policy 1, policy_version 1058589 (0.0007) [2023-12-26 08:06:11,057][123091] Updated weights for policy 0, policy_version 1065892 (0.0009) [2023-12-26 08:06:11,133][123091] Updated weights for policy 0, policy_version 1065902 (0.0009) [2023-12-26 08:06:11,917][123090] Updated weights for policy 1, policy_version 1058599 (0.0009) [2023-12-26 08:06:11,973][123091] Updated weights for policy 0, policy_version 1065912 (0.0007) [2023-12-26 08:06:11,982][123090] Updated weights for policy 1, policy_version 1058609 (0.0008) [2023-12-26 08:06:12,030][123091] Updated weights for policy 0, policy_version 1065922 (0.0007) [2023-12-26 08:06:12,049][123090] Updated weights for policy 1, policy_version 1058619 (0.0009) [2023-12-26 08:06:12,092][123091] Updated weights for policy 0, policy_version 1065932 (0.0008) [2023-12-26 08:06:12,775][123090] Updated weights for policy 1, policy_version 1058629 (0.0007) [2023-12-26 08:06:12,841][123090] Updated weights for policy 1, policy_version 1058639 (0.0005) [2023-12-26 08:06:12,923][123090] Updated weights for policy 1, policy_version 1058649 (0.0006) [2023-12-26 08:06:12,951][123091] Updated weights for policy 0, policy_version 1065942 (0.0009) [2023-12-26 08:06:13,014][123091] Updated weights for policy 0, policy_version 1065952 (0.0008) [2023-12-26 08:06:13,074][123091] Updated weights for policy 0, policy_version 1065962 (0.0009) [2023-12-26 08:06:13,720][123090] Updated weights for policy 1, policy_version 1058659 (0.0008) [2023-12-26 08:06:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 543907840. Throughput: 0: 8756.2, 1: 8834.9. Samples: 543907784. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:13,785][121949] Avg episode reward: [(0, '6238.609'), (1, '5776.464')] [2023-12-26 08:06:13,789][123090] Updated weights for policy 1, policy_version 1058669 (0.0010) [2023-12-26 08:06:13,825][123091] Updated weights for policy 0, policy_version 1065972 (0.0008) [2023-12-26 08:06:13,855][123090] Updated weights for policy 1, policy_version 1058679 (0.0008) [2023-12-26 08:06:13,879][123091] Updated weights for policy 0, policy_version 1065982 (0.0006) [2023-12-26 08:06:13,927][123091] Updated weights for policy 0, policy_version 1065992 (0.0009) [2023-12-26 08:06:14,674][123091] Updated weights for policy 0, policy_version 1066003 (0.0010) [2023-12-26 08:06:14,680][123090] Updated weights for policy 1, policy_version 1058689 (0.0009) [2023-12-26 08:06:14,735][123091] Updated weights for policy 0, policy_version 1066013 (0.0008) [2023-12-26 08:06:14,738][123090] Updated weights for policy 1, policy_version 1058699 (0.0009) [2023-12-26 08:06:14,805][123091] Updated weights for policy 0, policy_version 1066023 (0.0009) [2023-12-26 08:06:14,808][123090] Updated weights for policy 1, policy_version 1058709 (0.0008) [2023-12-26 08:06:14,868][123090] Updated weights for policy 1, policy_version 1058719 (0.0010) [2023-12-26 08:06:15,535][123091] Updated weights for policy 0, policy_version 1066033 (0.0006) [2023-12-26 08:06:15,597][123091] Updated weights for policy 0, policy_version 1066043 (0.0010) [2023-12-26 08:06:15,659][123091] Updated weights for policy 0, policy_version 1066053 (0.0010) [2023-12-26 08:06:15,721][123091] Updated weights for policy 0, policy_version 1066064 (0.0010) [2023-12-26 08:06:15,752][123090] Updated weights for policy 1, policy_version 1058729 (0.0008) [2023-12-26 08:06:15,804][123090] Updated weights for policy 1, policy_version 1058739 (0.0010) [2023-12-26 08:06:15,869][123090] Updated weights for policy 1, policy_version 1058749 (0.0010) [2023-12-26 08:06:16,550][123091] Updated weights for policy 0, policy_version 1066074 (0.0010) [2023-12-26 08:06:16,604][123091] Updated weights for policy 0, policy_version 1066084 (0.0009) [2023-12-26 08:06:16,657][123091] Updated weights for policy 0, policy_version 1066095 (0.0009) [2023-12-26 08:06:16,710][123090] Updated weights for policy 1, policy_version 1058759 (0.0010) [2023-12-26 08:06:16,772][123090] Updated weights for policy 1, policy_version 1058769 (0.0009) [2023-12-26 08:06:16,834][123090] Updated weights for policy 1, policy_version 1058779 (0.0008) [2023-12-26 08:06:17,509][123091] Updated weights for policy 0, policy_version 1066105 (0.0009) [2023-12-26 08:06:17,566][123091] Updated weights for policy 0, policy_version 1066115 (0.0009) [2023-12-26 08:06:17,618][123091] Updated weights for policy 0, policy_version 1066125 (0.0009) [2023-12-26 08:06:17,653][123090] Updated weights for policy 1, policy_version 1058789 (0.0010) [2023-12-26 08:06:17,701][123090] Updated weights for policy 1, policy_version 1058799 (0.0010) [2023-12-26 08:06:17,748][123090] Updated weights for policy 1, policy_version 1058809 (0.0010) [2023-12-26 08:06:18,451][123091] Updated weights for policy 0, policy_version 1066135 (0.0007) [2023-12-26 08:06:18,513][123091] Updated weights for policy 0, policy_version 1066145 (0.0008) [2023-12-26 08:06:18,585][123091] Updated weights for policy 0, policy_version 1066155 (0.0007) [2023-12-26 08:06:18,597][123090] Updated weights for policy 1, policy_version 1058819 (0.0010) [2023-12-26 08:06:18,653][123090] Updated weights for policy 1, policy_version 1058829 (0.0011) [2023-12-26 08:06:18,720][123090] Updated weights for policy 1, policy_version 1058839 (0.0011) [2023-12-26 08:06:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 544006144. Throughput: 0: 8750.3, 1: 8807.6. Samples: 544011936. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:18,784][121949] Avg episode reward: [(0, '6231.207'), (1, '5726.895')] [2023-12-26 08:06:19,421][123091] Updated weights for policy 0, policy_version 1066165 (0.0008) [2023-12-26 08:06:19,423][123090] Updated weights for policy 1, policy_version 1058849 (0.0010) [2023-12-26 08:06:19,478][123091] Updated weights for policy 0, policy_version 1066175 (0.0009) [2023-12-26 08:06:19,486][123090] Updated weights for policy 1, policy_version 1058859 (0.0006) [2023-12-26 08:06:19,546][123091] Updated weights for policy 0, policy_version 1066185 (0.0009) [2023-12-26 08:06:19,558][123090] Updated weights for policy 1, policy_version 1058869 (0.0007) [2023-12-26 08:06:19,629][123090] Updated weights for policy 1, policy_version 1058879 (0.0007) [2023-12-26 08:06:20,319][123090] Updated weights for policy 1, policy_version 1058889 (0.0006) [2023-12-26 08:06:20,377][123090] Updated weights for policy 1, policy_version 1058899 (0.0008) [2023-12-26 08:06:20,434][123090] Updated weights for policy 1, policy_version 1058909 (0.0005) [2023-12-26 08:06:20,470][123091] Updated weights for policy 0, policy_version 1066195 (0.0009) [2023-12-26 08:06:20,524][123091] Updated weights for policy 0, policy_version 1066205 (0.0010) [2023-12-26 08:06:20,592][123091] Updated weights for policy 0, policy_version 1066215 (0.0008) [2023-12-26 08:06:21,233][123090] Updated weights for policy 1, policy_version 1058919 (0.0009) [2023-12-26 08:06:21,303][123090] Updated weights for policy 1, policy_version 1058929 (0.0011) [2023-12-26 08:06:21,364][123090] Updated weights for policy 1, policy_version 1058939 (0.0009) [2023-12-26 08:06:21,458][123091] Updated weights for policy 0, policy_version 1066225 (0.0008) [2023-12-26 08:06:21,518][123091] Updated weights for policy 0, policy_version 1066235 (0.0009) [2023-12-26 08:06:21,581][123091] Updated weights for policy 0, policy_version 1066245 (0.0008) [2023-12-26 08:06:21,648][123091] Updated weights for policy 0, policy_version 1066255 (0.0008) [2023-12-26 08:06:22,167][123090] Updated weights for policy 1, policy_version 1058949 (0.0009) [2023-12-26 08:06:22,239][123090] Updated weights for policy 1, policy_version 1058959 (0.0011) [2023-12-26 08:06:22,312][123090] Updated weights for policy 1, policy_version 1058969 (0.0008) [2023-12-26 08:06:22,506][123091] Updated weights for policy 0, policy_version 1066265 (0.0009) [2023-12-26 08:06:22,571][123091] Updated weights for policy 0, policy_version 1066275 (0.0010) [2023-12-26 08:06:22,636][123091] Updated weights for policy 0, policy_version 1066285 (0.0010) [2023-12-26 08:06:23,034][123090] Updated weights for policy 1, policy_version 1058979 (0.0008) [2023-12-26 08:06:23,086][123090] Updated weights for policy 1, policy_version 1058989 (0.0006) [2023-12-26 08:06:23,136][123090] Updated weights for policy 1, policy_version 1058999 (0.0005) [2023-12-26 08:06:23,381][123091] Updated weights for policy 0, policy_version 1066295 (0.0006) [2023-12-26 08:06:23,431][123091] Updated weights for policy 0, policy_version 1066305 (0.0005) [2023-12-26 08:06:23,479][123091] Updated weights for policy 0, policy_version 1066315 (0.0005) [2023-12-26 08:06:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 544088064. Throughput: 0: 8622.4, 1: 8829.3. Samples: 544063768. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:23,784][121949] Avg episode reward: [(0, '6200.341'), (1, '5683.706')] [2023-12-26 08:06:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001059008_271106048.pth... [2023-12-26 08:06:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001066320_272982016.pth... [2023-12-26 08:06:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001057984_270843904.pth [2023-12-26 08:06:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001065328_272728064.pth [2023-12-26 08:06:23,849][123090] Updated weights for policy 1, policy_version 1059009 (0.0006) [2023-12-26 08:06:23,898][123090] Updated weights for policy 1, policy_version 1059019 (0.0010) [2023-12-26 08:06:23,953][123090] Updated weights for policy 1, policy_version 1059029 (0.0010) [2023-12-26 08:06:24,010][123090] Updated weights for policy 1, policy_version 1059039 (0.0007) [2023-12-26 08:06:24,175][123091] Updated weights for policy 0, policy_version 1066325 (0.0005) [2023-12-26 08:06:24,237][123091] Updated weights for policy 0, policy_version 1066335 (0.0005) [2023-12-26 08:06:24,287][123091] Updated weights for policy 0, policy_version 1066345 (0.0006) [2023-12-26 08:06:24,767][123090] Updated weights for policy 1, policy_version 1059049 (0.0010) [2023-12-26 08:06:24,818][123090] Updated weights for policy 1, policy_version 1059059 (0.0010) [2023-12-26 08:06:24,866][123090] Updated weights for policy 1, policy_version 1059069 (0.0010) [2023-12-26 08:06:24,958][123091] Updated weights for policy 0, policy_version 1066355 (0.0006) [2023-12-26 08:06:25,014][123091] Updated weights for policy 0, policy_version 1066365 (0.0009) [2023-12-26 08:06:25,065][123091] Updated weights for policy 0, policy_version 1066375 (0.0009) [2023-12-26 08:06:25,704][123090] Updated weights for policy 1, policy_version 1059079 (0.0010) [2023-12-26 08:06:25,767][123090] Updated weights for policy 1, policy_version 1059089 (0.0010) [2023-12-26 08:06:25,829][123090] Updated weights for policy 1, policy_version 1059099 (0.0009) [2023-12-26 08:06:25,854][123091] Updated weights for policy 0, policy_version 1066385 (0.0009) [2023-12-26 08:06:25,908][123091] Updated weights for policy 0, policy_version 1066395 (0.0005) [2023-12-26 08:06:25,972][123091] Updated weights for policy 0, policy_version 1066405 (0.0006) [2023-12-26 08:06:26,036][123091] Updated weights for policy 0, policy_version 1066415 (0.0009) [2023-12-26 08:06:26,601][123090] Updated weights for policy 1, policy_version 1059109 (0.0010) [2023-12-26 08:06:26,649][123090] Updated weights for policy 1, policy_version 1059119 (0.0010) [2023-12-26 08:06:26,705][123090] Updated weights for policy 1, policy_version 1059129 (0.0010) [2023-12-26 08:06:26,794][123091] Updated weights for policy 0, policy_version 1066425 (0.0008) [2023-12-26 08:06:26,848][123091] Updated weights for policy 0, policy_version 1066435 (0.0009) [2023-12-26 08:06:26,896][123091] Updated weights for policy 0, policy_version 1066445 (0.0009) [2023-12-26 08:06:27,434][123090] Updated weights for policy 1, policy_version 1059139 (0.0009) [2023-12-26 08:06:27,491][123090] Updated weights for policy 1, policy_version 1059149 (0.0005) [2023-12-26 08:06:27,541][123090] Updated weights for policy 1, policy_version 1059159 (0.0008) [2023-12-26 08:06:27,767][123091] Updated weights for policy 0, policy_version 1066455 (0.0006) [2023-12-26 08:06:27,816][123091] Updated weights for policy 0, policy_version 1066465 (0.0005) [2023-12-26 08:06:27,858][123091] Updated weights for policy 0, policy_version 1066475 (0.0005) [2023-12-26 08:06:28,447][123090] Updated weights for policy 1, policy_version 1059169 (0.0009) [2023-12-26 08:06:28,515][123090] Updated weights for policy 1, policy_version 1059179 (0.0008) [2023-12-26 08:06:28,555][123091] Updated weights for policy 0, policy_version 1066485 (0.0006) [2023-12-26 08:06:28,577][123090] Updated weights for policy 1, policy_version 1059189 (0.0009) [2023-12-26 08:06:28,614][123091] Updated weights for policy 0, policy_version 1066495 (0.0005) [2023-12-26 08:06:28,635][123090] Updated weights for policy 1, policy_version 1059200 (0.0009) [2023-12-26 08:06:28,674][123091] Updated weights for policy 0, policy_version 1066505 (0.0007) [2023-12-26 08:06:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 544186368. Throughput: 0: 8663.3, 1: 8966.7. Samples: 544174528. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:28,785][121949] Avg episode reward: [(0, '6245.145'), (1, '5562.123')] [2023-12-26 08:06:29,368][123091] Updated weights for policy 0, policy_version 1066515 (0.0009) [2023-12-26 08:06:29,414][123091] Updated weights for policy 0, policy_version 1066525 (0.0008) [2023-12-26 08:06:29,469][123091] Updated weights for policy 0, policy_version 1066535 (0.0008) [2023-12-26 08:06:29,489][123090] Updated weights for policy 1, policy_version 1059210 (0.0008) [2023-12-26 08:06:29,551][123090] Updated weights for policy 1, policy_version 1059220 (0.0008) [2023-12-26 08:06:29,616][123090] Updated weights for policy 1, policy_version 1059230 (0.0010) [2023-12-26 08:06:30,270][123091] Updated weights for policy 0, policy_version 1066545 (0.0009) [2023-12-26 08:06:30,339][123091] Updated weights for policy 0, policy_version 1066555 (0.0005) [2023-12-26 08:06:30,395][123091] Updated weights for policy 0, policy_version 1066565 (0.0006) [2023-12-26 08:06:30,450][123091] Updated weights for policy 0, policy_version 1066575 (0.0010) [2023-12-26 08:06:30,479][123090] Updated weights for policy 1, policy_version 1059240 (0.0007) [2023-12-26 08:06:30,542][123090] Updated weights for policy 1, policy_version 1059250 (0.0009) [2023-12-26 08:06:30,589][123090] Updated weights for policy 1, policy_version 1059260 (0.0009) [2023-12-26 08:06:31,070][123091] Updated weights for policy 0, policy_version 1066585 (0.0010) [2023-12-26 08:06:31,139][123091] Updated weights for policy 0, policy_version 1066596 (0.0010) [2023-12-26 08:06:31,209][123091] Updated weights for policy 0, policy_version 1066606 (0.0007) [2023-12-26 08:06:31,501][123090] Updated weights for policy 1, policy_version 1059270 (0.0009) [2023-12-26 08:06:31,554][123090] Updated weights for policy 1, policy_version 1059280 (0.0010) [2023-12-26 08:06:31,615][123090] Updated weights for policy 1, policy_version 1059290 (0.0010) [2023-12-26 08:06:31,998][123091] Updated weights for policy 0, policy_version 1066616 (0.0009) [2023-12-26 08:06:32,070][123091] Updated weights for policy 0, policy_version 1066626 (0.0009) [2023-12-26 08:06:32,141][123091] Updated weights for policy 0, policy_version 1066636 (0.0007) [2023-12-26 08:06:32,476][123090] Updated weights for policy 1, policy_version 1059300 (0.0007) [2023-12-26 08:06:32,543][123090] Updated weights for policy 1, policy_version 1059310 (0.0009) [2023-12-26 08:06:32,606][123090] Updated weights for policy 1, policy_version 1059320 (0.0009) [2023-12-26 08:06:32,927][123091] Updated weights for policy 0, policy_version 1066646 (0.0007) [2023-12-26 08:06:32,980][123091] Updated weights for policy 0, policy_version 1066656 (0.0005) [2023-12-26 08:06:33,033][123091] Updated weights for policy 0, policy_version 1066666 (0.0008) [2023-12-26 08:06:33,426][123090] Updated weights for policy 1, policy_version 1059330 (0.0009) [2023-12-26 08:06:33,513][123090] Updated weights for policy 1, policy_version 1059340 (0.0009) [2023-12-26 08:06:33,567][123090] Updated weights for policy 1, policy_version 1059352 (0.0010) [2023-12-26 08:06:33,774][123091] Updated weights for policy 0, policy_version 1066676 (0.0009) [2023-12-26 08:06:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 544268288. Throughput: 0: 8792.2, 1: 8806.1. Samples: 544280236. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:33,784][121949] Avg episode reward: [(0, '6287.330'), (1, '5657.178')] [2023-12-26 08:06:33,841][123091] Updated weights for policy 0, policy_version 1066686 (0.0009) [2023-12-26 08:06:33,899][123091] Updated weights for policy 0, policy_version 1066697 (0.0009) [2023-12-26 08:06:34,438][123090] Updated weights for policy 1, policy_version 1059363 (0.0010) [2023-12-26 08:06:34,502][123090] Updated weights for policy 1, policy_version 1059373 (0.0010) [2023-12-26 08:06:34,564][123090] Updated weights for policy 1, policy_version 1059383 (0.0009) [2023-12-26 08:06:34,689][123091] Updated weights for policy 0, policy_version 1066707 (0.0009) [2023-12-26 08:06:34,759][123091] Updated weights for policy 0, policy_version 1066717 (0.0009) [2023-12-26 08:06:34,824][123091] Updated weights for policy 0, policy_version 1066727 (0.0011) [2023-12-26 08:06:35,323][123090] Updated weights for policy 1, policy_version 1059393 (0.0009) [2023-12-26 08:06:35,381][123090] Updated weights for policy 1, policy_version 1059403 (0.0010) [2023-12-26 08:06:35,440][123090] Updated weights for policy 1, policy_version 1059413 (0.0010) [2023-12-26 08:06:35,499][123090] Updated weights for policy 1, policy_version 1059423 (0.0009) [2023-12-26 08:06:35,502][123091] Updated weights for policy 0, policy_version 1066737 (0.0010) [2023-12-26 08:06:35,573][123091] Updated weights for policy 0, policy_version 1066747 (0.0008) [2023-12-26 08:06:35,632][123091] Updated weights for policy 0, policy_version 1066757 (0.0009) [2023-12-26 08:06:35,698][123091] Updated weights for policy 0, policy_version 1066767 (0.0010) [2023-12-26 08:06:36,321][123090] Updated weights for policy 1, policy_version 1059433 (0.0009) [2023-12-26 08:06:36,385][123090] Updated weights for policy 1, policy_version 1059443 (0.0009) [2023-12-26 08:06:36,453][123090] Updated weights for policy 1, policy_version 1059453 (0.0009) [2023-12-26 08:06:36,515][123091] Updated weights for policy 0, policy_version 1066777 (0.0009) [2023-12-26 08:06:36,583][123091] Updated weights for policy 0, policy_version 1066787 (0.0008) [2023-12-26 08:06:36,651][123091] Updated weights for policy 0, policy_version 1066797 (0.0009) [2023-12-26 08:06:37,156][123090] Updated weights for policy 1, policy_version 1059463 (0.0008) [2023-12-26 08:06:37,221][123090] Updated weights for policy 1, policy_version 1059473 (0.0008) [2023-12-26 08:06:37,289][123090] Updated weights for policy 1, policy_version 1059483 (0.0009) [2023-12-26 08:06:37,522][123091] Updated weights for policy 0, policy_version 1066807 (0.0007) [2023-12-26 08:06:37,591][123091] Updated weights for policy 0, policy_version 1066817 (0.0006) [2023-12-26 08:06:37,657][123091] Updated weights for policy 0, policy_version 1066827 (0.0005) [2023-12-26 08:06:38,089][123090] Updated weights for policy 1, policy_version 1059493 (0.0009) [2023-12-26 08:06:38,140][123090] Updated weights for policy 1, policy_version 1059503 (0.0010) [2023-12-26 08:06:38,202][123090] Updated weights for policy 1, policy_version 1059513 (0.0009) [2023-12-26 08:06:38,372][123091] Updated weights for policy 0, policy_version 1066837 (0.0008) [2023-12-26 08:06:38,430][123091] Updated weights for policy 0, policy_version 1066847 (0.0009) [2023-12-26 08:06:38,483][123091] Updated weights for policy 0, policy_version 1066857 (0.0009) [2023-12-26 08:06:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 544358400. Throughput: 0: 8796.4, 1: 8758.7. Samples: 544332744. Policy #0 lag: (min: 23.0, avg: 23.2, max: 34.0) [2023-12-26 08:06:38,785][121949] Avg episode reward: [(0, '6265.613'), (1, '5772.574')] [2023-12-26 08:06:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001059520_271237120.pth... [2023-12-26 08:06:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001066864_273121280.pth... [2023-12-26 08:06:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001058528_270983168.pth [2023-12-26 08:06:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001065808_272850944.pth [2023-12-26 08:06:39,013][123090] Updated weights for policy 1, policy_version 1059523 (0.0008) [2023-12-26 08:06:39,069][123090] Updated weights for policy 1, policy_version 1059533 (0.0008) [2023-12-26 08:06:39,122][123090] Updated weights for policy 1, policy_version 1059543 (0.0009) [2023-12-26 08:06:39,369][123091] Updated weights for policy 0, policy_version 1066867 (0.0010) [2023-12-26 08:06:39,435][123091] Updated weights for policy 0, policy_version 1066877 (0.0010) [2023-12-26 08:06:39,487][123091] Updated weights for policy 0, policy_version 1066887 (0.0009) [2023-12-26 08:06:40,007][123090] Updated weights for policy 1, policy_version 1059553 (0.0009) [2023-12-26 08:06:40,067][123090] Updated weights for policy 1, policy_version 1059563 (0.0009) [2023-12-26 08:06:40,137][123090] Updated weights for policy 1, policy_version 1059573 (0.0008) [2023-12-26 08:06:40,208][123090] Updated weights for policy 1, policy_version 1059583 (0.0005) [2023-12-26 08:06:40,319][123091] Updated weights for policy 0, policy_version 1066897 (0.0008) [2023-12-26 08:06:40,384][123091] Updated weights for policy 0, policy_version 1066907 (0.0005) [2023-12-26 08:06:40,453][123091] Updated weights for policy 0, policy_version 1066917 (0.0006) [2023-12-26 08:06:40,524][123091] Updated weights for policy 0, policy_version 1066927 (0.0006) [2023-12-26 08:06:41,012][123090] Updated weights for policy 1, policy_version 1059593 (0.0009) [2023-12-26 08:06:41,078][123090] Updated weights for policy 1, policy_version 1059603 (0.0009) [2023-12-26 08:06:41,145][123090] Updated weights for policy 1, policy_version 1059613 (0.0010) [2023-12-26 08:06:41,214][123091] Updated weights for policy 0, policy_version 1066937 (0.0009) [2023-12-26 08:06:41,280][123091] Updated weights for policy 0, policy_version 1066947 (0.0010) [2023-12-26 08:06:41,342][123091] Updated weights for policy 0, policy_version 1066957 (0.0009) [2023-12-26 08:06:42,045][123090] Updated weights for policy 1, policy_version 1059623 (0.0010) [2023-12-26 08:06:42,117][123090] Updated weights for policy 1, policy_version 1059633 (0.0010) [2023-12-26 08:06:42,173][123091] Updated weights for policy 0, policy_version 1066967 (0.0009) [2023-12-26 08:06:42,187][123090] Updated weights for policy 1, policy_version 1059643 (0.0009) [2023-12-26 08:06:42,238][123091] Updated weights for policy 0, policy_version 1066977 (0.0008) [2023-12-26 08:06:42,300][123091] Updated weights for policy 0, policy_version 1066987 (0.0011) [2023-12-26 08:06:43,043][123090] Updated weights for policy 1, policy_version 1059653 (0.0010) [2023-12-26 08:06:43,102][123090] Updated weights for policy 1, policy_version 1059663 (0.0010) [2023-12-26 08:06:43,127][123091] Updated weights for policy 0, policy_version 1066997 (0.0008) [2023-12-26 08:06:43,162][123090] Updated weights for policy 1, policy_version 1059673 (0.0009) [2023-12-26 08:06:43,181][123091] Updated weights for policy 0, policy_version 1067007 (0.0007) [2023-12-26 08:06:43,229][123091] Updated weights for policy 0, policy_version 1067017 (0.0009) [2023-12-26 08:06:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 544440320. Throughput: 0: 8807.5, 1: 8616.2. Samples: 544436168. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:06:43,785][121949] Avg episode reward: [(0, '6246.609'), (1, '5809.995')] [2023-12-26 08:06:43,932][123091] Updated weights for policy 0, policy_version 1067027 (0.0010) [2023-12-26 08:06:43,997][123091] Updated weights for policy 0, policy_version 1067037 (0.0006) [2023-12-26 08:06:44,045][123091] Updated weights for policy 0, policy_version 1067047 (0.0005) [2023-12-26 08:06:44,081][123090] Updated weights for policy 1, policy_version 1059683 (0.0009) [2023-12-26 08:06:44,139][123090] Updated weights for policy 1, policy_version 1059694 (0.0010) [2023-12-26 08:06:44,194][123090] Updated weights for policy 1, policy_version 1059705 (0.0010) [2023-12-26 08:06:44,826][123091] Updated weights for policy 0, policy_version 1067057 (0.0006) [2023-12-26 08:06:44,876][123091] Updated weights for policy 0, policy_version 1067067 (0.0009) [2023-12-26 08:06:44,936][123091] Updated weights for policy 0, policy_version 1067078 (0.0010) [2023-12-26 08:06:44,994][123091] Updated weights for policy 0, policy_version 1067088 (0.0009) [2023-12-26 08:06:45,071][123090] Updated weights for policy 1, policy_version 1059715 (0.0010) [2023-12-26 08:06:45,139][123090] Updated weights for policy 1, policy_version 1059725 (0.0010) [2023-12-26 08:06:45,208][123090] Updated weights for policy 1, policy_version 1059735 (0.0008) [2023-12-26 08:06:45,873][123091] Updated weights for policy 0, policy_version 1067098 (0.0010) [2023-12-26 08:06:45,943][123091] Updated weights for policy 0, policy_version 1067108 (0.0010) [2023-12-26 08:06:46,008][123091] Updated weights for policy 0, policy_version 1067118 (0.0010) [2023-12-26 08:06:46,041][123090] Updated weights for policy 1, policy_version 1059745 (0.0010) [2023-12-26 08:06:46,101][123090] Updated weights for policy 1, policy_version 1059755 (0.0009) [2023-12-26 08:06:46,151][123090] Updated weights for policy 1, policy_version 1059765 (0.0009) [2023-12-26 08:06:46,202][123090] Updated weights for policy 1, policy_version 1059775 (0.0009) [2023-12-26 08:06:46,809][123091] Updated weights for policy 0, policy_version 1067128 (0.0008) [2023-12-26 08:06:46,866][123091] Updated weights for policy 0, policy_version 1067138 (0.0010) [2023-12-26 08:06:46,920][123091] Updated weights for policy 0, policy_version 1067148 (0.0010) [2023-12-26 08:06:46,949][123090] Updated weights for policy 1, policy_version 1059785 (0.0007) [2023-12-26 08:06:47,000][123090] Updated weights for policy 1, policy_version 1059795 (0.0009) [2023-12-26 08:06:47,057][123090] Updated weights for policy 1, policy_version 1059805 (0.0011) [2023-12-26 08:06:47,681][123091] Updated weights for policy 0, policy_version 1067158 (0.0007) [2023-12-26 08:06:47,733][123091] Updated weights for policy 0, policy_version 1067168 (0.0005) [2023-12-26 08:06:47,784][123091] Updated weights for policy 0, policy_version 1067178 (0.0005) [2023-12-26 08:06:47,853][123090] Updated weights for policy 1, policy_version 1059815 (0.0006) [2023-12-26 08:06:47,916][123090] Updated weights for policy 1, policy_version 1059825 (0.0005) [2023-12-26 08:06:47,978][123090] Updated weights for policy 1, policy_version 1059835 (0.0006) [2023-12-26 08:06:48,466][123091] Updated weights for policy 0, policy_version 1067188 (0.0006) [2023-12-26 08:06:48,534][123091] Updated weights for policy 0, policy_version 1067198 (0.0007) [2023-12-26 08:06:48,603][123091] Updated weights for policy 0, policy_version 1067208 (0.0011) [2023-12-26 08:06:48,744][123090] Updated weights for policy 1, policy_version 1059845 (0.0010) [2023-12-26 08:06:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 544530432. Throughput: 0: 8913.0, 1: 8603.0. Samples: 544542952. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:06:48,785][121949] Avg episode reward: [(0, '6175.489'), (1, '5668.534')] [2023-12-26 08:06:48,809][123090] Updated weights for policy 1, policy_version 1059855 (0.0011) [2023-12-26 08:06:48,873][123090] Updated weights for policy 1, policy_version 1059865 (0.0011) [2023-12-26 08:06:49,381][123091] Updated weights for policy 0, policy_version 1067218 (0.0010) [2023-12-26 08:06:49,445][123091] Updated weights for policy 0, policy_version 1067228 (0.0005) [2023-12-26 08:06:49,517][123091] Updated weights for policy 0, policy_version 1067238 (0.0005) [2023-12-26 08:06:49,590][123091] Updated weights for policy 0, policy_version 1067248 (0.0005) [2023-12-26 08:06:49,671][123090] Updated weights for policy 1, policy_version 1059875 (0.0009) [2023-12-26 08:06:49,733][123090] Updated weights for policy 1, policy_version 1059885 (0.0007) [2023-12-26 08:06:49,800][123090] Updated weights for policy 1, policy_version 1059895 (0.0011) [2023-12-26 08:06:50,296][123091] Updated weights for policy 0, policy_version 1067258 (0.0006) [2023-12-26 08:06:50,367][123091] Updated weights for policy 0, policy_version 1067268 (0.0008) [2023-12-26 08:06:50,426][123091] Updated weights for policy 0, policy_version 1067278 (0.0008) [2023-12-26 08:06:50,587][123090] Updated weights for policy 1, policy_version 1059905 (0.0011) [2023-12-26 08:06:50,643][123090] Updated weights for policy 1, policy_version 1059915 (0.0009) [2023-12-26 08:06:50,698][123090] Updated weights for policy 1, policy_version 1059925 (0.0009) [2023-12-26 08:06:50,771][123090] Updated weights for policy 1, policy_version 1059935 (0.0009) [2023-12-26 08:06:51,067][123091] Updated weights for policy 0, policy_version 1067288 (0.0008) [2023-12-26 08:06:51,126][123091] Updated weights for policy 0, policy_version 1067298 (0.0010) [2023-12-26 08:06:51,196][123091] Updated weights for policy 0, policy_version 1067308 (0.0006) [2023-12-26 08:06:51,724][123090] Updated weights for policy 1, policy_version 1059945 (0.0010) [2023-12-26 08:06:51,795][123090] Updated weights for policy 1, policy_version 1059955 (0.0010) [2023-12-26 08:06:51,858][123090] Updated weights for policy 1, policy_version 1059965 (0.0010) [2023-12-26 08:06:51,908][123091] Updated weights for policy 0, policy_version 1067318 (0.0005) [2023-12-26 08:06:51,969][123091] Updated weights for policy 0, policy_version 1067328 (0.0007) [2023-12-26 08:06:52,040][123091] Updated weights for policy 0, policy_version 1067338 (0.0011) [2023-12-26 08:06:52,701][123090] Updated weights for policy 1, policy_version 1059975 (0.0006) [2023-12-26 08:06:52,782][123090] Updated weights for policy 1, policy_version 1059985 (0.0006) [2023-12-26 08:06:52,844][123090] Updated weights for policy 1, policy_version 1059995 (0.0009) [2023-12-26 08:06:52,881][123091] Updated weights for policy 0, policy_version 1067348 (0.0009) [2023-12-26 08:06:52,940][123091] Updated weights for policy 0, policy_version 1067358 (0.0010) [2023-12-26 08:06:52,996][123091] Updated weights for policy 0, policy_version 1067368 (0.0009) [2023-12-26 08:06:53,579][123090] Updated weights for policy 1, policy_version 1060005 (0.0008) [2023-12-26 08:06:53,646][123090] Updated weights for policy 1, policy_version 1060015 (0.0005) [2023-12-26 08:06:53,680][123091] Updated weights for policy 0, policy_version 1067378 (0.0009) [2023-12-26 08:06:53,713][123090] Updated weights for policy 1, policy_version 1060025 (0.0005) [2023-12-26 08:06:53,751][123091] Updated weights for policy 0, policy_version 1067388 (0.0005) [2023-12-26 08:06:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 544620544. Throughput: 0: 8981.1, 1: 8615.3. Samples: 544597152. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:06:53,785][121949] Avg episode reward: [(0, '6086.428'), (1, '5655.265')] [2023-12-26 08:06:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001060032_271368192.pth... [2023-12-26 08:06:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001059008_271106048.pth [2023-12-26 08:06:53,835][123091] Updated weights for policy 0, policy_version 1067398 (0.0005) [2023-12-26 08:06:53,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001067408_273260544.pth... [2023-12-26 08:06:53,886][123091] Updated weights for policy 0, policy_version 1067408 (0.0005) [2023-12-26 08:06:53,890][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001066320_272982016.pth [2023-12-26 08:06:54,346][123090] Updated weights for policy 1, policy_version 1060035 (0.0007) [2023-12-26 08:06:54,399][123090] Updated weights for policy 1, policy_version 1060045 (0.0009) [2023-12-26 08:06:54,453][123090] Updated weights for policy 1, policy_version 1060055 (0.0009) [2023-12-26 08:06:54,610][123091] Updated weights for policy 0, policy_version 1067419 (0.0010) [2023-12-26 08:06:54,672][123091] Updated weights for policy 0, policy_version 1067430 (0.0009) [2023-12-26 08:06:54,725][123091] Updated weights for policy 0, policy_version 1067440 (0.0010) [2023-12-26 08:06:55,210][123090] Updated weights for policy 1, policy_version 1060065 (0.0009) [2023-12-26 08:06:55,272][123090] Updated weights for policy 1, policy_version 1060075 (0.0009) [2023-12-26 08:06:55,343][123090] Updated weights for policy 1, policy_version 1060085 (0.0010) [2023-12-26 08:06:55,403][123090] Updated weights for policy 1, policy_version 1060095 (0.0009) [2023-12-26 08:06:55,476][123091] Updated weights for policy 0, policy_version 1067450 (0.0007) [2023-12-26 08:06:55,531][123091] Updated weights for policy 0, policy_version 1067460 (0.0008) [2023-12-26 08:06:55,591][123091] Updated weights for policy 0, policy_version 1067470 (0.0009) [2023-12-26 08:06:56,267][123090] Updated weights for policy 1, policy_version 1060105 (0.0010) [2023-12-26 08:06:56,316][123091] Updated weights for policy 0, policy_version 1067480 (0.0006) [2023-12-26 08:06:56,317][123090] Updated weights for policy 1, policy_version 1060115 (0.0009) [2023-12-26 08:06:56,364][123090] Updated weights for policy 1, policy_version 1060125 (0.0007) [2023-12-26 08:06:56,375][123091] Updated weights for policy 0, policy_version 1067490 (0.0007) [2023-12-26 08:06:56,446][123091] Updated weights for policy 0, policy_version 1067500 (0.0006) [2023-12-26 08:06:57,045][123090] Updated weights for policy 1, policy_version 1060135 (0.0005) [2023-12-26 08:06:57,104][123090] Updated weights for policy 1, policy_version 1060145 (0.0005) [2023-12-26 08:06:57,158][123091] Updated weights for policy 0, policy_version 1067510 (0.0005) [2023-12-26 08:06:57,164][123090] Updated weights for policy 1, policy_version 1060155 (0.0005) [2023-12-26 08:06:57,231][123091] Updated weights for policy 0, policy_version 1067520 (0.0005) [2023-12-26 08:06:57,290][123091] Updated weights for policy 0, policy_version 1067530 (0.0005) [2023-12-26 08:06:57,835][123090] Updated weights for policy 1, policy_version 1060165 (0.0007) [2023-12-26 08:06:57,905][123090] Updated weights for policy 1, policy_version 1060175 (0.0007) [2023-12-26 08:06:57,919][123091] Updated weights for policy 0, policy_version 1067540 (0.0005) [2023-12-26 08:06:57,963][123091] Updated weights for policy 0, policy_version 1067550 (0.0005) [2023-12-26 08:06:57,974][123090] Updated weights for policy 1, policy_version 1060185 (0.0008) [2023-12-26 08:06:58,021][123091] Updated weights for policy 0, policy_version 1067560 (0.0006) [2023-12-26 08:06:58,784][123090] Updated weights for policy 1, policy_version 1060195 (0.0009) [2023-12-26 08:06:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 544710656. Throughput: 0: 9081.0, 1: 8739.8. Samples: 544709720. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:06:58,785][121949] Avg episode reward: [(0, '6078.080'), (1, '5856.399')] [2023-12-26 08:06:58,833][123091] Updated weights for policy 0, policy_version 1067570 (0.0007) [2023-12-26 08:06:58,848][123090] Updated weights for policy 1, policy_version 1060205 (0.0008) [2023-12-26 08:06:58,894][123091] Updated weights for policy 0, policy_version 1067580 (0.0006) [2023-12-26 08:06:58,901][123090] Updated weights for policy 1, policy_version 1060215 (0.0008) [2023-12-26 08:06:58,957][123091] Updated weights for policy 0, policy_version 1067590 (0.0007) [2023-12-26 08:06:59,021][123091] Updated weights for policy 0, policy_version 1067600 (0.0005) [2023-12-26 08:06:59,735][123091] Updated weights for policy 0, policy_version 1067610 (0.0006) [2023-12-26 08:06:59,765][123090] Updated weights for policy 1, policy_version 1060225 (0.0008) [2023-12-26 08:06:59,798][123091] Updated weights for policy 0, policy_version 1067620 (0.0005) [2023-12-26 08:06:59,837][123090] Updated weights for policy 1, policy_version 1060235 (0.0011) [2023-12-26 08:06:59,863][123091] Updated weights for policy 0, policy_version 1067630 (0.0007) [2023-12-26 08:06:59,895][123090] Updated weights for policy 1, policy_version 1060245 (0.0010) [2023-12-26 08:06:59,956][123090] Updated weights for policy 1, policy_version 1060255 (0.0006) [2023-12-26 08:07:00,536][123091] Updated weights for policy 0, policy_version 1067640 (0.0005) [2023-12-26 08:07:00,595][123091] Updated weights for policy 0, policy_version 1067650 (0.0005) [2023-12-26 08:07:00,650][123091] Updated weights for policy 0, policy_version 1067660 (0.0006) [2023-12-26 08:07:00,667][123090] Updated weights for policy 1, policy_version 1060265 (0.0007) [2023-12-26 08:07:00,714][123090] Updated weights for policy 1, policy_version 1060275 (0.0005) [2023-12-26 08:07:00,760][123090] Updated weights for policy 1, policy_version 1060285 (0.0005) [2023-12-26 08:07:01,294][123091] Updated weights for policy 0, policy_version 1067670 (0.0008) [2023-12-26 08:07:01,353][123091] Updated weights for policy 0, policy_version 1067681 (0.0011) [2023-12-26 08:07:01,420][123091] Updated weights for policy 0, policy_version 1067691 (0.0009) [2023-12-26 08:07:01,490][123090] Updated weights for policy 1, policy_version 1060295 (0.0008) [2023-12-26 08:07:01,538][123090] Updated weights for policy 1, policy_version 1060305 (0.0009) [2023-12-26 08:07:01,598][123090] Updated weights for policy 1, policy_version 1060315 (0.0010) [2023-12-26 08:07:02,217][123091] Updated weights for policy 0, policy_version 1067701 (0.0007) [2023-12-26 08:07:02,285][123091] Updated weights for policy 0, policy_version 1067711 (0.0008) [2023-12-26 08:07:02,350][123091] Updated weights for policy 0, policy_version 1067721 (0.0009) [2023-12-26 08:07:02,440][123090] Updated weights for policy 1, policy_version 1060325 (0.0008) [2023-12-26 08:07:02,510][123090] Updated weights for policy 1, policy_version 1060335 (0.0010) [2023-12-26 08:07:02,571][123090] Updated weights for policy 1, policy_version 1060345 (0.0010) [2023-12-26 08:07:03,031][123091] Updated weights for policy 0, policy_version 1067731 (0.0005) [2023-12-26 08:07:03,093][123091] Updated weights for policy 0, policy_version 1067741 (0.0008) [2023-12-26 08:07:03,147][123091] Updated weights for policy 0, policy_version 1067752 (0.0010) [2023-12-26 08:07:03,354][123090] Updated weights for policy 1, policy_version 1060355 (0.0010) [2023-12-26 08:07:03,413][123090] Updated weights for policy 1, policy_version 1060365 (0.0009) [2023-12-26 08:07:03,470][123090] Updated weights for policy 1, policy_version 1060375 (0.0009) [2023-12-26 08:07:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 544808960. Throughput: 0: 9176.6, 1: 8779.4. Samples: 544819956. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:03,785][121949] Avg episode reward: [(0, '6043.355'), (1, '5963.830')] [2023-12-26 08:07:03,997][123091] Updated weights for policy 0, policy_version 1067762 (0.0010) [2023-12-26 08:07:04,050][123091] Updated weights for policy 0, policy_version 1067772 (0.0009) [2023-12-26 08:07:04,111][123091] Updated weights for policy 0, policy_version 1067782 (0.0009) [2023-12-26 08:07:04,168][123091] Updated weights for policy 0, policy_version 1067792 (0.0009) [2023-12-26 08:07:04,279][123090] Updated weights for policy 1, policy_version 1060386 (0.0010) [2023-12-26 08:07:04,335][123090] Updated weights for policy 1, policy_version 1060396 (0.0009) [2023-12-26 08:07:04,392][123090] Updated weights for policy 1, policy_version 1060406 (0.0009) [2023-12-26 08:07:04,453][123090] Updated weights for policy 1, policy_version 1060416 (0.0008) [2023-12-26 08:07:05,031][123091] Updated weights for policy 0, policy_version 1067802 (0.0010) [2023-12-26 08:07:05,082][123091] Updated weights for policy 0, policy_version 1067812 (0.0010) [2023-12-26 08:07:05,140][123091] Updated weights for policy 0, policy_version 1067822 (0.0010) [2023-12-26 08:07:05,157][123090] Updated weights for policy 1, policy_version 1060426 (0.0005) [2023-12-26 08:07:05,207][123090] Updated weights for policy 1, policy_version 1060436 (0.0005) [2023-12-26 08:07:05,254][123090] Updated weights for policy 1, policy_version 1060446 (0.0005) [2023-12-26 08:07:05,891][123090] Updated weights for policy 1, policy_version 1060456 (0.0007) [2023-12-26 08:07:05,896][123091] Updated weights for policy 0, policy_version 1067832 (0.0006) [2023-12-26 08:07:05,940][123090] Updated weights for policy 1, policy_version 1060466 (0.0006) [2023-12-26 08:07:05,964][123091] Updated weights for policy 0, policy_version 1067842 (0.0005) [2023-12-26 08:07:06,010][123090] Updated weights for policy 1, policy_version 1060476 (0.0006) [2023-12-26 08:07:06,030][123091] Updated weights for policy 0, policy_version 1067852 (0.0005) [2023-12-26 08:07:06,663][123090] Updated weights for policy 1, policy_version 1060486 (0.0005) [2023-12-26 08:07:06,713][123091] Updated weights for policy 0, policy_version 1067862 (0.0006) [2023-12-26 08:07:06,722][123090] Updated weights for policy 1, policy_version 1060496 (0.0006) [2023-12-26 08:07:06,778][123090] Updated weights for policy 1, policy_version 1060506 (0.0005) [2023-12-26 08:07:06,781][123091] Updated weights for policy 0, policy_version 1067872 (0.0007) [2023-12-26 08:07:06,855][123091] Updated weights for policy 0, policy_version 1067882 (0.0011) [2023-12-26 08:07:07,555][123091] Updated weights for policy 0, policy_version 1067892 (0.0010) [2023-12-26 08:07:07,604][123090] Updated weights for policy 1, policy_version 1060516 (0.0006) [2023-12-26 08:07:07,615][123091] Updated weights for policy 0, policy_version 1067902 (0.0011) [2023-12-26 08:07:07,668][123090] Updated weights for policy 1, policy_version 1060526 (0.0006) [2023-12-26 08:07:07,674][123091] Updated weights for policy 0, policy_version 1067912 (0.0010) [2023-12-26 08:07:07,721][123090] Updated weights for policy 1, policy_version 1060536 (0.0007) [2023-12-26 08:07:08,480][123091] Updated weights for policy 0, policy_version 1067922 (0.0010) [2023-12-26 08:07:08,528][123091] Updated weights for policy 0, policy_version 1067932 (0.0010) [2023-12-26 08:07:08,551][123090] Updated weights for policy 1, policy_version 1060546 (0.0009) [2023-12-26 08:07:08,587][123091] Updated weights for policy 0, policy_version 1067942 (0.0011) [2023-12-26 08:07:08,607][123090] Updated weights for policy 1, policy_version 1060556 (0.0006) [2023-12-26 08:07:08,646][123091] Updated weights for policy 0, policy_version 1067952 (0.0010) [2023-12-26 08:07:08,664][123090] Updated weights for policy 1, policy_version 1060566 (0.0008) [2023-12-26 08:07:08,727][123090] Updated weights for policy 1, policy_version 1060576 (0.0009) [2023-12-26 08:07:08,784][121949] Fps is (10 sec: 19661.0, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 544907264. Throughput: 0: 9248.7, 1: 8834.3. Samples: 544877504. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:08,784][121949] Avg episode reward: [(0, '6222.633'), (1, '5800.276')] [2023-12-26 08:07:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001067952_273399808.pth... [2023-12-26 08:07:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001060576_271507456.pth... [2023-12-26 08:07:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001066864_273121280.pth [2023-12-26 08:07:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001059520_271237120.pth [2023-12-26 08:07:09,506][123091] Updated weights for policy 0, policy_version 1067962 (0.0011) [2023-12-26 08:07:09,543][123090] Updated weights for policy 1, policy_version 1060586 (0.0008) [2023-12-26 08:07:09,565][123091] Updated weights for policy 0, policy_version 1067972 (0.0011) [2023-12-26 08:07:09,608][123090] Updated weights for policy 1, policy_version 1060596 (0.0010) [2023-12-26 08:07:09,629][123091] Updated weights for policy 0, policy_version 1067982 (0.0011) [2023-12-26 08:07:09,663][123090] Updated weights for policy 1, policy_version 1060606 (0.0008) [2023-12-26 08:07:10,477][123091] Updated weights for policy 0, policy_version 1067992 (0.0009) [2023-12-26 08:07:10,484][123090] Updated weights for policy 1, policy_version 1060616 (0.0010) [2023-12-26 08:07:10,529][123091] Updated weights for policy 0, policy_version 1068002 (0.0007) [2023-12-26 08:07:10,548][123090] Updated weights for policy 1, policy_version 1060626 (0.0011) [2023-12-26 08:07:10,582][123091] Updated weights for policy 0, policy_version 1068012 (0.0007) [2023-12-26 08:07:10,611][123090] Updated weights for policy 1, policy_version 1060636 (0.0010) [2023-12-26 08:07:11,456][123091] Updated weights for policy 0, policy_version 1068022 (0.0008) [2023-12-26 08:07:11,469][123090] Updated weights for policy 1, policy_version 1060646 (0.0010) [2023-12-26 08:07:11,520][123091] Updated weights for policy 0, policy_version 1068032 (0.0008) [2023-12-26 08:07:11,534][123090] Updated weights for policy 1, policy_version 1060656 (0.0009) [2023-12-26 08:07:11,577][123091] Updated weights for policy 0, policy_version 1068042 (0.0009) [2023-12-26 08:07:11,597][123090] Updated weights for policy 1, policy_version 1060666 (0.0007) [2023-12-26 08:07:12,432][123091] Updated weights for policy 0, policy_version 1068052 (0.0008) [2023-12-26 08:07:12,441][123090] Updated weights for policy 1, policy_version 1060676 (0.0009) [2023-12-26 08:07:12,496][123091] Updated weights for policy 0, policy_version 1068062 (0.0009) [2023-12-26 08:07:12,507][123090] Updated weights for policy 1, policy_version 1060686 (0.0008) [2023-12-26 08:07:12,560][123091] Updated weights for policy 0, policy_version 1068072 (0.0007) [2023-12-26 08:07:12,573][123090] Updated weights for policy 1, policy_version 1060696 (0.0008) [2023-12-26 08:07:13,314][123091] Updated weights for policy 0, policy_version 1068082 (0.0007) [2023-12-26 08:07:13,368][123091] Updated weights for policy 0, policy_version 1068092 (0.0009) [2023-12-26 08:07:13,381][123090] Updated weights for policy 1, policy_version 1060706 (0.0008) [2023-12-26 08:07:13,417][123091] Updated weights for policy 0, policy_version 1068102 (0.0005) [2023-12-26 08:07:13,443][123090] Updated weights for policy 1, policy_version 1060716 (0.0009) [2023-12-26 08:07:13,475][123091] Updated weights for policy 0, policy_version 1068112 (0.0005) [2023-12-26 08:07:13,507][123090] Updated weights for policy 1, policy_version 1060726 (0.0009) [2023-12-26 08:07:13,567][123090] Updated weights for policy 1, policy_version 1060736 (0.0010) [2023-12-26 08:07:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 544989184. Throughput: 0: 9166.9, 1: 8739.5. Samples: 544980316. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:13,785][121949] Avg episode reward: [(0, '6254.578'), (1, '5677.594')] [2023-12-26 08:07:14,238][123091] Updated weights for policy 0, policy_version 1068122 (0.0011) [2023-12-26 08:07:14,305][123091] Updated weights for policy 0, policy_version 1068132 (0.0007) [2023-12-26 08:07:14,373][123091] Updated weights for policy 0, policy_version 1068142 (0.0007) [2023-12-26 08:07:14,453][123090] Updated weights for policy 1, policy_version 1060746 (0.0009) [2023-12-26 08:07:14,524][123090] Updated weights for policy 1, policy_version 1060756 (0.0009) [2023-12-26 08:07:14,590][123090] Updated weights for policy 1, policy_version 1060766 (0.0009) [2023-12-26 08:07:15,190][123091] Updated weights for policy 0, policy_version 1068152 (0.0010) [2023-12-26 08:07:15,254][123091] Updated weights for policy 0, policy_version 1068162 (0.0011) [2023-12-26 08:07:15,321][123091] Updated weights for policy 0, policy_version 1068172 (0.0011) [2023-12-26 08:07:15,410][123090] Updated weights for policy 1, policy_version 1060776 (0.0009) [2023-12-26 08:07:15,483][123090] Updated weights for policy 1, policy_version 1060786 (0.0009) [2023-12-26 08:07:15,555][123090] Updated weights for policy 1, policy_version 1060796 (0.0009) [2023-12-26 08:07:16,152][123091] Updated weights for policy 0, policy_version 1068182 (0.0011) [2023-12-26 08:07:16,200][123091] Updated weights for policy 0, policy_version 1068192 (0.0010) [2023-12-26 08:07:16,258][123091] Updated weights for policy 0, policy_version 1068202 (0.0011) [2023-12-26 08:07:16,378][123090] Updated weights for policy 1, policy_version 1060806 (0.0008) [2023-12-26 08:07:16,435][123090] Updated weights for policy 1, policy_version 1060816 (0.0009) [2023-12-26 08:07:16,487][123090] Updated weights for policy 1, policy_version 1060826 (0.0008) [2023-12-26 08:07:17,028][123091] Updated weights for policy 0, policy_version 1068212 (0.0008) [2023-12-26 08:07:17,084][123091] Updated weights for policy 0, policy_version 1068222 (0.0005) [2023-12-26 08:07:17,135][123091] Updated weights for policy 0, policy_version 1068232 (0.0005) [2023-12-26 08:07:17,386][123090] Updated weights for policy 1, policy_version 1060836 (0.0009) [2023-12-26 08:07:17,443][123090] Updated weights for policy 1, policy_version 1060846 (0.0010) [2023-12-26 08:07:17,506][123090] Updated weights for policy 1, policy_version 1060856 (0.0010) [2023-12-26 08:07:17,675][123091] Updated weights for policy 0, policy_version 1068242 (0.0006) [2023-12-26 08:07:17,740][123091] Updated weights for policy 0, policy_version 1068252 (0.0008) [2023-12-26 08:07:17,795][123091] Updated weights for policy 0, policy_version 1068262 (0.0005) [2023-12-26 08:07:17,850][123091] Updated weights for policy 0, policy_version 1068272 (0.0009) [2023-12-26 08:07:18,380][123090] Updated weights for policy 1, policy_version 1060866 (0.0009) [2023-12-26 08:07:18,445][123090] Updated weights for policy 1, policy_version 1060876 (0.0009) [2023-12-26 08:07:18,514][123090] Updated weights for policy 1, policy_version 1060886 (0.0009) [2023-12-26 08:07:18,585][123090] Updated weights for policy 1, policy_version 1060896 (0.0008) [2023-12-26 08:07:18,662][123091] Updated weights for policy 0, policy_version 1068282 (0.0010) [2023-12-26 08:07:18,730][123091] Updated weights for policy 0, policy_version 1068292 (0.0010) [2023-12-26 08:07:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 545071104. Throughput: 0: 9131.6, 1: 8761.9. Samples: 545085444. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:18,785][121949] Avg episode reward: [(0, '6316.357'), (1, '5587.657')] [2023-12-26 08:07:18,795][123091] Updated weights for policy 0, policy_version 1068302 (0.0006) [2023-12-26 08:07:19,415][123090] Updated weights for policy 1, policy_version 1060906 (0.0006) [2023-12-26 08:07:19,489][123090] Updated weights for policy 1, policy_version 1060916 (0.0008) [2023-12-26 08:07:19,557][123090] Updated weights for policy 1, policy_version 1060926 (0.0007) [2023-12-26 08:07:19,587][123091] Updated weights for policy 0, policy_version 1068312 (0.0010) [2023-12-26 08:07:19,642][123091] Updated weights for policy 0, policy_version 1068322 (0.0010) [2023-12-26 08:07:19,706][123091] Updated weights for policy 0, policy_version 1068332 (0.0005) [2023-12-26 08:07:20,360][123090] Updated weights for policy 1, policy_version 1060936 (0.0008) [2023-12-26 08:07:20,430][123090] Updated weights for policy 1, policy_version 1060946 (0.0007) [2023-12-26 08:07:20,501][123090] Updated weights for policy 1, policy_version 1060956 (0.0008) [2023-12-26 08:07:20,540][123091] Updated weights for policy 0, policy_version 1068342 (0.0005) [2023-12-26 08:07:20,609][123091] Updated weights for policy 0, policy_version 1068352 (0.0007) [2023-12-26 08:07:20,682][123091] Updated weights for policy 0, policy_version 1068362 (0.0006) [2023-12-26 08:07:21,286][123090] Updated weights for policy 1, policy_version 1060966 (0.0009) [2023-12-26 08:07:21,359][123090] Updated weights for policy 1, policy_version 1060976 (0.0009) [2023-12-26 08:07:21,423][123091] Updated weights for policy 0, policy_version 1068372 (0.0007) [2023-12-26 08:07:21,428][123090] Updated weights for policy 1, policy_version 1060986 (0.0008) [2023-12-26 08:07:21,490][123091] Updated weights for policy 0, policy_version 1068382 (0.0010) [2023-12-26 08:07:21,557][123091] Updated weights for policy 0, policy_version 1068392 (0.0010) [2023-12-26 08:07:22,202][123090] Updated weights for policy 1, policy_version 1060996 (0.0006) [2023-12-26 08:07:22,270][123090] Updated weights for policy 1, policy_version 1061006 (0.0006) [2023-12-26 08:07:22,331][123090] Updated weights for policy 1, policy_version 1061016 (0.0006) [2023-12-26 08:07:22,332][123091] Updated weights for policy 0, policy_version 1068402 (0.0010) [2023-12-26 08:07:22,408][123091] Updated weights for policy 0, policy_version 1068412 (0.0010) [2023-12-26 08:07:22,473][123091] Updated weights for policy 0, policy_version 1068422 (0.0008) [2023-12-26 08:07:22,542][123091] Updated weights for policy 0, policy_version 1068432 (0.0010) [2023-12-26 08:07:23,025][123090] Updated weights for policy 1, policy_version 1061026 (0.0008) [2023-12-26 08:07:23,088][123090] Updated weights for policy 1, policy_version 1061036 (0.0010) [2023-12-26 08:07:23,147][123090] Updated weights for policy 1, policy_version 1061046 (0.0010) [2023-12-26 08:07:23,196][123090] Updated weights for policy 1, policy_version 1061056 (0.0008) [2023-12-26 08:07:23,280][123091] Updated weights for policy 0, policy_version 1068442 (0.0011) [2023-12-26 08:07:23,331][123091] Updated weights for policy 0, policy_version 1068452 (0.0011) [2023-12-26 08:07:23,392][123091] Updated weights for policy 0, policy_version 1068462 (0.0011) [2023-12-26 08:07:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 545161216. Throughput: 0: 9115.2, 1: 8767.2. Samples: 545137448. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:23,784][121949] Avg episode reward: [(0, '6296.643'), (1, '5721.935')] [2023-12-26 08:07:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001068464_273530880.pth... [2023-12-26 08:07:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001061056_271630336.pth... [2023-12-26 08:07:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001060032_271368192.pth [2023-12-26 08:07:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001067408_273260544.pth [2023-12-26 08:07:23,898][123090] Updated weights for policy 1, policy_version 1061066 (0.0008) [2023-12-26 08:07:23,971][123090] Updated weights for policy 1, policy_version 1061076 (0.0009) [2023-12-26 08:07:24,031][123090] Updated weights for policy 1, policy_version 1061086 (0.0009) [2023-12-26 08:07:24,252][123091] Updated weights for policy 0, policy_version 1068472 (0.0011) [2023-12-26 08:07:24,321][123091] Updated weights for policy 0, policy_version 1068482 (0.0011) [2023-12-26 08:07:24,383][123091] Updated weights for policy 0, policy_version 1068492 (0.0011) [2023-12-26 08:07:24,792][123090] Updated weights for policy 1, policy_version 1061096 (0.0009) [2023-12-26 08:07:24,851][123090] Updated weights for policy 1, policy_version 1061106 (0.0010) [2023-12-26 08:07:24,910][123090] Updated weights for policy 1, policy_version 1061116 (0.0010) [2023-12-26 08:07:25,100][123091] Updated weights for policy 0, policy_version 1068502 (0.0007) [2023-12-26 08:07:25,150][123091] Updated weights for policy 0, policy_version 1068512 (0.0005) [2023-12-26 08:07:25,210][123091] Updated weights for policy 0, policy_version 1068522 (0.0006) [2023-12-26 08:07:25,857][123091] Updated weights for policy 0, policy_version 1068532 (0.0006) [2023-12-26 08:07:25,861][123090] Updated weights for policy 1, policy_version 1061126 (0.0009) [2023-12-26 08:07:25,924][123091] Updated weights for policy 0, policy_version 1068542 (0.0008) [2023-12-26 08:07:25,930][123090] Updated weights for policy 1, policy_version 1061136 (0.0009) [2023-12-26 08:07:25,977][123091] Updated weights for policy 0, policy_version 1068552 (0.0006) [2023-12-26 08:07:25,991][123090] Updated weights for policy 1, policy_version 1061146 (0.0009) [2023-12-26 08:07:26,618][123091] Updated weights for policy 0, policy_version 1068562 (0.0005) [2023-12-26 08:07:26,667][123091] Updated weights for policy 0, policy_version 1068572 (0.0005) [2023-12-26 08:07:26,715][123091] Updated weights for policy 0, policy_version 1068582 (0.0005) [2023-12-26 08:07:26,770][123091] Updated weights for policy 0, policy_version 1068592 (0.0006) [2023-12-26 08:07:26,782][123090] Updated weights for policy 1, policy_version 1061156 (0.0008) [2023-12-26 08:07:26,832][123090] Updated weights for policy 1, policy_version 1061166 (0.0005) [2023-12-26 08:07:26,880][123090] Updated weights for policy 1, policy_version 1061176 (0.0005) [2023-12-26 08:07:27,489][123090] Updated weights for policy 1, policy_version 1061186 (0.0005) [2023-12-26 08:07:27,518][123091] Updated weights for policy 0, policy_version 1068602 (0.0010) [2023-12-26 08:07:27,550][123090] Updated weights for policy 1, policy_version 1061196 (0.0005) [2023-12-26 08:07:27,565][123091] Updated weights for policy 0, policy_version 1068612 (0.0010) [2023-12-26 08:07:27,604][123090] Updated weights for policy 1, policy_version 1061206 (0.0005) [2023-12-26 08:07:27,623][123091] Updated weights for policy 0, policy_version 1068622 (0.0010) [2023-12-26 08:07:27,665][123090] Updated weights for policy 1, policy_version 1061216 (0.0008) [2023-12-26 08:07:28,415][123090] Updated weights for policy 1, policy_version 1061226 (0.0009) [2023-12-26 08:07:28,423][123091] Updated weights for policy 0, policy_version 1068632 (0.0007) [2023-12-26 08:07:28,483][123090] Updated weights for policy 1, policy_version 1061236 (0.0005) [2023-12-26 08:07:28,486][123091] Updated weights for policy 0, policy_version 1068642 (0.0009) [2023-12-26 08:07:28,543][123091] Updated weights for policy 0, policy_version 1068652 (0.0009) [2023-12-26 08:07:28,555][123090] Updated weights for policy 1, policy_version 1061246 (0.0005) [2023-12-26 08:07:28,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 545259520. Throughput: 0: 9230.5, 1: 8846.3. Samples: 545249628. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:28,785][121949] Avg episode reward: [(0, '6177.160'), (1, '5867.705')] [2023-12-26 08:07:29,264][123090] Updated weights for policy 1, policy_version 1061256 (0.0009) [2023-12-26 08:07:29,340][123090] Updated weights for policy 1, policy_version 1061266 (0.0009) [2023-12-26 08:07:29,404][123090] Updated weights for policy 1, policy_version 1061276 (0.0009) [2023-12-26 08:07:29,406][123091] Updated weights for policy 0, policy_version 1068662 (0.0007) [2023-12-26 08:07:29,455][123091] Updated weights for policy 0, policy_version 1068672 (0.0005) [2023-12-26 08:07:29,509][123091] Updated weights for policy 0, policy_version 1068682 (0.0005) [2023-12-26 08:07:30,253][123090] Updated weights for policy 1, policy_version 1061286 (0.0009) [2023-12-26 08:07:30,289][123091] Updated weights for policy 0, policy_version 1068692 (0.0007) [2023-12-26 08:07:30,299][123090] Updated weights for policy 1, policy_version 1061296 (0.0005) [2023-12-26 08:07:30,350][123090] Updated weights for policy 1, policy_version 1061306 (0.0005) [2023-12-26 08:07:30,351][123091] Updated weights for policy 0, policy_version 1068702 (0.0009) [2023-12-26 08:07:30,413][123091] Updated weights for policy 0, policy_version 1068712 (0.0008) [2023-12-26 08:07:31,170][123091] Updated weights for policy 0, policy_version 1068722 (0.0009) [2023-12-26 08:07:31,201][123090] Updated weights for policy 1, policy_version 1061316 (0.0009) [2023-12-26 08:07:31,229][123091] Updated weights for policy 0, policy_version 1068732 (0.0010) [2023-12-26 08:07:31,249][123090] Updated weights for policy 1, policy_version 1061326 (0.0010) [2023-12-26 08:07:31,288][123091] Updated weights for policy 0, policy_version 1068742 (0.0009) [2023-12-26 08:07:31,316][123090] Updated weights for policy 1, policy_version 1061336 (0.0010) [2023-12-26 08:07:32,111][123091] Updated weights for policy 0, policy_version 1068753 (0.0010) [2023-12-26 08:07:32,126][123090] Updated weights for policy 1, policy_version 1061346 (0.0009) [2023-12-26 08:07:32,172][123091] Updated weights for policy 0, policy_version 1068763 (0.0009) [2023-12-26 08:07:32,191][123090] Updated weights for policy 1, policy_version 1061356 (0.0005) [2023-12-26 08:07:32,241][123091] Updated weights for policy 0, policy_version 1068773 (0.0010) [2023-12-26 08:07:32,261][123090] Updated weights for policy 1, policy_version 1061366 (0.0007) [2023-12-26 08:07:32,303][123091] Updated weights for policy 0, policy_version 1068783 (0.0011) [2023-12-26 08:07:32,318][123090] Updated weights for policy 1, policy_version 1061376 (0.0008) [2023-12-26 08:07:32,985][123091] Updated weights for policy 0, policy_version 1068793 (0.0008) [2023-12-26 08:07:33,044][123091] Updated weights for policy 0, policy_version 1068803 (0.0008) [2023-12-26 08:07:33,045][123090] Updated weights for policy 1, policy_version 1061386 (0.0007) [2023-12-26 08:07:33,108][123091] Updated weights for policy 0, policy_version 1068813 (0.0008) [2023-12-26 08:07:33,111][123090] Updated weights for policy 1, policy_version 1061396 (0.0005) [2023-12-26 08:07:33,173][123090] Updated weights for policy 1, policy_version 1061406 (0.0010) [2023-12-26 08:07:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 545341440. Throughput: 0: 9214.3, 1: 8919.4. Samples: 545358968. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:33,785][121949] Avg episode reward: [(0, '6108.322'), (1, '5695.271')] [2023-12-26 08:07:33,787][123091] Updated weights for policy 0, policy_version 1068823 (0.0006) [2023-12-26 08:07:33,817][123090] Updated weights for policy 1, policy_version 1061416 (0.0006) [2023-12-26 08:07:33,840][123091] Updated weights for policy 0, policy_version 1068833 (0.0006) [2023-12-26 08:07:33,880][123090] Updated weights for policy 1, policy_version 1061426 (0.0007) [2023-12-26 08:07:33,896][123091] Updated weights for policy 0, policy_version 1068843 (0.0006) [2023-12-26 08:07:33,930][123090] Updated weights for policy 1, policy_version 1061436 (0.0007) [2023-12-26 08:07:34,555][123091] Updated weights for policy 0, policy_version 1068853 (0.0007) [2023-12-26 08:07:34,628][123091] Updated weights for policy 0, policy_version 1068863 (0.0007) [2023-12-26 08:07:34,698][123091] Updated weights for policy 0, policy_version 1068873 (0.0011) [2023-12-26 08:07:34,716][123090] Updated weights for policy 1, policy_version 1061446 (0.0006) [2023-12-26 08:07:34,781][123090] Updated weights for policy 1, policy_version 1061456 (0.0006) [2023-12-26 08:07:34,847][123090] Updated weights for policy 1, policy_version 1061466 (0.0009) [2023-12-26 08:07:35,499][123091] Updated weights for policy 0, policy_version 1068883 (0.0009) [2023-12-26 08:07:35,553][123091] Updated weights for policy 0, policy_version 1068893 (0.0007) [2023-12-26 08:07:35,574][123090] Updated weights for policy 1, policy_version 1061476 (0.0009) [2023-12-26 08:07:35,614][123091] Updated weights for policy 0, policy_version 1068903 (0.0007) [2023-12-26 08:07:35,637][123090] Updated weights for policy 1, policy_version 1061486 (0.0007) [2023-12-26 08:07:35,698][123090] Updated weights for policy 1, policy_version 1061496 (0.0007) [2023-12-26 08:07:36,425][123091] Updated weights for policy 0, policy_version 1068913 (0.0010) [2023-12-26 08:07:36,496][123091] Updated weights for policy 0, policy_version 1068923 (0.0011) [2023-12-26 08:07:36,526][123090] Updated weights for policy 1, policy_version 1061506 (0.0009) [2023-12-26 08:07:36,560][123091] Updated weights for policy 0, policy_version 1068933 (0.0011) [2023-12-26 08:07:36,594][123090] Updated weights for policy 1, policy_version 1061516 (0.0008) [2023-12-26 08:07:36,617][123091] Updated weights for policy 0, policy_version 1068943 (0.0011) [2023-12-26 08:07:36,651][123090] Updated weights for policy 1, policy_version 1061526 (0.0008) [2023-12-26 08:07:36,703][123090] Updated weights for policy 1, policy_version 1061536 (0.0009) [2023-12-26 08:07:37,442][123091] Updated weights for policy 0, policy_version 1068953 (0.0011) [2023-12-26 08:07:37,516][123091] Updated weights for policy 0, policy_version 1068963 (0.0010) [2023-12-26 08:07:37,540][123090] Updated weights for policy 1, policy_version 1061546 (0.0009) [2023-12-26 08:07:37,585][123091] Updated weights for policy 0, policy_version 1068973 (0.0011) [2023-12-26 08:07:37,603][123090] Updated weights for policy 1, policy_version 1061556 (0.0009) [2023-12-26 08:07:37,658][123090] Updated weights for policy 1, policy_version 1061566 (0.0008) [2023-12-26 08:07:38,363][123091] Updated weights for policy 0, policy_version 1068983 (0.0009) [2023-12-26 08:07:38,432][123091] Updated weights for policy 0, policy_version 1068993 (0.0006) [2023-12-26 08:07:38,506][123091] Updated weights for policy 0, policy_version 1069003 (0.0010) [2023-12-26 08:07:38,575][123090] Updated weights for policy 1, policy_version 1061576 (0.0009) [2023-12-26 08:07:38,627][123090] Updated weights for policy 1, policy_version 1061586 (0.0009) [2023-12-26 08:07:38,684][123090] Updated weights for policy 1, policy_version 1061596 (0.0010) [2023-12-26 08:07:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 545439744. Throughput: 0: 9182.3, 1: 8948.7. Samples: 545413048. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:38,784][121949] Avg episode reward: [(0, '6115.699'), (1, '5644.020')] [2023-12-26 08:07:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001069008_273670144.pth... [2023-12-26 08:07:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001061600_271769600.pth... [2023-12-26 08:07:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001060576_271507456.pth [2023-12-26 08:07:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001067952_273399808.pth [2023-12-26 08:07:39,175][123091] Updated weights for policy 0, policy_version 1069013 (0.0009) [2023-12-26 08:07:39,247][123091] Updated weights for policy 0, policy_version 1069023 (0.0010) [2023-12-26 08:07:39,302][123091] Updated weights for policy 0, policy_version 1069033 (0.0010) [2023-12-26 08:07:39,598][123090] Updated weights for policy 1, policy_version 1061606 (0.0009) [2023-12-26 08:07:39,660][123090] Updated weights for policy 1, policy_version 1061616 (0.0008) [2023-12-26 08:07:39,721][123090] Updated weights for policy 1, policy_version 1061626 (0.0009) [2023-12-26 08:07:40,115][123091] Updated weights for policy 0, policy_version 1069043 (0.0010) [2023-12-26 08:07:40,180][123091] Updated weights for policy 0, policy_version 1069053 (0.0009) [2023-12-26 08:07:40,251][123091] Updated weights for policy 0, policy_version 1069063 (0.0005) [2023-12-26 08:07:40,594][123090] Updated weights for policy 1, policy_version 1061636 (0.0008) [2023-12-26 08:07:40,661][123090] Updated weights for policy 1, policy_version 1061646 (0.0005) [2023-12-26 08:07:40,720][123090] Updated weights for policy 1, policy_version 1061656 (0.0005) [2023-12-26 08:07:41,113][123091] Updated weights for policy 0, policy_version 1069073 (0.0007) [2023-12-26 08:07:41,183][123091] Updated weights for policy 0, policy_version 1069083 (0.0010) [2023-12-26 08:07:41,256][123091] Updated weights for policy 0, policy_version 1069093 (0.0009) [2023-12-26 08:07:41,325][123091] Updated weights for policy 0, policy_version 1069103 (0.0008) [2023-12-26 08:07:41,472][123090] Updated weights for policy 1, policy_version 1061666 (0.0006) [2023-12-26 08:07:41,537][123090] Updated weights for policy 1, policy_version 1061676 (0.0009) [2023-12-26 08:07:41,607][123090] Updated weights for policy 1, policy_version 1061686 (0.0009) [2023-12-26 08:07:41,678][123090] Updated weights for policy 1, policy_version 1061696 (0.0009) [2023-12-26 08:07:42,141][123091] Updated weights for policy 0, policy_version 1069113 (0.0009) [2023-12-26 08:07:42,206][123091] Updated weights for policy 0, policy_version 1069123 (0.0010) [2023-12-26 08:07:42,262][123091] Updated weights for policy 0, policy_version 1069133 (0.0010) [2023-12-26 08:07:42,495][123090] Updated weights for policy 1, policy_version 1061706 (0.0008) [2023-12-26 08:07:42,560][123090] Updated weights for policy 1, policy_version 1061716 (0.0010) [2023-12-26 08:07:42,624][123090] Updated weights for policy 1, policy_version 1061726 (0.0010) [2023-12-26 08:07:42,992][123091] Updated weights for policy 0, policy_version 1069143 (0.0007) [2023-12-26 08:07:43,056][123091] Updated weights for policy 0, policy_version 1069153 (0.0006) [2023-12-26 08:07:43,115][123091] Updated weights for policy 0, policy_version 1069163 (0.0007) [2023-12-26 08:07:43,462][123090] Updated weights for policy 1, policy_version 1061736 (0.0006) [2023-12-26 08:07:43,510][123090] Updated weights for policy 1, policy_version 1061746 (0.0005) [2023-12-26 08:07:43,555][123090] Updated weights for policy 1, policy_version 1061756 (0.0005) [2023-12-26 08:07:43,768][123091] Updated weights for policy 0, policy_version 1069173 (0.0005) [2023-12-26 08:07:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 545521664. Throughput: 0: 9077.3, 1: 8807.0. Samples: 545514512. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:43,784][121949] Avg episode reward: [(0, '6109.963'), (1, '5893.087')] [2023-12-26 08:07:43,813][123091] Updated weights for policy 0, policy_version 1069183 (0.0005) [2023-12-26 08:07:43,861][123091] Updated weights for policy 0, policy_version 1069193 (0.0005) [2023-12-26 08:07:44,286][123090] Updated weights for policy 1, policy_version 1061766 (0.0008) [2023-12-26 08:07:44,346][123090] Updated weights for policy 1, policy_version 1061776 (0.0009) [2023-12-26 08:07:44,399][123090] Updated weights for policy 1, policy_version 1061786 (0.0008) [2023-12-26 08:07:44,707][123091] Updated weights for policy 0, policy_version 1069203 (0.0007) [2023-12-26 08:07:44,762][123091] Updated weights for policy 0, policy_version 1069213 (0.0010) [2023-12-26 08:07:44,832][123091] Updated weights for policy 0, policy_version 1069223 (0.0009) [2023-12-26 08:07:45,064][123090] Updated weights for policy 1, policy_version 1061796 (0.0008) [2023-12-26 08:07:45,127][123090] Updated weights for policy 1, policy_version 1061806 (0.0011) [2023-12-26 08:07:45,184][123090] Updated weights for policy 1, policy_version 1061816 (0.0011) [2023-12-26 08:07:45,661][123091] Updated weights for policy 0, policy_version 1069233 (0.0009) [2023-12-26 08:07:45,711][123091] Updated weights for policy 0, policy_version 1069243 (0.0006) [2023-12-26 08:07:45,762][123091] Updated weights for policy 0, policy_version 1069253 (0.0006) [2023-12-26 08:07:45,818][123091] Updated weights for policy 0, policy_version 1069263 (0.0009) [2023-12-26 08:07:46,029][123090] Updated weights for policy 1, policy_version 1061826 (0.0011) [2023-12-26 08:07:46,082][123090] Updated weights for policy 1, policy_version 1061836 (0.0010) [2023-12-26 08:07:46,142][123090] Updated weights for policy 1, policy_version 1061846 (0.0007) [2023-12-26 08:07:46,210][123090] Updated weights for policy 1, policy_version 1061856 (0.0011) [2023-12-26 08:07:46,589][123091] Updated weights for policy 0, policy_version 1069273 (0.0006) [2023-12-26 08:07:46,659][123091] Updated weights for policy 0, policy_version 1069283 (0.0005) [2023-12-26 08:07:46,722][123091] Updated weights for policy 0, policy_version 1069293 (0.0005) [2023-12-26 08:07:47,029][123090] Updated weights for policy 1, policy_version 1061866 (0.0010) [2023-12-26 08:07:47,076][123090] Updated weights for policy 1, policy_version 1061876 (0.0007) [2023-12-26 08:07:47,131][123090] Updated weights for policy 1, policy_version 1061886 (0.0005) [2023-12-26 08:07:47,485][123091] Updated weights for policy 0, policy_version 1069303 (0.0005) [2023-12-26 08:07:47,546][123091] Updated weights for policy 0, policy_version 1069313 (0.0006) [2023-12-26 08:07:47,609][123091] Updated weights for policy 0, policy_version 1069323 (0.0008) [2023-12-26 08:07:47,928][123090] Updated weights for policy 1, policy_version 1061896 (0.0009) [2023-12-26 08:07:47,983][123090] Updated weights for policy 1, policy_version 1061906 (0.0011) [2023-12-26 08:07:48,051][123090] Updated weights for policy 1, policy_version 1061916 (0.0011) [2023-12-26 08:07:48,268][123091] Updated weights for policy 0, policy_version 1069333 (0.0007) [2023-12-26 08:07:48,325][123091] Updated weights for policy 0, policy_version 1069343 (0.0006) [2023-12-26 08:07:48,397][123091] Updated weights for policy 0, policy_version 1069353 (0.0007) [2023-12-26 08:07:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 545611776. Throughput: 0: 9065.7, 1: 8822.0. Samples: 545624908. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:48,785][121949] Avg episode reward: [(0, '6121.228'), (1, '5979.886')] [2023-12-26 08:07:48,890][123090] Updated weights for policy 1, policy_version 1061926 (0.0010) [2023-12-26 08:07:48,960][123090] Updated weights for policy 1, policy_version 1061936 (0.0011) [2023-12-26 08:07:49,035][123090] Updated weights for policy 1, policy_version 1061946 (0.0011) [2023-12-26 08:07:49,164][123091] Updated weights for policy 0, policy_version 1069363 (0.0008) [2023-12-26 08:07:49,231][123091] Updated weights for policy 0, policy_version 1069373 (0.0009) [2023-12-26 08:07:49,298][123091] Updated weights for policy 0, policy_version 1069383 (0.0008) [2023-12-26 08:07:49,844][123090] Updated weights for policy 1, policy_version 1061956 (0.0010) [2023-12-26 08:07:49,908][123090] Updated weights for policy 1, policy_version 1061966 (0.0010) [2023-12-26 08:07:49,971][123090] Updated weights for policy 1, policy_version 1061976 (0.0009) [2023-12-26 08:07:50,142][123091] Updated weights for policy 0, policy_version 1069393 (0.0009) [2023-12-26 08:07:50,206][123091] Updated weights for policy 0, policy_version 1069403 (0.0005) [2023-12-26 08:07:50,270][123091] Updated weights for policy 0, policy_version 1069413 (0.0008) [2023-12-26 08:07:50,329][123091] Updated weights for policy 0, policy_version 1069423 (0.0008) [2023-12-26 08:07:50,767][123090] Updated weights for policy 1, policy_version 1061986 (0.0008) [2023-12-26 08:07:50,834][123090] Updated weights for policy 1, policy_version 1061996 (0.0008) [2023-12-26 08:07:50,896][123090] Updated weights for policy 1, policy_version 1062006 (0.0009) [2023-12-26 08:07:50,959][123090] Updated weights for policy 1, policy_version 1062016 (0.0010) [2023-12-26 08:07:51,161][123091] Updated weights for policy 0, policy_version 1069433 (0.0010) [2023-12-26 08:07:51,219][123091] Updated weights for policy 0, policy_version 1069444 (0.0010) [2023-12-26 08:07:51,281][123091] Updated weights for policy 0, policy_version 1069454 (0.0010) [2023-12-26 08:07:51,747][123090] Updated weights for policy 1, policy_version 1062026 (0.0009) [2023-12-26 08:07:51,802][123090] Updated weights for policy 1, policy_version 1062036 (0.0009) [2023-12-26 08:07:51,853][123090] Updated weights for policy 1, policy_version 1062046 (0.0008) [2023-12-26 08:07:52,171][123091] Updated weights for policy 0, policy_version 1069464 (0.0009) [2023-12-26 08:07:52,220][123091] Updated weights for policy 0, policy_version 1069474 (0.0009) [2023-12-26 08:07:52,276][123091] Updated weights for policy 0, policy_version 1069485 (0.0009) [2023-12-26 08:07:52,747][123090] Updated weights for policy 1, policy_version 1062056 (0.0009) [2023-12-26 08:07:52,802][123090] Updated weights for policy 1, policy_version 1062066 (0.0010) [2023-12-26 08:07:52,863][123090] Updated weights for policy 1, policy_version 1062076 (0.0009) [2023-12-26 08:07:53,155][123091] Updated weights for policy 0, policy_version 1069495 (0.0011) [2023-12-26 08:07:53,211][123091] Updated weights for policy 0, policy_version 1069505 (0.0010) [2023-12-26 08:07:53,262][123091] Updated weights for policy 0, policy_version 1069515 (0.0010) [2023-12-26 08:07:53,696][123090] Updated weights for policy 1, policy_version 1062086 (0.0008) [2023-12-26 08:07:53,760][123090] Updated weights for policy 1, policy_version 1062096 (0.0009) [2023-12-26 08:07:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 545693696. Throughput: 0: 9010.8, 1: 8726.2. Samples: 545675672. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:53,785][121949] Avg episode reward: [(0, '6153.879'), (1, '5783.165')] [2023-12-26 08:07:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001069520_273801216.pth... [2023-12-26 08:07:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001068464_273530880.pth [2023-12-26 08:07:53,824][123090] Updated weights for policy 1, policy_version 1062106 (0.0009) [2023-12-26 08:07:53,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001062112_271900672.pth... [2023-12-26 08:07:53,865][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001061056_271630336.pth [2023-12-26 08:07:54,093][123091] Updated weights for policy 0, policy_version 1069525 (0.0010) [2023-12-26 08:07:54,141][123091] Updated weights for policy 0, policy_version 1069535 (0.0010) [2023-12-26 08:07:54,187][123091] Updated weights for policy 0, policy_version 1069545 (0.0006) [2023-12-26 08:07:54,619][123090] Updated weights for policy 1, policy_version 1062116 (0.0009) [2023-12-26 08:07:54,670][123090] Updated weights for policy 1, policy_version 1062126 (0.0010) [2023-12-26 08:07:54,717][123090] Updated weights for policy 1, policy_version 1062136 (0.0010) [2023-12-26 08:07:55,009][123091] Updated weights for policy 0, policy_version 1069555 (0.0007) [2023-12-26 08:07:55,076][123091] Updated weights for policy 0, policy_version 1069565 (0.0011) [2023-12-26 08:07:55,143][123091] Updated weights for policy 0, policy_version 1069575 (0.0011) [2023-12-26 08:07:55,458][123090] Updated weights for policy 1, policy_version 1062146 (0.0009) [2023-12-26 08:07:55,526][123090] Updated weights for policy 1, policy_version 1062156 (0.0006) [2023-12-26 08:07:55,575][123090] Updated weights for policy 1, policy_version 1062166 (0.0005) [2023-12-26 08:07:55,624][123090] Updated weights for policy 1, policy_version 1062176 (0.0005) [2023-12-26 08:07:55,958][123091] Updated weights for policy 0, policy_version 1069585 (0.0011) [2023-12-26 08:07:56,020][123091] Updated weights for policy 0, policy_version 1069595 (0.0011) [2023-12-26 08:07:56,082][123091] Updated weights for policy 0, policy_version 1069605 (0.0011) [2023-12-26 08:07:56,145][123091] Updated weights for policy 0, policy_version 1069615 (0.0011) [2023-12-26 08:07:56,271][123090] Updated weights for policy 1, policy_version 1062186 (0.0009) [2023-12-26 08:07:56,330][123090] Updated weights for policy 1, policy_version 1062196 (0.0010) [2023-12-26 08:07:56,385][123090] Updated weights for policy 1, policy_version 1062206 (0.0010) [2023-12-26 08:07:56,892][123091] Updated weights for policy 0, policy_version 1069625 (0.0006) [2023-12-26 08:07:56,937][123091] Updated weights for policy 0, policy_version 1069635 (0.0005) [2023-12-26 08:07:57,000][123091] Updated weights for policy 0, policy_version 1069645 (0.0005) [2023-12-26 08:07:57,183][123090] Updated weights for policy 1, policy_version 1062216 (0.0007) [2023-12-26 08:07:57,248][123090] Updated weights for policy 1, policy_version 1062226 (0.0005) [2023-12-26 08:07:57,309][123090] Updated weights for policy 1, policy_version 1062236 (0.0005) [2023-12-26 08:07:57,655][123091] Updated weights for policy 0, policy_version 1069655 (0.0005) [2023-12-26 08:07:57,707][123091] Updated weights for policy 0, policy_version 1069665 (0.0005) [2023-12-26 08:07:57,770][123091] Updated weights for policy 0, policy_version 1069675 (0.0008) [2023-12-26 08:07:57,881][123090] Updated weights for policy 1, policy_version 1062246 (0.0006) [2023-12-26 08:07:57,943][123090] Updated weights for policy 1, policy_version 1062256 (0.0005) [2023-12-26 08:07:58,008][123090] Updated weights for policy 1, policy_version 1062266 (0.0005) [2023-12-26 08:07:58,571][123091] Updated weights for policy 0, policy_version 1069685 (0.0009) [2023-12-26 08:07:58,637][123091] Updated weights for policy 0, policy_version 1069695 (0.0009) [2023-12-26 08:07:58,703][123091] Updated weights for policy 0, policy_version 1069705 (0.0010) [2023-12-26 08:07:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 545792000. Throughput: 0: 9059.7, 1: 8813.9. Samples: 545784624. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:07:58,785][121949] Avg episode reward: [(0, '6149.968'), (1, '5428.076')] [2023-12-26 08:07:58,817][123090] Updated weights for policy 1, policy_version 1062276 (0.0009) [2023-12-26 08:07:58,875][123090] Updated weights for policy 1, policy_version 1062286 (0.0008) [2023-12-26 08:07:58,937][123090] Updated weights for policy 1, policy_version 1062296 (0.0008) [2023-12-26 08:07:59,437][123091] Updated weights for policy 0, policy_version 1069715 (0.0009) [2023-12-26 08:07:59,508][123091] Updated weights for policy 0, policy_version 1069725 (0.0007) [2023-12-26 08:07:59,570][123091] Updated weights for policy 0, policy_version 1069735 (0.0006) [2023-12-26 08:07:59,653][123090] Updated weights for policy 1, policy_version 1062306 (0.0008) [2023-12-26 08:07:59,707][123090] Updated weights for policy 1, policy_version 1062316 (0.0010) [2023-12-26 08:07:59,764][123090] Updated weights for policy 1, policy_version 1062326 (0.0009) [2023-12-26 08:07:59,820][123090] Updated weights for policy 1, policy_version 1062336 (0.0009) [2023-12-26 08:08:00,350][123091] Updated weights for policy 0, policy_version 1069745 (0.0005) [2023-12-26 08:08:00,411][123091] Updated weights for policy 0, policy_version 1069755 (0.0005) [2023-12-26 08:08:00,463][123091] Updated weights for policy 0, policy_version 1069765 (0.0005) [2023-12-26 08:08:00,521][123091] Updated weights for policy 0, policy_version 1069775 (0.0006) [2023-12-26 08:08:00,669][123090] Updated weights for policy 1, policy_version 1062347 (0.0010) [2023-12-26 08:08:00,725][123090] Updated weights for policy 1, policy_version 1062357 (0.0008) [2023-12-26 08:08:00,788][123090] Updated weights for policy 1, policy_version 1062367 (0.0009) [2023-12-26 08:08:01,240][123091] Updated weights for policy 0, policy_version 1069785 (0.0009) [2023-12-26 08:08:01,305][123091] Updated weights for policy 0, policy_version 1069795 (0.0007) [2023-12-26 08:08:01,375][123091] Updated weights for policy 0, policy_version 1069805 (0.0007) [2023-12-26 08:08:01,668][123090] Updated weights for policy 1, policy_version 1062377 (0.0008) [2023-12-26 08:08:01,737][123090] Updated weights for policy 1, policy_version 1062387 (0.0008) [2023-12-26 08:08:01,790][123090] Updated weights for policy 1, policy_version 1062397 (0.0010) [2023-12-26 08:08:02,178][123091] Updated weights for policy 0, policy_version 1069815 (0.0007) [2023-12-26 08:08:02,241][123091] Updated weights for policy 0, policy_version 1069825 (0.0010) [2023-12-26 08:08:02,307][123091] Updated weights for policy 0, policy_version 1069835 (0.0009) [2023-12-26 08:08:02,613][123090] Updated weights for policy 1, policy_version 1062407 (0.0009) [2023-12-26 08:08:02,662][123090] Updated weights for policy 1, policy_version 1062417 (0.0009) [2023-12-26 08:08:02,720][123090] Updated weights for policy 1, policy_version 1062427 (0.0010) [2023-12-26 08:08:03,109][123091] Updated weights for policy 0, policy_version 1069845 (0.0009) [2023-12-26 08:08:03,160][123091] Updated weights for policy 0, policy_version 1069855 (0.0008) [2023-12-26 08:08:03,208][123091] Updated weights for policy 0, policy_version 1069865 (0.0009) [2023-12-26 08:08:03,516][123090] Updated weights for policy 1, policy_version 1062438 (0.0007) [2023-12-26 08:08:03,567][123090] Updated weights for policy 1, policy_version 1062448 (0.0005) [2023-12-26 08:08:03,614][123090] Updated weights for policy 1, policy_version 1062458 (0.0005) [2023-12-26 08:08:03,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 545882112. Throughput: 0: 9004.4, 1: 8890.5. Samples: 545890720. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:03,785][121949] Avg episode reward: [(0, '6104.214'), (1, '5290.171')] [2023-12-26 08:08:04,146][123091] Updated weights for policy 0, policy_version 1069875 (0.0009) [2023-12-26 08:08:04,208][123091] Updated weights for policy 0, policy_version 1069885 (0.0009) [2023-12-26 08:08:04,260][123091] Updated weights for policy 0, policy_version 1069895 (0.0009) [2023-12-26 08:08:04,334][123090] Updated weights for policy 1, policy_version 1062468 (0.0007) [2023-12-26 08:08:04,386][123090] Updated weights for policy 1, policy_version 1062478 (0.0010) [2023-12-26 08:08:04,443][123090] Updated weights for policy 1, policy_version 1062488 (0.0010) [2023-12-26 08:08:05,104][123091] Updated weights for policy 0, policy_version 1069905 (0.0009) [2023-12-26 08:08:05,172][123091] Updated weights for policy 0, policy_version 1069915 (0.0010) [2023-12-26 08:08:05,236][123091] Updated weights for policy 0, policy_version 1069925 (0.0011) [2023-12-26 08:08:05,242][123090] Updated weights for policy 1, policy_version 1062498 (0.0009) [2023-12-26 08:08:05,292][123090] Updated weights for policy 1, policy_version 1062508 (0.0005) [2023-12-26 08:08:05,302][123091] Updated weights for policy 0, policy_version 1069935 (0.0010) [2023-12-26 08:08:05,340][123090] Updated weights for policy 1, policy_version 1062518 (0.0005) [2023-12-26 08:08:05,398][123090] Updated weights for policy 1, policy_version 1062528 (0.0008) [2023-12-26 08:08:06,154][123091] Updated weights for policy 0, policy_version 1069945 (0.0007) [2023-12-26 08:08:06,209][123091] Updated weights for policy 0, policy_version 1069955 (0.0008) [2023-12-26 08:08:06,233][123090] Updated weights for policy 1, policy_version 1062538 (0.0008) [2023-12-26 08:08:06,273][123091] Updated weights for policy 0, policy_version 1069965 (0.0007) [2023-12-26 08:08:06,297][123090] Updated weights for policy 1, policy_version 1062548 (0.0010) [2023-12-26 08:08:06,355][123090] Updated weights for policy 1, policy_version 1062558 (0.0009) [2023-12-26 08:08:07,045][123091] Updated weights for policy 0, policy_version 1069975 (0.0008) [2023-12-26 08:08:07,093][123091] Updated weights for policy 0, policy_version 1069985 (0.0009) [2023-12-26 08:08:07,142][123091] Updated weights for policy 0, policy_version 1069995 (0.0009) [2023-12-26 08:08:07,214][123090] Updated weights for policy 1, policy_version 1062568 (0.0011) [2023-12-26 08:08:07,281][123090] Updated weights for policy 1, policy_version 1062578 (0.0010) [2023-12-26 08:08:07,337][123090] Updated weights for policy 1, policy_version 1062588 (0.0010) [2023-12-26 08:08:07,951][123091] Updated weights for policy 0, policy_version 1070005 (0.0009) [2023-12-26 08:08:08,013][123091] Updated weights for policy 0, policy_version 1070015 (0.0009) [2023-12-26 08:08:08,053][123090] Updated weights for policy 1, policy_version 1062598 (0.0009) [2023-12-26 08:08:08,073][123091] Updated weights for policy 0, policy_version 1070025 (0.0009) [2023-12-26 08:08:08,123][123090] Updated weights for policy 1, policy_version 1062608 (0.0006) [2023-12-26 08:08:08,190][123090] Updated weights for policy 1, policy_version 1062618 (0.0006) [2023-12-26 08:08:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 545964032. Throughput: 0: 8974.0, 1: 8923.5. Samples: 545942832. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:08,785][121949] Avg episode reward: [(0, '6173.815'), (1, '5571.122')] [2023-12-26 08:08:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001070032_273932288.pth... [2023-12-26 08:08:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001062624_272031744.pth... [2023-12-26 08:08:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001069008_273670144.pth [2023-12-26 08:08:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001061600_271769600.pth [2023-12-26 08:08:08,896][123090] Updated weights for policy 1, policy_version 1062628 (0.0007) [2023-12-26 08:08:08,960][123090] Updated weights for policy 1, policy_version 1062638 (0.0005) [2023-12-26 08:08:08,980][123091] Updated weights for policy 0, policy_version 1070035 (0.0010) [2023-12-26 08:08:09,028][123090] Updated weights for policy 1, policy_version 1062648 (0.0005) [2023-12-26 08:08:09,031][123091] Updated weights for policy 0, policy_version 1070045 (0.0010) [2023-12-26 08:08:09,087][123091] Updated weights for policy 0, policy_version 1070055 (0.0009) [2023-12-26 08:08:09,807][123090] Updated weights for policy 1, policy_version 1062658 (0.0007) [2023-12-26 08:08:09,877][123090] Updated weights for policy 1, policy_version 1062668 (0.0010) [2023-12-26 08:08:09,915][123091] Updated weights for policy 0, policy_version 1070065 (0.0010) [2023-12-26 08:08:09,946][123090] Updated weights for policy 1, policy_version 1062678 (0.0008) [2023-12-26 08:08:09,986][123091] Updated weights for policy 0, policy_version 1070075 (0.0008) [2023-12-26 08:08:10,010][123090] Updated weights for policy 1, policy_version 1062688 (0.0007) [2023-12-26 08:08:10,053][123091] Updated weights for policy 0, policy_version 1070085 (0.0008) [2023-12-26 08:08:10,119][123091] Updated weights for policy 0, policy_version 1070095 (0.0008) [2023-12-26 08:08:10,801][123090] Updated weights for policy 1, policy_version 1062698 (0.0005) [2023-12-26 08:08:10,845][123091] Updated weights for policy 0, policy_version 1070105 (0.0006) [2023-12-26 08:08:10,857][123090] Updated weights for policy 1, policy_version 1062708 (0.0005) [2023-12-26 08:08:10,915][123091] Updated weights for policy 0, policy_version 1070115 (0.0006) [2023-12-26 08:08:10,920][123090] Updated weights for policy 1, policy_version 1062718 (0.0008) [2023-12-26 08:08:10,970][123091] Updated weights for policy 0, policy_version 1070125 (0.0005) [2023-12-26 08:08:11,699][123090] Updated weights for policy 1, policy_version 1062728 (0.0010) [2023-12-26 08:08:11,769][123090] Updated weights for policy 1, policy_version 1062738 (0.0009) [2023-12-26 08:08:11,799][123091] Updated weights for policy 0, policy_version 1070135 (0.0007) [2023-12-26 08:08:11,824][123090] Updated weights for policy 1, policy_version 1062748 (0.0008) [2023-12-26 08:08:11,865][123091] Updated weights for policy 0, policy_version 1070145 (0.0008) [2023-12-26 08:08:11,930][123091] Updated weights for policy 0, policy_version 1070155 (0.0008) [2023-12-26 08:08:12,608][123090] Updated weights for policy 1, policy_version 1062758 (0.0010) [2023-12-26 08:08:12,664][123090] Updated weights for policy 1, policy_version 1062768 (0.0009) [2023-12-26 08:08:12,728][123090] Updated weights for policy 1, policy_version 1062778 (0.0005) [2023-12-26 08:08:12,793][123091] Updated weights for policy 0, policy_version 1070165 (0.0009) [2023-12-26 08:08:12,860][123091] Updated weights for policy 0, policy_version 1070175 (0.0011) [2023-12-26 08:08:12,915][123091] Updated weights for policy 0, policy_version 1070185 (0.0011) [2023-12-26 08:08:13,385][123090] Updated weights for policy 1, policy_version 1062788 (0.0006) [2023-12-26 08:08:13,441][123090] Updated weights for policy 1, policy_version 1062798 (0.0005) [2023-12-26 08:08:13,498][123090] Updated weights for policy 1, policy_version 1062808 (0.0006) [2023-12-26 08:08:13,499][123091] Updated weights for policy 0, policy_version 1070195 (0.0008) [2023-12-26 08:08:13,554][123091] Updated weights for policy 0, policy_version 1070205 (0.0005) [2023-12-26 08:08:13,621][123091] Updated weights for policy 0, policy_version 1070215 (0.0005) [2023-12-26 08:08:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 546062336. Throughput: 0: 8860.2, 1: 8908.5. Samples: 546049220. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:13,785][121949] Avg episode reward: [(0, '6242.491'), (1, '5510.054')] [2023-12-26 08:08:14,172][123090] Updated weights for policy 1, policy_version 1062818 (0.0006) [2023-12-26 08:08:14,225][123090] Updated weights for policy 1, policy_version 1062828 (0.0005) [2023-12-26 08:08:14,284][123090] Updated weights for policy 1, policy_version 1062838 (0.0005) [2023-12-26 08:08:14,331][123090] Updated weights for policy 1, policy_version 1062848 (0.0005) [2023-12-26 08:08:14,366][123091] Updated weights for policy 0, policy_version 1070225 (0.0006) [2023-12-26 08:08:14,420][123091] Updated weights for policy 0, policy_version 1070235 (0.0009) [2023-12-26 08:08:14,475][123091] Updated weights for policy 0, policy_version 1070245 (0.0005) [2023-12-26 08:08:14,533][123091] Updated weights for policy 0, policy_version 1070255 (0.0005) [2023-12-26 08:08:15,057][123090] Updated weights for policy 1, policy_version 1062858 (0.0006) [2023-12-26 08:08:15,132][123090] Updated weights for policy 1, policy_version 1062868 (0.0007) [2023-12-26 08:08:15,204][123090] Updated weights for policy 1, policy_version 1062878 (0.0008) [2023-12-26 08:08:15,283][123091] Updated weights for policy 0, policy_version 1070265 (0.0010) [2023-12-26 08:08:15,350][123091] Updated weights for policy 0, policy_version 1070275 (0.0011) [2023-12-26 08:08:15,414][123091] Updated weights for policy 0, policy_version 1070285 (0.0011) [2023-12-26 08:08:16,032][123090] Updated weights for policy 1, policy_version 1062888 (0.0006) [2023-12-26 08:08:16,095][123090] Updated weights for policy 1, policy_version 1062898 (0.0006) [2023-12-26 08:08:16,124][123091] Updated weights for policy 0, policy_version 1070295 (0.0010) [2023-12-26 08:08:16,152][123090] Updated weights for policy 1, policy_version 1062908 (0.0007) [2023-12-26 08:08:16,168][123091] Updated weights for policy 0, policy_version 1070305 (0.0010) [2023-12-26 08:08:16,219][123091] Updated weights for policy 0, policy_version 1070315 (0.0010) [2023-12-26 08:08:16,910][123091] Updated weights for policy 0, policy_version 1070325 (0.0008) [2023-12-26 08:08:16,958][123090] Updated weights for policy 1, policy_version 1062918 (0.0007) [2023-12-26 08:08:16,975][123091] Updated weights for policy 0, policy_version 1070335 (0.0010) [2023-12-26 08:08:17,023][123090] Updated weights for policy 1, policy_version 1062928 (0.0006) [2023-12-26 08:08:17,039][123091] Updated weights for policy 0, policy_version 1070345 (0.0011) [2023-12-26 08:08:17,077][123090] Updated weights for policy 1, policy_version 1062938 (0.0007) [2023-12-26 08:08:17,773][123091] Updated weights for policy 0, policy_version 1070355 (0.0009) [2023-12-26 08:08:17,792][123090] Updated weights for policy 1, policy_version 1062948 (0.0008) [2023-12-26 08:08:17,840][123091] Updated weights for policy 0, policy_version 1070365 (0.0008) [2023-12-26 08:08:17,850][123090] Updated weights for policy 1, policy_version 1062958 (0.0005) [2023-12-26 08:08:17,903][123090] Updated weights for policy 1, policy_version 1062968 (0.0005) [2023-12-26 08:08:17,912][123091] Updated weights for policy 0, policy_version 1070375 (0.0009) [2023-12-26 08:08:18,552][123090] Updated weights for policy 1, policy_version 1062978 (0.0005) [2023-12-26 08:08:18,605][123091] Updated weights for policy 0, policy_version 1070385 (0.0006) [2023-12-26 08:08:18,620][123090] Updated weights for policy 1, policy_version 1062988 (0.0006) [2023-12-26 08:08:18,656][123091] Updated weights for policy 0, policy_version 1070395 (0.0010) [2023-12-26 08:08:18,683][123090] Updated weights for policy 1, policy_version 1062998 (0.0008) [2023-12-26 08:08:18,715][123091] Updated weights for policy 0, policy_version 1070405 (0.0011) [2023-12-26 08:08:18,750][123090] Updated weights for policy 1, policy_version 1063008 (0.0008) [2023-12-26 08:08:18,770][123091] Updated weights for policy 0, policy_version 1070415 (0.0011) [2023-12-26 08:08:18,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 546160640. Throughput: 0: 8936.5, 1: 8967.7. Samples: 546164660. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:18,785][121949] Avg episode reward: [(0, '6250.235'), (1, '5511.257')] [2023-12-26 08:08:19,444][123090] Updated weights for policy 1, policy_version 1063018 (0.0010) [2023-12-26 08:08:19,516][123090] Updated weights for policy 1, policy_version 1063028 (0.0011) [2023-12-26 08:08:19,584][123090] Updated weights for policy 1, policy_version 1063038 (0.0006) [2023-12-26 08:08:19,648][123091] Updated weights for policy 0, policy_version 1070425 (0.0011) [2023-12-26 08:08:19,703][123091] Updated weights for policy 0, policy_version 1070435 (0.0011) [2023-12-26 08:08:19,770][123091] Updated weights for policy 0, policy_version 1070445 (0.0011) [2023-12-26 08:08:20,388][123090] Updated weights for policy 1, policy_version 1063048 (0.0006) [2023-12-26 08:08:20,457][123090] Updated weights for policy 1, policy_version 1063058 (0.0008) [2023-12-26 08:08:20,529][123090] Updated weights for policy 1, policy_version 1063068 (0.0011) [2023-12-26 08:08:20,612][123091] Updated weights for policy 0, policy_version 1070455 (0.0010) [2023-12-26 08:08:20,676][123091] Updated weights for policy 0, policy_version 1070465 (0.0011) [2023-12-26 08:08:20,737][123091] Updated weights for policy 0, policy_version 1070475 (0.0011) [2023-12-26 08:08:21,340][123090] Updated weights for policy 1, policy_version 1063078 (0.0011) [2023-12-26 08:08:21,416][123090] Updated weights for policy 1, policy_version 1063088 (0.0007) [2023-12-26 08:08:21,479][123090] Updated weights for policy 1, policy_version 1063098 (0.0009) [2023-12-26 08:08:21,572][123091] Updated weights for policy 0, policy_version 1070485 (0.0011) [2023-12-26 08:08:21,640][123091] Updated weights for policy 0, policy_version 1070495 (0.0011) [2023-12-26 08:08:21,712][123091] Updated weights for policy 0, policy_version 1070505 (0.0010) [2023-12-26 08:08:22,263][123090] Updated weights for policy 1, policy_version 1063108 (0.0009) [2023-12-26 08:08:22,334][123090] Updated weights for policy 1, policy_version 1063118 (0.0010) [2023-12-26 08:08:22,405][123090] Updated weights for policy 1, policy_version 1063128 (0.0008) [2023-12-26 08:08:22,522][123091] Updated weights for policy 0, policy_version 1070515 (0.0011) [2023-12-26 08:08:22,594][123091] Updated weights for policy 0, policy_version 1070525 (0.0008) [2023-12-26 08:08:22,662][123091] Updated weights for policy 0, policy_version 1070535 (0.0010) [2023-12-26 08:08:23,183][123090] Updated weights for policy 1, policy_version 1063138 (0.0010) [2023-12-26 08:08:23,238][123090] Updated weights for policy 1, policy_version 1063148 (0.0010) [2023-12-26 08:08:23,293][123090] Updated weights for policy 1, policy_version 1063158 (0.0010) [2023-12-26 08:08:23,449][123091] Updated weights for policy 0, policy_version 1070545 (0.0009) [2023-12-26 08:08:23,526][123091] Updated weights for policy 0, policy_version 1070555 (0.0008) [2023-12-26 08:08:23,588][123091] Updated weights for policy 0, policy_version 1070565 (0.0009) [2023-12-26 08:08:23,650][123091] Updated weights for policy 0, policy_version 1070575 (0.0010) [2023-12-26 08:08:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 546242560. Throughput: 0: 8895.7, 1: 8956.1. Samples: 546216384. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:23,785][121949] Avg episode reward: [(0, '6153.775'), (1, '5572.737')] [2023-12-26 08:08:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001063168_272171008.pth... [2023-12-26 08:08:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001070576_274071552.pth... [2023-12-26 08:08:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001062112_271900672.pth [2023-12-26 08:08:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001069520_273801216.pth [2023-12-26 08:08:24,156][123090] Updated weights for policy 1, policy_version 1063169 (0.0011) [2023-12-26 08:08:24,209][123090] Updated weights for policy 1, policy_version 1063179 (0.0009) [2023-12-26 08:08:24,258][123090] Updated weights for policy 1, policy_version 1063189 (0.0009) [2023-12-26 08:08:24,310][123090] Updated weights for policy 1, policy_version 1063199 (0.0009) [2023-12-26 08:08:24,490][123091] Updated weights for policy 0, policy_version 1070585 (0.0006) [2023-12-26 08:08:24,567][123091] Updated weights for policy 0, policy_version 1070595 (0.0006) [2023-12-26 08:08:24,623][123091] Updated weights for policy 0, policy_version 1070605 (0.0005) [2023-12-26 08:08:25,182][123090] Updated weights for policy 1, policy_version 1063209 (0.0010) [2023-12-26 08:08:25,228][123091] Updated weights for policy 0, policy_version 1070615 (0.0005) [2023-12-26 08:08:25,230][123090] Updated weights for policy 1, policy_version 1063219 (0.0010) [2023-12-26 08:08:25,284][123091] Updated weights for policy 0, policy_version 1070625 (0.0006) [2023-12-26 08:08:25,285][123090] Updated weights for policy 1, policy_version 1063229 (0.0010) [2023-12-26 08:08:25,350][123091] Updated weights for policy 0, policy_version 1070635 (0.0008) [2023-12-26 08:08:26,108][123091] Updated weights for policy 0, policy_version 1070645 (0.0007) [2023-12-26 08:08:26,119][123090] Updated weights for policy 1, policy_version 1063239 (0.0010) [2023-12-26 08:08:26,159][123091] Updated weights for policy 0, policy_version 1070655 (0.0006) [2023-12-26 08:08:26,170][123090] Updated weights for policy 1, policy_version 1063249 (0.0010) [2023-12-26 08:08:26,217][123091] Updated weights for policy 0, policy_version 1070665 (0.0006) [2023-12-26 08:08:26,228][123090] Updated weights for policy 1, policy_version 1063259 (0.0010) [2023-12-26 08:08:26,870][123091] Updated weights for policy 0, policy_version 1070675 (0.0005) [2023-12-26 08:08:26,946][123091] Updated weights for policy 0, policy_version 1070685 (0.0005) [2023-12-26 08:08:26,990][123090] Updated weights for policy 1, policy_version 1063269 (0.0008) [2023-12-26 08:08:27,014][123091] Updated weights for policy 0, policy_version 1070695 (0.0006) [2023-12-26 08:08:27,039][123090] Updated weights for policy 1, policy_version 1063279 (0.0005) [2023-12-26 08:08:27,093][123090] Updated weights for policy 1, policy_version 1063289 (0.0010) [2023-12-26 08:08:27,615][123091] Updated weights for policy 0, policy_version 1070705 (0.0005) [2023-12-26 08:08:27,675][123091] Updated weights for policy 0, policy_version 1070715 (0.0005) [2023-12-26 08:08:27,727][123091] Updated weights for policy 0, policy_version 1070725 (0.0005) [2023-12-26 08:08:27,776][123091] Updated weights for policy 0, policy_version 1070735 (0.0005) [2023-12-26 08:08:27,799][123090] Updated weights for policy 1, policy_version 1063299 (0.0010) [2023-12-26 08:08:27,853][123090] Updated weights for policy 1, policy_version 1063309 (0.0010) [2023-12-26 08:08:27,909][123090] Updated weights for policy 1, policy_version 1063319 (0.0006) [2023-12-26 08:08:28,444][123091] Updated weights for policy 0, policy_version 1070745 (0.0009) [2023-12-26 08:08:28,493][123091] Updated weights for policy 0, policy_version 1070755 (0.0009) [2023-12-26 08:08:28,541][123091] Updated weights for policy 0, policy_version 1070765 (0.0009) [2023-12-26 08:08:28,611][123090] Updated weights for policy 1, policy_version 1063329 (0.0005) [2023-12-26 08:08:28,683][123090] Updated weights for policy 1, policy_version 1063339 (0.0005) [2023-12-26 08:08:28,750][123090] Updated weights for policy 1, policy_version 1063349 (0.0005) [2023-12-26 08:08:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 546332672. Throughput: 0: 9001.4, 1: 9028.3. Samples: 546325848. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:28,785][121949] Avg episode reward: [(0, '5946.389'), (1, '5668.562')] [2023-12-26 08:08:28,814][123090] Updated weights for policy 1, policy_version 1063359 (0.0006) [2023-12-26 08:08:29,269][123091] Updated weights for policy 0, policy_version 1070775 (0.0010) [2023-12-26 08:08:29,329][123091] Updated weights for policy 0, policy_version 1070785 (0.0010) [2023-12-26 08:08:29,393][123091] Updated weights for policy 0, policy_version 1070795 (0.0010) [2023-12-26 08:08:29,456][123090] Updated weights for policy 1, policy_version 1063369 (0.0005) [2023-12-26 08:08:29,524][123090] Updated weights for policy 1, policy_version 1063379 (0.0005) [2023-12-26 08:08:29,592][123090] Updated weights for policy 1, policy_version 1063389 (0.0005) [2023-12-26 08:08:30,194][123091] Updated weights for policy 0, policy_version 1070805 (0.0010) [2023-12-26 08:08:30,257][123091] Updated weights for policy 0, policy_version 1070815 (0.0009) [2023-12-26 08:08:30,277][123090] Updated weights for policy 1, policy_version 1063399 (0.0007) [2023-12-26 08:08:30,321][123091] Updated weights for policy 0, policy_version 1070825 (0.0009) [2023-12-26 08:08:30,345][123090] Updated weights for policy 1, policy_version 1063409 (0.0007) [2023-12-26 08:08:30,410][123090] Updated weights for policy 1, policy_version 1063419 (0.0007) [2023-12-26 08:08:31,183][123090] Updated weights for policy 1, policy_version 1063429 (0.0009) [2023-12-26 08:08:31,189][123091] Updated weights for policy 0, policy_version 1070835 (0.0009) [2023-12-26 08:08:31,243][123090] Updated weights for policy 1, policy_version 1063439 (0.0009) [2023-12-26 08:08:31,246][123091] Updated weights for policy 0, policy_version 1070845 (0.0008) [2023-12-26 08:08:31,308][123091] Updated weights for policy 0, policy_version 1070855 (0.0009) [2023-12-26 08:08:31,313][123090] Updated weights for policy 1, policy_version 1063449 (0.0007) [2023-12-26 08:08:32,096][123090] Updated weights for policy 1, policy_version 1063459 (0.0007) [2023-12-26 08:08:32,107][123091] Updated weights for policy 0, policy_version 1070865 (0.0007) [2023-12-26 08:08:32,156][123091] Updated weights for policy 0, policy_version 1070875 (0.0006) [2023-12-26 08:08:32,160][123090] Updated weights for policy 1, policy_version 1063469 (0.0005) [2023-12-26 08:08:32,213][123091] Updated weights for policy 0, policy_version 1070885 (0.0005) [2023-12-26 08:08:32,221][123090] Updated weights for policy 1, policy_version 1063479 (0.0005) [2023-12-26 08:08:32,274][123091] Updated weights for policy 0, policy_version 1070895 (0.0009) [2023-12-26 08:08:32,874][123090] Updated weights for policy 1, policy_version 1063489 (0.0006) [2023-12-26 08:08:32,936][123090] Updated weights for policy 1, policy_version 1063499 (0.0005) [2023-12-26 08:08:32,996][123090] Updated weights for policy 1, policy_version 1063509 (0.0007) [2023-12-26 08:08:33,015][123091] Updated weights for policy 0, policy_version 1070905 (0.0006) [2023-12-26 08:08:33,058][123090] Updated weights for policy 1, policy_version 1063519 (0.0010) [2023-12-26 08:08:33,070][123091] Updated weights for policy 0, policy_version 1070915 (0.0007) [2023-12-26 08:08:33,129][123091] Updated weights for policy 0, policy_version 1070925 (0.0009) [2023-12-26 08:08:33,776][123090] Updated weights for policy 1, policy_version 1063529 (0.0009) [2023-12-26 08:08:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 546422784. Throughput: 0: 8956.7, 1: 9110.6. Samples: 546437932. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:33,785][121949] Avg episode reward: [(0, '5810.414'), (1, '5536.650')] [2023-12-26 08:08:33,832][123090] Updated weights for policy 1, policy_version 1063539 (0.0010) [2023-12-26 08:08:33,883][123090] Updated weights for policy 1, policy_version 1063550 (0.0010) [2023-12-26 08:08:33,917][123091] Updated weights for policy 0, policy_version 1070935 (0.0007) [2023-12-26 08:08:33,980][123091] Updated weights for policy 0, policy_version 1070945 (0.0008) [2023-12-26 08:08:34,043][123091] Updated weights for policy 0, policy_version 1070955 (0.0005) [2023-12-26 08:08:34,743][123090] Updated weights for policy 1, policy_version 1063560 (0.0010) [2023-12-26 08:08:34,793][123090] Updated weights for policy 1, policy_version 1063570 (0.0008) [2023-12-26 08:08:34,806][123091] Updated weights for policy 0, policy_version 1070965 (0.0006) [2023-12-26 08:08:34,845][123090] Updated weights for policy 1, policy_version 1063580 (0.0005) [2023-12-26 08:08:34,871][123091] Updated weights for policy 0, policy_version 1070975 (0.0010) [2023-12-26 08:08:34,918][123091] Updated weights for policy 0, policy_version 1070985 (0.0008) [2023-12-26 08:08:35,549][123090] Updated weights for policy 1, policy_version 1063590 (0.0006) [2023-12-26 08:08:35,603][123090] Updated weights for policy 1, policy_version 1063600 (0.0007) [2023-12-26 08:08:35,652][123090] Updated weights for policy 1, policy_version 1063610 (0.0009) [2023-12-26 08:08:35,703][123091] Updated weights for policy 0, policy_version 1070996 (0.0009) [2023-12-26 08:08:35,783][123091] Updated weights for policy 0, policy_version 1071006 (0.0010) [2023-12-26 08:08:35,850][123091] Updated weights for policy 0, policy_version 1071016 (0.0010) [2023-12-26 08:08:36,441][123090] Updated weights for policy 1, policy_version 1063620 (0.0007) [2023-12-26 08:08:36,509][123090] Updated weights for policy 1, policy_version 1063630 (0.0010) [2023-12-26 08:08:36,578][123090] Updated weights for policy 1, policy_version 1063640 (0.0011) [2023-12-26 08:08:36,717][123091] Updated weights for policy 0, policy_version 1071026 (0.0010) [2023-12-26 08:08:36,787][123091] Updated weights for policy 0, policy_version 1071036 (0.0009) [2023-12-26 08:08:36,852][123091] Updated weights for policy 0, policy_version 1071046 (0.0009) [2023-12-26 08:08:36,922][123091] Updated weights for policy 0, policy_version 1071056 (0.0011) [2023-12-26 08:08:37,347][123090] Updated weights for policy 1, policy_version 1063650 (0.0010) [2023-12-26 08:08:37,405][123090] Updated weights for policy 1, policy_version 1063660 (0.0006) [2023-12-26 08:08:37,463][123090] Updated weights for policy 1, policy_version 1063670 (0.0006) [2023-12-26 08:08:37,536][123090] Updated weights for policy 1, policy_version 1063680 (0.0005) [2023-12-26 08:08:37,773][123091] Updated weights for policy 0, policy_version 1071066 (0.0010) [2023-12-26 08:08:37,833][123091] Updated weights for policy 0, policy_version 1071076 (0.0011) [2023-12-26 08:08:37,896][123091] Updated weights for policy 0, policy_version 1071086 (0.0011) [2023-12-26 08:08:38,186][123090] Updated weights for policy 1, policy_version 1063690 (0.0007) [2023-12-26 08:08:38,253][123090] Updated weights for policy 1, policy_version 1063700 (0.0007) [2023-12-26 08:08:38,328][123090] Updated weights for policy 1, policy_version 1063710 (0.0008) [2023-12-26 08:08:38,725][123091] Updated weights for policy 0, policy_version 1071096 (0.0007) [2023-12-26 08:08:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 546512896. Throughput: 0: 9007.9, 1: 9153.4. Samples: 546492932. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:38,785][121949] Avg episode reward: [(0, '5936.339'), (1, '5271.705')] [2023-12-26 08:08:38,791][123091] Updated weights for policy 0, policy_version 1071106 (0.0006) [2023-12-26 08:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001063712_272310272.pth... [2023-12-26 08:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001062624_272031744.pth [2023-12-26 08:08:38,860][123091] Updated weights for policy 0, policy_version 1071116 (0.0005) [2023-12-26 08:08:38,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001071120_274210816.pth... [2023-12-26 08:08:38,893][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001070032_273932288.pth [2023-12-26 08:08:39,023][123090] Updated weights for policy 1, policy_version 1063720 (0.0010) [2023-12-26 08:08:39,083][123090] Updated weights for policy 1, policy_version 1063730 (0.0011) [2023-12-26 08:08:39,151][123090] Updated weights for policy 1, policy_version 1063740 (0.0011) [2023-12-26 08:08:39,602][123091] Updated weights for policy 0, policy_version 1071126 (0.0007) [2023-12-26 08:08:39,668][123091] Updated weights for policy 0, policy_version 1071136 (0.0006) [2023-12-26 08:08:39,733][123091] Updated weights for policy 0, policy_version 1071146 (0.0006) [2023-12-26 08:08:39,884][123090] Updated weights for policy 1, policy_version 1063750 (0.0011) [2023-12-26 08:08:39,955][123090] Updated weights for policy 1, policy_version 1063760 (0.0011) [2023-12-26 08:08:40,023][123090] Updated weights for policy 1, policy_version 1063770 (0.0010) [2023-12-26 08:08:40,505][123091] Updated weights for policy 0, policy_version 1071156 (0.0007) [2023-12-26 08:08:40,554][123091] Updated weights for policy 0, policy_version 1071166 (0.0009) [2023-12-26 08:08:40,603][123091] Updated weights for policy 0, policy_version 1071176 (0.0008) [2023-12-26 08:08:40,833][123090] Updated weights for policy 1, policy_version 1063780 (0.0011) [2023-12-26 08:08:40,899][123090] Updated weights for policy 1, policy_version 1063790 (0.0011) [2023-12-26 08:08:40,966][123090] Updated weights for policy 1, policy_version 1063800 (0.0010) [2023-12-26 08:08:41,343][123091] Updated weights for policy 0, policy_version 1071186 (0.0006) [2023-12-26 08:08:41,416][123091] Updated weights for policy 0, policy_version 1071196 (0.0008) [2023-12-26 08:08:41,480][123091] Updated weights for policy 0, policy_version 1071206 (0.0009) [2023-12-26 08:08:41,532][123091] Updated weights for policy 0, policy_version 1071216 (0.0009) [2023-12-26 08:08:41,791][123090] Updated weights for policy 1, policy_version 1063810 (0.0011) [2023-12-26 08:08:41,855][123090] Updated weights for policy 1, policy_version 1063820 (0.0011) [2023-12-26 08:08:41,911][123090] Updated weights for policy 1, policy_version 1063830 (0.0010) [2023-12-26 08:08:41,963][123090] Updated weights for policy 1, policy_version 1063840 (0.0008) [2023-12-26 08:08:42,385][123091] Updated weights for policy 0, policy_version 1071226 (0.0011) [2023-12-26 08:08:42,432][123091] Updated weights for policy 0, policy_version 1071236 (0.0011) [2023-12-26 08:08:42,499][123091] Updated weights for policy 0, policy_version 1071246 (0.0011) [2023-12-26 08:08:42,744][123090] Updated weights for policy 1, policy_version 1063850 (0.0006) [2023-12-26 08:08:42,796][123090] Updated weights for policy 1, policy_version 1063860 (0.0005) [2023-12-26 08:08:42,857][123090] Updated weights for policy 1, policy_version 1063870 (0.0006) [2023-12-26 08:08:43,205][123091] Updated weights for policy 0, policy_version 1071256 (0.0011) [2023-12-26 08:08:43,253][123091] Updated weights for policy 0, policy_version 1071266 (0.0006) [2023-12-26 08:08:43,329][123091] Updated weights for policy 0, policy_version 1071276 (0.0007) [2023-12-26 08:08:43,567][123090] Updated weights for policy 1, policy_version 1063880 (0.0009) [2023-12-26 08:08:43,622][123090] Updated weights for policy 1, policy_version 1063890 (0.0010) [2023-12-26 08:08:43,670][123090] Updated weights for policy 1, policy_version 1063900 (0.0009) [2023-12-26 08:08:43,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 546611200. Throughput: 0: 8972.3, 1: 9140.7. Samples: 546599708. Policy #0 lag: (min: 31.0, avg: 35.4, max: 63.0) [2023-12-26 08:08:43,784][121949] Avg episode reward: [(0, '6039.661'), (1, '5392.947')] [2023-12-26 08:08:44,151][123091] Updated weights for policy 0, policy_version 1071286 (0.0010) [2023-12-26 08:08:44,209][123091] Updated weights for policy 0, policy_version 1071296 (0.0010) [2023-12-26 08:08:44,269][123091] Updated weights for policy 0, policy_version 1071306 (0.0010) [2023-12-26 08:08:44,464][123090] Updated weights for policy 1, policy_version 1063910 (0.0008) [2023-12-26 08:08:44,509][123090] Updated weights for policy 1, policy_version 1063920 (0.0010) [2023-12-26 08:08:44,568][123090] Updated weights for policy 1, policy_version 1063930 (0.0010) [2023-12-26 08:08:45,097][123091] Updated weights for policy 0, policy_version 1071316 (0.0009) [2023-12-26 08:08:45,164][123091] Updated weights for policy 0, policy_version 1071326 (0.0009) [2023-12-26 08:08:45,235][123091] Updated weights for policy 0, policy_version 1071336 (0.0006) [2023-12-26 08:08:45,374][123090] Updated weights for policy 1, policy_version 1063940 (0.0008) [2023-12-26 08:08:45,442][123090] Updated weights for policy 1, policy_version 1063950 (0.0010) [2023-12-26 08:08:45,522][123090] Updated weights for policy 1, policy_version 1063960 (0.0011) [2023-12-26 08:08:45,826][123091] Updated weights for policy 0, policy_version 1071346 (0.0006) [2023-12-26 08:08:45,892][123091] Updated weights for policy 0, policy_version 1071356 (0.0009) [2023-12-26 08:08:45,948][123091] Updated weights for policy 0, policy_version 1071366 (0.0009) [2023-12-26 08:08:46,000][123091] Updated weights for policy 0, policy_version 1071376 (0.0009) [2023-12-26 08:08:46,305][123090] Updated weights for policy 1, policy_version 1063970 (0.0009) [2023-12-26 08:08:46,382][123090] Updated weights for policy 1, policy_version 1063980 (0.0005) [2023-12-26 08:08:46,439][123090] Updated weights for policy 1, policy_version 1063990 (0.0006) [2023-12-26 08:08:46,493][123090] Updated weights for policy 1, policy_version 1064000 (0.0007) [2023-12-26 08:08:46,905][123091] Updated weights for policy 0, policy_version 1071386 (0.0009) [2023-12-26 08:08:46,959][123091] Updated weights for policy 0, policy_version 1071396 (0.0010) [2023-12-26 08:08:47,020][123091] Updated weights for policy 0, policy_version 1071406 (0.0009) [2023-12-26 08:08:47,147][123090] Updated weights for policy 1, policy_version 1064010 (0.0005) [2023-12-26 08:08:47,198][123090] Updated weights for policy 1, policy_version 1064020 (0.0006) [2023-12-26 08:08:47,254][123090] Updated weights for policy 1, policy_version 1064030 (0.0010) [2023-12-26 08:08:47,874][123091] Updated weights for policy 0, policy_version 1071416 (0.0006) [2023-12-26 08:08:47,926][123090] Updated weights for policy 1, policy_version 1064040 (0.0011) [2023-12-26 08:08:47,931][123091] Updated weights for policy 0, policy_version 1071426 (0.0010) [2023-12-26 08:08:47,986][123090] Updated weights for policy 1, policy_version 1064050 (0.0010) [2023-12-26 08:08:47,986][123091] Updated weights for policy 0, policy_version 1071436 (0.0010) [2023-12-26 08:08:48,048][123090] Updated weights for policy 1, policy_version 1064060 (0.0007) [2023-12-26 08:08:48,778][123090] Updated weights for policy 1, policy_version 1064070 (0.0007) [2023-12-26 08:08:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 546693120. Throughput: 0: 8983.1, 1: 9224.6. Samples: 546710064. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:08:48,785][121949] Avg episode reward: [(0, '6036.682'), (1, '5337.514')] [2023-12-26 08:08:48,791][123091] Updated weights for policy 0, policy_version 1071446 (0.0011) [2023-12-26 08:08:48,835][123090] Updated weights for policy 1, policy_version 1064080 (0.0008) [2023-12-26 08:08:48,851][123091] Updated weights for policy 0, policy_version 1071456 (0.0011) [2023-12-26 08:08:48,889][123090] Updated weights for policy 1, policy_version 1064090 (0.0006) [2023-12-26 08:08:48,904][123091] Updated weights for policy 0, policy_version 1071466 (0.0011) [2023-12-26 08:08:49,740][123091] Updated weights for policy 0, policy_version 1071476 (0.0011) [2023-12-26 08:08:49,747][123090] Updated weights for policy 1, policy_version 1064100 (0.0007) [2023-12-26 08:08:49,802][123091] Updated weights for policy 0, policy_version 1071486 (0.0011) [2023-12-26 08:08:49,805][123090] Updated weights for policy 1, policy_version 1064110 (0.0008) [2023-12-26 08:08:49,865][123091] Updated weights for policy 0, policy_version 1071496 (0.0011) [2023-12-26 08:08:49,876][123090] Updated weights for policy 1, policy_version 1064120 (0.0007) [2023-12-26 08:08:50,643][123090] Updated weights for policy 1, policy_version 1064130 (0.0008) [2023-12-26 08:08:50,667][123091] Updated weights for policy 0, policy_version 1071506 (0.0009) [2023-12-26 08:08:50,706][123090] Updated weights for policy 1, policy_version 1064140 (0.0010) [2023-12-26 08:08:50,727][123091] Updated weights for policy 0, policy_version 1071516 (0.0007) [2023-12-26 08:08:50,776][123090] Updated weights for policy 1, policy_version 1064150 (0.0008) [2023-12-26 08:08:50,788][123091] Updated weights for policy 0, policy_version 1071526 (0.0007) [2023-12-26 08:08:50,845][123090] Updated weights for policy 1, policy_version 1064160 (0.0008) [2023-12-26 08:08:50,853][123091] Updated weights for policy 0, policy_version 1071536 (0.0008) [2023-12-26 08:08:51,666][123091] Updated weights for policy 0, policy_version 1071546 (0.0009) [2023-12-26 08:08:51,737][123090] Updated weights for policy 1, policy_version 1064170 (0.0008) [2023-12-26 08:08:51,740][123091] Updated weights for policy 0, policy_version 1071556 (0.0009) [2023-12-26 08:08:51,801][123091] Updated weights for policy 0, policy_version 1071566 (0.0006) [2023-12-26 08:08:51,803][123090] Updated weights for policy 1, policy_version 1064180 (0.0008) [2023-12-26 08:08:51,876][123090] Updated weights for policy 1, policy_version 1064190 (0.0008) [2023-12-26 08:08:52,601][123091] Updated weights for policy 0, policy_version 1071576 (0.0006) [2023-12-26 08:08:52,666][123091] Updated weights for policy 0, policy_version 1071586 (0.0010) [2023-12-26 08:08:52,684][123090] Updated weights for policy 1, policy_version 1064200 (0.0007) [2023-12-26 08:08:52,728][123091] Updated weights for policy 0, policy_version 1071596 (0.0007) [2023-12-26 08:08:52,741][123090] Updated weights for policy 1, policy_version 1064210 (0.0010) [2023-12-26 08:08:52,790][123090] Updated weights for policy 1, policy_version 1064220 (0.0010) [2023-12-26 08:08:53,384][123091] Updated weights for policy 0, policy_version 1071606 (0.0007) [2023-12-26 08:08:53,453][123091] Updated weights for policy 0, policy_version 1071616 (0.0009) [2023-12-26 08:08:53,518][123091] Updated weights for policy 0, policy_version 1071626 (0.0009) [2023-12-26 08:08:53,692][123090] Updated weights for policy 1, policy_version 1064230 (0.0010) [2023-12-26 08:08:53,750][123090] Updated weights for policy 1, policy_version 1064240 (0.0010) [2023-12-26 08:08:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 546783232. Throughput: 0: 9011.4, 1: 9191.5. Samples: 546761960. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:08:53,784][121949] Avg episode reward: [(0, '6152.137'), (1, '5281.589')] [2023-12-26 08:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001071632_274341888.pth... [2023-12-26 08:08:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001070576_274071552.pth [2023-12-26 08:08:53,813][123090] Updated weights for policy 1, policy_version 1064250 (0.0010) [2023-12-26 08:08:53,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001064256_272449536.pth... [2023-12-26 08:08:53,852][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001063168_272171008.pth [2023-12-26 08:08:54,305][123091] Updated weights for policy 0, policy_version 1071636 (0.0007) [2023-12-26 08:08:54,372][123091] Updated weights for policy 0, policy_version 1071646 (0.0005) [2023-12-26 08:08:54,435][123091] Updated weights for policy 0, policy_version 1071656 (0.0005) [2023-12-26 08:08:54,680][123090] Updated weights for policy 1, policy_version 1064260 (0.0009) [2023-12-26 08:08:54,732][123090] Updated weights for policy 1, policy_version 1064270 (0.0010) [2023-12-26 08:08:54,793][123090] Updated weights for policy 1, policy_version 1064280 (0.0010) [2023-12-26 08:08:55,144][123091] Updated weights for policy 0, policy_version 1071666 (0.0006) [2023-12-26 08:08:55,208][123091] Updated weights for policy 0, policy_version 1071676 (0.0010) [2023-12-26 08:08:55,266][123091] Updated weights for policy 0, policy_version 1071686 (0.0009) [2023-12-26 08:08:55,321][123091] Updated weights for policy 0, policy_version 1071696 (0.0009) [2023-12-26 08:08:55,628][123090] Updated weights for policy 1, policy_version 1064290 (0.0010) [2023-12-26 08:08:55,692][123090] Updated weights for policy 1, policy_version 1064300 (0.0009) [2023-12-26 08:08:55,756][123090] Updated weights for policy 1, policy_version 1064310 (0.0009) [2023-12-26 08:08:55,820][123090] Updated weights for policy 1, policy_version 1064320 (0.0008) [2023-12-26 08:08:56,151][123091] Updated weights for policy 0, policy_version 1071706 (0.0010) [2023-12-26 08:08:56,203][123091] Updated weights for policy 0, policy_version 1071716 (0.0010) [2023-12-26 08:08:56,258][123091] Updated weights for policy 0, policy_version 1071726 (0.0010) [2023-12-26 08:08:56,584][123090] Updated weights for policy 1, policy_version 1064330 (0.0009) [2023-12-26 08:08:56,653][123090] Updated weights for policy 1, policy_version 1064340 (0.0009) [2023-12-26 08:08:56,709][123090] Updated weights for policy 1, policy_version 1064350 (0.0009) [2023-12-26 08:08:57,137][123091] Updated weights for policy 0, policy_version 1071736 (0.0009) [2023-12-26 08:08:57,191][123091] Updated weights for policy 0, policy_version 1071746 (0.0009) [2023-12-26 08:08:57,239][123091] Updated weights for policy 0, policy_version 1071756 (0.0009) [2023-12-26 08:08:57,469][123090] Updated weights for policy 1, policy_version 1064360 (0.0009) [2023-12-26 08:08:57,541][123090] Updated weights for policy 1, policy_version 1064370 (0.0009) [2023-12-26 08:08:57,589][123090] Updated weights for policy 1, policy_version 1064380 (0.0009) [2023-12-26 08:08:58,070][123091] Updated weights for policy 0, policy_version 1071766 (0.0009) [2023-12-26 08:08:58,136][123091] Updated weights for policy 0, policy_version 1071776 (0.0009) [2023-12-26 08:08:58,191][123091] Updated weights for policy 0, policy_version 1071786 (0.0009) [2023-12-26 08:08:58,426][123090] Updated weights for policy 1, policy_version 1064390 (0.0009) [2023-12-26 08:08:58,501][123090] Updated weights for policy 1, policy_version 1064400 (0.0009) [2023-12-26 08:08:58,571][123090] Updated weights for policy 1, policy_version 1064410 (0.0008) [2023-12-26 08:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 546873344. Throughput: 0: 9032.6, 1: 9115.3. Samples: 546865872. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:08:58,785][121949] Avg episode reward: [(0, '6028.575'), (1, '5271.999')] [2023-12-26 08:08:59,227][123091] Updated weights for policy 0, policy_version 1071796 (0.0009) [2023-12-26 08:08:59,292][123091] Updated weights for policy 0, policy_version 1071806 (0.0010) [2023-12-26 08:08:59,353][123091] Updated weights for policy 0, policy_version 1071816 (0.0010) [2023-12-26 08:08:59,551][123090] Updated weights for policy 1, policy_version 1064420 (0.0008) [2023-12-26 08:08:59,624][123090] Updated weights for policy 1, policy_version 1064430 (0.0005) [2023-12-26 08:08:59,697][123090] Updated weights for policy 1, policy_version 1064440 (0.0007) [2023-12-26 08:09:00,155][123091] Updated weights for policy 0, policy_version 1071826 (0.0009) [2023-12-26 08:09:00,219][123091] Updated weights for policy 0, policy_version 1071836 (0.0006) [2023-12-26 08:09:00,281][123091] Updated weights for policy 0, policy_version 1071846 (0.0008) [2023-12-26 08:09:00,332][123091] Updated weights for policy 0, policy_version 1071856 (0.0010) [2023-12-26 08:09:00,393][123090] Updated weights for policy 1, policy_version 1064450 (0.0007) [2023-12-26 08:09:00,457][123090] Updated weights for policy 1, policy_version 1064460 (0.0009) [2023-12-26 08:09:00,514][123090] Updated weights for policy 1, policy_version 1064470 (0.0010) [2023-12-26 08:09:00,567][123090] Updated weights for policy 1, policy_version 1064480 (0.0009) [2023-12-26 08:09:01,123][123091] Updated weights for policy 0, policy_version 1071866 (0.0010) [2023-12-26 08:09:01,187][123091] Updated weights for policy 0, policy_version 1071876 (0.0010) [2023-12-26 08:09:01,253][123091] Updated weights for policy 0, policy_version 1071886 (0.0010) [2023-12-26 08:09:01,392][123090] Updated weights for policy 1, policy_version 1064490 (0.0009) [2023-12-26 08:09:01,457][123090] Updated weights for policy 1, policy_version 1064500 (0.0009) [2023-12-26 08:09:01,512][123090] Updated weights for policy 1, policy_version 1064510 (0.0010) [2023-12-26 08:09:02,081][123091] Updated weights for policy 0, policy_version 1071896 (0.0009) [2023-12-26 08:09:02,143][123091] Updated weights for policy 0, policy_version 1071906 (0.0008) [2023-12-26 08:09:02,205][123091] Updated weights for policy 0, policy_version 1071916 (0.0009) [2023-12-26 08:09:02,398][123090] Updated weights for policy 1, policy_version 1064520 (0.0010) [2023-12-26 08:09:02,463][123090] Updated weights for policy 1, policy_version 1064530 (0.0009) [2023-12-26 08:09:02,510][123090] Updated weights for policy 1, policy_version 1064540 (0.0008) [2023-12-26 08:09:02,972][123091] Updated weights for policy 0, policy_version 1071926 (0.0007) [2023-12-26 08:09:03,019][123091] Updated weights for policy 0, policy_version 1071936 (0.0009) [2023-12-26 08:09:03,080][123091] Updated weights for policy 0, policy_version 1071946 (0.0009) [2023-12-26 08:09:03,355][123090] Updated weights for policy 1, policy_version 1064550 (0.0010) [2023-12-26 08:09:03,419][123090] Updated weights for policy 1, policy_version 1064560 (0.0010) [2023-12-26 08:09:03,470][123090] Updated weights for policy 1, policy_version 1064570 (0.0010) [2023-12-26 08:09:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 546955264. Throughput: 0: 8883.4, 1: 8966.0. Samples: 546967880. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:03,784][121949] Avg episode reward: [(0, '6093.599'), (1, '5262.027')] [2023-12-26 08:09:03,835][123091] Updated weights for policy 0, policy_version 1071956 (0.0008) [2023-12-26 08:09:03,895][123091] Updated weights for policy 0, policy_version 1071966 (0.0007) [2023-12-26 08:09:03,962][123091] Updated weights for policy 0, policy_version 1071976 (0.0005) [2023-12-26 08:09:04,091][123090] Updated weights for policy 1, policy_version 1064580 (0.0010) [2023-12-26 08:09:04,156][123090] Updated weights for policy 1, policy_version 1064590 (0.0009) [2023-12-26 08:09:04,225][123090] Updated weights for policy 1, policy_version 1064600 (0.0009) [2023-12-26 08:09:04,689][123091] Updated weights for policy 0, policy_version 1071986 (0.0006) [2023-12-26 08:09:04,738][123091] Updated weights for policy 0, policy_version 1071996 (0.0005) [2023-12-26 08:09:04,798][123091] Updated weights for policy 0, policy_version 1072006 (0.0005) [2023-12-26 08:09:04,860][123091] Updated weights for policy 0, policy_version 1072016 (0.0005) [2023-12-26 08:09:05,004][123090] Updated weights for policy 1, policy_version 1064610 (0.0008) [2023-12-26 08:09:05,070][123090] Updated weights for policy 1, policy_version 1064620 (0.0005) [2023-12-26 08:09:05,143][123090] Updated weights for policy 1, policy_version 1064631 (0.0006) [2023-12-26 08:09:05,526][123091] Updated weights for policy 0, policy_version 1072026 (0.0010) [2023-12-26 08:09:05,580][123091] Updated weights for policy 0, policy_version 1072036 (0.0010) [2023-12-26 08:09:05,628][123091] Updated weights for policy 0, policy_version 1072046 (0.0010) [2023-12-26 08:09:05,837][123090] Updated weights for policy 1, policy_version 1064641 (0.0005) [2023-12-26 08:09:05,913][123090] Updated weights for policy 1, policy_version 1064651 (0.0005) [2023-12-26 08:09:05,991][123090] Updated weights for policy 1, policy_version 1064661 (0.0005) [2023-12-26 08:09:06,066][123090] Updated weights for policy 1, policy_version 1064671 (0.0005) [2023-12-26 08:09:06,377][123091] Updated weights for policy 0, policy_version 1072056 (0.0011) [2023-12-26 08:09:06,445][123091] Updated weights for policy 0, policy_version 1072066 (0.0011) [2023-12-26 08:09:06,513][123091] Updated weights for policy 0, policy_version 1072076 (0.0011) [2023-12-26 08:09:06,696][123090] Updated weights for policy 1, policy_version 1064681 (0.0007) [2023-12-26 08:09:06,764][123090] Updated weights for policy 1, policy_version 1064691 (0.0008) [2023-12-26 08:09:06,828][123090] Updated weights for policy 1, policy_version 1064701 (0.0010) [2023-12-26 08:09:07,194][123091] Updated weights for policy 0, policy_version 1072086 (0.0008) [2023-12-26 08:09:07,251][123091] Updated weights for policy 0, policy_version 1072096 (0.0006) [2023-12-26 08:09:07,307][123091] Updated weights for policy 0, policy_version 1072106 (0.0006) [2023-12-26 08:09:07,643][123090] Updated weights for policy 1, policy_version 1064711 (0.0011) [2023-12-26 08:09:07,706][123090] Updated weights for policy 1, policy_version 1064721 (0.0010) [2023-12-26 08:09:07,765][123090] Updated weights for policy 1, policy_version 1064731 (0.0010) [2023-12-26 08:09:07,984][123091] Updated weights for policy 0, policy_version 1072116 (0.0006) [2023-12-26 08:09:08,044][123091] Updated weights for policy 0, policy_version 1072126 (0.0006) [2023-12-26 08:09:08,101][123091] Updated weights for policy 0, policy_version 1072136 (0.0005) [2023-12-26 08:09:08,496][123090] Updated weights for policy 1, policy_version 1064741 (0.0010) [2023-12-26 08:09:08,559][123090] Updated weights for policy 1, policy_version 1064751 (0.0010) [2023-12-26 08:09:08,623][123090] Updated weights for policy 1, policy_version 1064761 (0.0010) [2023-12-26 08:09:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 547053568. Throughput: 0: 8985.2, 1: 9030.3. Samples: 547027084. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:08,785][121949] Avg episode reward: [(0, '6193.570'), (1, '5422.078')] [2023-12-26 08:09:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001064768_272580608.pth... [2023-12-26 08:09:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001072144_274472960.pth... [2023-12-26 08:09:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001071120_274210816.pth [2023-12-26 08:09:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001063712_272310272.pth [2023-12-26 08:09:08,818][123091] Updated weights for policy 0, policy_version 1072146 (0.0006) [2023-12-26 08:09:08,886][123091] Updated weights for policy 0, policy_version 1072156 (0.0009) [2023-12-26 08:09:08,946][123091] Updated weights for policy 0, policy_version 1072166 (0.0010) [2023-12-26 08:09:09,008][123091] Updated weights for policy 0, policy_version 1072176 (0.0006) [2023-12-26 08:09:09,398][123090] Updated weights for policy 1, policy_version 1064771 (0.0012) [2023-12-26 08:09:09,462][123090] Updated weights for policy 1, policy_version 1064782 (0.0009) [2023-12-26 08:09:09,517][123090] Updated weights for policy 1, policy_version 1064792 (0.0009) [2023-12-26 08:09:09,714][123091] Updated weights for policy 0, policy_version 1072186 (0.0011) [2023-12-26 08:09:09,780][123091] Updated weights for policy 0, policy_version 1072196 (0.0009) [2023-12-26 08:09:09,850][123091] Updated weights for policy 0, policy_version 1072206 (0.0009) [2023-12-26 08:09:10,351][123090] Updated weights for policy 1, policy_version 1064802 (0.0010) [2023-12-26 08:09:10,414][123090] Updated weights for policy 1, policy_version 1064812 (0.0010) [2023-12-26 08:09:10,470][123090] Updated weights for policy 1, policy_version 1064822 (0.0010) [2023-12-26 08:09:10,520][123090] Updated weights for policy 1, policy_version 1064832 (0.0009) [2023-12-26 08:09:10,712][123091] Updated weights for policy 0, policy_version 1072216 (0.0010) [2023-12-26 08:09:10,779][123091] Updated weights for policy 0, policy_version 1072226 (0.0010) [2023-12-26 08:09:10,839][123091] Updated weights for policy 0, policy_version 1072236 (0.0009) [2023-12-26 08:09:11,338][123090] Updated weights for policy 1, policy_version 1064842 (0.0008) [2023-12-26 08:09:11,405][123090] Updated weights for policy 1, policy_version 1064852 (0.0011) [2023-12-26 08:09:11,473][123090] Updated weights for policy 1, policy_version 1064862 (0.0011) [2023-12-26 08:09:11,692][123091] Updated weights for policy 0, policy_version 1072246 (0.0009) [2023-12-26 08:09:11,762][123091] Updated weights for policy 0, policy_version 1072256 (0.0009) [2023-12-26 08:09:11,831][123091] Updated weights for policy 0, policy_version 1072266 (0.0008) [2023-12-26 08:09:12,304][123090] Updated weights for policy 1, policy_version 1064872 (0.0009) [2023-12-26 08:09:12,382][123090] Updated weights for policy 1, policy_version 1064882 (0.0008) [2023-12-26 08:09:12,442][123090] Updated weights for policy 1, policy_version 1064892 (0.0006) [2023-12-26 08:09:12,580][123091] Updated weights for policy 0, policy_version 1072276 (0.0009) [2023-12-26 08:09:12,645][123091] Updated weights for policy 0, policy_version 1072286 (0.0010) [2023-12-26 08:09:12,700][123091] Updated weights for policy 0, policy_version 1072296 (0.0011) [2023-12-26 08:09:13,155][123090] Updated weights for policy 1, policy_version 1064902 (0.0006) [2023-12-26 08:09:13,215][123090] Updated weights for policy 1, policy_version 1064912 (0.0006) [2023-12-26 08:09:13,285][123090] Updated weights for policy 1, policy_version 1064922 (0.0005) [2023-12-26 08:09:13,490][123091] Updated weights for policy 0, policy_version 1072306 (0.0009) [2023-12-26 08:09:13,545][123091] Updated weights for policy 0, policy_version 1072316 (0.0005) [2023-12-26 08:09:13,610][123091] Updated weights for policy 0, policy_version 1072326 (0.0007) [2023-12-26 08:09:13,665][123091] Updated weights for policy 0, policy_version 1072336 (0.0010) [2023-12-26 08:09:13,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 547143680. Throughput: 0: 8946.7, 1: 9027.2. Samples: 547134676. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:13,785][121949] Avg episode reward: [(0, '6139.269'), (1, '5510.141')] [2023-12-26 08:09:13,932][123090] Updated weights for policy 1, policy_version 1064932 (0.0007) [2023-12-26 08:09:13,990][123090] Updated weights for policy 1, policy_version 1064942 (0.0010) [2023-12-26 08:09:14,050][123090] Updated weights for policy 1, policy_version 1064952 (0.0009) [2023-12-26 08:09:14,378][123091] Updated weights for policy 0, policy_version 1072346 (0.0005) [2023-12-26 08:09:14,433][123091] Updated weights for policy 0, policy_version 1072356 (0.0005) [2023-12-26 08:09:14,504][123091] Updated weights for policy 0, policy_version 1072366 (0.0006) [2023-12-26 08:09:14,797][123090] Updated weights for policy 1, policy_version 1064962 (0.0009) [2023-12-26 08:09:14,874][123090] Updated weights for policy 1, policy_version 1064972 (0.0007) [2023-12-26 08:09:14,930][123090] Updated weights for policy 1, policy_version 1064982 (0.0010) [2023-12-26 08:09:15,003][123090] Updated weights for policy 1, policy_version 1064992 (0.0010) [2023-12-26 08:09:15,255][123091] Updated weights for policy 0, policy_version 1072376 (0.0008) [2023-12-26 08:09:15,307][123091] Updated weights for policy 0, policy_version 1072386 (0.0005) [2023-12-26 08:09:15,370][123091] Updated weights for policy 0, policy_version 1072396 (0.0008) [2023-12-26 08:09:15,819][123090] Updated weights for policy 1, policy_version 1065002 (0.0010) [2023-12-26 08:09:15,862][123090] Updated weights for policy 1, policy_version 1065012 (0.0010) [2023-12-26 08:09:15,916][123090] Updated weights for policy 1, policy_version 1065022 (0.0007) [2023-12-26 08:09:16,068][123091] Updated weights for policy 0, policy_version 1072406 (0.0006) [2023-12-26 08:09:16,123][123091] Updated weights for policy 0, policy_version 1072416 (0.0005) [2023-12-26 08:09:16,168][123091] Updated weights for policy 0, policy_version 1072426 (0.0005) [2023-12-26 08:09:16,572][123090] Updated weights for policy 1, policy_version 1065032 (0.0005) [2023-12-26 08:09:16,634][123090] Updated weights for policy 1, policy_version 1065042 (0.0005) [2023-12-26 08:09:16,693][123090] Updated weights for policy 1, policy_version 1065052 (0.0008) [2023-12-26 08:09:16,909][123091] Updated weights for policy 0, policy_version 1072436 (0.0005) [2023-12-26 08:09:16,956][123091] Updated weights for policy 0, policy_version 1072446 (0.0005) [2023-12-26 08:09:17,001][123091] Updated weights for policy 0, policy_version 1072456 (0.0005) [2023-12-26 08:09:17,474][123090] Updated weights for policy 1, policy_version 1065062 (0.0011) [2023-12-26 08:09:17,531][123090] Updated weights for policy 1, policy_version 1065072 (0.0006) [2023-12-26 08:09:17,589][123090] Updated weights for policy 1, policy_version 1065082 (0.0005) [2023-12-26 08:09:17,661][123091] Updated weights for policy 0, policy_version 1072466 (0.0005) [2023-12-26 08:09:17,718][123091] Updated weights for policy 0, policy_version 1072476 (0.0006) [2023-12-26 08:09:17,787][123091] Updated weights for policy 0, policy_version 1072486 (0.0005) [2023-12-26 08:09:17,846][123091] Updated weights for policy 0, policy_version 1072496 (0.0005) [2023-12-26 08:09:18,331][123090] Updated weights for policy 1, policy_version 1065092 (0.0006) [2023-12-26 08:09:18,393][123090] Updated weights for policy 1, policy_version 1065102 (0.0008) [2023-12-26 08:09:18,445][123090] Updated weights for policy 1, policy_version 1065112 (0.0008) [2023-12-26 08:09:18,554][123091] Updated weights for policy 0, policy_version 1072506 (0.0010) [2023-12-26 08:09:18,618][123091] Updated weights for policy 0, policy_version 1072516 (0.0011) [2023-12-26 08:09:18,677][123091] Updated weights for policy 0, policy_version 1072526 (0.0010) [2023-12-26 08:09:18,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 547241984. Throughput: 0: 9017.3, 1: 9015.6. Samples: 547249408. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:18,784][121949] Avg episode reward: [(0, '6186.450'), (1, '5245.916')] [2023-12-26 08:09:19,275][123090] Updated weights for policy 1, policy_version 1065122 (0.0008) [2023-12-26 08:09:19,332][123090] Updated weights for policy 1, policy_version 1065132 (0.0010) [2023-12-26 08:09:19,399][123090] Updated weights for policy 1, policy_version 1065142 (0.0008) [2023-12-26 08:09:19,409][123091] Updated weights for policy 0, policy_version 1072536 (0.0008) [2023-12-26 08:09:19,455][123090] Updated weights for policy 1, policy_version 1065152 (0.0008) [2023-12-26 08:09:19,469][123091] Updated weights for policy 0, policy_version 1072546 (0.0010) [2023-12-26 08:09:19,539][123091] Updated weights for policy 0, policy_version 1072556 (0.0010) [2023-12-26 08:09:20,334][123091] Updated weights for policy 0, policy_version 1072566 (0.0008) [2023-12-26 08:09:20,336][123090] Updated weights for policy 1, policy_version 1065162 (0.0009) [2023-12-26 08:09:20,404][123090] Updated weights for policy 1, policy_version 1065172 (0.0007) [2023-12-26 08:09:20,404][123091] Updated weights for policy 0, policy_version 1072576 (0.0007) [2023-12-26 08:09:20,466][123091] Updated weights for policy 0, policy_version 1072586 (0.0009) [2023-12-26 08:09:20,476][123090] Updated weights for policy 1, policy_version 1065182 (0.0007) [2023-12-26 08:09:21,276][123090] Updated weights for policy 1, policy_version 1065192 (0.0008) [2023-12-26 08:09:21,298][123091] Updated weights for policy 0, policy_version 1072596 (0.0008) [2023-12-26 08:09:21,343][123090] Updated weights for policy 1, policy_version 1065202 (0.0008) [2023-12-26 08:09:21,375][123091] Updated weights for policy 0, policy_version 1072606 (0.0008) [2023-12-26 08:09:21,418][123090] Updated weights for policy 1, policy_version 1065212 (0.0008) [2023-12-26 08:09:21,446][123091] Updated weights for policy 0, policy_version 1072616 (0.0009) [2023-12-26 08:09:22,274][123091] Updated weights for policy 0, policy_version 1072626 (0.0010) [2023-12-26 08:09:22,297][123090] Updated weights for policy 1, policy_version 1065222 (0.0008) [2023-12-26 08:09:22,338][123091] Updated weights for policy 0, policy_version 1072636 (0.0010) [2023-12-26 08:09:22,365][123090] Updated weights for policy 1, policy_version 1065232 (0.0007) [2023-12-26 08:09:22,413][123091] Updated weights for policy 0, policy_version 1072646 (0.0010) [2023-12-26 08:09:22,433][123090] Updated weights for policy 1, policy_version 1065242 (0.0007) [2023-12-26 08:09:22,477][123091] Updated weights for policy 0, policy_version 1072656 (0.0011) [2023-12-26 08:09:23,168][123091] Updated weights for policy 0, policy_version 1072666 (0.0005) [2023-12-26 08:09:23,224][123090] Updated weights for policy 1, policy_version 1065252 (0.0008) [2023-12-26 08:09:23,233][123091] Updated weights for policy 0, policy_version 1072676 (0.0005) [2023-12-26 08:09:23,277][123090] Updated weights for policy 1, policy_version 1065262 (0.0009) [2023-12-26 08:09:23,286][123091] Updated weights for policy 0, policy_version 1072686 (0.0005) [2023-12-26 08:09:23,329][123090] Updated weights for policy 1, policy_version 1065272 (0.0009) [2023-12-26 08:09:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 547323904. Throughput: 0: 9003.5, 1: 8955.1. Samples: 547301064. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:23,785][121949] Avg episode reward: [(0, '6042.936'), (1, '5412.706')] [2023-12-26 08:09:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001065280_272711680.pth... [2023-12-26 08:09:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001072688_274612224.pth... [2023-12-26 08:09:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001064256_272449536.pth [2023-12-26 08:09:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001071632_274341888.pth [2023-12-26 08:09:23,919][123091] Updated weights for policy 0, policy_version 1072696 (0.0010) [2023-12-26 08:09:23,974][123091] Updated weights for policy 0, policy_version 1072706 (0.0009) [2023-12-26 08:09:24,038][123091] Updated weights for policy 0, policy_version 1072716 (0.0011) [2023-12-26 08:09:24,268][123090] Updated weights for policy 1, policy_version 1065282 (0.0010) [2023-12-26 08:09:24,327][123090] Updated weights for policy 1, policy_version 1065292 (0.0010) [2023-12-26 08:09:24,389][123090] Updated weights for policy 1, policy_version 1065302 (0.0009) [2023-12-26 08:09:24,443][123090] Updated weights for policy 1, policy_version 1065312 (0.0010) [2023-12-26 08:09:24,695][123091] Updated weights for policy 0, policy_version 1072726 (0.0008) [2023-12-26 08:09:24,755][123091] Updated weights for policy 0, policy_version 1072736 (0.0005) [2023-12-26 08:09:24,804][123091] Updated weights for policy 0, policy_version 1072746 (0.0008) [2023-12-26 08:09:25,399][123090] Updated weights for policy 1, policy_version 1065322 (0.0009) [2023-12-26 08:09:25,461][123090] Updated weights for policy 1, policy_version 1065332 (0.0008) [2023-12-26 08:09:25,466][123091] Updated weights for policy 0, policy_version 1072756 (0.0010) [2023-12-26 08:09:25,521][123090] Updated weights for policy 1, policy_version 1065342 (0.0009) [2023-12-26 08:09:25,535][123091] Updated weights for policy 0, policy_version 1072766 (0.0009) [2023-12-26 08:09:25,599][123091] Updated weights for policy 0, policy_version 1072776 (0.0009) [2023-12-26 08:09:26,295][123091] Updated weights for policy 0, policy_version 1072786 (0.0008) [2023-12-26 08:09:26,306][123090] Updated weights for policy 1, policy_version 1065352 (0.0005) [2023-12-26 08:09:26,353][123090] Updated weights for policy 1, policy_version 1065362 (0.0005) [2023-12-26 08:09:26,355][123091] Updated weights for policy 0, policy_version 1072796 (0.0005) [2023-12-26 08:09:26,400][123090] Updated weights for policy 1, policy_version 1065372 (0.0005) [2023-12-26 08:09:26,426][123091] Updated weights for policy 0, policy_version 1072806 (0.0006) [2023-12-26 08:09:26,477][123091] Updated weights for policy 0, policy_version 1072816 (0.0010) [2023-12-26 08:09:27,066][123090] Updated weights for policy 1, policy_version 1065382 (0.0006) [2023-12-26 08:09:27,138][123090] Updated weights for policy 1, policy_version 1065392 (0.0005) [2023-12-26 08:09:27,185][123091] Updated weights for policy 0, policy_version 1072826 (0.0008) [2023-12-26 08:09:27,196][123090] Updated weights for policy 1, policy_version 1065402 (0.0005) [2023-12-26 08:09:27,247][123091] Updated weights for policy 0, policy_version 1072836 (0.0011) [2023-12-26 08:09:27,305][123091] Updated weights for policy 0, policy_version 1072846 (0.0010) [2023-12-26 08:09:27,936][123090] Updated weights for policy 1, policy_version 1065412 (0.0007) [2023-12-26 08:09:27,984][123090] Updated weights for policy 1, policy_version 1065422 (0.0010) [2023-12-26 08:09:28,042][123090] Updated weights for policy 1, policy_version 1065432 (0.0010) [2023-12-26 08:09:28,111][123091] Updated weights for policy 0, policy_version 1072856 (0.0010) [2023-12-26 08:09:28,172][123091] Updated weights for policy 0, policy_version 1072866 (0.0010) [2023-12-26 08:09:28,230][123091] Updated weights for policy 0, policy_version 1072876 (0.0010) [2023-12-26 08:09:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 547414016. Throughput: 0: 9147.1, 1: 8888.6. Samples: 547411316. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:28,785][121949] Avg episode reward: [(0, '5954.699'), (1, '5760.275')] [2023-12-26 08:09:28,867][123090] Updated weights for policy 1, policy_version 1065442 (0.0009) [2023-12-26 08:09:28,928][123091] Updated weights for policy 0, policy_version 1072886 (0.0006) [2023-12-26 08:09:28,943][123090] Updated weights for policy 1, policy_version 1065452 (0.0005) [2023-12-26 08:09:28,982][123091] Updated weights for policy 0, policy_version 1072896 (0.0006) [2023-12-26 08:09:29,013][123090] Updated weights for policy 1, policy_version 1065462 (0.0006) [2023-12-26 08:09:29,033][123091] Updated weights for policy 0, policy_version 1072906 (0.0005) [2023-12-26 08:09:29,082][123090] Updated weights for policy 1, policy_version 1065472 (0.0006) [2023-12-26 08:09:29,756][123091] Updated weights for policy 0, policy_version 1072916 (0.0005) [2023-12-26 08:09:29,767][123090] Updated weights for policy 1, policy_version 1065482 (0.0007) [2023-12-26 08:09:29,820][123091] Updated weights for policy 0, policy_version 1072926 (0.0006) [2023-12-26 08:09:29,832][123090] Updated weights for policy 1, policy_version 1065492 (0.0007) [2023-12-26 08:09:29,890][123091] Updated weights for policy 0, policy_version 1072936 (0.0007) [2023-12-26 08:09:29,898][123090] Updated weights for policy 1, policy_version 1065502 (0.0010) [2023-12-26 08:09:30,592][123091] Updated weights for policy 0, policy_version 1072946 (0.0008) [2023-12-26 08:09:30,628][123090] Updated weights for policy 1, policy_version 1065512 (0.0010) [2023-12-26 08:09:30,667][123091] Updated weights for policy 0, policy_version 1072956 (0.0005) [2023-12-26 08:09:30,675][123090] Updated weights for policy 1, policy_version 1065522 (0.0010) [2023-12-26 08:09:30,726][123090] Updated weights for policy 1, policy_version 1065532 (0.0010) [2023-12-26 08:09:30,736][123091] Updated weights for policy 0, policy_version 1072966 (0.0007) [2023-12-26 08:09:30,779][123091] Updated weights for policy 0, policy_version 1072976 (0.0010) [2023-12-26 08:09:31,573][123091] Updated weights for policy 0, policy_version 1072986 (0.0010) [2023-12-26 08:09:31,598][123090] Updated weights for policy 1, policy_version 1065542 (0.0008) [2023-12-26 08:09:31,640][123091] Updated weights for policy 0, policy_version 1072996 (0.0011) [2023-12-26 08:09:31,664][123090] Updated weights for policy 1, policy_version 1065552 (0.0007) [2023-12-26 08:09:31,700][123091] Updated weights for policy 0, policy_version 1073006 (0.0010) [2023-12-26 08:09:31,729][123090] Updated weights for policy 1, policy_version 1065562 (0.0006) [2023-12-26 08:09:32,449][123091] Updated weights for policy 0, policy_version 1073016 (0.0006) [2023-12-26 08:09:32,485][123090] Updated weights for policy 1, policy_version 1065572 (0.0007) [2023-12-26 08:09:32,508][123091] Updated weights for policy 0, policy_version 1073026 (0.0006) [2023-12-26 08:09:32,551][123090] Updated weights for policy 1, policy_version 1065582 (0.0010) [2023-12-26 08:09:32,579][123091] Updated weights for policy 0, policy_version 1073036 (0.0006) [2023-12-26 08:09:32,615][123090] Updated weights for policy 1, policy_version 1065592 (0.0010) [2023-12-26 08:09:33,297][123091] Updated weights for policy 0, policy_version 1073046 (0.0006) [2023-12-26 08:09:33,349][123091] Updated weights for policy 0, policy_version 1073056 (0.0005) [2023-12-26 08:09:33,401][123091] Updated weights for policy 0, policy_version 1073066 (0.0005) [2023-12-26 08:09:33,436][123090] Updated weights for policy 1, policy_version 1065602 (0.0011) [2023-12-26 08:09:33,490][123090] Updated weights for policy 1, policy_version 1065612 (0.0010) [2023-12-26 08:09:33,533][123090] Updated weights for policy 1, policy_version 1065622 (0.0010) [2023-12-26 08:09:33,580][123090] Updated weights for policy 1, policy_version 1065632 (0.0010) [2023-12-26 08:09:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 547512320. Throughput: 0: 9210.1, 1: 8808.0. Samples: 547520880. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:33,785][121949] Avg episode reward: [(0, '6166.388'), (1, '5552.362')] [2023-12-26 08:09:34,167][123091] Updated weights for policy 0, policy_version 1073076 (0.0007) [2023-12-26 08:09:34,228][123091] Updated weights for policy 0, policy_version 1073086 (0.0006) [2023-12-26 08:09:34,288][123091] Updated weights for policy 0, policy_version 1073096 (0.0007) [2023-12-26 08:09:34,438][123090] Updated weights for policy 1, policy_version 1065642 (0.0005) [2023-12-26 08:09:34,498][123090] Updated weights for policy 1, policy_version 1065652 (0.0005) [2023-12-26 08:09:34,554][123090] Updated weights for policy 1, policy_version 1065662 (0.0005) [2023-12-26 08:09:35,029][123091] Updated weights for policy 0, policy_version 1073106 (0.0009) [2023-12-26 08:09:35,076][123091] Updated weights for policy 0, policy_version 1073116 (0.0005) [2023-12-26 08:09:35,123][123091] Updated weights for policy 0, policy_version 1073126 (0.0005) [2023-12-26 08:09:35,169][123091] Updated weights for policy 0, policy_version 1073136 (0.0005) [2023-12-26 08:09:35,282][123090] Updated weights for policy 1, policy_version 1065672 (0.0008) [2023-12-26 08:09:35,341][123090] Updated weights for policy 1, policy_version 1065682 (0.0005) [2023-12-26 08:09:35,399][123090] Updated weights for policy 1, policy_version 1065692 (0.0005) [2023-12-26 08:09:35,868][123091] Updated weights for policy 0, policy_version 1073146 (0.0005) [2023-12-26 08:09:35,914][123091] Updated weights for policy 0, policy_version 1073156 (0.0005) [2023-12-26 08:09:35,922][123090] Updated weights for policy 1, policy_version 1065702 (0.0005) [2023-12-26 08:09:35,966][123091] Updated weights for policy 0, policy_version 1073166 (0.0005) [2023-12-26 08:09:35,999][123090] Updated weights for policy 1, policy_version 1065712 (0.0006) [2023-12-26 08:09:36,080][123090] Updated weights for policy 1, policy_version 1065722 (0.0005) [2023-12-26 08:09:36,662][123091] Updated weights for policy 0, policy_version 1073176 (0.0008) [2023-12-26 08:09:36,717][123091] Updated weights for policy 0, policy_version 1073186 (0.0009) [2023-12-26 08:09:36,777][123091] Updated weights for policy 0, policy_version 1073196 (0.0008) [2023-12-26 08:09:36,873][123090] Updated weights for policy 1, policy_version 1065732 (0.0009) [2023-12-26 08:09:36,921][123090] Updated weights for policy 1, policy_version 1065742 (0.0010) [2023-12-26 08:09:36,977][123090] Updated weights for policy 1, policy_version 1065752 (0.0010) [2023-12-26 08:09:37,581][123091] Updated weights for policy 0, policy_version 1073206 (0.0005) [2023-12-26 08:09:37,635][123091] Updated weights for policy 0, policy_version 1073216 (0.0005) [2023-12-26 08:09:37,695][123091] Updated weights for policy 0, policy_version 1073226 (0.0006) [2023-12-26 08:09:37,816][123090] Updated weights for policy 1, policy_version 1065762 (0.0010) [2023-12-26 08:09:37,868][123090] Updated weights for policy 1, policy_version 1065772 (0.0010) [2023-12-26 08:09:37,923][123090] Updated weights for policy 1, policy_version 1065782 (0.0010) [2023-12-26 08:09:37,993][123090] Updated weights for policy 1, policy_version 1065792 (0.0010) [2023-12-26 08:09:38,312][123091] Updated weights for policy 0, policy_version 1073236 (0.0005) [2023-12-26 08:09:38,376][123091] Updated weights for policy 0, policy_version 1073246 (0.0007) [2023-12-26 08:09:38,433][123091] Updated weights for policy 0, policy_version 1073256 (0.0007) [2023-12-26 08:09:38,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18159.0, 300 sec: 17911.3). Total num frames: 547602432. Throughput: 0: 9280.1, 1: 8863.1. Samples: 547578404. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:38,785][121949] Avg episode reward: [(0, '6248.430'), (1, '5189.746')] [2023-12-26 08:09:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001073264_274759680.pth... [2023-12-26 08:09:38,792][123090] Updated weights for policy 1, policy_version 1065802 (0.0008) [2023-12-26 08:09:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001072144_274472960.pth [2023-12-26 08:09:38,862][123090] Updated weights for policy 1, policy_version 1065812 (0.0008) [2023-12-26 08:09:38,922][123090] Updated weights for policy 1, policy_version 1065822 (0.0010) [2023-12-26 08:09:38,932][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001065824_272850944.pth... [2023-12-26 08:09:38,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001064768_272580608.pth [2023-12-26 08:09:39,157][123091] Updated weights for policy 0, policy_version 1073266 (0.0011) [2023-12-26 08:09:39,219][123091] Updated weights for policy 0, policy_version 1073276 (0.0008) [2023-12-26 08:09:39,275][123091] Updated weights for policy 0, policy_version 1073286 (0.0009) [2023-12-26 08:09:39,345][123091] Updated weights for policy 0, policy_version 1073296 (0.0009) [2023-12-26 08:09:39,767][123090] Updated weights for policy 1, policy_version 1065832 (0.0010) [2023-12-26 08:09:39,834][123090] Updated weights for policy 1, policy_version 1065842 (0.0009) [2023-12-26 08:09:39,902][123090] Updated weights for policy 1, policy_version 1065852 (0.0009) [2023-12-26 08:09:40,246][123091] Updated weights for policy 0, policy_version 1073306 (0.0009) [2023-12-26 08:09:40,307][123091] Updated weights for policy 0, policy_version 1073316 (0.0009) [2023-12-26 08:09:40,367][123091] Updated weights for policy 0, policy_version 1073326 (0.0009) [2023-12-26 08:09:40,749][123090] Updated weights for policy 1, policy_version 1065862 (0.0010) [2023-12-26 08:09:40,816][123090] Updated weights for policy 1, policy_version 1065872 (0.0010) [2023-12-26 08:09:40,886][123090] Updated weights for policy 1, policy_version 1065882 (0.0010) [2023-12-26 08:09:41,251][123091] Updated weights for policy 0, policy_version 1073336 (0.0010) [2023-12-26 08:09:41,320][123091] Updated weights for policy 0, policy_version 1073346 (0.0009) [2023-12-26 08:09:41,389][123091] Updated weights for policy 0, policy_version 1073356 (0.0009) [2023-12-26 08:09:41,702][123090] Updated weights for policy 1, policy_version 1065892 (0.0010) [2023-12-26 08:09:41,782][123090] Updated weights for policy 1, policy_version 1065902 (0.0009) [2023-12-26 08:09:41,853][123090] Updated weights for policy 1, policy_version 1065912 (0.0010) [2023-12-26 08:09:42,235][123091] Updated weights for policy 0, policy_version 1073366 (0.0009) [2023-12-26 08:09:42,302][123091] Updated weights for policy 0, policy_version 1073376 (0.0010) [2023-12-26 08:09:42,377][123091] Updated weights for policy 0, policy_version 1073386 (0.0009) [2023-12-26 08:09:42,613][123090] Updated weights for policy 1, policy_version 1065922 (0.0009) [2023-12-26 08:09:42,681][123090] Updated weights for policy 1, policy_version 1065932 (0.0008) [2023-12-26 08:09:42,746][123090] Updated weights for policy 1, policy_version 1065942 (0.0007) [2023-12-26 08:09:42,814][123090] Updated weights for policy 1, policy_version 1065952 (0.0007) [2023-12-26 08:09:43,273][123091] Updated weights for policy 0, policy_version 1073396 (0.0009) [2023-12-26 08:09:43,327][123091] Updated weights for policy 0, policy_version 1073406 (0.0009) [2023-12-26 08:09:43,375][123091] Updated weights for policy 0, policy_version 1073416 (0.0009) [2023-12-26 08:09:43,517][123090] Updated weights for policy 1, policy_version 1065962 (0.0009) [2023-12-26 08:09:43,564][123090] Updated weights for policy 1, policy_version 1065972 (0.0008) [2023-12-26 08:09:43,614][123090] Updated weights for policy 1, policy_version 1065982 (0.0008) [2023-12-26 08:09:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 547692544. Throughput: 0: 9259.9, 1: 8884.6. Samples: 547682376. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:43,785][121949] Avg episode reward: [(0, '6166.754'), (1, '5191.794')] [2023-12-26 08:09:44,260][123091] Updated weights for policy 0, policy_version 1073426 (0.0009) [2023-12-26 08:09:44,319][123091] Updated weights for policy 0, policy_version 1073436 (0.0010) [2023-12-26 08:09:44,374][123091] Updated weights for policy 0, policy_version 1073446 (0.0009) [2023-12-26 08:09:44,415][123090] Updated weights for policy 1, policy_version 1065992 (0.0008) [2023-12-26 08:09:44,430][123091] Updated weights for policy 0, policy_version 1073456 (0.0008) [2023-12-26 08:09:44,474][123090] Updated weights for policy 1, policy_version 1066002 (0.0009) [2023-12-26 08:09:44,537][123090] Updated weights for policy 1, policy_version 1066012 (0.0008) [2023-12-26 08:09:45,267][123091] Updated weights for policy 0, policy_version 1073466 (0.0010) [2023-12-26 08:09:45,297][123090] Updated weights for policy 1, policy_version 1066022 (0.0007) [2023-12-26 08:09:45,332][123091] Updated weights for policy 0, policy_version 1073476 (0.0008) [2023-12-26 08:09:45,362][123090] Updated weights for policy 1, policy_version 1066032 (0.0009) [2023-12-26 08:09:45,399][123091] Updated weights for policy 0, policy_version 1073486 (0.0008) [2023-12-26 08:09:45,431][123090] Updated weights for policy 1, policy_version 1066042 (0.0010) [2023-12-26 08:09:46,156][123091] Updated weights for policy 0, policy_version 1073496 (0.0005) [2023-12-26 08:09:46,186][123090] Updated weights for policy 1, policy_version 1066052 (0.0008) [2023-12-26 08:09:46,213][123091] Updated weights for policy 0, policy_version 1073506 (0.0005) [2023-12-26 08:09:46,259][123090] Updated weights for policy 1, policy_version 1066062 (0.0005) [2023-12-26 08:09:46,275][123091] Updated weights for policy 0, policy_version 1073516 (0.0007) [2023-12-26 08:09:46,315][123090] Updated weights for policy 1, policy_version 1066072 (0.0006) [2023-12-26 08:09:46,899][123090] Updated weights for policy 1, policy_version 1066082 (0.0005) [2023-12-26 08:09:46,965][123090] Updated weights for policy 1, policy_version 1066092 (0.0005) [2023-12-26 08:09:47,032][123090] Updated weights for policy 1, policy_version 1066102 (0.0008) [2023-12-26 08:09:47,086][123091] Updated weights for policy 0, policy_version 1073526 (0.0009) [2023-12-26 08:09:47,093][123090] Updated weights for policy 1, policy_version 1066112 (0.0009) [2023-12-26 08:09:47,148][123091] Updated weights for policy 0, policy_version 1073536 (0.0010) [2023-12-26 08:09:47,215][123091] Updated weights for policy 0, policy_version 1073546 (0.0010) [2023-12-26 08:09:47,763][123090] Updated weights for policy 1, policy_version 1066122 (0.0008) [2023-12-26 08:09:47,820][123090] Updated weights for policy 1, policy_version 1066132 (0.0009) [2023-12-26 08:09:47,889][123090] Updated weights for policy 1, policy_version 1066142 (0.0008) [2023-12-26 08:09:48,024][123091] Updated weights for policy 0, policy_version 1073556 (0.0010) [2023-12-26 08:09:48,093][123091] Updated weights for policy 0, policy_version 1073566 (0.0009) [2023-12-26 08:09:48,164][123091] Updated weights for policy 0, policy_version 1073576 (0.0009) [2023-12-26 08:09:48,654][123090] Updated weights for policy 1, policy_version 1066152 (0.0008) [2023-12-26 08:09:48,726][123090] Updated weights for policy 1, policy_version 1066162 (0.0008) [2023-12-26 08:09:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 547774464. Throughput: 0: 9244.5, 1: 9028.9. Samples: 547790184. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:48,785][121949] Avg episode reward: [(0, '6152.143'), (1, '5124.457')] [2023-12-26 08:09:48,796][123090] Updated weights for policy 1, policy_version 1066172 (0.0008) [2023-12-26 08:09:49,034][123091] Updated weights for policy 0, policy_version 1073586 (0.0010) [2023-12-26 08:09:49,087][123091] Updated weights for policy 0, policy_version 1073596 (0.0009) [2023-12-26 08:09:49,142][123091] Updated weights for policy 0, policy_version 1073607 (0.0010) [2023-12-26 08:09:49,538][123090] Updated weights for policy 1, policy_version 1066182 (0.0008) [2023-12-26 08:09:49,593][123090] Updated weights for policy 1, policy_version 1066192 (0.0009) [2023-12-26 08:09:49,652][123090] Updated weights for policy 1, policy_version 1066202 (0.0010) [2023-12-26 08:09:49,953][123091] Updated weights for policy 0, policy_version 1073617 (0.0010) [2023-12-26 08:09:50,008][123091] Updated weights for policy 0, policy_version 1073627 (0.0008) [2023-12-26 08:09:50,060][123091] Updated weights for policy 0, policy_version 1073637 (0.0008) [2023-12-26 08:09:50,112][123091] Updated weights for policy 0, policy_version 1073647 (0.0008) [2023-12-26 08:09:50,568][123090] Updated weights for policy 1, policy_version 1066212 (0.0010) [2023-12-26 08:09:50,632][123090] Updated weights for policy 1, policy_version 1066222 (0.0010) [2023-12-26 08:09:50,698][123090] Updated weights for policy 1, policy_version 1066232 (0.0009) [2023-12-26 08:09:50,903][123091] Updated weights for policy 0, policy_version 1073657 (0.0009) [2023-12-26 08:09:50,968][123091] Updated weights for policy 0, policy_version 1073667 (0.0009) [2023-12-26 08:09:51,030][123091] Updated weights for policy 0, policy_version 1073677 (0.0009) [2023-12-26 08:09:51,546][123090] Updated weights for policy 1, policy_version 1066242 (0.0010) [2023-12-26 08:09:51,598][123090] Updated weights for policy 1, policy_version 1066252 (0.0010) [2023-12-26 08:09:51,663][123090] Updated weights for policy 1, policy_version 1066262 (0.0010) [2023-12-26 08:09:51,731][123090] Updated weights for policy 1, policy_version 1066272 (0.0009) [2023-12-26 08:09:51,897][123091] Updated weights for policy 0, policy_version 1073687 (0.0009) [2023-12-26 08:09:51,965][123091] Updated weights for policy 0, policy_version 1073697 (0.0008) [2023-12-26 08:09:52,025][123091] Updated weights for policy 0, policy_version 1073707 (0.0010) [2023-12-26 08:09:52,660][123090] Updated weights for policy 1, policy_version 1066282 (0.0010) [2023-12-26 08:09:52,715][123090] Updated weights for policy 1, policy_version 1066292 (0.0010) [2023-12-26 08:09:52,779][123090] Updated weights for policy 1, policy_version 1066302 (0.0009) [2023-12-26 08:09:52,811][123091] Updated weights for policy 0, policy_version 1073717 (0.0008) [2023-12-26 08:09:52,864][123091] Updated weights for policy 0, policy_version 1073727 (0.0009) [2023-12-26 08:09:52,917][123091] Updated weights for policy 0, policy_version 1073737 (0.0007) [2023-12-26 08:09:53,548][123091] Updated weights for policy 0, policy_version 1073747 (0.0007) [2023-12-26 08:09:53,612][123091] Updated weights for policy 0, policy_version 1073757 (0.0009) [2023-12-26 08:09:53,663][123090] Updated weights for policy 1, policy_version 1066312 (0.0008) [2023-12-26 08:09:53,673][123091] Updated weights for policy 0, policy_version 1073767 (0.0008) [2023-12-26 08:09:53,716][123090] Updated weights for policy 1, policy_version 1066322 (0.0007) [2023-12-26 08:09:53,776][123090] Updated weights for policy 1, policy_version 1066332 (0.0009) [2023-12-26 08:09:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 547864576. Throughput: 0: 9170.0, 1: 8924.8. Samples: 547841348. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:53,785][121949] Avg episode reward: [(0, '6148.691'), (1, '5351.266')] [2023-12-26 08:09:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001073776_274890752.pth... [2023-12-26 08:09:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001066336_272982016.pth... [2023-12-26 08:09:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001065280_272711680.pth [2023-12-26 08:09:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001072688_274612224.pth [2023-12-26 08:09:54,525][123091] Updated weights for policy 0, policy_version 1073777 (0.0008) [2023-12-26 08:09:54,594][123091] Updated weights for policy 0, policy_version 1073787 (0.0007) [2023-12-26 08:09:54,604][123090] Updated weights for policy 1, policy_version 1066342 (0.0010) [2023-12-26 08:09:54,654][123091] Updated weights for policy 0, policy_version 1073797 (0.0006) [2023-12-26 08:09:54,668][123090] Updated weights for policy 1, policy_version 1066352 (0.0011) [2023-12-26 08:09:54,711][123091] Updated weights for policy 0, policy_version 1073807 (0.0008) [2023-12-26 08:09:54,728][123090] Updated weights for policy 1, policy_version 1066362 (0.0010) [2023-12-26 08:09:55,436][123091] Updated weights for policy 0, policy_version 1073817 (0.0006) [2023-12-26 08:09:55,481][123090] Updated weights for policy 1, policy_version 1066372 (0.0009) [2023-12-26 08:09:55,495][123091] Updated weights for policy 0, policy_version 1073827 (0.0005) [2023-12-26 08:09:55,548][123091] Updated weights for policy 0, policy_version 1073837 (0.0005) [2023-12-26 08:09:55,552][123090] Updated weights for policy 1, policy_version 1066382 (0.0007) [2023-12-26 08:09:55,621][123090] Updated weights for policy 1, policy_version 1066392 (0.0006) [2023-12-26 08:09:56,203][123091] Updated weights for policy 0, policy_version 1073847 (0.0005) [2023-12-26 08:09:56,262][123091] Updated weights for policy 0, policy_version 1073857 (0.0005) [2023-12-26 08:09:56,290][123090] Updated weights for policy 1, policy_version 1066402 (0.0008) [2023-12-26 08:09:56,328][123091] Updated weights for policy 0, policy_version 1073867 (0.0005) [2023-12-26 08:09:56,366][123090] Updated weights for policy 1, policy_version 1066412 (0.0007) [2023-12-26 08:09:56,437][123090] Updated weights for policy 1, policy_version 1066422 (0.0009) [2023-12-26 08:09:56,503][123090] Updated weights for policy 1, policy_version 1066432 (0.0008) [2023-12-26 08:09:57,113][123091] Updated weights for policy 0, policy_version 1073877 (0.0007) [2023-12-26 08:09:57,174][123091] Updated weights for policy 0, policy_version 1073890 (0.0009) [2023-12-26 08:09:57,198][123090] Updated weights for policy 1, policy_version 1066442 (0.0006) [2023-12-26 08:09:57,221][123091] Updated weights for policy 0, policy_version 1073900 (0.0008) [2023-12-26 08:09:57,268][123090] Updated weights for policy 1, policy_version 1066452 (0.0005) [2023-12-26 08:09:57,341][123090] Updated weights for policy 1, policy_version 1066462 (0.0008) [2023-12-26 08:09:57,911][123090] Updated weights for policy 1, policy_version 1066472 (0.0007) [2023-12-26 08:09:57,969][123090] Updated weights for policy 1, policy_version 1066482 (0.0006) [2023-12-26 08:09:58,036][123090] Updated weights for policy 1, policy_version 1066492 (0.0006) [2023-12-26 08:09:58,037][123091] Updated weights for policy 0, policy_version 1073910 (0.0008) [2023-12-26 08:09:58,105][123091] Updated weights for policy 0, policy_version 1073920 (0.0008) [2023-12-26 08:09:58,179][123091] Updated weights for policy 0, policy_version 1073930 (0.0007) [2023-12-26 08:09:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 547954688. Throughput: 0: 9179.8, 1: 8960.2. Samples: 547950976. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:09:58,785][121949] Avg episode reward: [(0, '6034.514'), (1, '5605.103')] [2023-12-26 08:09:58,786][123090] Updated weights for policy 1, policy_version 1066502 (0.0007) [2023-12-26 08:09:58,866][123090] Updated weights for policy 1, policy_version 1066512 (0.0008) [2023-12-26 08:09:58,934][123090] Updated weights for policy 1, policy_version 1066522 (0.0006) [2023-12-26 08:09:59,015][123091] Updated weights for policy 0, policy_version 1073940 (0.0009) [2023-12-26 08:09:59,082][123091] Updated weights for policy 0, policy_version 1073950 (0.0011) [2023-12-26 08:09:59,143][123091] Updated weights for policy 0, policy_version 1073960 (0.0010) [2023-12-26 08:09:59,711][123090] Updated weights for policy 1, policy_version 1066532 (0.0008) [2023-12-26 08:09:59,783][123090] Updated weights for policy 1, policy_version 1066542 (0.0006) [2023-12-26 08:09:59,852][123090] Updated weights for policy 1, policy_version 1066552 (0.0011) [2023-12-26 08:09:59,911][123091] Updated weights for policy 0, policy_version 1073970 (0.0007) [2023-12-26 08:09:59,974][123091] Updated weights for policy 0, policy_version 1073980 (0.0009) [2023-12-26 08:10:00,042][123091] Updated weights for policy 0, policy_version 1073990 (0.0008) [2023-12-26 08:10:00,108][123091] Updated weights for policy 0, policy_version 1074000 (0.0008) [2023-12-26 08:10:00,599][123090] Updated weights for policy 1, policy_version 1066562 (0.0010) [2023-12-26 08:10:00,649][123090] Updated weights for policy 1, policy_version 1066572 (0.0008) [2023-12-26 08:10:00,694][123090] Updated weights for policy 1, policy_version 1066582 (0.0005) [2023-12-26 08:10:00,740][123090] Updated weights for policy 1, policy_version 1066592 (0.0005) [2023-12-26 08:10:00,873][123091] Updated weights for policy 0, policy_version 1074010 (0.0009) [2023-12-26 08:10:00,933][123091] Updated weights for policy 0, policy_version 1074020 (0.0009) [2023-12-26 08:10:00,982][123091] Updated weights for policy 0, policy_version 1074031 (0.0009) [2023-12-26 08:10:01,501][123090] Updated weights for policy 1, policy_version 1066602 (0.0008) [2023-12-26 08:10:01,559][123090] Updated weights for policy 1, policy_version 1066612 (0.0007) [2023-12-26 08:10:01,627][123090] Updated weights for policy 1, policy_version 1066622 (0.0007) [2023-12-26 08:10:01,878][123091] Updated weights for policy 0, policy_version 1074041 (0.0009) [2023-12-26 08:10:01,932][123091] Updated weights for policy 0, policy_version 1074051 (0.0009) [2023-12-26 08:10:01,992][123091] Updated weights for policy 0, policy_version 1074061 (0.0009) [2023-12-26 08:10:02,417][123090] Updated weights for policy 1, policy_version 1066632 (0.0010) [2023-12-26 08:10:02,472][123090] Updated weights for policy 1, policy_version 1066643 (0.0010) [2023-12-26 08:10:02,524][123090] Updated weights for policy 1, policy_version 1066654 (0.0010) [2023-12-26 08:10:02,820][123091] Updated weights for policy 0, policy_version 1074071 (0.0010) [2023-12-26 08:10:02,874][123091] Updated weights for policy 0, policy_version 1074081 (0.0010) [2023-12-26 08:10:02,936][123091] Updated weights for policy 0, policy_version 1074091 (0.0009) [2023-12-26 08:10:03,354][123090] Updated weights for policy 1, policy_version 1066664 (0.0006) [2023-12-26 08:10:03,406][123090] Updated weights for policy 1, policy_version 1066674 (0.0005) [2023-12-26 08:10:03,459][123090] Updated weights for policy 1, policy_version 1066684 (0.0005) [2023-12-26 08:10:03,752][123091] Updated weights for policy 0, policy_version 1074101 (0.0008) [2023-12-26 08:10:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 548044800. Throughput: 0: 9060.1, 1: 8919.7. Samples: 548058504. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:03,785][121949] Avg episode reward: [(0, '6027.496'), (1, '5398.301')] [2023-12-26 08:10:03,814][123091] Updated weights for policy 0, policy_version 1074111 (0.0009) [2023-12-26 08:10:03,886][123091] Updated weights for policy 0, policy_version 1074121 (0.0010) [2023-12-26 08:10:04,196][123090] Updated weights for policy 1, policy_version 1066694 (0.0009) [2023-12-26 08:10:04,262][123090] Updated weights for policy 1, policy_version 1066704 (0.0008) [2023-12-26 08:10:04,321][123090] Updated weights for policy 1, policy_version 1066714 (0.0009) [2023-12-26 08:10:04,714][123091] Updated weights for policy 0, policy_version 1074131 (0.0010) [2023-12-26 08:10:04,774][123091] Updated weights for policy 0, policy_version 1074141 (0.0009) [2023-12-26 08:10:04,837][123091] Updated weights for policy 0, policy_version 1074151 (0.0009) [2023-12-26 08:10:05,096][123090] Updated weights for policy 1, policy_version 1066724 (0.0009) [2023-12-26 08:10:05,156][123090] Updated weights for policy 1, policy_version 1066734 (0.0009) [2023-12-26 08:10:05,219][123090] Updated weights for policy 1, policy_version 1066744 (0.0009) [2023-12-26 08:10:05,674][123091] Updated weights for policy 0, policy_version 1074161 (0.0010) [2023-12-26 08:10:05,726][123091] Updated weights for policy 0, policy_version 1074171 (0.0010) [2023-12-26 08:10:05,783][123091] Updated weights for policy 0, policy_version 1074181 (0.0010) [2023-12-26 08:10:05,837][123091] Updated weights for policy 0, policy_version 1074191 (0.0010) [2023-12-26 08:10:05,995][123090] Updated weights for policy 1, policy_version 1066754 (0.0009) [2023-12-26 08:10:06,052][123090] Updated weights for policy 1, policy_version 1066764 (0.0009) [2023-12-26 08:10:06,098][123090] Updated weights for policy 1, policy_version 1066774 (0.0008) [2023-12-26 08:10:06,164][123090] Updated weights for policy 1, policy_version 1066784 (0.0010) [2023-12-26 08:10:06,618][123091] Updated weights for policy 0, policy_version 1074201 (0.0006) [2023-12-26 08:10:06,669][123091] Updated weights for policy 0, policy_version 1074211 (0.0005) [2023-12-26 08:10:06,727][123091] Updated weights for policy 0, policy_version 1074221 (0.0005) [2023-12-26 08:10:07,001][123090] Updated weights for policy 1, policy_version 1066794 (0.0010) [2023-12-26 08:10:07,056][123090] Updated weights for policy 1, policy_version 1066805 (0.0010) [2023-12-26 08:10:07,112][123090] Updated weights for policy 1, policy_version 1066815 (0.0009) [2023-12-26 08:10:07,418][123091] Updated weights for policy 0, policy_version 1074231 (0.0007) [2023-12-26 08:10:07,479][123091] Updated weights for policy 0, policy_version 1074241 (0.0009) [2023-12-26 08:10:07,547][123091] Updated weights for policy 0, policy_version 1074251 (0.0007) [2023-12-26 08:10:08,043][123090] Updated weights for policy 1, policy_version 1066825 (0.0009) [2023-12-26 08:10:08,104][123090] Updated weights for policy 1, policy_version 1066835 (0.0009) [2023-12-26 08:10:08,159][123090] Updated weights for policy 1, policy_version 1066845 (0.0010) [2023-12-26 08:10:08,195][123091] Updated weights for policy 0, policy_version 1074261 (0.0006) [2023-12-26 08:10:08,241][123091] Updated weights for policy 0, policy_version 1074271 (0.0005) [2023-12-26 08:10:08,288][123091] Updated weights for policy 0, policy_version 1074281 (0.0005) [2023-12-26 08:10:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.5, 300 sec: 17883.5). Total num frames: 548134912. Throughput: 0: 9039.0, 1: 8949.3. Samples: 548110540. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:08,784][121949] Avg episode reward: [(0, '6040.172'), (1, '5079.199')] [2023-12-26 08:10:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001074288_275021824.pth... [2023-12-26 08:10:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001066848_273113088.pth... [2023-12-26 08:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001073264_274759680.pth [2023-12-26 08:10:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001065824_272850944.pth [2023-12-26 08:10:09,033][123090] Updated weights for policy 1, policy_version 1066855 (0.0009) [2023-12-26 08:10:09,090][123090] Updated weights for policy 1, policy_version 1066865 (0.0009) [2023-12-26 08:10:09,133][123091] Updated weights for policy 0, policy_version 1074291 (0.0006) [2023-12-26 08:10:09,156][123090] Updated weights for policy 1, policy_version 1066875 (0.0009) [2023-12-26 08:10:09,184][123091] Updated weights for policy 0, policy_version 1074301 (0.0007) [2023-12-26 08:10:09,251][123091] Updated weights for policy 0, policy_version 1074311 (0.0010) [2023-12-26 08:10:09,984][123090] Updated weights for policy 1, policy_version 1066885 (0.0006) [2023-12-26 08:10:10,055][123090] Updated weights for policy 1, policy_version 1066895 (0.0009) [2023-12-26 08:10:10,070][123091] Updated weights for policy 0, policy_version 1074321 (0.0010) [2023-12-26 08:10:10,124][123090] Updated weights for policy 1, policy_version 1066905 (0.0008) [2023-12-26 08:10:10,139][123091] Updated weights for policy 0, policy_version 1074331 (0.0008) [2023-12-26 08:10:10,204][123091] Updated weights for policy 0, policy_version 1074341 (0.0011) [2023-12-26 08:10:10,267][123091] Updated weights for policy 0, policy_version 1074351 (0.0011) [2023-12-26 08:10:10,942][123090] Updated weights for policy 1, policy_version 1066915 (0.0007) [2023-12-26 08:10:11,006][123090] Updated weights for policy 1, policy_version 1066925 (0.0009) [2023-12-26 08:10:11,076][123090] Updated weights for policy 1, policy_version 1066935 (0.0009) [2023-12-26 08:10:11,077][123091] Updated weights for policy 0, policy_version 1074361 (0.0008) [2023-12-26 08:10:11,148][123091] Updated weights for policy 0, policy_version 1074371 (0.0008) [2023-12-26 08:10:11,208][123091] Updated weights for policy 0, policy_version 1074381 (0.0010) [2023-12-26 08:10:11,993][123090] Updated weights for policy 1, policy_version 1066945 (0.0010) [2023-12-26 08:10:12,040][123091] Updated weights for policy 0, policy_version 1074391 (0.0008) [2023-12-26 08:10:12,055][123090] Updated weights for policy 1, policy_version 1066955 (0.0009) [2023-12-26 08:10:12,114][123091] Updated weights for policy 0, policy_version 1074402 (0.0008) [2023-12-26 08:10:12,120][123090] Updated weights for policy 1, policy_version 1066965 (0.0009) [2023-12-26 08:10:12,169][123091] Updated weights for policy 0, policy_version 1074412 (0.0006) [2023-12-26 08:10:12,185][123090] Updated weights for policy 1, policy_version 1066975 (0.0009) [2023-12-26 08:10:12,979][123091] Updated weights for policy 0, policy_version 1074422 (0.0008) [2023-12-26 08:10:13,028][123090] Updated weights for policy 1, policy_version 1066985 (0.0008) [2023-12-26 08:10:13,033][123091] Updated weights for policy 0, policy_version 1074432 (0.0005) [2023-12-26 08:10:13,076][123090] Updated weights for policy 1, policy_version 1066995 (0.0008) [2023-12-26 08:10:13,094][123091] Updated weights for policy 0, policy_version 1074442 (0.0006) [2023-12-26 08:10:13,131][123090] Updated weights for policy 1, policy_version 1067005 (0.0009) [2023-12-26 08:10:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 548216832. Throughput: 0: 8945.2, 1: 8895.5. Samples: 548214144. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:13,784][121949] Avg episode reward: [(0, '6132.580'), (1, '5006.136')] [2023-12-26 08:10:13,888][123091] Updated weights for policy 0, policy_version 1074452 (0.0009) [2023-12-26 08:10:13,949][123091] Updated weights for policy 0, policy_version 1074462 (0.0009) [2023-12-26 08:10:13,982][123090] Updated weights for policy 1, policy_version 1067015 (0.0010) [2023-12-26 08:10:14,017][123091] Updated weights for policy 0, policy_version 1074472 (0.0008) [2023-12-26 08:10:14,045][123090] Updated weights for policy 1, policy_version 1067025 (0.0009) [2023-12-26 08:10:14,102][123090] Updated weights for policy 1, policy_version 1067035 (0.0009) [2023-12-26 08:10:14,680][123091] Updated weights for policy 0, policy_version 1074482 (0.0008) [2023-12-26 08:10:14,731][123091] Updated weights for policy 0, policy_version 1074492 (0.0010) [2023-12-26 08:10:14,794][123091] Updated weights for policy 0, policy_version 1074502 (0.0009) [2023-12-26 08:10:14,856][123091] Updated weights for policy 0, policy_version 1074512 (0.0010) [2023-12-26 08:10:14,961][123090] Updated weights for policy 1, policy_version 1067045 (0.0009) [2023-12-26 08:10:15,031][123090] Updated weights for policy 1, policy_version 1067055 (0.0010) [2023-12-26 08:10:15,103][123090] Updated weights for policy 1, policy_version 1067065 (0.0009) [2023-12-26 08:10:15,725][123091] Updated weights for policy 0, policy_version 1074522 (0.0011) [2023-12-26 08:10:15,788][123091] Updated weights for policy 0, policy_version 1074532 (0.0011) [2023-12-26 08:10:15,847][123091] Updated weights for policy 0, policy_version 1074542 (0.0010) [2023-12-26 08:10:15,938][123090] Updated weights for policy 1, policy_version 1067075 (0.0010) [2023-12-26 08:10:16,000][123090] Updated weights for policy 1, policy_version 1067085 (0.0010) [2023-12-26 08:10:16,055][123090] Updated weights for policy 1, policy_version 1067096 (0.0010) [2023-12-26 08:10:16,531][123091] Updated weights for policy 0, policy_version 1074552 (0.0010) [2023-12-26 08:10:16,582][123091] Updated weights for policy 0, policy_version 1074562 (0.0010) [2023-12-26 08:10:16,627][123091] Updated weights for policy 0, policy_version 1074572 (0.0007) [2023-12-26 08:10:16,976][123090] Updated weights for policy 1, policy_version 1067106 (0.0009) [2023-12-26 08:10:17,030][123090] Updated weights for policy 1, policy_version 1067116 (0.0008) [2023-12-26 08:10:17,086][123090] Updated weights for policy 1, policy_version 1067126 (0.0009) [2023-12-26 08:10:17,134][123090] Updated weights for policy 1, policy_version 1067136 (0.0009) [2023-12-26 08:10:17,424][123091] Updated weights for policy 0, policy_version 1074582 (0.0008) [2023-12-26 08:10:17,486][123091] Updated weights for policy 0, policy_version 1074592 (0.0010) [2023-12-26 08:10:17,548][123091] Updated weights for policy 0, policy_version 1074602 (0.0010) [2023-12-26 08:10:18,019][123090] Updated weights for policy 1, policy_version 1067146 (0.0005) [2023-12-26 08:10:18,087][123090] Updated weights for policy 1, policy_version 1067156 (0.0006) [2023-12-26 08:10:18,161][123090] Updated weights for policy 1, policy_version 1067166 (0.0006) [2023-12-26 08:10:18,225][123091] Updated weights for policy 0, policy_version 1074612 (0.0010) [2023-12-26 08:10:18,280][123091] Updated weights for policy 0, policy_version 1074622 (0.0010) [2023-12-26 08:10:18,346][123091] Updated weights for policy 0, policy_version 1074632 (0.0011) [2023-12-26 08:10:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 548306944. Throughput: 0: 8912.3, 1: 8839.5. Samples: 548319716. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:18,785][121949] Avg episode reward: [(0, '6220.254'), (1, '4659.247')] [2023-12-26 08:10:18,879][123090] Updated weights for policy 1, policy_version 1067176 (0.0009) [2023-12-26 08:10:18,946][123090] Updated weights for policy 1, policy_version 1067186 (0.0010) [2023-12-26 08:10:19,012][123090] Updated weights for policy 1, policy_version 1067196 (0.0010) [2023-12-26 08:10:19,144][123091] Updated weights for policy 0, policy_version 1074642 (0.0011) [2023-12-26 08:10:19,206][123091] Updated weights for policy 0, policy_version 1074652 (0.0011) [2023-12-26 08:10:19,277][123091] Updated weights for policy 0, policy_version 1074662 (0.0009) [2023-12-26 08:10:19,342][123091] Updated weights for policy 0, policy_version 1074672 (0.0011) [2023-12-26 08:10:19,879][123090] Updated weights for policy 1, policy_version 1067206 (0.0008) [2023-12-26 08:10:19,942][123090] Updated weights for policy 1, policy_version 1067216 (0.0008) [2023-12-26 08:10:20,008][123090] Updated weights for policy 1, policy_version 1067226 (0.0008) [2023-12-26 08:10:20,243][123091] Updated weights for policy 0, policy_version 1074682 (0.0009) [2023-12-26 08:10:20,314][123091] Updated weights for policy 0, policy_version 1074692 (0.0009) [2023-12-26 08:10:20,377][123091] Updated weights for policy 0, policy_version 1074702 (0.0007) [2023-12-26 08:10:20,790][123090] Updated weights for policy 1, policy_version 1067236 (0.0009) [2023-12-26 08:10:20,859][123090] Updated weights for policy 1, policy_version 1067246 (0.0010) [2023-12-26 08:10:20,916][123090] Updated weights for policy 1, policy_version 1067256 (0.0010) [2023-12-26 08:10:21,082][123091] Updated weights for policy 0, policy_version 1074712 (0.0009) [2023-12-26 08:10:21,142][123091] Updated weights for policy 0, policy_version 1074722 (0.0010) [2023-12-26 08:10:21,197][123091] Updated weights for policy 0, policy_version 1074732 (0.0009) [2023-12-26 08:10:21,801][123090] Updated weights for policy 1, policy_version 1067266 (0.0009) [2023-12-26 08:10:21,877][123090] Updated weights for policy 1, policy_version 1067276 (0.0008) [2023-12-26 08:10:21,942][123090] Updated weights for policy 1, policy_version 1067286 (0.0010) [2023-12-26 08:10:22,015][123090] Updated weights for policy 1, policy_version 1067296 (0.0005) [2023-12-26 08:10:22,083][123091] Updated weights for policy 0, policy_version 1074742 (0.0010) [2023-12-26 08:10:22,151][123091] Updated weights for policy 0, policy_version 1074752 (0.0009) [2023-12-26 08:10:22,218][123091] Updated weights for policy 0, policy_version 1074762 (0.0009) [2023-12-26 08:10:22,806][123090] Updated weights for policy 1, policy_version 1067306 (0.0009) [2023-12-26 08:10:22,868][123090] Updated weights for policy 1, policy_version 1067316 (0.0009) [2023-12-26 08:10:22,934][123090] Updated weights for policy 1, policy_version 1067326 (0.0009) [2023-12-26 08:10:23,065][123091] Updated weights for policy 0, policy_version 1074772 (0.0010) [2023-12-26 08:10:23,137][123091] Updated weights for policy 0, policy_version 1074782 (0.0011) [2023-12-26 08:10:23,194][123091] Updated weights for policy 0, policy_version 1074792 (0.0011) [2023-12-26 08:10:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 548388864. Throughput: 0: 8835.5, 1: 8765.3. Samples: 548370444. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:23,785][121949] Avg episode reward: [(0, '6125.100'), (1, '4875.706')] [2023-12-26 08:10:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001074800_275152896.pth... [2023-12-26 08:10:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001073776_274890752.pth [2023-12-26 08:10:23,800][123090] Updated weights for policy 1, policy_version 1067336 (0.0010) [2023-12-26 08:10:23,870][123090] Updated weights for policy 1, policy_version 1067346 (0.0010) [2023-12-26 08:10:23,930][123091] Updated weights for policy 0, policy_version 1074802 (0.0011) [2023-12-26 08:10:23,932][123090] Updated weights for policy 1, policy_version 1067356 (0.0009) [2023-12-26 08:10:23,951][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001067360_273244160.pth... [2023-12-26 08:10:23,954][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001066336_272982016.pth [2023-12-26 08:10:23,993][123091] Updated weights for policy 0, policy_version 1074812 (0.0009) [2023-12-26 08:10:24,050][123091] Updated weights for policy 0, policy_version 1074822 (0.0009) [2023-12-26 08:10:24,106][123091] Updated weights for policy 0, policy_version 1074832 (0.0011) [2023-12-26 08:10:24,814][123090] Updated weights for policy 1, policy_version 1067366 (0.0008) [2023-12-26 08:10:24,867][123090] Updated weights for policy 1, policy_version 1067376 (0.0009) [2023-12-26 08:10:24,931][123090] Updated weights for policy 1, policy_version 1067386 (0.0010) [2023-12-26 08:10:24,942][123091] Updated weights for policy 0, policy_version 1074842 (0.0011) [2023-12-26 08:10:25,005][123091] Updated weights for policy 0, policy_version 1074852 (0.0011) [2023-12-26 08:10:25,065][123091] Updated weights for policy 0, policy_version 1074862 (0.0011) [2023-12-26 08:10:25,777][123090] Updated weights for policy 1, policy_version 1067396 (0.0007) [2023-12-26 08:10:25,842][123090] Updated weights for policy 1, policy_version 1067406 (0.0010) [2023-12-26 08:10:25,857][123091] Updated weights for policy 0, policy_version 1074872 (0.0008) [2023-12-26 08:10:25,902][123090] Updated weights for policy 1, policy_version 1067416 (0.0009) [2023-12-26 08:10:25,919][123091] Updated weights for policy 0, policy_version 1074882 (0.0009) [2023-12-26 08:10:25,975][123091] Updated weights for policy 0, policy_version 1074892 (0.0009) [2023-12-26 08:10:26,737][123090] Updated weights for policy 1, policy_version 1067426 (0.0008) [2023-12-26 08:10:26,787][123090] Updated weights for policy 1, policy_version 1067436 (0.0007) [2023-12-26 08:10:26,812][123091] Updated weights for policy 0, policy_version 1074903 (0.0006) [2023-12-26 08:10:26,844][123090] Updated weights for policy 1, policy_version 1067446 (0.0007) [2023-12-26 08:10:26,881][123091] Updated weights for policy 0, policy_version 1074913 (0.0008) [2023-12-26 08:10:26,897][123090] Updated weights for policy 1, policy_version 1067456 (0.0006) [2023-12-26 08:10:26,942][123091] Updated weights for policy 0, policy_version 1074923 (0.0008) [2023-12-26 08:10:27,571][123090] Updated weights for policy 1, policy_version 1067466 (0.0005) [2023-12-26 08:10:27,592][123091] Updated weights for policy 0, policy_version 1074933 (0.0005) [2023-12-26 08:10:27,618][123090] Updated weights for policy 1, policy_version 1067476 (0.0005) [2023-12-26 08:10:27,658][123091] Updated weights for policy 0, policy_version 1074943 (0.0005) [2023-12-26 08:10:27,667][123090] Updated weights for policy 1, policy_version 1067486 (0.0005) [2023-12-26 08:10:27,727][123091] Updated weights for policy 0, policy_version 1074953 (0.0006) [2023-12-26 08:10:28,365][123091] Updated weights for policy 0, policy_version 1074963 (0.0007) [2023-12-26 08:10:28,419][123091] Updated weights for policy 0, policy_version 1074973 (0.0010) [2023-12-26 08:10:28,486][123091] Updated weights for policy 0, policy_version 1074983 (0.0005) [2023-12-26 08:10:28,530][123090] Updated weights for policy 1, policy_version 1067496 (0.0008) [2023-12-26 08:10:28,590][123090] Updated weights for policy 1, policy_version 1067506 (0.0009) [2023-12-26 08:10:28,649][123090] Updated weights for policy 1, policy_version 1067516 (0.0010) [2023-12-26 08:10:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 548487168. Throughput: 0: 8862.3, 1: 8761.2. Samples: 548475436. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:28,785][121949] Avg episode reward: [(0, '6007.204'), (1, '5236.495')] [2023-12-26 08:10:29,141][123091] Updated weights for policy 0, policy_version 1074993 (0.0006) [2023-12-26 08:10:29,203][123091] Updated weights for policy 0, policy_version 1075003 (0.0005) [2023-12-26 08:10:29,273][123091] Updated weights for policy 0, policy_version 1075013 (0.0007) [2023-12-26 08:10:29,332][123091] Updated weights for policy 0, policy_version 1075023 (0.0008) [2023-12-26 08:10:29,564][123090] Updated weights for policy 1, policy_version 1067526 (0.0010) [2023-12-26 08:10:29,619][123090] Updated weights for policy 1, policy_version 1067538 (0.0011) [2023-12-26 08:10:29,672][123090] Updated weights for policy 1, policy_version 1067548 (0.0010) [2023-12-26 08:10:30,015][123091] Updated weights for policy 0, policy_version 1075033 (0.0009) [2023-12-26 08:10:30,071][123091] Updated weights for policy 0, policy_version 1075043 (0.0009) [2023-12-26 08:10:30,124][123091] Updated weights for policy 0, policy_version 1075053 (0.0007) [2023-12-26 08:10:30,419][123090] Updated weights for policy 1, policy_version 1067558 (0.0009) [2023-12-26 08:10:30,478][123090] Updated weights for policy 1, policy_version 1067568 (0.0010) [2023-12-26 08:10:30,530][123090] Updated weights for policy 1, policy_version 1067578 (0.0010) [2023-12-26 08:10:30,848][123091] Updated weights for policy 0, policy_version 1075063 (0.0009) [2023-12-26 08:10:30,910][123091] Updated weights for policy 0, policy_version 1075073 (0.0006) [2023-12-26 08:10:30,966][123091] Updated weights for policy 0, policy_version 1075083 (0.0006) [2023-12-26 08:10:31,325][123090] Updated weights for policy 1, policy_version 1067588 (0.0008) [2023-12-26 08:10:31,395][123090] Updated weights for policy 1, policy_version 1067598 (0.0009) [2023-12-26 08:10:31,448][123090] Updated weights for policy 1, policy_version 1067608 (0.0009) [2023-12-26 08:10:31,731][123091] Updated weights for policy 0, policy_version 1075093 (0.0007) [2023-12-26 08:10:31,794][123091] Updated weights for policy 0, policy_version 1075103 (0.0011) [2023-12-26 08:10:31,853][123091] Updated weights for policy 0, policy_version 1075113 (0.0010) [2023-12-26 08:10:32,310][123090] Updated weights for policy 1, policy_version 1067618 (0.0008) [2023-12-26 08:10:32,378][123090] Updated weights for policy 1, policy_version 1067628 (0.0008) [2023-12-26 08:10:32,438][123090] Updated weights for policy 1, policy_version 1067638 (0.0010) [2023-12-26 08:10:32,501][123090] Updated weights for policy 1, policy_version 1067648 (0.0009) [2023-12-26 08:10:32,586][123091] Updated weights for policy 0, policy_version 1075123 (0.0010) [2023-12-26 08:10:32,663][123091] Updated weights for policy 0, policy_version 1075133 (0.0010) [2023-12-26 08:10:32,721][123091] Updated weights for policy 0, policy_version 1075143 (0.0008) [2023-12-26 08:10:33,387][123090] Updated weights for policy 1, policy_version 1067658 (0.0010) [2023-12-26 08:10:33,446][123090] Updated weights for policy 1, policy_version 1067669 (0.0010) [2023-12-26 08:10:33,448][123091] Updated weights for policy 0, policy_version 1075153 (0.0005) [2023-12-26 08:10:33,499][123090] Updated weights for policy 1, policy_version 1067679 (0.0008) [2023-12-26 08:10:33,513][123091] Updated weights for policy 0, policy_version 1075163 (0.0005) [2023-12-26 08:10:33,566][123091] Updated weights for policy 0, policy_version 1075173 (0.0005) [2023-12-26 08:10:33,624][123091] Updated weights for policy 0, policy_version 1075183 (0.0005) [2023-12-26 08:10:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 548577280. Throughput: 0: 9060.4, 1: 8594.3. Samples: 548584648. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:33,785][121949] Avg episode reward: [(0, '6144.600'), (1, '5144.645')] [2023-12-26 08:10:34,282][123091] Updated weights for policy 0, policy_version 1075193 (0.0008) [2023-12-26 08:10:34,353][123091] Updated weights for policy 0, policy_version 1075203 (0.0007) [2023-12-26 08:10:34,423][123091] Updated weights for policy 0, policy_version 1075213 (0.0007) [2023-12-26 08:10:34,459][123090] Updated weights for policy 1, policy_version 1067689 (0.0009) [2023-12-26 08:10:34,527][123090] Updated weights for policy 1, policy_version 1067699 (0.0009) [2023-12-26 08:10:34,590][123090] Updated weights for policy 1, policy_version 1067709 (0.0010) [2023-12-26 08:10:35,058][123091] Updated weights for policy 0, policy_version 1075223 (0.0009) [2023-12-26 08:10:35,112][123091] Updated weights for policy 0, policy_version 1075233 (0.0008) [2023-12-26 08:10:35,170][123091] Updated weights for policy 0, policy_version 1075243 (0.0010) [2023-12-26 08:10:35,458][123090] Updated weights for policy 1, policy_version 1067719 (0.0009) [2023-12-26 08:10:35,525][123090] Updated weights for policy 1, policy_version 1067729 (0.0009) [2023-12-26 08:10:35,589][123090] Updated weights for policy 1, policy_version 1067739 (0.0008) [2023-12-26 08:10:35,886][123091] Updated weights for policy 0, policy_version 1075253 (0.0008) [2023-12-26 08:10:35,948][123091] Updated weights for policy 0, policy_version 1075263 (0.0005) [2023-12-26 08:10:35,999][123091] Updated weights for policy 0, policy_version 1075273 (0.0005) [2023-12-26 08:10:36,516][123090] Updated weights for policy 1, policy_version 1067749 (0.0010) [2023-12-26 08:10:36,570][123090] Updated weights for policy 1, policy_version 1067759 (0.0010) [2023-12-26 08:10:36,628][123090] Updated weights for policy 1, policy_version 1067770 (0.0011) [2023-12-26 08:10:36,701][123091] Updated weights for policy 0, policy_version 1075283 (0.0005) [2023-12-26 08:10:36,767][123091] Updated weights for policy 0, policy_version 1075293 (0.0006) [2023-12-26 08:10:36,829][123091] Updated weights for policy 0, policy_version 1075303 (0.0006) [2023-12-26 08:10:37,555][123090] Updated weights for policy 1, policy_version 1067780 (0.0010) [2023-12-26 08:10:37,558][123091] Updated weights for policy 0, policy_version 1075313 (0.0005) [2023-12-26 08:10:37,605][123091] Updated weights for policy 0, policy_version 1075323 (0.0009) [2023-12-26 08:10:37,620][123090] Updated weights for policy 1, policy_version 1067790 (0.0008) [2023-12-26 08:10:37,659][123091] Updated weights for policy 0, policy_version 1075333 (0.0008) [2023-12-26 08:10:37,679][123090] Updated weights for policy 1, policy_version 1067800 (0.0010) [2023-12-26 08:10:37,708][123091] Updated weights for policy 0, policy_version 1075343 (0.0009) [2023-12-26 08:10:38,495][123091] Updated weights for policy 0, policy_version 1075353 (0.0006) [2023-12-26 08:10:38,527][123090] Updated weights for policy 1, policy_version 1067810 (0.0008) [2023-12-26 08:10:38,562][123091] Updated weights for policy 0, policy_version 1075363 (0.0005) [2023-12-26 08:10:38,592][123090] Updated weights for policy 1, policy_version 1067820 (0.0009) [2023-12-26 08:10:38,621][123091] Updated weights for policy 0, policy_version 1075373 (0.0005) [2023-12-26 08:10:38,659][123090] Updated weights for policy 1, policy_version 1067830 (0.0009) [2023-12-26 08:10:38,722][123090] Updated weights for policy 1, policy_version 1067840 (0.0009) [2023-12-26 08:10:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 548667392. Throughput: 0: 9142.1, 1: 8566.7. Samples: 548638244. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:38,785][121949] Avg episode reward: [(0, '6217.169'), (1, '4902.074')] [2023-12-26 08:10:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001075376_275300352.pth... [2023-12-26 08:10:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001067840_273367040.pth... [2023-12-26 08:10:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001074288_275021824.pth [2023-12-26 08:10:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001066848_273113088.pth [2023-12-26 08:10:39,353][123091] Updated weights for policy 0, policy_version 1075383 (0.0009) [2023-12-26 08:10:39,418][123091] Updated weights for policy 0, policy_version 1075393 (0.0010) [2023-12-26 08:10:39,482][123091] Updated weights for policy 0, policy_version 1075403 (0.0009) [2023-12-26 08:10:39,554][123090] Updated weights for policy 1, policy_version 1067850 (0.0009) [2023-12-26 08:10:39,617][123090] Updated weights for policy 1, policy_version 1067860 (0.0010) [2023-12-26 08:10:39,680][123090] Updated weights for policy 1, policy_version 1067870 (0.0010) [2023-12-26 08:10:40,250][123091] Updated weights for policy 0, policy_version 1075413 (0.0010) [2023-12-26 08:10:40,311][123091] Updated weights for policy 0, policy_version 1075423 (0.0009) [2023-12-26 08:10:40,371][123091] Updated weights for policy 0, policy_version 1075433 (0.0009) [2023-12-26 08:10:40,594][123090] Updated weights for policy 1, policy_version 1067880 (0.0009) [2023-12-26 08:10:40,662][123090] Updated weights for policy 1, policy_version 1067890 (0.0009) [2023-12-26 08:10:40,721][123090] Updated weights for policy 1, policy_version 1067900 (0.0010) [2023-12-26 08:10:41,188][123091] Updated weights for policy 0, policy_version 1075443 (0.0009) [2023-12-26 08:10:41,252][123091] Updated weights for policy 0, policy_version 1075453 (0.0006) [2023-12-26 08:10:41,320][123091] Updated weights for policy 0, policy_version 1075463 (0.0008) [2023-12-26 08:10:41,565][123090] Updated weights for policy 1, policy_version 1067910 (0.0006) [2023-12-26 08:10:41,626][123090] Updated weights for policy 1, policy_version 1067920 (0.0006) [2023-12-26 08:10:41,701][123090] Updated weights for policy 1, policy_version 1067930 (0.0007) [2023-12-26 08:10:42,098][123091] Updated weights for policy 0, policy_version 1075473 (0.0010) [2023-12-26 08:10:42,163][123091] Updated weights for policy 0, policy_version 1075483 (0.0009) [2023-12-26 08:10:42,221][123091] Updated weights for policy 0, policy_version 1075493 (0.0010) [2023-12-26 08:10:42,282][123091] Updated weights for policy 0, policy_version 1075503 (0.0009) [2023-12-26 08:10:42,474][123090] Updated weights for policy 1, policy_version 1067940 (0.0010) [2023-12-26 08:10:42,546][123090] Updated weights for policy 1, policy_version 1067950 (0.0009) [2023-12-26 08:10:42,611][123090] Updated weights for policy 1, policy_version 1067960 (0.0009) [2023-12-26 08:10:43,116][123091] Updated weights for policy 0, policy_version 1075513 (0.0009) [2023-12-26 08:10:43,178][123091] Updated weights for policy 0, policy_version 1075523 (0.0009) [2023-12-26 08:10:43,230][123091] Updated weights for policy 0, policy_version 1075533 (0.0009) [2023-12-26 08:10:43,432][123090] Updated weights for policy 1, policy_version 1067970 (0.0010) [2023-12-26 08:10:43,497][123090] Updated weights for policy 1, policy_version 1067980 (0.0010) [2023-12-26 08:10:43,556][123090] Updated weights for policy 1, policy_version 1067991 (0.0009) [2023-12-26 08:10:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17883.6). Total num frames: 548749312. Throughput: 0: 9099.1, 1: 8453.8. Samples: 548740856. Policy #0 lag: (min: 30.0, avg: 30.0, max: 30.0) [2023-12-26 08:10:43,785][121949] Avg episode reward: [(0, '6185.969'), (1, '4786.364')] [2023-12-26 08:10:44,070][123091] Updated weights for policy 0, policy_version 1075543 (0.0010) [2023-12-26 08:10:44,132][123091] Updated weights for policy 0, policy_version 1075553 (0.0011) [2023-12-26 08:10:44,193][123091] Updated weights for policy 0, policy_version 1075563 (0.0010) [2023-12-26 08:10:44,385][123090] Updated weights for policy 1, policy_version 1068001 (0.0009) [2023-12-26 08:10:44,447][123090] Updated weights for policy 1, policy_version 1068011 (0.0010) [2023-12-26 08:10:44,494][123090] Updated weights for policy 1, policy_version 1068021 (0.0008) [2023-12-26 08:10:44,542][123090] Updated weights for policy 1, policy_version 1068031 (0.0008) [2023-12-26 08:10:44,956][123091] Updated weights for policy 0, policy_version 1075573 (0.0009) [2023-12-26 08:10:45,023][123091] Updated weights for policy 0, policy_version 1075583 (0.0007) [2023-12-26 08:10:45,089][123091] Updated weights for policy 0, policy_version 1075593 (0.0006) [2023-12-26 08:10:45,434][123090] Updated weights for policy 1, policy_version 1068041 (0.0009) [2023-12-26 08:10:45,486][123090] Updated weights for policy 1, policy_version 1068051 (0.0008) [2023-12-26 08:10:45,541][123090] Updated weights for policy 1, policy_version 1068061 (0.0009) [2023-12-26 08:10:45,876][123091] Updated weights for policy 0, policy_version 1075603 (0.0006) [2023-12-26 08:10:45,931][123091] Updated weights for policy 0, policy_version 1075613 (0.0006) [2023-12-26 08:10:45,996][123091] Updated weights for policy 0, policy_version 1075623 (0.0007) [2023-12-26 08:10:46,317][123090] Updated weights for policy 1, policy_version 1068071 (0.0006) [2023-12-26 08:10:46,370][123090] Updated weights for policy 1, policy_version 1068081 (0.0005) [2023-12-26 08:10:46,418][123090] Updated weights for policy 1, policy_version 1068091 (0.0005) [2023-12-26 08:10:46,682][123091] Updated weights for policy 0, policy_version 1075633 (0.0010) [2023-12-26 08:10:46,730][123091] Updated weights for policy 0, policy_version 1075643 (0.0005) [2023-12-26 08:10:46,779][123091] Updated weights for policy 0, policy_version 1075653 (0.0005) [2023-12-26 08:10:46,831][123091] Updated weights for policy 0, policy_version 1075663 (0.0005) [2023-12-26 08:10:47,180][123090] Updated weights for policy 1, policy_version 1068101 (0.0005) [2023-12-26 08:10:47,244][123090] Updated weights for policy 1, policy_version 1068111 (0.0006) [2023-12-26 08:10:47,318][123090] Updated weights for policy 1, policy_version 1068121 (0.0005) [2023-12-26 08:10:47,521][123091] Updated weights for policy 0, policy_version 1075673 (0.0005) [2023-12-26 08:10:47,589][123091] Updated weights for policy 0, policy_version 1075683 (0.0005) [2023-12-26 08:10:47,642][123091] Updated weights for policy 0, policy_version 1075693 (0.0005) [2023-12-26 08:10:47,925][123090] Updated weights for policy 1, policy_version 1068131 (0.0005) [2023-12-26 08:10:47,991][123090] Updated weights for policy 1, policy_version 1068141 (0.0010) [2023-12-26 08:10:48,052][123090] Updated weights for policy 1, policy_version 1068151 (0.0009) [2023-12-26 08:10:48,384][123091] Updated weights for policy 0, policy_version 1075703 (0.0009) [2023-12-26 08:10:48,455][123091] Updated weights for policy 0, policy_version 1075713 (0.0011) [2023-12-26 08:10:48,519][123091] Updated weights for policy 0, policy_version 1075723 (0.0011) [2023-12-26 08:10:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 548839424. Throughput: 0: 9169.6, 1: 8449.0. Samples: 548851340. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:10:48,785][121949] Avg episode reward: [(0, '6127.387'), (1, '5250.833')] [2023-12-26 08:10:48,791][123090] Updated weights for policy 1, policy_version 1068161 (0.0009) [2023-12-26 08:10:48,847][123090] Updated weights for policy 1, policy_version 1068171 (0.0006) [2023-12-26 08:10:48,904][123090] Updated weights for policy 1, policy_version 1068181 (0.0006) [2023-12-26 08:10:48,957][123090] Updated weights for policy 1, policy_version 1068191 (0.0008) [2023-12-26 08:10:49,366][123091] Updated weights for policy 0, policy_version 1075733 (0.0010) [2023-12-26 08:10:49,433][123091] Updated weights for policy 0, policy_version 1075743 (0.0011) [2023-12-26 08:10:49,500][123091] Updated weights for policy 0, policy_version 1075753 (0.0011) [2023-12-26 08:10:49,771][123090] Updated weights for policy 1, policy_version 1068201 (0.0010) [2023-12-26 08:10:49,828][123090] Updated weights for policy 1, policy_version 1068211 (0.0009) [2023-12-26 08:10:49,898][123090] Updated weights for policy 1, policy_version 1068221 (0.0010) [2023-12-26 08:10:50,330][123091] Updated weights for policy 0, policy_version 1075763 (0.0011) [2023-12-26 08:10:50,401][123091] Updated weights for policy 0, policy_version 1075773 (0.0008) [2023-12-26 08:10:50,476][123091] Updated weights for policy 0, policy_version 1075783 (0.0011) [2023-12-26 08:10:50,690][123090] Updated weights for policy 1, policy_version 1068231 (0.0011) [2023-12-26 08:10:50,757][123090] Updated weights for policy 1, policy_version 1068241 (0.0011) [2023-12-26 08:10:50,829][123090] Updated weights for policy 1, policy_version 1068251 (0.0009) [2023-12-26 08:10:51,345][123091] Updated weights for policy 0, policy_version 1075793 (0.0010) [2023-12-26 08:10:51,419][123091] Updated weights for policy 0, policy_version 1075803 (0.0009) [2023-12-26 08:10:51,475][123091] Updated weights for policy 0, policy_version 1075813 (0.0008) [2023-12-26 08:10:51,534][123091] Updated weights for policy 0, policy_version 1075823 (0.0009) [2023-12-26 08:10:51,614][123090] Updated weights for policy 1, policy_version 1068261 (0.0006) [2023-12-26 08:10:51,688][123090] Updated weights for policy 1, policy_version 1068271 (0.0006) [2023-12-26 08:10:51,764][123090] Updated weights for policy 1, policy_version 1068281 (0.0007) [2023-12-26 08:10:52,391][123091] Updated weights for policy 0, policy_version 1075833 (0.0009) [2023-12-26 08:10:52,458][123091] Updated weights for policy 0, policy_version 1075843 (0.0010) [2023-12-26 08:10:52,495][123090] Updated weights for policy 1, policy_version 1068291 (0.0007) [2023-12-26 08:10:52,521][123091] Updated weights for policy 0, policy_version 1075853 (0.0007) [2023-12-26 08:10:52,559][123090] Updated weights for policy 1, policy_version 1068301 (0.0009) [2023-12-26 08:10:52,621][123090] Updated weights for policy 1, policy_version 1068311 (0.0010) [2023-12-26 08:10:53,327][123091] Updated weights for policy 0, policy_version 1075863 (0.0009) [2023-12-26 08:10:53,380][123091] Updated weights for policy 0, policy_version 1075873 (0.0009) [2023-12-26 08:10:53,435][123091] Updated weights for policy 0, policy_version 1075883 (0.0008) [2023-12-26 08:10:53,467][123090] Updated weights for policy 1, policy_version 1068321 (0.0010) [2023-12-26 08:10:53,530][123090] Updated weights for policy 1, policy_version 1068331 (0.0010) [2023-12-26 08:10:53,589][123090] Updated weights for policy 1, policy_version 1068341 (0.0010) [2023-12-26 08:10:53,637][123090] Updated weights for policy 1, policy_version 1068351 (0.0010) [2023-12-26 08:10:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 548929536. Throughput: 0: 9145.0, 1: 8472.4. Samples: 548903328. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:10:53,786][121949] Avg episode reward: [(0, '6125.309'), (1, '5118.479')] [2023-12-26 08:10:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001075888_275431424.pth... [2023-12-26 08:10:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001068352_273498112.pth... [2023-12-26 08:10:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001074800_275152896.pth [2023-12-26 08:10:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001067360_273244160.pth [2023-12-26 08:10:54,251][123091] Updated weights for policy 0, policy_version 1075893 (0.0009) [2023-12-26 08:10:54,311][123091] Updated weights for policy 0, policy_version 1075903 (0.0009) [2023-12-26 08:10:54,370][123091] Updated weights for policy 0, policy_version 1075913 (0.0010) [2023-12-26 08:10:54,478][123090] Updated weights for policy 1, policy_version 1068361 (0.0011) [2023-12-26 08:10:54,542][123090] Updated weights for policy 1, policy_version 1068371 (0.0011) [2023-12-26 08:10:54,611][123090] Updated weights for policy 1, policy_version 1068381 (0.0011) [2023-12-26 08:10:55,185][123091] Updated weights for policy 0, policy_version 1075923 (0.0008) [2023-12-26 08:10:55,247][123091] Updated weights for policy 0, policy_version 1075933 (0.0006) [2023-12-26 08:10:55,311][123091] Updated weights for policy 0, policy_version 1075943 (0.0009) [2023-12-26 08:10:55,440][123090] Updated weights for policy 1, policy_version 1068391 (0.0010) [2023-12-26 08:10:55,496][123090] Updated weights for policy 1, policy_version 1068401 (0.0010) [2023-12-26 08:10:55,545][123090] Updated weights for policy 1, policy_version 1068411 (0.0010) [2023-12-26 08:10:56,072][123091] Updated weights for policy 0, policy_version 1075953 (0.0008) [2023-12-26 08:10:56,130][123091] Updated weights for policy 0, policy_version 1075963 (0.0008) [2023-12-26 08:10:56,180][123091] Updated weights for policy 0, policy_version 1075973 (0.0012) [2023-12-26 08:10:56,237][123091] Updated weights for policy 0, policy_version 1075983 (0.0011) [2023-12-26 08:10:56,238][123090] Updated weights for policy 1, policy_version 1068421 (0.0008) [2023-12-26 08:10:56,285][123090] Updated weights for policy 1, policy_version 1068431 (0.0005) [2023-12-26 08:10:56,352][123090] Updated weights for policy 1, policy_version 1068441 (0.0005) [2023-12-26 08:10:57,050][123090] Updated weights for policy 1, policy_version 1068451 (0.0005) [2023-12-26 08:10:57,070][123091] Updated weights for policy 0, policy_version 1075993 (0.0006) [2023-12-26 08:10:57,106][123090] Updated weights for policy 1, policy_version 1068461 (0.0006) [2023-12-26 08:10:57,117][123091] Updated weights for policy 0, policy_version 1076003 (0.0007) [2023-12-26 08:10:57,154][123090] Updated weights for policy 1, policy_version 1068471 (0.0005) [2023-12-26 08:10:57,171][123091] Updated weights for policy 0, policy_version 1076013 (0.0005) [2023-12-26 08:10:57,850][123091] Updated weights for policy 0, policy_version 1076023 (0.0008) [2023-12-26 08:10:57,906][123091] Updated weights for policy 0, policy_version 1076033 (0.0009) [2023-12-26 08:10:57,945][123090] Updated weights for policy 1, policy_version 1068481 (0.0006) [2023-12-26 08:10:57,957][123091] Updated weights for policy 0, policy_version 1076043 (0.0008) [2023-12-26 08:10:58,004][123090] Updated weights for policy 1, policy_version 1068491 (0.0010) [2023-12-26 08:10:58,065][123090] Updated weights for policy 1, policy_version 1068501 (0.0010) [2023-12-26 08:10:58,131][123090] Updated weights for policy 1, policy_version 1068511 (0.0010) [2023-12-26 08:10:58,783][123091] Updated weights for policy 0, policy_version 1076053 (0.0008) [2023-12-26 08:10:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 549011456. Throughput: 0: 9124.8, 1: 8567.2. Samples: 549010284. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:10:58,784][121949] Avg episode reward: [(0, '6132.206'), (1, '4277.712')] [2023-12-26 08:10:58,839][123091] Updated weights for policy 0, policy_version 1076063 (0.0008) [2023-12-26 08:10:58,904][123091] Updated weights for policy 0, policy_version 1076073 (0.0008) [2023-12-26 08:10:59,038][123090] Updated weights for policy 1, policy_version 1068521 (0.0011) [2023-12-26 08:10:59,097][123090] Updated weights for policy 1, policy_version 1068531 (0.0010) [2023-12-26 08:10:59,156][123090] Updated weights for policy 1, policy_version 1068541 (0.0010) [2023-12-26 08:10:59,710][123091] Updated weights for policy 0, policy_version 1076083 (0.0008) [2023-12-26 08:10:59,757][123091] Updated weights for policy 0, policy_version 1076093 (0.0005) [2023-12-26 08:10:59,811][123091] Updated weights for policy 0, policy_version 1076103 (0.0005) [2023-12-26 08:11:00,030][123090] Updated weights for policy 1, policy_version 1068551 (0.0009) [2023-12-26 08:11:00,095][123090] Updated weights for policy 1, policy_version 1068561 (0.0009) [2023-12-26 08:11:00,161][123090] Updated weights for policy 1, policy_version 1068571 (0.0010) [2023-12-26 08:11:00,629][123091] Updated weights for policy 0, policy_version 1076113 (0.0009) [2023-12-26 08:11:00,690][123091] Updated weights for policy 0, policy_version 1076123 (0.0010) [2023-12-26 08:11:00,745][123091] Updated weights for policy 0, policy_version 1076133 (0.0007) [2023-12-26 08:11:00,799][123091] Updated weights for policy 0, policy_version 1076143 (0.0005) [2023-12-26 08:11:00,971][123090] Updated weights for policy 1, policy_version 1068581 (0.0009) [2023-12-26 08:11:01,038][123090] Updated weights for policy 1, policy_version 1068591 (0.0008) [2023-12-26 08:11:01,111][123090] Updated weights for policy 1, policy_version 1068601 (0.0009) [2023-12-26 08:11:01,582][123091] Updated weights for policy 0, policy_version 1076153 (0.0008) [2023-12-26 08:11:01,648][123091] Updated weights for policy 0, policy_version 1076163 (0.0010) [2023-12-26 08:11:01,707][123091] Updated weights for policy 0, policy_version 1076173 (0.0011) [2023-12-26 08:11:01,902][123090] Updated weights for policy 1, policy_version 1068611 (0.0009) [2023-12-26 08:11:01,962][123090] Updated weights for policy 1, policy_version 1068621 (0.0009) [2023-12-26 08:11:02,015][123090] Updated weights for policy 1, policy_version 1068631 (0.0009) [2023-12-26 08:11:02,548][123091] Updated weights for policy 0, policy_version 1076183 (0.0010) [2023-12-26 08:11:02,606][123091] Updated weights for policy 0, policy_version 1076193 (0.0010) [2023-12-26 08:11:02,668][123091] Updated weights for policy 0, policy_version 1076203 (0.0010) [2023-12-26 08:11:02,857][123090] Updated weights for policy 1, policy_version 1068641 (0.0009) [2023-12-26 08:11:02,913][123090] Updated weights for policy 1, policy_version 1068651 (0.0009) [2023-12-26 08:11:02,966][123090] Updated weights for policy 1, policy_version 1068661 (0.0009) [2023-12-26 08:11:03,024][123090] Updated weights for policy 1, policy_version 1068671 (0.0009) [2023-12-26 08:11:03,463][123091] Updated weights for policy 0, policy_version 1076213 (0.0010) [2023-12-26 08:11:03,514][123091] Updated weights for policy 0, policy_version 1076223 (0.0010) [2023-12-26 08:11:03,557][123091] Updated weights for policy 0, policy_version 1076233 (0.0010) [2023-12-26 08:11:03,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17612.9, 300 sec: 17883.6). Total num frames: 549101568. Throughput: 0: 9057.5, 1: 8564.7. Samples: 549112708. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:03,784][121949] Avg episode reward: [(0, '6159.774'), (1, '4397.613')] [2023-12-26 08:11:03,875][123090] Updated weights for policy 1, policy_version 1068681 (0.0008) [2023-12-26 08:11:03,941][123090] Updated weights for policy 1, policy_version 1068691 (0.0008) [2023-12-26 08:11:04,007][123090] Updated weights for policy 1, policy_version 1068701 (0.0008) [2023-12-26 08:11:04,414][123091] Updated weights for policy 0, policy_version 1076243 (0.0010) [2023-12-26 08:11:04,464][123091] Updated weights for policy 0, policy_version 1076253 (0.0009) [2023-12-26 08:11:04,520][123091] Updated weights for policy 0, policy_version 1076263 (0.0007) [2023-12-26 08:11:04,852][123090] Updated weights for policy 1, policy_version 1068711 (0.0009) [2023-12-26 08:11:04,911][123090] Updated weights for policy 1, policy_version 1068721 (0.0009) [2023-12-26 08:11:04,974][123090] Updated weights for policy 1, policy_version 1068731 (0.0010) [2023-12-26 08:11:05,229][123091] Updated weights for policy 0, policy_version 1076273 (0.0009) [2023-12-26 08:11:05,277][123091] Updated weights for policy 0, policy_version 1076283 (0.0009) [2023-12-26 08:11:05,326][123091] Updated weights for policy 0, policy_version 1076293 (0.0009) [2023-12-26 08:11:05,373][123091] Updated weights for policy 0, policy_version 1076303 (0.0008) [2023-12-26 08:11:05,758][123090] Updated weights for policy 1, policy_version 1068741 (0.0007) [2023-12-26 08:11:05,810][123090] Updated weights for policy 1, policy_version 1068751 (0.0009) [2023-12-26 08:11:05,858][123090] Updated weights for policy 1, policy_version 1068761 (0.0009) [2023-12-26 08:11:06,254][123091] Updated weights for policy 0, policy_version 1076313 (0.0010) [2023-12-26 08:11:06,321][123091] Updated weights for policy 0, policy_version 1076323 (0.0009) [2023-12-26 08:11:06,388][123091] Updated weights for policy 0, policy_version 1076333 (0.0010) [2023-12-26 08:11:06,703][123090] Updated weights for policy 1, policy_version 1068771 (0.0009) [2023-12-26 08:11:06,767][123090] Updated weights for policy 1, policy_version 1068781 (0.0009) [2023-12-26 08:11:06,818][123090] Updated weights for policy 1, policy_version 1068791 (0.0009) [2023-12-26 08:11:07,236][123091] Updated weights for policy 0, policy_version 1076343 (0.0010) [2023-12-26 08:11:07,301][123091] Updated weights for policy 0, policy_version 1076353 (0.0009) [2023-12-26 08:11:07,361][123091] Updated weights for policy 0, policy_version 1076363 (0.0009) [2023-12-26 08:11:07,640][123090] Updated weights for policy 1, policy_version 1068801 (0.0010) [2023-12-26 08:11:07,712][123090] Updated weights for policy 1, policy_version 1068811 (0.0009) [2023-12-26 08:11:07,779][123090] Updated weights for policy 1, policy_version 1068821 (0.0010) [2023-12-26 08:11:07,851][123090] Updated weights for policy 1, policy_version 1068831 (0.0009) [2023-12-26 08:11:08,165][123091] Updated weights for policy 0, policy_version 1076373 (0.0010) [2023-12-26 08:11:08,221][123091] Updated weights for policy 0, policy_version 1076383 (0.0010) [2023-12-26 08:11:08,286][123091] Updated weights for policy 0, policy_version 1076393 (0.0011) [2023-12-26 08:11:08,665][123090] Updated weights for policy 1, policy_version 1068841 (0.0008) [2023-12-26 08:11:08,718][123090] Updated weights for policy 1, policy_version 1068851 (0.0009) [2023-12-26 08:11:08,775][123090] Updated weights for policy 1, policy_version 1068861 (0.0009) [2023-12-26 08:11:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17883.6). Total num frames: 549183488. Throughput: 0: 9070.8, 1: 8580.2. Samples: 549164736. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:08,785][121949] Avg episode reward: [(0, '6160.201'), (1, '4906.128')] [2023-12-26 08:11:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001076400_275562496.pth... [2023-12-26 08:11:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001068864_273629184.pth... [2023-12-26 08:11:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001075376_275300352.pth [2023-12-26 08:11:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001067840_273367040.pth [2023-12-26 08:11:09,096][123091] Updated weights for policy 0, policy_version 1076403 (0.0009) [2023-12-26 08:11:09,153][123091] Updated weights for policy 0, policy_version 1076413 (0.0010) [2023-12-26 08:11:09,208][123091] Updated weights for policy 0, policy_version 1076423 (0.0010) [2023-12-26 08:11:09,609][123090] Updated weights for policy 1, policy_version 1068871 (0.0009) [2023-12-26 08:11:09,683][123090] Updated weights for policy 1, policy_version 1068881 (0.0010) [2023-12-26 08:11:09,748][123090] Updated weights for policy 1, policy_version 1068891 (0.0009) [2023-12-26 08:11:10,127][123091] Updated weights for policy 0, policy_version 1076433 (0.0009) [2023-12-26 08:11:10,190][123091] Updated weights for policy 0, policy_version 1076443 (0.0009) [2023-12-26 08:11:10,252][123091] Updated weights for policy 0, policy_version 1076453 (0.0010) [2023-12-26 08:11:10,316][123091] Updated weights for policy 0, policy_version 1076463 (0.0009) [2023-12-26 08:11:10,570][123090] Updated weights for policy 1, policy_version 1068901 (0.0008) [2023-12-26 08:11:10,632][123090] Updated weights for policy 1, policy_version 1068911 (0.0009) [2023-12-26 08:11:10,703][123090] Updated weights for policy 1, policy_version 1068921 (0.0009) [2023-12-26 08:11:11,156][123091] Updated weights for policy 0, policy_version 1076473 (0.0010) [2023-12-26 08:11:11,227][123091] Updated weights for policy 0, policy_version 1076483 (0.0010) [2023-12-26 08:11:11,304][123091] Updated weights for policy 0, policy_version 1076493 (0.0009) [2023-12-26 08:11:11,574][123090] Updated weights for policy 1, policy_version 1068931 (0.0010) [2023-12-26 08:11:11,643][123090] Updated weights for policy 1, policy_version 1068941 (0.0009) [2023-12-26 08:11:11,714][123090] Updated weights for policy 1, policy_version 1068951 (0.0009) [2023-12-26 08:11:12,173][123091] Updated weights for policy 0, policy_version 1076503 (0.0007) [2023-12-26 08:11:12,238][123091] Updated weights for policy 0, policy_version 1076513 (0.0006) [2023-12-26 08:11:12,304][123091] Updated weights for policy 0, policy_version 1076523 (0.0007) [2023-12-26 08:11:12,603][123090] Updated weights for policy 1, policy_version 1068961 (0.0010) [2023-12-26 08:11:12,668][123090] Updated weights for policy 1, policy_version 1068971 (0.0010) [2023-12-26 08:11:12,734][123090] Updated weights for policy 1, policy_version 1068981 (0.0010) [2023-12-26 08:11:12,794][123090] Updated weights for policy 1, policy_version 1068991 (0.0010) [2023-12-26 08:11:13,103][123091] Updated weights for policy 0, policy_version 1076533 (0.0009) [2023-12-26 08:11:13,154][123091] Updated weights for policy 0, policy_version 1076543 (0.0009) [2023-12-26 08:11:13,207][123091] Updated weights for policy 0, policy_version 1076553 (0.0010) [2023-12-26 08:11:13,489][123090] Updated weights for policy 1, policy_version 1069001 (0.0006) [2023-12-26 08:11:13,542][123090] Updated weights for policy 1, policy_version 1069011 (0.0006) [2023-12-26 08:11:13,596][123090] Updated weights for policy 1, policy_version 1069021 (0.0008) [2023-12-26 08:11:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 549273600. Throughput: 0: 9018.4, 1: 8543.4. Samples: 549265712. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:13,784][121949] Avg episode reward: [(0, '6116.183'), (1, '4664.757')] [2023-12-26 08:11:14,089][123091] Updated weights for policy 0, policy_version 1076563 (0.0011) [2023-12-26 08:11:14,152][123091] Updated weights for policy 0, policy_version 1076573 (0.0006) [2023-12-26 08:11:14,206][123091] Updated weights for policy 0, policy_version 1076583 (0.0005) [2023-12-26 08:11:14,385][123090] Updated weights for policy 1, policy_version 1069031 (0.0007) [2023-12-26 08:11:14,432][123090] Updated weights for policy 1, policy_version 1069041 (0.0005) [2023-12-26 08:11:14,481][123090] Updated weights for policy 1, policy_version 1069051 (0.0005) [2023-12-26 08:11:14,957][123091] Updated weights for policy 0, policy_version 1076593 (0.0006) [2023-12-26 08:11:15,023][123091] Updated weights for policy 0, policy_version 1076603 (0.0010) [2023-12-26 08:11:15,073][123091] Updated weights for policy 0, policy_version 1076613 (0.0009) [2023-12-26 08:11:15,125][123091] Updated weights for policy 0, policy_version 1076623 (0.0010) [2023-12-26 08:11:15,229][123090] Updated weights for policy 1, policy_version 1069061 (0.0008) [2023-12-26 08:11:15,296][123090] Updated weights for policy 1, policy_version 1069071 (0.0009) [2023-12-26 08:11:15,349][123090] Updated weights for policy 1, policy_version 1069081 (0.0009) [2023-12-26 08:11:16,022][123091] Updated weights for policy 0, policy_version 1076633 (0.0010) [2023-12-26 08:11:16,052][123090] Updated weights for policy 1, policy_version 1069091 (0.0009) [2023-12-26 08:11:16,073][123091] Updated weights for policy 0, policy_version 1076643 (0.0008) [2023-12-26 08:11:16,110][123090] Updated weights for policy 1, policy_version 1069101 (0.0009) [2023-12-26 08:11:16,130][123091] Updated weights for policy 0, policy_version 1076653 (0.0008) [2023-12-26 08:11:16,172][123090] Updated weights for policy 1, policy_version 1069111 (0.0010) [2023-12-26 08:11:16,980][123091] Updated weights for policy 0, policy_version 1076663 (0.0008) [2023-12-26 08:11:17,002][123090] Updated weights for policy 1, policy_version 1069121 (0.0009) [2023-12-26 08:11:17,028][123091] Updated weights for policy 0, policy_version 1076673 (0.0009) [2023-12-26 08:11:17,064][123090] Updated weights for policy 1, policy_version 1069131 (0.0008) [2023-12-26 08:11:17,085][123091] Updated weights for policy 0, policy_version 1076683 (0.0009) [2023-12-26 08:11:17,110][123090] Updated weights for policy 1, policy_version 1069141 (0.0005) [2023-12-26 08:11:17,162][123090] Updated weights for policy 1, policy_version 1069151 (0.0005) [2023-12-26 08:11:17,866][123090] Updated weights for policy 1, policy_version 1069161 (0.0005) [2023-12-26 08:11:17,927][123090] Updated weights for policy 1, policy_version 1069171 (0.0005) [2023-12-26 08:11:17,990][123090] Updated weights for policy 1, policy_version 1069181 (0.0005) [2023-12-26 08:11:18,001][123091] Updated weights for policy 0, policy_version 1076693 (0.0009) [2023-12-26 08:11:18,055][123091] Updated weights for policy 0, policy_version 1076703 (0.0010) [2023-12-26 08:11:18,108][123091] Updated weights for policy 0, policy_version 1076713 (0.0010) [2023-12-26 08:11:18,574][123090] Updated weights for policy 1, policy_version 1069191 (0.0007) [2023-12-26 08:11:18,628][123090] Updated weights for policy 1, policy_version 1069201 (0.0005) [2023-12-26 08:11:18,684][123090] Updated weights for policy 1, policy_version 1069211 (0.0005) [2023-12-26 08:11:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17883.5). Total num frames: 549363712. Throughput: 0: 8796.7, 1: 8728.8. Samples: 549373296. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:18,785][121949] Avg episode reward: [(0, '5940.238'), (1, '4724.327')] [2023-12-26 08:11:19,007][123091] Updated weights for policy 0, policy_version 1076723 (0.0010) [2023-12-26 08:11:19,070][123091] Updated weights for policy 0, policy_version 1076733 (0.0010) [2023-12-26 08:11:19,140][123091] Updated weights for policy 0, policy_version 1076743 (0.0009) [2023-12-26 08:11:19,443][123090] Updated weights for policy 1, policy_version 1069221 (0.0008) [2023-12-26 08:11:19,514][123090] Updated weights for policy 1, policy_version 1069231 (0.0009) [2023-12-26 08:11:19,579][123090] Updated weights for policy 1, policy_version 1069241 (0.0009) [2023-12-26 08:11:19,983][123091] Updated weights for policy 0, policy_version 1076753 (0.0009) [2023-12-26 08:11:20,057][123091] Updated weights for policy 0, policy_version 1076763 (0.0010) [2023-12-26 08:11:20,133][123091] Updated weights for policy 0, policy_version 1076773 (0.0010) [2023-12-26 08:11:20,199][123091] Updated weights for policy 0, policy_version 1076783 (0.0010) [2023-12-26 08:11:20,400][123090] Updated weights for policy 1, policy_version 1069251 (0.0008) [2023-12-26 08:11:20,448][123090] Updated weights for policy 1, policy_version 1069261 (0.0009) [2023-12-26 08:11:20,504][123090] Updated weights for policy 1, policy_version 1069271 (0.0009) [2023-12-26 08:11:20,949][123091] Updated weights for policy 0, policy_version 1076793 (0.0010) [2023-12-26 08:11:21,006][123091] Updated weights for policy 0, policy_version 1076803 (0.0006) [2023-12-26 08:11:21,078][123091] Updated weights for policy 0, policy_version 1076813 (0.0009) [2023-12-26 08:11:21,420][123090] Updated weights for policy 1, policy_version 1069281 (0.0009) [2023-12-26 08:11:21,484][123090] Updated weights for policy 1, policy_version 1069291 (0.0007) [2023-12-26 08:11:21,546][123090] Updated weights for policy 1, policy_version 1069301 (0.0010) [2023-12-26 08:11:21,614][123090] Updated weights for policy 1, policy_version 1069311 (0.0010) [2023-12-26 08:11:21,889][123091] Updated weights for policy 0, policy_version 1076823 (0.0010) [2023-12-26 08:11:21,949][123091] Updated weights for policy 0, policy_version 1076833 (0.0009) [2023-12-26 08:11:22,024][123091] Updated weights for policy 0, policy_version 1076843 (0.0006) [2023-12-26 08:11:22,512][123090] Updated weights for policy 1, policy_version 1069321 (0.0009) [2023-12-26 08:11:22,573][123090] Updated weights for policy 1, policy_version 1069331 (0.0008) [2023-12-26 08:11:22,630][123090] Updated weights for policy 1, policy_version 1069341 (0.0008) [2023-12-26 08:11:22,795][123091] Updated weights for policy 0, policy_version 1076853 (0.0008) [2023-12-26 08:11:22,840][123091] Updated weights for policy 0, policy_version 1076863 (0.0010) [2023-12-26 08:11:22,888][123091] Updated weights for policy 0, policy_version 1076873 (0.0010) [2023-12-26 08:11:23,358][123090] Updated weights for policy 1, policy_version 1069351 (0.0007) [2023-12-26 08:11:23,432][123090] Updated weights for policy 1, policy_version 1069361 (0.0005) [2023-12-26 08:11:23,492][123090] Updated weights for policy 1, policy_version 1069371 (0.0005) [2023-12-26 08:11:23,573][123091] Updated weights for policy 0, policy_version 1076883 (0.0009) [2023-12-26 08:11:23,637][123091] Updated weights for policy 0, policy_version 1076893 (0.0005) [2023-12-26 08:11:23,705][123091] Updated weights for policy 0, policy_version 1076903 (0.0005) [2023-12-26 08:11:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 549453824. Throughput: 0: 8695.8, 1: 8760.7. Samples: 549423784. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:23,785][121949] Avg episode reward: [(0, '5989.919'), (1, '4488.644')] [2023-12-26 08:11:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001076912_275693568.pth... [2023-12-26 08:11:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001069376_273760256.pth... [2023-12-26 08:11:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001075888_275431424.pth [2023-12-26 08:11:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001068352_273498112.pth [2023-12-26 08:11:24,244][123090] Updated weights for policy 1, policy_version 1069381 (0.0007) [2023-12-26 08:11:24,300][123090] Updated weights for policy 1, policy_version 1069391 (0.0008) [2023-12-26 08:11:24,349][123090] Updated weights for policy 1, policy_version 1069401 (0.0009) [2023-12-26 08:11:24,462][123091] Updated weights for policy 0, policy_version 1076913 (0.0006) [2023-12-26 08:11:24,529][123091] Updated weights for policy 0, policy_version 1076923 (0.0011) [2023-12-26 08:11:24,594][123091] Updated weights for policy 0, policy_version 1076933 (0.0011) [2023-12-26 08:11:24,670][123091] Updated weights for policy 0, policy_version 1076943 (0.0010) [2023-12-26 08:11:25,195][123090] Updated weights for policy 1, policy_version 1069411 (0.0009) [2023-12-26 08:11:25,256][123090] Updated weights for policy 1, policy_version 1069421 (0.0009) [2023-12-26 08:11:25,321][123090] Updated weights for policy 1, policy_version 1069431 (0.0009) [2023-12-26 08:11:25,466][123091] Updated weights for policy 0, policy_version 1076953 (0.0010) [2023-12-26 08:11:25,521][123091] Updated weights for policy 0, policy_version 1076963 (0.0009) [2023-12-26 08:11:25,584][123091] Updated weights for policy 0, policy_version 1076973 (0.0010) [2023-12-26 08:11:26,138][123090] Updated weights for policy 1, policy_version 1069441 (0.0010) [2023-12-26 08:11:26,212][123090] Updated weights for policy 1, policy_version 1069451 (0.0009) [2023-12-26 08:11:26,265][123090] Updated weights for policy 1, policy_version 1069461 (0.0009) [2023-12-26 08:11:26,324][123090] Updated weights for policy 1, policy_version 1069471 (0.0010) [2023-12-26 08:11:26,379][123091] Updated weights for policy 0, policy_version 1076983 (0.0006) [2023-12-26 08:11:26,437][123091] Updated weights for policy 0, policy_version 1076993 (0.0009) [2023-12-26 08:11:26,498][123091] Updated weights for policy 0, policy_version 1077003 (0.0008) [2023-12-26 08:11:27,194][123090] Updated weights for policy 1, policy_version 1069481 (0.0010) [2023-12-26 08:11:27,249][123090] Updated weights for policy 1, policy_version 1069491 (0.0009) [2023-12-26 08:11:27,252][123091] Updated weights for policy 0, policy_version 1077013 (0.0008) [2023-12-26 08:11:27,296][123090] Updated weights for policy 1, policy_version 1069501 (0.0009) [2023-12-26 08:11:27,318][123091] Updated weights for policy 0, policy_version 1077023 (0.0008) [2023-12-26 08:11:27,382][123091] Updated weights for policy 0, policy_version 1077033 (0.0009) [2023-12-26 08:11:28,070][123090] Updated weights for policy 1, policy_version 1069511 (0.0006) [2023-12-26 08:11:28,120][123091] Updated weights for policy 0, policy_version 1077043 (0.0008) [2023-12-26 08:11:28,145][123090] Updated weights for policy 1, policy_version 1069521 (0.0005) [2023-12-26 08:11:28,180][123091] Updated weights for policy 0, policy_version 1077053 (0.0008) [2023-12-26 08:11:28,215][123090] Updated weights for policy 1, policy_version 1069531 (0.0006) [2023-12-26 08:11:28,239][123091] Updated weights for policy 0, policy_version 1077063 (0.0005) [2023-12-26 08:11:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 549535744. Throughput: 0: 8720.8, 1: 8813.6. Samples: 549529904. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:28,785][121949] Avg episode reward: [(0, '6007.419'), (1, '4289.342')] [2023-12-26 08:11:28,935][123091] Updated weights for policy 0, policy_version 1077073 (0.0005) [2023-12-26 08:11:28,957][123090] Updated weights for policy 1, policy_version 1069541 (0.0007) [2023-12-26 08:11:28,983][123091] Updated weights for policy 0, policy_version 1077083 (0.0007) [2023-12-26 08:11:29,012][123090] Updated weights for policy 1, policy_version 1069551 (0.0008) [2023-12-26 08:11:29,032][123091] Updated weights for policy 0, policy_version 1077093 (0.0007) [2023-12-26 08:11:29,075][123090] Updated weights for policy 1, policy_version 1069561 (0.0010) [2023-12-26 08:11:29,090][123091] Updated weights for policy 0, policy_version 1077103 (0.0007) [2023-12-26 08:11:29,893][123091] Updated weights for policy 0, policy_version 1077113 (0.0009) [2023-12-26 08:11:29,933][123090] Updated weights for policy 1, policy_version 1069571 (0.0008) [2023-12-26 08:11:29,953][123091] Updated weights for policy 0, policy_version 1077123 (0.0009) [2023-12-26 08:11:29,996][123090] Updated weights for policy 1, policy_version 1069581 (0.0009) [2023-12-26 08:11:30,000][123091] Updated weights for policy 0, policy_version 1077133 (0.0007) [2023-12-26 08:11:30,056][123090] Updated weights for policy 1, policy_version 1069591 (0.0010) [2023-12-26 08:11:30,781][123091] Updated weights for policy 0, policy_version 1077143 (0.0009) [2023-12-26 08:11:30,839][123091] Updated weights for policy 0, policy_version 1077153 (0.0010) [2023-12-26 08:11:30,884][123090] Updated weights for policy 1, policy_version 1069601 (0.0009) [2023-12-26 08:11:30,887][123091] Updated weights for policy 0, policy_version 1077163 (0.0009) [2023-12-26 08:11:30,951][123090] Updated weights for policy 1, policy_version 1069611 (0.0009) [2023-12-26 08:11:31,021][123090] Updated weights for policy 1, policy_version 1069621 (0.0009) [2023-12-26 08:11:31,084][123090] Updated weights for policy 1, policy_version 1069631 (0.0009) [2023-12-26 08:11:31,734][123091] Updated weights for policy 0, policy_version 1077173 (0.0010) [2023-12-26 08:11:31,785][123091] Updated weights for policy 0, policy_version 1077183 (0.0009) [2023-12-26 08:11:31,853][123091] Updated weights for policy 0, policy_version 1077193 (0.0010) [2023-12-26 08:11:31,920][123090] Updated weights for policy 1, policy_version 1069641 (0.0009) [2023-12-26 08:11:31,977][123090] Updated weights for policy 1, policy_version 1069651 (0.0010) [2023-12-26 08:11:32,042][123090] Updated weights for policy 1, policy_version 1069661 (0.0010) [2023-12-26 08:11:32,673][123091] Updated weights for policy 0, policy_version 1077203 (0.0008) [2023-12-26 08:11:32,732][123091] Updated weights for policy 0, policy_version 1077213 (0.0005) [2023-12-26 08:11:32,791][123091] Updated weights for policy 0, policy_version 1077223 (0.0005) [2023-12-26 08:11:32,892][123090] Updated weights for policy 1, policy_version 1069671 (0.0010) [2023-12-26 08:11:32,962][123090] Updated weights for policy 1, policy_version 1069681 (0.0010) [2023-12-26 08:11:33,032][123090] Updated weights for policy 1, policy_version 1069691 (0.0010) [2023-12-26 08:11:33,569][123091] Updated weights for policy 0, policy_version 1077233 (0.0007) [2023-12-26 08:11:33,618][123091] Updated weights for policy 0, policy_version 1077243 (0.0008) [2023-12-26 08:11:33,669][123091] Updated weights for policy 0, policy_version 1077254 (0.0008) [2023-12-26 08:11:33,725][123091] Updated weights for policy 0, policy_version 1077264 (0.0009) [2023-12-26 08:11:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 549625856. Throughput: 0: 8703.7, 1: 8743.1. Samples: 549636448. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:33,785][121949] Avg episode reward: [(0, '5921.885'), (1, '4179.534')] [2023-12-26 08:11:33,803][123090] Updated weights for policy 1, policy_version 1069701 (0.0008) [2023-12-26 08:11:33,865][123090] Updated weights for policy 1, policy_version 1069711 (0.0005) [2023-12-26 08:11:33,922][123090] Updated weights for policy 1, policy_version 1069721 (0.0005) [2023-12-26 08:11:34,625][123090] Updated weights for policy 1, policy_version 1069731 (0.0007) [2023-12-26 08:11:34,662][123091] Updated weights for policy 0, policy_version 1077274 (0.0007) [2023-12-26 08:11:34,690][123090] Updated weights for policy 1, policy_version 1069741 (0.0009) [2023-12-26 08:11:34,727][123091] Updated weights for policy 0, policy_version 1077284 (0.0008) [2023-12-26 08:11:34,757][123090] Updated weights for policy 1, policy_version 1069751 (0.0009) [2023-12-26 08:11:34,791][123091] Updated weights for policy 0, policy_version 1077294 (0.0007) [2023-12-26 08:11:35,577][123090] Updated weights for policy 1, policy_version 1069761 (0.0010) [2023-12-26 08:11:35,584][123091] Updated weights for policy 0, policy_version 1077304 (0.0009) [2023-12-26 08:11:35,644][123090] Updated weights for policy 1, policy_version 1069771 (0.0009) [2023-12-26 08:11:35,654][123091] Updated weights for policy 0, policy_version 1077314 (0.0009) [2023-12-26 08:11:35,708][123090] Updated weights for policy 1, policy_version 1069781 (0.0007) [2023-12-26 08:11:35,714][123091] Updated weights for policy 0, policy_version 1077324 (0.0009) [2023-12-26 08:11:35,766][123090] Updated weights for policy 1, policy_version 1069791 (0.0009) [2023-12-26 08:11:36,488][123091] Updated weights for policy 0, policy_version 1077334 (0.0007) [2023-12-26 08:11:36,537][123090] Updated weights for policy 1, policy_version 1069801 (0.0007) [2023-12-26 08:11:36,550][123091] Updated weights for policy 0, policy_version 1077344 (0.0007) [2023-12-26 08:11:36,602][123090] Updated weights for policy 1, policy_version 1069811 (0.0009) [2023-12-26 08:11:36,611][123091] Updated weights for policy 0, policy_version 1077354 (0.0008) [2023-12-26 08:11:36,670][123090] Updated weights for policy 1, policy_version 1069821 (0.0009) [2023-12-26 08:11:37,307][123091] Updated weights for policy 0, policy_version 1077364 (0.0007) [2023-12-26 08:11:37,361][123091] Updated weights for policy 0, policy_version 1077374 (0.0005) [2023-12-26 08:11:37,417][123091] Updated weights for policy 0, policy_version 1077384 (0.0005) [2023-12-26 08:11:37,607][123090] Updated weights for policy 1, policy_version 1069831 (0.0010) [2023-12-26 08:11:37,669][123090] Updated weights for policy 1, policy_version 1069841 (0.0008) [2023-12-26 08:11:37,729][123090] Updated weights for policy 1, policy_version 1069851 (0.0006) [2023-12-26 08:11:38,037][123091] Updated weights for policy 0, policy_version 1077394 (0.0006) [2023-12-26 08:11:38,108][123091] Updated weights for policy 0, policy_version 1077404 (0.0005) [2023-12-26 08:11:38,174][123091] Updated weights for policy 0, policy_version 1077414 (0.0005) [2023-12-26 08:11:38,226][123091] Updated weights for policy 0, policy_version 1077424 (0.0007) [2023-12-26 08:11:38,552][123090] Updated weights for policy 1, policy_version 1069861 (0.0007) [2023-12-26 08:11:38,616][123090] Updated weights for policy 1, policy_version 1069871 (0.0009) [2023-12-26 08:11:38,680][123090] Updated weights for policy 1, policy_version 1069881 (0.0009) [2023-12-26 08:11:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17883.5). Total num frames: 549715968. Throughput: 0: 8721.6, 1: 8738.4. Samples: 549689024. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:38,785][121949] Avg episode reward: [(0, '6139.681'), (1, '4370.525')] [2023-12-26 08:11:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001077424_275824640.pth... [2023-12-26 08:11:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001069888_273891328.pth... [2023-12-26 08:11:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001068864_273629184.pth [2023-12-26 08:11:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001076400_275562496.pth [2023-12-26 08:11:38,886][123091] Updated weights for policy 0, policy_version 1077434 (0.0010) [2023-12-26 08:11:38,948][123091] Updated weights for policy 0, policy_version 1077444 (0.0010) [2023-12-26 08:11:39,010][123091] Updated weights for policy 0, policy_version 1077454 (0.0008) [2023-12-26 08:11:39,518][123090] Updated weights for policy 1, policy_version 1069891 (0.0009) [2023-12-26 08:11:39,582][123090] Updated weights for policy 1, policy_version 1069901 (0.0009) [2023-12-26 08:11:39,649][123090] Updated weights for policy 1, policy_version 1069911 (0.0009) [2023-12-26 08:11:39,853][123091] Updated weights for policy 0, policy_version 1077464 (0.0009) [2023-12-26 08:11:39,926][123091] Updated weights for policy 0, policy_version 1077474 (0.0009) [2023-12-26 08:11:39,993][123091] Updated weights for policy 0, policy_version 1077484 (0.0009) [2023-12-26 08:11:40,501][123090] Updated weights for policy 1, policy_version 1069921 (0.0008) [2023-12-26 08:11:40,568][123090] Updated weights for policy 1, policy_version 1069931 (0.0009) [2023-12-26 08:11:40,636][123090] Updated weights for policy 1, policy_version 1069941 (0.0009) [2023-12-26 08:11:40,706][123090] Updated weights for policy 1, policy_version 1069951 (0.0009) [2023-12-26 08:11:40,816][123091] Updated weights for policy 0, policy_version 1077494 (0.0009) [2023-12-26 08:11:40,877][123091] Updated weights for policy 0, policy_version 1077504 (0.0010) [2023-12-26 08:11:40,943][123091] Updated weights for policy 0, policy_version 1077514 (0.0008) [2023-12-26 08:11:41,452][123090] Updated weights for policy 1, policy_version 1069961 (0.0007) [2023-12-26 08:11:41,517][123090] Updated weights for policy 1, policy_version 1069971 (0.0008) [2023-12-26 08:11:41,578][123090] Updated weights for policy 1, policy_version 1069981 (0.0009) [2023-12-26 08:11:41,855][123091] Updated weights for policy 0, policy_version 1077524 (0.0008) [2023-12-26 08:11:41,924][123091] Updated weights for policy 0, policy_version 1077534 (0.0005) [2023-12-26 08:11:41,987][123091] Updated weights for policy 0, policy_version 1077544 (0.0005) [2023-12-26 08:11:42,341][123090] Updated weights for policy 1, policy_version 1069991 (0.0010) [2023-12-26 08:11:42,418][123090] Updated weights for policy 1, policy_version 1070001 (0.0007) [2023-12-26 08:11:42,488][123090] Updated weights for policy 1, policy_version 1070011 (0.0007) [2023-12-26 08:11:42,814][123091] Updated weights for policy 0, policy_version 1077554 (0.0007) [2023-12-26 08:11:42,881][123091] Updated weights for policy 0, policy_version 1077564 (0.0011) [2023-12-26 08:11:42,948][123091] Updated weights for policy 0, policy_version 1077574 (0.0011) [2023-12-26 08:11:43,016][123091] Updated weights for policy 0, policy_version 1077584 (0.0011) [2023-12-26 08:11:43,226][123090] Updated weights for policy 1, policy_version 1070021 (0.0010) [2023-12-26 08:11:43,277][123090] Updated weights for policy 1, policy_version 1070031 (0.0010) [2023-12-26 08:11:43,325][123090] Updated weights for policy 1, policy_version 1070041 (0.0010) [2023-12-26 08:11:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17855.8). Total num frames: 549797888. Throughput: 0: 8728.4, 1: 8661.1. Samples: 549792816. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:43,785][121949] Avg episode reward: [(0, '6266.830'), (1, '4508.810')] [2023-12-26 08:11:43,813][123091] Updated weights for policy 0, policy_version 1077594 (0.0009) [2023-12-26 08:11:43,861][123091] Updated weights for policy 0, policy_version 1077604 (0.0009) [2023-12-26 08:11:43,908][123091] Updated weights for policy 0, policy_version 1077614 (0.0009) [2023-12-26 08:11:44,177][123090] Updated weights for policy 1, policy_version 1070051 (0.0010) [2023-12-26 08:11:44,229][123090] Updated weights for policy 1, policy_version 1070061 (0.0010) [2023-12-26 08:11:44,280][123090] Updated weights for policy 1, policy_version 1070071 (0.0010) [2023-12-26 08:11:44,758][123091] Updated weights for policy 0, policy_version 1077624 (0.0009) [2023-12-26 08:11:44,827][123091] Updated weights for policy 0, policy_version 1077634 (0.0010) [2023-12-26 08:11:44,892][123091] Updated weights for policy 0, policy_version 1077644 (0.0009) [2023-12-26 08:11:45,123][123090] Updated weights for policy 1, policy_version 1070081 (0.0010) [2023-12-26 08:11:45,183][123090] Updated weights for policy 1, policy_version 1070091 (0.0011) [2023-12-26 08:11:45,247][123090] Updated weights for policy 1, policy_version 1070101 (0.0011) [2023-12-26 08:11:45,314][123090] Updated weights for policy 1, policy_version 1070111 (0.0009) [2023-12-26 08:11:45,707][123091] Updated weights for policy 0, policy_version 1077654 (0.0009) [2023-12-26 08:11:45,777][123091] Updated weights for policy 0, policy_version 1077664 (0.0009) [2023-12-26 08:11:45,851][123091] Updated weights for policy 0, policy_version 1077674 (0.0008) [2023-12-26 08:11:46,152][123090] Updated weights for policy 1, policy_version 1070121 (0.0006) [2023-12-26 08:11:46,229][123090] Updated weights for policy 1, policy_version 1070131 (0.0005) [2023-12-26 08:11:46,302][123090] Updated weights for policy 1, policy_version 1070141 (0.0007) [2023-12-26 08:11:46,429][123091] Updated weights for policy 0, policy_version 1077684 (0.0006) [2023-12-26 08:11:46,506][123091] Updated weights for policy 0, policy_version 1077694 (0.0005) [2023-12-26 08:11:46,568][123091] Updated weights for policy 0, policy_version 1077704 (0.0005) [2023-12-26 08:11:47,016][123090] Updated weights for policy 1, policy_version 1070151 (0.0007) [2023-12-26 08:11:47,087][123090] Updated weights for policy 1, policy_version 1070161 (0.0005) [2023-12-26 08:11:47,146][123090] Updated weights for policy 1, policy_version 1070171 (0.0005) [2023-12-26 08:11:47,292][123091] Updated weights for policy 0, policy_version 1077714 (0.0006) [2023-12-26 08:11:47,339][123091] Updated weights for policy 0, policy_version 1077724 (0.0010) [2023-12-26 08:11:47,393][123091] Updated weights for policy 0, policy_version 1077734 (0.0010) [2023-12-26 08:11:47,447][123091] Updated weights for policy 0, policy_version 1077744 (0.0010) [2023-12-26 08:11:47,802][123090] Updated weights for policy 1, policy_version 1070181 (0.0005) [2023-12-26 08:11:47,853][123090] Updated weights for policy 1, policy_version 1070191 (0.0005) [2023-12-26 08:11:47,900][123090] Updated weights for policy 1, policy_version 1070201 (0.0005) [2023-12-26 08:11:48,274][123091] Updated weights for policy 0, policy_version 1077754 (0.0010) [2023-12-26 08:11:48,341][123091] Updated weights for policy 0, policy_version 1077764 (0.0010) [2023-12-26 08:11:48,401][123091] Updated weights for policy 0, policy_version 1077774 (0.0010) [2023-12-26 08:11:48,727][123090] Updated weights for policy 1, policy_version 1070211 (0.0007) [2023-12-26 08:11:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 549888000. Throughput: 0: 8779.3, 1: 8751.1. Samples: 549901576. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:48,785][121949] Avg episode reward: [(0, '6089.594'), (1, '4818.389')] [2023-12-26 08:11:48,798][123090] Updated weights for policy 1, policy_version 1070221 (0.0010) [2023-12-26 08:11:48,869][123090] Updated weights for policy 1, policy_version 1070231 (0.0010) [2023-12-26 08:11:49,225][123091] Updated weights for policy 0, policy_version 1077784 (0.0007) [2023-12-26 08:11:49,288][123091] Updated weights for policy 0, policy_version 1077794 (0.0006) [2023-12-26 08:11:49,346][123091] Updated weights for policy 0, policy_version 1077804 (0.0007) [2023-12-26 08:11:49,730][123090] Updated weights for policy 1, policy_version 1070241 (0.0011) [2023-12-26 08:11:49,793][123090] Updated weights for policy 1, policy_version 1070251 (0.0010) [2023-12-26 08:11:49,866][123090] Updated weights for policy 1, policy_version 1070261 (0.0010) [2023-12-26 08:11:49,941][123090] Updated weights for policy 1, policy_version 1070271 (0.0009) [2023-12-26 08:11:50,121][123091] Updated weights for policy 0, policy_version 1077814 (0.0010) [2023-12-26 08:11:50,192][123091] Updated weights for policy 0, policy_version 1077824 (0.0011) [2023-12-26 08:11:50,251][123091] Updated weights for policy 0, policy_version 1077834 (0.0010) [2023-12-26 08:11:50,777][123090] Updated weights for policy 1, policy_version 1070281 (0.0006) [2023-12-26 08:11:50,837][123090] Updated weights for policy 1, policy_version 1070291 (0.0010) [2023-12-26 08:11:50,905][123090] Updated weights for policy 1, policy_version 1070301 (0.0011) [2023-12-26 08:11:50,985][123091] Updated weights for policy 0, policy_version 1077844 (0.0011) [2023-12-26 08:11:51,053][123091] Updated weights for policy 0, policy_version 1077854 (0.0010) [2023-12-26 08:11:51,123][123091] Updated weights for policy 0, policy_version 1077864 (0.0012) [2023-12-26 08:11:51,804][123090] Updated weights for policy 1, policy_version 1070311 (0.0010) [2023-12-26 08:11:51,867][123090] Updated weights for policy 1, policy_version 1070321 (0.0010) [2023-12-26 08:11:51,930][123091] Updated weights for policy 0, policy_version 1077874 (0.0010) [2023-12-26 08:11:51,932][123090] Updated weights for policy 1, policy_version 1070331 (0.0009) [2023-12-26 08:11:51,994][123091] Updated weights for policy 0, policy_version 1077884 (0.0008) [2023-12-26 08:11:52,046][123091] Updated weights for policy 0, policy_version 1077894 (0.0009) [2023-12-26 08:11:52,102][123091] Updated weights for policy 0, policy_version 1077904 (0.0010) [2023-12-26 08:11:52,776][123090] Updated weights for policy 1, policy_version 1070341 (0.0009) [2023-12-26 08:11:52,832][123090] Updated weights for policy 1, policy_version 1070351 (0.0009) [2023-12-26 08:11:52,889][123090] Updated weights for policy 1, policy_version 1070361 (0.0009) [2023-12-26 08:11:52,966][123091] Updated weights for policy 0, policy_version 1077914 (0.0010) [2023-12-26 08:11:53,018][123091] Updated weights for policy 0, policy_version 1077924 (0.0009) [2023-12-26 08:11:53,068][123091] Updated weights for policy 0, policy_version 1077934 (0.0009) [2023-12-26 08:11:53,725][123090] Updated weights for policy 1, policy_version 1070371 (0.0007) [2023-12-26 08:11:53,783][123090] Updated weights for policy 1, policy_version 1070381 (0.0005) [2023-12-26 08:11:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17828.0). Total num frames: 549969920. Throughput: 0: 8788.1, 1: 8734.5. Samples: 549953252. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:53,785][121949] Avg episode reward: [(0, '5933.417'), (1, '4557.373')] [2023-12-26 08:11:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001077936_275955712.pth... [2023-12-26 08:11:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001076912_275693568.pth [2023-12-26 08:11:53,839][123090] Updated weights for policy 1, policy_version 1070391 (0.0005) [2023-12-26 08:11:53,890][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001070400_274022400.pth... [2023-12-26 08:11:53,893][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001069376_273760256.pth [2023-12-26 08:11:53,954][123091] Updated weights for policy 0, policy_version 1077944 (0.0008) [2023-12-26 08:11:54,003][123091] Updated weights for policy 0, policy_version 1077954 (0.0009) [2023-12-26 08:11:54,054][123091] Updated weights for policy 0, policy_version 1077964 (0.0008) [2023-12-26 08:11:54,585][123090] Updated weights for policy 1, policy_version 1070401 (0.0007) [2023-12-26 08:11:54,641][123090] Updated weights for policy 1, policy_version 1070411 (0.0005) [2023-12-26 08:11:54,697][123090] Updated weights for policy 1, policy_version 1070421 (0.0005) [2023-12-26 08:11:54,769][123090] Updated weights for policy 1, policy_version 1070431 (0.0005) [2023-12-26 08:11:54,853][123091] Updated weights for policy 0, policy_version 1077974 (0.0008) [2023-12-26 08:11:54,924][123091] Updated weights for policy 0, policy_version 1077984 (0.0010) [2023-12-26 08:11:54,979][123091] Updated weights for policy 0, policy_version 1077994 (0.0010) [2023-12-26 08:11:55,492][123090] Updated weights for policy 1, policy_version 1070441 (0.0007) [2023-12-26 08:11:55,555][123090] Updated weights for policy 1, policy_version 1070451 (0.0009) [2023-12-26 08:11:55,625][123090] Updated weights for policy 1, policy_version 1070461 (0.0006) [2023-12-26 08:11:55,827][123091] Updated weights for policy 0, policy_version 1078004 (0.0008) [2023-12-26 08:11:55,903][123091] Updated weights for policy 0, policy_version 1078014 (0.0007) [2023-12-26 08:11:55,952][123091] Updated weights for policy 0, policy_version 1078024 (0.0006) [2023-12-26 08:11:56,316][123090] Updated weights for policy 1, policy_version 1070471 (0.0005) [2023-12-26 08:11:56,367][123090] Updated weights for policy 1, policy_version 1070481 (0.0005) [2023-12-26 08:11:56,414][123090] Updated weights for policy 1, policy_version 1070491 (0.0005) [2023-12-26 08:11:56,606][123091] Updated weights for policy 0, policy_version 1078034 (0.0007) [2023-12-26 08:11:56,659][123091] Updated weights for policy 0, policy_version 1078044 (0.0005) [2023-12-26 08:11:56,707][123091] Updated weights for policy 0, policy_version 1078054 (0.0005) [2023-12-26 08:11:56,758][123091] Updated weights for policy 0, policy_version 1078064 (0.0006) [2023-12-26 08:11:57,027][123090] Updated weights for policy 1, policy_version 1070501 (0.0005) [2023-12-26 08:11:57,080][123090] Updated weights for policy 1, policy_version 1070511 (0.0005) [2023-12-26 08:11:57,137][123090] Updated weights for policy 1, policy_version 1070521 (0.0006) [2023-12-26 08:11:57,529][123091] Updated weights for policy 0, policy_version 1078074 (0.0010) [2023-12-26 08:11:57,577][123091] Updated weights for policy 0, policy_version 1078085 (0.0009) [2023-12-26 08:11:57,627][123091] Updated weights for policy 0, policy_version 1078096 (0.0009) [2023-12-26 08:11:57,853][123090] Updated weights for policy 1, policy_version 1070531 (0.0009) [2023-12-26 08:11:57,912][123090] Updated weights for policy 1, policy_version 1070541 (0.0009) [2023-12-26 08:11:57,972][123090] Updated weights for policy 1, policy_version 1070551 (0.0009) [2023-12-26 08:11:58,470][123091] Updated weights for policy 0, policy_version 1078106 (0.0009) [2023-12-26 08:11:58,544][123091] Updated weights for policy 0, policy_version 1078116 (0.0009) [2023-12-26 08:11:58,613][123091] Updated weights for policy 0, policy_version 1078126 (0.0009) [2023-12-26 08:11:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 550068224. Throughput: 0: 8828.7, 1: 8872.8. Samples: 550062280. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:11:58,785][121949] Avg episode reward: [(0, '5922.344'), (1, '4105.800')] [2023-12-26 08:11:58,973][123090] Updated weights for policy 1, policy_version 1070561 (0.0010) [2023-12-26 08:11:59,044][123090] Updated weights for policy 1, policy_version 1070571 (0.0008) [2023-12-26 08:11:59,108][123090] Updated weights for policy 1, policy_version 1070581 (0.0011) [2023-12-26 08:11:59,161][123090] Updated weights for policy 1, policy_version 1070591 (0.0010) [2023-12-26 08:11:59,569][123091] Updated weights for policy 0, policy_version 1078136 (0.0007) [2023-12-26 08:11:59,634][123091] Updated weights for policy 0, policy_version 1078146 (0.0005) [2023-12-26 08:11:59,713][123091] Updated weights for policy 0, policy_version 1078156 (0.0006) [2023-12-26 08:11:59,992][123090] Updated weights for policy 1, policy_version 1070601 (0.0008) [2023-12-26 08:12:00,051][123090] Updated weights for policy 1, policy_version 1070611 (0.0007) [2023-12-26 08:12:00,115][123090] Updated weights for policy 1, policy_version 1070621 (0.0005) [2023-12-26 08:12:00,388][123091] Updated weights for policy 0, policy_version 1078166 (0.0006) [2023-12-26 08:12:00,451][123091] Updated weights for policy 0, policy_version 1078176 (0.0005) [2023-12-26 08:12:00,523][123091] Updated weights for policy 0, policy_version 1078186 (0.0005) [2023-12-26 08:12:00,730][123090] Updated weights for policy 1, policy_version 1070631 (0.0005) [2023-12-26 08:12:00,789][123090] Updated weights for policy 1, policy_version 1070641 (0.0005) [2023-12-26 08:12:00,856][123090] Updated weights for policy 1, policy_version 1070651 (0.0005) [2023-12-26 08:12:01,281][123091] Updated weights for policy 0, policy_version 1078196 (0.0007) [2023-12-26 08:12:01,349][123091] Updated weights for policy 0, policy_version 1078206 (0.0010) [2023-12-26 08:12:01,416][123091] Updated weights for policy 0, policy_version 1078216 (0.0010) [2023-12-26 08:12:01,588][123090] Updated weights for policy 1, policy_version 1070661 (0.0005) [2023-12-26 08:12:01,653][123090] Updated weights for policy 1, policy_version 1070671 (0.0010) [2023-12-26 08:12:01,710][123090] Updated weights for policy 1, policy_version 1070681 (0.0009) [2023-12-26 08:12:02,256][123091] Updated weights for policy 0, policy_version 1078226 (0.0010) [2023-12-26 08:12:02,316][123091] Updated weights for policy 0, policy_version 1078236 (0.0010) [2023-12-26 08:12:02,384][123091] Updated weights for policy 0, policy_version 1078246 (0.0010) [2023-12-26 08:12:02,448][123090] Updated weights for policy 1, policy_version 1070691 (0.0009) [2023-12-26 08:12:02,450][123091] Updated weights for policy 0, policy_version 1078256 (0.0008) [2023-12-26 08:12:02,507][123090] Updated weights for policy 1, policy_version 1070701 (0.0009) [2023-12-26 08:12:02,552][123090] Updated weights for policy 1, policy_version 1070711 (0.0005) [2023-12-26 08:12:03,252][123091] Updated weights for policy 0, policy_version 1078266 (0.0010) [2023-12-26 08:12:03,318][123091] Updated weights for policy 0, policy_version 1078276 (0.0010) [2023-12-26 08:12:03,346][123090] Updated weights for policy 1, policy_version 1070721 (0.0009) [2023-12-26 08:12:03,379][123091] Updated weights for policy 0, policy_version 1078286 (0.0008) [2023-12-26 08:12:03,395][123090] Updated weights for policy 1, policy_version 1070731 (0.0005) [2023-12-26 08:12:03,451][123090] Updated weights for policy 1, policy_version 1070741 (0.0005) [2023-12-26 08:12:03,503][123090] Updated weights for policy 1, policy_version 1070751 (0.0005) [2023-12-26 08:12:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 550158336. Throughput: 0: 8875.4, 1: 8774.1. Samples: 550167524. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:03,785][121949] Avg episode reward: [(0, '5911.441'), (1, '3383.243')] [2023-12-26 08:12:04,179][123090] Updated weights for policy 1, policy_version 1070761 (0.0009) [2023-12-26 08:12:04,249][123090] Updated weights for policy 1, policy_version 1070771 (0.0007) [2023-12-26 08:12:04,273][123091] Updated weights for policy 0, policy_version 1078296 (0.0007) [2023-12-26 08:12:04,316][123090] Updated weights for policy 1, policy_version 1070781 (0.0008) [2023-12-26 08:12:04,343][123091] Updated weights for policy 0, policy_version 1078306 (0.0007) [2023-12-26 08:12:04,412][123091] Updated weights for policy 0, policy_version 1078316 (0.0005) [2023-12-26 08:12:05,081][123091] Updated weights for policy 0, policy_version 1078326 (0.0008) [2023-12-26 08:12:05,093][123090] Updated weights for policy 1, policy_version 1070791 (0.0009) [2023-12-26 08:12:05,137][123091] Updated weights for policy 0, policy_version 1078336 (0.0009) [2023-12-26 08:12:05,147][123090] Updated weights for policy 1, policy_version 1070801 (0.0009) [2023-12-26 08:12:05,193][123091] Updated weights for policy 0, policy_version 1078346 (0.0006) [2023-12-26 08:12:05,200][123090] Updated weights for policy 1, policy_version 1070811 (0.0009) [2023-12-26 08:12:05,893][123091] Updated weights for policy 0, policy_version 1078356 (0.0007) [2023-12-26 08:12:05,926][123090] Updated weights for policy 1, policy_version 1070821 (0.0008) [2023-12-26 08:12:05,947][123091] Updated weights for policy 0, policy_version 1078366 (0.0007) [2023-12-26 08:12:05,992][123090] Updated weights for policy 1, policy_version 1070831 (0.0005) [2023-12-26 08:12:05,998][123091] Updated weights for policy 0, policy_version 1078376 (0.0005) [2023-12-26 08:12:06,054][123090] Updated weights for policy 1, policy_version 1070841 (0.0007) [2023-12-26 08:12:06,745][123090] Updated weights for policy 1, policy_version 1070851 (0.0006) [2023-12-26 08:12:06,765][123091] Updated weights for policy 0, policy_version 1078386 (0.0007) [2023-12-26 08:12:06,801][123090] Updated weights for policy 1, policy_version 1070861 (0.0008) [2023-12-26 08:12:06,829][123091] Updated weights for policy 0, policy_version 1078396 (0.0011) [2023-12-26 08:12:06,857][123090] Updated weights for policy 1, policy_version 1070871 (0.0011) [2023-12-26 08:12:06,889][123091] Updated weights for policy 0, policy_version 1078406 (0.0011) [2023-12-26 08:12:06,937][123091] Updated weights for policy 0, policy_version 1078416 (0.0010) [2023-12-26 08:12:07,620][123090] Updated weights for policy 1, policy_version 1070881 (0.0010) [2023-12-26 08:12:07,691][123090] Updated weights for policy 1, policy_version 1070891 (0.0005) [2023-12-26 08:12:07,762][123090] Updated weights for policy 1, policy_version 1070901 (0.0005) [2023-12-26 08:12:07,768][123091] Updated weights for policy 0, policy_version 1078426 (0.0011) [2023-12-26 08:12:07,815][123090] Updated weights for policy 1, policy_version 1070911 (0.0009) [2023-12-26 08:12:07,816][123091] Updated weights for policy 0, policy_version 1078436 (0.0010) [2023-12-26 08:12:07,879][123091] Updated weights for policy 0, policy_version 1078446 (0.0010) [2023-12-26 08:12:08,593][123090] Updated weights for policy 1, policy_version 1070921 (0.0010) [2023-12-26 08:12:08,641][123090] Updated weights for policy 1, policy_version 1070931 (0.0010) [2023-12-26 08:12:08,667][123091] Updated weights for policy 0, policy_version 1078456 (0.0011) [2023-12-26 08:12:08,701][123090] Updated weights for policy 1, policy_version 1070941 (0.0010) [2023-12-26 08:12:08,726][123091] Updated weights for policy 0, policy_version 1078466 (0.0011) [2023-12-26 08:12:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 550248448. Throughput: 0: 8937.0, 1: 8864.0. Samples: 550224828. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:08,785][121949] Avg episode reward: [(0, '5956.056'), (1, '2869.127')] [2023-12-26 08:12:08,788][123091] Updated weights for policy 0, policy_version 1078476 (0.0010) [2023-12-26 08:12:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001070944_274161664.pth... [2023-12-26 08:12:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001069888_273891328.pth [2023-12-26 08:12:08,811][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001078480_276094976.pth... [2023-12-26 08:12:08,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001077424_275824640.pth [2023-12-26 08:12:09,575][123090] Updated weights for policy 1, policy_version 1070951 (0.0011) [2023-12-26 08:12:09,619][123091] Updated weights for policy 0, policy_version 1078486 (0.0008) [2023-12-26 08:12:09,644][123090] Updated weights for policy 1, policy_version 1070961 (0.0011) [2023-12-26 08:12:09,685][123091] Updated weights for policy 0, policy_version 1078496 (0.0007) [2023-12-26 08:12:09,704][123090] Updated weights for policy 1, policy_version 1070971 (0.0011) [2023-12-26 08:12:09,746][123091] Updated weights for policy 0, policy_version 1078506 (0.0006) [2023-12-26 08:12:10,518][123090] Updated weights for policy 1, policy_version 1070981 (0.0011) [2023-12-26 08:12:10,584][123091] Updated weights for policy 0, policy_version 1078516 (0.0009) [2023-12-26 08:12:10,586][123090] Updated weights for policy 1, policy_version 1070991 (0.0011) [2023-12-26 08:12:10,637][123091] Updated weights for policy 0, policy_version 1078526 (0.0006) [2023-12-26 08:12:10,646][123090] Updated weights for policy 1, policy_version 1071001 (0.0010) [2023-12-26 08:12:10,699][123091] Updated weights for policy 0, policy_version 1078536 (0.0005) [2023-12-26 08:12:11,520][123090] Updated weights for policy 1, policy_version 1071011 (0.0010) [2023-12-26 08:12:11,533][123091] Updated weights for policy 0, policy_version 1078546 (0.0006) [2023-12-26 08:12:11,585][123090] Updated weights for policy 1, policy_version 1071021 (0.0009) [2023-12-26 08:12:11,591][123091] Updated weights for policy 0, policy_version 1078556 (0.0010) [2023-12-26 08:12:11,651][123090] Updated weights for policy 1, policy_version 1071031 (0.0009) [2023-12-26 08:12:11,658][123091] Updated weights for policy 0, policy_version 1078566 (0.0008) [2023-12-26 08:12:11,727][123091] Updated weights for policy 0, policy_version 1078576 (0.0009) [2023-12-26 08:12:12,489][123090] Updated weights for policy 1, policy_version 1071041 (0.0009) [2023-12-26 08:12:12,555][123090] Updated weights for policy 1, policy_version 1071051 (0.0007) [2023-12-26 08:12:12,599][123091] Updated weights for policy 0, policy_version 1078586 (0.0008) [2023-12-26 08:12:12,620][123090] Updated weights for policy 1, policy_version 1071061 (0.0006) [2023-12-26 08:12:12,655][123091] Updated weights for policy 0, policy_version 1078596 (0.0006) [2023-12-26 08:12:12,688][123090] Updated weights for policy 1, policy_version 1071071 (0.0010) [2023-12-26 08:12:12,709][123091] Updated weights for policy 0, policy_version 1078606 (0.0009) [2023-12-26 08:12:13,479][123090] Updated weights for policy 1, policy_version 1071081 (0.0006) [2023-12-26 08:12:13,531][123090] Updated weights for policy 1, policy_version 1071091 (0.0006) [2023-12-26 08:12:13,540][123091] Updated weights for policy 0, policy_version 1078616 (0.0011) [2023-12-26 08:12:13,576][123090] Updated weights for policy 1, policy_version 1071101 (0.0009) [2023-12-26 08:12:13,595][123091] Updated weights for policy 0, policy_version 1078626 (0.0010) [2023-12-26 08:12:13,653][123091] Updated weights for policy 0, policy_version 1078636 (0.0007) [2023-12-26 08:12:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 550338560. Throughput: 0: 8861.0, 1: 8875.8. Samples: 550328060. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:13,785][121949] Avg episode reward: [(0, '6066.375'), (1, '3173.573')] [2023-12-26 08:12:14,312][123091] Updated weights for policy 0, policy_version 1078646 (0.0005) [2023-12-26 08:12:14,368][123091] Updated weights for policy 0, policy_version 1078656 (0.0005) [2023-12-26 08:12:14,401][123090] Updated weights for policy 1, policy_version 1071111 (0.0009) [2023-12-26 08:12:14,421][123091] Updated weights for policy 0, policy_version 1078666 (0.0007) [2023-12-26 08:12:14,455][123090] Updated weights for policy 1, policy_version 1071121 (0.0010) [2023-12-26 08:12:14,528][123090] Updated weights for policy 1, policy_version 1071131 (0.0010) [2023-12-26 08:12:15,177][123091] Updated weights for policy 0, policy_version 1078676 (0.0008) [2023-12-26 08:12:15,252][123091] Updated weights for policy 0, policy_version 1078686 (0.0011) [2023-12-26 08:12:15,320][123090] Updated weights for policy 1, policy_version 1071141 (0.0008) [2023-12-26 08:12:15,330][123091] Updated weights for policy 0, policy_version 1078696 (0.0011) [2023-12-26 08:12:15,392][123090] Updated weights for policy 1, policy_version 1071151 (0.0006) [2023-12-26 08:12:15,470][123090] Updated weights for policy 1, policy_version 1071161 (0.0006) [2023-12-26 08:12:16,071][123091] Updated weights for policy 0, policy_version 1078706 (0.0010) [2023-12-26 08:12:16,136][123091] Updated weights for policy 0, policy_version 1078716 (0.0005) [2023-12-26 08:12:16,201][123091] Updated weights for policy 0, policy_version 1078726 (0.0005) [2023-12-26 08:12:16,210][123090] Updated weights for policy 1, policy_version 1071171 (0.0010) [2023-12-26 08:12:16,255][123091] Updated weights for policy 0, policy_version 1078736 (0.0005) [2023-12-26 08:12:16,280][123090] Updated weights for policy 1, policy_version 1071181 (0.0010) [2023-12-26 08:12:16,346][123090] Updated weights for policy 1, policy_version 1071191 (0.0010) [2023-12-26 08:12:16,912][123091] Updated weights for policy 0, policy_version 1078746 (0.0010) [2023-12-26 08:12:16,977][123091] Updated weights for policy 0, policy_version 1078756 (0.0010) [2023-12-26 08:12:17,036][123091] Updated weights for policy 0, policy_version 1078766 (0.0010) [2023-12-26 08:12:17,151][123090] Updated weights for policy 1, policy_version 1071201 (0.0010) [2023-12-26 08:12:17,198][123090] Updated weights for policy 1, policy_version 1071211 (0.0010) [2023-12-26 08:12:17,253][123090] Updated weights for policy 1, policy_version 1071221 (0.0010) [2023-12-26 08:12:17,311][123090] Updated weights for policy 1, policy_version 1071231 (0.0010) [2023-12-26 08:12:17,729][123091] Updated weights for policy 0, policy_version 1078776 (0.0007) [2023-12-26 08:12:17,777][123091] Updated weights for policy 0, policy_version 1078786 (0.0006) [2023-12-26 08:12:17,834][123091] Updated weights for policy 0, policy_version 1078796 (0.0006) [2023-12-26 08:12:18,134][123090] Updated weights for policy 1, policy_version 1071241 (0.0010) [2023-12-26 08:12:18,193][123090] Updated weights for policy 1, policy_version 1071251 (0.0010) [2023-12-26 08:12:18,244][123090] Updated weights for policy 1, policy_version 1071261 (0.0010) [2023-12-26 08:12:18,495][123091] Updated weights for policy 0, policy_version 1078806 (0.0008) [2023-12-26 08:12:18,551][123091] Updated weights for policy 0, policy_version 1078816 (0.0011) [2023-12-26 08:12:18,598][123091] Updated weights for policy 0, policy_version 1078826 (0.0010) [2023-12-26 08:12:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 550428672. Throughput: 0: 8923.8, 1: 8886.3. Samples: 550437904. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:18,785][121949] Avg episode reward: [(0, '6068.450'), (1, '3545.488')] [2023-12-26 08:12:19,123][123090] Updated weights for policy 1, policy_version 1071271 (0.0010) [2023-12-26 08:12:19,175][123090] Updated weights for policy 1, policy_version 1071281 (0.0010) [2023-12-26 08:12:19,236][123090] Updated weights for policy 1, policy_version 1071291 (0.0012) [2023-12-26 08:12:19,428][123091] Updated weights for policy 0, policy_version 1078836 (0.0008) [2023-12-26 08:12:19,505][123091] Updated weights for policy 0, policy_version 1078846 (0.0006) [2023-12-26 08:12:19,577][123091] Updated weights for policy 0, policy_version 1078856 (0.0007) [2023-12-26 08:12:20,017][123090] Updated weights for policy 1, policy_version 1071301 (0.0008) [2023-12-26 08:12:20,079][123090] Updated weights for policy 1, policy_version 1071311 (0.0008) [2023-12-26 08:12:20,147][123090] Updated weights for policy 1, policy_version 1071321 (0.0007) [2023-12-26 08:12:20,282][123091] Updated weights for policy 0, policy_version 1078866 (0.0009) [2023-12-26 08:12:20,356][123091] Updated weights for policy 0, policy_version 1078876 (0.0010) [2023-12-26 08:12:20,415][123091] Updated weights for policy 0, policy_version 1078886 (0.0011) [2023-12-26 08:12:20,475][123091] Updated weights for policy 0, policy_version 1078896 (0.0011) [2023-12-26 08:12:20,944][123090] Updated weights for policy 1, policy_version 1071331 (0.0009) [2023-12-26 08:12:21,019][123090] Updated weights for policy 1, policy_version 1071341 (0.0009) [2023-12-26 08:12:21,095][123090] Updated weights for policy 1, policy_version 1071351 (0.0009) [2023-12-26 08:12:21,317][123091] Updated weights for policy 0, policy_version 1078906 (0.0009) [2023-12-26 08:12:21,392][123091] Updated weights for policy 0, policy_version 1078916 (0.0009) [2023-12-26 08:12:21,454][123091] Updated weights for policy 0, policy_version 1078926 (0.0009) [2023-12-26 08:12:21,952][123090] Updated weights for policy 1, policy_version 1071361 (0.0009) [2023-12-26 08:12:22,017][123090] Updated weights for policy 1, policy_version 1071371 (0.0009) [2023-12-26 08:12:22,084][123090] Updated weights for policy 1, policy_version 1071381 (0.0009) [2023-12-26 08:12:22,142][123090] Updated weights for policy 1, policy_version 1071391 (0.0009) [2023-12-26 08:12:22,312][123091] Updated weights for policy 0, policy_version 1078936 (0.0010) [2023-12-26 08:12:22,395][123091] Updated weights for policy 0, policy_version 1078946 (0.0011) [2023-12-26 08:12:22,456][123091] Updated weights for policy 0, policy_version 1078956 (0.0009) [2023-12-26 08:12:23,007][123090] Updated weights for policy 1, policy_version 1071401 (0.0005) [2023-12-26 08:12:23,068][123090] Updated weights for policy 1, policy_version 1071411 (0.0005) [2023-12-26 08:12:23,130][123090] Updated weights for policy 1, policy_version 1071421 (0.0006) [2023-12-26 08:12:23,240][123091] Updated weights for policy 0, policy_version 1078966 (0.0009) [2023-12-26 08:12:23,314][123091] Updated weights for policy 0, policy_version 1078976 (0.0006) [2023-12-26 08:12:23,364][123091] Updated weights for policy 0, policy_version 1078986 (0.0005) [2023-12-26 08:12:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 550510592. Throughput: 0: 8944.3, 1: 8848.8. Samples: 550489712. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:23,785][121949] Avg episode reward: [(0, '6185.308'), (1, '3770.664')] [2023-12-26 08:12:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001078992_276226048.pth... [2023-12-26 08:12:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001077936_275955712.pth [2023-12-26 08:12:23,804][123090] Updated weights for policy 1, policy_version 1071431 (0.0005) [2023-12-26 08:12:23,856][123090] Updated weights for policy 1, policy_version 1071441 (0.0005) [2023-12-26 08:12:23,911][123090] Updated weights for policy 1, policy_version 1071451 (0.0005) [2023-12-26 08:12:23,934][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001071456_274292736.pth... [2023-12-26 08:12:23,938][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001070400_274022400.pth [2023-12-26 08:12:24,078][123091] Updated weights for policy 0, policy_version 1078996 (0.0005) [2023-12-26 08:12:24,145][123091] Updated weights for policy 0, policy_version 1079006 (0.0009) [2023-12-26 08:12:24,207][123091] Updated weights for policy 0, policy_version 1079016 (0.0011) [2023-12-26 08:12:24,590][123090] Updated weights for policy 1, policy_version 1071461 (0.0005) [2023-12-26 08:12:24,636][123090] Updated weights for policy 1, policy_version 1071471 (0.0006) [2023-12-26 08:12:24,683][123090] Updated weights for policy 1, policy_version 1071481 (0.0009) [2023-12-26 08:12:25,018][123091] Updated weights for policy 0, policy_version 1079026 (0.0011) [2023-12-26 08:12:25,076][123091] Updated weights for policy 0, policy_version 1079036 (0.0011) [2023-12-26 08:12:25,127][123091] Updated weights for policy 0, policy_version 1079046 (0.0010) [2023-12-26 08:12:25,192][123091] Updated weights for policy 0, policy_version 1079056 (0.0011) [2023-12-26 08:12:25,479][123090] Updated weights for policy 1, policy_version 1071491 (0.0008) [2023-12-26 08:12:25,541][123090] Updated weights for policy 1, policy_version 1071501 (0.0006) [2023-12-26 08:12:25,591][123090] Updated weights for policy 1, policy_version 1071511 (0.0008) [2023-12-26 08:12:25,965][123091] Updated weights for policy 0, policy_version 1079066 (0.0005) [2023-12-26 08:12:26,017][123091] Updated weights for policy 0, policy_version 1079076 (0.0005) [2023-12-26 08:12:26,073][123091] Updated weights for policy 0, policy_version 1079086 (0.0008) [2023-12-26 08:12:26,250][123090] Updated weights for policy 1, policy_version 1071521 (0.0008) [2023-12-26 08:12:26,298][123090] Updated weights for policy 1, policy_version 1071531 (0.0008) [2023-12-26 08:12:26,358][123090] Updated weights for policy 1, policy_version 1071541 (0.0008) [2023-12-26 08:12:26,407][123090] Updated weights for policy 1, policy_version 1071551 (0.0009) [2023-12-26 08:12:26,880][123091] Updated weights for policy 0, policy_version 1079096 (0.0007) [2023-12-26 08:12:26,933][123091] Updated weights for policy 0, policy_version 1079106 (0.0006) [2023-12-26 08:12:26,980][123091] Updated weights for policy 0, policy_version 1079116 (0.0009) [2023-12-26 08:12:27,304][123090] Updated weights for policy 1, policy_version 1071562 (0.0010) [2023-12-26 08:12:27,366][123090] Updated weights for policy 1, policy_version 1071572 (0.0008) [2023-12-26 08:12:27,424][123090] Updated weights for policy 1, policy_version 1071582 (0.0009) [2023-12-26 08:12:27,747][123091] Updated weights for policy 0, policy_version 1079126 (0.0008) [2023-12-26 08:12:27,801][123091] Updated weights for policy 0, policy_version 1079136 (0.0010) [2023-12-26 08:12:27,859][123091] Updated weights for policy 0, policy_version 1079146 (0.0010) [2023-12-26 08:12:28,132][123090] Updated weights for policy 1, policy_version 1071592 (0.0009) [2023-12-26 08:12:28,179][123090] Updated weights for policy 1, policy_version 1071602 (0.0010) [2023-12-26 08:12:28,222][123090] Updated weights for policy 1, policy_version 1071612 (0.0010) [2023-12-26 08:12:28,676][123091] Updated weights for policy 0, policy_version 1079156 (0.0010) [2023-12-26 08:12:28,727][123091] Updated weights for policy 0, policy_version 1079166 (0.0010) [2023-12-26 08:12:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 550600704. Throughput: 0: 8956.3, 1: 8951.8. Samples: 550598680. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:28,785][121949] Avg episode reward: [(0, '6255.916'), (1, '3797.055')] [2023-12-26 08:12:28,786][123091] Updated weights for policy 0, policy_version 1079176 (0.0010) [2023-12-26 08:12:28,967][123090] Updated weights for policy 1, policy_version 1071622 (0.0008) [2023-12-26 08:12:29,036][123090] Updated weights for policy 1, policy_version 1071632 (0.0008) [2023-12-26 08:12:29,108][123090] Updated weights for policy 1, policy_version 1071642 (0.0007) [2023-12-26 08:12:29,635][123091] Updated weights for policy 0, policy_version 1079186 (0.0011) [2023-12-26 08:12:29,708][123091] Updated weights for policy 0, policy_version 1079196 (0.0011) [2023-12-26 08:12:29,776][123091] Updated weights for policy 0, policy_version 1079206 (0.0011) [2023-12-26 08:12:29,841][123091] Updated weights for policy 0, policy_version 1079216 (0.0011) [2023-12-26 08:12:29,912][123090] Updated weights for policy 1, policy_version 1071652 (0.0009) [2023-12-26 08:12:29,983][123090] Updated weights for policy 1, policy_version 1071662 (0.0009) [2023-12-26 08:12:30,051][123090] Updated weights for policy 1, policy_version 1071672 (0.0011) [2023-12-26 08:12:30,676][123091] Updated weights for policy 0, policy_version 1079226 (0.0011) [2023-12-26 08:12:30,731][123091] Updated weights for policy 0, policy_version 1079236 (0.0010) [2023-12-26 08:12:30,786][123091] Updated weights for policy 0, policy_version 1079246 (0.0010) [2023-12-26 08:12:30,843][123090] Updated weights for policy 1, policy_version 1071682 (0.0010) [2023-12-26 08:12:30,897][123090] Updated weights for policy 1, policy_version 1071692 (0.0008) [2023-12-26 08:12:30,953][123090] Updated weights for policy 1, policy_version 1071702 (0.0008) [2023-12-26 08:12:31,020][123090] Updated weights for policy 1, policy_version 1071712 (0.0010) [2023-12-26 08:12:31,586][123091] Updated weights for policy 0, policy_version 1079256 (0.0011) [2023-12-26 08:12:31,648][123091] Updated weights for policy 0, policy_version 1079266 (0.0011) [2023-12-26 08:12:31,707][123091] Updated weights for policy 0, policy_version 1079276 (0.0011) [2023-12-26 08:12:31,858][123090] Updated weights for policy 1, policy_version 1071722 (0.0009) [2023-12-26 08:12:31,910][123090] Updated weights for policy 1, policy_version 1071732 (0.0009) [2023-12-26 08:12:31,969][123090] Updated weights for policy 1, policy_version 1071742 (0.0008) [2023-12-26 08:12:32,571][123091] Updated weights for policy 0, policy_version 1079286 (0.0011) [2023-12-26 08:12:32,633][123091] Updated weights for policy 0, policy_version 1079296 (0.0010) [2023-12-26 08:12:32,695][123091] Updated weights for policy 0, policy_version 1079306 (0.0010) [2023-12-26 08:12:32,783][123090] Updated weights for policy 1, policy_version 1071752 (0.0009) [2023-12-26 08:12:32,849][123090] Updated weights for policy 1, policy_version 1071762 (0.0009) [2023-12-26 08:12:32,902][123090] Updated weights for policy 1, policy_version 1071772 (0.0008) [2023-12-26 08:12:33,512][123091] Updated weights for policy 0, policy_version 1079316 (0.0010) [2023-12-26 08:12:33,563][123091] Updated weights for policy 0, policy_version 1079326 (0.0010) [2023-12-26 08:12:33,615][123091] Updated weights for policy 0, policy_version 1079336 (0.0010) [2023-12-26 08:12:33,738][123090] Updated weights for policy 1, policy_version 1071782 (0.0009) [2023-12-26 08:12:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 550690816. Throughput: 0: 8887.1, 1: 8934.2. Samples: 550703536. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:33,785][121949] Avg episode reward: [(0, '6003.501'), (1, '3410.146')] [2023-12-26 08:12:33,788][123090] Updated weights for policy 1, policy_version 1071792 (0.0008) [2023-12-26 08:12:33,836][123090] Updated weights for policy 1, policy_version 1071802 (0.0009) [2023-12-26 08:12:34,299][123091] Updated weights for policy 0, policy_version 1079346 (0.0010) [2023-12-26 08:12:34,370][123091] Updated weights for policy 0, policy_version 1079356 (0.0006) [2023-12-26 08:12:34,440][123091] Updated weights for policy 0, policy_version 1079366 (0.0007) [2023-12-26 08:12:34,503][123091] Updated weights for policy 0, policy_version 1079376 (0.0010) [2023-12-26 08:12:34,737][123090] Updated weights for policy 1, policy_version 1071812 (0.0009) [2023-12-26 08:12:34,786][123090] Updated weights for policy 1, policy_version 1071822 (0.0009) [2023-12-26 08:12:34,839][123090] Updated weights for policy 1, policy_version 1071832 (0.0009) [2023-12-26 08:12:35,273][123091] Updated weights for policy 0, policy_version 1079386 (0.0010) [2023-12-26 08:12:35,323][123091] Updated weights for policy 0, policy_version 1079396 (0.0010) [2023-12-26 08:12:35,377][123091] Updated weights for policy 0, policy_version 1079406 (0.0010) [2023-12-26 08:12:35,672][123090] Updated weights for policy 1, policy_version 1071842 (0.0008) [2023-12-26 08:12:35,737][123090] Updated weights for policy 1, policy_version 1071852 (0.0006) [2023-12-26 08:12:35,796][123090] Updated weights for policy 1, policy_version 1071862 (0.0006) [2023-12-26 08:12:35,846][123090] Updated weights for policy 1, policy_version 1071872 (0.0009) [2023-12-26 08:12:36,237][123091] Updated weights for policy 0, policy_version 1079416 (0.0010) [2023-12-26 08:12:36,307][123091] Updated weights for policy 0, policy_version 1079426 (0.0011) [2023-12-26 08:12:36,377][123091] Updated weights for policy 0, policy_version 1079436 (0.0011) [2023-12-26 08:12:36,606][123090] Updated weights for policy 1, policy_version 1071882 (0.0009) [2023-12-26 08:12:36,670][123090] Updated weights for policy 1, policy_version 1071892 (0.0009) [2023-12-26 08:12:36,742][123090] Updated weights for policy 1, policy_version 1071902 (0.0009) [2023-12-26 08:12:37,195][123091] Updated weights for policy 0, policy_version 1079446 (0.0010) [2023-12-26 08:12:37,255][123091] Updated weights for policy 0, policy_version 1079456 (0.0006) [2023-12-26 08:12:37,325][123091] Updated weights for policy 0, policy_version 1079466 (0.0006) [2023-12-26 08:12:37,569][123090] Updated weights for policy 1, policy_version 1071912 (0.0009) [2023-12-26 08:12:37,630][123090] Updated weights for policy 1, policy_version 1071922 (0.0009) [2023-12-26 08:12:37,691][123090] Updated weights for policy 1, policy_version 1071932 (0.0009) [2023-12-26 08:12:38,040][123091] Updated weights for policy 0, policy_version 1079476 (0.0005) [2023-12-26 08:12:38,100][123091] Updated weights for policy 0, policy_version 1079486 (0.0005) [2023-12-26 08:12:38,168][123091] Updated weights for policy 0, policy_version 1079496 (0.0005) [2023-12-26 08:12:38,636][123090] Updated weights for policy 1, policy_version 1071942 (0.0010) [2023-12-26 08:12:38,690][123090] Updated weights for policy 1, policy_version 1071952 (0.0010) [2023-12-26 08:12:38,763][123090] Updated weights for policy 1, policy_version 1071962 (0.0010) [2023-12-26 08:12:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 550772736. Throughput: 0: 8888.9, 1: 8953.6. Samples: 550756164. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:38,786][121949] Avg episode reward: [(0, '6027.539'), (1, '3626.754')] [2023-12-26 08:12:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001071968_274423808.pth... [2023-12-26 08:12:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001079504_276357120.pth... [2023-12-26 08:12:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001070944_274161664.pth [2023-12-26 08:12:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001078480_276094976.pth [2023-12-26 08:12:38,823][123091] Updated weights for policy 0, policy_version 1079506 (0.0005) [2023-12-26 08:12:38,884][123091] Updated weights for policy 0, policy_version 1079516 (0.0005) [2023-12-26 08:12:38,946][123091] Updated weights for policy 0, policy_version 1079526 (0.0005) [2023-12-26 08:12:39,018][123091] Updated weights for policy 0, policy_version 1079536 (0.0005) [2023-12-26 08:12:39,683][123090] Updated weights for policy 1, policy_version 1071972 (0.0010) [2023-12-26 08:12:39,745][123090] Updated weights for policy 1, policy_version 1071982 (0.0008) [2023-12-26 08:12:39,763][123091] Updated weights for policy 0, policy_version 1079546 (0.0011) [2023-12-26 08:12:39,809][123090] Updated weights for policy 1, policy_version 1071992 (0.0010) [2023-12-26 08:12:39,826][123091] Updated weights for policy 0, policy_version 1079556 (0.0011) [2023-12-26 08:12:39,897][123091] Updated weights for policy 0, policy_version 1079566 (0.0011) [2023-12-26 08:12:40,656][123091] Updated weights for policy 0, policy_version 1079576 (0.0006) [2023-12-26 08:12:40,712][123090] Updated weights for policy 1, policy_version 1072002 (0.0008) [2023-12-26 08:12:40,716][123091] Updated weights for policy 0, policy_version 1079586 (0.0005) [2023-12-26 08:12:40,773][123090] Updated weights for policy 1, policy_version 1072012 (0.0009) [2023-12-26 08:12:40,773][123091] Updated weights for policy 0, policy_version 1079596 (0.0005) [2023-12-26 08:12:40,835][123090] Updated weights for policy 1, policy_version 1072022 (0.0010) [2023-12-26 08:12:40,893][123090] Updated weights for policy 1, policy_version 1072032 (0.0010) [2023-12-26 08:12:41,475][123091] Updated weights for policy 0, policy_version 1079606 (0.0009) [2023-12-26 08:12:41,543][123091] Updated weights for policy 0, policy_version 1079616 (0.0011) [2023-12-26 08:12:41,611][123091] Updated weights for policy 0, policy_version 1079626 (0.0011) [2023-12-26 08:12:41,801][123090] Updated weights for policy 1, policy_version 1072042 (0.0009) [2023-12-26 08:12:41,859][123090] Updated weights for policy 1, policy_version 1072052 (0.0007) [2023-12-26 08:12:41,927][123090] Updated weights for policy 1, policy_version 1072062 (0.0008) [2023-12-26 08:12:42,435][123091] Updated weights for policy 0, policy_version 1079636 (0.0009) [2023-12-26 08:12:42,498][123091] Updated weights for policy 0, policy_version 1079646 (0.0010) [2023-12-26 08:12:42,557][123091] Updated weights for policy 0, policy_version 1079656 (0.0009) [2023-12-26 08:12:42,712][123090] Updated weights for policy 1, policy_version 1072072 (0.0010) [2023-12-26 08:12:42,769][123090] Updated weights for policy 1, policy_version 1072082 (0.0010) [2023-12-26 08:12:42,823][123090] Updated weights for policy 1, policy_version 1072092 (0.0009) [2023-12-26 08:12:43,366][123091] Updated weights for policy 0, policy_version 1079666 (0.0009) [2023-12-26 08:12:43,420][123091] Updated weights for policy 0, policy_version 1079676 (0.0005) [2023-12-26 08:12:43,477][123091] Updated weights for policy 0, policy_version 1079686 (0.0005) [2023-12-26 08:12:43,531][123091] Updated weights for policy 0, policy_version 1079696 (0.0006) [2023-12-26 08:12:43,677][123090] Updated weights for policy 1, policy_version 1072102 (0.0007) [2023-12-26 08:12:43,729][123090] Updated weights for policy 1, policy_version 1072112 (0.0006) [2023-12-26 08:12:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 550862848. Throughput: 0: 8929.9, 1: 8776.2. Samples: 550859052. Policy #0 lag: (min: 31.0, avg: 31.2, max: 43.0) [2023-12-26 08:12:43,785][121949] Avg episode reward: [(0, '6198.732'), (1, '3928.476')] [2023-12-26 08:12:43,789][123090] Updated weights for policy 1, policy_version 1072122 (0.0007) [2023-12-26 08:12:44,355][123091] Updated weights for policy 0, policy_version 1079706 (0.0010) [2023-12-26 08:12:44,424][123091] Updated weights for policy 0, policy_version 1079716 (0.0009) [2023-12-26 08:12:44,494][123091] Updated weights for policy 0, policy_version 1079726 (0.0008) [2023-12-26 08:12:44,509][123090] Updated weights for policy 1, policy_version 1072132 (0.0008) [2023-12-26 08:12:44,569][123090] Updated weights for policy 1, policy_version 1072142 (0.0005) [2023-12-26 08:12:44,635][123090] Updated weights for policy 1, policy_version 1072152 (0.0005) [2023-12-26 08:12:45,365][123091] Updated weights for policy 0, policy_version 1079736 (0.0007) [2023-12-26 08:12:45,379][123090] Updated weights for policy 1, policy_version 1072162 (0.0006) [2023-12-26 08:12:45,437][123091] Updated weights for policy 0, policy_version 1079746 (0.0007) [2023-12-26 08:12:45,449][123090] Updated weights for policy 1, policy_version 1072172 (0.0007) [2023-12-26 08:12:45,508][123091] Updated weights for policy 0, policy_version 1079756 (0.0008) [2023-12-26 08:12:45,521][123090] Updated weights for policy 1, policy_version 1072182 (0.0006) [2023-12-26 08:12:45,593][123090] Updated weights for policy 1, policy_version 1072192 (0.0006) [2023-12-26 08:12:46,160][123091] Updated weights for policy 0, policy_version 1079766 (0.0006) [2023-12-26 08:12:46,217][123091] Updated weights for policy 0, policy_version 1079776 (0.0005) [2023-12-26 08:12:46,235][123090] Updated weights for policy 1, policy_version 1072202 (0.0009) [2023-12-26 08:12:46,264][123091] Updated weights for policy 0, policy_version 1079786 (0.0005) [2023-12-26 08:12:46,300][123090] Updated weights for policy 1, policy_version 1072212 (0.0007) [2023-12-26 08:12:46,361][123090] Updated weights for policy 1, policy_version 1072222 (0.0009) [2023-12-26 08:12:47,010][123091] Updated weights for policy 0, policy_version 1079796 (0.0007) [2023-12-26 08:12:47,068][123091] Updated weights for policy 0, policy_version 1079806 (0.0010) [2023-12-26 08:12:47,116][123091] Updated weights for policy 0, policy_version 1079816 (0.0008) [2023-12-26 08:12:47,148][123090] Updated weights for policy 1, policy_version 1072232 (0.0008) [2023-12-26 08:12:47,198][123090] Updated weights for policy 1, policy_version 1072242 (0.0008) [2023-12-26 08:12:47,246][123090] Updated weights for policy 1, policy_version 1072252 (0.0009) [2023-12-26 08:12:47,830][123091] Updated weights for policy 0, policy_version 1079826 (0.0009) [2023-12-26 08:12:47,878][123091] Updated weights for policy 0, policy_version 1079836 (0.0005) [2023-12-26 08:12:47,935][123091] Updated weights for policy 0, policy_version 1079846 (0.0005) [2023-12-26 08:12:47,987][123091] Updated weights for policy 0, policy_version 1079856 (0.0006) [2023-12-26 08:12:47,990][123090] Updated weights for policy 1, policy_version 1072263 (0.0008) [2023-12-26 08:12:48,046][123090] Updated weights for policy 1, policy_version 1072273 (0.0010) [2023-12-26 08:12:48,094][123090] Updated weights for policy 1, policy_version 1072283 (0.0008) [2023-12-26 08:12:48,780][123091] Updated weights for policy 0, policy_version 1079866 (0.0010) [2023-12-26 08:12:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 550952960. Throughput: 0: 9029.5, 1: 8806.6. Samples: 550970144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:12:48,785][121949] Avg episode reward: [(0, '6115.563'), (1, '3908.628')] [2023-12-26 08:12:48,854][123091] Updated weights for policy 0, policy_version 1079876 (0.0006) [2023-12-26 08:12:48,886][123090] Updated weights for policy 1, policy_version 1072293 (0.0008) [2023-12-26 08:12:48,915][123091] Updated weights for policy 0, policy_version 1079886 (0.0005) [2023-12-26 08:12:48,951][123090] Updated weights for policy 1, policy_version 1072303 (0.0009) [2023-12-26 08:12:49,021][123090] Updated weights for policy 1, policy_version 1072313 (0.0010) [2023-12-26 08:12:49,561][123091] Updated weights for policy 0, policy_version 1079896 (0.0007) [2023-12-26 08:12:49,611][123091] Updated weights for policy 0, policy_version 1079906 (0.0009) [2023-12-26 08:12:49,669][123091] Updated weights for policy 0, policy_version 1079916 (0.0007) [2023-12-26 08:12:49,897][123090] Updated weights for policy 1, policy_version 1072323 (0.0010) [2023-12-26 08:12:49,960][123090] Updated weights for policy 1, policy_version 1072333 (0.0008) [2023-12-26 08:12:50,019][123090] Updated weights for policy 1, policy_version 1072343 (0.0010) [2023-12-26 08:12:50,468][123091] Updated weights for policy 0, policy_version 1079926 (0.0009) [2023-12-26 08:12:50,527][123091] Updated weights for policy 0, policy_version 1079936 (0.0011) [2023-12-26 08:12:50,594][123091] Updated weights for policy 0, policy_version 1079946 (0.0011) [2023-12-26 08:12:50,862][123090] Updated weights for policy 1, policy_version 1072353 (0.0010) [2023-12-26 08:12:50,927][123090] Updated weights for policy 1, policy_version 1072363 (0.0011) [2023-12-26 08:12:50,980][123090] Updated weights for policy 1, policy_version 1072373 (0.0010) [2023-12-26 08:12:51,045][123090] Updated weights for policy 1, policy_version 1072383 (0.0010) [2023-12-26 08:12:51,447][123091] Updated weights for policy 0, policy_version 1079956 (0.0008) [2023-12-26 08:12:51,516][123091] Updated weights for policy 0, policy_version 1079966 (0.0005) [2023-12-26 08:12:51,589][123091] Updated weights for policy 0, policy_version 1079976 (0.0006) [2023-12-26 08:12:51,864][123090] Updated weights for policy 1, policy_version 1072393 (0.0006) [2023-12-26 08:12:51,924][123090] Updated weights for policy 1, policy_version 1072403 (0.0009) [2023-12-26 08:12:51,982][123090] Updated weights for policy 1, policy_version 1072413 (0.0006) [2023-12-26 08:12:52,396][123091] Updated weights for policy 0, policy_version 1079986 (0.0009) [2023-12-26 08:12:52,449][123091] Updated weights for policy 0, policy_version 1079996 (0.0009) [2023-12-26 08:12:52,519][123091] Updated weights for policy 0, policy_version 1080006 (0.0009) [2023-12-26 08:12:52,589][123091] Updated weights for policy 0, policy_version 1080016 (0.0010) [2023-12-26 08:12:52,822][123090] Updated weights for policy 1, policy_version 1072423 (0.0011) [2023-12-26 08:12:52,888][123090] Updated weights for policy 1, policy_version 1072433 (0.0008) [2023-12-26 08:12:52,959][123090] Updated weights for policy 1, policy_version 1072443 (0.0007) [2023-12-26 08:12:53,305][123091] Updated weights for policy 0, policy_version 1080026 (0.0007) [2023-12-26 08:12:53,358][123091] Updated weights for policy 0, policy_version 1080036 (0.0009) [2023-12-26 08:12:53,417][123091] Updated weights for policy 0, policy_version 1080046 (0.0009) [2023-12-26 08:12:53,749][123090] Updated weights for policy 1, policy_version 1072453 (0.0010) [2023-12-26 08:12:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 551043072. Throughput: 0: 8996.3, 1: 8713.1. Samples: 551021748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:12:53,785][121949] Avg episode reward: [(0, '6073.931'), (1, '3883.604')] [2023-12-26 08:12:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001080048_276496384.pth... [2023-12-26 08:12:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001078992_276226048.pth [2023-12-26 08:12:53,812][123090] Updated weights for policy 1, policy_version 1072463 (0.0010) [2023-12-26 08:12:53,875][123090] Updated weights for policy 1, policy_version 1072473 (0.0010) [2023-12-26 08:12:53,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001072480_274554880.pth... [2023-12-26 08:12:53,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001071456_274292736.pth [2023-12-26 08:12:54,156][123091] Updated weights for policy 0, policy_version 1080056 (0.0007) [2023-12-26 08:12:54,210][123091] Updated weights for policy 0, policy_version 1080066 (0.0008) [2023-12-26 08:12:54,273][123091] Updated weights for policy 0, policy_version 1080076 (0.0007) [2023-12-26 08:12:54,694][123090] Updated weights for policy 1, policy_version 1072483 (0.0010) [2023-12-26 08:12:54,751][123090] Updated weights for policy 1, policy_version 1072493 (0.0011) [2023-12-26 08:12:54,799][123090] Updated weights for policy 1, policy_version 1072503 (0.0010) [2023-12-26 08:12:55,068][123091] Updated weights for policy 0, policy_version 1080086 (0.0009) [2023-12-26 08:12:55,138][123091] Updated weights for policy 0, policy_version 1080096 (0.0008) [2023-12-26 08:12:55,207][123091] Updated weights for policy 0, policy_version 1080106 (0.0005) [2023-12-26 08:12:55,661][123090] Updated weights for policy 1, policy_version 1072513 (0.0010) [2023-12-26 08:12:55,724][123090] Updated weights for policy 1, policy_version 1072523 (0.0010) [2023-12-26 08:12:55,787][123090] Updated weights for policy 1, policy_version 1072533 (0.0011) [2023-12-26 08:12:55,859][123090] Updated weights for policy 1, policy_version 1072543 (0.0010) [2023-12-26 08:12:55,945][123091] Updated weights for policy 0, policy_version 1080116 (0.0008) [2023-12-26 08:12:56,014][123091] Updated weights for policy 0, policy_version 1080126 (0.0009) [2023-12-26 08:12:56,072][123091] Updated weights for policy 0, policy_version 1080136 (0.0007) [2023-12-26 08:12:56,672][123090] Updated weights for policy 1, policy_version 1072553 (0.0010) [2023-12-26 08:12:56,724][123090] Updated weights for policy 1, policy_version 1072563 (0.0010) [2023-12-26 08:12:56,771][123090] Updated weights for policy 1, policy_version 1072573 (0.0010) [2023-12-26 08:12:56,839][123091] Updated weights for policy 0, policy_version 1080146 (0.0009) [2023-12-26 08:12:56,897][123091] Updated weights for policy 0, policy_version 1080156 (0.0008) [2023-12-26 08:12:56,950][123091] Updated weights for policy 0, policy_version 1080166 (0.0008) [2023-12-26 08:12:57,010][123091] Updated weights for policy 0, policy_version 1080176 (0.0008) [2023-12-26 08:12:57,564][123090] Updated weights for policy 1, policy_version 1072583 (0.0007) [2023-12-26 08:12:57,617][123090] Updated weights for policy 1, policy_version 1072593 (0.0005) [2023-12-26 08:12:57,668][123090] Updated weights for policy 1, policy_version 1072603 (0.0005) [2023-12-26 08:12:57,726][123091] Updated weights for policy 0, policy_version 1080186 (0.0006) [2023-12-26 08:12:57,775][123091] Updated weights for policy 0, policy_version 1080196 (0.0005) [2023-12-26 08:12:57,824][123091] Updated weights for policy 0, policy_version 1080206 (0.0005) [2023-12-26 08:12:58,446][123090] Updated weights for policy 1, policy_version 1072613 (0.0008) [2023-12-26 08:12:58,518][123090] Updated weights for policy 1, policy_version 1072623 (0.0009) [2023-12-26 08:12:58,586][123090] Updated weights for policy 1, policy_version 1072633 (0.0009) [2023-12-26 08:12:58,608][123091] Updated weights for policy 0, policy_version 1080216 (0.0007) [2023-12-26 08:12:58,674][123091] Updated weights for policy 0, policy_version 1080226 (0.0007) [2023-12-26 08:12:58,744][123091] Updated weights for policy 0, policy_version 1080236 (0.0010) [2023-12-26 08:12:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 551141376. Throughput: 0: 9090.4, 1: 8711.5. Samples: 551129144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:12:58,785][121949] Avg episode reward: [(0, '6031.636'), (1, '4105.708')] [2023-12-26 08:12:59,508][123090] Updated weights for policy 1, policy_version 1072643 (0.0009) [2023-12-26 08:12:59,546][123091] Updated weights for policy 0, policy_version 1080246 (0.0007) [2023-12-26 08:12:59,574][123090] Updated weights for policy 1, policy_version 1072653 (0.0008) [2023-12-26 08:12:59,598][123091] Updated weights for policy 0, policy_version 1080256 (0.0008) [2023-12-26 08:12:59,632][123090] Updated weights for policy 1, policy_version 1072663 (0.0008) [2023-12-26 08:12:59,651][123091] Updated weights for policy 0, policy_version 1080266 (0.0005) [2023-12-26 08:13:00,378][123091] Updated weights for policy 0, policy_version 1080276 (0.0008) [2023-12-26 08:13:00,437][123091] Updated weights for policy 0, policy_version 1080286 (0.0011) [2023-12-26 08:13:00,471][123090] Updated weights for policy 1, policy_version 1072673 (0.0008) [2023-12-26 08:13:00,493][123091] Updated weights for policy 0, policy_version 1080296 (0.0010) [2023-12-26 08:13:00,530][123090] Updated weights for policy 1, policy_version 1072683 (0.0007) [2023-12-26 08:13:00,595][123090] Updated weights for policy 1, policy_version 1072693 (0.0010) [2023-12-26 08:13:00,656][123090] Updated weights for policy 1, policy_version 1072703 (0.0008) [2023-12-26 08:13:01,290][123091] Updated weights for policy 0, policy_version 1080306 (0.0010) [2023-12-26 08:13:01,360][123091] Updated weights for policy 0, policy_version 1080316 (0.0009) [2023-12-26 08:13:01,434][123091] Updated weights for policy 0, policy_version 1080326 (0.0008) [2023-12-26 08:13:01,486][123090] Updated weights for policy 1, policy_version 1072713 (0.0006) [2023-12-26 08:13:01,495][123091] Updated weights for policy 0, policy_version 1080336 (0.0009) [2023-12-26 08:13:01,543][123090] Updated weights for policy 1, policy_version 1072723 (0.0006) [2023-12-26 08:13:01,613][123090] Updated weights for policy 1, policy_version 1072733 (0.0006) [2023-12-26 08:13:02,305][123091] Updated weights for policy 0, policy_version 1080346 (0.0009) [2023-12-26 08:13:02,362][123091] Updated weights for policy 0, policy_version 1080356 (0.0008) [2023-12-26 08:13:02,385][123090] Updated weights for policy 1, policy_version 1072743 (0.0008) [2023-12-26 08:13:02,427][123091] Updated weights for policy 0, policy_version 1080366 (0.0006) [2023-12-26 08:13:02,451][123090] Updated weights for policy 1, policy_version 1072753 (0.0006) [2023-12-26 08:13:02,511][123090] Updated weights for policy 1, policy_version 1072763 (0.0005) [2023-12-26 08:13:03,118][123091] Updated weights for policy 0, policy_version 1080376 (0.0008) [2023-12-26 08:13:03,165][123091] Updated weights for policy 0, policy_version 1080386 (0.0009) [2023-12-26 08:13:03,177][123090] Updated weights for policy 1, policy_version 1072773 (0.0006) [2023-12-26 08:13:03,215][123091] Updated weights for policy 0, policy_version 1080396 (0.0009) [2023-12-26 08:13:03,235][123090] Updated weights for policy 1, policy_version 1072783 (0.0008) [2023-12-26 08:13:03,290][123090] Updated weights for policy 1, policy_version 1072793 (0.0009) [2023-12-26 08:13:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 551223296. Throughput: 0: 8992.7, 1: 8730.1. Samples: 551235432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:03,785][121949] Avg episode reward: [(0, '6067.707'), (1, '4108.746')] [2023-12-26 08:13:03,923][123090] Updated weights for policy 1, policy_version 1072803 (0.0007) [2023-12-26 08:13:03,991][123090] Updated weights for policy 1, policy_version 1072813 (0.0010) [2023-12-26 08:13:04,057][123090] Updated weights for policy 1, policy_version 1072823 (0.0009) [2023-12-26 08:13:04,105][123091] Updated weights for policy 0, policy_version 1080406 (0.0009) [2023-12-26 08:13:04,154][123091] Updated weights for policy 0, policy_version 1080416 (0.0009) [2023-12-26 08:13:04,213][123091] Updated weights for policy 0, policy_version 1080426 (0.0009) [2023-12-26 08:13:04,796][123090] Updated weights for policy 1, policy_version 1072833 (0.0007) [2023-12-26 08:13:04,859][123090] Updated weights for policy 1, policy_version 1072843 (0.0005) [2023-12-26 08:13:04,923][123090] Updated weights for policy 1, policy_version 1072853 (0.0006) [2023-12-26 08:13:04,983][123090] Updated weights for policy 1, policy_version 1072863 (0.0008) [2023-12-26 08:13:05,100][123091] Updated weights for policy 0, policy_version 1080436 (0.0010) [2023-12-26 08:13:05,157][123091] Updated weights for policy 0, policy_version 1080446 (0.0009) [2023-12-26 08:13:05,215][123091] Updated weights for policy 0, policy_version 1080456 (0.0009) [2023-12-26 08:13:05,724][123090] Updated weights for policy 1, policy_version 1072873 (0.0006) [2023-12-26 08:13:05,781][123090] Updated weights for policy 1, policy_version 1072883 (0.0005) [2023-12-26 08:13:05,834][123090] Updated weights for policy 1, policy_version 1072893 (0.0005) [2023-12-26 08:13:06,060][123091] Updated weights for policy 0, policy_version 1080466 (0.0010) [2023-12-26 08:13:06,111][123091] Updated weights for policy 0, policy_version 1080476 (0.0009) [2023-12-26 08:13:06,172][123091] Updated weights for policy 0, policy_version 1080486 (0.0010) [2023-12-26 08:13:06,229][123091] Updated weights for policy 0, policy_version 1080496 (0.0010) [2023-12-26 08:13:06,671][123090] Updated weights for policy 1, policy_version 1072903 (0.0008) [2023-12-26 08:13:06,726][123090] Updated weights for policy 1, policy_version 1072913 (0.0009) [2023-12-26 08:13:06,787][123090] Updated weights for policy 1, policy_version 1072923 (0.0009) [2023-12-26 08:13:07,030][123091] Updated weights for policy 0, policy_version 1080506 (0.0009) [2023-12-26 08:13:07,090][123091] Updated weights for policy 0, policy_version 1080516 (0.0009) [2023-12-26 08:13:07,156][123091] Updated weights for policy 0, policy_version 1080526 (0.0009) [2023-12-26 08:13:07,567][123090] Updated weights for policy 1, policy_version 1072933 (0.0008) [2023-12-26 08:13:07,624][123090] Updated weights for policy 1, policy_version 1072943 (0.0009) [2023-12-26 08:13:07,681][123090] Updated weights for policy 1, policy_version 1072954 (0.0009) [2023-12-26 08:13:07,998][123091] Updated weights for policy 0, policy_version 1080536 (0.0010) [2023-12-26 08:13:08,054][123091] Updated weights for policy 0, policy_version 1080546 (0.0010) [2023-12-26 08:13:08,108][123091] Updated weights for policy 0, policy_version 1080556 (0.0008) [2023-12-26 08:13:08,507][123090] Updated weights for policy 1, policy_version 1072964 (0.0009) [2023-12-26 08:13:08,568][123090] Updated weights for policy 1, policy_version 1072974 (0.0009) [2023-12-26 08:13:08,635][123090] Updated weights for policy 1, policy_version 1072984 (0.0010) [2023-12-26 08:13:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 551313408. Throughput: 0: 8979.3, 1: 8792.8. Samples: 551289456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:08,785][121949] Avg episode reward: [(0, '5976.107'), (1, '3877.957')] [2023-12-26 08:13:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001080560_276627456.pth... [2023-12-26 08:13:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001072992_274685952.pth... [2023-12-26 08:13:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001079504_276357120.pth [2023-12-26 08:13:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001071968_274423808.pth [2023-12-26 08:13:08,964][123091] Updated weights for policy 0, policy_version 1080566 (0.0010) [2023-12-26 08:13:09,033][123091] Updated weights for policy 0, policy_version 1080576 (0.0009) [2023-12-26 08:13:09,096][123091] Updated weights for policy 0, policy_version 1080586 (0.0009) [2023-12-26 08:13:09,466][123090] Updated weights for policy 1, policy_version 1072994 (0.0008) [2023-12-26 08:13:09,527][123090] Updated weights for policy 1, policy_version 1073004 (0.0009) [2023-12-26 08:13:09,583][123090] Updated weights for policy 1, policy_version 1073014 (0.0009) [2023-12-26 08:13:09,648][123090] Updated weights for policy 1, policy_version 1073024 (0.0008) [2023-12-26 08:13:09,935][123091] Updated weights for policy 0, policy_version 1080596 (0.0010) [2023-12-26 08:13:10,001][123091] Updated weights for policy 0, policy_version 1080606 (0.0010) [2023-12-26 08:13:10,054][123091] Updated weights for policy 0, policy_version 1080616 (0.0010) [2023-12-26 08:13:10,459][123090] Updated weights for policy 1, policy_version 1073034 (0.0010) [2023-12-26 08:13:10,515][123090] Updated weights for policy 1, policy_version 1073044 (0.0010) [2023-12-26 08:13:10,564][123090] Updated weights for policy 1, policy_version 1073054 (0.0009) [2023-12-26 08:13:10,900][123091] Updated weights for policy 0, policy_version 1080626 (0.0009) [2023-12-26 08:13:10,960][123091] Updated weights for policy 0, policy_version 1080636 (0.0009) [2023-12-26 08:13:11,024][123091] Updated weights for policy 0, policy_version 1080646 (0.0010) [2023-12-26 08:13:11,095][123091] Updated weights for policy 0, policy_version 1080656 (0.0009) [2023-12-26 08:13:11,466][123090] Updated weights for policy 1, policy_version 1073064 (0.0010) [2023-12-26 08:13:11,533][123090] Updated weights for policy 1, policy_version 1073074 (0.0009) [2023-12-26 08:13:11,600][123090] Updated weights for policy 1, policy_version 1073084 (0.0009) [2023-12-26 08:13:11,971][123091] Updated weights for policy 0, policy_version 1080666 (0.0010) [2023-12-26 08:13:12,034][123091] Updated weights for policy 0, policy_version 1080676 (0.0009) [2023-12-26 08:13:12,103][123091] Updated weights for policy 0, policy_version 1080686 (0.0008) [2023-12-26 08:13:12,413][123090] Updated weights for policy 1, policy_version 1073094 (0.0010) [2023-12-26 08:13:12,475][123090] Updated weights for policy 1, policy_version 1073104 (0.0009) [2023-12-26 08:13:12,541][123090] Updated weights for policy 1, policy_version 1073114 (0.0010) [2023-12-26 08:13:12,912][123091] Updated weights for policy 0, policy_version 1080696 (0.0010) [2023-12-26 08:13:12,971][123091] Updated weights for policy 0, policy_version 1080706 (0.0009) [2023-12-26 08:13:13,035][123091] Updated weights for policy 0, policy_version 1080716 (0.0010) [2023-12-26 08:13:13,408][123090] Updated weights for policy 1, policy_version 1073124 (0.0009) [2023-12-26 08:13:13,466][123090] Updated weights for policy 1, policy_version 1073134 (0.0009) [2023-12-26 08:13:13,534][123090] Updated weights for policy 1, policy_version 1073144 (0.0009) [2023-12-26 08:13:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 551395328. Throughput: 0: 8879.8, 1: 8701.8. Samples: 551389856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:13,785][121949] Avg episode reward: [(0, '5845.890'), (1, '3608.125')] [2023-12-26 08:13:13,791][123091] Updated weights for policy 0, policy_version 1080726 (0.0010) [2023-12-26 08:13:13,839][123091] Updated weights for policy 0, policy_version 1080736 (0.0010) [2023-12-26 08:13:13,890][123091] Updated weights for policy 0, policy_version 1080746 (0.0010) [2023-12-26 08:13:14,442][123090] Updated weights for policy 1, policy_version 1073154 (0.0010) [2023-12-26 08:13:14,500][123090] Updated weights for policy 1, policy_version 1073164 (0.0010) [2023-12-26 08:13:14,551][123090] Updated weights for policy 1, policy_version 1073174 (0.0009) [2023-12-26 08:13:14,603][123090] Updated weights for policy 1, policy_version 1073184 (0.0009) [2023-12-26 08:13:14,614][123091] Updated weights for policy 0, policy_version 1080756 (0.0008) [2023-12-26 08:13:14,675][123091] Updated weights for policy 0, policy_version 1080766 (0.0005) [2023-12-26 08:13:14,739][123091] Updated weights for policy 0, policy_version 1080776 (0.0005) [2023-12-26 08:13:15,468][123091] Updated weights for policy 0, policy_version 1080786 (0.0007) [2023-12-26 08:13:15,533][123091] Updated weights for policy 0, policy_version 1080796 (0.0009) [2023-12-26 08:13:15,549][123090] Updated weights for policy 1, policy_version 1073194 (0.0009) [2023-12-26 08:13:15,590][123091] Updated weights for policy 0, policy_version 1080806 (0.0007) [2023-12-26 08:13:15,613][123090] Updated weights for policy 1, policy_version 1073204 (0.0007) [2023-12-26 08:13:15,643][123091] Updated weights for policy 0, policy_version 1080816 (0.0008) [2023-12-26 08:13:15,670][123090] Updated weights for policy 1, policy_version 1073214 (0.0010) [2023-12-26 08:13:16,400][123091] Updated weights for policy 0, policy_version 1080826 (0.0006) [2023-12-26 08:13:16,490][123091] Updated weights for policy 0, policy_version 1080836 (0.0010) [2023-12-26 08:13:16,539][123090] Updated weights for policy 1, policy_version 1073224 (0.0008) [2023-12-26 08:13:16,552][123091] Updated weights for policy 0, policy_version 1080846 (0.0005) [2023-12-26 08:13:16,594][123090] Updated weights for policy 1, policy_version 1073234 (0.0009) [2023-12-26 08:13:16,648][123090] Updated weights for policy 1, policy_version 1073244 (0.0009) [2023-12-26 08:13:17,195][123091] Updated weights for policy 0, policy_version 1080856 (0.0010) [2023-12-26 08:13:17,264][123091] Updated weights for policy 0, policy_version 1080866 (0.0010) [2023-12-26 08:13:17,326][123091] Updated weights for policy 0, policy_version 1080876 (0.0010) [2023-12-26 08:13:17,517][123090] Updated weights for policy 1, policy_version 1073254 (0.0009) [2023-12-26 08:13:17,573][123090] Updated weights for policy 1, policy_version 1073264 (0.0009) [2023-12-26 08:13:17,625][123090] Updated weights for policy 1, policy_version 1073274 (0.0008) [2023-12-26 08:13:18,075][123091] Updated weights for policy 0, policy_version 1080886 (0.0009) [2023-12-26 08:13:18,137][123091] Updated weights for policy 0, policy_version 1080896 (0.0010) [2023-12-26 08:13:18,193][123091] Updated weights for policy 0, policy_version 1080906 (0.0011) [2023-12-26 08:13:18,523][123090] Updated weights for policy 1, policy_version 1073284 (0.0009) [2023-12-26 08:13:18,580][123090] Updated weights for policy 1, policy_version 1073294 (0.0009) [2023-12-26 08:13:18,646][123090] Updated weights for policy 1, policy_version 1073304 (0.0009) [2023-12-26 08:13:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 551485440. Throughput: 0: 9016.6, 1: 8580.8. Samples: 551495420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:18,785][121949] Avg episode reward: [(0, '5917.089'), (1, '3612.181')] [2023-12-26 08:13:18,943][123091] Updated weights for policy 0, policy_version 1080916 (0.0009) [2023-12-26 08:13:19,007][123091] Updated weights for policy 0, policy_version 1080926 (0.0005) [2023-12-26 08:13:19,076][123091] Updated weights for policy 0, policy_version 1080936 (0.0006) [2023-12-26 08:13:19,557][123090] Updated weights for policy 1, policy_version 1073314 (0.0009) [2023-12-26 08:13:19,630][123090] Updated weights for policy 1, policy_version 1073324 (0.0010) [2023-12-26 08:13:19,700][123090] Updated weights for policy 1, policy_version 1073334 (0.0009) [2023-12-26 08:13:19,770][123090] Updated weights for policy 1, policy_version 1073344 (0.0010) [2023-12-26 08:13:19,811][123091] Updated weights for policy 0, policy_version 1080946 (0.0006) [2023-12-26 08:13:19,885][123091] Updated weights for policy 0, policy_version 1080956 (0.0009) [2023-12-26 08:13:19,958][123091] Updated weights for policy 0, policy_version 1080966 (0.0010) [2023-12-26 08:13:20,018][123091] Updated weights for policy 0, policy_version 1080976 (0.0009) [2023-12-26 08:13:20,646][123090] Updated weights for policy 1, policy_version 1073354 (0.0009) [2023-12-26 08:13:20,708][123090] Updated weights for policy 1, policy_version 1073364 (0.0009) [2023-12-26 08:13:20,715][123091] Updated weights for policy 0, policy_version 1080986 (0.0009) [2023-12-26 08:13:20,762][123090] Updated weights for policy 1, policy_version 1073374 (0.0007) [2023-12-26 08:13:20,784][123091] Updated weights for policy 0, policy_version 1080996 (0.0009) [2023-12-26 08:13:20,847][123091] Updated weights for policy 0, policy_version 1081006 (0.0009) [2023-12-26 08:13:21,682][123090] Updated weights for policy 1, policy_version 1073384 (0.0008) [2023-12-26 08:13:21,704][123091] Updated weights for policy 0, policy_version 1081016 (0.0008) [2023-12-26 08:13:21,753][123090] Updated weights for policy 1, policy_version 1073394 (0.0009) [2023-12-26 08:13:21,772][123091] Updated weights for policy 0, policy_version 1081026 (0.0007) [2023-12-26 08:13:21,826][123090] Updated weights for policy 1, policy_version 1073404 (0.0010) [2023-12-26 08:13:21,841][123091] Updated weights for policy 0, policy_version 1081036 (0.0007) [2023-12-26 08:13:22,628][123091] Updated weights for policy 0, policy_version 1081046 (0.0010) [2023-12-26 08:13:22,693][123090] Updated weights for policy 1, policy_version 1073414 (0.0007) [2023-12-26 08:13:22,695][123091] Updated weights for policy 0, policy_version 1081056 (0.0011) [2023-12-26 08:13:22,754][123090] Updated weights for policy 1, policy_version 1073424 (0.0006) [2023-12-26 08:13:22,759][123091] Updated weights for policy 0, policy_version 1081066 (0.0011) [2023-12-26 08:13:22,820][123090] Updated weights for policy 1, policy_version 1073434 (0.0006) [2023-12-26 08:13:23,551][123091] Updated weights for policy 0, policy_version 1081076 (0.0010) [2023-12-26 08:13:23,565][123090] Updated weights for policy 1, policy_version 1073444 (0.0007) [2023-12-26 08:13:23,618][123091] Updated weights for policy 0, policy_version 1081086 (0.0008) [2023-12-26 08:13:23,621][123090] Updated weights for policy 1, policy_version 1073454 (0.0008) [2023-12-26 08:13:23,676][123090] Updated weights for policy 1, policy_version 1073465 (0.0010) [2023-12-26 08:13:23,683][123091] Updated weights for policy 0, policy_version 1081096 (0.0006) [2023-12-26 08:13:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.4). Total num frames: 551575552. Throughput: 0: 9028.6, 1: 8539.7. Samples: 551546740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:23,786][121949] Avg episode reward: [(0, '6052.641'), (1, '4189.621')] [2023-12-26 08:13:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001073472_274808832.pth... [2023-12-26 08:13:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001081104_276766720.pth... [2023-12-26 08:13:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001080048_276496384.pth [2023-12-26 08:13:23,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001072480_274554880.pth [2023-12-26 08:13:24,398][123091] Updated weights for policy 0, policy_version 1081106 (0.0005) [2023-12-26 08:13:24,450][123091] Updated weights for policy 0, policy_version 1081116 (0.0008) [2023-12-26 08:13:24,499][123091] Updated weights for policy 0, policy_version 1081126 (0.0008) [2023-12-26 08:13:24,554][123091] Updated weights for policy 0, policy_version 1081136 (0.0005) [2023-12-26 08:13:24,590][123090] Updated weights for policy 1, policy_version 1073475 (0.0008) [2023-12-26 08:13:24,650][123090] Updated weights for policy 1, policy_version 1073485 (0.0010) [2023-12-26 08:13:24,705][123090] Updated weights for policy 1, policy_version 1073497 (0.0011) [2023-12-26 08:13:25,252][123091] Updated weights for policy 0, policy_version 1081146 (0.0006) [2023-12-26 08:13:25,305][123091] Updated weights for policy 0, policy_version 1081156 (0.0005) [2023-12-26 08:13:25,349][123091] Updated weights for policy 0, policy_version 1081166 (0.0005) [2023-12-26 08:13:25,660][123090] Updated weights for policy 1, policy_version 1073507 (0.0010) [2023-12-26 08:13:25,720][123090] Updated weights for policy 1, policy_version 1073517 (0.0009) [2023-12-26 08:13:25,787][123090] Updated weights for policy 1, policy_version 1073527 (0.0010) [2023-12-26 08:13:26,002][123091] Updated weights for policy 0, policy_version 1081176 (0.0010) [2023-12-26 08:13:26,063][123091] Updated weights for policy 0, policy_version 1081186 (0.0011) [2023-12-26 08:13:26,125][123091] Updated weights for policy 0, policy_version 1081196 (0.0010) [2023-12-26 08:13:26,631][123090] Updated weights for policy 1, policy_version 1073537 (0.0009) [2023-12-26 08:13:26,694][123090] Updated weights for policy 1, policy_version 1073547 (0.0010) [2023-12-26 08:13:26,749][123090] Updated weights for policy 1, policy_version 1073557 (0.0010) [2023-12-26 08:13:26,802][123090] Updated weights for policy 1, policy_version 1073567 (0.0009) [2023-12-26 08:13:26,886][123091] Updated weights for policy 0, policy_version 1081206 (0.0008) [2023-12-26 08:13:26,946][123091] Updated weights for policy 0, policy_version 1081216 (0.0006) [2023-12-26 08:13:26,997][123091] Updated weights for policy 0, policy_version 1081226 (0.0006) [2023-12-26 08:13:27,671][123091] Updated weights for policy 0, policy_version 1081236 (0.0007) [2023-12-26 08:13:27,702][123090] Updated weights for policy 1, policy_version 1073577 (0.0010) [2023-12-26 08:13:27,718][123091] Updated weights for policy 0, policy_version 1081246 (0.0007) [2023-12-26 08:13:27,762][123090] Updated weights for policy 1, policy_version 1073587 (0.0009) [2023-12-26 08:13:27,769][123091] Updated weights for policy 0, policy_version 1081256 (0.0007) [2023-12-26 08:13:27,827][123090] Updated weights for policy 1, policy_version 1073597 (0.0009) [2023-12-26 08:13:28,575][123090] Updated weights for policy 1, policy_version 1073607 (0.0006) [2023-12-26 08:13:28,637][123090] Updated weights for policy 1, policy_version 1073617 (0.0005) [2023-12-26 08:13:28,638][123091] Updated weights for policy 0, policy_version 1081266 (0.0008) [2023-12-26 08:13:28,697][123090] Updated weights for policy 1, policy_version 1073627 (0.0005) [2023-12-26 08:13:28,702][123091] Updated weights for policy 0, policy_version 1081276 (0.0009) [2023-12-26 08:13:28,766][123091] Updated weights for policy 0, policy_version 1081286 (0.0009) [2023-12-26 08:13:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 551657472. Throughput: 0: 9069.2, 1: 8553.0. Samples: 551652052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:28,785][121949] Avg episode reward: [(0, '5993.013'), (1, '4220.394')] [2023-12-26 08:13:28,820][123091] Updated weights for policy 0, policy_version 1081296 (0.0009) [2023-12-26 08:13:29,303][123090] Updated weights for policy 1, policy_version 1073637 (0.0008) [2023-12-26 08:13:29,361][123090] Updated weights for policy 1, policy_version 1073647 (0.0009) [2023-12-26 08:13:29,416][123090] Updated weights for policy 1, policy_version 1073657 (0.0009) [2023-12-26 08:13:29,701][123091] Updated weights for policy 0, policy_version 1081306 (0.0010) [2023-12-26 08:13:29,765][123091] Updated weights for policy 0, policy_version 1081316 (0.0010) [2023-12-26 08:13:29,838][123091] Updated weights for policy 0, policy_version 1081326 (0.0009) [2023-12-26 08:13:30,231][123090] Updated weights for policy 1, policy_version 1073667 (0.0009) [2023-12-26 08:13:30,284][123090] Updated weights for policy 1, policy_version 1073677 (0.0008) [2023-12-26 08:13:30,347][123090] Updated weights for policy 1, policy_version 1073687 (0.0009) [2023-12-26 08:13:30,705][123091] Updated weights for policy 0, policy_version 1081336 (0.0010) [2023-12-26 08:13:30,762][123091] Updated weights for policy 0, policy_version 1081346 (0.0009) [2023-12-26 08:13:30,816][123091] Updated weights for policy 0, policy_version 1081356 (0.0010) [2023-12-26 08:13:31,155][123090] Updated weights for policy 1, policy_version 1073697 (0.0006) [2023-12-26 08:13:31,209][123090] Updated weights for policy 1, policy_version 1073707 (0.0010) [2023-12-26 08:13:31,280][123090] Updated weights for policy 1, policy_version 1073717 (0.0008) [2023-12-26 08:13:31,332][123090] Updated weights for policy 1, policy_version 1073727 (0.0009) [2023-12-26 08:13:31,691][123091] Updated weights for policy 0, policy_version 1081366 (0.0009) [2023-12-26 08:13:31,764][123091] Updated weights for policy 0, policy_version 1081376 (0.0009) [2023-12-26 08:13:31,825][123091] Updated weights for policy 0, policy_version 1081386 (0.0009) [2023-12-26 08:13:32,196][123090] Updated weights for policy 1, policy_version 1073737 (0.0010) [2023-12-26 08:13:32,260][123090] Updated weights for policy 1, policy_version 1073747 (0.0010) [2023-12-26 08:13:32,324][123090] Updated weights for policy 1, policy_version 1073757 (0.0011) [2023-12-26 08:13:32,688][123091] Updated weights for policy 0, policy_version 1081396 (0.0009) [2023-12-26 08:13:32,736][123091] Updated weights for policy 0, policy_version 1081406 (0.0009) [2023-12-26 08:13:32,784][123091] Updated weights for policy 0, policy_version 1081416 (0.0009) [2023-12-26 08:13:33,155][123090] Updated weights for policy 1, policy_version 1073767 (0.0010) [2023-12-26 08:13:33,206][123090] Updated weights for policy 1, policy_version 1073777 (0.0010) [2023-12-26 08:13:33,257][123090] Updated weights for policy 1, policy_version 1073787 (0.0010) [2023-12-26 08:13:33,657][123091] Updated weights for policy 0, policy_version 1081426 (0.0008) [2023-12-26 08:13:33,707][123091] Updated weights for policy 0, policy_version 1081436 (0.0005) [2023-12-26 08:13:33,764][123091] Updated weights for policy 0, policy_version 1081447 (0.0008) [2023-12-26 08:13:33,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 551739392. Throughput: 0: 8929.5, 1: 8522.6. Samples: 551755492. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:33,785][121949] Avg episode reward: [(0, '5960.467'), (1, '4410.696')] [2023-12-26 08:13:34,041][123090] Updated weights for policy 1, policy_version 1073797 (0.0009) [2023-12-26 08:13:34,099][123090] Updated weights for policy 1, policy_version 1073807 (0.0008) [2023-12-26 08:13:34,179][123090] Updated weights for policy 1, policy_version 1073817 (0.0007) [2023-12-26 08:13:34,525][123091] Updated weights for policy 0, policy_version 1081458 (0.0010) [2023-12-26 08:13:34,579][123091] Updated weights for policy 0, policy_version 1081468 (0.0007) [2023-12-26 08:13:34,644][123091] Updated weights for policy 0, policy_version 1081478 (0.0006) [2023-12-26 08:13:34,699][123091] Updated weights for policy 0, policy_version 1081488 (0.0005) [2023-12-26 08:13:34,997][123090] Updated weights for policy 1, policy_version 1073827 (0.0007) [2023-12-26 08:13:35,057][123090] Updated weights for policy 1, policy_version 1073837 (0.0008) [2023-12-26 08:13:35,120][123090] Updated weights for policy 1, policy_version 1073847 (0.0007) [2023-12-26 08:13:35,406][123091] Updated weights for policy 0, policy_version 1081498 (0.0006) [2023-12-26 08:13:35,466][123091] Updated weights for policy 0, policy_version 1081508 (0.0005) [2023-12-26 08:13:35,520][123091] Updated weights for policy 0, policy_version 1081518 (0.0005) [2023-12-26 08:13:35,747][123090] Updated weights for policy 1, policy_version 1073857 (0.0005) [2023-12-26 08:13:35,809][123090] Updated weights for policy 1, policy_version 1073867 (0.0005) [2023-12-26 08:13:35,873][123090] Updated weights for policy 1, policy_version 1073877 (0.0007) [2023-12-26 08:13:35,939][123090] Updated weights for policy 1, policy_version 1073887 (0.0006) [2023-12-26 08:13:36,187][123091] Updated weights for policy 0, policy_version 1081528 (0.0006) [2023-12-26 08:13:36,248][123091] Updated weights for policy 0, policy_version 1081538 (0.0006) [2023-12-26 08:13:36,307][123091] Updated weights for policy 0, policy_version 1081548 (0.0006) [2023-12-26 08:13:36,659][123090] Updated weights for policy 1, policy_version 1073897 (0.0005) [2023-12-26 08:13:36,724][123090] Updated weights for policy 1, policy_version 1073907 (0.0006) [2023-12-26 08:13:36,787][123090] Updated weights for policy 1, policy_version 1073917 (0.0007) [2023-12-26 08:13:37,044][123091] Updated weights for policy 0, policy_version 1081558 (0.0005) [2023-12-26 08:13:37,096][123091] Updated weights for policy 0, policy_version 1081568 (0.0006) [2023-12-26 08:13:37,154][123091] Updated weights for policy 0, policy_version 1081578 (0.0007) [2023-12-26 08:13:37,499][123090] Updated weights for policy 1, policy_version 1073927 (0.0007) [2023-12-26 08:13:37,579][123090] Updated weights for policy 1, policy_version 1073937 (0.0006) [2023-12-26 08:13:37,652][123090] Updated weights for policy 1, policy_version 1073947 (0.0005) [2023-12-26 08:13:37,799][123091] Updated weights for policy 0, policy_version 1081588 (0.0010) [2023-12-26 08:13:37,858][123091] Updated weights for policy 0, policy_version 1081598 (0.0011) [2023-12-26 08:13:37,922][123091] Updated weights for policy 0, policy_version 1081608 (0.0011) [2023-12-26 08:13:38,415][123090] Updated weights for policy 1, policy_version 1073957 (0.0010) [2023-12-26 08:13:38,487][123090] Updated weights for policy 1, policy_version 1073967 (0.0011) [2023-12-26 08:13:38,557][123090] Updated weights for policy 1, policy_version 1073977 (0.0011) [2023-12-26 08:13:38,749][123091] Updated weights for policy 0, policy_version 1081618 (0.0010) [2023-12-26 08:13:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 551837696. Throughput: 0: 8982.3, 1: 8600.6. Samples: 551812980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:38,785][121949] Avg episode reward: [(0, '5999.974'), (1, '4030.652')] [2023-12-26 08:13:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001073984_274939904.pth... [2023-12-26 08:13:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001072992_274685952.pth [2023-12-26 08:13:38,812][123091] Updated weights for policy 0, policy_version 1081628 (0.0008) [2023-12-26 08:13:38,883][123091] Updated weights for policy 0, policy_version 1081638 (0.0007) [2023-12-26 08:13:38,951][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001081648_276905984.pth... [2023-12-26 08:13:38,953][123091] Updated weights for policy 0, policy_version 1081648 (0.0007) [2023-12-26 08:13:38,955][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001080560_276627456.pth [2023-12-26 08:13:39,299][123090] Updated weights for policy 1, policy_version 1073987 (0.0010) [2023-12-26 08:13:39,369][123090] Updated weights for policy 1, policy_version 1073997 (0.0010) [2023-12-26 08:13:39,446][123090] Updated weights for policy 1, policy_version 1074007 (0.0010) [2023-12-26 08:13:39,719][123091] Updated weights for policy 0, policy_version 1081658 (0.0006) [2023-12-26 08:13:39,793][123091] Updated weights for policy 0, policy_version 1081668 (0.0006) [2023-12-26 08:13:39,861][123091] Updated weights for policy 0, policy_version 1081678 (0.0009) [2023-12-26 08:13:40,281][123090] Updated weights for policy 1, policy_version 1074017 (0.0007) [2023-12-26 08:13:40,330][123090] Updated weights for policy 1, policy_version 1074027 (0.0010) [2023-12-26 08:13:40,397][123090] Updated weights for policy 1, policy_version 1074037 (0.0010) [2023-12-26 08:13:40,461][123090] Updated weights for policy 1, policy_version 1074047 (0.0010) [2023-12-26 08:13:40,656][123091] Updated weights for policy 0, policy_version 1081688 (0.0009) [2023-12-26 08:13:40,715][123091] Updated weights for policy 0, policy_version 1081698 (0.0009) [2023-12-26 08:13:40,770][123091] Updated weights for policy 0, policy_version 1081710 (0.0010) [2023-12-26 08:13:41,245][123090] Updated weights for policy 1, policy_version 1074057 (0.0007) [2023-12-26 08:13:41,315][123090] Updated weights for policy 1, policy_version 1074067 (0.0006) [2023-12-26 08:13:41,387][123090] Updated weights for policy 1, policy_version 1074077 (0.0006) [2023-12-26 08:13:41,625][123091] Updated weights for policy 0, policy_version 1081720 (0.0009) [2023-12-26 08:13:41,692][123091] Updated weights for policy 0, policy_version 1081730 (0.0009) [2023-12-26 08:13:41,767][123091] Updated weights for policy 0, policy_version 1081740 (0.0009) [2023-12-26 08:13:42,236][123090] Updated weights for policy 1, policy_version 1074087 (0.0007) [2023-12-26 08:13:42,309][123090] Updated weights for policy 1, policy_version 1074097 (0.0008) [2023-12-26 08:13:42,382][123090] Updated weights for policy 1, policy_version 1074107 (0.0009) [2023-12-26 08:13:42,480][123091] Updated weights for policy 0, policy_version 1081750 (0.0007) [2023-12-26 08:13:42,544][123091] Updated weights for policy 0, policy_version 1081760 (0.0008) [2023-12-26 08:13:42,604][123091] Updated weights for policy 0, policy_version 1081770 (0.0009) [2023-12-26 08:13:43,101][123090] Updated weights for policy 1, policy_version 1074117 (0.0006) [2023-12-26 08:13:43,167][123090] Updated weights for policy 1, policy_version 1074127 (0.0005) [2023-12-26 08:13:43,233][123090] Updated weights for policy 1, policy_version 1074137 (0.0005) [2023-12-26 08:13:43,380][123091] Updated weights for policy 0, policy_version 1081780 (0.0007) [2023-12-26 08:13:43,434][123091] Updated weights for policy 0, policy_version 1081790 (0.0009) [2023-12-26 08:13:43,485][123091] Updated weights for policy 0, policy_version 1081800 (0.0010) [2023-12-26 08:13:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 551927808. Throughput: 0: 8967.6, 1: 8621.5. Samples: 551920656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:43,785][121949] Avg episode reward: [(0, '6034.677'), (1, '4447.429')] [2023-12-26 08:13:43,888][123090] Updated weights for policy 1, policy_version 1074147 (0.0005) [2023-12-26 08:13:43,964][123090] Updated weights for policy 1, policy_version 1074157 (0.0007) [2023-12-26 08:13:44,041][123090] Updated weights for policy 1, policy_version 1074167 (0.0005) [2023-12-26 08:13:44,193][123091] Updated weights for policy 0, policy_version 1081810 (0.0009) [2023-12-26 08:13:44,254][123091] Updated weights for policy 0, policy_version 1081820 (0.0005) [2023-12-26 08:13:44,312][123091] Updated weights for policy 0, policy_version 1081830 (0.0006) [2023-12-26 08:13:44,370][123091] Updated weights for policy 0, policy_version 1081840 (0.0005) [2023-12-26 08:13:44,857][123090] Updated weights for policy 1, policy_version 1074177 (0.0010) [2023-12-26 08:13:44,923][123090] Updated weights for policy 1, policy_version 1074187 (0.0009) [2023-12-26 08:13:44,988][123090] Updated weights for policy 1, policy_version 1074197 (0.0009) [2023-12-26 08:13:45,044][123090] Updated weights for policy 1, policy_version 1074207 (0.0008) [2023-12-26 08:13:45,080][123091] Updated weights for policy 0, policy_version 1081850 (0.0010) [2023-12-26 08:13:45,137][123091] Updated weights for policy 0, policy_version 1081860 (0.0010) [2023-12-26 08:13:45,192][123091] Updated weights for policy 0, policy_version 1081870 (0.0010) [2023-12-26 08:13:45,851][123090] Updated weights for policy 1, policy_version 1074218 (0.0008) [2023-12-26 08:13:45,910][123090] Updated weights for policy 1, policy_version 1074228 (0.0008) [2023-12-26 08:13:45,984][123090] Updated weights for policy 1, policy_version 1074238 (0.0010) [2023-12-26 08:13:46,061][123091] Updated weights for policy 0, policy_version 1081880 (0.0006) [2023-12-26 08:13:46,116][123091] Updated weights for policy 0, policy_version 1081890 (0.0006) [2023-12-26 08:13:46,165][123091] Updated weights for policy 0, policy_version 1081900 (0.0009) [2023-12-26 08:13:46,664][123090] Updated weights for policy 1, policy_version 1074248 (0.0006) [2023-12-26 08:13:46,721][123090] Updated weights for policy 1, policy_version 1074258 (0.0005) [2023-12-26 08:13:46,768][123090] Updated weights for policy 1, policy_version 1074268 (0.0005) [2023-12-26 08:13:46,825][123091] Updated weights for policy 0, policy_version 1081910 (0.0007) [2023-12-26 08:13:46,879][123091] Updated weights for policy 0, policy_version 1081920 (0.0005) [2023-12-26 08:13:46,946][123091] Updated weights for policy 0, policy_version 1081930 (0.0008) [2023-12-26 08:13:47,436][123090] Updated weights for policy 1, policy_version 1074278 (0.0005) [2023-12-26 08:13:47,485][123090] Updated weights for policy 1, policy_version 1074288 (0.0005) [2023-12-26 08:13:47,533][123090] Updated weights for policy 1, policy_version 1074298 (0.0005) [2023-12-26 08:13:47,831][123091] Updated weights for policy 0, policy_version 1081940 (0.0010) [2023-12-26 08:13:47,887][123091] Updated weights for policy 0, policy_version 1081950 (0.0009) [2023-12-26 08:13:47,954][123091] Updated weights for policy 0, policy_version 1081960 (0.0010) [2023-12-26 08:13:48,205][123090] Updated weights for policy 1, policy_version 1074308 (0.0007) [2023-12-26 08:13:48,256][123090] Updated weights for policy 1, policy_version 1074318 (0.0010) [2023-12-26 08:13:48,307][123090] Updated weights for policy 1, policy_version 1074328 (0.0010) [2023-12-26 08:13:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 552017920. Throughput: 0: 8978.8, 1: 8722.0. Samples: 552031964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:48,784][121949] Avg episode reward: [(0, '6012.265'), (1, '5272.664')] [2023-12-26 08:13:48,826][123091] Updated weights for policy 0, policy_version 1081970 (0.0010) [2023-12-26 08:13:48,883][123091] Updated weights for policy 0, policy_version 1081980 (0.0009) [2023-12-26 08:13:48,941][123091] Updated weights for policy 0, policy_version 1081990 (0.0009) [2023-12-26 08:13:49,010][123091] Updated weights for policy 0, policy_version 1082000 (0.0010) [2023-12-26 08:13:49,106][123090] Updated weights for policy 1, policy_version 1074338 (0.0010) [2023-12-26 08:13:49,164][123090] Updated weights for policy 1, policy_version 1074348 (0.0005) [2023-12-26 08:13:49,212][123090] Updated weights for policy 1, policy_version 1074358 (0.0005) [2023-12-26 08:13:49,278][123090] Updated weights for policy 1, policy_version 1074368 (0.0011) [2023-12-26 08:13:49,914][123091] Updated weights for policy 0, policy_version 1082010 (0.0005) [2023-12-26 08:13:49,986][123091] Updated weights for policy 0, policy_version 1082020 (0.0007) [2023-12-26 08:13:50,052][123091] Updated weights for policy 0, policy_version 1082030 (0.0008) [2023-12-26 08:13:50,129][123090] Updated weights for policy 1, policy_version 1074378 (0.0009) [2023-12-26 08:13:50,191][123090] Updated weights for policy 1, policy_version 1074388 (0.0009) [2023-12-26 08:13:50,243][123090] Updated weights for policy 1, policy_version 1074398 (0.0009) [2023-12-26 08:13:50,857][123091] Updated weights for policy 0, policy_version 1082040 (0.0007) [2023-12-26 08:13:50,906][123091] Updated weights for policy 0, policy_version 1082050 (0.0006) [2023-12-26 08:13:50,973][123091] Updated weights for policy 0, policy_version 1082060 (0.0006) [2023-12-26 08:13:51,110][123090] Updated weights for policy 1, policy_version 1074409 (0.0008) [2023-12-26 08:13:51,180][123090] Updated weights for policy 1, policy_version 1074419 (0.0008) [2023-12-26 08:13:51,242][123090] Updated weights for policy 1, policy_version 1074429 (0.0008) [2023-12-26 08:13:51,742][123091] Updated weights for policy 0, policy_version 1082070 (0.0007) [2023-12-26 08:13:51,804][123091] Updated weights for policy 0, policy_version 1082080 (0.0008) [2023-12-26 08:13:51,863][123091] Updated weights for policy 0, policy_version 1082090 (0.0008) [2023-12-26 08:13:52,017][123090] Updated weights for policy 1, policy_version 1074439 (0.0009) [2023-12-26 08:13:52,079][123090] Updated weights for policy 1, policy_version 1074449 (0.0010) [2023-12-26 08:13:52,148][123090] Updated weights for policy 1, policy_version 1074459 (0.0009) [2023-12-26 08:13:52,710][123091] Updated weights for policy 0, policy_version 1082100 (0.0010) [2023-12-26 08:13:52,764][123091] Updated weights for policy 0, policy_version 1082111 (0.0009) [2023-12-26 08:13:52,817][123091] Updated weights for policy 0, policy_version 1082121 (0.0009) [2023-12-26 08:13:52,968][123090] Updated weights for policy 1, policy_version 1074469 (0.0009) [2023-12-26 08:13:53,015][123090] Updated weights for policy 1, policy_version 1074479 (0.0009) [2023-12-26 08:13:53,071][123090] Updated weights for policy 1, policy_version 1074489 (0.0009) [2023-12-26 08:13:53,515][123091] Updated weights for policy 0, policy_version 1082131 (0.0008) [2023-12-26 08:13:53,568][123091] Updated weights for policy 0, policy_version 1082141 (0.0008) [2023-12-26 08:13:53,628][123091] Updated weights for policy 0, policy_version 1082151 (0.0011) [2023-12-26 08:13:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 552108032. Throughput: 0: 8985.6, 1: 8671.8. Samples: 552084040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:53,785][121949] Avg episode reward: [(0, '6031.201'), (1, '5275.788')] [2023-12-26 08:13:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001082160_277037056.pth... [2023-12-26 08:13:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001074496_275070976.pth... [2023-12-26 08:13:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001081104_276766720.pth [2023-12-26 08:13:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001073472_274808832.pth [2023-12-26 08:13:53,799][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001082160_277037056.pth [2023-12-26 08:13:53,800][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001074496_275070976.pth [2023-12-26 08:13:53,918][123090] Updated weights for policy 1, policy_version 1074499 (0.0009) [2023-12-26 08:13:53,979][123090] Updated weights for policy 1, policy_version 1074509 (0.0009) [2023-12-26 08:13:54,043][123090] Updated weights for policy 1, policy_version 1074519 (0.0011) [2023-12-26 08:13:54,372][123091] Updated weights for policy 0, policy_version 1082161 (0.0010) [2023-12-26 08:13:54,437][123091] Updated weights for policy 0, policy_version 1082171 (0.0005) [2023-12-26 08:13:54,490][123091] Updated weights for policy 0, policy_version 1082181 (0.0005) [2023-12-26 08:13:54,541][123091] Updated weights for policy 0, policy_version 1082191 (0.0005) [2023-12-26 08:13:54,790][123090] Updated weights for policy 1, policy_version 1074529 (0.0010) [2023-12-26 08:13:54,846][123090] Updated weights for policy 1, policy_version 1074539 (0.0006) [2023-12-26 08:13:54,892][123090] Updated weights for policy 1, policy_version 1074549 (0.0005) [2023-12-26 08:13:54,943][123090] Updated weights for policy 1, policy_version 1074559 (0.0005) [2023-12-26 08:13:55,246][123091] Updated weights for policy 0, policy_version 1082201 (0.0010) [2023-12-26 08:13:55,309][123091] Updated weights for policy 0, policy_version 1082211 (0.0010) [2023-12-26 08:13:55,360][123091] Updated weights for policy 0, policy_version 1082221 (0.0010) [2023-12-26 08:13:55,692][123090] Updated weights for policy 1, policy_version 1074569 (0.0006) [2023-12-26 08:13:55,755][123090] Updated weights for policy 1, policy_version 1074579 (0.0007) [2023-12-26 08:13:55,813][123090] Updated weights for policy 1, policy_version 1074589 (0.0010) [2023-12-26 08:13:56,179][123091] Updated weights for policy 0, policy_version 1082231 (0.0010) [2023-12-26 08:13:56,234][123091] Updated weights for policy 0, policy_version 1082241 (0.0011) [2023-12-26 08:13:56,286][123091] Updated weights for policy 0, policy_version 1082251 (0.0010) [2023-12-26 08:13:56,567][123090] Updated weights for policy 1, policy_version 1074599 (0.0007) [2023-12-26 08:13:56,626][123090] Updated weights for policy 1, policy_version 1074609 (0.0005) [2023-12-26 08:13:56,680][123090] Updated weights for policy 1, policy_version 1074619 (0.0005) [2023-12-26 08:13:57,129][123091] Updated weights for policy 0, policy_version 1082261 (0.0011) [2023-12-26 08:13:57,180][123091] Updated weights for policy 0, policy_version 1082271 (0.0011) [2023-12-26 08:13:57,238][123091] Updated weights for policy 0, policy_version 1082281 (0.0010) [2023-12-26 08:13:57,438][123090] Updated weights for policy 1, policy_version 1074629 (0.0008) [2023-12-26 08:13:57,502][123090] Updated weights for policy 1, policy_version 1074639 (0.0010) [2023-12-26 08:13:57,574][123090] Updated weights for policy 1, policy_version 1074649 (0.0010) [2023-12-26 08:13:58,062][123091] Updated weights for policy 0, policy_version 1082291 (0.0009) [2023-12-26 08:13:58,124][123091] Updated weights for policy 0, policy_version 1082301 (0.0008) [2023-12-26 08:13:58,179][123091] Updated weights for policy 0, policy_version 1082311 (0.0008) [2023-12-26 08:13:58,394][123090] Updated weights for policy 1, policy_version 1074659 (0.0010) [2023-12-26 08:13:58,461][123090] Updated weights for policy 1, policy_version 1074669 (0.0010) [2023-12-26 08:13:58,526][123090] Updated weights for policy 1, policy_version 1074679 (0.0009) [2023-12-26 08:13:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 552198144. Throughput: 0: 9083.5, 1: 8749.4. Samples: 552192336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:13:58,785][121949] Avg episode reward: [(0, '6087.939'), (1, '5486.545')] [2023-12-26 08:13:58,975][123091] Updated weights for policy 0, policy_version 1082321 (0.0008) [2023-12-26 08:13:59,038][123091] Updated weights for policy 0, policy_version 1082331 (0.0007) [2023-12-26 08:13:59,109][123091] Updated weights for policy 0, policy_version 1082341 (0.0006) [2023-12-26 08:13:59,180][123091] Updated weights for policy 0, policy_version 1082351 (0.0006) [2023-12-26 08:13:59,505][123090] Updated weights for policy 1, policy_version 1074689 (0.0010) [2023-12-26 08:13:59,577][123090] Updated weights for policy 1, policy_version 1074699 (0.0009) [2023-12-26 08:13:59,650][123090] Updated weights for policy 1, policy_version 1074709 (0.0011) [2023-12-26 08:13:59,725][123090] Updated weights for policy 1, policy_version 1074719 (0.0009) [2023-12-26 08:13:59,843][123091] Updated weights for policy 0, policy_version 1082361 (0.0008) [2023-12-26 08:13:59,904][123091] Updated weights for policy 0, policy_version 1082371 (0.0008) [2023-12-26 08:13:59,975][123091] Updated weights for policy 0, policy_version 1082381 (0.0009) [2023-12-26 08:14:00,534][123090] Updated weights for policy 1, policy_version 1074729 (0.0009) [2023-12-26 08:14:00,603][123090] Updated weights for policy 1, policy_version 1074739 (0.0010) [2023-12-26 08:14:00,662][123090] Updated weights for policy 1, policy_version 1074749 (0.0010) [2023-12-26 08:14:00,778][123091] Updated weights for policy 0, policy_version 1082391 (0.0011) [2023-12-26 08:14:00,851][123091] Updated weights for policy 0, policy_version 1082401 (0.0010) [2023-12-26 08:14:00,905][123091] Updated weights for policy 0, policy_version 1082411 (0.0010) [2023-12-26 08:14:01,413][123090] Updated weights for policy 1, policy_version 1074759 (0.0010) [2023-12-26 08:14:01,484][123090] Updated weights for policy 1, policy_version 1074769 (0.0009) [2023-12-26 08:14:01,553][123090] Updated weights for policy 1, policy_version 1074779 (0.0009) [2023-12-26 08:14:01,691][123091] Updated weights for policy 0, policy_version 1082421 (0.0008) [2023-12-26 08:14:01,749][123091] Updated weights for policy 0, policy_version 1082431 (0.0008) [2023-12-26 08:14:01,804][123091] Updated weights for policy 0, policy_version 1082441 (0.0011) [2023-12-26 08:14:02,450][123090] Updated weights for policy 1, policy_version 1074789 (0.0010) [2023-12-26 08:14:02,503][123090] Updated weights for policy 1, policy_version 1074799 (0.0009) [2023-12-26 08:14:02,539][123091] Updated weights for policy 0, policy_version 1082451 (0.0009) [2023-12-26 08:14:02,558][123090] Updated weights for policy 1, policy_version 1074809 (0.0009) [2023-12-26 08:14:02,605][123091] Updated weights for policy 0, policy_version 1082461 (0.0005) [2023-12-26 08:14:02,672][123091] Updated weights for policy 0, policy_version 1082471 (0.0009) [2023-12-26 08:14:03,356][123090] Updated weights for policy 1, policy_version 1074819 (0.0006) [2023-12-26 08:14:03,426][123090] Updated weights for policy 1, policy_version 1074829 (0.0006) [2023-12-26 08:14:03,436][123091] Updated weights for policy 0, policy_version 1082481 (0.0011) [2023-12-26 08:14:03,483][123090] Updated weights for policy 1, policy_version 1074839 (0.0010) [2023-12-26 08:14:03,493][123091] Updated weights for policy 0, policy_version 1082491 (0.0010) [2023-12-26 08:14:03,554][123091] Updated weights for policy 0, policy_version 1082501 (0.0010) [2023-12-26 08:14:03,619][123091] Updated weights for policy 0, policy_version 1082511 (0.0010) [2023-12-26 08:14:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 552288256. Throughput: 0: 9014.1, 1: 8784.6. Samples: 552296364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:03,785][121949] Avg episode reward: [(0, '6001.442'), (1, '5345.570')] [2023-12-26 08:14:04,293][123090] Updated weights for policy 1, policy_version 1074849 (0.0010) [2023-12-26 08:14:04,366][123090] Updated weights for policy 1, policy_version 1074859 (0.0011) [2023-12-26 08:14:04,412][123091] Updated weights for policy 0, policy_version 1082521 (0.0006) [2023-12-26 08:14:04,437][123090] Updated weights for policy 1, policy_version 1074869 (0.0011) [2023-12-26 08:14:04,481][123091] Updated weights for policy 0, policy_version 1082531 (0.0008) [2023-12-26 08:14:04,500][123090] Updated weights for policy 1, policy_version 1074879 (0.0011) [2023-12-26 08:14:04,547][123091] Updated weights for policy 0, policy_version 1082541 (0.0009) [2023-12-26 08:14:05,315][123090] Updated weights for policy 1, policy_version 1074889 (0.0006) [2023-12-26 08:14:05,321][123091] Updated weights for policy 0, policy_version 1082551 (0.0010) [2023-12-26 08:14:05,379][123090] Updated weights for policy 1, policy_version 1074899 (0.0007) [2023-12-26 08:14:05,384][123091] Updated weights for policy 0, policy_version 1082561 (0.0011) [2023-12-26 08:14:05,439][123091] Updated weights for policy 0, policy_version 1082571 (0.0010) [2023-12-26 08:14:05,441][123090] Updated weights for policy 1, policy_version 1074909 (0.0007) [2023-12-26 08:14:06,105][123090] Updated weights for policy 1, policy_version 1074919 (0.0009) [2023-12-26 08:14:06,117][123091] Updated weights for policy 0, policy_version 1082581 (0.0009) [2023-12-26 08:14:06,169][123090] Updated weights for policy 1, policy_version 1074929 (0.0011) [2023-12-26 08:14:06,179][123091] Updated weights for policy 0, policy_version 1082591 (0.0008) [2023-12-26 08:14:06,224][123090] Updated weights for policy 1, policy_version 1074939 (0.0009) [2023-12-26 08:14:06,249][123091] Updated weights for policy 0, policy_version 1082601 (0.0008) [2023-12-26 08:14:07,030][123091] Updated weights for policy 0, policy_version 1082611 (0.0009) [2023-12-26 08:14:07,067][123090] Updated weights for policy 1, policy_version 1074949 (0.0011) [2023-12-26 08:14:07,093][123091] Updated weights for policy 0, policy_version 1082621 (0.0011) [2023-12-26 08:14:07,129][123090] Updated weights for policy 1, policy_version 1074959 (0.0010) [2023-12-26 08:14:07,155][123091] Updated weights for policy 0, policy_version 1082631 (0.0010) [2023-12-26 08:14:07,196][123090] Updated weights for policy 1, policy_version 1074969 (0.0010) [2023-12-26 08:14:07,817][123091] Updated weights for policy 0, policy_version 1082641 (0.0010) [2023-12-26 08:14:07,872][123091] Updated weights for policy 0, policy_version 1082651 (0.0008) [2023-12-26 08:14:07,926][123091] Updated weights for policy 0, policy_version 1082661 (0.0010) [2023-12-26 08:14:07,973][123091] Updated weights for policy 0, policy_version 1082671 (0.0010) [2023-12-26 08:14:08,006][123090] Updated weights for policy 1, policy_version 1074979 (0.0011) [2023-12-26 08:14:08,066][123090] Updated weights for policy 1, policy_version 1074989 (0.0010) [2023-12-26 08:14:08,119][123090] Updated weights for policy 1, policy_version 1074999 (0.0007) [2023-12-26 08:14:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 552370176. Throughput: 0: 9029.8, 1: 8844.8. Samples: 552351092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:08,785][121949] Avg episode reward: [(0, '6109.226'), (1, '5091.449')] [2023-12-26 08:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001075008_275202048.pth... [2023-12-26 08:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001073984_274939904.pth [2023-12-26 08:14:08,834][123090] Updated weights for policy 1, policy_version 1075009 (0.0010) [2023-12-26 08:14:08,849][123091] Updated weights for policy 0, policy_version 1082681 (0.0006) [2023-12-26 08:14:08,894][123090] Updated weights for policy 1, policy_version 1075019 (0.0006) [2023-12-26 08:14:08,908][123091] Updated weights for policy 0, policy_version 1082691 (0.0010) [2023-12-26 08:14:08,955][123090] Updated weights for policy 1, policy_version 1075029 (0.0006) [2023-12-26 08:14:08,959][123091] Updated weights for policy 0, policy_version 1082701 (0.0010) [2023-12-26 08:14:08,972][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001082704_277176320.pth... [2023-12-26 08:14:08,976][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001081648_276905984.pth [2023-12-26 08:14:09,019][123090] Updated weights for policy 1, policy_version 1075039 (0.0005) [2023-12-26 08:14:09,734][123091] Updated weights for policy 0, policy_version 1082711 (0.0009) [2023-12-26 08:14:09,739][123090] Updated weights for policy 1, policy_version 1075049 (0.0009) [2023-12-26 08:14:09,803][123091] Updated weights for policy 0, policy_version 1082721 (0.0008) [2023-12-26 08:14:09,805][123090] Updated weights for policy 1, policy_version 1075059 (0.0009) [2023-12-26 08:14:09,872][123091] Updated weights for policy 0, policy_version 1082731 (0.0008) [2023-12-26 08:14:09,872][123090] Updated weights for policy 1, policy_version 1075069 (0.0008) [2023-12-26 08:14:10,580][123091] Updated weights for policy 0, policy_version 1082741 (0.0007) [2023-12-26 08:14:10,638][123091] Updated weights for policy 0, policy_version 1082751 (0.0009) [2023-12-26 08:14:10,686][123091] Updated weights for policy 0, policy_version 1082761 (0.0009) [2023-12-26 08:14:10,688][123090] Updated weights for policy 1, policy_version 1075079 (0.0008) [2023-12-26 08:14:10,753][123090] Updated weights for policy 1, policy_version 1075089 (0.0008) [2023-12-26 08:14:10,823][123090] Updated weights for policy 1, policy_version 1075099 (0.0009) [2023-12-26 08:14:11,500][123091] Updated weights for policy 0, policy_version 1082771 (0.0009) [2023-12-26 08:14:11,562][123091] Updated weights for policy 0, policy_version 1082781 (0.0008) [2023-12-26 08:14:11,628][123091] Updated weights for policy 0, policy_version 1082791 (0.0008) [2023-12-26 08:14:11,726][123090] Updated weights for policy 1, policy_version 1075109 (0.0009) [2023-12-26 08:14:11,800][123090] Updated weights for policy 1, policy_version 1075119 (0.0010) [2023-12-26 08:14:11,861][123090] Updated weights for policy 1, policy_version 1075129 (0.0010) [2023-12-26 08:14:12,463][123091] Updated weights for policy 0, policy_version 1082801 (0.0009) [2023-12-26 08:14:12,522][123091] Updated weights for policy 0, policy_version 1082811 (0.0007) [2023-12-26 08:14:12,595][123091] Updated weights for policy 0, policy_version 1082821 (0.0006) [2023-12-26 08:14:12,664][123091] Updated weights for policy 0, policy_version 1082831 (0.0009) [2023-12-26 08:14:12,709][123090] Updated weights for policy 1, policy_version 1075139 (0.0009) [2023-12-26 08:14:12,771][123090] Updated weights for policy 1, policy_version 1075149 (0.0009) [2023-12-26 08:14:12,835][123090] Updated weights for policy 1, policy_version 1075159 (0.0010) [2023-12-26 08:14:13,370][123091] Updated weights for policy 0, policy_version 1082841 (0.0006) [2023-12-26 08:14:13,417][123091] Updated weights for policy 0, policy_version 1082851 (0.0005) [2023-12-26 08:14:13,462][123091] Updated weights for policy 0, policy_version 1082861 (0.0007) [2023-12-26 08:14:13,738][123090] Updated weights for policy 1, policy_version 1075169 (0.0009) [2023-12-26 08:14:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 552460288. Throughput: 0: 8960.8, 1: 8918.9. Samples: 552456636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:13,785][121949] Avg episode reward: [(0, '6175.268'), (1, '5038.544')] [2023-12-26 08:14:13,788][123090] Updated weights for policy 1, policy_version 1075179 (0.0008) [2023-12-26 08:14:13,844][123090] Updated weights for policy 1, policy_version 1075189 (0.0008) [2023-12-26 08:14:13,897][123090] Updated weights for policy 1, policy_version 1075199 (0.0009) [2023-12-26 08:14:14,267][123091] Updated weights for policy 0, policy_version 1082871 (0.0010) [2023-12-26 08:14:14,334][123091] Updated weights for policy 0, policy_version 1082881 (0.0009) [2023-12-26 08:14:14,393][123091] Updated weights for policy 0, policy_version 1082891 (0.0010) [2023-12-26 08:14:14,761][123090] Updated weights for policy 1, policy_version 1075209 (0.0009) [2023-12-26 08:14:14,821][123090] Updated weights for policy 1, policy_version 1075219 (0.0009) [2023-12-26 08:14:14,870][123090] Updated weights for policy 1, policy_version 1075229 (0.0009) [2023-12-26 08:14:15,154][123091] Updated weights for policy 0, policy_version 1082901 (0.0009) [2023-12-26 08:14:15,211][123091] Updated weights for policy 0, policy_version 1082911 (0.0009) [2023-12-26 08:14:15,263][123091] Updated weights for policy 0, policy_version 1082921 (0.0008) [2023-12-26 08:14:15,748][123090] Updated weights for policy 1, policy_version 1075239 (0.0010) [2023-12-26 08:14:15,808][123090] Updated weights for policy 1, policy_version 1075249 (0.0009) [2023-12-26 08:14:15,873][123090] Updated weights for policy 1, policy_version 1075259 (0.0009) [2023-12-26 08:14:16,101][123091] Updated weights for policy 0, policy_version 1082931 (0.0010) [2023-12-26 08:14:16,160][123091] Updated weights for policy 0, policy_version 1082941 (0.0009) [2023-12-26 08:14:16,212][123091] Updated weights for policy 0, policy_version 1082951 (0.0009) [2023-12-26 08:14:16,697][123090] Updated weights for policy 1, policy_version 1075269 (0.0009) [2023-12-26 08:14:16,751][123090] Updated weights for policy 1, policy_version 1075279 (0.0009) [2023-12-26 08:14:16,815][123090] Updated weights for policy 1, policy_version 1075289 (0.0009) [2023-12-26 08:14:17,040][123091] Updated weights for policy 0, policy_version 1082961 (0.0009) [2023-12-26 08:14:17,105][123091] Updated weights for policy 0, policy_version 1082971 (0.0009) [2023-12-26 08:14:17,166][123091] Updated weights for policy 0, policy_version 1082981 (0.0009) [2023-12-26 08:14:17,223][123091] Updated weights for policy 0, policy_version 1082991 (0.0009) [2023-12-26 08:14:17,640][123090] Updated weights for policy 1, policy_version 1075299 (0.0009) [2023-12-26 08:14:17,703][123090] Updated weights for policy 1, policy_version 1075309 (0.0009) [2023-12-26 08:14:17,760][123090] Updated weights for policy 1, policy_version 1075319 (0.0009) [2023-12-26 08:14:18,042][123091] Updated weights for policy 0, policy_version 1083001 (0.0010) [2023-12-26 08:14:18,101][123091] Updated weights for policy 0, policy_version 1083011 (0.0010) [2023-12-26 08:14:18,166][123091] Updated weights for policy 0, policy_version 1083021 (0.0010) [2023-12-26 08:14:18,615][123090] Updated weights for policy 1, policy_version 1075329 (0.0010) [2023-12-26 08:14:18,681][123090] Updated weights for policy 1, policy_version 1075339 (0.0010) [2023-12-26 08:14:18,742][123090] Updated weights for policy 1, policy_version 1075349 (0.0009) [2023-12-26 08:14:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 552542208. Throughput: 0: 9027.3, 1: 8834.6. Samples: 552559276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:18,784][121949] Avg episode reward: [(0, '6203.911'), (1, '4981.626')] [2023-12-26 08:14:18,805][123090] Updated weights for policy 1, policy_version 1075359 (0.0008) [2023-12-26 08:14:19,037][123091] Updated weights for policy 0, policy_version 1083031 (0.0010) [2023-12-26 08:14:19,100][123091] Updated weights for policy 0, policy_version 1083041 (0.0011) [2023-12-26 08:14:19,148][123091] Updated weights for policy 0, policy_version 1083051 (0.0010) [2023-12-26 08:14:19,648][123090] Updated weights for policy 1, policy_version 1075369 (0.0010) [2023-12-26 08:14:19,707][123090] Updated weights for policy 1, policy_version 1075379 (0.0010) [2023-12-26 08:14:19,764][123090] Updated weights for policy 1, policy_version 1075389 (0.0010) [2023-12-26 08:14:19,990][123091] Updated weights for policy 0, policy_version 1083061 (0.0009) [2023-12-26 08:14:20,055][123091] Updated weights for policy 0, policy_version 1083071 (0.0009) [2023-12-26 08:14:20,118][123091] Updated weights for policy 0, policy_version 1083081 (0.0009) [2023-12-26 08:14:20,536][123090] Updated weights for policy 1, policy_version 1075399 (0.0006) [2023-12-26 08:14:20,609][123090] Updated weights for policy 1, policy_version 1075409 (0.0009) [2023-12-26 08:14:20,668][123090] Updated weights for policy 1, policy_version 1075420 (0.0010) [2023-12-26 08:14:20,927][123091] Updated weights for policy 0, policy_version 1083091 (0.0009) [2023-12-26 08:14:21,004][123091] Updated weights for policy 0, policy_version 1083101 (0.0006) [2023-12-26 08:14:21,075][123091] Updated weights for policy 0, policy_version 1083111 (0.0009) [2023-12-26 08:14:21,525][123090] Updated weights for policy 1, policy_version 1075430 (0.0010) [2023-12-26 08:14:21,585][123090] Updated weights for policy 1, policy_version 1075440 (0.0009) [2023-12-26 08:14:21,652][123090] Updated weights for policy 1, policy_version 1075450 (0.0010) [2023-12-26 08:14:21,940][123091] Updated weights for policy 0, policy_version 1083121 (0.0010) [2023-12-26 08:14:22,006][123091] Updated weights for policy 0, policy_version 1083131 (0.0009) [2023-12-26 08:14:22,073][123091] Updated weights for policy 0, policy_version 1083141 (0.0009) [2023-12-26 08:14:22,136][123091] Updated weights for policy 0, policy_version 1083151 (0.0010) [2023-12-26 08:14:22,493][123090] Updated weights for policy 1, policy_version 1075460 (0.0009) [2023-12-26 08:14:22,553][123090] Updated weights for policy 1, policy_version 1075470 (0.0008) [2023-12-26 08:14:22,614][123090] Updated weights for policy 1, policy_version 1075480 (0.0009) [2023-12-26 08:14:22,945][123091] Updated weights for policy 0, policy_version 1083161 (0.0006) [2023-12-26 08:14:23,016][123091] Updated weights for policy 0, policy_version 1083171 (0.0006) [2023-12-26 08:14:23,087][123091] Updated weights for policy 0, policy_version 1083181 (0.0006) [2023-12-26 08:14:23,407][123090] Updated weights for policy 1, policy_version 1075490 (0.0008) [2023-12-26 08:14:23,463][123090] Updated weights for policy 1, policy_version 1075500 (0.0005) [2023-12-26 08:14:23,523][123090] Updated weights for policy 1, policy_version 1075510 (0.0005) [2023-12-26 08:14:23,585][123090] Updated weights for policy 1, policy_version 1075520 (0.0005) [2023-12-26 08:14:23,785][121949] Fps is (10 sec: 17202.4, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 552632320. Throughput: 0: 8939.0, 1: 8758.8. Samples: 552609384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:23,786][121949] Avg episode reward: [(0, '6159.757'), (1, '4977.385')] [2023-12-26 08:14:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001075520_275333120.pth... [2023-12-26 08:14:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001074496_275070976.pth [2023-12-26 08:14:23,836][123091] Updated weights for policy 0, policy_version 1083191 (0.0008) [2023-12-26 08:14:23,890][123091] Updated weights for policy 0, policy_version 1083201 (0.0009) [2023-12-26 08:14:23,947][123091] Updated weights for policy 0, policy_version 1083211 (0.0010) [2023-12-26 08:14:23,970][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001083216_277307392.pth... [2023-12-26 08:14:23,974][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001082160_277037056.pth [2023-12-26 08:14:24,176][123090] Updated weights for policy 1, policy_version 1075530 (0.0008) [2023-12-26 08:14:24,242][123090] Updated weights for policy 1, policy_version 1075540 (0.0010) [2023-12-26 08:14:24,309][123090] Updated weights for policy 1, policy_version 1075550 (0.0010) [2023-12-26 08:14:24,836][123091] Updated weights for policy 0, policy_version 1083221 (0.0009) [2023-12-26 08:14:24,889][123091] Updated weights for policy 0, policy_version 1083231 (0.0010) [2023-12-26 08:14:24,942][123091] Updated weights for policy 0, policy_version 1083242 (0.0010) [2023-12-26 08:14:25,101][123090] Updated weights for policy 1, policy_version 1075560 (0.0008) [2023-12-26 08:14:25,174][123090] Updated weights for policy 1, policy_version 1075570 (0.0007) [2023-12-26 08:14:25,246][123090] Updated weights for policy 1, policy_version 1075580 (0.0007) [2023-12-26 08:14:25,869][123091] Updated weights for policy 0, policy_version 1083252 (0.0009) [2023-12-26 08:14:25,897][123090] Updated weights for policy 1, policy_version 1075590 (0.0009) [2023-12-26 08:14:25,925][123091] Updated weights for policy 0, policy_version 1083262 (0.0006) [2023-12-26 08:14:25,947][123090] Updated weights for policy 1, policy_version 1075600 (0.0010) [2023-12-26 08:14:25,976][123091] Updated weights for policy 0, policy_version 1083272 (0.0006) [2023-12-26 08:14:26,003][123090] Updated weights for policy 1, policy_version 1075610 (0.0010) [2023-12-26 08:14:26,763][123090] Updated weights for policy 1, policy_version 1075620 (0.0009) [2023-12-26 08:14:26,765][123091] Updated weights for policy 0, policy_version 1083282 (0.0008) [2023-12-26 08:14:26,815][123090] Updated weights for policy 1, policy_version 1075630 (0.0010) [2023-12-26 08:14:26,826][123091] Updated weights for policy 0, policy_version 1083292 (0.0006) [2023-12-26 08:14:26,870][123090] Updated weights for policy 1, policy_version 1075640 (0.0010) [2023-12-26 08:14:26,881][123091] Updated weights for policy 0, policy_version 1083302 (0.0006) [2023-12-26 08:14:26,937][123091] Updated weights for policy 0, policy_version 1083312 (0.0007) [2023-12-26 08:14:27,703][123090] Updated weights for policy 1, policy_version 1075650 (0.0010) [2023-12-26 08:14:27,711][123091] Updated weights for policy 0, policy_version 1083322 (0.0009) [2023-12-26 08:14:27,754][123090] Updated weights for policy 1, policy_version 1075660 (0.0010) [2023-12-26 08:14:27,763][123091] Updated weights for policy 0, policy_version 1083332 (0.0005) [2023-12-26 08:14:27,805][123090] Updated weights for policy 1, policy_version 1075670 (0.0010) [2023-12-26 08:14:27,809][123091] Updated weights for policy 0, policy_version 1083342 (0.0005) [2023-12-26 08:14:27,857][123090] Updated weights for policy 1, policy_version 1075680 (0.0010) [2023-12-26 08:14:28,505][123091] Updated weights for policy 0, policy_version 1083352 (0.0008) [2023-12-26 08:14:28,560][123091] Updated weights for policy 0, policy_version 1083362 (0.0009) [2023-12-26 08:14:28,623][123091] Updated weights for policy 0, policy_version 1083372 (0.0006) [2023-12-26 08:14:28,710][123090] Updated weights for policy 1, policy_version 1075690 (0.0010) [2023-12-26 08:14:28,772][123090] Updated weights for policy 1, policy_version 1075700 (0.0010) [2023-12-26 08:14:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 552722432. Throughput: 0: 8867.3, 1: 8825.1. Samples: 552716812. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:28,785][121949] Avg episode reward: [(0, '6171.830'), (1, '5154.653')] [2023-12-26 08:14:28,838][123090] Updated weights for policy 1, policy_version 1075710 (0.0010) [2023-12-26 08:14:29,442][123091] Updated weights for policy 0, policy_version 1083382 (0.0008) [2023-12-26 08:14:29,505][123091] Updated weights for policy 0, policy_version 1083392 (0.0009) [2023-12-26 08:14:29,561][123091] Updated weights for policy 0, policy_version 1083402 (0.0009) [2023-12-26 08:14:29,676][123090] Updated weights for policy 1, policy_version 1075720 (0.0010) [2023-12-26 08:14:29,729][123090] Updated weights for policy 1, policy_version 1075730 (0.0009) [2023-12-26 08:14:29,786][123090] Updated weights for policy 1, policy_version 1075741 (0.0010) [2023-12-26 08:14:30,399][123091] Updated weights for policy 0, policy_version 1083412 (0.0008) [2023-12-26 08:14:30,446][123091] Updated weights for policy 0, policy_version 1083422 (0.0009) [2023-12-26 08:14:30,500][123091] Updated weights for policy 0, policy_version 1083433 (0.0010) [2023-12-26 08:14:30,582][123090] Updated weights for policy 1, policy_version 1075751 (0.0010) [2023-12-26 08:14:30,654][123090] Updated weights for policy 1, policy_version 1075761 (0.0009) [2023-12-26 08:14:30,717][123090] Updated weights for policy 1, policy_version 1075771 (0.0010) [2023-12-26 08:14:31,302][123091] Updated weights for policy 0, policy_version 1083443 (0.0009) [2023-12-26 08:14:31,371][123091] Updated weights for policy 0, policy_version 1083453 (0.0009) [2023-12-26 08:14:31,443][123091] Updated weights for policy 0, policy_version 1083463 (0.0010) [2023-12-26 08:14:31,517][123090] Updated weights for policy 1, policy_version 1075781 (0.0009) [2023-12-26 08:14:31,575][123090] Updated weights for policy 1, policy_version 1075791 (0.0009) [2023-12-26 08:14:31,645][123090] Updated weights for policy 1, policy_version 1075801 (0.0009) [2023-12-26 08:14:32,292][123091] Updated weights for policy 0, policy_version 1083473 (0.0009) [2023-12-26 08:14:32,346][123091] Updated weights for policy 0, policy_version 1083483 (0.0010) [2023-12-26 08:14:32,420][123091] Updated weights for policy 0, policy_version 1083493 (0.0008) [2023-12-26 08:14:32,442][123090] Updated weights for policy 1, policy_version 1075811 (0.0008) [2023-12-26 08:14:32,488][123091] Updated weights for policy 0, policy_version 1083503 (0.0008) [2023-12-26 08:14:32,509][123090] Updated weights for policy 1, policy_version 1075821 (0.0006) [2023-12-26 08:14:32,584][123090] Updated weights for policy 1, policy_version 1075831 (0.0005) [2023-12-26 08:14:33,286][123090] Updated weights for policy 1, policy_version 1075841 (0.0009) [2023-12-26 08:14:33,336][123090] Updated weights for policy 1, policy_version 1075851 (0.0008) [2023-12-26 08:14:33,345][123091] Updated weights for policy 0, policy_version 1083513 (0.0009) [2023-12-26 08:14:33,393][123091] Updated weights for policy 0, policy_version 1083523 (0.0008) [2023-12-26 08:14:33,402][123090] Updated weights for policy 1, policy_version 1075861 (0.0006) [2023-12-26 08:14:33,447][123091] Updated weights for policy 0, policy_version 1083533 (0.0008) [2023-12-26 08:14:33,471][123090] Updated weights for policy 1, policy_version 1075871 (0.0005) [2023-12-26 08:14:33,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 552812544. Throughput: 0: 8817.1, 1: 8737.0. Samples: 552821900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:33,785][121949] Avg episode reward: [(0, '6154.442'), (1, '5018.959')] [2023-12-26 08:14:34,135][123090] Updated weights for policy 1, policy_version 1075881 (0.0005) [2023-12-26 08:14:34,206][123090] Updated weights for policy 1, policy_version 1075891 (0.0008) [2023-12-26 08:14:34,231][123091] Updated weights for policy 0, policy_version 1083543 (0.0008) [2023-12-26 08:14:34,263][123090] Updated weights for policy 1, policy_version 1075901 (0.0010) [2023-12-26 08:14:34,296][123091] Updated weights for policy 0, policy_version 1083553 (0.0007) [2023-12-26 08:14:34,358][123091] Updated weights for policy 0, policy_version 1083563 (0.0009) [2023-12-26 08:14:35,036][123090] Updated weights for policy 1, policy_version 1075911 (0.0007) [2023-12-26 08:14:35,090][123090] Updated weights for policy 1, policy_version 1075921 (0.0005) [2023-12-26 08:14:35,146][123090] Updated weights for policy 1, policy_version 1075931 (0.0010) [2023-12-26 08:14:35,203][123091] Updated weights for policy 0, policy_version 1083573 (0.0009) [2023-12-26 08:14:35,266][123091] Updated weights for policy 0, policy_version 1083583 (0.0009) [2023-12-26 08:14:35,321][123091] Updated weights for policy 0, policy_version 1083593 (0.0009) [2023-12-26 08:14:35,896][123090] Updated weights for policy 1, policy_version 1075941 (0.0008) [2023-12-26 08:14:35,953][123090] Updated weights for policy 1, policy_version 1075951 (0.0005) [2023-12-26 08:14:36,009][123090] Updated weights for policy 1, policy_version 1075961 (0.0006) [2023-12-26 08:14:36,178][123091] Updated weights for policy 0, policy_version 1083603 (0.0009) [2023-12-26 08:14:36,247][123091] Updated weights for policy 0, policy_version 1083613 (0.0010) [2023-12-26 08:14:36,313][123091] Updated weights for policy 0, policy_version 1083623 (0.0011) [2023-12-26 08:14:36,798][123090] Updated weights for policy 1, policy_version 1075971 (0.0007) [2023-12-26 08:14:36,866][123090] Updated weights for policy 1, policy_version 1075981 (0.0009) [2023-12-26 08:14:36,933][123090] Updated weights for policy 1, policy_version 1075991 (0.0008) [2023-12-26 08:14:37,152][123091] Updated weights for policy 0, policy_version 1083633 (0.0010) [2023-12-26 08:14:37,216][123091] Updated weights for policy 0, policy_version 1083643 (0.0010) [2023-12-26 08:14:37,281][123091] Updated weights for policy 0, policy_version 1083653 (0.0010) [2023-12-26 08:14:37,350][123091] Updated weights for policy 0, policy_version 1083663 (0.0010) [2023-12-26 08:14:37,635][123090] Updated weights for policy 1, policy_version 1076001 (0.0009) [2023-12-26 08:14:37,696][123090] Updated weights for policy 1, policy_version 1076011 (0.0008) [2023-12-26 08:14:37,761][123090] Updated weights for policy 1, policy_version 1076021 (0.0010) [2023-12-26 08:14:37,809][123090] Updated weights for policy 1, policy_version 1076031 (0.0009) [2023-12-26 08:14:38,214][123091] Updated weights for policy 0, policy_version 1083673 (0.0009) [2023-12-26 08:14:38,263][123091] Updated weights for policy 0, policy_version 1083684 (0.0009) [2023-12-26 08:14:38,316][123091] Updated weights for policy 0, policy_version 1083694 (0.0009) [2023-12-26 08:14:38,683][123090] Updated weights for policy 1, policy_version 1076041 (0.0009) [2023-12-26 08:14:38,748][123090] Updated weights for policy 1, policy_version 1076051 (0.0007) [2023-12-26 08:14:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 552894464. Throughput: 0: 8809.0, 1: 8787.7. Samples: 552875888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:38,785][121949] Avg episode reward: [(0, '5959.108'), (1, '4930.987')] [2023-12-26 08:14:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001083696_277430272.pth... [2023-12-26 08:14:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001082704_277176320.pth [2023-12-26 08:14:38,818][123090] Updated weights for policy 1, policy_version 1076061 (0.0006) [2023-12-26 08:14:38,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001076064_275472384.pth... [2023-12-26 08:14:38,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001075008_275202048.pth [2023-12-26 08:14:39,220][123091] Updated weights for policy 0, policy_version 1083704 (0.0011) [2023-12-26 08:14:39,289][123091] Updated weights for policy 0, policy_version 1083714 (0.0011) [2023-12-26 08:14:39,360][123091] Updated weights for policy 0, policy_version 1083724 (0.0011) [2023-12-26 08:14:39,580][123090] Updated weights for policy 1, policy_version 1076071 (0.0008) [2023-12-26 08:14:39,649][123090] Updated weights for policy 1, policy_version 1076081 (0.0008) [2023-12-26 08:14:39,722][123090] Updated weights for policy 1, policy_version 1076091 (0.0009) [2023-12-26 08:14:40,210][123091] Updated weights for policy 0, policy_version 1083734 (0.0011) [2023-12-26 08:14:40,266][123091] Updated weights for policy 0, policy_version 1083744 (0.0010) [2023-12-26 08:14:40,314][123091] Updated weights for policy 0, policy_version 1083754 (0.0010) [2023-12-26 08:14:40,577][123090] Updated weights for policy 1, policy_version 1076101 (0.0009) [2023-12-26 08:14:40,630][123090] Updated weights for policy 1, policy_version 1076111 (0.0009) [2023-12-26 08:14:40,688][123090] Updated weights for policy 1, policy_version 1076121 (0.0009) [2023-12-26 08:14:41,163][123091] Updated weights for policy 0, policy_version 1083764 (0.0010) [2023-12-26 08:14:41,222][123091] Updated weights for policy 0, policy_version 1083774 (0.0010) [2023-12-26 08:14:41,292][123091] Updated weights for policy 0, policy_version 1083784 (0.0011) [2023-12-26 08:14:41,569][123090] Updated weights for policy 1, policy_version 1076131 (0.0009) [2023-12-26 08:14:41,632][123090] Updated weights for policy 1, policy_version 1076141 (0.0009) [2023-12-26 08:14:41,694][123090] Updated weights for policy 1, policy_version 1076151 (0.0009) [2023-12-26 08:14:42,098][123091] Updated weights for policy 0, policy_version 1083794 (0.0010) [2023-12-26 08:14:42,157][123091] Updated weights for policy 0, policy_version 1083804 (0.0010) [2023-12-26 08:14:42,215][123091] Updated weights for policy 0, policy_version 1083814 (0.0010) [2023-12-26 08:14:42,283][123091] Updated weights for policy 0, policy_version 1083824 (0.0010) [2023-12-26 08:14:42,541][123090] Updated weights for policy 1, policy_version 1076161 (0.0008) [2023-12-26 08:14:42,605][123090] Updated weights for policy 1, policy_version 1076171 (0.0009) [2023-12-26 08:14:42,665][123090] Updated weights for policy 1, policy_version 1076181 (0.0009) [2023-12-26 08:14:42,726][123090] Updated weights for policy 1, policy_version 1076191 (0.0009) [2023-12-26 08:14:43,123][123091] Updated weights for policy 0, policy_version 1083834 (0.0011) [2023-12-26 08:14:43,186][123091] Updated weights for policy 0, policy_version 1083844 (0.0010) [2023-12-26 08:14:43,244][123091] Updated weights for policy 0, policy_version 1083854 (0.0010) [2023-12-26 08:14:43,565][123090] Updated weights for policy 1, policy_version 1076201 (0.0008) [2023-12-26 08:14:43,620][123090] Updated weights for policy 1, policy_version 1076211 (0.0005) [2023-12-26 08:14:43,688][123090] Updated weights for policy 1, policy_version 1076221 (0.0005) [2023-12-26 08:14:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 552984576. Throughput: 0: 8717.4, 1: 8731.4. Samples: 552977532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:43,785][121949] Avg episode reward: [(0, '5985.013'), (1, '5109.128')] [2023-12-26 08:14:44,026][123091] Updated weights for policy 0, policy_version 1083864 (0.0009) [2023-12-26 08:14:44,090][123091] Updated weights for policy 0, policy_version 1083874 (0.0009) [2023-12-26 08:14:44,152][123091] Updated weights for policy 0, policy_version 1083884 (0.0009) [2023-12-26 08:14:44,346][123090] Updated weights for policy 1, policy_version 1076231 (0.0008) [2023-12-26 08:14:44,399][123090] Updated weights for policy 1, policy_version 1076241 (0.0010) [2023-12-26 08:14:44,456][123090] Updated weights for policy 1, policy_version 1076251 (0.0009) [2023-12-26 08:14:44,900][123091] Updated weights for policy 0, policy_version 1083894 (0.0007) [2023-12-26 08:14:44,959][123091] Updated weights for policy 0, policy_version 1083904 (0.0006) [2023-12-26 08:14:45,015][123091] Updated weights for policy 0, policy_version 1083914 (0.0008) [2023-12-26 08:14:45,379][123090] Updated weights for policy 1, policy_version 1076261 (0.0010) [2023-12-26 08:14:45,441][123090] Updated weights for policy 1, policy_version 1076271 (0.0010) [2023-12-26 08:14:45,510][123090] Updated weights for policy 1, policy_version 1076281 (0.0009) [2023-12-26 08:14:45,828][123091] Updated weights for policy 0, policy_version 1083924 (0.0009) [2023-12-26 08:14:45,883][123091] Updated weights for policy 0, policy_version 1083934 (0.0010) [2023-12-26 08:14:45,939][123091] Updated weights for policy 0, policy_version 1083944 (0.0010) [2023-12-26 08:14:46,304][123090] Updated weights for policy 1, policy_version 1076291 (0.0008) [2023-12-26 08:14:46,364][123090] Updated weights for policy 1, policy_version 1076301 (0.0010) [2023-12-26 08:14:46,427][123090] Updated weights for policy 1, policy_version 1076311 (0.0011) [2023-12-26 08:14:46,647][123091] Updated weights for policy 0, policy_version 1083954 (0.0009) [2023-12-26 08:14:46,716][123091] Updated weights for policy 0, policy_version 1083964 (0.0005) [2023-12-26 08:14:46,772][123091] Updated weights for policy 0, policy_version 1083974 (0.0005) [2023-12-26 08:14:46,823][123091] Updated weights for policy 0, policy_version 1083984 (0.0005) [2023-12-26 08:14:47,221][123090] Updated weights for policy 1, policy_version 1076321 (0.0010) [2023-12-26 08:14:47,269][123090] Updated weights for policy 1, policy_version 1076331 (0.0010) [2023-12-26 08:14:47,317][123090] Updated weights for policy 1, policy_version 1076341 (0.0010) [2023-12-26 08:14:47,368][123090] Updated weights for policy 1, policy_version 1076351 (0.0010) [2023-12-26 08:14:47,546][123091] Updated weights for policy 0, policy_version 1083994 (0.0005) [2023-12-26 08:14:47,604][123091] Updated weights for policy 0, policy_version 1084004 (0.0005) [2023-12-26 08:14:47,651][123091] Updated weights for policy 0, policy_version 1084014 (0.0005) [2023-12-26 08:14:48,161][123090] Updated weights for policy 1, policy_version 1076361 (0.0010) [2023-12-26 08:14:48,229][123090] Updated weights for policy 1, policy_version 1076371 (0.0011) [2023-12-26 08:14:48,307][123090] Updated weights for policy 1, policy_version 1076381 (0.0011) [2023-12-26 08:14:48,342][123091] Updated weights for policy 0, policy_version 1084024 (0.0007) [2023-12-26 08:14:48,410][123091] Updated weights for policy 0, policy_version 1084034 (0.0010) [2023-12-26 08:14:48,470][123091] Updated weights for policy 0, policy_version 1084044 (0.0011) [2023-12-26 08:14:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 553074688. Throughput: 0: 8763.2, 1: 8768.8. Samples: 553085304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:48,785][121949] Avg episode reward: [(0, '6229.848'), (1, '5360.301')] [2023-12-26 08:14:49,088][123090] Updated weights for policy 1, policy_version 1076391 (0.0007) [2023-12-26 08:14:49,149][123090] Updated weights for policy 1, policy_version 1076401 (0.0005) [2023-12-26 08:14:49,222][123090] Updated weights for policy 1, policy_version 1076411 (0.0006) [2023-12-26 08:14:49,287][123091] Updated weights for policy 0, policy_version 1084054 (0.0011) [2023-12-26 08:14:49,354][123091] Updated weights for policy 0, policy_version 1084064 (0.0006) [2023-12-26 08:14:49,421][123091] Updated weights for policy 0, policy_version 1084074 (0.0011) [2023-12-26 08:14:50,010][123090] Updated weights for policy 1, policy_version 1076421 (0.0010) [2023-12-26 08:14:50,074][123090] Updated weights for policy 1, policy_version 1076431 (0.0009) [2023-12-26 08:14:50,145][123090] Updated weights for policy 1, policy_version 1076441 (0.0005) [2023-12-26 08:14:50,233][123091] Updated weights for policy 0, policy_version 1084084 (0.0010) [2023-12-26 08:14:50,292][123091] Updated weights for policy 0, policy_version 1084094 (0.0009) [2023-12-26 08:14:50,352][123091] Updated weights for policy 0, policy_version 1084104 (0.0009) [2023-12-26 08:14:50,933][123090] Updated weights for policy 1, policy_version 1076451 (0.0010) [2023-12-26 08:14:51,005][123090] Updated weights for policy 1, policy_version 1076461 (0.0011) [2023-12-26 08:14:51,079][123090] Updated weights for policy 1, policy_version 1076471 (0.0011) [2023-12-26 08:14:51,127][123091] Updated weights for policy 0, policy_version 1084114 (0.0008) [2023-12-26 08:14:51,185][123091] Updated weights for policy 0, policy_version 1084124 (0.0008) [2023-12-26 08:14:51,239][123091] Updated weights for policy 0, policy_version 1084134 (0.0008) [2023-12-26 08:14:51,304][123091] Updated weights for policy 0, policy_version 1084144 (0.0008) [2023-12-26 08:14:51,893][123090] Updated weights for policy 1, policy_version 1076481 (0.0011) [2023-12-26 08:14:51,953][123090] Updated weights for policy 1, policy_version 1076491 (0.0010) [2023-12-26 08:14:52,013][123090] Updated weights for policy 1, policy_version 1076501 (0.0011) [2023-12-26 08:14:52,069][123090] Updated weights for policy 1, policy_version 1076511 (0.0010) [2023-12-26 08:14:52,150][123091] Updated weights for policy 0, policy_version 1084154 (0.0009) [2023-12-26 08:14:52,199][123091] Updated weights for policy 0, policy_version 1084164 (0.0009) [2023-12-26 08:14:52,259][123091] Updated weights for policy 0, policy_version 1084174 (0.0009) [2023-12-26 08:14:52,855][123090] Updated weights for policy 1, policy_version 1076521 (0.0006) [2023-12-26 08:14:52,902][123090] Updated weights for policy 1, policy_version 1076531 (0.0006) [2023-12-26 08:14:52,952][123090] Updated weights for policy 1, policy_version 1076541 (0.0005) [2023-12-26 08:14:53,137][123091] Updated weights for policy 0, policy_version 1084184 (0.0006) [2023-12-26 08:14:53,190][123091] Updated weights for policy 0, policy_version 1084194 (0.0005) [2023-12-26 08:14:53,251][123091] Updated weights for policy 0, policy_version 1084204 (0.0005) [2023-12-26 08:14:53,635][123090] Updated weights for policy 1, policy_version 1076551 (0.0006) [2023-12-26 08:14:53,697][123090] Updated weights for policy 1, policy_version 1076561 (0.0006) [2023-12-26 08:14:53,760][123090] Updated weights for policy 1, policy_version 1076571 (0.0009) [2023-12-26 08:14:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17633.6). Total num frames: 553156608. Throughput: 0: 8708.9, 1: 8763.3. Samples: 553137340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:53,785][121949] Avg episode reward: [(0, '6115.996'), (1, '5301.275')] [2023-12-26 08:14:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001084208_277561344.pth... [2023-12-26 08:14:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001076576_275603456.pth... [2023-12-26 08:14:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001083216_277307392.pth [2023-12-26 08:14:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001075520_275333120.pth [2023-12-26 08:14:53,948][123091] Updated weights for policy 0, policy_version 1084214 (0.0008) [2023-12-26 08:14:54,007][123091] Updated weights for policy 0, policy_version 1084224 (0.0010) [2023-12-26 08:14:54,070][123091] Updated weights for policy 0, policy_version 1084234 (0.0010) [2023-12-26 08:14:54,456][123090] Updated weights for policy 1, policy_version 1076581 (0.0011) [2023-12-26 08:14:54,520][123090] Updated weights for policy 1, policy_version 1076591 (0.0010) [2023-12-26 08:14:54,564][123090] Updated weights for policy 1, policy_version 1076601 (0.0010) [2023-12-26 08:14:54,895][123091] Updated weights for policy 0, policy_version 1084244 (0.0009) [2023-12-26 08:14:54,950][123091] Updated weights for policy 0, policy_version 1084255 (0.0009) [2023-12-26 08:14:55,018][123091] Updated weights for policy 0, policy_version 1084265 (0.0010) [2023-12-26 08:14:55,345][123090] Updated weights for policy 1, policy_version 1076611 (0.0006) [2023-12-26 08:14:55,400][123090] Updated weights for policy 1, policy_version 1076621 (0.0005) [2023-12-26 08:14:55,451][123090] Updated weights for policy 1, policy_version 1076631 (0.0005) [2023-12-26 08:14:55,943][123091] Updated weights for policy 0, policy_version 1084275 (0.0010) [2023-12-26 08:14:55,998][123091] Updated weights for policy 0, policy_version 1084285 (0.0011) [2023-12-26 08:14:56,052][123091] Updated weights for policy 0, policy_version 1084297 (0.0011) [2023-12-26 08:14:56,122][123090] Updated weights for policy 1, policy_version 1076641 (0.0005) [2023-12-26 08:14:56,169][123090] Updated weights for policy 1, policy_version 1076651 (0.0005) [2023-12-26 08:14:56,227][123090] Updated weights for policy 1, policy_version 1076661 (0.0005) [2023-12-26 08:14:56,288][123090] Updated weights for policy 1, policy_version 1076671 (0.0005) [2023-12-26 08:14:56,842][123091] Updated weights for policy 0, policy_version 1084307 (0.0009) [2023-12-26 08:14:56,894][123091] Updated weights for policy 0, policy_version 1084317 (0.0009) [2023-12-26 08:14:56,956][123091] Updated weights for policy 0, policy_version 1084327 (0.0006) [2023-12-26 08:14:57,007][123090] Updated weights for policy 1, policy_version 1076681 (0.0010) [2023-12-26 08:14:57,058][123090] Updated weights for policy 1, policy_version 1076691 (0.0010) [2023-12-26 08:14:57,109][123090] Updated weights for policy 1, policy_version 1076701 (0.0010) [2023-12-26 08:14:57,740][123091] Updated weights for policy 0, policy_version 1084337 (0.0005) [2023-12-26 08:14:57,803][123091] Updated weights for policy 0, policy_version 1084347 (0.0005) [2023-12-26 08:14:57,872][123091] Updated weights for policy 0, policy_version 1084357 (0.0005) [2023-12-26 08:14:57,882][123090] Updated weights for policy 1, policy_version 1076711 (0.0007) [2023-12-26 08:14:57,918][123091] Updated weights for policy 0, policy_version 1084367 (0.0005) [2023-12-26 08:14:57,953][123090] Updated weights for policy 1, policy_version 1076721 (0.0008) [2023-12-26 08:14:58,019][123090] Updated weights for policy 1, policy_version 1076731 (0.0010) [2023-12-26 08:14:58,643][123091] Updated weights for policy 0, policy_version 1084377 (0.0008) [2023-12-26 08:14:58,712][123091] Updated weights for policy 0, policy_version 1084387 (0.0008) [2023-12-26 08:14:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 553246720. Throughput: 0: 8673.5, 1: 8886.6. Samples: 553246844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:14:58,785][121949] Avg episode reward: [(0, '6093.877'), (1, '5032.469')] [2023-12-26 08:14:58,785][123091] Updated weights for policy 0, policy_version 1084397 (0.0008) [2023-12-26 08:14:58,862][123090] Updated weights for policy 1, policy_version 1076741 (0.0010) [2023-12-26 08:14:58,923][123090] Updated weights for policy 1, policy_version 1076751 (0.0006) [2023-12-26 08:14:58,992][123090] Updated weights for policy 1, policy_version 1076761 (0.0007) [2023-12-26 08:14:59,651][123091] Updated weights for policy 0, policy_version 1084407 (0.0006) [2023-12-26 08:14:59,717][123091] Updated weights for policy 0, policy_version 1084417 (0.0005) [2023-12-26 08:14:59,745][123090] Updated weights for policy 1, policy_version 1076771 (0.0008) [2023-12-26 08:14:59,778][123091] Updated weights for policy 0, policy_version 1084427 (0.0007) [2023-12-26 08:14:59,801][123090] Updated weights for policy 1, policy_version 1076781 (0.0009) [2023-12-26 08:14:59,866][123090] Updated weights for policy 1, policy_version 1076791 (0.0007) [2023-12-26 08:15:00,465][123091] Updated weights for policy 0, policy_version 1084437 (0.0008) [2023-12-26 08:15:00,513][123091] Updated weights for policy 0, policy_version 1084447 (0.0005) [2023-12-26 08:15:00,565][123091] Updated weights for policy 0, policy_version 1084457 (0.0005) [2023-12-26 08:15:00,658][123090] Updated weights for policy 1, policy_version 1076801 (0.0007) [2023-12-26 08:15:00,719][123090] Updated weights for policy 1, policy_version 1076811 (0.0005) [2023-12-26 08:15:00,784][123090] Updated weights for policy 1, policy_version 1076821 (0.0005) [2023-12-26 08:15:00,831][123090] Updated weights for policy 1, policy_version 1076831 (0.0005) [2023-12-26 08:15:01,332][123091] Updated weights for policy 0, policy_version 1084467 (0.0007) [2023-12-26 08:15:01,408][123091] Updated weights for policy 0, policy_version 1084477 (0.0009) [2023-12-26 08:15:01,470][123091] Updated weights for policy 0, policy_version 1084487 (0.0010) [2023-12-26 08:15:01,602][123090] Updated weights for policy 1, policy_version 1076841 (0.0009) [2023-12-26 08:15:01,664][123090] Updated weights for policy 1, policy_version 1076851 (0.0009) [2023-12-26 08:15:01,739][123090] Updated weights for policy 1, policy_version 1076861 (0.0009) [2023-12-26 08:15:02,308][123091] Updated weights for policy 0, policy_version 1084497 (0.0009) [2023-12-26 08:15:02,372][123091] Updated weights for policy 0, policy_version 1084507 (0.0007) [2023-12-26 08:15:02,444][123091] Updated weights for policy 0, policy_version 1084517 (0.0007) [2023-12-26 08:15:02,510][123091] Updated weights for policy 0, policy_version 1084527 (0.0009) [2023-12-26 08:15:02,581][123090] Updated weights for policy 1, policy_version 1076871 (0.0010) [2023-12-26 08:15:02,632][123090] Updated weights for policy 1, policy_version 1076881 (0.0009) [2023-12-26 08:15:02,685][123090] Updated weights for policy 1, policy_version 1076891 (0.0009) [2023-12-26 08:15:03,317][123091] Updated weights for policy 0, policy_version 1084537 (0.0010) [2023-12-26 08:15:03,365][123091] Updated weights for policy 0, policy_version 1084547 (0.0010) [2023-12-26 08:15:03,395][123090] Updated weights for policy 1, policy_version 1076901 (0.0007) [2023-12-26 08:15:03,417][123091] Updated weights for policy 0, policy_version 1084557 (0.0010) [2023-12-26 08:15:03,442][123090] Updated weights for policy 1, policy_version 1076911 (0.0005) [2023-12-26 08:15:03,490][123090] Updated weights for policy 1, policy_version 1076921 (0.0005) [2023-12-26 08:15:03,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 553345024. Throughput: 0: 8689.3, 1: 8955.7. Samples: 553353304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:03,785][121949] Avg episode reward: [(0, '6116.723'), (1, '4837.691')] [2023-12-26 08:15:04,177][123090] Updated weights for policy 1, policy_version 1076931 (0.0005) [2023-12-26 08:15:04,198][123091] Updated weights for policy 0, policy_version 1084567 (0.0008) [2023-12-26 08:15:04,244][123090] Updated weights for policy 1, policy_version 1076941 (0.0007) [2023-12-26 08:15:04,259][123091] Updated weights for policy 0, policy_version 1084577 (0.0009) [2023-12-26 08:15:04,303][123090] Updated weights for policy 1, policy_version 1076951 (0.0006) [2023-12-26 08:15:04,319][123091] Updated weights for policy 0, policy_version 1084587 (0.0010) [2023-12-26 08:15:05,104][123090] Updated weights for policy 1, policy_version 1076961 (0.0006) [2023-12-26 08:15:05,133][123091] Updated weights for policy 0, policy_version 1084597 (0.0008) [2023-12-26 08:15:05,165][123090] Updated weights for policy 1, policy_version 1076971 (0.0011) [2023-12-26 08:15:05,192][123091] Updated weights for policy 0, policy_version 1084607 (0.0006) [2023-12-26 08:15:05,229][123090] Updated weights for policy 1, policy_version 1076981 (0.0011) [2023-12-26 08:15:05,270][123091] Updated weights for policy 0, policy_version 1084617 (0.0006) [2023-12-26 08:15:05,285][123090] Updated weights for policy 1, policy_version 1076991 (0.0010) [2023-12-26 08:15:06,003][123091] Updated weights for policy 0, policy_version 1084627 (0.0008) [2023-12-26 08:15:06,069][123091] Updated weights for policy 0, policy_version 1084637 (0.0008) [2023-12-26 08:15:06,098][123090] Updated weights for policy 1, policy_version 1077001 (0.0006) [2023-12-26 08:15:06,137][123091] Updated weights for policy 0, policy_version 1084647 (0.0008) [2023-12-26 08:15:06,166][123090] Updated weights for policy 1, policy_version 1077011 (0.0007) [2023-12-26 08:15:06,235][123090] Updated weights for policy 1, policy_version 1077021 (0.0009) [2023-12-26 08:15:06,890][123091] Updated weights for policy 0, policy_version 1084657 (0.0006) [2023-12-26 08:15:06,947][123091] Updated weights for policy 0, policy_version 1084667 (0.0006) [2023-12-26 08:15:06,985][123090] Updated weights for policy 1, policy_version 1077031 (0.0007) [2023-12-26 08:15:07,007][123091] Updated weights for policy 0, policy_version 1084677 (0.0007) [2023-12-26 08:15:07,052][123090] Updated weights for policy 1, policy_version 1077041 (0.0011) [2023-12-26 08:15:07,064][123091] Updated weights for policy 0, policy_version 1084687 (0.0007) [2023-12-26 08:15:07,119][123090] Updated weights for policy 1, policy_version 1077051 (0.0011) [2023-12-26 08:15:07,809][123090] Updated weights for policy 1, policy_version 1077061 (0.0008) [2023-12-26 08:15:07,862][123090] Updated weights for policy 1, policy_version 1077071 (0.0005) [2023-12-26 08:15:07,922][123090] Updated weights for policy 1, policy_version 1077081 (0.0006) [2023-12-26 08:15:07,948][123091] Updated weights for policy 0, policy_version 1084697 (0.0005) [2023-12-26 08:15:08,018][123091] Updated weights for policy 0, policy_version 1084707 (0.0006) [2023-12-26 08:15:08,085][123091] Updated weights for policy 0, policy_version 1084717 (0.0005) [2023-12-26 08:15:08,755][123090] Updated weights for policy 1, policy_version 1077091 (0.0008) [2023-12-26 08:15:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 553426944. Throughput: 0: 8732.9, 1: 9007.0. Samples: 553407672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:08,785][121949] Avg episode reward: [(0, '6065.089'), (1, '4984.351')] [2023-12-26 08:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001084720_277692416.pth... [2023-12-26 08:15:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001083696_277430272.pth [2023-12-26 08:15:08,811][123090] Updated weights for policy 1, policy_version 1077101 (0.0009) [2023-12-26 08:15:08,861][123091] Updated weights for policy 0, policy_version 1084727 (0.0011) [2023-12-26 08:15:08,870][123090] Updated weights for policy 1, policy_version 1077111 (0.0010) [2023-12-26 08:15:08,920][123091] Updated weights for policy 0, policy_version 1084737 (0.0011) [2023-12-26 08:15:08,925][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001077120_275742720.pth... [2023-12-26 08:15:08,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001076064_275472384.pth [2023-12-26 08:15:08,990][123091] Updated weights for policy 0, policy_version 1084747 (0.0011) [2023-12-26 08:15:09,766][123090] Updated weights for policy 1, policy_version 1077121 (0.0010) [2023-12-26 08:15:09,789][123091] Updated weights for policy 0, policy_version 1084757 (0.0009) [2023-12-26 08:15:09,839][123090] Updated weights for policy 1, policy_version 1077131 (0.0008) [2023-12-26 08:15:09,863][123091] Updated weights for policy 0, policy_version 1084767 (0.0008) [2023-12-26 08:15:09,901][123090] Updated weights for policy 1, policy_version 1077141 (0.0008) [2023-12-26 08:15:09,927][123091] Updated weights for policy 0, policy_version 1084777 (0.0008) [2023-12-26 08:15:09,959][123090] Updated weights for policy 1, policy_version 1077151 (0.0009) [2023-12-26 08:15:10,660][123090] Updated weights for policy 1, policy_version 1077161 (0.0005) [2023-12-26 08:15:10,730][123090] Updated weights for policy 1, policy_version 1077171 (0.0006) [2023-12-26 08:15:10,752][123091] Updated weights for policy 0, policy_version 1084787 (0.0008) [2023-12-26 08:15:10,804][123090] Updated weights for policy 1, policy_version 1077181 (0.0005) [2023-12-26 08:15:10,825][123091] Updated weights for policy 0, policy_version 1084797 (0.0005) [2023-12-26 08:15:10,887][123091] Updated weights for policy 0, policy_version 1084807 (0.0006) [2023-12-26 08:15:11,506][123090] Updated weights for policy 1, policy_version 1077191 (0.0009) [2023-12-26 08:15:11,579][123090] Updated weights for policy 1, policy_version 1077201 (0.0010) [2023-12-26 08:15:11,648][123090] Updated weights for policy 1, policy_version 1077211 (0.0009) [2023-12-26 08:15:11,673][123091] Updated weights for policy 0, policy_version 1084817 (0.0006) [2023-12-26 08:15:11,749][123091] Updated weights for policy 0, policy_version 1084827 (0.0009) [2023-12-26 08:15:11,810][123091] Updated weights for policy 0, policy_version 1084837 (0.0009) [2023-12-26 08:15:11,869][123091] Updated weights for policy 0, policy_version 1084847 (0.0010) [2023-12-26 08:15:12,512][123090] Updated weights for policy 1, policy_version 1077221 (0.0008) [2023-12-26 08:15:12,574][123090] Updated weights for policy 1, policy_version 1077231 (0.0009) [2023-12-26 08:15:12,640][123090] Updated weights for policy 1, policy_version 1077241 (0.0009) [2023-12-26 08:15:12,653][123091] Updated weights for policy 0, policy_version 1084857 (0.0009) [2023-12-26 08:15:12,716][123091] Updated weights for policy 0, policy_version 1084867 (0.0009) [2023-12-26 08:15:12,790][123091] Updated weights for policy 0, policy_version 1084877 (0.0009) [2023-12-26 08:15:13,471][123090] Updated weights for policy 1, policy_version 1077251 (0.0010) [2023-12-26 08:15:13,535][123090] Updated weights for policy 1, policy_version 1077261 (0.0010) [2023-12-26 08:15:13,590][123090] Updated weights for policy 1, policy_version 1077271 (0.0009) [2023-12-26 08:15:13,620][123091] Updated weights for policy 0, policy_version 1084887 (0.0008) [2023-12-26 08:15:13,675][123091] Updated weights for policy 0, policy_version 1084897 (0.0009) [2023-12-26 08:15:13,736][123091] Updated weights for policy 0, policy_version 1084907 (0.0010) [2023-12-26 08:15:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 553525248. Throughput: 0: 8752.2, 1: 8963.8. Samples: 553514028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:13,784][121949] Avg episode reward: [(0, '6106.096'), (1, '5315.101')] [2023-12-26 08:15:14,409][123090] Updated weights for policy 1, policy_version 1077281 (0.0010) [2023-12-26 08:15:14,503][123090] Updated weights for policy 1, policy_version 1077291 (0.0010) [2023-12-26 08:15:14,557][123090] Updated weights for policy 1, policy_version 1077301 (0.0009) [2023-12-26 08:15:14,591][123091] Updated weights for policy 0, policy_version 1084917 (0.0009) [2023-12-26 08:15:14,610][123090] Updated weights for policy 1, policy_version 1077311 (0.0010) [2023-12-26 08:15:14,654][123091] Updated weights for policy 0, policy_version 1084927 (0.0008) [2023-12-26 08:15:14,715][123091] Updated weights for policy 0, policy_version 1084937 (0.0009) [2023-12-26 08:15:15,421][123090] Updated weights for policy 1, policy_version 1077321 (0.0009) [2023-12-26 08:15:15,470][123090] Updated weights for policy 1, policy_version 1077331 (0.0009) [2023-12-26 08:15:15,526][123090] Updated weights for policy 1, policy_version 1077341 (0.0009) [2023-12-26 08:15:15,569][123091] Updated weights for policy 0, policy_version 1084947 (0.0010) [2023-12-26 08:15:15,627][123091] Updated weights for policy 0, policy_version 1084957 (0.0010) [2023-12-26 08:15:15,681][123091] Updated weights for policy 0, policy_version 1084967 (0.0009) [2023-12-26 08:15:16,365][123090] Updated weights for policy 1, policy_version 1077351 (0.0010) [2023-12-26 08:15:16,431][123090] Updated weights for policy 1, policy_version 1077361 (0.0009) [2023-12-26 08:15:16,488][123090] Updated weights for policy 1, policy_version 1077371 (0.0009) [2023-12-26 08:15:16,517][123091] Updated weights for policy 0, policy_version 1084977 (0.0009) [2023-12-26 08:15:16,576][123091] Updated weights for policy 0, policy_version 1084987 (0.0008) [2023-12-26 08:15:16,634][123091] Updated weights for policy 0, policy_version 1084997 (0.0009) [2023-12-26 08:15:16,701][123091] Updated weights for policy 0, policy_version 1085007 (0.0009) [2023-12-26 08:15:17,321][123090] Updated weights for policy 1, policy_version 1077381 (0.0009) [2023-12-26 08:15:17,385][123090] Updated weights for policy 1, policy_version 1077391 (0.0008) [2023-12-26 08:15:17,441][123090] Updated weights for policy 1, policy_version 1077401 (0.0009) [2023-12-26 08:15:17,526][123091] Updated weights for policy 0, policy_version 1085017 (0.0009) [2023-12-26 08:15:17,587][123091] Updated weights for policy 0, policy_version 1085027 (0.0010) [2023-12-26 08:15:17,644][123091] Updated weights for policy 0, policy_version 1085037 (0.0009) [2023-12-26 08:15:18,259][123090] Updated weights for policy 1, policy_version 1077411 (0.0010) [2023-12-26 08:15:18,328][123090] Updated weights for policy 1, policy_version 1077421 (0.0010) [2023-12-26 08:15:18,390][123090] Updated weights for policy 1, policy_version 1077431 (0.0009) [2023-12-26 08:15:18,458][123091] Updated weights for policy 0, policy_version 1085047 (0.0008) [2023-12-26 08:15:18,525][123091] Updated weights for policy 0, policy_version 1085057 (0.0007) [2023-12-26 08:15:18,596][123091] Updated weights for policy 0, policy_version 1085067 (0.0006) [2023-12-26 08:15:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 553607168. Throughput: 0: 8729.7, 1: 8896.0. Samples: 553615056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:18,785][121949] Avg episode reward: [(0, '6146.734'), (1, '5421.589')] [2023-12-26 08:15:19,290][123090] Updated weights for policy 1, policy_version 1077441 (0.0009) [2023-12-26 08:15:19,365][123090] Updated weights for policy 1, policy_version 1077451 (0.0009) [2023-12-26 08:15:19,384][123091] Updated weights for policy 0, policy_version 1085077 (0.0008) [2023-12-26 08:15:19,430][123090] Updated weights for policy 1, policy_version 1077461 (0.0007) [2023-12-26 08:15:19,449][123091] Updated weights for policy 0, policy_version 1085087 (0.0010) [2023-12-26 08:15:19,503][123090] Updated weights for policy 1, policy_version 1077471 (0.0008) [2023-12-26 08:15:19,516][123091] Updated weights for policy 0, policy_version 1085097 (0.0008) [2023-12-26 08:15:20,347][123090] Updated weights for policy 1, policy_version 1077481 (0.0007) [2023-12-26 08:15:20,424][123091] Updated weights for policy 0, policy_version 1085107 (0.0009) [2023-12-26 08:15:20,426][123090] Updated weights for policy 1, policy_version 1077491 (0.0006) [2023-12-26 08:15:20,491][123091] Updated weights for policy 0, policy_version 1085117 (0.0008) [2023-12-26 08:15:20,503][123090] Updated weights for policy 1, policy_version 1077501 (0.0006) [2023-12-26 08:15:20,562][123091] Updated weights for policy 0, policy_version 1085127 (0.0010) [2023-12-26 08:15:21,288][123090] Updated weights for policy 1, policy_version 1077511 (0.0008) [2023-12-26 08:15:21,357][123090] Updated weights for policy 1, policy_version 1077521 (0.0008) [2023-12-26 08:15:21,438][123090] Updated weights for policy 1, policy_version 1077531 (0.0008) [2023-12-26 08:15:21,497][123091] Updated weights for policy 0, policy_version 1085137 (0.0009) [2023-12-26 08:15:21,567][123091] Updated weights for policy 0, policy_version 1085147 (0.0010) [2023-12-26 08:15:21,642][123091] Updated weights for policy 0, policy_version 1085157 (0.0010) [2023-12-26 08:15:21,714][123091] Updated weights for policy 0, policy_version 1085167 (0.0009) [2023-12-26 08:15:22,279][123090] Updated weights for policy 1, policy_version 1077541 (0.0010) [2023-12-26 08:15:22,353][123090] Updated weights for policy 1, policy_version 1077551 (0.0006) [2023-12-26 08:15:22,430][123090] Updated weights for policy 1, policy_version 1077561 (0.0009) [2023-12-26 08:15:22,584][123091] Updated weights for policy 0, policy_version 1085177 (0.0007) [2023-12-26 08:15:22,659][123091] Updated weights for policy 0, policy_version 1085187 (0.0006) [2023-12-26 08:15:22,728][123091] Updated weights for policy 0, policy_version 1085197 (0.0007) [2023-12-26 08:15:23,290][123090] Updated weights for policy 1, policy_version 1077571 (0.0009) [2023-12-26 08:15:23,355][123090] Updated weights for policy 1, policy_version 1077581 (0.0009) [2023-12-26 08:15:23,401][123091] Updated weights for policy 0, policy_version 1085207 (0.0008) [2023-12-26 08:15:23,418][123090] Updated weights for policy 1, policy_version 1077591 (0.0007) [2023-12-26 08:15:23,460][123091] Updated weights for policy 0, policy_version 1085217 (0.0008) [2023-12-26 08:15:23,518][123091] Updated weights for policy 0, policy_version 1085227 (0.0007) [2023-12-26 08:15:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17613.0, 300 sec: 17633.6). Total num frames: 553689088. Throughput: 0: 8693.7, 1: 8820.6. Samples: 553664032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:23,785][121949] Avg episode reward: [(0, '6152.343'), (1, '5300.000')] [2023-12-26 08:15:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001085232_277823488.pth... [2023-12-26 08:15:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001077600_275865600.pth... [2023-12-26 08:15:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001076576_275603456.pth [2023-12-26 08:15:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001084208_277561344.pth [2023-12-26 08:15:24,240][123090] Updated weights for policy 1, policy_version 1077601 (0.0009) [2023-12-26 08:15:24,304][123090] Updated weights for policy 1, policy_version 1077611 (0.0010) [2023-12-26 08:15:24,319][123091] Updated weights for policy 0, policy_version 1085237 (0.0009) [2023-12-26 08:15:24,368][123090] Updated weights for policy 1, policy_version 1077621 (0.0009) [2023-12-26 08:15:24,383][123091] Updated weights for policy 0, policy_version 1085247 (0.0007) [2023-12-26 08:15:24,435][123090] Updated weights for policy 1, policy_version 1077631 (0.0009) [2023-12-26 08:15:24,440][123091] Updated weights for policy 0, policy_version 1085257 (0.0007) [2023-12-26 08:15:25,213][123090] Updated weights for policy 1, policy_version 1077641 (0.0009) [2023-12-26 08:15:25,225][123091] Updated weights for policy 0, policy_version 1085267 (0.0009) [2023-12-26 08:15:25,275][123090] Updated weights for policy 1, policy_version 1077651 (0.0008) [2023-12-26 08:15:25,287][123091] Updated weights for policy 0, policy_version 1085277 (0.0007) [2023-12-26 08:15:25,340][123090] Updated weights for policy 1, policy_version 1077661 (0.0010) [2023-12-26 08:15:25,352][123091] Updated weights for policy 0, policy_version 1085287 (0.0007) [2023-12-26 08:15:26,117][123091] Updated weights for policy 0, policy_version 1085297 (0.0009) [2023-12-26 08:15:26,174][123091] Updated weights for policy 0, policy_version 1085307 (0.0006) [2023-12-26 08:15:26,201][123090] Updated weights for policy 1, policy_version 1077671 (0.0009) [2023-12-26 08:15:26,224][123091] Updated weights for policy 0, policy_version 1085317 (0.0008) [2023-12-26 08:15:26,269][123090] Updated weights for policy 1, policy_version 1077681 (0.0008) [2023-12-26 08:15:26,275][123091] Updated weights for policy 0, policy_version 1085327 (0.0009) [2023-12-26 08:15:26,333][123090] Updated weights for policy 1, policy_version 1077691 (0.0009) [2023-12-26 08:15:26,967][123091] Updated weights for policy 0, policy_version 1085337 (0.0006) [2023-12-26 08:15:27,029][123091] Updated weights for policy 0, policy_version 1085347 (0.0006) [2023-12-26 08:15:27,092][123091] Updated weights for policy 0, policy_version 1085357 (0.0008) [2023-12-26 08:15:27,141][123090] Updated weights for policy 1, policy_version 1077701 (0.0009) [2023-12-26 08:15:27,211][123090] Updated weights for policy 1, policy_version 1077711 (0.0005) [2023-12-26 08:15:27,280][123090] Updated weights for policy 1, policy_version 1077721 (0.0006) [2023-12-26 08:15:27,938][123091] Updated weights for policy 0, policy_version 1085367 (0.0009) [2023-12-26 08:15:27,961][123090] Updated weights for policy 1, policy_version 1077731 (0.0009) [2023-12-26 08:15:27,986][123091] Updated weights for policy 0, policy_version 1085377 (0.0007) [2023-12-26 08:15:28,009][123090] Updated weights for policy 1, policy_version 1077741 (0.0008) [2023-12-26 08:15:28,037][123091] Updated weights for policy 0, policy_version 1085387 (0.0007) [2023-12-26 08:15:28,060][123090] Updated weights for policy 1, policy_version 1077751 (0.0008) [2023-12-26 08:15:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 553771008. Throughput: 0: 8776.1, 1: 8808.3. Samples: 553768828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:28,784][121949] Avg episode reward: [(0, '6231.544'), (1, '5262.434')] [2023-12-26 08:15:28,881][123090] Updated weights for policy 1, policy_version 1077761 (0.0009) [2023-12-26 08:15:28,918][123091] Updated weights for policy 0, policy_version 1085397 (0.0008) [2023-12-26 08:15:28,946][123090] Updated weights for policy 1, policy_version 1077771 (0.0008) [2023-12-26 08:15:28,980][123091] Updated weights for policy 0, policy_version 1085407 (0.0008) [2023-12-26 08:15:29,005][123090] Updated weights for policy 1, policy_version 1077781 (0.0008) [2023-12-26 08:15:29,039][123091] Updated weights for policy 0, policy_version 1085417 (0.0008) [2023-12-26 08:15:29,060][123090] Updated weights for policy 1, policy_version 1077791 (0.0009) [2023-12-26 08:15:29,798][123090] Updated weights for policy 1, policy_version 1077801 (0.0008) [2023-12-26 08:15:29,869][123090] Updated weights for policy 1, policy_version 1077811 (0.0008) [2023-12-26 08:15:29,920][123091] Updated weights for policy 0, policy_version 1085427 (0.0008) [2023-12-26 08:15:29,938][123090] Updated weights for policy 1, policy_version 1077821 (0.0008) [2023-12-26 08:15:29,987][123091] Updated weights for policy 0, policy_version 1085437 (0.0008) [2023-12-26 08:15:30,043][123091] Updated weights for policy 0, policy_version 1085447 (0.0010) [2023-12-26 08:15:30,705][123090] Updated weights for policy 1, policy_version 1077831 (0.0010) [2023-12-26 08:15:30,763][123090] Updated weights for policy 1, policy_version 1077841 (0.0009) [2023-12-26 08:15:30,817][123090] Updated weights for policy 1, policy_version 1077851 (0.0008) [2023-12-26 08:15:30,868][123091] Updated weights for policy 0, policy_version 1085457 (0.0009) [2023-12-26 08:15:30,929][123091] Updated weights for policy 0, policy_version 1085467 (0.0008) [2023-12-26 08:15:30,981][123091] Updated weights for policy 0, policy_version 1085477 (0.0009) [2023-12-26 08:15:31,033][123091] Updated weights for policy 0, policy_version 1085487 (0.0010) [2023-12-26 08:15:31,593][123090] Updated weights for policy 1, policy_version 1077861 (0.0008) [2023-12-26 08:15:31,660][123090] Updated weights for policy 1, policy_version 1077871 (0.0008) [2023-12-26 08:15:31,726][123090] Updated weights for policy 1, policy_version 1077881 (0.0010) [2023-12-26 08:15:31,885][123091] Updated weights for policy 0, policy_version 1085497 (0.0006) [2023-12-26 08:15:31,957][123091] Updated weights for policy 0, policy_version 1085507 (0.0006) [2023-12-26 08:15:32,018][123091] Updated weights for policy 0, policy_version 1085517 (0.0006) [2023-12-26 08:15:32,534][123090] Updated weights for policy 1, policy_version 1077891 (0.0009) [2023-12-26 08:15:32,583][123090] Updated weights for policy 1, policy_version 1077901 (0.0009) [2023-12-26 08:15:32,643][123090] Updated weights for policy 1, policy_version 1077911 (0.0006) [2023-12-26 08:15:32,778][123091] Updated weights for policy 0, policy_version 1085527 (0.0009) [2023-12-26 08:15:32,836][123091] Updated weights for policy 0, policy_version 1085537 (0.0010) [2023-12-26 08:15:32,899][123091] Updated weights for policy 0, policy_version 1085548 (0.0010) [2023-12-26 08:15:33,428][123090] Updated weights for policy 1, policy_version 1077921 (0.0006) [2023-12-26 08:15:33,489][123090] Updated weights for policy 1, policy_version 1077931 (0.0010) [2023-12-26 08:15:33,551][123090] Updated weights for policy 1, policy_version 1077941 (0.0010) [2023-12-26 08:15:33,614][123090] Updated weights for policy 1, policy_version 1077951 (0.0010) [2023-12-26 08:15:33,749][123091] Updated weights for policy 0, policy_version 1085558 (0.0009) [2023-12-26 08:15:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 553861120. Throughput: 0: 8653.9, 1: 8861.6. Samples: 553873500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:33,784][121949] Avg episode reward: [(0, '6165.936'), (1, '5152.125')] [2023-12-26 08:15:33,801][123091] Updated weights for policy 0, policy_version 1085568 (0.0009) [2023-12-26 08:15:33,854][123091] Updated weights for policy 0, policy_version 1085579 (0.0010) [2023-12-26 08:15:34,443][123090] Updated weights for policy 1, policy_version 1077961 (0.0011) [2023-12-26 08:15:34,510][123090] Updated weights for policy 1, policy_version 1077971 (0.0011) [2023-12-26 08:15:34,578][123090] Updated weights for policy 1, policy_version 1077981 (0.0011) [2023-12-26 08:15:34,733][123091] Updated weights for policy 0, policy_version 1085590 (0.0009) [2023-12-26 08:15:34,799][123091] Updated weights for policy 0, policy_version 1085600 (0.0010) [2023-12-26 08:15:34,858][123091] Updated weights for policy 0, policy_version 1085610 (0.0010) [2023-12-26 08:15:35,297][123090] Updated weights for policy 1, policy_version 1077991 (0.0010) [2023-12-26 08:15:35,353][123090] Updated weights for policy 1, policy_version 1078001 (0.0008) [2023-12-26 08:15:35,421][123090] Updated weights for policy 1, policy_version 1078011 (0.0008) [2023-12-26 08:15:35,668][123091] Updated weights for policy 0, policy_version 1085620 (0.0009) [2023-12-26 08:15:35,735][123091] Updated weights for policy 0, policy_version 1085630 (0.0008) [2023-12-26 08:15:35,803][123091] Updated weights for policy 0, policy_version 1085640 (0.0005) [2023-12-26 08:15:36,136][123090] Updated weights for policy 1, policy_version 1078021 (0.0007) [2023-12-26 08:15:36,209][123090] Updated weights for policy 1, policy_version 1078031 (0.0011) [2023-12-26 08:15:36,276][123090] Updated weights for policy 1, policy_version 1078041 (0.0008) [2023-12-26 08:15:36,548][123091] Updated weights for policy 0, policy_version 1085650 (0.0006) [2023-12-26 08:15:36,615][123091] Updated weights for policy 0, policy_version 1085660 (0.0009) [2023-12-26 08:15:36,683][123091] Updated weights for policy 0, policy_version 1085670 (0.0009) [2023-12-26 08:15:36,744][123091] Updated weights for policy 0, policy_version 1085680 (0.0009) [2023-12-26 08:15:37,115][123090] Updated weights for policy 1, policy_version 1078051 (0.0010) [2023-12-26 08:15:37,164][123090] Updated weights for policy 1, policy_version 1078061 (0.0010) [2023-12-26 08:15:37,216][123090] Updated weights for policy 1, policy_version 1078071 (0.0010) [2023-12-26 08:15:37,536][123091] Updated weights for policy 0, policy_version 1085690 (0.0011) [2023-12-26 08:15:37,599][123091] Updated weights for policy 0, policy_version 1085700 (0.0011) [2023-12-26 08:15:37,669][123091] Updated weights for policy 0, policy_version 1085710 (0.0011) [2023-12-26 08:15:38,050][123090] Updated weights for policy 1, policy_version 1078081 (0.0010) [2023-12-26 08:15:38,109][123090] Updated weights for policy 1, policy_version 1078091 (0.0010) [2023-12-26 08:15:38,167][123090] Updated weights for policy 1, policy_version 1078101 (0.0010) [2023-12-26 08:15:38,222][123090] Updated weights for policy 1, policy_version 1078111 (0.0010) [2023-12-26 08:15:38,478][123091] Updated weights for policy 0, policy_version 1085720 (0.0010) [2023-12-26 08:15:38,526][123091] Updated weights for policy 0, policy_version 1085730 (0.0011) [2023-12-26 08:15:38,574][123091] Updated weights for policy 0, policy_version 1085740 (0.0010) [2023-12-26 08:15:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 553951232. Throughput: 0: 8666.8, 1: 8877.5. Samples: 553926832. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:38,784][121949] Avg episode reward: [(0, '6084.192'), (1, '5016.846')] [2023-12-26 08:15:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001085744_277954560.pth... [2023-12-26 08:15:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001078112_275996672.pth... [2023-12-26 08:15:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001084720_277692416.pth [2023-12-26 08:15:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001077120_275742720.pth [2023-12-26 08:15:39,077][123090] Updated weights for policy 1, policy_version 1078121 (0.0010) [2023-12-26 08:15:39,133][123090] Updated weights for policy 1, policy_version 1078131 (0.0010) [2023-12-26 08:15:39,193][123090] Updated weights for policy 1, policy_version 1078141 (0.0011) [2023-12-26 08:15:39,450][123091] Updated weights for policy 0, policy_version 1085750 (0.0010) [2023-12-26 08:15:39,521][123091] Updated weights for policy 0, policy_version 1085760 (0.0007) [2023-12-26 08:15:39,592][123091] Updated weights for policy 0, policy_version 1085770 (0.0008) [2023-12-26 08:15:40,062][123090] Updated weights for policy 1, policy_version 1078151 (0.0009) [2023-12-26 08:15:40,121][123090] Updated weights for policy 1, policy_version 1078161 (0.0009) [2023-12-26 08:15:40,176][123090] Updated weights for policy 1, policy_version 1078171 (0.0009) [2023-12-26 08:15:40,424][123091] Updated weights for policy 0, policy_version 1085780 (0.0008) [2023-12-26 08:15:40,484][123091] Updated weights for policy 0, policy_version 1085790 (0.0009) [2023-12-26 08:15:40,542][123091] Updated weights for policy 0, policy_version 1085800 (0.0010) [2023-12-26 08:15:41,027][123090] Updated weights for policy 1, policy_version 1078181 (0.0007) [2023-12-26 08:15:41,095][123090] Updated weights for policy 1, policy_version 1078191 (0.0006) [2023-12-26 08:15:41,168][123090] Updated weights for policy 1, policy_version 1078201 (0.0007) [2023-12-26 08:15:41,295][123091] Updated weights for policy 0, policy_version 1085810 (0.0009) [2023-12-26 08:15:41,368][123091] Updated weights for policy 0, policy_version 1085820 (0.0008) [2023-12-26 08:15:41,439][123091] Updated weights for policy 0, policy_version 1085830 (0.0009) [2023-12-26 08:15:41,508][123091] Updated weights for policy 0, policy_version 1085840 (0.0008) [2023-12-26 08:15:41,997][123090] Updated weights for policy 1, policy_version 1078211 (0.0009) [2023-12-26 08:15:42,067][123090] Updated weights for policy 1, policy_version 1078221 (0.0009) [2023-12-26 08:15:42,135][123090] Updated weights for policy 1, policy_version 1078231 (0.0009) [2023-12-26 08:15:42,329][123091] Updated weights for policy 0, policy_version 1085850 (0.0009) [2023-12-26 08:15:42,414][123091] Updated weights for policy 0, policy_version 1085860 (0.0008) [2023-12-26 08:15:42,483][123091] Updated weights for policy 0, policy_version 1085870 (0.0008) [2023-12-26 08:15:42,971][123090] Updated weights for policy 1, policy_version 1078241 (0.0008) [2023-12-26 08:15:43,044][123090] Updated weights for policy 1, policy_version 1078251 (0.0010) [2023-12-26 08:15:43,107][123090] Updated weights for policy 1, policy_version 1078261 (0.0010) [2023-12-26 08:15:43,174][123090] Updated weights for policy 1, policy_version 1078271 (0.0006) [2023-12-26 08:15:43,243][123091] Updated weights for policy 0, policy_version 1085880 (0.0008) [2023-12-26 08:15:43,298][123091] Updated weights for policy 0, policy_version 1085891 (0.0010) [2023-12-26 08:15:43,350][123091] Updated weights for policy 0, policy_version 1085901 (0.0009) [2023-12-26 08:15:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 554033152. Throughput: 0: 8647.7, 1: 8715.2. Samples: 554028172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:43,785][121949] Avg episode reward: [(0, '6078.666'), (1, '5097.659')] [2023-12-26 08:15:43,889][123090] Updated weights for policy 1, policy_version 1078281 (0.0010) [2023-12-26 08:15:43,941][123090] Updated weights for policy 1, policy_version 1078291 (0.0010) [2023-12-26 08:15:44,004][123090] Updated weights for policy 1, policy_version 1078301 (0.0010) [2023-12-26 08:15:44,205][123091] Updated weights for policy 0, policy_version 1085911 (0.0007) [2023-12-26 08:15:44,263][123091] Updated weights for policy 0, policy_version 1085921 (0.0010) [2023-12-26 08:15:44,313][123091] Updated weights for policy 0, policy_version 1085931 (0.0008) [2023-12-26 08:15:44,791][123090] Updated weights for policy 1, policy_version 1078311 (0.0008) [2023-12-26 08:15:44,862][123090] Updated weights for policy 1, policy_version 1078321 (0.0006) [2023-12-26 08:15:44,923][123090] Updated weights for policy 1, policy_version 1078331 (0.0011) [2023-12-26 08:15:45,069][123091] Updated weights for policy 0, policy_version 1085941 (0.0009) [2023-12-26 08:15:45,128][123091] Updated weights for policy 0, policy_version 1085951 (0.0009) [2023-12-26 08:15:45,195][123091] Updated weights for policy 0, policy_version 1085961 (0.0011) [2023-12-26 08:15:45,698][123090] Updated weights for policy 1, policy_version 1078341 (0.0008) [2023-12-26 08:15:45,771][123090] Updated weights for policy 1, policy_version 1078351 (0.0009) [2023-12-26 08:15:45,832][123090] Updated weights for policy 1, policy_version 1078361 (0.0011) [2023-12-26 08:15:46,009][123091] Updated weights for policy 0, policy_version 1085971 (0.0006) [2023-12-26 08:15:46,064][123091] Updated weights for policy 0, policy_version 1085981 (0.0008) [2023-12-26 08:15:46,126][123091] Updated weights for policy 0, policy_version 1085991 (0.0009) [2023-12-26 08:15:46,537][123090] Updated weights for policy 1, policy_version 1078371 (0.0009) [2023-12-26 08:15:46,605][123090] Updated weights for policy 1, policy_version 1078381 (0.0008) [2023-12-26 08:15:46,662][123090] Updated weights for policy 1, policy_version 1078391 (0.0011) [2023-12-26 08:15:46,923][123091] Updated weights for policy 0, policy_version 1086001 (0.0010) [2023-12-26 08:15:46,971][123091] Updated weights for policy 0, policy_version 1086011 (0.0005) [2023-12-26 08:15:47,030][123091] Updated weights for policy 0, policy_version 1086021 (0.0008) [2023-12-26 08:15:47,084][123091] Updated weights for policy 0, policy_version 1086031 (0.0010) [2023-12-26 08:15:47,508][123090] Updated weights for policy 1, policy_version 1078401 (0.0010) [2023-12-26 08:15:47,560][123090] Updated weights for policy 1, policy_version 1078411 (0.0005) [2023-12-26 08:15:47,616][123090] Updated weights for policy 1, policy_version 1078421 (0.0005) [2023-12-26 08:15:47,676][123090] Updated weights for policy 1, policy_version 1078432 (0.0007) [2023-12-26 08:15:47,791][123091] Updated weights for policy 0, policy_version 1086041 (0.0011) [2023-12-26 08:15:47,850][123091] Updated weights for policy 0, policy_version 1086051 (0.0010) [2023-12-26 08:15:47,898][123091] Updated weights for policy 0, policy_version 1086061 (0.0010) [2023-12-26 08:15:48,440][123090] Updated weights for policy 1, policy_version 1078442 (0.0010) [2023-12-26 08:15:48,506][123090] Updated weights for policy 1, policy_version 1078452 (0.0005) [2023-12-26 08:15:48,576][123090] Updated weights for policy 1, policy_version 1078462 (0.0008) [2023-12-26 08:15:48,762][123091] Updated weights for policy 0, policy_version 1086071 (0.0010) [2023-12-26 08:15:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 554123264. Throughput: 0: 8658.1, 1: 8745.5. Samples: 554136460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:48,784][121949] Avg episode reward: [(0, '6161.629'), (1, '5388.617')] [2023-12-26 08:15:48,828][123091] Updated weights for policy 0, policy_version 1086081 (0.0011) [2023-12-26 08:15:48,896][123091] Updated weights for policy 0, policy_version 1086091 (0.0011) [2023-12-26 08:15:49,386][123090] Updated weights for policy 1, policy_version 1078472 (0.0009) [2023-12-26 08:15:49,455][123090] Updated weights for policy 1, policy_version 1078482 (0.0009) [2023-12-26 08:15:49,504][123090] Updated weights for policy 1, policy_version 1078492 (0.0009) [2023-12-26 08:15:49,729][123091] Updated weights for policy 0, policy_version 1086101 (0.0011) [2023-12-26 08:15:49,792][123091] Updated weights for policy 0, policy_version 1086111 (0.0011) [2023-12-26 08:15:49,858][123091] Updated weights for policy 0, policy_version 1086121 (0.0011) [2023-12-26 08:15:50,333][123090] Updated weights for policy 1, policy_version 1078502 (0.0009) [2023-12-26 08:15:50,400][123090] Updated weights for policy 1, policy_version 1078512 (0.0010) [2023-12-26 08:15:50,463][123090] Updated weights for policy 1, policy_version 1078522 (0.0009) [2023-12-26 08:15:50,657][123091] Updated weights for policy 0, policy_version 1086131 (0.0010) [2023-12-26 08:15:50,724][123091] Updated weights for policy 0, policy_version 1086141 (0.0010) [2023-12-26 08:15:50,795][123091] Updated weights for policy 0, policy_version 1086151 (0.0010) [2023-12-26 08:15:51,261][123090] Updated weights for policy 1, policy_version 1078532 (0.0010) [2023-12-26 08:15:51,327][123090] Updated weights for policy 1, policy_version 1078542 (0.0008) [2023-12-26 08:15:51,406][123090] Updated weights for policy 1, policy_version 1078552 (0.0008) [2023-12-26 08:15:51,658][123091] Updated weights for policy 0, policy_version 1086161 (0.0010) [2023-12-26 08:15:51,732][123091] Updated weights for policy 0, policy_version 1086171 (0.0009) [2023-12-26 08:15:51,794][123091] Updated weights for policy 0, policy_version 1086181 (0.0010) [2023-12-26 08:15:51,860][123091] Updated weights for policy 0, policy_version 1086191 (0.0009) [2023-12-26 08:15:52,228][123090] Updated weights for policy 1, policy_version 1078562 (0.0008) [2023-12-26 08:15:52,294][123090] Updated weights for policy 1, policy_version 1078572 (0.0009) [2023-12-26 08:15:52,365][123090] Updated weights for policy 1, policy_version 1078582 (0.0010) [2023-12-26 08:15:52,434][123090] Updated weights for policy 1, policy_version 1078592 (0.0011) [2023-12-26 08:15:52,648][123091] Updated weights for policy 0, policy_version 1086201 (0.0009) [2023-12-26 08:15:52,718][123091] Updated weights for policy 0, policy_version 1086211 (0.0010) [2023-12-26 08:15:52,779][123091] Updated weights for policy 0, policy_version 1086221 (0.0009) [2023-12-26 08:15:53,195][123090] Updated weights for policy 1, policy_version 1078602 (0.0011) [2023-12-26 08:15:53,265][123090] Updated weights for policy 1, policy_version 1078612 (0.0010) [2023-12-26 08:15:53,321][123090] Updated weights for policy 1, policy_version 1078622 (0.0010) [2023-12-26 08:15:53,583][123091] Updated weights for policy 0, policy_version 1086231 (0.0010) [2023-12-26 08:15:53,645][123091] Updated weights for policy 0, policy_version 1086241 (0.0010) [2023-12-26 08:15:53,712][123091] Updated weights for policy 0, policy_version 1086251 (0.0010) [2023-12-26 08:15:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 554213376. Throughput: 0: 8611.1, 1: 8701.8. Samples: 554186756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:53,785][121949] Avg episode reward: [(0, '6183.310'), (1, '5109.867')] [2023-12-26 08:15:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001086256_278085632.pth... [2023-12-26 08:15:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001078624_276127744.pth... [2023-12-26 08:15:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001085232_277823488.pth [2023-12-26 08:15:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001077600_275865600.pth [2023-12-26 08:15:54,088][123090] Updated weights for policy 1, policy_version 1078632 (0.0010) [2023-12-26 08:15:54,151][123090] Updated weights for policy 1, policy_version 1078642 (0.0010) [2023-12-26 08:15:54,206][123090] Updated weights for policy 1, policy_version 1078652 (0.0010) [2023-12-26 08:15:54,491][123091] Updated weights for policy 0, policy_version 1086261 (0.0006) [2023-12-26 08:15:54,551][123091] Updated weights for policy 0, policy_version 1086271 (0.0006) [2023-12-26 08:15:54,617][123091] Updated weights for policy 0, policy_version 1086281 (0.0006) [2023-12-26 08:15:55,038][123090] Updated weights for policy 1, policy_version 1078662 (0.0010) [2023-12-26 08:15:55,102][123090] Updated weights for policy 1, policy_version 1078672 (0.0009) [2023-12-26 08:15:55,170][123090] Updated weights for policy 1, policy_version 1078682 (0.0007) [2023-12-26 08:15:55,277][123091] Updated weights for policy 0, policy_version 1086291 (0.0005) [2023-12-26 08:15:55,331][123091] Updated weights for policy 0, policy_version 1086301 (0.0006) [2023-12-26 08:15:55,398][123091] Updated weights for policy 0, policy_version 1086311 (0.0005) [2023-12-26 08:15:55,881][123090] Updated weights for policy 1, policy_version 1078692 (0.0006) [2023-12-26 08:15:55,944][123090] Updated weights for policy 1, policy_version 1078702 (0.0005) [2023-12-26 08:15:56,016][123090] Updated weights for policy 1, policy_version 1078712 (0.0005) [2023-12-26 08:15:56,196][123091] Updated weights for policy 0, policy_version 1086321 (0.0010) [2023-12-26 08:15:56,256][123091] Updated weights for policy 0, policy_version 1086331 (0.0009) [2023-12-26 08:15:56,322][123091] Updated weights for policy 0, policy_version 1086341 (0.0005) [2023-12-26 08:15:56,386][123091] Updated weights for policy 0, policy_version 1086351 (0.0006) [2023-12-26 08:15:56,813][123090] Updated weights for policy 1, policy_version 1078722 (0.0009) [2023-12-26 08:15:56,861][123090] Updated weights for policy 1, policy_version 1078732 (0.0009) [2023-12-26 08:15:56,918][123090] Updated weights for policy 1, policy_version 1078742 (0.0008) [2023-12-26 08:15:56,985][123090] Updated weights for policy 1, policy_version 1078752 (0.0009) [2023-12-26 08:15:57,135][123091] Updated weights for policy 0, policy_version 1086361 (0.0010) [2023-12-26 08:15:57,199][123091] Updated weights for policy 0, policy_version 1086371 (0.0011) [2023-12-26 08:15:57,263][123091] Updated weights for policy 0, policy_version 1086381 (0.0011) [2023-12-26 08:15:57,883][123090] Updated weights for policy 1, policy_version 1078762 (0.0010) [2023-12-26 08:15:57,940][123090] Updated weights for policy 1, policy_version 1078772 (0.0009) [2023-12-26 08:15:58,009][123090] Updated weights for policy 1, policy_version 1078782 (0.0007) [2023-12-26 08:15:58,020][123091] Updated weights for policy 0, policy_version 1086391 (0.0008) [2023-12-26 08:15:58,079][123091] Updated weights for policy 0, policy_version 1086401 (0.0010) [2023-12-26 08:15:58,142][123091] Updated weights for policy 0, policy_version 1086411 (0.0011) [2023-12-26 08:15:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 554295296. Throughput: 0: 8648.2, 1: 8666.5. Samples: 554293188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:15:58,785][121949] Avg episode reward: [(0, '6228.948'), (1, '4936.124')] [2023-12-26 08:15:58,849][123090] Updated weights for policy 1, policy_version 1078792 (0.0008) [2023-12-26 08:15:58,919][123090] Updated weights for policy 1, policy_version 1078802 (0.0007) [2023-12-26 08:15:58,926][123091] Updated weights for policy 0, policy_version 1086421 (0.0011) [2023-12-26 08:15:58,987][123091] Updated weights for policy 0, policy_version 1086431 (0.0010) [2023-12-26 08:15:58,990][123090] Updated weights for policy 1, policy_version 1078812 (0.0007) [2023-12-26 08:15:59,047][123091] Updated weights for policy 0, policy_version 1086441 (0.0011) [2023-12-26 08:15:59,785][123090] Updated weights for policy 1, policy_version 1078822 (0.0005) [2023-12-26 08:15:59,860][123090] Updated weights for policy 1, policy_version 1078832 (0.0007) [2023-12-26 08:15:59,863][123091] Updated weights for policy 0, policy_version 1086451 (0.0009) [2023-12-26 08:15:59,929][123090] Updated weights for policy 1, policy_version 1078842 (0.0007) [2023-12-26 08:15:59,929][123091] Updated weights for policy 0, policy_version 1086461 (0.0009) [2023-12-26 08:15:59,993][123091] Updated weights for policy 0, policy_version 1086471 (0.0010) [2023-12-26 08:16:00,703][123090] Updated weights for policy 1, policy_version 1078852 (0.0007) [2023-12-26 08:16:00,754][123090] Updated weights for policy 1, policy_version 1078862 (0.0009) [2023-12-26 08:16:00,798][123091] Updated weights for policy 0, policy_version 1086481 (0.0006) [2023-12-26 08:16:00,813][123090] Updated weights for policy 1, policy_version 1078872 (0.0007) [2023-12-26 08:16:00,850][123091] Updated weights for policy 0, policy_version 1086491 (0.0008) [2023-12-26 08:16:00,906][123091] Updated weights for policy 0, policy_version 1086501 (0.0008) [2023-12-26 08:16:00,950][123091] Updated weights for policy 0, policy_version 1086511 (0.0005) [2023-12-26 08:16:01,645][123090] Updated weights for policy 1, policy_version 1078882 (0.0007) [2023-12-26 08:16:01,720][123090] Updated weights for policy 1, policy_version 1078892 (0.0009) [2023-12-26 08:16:01,787][123090] Updated weights for policy 1, policy_version 1078902 (0.0008) [2023-12-26 08:16:01,797][123091] Updated weights for policy 0, policy_version 1086521 (0.0009) [2023-12-26 08:16:01,847][123090] Updated weights for policy 1, policy_version 1078912 (0.0007) [2023-12-26 08:16:01,859][123091] Updated weights for policy 0, policy_version 1086531 (0.0009) [2023-12-26 08:16:01,924][123091] Updated weights for policy 0, policy_version 1086541 (0.0010) [2023-12-26 08:16:02,650][123091] Updated weights for policy 0, policy_version 1086551 (0.0008) [2023-12-26 08:16:02,676][123090] Updated weights for policy 1, policy_version 1078922 (0.0010) [2023-12-26 08:16:02,713][123091] Updated weights for policy 0, policy_version 1086561 (0.0009) [2023-12-26 08:16:02,739][123090] Updated weights for policy 1, policy_version 1078932 (0.0007) [2023-12-26 08:16:02,765][123091] Updated weights for policy 0, policy_version 1086571 (0.0009) [2023-12-26 08:16:02,802][123090] Updated weights for policy 1, policy_version 1078942 (0.0009) [2023-12-26 08:16:03,440][123091] Updated weights for policy 0, policy_version 1086581 (0.0006) [2023-12-26 08:16:03,499][123091] Updated weights for policy 0, policy_version 1086591 (0.0008) [2023-12-26 08:16:03,549][123091] Updated weights for policy 0, policy_version 1086601 (0.0009) [2023-12-26 08:16:03,657][123090] Updated weights for policy 1, policy_version 1078952 (0.0010) [2023-12-26 08:16:03,722][123090] Updated weights for policy 1, policy_version 1078962 (0.0009) [2023-12-26 08:16:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 554385408. Throughput: 0: 8722.4, 1: 8678.0. Samples: 554398076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:03,784][121949] Avg episode reward: [(0, '6161.151'), (1, '4960.485')] [2023-12-26 08:16:03,788][123090] Updated weights for policy 1, policy_version 1078972 (0.0009) [2023-12-26 08:16:04,244][123091] Updated weights for policy 0, policy_version 1086611 (0.0007) [2023-12-26 08:16:04,314][123091] Updated weights for policy 0, policy_version 1086621 (0.0008) [2023-12-26 08:16:04,385][123091] Updated weights for policy 0, policy_version 1086631 (0.0011) [2023-12-26 08:16:04,650][123090] Updated weights for policy 1, policy_version 1078982 (0.0009) [2023-12-26 08:16:04,699][123090] Updated weights for policy 1, policy_version 1078992 (0.0009) [2023-12-26 08:16:04,749][123090] Updated weights for policy 1, policy_version 1079002 (0.0009) [2023-12-26 08:16:05,127][123091] Updated weights for policy 0, policy_version 1086641 (0.0009) [2023-12-26 08:16:05,192][123091] Updated weights for policy 0, policy_version 1086651 (0.0005) [2023-12-26 08:16:05,253][123091] Updated weights for policy 0, policy_version 1086661 (0.0006) [2023-12-26 08:16:05,317][123091] Updated weights for policy 0, policy_version 1086671 (0.0006) [2023-12-26 08:16:05,698][123090] Updated weights for policy 1, policy_version 1079012 (0.0010) [2023-12-26 08:16:05,745][123090] Updated weights for policy 1, policy_version 1079022 (0.0010) [2023-12-26 08:16:05,805][123090] Updated weights for policy 1, policy_version 1079032 (0.0010) [2023-12-26 08:16:06,040][123091] Updated weights for policy 0, policy_version 1086681 (0.0005) [2023-12-26 08:16:06,113][123091] Updated weights for policy 0, policy_version 1086691 (0.0007) [2023-12-26 08:16:06,181][123091] Updated weights for policy 0, policy_version 1086701 (0.0008) [2023-12-26 08:16:06,583][123090] Updated weights for policy 1, policy_version 1079042 (0.0006) [2023-12-26 08:16:06,636][123090] Updated weights for policy 1, policy_version 1079052 (0.0011) [2023-12-26 08:16:06,700][123090] Updated weights for policy 1, policy_version 1079062 (0.0011) [2023-12-26 08:16:06,756][123090] Updated weights for policy 1, policy_version 1079072 (0.0011) [2023-12-26 08:16:06,921][123091] Updated weights for policy 0, policy_version 1086711 (0.0006) [2023-12-26 08:16:06,973][123091] Updated weights for policy 0, policy_version 1086721 (0.0005) [2023-12-26 08:16:07,029][123091] Updated weights for policy 0, policy_version 1086731 (0.0005) [2023-12-26 08:16:07,595][123090] Updated weights for policy 1, policy_version 1079082 (0.0010) [2023-12-26 08:16:07,657][123090] Updated weights for policy 1, policy_version 1079092 (0.0010) [2023-12-26 08:16:07,718][123090] Updated weights for policy 1, policy_version 1079102 (0.0008) [2023-12-26 08:16:07,803][123091] Updated weights for policy 0, policy_version 1086741 (0.0008) [2023-12-26 08:16:07,858][123091] Updated weights for policy 0, policy_version 1086751 (0.0011) [2023-12-26 08:16:07,913][123091] Updated weights for policy 0, policy_version 1086761 (0.0010) [2023-12-26 08:16:08,589][123090] Updated weights for policy 1, policy_version 1079112 (0.0010) [2023-12-26 08:16:08,656][123091] Updated weights for policy 0, policy_version 1086771 (0.0009) [2023-12-26 08:16:08,656][123090] Updated weights for policy 1, policy_version 1079122 (0.0010) [2023-12-26 08:16:08,726][123090] Updated weights for policy 1, policy_version 1079132 (0.0010) [2023-12-26 08:16:08,728][123091] Updated weights for policy 0, policy_version 1086781 (0.0006) [2023-12-26 08:16:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 554475520. Throughput: 0: 8830.4, 1: 8678.6. Samples: 554451944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:08,786][121949] Avg episode reward: [(0, '6131.876'), (1, '5179.001')] [2023-12-26 08:16:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001079136_276258816.pth... [2023-12-26 08:16:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001078112_275996672.pth [2023-12-26 08:16:08,802][123091] Updated weights for policy 0, policy_version 1086791 (0.0007) [2023-12-26 08:16:08,858][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001086800_278224896.pth... [2023-12-26 08:16:08,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001085744_277954560.pth [2023-12-26 08:16:09,587][123090] Updated weights for policy 1, policy_version 1079142 (0.0009) [2023-12-26 08:16:09,610][123091] Updated weights for policy 0, policy_version 1086801 (0.0011) [2023-12-26 08:16:09,651][123090] Updated weights for policy 1, policy_version 1079152 (0.0009) [2023-12-26 08:16:09,658][123091] Updated weights for policy 0, policy_version 1086811 (0.0010) [2023-12-26 08:16:09,713][123090] Updated weights for policy 1, policy_version 1079162 (0.0009) [2023-12-26 08:16:09,744][123091] Updated weights for policy 0, policy_version 1086821 (0.0011) [2023-12-26 08:16:09,812][123091] Updated weights for policy 0, policy_version 1086831 (0.0011) [2023-12-26 08:16:10,574][123091] Updated weights for policy 0, policy_version 1086841 (0.0011) [2023-12-26 08:16:10,603][123090] Updated weights for policy 1, policy_version 1079172 (0.0007) [2023-12-26 08:16:10,625][123091] Updated weights for policy 0, policy_version 1086851 (0.0010) [2023-12-26 08:16:10,658][123090] Updated weights for policy 1, policy_version 1079182 (0.0007) [2023-12-26 08:16:10,682][123091] Updated weights for policy 0, policy_version 1086861 (0.0005) [2023-12-26 08:16:10,726][123090] Updated weights for policy 1, policy_version 1079192 (0.0009) [2023-12-26 08:16:11,380][123091] Updated weights for policy 0, policy_version 1086871 (0.0010) [2023-12-26 08:16:11,459][123091] Updated weights for policy 0, policy_version 1086881 (0.0006) [2023-12-26 08:16:11,525][123091] Updated weights for policy 0, policy_version 1086891 (0.0010) [2023-12-26 08:16:11,649][123090] Updated weights for policy 1, policy_version 1079202 (0.0010) [2023-12-26 08:16:11,730][123090] Updated weights for policy 1, policy_version 1079212 (0.0009) [2023-12-26 08:16:11,789][123090] Updated weights for policy 1, policy_version 1079222 (0.0009) [2023-12-26 08:16:11,850][123090] Updated weights for policy 1, policy_version 1079232 (0.0009) [2023-12-26 08:16:12,367][123091] Updated weights for policy 0, policy_version 1086901 (0.0011) [2023-12-26 08:16:12,437][123091] Updated weights for policy 0, policy_version 1086911 (0.0006) [2023-12-26 08:16:12,505][123091] Updated weights for policy 0, policy_version 1086921 (0.0010) [2023-12-26 08:16:12,675][123090] Updated weights for policy 1, policy_version 1079242 (0.0009) [2023-12-26 08:16:12,733][123090] Updated weights for policy 1, policy_version 1079252 (0.0009) [2023-12-26 08:16:12,789][123090] Updated weights for policy 1, policy_version 1079262 (0.0009) [2023-12-26 08:16:13,223][123091] Updated weights for policy 0, policy_version 1086931 (0.0010) [2023-12-26 08:16:13,271][123091] Updated weights for policy 0, policy_version 1086941 (0.0009) [2023-12-26 08:16:13,323][123091] Updated weights for policy 0, policy_version 1086951 (0.0010) [2023-12-26 08:16:13,612][123090] Updated weights for policy 1, policy_version 1079272 (0.0006) [2023-12-26 08:16:13,668][123090] Updated weights for policy 1, policy_version 1079282 (0.0005) [2023-12-26 08:16:13,725][123090] Updated weights for policy 1, policy_version 1079292 (0.0005) [2023-12-26 08:16:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 554565632. Throughput: 0: 8841.9, 1: 8622.1. Samples: 554554712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:13,785][121949] Avg episode reward: [(0, '6000.045'), (1, '5579.755')] [2023-12-26 08:16:14,252][123091] Updated weights for policy 0, policy_version 1086961 (0.0010) [2023-12-26 08:16:14,304][123091] Updated weights for policy 0, policy_version 1086971 (0.0009) [2023-12-26 08:16:14,346][123090] Updated weights for policy 1, policy_version 1079302 (0.0007) [2023-12-26 08:16:14,365][123091] Updated weights for policy 0, policy_version 1086981 (0.0007) [2023-12-26 08:16:14,401][123090] Updated weights for policy 1, policy_version 1079312 (0.0008) [2023-12-26 08:16:14,417][123091] Updated weights for policy 0, policy_version 1086991 (0.0007) [2023-12-26 08:16:14,454][123090] Updated weights for policy 1, policy_version 1079322 (0.0007) [2023-12-26 08:16:15,207][123091] Updated weights for policy 0, policy_version 1087001 (0.0010) [2023-12-26 08:16:15,271][123091] Updated weights for policy 0, policy_version 1087011 (0.0006) [2023-12-26 08:16:15,319][123091] Updated weights for policy 0, policy_version 1087021 (0.0006) [2023-12-26 08:16:15,326][123090] Updated weights for policy 1, policy_version 1079332 (0.0007) [2023-12-26 08:16:15,396][123090] Updated weights for policy 1, policy_version 1079342 (0.0010) [2023-12-26 08:16:15,470][123090] Updated weights for policy 1, policy_version 1079352 (0.0009) [2023-12-26 08:16:15,933][123091] Updated weights for policy 0, policy_version 1087031 (0.0006) [2023-12-26 08:16:15,989][123091] Updated weights for policy 0, policy_version 1087041 (0.0005) [2023-12-26 08:16:16,042][123091] Updated weights for policy 0, policy_version 1087051 (0.0006) [2023-12-26 08:16:16,226][123090] Updated weights for policy 1, policy_version 1079362 (0.0009) [2023-12-26 08:16:16,276][123090] Updated weights for policy 1, policy_version 1079372 (0.0009) [2023-12-26 08:16:16,328][123090] Updated weights for policy 1, policy_version 1079382 (0.0008) [2023-12-26 08:16:16,392][123090] Updated weights for policy 1, policy_version 1079392 (0.0006) [2023-12-26 08:16:16,751][123091] Updated weights for policy 0, policy_version 1087061 (0.0008) [2023-12-26 08:16:16,799][123091] Updated weights for policy 0, policy_version 1087071 (0.0005) [2023-12-26 08:16:16,856][123091] Updated weights for policy 0, policy_version 1087081 (0.0006) [2023-12-26 08:16:17,257][123090] Updated weights for policy 1, policy_version 1079402 (0.0010) [2023-12-26 08:16:17,314][123090] Updated weights for policy 1, policy_version 1079412 (0.0010) [2023-12-26 08:16:17,372][123090] Updated weights for policy 1, policy_version 1079422 (0.0009) [2023-12-26 08:16:17,601][123091] Updated weights for policy 0, policy_version 1087091 (0.0009) [2023-12-26 08:16:17,665][123091] Updated weights for policy 0, policy_version 1087101 (0.0010) [2023-12-26 08:16:17,724][123091] Updated weights for policy 0, policy_version 1087111 (0.0009) [2023-12-26 08:16:18,221][123090] Updated weights for policy 1, policy_version 1079432 (0.0010) [2023-12-26 08:16:18,282][123090] Updated weights for policy 1, policy_version 1079442 (0.0009) [2023-12-26 08:16:18,359][123090] Updated weights for policy 1, policy_version 1079452 (0.0009) [2023-12-26 08:16:18,496][123091] Updated weights for policy 0, policy_version 1087121 (0.0009) [2023-12-26 08:16:18,560][123091] Updated weights for policy 0, policy_version 1087131 (0.0010) [2023-12-26 08:16:18,624][123091] Updated weights for policy 0, policy_version 1087141 (0.0010) [2023-12-26 08:16:18,689][123091] Updated weights for policy 0, policy_version 1087151 (0.0010) [2023-12-26 08:16:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 554655744. Throughput: 0: 8954.7, 1: 8590.9. Samples: 554663052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:18,785][121949] Avg episode reward: [(0, '5940.703'), (1, '5603.214')] [2023-12-26 08:16:19,109][123090] Updated weights for policy 1, policy_version 1079462 (0.0007) [2023-12-26 08:16:19,177][123090] Updated weights for policy 1, policy_version 1079472 (0.0006) [2023-12-26 08:16:19,254][123090] Updated weights for policy 1, policy_version 1079482 (0.0008) [2023-12-26 08:16:19,390][123091] Updated weights for policy 0, policy_version 1087161 (0.0010) [2023-12-26 08:16:19,453][123091] Updated weights for policy 0, policy_version 1087171 (0.0011) [2023-12-26 08:16:19,528][123091] Updated weights for policy 0, policy_version 1087181 (0.0008) [2023-12-26 08:16:20,078][123090] Updated weights for policy 1, policy_version 1079492 (0.0009) [2023-12-26 08:16:20,134][123090] Updated weights for policy 1, policy_version 1079502 (0.0010) [2023-12-26 08:16:20,206][123090] Updated weights for policy 1, policy_version 1079513 (0.0010) [2023-12-26 08:16:20,316][123091] Updated weights for policy 0, policy_version 1087191 (0.0008) [2023-12-26 08:16:20,388][123091] Updated weights for policy 0, policy_version 1087201 (0.0009) [2023-12-26 08:16:20,457][123091] Updated weights for policy 0, policy_version 1087211 (0.0009) [2023-12-26 08:16:21,002][123090] Updated weights for policy 1, policy_version 1079523 (0.0008) [2023-12-26 08:16:21,085][123090] Updated weights for policy 1, policy_version 1079533 (0.0008) [2023-12-26 08:16:21,154][123090] Updated weights for policy 1, policy_version 1079543 (0.0011) [2023-12-26 08:16:21,294][123091] Updated weights for policy 0, policy_version 1087221 (0.0009) [2023-12-26 08:16:21,367][123091] Updated weights for policy 0, policy_version 1087231 (0.0009) [2023-12-26 08:16:21,428][123091] Updated weights for policy 0, policy_version 1087241 (0.0009) [2023-12-26 08:16:21,991][123090] Updated weights for policy 1, policy_version 1079553 (0.0011) [2023-12-26 08:16:22,061][123090] Updated weights for policy 1, policy_version 1079563 (0.0009) [2023-12-26 08:16:22,129][123090] Updated weights for policy 1, policy_version 1079573 (0.0010) [2023-12-26 08:16:22,189][123090] Updated weights for policy 1, policy_version 1079584 (0.0009) [2023-12-26 08:16:22,234][123091] Updated weights for policy 0, policy_version 1087251 (0.0009) [2023-12-26 08:16:22,300][123091] Updated weights for policy 0, policy_version 1087261 (0.0009) [2023-12-26 08:16:22,370][123091] Updated weights for policy 0, policy_version 1087271 (0.0009) [2023-12-26 08:16:23,031][123090] Updated weights for policy 1, policy_version 1079594 (0.0010) [2023-12-26 08:16:23,101][123090] Updated weights for policy 1, policy_version 1079604 (0.0010) [2023-12-26 08:16:23,135][123091] Updated weights for policy 0, policy_version 1087281 (0.0010) [2023-12-26 08:16:23,168][123090] Updated weights for policy 1, policy_version 1079614 (0.0010) [2023-12-26 08:16:23,192][123091] Updated weights for policy 0, policy_version 1087291 (0.0006) [2023-12-26 08:16:23,257][123091] Updated weights for policy 0, policy_version 1087301 (0.0009) [2023-12-26 08:16:23,320][123091] Updated weights for policy 0, policy_version 1087311 (0.0009) [2023-12-26 08:16:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 554737664. Throughput: 0: 8954.8, 1: 8571.0. Samples: 554715496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:23,785][121949] Avg episode reward: [(0, '6145.059'), (1, '5218.485')] [2023-12-26 08:16:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001087312_278355968.pth... [2023-12-26 08:16:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001079616_276381696.pth... [2023-12-26 08:16:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001078624_276127744.pth [2023-12-26 08:16:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001086256_278085632.pth [2023-12-26 08:16:23,983][123090] Updated weights for policy 1, policy_version 1079624 (0.0010) [2023-12-26 08:16:24,049][123090] Updated weights for policy 1, policy_version 1079634 (0.0010) [2023-12-26 08:16:24,115][123090] Updated weights for policy 1, policy_version 1079644 (0.0010) [2023-12-26 08:16:24,144][123091] Updated weights for policy 0, policy_version 1087321 (0.0007) [2023-12-26 08:16:24,199][123091] Updated weights for policy 0, policy_version 1087331 (0.0008) [2023-12-26 08:16:24,267][123091] Updated weights for policy 0, policy_version 1087341 (0.0008) [2023-12-26 08:16:24,925][123090] Updated weights for policy 1, policy_version 1079654 (0.0010) [2023-12-26 08:16:24,976][123090] Updated weights for policy 1, policy_version 1079664 (0.0010) [2023-12-26 08:16:25,031][123090] Updated weights for policy 1, policy_version 1079674 (0.0010) [2023-12-26 08:16:25,093][123091] Updated weights for policy 0, policy_version 1087351 (0.0009) [2023-12-26 08:16:25,145][123091] Updated weights for policy 0, policy_version 1087361 (0.0008) [2023-12-26 08:16:25,202][123091] Updated weights for policy 0, policy_version 1087371 (0.0009) [2023-12-26 08:16:25,803][123090] Updated weights for policy 1, policy_version 1079684 (0.0008) [2023-12-26 08:16:25,872][123090] Updated weights for policy 1, policy_version 1079694 (0.0005) [2023-12-26 08:16:25,931][123090] Updated weights for policy 1, policy_version 1079704 (0.0005) [2023-12-26 08:16:25,960][123091] Updated weights for policy 0, policy_version 1087381 (0.0009) [2023-12-26 08:16:26,013][123091] Updated weights for policy 0, policy_version 1087392 (0.0010) [2023-12-26 08:16:26,067][123091] Updated weights for policy 0, policy_version 1087402 (0.0010) [2023-12-26 08:16:26,596][123090] Updated weights for policy 1, policy_version 1079714 (0.0006) [2023-12-26 08:16:26,650][123090] Updated weights for policy 1, policy_version 1079724 (0.0010) [2023-12-26 08:16:26,704][123090] Updated weights for policy 1, policy_version 1079734 (0.0010) [2023-12-26 08:16:26,774][123090] Updated weights for policy 1, policy_version 1079744 (0.0010) [2023-12-26 08:16:26,854][123091] Updated weights for policy 0, policy_version 1087412 (0.0009) [2023-12-26 08:16:26,925][123091] Updated weights for policy 0, policy_version 1087422 (0.0008) [2023-12-26 08:16:26,991][123091] Updated weights for policy 0, policy_version 1087432 (0.0008) [2023-12-26 08:16:27,528][123090] Updated weights for policy 1, policy_version 1079754 (0.0010) [2023-12-26 08:16:27,579][123090] Updated weights for policy 1, policy_version 1079764 (0.0010) [2023-12-26 08:16:27,634][123090] Updated weights for policy 1, policy_version 1079774 (0.0010) [2023-12-26 08:16:27,735][123091] Updated weights for policy 0, policy_version 1087442 (0.0008) [2023-12-26 08:16:27,802][123091] Updated weights for policy 0, policy_version 1087452 (0.0008) [2023-12-26 08:16:27,851][123091] Updated weights for policy 0, policy_version 1087462 (0.0006) [2023-12-26 08:16:27,902][123091] Updated weights for policy 0, policy_version 1087472 (0.0005) [2023-12-26 08:16:28,410][123090] Updated weights for policy 1, policy_version 1079784 (0.0006) [2023-12-26 08:16:28,476][123090] Updated weights for policy 1, policy_version 1079794 (0.0006) [2023-12-26 08:16:28,545][123090] Updated weights for policy 1, policy_version 1079804 (0.0010) [2023-12-26 08:16:28,571][123091] Updated weights for policy 0, policy_version 1087482 (0.0006) [2023-12-26 08:16:28,641][123091] Updated weights for policy 0, policy_version 1087492 (0.0005) [2023-12-26 08:16:28,710][123091] Updated weights for policy 0, policy_version 1087502 (0.0005) [2023-12-26 08:16:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 554835968. Throughput: 0: 9036.6, 1: 8641.1. Samples: 554823668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:28,785][121949] Avg episode reward: [(0, '6175.258'), (1, '5254.134')] [2023-12-26 08:16:29,255][123090] Updated weights for policy 1, policy_version 1079814 (0.0010) [2023-12-26 08:16:29,315][123090] Updated weights for policy 1, policy_version 1079824 (0.0008) [2023-12-26 08:16:29,385][123090] Updated weights for policy 1, policy_version 1079834 (0.0008) [2023-12-26 08:16:29,400][123091] Updated weights for policy 0, policy_version 1087512 (0.0006) [2023-12-26 08:16:29,454][123091] Updated weights for policy 0, policy_version 1087522 (0.0005) [2023-12-26 08:16:29,514][123091] Updated weights for policy 0, policy_version 1087532 (0.0006) [2023-12-26 08:16:30,185][123091] Updated weights for policy 0, policy_version 1087542 (0.0007) [2023-12-26 08:16:30,240][123091] Updated weights for policy 0, policy_version 1087552 (0.0009) [2023-12-26 08:16:30,259][123090] Updated weights for policy 1, policy_version 1079844 (0.0011) [2023-12-26 08:16:30,310][123091] Updated weights for policy 0, policy_version 1087562 (0.0008) [2023-12-26 08:16:30,320][123090] Updated weights for policy 1, policy_version 1079854 (0.0009) [2023-12-26 08:16:30,385][123090] Updated weights for policy 1, policy_version 1079864 (0.0010) [2023-12-26 08:16:30,976][123091] Updated weights for policy 0, policy_version 1087572 (0.0006) [2023-12-26 08:16:31,035][123091] Updated weights for policy 0, policy_version 1087582 (0.0006) [2023-12-26 08:16:31,100][123091] Updated weights for policy 0, policy_version 1087592 (0.0007) [2023-12-26 08:16:31,176][123090] Updated weights for policy 1, policy_version 1079874 (0.0008) [2023-12-26 08:16:31,246][123090] Updated weights for policy 1, policy_version 1079884 (0.0006) [2023-12-26 08:16:31,306][123090] Updated weights for policy 1, policy_version 1079894 (0.0010) [2023-12-26 08:16:31,373][123090] Updated weights for policy 1, policy_version 1079904 (0.0009) [2023-12-26 08:16:31,828][123091] Updated weights for policy 0, policy_version 1087602 (0.0008) [2023-12-26 08:16:31,890][123091] Updated weights for policy 0, policy_version 1087612 (0.0009) [2023-12-26 08:16:31,954][123091] Updated weights for policy 0, policy_version 1087622 (0.0009) [2023-12-26 08:16:32,017][123091] Updated weights for policy 0, policy_version 1087632 (0.0010) [2023-12-26 08:16:32,189][123090] Updated weights for policy 1, policy_version 1079914 (0.0009) [2023-12-26 08:16:32,260][123090] Updated weights for policy 1, policy_version 1079924 (0.0010) [2023-12-26 08:16:32,318][123090] Updated weights for policy 1, policy_version 1079934 (0.0009) [2023-12-26 08:16:32,860][123091] Updated weights for policy 0, policy_version 1087642 (0.0010) [2023-12-26 08:16:32,923][123091] Updated weights for policy 0, policy_version 1087652 (0.0010) [2023-12-26 08:16:32,996][123091] Updated weights for policy 0, policy_version 1087662 (0.0009) [2023-12-26 08:16:33,127][123090] Updated weights for policy 1, policy_version 1079944 (0.0010) [2023-12-26 08:16:33,173][123090] Updated weights for policy 1, policy_version 1079954 (0.0010) [2023-12-26 08:16:33,220][123090] Updated weights for policy 1, policy_version 1079964 (0.0010) [2023-12-26 08:16:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 554917888. Throughput: 0: 9092.7, 1: 8593.0. Samples: 554932320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:33,785][121949] Avg episode reward: [(0, '5979.334'), (1, '5412.574')] [2023-12-26 08:16:33,803][123091] Updated weights for policy 0, policy_version 1087672 (0.0009) [2023-12-26 08:16:33,868][123091] Updated weights for policy 0, policy_version 1087682 (0.0010) [2023-12-26 08:16:33,928][123091] Updated weights for policy 0, policy_version 1087692 (0.0009) [2023-12-26 08:16:34,038][123090] Updated weights for policy 1, policy_version 1079974 (0.0009) [2023-12-26 08:16:34,092][123090] Updated weights for policy 1, policy_version 1079984 (0.0009) [2023-12-26 08:16:34,164][123090] Updated weights for policy 1, policy_version 1079994 (0.0009) [2023-12-26 08:16:34,745][123091] Updated weights for policy 0, policy_version 1087702 (0.0009) [2023-12-26 08:16:34,798][123091] Updated weights for policy 0, policy_version 1087712 (0.0009) [2023-12-26 08:16:34,855][123091] Updated weights for policy 0, policy_version 1087722 (0.0008) [2023-12-26 08:16:34,998][123090] Updated weights for policy 1, policy_version 1080004 (0.0008) [2023-12-26 08:16:35,067][123090] Updated weights for policy 1, policy_version 1080014 (0.0010) [2023-12-26 08:16:35,125][123090] Updated weights for policy 1, policy_version 1080024 (0.0010) [2023-12-26 08:16:35,708][123091] Updated weights for policy 0, policy_version 1087732 (0.0006) [2023-12-26 08:16:35,765][123091] Updated weights for policy 0, policy_version 1087742 (0.0007) [2023-12-26 08:16:35,824][123091] Updated weights for policy 0, policy_version 1087752 (0.0006) [2023-12-26 08:16:35,830][123090] Updated weights for policy 1, policy_version 1080034 (0.0009) [2023-12-26 08:16:35,881][123090] Updated weights for policy 1, policy_version 1080044 (0.0005) [2023-12-26 08:16:35,934][123090] Updated weights for policy 1, policy_version 1080054 (0.0005) [2023-12-26 08:16:35,989][123090] Updated weights for policy 1, policy_version 1080064 (0.0005) [2023-12-26 08:16:36,606][123091] Updated weights for policy 0, policy_version 1087762 (0.0008) [2023-12-26 08:16:36,676][123091] Updated weights for policy 0, policy_version 1087772 (0.0009) [2023-12-26 08:16:36,738][123091] Updated weights for policy 0, policy_version 1087782 (0.0009) [2023-12-26 08:16:36,744][123090] Updated weights for policy 1, policy_version 1080074 (0.0011) [2023-12-26 08:16:36,802][123091] Updated weights for policy 0, policy_version 1087792 (0.0007) [2023-12-26 08:16:36,807][123090] Updated weights for policy 1, policy_version 1080084 (0.0010) [2023-12-26 08:16:36,873][123090] Updated weights for policy 1, policy_version 1080094 (0.0010) [2023-12-26 08:16:37,636][123091] Updated weights for policy 0, policy_version 1087802 (0.0009) [2023-12-26 08:16:37,671][123090] Updated weights for policy 1, policy_version 1080104 (0.0009) [2023-12-26 08:16:37,682][123091] Updated weights for policy 0, policy_version 1087812 (0.0008) [2023-12-26 08:16:37,727][123090] Updated weights for policy 1, policy_version 1080114 (0.0010) [2023-12-26 08:16:37,733][123091] Updated weights for policy 0, policy_version 1087822 (0.0007) [2023-12-26 08:16:37,787][123090] Updated weights for policy 1, policy_version 1080124 (0.0009) [2023-12-26 08:16:38,567][123090] Updated weights for policy 1, policy_version 1080134 (0.0007) [2023-12-26 08:16:38,596][123091] Updated weights for policy 0, policy_version 1087832 (0.0008) [2023-12-26 08:16:38,627][123090] Updated weights for policy 1, policy_version 1080144 (0.0010) [2023-12-26 08:16:38,664][123091] Updated weights for policy 0, policy_version 1087842 (0.0009) [2023-12-26 08:16:38,684][123090] Updated weights for policy 1, policy_version 1080154 (0.0007) [2023-12-26 08:16:38,718][123091] Updated weights for policy 0, policy_version 1087852 (0.0009) [2023-12-26 08:16:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 555016192. Throughput: 0: 9112.2, 1: 8641.0. Samples: 554985652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:38,785][121949] Avg episode reward: [(0, '6061.853'), (1, '5574.732')] [2023-12-26 08:16:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001080160_276520960.pth... [2023-12-26 08:16:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001087856_278495232.pth... [2023-12-26 08:16:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001086800_278224896.pth [2023-12-26 08:16:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001079136_276258816.pth [2023-12-26 08:16:39,513][123090] Updated weights for policy 1, policy_version 1080164 (0.0008) [2023-12-26 08:16:39,565][123091] Updated weights for policy 0, policy_version 1087862 (0.0009) [2023-12-26 08:16:39,584][123090] Updated weights for policy 1, policy_version 1080174 (0.0006) [2023-12-26 08:16:39,622][123091] Updated weights for policy 0, policy_version 1087872 (0.0008) [2023-12-26 08:16:39,656][123090] Updated weights for policy 1, policy_version 1080184 (0.0007) [2023-12-26 08:16:39,688][123091] Updated weights for policy 0, policy_version 1087882 (0.0007) [2023-12-26 08:16:40,483][123091] Updated weights for policy 0, policy_version 1087892 (0.0007) [2023-12-26 08:16:40,487][123090] Updated weights for policy 1, policy_version 1080194 (0.0009) [2023-12-26 08:16:40,537][123091] Updated weights for policy 0, policy_version 1087902 (0.0007) [2023-12-26 08:16:40,554][123090] Updated weights for policy 1, policy_version 1080204 (0.0009) [2023-12-26 08:16:40,591][123091] Updated weights for policy 0, policy_version 1087912 (0.0008) [2023-12-26 08:16:40,616][123090] Updated weights for policy 1, policy_version 1080214 (0.0008) [2023-12-26 08:16:40,676][123090] Updated weights for policy 1, policy_version 1080224 (0.0009) [2023-12-26 08:16:41,460][123091] Updated weights for policy 0, policy_version 1087922 (0.0009) [2023-12-26 08:16:41,519][123090] Updated weights for policy 1, policy_version 1080234 (0.0007) [2023-12-26 08:16:41,521][123091] Updated weights for policy 0, policy_version 1087932 (0.0009) [2023-12-26 08:16:41,574][123090] Updated weights for policy 1, policy_version 1080244 (0.0009) [2023-12-26 08:16:41,581][123091] Updated weights for policy 0, policy_version 1087942 (0.0006) [2023-12-26 08:16:41,645][123090] Updated weights for policy 1, policy_version 1080254 (0.0009) [2023-12-26 08:16:41,657][123091] Updated weights for policy 0, policy_version 1087952 (0.0009) [2023-12-26 08:16:42,531][123091] Updated weights for policy 0, policy_version 1087962 (0.0010) [2023-12-26 08:16:42,536][123090] Updated weights for policy 1, policy_version 1080264 (0.0007) [2023-12-26 08:16:42,603][123091] Updated weights for policy 0, policy_version 1087972 (0.0008) [2023-12-26 08:16:42,605][123090] Updated weights for policy 1, policy_version 1080274 (0.0007) [2023-12-26 08:16:42,668][123091] Updated weights for policy 0, policy_version 1087982 (0.0009) [2023-12-26 08:16:42,671][123090] Updated weights for policy 1, policy_version 1080284 (0.0008) [2023-12-26 08:16:43,408][123090] Updated weights for policy 1, policy_version 1080294 (0.0007) [2023-12-26 08:16:43,480][123090] Updated weights for policy 1, policy_version 1080304 (0.0006) [2023-12-26 08:16:43,525][123091] Updated weights for policy 0, policy_version 1087992 (0.0009) [2023-12-26 08:16:43,550][123090] Updated weights for policy 1, policy_version 1080314 (0.0010) [2023-12-26 08:16:43,578][123091] Updated weights for policy 0, policy_version 1088002 (0.0007) [2023-12-26 08:16:43,627][123091] Updated weights for policy 0, policy_version 1088012 (0.0005) [2023-12-26 08:16:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 555098112. Throughput: 0: 9029.6, 1: 8609.3. Samples: 555086940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:43,785][121949] Avg episode reward: [(0, '6042.017'), (1, '5509.194')] [2023-12-26 08:16:44,208][123091] Updated weights for policy 0, policy_version 1088022 (0.0005) [2023-12-26 08:16:44,211][123090] Updated weights for policy 1, policy_version 1080324 (0.0008) [2023-12-26 08:16:44,273][123091] Updated weights for policy 0, policy_version 1088032 (0.0005) [2023-12-26 08:16:44,281][123090] Updated weights for policy 1, policy_version 1080334 (0.0005) [2023-12-26 08:16:44,339][123090] Updated weights for policy 1, policy_version 1080344 (0.0005) [2023-12-26 08:16:44,340][123091] Updated weights for policy 0, policy_version 1088042 (0.0005) [2023-12-26 08:16:45,036][123091] Updated weights for policy 0, policy_version 1088052 (0.0007) [2023-12-26 08:16:45,101][123091] Updated weights for policy 0, policy_version 1088062 (0.0010) [2023-12-26 08:16:45,105][123090] Updated weights for policy 1, policy_version 1080354 (0.0009) [2023-12-26 08:16:45,165][123091] Updated weights for policy 0, policy_version 1088072 (0.0010) [2023-12-26 08:16:45,175][123090] Updated weights for policy 1, policy_version 1080364 (0.0006) [2023-12-26 08:16:45,243][123090] Updated weights for policy 1, policy_version 1080374 (0.0006) [2023-12-26 08:16:45,300][123090] Updated weights for policy 1, policy_version 1080384 (0.0006) [2023-12-26 08:16:46,000][123091] Updated weights for policy 0, policy_version 1088082 (0.0008) [2023-12-26 08:16:46,070][123091] Updated weights for policy 0, policy_version 1088092 (0.0009) [2023-12-26 08:16:46,096][123090] Updated weights for policy 1, policy_version 1080394 (0.0007) [2023-12-26 08:16:46,123][123091] Updated weights for policy 0, policy_version 1088102 (0.0009) [2023-12-26 08:16:46,148][123090] Updated weights for policy 1, policy_version 1080404 (0.0007) [2023-12-26 08:16:46,184][123091] Updated weights for policy 0, policy_version 1088112 (0.0008) [2023-12-26 08:16:46,204][123090] Updated weights for policy 1, policy_version 1080414 (0.0010) [2023-12-26 08:16:46,970][123091] Updated weights for policy 0, policy_version 1088122 (0.0009) [2023-12-26 08:16:47,026][123091] Updated weights for policy 0, policy_version 1088132 (0.0009) [2023-12-26 08:16:47,032][123090] Updated weights for policy 1, policy_version 1080424 (0.0008) [2023-12-26 08:16:47,090][123091] Updated weights for policy 0, policy_version 1088142 (0.0007) [2023-12-26 08:16:47,092][123090] Updated weights for policy 1, policy_version 1080434 (0.0009) [2023-12-26 08:16:47,159][123090] Updated weights for policy 1, policy_version 1080444 (0.0008) [2023-12-26 08:16:47,901][123091] Updated weights for policy 0, policy_version 1088152 (0.0008) [2023-12-26 08:16:47,966][123091] Updated weights for policy 0, policy_version 1088162 (0.0010) [2023-12-26 08:16:47,982][123090] Updated weights for policy 1, policy_version 1080454 (0.0008) [2023-12-26 08:16:48,028][123091] Updated weights for policy 0, policy_version 1088172 (0.0009) [2023-12-26 08:16:48,032][123090] Updated weights for policy 1, policy_version 1080464 (0.0008) [2023-12-26 08:16:48,094][123090] Updated weights for policy 1, policy_version 1080474 (0.0009) [2023-12-26 08:16:48,738][123091] Updated weights for policy 0, policy_version 1088182 (0.0007) [2023-12-26 08:16:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 555180032. Throughput: 0: 9047.4, 1: 8695.7. Samples: 555196520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:48,785][121949] Avg episode reward: [(0, '5960.358'), (1, '5491.548')] [2023-12-26 08:16:48,810][123091] Updated weights for policy 0, policy_version 1088192 (0.0006) [2023-12-26 08:16:48,838][123090] Updated weights for policy 1, policy_version 1080484 (0.0007) [2023-12-26 08:16:48,881][123091] Updated weights for policy 0, policy_version 1088202 (0.0005) [2023-12-26 08:16:48,899][123090] Updated weights for policy 1, policy_version 1080495 (0.0009) [2023-12-26 08:16:48,958][123090] Updated weights for policy 1, policy_version 1080505 (0.0009) [2023-12-26 08:16:49,647][123091] Updated weights for policy 0, policy_version 1088212 (0.0007) [2023-12-26 08:16:49,707][123091] Updated weights for policy 0, policy_version 1088222 (0.0009) [2023-12-26 08:16:49,766][123091] Updated weights for policy 0, policy_version 1088232 (0.0010) [2023-12-26 08:16:49,796][123090] Updated weights for policy 1, policy_version 1080515 (0.0007) [2023-12-26 08:16:49,868][123090] Updated weights for policy 1, policy_version 1080525 (0.0009) [2023-12-26 08:16:49,926][123090] Updated weights for policy 1, policy_version 1080535 (0.0008) [2023-12-26 08:16:50,595][123091] Updated weights for policy 0, policy_version 1088242 (0.0009) [2023-12-26 08:16:50,655][123091] Updated weights for policy 0, policy_version 1088252 (0.0010) [2023-12-26 08:16:50,721][123091] Updated weights for policy 0, policy_version 1088262 (0.0010) [2023-12-26 08:16:50,784][123091] Updated weights for policy 0, policy_version 1088272 (0.0009) [2023-12-26 08:16:50,841][123090] Updated weights for policy 1, policy_version 1080545 (0.0008) [2023-12-26 08:16:50,889][123090] Updated weights for policy 1, policy_version 1080555 (0.0009) [2023-12-26 08:16:50,938][123090] Updated weights for policy 1, policy_version 1080565 (0.0009) [2023-12-26 08:16:50,993][123090] Updated weights for policy 1, policy_version 1080575 (0.0009) [2023-12-26 08:16:51,641][123091] Updated weights for policy 0, policy_version 1088282 (0.0010) [2023-12-26 08:16:51,713][123091] Updated weights for policy 0, policy_version 1088292 (0.0010) [2023-12-26 08:16:51,773][123091] Updated weights for policy 0, policy_version 1088302 (0.0009) [2023-12-26 08:16:51,883][123090] Updated weights for policy 1, policy_version 1080585 (0.0010) [2023-12-26 08:16:51,951][123090] Updated weights for policy 1, policy_version 1080595 (0.0006) [2023-12-26 08:16:52,012][123090] Updated weights for policy 1, policy_version 1080605 (0.0008) [2023-12-26 08:16:52,622][123091] Updated weights for policy 0, policy_version 1088312 (0.0009) [2023-12-26 08:16:52,677][123091] Updated weights for policy 0, policy_version 1088322 (0.0010) [2023-12-26 08:16:52,707][123090] Updated weights for policy 1, policy_version 1080615 (0.0009) [2023-12-26 08:16:52,742][123091] Updated weights for policy 0, policy_version 1088332 (0.0009) [2023-12-26 08:16:52,766][123090] Updated weights for policy 1, policy_version 1080625 (0.0009) [2023-12-26 08:16:52,835][123090] Updated weights for policy 1, policy_version 1080635 (0.0007) [2023-12-26 08:16:53,575][123091] Updated weights for policy 0, policy_version 1088342 (0.0009) [2023-12-26 08:16:53,626][123091] Updated weights for policy 0, policy_version 1088352 (0.0009) [2023-12-26 08:16:53,653][123090] Updated weights for policy 1, policy_version 1080645 (0.0007) [2023-12-26 08:16:53,680][123091] Updated weights for policy 0, policy_version 1088362 (0.0009) [2023-12-26 08:16:53,729][123090] Updated weights for policy 1, policy_version 1080655 (0.0006) [2023-12-26 08:16:53,783][123090] Updated weights for policy 1, policy_version 1080665 (0.0009) [2023-12-26 08:16:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 555270144. Throughput: 0: 8985.2, 1: 8686.0. Samples: 555247144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:53,785][121949] Avg episode reward: [(0, '6049.221'), (1, '5491.210')] [2023-12-26 08:16:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001088368_278626304.pth... [2023-12-26 08:16:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001087312_278355968.pth [2023-12-26 08:16:53,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001080672_276652032.pth... [2023-12-26 08:16:53,836][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001079616_276381696.pth [2023-12-26 08:16:54,416][123090] Updated weights for policy 1, policy_version 1080675 (0.0007) [2023-12-26 08:16:54,475][123090] Updated weights for policy 1, policy_version 1080685 (0.0009) [2023-12-26 08:16:54,528][123090] Updated weights for policy 1, policy_version 1080695 (0.0009) [2023-12-26 08:16:54,571][123091] Updated weights for policy 0, policy_version 1088372 (0.0008) [2023-12-26 08:16:54,628][123091] Updated weights for policy 0, policy_version 1088382 (0.0009) [2023-12-26 08:16:54,688][123091] Updated weights for policy 0, policy_version 1088392 (0.0008) [2023-12-26 08:16:55,240][123090] Updated weights for policy 1, policy_version 1080706 (0.0008) [2023-12-26 08:16:55,308][123090] Updated weights for policy 1, policy_version 1080716 (0.0006) [2023-12-26 08:16:55,382][123090] Updated weights for policy 1, policy_version 1080726 (0.0005) [2023-12-26 08:16:55,454][123090] Updated weights for policy 1, policy_version 1080736 (0.0005) [2023-12-26 08:16:55,596][123091] Updated weights for policy 0, policy_version 1088402 (0.0010) [2023-12-26 08:16:55,657][123091] Updated weights for policy 0, policy_version 1088412 (0.0010) [2023-12-26 08:16:55,709][123091] Updated weights for policy 0, policy_version 1088422 (0.0009) [2023-12-26 08:16:55,760][123091] Updated weights for policy 0, policy_version 1088432 (0.0009) [2023-12-26 08:16:56,077][123090] Updated weights for policy 1, policy_version 1080746 (0.0008) [2023-12-26 08:16:56,135][123090] Updated weights for policy 1, policy_version 1080756 (0.0005) [2023-12-26 08:16:56,202][123090] Updated weights for policy 1, policy_version 1080767 (0.0009) [2023-12-26 08:16:56,595][123091] Updated weights for policy 0, policy_version 1088442 (0.0005) [2023-12-26 08:16:56,647][123091] Updated weights for policy 0, policy_version 1088452 (0.0005) [2023-12-26 08:16:56,692][123091] Updated weights for policy 0, policy_version 1088462 (0.0005) [2023-12-26 08:16:57,049][123090] Updated weights for policy 1, policy_version 1080777 (0.0007) [2023-12-26 08:16:57,094][123090] Updated weights for policy 1, policy_version 1080787 (0.0005) [2023-12-26 08:16:57,147][123090] Updated weights for policy 1, policy_version 1080797 (0.0006) [2023-12-26 08:16:57,389][123091] Updated weights for policy 0, policy_version 1088472 (0.0006) [2023-12-26 08:16:57,460][123091] Updated weights for policy 0, policy_version 1088482 (0.0008) [2023-12-26 08:16:57,515][123091] Updated weights for policy 0, policy_version 1088492 (0.0009) [2023-12-26 08:16:58,022][123090] Updated weights for policy 1, policy_version 1080807 (0.0010) [2023-12-26 08:16:58,097][123090] Updated weights for policy 1, policy_version 1080817 (0.0011) [2023-12-26 08:16:58,160][123090] Updated weights for policy 1, policy_version 1080827 (0.0010) [2023-12-26 08:16:58,329][123091] Updated weights for policy 0, policy_version 1088502 (0.0009) [2023-12-26 08:16:58,399][123091] Updated weights for policy 0, policy_version 1088512 (0.0009) [2023-12-26 08:16:58,468][123091] Updated weights for policy 0, policy_version 1088522 (0.0009) [2023-12-26 08:16:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 555360256. Throughput: 0: 8912.7, 1: 8848.8. Samples: 555353972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:16:58,785][121949] Avg episode reward: [(0, '6007.679'), (1, '5366.991')] [2023-12-26 08:16:59,025][123090] Updated weights for policy 1, policy_version 1080837 (0.0010) [2023-12-26 08:16:59,072][123090] Updated weights for policy 1, policy_version 1080847 (0.0010) [2023-12-26 08:16:59,126][123090] Updated weights for policy 1, policy_version 1080857 (0.0010) [2023-12-26 08:16:59,322][123091] Updated weights for policy 0, policy_version 1088532 (0.0008) [2023-12-26 08:16:59,395][123091] Updated weights for policy 0, policy_version 1088542 (0.0007) [2023-12-26 08:16:59,453][123091] Updated weights for policy 0, policy_version 1088552 (0.0005) [2023-12-26 08:16:59,891][123090] Updated weights for policy 1, policy_version 1080867 (0.0006) [2023-12-26 08:16:59,954][123090] Updated weights for policy 1, policy_version 1080877 (0.0009) [2023-12-26 08:17:00,016][123090] Updated weights for policy 1, policy_version 1080887 (0.0009) [2023-12-26 08:17:00,123][123091] Updated weights for policy 0, policy_version 1088562 (0.0006) [2023-12-26 08:17:00,181][123091] Updated weights for policy 0, policy_version 1088572 (0.0009) [2023-12-26 08:17:00,229][123091] Updated weights for policy 0, policy_version 1088582 (0.0010) [2023-12-26 08:17:00,276][123091] Updated weights for policy 0, policy_version 1088592 (0.0009) [2023-12-26 08:17:00,724][123090] Updated weights for policy 1, policy_version 1080897 (0.0006) [2023-12-26 08:17:00,783][123090] Updated weights for policy 1, policy_version 1080907 (0.0009) [2023-12-26 08:17:00,848][123090] Updated weights for policy 1, policy_version 1080917 (0.0005) [2023-12-26 08:17:00,911][123090] Updated weights for policy 1, policy_version 1080927 (0.0005) [2023-12-26 08:17:01,086][123091] Updated weights for policy 0, policy_version 1088602 (0.0010) [2023-12-26 08:17:01,144][123091] Updated weights for policy 0, policy_version 1088612 (0.0010) [2023-12-26 08:17:01,203][123091] Updated weights for policy 0, policy_version 1088622 (0.0009) [2023-12-26 08:17:01,671][123090] Updated weights for policy 1, policy_version 1080937 (0.0006) [2023-12-26 08:17:01,742][123090] Updated weights for policy 1, policy_version 1080947 (0.0007) [2023-12-26 08:17:01,803][123090] Updated weights for policy 1, policy_version 1080957 (0.0009) [2023-12-26 08:17:01,991][123091] Updated weights for policy 0, policy_version 1088632 (0.0006) [2023-12-26 08:17:02,052][123091] Updated weights for policy 0, policy_version 1088642 (0.0006) [2023-12-26 08:17:02,109][123091] Updated weights for policy 0, policy_version 1088652 (0.0009) [2023-12-26 08:17:02,633][123090] Updated weights for policy 1, policy_version 1080968 (0.0006) [2023-12-26 08:17:02,687][123090] Updated weights for policy 1, policy_version 1080978 (0.0007) [2023-12-26 08:17:02,745][123090] Updated weights for policy 1, policy_version 1080988 (0.0010) [2023-12-26 08:17:02,893][123091] Updated weights for policy 0, policy_version 1088662 (0.0009) [2023-12-26 08:17:02,959][123091] Updated weights for policy 0, policy_version 1088672 (0.0009) [2023-12-26 08:17:03,020][123091] Updated weights for policy 0, policy_version 1088682 (0.0007) [2023-12-26 08:17:03,560][123090] Updated weights for policy 1, policy_version 1080998 (0.0007) [2023-12-26 08:17:03,630][123090] Updated weights for policy 1, policy_version 1081008 (0.0005) [2023-12-26 08:17:03,686][123090] Updated weights for policy 1, policy_version 1081018 (0.0005) [2023-12-26 08:17:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 555450368. Throughput: 0: 8856.5, 1: 8873.8. Samples: 555460916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:03,785][121949] Avg episode reward: [(0, '6093.819'), (1, '5423.486')] [2023-12-26 08:17:03,843][123091] Updated weights for policy 0, policy_version 1088692 (0.0008) [2023-12-26 08:17:03,907][123091] Updated weights for policy 0, policy_version 1088702 (0.0006) [2023-12-26 08:17:03,971][123091] Updated weights for policy 0, policy_version 1088712 (0.0005) [2023-12-26 08:17:04,453][123090] Updated weights for policy 1, policy_version 1081028 (0.0007) [2023-12-26 08:17:04,509][123090] Updated weights for policy 1, policy_version 1081038 (0.0008) [2023-12-26 08:17:04,578][123090] Updated weights for policy 1, policy_version 1081048 (0.0009) [2023-12-26 08:17:04,698][123091] Updated weights for policy 0, policy_version 1088722 (0.0007) [2023-12-26 08:17:04,761][123091] Updated weights for policy 0, policy_version 1088732 (0.0010) [2023-12-26 08:17:04,816][123091] Updated weights for policy 0, policy_version 1088742 (0.0011) [2023-12-26 08:17:04,880][123091] Updated weights for policy 0, policy_version 1088752 (0.0011) [2023-12-26 08:17:05,262][123090] Updated weights for policy 1, policy_version 1081058 (0.0007) [2023-12-26 08:17:05,328][123090] Updated weights for policy 1, policy_version 1081068 (0.0008) [2023-12-26 08:17:05,400][123090] Updated weights for policy 1, policy_version 1081078 (0.0008) [2023-12-26 08:17:05,464][123090] Updated weights for policy 1, policy_version 1081088 (0.0008) [2023-12-26 08:17:05,639][123091] Updated weights for policy 0, policy_version 1088762 (0.0006) [2023-12-26 08:17:05,703][123091] Updated weights for policy 0, policy_version 1088772 (0.0006) [2023-12-26 08:17:05,757][123091] Updated weights for policy 0, policy_version 1088782 (0.0005) [2023-12-26 08:17:06,145][123090] Updated weights for policy 1, policy_version 1081098 (0.0009) [2023-12-26 08:17:06,209][123090] Updated weights for policy 1, policy_version 1081108 (0.0009) [2023-12-26 08:17:06,264][123090] Updated weights for policy 1, policy_version 1081118 (0.0009) [2023-12-26 08:17:06,498][123091] Updated weights for policy 0, policy_version 1088792 (0.0008) [2023-12-26 08:17:06,550][123091] Updated weights for policy 0, policy_version 1088802 (0.0011) [2023-12-26 08:17:06,610][123091] Updated weights for policy 0, policy_version 1088812 (0.0011) [2023-12-26 08:17:07,080][123090] Updated weights for policy 1, policy_version 1081128 (0.0006) [2023-12-26 08:17:07,142][123090] Updated weights for policy 1, policy_version 1081139 (0.0007) [2023-12-26 08:17:07,194][123090] Updated weights for policy 1, policy_version 1081149 (0.0005) [2023-12-26 08:17:07,383][123091] Updated weights for policy 0, policy_version 1088822 (0.0007) [2023-12-26 08:17:07,435][123091] Updated weights for policy 0, policy_version 1088832 (0.0005) [2023-12-26 08:17:07,492][123091] Updated weights for policy 0, policy_version 1088842 (0.0005) [2023-12-26 08:17:08,075][123090] Updated weights for policy 1, policy_version 1081159 (0.0005) [2023-12-26 08:17:08,134][123090] Updated weights for policy 1, policy_version 1081169 (0.0005) [2023-12-26 08:17:08,166][123091] Updated weights for policy 0, policy_version 1088852 (0.0006) [2023-12-26 08:17:08,201][123090] Updated weights for policy 1, policy_version 1081179 (0.0005) [2023-12-26 08:17:08,219][123091] Updated weights for policy 0, policy_version 1088862 (0.0007) [2023-12-26 08:17:08,266][123091] Updated weights for policy 0, policy_version 1088872 (0.0005) [2023-12-26 08:17:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 555540480. Throughput: 0: 8886.7, 1: 8904.7. Samples: 555516112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:08,785][121949] Avg episode reward: [(0, '6116.986'), (1, '5594.058')] [2023-12-26 08:17:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001088880_278757376.pth... [2023-12-26 08:17:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001081184_276783104.pth... [2023-12-26 08:17:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001087856_278495232.pth [2023-12-26 08:17:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001080160_276520960.pth [2023-12-26 08:17:08,953][123090] Updated weights for policy 1, policy_version 1081189 (0.0005) [2023-12-26 08:17:09,022][123090] Updated weights for policy 1, policy_version 1081199 (0.0005) [2023-12-26 08:17:09,033][123091] Updated weights for policy 0, policy_version 1088882 (0.0006) [2023-12-26 08:17:09,087][123090] Updated weights for policy 1, policy_version 1081209 (0.0005) [2023-12-26 08:17:09,087][123091] Updated weights for policy 0, policy_version 1088892 (0.0007) [2023-12-26 08:17:09,143][123091] Updated weights for policy 0, policy_version 1088903 (0.0007) [2023-12-26 08:17:09,901][123090] Updated weights for policy 1, policy_version 1081219 (0.0007) [2023-12-26 08:17:09,966][123091] Updated weights for policy 0, policy_version 1088913 (0.0006) [2023-12-26 08:17:09,976][123090] Updated weights for policy 1, policy_version 1081229 (0.0009) [2023-12-26 08:17:10,033][123091] Updated weights for policy 0, policy_version 1088923 (0.0006) [2023-12-26 08:17:10,035][123090] Updated weights for policy 1, policy_version 1081239 (0.0008) [2023-12-26 08:17:10,091][123091] Updated weights for policy 0, policy_version 1088933 (0.0009) [2023-12-26 08:17:10,154][123091] Updated weights for policy 0, policy_version 1088943 (0.0010) [2023-12-26 08:17:10,901][123091] Updated weights for policy 0, policy_version 1088953 (0.0005) [2023-12-26 08:17:10,913][123090] Updated weights for policy 1, policy_version 1081249 (0.0007) [2023-12-26 08:17:10,958][123091] Updated weights for policy 0, policy_version 1088963 (0.0005) [2023-12-26 08:17:10,976][123090] Updated weights for policy 1, policy_version 1081259 (0.0010) [2023-12-26 08:17:11,027][123091] Updated weights for policy 0, policy_version 1088973 (0.0007) [2023-12-26 08:17:11,037][123090] Updated weights for policy 1, policy_version 1081269 (0.0010) [2023-12-26 08:17:11,106][123090] Updated weights for policy 1, policy_version 1081279 (0.0011) [2023-12-26 08:17:11,878][123091] Updated weights for policy 0, policy_version 1088983 (0.0009) [2023-12-26 08:17:11,940][123091] Updated weights for policy 0, policy_version 1088993 (0.0009) [2023-12-26 08:17:11,943][123090] Updated weights for policy 1, policy_version 1081289 (0.0008) [2023-12-26 08:17:12,000][123090] Updated weights for policy 1, policy_version 1081299 (0.0006) [2023-12-26 08:17:12,002][123091] Updated weights for policy 0, policy_version 1089003 (0.0010) [2023-12-26 08:17:12,066][123090] Updated weights for policy 1, policy_version 1081309 (0.0009) [2023-12-26 08:17:12,828][123090] Updated weights for policy 1, policy_version 1081319 (0.0006) [2023-12-26 08:17:12,877][123091] Updated weights for policy 0, policy_version 1089013 (0.0008) [2023-12-26 08:17:12,887][123090] Updated weights for policy 1, policy_version 1081329 (0.0005) [2023-12-26 08:17:12,940][123091] Updated weights for policy 0, policy_version 1089023 (0.0008) [2023-12-26 08:17:12,950][123090] Updated weights for policy 1, policy_version 1081339 (0.0008) [2023-12-26 08:17:12,993][123091] Updated weights for policy 0, policy_version 1089033 (0.0008) [2023-12-26 08:17:13,750][123090] Updated weights for policy 1, policy_version 1081349 (0.0010) [2023-12-26 08:17:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 555622400. Throughput: 0: 8876.8, 1: 8872.3. Samples: 555622380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:13,785][121949] Avg episode reward: [(0, '6095.161'), (1, '5698.322')] [2023-12-26 08:17:13,798][123090] Updated weights for policy 1, policy_version 1081359 (0.0010) [2023-12-26 08:17:13,819][123091] Updated weights for policy 0, policy_version 1089043 (0.0008) [2023-12-26 08:17:13,850][123090] Updated weights for policy 1, policy_version 1081369 (0.0010) [2023-12-26 08:17:13,870][123091] Updated weights for policy 0, policy_version 1089053 (0.0006) [2023-12-26 08:17:13,921][123091] Updated weights for policy 0, policy_version 1089063 (0.0007) [2023-12-26 08:17:14,714][123091] Updated weights for policy 0, policy_version 1089073 (0.0009) [2023-12-26 08:17:14,714][123090] Updated weights for policy 1, policy_version 1081379 (0.0011) [2023-12-26 08:17:14,774][123090] Updated weights for policy 1, policy_version 1081389 (0.0011) [2023-12-26 08:17:14,777][123091] Updated weights for policy 0, policy_version 1089083 (0.0007) [2023-12-26 08:17:14,835][123091] Updated weights for policy 0, policy_version 1089093 (0.0009) [2023-12-26 08:17:14,840][123090] Updated weights for policy 1, policy_version 1081399 (0.0008) [2023-12-26 08:17:14,884][123091] Updated weights for policy 0, policy_version 1089103 (0.0008) [2023-12-26 08:17:15,633][123090] Updated weights for policy 1, policy_version 1081409 (0.0006) [2023-12-26 08:17:15,696][123090] Updated weights for policy 1, policy_version 1081419 (0.0010) [2023-12-26 08:17:15,724][123091] Updated weights for policy 0, policy_version 1089113 (0.0007) [2023-12-26 08:17:15,759][123090] Updated weights for policy 1, policy_version 1081429 (0.0011) [2023-12-26 08:17:15,788][123091] Updated weights for policy 0, policy_version 1089123 (0.0006) [2023-12-26 08:17:15,819][123090] Updated weights for policy 1, policy_version 1081439 (0.0011) [2023-12-26 08:17:15,859][123091] Updated weights for policy 0, policy_version 1089133 (0.0007) [2023-12-26 08:17:16,543][123091] Updated weights for policy 0, policy_version 1089143 (0.0006) [2023-12-26 08:17:16,549][123090] Updated weights for policy 1, policy_version 1081449 (0.0010) [2023-12-26 08:17:16,600][123091] Updated weights for policy 0, policy_version 1089153 (0.0007) [2023-12-26 08:17:16,609][123090] Updated weights for policy 1, policy_version 1081459 (0.0009) [2023-12-26 08:17:16,664][123091] Updated weights for policy 0, policy_version 1089163 (0.0007) [2023-12-26 08:17:16,670][123090] Updated weights for policy 1, policy_version 1081469 (0.0009) [2023-12-26 08:17:17,430][123090] Updated weights for policy 1, policy_version 1081479 (0.0010) [2023-12-26 08:17:17,481][123090] Updated weights for policy 1, policy_version 1081489 (0.0010) [2023-12-26 08:17:17,496][123091] Updated weights for policy 0, policy_version 1089173 (0.0006) [2023-12-26 08:17:17,540][123090] Updated weights for policy 1, policy_version 1081499 (0.0010) [2023-12-26 08:17:17,548][123091] Updated weights for policy 0, policy_version 1089183 (0.0008) [2023-12-26 08:17:17,598][123091] Updated weights for policy 0, policy_version 1089193 (0.0008) [2023-12-26 08:17:18,375][123091] Updated weights for policy 0, policy_version 1089203 (0.0008) [2023-12-26 08:17:18,385][123090] Updated weights for policy 1, policy_version 1081509 (0.0010) [2023-12-26 08:17:18,435][123091] Updated weights for policy 0, policy_version 1089213 (0.0007) [2023-12-26 08:17:18,449][123090] Updated weights for policy 1, policy_version 1081519 (0.0011) [2023-12-26 08:17:18,498][123091] Updated weights for policy 0, policy_version 1089223 (0.0006) [2023-12-26 08:17:18,512][123090] Updated weights for policy 1, policy_version 1081529 (0.0010) [2023-12-26 08:17:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 555720704. Throughput: 0: 8804.3, 1: 8881.7. Samples: 555728188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:18,785][121949] Avg episode reward: [(0, '5955.724'), (1, '5664.424')] [2023-12-26 08:17:19,236][123090] Updated weights for policy 1, policy_version 1081539 (0.0007) [2023-12-26 08:17:19,303][123090] Updated weights for policy 1, policy_version 1081549 (0.0010) [2023-12-26 08:17:19,375][123090] Updated weights for policy 1, policy_version 1081559 (0.0010) [2023-12-26 08:17:19,433][123091] Updated weights for policy 0, policy_version 1089233 (0.0008) [2023-12-26 08:17:19,502][123091] Updated weights for policy 0, policy_version 1089243 (0.0011) [2023-12-26 08:17:19,561][123091] Updated weights for policy 0, policy_version 1089253 (0.0010) [2023-12-26 08:17:19,621][123091] Updated weights for policy 0, policy_version 1089263 (0.0011) [2023-12-26 08:17:20,134][123090] Updated weights for policy 1, policy_version 1081569 (0.0010) [2023-12-26 08:17:20,205][123090] Updated weights for policy 1, policy_version 1081579 (0.0008) [2023-12-26 08:17:20,274][123090] Updated weights for policy 1, policy_version 1081589 (0.0009) [2023-12-26 08:17:20,344][123090] Updated weights for policy 1, policy_version 1081599 (0.0008) [2023-12-26 08:17:20,463][123091] Updated weights for policy 0, policy_version 1089273 (0.0011) [2023-12-26 08:17:20,518][123091] Updated weights for policy 0, policy_version 1089283 (0.0010) [2023-12-26 08:17:20,578][123091] Updated weights for policy 0, policy_version 1089293 (0.0010) [2023-12-26 08:17:21,165][123090] Updated weights for policy 1, policy_version 1081609 (0.0009) [2023-12-26 08:17:21,234][123090] Updated weights for policy 1, policy_version 1081619 (0.0009) [2023-12-26 08:17:21,308][123090] Updated weights for policy 1, policy_version 1081629 (0.0009) [2023-12-26 08:17:21,422][123091] Updated weights for policy 0, policy_version 1089303 (0.0008) [2023-12-26 08:17:21,489][123091] Updated weights for policy 0, policy_version 1089313 (0.0006) [2023-12-26 08:17:21,557][123091] Updated weights for policy 0, policy_version 1089323 (0.0006) [2023-12-26 08:17:22,071][123090] Updated weights for policy 1, policy_version 1081639 (0.0007) [2023-12-26 08:17:22,123][123090] Updated weights for policy 1, policy_version 1081649 (0.0011) [2023-12-26 08:17:22,176][123090] Updated weights for policy 1, policy_version 1081659 (0.0010) [2023-12-26 08:17:22,361][123091] Updated weights for policy 0, policy_version 1089333 (0.0010) [2023-12-26 08:17:22,424][123091] Updated weights for policy 0, policy_version 1089343 (0.0011) [2023-12-26 08:17:22,499][123091] Updated weights for policy 0, policy_version 1089353 (0.0011) [2023-12-26 08:17:22,999][123090] Updated weights for policy 1, policy_version 1081669 (0.0008) [2023-12-26 08:17:23,065][123090] Updated weights for policy 1, policy_version 1081679 (0.0006) [2023-12-26 08:17:23,128][123090] Updated weights for policy 1, policy_version 1081689 (0.0005) [2023-12-26 08:17:23,312][123091] Updated weights for policy 0, policy_version 1089363 (0.0009) [2023-12-26 08:17:23,380][123091] Updated weights for policy 0, policy_version 1089373 (0.0005) [2023-12-26 08:17:23,450][123091] Updated weights for policy 0, policy_version 1089383 (0.0006) [2023-12-26 08:17:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 555802624. Throughput: 0: 8779.9, 1: 8868.7. Samples: 555779840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:23,785][121949] Avg episode reward: [(0, '6045.003'), (1, '5832.988')] [2023-12-26 08:17:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001089392_278888448.pth... [2023-12-26 08:17:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001081696_276914176.pth... [2023-12-26 08:17:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001088368_278626304.pth [2023-12-26 08:17:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001080672_276652032.pth [2023-12-26 08:17:23,846][123090] Updated weights for policy 1, policy_version 1081699 (0.0008) [2023-12-26 08:17:23,915][123090] Updated weights for policy 1, policy_version 1081709 (0.0010) [2023-12-26 08:17:23,972][123090] Updated weights for policy 1, policy_version 1081719 (0.0006) [2023-12-26 08:17:24,171][123091] Updated weights for policy 0, policy_version 1089393 (0.0009) [2023-12-26 08:17:24,233][123091] Updated weights for policy 0, policy_version 1089403 (0.0010) [2023-12-26 08:17:24,291][123091] Updated weights for policy 0, policy_version 1089413 (0.0010) [2023-12-26 08:17:24,349][123091] Updated weights for policy 0, policy_version 1089423 (0.0010) [2023-12-26 08:17:24,680][123090] Updated weights for policy 1, policy_version 1081729 (0.0006) [2023-12-26 08:17:24,739][123090] Updated weights for policy 1, policy_version 1081739 (0.0010) [2023-12-26 08:17:24,803][123090] Updated weights for policy 1, policy_version 1081749 (0.0011) [2023-12-26 08:17:24,853][123090] Updated weights for policy 1, policy_version 1081759 (0.0006) [2023-12-26 08:17:25,152][123091] Updated weights for policy 0, policy_version 1089433 (0.0006) [2023-12-26 08:17:25,207][123091] Updated weights for policy 0, policy_version 1089443 (0.0005) [2023-12-26 08:17:25,252][123091] Updated weights for policy 0, policy_version 1089453 (0.0005) [2023-12-26 08:17:25,589][123090] Updated weights for policy 1, policy_version 1081769 (0.0008) [2023-12-26 08:17:25,659][123090] Updated weights for policy 1, policy_version 1081779 (0.0008) [2023-12-26 08:17:25,728][123090] Updated weights for policy 1, policy_version 1081789 (0.0008) [2023-12-26 08:17:25,926][123091] Updated weights for policy 0, policy_version 1089463 (0.0005) [2023-12-26 08:17:25,977][123091] Updated weights for policy 0, policy_version 1089473 (0.0005) [2023-12-26 08:17:26,034][123091] Updated weights for policy 0, policy_version 1089483 (0.0005) [2023-12-26 08:17:26,406][123090] Updated weights for policy 1, policy_version 1081799 (0.0007) [2023-12-26 08:17:26,459][123090] Updated weights for policy 1, policy_version 1081809 (0.0005) [2023-12-26 08:17:26,516][123090] Updated weights for policy 1, policy_version 1081819 (0.0005) [2023-12-26 08:17:26,733][123091] Updated weights for policy 0, policy_version 1089493 (0.0005) [2023-12-26 08:17:26,793][123091] Updated weights for policy 0, policy_version 1089503 (0.0007) [2023-12-26 08:17:26,846][123091] Updated weights for policy 0, policy_version 1089513 (0.0008) [2023-12-26 08:17:27,319][123090] Updated weights for policy 1, policy_version 1081829 (0.0008) [2023-12-26 08:17:27,375][123090] Updated weights for policy 1, policy_version 1081839 (0.0010) [2023-12-26 08:17:27,437][123090] Updated weights for policy 1, policy_version 1081849 (0.0007) [2023-12-26 08:17:27,638][123091] Updated weights for policy 0, policy_version 1089523 (0.0007) [2023-12-26 08:17:27,705][123091] Updated weights for policy 0, policy_version 1089533 (0.0007) [2023-12-26 08:17:27,766][123091] Updated weights for policy 0, policy_version 1089543 (0.0007) [2023-12-26 08:17:28,175][123090] Updated weights for policy 1, policy_version 1081859 (0.0006) [2023-12-26 08:17:28,239][123090] Updated weights for policy 1, policy_version 1081869 (0.0008) [2023-12-26 08:17:28,307][123090] Updated weights for policy 1, policy_version 1081879 (0.0009) [2023-12-26 08:17:28,484][123091] Updated weights for policy 0, policy_version 1089553 (0.0006) [2023-12-26 08:17:28,548][123091] Updated weights for policy 0, policy_version 1089563 (0.0011) [2023-12-26 08:17:28,600][123091] Updated weights for policy 0, policy_version 1089573 (0.0011) [2023-12-26 08:17:28,660][123091] Updated weights for policy 0, policy_version 1089583 (0.0011) [2023-12-26 08:17:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 555900928. Throughput: 0: 8893.4, 1: 8989.4. Samples: 555891668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:28,785][121949] Avg episode reward: [(0, '6131.992'), (1, '5832.409')] [2023-12-26 08:17:29,056][123090] Updated weights for policy 1, policy_version 1081889 (0.0008) [2023-12-26 08:17:29,109][123090] Updated weights for policy 1, policy_version 1081899 (0.0005) [2023-12-26 08:17:29,158][123090] Updated weights for policy 1, policy_version 1081909 (0.0005) [2023-12-26 08:17:29,203][123090] Updated weights for policy 1, policy_version 1081919 (0.0005) [2023-12-26 08:17:29,449][123091] Updated weights for policy 0, policy_version 1089593 (0.0011) [2023-12-26 08:17:29,512][123091] Updated weights for policy 0, policy_version 1089603 (0.0011) [2023-12-26 08:17:29,574][123091] Updated weights for policy 0, policy_version 1089613 (0.0011) [2023-12-26 08:17:29,898][123090] Updated weights for policy 1, policy_version 1081929 (0.0005) [2023-12-26 08:17:29,968][123090] Updated weights for policy 1, policy_version 1081939 (0.0008) [2023-12-26 08:17:30,029][123090] Updated weights for policy 1, policy_version 1081949 (0.0009) [2023-12-26 08:17:30,396][123091] Updated weights for policy 0, policy_version 1089623 (0.0010) [2023-12-26 08:17:30,444][123091] Updated weights for policy 0, policy_version 1089633 (0.0010) [2023-12-26 08:17:30,506][123091] Updated weights for policy 0, policy_version 1089643 (0.0010) [2023-12-26 08:17:30,815][123090] Updated weights for policy 1, policy_version 1081959 (0.0007) [2023-12-26 08:17:30,867][123090] Updated weights for policy 1, policy_version 1081969 (0.0005) [2023-12-26 08:17:30,938][123090] Updated weights for policy 1, policy_version 1081979 (0.0008) [2023-12-26 08:17:31,357][123091] Updated weights for policy 0, policy_version 1089653 (0.0010) [2023-12-26 08:17:31,424][123091] Updated weights for policy 0, policy_version 1089663 (0.0009) [2023-12-26 08:17:31,495][123091] Updated weights for policy 0, policy_version 1089673 (0.0008) [2023-12-26 08:17:31,698][123090] Updated weights for policy 1, policy_version 1081989 (0.0009) [2023-12-26 08:17:31,769][123090] Updated weights for policy 1, policy_version 1081999 (0.0009) [2023-12-26 08:17:31,826][123090] Updated weights for policy 1, policy_version 1082009 (0.0005) [2023-12-26 08:17:32,247][123091] Updated weights for policy 0, policy_version 1089683 (0.0010) [2023-12-26 08:17:32,307][123091] Updated weights for policy 0, policy_version 1089693 (0.0010) [2023-12-26 08:17:32,379][123091] Updated weights for policy 0, policy_version 1089703 (0.0008) [2023-12-26 08:17:32,584][123090] Updated weights for policy 1, policy_version 1082019 (0.0007) [2023-12-26 08:17:32,632][123090] Updated weights for policy 1, policy_version 1082029 (0.0009) [2023-12-26 08:17:32,681][123090] Updated weights for policy 1, policy_version 1082039 (0.0009) [2023-12-26 08:17:33,211][123091] Updated weights for policy 0, policy_version 1089713 (0.0009) [2023-12-26 08:17:33,273][123091] Updated weights for policy 0, policy_version 1089723 (0.0006) [2023-12-26 08:17:33,324][123091] Updated weights for policy 0, policy_version 1089733 (0.0009) [2023-12-26 08:17:33,371][123091] Updated weights for policy 0, policy_version 1089743 (0.0009) [2023-12-26 08:17:33,550][123090] Updated weights for policy 1, policy_version 1082049 (0.0009) [2023-12-26 08:17:33,614][123090] Updated weights for policy 1, policy_version 1082059 (0.0009) [2023-12-26 08:17:33,671][123090] Updated weights for policy 1, policy_version 1082069 (0.0008) [2023-12-26 08:17:33,735][123090] Updated weights for policy 1, policy_version 1082079 (0.0005) [2023-12-26 08:17:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 555991040. Throughput: 0: 8839.0, 1: 8989.4. Samples: 555998800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:33,785][121949] Avg episode reward: [(0, '6255.841'), (1, '5711.931')] [2023-12-26 08:17:34,177][123091] Updated weights for policy 0, policy_version 1089753 (0.0010) [2023-12-26 08:17:34,239][123091] Updated weights for policy 0, policy_version 1089763 (0.0010) [2023-12-26 08:17:34,296][123091] Updated weights for policy 0, policy_version 1089773 (0.0009) [2023-12-26 08:17:34,521][123090] Updated weights for policy 1, policy_version 1082089 (0.0006) [2023-12-26 08:17:34,584][123090] Updated weights for policy 1, policy_version 1082099 (0.0005) [2023-12-26 08:17:34,653][123090] Updated weights for policy 1, policy_version 1082109 (0.0009) [2023-12-26 08:17:35,156][123091] Updated weights for policy 0, policy_version 1089783 (0.0009) [2023-12-26 08:17:35,223][123091] Updated weights for policy 0, policy_version 1089793 (0.0009) [2023-12-26 08:17:35,291][123091] Updated weights for policy 0, policy_version 1089803 (0.0010) [2023-12-26 08:17:35,450][123090] Updated weights for policy 1, policy_version 1082119 (0.0009) [2023-12-26 08:17:35,503][123090] Updated weights for policy 1, policy_version 1082130 (0.0007) [2023-12-26 08:17:35,551][123090] Updated weights for policy 1, policy_version 1082140 (0.0006) [2023-12-26 08:17:36,124][123091] Updated weights for policy 0, policy_version 1089813 (0.0009) [2023-12-26 08:17:36,189][123091] Updated weights for policy 0, policy_version 1089823 (0.0009) [2023-12-26 08:17:36,253][123091] Updated weights for policy 0, policy_version 1089833 (0.0009) [2023-12-26 08:17:36,386][123090] Updated weights for policy 1, policy_version 1082150 (0.0006) [2023-12-26 08:17:36,456][123090] Updated weights for policy 1, policy_version 1082160 (0.0005) [2023-12-26 08:17:36,528][123090] Updated weights for policy 1, policy_version 1082170 (0.0005) [2023-12-26 08:17:37,056][123091] Updated weights for policy 0, policy_version 1089843 (0.0009) [2023-12-26 08:17:37,123][123091] Updated weights for policy 0, policy_version 1089853 (0.0008) [2023-12-26 08:17:37,192][123091] Updated weights for policy 0, policy_version 1089863 (0.0005) [2023-12-26 08:17:37,312][123090] Updated weights for policy 1, policy_version 1082180 (0.0008) [2023-12-26 08:17:37,379][123090] Updated weights for policy 1, policy_version 1082190 (0.0008) [2023-12-26 08:17:37,446][123090] Updated weights for policy 1, policy_version 1082200 (0.0010) [2023-12-26 08:17:37,904][123091] Updated weights for policy 0, policy_version 1089873 (0.0007) [2023-12-26 08:17:37,974][123091] Updated weights for policy 0, policy_version 1089883 (0.0005) [2023-12-26 08:17:38,040][123091] Updated weights for policy 0, policy_version 1089893 (0.0008) [2023-12-26 08:17:38,102][123091] Updated weights for policy 0, policy_version 1089903 (0.0009) [2023-12-26 08:17:38,247][123090] Updated weights for policy 1, policy_version 1082210 (0.0010) [2023-12-26 08:17:38,314][123090] Updated weights for policy 1, policy_version 1082220 (0.0010) [2023-12-26 08:17:38,385][123090] Updated weights for policy 1, policy_version 1082230 (0.0011) [2023-12-26 08:17:38,455][123090] Updated weights for policy 1, policy_version 1082240 (0.0009) [2023-12-26 08:17:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 556072960. Throughput: 0: 8822.7, 1: 9028.7. Samples: 556050456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:38,785][121949] Avg episode reward: [(0, '6238.065'), (1, '5721.062')] [2023-12-26 08:17:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001082240_277053440.pth... [2023-12-26 08:17:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001089904_279019520.pth... [2023-12-26 08:17:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001081184_276783104.pth [2023-12-26 08:17:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001088880_278757376.pth [2023-12-26 08:17:38,886][123091] Updated weights for policy 0, policy_version 1089913 (0.0009) [2023-12-26 08:17:38,940][123091] Updated weights for policy 0, policy_version 1089923 (0.0009) [2023-12-26 08:17:38,995][123091] Updated weights for policy 0, policy_version 1089933 (0.0009) [2023-12-26 08:17:39,218][123090] Updated weights for policy 1, policy_version 1082250 (0.0010) [2023-12-26 08:17:39,288][123090] Updated weights for policy 1, policy_version 1082260 (0.0010) [2023-12-26 08:17:39,365][123090] Updated weights for policy 1, policy_version 1082270 (0.0012) [2023-12-26 08:17:39,926][123091] Updated weights for policy 0, policy_version 1089943 (0.0011) [2023-12-26 08:17:39,994][123091] Updated weights for policy 0, policy_version 1089953 (0.0010) [2023-12-26 08:17:40,060][123091] Updated weights for policy 0, policy_version 1089963 (0.0009) [2023-12-26 08:17:40,177][123090] Updated weights for policy 1, policy_version 1082280 (0.0010) [2023-12-26 08:17:40,244][123090] Updated weights for policy 1, policy_version 1082290 (0.0007) [2023-12-26 08:17:40,309][123090] Updated weights for policy 1, policy_version 1082300 (0.0011) [2023-12-26 08:17:40,874][123091] Updated weights for policy 0, policy_version 1089973 (0.0010) [2023-12-26 08:17:40,921][123091] Updated weights for policy 0, policy_version 1089983 (0.0010) [2023-12-26 08:17:40,972][123091] Updated weights for policy 0, policy_version 1089993 (0.0010) [2023-12-26 08:17:41,148][123090] Updated weights for policy 1, policy_version 1082310 (0.0010) [2023-12-26 08:17:41,215][123090] Updated weights for policy 1, policy_version 1082320 (0.0010) [2023-12-26 08:17:41,286][123090] Updated weights for policy 1, policy_version 1082330 (0.0009) [2023-12-26 08:17:41,746][123091] Updated weights for policy 0, policy_version 1090003 (0.0007) [2023-12-26 08:17:41,802][123091] Updated weights for policy 0, policy_version 1090013 (0.0011) [2023-12-26 08:17:41,854][123091] Updated weights for policy 0, policy_version 1090023 (0.0010) [2023-12-26 08:17:42,193][123090] Updated weights for policy 1, policy_version 1082340 (0.0009) [2023-12-26 08:17:42,261][123090] Updated weights for policy 1, policy_version 1082350 (0.0009) [2023-12-26 08:17:42,330][123090] Updated weights for policy 1, policy_version 1082360 (0.0009) [2023-12-26 08:17:42,692][123091] Updated weights for policy 0, policy_version 1090033 (0.0010) [2023-12-26 08:17:42,750][123091] Updated weights for policy 0, policy_version 1090043 (0.0007) [2023-12-26 08:17:42,803][123091] Updated weights for policy 0, policy_version 1090053 (0.0009) [2023-12-26 08:17:42,865][123091] Updated weights for policy 0, policy_version 1090063 (0.0009) [2023-12-26 08:17:43,206][123090] Updated weights for policy 1, policy_version 1082370 (0.0010) [2023-12-26 08:17:43,265][123090] Updated weights for policy 1, policy_version 1082380 (0.0009) [2023-12-26 08:17:43,332][123090] Updated weights for policy 1, policy_version 1082390 (0.0009) [2023-12-26 08:17:43,402][123090] Updated weights for policy 1, policy_version 1082400 (0.0010) [2023-12-26 08:17:43,629][123091] Updated weights for policy 0, policy_version 1090073 (0.0009) [2023-12-26 08:17:43,681][123091] Updated weights for policy 0, policy_version 1090083 (0.0009) [2023-12-26 08:17:43,732][123091] Updated weights for policy 0, policy_version 1090093 (0.0009) [2023-12-26 08:17:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 556163072. Throughput: 0: 8861.5, 1: 8904.6. Samples: 556153448. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:43,785][121949] Avg episode reward: [(0, '6180.929'), (1, '5825.575')] [2023-12-26 08:17:44,201][123090] Updated weights for policy 1, policy_version 1082410 (0.0009) [2023-12-26 08:17:44,252][123090] Updated weights for policy 1, policy_version 1082420 (0.0009) [2023-12-26 08:17:44,315][123090] Updated weights for policy 1, policy_version 1082430 (0.0009) [2023-12-26 08:17:44,554][123091] Updated weights for policy 0, policy_version 1090103 (0.0007) [2023-12-26 08:17:44,622][123091] Updated weights for policy 0, policy_version 1090113 (0.0005) [2023-12-26 08:17:44,694][123091] Updated weights for policy 0, policy_version 1090123 (0.0006) [2023-12-26 08:17:45,092][123090] Updated weights for policy 1, policy_version 1082440 (0.0010) [2023-12-26 08:17:45,149][123090] Updated weights for policy 1, policy_version 1082450 (0.0010) [2023-12-26 08:17:45,213][123090] Updated weights for policy 1, policy_version 1082460 (0.0009) [2023-12-26 08:17:45,423][123091] Updated weights for policy 0, policy_version 1090133 (0.0007) [2023-12-26 08:17:45,488][123091] Updated weights for policy 0, policy_version 1090143 (0.0011) [2023-12-26 08:17:45,561][123091] Updated weights for policy 0, policy_version 1090153 (0.0011) [2023-12-26 08:17:46,122][123090] Updated weights for policy 1, policy_version 1082470 (0.0009) [2023-12-26 08:17:46,186][123090] Updated weights for policy 1, policy_version 1082480 (0.0009) [2023-12-26 08:17:46,246][123090] Updated weights for policy 1, policy_version 1082490 (0.0009) [2023-12-26 08:17:46,268][123091] Updated weights for policy 0, policy_version 1090163 (0.0011) [2023-12-26 08:17:46,316][123091] Updated weights for policy 0, policy_version 1090173 (0.0011) [2023-12-26 08:17:46,368][123091] Updated weights for policy 0, policy_version 1090183 (0.0010) [2023-12-26 08:17:46,991][123090] Updated weights for policy 1, policy_version 1082500 (0.0007) [2023-12-26 08:17:47,043][123090] Updated weights for policy 1, policy_version 1082510 (0.0005) [2023-12-26 08:17:47,089][123090] Updated weights for policy 1, policy_version 1082520 (0.0005) [2023-12-26 08:17:47,203][123091] Updated weights for policy 0, policy_version 1090193 (0.0010) [2023-12-26 08:17:47,254][123091] Updated weights for policy 0, policy_version 1090203 (0.0005) [2023-12-26 08:17:47,311][123091] Updated weights for policy 0, policy_version 1090213 (0.0005) [2023-12-26 08:17:47,360][123091] Updated weights for policy 0, policy_version 1090223 (0.0009) [2023-12-26 08:17:47,806][123090] Updated weights for policy 1, policy_version 1082530 (0.0006) [2023-12-26 08:17:47,854][123090] Updated weights for policy 1, policy_version 1082540 (0.0010) [2023-12-26 08:17:47,901][123090] Updated weights for policy 1, policy_version 1082550 (0.0006) [2023-12-26 08:17:47,947][123090] Updated weights for policy 1, policy_version 1082560 (0.0005) [2023-12-26 08:17:48,119][123091] Updated weights for policy 0, policy_version 1090233 (0.0011) [2023-12-26 08:17:48,170][123091] Updated weights for policy 0, policy_version 1090243 (0.0010) [2023-12-26 08:17:48,218][123091] Updated weights for policy 0, policy_version 1090253 (0.0011) [2023-12-26 08:17:48,775][123090] Updated weights for policy 1, policy_version 1082570 (0.0006) [2023-12-26 08:17:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 556244992. Throughput: 0: 8881.7, 1: 8897.3. Samples: 556260972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:48,785][121949] Avg episode reward: [(0, '6228.726'), (1, '5798.312')] [2023-12-26 08:17:48,827][123090] Updated weights for policy 1, policy_version 1082580 (0.0005) [2023-12-26 08:17:48,898][123090] Updated weights for policy 1, policy_version 1082590 (0.0007) [2023-12-26 08:17:49,049][123091] Updated weights for policy 0, policy_version 1090263 (0.0007) [2023-12-26 08:17:49,103][123091] Updated weights for policy 0, policy_version 1090273 (0.0005) [2023-12-26 08:17:49,155][123091] Updated weights for policy 0, policy_version 1090283 (0.0005) [2023-12-26 08:17:49,743][123090] Updated weights for policy 1, policy_version 1082600 (0.0009) [2023-12-26 08:17:49,804][123090] Updated weights for policy 1, policy_version 1082610 (0.0009) [2023-12-26 08:17:49,856][123091] Updated weights for policy 0, policy_version 1090293 (0.0007) [2023-12-26 08:17:49,870][123090] Updated weights for policy 1, policy_version 1082620 (0.0008) [2023-12-26 08:17:49,924][123091] Updated weights for policy 0, policy_version 1090303 (0.0008) [2023-12-26 08:17:49,989][123091] Updated weights for policy 0, policy_version 1090313 (0.0009) [2023-12-26 08:17:50,708][123090] Updated weights for policy 1, policy_version 1082630 (0.0007) [2023-12-26 08:17:50,778][123090] Updated weights for policy 1, policy_version 1082640 (0.0006) [2023-12-26 08:17:50,822][123091] Updated weights for policy 0, policy_version 1090323 (0.0009) [2023-12-26 08:17:50,833][123090] Updated weights for policy 1, policy_version 1082650 (0.0007) [2023-12-26 08:17:50,884][123091] Updated weights for policy 0, policy_version 1090333 (0.0010) [2023-12-26 08:17:50,931][123091] Updated weights for policy 0, policy_version 1090343 (0.0009) [2023-12-26 08:17:51,609][123090] Updated weights for policy 1, policy_version 1082660 (0.0008) [2023-12-26 08:17:51,673][123090] Updated weights for policy 1, policy_version 1082670 (0.0007) [2023-12-26 08:17:51,685][123091] Updated weights for policy 0, policy_version 1090353 (0.0005) [2023-12-26 08:17:51,738][123090] Updated weights for policy 1, policy_version 1082680 (0.0008) [2023-12-26 08:17:51,758][123091] Updated weights for policy 0, policy_version 1090363 (0.0009) [2023-12-26 08:17:51,821][123091] Updated weights for policy 0, policy_version 1090373 (0.0006) [2023-12-26 08:17:51,880][123091] Updated weights for policy 0, policy_version 1090383 (0.0009) [2023-12-26 08:17:52,415][123090] Updated weights for policy 1, policy_version 1082690 (0.0007) [2023-12-26 08:17:52,483][123090] Updated weights for policy 1, policy_version 1082700 (0.0010) [2023-12-26 08:17:52,551][123090] Updated weights for policy 1, policy_version 1082710 (0.0009) [2023-12-26 08:17:52,615][123090] Updated weights for policy 1, policy_version 1082720 (0.0009) [2023-12-26 08:17:52,773][123091] Updated weights for policy 0, policy_version 1090393 (0.0006) [2023-12-26 08:17:52,844][123091] Updated weights for policy 0, policy_version 1090403 (0.0006) [2023-12-26 08:17:52,902][123091] Updated weights for policy 0, policy_version 1090413 (0.0009) [2023-12-26 08:17:53,372][123090] Updated weights for policy 1, policy_version 1082730 (0.0006) [2023-12-26 08:17:53,435][123090] Updated weights for policy 1, policy_version 1082740 (0.0007) [2023-12-26 08:17:53,498][123090] Updated weights for policy 1, policy_version 1082750 (0.0006) [2023-12-26 08:17:53,583][123091] Updated weights for policy 0, policy_version 1090423 (0.0008) [2023-12-26 08:17:53,640][123091] Updated weights for policy 0, policy_version 1090433 (0.0009) [2023-12-26 08:17:53,694][123091] Updated weights for policy 0, policy_version 1090443 (0.0009) [2023-12-26 08:17:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 556343296. Throughput: 0: 8879.4, 1: 8849.1. Samples: 556313900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:53,785][121949] Avg episode reward: [(0, '6002.686'), (1, '5791.386')] [2023-12-26 08:17:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001082752_277184512.pth... [2023-12-26 08:17:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001090448_279158784.pth... [2023-12-26 08:17:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001081696_276914176.pth [2023-12-26 08:17:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001089392_278888448.pth [2023-12-26 08:17:54,280][123090] Updated weights for policy 1, policy_version 1082760 (0.0008) [2023-12-26 08:17:54,340][123090] Updated weights for policy 1, policy_version 1082770 (0.0008) [2023-12-26 08:17:54,389][123090] Updated weights for policy 1, policy_version 1082780 (0.0009) [2023-12-26 08:17:54,426][123091] Updated weights for policy 0, policy_version 1090453 (0.0008) [2023-12-26 08:17:54,481][123091] Updated weights for policy 0, policy_version 1090463 (0.0009) [2023-12-26 08:17:54,548][123091] Updated weights for policy 0, policy_version 1090473 (0.0009) [2023-12-26 08:17:55,134][123090] Updated weights for policy 1, policy_version 1082790 (0.0007) [2023-12-26 08:17:55,191][123090] Updated weights for policy 1, policy_version 1082800 (0.0005) [2023-12-26 08:17:55,242][123090] Updated weights for policy 1, policy_version 1082810 (0.0008) [2023-12-26 08:17:55,448][123091] Updated weights for policy 0, policy_version 1090483 (0.0008) [2023-12-26 08:17:55,519][123091] Updated weights for policy 0, policy_version 1090493 (0.0005) [2023-12-26 08:17:55,587][123091] Updated weights for policy 0, policy_version 1090503 (0.0005) [2023-12-26 08:17:56,093][123090] Updated weights for policy 1, policy_version 1082820 (0.0009) [2023-12-26 08:17:56,141][123090] Updated weights for policy 1, policy_version 1082830 (0.0009) [2023-12-26 08:17:56,189][123090] Updated weights for policy 1, policy_version 1082840 (0.0009) [2023-12-26 08:17:56,247][123091] Updated weights for policy 0, policy_version 1090513 (0.0005) [2023-12-26 08:17:56,304][123091] Updated weights for policy 0, policy_version 1090523 (0.0007) [2023-12-26 08:17:56,364][123091] Updated weights for policy 0, policy_version 1090533 (0.0006) [2023-12-26 08:17:56,420][123091] Updated weights for policy 0, policy_version 1090543 (0.0007) [2023-12-26 08:17:56,981][123090] Updated weights for policy 1, policy_version 1082850 (0.0008) [2023-12-26 08:17:57,033][123090] Updated weights for policy 1, policy_version 1082860 (0.0005) [2023-12-26 08:17:57,047][123091] Updated weights for policy 0, policy_version 1090553 (0.0005) [2023-12-26 08:17:57,090][123090] Updated weights for policy 1, policy_version 1082870 (0.0005) [2023-12-26 08:17:57,098][123091] Updated weights for policy 0, policy_version 1090563 (0.0005) [2023-12-26 08:17:57,153][123090] Updated weights for policy 1, policy_version 1082880 (0.0005) [2023-12-26 08:17:57,160][123091] Updated weights for policy 0, policy_version 1090573 (0.0007) [2023-12-26 08:17:57,779][123090] Updated weights for policy 1, policy_version 1082890 (0.0005) [2023-12-26 08:17:57,853][123090] Updated weights for policy 1, policy_version 1082900 (0.0010) [2023-12-26 08:17:57,895][123091] Updated weights for policy 0, policy_version 1090583 (0.0009) [2023-12-26 08:17:57,905][123090] Updated weights for policy 1, policy_version 1082910 (0.0006) [2023-12-26 08:17:57,953][123091] Updated weights for policy 0, policy_version 1090593 (0.0008) [2023-12-26 08:17:58,009][123091] Updated weights for policy 0, policy_version 1090603 (0.0009) [2023-12-26 08:17:58,707][123090] Updated weights for policy 1, policy_version 1082920 (0.0010) [2023-12-26 08:17:58,770][123090] Updated weights for policy 1, policy_version 1082930 (0.0013) [2023-12-26 08:17:58,785][121949] Fps is (10 sec: 18020.8, 60 sec: 17749.0, 300 sec: 17633.6). Total num frames: 556425216. Throughput: 0: 8909.3, 1: 8925.9. Samples: 556424976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:17:58,786][121949] Avg episode reward: [(0, '5856.303'), (1, '5696.131')] [2023-12-26 08:17:58,846][123090] Updated weights for policy 1, policy_version 1082940 (0.0012) [2023-12-26 08:17:58,928][123091] Updated weights for policy 0, policy_version 1090613 (0.0008) [2023-12-26 08:17:58,999][123091] Updated weights for policy 0, policy_version 1090623 (0.0009) [2023-12-26 08:17:59,065][123091] Updated weights for policy 0, policy_version 1090633 (0.0010) [2023-12-26 08:17:59,796][123090] Updated weights for policy 1, policy_version 1082950 (0.0009) [2023-12-26 08:17:59,855][123090] Updated weights for policy 1, policy_version 1082960 (0.0008) [2023-12-26 08:17:59,893][123091] Updated weights for policy 0, policy_version 1090643 (0.0009) [2023-12-26 08:17:59,913][123090] Updated weights for policy 1, policy_version 1082970 (0.0005) [2023-12-26 08:17:59,961][123091] Updated weights for policy 0, policy_version 1090653 (0.0011) [2023-12-26 08:18:00,021][123091] Updated weights for policy 0, policy_version 1090663 (0.0011) [2023-12-26 08:18:00,698][123090] Updated weights for policy 1, policy_version 1082980 (0.0009) [2023-12-26 08:18:00,756][123090] Updated weights for policy 1, policy_version 1082990 (0.0009) [2023-12-26 08:18:00,768][123091] Updated weights for policy 0, policy_version 1090673 (0.0006) [2023-12-26 08:18:00,826][123090] Updated weights for policy 1, policy_version 1083000 (0.0009) [2023-12-26 08:18:00,831][123091] Updated weights for policy 0, policy_version 1090683 (0.0007) [2023-12-26 08:18:00,886][123091] Updated weights for policy 0, policy_version 1090693 (0.0010) [2023-12-26 08:18:00,937][123091] Updated weights for policy 0, policy_version 1090703 (0.0010) [2023-12-26 08:18:01,625][123090] Updated weights for policy 1, policy_version 1083010 (0.0007) [2023-12-26 08:18:01,683][123090] Updated weights for policy 1, policy_version 1083020 (0.0009) [2023-12-26 08:18:01,738][123091] Updated weights for policy 0, policy_version 1090713 (0.0010) [2023-12-26 08:18:01,750][123090] Updated weights for policy 1, policy_version 1083030 (0.0006) [2023-12-26 08:18:01,810][123091] Updated weights for policy 0, policy_version 1090723 (0.0006) [2023-12-26 08:18:01,810][123090] Updated weights for policy 1, policy_version 1083040 (0.0008) [2023-12-26 08:18:01,886][123091] Updated weights for policy 0, policy_version 1090733 (0.0005) [2023-12-26 08:18:02,559][123091] Updated weights for policy 0, policy_version 1090743 (0.0008) [2023-12-26 08:18:02,561][123090] Updated weights for policy 1, policy_version 1083050 (0.0005) [2023-12-26 08:18:02,610][123091] Updated weights for policy 0, policy_version 1090754 (0.0009) [2023-12-26 08:18:02,625][123090] Updated weights for policy 1, policy_version 1083060 (0.0005) [2023-12-26 08:18:02,660][123091] Updated weights for policy 0, policy_version 1090764 (0.0009) [2023-12-26 08:18:02,691][123090] Updated weights for policy 1, policy_version 1083070 (0.0005) [2023-12-26 08:18:03,306][123090] Updated weights for policy 1, policy_version 1083080 (0.0005) [2023-12-26 08:18:03,359][123090] Updated weights for policy 1, policy_version 1083090 (0.0005) [2023-12-26 08:18:03,406][123090] Updated weights for policy 1, policy_version 1083100 (0.0005) [2023-12-26 08:18:03,612][123091] Updated weights for policy 0, policy_version 1090774 (0.0010) [2023-12-26 08:18:03,667][123091] Updated weights for policy 0, policy_version 1090784 (0.0009) [2023-12-26 08:18:03,724][123091] Updated weights for policy 0, policy_version 1090794 (0.0009) [2023-12-26 08:18:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 556523520. Throughput: 0: 8891.0, 1: 8950.1. Samples: 556531036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:03,784][121949] Avg episode reward: [(0, '5979.073'), (1, '5375.669')] [2023-12-26 08:18:04,063][123090] Updated weights for policy 1, policy_version 1083110 (0.0005) [2023-12-26 08:18:04,121][123090] Updated weights for policy 1, policy_version 1083120 (0.0006) [2023-12-26 08:18:04,188][123090] Updated weights for policy 1, policy_version 1083130 (0.0006) [2023-12-26 08:18:04,632][123091] Updated weights for policy 0, policy_version 1090804 (0.0008) [2023-12-26 08:18:04,701][123091] Updated weights for policy 0, policy_version 1090814 (0.0007) [2023-12-26 08:18:04,773][123091] Updated weights for policy 0, policy_version 1090824 (0.0006) [2023-12-26 08:18:04,915][123090] Updated weights for policy 1, policy_version 1083140 (0.0006) [2023-12-26 08:18:04,963][123090] Updated weights for policy 1, policy_version 1083150 (0.0007) [2023-12-26 08:18:05,022][123090] Updated weights for policy 1, policy_version 1083160 (0.0010) [2023-12-26 08:18:05,371][123091] Updated weights for policy 0, policy_version 1090834 (0.0007) [2023-12-26 08:18:05,427][123091] Updated weights for policy 0, policy_version 1090844 (0.0005) [2023-12-26 08:18:05,479][123091] Updated weights for policy 0, policy_version 1090854 (0.0009) [2023-12-26 08:18:05,534][123091] Updated weights for policy 0, policy_version 1090864 (0.0010) [2023-12-26 08:18:05,840][123090] Updated weights for policy 1, policy_version 1083170 (0.0010) [2023-12-26 08:18:05,901][123090] Updated weights for policy 1, policy_version 1083180 (0.0010) [2023-12-26 08:18:05,967][123090] Updated weights for policy 1, policy_version 1083190 (0.0010) [2023-12-26 08:18:06,018][123090] Updated weights for policy 1, policy_version 1083200 (0.0010) [2023-12-26 08:18:06,363][123091] Updated weights for policy 0, policy_version 1090874 (0.0006) [2023-12-26 08:18:06,414][123091] Updated weights for policy 0, policy_version 1090884 (0.0005) [2023-12-26 08:18:06,472][123091] Updated weights for policy 0, policy_version 1090894 (0.0006) [2023-12-26 08:18:06,874][123090] Updated weights for policy 1, policy_version 1083210 (0.0010) [2023-12-26 08:18:06,942][123090] Updated weights for policy 1, policy_version 1083220 (0.0007) [2023-12-26 08:18:07,008][123090] Updated weights for policy 1, policy_version 1083230 (0.0009) [2023-12-26 08:18:07,204][123091] Updated weights for policy 0, policy_version 1090904 (0.0006) [2023-12-26 08:18:07,262][123091] Updated weights for policy 0, policy_version 1090914 (0.0008) [2023-12-26 08:18:07,323][123091] Updated weights for policy 0, policy_version 1090924 (0.0009) [2023-12-26 08:18:07,770][123090] Updated weights for policy 1, policy_version 1083240 (0.0010) [2023-12-26 08:18:07,832][123090] Updated weights for policy 1, policy_version 1083250 (0.0010) [2023-12-26 08:18:07,907][123090] Updated weights for policy 1, policy_version 1083260 (0.0010) [2023-12-26 08:18:08,176][123091] Updated weights for policy 0, policy_version 1090934 (0.0009) [2023-12-26 08:18:08,228][123091] Updated weights for policy 0, policy_version 1090944 (0.0009) [2023-12-26 08:18:08,281][123091] Updated weights for policy 0, policy_version 1090954 (0.0010) [2023-12-26 08:18:08,685][123090] Updated weights for policy 1, policy_version 1083270 (0.0009) [2023-12-26 08:18:08,759][123090] Updated weights for policy 1, policy_version 1083280 (0.0005) [2023-12-26 08:18:08,784][121949] Fps is (10 sec: 18023.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 556605440. Throughput: 0: 8941.7, 1: 8965.2. Samples: 556585652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:08,785][121949] Avg episode reward: [(0, '6152.830'), (1, '5336.031')] [2023-12-26 08:18:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001090960_279289856.pth... [2023-12-26 08:18:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001089904_279019520.pth [2023-12-26 08:18:08,831][123090] Updated weights for policy 1, policy_version 1083290 (0.0007) [2023-12-26 08:18:08,872][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001083296_277323776.pth... [2023-12-26 08:18:08,878][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001082240_277053440.pth [2023-12-26 08:18:09,045][123091] Updated weights for policy 0, policy_version 1090964 (0.0009) [2023-12-26 08:18:09,109][123091] Updated weights for policy 0, policy_version 1090974 (0.0008) [2023-12-26 08:18:09,167][123091] Updated weights for policy 0, policy_version 1090984 (0.0007) [2023-12-26 08:18:09,573][123090] Updated weights for policy 1, policy_version 1083300 (0.0011) [2023-12-26 08:18:09,636][123090] Updated weights for policy 1, policy_version 1083310 (0.0010) [2023-12-26 08:18:09,700][123090] Updated weights for policy 1, policy_version 1083320 (0.0006) [2023-12-26 08:18:09,964][123091] Updated weights for policy 0, policy_version 1090994 (0.0008) [2023-12-26 08:18:10,036][123091] Updated weights for policy 0, policy_version 1091004 (0.0011) [2023-12-26 08:18:10,110][123091] Updated weights for policy 0, policy_version 1091014 (0.0011) [2023-12-26 08:18:10,169][123091] Updated weights for policy 0, policy_version 1091024 (0.0010) [2023-12-26 08:18:10,432][123090] Updated weights for policy 1, policy_version 1083330 (0.0006) [2023-12-26 08:18:10,499][123090] Updated weights for policy 1, policy_version 1083340 (0.0008) [2023-12-26 08:18:10,571][123090] Updated weights for policy 1, policy_version 1083350 (0.0007) [2023-12-26 08:18:10,636][123090] Updated weights for policy 1, policy_version 1083360 (0.0008) [2023-12-26 08:18:10,962][123091] Updated weights for policy 0, policy_version 1091034 (0.0005) [2023-12-26 08:18:11,047][123091] Updated weights for policy 0, policy_version 1091044 (0.0006) [2023-12-26 08:18:11,110][123091] Updated weights for policy 0, policy_version 1091054 (0.0007) [2023-12-26 08:18:11,340][123090] Updated weights for policy 1, policy_version 1083370 (0.0009) [2023-12-26 08:18:11,419][123090] Updated weights for policy 1, policy_version 1083380 (0.0008) [2023-12-26 08:18:11,487][123090] Updated weights for policy 1, policy_version 1083390 (0.0010) [2023-12-26 08:18:11,828][123091] Updated weights for policy 0, policy_version 1091064 (0.0008) [2023-12-26 08:18:11,894][123091] Updated weights for policy 0, policy_version 1091074 (0.0008) [2023-12-26 08:18:11,950][123091] Updated weights for policy 0, policy_version 1091084 (0.0008) [2023-12-26 08:18:12,395][123090] Updated weights for policy 1, policy_version 1083400 (0.0009) [2023-12-26 08:18:12,454][123090] Updated weights for policy 1, policy_version 1083410 (0.0009) [2023-12-26 08:18:12,505][123090] Updated weights for policy 1, policy_version 1083420 (0.0009) [2023-12-26 08:18:12,673][123091] Updated weights for policy 0, policy_version 1091094 (0.0007) [2023-12-26 08:18:12,728][123091] Updated weights for policy 0, policy_version 1091104 (0.0005) [2023-12-26 08:18:12,784][123091] Updated weights for policy 0, policy_version 1091114 (0.0005) [2023-12-26 08:18:13,426][123090] Updated weights for policy 1, policy_version 1083430 (0.0009) [2023-12-26 08:18:13,483][123090] Updated weights for policy 1, policy_version 1083440 (0.0009) [2023-12-26 08:18:13,545][123090] Updated weights for policy 1, policy_version 1083450 (0.0009) [2023-12-26 08:18:13,550][123091] Updated weights for policy 0, policy_version 1091124 (0.0008) [2023-12-26 08:18:13,608][123091] Updated weights for policy 0, policy_version 1091134 (0.0010) [2023-12-26 08:18:13,675][123091] Updated weights for policy 0, policy_version 1091144 (0.0011) [2023-12-26 08:18:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 556703744. Throughput: 0: 8916.9, 1: 8881.9. Samples: 556692612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:13,785][121949] Avg episode reward: [(0, '6079.772'), (1, '5442.558')] [2023-12-26 08:18:14,252][123090] Updated weights for policy 1, policy_version 1083460 (0.0006) [2023-12-26 08:18:14,300][123090] Updated weights for policy 1, policy_version 1083470 (0.0005) [2023-12-26 08:18:14,353][123090] Updated weights for policy 1, policy_version 1083480 (0.0005) [2023-12-26 08:18:14,491][123091] Updated weights for policy 0, policy_version 1091154 (0.0011) [2023-12-26 08:18:14,542][123091] Updated weights for policy 0, policy_version 1091164 (0.0010) [2023-12-26 08:18:14,589][123091] Updated weights for policy 0, policy_version 1091174 (0.0010) [2023-12-26 08:18:14,641][123091] Updated weights for policy 0, policy_version 1091184 (0.0010) [2023-12-26 08:18:15,137][123090] Updated weights for policy 1, policy_version 1083490 (0.0006) [2023-12-26 08:18:15,203][123090] Updated weights for policy 1, policy_version 1083500 (0.0009) [2023-12-26 08:18:15,272][123090] Updated weights for policy 1, policy_version 1083510 (0.0010) [2023-12-26 08:18:15,336][123090] Updated weights for policy 1, policy_version 1083520 (0.0009) [2023-12-26 08:18:15,483][123091] Updated weights for policy 0, policy_version 1091194 (0.0010) [2023-12-26 08:18:15,544][123091] Updated weights for policy 0, policy_version 1091204 (0.0009) [2023-12-26 08:18:15,595][123091] Updated weights for policy 0, policy_version 1091214 (0.0009) [2023-12-26 08:18:16,175][123090] Updated weights for policy 1, policy_version 1083530 (0.0008) [2023-12-26 08:18:16,243][123090] Updated weights for policy 1, policy_version 1083540 (0.0009) [2023-12-26 08:18:16,303][123090] Updated weights for policy 1, policy_version 1083550 (0.0009) [2023-12-26 08:18:16,442][123091] Updated weights for policy 0, policy_version 1091225 (0.0010) [2023-12-26 08:18:16,496][123091] Updated weights for policy 0, policy_version 1091235 (0.0009) [2023-12-26 08:18:16,550][123091] Updated weights for policy 0, policy_version 1091245 (0.0009) [2023-12-26 08:18:17,085][123090] Updated weights for policy 1, policy_version 1083560 (0.0010) [2023-12-26 08:18:17,141][123090] Updated weights for policy 1, policy_version 1083571 (0.0011) [2023-12-26 08:18:17,195][123090] Updated weights for policy 1, policy_version 1083581 (0.0010) [2023-12-26 08:18:17,354][123091] Updated weights for policy 0, policy_version 1091255 (0.0009) [2023-12-26 08:18:17,419][123091] Updated weights for policy 0, policy_version 1091265 (0.0008) [2023-12-26 08:18:17,478][123091] Updated weights for policy 0, policy_version 1091275 (0.0008) [2023-12-26 08:18:18,075][123090] Updated weights for policy 1, policy_version 1083591 (0.0011) [2023-12-26 08:18:18,126][123090] Updated weights for policy 1, policy_version 1083601 (0.0010) [2023-12-26 08:18:18,174][123090] Updated weights for policy 1, policy_version 1083611 (0.0010) [2023-12-26 08:18:18,245][123091] Updated weights for policy 0, policy_version 1091285 (0.0007) [2023-12-26 08:18:18,295][123091] Updated weights for policy 0, policy_version 1091295 (0.0005) [2023-12-26 08:18:18,369][123091] Updated weights for policy 0, policy_version 1091305 (0.0007) [2023-12-26 08:18:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 556785664. Throughput: 0: 8931.6, 1: 8847.7. Samples: 556798872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:18,785][121949] Avg episode reward: [(0, '6165.412'), (1, '5437.437')] [2023-12-26 08:18:18,909][123090] Updated weights for policy 1, policy_version 1083621 (0.0011) [2023-12-26 08:18:18,973][123090] Updated weights for policy 1, policy_version 1083631 (0.0011) [2023-12-26 08:18:19,041][123090] Updated weights for policy 1, policy_version 1083641 (0.0011) [2023-12-26 08:18:19,174][123091] Updated weights for policy 0, policy_version 1091315 (0.0007) [2023-12-26 08:18:19,237][123091] Updated weights for policy 0, policy_version 1091325 (0.0009) [2023-12-26 08:18:19,298][123091] Updated weights for policy 0, policy_version 1091335 (0.0009) [2023-12-26 08:18:19,846][123090] Updated weights for policy 1, policy_version 1083651 (0.0009) [2023-12-26 08:18:19,918][123090] Updated weights for policy 1, policy_version 1083661 (0.0008) [2023-12-26 08:18:19,990][123090] Updated weights for policy 1, policy_version 1083671 (0.0011) [2023-12-26 08:18:20,103][123091] Updated weights for policy 0, policy_version 1091345 (0.0009) [2023-12-26 08:18:20,166][123091] Updated weights for policy 0, policy_version 1091355 (0.0009) [2023-12-26 08:18:20,227][123091] Updated weights for policy 0, policy_version 1091365 (0.0009) [2023-12-26 08:18:20,294][123091] Updated weights for policy 0, policy_version 1091375 (0.0009) [2023-12-26 08:18:20,794][123090] Updated weights for policy 1, policy_version 1083681 (0.0010) [2023-12-26 08:18:20,866][123090] Updated weights for policy 1, policy_version 1083691 (0.0006) [2023-12-26 08:18:20,948][123090] Updated weights for policy 1, policy_version 1083701 (0.0006) [2023-12-26 08:18:21,022][123090] Updated weights for policy 1, policy_version 1083711 (0.0006) [2023-12-26 08:18:21,092][123091] Updated weights for policy 0, policy_version 1091385 (0.0009) [2023-12-26 08:18:21,160][123091] Updated weights for policy 0, policy_version 1091395 (0.0009) [2023-12-26 08:18:21,228][123091] Updated weights for policy 0, policy_version 1091405 (0.0010) [2023-12-26 08:18:21,795][123090] Updated weights for policy 1, policy_version 1083721 (0.0007) [2023-12-26 08:18:21,864][123090] Updated weights for policy 1, policy_version 1083731 (0.0005) [2023-12-26 08:18:21,921][123090] Updated weights for policy 1, policy_version 1083741 (0.0005) [2023-12-26 08:18:22,043][123091] Updated weights for policy 0, policy_version 1091415 (0.0010) [2023-12-26 08:18:22,104][123091] Updated weights for policy 0, policy_version 1091425 (0.0010) [2023-12-26 08:18:22,162][123091] Updated weights for policy 0, policy_version 1091435 (0.0006) [2023-12-26 08:18:22,679][123090] Updated weights for policy 1, policy_version 1083751 (0.0009) [2023-12-26 08:18:22,744][123090] Updated weights for policy 1, policy_version 1083761 (0.0010) [2023-12-26 08:18:22,808][123090] Updated weights for policy 1, policy_version 1083771 (0.0011) [2023-12-26 08:18:22,961][123091] Updated weights for policy 0, policy_version 1091445 (0.0005) [2023-12-26 08:18:23,017][123091] Updated weights for policy 0, policy_version 1091455 (0.0007) [2023-12-26 08:18:23,074][123091] Updated weights for policy 0, policy_version 1091465 (0.0010) [2023-12-26 08:18:23,614][123090] Updated weights for policy 1, policy_version 1083781 (0.0008) [2023-12-26 08:18:23,683][123090] Updated weights for policy 1, policy_version 1083791 (0.0009) [2023-12-26 08:18:23,746][123090] Updated weights for policy 1, policy_version 1083801 (0.0007) [2023-12-26 08:18:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 556867584. Throughput: 0: 8941.8, 1: 8837.3. Samples: 556850516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:23,785][121949] Avg episode reward: [(0, '6177.308'), (1, '5491.469')] [2023-12-26 08:18:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001083808_277454848.pth... [2023-12-26 08:18:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001091472_279420928.pth... [2023-12-26 08:18:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001082752_277184512.pth [2023-12-26 08:18:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001090448_279158784.pth [2023-12-26 08:18:23,886][123091] Updated weights for policy 0, policy_version 1091475 (0.0010) [2023-12-26 08:18:23,950][123091] Updated weights for policy 0, policy_version 1091485 (0.0009) [2023-12-26 08:18:24,010][123091] Updated weights for policy 0, policy_version 1091495 (0.0009) [2023-12-26 08:18:24,466][123090] Updated weights for policy 1, policy_version 1083811 (0.0007) [2023-12-26 08:18:24,525][123090] Updated weights for policy 1, policy_version 1083821 (0.0010) [2023-12-26 08:18:24,587][123090] Updated weights for policy 1, policy_version 1083831 (0.0011) [2023-12-26 08:18:24,876][123091] Updated weights for policy 0, policy_version 1091505 (0.0009) [2023-12-26 08:18:24,927][123091] Updated weights for policy 0, policy_version 1091515 (0.0009) [2023-12-26 08:18:24,975][123091] Updated weights for policy 0, policy_version 1091525 (0.0008) [2023-12-26 08:18:25,024][123091] Updated weights for policy 0, policy_version 1091535 (0.0009) [2023-12-26 08:18:25,434][123090] Updated weights for policy 1, policy_version 1083841 (0.0011) [2023-12-26 08:18:25,489][123090] Updated weights for policy 1, policy_version 1083851 (0.0009) [2023-12-26 08:18:25,543][123090] Updated weights for policy 1, policy_version 1083861 (0.0009) [2023-12-26 08:18:25,611][123090] Updated weights for policy 1, policy_version 1083872 (0.0009) [2023-12-26 08:18:25,794][123091] Updated weights for policy 0, policy_version 1091545 (0.0006) [2023-12-26 08:18:25,860][123091] Updated weights for policy 0, policy_version 1091555 (0.0007) [2023-12-26 08:18:25,925][123091] Updated weights for policy 0, policy_version 1091565 (0.0007) [2023-12-26 08:18:26,500][123090] Updated weights for policy 1, policy_version 1083882 (0.0009) [2023-12-26 08:18:26,552][123090] Updated weights for policy 1, policy_version 1083892 (0.0009) [2023-12-26 08:18:26,609][123091] Updated weights for policy 0, policy_version 1091575 (0.0007) [2023-12-26 08:18:26,611][123090] Updated weights for policy 1, policy_version 1083902 (0.0008) [2023-12-26 08:18:26,658][123091] Updated weights for policy 0, policy_version 1091585 (0.0010) [2023-12-26 08:18:26,719][123091] Updated weights for policy 0, policy_version 1091596 (0.0009) [2023-12-26 08:18:27,459][123090] Updated weights for policy 1, policy_version 1083912 (0.0005) [2023-12-26 08:18:27,533][123090] Updated weights for policy 1, policy_version 1083922 (0.0005) [2023-12-26 08:18:27,585][123091] Updated weights for policy 0, policy_version 1091606 (0.0010) [2023-12-26 08:18:27,596][123090] Updated weights for policy 1, policy_version 1083932 (0.0008) [2023-12-26 08:18:27,637][123091] Updated weights for policy 0, policy_version 1091616 (0.0008) [2023-12-26 08:18:27,686][123091] Updated weights for policy 0, policy_version 1091626 (0.0009) [2023-12-26 08:18:28,263][123090] Updated weights for policy 1, policy_version 1083942 (0.0005) [2023-12-26 08:18:28,332][123090] Updated weights for policy 1, policy_version 1083952 (0.0009) [2023-12-26 08:18:28,407][123090] Updated weights for policy 1, policy_version 1083962 (0.0008) [2023-12-26 08:18:28,575][123091] Updated weights for policy 0, policy_version 1091636 (0.0009) [2023-12-26 08:18:28,644][123091] Updated weights for policy 0, policy_version 1091646 (0.0009) [2023-12-26 08:18:28,712][123091] Updated weights for policy 0, policy_version 1091656 (0.0009) [2023-12-26 08:18:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 556965888. Throughput: 0: 8957.0, 1: 8893.5. Samples: 556956720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:28,785][121949] Avg episode reward: [(0, '6174.630'), (1, '5561.783')] [2023-12-26 08:18:29,135][123090] Updated weights for policy 1, policy_version 1083972 (0.0008) [2023-12-26 08:18:29,210][123090] Updated weights for policy 1, policy_version 1083982 (0.0006) [2023-12-26 08:18:29,283][123090] Updated weights for policy 1, policy_version 1083992 (0.0008) [2023-12-26 08:18:29,522][123091] Updated weights for policy 0, policy_version 1091666 (0.0009) [2023-12-26 08:18:29,593][123091] Updated weights for policy 0, policy_version 1091676 (0.0010) [2023-12-26 08:18:29,660][123091] Updated weights for policy 0, policy_version 1091686 (0.0009) [2023-12-26 08:18:29,725][123091] Updated weights for policy 0, policy_version 1091696 (0.0010) [2023-12-26 08:18:30,000][123090] Updated weights for policy 1, policy_version 1084002 (0.0008) [2023-12-26 08:18:30,059][123090] Updated weights for policy 1, policy_version 1084012 (0.0007) [2023-12-26 08:18:30,115][123090] Updated weights for policy 1, policy_version 1084022 (0.0009) [2023-12-26 08:18:30,169][123090] Updated weights for policy 1, policy_version 1084032 (0.0009) [2023-12-26 08:18:30,569][123091] Updated weights for policy 0, policy_version 1091706 (0.0010) [2023-12-26 08:18:30,629][123091] Updated weights for policy 0, policy_version 1091716 (0.0010) [2023-12-26 08:18:30,688][123091] Updated weights for policy 0, policy_version 1091726 (0.0010) [2023-12-26 08:18:30,935][123090] Updated weights for policy 1, policy_version 1084042 (0.0010) [2023-12-26 08:18:30,989][123090] Updated weights for policy 1, policy_version 1084052 (0.0009) [2023-12-26 08:18:31,048][123090] Updated weights for policy 1, policy_version 1084062 (0.0008) [2023-12-26 08:18:31,556][123091] Updated weights for policy 0, policy_version 1091736 (0.0006) [2023-12-26 08:18:31,630][123091] Updated weights for policy 0, policy_version 1091746 (0.0007) [2023-12-26 08:18:31,696][123091] Updated weights for policy 0, policy_version 1091756 (0.0006) [2023-12-26 08:18:31,925][123090] Updated weights for policy 1, policy_version 1084072 (0.0006) [2023-12-26 08:18:31,987][123090] Updated weights for policy 1, policy_version 1084082 (0.0005) [2023-12-26 08:18:32,046][123090] Updated weights for policy 1, policy_version 1084092 (0.0005) [2023-12-26 08:18:32,418][123091] Updated weights for policy 0, policy_version 1091766 (0.0006) [2023-12-26 08:18:32,465][123091] Updated weights for policy 0, policy_version 1091776 (0.0005) [2023-12-26 08:18:32,519][123091] Updated weights for policy 0, policy_version 1091786 (0.0006) [2023-12-26 08:18:32,770][123090] Updated weights for policy 1, policy_version 1084102 (0.0008) [2023-12-26 08:18:32,819][123090] Updated weights for policy 1, policy_version 1084112 (0.0009) [2023-12-26 08:18:32,882][123090] Updated weights for policy 1, policy_version 1084122 (0.0010) [2023-12-26 08:18:33,256][123091] Updated weights for policy 0, policy_version 1091796 (0.0007) [2023-12-26 08:18:33,313][123091] Updated weights for policy 0, policy_version 1091806 (0.0009) [2023-12-26 08:18:33,366][123091] Updated weights for policy 0, policy_version 1091816 (0.0009) [2023-12-26 08:18:33,756][123090] Updated weights for policy 1, policy_version 1084132 (0.0009) [2023-12-26 08:18:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 557047808. Throughput: 0: 8906.7, 1: 8905.5. Samples: 557062520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:33,785][121949] Avg episode reward: [(0, '6060.079'), (1, '5524.146')] [2023-12-26 08:18:33,810][123090] Updated weights for policy 1, policy_version 1084142 (0.0009) [2023-12-26 08:18:33,865][123090] Updated weights for policy 1, policy_version 1084153 (0.0009) [2023-12-26 08:18:34,164][123091] Updated weights for policy 0, policy_version 1091826 (0.0009) [2023-12-26 08:18:34,228][123091] Updated weights for policy 0, policy_version 1091836 (0.0008) [2023-12-26 08:18:34,301][123091] Updated weights for policy 0, policy_version 1091846 (0.0007) [2023-12-26 08:18:34,368][123091] Updated weights for policy 0, policy_version 1091856 (0.0008) [2023-12-26 08:18:34,740][123090] Updated weights for policy 1, policy_version 1084163 (0.0009) [2023-12-26 08:18:34,794][123090] Updated weights for policy 1, policy_version 1084173 (0.0009) [2023-12-26 08:18:34,845][123090] Updated weights for policy 1, policy_version 1084183 (0.0009) [2023-12-26 08:18:35,094][123091] Updated weights for policy 0, policy_version 1091866 (0.0010) [2023-12-26 08:18:35,156][123091] Updated weights for policy 0, policy_version 1091876 (0.0009) [2023-12-26 08:18:35,216][123091] Updated weights for policy 0, policy_version 1091886 (0.0009) [2023-12-26 08:18:35,688][123090] Updated weights for policy 1, policy_version 1084193 (0.0009) [2023-12-26 08:18:35,743][123090] Updated weights for policy 1, policy_version 1084203 (0.0009) [2023-12-26 08:18:35,795][123090] Updated weights for policy 1, policy_version 1084213 (0.0010) [2023-12-26 08:18:35,846][123090] Updated weights for policy 1, policy_version 1084223 (0.0009) [2023-12-26 08:18:36,014][123091] Updated weights for policy 0, policy_version 1091896 (0.0006) [2023-12-26 08:18:36,068][123091] Updated weights for policy 0, policy_version 1091906 (0.0005) [2023-12-26 08:18:36,127][123091] Updated weights for policy 0, policy_version 1091916 (0.0007) [2023-12-26 08:18:36,725][123090] Updated weights for policy 1, policy_version 1084234 (0.0010) [2023-12-26 08:18:36,788][123090] Updated weights for policy 1, policy_version 1084244 (0.0009) [2023-12-26 08:18:36,852][123090] Updated weights for policy 1, policy_version 1084254 (0.0009) [2023-12-26 08:18:36,860][123091] Updated weights for policy 0, policy_version 1091926 (0.0007) [2023-12-26 08:18:36,925][123091] Updated weights for policy 0, policy_version 1091936 (0.0009) [2023-12-26 08:18:36,986][123091] Updated weights for policy 0, policy_version 1091946 (0.0009) [2023-12-26 08:18:37,749][123090] Updated weights for policy 1, policy_version 1084264 (0.0009) [2023-12-26 08:18:37,782][123091] Updated weights for policy 0, policy_version 1091956 (0.0008) [2023-12-26 08:18:37,816][123090] Updated weights for policy 1, policy_version 1084274 (0.0010) [2023-12-26 08:18:37,847][123091] Updated weights for policy 0, policy_version 1091966 (0.0005) [2023-12-26 08:18:37,876][123090] Updated weights for policy 1, policy_version 1084284 (0.0009) [2023-12-26 08:18:37,909][123091] Updated weights for policy 0, policy_version 1091976 (0.0007) [2023-12-26 08:18:38,617][123091] Updated weights for policy 0, policy_version 1091986 (0.0007) [2023-12-26 08:18:38,676][123091] Updated weights for policy 0, policy_version 1091996 (0.0009) [2023-12-26 08:18:38,724][123090] Updated weights for policy 1, policy_version 1084294 (0.0008) [2023-12-26 08:18:38,732][123091] Updated weights for policy 0, policy_version 1092006 (0.0009) [2023-12-26 08:18:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 557129728. Throughput: 0: 8889.3, 1: 8903.0. Samples: 557114548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:38,785][121949] Avg episode reward: [(0, '5849.222'), (1, '5500.769')] [2023-12-26 08:18:38,796][123090] Updated weights for policy 1, policy_version 1084304 (0.0007) [2023-12-26 08:18:38,798][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001092016_279560192.pth... [2023-12-26 08:18:38,799][123091] Updated weights for policy 0, policy_version 1092016 (0.0009) [2023-12-26 08:18:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001090960_279289856.pth [2023-12-26 08:18:38,859][123090] Updated weights for policy 1, policy_version 1084314 (0.0010) [2023-12-26 08:18:38,905][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001084320_277585920.pth... [2023-12-26 08:18:38,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001083296_277323776.pth [2023-12-26 08:18:39,596][123091] Updated weights for policy 0, policy_version 1092026 (0.0011) [2023-12-26 08:18:39,623][123090] Updated weights for policy 1, policy_version 1084324 (0.0007) [2023-12-26 08:18:39,656][123091] Updated weights for policy 0, policy_version 1092036 (0.0011) [2023-12-26 08:18:39,701][123090] Updated weights for policy 1, policy_version 1084334 (0.0006) [2023-12-26 08:18:39,720][123091] Updated weights for policy 0, policy_version 1092046 (0.0011) [2023-12-26 08:18:39,756][123090] Updated weights for policy 1, policy_version 1084344 (0.0008) [2023-12-26 08:18:40,499][123090] Updated weights for policy 1, policy_version 1084354 (0.0008) [2023-12-26 08:18:40,557][123090] Updated weights for policy 1, policy_version 1084364 (0.0005) [2023-12-26 08:18:40,593][123091] Updated weights for policy 0, policy_version 1092056 (0.0009) [2023-12-26 08:18:40,608][123090] Updated weights for policy 1, policy_version 1084374 (0.0008) [2023-12-26 08:18:40,655][123091] Updated weights for policy 0, policy_version 1092066 (0.0006) [2023-12-26 08:18:40,661][123090] Updated weights for policy 1, policy_version 1084384 (0.0010) [2023-12-26 08:18:40,714][123091] Updated weights for policy 0, policy_version 1092076 (0.0009) [2023-12-26 08:18:41,468][123090] Updated weights for policy 1, policy_version 1084394 (0.0005) [2023-12-26 08:18:41,524][123090] Updated weights for policy 1, policy_version 1084404 (0.0005) [2023-12-26 08:18:41,588][123090] Updated weights for policy 1, policy_version 1084414 (0.0005) [2023-12-26 08:18:41,728][123091] Updated weights for policy 0, policy_version 1092086 (0.0009) [2023-12-26 08:18:41,798][123091] Updated weights for policy 0, policy_version 1092096 (0.0008) [2023-12-26 08:18:41,858][123091] Updated weights for policy 0, policy_version 1092106 (0.0006) [2023-12-26 08:18:42,331][123090] Updated weights for policy 1, policy_version 1084424 (0.0007) [2023-12-26 08:18:42,398][123090] Updated weights for policy 1, policy_version 1084434 (0.0009) [2023-12-26 08:18:42,456][123090] Updated weights for policy 1, policy_version 1084444 (0.0009) [2023-12-26 08:18:42,696][123091] Updated weights for policy 0, policy_version 1092116 (0.0007) [2023-12-26 08:18:42,753][123091] Updated weights for policy 0, policy_version 1092126 (0.0010) [2023-12-26 08:18:42,822][123091] Updated weights for policy 0, policy_version 1092136 (0.0010) [2023-12-26 08:18:43,287][123090] Updated weights for policy 1, policy_version 1084454 (0.0007) [2023-12-26 08:18:43,345][123090] Updated weights for policy 1, policy_version 1084464 (0.0005) [2023-12-26 08:18:43,392][123090] Updated weights for policy 1, policy_version 1084474 (0.0005) [2023-12-26 08:18:43,694][123091] Updated weights for policy 0, policy_version 1092146 (0.0010) [2023-12-26 08:18:43,760][123091] Updated weights for policy 0, policy_version 1092156 (0.0009) [2023-12-26 08:18:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 557219840. Throughput: 0: 8798.3, 1: 8821.2. Samples: 557217840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:18:43,785][121949] Avg episode reward: [(0, '5908.091'), (1, '5509.570')] [2023-12-26 08:18:43,824][123091] Updated weights for policy 0, policy_version 1092166 (0.0010) [2023-12-26 08:18:43,889][123091] Updated weights for policy 0, policy_version 1092176 (0.0009) [2023-12-26 08:18:44,122][123090] Updated weights for policy 1, policy_version 1084484 (0.0007) [2023-12-26 08:18:44,171][123090] Updated weights for policy 1, policy_version 1084494 (0.0009) [2023-12-26 08:18:44,241][123090] Updated weights for policy 1, policy_version 1084504 (0.0009) [2023-12-26 08:18:44,694][123091] Updated weights for policy 0, policy_version 1092186 (0.0005) [2023-12-26 08:18:44,743][123091] Updated weights for policy 0, policy_version 1092196 (0.0005) [2023-12-26 08:18:44,806][123091] Updated weights for policy 0, policy_version 1092206 (0.0008) [2023-12-26 08:18:44,987][123090] Updated weights for policy 1, policy_version 1084514 (0.0007) [2023-12-26 08:18:45,050][123090] Updated weights for policy 1, policy_version 1084524 (0.0010) [2023-12-26 08:18:45,122][123090] Updated weights for policy 1, policy_version 1084534 (0.0008) [2023-12-26 08:18:45,192][123090] Updated weights for policy 1, policy_version 1084544 (0.0010) [2023-12-26 08:18:45,526][123091] Updated weights for policy 0, policy_version 1092216 (0.0009) [2023-12-26 08:18:45,581][123091] Updated weights for policy 0, policy_version 1092226 (0.0010) [2023-12-26 08:18:45,640][123091] Updated weights for policy 0, policy_version 1092236 (0.0009) [2023-12-26 08:18:45,966][123090] Updated weights for policy 1, policy_version 1084554 (0.0005) [2023-12-26 08:18:46,022][123090] Updated weights for policy 1, policy_version 1084564 (0.0005) [2023-12-26 08:18:46,087][123090] Updated weights for policy 1, policy_version 1084574 (0.0005) [2023-12-26 08:18:46,501][123091] Updated weights for policy 0, policy_version 1092246 (0.0010) [2023-12-26 08:18:46,561][123091] Updated weights for policy 0, policy_version 1092256 (0.0010) [2023-12-26 08:18:46,619][123091] Updated weights for policy 0, policy_version 1092266 (0.0009) [2023-12-26 08:18:46,751][123090] Updated weights for policy 1, policy_version 1084584 (0.0009) [2023-12-26 08:18:46,813][123090] Updated weights for policy 1, policy_version 1084594 (0.0007) [2023-12-26 08:18:46,875][123090] Updated weights for policy 1, policy_version 1084604 (0.0008) [2023-12-26 08:18:47,460][123091] Updated weights for policy 0, policy_version 1092276 (0.0007) [2023-12-26 08:18:47,524][123091] Updated weights for policy 0, policy_version 1092286 (0.0005) [2023-12-26 08:18:47,576][123091] Updated weights for policy 0, policy_version 1092296 (0.0005) [2023-12-26 08:18:47,628][123090] Updated weights for policy 1, policy_version 1084614 (0.0009) [2023-12-26 08:18:47,691][123090] Updated weights for policy 1, policy_version 1084624 (0.0010) [2023-12-26 08:18:47,758][123090] Updated weights for policy 1, policy_version 1084634 (0.0010) [2023-12-26 08:18:48,275][123091] Updated weights for policy 0, policy_version 1092306 (0.0007) [2023-12-26 08:18:48,356][123091] Updated weights for policy 0, policy_version 1092316 (0.0009) [2023-12-26 08:18:48,425][123091] Updated weights for policy 0, policy_version 1092326 (0.0010) [2023-12-26 08:18:48,472][123090] Updated weights for policy 1, policy_version 1084644 (0.0008) [2023-12-26 08:18:48,487][123091] Updated weights for policy 0, policy_version 1092336 (0.0007) [2023-12-26 08:18:48,533][123090] Updated weights for policy 1, policy_version 1084654 (0.0006) [2023-12-26 08:18:48,594][123090] Updated weights for policy 1, policy_version 1084664 (0.0007) [2023-12-26 08:18:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 557318144. Throughput: 0: 8798.7, 1: 8856.9. Samples: 557325540. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:18:48,785][121949] Avg episode reward: [(0, '5990.533'), (1, '5431.591')] [2023-12-26 08:18:49,323][123091] Updated weights for policy 0, policy_version 1092346 (0.0010) [2023-12-26 08:18:49,357][123090] Updated weights for policy 1, policy_version 1084674 (0.0007) [2023-12-26 08:18:49,394][123091] Updated weights for policy 0, policy_version 1092356 (0.0008) [2023-12-26 08:18:49,427][123090] Updated weights for policy 1, policy_version 1084684 (0.0010) [2023-12-26 08:18:49,455][123091] Updated weights for policy 0, policy_version 1092366 (0.0007) [2023-12-26 08:18:49,491][123090] Updated weights for policy 1, policy_version 1084694 (0.0008) [2023-12-26 08:18:49,556][123090] Updated weights for policy 1, policy_version 1084704 (0.0009) [2023-12-26 08:18:50,259][123091] Updated weights for policy 0, policy_version 1092376 (0.0009) [2023-12-26 08:18:50,314][123091] Updated weights for policy 0, policy_version 1092386 (0.0009) [2023-12-26 08:18:50,376][123091] Updated weights for policy 0, policy_version 1092396 (0.0009) [2023-12-26 08:18:50,414][123090] Updated weights for policy 1, policy_version 1084714 (0.0009) [2023-12-26 08:18:50,474][123090] Updated weights for policy 1, policy_version 1084724 (0.0009) [2023-12-26 08:18:50,541][123090] Updated weights for policy 1, policy_version 1084734 (0.0009) [2023-12-26 08:18:51,151][123091] Updated weights for policy 0, policy_version 1092406 (0.0010) [2023-12-26 08:18:51,207][123091] Updated weights for policy 0, policy_version 1092416 (0.0011) [2023-12-26 08:18:51,266][123091] Updated weights for policy 0, policy_version 1092426 (0.0011) [2023-12-26 08:18:51,414][123090] Updated weights for policy 1, policy_version 1084744 (0.0010) [2023-12-26 08:18:51,480][123090] Updated weights for policy 1, policy_version 1084754 (0.0009) [2023-12-26 08:18:51,549][123090] Updated weights for policy 1, policy_version 1084764 (0.0009) [2023-12-26 08:18:52,086][123091] Updated weights for policy 0, policy_version 1092436 (0.0011) [2023-12-26 08:18:52,141][123091] Updated weights for policy 0, policy_version 1092446 (0.0010) [2023-12-26 08:18:52,200][123091] Updated weights for policy 0, policy_version 1092456 (0.0010) [2023-12-26 08:18:52,420][123090] Updated weights for policy 1, policy_version 1084774 (0.0009) [2023-12-26 08:18:52,489][123090] Updated weights for policy 1, policy_version 1084784 (0.0009) [2023-12-26 08:18:52,546][123090] Updated weights for policy 1, policy_version 1084794 (0.0009) [2023-12-26 08:18:52,991][123091] Updated weights for policy 0, policy_version 1092466 (0.0009) [2023-12-26 08:18:53,059][123091] Updated weights for policy 0, policy_version 1092476 (0.0009) [2023-12-26 08:18:53,108][123091] Updated weights for policy 0, policy_version 1092486 (0.0009) [2023-12-26 08:18:53,167][123091] Updated weights for policy 0, policy_version 1092496 (0.0006) [2023-12-26 08:18:53,429][123090] Updated weights for policy 1, policy_version 1084804 (0.0009) [2023-12-26 08:18:53,499][123090] Updated weights for policy 1, policy_version 1084814 (0.0009) [2023-12-26 08:18:53,566][123090] Updated weights for policy 1, policy_version 1084824 (0.0010) [2023-12-26 08:18:53,721][123091] Updated weights for policy 0, policy_version 1092506 (0.0005) [2023-12-26 08:18:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 557400064. Throughput: 0: 8772.6, 1: 8804.6. Samples: 557376620. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:18:53,785][121949] Avg episode reward: [(0, '6133.406'), (1, '5550.244')] [2023-12-26 08:18:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001084832_277716992.pth... [2023-12-26 08:18:53,791][123091] Updated weights for policy 0, policy_version 1092516 (0.0006) [2023-12-26 08:18:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001083808_277454848.pth [2023-12-26 08:18:53,857][123091] Updated weights for policy 0, policy_version 1092526 (0.0010) [2023-12-26 08:18:53,867][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001092528_279691264.pth... [2023-12-26 08:18:53,871][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001091472_279420928.pth [2023-12-26 08:18:54,471][123090] Updated weights for policy 1, policy_version 1084834 (0.0009) [2023-12-26 08:18:54,525][123091] Updated weights for policy 0, policy_version 1092536 (0.0008) [2023-12-26 08:18:54,536][123090] Updated weights for policy 1, policy_version 1084844 (0.0007) [2023-12-26 08:18:54,580][123091] Updated weights for policy 0, policy_version 1092546 (0.0007) [2023-12-26 08:18:54,597][123090] Updated weights for policy 1, policy_version 1084854 (0.0008) [2023-12-26 08:18:54,641][123091] Updated weights for policy 0, policy_version 1092556 (0.0005) [2023-12-26 08:18:54,658][123090] Updated weights for policy 1, policy_version 1084864 (0.0008) [2023-12-26 08:18:55,399][123091] Updated weights for policy 0, policy_version 1092566 (0.0007) [2023-12-26 08:18:55,447][123091] Updated weights for policy 0, policy_version 1092576 (0.0009) [2023-12-26 08:18:55,481][123090] Updated weights for policy 1, policy_version 1084874 (0.0007) [2023-12-26 08:18:55,500][123091] Updated weights for policy 0, policy_version 1092586 (0.0009) [2023-12-26 08:18:55,540][123090] Updated weights for policy 1, policy_version 1084884 (0.0008) [2023-12-26 08:18:55,608][123090] Updated weights for policy 1, policy_version 1084894 (0.0010) [2023-12-26 08:18:56,189][123091] Updated weights for policy 0, policy_version 1092596 (0.0006) [2023-12-26 08:18:56,235][123091] Updated weights for policy 0, policy_version 1092606 (0.0005) [2023-12-26 08:18:56,283][123091] Updated weights for policy 0, policy_version 1092616 (0.0005) [2023-12-26 08:18:56,526][123090] Updated weights for policy 1, policy_version 1084904 (0.0010) [2023-12-26 08:18:56,592][123090] Updated weights for policy 1, policy_version 1084914 (0.0010) [2023-12-26 08:18:56,663][123090] Updated weights for policy 1, policy_version 1084924 (0.0010) [2023-12-26 08:18:56,946][123091] Updated weights for policy 0, policy_version 1092626 (0.0006) [2023-12-26 08:18:57,003][123091] Updated weights for policy 0, policy_version 1092636 (0.0011) [2023-12-26 08:18:57,065][123091] Updated weights for policy 0, policy_version 1092646 (0.0010) [2023-12-26 08:18:57,121][123091] Updated weights for policy 0, policy_version 1092656 (0.0010) [2023-12-26 08:18:57,537][123090] Updated weights for policy 1, policy_version 1084934 (0.0010) [2023-12-26 08:18:57,600][123090] Updated weights for policy 1, policy_version 1084944 (0.0010) [2023-12-26 08:18:57,665][123090] Updated weights for policy 1, policy_version 1084954 (0.0010) [2023-12-26 08:18:57,824][123091] Updated weights for policy 0, policy_version 1092666 (0.0005) [2023-12-26 08:18:57,869][123091] Updated weights for policy 0, policy_version 1092676 (0.0005) [2023-12-26 08:18:57,918][123091] Updated weights for policy 0, policy_version 1092686 (0.0005) [2023-12-26 08:18:58,588][123090] Updated weights for policy 1, policy_version 1084964 (0.0009) [2023-12-26 08:18:58,666][123090] Updated weights for policy 1, policy_version 1084974 (0.0008) [2023-12-26 08:18:58,735][123090] Updated weights for policy 1, policy_version 1084984 (0.0008) [2023-12-26 08:18:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17613.0, 300 sec: 17605.9). Total num frames: 557481984. Throughput: 0: 8894.1, 1: 8706.3. Samples: 557484632. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:18:58,785][121949] Avg episode reward: [(0, '6119.225'), (1, '5685.797')] [2023-12-26 08:18:58,832][123091] Updated weights for policy 0, policy_version 1092696 (0.0008) [2023-12-26 08:18:58,894][123091] Updated weights for policy 0, policy_version 1092706 (0.0009) [2023-12-26 08:18:58,965][123091] Updated weights for policy 0, policy_version 1092716 (0.0011) [2023-12-26 08:18:59,617][123090] Updated weights for policy 1, policy_version 1084994 (0.0009) [2023-12-26 08:18:59,683][123090] Updated weights for policy 1, policy_version 1085004 (0.0006) [2023-12-26 08:18:59,743][123090] Updated weights for policy 1, policy_version 1085014 (0.0009) [2023-12-26 08:18:59,800][123090] Updated weights for policy 1, policy_version 1085024 (0.0009) [2023-12-26 08:18:59,882][123091] Updated weights for policy 0, policy_version 1092726 (0.0009) [2023-12-26 08:18:59,953][123091] Updated weights for policy 0, policy_version 1092736 (0.0008) [2023-12-26 08:19:00,007][123091] Updated weights for policy 0, policy_version 1092746 (0.0010) [2023-12-26 08:19:00,616][123090] Updated weights for policy 1, policy_version 1085034 (0.0010) [2023-12-26 08:19:00,678][123091] Updated weights for policy 0, policy_version 1092756 (0.0009) [2023-12-26 08:19:00,681][123090] Updated weights for policy 1, policy_version 1085044 (0.0009) [2023-12-26 08:19:00,748][123091] Updated weights for policy 0, policy_version 1092766 (0.0005) [2023-12-26 08:19:00,749][123090] Updated weights for policy 1, policy_version 1085054 (0.0008) [2023-12-26 08:19:00,820][123091] Updated weights for policy 0, policy_version 1092776 (0.0005) [2023-12-26 08:19:01,496][123091] Updated weights for policy 0, policy_version 1092786 (0.0005) [2023-12-26 08:19:01,557][123091] Updated weights for policy 0, policy_version 1092796 (0.0007) [2023-12-26 08:19:01,648][123091] Updated weights for policy 0, policy_version 1092806 (0.0010) [2023-12-26 08:19:01,666][123090] Updated weights for policy 1, policy_version 1085064 (0.0008) [2023-12-26 08:19:01,705][123091] Updated weights for policy 0, policy_version 1092816 (0.0007) [2023-12-26 08:19:01,732][123090] Updated weights for policy 1, policy_version 1085074 (0.0008) [2023-12-26 08:19:01,798][123090] Updated weights for policy 1, policy_version 1085084 (0.0008) [2023-12-26 08:19:02,531][123091] Updated weights for policy 0, policy_version 1092827 (0.0010) [2023-12-26 08:19:02,550][123090] Updated weights for policy 1, policy_version 1085094 (0.0006) [2023-12-26 08:19:02,588][123091] Updated weights for policy 0, policy_version 1092837 (0.0009) [2023-12-26 08:19:02,600][123090] Updated weights for policy 1, policy_version 1085104 (0.0006) [2023-12-26 08:19:02,648][123090] Updated weights for policy 1, policy_version 1085114 (0.0007) [2023-12-26 08:19:02,657][123091] Updated weights for policy 0, policy_version 1092847 (0.0009) [2023-12-26 08:19:03,332][123090] Updated weights for policy 1, policy_version 1085124 (0.0006) [2023-12-26 08:19:03,383][123090] Updated weights for policy 1, policy_version 1085134 (0.0005) [2023-12-26 08:19:03,432][123090] Updated weights for policy 1, policy_version 1085144 (0.0005) [2023-12-26 08:19:03,534][123091] Updated weights for policy 0, policy_version 1092857 (0.0008) [2023-12-26 08:19:03,598][123091] Updated weights for policy 0, policy_version 1092867 (0.0009) [2023-12-26 08:19:03,673][123091] Updated weights for policy 0, policy_version 1092877 (0.0009) [2023-12-26 08:19:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 557580288. Throughput: 0: 8868.1, 1: 8665.6. Samples: 557587892. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:03,785][121949] Avg episode reward: [(0, '6036.705'), (1, '5543.848')] [2023-12-26 08:19:04,132][123090] Updated weights for policy 1, policy_version 1085154 (0.0006) [2023-12-26 08:19:04,187][123090] Updated weights for policy 1, policy_version 1085164 (0.0008) [2023-12-26 08:19:04,253][123090] Updated weights for policy 1, policy_version 1085174 (0.0009) [2023-12-26 08:19:04,322][123090] Updated weights for policy 1, policy_version 1085184 (0.0009) [2023-12-26 08:19:04,374][123091] Updated weights for policy 0, policy_version 1092887 (0.0009) [2023-12-26 08:19:04,434][123091] Updated weights for policy 0, policy_version 1092897 (0.0009) [2023-12-26 08:19:04,498][123091] Updated weights for policy 0, policy_version 1092907 (0.0009) [2023-12-26 08:19:05,170][123090] Updated weights for policy 1, policy_version 1085194 (0.0009) [2023-12-26 08:19:05,241][123090] Updated weights for policy 1, policy_version 1085204 (0.0010) [2023-12-26 08:19:05,297][123091] Updated weights for policy 0, policy_version 1092917 (0.0008) [2023-12-26 08:19:05,308][123090] Updated weights for policy 1, policy_version 1085214 (0.0009) [2023-12-26 08:19:05,359][123091] Updated weights for policy 0, policy_version 1092927 (0.0005) [2023-12-26 08:19:05,431][123091] Updated weights for policy 0, policy_version 1092937 (0.0005) [2023-12-26 08:19:06,041][123091] Updated weights for policy 0, policy_version 1092947 (0.0005) [2023-12-26 08:19:06,101][123091] Updated weights for policy 0, policy_version 1092957 (0.0006) [2023-12-26 08:19:06,161][123091] Updated weights for policy 0, policy_version 1092967 (0.0007) [2023-12-26 08:19:06,221][123090] Updated weights for policy 1, policy_version 1085224 (0.0008) [2023-12-26 08:19:06,282][123090] Updated weights for policy 1, policy_version 1085234 (0.0010) [2023-12-26 08:19:06,347][123090] Updated weights for policy 1, policy_version 1085244 (0.0010) [2023-12-26 08:19:06,859][123091] Updated weights for policy 0, policy_version 1092977 (0.0008) [2023-12-26 08:19:06,923][123091] Updated weights for policy 0, policy_version 1092987 (0.0007) [2023-12-26 08:19:06,997][123091] Updated weights for policy 0, policy_version 1092997 (0.0011) [2023-12-26 08:19:07,067][123091] Updated weights for policy 0, policy_version 1093007 (0.0011) [2023-12-26 08:19:07,225][123090] Updated weights for policy 1, policy_version 1085254 (0.0009) [2023-12-26 08:19:07,273][123090] Updated weights for policy 1, policy_version 1085264 (0.0008) [2023-12-26 08:19:07,321][123090] Updated weights for policy 1, policy_version 1085274 (0.0009) [2023-12-26 08:19:07,818][123091] Updated weights for policy 0, policy_version 1093017 (0.0011) [2023-12-26 08:19:07,888][123091] Updated weights for policy 0, policy_version 1093027 (0.0008) [2023-12-26 08:19:07,957][123091] Updated weights for policy 0, policy_version 1093037 (0.0005) [2023-12-26 08:19:08,255][123090] Updated weights for policy 1, policy_version 1085284 (0.0009) [2023-12-26 08:19:08,307][123090] Updated weights for policy 1, policy_version 1085294 (0.0009) [2023-12-26 08:19:08,369][123090] Updated weights for policy 1, policy_version 1085304 (0.0009) [2023-12-26 08:19:08,702][123091] Updated weights for policy 0, policy_version 1093047 (0.0006) [2023-12-26 08:19:08,777][123091] Updated weights for policy 0, policy_version 1093057 (0.0005) [2023-12-26 08:19:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 557662208. Throughput: 0: 8953.7, 1: 8634.7. Samples: 557641992. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:08,785][121949] Avg episode reward: [(0, '6049.604'), (1, '5505.844')] [2023-12-26 08:19:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001085312_277839872.pth... [2023-12-26 08:19:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001084320_277585920.pth [2023-12-26 08:19:08,850][123091] Updated weights for policy 0, policy_version 1093067 (0.0006) [2023-12-26 08:19:08,889][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001093072_279830528.pth... [2023-12-26 08:19:08,894][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001092016_279560192.pth [2023-12-26 08:19:09,036][123090] Updated weights for policy 1, policy_version 1085314 (0.0006) [2023-12-26 08:19:09,103][123090] Updated weights for policy 1, policy_version 1085324 (0.0005) [2023-12-26 08:19:09,155][123090] Updated weights for policy 1, policy_version 1085334 (0.0005) [2023-12-26 08:19:09,207][123090] Updated weights for policy 1, policy_version 1085344 (0.0008) [2023-12-26 08:19:09,577][123091] Updated weights for policy 0, policy_version 1093077 (0.0008) [2023-12-26 08:19:09,649][123091] Updated weights for policy 0, policy_version 1093087 (0.0011) [2023-12-26 08:19:09,710][123091] Updated weights for policy 0, policy_version 1093097 (0.0008) [2023-12-26 08:19:10,094][123090] Updated weights for policy 1, policy_version 1085354 (0.0009) [2023-12-26 08:19:10,165][123090] Updated weights for policy 1, policy_version 1085364 (0.0008) [2023-12-26 08:19:10,231][123090] Updated weights for policy 1, policy_version 1085374 (0.0009) [2023-12-26 08:19:10,459][123091] Updated weights for policy 0, policy_version 1093107 (0.0006) [2023-12-26 08:19:10,517][123091] Updated weights for policy 0, policy_version 1093117 (0.0006) [2023-12-26 08:19:10,582][123091] Updated weights for policy 0, policy_version 1093127 (0.0009) [2023-12-26 08:19:11,098][123090] Updated weights for policy 1, policy_version 1085384 (0.0010) [2023-12-26 08:19:11,166][123090] Updated weights for policy 1, policy_version 1085394 (0.0011) [2023-12-26 08:19:11,230][123090] Updated weights for policy 1, policy_version 1085404 (0.0011) [2023-12-26 08:19:11,393][123091] Updated weights for policy 0, policy_version 1093137 (0.0008) [2023-12-26 08:19:11,441][123091] Updated weights for policy 0, policy_version 1093147 (0.0006) [2023-12-26 08:19:11,506][123091] Updated weights for policy 0, policy_version 1093157 (0.0007) [2023-12-26 08:19:11,569][123091] Updated weights for policy 0, policy_version 1093167 (0.0008) [2023-12-26 08:19:12,062][123090] Updated weights for policy 1, policy_version 1085414 (0.0009) [2023-12-26 08:19:12,117][123090] Updated weights for policy 1, policy_version 1085424 (0.0008) [2023-12-26 08:19:12,166][123090] Updated weights for policy 1, policy_version 1085434 (0.0008) [2023-12-26 08:19:12,363][123091] Updated weights for policy 0, policy_version 1093177 (0.0009) [2023-12-26 08:19:12,431][123091] Updated weights for policy 0, policy_version 1093187 (0.0011) [2023-12-26 08:19:12,490][123091] Updated weights for policy 0, policy_version 1093197 (0.0011) [2023-12-26 08:19:12,975][123090] Updated weights for policy 1, policy_version 1085444 (0.0008) [2023-12-26 08:19:13,031][123090] Updated weights for policy 1, policy_version 1085454 (0.0010) [2023-12-26 08:19:13,085][123090] Updated weights for policy 1, policy_version 1085464 (0.0009) [2023-12-26 08:19:13,285][123091] Updated weights for policy 0, policy_version 1093207 (0.0010) [2023-12-26 08:19:13,337][123091] Updated weights for policy 0, policy_version 1093217 (0.0009) [2023-12-26 08:19:13,384][123091] Updated weights for policy 0, policy_version 1093227 (0.0008) [2023-12-26 08:19:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 557752320. Throughput: 0: 8958.9, 1: 8590.0. Samples: 557746416. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:13,784][121949] Avg episode reward: [(0, '6064.692'), (1, '5475.051')] [2023-12-26 08:19:13,979][123090] Updated weights for policy 1, policy_version 1085474 (0.0009) [2023-12-26 08:19:14,042][123090] Updated weights for policy 1, policy_version 1085484 (0.0009) [2023-12-26 08:19:14,087][123091] Updated weights for policy 0, policy_version 1093237 (0.0006) [2023-12-26 08:19:14,102][123090] Updated weights for policy 1, policy_version 1085494 (0.0010) [2023-12-26 08:19:14,160][123091] Updated weights for policy 0, policy_version 1093247 (0.0006) [2023-12-26 08:19:14,166][123090] Updated weights for policy 1, policy_version 1085504 (0.0009) [2023-12-26 08:19:14,228][123091] Updated weights for policy 0, policy_version 1093257 (0.0010) [2023-12-26 08:19:14,954][123091] Updated weights for policy 0, policy_version 1093267 (0.0010) [2023-12-26 08:19:15,013][123091] Updated weights for policy 0, policy_version 1093277 (0.0008) [2023-12-26 08:19:15,025][123090] Updated weights for policy 1, policy_version 1085514 (0.0008) [2023-12-26 08:19:15,081][123091] Updated weights for policy 0, policy_version 1093287 (0.0007) [2023-12-26 08:19:15,088][123090] Updated weights for policy 1, policy_version 1085524 (0.0007) [2023-12-26 08:19:15,143][123090] Updated weights for policy 1, policy_version 1085534 (0.0007) [2023-12-26 08:19:15,836][123091] Updated weights for policy 0, policy_version 1093297 (0.0006) [2023-12-26 08:19:15,850][123090] Updated weights for policy 1, policy_version 1085544 (0.0005) [2023-12-26 08:19:15,895][123091] Updated weights for policy 0, policy_version 1093307 (0.0009) [2023-12-26 08:19:15,902][123090] Updated weights for policy 1, policy_version 1085554 (0.0005) [2023-12-26 08:19:15,950][123091] Updated weights for policy 0, policy_version 1093317 (0.0007) [2023-12-26 08:19:15,960][123090] Updated weights for policy 1, policy_version 1085564 (0.0005) [2023-12-26 08:19:16,005][123091] Updated weights for policy 0, policy_version 1093328 (0.0010) [2023-12-26 08:19:16,700][123090] Updated weights for policy 1, policy_version 1085574 (0.0008) [2023-12-26 08:19:16,760][123090] Updated weights for policy 1, policy_version 1085584 (0.0010) [2023-12-26 08:19:16,814][123090] Updated weights for policy 1, policy_version 1085594 (0.0009) [2023-12-26 08:19:16,842][123091] Updated weights for policy 0, policy_version 1093338 (0.0008) [2023-12-26 08:19:16,912][123091] Updated weights for policy 0, policy_version 1093348 (0.0010) [2023-12-26 08:19:16,994][123091] Updated weights for policy 0, policy_version 1093358 (0.0009) [2023-12-26 08:19:17,565][123090] Updated weights for policy 1, policy_version 1085604 (0.0007) [2023-12-26 08:19:17,610][123090] Updated weights for policy 1, policy_version 1085614 (0.0005) [2023-12-26 08:19:17,655][123090] Updated weights for policy 1, policy_version 1085624 (0.0005) [2023-12-26 08:19:17,847][123091] Updated weights for policy 0, policy_version 1093368 (0.0010) [2023-12-26 08:19:17,908][123091] Updated weights for policy 0, policy_version 1093379 (0.0010) [2023-12-26 08:19:17,958][123091] Updated weights for policy 0, policy_version 1093389 (0.0009) [2023-12-26 08:19:18,399][123090] Updated weights for policy 1, policy_version 1085634 (0.0005) [2023-12-26 08:19:18,449][123090] Updated weights for policy 1, policy_version 1085644 (0.0006) [2023-12-26 08:19:18,506][123090] Updated weights for policy 1, policy_version 1085654 (0.0006) [2023-12-26 08:19:18,570][123090] Updated weights for policy 1, policy_version 1085664 (0.0005) [2023-12-26 08:19:18,776][123091] Updated weights for policy 0, policy_version 1093399 (0.0008) [2023-12-26 08:19:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 557842432. Throughput: 0: 8999.4, 1: 8613.0. Samples: 557855076. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:18,784][121949] Avg episode reward: [(0, '6067.022'), (1, '5212.150')] [2023-12-26 08:19:18,834][123091] Updated weights for policy 0, policy_version 1093409 (0.0009) [2023-12-26 08:19:18,893][123091] Updated weights for policy 0, policy_version 1093419 (0.0009) [2023-12-26 08:19:19,246][123090] Updated weights for policy 1, policy_version 1085674 (0.0006) [2023-12-26 08:19:19,314][123090] Updated weights for policy 1, policy_version 1085684 (0.0009) [2023-12-26 08:19:19,386][123090] Updated weights for policy 1, policy_version 1085694 (0.0008) [2023-12-26 08:19:19,878][123091] Updated weights for policy 0, policy_version 1093429 (0.0009) [2023-12-26 08:19:19,947][123091] Updated weights for policy 0, policy_version 1093439 (0.0009) [2023-12-26 08:19:20,015][123091] Updated weights for policy 0, policy_version 1093449 (0.0009) [2023-12-26 08:19:20,065][123090] Updated weights for policy 1, policy_version 1085704 (0.0009) [2023-12-26 08:19:20,127][123090] Updated weights for policy 1, policy_version 1085714 (0.0009) [2023-12-26 08:19:20,177][123090] Updated weights for policy 1, policy_version 1085724 (0.0009) [2023-12-26 08:19:20,869][123091] Updated weights for policy 0, policy_version 1093459 (0.0008) [2023-12-26 08:19:20,937][123091] Updated weights for policy 0, policy_version 1093469 (0.0009) [2023-12-26 08:19:20,945][123090] Updated weights for policy 1, policy_version 1085734 (0.0009) [2023-12-26 08:19:21,000][123091] Updated weights for policy 0, policy_version 1093479 (0.0009) [2023-12-26 08:19:21,007][123090] Updated weights for policy 1, policy_version 1085744 (0.0008) [2023-12-26 08:19:21,080][123090] Updated weights for policy 1, policy_version 1085754 (0.0008) [2023-12-26 08:19:21,871][123090] Updated weights for policy 1, policy_version 1085764 (0.0007) [2023-12-26 08:19:21,934][123090] Updated weights for policy 1, policy_version 1085774 (0.0009) [2023-12-26 08:19:21,959][123091] Updated weights for policy 0, policy_version 1093489 (0.0010) [2023-12-26 08:19:22,011][123090] Updated weights for policy 1, policy_version 1085784 (0.0010) [2023-12-26 08:19:22,019][123091] Updated weights for policy 0, policy_version 1093499 (0.0006) [2023-12-26 08:19:22,082][123091] Updated weights for policy 0, policy_version 1093509 (0.0007) [2023-12-26 08:19:22,135][123091] Updated weights for policy 0, policy_version 1093519 (0.0009) [2023-12-26 08:19:22,816][123090] Updated weights for policy 1, policy_version 1085794 (0.0010) [2023-12-26 08:19:22,890][123090] Updated weights for policy 1, policy_version 1085804 (0.0009) [2023-12-26 08:19:22,956][123090] Updated weights for policy 1, policy_version 1085814 (0.0008) [2023-12-26 08:19:22,989][123091] Updated weights for policy 0, policy_version 1093529 (0.0008) [2023-12-26 08:19:23,022][123090] Updated weights for policy 1, policy_version 1085824 (0.0009) [2023-12-26 08:19:23,049][123091] Updated weights for policy 0, policy_version 1093539 (0.0008) [2023-12-26 08:19:23,114][123091] Updated weights for policy 0, policy_version 1093549 (0.0010) [2023-12-26 08:19:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 557924352. Throughput: 0: 8922.5, 1: 8675.0. Samples: 557906440. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:23,785][121949] Avg episode reward: [(0, '6087.149'), (1, '5183.232')] [2023-12-26 08:19:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001093552_279953408.pth... [2023-12-26 08:19:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001092528_279691264.pth [2023-12-26 08:19:23,827][123090] Updated weights for policy 1, policy_version 1085834 (0.0006) [2023-12-26 08:19:23,888][123090] Updated weights for policy 1, policy_version 1085844 (0.0007) [2023-12-26 08:19:23,894][123091] Updated weights for policy 0, policy_version 1093559 (0.0009) [2023-12-26 08:19:23,955][123090] Updated weights for policy 1, policy_version 1085854 (0.0008) [2023-12-26 08:19:23,957][123091] Updated weights for policy 0, policy_version 1093569 (0.0008) [2023-12-26 08:19:23,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001085856_277979136.pth... [2023-12-26 08:19:23,971][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001084832_277716992.pth [2023-12-26 08:19:24,020][123091] Updated weights for policy 0, policy_version 1093579 (0.0009) [2023-12-26 08:19:24,721][123090] Updated weights for policy 1, policy_version 1085864 (0.0006) [2023-12-26 08:19:24,781][123090] Updated weights for policy 1, policy_version 1085874 (0.0005) [2023-12-26 08:19:24,845][123090] Updated weights for policy 1, policy_version 1085884 (0.0005) [2023-12-26 08:19:24,854][123091] Updated weights for policy 0, policy_version 1093589 (0.0008) [2023-12-26 08:19:24,918][123091] Updated weights for policy 0, policy_version 1093599 (0.0009) [2023-12-26 08:19:24,988][123091] Updated weights for policy 0, policy_version 1093609 (0.0009) [2023-12-26 08:19:25,499][123090] Updated weights for policy 1, policy_version 1085894 (0.0005) [2023-12-26 08:19:25,548][123090] Updated weights for policy 1, policy_version 1085904 (0.0005) [2023-12-26 08:19:25,613][123090] Updated weights for policy 1, policy_version 1085914 (0.0008) [2023-12-26 08:19:25,867][123091] Updated weights for policy 0, policy_version 1093619 (0.0010) [2023-12-26 08:19:25,924][123091] Updated weights for policy 0, policy_version 1093629 (0.0010) [2023-12-26 08:19:25,991][123091] Updated weights for policy 0, policy_version 1093639 (0.0010) [2023-12-26 08:19:26,307][123090] Updated weights for policy 1, policy_version 1085924 (0.0009) [2023-12-26 08:19:26,362][123090] Updated weights for policy 1, policy_version 1085934 (0.0006) [2023-12-26 08:19:26,407][123090] Updated weights for policy 1, policy_version 1085944 (0.0005) [2023-12-26 08:19:26,874][123091] Updated weights for policy 0, policy_version 1093649 (0.0009) [2023-12-26 08:19:26,944][123091] Updated weights for policy 0, policy_version 1093659 (0.0009) [2023-12-26 08:19:27,007][123091] Updated weights for policy 0, policy_version 1093669 (0.0009) [2023-12-26 08:19:27,065][123091] Updated weights for policy 0, policy_version 1093679 (0.0010) [2023-12-26 08:19:27,155][123090] Updated weights for policy 1, policy_version 1085954 (0.0007) [2023-12-26 08:19:27,205][123090] Updated weights for policy 1, policy_version 1085964 (0.0005) [2023-12-26 08:19:27,253][123090] Updated weights for policy 1, policy_version 1085974 (0.0006) [2023-12-26 08:19:27,313][123090] Updated weights for policy 1, policy_version 1085984 (0.0006) [2023-12-26 08:19:27,912][123091] Updated weights for policy 0, policy_version 1093689 (0.0009) [2023-12-26 08:19:27,965][123091] Updated weights for policy 0, policy_version 1093700 (0.0010) [2023-12-26 08:19:28,019][123091] Updated weights for policy 0, policy_version 1093710 (0.0006) [2023-12-26 08:19:28,027][123090] Updated weights for policy 1, policy_version 1085994 (0.0009) [2023-12-26 08:19:28,086][123090] Updated weights for policy 1, policy_version 1086004 (0.0009) [2023-12-26 08:19:28,137][123090] Updated weights for policy 1, policy_version 1086014 (0.0009) [2023-12-26 08:19:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 558014464. Throughput: 0: 8874.7, 1: 8793.3. Samples: 558012900. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:28,785][121949] Avg episode reward: [(0, '6084.276'), (1, '5247.163')] [2023-12-26 08:19:28,843][123090] Updated weights for policy 1, policy_version 1086024 (0.0006) [2023-12-26 08:19:28,910][123091] Updated weights for policy 0, policy_version 1093720 (0.0007) [2023-12-26 08:19:28,913][123090] Updated weights for policy 1, policy_version 1086034 (0.0008) [2023-12-26 08:19:28,972][123091] Updated weights for policy 0, policy_version 1093730 (0.0006) [2023-12-26 08:19:28,980][123090] Updated weights for policy 1, policy_version 1086044 (0.0009) [2023-12-26 08:19:29,033][123091] Updated weights for policy 0, policy_version 1093740 (0.0009) [2023-12-26 08:19:29,814][123091] Updated weights for policy 0, policy_version 1093750 (0.0007) [2023-12-26 08:19:29,883][123090] Updated weights for policy 1, policy_version 1086054 (0.0007) [2023-12-26 08:19:29,885][123091] Updated weights for policy 0, policy_version 1093760 (0.0009) [2023-12-26 08:19:29,944][123091] Updated weights for policy 0, policy_version 1093770 (0.0009) [2023-12-26 08:19:29,948][123090] Updated weights for policy 1, policy_version 1086064 (0.0008) [2023-12-26 08:19:30,013][123090] Updated weights for policy 1, policy_version 1086074 (0.0009) [2023-12-26 08:19:30,669][123091] Updated weights for policy 0, policy_version 1093780 (0.0010) [2023-12-26 08:19:30,725][123091] Updated weights for policy 0, policy_version 1093790 (0.0008) [2023-12-26 08:19:30,770][123091] Updated weights for policy 0, policy_version 1093800 (0.0007) [2023-12-26 08:19:30,858][123090] Updated weights for policy 1, policy_version 1086084 (0.0009) [2023-12-26 08:19:30,911][123090] Updated weights for policy 1, policy_version 1086094 (0.0008) [2023-12-26 08:19:30,962][123090] Updated weights for policy 1, policy_version 1086104 (0.0009) [2023-12-26 08:19:31,675][123091] Updated weights for policy 0, policy_version 1093810 (0.0008) [2023-12-26 08:19:31,739][123091] Updated weights for policy 0, policy_version 1093820 (0.0009) [2023-12-26 08:19:31,766][123090] Updated weights for policy 1, policy_version 1086114 (0.0010) [2023-12-26 08:19:31,790][123091] Updated weights for policy 0, policy_version 1093830 (0.0008) [2023-12-26 08:19:31,834][123090] Updated weights for policy 1, policy_version 1086124 (0.0008) [2023-12-26 08:19:31,842][123091] Updated weights for policy 0, policy_version 1093840 (0.0008) [2023-12-26 08:19:31,881][123090] Updated weights for policy 1, policy_version 1086134 (0.0008) [2023-12-26 08:19:31,933][123090] Updated weights for policy 1, policy_version 1086144 (0.0008) [2023-12-26 08:19:32,673][123091] Updated weights for policy 0, policy_version 1093850 (0.0010) [2023-12-26 08:19:32,728][123091] Updated weights for policy 0, policy_version 1093861 (0.0009) [2023-12-26 08:19:32,759][123090] Updated weights for policy 1, policy_version 1086154 (0.0010) [2023-12-26 08:19:32,785][123091] Updated weights for policy 0, policy_version 1093871 (0.0010) [2023-12-26 08:19:32,818][123090] Updated weights for policy 1, policy_version 1086164 (0.0009) [2023-12-26 08:19:32,884][123090] Updated weights for policy 1, policy_version 1086174 (0.0009) [2023-12-26 08:19:33,630][123091] Updated weights for policy 0, policy_version 1093881 (0.0009) [2023-12-26 08:19:33,672][123090] Updated weights for policy 1, policy_version 1086184 (0.0010) [2023-12-26 08:19:33,675][123091] Updated weights for policy 0, policy_version 1093891 (0.0008) [2023-12-26 08:19:33,737][123090] Updated weights for policy 1, policy_version 1086194 (0.0010) [2023-12-26 08:19:33,738][123091] Updated weights for policy 0, policy_version 1093901 (0.0007) [2023-12-26 08:19:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 558104576. Throughput: 0: 8866.2, 1: 8722.2. Samples: 558117016. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:33,785][121949] Avg episode reward: [(0, '5972.918'), (1, '5357.855')] [2023-12-26 08:19:33,802][123090] Updated weights for policy 1, policy_version 1086204 (0.0010) [2023-12-26 08:19:34,547][123090] Updated weights for policy 1, policy_version 1086214 (0.0011) [2023-12-26 08:19:34,560][123091] Updated weights for policy 0, policy_version 1093911 (0.0010) [2023-12-26 08:19:34,612][123090] Updated weights for policy 1, policy_version 1086224 (0.0011) [2023-12-26 08:19:34,624][123091] Updated weights for policy 0, policy_version 1093921 (0.0009) [2023-12-26 08:19:34,671][123090] Updated weights for policy 1, policy_version 1086234 (0.0010) [2023-12-26 08:19:34,687][123091] Updated weights for policy 0, policy_version 1093931 (0.0007) [2023-12-26 08:19:35,481][123091] Updated weights for policy 0, policy_version 1093941 (0.0006) [2023-12-26 08:19:35,513][123090] Updated weights for policy 1, policy_version 1086244 (0.0010) [2023-12-26 08:19:35,543][123091] Updated weights for policy 0, policy_version 1093951 (0.0005) [2023-12-26 08:19:35,576][123090] Updated weights for policy 1, policy_version 1086254 (0.0010) [2023-12-26 08:19:35,598][123091] Updated weights for policy 0, policy_version 1093961 (0.0005) [2023-12-26 08:19:35,647][123090] Updated weights for policy 1, policy_version 1086264 (0.0011) [2023-12-26 08:19:36,321][123091] Updated weights for policy 0, policy_version 1093971 (0.0007) [2023-12-26 08:19:36,369][123091] Updated weights for policy 0, policy_version 1093981 (0.0010) [2023-12-26 08:19:36,430][123090] Updated weights for policy 1, policy_version 1086274 (0.0011) [2023-12-26 08:19:36,433][123091] Updated weights for policy 0, policy_version 1093991 (0.0011) [2023-12-26 08:19:36,491][123090] Updated weights for policy 1, policy_version 1086284 (0.0011) [2023-12-26 08:19:36,551][123090] Updated weights for policy 1, policy_version 1086294 (0.0011) [2023-12-26 08:19:36,623][123090] Updated weights for policy 1, policy_version 1086304 (0.0011) [2023-12-26 08:19:37,244][123091] Updated weights for policy 0, policy_version 1094001 (0.0010) [2023-12-26 08:19:37,317][123091] Updated weights for policy 0, policy_version 1094011 (0.0009) [2023-12-26 08:19:37,392][123091] Updated weights for policy 0, policy_version 1094021 (0.0007) [2023-12-26 08:19:37,404][123090] Updated weights for policy 1, policy_version 1086314 (0.0006) [2023-12-26 08:19:37,464][123091] Updated weights for policy 0, policy_version 1094031 (0.0006) [2023-12-26 08:19:37,464][123090] Updated weights for policy 1, policy_version 1086324 (0.0010) [2023-12-26 08:19:37,536][123090] Updated weights for policy 1, policy_version 1086334 (0.0006) [2023-12-26 08:19:38,071][123091] Updated weights for policy 0, policy_version 1094041 (0.0006) [2023-12-26 08:19:38,129][123091] Updated weights for policy 0, policy_version 1094051 (0.0006) [2023-12-26 08:19:38,187][123091] Updated weights for policy 0, policy_version 1094061 (0.0005) [2023-12-26 08:19:38,251][123090] Updated weights for policy 1, policy_version 1086344 (0.0006) [2023-12-26 08:19:38,299][123090] Updated weights for policy 1, policy_version 1086354 (0.0005) [2023-12-26 08:19:38,370][123090] Updated weights for policy 1, policy_version 1086364 (0.0009) [2023-12-26 08:19:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 558194688. Throughput: 0: 8884.1, 1: 8743.6. Samples: 558169864. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:38,785][121949] Avg episode reward: [(0, '5974.031'), (1, '5357.416')] [2023-12-26 08:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001094064_280084480.pth... [2023-12-26 08:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001086368_278110208.pth... [2023-12-26 08:19:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001093072_279830528.pth [2023-12-26 08:19:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001085312_277839872.pth [2023-12-26 08:19:39,009][123091] Updated weights for policy 0, policy_version 1094071 (0.0008) [2023-12-26 08:19:39,065][123091] Updated weights for policy 0, policy_version 1094081 (0.0009) [2023-12-26 08:19:39,100][123090] Updated weights for policy 1, policy_version 1086374 (0.0007) [2023-12-26 08:19:39,122][123091] Updated weights for policy 0, policy_version 1094091 (0.0009) [2023-12-26 08:19:39,169][123090] Updated weights for policy 1, policy_version 1086384 (0.0009) [2023-12-26 08:19:39,239][123090] Updated weights for policy 1, policy_version 1086394 (0.0010) [2023-12-26 08:19:39,950][123091] Updated weights for policy 0, policy_version 1094101 (0.0008) [2023-12-26 08:19:40,012][123091] Updated weights for policy 0, policy_version 1094111 (0.0009) [2023-12-26 08:19:40,083][123091] Updated weights for policy 0, policy_version 1094121 (0.0009) [2023-12-26 08:19:40,101][123090] Updated weights for policy 1, policy_version 1086404 (0.0009) [2023-12-26 08:19:40,160][123090] Updated weights for policy 1, policy_version 1086414 (0.0010) [2023-12-26 08:19:40,224][123090] Updated weights for policy 1, policy_version 1086424 (0.0010) [2023-12-26 08:19:40,894][123091] Updated weights for policy 0, policy_version 1094131 (0.0007) [2023-12-26 08:19:40,947][123091] Updated weights for policy 0, policy_version 1094141 (0.0007) [2023-12-26 08:19:41,006][123091] Updated weights for policy 0, policy_version 1094151 (0.0010) [2023-12-26 08:19:41,045][123090] Updated weights for policy 1, policy_version 1086434 (0.0010) [2023-12-26 08:19:41,113][123090] Updated weights for policy 1, policy_version 1086444 (0.0009) [2023-12-26 08:19:41,187][123090] Updated weights for policy 1, policy_version 1086454 (0.0010) [2023-12-26 08:19:41,252][123090] Updated weights for policy 1, policy_version 1086464 (0.0010) [2023-12-26 08:19:41,872][123091] Updated weights for policy 0, policy_version 1094161 (0.0009) [2023-12-26 08:19:41,936][123091] Updated weights for policy 0, policy_version 1094171 (0.0009) [2023-12-26 08:19:42,009][123091] Updated weights for policy 0, policy_version 1094181 (0.0008) [2023-12-26 08:19:42,078][123091] Updated weights for policy 0, policy_version 1094191 (0.0009) [2023-12-26 08:19:42,108][123090] Updated weights for policy 1, policy_version 1086474 (0.0006) [2023-12-26 08:19:42,159][123090] Updated weights for policy 1, policy_version 1086484 (0.0005) [2023-12-26 08:19:42,210][123090] Updated weights for policy 1, policy_version 1086494 (0.0008) [2023-12-26 08:19:42,871][123091] Updated weights for policy 0, policy_version 1094201 (0.0009) [2023-12-26 08:19:42,929][123091] Updated weights for policy 0, policy_version 1094211 (0.0009) [2023-12-26 08:19:42,989][123091] Updated weights for policy 0, policy_version 1094221 (0.0009) [2023-12-26 08:19:43,027][123090] Updated weights for policy 1, policy_version 1086504 (0.0010) [2023-12-26 08:19:43,084][123090] Updated weights for policy 1, policy_version 1086514 (0.0010) [2023-12-26 08:19:43,130][123090] Updated weights for policy 1, policy_version 1086524 (0.0010) [2023-12-26 08:19:43,764][123091] Updated weights for policy 0, policy_version 1094231 (0.0007) [2023-12-26 08:19:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 558276608. Throughput: 0: 8732.4, 1: 8843.3. Samples: 558275540. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:43,785][121949] Avg episode reward: [(0, '5999.253'), (1, '5452.690')] [2023-12-26 08:19:43,819][123091] Updated weights for policy 0, policy_version 1094241 (0.0005) [2023-12-26 08:19:43,872][123091] Updated weights for policy 0, policy_version 1094251 (0.0005) [2023-12-26 08:19:43,970][123090] Updated weights for policy 1, policy_version 1086534 (0.0010) [2023-12-26 08:19:44,038][123090] Updated weights for policy 1, policy_version 1086544 (0.0009) [2023-12-26 08:19:44,099][123090] Updated weights for policy 1, policy_version 1086554 (0.0008) [2023-12-26 08:19:44,698][123091] Updated weights for policy 0, policy_version 1094261 (0.0009) [2023-12-26 08:19:44,747][123091] Updated weights for policy 0, policy_version 1094271 (0.0009) [2023-12-26 08:19:44,810][123091] Updated weights for policy 0, policy_version 1094281 (0.0009) [2023-12-26 08:19:44,946][123090] Updated weights for policy 1, policy_version 1086564 (0.0009) [2023-12-26 08:19:45,017][123090] Updated weights for policy 1, policy_version 1086574 (0.0009) [2023-12-26 08:19:45,083][123090] Updated weights for policy 1, policy_version 1086584 (0.0009) [2023-12-26 08:19:45,698][123091] Updated weights for policy 0, policy_version 1094291 (0.0008) [2023-12-26 08:19:45,749][123091] Updated weights for policy 0, policy_version 1094301 (0.0005) [2023-12-26 08:19:45,814][123091] Updated weights for policy 0, policy_version 1094311 (0.0005) [2023-12-26 08:19:45,902][123090] Updated weights for policy 1, policy_version 1086594 (0.0009) [2023-12-26 08:19:45,965][123090] Updated weights for policy 1, policy_version 1086604 (0.0009) [2023-12-26 08:19:46,031][123090] Updated weights for policy 1, policy_version 1086614 (0.0009) [2023-12-26 08:19:46,100][123090] Updated weights for policy 1, policy_version 1086624 (0.0010) [2023-12-26 08:19:46,575][123091] Updated weights for policy 0, policy_version 1094321 (0.0008) [2023-12-26 08:19:46,641][123091] Updated weights for policy 0, policy_version 1094331 (0.0006) [2023-12-26 08:19:46,695][123091] Updated weights for policy 0, policy_version 1094341 (0.0007) [2023-12-26 08:19:46,745][123091] Updated weights for policy 0, policy_version 1094351 (0.0009) [2023-12-26 08:19:46,929][123090] Updated weights for policy 1, policy_version 1086634 (0.0009) [2023-12-26 08:19:46,983][123090] Updated weights for policy 1, policy_version 1086645 (0.0010) [2023-12-26 08:19:47,047][123090] Updated weights for policy 1, policy_version 1086656 (0.0009) [2023-12-26 08:19:47,511][123091] Updated weights for policy 0, policy_version 1094361 (0.0006) [2023-12-26 08:19:47,579][123091] Updated weights for policy 0, policy_version 1094371 (0.0006) [2023-12-26 08:19:47,627][123091] Updated weights for policy 0, policy_version 1094381 (0.0006) [2023-12-26 08:19:47,787][123090] Updated weights for policy 1, policy_version 1086666 (0.0006) [2023-12-26 08:19:47,857][123090] Updated weights for policy 1, policy_version 1086676 (0.0005) [2023-12-26 08:19:47,916][123090] Updated weights for policy 1, policy_version 1086686 (0.0005) [2023-12-26 08:19:48,391][123091] Updated weights for policy 0, policy_version 1094391 (0.0008) [2023-12-26 08:19:48,456][123091] Updated weights for policy 0, policy_version 1094401 (0.0009) [2023-12-26 08:19:48,529][123091] Updated weights for policy 0, policy_version 1094411 (0.0009) [2023-12-26 08:19:48,562][123090] Updated weights for policy 1, policy_version 1086696 (0.0009) [2023-12-26 08:19:48,622][123090] Updated weights for policy 1, policy_version 1086706 (0.0010) [2023-12-26 08:19:48,691][123090] Updated weights for policy 1, policy_version 1086716 (0.0010) [2023-12-26 08:19:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 558374912. Throughput: 0: 8750.7, 1: 8874.6. Samples: 558381028. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:48,784][121949] Avg episode reward: [(0, '6027.918'), (1, '5524.415')] [2023-12-26 08:19:49,227][123091] Updated weights for policy 0, policy_version 1094421 (0.0007) [2023-12-26 08:19:49,292][123091] Updated weights for policy 0, policy_version 1094431 (0.0007) [2023-12-26 08:19:49,365][123091] Updated weights for policy 0, policy_version 1094441 (0.0007) [2023-12-26 08:19:49,475][123090] Updated weights for policy 1, policy_version 1086726 (0.0010) [2023-12-26 08:19:49,536][123090] Updated weights for policy 1, policy_version 1086736 (0.0013) [2023-12-26 08:19:49,595][123090] Updated weights for policy 1, policy_version 1086746 (0.0010) [2023-12-26 08:19:50,079][123091] Updated weights for policy 0, policy_version 1094451 (0.0007) [2023-12-26 08:19:50,145][123091] Updated weights for policy 0, policy_version 1094461 (0.0008) [2023-12-26 08:19:50,211][123091] Updated weights for policy 0, policy_version 1094471 (0.0008) [2023-12-26 08:19:50,404][123090] Updated weights for policy 1, policy_version 1086756 (0.0008) [2023-12-26 08:19:50,469][123090] Updated weights for policy 1, policy_version 1086766 (0.0009) [2023-12-26 08:19:50,522][123090] Updated weights for policy 1, policy_version 1086776 (0.0009) [2023-12-26 08:19:50,941][123091] Updated weights for policy 0, policy_version 1094481 (0.0007) [2023-12-26 08:19:50,994][123091] Updated weights for policy 0, policy_version 1094491 (0.0005) [2023-12-26 08:19:51,069][123091] Updated weights for policy 0, policy_version 1094501 (0.0009) [2023-12-26 08:19:51,139][123091] Updated weights for policy 0, policy_version 1094511 (0.0009) [2023-12-26 08:19:51,356][123090] Updated weights for policy 1, policy_version 1086786 (0.0009) [2023-12-26 08:19:51,424][123090] Updated weights for policy 1, policy_version 1086796 (0.0008) [2023-12-26 08:19:51,496][123090] Updated weights for policy 1, policy_version 1086806 (0.0010) [2023-12-26 08:19:51,569][123090] Updated weights for policy 1, policy_version 1086816 (0.0008) [2023-12-26 08:19:51,930][123091] Updated weights for policy 0, policy_version 1094521 (0.0009) [2023-12-26 08:19:51,991][123091] Updated weights for policy 0, policy_version 1094531 (0.0010) [2023-12-26 08:19:52,057][123091] Updated weights for policy 0, policy_version 1094541 (0.0010) [2023-12-26 08:19:52,385][123090] Updated weights for policy 1, policy_version 1086826 (0.0007) [2023-12-26 08:19:52,444][123090] Updated weights for policy 1, policy_version 1086836 (0.0006) [2023-12-26 08:19:52,507][123090] Updated weights for policy 1, policy_version 1086846 (0.0008) [2023-12-26 08:19:52,942][123091] Updated weights for policy 0, policy_version 1094551 (0.0007) [2023-12-26 08:19:52,989][123091] Updated weights for policy 0, policy_version 1094561 (0.0005) [2023-12-26 08:19:53,044][123091] Updated weights for policy 0, policy_version 1094571 (0.0005) [2023-12-26 08:19:53,280][123090] Updated weights for policy 1, policy_version 1086856 (0.0010) [2023-12-26 08:19:53,324][123090] Updated weights for policy 1, policy_version 1086866 (0.0010) [2023-12-26 08:19:53,371][123090] Updated weights for policy 1, policy_version 1086876 (0.0010) [2023-12-26 08:19:53,777][123091] Updated weights for policy 0, policy_version 1094581 (0.0006) [2023-12-26 08:19:53,785][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.6, 300 sec: 17661.4). Total num frames: 558456832. Throughput: 0: 8738.5, 1: 8897.6. Samples: 558435624. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:53,786][121949] Avg episode reward: [(0, '5995.747'), (1, '5540.783')] [2023-12-26 08:19:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001086880_278241280.pth... [2023-12-26 08:19:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001085856_277979136.pth [2023-12-26 08:19:53,824][123091] Updated weights for policy 0, policy_version 1094591 (0.0005) [2023-12-26 08:19:53,871][123091] Updated weights for policy 0, policy_version 1094601 (0.0005) [2023-12-26 08:19:53,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001094608_280223744.pth... [2023-12-26 08:19:53,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001093552_279953408.pth [2023-12-26 08:19:54,111][123090] Updated weights for policy 1, policy_version 1086886 (0.0008) [2023-12-26 08:19:54,172][123090] Updated weights for policy 1, policy_version 1086896 (0.0008) [2023-12-26 08:19:54,240][123090] Updated weights for policy 1, policy_version 1086906 (0.0010) [2023-12-26 08:19:54,536][123091] Updated weights for policy 0, policy_version 1094611 (0.0007) [2023-12-26 08:19:54,594][123091] Updated weights for policy 0, policy_version 1094621 (0.0010) [2023-12-26 08:19:54,653][123091] Updated weights for policy 0, policy_version 1094631 (0.0010) [2023-12-26 08:19:54,975][123090] Updated weights for policy 1, policy_version 1086916 (0.0008) [2023-12-26 08:19:55,037][123090] Updated weights for policy 1, policy_version 1086926 (0.0007) [2023-12-26 08:19:55,108][123090] Updated weights for policy 1, policy_version 1086936 (0.0009) [2023-12-26 08:19:55,462][123091] Updated weights for policy 0, policy_version 1094641 (0.0010) [2023-12-26 08:19:55,520][123091] Updated weights for policy 0, policy_version 1094651 (0.0010) [2023-12-26 08:19:55,577][123091] Updated weights for policy 0, policy_version 1094661 (0.0010) [2023-12-26 08:19:55,635][123091] Updated weights for policy 0, policy_version 1094671 (0.0010) [2023-12-26 08:19:55,929][123090] Updated weights for policy 1, policy_version 1086946 (0.0009) [2023-12-26 08:19:55,991][123090] Updated weights for policy 1, policy_version 1086956 (0.0010) [2023-12-26 08:19:56,049][123090] Updated weights for policy 1, policy_version 1086966 (0.0010) [2023-12-26 08:19:56,102][123090] Updated weights for policy 1, policy_version 1086976 (0.0010) [2023-12-26 08:19:56,376][123091] Updated weights for policy 0, policy_version 1094681 (0.0006) [2023-12-26 08:19:56,432][123091] Updated weights for policy 0, policy_version 1094691 (0.0005) [2023-12-26 08:19:56,487][123091] Updated weights for policy 0, policy_version 1094701 (0.0005) [2023-12-26 08:19:56,989][123090] Updated weights for policy 1, policy_version 1086986 (0.0005) [2023-12-26 08:19:57,042][123090] Updated weights for policy 1, policy_version 1086996 (0.0006) [2023-12-26 08:19:57,084][123090] Updated weights for policy 1, policy_version 1087006 (0.0005) [2023-12-26 08:19:57,126][123091] Updated weights for policy 0, policy_version 1094711 (0.0005) [2023-12-26 08:19:57,174][123091] Updated weights for policy 0, policy_version 1094721 (0.0005) [2023-12-26 08:19:57,222][123091] Updated weights for policy 0, policy_version 1094731 (0.0005) [2023-12-26 08:19:57,781][123090] Updated weights for policy 1, policy_version 1087016 (0.0005) [2023-12-26 08:19:57,830][123090] Updated weights for policy 1, policy_version 1087026 (0.0005) [2023-12-26 08:19:57,902][123090] Updated weights for policy 1, policy_version 1087036 (0.0005) [2023-12-26 08:19:57,924][123091] Updated weights for policy 0, policy_version 1094741 (0.0005) [2023-12-26 08:19:57,968][123091] Updated weights for policy 0, policy_version 1094751 (0.0009) [2023-12-26 08:19:58,019][123091] Updated weights for policy 0, policy_version 1094761 (0.0010) [2023-12-26 08:19:58,696][123090] Updated weights for policy 1, policy_version 1087046 (0.0008) [2023-12-26 08:19:58,767][123090] Updated weights for policy 1, policy_version 1087057 (0.0011) [2023-12-26 08:19:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 558546944. Throughput: 0: 8806.3, 1: 8976.8. Samples: 558546656. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:19:58,785][121949] Avg episode reward: [(0, '5835.088'), (1, '5569.460')] [2023-12-26 08:19:58,802][123091] Updated weights for policy 0, policy_version 1094771 (0.0011) [2023-12-26 08:19:58,831][123090] Updated weights for policy 1, policy_version 1087067 (0.0010) [2023-12-26 08:19:58,869][123091] Updated weights for policy 0, policy_version 1094781 (0.0011) [2023-12-26 08:19:58,936][123091] Updated weights for policy 0, policy_version 1094791 (0.0009) [2023-12-26 08:19:59,637][123091] Updated weights for policy 0, policy_version 1094801 (0.0006) [2023-12-26 08:19:59,694][123090] Updated weights for policy 1, policy_version 1087077 (0.0011) [2023-12-26 08:19:59,704][123091] Updated weights for policy 0, policy_version 1094811 (0.0011) [2023-12-26 08:19:59,750][123090] Updated weights for policy 1, policy_version 1087087 (0.0011) [2023-12-26 08:19:59,768][123091] Updated weights for policy 0, policy_version 1094821 (0.0011) [2023-12-26 08:19:59,812][123090] Updated weights for policy 1, policy_version 1087097 (0.0011) [2023-12-26 08:19:59,837][123091] Updated weights for policy 0, policy_version 1094831 (0.0010) [2023-12-26 08:20:00,659][123090] Updated weights for policy 1, policy_version 1087107 (0.0010) [2023-12-26 08:20:00,676][123091] Updated weights for policy 0, policy_version 1094841 (0.0010) [2023-12-26 08:20:00,718][123090] Updated weights for policy 1, policy_version 1087117 (0.0008) [2023-12-26 08:20:00,738][123091] Updated weights for policy 0, policy_version 1094851 (0.0010) [2023-12-26 08:20:00,780][123090] Updated weights for policy 1, policy_version 1087127 (0.0006) [2023-12-26 08:20:00,803][123091] Updated weights for policy 0, policy_version 1094861 (0.0011) [2023-12-26 08:20:01,491][123090] Updated weights for policy 1, policy_version 1087137 (0.0006) [2023-12-26 08:20:01,559][123090] Updated weights for policy 1, policy_version 1087147 (0.0011) [2023-12-26 08:20:01,627][123090] Updated weights for policy 1, policy_version 1087157 (0.0009) [2023-12-26 08:20:01,661][123091] Updated weights for policy 0, policy_version 1094871 (0.0008) [2023-12-26 08:20:01,684][123090] Updated weights for policy 1, policy_version 1087167 (0.0008) [2023-12-26 08:20:01,725][123091] Updated weights for policy 0, policy_version 1094881 (0.0008) [2023-12-26 08:20:01,788][123091] Updated weights for policy 0, policy_version 1094891 (0.0010) [2023-12-26 08:20:02,395][123090] Updated weights for policy 1, policy_version 1087177 (0.0008) [2023-12-26 08:20:02,450][123090] Updated weights for policy 1, policy_version 1087187 (0.0010) [2023-12-26 08:20:02,497][123090] Updated weights for policy 1, policy_version 1087197 (0.0010) [2023-12-26 08:20:02,692][123091] Updated weights for policy 0, policy_version 1094901 (0.0010) [2023-12-26 08:20:02,759][123091] Updated weights for policy 0, policy_version 1094911 (0.0008) [2023-12-26 08:20:02,820][123091] Updated weights for policy 0, policy_version 1094921 (0.0006) [2023-12-26 08:20:03,271][123090] Updated weights for policy 1, policy_version 1087207 (0.0007) [2023-12-26 08:20:03,341][123090] Updated weights for policy 1, policy_version 1087217 (0.0006) [2023-12-26 08:20:03,394][123090] Updated weights for policy 1, policy_version 1087227 (0.0005) [2023-12-26 08:20:03,604][123091] Updated weights for policy 0, policy_version 1094931 (0.0009) [2023-12-26 08:20:03,662][123091] Updated weights for policy 0, policy_version 1094941 (0.0010) [2023-12-26 08:20:03,721][123091] Updated weights for policy 0, policy_version 1094951 (0.0009) [2023-12-26 08:20:03,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 558645248. Throughput: 0: 8780.3, 1: 8977.0. Samples: 558654160. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:03,785][121949] Avg episode reward: [(0, '5852.388'), (1, '5481.666')] [2023-12-26 08:20:04,101][123090] Updated weights for policy 1, policy_version 1087237 (0.0008) [2023-12-26 08:20:04,168][123090] Updated weights for policy 1, policy_version 1087247 (0.0011) [2023-12-26 08:20:04,231][123090] Updated weights for policy 1, policy_version 1087257 (0.0010) [2023-12-26 08:20:04,557][123091] Updated weights for policy 0, policy_version 1094961 (0.0009) [2023-12-26 08:20:04,608][123091] Updated weights for policy 0, policy_version 1094971 (0.0009) [2023-12-26 08:20:04,665][123091] Updated weights for policy 0, policy_version 1094981 (0.0009) [2023-12-26 08:20:04,717][123091] Updated weights for policy 0, policy_version 1094991 (0.0009) [2023-12-26 08:20:05,050][123090] Updated weights for policy 1, policy_version 1087267 (0.0011) [2023-12-26 08:20:05,109][123090] Updated weights for policy 1, policy_version 1087277 (0.0010) [2023-12-26 08:20:05,170][123090] Updated weights for policy 1, policy_version 1087287 (0.0009) [2023-12-26 08:20:05,516][123091] Updated weights for policy 0, policy_version 1095001 (0.0010) [2023-12-26 08:20:05,574][123091] Updated weights for policy 0, policy_version 1095011 (0.0010) [2023-12-26 08:20:05,633][123091] Updated weights for policy 0, policy_version 1095021 (0.0010) [2023-12-26 08:20:05,916][123090] Updated weights for policy 1, policy_version 1087297 (0.0006) [2023-12-26 08:20:05,971][123090] Updated weights for policy 1, policy_version 1087307 (0.0005) [2023-12-26 08:20:06,022][123090] Updated weights for policy 1, policy_version 1087317 (0.0007) [2023-12-26 08:20:06,086][123090] Updated weights for policy 1, policy_version 1087327 (0.0006) [2023-12-26 08:20:06,375][123091] Updated weights for policy 0, policy_version 1095031 (0.0011) [2023-12-26 08:20:06,429][123091] Updated weights for policy 0, policy_version 1095041 (0.0010) [2023-12-26 08:20:06,492][123091] Updated weights for policy 0, policy_version 1095051 (0.0011) [2023-12-26 08:20:06,945][123090] Updated weights for policy 1, policy_version 1087337 (0.0006) [2023-12-26 08:20:07,010][123090] Updated weights for policy 1, policy_version 1087347 (0.0005) [2023-12-26 08:20:07,082][123090] Updated weights for policy 1, policy_version 1087357 (0.0005) [2023-12-26 08:20:07,207][123091] Updated weights for policy 0, policy_version 1095061 (0.0008) [2023-12-26 08:20:07,268][123091] Updated weights for policy 0, policy_version 1095071 (0.0006) [2023-12-26 08:20:07,327][123091] Updated weights for policy 0, policy_version 1095081 (0.0006) [2023-12-26 08:20:07,650][123090] Updated weights for policy 1, policy_version 1087367 (0.0008) [2023-12-26 08:20:07,711][123090] Updated weights for policy 1, policy_version 1087377 (0.0010) [2023-12-26 08:20:07,773][123090] Updated weights for policy 1, policy_version 1087387 (0.0010) [2023-12-26 08:20:07,921][123091] Updated weights for policy 0, policy_version 1095091 (0.0005) [2023-12-26 08:20:07,974][123091] Updated weights for policy 0, policy_version 1095101 (0.0005) [2023-12-26 08:20:08,035][123091] Updated weights for policy 0, policy_version 1095111 (0.0006) [2023-12-26 08:20:08,562][123090] Updated weights for policy 1, policy_version 1087397 (0.0010) [2023-12-26 08:20:08,623][123090] Updated weights for policy 1, policy_version 1087407 (0.0008) [2023-12-26 08:20:08,683][123090] Updated weights for policy 1, policy_version 1087417 (0.0009) [2023-12-26 08:20:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 558735360. Throughput: 0: 8848.6, 1: 8951.8. Samples: 558707452. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:08,785][121949] Avg episode reward: [(0, '6086.594'), (1, '5539.945')] [2023-12-26 08:20:08,789][123091] Updated weights for policy 0, policy_version 1095121 (0.0006) [2023-12-26 08:20:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001087424_278380544.pth... [2023-12-26 08:20:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001086368_278110208.pth [2023-12-26 08:20:08,853][123091] Updated weights for policy 0, policy_version 1095131 (0.0010) [2023-12-26 08:20:08,912][123091] Updated weights for policy 0, policy_version 1095141 (0.0010) [2023-12-26 08:20:08,964][123091] Updated weights for policy 0, policy_version 1095151 (0.0010) [2023-12-26 08:20:08,965][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001095152_280363008.pth... [2023-12-26 08:20:08,968][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001094064_280084480.pth [2023-12-26 08:20:09,543][123090] Updated weights for policy 1, policy_version 1087427 (0.0009) [2023-12-26 08:20:09,610][123090] Updated weights for policy 1, policy_version 1087437 (0.0009) [2023-12-26 08:20:09,681][123090] Updated weights for policy 1, policy_version 1087447 (0.0011) [2023-12-26 08:20:09,820][123091] Updated weights for policy 0, policy_version 1095161 (0.0010) [2023-12-26 08:20:09,890][123091] Updated weights for policy 0, policy_version 1095171 (0.0009) [2023-12-26 08:20:09,960][123091] Updated weights for policy 0, policy_version 1095181 (0.0009) [2023-12-26 08:20:10,507][123090] Updated weights for policy 1, policy_version 1087457 (0.0011) [2023-12-26 08:20:10,575][123090] Updated weights for policy 1, policy_version 1087467 (0.0011) [2023-12-26 08:20:10,639][123090] Updated weights for policy 1, policy_version 1087477 (0.0011) [2023-12-26 08:20:10,700][123090] Updated weights for policy 1, policy_version 1087487 (0.0011) [2023-12-26 08:20:10,810][123091] Updated weights for policy 0, policy_version 1095191 (0.0010) [2023-12-26 08:20:10,868][123091] Updated weights for policy 0, policy_version 1095201 (0.0009) [2023-12-26 08:20:10,924][123091] Updated weights for policy 0, policy_version 1095211 (0.0009) [2023-12-26 08:20:11,579][123090] Updated weights for policy 1, policy_version 1087497 (0.0011) [2023-12-26 08:20:11,649][123090] Updated weights for policy 1, policy_version 1087507 (0.0009) [2023-12-26 08:20:11,739][123090] Updated weights for policy 1, policy_version 1087517 (0.0010) [2023-12-26 08:20:11,805][123091] Updated weights for policy 0, policy_version 1095221 (0.0009) [2023-12-26 08:20:11,870][123091] Updated weights for policy 0, policy_version 1095231 (0.0009) [2023-12-26 08:20:11,924][123091] Updated weights for policy 0, policy_version 1095241 (0.0009) [2023-12-26 08:20:12,388][123090] Updated weights for policy 1, policy_version 1087527 (0.0009) [2023-12-26 08:20:12,441][123090] Updated weights for policy 1, policy_version 1087537 (0.0009) [2023-12-26 08:20:12,501][123090] Updated weights for policy 1, policy_version 1087547 (0.0010) [2023-12-26 08:20:12,803][123091] Updated weights for policy 0, policy_version 1095251 (0.0010) [2023-12-26 08:20:12,858][123091] Updated weights for policy 0, policy_version 1095261 (0.0009) [2023-12-26 08:20:12,912][123091] Updated weights for policy 0, policy_version 1095271 (0.0009) [2023-12-26 08:20:13,345][123090] Updated weights for policy 1, policy_version 1087557 (0.0009) [2023-12-26 08:20:13,407][123090] Updated weights for policy 1, policy_version 1087567 (0.0010) [2023-12-26 08:20:13,473][123090] Updated weights for policy 1, policy_version 1087577 (0.0010) [2023-12-26 08:20:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 558817280. Throughput: 0: 8939.5, 1: 8841.1. Samples: 558813028. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:13,785][121949] Avg episode reward: [(0, '6026.383'), (1, '5480.714')] [2023-12-26 08:20:13,812][123091] Updated weights for policy 0, policy_version 1095281 (0.0010) [2023-12-26 08:20:13,870][123091] Updated weights for policy 0, policy_version 1095291 (0.0010) [2023-12-26 08:20:13,929][123091] Updated weights for policy 0, policy_version 1095301 (0.0011) [2023-12-26 08:20:13,988][123091] Updated weights for policy 0, policy_version 1095311 (0.0009) [2023-12-26 08:20:14,190][123090] Updated weights for policy 1, policy_version 1087587 (0.0010) [2023-12-26 08:20:14,234][123090] Updated weights for policy 1, policy_version 1087597 (0.0010) [2023-12-26 08:20:14,293][123090] Updated weights for policy 1, policy_version 1087607 (0.0010) [2023-12-26 08:20:14,889][123091] Updated weights for policy 0, policy_version 1095321 (0.0009) [2023-12-26 08:20:14,947][123091] Updated weights for policy 0, policy_version 1095331 (0.0010) [2023-12-26 08:20:14,998][123091] Updated weights for policy 0, policy_version 1095341 (0.0010) [2023-12-26 08:20:15,027][123090] Updated weights for policy 1, policy_version 1087617 (0.0009) [2023-12-26 08:20:15,084][123090] Updated weights for policy 1, policy_version 1087627 (0.0010) [2023-12-26 08:20:15,151][123090] Updated weights for policy 1, policy_version 1087637 (0.0010) [2023-12-26 08:20:15,215][123090] Updated weights for policy 1, policy_version 1087647 (0.0010) [2023-12-26 08:20:15,861][123091] Updated weights for policy 0, policy_version 1095351 (0.0010) [2023-12-26 08:20:15,920][123091] Updated weights for policy 0, policy_version 1095361 (0.0010) [2023-12-26 08:20:15,979][123091] Updated weights for policy 0, policy_version 1095371 (0.0010) [2023-12-26 08:20:16,050][123090] Updated weights for policy 1, policy_version 1087657 (0.0009) [2023-12-26 08:20:16,122][123090] Updated weights for policy 1, policy_version 1087667 (0.0005) [2023-12-26 08:20:16,190][123090] Updated weights for policy 1, policy_version 1087677 (0.0008) [2023-12-26 08:20:16,758][123091] Updated weights for policy 0, policy_version 1095381 (0.0008) [2023-12-26 08:20:16,815][123091] Updated weights for policy 0, policy_version 1095391 (0.0005) [2023-12-26 08:20:16,885][123091] Updated weights for policy 0, policy_version 1095401 (0.0005) [2023-12-26 08:20:17,008][123090] Updated weights for policy 1, policy_version 1087687 (0.0010) [2023-12-26 08:20:17,058][123090] Updated weights for policy 1, policy_version 1087697 (0.0009) [2023-12-26 08:20:17,109][123090] Updated weights for policy 1, policy_version 1087707 (0.0008) [2023-12-26 08:20:17,562][123091] Updated weights for policy 0, policy_version 1095411 (0.0005) [2023-12-26 08:20:17,629][123091] Updated weights for policy 0, policy_version 1095421 (0.0005) [2023-12-26 08:20:17,702][123091] Updated weights for policy 0, policy_version 1095431 (0.0009) [2023-12-26 08:20:18,002][123090] Updated weights for policy 1, policy_version 1087717 (0.0009) [2023-12-26 08:20:18,049][123090] Updated weights for policy 1, policy_version 1087727 (0.0008) [2023-12-26 08:20:18,098][123090] Updated weights for policy 1, policy_version 1087737 (0.0009) [2023-12-26 08:20:18,432][123091] Updated weights for policy 0, policy_version 1095441 (0.0006) [2023-12-26 08:20:18,494][123091] Updated weights for policy 0, policy_version 1095451 (0.0010) [2023-12-26 08:20:18,558][123091] Updated weights for policy 0, policy_version 1095461 (0.0009) [2023-12-26 08:20:18,630][123091] Updated weights for policy 0, policy_version 1095471 (0.0013) [2023-12-26 08:20:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 558907392. Throughput: 0: 8948.5, 1: 8854.0. Samples: 558918132. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:18,785][121949] Avg episode reward: [(0, '5834.011'), (1, '5242.614')] [2023-12-26 08:20:18,987][123090] Updated weights for policy 1, policy_version 1087747 (0.0009) [2023-12-26 08:20:19,041][123090] Updated weights for policy 1, policy_version 1087757 (0.0009) [2023-12-26 08:20:19,113][123090] Updated weights for policy 1, policy_version 1087767 (0.0006) [2023-12-26 08:20:19,390][123091] Updated weights for policy 0, policy_version 1095481 (0.0009) [2023-12-26 08:20:19,452][123091] Updated weights for policy 0, policy_version 1095491 (0.0010) [2023-12-26 08:20:19,512][123091] Updated weights for policy 0, policy_version 1095501 (0.0007) [2023-12-26 08:20:19,873][123090] Updated weights for policy 1, policy_version 1087777 (0.0006) [2023-12-26 08:20:19,940][123090] Updated weights for policy 1, policy_version 1087787 (0.0011) [2023-12-26 08:20:20,003][123090] Updated weights for policy 1, policy_version 1087797 (0.0011) [2023-12-26 08:20:20,060][123090] Updated weights for policy 1, policy_version 1087807 (0.0010) [2023-12-26 08:20:20,322][123091] Updated weights for policy 0, policy_version 1095511 (0.0008) [2023-12-26 08:20:20,388][123091] Updated weights for policy 0, policy_version 1095521 (0.0010) [2023-12-26 08:20:20,447][123091] Updated weights for policy 0, policy_version 1095531 (0.0010) [2023-12-26 08:20:20,863][123090] Updated weights for policy 1, policy_version 1087817 (0.0009) [2023-12-26 08:20:20,916][123090] Updated weights for policy 1, policy_version 1087827 (0.0010) [2023-12-26 08:20:20,984][123090] Updated weights for policy 1, policy_version 1087837 (0.0008) [2023-12-26 08:20:21,346][123091] Updated weights for policy 0, policy_version 1095541 (0.0010) [2023-12-26 08:20:21,428][123091] Updated weights for policy 0, policy_version 1095551 (0.0009) [2023-12-26 08:20:21,489][123091] Updated weights for policy 0, policy_version 1095561 (0.0010) [2023-12-26 08:20:21,827][123090] Updated weights for policy 1, policy_version 1087847 (0.0009) [2023-12-26 08:20:21,886][123090] Updated weights for policy 1, policy_version 1087857 (0.0010) [2023-12-26 08:20:21,952][123090] Updated weights for policy 1, policy_version 1087867 (0.0009) [2023-12-26 08:20:22,247][123091] Updated weights for policy 0, policy_version 1095571 (0.0009) [2023-12-26 08:20:22,309][123091] Updated weights for policy 0, policy_version 1095581 (0.0009) [2023-12-26 08:20:22,374][123091] Updated weights for policy 0, policy_version 1095591 (0.0010) [2023-12-26 08:20:22,724][123090] Updated weights for policy 1, policy_version 1087877 (0.0010) [2023-12-26 08:20:22,785][123090] Updated weights for policy 1, policy_version 1087887 (0.0008) [2023-12-26 08:20:22,855][123090] Updated weights for policy 1, policy_version 1087897 (0.0009) [2023-12-26 08:20:23,248][123091] Updated weights for policy 0, policy_version 1095601 (0.0010) [2023-12-26 08:20:23,308][123091] Updated weights for policy 0, policy_version 1095611 (0.0009) [2023-12-26 08:20:23,365][123091] Updated weights for policy 0, policy_version 1095621 (0.0009) [2023-12-26 08:20:23,418][123091] Updated weights for policy 0, policy_version 1095631 (0.0009) [2023-12-26 08:20:23,657][123090] Updated weights for policy 1, policy_version 1087907 (0.0008) [2023-12-26 08:20:23,730][123090] Updated weights for policy 1, policy_version 1087917 (0.0006) [2023-12-26 08:20:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 558989312. Throughput: 0: 8914.1, 1: 8861.2. Samples: 558969756. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:23,785][121949] Avg episode reward: [(0, '5822.924'), (1, '5372.429')] [2023-12-26 08:20:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001095632_280485888.pth... [2023-12-26 08:20:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001094608_280223744.pth [2023-12-26 08:20:23,796][123090] Updated weights for policy 1, policy_version 1087927 (0.0005) [2023-12-26 08:20:23,856][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001087936_278511616.pth... [2023-12-26 08:20:23,862][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001086880_278241280.pth [2023-12-26 08:20:24,261][123091] Updated weights for policy 0, policy_version 1095641 (0.0005) [2023-12-26 08:20:24,317][123091] Updated weights for policy 0, policy_version 1095651 (0.0005) [2023-12-26 08:20:24,369][123091] Updated weights for policy 0, policy_version 1095661 (0.0005) [2023-12-26 08:20:24,528][123090] Updated weights for policy 1, policy_version 1087937 (0.0008) [2023-12-26 08:20:24,596][123090] Updated weights for policy 1, policy_version 1087947 (0.0009) [2023-12-26 08:20:24,658][123090] Updated weights for policy 1, policy_version 1087957 (0.0009) [2023-12-26 08:20:24,712][123090] Updated weights for policy 1, policy_version 1087967 (0.0010) [2023-12-26 08:20:25,179][123091] Updated weights for policy 0, policy_version 1095672 (0.0010) [2023-12-26 08:20:25,233][123091] Updated weights for policy 0, policy_version 1095682 (0.0010) [2023-12-26 08:20:25,289][123091] Updated weights for policy 0, policy_version 1095692 (0.0010) [2023-12-26 08:20:25,474][123090] Updated weights for policy 1, policy_version 1087977 (0.0008) [2023-12-26 08:20:25,543][123090] Updated weights for policy 1, policy_version 1087987 (0.0005) [2023-12-26 08:20:25,598][123090] Updated weights for policy 1, policy_version 1087997 (0.0005) [2023-12-26 08:20:26,172][123091] Updated weights for policy 0, policy_version 1095703 (0.0010) [2023-12-26 08:20:26,240][123091] Updated weights for policy 0, policy_version 1095713 (0.0010) [2023-12-26 08:20:26,290][123090] Updated weights for policy 1, policy_version 1088007 (0.0008) [2023-12-26 08:20:26,292][123091] Updated weights for policy 0, policy_version 1095723 (0.0009) [2023-12-26 08:20:26,336][123090] Updated weights for policy 1, policy_version 1088017 (0.0006) [2023-12-26 08:20:26,393][123090] Updated weights for policy 1, policy_version 1088027 (0.0005) [2023-12-26 08:20:27,049][123091] Updated weights for policy 0, policy_version 1095733 (0.0007) [2023-12-26 08:20:27,095][123091] Updated weights for policy 0, policy_version 1095743 (0.0005) [2023-12-26 08:20:27,144][123091] Updated weights for policy 0, policy_version 1095753 (0.0007) [2023-12-26 08:20:27,223][123090] Updated weights for policy 1, policy_version 1088037 (0.0008) [2023-12-26 08:20:27,290][123090] Updated weights for policy 1, policy_version 1088047 (0.0009) [2023-12-26 08:20:27,347][123090] Updated weights for policy 1, policy_version 1088057 (0.0010) [2023-12-26 08:20:27,948][123091] Updated weights for policy 0, policy_version 1095763 (0.0008) [2023-12-26 08:20:27,994][123091] Updated weights for policy 0, policy_version 1095773 (0.0005) [2023-12-26 08:20:28,043][123091] Updated weights for policy 0, policy_version 1095783 (0.0010) [2023-12-26 08:20:28,122][123090] Updated weights for policy 1, policy_version 1088067 (0.0010) [2023-12-26 08:20:28,184][123090] Updated weights for policy 1, policy_version 1088077 (0.0010) [2023-12-26 08:20:28,246][123090] Updated weights for policy 1, policy_version 1088087 (0.0010) [2023-12-26 08:20:28,762][123091] Updated weights for policy 0, policy_version 1095793 (0.0009) [2023-12-26 08:20:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 559079424. Throughput: 0: 8899.5, 1: 8892.5. Samples: 559076176. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:28,785][121949] Avg episode reward: [(0, '6061.346'), (1, '5564.369')] [2023-12-26 08:20:28,821][123091] Updated weights for policy 0, policy_version 1095803 (0.0005) [2023-12-26 08:20:28,892][123091] Updated weights for policy 0, policy_version 1095813 (0.0005) [2023-12-26 08:20:28,959][123091] Updated weights for policy 0, policy_version 1095823 (0.0005) [2023-12-26 08:20:29,061][123090] Updated weights for policy 1, policy_version 1088097 (0.0010) [2023-12-26 08:20:29,136][123090] Updated weights for policy 1, policy_version 1088107 (0.0005) [2023-12-26 08:20:29,212][123090] Updated weights for policy 1, policy_version 1088117 (0.0005) [2023-12-26 08:20:29,287][123090] Updated weights for policy 1, policy_version 1088127 (0.0007) [2023-12-26 08:20:29,665][123091] Updated weights for policy 0, policy_version 1095833 (0.0008) [2023-12-26 08:20:29,715][123091] Updated weights for policy 0, policy_version 1095843 (0.0010) [2023-12-26 08:20:29,773][123091] Updated weights for policy 0, policy_version 1095853 (0.0008) [2023-12-26 08:20:30,017][123090] Updated weights for policy 1, policy_version 1088137 (0.0009) [2023-12-26 08:20:30,089][123090] Updated weights for policy 1, policy_version 1088147 (0.0009) [2023-12-26 08:20:30,149][123090] Updated weights for policy 1, policy_version 1088157 (0.0010) [2023-12-26 08:20:30,625][123091] Updated weights for policy 0, policy_version 1095863 (0.0009) [2023-12-26 08:20:30,686][123091] Updated weights for policy 0, policy_version 1095873 (0.0009) [2023-12-26 08:20:30,734][123091] Updated weights for policy 0, policy_version 1095883 (0.0009) [2023-12-26 08:20:30,932][123090] Updated weights for policy 1, policy_version 1088167 (0.0006) [2023-12-26 08:20:30,983][123090] Updated weights for policy 1, policy_version 1088177 (0.0005) [2023-12-26 08:20:31,038][123090] Updated weights for policy 1, policy_version 1088187 (0.0008) [2023-12-26 08:20:31,598][123091] Updated weights for policy 0, policy_version 1095893 (0.0010) [2023-12-26 08:20:31,671][123091] Updated weights for policy 0, policy_version 1095903 (0.0010) [2023-12-26 08:20:31,738][123091] Updated weights for policy 0, policy_version 1095913 (0.0010) [2023-12-26 08:20:31,891][123090] Updated weights for policy 1, policy_version 1088197 (0.0009) [2023-12-26 08:20:31,959][123090] Updated weights for policy 1, policy_version 1088207 (0.0008) [2023-12-26 08:20:32,028][123090] Updated weights for policy 1, policy_version 1088217 (0.0009) [2023-12-26 08:20:32,604][123091] Updated weights for policy 0, policy_version 1095923 (0.0010) [2023-12-26 08:20:32,663][123091] Updated weights for policy 0, policy_version 1095933 (0.0011) [2023-12-26 08:20:32,729][123091] Updated weights for policy 0, policy_version 1095943 (0.0011) [2023-12-26 08:20:32,841][123090] Updated weights for policy 1, policy_version 1088227 (0.0008) [2023-12-26 08:20:32,907][123090] Updated weights for policy 1, policy_version 1088239 (0.0010) [2023-12-26 08:20:32,963][123090] Updated weights for policy 1, policy_version 1088249 (0.0009) [2023-12-26 08:20:33,545][123091] Updated weights for policy 0, policy_version 1095953 (0.0010) [2023-12-26 08:20:33,604][123091] Updated weights for policy 0, policy_version 1095963 (0.0010) [2023-12-26 08:20:33,650][123091] Updated weights for policy 0, policy_version 1095973 (0.0010) [2023-12-26 08:20:33,705][123091] Updated weights for policy 0, policy_version 1095983 (0.0010) [2023-12-26 08:20:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 559169536. Throughput: 0: 8891.5, 1: 8877.9. Samples: 559180656. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:33,785][121949] Avg episode reward: [(0, '6089.210'), (1, '5549.757')] [2023-12-26 08:20:33,820][123090] Updated weights for policy 1, policy_version 1088259 (0.0009) [2023-12-26 08:20:33,870][123090] Updated weights for policy 1, policy_version 1088269 (0.0009) [2023-12-26 08:20:33,930][123090] Updated weights for policy 1, policy_version 1088279 (0.0009) [2023-12-26 08:20:34,452][123091] Updated weights for policy 0, policy_version 1095993 (0.0006) [2023-12-26 08:20:34,512][123091] Updated weights for policy 0, policy_version 1096003 (0.0006) [2023-12-26 08:20:34,575][123091] Updated weights for policy 0, policy_version 1096013 (0.0007) [2023-12-26 08:20:34,873][123090] Updated weights for policy 1, policy_version 1088289 (0.0010) [2023-12-26 08:20:34,944][123090] Updated weights for policy 1, policy_version 1088299 (0.0010) [2023-12-26 08:20:35,024][123090] Updated weights for policy 1, policy_version 1088309 (0.0010) [2023-12-26 08:20:35,090][123090] Updated weights for policy 1, policy_version 1088319 (0.0010) [2023-12-26 08:20:35,236][123091] Updated weights for policy 0, policy_version 1096023 (0.0007) [2023-12-26 08:20:35,287][123091] Updated weights for policy 0, policy_version 1096033 (0.0006) [2023-12-26 08:20:35,349][123091] Updated weights for policy 0, policy_version 1096043 (0.0011) [2023-12-26 08:20:35,861][123090] Updated weights for policy 1, policy_version 1088329 (0.0009) [2023-12-26 08:20:35,908][123090] Updated weights for policy 1, policy_version 1088339 (0.0009) [2023-12-26 08:20:35,956][123090] Updated weights for policy 1, policy_version 1088349 (0.0008) [2023-12-26 08:20:36,185][123091] Updated weights for policy 0, policy_version 1096053 (0.0011) [2023-12-26 08:20:36,249][123091] Updated weights for policy 0, policy_version 1096063 (0.0011) [2023-12-26 08:20:36,319][123091] Updated weights for policy 0, policy_version 1096073 (0.0011) [2023-12-26 08:20:36,752][123090] Updated weights for policy 1, policy_version 1088359 (0.0009) [2023-12-26 08:20:36,801][123090] Updated weights for policy 1, policy_version 1088369 (0.0008) [2023-12-26 08:20:36,849][123090] Updated weights for policy 1, policy_version 1088379 (0.0009) [2023-12-26 08:20:37,125][123091] Updated weights for policy 0, policy_version 1096083 (0.0011) [2023-12-26 08:20:37,185][123091] Updated weights for policy 0, policy_version 1096093 (0.0011) [2023-12-26 08:20:37,241][123091] Updated weights for policy 0, policy_version 1096103 (0.0011) [2023-12-26 08:20:37,693][123090] Updated weights for policy 1, policy_version 1088389 (0.0009) [2023-12-26 08:20:37,749][123090] Updated weights for policy 1, policy_version 1088399 (0.0010) [2023-12-26 08:20:37,798][123090] Updated weights for policy 1, policy_version 1088409 (0.0009) [2023-12-26 08:20:38,048][123091] Updated weights for policy 0, policy_version 1096113 (0.0010) [2023-12-26 08:20:38,111][123091] Updated weights for policy 0, policy_version 1096123 (0.0006) [2023-12-26 08:20:38,170][123091] Updated weights for policy 0, policy_version 1096133 (0.0005) [2023-12-26 08:20:38,245][123091] Updated weights for policy 0, policy_version 1096143 (0.0005) [2023-12-26 08:20:38,548][123090] Updated weights for policy 1, policy_version 1088419 (0.0008) [2023-12-26 08:20:38,597][123090] Updated weights for policy 1, policy_version 1088429 (0.0006) [2023-12-26 08:20:38,644][123090] Updated weights for policy 1, policy_version 1088439 (0.0005) [2023-12-26 08:20:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 559259648. Throughput: 0: 8875.7, 1: 8870.5. Samples: 559234200. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:38,785][121949] Avg episode reward: [(0, '6095.132'), (1, '5593.763')] [2023-12-26 08:20:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001088448_278642688.pth... [2023-12-26 08:20:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001087424_278380544.pth [2023-12-26 08:20:38,867][123091] Updated weights for policy 0, policy_version 1096153 (0.0005) [2023-12-26 08:20:38,946][123091] Updated weights for policy 0, policy_version 1096163 (0.0006) [2023-12-26 08:20:39,021][123091] Updated weights for policy 0, policy_version 1096173 (0.0006) [2023-12-26 08:20:39,037][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001096176_280625152.pth... [2023-12-26 08:20:39,042][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001095152_280363008.pth [2023-12-26 08:20:39,422][123090] Updated weights for policy 1, policy_version 1088449 (0.0006) [2023-12-26 08:20:39,482][123090] Updated weights for policy 1, policy_version 1088459 (0.0011) [2023-12-26 08:20:39,546][123090] Updated weights for policy 1, policy_version 1088469 (0.0011) [2023-12-26 08:20:39,603][123090] Updated weights for policy 1, policy_version 1088479 (0.0010) [2023-12-26 08:20:39,749][123091] Updated weights for policy 0, policy_version 1096183 (0.0008) [2023-12-26 08:20:39,820][123091] Updated weights for policy 0, policy_version 1096193 (0.0009) [2023-12-26 08:20:39,887][123091] Updated weights for policy 0, policy_version 1096203 (0.0009) [2023-12-26 08:20:40,422][123090] Updated weights for policy 1, policy_version 1088489 (0.0011) [2023-12-26 08:20:40,490][123090] Updated weights for policy 1, policy_version 1088499 (0.0008) [2023-12-26 08:20:40,556][123090] Updated weights for policy 1, policy_version 1088509 (0.0009) [2023-12-26 08:20:40,680][123091] Updated weights for policy 0, policy_version 1096213 (0.0010) [2023-12-26 08:20:40,747][123091] Updated weights for policy 0, policy_version 1096223 (0.0011) [2023-12-26 08:20:40,818][123091] Updated weights for policy 0, policy_version 1096233 (0.0007) [2023-12-26 08:20:41,298][123090] Updated weights for policy 1, policy_version 1088519 (0.0008) [2023-12-26 08:20:41,359][123090] Updated weights for policy 1, policy_version 1088529 (0.0008) [2023-12-26 08:20:41,437][123090] Updated weights for policy 1, policy_version 1088539 (0.0009) [2023-12-26 08:20:41,561][123091] Updated weights for policy 0, policy_version 1096243 (0.0005) [2023-12-26 08:20:41,635][123091] Updated weights for policy 0, policy_version 1096253 (0.0007) [2023-12-26 08:20:41,709][123091] Updated weights for policy 0, policy_version 1096263 (0.0009) [2023-12-26 08:20:42,306][123090] Updated weights for policy 1, policy_version 1088549 (0.0009) [2023-12-26 08:20:42,376][123090] Updated weights for policy 1, policy_version 1088559 (0.0009) [2023-12-26 08:20:42,443][123090] Updated weights for policy 1, policy_version 1088569 (0.0010) [2023-12-26 08:20:42,530][123091] Updated weights for policy 0, policy_version 1096273 (0.0010) [2023-12-26 08:20:42,581][123091] Updated weights for policy 0, policy_version 1096283 (0.0010) [2023-12-26 08:20:42,646][123091] Updated weights for policy 0, policy_version 1096293 (0.0009) [2023-12-26 08:20:42,706][123091] Updated weights for policy 0, policy_version 1096303 (0.0010) [2023-12-26 08:20:43,203][123090] Updated weights for policy 1, policy_version 1088579 (0.0008) [2023-12-26 08:20:43,267][123090] Updated weights for policy 1, policy_version 1088589 (0.0005) [2023-12-26 08:20:43,335][123090] Updated weights for policy 1, policy_version 1088599 (0.0005) [2023-12-26 08:20:43,477][123091] Updated weights for policy 0, policy_version 1096313 (0.0005) [2023-12-26 08:20:43,523][123091] Updated weights for policy 0, policy_version 1096323 (0.0005) [2023-12-26 08:20:43,570][123091] Updated weights for policy 0, policy_version 1096333 (0.0005) [2023-12-26 08:20:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 559349760. Throughput: 0: 8819.6, 1: 8826.5. Samples: 559340736. Policy #0 lag: (min: 25.0, avg: 46.6, max: 57.0) [2023-12-26 08:20:43,785][121949] Avg episode reward: [(0, '6102.341'), (1, '5644.594')] [2023-12-26 08:20:43,942][123090] Updated weights for policy 1, policy_version 1088609 (0.0006) [2023-12-26 08:20:43,999][123090] Updated weights for policy 1, policy_version 1088619 (0.0009) [2023-12-26 08:20:44,051][123090] Updated weights for policy 1, policy_version 1088629 (0.0009) [2023-12-26 08:20:44,113][123090] Updated weights for policy 1, policy_version 1088639 (0.0009) [2023-12-26 08:20:44,445][123091] Updated weights for policy 0, policy_version 1096343 (0.0009) [2023-12-26 08:20:44,496][123091] Updated weights for policy 0, policy_version 1096353 (0.0009) [2023-12-26 08:20:44,548][123091] Updated weights for policy 0, policy_version 1096363 (0.0009) [2023-12-26 08:20:44,941][123090] Updated weights for policy 1, policy_version 1088649 (0.0010) [2023-12-26 08:20:44,993][123090] Updated weights for policy 1, policy_version 1088659 (0.0010) [2023-12-26 08:20:45,043][123090] Updated weights for policy 1, policy_version 1088669 (0.0009) [2023-12-26 08:20:45,392][123091] Updated weights for policy 0, policy_version 1096373 (0.0008) [2023-12-26 08:20:45,462][123091] Updated weights for policy 0, policy_version 1096383 (0.0006) [2023-12-26 08:20:45,524][123091] Updated weights for policy 0, policy_version 1096393 (0.0009) [2023-12-26 08:20:45,939][123090] Updated weights for policy 1, policy_version 1088679 (0.0007) [2023-12-26 08:20:45,996][123090] Updated weights for policy 1, policy_version 1088689 (0.0005) [2023-12-26 08:20:46,042][123090] Updated weights for policy 1, policy_version 1088699 (0.0005) [2023-12-26 08:20:46,266][123091] Updated weights for policy 0, policy_version 1096403 (0.0008) [2023-12-26 08:20:46,329][123091] Updated weights for policy 0, policy_version 1096413 (0.0005) [2023-12-26 08:20:46,384][123091] Updated weights for policy 0, policy_version 1096423 (0.0008) [2023-12-26 08:20:46,792][123090] Updated weights for policy 1, policy_version 1088709 (0.0005) [2023-12-26 08:20:46,864][123090] Updated weights for policy 1, policy_version 1088719 (0.0005) [2023-12-26 08:20:46,937][123090] Updated weights for policy 1, policy_version 1088729 (0.0006) [2023-12-26 08:20:47,065][123091] Updated weights for policy 0, policy_version 1096433 (0.0009) [2023-12-26 08:20:47,125][123091] Updated weights for policy 0, policy_version 1096443 (0.0005) [2023-12-26 08:20:47,190][123091] Updated weights for policy 0, policy_version 1096453 (0.0009) [2023-12-26 08:20:47,244][123091] Updated weights for policy 0, policy_version 1096464 (0.0010) [2023-12-26 08:20:47,644][123090] Updated weights for policy 1, policy_version 1088739 (0.0009) [2023-12-26 08:20:47,703][123090] Updated weights for policy 1, policy_version 1088749 (0.0006) [2023-12-26 08:20:47,762][123090] Updated weights for policy 1, policy_version 1088759 (0.0009) [2023-12-26 08:20:47,976][123091] Updated weights for policy 0, policy_version 1096474 (0.0009) [2023-12-26 08:20:48,041][123091] Updated weights for policy 0, policy_version 1096484 (0.0009) [2023-12-26 08:20:48,102][123091] Updated weights for policy 0, policy_version 1096494 (0.0009) [2023-12-26 08:20:48,582][123090] Updated weights for policy 1, policy_version 1088769 (0.0010) [2023-12-26 08:20:48,643][123090] Updated weights for policy 1, policy_version 1088779 (0.0010) [2023-12-26 08:20:48,695][123090] Updated weights for policy 1, policy_version 1088789 (0.0010) [2023-12-26 08:20:48,743][123090] Updated weights for policy 1, policy_version 1088799 (0.0010) [2023-12-26 08:20:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 559439872. Throughput: 0: 8858.6, 1: 8839.7. Samples: 559450580. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:20:48,785][121949] Avg episode reward: [(0, '6010.524'), (1, '5746.957')] [2023-12-26 08:20:48,896][123091] Updated weights for policy 0, policy_version 1096504 (0.0009) [2023-12-26 08:20:48,952][123091] Updated weights for policy 0, policy_version 1096514 (0.0009) [2023-12-26 08:20:49,000][123091] Updated weights for policy 0, policy_version 1096524 (0.0005) [2023-12-26 08:20:49,617][123090] Updated weights for policy 1, policy_version 1088809 (0.0010) [2023-12-26 08:20:49,679][123090] Updated weights for policy 1, policy_version 1088819 (0.0010) [2023-12-26 08:20:49,734][123090] Updated weights for policy 1, policy_version 1088829 (0.0010) [2023-12-26 08:20:49,871][123091] Updated weights for policy 0, policy_version 1096534 (0.0009) [2023-12-26 08:20:49,943][123091] Updated weights for policy 0, policy_version 1096544 (0.0009) [2023-12-26 08:20:50,005][123091] Updated weights for policy 0, policy_version 1096554 (0.0008) [2023-12-26 08:20:50,527][123090] Updated weights for policy 1, policy_version 1088839 (0.0007) [2023-12-26 08:20:50,596][123090] Updated weights for policy 1, policy_version 1088849 (0.0007) [2023-12-26 08:20:50,656][123090] Updated weights for policy 1, policy_version 1088859 (0.0006) [2023-12-26 08:20:50,865][123091] Updated weights for policy 0, policy_version 1096564 (0.0009) [2023-12-26 08:20:50,929][123091] Updated weights for policy 0, policy_version 1096574 (0.0009) [2023-12-26 08:20:51,002][123091] Updated weights for policy 0, policy_version 1096584 (0.0007) [2023-12-26 08:20:51,433][123090] Updated weights for policy 1, policy_version 1088869 (0.0005) [2023-12-26 08:20:51,499][123090] Updated weights for policy 1, policy_version 1088879 (0.0005) [2023-12-26 08:20:51,573][123090] Updated weights for policy 1, policy_version 1088889 (0.0010) [2023-12-26 08:20:51,837][123091] Updated weights for policy 0, policy_version 1096594 (0.0009) [2023-12-26 08:20:51,894][123091] Updated weights for policy 0, policy_version 1096604 (0.0005) [2023-12-26 08:20:51,954][123091] Updated weights for policy 0, policy_version 1096614 (0.0006) [2023-12-26 08:20:52,020][123091] Updated weights for policy 0, policy_version 1096624 (0.0007) [2023-12-26 08:20:52,347][123090] Updated weights for policy 1, policy_version 1088899 (0.0007) [2023-12-26 08:20:52,416][123090] Updated weights for policy 1, policy_version 1088909 (0.0010) [2023-12-26 08:20:52,475][123090] Updated weights for policy 1, policy_version 1088919 (0.0009) [2023-12-26 08:20:52,613][123091] Updated weights for policy 0, policy_version 1096634 (0.0010) [2023-12-26 08:20:52,667][123091] Updated weights for policy 0, policy_version 1096644 (0.0010) [2023-12-26 08:20:52,725][123091] Updated weights for policy 0, policy_version 1096654 (0.0010) [2023-12-26 08:20:53,362][123090] Updated weights for policy 1, policy_version 1088929 (0.0007) [2023-12-26 08:20:53,423][123090] Updated weights for policy 1, policy_version 1088939 (0.0010) [2023-12-26 08:20:53,472][123090] Updated weights for policy 1, policy_version 1088949 (0.0009) [2023-12-26 08:20:53,507][123091] Updated weights for policy 0, policy_version 1096664 (0.0006) [2023-12-26 08:20:53,526][123090] Updated weights for policy 1, policy_version 1088959 (0.0008) [2023-12-26 08:20:53,560][123091] Updated weights for policy 0, policy_version 1096674 (0.0005) [2023-12-26 08:20:53,617][123091] Updated weights for policy 0, policy_version 1096684 (0.0005) [2023-12-26 08:20:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 559529984. Throughput: 0: 8825.7, 1: 8822.7. Samples: 559501628. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:20:53,785][121949] Avg episode reward: [(0, '6034.225'), (1, '5578.079')] [2023-12-26 08:20:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001096688_280756224.pth... [2023-12-26 08:20:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001088960_278773760.pth... [2023-12-26 08:20:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001095632_280485888.pth [2023-12-26 08:20:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001087936_278511616.pth [2023-12-26 08:20:54,214][123091] Updated weights for policy 0, policy_version 1096694 (0.0005) [2023-12-26 08:20:54,276][123091] Updated weights for policy 0, policy_version 1096704 (0.0006) [2023-12-26 08:20:54,328][123091] Updated weights for policy 0, policy_version 1096714 (0.0005) [2023-12-26 08:20:54,471][123090] Updated weights for policy 1, policy_version 1088969 (0.0010) [2023-12-26 08:20:54,530][123090] Updated weights for policy 1, policy_version 1088979 (0.0010) [2023-12-26 08:20:54,589][123090] Updated weights for policy 1, policy_version 1088989 (0.0010) [2023-12-26 08:20:54,981][123091] Updated weights for policy 0, policy_version 1096724 (0.0007) [2023-12-26 08:20:55,034][123091] Updated weights for policy 0, policy_version 1096734 (0.0011) [2023-12-26 08:20:55,093][123091] Updated weights for policy 0, policy_version 1096744 (0.0010) [2023-12-26 08:20:55,490][123090] Updated weights for policy 1, policy_version 1088999 (0.0009) [2023-12-26 08:20:55,549][123090] Updated weights for policy 1, policy_version 1089009 (0.0008) [2023-12-26 08:20:55,601][123090] Updated weights for policy 1, policy_version 1089019 (0.0009) [2023-12-26 08:20:55,927][123091] Updated weights for policy 0, policy_version 1096754 (0.0011) [2023-12-26 08:20:55,981][123091] Updated weights for policy 0, policy_version 1096764 (0.0010) [2023-12-26 08:20:56,029][123091] Updated weights for policy 0, policy_version 1096774 (0.0010) [2023-12-26 08:20:56,084][123091] Updated weights for policy 0, policy_version 1096784 (0.0011) [2023-12-26 08:20:56,431][123090] Updated weights for policy 1, policy_version 1089029 (0.0009) [2023-12-26 08:20:56,479][123090] Updated weights for policy 1, policy_version 1089039 (0.0008) [2023-12-26 08:20:56,527][123090] Updated weights for policy 1, policy_version 1089049 (0.0008) [2023-12-26 08:20:56,922][123091] Updated weights for policy 0, policy_version 1096794 (0.0010) [2023-12-26 08:20:56,977][123091] Updated weights for policy 0, policy_version 1096804 (0.0010) [2023-12-26 08:20:57,025][123091] Updated weights for policy 0, policy_version 1096814 (0.0010) [2023-12-26 08:20:57,235][123090] Updated weights for policy 1, policy_version 1089059 (0.0006) [2023-12-26 08:20:57,290][123090] Updated weights for policy 1, policy_version 1089069 (0.0010) [2023-12-26 08:20:57,344][123090] Updated weights for policy 1, policy_version 1089079 (0.0011) [2023-12-26 08:20:57,746][123091] Updated weights for policy 0, policy_version 1096824 (0.0006) [2023-12-26 08:20:57,798][123091] Updated weights for policy 0, policy_version 1096834 (0.0005) [2023-12-26 08:20:57,846][123091] Updated weights for policy 0, policy_version 1096844 (0.0005) [2023-12-26 08:20:58,188][123090] Updated weights for policy 1, policy_version 1089089 (0.0010) [2023-12-26 08:20:58,252][123090] Updated weights for policy 1, policy_version 1089099 (0.0007) [2023-12-26 08:20:58,320][123090] Updated weights for policy 1, policy_version 1089109 (0.0009) [2023-12-26 08:20:58,399][123090] Updated weights for policy 1, policy_version 1089119 (0.0010) [2023-12-26 08:20:58,604][123091] Updated weights for policy 0, policy_version 1096854 (0.0007) [2023-12-26 08:20:58,674][123091] Updated weights for policy 0, policy_version 1096864 (0.0007) [2023-12-26 08:20:58,749][123091] Updated weights for policy 0, policy_version 1096874 (0.0009) [2023-12-26 08:20:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 559611904. Throughput: 0: 8924.7, 1: 8781.7. Samples: 559609816. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:20:58,785][121949] Avg episode reward: [(0, '5959.141'), (1, '5604.243')] [2023-12-26 08:20:59,228][123090] Updated weights for policy 1, policy_version 1089129 (0.0010) [2023-12-26 08:20:59,282][123090] Updated weights for policy 1, policy_version 1089139 (0.0010) [2023-12-26 08:20:59,341][123090] Updated weights for policy 1, policy_version 1089149 (0.0011) [2023-12-26 08:20:59,595][123091] Updated weights for policy 0, policy_version 1096884 (0.0009) [2023-12-26 08:20:59,656][123091] Updated weights for policy 0, policy_version 1096894 (0.0010) [2023-12-26 08:20:59,719][123091] Updated weights for policy 0, policy_version 1096904 (0.0007) [2023-12-26 08:21:00,161][123090] Updated weights for policy 1, policy_version 1089159 (0.0009) [2023-12-26 08:21:00,220][123090] Updated weights for policy 1, policy_version 1089169 (0.0009) [2023-12-26 08:21:00,279][123090] Updated weights for policy 1, policy_version 1089179 (0.0006) [2023-12-26 08:21:00,417][123091] Updated weights for policy 0, policy_version 1096914 (0.0009) [2023-12-26 08:21:00,471][123091] Updated weights for policy 0, policy_version 1096925 (0.0010) [2023-12-26 08:21:00,527][123091] Updated weights for policy 0, policy_version 1096935 (0.0009) [2023-12-26 08:21:01,142][123090] Updated weights for policy 1, policy_version 1089189 (0.0006) [2023-12-26 08:21:01,190][123090] Updated weights for policy 1, policy_version 1089199 (0.0005) [2023-12-26 08:21:01,245][123090] Updated weights for policy 1, policy_version 1089209 (0.0005) [2023-12-26 08:21:01,287][123091] Updated weights for policy 0, policy_version 1096945 (0.0006) [2023-12-26 08:21:01,356][123091] Updated weights for policy 0, policy_version 1096955 (0.0009) [2023-12-26 08:21:01,425][123091] Updated weights for policy 0, policy_version 1096965 (0.0008) [2023-12-26 08:21:01,486][123091] Updated weights for policy 0, policy_version 1096975 (0.0009) [2023-12-26 08:21:01,951][123090] Updated weights for policy 1, policy_version 1089219 (0.0007) [2023-12-26 08:21:02,014][123090] Updated weights for policy 1, policy_version 1089229 (0.0009) [2023-12-26 08:21:02,077][123090] Updated weights for policy 1, policy_version 1089239 (0.0009) [2023-12-26 08:21:02,334][123091] Updated weights for policy 0, policy_version 1096985 (0.0009) [2023-12-26 08:21:02,409][123091] Updated weights for policy 0, policy_version 1096995 (0.0008) [2023-12-26 08:21:02,466][123091] Updated weights for policy 0, policy_version 1097005 (0.0008) [2023-12-26 08:21:02,940][123090] Updated weights for policy 1, policy_version 1089249 (0.0009) [2023-12-26 08:21:03,019][123090] Updated weights for policy 1, policy_version 1089259 (0.0009) [2023-12-26 08:21:03,070][123090] Updated weights for policy 1, policy_version 1089269 (0.0009) [2023-12-26 08:21:03,131][123090] Updated weights for policy 1, policy_version 1089279 (0.0009) [2023-12-26 08:21:03,302][123091] Updated weights for policy 0, policy_version 1097015 (0.0009) [2023-12-26 08:21:03,354][123091] Updated weights for policy 0, policy_version 1097025 (0.0009) [2023-12-26 08:21:03,403][123091] Updated weights for policy 0, policy_version 1097035 (0.0009) [2023-12-26 08:21:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17717.0). Total num frames: 559702016. Throughput: 0: 8939.3, 1: 8761.7. Samples: 559714676. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:03,784][121949] Avg episode reward: [(0, '5995.906'), (1, '5685.270')] [2023-12-26 08:21:03,817][123090] Updated weights for policy 1, policy_version 1089289 (0.0005) [2023-12-26 08:21:03,886][123090] Updated weights for policy 1, policy_version 1089299 (0.0008) [2023-12-26 08:21:03,957][123090] Updated weights for policy 1, policy_version 1089309 (0.0005) [2023-12-26 08:21:04,331][123091] Updated weights for policy 0, policy_version 1097045 (0.0009) [2023-12-26 08:21:04,389][123091] Updated weights for policy 0, policy_version 1097055 (0.0010) [2023-12-26 08:21:04,449][123091] Updated weights for policy 0, policy_version 1097065 (0.0010) [2023-12-26 08:21:04,718][123090] Updated weights for policy 1, policy_version 1089319 (0.0006) [2023-12-26 08:21:04,781][123090] Updated weights for policy 1, policy_version 1089329 (0.0006) [2023-12-26 08:21:04,832][123090] Updated weights for policy 1, policy_version 1089339 (0.0007) [2023-12-26 08:21:05,392][123091] Updated weights for policy 0, policy_version 1097075 (0.0010) [2023-12-26 08:21:05,451][123091] Updated weights for policy 0, policy_version 1097085 (0.0010) [2023-12-26 08:21:05,505][123090] Updated weights for policy 1, policy_version 1089349 (0.0006) [2023-12-26 08:21:05,512][123091] Updated weights for policy 0, policy_version 1097095 (0.0008) [2023-12-26 08:21:05,562][123090] Updated weights for policy 1, policy_version 1089359 (0.0006) [2023-12-26 08:21:05,620][123090] Updated weights for policy 1, policy_version 1089369 (0.0006) [2023-12-26 08:21:06,366][123091] Updated weights for policy 0, policy_version 1097105 (0.0008) [2023-12-26 08:21:06,382][123090] Updated weights for policy 1, policy_version 1089379 (0.0007) [2023-12-26 08:21:06,417][123091] Updated weights for policy 0, policy_version 1097115 (0.0008) [2023-12-26 08:21:06,446][123090] Updated weights for policy 1, policy_version 1089389 (0.0009) [2023-12-26 08:21:06,477][123091] Updated weights for policy 0, policy_version 1097125 (0.0008) [2023-12-26 08:21:06,511][123090] Updated weights for policy 1, policy_version 1089399 (0.0006) [2023-12-26 08:21:06,545][123091] Updated weights for policy 0, policy_version 1097135 (0.0010) [2023-12-26 08:21:07,283][123090] Updated weights for policy 1, policy_version 1089409 (0.0006) [2023-12-26 08:21:07,334][123090] Updated weights for policy 1, policy_version 1089419 (0.0008) [2023-12-26 08:21:07,384][123090] Updated weights for policy 1, policy_version 1089429 (0.0009) [2023-12-26 08:21:07,403][123091] Updated weights for policy 0, policy_version 1097145 (0.0007) [2023-12-26 08:21:07,443][123090] Updated weights for policy 1, policy_version 1089439 (0.0008) [2023-12-26 08:21:07,466][123091] Updated weights for policy 0, policy_version 1097155 (0.0009) [2023-12-26 08:21:07,527][123091] Updated weights for policy 0, policy_version 1097165 (0.0009) [2023-12-26 08:21:08,108][123090] Updated weights for policy 1, policy_version 1089449 (0.0005) [2023-12-26 08:21:08,174][123090] Updated weights for policy 1, policy_version 1089459 (0.0005) [2023-12-26 08:21:08,235][123090] Updated weights for policy 1, policy_version 1089469 (0.0005) [2023-12-26 08:21:08,427][123091] Updated weights for policy 0, policy_version 1097175 (0.0010) [2023-12-26 08:21:08,480][123091] Updated weights for policy 0, policy_version 1097185 (0.0009) [2023-12-26 08:21:08,539][123091] Updated weights for policy 0, policy_version 1097195 (0.0007) [2023-12-26 08:21:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 559792128. Throughput: 0: 8905.5, 1: 8815.0. Samples: 559767180. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:08,785][121949] Avg episode reward: [(0, '5964.678'), (1, '5786.538')] [2023-12-26 08:21:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001097200_280887296.pth... [2023-12-26 08:21:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001089472_278904832.pth... [2023-12-26 08:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001096176_280625152.pth [2023-12-26 08:21:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001088448_278642688.pth [2023-12-26 08:21:08,962][123090] Updated weights for policy 1, policy_version 1089479 (0.0007) [2023-12-26 08:21:09,018][123090] Updated weights for policy 1, policy_version 1089489 (0.0009) [2023-12-26 08:21:09,070][123090] Updated weights for policy 1, policy_version 1089499 (0.0007) [2023-12-26 08:21:09,342][123091] Updated weights for policy 0, policy_version 1097205 (0.0007) [2023-12-26 08:21:09,398][123091] Updated weights for policy 0, policy_version 1097215 (0.0009) [2023-12-26 08:21:09,462][123091] Updated weights for policy 0, policy_version 1097225 (0.0009) [2023-12-26 08:21:09,869][123090] Updated weights for policy 1, policy_version 1089509 (0.0006) [2023-12-26 08:21:09,938][123090] Updated weights for policy 1, policy_version 1089519 (0.0008) [2023-12-26 08:21:10,007][123090] Updated weights for policy 1, policy_version 1089529 (0.0008) [2023-12-26 08:21:10,397][123091] Updated weights for policy 0, policy_version 1097235 (0.0010) [2023-12-26 08:21:10,462][123091] Updated weights for policy 0, policy_version 1097245 (0.0010) [2023-12-26 08:21:10,530][123091] Updated weights for policy 0, policy_version 1097255 (0.0010) [2023-12-26 08:21:10,786][123090] Updated weights for policy 1, policy_version 1089539 (0.0008) [2023-12-26 08:21:10,843][123090] Updated weights for policy 1, policy_version 1089549 (0.0010) [2023-12-26 08:21:10,899][123090] Updated weights for policy 1, policy_version 1089559 (0.0009) [2023-12-26 08:21:11,322][123091] Updated weights for policy 0, policy_version 1097265 (0.0010) [2023-12-26 08:21:11,393][123091] Updated weights for policy 0, policy_version 1097275 (0.0009) [2023-12-26 08:21:11,455][123091] Updated weights for policy 0, policy_version 1097285 (0.0007) [2023-12-26 08:21:11,520][123091] Updated weights for policy 0, policy_version 1097295 (0.0008) [2023-12-26 08:21:11,782][123090] Updated weights for policy 1, policy_version 1089569 (0.0008) [2023-12-26 08:21:11,841][123090] Updated weights for policy 1, policy_version 1089579 (0.0010) [2023-12-26 08:21:11,900][123090] Updated weights for policy 1, policy_version 1089589 (0.0010) [2023-12-26 08:21:11,952][123090] Updated weights for policy 1, policy_version 1089599 (0.0010) [2023-12-26 08:21:12,324][123091] Updated weights for policy 0, policy_version 1097305 (0.0010) [2023-12-26 08:21:12,400][123091] Updated weights for policy 0, policy_version 1097315 (0.0010) [2023-12-26 08:21:12,457][123091] Updated weights for policy 0, policy_version 1097325 (0.0009) [2023-12-26 08:21:12,847][123090] Updated weights for policy 1, policy_version 1089609 (0.0009) [2023-12-26 08:21:12,907][123090] Updated weights for policy 1, policy_version 1089619 (0.0008) [2023-12-26 08:21:12,973][123090] Updated weights for policy 1, policy_version 1089629 (0.0008) [2023-12-26 08:21:13,258][123091] Updated weights for policy 0, policy_version 1097335 (0.0010) [2023-12-26 08:21:13,327][123091] Updated weights for policy 0, policy_version 1097345 (0.0010) [2023-12-26 08:21:13,392][123091] Updated weights for policy 0, policy_version 1097355 (0.0010) [2023-12-26 08:21:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 559874048. Throughput: 0: 8842.1, 1: 8795.3. Samples: 559869860. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:13,785][121949] Avg episode reward: [(0, '6123.409'), (1, '5829.263')] [2023-12-26 08:21:13,812][123090] Updated weights for policy 1, policy_version 1089639 (0.0010) [2023-12-26 08:21:13,874][123090] Updated weights for policy 1, policy_version 1089649 (0.0010) [2023-12-26 08:21:13,940][123090] Updated weights for policy 1, policy_version 1089659 (0.0010) [2023-12-26 08:21:14,204][123091] Updated weights for policy 0, policy_version 1097365 (0.0009) [2023-12-26 08:21:14,264][123091] Updated weights for policy 0, policy_version 1097375 (0.0009) [2023-12-26 08:21:14,322][123091] Updated weights for policy 0, policy_version 1097385 (0.0008) [2023-12-26 08:21:14,770][123090] Updated weights for policy 1, policy_version 1089669 (0.0010) [2023-12-26 08:21:14,845][123090] Updated weights for policy 1, policy_version 1089679 (0.0008) [2023-12-26 08:21:14,919][123090] Updated weights for policy 1, policy_version 1089689 (0.0007) [2023-12-26 08:21:15,122][123091] Updated weights for policy 0, policy_version 1097395 (0.0008) [2023-12-26 08:21:15,191][123091] Updated weights for policy 0, policy_version 1097405 (0.0008) [2023-12-26 08:21:15,263][123091] Updated weights for policy 0, policy_version 1097416 (0.0010) [2023-12-26 08:21:15,681][123090] Updated weights for policy 1, policy_version 1089699 (0.0007) [2023-12-26 08:21:15,752][123090] Updated weights for policy 1, policy_version 1089709 (0.0009) [2023-12-26 08:21:15,822][123090] Updated weights for policy 1, policy_version 1089719 (0.0010) [2023-12-26 08:21:16,068][123091] Updated weights for policy 0, policy_version 1097426 (0.0010) [2023-12-26 08:21:16,115][123091] Updated weights for policy 0, policy_version 1097436 (0.0006) [2023-12-26 08:21:16,167][123091] Updated weights for policy 0, policy_version 1097446 (0.0006) [2023-12-26 08:21:16,230][123091] Updated weights for policy 0, policy_version 1097456 (0.0008) [2023-12-26 08:21:16,636][123090] Updated weights for policy 1, policy_version 1089729 (0.0010) [2023-12-26 08:21:16,701][123090] Updated weights for policy 1, policy_version 1089739 (0.0009) [2023-12-26 08:21:16,758][123090] Updated weights for policy 1, policy_version 1089749 (0.0010) [2023-12-26 08:21:16,812][123090] Updated weights for policy 1, policy_version 1089760 (0.0010) [2023-12-26 08:21:17,029][123091] Updated weights for policy 0, policy_version 1097466 (0.0010) [2023-12-26 08:21:17,084][123091] Updated weights for policy 0, policy_version 1097476 (0.0010) [2023-12-26 08:21:17,137][123091] Updated weights for policy 0, policy_version 1097486 (0.0009) [2023-12-26 08:21:17,529][123090] Updated weights for policy 1, policy_version 1089770 (0.0008) [2023-12-26 08:21:17,577][123090] Updated weights for policy 1, policy_version 1089780 (0.0009) [2023-12-26 08:21:17,625][123090] Updated weights for policy 1, policy_version 1089790 (0.0009) [2023-12-26 08:21:18,015][123091] Updated weights for policy 0, policy_version 1097496 (0.0010) [2023-12-26 08:21:18,078][123091] Updated weights for policy 0, policy_version 1097506 (0.0010) [2023-12-26 08:21:18,140][123091] Updated weights for policy 0, policy_version 1097516 (0.0010) [2023-12-26 08:21:18,446][123090] Updated weights for policy 1, policy_version 1089800 (0.0009) [2023-12-26 08:21:18,514][123090] Updated weights for policy 1, policy_version 1089810 (0.0010) [2023-12-26 08:21:18,580][123090] Updated weights for policy 1, policy_version 1089820 (0.0010) [2023-12-26 08:21:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 559964160. Throughput: 0: 8849.1, 1: 8802.8. Samples: 559974992. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:18,785][121949] Avg episode reward: [(0, '6243.569'), (1, '5904.534')] [2023-12-26 08:21:18,911][123091] Updated weights for policy 0, policy_version 1097526 (0.0009) [2023-12-26 08:21:18,978][123091] Updated weights for policy 0, policy_version 1097536 (0.0010) [2023-12-26 08:21:19,041][123091] Updated weights for policy 0, policy_version 1097546 (0.0009) [2023-12-26 08:21:19,373][123090] Updated weights for policy 1, policy_version 1089831 (0.0008) [2023-12-26 08:21:19,445][123090] Updated weights for policy 1, policy_version 1089841 (0.0008) [2023-12-26 08:21:19,511][123090] Updated weights for policy 1, policy_version 1089851 (0.0008) [2023-12-26 08:21:19,926][123091] Updated weights for policy 0, policy_version 1097556 (0.0009) [2023-12-26 08:21:19,996][123091] Updated weights for policy 0, policy_version 1097566 (0.0010) [2023-12-26 08:21:20,055][123091] Updated weights for policy 0, policy_version 1097576 (0.0010) [2023-12-26 08:21:20,270][123090] Updated weights for policy 1, policy_version 1089861 (0.0007) [2023-12-26 08:21:20,330][123090] Updated weights for policy 1, policy_version 1089871 (0.0005) [2023-12-26 08:21:20,389][123090] Updated weights for policy 1, policy_version 1089881 (0.0007) [2023-12-26 08:21:20,922][123091] Updated weights for policy 0, policy_version 1097586 (0.0010) [2023-12-26 08:21:20,975][123091] Updated weights for policy 0, policy_version 1097596 (0.0006) [2023-12-26 08:21:21,038][123091] Updated weights for policy 0, policy_version 1097606 (0.0008) [2023-12-26 08:21:21,101][123091] Updated weights for policy 0, policy_version 1097616 (0.0010) [2023-12-26 08:21:21,235][123090] Updated weights for policy 1, policy_version 1089891 (0.0008) [2023-12-26 08:21:21,296][123090] Updated weights for policy 1, policy_version 1089901 (0.0006) [2023-12-26 08:21:21,364][123090] Updated weights for policy 1, policy_version 1089911 (0.0007) [2023-12-26 08:21:21,990][123091] Updated weights for policy 0, policy_version 1097626 (0.0011) [2023-12-26 08:21:22,058][123091] Updated weights for policy 0, policy_version 1097636 (0.0011) [2023-12-26 08:21:22,115][123090] Updated weights for policy 1, policy_version 1089921 (0.0006) [2023-12-26 08:21:22,126][123091] Updated weights for policy 0, policy_version 1097646 (0.0011) [2023-12-26 08:21:22,170][123090] Updated weights for policy 1, policy_version 1089931 (0.0008) [2023-12-26 08:21:22,226][123090] Updated weights for policy 1, policy_version 1089941 (0.0009) [2023-12-26 08:21:22,291][123090] Updated weights for policy 1, policy_version 1089951 (0.0008) [2023-12-26 08:21:22,946][123091] Updated weights for policy 0, policy_version 1097656 (0.0011) [2023-12-26 08:21:23,005][123091] Updated weights for policy 0, policy_version 1097666 (0.0010) [2023-12-26 08:21:23,061][123091] Updated weights for policy 0, policy_version 1097676 (0.0011) [2023-12-26 08:21:23,149][123090] Updated weights for policy 1, policy_version 1089961 (0.0006) [2023-12-26 08:21:23,195][123090] Updated weights for policy 1, policy_version 1089971 (0.0005) [2023-12-26 08:21:23,258][123090] Updated weights for policy 1, policy_version 1089981 (0.0005) [2023-12-26 08:21:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 560046080. Throughput: 0: 8775.1, 1: 8839.6. Samples: 560026860. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:23,785][121949] Avg episode reward: [(0, '6134.052'), (1, '6031.919')] [2023-12-26 08:21:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001097680_281010176.pth... [2023-12-26 08:21:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001089984_279035904.pth... [2023-12-26 08:21:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001088960_278773760.pth [2023-12-26 08:21:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001096688_280756224.pth [2023-12-26 08:21:23,867][123091] Updated weights for policy 0, policy_version 1097686 (0.0009) [2023-12-26 08:21:23,941][123091] Updated weights for policy 0, policy_version 1097696 (0.0009) [2023-12-26 08:21:23,969][123090] Updated weights for policy 1, policy_version 1089991 (0.0005) [2023-12-26 08:21:24,007][123091] Updated weights for policy 0, policy_version 1097706 (0.0011) [2023-12-26 08:21:24,036][123090] Updated weights for policy 1, policy_version 1090001 (0.0005) [2023-12-26 08:21:24,106][123090] Updated weights for policy 1, policy_version 1090011 (0.0009) [2023-12-26 08:21:24,772][123091] Updated weights for policy 0, policy_version 1097716 (0.0009) [2023-12-26 08:21:24,831][123091] Updated weights for policy 0, policy_version 1097726 (0.0006) [2023-12-26 08:21:24,880][123090] Updated weights for policy 1, policy_version 1090021 (0.0010) [2023-12-26 08:21:24,892][123091] Updated weights for policy 0, policy_version 1097736 (0.0005) [2023-12-26 08:21:24,943][123090] Updated weights for policy 1, policy_version 1090031 (0.0010) [2023-12-26 08:21:25,009][123090] Updated weights for policy 1, policy_version 1090041 (0.0010) [2023-12-26 08:21:25,537][123091] Updated weights for policy 0, policy_version 1097746 (0.0006) [2023-12-26 08:21:25,585][123091] Updated weights for policy 0, policy_version 1097756 (0.0005) [2023-12-26 08:21:25,631][123091] Updated weights for policy 0, policy_version 1097766 (0.0005) [2023-12-26 08:21:25,677][123091] Updated weights for policy 0, policy_version 1097776 (0.0005) [2023-12-26 08:21:25,757][123090] Updated weights for policy 1, policy_version 1090051 (0.0009) [2023-12-26 08:21:25,813][123090] Updated weights for policy 1, policy_version 1090061 (0.0006) [2023-12-26 08:21:25,868][123090] Updated weights for policy 1, policy_version 1090071 (0.0005) [2023-12-26 08:21:26,362][123091] Updated weights for policy 0, policy_version 1097786 (0.0005) [2023-12-26 08:21:26,417][123091] Updated weights for policy 0, policy_version 1097796 (0.0005) [2023-12-26 08:21:26,489][123091] Updated weights for policy 0, policy_version 1097806 (0.0006) [2023-12-26 08:21:26,531][123090] Updated weights for policy 1, policy_version 1090081 (0.0005) [2023-12-26 08:21:26,602][123090] Updated weights for policy 1, policy_version 1090091 (0.0007) [2023-12-26 08:21:26,664][123090] Updated weights for policy 1, policy_version 1090101 (0.0008) [2023-12-26 08:21:26,729][123090] Updated weights for policy 1, policy_version 1090111 (0.0008) [2023-12-26 08:21:27,051][123091] Updated weights for policy 0, policy_version 1097816 (0.0005) [2023-12-26 08:21:27,107][123091] Updated weights for policy 0, policy_version 1097826 (0.0005) [2023-12-26 08:21:27,178][123091] Updated weights for policy 0, policy_version 1097836 (0.0005) [2023-12-26 08:21:27,488][123090] Updated weights for policy 1, policy_version 1090121 (0.0010) [2023-12-26 08:21:27,536][123090] Updated weights for policy 1, policy_version 1090131 (0.0010) [2023-12-26 08:21:27,587][123090] Updated weights for policy 1, policy_version 1090141 (0.0010) [2023-12-26 08:21:27,895][123091] Updated weights for policy 0, policy_version 1097846 (0.0007) [2023-12-26 08:21:27,943][123091] Updated weights for policy 0, policy_version 1097856 (0.0008) [2023-12-26 08:21:27,994][123091] Updated weights for policy 0, policy_version 1097868 (0.0009) [2023-12-26 08:21:28,389][123090] Updated weights for policy 1, policy_version 1090151 (0.0009) [2023-12-26 08:21:28,467][123090] Updated weights for policy 1, policy_version 1090161 (0.0007) [2023-12-26 08:21:28,537][123090] Updated weights for policy 1, policy_version 1090171 (0.0007) [2023-12-26 08:21:28,731][123091] Updated weights for policy 0, policy_version 1097878 (0.0007) [2023-12-26 08:21:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 560144384. Throughput: 0: 8856.3, 1: 8909.3. Samples: 560140184. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:28,785][121949] Avg episode reward: [(0, '6088.870'), (1, '5909.255')] [2023-12-26 08:21:28,789][123091] Updated weights for policy 0, policy_version 1097888 (0.0005) [2023-12-26 08:21:28,841][123091] Updated weights for policy 0, policy_version 1097898 (0.0005) [2023-12-26 08:21:29,376][123090] Updated weights for policy 1, policy_version 1090181 (0.0010) [2023-12-26 08:21:29,433][123090] Updated weights for policy 1, policy_version 1090191 (0.0010) [2023-12-26 08:21:29,490][123090] Updated weights for policy 1, policy_version 1090201 (0.0009) [2023-12-26 08:21:29,528][123091] Updated weights for policy 0, policy_version 1097908 (0.0006) [2023-12-26 08:21:29,605][123091] Updated weights for policy 0, policy_version 1097918 (0.0005) [2023-12-26 08:21:29,666][123091] Updated weights for policy 0, policy_version 1097928 (0.0005) [2023-12-26 08:21:30,360][123091] Updated weights for policy 0, policy_version 1097938 (0.0008) [2023-12-26 08:21:30,400][123090] Updated weights for policy 1, policy_version 1090211 (0.0009) [2023-12-26 08:21:30,426][123091] Updated weights for policy 0, policy_version 1097948 (0.0010) [2023-12-26 08:21:30,457][123090] Updated weights for policy 1, policy_version 1090221 (0.0007) [2023-12-26 08:21:30,487][123091] Updated weights for policy 0, policy_version 1097958 (0.0010) [2023-12-26 08:21:30,519][123090] Updated weights for policy 1, policy_version 1090231 (0.0007) [2023-12-26 08:21:30,548][123091] Updated weights for policy 0, policy_version 1097968 (0.0010) [2023-12-26 08:21:31,303][123091] Updated weights for policy 0, policy_version 1097978 (0.0009) [2023-12-26 08:21:31,306][123090] Updated weights for policy 1, policy_version 1090241 (0.0009) [2023-12-26 08:21:31,362][123090] Updated weights for policy 1, policy_version 1090251 (0.0008) [2023-12-26 08:21:31,370][123091] Updated weights for policy 0, policy_version 1097988 (0.0011) [2023-12-26 08:21:31,424][123090] Updated weights for policy 1, policy_version 1090261 (0.0008) [2023-12-26 08:21:31,438][123091] Updated weights for policy 0, policy_version 1097998 (0.0011) [2023-12-26 08:21:31,487][123090] Updated weights for policy 1, policy_version 1090271 (0.0008) [2023-12-26 08:21:32,218][123091] Updated weights for policy 0, policy_version 1098008 (0.0010) [2023-12-26 08:21:32,280][123091] Updated weights for policy 0, policy_version 1098018 (0.0011) [2023-12-26 08:21:32,284][123090] Updated weights for policy 1, policy_version 1090281 (0.0008) [2023-12-26 08:21:32,332][123091] Updated weights for policy 0, policy_version 1098028 (0.0010) [2023-12-26 08:21:32,355][123090] Updated weights for policy 1, policy_version 1090291 (0.0007) [2023-12-26 08:21:32,414][123090] Updated weights for policy 1, policy_version 1090301 (0.0008) [2023-12-26 08:21:33,005][123091] Updated weights for policy 0, policy_version 1098038 (0.0007) [2023-12-26 08:21:33,055][123091] Updated weights for policy 0, policy_version 1098048 (0.0005) [2023-12-26 08:21:33,108][123091] Updated weights for policy 0, policy_version 1098058 (0.0005) [2023-12-26 08:21:33,221][123090] Updated weights for policy 1, policy_version 1090311 (0.0010) [2023-12-26 08:21:33,281][123090] Updated weights for policy 1, policy_version 1090322 (0.0010) [2023-12-26 08:21:33,335][123090] Updated weights for policy 1, policy_version 1090332 (0.0010) [2023-12-26 08:21:33,705][123091] Updated weights for policy 0, policy_version 1098068 (0.0005) [2023-12-26 08:21:33,755][123091] Updated weights for policy 0, policy_version 1098078 (0.0005) [2023-12-26 08:21:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 560234496. Throughput: 0: 8942.0, 1: 8803.3. Samples: 560249116. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:33,785][121949] Avg episode reward: [(0, '6002.875'), (1, '5910.598')] [2023-12-26 08:21:33,807][123091] Updated weights for policy 0, policy_version 1098088 (0.0005) [2023-12-26 08:21:34,139][123090] Updated weights for policy 1, policy_version 1090342 (0.0009) [2023-12-26 08:21:34,211][123090] Updated weights for policy 1, policy_version 1090352 (0.0009) [2023-12-26 08:21:34,279][123090] Updated weights for policy 1, policy_version 1090362 (0.0010) [2023-12-26 08:21:34,648][123091] Updated weights for policy 0, policy_version 1098098 (0.0007) [2023-12-26 08:21:34,707][123091] Updated weights for policy 0, policy_version 1098108 (0.0010) [2023-12-26 08:21:34,773][123091] Updated weights for policy 0, policy_version 1098118 (0.0009) [2023-12-26 08:21:34,838][123091] Updated weights for policy 0, policy_version 1098128 (0.0010) [2023-12-26 08:21:35,018][123090] Updated weights for policy 1, policy_version 1090372 (0.0008) [2023-12-26 08:21:35,082][123090] Updated weights for policy 1, policy_version 1090382 (0.0005) [2023-12-26 08:21:35,144][123090] Updated weights for policy 1, policy_version 1090392 (0.0008) [2023-12-26 08:21:35,647][123091] Updated weights for policy 0, policy_version 1098138 (0.0005) [2023-12-26 08:21:35,703][123091] Updated weights for policy 0, policy_version 1098148 (0.0005) [2023-12-26 08:21:35,755][123091] Updated weights for policy 0, policy_version 1098158 (0.0005) [2023-12-26 08:21:35,935][123090] Updated weights for policy 1, policy_version 1090402 (0.0007) [2023-12-26 08:21:35,987][123090] Updated weights for policy 1, policy_version 1090412 (0.0008) [2023-12-26 08:21:36,050][123090] Updated weights for policy 1, policy_version 1090423 (0.0010) [2023-12-26 08:21:36,440][123091] Updated weights for policy 0, policy_version 1098168 (0.0010) [2023-12-26 08:21:36,507][123091] Updated weights for policy 0, policy_version 1098178 (0.0011) [2023-12-26 08:21:36,562][123091] Updated weights for policy 0, policy_version 1098188 (0.0011) [2023-12-26 08:21:36,893][123090] Updated weights for policy 1, policy_version 1090434 (0.0009) [2023-12-26 08:21:36,963][123090] Updated weights for policy 1, policy_version 1090444 (0.0008) [2023-12-26 08:21:37,035][123090] Updated weights for policy 1, policy_version 1090454 (0.0006) [2023-12-26 08:21:37,107][123090] Updated weights for policy 1, policy_version 1090464 (0.0007) [2023-12-26 08:21:37,393][123091] Updated weights for policy 0, policy_version 1098198 (0.0010) [2023-12-26 08:21:37,454][123091] Updated weights for policy 0, policy_version 1098208 (0.0009) [2023-12-26 08:21:37,508][123091] Updated weights for policy 0, policy_version 1098218 (0.0009) [2023-12-26 08:21:37,777][123090] Updated weights for policy 1, policy_version 1090474 (0.0010) [2023-12-26 08:21:37,837][123090] Updated weights for policy 1, policy_version 1090484 (0.0009) [2023-12-26 08:21:37,889][123090] Updated weights for policy 1, policy_version 1090494 (0.0009) [2023-12-26 08:21:38,352][123091] Updated weights for policy 0, policy_version 1098228 (0.0010) [2023-12-26 08:21:38,414][123091] Updated weights for policy 0, policy_version 1098238 (0.0009) [2023-12-26 08:21:38,467][123091] Updated weights for policy 0, policy_version 1098248 (0.0005) [2023-12-26 08:21:38,765][123090] Updated weights for policy 1, policy_version 1090504 (0.0010) [2023-12-26 08:21:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 560324608. Throughput: 0: 8993.6, 1: 8806.9. Samples: 560302652. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:38,785][121949] Avg episode reward: [(0, '5946.396'), (1, '5908.808')] [2023-12-26 08:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001098256_281157632.pth... [2023-12-26 08:21:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001097200_280887296.pth [2023-12-26 08:21:38,827][123090] Updated weights for policy 1, policy_version 1090514 (0.0009) [2023-12-26 08:21:38,881][123090] Updated weights for policy 1, policy_version 1090524 (0.0010) [2023-12-26 08:21:38,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001090528_279175168.pth... [2023-12-26 08:21:38,901][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001089472_278904832.pth [2023-12-26 08:21:39,180][123091] Updated weights for policy 0, policy_version 1098258 (0.0008) [2023-12-26 08:21:39,247][123091] Updated weights for policy 0, policy_version 1098268 (0.0007) [2023-12-26 08:21:39,311][123091] Updated weights for policy 0, policy_version 1098278 (0.0011) [2023-12-26 08:21:39,399][123091] Updated weights for policy 0, policy_version 1098288 (0.0011) [2023-12-26 08:21:39,711][123090] Updated weights for policy 1, policy_version 1090534 (0.0008) [2023-12-26 08:21:39,786][123090] Updated weights for policy 1, policy_version 1090544 (0.0009) [2023-12-26 08:21:39,854][123090] Updated weights for policy 1, policy_version 1090554 (0.0008) [2023-12-26 08:21:40,201][123091] Updated weights for policy 0, policy_version 1098298 (0.0009) [2023-12-26 08:21:40,256][123091] Updated weights for policy 0, policy_version 1098308 (0.0011) [2023-12-26 08:21:40,321][123091] Updated weights for policy 0, policy_version 1098318 (0.0011) [2023-12-26 08:21:40,598][123090] Updated weights for policy 1, policy_version 1090564 (0.0009) [2023-12-26 08:21:40,658][123090] Updated weights for policy 1, policy_version 1090574 (0.0010) [2023-12-26 08:21:40,717][123090] Updated weights for policy 1, policy_version 1090584 (0.0010) [2023-12-26 08:21:41,082][123091] Updated weights for policy 0, policy_version 1098328 (0.0009) [2023-12-26 08:21:41,147][123091] Updated weights for policy 0, policy_version 1098338 (0.0011) [2023-12-26 08:21:41,204][123091] Updated weights for policy 0, policy_version 1098348 (0.0010) [2023-12-26 08:21:41,654][123090] Updated weights for policy 1, policy_version 1090594 (0.0010) [2023-12-26 08:21:41,733][123090] Updated weights for policy 1, policy_version 1090604 (0.0007) [2023-12-26 08:21:41,803][123090] Updated weights for policy 1, policy_version 1090614 (0.0009) [2023-12-26 08:21:41,857][123090] Updated weights for policy 1, policy_version 1090624 (0.0009) [2023-12-26 08:21:42,031][123091] Updated weights for policy 0, policy_version 1098358 (0.0008) [2023-12-26 08:21:42,079][123091] Updated weights for policy 0, policy_version 1098368 (0.0008) [2023-12-26 08:21:42,142][123091] Updated weights for policy 0, policy_version 1098378 (0.0009) [2023-12-26 08:21:42,731][123090] Updated weights for policy 1, policy_version 1090634 (0.0009) [2023-12-26 08:21:42,801][123090] Updated weights for policy 1, policy_version 1090644 (0.0010) [2023-12-26 08:21:42,872][123090] Updated weights for policy 1, policy_version 1090654 (0.0010) [2023-12-26 08:21:42,895][123091] Updated weights for policy 0, policy_version 1098388 (0.0007) [2023-12-26 08:21:42,943][123091] Updated weights for policy 0, policy_version 1098398 (0.0007) [2023-12-26 08:21:43,005][123091] Updated weights for policy 0, policy_version 1098408 (0.0009) [2023-12-26 08:21:43,628][123090] Updated weights for policy 1, policy_version 1090664 (0.0008) [2023-12-26 08:21:43,683][123090] Updated weights for policy 1, policy_version 1090674 (0.0010) [2023-12-26 08:21:43,745][123090] Updated weights for policy 1, policy_version 1090684 (0.0009) [2023-12-26 08:21:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 560414720. Throughput: 0: 8882.8, 1: 8818.7. Samples: 560406380. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:43,784][121949] Avg episode reward: [(0, '6186.772'), (1, '5963.464')] [2023-12-26 08:21:43,837][123091] Updated weights for policy 0, policy_version 1098418 (0.0009) [2023-12-26 08:21:43,903][123091] Updated weights for policy 0, policy_version 1098428 (0.0005) [2023-12-26 08:21:43,970][123091] Updated weights for policy 0, policy_version 1098438 (0.0008) [2023-12-26 08:21:44,037][123091] Updated weights for policy 0, policy_version 1098448 (0.0010) [2023-12-26 08:21:44,623][123091] Updated weights for policy 0, policy_version 1098458 (0.0005) [2023-12-26 08:21:44,630][123090] Updated weights for policy 1, policy_version 1090694 (0.0007) [2023-12-26 08:21:44,678][123091] Updated weights for policy 0, policy_version 1098468 (0.0005) [2023-12-26 08:21:44,684][123090] Updated weights for policy 1, policy_version 1090704 (0.0005) [2023-12-26 08:21:44,740][123091] Updated weights for policy 0, policy_version 1098478 (0.0005) [2023-12-26 08:21:44,747][123090] Updated weights for policy 1, policy_version 1090714 (0.0005) [2023-12-26 08:21:45,495][123090] Updated weights for policy 1, policy_version 1090724 (0.0007) [2023-12-26 08:21:45,537][123091] Updated weights for policy 0, policy_version 1098488 (0.0007) [2023-12-26 08:21:45,559][123090] Updated weights for policy 1, policy_version 1090734 (0.0009) [2023-12-26 08:21:45,601][123091] Updated weights for policy 0, policy_version 1098498 (0.0008) [2023-12-26 08:21:45,613][123090] Updated weights for policy 1, policy_version 1090744 (0.0009) [2023-12-26 08:21:45,664][123091] Updated weights for policy 0, policy_version 1098508 (0.0008) [2023-12-26 08:21:46,430][123091] Updated weights for policy 0, policy_version 1098518 (0.0007) [2023-12-26 08:21:46,474][123090] Updated weights for policy 1, policy_version 1090754 (0.0008) [2023-12-26 08:21:46,484][123091] Updated weights for policy 0, policy_version 1098528 (0.0005) [2023-12-26 08:21:46,530][123090] Updated weights for policy 1, policy_version 1090764 (0.0008) [2023-12-26 08:21:46,534][123091] Updated weights for policy 0, policy_version 1098538 (0.0007) [2023-12-26 08:21:46,594][123090] Updated weights for policy 1, policy_version 1090774 (0.0009) [2023-12-26 08:21:46,661][123090] Updated weights for policy 1, policy_version 1090784 (0.0009) [2023-12-26 08:21:47,260][123091] Updated weights for policy 0, policy_version 1098548 (0.0009) [2023-12-26 08:21:47,315][123091] Updated weights for policy 0, policy_version 1098559 (0.0006) [2023-12-26 08:21:47,369][123091] Updated weights for policy 0, policy_version 1098569 (0.0005) [2023-12-26 08:21:47,510][123090] Updated weights for policy 1, policy_version 1090794 (0.0005) [2023-12-26 08:21:47,558][123090] Updated weights for policy 1, policy_version 1090804 (0.0005) [2023-12-26 08:21:47,605][123090] Updated weights for policy 1, policy_version 1090814 (0.0005) [2023-12-26 08:21:48,073][123091] Updated weights for policy 0, policy_version 1098579 (0.0006) [2023-12-26 08:21:48,145][123091] Updated weights for policy 0, policy_version 1098589 (0.0006) [2023-12-26 08:21:48,195][123091] Updated weights for policy 0, policy_version 1098599 (0.0006) [2023-12-26 08:21:48,364][123090] Updated weights for policy 1, policy_version 1090824 (0.0007) [2023-12-26 08:21:48,425][123090] Updated weights for policy 1, policy_version 1090834 (0.0008) [2023-12-26 08:21:48,478][123090] Updated weights for policy 1, policy_version 1090844 (0.0009) [2023-12-26 08:21:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 560504832. Throughput: 0: 8969.2, 1: 8821.8. Samples: 560515276. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:48,785][121949] Avg episode reward: [(0, '6183.928'), (1, '6023.538')] [2023-12-26 08:21:48,983][123091] Updated weights for policy 0, policy_version 1098609 (0.0008) [2023-12-26 08:21:49,046][123091] Updated weights for policy 0, policy_version 1098619 (0.0011) [2023-12-26 08:21:49,091][123091] Updated weights for policy 0, policy_version 1098629 (0.0010) [2023-12-26 08:21:49,143][123091] Updated weights for policy 0, policy_version 1098639 (0.0011) [2023-12-26 08:21:49,206][123090] Updated weights for policy 1, policy_version 1090854 (0.0009) [2023-12-26 08:21:49,281][123090] Updated weights for policy 1, policy_version 1090864 (0.0008) [2023-12-26 08:21:49,350][123090] Updated weights for policy 1, policy_version 1090874 (0.0007) [2023-12-26 08:21:49,883][123091] Updated weights for policy 0, policy_version 1098649 (0.0009) [2023-12-26 08:21:49,949][123091] Updated weights for policy 0, policy_version 1098659 (0.0009) [2023-12-26 08:21:50,005][123091] Updated weights for policy 0, policy_version 1098669 (0.0009) [2023-12-26 08:21:50,203][123090] Updated weights for policy 1, policy_version 1090884 (0.0009) [2023-12-26 08:21:50,263][123090] Updated weights for policy 1, policy_version 1090894 (0.0010) [2023-12-26 08:21:50,327][123090] Updated weights for policy 1, policy_version 1090904 (0.0011) [2023-12-26 08:21:50,860][123091] Updated weights for policy 0, policy_version 1098679 (0.0009) [2023-12-26 08:21:50,915][123091] Updated weights for policy 0, policy_version 1098689 (0.0009) [2023-12-26 08:21:50,967][123091] Updated weights for policy 0, policy_version 1098700 (0.0010) [2023-12-26 08:21:51,129][123090] Updated weights for policy 1, policy_version 1090914 (0.0010) [2023-12-26 08:21:51,201][123090] Updated weights for policy 1, policy_version 1090924 (0.0010) [2023-12-26 08:21:51,264][123090] Updated weights for policy 1, policy_version 1090934 (0.0010) [2023-12-26 08:21:51,325][123090] Updated weights for policy 1, policy_version 1090944 (0.0010) [2023-12-26 08:21:51,882][123091] Updated weights for policy 0, policy_version 1098710 (0.0010) [2023-12-26 08:21:51,946][123091] Updated weights for policy 0, policy_version 1098720 (0.0009) [2023-12-26 08:21:52,016][123091] Updated weights for policy 0, policy_version 1098730 (0.0009) [2023-12-26 08:21:52,110][123090] Updated weights for policy 1, policy_version 1090954 (0.0010) [2023-12-26 08:21:52,163][123090] Updated weights for policy 1, policy_version 1090964 (0.0009) [2023-12-26 08:21:52,212][123090] Updated weights for policy 1, policy_version 1090974 (0.0009) [2023-12-26 08:21:52,838][123091] Updated weights for policy 0, policy_version 1098740 (0.0008) [2023-12-26 08:21:52,906][123091] Updated weights for policy 0, policy_version 1098750 (0.0006) [2023-12-26 08:21:52,964][123091] Updated weights for policy 0, policy_version 1098760 (0.0006) [2023-12-26 08:21:53,108][123090] Updated weights for policy 1, policy_version 1090984 (0.0009) [2023-12-26 08:21:53,180][123090] Updated weights for policy 1, policy_version 1090994 (0.0010) [2023-12-26 08:21:53,253][123090] Updated weights for policy 1, policy_version 1091004 (0.0010) [2023-12-26 08:21:53,643][123091] Updated weights for policy 0, policy_version 1098770 (0.0006) [2023-12-26 08:21:53,706][123091] Updated weights for policy 0, policy_version 1098780 (0.0011) [2023-12-26 08:21:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 560586752. Throughput: 0: 9011.8, 1: 8769.3. Samples: 560567332. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:53,785][121949] Avg episode reward: [(0, '6235.382'), (1, '6024.487')] [2023-12-26 08:21:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001091008_279298048.pth... [2023-12-26 08:21:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001089984_279035904.pth [2023-12-26 08:21:53,801][123091] Updated weights for policy 0, policy_version 1098790 (0.0011) [2023-12-26 08:21:53,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001098800_281296896.pth... [2023-12-26 08:21:53,863][123091] Updated weights for policy 0, policy_version 1098800 (0.0010) [2023-12-26 08:21:53,866][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001097680_281010176.pth [2023-12-26 08:21:54,039][123090] Updated weights for policy 1, policy_version 1091014 (0.0009) [2023-12-26 08:21:54,088][123090] Updated weights for policy 1, policy_version 1091024 (0.0009) [2023-12-26 08:21:54,136][123090] Updated weights for policy 1, policy_version 1091034 (0.0008) [2023-12-26 08:21:54,658][123091] Updated weights for policy 0, policy_version 1098810 (0.0011) [2023-12-26 08:21:54,705][123091] Updated weights for policy 0, policy_version 1098820 (0.0010) [2023-12-26 08:21:54,764][123091] Updated weights for policy 0, policy_version 1098830 (0.0010) [2023-12-26 08:21:54,995][123090] Updated weights for policy 1, policy_version 1091044 (0.0008) [2023-12-26 08:21:55,051][123090] Updated weights for policy 1, policy_version 1091054 (0.0009) [2023-12-26 08:21:55,100][123090] Updated weights for policy 1, policy_version 1091064 (0.0009) [2023-12-26 08:21:55,600][123091] Updated weights for policy 0, policy_version 1098840 (0.0010) [2023-12-26 08:21:55,648][123091] Updated weights for policy 0, policy_version 1098850 (0.0010) [2023-12-26 08:21:55,695][123091] Updated weights for policy 0, policy_version 1098860 (0.0010) [2023-12-26 08:21:55,940][123090] Updated weights for policy 1, policy_version 1091074 (0.0009) [2023-12-26 08:21:56,010][123090] Updated weights for policy 1, policy_version 1091084 (0.0009) [2023-12-26 08:21:56,073][123090] Updated weights for policy 1, policy_version 1091094 (0.0009) [2023-12-26 08:21:56,144][123090] Updated weights for policy 1, policy_version 1091104 (0.0009) [2023-12-26 08:21:56,524][123091] Updated weights for policy 0, policy_version 1098870 (0.0010) [2023-12-26 08:21:56,590][123091] Updated weights for policy 0, policy_version 1098880 (0.0010) [2023-12-26 08:21:56,637][123091] Updated weights for policy 0, policy_version 1098890 (0.0010) [2023-12-26 08:21:56,929][123090] Updated weights for policy 1, policy_version 1091114 (0.0005) [2023-12-26 08:21:57,003][123090] Updated weights for policy 1, policy_version 1091124 (0.0006) [2023-12-26 08:21:57,075][123090] Updated weights for policy 1, policy_version 1091134 (0.0010) [2023-12-26 08:21:57,459][123091] Updated weights for policy 0, policy_version 1098900 (0.0008) [2023-12-26 08:21:57,519][123091] Updated weights for policy 0, policy_version 1098911 (0.0007) [2023-12-26 08:21:57,571][123091] Updated weights for policy 0, policy_version 1098921 (0.0009) [2023-12-26 08:21:57,821][123090] Updated weights for policy 1, policy_version 1091144 (0.0010) [2023-12-26 08:21:57,864][123090] Updated weights for policy 1, policy_version 1091154 (0.0010) [2023-12-26 08:21:57,911][123090] Updated weights for policy 1, policy_version 1091164 (0.0010) [2023-12-26 08:21:58,395][123091] Updated weights for policy 0, policy_version 1098931 (0.0009) [2023-12-26 08:21:58,466][123091] Updated weights for policy 0, policy_version 1098941 (0.0010) [2023-12-26 08:21:58,539][123091] Updated weights for policy 0, policy_version 1098951 (0.0008) [2023-12-26 08:21:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 560676864. Throughput: 0: 9091.5, 1: 8737.8. Samples: 560672176. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:21:58,785][121949] Avg episode reward: [(0, '6233.087'), (1, '6012.998')] [2023-12-26 08:21:58,800][123090] Updated weights for policy 1, policy_version 1091174 (0.0010) [2023-12-26 08:21:58,862][123090] Updated weights for policy 1, policy_version 1091184 (0.0009) [2023-12-26 08:21:58,919][123090] Updated weights for policy 1, policy_version 1091194 (0.0008) [2023-12-26 08:21:59,423][123091] Updated weights for policy 0, policy_version 1098961 (0.0008) [2023-12-26 08:21:59,497][123091] Updated weights for policy 0, policy_version 1098971 (0.0010) [2023-12-26 08:21:59,556][123091] Updated weights for policy 0, policy_version 1098981 (0.0006) [2023-12-26 08:21:59,616][123091] Updated weights for policy 0, policy_version 1098991 (0.0006) [2023-12-26 08:21:59,665][123090] Updated weights for policy 1, policy_version 1091204 (0.0007) [2023-12-26 08:21:59,722][123090] Updated weights for policy 1, policy_version 1091214 (0.0009) [2023-12-26 08:21:59,778][123090] Updated weights for policy 1, policy_version 1091224 (0.0008) [2023-12-26 08:22:00,382][123091] Updated weights for policy 0, policy_version 1099001 (0.0010) [2023-12-26 08:22:00,441][123091] Updated weights for policy 0, policy_version 1099011 (0.0010) [2023-12-26 08:22:00,499][123091] Updated weights for policy 0, policy_version 1099021 (0.0009) [2023-12-26 08:22:00,518][123090] Updated weights for policy 1, policy_version 1091234 (0.0009) [2023-12-26 08:22:00,582][123090] Updated weights for policy 1, policy_version 1091244 (0.0005) [2023-12-26 08:22:00,645][123090] Updated weights for policy 1, policy_version 1091254 (0.0009) [2023-12-26 08:22:00,711][123090] Updated weights for policy 1, policy_version 1091264 (0.0010) [2023-12-26 08:22:01,359][123091] Updated weights for policy 0, policy_version 1099031 (0.0010) [2023-12-26 08:22:01,429][123091] Updated weights for policy 0, policy_version 1099041 (0.0009) [2023-12-26 08:22:01,485][123091] Updated weights for policy 0, policy_version 1099051 (0.0006) [2023-12-26 08:22:01,497][123090] Updated weights for policy 1, policy_version 1091274 (0.0008) [2023-12-26 08:22:01,568][123090] Updated weights for policy 1, policy_version 1091284 (0.0006) [2023-12-26 08:22:01,636][123090] Updated weights for policy 1, policy_version 1091294 (0.0007) [2023-12-26 08:22:02,200][123091] Updated weights for policy 0, policy_version 1099061 (0.0008) [2023-12-26 08:22:02,271][123091] Updated weights for policy 0, policy_version 1099071 (0.0009) [2023-12-26 08:22:02,340][123091] Updated weights for policy 0, policy_version 1099081 (0.0008) [2023-12-26 08:22:02,396][123090] Updated weights for policy 1, policy_version 1091304 (0.0009) [2023-12-26 08:22:02,458][123090] Updated weights for policy 1, policy_version 1091314 (0.0010) [2023-12-26 08:22:02,524][123090] Updated weights for policy 1, policy_version 1091325 (0.0008) [2023-12-26 08:22:03,188][123091] Updated weights for policy 0, policy_version 1099091 (0.0008) [2023-12-26 08:22:03,239][123091] Updated weights for policy 0, policy_version 1099101 (0.0008) [2023-12-26 08:22:03,245][123090] Updated weights for policy 1, policy_version 1091335 (0.0009) [2023-12-26 08:22:03,289][123090] Updated weights for policy 1, policy_version 1091345 (0.0007) [2023-12-26 08:22:03,305][123091] Updated weights for policy 0, policy_version 1099111 (0.0007) [2023-12-26 08:22:03,335][123090] Updated weights for policy 1, policy_version 1091355 (0.0005) [2023-12-26 08:22:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 560766976. Throughput: 0: 9050.6, 1: 8791.0. Samples: 560777864. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:03,785][121949] Avg episode reward: [(0, '6126.567'), (1, '5977.939')] [2023-12-26 08:22:04,082][123090] Updated weights for policy 1, policy_version 1091365 (0.0008) [2023-12-26 08:22:04,144][123090] Updated weights for policy 1, policy_version 1091375 (0.0007) [2023-12-26 08:22:04,161][123091] Updated weights for policy 0, policy_version 1099121 (0.0006) [2023-12-26 08:22:04,216][123090] Updated weights for policy 1, policy_version 1091385 (0.0006) [2023-12-26 08:22:04,232][123091] Updated weights for policy 0, policy_version 1099131 (0.0006) [2023-12-26 08:22:04,304][123091] Updated weights for policy 0, policy_version 1099141 (0.0008) [2023-12-26 08:22:04,367][123091] Updated weights for policy 0, policy_version 1099151 (0.0008) [2023-12-26 08:22:04,837][123090] Updated weights for policy 1, policy_version 1091395 (0.0006) [2023-12-26 08:22:04,893][123090] Updated weights for policy 1, policy_version 1091405 (0.0005) [2023-12-26 08:22:04,945][123090] Updated weights for policy 1, policy_version 1091415 (0.0007) [2023-12-26 08:22:05,089][123091] Updated weights for policy 0, policy_version 1099161 (0.0007) [2023-12-26 08:22:05,162][123091] Updated weights for policy 0, policy_version 1099171 (0.0006) [2023-12-26 08:22:05,231][123091] Updated weights for policy 0, policy_version 1099181 (0.0007) [2023-12-26 08:22:05,728][123090] Updated weights for policy 1, policy_version 1091425 (0.0008) [2023-12-26 08:22:05,798][123090] Updated weights for policy 1, policy_version 1091435 (0.0005) [2023-12-26 08:22:05,849][123090] Updated weights for policy 1, policy_version 1091445 (0.0005) [2023-12-26 08:22:05,905][123090] Updated weights for policy 1, policy_version 1091455 (0.0006) [2023-12-26 08:22:05,954][123091] Updated weights for policy 0, policy_version 1099191 (0.0007) [2023-12-26 08:22:06,001][123091] Updated weights for policy 0, policy_version 1099201 (0.0006) [2023-12-26 08:22:06,054][123091] Updated weights for policy 0, policy_version 1099211 (0.0007) [2023-12-26 08:22:06,553][123090] Updated weights for policy 1, policy_version 1091465 (0.0010) [2023-12-26 08:22:06,610][123090] Updated weights for policy 1, policy_version 1091475 (0.0006) [2023-12-26 08:22:06,666][123090] Updated weights for policy 1, policy_version 1091485 (0.0008) [2023-12-26 08:22:06,926][123091] Updated weights for policy 0, policy_version 1099222 (0.0010) [2023-12-26 08:22:06,978][123091] Updated weights for policy 0, policy_version 1099233 (0.0010) [2023-12-26 08:22:07,035][123091] Updated weights for policy 0, policy_version 1099243 (0.0010) [2023-12-26 08:22:07,463][123090] Updated weights for policy 1, policy_version 1091495 (0.0010) [2023-12-26 08:22:07,512][123090] Updated weights for policy 1, policy_version 1091505 (0.0009) [2023-12-26 08:22:07,574][123090] Updated weights for policy 1, policy_version 1091515 (0.0010) [2023-12-26 08:22:07,923][123091] Updated weights for policy 0, policy_version 1099253 (0.0009) [2023-12-26 08:22:07,970][123091] Updated weights for policy 0, policy_version 1099263 (0.0008) [2023-12-26 08:22:08,016][123091] Updated weights for policy 0, policy_version 1099273 (0.0005) [2023-12-26 08:22:08,333][123090] Updated weights for policy 1, policy_version 1091525 (0.0010) [2023-12-26 08:22:08,395][123090] Updated weights for policy 1, policy_version 1091535 (0.0007) [2023-12-26 08:22:08,456][123090] Updated weights for policy 1, policy_version 1091545 (0.0007) [2023-12-26 08:22:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 560857088. Throughput: 0: 9098.8, 1: 8837.2. Samples: 560833984. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:08,785][121949] Avg episode reward: [(0, '6041.091'), (1, '6004.934')] [2023-12-26 08:22:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001091552_279437312.pth... [2023-12-26 08:22:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001090528_279175168.pth [2023-12-26 08:22:08,809][123091] Updated weights for policy 0, policy_version 1099283 (0.0007) [2023-12-26 08:22:08,867][123091] Updated weights for policy 0, policy_version 1099293 (0.0009) [2023-12-26 08:22:08,922][123091] Updated weights for policy 0, policy_version 1099303 (0.0010) [2023-12-26 08:22:08,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001099312_281427968.pth... [2023-12-26 08:22:08,965][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001098256_281157632.pth [2023-12-26 08:22:09,200][123090] Updated weights for policy 1, policy_version 1091555 (0.0009) [2023-12-26 08:22:09,273][123090] Updated weights for policy 1, policy_version 1091565 (0.0008) [2023-12-26 08:22:09,341][123090] Updated weights for policy 1, policy_version 1091575 (0.0009) [2023-12-26 08:22:09,748][123091] Updated weights for policy 0, policy_version 1099314 (0.0010) [2023-12-26 08:22:09,804][123091] Updated weights for policy 0, policy_version 1099324 (0.0010) [2023-12-26 08:22:09,872][123091] Updated weights for policy 0, policy_version 1099334 (0.0008) [2023-12-26 08:22:09,945][123091] Updated weights for policy 0, policy_version 1099344 (0.0006) [2023-12-26 08:22:10,186][123090] Updated weights for policy 1, policy_version 1091585 (0.0008) [2023-12-26 08:22:10,256][123090] Updated weights for policy 1, policy_version 1091595 (0.0010) [2023-12-26 08:22:10,329][123090] Updated weights for policy 1, policy_version 1091605 (0.0010) [2023-12-26 08:22:10,397][123090] Updated weights for policy 1, policy_version 1091615 (0.0010) [2023-12-26 08:22:10,711][123091] Updated weights for policy 0, policy_version 1099354 (0.0006) [2023-12-26 08:22:10,773][123091] Updated weights for policy 0, policy_version 1099364 (0.0008) [2023-12-26 08:22:10,836][123091] Updated weights for policy 0, policy_version 1099374 (0.0009) [2023-12-26 08:22:11,275][123090] Updated weights for policy 1, policy_version 1091625 (0.0011) [2023-12-26 08:22:11,340][123090] Updated weights for policy 1, policy_version 1091635 (0.0010) [2023-12-26 08:22:11,415][123090] Updated weights for policy 1, policy_version 1091645 (0.0011) [2023-12-26 08:22:11,649][123091] Updated weights for policy 0, policy_version 1099384 (0.0009) [2023-12-26 08:22:11,718][123091] Updated weights for policy 0, policy_version 1099394 (0.0009) [2023-12-26 08:22:11,800][123091] Updated weights for policy 0, policy_version 1099404 (0.0009) [2023-12-26 08:22:12,252][123090] Updated weights for policy 1, policy_version 1091655 (0.0011) [2023-12-26 08:22:12,315][123090] Updated weights for policy 1, policy_version 1091665 (0.0011) [2023-12-26 08:22:12,385][123090] Updated weights for policy 1, policy_version 1091675 (0.0010) [2023-12-26 08:22:12,638][123091] Updated weights for policy 0, policy_version 1099414 (0.0010) [2023-12-26 08:22:12,691][123091] Updated weights for policy 0, policy_version 1099424 (0.0010) [2023-12-26 08:22:12,743][123091] Updated weights for policy 0, policy_version 1099434 (0.0009) [2023-12-26 08:22:13,253][123090] Updated weights for policy 1, policy_version 1091685 (0.0010) [2023-12-26 08:22:13,316][123090] Updated weights for policy 1, policy_version 1091695 (0.0009) [2023-12-26 08:22:13,386][123090] Updated weights for policy 1, policy_version 1091705 (0.0010) [2023-12-26 08:22:13,534][123091] Updated weights for policy 0, policy_version 1099444 (0.0010) [2023-12-26 08:22:13,600][123091] Updated weights for policy 0, policy_version 1099454 (0.0010) [2023-12-26 08:22:13,665][123091] Updated weights for policy 0, policy_version 1099464 (0.0007) [2023-12-26 08:22:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 560947200. Throughput: 0: 8970.5, 1: 8751.2. Samples: 560937660. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:13,785][121949] Avg episode reward: [(0, '6163.383'), (1, '6043.005')] [2023-12-26 08:22:14,257][123090] Updated weights for policy 1, policy_version 1091715 (0.0009) [2023-12-26 08:22:14,311][123090] Updated weights for policy 1, policy_version 1091725 (0.0010) [2023-12-26 08:22:14,338][123091] Updated weights for policy 0, policy_version 1099474 (0.0009) [2023-12-26 08:22:14,368][123090] Updated weights for policy 1, policy_version 1091735 (0.0008) [2023-12-26 08:22:14,393][123091] Updated weights for policy 0, policy_version 1099484 (0.0005) [2023-12-26 08:22:14,442][123091] Updated weights for policy 0, policy_version 1099494 (0.0005) [2023-12-26 08:22:14,493][123091] Updated weights for policy 0, policy_version 1099504 (0.0008) [2023-12-26 08:22:15,134][123090] Updated weights for policy 1, policy_version 1091745 (0.0006) [2023-12-26 08:22:15,201][123090] Updated weights for policy 1, policy_version 1091755 (0.0008) [2023-12-26 08:22:15,257][123090] Updated weights for policy 1, policy_version 1091765 (0.0008) [2023-12-26 08:22:15,325][123090] Updated weights for policy 1, policy_version 1091775 (0.0009) [2023-12-26 08:22:15,358][123091] Updated weights for policy 0, policy_version 1099514 (0.0008) [2023-12-26 08:22:15,423][123091] Updated weights for policy 0, policy_version 1099524 (0.0008) [2023-12-26 08:22:15,486][123091] Updated weights for policy 0, policy_version 1099534 (0.0008) [2023-12-26 08:22:16,132][123090] Updated weights for policy 1, policy_version 1091785 (0.0009) [2023-12-26 08:22:16,187][123090] Updated weights for policy 1, policy_version 1091795 (0.0008) [2023-12-26 08:22:16,236][123090] Updated weights for policy 1, policy_version 1091805 (0.0005) [2023-12-26 08:22:16,290][123091] Updated weights for policy 0, policy_version 1099544 (0.0008) [2023-12-26 08:22:16,359][123091] Updated weights for policy 0, policy_version 1099554 (0.0009) [2023-12-26 08:22:16,419][123091] Updated weights for policy 0, policy_version 1099564 (0.0008) [2023-12-26 08:22:16,942][123090] Updated weights for policy 1, policy_version 1091815 (0.0006) [2023-12-26 08:22:16,986][123090] Updated weights for policy 1, policy_version 1091825 (0.0005) [2023-12-26 08:22:17,039][123090] Updated weights for policy 1, policy_version 1091835 (0.0005) [2023-12-26 08:22:17,311][123091] Updated weights for policy 0, policy_version 1099574 (0.0008) [2023-12-26 08:22:17,366][123091] Updated weights for policy 0, policy_version 1099584 (0.0005) [2023-12-26 08:22:17,427][123091] Updated weights for policy 0, policy_version 1099594 (0.0005) [2023-12-26 08:22:17,734][123090] Updated weights for policy 1, policy_version 1091845 (0.0005) [2023-12-26 08:22:17,784][123090] Updated weights for policy 1, policy_version 1091855 (0.0005) [2023-12-26 08:22:17,831][123090] Updated weights for policy 1, policy_version 1091865 (0.0005) [2023-12-26 08:22:18,054][123091] Updated weights for policy 0, policy_version 1099604 (0.0007) [2023-12-26 08:22:18,102][123091] Updated weights for policy 0, policy_version 1099614 (0.0009) [2023-12-26 08:22:18,153][123091] Updated weights for policy 0, policy_version 1099624 (0.0008) [2023-12-26 08:22:18,667][123090] Updated weights for policy 1, policy_version 1091875 (0.0007) [2023-12-26 08:22:18,736][123090] Updated weights for policy 1, policy_version 1091885 (0.0006) [2023-12-26 08:22:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 561029120. Throughput: 0: 8878.8, 1: 8832.7. Samples: 561046136. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:18,785][121949] Avg episode reward: [(0, '6096.757'), (1, '5958.135')] [2023-12-26 08:22:18,790][123090] Updated weights for policy 1, policy_version 1091895 (0.0006) [2023-12-26 08:22:18,930][123091] Updated weights for policy 0, policy_version 1099634 (0.0008) [2023-12-26 08:22:18,982][123091] Updated weights for policy 0, policy_version 1099644 (0.0009) [2023-12-26 08:22:19,035][123091] Updated weights for policy 0, policy_version 1099654 (0.0009) [2023-12-26 08:22:19,090][123091] Updated weights for policy 0, policy_version 1099664 (0.0009) [2023-12-26 08:22:19,580][123090] Updated weights for policy 1, policy_version 1091905 (0.0009) [2023-12-26 08:22:19,648][123090] Updated weights for policy 1, policy_version 1091915 (0.0008) [2023-12-26 08:22:19,706][123090] Updated weights for policy 1, policy_version 1091925 (0.0009) [2023-12-26 08:22:19,771][123090] Updated weights for policy 1, policy_version 1091935 (0.0007) [2023-12-26 08:22:19,977][123091] Updated weights for policy 0, policy_version 1099674 (0.0010) [2023-12-26 08:22:20,048][123091] Updated weights for policy 0, policy_version 1099684 (0.0008) [2023-12-26 08:22:20,105][123091] Updated weights for policy 0, policy_version 1099694 (0.0010) [2023-12-26 08:22:20,612][123090] Updated weights for policy 1, policy_version 1091945 (0.0009) [2023-12-26 08:22:20,687][123090] Updated weights for policy 1, policy_version 1091955 (0.0007) [2023-12-26 08:22:20,756][123090] Updated weights for policy 1, policy_version 1091965 (0.0006) [2023-12-26 08:22:21,005][123091] Updated weights for policy 0, policy_version 1099704 (0.0010) [2023-12-26 08:22:21,068][123091] Updated weights for policy 0, policy_version 1099714 (0.0010) [2023-12-26 08:22:21,138][123091] Updated weights for policy 0, policy_version 1099724 (0.0010) [2023-12-26 08:22:21,572][123090] Updated weights for policy 1, policy_version 1091975 (0.0009) [2023-12-26 08:22:21,634][123090] Updated weights for policy 1, policy_version 1091985 (0.0009) [2023-12-26 08:22:21,707][123090] Updated weights for policy 1, policy_version 1091995 (0.0009) [2023-12-26 08:22:22,022][123091] Updated weights for policy 0, policy_version 1099734 (0.0008) [2023-12-26 08:22:22,085][123091] Updated weights for policy 0, policy_version 1099744 (0.0008) [2023-12-26 08:22:22,159][123091] Updated weights for policy 0, policy_version 1099754 (0.0007) [2023-12-26 08:22:22,600][123090] Updated weights for policy 1, policy_version 1092005 (0.0008) [2023-12-26 08:22:22,666][123090] Updated weights for policy 1, policy_version 1092015 (0.0009) [2023-12-26 08:22:22,728][123090] Updated weights for policy 1, policy_version 1092025 (0.0009) [2023-12-26 08:22:22,947][123091] Updated weights for policy 0, policy_version 1099764 (0.0008) [2023-12-26 08:22:23,007][123091] Updated weights for policy 0, policy_version 1099774 (0.0011) [2023-12-26 08:22:23,064][123091] Updated weights for policy 0, policy_version 1099784 (0.0011) [2023-12-26 08:22:23,431][123090] Updated weights for policy 1, policy_version 1092035 (0.0009) [2023-12-26 08:22:23,504][123090] Updated weights for policy 1, policy_version 1092045 (0.0010) [2023-12-26 08:22:23,578][123090] Updated weights for policy 1, policy_version 1092055 (0.0010) [2023-12-26 08:22:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 561119232. Throughput: 0: 8822.1, 1: 8815.6. Samples: 561096352. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:23,785][121949] Avg episode reward: [(0, '6117.870'), (1, '5849.873')] [2023-12-26 08:22:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001092064_279568384.pth... [2023-12-26 08:22:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001099792_281550848.pth... [2023-12-26 08:22:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001098800_281296896.pth [2023-12-26 08:22:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001091008_279298048.pth [2023-12-26 08:22:23,820][123091] Updated weights for policy 0, policy_version 1099794 (0.0006) [2023-12-26 08:22:23,865][123091] Updated weights for policy 0, policy_version 1099804 (0.0005) [2023-12-26 08:22:23,913][123091] Updated weights for policy 0, policy_version 1099814 (0.0005) [2023-12-26 08:22:23,966][123091] Updated weights for policy 0, policy_version 1099824 (0.0005) [2023-12-26 08:22:24,318][123090] Updated weights for policy 1, policy_version 1092065 (0.0010) [2023-12-26 08:22:24,377][123090] Updated weights for policy 1, policy_version 1092075 (0.0005) [2023-12-26 08:22:24,425][123090] Updated weights for policy 1, policy_version 1092085 (0.0005) [2023-12-26 08:22:24,480][123090] Updated weights for policy 1, policy_version 1092095 (0.0005) [2023-12-26 08:22:24,654][123091] Updated weights for policy 0, policy_version 1099834 (0.0006) [2023-12-26 08:22:24,711][123091] Updated weights for policy 0, policy_version 1099844 (0.0005) [2023-12-26 08:22:24,772][123091] Updated weights for policy 0, policy_version 1099854 (0.0005) [2023-12-26 08:22:25,175][123090] Updated weights for policy 1, policy_version 1092105 (0.0010) [2023-12-26 08:22:25,226][123090] Updated weights for policy 1, policy_version 1092115 (0.0010) [2023-12-26 08:22:25,273][123090] Updated weights for policy 1, policy_version 1092125 (0.0010) [2023-12-26 08:22:25,429][123091] Updated weights for policy 0, policy_version 1099864 (0.0006) [2023-12-26 08:22:25,484][123091] Updated weights for policy 0, policy_version 1099874 (0.0005) [2023-12-26 08:22:25,533][123091] Updated weights for policy 0, policy_version 1099884 (0.0005) [2023-12-26 08:22:26,112][123090] Updated weights for policy 1, policy_version 1092135 (0.0010) [2023-12-26 08:22:26,171][123090] Updated weights for policy 1, policy_version 1092145 (0.0010) [2023-12-26 08:22:26,176][123091] Updated weights for policy 0, policy_version 1099894 (0.0005) [2023-12-26 08:22:26,236][123091] Updated weights for policy 0, policy_version 1099904 (0.0005) [2023-12-26 08:22:26,238][123090] Updated weights for policy 1, policy_version 1092155 (0.0010) [2023-12-26 08:22:26,294][123091] Updated weights for policy 0, policy_version 1099914 (0.0010) [2023-12-26 08:22:27,062][123090] Updated weights for policy 1, policy_version 1092165 (0.0008) [2023-12-26 08:22:27,097][123091] Updated weights for policy 0, policy_version 1099924 (0.0010) [2023-12-26 08:22:27,107][123090] Updated weights for policy 1, policy_version 1092175 (0.0009) [2023-12-26 08:22:27,140][123091] Updated weights for policy 0, policy_version 1099934 (0.0010) [2023-12-26 08:22:27,151][123090] Updated weights for policy 1, policy_version 1092185 (0.0005) [2023-12-26 08:22:27,190][123091] Updated weights for policy 0, policy_version 1099944 (0.0010) [2023-12-26 08:22:27,998][123090] Updated weights for policy 1, policy_version 1092195 (0.0008) [2023-12-26 08:22:28,021][123091] Updated weights for policy 0, policy_version 1099954 (0.0010) [2023-12-26 08:22:28,058][123090] Updated weights for policy 1, policy_version 1092205 (0.0006) [2023-12-26 08:22:28,083][123091] Updated weights for policy 0, policy_version 1099964 (0.0010) [2023-12-26 08:22:28,111][123090] Updated weights for policy 1, policy_version 1092215 (0.0009) [2023-12-26 08:22:28,134][123091] Updated weights for policy 0, policy_version 1099974 (0.0010) [2023-12-26 08:22:28,193][123091] Updated weights for policy 0, policy_version 1099984 (0.0010) [2023-12-26 08:22:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 561209344. Throughput: 0: 8910.7, 1: 8880.4. Samples: 561206984. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:28,785][121949] Avg episode reward: [(0, '6199.412'), (1, '5778.159')] [2023-12-26 08:22:28,976][123090] Updated weights for policy 1, policy_version 1092225 (0.0006) [2023-12-26 08:22:29,019][123091] Updated weights for policy 0, policy_version 1099994 (0.0011) [2023-12-26 08:22:29,042][123090] Updated weights for policy 1, policy_version 1092235 (0.0006) [2023-12-26 08:22:29,073][123091] Updated weights for policy 0, policy_version 1100004 (0.0010) [2023-12-26 08:22:29,102][123090] Updated weights for policy 1, policy_version 1092245 (0.0006) [2023-12-26 08:22:29,131][123091] Updated weights for policy 0, policy_version 1100014 (0.0010) [2023-12-26 08:22:29,166][123090] Updated weights for policy 1, policy_version 1092255 (0.0009) [2023-12-26 08:22:29,989][123091] Updated weights for policy 0, policy_version 1100024 (0.0010) [2023-12-26 08:22:30,010][123090] Updated weights for policy 1, policy_version 1092265 (0.0008) [2023-12-26 08:22:30,053][123091] Updated weights for policy 0, policy_version 1100034 (0.0011) [2023-12-26 08:22:30,073][123090] Updated weights for policy 1, policy_version 1092275 (0.0008) [2023-12-26 08:22:30,113][123091] Updated weights for policy 0, policy_version 1100044 (0.0011) [2023-12-26 08:22:30,135][123090] Updated weights for policy 1, policy_version 1092285 (0.0008) [2023-12-26 08:22:30,936][123091] Updated weights for policy 0, policy_version 1100054 (0.0011) [2023-12-26 08:22:30,981][123090] Updated weights for policy 1, policy_version 1092295 (0.0006) [2023-12-26 08:22:30,983][123091] Updated weights for policy 0, policy_version 1100064 (0.0010) [2023-12-26 08:22:31,035][123090] Updated weights for policy 1, policy_version 1092305 (0.0006) [2023-12-26 08:22:31,036][123091] Updated weights for policy 0, policy_version 1100074 (0.0010) [2023-12-26 08:22:31,101][123090] Updated weights for policy 1, policy_version 1092315 (0.0008) [2023-12-26 08:22:31,854][123091] Updated weights for policy 0, policy_version 1100084 (0.0009) [2023-12-26 08:22:31,872][123090] Updated weights for policy 1, policy_version 1092325 (0.0009) [2023-12-26 08:22:31,917][123091] Updated weights for policy 0, policy_version 1100094 (0.0011) [2023-12-26 08:22:31,929][123090] Updated weights for policy 1, policy_version 1092335 (0.0005) [2023-12-26 08:22:31,984][123091] Updated weights for policy 0, policy_version 1100104 (0.0009) [2023-12-26 08:22:31,985][123090] Updated weights for policy 1, policy_version 1092345 (0.0005) [2023-12-26 08:22:32,648][123090] Updated weights for policy 1, policy_version 1092355 (0.0005) [2023-12-26 08:22:32,708][123090] Updated weights for policy 1, policy_version 1092365 (0.0006) [2023-12-26 08:22:32,759][123090] Updated weights for policy 1, policy_version 1092375 (0.0006) [2023-12-26 08:22:32,794][123091] Updated weights for policy 0, policy_version 1100114 (0.0009) [2023-12-26 08:22:32,864][123091] Updated weights for policy 0, policy_version 1100124 (0.0008) [2023-12-26 08:22:32,933][123091] Updated weights for policy 0, policy_version 1100134 (0.0008) [2023-12-26 08:22:32,989][123091] Updated weights for policy 0, policy_version 1100144 (0.0007) [2023-12-26 08:22:33,535][123090] Updated weights for policy 1, policy_version 1092385 (0.0006) [2023-12-26 08:22:33,592][123090] Updated weights for policy 1, policy_version 1092395 (0.0009) [2023-12-26 08:22:33,617][123091] Updated weights for policy 0, policy_version 1100154 (0.0005) [2023-12-26 08:22:33,645][123090] Updated weights for policy 1, policy_version 1092405 (0.0009) [2023-12-26 08:22:33,676][123091] Updated weights for policy 0, policy_version 1100164 (0.0005) [2023-12-26 08:22:33,694][123090] Updated weights for policy 1, policy_version 1092415 (0.0008) [2023-12-26 08:22:33,725][123091] Updated weights for policy 0, policy_version 1100174 (0.0005) [2023-12-26 08:22:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 561307648. Throughput: 0: 8834.7, 1: 8899.2. Samples: 561313296. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:33,784][121949] Avg episode reward: [(0, '6139.714'), (1, '5814.615')] [2023-12-26 08:22:34,368][123091] Updated weights for policy 0, policy_version 1100184 (0.0008) [2023-12-26 08:22:34,422][123091] Updated weights for policy 0, policy_version 1100194 (0.0006) [2023-12-26 08:22:34,490][123091] Updated weights for policy 0, policy_version 1100204 (0.0006) [2023-12-26 08:22:34,550][123090] Updated weights for policy 1, policy_version 1092425 (0.0009) [2023-12-26 08:22:34,609][123090] Updated weights for policy 1, policy_version 1092435 (0.0010) [2023-12-26 08:22:34,663][123090] Updated weights for policy 1, policy_version 1092445 (0.0010) [2023-12-26 08:22:35,283][123091] Updated weights for policy 0, policy_version 1100214 (0.0008) [2023-12-26 08:22:35,332][123091] Updated weights for policy 0, policy_version 1100224 (0.0009) [2023-12-26 08:22:35,394][123091] Updated weights for policy 0, policy_version 1100234 (0.0010) [2023-12-26 08:22:35,495][123090] Updated weights for policy 1, policy_version 1092455 (0.0006) [2023-12-26 08:22:35,564][123090] Updated weights for policy 1, policy_version 1092465 (0.0007) [2023-12-26 08:22:35,626][123090] Updated weights for policy 1, policy_version 1092475 (0.0010) [2023-12-26 08:22:36,208][123091] Updated weights for policy 0, policy_version 1100244 (0.0010) [2023-12-26 08:22:36,263][123091] Updated weights for policy 0, policy_version 1100254 (0.0009) [2023-12-26 08:22:36,318][123091] Updated weights for policy 0, policy_version 1100264 (0.0010) [2023-12-26 08:22:36,389][123090] Updated weights for policy 1, policy_version 1092485 (0.0010) [2023-12-26 08:22:36,458][123090] Updated weights for policy 1, policy_version 1092495 (0.0009) [2023-12-26 08:22:36,522][123090] Updated weights for policy 1, policy_version 1092505 (0.0009) [2023-12-26 08:22:37,156][123091] Updated weights for policy 0, policy_version 1100274 (0.0010) [2023-12-26 08:22:37,217][123091] Updated weights for policy 0, policy_version 1100284 (0.0009) [2023-12-26 08:22:37,267][123091] Updated weights for policy 0, policy_version 1100294 (0.0009) [2023-12-26 08:22:37,314][123091] Updated weights for policy 0, policy_version 1100304 (0.0007) [2023-12-26 08:22:37,361][123090] Updated weights for policy 1, policy_version 1092515 (0.0010) [2023-12-26 08:22:37,429][123090] Updated weights for policy 1, policy_version 1092525 (0.0010) [2023-12-26 08:22:37,493][123090] Updated weights for policy 1, policy_version 1092536 (0.0010) [2023-12-26 08:22:38,126][123091] Updated weights for policy 0, policy_version 1100314 (0.0006) [2023-12-26 08:22:38,180][123091] Updated weights for policy 0, policy_version 1100324 (0.0008) [2023-12-26 08:22:38,235][123091] Updated weights for policy 0, policy_version 1100334 (0.0008) [2023-12-26 08:22:38,369][123090] Updated weights for policy 1, policy_version 1092546 (0.0009) [2023-12-26 08:22:38,435][123090] Updated weights for policy 1, policy_version 1092556 (0.0009) [2023-12-26 08:22:38,491][123090] Updated weights for policy 1, policy_version 1092566 (0.0009) [2023-12-26 08:22:38,555][123090] Updated weights for policy 1, policy_version 1092576 (0.0009) [2023-12-26 08:22:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 561389568. Throughput: 0: 8874.9, 1: 8877.9. Samples: 561366208. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:38,785][121949] Avg episode reward: [(0, '6160.937'), (1, '5854.289')] [2023-12-26 08:22:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001100336_281690112.pth... [2023-12-26 08:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001092576_279699456.pth... [2023-12-26 08:22:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001091552_279437312.pth [2023-12-26 08:22:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001099312_281427968.pth [2023-12-26 08:22:38,994][123091] Updated weights for policy 0, policy_version 1100344 (0.0005) [2023-12-26 08:22:39,070][123091] Updated weights for policy 0, policy_version 1100354 (0.0006) [2023-12-26 08:22:39,133][123091] Updated weights for policy 0, policy_version 1100364 (0.0009) [2023-12-26 08:22:39,443][123090] Updated weights for policy 1, policy_version 1092586 (0.0008) [2023-12-26 08:22:39,510][123090] Updated weights for policy 1, policy_version 1092596 (0.0006) [2023-12-26 08:22:39,579][123090] Updated weights for policy 1, policy_version 1092606 (0.0006) [2023-12-26 08:22:39,993][123091] Updated weights for policy 0, policy_version 1100374 (0.0009) [2023-12-26 08:22:40,057][123091] Updated weights for policy 0, policy_version 1100384 (0.0008) [2023-12-26 08:22:40,119][123091] Updated weights for policy 0, policy_version 1100394 (0.0006) [2023-12-26 08:22:40,338][123090] Updated weights for policy 1, policy_version 1092616 (0.0009) [2023-12-26 08:22:40,399][123090] Updated weights for policy 1, policy_version 1092626 (0.0011) [2023-12-26 08:22:40,455][123090] Updated weights for policy 1, policy_version 1092636 (0.0011) [2023-12-26 08:22:40,874][123091] Updated weights for policy 0, policy_version 1100404 (0.0006) [2023-12-26 08:22:40,943][123091] Updated weights for policy 0, policy_version 1100414 (0.0006) [2023-12-26 08:22:41,015][123091] Updated weights for policy 0, policy_version 1100424 (0.0007) [2023-12-26 08:22:41,355][123090] Updated weights for policy 1, policy_version 1092646 (0.0008) [2023-12-26 08:22:41,430][123090] Updated weights for policy 1, policy_version 1092656 (0.0007) [2023-12-26 08:22:41,497][123090] Updated weights for policy 1, policy_version 1092666 (0.0006) [2023-12-26 08:22:41,878][123091] Updated weights for policy 0, policy_version 1100434 (0.0008) [2023-12-26 08:22:41,944][123091] Updated weights for policy 0, policy_version 1100444 (0.0009) [2023-12-26 08:22:42,013][123091] Updated weights for policy 0, policy_version 1100454 (0.0006) [2023-12-26 08:22:42,084][123091] Updated weights for policy 0, policy_version 1100464 (0.0006) [2023-12-26 08:22:42,281][123090] Updated weights for policy 1, policy_version 1092676 (0.0008) [2023-12-26 08:22:42,350][123090] Updated weights for policy 1, policy_version 1092686 (0.0008) [2023-12-26 08:22:42,419][123090] Updated weights for policy 1, policy_version 1092696 (0.0007) [2023-12-26 08:22:42,804][123091] Updated weights for policy 0, policy_version 1100474 (0.0009) [2023-12-26 08:22:42,862][123091] Updated weights for policy 0, policy_version 1100485 (0.0010) [2023-12-26 08:22:42,924][123091] Updated weights for policy 0, policy_version 1100496 (0.0010) [2023-12-26 08:22:43,110][123090] Updated weights for policy 1, policy_version 1092706 (0.0006) [2023-12-26 08:22:43,172][123090] Updated weights for policy 1, policy_version 1092716 (0.0006) [2023-12-26 08:22:43,222][123090] Updated weights for policy 1, policy_version 1092726 (0.0010) [2023-12-26 08:22:43,265][123090] Updated weights for policy 1, policy_version 1092736 (0.0010) [2023-12-26 08:22:43,666][123091] Updated weights for policy 0, policy_version 1100506 (0.0006) [2023-12-26 08:22:43,736][123091] Updated weights for policy 0, policy_version 1100516 (0.0005) [2023-12-26 08:22:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 561471488. Throughput: 0: 8875.5, 1: 8860.2. Samples: 561470280. Policy #0 lag: (min: 5.0, avg: 10.6, max: 37.0) [2023-12-26 08:22:43,785][121949] Avg episode reward: [(0, '6113.589'), (1, '5879.479')] [2023-12-26 08:22:43,797][123091] Updated weights for policy 0, policy_version 1100526 (0.0007) [2023-12-26 08:22:44,083][123090] Updated weights for policy 1, policy_version 1092746 (0.0010) [2023-12-26 08:22:44,139][123090] Updated weights for policy 1, policy_version 1092756 (0.0010) [2023-12-26 08:22:44,195][123090] Updated weights for policy 1, policy_version 1092766 (0.0010) [2023-12-26 08:22:44,572][123091] Updated weights for policy 0, policy_version 1100536 (0.0009) [2023-12-26 08:22:44,624][123091] Updated weights for policy 0, policy_version 1100546 (0.0008) [2023-12-26 08:22:44,672][123091] Updated weights for policy 0, policy_version 1100556 (0.0009) [2023-12-26 08:22:45,035][123090] Updated weights for policy 1, policy_version 1092776 (0.0010) [2023-12-26 08:22:45,098][123090] Updated weights for policy 1, policy_version 1092786 (0.0010) [2023-12-26 08:22:45,169][123090] Updated weights for policy 1, policy_version 1092796 (0.0011) [2023-12-26 08:22:45,541][123091] Updated weights for policy 0, policy_version 1100566 (0.0009) [2023-12-26 08:22:45,612][123091] Updated weights for policy 0, policy_version 1100576 (0.0009) [2023-12-26 08:22:45,665][123091] Updated weights for policy 0, policy_version 1100586 (0.0009) [2023-12-26 08:22:45,991][123090] Updated weights for policy 1, policy_version 1092806 (0.0011) [2023-12-26 08:22:46,052][123090] Updated weights for policy 1, policy_version 1092816 (0.0011) [2023-12-26 08:22:46,123][123090] Updated weights for policy 1, policy_version 1092826 (0.0011) [2023-12-26 08:22:46,492][123091] Updated weights for policy 0, policy_version 1100596 (0.0009) [2023-12-26 08:22:46,541][123091] Updated weights for policy 0, policy_version 1100606 (0.0009) [2023-12-26 08:22:46,596][123091] Updated weights for policy 0, policy_version 1100616 (0.0009) [2023-12-26 08:22:46,936][123090] Updated weights for policy 1, policy_version 1092836 (0.0010) [2023-12-26 08:22:46,994][123090] Updated weights for policy 1, policy_version 1092846 (0.0010) [2023-12-26 08:22:47,056][123090] Updated weights for policy 1, policy_version 1092856 (0.0010) [2023-12-26 08:22:47,446][123091] Updated weights for policy 0, policy_version 1100626 (0.0008) [2023-12-26 08:22:47,506][123091] Updated weights for policy 0, policy_version 1100636 (0.0009) [2023-12-26 08:22:47,569][123091] Updated weights for policy 0, policy_version 1100646 (0.0008) [2023-12-26 08:22:47,616][123091] Updated weights for policy 0, policy_version 1100656 (0.0008) [2023-12-26 08:22:47,887][123090] Updated weights for policy 1, policy_version 1092866 (0.0010) [2023-12-26 08:22:47,942][123090] Updated weights for policy 1, policy_version 1092876 (0.0010) [2023-12-26 08:22:47,989][123090] Updated weights for policy 1, policy_version 1092886 (0.0010) [2023-12-26 08:22:48,044][123090] Updated weights for policy 1, policy_version 1092896 (0.0010) [2023-12-26 08:22:48,440][123091] Updated weights for policy 0, policy_version 1100666 (0.0009) [2023-12-26 08:22:48,507][123091] Updated weights for policy 0, policy_version 1100676 (0.0008) [2023-12-26 08:22:48,567][123091] Updated weights for policy 0, policy_version 1100686 (0.0009) [2023-12-26 08:22:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 561561600. Throughput: 0: 8904.6, 1: 8792.7. Samples: 561574240. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:22:48,784][121949] Avg episode reward: [(0, '6150.833'), (1, '5918.266')] [2023-12-26 08:22:48,884][123090] Updated weights for policy 1, policy_version 1092906 (0.0010) [2023-12-26 08:22:48,936][123090] Updated weights for policy 1, policy_version 1092916 (0.0010) [2023-12-26 08:22:48,995][123090] Updated weights for policy 1, policy_version 1092926 (0.0008) [2023-12-26 08:22:49,416][123091] Updated weights for policy 0, policy_version 1100696 (0.0008) [2023-12-26 08:22:49,489][123091] Updated weights for policy 0, policy_version 1100706 (0.0006) [2023-12-26 08:22:49,567][123091] Updated weights for policy 0, policy_version 1100716 (0.0008) [2023-12-26 08:22:49,813][123090] Updated weights for policy 1, policy_version 1092936 (0.0009) [2023-12-26 08:22:49,875][123090] Updated weights for policy 1, policy_version 1092946 (0.0009) [2023-12-26 08:22:49,932][123090] Updated weights for policy 1, policy_version 1092956 (0.0010) [2023-12-26 08:22:50,359][123091] Updated weights for policy 0, policy_version 1100726 (0.0009) [2023-12-26 08:22:50,420][123091] Updated weights for policy 0, policy_version 1100736 (0.0008) [2023-12-26 08:22:50,479][123091] Updated weights for policy 0, policy_version 1100746 (0.0009) [2023-12-26 08:22:50,778][123090] Updated weights for policy 1, policy_version 1092966 (0.0010) [2023-12-26 08:22:50,838][123090] Updated weights for policy 1, policy_version 1092976 (0.0010) [2023-12-26 08:22:50,895][123090] Updated weights for policy 1, policy_version 1092986 (0.0009) [2023-12-26 08:22:51,350][123091] Updated weights for policy 0, policy_version 1100756 (0.0010) [2023-12-26 08:22:51,424][123091] Updated weights for policy 0, policy_version 1100766 (0.0007) [2023-12-26 08:22:51,475][123091] Updated weights for policy 0, policy_version 1100776 (0.0010) [2023-12-26 08:22:51,775][123090] Updated weights for policy 1, policy_version 1092996 (0.0008) [2023-12-26 08:22:51,846][123090] Updated weights for policy 1, policy_version 1093006 (0.0008) [2023-12-26 08:22:51,905][123090] Updated weights for policy 1, policy_version 1093016 (0.0008) [2023-12-26 08:22:52,332][123091] Updated weights for policy 0, policy_version 1100786 (0.0010) [2023-12-26 08:22:52,403][123091] Updated weights for policy 0, policy_version 1100796 (0.0009) [2023-12-26 08:22:52,460][123091] Updated weights for policy 0, policy_version 1100806 (0.0008) [2023-12-26 08:22:52,531][123091] Updated weights for policy 0, policy_version 1100816 (0.0006) [2023-12-26 08:22:52,672][123090] Updated weights for policy 1, policy_version 1093026 (0.0009) [2023-12-26 08:22:52,732][123090] Updated weights for policy 1, policy_version 1093036 (0.0008) [2023-12-26 08:22:52,804][123090] Updated weights for policy 1, policy_version 1093046 (0.0008) [2023-12-26 08:22:52,866][123090] Updated weights for policy 1, policy_version 1093056 (0.0008) [2023-12-26 08:22:53,270][123091] Updated weights for policy 0, policy_version 1100826 (0.0009) [2023-12-26 08:22:53,317][123091] Updated weights for policy 0, policy_version 1100836 (0.0009) [2023-12-26 08:22:53,368][123091] Updated weights for policy 0, policy_version 1100846 (0.0009) [2023-12-26 08:22:53,615][123090] Updated weights for policy 1, policy_version 1093066 (0.0010) [2023-12-26 08:22:53,662][123090] Updated weights for policy 1, policy_version 1093076 (0.0006) [2023-12-26 08:22:53,713][123090] Updated weights for policy 1, policy_version 1093086 (0.0005) [2023-12-26 08:22:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 561651712. Throughput: 0: 8863.3, 1: 8711.1. Samples: 561624832. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:22:53,785][121949] Avg episode reward: [(0, '6063.946'), (1, '5875.058')] [2023-12-26 08:22:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001100848_281821184.pth... [2023-12-26 08:22:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001093088_279830528.pth... [2023-12-26 08:22:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001099792_281550848.pth [2023-12-26 08:22:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001092064_279568384.pth [2023-12-26 08:22:54,259][123091] Updated weights for policy 0, policy_version 1100856 (0.0010) [2023-12-26 08:22:54,313][123091] Updated weights for policy 0, policy_version 1100866 (0.0008) [2023-12-26 08:22:54,356][123090] Updated weights for policy 1, policy_version 1093096 (0.0009) [2023-12-26 08:22:54,359][123091] Updated weights for policy 0, policy_version 1100876 (0.0008) [2023-12-26 08:22:54,422][123090] Updated weights for policy 1, policy_version 1093106 (0.0010) [2023-12-26 08:22:54,494][123090] Updated weights for policy 1, policy_version 1093116 (0.0007) [2023-12-26 08:22:55,047][123091] Updated weights for policy 0, policy_version 1100886 (0.0006) [2023-12-26 08:22:55,104][123091] Updated weights for policy 0, policy_version 1100896 (0.0005) [2023-12-26 08:22:55,183][123091] Updated weights for policy 0, policy_version 1100906 (0.0006) [2023-12-26 08:22:55,219][123090] Updated weights for policy 1, policy_version 1093126 (0.0007) [2023-12-26 08:22:55,288][123090] Updated weights for policy 1, policy_version 1093136 (0.0006) [2023-12-26 08:22:55,355][123090] Updated weights for policy 1, policy_version 1093146 (0.0005) [2023-12-26 08:22:55,949][123091] Updated weights for policy 0, policy_version 1100916 (0.0007) [2023-12-26 08:22:55,999][123091] Updated weights for policy 0, policy_version 1100926 (0.0005) [2023-12-26 08:22:56,019][123090] Updated weights for policy 1, policy_version 1093156 (0.0006) [2023-12-26 08:22:56,056][123091] Updated weights for policy 0, policy_version 1100936 (0.0005) [2023-12-26 08:22:56,071][123090] Updated weights for policy 1, policy_version 1093166 (0.0008) [2023-12-26 08:22:56,125][123090] Updated weights for policy 1, policy_version 1093176 (0.0010) [2023-12-26 08:22:56,879][123091] Updated weights for policy 0, policy_version 1100946 (0.0010) [2023-12-26 08:22:56,921][123090] Updated weights for policy 1, policy_version 1093186 (0.0009) [2023-12-26 08:22:56,938][123091] Updated weights for policy 0, policy_version 1100956 (0.0010) [2023-12-26 08:22:56,973][123090] Updated weights for policy 1, policy_version 1093196 (0.0008) [2023-12-26 08:22:56,997][123091] Updated weights for policy 0, policy_version 1100966 (0.0007) [2023-12-26 08:22:57,026][123090] Updated weights for policy 1, policy_version 1093206 (0.0009) [2023-12-26 08:22:57,055][123091] Updated weights for policy 0, policy_version 1100976 (0.0009) [2023-12-26 08:22:57,090][123090] Updated weights for policy 1, policy_version 1093216 (0.0008) [2023-12-26 08:22:57,745][123091] Updated weights for policy 0, policy_version 1100986 (0.0005) [2023-12-26 08:22:57,792][123091] Updated weights for policy 0, policy_version 1100996 (0.0005) [2023-12-26 08:22:57,836][123090] Updated weights for policy 1, policy_version 1093226 (0.0005) [2023-12-26 08:22:57,841][123091] Updated weights for policy 0, policy_version 1101006 (0.0005) [2023-12-26 08:22:57,883][123090] Updated weights for policy 1, policy_version 1093236 (0.0005) [2023-12-26 08:22:57,928][123090] Updated weights for policy 1, policy_version 1093246 (0.0005) [2023-12-26 08:22:58,647][123091] Updated weights for policy 0, policy_version 1101016 (0.0009) [2023-12-26 08:22:58,699][123090] Updated weights for policy 1, policy_version 1093256 (0.0009) [2023-12-26 08:22:58,708][123091] Updated weights for policy 0, policy_version 1101026 (0.0008) [2023-12-26 08:22:58,765][123090] Updated weights for policy 1, policy_version 1093266 (0.0007) [2023-12-26 08:22:58,775][123091] Updated weights for policy 0, policy_version 1101036 (0.0009) [2023-12-26 08:22:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 561733632. Throughput: 0: 8906.3, 1: 8813.0. Samples: 561735028. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:22:58,785][121949] Avg episode reward: [(0, '6002.458'), (1, '5792.284')] [2023-12-26 08:22:58,838][123090] Updated weights for policy 1, policy_version 1093276 (0.0006) [2023-12-26 08:22:59,625][123091] Updated weights for policy 0, policy_version 1101046 (0.0008) [2023-12-26 08:22:59,625][123090] Updated weights for policy 1, policy_version 1093286 (0.0008) [2023-12-26 08:22:59,675][123091] Updated weights for policy 0, policy_version 1101056 (0.0007) [2023-12-26 08:22:59,689][123090] Updated weights for policy 1, policy_version 1093296 (0.0010) [2023-12-26 08:22:59,722][123091] Updated weights for policy 0, policy_version 1101066 (0.0007) [2023-12-26 08:22:59,751][123090] Updated weights for policy 1, policy_version 1093306 (0.0010) [2023-12-26 08:23:00,538][123091] Updated weights for policy 0, policy_version 1101076 (0.0008) [2023-12-26 08:23:00,593][123090] Updated weights for policy 1, policy_version 1093316 (0.0010) [2023-12-26 08:23:00,604][123091] Updated weights for policy 0, policy_version 1101086 (0.0008) [2023-12-26 08:23:00,654][123090] Updated weights for policy 1, policy_version 1093326 (0.0007) [2023-12-26 08:23:00,661][123091] Updated weights for policy 0, policy_version 1101096 (0.0009) [2023-12-26 08:23:00,721][123090] Updated weights for policy 1, policy_version 1093336 (0.0009) [2023-12-26 08:23:01,462][123091] Updated weights for policy 0, policy_version 1101106 (0.0009) [2023-12-26 08:23:01,514][123091] Updated weights for policy 0, policy_version 1101116 (0.0009) [2023-12-26 08:23:01,516][123090] Updated weights for policy 1, policy_version 1093346 (0.0010) [2023-12-26 08:23:01,566][123091] Updated weights for policy 0, policy_version 1101126 (0.0006) [2023-12-26 08:23:01,576][123090] Updated weights for policy 1, policy_version 1093356 (0.0011) [2023-12-26 08:23:01,636][123091] Updated weights for policy 0, policy_version 1101136 (0.0007) [2023-12-26 08:23:01,645][123090] Updated weights for policy 1, policy_version 1093366 (0.0009) [2023-12-26 08:23:01,722][123090] Updated weights for policy 1, policy_version 1093376 (0.0008) [2023-12-26 08:23:02,508][123091] Updated weights for policy 0, policy_version 1101146 (0.0009) [2023-12-26 08:23:02,528][123090] Updated weights for policy 1, policy_version 1093386 (0.0005) [2023-12-26 08:23:02,566][123091] Updated weights for policy 0, policy_version 1101156 (0.0008) [2023-12-26 08:23:02,584][123090] Updated weights for policy 1, policy_version 1093396 (0.0005) [2023-12-26 08:23:02,615][123091] Updated weights for policy 0, policy_version 1101166 (0.0009) [2023-12-26 08:23:02,651][123090] Updated weights for policy 1, policy_version 1093406 (0.0006) [2023-12-26 08:23:03,401][123091] Updated weights for policy 0, policy_version 1101176 (0.0009) [2023-12-26 08:23:03,419][123090] Updated weights for policy 1, policy_version 1093416 (0.0010) [2023-12-26 08:23:03,452][123091] Updated weights for policy 0, policy_version 1101186 (0.0006) [2023-12-26 08:23:03,472][123090] Updated weights for policy 1, policy_version 1093426 (0.0009) [2023-12-26 08:23:03,504][123091] Updated weights for policy 0, policy_version 1101196 (0.0008) [2023-12-26 08:23:03,524][123090] Updated weights for policy 1, policy_version 1093436 (0.0005) [2023-12-26 08:23:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 561831936. Throughput: 0: 8861.0, 1: 8783.6. Samples: 561840144. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:03,784][121949] Avg episode reward: [(0, '6179.643'), (1, '5820.598')] [2023-12-26 08:23:04,306][123090] Updated weights for policy 1, policy_version 1093446 (0.0008) [2023-12-26 08:23:04,369][123090] Updated weights for policy 1, policy_version 1093456 (0.0008) [2023-12-26 08:23:04,375][123091] Updated weights for policy 0, policy_version 1101206 (0.0010) [2023-12-26 08:23:04,429][123090] Updated weights for policy 1, policy_version 1093466 (0.0007) [2023-12-26 08:23:04,437][123091] Updated weights for policy 0, policy_version 1101216 (0.0009) [2023-12-26 08:23:04,504][123091] Updated weights for policy 0, policy_version 1101226 (0.0008) [2023-12-26 08:23:05,283][123090] Updated weights for policy 1, policy_version 1093476 (0.0008) [2023-12-26 08:23:05,313][123091] Updated weights for policy 0, policy_version 1101236 (0.0008) [2023-12-26 08:23:05,343][123090] Updated weights for policy 1, policy_version 1093486 (0.0006) [2023-12-26 08:23:05,375][123091] Updated weights for policy 0, policy_version 1101246 (0.0008) [2023-12-26 08:23:05,403][123090] Updated weights for policy 1, policy_version 1093496 (0.0006) [2023-12-26 08:23:05,424][123091] Updated weights for policy 0, policy_version 1101256 (0.0009) [2023-12-26 08:23:06,110][123090] Updated weights for policy 1, policy_version 1093506 (0.0007) [2023-12-26 08:23:06,176][123090] Updated weights for policy 1, policy_version 1093516 (0.0006) [2023-12-26 08:23:06,240][123090] Updated weights for policy 1, policy_version 1093526 (0.0010) [2023-12-26 08:23:06,260][123091] Updated weights for policy 0, policy_version 1101266 (0.0010) [2023-12-26 08:23:06,302][123090] Updated weights for policy 1, policy_version 1093536 (0.0007) [2023-12-26 08:23:06,326][123091] Updated weights for policy 0, policy_version 1101276 (0.0010) [2023-12-26 08:23:06,397][123091] Updated weights for policy 0, policy_version 1101286 (0.0007) [2023-12-26 08:23:06,467][123091] Updated weights for policy 0, policy_version 1101296 (0.0006) [2023-12-26 08:23:07,131][123090] Updated weights for policy 1, policy_version 1093546 (0.0009) [2023-12-26 08:23:07,175][123091] Updated weights for policy 0, policy_version 1101306 (0.0005) [2023-12-26 08:23:07,182][123090] Updated weights for policy 1, policy_version 1093556 (0.0009) [2023-12-26 08:23:07,228][123091] Updated weights for policy 0, policy_version 1101316 (0.0005) [2023-12-26 08:23:07,231][123090] Updated weights for policy 1, policy_version 1093566 (0.0009) [2023-12-26 08:23:07,284][123091] Updated weights for policy 0, policy_version 1101326 (0.0006) [2023-12-26 08:23:08,029][123091] Updated weights for policy 0, policy_version 1101336 (0.0009) [2023-12-26 08:23:08,091][123091] Updated weights for policy 0, policy_version 1101346 (0.0009) [2023-12-26 08:23:08,139][123090] Updated weights for policy 1, policy_version 1093576 (0.0006) [2023-12-26 08:23:08,154][123091] Updated weights for policy 0, policy_version 1101356 (0.0008) [2023-12-26 08:23:08,197][123090] Updated weights for policy 1, policy_version 1093586 (0.0010) [2023-12-26 08:23:08,267][123090] Updated weights for policy 1, policy_version 1093596 (0.0010) [2023-12-26 08:23:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 561913856. Throughput: 0: 8888.1, 1: 8813.5. Samples: 561892924. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:08,785][121949] Avg episode reward: [(0, '6096.256'), (1, '5941.071')] [2023-12-26 08:23:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001101360_281952256.pth... [2023-12-26 08:23:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001093600_279961600.pth... [2023-12-26 08:23:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001100336_281690112.pth [2023-12-26 08:23:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001092576_279699456.pth [2023-12-26 08:23:08,998][123091] Updated weights for policy 0, policy_version 1101366 (0.0007) [2023-12-26 08:23:09,041][123090] Updated weights for policy 1, policy_version 1093606 (0.0010) [2023-12-26 08:23:09,052][123091] Updated weights for policy 0, policy_version 1101376 (0.0007) [2023-12-26 08:23:09,099][123090] Updated weights for policy 1, policy_version 1093616 (0.0010) [2023-12-26 08:23:09,110][123091] Updated weights for policy 0, policy_version 1101386 (0.0006) [2023-12-26 08:23:09,162][123090] Updated weights for policy 1, policy_version 1093626 (0.0010) [2023-12-26 08:23:09,967][123090] Updated weights for policy 1, policy_version 1093636 (0.0011) [2023-12-26 08:23:09,972][123091] Updated weights for policy 0, policy_version 1101396 (0.0005) [2023-12-26 08:23:10,035][123090] Updated weights for policy 1, policy_version 1093646 (0.0011) [2023-12-26 08:23:10,039][123091] Updated weights for policy 0, policy_version 1101406 (0.0007) [2023-12-26 08:23:10,092][123090] Updated weights for policy 1, policy_version 1093656 (0.0011) [2023-12-26 08:23:10,106][123091] Updated weights for policy 0, policy_version 1101416 (0.0006) [2023-12-26 08:23:10,827][123091] Updated weights for policy 0, policy_version 1101426 (0.0006) [2023-12-26 08:23:10,884][123091] Updated weights for policy 0, policy_version 1101436 (0.0008) [2023-12-26 08:23:10,927][123090] Updated weights for policy 1, policy_version 1093666 (0.0010) [2023-12-26 08:23:10,942][123091] Updated weights for policy 0, policy_version 1101446 (0.0008) [2023-12-26 08:23:10,987][123090] Updated weights for policy 1, policy_version 1093676 (0.0011) [2023-12-26 08:23:10,999][123091] Updated weights for policy 0, policy_version 1101456 (0.0008) [2023-12-26 08:23:11,052][123090] Updated weights for policy 1, policy_version 1093686 (0.0010) [2023-12-26 08:23:11,120][123090] Updated weights for policy 1, policy_version 1093696 (0.0011) [2023-12-26 08:23:11,805][123091] Updated weights for policy 0, policy_version 1101466 (0.0006) [2023-12-26 08:23:11,861][123091] Updated weights for policy 0, policy_version 1101476 (0.0010) [2023-12-26 08:23:11,921][123091] Updated weights for policy 0, policy_version 1101486 (0.0010) [2023-12-26 08:23:12,011][123090] Updated weights for policy 1, policy_version 1093706 (0.0010) [2023-12-26 08:23:12,080][123090] Updated weights for policy 1, policy_version 1093716 (0.0010) [2023-12-26 08:23:12,143][123090] Updated weights for policy 1, policy_version 1093726 (0.0010) [2023-12-26 08:23:12,642][123091] Updated weights for policy 0, policy_version 1101496 (0.0009) [2023-12-26 08:23:12,689][123091] Updated weights for policy 0, policy_version 1101506 (0.0007) [2023-12-26 08:23:12,735][123091] Updated weights for policy 0, policy_version 1101516 (0.0005) [2023-12-26 08:23:12,994][123090] Updated weights for policy 1, policy_version 1093736 (0.0008) [2023-12-26 08:23:13,065][123090] Updated weights for policy 1, policy_version 1093746 (0.0006) [2023-12-26 08:23:13,138][123090] Updated weights for policy 1, policy_version 1093756 (0.0006) [2023-12-26 08:23:13,448][123091] Updated weights for policy 0, policy_version 1101526 (0.0008) [2023-12-26 08:23:13,503][123091] Updated weights for policy 0, policy_version 1101537 (0.0011) [2023-12-26 08:23:13,555][123091] Updated weights for policy 0, policy_version 1101548 (0.0010) [2023-12-26 08:23:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 562003968. Throughput: 0: 8812.9, 1: 8724.4. Samples: 561996160. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:13,784][121949] Avg episode reward: [(0, '5904.908'), (1, '5962.925')] [2023-12-26 08:23:13,862][123090] Updated weights for policy 1, policy_version 1093766 (0.0009) [2023-12-26 08:23:13,912][123090] Updated weights for policy 1, policy_version 1093776 (0.0009) [2023-12-26 08:23:13,979][123090] Updated weights for policy 1, policy_version 1093786 (0.0009) [2023-12-26 08:23:14,399][123091] Updated weights for policy 0, policy_version 1101558 (0.0007) [2023-12-26 08:23:14,445][123091] Updated weights for policy 0, policy_version 1101568 (0.0005) [2023-12-26 08:23:14,491][123091] Updated weights for policy 0, policy_version 1101578 (0.0005) [2023-12-26 08:23:14,838][123090] Updated weights for policy 1, policy_version 1093796 (0.0008) [2023-12-26 08:23:14,906][123090] Updated weights for policy 1, policy_version 1093806 (0.0007) [2023-12-26 08:23:14,959][123090] Updated weights for policy 1, policy_version 1093816 (0.0006) [2023-12-26 08:23:15,298][123091] Updated weights for policy 0, policy_version 1101588 (0.0007) [2023-12-26 08:23:15,363][123091] Updated weights for policy 0, policy_version 1101598 (0.0005) [2023-12-26 08:23:15,436][123091] Updated weights for policy 0, policy_version 1101608 (0.0005) [2023-12-26 08:23:15,676][123090] Updated weights for policy 1, policy_version 1093826 (0.0007) [2023-12-26 08:23:15,728][123090] Updated weights for policy 1, policy_version 1093836 (0.0010) [2023-12-26 08:23:15,787][123090] Updated weights for policy 1, policy_version 1093846 (0.0010) [2023-12-26 08:23:15,849][123090] Updated weights for policy 1, policy_version 1093856 (0.0011) [2023-12-26 08:23:16,167][123091] Updated weights for policy 0, policy_version 1101618 (0.0007) [2023-12-26 08:23:16,230][123091] Updated weights for policy 0, policy_version 1101628 (0.0011) [2023-12-26 08:23:16,290][123091] Updated weights for policy 0, policy_version 1101638 (0.0010) [2023-12-26 08:23:16,360][123091] Updated weights for policy 0, policy_version 1101648 (0.0011) [2023-12-26 08:23:16,631][123090] Updated weights for policy 1, policy_version 1093866 (0.0010) [2023-12-26 08:23:16,691][123090] Updated weights for policy 1, policy_version 1093876 (0.0010) [2023-12-26 08:23:16,751][123090] Updated weights for policy 1, policy_version 1093886 (0.0011) [2023-12-26 08:23:17,189][123091] Updated weights for policy 0, policy_version 1101658 (0.0011) [2023-12-26 08:23:17,244][123091] Updated weights for policy 0, policy_version 1101668 (0.0011) [2023-12-26 08:23:17,296][123091] Updated weights for policy 0, policy_version 1101678 (0.0011) [2023-12-26 08:23:17,428][123090] Updated weights for policy 1, policy_version 1093896 (0.0007) [2023-12-26 08:23:17,502][123090] Updated weights for policy 1, policy_version 1093906 (0.0006) [2023-12-26 08:23:17,561][123090] Updated weights for policy 1, policy_version 1093916 (0.0010) [2023-12-26 08:23:18,125][123091] Updated weights for policy 0, policy_version 1101688 (0.0010) [2023-12-26 08:23:18,172][123091] Updated weights for policy 0, policy_version 1101698 (0.0010) [2023-12-26 08:23:18,200][123090] Updated weights for policy 1, policy_version 1093926 (0.0007) [2023-12-26 08:23:18,220][123091] Updated weights for policy 0, policy_version 1101708 (0.0010) [2023-12-26 08:23:18,262][123090] Updated weights for policy 1, policy_version 1093936 (0.0010) [2023-12-26 08:23:18,325][123090] Updated weights for policy 1, policy_version 1093946 (0.0010) [2023-12-26 08:23:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 562094080. Throughput: 0: 8825.3, 1: 8788.4. Samples: 562105912. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:18,785][121949] Avg episode reward: [(0, '5986.125'), (1, '5858.542')] [2023-12-26 08:23:18,976][123091] Updated weights for policy 0, policy_version 1101718 (0.0007) [2023-12-26 08:23:19,022][123091] Updated weights for policy 0, policy_version 1101728 (0.0005) [2023-12-26 08:23:19,074][123091] Updated weights for policy 0, policy_version 1101738 (0.0006) [2023-12-26 08:23:19,099][123090] Updated weights for policy 1, policy_version 1093956 (0.0008) [2023-12-26 08:23:19,146][123090] Updated weights for policy 1, policy_version 1093966 (0.0005) [2023-12-26 08:23:19,193][123090] Updated weights for policy 1, policy_version 1093976 (0.0005) [2023-12-26 08:23:19,896][123091] Updated weights for policy 0, policy_version 1101748 (0.0007) [2023-12-26 08:23:19,957][123091] Updated weights for policy 0, policy_version 1101758 (0.0008) [2023-12-26 08:23:20,013][123091] Updated weights for policy 0, policy_version 1101768 (0.0009) [2023-12-26 08:23:20,063][123090] Updated weights for policy 1, policy_version 1093986 (0.0010) [2023-12-26 08:23:20,118][123090] Updated weights for policy 1, policy_version 1093996 (0.0006) [2023-12-26 08:23:20,178][123090] Updated weights for policy 1, policy_version 1094006 (0.0007) [2023-12-26 08:23:20,234][123090] Updated weights for policy 1, policy_version 1094016 (0.0010) [2023-12-26 08:23:20,695][123091] Updated weights for policy 0, policy_version 1101778 (0.0008) [2023-12-26 08:23:20,751][123091] Updated weights for policy 0, policy_version 1101788 (0.0009) [2023-12-26 08:23:20,822][123091] Updated weights for policy 0, policy_version 1101798 (0.0009) [2023-12-26 08:23:20,896][123091] Updated weights for policy 0, policy_version 1101808 (0.0008) [2023-12-26 08:23:21,058][123090] Updated weights for policy 1, policy_version 1094026 (0.0011) [2023-12-26 08:23:21,134][123090] Updated weights for policy 1, policy_version 1094036 (0.0011) [2023-12-26 08:23:21,203][123090] Updated weights for policy 1, policy_version 1094046 (0.0011) [2023-12-26 08:23:21,774][123091] Updated weights for policy 0, policy_version 1101818 (0.0008) [2023-12-26 08:23:21,837][123091] Updated weights for policy 0, policy_version 1101828 (0.0009) [2023-12-26 08:23:21,893][123091] Updated weights for policy 0, policy_version 1101838 (0.0009) [2023-12-26 08:23:22,017][123090] Updated weights for policy 1, policy_version 1094056 (0.0008) [2023-12-26 08:23:22,081][123090] Updated weights for policy 1, policy_version 1094066 (0.0009) [2023-12-26 08:23:22,141][123090] Updated weights for policy 1, policy_version 1094076 (0.0007) [2023-12-26 08:23:22,767][123091] Updated weights for policy 0, policy_version 1101848 (0.0010) [2023-12-26 08:23:22,839][123091] Updated weights for policy 0, policy_version 1101858 (0.0010) [2023-12-26 08:23:22,907][123091] Updated weights for policy 0, policy_version 1101868 (0.0008) [2023-12-26 08:23:22,948][123090] Updated weights for policy 1, policy_version 1094086 (0.0008) [2023-12-26 08:23:23,010][123090] Updated weights for policy 1, policy_version 1094096 (0.0009) [2023-12-26 08:23:23,078][123090] Updated weights for policy 1, policy_version 1094106 (0.0010) [2023-12-26 08:23:23,738][123091] Updated weights for policy 0, policy_version 1101878 (0.0008) [2023-12-26 08:23:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 562176000. Throughput: 0: 8822.6, 1: 8802.2. Samples: 562159320. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:23,784][121949] Avg episode reward: [(0, '6076.611'), (1, '5800.288')] [2023-12-26 08:23:23,795][123091] Updated weights for policy 0, policy_version 1101888 (0.0006) [2023-12-26 08:23:23,823][123090] Updated weights for policy 1, policy_version 1094116 (0.0010) [2023-12-26 08:23:23,843][123091] Updated weights for policy 0, policy_version 1101898 (0.0007) [2023-12-26 08:23:23,872][123090] Updated weights for policy 1, policy_version 1094126 (0.0009) [2023-12-26 08:23:23,876][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001101904_282091520.pth... [2023-12-26 08:23:23,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001100848_281821184.pth [2023-12-26 08:23:23,927][123090] Updated weights for policy 1, policy_version 1094136 (0.0010) [2023-12-26 08:23:23,972][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001094144_280100864.pth... [2023-12-26 08:23:23,975][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001093088_279830528.pth [2023-12-26 08:23:24,566][123091] Updated weights for policy 0, policy_version 1101908 (0.0007) [2023-12-26 08:23:24,622][123091] Updated weights for policy 0, policy_version 1101918 (0.0006) [2023-12-26 08:23:24,633][123090] Updated weights for policy 1, policy_version 1094146 (0.0010) [2023-12-26 08:23:24,669][123091] Updated weights for policy 0, policy_version 1101928 (0.0005) [2023-12-26 08:23:24,680][123090] Updated weights for policy 1, policy_version 1094156 (0.0008) [2023-12-26 08:23:24,728][123090] Updated weights for policy 1, policy_version 1094166 (0.0005) [2023-12-26 08:23:24,780][123090] Updated weights for policy 1, policy_version 1094176 (0.0010) [2023-12-26 08:23:25,418][123091] Updated weights for policy 0, policy_version 1101938 (0.0005) [2023-12-26 08:23:25,472][123090] Updated weights for policy 1, policy_version 1094186 (0.0010) [2023-12-26 08:23:25,473][123091] Updated weights for policy 0, policy_version 1101948 (0.0005) [2023-12-26 08:23:25,523][123091] Updated weights for policy 0, policy_version 1101958 (0.0005) [2023-12-26 08:23:25,534][123090] Updated weights for policy 1, policy_version 1094196 (0.0010) [2023-12-26 08:23:25,575][123091] Updated weights for policy 0, policy_version 1101968 (0.0005) [2023-12-26 08:23:25,604][123090] Updated weights for policy 1, policy_version 1094206 (0.0010) [2023-12-26 08:23:26,255][123091] Updated weights for policy 0, policy_version 1101978 (0.0009) [2023-12-26 08:23:26,309][123091] Updated weights for policy 0, policy_version 1101988 (0.0009) [2023-12-26 08:23:26,353][123091] Updated weights for policy 0, policy_version 1101998 (0.0008) [2023-12-26 08:23:26,406][123090] Updated weights for policy 1, policy_version 1094216 (0.0010) [2023-12-26 08:23:26,473][123090] Updated weights for policy 1, policy_version 1094226 (0.0010) [2023-12-26 08:23:26,532][123090] Updated weights for policy 1, policy_version 1094236 (0.0010) [2023-12-26 08:23:27,119][123091] Updated weights for policy 0, policy_version 1102008 (0.0009) [2023-12-26 08:23:27,166][123091] Updated weights for policy 0, policy_version 1102018 (0.0010) [2023-12-26 08:23:27,209][123091] Updated weights for policy 0, policy_version 1102028 (0.0010) [2023-12-26 08:23:27,357][123090] Updated weights for policy 1, policy_version 1094246 (0.0010) [2023-12-26 08:23:27,422][123090] Updated weights for policy 1, policy_version 1094256 (0.0010) [2023-12-26 08:23:27,477][123090] Updated weights for policy 1, policy_version 1094266 (0.0010) [2023-12-26 08:23:27,924][123091] Updated weights for policy 0, policy_version 1102038 (0.0007) [2023-12-26 08:23:27,977][123091] Updated weights for policy 0, policy_version 1102048 (0.0005) [2023-12-26 08:23:28,033][123091] Updated weights for policy 0, policy_version 1102058 (0.0005) [2023-12-26 08:23:28,294][123090] Updated weights for policy 1, policy_version 1094276 (0.0010) [2023-12-26 08:23:28,354][123090] Updated weights for policy 1, policy_version 1094286 (0.0009) [2023-12-26 08:23:28,411][123090] Updated weights for policy 1, policy_version 1094296 (0.0006) [2023-12-26 08:23:28,642][123091] Updated weights for policy 0, policy_version 1102068 (0.0005) [2023-12-26 08:23:28,694][123091] Updated weights for policy 0, policy_version 1102078 (0.0005) [2023-12-26 08:23:28,747][123091] Updated weights for policy 0, policy_version 1102088 (0.0006) [2023-12-26 08:23:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 562282496. Throughput: 0: 8873.4, 1: 8888.1. Samples: 562269544. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:28,785][121949] Avg episode reward: [(0, '6181.832'), (1, '5785.752')] [2023-12-26 08:23:29,095][123090] Updated weights for policy 1, policy_version 1094306 (0.0005) [2023-12-26 08:23:29,143][123090] Updated weights for policy 1, policy_version 1094316 (0.0005) [2023-12-26 08:23:29,190][123090] Updated weights for policy 1, policy_version 1094326 (0.0005) [2023-12-26 08:23:29,260][123090] Updated weights for policy 1, policy_version 1094336 (0.0007) [2023-12-26 08:23:29,445][123091] Updated weights for policy 0, policy_version 1102098 (0.0006) [2023-12-26 08:23:29,501][123091] Updated weights for policy 0, policy_version 1102108 (0.0009) [2023-12-26 08:23:29,554][123091] Updated weights for policy 0, policy_version 1102118 (0.0009) [2023-12-26 08:23:29,613][123091] Updated weights for policy 0, policy_version 1102128 (0.0008) [2023-12-26 08:23:30,113][123090] Updated weights for policy 1, policy_version 1094346 (0.0011) [2023-12-26 08:23:30,168][123090] Updated weights for policy 1, policy_version 1094356 (0.0010) [2023-12-26 08:23:30,231][123090] Updated weights for policy 1, policy_version 1094366 (0.0010) [2023-12-26 08:23:30,390][123091] Updated weights for policy 0, policy_version 1102138 (0.0008) [2023-12-26 08:23:30,449][123091] Updated weights for policy 0, policy_version 1102148 (0.0009) [2023-12-26 08:23:30,492][123091] Updated weights for policy 0, policy_version 1102158 (0.0010) [2023-12-26 08:23:30,885][123090] Updated weights for policy 1, policy_version 1094376 (0.0007) [2023-12-26 08:23:30,950][123090] Updated weights for policy 1, policy_version 1094386 (0.0009) [2023-12-26 08:23:31,025][123090] Updated weights for policy 1, policy_version 1094396 (0.0011) [2023-12-26 08:23:31,225][123091] Updated weights for policy 0, policy_version 1102168 (0.0010) [2023-12-26 08:23:31,288][123091] Updated weights for policy 0, policy_version 1102178 (0.0011) [2023-12-26 08:23:31,346][123091] Updated weights for policy 0, policy_version 1102188 (0.0011) [2023-12-26 08:23:31,840][123090] Updated weights for policy 1, policy_version 1094406 (0.0010) [2023-12-26 08:23:31,901][123090] Updated weights for policy 1, policy_version 1094416 (0.0008) [2023-12-26 08:23:31,965][123090] Updated weights for policy 1, policy_version 1094426 (0.0007) [2023-12-26 08:23:32,156][123091] Updated weights for policy 0, policy_version 1102198 (0.0012) [2023-12-26 08:23:32,212][123091] Updated weights for policy 0, policy_version 1102208 (0.0010) [2023-12-26 08:23:32,265][123091] Updated weights for policy 0, policy_version 1102218 (0.0009) [2023-12-26 08:23:32,745][123090] Updated weights for policy 1, policy_version 1094436 (0.0007) [2023-12-26 08:23:32,803][123090] Updated weights for policy 1, policy_version 1094446 (0.0010) [2023-12-26 08:23:32,858][123090] Updated weights for policy 1, policy_version 1094456 (0.0009) [2023-12-26 08:23:33,041][123091] Updated weights for policy 0, policy_version 1102228 (0.0008) [2023-12-26 08:23:33,104][123091] Updated weights for policy 0, policy_version 1102238 (0.0006) [2023-12-26 08:23:33,162][123091] Updated weights for policy 0, policy_version 1102248 (0.0006) [2023-12-26 08:23:33,752][123090] Updated weights for policy 1, policy_version 1094466 (0.0010) [2023-12-26 08:23:33,763][123091] Updated weights for policy 0, policy_version 1102258 (0.0006) [2023-12-26 08:23:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 562364416. Throughput: 0: 9014.3, 1: 8913.5. Samples: 562380992. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:33,784][121949] Avg episode reward: [(0, '6326.387'), (1, '5835.332')] [2023-12-26 08:23:33,815][123091] Updated weights for policy 0, policy_version 1102268 (0.0005) [2023-12-26 08:23:33,816][123090] Updated weights for policy 1, policy_version 1094476 (0.0011) [2023-12-26 08:23:33,866][123090] Updated weights for policy 1, policy_version 1094486 (0.0006) [2023-12-26 08:23:33,870][123091] Updated weights for policy 0, policy_version 1102278 (0.0006) [2023-12-26 08:23:33,920][123090] Updated weights for policy 1, policy_version 1094496 (0.0005) [2023-12-26 08:23:33,933][123091] Updated weights for policy 0, policy_version 1102288 (0.0008) [2023-12-26 08:23:34,649][123090] Updated weights for policy 1, policy_version 1094506 (0.0006) [2023-12-26 08:23:34,714][123090] Updated weights for policy 1, policy_version 1094516 (0.0006) [2023-12-26 08:23:34,731][123091] Updated weights for policy 0, policy_version 1102298 (0.0006) [2023-12-26 08:23:34,775][123090] Updated weights for policy 1, policy_version 1094526 (0.0006) [2023-12-26 08:23:34,793][123091] Updated weights for policy 0, policy_version 1102308 (0.0007) [2023-12-26 08:23:34,848][123091] Updated weights for policy 0, policy_version 1102318 (0.0007) [2023-12-26 08:23:35,507][123091] Updated weights for policy 0, policy_version 1102328 (0.0005) [2023-12-26 08:23:35,557][123091] Updated weights for policy 0, policy_version 1102338 (0.0005) [2023-12-26 08:23:35,557][123090] Updated weights for policy 1, policy_version 1094536 (0.0010) [2023-12-26 08:23:35,613][123091] Updated weights for policy 0, policy_version 1102348 (0.0006) [2023-12-26 08:23:35,623][123090] Updated weights for policy 1, policy_version 1094546 (0.0011) [2023-12-26 08:23:35,690][123090] Updated weights for policy 1, policy_version 1094556 (0.0005) [2023-12-26 08:23:36,337][123091] Updated weights for policy 0, policy_version 1102358 (0.0006) [2023-12-26 08:23:36,385][123091] Updated weights for policy 0, policy_version 1102368 (0.0006) [2023-12-26 08:23:36,414][123090] Updated weights for policy 1, policy_version 1094566 (0.0009) [2023-12-26 08:23:36,432][123091] Updated weights for policy 0, policy_version 1102378 (0.0005) [2023-12-26 08:23:36,471][123090] Updated weights for policy 1, policy_version 1094576 (0.0011) [2023-12-26 08:23:36,527][123090] Updated weights for policy 1, policy_version 1094586 (0.0011) [2023-12-26 08:23:37,102][123091] Updated weights for policy 0, policy_version 1102388 (0.0008) [2023-12-26 08:23:37,164][123091] Updated weights for policy 0, policy_version 1102398 (0.0010) [2023-12-26 08:23:37,227][123091] Updated weights for policy 0, policy_version 1102408 (0.0006) [2023-12-26 08:23:37,315][123090] Updated weights for policy 1, policy_version 1094596 (0.0010) [2023-12-26 08:23:37,378][123090] Updated weights for policy 1, policy_version 1094606 (0.0010) [2023-12-26 08:23:37,452][123090] Updated weights for policy 1, policy_version 1094616 (0.0010) [2023-12-26 08:23:38,045][123091] Updated weights for policy 0, policy_version 1102418 (0.0010) [2023-12-26 08:23:38,101][123091] Updated weights for policy 0, policy_version 1102428 (0.0011) [2023-12-26 08:23:38,157][123091] Updated weights for policy 0, policy_version 1102438 (0.0010) [2023-12-26 08:23:38,213][123091] Updated weights for policy 0, policy_version 1102448 (0.0010) [2023-12-26 08:23:38,268][123090] Updated weights for policy 1, policy_version 1094626 (0.0009) [2023-12-26 08:23:38,337][123090] Updated weights for policy 1, policy_version 1094636 (0.0007) [2023-12-26 08:23:38,401][123090] Updated weights for policy 1, policy_version 1094646 (0.0010) [2023-12-26 08:23:38,449][123090] Updated weights for policy 1, policy_version 1094656 (0.0010) [2023-12-26 08:23:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 562462720. Throughput: 0: 9109.8, 1: 8977.3. Samples: 562438748. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:38,785][121949] Avg episode reward: [(0, '6294.138'), (1, '5951.760')] [2023-12-26 08:23:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001102448_282230784.pth... [2023-12-26 08:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001094656_280231936.pth... [2023-12-26 08:23:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001101360_281952256.pth [2023-12-26 08:23:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001093600_279961600.pth [2023-12-26 08:23:39,062][123091] Updated weights for policy 0, policy_version 1102458 (0.0011) [2023-12-26 08:23:39,129][123091] Updated weights for policy 0, policy_version 1102468 (0.0011) [2023-12-26 08:23:39,201][123091] Updated weights for policy 0, policy_version 1102478 (0.0010) [2023-12-26 08:23:39,267][123090] Updated weights for policy 1, policy_version 1094666 (0.0007) [2023-12-26 08:23:39,340][123090] Updated weights for policy 1, policy_version 1094676 (0.0007) [2023-12-26 08:23:39,423][123090] Updated weights for policy 1, policy_version 1094686 (0.0008) [2023-12-26 08:23:39,928][123091] Updated weights for policy 0, policy_version 1102488 (0.0010) [2023-12-26 08:23:39,985][123091] Updated weights for policy 0, policy_version 1102498 (0.0010) [2023-12-26 08:23:40,045][123091] Updated weights for policy 0, policy_version 1102508 (0.0011) [2023-12-26 08:23:40,260][123090] Updated weights for policy 1, policy_version 1094696 (0.0010) [2023-12-26 08:23:40,323][123090] Updated weights for policy 1, policy_version 1094706 (0.0010) [2023-12-26 08:23:40,375][123090] Updated weights for policy 1, policy_version 1094716 (0.0010) [2023-12-26 08:23:40,905][123091] Updated weights for policy 0, policy_version 1102518 (0.0011) [2023-12-26 08:23:40,955][123091] Updated weights for policy 0, policy_version 1102528 (0.0009) [2023-12-26 08:23:41,015][123091] Updated weights for policy 0, policy_version 1102538 (0.0006) [2023-12-26 08:23:41,209][123090] Updated weights for policy 1, policy_version 1094726 (0.0010) [2023-12-26 08:23:41,270][123090] Updated weights for policy 1, policy_version 1094736 (0.0011) [2023-12-26 08:23:41,340][123090] Updated weights for policy 1, policy_version 1094746 (0.0011) [2023-12-26 08:23:41,870][123091] Updated weights for policy 0, policy_version 1102548 (0.0008) [2023-12-26 08:23:41,926][123091] Updated weights for policy 0, policy_version 1102558 (0.0008) [2023-12-26 08:23:41,994][123091] Updated weights for policy 0, policy_version 1102568 (0.0008) [2023-12-26 08:23:42,195][123090] Updated weights for policy 1, policy_version 1094756 (0.0009) [2023-12-26 08:23:42,257][123090] Updated weights for policy 1, policy_version 1094766 (0.0006) [2023-12-26 08:23:42,322][123090] Updated weights for policy 1, policy_version 1094776 (0.0009) [2023-12-26 08:23:42,855][123091] Updated weights for policy 0, policy_version 1102578 (0.0008) [2023-12-26 08:23:42,921][123091] Updated weights for policy 0, policy_version 1102588 (0.0007) [2023-12-26 08:23:42,975][123091] Updated weights for policy 0, policy_version 1102598 (0.0005) [2023-12-26 08:23:43,042][123091] Updated weights for policy 0, policy_version 1102608 (0.0006) [2023-12-26 08:23:43,136][123090] Updated weights for policy 1, policy_version 1094786 (0.0008) [2023-12-26 08:23:43,207][123090] Updated weights for policy 1, policy_version 1094796 (0.0009) [2023-12-26 08:23:43,269][123090] Updated weights for policy 1, policy_version 1094806 (0.0010) [2023-12-26 08:23:43,331][123090] Updated weights for policy 1, policy_version 1094816 (0.0009) [2023-12-26 08:23:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 562544640. Throughput: 0: 9056.3, 1: 8868.0. Samples: 562541624. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:43,785][121949] Avg episode reward: [(0, '6223.567'), (1, '6031.044')] [2023-12-26 08:23:43,808][123091] Updated weights for policy 0, policy_version 1102618 (0.0009) [2023-12-26 08:23:43,859][123091] Updated weights for policy 0, policy_version 1102628 (0.0009) [2023-12-26 08:23:43,904][123091] Updated weights for policy 0, policy_version 1102638 (0.0006) [2023-12-26 08:23:44,115][123090] Updated weights for policy 1, policy_version 1094826 (0.0010) [2023-12-26 08:23:44,167][123090] Updated weights for policy 1, policy_version 1094836 (0.0009) [2023-12-26 08:23:44,226][123090] Updated weights for policy 1, policy_version 1094846 (0.0009) [2023-12-26 08:23:44,746][123091] Updated weights for policy 0, policy_version 1102648 (0.0008) [2023-12-26 08:23:44,812][123091] Updated weights for policy 0, policy_version 1102658 (0.0009) [2023-12-26 08:23:44,881][123091] Updated weights for policy 0, policy_version 1102668 (0.0007) [2023-12-26 08:23:45,109][123090] Updated weights for policy 1, policy_version 1094856 (0.0008) [2023-12-26 08:23:45,178][123090] Updated weights for policy 1, policy_version 1094866 (0.0009) [2023-12-26 08:23:45,243][123090] Updated weights for policy 1, policy_version 1094876 (0.0009) [2023-12-26 08:23:45,738][123091] Updated weights for policy 0, policy_version 1102678 (0.0008) [2023-12-26 08:23:45,789][123091] Updated weights for policy 0, policy_version 1102688 (0.0005) [2023-12-26 08:23:45,854][123091] Updated weights for policy 0, policy_version 1102698 (0.0005) [2023-12-26 08:23:46,107][123090] Updated weights for policy 1, policy_version 1094886 (0.0008) [2023-12-26 08:23:46,176][123090] Updated weights for policy 1, policy_version 1094896 (0.0009) [2023-12-26 08:23:46,241][123090] Updated weights for policy 1, policy_version 1094906 (0.0009) [2023-12-26 08:23:46,578][123091] Updated weights for policy 0, policy_version 1102708 (0.0008) [2023-12-26 08:23:46,649][123091] Updated weights for policy 0, policy_version 1102718 (0.0011) [2023-12-26 08:23:46,698][123091] Updated weights for policy 0, policy_version 1102728 (0.0011) [2023-12-26 08:23:47,108][123090] Updated weights for policy 1, policy_version 1094916 (0.0009) [2023-12-26 08:23:47,183][123090] Updated weights for policy 1, policy_version 1094926 (0.0010) [2023-12-26 08:23:47,249][123090] Updated weights for policy 1, policy_version 1094936 (0.0010) [2023-12-26 08:23:47,369][123091] Updated weights for policy 0, policy_version 1102738 (0.0010) [2023-12-26 08:23:47,423][123091] Updated weights for policy 0, policy_version 1102748 (0.0005) [2023-12-26 08:23:47,478][123091] Updated weights for policy 0, policy_version 1102758 (0.0008) [2023-12-26 08:23:47,532][123091] Updated weights for policy 0, policy_version 1102768 (0.0009) [2023-12-26 08:23:48,138][123090] Updated weights for policy 1, policy_version 1094946 (0.0010) [2023-12-26 08:23:48,200][123090] Updated weights for policy 1, policy_version 1094956 (0.0009) [2023-12-26 08:23:48,212][123091] Updated weights for policy 0, policy_version 1102778 (0.0006) [2023-12-26 08:23:48,262][123090] Updated weights for policy 1, policy_version 1094966 (0.0009) [2023-12-26 08:23:48,267][123091] Updated weights for policy 0, policy_version 1102788 (0.0005) [2023-12-26 08:23:48,312][123090] Updated weights for policy 1, policy_version 1094976 (0.0008) [2023-12-26 08:23:48,334][123091] Updated weights for policy 0, policy_version 1102798 (0.0007) [2023-12-26 08:23:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 562634752. Throughput: 0: 9133.6, 1: 8790.0. Samples: 562646708. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:48,785][121949] Avg episode reward: [(0, '6170.828'), (1, '6014.285')] [2023-12-26 08:23:49,070][123090] Updated weights for policy 1, policy_version 1094986 (0.0010) [2023-12-26 08:23:49,101][123091] Updated weights for policy 0, policy_version 1102808 (0.0009) [2023-12-26 08:23:49,126][123090] Updated weights for policy 1, policy_version 1094996 (0.0010) [2023-12-26 08:23:49,171][123090] Updated weights for policy 1, policy_version 1095006 (0.0009) [2023-12-26 08:23:49,173][123091] Updated weights for policy 0, policy_version 1102818 (0.0005) [2023-12-26 08:23:49,244][123091] Updated weights for policy 0, policy_version 1102828 (0.0008) [2023-12-26 08:23:50,005][123091] Updated weights for policy 0, policy_version 1102838 (0.0011) [2023-12-26 08:23:50,066][123090] Updated weights for policy 1, policy_version 1095016 (0.0008) [2023-12-26 08:23:50,073][123091] Updated weights for policy 0, policy_version 1102848 (0.0011) [2023-12-26 08:23:50,120][123090] Updated weights for policy 1, policy_version 1095026 (0.0008) [2023-12-26 08:23:50,133][123091] Updated weights for policy 0, policy_version 1102858 (0.0011) [2023-12-26 08:23:50,174][123090] Updated weights for policy 1, policy_version 1095036 (0.0009) [2023-12-26 08:23:50,962][123091] Updated weights for policy 0, policy_version 1102868 (0.0011) [2023-12-26 08:23:51,029][123091] Updated weights for policy 0, policy_version 1102878 (0.0011) [2023-12-26 08:23:51,057][123090] Updated weights for policy 1, policy_version 1095046 (0.0009) [2023-12-26 08:23:51,097][123091] Updated weights for policy 0, policy_version 1102888 (0.0011) [2023-12-26 08:23:51,126][123090] Updated weights for policy 1, policy_version 1095056 (0.0007) [2023-12-26 08:23:51,194][123090] Updated weights for policy 1, policy_version 1095066 (0.0009) [2023-12-26 08:23:51,944][123091] Updated weights for policy 0, policy_version 1102898 (0.0010) [2023-12-26 08:23:52,015][123091] Updated weights for policy 0, policy_version 1102908 (0.0011) [2023-12-26 08:23:52,030][123090] Updated weights for policy 1, policy_version 1095076 (0.0008) [2023-12-26 08:23:52,067][123091] Updated weights for policy 0, policy_version 1102918 (0.0011) [2023-12-26 08:23:52,095][123090] Updated weights for policy 1, policy_version 1095086 (0.0006) [2023-12-26 08:23:52,115][123091] Updated weights for policy 0, policy_version 1102928 (0.0010) [2023-12-26 08:23:52,162][123090] Updated weights for policy 1, policy_version 1095096 (0.0008) [2023-12-26 08:23:52,965][123091] Updated weights for policy 0, policy_version 1102938 (0.0011) [2023-12-26 08:23:52,984][123090] Updated weights for policy 1, policy_version 1095106 (0.0009) [2023-12-26 08:23:53,024][123091] Updated weights for policy 0, policy_version 1102948 (0.0011) [2023-12-26 08:23:53,049][123090] Updated weights for policy 1, policy_version 1095116 (0.0006) [2023-12-26 08:23:53,084][123091] Updated weights for policy 0, policy_version 1102958 (0.0010) [2023-12-26 08:23:53,114][123090] Updated weights for policy 1, policy_version 1095126 (0.0008) [2023-12-26 08:23:53,178][123090] Updated weights for policy 1, policy_version 1095136 (0.0009) [2023-12-26 08:23:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 562716672. Throughput: 0: 9124.2, 1: 8761.4. Samples: 562697780. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:53,785][121949] Avg episode reward: [(0, '6083.944'), (1, '6008.938')] [2023-12-26 08:23:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001095136_280354816.pth... [2023-12-26 08:23:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001102960_282361856.pth... [2023-12-26 08:23:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001094144_280100864.pth [2023-12-26 08:23:53,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001101904_282091520.pth [2023-12-26 08:23:53,904][123091] Updated weights for policy 0, policy_version 1102968 (0.0010) [2023-12-26 08:23:53,948][123091] Updated weights for policy 0, policy_version 1102978 (0.0010) [2023-12-26 08:23:53,995][123091] Updated weights for policy 0, policy_version 1102988 (0.0010) [2023-12-26 08:23:53,998][123090] Updated weights for policy 1, policy_version 1095146 (0.0006) [2023-12-26 08:23:54,056][123090] Updated weights for policy 1, policy_version 1095156 (0.0008) [2023-12-26 08:23:54,112][123090] Updated weights for policy 1, policy_version 1095166 (0.0009) [2023-12-26 08:23:54,833][123091] Updated weights for policy 0, policy_version 1102998 (0.0010) [2023-12-26 08:23:54,880][123091] Updated weights for policy 0, policy_version 1103008 (0.0010) [2023-12-26 08:23:54,924][123091] Updated weights for policy 0, policy_version 1103018 (0.0010) [2023-12-26 08:23:54,961][123090] Updated weights for policy 1, policy_version 1095176 (0.0007) [2023-12-26 08:23:55,017][123090] Updated weights for policy 1, policy_version 1095186 (0.0009) [2023-12-26 08:23:55,065][123090] Updated weights for policy 1, policy_version 1095196 (0.0008) [2023-12-26 08:23:55,785][123091] Updated weights for policy 0, policy_version 1103028 (0.0011) [2023-12-26 08:23:55,839][123091] Updated weights for policy 0, policy_version 1103038 (0.0010) [2023-12-26 08:23:55,886][123091] Updated weights for policy 0, policy_version 1103048 (0.0010) [2023-12-26 08:23:55,912][123090] Updated weights for policy 1, policy_version 1095206 (0.0009) [2023-12-26 08:23:55,977][123090] Updated weights for policy 1, policy_version 1095216 (0.0007) [2023-12-26 08:23:56,037][123090] Updated weights for policy 1, policy_version 1095226 (0.0009) [2023-12-26 08:23:56,713][123091] Updated weights for policy 0, policy_version 1103058 (0.0011) [2023-12-26 08:23:56,768][123091] Updated weights for policy 0, policy_version 1103068 (0.0010) [2023-12-26 08:23:56,818][123091] Updated weights for policy 0, policy_version 1103078 (0.0010) [2023-12-26 08:23:56,849][123090] Updated weights for policy 1, policy_version 1095236 (0.0007) [2023-12-26 08:23:56,875][123091] Updated weights for policy 0, policy_version 1103088 (0.0010) [2023-12-26 08:23:56,931][123090] Updated weights for policy 1, policy_version 1095246 (0.0008) [2023-12-26 08:23:56,993][123090] Updated weights for policy 1, policy_version 1095256 (0.0008) [2023-12-26 08:23:57,714][123091] Updated weights for policy 0, policy_version 1103098 (0.0010) [2023-12-26 08:23:57,761][123091] Updated weights for policy 0, policy_version 1103108 (0.0010) [2023-12-26 08:23:57,790][123090] Updated weights for policy 1, policy_version 1095266 (0.0009) [2023-12-26 08:23:57,816][123091] Updated weights for policy 0, policy_version 1103118 (0.0010) [2023-12-26 08:23:57,845][123090] Updated weights for policy 1, policy_version 1095276 (0.0008) [2023-12-26 08:23:57,892][123090] Updated weights for policy 1, policy_version 1095286 (0.0008) [2023-12-26 08:23:57,938][123090] Updated weights for policy 1, policy_version 1095296 (0.0008) [2023-12-26 08:23:58,722][123091] Updated weights for policy 0, policy_version 1103128 (0.0011) [2023-12-26 08:23:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 562798592. Throughput: 0: 9081.7, 1: 8788.1. Samples: 562800308. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:23:58,785][121949] Avg episode reward: [(0, '6068.355'), (1, '6009.281')] [2023-12-26 08:23:58,790][123091] Updated weights for policy 0, policy_version 1103138 (0.0010) [2023-12-26 08:23:58,857][123091] Updated weights for policy 0, policy_version 1103148 (0.0009) [2023-12-26 08:23:58,866][123090] Updated weights for policy 1, policy_version 1095306 (0.0009) [2023-12-26 08:23:58,946][123090] Updated weights for policy 1, policy_version 1095316 (0.0006) [2023-12-26 08:23:59,017][123090] Updated weights for policy 1, policy_version 1095326 (0.0007) [2023-12-26 08:23:59,702][123091] Updated weights for policy 0, policy_version 1103158 (0.0007) [2023-12-26 08:23:59,754][123091] Updated weights for policy 0, policy_version 1103168 (0.0008) [2023-12-26 08:23:59,780][123090] Updated weights for policy 1, policy_version 1095336 (0.0006) [2023-12-26 08:23:59,809][123091] Updated weights for policy 0, policy_version 1103178 (0.0006) [2023-12-26 08:23:59,849][123090] Updated weights for policy 1, policy_version 1095346 (0.0008) [2023-12-26 08:23:59,911][123090] Updated weights for policy 1, policy_version 1095356 (0.0009) [2023-12-26 08:24:00,562][123091] Updated weights for policy 0, policy_version 1103188 (0.0007) [2023-12-26 08:24:00,623][123091] Updated weights for policy 0, policy_version 1103198 (0.0005) [2023-12-26 08:24:00,669][123090] Updated weights for policy 1, policy_version 1095366 (0.0007) [2023-12-26 08:24:00,671][123091] Updated weights for policy 0, policy_version 1103208 (0.0006) [2023-12-26 08:24:00,726][123090] Updated weights for policy 1, policy_version 1095376 (0.0008) [2023-12-26 08:24:00,780][123090] Updated weights for policy 1, policy_version 1095386 (0.0010) [2023-12-26 08:24:01,473][123091] Updated weights for policy 0, policy_version 1103218 (0.0009) [2023-12-26 08:24:01,534][123090] Updated weights for policy 1, policy_version 1095396 (0.0007) [2023-12-26 08:24:01,540][123091] Updated weights for policy 0, policy_version 1103228 (0.0010) [2023-12-26 08:24:01,600][123090] Updated weights for policy 1, policy_version 1095406 (0.0007) [2023-12-26 08:24:01,602][123091] Updated weights for policy 0, policy_version 1103238 (0.0009) [2023-12-26 08:24:01,662][123090] Updated weights for policy 1, policy_version 1095416 (0.0009) [2023-12-26 08:24:01,676][123091] Updated weights for policy 0, policy_version 1103248 (0.0009) [2023-12-26 08:24:02,427][123090] Updated weights for policy 1, policy_version 1095426 (0.0008) [2023-12-26 08:24:02,496][123090] Updated weights for policy 1, policy_version 1095436 (0.0005) [2023-12-26 08:24:02,559][123090] Updated weights for policy 1, policy_version 1095446 (0.0005) [2023-12-26 08:24:02,568][123091] Updated weights for policy 0, policy_version 1103258 (0.0008) [2023-12-26 08:24:02,617][123090] Updated weights for policy 1, policy_version 1095456 (0.0009) [2023-12-26 08:24:02,618][123091] Updated weights for policy 0, policy_version 1103268 (0.0007) [2023-12-26 08:24:02,676][123091] Updated weights for policy 0, policy_version 1103278 (0.0010) [2023-12-26 08:24:03,239][123090] Updated weights for policy 1, policy_version 1095466 (0.0005) [2023-12-26 08:24:03,308][123090] Updated weights for policy 1, policy_version 1095476 (0.0005) [2023-12-26 08:24:03,364][123090] Updated weights for policy 1, policy_version 1095486 (0.0005) [2023-12-26 08:24:03,604][123091] Updated weights for policy 0, policy_version 1103288 (0.0010) [2023-12-26 08:24:03,661][123091] Updated weights for policy 0, policy_version 1103298 (0.0010) [2023-12-26 08:24:03,717][123091] Updated weights for policy 0, policy_version 1103308 (0.0009) [2023-12-26 08:24:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 562896896. Throughput: 0: 8994.7, 1: 8768.2. Samples: 562905248. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:03,785][121949] Avg episode reward: [(0, '6181.974'), (1, '5785.995')] [2023-12-26 08:24:04,049][123090] Updated weights for policy 1, policy_version 1095496 (0.0008) [2023-12-26 08:24:04,113][123090] Updated weights for policy 1, policy_version 1095506 (0.0006) [2023-12-26 08:24:04,178][123090] Updated weights for policy 1, policy_version 1095516 (0.0005) [2023-12-26 08:24:04,618][123091] Updated weights for policy 0, policy_version 1103318 (0.0008) [2023-12-26 08:24:04,678][123091] Updated weights for policy 0, policy_version 1103328 (0.0010) [2023-12-26 08:24:04,738][123091] Updated weights for policy 0, policy_version 1103339 (0.0010) [2023-12-26 08:24:04,933][123090] Updated weights for policy 1, policy_version 1095526 (0.0007) [2023-12-26 08:24:04,992][123090] Updated weights for policy 1, policy_version 1095536 (0.0010) [2023-12-26 08:24:05,054][123090] Updated weights for policy 1, policy_version 1095546 (0.0007) [2023-12-26 08:24:05,637][123091] Updated weights for policy 0, policy_version 1103349 (0.0010) [2023-12-26 08:24:05,691][123091] Updated weights for policy 0, policy_version 1103359 (0.0010) [2023-12-26 08:24:05,743][123091] Updated weights for policy 0, policy_version 1103369 (0.0009) [2023-12-26 08:24:05,770][123090] Updated weights for policy 1, policy_version 1095556 (0.0008) [2023-12-26 08:24:05,821][123090] Updated weights for policy 1, policy_version 1095566 (0.0010) [2023-12-26 08:24:05,875][123090] Updated weights for policy 1, policy_version 1095576 (0.0010) [2023-12-26 08:24:06,619][123091] Updated weights for policy 0, policy_version 1103379 (0.0009) [2023-12-26 08:24:06,666][123090] Updated weights for policy 1, policy_version 1095586 (0.0009) [2023-12-26 08:24:06,688][123091] Updated weights for policy 0, policy_version 1103389 (0.0009) [2023-12-26 08:24:06,742][123090] Updated weights for policy 1, policy_version 1095596 (0.0006) [2023-12-26 08:24:06,753][123091] Updated weights for policy 0, policy_version 1103399 (0.0008) [2023-12-26 08:24:06,813][123090] Updated weights for policy 1, policy_version 1095606 (0.0006) [2023-12-26 08:24:06,892][123090] Updated weights for policy 1, policy_version 1095616 (0.0006) [2023-12-26 08:24:07,476][123090] Updated weights for policy 1, policy_version 1095626 (0.0008) [2023-12-26 08:24:07,524][123090] Updated weights for policy 1, policy_version 1095636 (0.0010) [2023-12-26 08:24:07,572][123090] Updated weights for policy 1, policy_version 1095646 (0.0010) [2023-12-26 08:24:07,644][123091] Updated weights for policy 0, policy_version 1103409 (0.0009) [2023-12-26 08:24:07,696][123091] Updated weights for policy 0, policy_version 1103419 (0.0009) [2023-12-26 08:24:07,748][123091] Updated weights for policy 0, policy_version 1103429 (0.0010) [2023-12-26 08:24:08,270][123090] Updated weights for policy 1, policy_version 1095656 (0.0007) [2023-12-26 08:24:08,344][123090] Updated weights for policy 1, policy_version 1095666 (0.0007) [2023-12-26 08:24:08,408][123090] Updated weights for policy 1, policy_version 1095676 (0.0011) [2023-12-26 08:24:08,721][123091] Updated weights for policy 0, policy_version 1103441 (0.0010) [2023-12-26 08:24:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 562978816. Throughput: 0: 8924.7, 1: 8813.4. Samples: 562957536. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:08,784][121949] Avg episode reward: [(0, '6059.101'), (1, '5784.123')] [2023-12-26 08:24:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001095680_280494080.pth... [2023-12-26 08:24:08,790][123091] Updated weights for policy 0, policy_version 1103451 (0.0009) [2023-12-26 08:24:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001094656_280231936.pth [2023-12-26 08:24:08,862][123091] Updated weights for policy 0, policy_version 1103461 (0.0008) [2023-12-26 08:24:08,942][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001103472_282492928.pth... [2023-12-26 08:24:08,945][123091] Updated weights for policy 0, policy_version 1103472 (0.0009) [2023-12-26 08:24:08,947][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001102448_282230784.pth [2023-12-26 08:24:09,232][123090] Updated weights for policy 1, policy_version 1095686 (0.0011) [2023-12-26 08:24:09,294][123090] Updated weights for policy 1, policy_version 1095696 (0.0010) [2023-12-26 08:24:09,362][123090] Updated weights for policy 1, policy_version 1095706 (0.0010) [2023-12-26 08:24:09,703][123091] Updated weights for policy 0, policy_version 1103482 (0.0005) [2023-12-26 08:24:09,778][123091] Updated weights for policy 0, policy_version 1103492 (0.0006) [2023-12-26 08:24:09,845][123091] Updated weights for policy 0, policy_version 1103502 (0.0007) [2023-12-26 08:24:10,250][123090] Updated weights for policy 1, policy_version 1095716 (0.0010) [2023-12-26 08:24:10,306][123090] Updated weights for policy 1, policy_version 1095726 (0.0008) [2023-12-26 08:24:10,370][123090] Updated weights for policy 1, policy_version 1095736 (0.0010) [2023-12-26 08:24:10,609][123091] Updated weights for policy 0, policy_version 1103512 (0.0006) [2023-12-26 08:24:10,677][123091] Updated weights for policy 0, policy_version 1103522 (0.0005) [2023-12-26 08:24:10,734][123091] Updated weights for policy 0, policy_version 1103532 (0.0008) [2023-12-26 08:24:11,255][123090] Updated weights for policy 1, policy_version 1095746 (0.0009) [2023-12-26 08:24:11,323][123090] Updated weights for policy 1, policy_version 1095756 (0.0008) [2023-12-26 08:24:11,396][123090] Updated weights for policy 1, policy_version 1095766 (0.0007) [2023-12-26 08:24:11,454][123090] Updated weights for policy 1, policy_version 1095776 (0.0006) [2023-12-26 08:24:11,540][123091] Updated weights for policy 0, policy_version 1103542 (0.0009) [2023-12-26 08:24:11,611][123091] Updated weights for policy 0, policy_version 1103552 (0.0009) [2023-12-26 08:24:11,680][123091] Updated weights for policy 0, policy_version 1103562 (0.0009) [2023-12-26 08:24:12,275][123090] Updated weights for policy 1, policy_version 1095786 (0.0008) [2023-12-26 08:24:12,349][123090] Updated weights for policy 1, policy_version 1095796 (0.0008) [2023-12-26 08:24:12,418][123090] Updated weights for policy 1, policy_version 1095806 (0.0008) [2023-12-26 08:24:12,549][123091] Updated weights for policy 0, policy_version 1103572 (0.0009) [2023-12-26 08:24:12,618][123091] Updated weights for policy 0, policy_version 1103582 (0.0010) [2023-12-26 08:24:12,687][123091] Updated weights for policy 0, policy_version 1103592 (0.0009) [2023-12-26 08:24:13,209][123090] Updated weights for policy 1, policy_version 1095816 (0.0006) [2023-12-26 08:24:13,270][123090] Updated weights for policy 1, policy_version 1095826 (0.0005) [2023-12-26 08:24:13,336][123090] Updated weights for policy 1, policy_version 1095836 (0.0005) [2023-12-26 08:24:13,540][123091] Updated weights for policy 0, policy_version 1103602 (0.0008) [2023-12-26 08:24:13,595][123091] Updated weights for policy 0, policy_version 1103613 (0.0010) [2023-12-26 08:24:13,649][123091] Updated weights for policy 0, policy_version 1103625 (0.0010) [2023-12-26 08:24:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 563068928. Throughput: 0: 8796.3, 1: 8772.5. Samples: 563060144. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:13,785][121949] Avg episode reward: [(0, '6016.685'), (1, '5913.860')] [2023-12-26 08:24:13,944][123090] Updated weights for policy 1, policy_version 1095846 (0.0008) [2023-12-26 08:24:13,993][123090] Updated weights for policy 1, policy_version 1095856 (0.0009) [2023-12-26 08:24:14,043][123090] Updated weights for policy 1, policy_version 1095866 (0.0010) [2023-12-26 08:24:14,555][123091] Updated weights for policy 0, policy_version 1103636 (0.0008) [2023-12-26 08:24:14,608][123091] Updated weights for policy 0, policy_version 1103646 (0.0006) [2023-12-26 08:24:14,666][123091] Updated weights for policy 0, policy_version 1103657 (0.0011) [2023-12-26 08:24:14,857][123090] Updated weights for policy 1, policy_version 1095876 (0.0009) [2023-12-26 08:24:14,928][123090] Updated weights for policy 1, policy_version 1095886 (0.0009) [2023-12-26 08:24:14,994][123090] Updated weights for policy 1, policy_version 1095896 (0.0010) [2023-12-26 08:24:15,495][123091] Updated weights for policy 0, policy_version 1103667 (0.0010) [2023-12-26 08:24:15,577][123091] Updated weights for policy 0, policy_version 1103677 (0.0010) [2023-12-26 08:24:15,652][123091] Updated weights for policy 0, policy_version 1103687 (0.0009) [2023-12-26 08:24:15,725][123090] Updated weights for policy 1, policy_version 1095906 (0.0009) [2023-12-26 08:24:15,781][123090] Updated weights for policy 1, policy_version 1095916 (0.0010) [2023-12-26 08:24:15,849][123090] Updated weights for policy 1, policy_version 1095926 (0.0009) [2023-12-26 08:24:15,905][123090] Updated weights for policy 1, policy_version 1095936 (0.0009) [2023-12-26 08:24:16,475][123091] Updated weights for policy 0, policy_version 1103697 (0.0009) [2023-12-26 08:24:16,536][123091] Updated weights for policy 0, policy_version 1103707 (0.0010) [2023-12-26 08:24:16,587][123091] Updated weights for policy 0, policy_version 1103717 (0.0010) [2023-12-26 08:24:16,646][123091] Updated weights for policy 0, policy_version 1103727 (0.0010) [2023-12-26 08:24:16,696][123090] Updated weights for policy 1, policy_version 1095946 (0.0009) [2023-12-26 08:24:16,759][123090] Updated weights for policy 1, policy_version 1095956 (0.0009) [2023-12-26 08:24:16,816][123090] Updated weights for policy 1, policy_version 1095966 (0.0009) [2023-12-26 08:24:17,364][123091] Updated weights for policy 0, policy_version 1103737 (0.0005) [2023-12-26 08:24:17,419][123091] Updated weights for policy 0, policy_version 1103747 (0.0005) [2023-12-26 08:24:17,480][123091] Updated weights for policy 0, policy_version 1103757 (0.0008) [2023-12-26 08:24:17,684][123090] Updated weights for policy 1, policy_version 1095976 (0.0006) [2023-12-26 08:24:17,755][123090] Updated weights for policy 1, policy_version 1095986 (0.0005) [2023-12-26 08:24:17,809][123090] Updated weights for policy 1, policy_version 1095996 (0.0005) [2023-12-26 08:24:18,236][123091] Updated weights for policy 0, policy_version 1103767 (0.0009) [2023-12-26 08:24:18,291][123091] Updated weights for policy 0, policy_version 1103777 (0.0008) [2023-12-26 08:24:18,361][123091] Updated weights for policy 0, policy_version 1103787 (0.0010) [2023-12-26 08:24:18,523][123090] Updated weights for policy 1, policy_version 1096006 (0.0007) [2023-12-26 08:24:18,577][123090] Updated weights for policy 1, policy_version 1096016 (0.0009) [2023-12-26 08:24:18,638][123090] Updated weights for policy 1, policy_version 1096026 (0.0007) [2023-12-26 08:24:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 563159040. Throughput: 0: 8629.7, 1: 8813.8. Samples: 563165956. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:18,785][121949] Avg episode reward: [(0, '6115.645'), (1, '5893.334')] [2023-12-26 08:24:19,210][123091] Updated weights for policy 0, policy_version 1103797 (0.0010) [2023-12-26 08:24:19,269][123091] Updated weights for policy 0, policy_version 1103807 (0.0009) [2023-12-26 08:24:19,332][123091] Updated weights for policy 0, policy_version 1103817 (0.0010) [2023-12-26 08:24:19,533][123090] Updated weights for policy 1, policy_version 1096036 (0.0009) [2023-12-26 08:24:19,593][123090] Updated weights for policy 1, policy_version 1096046 (0.0008) [2023-12-26 08:24:19,652][123090] Updated weights for policy 1, policy_version 1096056 (0.0009) [2023-12-26 08:24:20,196][123091] Updated weights for policy 0, policy_version 1103827 (0.0009) [2023-12-26 08:24:20,266][123091] Updated weights for policy 0, policy_version 1103837 (0.0009) [2023-12-26 08:24:20,327][123091] Updated weights for policy 0, policy_version 1103847 (0.0010) [2023-12-26 08:24:20,464][123090] Updated weights for policy 1, policy_version 1096066 (0.0009) [2023-12-26 08:24:20,535][123090] Updated weights for policy 1, policy_version 1096076 (0.0010) [2023-12-26 08:24:20,600][123090] Updated weights for policy 1, policy_version 1096086 (0.0008) [2023-12-26 08:24:20,667][123090] Updated weights for policy 1, policy_version 1096096 (0.0010) [2023-12-26 08:24:21,153][123091] Updated weights for policy 0, policy_version 1103857 (0.0009) [2023-12-26 08:24:21,208][123091] Updated weights for policy 0, policy_version 1103867 (0.0006) [2023-12-26 08:24:21,276][123091] Updated weights for policy 0, policy_version 1103877 (0.0007) [2023-12-26 08:24:21,345][123091] Updated weights for policy 0, policy_version 1103887 (0.0006) [2023-12-26 08:24:21,426][123090] Updated weights for policy 1, policy_version 1096106 (0.0008) [2023-12-26 08:24:21,493][123090] Updated weights for policy 1, policy_version 1096116 (0.0007) [2023-12-26 08:24:21,559][123090] Updated weights for policy 1, policy_version 1096126 (0.0005) [2023-12-26 08:24:22,209][123091] Updated weights for policy 0, policy_version 1103897 (0.0010) [2023-12-26 08:24:22,278][123091] Updated weights for policy 0, policy_version 1103907 (0.0009) [2023-12-26 08:24:22,301][123090] Updated weights for policy 1, policy_version 1096136 (0.0010) [2023-12-26 08:24:22,335][123091] Updated weights for policy 0, policy_version 1103917 (0.0008) [2023-12-26 08:24:22,373][123090] Updated weights for policy 1, policy_version 1096146 (0.0010) [2023-12-26 08:24:22,437][123090] Updated weights for policy 1, policy_version 1096156 (0.0010) [2023-12-26 08:24:23,148][123090] Updated weights for policy 1, policy_version 1096166 (0.0010) [2023-12-26 08:24:23,215][123090] Updated weights for policy 1, policy_version 1096176 (0.0011) [2023-12-26 08:24:23,261][123091] Updated weights for policy 0, policy_version 1103927 (0.0007) [2023-12-26 08:24:23,279][123090] Updated weights for policy 1, policy_version 1096186 (0.0010) [2023-12-26 08:24:23,326][123091] Updated weights for policy 0, policy_version 1103937 (0.0007) [2023-12-26 08:24:23,388][123091] Updated weights for policy 0, policy_version 1103947 (0.0009) [2023-12-26 08:24:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 563240960. Throughput: 0: 8549.6, 1: 8755.0. Samples: 563217456. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:23,785][121949] Avg episode reward: [(0, '6167.849'), (1, '5833.004')] [2023-12-26 08:24:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001103952_282615808.pth... [2023-12-26 08:24:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001096192_280625152.pth... [2023-12-26 08:24:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001102960_282361856.pth [2023-12-26 08:24:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001095136_280354816.pth [2023-12-26 08:24:23,942][123090] Updated weights for policy 1, policy_version 1096196 (0.0010) [2023-12-26 08:24:23,999][123090] Updated weights for policy 1, policy_version 1096206 (0.0008) [2023-12-26 08:24:24,051][123090] Updated weights for policy 1, policy_version 1096216 (0.0007) [2023-12-26 08:24:24,158][123091] Updated weights for policy 0, policy_version 1103957 (0.0009) [2023-12-26 08:24:24,228][123091] Updated weights for policy 0, policy_version 1103967 (0.0009) [2023-12-26 08:24:24,295][123091] Updated weights for policy 0, policy_version 1103977 (0.0010) [2023-12-26 08:24:24,778][123090] Updated weights for policy 1, policy_version 1096226 (0.0006) [2023-12-26 08:24:24,849][123090] Updated weights for policy 1, policy_version 1096236 (0.0006) [2023-12-26 08:24:24,910][123090] Updated weights for policy 1, policy_version 1096246 (0.0005) [2023-12-26 08:24:24,975][123090] Updated weights for policy 1, policy_version 1096256 (0.0005) [2023-12-26 08:24:25,216][123091] Updated weights for policy 0, policy_version 1103987 (0.0010) [2023-12-26 08:24:25,274][123091] Updated weights for policy 0, policy_version 1103997 (0.0010) [2023-12-26 08:24:25,329][123091] Updated weights for policy 0, policy_version 1104007 (0.0010) [2023-12-26 08:24:25,596][123090] Updated weights for policy 1, policy_version 1096266 (0.0005) [2023-12-26 08:24:25,653][123090] Updated weights for policy 1, policy_version 1096276 (0.0005) [2023-12-26 08:24:25,707][123090] Updated weights for policy 1, policy_version 1096286 (0.0005) [2023-12-26 08:24:26,275][123091] Updated weights for policy 0, policy_version 1104017 (0.0009) [2023-12-26 08:24:26,324][123091] Updated weights for policy 0, policy_version 1104027 (0.0009) [2023-12-26 08:24:26,381][123091] Updated weights for policy 0, policy_version 1104037 (0.0009) [2023-12-26 08:24:26,418][123090] Updated weights for policy 1, policy_version 1096296 (0.0009) [2023-12-26 08:24:26,445][123091] Updated weights for policy 0, policy_version 1104047 (0.0010) [2023-12-26 08:24:26,480][123090] Updated weights for policy 1, policy_version 1096306 (0.0010) [2023-12-26 08:24:26,551][123090] Updated weights for policy 1, policy_version 1096316 (0.0011) [2023-12-26 08:24:27,271][123090] Updated weights for policy 1, policy_version 1096326 (0.0007) [2023-12-26 08:24:27,298][123091] Updated weights for policy 0, policy_version 1104057 (0.0010) [2023-12-26 08:24:27,341][123090] Updated weights for policy 1, policy_version 1096336 (0.0008) [2023-12-26 08:24:27,355][123091] Updated weights for policy 0, policy_version 1104067 (0.0006) [2023-12-26 08:24:27,394][123090] Updated weights for policy 1, policy_version 1096346 (0.0008) [2023-12-26 08:24:27,411][123091] Updated weights for policy 0, policy_version 1104077 (0.0007) [2023-12-26 08:24:28,105][123091] Updated weights for policy 0, policy_version 1104087 (0.0007) [2023-12-26 08:24:28,153][123091] Updated weights for policy 0, policy_version 1104097 (0.0005) [2023-12-26 08:24:28,199][123091] Updated weights for policy 0, policy_version 1104107 (0.0005) [2023-12-26 08:24:28,245][123090] Updated weights for policy 1, policy_version 1096356 (0.0009) [2023-12-26 08:24:28,300][123090] Updated weights for policy 1, policy_version 1096366 (0.0008) [2023-12-26 08:24:28,364][123090] Updated weights for policy 1, policy_version 1096376 (0.0009) [2023-12-26 08:24:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 563331072. Throughput: 0: 8485.8, 1: 8925.4. Samples: 563325124. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:28,784][121949] Avg episode reward: [(0, '6118.172'), (1, '5860.200')] [2023-12-26 08:24:28,947][123091] Updated weights for policy 0, policy_version 1104117 (0.0005) [2023-12-26 08:24:28,999][123091] Updated weights for policy 0, policy_version 1104127 (0.0006) [2023-12-26 08:24:29,054][123091] Updated weights for policy 0, policy_version 1104137 (0.0010) [2023-12-26 08:24:29,162][123090] Updated weights for policy 1, policy_version 1096386 (0.0009) [2023-12-26 08:24:29,222][123090] Updated weights for policy 1, policy_version 1096396 (0.0009) [2023-12-26 08:24:29,280][123090] Updated weights for policy 1, policy_version 1096406 (0.0009) [2023-12-26 08:24:29,332][123090] Updated weights for policy 1, policy_version 1096416 (0.0008) [2023-12-26 08:24:29,789][123091] Updated weights for policy 0, policy_version 1104147 (0.0009) [2023-12-26 08:24:29,860][123091] Updated weights for policy 0, policy_version 1104157 (0.0010) [2023-12-26 08:24:29,924][123091] Updated weights for policy 0, policy_version 1104167 (0.0011) [2023-12-26 08:24:30,101][123090] Updated weights for policy 1, policy_version 1096426 (0.0009) [2023-12-26 08:24:30,154][123090] Updated weights for policy 1, policy_version 1096436 (0.0009) [2023-12-26 08:24:30,218][123090] Updated weights for policy 1, policy_version 1096446 (0.0010) [2023-12-26 08:24:30,677][123091] Updated weights for policy 0, policy_version 1104177 (0.0010) [2023-12-26 08:24:30,744][123091] Updated weights for policy 0, policy_version 1104187 (0.0008) [2023-12-26 08:24:30,803][123091] Updated weights for policy 0, policy_version 1104197 (0.0008) [2023-12-26 08:24:30,867][123091] Updated weights for policy 0, policy_version 1104207 (0.0009) [2023-12-26 08:24:31,070][123090] Updated weights for policy 1, policy_version 1096456 (0.0008) [2023-12-26 08:24:31,125][123090] Updated weights for policy 1, policy_version 1096466 (0.0009) [2023-12-26 08:24:31,194][123090] Updated weights for policy 1, policy_version 1096476 (0.0011) [2023-12-26 08:24:31,682][123091] Updated weights for policy 0, policy_version 1104217 (0.0009) [2023-12-26 08:24:31,745][123091] Updated weights for policy 0, policy_version 1104227 (0.0009) [2023-12-26 08:24:31,799][123091] Updated weights for policy 0, policy_version 1104237 (0.0009) [2023-12-26 08:24:32,048][123090] Updated weights for policy 1, policy_version 1096486 (0.0010) [2023-12-26 08:24:32,110][123090] Updated weights for policy 1, policy_version 1096496 (0.0009) [2023-12-26 08:24:32,168][123090] Updated weights for policy 1, policy_version 1096506 (0.0009) [2023-12-26 08:24:32,648][123091] Updated weights for policy 0, policy_version 1104247 (0.0009) [2023-12-26 08:24:32,710][123091] Updated weights for policy 0, policy_version 1104257 (0.0008) [2023-12-26 08:24:32,772][123091] Updated weights for policy 0, policy_version 1104267 (0.0005) [2023-12-26 08:24:32,980][123090] Updated weights for policy 1, policy_version 1096516 (0.0010) [2023-12-26 08:24:33,042][123090] Updated weights for policy 1, policy_version 1096526 (0.0006) [2023-12-26 08:24:33,108][123090] Updated weights for policy 1, policy_version 1096536 (0.0007) [2023-12-26 08:24:33,585][123091] Updated weights for policy 0, policy_version 1104277 (0.0007) [2023-12-26 08:24:33,643][123091] Updated weights for policy 0, policy_version 1104287 (0.0010) [2023-12-26 08:24:33,696][123091] Updated weights for policy 0, policy_version 1104298 (0.0010) [2023-12-26 08:24:33,718][123090] Updated weights for policy 1, policy_version 1096546 (0.0005) [2023-12-26 08:24:33,771][123090] Updated weights for policy 1, policy_version 1096556 (0.0005) [2023-12-26 08:24:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 563421184. Throughput: 0: 8482.5, 1: 8990.5. Samples: 563432992. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:33,785][121949] Avg episode reward: [(0, '6058.325'), (1, '5953.493')] [2023-12-26 08:24:33,818][123090] Updated weights for policy 1, policy_version 1096566 (0.0005) [2023-12-26 08:24:33,871][123090] Updated weights for policy 1, policy_version 1096576 (0.0005) [2023-12-26 08:24:34,571][123091] Updated weights for policy 0, policy_version 1104308 (0.0010) [2023-12-26 08:24:34,631][123091] Updated weights for policy 0, policy_version 1104318 (0.0007) [2023-12-26 08:24:34,635][123090] Updated weights for policy 1, policy_version 1096586 (0.0011) [2023-12-26 08:24:34,690][123091] Updated weights for policy 0, policy_version 1104328 (0.0010) [2023-12-26 08:24:34,703][123090] Updated weights for policy 1, policy_version 1096596 (0.0011) [2023-12-26 08:24:34,771][123090] Updated weights for policy 1, policy_version 1096606 (0.0011) [2023-12-26 08:24:35,438][123091] Updated weights for policy 0, policy_version 1104338 (0.0008) [2023-12-26 08:24:35,494][123091] Updated weights for policy 0, policy_version 1104348 (0.0009) [2023-12-26 08:24:35,546][123091] Updated weights for policy 0, policy_version 1104358 (0.0009) [2023-12-26 08:24:35,589][123090] Updated weights for policy 1, policy_version 1096616 (0.0010) [2023-12-26 08:24:35,598][123091] Updated weights for policy 0, policy_version 1104368 (0.0009) [2023-12-26 08:24:35,651][123090] Updated weights for policy 1, policy_version 1096626 (0.0010) [2023-12-26 08:24:35,708][123090] Updated weights for policy 1, policy_version 1096636 (0.0006) [2023-12-26 08:24:36,429][123090] Updated weights for policy 1, policy_version 1096646 (0.0009) [2023-12-26 08:24:36,470][123091] Updated weights for policy 0, policy_version 1104378 (0.0006) [2023-12-26 08:24:36,493][123090] Updated weights for policy 1, policy_version 1096656 (0.0011) [2023-12-26 08:24:36,535][123091] Updated weights for policy 0, policy_version 1104388 (0.0007) [2023-12-26 08:24:36,558][123090] Updated weights for policy 1, policy_version 1096666 (0.0011) [2023-12-26 08:24:36,601][123091] Updated weights for policy 0, policy_version 1104398 (0.0010) [2023-12-26 08:24:37,392][123090] Updated weights for policy 1, policy_version 1096676 (0.0011) [2023-12-26 08:24:37,416][123091] Updated weights for policy 0, policy_version 1104408 (0.0006) [2023-12-26 08:24:37,459][123090] Updated weights for policy 1, policy_version 1096686 (0.0010) [2023-12-26 08:24:37,483][123091] Updated weights for policy 0, policy_version 1104418 (0.0006) [2023-12-26 08:24:37,527][123090] Updated weights for policy 1, policy_version 1096696 (0.0011) [2023-12-26 08:24:37,538][123091] Updated weights for policy 0, policy_version 1104428 (0.0008) [2023-12-26 08:24:38,254][123091] Updated weights for policy 0, policy_version 1104438 (0.0008) [2023-12-26 08:24:38,313][123091] Updated weights for policy 0, policy_version 1104448 (0.0006) [2023-12-26 08:24:38,339][123090] Updated weights for policy 1, policy_version 1096706 (0.0010) [2023-12-26 08:24:38,381][123091] Updated weights for policy 0, policy_version 1104458 (0.0010) [2023-12-26 08:24:38,402][123090] Updated weights for policy 1, policy_version 1096716 (0.0008) [2023-12-26 08:24:38,472][123090] Updated weights for policy 1, policy_version 1096726 (0.0008) [2023-12-26 08:24:38,543][123090] Updated weights for policy 1, policy_version 1096736 (0.0008) [2023-12-26 08:24:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 563511296. Throughput: 0: 8489.8, 1: 9033.7. Samples: 563486332. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:38,785][121949] Avg episode reward: [(0, '6068.493'), (1, '5987.938')] [2023-12-26 08:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001104464_282746880.pth... [2023-12-26 08:24:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001096736_280764416.pth... [2023-12-26 08:24:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001103472_282492928.pth [2023-12-26 08:24:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001095680_280494080.pth [2023-12-26 08:24:39,146][123091] Updated weights for policy 0, policy_version 1104468 (0.0011) [2023-12-26 08:24:39,207][123091] Updated weights for policy 0, policy_version 1104478 (0.0011) [2023-12-26 08:24:39,217][123090] Updated weights for policy 1, policy_version 1096746 (0.0007) [2023-12-26 08:24:39,283][123091] Updated weights for policy 0, policy_version 1104488 (0.0011) [2023-12-26 08:24:39,286][123090] Updated weights for policy 1, policy_version 1096756 (0.0006) [2023-12-26 08:24:39,351][123090] Updated weights for policy 1, policy_version 1096766 (0.0008) [2023-12-26 08:24:40,100][123091] Updated weights for policy 0, policy_version 1104498 (0.0011) [2023-12-26 08:24:40,166][123091] Updated weights for policy 0, policy_version 1104508 (0.0008) [2023-12-26 08:24:40,183][123090] Updated weights for policy 1, policy_version 1096776 (0.0014) [2023-12-26 08:24:40,235][123091] Updated weights for policy 0, policy_version 1104518 (0.0007) [2023-12-26 08:24:40,247][123090] Updated weights for policy 1, policy_version 1096786 (0.0011) [2023-12-26 08:24:40,300][123091] Updated weights for policy 0, policy_version 1104528 (0.0007) [2023-12-26 08:24:40,311][123090] Updated weights for policy 1, policy_version 1096796 (0.0011) [2023-12-26 08:24:41,035][123090] Updated weights for policy 1, policy_version 1096806 (0.0008) [2023-12-26 08:24:41,048][123091] Updated weights for policy 0, policy_version 1104538 (0.0010) [2023-12-26 08:24:41,095][123090] Updated weights for policy 1, policy_version 1096816 (0.0008) [2023-12-26 08:24:41,117][123091] Updated weights for policy 0, policy_version 1104548 (0.0008) [2023-12-26 08:24:41,172][123090] Updated weights for policy 1, policy_version 1096826 (0.0010) [2023-12-26 08:24:41,187][123091] Updated weights for policy 0, policy_version 1104558 (0.0008) [2023-12-26 08:24:42,037][123091] Updated weights for policy 0, policy_version 1104568 (0.0009) [2023-12-26 08:24:42,069][123090] Updated weights for policy 1, policy_version 1096836 (0.0010) [2023-12-26 08:24:42,094][123091] Updated weights for policy 0, policy_version 1104578 (0.0009) [2023-12-26 08:24:42,133][123090] Updated weights for policy 1, policy_version 1096846 (0.0010) [2023-12-26 08:24:42,161][123091] Updated weights for policy 0, policy_version 1104588 (0.0007) [2023-12-26 08:24:42,203][123090] Updated weights for policy 1, policy_version 1096856 (0.0010) [2023-12-26 08:24:42,951][123091] Updated weights for policy 0, policy_version 1104598 (0.0006) [2023-12-26 08:24:42,962][123090] Updated weights for policy 1, policy_version 1096866 (0.0008) [2023-12-26 08:24:43,016][123091] Updated weights for policy 0, policy_version 1104608 (0.0006) [2023-12-26 08:24:43,021][123090] Updated weights for policy 1, policy_version 1096876 (0.0005) [2023-12-26 08:24:43,080][123091] Updated weights for policy 0, policy_version 1104618 (0.0006) [2023-12-26 08:24:43,085][123090] Updated weights for policy 1, policy_version 1096886 (0.0006) [2023-12-26 08:24:43,149][123090] Updated weights for policy 1, policy_version 1096896 (0.0008) [2023-12-26 08:24:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 563593216. Throughput: 0: 8511.5, 1: 9060.9. Samples: 563591064. Policy #0 lag: (min: 11.0, avg: 19.7, max: 43.0) [2023-12-26 08:24:43,785][121949] Avg episode reward: [(0, '6172.268'), (1, '5994.439')] [2023-12-26 08:24:43,788][123091] Updated weights for policy 0, policy_version 1104628 (0.0007) [2023-12-26 08:24:43,849][123091] Updated weights for policy 0, policy_version 1104638 (0.0008) [2023-12-26 08:24:43,909][123091] Updated weights for policy 0, policy_version 1104648 (0.0006) [2023-12-26 08:24:43,928][123090] Updated weights for policy 1, policy_version 1096906 (0.0010) [2023-12-26 08:24:43,986][123090] Updated weights for policy 1, policy_version 1096916 (0.0010) [2023-12-26 08:24:44,057][123090] Updated weights for policy 1, policy_version 1096926 (0.0008) [2023-12-26 08:24:44,547][123091] Updated weights for policy 0, policy_version 1104658 (0.0008) [2023-12-26 08:24:44,609][123091] Updated weights for policy 0, policy_version 1104668 (0.0009) [2023-12-26 08:24:44,667][123091] Updated weights for policy 0, policy_version 1104678 (0.0005) [2023-12-26 08:24:44,716][123091] Updated weights for policy 0, policy_version 1104688 (0.0005) [2023-12-26 08:24:44,853][123090] Updated weights for policy 1, policy_version 1096936 (0.0008) [2023-12-26 08:24:44,926][123090] Updated weights for policy 1, policy_version 1096946 (0.0008) [2023-12-26 08:24:45,000][123090] Updated weights for policy 1, policy_version 1096956 (0.0008) [2023-12-26 08:24:45,465][123091] Updated weights for policy 0, policy_version 1104698 (0.0010) [2023-12-26 08:24:45,520][123091] Updated weights for policy 0, policy_version 1104708 (0.0010) [2023-12-26 08:24:45,579][123091] Updated weights for policy 0, policy_version 1104718 (0.0010) [2023-12-26 08:24:45,684][123090] Updated weights for policy 1, policy_version 1096966 (0.0007) [2023-12-26 08:24:45,755][123090] Updated weights for policy 1, policy_version 1096976 (0.0007) [2023-12-26 08:24:45,816][123090] Updated weights for policy 1, policy_version 1096986 (0.0007) [2023-12-26 08:24:46,365][123091] Updated weights for policy 0, policy_version 1104728 (0.0010) [2023-12-26 08:24:46,417][123091] Updated weights for policy 0, policy_version 1104738 (0.0010) [2023-12-26 08:24:46,476][123091] Updated weights for policy 0, policy_version 1104748 (0.0010) [2023-12-26 08:24:46,478][123090] Updated weights for policy 1, policy_version 1096996 (0.0006) [2023-12-26 08:24:46,533][123090] Updated weights for policy 1, policy_version 1097006 (0.0007) [2023-12-26 08:24:46,597][123090] Updated weights for policy 1, policy_version 1097016 (0.0009) [2023-12-26 08:24:47,336][123091] Updated weights for policy 0, policy_version 1104758 (0.0010) [2023-12-26 08:24:47,410][123091] Updated weights for policy 0, policy_version 1104768 (0.0009) [2023-12-26 08:24:47,433][123090] Updated weights for policy 1, policy_version 1097026 (0.0009) [2023-12-26 08:24:47,500][123090] Updated weights for policy 1, policy_version 1097036 (0.0006) [2023-12-26 08:24:47,505][123091] Updated weights for policy 0, policy_version 1104778 (0.0008) [2023-12-26 08:24:47,557][123090] Updated weights for policy 1, policy_version 1097046 (0.0007) [2023-12-26 08:24:47,620][123090] Updated weights for policy 1, policy_version 1097056 (0.0006) [2023-12-26 08:24:48,227][123091] Updated weights for policy 0, policy_version 1104788 (0.0007) [2023-12-26 08:24:48,280][123091] Updated weights for policy 0, policy_version 1104798 (0.0005) [2023-12-26 08:24:48,358][123091] Updated weights for policy 0, policy_version 1104808 (0.0008) [2023-12-26 08:24:48,445][123090] Updated weights for policy 1, policy_version 1097066 (0.0009) [2023-12-26 08:24:48,505][123090] Updated weights for policy 1, policy_version 1097076 (0.0009) [2023-12-26 08:24:48,573][123090] Updated weights for policy 1, policy_version 1097086 (0.0011) [2023-12-26 08:24:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 563691520. Throughput: 0: 8636.3, 1: 9051.2. Samples: 563701184. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:24:48,785][121949] Avg episode reward: [(0, '6183.652'), (1, '5879.149')] [2023-12-26 08:24:49,093][123091] Updated weights for policy 0, policy_version 1104818 (0.0009) [2023-12-26 08:24:49,168][123091] Updated weights for policy 0, policy_version 1104828 (0.0010) [2023-12-26 08:24:49,237][123091] Updated weights for policy 0, policy_version 1104838 (0.0010) [2023-12-26 08:24:49,296][123091] Updated weights for policy 0, policy_version 1104848 (0.0010) [2023-12-26 08:24:49,340][123090] Updated weights for policy 1, policy_version 1097096 (0.0009) [2023-12-26 08:24:49,412][123090] Updated weights for policy 1, policy_version 1097106 (0.0010) [2023-12-26 08:24:49,478][123090] Updated weights for policy 1, policy_version 1097116 (0.0009) [2023-12-26 08:24:50,038][123091] Updated weights for policy 0, policy_version 1104858 (0.0006) [2023-12-26 08:24:50,100][123091] Updated weights for policy 0, policy_version 1104868 (0.0006) [2023-12-26 08:24:50,158][123091] Updated weights for policy 0, policy_version 1104878 (0.0006) [2023-12-26 08:24:50,409][123090] Updated weights for policy 1, policy_version 1097126 (0.0009) [2023-12-26 08:24:50,479][123090] Updated weights for policy 1, policy_version 1097136 (0.0009) [2023-12-26 08:24:50,550][123090] Updated weights for policy 1, policy_version 1097146 (0.0009) [2023-12-26 08:24:50,885][123091] Updated weights for policy 0, policy_version 1104888 (0.0006) [2023-12-26 08:24:50,951][123091] Updated weights for policy 0, policy_version 1104898 (0.0010) [2023-12-26 08:24:51,017][123091] Updated weights for policy 0, policy_version 1104908 (0.0009) [2023-12-26 08:24:51,428][123090] Updated weights for policy 1, policy_version 1097156 (0.0009) [2023-12-26 08:24:51,504][123090] Updated weights for policy 1, policy_version 1097166 (0.0009) [2023-12-26 08:24:51,570][123090] Updated weights for policy 1, policy_version 1097176 (0.0009) [2023-12-26 08:24:51,836][123091] Updated weights for policy 0, policy_version 1104918 (0.0010) [2023-12-26 08:24:51,884][123091] Updated weights for policy 0, policy_version 1104928 (0.0009) [2023-12-26 08:24:51,934][123091] Updated weights for policy 0, policy_version 1104938 (0.0010) [2023-12-26 08:24:52,404][123090] Updated weights for policy 1, policy_version 1097186 (0.0010) [2023-12-26 08:24:52,454][123090] Updated weights for policy 1, policy_version 1097196 (0.0008) [2023-12-26 08:24:52,504][123090] Updated weights for policy 1, policy_version 1097206 (0.0008) [2023-12-26 08:24:52,553][123090] Updated weights for policy 1, policy_version 1097216 (0.0009) [2023-12-26 08:24:52,787][123091] Updated weights for policy 0, policy_version 1104949 (0.0010) [2023-12-26 08:24:52,853][123091] Updated weights for policy 0, policy_version 1104959 (0.0009) [2023-12-26 08:24:52,908][123091] Updated weights for policy 0, policy_version 1104969 (0.0010) [2023-12-26 08:24:53,450][123090] Updated weights for policy 1, policy_version 1097226 (0.0010) [2023-12-26 08:24:53,521][123090] Updated weights for policy 1, policy_version 1097236 (0.0006) [2023-12-26 08:24:53,570][123090] Updated weights for policy 1, policy_version 1097246 (0.0005) [2023-12-26 08:24:53,706][123091] Updated weights for policy 0, policy_version 1104979 (0.0008) [2023-12-26 08:24:53,765][123091] Updated weights for policy 0, policy_version 1104989 (0.0005) [2023-12-26 08:24:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 563773440. Throughput: 0: 8707.7, 1: 8970.0. Samples: 563753036. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:24:53,784][121949] Avg episode reward: [(0, '6113.609'), (1, '5697.495')] [2023-12-26 08:24:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001097248_280895488.pth... [2023-12-26 08:24:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001096192_280625152.pth [2023-12-26 08:24:53,815][123091] Updated weights for policy 0, policy_version 1104999 (0.0005) [2023-12-26 08:24:53,855][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001105008_282886144.pth... [2023-12-26 08:24:53,858][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001103952_282615808.pth [2023-12-26 08:24:54,338][123090] Updated weights for policy 1, policy_version 1097256 (0.0005) [2023-12-26 08:24:54,396][123090] Updated weights for policy 1, policy_version 1097266 (0.0005) [2023-12-26 08:24:54,463][123091] Updated weights for policy 0, policy_version 1105009 (0.0006) [2023-12-26 08:24:54,470][123090] Updated weights for policy 1, policy_version 1097276 (0.0009) [2023-12-26 08:24:54,533][123091] Updated weights for policy 0, policy_version 1105019 (0.0010) [2023-12-26 08:24:54,595][123091] Updated weights for policy 0, policy_version 1105029 (0.0010) [2023-12-26 08:24:54,662][123091] Updated weights for policy 0, policy_version 1105039 (0.0010) [2023-12-26 08:24:55,187][123090] Updated weights for policy 1, policy_version 1097286 (0.0009) [2023-12-26 08:24:55,242][123090] Updated weights for policy 1, policy_version 1097296 (0.0009) [2023-12-26 08:24:55,292][123090] Updated weights for policy 1, policy_version 1097306 (0.0009) [2023-12-26 08:24:55,442][123091] Updated weights for policy 0, policy_version 1105049 (0.0010) [2023-12-26 08:24:55,498][123091] Updated weights for policy 0, policy_version 1105059 (0.0009) [2023-12-26 08:24:55,563][123091] Updated weights for policy 0, policy_version 1105069 (0.0009) [2023-12-26 08:24:56,128][123090] Updated weights for policy 1, policy_version 1097316 (0.0010) [2023-12-26 08:24:56,176][123090] Updated weights for policy 1, policy_version 1097326 (0.0009) [2023-12-26 08:24:56,229][123090] Updated weights for policy 1, policy_version 1097336 (0.0009) [2023-12-26 08:24:56,381][123091] Updated weights for policy 0, policy_version 1105079 (0.0010) [2023-12-26 08:24:56,439][123091] Updated weights for policy 0, policy_version 1105089 (0.0009) [2023-12-26 08:24:56,498][123091] Updated weights for policy 0, policy_version 1105099 (0.0009) [2023-12-26 08:24:57,066][123090] Updated weights for policy 1, policy_version 1097346 (0.0009) [2023-12-26 08:24:57,117][123090] Updated weights for policy 1, policy_version 1097356 (0.0009) [2023-12-26 08:24:57,165][123090] Updated weights for policy 1, policy_version 1097366 (0.0009) [2023-12-26 08:24:57,212][123090] Updated weights for policy 1, policy_version 1097376 (0.0008) [2023-12-26 08:24:57,330][123091] Updated weights for policy 0, policy_version 1105109 (0.0009) [2023-12-26 08:24:57,383][123091] Updated weights for policy 0, policy_version 1105119 (0.0010) [2023-12-26 08:24:57,440][123091] Updated weights for policy 0, policy_version 1105129 (0.0010) [2023-12-26 08:24:57,915][123090] Updated weights for policy 1, policy_version 1097386 (0.0005) [2023-12-26 08:24:57,989][123090] Updated weights for policy 1, policy_version 1097396 (0.0006) [2023-12-26 08:24:58,061][123090] Updated weights for policy 1, policy_version 1097407 (0.0009) [2023-12-26 08:24:58,175][123091] Updated weights for policy 0, policy_version 1105140 (0.0010) [2023-12-26 08:24:58,240][123091] Updated weights for policy 0, policy_version 1105150 (0.0008) [2023-12-26 08:24:58,308][123091] Updated weights for policy 0, policy_version 1105160 (0.0008) [2023-12-26 08:24:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 563863552. Throughput: 0: 8785.9, 1: 8965.5. Samples: 563858956. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:24:58,785][121949] Avg episode reward: [(0, '5981.261'), (1, '5550.652')] [2023-12-26 08:24:58,864][123090] Updated weights for policy 1, policy_version 1097417 (0.0008) [2023-12-26 08:24:58,928][123090] Updated weights for policy 1, policy_version 1097427 (0.0009) [2023-12-26 08:24:58,996][123090] Updated weights for policy 1, policy_version 1097437 (0.0009) [2023-12-26 08:24:59,081][123091] Updated weights for policy 0, policy_version 1105170 (0.0007) [2023-12-26 08:24:59,142][123091] Updated weights for policy 0, policy_version 1105180 (0.0006) [2023-12-26 08:24:59,200][123091] Updated weights for policy 0, policy_version 1105190 (0.0005) [2023-12-26 08:24:59,273][123091] Updated weights for policy 0, policy_version 1105200 (0.0009) [2023-12-26 08:24:59,818][123090] Updated weights for policy 1, policy_version 1097447 (0.0006) [2023-12-26 08:24:59,875][123090] Updated weights for policy 1, policy_version 1097457 (0.0007) [2023-12-26 08:24:59,941][123090] Updated weights for policy 1, policy_version 1097467 (0.0008) [2023-12-26 08:25:00,126][123091] Updated weights for policy 0, policy_version 1105210 (0.0009) [2023-12-26 08:25:00,191][123091] Updated weights for policy 0, policy_version 1105220 (0.0010) [2023-12-26 08:25:00,268][123091] Updated weights for policy 0, policy_version 1105230 (0.0005) [2023-12-26 08:25:00,581][123090] Updated weights for policy 1, policy_version 1097477 (0.0008) [2023-12-26 08:25:00,643][123090] Updated weights for policy 1, policy_version 1097487 (0.0008) [2023-12-26 08:25:00,709][123090] Updated weights for policy 1, policy_version 1097497 (0.0008) [2023-12-26 08:25:01,011][123091] Updated weights for policy 0, policy_version 1105240 (0.0008) [2023-12-26 08:25:01,080][123091] Updated weights for policy 0, policy_version 1105250 (0.0008) [2023-12-26 08:25:01,142][123091] Updated weights for policy 0, policy_version 1105260 (0.0009) [2023-12-26 08:25:01,432][123090] Updated weights for policy 1, policy_version 1097507 (0.0009) [2023-12-26 08:25:01,484][123090] Updated weights for policy 1, policy_version 1097517 (0.0009) [2023-12-26 08:25:01,539][123090] Updated weights for policy 1, policy_version 1097527 (0.0010) [2023-12-26 08:25:01,947][123091] Updated weights for policy 0, policy_version 1105270 (0.0010) [2023-12-26 08:25:02,018][123091] Updated weights for policy 0, policy_version 1105280 (0.0009) [2023-12-26 08:25:02,081][123091] Updated weights for policy 0, policy_version 1105290 (0.0009) [2023-12-26 08:25:02,413][123090] Updated weights for policy 1, policy_version 1097537 (0.0009) [2023-12-26 08:25:02,484][123090] Updated weights for policy 1, policy_version 1097547 (0.0009) [2023-12-26 08:25:02,544][123090] Updated weights for policy 1, policy_version 1097557 (0.0009) [2023-12-26 08:25:02,604][123090] Updated weights for policy 1, policy_version 1097567 (0.0009) [2023-12-26 08:25:02,930][123091] Updated weights for policy 0, policy_version 1105300 (0.0008) [2023-12-26 08:25:02,990][123091] Updated weights for policy 0, policy_version 1105310 (0.0005) [2023-12-26 08:25:03,047][123091] Updated weights for policy 0, policy_version 1105320 (0.0005) [2023-12-26 08:25:03,398][123090] Updated weights for policy 1, policy_version 1097577 (0.0006) [2023-12-26 08:25:03,448][123090] Updated weights for policy 1, policy_version 1097587 (0.0005) [2023-12-26 08:25:03,508][123090] Updated weights for policy 1, policy_version 1097597 (0.0005) [2023-12-26 08:25:03,694][123091] Updated weights for policy 0, policy_version 1105330 (0.0006) [2023-12-26 08:25:03,749][123091] Updated weights for policy 0, policy_version 1105340 (0.0008) [2023-12-26 08:25:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 563953664. Throughput: 0: 8868.8, 1: 8957.3. Samples: 563968132. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:03,785][121949] Avg episode reward: [(0, '5939.584'), (1, '5513.522')] [2023-12-26 08:25:03,821][123091] Updated weights for policy 0, policy_version 1105350 (0.0007) [2023-12-26 08:25:03,890][123091] Updated weights for policy 0, policy_version 1105360 (0.0010) [2023-12-26 08:25:04,221][123090] Updated weights for policy 1, policy_version 1097607 (0.0008) [2023-12-26 08:25:04,271][123090] Updated weights for policy 1, policy_version 1097617 (0.0008) [2023-12-26 08:25:04,331][123090] Updated weights for policy 1, policy_version 1097627 (0.0009) [2023-12-26 08:25:04,648][123091] Updated weights for policy 0, policy_version 1105370 (0.0006) [2023-12-26 08:25:04,714][123091] Updated weights for policy 0, policy_version 1105380 (0.0005) [2023-12-26 08:25:04,787][123091] Updated weights for policy 0, policy_version 1105390 (0.0006) [2023-12-26 08:25:05,026][123090] Updated weights for policy 1, policy_version 1097637 (0.0007) [2023-12-26 08:25:05,073][123090] Updated weights for policy 1, policy_version 1097647 (0.0005) [2023-12-26 08:25:05,124][123090] Updated weights for policy 1, policy_version 1097657 (0.0005) [2023-12-26 08:25:05,500][123091] Updated weights for policy 0, policy_version 1105400 (0.0010) [2023-12-26 08:25:05,554][123091] Updated weights for policy 0, policy_version 1105410 (0.0008) [2023-12-26 08:25:05,629][123091] Updated weights for policy 0, policy_version 1105420 (0.0006) [2023-12-26 08:25:05,792][123090] Updated weights for policy 1, policy_version 1097667 (0.0006) [2023-12-26 08:25:05,861][123090] Updated weights for policy 1, policy_version 1097677 (0.0008) [2023-12-26 08:25:05,918][123090] Updated weights for policy 1, policy_version 1097687 (0.0005) [2023-12-26 08:25:06,307][123091] Updated weights for policy 0, policy_version 1105430 (0.0007) [2023-12-26 08:25:06,375][123091] Updated weights for policy 0, policy_version 1105440 (0.0009) [2023-12-26 08:25:06,444][123091] Updated weights for policy 0, policy_version 1105450 (0.0010) [2023-12-26 08:25:06,569][123090] Updated weights for policy 1, policy_version 1097697 (0.0006) [2023-12-26 08:25:06,639][123090] Updated weights for policy 1, policy_version 1097707 (0.0010) [2023-12-26 08:25:06,700][123090] Updated weights for policy 1, policy_version 1097717 (0.0009) [2023-12-26 08:25:06,763][123090] Updated weights for policy 1, policy_version 1097727 (0.0009) [2023-12-26 08:25:07,280][123091] Updated weights for policy 0, policy_version 1105460 (0.0010) [2023-12-26 08:25:07,329][123091] Updated weights for policy 0, policy_version 1105470 (0.0009) [2023-12-26 08:25:07,393][123091] Updated weights for policy 0, policy_version 1105480 (0.0009) [2023-12-26 08:25:07,617][123090] Updated weights for policy 1, policy_version 1097737 (0.0009) [2023-12-26 08:25:07,676][123090] Updated weights for policy 1, policy_version 1097747 (0.0010) [2023-12-26 08:25:07,740][123090] Updated weights for policy 1, policy_version 1097757 (0.0009) [2023-12-26 08:25:08,253][123091] Updated weights for policy 0, policy_version 1105490 (0.0009) [2023-12-26 08:25:08,317][123091] Updated weights for policy 0, policy_version 1105500 (0.0010) [2023-12-26 08:25:08,376][123091] Updated weights for policy 0, policy_version 1105510 (0.0009) [2023-12-26 08:25:08,443][123091] Updated weights for policy 0, policy_version 1105520 (0.0010) [2023-12-26 08:25:08,557][123090] Updated weights for policy 1, policy_version 1097767 (0.0009) [2023-12-26 08:25:08,623][123090] Updated weights for policy 1, policy_version 1097777 (0.0010) [2023-12-26 08:25:08,691][123090] Updated weights for policy 1, policy_version 1097787 (0.0010) [2023-12-26 08:25:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 564051968. Throughput: 0: 8903.1, 1: 9060.3. Samples: 564025808. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:08,784][121949] Avg episode reward: [(0, '6173.585'), (1, '5678.904')] [2023-12-26 08:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001105520_283017216.pth... [2023-12-26 08:25:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001097792_281034752.pth... [2023-12-26 08:25:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001104464_282746880.pth [2023-12-26 08:25:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001096736_280764416.pth [2023-12-26 08:25:09,275][123091] Updated weights for policy 0, policy_version 1105530 (0.0009) [2023-12-26 08:25:09,341][123091] Updated weights for policy 0, policy_version 1105540 (0.0009) [2023-12-26 08:25:09,411][123091] Updated weights for policy 0, policy_version 1105550 (0.0010) [2023-12-26 08:25:09,494][123090] Updated weights for policy 1, policy_version 1097797 (0.0009) [2023-12-26 08:25:09,548][123090] Updated weights for policy 1, policy_version 1097807 (0.0010) [2023-12-26 08:25:09,605][123090] Updated weights for policy 1, policy_version 1097817 (0.0009) [2023-12-26 08:25:10,269][123091] Updated weights for policy 0, policy_version 1105560 (0.0009) [2023-12-26 08:25:10,335][123091] Updated weights for policy 0, policy_version 1105570 (0.0009) [2023-12-26 08:25:10,392][123091] Updated weights for policy 0, policy_version 1105580 (0.0009) [2023-12-26 08:25:10,461][123090] Updated weights for policy 1, policy_version 1097827 (0.0010) [2023-12-26 08:25:10,513][123090] Updated weights for policy 1, policy_version 1097837 (0.0010) [2023-12-26 08:25:10,569][123090] Updated weights for policy 1, policy_version 1097847 (0.0010) [2023-12-26 08:25:11,266][123091] Updated weights for policy 0, policy_version 1105590 (0.0009) [2023-12-26 08:25:11,335][123091] Updated weights for policy 0, policy_version 1105600 (0.0009) [2023-12-26 08:25:11,410][123090] Updated weights for policy 1, policy_version 1097857 (0.0011) [2023-12-26 08:25:11,412][123091] Updated weights for policy 0, policy_version 1105610 (0.0009) [2023-12-26 08:25:11,475][123090] Updated weights for policy 1, policy_version 1097867 (0.0011) [2023-12-26 08:25:11,543][123090] Updated weights for policy 1, policy_version 1097877 (0.0011) [2023-12-26 08:25:11,605][123090] Updated weights for policy 1, policy_version 1097887 (0.0011) [2023-12-26 08:25:12,200][123091] Updated weights for policy 0, policy_version 1105620 (0.0007) [2023-12-26 08:25:12,271][123091] Updated weights for policy 0, policy_version 1105630 (0.0009) [2023-12-26 08:25:12,336][123091] Updated weights for policy 0, policy_version 1105640 (0.0010) [2023-12-26 08:25:12,433][123090] Updated weights for policy 1, policy_version 1097897 (0.0010) [2023-12-26 08:25:12,501][123090] Updated weights for policy 1, policy_version 1097907 (0.0009) [2023-12-26 08:25:12,561][123090] Updated weights for policy 1, policy_version 1097917 (0.0009) [2023-12-26 08:25:13,102][123091] Updated weights for policy 0, policy_version 1105650 (0.0007) [2023-12-26 08:25:13,173][123091] Updated weights for policy 0, policy_version 1105660 (0.0006) [2023-12-26 08:25:13,231][123091] Updated weights for policy 0, policy_version 1105670 (0.0010) [2023-12-26 08:25:13,285][123091] Updated weights for policy 0, policy_version 1105680 (0.0009) [2023-12-26 08:25:13,457][123090] Updated weights for policy 1, policy_version 1097927 (0.0007) [2023-12-26 08:25:13,517][123090] Updated weights for policy 1, policy_version 1097937 (0.0005) [2023-12-26 08:25:13,575][123090] Updated weights for policy 1, policy_version 1097947 (0.0007) [2023-12-26 08:25:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 564133888. Throughput: 0: 8933.0, 1: 8867.0. Samples: 564126124. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:13,785][121949] Avg episode reward: [(0, '6211.794'), (1, '5847.521')] [2023-12-26 08:25:14,081][123091] Updated weights for policy 0, policy_version 1105690 (0.0005) [2023-12-26 08:25:14,129][123091] Updated weights for policy 0, policy_version 1105700 (0.0008) [2023-12-26 08:25:14,180][123091] Updated weights for policy 0, policy_version 1105710 (0.0010) [2023-12-26 08:25:14,292][123090] Updated weights for policy 1, policy_version 1097957 (0.0010) [2023-12-26 08:25:14,346][123090] Updated weights for policy 1, policy_version 1097967 (0.0007) [2023-12-26 08:25:14,417][123090] Updated weights for policy 1, policy_version 1097977 (0.0006) [2023-12-26 08:25:14,951][123091] Updated weights for policy 0, policy_version 1105720 (0.0006) [2023-12-26 08:25:15,009][123091] Updated weights for policy 0, policy_version 1105730 (0.0008) [2023-12-26 08:25:15,066][123091] Updated weights for policy 0, policy_version 1105740 (0.0006) [2023-12-26 08:25:15,178][123090] Updated weights for policy 1, policy_version 1097987 (0.0010) [2023-12-26 08:25:15,240][123090] Updated weights for policy 1, policy_version 1097997 (0.0008) [2023-12-26 08:25:15,291][123090] Updated weights for policy 1, policy_version 1098007 (0.0007) [2023-12-26 08:25:15,876][123091] Updated weights for policy 0, policy_version 1105750 (0.0006) [2023-12-26 08:25:15,938][123091] Updated weights for policy 0, policy_version 1105760 (0.0007) [2023-12-26 08:25:15,999][123091] Updated weights for policy 0, policy_version 1105770 (0.0007) [2023-12-26 08:25:16,043][123090] Updated weights for policy 1, policy_version 1098017 (0.0006) [2023-12-26 08:25:16,091][123090] Updated weights for policy 1, policy_version 1098027 (0.0010) [2023-12-26 08:25:16,146][123090] Updated weights for policy 1, policy_version 1098037 (0.0010) [2023-12-26 08:25:16,201][123090] Updated weights for policy 1, policy_version 1098047 (0.0010) [2023-12-26 08:25:16,643][123091] Updated weights for policy 0, policy_version 1105780 (0.0005) [2023-12-26 08:25:16,691][123091] Updated weights for policy 0, policy_version 1105790 (0.0005) [2023-12-26 08:25:16,749][123091] Updated weights for policy 0, policy_version 1105800 (0.0007) [2023-12-26 08:25:17,063][123090] Updated weights for policy 1, policy_version 1098057 (0.0011) [2023-12-26 08:25:17,115][123090] Updated weights for policy 1, policy_version 1098067 (0.0010) [2023-12-26 08:25:17,171][123090] Updated weights for policy 1, policy_version 1098077 (0.0011) [2023-12-26 08:25:17,526][123091] Updated weights for policy 0, policy_version 1105810 (0.0009) [2023-12-26 08:25:17,579][123091] Updated weights for policy 0, policy_version 1105820 (0.0006) [2023-12-26 08:25:17,639][123091] Updated weights for policy 0, policy_version 1105830 (0.0006) [2023-12-26 08:25:17,694][123091] Updated weights for policy 0, policy_version 1105840 (0.0006) [2023-12-26 08:25:18,040][123090] Updated weights for policy 1, policy_version 1098087 (0.0007) [2023-12-26 08:25:18,111][123090] Updated weights for policy 1, policy_version 1098097 (0.0010) [2023-12-26 08:25:18,177][123090] Updated weights for policy 1, policy_version 1098107 (0.0009) [2023-12-26 08:25:18,416][123091] Updated weights for policy 0, policy_version 1105850 (0.0010) [2023-12-26 08:25:18,476][123091] Updated weights for policy 0, policy_version 1105860 (0.0009) [2023-12-26 08:25:18,540][123091] Updated weights for policy 0, policy_version 1105870 (0.0010) [2023-12-26 08:25:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 564224000. Throughput: 0: 8944.1, 1: 8888.9. Samples: 564235480. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:18,785][121949] Avg episode reward: [(0, '6165.869'), (1, '5800.554')] [2023-12-26 08:25:18,980][123090] Updated weights for policy 1, policy_version 1098117 (0.0009) [2023-12-26 08:25:19,038][123090] Updated weights for policy 1, policy_version 1098127 (0.0010) [2023-12-26 08:25:19,099][123090] Updated weights for policy 1, policy_version 1098137 (0.0009) [2023-12-26 08:25:19,393][123091] Updated weights for policy 0, policy_version 1105880 (0.0010) [2023-12-26 08:25:19,454][123091] Updated weights for policy 0, policy_version 1105890 (0.0009) [2023-12-26 08:25:19,525][123091] Updated weights for policy 0, policy_version 1105900 (0.0010) [2023-12-26 08:25:19,957][123090] Updated weights for policy 1, policy_version 1098147 (0.0009) [2023-12-26 08:25:20,026][123090] Updated weights for policy 1, policy_version 1098157 (0.0010) [2023-12-26 08:25:20,094][123090] Updated weights for policy 1, policy_version 1098167 (0.0009) [2023-12-26 08:25:20,337][123091] Updated weights for policy 0, policy_version 1105910 (0.0008) [2023-12-26 08:25:20,388][123091] Updated weights for policy 0, policy_version 1105920 (0.0005) [2023-12-26 08:25:20,456][123091] Updated weights for policy 0, policy_version 1105930 (0.0006) [2023-12-26 08:25:20,981][123090] Updated weights for policy 1, policy_version 1098177 (0.0010) [2023-12-26 08:25:21,056][123090] Updated weights for policy 1, policy_version 1098187 (0.0008) [2023-12-26 08:25:21,127][123090] Updated weights for policy 1, policy_version 1098197 (0.0008) [2023-12-26 08:25:21,191][123090] Updated weights for policy 1, policy_version 1098207 (0.0008) [2023-12-26 08:25:21,277][123091] Updated weights for policy 0, policy_version 1105940 (0.0008) [2023-12-26 08:25:21,348][123091] Updated weights for policy 0, policy_version 1105950 (0.0011) [2023-12-26 08:25:21,425][123091] Updated weights for policy 0, policy_version 1105960 (0.0011) [2023-12-26 08:25:22,000][123090] Updated weights for policy 1, policy_version 1098217 (0.0009) [2023-12-26 08:25:22,065][123090] Updated weights for policy 1, policy_version 1098227 (0.0010) [2023-12-26 08:25:22,127][123090] Updated weights for policy 1, policy_version 1098237 (0.0008) [2023-12-26 08:25:22,260][123091] Updated weights for policy 0, policy_version 1105970 (0.0010) [2023-12-26 08:25:22,330][123091] Updated weights for policy 0, policy_version 1105980 (0.0007) [2023-12-26 08:25:22,390][123091] Updated weights for policy 0, policy_version 1105990 (0.0010) [2023-12-26 08:25:22,445][123091] Updated weights for policy 0, policy_version 1106000 (0.0010) [2023-12-26 08:25:22,856][123090] Updated weights for policy 1, policy_version 1098247 (0.0006) [2023-12-26 08:25:22,925][123090] Updated weights for policy 1, policy_version 1098257 (0.0009) [2023-12-26 08:25:22,992][123090] Updated weights for policy 1, policy_version 1098267 (0.0009) [2023-12-26 08:25:23,260][123091] Updated weights for policy 0, policy_version 1106010 (0.0005) [2023-12-26 08:25:23,318][123091] Updated weights for policy 0, policy_version 1106020 (0.0007) [2023-12-26 08:25:23,392][123091] Updated weights for policy 0, policy_version 1106030 (0.0011) [2023-12-26 08:25:23,735][123090] Updated weights for policy 1, policy_version 1098277 (0.0008) [2023-12-26 08:25:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 564305920. Throughput: 0: 8945.4, 1: 8829.0. Samples: 564286180. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:23,785][121949] Avg episode reward: [(0, '6212.263'), (1, '5854.038')] [2023-12-26 08:25:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001106032_283148288.pth... [2023-12-26 08:25:23,791][123090] Updated weights for policy 1, policy_version 1098287 (0.0008) [2023-12-26 08:25:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001105008_282886144.pth [2023-12-26 08:25:23,847][123090] Updated weights for policy 1, policy_version 1098297 (0.0009) [2023-12-26 08:25:23,888][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001098304_281165824.pth... [2023-12-26 08:25:23,893][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001097248_280895488.pth [2023-12-26 08:25:24,179][123091] Updated weights for policy 0, policy_version 1106040 (0.0009) [2023-12-26 08:25:24,233][123091] Updated weights for policy 0, policy_version 1106050 (0.0005) [2023-12-26 08:25:24,298][123091] Updated weights for policy 0, policy_version 1106060 (0.0005) [2023-12-26 08:25:24,687][123090] Updated weights for policy 1, policy_version 1098307 (0.0007) [2023-12-26 08:25:24,744][123090] Updated weights for policy 1, policy_version 1098317 (0.0009) [2023-12-26 08:25:24,802][123090] Updated weights for policy 1, policy_version 1098327 (0.0010) [2023-12-26 08:25:24,922][123091] Updated weights for policy 0, policy_version 1106070 (0.0008) [2023-12-26 08:25:24,984][123091] Updated weights for policy 0, policy_version 1106080 (0.0011) [2023-12-26 08:25:25,054][123091] Updated weights for policy 0, policy_version 1106090 (0.0011) [2023-12-26 08:25:25,550][123090] Updated weights for policy 1, policy_version 1098337 (0.0009) [2023-12-26 08:25:25,607][123090] Updated weights for policy 1, policy_version 1098347 (0.0005) [2023-12-26 08:25:25,664][123090] Updated weights for policy 1, policy_version 1098357 (0.0005) [2023-12-26 08:25:25,731][123090] Updated weights for policy 1, policy_version 1098367 (0.0005) [2023-12-26 08:25:25,787][123091] Updated weights for policy 0, policy_version 1106100 (0.0008) [2023-12-26 08:25:25,848][123091] Updated weights for policy 0, policy_version 1106110 (0.0005) [2023-12-26 08:25:25,911][123091] Updated weights for policy 0, policy_version 1106120 (0.0006) [2023-12-26 08:25:26,525][123091] Updated weights for policy 0, policy_version 1106130 (0.0006) [2023-12-26 08:25:26,564][123090] Updated weights for policy 1, policy_version 1098377 (0.0009) [2023-12-26 08:25:26,578][123091] Updated weights for policy 0, policy_version 1106140 (0.0006) [2023-12-26 08:25:26,619][123090] Updated weights for policy 1, policy_version 1098387 (0.0007) [2023-12-26 08:25:26,638][123091] Updated weights for policy 0, policy_version 1106150 (0.0009) [2023-12-26 08:25:26,679][123090] Updated weights for policy 1, policy_version 1098397 (0.0005) [2023-12-26 08:25:26,694][123091] Updated weights for policy 0, policy_version 1106160 (0.0010) [2023-12-26 08:25:27,472][123091] Updated weights for policy 0, policy_version 1106170 (0.0006) [2023-12-26 08:25:27,473][123090] Updated weights for policy 1, policy_version 1098407 (0.0006) [2023-12-26 08:25:27,531][123091] Updated weights for policy 0, policy_version 1106180 (0.0007) [2023-12-26 08:25:27,537][123090] Updated weights for policy 1, policy_version 1098417 (0.0006) [2023-12-26 08:25:27,593][123091] Updated weights for policy 0, policy_version 1106190 (0.0006) [2023-12-26 08:25:27,603][123090] Updated weights for policy 1, policy_version 1098427 (0.0005) [2023-12-26 08:25:28,226][123090] Updated weights for policy 1, policy_version 1098437 (0.0005) [2023-12-26 08:25:28,261][123091] Updated weights for policy 0, policy_version 1106200 (0.0009) [2023-12-26 08:25:28,291][123090] Updated weights for policy 1, policy_version 1098447 (0.0005) [2023-12-26 08:25:28,310][123091] Updated weights for policy 0, policy_version 1106210 (0.0008) [2023-12-26 08:25:28,355][123090] Updated weights for policy 1, policy_version 1098457 (0.0006) [2023-12-26 08:25:28,374][123091] Updated weights for policy 0, policy_version 1106220 (0.0008) [2023-12-26 08:25:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 564404224. Throughput: 0: 9016.7, 1: 8861.9. Samples: 564395604. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:28,785][121949] Avg episode reward: [(0, '6155.782'), (1, '5922.868')] [2023-12-26 08:25:29,002][123090] Updated weights for policy 1, policy_version 1098467 (0.0009) [2023-12-26 08:25:29,058][123090] Updated weights for policy 1, policy_version 1098477 (0.0010) [2023-12-26 08:25:29,110][123090] Updated weights for policy 1, policy_version 1098487 (0.0009) [2023-12-26 08:25:29,281][123091] Updated weights for policy 0, policy_version 1106230 (0.0008) [2023-12-26 08:25:29,348][123091] Updated weights for policy 0, policy_version 1106240 (0.0010) [2023-12-26 08:25:29,414][123091] Updated weights for policy 0, policy_version 1106250 (0.0007) [2023-12-26 08:25:29,946][123090] Updated weights for policy 1, policy_version 1098497 (0.0009) [2023-12-26 08:25:30,012][123090] Updated weights for policy 1, policy_version 1098507 (0.0008) [2023-12-26 08:25:30,079][123090] Updated weights for policy 1, policy_version 1098517 (0.0007) [2023-12-26 08:25:30,148][123090] Updated weights for policy 1, policy_version 1098527 (0.0005) [2023-12-26 08:25:30,197][123091] Updated weights for policy 0, policy_version 1106260 (0.0005) [2023-12-26 08:25:30,270][123091] Updated weights for policy 0, policy_version 1106270 (0.0005) [2023-12-26 08:25:30,338][123091] Updated weights for policy 0, policy_version 1106280 (0.0006) [2023-12-26 08:25:30,968][123091] Updated weights for policy 0, policy_version 1106290 (0.0007) [2023-12-26 08:25:30,975][123090] Updated weights for policy 1, policy_version 1098537 (0.0008) [2023-12-26 08:25:31,029][123090] Updated weights for policy 1, policy_version 1098547 (0.0008) [2023-12-26 08:25:31,032][123091] Updated weights for policy 0, policy_version 1106300 (0.0009) [2023-12-26 08:25:31,087][123091] Updated weights for policy 0, policy_version 1106310 (0.0008) [2023-12-26 08:25:31,090][123090] Updated weights for policy 1, policy_version 1098557 (0.0008) [2023-12-26 08:25:31,168][123091] Updated weights for policy 0, policy_version 1106320 (0.0008) [2023-12-26 08:25:31,927][123091] Updated weights for policy 0, policy_version 1106330 (0.0008) [2023-12-26 08:25:31,981][123090] Updated weights for policy 1, policy_version 1098567 (0.0009) [2023-12-26 08:25:31,995][123091] Updated weights for policy 0, policy_version 1106340 (0.0007) [2023-12-26 08:25:32,043][123090] Updated weights for policy 1, policy_version 1098577 (0.0008) [2023-12-26 08:25:32,051][123091] Updated weights for policy 0, policy_version 1106350 (0.0007) [2023-12-26 08:25:32,102][123090] Updated weights for policy 1, policy_version 1098587 (0.0009) [2023-12-26 08:25:32,824][123091] Updated weights for policy 0, policy_version 1106360 (0.0008) [2023-12-26 08:25:32,883][123091] Updated weights for policy 0, policy_version 1106370 (0.0005) [2023-12-26 08:25:32,929][123090] Updated weights for policy 1, policy_version 1098597 (0.0009) [2023-12-26 08:25:32,948][123091] Updated weights for policy 0, policy_version 1106380 (0.0006) [2023-12-26 08:25:32,973][123090] Updated weights for policy 1, policy_version 1098607 (0.0008) [2023-12-26 08:25:33,042][123090] Updated weights for policy 1, policy_version 1098617 (0.0010) [2023-12-26 08:25:33,679][123091] Updated weights for policy 0, policy_version 1106390 (0.0009) [2023-12-26 08:25:33,738][123091] Updated weights for policy 0, policy_version 1106400 (0.0009) [2023-12-26 08:25:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 564486144. Throughput: 0: 9014.9, 1: 8830.3. Samples: 564504220. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:33,785][121949] Avg episode reward: [(0, '6057.293'), (1, '5936.370')] [2023-12-26 08:25:33,797][123091] Updated weights for policy 0, policy_version 1106410 (0.0009) [2023-12-26 08:25:33,881][123090] Updated weights for policy 1, policy_version 1098627 (0.0009) [2023-12-26 08:25:33,938][123090] Updated weights for policy 1, policy_version 1098637 (0.0009) [2023-12-26 08:25:33,998][123090] Updated weights for policy 1, policy_version 1098647 (0.0009) [2023-12-26 08:25:34,543][123091] Updated weights for policy 0, policy_version 1106420 (0.0010) [2023-12-26 08:25:34,606][123091] Updated weights for policy 0, policy_version 1106430 (0.0009) [2023-12-26 08:25:34,665][123091] Updated weights for policy 0, policy_version 1106440 (0.0010) [2023-12-26 08:25:34,844][123090] Updated weights for policy 1, policy_version 1098657 (0.0010) [2023-12-26 08:25:34,910][123090] Updated weights for policy 1, policy_version 1098667 (0.0009) [2023-12-26 08:25:34,968][123090] Updated weights for policy 1, policy_version 1098677 (0.0009) [2023-12-26 08:25:35,042][123090] Updated weights for policy 1, policy_version 1098687 (0.0005) [2023-12-26 08:25:35,572][123091] Updated weights for policy 0, policy_version 1106450 (0.0009) [2023-12-26 08:25:35,629][123091] Updated weights for policy 0, policy_version 1106460 (0.0010) [2023-12-26 08:25:35,672][123090] Updated weights for policy 1, policy_version 1098697 (0.0005) [2023-12-26 08:25:35,686][123091] Updated weights for policy 0, policy_version 1106470 (0.0010) [2023-12-26 08:25:35,721][123090] Updated weights for policy 1, policy_version 1098707 (0.0010) [2023-12-26 08:25:35,740][123091] Updated weights for policy 0, policy_version 1106480 (0.0006) [2023-12-26 08:25:35,775][123090] Updated weights for policy 1, policy_version 1098717 (0.0010) [2023-12-26 08:25:36,533][123090] Updated weights for policy 1, policy_version 1098727 (0.0009) [2023-12-26 08:25:36,582][123090] Updated weights for policy 1, policy_version 1098737 (0.0010) [2023-12-26 08:25:36,636][123090] Updated weights for policy 1, policy_version 1098747 (0.0008) [2023-12-26 08:25:36,648][123091] Updated weights for policy 0, policy_version 1106490 (0.0010) [2023-12-26 08:25:36,721][123091] Updated weights for policy 0, policy_version 1106500 (0.0010) [2023-12-26 08:25:36,787][123091] Updated weights for policy 0, policy_version 1106510 (0.0010) [2023-12-26 08:25:37,426][123090] Updated weights for policy 1, policy_version 1098757 (0.0006) [2023-12-26 08:25:37,493][123090] Updated weights for policy 1, policy_version 1098767 (0.0006) [2023-12-26 08:25:37,563][123090] Updated weights for policy 1, policy_version 1098777 (0.0008) [2023-12-26 08:25:37,595][123091] Updated weights for policy 0, policy_version 1106520 (0.0009) [2023-12-26 08:25:37,643][123091] Updated weights for policy 0, policy_version 1106530 (0.0008) [2023-12-26 08:25:37,699][123091] Updated weights for policy 0, policy_version 1106540 (0.0009) [2023-12-26 08:25:38,341][123090] Updated weights for policy 1, policy_version 1098787 (0.0009) [2023-12-26 08:25:38,413][123090] Updated weights for policy 1, policy_version 1098797 (0.0006) [2023-12-26 08:25:38,486][123090] Updated weights for policy 1, policy_version 1098807 (0.0008) [2023-12-26 08:25:38,604][123091] Updated weights for policy 0, policy_version 1106550 (0.0008) [2023-12-26 08:25:38,669][123091] Updated weights for policy 0, policy_version 1106560 (0.0009) [2023-12-26 08:25:38,739][123091] Updated weights for policy 0, policy_version 1106570 (0.0009) [2023-12-26 08:25:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 564584448. Throughput: 0: 8961.3, 1: 8897.2. Samples: 564556672. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:38,785][121949] Avg episode reward: [(0, '6165.711'), (1, '5854.212')] [2023-12-26 08:25:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001106576_283287552.pth... [2023-12-26 08:25:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001098816_281296896.pth... [2023-12-26 08:25:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001105520_283017216.pth [2023-12-26 08:25:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001097792_281034752.pth [2023-12-26 08:25:39,250][123090] Updated weights for policy 1, policy_version 1098817 (0.0009) [2023-12-26 08:25:39,313][123090] Updated weights for policy 1, policy_version 1098827 (0.0011) [2023-12-26 08:25:39,388][123090] Updated weights for policy 1, policy_version 1098837 (0.0009) [2023-12-26 08:25:39,461][123090] Updated weights for policy 1, policy_version 1098847 (0.0010) [2023-12-26 08:25:39,614][123091] Updated weights for policy 0, policy_version 1106580 (0.0008) [2023-12-26 08:25:39,674][123091] Updated weights for policy 0, policy_version 1106590 (0.0009) [2023-12-26 08:25:39,736][123091] Updated weights for policy 0, policy_version 1106601 (0.0011) [2023-12-26 08:25:40,210][123090] Updated weights for policy 1, policy_version 1098857 (0.0006) [2023-12-26 08:25:40,278][123090] Updated weights for policy 1, policy_version 1098867 (0.0006) [2023-12-26 08:25:40,337][123090] Updated weights for policy 1, policy_version 1098877 (0.0007) [2023-12-26 08:25:40,651][123091] Updated weights for policy 0, policy_version 1106611 (0.0009) [2023-12-26 08:25:40,721][123091] Updated weights for policy 0, policy_version 1106621 (0.0010) [2023-12-26 08:25:40,775][123091] Updated weights for policy 0, policy_version 1106631 (0.0010) [2023-12-26 08:25:40,956][123090] Updated weights for policy 1, policy_version 1098887 (0.0006) [2023-12-26 08:25:41,027][123090] Updated weights for policy 1, policy_version 1098897 (0.0006) [2023-12-26 08:25:41,096][123090] Updated weights for policy 1, policy_version 1098907 (0.0007) [2023-12-26 08:25:41,706][123091] Updated weights for policy 0, policy_version 1106641 (0.0009) [2023-12-26 08:25:41,786][123091] Updated weights for policy 0, policy_version 1106651 (0.0009) [2023-12-26 08:25:41,851][123091] Updated weights for policy 0, policy_version 1106661 (0.0008) [2023-12-26 08:25:41,861][123090] Updated weights for policy 1, policy_version 1098917 (0.0009) [2023-12-26 08:25:41,916][123091] Updated weights for policy 0, policy_version 1106671 (0.0006) [2023-12-26 08:25:41,926][123090] Updated weights for policy 1, policy_version 1098927 (0.0011) [2023-12-26 08:25:41,988][123090] Updated weights for policy 1, policy_version 1098937 (0.0011) [2023-12-26 08:25:42,745][123091] Updated weights for policy 0, policy_version 1106681 (0.0009) [2023-12-26 08:25:42,795][123090] Updated weights for policy 1, policy_version 1098947 (0.0009) [2023-12-26 08:25:42,807][123091] Updated weights for policy 0, policy_version 1106691 (0.0008) [2023-12-26 08:25:42,851][123090] Updated weights for policy 1, policy_version 1098957 (0.0007) [2023-12-26 08:25:42,867][123091] Updated weights for policy 0, policy_version 1106701 (0.0008) [2023-12-26 08:25:42,909][123090] Updated weights for policy 1, policy_version 1098967 (0.0006) [2023-12-26 08:25:43,637][123090] Updated weights for policy 1, policy_version 1098977 (0.0006) [2023-12-26 08:25:43,688][123090] Updated weights for policy 1, policy_version 1098987 (0.0010) [2023-12-26 08:25:43,736][123090] Updated weights for policy 1, policy_version 1098997 (0.0010) [2023-12-26 08:25:43,750][123091] Updated weights for policy 0, policy_version 1106711 (0.0008) [2023-12-26 08:25:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 564658176. Throughput: 0: 8853.1, 1: 8933.1. Samples: 564659332. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:43,784][121949] Avg episode reward: [(0, '6264.065'), (1, '5819.725')] [2023-12-26 08:25:43,799][123090] Updated weights for policy 1, policy_version 1099007 (0.0010) [2023-12-26 08:25:43,810][123091] Updated weights for policy 0, policy_version 1106721 (0.0006) [2023-12-26 08:25:43,865][123091] Updated weights for policy 0, policy_version 1106731 (0.0009) [2023-12-26 08:25:44,609][123090] Updated weights for policy 1, policy_version 1099017 (0.0006) [2023-12-26 08:25:44,676][123090] Updated weights for policy 1, policy_version 1099027 (0.0006) [2023-12-26 08:25:44,738][123090] Updated weights for policy 1, policy_version 1099037 (0.0005) [2023-12-26 08:25:44,770][123091] Updated weights for policy 0, policy_version 1106741 (0.0009) [2023-12-26 08:25:44,834][123091] Updated weights for policy 0, policy_version 1106751 (0.0010) [2023-12-26 08:25:44,895][123091] Updated weights for policy 0, policy_version 1106761 (0.0007) [2023-12-26 08:25:45,544][123090] Updated weights for policy 1, policy_version 1099047 (0.0006) [2023-12-26 08:25:45,599][123090] Updated weights for policy 1, policy_version 1099057 (0.0009) [2023-12-26 08:25:45,608][123091] Updated weights for policy 0, policy_version 1106771 (0.0007) [2023-12-26 08:25:45,658][123091] Updated weights for policy 0, policy_version 1106781 (0.0008) [2023-12-26 08:25:45,660][123090] Updated weights for policy 1, policy_version 1099067 (0.0007) [2023-12-26 08:25:45,705][123091] Updated weights for policy 0, policy_version 1106791 (0.0010) [2023-12-26 08:25:46,509][123090] Updated weights for policy 1, policy_version 1099077 (0.0009) [2023-12-26 08:25:46,552][123091] Updated weights for policy 0, policy_version 1106801 (0.0010) [2023-12-26 08:25:46,563][123090] Updated weights for policy 1, policy_version 1099087 (0.0008) [2023-12-26 08:25:46,599][123091] Updated weights for policy 0, policy_version 1106811 (0.0010) [2023-12-26 08:25:46,627][123090] Updated weights for policy 1, policy_version 1099097 (0.0006) [2023-12-26 08:25:46,655][123091] Updated weights for policy 0, policy_version 1106821 (0.0011) [2023-12-26 08:25:46,707][123091] Updated weights for policy 0, policy_version 1106831 (0.0011) [2023-12-26 08:25:47,451][123090] Updated weights for policy 1, policy_version 1099107 (0.0007) [2023-12-26 08:25:47,519][123090] Updated weights for policy 1, policy_version 1099117 (0.0009) [2023-12-26 08:25:47,559][123091] Updated weights for policy 0, policy_version 1106841 (0.0011) [2023-12-26 08:25:47,583][123090] Updated weights for policy 1, policy_version 1099127 (0.0006) [2023-12-26 08:25:47,614][123091] Updated weights for policy 0, policy_version 1106851 (0.0010) [2023-12-26 08:25:47,671][123091] Updated weights for policy 0, policy_version 1106861 (0.0011) [2023-12-26 08:25:48,419][123090] Updated weights for policy 1, policy_version 1099137 (0.0007) [2023-12-26 08:25:48,479][123090] Updated weights for policy 1, policy_version 1099147 (0.0008) [2023-12-26 08:25:48,505][123091] Updated weights for policy 0, policy_version 1106871 (0.0010) [2023-12-26 08:25:48,538][123090] Updated weights for policy 1, policy_version 1099157 (0.0007) [2023-12-26 08:25:48,568][123091] Updated weights for policy 0, policy_version 1106881 (0.0011) [2023-12-26 08:25:48,602][123090] Updated weights for policy 1, policy_version 1099167 (0.0009) [2023-12-26 08:25:48,627][123091] Updated weights for policy 0, policy_version 1106891 (0.0010) [2023-12-26 08:25:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 564756480. Throughput: 0: 8771.2, 1: 8900.2. Samples: 564763344. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:48,785][121949] Avg episode reward: [(0, '6260.792'), (1, '5737.356')] [2023-12-26 08:25:49,276][123090] Updated weights for policy 1, policy_version 1099177 (0.0008) [2023-12-26 08:25:49,344][123090] Updated weights for policy 1, policy_version 1099187 (0.0008) [2023-12-26 08:25:49,406][123090] Updated weights for policy 1, policy_version 1099197 (0.0008) [2023-12-26 08:25:49,465][123091] Updated weights for policy 0, policy_version 1106901 (0.0011) [2023-12-26 08:25:49,525][123091] Updated weights for policy 0, policy_version 1106911 (0.0011) [2023-12-26 08:25:49,581][123091] Updated weights for policy 0, policy_version 1106921 (0.0010) [2023-12-26 08:25:50,095][123090] Updated weights for policy 1, policy_version 1099207 (0.0009) [2023-12-26 08:25:50,160][123090] Updated weights for policy 1, policy_version 1099217 (0.0009) [2023-12-26 08:25:50,228][123090] Updated weights for policy 1, policy_version 1099227 (0.0009) [2023-12-26 08:25:50,422][123091] Updated weights for policy 0, policy_version 1106931 (0.0011) [2023-12-26 08:25:50,491][123091] Updated weights for policy 0, policy_version 1106941 (0.0010) [2023-12-26 08:25:50,549][123091] Updated weights for policy 0, policy_version 1106951 (0.0010) [2023-12-26 08:25:51,011][123090] Updated weights for policy 1, policy_version 1099237 (0.0009) [2023-12-26 08:25:51,079][123090] Updated weights for policy 1, policy_version 1099247 (0.0009) [2023-12-26 08:25:51,145][123090] Updated weights for policy 1, policy_version 1099257 (0.0009) [2023-12-26 08:25:51,369][123091] Updated weights for policy 0, policy_version 1106961 (0.0010) [2023-12-26 08:25:51,441][123091] Updated weights for policy 0, policy_version 1106971 (0.0007) [2023-12-26 08:25:51,510][123091] Updated weights for policy 0, policy_version 1106981 (0.0010) [2023-12-26 08:25:51,573][123091] Updated weights for policy 0, policy_version 1106991 (0.0011) [2023-12-26 08:25:52,022][123090] Updated weights for policy 1, policy_version 1099267 (0.0009) [2023-12-26 08:25:52,083][123090] Updated weights for policy 1, policy_version 1099277 (0.0009) [2023-12-26 08:25:52,146][123090] Updated weights for policy 1, policy_version 1099287 (0.0009) [2023-12-26 08:25:52,390][123091] Updated weights for policy 0, policy_version 1107001 (0.0010) [2023-12-26 08:25:52,461][123091] Updated weights for policy 0, policy_version 1107011 (0.0010) [2023-12-26 08:25:52,521][123091] Updated weights for policy 0, policy_version 1107021 (0.0011) [2023-12-26 08:25:53,025][123090] Updated weights for policy 1, policy_version 1099297 (0.0009) [2023-12-26 08:25:53,081][123090] Updated weights for policy 1, policy_version 1099307 (0.0009) [2023-12-26 08:25:53,129][123090] Updated weights for policy 1, policy_version 1099317 (0.0009) [2023-12-26 08:25:53,175][123090] Updated weights for policy 1, policy_version 1099327 (0.0008) [2023-12-26 08:25:53,302][123091] Updated weights for policy 0, policy_version 1107031 (0.0011) [2023-12-26 08:25:53,369][123091] Updated weights for policy 0, policy_version 1107041 (0.0010) [2023-12-26 08:25:53,434][123091] Updated weights for policy 0, policy_version 1107051 (0.0011) [2023-12-26 08:25:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 564838400. Throughput: 0: 8722.4, 1: 8833.5. Samples: 564815824. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:53,785][121949] Avg episode reward: [(0, '6239.855'), (1, '5644.585')] [2023-12-26 08:25:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001107056_283410432.pth... [2023-12-26 08:25:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001099328_281427968.pth... [2023-12-26 08:25:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001106032_283148288.pth [2023-12-26 08:25:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001098304_281165824.pth [2023-12-26 08:25:53,976][123090] Updated weights for policy 1, policy_version 1099337 (0.0005) [2023-12-26 08:25:54,027][123090] Updated weights for policy 1, policy_version 1099347 (0.0005) [2023-12-26 08:25:54,073][123090] Updated weights for policy 1, policy_version 1099357 (0.0005) [2023-12-26 08:25:54,241][123091] Updated weights for policy 0, policy_version 1107061 (0.0010) [2023-12-26 08:25:54,296][123091] Updated weights for policy 0, policy_version 1107071 (0.0010) [2023-12-26 08:25:54,347][123091] Updated weights for policy 0, policy_version 1107081 (0.0010) [2023-12-26 08:25:54,814][123090] Updated weights for policy 1, policy_version 1099367 (0.0006) [2023-12-26 08:25:54,885][123090] Updated weights for policy 1, policy_version 1099377 (0.0006) [2023-12-26 08:25:54,948][123090] Updated weights for policy 1, policy_version 1099387 (0.0011) [2023-12-26 08:25:55,198][123091] Updated weights for policy 0, policy_version 1107091 (0.0010) [2023-12-26 08:25:55,267][123091] Updated weights for policy 0, policy_version 1107101 (0.0010) [2023-12-26 08:25:55,328][123091] Updated weights for policy 0, policy_version 1107111 (0.0010) [2023-12-26 08:25:55,621][123090] Updated weights for policy 1, policy_version 1099397 (0.0008) [2023-12-26 08:25:55,667][123090] Updated weights for policy 1, policy_version 1099407 (0.0005) [2023-12-26 08:25:55,725][123090] Updated weights for policy 1, policy_version 1099417 (0.0005) [2023-12-26 08:25:56,133][123091] Updated weights for policy 0, policy_version 1107121 (0.0010) [2023-12-26 08:25:56,188][123091] Updated weights for policy 0, policy_version 1107131 (0.0011) [2023-12-26 08:25:56,235][123091] Updated weights for policy 0, policy_version 1107141 (0.0010) [2023-12-26 08:25:56,286][123091] Updated weights for policy 0, policy_version 1107151 (0.0010) [2023-12-26 08:25:56,379][123090] Updated weights for policy 1, policy_version 1099427 (0.0007) [2023-12-26 08:25:56,445][123090] Updated weights for policy 1, policy_version 1099437 (0.0010) [2023-12-26 08:25:56,504][123090] Updated weights for policy 1, policy_version 1099447 (0.0010) [2023-12-26 08:25:57,146][123091] Updated weights for policy 0, policy_version 1107161 (0.0011) [2023-12-26 08:25:57,208][123091] Updated weights for policy 0, policy_version 1107171 (0.0010) [2023-12-26 08:25:57,269][123091] Updated weights for policy 0, policy_version 1107181 (0.0010) [2023-12-26 08:25:57,271][123090] Updated weights for policy 1, policy_version 1099457 (0.0010) [2023-12-26 08:25:57,333][123090] Updated weights for policy 1, policy_version 1099467 (0.0008) [2023-12-26 08:25:57,392][123090] Updated weights for policy 1, policy_version 1099477 (0.0005) [2023-12-26 08:25:57,455][123090] Updated weights for policy 1, policy_version 1099487 (0.0005) [2023-12-26 08:25:58,084][123091] Updated weights for policy 0, policy_version 1107191 (0.0008) [2023-12-26 08:25:58,149][123091] Updated weights for policy 0, policy_version 1107201 (0.0008) [2023-12-26 08:25:58,153][123090] Updated weights for policy 1, policy_version 1099497 (0.0007) [2023-12-26 08:25:58,214][123091] Updated weights for policy 0, policy_version 1107211 (0.0008) [2023-12-26 08:25:58,221][123090] Updated weights for policy 1, policy_version 1099507 (0.0005) [2023-12-26 08:25:58,281][123090] Updated weights for policy 1, policy_version 1099517 (0.0006) [2023-12-26 08:25:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 564928512. Throughput: 0: 8759.0, 1: 8962.7. Samples: 564923596. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:25:58,785][121949] Avg episode reward: [(0, '6289.841'), (1, '5877.724')] [2023-12-26 08:25:59,030][123091] Updated weights for policy 0, policy_version 1107221 (0.0009) [2023-12-26 08:25:59,091][123091] Updated weights for policy 0, policy_version 1107231 (0.0010) [2023-12-26 08:25:59,115][123090] Updated weights for policy 1, policy_version 1099527 (0.0008) [2023-12-26 08:25:59,148][123091] Updated weights for policy 0, policy_version 1107241 (0.0008) [2023-12-26 08:25:59,176][123090] Updated weights for policy 1, policy_version 1099537 (0.0008) [2023-12-26 08:25:59,246][123090] Updated weights for policy 1, policy_version 1099547 (0.0008) [2023-12-26 08:25:59,981][123091] Updated weights for policy 0, policy_version 1107251 (0.0008) [2023-12-26 08:26:00,036][123091] Updated weights for policy 0, policy_version 1107261 (0.0009) [2023-12-26 08:26:00,045][123090] Updated weights for policy 1, policy_version 1099557 (0.0008) [2023-12-26 08:26:00,089][123091] Updated weights for policy 0, policy_version 1107271 (0.0009) [2023-12-26 08:26:00,094][123090] Updated weights for policy 1, policy_version 1099567 (0.0009) [2023-12-26 08:26:00,152][123090] Updated weights for policy 1, policy_version 1099577 (0.0009) [2023-12-26 08:26:00,877][123091] Updated weights for policy 0, policy_version 1107281 (0.0009) [2023-12-26 08:26:00,943][123091] Updated weights for policy 0, policy_version 1107292 (0.0007) [2023-12-26 08:26:00,990][123091] Updated weights for policy 0, policy_version 1107302 (0.0009) [2023-12-26 08:26:01,026][123090] Updated weights for policy 1, policy_version 1099587 (0.0008) [2023-12-26 08:26:01,053][123091] Updated weights for policy 0, policy_version 1107312 (0.0011) [2023-12-26 08:26:01,098][123090] Updated weights for policy 1, policy_version 1099597 (0.0009) [2023-12-26 08:26:01,166][123090] Updated weights for policy 1, policy_version 1099607 (0.0009) [2023-12-26 08:26:01,845][123091] Updated weights for policy 0, policy_version 1107322 (0.0008) [2023-12-26 08:26:01,914][123091] Updated weights for policy 0, policy_version 1107332 (0.0008) [2023-12-26 08:26:01,968][123090] Updated weights for policy 1, policy_version 1099617 (0.0009) [2023-12-26 08:26:01,969][123091] Updated weights for policy 0, policy_version 1107342 (0.0008) [2023-12-26 08:26:02,037][123090] Updated weights for policy 1, policy_version 1099627 (0.0005) [2023-12-26 08:26:02,097][123090] Updated weights for policy 1, policy_version 1099637 (0.0005) [2023-12-26 08:26:02,146][123090] Updated weights for policy 1, policy_version 1099647 (0.0005) [2023-12-26 08:26:02,766][123091] Updated weights for policy 0, policy_version 1107352 (0.0010) [2023-12-26 08:26:02,836][123091] Updated weights for policy 0, policy_version 1107362 (0.0010) [2023-12-26 08:26:02,902][123091] Updated weights for policy 0, policy_version 1107372 (0.0010) [2023-12-26 08:26:02,941][123090] Updated weights for policy 1, policy_version 1099657 (0.0008) [2023-12-26 08:26:02,998][123090] Updated weights for policy 1, policy_version 1099667 (0.0009) [2023-12-26 08:26:03,052][123090] Updated weights for policy 1, policy_version 1099677 (0.0009) [2023-12-26 08:26:03,683][123091] Updated weights for policy 0, policy_version 1107382 (0.0008) [2023-12-26 08:26:03,745][123091] Updated weights for policy 0, policy_version 1107392 (0.0008) [2023-12-26 08:26:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 565010432. Throughput: 0: 8690.8, 1: 8918.3. Samples: 565027888. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:03,784][121949] Avg episode reward: [(0, '6267.314'), (1, '5802.291')] [2023-12-26 08:26:03,802][123091] Updated weights for policy 0, policy_version 1107402 (0.0009) [2023-12-26 08:26:03,907][123090] Updated weights for policy 1, policy_version 1099687 (0.0010) [2023-12-26 08:26:03,966][123090] Updated weights for policy 1, policy_version 1099697 (0.0010) [2023-12-26 08:26:04,033][123090] Updated weights for policy 1, policy_version 1099707 (0.0010) [2023-12-26 08:26:04,654][123091] Updated weights for policy 0, policy_version 1107412 (0.0009) [2023-12-26 08:26:04,716][123091] Updated weights for policy 0, policy_version 1107422 (0.0010) [2023-12-26 08:26:04,769][123091] Updated weights for policy 0, policy_version 1107432 (0.0009) [2023-12-26 08:26:04,874][123090] Updated weights for policy 1, policy_version 1099717 (0.0009) [2023-12-26 08:26:04,927][123090] Updated weights for policy 1, policy_version 1099727 (0.0009) [2023-12-26 08:26:04,995][123090] Updated weights for policy 1, policy_version 1099737 (0.0010) [2023-12-26 08:26:05,617][123091] Updated weights for policy 0, policy_version 1107442 (0.0010) [2023-12-26 08:26:05,682][123091] Updated weights for policy 0, policy_version 1107452 (0.0010) [2023-12-26 08:26:05,742][123091] Updated weights for policy 0, policy_version 1107462 (0.0009) [2023-12-26 08:26:05,808][123091] Updated weights for policy 0, policy_version 1107472 (0.0009) [2023-12-26 08:26:05,818][123090] Updated weights for policy 1, policy_version 1099747 (0.0008) [2023-12-26 08:26:05,890][123090] Updated weights for policy 1, policy_version 1099757 (0.0005) [2023-12-26 08:26:05,949][123090] Updated weights for policy 1, policy_version 1099767 (0.0005) [2023-12-26 08:26:06,656][123090] Updated weights for policy 1, policy_version 1099777 (0.0005) [2023-12-26 08:26:06,697][123091] Updated weights for policy 0, policy_version 1107482 (0.0009) [2023-12-26 08:26:06,715][123090] Updated weights for policy 1, policy_version 1099787 (0.0007) [2023-12-26 08:26:06,759][123091] Updated weights for policy 0, policy_version 1107492 (0.0009) [2023-12-26 08:26:06,790][123090] Updated weights for policy 1, policy_version 1099797 (0.0006) [2023-12-26 08:26:06,823][123091] Updated weights for policy 0, policy_version 1107502 (0.0007) [2023-12-26 08:26:06,860][123090] Updated weights for policy 1, policy_version 1099807 (0.0006) [2023-12-26 08:26:07,505][123090] Updated weights for policy 1, policy_version 1099817 (0.0007) [2023-12-26 08:26:07,573][123090] Updated weights for policy 1, policy_version 1099827 (0.0010) [2023-12-26 08:26:07,641][123090] Updated weights for policy 1, policy_version 1099837 (0.0011) [2023-12-26 08:26:07,738][123091] Updated weights for policy 0, policy_version 1107512 (0.0009) [2023-12-26 08:26:07,791][123091] Updated weights for policy 0, policy_version 1107522 (0.0009) [2023-12-26 08:26:07,852][123091] Updated weights for policy 0, policy_version 1107532 (0.0009) [2023-12-26 08:26:08,459][123090] Updated weights for policy 1, policy_version 1099847 (0.0011) [2023-12-26 08:26:08,523][123090] Updated weights for policy 1, policy_version 1099857 (0.0011) [2023-12-26 08:26:08,579][123090] Updated weights for policy 1, policy_version 1099867 (0.0010) [2023-12-26 08:26:08,702][123091] Updated weights for policy 0, policy_version 1107542 (0.0009) [2023-12-26 08:26:08,759][123091] Updated weights for policy 0, policy_version 1107552 (0.0009) [2023-12-26 08:26:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 565100544. Throughput: 0: 8663.1, 1: 8955.8. Samples: 565079032. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:08,785][121949] Avg episode reward: [(0, '6204.435'), (1, '5698.937')] [2023-12-26 08:26:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001099872_281567232.pth... [2023-12-26 08:26:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001098816_281296896.pth [2023-12-26 08:26:08,819][123091] Updated weights for policy 0, policy_version 1107562 (0.0009) [2023-12-26 08:26:08,855][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001107568_283541504.pth... [2023-12-26 08:26:08,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001106576_283287552.pth [2023-12-26 08:26:09,440][123090] Updated weights for policy 1, policy_version 1099877 (0.0010) [2023-12-26 08:26:09,505][123090] Updated weights for policy 1, policy_version 1099887 (0.0009) [2023-12-26 08:26:09,563][123090] Updated weights for policy 1, policy_version 1099897 (0.0009) [2023-12-26 08:26:09,696][123091] Updated weights for policy 0, policy_version 1107572 (0.0009) [2023-12-26 08:26:09,756][123091] Updated weights for policy 0, policy_version 1107582 (0.0011) [2023-12-26 08:26:09,828][123091] Updated weights for policy 0, policy_version 1107592 (0.0011) [2023-12-26 08:26:10,427][123090] Updated weights for policy 1, policy_version 1099907 (0.0009) [2023-12-26 08:26:10,484][123090] Updated weights for policy 1, policy_version 1099917 (0.0009) [2023-12-26 08:26:10,546][123090] Updated weights for policy 1, policy_version 1099927 (0.0009) [2023-12-26 08:26:10,649][123091] Updated weights for policy 0, policy_version 1107602 (0.0009) [2023-12-26 08:26:10,710][123091] Updated weights for policy 0, policy_version 1107612 (0.0010) [2023-12-26 08:26:10,766][123091] Updated weights for policy 0, policy_version 1107622 (0.0011) [2023-12-26 08:26:10,826][123091] Updated weights for policy 0, policy_version 1107632 (0.0011) [2023-12-26 08:26:11,410][123090] Updated weights for policy 1, policy_version 1099937 (0.0009) [2023-12-26 08:26:11,474][123090] Updated weights for policy 1, policy_version 1099947 (0.0006) [2023-12-26 08:26:11,545][123090] Updated weights for policy 1, policy_version 1099957 (0.0006) [2023-12-26 08:26:11,621][123090] Updated weights for policy 1, policy_version 1099967 (0.0007) [2023-12-26 08:26:11,757][123091] Updated weights for policy 0, policy_version 1107642 (0.0009) [2023-12-26 08:26:11,825][123091] Updated weights for policy 0, policy_version 1107652 (0.0008) [2023-12-26 08:26:11,899][123091] Updated weights for policy 0, policy_version 1107662 (0.0009) [2023-12-26 08:26:12,396][123090] Updated weights for policy 1, policy_version 1099977 (0.0009) [2023-12-26 08:26:12,460][123090] Updated weights for policy 1, policy_version 1099987 (0.0011) [2023-12-26 08:26:12,527][123090] Updated weights for policy 1, policy_version 1099997 (0.0010) [2023-12-26 08:26:12,670][123091] Updated weights for policy 0, policy_version 1107672 (0.0008) [2023-12-26 08:26:12,734][123091] Updated weights for policy 0, policy_version 1107682 (0.0006) [2023-12-26 08:26:12,794][123091] Updated weights for policy 0, policy_version 1107692 (0.0005) [2023-12-26 08:26:13,334][123090] Updated weights for policy 1, policy_version 1100007 (0.0010) [2023-12-26 08:26:13,391][123090] Updated weights for policy 1, policy_version 1100017 (0.0009) [2023-12-26 08:26:13,446][123090] Updated weights for policy 1, policy_version 1100027 (0.0009) [2023-12-26 08:26:13,495][123091] Updated weights for policy 0, policy_version 1107702 (0.0006) [2023-12-26 08:26:13,540][123091] Updated weights for policy 0, policy_version 1107712 (0.0005) [2023-12-26 08:26:13,594][123091] Updated weights for policy 0, policy_version 1107722 (0.0005) [2023-12-26 08:26:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 565190656. Throughput: 0: 8520.1, 1: 8895.5. Samples: 565179304. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:13,785][121949] Avg episode reward: [(0, '6240.081'), (1, '5842.265')] [2023-12-26 08:26:14,143][123090] Updated weights for policy 1, policy_version 1100037 (0.0007) [2023-12-26 08:26:14,200][123090] Updated weights for policy 1, policy_version 1100047 (0.0006) [2023-12-26 08:26:14,265][123090] Updated weights for policy 1, policy_version 1100057 (0.0007) [2023-12-26 08:26:14,278][123091] Updated weights for policy 0, policy_version 1107732 (0.0005) [2023-12-26 08:26:14,335][123091] Updated weights for policy 0, policy_version 1107742 (0.0005) [2023-12-26 08:26:14,407][123091] Updated weights for policy 0, policy_version 1107752 (0.0005) [2023-12-26 08:26:14,893][123090] Updated weights for policy 1, policy_version 1100067 (0.0006) [2023-12-26 08:26:14,953][123090] Updated weights for policy 1, policy_version 1100077 (0.0009) [2023-12-26 08:26:15,022][123090] Updated weights for policy 1, policy_version 1100087 (0.0009) [2023-12-26 08:26:15,107][123091] Updated weights for policy 0, policy_version 1107762 (0.0005) [2023-12-26 08:26:15,165][123091] Updated weights for policy 0, policy_version 1107772 (0.0006) [2023-12-26 08:26:15,224][123091] Updated weights for policy 0, policy_version 1107782 (0.0006) [2023-12-26 08:26:15,293][123091] Updated weights for policy 0, policy_version 1107792 (0.0010) [2023-12-26 08:26:15,805][123090] Updated weights for policy 1, policy_version 1100097 (0.0006) [2023-12-26 08:26:15,853][123090] Updated weights for policy 1, policy_version 1100107 (0.0010) [2023-12-26 08:26:15,908][123090] Updated weights for policy 1, policy_version 1100117 (0.0010) [2023-12-26 08:26:15,956][123090] Updated weights for policy 1, policy_version 1100127 (0.0010) [2023-12-26 08:26:16,065][123091] Updated weights for policy 0, policy_version 1107802 (0.0005) [2023-12-26 08:26:16,132][123091] Updated weights for policy 0, policy_version 1107812 (0.0005) [2023-12-26 08:26:16,200][123091] Updated weights for policy 0, policy_version 1107822 (0.0005) [2023-12-26 08:26:16,728][123091] Updated weights for policy 0, policy_version 1107832 (0.0005) [2023-12-26 08:26:16,797][123091] Updated weights for policy 0, policy_version 1107842 (0.0008) [2023-12-26 08:26:16,823][123090] Updated weights for policy 1, policy_version 1100137 (0.0010) [2023-12-26 08:26:16,858][123091] Updated weights for policy 0, policy_version 1107852 (0.0009) [2023-12-26 08:26:16,876][123090] Updated weights for policy 1, policy_version 1100147 (0.0009) [2023-12-26 08:26:16,938][123090] Updated weights for policy 1, policy_version 1100157 (0.0010) [2023-12-26 08:26:17,651][123091] Updated weights for policy 0, policy_version 1107862 (0.0008) [2023-12-26 08:26:17,696][123090] Updated weights for policy 1, policy_version 1100167 (0.0009) [2023-12-26 08:26:17,710][123091] Updated weights for policy 0, policy_version 1107872 (0.0008) [2023-12-26 08:26:17,753][123090] Updated weights for policy 1, policy_version 1100177 (0.0007) [2023-12-26 08:26:17,774][123091] Updated weights for policy 0, policy_version 1107882 (0.0008) [2023-12-26 08:26:17,808][123090] Updated weights for policy 1, policy_version 1100187 (0.0008) [2023-12-26 08:26:18,576][123091] Updated weights for policy 0, policy_version 1107892 (0.0008) [2023-12-26 08:26:18,643][123091] Updated weights for policy 0, policy_version 1107902 (0.0005) [2023-12-26 08:26:18,684][123090] Updated weights for policy 1, policy_version 1100197 (0.0010) [2023-12-26 08:26:18,708][123091] Updated weights for policy 0, policy_version 1107912 (0.0006) [2023-12-26 08:26:18,750][123090] Updated weights for policy 1, policy_version 1100207 (0.0008) [2023-12-26 08:26:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 565280768. Throughput: 0: 8559.8, 1: 8949.6. Samples: 565292144. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:18,785][121949] Avg episode reward: [(0, '6326.683'), (1, '5819.379')] [2023-12-26 08:26:18,812][123090] Updated weights for policy 1, policy_version 1100217 (0.0010) [2023-12-26 08:26:19,393][123091] Updated weights for policy 0, policy_version 1107922 (0.0007) [2023-12-26 08:26:19,465][123091] Updated weights for policy 0, policy_version 1107932 (0.0011) [2023-12-26 08:26:19,538][123091] Updated weights for policy 0, policy_version 1107942 (0.0010) [2023-12-26 08:26:19,603][123091] Updated weights for policy 0, policy_version 1107952 (0.0009) [2023-12-26 08:26:19,634][123090] Updated weights for policy 1, policy_version 1100227 (0.0010) [2023-12-26 08:26:19,683][123090] Updated weights for policy 1, policy_version 1100237 (0.0009) [2023-12-26 08:26:19,734][123090] Updated weights for policy 1, policy_version 1100247 (0.0009) [2023-12-26 08:26:20,382][123091] Updated weights for policy 0, policy_version 1107962 (0.0010) [2023-12-26 08:26:20,446][123091] Updated weights for policy 0, policy_version 1107972 (0.0011) [2023-12-26 08:26:20,516][123091] Updated weights for policy 0, policy_version 1107982 (0.0009) [2023-12-26 08:26:20,647][123090] Updated weights for policy 1, policy_version 1100257 (0.0009) [2023-12-26 08:26:20,698][123090] Updated weights for policy 1, policy_version 1100267 (0.0010) [2023-12-26 08:26:20,748][123090] Updated weights for policy 1, policy_version 1100277 (0.0009) [2023-12-26 08:26:20,817][123090] Updated weights for policy 1, policy_version 1100287 (0.0010) [2023-12-26 08:26:21,400][123091] Updated weights for policy 0, policy_version 1107992 (0.0009) [2023-12-26 08:26:21,460][123091] Updated weights for policy 0, policy_version 1108002 (0.0009) [2023-12-26 08:26:21,510][123091] Updated weights for policy 0, policy_version 1108012 (0.0009) [2023-12-26 08:26:21,751][123090] Updated weights for policy 1, policy_version 1100297 (0.0010) [2023-12-26 08:26:21,816][123090] Updated weights for policy 1, policy_version 1100307 (0.0011) [2023-12-26 08:26:21,885][123090] Updated weights for policy 1, policy_version 1100317 (0.0011) [2023-12-26 08:26:22,383][123091] Updated weights for policy 0, policy_version 1108022 (0.0008) [2023-12-26 08:26:22,439][123091] Updated weights for policy 0, policy_version 1108032 (0.0009) [2023-12-26 08:26:22,499][123091] Updated weights for policy 0, policy_version 1108042 (0.0009) [2023-12-26 08:26:22,747][123090] Updated weights for policy 1, policy_version 1100327 (0.0010) [2023-12-26 08:26:22,812][123090] Updated weights for policy 1, policy_version 1100337 (0.0008) [2023-12-26 08:26:22,889][123090] Updated weights for policy 1, policy_version 1100347 (0.0006) [2023-12-26 08:26:23,286][123091] Updated weights for policy 0, policy_version 1108052 (0.0010) [2023-12-26 08:26:23,356][123091] Updated weights for policy 0, policy_version 1108062 (0.0009) [2023-12-26 08:26:23,422][123091] Updated weights for policy 0, policy_version 1108072 (0.0010) [2023-12-26 08:26:23,638][123090] Updated weights for policy 1, policy_version 1100357 (0.0009) [2023-12-26 08:26:23,697][123090] Updated weights for policy 1, policy_version 1100367 (0.0010) [2023-12-26 08:26:23,764][123090] Updated weights for policy 1, policy_version 1100377 (0.0009) [2023-12-26 08:26:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 565362688. Throughput: 0: 8585.2, 1: 8880.5. Samples: 565342632. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:23,785][121949] Avg episode reward: [(0, '6378.034'), (1, '5739.330')] [2023-12-26 08:26:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001108080_283672576.pth... [2023-12-26 08:26:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001107056_283410432.pth [2023-12-26 08:26:23,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001100384_281698304.pth... [2023-12-26 08:26:23,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001099328_281427968.pth [2023-12-26 08:26:24,267][123091] Updated weights for policy 0, policy_version 1108082 (0.0010) [2023-12-26 08:26:24,326][123091] Updated weights for policy 0, policy_version 1108092 (0.0008) [2023-12-26 08:26:24,388][123091] Updated weights for policy 0, policy_version 1108102 (0.0009) [2023-12-26 08:26:24,443][123091] Updated weights for policy 0, policy_version 1108112 (0.0010) [2023-12-26 08:26:24,594][123090] Updated weights for policy 1, policy_version 1100387 (0.0009) [2023-12-26 08:26:24,652][123090] Updated weights for policy 1, policy_version 1100397 (0.0010) [2023-12-26 08:26:24,711][123090] Updated weights for policy 1, policy_version 1100407 (0.0010) [2023-12-26 08:26:25,204][123091] Updated weights for policy 0, policy_version 1108122 (0.0005) [2023-12-26 08:26:25,259][123091] Updated weights for policy 0, policy_version 1108132 (0.0005) [2023-12-26 08:26:25,308][123091] Updated weights for policy 0, policy_version 1108142 (0.0005) [2023-12-26 08:26:25,631][123090] Updated weights for policy 1, policy_version 1100417 (0.0010) [2023-12-26 08:26:25,685][123090] Updated weights for policy 1, policy_version 1100429 (0.0011) [2023-12-26 08:26:25,740][123090] Updated weights for policy 1, policy_version 1100439 (0.0011) [2023-12-26 08:26:26,027][123091] Updated weights for policy 0, policy_version 1108152 (0.0005) [2023-12-26 08:26:26,097][123091] Updated weights for policy 0, policy_version 1108162 (0.0005) [2023-12-26 08:26:26,168][123091] Updated weights for policy 0, policy_version 1108172 (0.0009) [2023-12-26 08:26:26,621][123090] Updated weights for policy 1, policy_version 1100450 (0.0008) [2023-12-26 08:26:26,669][123090] Updated weights for policy 1, policy_version 1100460 (0.0005) [2023-12-26 08:26:26,717][123090] Updated weights for policy 1, policy_version 1100470 (0.0008) [2023-12-26 08:26:26,762][123090] Updated weights for policy 1, policy_version 1100480 (0.0005) [2023-12-26 08:26:26,812][123091] Updated weights for policy 0, policy_version 1108182 (0.0006) [2023-12-26 08:26:26,858][123091] Updated weights for policy 0, policy_version 1108192 (0.0005) [2023-12-26 08:26:26,905][123091] Updated weights for policy 0, policy_version 1108202 (0.0005) [2023-12-26 08:26:27,439][123090] Updated weights for policy 1, policy_version 1100490 (0.0005) [2023-12-26 08:26:27,490][123090] Updated weights for policy 1, policy_version 1100500 (0.0006) [2023-12-26 08:26:27,559][123090] Updated weights for policy 1, policy_version 1100510 (0.0007) [2023-12-26 08:26:27,567][123091] Updated weights for policy 0, policy_version 1108212 (0.0005) [2023-12-26 08:26:27,642][123091] Updated weights for policy 0, policy_version 1108222 (0.0005) [2023-12-26 08:26:27,694][123091] Updated weights for policy 0, policy_version 1108232 (0.0005) [2023-12-26 08:26:28,162][123090] Updated weights for policy 1, policy_version 1100520 (0.0005) [2023-12-26 08:26:28,237][123090] Updated weights for policy 1, policy_version 1100530 (0.0005) [2023-12-26 08:26:28,297][123091] Updated weights for policy 0, policy_version 1108242 (0.0009) [2023-12-26 08:26:28,314][123090] Updated weights for policy 1, policy_version 1100540 (0.0005) [2023-12-26 08:26:28,367][123091] Updated weights for policy 0, policy_version 1108252 (0.0010) [2023-12-26 08:26:28,429][123091] Updated weights for policy 0, policy_version 1108262 (0.0011) [2023-12-26 08:26:28,499][123091] Updated weights for policy 0, policy_version 1108272 (0.0011) [2023-12-26 08:26:28,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 565460992. Throughput: 0: 8773.5, 1: 8826.1. Samples: 565451320. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:28,786][121949] Avg episode reward: [(0, '6334.152'), (1, '5766.011')] [2023-12-26 08:26:28,963][123090] Updated weights for policy 1, policy_version 1100550 (0.0010) [2023-12-26 08:26:29,022][123090] Updated weights for policy 1, policy_version 1100560 (0.0010) [2023-12-26 08:26:29,092][123090] Updated weights for policy 1, policy_version 1100570 (0.0010) [2023-12-26 08:26:29,189][123091] Updated weights for policy 0, policy_version 1108282 (0.0005) [2023-12-26 08:26:29,249][123091] Updated weights for policy 0, policy_version 1108292 (0.0009) [2023-12-26 08:26:29,301][123091] Updated weights for policy 0, policy_version 1108302 (0.0006) [2023-12-26 08:26:29,884][123090] Updated weights for policy 1, policy_version 1100580 (0.0009) [2023-12-26 08:26:29,951][123090] Updated weights for policy 1, policy_version 1100590 (0.0008) [2023-12-26 08:26:29,983][123091] Updated weights for policy 0, policy_version 1108312 (0.0008) [2023-12-26 08:26:30,009][123090] Updated weights for policy 1, policy_version 1100600 (0.0006) [2023-12-26 08:26:30,048][123091] Updated weights for policy 0, policy_version 1108322 (0.0008) [2023-12-26 08:26:30,102][123091] Updated weights for policy 0, policy_version 1108332 (0.0008) [2023-12-26 08:26:30,719][123091] Updated weights for policy 0, policy_version 1108342 (0.0006) [2023-12-26 08:26:30,768][123091] Updated weights for policy 0, policy_version 1108352 (0.0005) [2023-12-26 08:26:30,823][123091] Updated weights for policy 0, policy_version 1108362 (0.0005) [2023-12-26 08:26:30,894][123090] Updated weights for policy 1, policy_version 1100610 (0.0009) [2023-12-26 08:26:30,957][123090] Updated weights for policy 1, policy_version 1100620 (0.0010) [2023-12-26 08:26:31,010][123090] Updated weights for policy 1, policy_version 1100631 (0.0010) [2023-12-26 08:26:31,548][123091] Updated weights for policy 0, policy_version 1108372 (0.0007) [2023-12-26 08:26:31,597][123091] Updated weights for policy 0, policy_version 1108382 (0.0010) [2023-12-26 08:26:31,660][123091] Updated weights for policy 0, policy_version 1108392 (0.0008) [2023-12-26 08:26:31,783][123090] Updated weights for policy 1, policy_version 1100641 (0.0009) [2023-12-26 08:26:31,838][123090] Updated weights for policy 1, policy_version 1100651 (0.0010) [2023-12-26 08:26:31,893][123090] Updated weights for policy 1, policy_version 1100661 (0.0010) [2023-12-26 08:26:31,947][123090] Updated weights for policy 1, policy_version 1100671 (0.0010) [2023-12-26 08:26:32,367][123091] Updated weights for policy 0, policy_version 1108402 (0.0010) [2023-12-26 08:26:32,427][123091] Updated weights for policy 0, policy_version 1108412 (0.0007) [2023-12-26 08:26:32,480][123091] Updated weights for policy 0, policy_version 1108422 (0.0007) [2023-12-26 08:26:32,546][123091] Updated weights for policy 0, policy_version 1108432 (0.0007) [2023-12-26 08:26:32,909][123090] Updated weights for policy 1, policy_version 1100681 (0.0009) [2023-12-26 08:26:32,968][123090] Updated weights for policy 1, policy_version 1100691 (0.0009) [2023-12-26 08:26:33,021][123090] Updated weights for policy 1, policy_version 1100701 (0.0009) [2023-12-26 08:26:33,370][123091] Updated weights for policy 0, policy_version 1108442 (0.0010) [2023-12-26 08:26:33,431][123091] Updated weights for policy 0, policy_version 1108452 (0.0008) [2023-12-26 08:26:33,484][123091] Updated weights for policy 0, policy_version 1108462 (0.0009) [2023-12-26 08:26:33,758][123090] Updated weights for policy 1, policy_version 1100711 (0.0006) [2023-12-26 08:26:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 565551104. Throughput: 0: 8953.5, 1: 8843.7. Samples: 565564220. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:33,785][121949] Avg episode reward: [(0, '6276.746'), (1, '5609.423')] [2023-12-26 08:26:33,816][123090] Updated weights for policy 1, policy_version 1100721 (0.0005) [2023-12-26 08:26:33,877][123090] Updated weights for policy 1, policy_version 1100731 (0.0005) [2023-12-26 08:26:34,199][123091] Updated weights for policy 0, policy_version 1108472 (0.0008) [2023-12-26 08:26:34,265][123091] Updated weights for policy 0, policy_version 1108482 (0.0006) [2023-12-26 08:26:34,338][123091] Updated weights for policy 0, policy_version 1108492 (0.0006) [2023-12-26 08:26:34,596][123090] Updated weights for policy 1, policy_version 1100741 (0.0007) [2023-12-26 08:26:34,663][123090] Updated weights for policy 1, policy_version 1100751 (0.0009) [2023-12-26 08:26:34,734][123090] Updated weights for policy 1, policy_version 1100761 (0.0010) [2023-12-26 08:26:35,004][123091] Updated weights for policy 0, policy_version 1108502 (0.0005) [2023-12-26 08:26:35,053][123091] Updated weights for policy 0, policy_version 1108512 (0.0005) [2023-12-26 08:26:35,110][123091] Updated weights for policy 0, policy_version 1108522 (0.0006) [2023-12-26 08:26:35,648][123090] Updated weights for policy 1, policy_version 1100771 (0.0009) [2023-12-26 08:26:35,701][123090] Updated weights for policy 1, policy_version 1100781 (0.0010) [2023-12-26 08:26:35,712][123091] Updated weights for policy 0, policy_version 1108532 (0.0005) [2023-12-26 08:26:35,751][123090] Updated weights for policy 1, policy_version 1100791 (0.0009) [2023-12-26 08:26:35,778][123091] Updated weights for policy 0, policy_version 1108542 (0.0005) [2023-12-26 08:26:35,831][123091] Updated weights for policy 0, policy_version 1108552 (0.0005) [2023-12-26 08:26:36,459][123091] Updated weights for policy 0, policy_version 1108562 (0.0005) [2023-12-26 08:26:36,528][123091] Updated weights for policy 0, policy_version 1108572 (0.0009) [2023-12-26 08:26:36,595][123091] Updated weights for policy 0, policy_version 1108582 (0.0010) [2023-12-26 08:26:36,650][123090] Updated weights for policy 1, policy_version 1100801 (0.0009) [2023-12-26 08:26:36,653][123091] Updated weights for policy 0, policy_version 1108592 (0.0009) [2023-12-26 08:26:36,718][123090] Updated weights for policy 1, policy_version 1100811 (0.0009) [2023-12-26 08:26:36,782][123090] Updated weights for policy 1, policy_version 1100821 (0.0008) [2023-12-26 08:26:36,830][123090] Updated weights for policy 1, policy_version 1100831 (0.0009) [2023-12-26 08:26:37,467][123091] Updated weights for policy 0, policy_version 1108602 (0.0010) [2023-12-26 08:26:37,520][123091] Updated weights for policy 0, policy_version 1108613 (0.0009) [2023-12-26 08:26:37,573][123091] Updated weights for policy 0, policy_version 1108624 (0.0009) [2023-12-26 08:26:37,659][123090] Updated weights for policy 1, policy_version 1100841 (0.0009) [2023-12-26 08:26:37,715][123090] Updated weights for policy 1, policy_version 1100851 (0.0010) [2023-12-26 08:26:37,775][123090] Updated weights for policy 1, policy_version 1100861 (0.0009) [2023-12-26 08:26:38,431][123091] Updated weights for policy 0, policy_version 1108634 (0.0010) [2023-12-26 08:26:38,483][123091] Updated weights for policy 0, policy_version 1108644 (0.0010) [2023-12-26 08:26:38,531][123091] Updated weights for policy 0, policy_version 1108654 (0.0009) [2023-12-26 08:26:38,642][123090] Updated weights for policy 1, policy_version 1100871 (0.0010) [2023-12-26 08:26:38,707][123090] Updated weights for policy 1, policy_version 1100881 (0.0008) [2023-12-26 08:26:38,756][123090] Updated weights for policy 1, policy_version 1100891 (0.0009) [2023-12-26 08:26:38,784][121949] Fps is (10 sec: 18842.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 565649408. Throughput: 0: 9082.3, 1: 8803.3. Samples: 565620676. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:38,784][121949] Avg episode reward: [(0, '6150.569'), (1, '5514.946')] [2023-12-26 08:26:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001108656_283820032.pth... [2023-12-26 08:26:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001100896_281829376.pth... [2023-12-26 08:26:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001107568_283541504.pth [2023-12-26 08:26:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001099872_281567232.pth [2023-12-26 08:26:39,388][123091] Updated weights for policy 0, policy_version 1108664 (0.0010) [2023-12-26 08:26:39,455][123091] Updated weights for policy 0, policy_version 1108674 (0.0009) [2023-12-26 08:26:39,518][123091] Updated weights for policy 0, policy_version 1108684 (0.0010) [2023-12-26 08:26:39,663][123090] Updated weights for policy 1, policy_version 1100901 (0.0010) [2023-12-26 08:26:39,734][123090] Updated weights for policy 1, policy_version 1100911 (0.0009) [2023-12-26 08:26:39,805][123090] Updated weights for policy 1, policy_version 1100921 (0.0009) [2023-12-26 08:26:40,408][123091] Updated weights for policy 0, policy_version 1108694 (0.0009) [2023-12-26 08:26:40,465][123091] Updated weights for policy 0, policy_version 1108704 (0.0010) [2023-12-26 08:26:40,520][123091] Updated weights for policy 0, policy_version 1108714 (0.0008) [2023-12-26 08:26:40,658][123090] Updated weights for policy 1, policy_version 1100931 (0.0010) [2023-12-26 08:26:40,721][123090] Updated weights for policy 1, policy_version 1100941 (0.0010) [2023-12-26 08:26:40,781][123090] Updated weights for policy 1, policy_version 1100951 (0.0010) [2023-12-26 08:26:41,388][123091] Updated weights for policy 0, policy_version 1108724 (0.0009) [2023-12-26 08:26:41,460][123091] Updated weights for policy 0, policy_version 1108734 (0.0009) [2023-12-26 08:26:41,520][123091] Updated weights for policy 0, policy_version 1108744 (0.0009) [2023-12-26 08:26:41,624][123090] Updated weights for policy 1, policy_version 1100961 (0.0009) [2023-12-26 08:26:41,695][123090] Updated weights for policy 1, policy_version 1100971 (0.0007) [2023-12-26 08:26:41,767][123090] Updated weights for policy 1, policy_version 1100981 (0.0009) [2023-12-26 08:26:41,835][123090] Updated weights for policy 1, policy_version 1100991 (0.0010) [2023-12-26 08:26:42,414][123091] Updated weights for policy 0, policy_version 1108754 (0.0010) [2023-12-26 08:26:42,482][123091] Updated weights for policy 0, policy_version 1108764 (0.0009) [2023-12-26 08:26:42,550][123091] Updated weights for policy 0, policy_version 1108774 (0.0009) [2023-12-26 08:26:42,603][123091] Updated weights for policy 0, policy_version 1108784 (0.0009) [2023-12-26 08:26:42,638][123090] Updated weights for policy 1, policy_version 1101001 (0.0008) [2023-12-26 08:26:42,693][123090] Updated weights for policy 1, policy_version 1101011 (0.0010) [2023-12-26 08:26:42,749][123090] Updated weights for policy 1, policy_version 1101021 (0.0009) [2023-12-26 08:26:43,428][123091] Updated weights for policy 0, policy_version 1108794 (0.0009) [2023-12-26 08:26:43,492][123091] Updated weights for policy 0, policy_version 1108804 (0.0010) [2023-12-26 08:26:43,556][123091] Updated weights for policy 0, policy_version 1108815 (0.0009) [2023-12-26 08:26:43,622][123090] Updated weights for policy 1, policy_version 1101031 (0.0007) [2023-12-26 08:26:43,678][123090] Updated weights for policy 1, policy_version 1101041 (0.0005) [2023-12-26 08:26:43,726][123090] Updated weights for policy 1, policy_version 1101051 (0.0005) [2023-12-26 08:26:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 565731328. Throughput: 0: 9039.2, 1: 8670.2. Samples: 565720520. Policy #0 lag: (min: 10.0, avg: 30.1, max: 32.0) [2023-12-26 08:26:43,785][121949] Avg episode reward: [(0, '6136.951'), (1, '5522.521')] [2023-12-26 08:26:44,403][123091] Updated weights for policy 0, policy_version 1108825 (0.0010) [2023-12-26 08:26:44,447][123090] Updated weights for policy 1, policy_version 1101061 (0.0005) [2023-12-26 08:26:44,454][123091] Updated weights for policy 0, policy_version 1108835 (0.0009) [2023-12-26 08:26:44,501][123090] Updated weights for policy 1, policy_version 1101071 (0.0005) [2023-12-26 08:26:44,516][123091] Updated weights for policy 0, policy_version 1108845 (0.0009) [2023-12-26 08:26:44,549][123090] Updated weights for policy 1, policy_version 1101081 (0.0005) [2023-12-26 08:26:45,274][123090] Updated weights for policy 1, policy_version 1101091 (0.0007) [2023-12-26 08:26:45,325][123090] Updated weights for policy 1, policy_version 1101101 (0.0009) [2023-12-26 08:26:45,381][123090] Updated weights for policy 1, policy_version 1101111 (0.0008) [2023-12-26 08:26:45,448][123091] Updated weights for policy 0, policy_version 1108855 (0.0007) [2023-12-26 08:26:45,509][123091] Updated weights for policy 0, policy_version 1108865 (0.0009) [2023-12-26 08:26:45,565][123091] Updated weights for policy 0, policy_version 1108875 (0.0009) [2023-12-26 08:26:46,229][123090] Updated weights for policy 1, policy_version 1101121 (0.0008) [2023-12-26 08:26:46,299][123090] Updated weights for policy 1, policy_version 1101131 (0.0009) [2023-12-26 08:26:46,355][123090] Updated weights for policy 1, policy_version 1101141 (0.0008) [2023-12-26 08:26:46,358][123091] Updated weights for policy 0, policy_version 1108885 (0.0009) [2023-12-26 08:26:46,409][123091] Updated weights for policy 0, policy_version 1108895 (0.0007) [2023-12-26 08:26:46,412][123090] Updated weights for policy 1, policy_version 1101151 (0.0008) [2023-12-26 08:26:46,462][123091] Updated weights for policy 0, policy_version 1108905 (0.0009) [2023-12-26 08:26:47,234][123090] Updated weights for policy 1, policy_version 1101161 (0.0009) [2023-12-26 08:26:47,283][123090] Updated weights for policy 1, policy_version 1101171 (0.0009) [2023-12-26 08:26:47,308][123091] Updated weights for policy 0, policy_version 1108915 (0.0009) [2023-12-26 08:26:47,337][123090] Updated weights for policy 1, policy_version 1101181 (0.0008) [2023-12-26 08:26:47,360][123091] Updated weights for policy 0, policy_version 1108925 (0.0007) [2023-12-26 08:26:47,413][123091] Updated weights for policy 0, policy_version 1108935 (0.0009) [2023-12-26 08:26:48,121][123090] Updated weights for policy 1, policy_version 1101191 (0.0009) [2023-12-26 08:26:48,190][123090] Updated weights for policy 1, policy_version 1101201 (0.0009) [2023-12-26 08:26:48,236][123091] Updated weights for policy 0, policy_version 1108945 (0.0009) [2023-12-26 08:26:48,250][123090] Updated weights for policy 1, policy_version 1101211 (0.0010) [2023-12-26 08:26:48,288][123091] Updated weights for policy 0, policy_version 1108955 (0.0007) [2023-12-26 08:26:48,349][123091] Updated weights for policy 0, policy_version 1108965 (0.0009) [2023-12-26 08:26:48,424][123091] Updated weights for policy 0, policy_version 1108975 (0.0009) [2023-12-26 08:26:48,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 565813248. Throughput: 0: 8980.9, 1: 8696.2. Samples: 565823360. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:26:48,785][121949] Avg episode reward: [(0, '6223.493'), (1, '5632.086')] [2023-12-26 08:26:49,049][123090] Updated weights for policy 1, policy_version 1101221 (0.0010) [2023-12-26 08:26:49,140][123090] Updated weights for policy 1, policy_version 1101231 (0.0009) [2023-12-26 08:26:49,166][123091] Updated weights for policy 0, policy_version 1108985 (0.0011) [2023-12-26 08:26:49,202][123090] Updated weights for policy 1, policy_version 1101241 (0.0009) [2023-12-26 08:26:49,227][123091] Updated weights for policy 0, policy_version 1108995 (0.0010) [2023-12-26 08:26:49,287][123091] Updated weights for policy 0, policy_version 1109005 (0.0010) [2023-12-26 08:26:49,984][123090] Updated weights for policy 1, policy_version 1101251 (0.0009) [2023-12-26 08:26:50,040][123090] Updated weights for policy 1, policy_version 1101261 (0.0010) [2023-12-26 08:26:50,099][123090] Updated weights for policy 1, policy_version 1101271 (0.0010) [2023-12-26 08:26:50,103][123091] Updated weights for policy 0, policy_version 1109015 (0.0008) [2023-12-26 08:26:50,161][123091] Updated weights for policy 0, policy_version 1109025 (0.0008) [2023-12-26 08:26:50,225][123091] Updated weights for policy 0, policy_version 1109035 (0.0009) [2023-12-26 08:26:50,960][123090] Updated weights for policy 1, policy_version 1101281 (0.0008) [2023-12-26 08:26:51,022][123091] Updated weights for policy 0, policy_version 1109045 (0.0009) [2023-12-26 08:26:51,024][123090] Updated weights for policy 1, policy_version 1101291 (0.0011) [2023-12-26 08:26:51,086][123091] Updated weights for policy 0, policy_version 1109055 (0.0009) [2023-12-26 08:26:51,088][123090] Updated weights for policy 1, policy_version 1101301 (0.0007) [2023-12-26 08:26:51,152][123091] Updated weights for policy 0, policy_version 1109065 (0.0009) [2023-12-26 08:26:51,156][123090] Updated weights for policy 1, policy_version 1101311 (0.0006) [2023-12-26 08:26:51,932][123090] Updated weights for policy 1, policy_version 1101321 (0.0010) [2023-12-26 08:26:51,977][123091] Updated weights for policy 0, policy_version 1109075 (0.0009) [2023-12-26 08:26:52,000][123090] Updated weights for policy 1, policy_version 1101331 (0.0011) [2023-12-26 08:26:52,032][123091] Updated weights for policy 0, policy_version 1109085 (0.0006) [2023-12-26 08:26:52,064][123090] Updated weights for policy 1, policy_version 1101341 (0.0011) [2023-12-26 08:26:52,088][123091] Updated weights for policy 0, policy_version 1109095 (0.0006) [2023-12-26 08:26:52,766][123090] Updated weights for policy 1, policy_version 1101351 (0.0007) [2023-12-26 08:26:52,819][123090] Updated weights for policy 1, policy_version 1101361 (0.0006) [2023-12-26 08:26:52,862][123091] Updated weights for policy 0, policy_version 1109105 (0.0009) [2023-12-26 08:26:52,869][123090] Updated weights for policy 1, policy_version 1101371 (0.0006) [2023-12-26 08:26:52,924][123091] Updated weights for policy 0, policy_version 1109115 (0.0009) [2023-12-26 08:26:52,980][123091] Updated weights for policy 0, policy_version 1109125 (0.0010) [2023-12-26 08:26:53,042][123091] Updated weights for policy 0, policy_version 1109135 (0.0009) [2023-12-26 08:26:53,646][123090] Updated weights for policy 1, policy_version 1101381 (0.0008) [2023-12-26 08:26:53,693][123090] Updated weights for policy 1, policy_version 1101391 (0.0010) [2023-12-26 08:26:53,748][123090] Updated weights for policy 1, policy_version 1101401 (0.0010) [2023-12-26 08:26:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 565895168. Throughput: 0: 9037.7, 1: 8682.5. Samples: 565876440. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:26:53,786][121949] Avg episode reward: [(0, '6330.975'), (1, '5689.752')] [2023-12-26 08:26:53,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001101408_281960448.pth... [2023-12-26 08:26:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001100384_281698304.pth [2023-12-26 08:26:53,837][123091] Updated weights for policy 0, policy_version 1109145 (0.0006) [2023-12-26 08:26:53,900][123091] Updated weights for policy 0, policy_version 1109155 (0.0005) [2023-12-26 08:26:53,969][123091] Updated weights for policy 0, policy_version 1109165 (0.0006) [2023-12-26 08:26:53,984][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001109168_283951104.pth... [2023-12-26 08:26:53,989][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001108080_283672576.pth [2023-12-26 08:26:54,619][123090] Updated weights for policy 1, policy_version 1101411 (0.0010) [2023-12-26 08:26:54,674][123090] Updated weights for policy 1, policy_version 1101421 (0.0010) [2023-12-26 08:26:54,703][123091] Updated weights for policy 0, policy_version 1109175 (0.0011) [2023-12-26 08:26:54,733][123090] Updated weights for policy 1, policy_version 1101431 (0.0010) [2023-12-26 08:26:54,765][123091] Updated weights for policy 0, policy_version 1109185 (0.0010) [2023-12-26 08:26:54,824][123091] Updated weights for policy 0, policy_version 1109195 (0.0010) [2023-12-26 08:26:55,567][123090] Updated weights for policy 1, policy_version 1101441 (0.0010) [2023-12-26 08:26:55,597][123091] Updated weights for policy 0, policy_version 1109205 (0.0008) [2023-12-26 08:26:55,618][123090] Updated weights for policy 1, policy_version 1101451 (0.0010) [2023-12-26 08:26:55,654][123091] Updated weights for policy 0, policy_version 1109215 (0.0008) [2023-12-26 08:26:55,670][123090] Updated weights for policy 1, policy_version 1101461 (0.0010) [2023-12-26 08:26:55,712][123091] Updated weights for policy 0, policy_version 1109225 (0.0010) [2023-12-26 08:26:55,718][123090] Updated weights for policy 1, policy_version 1101471 (0.0010) [2023-12-26 08:26:56,414][123091] Updated weights for policy 0, policy_version 1109235 (0.0009) [2023-12-26 08:26:56,470][123091] Updated weights for policy 0, policy_version 1109245 (0.0009) [2023-12-26 08:26:56,532][123091] Updated weights for policy 0, policy_version 1109255 (0.0008) [2023-12-26 08:26:56,567][123090] Updated weights for policy 1, policy_version 1101481 (0.0006) [2023-12-26 08:26:56,616][123090] Updated weights for policy 1, policy_version 1101491 (0.0005) [2023-12-26 08:26:56,663][123090] Updated weights for policy 1, policy_version 1101501 (0.0005) [2023-12-26 08:26:57,202][123091] Updated weights for policy 0, policy_version 1109265 (0.0009) [2023-12-26 08:26:57,266][123091] Updated weights for policy 0, policy_version 1109275 (0.0010) [2023-12-26 08:26:57,331][123091] Updated weights for policy 0, policy_version 1109285 (0.0009) [2023-12-26 08:26:57,351][123090] Updated weights for policy 1, policy_version 1101511 (0.0007) [2023-12-26 08:26:57,389][123091] Updated weights for policy 0, policy_version 1109295 (0.0007) [2023-12-26 08:26:57,405][123090] Updated weights for policy 1, policy_version 1101521 (0.0006) [2023-12-26 08:26:57,468][123090] Updated weights for policy 1, policy_version 1101531 (0.0008) [2023-12-26 08:26:58,150][123091] Updated weights for policy 0, policy_version 1109305 (0.0008) [2023-12-26 08:26:58,178][123090] Updated weights for policy 1, policy_version 1101541 (0.0009) [2023-12-26 08:26:58,206][123091] Updated weights for policy 0, policy_version 1109315 (0.0008) [2023-12-26 08:26:58,246][123090] Updated weights for policy 1, policy_version 1101551 (0.0010) [2023-12-26 08:26:58,278][123091] Updated weights for policy 0, policy_version 1109325 (0.0007) [2023-12-26 08:26:58,309][123090] Updated weights for policy 1, policy_version 1101561 (0.0010) [2023-12-26 08:26:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 565993472. Throughput: 0: 9171.3, 1: 8750.1. Samples: 565985768. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:26:58,785][121949] Avg episode reward: [(0, '6336.179'), (1, '5722.061')] [2023-12-26 08:26:59,162][123091] Updated weights for policy 0, policy_version 1109336 (0.0009) [2023-12-26 08:26:59,180][123090] Updated weights for policy 1, policy_version 1101571 (0.0011) [2023-12-26 08:26:59,227][123091] Updated weights for policy 0, policy_version 1109346 (0.0011) [2023-12-26 08:26:59,246][123090] Updated weights for policy 1, policy_version 1101581 (0.0010) [2023-12-26 08:26:59,299][123091] Updated weights for policy 0, policy_version 1109356 (0.0008) [2023-12-26 08:26:59,314][123090] Updated weights for policy 1, policy_version 1101591 (0.0009) [2023-12-26 08:27:00,072][123090] Updated weights for policy 1, policy_version 1101601 (0.0011) [2023-12-26 08:27:00,087][123091] Updated weights for policy 0, policy_version 1109366 (0.0008) [2023-12-26 08:27:00,133][123090] Updated weights for policy 1, policy_version 1101611 (0.0009) [2023-12-26 08:27:00,149][123091] Updated weights for policy 0, policy_version 1109376 (0.0007) [2023-12-26 08:27:00,192][123090] Updated weights for policy 1, policy_version 1101621 (0.0005) [2023-12-26 08:27:00,209][123091] Updated weights for policy 0, policy_version 1109386 (0.0009) [2023-12-26 08:27:00,251][123090] Updated weights for policy 1, policy_version 1101631 (0.0005) [2023-12-26 08:27:00,913][123091] Updated weights for policy 0, policy_version 1109396 (0.0008) [2023-12-26 08:27:00,948][123090] Updated weights for policy 1, policy_version 1101641 (0.0007) [2023-12-26 08:27:00,984][123091] Updated weights for policy 0, policy_version 1109406 (0.0006) [2023-12-26 08:27:01,012][123090] Updated weights for policy 1, policy_version 1101651 (0.0007) [2023-12-26 08:27:01,049][123091] Updated weights for policy 0, policy_version 1109416 (0.0007) [2023-12-26 08:27:01,081][123090] Updated weights for policy 1, policy_version 1101661 (0.0008) [2023-12-26 08:27:01,859][123091] Updated weights for policy 0, policy_version 1109426 (0.0010) [2023-12-26 08:27:01,869][123090] Updated weights for policy 1, policy_version 1101671 (0.0009) [2023-12-26 08:27:01,910][123091] Updated weights for policy 0, policy_version 1109436 (0.0010) [2023-12-26 08:27:01,921][123090] Updated weights for policy 1, policy_version 1101682 (0.0010) [2023-12-26 08:27:01,966][123091] Updated weights for policy 0, policy_version 1109446 (0.0011) [2023-12-26 08:27:01,973][123090] Updated weights for policy 1, policy_version 1101692 (0.0010) [2023-12-26 08:27:02,029][123091] Updated weights for policy 0, policy_version 1109456 (0.0011) [2023-12-26 08:27:02,780][123091] Updated weights for policy 0, policy_version 1109466 (0.0009) [2023-12-26 08:27:02,792][123090] Updated weights for policy 1, policy_version 1101702 (0.0009) [2023-12-26 08:27:02,840][123091] Updated weights for policy 0, policy_version 1109476 (0.0006) [2023-12-26 08:27:02,845][123090] Updated weights for policy 1, policy_version 1101712 (0.0008) [2023-12-26 08:27:02,902][123090] Updated weights for policy 1, policy_version 1101722 (0.0008) [2023-12-26 08:27:02,908][123091] Updated weights for policy 0, policy_version 1109486 (0.0007) [2023-12-26 08:27:03,690][123091] Updated weights for policy 0, policy_version 1109496 (0.0011) [2023-12-26 08:27:03,728][123090] Updated weights for policy 1, policy_version 1101732 (0.0007) [2023-12-26 08:27:03,752][123091] Updated weights for policy 0, policy_version 1109506 (0.0010) [2023-12-26 08:27:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 566075392. Throughput: 0: 9098.1, 1: 8729.6. Samples: 566094392. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:03,785][121949] Avg episode reward: [(0, '6261.367'), (1, '5545.729')] [2023-12-26 08:27:03,796][123090] Updated weights for policy 1, policy_version 1101742 (0.0005) [2023-12-26 08:27:03,810][123091] Updated weights for policy 0, policy_version 1109516 (0.0010) [2023-12-26 08:27:03,875][123090] Updated weights for policy 1, policy_version 1101752 (0.0006) [2023-12-26 08:27:04,641][123090] Updated weights for policy 1, policy_version 1101762 (0.0008) [2023-12-26 08:27:04,649][123091] Updated weights for policy 0, policy_version 1109526 (0.0011) [2023-12-26 08:27:04,700][123090] Updated weights for policy 1, policy_version 1101772 (0.0008) [2023-12-26 08:27:04,704][123091] Updated weights for policy 0, policy_version 1109536 (0.0010) [2023-12-26 08:27:04,753][123090] Updated weights for policy 1, policy_version 1101782 (0.0007) [2023-12-26 08:27:04,759][123091] Updated weights for policy 0, policy_version 1109546 (0.0010) [2023-12-26 08:27:04,804][123090] Updated weights for policy 1, policy_version 1101792 (0.0006) [2023-12-26 08:27:05,580][123091] Updated weights for policy 0, policy_version 1109556 (0.0010) [2023-12-26 08:27:05,624][123090] Updated weights for policy 1, policy_version 1101802 (0.0008) [2023-12-26 08:27:05,634][123091] Updated weights for policy 0, policy_version 1109566 (0.0006) [2023-12-26 08:27:05,671][123090] Updated weights for policy 1, policy_version 1101812 (0.0009) [2023-12-26 08:27:05,678][123091] Updated weights for policy 0, policy_version 1109576 (0.0005) [2023-12-26 08:27:05,718][123090] Updated weights for policy 1, policy_version 1101822 (0.0008) [2023-12-26 08:27:06,368][123091] Updated weights for policy 0, policy_version 1109586 (0.0005) [2023-12-26 08:27:06,442][123091] Updated weights for policy 0, policy_version 1109596 (0.0006) [2023-12-26 08:27:06,511][123091] Updated weights for policy 0, policy_version 1109606 (0.0006) [2023-12-26 08:27:06,569][123091] Updated weights for policy 0, policy_version 1109616 (0.0008) [2023-12-26 08:27:06,595][123090] Updated weights for policy 1, policy_version 1101832 (0.0010) [2023-12-26 08:27:06,655][123090] Updated weights for policy 1, policy_version 1101842 (0.0009) [2023-12-26 08:27:06,720][123090] Updated weights for policy 1, policy_version 1101852 (0.0009) [2023-12-26 08:27:07,222][123091] Updated weights for policy 0, policy_version 1109626 (0.0009) [2023-12-26 08:27:07,282][123091] Updated weights for policy 0, policy_version 1109636 (0.0010) [2023-12-26 08:27:07,343][123091] Updated weights for policy 0, policy_version 1109646 (0.0009) [2023-12-26 08:27:07,586][123090] Updated weights for policy 1, policy_version 1101862 (0.0010) [2023-12-26 08:27:07,644][123090] Updated weights for policy 1, policy_version 1101872 (0.0009) [2023-12-26 08:27:07,702][123090] Updated weights for policy 1, policy_version 1101882 (0.0010) [2023-12-26 08:27:08,045][123091] Updated weights for policy 0, policy_version 1109656 (0.0006) [2023-12-26 08:27:08,097][123091] Updated weights for policy 0, policy_version 1109666 (0.0006) [2023-12-26 08:27:08,147][123091] Updated weights for policy 0, policy_version 1109676 (0.0005) [2023-12-26 08:27:08,591][123090] Updated weights for policy 1, policy_version 1101892 (0.0009) [2023-12-26 08:27:08,651][123090] Updated weights for policy 1, policy_version 1101902 (0.0009) [2023-12-26 08:27:08,708][123090] Updated weights for policy 1, policy_version 1101912 (0.0009) [2023-12-26 08:27:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 566173696. Throughput: 0: 9124.5, 1: 8766.2. Samples: 566147708. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:08,785][121949] Avg episode reward: [(0, '6213.099'), (1, '5546.031')] [2023-12-26 08:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001101920_282091520.pth... [2023-12-26 08:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001109680_284082176.pth... [2023-12-26 08:27:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001100896_281829376.pth [2023-12-26 08:27:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001108656_283820032.pth [2023-12-26 08:27:08,918][123091] Updated weights for policy 0, policy_version 1109686 (0.0008) [2023-12-26 08:27:08,990][123091] Updated weights for policy 0, policy_version 1109696 (0.0010) [2023-12-26 08:27:09,046][123091] Updated weights for policy 0, policy_version 1109706 (0.0009) [2023-12-26 08:27:09,554][123090] Updated weights for policy 1, policy_version 1101922 (0.0010) [2023-12-26 08:27:09,617][123090] Updated weights for policy 1, policy_version 1101932 (0.0010) [2023-12-26 08:27:09,671][123090] Updated weights for policy 1, policy_version 1101942 (0.0010) [2023-12-26 08:27:09,722][123090] Updated weights for policy 1, policy_version 1101952 (0.0010) [2023-12-26 08:27:09,897][123091] Updated weights for policy 0, policy_version 1109716 (0.0010) [2023-12-26 08:27:09,967][123091] Updated weights for policy 0, policy_version 1109726 (0.0010) [2023-12-26 08:27:10,031][123091] Updated weights for policy 0, policy_version 1109736 (0.0008) [2023-12-26 08:27:10,640][123090] Updated weights for policy 1, policy_version 1101962 (0.0010) [2023-12-26 08:27:10,706][123090] Updated weights for policy 1, policy_version 1101972 (0.0009) [2023-12-26 08:27:10,769][123090] Updated weights for policy 1, policy_version 1101982 (0.0009) [2023-12-26 08:27:10,776][123091] Updated weights for policy 0, policy_version 1109746 (0.0006) [2023-12-26 08:27:10,846][123091] Updated weights for policy 0, policy_version 1109756 (0.0007) [2023-12-26 08:27:10,915][123091] Updated weights for policy 0, policy_version 1109766 (0.0007) [2023-12-26 08:27:10,972][123091] Updated weights for policy 0, policy_version 1109776 (0.0006) [2023-12-26 08:27:11,655][123090] Updated weights for policy 1, policy_version 1101992 (0.0009) [2023-12-26 08:27:11,722][123090] Updated weights for policy 1, policy_version 1102002 (0.0008) [2023-12-26 08:27:11,750][123091] Updated weights for policy 0, policy_version 1109786 (0.0010) [2023-12-26 08:27:11,790][123090] Updated weights for policy 1, policy_version 1102012 (0.0008) [2023-12-26 08:27:11,816][123091] Updated weights for policy 0, policy_version 1109796 (0.0008) [2023-12-26 08:27:11,887][123091] Updated weights for policy 0, policy_version 1109806 (0.0010) [2023-12-26 08:27:12,615][123091] Updated weights for policy 0, policy_version 1109816 (0.0007) [2023-12-26 08:27:12,651][123090] Updated weights for policy 1, policy_version 1102022 (0.0009) [2023-12-26 08:27:12,669][123091] Updated weights for policy 0, policy_version 1109826 (0.0006) [2023-12-26 08:27:12,713][123090] Updated weights for policy 1, policy_version 1102032 (0.0010) [2023-12-26 08:27:12,726][123091] Updated weights for policy 0, policy_version 1109836 (0.0006) [2023-12-26 08:27:12,776][123090] Updated weights for policy 1, policy_version 1102042 (0.0010) [2023-12-26 08:27:13,413][123091] Updated weights for policy 0, policy_version 1109846 (0.0005) [2023-12-26 08:27:13,477][123091] Updated weights for policy 0, policy_version 1109856 (0.0007) [2023-12-26 08:27:13,541][123091] Updated weights for policy 0, policy_version 1109866 (0.0009) [2023-12-26 08:27:13,647][123090] Updated weights for policy 1, policy_version 1102052 (0.0009) [2023-12-26 08:27:13,704][123090] Updated weights for policy 1, policy_version 1102062 (0.0009) [2023-12-26 08:27:13,763][123090] Updated weights for policy 1, policy_version 1102073 (0.0010) [2023-12-26 08:27:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 566255616. Throughput: 0: 9105.8, 1: 8675.1. Samples: 566251456. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:13,785][121949] Avg episode reward: [(0, '6253.217'), (1, '5747.634')] [2023-12-26 08:27:14,323][123091] Updated weights for policy 0, policy_version 1109876 (0.0008) [2023-12-26 08:27:14,373][123091] Updated weights for policy 0, policy_version 1109886 (0.0007) [2023-12-26 08:27:14,436][123091] Updated weights for policy 0, policy_version 1109896 (0.0007) [2023-12-26 08:27:14,634][123090] Updated weights for policy 1, policy_version 1102083 (0.0010) [2023-12-26 08:27:14,702][123090] Updated weights for policy 1, policy_version 1102093 (0.0010) [2023-12-26 08:27:14,759][123090] Updated weights for policy 1, policy_version 1102103 (0.0010) [2023-12-26 08:27:15,206][123091] Updated weights for policy 0, policy_version 1109906 (0.0006) [2023-12-26 08:27:15,278][123091] Updated weights for policy 0, policy_version 1109916 (0.0009) [2023-12-26 08:27:15,336][123091] Updated weights for policy 0, policy_version 1109926 (0.0010) [2023-12-26 08:27:15,404][123091] Updated weights for policy 0, policy_version 1109936 (0.0009) [2023-12-26 08:27:15,567][123090] Updated weights for policy 1, policy_version 1102113 (0.0010) [2023-12-26 08:27:15,627][123090] Updated weights for policy 1, policy_version 1102123 (0.0005) [2023-12-26 08:27:15,695][123090] Updated weights for policy 1, policy_version 1102133 (0.0006) [2023-12-26 08:27:15,769][123090] Updated weights for policy 1, policy_version 1102143 (0.0011) [2023-12-26 08:27:16,132][123091] Updated weights for policy 0, policy_version 1109946 (0.0006) [2023-12-26 08:27:16,191][123091] Updated weights for policy 0, policy_version 1109956 (0.0005) [2023-12-26 08:27:16,249][123091] Updated weights for policy 0, policy_version 1109966 (0.0006) [2023-12-26 08:27:16,548][123090] Updated weights for policy 1, policy_version 1102153 (0.0010) [2023-12-26 08:27:16,603][123090] Updated weights for policy 1, policy_version 1102163 (0.0010) [2023-12-26 08:27:16,662][123090] Updated weights for policy 1, policy_version 1102173 (0.0007) [2023-12-26 08:27:17,073][123091] Updated weights for policy 0, policy_version 1109976 (0.0009) [2023-12-26 08:27:17,136][123091] Updated weights for policy 0, policy_version 1109986 (0.0010) [2023-12-26 08:27:17,193][123091] Updated weights for policy 0, policy_version 1109996 (0.0010) [2023-12-26 08:27:17,338][123090] Updated weights for policy 1, policy_version 1102183 (0.0006) [2023-12-26 08:27:17,411][123090] Updated weights for policy 1, policy_version 1102193 (0.0005) [2023-12-26 08:27:17,476][123090] Updated weights for policy 1, policy_version 1102203 (0.0005) [2023-12-26 08:27:18,113][123091] Updated weights for policy 0, policy_version 1110006 (0.0007) [2023-12-26 08:27:18,122][123090] Updated weights for policy 1, policy_version 1102213 (0.0005) [2023-12-26 08:27:18,174][123090] Updated weights for policy 1, policy_version 1102223 (0.0007) [2023-12-26 08:27:18,174][123091] Updated weights for policy 0, policy_version 1110016 (0.0006) [2023-12-26 08:27:18,222][123090] Updated weights for policy 1, policy_version 1102233 (0.0011) [2023-12-26 08:27:18,231][123091] Updated weights for policy 0, policy_version 1110026 (0.0006) [2023-12-26 08:27:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 566345728. Throughput: 0: 8989.3, 1: 8684.8. Samples: 566359552. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:18,784][121949] Avg episode reward: [(0, '6246.712'), (1, '5853.571')] [2023-12-26 08:27:18,941][123090] Updated weights for policy 1, policy_version 1102243 (0.0011) [2023-12-26 08:27:19,004][123090] Updated weights for policy 1, policy_version 1102253 (0.0006) [2023-12-26 08:27:19,006][123091] Updated weights for policy 0, policy_version 1110036 (0.0007) [2023-12-26 08:27:19,065][123090] Updated weights for policy 1, policy_version 1102263 (0.0005) [2023-12-26 08:27:19,070][123091] Updated weights for policy 0, policy_version 1110046 (0.0009) [2023-12-26 08:27:19,143][123091] Updated weights for policy 0, policy_version 1110056 (0.0005) [2023-12-26 08:27:19,868][123090] Updated weights for policy 1, policy_version 1102273 (0.0006) [2023-12-26 08:27:19,932][123090] Updated weights for policy 1, policy_version 1102283 (0.0010) [2023-12-26 08:27:19,938][123091] Updated weights for policy 0, policy_version 1110066 (0.0006) [2023-12-26 08:27:19,989][123090] Updated weights for policy 1, policy_version 1102293 (0.0008) [2023-12-26 08:27:19,991][123091] Updated weights for policy 0, policy_version 1110076 (0.0008) [2023-12-26 08:27:20,046][123090] Updated weights for policy 1, policy_version 1102303 (0.0006) [2023-12-26 08:27:20,061][123091] Updated weights for policy 0, policy_version 1110086 (0.0010) [2023-12-26 08:27:20,132][123091] Updated weights for policy 0, policy_version 1110096 (0.0010) [2023-12-26 08:27:20,862][123090] Updated weights for policy 1, policy_version 1102313 (0.0008) [2023-12-26 08:27:20,919][123090] Updated weights for policy 1, policy_version 1102323 (0.0011) [2023-12-26 08:27:20,980][123090] Updated weights for policy 1, policy_version 1102333 (0.0011) [2023-12-26 08:27:20,998][123091] Updated weights for policy 0, policy_version 1110106 (0.0007) [2023-12-26 08:27:21,074][123091] Updated weights for policy 0, policy_version 1110116 (0.0009) [2023-12-26 08:27:21,140][123091] Updated weights for policy 0, policy_version 1110126 (0.0009) [2023-12-26 08:27:21,774][123090] Updated weights for policy 1, policy_version 1102343 (0.0007) [2023-12-26 08:27:21,841][123090] Updated weights for policy 1, policy_version 1102353 (0.0009) [2023-12-26 08:27:21,901][123090] Updated weights for policy 1, policy_version 1102363 (0.0011) [2023-12-26 08:27:21,960][123091] Updated weights for policy 0, policy_version 1110136 (0.0006) [2023-12-26 08:27:22,018][123091] Updated weights for policy 0, policy_version 1110146 (0.0005) [2023-12-26 08:27:22,067][123091] Updated weights for policy 0, policy_version 1110156 (0.0005) [2023-12-26 08:27:22,666][123090] Updated weights for policy 1, policy_version 1102373 (0.0007) [2023-12-26 08:27:22,728][123090] Updated weights for policy 1, policy_version 1102383 (0.0006) [2023-12-26 08:27:22,757][123091] Updated weights for policy 0, policy_version 1110166 (0.0007) [2023-12-26 08:27:22,783][123090] Updated weights for policy 1, policy_version 1102393 (0.0007) [2023-12-26 08:27:22,824][123091] Updated weights for policy 0, policy_version 1110176 (0.0005) [2023-12-26 08:27:22,889][123091] Updated weights for policy 0, policy_version 1110186 (0.0005) [2023-12-26 08:27:23,499][123090] Updated weights for policy 1, policy_version 1102403 (0.0006) [2023-12-26 08:27:23,512][123091] Updated weights for policy 0, policy_version 1110196 (0.0006) [2023-12-26 08:27:23,545][123090] Updated weights for policy 1, policy_version 1102413 (0.0005) [2023-12-26 08:27:23,576][123091] Updated weights for policy 0, policy_version 1110206 (0.0008) [2023-12-26 08:27:23,595][123090] Updated weights for policy 1, policy_version 1102423 (0.0005) [2023-12-26 08:27:23,641][123091] Updated weights for policy 0, policy_version 1110216 (0.0007) [2023-12-26 08:27:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 566444032. Throughput: 0: 8857.7, 1: 8712.1. Samples: 566411316. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:23,785][121949] Avg episode reward: [(0, '6259.154'), (1, '5919.272')] [2023-12-26 08:27:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001102432_282222592.pth... [2023-12-26 08:27:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001110224_284221440.pth... [2023-12-26 08:27:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001101408_281960448.pth [2023-12-26 08:27:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001109168_283951104.pth [2023-12-26 08:27:24,327][123091] Updated weights for policy 0, policy_version 1110226 (0.0008) [2023-12-26 08:27:24,348][123090] Updated weights for policy 1, policy_version 1102433 (0.0005) [2023-12-26 08:27:24,387][123091] Updated weights for policy 0, policy_version 1110236 (0.0008) [2023-12-26 08:27:24,417][123090] Updated weights for policy 1, policy_version 1102443 (0.0009) [2023-12-26 08:27:24,448][123091] Updated weights for policy 0, policy_version 1110246 (0.0005) [2023-12-26 08:27:24,484][123090] Updated weights for policy 1, policy_version 1102453 (0.0011) [2023-12-26 08:27:24,520][123091] Updated weights for policy 0, policy_version 1110256 (0.0006) [2023-12-26 08:27:24,539][123090] Updated weights for policy 1, policy_version 1102463 (0.0010) [2023-12-26 08:27:25,190][123091] Updated weights for policy 0, policy_version 1110266 (0.0005) [2023-12-26 08:27:25,255][123091] Updated weights for policy 0, policy_version 1110276 (0.0009) [2023-12-26 08:27:25,309][123091] Updated weights for policy 0, policy_version 1110286 (0.0006) [2023-12-26 08:27:25,407][123090] Updated weights for policy 1, policy_version 1102473 (0.0009) [2023-12-26 08:27:25,465][123090] Updated weights for policy 1, policy_version 1102483 (0.0010) [2023-12-26 08:27:25,524][123090] Updated weights for policy 1, policy_version 1102493 (0.0007) [2023-12-26 08:27:25,963][123091] Updated weights for policy 0, policy_version 1110296 (0.0006) [2023-12-26 08:27:26,009][123091] Updated weights for policy 0, policy_version 1110306 (0.0005) [2023-12-26 08:27:26,067][123091] Updated weights for policy 0, policy_version 1110316 (0.0006) [2023-12-26 08:27:26,283][123090] Updated weights for policy 1, policy_version 1102503 (0.0005) [2023-12-26 08:27:26,352][123090] Updated weights for policy 1, policy_version 1102513 (0.0010) [2023-12-26 08:27:26,416][123090] Updated weights for policy 1, policy_version 1102523 (0.0011) [2023-12-26 08:27:26,762][123091] Updated weights for policy 0, policy_version 1110326 (0.0005) [2023-12-26 08:27:26,815][123091] Updated weights for policy 0, policy_version 1110336 (0.0006) [2023-12-26 08:27:26,865][123091] Updated weights for policy 0, policy_version 1110346 (0.0010) [2023-12-26 08:27:27,205][123090] Updated weights for policy 1, policy_version 1102533 (0.0010) [2023-12-26 08:27:27,266][123090] Updated weights for policy 1, policy_version 1102543 (0.0010) [2023-12-26 08:27:27,327][123090] Updated weights for policy 1, policy_version 1102553 (0.0007) [2023-12-26 08:27:27,660][123091] Updated weights for policy 0, policy_version 1110356 (0.0010) [2023-12-26 08:27:27,707][123091] Updated weights for policy 0, policy_version 1110366 (0.0010) [2023-12-26 08:27:27,758][123091] Updated weights for policy 0, policy_version 1110376 (0.0010) [2023-12-26 08:27:28,022][123090] Updated weights for policy 1, policy_version 1102563 (0.0005) [2023-12-26 08:27:28,094][123090] Updated weights for policy 1, policy_version 1102573 (0.0005) [2023-12-26 08:27:28,150][123090] Updated weights for policy 1, policy_version 1102583 (0.0005) [2023-12-26 08:27:28,568][123091] Updated weights for policy 0, policy_version 1110386 (0.0010) [2023-12-26 08:27:28,625][123091] Updated weights for policy 0, policy_version 1110396 (0.0008) [2023-12-26 08:27:28,689][123091] Updated weights for policy 0, policy_version 1110406 (0.0006) [2023-12-26 08:27:28,752][123091] Updated weights for policy 0, policy_version 1110416 (0.0006) [2023-12-26 08:27:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 566534144. Throughput: 0: 9072.7, 1: 8808.0. Samples: 566525152. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:28,785][121949] Avg episode reward: [(0, '6296.033'), (1, '5887.864')] [2023-12-26 08:27:28,929][123090] Updated weights for policy 1, policy_version 1102593 (0.0006) [2023-12-26 08:27:28,992][123090] Updated weights for policy 1, policy_version 1102603 (0.0010) [2023-12-26 08:27:29,054][123090] Updated weights for policy 1, policy_version 1102613 (0.0010) [2023-12-26 08:27:29,117][123090] Updated weights for policy 1, policy_version 1102623 (0.0010) [2023-12-26 08:27:29,400][123091] Updated weights for policy 0, policy_version 1110426 (0.0007) [2023-12-26 08:27:29,461][123091] Updated weights for policy 0, policy_version 1110436 (0.0005) [2023-12-26 08:27:29,511][123091] Updated weights for policy 0, policy_version 1110446 (0.0006) [2023-12-26 08:27:29,935][123090] Updated weights for policy 1, policy_version 1102633 (0.0010) [2023-12-26 08:27:30,001][123090] Updated weights for policy 1, policy_version 1102643 (0.0008) [2023-12-26 08:27:30,061][123090] Updated weights for policy 1, policy_version 1102653 (0.0010) [2023-12-26 08:27:30,211][123091] Updated weights for policy 0, policy_version 1110456 (0.0009) [2023-12-26 08:27:30,274][123091] Updated weights for policy 0, policy_version 1110466 (0.0009) [2023-12-26 08:27:30,337][123091] Updated weights for policy 0, policy_version 1110476 (0.0009) [2023-12-26 08:27:30,879][123090] Updated weights for policy 1, policy_version 1102663 (0.0007) [2023-12-26 08:27:30,938][123090] Updated weights for policy 1, policy_version 1102673 (0.0005) [2023-12-26 08:27:30,976][123091] Updated weights for policy 0, policy_version 1110486 (0.0007) [2023-12-26 08:27:31,005][123090] Updated weights for policy 1, policy_version 1102683 (0.0009) [2023-12-26 08:27:31,033][123091] Updated weights for policy 0, policy_version 1110496 (0.0006) [2023-12-26 08:27:31,085][123091] Updated weights for policy 0, policy_version 1110506 (0.0007) [2023-12-26 08:27:31,749][123090] Updated weights for policy 1, policy_version 1102693 (0.0008) [2023-12-26 08:27:31,814][123090] Updated weights for policy 1, policy_version 1102703 (0.0010) [2023-12-26 08:27:31,877][123090] Updated weights for policy 1, policy_version 1102713 (0.0009) [2023-12-26 08:27:31,916][123091] Updated weights for policy 0, policy_version 1110516 (0.0008) [2023-12-26 08:27:31,976][123091] Updated weights for policy 0, policy_version 1110526 (0.0009) [2023-12-26 08:27:32,030][123091] Updated weights for policy 0, policy_version 1110536 (0.0009) [2023-12-26 08:27:32,691][123090] Updated weights for policy 1, policy_version 1102723 (0.0008) [2023-12-26 08:27:32,750][123090] Updated weights for policy 1, policy_version 1102733 (0.0009) [2023-12-26 08:27:32,810][123090] Updated weights for policy 1, policy_version 1102743 (0.0009) [2023-12-26 08:27:32,864][123091] Updated weights for policy 0, policy_version 1110547 (0.0010) [2023-12-26 08:27:32,922][123091] Updated weights for policy 0, policy_version 1110557 (0.0011) [2023-12-26 08:27:32,992][123091] Updated weights for policy 0, policy_version 1110567 (0.0010) [2023-12-26 08:27:33,612][123090] Updated weights for policy 1, policy_version 1102753 (0.0008) [2023-12-26 08:27:33,674][123090] Updated weights for policy 1, policy_version 1102763 (0.0010) [2023-12-26 08:27:33,718][123090] Updated weights for policy 1, policy_version 1102773 (0.0010) [2023-12-26 08:27:33,769][123090] Updated weights for policy 1, policy_version 1102783 (0.0010) [2023-12-26 08:27:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 566624256. Throughput: 0: 9173.1, 1: 8819.1. Samples: 566633008. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:33,785][121949] Avg episode reward: [(0, '6221.025'), (1, '5910.116')] [2023-12-26 08:27:33,800][123091] Updated weights for policy 0, policy_version 1110577 (0.0008) [2023-12-26 08:27:33,850][123091] Updated weights for policy 0, policy_version 1110587 (0.0005) [2023-12-26 08:27:33,901][123091] Updated weights for policy 0, policy_version 1110597 (0.0005) [2023-12-26 08:27:33,960][123091] Updated weights for policy 0, policy_version 1110607 (0.0005) [2023-12-26 08:27:34,599][123090] Updated weights for policy 1, policy_version 1102793 (0.0009) [2023-12-26 08:27:34,668][123090] Updated weights for policy 1, policy_version 1102803 (0.0009) [2023-12-26 08:27:34,736][123090] Updated weights for policy 1, policy_version 1102813 (0.0009) [2023-12-26 08:27:34,754][123091] Updated weights for policy 0, policy_version 1110617 (0.0010) [2023-12-26 08:27:34,806][123091] Updated weights for policy 0, policy_version 1110627 (0.0010) [2023-12-26 08:27:34,865][123091] Updated weights for policy 0, policy_version 1110637 (0.0010) [2023-12-26 08:27:35,556][123090] Updated weights for policy 1, policy_version 1102823 (0.0009) [2023-12-26 08:27:35,614][123090] Updated weights for policy 1, policy_version 1102833 (0.0010) [2023-12-26 08:27:35,674][123090] Updated weights for policy 1, policy_version 1102843 (0.0009) [2023-12-26 08:27:35,693][123091] Updated weights for policy 0, policy_version 1110647 (0.0008) [2023-12-26 08:27:35,753][123091] Updated weights for policy 0, policy_version 1110657 (0.0009) [2023-12-26 08:27:35,821][123091] Updated weights for policy 0, policy_version 1110667 (0.0009) [2023-12-26 08:27:36,486][123090] Updated weights for policy 1, policy_version 1102853 (0.0006) [2023-12-26 08:27:36,562][123090] Updated weights for policy 1, policy_version 1102863 (0.0009) [2023-12-26 08:27:36,630][123090] Updated weights for policy 1, policy_version 1102873 (0.0009) [2023-12-26 08:27:36,656][123091] Updated weights for policy 0, policy_version 1110677 (0.0007) [2023-12-26 08:27:36,728][123091] Updated weights for policy 0, policy_version 1110687 (0.0010) [2023-12-26 08:27:36,797][123091] Updated weights for policy 0, policy_version 1110697 (0.0009) [2023-12-26 08:27:37,238][123090] Updated weights for policy 1, policy_version 1102883 (0.0008) [2023-12-26 08:27:37,302][123090] Updated weights for policy 1, policy_version 1102893 (0.0005) [2023-12-26 08:27:37,358][123090] Updated weights for policy 1, policy_version 1102903 (0.0005) [2023-12-26 08:27:37,610][123091] Updated weights for policy 0, policy_version 1110707 (0.0008) [2023-12-26 08:27:37,666][123091] Updated weights for policy 0, policy_version 1110717 (0.0009) [2023-12-26 08:27:37,731][123091] Updated weights for policy 0, policy_version 1110727 (0.0009) [2023-12-26 08:27:38,071][123090] Updated weights for policy 1, policy_version 1102913 (0.0006) [2023-12-26 08:27:38,123][123090] Updated weights for policy 1, policy_version 1102923 (0.0010) [2023-12-26 08:27:38,178][123090] Updated weights for policy 1, policy_version 1102933 (0.0010) [2023-12-26 08:27:38,233][123090] Updated weights for policy 1, policy_version 1102943 (0.0010) [2023-12-26 08:27:38,578][123091] Updated weights for policy 0, policy_version 1110737 (0.0009) [2023-12-26 08:27:38,650][123091] Updated weights for policy 0, policy_version 1110747 (0.0008) [2023-12-26 08:27:38,711][123091] Updated weights for policy 0, policy_version 1110757 (0.0009) [2023-12-26 08:27:38,771][123091] Updated weights for policy 0, policy_version 1110767 (0.0008) [2023-12-26 08:27:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 566714368. Throughput: 0: 9150.3, 1: 8822.9. Samples: 566685232. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:38,785][121949] Avg episode reward: [(0, '6157.636'), (1, '5996.996')] [2023-12-26 08:27:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001110768_284360704.pth... [2023-12-26 08:27:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001102944_282353664.pth... [2023-12-26 08:27:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001101920_282091520.pth [2023-12-26 08:27:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001109680_284082176.pth [2023-12-26 08:27:39,019][123090] Updated weights for policy 1, policy_version 1102953 (0.0010) [2023-12-26 08:27:39,074][123090] Updated weights for policy 1, policy_version 1102963 (0.0010) [2023-12-26 08:27:39,129][123090] Updated weights for policy 1, policy_version 1102973 (0.0010) [2023-12-26 08:27:39,616][123091] Updated weights for policy 0, policy_version 1110777 (0.0010) [2023-12-26 08:27:39,682][123091] Updated weights for policy 0, policy_version 1110787 (0.0010) [2023-12-26 08:27:39,743][123091] Updated weights for policy 0, policy_version 1110797 (0.0009) [2023-12-26 08:27:39,999][123090] Updated weights for policy 1, policy_version 1102983 (0.0010) [2023-12-26 08:27:40,054][123090] Updated weights for policy 1, policy_version 1102993 (0.0009) [2023-12-26 08:27:40,113][123090] Updated weights for policy 1, policy_version 1103003 (0.0010) [2023-12-26 08:27:40,615][123091] Updated weights for policy 0, policy_version 1110807 (0.0010) [2023-12-26 08:27:40,677][123091] Updated weights for policy 0, policy_version 1110817 (0.0010) [2023-12-26 08:27:40,730][123091] Updated weights for policy 0, policy_version 1110827 (0.0009) [2023-12-26 08:27:40,991][123090] Updated weights for policy 1, policy_version 1103013 (0.0010) [2023-12-26 08:27:41,059][123090] Updated weights for policy 1, policy_version 1103023 (0.0009) [2023-12-26 08:27:41,116][123090] Updated weights for policy 1, policy_version 1103033 (0.0009) [2023-12-26 08:27:41,532][123091] Updated weights for policy 0, policy_version 1110837 (0.0009) [2023-12-26 08:27:41,600][123091] Updated weights for policy 0, policy_version 1110847 (0.0009) [2023-12-26 08:27:41,664][123091] Updated weights for policy 0, policy_version 1110857 (0.0010) [2023-12-26 08:27:41,981][123090] Updated weights for policy 1, policy_version 1103043 (0.0009) [2023-12-26 08:27:42,054][123090] Updated weights for policy 1, policy_version 1103053 (0.0009) [2023-12-26 08:27:42,122][123090] Updated weights for policy 1, policy_version 1103063 (0.0009) [2023-12-26 08:27:42,453][123091] Updated weights for policy 0, policy_version 1110867 (0.0009) [2023-12-26 08:27:42,516][123091] Updated weights for policy 0, policy_version 1110877 (0.0008) [2023-12-26 08:27:42,583][123091] Updated weights for policy 0, policy_version 1110887 (0.0008) [2023-12-26 08:27:42,958][123090] Updated weights for policy 1, policy_version 1103073 (0.0010) [2023-12-26 08:27:43,031][123090] Updated weights for policy 1, policy_version 1103083 (0.0006) [2023-12-26 08:27:43,088][123090] Updated weights for policy 1, policy_version 1103093 (0.0006) [2023-12-26 08:27:43,140][123090] Updated weights for policy 1, policy_version 1103103 (0.0006) [2023-12-26 08:27:43,335][123091] Updated weights for policy 0, policy_version 1110897 (0.0008) [2023-12-26 08:27:43,384][123091] Updated weights for policy 0, policy_version 1110907 (0.0005) [2023-12-26 08:27:43,433][123091] Updated weights for policy 0, policy_version 1110917 (0.0006) [2023-12-26 08:27:43,485][123091] Updated weights for policy 0, policy_version 1110927 (0.0006) [2023-12-26 08:27:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 566796288. Throughput: 0: 9051.9, 1: 8784.4. Samples: 566788400. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:43,784][121949] Avg episode reward: [(0, '6108.492'), (1, '5951.119')] [2023-12-26 08:27:43,863][123090] Updated weights for policy 1, policy_version 1103113 (0.0005) [2023-12-26 08:27:43,922][123090] Updated weights for policy 1, policy_version 1103123 (0.0009) [2023-12-26 08:27:43,978][123090] Updated weights for policy 1, policy_version 1103133 (0.0010) [2023-12-26 08:27:44,163][123091] Updated weights for policy 0, policy_version 1110937 (0.0005) [2023-12-26 08:27:44,226][123091] Updated weights for policy 0, policy_version 1110947 (0.0005) [2023-12-26 08:27:44,281][123091] Updated weights for policy 0, policy_version 1110957 (0.0005) [2023-12-26 08:27:44,754][123090] Updated weights for policy 1, policy_version 1103143 (0.0010) [2023-12-26 08:27:44,818][123090] Updated weights for policy 1, policy_version 1103153 (0.0008) [2023-12-26 08:27:44,873][123090] Updated weights for policy 1, policy_version 1103163 (0.0005) [2023-12-26 08:27:44,964][123091] Updated weights for policy 0, policy_version 1110967 (0.0009) [2023-12-26 08:27:45,017][123091] Updated weights for policy 0, policy_version 1110977 (0.0011) [2023-12-26 08:27:45,077][123091] Updated weights for policy 0, policy_version 1110987 (0.0010) [2023-12-26 08:27:45,694][123090] Updated weights for policy 1, policy_version 1103173 (0.0007) [2023-12-26 08:27:45,757][123090] Updated weights for policy 1, policy_version 1103183 (0.0008) [2023-12-26 08:27:45,824][123090] Updated weights for policy 1, policy_version 1103193 (0.0009) [2023-12-26 08:27:45,935][123091] Updated weights for policy 0, policy_version 1110997 (0.0011) [2023-12-26 08:27:45,991][123091] Updated weights for policy 0, policy_version 1111007 (0.0011) [2023-12-26 08:27:46,054][123091] Updated weights for policy 0, policy_version 1111017 (0.0010) [2023-12-26 08:27:46,638][123090] Updated weights for policy 1, policy_version 1103203 (0.0009) [2023-12-26 08:27:46,713][123090] Updated weights for policy 1, policy_version 1103213 (0.0009) [2023-12-26 08:27:46,776][123090] Updated weights for policy 1, policy_version 1103223 (0.0010) [2023-12-26 08:27:46,874][123091] Updated weights for policy 0, policy_version 1111027 (0.0009) [2023-12-26 08:27:46,930][123091] Updated weights for policy 0, policy_version 1111037 (0.0010) [2023-12-26 08:27:46,985][123091] Updated weights for policy 0, policy_version 1111047 (0.0010) [2023-12-26 08:27:47,633][123090] Updated weights for policy 1, policy_version 1103233 (0.0010) [2023-12-26 08:27:47,685][123090] Updated weights for policy 1, policy_version 1103243 (0.0009) [2023-12-26 08:27:47,735][123090] Updated weights for policy 1, policy_version 1103253 (0.0009) [2023-12-26 08:27:47,755][123091] Updated weights for policy 0, policy_version 1111057 (0.0011) [2023-12-26 08:27:47,797][123090] Updated weights for policy 1, policy_version 1103263 (0.0008) [2023-12-26 08:27:47,801][123091] Updated weights for policy 0, policy_version 1111067 (0.0009) [2023-12-26 08:27:47,849][123091] Updated weights for policy 0, policy_version 1111077 (0.0005) [2023-12-26 08:27:47,905][123091] Updated weights for policy 0, policy_version 1111087 (0.0005) [2023-12-26 08:27:48,668][123090] Updated weights for policy 1, policy_version 1103273 (0.0009) [2023-12-26 08:27:48,737][123091] Updated weights for policy 0, policy_version 1111097 (0.0008) [2023-12-26 08:27:48,738][123090] Updated weights for policy 1, policy_version 1103283 (0.0008) [2023-12-26 08:27:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 566878208. Throughput: 0: 9095.0, 1: 8747.0. Samples: 566897276. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:48,785][121949] Avg episode reward: [(0, '6143.062'), (1, '5932.736')] [2023-12-26 08:27:48,794][123091] Updated weights for policy 0, policy_version 1111107 (0.0008) [2023-12-26 08:27:48,802][123090] Updated weights for policy 1, policy_version 1103293 (0.0010) [2023-12-26 08:27:48,848][123091] Updated weights for policy 0, policy_version 1111117 (0.0009) [2023-12-26 08:27:49,585][123090] Updated weights for policy 1, policy_version 1103303 (0.0009) [2023-12-26 08:27:49,644][123090] Updated weights for policy 1, policy_version 1103313 (0.0010) [2023-12-26 08:27:49,707][123090] Updated weights for policy 1, policy_version 1103323 (0.0010) [2023-12-26 08:27:49,740][123091] Updated weights for policy 0, policy_version 1111127 (0.0007) [2023-12-26 08:27:49,801][123091] Updated weights for policy 0, policy_version 1111137 (0.0010) [2023-12-26 08:27:49,878][123091] Updated weights for policy 0, policy_version 1111147 (0.0010) [2023-12-26 08:27:50,535][123090] Updated weights for policy 1, policy_version 1103333 (0.0010) [2023-12-26 08:27:50,607][123090] Updated weights for policy 1, policy_version 1103343 (0.0011) [2023-12-26 08:27:50,672][123090] Updated weights for policy 1, policy_version 1103353 (0.0011) [2023-12-26 08:27:50,714][123091] Updated weights for policy 0, policy_version 1111157 (0.0008) [2023-12-26 08:27:50,772][123091] Updated weights for policy 0, policy_version 1111167 (0.0009) [2023-12-26 08:27:50,836][123091] Updated weights for policy 0, policy_version 1111177 (0.0009) [2023-12-26 08:27:51,498][123090] Updated weights for policy 1, policy_version 1103363 (0.0011) [2023-12-26 08:27:51,562][123090] Updated weights for policy 1, policy_version 1103373 (0.0007) [2023-12-26 08:27:51,629][123090] Updated weights for policy 1, policy_version 1103383 (0.0009) [2023-12-26 08:27:51,698][123091] Updated weights for policy 0, policy_version 1111187 (0.0009) [2023-12-26 08:27:51,768][123091] Updated weights for policy 0, policy_version 1111197 (0.0009) [2023-12-26 08:27:51,825][123091] Updated weights for policy 0, policy_version 1111207 (0.0010) [2023-12-26 08:27:52,422][123090] Updated weights for policy 1, policy_version 1103393 (0.0011) [2023-12-26 08:27:52,474][123090] Updated weights for policy 1, policy_version 1103403 (0.0010) [2023-12-26 08:27:52,537][123090] Updated weights for policy 1, policy_version 1103413 (0.0010) [2023-12-26 08:27:52,595][123090] Updated weights for policy 1, policy_version 1103423 (0.0010) [2023-12-26 08:27:52,700][123091] Updated weights for policy 0, policy_version 1111217 (0.0010) [2023-12-26 08:27:52,753][123091] Updated weights for policy 0, policy_version 1111227 (0.0010) [2023-12-26 08:27:52,805][123091] Updated weights for policy 0, policy_version 1111237 (0.0009) [2023-12-26 08:27:52,866][123091] Updated weights for policy 0, policy_version 1111247 (0.0009) [2023-12-26 08:27:53,354][123090] Updated weights for policy 1, policy_version 1103433 (0.0005) [2023-12-26 08:27:53,422][123090] Updated weights for policy 1, policy_version 1103443 (0.0005) [2023-12-26 08:27:53,474][123090] Updated weights for policy 1, policy_version 1103453 (0.0005) [2023-12-26 08:27:53,704][123091] Updated weights for policy 0, policy_version 1111257 (0.0005) [2023-12-26 08:27:53,762][123091] Updated weights for policy 0, policy_version 1111267 (0.0006) [2023-12-26 08:27:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 566968320. Throughput: 0: 9034.5, 1: 8740.7. Samples: 566947600. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:53,786][121949] Avg episode reward: [(0, '6177.841'), (1, '5942.956')] [2023-12-26 08:27:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001103456_282484736.pth... [2023-12-26 08:27:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001102432_282222592.pth [2023-12-26 08:27:53,817][123091] Updated weights for policy 0, policy_version 1111277 (0.0008) [2023-12-26 08:27:53,830][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001111280_284491776.pth... [2023-12-26 08:27:53,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001110224_284221440.pth [2023-12-26 08:27:54,235][123090] Updated weights for policy 1, policy_version 1103463 (0.0006) [2023-12-26 08:27:54,284][123090] Updated weights for policy 1, policy_version 1103473 (0.0005) [2023-12-26 08:27:54,335][123090] Updated weights for policy 1, policy_version 1103483 (0.0008) [2023-12-26 08:27:54,552][123091] Updated weights for policy 0, policy_version 1111287 (0.0007) [2023-12-26 08:27:54,609][123091] Updated weights for policy 0, policy_version 1111297 (0.0010) [2023-12-26 08:27:54,660][123091] Updated weights for policy 0, policy_version 1111308 (0.0009) [2023-12-26 08:27:55,017][123090] Updated weights for policy 1, policy_version 1103493 (0.0008) [2023-12-26 08:27:55,085][123090] Updated weights for policy 1, policy_version 1103503 (0.0005) [2023-12-26 08:27:55,137][123090] Updated weights for policy 1, policy_version 1103513 (0.0005) [2023-12-26 08:27:55,426][123091] Updated weights for policy 0, policy_version 1111318 (0.0006) [2023-12-26 08:27:55,471][123091] Updated weights for policy 0, policy_version 1111328 (0.0007) [2023-12-26 08:27:55,518][123091] Updated weights for policy 0, policy_version 1111338 (0.0010) [2023-12-26 08:27:55,808][123090] Updated weights for policy 1, policy_version 1103523 (0.0005) [2023-12-26 08:27:55,856][123090] Updated weights for policy 1, policy_version 1103533 (0.0005) [2023-12-26 08:27:55,907][123090] Updated weights for policy 1, policy_version 1103543 (0.0005) [2023-12-26 08:27:56,193][123091] Updated weights for policy 0, policy_version 1111348 (0.0008) [2023-12-26 08:27:56,251][123091] Updated weights for policy 0, policy_version 1111358 (0.0005) [2023-12-26 08:27:56,311][123091] Updated weights for policy 0, policy_version 1111368 (0.0006) [2023-12-26 08:27:56,661][123090] Updated weights for policy 1, policy_version 1103553 (0.0006) [2023-12-26 08:27:56,717][123090] Updated weights for policy 1, policy_version 1103563 (0.0009) [2023-12-26 08:27:56,774][123090] Updated weights for policy 1, policy_version 1103573 (0.0005) [2023-12-26 08:27:56,826][123090] Updated weights for policy 1, policy_version 1103583 (0.0005) [2023-12-26 08:27:56,979][123091] Updated weights for policy 0, policy_version 1111378 (0.0005) [2023-12-26 08:27:57,060][123091] Updated weights for policy 0, policy_version 1111388 (0.0006) [2023-12-26 08:27:57,119][123091] Updated weights for policy 0, policy_version 1111399 (0.0010) [2023-12-26 08:27:57,520][123090] Updated weights for policy 1, policy_version 1103593 (0.0010) [2023-12-26 08:27:57,587][123090] Updated weights for policy 1, policy_version 1103603 (0.0010) [2023-12-26 08:27:57,654][123090] Updated weights for policy 1, policy_version 1103613 (0.0010) [2023-12-26 08:27:57,852][123091] Updated weights for policy 0, policy_version 1111410 (0.0010) [2023-12-26 08:27:57,909][123091] Updated weights for policy 0, policy_version 1111420 (0.0007) [2023-12-26 08:27:57,954][123091] Updated weights for policy 0, policy_version 1111430 (0.0005) [2023-12-26 08:27:58,004][123091] Updated weights for policy 0, policy_version 1111440 (0.0010) [2023-12-26 08:27:58,430][123090] Updated weights for policy 1, policy_version 1103623 (0.0008) [2023-12-26 08:27:58,499][123090] Updated weights for policy 1, policy_version 1103633 (0.0008) [2023-12-26 08:27:58,562][123090] Updated weights for policy 1, policy_version 1103643 (0.0008) [2023-12-26 08:27:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 567066624. Throughput: 0: 9014.1, 1: 8957.9. Samples: 567060196. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:27:58,785][121949] Avg episode reward: [(0, '6173.841'), (1, '5886.344')] [2023-12-26 08:27:58,918][123091] Updated weights for policy 0, policy_version 1111450 (0.0007) [2023-12-26 08:27:58,981][123091] Updated weights for policy 0, policy_version 1111460 (0.0008) [2023-12-26 08:27:59,048][123091] Updated weights for policy 0, policy_version 1111470 (0.0008) [2023-12-26 08:27:59,429][123090] Updated weights for policy 1, policy_version 1103653 (0.0008) [2023-12-26 08:27:59,494][123090] Updated weights for policy 1, policy_version 1103663 (0.0009) [2023-12-26 08:27:59,547][123090] Updated weights for policy 1, policy_version 1103673 (0.0009) [2023-12-26 08:27:59,816][123091] Updated weights for policy 0, policy_version 1111480 (0.0008) [2023-12-26 08:27:59,888][123091] Updated weights for policy 0, policy_version 1111490 (0.0008) [2023-12-26 08:27:59,957][123091] Updated weights for policy 0, policy_version 1111500 (0.0008) [2023-12-26 08:28:00,440][123090] Updated weights for policy 1, policy_version 1103683 (0.0010) [2023-12-26 08:28:00,501][123090] Updated weights for policy 1, policy_version 1103693 (0.0010) [2023-12-26 08:28:00,553][123090] Updated weights for policy 1, policy_version 1103703 (0.0009) [2023-12-26 08:28:00,662][123091] Updated weights for policy 0, policy_version 1111510 (0.0006) [2023-12-26 08:28:00,734][123091] Updated weights for policy 0, policy_version 1111520 (0.0005) [2023-12-26 08:28:00,793][123091] Updated weights for policy 0, policy_version 1111530 (0.0005) [2023-12-26 08:28:01,430][123090] Updated weights for policy 1, policy_version 1103714 (0.0009) [2023-12-26 08:28:01,431][123091] Updated weights for policy 0, policy_version 1111540 (0.0005) [2023-12-26 08:28:01,489][123091] Updated weights for policy 0, policy_version 1111550 (0.0010) [2023-12-26 08:28:01,493][123090] Updated weights for policy 1, policy_version 1103724 (0.0008) [2023-12-26 08:28:01,537][123091] Updated weights for policy 0, policy_version 1111560 (0.0010) [2023-12-26 08:28:01,545][123090] Updated weights for policy 1, policy_version 1103734 (0.0008) [2023-12-26 08:28:01,595][123090] Updated weights for policy 1, policy_version 1103744 (0.0006) [2023-12-26 08:28:02,360][123091] Updated weights for policy 0, policy_version 1111570 (0.0009) [2023-12-26 08:28:02,419][123091] Updated weights for policy 0, policy_version 1111580 (0.0011) [2023-12-26 08:28:02,460][123090] Updated weights for policy 1, policy_version 1103754 (0.0008) [2023-12-26 08:28:02,478][123091] Updated weights for policy 0, policy_version 1111590 (0.0011) [2023-12-26 08:28:02,525][123090] Updated weights for policy 1, policy_version 1103764 (0.0006) [2023-12-26 08:28:02,544][123091] Updated weights for policy 0, policy_version 1111600 (0.0011) [2023-12-26 08:28:02,594][123090] Updated weights for policy 1, policy_version 1103774 (0.0007) [2023-12-26 08:28:03,332][123090] Updated weights for policy 1, policy_version 1103784 (0.0007) [2023-12-26 08:28:03,367][123091] Updated weights for policy 0, policy_version 1111610 (0.0011) [2023-12-26 08:28:03,395][123090] Updated weights for policy 1, policy_version 1103794 (0.0007) [2023-12-26 08:28:03,427][123091] Updated weights for policy 0, policy_version 1111620 (0.0011) [2023-12-26 08:28:03,457][123090] Updated weights for policy 1, policy_version 1103804 (0.0006) [2023-12-26 08:28:03,483][123091] Updated weights for policy 0, policy_version 1111630 (0.0009) [2023-12-26 08:28:03,784][121949] Fps is (10 sec: 18842.4, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 567156736. Throughput: 0: 9021.4, 1: 8897.5. Samples: 567165904. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:03,785][121949] Avg episode reward: [(0, '6299.020'), (1, '5922.549')] [2023-12-26 08:28:04,224][123090] Updated weights for policy 1, policy_version 1103814 (0.0008) [2023-12-26 08:28:04,276][123090] Updated weights for policy 1, policy_version 1103824 (0.0008) [2023-12-26 08:28:04,303][123091] Updated weights for policy 0, policy_version 1111640 (0.0011) [2023-12-26 08:28:04,338][123090] Updated weights for policy 1, policy_version 1103834 (0.0008) [2023-12-26 08:28:04,372][123091] Updated weights for policy 0, policy_version 1111650 (0.0011) [2023-12-26 08:28:04,431][123091] Updated weights for policy 0, policy_version 1111660 (0.0011) [2023-12-26 08:28:05,144][123090] Updated weights for policy 1, policy_version 1103844 (0.0008) [2023-12-26 08:28:05,196][123090] Updated weights for policy 1, policy_version 1103854 (0.0009) [2023-12-26 08:28:05,245][123091] Updated weights for policy 0, policy_version 1111670 (0.0009) [2023-12-26 08:28:05,248][123090] Updated weights for policy 1, policy_version 1103864 (0.0010) [2023-12-26 08:28:05,301][123091] Updated weights for policy 0, policy_version 1111680 (0.0006) [2023-12-26 08:28:05,360][123091] Updated weights for policy 0, policy_version 1111690 (0.0006) [2023-12-26 08:28:06,030][123090] Updated weights for policy 1, policy_version 1103874 (0.0010) [2023-12-26 08:28:06,041][123091] Updated weights for policy 0, policy_version 1111700 (0.0008) [2023-12-26 08:28:06,095][123090] Updated weights for policy 1, policy_version 1103884 (0.0006) [2023-12-26 08:28:06,096][123091] Updated weights for policy 0, policy_version 1111710 (0.0006) [2023-12-26 08:28:06,163][123090] Updated weights for policy 1, policy_version 1103894 (0.0007) [2023-12-26 08:28:06,167][123091] Updated weights for policy 0, policy_version 1111720 (0.0008) [2023-12-26 08:28:06,236][123090] Updated weights for policy 1, policy_version 1103904 (0.0006) [2023-12-26 08:28:06,886][123090] Updated weights for policy 1, policy_version 1103914 (0.0006) [2023-12-26 08:28:06,916][123091] Updated weights for policy 0, policy_version 1111730 (0.0007) [2023-12-26 08:28:06,948][123090] Updated weights for policy 1, policy_version 1103924 (0.0005) [2023-12-26 08:28:06,979][123091] Updated weights for policy 0, policy_version 1111740 (0.0011) [2023-12-26 08:28:07,009][123090] Updated weights for policy 1, policy_version 1103934 (0.0009) [2023-12-26 08:28:07,039][123091] Updated weights for policy 0, policy_version 1111750 (0.0009) [2023-12-26 08:28:07,101][123091] Updated weights for policy 0, policy_version 1111760 (0.0011) [2023-12-26 08:28:07,712][123090] Updated weights for policy 1, policy_version 1103944 (0.0006) [2023-12-26 08:28:07,774][123090] Updated weights for policy 1, policy_version 1103954 (0.0009) [2023-12-26 08:28:07,804][123091] Updated weights for policy 0, policy_version 1111770 (0.0005) [2023-12-26 08:28:07,843][123090] Updated weights for policy 1, policy_version 1103964 (0.0008) [2023-12-26 08:28:07,858][123091] Updated weights for policy 0, policy_version 1111780 (0.0006) [2023-12-26 08:28:07,907][123091] Updated weights for policy 0, policy_version 1111790 (0.0005) [2023-12-26 08:28:08,616][123090] Updated weights for policy 1, policy_version 1103974 (0.0007) [2023-12-26 08:28:08,674][123090] Updated weights for policy 1, policy_version 1103984 (0.0006) [2023-12-26 08:28:08,674][123091] Updated weights for policy 0, policy_version 1111800 (0.0008) [2023-12-26 08:28:08,734][123091] Updated weights for policy 0, policy_version 1111810 (0.0008) [2023-12-26 08:28:08,740][123090] Updated weights for policy 1, policy_version 1103994 (0.0008) [2023-12-26 08:28:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 567246848. Throughput: 0: 9067.1, 1: 8915.0. Samples: 567220508. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:08,785][121949] Avg episode reward: [(0, '6261.156'), (1, '5906.714')] [2023-12-26 08:28:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001104000_282624000.pth... [2023-12-26 08:28:08,793][123091] Updated weights for policy 0, policy_version 1111820 (0.0009) [2023-12-26 08:28:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001102944_282353664.pth [2023-12-26 08:28:08,812][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001111824_284631040.pth... [2023-12-26 08:28:08,815][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001110768_284360704.pth [2023-12-26 08:28:09,446][123090] Updated weights for policy 1, policy_version 1104004 (0.0006) [2023-12-26 08:28:09,508][123090] Updated weights for policy 1, policy_version 1104014 (0.0008) [2023-12-26 08:28:09,583][123090] Updated weights for policy 1, policy_version 1104024 (0.0006) [2023-12-26 08:28:09,662][123091] Updated weights for policy 0, policy_version 1111830 (0.0007) [2023-12-26 08:28:09,734][123091] Updated weights for policy 0, policy_version 1111840 (0.0010) [2023-12-26 08:28:09,794][123091] Updated weights for policy 0, policy_version 1111850 (0.0010) [2023-12-26 08:28:10,375][123090] Updated weights for policy 1, policy_version 1104034 (0.0006) [2023-12-26 08:28:10,443][123090] Updated weights for policy 1, policy_version 1104044 (0.0010) [2023-12-26 08:28:10,509][123090] Updated weights for policy 1, policy_version 1104054 (0.0009) [2023-12-26 08:28:10,566][123090] Updated weights for policy 1, policy_version 1104064 (0.0008) [2023-12-26 08:28:10,609][123091] Updated weights for policy 0, policy_version 1111860 (0.0010) [2023-12-26 08:28:10,675][123091] Updated weights for policy 0, policy_version 1111870 (0.0010) [2023-12-26 08:28:10,730][123091] Updated weights for policy 0, policy_version 1111880 (0.0010) [2023-12-26 08:28:11,429][123090] Updated weights for policy 1, policy_version 1104074 (0.0009) [2023-12-26 08:28:11,488][123090] Updated weights for policy 1, policy_version 1104084 (0.0009) [2023-12-26 08:28:11,554][123090] Updated weights for policy 1, policy_version 1104094 (0.0010) [2023-12-26 08:28:11,588][123091] Updated weights for policy 0, policy_version 1111890 (0.0009) [2023-12-26 08:28:11,662][123091] Updated weights for policy 0, policy_version 1111900 (0.0009) [2023-12-26 08:28:11,728][123091] Updated weights for policy 0, policy_version 1111910 (0.0009) [2023-12-26 08:28:11,801][123091] Updated weights for policy 0, policy_version 1111920 (0.0010) [2023-12-26 08:28:12,484][123090] Updated weights for policy 1, policy_version 1104104 (0.0009) [2023-12-26 08:28:12,558][123090] Updated weights for policy 1, policy_version 1104114 (0.0009) [2023-12-26 08:28:12,601][123091] Updated weights for policy 0, policy_version 1111930 (0.0008) [2023-12-26 08:28:12,625][123090] Updated weights for policy 1, policy_version 1104124 (0.0009) [2023-12-26 08:28:12,666][123091] Updated weights for policy 0, policy_version 1111940 (0.0007) [2023-12-26 08:28:12,735][123091] Updated weights for policy 0, policy_version 1111950 (0.0010) [2023-12-26 08:28:13,451][123090] Updated weights for policy 1, policy_version 1104134 (0.0010) [2023-12-26 08:28:13,477][123091] Updated weights for policy 0, policy_version 1111960 (0.0006) [2023-12-26 08:28:13,513][123090] Updated weights for policy 1, policy_version 1104144 (0.0009) [2023-12-26 08:28:13,534][123091] Updated weights for policy 0, policy_version 1111970 (0.0005) [2023-12-26 08:28:13,567][123090] Updated weights for policy 1, policy_version 1104154 (0.0008) [2023-12-26 08:28:13,588][123091] Updated weights for policy 0, policy_version 1111980 (0.0007) [2023-12-26 08:28:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 567336960. Throughput: 0: 8924.5, 1: 8879.2. Samples: 567326320. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:13,785][121949] Avg episode reward: [(0, '6224.007'), (1, '5822.422')] [2023-12-26 08:28:14,285][123090] Updated weights for policy 1, policy_version 1104164 (0.0007) [2023-12-26 08:28:14,341][123090] Updated weights for policy 1, policy_version 1104174 (0.0005) [2023-12-26 08:28:14,402][123090] Updated weights for policy 1, policy_version 1104184 (0.0006) [2023-12-26 08:28:14,416][123091] Updated weights for policy 0, policy_version 1111990 (0.0009) [2023-12-26 08:28:14,473][123091] Updated weights for policy 0, policy_version 1112000 (0.0008) [2023-12-26 08:28:14,527][123091] Updated weights for policy 0, policy_version 1112010 (0.0009) [2023-12-26 08:28:15,222][123090] Updated weights for policy 1, policy_version 1104194 (0.0008) [2023-12-26 08:28:15,279][123090] Updated weights for policy 1, policy_version 1104204 (0.0009) [2023-12-26 08:28:15,335][123090] Updated weights for policy 1, policy_version 1104214 (0.0009) [2023-12-26 08:28:15,378][123091] Updated weights for policy 0, policy_version 1112020 (0.0008) [2023-12-26 08:28:15,397][123090] Updated weights for policy 1, policy_version 1104224 (0.0009) [2023-12-26 08:28:15,439][123091] Updated weights for policy 0, policy_version 1112030 (0.0009) [2023-12-26 08:28:15,497][123091] Updated weights for policy 0, policy_version 1112040 (0.0010) [2023-12-26 08:28:16,241][123090] Updated weights for policy 1, policy_version 1104234 (0.0010) [2023-12-26 08:28:16,292][123091] Updated weights for policy 0, policy_version 1112050 (0.0009) [2023-12-26 08:28:16,298][123090] Updated weights for policy 1, policy_version 1104244 (0.0009) [2023-12-26 08:28:16,349][123091] Updated weights for policy 0, policy_version 1112060 (0.0008) [2023-12-26 08:28:16,352][123090] Updated weights for policy 1, policy_version 1104254 (0.0008) [2023-12-26 08:28:16,409][123091] Updated weights for policy 0, policy_version 1112070 (0.0009) [2023-12-26 08:28:16,475][123091] Updated weights for policy 0, policy_version 1112080 (0.0009) [2023-12-26 08:28:17,222][123090] Updated weights for policy 1, policy_version 1104264 (0.0009) [2023-12-26 08:28:17,273][123091] Updated weights for policy 0, policy_version 1112090 (0.0009) [2023-12-26 08:28:17,284][123090] Updated weights for policy 1, policy_version 1104274 (0.0007) [2023-12-26 08:28:17,338][123090] Updated weights for policy 1, policy_version 1104284 (0.0009) [2023-12-26 08:28:17,341][123091] Updated weights for policy 0, policy_version 1112100 (0.0008) [2023-12-26 08:28:17,405][123091] Updated weights for policy 0, policy_version 1112110 (0.0008) [2023-12-26 08:28:18,183][123090] Updated weights for policy 1, policy_version 1104294 (0.0010) [2023-12-26 08:28:18,218][123091] Updated weights for policy 0, policy_version 1112120 (0.0008) [2023-12-26 08:28:18,239][123090] Updated weights for policy 1, policy_version 1104304 (0.0007) [2023-12-26 08:28:18,282][123091] Updated weights for policy 0, policy_version 1112130 (0.0008) [2023-12-26 08:28:18,290][123090] Updated weights for policy 1, policy_version 1104314 (0.0006) [2023-12-26 08:28:18,349][123091] Updated weights for policy 0, policy_version 1112140 (0.0010) [2023-12-26 08:28:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 567418880. Throughput: 0: 8867.2, 1: 8850.8. Samples: 567430316. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:18,784][121949] Avg episode reward: [(0, '6280.747'), (1, '5913.319')] [2023-12-26 08:28:19,122][123091] Updated weights for policy 0, policy_version 1112150 (0.0010) [2023-12-26 08:28:19,164][123090] Updated weights for policy 1, policy_version 1104324 (0.0008) [2023-12-26 08:28:19,181][123091] Updated weights for policy 0, policy_version 1112160 (0.0008) [2023-12-26 08:28:19,217][123090] Updated weights for policy 1, policy_version 1104334 (0.0008) [2023-12-26 08:28:19,247][123091] Updated weights for policy 0, policy_version 1112170 (0.0008) [2023-12-26 08:28:19,286][123090] Updated weights for policy 1, policy_version 1104344 (0.0011) [2023-12-26 08:28:20,031][123091] Updated weights for policy 0, policy_version 1112180 (0.0006) [2023-12-26 08:28:20,084][123090] Updated weights for policy 1, policy_version 1104354 (0.0010) [2023-12-26 08:28:20,093][123091] Updated weights for policy 0, policy_version 1112190 (0.0006) [2023-12-26 08:28:20,140][123091] Updated weights for policy 0, policy_version 1112200 (0.0005) [2023-12-26 08:28:20,159][123090] Updated weights for policy 1, policy_version 1104364 (0.0007) [2023-12-26 08:28:20,230][123090] Updated weights for policy 1, policy_version 1104374 (0.0008) [2023-12-26 08:28:20,299][123090] Updated weights for policy 1, policy_version 1104384 (0.0008) [2023-12-26 08:28:20,943][123091] Updated weights for policy 0, policy_version 1112210 (0.0006) [2023-12-26 08:28:20,967][123090] Updated weights for policy 1, policy_version 1104394 (0.0009) [2023-12-26 08:28:21,004][123091] Updated weights for policy 0, policy_version 1112220 (0.0009) [2023-12-26 08:28:21,029][123090] Updated weights for policy 1, policy_version 1104404 (0.0009) [2023-12-26 08:28:21,070][123091] Updated weights for policy 0, policy_version 1112230 (0.0009) [2023-12-26 08:28:21,099][123090] Updated weights for policy 1, policy_version 1104414 (0.0009) [2023-12-26 08:28:21,128][123091] Updated weights for policy 0, policy_version 1112240 (0.0009) [2023-12-26 08:28:22,009][123090] Updated weights for policy 1, policy_version 1104424 (0.0009) [2023-12-26 08:28:22,013][123091] Updated weights for policy 0, policy_version 1112250 (0.0007) [2023-12-26 08:28:22,068][123090] Updated weights for policy 1, policy_version 1104434 (0.0010) [2023-12-26 08:28:22,075][123091] Updated weights for policy 0, policy_version 1112260 (0.0005) [2023-12-26 08:28:22,137][123091] Updated weights for policy 0, policy_version 1112270 (0.0005) [2023-12-26 08:28:22,144][123090] Updated weights for policy 1, policy_version 1104444 (0.0007) [2023-12-26 08:28:22,826][123091] Updated weights for policy 0, policy_version 1112280 (0.0009) [2023-12-26 08:28:22,894][123091] Updated weights for policy 0, policy_version 1112290 (0.0009) [2023-12-26 08:28:22,941][123090] Updated weights for policy 1, policy_version 1104454 (0.0010) [2023-12-26 08:28:22,958][123091] Updated weights for policy 0, policy_version 1112300 (0.0006) [2023-12-26 08:28:23,010][123090] Updated weights for policy 1, policy_version 1104464 (0.0011) [2023-12-26 08:28:23,079][123090] Updated weights for policy 1, policy_version 1104474 (0.0011) [2023-12-26 08:28:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 567500800. Throughput: 0: 8858.5, 1: 8841.3. Samples: 567481724. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:23,784][121949] Avg episode reward: [(0, '6093.826'), (1, '6042.642')] [2023-12-26 08:28:23,817][123090] Updated weights for policy 1, policy_version 1104484 (0.0008) [2023-12-26 08:28:23,830][123091] Updated weights for policy 0, policy_version 1112310 (0.0008) [2023-12-26 08:28:23,888][123090] Updated weights for policy 1, policy_version 1104494 (0.0006) [2023-12-26 08:28:23,900][123091] Updated weights for policy 0, policy_version 1112320 (0.0008) [2023-12-26 08:28:23,960][123090] Updated weights for policy 1, policy_version 1104504 (0.0006) [2023-12-26 08:28:23,964][123091] Updated weights for policy 0, policy_version 1112330 (0.0008) [2023-12-26 08:28:24,003][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001112336_284762112.pth... [2023-12-26 08:28:24,007][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001111280_284491776.pth [2023-12-26 08:28:24,016][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001104512_282755072.pth... [2023-12-26 08:28:24,021][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001103456_282484736.pth [2023-12-26 08:28:24,622][123091] Updated weights for policy 0, policy_version 1112340 (0.0006) [2023-12-26 08:28:24,654][123090] Updated weights for policy 1, policy_version 1104514 (0.0009) [2023-12-26 08:28:24,674][123091] Updated weights for policy 0, policy_version 1112350 (0.0005) [2023-12-26 08:28:24,707][123090] Updated weights for policy 1, policy_version 1104524 (0.0005) [2023-12-26 08:28:24,735][123091] Updated weights for policy 0, policy_version 1112360 (0.0005) [2023-12-26 08:28:24,757][123090] Updated weights for policy 1, policy_version 1104534 (0.0005) [2023-12-26 08:28:24,815][123090] Updated weights for policy 1, policy_version 1104544 (0.0005) [2023-12-26 08:28:25,376][123091] Updated weights for policy 0, policy_version 1112370 (0.0006) [2023-12-26 08:28:25,439][123091] Updated weights for policy 0, policy_version 1112380 (0.0006) [2023-12-26 08:28:25,472][123090] Updated weights for policy 1, policy_version 1104554 (0.0005) [2023-12-26 08:28:25,491][123091] Updated weights for policy 0, policy_version 1112390 (0.0009) [2023-12-26 08:28:25,527][123090] Updated weights for policy 1, policy_version 1104564 (0.0005) [2023-12-26 08:28:25,542][123091] Updated weights for policy 0, policy_version 1112400 (0.0008) [2023-12-26 08:28:25,589][123090] Updated weights for policy 1, policy_version 1104574 (0.0005) [2023-12-26 08:28:26,184][123090] Updated weights for policy 1, policy_version 1104584 (0.0009) [2023-12-26 08:28:26,240][123090] Updated weights for policy 1, policy_version 1104594 (0.0009) [2023-12-26 08:28:26,286][123091] Updated weights for policy 0, policy_version 1112410 (0.0007) [2023-12-26 08:28:26,297][123090] Updated weights for policy 1, policy_version 1104604 (0.0007) [2023-12-26 08:28:26,347][123091] Updated weights for policy 0, policy_version 1112420 (0.0009) [2023-12-26 08:28:26,394][123091] Updated weights for policy 0, policy_version 1112430 (0.0009) [2023-12-26 08:28:27,124][123090] Updated weights for policy 1, policy_version 1104614 (0.0009) [2023-12-26 08:28:27,191][123090] Updated weights for policy 1, policy_version 1104625 (0.0009) [2023-12-26 08:28:27,205][123091] Updated weights for policy 0, policy_version 1112440 (0.0008) [2023-12-26 08:28:27,252][123090] Updated weights for policy 1, policy_version 1104635 (0.0009) [2023-12-26 08:28:27,259][123091] Updated weights for policy 0, policy_version 1112450 (0.0008) [2023-12-26 08:28:27,309][123091] Updated weights for policy 0, policy_version 1112460 (0.0007) [2023-12-26 08:28:28,069][123090] Updated weights for policy 1, policy_version 1104645 (0.0009) [2023-12-26 08:28:28,120][123090] Updated weights for policy 1, policy_version 1104655 (0.0010) [2023-12-26 08:28:28,127][123091] Updated weights for policy 0, policy_version 1112470 (0.0007) [2023-12-26 08:28:28,183][123091] Updated weights for policy 0, policy_version 1112480 (0.0009) [2023-12-26 08:28:28,186][123090] Updated weights for policy 1, policy_version 1104665 (0.0009) [2023-12-26 08:28:28,244][123091] Updated weights for policy 0, policy_version 1112490 (0.0008) [2023-12-26 08:28:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 567599104. Throughput: 0: 8967.8, 1: 8925.1. Samples: 567593584. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:28,785][121949] Avg episode reward: [(0, '6094.515'), (1, '6036.377')] [2023-12-26 08:28:28,987][123090] Updated weights for policy 1, policy_version 1104675 (0.0007) [2023-12-26 08:28:29,048][123090] Updated weights for policy 1, policy_version 1104685 (0.0010) [2023-12-26 08:28:29,092][123091] Updated weights for policy 0, policy_version 1112500 (0.0010) [2023-12-26 08:28:29,108][123090] Updated weights for policy 1, policy_version 1104695 (0.0009) [2023-12-26 08:28:29,145][123091] Updated weights for policy 0, policy_version 1112510 (0.0009) [2023-12-26 08:28:29,199][123091] Updated weights for policy 0, policy_version 1112520 (0.0008) [2023-12-26 08:28:29,858][123090] Updated weights for policy 1, policy_version 1104705 (0.0007) [2023-12-26 08:28:29,912][123090] Updated weights for policy 1, policy_version 1104715 (0.0010) [2023-12-26 08:28:29,977][123090] Updated weights for policy 1, policy_version 1104725 (0.0009) [2023-12-26 08:28:30,027][123090] Updated weights for policy 1, policy_version 1104735 (0.0009) [2023-12-26 08:28:30,093][123091] Updated weights for policy 0, policy_version 1112530 (0.0009) [2023-12-26 08:28:30,144][123091] Updated weights for policy 0, policy_version 1112540 (0.0008) [2023-12-26 08:28:30,198][123091] Updated weights for policy 0, policy_version 1112550 (0.0008) [2023-12-26 08:28:30,260][123091] Updated weights for policy 0, policy_version 1112560 (0.0008) [2023-12-26 08:28:30,827][123090] Updated weights for policy 1, policy_version 1104745 (0.0008) [2023-12-26 08:28:30,890][123090] Updated weights for policy 1, policy_version 1104755 (0.0010) [2023-12-26 08:28:30,943][123090] Updated weights for policy 1, policy_version 1104765 (0.0009) [2023-12-26 08:28:31,084][123091] Updated weights for policy 0, policy_version 1112571 (0.0009) [2023-12-26 08:28:31,146][123091] Updated weights for policy 0, policy_version 1112581 (0.0010) [2023-12-26 08:28:31,204][123091] Updated weights for policy 0, policy_version 1112591 (0.0009) [2023-12-26 08:28:31,760][123090] Updated weights for policy 1, policy_version 1104775 (0.0010) [2023-12-26 08:28:31,816][123090] Updated weights for policy 1, policy_version 1104785 (0.0008) [2023-12-26 08:28:31,863][123090] Updated weights for policy 1, policy_version 1104795 (0.0009) [2023-12-26 08:28:32,102][123091] Updated weights for policy 0, policy_version 1112601 (0.0010) [2023-12-26 08:28:32,154][123091] Updated weights for policy 0, policy_version 1112611 (0.0009) [2023-12-26 08:28:32,204][123091] Updated weights for policy 0, policy_version 1112621 (0.0009) [2023-12-26 08:28:32,684][123090] Updated weights for policy 1, policy_version 1104805 (0.0010) [2023-12-26 08:28:32,747][123090] Updated weights for policy 1, policy_version 1104815 (0.0009) [2023-12-26 08:28:32,810][123090] Updated weights for policy 1, policy_version 1104825 (0.0010) [2023-12-26 08:28:32,982][123091] Updated weights for policy 0, policy_version 1112631 (0.0007) [2023-12-26 08:28:33,043][123091] Updated weights for policy 0, policy_version 1112641 (0.0005) [2023-12-26 08:28:33,099][123091] Updated weights for policy 0, policy_version 1112652 (0.0010) [2023-12-26 08:28:33,612][123090] Updated weights for policy 1, policy_version 1104835 (0.0010) [2023-12-26 08:28:33,676][123090] Updated weights for policy 1, policy_version 1104845 (0.0010) [2023-12-26 08:28:33,736][123090] Updated weights for policy 1, policy_version 1104855 (0.0010) [2023-12-26 08:28:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 567681024. Throughput: 0: 8870.6, 1: 8932.4. Samples: 567698416. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:33,785][121949] Avg episode reward: [(0, '6262.363'), (1, '5958.943')] [2023-12-26 08:28:33,925][123091] Updated weights for policy 0, policy_version 1112662 (0.0008) [2023-12-26 08:28:33,996][123091] Updated weights for policy 0, policy_version 1112672 (0.0009) [2023-12-26 08:28:34,066][123091] Updated weights for policy 0, policy_version 1112682 (0.0010) [2023-12-26 08:28:34,568][123090] Updated weights for policy 1, policy_version 1104865 (0.0010) [2023-12-26 08:28:34,622][123090] Updated weights for policy 1, policy_version 1104875 (0.0008) [2023-12-26 08:28:34,669][123090] Updated weights for policy 1, policy_version 1104885 (0.0005) [2023-12-26 08:28:34,731][123090] Updated weights for policy 1, policy_version 1104895 (0.0006) [2023-12-26 08:28:34,734][123091] Updated weights for policy 0, policy_version 1112692 (0.0008) [2023-12-26 08:28:34,802][123091] Updated weights for policy 0, policy_version 1112702 (0.0009) [2023-12-26 08:28:34,870][123091] Updated weights for policy 0, policy_version 1112712 (0.0005) [2023-12-26 08:28:35,551][123090] Updated weights for policy 1, policy_version 1104905 (0.0010) [2023-12-26 08:28:35,580][123091] Updated weights for policy 0, policy_version 1112722 (0.0006) [2023-12-26 08:28:35,610][123090] Updated weights for policy 1, policy_version 1104915 (0.0010) [2023-12-26 08:28:35,635][123091] Updated weights for policy 0, policy_version 1112732 (0.0010) [2023-12-26 08:28:35,657][123090] Updated weights for policy 1, policy_version 1104925 (0.0010) [2023-12-26 08:28:35,686][123091] Updated weights for policy 0, policy_version 1112742 (0.0010) [2023-12-26 08:28:35,739][123091] Updated weights for policy 0, policy_version 1112752 (0.0009) [2023-12-26 08:28:36,496][123090] Updated weights for policy 1, policy_version 1104935 (0.0011) [2023-12-26 08:28:36,516][123091] Updated weights for policy 0, policy_version 1112762 (0.0006) [2023-12-26 08:28:36,563][123090] Updated weights for policy 1, policy_version 1104945 (0.0011) [2023-12-26 08:28:36,583][123091] Updated weights for policy 0, policy_version 1112772 (0.0008) [2023-12-26 08:28:36,620][123090] Updated weights for policy 1, policy_version 1104955 (0.0010) [2023-12-26 08:28:36,650][123091] Updated weights for policy 0, policy_version 1112782 (0.0009) [2023-12-26 08:28:37,331][123090] Updated weights for policy 1, policy_version 1104965 (0.0008) [2023-12-26 08:28:37,393][123090] Updated weights for policy 1, policy_version 1104975 (0.0010) [2023-12-26 08:28:37,458][123090] Updated weights for policy 1, policy_version 1104985 (0.0010) [2023-12-26 08:28:37,492][123091] Updated weights for policy 0, policy_version 1112792 (0.0009) [2023-12-26 08:28:37,548][123091] Updated weights for policy 0, policy_version 1112802 (0.0009) [2023-12-26 08:28:37,603][123091] Updated weights for policy 0, policy_version 1112812 (0.0009) [2023-12-26 08:28:38,276][123090] Updated weights for policy 1, policy_version 1104995 (0.0010) [2023-12-26 08:28:38,338][123090] Updated weights for policy 1, policy_version 1105005 (0.0010) [2023-12-26 08:28:38,409][123090] Updated weights for policy 1, policy_version 1105015 (0.0011) [2023-12-26 08:28:38,451][123091] Updated weights for policy 0, policy_version 1112822 (0.0007) [2023-12-26 08:28:38,514][123091] Updated weights for policy 0, policy_version 1112832 (0.0006) [2023-12-26 08:28:38,571][123091] Updated weights for policy 0, policy_version 1112842 (0.0006) [2023-12-26 08:28:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 567779328. Throughput: 0: 8966.4, 1: 8931.0. Samples: 567752976. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:38,785][121949] Avg episode reward: [(0, '6129.399'), (1, '5907.893')] [2023-12-26 08:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001112848_284893184.pth... [2023-12-26 08:28:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001105024_282886144.pth... [2023-12-26 08:28:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001104000_282624000.pth [2023-12-26 08:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001111824_284631040.pth [2023-12-26 08:28:39,180][123090] Updated weights for policy 1, policy_version 1105025 (0.0010) [2023-12-26 08:28:39,243][123090] Updated weights for policy 1, policy_version 1105035 (0.0007) [2023-12-26 08:28:39,307][123090] Updated weights for policy 1, policy_version 1105045 (0.0010) [2023-12-26 08:28:39,383][123090] Updated weights for policy 1, policy_version 1105055 (0.0010) [2023-12-26 08:28:39,417][123091] Updated weights for policy 0, policy_version 1112852 (0.0009) [2023-12-26 08:28:39,479][123091] Updated weights for policy 0, policy_version 1112862 (0.0009) [2023-12-26 08:28:39,543][123091] Updated weights for policy 0, policy_version 1112872 (0.0009) [2023-12-26 08:28:40,215][123090] Updated weights for policy 1, policy_version 1105065 (0.0010) [2023-12-26 08:28:40,271][123090] Updated weights for policy 1, policy_version 1105075 (0.0010) [2023-12-26 08:28:40,331][123090] Updated weights for policy 1, policy_version 1105085 (0.0011) [2023-12-26 08:28:40,373][123091] Updated weights for policy 0, policy_version 1112882 (0.0009) [2023-12-26 08:28:40,422][123091] Updated weights for policy 0, policy_version 1112892 (0.0009) [2023-12-26 08:28:40,481][123091] Updated weights for policy 0, policy_version 1112902 (0.0009) [2023-12-26 08:28:40,546][123091] Updated weights for policy 0, policy_version 1112912 (0.0009) [2023-12-26 08:28:41,188][123090] Updated weights for policy 1, policy_version 1105095 (0.0011) [2023-12-26 08:28:41,256][123090] Updated weights for policy 1, policy_version 1105105 (0.0011) [2023-12-26 08:28:41,322][123090] Updated weights for policy 1, policy_version 1105115 (0.0010) [2023-12-26 08:28:41,447][123091] Updated weights for policy 0, policy_version 1112922 (0.0006) [2023-12-26 08:28:41,516][123091] Updated weights for policy 0, policy_version 1112932 (0.0008) [2023-12-26 08:28:41,585][123091] Updated weights for policy 0, policy_version 1112942 (0.0009) [2023-12-26 08:28:42,201][123090] Updated weights for policy 1, policy_version 1105125 (0.0010) [2023-12-26 08:28:42,272][123090] Updated weights for policy 1, policy_version 1105135 (0.0007) [2023-12-26 08:28:42,275][123091] Updated weights for policy 0, policy_version 1112952 (0.0009) [2023-12-26 08:28:42,339][123091] Updated weights for policy 0, policy_version 1112962 (0.0009) [2023-12-26 08:28:42,341][123090] Updated weights for policy 1, policy_version 1105145 (0.0008) [2023-12-26 08:28:42,412][123091] Updated weights for policy 0, policy_version 1112972 (0.0009) [2023-12-26 08:28:43,136][123090] Updated weights for policy 1, policy_version 1105155 (0.0008) [2023-12-26 08:28:43,183][123091] Updated weights for policy 0, policy_version 1112982 (0.0008) [2023-12-26 08:28:43,198][123090] Updated weights for policy 1, policy_version 1105165 (0.0010) [2023-12-26 08:28:43,239][123091] Updated weights for policy 0, policy_version 1112992 (0.0006) [2023-12-26 08:28:43,253][123090] Updated weights for policy 1, policy_version 1105175 (0.0010) [2023-12-26 08:28:43,291][123091] Updated weights for policy 0, policy_version 1113002 (0.0009) [2023-12-26 08:28:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 567861248. Throughput: 0: 8859.5, 1: 8797.8. Samples: 567854772. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:43,785][121949] Avg episode reward: [(0, '6035.671'), (1, '5884.775')] [2023-12-26 08:28:44,003][123090] Updated weights for policy 1, policy_version 1105185 (0.0010) [2023-12-26 08:28:44,068][123091] Updated weights for policy 0, policy_version 1113012 (0.0008) [2023-12-26 08:28:44,080][123090] Updated weights for policy 1, policy_version 1105195 (0.0007) [2023-12-26 08:28:44,140][123091] Updated weights for policy 0, policy_version 1113022 (0.0006) [2023-12-26 08:28:44,151][123090] Updated weights for policy 1, policy_version 1105205 (0.0007) [2023-12-26 08:28:44,209][123091] Updated weights for policy 0, policy_version 1113032 (0.0009) [2023-12-26 08:28:44,217][123090] Updated weights for policy 1, policy_version 1105215 (0.0007) [2023-12-26 08:28:44,992][123090] Updated weights for policy 1, policy_version 1105225 (0.0009) [2023-12-26 08:28:45,005][123091] Updated weights for policy 0, policy_version 1113042 (0.0009) [2023-12-26 08:28:45,053][123090] Updated weights for policy 1, policy_version 1105235 (0.0009) [2023-12-26 08:28:45,057][123091] Updated weights for policy 0, policy_version 1113052 (0.0007) [2023-12-26 08:28:45,112][123090] Updated weights for policy 1, policy_version 1105245 (0.0009) [2023-12-26 08:28:45,119][123091] Updated weights for policy 0, policy_version 1113062 (0.0008) [2023-12-26 08:28:45,185][123091] Updated weights for policy 0, policy_version 1113072 (0.0010) [2023-12-26 08:28:45,925][123090] Updated weights for policy 1, policy_version 1105255 (0.0009) [2023-12-26 08:28:45,995][123090] Updated weights for policy 1, policy_version 1105265 (0.0005) [2023-12-26 08:28:46,016][123091] Updated weights for policy 0, policy_version 1113082 (0.0010) [2023-12-26 08:28:46,059][123090] Updated weights for policy 1, policy_version 1105275 (0.0006) [2023-12-26 08:28:46,064][123091] Updated weights for policy 0, policy_version 1113092 (0.0009) [2023-12-26 08:28:46,115][123091] Updated weights for policy 0, policy_version 1113102 (0.0010) [2023-12-26 08:28:46,830][123090] Updated weights for policy 1, policy_version 1105285 (0.0006) [2023-12-26 08:28:46,908][123090] Updated weights for policy 1, policy_version 1105295 (0.0005) [2023-12-26 08:28:46,920][123091] Updated weights for policy 0, policy_version 1113112 (0.0009) [2023-12-26 08:28:46,983][123090] Updated weights for policy 1, policy_version 1105305 (0.0006) [2023-12-26 08:28:46,993][123091] Updated weights for policy 0, policy_version 1113122 (0.0009) [2023-12-26 08:28:47,050][123091] Updated weights for policy 0, policy_version 1113132 (0.0010) [2023-12-26 08:28:47,691][123090] Updated weights for policy 1, policy_version 1105315 (0.0009) [2023-12-26 08:28:47,748][123090] Updated weights for policy 1, policy_version 1105325 (0.0008) [2023-12-26 08:28:47,804][123090] Updated weights for policy 1, policy_version 1105335 (0.0009) [2023-12-26 08:28:47,875][123091] Updated weights for policy 0, policy_version 1113142 (0.0009) [2023-12-26 08:28:47,926][123091] Updated weights for policy 0, policy_version 1113152 (0.0009) [2023-12-26 08:28:47,977][123091] Updated weights for policy 0, policy_version 1113162 (0.0006) [2023-12-26 08:28:48,697][123090] Updated weights for policy 1, policy_version 1105345 (0.0009) [2023-12-26 08:28:48,761][123090] Updated weights for policy 1, policy_version 1105355 (0.0009) [2023-12-26 08:28:48,781][123091] Updated weights for policy 0, policy_version 1113172 (0.0006) [2023-12-26 08:28:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 567943168. Throughput: 0: 8841.9, 1: 8838.6. Samples: 567961524. Policy #0 lag: (min: 29.0, avg: 35.5, max: 61.0) [2023-12-26 08:28:48,785][121949] Avg episode reward: [(0, '6001.956'), (1, '5930.205')] [2023-12-26 08:28:48,832][123090] Updated weights for policy 1, policy_version 1105366 (0.0010) [2023-12-26 08:28:48,839][123091] Updated weights for policy 0, policy_version 1113182 (0.0008) [2023-12-26 08:28:48,893][123090] Updated weights for policy 1, policy_version 1105376 (0.0010) [2023-12-26 08:28:48,897][123091] Updated weights for policy 0, policy_version 1113192 (0.0007) [2023-12-26 08:28:49,776][123090] Updated weights for policy 1, policy_version 1105386 (0.0011) [2023-12-26 08:28:49,782][123091] Updated weights for policy 0, policy_version 1113202 (0.0009) [2023-12-26 08:28:49,843][123091] Updated weights for policy 0, policy_version 1113212 (0.0008) [2023-12-26 08:28:49,851][123090] Updated weights for policy 1, policy_version 1105396 (0.0010) [2023-12-26 08:28:49,903][123091] Updated weights for policy 0, policy_version 1113222 (0.0008) [2023-12-26 08:28:49,918][123090] Updated weights for policy 1, policy_version 1105406 (0.0010) [2023-12-26 08:28:49,975][123091] Updated weights for policy 0, policy_version 1113232 (0.0009) [2023-12-26 08:28:50,740][123090] Updated weights for policy 1, policy_version 1105416 (0.0010) [2023-12-26 08:28:50,800][123090] Updated weights for policy 1, policy_version 1105426 (0.0010) [2023-12-26 08:28:50,803][123091] Updated weights for policy 0, policy_version 1113242 (0.0010) [2023-12-26 08:28:50,851][123091] Updated weights for policy 0, policy_version 1113252 (0.0006) [2023-12-26 08:28:50,856][123090] Updated weights for policy 1, policy_version 1105436 (0.0010) [2023-12-26 08:28:50,898][123091] Updated weights for policy 0, policy_version 1113262 (0.0010) [2023-12-26 08:28:51,732][123091] Updated weights for policy 0, policy_version 1113272 (0.0008) [2023-12-26 08:28:51,750][123090] Updated weights for policy 1, policy_version 1105446 (0.0008) [2023-12-26 08:28:51,790][123091] Updated weights for policy 0, policy_version 1113282 (0.0008) [2023-12-26 08:28:51,817][123090] Updated weights for policy 1, policy_version 1105456 (0.0008) [2023-12-26 08:28:51,857][123091] Updated weights for policy 0, policy_version 1113292 (0.0006) [2023-12-26 08:28:51,883][123090] Updated weights for policy 1, policy_version 1105466 (0.0009) [2023-12-26 08:28:52,531][123091] Updated weights for policy 0, policy_version 1113302 (0.0009) [2023-12-26 08:28:52,582][123091] Updated weights for policy 0, policy_version 1113312 (0.0009) [2023-12-26 08:28:52,634][123091] Updated weights for policy 0, policy_version 1113322 (0.0009) [2023-12-26 08:28:52,765][123090] Updated weights for policy 1, policy_version 1105476 (0.0009) [2023-12-26 08:28:52,833][123090] Updated weights for policy 1, policy_version 1105486 (0.0009) [2023-12-26 08:28:52,890][123090] Updated weights for policy 1, policy_version 1105496 (0.0009) [2023-12-26 08:28:53,485][123091] Updated weights for policy 0, policy_version 1113332 (0.0010) [2023-12-26 08:28:53,544][123091] Updated weights for policy 0, policy_version 1113342 (0.0010) [2023-12-26 08:28:53,613][123091] Updated weights for policy 0, policy_version 1113352 (0.0010) [2023-12-26 08:28:53,707][123090] Updated weights for policy 1, policy_version 1105506 (0.0009) [2023-12-26 08:28:53,770][123090] Updated weights for policy 1, policy_version 1105516 (0.0009) [2023-12-26 08:28:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 568033280. Throughput: 0: 8794.9, 1: 8766.7. Samples: 568010784. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:28:53,785][121949] Avg episode reward: [(0, '6024.016'), (1, '5973.646')] [2023-12-26 08:28:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001113360_285024256.pth... [2023-12-26 08:28:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001112336_284762112.pth [2023-12-26 08:28:53,831][123090] Updated weights for policy 1, policy_version 1105526 (0.0010) [2023-12-26 08:28:53,893][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001105536_283017216.pth... [2023-12-26 08:28:53,896][123090] Updated weights for policy 1, policy_version 1105536 (0.0010) [2023-12-26 08:28:53,898][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001104512_282755072.pth [2023-12-26 08:28:54,317][123091] Updated weights for policy 0, policy_version 1113362 (0.0009) [2023-12-26 08:28:54,380][123091] Updated weights for policy 0, policy_version 1113372 (0.0005) [2023-12-26 08:28:54,442][123091] Updated weights for policy 0, policy_version 1113382 (0.0008) [2023-12-26 08:28:54,494][123091] Updated weights for policy 0, policy_version 1113392 (0.0010) [2023-12-26 08:28:54,791][123090] Updated weights for policy 1, policy_version 1105546 (0.0010) [2023-12-26 08:28:54,865][123090] Updated weights for policy 1, policy_version 1105556 (0.0010) [2023-12-26 08:28:54,935][123090] Updated weights for policy 1, policy_version 1105566 (0.0009) [2023-12-26 08:28:55,200][123091] Updated weights for policy 0, policy_version 1113402 (0.0005) [2023-12-26 08:28:55,269][123091] Updated weights for policy 0, policy_version 1113412 (0.0005) [2023-12-26 08:28:55,333][123091] Updated weights for policy 0, policy_version 1113422 (0.0005) [2023-12-26 08:28:55,605][123090] Updated weights for policy 1, policy_version 1105576 (0.0006) [2023-12-26 08:28:55,657][123090] Updated weights for policy 1, policy_version 1105586 (0.0005) [2023-12-26 08:28:55,712][123090] Updated weights for policy 1, policy_version 1105596 (0.0005) [2023-12-26 08:28:55,981][123091] Updated weights for policy 0, policy_version 1113432 (0.0005) [2023-12-26 08:28:56,038][123091] Updated weights for policy 0, policy_version 1113442 (0.0005) [2023-12-26 08:28:56,099][123091] Updated weights for policy 0, policy_version 1113452 (0.0005) [2023-12-26 08:28:56,373][123090] Updated weights for policy 1, policy_version 1105606 (0.0005) [2023-12-26 08:28:56,425][123090] Updated weights for policy 1, policy_version 1105616 (0.0005) [2023-12-26 08:28:56,481][123090] Updated weights for policy 1, policy_version 1105626 (0.0005) [2023-12-26 08:28:56,900][123091] Updated weights for policy 0, policy_version 1113462 (0.0008) [2023-12-26 08:28:56,950][123091] Updated weights for policy 0, policy_version 1113472 (0.0009) [2023-12-26 08:28:57,001][123091] Updated weights for policy 0, policy_version 1113482 (0.0009) [2023-12-26 08:28:57,176][123090] Updated weights for policy 1, policy_version 1105636 (0.0006) [2023-12-26 08:28:57,220][123090] Updated weights for policy 1, policy_version 1105646 (0.0006) [2023-12-26 08:28:57,273][123090] Updated weights for policy 1, policy_version 1105656 (0.0005) [2023-12-26 08:28:57,758][123091] Updated weights for policy 0, policy_version 1113492 (0.0008) [2023-12-26 08:28:57,813][123091] Updated weights for policy 0, policy_version 1113502 (0.0005) [2023-12-26 08:28:57,865][123091] Updated weights for policy 0, policy_version 1113512 (0.0006) [2023-12-26 08:28:57,870][123090] Updated weights for policy 1, policy_version 1105666 (0.0005) [2023-12-26 08:28:57,934][123090] Updated weights for policy 1, policy_version 1105676 (0.0005) [2023-12-26 08:28:57,991][123090] Updated weights for policy 1, policy_version 1105686 (0.0005) [2023-12-26 08:28:58,054][123090] Updated weights for policy 1, policy_version 1105696 (0.0006) [2023-12-26 08:28:58,658][123091] Updated weights for policy 0, policy_version 1113522 (0.0006) [2023-12-26 08:28:58,726][123091] Updated weights for policy 0, policy_version 1113532 (0.0011) [2023-12-26 08:28:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 568123392. Throughput: 0: 8885.5, 1: 8814.4. Samples: 568122816. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:28:58,785][121949] Avg episode reward: [(0, '6207.609'), (1, '5968.894')] [2023-12-26 08:28:58,805][123091] Updated weights for policy 0, policy_version 1113542 (0.0010) [2023-12-26 08:28:58,873][123091] Updated weights for policy 0, policy_version 1113552 (0.0011) [2023-12-26 08:28:58,922][123090] Updated weights for policy 1, policy_version 1105706 (0.0008) [2023-12-26 08:28:58,992][123090] Updated weights for policy 1, policy_version 1105716 (0.0009) [2023-12-26 08:28:59,052][123090] Updated weights for policy 1, policy_version 1105726 (0.0009) [2023-12-26 08:28:59,729][123091] Updated weights for policy 0, policy_version 1113562 (0.0009) [2023-12-26 08:28:59,799][123091] Updated weights for policy 0, policy_version 1113572 (0.0008) [2023-12-26 08:28:59,865][123091] Updated weights for policy 0, policy_version 1113582 (0.0008) [2023-12-26 08:28:59,880][123090] Updated weights for policy 1, policy_version 1105736 (0.0008) [2023-12-26 08:28:59,945][123090] Updated weights for policy 1, policy_version 1105746 (0.0009) [2023-12-26 08:29:00,014][123090] Updated weights for policy 1, policy_version 1105756 (0.0008) [2023-12-26 08:29:00,632][123091] Updated weights for policy 0, policy_version 1113592 (0.0009) [2023-12-26 08:29:00,689][123091] Updated weights for policy 0, policy_version 1113602 (0.0009) [2023-12-26 08:29:00,752][123091] Updated weights for policy 0, policy_version 1113612 (0.0005) [2023-12-26 08:29:00,774][123090] Updated weights for policy 1, policy_version 1105766 (0.0008) [2023-12-26 08:29:00,848][123090] Updated weights for policy 1, policy_version 1105776 (0.0009) [2023-12-26 08:29:00,923][123090] Updated weights for policy 1, policy_version 1105786 (0.0009) [2023-12-26 08:29:01,460][123091] Updated weights for policy 0, policy_version 1113622 (0.0008) [2023-12-26 08:29:01,510][123091] Updated weights for policy 0, policy_version 1113632 (0.0009) [2023-12-26 08:29:01,564][123091] Updated weights for policy 0, policy_version 1113643 (0.0010) [2023-12-26 08:29:01,726][123090] Updated weights for policy 1, policy_version 1105796 (0.0009) [2023-12-26 08:29:01,789][123090] Updated weights for policy 1, policy_version 1105806 (0.0006) [2023-12-26 08:29:01,848][123090] Updated weights for policy 1, policy_version 1105816 (0.0005) [2023-12-26 08:29:02,372][123091] Updated weights for policy 0, policy_version 1113654 (0.0009) [2023-12-26 08:29:02,433][123091] Updated weights for policy 0, policy_version 1113664 (0.0005) [2023-12-26 08:29:02,490][123091] Updated weights for policy 0, policy_version 1113674 (0.0005) [2023-12-26 08:29:02,636][123090] Updated weights for policy 1, policy_version 1105826 (0.0006) [2023-12-26 08:29:02,703][123090] Updated weights for policy 1, policy_version 1105836 (0.0009) [2023-12-26 08:29:02,767][123090] Updated weights for policy 1, policy_version 1105846 (0.0010) [2023-12-26 08:29:02,831][123090] Updated weights for policy 1, policy_version 1105856 (0.0010) [2023-12-26 08:29:03,228][123091] Updated weights for policy 0, policy_version 1113684 (0.0007) [2023-12-26 08:29:03,287][123091] Updated weights for policy 0, policy_version 1113694 (0.0009) [2023-12-26 08:29:03,350][123091] Updated weights for policy 0, policy_version 1113704 (0.0009) [2023-12-26 08:29:03,657][123090] Updated weights for policy 1, policy_version 1105866 (0.0010) [2023-12-26 08:29:03,715][123090] Updated weights for policy 1, policy_version 1105876 (0.0010) [2023-12-26 08:29:03,770][123090] Updated weights for policy 1, policy_version 1105886 (0.0009) [2023-12-26 08:29:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 568221696. Throughput: 0: 8929.2, 1: 8816.8. Samples: 568228884. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:03,785][121949] Avg episode reward: [(0, '6180.790'), (1, '5918.990')] [2023-12-26 08:29:04,193][123091] Updated weights for policy 0, policy_version 1113714 (0.0008) [2023-12-26 08:29:04,261][123091] Updated weights for policy 0, policy_version 1113724 (0.0005) [2023-12-26 08:29:04,329][123091] Updated weights for policy 0, policy_version 1113734 (0.0009) [2023-12-26 08:29:04,397][123091] Updated weights for policy 0, policy_version 1113744 (0.0005) [2023-12-26 08:29:04,579][123090] Updated weights for policy 1, policy_version 1105896 (0.0010) [2023-12-26 08:29:04,632][123090] Updated weights for policy 1, policy_version 1105906 (0.0010) [2023-12-26 08:29:04,679][123090] Updated weights for policy 1, policy_version 1105916 (0.0010) [2023-12-26 08:29:05,104][123091] Updated weights for policy 0, policy_version 1113754 (0.0011) [2023-12-26 08:29:05,159][123091] Updated weights for policy 0, policy_version 1113764 (0.0010) [2023-12-26 08:29:05,222][123091] Updated weights for policy 0, policy_version 1113774 (0.0007) [2023-12-26 08:29:05,496][123090] Updated weights for policy 1, policy_version 1105926 (0.0007) [2023-12-26 08:29:05,550][123090] Updated weights for policy 1, policy_version 1105936 (0.0008) [2023-12-26 08:29:05,598][123090] Updated weights for policy 1, policy_version 1105946 (0.0010) [2023-12-26 08:29:05,843][123091] Updated weights for policy 0, policy_version 1113784 (0.0005) [2023-12-26 08:29:05,894][123091] Updated weights for policy 0, policy_version 1113794 (0.0005) [2023-12-26 08:29:05,943][123091] Updated weights for policy 0, policy_version 1113804 (0.0006) [2023-12-26 08:29:06,423][123090] Updated weights for policy 1, policy_version 1105956 (0.0010) [2023-12-26 08:29:06,495][123090] Updated weights for policy 1, policy_version 1105966 (0.0010) [2023-12-26 08:29:06,549][123090] Updated weights for policy 1, policy_version 1105976 (0.0010) [2023-12-26 08:29:06,656][123091] Updated weights for policy 0, policy_version 1113814 (0.0006) [2023-12-26 08:29:06,716][123091] Updated weights for policy 0, policy_version 1113824 (0.0005) [2023-12-26 08:29:06,771][123091] Updated weights for policy 0, policy_version 1113834 (0.0006) [2023-12-26 08:29:07,448][123091] Updated weights for policy 0, policy_version 1113844 (0.0005) [2023-12-26 08:29:07,478][123090] Updated weights for policy 1, policy_version 1105986 (0.0009) [2023-12-26 08:29:07,502][123091] Updated weights for policy 0, policy_version 1113854 (0.0005) [2023-12-26 08:29:07,527][123090] Updated weights for policy 1, policy_version 1105996 (0.0009) [2023-12-26 08:29:07,551][123091] Updated weights for policy 0, policy_version 1113864 (0.0005) [2023-12-26 08:29:07,576][123090] Updated weights for policy 1, policy_version 1106006 (0.0008) [2023-12-26 08:29:07,628][123090] Updated weights for policy 1, policy_version 1106016 (0.0009) [2023-12-26 08:29:08,199][123091] Updated weights for policy 0, policy_version 1113874 (0.0006) [2023-12-26 08:29:08,263][123091] Updated weights for policy 0, policy_version 1113884 (0.0010) [2023-12-26 08:29:08,342][123091] Updated weights for policy 0, policy_version 1113894 (0.0011) [2023-12-26 08:29:08,412][123091] Updated weights for policy 0, policy_version 1113904 (0.0006) [2023-12-26 08:29:08,561][123090] Updated weights for policy 1, policy_version 1106026 (0.0005) [2023-12-26 08:29:08,639][123090] Updated weights for policy 1, policy_version 1106036 (0.0005) [2023-12-26 08:29:08,700][123090] Updated weights for policy 1, policy_version 1106046 (0.0005) [2023-12-26 08:29:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 568311808. Throughput: 0: 9005.0, 1: 8823.7. Samples: 568284020. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:08,785][121949] Avg episode reward: [(0, '6135.968'), (1, '5916.197')] [2023-12-26 08:29:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001113904_285163520.pth... [2023-12-26 08:29:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001106048_283148288.pth... [2023-12-26 08:29:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001112848_284893184.pth [2023-12-26 08:29:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001105024_282886144.pth [2023-12-26 08:29:09,054][123091] Updated weights for policy 0, policy_version 1113914 (0.0006) [2023-12-26 08:29:09,121][123091] Updated weights for policy 0, policy_version 1113924 (0.0008) [2023-12-26 08:29:09,191][123091] Updated weights for policy 0, policy_version 1113934 (0.0007) [2023-12-26 08:29:09,392][123090] Updated weights for policy 1, policy_version 1106056 (0.0012) [2023-12-26 08:29:09,460][123090] Updated weights for policy 1, policy_version 1106066 (0.0011) [2023-12-26 08:29:09,535][123090] Updated weights for policy 1, policy_version 1106076 (0.0011) [2023-12-26 08:29:09,964][123091] Updated weights for policy 0, policy_version 1113944 (0.0009) [2023-12-26 08:29:10,021][123091] Updated weights for policy 0, policy_version 1113954 (0.0006) [2023-12-26 08:29:10,083][123091] Updated weights for policy 0, policy_version 1113964 (0.0010) [2023-12-26 08:29:10,382][123090] Updated weights for policy 1, policy_version 1106086 (0.0010) [2023-12-26 08:29:10,446][123090] Updated weights for policy 1, policy_version 1106096 (0.0009) [2023-12-26 08:29:10,516][123090] Updated weights for policy 1, policy_version 1106106 (0.0009) [2023-12-26 08:29:10,910][123091] Updated weights for policy 0, policy_version 1113974 (0.0010) [2023-12-26 08:29:10,965][123091] Updated weights for policy 0, policy_version 1113984 (0.0009) [2023-12-26 08:29:11,023][123091] Updated weights for policy 0, policy_version 1113995 (0.0011) [2023-12-26 08:29:11,328][123090] Updated weights for policy 1, policy_version 1106116 (0.0009) [2023-12-26 08:29:11,421][123090] Updated weights for policy 1, policy_version 1106126 (0.0008) [2023-12-26 08:29:11,496][123090] Updated weights for policy 1, policy_version 1106136 (0.0006) [2023-12-26 08:29:11,913][123091] Updated weights for policy 0, policy_version 1114005 (0.0010) [2023-12-26 08:29:11,983][123091] Updated weights for policy 0, policy_version 1114015 (0.0009) [2023-12-26 08:29:12,052][123091] Updated weights for policy 0, policy_version 1114025 (0.0010) [2023-12-26 08:29:12,271][123090] Updated weights for policy 1, policy_version 1106146 (0.0010) [2023-12-26 08:29:12,336][123090] Updated weights for policy 1, policy_version 1106156 (0.0009) [2023-12-26 08:29:12,403][123090] Updated weights for policy 1, policy_version 1106166 (0.0006) [2023-12-26 08:29:12,467][123090] Updated weights for policy 1, policy_version 1106176 (0.0006) [2023-12-26 08:29:12,867][123091] Updated weights for policy 0, policy_version 1114035 (0.0009) [2023-12-26 08:29:12,923][123091] Updated weights for policy 0, policy_version 1114045 (0.0009) [2023-12-26 08:29:12,974][123091] Updated weights for policy 0, policy_version 1114055 (0.0009) [2023-12-26 08:29:13,212][123090] Updated weights for policy 1, policy_version 1106186 (0.0009) [2023-12-26 08:29:13,265][123090] Updated weights for policy 1, policy_version 1106196 (0.0009) [2023-12-26 08:29:13,323][123090] Updated weights for policy 1, policy_version 1106206 (0.0009) [2023-12-26 08:29:13,771][123091] Updated weights for policy 0, policy_version 1114065 (0.0009) [2023-12-26 08:29:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 568393728. Throughput: 0: 8991.7, 1: 8717.6. Samples: 568390500. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:13,785][121949] Avg episode reward: [(0, '6134.527'), (1, '5827.256')] [2023-12-26 08:29:13,836][123091] Updated weights for policy 0, policy_version 1114075 (0.0006) [2023-12-26 08:29:13,906][123091] Updated weights for policy 0, policy_version 1114085 (0.0006) [2023-12-26 08:29:13,961][123091] Updated weights for policy 0, policy_version 1114095 (0.0005) [2023-12-26 08:29:14,114][123090] Updated weights for policy 1, policy_version 1106216 (0.0006) [2023-12-26 08:29:14,167][123090] Updated weights for policy 1, policy_version 1106226 (0.0005) [2023-12-26 08:29:14,232][123090] Updated weights for policy 1, policy_version 1106236 (0.0005) [2023-12-26 08:29:14,614][123091] Updated weights for policy 0, policy_version 1114105 (0.0005) [2023-12-26 08:29:14,675][123091] Updated weights for policy 0, policy_version 1114115 (0.0006) [2023-12-26 08:29:14,736][123091] Updated weights for policy 0, policy_version 1114125 (0.0009) [2023-12-26 08:29:14,959][123090] Updated weights for policy 1, policy_version 1106246 (0.0006) [2023-12-26 08:29:15,014][123090] Updated weights for policy 1, policy_version 1106256 (0.0006) [2023-12-26 08:29:15,091][123090] Updated weights for policy 1, policy_version 1106266 (0.0006) [2023-12-26 08:29:15,520][123091] Updated weights for policy 0, policy_version 1114135 (0.0010) [2023-12-26 08:29:15,574][123091] Updated weights for policy 0, policy_version 1114145 (0.0010) [2023-12-26 08:29:15,635][123091] Updated weights for policy 0, policy_version 1114155 (0.0010) [2023-12-26 08:29:15,867][123090] Updated weights for policy 1, policy_version 1106276 (0.0007) [2023-12-26 08:29:15,944][123090] Updated weights for policy 1, policy_version 1106286 (0.0005) [2023-12-26 08:29:16,008][123090] Updated weights for policy 1, policy_version 1106296 (0.0005) [2023-12-26 08:29:16,465][123091] Updated weights for policy 0, policy_version 1114165 (0.0010) [2023-12-26 08:29:16,520][123091] Updated weights for policy 0, policy_version 1114175 (0.0010) [2023-12-26 08:29:16,576][123091] Updated weights for policy 0, policy_version 1114187 (0.0011) [2023-12-26 08:29:16,691][123090] Updated weights for policy 1, policy_version 1106306 (0.0005) [2023-12-26 08:29:16,750][123090] Updated weights for policy 1, policy_version 1106316 (0.0005) [2023-12-26 08:29:16,824][123090] Updated weights for policy 1, policy_version 1106326 (0.0007) [2023-12-26 08:29:16,897][123090] Updated weights for policy 1, policy_version 1106336 (0.0010) [2023-12-26 08:29:17,420][123091] Updated weights for policy 0, policy_version 1114197 (0.0008) [2023-12-26 08:29:17,477][123091] Updated weights for policy 0, policy_version 1114207 (0.0007) [2023-12-26 08:29:17,548][123091] Updated weights for policy 0, policy_version 1114217 (0.0011) [2023-12-26 08:29:17,572][123090] Updated weights for policy 1, policy_version 1106346 (0.0006) [2023-12-26 08:29:17,637][123090] Updated weights for policy 1, policy_version 1106356 (0.0005) [2023-12-26 08:29:17,709][123090] Updated weights for policy 1, policy_version 1106366 (0.0005) [2023-12-26 08:29:18,307][123091] Updated weights for policy 0, policy_version 1114227 (0.0010) [2023-12-26 08:29:18,347][123090] Updated weights for policy 1, policy_version 1106376 (0.0006) [2023-12-26 08:29:18,374][123091] Updated weights for policy 0, policy_version 1114237 (0.0007) [2023-12-26 08:29:18,412][123090] Updated weights for policy 1, policy_version 1106386 (0.0009) [2023-12-26 08:29:18,442][123091] Updated weights for policy 0, policy_version 1114247 (0.0007) [2023-12-26 08:29:18,469][123090] Updated weights for policy 1, policy_version 1106396 (0.0010) [2023-12-26 08:29:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 568492032. Throughput: 0: 9059.2, 1: 8795.0. Samples: 568501856. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:18,785][121949] Avg episode reward: [(0, '6065.669'), (1, '5801.114')] [2023-12-26 08:29:19,093][123091] Updated weights for policy 0, policy_version 1114257 (0.0008) [2023-12-26 08:29:19,155][123091] Updated weights for policy 0, policy_version 1114267 (0.0008) [2023-12-26 08:29:19,203][123091] Updated weights for policy 0, policy_version 1114277 (0.0008) [2023-12-26 08:29:19,256][123090] Updated weights for policy 1, policy_version 1106406 (0.0008) [2023-12-26 08:29:19,270][123091] Updated weights for policy 0, policy_version 1114287 (0.0009) [2023-12-26 08:29:19,325][123090] Updated weights for policy 1, policy_version 1106416 (0.0009) [2023-12-26 08:29:19,394][123090] Updated weights for policy 1, policy_version 1106426 (0.0009) [2023-12-26 08:29:20,116][123091] Updated weights for policy 0, policy_version 1114297 (0.0006) [2023-12-26 08:29:20,175][123091] Updated weights for policy 0, policy_version 1114307 (0.0006) [2023-12-26 08:29:20,238][123091] Updated weights for policy 0, policy_version 1114317 (0.0007) [2023-12-26 08:29:20,255][123090] Updated weights for policy 1, policy_version 1106436 (0.0008) [2023-12-26 08:29:20,312][123090] Updated weights for policy 1, policy_version 1106446 (0.0009) [2023-12-26 08:29:20,372][123090] Updated weights for policy 1, policy_version 1106456 (0.0010) [2023-12-26 08:29:21,028][123091] Updated weights for policy 0, policy_version 1114327 (0.0010) [2023-12-26 08:29:21,103][123091] Updated weights for policy 0, policy_version 1114337 (0.0010) [2023-12-26 08:29:21,178][123091] Updated weights for policy 0, policy_version 1114347 (0.0010) [2023-12-26 08:29:21,257][123090] Updated weights for policy 1, policy_version 1106467 (0.0009) [2023-12-26 08:29:21,321][123090] Updated weights for policy 1, policy_version 1106477 (0.0007) [2023-12-26 08:29:21,396][123090] Updated weights for policy 1, policy_version 1106487 (0.0008) [2023-12-26 08:29:22,030][123091] Updated weights for policy 0, policy_version 1114357 (0.0009) [2023-12-26 08:29:22,093][123091] Updated weights for policy 0, policy_version 1114367 (0.0008) [2023-12-26 08:29:22,155][123091] Updated weights for policy 0, policy_version 1114377 (0.0008) [2023-12-26 08:29:22,200][123090] Updated weights for policy 1, policy_version 1106497 (0.0009) [2023-12-26 08:29:22,275][123090] Updated weights for policy 1, policy_version 1106507 (0.0008) [2023-12-26 08:29:22,344][123090] Updated weights for policy 1, policy_version 1106517 (0.0010) [2023-12-26 08:29:22,422][123090] Updated weights for policy 1, policy_version 1106527 (0.0010) [2023-12-26 08:29:22,986][123091] Updated weights for policy 0, policy_version 1114387 (0.0008) [2023-12-26 08:29:23,057][123091] Updated weights for policy 0, policy_version 1114397 (0.0006) [2023-12-26 08:29:23,129][123091] Updated weights for policy 0, policy_version 1114407 (0.0005) [2023-12-26 08:29:23,144][123090] Updated weights for policy 1, policy_version 1106537 (0.0006) [2023-12-26 08:29:23,213][123090] Updated weights for policy 1, policy_version 1106547 (0.0008) [2023-12-26 08:29:23,281][123090] Updated weights for policy 1, policy_version 1106557 (0.0007) [2023-12-26 08:29:23,750][123091] Updated weights for policy 0, policy_version 1114417 (0.0006) [2023-12-26 08:29:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 568573952. Throughput: 0: 8997.2, 1: 8777.7. Samples: 568552844. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:23,785][121949] Avg episode reward: [(0, '6017.629'), (1, '5880.038')] [2023-12-26 08:29:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001106560_283279360.pth... [2023-12-26 08:29:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001105536_283017216.pth [2023-12-26 08:29:23,804][123091] Updated weights for policy 0, policy_version 1114427 (0.0010) [2023-12-26 08:29:23,864][123091] Updated weights for policy 0, policy_version 1114437 (0.0009) [2023-12-26 08:29:23,930][123091] Updated weights for policy 0, policy_version 1114447 (0.0011) [2023-12-26 08:29:23,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001114448_285302784.pth... [2023-12-26 08:29:23,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001113360_285024256.pth [2023-12-26 08:29:24,106][123090] Updated weights for policy 1, policy_version 1106567 (0.0009) [2023-12-26 08:29:24,169][123090] Updated weights for policy 1, policy_version 1106577 (0.0010) [2023-12-26 08:29:24,241][123090] Updated weights for policy 1, policy_version 1106587 (0.0010) [2023-12-26 08:29:24,542][123091] Updated weights for policy 0, policy_version 1114457 (0.0009) [2023-12-26 08:29:24,589][123091] Updated weights for policy 0, policy_version 1114467 (0.0010) [2023-12-26 08:29:24,636][123091] Updated weights for policy 0, policy_version 1114477 (0.0010) [2023-12-26 08:29:25,101][123090] Updated weights for policy 1, policy_version 1106597 (0.0008) [2023-12-26 08:29:25,160][123090] Updated weights for policy 1, policy_version 1106607 (0.0010) [2023-12-26 08:29:25,224][123090] Updated weights for policy 1, policy_version 1106617 (0.0006) [2023-12-26 08:29:25,376][123091] Updated weights for policy 0, policy_version 1114487 (0.0007) [2023-12-26 08:29:25,432][123091] Updated weights for policy 0, policy_version 1114497 (0.0006) [2023-12-26 08:29:25,483][123091] Updated weights for policy 0, policy_version 1114507 (0.0010) [2023-12-26 08:29:25,962][123090] Updated weights for policy 1, policy_version 1106627 (0.0006) [2023-12-26 08:29:26,011][123090] Updated weights for policy 1, policy_version 1106637 (0.0008) [2023-12-26 08:29:26,060][123090] Updated weights for policy 1, policy_version 1106647 (0.0009) [2023-12-26 08:29:26,286][123091] Updated weights for policy 0, policy_version 1114517 (0.0010) [2023-12-26 08:29:26,336][123091] Updated weights for policy 0, policy_version 1114527 (0.0010) [2023-12-26 08:29:26,390][123091] Updated weights for policy 0, policy_version 1114537 (0.0010) [2023-12-26 08:29:26,941][123090] Updated weights for policy 1, policy_version 1106657 (0.0009) [2023-12-26 08:29:26,993][123090] Updated weights for policy 1, policy_version 1106667 (0.0008) [2023-12-26 08:29:27,042][123090] Updated weights for policy 1, policy_version 1106677 (0.0009) [2023-12-26 08:29:27,090][123090] Updated weights for policy 1, policy_version 1106687 (0.0008) [2023-12-26 08:29:27,235][123091] Updated weights for policy 0, policy_version 1114547 (0.0010) [2023-12-26 08:29:27,282][123091] Updated weights for policy 0, policy_version 1114557 (0.0010) [2023-12-26 08:29:27,333][123091] Updated weights for policy 0, policy_version 1114567 (0.0010) [2023-12-26 08:29:27,938][123090] Updated weights for policy 1, policy_version 1106697 (0.0010) [2023-12-26 08:29:27,993][123090] Updated weights for policy 1, policy_version 1106707 (0.0010) [2023-12-26 08:29:28,046][123090] Updated weights for policy 1, policy_version 1106718 (0.0009) [2023-12-26 08:29:28,122][123091] Updated weights for policy 0, policy_version 1114577 (0.0010) [2023-12-26 08:29:28,172][123091] Updated weights for policy 0, policy_version 1114587 (0.0010) [2023-12-26 08:29:28,219][123091] Updated weights for policy 0, policy_version 1114597 (0.0010) [2023-12-26 08:29:28,266][123091] Updated weights for policy 0, policy_version 1114607 (0.0006) [2023-12-26 08:29:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 568664064. Throughput: 0: 9110.0, 1: 8790.0. Samples: 568660276. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:28,785][121949] Avg episode reward: [(0, '6057.209'), (1, '5836.371')] [2023-12-26 08:29:28,928][123090] Updated weights for policy 1, policy_version 1106728 (0.0010) [2023-12-26 08:29:28,979][123090] Updated weights for policy 1, policy_version 1106738 (0.0008) [2023-12-26 08:29:29,043][123090] Updated weights for policy 1, policy_version 1106748 (0.0006) [2023-12-26 08:29:29,080][123091] Updated weights for policy 0, policy_version 1114617 (0.0005) [2023-12-26 08:29:29,127][123091] Updated weights for policy 0, policy_version 1114627 (0.0005) [2023-12-26 08:29:29,180][123091] Updated weights for policy 0, policy_version 1114637 (0.0005) [2023-12-26 08:29:29,817][123090] Updated weights for policy 1, policy_version 1106758 (0.0009) [2023-12-26 08:29:29,876][123090] Updated weights for policy 1, policy_version 1106768 (0.0014) [2023-12-26 08:29:29,917][123091] Updated weights for policy 0, policy_version 1114647 (0.0006) [2023-12-26 08:29:29,940][123090] Updated weights for policy 1, policy_version 1106778 (0.0011) [2023-12-26 08:29:29,978][123091] Updated weights for policy 0, policy_version 1114657 (0.0009) [2023-12-26 08:29:30,034][123091] Updated weights for policy 0, policy_version 1114667 (0.0009) [2023-12-26 08:29:30,680][123090] Updated weights for policy 1, policy_version 1106788 (0.0009) [2023-12-26 08:29:30,742][123090] Updated weights for policy 1, policy_version 1106798 (0.0005) [2023-12-26 08:29:30,801][123090] Updated weights for policy 1, policy_version 1106808 (0.0005) [2023-12-26 08:29:30,925][123091] Updated weights for policy 0, policy_version 1114677 (0.0009) [2023-12-26 08:29:30,977][123091] Updated weights for policy 0, policy_version 1114687 (0.0009) [2023-12-26 08:29:31,033][123091] Updated weights for policy 0, policy_version 1114697 (0.0009) [2023-12-26 08:29:31,561][123090] Updated weights for policy 1, policy_version 1106818 (0.0007) [2023-12-26 08:29:31,623][123090] Updated weights for policy 1, policy_version 1106828 (0.0006) [2023-12-26 08:29:31,689][123090] Updated weights for policy 1, policy_version 1106838 (0.0008) [2023-12-26 08:29:31,761][123090] Updated weights for policy 1, policy_version 1106848 (0.0008) [2023-12-26 08:29:31,910][123091] Updated weights for policy 0, policy_version 1114707 (0.0009) [2023-12-26 08:29:31,964][123091] Updated weights for policy 0, policy_version 1114717 (0.0009) [2023-12-26 08:29:32,023][123091] Updated weights for policy 0, policy_version 1114727 (0.0010) [2023-12-26 08:29:32,425][123090] Updated weights for policy 1, policy_version 1106858 (0.0010) [2023-12-26 08:29:32,493][123090] Updated weights for policy 1, policy_version 1106868 (0.0009) [2023-12-26 08:29:32,555][123090] Updated weights for policy 1, policy_version 1106878 (0.0010) [2023-12-26 08:29:32,896][123091] Updated weights for policy 0, policy_version 1114737 (0.0010) [2023-12-26 08:29:32,955][123091] Updated weights for policy 0, policy_version 1114747 (0.0009) [2023-12-26 08:29:33,023][123091] Updated weights for policy 0, policy_version 1114757 (0.0010) [2023-12-26 08:29:33,084][123091] Updated weights for policy 0, policy_version 1114767 (0.0008) [2023-12-26 08:29:33,309][123090] Updated weights for policy 1, policy_version 1106888 (0.0008) [2023-12-26 08:29:33,367][123090] Updated weights for policy 1, policy_version 1106898 (0.0006) [2023-12-26 08:29:33,425][123090] Updated weights for policy 1, policy_version 1106908 (0.0006) [2023-12-26 08:29:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 568754176. Throughput: 0: 9064.6, 1: 8816.7. Samples: 568766184. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:33,785][121949] Avg episode reward: [(0, '6206.369'), (1, '5722.276')] [2023-12-26 08:29:33,963][123091] Updated weights for policy 0, policy_version 1114777 (0.0010) [2023-12-26 08:29:34,026][123091] Updated weights for policy 0, policy_version 1114787 (0.0010) [2023-12-26 08:29:34,093][123091] Updated weights for policy 0, policy_version 1114797 (0.0007) [2023-12-26 08:29:34,149][123090] Updated weights for policy 1, policy_version 1106918 (0.0009) [2023-12-26 08:29:34,210][123090] Updated weights for policy 1, policy_version 1106928 (0.0010) [2023-12-26 08:29:34,263][123090] Updated weights for policy 1, policy_version 1106938 (0.0010) [2023-12-26 08:29:34,938][123091] Updated weights for policy 0, policy_version 1114807 (0.0008) [2023-12-26 08:29:34,988][123090] Updated weights for policy 1, policy_version 1106948 (0.0009) [2023-12-26 08:29:34,991][123091] Updated weights for policy 0, policy_version 1114817 (0.0008) [2023-12-26 08:29:35,050][123091] Updated weights for policy 0, policy_version 1114827 (0.0009) [2023-12-26 08:29:35,051][123090] Updated weights for policy 1, policy_version 1106958 (0.0008) [2023-12-26 08:29:35,102][123090] Updated weights for policy 1, policy_version 1106968 (0.0008) [2023-12-26 08:29:35,891][123091] Updated weights for policy 0, policy_version 1114837 (0.0007) [2023-12-26 08:29:35,949][123090] Updated weights for policy 1, policy_version 1106978 (0.0008) [2023-12-26 08:29:35,967][123091] Updated weights for policy 0, policy_version 1114847 (0.0005) [2023-12-26 08:29:36,003][123090] Updated weights for policy 1, policy_version 1106988 (0.0005) [2023-12-26 08:29:36,040][123091] Updated weights for policy 0, policy_version 1114857 (0.0005) [2023-12-26 08:29:36,075][123090] Updated weights for policy 1, policy_version 1106998 (0.0009) [2023-12-26 08:29:36,146][123090] Updated weights for policy 1, policy_version 1107008 (0.0010) [2023-12-26 08:29:36,653][123091] Updated weights for policy 0, policy_version 1114867 (0.0007) [2023-12-26 08:29:36,715][123091] Updated weights for policy 0, policy_version 1114877 (0.0005) [2023-12-26 08:29:36,775][123091] Updated weights for policy 0, policy_version 1114887 (0.0007) [2023-12-26 08:29:36,985][123090] Updated weights for policy 1, policy_version 1107018 (0.0008) [2023-12-26 08:29:37,048][123090] Updated weights for policy 1, policy_version 1107028 (0.0008) [2023-12-26 08:29:37,099][123090] Updated weights for policy 1, policy_version 1107038 (0.0009) [2023-12-26 08:29:37,543][123091] Updated weights for policy 0, policy_version 1114897 (0.0010) [2023-12-26 08:29:37,606][123091] Updated weights for policy 0, policy_version 1114907 (0.0010) [2023-12-26 08:29:37,667][123091] Updated weights for policy 0, policy_version 1114917 (0.0009) [2023-12-26 08:29:37,720][123091] Updated weights for policy 0, policy_version 1114927 (0.0009) [2023-12-26 08:29:37,836][123090] Updated weights for policy 1, policy_version 1107048 (0.0009) [2023-12-26 08:29:37,886][123090] Updated weights for policy 1, policy_version 1107058 (0.0009) [2023-12-26 08:29:37,946][123090] Updated weights for policy 1, policy_version 1107068 (0.0008) [2023-12-26 08:29:38,521][123091] Updated weights for policy 0, policy_version 1114937 (0.0010) [2023-12-26 08:29:38,593][123091] Updated weights for policy 0, policy_version 1114947 (0.0009) [2023-12-26 08:29:38,662][123091] Updated weights for policy 0, policy_version 1114957 (0.0009) [2023-12-26 08:29:38,710][123090] Updated weights for policy 1, policy_version 1107078 (0.0010) [2023-12-26 08:29:38,775][123090] Updated weights for policy 1, policy_version 1107088 (0.0007) [2023-12-26 08:29:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 568844288. Throughput: 0: 9096.2, 1: 8867.4. Samples: 568819144. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:38,784][121949] Avg episode reward: [(0, '6323.407'), (1, '5669.995')] [2023-12-26 08:29:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001114960_285433856.pth... [2023-12-26 08:29:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001113904_285163520.pth [2023-12-26 08:29:38,850][123090] Updated weights for policy 1, policy_version 1107098 (0.0006) [2023-12-26 08:29:38,893][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001107104_283418624.pth... [2023-12-26 08:29:38,899][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001106048_283148288.pth [2023-12-26 08:29:39,446][123091] Updated weights for policy 0, policy_version 1114967 (0.0010) [2023-12-26 08:29:39,515][123091] Updated weights for policy 0, policy_version 1114977 (0.0009) [2023-12-26 08:29:39,535][123090] Updated weights for policy 1, policy_version 1107108 (0.0006) [2023-12-26 08:29:39,585][123091] Updated weights for policy 0, policy_version 1114987 (0.0006) [2023-12-26 08:29:39,598][123090] Updated weights for policy 1, policy_version 1107118 (0.0007) [2023-12-26 08:29:39,662][123090] Updated weights for policy 1, policy_version 1107128 (0.0006) [2023-12-26 08:29:40,354][123091] Updated weights for policy 0, policy_version 1114997 (0.0009) [2023-12-26 08:29:40,419][123091] Updated weights for policy 0, policy_version 1115007 (0.0010) [2023-12-26 08:29:40,433][123090] Updated weights for policy 1, policy_version 1107138 (0.0006) [2023-12-26 08:29:40,483][123090] Updated weights for policy 1, policy_version 1107148 (0.0009) [2023-12-26 08:29:40,483][123091] Updated weights for policy 0, policy_version 1115017 (0.0009) [2023-12-26 08:29:40,529][123090] Updated weights for policy 1, policy_version 1107158 (0.0008) [2023-12-26 08:29:40,583][123090] Updated weights for policy 1, policy_version 1107168 (0.0009) [2023-12-26 08:29:41,329][123091] Updated weights for policy 0, policy_version 1115027 (0.0009) [2023-12-26 08:29:41,401][123091] Updated weights for policy 0, policy_version 1115037 (0.0010) [2023-12-26 08:29:41,454][123090] Updated weights for policy 1, policy_version 1107178 (0.0007) [2023-12-26 08:29:41,465][123091] Updated weights for policy 0, policy_version 1115047 (0.0008) [2023-12-26 08:29:41,516][123090] Updated weights for policy 1, policy_version 1107188 (0.0008) [2023-12-26 08:29:41,579][123090] Updated weights for policy 1, policy_version 1107198 (0.0010) [2023-12-26 08:29:42,347][123091] Updated weights for policy 0, policy_version 1115057 (0.0008) [2023-12-26 08:29:42,393][123090] Updated weights for policy 1, policy_version 1107208 (0.0009) [2023-12-26 08:29:42,424][123091] Updated weights for policy 0, policy_version 1115067 (0.0009) [2023-12-26 08:29:42,465][123090] Updated weights for policy 1, policy_version 1107218 (0.0009) [2023-12-26 08:29:42,492][123091] Updated weights for policy 0, policy_version 1115077 (0.0007) [2023-12-26 08:29:42,526][123090] Updated weights for policy 1, policy_version 1107228 (0.0009) [2023-12-26 08:29:42,546][123091] Updated weights for policy 0, policy_version 1115087 (0.0009) [2023-12-26 08:29:43,280][123090] Updated weights for policy 1, policy_version 1107239 (0.0010) [2023-12-26 08:29:43,337][123090] Updated weights for policy 1, policy_version 1107249 (0.0009) [2023-12-26 08:29:43,341][123091] Updated weights for policy 0, policy_version 1115097 (0.0006) [2023-12-26 08:29:43,400][123091] Updated weights for policy 0, policy_version 1115107 (0.0005) [2023-12-26 08:29:43,402][123090] Updated weights for policy 1, policy_version 1107259 (0.0009) [2023-12-26 08:29:43,467][123091] Updated weights for policy 0, policy_version 1115117 (0.0008) [2023-12-26 08:29:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 568934400. Throughput: 0: 8993.1, 1: 8846.3. Samples: 568925592. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:43,785][121949] Avg episode reward: [(0, '6251.927'), (1, '5676.121')] [2023-12-26 08:29:44,021][123091] Updated weights for policy 0, policy_version 1115127 (0.0006) [2023-12-26 08:29:44,090][123091] Updated weights for policy 0, policy_version 1115137 (0.0009) [2023-12-26 08:29:44,142][123091] Updated weights for policy 0, policy_version 1115147 (0.0006) [2023-12-26 08:29:44,316][123090] Updated weights for policy 1, policy_version 1107269 (0.0010) [2023-12-26 08:29:44,381][123090] Updated weights for policy 1, policy_version 1107279 (0.0010) [2023-12-26 08:29:44,443][123090] Updated weights for policy 1, policy_version 1107289 (0.0010) [2023-12-26 08:29:44,805][123091] Updated weights for policy 0, policy_version 1115157 (0.0007) [2023-12-26 08:29:44,870][123091] Updated weights for policy 0, policy_version 1115167 (0.0008) [2023-12-26 08:29:44,939][123091] Updated weights for policy 0, policy_version 1115177 (0.0008) [2023-12-26 08:29:45,393][123090] Updated weights for policy 1, policy_version 1107299 (0.0010) [2023-12-26 08:29:45,454][123090] Updated weights for policy 1, policy_version 1107309 (0.0010) [2023-12-26 08:29:45,513][123090] Updated weights for policy 1, policy_version 1107319 (0.0010) [2023-12-26 08:29:45,637][123091] Updated weights for policy 0, policy_version 1115187 (0.0007) [2023-12-26 08:29:45,713][123091] Updated weights for policy 0, policy_version 1115197 (0.0006) [2023-12-26 08:29:45,775][123091] Updated weights for policy 0, policy_version 1115207 (0.0005) [2023-12-26 08:29:46,297][123090] Updated weights for policy 1, policy_version 1107329 (0.0010) [2023-12-26 08:29:46,352][123090] Updated weights for policy 1, policy_version 1107339 (0.0006) [2023-12-26 08:29:46,414][123090] Updated weights for policy 1, policy_version 1107349 (0.0008) [2023-12-26 08:29:46,435][123091] Updated weights for policy 0, policy_version 1115217 (0.0005) [2023-12-26 08:29:46,485][123090] Updated weights for policy 1, policy_version 1107359 (0.0006) [2023-12-26 08:29:46,507][123091] Updated weights for policy 0, policy_version 1115227 (0.0005) [2023-12-26 08:29:46,570][123091] Updated weights for policy 0, policy_version 1115237 (0.0005) [2023-12-26 08:29:46,617][123091] Updated weights for policy 0, policy_version 1115247 (0.0005) [2023-12-26 08:29:47,177][123090] Updated weights for policy 1, policy_version 1107369 (0.0005) [2023-12-26 08:29:47,246][123090] Updated weights for policy 1, policy_version 1107379 (0.0006) [2023-12-26 08:29:47,306][123090] Updated weights for policy 1, policy_version 1107389 (0.0007) [2023-12-26 08:29:47,349][123091] Updated weights for policy 0, policy_version 1115257 (0.0007) [2023-12-26 08:29:47,409][123091] Updated weights for policy 0, policy_version 1115267 (0.0009) [2023-12-26 08:29:47,473][123091] Updated weights for policy 0, policy_version 1115277 (0.0009) [2023-12-26 08:29:48,066][123090] Updated weights for policy 1, policy_version 1107399 (0.0009) [2023-12-26 08:29:48,122][123090] Updated weights for policy 1, policy_version 1107409 (0.0010) [2023-12-26 08:29:48,171][123090] Updated weights for policy 1, policy_version 1107419 (0.0009) [2023-12-26 08:29:48,275][123091] Updated weights for policy 0, policy_version 1115287 (0.0007) [2023-12-26 08:29:48,349][123091] Updated weights for policy 0, policy_version 1115297 (0.0008) [2023-12-26 08:29:48,407][123091] Updated weights for policy 0, policy_version 1115307 (0.0010) [2023-12-26 08:29:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 569024512. Throughput: 0: 9076.9, 1: 8845.3. Samples: 569035384. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:48,785][121949] Avg episode reward: [(0, '6219.156'), (1, '5688.651')] [2023-12-26 08:29:49,035][123090] Updated weights for policy 1, policy_version 1107429 (0.0007) [2023-12-26 08:29:49,088][123090] Updated weights for policy 1, policy_version 1107439 (0.0005) [2023-12-26 08:29:49,156][123090] Updated weights for policy 1, policy_version 1107449 (0.0005) [2023-12-26 08:29:49,240][123091] Updated weights for policy 0, policy_version 1115317 (0.0009) [2023-12-26 08:29:49,308][123091] Updated weights for policy 0, policy_version 1115327 (0.0009) [2023-12-26 08:29:49,377][123091] Updated weights for policy 0, policy_version 1115337 (0.0009) [2023-12-26 08:29:49,941][123090] Updated weights for policy 1, policy_version 1107459 (0.0007) [2023-12-26 08:29:49,999][123090] Updated weights for policy 1, policy_version 1107469 (0.0009) [2023-12-26 08:29:50,061][123090] Updated weights for policy 1, policy_version 1107479 (0.0010) [2023-12-26 08:29:50,191][123091] Updated weights for policy 0, policy_version 1115347 (0.0009) [2023-12-26 08:29:50,245][123091] Updated weights for policy 0, policy_version 1115357 (0.0009) [2023-12-26 08:29:50,293][123091] Updated weights for policy 0, policy_version 1115367 (0.0009) [2023-12-26 08:29:50,923][123090] Updated weights for policy 1, policy_version 1107489 (0.0009) [2023-12-26 08:29:50,989][123090] Updated weights for policy 1, policy_version 1107499 (0.0009) [2023-12-26 08:29:51,055][123090] Updated weights for policy 1, policy_version 1107509 (0.0009) [2023-12-26 08:29:51,108][123090] Updated weights for policy 1, policy_version 1107519 (0.0009) [2023-12-26 08:29:51,137][123091] Updated weights for policy 0, policy_version 1115377 (0.0009) [2023-12-26 08:29:51,194][123091] Updated weights for policy 0, policy_version 1115387 (0.0008) [2023-12-26 08:29:51,250][123091] Updated weights for policy 0, policy_version 1115397 (0.0009) [2023-12-26 08:29:51,313][123091] Updated weights for policy 0, policy_version 1115407 (0.0010) [2023-12-26 08:29:51,873][123090] Updated weights for policy 1, policy_version 1107529 (0.0007) [2023-12-26 08:29:51,947][123090] Updated weights for policy 1, policy_version 1107539 (0.0005) [2023-12-26 08:29:52,001][123090] Updated weights for policy 1, policy_version 1107549 (0.0005) [2023-12-26 08:29:52,239][123091] Updated weights for policy 0, policy_version 1115417 (0.0011) [2023-12-26 08:29:52,316][123091] Updated weights for policy 0, policy_version 1115427 (0.0010) [2023-12-26 08:29:52,381][123091] Updated weights for policy 0, policy_version 1115437 (0.0009) [2023-12-26 08:29:52,759][123090] Updated weights for policy 1, policy_version 1107559 (0.0007) [2023-12-26 08:29:52,819][123090] Updated weights for policy 1, policy_version 1107569 (0.0009) [2023-12-26 08:29:52,876][123090] Updated weights for policy 1, policy_version 1107579 (0.0010) [2023-12-26 08:29:53,157][123091] Updated weights for policy 0, policy_version 1115447 (0.0007) [2023-12-26 08:29:53,203][123091] Updated weights for policy 0, policy_version 1115457 (0.0005) [2023-12-26 08:29:53,257][123091] Updated weights for policy 0, policy_version 1115467 (0.0005) [2023-12-26 08:29:53,779][123090] Updated weights for policy 1, policy_version 1107589 (0.0010) [2023-12-26 08:29:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 569106432. Throughput: 0: 8989.0, 1: 8840.6. Samples: 569086352. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:53,785][121949] Avg episode reward: [(0, '6079.018'), (1, '5753.536')] [2023-12-26 08:29:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001115472_285564928.pth... [2023-12-26 08:29:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001114448_285302784.pth [2023-12-26 08:29:53,842][123090] Updated weights for policy 1, policy_version 1107599 (0.0010) [2023-12-26 08:29:53,908][123090] Updated weights for policy 1, policy_version 1107609 (0.0010) [2023-12-26 08:29:53,950][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001107616_283549696.pth... [2023-12-26 08:29:53,955][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001106560_283279360.pth [2023-12-26 08:29:54,012][123091] Updated weights for policy 0, policy_version 1115477 (0.0008) [2023-12-26 08:29:54,066][123091] Updated weights for policy 0, policy_version 1115487 (0.0010) [2023-12-26 08:29:54,128][123091] Updated weights for policy 0, policy_version 1115497 (0.0009) [2023-12-26 08:29:54,749][123090] Updated weights for policy 1, policy_version 1107619 (0.0009) [2023-12-26 08:29:54,803][123090] Updated weights for policy 1, policy_version 1107629 (0.0009) [2023-12-26 08:29:54,805][123091] Updated weights for policy 0, policy_version 1115507 (0.0009) [2023-12-26 08:29:54,860][123090] Updated weights for policy 1, policy_version 1107639 (0.0007) [2023-12-26 08:29:54,869][123091] Updated weights for policy 0, policy_version 1115517 (0.0009) [2023-12-26 08:29:54,931][123091] Updated weights for policy 0, policy_version 1115527 (0.0009) [2023-12-26 08:29:55,715][123091] Updated weights for policy 0, policy_version 1115537 (0.0007) [2023-12-26 08:29:55,735][123090] Updated weights for policy 1, policy_version 1107649 (0.0008) [2023-12-26 08:29:55,778][123091] Updated weights for policy 0, policy_version 1115547 (0.0008) [2023-12-26 08:29:55,781][123090] Updated weights for policy 1, policy_version 1107659 (0.0008) [2023-12-26 08:29:55,828][123090] Updated weights for policy 1, policy_version 1107669 (0.0008) [2023-12-26 08:29:55,842][123091] Updated weights for policy 0, policy_version 1115557 (0.0008) [2023-12-26 08:29:55,881][123090] Updated weights for policy 1, policy_version 1107679 (0.0009) [2023-12-26 08:29:55,904][123091] Updated weights for policy 0, policy_version 1115567 (0.0008) [2023-12-26 08:29:56,555][123091] Updated weights for policy 0, policy_version 1115577 (0.0005) [2023-12-26 08:29:56,618][123091] Updated weights for policy 0, policy_version 1115587 (0.0008) [2023-12-26 08:29:56,669][123091] Updated weights for policy 0, policy_version 1115597 (0.0009) [2023-12-26 08:29:56,829][123090] Updated weights for policy 1, policy_version 1107689 (0.0010) [2023-12-26 08:29:56,888][123090] Updated weights for policy 1, policy_version 1107699 (0.0009) [2023-12-26 08:29:56,939][123090] Updated weights for policy 1, policy_version 1107710 (0.0009) [2023-12-26 08:29:57,430][123091] Updated weights for policy 0, policy_version 1115607 (0.0006) [2023-12-26 08:29:57,485][123091] Updated weights for policy 0, policy_version 1115617 (0.0005) [2023-12-26 08:29:57,547][123091] Updated weights for policy 0, policy_version 1115627 (0.0005) [2023-12-26 08:29:57,852][123090] Updated weights for policy 1, policy_version 1107720 (0.0009) [2023-12-26 08:29:57,916][123090] Updated weights for policy 1, policy_version 1107730 (0.0009) [2023-12-26 08:29:57,974][123090] Updated weights for policy 1, policy_version 1107740 (0.0008) [2023-12-26 08:29:58,209][123091] Updated weights for policy 0, policy_version 1115637 (0.0007) [2023-12-26 08:29:58,285][123091] Updated weights for policy 0, policy_version 1115647 (0.0008) [2023-12-26 08:29:58,357][123091] Updated weights for policy 0, policy_version 1115657 (0.0009) [2023-12-26 08:29:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 569196544. Throughput: 0: 9033.3, 1: 8798.8. Samples: 569192948. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:29:58,785][121949] Avg episode reward: [(0, '5951.979'), (1, '5848.330')] [2023-12-26 08:29:58,818][123090] Updated weights for policy 1, policy_version 1107750 (0.0008) [2023-12-26 08:29:58,886][123090] Updated weights for policy 1, policy_version 1107760 (0.0008) [2023-12-26 08:29:58,945][123090] Updated weights for policy 1, policy_version 1107770 (0.0006) [2023-12-26 08:29:59,230][123091] Updated weights for policy 0, policy_version 1115667 (0.0010) [2023-12-26 08:29:59,290][123091] Updated weights for policy 0, policy_version 1115677 (0.0010) [2023-12-26 08:29:59,350][123091] Updated weights for policy 0, policy_version 1115687 (0.0010) [2023-12-26 08:29:59,664][123090] Updated weights for policy 1, policy_version 1107780 (0.0007) [2023-12-26 08:29:59,728][123090] Updated weights for policy 1, policy_version 1107790 (0.0005) [2023-12-26 08:29:59,793][123090] Updated weights for policy 1, policy_version 1107800 (0.0006) [2023-12-26 08:30:00,183][123091] Updated weights for policy 0, policy_version 1115697 (0.0010) [2023-12-26 08:30:00,234][123091] Updated weights for policy 0, policy_version 1115707 (0.0009) [2023-12-26 08:30:00,281][123091] Updated weights for policy 0, policy_version 1115717 (0.0009) [2023-12-26 08:30:00,330][123091] Updated weights for policy 0, policy_version 1115727 (0.0009) [2023-12-26 08:30:00,587][123090] Updated weights for policy 1, policy_version 1107810 (0.0010) [2023-12-26 08:30:00,643][123090] Updated weights for policy 1, policy_version 1107820 (0.0009) [2023-12-26 08:30:00,693][123090] Updated weights for policy 1, policy_version 1107830 (0.0009) [2023-12-26 08:30:00,748][123090] Updated weights for policy 1, policy_version 1107840 (0.0009) [2023-12-26 08:30:01,200][123091] Updated weights for policy 0, policy_version 1115737 (0.0008) [2023-12-26 08:30:01,264][123091] Updated weights for policy 0, policy_version 1115747 (0.0007) [2023-12-26 08:30:01,321][123091] Updated weights for policy 0, policy_version 1115757 (0.0010) [2023-12-26 08:30:01,592][123090] Updated weights for policy 1, policy_version 1107850 (0.0005) [2023-12-26 08:30:01,656][123090] Updated weights for policy 1, policy_version 1107860 (0.0009) [2023-12-26 08:30:01,719][123090] Updated weights for policy 1, policy_version 1107870 (0.0009) [2023-12-26 08:30:02,129][123091] Updated weights for policy 0, policy_version 1115767 (0.0009) [2023-12-26 08:30:02,202][123091] Updated weights for policy 0, policy_version 1115777 (0.0010) [2023-12-26 08:30:02,275][123091] Updated weights for policy 0, policy_version 1115787 (0.0009) [2023-12-26 08:30:02,514][123090] Updated weights for policy 1, policy_version 1107880 (0.0008) [2023-12-26 08:30:02,586][123090] Updated weights for policy 1, policy_version 1107890 (0.0005) [2023-12-26 08:30:02,646][123090] Updated weights for policy 1, policy_version 1107900 (0.0007) [2023-12-26 08:30:03,097][123091] Updated weights for policy 0, policy_version 1115797 (0.0010) [2023-12-26 08:30:03,159][123091] Updated weights for policy 0, policy_version 1115807 (0.0010) [2023-12-26 08:30:03,222][123091] Updated weights for policy 0, policy_version 1115817 (0.0009) [2023-12-26 08:30:03,336][123090] Updated weights for policy 1, policy_version 1107910 (0.0008) [2023-12-26 08:30:03,385][123090] Updated weights for policy 1, policy_version 1107920 (0.0009) [2023-12-26 08:30:03,441][123090] Updated weights for policy 1, policy_version 1107930 (0.0009) [2023-12-26 08:30:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 569286656. Throughput: 0: 8956.4, 1: 8725.1. Samples: 569297520. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:03,785][121949] Avg episode reward: [(0, '6005.661'), (1, '5914.760')] [2023-12-26 08:30:03,992][123091] Updated weights for policy 0, policy_version 1115827 (0.0008) [2023-12-26 08:30:04,054][123091] Updated weights for policy 0, policy_version 1115837 (0.0006) [2023-12-26 08:30:04,119][123091] Updated weights for policy 0, policy_version 1115847 (0.0006) [2023-12-26 08:30:04,359][123090] Updated weights for policy 1, policy_version 1107940 (0.0008) [2023-12-26 08:30:04,429][123090] Updated weights for policy 1, policy_version 1107950 (0.0006) [2023-12-26 08:30:04,490][123090] Updated weights for policy 1, policy_version 1107960 (0.0009) [2023-12-26 08:30:04,867][123091] Updated weights for policy 0, policy_version 1115857 (0.0006) [2023-12-26 08:30:04,911][123091] Updated weights for policy 0, policy_version 1115867 (0.0007) [2023-12-26 08:30:04,959][123091] Updated weights for policy 0, policy_version 1115877 (0.0008) [2023-12-26 08:30:05,006][123091] Updated weights for policy 0, policy_version 1115887 (0.0007) [2023-12-26 08:30:05,295][123090] Updated weights for policy 1, policy_version 1107970 (0.0009) [2023-12-26 08:30:05,351][123090] Updated weights for policy 1, policy_version 1107980 (0.0008) [2023-12-26 08:30:05,400][123090] Updated weights for policy 1, policy_version 1107990 (0.0009) [2023-12-26 08:30:05,450][123090] Updated weights for policy 1, policy_version 1108000 (0.0009) [2023-12-26 08:30:05,823][123091] Updated weights for policy 0, policy_version 1115897 (0.0006) [2023-12-26 08:30:05,880][123091] Updated weights for policy 0, policy_version 1115907 (0.0008) [2023-12-26 08:30:05,935][123091] Updated weights for policy 0, policy_version 1115917 (0.0009) [2023-12-26 08:30:06,350][123090] Updated weights for policy 1, policy_version 1108010 (0.0011) [2023-12-26 08:30:06,417][123090] Updated weights for policy 1, policy_version 1108020 (0.0011) [2023-12-26 08:30:06,481][123090] Updated weights for policy 1, policy_version 1108030 (0.0011) [2023-12-26 08:30:06,788][123091] Updated weights for policy 0, policy_version 1115927 (0.0010) [2023-12-26 08:30:06,859][123091] Updated weights for policy 0, policy_version 1115937 (0.0011) [2023-12-26 08:30:06,930][123091] Updated weights for policy 0, policy_version 1115947 (0.0011) [2023-12-26 08:30:07,305][123090] Updated weights for policy 1, policy_version 1108040 (0.0006) [2023-12-26 08:30:07,376][123090] Updated weights for policy 1, policy_version 1108050 (0.0005) [2023-12-26 08:30:07,432][123090] Updated weights for policy 1, policy_version 1108060 (0.0005) [2023-12-26 08:30:07,687][123091] Updated weights for policy 0, policy_version 1115957 (0.0008) [2023-12-26 08:30:07,750][123091] Updated weights for policy 0, policy_version 1115967 (0.0005) [2023-12-26 08:30:07,805][123091] Updated weights for policy 0, policy_version 1115977 (0.0005) [2023-12-26 08:30:08,095][123090] Updated weights for policy 1, policy_version 1108070 (0.0006) [2023-12-26 08:30:08,150][123090] Updated weights for policy 1, policy_version 1108080 (0.0005) [2023-12-26 08:30:08,204][123090] Updated weights for policy 1, policy_version 1108090 (0.0005) [2023-12-26 08:30:08,606][123091] Updated weights for policy 0, policy_version 1115987 (0.0006) [2023-12-26 08:30:08,666][123091] Updated weights for policy 0, policy_version 1115997 (0.0009) [2023-12-26 08:30:08,725][123091] Updated weights for policy 0, policy_version 1116007 (0.0009) [2023-12-26 08:30:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 569376768. Throughput: 0: 8980.2, 1: 8721.1. Samples: 569349400. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:08,785][121949] Avg episode reward: [(0, '6022.131'), (1, '5888.795')] [2023-12-26 08:30:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001108096_283672576.pth... [2023-12-26 08:30:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001116016_285704192.pth... [2023-12-26 08:30:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001114960_285433856.pth [2023-12-26 08:30:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001107104_283418624.pth [2023-12-26 08:30:08,991][123090] Updated weights for policy 1, policy_version 1108100 (0.0007) [2023-12-26 08:30:09,059][123090] Updated weights for policy 1, policy_version 1108110 (0.0011) [2023-12-26 08:30:09,115][123090] Updated weights for policy 1, policy_version 1108120 (0.0010) [2023-12-26 08:30:09,543][123091] Updated weights for policy 0, policy_version 1116017 (0.0009) [2023-12-26 08:30:09,608][123091] Updated weights for policy 0, policy_version 1116027 (0.0008) [2023-12-26 08:30:09,657][123091] Updated weights for policy 0, policy_version 1116037 (0.0009) [2023-12-26 08:30:09,714][123091] Updated weights for policy 0, policy_version 1116047 (0.0009) [2023-12-26 08:30:09,962][123090] Updated weights for policy 1, policy_version 1108130 (0.0010) [2023-12-26 08:30:10,036][123090] Updated weights for policy 1, policy_version 1108140 (0.0011) [2023-12-26 08:30:10,096][123090] Updated weights for policy 1, policy_version 1108150 (0.0011) [2023-12-26 08:30:10,156][123090] Updated weights for policy 1, policy_version 1108160 (0.0010) [2023-12-26 08:30:10,534][123091] Updated weights for policy 0, policy_version 1116057 (0.0006) [2023-12-26 08:30:10,590][123091] Updated weights for policy 0, policy_version 1116067 (0.0006) [2023-12-26 08:30:10,655][123091] Updated weights for policy 0, policy_version 1116077 (0.0006) [2023-12-26 08:30:10,984][123090] Updated weights for policy 1, policy_version 1108170 (0.0010) [2023-12-26 08:30:11,055][123090] Updated weights for policy 1, policy_version 1108180 (0.0011) [2023-12-26 08:30:11,124][123090] Updated weights for policy 1, policy_version 1108190 (0.0009) [2023-12-26 08:30:11,437][123091] Updated weights for policy 0, policy_version 1116087 (0.0009) [2023-12-26 08:30:11,492][123091] Updated weights for policy 0, policy_version 1116097 (0.0010) [2023-12-26 08:30:11,546][123091] Updated weights for policy 0, policy_version 1116107 (0.0010) [2023-12-26 08:30:11,966][123090] Updated weights for policy 1, policy_version 1108200 (0.0008) [2023-12-26 08:30:12,022][123090] Updated weights for policy 1, policy_version 1108210 (0.0006) [2023-12-26 08:30:12,086][123090] Updated weights for policy 1, policy_version 1108220 (0.0010) [2023-12-26 08:30:12,497][123091] Updated weights for policy 0, policy_version 1116117 (0.0010) [2023-12-26 08:30:12,555][123091] Updated weights for policy 0, policy_version 1116127 (0.0008) [2023-12-26 08:30:12,612][123091] Updated weights for policy 0, policy_version 1116138 (0.0010) [2023-12-26 08:30:12,895][123090] Updated weights for policy 1, policy_version 1108230 (0.0009) [2023-12-26 08:30:12,960][123090] Updated weights for policy 1, policy_version 1108240 (0.0008) [2023-12-26 08:30:13,024][123090] Updated weights for policy 1, policy_version 1108250 (0.0008) [2023-12-26 08:30:13,367][123091] Updated weights for policy 0, policy_version 1116148 (0.0008) [2023-12-26 08:30:13,413][123091] Updated weights for policy 0, policy_version 1116158 (0.0005) [2023-12-26 08:30:13,469][123091] Updated weights for policy 0, policy_version 1116168 (0.0008) [2023-12-26 08:30:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 569458688. Throughput: 0: 8882.4, 1: 8746.4. Samples: 569453572. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:13,785][121949] Avg episode reward: [(0, '5976.928'), (1, '5887.051')] [2023-12-26 08:30:13,832][123090] Updated weights for policy 1, policy_version 1108260 (0.0008) [2023-12-26 08:30:13,887][123090] Updated weights for policy 1, policy_version 1108270 (0.0005) [2023-12-26 08:30:13,951][123090] Updated weights for policy 1, policy_version 1108280 (0.0005) [2023-12-26 08:30:14,233][123091] Updated weights for policy 0, policy_version 1116178 (0.0009) [2023-12-26 08:30:14,298][123091] Updated weights for policy 0, policy_version 1116188 (0.0011) [2023-12-26 08:30:14,364][123091] Updated weights for policy 0, policy_version 1116198 (0.0008) [2023-12-26 08:30:14,425][123091] Updated weights for policy 0, policy_version 1116208 (0.0006) [2023-12-26 08:30:14,753][123090] Updated weights for policy 1, policy_version 1108290 (0.0006) [2023-12-26 08:30:14,825][123090] Updated weights for policy 1, policy_version 1108300 (0.0009) [2023-12-26 08:30:14,899][123090] Updated weights for policy 1, policy_version 1108310 (0.0009) [2023-12-26 08:30:14,971][123090] Updated weights for policy 1, policy_version 1108320 (0.0010) [2023-12-26 08:30:15,153][123091] Updated weights for policy 0, policy_version 1116218 (0.0008) [2023-12-26 08:30:15,224][123091] Updated weights for policy 0, policy_version 1116228 (0.0010) [2023-12-26 08:30:15,287][123091] Updated weights for policy 0, policy_version 1116238 (0.0009) [2023-12-26 08:30:15,790][123090] Updated weights for policy 1, policy_version 1108330 (0.0009) [2023-12-26 08:30:15,846][123090] Updated weights for policy 1, policy_version 1108340 (0.0009) [2023-12-26 08:30:15,906][123090] Updated weights for policy 1, policy_version 1108350 (0.0009) [2023-12-26 08:30:16,120][123091] Updated weights for policy 0, policy_version 1116248 (0.0010) [2023-12-26 08:30:16,177][123091] Updated weights for policy 0, policy_version 1116258 (0.0010) [2023-12-26 08:30:16,227][123091] Updated weights for policy 0, policy_version 1116268 (0.0009) [2023-12-26 08:30:16,640][123090] Updated weights for policy 1, policy_version 1108360 (0.0007) [2023-12-26 08:30:16,700][123090] Updated weights for policy 1, policy_version 1108370 (0.0005) [2023-12-26 08:30:16,769][123090] Updated weights for policy 1, policy_version 1108380 (0.0005) [2023-12-26 08:30:17,144][123091] Updated weights for policy 0, policy_version 1116278 (0.0009) [2023-12-26 08:30:17,199][123091] Updated weights for policy 0, policy_version 1116288 (0.0009) [2023-12-26 08:30:17,265][123091] Updated weights for policy 0, policy_version 1116298 (0.0009) [2023-12-26 08:30:17,481][123090] Updated weights for policy 1, policy_version 1108390 (0.0005) [2023-12-26 08:30:17,562][123090] Updated weights for policy 1, policy_version 1108400 (0.0005) [2023-12-26 08:30:17,633][123090] Updated weights for policy 1, policy_version 1108410 (0.0005) [2023-12-26 08:30:18,141][123091] Updated weights for policy 0, policy_version 1116308 (0.0010) [2023-12-26 08:30:18,192][123091] Updated weights for policy 0, policy_version 1116318 (0.0009) [2023-12-26 08:30:18,249][123091] Updated weights for policy 0, policy_version 1116328 (0.0009) [2023-12-26 08:30:18,309][123090] Updated weights for policy 1, policy_version 1108420 (0.0008) [2023-12-26 08:30:18,371][123090] Updated weights for policy 1, policy_version 1108430 (0.0008) [2023-12-26 08:30:18,426][123090] Updated weights for policy 1, policy_version 1108440 (0.0006) [2023-12-26 08:30:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 569548800. Throughput: 0: 8885.7, 1: 8736.9. Samples: 569559200. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:18,784][121949] Avg episode reward: [(0, '6174.487'), (1, '5868.225')] [2023-12-26 08:30:19,128][123091] Updated weights for policy 0, policy_version 1116338 (0.0009) [2023-12-26 08:30:19,158][123090] Updated weights for policy 1, policy_version 1108450 (0.0007) [2023-12-26 08:30:19,183][123091] Updated weights for policy 0, policy_version 1116348 (0.0009) [2023-12-26 08:30:19,219][123090] Updated weights for policy 1, policy_version 1108461 (0.0006) [2023-12-26 08:30:19,250][123091] Updated weights for policy 0, policy_version 1116358 (0.0008) [2023-12-26 08:30:19,288][123090] Updated weights for policy 1, policy_version 1108471 (0.0009) [2023-12-26 08:30:19,326][123091] Updated weights for policy 0, policy_version 1116368 (0.0008) [2023-12-26 08:30:20,149][123091] Updated weights for policy 0, policy_version 1116378 (0.0008) [2023-12-26 08:30:20,201][123090] Updated weights for policy 1, policy_version 1108481 (0.0010) [2023-12-26 08:30:20,213][123091] Updated weights for policy 0, policy_version 1116388 (0.0008) [2023-12-26 08:30:20,258][123090] Updated weights for policy 1, policy_version 1108491 (0.0011) [2023-12-26 08:30:20,276][123091] Updated weights for policy 0, policy_version 1116398 (0.0008) [2023-12-26 08:30:20,312][123090] Updated weights for policy 1, policy_version 1108501 (0.0011) [2023-12-26 08:30:20,375][123090] Updated weights for policy 1, policy_version 1108511 (0.0011) [2023-12-26 08:30:21,087][123091] Updated weights for policy 0, policy_version 1116408 (0.0009) [2023-12-26 08:30:21,153][123091] Updated weights for policy 0, policy_version 1116418 (0.0009) [2023-12-26 08:30:21,221][123091] Updated weights for policy 0, policy_version 1116428 (0.0009) [2023-12-26 08:30:21,280][123090] Updated weights for policy 1, policy_version 1108521 (0.0010) [2023-12-26 08:30:21,349][123090] Updated weights for policy 1, policy_version 1108531 (0.0010) [2023-12-26 08:30:21,418][123090] Updated weights for policy 1, policy_version 1108541 (0.0012) [2023-12-26 08:30:22,120][123091] Updated weights for policy 0, policy_version 1116438 (0.0008) [2023-12-26 08:30:22,193][123091] Updated weights for policy 0, policy_version 1116448 (0.0010) [2023-12-26 08:30:22,262][123091] Updated weights for policy 0, policy_version 1116458 (0.0008) [2023-12-26 08:30:22,284][123090] Updated weights for policy 1, policy_version 1108551 (0.0009) [2023-12-26 08:30:22,364][123090] Updated weights for policy 1, policy_version 1108561 (0.0009) [2023-12-26 08:30:22,434][123090] Updated weights for policy 1, policy_version 1108571 (0.0009) [2023-12-26 08:30:23,031][123091] Updated weights for policy 0, policy_version 1116468 (0.0009) [2023-12-26 08:30:23,087][123091] Updated weights for policy 0, policy_version 1116478 (0.0009) [2023-12-26 08:30:23,148][123091] Updated weights for policy 0, policy_version 1116488 (0.0009) [2023-12-26 08:30:23,279][123090] Updated weights for policy 1, policy_version 1108581 (0.0009) [2023-12-26 08:30:23,334][123090] Updated weights for policy 1, policy_version 1108591 (0.0010) [2023-12-26 08:30:23,397][123090] Updated weights for policy 1, policy_version 1108601 (0.0010) [2023-12-26 08:30:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 569630720. Throughput: 0: 8854.0, 1: 8695.5. Samples: 569608872. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:23,785][121949] Avg episode reward: [(0, '6135.962'), (1, '5834.338')] [2023-12-26 08:30:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001116496_285827072.pth... [2023-12-26 08:30:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001108608_283803648.pth... [2023-12-26 08:30:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001107616_283549696.pth [2023-12-26 08:30:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001115472_285564928.pth [2023-12-26 08:30:23,905][123091] Updated weights for policy 0, policy_version 1116498 (0.0008) [2023-12-26 08:30:23,956][123091] Updated weights for policy 0, policy_version 1116508 (0.0005) [2023-12-26 08:30:24,010][123091] Updated weights for policy 0, policy_version 1116518 (0.0006) [2023-12-26 08:30:24,072][123091] Updated weights for policy 0, policy_version 1116528 (0.0006) [2023-12-26 08:30:24,311][123090] Updated weights for policy 1, policy_version 1108611 (0.0010) [2023-12-26 08:30:24,374][123090] Updated weights for policy 1, policy_version 1108621 (0.0009) [2023-12-26 08:30:24,437][123090] Updated weights for policy 1, policy_version 1108631 (0.0008) [2023-12-26 08:30:24,736][123091] Updated weights for policy 0, policy_version 1116538 (0.0011) [2023-12-26 08:30:24,805][123091] Updated weights for policy 0, policy_version 1116548 (0.0011) [2023-12-26 08:30:24,865][123091] Updated weights for policy 0, policy_version 1116558 (0.0011) [2023-12-26 08:30:25,240][123090] Updated weights for policy 1, policy_version 1108641 (0.0006) [2023-12-26 08:30:25,306][123090] Updated weights for policy 1, policy_version 1108651 (0.0009) [2023-12-26 08:30:25,358][123090] Updated weights for policy 1, policy_version 1108661 (0.0008) [2023-12-26 08:30:25,406][123090] Updated weights for policy 1, policy_version 1108671 (0.0009) [2023-12-26 08:30:25,690][123091] Updated weights for policy 0, policy_version 1116568 (0.0010) [2023-12-26 08:30:25,737][123091] Updated weights for policy 0, policy_version 1116578 (0.0010) [2023-12-26 08:30:25,784][123091] Updated weights for policy 0, policy_version 1116588 (0.0010) [2023-12-26 08:30:26,212][123090] Updated weights for policy 1, policy_version 1108681 (0.0006) [2023-12-26 08:30:26,263][123090] Updated weights for policy 1, policy_version 1108691 (0.0005) [2023-12-26 08:30:26,308][123090] Updated weights for policy 1, policy_version 1108701 (0.0005) [2023-12-26 08:30:26,532][123091] Updated weights for policy 0, policy_version 1116598 (0.0007) [2023-12-26 08:30:26,578][123091] Updated weights for policy 0, policy_version 1116608 (0.0005) [2023-12-26 08:30:26,630][123091] Updated weights for policy 0, policy_version 1116618 (0.0005) [2023-12-26 08:30:26,975][123090] Updated weights for policy 1, policy_version 1108711 (0.0005) [2023-12-26 08:30:27,024][123090] Updated weights for policy 1, policy_version 1108721 (0.0005) [2023-12-26 08:30:27,068][123090] Updated weights for policy 1, policy_version 1108731 (0.0005) [2023-12-26 08:30:27,398][123091] Updated weights for policy 0, policy_version 1116628 (0.0007) [2023-12-26 08:30:27,448][123091] Updated weights for policy 0, policy_version 1116638 (0.0010) [2023-12-26 08:30:27,506][123091] Updated weights for policy 0, policy_version 1116648 (0.0010) [2023-12-26 08:30:27,703][123090] Updated weights for policy 1, policy_version 1108741 (0.0005) [2023-12-26 08:30:27,771][123090] Updated weights for policy 1, policy_version 1108751 (0.0005) [2023-12-26 08:30:27,846][123090] Updated weights for policy 1, policy_version 1108761 (0.0005) [2023-12-26 08:30:28,250][123091] Updated weights for policy 0, policy_version 1116658 (0.0009) [2023-12-26 08:30:28,302][123091] Updated weights for policy 0, policy_version 1116668 (0.0005) [2023-12-26 08:30:28,364][123091] Updated weights for policy 0, policy_version 1116678 (0.0007) [2023-12-26 08:30:28,437][123091] Updated weights for policy 0, policy_version 1116688 (0.0006) [2023-12-26 08:30:28,535][123090] Updated weights for policy 1, policy_version 1108771 (0.0008) [2023-12-26 08:30:28,601][123090] Updated weights for policy 1, policy_version 1108781 (0.0005) [2023-12-26 08:30:28,652][123090] Updated weights for policy 1, policy_version 1108791 (0.0005) [2023-12-26 08:30:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 569729024. Throughput: 0: 8895.6, 1: 8680.8. Samples: 569716528. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:28,784][121949] Avg episode reward: [(0, '6195.524'), (1, '5963.558')] [2023-12-26 08:30:29,186][123091] Updated weights for policy 0, policy_version 1116698 (0.0006) [2023-12-26 08:30:29,251][123091] Updated weights for policy 0, policy_version 1116708 (0.0007) [2023-12-26 08:30:29,305][123091] Updated weights for policy 0, policy_version 1116718 (0.0008) [2023-12-26 08:30:29,433][123090] Updated weights for policy 1, policy_version 1108801 (0.0006) [2023-12-26 08:30:29,496][123090] Updated weights for policy 1, policy_version 1108811 (0.0010) [2023-12-26 08:30:29,558][123090] Updated weights for policy 1, policy_version 1108821 (0.0010) [2023-12-26 08:30:29,620][123090] Updated weights for policy 1, policy_version 1108831 (0.0010) [2023-12-26 08:30:30,058][123091] Updated weights for policy 0, policy_version 1116728 (0.0009) [2023-12-26 08:30:30,125][123091] Updated weights for policy 0, policy_version 1116738 (0.0007) [2023-12-26 08:30:30,195][123091] Updated weights for policy 0, policy_version 1116748 (0.0009) [2023-12-26 08:30:30,361][123090] Updated weights for policy 1, policy_version 1108841 (0.0006) [2023-12-26 08:30:30,419][123090] Updated weights for policy 1, policy_version 1108851 (0.0005) [2023-12-26 08:30:30,484][123090] Updated weights for policy 1, policy_version 1108861 (0.0005) [2023-12-26 08:30:30,937][123091] Updated weights for policy 0, policy_version 1116758 (0.0009) [2023-12-26 08:30:30,985][123091] Updated weights for policy 0, policy_version 1116768 (0.0009) [2023-12-26 08:30:31,051][123091] Updated weights for policy 0, policy_version 1116778 (0.0009) [2023-12-26 08:30:31,258][123090] Updated weights for policy 1, policy_version 1108871 (0.0009) [2023-12-26 08:30:31,317][123090] Updated weights for policy 1, policy_version 1108881 (0.0010) [2023-12-26 08:30:31,382][123090] Updated weights for policy 1, policy_version 1108891 (0.0011) [2023-12-26 08:30:31,899][123091] Updated weights for policy 0, policy_version 1116788 (0.0010) [2023-12-26 08:30:31,958][123091] Updated weights for policy 0, policy_version 1116798 (0.0011) [2023-12-26 08:30:32,009][123091] Updated weights for policy 0, policy_version 1116808 (0.0010) [2023-12-26 08:30:32,153][123090] Updated weights for policy 1, policy_version 1108901 (0.0010) [2023-12-26 08:30:32,212][123090] Updated weights for policy 1, policy_version 1108911 (0.0008) [2023-12-26 08:30:32,286][123090] Updated weights for policy 1, policy_version 1108921 (0.0009) [2023-12-26 08:30:32,822][123091] Updated weights for policy 0, policy_version 1116818 (0.0009) [2023-12-26 08:30:32,886][123091] Updated weights for policy 0, policy_version 1116828 (0.0010) [2023-12-26 08:30:32,952][123091] Updated weights for policy 0, policy_version 1116838 (0.0010) [2023-12-26 08:30:33,006][123091] Updated weights for policy 0, policy_version 1116848 (0.0011) [2023-12-26 08:30:33,101][123090] Updated weights for policy 1, policy_version 1108931 (0.0009) [2023-12-26 08:30:33,157][123090] Updated weights for policy 1, policy_version 1108941 (0.0006) [2023-12-26 08:30:33,211][123090] Updated weights for policy 1, policy_version 1108951 (0.0005) [2023-12-26 08:30:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 569810944. Throughput: 0: 8823.1, 1: 8766.3. Samples: 569826908. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:33,785][121949] Avg episode reward: [(0, '6253.955'), (1, '5995.723')] [2023-12-26 08:30:33,807][123091] Updated weights for policy 0, policy_version 1116858 (0.0010) [2023-12-26 08:30:33,849][123091] Updated weights for policy 0, policy_version 1116868 (0.0010) [2023-12-26 08:30:33,887][123090] Updated weights for policy 1, policy_version 1108961 (0.0006) [2023-12-26 08:30:33,900][123091] Updated weights for policy 0, policy_version 1116878 (0.0010) [2023-12-26 08:30:33,941][123090] Updated weights for policy 1, policy_version 1108971 (0.0008) [2023-12-26 08:30:33,991][123090] Updated weights for policy 1, policy_version 1108981 (0.0007) [2023-12-26 08:30:34,043][123090] Updated weights for policy 1, policy_version 1108991 (0.0008) [2023-12-26 08:30:34,797][123091] Updated weights for policy 0, policy_version 1116888 (0.0007) [2023-12-26 08:30:34,855][123091] Updated weights for policy 0, policy_version 1116898 (0.0006) [2023-12-26 08:30:34,927][123091] Updated weights for policy 0, policy_version 1116908 (0.0006) [2023-12-26 08:30:34,933][123090] Updated weights for policy 1, policy_version 1109001 (0.0009) [2023-12-26 08:30:35,001][123090] Updated weights for policy 1, policy_version 1109011 (0.0009) [2023-12-26 08:30:35,057][123090] Updated weights for policy 1, policy_version 1109021 (0.0009) [2023-12-26 08:30:35,630][123091] Updated weights for policy 0, policy_version 1116918 (0.0008) [2023-12-26 08:30:35,688][123091] Updated weights for policy 0, policy_version 1116928 (0.0005) [2023-12-26 08:30:35,743][123091] Updated weights for policy 0, policy_version 1116938 (0.0005) [2023-12-26 08:30:35,868][123090] Updated weights for policy 1, policy_version 1109031 (0.0008) [2023-12-26 08:30:35,919][123090] Updated weights for policy 1, policy_version 1109041 (0.0010) [2023-12-26 08:30:35,970][123090] Updated weights for policy 1, policy_version 1109051 (0.0010) [2023-12-26 08:30:36,528][123091] Updated weights for policy 0, policy_version 1116948 (0.0007) [2023-12-26 08:30:36,604][123091] Updated weights for policy 0, policy_version 1116958 (0.0008) [2023-12-26 08:30:36,673][123091] Updated weights for policy 0, policy_version 1116968 (0.0010) [2023-12-26 08:30:36,719][123090] Updated weights for policy 1, policy_version 1109061 (0.0008) [2023-12-26 08:30:36,790][123090] Updated weights for policy 1, policy_version 1109071 (0.0005) [2023-12-26 08:30:36,853][123090] Updated weights for policy 1, policy_version 1109081 (0.0009) [2023-12-26 08:30:37,435][123091] Updated weights for policy 0, policy_version 1116978 (0.0008) [2023-12-26 08:30:37,491][123091] Updated weights for policy 0, policy_version 1116988 (0.0010) [2023-12-26 08:30:37,544][123091] Updated weights for policy 0, policy_version 1116998 (0.0008) [2023-12-26 08:30:37,547][123090] Updated weights for policy 1, policy_version 1109091 (0.0010) [2023-12-26 08:30:37,608][123091] Updated weights for policy 0, policy_version 1117008 (0.0011) [2023-12-26 08:30:37,616][123090] Updated weights for policy 1, policy_version 1109101 (0.0006) [2023-12-26 08:30:37,673][123090] Updated weights for policy 1, policy_version 1109111 (0.0009) [2023-12-26 08:30:38,341][123091] Updated weights for policy 0, policy_version 1117018 (0.0007) [2023-12-26 08:30:38,404][123091] Updated weights for policy 0, policy_version 1117028 (0.0007) [2023-12-26 08:30:38,472][123091] Updated weights for policy 0, policy_version 1117038 (0.0006) [2023-12-26 08:30:38,481][123090] Updated weights for policy 1, policy_version 1109121 (0.0010) [2023-12-26 08:30:38,543][123090] Updated weights for policy 1, policy_version 1109131 (0.0008) [2023-12-26 08:30:38,594][123090] Updated weights for policy 1, policy_version 1109141 (0.0008) [2023-12-26 08:30:38,651][123090] Updated weights for policy 1, policy_version 1109151 (0.0005) [2023-12-26 08:30:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 569909248. Throughput: 0: 8859.9, 1: 8783.1. Samples: 569880288. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:38,785][121949] Avg episode reward: [(0, '6280.290'), (1, '6002.090')] [2023-12-26 08:30:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001109152_283942912.pth... [2023-12-26 08:30:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001117040_285966336.pth... [2023-12-26 08:30:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001108096_283672576.pth [2023-12-26 08:30:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001116016_285704192.pth [2023-12-26 08:30:39,275][123091] Updated weights for policy 0, policy_version 1117048 (0.0009) [2023-12-26 08:30:39,332][123091] Updated weights for policy 0, policy_version 1117058 (0.0010) [2023-12-26 08:30:39,397][123091] Updated weights for policy 0, policy_version 1117068 (0.0008) [2023-12-26 08:30:39,401][123090] Updated weights for policy 1, policy_version 1109161 (0.0008) [2023-12-26 08:30:39,459][123090] Updated weights for policy 1, policy_version 1109171 (0.0010) [2023-12-26 08:30:39,511][123090] Updated weights for policy 1, policy_version 1109181 (0.0010) [2023-12-26 08:30:40,197][123091] Updated weights for policy 0, policy_version 1117078 (0.0011) [2023-12-26 08:30:40,253][123091] Updated weights for policy 0, policy_version 1117088 (0.0011) [2023-12-26 08:30:40,312][123091] Updated weights for policy 0, policy_version 1117098 (0.0008) [2023-12-26 08:30:40,369][123090] Updated weights for policy 1, policy_version 1109191 (0.0011) [2023-12-26 08:30:40,433][123090] Updated weights for policy 1, policy_version 1109201 (0.0011) [2023-12-26 08:30:40,501][123090] Updated weights for policy 1, policy_version 1109211 (0.0011) [2023-12-26 08:30:41,046][123091] Updated weights for policy 0, policy_version 1117108 (0.0008) [2023-12-26 08:30:41,104][123091] Updated weights for policy 0, policy_version 1117118 (0.0006) [2023-12-26 08:30:41,176][123091] Updated weights for policy 0, policy_version 1117128 (0.0007) [2023-12-26 08:30:41,348][123090] Updated weights for policy 1, policy_version 1109221 (0.0010) [2023-12-26 08:30:41,421][123090] Updated weights for policy 1, policy_version 1109231 (0.0008) [2023-12-26 08:30:41,483][123090] Updated weights for policy 1, policy_version 1109241 (0.0006) [2023-12-26 08:30:42,010][123091] Updated weights for policy 0, policy_version 1117138 (0.0011) [2023-12-26 08:30:42,073][123091] Updated weights for policy 0, policy_version 1117148 (0.0009) [2023-12-26 08:30:42,140][123091] Updated weights for policy 0, policy_version 1117158 (0.0006) [2023-12-26 08:30:42,209][123091] Updated weights for policy 0, policy_version 1117168 (0.0005) [2023-12-26 08:30:42,255][123090] Updated weights for policy 1, policy_version 1109251 (0.0008) [2023-12-26 08:30:42,329][123090] Updated weights for policy 1, policy_version 1109261 (0.0008) [2023-12-26 08:30:42,395][123090] Updated weights for policy 1, policy_version 1109271 (0.0007) [2023-12-26 08:30:43,045][123091] Updated weights for policy 0, policy_version 1117178 (0.0010) [2023-12-26 08:30:43,106][123091] Updated weights for policy 0, policy_version 1117188 (0.0010) [2023-12-26 08:30:43,109][123090] Updated weights for policy 1, policy_version 1109281 (0.0006) [2023-12-26 08:30:43,170][123091] Updated weights for policy 0, policy_version 1117198 (0.0009) [2023-12-26 08:30:43,176][123090] Updated weights for policy 1, policy_version 1109291 (0.0007) [2023-12-26 08:30:43,244][123090] Updated weights for policy 1, policy_version 1109301 (0.0007) [2023-12-26 08:30:43,304][123090] Updated weights for policy 1, policy_version 1109311 (0.0006) [2023-12-26 08:30:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 569991168. Throughput: 0: 8774.2, 1: 8851.9. Samples: 569986120. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:43,784][121949] Avg episode reward: [(0, '6203.245'), (1, '5954.940')] [2023-12-26 08:30:44,023][123090] Updated weights for policy 1, policy_version 1109321 (0.0009) [2023-12-26 08:30:44,029][123091] Updated weights for policy 0, policy_version 1117208 (0.0008) [2023-12-26 08:30:44,069][123090] Updated weights for policy 1, policy_version 1109331 (0.0007) [2023-12-26 08:30:44,091][123091] Updated weights for policy 0, policy_version 1117218 (0.0009) [2023-12-26 08:30:44,116][123090] Updated weights for policy 1, policy_version 1109341 (0.0008) [2023-12-26 08:30:44,158][123091] Updated weights for policy 0, policy_version 1117228 (0.0010) [2023-12-26 08:30:44,829][123090] Updated weights for policy 1, policy_version 1109351 (0.0008) [2023-12-26 08:30:44,895][123090] Updated weights for policy 1, policy_version 1109361 (0.0008) [2023-12-26 08:30:44,970][123090] Updated weights for policy 1, policy_version 1109371 (0.0008) [2023-12-26 08:30:45,021][123091] Updated weights for policy 0, policy_version 1117238 (0.0010) [2023-12-26 08:30:45,092][123091] Updated weights for policy 0, policy_version 1117248 (0.0010) [2023-12-26 08:30:45,162][123091] Updated weights for policy 0, policy_version 1117258 (0.0008) [2023-12-26 08:30:45,743][123090] Updated weights for policy 1, policy_version 1109381 (0.0007) [2023-12-26 08:30:45,807][123090] Updated weights for policy 1, policy_version 1109391 (0.0005) [2023-12-26 08:30:45,881][123090] Updated weights for policy 1, policy_version 1109401 (0.0005) [2023-12-26 08:30:46,028][123091] Updated weights for policy 0, policy_version 1117268 (0.0009) [2023-12-26 08:30:46,078][123091] Updated weights for policy 0, policy_version 1117279 (0.0010) [2023-12-26 08:30:46,125][123091] Updated weights for policy 0, policy_version 1117289 (0.0009) [2023-12-26 08:30:46,613][123090] Updated weights for policy 1, policy_version 1109411 (0.0007) [2023-12-26 08:30:46,663][123090] Updated weights for policy 1, policy_version 1109421 (0.0009) [2023-12-26 08:30:46,713][123090] Updated weights for policy 1, policy_version 1109431 (0.0009) [2023-12-26 08:30:47,007][123091] Updated weights for policy 0, policy_version 1117299 (0.0010) [2023-12-26 08:30:47,062][123091] Updated weights for policy 0, policy_version 1117309 (0.0009) [2023-12-26 08:30:47,135][123091] Updated weights for policy 0, policy_version 1117319 (0.0010) [2023-12-26 08:30:47,571][123090] Updated weights for policy 1, policy_version 1109441 (0.0008) [2023-12-26 08:30:47,620][123090] Updated weights for policy 1, policy_version 1109451 (0.0009) [2023-12-26 08:30:47,670][123090] Updated weights for policy 1, policy_version 1109461 (0.0009) [2023-12-26 08:30:47,738][123090] Updated weights for policy 1, policy_version 1109471 (0.0009) [2023-12-26 08:30:47,952][123091] Updated weights for policy 0, policy_version 1117329 (0.0009) [2023-12-26 08:30:48,014][123091] Updated weights for policy 0, policy_version 1117339 (0.0009) [2023-12-26 08:30:48,077][123091] Updated weights for policy 0, policy_version 1117349 (0.0010) [2023-12-26 08:30:48,136][123091] Updated weights for policy 0, policy_version 1117359 (0.0010) [2023-12-26 08:30:48,570][123090] Updated weights for policy 1, policy_version 1109481 (0.0009) [2023-12-26 08:30:48,624][123090] Updated weights for policy 1, policy_version 1109492 (0.0008) [2023-12-26 08:30:48,677][123090] Updated weights for policy 1, policy_version 1109502 (0.0009) [2023-12-26 08:30:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 570081280. Throughput: 0: 8732.7, 1: 8886.9. Samples: 570090404. Policy #0 lag: (min: 28.0, avg: 34.1, max: 60.0) [2023-12-26 08:30:48,785][121949] Avg episode reward: [(0, '6143.580'), (1, '5903.223')] [2023-12-26 08:30:48,982][123091] Updated weights for policy 0, policy_version 1117369 (0.0006) [2023-12-26 08:30:49,055][123091] Updated weights for policy 0, policy_version 1117379 (0.0006) [2023-12-26 08:30:49,116][123091] Updated weights for policy 0, policy_version 1117389 (0.0007) [2023-12-26 08:30:49,546][123090] Updated weights for policy 1, policy_version 1109512 (0.0006) [2023-12-26 08:30:49,606][123090] Updated weights for policy 1, policy_version 1109522 (0.0005) [2023-12-26 08:30:49,660][123090] Updated weights for policy 1, policy_version 1109532 (0.0005) [2023-12-26 08:30:49,814][123091] Updated weights for policy 0, policy_version 1117399 (0.0007) [2023-12-26 08:30:49,886][123091] Updated weights for policy 0, policy_version 1117409 (0.0007) [2023-12-26 08:30:49,948][123091] Updated weights for policy 0, policy_version 1117419 (0.0006) [2023-12-26 08:30:50,410][123090] Updated weights for policy 1, policy_version 1109542 (0.0006) [2023-12-26 08:30:50,480][123090] Updated weights for policy 1, policy_version 1109552 (0.0005) [2023-12-26 08:30:50,548][123090] Updated weights for policy 1, policy_version 1109562 (0.0007) [2023-12-26 08:30:50,617][123091] Updated weights for policy 0, policy_version 1117429 (0.0006) [2023-12-26 08:30:50,680][123091] Updated weights for policy 0, policy_version 1117439 (0.0007) [2023-12-26 08:30:50,752][123091] Updated weights for policy 0, policy_version 1117449 (0.0009) [2023-12-26 08:30:51,229][123090] Updated weights for policy 1, policy_version 1109572 (0.0009) [2023-12-26 08:30:51,289][123090] Updated weights for policy 1, policy_version 1109582 (0.0007) [2023-12-26 08:30:51,351][123090] Updated weights for policy 1, policy_version 1109592 (0.0009) [2023-12-26 08:30:51,579][123091] Updated weights for policy 0, policy_version 1117459 (0.0011) [2023-12-26 08:30:51,639][123091] Updated weights for policy 0, policy_version 1117469 (0.0009) [2023-12-26 08:30:51,698][123091] Updated weights for policy 0, policy_version 1117479 (0.0009) [2023-12-26 08:30:52,123][123090] Updated weights for policy 1, policy_version 1109602 (0.0009) [2023-12-26 08:30:52,189][123090] Updated weights for policy 1, policy_version 1109612 (0.0009) [2023-12-26 08:30:52,254][123090] Updated weights for policy 1, policy_version 1109622 (0.0009) [2023-12-26 08:30:52,329][123090] Updated weights for policy 1, policy_version 1109632 (0.0009) [2023-12-26 08:30:52,604][123091] Updated weights for policy 0, policy_version 1117489 (0.0010) [2023-12-26 08:30:52,668][123091] Updated weights for policy 0, policy_version 1117500 (0.0010) [2023-12-26 08:30:52,720][123091] Updated weights for policy 0, policy_version 1117510 (0.0009) [2023-12-26 08:30:52,773][123091] Updated weights for policy 0, policy_version 1117520 (0.0009) [2023-12-26 08:30:53,096][123090] Updated weights for policy 1, policy_version 1109642 (0.0007) [2023-12-26 08:30:53,160][123090] Updated weights for policy 1, policy_version 1109652 (0.0008) [2023-12-26 08:30:53,206][123090] Updated weights for policy 1, policy_version 1109662 (0.0005) [2023-12-26 08:30:53,561][123091] Updated weights for policy 0, policy_version 1117530 (0.0008) [2023-12-26 08:30:53,628][123091] Updated weights for policy 0, policy_version 1117540 (0.0006) [2023-12-26 08:30:53,694][123091] Updated weights for policy 0, policy_version 1117550 (0.0006) [2023-12-26 08:30:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 570171392. Throughput: 0: 8750.0, 1: 8940.4. Samples: 570145472. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:30:53,785][121949] Avg episode reward: [(0, '6020.294'), (1, '5712.900')] [2023-12-26 08:30:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001117552_286097408.pth... [2023-12-26 08:30:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001109664_284073984.pth... [2023-12-26 08:30:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001116496_285827072.pth [2023-12-26 08:30:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001108608_283803648.pth [2023-12-26 08:30:54,009][123090] Updated weights for policy 1, policy_version 1109672 (0.0009) [2023-12-26 08:30:54,075][123090] Updated weights for policy 1, policy_version 1109682 (0.0009) [2023-12-26 08:30:54,128][123090] Updated weights for policy 1, policy_version 1109692 (0.0010) [2023-12-26 08:30:54,358][123091] Updated weights for policy 0, policy_version 1117560 (0.0005) [2023-12-26 08:30:54,419][123091] Updated weights for policy 0, policy_version 1117570 (0.0005) [2023-12-26 08:30:54,468][123091] Updated weights for policy 0, policy_version 1117580 (0.0006) [2023-12-26 08:30:54,975][123090] Updated weights for policy 1, policy_version 1109702 (0.0007) [2023-12-26 08:30:55,041][123090] Updated weights for policy 1, policy_version 1109712 (0.0005) [2023-12-26 08:30:55,101][123090] Updated weights for policy 1, policy_version 1109722 (0.0005) [2023-12-26 08:30:55,133][123091] Updated weights for policy 0, policy_version 1117590 (0.0008) [2023-12-26 08:30:55,180][123091] Updated weights for policy 0, policy_version 1117600 (0.0005) [2023-12-26 08:30:55,230][123091] Updated weights for policy 0, policy_version 1117610 (0.0007) [2023-12-26 08:30:55,722][123090] Updated weights for policy 1, policy_version 1109732 (0.0008) [2023-12-26 08:30:55,791][123090] Updated weights for policy 1, policy_version 1109742 (0.0008) [2023-12-26 08:30:55,851][123090] Updated weights for policy 1, policy_version 1109752 (0.0008) [2023-12-26 08:30:55,995][123091] Updated weights for policy 0, policy_version 1117620 (0.0008) [2023-12-26 08:30:56,063][123091] Updated weights for policy 0, policy_version 1117630 (0.0005) [2023-12-26 08:30:56,133][123091] Updated weights for policy 0, policy_version 1117640 (0.0008) [2023-12-26 08:30:56,643][123090] Updated weights for policy 1, policy_version 1109762 (0.0006) [2023-12-26 08:30:56,699][123090] Updated weights for policy 1, policy_version 1109772 (0.0009) [2023-12-26 08:30:56,747][123090] Updated weights for policy 1, policy_version 1109782 (0.0009) [2023-12-26 08:30:56,807][123090] Updated weights for policy 1, policy_version 1109792 (0.0009) [2023-12-26 08:30:56,921][123091] Updated weights for policy 0, policy_version 1117650 (0.0010) [2023-12-26 08:30:56,985][123091] Updated weights for policy 0, policy_version 1117660 (0.0009) [2023-12-26 08:30:57,053][123091] Updated weights for policy 0, policy_version 1117670 (0.0010) [2023-12-26 08:30:57,107][123091] Updated weights for policy 0, policy_version 1117680 (0.0009) [2023-12-26 08:30:57,538][123090] Updated weights for policy 1, policy_version 1109802 (0.0005) [2023-12-26 08:30:57,589][123090] Updated weights for policy 1, policy_version 1109812 (0.0005) [2023-12-26 08:30:57,633][123090] Updated weights for policy 1, policy_version 1109822 (0.0005) [2023-12-26 08:30:57,971][123091] Updated weights for policy 0, policy_version 1117690 (0.0008) [2023-12-26 08:30:58,038][123091] Updated weights for policy 0, policy_version 1117700 (0.0008) [2023-12-26 08:30:58,101][123091] Updated weights for policy 0, policy_version 1117710 (0.0008) [2023-12-26 08:30:58,376][123090] Updated weights for policy 1, policy_version 1109832 (0.0009) [2023-12-26 08:30:58,447][123090] Updated weights for policy 1, policy_version 1109842 (0.0011) [2023-12-26 08:30:58,516][123090] Updated weights for policy 1, policy_version 1109853 (0.0010) [2023-12-26 08:30:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 570261504. Throughput: 0: 8836.6, 1: 8986.3. Samples: 570255604. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:30:58,785][121949] Avg episode reward: [(0, '6018.640'), (1, '5735.189')] [2023-12-26 08:30:58,917][123091] Updated weights for policy 0, policy_version 1117720 (0.0008) [2023-12-26 08:30:58,972][123091] Updated weights for policy 0, policy_version 1117730 (0.0007) [2023-12-26 08:30:59,036][123091] Updated weights for policy 0, policy_version 1117740 (0.0009) [2023-12-26 08:30:59,432][123090] Updated weights for policy 1, policy_version 1109863 (0.0011) [2023-12-26 08:30:59,497][123090] Updated weights for policy 1, policy_version 1109873 (0.0010) [2023-12-26 08:30:59,564][123090] Updated weights for policy 1, policy_version 1109883 (0.0008) [2023-12-26 08:30:59,927][123091] Updated weights for policy 0, policy_version 1117750 (0.0008) [2023-12-26 08:30:59,992][123091] Updated weights for policy 0, policy_version 1117760 (0.0007) [2023-12-26 08:31:00,050][123091] Updated weights for policy 0, policy_version 1117770 (0.0006) [2023-12-26 08:31:00,287][123090] Updated weights for policy 1, policy_version 1109893 (0.0005) [2023-12-26 08:31:00,344][123090] Updated weights for policy 1, policy_version 1109903 (0.0005) [2023-12-26 08:31:00,405][123090] Updated weights for policy 1, policy_version 1109913 (0.0008) [2023-12-26 08:31:00,914][123091] Updated weights for policy 0, policy_version 1117780 (0.0009) [2023-12-26 08:31:00,977][123091] Updated weights for policy 0, policy_version 1117790 (0.0010) [2023-12-26 08:31:01,045][123091] Updated weights for policy 0, policy_version 1117800 (0.0010) [2023-12-26 08:31:01,117][123090] Updated weights for policy 1, policy_version 1109923 (0.0009) [2023-12-26 08:31:01,179][123090] Updated weights for policy 1, policy_version 1109933 (0.0009) [2023-12-26 08:31:01,235][123090] Updated weights for policy 1, policy_version 1109943 (0.0010) [2023-12-26 08:31:01,858][123091] Updated weights for policy 0, policy_version 1117810 (0.0009) [2023-12-26 08:31:01,928][123091] Updated weights for policy 0, policy_version 1117820 (0.0011) [2023-12-26 08:31:02,002][123091] Updated weights for policy 0, policy_version 1117830 (0.0011) [2023-12-26 08:31:02,020][123090] Updated weights for policy 1, policy_version 1109953 (0.0010) [2023-12-26 08:31:02,060][123091] Updated weights for policy 0, policy_version 1117840 (0.0010) [2023-12-26 08:31:02,084][123090] Updated weights for policy 1, policy_version 1109963 (0.0011) [2023-12-26 08:31:02,143][123090] Updated weights for policy 1, policy_version 1109973 (0.0010) [2023-12-26 08:31:02,208][123090] Updated weights for policy 1, policy_version 1109983 (0.0006) [2023-12-26 08:31:02,859][123091] Updated weights for policy 0, policy_version 1117850 (0.0010) [2023-12-26 08:31:02,913][123091] Updated weights for policy 0, policy_version 1117860 (0.0010) [2023-12-26 08:31:02,975][123091] Updated weights for policy 0, policy_version 1117870 (0.0011) [2023-12-26 08:31:03,020][123090] Updated weights for policy 1, policy_version 1109993 (0.0006) [2023-12-26 08:31:03,076][123090] Updated weights for policy 1, policy_version 1110003 (0.0005) [2023-12-26 08:31:03,133][123090] Updated weights for policy 1, policy_version 1110013 (0.0008) [2023-12-26 08:31:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 570343424. Throughput: 0: 8811.8, 1: 8986.1. Samples: 570360108. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:03,785][121949] Avg episode reward: [(0, '6072.150'), (1, '5869.468')] [2023-12-26 08:31:03,798][123091] Updated weights for policy 0, policy_version 1117880 (0.0010) [2023-12-26 08:31:03,853][123091] Updated weights for policy 0, policy_version 1117890 (0.0009) [2023-12-26 08:31:03,889][123090] Updated weights for policy 1, policy_version 1110023 (0.0009) [2023-12-26 08:31:03,921][123091] Updated weights for policy 0, policy_version 1117900 (0.0009) [2023-12-26 08:31:03,956][123090] Updated weights for policy 1, policy_version 1110033 (0.0007) [2023-12-26 08:31:04,021][123090] Updated weights for policy 1, policy_version 1110043 (0.0011) [2023-12-26 08:31:04,772][123090] Updated weights for policy 1, policy_version 1110053 (0.0006) [2023-12-26 08:31:04,816][123091] Updated weights for policy 0, policy_version 1117910 (0.0009) [2023-12-26 08:31:04,837][123090] Updated weights for policy 1, policy_version 1110063 (0.0006) [2023-12-26 08:31:04,873][123091] Updated weights for policy 0, policy_version 1117920 (0.0009) [2023-12-26 08:31:04,902][123090] Updated weights for policy 1, policy_version 1110073 (0.0007) [2023-12-26 08:31:04,936][123091] Updated weights for policy 0, policy_version 1117930 (0.0010) [2023-12-26 08:31:05,587][123090] Updated weights for policy 1, policy_version 1110083 (0.0007) [2023-12-26 08:31:05,652][123090] Updated weights for policy 1, policy_version 1110093 (0.0005) [2023-12-26 08:31:05,715][123090] Updated weights for policy 1, policy_version 1110103 (0.0005) [2023-12-26 08:31:05,755][123091] Updated weights for policy 0, policy_version 1117940 (0.0010) [2023-12-26 08:31:05,815][123091] Updated weights for policy 0, policy_version 1117950 (0.0011) [2023-12-26 08:31:05,871][123091] Updated weights for policy 0, policy_version 1117960 (0.0010) [2023-12-26 08:31:06,352][123090] Updated weights for policy 1, policy_version 1110113 (0.0006) [2023-12-26 08:31:06,422][123090] Updated weights for policy 1, policy_version 1110123 (0.0009) [2023-12-26 08:31:06,494][123090] Updated weights for policy 1, policy_version 1110133 (0.0007) [2023-12-26 08:31:06,554][123090] Updated weights for policy 1, policy_version 1110143 (0.0006) [2023-12-26 08:31:06,628][123091] Updated weights for policy 0, policy_version 1117970 (0.0010) [2023-12-26 08:31:06,701][123091] Updated weights for policy 0, policy_version 1117980 (0.0011) [2023-12-26 08:31:06,769][123091] Updated weights for policy 0, policy_version 1117990 (0.0011) [2023-12-26 08:31:06,832][123091] Updated weights for policy 0, policy_version 1118000 (0.0010) [2023-12-26 08:31:07,345][123090] Updated weights for policy 1, policy_version 1110153 (0.0008) [2023-12-26 08:31:07,401][123090] Updated weights for policy 1, policy_version 1110163 (0.0009) [2023-12-26 08:31:07,461][123090] Updated weights for policy 1, policy_version 1110173 (0.0009) [2023-12-26 08:31:07,652][123091] Updated weights for policy 0, policy_version 1118010 (0.0011) [2023-12-26 08:31:07,704][123091] Updated weights for policy 0, policy_version 1118020 (0.0011) [2023-12-26 08:31:07,768][123091] Updated weights for policy 0, policy_version 1118030 (0.0011) [2023-12-26 08:31:08,270][123090] Updated weights for policy 1, policy_version 1110183 (0.0009) [2023-12-26 08:31:08,327][123090] Updated weights for policy 1, policy_version 1110193 (0.0009) [2023-12-26 08:31:08,393][123090] Updated weights for policy 1, policy_version 1110203 (0.0008) [2023-12-26 08:31:08,597][123091] Updated weights for policy 0, policy_version 1118040 (0.0011) [2023-12-26 08:31:08,662][123091] Updated weights for policy 0, policy_version 1118050 (0.0010) [2023-12-26 08:31:08,722][123091] Updated weights for policy 0, policy_version 1118060 (0.0011) [2023-12-26 08:31:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 570441728. Throughput: 0: 8820.1, 1: 9075.5. Samples: 570414176. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:08,785][121949] Avg episode reward: [(0, '6062.315'), (1, '5834.406')] [2023-12-26 08:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001118064_286228480.pth... [2023-12-26 08:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001110208_284213248.pth... [2023-12-26 08:31:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001117040_285966336.pth [2023-12-26 08:31:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001109152_283942912.pth [2023-12-26 08:31:09,130][123090] Updated weights for policy 1, policy_version 1110213 (0.0007) [2023-12-26 08:31:09,186][123090] Updated weights for policy 1, policy_version 1110223 (0.0009) [2023-12-26 08:31:09,258][123090] Updated weights for policy 1, policy_version 1110233 (0.0009) [2023-12-26 08:31:09,537][123091] Updated weights for policy 0, policy_version 1118070 (0.0008) [2023-12-26 08:31:09,598][123091] Updated weights for policy 0, policy_version 1118080 (0.0006) [2023-12-26 08:31:09,651][123091] Updated weights for policy 0, policy_version 1118090 (0.0006) [2023-12-26 08:31:10,182][123090] Updated weights for policy 1, policy_version 1110243 (0.0010) [2023-12-26 08:31:10,235][123090] Updated weights for policy 1, policy_version 1110253 (0.0009) [2023-12-26 08:31:10,294][123090] Updated weights for policy 1, policy_version 1110263 (0.0009) [2023-12-26 08:31:10,459][123091] Updated weights for policy 0, policy_version 1118100 (0.0008) [2023-12-26 08:31:10,522][123091] Updated weights for policy 0, policy_version 1118110 (0.0010) [2023-12-26 08:31:10,582][123091] Updated weights for policy 0, policy_version 1118120 (0.0009) [2023-12-26 08:31:11,153][123090] Updated weights for policy 1, policy_version 1110273 (0.0007) [2023-12-26 08:31:11,216][123090] Updated weights for policy 1, policy_version 1110283 (0.0006) [2023-12-26 08:31:11,282][123090] Updated weights for policy 1, policy_version 1110293 (0.0006) [2023-12-26 08:31:11,346][123090] Updated weights for policy 1, policy_version 1110303 (0.0008) [2023-12-26 08:31:11,407][123091] Updated weights for policy 0, policy_version 1118130 (0.0010) [2023-12-26 08:31:11,471][123091] Updated weights for policy 0, policy_version 1118140 (0.0010) [2023-12-26 08:31:11,534][123091] Updated weights for policy 0, policy_version 1118150 (0.0008) [2023-12-26 08:31:11,603][123091] Updated weights for policy 0, policy_version 1118160 (0.0010) [2023-12-26 08:31:12,176][123090] Updated weights for policy 1, policy_version 1110313 (0.0009) [2023-12-26 08:31:12,246][123090] Updated weights for policy 1, policy_version 1110323 (0.0009) [2023-12-26 08:31:12,310][123090] Updated weights for policy 1, policy_version 1110333 (0.0008) [2023-12-26 08:31:12,438][123091] Updated weights for policy 0, policy_version 1118170 (0.0009) [2023-12-26 08:31:12,487][123091] Updated weights for policy 0, policy_version 1118181 (0.0009) [2023-12-26 08:31:12,537][123091] Updated weights for policy 0, policy_version 1118191 (0.0010) [2023-12-26 08:31:13,186][123090] Updated weights for policy 1, policy_version 1110343 (0.0010) [2023-12-26 08:31:13,248][123090] Updated weights for policy 1, policy_version 1110353 (0.0010) [2023-12-26 08:31:13,297][123091] Updated weights for policy 0, policy_version 1118201 (0.0006) [2023-12-26 08:31:13,304][123090] Updated weights for policy 1, policy_version 1110363 (0.0010) [2023-12-26 08:31:13,357][123091] Updated weights for policy 0, policy_version 1118211 (0.0006) [2023-12-26 08:31:13,413][123091] Updated weights for policy 0, policy_version 1118221 (0.0005) [2023-12-26 08:31:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 570523648. Throughput: 0: 8746.0, 1: 9016.7. Samples: 570515852. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:13,785][121949] Avg episode reward: [(0, '6121.576'), (1, '5860.113')] [2023-12-26 08:31:14,055][123091] Updated weights for policy 0, policy_version 1118231 (0.0005) [2023-12-26 08:31:14,079][123090] Updated weights for policy 1, policy_version 1110373 (0.0009) [2023-12-26 08:31:14,116][123091] Updated weights for policy 0, policy_version 1118241 (0.0007) [2023-12-26 08:31:14,146][123090] Updated weights for policy 1, policy_version 1110383 (0.0006) [2023-12-26 08:31:14,172][123091] Updated weights for policy 0, policy_version 1118251 (0.0008) [2023-12-26 08:31:14,214][123090] Updated weights for policy 1, policy_version 1110393 (0.0006) [2023-12-26 08:31:14,975][123090] Updated weights for policy 1, policy_version 1110403 (0.0007) [2023-12-26 08:31:14,986][123091] Updated weights for policy 0, policy_version 1118261 (0.0006) [2023-12-26 08:31:15,036][123090] Updated weights for policy 1, policy_version 1110413 (0.0011) [2023-12-26 08:31:15,053][123091] Updated weights for policy 0, policy_version 1118271 (0.0006) [2023-12-26 08:31:15,103][123090] Updated weights for policy 1, policy_version 1110423 (0.0011) [2023-12-26 08:31:15,123][123091] Updated weights for policy 0, policy_version 1118281 (0.0007) [2023-12-26 08:31:15,824][123091] Updated weights for policy 0, policy_version 1118291 (0.0007) [2023-12-26 08:31:15,873][123091] Updated weights for policy 0, policy_version 1118301 (0.0005) [2023-12-26 08:31:15,904][123090] Updated weights for policy 1, policy_version 1110433 (0.0011) [2023-12-26 08:31:15,918][123091] Updated weights for policy 0, policy_version 1118311 (0.0005) [2023-12-26 08:31:15,963][123090] Updated weights for policy 1, policy_version 1110443 (0.0010) [2023-12-26 08:31:16,025][123090] Updated weights for policy 1, policy_version 1110453 (0.0010) [2023-12-26 08:31:16,091][123090] Updated weights for policy 1, policy_version 1110463 (0.0010) [2023-12-26 08:31:16,562][123091] Updated weights for policy 0, policy_version 1118321 (0.0006) [2023-12-26 08:31:16,620][123091] Updated weights for policy 0, policy_version 1118331 (0.0010) [2023-12-26 08:31:16,675][123091] Updated weights for policy 0, policy_version 1118341 (0.0010) [2023-12-26 08:31:16,733][123091] Updated weights for policy 0, policy_version 1118351 (0.0011) [2023-12-26 08:31:16,790][123090] Updated weights for policy 1, policy_version 1110473 (0.0006) [2023-12-26 08:31:16,858][123090] Updated weights for policy 1, policy_version 1110483 (0.0007) [2023-12-26 08:31:16,930][123090] Updated weights for policy 1, policy_version 1110493 (0.0005) [2023-12-26 08:31:17,538][123091] Updated weights for policy 0, policy_version 1118361 (0.0010) [2023-12-26 08:31:17,599][123091] Updated weights for policy 0, policy_version 1118371 (0.0006) [2023-12-26 08:31:17,626][123090] Updated weights for policy 1, policy_version 1110503 (0.0009) [2023-12-26 08:31:17,665][123091] Updated weights for policy 0, policy_version 1118381 (0.0007) [2023-12-26 08:31:17,700][123090] Updated weights for policy 1, policy_version 1110513 (0.0010) [2023-12-26 08:31:17,771][123090] Updated weights for policy 1, policy_version 1110523 (0.0010) [2023-12-26 08:31:18,438][123091] Updated weights for policy 0, policy_version 1118391 (0.0006) [2023-12-26 08:31:18,446][123090] Updated weights for policy 1, policy_version 1110533 (0.0010) [2023-12-26 08:31:18,501][123091] Updated weights for policy 0, policy_version 1118401 (0.0005) [2023-12-26 08:31:18,506][123090] Updated weights for policy 1, policy_version 1110543 (0.0010) [2023-12-26 08:31:18,565][123091] Updated weights for policy 0, policy_version 1118411 (0.0006) [2023-12-26 08:31:18,570][123090] Updated weights for policy 1, policy_version 1110553 (0.0010) [2023-12-26 08:31:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 570621952. Throughput: 0: 8819.1, 1: 9017.2. Samples: 570629540. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:18,785][121949] Avg episode reward: [(0, '6221.168'), (1, '5873.301')] [2023-12-26 08:31:19,274][123091] Updated weights for policy 0, policy_version 1118421 (0.0007) [2023-12-26 08:31:19,340][123091] Updated weights for policy 0, policy_version 1118431 (0.0009) [2023-12-26 08:31:19,394][123090] Updated weights for policy 1, policy_version 1110563 (0.0010) [2023-12-26 08:31:19,399][123091] Updated weights for policy 0, policy_version 1118441 (0.0010) [2023-12-26 08:31:19,453][123090] Updated weights for policy 1, policy_version 1110573 (0.0010) [2023-12-26 08:31:19,526][123090] Updated weights for policy 1, policy_version 1110583 (0.0008) [2023-12-26 08:31:20,243][123091] Updated weights for policy 0, policy_version 1118451 (0.0007) [2023-12-26 08:31:20,314][123091] Updated weights for policy 0, policy_version 1118461 (0.0006) [2023-12-26 08:31:20,331][123090] Updated weights for policy 1, policy_version 1110593 (0.0010) [2023-12-26 08:31:20,370][123091] Updated weights for policy 0, policy_version 1118471 (0.0008) [2023-12-26 08:31:20,398][123090] Updated weights for policy 1, policy_version 1110603 (0.0009) [2023-12-26 08:31:20,469][123090] Updated weights for policy 1, policy_version 1110613 (0.0009) [2023-12-26 08:31:20,532][123090] Updated weights for policy 1, policy_version 1110623 (0.0010) [2023-12-26 08:31:21,171][123091] Updated weights for policy 0, policy_version 1118481 (0.0007) [2023-12-26 08:31:21,226][123091] Updated weights for policy 0, policy_version 1118491 (0.0009) [2023-12-26 08:31:21,287][123091] Updated weights for policy 0, policy_version 1118501 (0.0009) [2023-12-26 08:31:21,323][123090] Updated weights for policy 1, policy_version 1110633 (0.0008) [2023-12-26 08:31:21,358][123091] Updated weights for policy 0, policy_version 1118511 (0.0008) [2023-12-26 08:31:21,395][123090] Updated weights for policy 1, policy_version 1110643 (0.0010) [2023-12-26 08:31:21,462][123090] Updated weights for policy 1, policy_version 1110653 (0.0010) [2023-12-26 08:31:22,235][123091] Updated weights for policy 0, policy_version 1118521 (0.0009) [2023-12-26 08:31:22,298][123091] Updated weights for policy 0, policy_version 1118531 (0.0009) [2023-12-26 08:31:22,319][123090] Updated weights for policy 1, policy_version 1110663 (0.0008) [2023-12-26 08:31:22,359][123091] Updated weights for policy 0, policy_version 1118541 (0.0009) [2023-12-26 08:31:22,381][123090] Updated weights for policy 1, policy_version 1110673 (0.0007) [2023-12-26 08:31:22,447][123090] Updated weights for policy 1, policy_version 1110683 (0.0009) [2023-12-26 08:31:23,196][123091] Updated weights for policy 0, policy_version 1118551 (0.0009) [2023-12-26 08:31:23,251][123091] Updated weights for policy 0, policy_version 1118561 (0.0009) [2023-12-26 08:31:23,296][123090] Updated weights for policy 1, policy_version 1110693 (0.0010) [2023-12-26 08:31:23,309][123091] Updated weights for policy 0, policy_version 1118571 (0.0008) [2023-12-26 08:31:23,359][123090] Updated weights for policy 1, policy_version 1110703 (0.0009) [2023-12-26 08:31:23,428][123090] Updated weights for policy 1, policy_version 1110713 (0.0009) [2023-12-26 08:31:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 570703872. Throughput: 0: 8797.8, 1: 8993.9. Samples: 570680912. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:23,784][121949] Avg episode reward: [(0, '6312.036'), (1, '5862.857')] [2023-12-26 08:31:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001118576_286359552.pth... [2023-12-26 08:31:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001110720_284344320.pth... [2023-12-26 08:31:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001117552_286097408.pth [2023-12-26 08:31:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001109664_284073984.pth [2023-12-26 08:31:24,151][123091] Updated weights for policy 0, policy_version 1118581 (0.0010) [2023-12-26 08:31:24,200][123091] Updated weights for policy 0, policy_version 1118591 (0.0009) [2023-12-26 08:31:24,252][123091] Updated weights for policy 0, policy_version 1118601 (0.0009) [2023-12-26 08:31:24,265][123090] Updated weights for policy 1, policy_version 1110723 (0.0008) [2023-12-26 08:31:24,328][123090] Updated weights for policy 1, policy_version 1110733 (0.0008) [2023-12-26 08:31:24,399][123090] Updated weights for policy 1, policy_version 1110743 (0.0010) [2023-12-26 08:31:25,118][123091] Updated weights for policy 0, policy_version 1118611 (0.0010) [2023-12-26 08:31:25,190][123091] Updated weights for policy 0, policy_version 1118621 (0.0010) [2023-12-26 08:31:25,233][123090] Updated weights for policy 1, policy_version 1110753 (0.0009) [2023-12-26 08:31:25,244][123091] Updated weights for policy 0, policy_version 1118631 (0.0010) [2023-12-26 08:31:25,293][123090] Updated weights for policy 1, policy_version 1110763 (0.0008) [2023-12-26 08:31:25,345][123090] Updated weights for policy 1, policy_version 1110773 (0.0009) [2023-12-26 08:31:25,393][123090] Updated weights for policy 1, policy_version 1110783 (0.0009) [2023-12-26 08:31:26,046][123091] Updated weights for policy 0, policy_version 1118641 (0.0010) [2023-12-26 08:31:26,108][123091] Updated weights for policy 0, policy_version 1118651 (0.0007) [2023-12-26 08:31:26,161][123091] Updated weights for policy 0, policy_version 1118661 (0.0005) [2023-12-26 08:31:26,226][123091] Updated weights for policy 0, policy_version 1118671 (0.0005) [2023-12-26 08:31:26,245][123090] Updated weights for policy 1, policy_version 1110793 (0.0010) [2023-12-26 08:31:26,319][123090] Updated weights for policy 1, policy_version 1110803 (0.0009) [2023-12-26 08:31:26,387][123090] Updated weights for policy 1, policy_version 1110813 (0.0009) [2023-12-26 08:31:27,024][123091] Updated weights for policy 0, policy_version 1118681 (0.0009) [2023-12-26 08:31:27,080][123091] Updated weights for policy 0, policy_version 1118691 (0.0009) [2023-12-26 08:31:27,138][123091] Updated weights for policy 0, policy_version 1118701 (0.0009) [2023-12-26 08:31:27,188][123090] Updated weights for policy 1, policy_version 1110823 (0.0009) [2023-12-26 08:31:27,239][123090] Updated weights for policy 1, policy_version 1110833 (0.0010) [2023-12-26 08:31:27,302][123090] Updated weights for policy 1, policy_version 1110844 (0.0010) [2023-12-26 08:31:27,845][123091] Updated weights for policy 0, policy_version 1118711 (0.0006) [2023-12-26 08:31:27,901][123091] Updated weights for policy 0, policy_version 1118721 (0.0008) [2023-12-26 08:31:27,966][123091] Updated weights for policy 0, policy_version 1118731 (0.0010) [2023-12-26 08:31:28,165][123090] Updated weights for policy 1, policy_version 1110854 (0.0007) [2023-12-26 08:31:28,232][123090] Updated weights for policy 1, policy_version 1110864 (0.0005) [2023-12-26 08:31:28,300][123090] Updated weights for policy 1, policy_version 1110874 (0.0005) [2023-12-26 08:31:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 570785792. Throughput: 0: 8773.9, 1: 8947.5. Samples: 570783588. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:28,785][123091] Updated weights for policy 0, policy_version 1118741 (0.0008) [2023-12-26 08:31:28,785][121949] Avg episode reward: [(0, '6248.021'), (1, '5686.569')] [2023-12-26 08:31:28,842][123091] Updated weights for policy 0, policy_version 1118751 (0.0009) [2023-12-26 08:31:28,910][123091] Updated weights for policy 0, policy_version 1118761 (0.0011) [2023-12-26 08:31:28,980][123090] Updated weights for policy 1, policy_version 1110884 (0.0006) [2023-12-26 08:31:29,035][123090] Updated weights for policy 1, policy_version 1110894 (0.0005) [2023-12-26 08:31:29,106][123090] Updated weights for policy 1, policy_version 1110904 (0.0005) [2023-12-26 08:31:29,719][123091] Updated weights for policy 0, policy_version 1118771 (0.0010) [2023-12-26 08:31:29,780][123091] Updated weights for policy 0, policy_version 1118781 (0.0010) [2023-12-26 08:31:29,848][123091] Updated weights for policy 0, policy_version 1118791 (0.0010) [2023-12-26 08:31:29,896][123090] Updated weights for policy 1, policy_version 1110914 (0.0006) [2023-12-26 08:31:29,962][123090] Updated weights for policy 1, policy_version 1110924 (0.0007) [2023-12-26 08:31:30,028][123090] Updated weights for policy 1, policy_version 1110934 (0.0005) [2023-12-26 08:31:30,086][123090] Updated weights for policy 1, policy_version 1110944 (0.0010) [2023-12-26 08:31:30,576][123091] Updated weights for policy 0, policy_version 1118801 (0.0010) [2023-12-26 08:31:30,624][123091] Updated weights for policy 0, policy_version 1118811 (0.0005) [2023-12-26 08:31:30,671][123091] Updated weights for policy 0, policy_version 1118821 (0.0006) [2023-12-26 08:31:30,719][123091] Updated weights for policy 0, policy_version 1118831 (0.0010) [2023-12-26 08:31:30,800][123090] Updated weights for policy 1, policy_version 1110954 (0.0005) [2023-12-26 08:31:30,859][123090] Updated weights for policy 1, policy_version 1110964 (0.0006) [2023-12-26 08:31:30,916][123090] Updated weights for policy 1, policy_version 1110974 (0.0010) [2023-12-26 08:31:31,545][123091] Updated weights for policy 0, policy_version 1118841 (0.0006) [2023-12-26 08:31:31,622][123091] Updated weights for policy 0, policy_version 1118851 (0.0006) [2023-12-26 08:31:31,660][123090] Updated weights for policy 1, policy_version 1110984 (0.0009) [2023-12-26 08:31:31,692][123091] Updated weights for policy 0, policy_version 1118861 (0.0007) [2023-12-26 08:31:31,729][123090] Updated weights for policy 1, policy_version 1110994 (0.0010) [2023-12-26 08:31:31,781][123090] Updated weights for policy 1, policy_version 1111004 (0.0009) [2023-12-26 08:31:32,357][123091] Updated weights for policy 0, policy_version 1118871 (0.0009) [2023-12-26 08:31:32,426][123091] Updated weights for policy 0, policy_version 1118881 (0.0008) [2023-12-26 08:31:32,481][123091] Updated weights for policy 0, policy_version 1118891 (0.0009) [2023-12-26 08:31:32,641][123090] Updated weights for policy 1, policy_version 1111014 (0.0007) [2023-12-26 08:31:32,693][123090] Updated weights for policy 1, policy_version 1111024 (0.0009) [2023-12-26 08:31:32,756][123090] Updated weights for policy 1, policy_version 1111034 (0.0010) [2023-12-26 08:31:33,229][123091] Updated weights for policy 0, policy_version 1118901 (0.0007) [2023-12-26 08:31:33,284][123091] Updated weights for policy 0, policy_version 1118911 (0.0007) [2023-12-26 08:31:33,327][123091] Updated weights for policy 0, policy_version 1118921 (0.0010) [2023-12-26 08:31:33,403][123090] Updated weights for policy 1, policy_version 1111044 (0.0008) [2023-12-26 08:31:33,460][123090] Updated weights for policy 1, policy_version 1111054 (0.0005) [2023-12-26 08:31:33,527][123090] Updated weights for policy 1, policy_version 1111064 (0.0006) [2023-12-26 08:31:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 570884096. Throughput: 0: 8893.9, 1: 8960.3. Samples: 570893840. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:33,785][121949] Avg episode reward: [(0, '6311.721'), (1, '5524.194')] [2023-12-26 08:31:34,034][123091] Updated weights for policy 0, policy_version 1118931 (0.0009) [2023-12-26 08:31:34,092][123091] Updated weights for policy 0, policy_version 1118941 (0.0005) [2023-12-26 08:31:34,156][123091] Updated weights for policy 0, policy_version 1118951 (0.0007) [2023-12-26 08:31:34,203][123090] Updated weights for policy 1, policy_version 1111074 (0.0010) [2023-12-26 08:31:34,267][123090] Updated weights for policy 1, policy_version 1111084 (0.0010) [2023-12-26 08:31:34,338][123090] Updated weights for policy 1, policy_version 1111094 (0.0011) [2023-12-26 08:31:34,407][123090] Updated weights for policy 1, policy_version 1111104 (0.0006) [2023-12-26 08:31:34,869][123091] Updated weights for policy 0, policy_version 1118961 (0.0007) [2023-12-26 08:31:34,920][123091] Updated weights for policy 0, policy_version 1118971 (0.0006) [2023-12-26 08:31:34,977][123091] Updated weights for policy 0, policy_version 1118981 (0.0010) [2023-12-26 08:31:35,031][123091] Updated weights for policy 0, policy_version 1118991 (0.0010) [2023-12-26 08:31:35,044][123090] Updated weights for policy 1, policy_version 1111114 (0.0006) [2023-12-26 08:31:35,092][123090] Updated weights for policy 1, policy_version 1111124 (0.0005) [2023-12-26 08:31:35,145][123090] Updated weights for policy 1, policy_version 1111134 (0.0007) [2023-12-26 08:31:35,886][123091] Updated weights for policy 0, policy_version 1119001 (0.0008) [2023-12-26 08:31:35,954][123091] Updated weights for policy 0, policy_version 1119011 (0.0007) [2023-12-26 08:31:35,988][123090] Updated weights for policy 1, policy_version 1111144 (0.0008) [2023-12-26 08:31:36,016][123091] Updated weights for policy 0, policy_version 1119021 (0.0006) [2023-12-26 08:31:36,051][123090] Updated weights for policy 1, policy_version 1111154 (0.0009) [2023-12-26 08:31:36,124][123090] Updated weights for policy 1, policy_version 1111164 (0.0009) [2023-12-26 08:31:36,823][123091] Updated weights for policy 0, policy_version 1119031 (0.0008) [2023-12-26 08:31:36,876][123091] Updated weights for policy 0, policy_version 1119041 (0.0010) [2023-12-26 08:31:36,926][123091] Updated weights for policy 0, policy_version 1119051 (0.0009) [2023-12-26 08:31:36,955][123090] Updated weights for policy 1, policy_version 1111174 (0.0008) [2023-12-26 08:31:37,017][123090] Updated weights for policy 1, policy_version 1111184 (0.0009) [2023-12-26 08:31:37,070][123090] Updated weights for policy 1, policy_version 1111194 (0.0009) [2023-12-26 08:31:37,804][123091] Updated weights for policy 0, policy_version 1119061 (0.0007) [2023-12-26 08:31:37,873][123091] Updated weights for policy 0, policy_version 1119071 (0.0006) [2023-12-26 08:31:37,883][123090] Updated weights for policy 1, policy_version 1111204 (0.0010) [2023-12-26 08:31:37,934][123090] Updated weights for policy 1, policy_version 1111214 (0.0010) [2023-12-26 08:31:37,940][123091] Updated weights for policy 0, policy_version 1119081 (0.0006) [2023-12-26 08:31:37,985][123090] Updated weights for policy 1, policy_version 1111224 (0.0010) [2023-12-26 08:31:38,708][123091] Updated weights for policy 0, policy_version 1119091 (0.0006) [2023-12-26 08:31:38,778][123091] Updated weights for policy 0, policy_version 1119101 (0.0007) [2023-12-26 08:31:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 570966016. Throughput: 0: 8895.4, 1: 8974.8. Samples: 570949624. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:38,784][121949] Avg episode reward: [(0, '6298.431'), (1, '5506.536')] [2023-12-26 08:31:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001111232_284475392.pth... [2023-12-26 08:31:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001110208_284213248.pth [2023-12-26 08:31:38,827][123090] Updated weights for policy 1, policy_version 1111234 (0.0010) [2023-12-26 08:31:38,842][123091] Updated weights for policy 0, policy_version 1119111 (0.0011) [2023-12-26 08:31:38,890][123090] Updated weights for policy 1, policy_version 1111244 (0.0009) [2023-12-26 08:31:38,895][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001119120_286498816.pth... [2023-12-26 08:31:38,901][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001118064_286228480.pth [2023-12-26 08:31:38,957][123090] Updated weights for policy 1, policy_version 1111254 (0.0007) [2023-12-26 08:31:39,030][123090] Updated weights for policy 1, policy_version 1111264 (0.0008) [2023-12-26 08:31:39,624][123091] Updated weights for policy 0, policy_version 1119121 (0.0010) [2023-12-26 08:31:39,684][123091] Updated weights for policy 0, policy_version 1119131 (0.0011) [2023-12-26 08:31:39,737][123091] Updated weights for policy 0, policy_version 1119141 (0.0011) [2023-12-26 08:31:39,791][123090] Updated weights for policy 1, policy_version 1111274 (0.0009) [2023-12-26 08:31:39,797][123091] Updated weights for policy 0, policy_version 1119151 (0.0011) [2023-12-26 08:31:39,855][123090] Updated weights for policy 1, policy_version 1111284 (0.0009) [2023-12-26 08:31:39,930][123090] Updated weights for policy 1, policy_version 1111294 (0.0010) [2023-12-26 08:31:40,635][123091] Updated weights for policy 0, policy_version 1119161 (0.0010) [2023-12-26 08:31:40,693][123091] Updated weights for policy 0, policy_version 1119171 (0.0006) [2023-12-26 08:31:40,765][123091] Updated weights for policy 0, policy_version 1119181 (0.0005) [2023-12-26 08:31:40,769][123090] Updated weights for policy 1, policy_version 1111304 (0.0006) [2023-12-26 08:31:40,849][123090] Updated weights for policy 1, policy_version 1111314 (0.0006) [2023-12-26 08:31:40,910][123090] Updated weights for policy 1, policy_version 1111324 (0.0008) [2023-12-26 08:31:41,546][123091] Updated weights for policy 0, policy_version 1119191 (0.0009) [2023-12-26 08:31:41,605][123091] Updated weights for policy 0, policy_version 1119201 (0.0010) [2023-12-26 08:31:41,660][123090] Updated weights for policy 1, policy_version 1111334 (0.0010) [2023-12-26 08:31:41,676][123091] Updated weights for policy 0, policy_version 1119211 (0.0011) [2023-12-26 08:31:41,727][123090] Updated weights for policy 1, policy_version 1111344 (0.0007) [2023-12-26 08:31:41,791][123090] Updated weights for policy 1, policy_version 1111354 (0.0009) [2023-12-26 08:31:42,460][123091] Updated weights for policy 0, policy_version 1119221 (0.0010) [2023-12-26 08:31:42,527][123091] Updated weights for policy 0, policy_version 1119231 (0.0005) [2023-12-26 08:31:42,582][123091] Updated weights for policy 0, policy_version 1119241 (0.0005) [2023-12-26 08:31:42,672][123090] Updated weights for policy 1, policy_version 1111364 (0.0009) [2023-12-26 08:31:42,755][123090] Updated weights for policy 1, policy_version 1111374 (0.0011) [2023-12-26 08:31:42,833][123090] Updated weights for policy 1, policy_version 1111384 (0.0011) [2023-12-26 08:31:43,195][123091] Updated weights for policy 0, policy_version 1119251 (0.0005) [2023-12-26 08:31:43,259][123091] Updated weights for policy 0, policy_version 1119261 (0.0005) [2023-12-26 08:31:43,307][123091] Updated weights for policy 0, policy_version 1119271 (0.0005) [2023-12-26 08:31:43,557][123090] Updated weights for policy 1, policy_version 1111394 (0.0011) [2023-12-26 08:31:43,620][123090] Updated weights for policy 1, policy_version 1111404 (0.0008) [2023-12-26 08:31:43,668][123090] Updated weights for policy 1, policy_version 1111414 (0.0010) [2023-12-26 08:31:43,719][123090] Updated weights for policy 1, policy_version 1111424 (0.0010) [2023-12-26 08:31:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 571064320. Throughput: 0: 8834.2, 1: 8881.0. Samples: 571052784. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:43,785][121949] Avg episode reward: [(0, '6277.581'), (1, '5637.532')] [2023-12-26 08:31:43,991][123091] Updated weights for policy 0, policy_version 1119281 (0.0006) [2023-12-26 08:31:44,056][123091] Updated weights for policy 0, policy_version 1119291 (0.0006) [2023-12-26 08:31:44,124][123091] Updated weights for policy 0, policy_version 1119301 (0.0006) [2023-12-26 08:31:44,181][123091] Updated weights for policy 0, policy_version 1119311 (0.0005) [2023-12-26 08:31:44,564][123090] Updated weights for policy 1, policy_version 1111434 (0.0009) [2023-12-26 08:31:44,614][123090] Updated weights for policy 1, policy_version 1111444 (0.0009) [2023-12-26 08:31:44,680][123090] Updated weights for policy 1, policy_version 1111454 (0.0006) [2023-12-26 08:31:44,951][123091] Updated weights for policy 0, policy_version 1119321 (0.0009) [2023-12-26 08:31:45,006][123091] Updated weights for policy 0, policy_version 1119331 (0.0006) [2023-12-26 08:31:45,060][123091] Updated weights for policy 0, policy_version 1119341 (0.0005) [2023-12-26 08:31:45,538][123090] Updated weights for policy 1, policy_version 1111464 (0.0009) [2023-12-26 08:31:45,612][123090] Updated weights for policy 1, policy_version 1111474 (0.0009) [2023-12-26 08:31:45,669][123090] Updated weights for policy 1, policy_version 1111484 (0.0006) [2023-12-26 08:31:45,901][123091] Updated weights for policy 0, policy_version 1119351 (0.0010) [2023-12-26 08:31:45,968][123091] Updated weights for policy 0, policy_version 1119361 (0.0011) [2023-12-26 08:31:46,036][123091] Updated weights for policy 0, policy_version 1119371 (0.0011) [2023-12-26 08:31:46,441][123090] Updated weights for policy 1, policy_version 1111494 (0.0006) [2023-12-26 08:31:46,510][123090] Updated weights for policy 1, policy_version 1111504 (0.0006) [2023-12-26 08:31:46,561][123090] Updated weights for policy 1, policy_version 1111514 (0.0009) [2023-12-26 08:31:46,863][123091] Updated weights for policy 0, policy_version 1119381 (0.0009) [2023-12-26 08:31:46,924][123091] Updated weights for policy 0, policy_version 1119391 (0.0009) [2023-12-26 08:31:46,995][123091] Updated weights for policy 0, policy_version 1119401 (0.0009) [2023-12-26 08:31:47,374][123090] Updated weights for policy 1, policy_version 1111524 (0.0007) [2023-12-26 08:31:47,431][123090] Updated weights for policy 1, policy_version 1111534 (0.0005) [2023-12-26 08:31:47,477][123090] Updated weights for policy 1, policy_version 1111544 (0.0005) [2023-12-26 08:31:47,705][123091] Updated weights for policy 0, policy_version 1119411 (0.0008) [2023-12-26 08:31:47,775][123091] Updated weights for policy 0, policy_version 1119421 (0.0005) [2023-12-26 08:31:47,845][123091] Updated weights for policy 0, policy_version 1119431 (0.0005) [2023-12-26 08:31:48,320][123090] Updated weights for policy 1, policy_version 1111554 (0.0008) [2023-12-26 08:31:48,389][123090] Updated weights for policy 1, policy_version 1111564 (0.0009) [2023-12-26 08:31:48,456][123090] Updated weights for policy 1, policy_version 1111574 (0.0009) [2023-12-26 08:31:48,520][123090] Updated weights for policy 1, policy_version 1111584 (0.0010) [2023-12-26 08:31:48,598][123091] Updated weights for policy 0, policy_version 1119441 (0.0009) [2023-12-26 08:31:48,665][123091] Updated weights for policy 0, policy_version 1119451 (0.0006) [2023-12-26 08:31:48,729][123091] Updated weights for policy 0, policy_version 1119461 (0.0005) [2023-12-26 08:31:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 571146240. Throughput: 0: 8953.5, 1: 8836.1. Samples: 571160640. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:48,785][121949] Avg episode reward: [(0, '6224.380'), (1, '5614.257')] [2023-12-26 08:31:48,790][123091] Updated weights for policy 0, policy_version 1119471 (0.0007) [2023-12-26 08:31:49,393][123090] Updated weights for policy 1, policy_version 1111594 (0.0010) [2023-12-26 08:31:49,449][123090] Updated weights for policy 1, policy_version 1111604 (0.0010) [2023-12-26 08:31:49,496][123091] Updated weights for policy 0, policy_version 1119481 (0.0008) [2023-12-26 08:31:49,513][123090] Updated weights for policy 1, policy_version 1111614 (0.0010) [2023-12-26 08:31:49,560][123091] Updated weights for policy 0, policy_version 1119491 (0.0009) [2023-12-26 08:31:49,622][123091] Updated weights for policy 0, policy_version 1119501 (0.0007) [2023-12-26 08:31:50,330][123090] Updated weights for policy 1, policy_version 1111624 (0.0010) [2023-12-26 08:31:50,381][123091] Updated weights for policy 0, policy_version 1119511 (0.0006) [2023-12-26 08:31:50,395][123090] Updated weights for policy 1, policy_version 1111634 (0.0010) [2023-12-26 08:31:50,442][123091] Updated weights for policy 0, policy_version 1119521 (0.0008) [2023-12-26 08:31:50,462][123090] Updated weights for policy 1, policy_version 1111644 (0.0009) [2023-12-26 08:31:50,492][123091] Updated weights for policy 0, policy_version 1119531 (0.0010) [2023-12-26 08:31:51,248][123090] Updated weights for policy 1, policy_version 1111654 (0.0009) [2023-12-26 08:31:51,304][123090] Updated weights for policy 1, policy_version 1111664 (0.0009) [2023-12-26 08:31:51,340][123091] Updated weights for policy 0, policy_version 1119541 (0.0010) [2023-12-26 08:31:51,376][123090] Updated weights for policy 1, policy_version 1111674 (0.0009) [2023-12-26 08:31:51,415][123091] Updated weights for policy 0, policy_version 1119551 (0.0008) [2023-12-26 08:31:51,480][123091] Updated weights for policy 0, policy_version 1119561 (0.0009) [2023-12-26 08:31:52,162][123091] Updated weights for policy 0, policy_version 1119571 (0.0010) [2023-12-26 08:31:52,214][123090] Updated weights for policy 1, policy_version 1111684 (0.0008) [2023-12-26 08:31:52,224][123091] Updated weights for policy 0, policy_version 1119581 (0.0009) [2023-12-26 08:31:52,275][123090] Updated weights for policy 1, policy_version 1111694 (0.0009) [2023-12-26 08:31:52,287][123091] Updated weights for policy 0, policy_version 1119591 (0.0006) [2023-12-26 08:31:52,342][123090] Updated weights for policy 1, policy_version 1111704 (0.0010) [2023-12-26 08:31:53,092][123091] Updated weights for policy 0, policy_version 1119601 (0.0006) [2023-12-26 08:31:53,140][123091] Updated weights for policy 0, policy_version 1119611 (0.0005) [2023-12-26 08:31:53,210][123091] Updated weights for policy 0, policy_version 1119621 (0.0006) [2023-12-26 08:31:53,217][123090] Updated weights for policy 1, policy_version 1111714 (0.0010) [2023-12-26 08:31:53,255][123091] Updated weights for policy 0, policy_version 1119631 (0.0010) [2023-12-26 08:31:53,266][123090] Updated weights for policy 1, policy_version 1111724 (0.0007) [2023-12-26 08:31:53,324][123090] Updated weights for policy 1, policy_version 1111734 (0.0008) [2023-12-26 08:31:53,383][123090] Updated weights for policy 1, policy_version 1111744 (0.0009) [2023-12-26 08:31:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 571236352. Throughput: 0: 8978.6, 1: 8765.9. Samples: 571212676. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:53,785][121949] Avg episode reward: [(0, '6223.018'), (1, '5531.174')] [2023-12-26 08:31:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001119632_286629888.pth... [2023-12-26 08:31:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001111744_284606464.pth... [2023-12-26 08:31:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001110720_284344320.pth [2023-12-26 08:31:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001118576_286359552.pth [2023-12-26 08:31:54,047][123091] Updated weights for policy 0, policy_version 1119641 (0.0008) [2023-12-26 08:31:54,116][123091] Updated weights for policy 0, policy_version 1119651 (0.0005) [2023-12-26 08:31:54,178][123091] Updated weights for policy 0, policy_version 1119661 (0.0011) [2023-12-26 08:31:54,265][123090] Updated weights for policy 1, policy_version 1111754 (0.0006) [2023-12-26 08:31:54,318][123090] Updated weights for policy 1, policy_version 1111764 (0.0007) [2023-12-26 08:31:54,366][123090] Updated weights for policy 1, policy_version 1111774 (0.0008) [2023-12-26 08:31:54,941][123091] Updated weights for policy 0, policy_version 1119671 (0.0009) [2023-12-26 08:31:54,995][123091] Updated weights for policy 0, policy_version 1119681 (0.0010) [2023-12-26 08:31:55,049][123091] Updated weights for policy 0, policy_version 1119691 (0.0010) [2023-12-26 08:31:55,184][123090] Updated weights for policy 1, policy_version 1111784 (0.0008) [2023-12-26 08:31:55,254][123090] Updated weights for policy 1, policy_version 1111794 (0.0008) [2023-12-26 08:31:55,314][123090] Updated weights for policy 1, policy_version 1111804 (0.0005) [2023-12-26 08:31:55,918][123091] Updated weights for policy 0, policy_version 1119701 (0.0010) [2023-12-26 08:31:55,964][123091] Updated weights for policy 0, policy_version 1119711 (0.0009) [2023-12-26 08:31:56,013][123091] Updated weights for policy 0, policy_version 1119721 (0.0008) [2023-12-26 08:31:56,028][123090] Updated weights for policy 1, policy_version 1111814 (0.0006) [2023-12-26 08:31:56,076][123090] Updated weights for policy 1, policy_version 1111824 (0.0005) [2023-12-26 08:31:56,125][123090] Updated weights for policy 1, policy_version 1111834 (0.0005) [2023-12-26 08:31:56,884][123090] Updated weights for policy 1, policy_version 1111844 (0.0008) [2023-12-26 08:31:56,914][123091] Updated weights for policy 0, policy_version 1119731 (0.0009) [2023-12-26 08:31:56,936][123090] Updated weights for policy 1, policy_version 1111854 (0.0005) [2023-12-26 08:31:56,971][123091] Updated weights for policy 0, policy_version 1119741 (0.0009) [2023-12-26 08:31:56,984][123090] Updated weights for policy 1, policy_version 1111864 (0.0007) [2023-12-26 08:31:57,022][123091] Updated weights for policy 0, policy_version 1119751 (0.0007) [2023-12-26 08:31:57,804][123090] Updated weights for policy 1, policy_version 1111874 (0.0008) [2023-12-26 08:31:57,861][123091] Updated weights for policy 0, policy_version 1119761 (0.0009) [2023-12-26 08:31:57,865][123090] Updated weights for policy 1, policy_version 1111884 (0.0009) [2023-12-26 08:31:57,917][123091] Updated weights for policy 0, policy_version 1119771 (0.0007) [2023-12-26 08:31:57,922][123090] Updated weights for policy 1, policy_version 1111894 (0.0009) [2023-12-26 08:31:57,985][123090] Updated weights for policy 1, policy_version 1111904 (0.0009) [2023-12-26 08:31:57,989][123091] Updated weights for policy 0, policy_version 1119781 (0.0005) [2023-12-26 08:31:58,061][123091] Updated weights for policy 0, policy_version 1119791 (0.0007) [2023-12-26 08:31:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 571318272. Throughput: 0: 9021.3, 1: 8807.0. Samples: 571318124. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:31:58,784][121949] Avg episode reward: [(0, '6266.204'), (1, '5543.369')] [2023-12-26 08:31:58,918][123091] Updated weights for policy 0, policy_version 1119801 (0.0011) [2023-12-26 08:31:58,921][123090] Updated weights for policy 1, policy_version 1111914 (0.0008) [2023-12-26 08:31:58,983][123091] Updated weights for policy 0, policy_version 1119811 (0.0008) [2023-12-26 08:31:58,990][123090] Updated weights for policy 1, policy_version 1111924 (0.0008) [2023-12-26 08:31:59,046][123091] Updated weights for policy 0, policy_version 1119821 (0.0008) [2023-12-26 08:31:59,056][123090] Updated weights for policy 1, policy_version 1111934 (0.0008) [2023-12-26 08:31:59,772][123090] Updated weights for policy 1, policy_version 1111944 (0.0008) [2023-12-26 08:31:59,812][123091] Updated weights for policy 0, policy_version 1119831 (0.0010) [2023-12-26 08:31:59,840][123090] Updated weights for policy 1, policy_version 1111954 (0.0009) [2023-12-26 08:31:59,876][123091] Updated weights for policy 0, policy_version 1119841 (0.0010) [2023-12-26 08:31:59,906][123090] Updated weights for policy 1, policy_version 1111964 (0.0007) [2023-12-26 08:31:59,944][123091] Updated weights for policy 0, policy_version 1119851 (0.0008) [2023-12-26 08:32:00,643][123090] Updated weights for policy 1, policy_version 1111974 (0.0006) [2023-12-26 08:32:00,708][123091] Updated weights for policy 0, policy_version 1119861 (0.0007) [2023-12-26 08:32:00,709][123090] Updated weights for policy 1, policy_version 1111984 (0.0005) [2023-12-26 08:32:00,772][123091] Updated weights for policy 0, policy_version 1119871 (0.0005) [2023-12-26 08:32:00,781][123090] Updated weights for policy 1, policy_version 1111994 (0.0005) [2023-12-26 08:32:00,834][123091] Updated weights for policy 0, policy_version 1119881 (0.0005) [2023-12-26 08:32:01,468][123090] Updated weights for policy 1, policy_version 1112004 (0.0006) [2023-12-26 08:32:01,523][123091] Updated weights for policy 0, policy_version 1119891 (0.0006) [2023-12-26 08:32:01,523][123090] Updated weights for policy 1, policy_version 1112014 (0.0008) [2023-12-26 08:32:01,586][123090] Updated weights for policy 1, policy_version 1112024 (0.0008) [2023-12-26 08:32:01,587][123091] Updated weights for policy 0, policy_version 1119901 (0.0010) [2023-12-26 08:32:01,650][123091] Updated weights for policy 0, policy_version 1119911 (0.0010) [2023-12-26 08:32:02,315][123090] Updated weights for policy 1, policy_version 1112034 (0.0008) [2023-12-26 08:32:02,381][123090] Updated weights for policy 1, policy_version 1112044 (0.0007) [2023-12-26 08:32:02,440][123090] Updated weights for policy 1, policy_version 1112054 (0.0008) [2023-12-26 08:32:02,495][123090] Updated weights for policy 1, policy_version 1112064 (0.0010) [2023-12-26 08:32:02,532][123091] Updated weights for policy 0, policy_version 1119921 (0.0009) [2023-12-26 08:32:02,591][123091] Updated weights for policy 0, policy_version 1119931 (0.0009) [2023-12-26 08:32:02,663][123091] Updated weights for policy 0, policy_version 1119941 (0.0010) [2023-12-26 08:32:02,733][123091] Updated weights for policy 0, policy_version 1119951 (0.0010) [2023-12-26 08:32:03,212][123090] Updated weights for policy 1, policy_version 1112074 (0.0005) [2023-12-26 08:32:03,270][123090] Updated weights for policy 1, policy_version 1112084 (0.0005) [2023-12-26 08:32:03,316][123090] Updated weights for policy 1, policy_version 1112094 (0.0005) [2023-12-26 08:32:03,480][123091] Updated weights for policy 0, policy_version 1119961 (0.0006) [2023-12-26 08:32:03,546][123091] Updated weights for policy 0, policy_version 1119971 (0.0005) [2023-12-26 08:32:03,606][123091] Updated weights for policy 0, policy_version 1119981 (0.0006) [2023-12-26 08:32:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 571416576. Throughput: 0: 8913.7, 1: 8802.5. Samples: 571426768. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:03,785][121949] Avg episode reward: [(0, '6271.060'), (1, '5629.540')] [2023-12-26 08:32:03,986][123090] Updated weights for policy 1, policy_version 1112104 (0.0006) [2023-12-26 08:32:04,035][123090] Updated weights for policy 1, policy_version 1112114 (0.0005) [2023-12-26 08:32:04,084][123090] Updated weights for policy 1, policy_version 1112124 (0.0007) [2023-12-26 08:32:04,315][123091] Updated weights for policy 0, policy_version 1119991 (0.0009) [2023-12-26 08:32:04,377][123091] Updated weights for policy 0, policy_version 1120001 (0.0010) [2023-12-26 08:32:04,442][123091] Updated weights for policy 0, policy_version 1120011 (0.0011) [2023-12-26 08:32:04,896][123090] Updated weights for policy 1, policy_version 1112134 (0.0010) [2023-12-26 08:32:04,947][123090] Updated weights for policy 1, policy_version 1112144 (0.0010) [2023-12-26 08:32:05,021][123090] Updated weights for policy 1, policy_version 1112154 (0.0011) [2023-12-26 08:32:05,253][123091] Updated weights for policy 0, policy_version 1120021 (0.0010) [2023-12-26 08:32:05,317][123091] Updated weights for policy 0, policy_version 1120031 (0.0009) [2023-12-26 08:32:05,373][123091] Updated weights for policy 0, policy_version 1120041 (0.0009) [2023-12-26 08:32:05,764][123090] Updated weights for policy 1, policy_version 1112164 (0.0009) [2023-12-26 08:32:05,817][123090] Updated weights for policy 1, policy_version 1112174 (0.0009) [2023-12-26 08:32:05,867][123090] Updated weights for policy 1, policy_version 1112184 (0.0009) [2023-12-26 08:32:06,218][123091] Updated weights for policy 0, policy_version 1120051 (0.0009) [2023-12-26 08:32:06,277][123091] Updated weights for policy 0, policy_version 1120061 (0.0009) [2023-12-26 08:32:06,331][123091] Updated weights for policy 0, policy_version 1120071 (0.0005) [2023-12-26 08:32:06,708][123090] Updated weights for policy 1, policy_version 1112194 (0.0009) [2023-12-26 08:32:06,780][123090] Updated weights for policy 1, policy_version 1112204 (0.0006) [2023-12-26 08:32:06,841][123090] Updated weights for policy 1, policy_version 1112214 (0.0005) [2023-12-26 08:32:06,910][123090] Updated weights for policy 1, policy_version 1112224 (0.0008) [2023-12-26 08:32:07,074][123091] Updated weights for policy 0, policy_version 1120081 (0.0006) [2023-12-26 08:32:07,139][123091] Updated weights for policy 0, policy_version 1120091 (0.0006) [2023-12-26 08:32:07,202][123091] Updated weights for policy 0, policy_version 1120101 (0.0005) [2023-12-26 08:32:07,276][123091] Updated weights for policy 0, policy_version 1120111 (0.0005) [2023-12-26 08:32:07,637][123090] Updated weights for policy 1, policy_version 1112234 (0.0010) [2023-12-26 08:32:07,692][123090] Updated weights for policy 1, policy_version 1112244 (0.0010) [2023-12-26 08:32:07,742][123090] Updated weights for policy 1, policy_version 1112255 (0.0009) [2023-12-26 08:32:07,863][123091] Updated weights for policy 0, policy_version 1120121 (0.0010) [2023-12-26 08:32:07,929][123091] Updated weights for policy 0, policy_version 1120132 (0.0009) [2023-12-26 08:32:07,989][123091] Updated weights for policy 0, policy_version 1120142 (0.0009) [2023-12-26 08:32:08,662][123091] Updated weights for policy 0, policy_version 1120152 (0.0009) [2023-12-26 08:32:08,668][123090] Updated weights for policy 1, policy_version 1112265 (0.0010) [2023-12-26 08:32:08,722][123091] Updated weights for policy 0, policy_version 1120162 (0.0010) [2023-12-26 08:32:08,729][123090] Updated weights for policy 1, policy_version 1112275 (0.0008) [2023-12-26 08:32:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 571498496. Throughput: 0: 8928.0, 1: 8835.8. Samples: 571480284. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:08,785][121949] Avg episode reward: [(0, '6331.541'), (1, '5566.155')] [2023-12-26 08:32:08,787][123091] Updated weights for policy 0, policy_version 1120172 (0.0007) [2023-12-26 08:32:08,793][123090] Updated weights for policy 1, policy_version 1112285 (0.0009) [2023-12-26 08:32:08,808][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001120176_286769152.pth... [2023-12-26 08:32:08,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001112288_284745728.pth... [2023-12-26 08:32:08,813][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001119120_286498816.pth [2023-12-26 08:32:08,814][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001111232_284475392.pth [2023-12-26 08:32:09,627][123091] Updated weights for policy 0, policy_version 1120182 (0.0010) [2023-12-26 08:32:09,669][123090] Updated weights for policy 1, policy_version 1112295 (0.0009) [2023-12-26 08:32:09,693][123091] Updated weights for policy 0, policy_version 1120192 (0.0008) [2023-12-26 08:32:09,723][123090] Updated weights for policy 1, policy_version 1112305 (0.0006) [2023-12-26 08:32:09,762][123091] Updated weights for policy 0, policy_version 1120202 (0.0009) [2023-12-26 08:32:09,790][123090] Updated weights for policy 1, policy_version 1112315 (0.0008) [2023-12-26 08:32:10,591][123091] Updated weights for policy 0, policy_version 1120212 (0.0008) [2023-12-26 08:32:10,603][123090] Updated weights for policy 1, policy_version 1112325 (0.0008) [2023-12-26 08:32:10,649][123091] Updated weights for policy 0, policy_version 1120222 (0.0009) [2023-12-26 08:32:10,665][123090] Updated weights for policy 1, policy_version 1112335 (0.0005) [2023-12-26 08:32:10,703][123091] Updated weights for policy 0, policy_version 1120232 (0.0010) [2023-12-26 08:32:10,724][123090] Updated weights for policy 1, policy_version 1112345 (0.0007) [2023-12-26 08:32:11,554][123090] Updated weights for policy 1, policy_version 1112355 (0.0009) [2023-12-26 08:32:11,580][123091] Updated weights for policy 0, policy_version 1120242 (0.0007) [2023-12-26 08:32:11,620][123090] Updated weights for policy 1, policy_version 1112365 (0.0010) [2023-12-26 08:32:11,641][123091] Updated weights for policy 0, policy_version 1120252 (0.0007) [2023-12-26 08:32:11,687][123090] Updated weights for policy 1, policy_version 1112375 (0.0010) [2023-12-26 08:32:11,700][123091] Updated weights for policy 0, policy_version 1120262 (0.0008) [2023-12-26 08:32:11,776][123091] Updated weights for policy 0, policy_version 1120272 (0.0009) [2023-12-26 08:32:12,434][123090] Updated weights for policy 1, policy_version 1112385 (0.0008) [2023-12-26 08:32:12,486][123090] Updated weights for policy 1, policy_version 1112395 (0.0010) [2023-12-26 08:32:12,520][123091] Updated weights for policy 0, policy_version 1120282 (0.0011) [2023-12-26 08:32:12,542][123090] Updated weights for policy 1, policy_version 1112405 (0.0010) [2023-12-26 08:32:12,576][123091] Updated weights for policy 0, policy_version 1120292 (0.0011) [2023-12-26 08:32:12,596][123090] Updated weights for policy 1, policy_version 1112415 (0.0011) [2023-12-26 08:32:12,637][123091] Updated weights for policy 0, policy_version 1120302 (0.0011) [2023-12-26 08:32:13,270][123090] Updated weights for policy 1, policy_version 1112425 (0.0006) [2023-12-26 08:32:13,331][123090] Updated weights for policy 1, policy_version 1112435 (0.0005) [2023-12-26 08:32:13,382][123090] Updated weights for policy 1, policy_version 1112445 (0.0005) [2023-12-26 08:32:13,475][123091] Updated weights for policy 0, policy_version 1120312 (0.0006) [2023-12-26 08:32:13,535][123091] Updated weights for policy 0, policy_version 1120322 (0.0005) [2023-12-26 08:32:13,595][123091] Updated weights for policy 0, policy_version 1120332 (0.0005) [2023-12-26 08:32:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 571596800. Throughput: 0: 8983.4, 1: 8861.1. Samples: 571586592. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:13,785][121949] Avg episode reward: [(0, '6413.888'), (1, '5484.406')] [2023-12-26 08:32:14,053][123090] Updated weights for policy 1, policy_version 1112455 (0.0005) [2023-12-26 08:32:14,106][123090] Updated weights for policy 1, policy_version 1112465 (0.0006) [2023-12-26 08:32:14,179][123090] Updated weights for policy 1, policy_version 1112475 (0.0006) [2023-12-26 08:32:14,271][123091] Updated weights for policy 0, policy_version 1120342 (0.0009) [2023-12-26 08:32:14,319][123091] Updated weights for policy 0, policy_version 1120352 (0.0011) [2023-12-26 08:32:14,367][123091] Updated weights for policy 0, policy_version 1120362 (0.0010) [2023-12-26 08:32:14,862][123090] Updated weights for policy 1, policy_version 1112485 (0.0007) [2023-12-26 08:32:14,927][123090] Updated weights for policy 1, policy_version 1112495 (0.0009) [2023-12-26 08:32:14,988][123090] Updated weights for policy 1, policy_version 1112505 (0.0008) [2023-12-26 08:32:15,228][123091] Updated weights for policy 0, policy_version 1120372 (0.0010) [2023-12-26 08:32:15,281][123091] Updated weights for policy 0, policy_version 1120382 (0.0011) [2023-12-26 08:32:15,344][123091] Updated weights for policy 0, policy_version 1120392 (0.0011) [2023-12-26 08:32:15,863][123090] Updated weights for policy 1, policy_version 1112515 (0.0010) [2023-12-26 08:32:15,907][123090] Updated weights for policy 1, policy_version 1112525 (0.0010) [2023-12-26 08:32:15,954][123090] Updated weights for policy 1, policy_version 1112535 (0.0010) [2023-12-26 08:32:16,189][123091] Updated weights for policy 0, policy_version 1120402 (0.0011) [2023-12-26 08:32:16,241][123091] Updated weights for policy 0, policy_version 1120412 (0.0010) [2023-12-26 08:32:16,292][123091] Updated weights for policy 0, policy_version 1120422 (0.0010) [2023-12-26 08:32:16,340][123091] Updated weights for policy 0, policy_version 1120432 (0.0010) [2023-12-26 08:32:16,589][123090] Updated weights for policy 1, policy_version 1112545 (0.0008) [2023-12-26 08:32:16,640][123090] Updated weights for policy 1, policy_version 1112555 (0.0005) [2023-12-26 08:32:16,699][123090] Updated weights for policy 1, policy_version 1112565 (0.0008) [2023-12-26 08:32:16,764][123090] Updated weights for policy 1, policy_version 1112575 (0.0005) [2023-12-26 08:32:17,020][123091] Updated weights for policy 0, policy_version 1120442 (0.0009) [2023-12-26 08:32:17,076][123091] Updated weights for policy 0, policy_version 1120452 (0.0011) [2023-12-26 08:32:17,141][123091] Updated weights for policy 0, policy_version 1120462 (0.0010) [2023-12-26 08:32:17,467][123090] Updated weights for policy 1, policy_version 1112585 (0.0005) [2023-12-26 08:32:17,535][123090] Updated weights for policy 1, policy_version 1112595 (0.0005) [2023-12-26 08:32:17,599][123090] Updated weights for policy 1, policy_version 1112605 (0.0005) [2023-12-26 08:32:17,983][123091] Updated weights for policy 0, policy_version 1120472 (0.0011) [2023-12-26 08:32:18,042][123091] Updated weights for policy 0, policy_version 1120482 (0.0010) [2023-12-26 08:32:18,104][123091] Updated weights for policy 0, policy_version 1120492 (0.0010) [2023-12-26 08:32:18,250][123090] Updated weights for policy 1, policy_version 1112615 (0.0005) [2023-12-26 08:32:18,305][123090] Updated weights for policy 1, policy_version 1112625 (0.0006) [2023-12-26 08:32:18,375][123090] Updated weights for policy 1, policy_version 1112635 (0.0009) [2023-12-26 08:32:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 571686912. Throughput: 0: 8963.7, 1: 8943.8. Samples: 571699680. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:18,785][121949] Avg episode reward: [(0, '6378.787'), (1, '5543.573')] [2023-12-26 08:32:18,937][123091] Updated weights for policy 0, policy_version 1120502 (0.0011) [2023-12-26 08:32:18,995][123091] Updated weights for policy 0, policy_version 1120512 (0.0011) [2023-12-26 08:32:19,059][123091] Updated weights for policy 0, policy_version 1120522 (0.0011) [2023-12-26 08:32:19,200][123090] Updated weights for policy 1, policy_version 1112645 (0.0011) [2023-12-26 08:32:19,266][123090] Updated weights for policy 1, policy_version 1112655 (0.0010) [2023-12-26 08:32:19,323][123090] Updated weights for policy 1, policy_version 1112665 (0.0007) [2023-12-26 08:32:19,892][123091] Updated weights for policy 0, policy_version 1120532 (0.0010) [2023-12-26 08:32:19,964][123091] Updated weights for policy 0, policy_version 1120542 (0.0009) [2023-12-26 08:32:20,030][123091] Updated weights for policy 0, policy_version 1120552 (0.0010) [2023-12-26 08:32:20,079][123090] Updated weights for policy 1, policy_version 1112675 (0.0010) [2023-12-26 08:32:20,140][123090] Updated weights for policy 1, policy_version 1112685 (0.0011) [2023-12-26 08:32:20,207][123090] Updated weights for policy 1, policy_version 1112695 (0.0011) [2023-12-26 08:32:20,858][123091] Updated weights for policy 0, policy_version 1120562 (0.0008) [2023-12-26 08:32:20,924][123091] Updated weights for policy 0, policy_version 1120572 (0.0008) [2023-12-26 08:32:20,977][123091] Updated weights for policy 0, policy_version 1120582 (0.0011) [2023-12-26 08:32:21,037][123091] Updated weights for policy 0, policy_version 1120592 (0.0011) [2023-12-26 08:32:21,059][123090] Updated weights for policy 1, policy_version 1112705 (0.0010) [2023-12-26 08:32:21,131][123090] Updated weights for policy 1, policy_version 1112715 (0.0009) [2023-12-26 08:32:21,196][123090] Updated weights for policy 1, policy_version 1112725 (0.0011) [2023-12-26 08:32:21,264][123090] Updated weights for policy 1, policy_version 1112736 (0.0009) [2023-12-26 08:32:21,922][123091] Updated weights for policy 0, policy_version 1120602 (0.0009) [2023-12-26 08:32:21,995][123091] Updated weights for policy 0, policy_version 1120612 (0.0008) [2023-12-26 08:32:22,055][123091] Updated weights for policy 0, policy_version 1120622 (0.0008) [2023-12-26 08:32:22,071][123090] Updated weights for policy 1, policy_version 1112746 (0.0010) [2023-12-26 08:32:22,143][123090] Updated weights for policy 1, policy_version 1112756 (0.0009) [2023-12-26 08:32:22,211][123090] Updated weights for policy 1, policy_version 1112766 (0.0009) [2023-12-26 08:32:22,885][123091] Updated weights for policy 0, policy_version 1120632 (0.0010) [2023-12-26 08:32:22,946][123091] Updated weights for policy 0, policy_version 1120642 (0.0009) [2023-12-26 08:32:23,018][123091] Updated weights for policy 0, policy_version 1120652 (0.0009) [2023-12-26 08:32:23,051][123090] Updated weights for policy 1, policy_version 1112776 (0.0008) [2023-12-26 08:32:23,116][123090] Updated weights for policy 1, policy_version 1112786 (0.0009) [2023-12-26 08:32:23,185][123090] Updated weights for policy 1, policy_version 1112796 (0.0009) [2023-12-26 08:32:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 571768832. Throughput: 0: 8910.1, 1: 8908.1. Samples: 571751444. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:23,785][121949] Avg episode reward: [(0, '6363.680'), (1, '5661.669')] [2023-12-26 08:32:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001112800_284876800.pth... [2023-12-26 08:32:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001111744_284606464.pth [2023-12-26 08:32:23,826][123091] Updated weights for policy 0, policy_version 1120662 (0.0009) [2023-12-26 08:32:23,882][123091] Updated weights for policy 0, policy_version 1120672 (0.0009) [2023-12-26 08:32:23,937][123091] Updated weights for policy 0, policy_version 1120682 (0.0010) [2023-12-26 08:32:23,968][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001120688_286900224.pth... [2023-12-26 08:32:23,971][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001119632_286629888.pth [2023-12-26 08:32:23,984][123090] Updated weights for policy 1, policy_version 1112806 (0.0008) [2023-12-26 08:32:24,046][123090] Updated weights for policy 1, policy_version 1112816 (0.0009) [2023-12-26 08:32:24,096][123090] Updated weights for policy 1, policy_version 1112826 (0.0008) [2023-12-26 08:32:24,761][123091] Updated weights for policy 0, policy_version 1120692 (0.0010) [2023-12-26 08:32:24,827][123091] Updated weights for policy 0, policy_version 1120702 (0.0008) [2023-12-26 08:32:24,885][123091] Updated weights for policy 0, policy_version 1120712 (0.0009) [2023-12-26 08:32:24,948][123090] Updated weights for policy 1, policy_version 1112836 (0.0009) [2023-12-26 08:32:25,006][123090] Updated weights for policy 1, policy_version 1112846 (0.0009) [2023-12-26 08:32:25,066][123090] Updated weights for policy 1, policy_version 1112856 (0.0009) [2023-12-26 08:32:25,559][123091] Updated weights for policy 0, policy_version 1120722 (0.0007) [2023-12-26 08:32:25,617][123091] Updated weights for policy 0, policy_version 1120732 (0.0005) [2023-12-26 08:32:25,674][123091] Updated weights for policy 0, policy_version 1120742 (0.0005) [2023-12-26 08:32:25,735][123091] Updated weights for policy 0, policy_version 1120752 (0.0007) [2023-12-26 08:32:25,954][123090] Updated weights for policy 1, policy_version 1112867 (0.0010) [2023-12-26 08:32:26,012][123090] Updated weights for policy 1, policy_version 1112877 (0.0009) [2023-12-26 08:32:26,080][123090] Updated weights for policy 1, policy_version 1112887 (0.0009) [2023-12-26 08:32:26,476][123091] Updated weights for policy 0, policy_version 1120763 (0.0010) [2023-12-26 08:32:26,539][123091] Updated weights for policy 0, policy_version 1120773 (0.0010) [2023-12-26 08:32:26,590][123091] Updated weights for policy 0, policy_version 1120783 (0.0008) [2023-12-26 08:32:26,873][123090] Updated weights for policy 1, policy_version 1112897 (0.0009) [2023-12-26 08:32:26,940][123090] Updated weights for policy 1, policy_version 1112907 (0.0006) [2023-12-26 08:32:26,999][123090] Updated weights for policy 1, policy_version 1112917 (0.0009) [2023-12-26 08:32:27,064][123090] Updated weights for policy 1, policy_version 1112927 (0.0009) [2023-12-26 08:32:27,458][123091] Updated weights for policy 0, policy_version 1120793 (0.0010) [2023-12-26 08:32:27,513][123091] Updated weights for policy 0, policy_version 1120803 (0.0009) [2023-12-26 08:32:27,561][123091] Updated weights for policy 0, policy_version 1120813 (0.0009) [2023-12-26 08:32:27,818][123090] Updated weights for policy 1, policy_version 1112937 (0.0006) [2023-12-26 08:32:27,891][123090] Updated weights for policy 1, policy_version 1112947 (0.0008) [2023-12-26 08:32:27,949][123090] Updated weights for policy 1, policy_version 1112957 (0.0005) [2023-12-26 08:32:28,469][123091] Updated weights for policy 0, policy_version 1120823 (0.0009) [2023-12-26 08:32:28,524][123091] Updated weights for policy 0, policy_version 1120833 (0.0008) [2023-12-26 08:32:28,537][123090] Updated weights for policy 1, policy_version 1112967 (0.0009) [2023-12-26 08:32:28,573][123091] Updated weights for policy 0, policy_version 1120843 (0.0007) [2023-12-26 08:32:28,600][123090] Updated weights for policy 1, policy_version 1112977 (0.0010) [2023-12-26 08:32:28,671][123090] Updated weights for policy 1, policy_version 1112987 (0.0005) [2023-12-26 08:32:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 571867136. Throughput: 0: 8922.1, 1: 8907.0. Samples: 571855096. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:28,785][121949] Avg episode reward: [(0, '6356.861'), (1, '5865.410')] [2023-12-26 08:32:29,330][123090] Updated weights for policy 1, policy_version 1112997 (0.0006) [2023-12-26 08:32:29,394][123090] Updated weights for policy 1, policy_version 1113007 (0.0007) [2023-12-26 08:32:29,455][123090] Updated weights for policy 1, policy_version 1113017 (0.0005) [2023-12-26 08:32:29,509][123091] Updated weights for policy 0, policy_version 1120853 (0.0008) [2023-12-26 08:32:29,572][123091] Updated weights for policy 0, policy_version 1120863 (0.0009) [2023-12-26 08:32:29,635][123091] Updated weights for policy 0, policy_version 1120873 (0.0010) [2023-12-26 08:32:30,211][123090] Updated weights for policy 1, policy_version 1113027 (0.0011) [2023-12-26 08:32:30,265][123090] Updated weights for policy 1, policy_version 1113037 (0.0010) [2023-12-26 08:32:30,324][123090] Updated weights for policy 1, policy_version 1113047 (0.0010) [2023-12-26 08:32:30,499][123091] Updated weights for policy 0, policy_version 1120884 (0.0010) [2023-12-26 08:32:30,560][123091] Updated weights for policy 0, policy_version 1120894 (0.0009) [2023-12-26 08:32:30,625][123091] Updated weights for policy 0, policy_version 1120904 (0.0009) [2023-12-26 08:32:31,097][123090] Updated weights for policy 1, policy_version 1113057 (0.0010) [2023-12-26 08:32:31,166][123090] Updated weights for policy 1, policy_version 1113067 (0.0007) [2023-12-26 08:32:31,232][123090] Updated weights for policy 1, policy_version 1113077 (0.0009) [2023-12-26 08:32:31,300][123090] Updated weights for policy 1, policy_version 1113087 (0.0009) [2023-12-26 08:32:31,507][123091] Updated weights for policy 0, policy_version 1120914 (0.0009) [2023-12-26 08:32:31,568][123091] Updated weights for policy 0, policy_version 1120924 (0.0010) [2023-12-26 08:32:31,640][123091] Updated weights for policy 0, policy_version 1120934 (0.0010) [2023-12-26 08:32:31,702][123091] Updated weights for policy 0, policy_version 1120944 (0.0009) [2023-12-26 08:32:32,062][123090] Updated weights for policy 1, policy_version 1113097 (0.0010) [2023-12-26 08:32:32,121][123090] Updated weights for policy 1, policy_version 1113107 (0.0010) [2023-12-26 08:32:32,186][123090] Updated weights for policy 1, policy_version 1113117 (0.0010) [2023-12-26 08:32:32,608][123091] Updated weights for policy 0, policy_version 1120954 (0.0009) [2023-12-26 08:32:32,676][123091] Updated weights for policy 0, policy_version 1120964 (0.0009) [2023-12-26 08:32:32,728][123091] Updated weights for policy 0, policy_version 1120974 (0.0008) [2023-12-26 08:32:32,976][123090] Updated weights for policy 1, policy_version 1113127 (0.0010) [2023-12-26 08:32:33,027][123090] Updated weights for policy 1, policy_version 1113137 (0.0010) [2023-12-26 08:32:33,073][123090] Updated weights for policy 1, policy_version 1113147 (0.0010) [2023-12-26 08:32:33,569][123091] Updated weights for policy 0, policy_version 1120984 (0.0009) [2023-12-26 08:32:33,636][123091] Updated weights for policy 0, policy_version 1120994 (0.0010) [2023-12-26 08:32:33,693][123091] Updated weights for policy 0, policy_version 1121004 (0.0008) [2023-12-26 08:32:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 571949056. Throughput: 0: 8757.7, 1: 9014.6. Samples: 571960392. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:33,784][121949] Avg episode reward: [(0, '6299.612'), (1, '6012.815')] [2023-12-26 08:32:33,847][123090] Updated weights for policy 1, policy_version 1113157 (0.0008) [2023-12-26 08:32:33,900][123090] Updated weights for policy 1, policy_version 1113167 (0.0009) [2023-12-26 08:32:33,948][123090] Updated weights for policy 1, policy_version 1113177 (0.0010) [2023-12-26 08:32:34,589][123091] Updated weights for policy 0, policy_version 1121014 (0.0010) [2023-12-26 08:32:34,645][123091] Updated weights for policy 0, policy_version 1121024 (0.0012) [2023-12-26 08:32:34,682][123090] Updated weights for policy 1, policy_version 1113187 (0.0010) [2023-12-26 08:32:34,709][123091] Updated weights for policy 0, policy_version 1121034 (0.0009) [2023-12-26 08:32:34,775][123090] Updated weights for policy 1, policy_version 1113197 (0.0007) [2023-12-26 08:32:34,836][123090] Updated weights for policy 1, policy_version 1113207 (0.0005) [2023-12-26 08:32:35,416][123091] Updated weights for policy 0, policy_version 1121044 (0.0009) [2023-12-26 08:32:35,472][123091] Updated weights for policy 0, policy_version 1121054 (0.0009) [2023-12-26 08:32:35,528][123091] Updated weights for policy 0, policy_version 1121064 (0.0009) [2023-12-26 08:32:35,574][123090] Updated weights for policy 1, policy_version 1113217 (0.0006) [2023-12-26 08:32:35,621][123090] Updated weights for policy 1, policy_version 1113227 (0.0010) [2023-12-26 08:32:35,672][123090] Updated weights for policy 1, policy_version 1113237 (0.0010) [2023-12-26 08:32:35,741][123090] Updated weights for policy 1, policy_version 1113247 (0.0010) [2023-12-26 08:32:36,465][123091] Updated weights for policy 0, policy_version 1121074 (0.0008) [2023-12-26 08:32:36,514][123091] Updated weights for policy 0, policy_version 1121084 (0.0009) [2023-12-26 08:32:36,577][123091] Updated weights for policy 0, policy_version 1121094 (0.0007) [2023-12-26 08:32:36,600][123090] Updated weights for policy 1, policy_version 1113257 (0.0011) [2023-12-26 08:32:36,637][123091] Updated weights for policy 0, policy_version 1121104 (0.0007) [2023-12-26 08:32:36,660][123090] Updated weights for policy 1, policy_version 1113267 (0.0011) [2023-12-26 08:32:36,724][123090] Updated weights for policy 1, policy_version 1113277 (0.0011) [2023-12-26 08:32:37,437][123091] Updated weights for policy 0, policy_version 1121114 (0.0009) [2023-12-26 08:32:37,510][123091] Updated weights for policy 0, policy_version 1121124 (0.0009) [2023-12-26 08:32:37,563][123090] Updated weights for policy 1, policy_version 1113287 (0.0011) [2023-12-26 08:32:37,579][123091] Updated weights for policy 0, policy_version 1121134 (0.0008) [2023-12-26 08:32:37,623][123090] Updated weights for policy 1, policy_version 1113297 (0.0010) [2023-12-26 08:32:37,685][123090] Updated weights for policy 1, policy_version 1113307 (0.0008) [2023-12-26 08:32:38,291][123091] Updated weights for policy 0, policy_version 1121144 (0.0008) [2023-12-26 08:32:38,324][123090] Updated weights for policy 1, policy_version 1113317 (0.0007) [2023-12-26 08:32:38,347][123091] Updated weights for policy 0, policy_version 1121154 (0.0008) [2023-12-26 08:32:38,387][123090] Updated weights for policy 1, policy_version 1113327 (0.0008) [2023-12-26 08:32:38,418][123091] Updated weights for policy 0, policy_version 1121164 (0.0007) [2023-12-26 08:32:38,454][123090] Updated weights for policy 1, policy_version 1113337 (0.0009) [2023-12-26 08:32:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 572039168. Throughput: 0: 8728.8, 1: 9058.0. Samples: 572013080. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:38,785][121949] Avg episode reward: [(0, '6344.757'), (1, '6019.002')] [2023-12-26 08:32:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001121168_287023104.pth... [2023-12-26 08:32:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001113344_285016064.pth... [2023-12-26 08:32:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001120176_286769152.pth [2023-12-26 08:32:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001112288_284745728.pth [2023-12-26 08:32:39,124][123091] Updated weights for policy 0, policy_version 1121174 (0.0005) [2023-12-26 08:32:39,196][123091] Updated weights for policy 0, policy_version 1121184 (0.0010) [2023-12-26 08:32:39,269][123091] Updated weights for policy 0, policy_version 1121194 (0.0011) [2023-12-26 08:32:39,342][123090] Updated weights for policy 1, policy_version 1113347 (0.0009) [2023-12-26 08:32:39,416][123090] Updated weights for policy 1, policy_version 1113357 (0.0009) [2023-12-26 08:32:39,482][123090] Updated weights for policy 1, policy_version 1113367 (0.0006) [2023-12-26 08:32:40,104][123091] Updated weights for policy 0, policy_version 1121204 (0.0009) [2023-12-26 08:32:40,170][123091] Updated weights for policy 0, policy_version 1121214 (0.0009) [2023-12-26 08:32:40,245][123091] Updated weights for policy 0, policy_version 1121224 (0.0007) [2023-12-26 08:32:40,307][123090] Updated weights for policy 1, policy_version 1113377 (0.0008) [2023-12-26 08:32:40,373][123090] Updated weights for policy 1, policy_version 1113387 (0.0008) [2023-12-26 08:32:40,444][123090] Updated weights for policy 1, policy_version 1113397 (0.0009) [2023-12-26 08:32:40,515][123090] Updated weights for policy 1, policy_version 1113407 (0.0009) [2023-12-26 08:32:40,978][123091] Updated weights for policy 0, policy_version 1121234 (0.0006) [2023-12-26 08:32:41,041][123091] Updated weights for policy 0, policy_version 1121244 (0.0006) [2023-12-26 08:32:41,106][123091] Updated weights for policy 0, policy_version 1121254 (0.0008) [2023-12-26 08:32:41,186][123091] Updated weights for policy 0, policy_version 1121264 (0.0010) [2023-12-26 08:32:41,399][123090] Updated weights for policy 1, policy_version 1113417 (0.0008) [2023-12-26 08:32:41,469][123090] Updated weights for policy 1, policy_version 1113427 (0.0008) [2023-12-26 08:32:41,539][123090] Updated weights for policy 1, policy_version 1113437 (0.0008) [2023-12-26 08:32:42,027][123091] Updated weights for policy 0, policy_version 1121274 (0.0009) [2023-12-26 08:32:42,094][123091] Updated weights for policy 0, policy_version 1121284 (0.0009) [2023-12-26 08:32:42,170][123091] Updated weights for policy 0, policy_version 1121294 (0.0009) [2023-12-26 08:32:42,353][123090] Updated weights for policy 1, policy_version 1113447 (0.0009) [2023-12-26 08:32:42,421][123090] Updated weights for policy 1, policy_version 1113457 (0.0011) [2023-12-26 08:32:42,483][123090] Updated weights for policy 1, policy_version 1113467 (0.0010) [2023-12-26 08:32:42,971][123091] Updated weights for policy 0, policy_version 1121304 (0.0007) [2023-12-26 08:32:43,025][123091] Updated weights for policy 0, policy_version 1121315 (0.0010) [2023-12-26 08:32:43,082][123091] Updated weights for policy 0, policy_version 1121326 (0.0010) [2023-12-26 08:32:43,249][123090] Updated weights for policy 1, policy_version 1113477 (0.0008) [2023-12-26 08:32:43,315][123090] Updated weights for policy 1, policy_version 1113487 (0.0007) [2023-12-26 08:32:43,377][123090] Updated weights for policy 1, policy_version 1113497 (0.0010) [2023-12-26 08:32:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 572121088. Throughput: 0: 8732.3, 1: 9011.5. Samples: 572116600. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:43,785][121949] Avg episode reward: [(0, '6366.885'), (1, '5841.936')] [2023-12-26 08:32:43,899][123091] Updated weights for policy 0, policy_version 1121336 (0.0007) [2023-12-26 08:32:43,968][123091] Updated weights for policy 0, policy_version 1121346 (0.0007) [2023-12-26 08:32:44,040][123091] Updated weights for policy 0, policy_version 1121356 (0.0006) [2023-12-26 08:32:44,133][123090] Updated weights for policy 1, policy_version 1113507 (0.0010) [2023-12-26 08:32:44,203][123090] Updated weights for policy 1, policy_version 1113517 (0.0007) [2023-12-26 08:32:44,272][123090] Updated weights for policy 1, policy_version 1113527 (0.0005) [2023-12-26 08:32:44,710][123091] Updated weights for policy 0, policy_version 1121366 (0.0008) [2023-12-26 08:32:44,762][123091] Updated weights for policy 0, policy_version 1121376 (0.0010) [2023-12-26 08:32:44,834][123091] Updated weights for policy 0, policy_version 1121386 (0.0010) [2023-12-26 08:32:44,856][123090] Updated weights for policy 1, policy_version 1113537 (0.0006) [2023-12-26 08:32:44,929][123090] Updated weights for policy 1, policy_version 1113547 (0.0006) [2023-12-26 08:32:45,000][123090] Updated weights for policy 1, policy_version 1113557 (0.0005) [2023-12-26 08:32:45,074][123090] Updated weights for policy 1, policy_version 1113567 (0.0006) [2023-12-26 08:32:45,666][123091] Updated weights for policy 0, policy_version 1121396 (0.0010) [2023-12-26 08:32:45,731][123091] Updated weights for policy 0, policy_version 1121406 (0.0005) [2023-12-26 08:32:45,790][123091] Updated weights for policy 0, policy_version 1121416 (0.0005) [2023-12-26 08:32:45,810][123090] Updated weights for policy 1, policy_version 1113577 (0.0008) [2023-12-26 08:32:45,876][123090] Updated weights for policy 1, policy_version 1113587 (0.0010) [2023-12-26 08:32:45,947][123090] Updated weights for policy 1, policy_version 1113597 (0.0010) [2023-12-26 08:32:46,464][123091] Updated weights for policy 0, policy_version 1121426 (0.0006) [2023-12-26 08:32:46,525][123091] Updated weights for policy 0, policy_version 1121436 (0.0009) [2023-12-26 08:32:46,592][123091] Updated weights for policy 0, policy_version 1121446 (0.0008) [2023-12-26 08:32:46,646][123091] Updated weights for policy 0, policy_version 1121456 (0.0005) [2023-12-26 08:32:46,731][123090] Updated weights for policy 1, policy_version 1113607 (0.0011) [2023-12-26 08:32:46,796][123090] Updated weights for policy 1, policy_version 1113617 (0.0010) [2023-12-26 08:32:46,855][123090] Updated weights for policy 1, policy_version 1113627 (0.0010) [2023-12-26 08:32:47,320][123091] Updated weights for policy 0, policy_version 1121466 (0.0007) [2023-12-26 08:32:47,385][123091] Updated weights for policy 0, policy_version 1121476 (0.0006) [2023-12-26 08:32:47,460][123091] Updated weights for policy 0, policy_version 1121486 (0.0010) [2023-12-26 08:32:47,595][123090] Updated weights for policy 1, policy_version 1113637 (0.0008) [2023-12-26 08:32:47,665][123090] Updated weights for policy 1, policy_version 1113647 (0.0005) [2023-12-26 08:32:47,732][123090] Updated weights for policy 1, policy_version 1113657 (0.0008) [2023-12-26 08:32:48,252][123091] Updated weights for policy 0, policy_version 1121496 (0.0011) [2023-12-26 08:32:48,324][123091] Updated weights for policy 0, policy_version 1121506 (0.0010) [2023-12-26 08:32:48,394][123091] Updated weights for policy 0, policy_version 1121516 (0.0011) [2023-12-26 08:32:48,534][123090] Updated weights for policy 1, policy_version 1113667 (0.0010) [2023-12-26 08:32:48,597][123090] Updated weights for policy 1, policy_version 1113677 (0.0010) [2023-12-26 08:32:48,656][123090] Updated weights for policy 1, policy_version 1113687 (0.0010) [2023-12-26 08:32:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 572219392. Throughput: 0: 8798.0, 1: 9025.0. Samples: 572228800. Policy #0 lag: (min: 27.0, avg: 42.3, max: 59.0) [2023-12-26 08:32:48,785][121949] Avg episode reward: [(0, '6359.558'), (1, '5759.250')] [2023-12-26 08:32:49,161][123091] Updated weights for policy 0, policy_version 1121526 (0.0010) [2023-12-26 08:32:49,232][123091] Updated weights for policy 0, policy_version 1121536 (0.0009) [2023-12-26 08:32:49,297][123091] Updated weights for policy 0, policy_version 1121546 (0.0009) [2023-12-26 08:32:49,478][123090] Updated weights for policy 1, policy_version 1113697 (0.0010) [2023-12-26 08:32:49,532][123090] Updated weights for policy 1, policy_version 1113707 (0.0009) [2023-12-26 08:32:49,584][123090] Updated weights for policy 1, policy_version 1113718 (0.0009) [2023-12-26 08:32:49,650][123090] Updated weights for policy 1, policy_version 1113728 (0.0010) [2023-12-26 08:32:50,133][123091] Updated weights for policy 0, policy_version 1121556 (0.0010) [2023-12-26 08:32:50,193][123091] Updated weights for policy 0, policy_version 1121566 (0.0009) [2023-12-26 08:32:50,255][123091] Updated weights for policy 0, policy_version 1121576 (0.0009) [2023-12-26 08:32:50,469][123090] Updated weights for policy 1, policy_version 1113738 (0.0005) [2023-12-26 08:32:50,519][123090] Updated weights for policy 1, policy_version 1113748 (0.0005) [2023-12-26 08:32:50,573][123090] Updated weights for policy 1, policy_version 1113758 (0.0007) [2023-12-26 08:32:51,105][123091] Updated weights for policy 0, policy_version 1121586 (0.0010) [2023-12-26 08:32:51,173][123091] Updated weights for policy 0, policy_version 1121596 (0.0008) [2023-12-26 08:32:51,228][123091] Updated weights for policy 0, policy_version 1121606 (0.0008) [2023-12-26 08:32:51,284][123091] Updated weights for policy 0, policy_version 1121616 (0.0008) [2023-12-26 08:32:51,392][123090] Updated weights for policy 1, policy_version 1113768 (0.0008) [2023-12-26 08:32:51,447][123090] Updated weights for policy 1, policy_version 1113778 (0.0010) [2023-12-26 08:32:51,501][123090] Updated weights for policy 1, policy_version 1113788 (0.0010) [2023-12-26 08:32:52,062][123091] Updated weights for policy 0, policy_version 1121626 (0.0009) [2023-12-26 08:32:52,122][123091] Updated weights for policy 0, policy_version 1121636 (0.0011) [2023-12-26 08:32:52,181][123091] Updated weights for policy 0, policy_version 1121646 (0.0011) [2023-12-26 08:32:52,374][123090] Updated weights for policy 1, policy_version 1113798 (0.0009) [2023-12-26 08:32:52,437][123090] Updated weights for policy 1, policy_version 1113808 (0.0009) [2023-12-26 08:32:52,510][123090] Updated weights for policy 1, policy_version 1113818 (0.0008) [2023-12-26 08:32:52,914][123091] Updated weights for policy 0, policy_version 1121656 (0.0007) [2023-12-26 08:32:52,979][123091] Updated weights for policy 0, policy_version 1121666 (0.0006) [2023-12-26 08:32:53,047][123091] Updated weights for policy 0, policy_version 1121676 (0.0006) [2023-12-26 08:32:53,385][123090] Updated weights for policy 1, policy_version 1113828 (0.0009) [2023-12-26 08:32:53,433][123090] Updated weights for policy 1, policy_version 1113838 (0.0009) [2023-12-26 08:32:53,483][123090] Updated weights for policy 1, policy_version 1113849 (0.0010) [2023-12-26 08:32:53,758][123091] Updated weights for policy 0, policy_version 1121686 (0.0008) [2023-12-26 08:32:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 572301312. Throughput: 0: 8772.5, 1: 8996.0. Samples: 572279876. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:32:53,785][121949] Avg episode reward: [(0, '6367.652'), (1, '5878.143')] [2023-12-26 08:32:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001113856_285147136.pth... [2023-12-26 08:32:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001112800_284876800.pth [2023-12-26 08:32:53,809][123091] Updated weights for policy 0, policy_version 1121696 (0.0010) [2023-12-26 08:32:53,864][123091] Updated weights for policy 0, policy_version 1121706 (0.0010) [2023-12-26 08:32:53,894][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001121712_287162368.pth... [2023-12-26 08:32:53,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001120688_286900224.pth [2023-12-26 08:32:54,266][123090] Updated weights for policy 1, policy_version 1113860 (0.0008) [2023-12-26 08:32:54,316][123090] Updated weights for policy 1, policy_version 1113870 (0.0009) [2023-12-26 08:32:54,369][123090] Updated weights for policy 1, policy_version 1113880 (0.0009) [2023-12-26 08:32:54,818][123091] Updated weights for policy 0, policy_version 1121716 (0.0009) [2023-12-26 08:32:54,875][123091] Updated weights for policy 0, policy_version 1121726 (0.0009) [2023-12-26 08:32:54,938][123091] Updated weights for policy 0, policy_version 1121737 (0.0010) [2023-12-26 08:32:55,134][123090] Updated weights for policy 1, policy_version 1113890 (0.0007) [2023-12-26 08:32:55,200][123090] Updated weights for policy 1, policy_version 1113900 (0.0010) [2023-12-26 08:32:55,264][123090] Updated weights for policy 1, policy_version 1113910 (0.0009) [2023-12-26 08:32:55,318][123090] Updated weights for policy 1, policy_version 1113920 (0.0009) [2023-12-26 08:32:55,748][123091] Updated weights for policy 0, policy_version 1121747 (0.0008) [2023-12-26 08:32:55,813][123091] Updated weights for policy 0, policy_version 1121757 (0.0006) [2023-12-26 08:32:55,870][123091] Updated weights for policy 0, policy_version 1121767 (0.0006) [2023-12-26 08:32:56,133][123090] Updated weights for policy 1, policy_version 1113930 (0.0007) [2023-12-26 08:32:56,184][123090] Updated weights for policy 1, policy_version 1113940 (0.0005) [2023-12-26 08:32:56,239][123090] Updated weights for policy 1, policy_version 1113950 (0.0005) [2023-12-26 08:32:56,532][123091] Updated weights for policy 0, policy_version 1121777 (0.0006) [2023-12-26 08:32:56,589][123091] Updated weights for policy 0, policy_version 1121787 (0.0006) [2023-12-26 08:32:56,644][123091] Updated weights for policy 0, policy_version 1121797 (0.0006) [2023-12-26 08:32:56,694][123091] Updated weights for policy 0, policy_version 1121807 (0.0007) [2023-12-26 08:32:56,887][123090] Updated weights for policy 1, policy_version 1113960 (0.0009) [2023-12-26 08:32:56,939][123090] Updated weights for policy 1, policy_version 1113970 (0.0010) [2023-12-26 08:32:56,986][123090] Updated weights for policy 1, policy_version 1113980 (0.0010) [2023-12-26 08:32:57,439][123091] Updated weights for policy 0, policy_version 1121817 (0.0005) [2023-12-26 08:32:57,484][123091] Updated weights for policy 0, policy_version 1121827 (0.0005) [2023-12-26 08:32:57,533][123091] Updated weights for policy 0, policy_version 1121837 (0.0005) [2023-12-26 08:32:57,732][123090] Updated weights for policy 1, policy_version 1113990 (0.0007) [2023-12-26 08:32:57,785][123090] Updated weights for policy 1, policy_version 1114000 (0.0005) [2023-12-26 08:32:57,833][123090] Updated weights for policy 1, policy_version 1114010 (0.0005) [2023-12-26 08:32:58,206][123091] Updated weights for policy 0, policy_version 1121847 (0.0007) [2023-12-26 08:32:58,270][123091] Updated weights for policy 0, policy_version 1121857 (0.0008) [2023-12-26 08:32:58,330][123091] Updated weights for policy 0, policy_version 1121867 (0.0008) [2023-12-26 08:32:58,593][123090] Updated weights for policy 1, policy_version 1114020 (0.0006) [2023-12-26 08:32:58,682][123090] Updated weights for policy 1, policy_version 1114030 (0.0008) [2023-12-26 08:32:58,755][123090] Updated weights for policy 1, policy_version 1114040 (0.0008) [2023-12-26 08:32:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 572391424. Throughput: 0: 8769.9, 1: 9062.3. Samples: 572389040. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:32:58,784][121949] Avg episode reward: [(0, '6315.069'), (1, '5963.848')] [2023-12-26 08:32:59,142][123091] Updated weights for policy 0, policy_version 1121877 (0.0008) [2023-12-26 08:32:59,210][123091] Updated weights for policy 0, policy_version 1121887 (0.0007) [2023-12-26 08:32:59,274][123091] Updated weights for policy 0, policy_version 1121897 (0.0009) [2023-12-26 08:32:59,506][123090] Updated weights for policy 1, policy_version 1114050 (0.0007) [2023-12-26 08:32:59,569][123090] Updated weights for policy 1, policy_version 1114061 (0.0007) [2023-12-26 08:32:59,631][123090] Updated weights for policy 1, policy_version 1114071 (0.0005) [2023-12-26 08:33:00,035][123091] Updated weights for policy 0, policy_version 1121907 (0.0009) [2023-12-26 08:33:00,094][123091] Updated weights for policy 0, policy_version 1121917 (0.0009) [2023-12-26 08:33:00,145][123091] Updated weights for policy 0, policy_version 1121927 (0.0009) [2023-12-26 08:33:00,396][123090] Updated weights for policy 1, policy_version 1114081 (0.0006) [2023-12-26 08:33:00,453][123090] Updated weights for policy 1, policy_version 1114091 (0.0008) [2023-12-26 08:33:00,512][123090] Updated weights for policy 1, policy_version 1114101 (0.0008) [2023-12-26 08:33:00,577][123090] Updated weights for policy 1, policy_version 1114111 (0.0010) [2023-12-26 08:33:00,873][123091] Updated weights for policy 0, policy_version 1121937 (0.0009) [2023-12-26 08:33:00,922][123091] Updated weights for policy 0, policy_version 1121947 (0.0005) [2023-12-26 08:33:00,968][123091] Updated weights for policy 0, policy_version 1121957 (0.0005) [2023-12-26 08:33:01,034][123091] Updated weights for policy 0, policy_version 1121967 (0.0006) [2023-12-26 08:33:01,313][123090] Updated weights for policy 1, policy_version 1114121 (0.0008) [2023-12-26 08:33:01,394][123090] Updated weights for policy 1, policy_version 1114131 (0.0011) [2023-12-26 08:33:01,445][123090] Updated weights for policy 1, policy_version 1114141 (0.0010) [2023-12-26 08:33:01,826][123091] Updated weights for policy 0, policy_version 1121977 (0.0009) [2023-12-26 08:33:01,878][123091] Updated weights for policy 0, policy_version 1121987 (0.0009) [2023-12-26 08:33:01,929][123091] Updated weights for policy 0, policy_version 1121997 (0.0008) [2023-12-26 08:33:02,237][123090] Updated weights for policy 1, policy_version 1114151 (0.0010) [2023-12-26 08:33:02,300][123090] Updated weights for policy 1, policy_version 1114161 (0.0010) [2023-12-26 08:33:02,371][123090] Updated weights for policy 1, policy_version 1114171 (0.0009) [2023-12-26 08:33:02,836][123091] Updated weights for policy 0, policy_version 1122007 (0.0008) [2023-12-26 08:33:02,884][123091] Updated weights for policy 0, policy_version 1122017 (0.0009) [2023-12-26 08:33:02,934][123091] Updated weights for policy 0, policy_version 1122027 (0.0010) [2023-12-26 08:33:03,179][123090] Updated weights for policy 1, policy_version 1114181 (0.0008) [2023-12-26 08:33:03,251][123090] Updated weights for policy 1, policy_version 1114191 (0.0006) [2023-12-26 08:33:03,323][123090] Updated weights for policy 1, policy_version 1114201 (0.0006) [2023-12-26 08:33:03,602][123091] Updated weights for policy 0, policy_version 1122037 (0.0007) [2023-12-26 08:33:03,655][123091] Updated weights for policy 0, policy_version 1122047 (0.0005) [2023-12-26 08:33:03,708][123091] Updated weights for policy 0, policy_version 1122057 (0.0008) [2023-12-26 08:33:03,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 572489728. Throughput: 0: 8793.9, 1: 8931.0. Samples: 572497304. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:03,785][121949] Avg episode reward: [(0, '6230.607'), (1, '5979.639')] [2023-12-26 08:33:04,084][123090] Updated weights for policy 1, policy_version 1114211 (0.0009) [2023-12-26 08:33:04,143][123090] Updated weights for policy 1, policy_version 1114221 (0.0010) [2023-12-26 08:33:04,204][123090] Updated weights for policy 1, policy_version 1114231 (0.0009) [2023-12-26 08:33:04,489][123091] Updated weights for policy 0, policy_version 1122067 (0.0006) [2023-12-26 08:33:04,552][123091] Updated weights for policy 0, policy_version 1122077 (0.0009) [2023-12-26 08:33:04,609][123091] Updated weights for policy 0, policy_version 1122087 (0.0006) [2023-12-26 08:33:04,972][123090] Updated weights for policy 1, policy_version 1114241 (0.0009) [2023-12-26 08:33:05,035][123090] Updated weights for policy 1, policy_version 1114251 (0.0010) [2023-12-26 08:33:05,115][123090] Updated weights for policy 1, policy_version 1114261 (0.0009) [2023-12-26 08:33:05,190][123090] Updated weights for policy 1, policy_version 1114271 (0.0009) [2023-12-26 08:33:05,281][123091] Updated weights for policy 0, policy_version 1122097 (0.0010) [2023-12-26 08:33:05,347][123091] Updated weights for policy 0, policy_version 1122107 (0.0009) [2023-12-26 08:33:05,412][123091] Updated weights for policy 0, policy_version 1122117 (0.0010) [2023-12-26 08:33:05,468][123091] Updated weights for policy 0, policy_version 1122127 (0.0006) [2023-12-26 08:33:06,032][123090] Updated weights for policy 1, policy_version 1114281 (0.0009) [2023-12-26 08:33:06,105][123090] Updated weights for policy 1, policy_version 1114291 (0.0009) [2023-12-26 08:33:06,167][123090] Updated weights for policy 1, policy_version 1114301 (0.0008) [2023-12-26 08:33:06,221][123091] Updated weights for policy 0, policy_version 1122137 (0.0010) [2023-12-26 08:33:06,292][123091] Updated weights for policy 0, policy_version 1122147 (0.0011) [2023-12-26 08:33:06,359][123091] Updated weights for policy 0, policy_version 1122157 (0.0011) [2023-12-26 08:33:06,979][123090] Updated weights for policy 1, policy_version 1114311 (0.0007) [2023-12-26 08:33:07,053][123090] Updated weights for policy 1, policy_version 1114321 (0.0006) [2023-12-26 08:33:07,125][123090] Updated weights for policy 1, policy_version 1114331 (0.0006) [2023-12-26 08:33:07,183][123091] Updated weights for policy 0, policy_version 1122167 (0.0011) [2023-12-26 08:33:07,239][123091] Updated weights for policy 0, policy_version 1122177 (0.0010) [2023-12-26 08:33:07,298][123091] Updated weights for policy 0, policy_version 1122187 (0.0010) [2023-12-26 08:33:07,752][123090] Updated weights for policy 1, policy_version 1114341 (0.0007) [2023-12-26 08:33:07,819][123090] Updated weights for policy 1, policy_version 1114351 (0.0009) [2023-12-26 08:33:07,879][123090] Updated weights for policy 1, policy_version 1114361 (0.0009) [2023-12-26 08:33:08,100][123091] Updated weights for policy 0, policy_version 1122197 (0.0011) [2023-12-26 08:33:08,166][123091] Updated weights for policy 0, policy_version 1122207 (0.0010) [2023-12-26 08:33:08,227][123091] Updated weights for policy 0, policy_version 1122217 (0.0010) [2023-12-26 08:33:08,719][123090] Updated weights for policy 1, policy_version 1114371 (0.0009) [2023-12-26 08:33:08,785][123090] Updated weights for policy 1, policy_version 1114381 (0.0010) [2023-12-26 08:33:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 572571648. Throughput: 0: 8843.8, 1: 8916.9. Samples: 572550676. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:08,785][121949] Avg episode reward: [(0, '6289.750'), (1, '5961.968')] [2023-12-26 08:33:08,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001122224_287293440.pth... [2023-12-26 08:33:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001121168_287023104.pth [2023-12-26 08:33:08,855][123090] Updated weights for policy 1, policy_version 1114391 (0.0010) [2023-12-26 08:33:08,916][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001114400_285286400.pth... [2023-12-26 08:33:08,921][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001113344_285016064.pth [2023-12-26 08:33:08,963][123091] Updated weights for policy 0, policy_version 1122227 (0.0009) [2023-12-26 08:33:09,027][123091] Updated weights for policy 0, policy_version 1122237 (0.0006) [2023-12-26 08:33:09,090][123091] Updated weights for policy 0, policy_version 1122247 (0.0006) [2023-12-26 08:33:09,805][123090] Updated weights for policy 1, policy_version 1114401 (0.0010) [2023-12-26 08:33:09,874][123090] Updated weights for policy 1, policy_version 1114411 (0.0009) [2023-12-26 08:33:09,922][123091] Updated weights for policy 0, policy_version 1122257 (0.0009) [2023-12-26 08:33:09,948][123090] Updated weights for policy 1, policy_version 1114421 (0.0010) [2023-12-26 08:33:09,992][123091] Updated weights for policy 0, policy_version 1122267 (0.0008) [2023-12-26 08:33:10,013][123090] Updated weights for policy 1, policy_version 1114431 (0.0008) [2023-12-26 08:33:10,059][123091] Updated weights for policy 0, policy_version 1122277 (0.0008) [2023-12-26 08:33:10,132][123091] Updated weights for policy 0, policy_version 1122287 (0.0008) [2023-12-26 08:33:10,888][123090] Updated weights for policy 1, policy_version 1114441 (0.0007) [2023-12-26 08:33:10,898][123091] Updated weights for policy 0, policy_version 1122297 (0.0006) [2023-12-26 08:33:10,946][123090] Updated weights for policy 1, policy_version 1114451 (0.0005) [2023-12-26 08:33:10,951][123091] Updated weights for policy 0, policy_version 1122307 (0.0005) [2023-12-26 08:33:11,009][123091] Updated weights for policy 0, policy_version 1122317 (0.0006) [2023-12-26 08:33:11,011][123090] Updated weights for policy 1, policy_version 1114461 (0.0007) [2023-12-26 08:33:11,776][123091] Updated weights for policy 0, policy_version 1122327 (0.0009) [2023-12-26 08:33:11,837][123091] Updated weights for policy 0, policy_version 1122337 (0.0009) [2023-12-26 08:33:11,861][123090] Updated weights for policy 1, policy_version 1114471 (0.0007) [2023-12-26 08:33:11,901][123091] Updated weights for policy 0, policy_version 1122347 (0.0010) [2023-12-26 08:33:11,917][123090] Updated weights for policy 1, policy_version 1114481 (0.0007) [2023-12-26 08:33:11,974][123090] Updated weights for policy 1, policy_version 1114491 (0.0009) [2023-12-26 08:33:12,749][123091] Updated weights for policy 0, policy_version 1122357 (0.0008) [2023-12-26 08:33:12,792][123090] Updated weights for policy 1, policy_version 1114501 (0.0011) [2023-12-26 08:33:12,814][123091] Updated weights for policy 0, policy_version 1122367 (0.0006) [2023-12-26 08:33:12,848][123090] Updated weights for policy 1, policy_version 1114511 (0.0011) [2023-12-26 08:33:12,875][123091] Updated weights for policy 0, policy_version 1122377 (0.0006) [2023-12-26 08:33:12,904][123090] Updated weights for policy 1, policy_version 1114521 (0.0010) [2023-12-26 08:33:13,652][123091] Updated weights for policy 0, policy_version 1122387 (0.0006) [2023-12-26 08:33:13,716][123091] Updated weights for policy 0, policy_version 1122397 (0.0005) [2023-12-26 08:33:13,716][123090] Updated weights for policy 1, policy_version 1114531 (0.0010) [2023-12-26 08:33:13,777][123091] Updated weights for policy 0, policy_version 1122407 (0.0007) [2023-12-26 08:33:13,779][123090] Updated weights for policy 1, policy_version 1114541 (0.0008) [2023-12-26 08:33:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 572653568. Throughput: 0: 8857.5, 1: 8923.7. Samples: 572655244. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:13,785][121949] Avg episode reward: [(0, '6333.568'), (1, '5877.366')] [2023-12-26 08:33:13,833][123090] Updated weights for policy 1, policy_version 1114551 (0.0007) [2023-12-26 08:33:14,516][123091] Updated weights for policy 0, policy_version 1122417 (0.0007) [2023-12-26 08:33:14,562][123090] Updated weights for policy 1, policy_version 1114561 (0.0007) [2023-12-26 08:33:14,591][123091] Updated weights for policy 0, policy_version 1122427 (0.0006) [2023-12-26 08:33:14,630][123090] Updated weights for policy 1, policy_version 1114571 (0.0010) [2023-12-26 08:33:14,656][123091] Updated weights for policy 0, policy_version 1122437 (0.0006) [2023-12-26 08:33:14,690][123090] Updated weights for policy 1, policy_version 1114581 (0.0011) [2023-12-26 08:33:14,719][123091] Updated weights for policy 0, policy_version 1122447 (0.0005) [2023-12-26 08:33:14,750][123090] Updated weights for policy 1, policy_version 1114591 (0.0006) [2023-12-26 08:33:15,390][123090] Updated weights for policy 1, policy_version 1114601 (0.0009) [2023-12-26 08:33:15,435][123091] Updated weights for policy 0, policy_version 1122457 (0.0006) [2023-12-26 08:33:15,453][123090] Updated weights for policy 1, policy_version 1114611 (0.0011) [2023-12-26 08:33:15,498][123091] Updated weights for policy 0, policy_version 1122467 (0.0006) [2023-12-26 08:33:15,517][123090] Updated weights for policy 1, policy_version 1114621 (0.0011) [2023-12-26 08:33:15,561][123091] Updated weights for policy 0, policy_version 1122478 (0.0008) [2023-12-26 08:33:16,281][123090] Updated weights for policy 1, policy_version 1114631 (0.0010) [2023-12-26 08:33:16,336][123090] Updated weights for policy 1, policy_version 1114641 (0.0010) [2023-12-26 08:33:16,351][123091] Updated weights for policy 0, policy_version 1122488 (0.0006) [2023-12-26 08:33:16,395][123090] Updated weights for policy 1, policy_version 1114651 (0.0010) [2023-12-26 08:33:16,410][123091] Updated weights for policy 0, policy_version 1122498 (0.0007) [2023-12-26 08:33:16,480][123091] Updated weights for policy 0, policy_version 1122508 (0.0008) [2023-12-26 08:33:17,218][123090] Updated weights for policy 1, policy_version 1114661 (0.0010) [2023-12-26 08:33:17,228][123091] Updated weights for policy 0, policy_version 1122518 (0.0007) [2023-12-26 08:33:17,273][123090] Updated weights for policy 1, policy_version 1114671 (0.0010) [2023-12-26 08:33:17,293][123091] Updated weights for policy 0, policy_version 1122528 (0.0005) [2023-12-26 08:33:17,339][123090] Updated weights for policy 1, policy_version 1114681 (0.0010) [2023-12-26 08:33:17,355][123091] Updated weights for policy 0, policy_version 1122538 (0.0007) [2023-12-26 08:33:18,095][123091] Updated weights for policy 0, policy_version 1122548 (0.0008) [2023-12-26 08:33:18,156][123090] Updated weights for policy 1, policy_version 1114691 (0.0010) [2023-12-26 08:33:18,163][123091] Updated weights for policy 0, policy_version 1122558 (0.0006) [2023-12-26 08:33:18,208][123090] Updated weights for policy 1, policy_version 1114701 (0.0010) [2023-12-26 08:33:18,222][123091] Updated weights for policy 0, policy_version 1122568 (0.0011) [2023-12-26 08:33:18,258][123090] Updated weights for policy 1, policy_version 1114711 (0.0010) [2023-12-26 08:33:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 572751872. Throughput: 0: 8997.2, 1: 8862.5. Samples: 572764088. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:18,786][121949] Avg episode reward: [(0, '6257.547'), (1, '5941.225')] [2023-12-26 08:33:19,024][123091] Updated weights for policy 0, policy_version 1122578 (0.0011) [2023-12-26 08:33:19,085][123091] Updated weights for policy 0, policy_version 1122588 (0.0010) [2023-12-26 08:33:19,092][123090] Updated weights for policy 1, policy_version 1114721 (0.0010) [2023-12-26 08:33:19,155][123091] Updated weights for policy 0, policy_version 1122598 (0.0007) [2023-12-26 08:33:19,156][123090] Updated weights for policy 1, policy_version 1114731 (0.0007) [2023-12-26 08:33:19,216][123091] Updated weights for policy 0, policy_version 1122608 (0.0007) [2023-12-26 08:33:19,223][123090] Updated weights for policy 1, policy_version 1114741 (0.0009) [2023-12-26 08:33:19,287][123090] Updated weights for policy 1, policy_version 1114751 (0.0009) [2023-12-26 08:33:20,066][123091] Updated weights for policy 0, policy_version 1122618 (0.0008) [2023-12-26 08:33:20,124][123090] Updated weights for policy 1, policy_version 1114761 (0.0007) [2023-12-26 08:33:20,137][123091] Updated weights for policy 0, policy_version 1122628 (0.0010) [2023-12-26 08:33:20,199][123090] Updated weights for policy 1, policy_version 1114771 (0.0006) [2023-12-26 08:33:20,202][123091] Updated weights for policy 0, policy_version 1122638 (0.0008) [2023-12-26 08:33:20,272][123090] Updated weights for policy 1, policy_version 1114781 (0.0009) [2023-12-26 08:33:20,938][123091] Updated weights for policy 0, policy_version 1122648 (0.0006) [2023-12-26 08:33:21,003][123091] Updated weights for policy 0, policy_version 1122658 (0.0007) [2023-12-26 08:33:21,021][123090] Updated weights for policy 1, policy_version 1114791 (0.0007) [2023-12-26 08:33:21,072][123091] Updated weights for policy 0, policy_version 1122668 (0.0011) [2023-12-26 08:33:21,088][123090] Updated weights for policy 1, policy_version 1114801 (0.0007) [2023-12-26 08:33:21,155][123090] Updated weights for policy 1, policy_version 1114811 (0.0008) [2023-12-26 08:33:21,805][123091] Updated weights for policy 0, policy_version 1122678 (0.0010) [2023-12-26 08:33:21,867][123091] Updated weights for policy 0, policy_version 1122688 (0.0009) [2023-12-26 08:33:21,927][123091] Updated weights for policy 0, policy_version 1122698 (0.0010) [2023-12-26 08:33:21,987][123090] Updated weights for policy 1, policy_version 1114821 (0.0010) [2023-12-26 08:33:22,038][123090] Updated weights for policy 1, policy_version 1114831 (0.0009) [2023-12-26 08:33:22,109][123090] Updated weights for policy 1, policy_version 1114841 (0.0010) [2023-12-26 08:33:22,824][123091] Updated weights for policy 0, policy_version 1122708 (0.0009) [2023-12-26 08:33:22,875][123091] Updated weights for policy 0, policy_version 1122718 (0.0011) [2023-12-26 08:33:22,895][123090] Updated weights for policy 1, policy_version 1114851 (0.0008) [2023-12-26 08:33:22,935][123091] Updated weights for policy 0, policy_version 1122728 (0.0011) [2023-12-26 08:33:22,959][123090] Updated weights for policy 1, policy_version 1114861 (0.0005) [2023-12-26 08:33:23,011][123090] Updated weights for policy 1, policy_version 1114871 (0.0008) [2023-12-26 08:33:23,746][123091] Updated weights for policy 0, policy_version 1122738 (0.0009) [2023-12-26 08:33:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 572833792. Throughput: 0: 9038.9, 1: 8812.7. Samples: 572816400. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:23,784][121949] Avg episode reward: [(0, '6242.339'), (1, '5897.242')] [2023-12-26 08:33:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001114880_285409280.pth... [2023-12-26 08:33:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001113856_285147136.pth [2023-12-26 08:33:23,812][123091] Updated weights for policy 0, policy_version 1122748 (0.0011) [2023-12-26 08:33:23,836][123090] Updated weights for policy 1, policy_version 1114881 (0.0009) [2023-12-26 08:33:23,860][123091] Updated weights for policy 0, policy_version 1122758 (0.0008) [2023-12-26 08:33:23,891][123090] Updated weights for policy 1, policy_version 1114891 (0.0009) [2023-12-26 08:33:23,921][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001122768_287432704.pth... [2023-12-26 08:33:23,922][123091] Updated weights for policy 0, policy_version 1122768 (0.0007) [2023-12-26 08:33:23,927][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001121712_287162368.pth [2023-12-26 08:33:23,949][123090] Updated weights for policy 1, policy_version 1114901 (0.0008) [2023-12-26 08:33:24,011][123090] Updated weights for policy 1, policy_version 1114911 (0.0009) [2023-12-26 08:33:24,649][123091] Updated weights for policy 0, policy_version 1122778 (0.0005) [2023-12-26 08:33:24,704][123091] Updated weights for policy 0, policy_version 1122788 (0.0005) [2023-12-26 08:33:24,771][123091] Updated weights for policy 0, policy_version 1122798 (0.0005) [2023-12-26 08:33:24,904][123090] Updated weights for policy 1, policy_version 1114921 (0.0008) [2023-12-26 08:33:24,952][123090] Updated weights for policy 1, policy_version 1114931 (0.0009) [2023-12-26 08:33:25,005][123090] Updated weights for policy 1, policy_version 1114941 (0.0009) [2023-12-26 08:33:25,413][123091] Updated weights for policy 0, policy_version 1122808 (0.0009) [2023-12-26 08:33:25,475][123091] Updated weights for policy 0, policy_version 1122818 (0.0010) [2023-12-26 08:33:25,534][123091] Updated weights for policy 0, policy_version 1122828 (0.0011) [2023-12-26 08:33:25,749][123090] Updated weights for policy 1, policy_version 1114951 (0.0007) [2023-12-26 08:33:25,821][123090] Updated weights for policy 1, policy_version 1114961 (0.0005) [2023-12-26 08:33:25,890][123090] Updated weights for policy 1, policy_version 1114971 (0.0005) [2023-12-26 08:33:26,340][123091] Updated weights for policy 0, policy_version 1122838 (0.0010) [2023-12-26 08:33:26,390][123091] Updated weights for policy 0, policy_version 1122848 (0.0009) [2023-12-26 08:33:26,437][123091] Updated weights for policy 0, policy_version 1122858 (0.0005) [2023-12-26 08:33:26,509][123090] Updated weights for policy 1, policy_version 1114981 (0.0005) [2023-12-26 08:33:26,563][123090] Updated weights for policy 1, policy_version 1114991 (0.0005) [2023-12-26 08:33:26,614][123090] Updated weights for policy 1, policy_version 1115001 (0.0005) [2023-12-26 08:33:27,158][123091] Updated weights for policy 0, policy_version 1122868 (0.0005) [2023-12-26 08:33:27,226][123091] Updated weights for policy 0, policy_version 1122878 (0.0005) [2023-12-26 08:33:27,291][123091] Updated weights for policy 0, policy_version 1122889 (0.0006) [2023-12-26 08:33:27,334][123090] Updated weights for policy 1, policy_version 1115011 (0.0007) [2023-12-26 08:33:27,382][123090] Updated weights for policy 1, policy_version 1115021 (0.0010) [2023-12-26 08:33:27,433][123090] Updated weights for policy 1, policy_version 1115031 (0.0009) [2023-12-26 08:33:27,886][123091] Updated weights for policy 0, policy_version 1122899 (0.0007) [2023-12-26 08:33:27,954][123091] Updated weights for policy 0, policy_version 1122909 (0.0010) [2023-12-26 08:33:28,016][123091] Updated weights for policy 0, policy_version 1122919 (0.0010) [2023-12-26 08:33:28,249][123090] Updated weights for policy 1, policy_version 1115041 (0.0007) [2023-12-26 08:33:28,319][123090] Updated weights for policy 1, policy_version 1115051 (0.0006) [2023-12-26 08:33:28,388][123090] Updated weights for policy 1, policy_version 1115061 (0.0007) [2023-12-26 08:33:28,450][123090] Updated weights for policy 1, policy_version 1115071 (0.0006) [2023-12-26 08:33:28,766][123091] Updated weights for policy 0, policy_version 1122929 (0.0010) [2023-12-26 08:33:28,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 572932096. Throughput: 0: 9089.9, 1: 8910.0. Samples: 572926592. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:28,785][121949] Avg episode reward: [(0, '6250.725'), (1, '5973.842')] [2023-12-26 08:33:28,824][123091] Updated weights for policy 0, policy_version 1122939 (0.0010) [2023-12-26 08:33:28,883][123091] Updated weights for policy 0, policy_version 1122949 (0.0011) [2023-12-26 08:33:28,946][123091] Updated weights for policy 0, policy_version 1122959 (0.0011) [2023-12-26 08:33:29,134][123090] Updated weights for policy 1, policy_version 1115081 (0.0005) [2023-12-26 08:33:29,204][123090] Updated weights for policy 1, policy_version 1115091 (0.0007) [2023-12-26 08:33:29,266][123090] Updated weights for policy 1, policy_version 1115101 (0.0009) [2023-12-26 08:33:29,770][123091] Updated weights for policy 0, policy_version 1122969 (0.0007) [2023-12-26 08:33:29,833][123091] Updated weights for policy 0, policy_version 1122979 (0.0010) [2023-12-26 08:33:29,897][123091] Updated weights for policy 0, policy_version 1122989 (0.0011) [2023-12-26 08:33:30,011][123090] Updated weights for policy 1, policy_version 1115111 (0.0010) [2023-12-26 08:33:30,082][123090] Updated weights for policy 1, policy_version 1115121 (0.0009) [2023-12-26 08:33:30,146][123090] Updated weights for policy 1, policy_version 1115131 (0.0010) [2023-12-26 08:33:30,710][123091] Updated weights for policy 0, policy_version 1122999 (0.0009) [2023-12-26 08:33:30,761][123091] Updated weights for policy 0, policy_version 1123009 (0.0008) [2023-12-26 08:33:30,808][123091] Updated weights for policy 0, policy_version 1123019 (0.0009) [2023-12-26 08:33:30,857][123090] Updated weights for policy 1, policy_version 1115141 (0.0010) [2023-12-26 08:33:30,915][123090] Updated weights for policy 1, policy_version 1115151 (0.0010) [2023-12-26 08:33:30,976][123090] Updated weights for policy 1, policy_version 1115161 (0.0010) [2023-12-26 08:33:31,598][123091] Updated weights for policy 0, policy_version 1123029 (0.0007) [2023-12-26 08:33:31,675][123091] Updated weights for policy 0, policy_version 1123039 (0.0010) [2023-12-26 08:33:31,722][123090] Updated weights for policy 1, policy_version 1115171 (0.0010) [2023-12-26 08:33:31,745][123091] Updated weights for policy 0, policy_version 1123049 (0.0009) [2023-12-26 08:33:31,787][123090] Updated weights for policy 1, policy_version 1115181 (0.0008) [2023-12-26 08:33:31,866][123090] Updated weights for policy 1, policy_version 1115191 (0.0006) [2023-12-26 08:33:32,505][123091] Updated weights for policy 0, policy_version 1123059 (0.0008) [2023-12-26 08:33:32,567][123091] Updated weights for policy 0, policy_version 1123069 (0.0009) [2023-12-26 08:33:32,622][123090] Updated weights for policy 1, policy_version 1115201 (0.0006) [2023-12-26 08:33:32,629][123091] Updated weights for policy 0, policy_version 1123079 (0.0009) [2023-12-26 08:33:32,686][123090] Updated weights for policy 1, policy_version 1115211 (0.0006) [2023-12-26 08:33:32,756][123090] Updated weights for policy 1, policy_version 1115221 (0.0005) [2023-12-26 08:33:32,819][123090] Updated weights for policy 1, policy_version 1115231 (0.0008) [2023-12-26 08:33:33,449][123090] Updated weights for policy 1, policy_version 1115241 (0.0009) [2023-12-26 08:33:33,482][123091] Updated weights for policy 0, policy_version 1123090 (0.0009) [2023-12-26 08:33:33,497][123090] Updated weights for policy 1, policy_version 1115251 (0.0008) [2023-12-26 08:33:33,534][123091] Updated weights for policy 0, policy_version 1123100 (0.0007) [2023-12-26 08:33:33,553][123090] Updated weights for policy 1, policy_version 1115261 (0.0007) [2023-12-26 08:33:33,583][123091] Updated weights for policy 0, policy_version 1123110 (0.0008) [2023-12-26 08:33:33,644][123091] Updated weights for policy 0, policy_version 1123120 (0.0010) [2023-12-26 08:33:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 573030400. Throughput: 0: 9021.6, 1: 8905.8. Samples: 573035532. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:33,785][121949] Avg episode reward: [(0, '6328.015'), (1, '6015.772')] [2023-12-26 08:33:34,402][123091] Updated weights for policy 0, policy_version 1123130 (0.0010) [2023-12-26 08:33:34,469][123091] Updated weights for policy 0, policy_version 1123140 (0.0011) [2023-12-26 08:33:34,482][123090] Updated weights for policy 1, policy_version 1115271 (0.0010) [2023-12-26 08:33:34,532][123091] Updated weights for policy 0, policy_version 1123150 (0.0008) [2023-12-26 08:33:34,546][123090] Updated weights for policy 1, policy_version 1115281 (0.0010) [2023-12-26 08:33:34,617][123090] Updated weights for policy 1, policy_version 1115291 (0.0008) [2023-12-26 08:33:35,241][123091] Updated weights for policy 0, policy_version 1123160 (0.0007) [2023-12-26 08:33:35,292][123091] Updated weights for policy 0, policy_version 1123170 (0.0009) [2023-12-26 08:33:35,340][123091] Updated weights for policy 0, policy_version 1123180 (0.0010) [2023-12-26 08:33:35,493][123090] Updated weights for policy 1, policy_version 1115301 (0.0009) [2023-12-26 08:33:35,546][123090] Updated weights for policy 1, policy_version 1115311 (0.0009) [2023-12-26 08:33:35,598][123090] Updated weights for policy 1, policy_version 1115321 (0.0010) [2023-12-26 08:33:36,082][123091] Updated weights for policy 0, policy_version 1123190 (0.0009) [2023-12-26 08:33:36,150][123091] Updated weights for policy 0, policy_version 1123200 (0.0009) [2023-12-26 08:33:36,225][123091] Updated weights for policy 0, policy_version 1123210 (0.0011) [2023-12-26 08:33:36,522][123090] Updated weights for policy 1, policy_version 1115331 (0.0010) [2023-12-26 08:33:36,583][123090] Updated weights for policy 1, policy_version 1115341 (0.0009) [2023-12-26 08:33:36,646][123090] Updated weights for policy 1, policy_version 1115351 (0.0008) [2023-12-26 08:33:37,037][123091] Updated weights for policy 0, policy_version 1123220 (0.0009) [2023-12-26 08:33:37,092][123091] Updated weights for policy 0, policy_version 1123230 (0.0005) [2023-12-26 08:33:37,144][123091] Updated weights for policy 0, policy_version 1123240 (0.0005) [2023-12-26 08:33:37,499][123090] Updated weights for policy 1, policy_version 1115361 (0.0009) [2023-12-26 08:33:37,548][123090] Updated weights for policy 1, policy_version 1115371 (0.0010) [2023-12-26 08:33:37,598][123090] Updated weights for policy 1, policy_version 1115381 (0.0008) [2023-12-26 08:33:37,650][123090] Updated weights for policy 1, policy_version 1115391 (0.0006) [2023-12-26 08:33:37,748][123091] Updated weights for policy 0, policy_version 1123250 (0.0005) [2023-12-26 08:33:37,802][123091] Updated weights for policy 0, policy_version 1123260 (0.0006) [2023-12-26 08:33:37,855][123091] Updated weights for policy 0, policy_version 1123270 (0.0006) [2023-12-26 08:33:38,422][123090] Updated weights for policy 1, policy_version 1115401 (0.0009) [2023-12-26 08:33:38,476][123090] Updated weights for policy 1, policy_version 1115411 (0.0009) [2023-12-26 08:33:38,523][123090] Updated weights for policy 1, policy_version 1115421 (0.0008) [2023-12-26 08:33:38,654][123091] Updated weights for policy 0, policy_version 1123281 (0.0007) [2023-12-26 08:33:38,715][123091] Updated weights for policy 0, policy_version 1123291 (0.0009) [2023-12-26 08:33:38,772][123091] Updated weights for policy 0, policy_version 1123301 (0.0009) [2023-12-26 08:33:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 573112320. Throughput: 0: 9096.5, 1: 8864.8. Samples: 573088128. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:38,784][121949] Avg episode reward: [(0, '6360.827'), (1, '5851.634')] [2023-12-26 08:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001115424_285548544.pth... [2023-12-26 08:33:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001114400_285286400.pth [2023-12-26 08:33:38,830][123091] Updated weights for policy 0, policy_version 1123311 (0.0008) [2023-12-26 08:33:38,833][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001123312_287571968.pth... [2023-12-26 08:33:38,836][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001122224_287293440.pth [2023-12-26 08:33:39,316][123090] Updated weights for policy 1, policy_version 1115431 (0.0009) [2023-12-26 08:33:39,391][123090] Updated weights for policy 1, policy_version 1115441 (0.0011) [2023-12-26 08:33:39,461][123090] Updated weights for policy 1, policy_version 1115451 (0.0010) [2023-12-26 08:33:39,602][123091] Updated weights for policy 0, policy_version 1123321 (0.0008) [2023-12-26 08:33:39,669][123091] Updated weights for policy 0, policy_version 1123331 (0.0008) [2023-12-26 08:33:39,736][123091] Updated weights for policy 0, policy_version 1123341 (0.0008) [2023-12-26 08:33:40,350][123090] Updated weights for policy 1, policy_version 1115461 (0.0011) [2023-12-26 08:33:40,411][123090] Updated weights for policy 1, policy_version 1115471 (0.0011) [2023-12-26 08:33:40,480][123090] Updated weights for policy 1, policy_version 1115481 (0.0009) [2023-12-26 08:33:40,534][123091] Updated weights for policy 0, policy_version 1123351 (0.0006) [2023-12-26 08:33:40,607][123091] Updated weights for policy 0, policy_version 1123361 (0.0005) [2023-12-26 08:33:40,657][123091] Updated weights for policy 0, policy_version 1123371 (0.0007) [2023-12-26 08:33:41,221][123090] Updated weights for policy 1, policy_version 1115491 (0.0009) [2023-12-26 08:33:41,277][123090] Updated weights for policy 1, policy_version 1115501 (0.0011) [2023-12-26 08:33:41,326][123090] Updated weights for policy 1, policy_version 1115511 (0.0010) [2023-12-26 08:33:41,373][123091] Updated weights for policy 0, policy_version 1123381 (0.0010) [2023-12-26 08:33:41,443][123091] Updated weights for policy 0, policy_version 1123391 (0.0011) [2023-12-26 08:33:41,514][123091] Updated weights for policy 0, policy_version 1123401 (0.0008) [2023-12-26 08:33:42,187][123090] Updated weights for policy 1, policy_version 1115521 (0.0010) [2023-12-26 08:33:42,215][123091] Updated weights for policy 0, policy_version 1123411 (0.0008) [2023-12-26 08:33:42,259][123090] Updated weights for policy 1, policy_version 1115531 (0.0011) [2023-12-26 08:33:42,284][123091] Updated weights for policy 0, policy_version 1123421 (0.0008) [2023-12-26 08:33:42,324][123090] Updated weights for policy 1, policy_version 1115541 (0.0011) [2023-12-26 08:33:42,341][123091] Updated weights for policy 0, policy_version 1123431 (0.0010) [2023-12-26 08:33:42,393][123090] Updated weights for policy 1, policy_version 1115551 (0.0009) [2023-12-26 08:33:43,080][123090] Updated weights for policy 1, policy_version 1115561 (0.0007) [2023-12-26 08:33:43,153][123090] Updated weights for policy 1, policy_version 1115571 (0.0005) [2023-12-26 08:33:43,159][123091] Updated weights for policy 0, policy_version 1123441 (0.0010) [2023-12-26 08:33:43,222][123091] Updated weights for policy 0, policy_version 1123451 (0.0005) [2023-12-26 08:33:43,225][123090] Updated weights for policy 1, policy_version 1115581 (0.0006) [2023-12-26 08:33:43,272][123091] Updated weights for policy 0, policy_version 1123461 (0.0005) [2023-12-26 08:33:43,319][123091] Updated weights for policy 0, policy_version 1123471 (0.0005) [2023-12-26 08:33:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 573202432. Throughput: 0: 9113.5, 1: 8809.5. Samples: 573195576. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:43,784][121949] Avg episode reward: [(0, '6420.411'), (1, '5812.846')] [2023-12-26 08:33:43,894][123090] Updated weights for policy 1, policy_version 1115591 (0.0009) [2023-12-26 08:33:43,946][123090] Updated weights for policy 1, policy_version 1115601 (0.0010) [2023-12-26 08:33:43,994][123090] Updated weights for policy 1, policy_version 1115611 (0.0010) [2023-12-26 08:33:44,103][123091] Updated weights for policy 0, policy_version 1123481 (0.0009) [2023-12-26 08:33:44,154][123091] Updated weights for policy 0, policy_version 1123491 (0.0009) [2023-12-26 08:33:44,213][123091] Updated weights for policy 0, policy_version 1123501 (0.0009) [2023-12-26 08:33:44,807][123090] Updated weights for policy 1, policy_version 1115621 (0.0009) [2023-12-26 08:33:44,877][123090] Updated weights for policy 1, policy_version 1115631 (0.0007) [2023-12-26 08:33:44,946][123090] Updated weights for policy 1, policy_version 1115641 (0.0007) [2023-12-26 08:33:45,057][123091] Updated weights for policy 0, policy_version 1123511 (0.0009) [2023-12-26 08:33:45,113][123091] Updated weights for policy 0, policy_version 1123521 (0.0008) [2023-12-26 08:33:45,170][123091] Updated weights for policy 0, policy_version 1123531 (0.0006) [2023-12-26 08:33:45,705][123090] Updated weights for policy 1, policy_version 1115651 (0.0008) [2023-12-26 08:33:45,752][123090] Updated weights for policy 1, policy_version 1115661 (0.0005) [2023-12-26 08:33:45,825][123090] Updated weights for policy 1, policy_version 1115671 (0.0005) [2023-12-26 08:33:46,007][123091] Updated weights for policy 0, policy_version 1123541 (0.0008) [2023-12-26 08:33:46,058][123091] Updated weights for policy 0, policy_version 1123551 (0.0008) [2023-12-26 08:33:46,111][123091] Updated weights for policy 0, policy_version 1123561 (0.0010) [2023-12-26 08:33:46,550][123090] Updated weights for policy 1, policy_version 1115681 (0.0006) [2023-12-26 08:33:46,611][123090] Updated weights for policy 1, policy_version 1115691 (0.0010) [2023-12-26 08:33:46,664][123090] Updated weights for policy 1, policy_version 1115701 (0.0009) [2023-12-26 08:33:46,710][123090] Updated weights for policy 1, policy_version 1115711 (0.0009) [2023-12-26 08:33:46,960][123091] Updated weights for policy 0, policy_version 1123571 (0.0010) [2023-12-26 08:33:47,025][123091] Updated weights for policy 0, policy_version 1123581 (0.0009) [2023-12-26 08:33:47,089][123091] Updated weights for policy 0, policy_version 1123591 (0.0009) [2023-12-26 08:33:47,548][123090] Updated weights for policy 1, policy_version 1115721 (0.0010) [2023-12-26 08:33:47,603][123090] Updated weights for policy 1, policy_version 1115731 (0.0009) [2023-12-26 08:33:47,652][123090] Updated weights for policy 1, policy_version 1115741 (0.0009) [2023-12-26 08:33:47,906][123091] Updated weights for policy 0, policy_version 1123601 (0.0010) [2023-12-26 08:33:47,973][123091] Updated weights for policy 0, policy_version 1123611 (0.0009) [2023-12-26 08:33:48,041][123091] Updated weights for policy 0, policy_version 1123621 (0.0009) [2023-12-26 08:33:48,108][123091] Updated weights for policy 0, policy_version 1123631 (0.0009) [2023-12-26 08:33:48,473][123090] Updated weights for policy 1, policy_version 1115751 (0.0009) [2023-12-26 08:33:48,534][123090] Updated weights for policy 1, policy_version 1115761 (0.0009) [2023-12-26 08:33:48,587][123090] Updated weights for policy 1, policy_version 1115771 (0.0009) [2023-12-26 08:33:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 573292544. Throughput: 0: 9034.5, 1: 8855.4. Samples: 573302348. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:48,785][121949] Avg episode reward: [(0, '6433.271'), (1, '5932.272')] [2023-12-26 08:33:48,960][123091] Updated weights for policy 0, policy_version 1123641 (0.0009) [2023-12-26 08:33:49,037][123091] Updated weights for policy 0, policy_version 1123651 (0.0009) [2023-12-26 08:33:49,088][123091] Updated weights for policy 0, policy_version 1123661 (0.0010) [2023-12-26 08:33:49,437][123090] Updated weights for policy 1, policy_version 1115781 (0.0009) [2023-12-26 08:33:49,503][123090] Updated weights for policy 1, policy_version 1115791 (0.0010) [2023-12-26 08:33:49,571][123090] Updated weights for policy 1, policy_version 1115801 (0.0010) [2023-12-26 08:33:49,877][123091] Updated weights for policy 0, policy_version 1123671 (0.0009) [2023-12-26 08:33:49,937][123091] Updated weights for policy 0, policy_version 1123681 (0.0009) [2023-12-26 08:33:50,002][123091] Updated weights for policy 0, policy_version 1123691 (0.0008) [2023-12-26 08:33:50,399][123090] Updated weights for policy 1, policy_version 1115811 (0.0009) [2023-12-26 08:33:50,471][123090] Updated weights for policy 1, policy_version 1115821 (0.0005) [2023-12-26 08:33:50,549][123090] Updated weights for policy 1, policy_version 1115831 (0.0005) [2023-12-26 08:33:50,795][123091] Updated weights for policy 0, policy_version 1123701 (0.0008) [2023-12-26 08:33:50,865][123091] Updated weights for policy 0, policy_version 1123711 (0.0008) [2023-12-26 08:33:50,935][123091] Updated weights for policy 0, policy_version 1123721 (0.0008) [2023-12-26 08:33:51,220][123090] Updated weights for policy 1, policy_version 1115841 (0.0007) [2023-12-26 08:33:51,292][123090] Updated weights for policy 1, policy_version 1115851 (0.0008) [2023-12-26 08:33:51,357][123090] Updated weights for policy 1, policy_version 1115861 (0.0006) [2023-12-26 08:33:51,423][123090] Updated weights for policy 1, policy_version 1115871 (0.0007) [2023-12-26 08:33:51,744][123091] Updated weights for policy 0, policy_version 1123731 (0.0009) [2023-12-26 08:33:51,799][123091] Updated weights for policy 0, policy_version 1123741 (0.0009) [2023-12-26 08:33:51,850][123091] Updated weights for policy 0, policy_version 1123751 (0.0010) [2023-12-26 08:33:52,127][123090] Updated weights for policy 1, policy_version 1115881 (0.0008) [2023-12-26 08:33:52,188][123090] Updated weights for policy 1, policy_version 1115891 (0.0005) [2023-12-26 08:33:52,252][123090] Updated weights for policy 1, policy_version 1115901 (0.0006) [2023-12-26 08:33:52,782][123091] Updated weights for policy 0, policy_version 1123761 (0.0009) [2023-12-26 08:33:52,858][123091] Updated weights for policy 0, policy_version 1123771 (0.0010) [2023-12-26 08:33:52,930][123091] Updated weights for policy 0, policy_version 1123781 (0.0009) [2023-12-26 08:33:52,952][123090] Updated weights for policy 1, policy_version 1115911 (0.0007) [2023-12-26 08:33:52,999][123091] Updated weights for policy 0, policy_version 1123791 (0.0009) [2023-12-26 08:33:53,009][123090] Updated weights for policy 1, policy_version 1115921 (0.0005) [2023-12-26 08:33:53,063][123090] Updated weights for policy 1, policy_version 1115931 (0.0005) [2023-12-26 08:33:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17886.0, 300 sec: 17800.2). Total num frames: 573374464. Throughput: 0: 9000.4, 1: 8892.0. Samples: 573355832. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:53,785][121949] Avg episode reward: [(0, '6404.379'), (1, '5944.186')] [2023-12-26 08:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001123792_287694848.pth... [2023-12-26 08:33:53,792][123090] Updated weights for policy 1, policy_version 1115941 (0.0005) [2023-12-26 08:33:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001122768_287432704.pth [2023-12-26 08:33:53,795][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001123792_287694848.pth [2023-12-26 08:33:53,861][123091] Updated weights for policy 0, policy_version 1123801 (0.0008) [2023-12-26 08:33:53,866][123090] Updated weights for policy 1, policy_version 1115951 (0.0006) [2023-12-26 08:33:53,909][123091] Updated weights for policy 0, policy_version 1123811 (0.0007) [2023-12-26 08:33:53,920][123090] Updated weights for policy 1, policy_version 1115961 (0.0009) [2023-12-26 08:33:53,953][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001115968_285687808.pth... [2023-12-26 08:33:53,958][123091] Updated weights for policy 0, policy_version 1123821 (0.0006) [2023-12-26 08:33:53,958][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001114880_285409280.pth [2023-12-26 08:33:53,959][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001115968_285687808.pth [2023-12-26 08:33:54,726][123090] Updated weights for policy 1, policy_version 1115971 (0.0008) [2023-12-26 08:33:54,778][123090] Updated weights for policy 1, policy_version 1115981 (0.0009) [2023-12-26 08:33:54,808][123091] Updated weights for policy 0, policy_version 1123831 (0.0010) [2023-12-26 08:33:54,831][123090] Updated weights for policy 1, policy_version 1115991 (0.0008) [2023-12-26 08:33:54,860][123091] Updated weights for policy 0, policy_version 1123841 (0.0007) [2023-12-26 08:33:54,921][123091] Updated weights for policy 0, policy_version 1123851 (0.0007) [2023-12-26 08:33:55,684][123090] Updated weights for policy 1, policy_version 1116001 (0.0009) [2023-12-26 08:33:55,733][123090] Updated weights for policy 1, policy_version 1116011 (0.0009) [2023-12-26 08:33:55,750][123091] Updated weights for policy 0, policy_version 1123861 (0.0008) [2023-12-26 08:33:55,792][123090] Updated weights for policy 1, policy_version 1116021 (0.0010) [2023-12-26 08:33:55,809][123091] Updated weights for policy 0, policy_version 1123871 (0.0009) [2023-12-26 08:33:55,854][123090] Updated weights for policy 1, policy_version 1116031 (0.0008) [2023-12-26 08:33:55,871][123091] Updated weights for policy 0, policy_version 1123881 (0.0010) [2023-12-26 08:33:56,599][123090] Updated weights for policy 1, policy_version 1116041 (0.0009) [2023-12-26 08:33:56,651][123090] Updated weights for policy 1, policy_version 1116051 (0.0007) [2023-12-26 08:33:56,701][123090] Updated weights for policy 1, policy_version 1116061 (0.0005) [2023-12-26 08:33:56,725][123091] Updated weights for policy 0, policy_version 1123891 (0.0009) [2023-12-26 08:33:56,782][123091] Updated weights for policy 0, policy_version 1123901 (0.0009) [2023-12-26 08:33:56,843][123091] Updated weights for policy 0, policy_version 1123911 (0.0010) [2023-12-26 08:33:57,335][123090] Updated weights for policy 1, policy_version 1116071 (0.0005) [2023-12-26 08:33:57,389][123090] Updated weights for policy 1, policy_version 1116081 (0.0005) [2023-12-26 08:33:57,449][123090] Updated weights for policy 1, policy_version 1116091 (0.0005) [2023-12-26 08:33:57,784][123091] Updated weights for policy 0, policy_version 1123922 (0.0011) [2023-12-26 08:33:57,837][123091] Updated weights for policy 0, policy_version 1123934 (0.0011) [2023-12-26 08:33:57,887][123091] Updated weights for policy 0, policy_version 1123944 (0.0009) [2023-12-26 08:33:58,169][123090] Updated weights for policy 1, policy_version 1116101 (0.0007) [2023-12-26 08:33:58,238][123090] Updated weights for policy 1, policy_version 1116111 (0.0008) [2023-12-26 08:33:58,298][123090] Updated weights for policy 1, policy_version 1116121 (0.0010) [2023-12-26 08:33:58,786][121949] Fps is (10 sec: 17199.7, 60 sec: 17885.3, 300 sec: 17772.4). Total num frames: 573464576. Throughput: 0: 8903.4, 1: 9006.1. Samples: 573461208. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:33:58,787][121949] Avg episode reward: [(0, '6388.894'), (1, '5948.744')] [2023-12-26 08:33:58,866][123091] Updated weights for policy 0, policy_version 1123954 (0.0009) [2023-12-26 08:33:58,946][123091] Updated weights for policy 0, policy_version 1123964 (0.0006) [2023-12-26 08:33:59,016][123091] Updated weights for policy 0, policy_version 1123974 (0.0007) [2023-12-26 08:33:59,070][123091] Updated weights for policy 0, policy_version 1123984 (0.0007) [2023-12-26 08:33:59,235][123090] Updated weights for policy 1, policy_version 1116131 (0.0009) [2023-12-26 08:33:59,295][123090] Updated weights for policy 1, policy_version 1116141 (0.0008) [2023-12-26 08:33:59,355][123090] Updated weights for policy 1, policy_version 1116151 (0.0008) [2023-12-26 08:33:59,865][123091] Updated weights for policy 0, policy_version 1123994 (0.0008) [2023-12-26 08:33:59,912][123091] Updated weights for policy 0, policy_version 1124004 (0.0006) [2023-12-26 08:33:59,971][123091] Updated weights for policy 0, policy_version 1124014 (0.0007) [2023-12-26 08:34:00,096][123090] Updated weights for policy 1, policy_version 1116161 (0.0008) [2023-12-26 08:34:00,160][123090] Updated weights for policy 1, policy_version 1116171 (0.0005) [2023-12-26 08:34:00,221][123090] Updated weights for policy 1, policy_version 1116181 (0.0005) [2023-12-26 08:34:00,281][123090] Updated weights for policy 1, policy_version 1116191 (0.0005) [2023-12-26 08:34:00,781][123091] Updated weights for policy 0, policy_version 1124024 (0.0008) [2023-12-26 08:34:00,835][123091] Updated weights for policy 0, policy_version 1124034 (0.0010) [2023-12-26 08:34:00,887][123091] Updated weights for policy 0, policy_version 1124044 (0.0009) [2023-12-26 08:34:00,946][123090] Updated weights for policy 1, policy_version 1116201 (0.0005) [2023-12-26 08:34:01,004][123090] Updated weights for policy 1, policy_version 1116211 (0.0005) [2023-12-26 08:34:01,094][123090] Updated weights for policy 1, policy_version 1116221 (0.0008) [2023-12-26 08:34:01,798][123091] Updated weights for policy 0, policy_version 1124054 (0.0007) [2023-12-26 08:34:01,844][123091] Updated weights for policy 0, policy_version 1124064 (0.0005) [2023-12-26 08:34:01,862][123090] Updated weights for policy 1, policy_version 1116231 (0.0008) [2023-12-26 08:34:01,892][123091] Updated weights for policy 0, policy_version 1124074 (0.0006) [2023-12-26 08:34:01,931][123090] Updated weights for policy 1, policy_version 1116241 (0.0009) [2023-12-26 08:34:01,999][123090] Updated weights for policy 1, policy_version 1116251 (0.0010) [2023-12-26 08:34:02,591][123091] Updated weights for policy 0, policy_version 1124084 (0.0005) [2023-12-26 08:34:02,659][123091] Updated weights for policy 0, policy_version 1124094 (0.0005) [2023-12-26 08:34:02,719][123091] Updated weights for policy 0, policy_version 1124104 (0.0005) [2023-12-26 08:34:02,731][123090] Updated weights for policy 1, policy_version 1116261 (0.0008) [2023-12-26 08:34:02,798][123090] Updated weights for policy 1, policy_version 1116271 (0.0007) [2023-12-26 08:34:02,869][123090] Updated weights for policy 1, policy_version 1116281 (0.0006) [2023-12-26 08:34:03,474][123091] Updated weights for policy 0, policy_version 1124114 (0.0008) [2023-12-26 08:34:03,539][123091] Updated weights for policy 0, policy_version 1124124 (0.0005) [2023-12-26 08:34:03,601][123091] Updated weights for policy 0, policy_version 1124134 (0.0005) [2023-12-26 08:34:03,607][123090] Updated weights for policy 1, policy_version 1116291 (0.0007) [2023-12-26 08:34:03,659][123091] Updated weights for policy 0, policy_version 1124144 (0.0005) [2023-12-26 08:34:03,676][123090] Updated weights for policy 1, policy_version 1116301 (0.0009) [2023-12-26 08:34:03,732][123090] Updated weights for policy 1, policy_version 1116311 (0.0010) [2023-12-26 08:34:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 573562880. Throughput: 0: 8842.1, 1: 9021.1. Samples: 573567924. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:03,784][121949] Avg episode reward: [(0, '6313.929'), (1, '5961.929')] [2023-12-26 08:34:04,371][123091] Updated weights for policy 0, policy_version 1124154 (0.0006) [2023-12-26 08:34:04,415][123090] Updated weights for policy 1, policy_version 1116321 (0.0010) [2023-12-26 08:34:04,436][123091] Updated weights for policy 0, policy_version 1124164 (0.0007) [2023-12-26 08:34:04,478][123090] Updated weights for policy 1, policy_version 1116331 (0.0010) [2023-12-26 08:34:04,500][123091] Updated weights for policy 0, policy_version 1124174 (0.0007) [2023-12-26 08:34:04,540][123090] Updated weights for policy 1, policy_version 1116341 (0.0008) [2023-12-26 08:34:04,601][123090] Updated weights for policy 1, policy_version 1116351 (0.0005) [2023-12-26 08:34:05,302][123090] Updated weights for policy 1, policy_version 1116361 (0.0005) [2023-12-26 08:34:05,357][123091] Updated weights for policy 0, policy_version 1124184 (0.0009) [2023-12-26 08:34:05,359][123090] Updated weights for policy 1, policy_version 1116371 (0.0005) [2023-12-26 08:34:05,415][123090] Updated weights for policy 1, policy_version 1116381 (0.0005) [2023-12-26 08:34:05,415][123091] Updated weights for policy 0, policy_version 1124194 (0.0009) [2023-12-26 08:34:05,466][123091] Updated weights for policy 0, policy_version 1124204 (0.0010) [2023-12-26 08:34:06,077][123090] Updated weights for policy 1, policy_version 1116391 (0.0006) [2023-12-26 08:34:06,153][123090] Updated weights for policy 1, policy_version 1116401 (0.0007) [2023-12-26 08:34:06,221][123090] Updated weights for policy 1, policy_version 1116411 (0.0010) [2023-12-26 08:34:06,329][123091] Updated weights for policy 0, policy_version 1124215 (0.0009) [2023-12-26 08:34:06,403][123091] Updated weights for policy 0, policy_version 1124225 (0.0013) [2023-12-26 08:34:06,473][123091] Updated weights for policy 0, policy_version 1124235 (0.0007) [2023-12-26 08:34:06,992][123090] Updated weights for policy 1, policy_version 1116421 (0.0010) [2023-12-26 08:34:07,044][123090] Updated weights for policy 1, policy_version 1116431 (0.0010) [2023-12-26 08:34:07,114][123090] Updated weights for policy 1, policy_version 1116441 (0.0010) [2023-12-26 08:34:07,265][123091] Updated weights for policy 0, policy_version 1124245 (0.0007) [2023-12-26 08:34:07,314][123091] Updated weights for policy 0, policy_version 1124255 (0.0009) [2023-12-26 08:34:07,369][123091] Updated weights for policy 0, policy_version 1124265 (0.0006) [2023-12-26 08:34:07,843][123090] Updated weights for policy 1, policy_version 1116451 (0.0011) [2023-12-26 08:34:07,890][123090] Updated weights for policy 1, policy_version 1116461 (0.0010) [2023-12-26 08:34:07,937][123090] Updated weights for policy 1, policy_version 1116471 (0.0010) [2023-12-26 08:34:08,139][123091] Updated weights for policy 0, policy_version 1124275 (0.0005) [2023-12-26 08:34:08,194][123091] Updated weights for policy 0, policy_version 1124285 (0.0005) [2023-12-26 08:34:08,243][123091] Updated weights for policy 0, policy_version 1124295 (0.0005) [2023-12-26 08:34:08,730][123090] Updated weights for policy 1, policy_version 1116481 (0.0010) [2023-12-26 08:34:08,784][121949] Fps is (10 sec: 18025.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 573644800. Throughput: 0: 8820.1, 1: 9120.1. Samples: 573623716. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:08,785][121949] Avg episode reward: [(0, '6280.223'), (1, '6013.613')] [2023-12-26 08:34:08,789][123090] Updated weights for policy 1, policy_version 1116491 (0.0010) [2023-12-26 08:34:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001124304_287825920.pth... [2023-12-26 08:34:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001123312_287571968.pth [2023-12-26 08:34:08,838][123090] Updated weights for policy 1, policy_version 1116501 (0.0006) [2023-12-26 08:34:08,886][123090] Updated weights for policy 1, policy_version 1116511 (0.0008) [2023-12-26 08:34:08,890][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001116512_285827072.pth... [2023-12-26 08:34:08,893][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001115424_285548544.pth [2023-12-26 08:34:09,022][123091] Updated weights for policy 0, policy_version 1124305 (0.0006) [2023-12-26 08:34:09,070][123091] Updated weights for policy 0, policy_version 1124315 (0.0009) [2023-12-26 08:34:09,118][123091] Updated weights for policy 0, policy_version 1124325 (0.0009) [2023-12-26 08:34:09,170][123091] Updated weights for policy 0, policy_version 1124335 (0.0009) [2023-12-26 08:34:09,728][123090] Updated weights for policy 1, policy_version 1116521 (0.0011) [2023-12-26 08:34:09,792][123090] Updated weights for policy 1, policy_version 1116531 (0.0011) [2023-12-26 08:34:09,864][123090] Updated weights for policy 1, policy_version 1116541 (0.0008) [2023-12-26 08:34:09,944][123091] Updated weights for policy 0, policy_version 1124345 (0.0013) [2023-12-26 08:34:10,014][123091] Updated weights for policy 0, policy_version 1124355 (0.0011) [2023-12-26 08:34:10,085][123091] Updated weights for policy 0, policy_version 1124365 (0.0011) [2023-12-26 08:34:10,688][123090] Updated weights for policy 1, policy_version 1116551 (0.0010) [2023-12-26 08:34:10,754][123090] Updated weights for policy 1, policy_version 1116561 (0.0008) [2023-12-26 08:34:10,812][123090] Updated weights for policy 1, policy_version 1116571 (0.0009) [2023-12-26 08:34:10,909][123091] Updated weights for policy 0, policy_version 1124375 (0.0010) [2023-12-26 08:34:10,959][123091] Updated weights for policy 0, policy_version 1124385 (0.0010) [2023-12-26 08:34:11,005][123091] Updated weights for policy 0, policy_version 1124395 (0.0008) [2023-12-26 08:34:11,644][123090] Updated weights for policy 1, policy_version 1116581 (0.0010) [2023-12-26 08:34:11,715][123090] Updated weights for policy 1, policy_version 1116591 (0.0010) [2023-12-26 08:34:11,784][123090] Updated weights for policy 1, policy_version 1116601 (0.0008) [2023-12-26 08:34:11,939][123091] Updated weights for policy 0, policy_version 1124405 (0.0010) [2023-12-26 08:34:11,997][123091] Updated weights for policy 0, policy_version 1124415 (0.0010) [2023-12-26 08:34:12,054][123091] Updated weights for policy 0, policy_version 1124425 (0.0009) [2023-12-26 08:34:12,560][123090] Updated weights for policy 1, policy_version 1116611 (0.0010) [2023-12-26 08:34:12,611][123090] Updated weights for policy 1, policy_version 1116621 (0.0010) [2023-12-26 08:34:12,672][123090] Updated weights for policy 1, policy_version 1116631 (0.0009) [2023-12-26 08:34:12,946][123091] Updated weights for policy 0, policy_version 1124435 (0.0010) [2023-12-26 08:34:13,007][123091] Updated weights for policy 0, policy_version 1124445 (0.0009) [2023-12-26 08:34:13,070][123091] Updated weights for policy 0, policy_version 1124455 (0.0010) [2023-12-26 08:34:13,465][123090] Updated weights for policy 1, policy_version 1116641 (0.0009) [2023-12-26 08:34:13,520][123090] Updated weights for policy 1, policy_version 1116651 (0.0005) [2023-12-26 08:34:13,590][123090] Updated weights for policy 1, policy_version 1116661 (0.0005) [2023-12-26 08:34:13,661][123090] Updated weights for policy 1, policy_version 1116671 (0.0006) [2023-12-26 08:34:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 573734912. Throughput: 0: 8742.4, 1: 9073.5. Samples: 573728308. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:13,785][121949] Avg episode reward: [(0, '6343.156'), (1, '5959.636')] [2023-12-26 08:34:13,916][123091] Updated weights for policy 0, policy_version 1124465 (0.0009) [2023-12-26 08:34:13,970][123091] Updated weights for policy 0, policy_version 1124475 (0.0009) [2023-12-26 08:34:14,026][123091] Updated weights for policy 0, policy_version 1124485 (0.0010) [2023-12-26 08:34:14,079][123091] Updated weights for policy 0, policy_version 1124495 (0.0009) [2023-12-26 08:34:14,309][123090] Updated weights for policy 1, policy_version 1116681 (0.0009) [2023-12-26 08:34:14,370][123090] Updated weights for policy 1, policy_version 1116691 (0.0010) [2023-12-26 08:34:14,432][123090] Updated weights for policy 1, policy_version 1116701 (0.0010) [2023-12-26 08:34:14,979][123091] Updated weights for policy 0, policy_version 1124505 (0.0010) [2023-12-26 08:34:15,048][123091] Updated weights for policy 0, policy_version 1124515 (0.0010) [2023-12-26 08:34:15,116][123091] Updated weights for policy 0, policy_version 1124525 (0.0009) [2023-12-26 08:34:15,234][123090] Updated weights for policy 1, policy_version 1116711 (0.0011) [2023-12-26 08:34:15,302][123090] Updated weights for policy 1, policy_version 1116721 (0.0011) [2023-12-26 08:34:15,370][123090] Updated weights for policy 1, policy_version 1116731 (0.0011) [2023-12-26 08:34:15,896][123091] Updated weights for policy 0, policy_version 1124535 (0.0008) [2023-12-26 08:34:15,943][123091] Updated weights for policy 0, policy_version 1124545 (0.0008) [2023-12-26 08:34:15,991][123091] Updated weights for policy 0, policy_version 1124555 (0.0009) [2023-12-26 08:34:16,168][123090] Updated weights for policy 1, policy_version 1116741 (0.0010) [2023-12-26 08:34:16,219][123090] Updated weights for policy 1, policy_version 1116751 (0.0010) [2023-12-26 08:34:16,270][123090] Updated weights for policy 1, policy_version 1116761 (0.0010) [2023-12-26 08:34:16,888][123091] Updated weights for policy 0, policy_version 1124565 (0.0009) [2023-12-26 08:34:16,952][123090] Updated weights for policy 1, policy_version 1116771 (0.0009) [2023-12-26 08:34:16,956][123091] Updated weights for policy 0, policy_version 1124575 (0.0009) [2023-12-26 08:34:17,005][123090] Updated weights for policy 1, policy_version 1116781 (0.0006) [2023-12-26 08:34:17,025][123091] Updated weights for policy 0, policy_version 1124585 (0.0009) [2023-12-26 08:34:17,063][123090] Updated weights for policy 1, policy_version 1116791 (0.0007) [2023-12-26 08:34:17,757][123091] Updated weights for policy 0, policy_version 1124595 (0.0009) [2023-12-26 08:34:17,821][123091] Updated weights for policy 0, policy_version 1124605 (0.0009) [2023-12-26 08:34:17,880][123090] Updated weights for policy 1, policy_version 1116801 (0.0011) [2023-12-26 08:34:17,883][123091] Updated weights for policy 0, policy_version 1124615 (0.0007) [2023-12-26 08:34:17,936][123090] Updated weights for policy 1, policy_version 1116811 (0.0010) [2023-12-26 08:34:18,019][123090] Updated weights for policy 1, policy_version 1116821 (0.0011) [2023-12-26 08:34:18,092][123090] Updated weights for policy 1, policy_version 1116831 (0.0011) [2023-12-26 08:34:18,663][123091] Updated weights for policy 0, policy_version 1124625 (0.0008) [2023-12-26 08:34:18,720][123091] Updated weights for policy 0, policy_version 1124635 (0.0010) [2023-12-26 08:34:18,773][123091] Updated weights for policy 0, policy_version 1124646 (0.0010) [2023-12-26 08:34:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.5, 300 sec: 17772.5). Total num frames: 573816832. Throughput: 0: 8712.5, 1: 9050.2. Samples: 573834852. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:18,784][121949] Avg episode reward: [(0, '6419.014'), (1, '5933.313')] [2023-12-26 08:34:18,814][123090] Updated weights for policy 1, policy_version 1116841 (0.0006) [2023-12-26 08:34:18,824][123091] Updated weights for policy 0, policy_version 1124656 (0.0008) [2023-12-26 08:34:18,875][123090] Updated weights for policy 1, policy_version 1116851 (0.0006) [2023-12-26 08:34:18,931][123090] Updated weights for policy 1, policy_version 1116861 (0.0005) [2023-12-26 08:34:19,743][123090] Updated weights for policy 1, policy_version 1116871 (0.0007) [2023-12-26 08:34:19,745][123091] Updated weights for policy 0, policy_version 1124666 (0.0008) [2023-12-26 08:34:19,795][123091] Updated weights for policy 0, policy_version 1124676 (0.0008) [2023-12-26 08:34:19,804][123090] Updated weights for policy 1, policy_version 1116881 (0.0008) [2023-12-26 08:34:19,855][123091] Updated weights for policy 0, policy_version 1124686 (0.0008) [2023-12-26 08:34:19,870][123090] Updated weights for policy 1, policy_version 1116891 (0.0009) [2023-12-26 08:34:20,690][123091] Updated weights for policy 0, policy_version 1124697 (0.0011) [2023-12-26 08:34:20,715][123090] Updated weights for policy 1, policy_version 1116901 (0.0008) [2023-12-26 08:34:20,740][123091] Updated weights for policy 0, policy_version 1124707 (0.0009) [2023-12-26 08:34:20,776][123090] Updated weights for policy 1, policy_version 1116911 (0.0009) [2023-12-26 08:34:20,792][123091] Updated weights for policy 0, policy_version 1124717 (0.0009) [2023-12-26 08:34:20,831][123090] Updated weights for policy 1, policy_version 1116921 (0.0008) [2023-12-26 08:34:21,639][123091] Updated weights for policy 0, policy_version 1124727 (0.0008) [2023-12-26 08:34:21,701][123091] Updated weights for policy 0, policy_version 1124737 (0.0007) [2023-12-26 08:34:21,734][123090] Updated weights for policy 1, policy_version 1116931 (0.0009) [2023-12-26 08:34:21,752][123091] Updated weights for policy 0, policy_version 1124747 (0.0006) [2023-12-26 08:34:21,798][123090] Updated weights for policy 1, policy_version 1116941 (0.0009) [2023-12-26 08:34:21,860][123090] Updated weights for policy 1, policy_version 1116951 (0.0008) [2023-12-26 08:34:22,522][123091] Updated weights for policy 0, policy_version 1124757 (0.0008) [2023-12-26 08:34:22,585][123091] Updated weights for policy 0, policy_version 1124767 (0.0008) [2023-12-26 08:34:22,648][123091] Updated weights for policy 0, policy_version 1124777 (0.0009) [2023-12-26 08:34:22,689][123090] Updated weights for policy 1, policy_version 1116961 (0.0009) [2023-12-26 08:34:22,749][123090] Updated weights for policy 1, policy_version 1116971 (0.0009) [2023-12-26 08:34:22,802][123090] Updated weights for policy 1, policy_version 1116981 (0.0009) [2023-12-26 08:34:22,850][123090] Updated weights for policy 1, policy_version 1116991 (0.0009) [2023-12-26 08:34:23,436][123091] Updated weights for policy 0, policy_version 1124787 (0.0009) [2023-12-26 08:34:23,500][123091] Updated weights for policy 0, policy_version 1124797 (0.0005) [2023-12-26 08:34:23,549][123091] Updated weights for policy 0, policy_version 1124807 (0.0005) [2023-12-26 08:34:23,752][123090] Updated weights for policy 1, policy_version 1117001 (0.0009) [2023-12-26 08:34:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 573906944. Throughput: 0: 8627.5, 1: 9092.5. Samples: 573885532. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:23,785][121949] Avg episode reward: [(0, '6401.394'), (1, '5956.332')] [2023-12-26 08:34:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001124816_287956992.pth... [2023-12-26 08:34:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001123792_287694848.pth [2023-12-26 08:34:23,806][123090] Updated weights for policy 1, policy_version 1117011 (0.0010) [2023-12-26 08:34:23,869][123090] Updated weights for policy 1, policy_version 1117021 (0.0010) [2023-12-26 08:34:23,884][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001117024_285958144.pth... [2023-12-26 08:34:23,887][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001115968_285687808.pth [2023-12-26 08:34:24,214][123091] Updated weights for policy 0, policy_version 1124817 (0.0006) [2023-12-26 08:34:24,279][123091] Updated weights for policy 0, policy_version 1124827 (0.0011) [2023-12-26 08:34:24,342][123091] Updated weights for policy 0, policy_version 1124837 (0.0009) [2023-12-26 08:34:24,397][123091] Updated weights for policy 0, policy_version 1124847 (0.0007) [2023-12-26 08:34:24,752][123090] Updated weights for policy 1, policy_version 1117031 (0.0009) [2023-12-26 08:34:24,811][123090] Updated weights for policy 1, policy_version 1117041 (0.0010) [2023-12-26 08:34:24,870][123090] Updated weights for policy 1, policy_version 1117051 (0.0010) [2023-12-26 08:34:25,107][123091] Updated weights for policy 0, policy_version 1124857 (0.0006) [2023-12-26 08:34:25,173][123091] Updated weights for policy 0, policy_version 1124867 (0.0005) [2023-12-26 08:34:25,243][123091] Updated weights for policy 0, policy_version 1124877 (0.0005) [2023-12-26 08:34:25,677][123090] Updated weights for policy 1, policy_version 1117061 (0.0008) [2023-12-26 08:34:25,735][123090] Updated weights for policy 1, policy_version 1117071 (0.0009) [2023-12-26 08:34:25,791][123090] Updated weights for policy 1, policy_version 1117081 (0.0005) [2023-12-26 08:34:25,983][123091] Updated weights for policy 0, policy_version 1124887 (0.0009) [2023-12-26 08:34:26,026][123091] Updated weights for policy 0, policy_version 1124897 (0.0010) [2023-12-26 08:34:26,085][123091] Updated weights for policy 0, policy_version 1124907 (0.0010) [2023-12-26 08:34:26,450][123090] Updated weights for policy 1, policy_version 1117091 (0.0005) [2023-12-26 08:34:26,517][123090] Updated weights for policy 1, policy_version 1117101 (0.0006) [2023-12-26 08:34:26,592][123090] Updated weights for policy 1, policy_version 1117111 (0.0005) [2023-12-26 08:34:26,901][123091] Updated weights for policy 0, policy_version 1124917 (0.0010) [2023-12-26 08:34:26,952][123091] Updated weights for policy 0, policy_version 1124927 (0.0010) [2023-12-26 08:34:27,007][123091] Updated weights for policy 0, policy_version 1124937 (0.0006) [2023-12-26 08:34:27,203][123090] Updated weights for policy 1, policy_version 1117121 (0.0008) [2023-12-26 08:34:27,263][123090] Updated weights for policy 1, policy_version 1117131 (0.0010) [2023-12-26 08:34:27,329][123090] Updated weights for policy 1, policy_version 1117141 (0.0006) [2023-12-26 08:34:27,378][123090] Updated weights for policy 1, policy_version 1117151 (0.0006) [2023-12-26 08:34:27,735][123091] Updated weights for policy 0, policy_version 1124947 (0.0007) [2023-12-26 08:34:27,783][123091] Updated weights for policy 0, policy_version 1124957 (0.0005) [2023-12-26 08:34:27,832][123091] Updated weights for policy 0, policy_version 1124967 (0.0005) [2023-12-26 08:34:28,056][123090] Updated weights for policy 1, policy_version 1117161 (0.0005) [2023-12-26 08:34:28,129][123090] Updated weights for policy 1, policy_version 1117171 (0.0005) [2023-12-26 08:34:28,202][123090] Updated weights for policy 1, policy_version 1117181 (0.0005) [2023-12-26 08:34:28,640][123091] Updated weights for policy 0, policy_version 1124977 (0.0008) [2023-12-26 08:34:28,687][123091] Updated weights for policy 0, policy_version 1124987 (0.0010) [2023-12-26 08:34:28,742][123091] Updated weights for policy 0, policy_version 1124997 (0.0010) [2023-12-26 08:34:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 573997056. Throughput: 0: 8641.0, 1: 9112.1. Samples: 573994464. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:28,785][121949] Avg episode reward: [(0, '6315.633'), (1, '6041.717')] [2023-12-26 08:34:28,794][123091] Updated weights for policy 0, policy_version 1125007 (0.0010) [2023-12-26 08:34:28,891][123090] Updated weights for policy 1, policy_version 1117191 (0.0007) [2023-12-26 08:34:28,959][123090] Updated weights for policy 1, policy_version 1117201 (0.0005) [2023-12-26 08:34:29,027][123090] Updated weights for policy 1, policy_version 1117211 (0.0008) [2023-12-26 08:34:29,627][123091] Updated weights for policy 0, policy_version 1125017 (0.0006) [2023-12-26 08:34:29,687][123090] Updated weights for policy 1, policy_version 1117221 (0.0009) [2023-12-26 08:34:29,701][123091] Updated weights for policy 0, policy_version 1125027 (0.0005) [2023-12-26 08:34:29,752][123090] Updated weights for policy 1, policy_version 1117231 (0.0009) [2023-12-26 08:34:29,754][123091] Updated weights for policy 0, policy_version 1125037 (0.0007) [2023-12-26 08:34:29,815][123090] Updated weights for policy 1, policy_version 1117241 (0.0008) [2023-12-26 08:34:30,466][123091] Updated weights for policy 0, policy_version 1125047 (0.0010) [2023-12-26 08:34:30,525][123091] Updated weights for policy 0, policy_version 1125057 (0.0010) [2023-12-26 08:34:30,599][123091] Updated weights for policy 0, policy_version 1125067 (0.0008) [2023-12-26 08:34:30,601][123090] Updated weights for policy 1, policy_version 1117251 (0.0009) [2023-12-26 08:34:30,668][123090] Updated weights for policy 1, policy_version 1117261 (0.0007) [2023-12-26 08:34:30,733][123090] Updated weights for policy 1, policy_version 1117271 (0.0009) [2023-12-26 08:34:31,421][123091] Updated weights for policy 0, policy_version 1125077 (0.0009) [2023-12-26 08:34:31,465][123090] Updated weights for policy 1, policy_version 1117281 (0.0006) [2023-12-26 08:34:31,482][123091] Updated weights for policy 0, policy_version 1125087 (0.0008) [2023-12-26 08:34:31,524][123090] Updated weights for policy 1, policy_version 1117291 (0.0010) [2023-12-26 08:34:31,543][123091] Updated weights for policy 0, policy_version 1125097 (0.0008) [2023-12-26 08:34:31,584][123090] Updated weights for policy 1, policy_version 1117301 (0.0010) [2023-12-26 08:34:31,648][123090] Updated weights for policy 1, policy_version 1117311 (0.0011) [2023-12-26 08:34:32,304][123091] Updated weights for policy 0, policy_version 1125107 (0.0009) [2023-12-26 08:34:32,367][123091] Updated weights for policy 0, policy_version 1125117 (0.0011) [2023-12-26 08:34:32,426][123091] Updated weights for policy 0, policy_version 1125127 (0.0010) [2023-12-26 08:34:32,476][123090] Updated weights for policy 1, policy_version 1117321 (0.0006) [2023-12-26 08:34:32,528][123090] Updated weights for policy 1, policy_version 1117331 (0.0009) [2023-12-26 08:34:32,577][123090] Updated weights for policy 1, policy_version 1117341 (0.0009) [2023-12-26 08:34:33,256][123091] Updated weights for policy 0, policy_version 1125137 (0.0010) [2023-12-26 08:34:33,303][123091] Updated weights for policy 0, policy_version 1125147 (0.0005) [2023-12-26 08:34:33,347][123091] Updated weights for policy 0, policy_version 1125157 (0.0005) [2023-12-26 08:34:33,418][123091] Updated weights for policy 0, policy_version 1125167 (0.0005) [2023-12-26 08:34:33,445][123090] Updated weights for policy 1, policy_version 1117351 (0.0009) [2023-12-26 08:34:33,502][123090] Updated weights for policy 1, policy_version 1117361 (0.0009) [2023-12-26 08:34:33,558][123090] Updated weights for policy 1, policy_version 1117371 (0.0009) [2023-12-26 08:34:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 574095360. Throughput: 0: 8701.0, 1: 9104.8. Samples: 574103612. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:33,785][121949] Avg episode reward: [(0, '6218.542'), (1, '6049.214')] [2023-12-26 08:34:34,156][123091] Updated weights for policy 0, policy_version 1125177 (0.0006) [2023-12-26 08:34:34,223][123091] Updated weights for policy 0, policy_version 1125187 (0.0010) [2023-12-26 08:34:34,291][123091] Updated weights for policy 0, policy_version 1125197 (0.0011) [2023-12-26 08:34:34,418][123090] Updated weights for policy 1, policy_version 1117381 (0.0009) [2023-12-26 08:34:34,488][123090] Updated weights for policy 1, policy_version 1117391 (0.0009) [2023-12-26 08:34:34,548][123090] Updated weights for policy 1, policy_version 1117401 (0.0009) [2023-12-26 08:34:35,045][123091] Updated weights for policy 0, policy_version 1125207 (0.0011) [2023-12-26 08:34:35,092][123091] Updated weights for policy 0, policy_version 1125217 (0.0010) [2023-12-26 08:34:35,136][123091] Updated weights for policy 0, policy_version 1125227 (0.0010) [2023-12-26 08:34:35,248][123090] Updated weights for policy 1, policy_version 1117411 (0.0009) [2023-12-26 08:34:35,315][123090] Updated weights for policy 1, policy_version 1117421 (0.0009) [2023-12-26 08:34:35,385][123090] Updated weights for policy 1, policy_version 1117431 (0.0009) [2023-12-26 08:34:35,853][123091] Updated weights for policy 0, policy_version 1125237 (0.0008) [2023-12-26 08:34:35,922][123091] Updated weights for policy 0, policy_version 1125247 (0.0007) [2023-12-26 08:34:35,989][123091] Updated weights for policy 0, policy_version 1125257 (0.0009) [2023-12-26 08:34:36,273][123090] Updated weights for policy 1, policy_version 1117441 (0.0009) [2023-12-26 08:34:36,330][123090] Updated weights for policy 1, policy_version 1117451 (0.0010) [2023-12-26 08:34:36,395][123090] Updated weights for policy 1, policy_version 1117461 (0.0009) [2023-12-26 08:34:36,460][123090] Updated weights for policy 1, policy_version 1117471 (0.0009) [2023-12-26 08:34:36,707][123091] Updated weights for policy 0, policy_version 1125267 (0.0007) [2023-12-26 08:34:36,773][123091] Updated weights for policy 0, policy_version 1125277 (0.0010) [2023-12-26 08:34:36,841][123091] Updated weights for policy 0, policy_version 1125287 (0.0011) [2023-12-26 08:34:37,331][123090] Updated weights for policy 1, policy_version 1117481 (0.0010) [2023-12-26 08:34:37,400][123090] Updated weights for policy 1, policy_version 1117491 (0.0009) [2023-12-26 08:34:37,470][123090] Updated weights for policy 1, policy_version 1117501 (0.0005) [2023-12-26 08:34:37,556][123091] Updated weights for policy 0, policy_version 1125297 (0.0009) [2023-12-26 08:34:37,620][123091] Updated weights for policy 0, policy_version 1125307 (0.0011) [2023-12-26 08:34:37,673][123091] Updated weights for policy 0, policy_version 1125317 (0.0010) [2023-12-26 08:34:37,733][123091] Updated weights for policy 0, policy_version 1125327 (0.0011) [2023-12-26 08:34:38,178][123090] Updated weights for policy 1, policy_version 1117511 (0.0009) [2023-12-26 08:34:38,241][123090] Updated weights for policy 1, policy_version 1117521 (0.0008) [2023-12-26 08:34:38,310][123090] Updated weights for policy 1, policy_version 1117531 (0.0007) [2023-12-26 08:34:38,548][123091] Updated weights for policy 0, policy_version 1125337 (0.0010) [2023-12-26 08:34:38,601][123091] Updated weights for policy 0, policy_version 1125347 (0.0008) [2023-12-26 08:34:38,659][123091] Updated weights for policy 0, policy_version 1125357 (0.0008) [2023-12-26 08:34:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 574185472. Throughput: 0: 8748.3, 1: 9070.6. Samples: 574157680. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:38,785][121949] Avg episode reward: [(0, '6272.752'), (1, '5964.667')] [2023-12-26 08:34:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001117536_286089216.pth... [2023-12-26 08:34:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001125360_288096256.pth... [2023-12-26 08:34:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001116512_285827072.pth [2023-12-26 08:34:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001124304_287825920.pth [2023-12-26 08:34:39,106][123090] Updated weights for policy 1, policy_version 1117541 (0.0011) [2023-12-26 08:34:39,165][123090] Updated weights for policy 1, policy_version 1117551 (0.0010) [2023-12-26 08:34:39,224][123090] Updated weights for policy 1, policy_version 1117561 (0.0010) [2023-12-26 08:34:39,419][123091] Updated weights for policy 0, policy_version 1125367 (0.0008) [2023-12-26 08:34:39,473][123091] Updated weights for policy 0, policy_version 1125377 (0.0006) [2023-12-26 08:34:39,535][123091] Updated weights for policy 0, policy_version 1125387 (0.0006) [2023-12-26 08:34:40,115][123090] Updated weights for policy 1, policy_version 1117571 (0.0010) [2023-12-26 08:34:40,181][123090] Updated weights for policy 1, policy_version 1117581 (0.0009) [2023-12-26 08:34:40,244][123090] Updated weights for policy 1, policy_version 1117591 (0.0010) [2023-12-26 08:34:40,350][123091] Updated weights for policy 0, policy_version 1125397 (0.0008) [2023-12-26 08:34:40,416][123091] Updated weights for policy 0, policy_version 1125407 (0.0010) [2023-12-26 08:34:40,482][123091] Updated weights for policy 0, policy_version 1125417 (0.0010) [2023-12-26 08:34:41,070][123090] Updated weights for policy 1, policy_version 1117601 (0.0009) [2023-12-26 08:34:41,145][123090] Updated weights for policy 1, policy_version 1117611 (0.0010) [2023-12-26 08:34:41,215][123090] Updated weights for policy 1, policy_version 1117621 (0.0009) [2023-12-26 08:34:41,286][123090] Updated weights for policy 1, policy_version 1117631 (0.0010) [2023-12-26 08:34:41,345][123091] Updated weights for policy 0, policy_version 1125427 (0.0010) [2023-12-26 08:34:41,411][123091] Updated weights for policy 0, policy_version 1125437 (0.0010) [2023-12-26 08:34:41,470][123091] Updated weights for policy 0, policy_version 1125447 (0.0010) [2023-12-26 08:34:42,070][123090] Updated weights for policy 1, policy_version 1117641 (0.0010) [2023-12-26 08:34:42,128][123090] Updated weights for policy 1, policy_version 1117651 (0.0009) [2023-12-26 08:34:42,187][123090] Updated weights for policy 1, policy_version 1117661 (0.0010) [2023-12-26 08:34:42,372][123091] Updated weights for policy 0, policy_version 1125457 (0.0010) [2023-12-26 08:34:42,429][123091] Updated weights for policy 0, policy_version 1125467 (0.0010) [2023-12-26 08:34:42,481][123091] Updated weights for policy 0, policy_version 1125477 (0.0009) [2023-12-26 08:34:42,538][123091] Updated weights for policy 0, policy_version 1125487 (0.0009) [2023-12-26 08:34:42,974][123090] Updated weights for policy 1, policy_version 1117671 (0.0010) [2023-12-26 08:34:43,033][123090] Updated weights for policy 1, policy_version 1117681 (0.0009) [2023-12-26 08:34:43,091][123090] Updated weights for policy 1, policy_version 1117691 (0.0009) [2023-12-26 08:34:43,433][123091] Updated weights for policy 0, policy_version 1125497 (0.0006) [2023-12-26 08:34:43,507][123091] Updated weights for policy 0, policy_version 1125507 (0.0006) [2023-12-26 08:34:43,581][123091] Updated weights for policy 0, policy_version 1125517 (0.0006) [2023-12-26 08:34:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 574267392. Throughput: 0: 8810.3, 1: 8963.2. Samples: 574260984. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:43,785][121949] Avg episode reward: [(0, '6247.022'), (1, '5970.668')] [2023-12-26 08:34:43,912][123090] Updated weights for policy 1, policy_version 1117701 (0.0007) [2023-12-26 08:34:43,957][123090] Updated weights for policy 1, policy_version 1117711 (0.0005) [2023-12-26 08:34:44,020][123090] Updated weights for policy 1, policy_version 1117721 (0.0005) [2023-12-26 08:34:44,199][123091] Updated weights for policy 0, policy_version 1125527 (0.0005) [2023-12-26 08:34:44,248][123091] Updated weights for policy 0, policy_version 1125537 (0.0005) [2023-12-26 08:34:44,298][123091] Updated weights for policy 0, policy_version 1125547 (0.0006) [2023-12-26 08:34:44,674][123090] Updated weights for policy 1, policy_version 1117731 (0.0005) [2023-12-26 08:34:44,733][123090] Updated weights for policy 1, policy_version 1117741 (0.0005) [2023-12-26 08:34:44,796][123090] Updated weights for policy 1, policy_version 1117751 (0.0010) [2023-12-26 08:34:44,958][123091] Updated weights for policy 0, policy_version 1125557 (0.0008) [2023-12-26 08:34:45,021][123091] Updated weights for policy 0, policy_version 1125567 (0.0008) [2023-12-26 08:34:45,077][123091] Updated weights for policy 0, policy_version 1125577 (0.0009) [2023-12-26 08:34:45,565][123090] Updated weights for policy 1, policy_version 1117761 (0.0010) [2023-12-26 08:34:45,643][123090] Updated weights for policy 1, policy_version 1117771 (0.0005) [2023-12-26 08:34:45,695][123090] Updated weights for policy 1, policy_version 1117781 (0.0005) [2023-12-26 08:34:45,749][123090] Updated weights for policy 1, policy_version 1117791 (0.0006) [2023-12-26 08:34:45,842][123091] Updated weights for policy 0, policy_version 1125587 (0.0008) [2023-12-26 08:34:45,905][123091] Updated weights for policy 0, policy_version 1125597 (0.0006) [2023-12-26 08:34:45,968][123091] Updated weights for policy 0, policy_version 1125607 (0.0005) [2023-12-26 08:34:46,408][123090] Updated weights for policy 1, policy_version 1117802 (0.0010) [2023-12-26 08:34:46,473][123090] Updated weights for policy 1, policy_version 1117812 (0.0009) [2023-12-26 08:34:46,539][123090] Updated weights for policy 1, policy_version 1117822 (0.0006) [2023-12-26 08:34:46,698][123091] Updated weights for policy 0, policy_version 1125617 (0.0006) [2023-12-26 08:34:46,750][123091] Updated weights for policy 0, policy_version 1125627 (0.0010) [2023-12-26 08:34:46,808][123091] Updated weights for policy 0, policy_version 1125638 (0.0010) [2023-12-26 08:34:46,862][123091] Updated weights for policy 0, policy_version 1125648 (0.0010) [2023-12-26 08:34:47,280][123090] Updated weights for policy 1, policy_version 1117832 (0.0005) [2023-12-26 08:34:47,335][123090] Updated weights for policy 1, policy_version 1117842 (0.0005) [2023-12-26 08:34:47,397][123090] Updated weights for policy 1, policy_version 1117852 (0.0007) [2023-12-26 08:34:47,739][123091] Updated weights for policy 0, policy_version 1125658 (0.0008) [2023-12-26 08:34:47,793][123091] Updated weights for policy 0, policy_version 1125669 (0.0010) [2023-12-26 08:34:47,849][123091] Updated weights for policy 0, policy_version 1125679 (0.0008) [2023-12-26 08:34:48,067][123090] Updated weights for policy 1, policy_version 1117862 (0.0007) [2023-12-26 08:34:48,139][123090] Updated weights for policy 1, policy_version 1117872 (0.0006) [2023-12-26 08:34:48,202][123090] Updated weights for policy 1, policy_version 1117882 (0.0006) [2023-12-26 08:34:48,601][123091] Updated weights for policy 0, policy_version 1125689 (0.0009) [2023-12-26 08:34:48,668][123091] Updated weights for policy 0, policy_version 1125699 (0.0009) [2023-12-26 08:34:48,737][123091] Updated weights for policy 0, policy_version 1125709 (0.0009) [2023-12-26 08:34:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 574365696. Throughput: 0: 8914.0, 1: 9029.9. Samples: 574375396. Policy #0 lag: (min: 28.0, avg: 31.1, max: 52.0) [2023-12-26 08:34:48,784][121949] Avg episode reward: [(0, '6215.326'), (1, '6010.740')] [2023-12-26 08:34:48,993][123090] Updated weights for policy 1, policy_version 1117892 (0.0011) [2023-12-26 08:34:49,052][123090] Updated weights for policy 1, policy_version 1117902 (0.0010) [2023-12-26 08:34:49,120][123090] Updated weights for policy 1, policy_version 1117912 (0.0011) [2023-12-26 08:34:49,604][123091] Updated weights for policy 0, policy_version 1125719 (0.0010) [2023-12-26 08:34:49,667][123091] Updated weights for policy 0, policy_version 1125729 (0.0008) [2023-12-26 08:34:49,724][123091] Updated weights for policy 0, policy_version 1125739 (0.0009) [2023-12-26 08:34:49,950][123090] Updated weights for policy 1, policy_version 1117922 (0.0011) [2023-12-26 08:34:50,018][123090] Updated weights for policy 1, policy_version 1117932 (0.0011) [2023-12-26 08:34:50,092][123090] Updated weights for policy 1, policy_version 1117942 (0.0011) [2023-12-26 08:34:50,157][123090] Updated weights for policy 1, policy_version 1117952 (0.0011) [2023-12-26 08:34:50,588][123091] Updated weights for policy 0, policy_version 1125749 (0.0009) [2023-12-26 08:34:50,650][123091] Updated weights for policy 0, policy_version 1125759 (0.0009) [2023-12-26 08:34:50,704][123091] Updated weights for policy 0, policy_version 1125769 (0.0009) [2023-12-26 08:34:51,009][123090] Updated weights for policy 1, policy_version 1117962 (0.0011) [2023-12-26 08:34:51,084][123090] Updated weights for policy 1, policy_version 1117972 (0.0011) [2023-12-26 08:34:51,153][123090] Updated weights for policy 1, policy_version 1117982 (0.0010) [2023-12-26 08:34:51,605][123091] Updated weights for policy 0, policy_version 1125779 (0.0009) [2023-12-26 08:34:51,676][123091] Updated weights for policy 0, policy_version 1125789 (0.0009) [2023-12-26 08:34:51,738][123091] Updated weights for policy 0, policy_version 1125799 (0.0009) [2023-12-26 08:34:52,002][123090] Updated weights for policy 1, policy_version 1117992 (0.0011) [2023-12-26 08:34:52,050][123090] Updated weights for policy 1, policy_version 1118002 (0.0010) [2023-12-26 08:34:52,102][123090] Updated weights for policy 1, policy_version 1118012 (0.0010) [2023-12-26 08:34:52,590][123091] Updated weights for policy 0, policy_version 1125809 (0.0009) [2023-12-26 08:34:52,648][123091] Updated weights for policy 0, policy_version 1125819 (0.0009) [2023-12-26 08:34:52,712][123091] Updated weights for policy 0, policy_version 1125829 (0.0009) [2023-12-26 08:34:52,768][123091] Updated weights for policy 0, policy_version 1125839 (0.0009) [2023-12-26 08:34:52,947][123090] Updated weights for policy 1, policy_version 1118022 (0.0010) [2023-12-26 08:34:53,004][123090] Updated weights for policy 1, policy_version 1118032 (0.0010) [2023-12-26 08:34:53,060][123090] Updated weights for policy 1, policy_version 1118042 (0.0009) [2023-12-26 08:34:53,380][123091] Updated weights for policy 0, policy_version 1125849 (0.0006) [2023-12-26 08:34:53,432][123091] Updated weights for policy 0, policy_version 1125859 (0.0005) [2023-12-26 08:34:53,495][123091] Updated weights for policy 0, policy_version 1125869 (0.0008) [2023-12-26 08:34:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 574447616. Throughput: 0: 8882.1, 1: 8925.7. Samples: 574425064. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:34:53,785][121949] Avg episode reward: [(0, '6264.924'), (1, '6042.297')] [2023-12-26 08:34:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001125872_288227328.pth... [2023-12-26 08:34:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001118048_286220288.pth... [2023-12-26 08:34:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001124816_287956992.pth [2023-12-26 08:34:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001117024_285958144.pth [2023-12-26 08:34:53,849][123090] Updated weights for policy 1, policy_version 1118052 (0.0008) [2023-12-26 08:34:53,923][123090] Updated weights for policy 1, policy_version 1118062 (0.0005) [2023-12-26 08:34:53,983][123090] Updated weights for policy 1, policy_version 1118072 (0.0005) [2023-12-26 08:34:54,110][123091] Updated weights for policy 0, policy_version 1125879 (0.0006) [2023-12-26 08:34:54,166][123091] Updated weights for policy 0, policy_version 1125889 (0.0006) [2023-12-26 08:34:54,222][123091] Updated weights for policy 0, policy_version 1125899 (0.0007) [2023-12-26 08:34:54,754][123090] Updated weights for policy 1, policy_version 1118082 (0.0006) [2023-12-26 08:34:54,804][123090] Updated weights for policy 1, policy_version 1118092 (0.0009) [2023-12-26 08:34:54,873][123090] Updated weights for policy 1, policy_version 1118102 (0.0009) [2023-12-26 08:34:54,933][123090] Updated weights for policy 1, policy_version 1118112 (0.0010) [2023-12-26 08:34:54,947][123091] Updated weights for policy 0, policy_version 1125909 (0.0008) [2023-12-26 08:34:55,021][123091] Updated weights for policy 0, policy_version 1125919 (0.0006) [2023-12-26 08:34:55,097][123091] Updated weights for policy 0, policy_version 1125929 (0.0005) [2023-12-26 08:34:55,751][123090] Updated weights for policy 1, policy_version 1118122 (0.0010) [2023-12-26 08:34:55,795][123091] Updated weights for policy 0, policy_version 1125939 (0.0009) [2023-12-26 08:34:55,807][123090] Updated weights for policy 1, policy_version 1118132 (0.0009) [2023-12-26 08:34:55,860][123091] Updated weights for policy 0, policy_version 1125949 (0.0006) [2023-12-26 08:34:55,876][123090] Updated weights for policy 1, policy_version 1118142 (0.0010) [2023-12-26 08:34:55,928][123091] Updated weights for policy 0, policy_version 1125959 (0.0009) [2023-12-26 08:34:56,642][123091] Updated weights for policy 0, policy_version 1125969 (0.0009) [2023-12-26 08:34:56,704][123091] Updated weights for policy 0, policy_version 1125979 (0.0010) [2023-12-26 08:34:56,706][123090] Updated weights for policy 1, policy_version 1118152 (0.0007) [2023-12-26 08:34:56,762][123091] Updated weights for policy 0, policy_version 1125989 (0.0010) [2023-12-26 08:34:56,773][123090] Updated weights for policy 1, policy_version 1118162 (0.0006) [2023-12-26 08:34:56,809][123091] Updated weights for policy 0, policy_version 1125999 (0.0010) [2023-12-26 08:34:56,834][123090] Updated weights for policy 1, policy_version 1118172 (0.0008) [2023-12-26 08:34:57,597][123091] Updated weights for policy 0, policy_version 1126009 (0.0006) [2023-12-26 08:34:57,652][123091] Updated weights for policy 0, policy_version 1126019 (0.0005) [2023-12-26 08:34:57,687][123090] Updated weights for policy 1, policy_version 1118182 (0.0009) [2023-12-26 08:34:57,699][123091] Updated weights for policy 0, policy_version 1126029 (0.0005) [2023-12-26 08:34:57,742][123090] Updated weights for policy 1, policy_version 1118192 (0.0010) [2023-12-26 08:34:57,805][123090] Updated weights for policy 1, policy_version 1118202 (0.0010) [2023-12-26 08:34:58,371][123091] Updated weights for policy 0, policy_version 1126039 (0.0008) [2023-12-26 08:34:58,437][123091] Updated weights for policy 0, policy_version 1126049 (0.0008) [2023-12-26 08:34:58,511][123091] Updated weights for policy 0, policy_version 1126059 (0.0008) [2023-12-26 08:34:58,716][123090] Updated weights for policy 1, policy_version 1118212 (0.0009) [2023-12-26 08:34:58,784][123090] Updated weights for policy 1, policy_version 1118222 (0.0008) [2023-12-26 08:34:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17886.5, 300 sec: 17800.3). Total num frames: 574537728. Throughput: 0: 9003.1, 1: 8907.6. Samples: 574534284. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:34:58,784][121949] Avg episode reward: [(0, '6331.182'), (1, '6041.518')] [2023-12-26 08:34:58,857][123090] Updated weights for policy 1, policy_version 1118232 (0.0008) [2023-12-26 08:34:59,383][123091] Updated weights for policy 0, policy_version 1126069 (0.0010) [2023-12-26 08:34:59,446][123091] Updated weights for policy 0, policy_version 1126079 (0.0010) [2023-12-26 08:34:59,521][123091] Updated weights for policy 0, policy_version 1126089 (0.0006) [2023-12-26 08:34:59,673][123090] Updated weights for policy 1, policy_version 1118242 (0.0007) [2023-12-26 08:34:59,729][123090] Updated weights for policy 1, policy_version 1118252 (0.0010) [2023-12-26 08:34:59,781][123090] Updated weights for policy 1, policy_version 1118262 (0.0009) [2023-12-26 08:34:59,843][123090] Updated weights for policy 1, policy_version 1118272 (0.0009) [2023-12-26 08:35:00,297][123091] Updated weights for policy 0, policy_version 1126099 (0.0007) [2023-12-26 08:35:00,361][123091] Updated weights for policy 0, policy_version 1126109 (0.0006) [2023-12-26 08:35:00,426][123091] Updated weights for policy 0, policy_version 1126119 (0.0009) [2023-12-26 08:35:00,744][123090] Updated weights for policy 1, policy_version 1118282 (0.0006) [2023-12-26 08:35:00,809][123090] Updated weights for policy 1, policy_version 1118292 (0.0010) [2023-12-26 08:35:00,870][123090] Updated weights for policy 1, policy_version 1118302 (0.0008) [2023-12-26 08:35:01,190][123091] Updated weights for policy 0, policy_version 1126129 (0.0008) [2023-12-26 08:35:01,242][123091] Updated weights for policy 0, policy_version 1126139 (0.0010) [2023-12-26 08:35:01,312][123091] Updated weights for policy 0, policy_version 1126149 (0.0010) [2023-12-26 08:35:01,385][123091] Updated weights for policy 0, policy_version 1126159 (0.0010) [2023-12-26 08:35:01,604][123090] Updated weights for policy 1, policy_version 1118312 (0.0006) [2023-12-26 08:35:01,673][123090] Updated weights for policy 1, policy_version 1118322 (0.0007) [2023-12-26 08:35:01,742][123090] Updated weights for policy 1, policy_version 1118332 (0.0010) [2023-12-26 08:35:02,202][123091] Updated weights for policy 0, policy_version 1126169 (0.0006) [2023-12-26 08:35:02,265][123091] Updated weights for policy 0, policy_version 1126179 (0.0006) [2023-12-26 08:35:02,326][123091] Updated weights for policy 0, policy_version 1126189 (0.0008) [2023-12-26 08:35:02,561][123090] Updated weights for policy 1, policy_version 1118342 (0.0009) [2023-12-26 08:35:02,609][123090] Updated weights for policy 1, policy_version 1118352 (0.0008) [2023-12-26 08:35:02,657][123090] Updated weights for policy 1, policy_version 1118362 (0.0007) [2023-12-26 08:35:03,053][123091] Updated weights for policy 0, policy_version 1126199 (0.0010) [2023-12-26 08:35:03,118][123091] Updated weights for policy 0, policy_version 1126209 (0.0011) [2023-12-26 08:35:03,183][123091] Updated weights for policy 0, policy_version 1126219 (0.0010) [2023-12-26 08:35:03,505][123090] Updated weights for policy 1, policy_version 1118372 (0.0005) [2023-12-26 08:35:03,578][123090] Updated weights for policy 1, policy_version 1118382 (0.0006) [2023-12-26 08:35:03,640][123090] Updated weights for policy 1, policy_version 1118392 (0.0010) [2023-12-26 08:35:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 574627840. Throughput: 0: 9046.2, 1: 8805.6. Samples: 574638184. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:03,785][121949] Avg episode reward: [(0, '6263.962'), (1, '6072.724')] [2023-12-26 08:35:03,962][123091] Updated weights for policy 0, policy_version 1126229 (0.0008) [2023-12-26 08:35:04,018][123091] Updated weights for policy 0, policy_version 1126239 (0.0006) [2023-12-26 08:35:04,073][123091] Updated weights for policy 0, policy_version 1126249 (0.0008) [2023-12-26 08:35:04,407][123090] Updated weights for policy 1, policy_version 1118402 (0.0010) [2023-12-26 08:35:04,463][123090] Updated weights for policy 1, policy_version 1118412 (0.0010) [2023-12-26 08:35:04,527][123090] Updated weights for policy 1, policy_version 1118422 (0.0010) [2023-12-26 08:35:04,590][123090] Updated weights for policy 1, policy_version 1118432 (0.0011) [2023-12-26 08:35:04,790][123091] Updated weights for policy 0, policy_version 1126259 (0.0010) [2023-12-26 08:35:04,846][123091] Updated weights for policy 0, policy_version 1126269 (0.0011) [2023-12-26 08:35:04,901][123091] Updated weights for policy 0, policy_version 1126279 (0.0010) [2023-12-26 08:35:05,460][123090] Updated weights for policy 1, policy_version 1118442 (0.0009) [2023-12-26 08:35:05,500][123091] Updated weights for policy 0, policy_version 1126289 (0.0007) [2023-12-26 08:35:05,510][123090] Updated weights for policy 1, policy_version 1118453 (0.0009) [2023-12-26 08:35:05,555][123091] Updated weights for policy 0, policy_version 1126299 (0.0005) [2023-12-26 08:35:05,564][123090] Updated weights for policy 1, policy_version 1118463 (0.0009) [2023-12-26 08:35:05,601][123091] Updated weights for policy 0, policy_version 1126309 (0.0005) [2023-12-26 08:35:05,653][123091] Updated weights for policy 0, policy_version 1126319 (0.0005) [2023-12-26 08:35:06,397][123091] Updated weights for policy 0, policy_version 1126329 (0.0008) [2023-12-26 08:35:06,466][123091] Updated weights for policy 0, policy_version 1126339 (0.0006) [2023-12-26 08:35:06,514][123090] Updated weights for policy 1, policy_version 1118473 (0.0009) [2023-12-26 08:35:06,531][123091] Updated weights for policy 0, policy_version 1126349 (0.0006) [2023-12-26 08:35:06,578][123090] Updated weights for policy 1, policy_version 1118483 (0.0009) [2023-12-26 08:35:06,631][123090] Updated weights for policy 1, policy_version 1118493 (0.0010) [2023-12-26 08:35:07,241][123091] Updated weights for policy 0, policy_version 1126359 (0.0009) [2023-12-26 08:35:07,289][123091] Updated weights for policy 0, policy_version 1126369 (0.0009) [2023-12-26 08:35:07,350][123091] Updated weights for policy 0, policy_version 1126379 (0.0006) [2023-12-26 08:35:07,544][123090] Updated weights for policy 1, policy_version 1118503 (0.0010) [2023-12-26 08:35:07,605][123090] Updated weights for policy 1, policy_version 1118513 (0.0010) [2023-12-26 08:35:07,664][123090] Updated weights for policy 1, policy_version 1118523 (0.0010) [2023-12-26 08:35:08,098][123091] Updated weights for policy 0, policy_version 1126389 (0.0006) [2023-12-26 08:35:08,152][123091] Updated weights for policy 0, policy_version 1126399 (0.0006) [2023-12-26 08:35:08,197][123091] Updated weights for policy 0, policy_version 1126409 (0.0005) [2023-12-26 08:35:08,463][123090] Updated weights for policy 1, policy_version 1118533 (0.0008) [2023-12-26 08:35:08,530][123090] Updated weights for policy 1, policy_version 1118543 (0.0005) [2023-12-26 08:35:08,594][123090] Updated weights for policy 1, policy_version 1118553 (0.0007) [2023-12-26 08:35:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 574717952. Throughput: 0: 9156.1, 1: 8774.5. Samples: 574692408. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:08,785][121949] Avg episode reward: [(0, '6272.956'), (1, '6019.088')] [2023-12-26 08:35:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001126416_288366592.pth... [2023-12-26 08:35:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001118560_286351360.pth... [2023-12-26 08:35:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001125360_288096256.pth [2023-12-26 08:35:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001117536_286089216.pth [2023-12-26 08:35:08,976][123091] Updated weights for policy 0, policy_version 1126419 (0.0007) [2023-12-26 08:35:09,032][123091] Updated weights for policy 0, policy_version 1126429 (0.0011) [2023-12-26 08:35:09,089][123091] Updated weights for policy 0, policy_version 1126439 (0.0011) [2023-12-26 08:35:09,342][123090] Updated weights for policy 1, policy_version 1118563 (0.0008) [2023-12-26 08:35:09,420][123090] Updated weights for policy 1, policy_version 1118573 (0.0009) [2023-12-26 08:35:09,486][123090] Updated weights for policy 1, policy_version 1118583 (0.0011) [2023-12-26 08:35:09,936][123091] Updated weights for policy 0, policy_version 1126449 (0.0009) [2023-12-26 08:35:10,006][123091] Updated weights for policy 0, policy_version 1126459 (0.0009) [2023-12-26 08:35:10,071][123091] Updated weights for policy 0, policy_version 1126469 (0.0010) [2023-12-26 08:35:10,136][123091] Updated weights for policy 0, policy_version 1126479 (0.0009) [2023-12-26 08:35:10,307][123090] Updated weights for policy 1, policy_version 1118593 (0.0010) [2023-12-26 08:35:10,367][123090] Updated weights for policy 1, policy_version 1118603 (0.0007) [2023-12-26 08:35:10,429][123090] Updated weights for policy 1, policy_version 1118613 (0.0006) [2023-12-26 08:35:10,486][123090] Updated weights for policy 1, policy_version 1118623 (0.0006) [2023-12-26 08:35:10,877][123091] Updated weights for policy 0, policy_version 1126489 (0.0006) [2023-12-26 08:35:10,938][123091] Updated weights for policy 0, policy_version 1126499 (0.0006) [2023-12-26 08:35:11,007][123091] Updated weights for policy 0, policy_version 1126509 (0.0005) [2023-12-26 08:35:11,107][123090] Updated weights for policy 1, policy_version 1118633 (0.0009) [2023-12-26 08:35:11,178][123090] Updated weights for policy 1, policy_version 1118643 (0.0008) [2023-12-26 08:35:11,249][123090] Updated weights for policy 1, policy_version 1118653 (0.0008) [2023-12-26 08:35:11,825][123091] Updated weights for policy 0, policy_version 1126519 (0.0008) [2023-12-26 08:35:11,886][123091] Updated weights for policy 0, policy_version 1126529 (0.0009) [2023-12-26 08:35:11,947][123091] Updated weights for policy 0, policy_version 1126539 (0.0009) [2023-12-26 08:35:12,130][123090] Updated weights for policy 1, policy_version 1118663 (0.0009) [2023-12-26 08:35:12,199][123090] Updated weights for policy 1, policy_version 1118673 (0.0009) [2023-12-26 08:35:12,265][123090] Updated weights for policy 1, policy_version 1118683 (0.0009) [2023-12-26 08:35:12,815][123091] Updated weights for policy 0, policy_version 1126549 (0.0011) [2023-12-26 08:35:12,866][123091] Updated weights for policy 0, policy_version 1126559 (0.0010) [2023-12-26 08:35:12,914][123091] Updated weights for policy 0, policy_version 1126569 (0.0010) [2023-12-26 08:35:13,102][123090] Updated weights for policy 1, policy_version 1118693 (0.0009) [2023-12-26 08:35:13,150][123090] Updated weights for policy 1, policy_version 1118703 (0.0009) [2023-12-26 08:35:13,203][123090] Updated weights for policy 1, policy_version 1118713 (0.0009) [2023-12-26 08:35:13,761][123091] Updated weights for policy 0, policy_version 1126579 (0.0010) [2023-12-26 08:35:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 574799872. Throughput: 0: 9092.5, 1: 8753.3. Samples: 574797524. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:13,784][121949] Avg episode reward: [(0, '6292.565'), (1, '5921.558')] [2023-12-26 08:35:13,820][123091] Updated weights for policy 0, policy_version 1126589 (0.0010) [2023-12-26 08:35:13,883][123091] Updated weights for policy 0, policy_version 1126599 (0.0011) [2023-12-26 08:35:14,053][123090] Updated weights for policy 1, policy_version 1118723 (0.0009) [2023-12-26 08:35:14,104][123090] Updated weights for policy 1, policy_version 1118733 (0.0008) [2023-12-26 08:35:14,164][123090] Updated weights for policy 1, policy_version 1118743 (0.0009) [2023-12-26 08:35:14,677][123091] Updated weights for policy 0, policy_version 1126609 (0.0010) [2023-12-26 08:35:14,723][123091] Updated weights for policy 0, policy_version 1126619 (0.0005) [2023-12-26 08:35:14,783][123091] Updated weights for policy 0, policy_version 1126629 (0.0009) [2023-12-26 08:35:14,847][123091] Updated weights for policy 0, policy_version 1126639 (0.0010) [2023-12-26 08:35:14,943][123090] Updated weights for policy 1, policy_version 1118753 (0.0008) [2023-12-26 08:35:15,011][123090] Updated weights for policy 1, policy_version 1118763 (0.0005) [2023-12-26 08:35:15,083][123090] Updated weights for policy 1, policy_version 1118773 (0.0010) [2023-12-26 08:35:15,143][123090] Updated weights for policy 1, policy_version 1118783 (0.0009) [2023-12-26 08:35:15,672][123091] Updated weights for policy 0, policy_version 1126649 (0.0006) [2023-12-26 08:35:15,743][123091] Updated weights for policy 0, policy_version 1126659 (0.0005) [2023-12-26 08:35:15,807][123091] Updated weights for policy 0, policy_version 1126669 (0.0005) [2023-12-26 08:35:15,998][123090] Updated weights for policy 1, policy_version 1118793 (0.0009) [2023-12-26 08:35:16,063][123090] Updated weights for policy 1, policy_version 1118803 (0.0010) [2023-12-26 08:35:16,123][123090] Updated weights for policy 1, policy_version 1118813 (0.0006) [2023-12-26 08:35:16,564][123091] Updated weights for policy 0, policy_version 1126679 (0.0008) [2023-12-26 08:35:16,615][123091] Updated weights for policy 0, policy_version 1126689 (0.0008) [2023-12-26 08:35:16,669][123091] Updated weights for policy 0, policy_version 1126699 (0.0006) [2023-12-26 08:35:16,857][123090] Updated weights for policy 1, policy_version 1118823 (0.0005) [2023-12-26 08:35:16,920][123090] Updated weights for policy 1, policy_version 1118833 (0.0006) [2023-12-26 08:35:16,996][123090] Updated weights for policy 1, policy_version 1118843 (0.0011) [2023-12-26 08:35:17,495][123091] Updated weights for policy 0, policy_version 1126709 (0.0008) [2023-12-26 08:35:17,554][123091] Updated weights for policy 0, policy_version 1126719 (0.0010) [2023-12-26 08:35:17,611][123091] Updated weights for policy 0, policy_version 1126729 (0.0010) [2023-12-26 08:35:17,641][123090] Updated weights for policy 1, policy_version 1118853 (0.0008) [2023-12-26 08:35:17,696][123090] Updated weights for policy 1, policy_version 1118863 (0.0009) [2023-12-26 08:35:17,747][123090] Updated weights for policy 1, policy_version 1118873 (0.0010) [2023-12-26 08:35:18,443][123090] Updated weights for policy 1, policy_version 1118883 (0.0010) [2023-12-26 08:35:18,502][123090] Updated weights for policy 1, policy_version 1118893 (0.0010) [2023-12-26 08:35:18,509][123091] Updated weights for policy 0, policy_version 1126739 (0.0009) [2023-12-26 08:35:18,561][123091] Updated weights for policy 0, policy_version 1126749 (0.0008) [2023-12-26 08:35:18,562][123090] Updated weights for policy 1, policy_version 1118903 (0.0010) [2023-12-26 08:35:18,619][123091] Updated weights for policy 0, policy_version 1126759 (0.0009) [2023-12-26 08:35:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 574898176. Throughput: 0: 9039.2, 1: 8735.0. Samples: 574903452. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:18,785][121949] Avg episode reward: [(0, '6250.254'), (1, '5947.424')] [2023-12-26 08:35:19,369][123090] Updated weights for policy 1, policy_version 1118913 (0.0006) [2023-12-26 08:35:19,429][123090] Updated weights for policy 1, policy_version 1118923 (0.0009) [2023-12-26 08:35:19,488][123090] Updated weights for policy 1, policy_version 1118933 (0.0009) [2023-12-26 08:35:19,511][123091] Updated weights for policy 0, policy_version 1126769 (0.0010) [2023-12-26 08:35:19,554][123090] Updated weights for policy 1, policy_version 1118943 (0.0008) [2023-12-26 08:35:19,570][123091] Updated weights for policy 0, policy_version 1126779 (0.0009) [2023-12-26 08:35:19,637][123091] Updated weights for policy 0, policy_version 1126789 (0.0010) [2023-12-26 08:35:19,692][123091] Updated weights for policy 0, policy_version 1126799 (0.0008) [2023-12-26 08:35:20,458][123090] Updated weights for policy 1, policy_version 1118953 (0.0009) [2023-12-26 08:35:20,482][123091] Updated weights for policy 0, policy_version 1126809 (0.0009) [2023-12-26 08:35:20,517][123090] Updated weights for policy 1, policy_version 1118963 (0.0009) [2023-12-26 08:35:20,541][123091] Updated weights for policy 0, policy_version 1126819 (0.0009) [2023-12-26 08:35:20,583][123090] Updated weights for policy 1, policy_version 1118973 (0.0009) [2023-12-26 08:35:20,619][123091] Updated weights for policy 0, policy_version 1126829 (0.0009) [2023-12-26 08:35:21,526][123090] Updated weights for policy 1, policy_version 1118983 (0.0009) [2023-12-26 08:35:21,557][123091] Updated weights for policy 0, policy_version 1126839 (0.0009) [2023-12-26 08:35:21,592][123090] Updated weights for policy 1, policy_version 1118993 (0.0009) [2023-12-26 08:35:21,630][123091] Updated weights for policy 0, policy_version 1126849 (0.0009) [2023-12-26 08:35:21,656][123090] Updated weights for policy 1, policy_version 1119003 (0.0010) [2023-12-26 08:35:21,702][123091] Updated weights for policy 0, policy_version 1126859 (0.0007) [2023-12-26 08:35:22,448][123091] Updated weights for policy 0, policy_version 1126869 (0.0007) [2023-12-26 08:35:22,472][123090] Updated weights for policy 1, policy_version 1119013 (0.0008) [2023-12-26 08:35:22,527][123091] Updated weights for policy 0, policy_version 1126879 (0.0006) [2023-12-26 08:35:22,543][123090] Updated weights for policy 1, policy_version 1119023 (0.0005) [2023-12-26 08:35:22,592][123091] Updated weights for policy 0, policy_version 1126889 (0.0006) [2023-12-26 08:35:22,610][123090] Updated weights for policy 1, policy_version 1119033 (0.0007) [2023-12-26 08:35:23,302][123090] Updated weights for policy 1, policy_version 1119043 (0.0006) [2023-12-26 08:35:23,358][123090] Updated weights for policy 1, policy_version 1119053 (0.0010) [2023-12-26 08:35:23,407][123090] Updated weights for policy 1, policy_version 1119063 (0.0010) [2023-12-26 08:35:23,421][123091] Updated weights for policy 0, policy_version 1126899 (0.0009) [2023-12-26 08:35:23,468][123091] Updated weights for policy 0, policy_version 1126909 (0.0010) [2023-12-26 08:35:23,521][123091] Updated weights for policy 0, policy_version 1126919 (0.0008) [2023-12-26 08:35:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 574980096. Throughput: 0: 8952.0, 1: 8708.9. Samples: 574952428. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:23,785][121949] Avg episode reward: [(0, '6310.529'), (1, '6025.835')] [2023-12-26 08:35:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001126928_288497664.pth... [2023-12-26 08:35:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001119072_286482432.pth... [2023-12-26 08:35:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001125872_288227328.pth [2023-12-26 08:35:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001118048_286220288.pth [2023-12-26 08:35:24,250][123090] Updated weights for policy 1, policy_version 1119073 (0.0010) [2023-12-26 08:35:24,309][123090] Updated weights for policy 1, policy_version 1119083 (0.0005) [2023-12-26 08:35:24,327][123091] Updated weights for policy 0, policy_version 1126929 (0.0006) [2023-12-26 08:35:24,374][123090] Updated weights for policy 1, policy_version 1119093 (0.0005) [2023-12-26 08:35:24,392][123091] Updated weights for policy 0, policy_version 1126939 (0.0011) [2023-12-26 08:35:24,436][123091] Updated weights for policy 0, policy_version 1126949 (0.0010) [2023-12-26 08:35:24,440][123090] Updated weights for policy 1, policy_version 1119103 (0.0005) [2023-12-26 08:35:24,490][123091] Updated weights for policy 0, policy_version 1126959 (0.0007) [2023-12-26 08:35:25,217][123090] Updated weights for policy 1, policy_version 1119113 (0.0009) [2023-12-26 08:35:25,247][123091] Updated weights for policy 0, policy_version 1126969 (0.0006) [2023-12-26 08:35:25,267][123090] Updated weights for policy 1, policy_version 1119123 (0.0009) [2023-12-26 08:35:25,302][123091] Updated weights for policy 0, policy_version 1126979 (0.0005) [2023-12-26 08:35:25,319][123090] Updated weights for policy 1, policy_version 1119133 (0.0009) [2023-12-26 08:35:25,355][123091] Updated weights for policy 0, policy_version 1126989 (0.0005) [2023-12-26 08:35:26,039][123091] Updated weights for policy 0, policy_version 1126999 (0.0006) [2023-12-26 08:35:26,103][123091] Updated weights for policy 0, policy_version 1127009 (0.0006) [2023-12-26 08:35:26,150][123091] Updated weights for policy 0, policy_version 1127019 (0.0006) [2023-12-26 08:35:26,206][123090] Updated weights for policy 1, policy_version 1119143 (0.0010) [2023-12-26 08:35:26,260][123090] Updated weights for policy 1, policy_version 1119153 (0.0009) [2023-12-26 08:35:26,313][123090] Updated weights for policy 1, policy_version 1119163 (0.0009) [2023-12-26 08:35:26,802][123091] Updated weights for policy 0, policy_version 1127029 (0.0006) [2023-12-26 08:35:26,857][123091] Updated weights for policy 0, policy_version 1127039 (0.0005) [2023-12-26 08:35:26,917][123091] Updated weights for policy 0, policy_version 1127049 (0.0005) [2023-12-26 08:35:27,277][123090] Updated weights for policy 1, policy_version 1119173 (0.0010) [2023-12-26 08:35:27,368][123090] Updated weights for policy 1, policy_version 1119183 (0.0009) [2023-12-26 08:35:27,420][123090] Updated weights for policy 1, policy_version 1119193 (0.0009) [2023-12-26 08:35:27,536][123091] Updated weights for policy 0, policy_version 1127059 (0.0007) [2023-12-26 08:35:27,590][123091] Updated weights for policy 0, policy_version 1127069 (0.0010) [2023-12-26 08:35:27,644][123091] Updated weights for policy 0, policy_version 1127079 (0.0010) [2023-12-26 08:35:28,283][123090] Updated weights for policy 1, policy_version 1119203 (0.0009) [2023-12-26 08:35:28,337][123090] Updated weights for policy 1, policy_version 1119213 (0.0008) [2023-12-26 08:35:28,364][123091] Updated weights for policy 0, policy_version 1127089 (0.0008) [2023-12-26 08:35:28,391][123090] Updated weights for policy 1, policy_version 1119223 (0.0009) [2023-12-26 08:35:28,426][123091] Updated weights for policy 0, policy_version 1127099 (0.0010) [2023-12-26 08:35:28,483][123091] Updated weights for policy 0, policy_version 1127109 (0.0011) [2023-12-26 08:35:28,536][123091] Updated weights for policy 0, policy_version 1127119 (0.0010) [2023-12-26 08:35:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 575070208. Throughput: 0: 9070.4, 1: 8705.0. Samples: 575060872. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:28,784][121949] Avg episode reward: [(0, '6285.264'), (1, '6077.020')] [2023-12-26 08:35:29,243][123090] Updated weights for policy 1, policy_version 1119233 (0.0008) [2023-12-26 08:35:29,306][123090] Updated weights for policy 1, policy_version 1119243 (0.0006) [2023-12-26 08:35:29,308][123091] Updated weights for policy 0, policy_version 1127129 (0.0010) [2023-12-26 08:35:29,362][123091] Updated weights for policy 0, policy_version 1127139 (0.0010) [2023-12-26 08:35:29,372][123090] Updated weights for policy 1, policy_version 1119253 (0.0009) [2023-12-26 08:35:29,431][123090] Updated weights for policy 1, policy_version 1119263 (0.0007) [2023-12-26 08:35:29,434][123091] Updated weights for policy 0, policy_version 1127149 (0.0011) [2023-12-26 08:35:30,196][123091] Updated weights for policy 0, policy_version 1127159 (0.0007) [2023-12-26 08:35:30,242][123090] Updated weights for policy 1, policy_version 1119273 (0.0006) [2023-12-26 08:35:30,246][123091] Updated weights for policy 0, policy_version 1127169 (0.0006) [2023-12-26 08:35:30,293][123090] Updated weights for policy 1, policy_version 1119283 (0.0010) [2023-12-26 08:35:30,296][123091] Updated weights for policy 0, policy_version 1127179 (0.0005) [2023-12-26 08:35:30,349][123090] Updated weights for policy 1, policy_version 1119293 (0.0010) [2023-12-26 08:35:30,945][123091] Updated weights for policy 0, policy_version 1127189 (0.0006) [2023-12-26 08:35:31,000][123091] Updated weights for policy 0, policy_version 1127199 (0.0005) [2023-12-26 08:35:31,058][123090] Updated weights for policy 1, policy_version 1119303 (0.0009) [2023-12-26 08:35:31,070][123091] Updated weights for policy 0, policy_version 1127209 (0.0008) [2023-12-26 08:35:31,127][123090] Updated weights for policy 1, policy_version 1119313 (0.0010) [2023-12-26 08:35:31,190][123090] Updated weights for policy 1, policy_version 1119323 (0.0010) [2023-12-26 08:35:31,907][123091] Updated weights for policy 0, policy_version 1127219 (0.0009) [2023-12-26 08:35:31,958][123090] Updated weights for policy 1, policy_version 1119333 (0.0008) [2023-12-26 08:35:31,961][123091] Updated weights for policy 0, policy_version 1127229 (0.0009) [2023-12-26 08:35:32,022][123091] Updated weights for policy 0, policy_version 1127239 (0.0007) [2023-12-26 08:35:32,026][123090] Updated weights for policy 1, policy_version 1119343 (0.0010) [2023-12-26 08:35:32,084][123090] Updated weights for policy 1, policy_version 1119353 (0.0008) [2023-12-26 08:35:32,859][123091] Updated weights for policy 0, policy_version 1127249 (0.0009) [2023-12-26 08:35:32,909][123090] Updated weights for policy 1, policy_version 1119363 (0.0009) [2023-12-26 08:35:32,912][123091] Updated weights for policy 0, policy_version 1127259 (0.0007) [2023-12-26 08:35:32,971][123091] Updated weights for policy 0, policy_version 1127269 (0.0009) [2023-12-26 08:35:32,971][123090] Updated weights for policy 1, policy_version 1119373 (0.0008) [2023-12-26 08:35:33,021][123090] Updated weights for policy 1, policy_version 1119383 (0.0009) [2023-12-26 08:35:33,034][123091] Updated weights for policy 0, policy_version 1127279 (0.0007) [2023-12-26 08:35:33,681][123090] Updated weights for policy 1, policy_version 1119393 (0.0006) [2023-12-26 08:35:33,744][123090] Updated weights for policy 1, policy_version 1119403 (0.0006) [2023-12-26 08:35:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 575152128. Throughput: 0: 9037.1, 1: 8602.8. Samples: 575169192. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:33,784][121949] Avg episode reward: [(0, '6276.265'), (1, '6073.024')] [2023-12-26 08:35:33,799][123090] Updated weights for policy 1, policy_version 1119413 (0.0006) [2023-12-26 08:35:33,850][123091] Updated weights for policy 0, policy_version 1127289 (0.0006) [2023-12-26 08:35:33,856][123090] Updated weights for policy 1, policy_version 1119423 (0.0005) [2023-12-26 08:35:33,900][123091] Updated weights for policy 0, policy_version 1127299 (0.0005) [2023-12-26 08:35:33,953][123091] Updated weights for policy 0, policy_version 1127309 (0.0005) [2023-12-26 08:35:34,614][123090] Updated weights for policy 1, policy_version 1119433 (0.0009) [2023-12-26 08:35:34,674][123090] Updated weights for policy 1, policy_version 1119443 (0.0009) [2023-12-26 08:35:34,736][123090] Updated weights for policy 1, policy_version 1119453 (0.0009) [2023-12-26 08:35:34,768][123091] Updated weights for policy 0, policy_version 1127319 (0.0009) [2023-12-26 08:35:34,820][123091] Updated weights for policy 0, policy_version 1127329 (0.0010) [2023-12-26 08:35:34,872][123091] Updated weights for policy 0, policy_version 1127339 (0.0011) [2023-12-26 08:35:35,587][123091] Updated weights for policy 0, policy_version 1127349 (0.0008) [2023-12-26 08:35:35,597][123090] Updated weights for policy 1, policy_version 1119463 (0.0007) [2023-12-26 08:35:35,647][123091] Updated weights for policy 0, policy_version 1127359 (0.0005) [2023-12-26 08:35:35,652][123090] Updated weights for policy 1, policy_version 1119473 (0.0008) [2023-12-26 08:35:35,704][123091] Updated weights for policy 0, policy_version 1127369 (0.0008) [2023-12-26 08:35:35,706][123090] Updated weights for policy 1, policy_version 1119483 (0.0008) [2023-12-26 08:35:36,425][123090] Updated weights for policy 1, policy_version 1119493 (0.0006) [2023-12-26 08:35:36,472][123091] Updated weights for policy 0, policy_version 1127379 (0.0011) [2023-12-26 08:35:36,488][123090] Updated weights for policy 1, policy_version 1119503 (0.0007) [2023-12-26 08:35:36,536][123091] Updated weights for policy 0, policy_version 1127389 (0.0011) [2023-12-26 08:35:36,548][123090] Updated weights for policy 1, policy_version 1119513 (0.0009) [2023-12-26 08:35:36,603][123091] Updated weights for policy 0, policy_version 1127399 (0.0008) [2023-12-26 08:35:37,182][123091] Updated weights for policy 0, policy_version 1127409 (0.0006) [2023-12-26 08:35:37,248][123091] Updated weights for policy 0, policy_version 1127419 (0.0006) [2023-12-26 08:35:37,306][123091] Updated weights for policy 0, policy_version 1127429 (0.0010) [2023-12-26 08:35:37,365][123091] Updated weights for policy 0, policy_version 1127439 (0.0011) [2023-12-26 08:35:37,411][123090] Updated weights for policy 1, policy_version 1119523 (0.0007) [2023-12-26 08:35:37,468][123090] Updated weights for policy 1, policy_version 1119533 (0.0009) [2023-12-26 08:35:37,521][123090] Updated weights for policy 1, policy_version 1119543 (0.0009) [2023-12-26 08:35:38,182][123091] Updated weights for policy 0, policy_version 1127449 (0.0006) [2023-12-26 08:35:38,233][123091] Updated weights for policy 0, policy_version 1127459 (0.0005) [2023-12-26 08:35:38,284][123091] Updated weights for policy 0, policy_version 1127469 (0.0005) [2023-12-26 08:35:38,413][123090] Updated weights for policy 1, policy_version 1119553 (0.0009) [2023-12-26 08:35:38,481][123090] Updated weights for policy 1, policy_version 1119563 (0.0007) [2023-12-26 08:35:38,545][123090] Updated weights for policy 1, policy_version 1119573 (0.0005) [2023-12-26 08:35:38,597][123090] Updated weights for policy 1, policy_version 1119583 (0.0005) [2023-12-26 08:35:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 575250432. Throughput: 0: 9124.7, 1: 8646.9. Samples: 575224784. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:38,785][121949] Avg episode reward: [(0, '6307.759'), (1, '6037.482')] [2023-12-26 08:35:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001119584_286613504.pth... [2023-12-26 08:35:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001127472_288636928.pth... [2023-12-26 08:35:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001118560_286351360.pth [2023-12-26 08:35:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001126416_288366592.pth [2023-12-26 08:35:39,011][123091] Updated weights for policy 0, policy_version 1127479 (0.0005) [2023-12-26 08:35:39,070][123091] Updated weights for policy 0, policy_version 1127489 (0.0005) [2023-12-26 08:35:39,144][123091] Updated weights for policy 0, policy_version 1127499 (0.0005) [2023-12-26 08:35:39,231][123090] Updated weights for policy 1, policy_version 1119593 (0.0006) [2023-12-26 08:35:39,294][123090] Updated weights for policy 1, policy_version 1119603 (0.0007) [2023-12-26 08:35:39,361][123090] Updated weights for policy 1, policy_version 1119613 (0.0007) [2023-12-26 08:35:39,854][123091] Updated weights for policy 0, policy_version 1127509 (0.0008) [2023-12-26 08:35:39,918][123091] Updated weights for policy 0, policy_version 1127519 (0.0011) [2023-12-26 08:35:39,983][123091] Updated weights for policy 0, policy_version 1127529 (0.0008) [2023-12-26 08:35:40,075][123090] Updated weights for policy 1, policy_version 1119623 (0.0010) [2023-12-26 08:35:40,131][123090] Updated weights for policy 1, policy_version 1119633 (0.0010) [2023-12-26 08:35:40,188][123090] Updated weights for policy 1, policy_version 1119643 (0.0010) [2023-12-26 08:35:40,770][123091] Updated weights for policy 0, policy_version 1127539 (0.0009) [2023-12-26 08:35:40,846][123091] Updated weights for policy 0, policy_version 1127549 (0.0006) [2023-12-26 08:35:40,918][123091] Updated weights for policy 0, policy_version 1127559 (0.0006) [2023-12-26 08:35:40,924][123090] Updated weights for policy 1, policy_version 1119653 (0.0010) [2023-12-26 08:35:40,980][123090] Updated weights for policy 1, policy_version 1119663 (0.0006) [2023-12-26 08:35:41,049][123090] Updated weights for policy 1, policy_version 1119673 (0.0006) [2023-12-26 08:35:41,698][123091] Updated weights for policy 0, policy_version 1127569 (0.0009) [2023-12-26 08:35:41,768][123091] Updated weights for policy 0, policy_version 1127579 (0.0008) [2023-12-26 08:35:41,834][123091] Updated weights for policy 0, policy_version 1127589 (0.0007) [2023-12-26 08:35:41,898][123091] Updated weights for policy 0, policy_version 1127599 (0.0008) [2023-12-26 08:35:41,956][123090] Updated weights for policy 1, policy_version 1119683 (0.0010) [2023-12-26 08:35:42,015][123090] Updated weights for policy 1, policy_version 1119693 (0.0010) [2023-12-26 08:35:42,081][123090] Updated weights for policy 1, policy_version 1119703 (0.0009) [2023-12-26 08:35:42,655][123091] Updated weights for policy 0, policy_version 1127609 (0.0010) [2023-12-26 08:35:42,719][123091] Updated weights for policy 0, policy_version 1127619 (0.0010) [2023-12-26 08:35:42,774][123091] Updated weights for policy 0, policy_version 1127629 (0.0010) [2023-12-26 08:35:42,937][123090] Updated weights for policy 1, policy_version 1119713 (0.0010) [2023-12-26 08:35:42,989][123090] Updated weights for policy 1, policy_version 1119723 (0.0008) [2023-12-26 08:35:43,045][123090] Updated weights for policy 1, policy_version 1119733 (0.0009) [2023-12-26 08:35:43,110][123090] Updated weights for policy 1, policy_version 1119743 (0.0009) [2023-12-26 08:35:43,492][123091] Updated weights for policy 0, policy_version 1127639 (0.0007) [2023-12-26 08:35:43,547][123091] Updated weights for policy 0, policy_version 1127649 (0.0005) [2023-12-26 08:35:43,618][123091] Updated weights for policy 0, policy_version 1127659 (0.0006) [2023-12-26 08:35:43,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 575340544. Throughput: 0: 9081.6, 1: 8658.5. Samples: 575332596. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:43,785][121949] Avg episode reward: [(0, '6284.778'), (1, '6037.713')] [2023-12-26 08:35:44,012][123090] Updated weights for policy 1, policy_version 1119753 (0.0009) [2023-12-26 08:35:44,068][123090] Updated weights for policy 1, policy_version 1119763 (0.0010) [2023-12-26 08:35:44,122][123090] Updated weights for policy 1, policy_version 1119773 (0.0010) [2023-12-26 08:35:44,350][123091] Updated weights for policy 0, policy_version 1127669 (0.0010) [2023-12-26 08:35:44,406][123091] Updated weights for policy 0, policy_version 1127679 (0.0010) [2023-12-26 08:35:44,457][123091] Updated weights for policy 0, policy_version 1127689 (0.0010) [2023-12-26 08:35:44,989][123090] Updated weights for policy 1, policy_version 1119783 (0.0009) [2023-12-26 08:35:45,058][123090] Updated weights for policy 1, policy_version 1119793 (0.0010) [2023-12-26 08:35:45,126][123090] Updated weights for policy 1, policy_version 1119803 (0.0010) [2023-12-26 08:35:45,275][123091] Updated weights for policy 0, policy_version 1127699 (0.0009) [2023-12-26 08:35:45,346][123091] Updated weights for policy 0, policy_version 1127709 (0.0006) [2023-12-26 08:35:45,413][123091] Updated weights for policy 0, policy_version 1127719 (0.0006) [2023-12-26 08:35:45,935][123090] Updated weights for policy 1, policy_version 1119813 (0.0010) [2023-12-26 08:35:45,982][123090] Updated weights for policy 1, policy_version 1119823 (0.0010) [2023-12-26 08:35:46,045][123090] Updated weights for policy 1, policy_version 1119833 (0.0009) [2023-12-26 08:35:46,062][123091] Updated weights for policy 0, policy_version 1127729 (0.0006) [2023-12-26 08:35:46,124][123091] Updated weights for policy 0, policy_version 1127739 (0.0005) [2023-12-26 08:35:46,182][123091] Updated weights for policy 0, policy_version 1127749 (0.0006) [2023-12-26 08:35:46,241][123091] Updated weights for policy 0, policy_version 1127759 (0.0005) [2023-12-26 08:35:46,752][123090] Updated weights for policy 1, policy_version 1119843 (0.0005) [2023-12-26 08:35:46,808][123090] Updated weights for policy 1, policy_version 1119853 (0.0005) [2023-12-26 08:35:46,836][123091] Updated weights for policy 0, policy_version 1127769 (0.0005) [2023-12-26 08:35:46,870][123090] Updated weights for policy 1, policy_version 1119863 (0.0005) [2023-12-26 08:35:46,885][123091] Updated weights for policy 0, policy_version 1127779 (0.0005) [2023-12-26 08:35:46,931][123091] Updated weights for policy 0, policy_version 1127789 (0.0007) [2023-12-26 08:35:47,643][123090] Updated weights for policy 1, policy_version 1119873 (0.0006) [2023-12-26 08:35:47,662][123091] Updated weights for policy 0, policy_version 1127799 (0.0009) [2023-12-26 08:35:47,705][123090] Updated weights for policy 1, policy_version 1119883 (0.0010) [2023-12-26 08:35:47,725][123091] Updated weights for policy 0, policy_version 1127809 (0.0010) [2023-12-26 08:35:47,768][123090] Updated weights for policy 1, policy_version 1119893 (0.0010) [2023-12-26 08:35:47,787][123091] Updated weights for policy 0, policy_version 1127819 (0.0010) [2023-12-26 08:35:47,819][123090] Updated weights for policy 1, policy_version 1119903 (0.0010) [2023-12-26 08:35:48,627][123090] Updated weights for policy 1, policy_version 1119913 (0.0010) [2023-12-26 08:35:48,647][123091] Updated weights for policy 0, policy_version 1127829 (0.0008) [2023-12-26 08:35:48,678][123090] Updated weights for policy 1, policy_version 1119923 (0.0010) [2023-12-26 08:35:48,703][123091] Updated weights for policy 0, policy_version 1127839 (0.0006) [2023-12-26 08:35:48,734][123090] Updated weights for policy 1, policy_version 1119933 (0.0010) [2023-12-26 08:35:48,764][123091] Updated weights for policy 0, policy_version 1127849 (0.0007) [2023-12-26 08:35:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 575430656. Throughput: 0: 9158.5, 1: 8714.3. Samples: 575442456. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:48,785][121949] Avg episode reward: [(0, '6278.632'), (1, '6072.037')] [2023-12-26 08:35:49,498][123090] Updated weights for policy 1, policy_version 1119943 (0.0010) [2023-12-26 08:35:49,509][123091] Updated weights for policy 0, policy_version 1127859 (0.0008) [2023-12-26 08:35:49,557][123090] Updated weights for policy 1, policy_version 1119953 (0.0010) [2023-12-26 08:35:49,573][123091] Updated weights for policy 0, policy_version 1127869 (0.0007) [2023-12-26 08:35:49,620][123090] Updated weights for policy 1, policy_version 1119963 (0.0010) [2023-12-26 08:35:49,641][123091] Updated weights for policy 0, policy_version 1127879 (0.0010) [2023-12-26 08:35:50,370][123090] Updated weights for policy 1, policy_version 1119973 (0.0008) [2023-12-26 08:35:50,429][123090] Updated weights for policy 1, policy_version 1119983 (0.0005) [2023-12-26 08:35:50,479][123090] Updated weights for policy 1, policy_version 1119993 (0.0007) [2023-12-26 08:35:50,535][123091] Updated weights for policy 0, policy_version 1127889 (0.0010) [2023-12-26 08:35:50,605][123091] Updated weights for policy 0, policy_version 1127899 (0.0010) [2023-12-26 08:35:50,671][123091] Updated weights for policy 0, policy_version 1127909 (0.0009) [2023-12-26 08:35:50,724][123091] Updated weights for policy 0, policy_version 1127919 (0.0009) [2023-12-26 08:35:51,290][123090] Updated weights for policy 1, policy_version 1120003 (0.0007) [2023-12-26 08:35:51,359][123090] Updated weights for policy 1, policy_version 1120013 (0.0011) [2023-12-26 08:35:51,427][123090] Updated weights for policy 1, policy_version 1120023 (0.0009) [2023-12-26 08:35:51,623][123091] Updated weights for policy 0, policy_version 1127929 (0.0010) [2023-12-26 08:35:51,694][123091] Updated weights for policy 0, policy_version 1127939 (0.0008) [2023-12-26 08:35:51,764][123091] Updated weights for policy 0, policy_version 1127949 (0.0010) [2023-12-26 08:35:52,264][123090] Updated weights for policy 1, policy_version 1120033 (0.0009) [2023-12-26 08:35:52,319][123090] Updated weights for policy 1, policy_version 1120043 (0.0010) [2023-12-26 08:35:52,387][123090] Updated weights for policy 1, policy_version 1120053 (0.0008) [2023-12-26 08:35:52,448][123090] Updated weights for policy 1, policy_version 1120063 (0.0009) [2023-12-26 08:35:52,601][123091] Updated weights for policy 0, policy_version 1127959 (0.0009) [2023-12-26 08:35:52,659][123091] Updated weights for policy 0, policy_version 1127969 (0.0010) [2023-12-26 08:35:52,710][123091] Updated weights for policy 0, policy_version 1127979 (0.0010) [2023-12-26 08:35:53,310][123090] Updated weights for policy 1, policy_version 1120073 (0.0009) [2023-12-26 08:35:53,363][123090] Updated weights for policy 1, policy_version 1120083 (0.0009) [2023-12-26 08:35:53,419][123090] Updated weights for policy 1, policy_version 1120093 (0.0009) [2023-12-26 08:35:53,530][123091] Updated weights for policy 0, policy_version 1127989 (0.0010) [2023-12-26 08:35:53,585][123091] Updated weights for policy 0, policy_version 1127999 (0.0010) [2023-12-26 08:35:53,644][123091] Updated weights for policy 0, policy_version 1128009 (0.0011) [2023-12-26 08:35:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 575520768. Throughput: 0: 9046.9, 1: 8776.6. Samples: 575494468. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:53,785][121949] Avg episode reward: [(0, '6312.255'), (1, '6073.834')] [2023-12-26 08:35:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001128016_288776192.pth... [2023-12-26 08:35:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001120096_286744576.pth... [2023-12-26 08:35:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001126928_288497664.pth [2023-12-26 08:35:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001119072_286482432.pth [2023-12-26 08:35:54,256][123090] Updated weights for policy 1, policy_version 1120103 (0.0010) [2023-12-26 08:35:54,325][123090] Updated weights for policy 1, policy_version 1120113 (0.0010) [2023-12-26 08:35:54,383][123090] Updated weights for policy 1, policy_version 1120123 (0.0010) [2023-12-26 08:35:54,441][123091] Updated weights for policy 0, policy_version 1128019 (0.0010) [2023-12-26 08:35:54,497][123091] Updated weights for policy 0, policy_version 1128029 (0.0009) [2023-12-26 08:35:54,553][123091] Updated weights for policy 0, policy_version 1128039 (0.0009) [2023-12-26 08:35:55,176][123090] Updated weights for policy 1, policy_version 1120134 (0.0009) [2023-12-26 08:35:55,229][123090] Updated weights for policy 1, policy_version 1120144 (0.0010) [2023-12-26 08:35:55,284][123090] Updated weights for policy 1, policy_version 1120154 (0.0010) [2023-12-26 08:35:55,374][123091] Updated weights for policy 0, policy_version 1128049 (0.0010) [2023-12-26 08:35:55,428][123091] Updated weights for policy 0, policy_version 1128059 (0.0010) [2023-12-26 08:35:55,472][123091] Updated weights for policy 0, policy_version 1128069 (0.0010) [2023-12-26 08:35:55,518][123091] Updated weights for policy 0, policy_version 1128079 (0.0010) [2023-12-26 08:35:56,087][123090] Updated weights for policy 1, policy_version 1120164 (0.0008) [2023-12-26 08:35:56,167][123090] Updated weights for policy 1, policy_version 1120174 (0.0005) [2023-12-26 08:35:56,226][123090] Updated weights for policy 1, policy_version 1120184 (0.0005) [2023-12-26 08:35:56,248][123091] Updated weights for policy 0, policy_version 1128089 (0.0008) [2023-12-26 08:35:56,305][123091] Updated weights for policy 0, policy_version 1128099 (0.0008) [2023-12-26 08:35:56,356][123091] Updated weights for policy 0, policy_version 1128109 (0.0008) [2023-12-26 08:35:56,923][123090] Updated weights for policy 1, policy_version 1120194 (0.0010) [2023-12-26 08:35:56,992][123090] Updated weights for policy 1, policy_version 1120204 (0.0010) [2023-12-26 08:35:57,053][123090] Updated weights for policy 1, policy_version 1120214 (0.0010) [2023-12-26 08:35:57,118][123090] Updated weights for policy 1, policy_version 1120224 (0.0010) [2023-12-26 08:35:57,182][123091] Updated weights for policy 0, policy_version 1128119 (0.0009) [2023-12-26 08:35:57,241][123091] Updated weights for policy 0, policy_version 1128129 (0.0009) [2023-12-26 08:35:57,303][123091] Updated weights for policy 0, policy_version 1128139 (0.0008) [2023-12-26 08:35:57,904][123090] Updated weights for policy 1, policy_version 1120234 (0.0010) [2023-12-26 08:35:57,947][123090] Updated weights for policy 1, policy_version 1120244 (0.0010) [2023-12-26 08:35:57,990][123090] Updated weights for policy 1, policy_version 1120254 (0.0006) [2023-12-26 08:35:58,131][123091] Updated weights for policy 0, policy_version 1128149 (0.0009) [2023-12-26 08:35:58,196][123091] Updated weights for policy 0, policy_version 1128159 (0.0009) [2023-12-26 08:35:58,260][123091] Updated weights for policy 0, policy_version 1128169 (0.0009) [2023-12-26 08:35:58,786][121949] Fps is (10 sec: 17200.0, 60 sec: 17748.7, 300 sec: 17827.9). Total num frames: 575602688. Throughput: 0: 9035.5, 1: 8779.1. Samples: 575599216. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:35:58,787][121949] Avg episode reward: [(0, '6224.398'), (1, '5992.303')] [2023-12-26 08:35:58,846][123090] Updated weights for policy 1, policy_version 1120264 (0.0007) [2023-12-26 08:35:58,915][123090] Updated weights for policy 1, policy_version 1120274 (0.0007) [2023-12-26 08:35:58,984][123090] Updated weights for policy 1, policy_version 1120284 (0.0011) [2023-12-26 08:35:59,262][123091] Updated weights for policy 0, policy_version 1128179 (0.0009) [2023-12-26 08:35:59,334][123091] Updated weights for policy 0, policy_version 1128189 (0.0008) [2023-12-26 08:35:59,400][123091] Updated weights for policy 0, policy_version 1128199 (0.0009) [2023-12-26 08:35:59,823][123090] Updated weights for policy 1, policy_version 1120294 (0.0011) [2023-12-26 08:35:59,886][123090] Updated weights for policy 1, policy_version 1120304 (0.0007) [2023-12-26 08:35:59,961][123090] Updated weights for policy 1, policy_version 1120314 (0.0006) [2023-12-26 08:36:00,180][123091] Updated weights for policy 0, policy_version 1128209 (0.0008) [2023-12-26 08:36:00,239][123091] Updated weights for policy 0, policy_version 1128219 (0.0009) [2023-12-26 08:36:00,297][123091] Updated weights for policy 0, policy_version 1128229 (0.0010) [2023-12-26 08:36:00,347][123091] Updated weights for policy 0, policy_version 1128239 (0.0009) [2023-12-26 08:36:00,649][123090] Updated weights for policy 1, policy_version 1120324 (0.0007) [2023-12-26 08:36:00,722][123090] Updated weights for policy 1, policy_version 1120334 (0.0010) [2023-12-26 08:36:00,787][123090] Updated weights for policy 1, policy_version 1120344 (0.0010) [2023-12-26 08:36:01,111][123091] Updated weights for policy 0, policy_version 1128249 (0.0010) [2023-12-26 08:36:01,173][123091] Updated weights for policy 0, policy_version 1128259 (0.0010) [2023-12-26 08:36:01,231][123091] Updated weights for policy 0, policy_version 1128269 (0.0008) [2023-12-26 08:36:01,533][123090] Updated weights for policy 1, policy_version 1120355 (0.0007) [2023-12-26 08:36:01,586][123090] Updated weights for policy 1, policy_version 1120365 (0.0007) [2023-12-26 08:36:01,661][123090] Updated weights for policy 1, policy_version 1120375 (0.0009) [2023-12-26 08:36:02,110][123091] Updated weights for policy 0, policy_version 1128279 (0.0009) [2023-12-26 08:36:02,169][123091] Updated weights for policy 0, policy_version 1128289 (0.0009) [2023-12-26 08:36:02,228][123091] Updated weights for policy 0, policy_version 1128299 (0.0010) [2023-12-26 08:36:02,432][123090] Updated weights for policy 1, policy_version 1120385 (0.0006) [2023-12-26 08:36:02,499][123090] Updated weights for policy 1, policy_version 1120395 (0.0007) [2023-12-26 08:36:02,568][123090] Updated weights for policy 1, policy_version 1120405 (0.0007) [2023-12-26 08:36:02,635][123090] Updated weights for policy 1, policy_version 1120415 (0.0010) [2023-12-26 08:36:03,090][123091] Updated weights for policy 0, policy_version 1128309 (0.0010) [2023-12-26 08:36:03,139][123091] Updated weights for policy 0, policy_version 1128319 (0.0009) [2023-12-26 08:36:03,193][123091] Updated weights for policy 0, policy_version 1128330 (0.0010) [2023-12-26 08:36:03,347][123090] Updated weights for policy 1, policy_version 1120425 (0.0009) [2023-12-26 08:36:03,401][123090] Updated weights for policy 1, policy_version 1120435 (0.0010) [2023-12-26 08:36:03,452][123090] Updated weights for policy 1, policy_version 1120445 (0.0009) [2023-12-26 08:36:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 575692800. Throughput: 0: 9031.2, 1: 8768.5. Samples: 575704436. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:03,784][121949] Avg episode reward: [(0, '6265.930'), (1, '5932.179')] [2023-12-26 08:36:03,937][123091] Updated weights for policy 0, policy_version 1128340 (0.0010) [2023-12-26 08:36:03,989][123091] Updated weights for policy 0, policy_version 1128350 (0.0011) [2023-12-26 08:36:04,050][123091] Updated weights for policy 0, policy_version 1128360 (0.0011) [2023-12-26 08:36:04,179][123090] Updated weights for policy 1, policy_version 1120455 (0.0007) [2023-12-26 08:36:04,246][123090] Updated weights for policy 1, policy_version 1120465 (0.0008) [2023-12-26 08:36:04,309][123090] Updated weights for policy 1, policy_version 1120475 (0.0008) [2023-12-26 08:36:04,883][123091] Updated weights for policy 0, policy_version 1128370 (0.0011) [2023-12-26 08:36:04,948][123091] Updated weights for policy 0, policy_version 1128380 (0.0011) [2023-12-26 08:36:05,003][123091] Updated weights for policy 0, policy_version 1128390 (0.0011) [2023-12-26 08:36:05,059][123091] Updated weights for policy 0, policy_version 1128400 (0.0010) [2023-12-26 08:36:05,069][123090] Updated weights for policy 1, policy_version 1120485 (0.0009) [2023-12-26 08:36:05,132][123090] Updated weights for policy 1, policy_version 1120495 (0.0010) [2023-12-26 08:36:05,186][123090] Updated weights for policy 1, policy_version 1120505 (0.0010) [2023-12-26 08:36:05,756][123091] Updated weights for policy 0, policy_version 1128410 (0.0007) [2023-12-26 08:36:05,805][123091] Updated weights for policy 0, policy_version 1128420 (0.0009) [2023-12-26 08:36:05,858][123091] Updated weights for policy 0, policy_version 1128430 (0.0009) [2023-12-26 08:36:06,016][123090] Updated weights for policy 1, policy_version 1120515 (0.0010) [2023-12-26 08:36:06,071][123090] Updated weights for policy 1, policy_version 1120525 (0.0010) [2023-12-26 08:36:06,139][123090] Updated weights for policy 1, policy_version 1120535 (0.0010) [2023-12-26 08:36:06,588][123091] Updated weights for policy 0, policy_version 1128440 (0.0008) [2023-12-26 08:36:06,652][123091] Updated weights for policy 0, policy_version 1128450 (0.0006) [2023-12-26 08:36:06,713][123091] Updated weights for policy 0, policy_version 1128460 (0.0006) [2023-12-26 08:36:06,997][123090] Updated weights for policy 1, policy_version 1120545 (0.0010) [2023-12-26 08:36:07,069][123090] Updated weights for policy 1, policy_version 1120555 (0.0010) [2023-12-26 08:36:07,139][123090] Updated weights for policy 1, policy_version 1120565 (0.0010) [2023-12-26 08:36:07,210][123090] Updated weights for policy 1, policy_version 1120575 (0.0010) [2023-12-26 08:36:07,432][123091] Updated weights for policy 0, policy_version 1128470 (0.0009) [2023-12-26 08:36:07,498][123091] Updated weights for policy 0, policy_version 1128480 (0.0011) [2023-12-26 08:36:07,561][123091] Updated weights for policy 0, policy_version 1128490 (0.0006) [2023-12-26 08:36:08,014][123090] Updated weights for policy 1, policy_version 1120585 (0.0011) [2023-12-26 08:36:08,082][123090] Updated weights for policy 1, policy_version 1120595 (0.0010) [2023-12-26 08:36:08,153][123090] Updated weights for policy 1, policy_version 1120605 (0.0011) [2023-12-26 08:36:08,336][123091] Updated weights for policy 0, policy_version 1128500 (0.0011) [2023-12-26 08:36:08,399][123091] Updated weights for policy 0, policy_version 1128510 (0.0011) [2023-12-26 08:36:08,466][123091] Updated weights for policy 0, policy_version 1128520 (0.0011) [2023-12-26 08:36:08,784][121949] Fps is (10 sec: 18025.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 575782912. Throughput: 0: 9097.2, 1: 8817.9. Samples: 575758608. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:08,785][121949] Avg episode reward: [(0, '6356.429'), (1, '5937.959')] [2023-12-26 08:36:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001128528_288907264.pth... [2023-12-26 08:36:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001120608_286875648.pth... [2023-12-26 08:36:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001127472_288636928.pth [2023-12-26 08:36:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001119584_286613504.pth [2023-12-26 08:36:08,938][123090] Updated weights for policy 1, policy_version 1120615 (0.0009) [2023-12-26 08:36:09,005][123090] Updated weights for policy 1, policy_version 1120625 (0.0010) [2023-12-26 08:36:09,063][123090] Updated weights for policy 1, policy_version 1120635 (0.0010) [2023-12-26 08:36:09,276][123091] Updated weights for policy 0, policy_version 1128530 (0.0010) [2023-12-26 08:36:09,344][123091] Updated weights for policy 0, policy_version 1128540 (0.0013) [2023-12-26 08:36:09,416][123091] Updated weights for policy 0, policy_version 1128550 (0.0011) [2023-12-26 08:36:09,476][123091] Updated weights for policy 0, policy_version 1128560 (0.0011) [2023-12-26 08:36:09,874][123090] Updated weights for policy 1, policy_version 1120645 (0.0008) [2023-12-26 08:36:09,938][123090] Updated weights for policy 1, policy_version 1120655 (0.0010) [2023-12-26 08:36:10,013][123090] Updated weights for policy 1, policy_version 1120665 (0.0008) [2023-12-26 08:36:10,268][123091] Updated weights for policy 0, policy_version 1128570 (0.0010) [2023-12-26 08:36:10,328][123091] Updated weights for policy 0, policy_version 1128580 (0.0011) [2023-12-26 08:36:10,383][123091] Updated weights for policy 0, policy_version 1128590 (0.0010) [2023-12-26 08:36:10,894][123090] Updated weights for policy 1, policy_version 1120675 (0.0009) [2023-12-26 08:36:10,942][123090] Updated weights for policy 1, policy_version 1120685 (0.0009) [2023-12-26 08:36:11,000][123090] Updated weights for policy 1, policy_version 1120695 (0.0009) [2023-12-26 08:36:11,218][123091] Updated weights for policy 0, policy_version 1128600 (0.0010) [2023-12-26 08:36:11,294][123091] Updated weights for policy 0, policy_version 1128610 (0.0010) [2023-12-26 08:36:11,383][123091] Updated weights for policy 0, policy_version 1128620 (0.0011) [2023-12-26 08:36:11,922][123090] Updated weights for policy 1, policy_version 1120705 (0.0010) [2023-12-26 08:36:11,971][123090] Updated weights for policy 1, policy_version 1120715 (0.0008) [2023-12-26 08:36:12,024][123090] Updated weights for policy 1, policy_version 1120725 (0.0009) [2023-12-26 08:36:12,083][123090] Updated weights for policy 1, policy_version 1120735 (0.0009) [2023-12-26 08:36:12,167][123091] Updated weights for policy 0, policy_version 1128630 (0.0011) [2023-12-26 08:36:12,241][123091] Updated weights for policy 0, policy_version 1128640 (0.0011) [2023-12-26 08:36:12,309][123091] Updated weights for policy 0, policy_version 1128650 (0.0011) [2023-12-26 08:36:12,971][123090] Updated weights for policy 1, policy_version 1120745 (0.0010) [2023-12-26 08:36:13,024][123090] Updated weights for policy 1, policy_version 1120755 (0.0010) [2023-12-26 08:36:13,088][123090] Updated weights for policy 1, policy_version 1120765 (0.0010) [2023-12-26 08:36:13,107][123091] Updated weights for policy 0, policy_version 1128660 (0.0009) [2023-12-26 08:36:13,154][123091] Updated weights for policy 0, policy_version 1128670 (0.0008) [2023-12-26 08:36:13,202][123091] Updated weights for policy 0, policy_version 1128680 (0.0009) [2023-12-26 08:36:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 575864832. Throughput: 0: 9005.5, 1: 8784.8. Samples: 575861436. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:13,785][121949] Avg episode reward: [(0, '6232.947'), (1, '5840.013')] [2023-12-26 08:36:13,833][123090] Updated weights for policy 1, policy_version 1120775 (0.0007) [2023-12-26 08:36:13,883][123090] Updated weights for policy 1, policy_version 1120785 (0.0005) [2023-12-26 08:36:13,938][123090] Updated weights for policy 1, policy_version 1120795 (0.0005) [2023-12-26 08:36:14,121][123091] Updated weights for policy 0, policy_version 1128690 (0.0009) [2023-12-26 08:36:14,187][123091] Updated weights for policy 0, policy_version 1128700 (0.0009) [2023-12-26 08:36:14,248][123091] Updated weights for policy 0, policy_version 1128710 (0.0009) [2023-12-26 08:36:14,311][123091] Updated weights for policy 0, policy_version 1128720 (0.0009) [2023-12-26 08:36:14,659][123090] Updated weights for policy 1, policy_version 1120805 (0.0008) [2023-12-26 08:36:14,706][123090] Updated weights for policy 1, policy_version 1120815 (0.0010) [2023-12-26 08:36:14,750][123090] Updated weights for policy 1, policy_version 1120825 (0.0010) [2023-12-26 08:36:15,074][123091] Updated weights for policy 0, policy_version 1128730 (0.0006) [2023-12-26 08:36:15,143][123091] Updated weights for policy 0, policy_version 1128740 (0.0008) [2023-12-26 08:36:15,206][123091] Updated weights for policy 0, policy_version 1128750 (0.0005) [2023-12-26 08:36:15,560][123090] Updated weights for policy 1, policy_version 1120835 (0.0010) [2023-12-26 08:36:15,628][123090] Updated weights for policy 1, policy_version 1120845 (0.0007) [2023-12-26 08:36:15,695][123090] Updated weights for policy 1, policy_version 1120855 (0.0006) [2023-12-26 08:36:15,971][123091] Updated weights for policy 0, policy_version 1128760 (0.0009) [2023-12-26 08:36:16,024][123091] Updated weights for policy 0, policy_version 1128770 (0.0010) [2023-12-26 08:36:16,079][123091] Updated weights for policy 0, policy_version 1128780 (0.0008) [2023-12-26 08:36:16,380][123090] Updated weights for policy 1, policy_version 1120865 (0.0005) [2023-12-26 08:36:16,442][123090] Updated weights for policy 1, policy_version 1120875 (0.0005) [2023-12-26 08:36:16,505][123090] Updated weights for policy 1, policy_version 1120885 (0.0005) [2023-12-26 08:36:16,567][123090] Updated weights for policy 1, policy_version 1120895 (0.0005) [2023-12-26 08:36:16,898][123091] Updated weights for policy 0, policy_version 1128790 (0.0008) [2023-12-26 08:36:16,960][123091] Updated weights for policy 0, policy_version 1128800 (0.0009) [2023-12-26 08:36:17,014][123091] Updated weights for policy 0, policy_version 1128810 (0.0006) [2023-12-26 08:36:17,224][123090] Updated weights for policy 1, policy_version 1120906 (0.0010) [2023-12-26 08:36:17,280][123090] Updated weights for policy 1, policy_version 1120917 (0.0008) [2023-12-26 08:36:17,331][123090] Updated weights for policy 1, policy_version 1120927 (0.0007) [2023-12-26 08:36:17,675][123091] Updated weights for policy 0, policy_version 1128820 (0.0008) [2023-12-26 08:36:17,723][123091] Updated weights for policy 0, policy_version 1128830 (0.0010) [2023-12-26 08:36:17,766][123091] Updated weights for policy 0, policy_version 1128840 (0.0010) [2023-12-26 08:36:18,134][123090] Updated weights for policy 1, policy_version 1120937 (0.0008) [2023-12-26 08:36:18,199][123090] Updated weights for policy 1, policy_version 1120947 (0.0007) [2023-12-26 08:36:18,261][123090] Updated weights for policy 1, policy_version 1120957 (0.0008) [2023-12-26 08:36:18,613][123091] Updated weights for policy 0, policy_version 1128850 (0.0010) [2023-12-26 08:36:18,677][123091] Updated weights for policy 0, policy_version 1128860 (0.0011) [2023-12-26 08:36:18,729][123091] Updated weights for policy 0, policy_version 1128870 (0.0011) [2023-12-26 08:36:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 575963136. Throughput: 0: 8969.0, 1: 8865.3. Samples: 575971736. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:18,785][121949] Avg episode reward: [(0, '6228.482'), (1, '5530.253')] [2023-12-26 08:36:18,785][123091] Updated weights for policy 0, policy_version 1128880 (0.0011) [2023-12-26 08:36:18,991][123090] Updated weights for policy 1, policy_version 1120967 (0.0006) [2023-12-26 08:36:19,060][123090] Updated weights for policy 1, policy_version 1120977 (0.0006) [2023-12-26 08:36:19,126][123090] Updated weights for policy 1, policy_version 1120987 (0.0008) [2023-12-26 08:36:19,631][123091] Updated weights for policy 0, policy_version 1128890 (0.0010) [2023-12-26 08:36:19,694][123091] Updated weights for policy 0, policy_version 1128900 (0.0011) [2023-12-26 08:36:19,757][123091] Updated weights for policy 0, policy_version 1128910 (0.0010) [2023-12-26 08:36:19,864][123090] Updated weights for policy 1, policy_version 1120997 (0.0011) [2023-12-26 08:36:19,934][123090] Updated weights for policy 1, policy_version 1121007 (0.0011) [2023-12-26 08:36:19,998][123090] Updated weights for policy 1, policy_version 1121017 (0.0010) [2023-12-26 08:36:20,598][123091] Updated weights for policy 0, policy_version 1128920 (0.0010) [2023-12-26 08:36:20,666][123091] Updated weights for policy 0, policy_version 1128930 (0.0011) [2023-12-26 08:36:20,730][123091] Updated weights for policy 0, policy_version 1128940 (0.0011) [2023-12-26 08:36:20,824][123090] Updated weights for policy 1, policy_version 1121027 (0.0011) [2023-12-26 08:36:20,904][123090] Updated weights for policy 1, policy_version 1121037 (0.0011) [2023-12-26 08:36:20,973][123090] Updated weights for policy 1, policy_version 1121047 (0.0011) [2023-12-26 08:36:21,542][123091] Updated weights for policy 0, policy_version 1128950 (0.0008) [2023-12-26 08:36:21,595][123091] Updated weights for policy 0, policy_version 1128960 (0.0005) [2023-12-26 08:36:21,669][123091] Updated weights for policy 0, policy_version 1128970 (0.0008) [2023-12-26 08:36:21,807][123090] Updated weights for policy 1, policy_version 1121057 (0.0013) [2023-12-26 08:36:21,874][123090] Updated weights for policy 1, policy_version 1121067 (0.0010) [2023-12-26 08:36:21,949][123090] Updated weights for policy 1, policy_version 1121077 (0.0007) [2023-12-26 08:36:22,025][123090] Updated weights for policy 1, policy_version 1121087 (0.0007) [2023-12-26 08:36:22,468][123091] Updated weights for policy 0, policy_version 1128980 (0.0009) [2023-12-26 08:36:22,535][123091] Updated weights for policy 0, policy_version 1128990 (0.0007) [2023-12-26 08:36:22,605][123091] Updated weights for policy 0, policy_version 1129000 (0.0010) [2023-12-26 08:36:22,777][123090] Updated weights for policy 1, policy_version 1121097 (0.0010) [2023-12-26 08:36:22,841][123090] Updated weights for policy 1, policy_version 1121107 (0.0010) [2023-12-26 08:36:22,909][123090] Updated weights for policy 1, policy_version 1121117 (0.0011) [2023-12-26 08:36:23,407][123091] Updated weights for policy 0, policy_version 1129010 (0.0008) [2023-12-26 08:36:23,477][123091] Updated weights for policy 0, policy_version 1129020 (0.0005) [2023-12-26 08:36:23,547][123091] Updated weights for policy 0, policy_version 1129030 (0.0007) [2023-12-26 08:36:23,609][123091] Updated weights for policy 0, policy_version 1129040 (0.0010) [2023-12-26 08:36:23,715][123090] Updated weights for policy 1, policy_version 1121127 (0.0010) [2023-12-26 08:36:23,769][123090] Updated weights for policy 1, policy_version 1121137 (0.0010) [2023-12-26 08:36:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 576045056. Throughput: 0: 8893.2, 1: 8841.2. Samples: 576022836. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:23,785][121949] Avg episode reward: [(0, '6263.704'), (1, '5506.014')] [2023-12-26 08:36:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001129040_289038336.pth... [2023-12-26 08:36:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001128016_288776192.pth [2023-12-26 08:36:23,824][123090] Updated weights for policy 1, policy_version 1121147 (0.0010) [2023-12-26 08:36:23,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001121152_287014912.pth... [2023-12-26 08:36:23,851][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001120096_286744576.pth [2023-12-26 08:36:24,298][123091] Updated weights for policy 0, policy_version 1129050 (0.0005) [2023-12-26 08:36:24,361][123091] Updated weights for policy 0, policy_version 1129060 (0.0008) [2023-12-26 08:36:24,422][123091] Updated weights for policy 0, policy_version 1129070 (0.0008) [2023-12-26 08:36:24,657][123090] Updated weights for policy 1, policy_version 1121157 (0.0011) [2023-12-26 08:36:24,715][123090] Updated weights for policy 1, policy_version 1121167 (0.0010) [2023-12-26 08:36:24,769][123090] Updated weights for policy 1, policy_version 1121177 (0.0010) [2023-12-26 08:36:25,232][123091] Updated weights for policy 0, policy_version 1129080 (0.0006) [2023-12-26 08:36:25,288][123091] Updated weights for policy 0, policy_version 1129090 (0.0005) [2023-12-26 08:36:25,350][123091] Updated weights for policy 0, policy_version 1129100 (0.0006) [2023-12-26 08:36:25,598][123090] Updated weights for policy 1, policy_version 1121187 (0.0010) [2023-12-26 08:36:25,650][123090] Updated weights for policy 1, policy_version 1121197 (0.0010) [2023-12-26 08:36:25,718][123090] Updated weights for policy 1, policy_version 1121207 (0.0011) [2023-12-26 08:36:25,975][123091] Updated weights for policy 0, policy_version 1129110 (0.0006) [2023-12-26 08:36:26,043][123091] Updated weights for policy 0, policy_version 1129120 (0.0006) [2023-12-26 08:36:26,113][123091] Updated weights for policy 0, policy_version 1129130 (0.0005) [2023-12-26 08:36:26,552][123090] Updated weights for policy 1, policy_version 1121217 (0.0010) [2023-12-26 08:36:26,605][123090] Updated weights for policy 1, policy_version 1121227 (0.0010) [2023-12-26 08:36:26,652][123090] Updated weights for policy 1, policy_version 1121237 (0.0010) [2023-12-26 08:36:26,703][123090] Updated weights for policy 1, policy_version 1121247 (0.0010) [2023-12-26 08:36:26,705][123091] Updated weights for policy 0, policy_version 1129140 (0.0007) [2023-12-26 08:36:26,761][123091] Updated weights for policy 0, policy_version 1129150 (0.0005) [2023-12-26 08:36:26,815][123091] Updated weights for policy 0, policy_version 1129160 (0.0005) [2023-12-26 08:36:27,487][123090] Updated weights for policy 1, policy_version 1121257 (0.0010) [2023-12-26 08:36:27,534][123090] Updated weights for policy 1, policy_version 1121267 (0.0010) [2023-12-26 08:36:27,537][123091] Updated weights for policy 0, policy_version 1129170 (0.0005) [2023-12-26 08:36:27,585][123090] Updated weights for policy 1, policy_version 1121277 (0.0010) [2023-12-26 08:36:27,596][123091] Updated weights for policy 0, policy_version 1129180 (0.0009) [2023-12-26 08:36:27,659][123091] Updated weights for policy 0, policy_version 1129190 (0.0010) [2023-12-26 08:36:27,717][123091] Updated weights for policy 0, policy_version 1129200 (0.0010) [2023-12-26 08:36:28,448][123090] Updated weights for policy 1, policy_version 1121287 (0.0010) [2023-12-26 08:36:28,476][123091] Updated weights for policy 0, policy_version 1129210 (0.0009) [2023-12-26 08:36:28,511][123090] Updated weights for policy 1, policy_version 1121297 (0.0010) [2023-12-26 08:36:28,535][123091] Updated weights for policy 0, policy_version 1129220 (0.0011) [2023-12-26 08:36:28,573][123090] Updated weights for policy 1, policy_version 1121307 (0.0010) [2023-12-26 08:36:28,586][123091] Updated weights for policy 0, policy_version 1129230 (0.0010) [2023-12-26 08:36:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 576143360. Throughput: 0: 8934.3, 1: 8840.4. Samples: 576132456. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:28,785][121949] Avg episode reward: [(0, '6314.484'), (1, '5605.608')] [2023-12-26 08:36:29,246][123090] Updated weights for policy 1, policy_version 1121317 (0.0010) [2023-12-26 08:36:29,309][123090] Updated weights for policy 1, policy_version 1121327 (0.0008) [2023-12-26 08:36:29,310][123091] Updated weights for policy 0, policy_version 1129240 (0.0010) [2023-12-26 08:36:29,374][123091] Updated weights for policy 0, policy_version 1129250 (0.0008) [2023-12-26 08:36:29,379][123090] Updated weights for policy 1, policy_version 1121337 (0.0007) [2023-12-26 08:36:29,442][123091] Updated weights for policy 0, policy_version 1129260 (0.0007) [2023-12-26 08:36:30,114][123090] Updated weights for policy 1, policy_version 1121347 (0.0009) [2023-12-26 08:36:30,164][123090] Updated weights for policy 1, policy_version 1121357 (0.0009) [2023-12-26 08:36:30,212][123090] Updated weights for policy 1, policy_version 1121367 (0.0008) [2023-12-26 08:36:30,321][123091] Updated weights for policy 0, policy_version 1129270 (0.0010) [2023-12-26 08:36:30,373][123091] Updated weights for policy 0, policy_version 1129280 (0.0009) [2023-12-26 08:36:30,430][123091] Updated weights for policy 0, policy_version 1129290 (0.0009) [2023-12-26 08:36:31,021][123090] Updated weights for policy 1, policy_version 1121377 (0.0007) [2023-12-26 08:36:31,080][123090] Updated weights for policy 1, policy_version 1121387 (0.0008) [2023-12-26 08:36:31,139][123090] Updated weights for policy 1, policy_version 1121397 (0.0008) [2023-12-26 08:36:31,206][123090] Updated weights for policy 1, policy_version 1121407 (0.0008) [2023-12-26 08:36:31,280][123091] Updated weights for policy 0, policy_version 1129300 (0.0008) [2023-12-26 08:36:31,332][123091] Updated weights for policy 0, policy_version 1129310 (0.0010) [2023-12-26 08:36:31,401][123091] Updated weights for policy 0, policy_version 1129320 (0.0010) [2023-12-26 08:36:32,050][123090] Updated weights for policy 1, policy_version 1121417 (0.0010) [2023-12-26 08:36:32,105][123090] Updated weights for policy 1, policy_version 1121427 (0.0007) [2023-12-26 08:36:32,154][123090] Updated weights for policy 1, policy_version 1121437 (0.0005) [2023-12-26 08:36:32,257][123091] Updated weights for policy 0, policy_version 1129330 (0.0009) [2023-12-26 08:36:32,320][123091] Updated weights for policy 0, policy_version 1129340 (0.0006) [2023-12-26 08:36:32,389][123091] Updated weights for policy 0, policy_version 1129350 (0.0008) [2023-12-26 08:36:32,446][123091] Updated weights for policy 0, policy_version 1129360 (0.0010) [2023-12-26 08:36:32,850][123090] Updated weights for policy 1, policy_version 1121447 (0.0005) [2023-12-26 08:36:32,907][123090] Updated weights for policy 1, policy_version 1121457 (0.0005) [2023-12-26 08:36:32,970][123090] Updated weights for policy 1, policy_version 1121467 (0.0005) [2023-12-26 08:36:33,189][123091] Updated weights for policy 0, policy_version 1129370 (0.0005) [2023-12-26 08:36:33,257][123091] Updated weights for policy 0, policy_version 1129380 (0.0005) [2023-12-26 08:36:33,322][123091] Updated weights for policy 0, policy_version 1129390 (0.0005) [2023-12-26 08:36:33,625][123090] Updated weights for policy 1, policy_version 1121477 (0.0005) [2023-12-26 08:36:33,695][123090] Updated weights for policy 1, policy_version 1121487 (0.0005) [2023-12-26 08:36:33,745][123090] Updated weights for policy 1, policy_version 1121497 (0.0005) [2023-12-26 08:36:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 576233472. Throughput: 0: 8855.2, 1: 8917.3. Samples: 576242220. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:33,784][121949] Avg episode reward: [(0, '6317.955'), (1, '5570.670')] [2023-12-26 08:36:34,009][123091] Updated weights for policy 0, policy_version 1129400 (0.0005) [2023-12-26 08:36:34,070][123091] Updated weights for policy 0, policy_version 1129410 (0.0005) [2023-12-26 08:36:34,146][123091] Updated weights for policy 0, policy_version 1129420 (0.0006) [2023-12-26 08:36:34,416][123090] Updated weights for policy 1, policy_version 1121507 (0.0006) [2023-12-26 08:36:34,485][123090] Updated weights for policy 1, policy_version 1121517 (0.0008) [2023-12-26 08:36:34,556][123090] Updated weights for policy 1, policy_version 1121527 (0.0009) [2023-12-26 08:36:34,892][123091] Updated weights for policy 0, policy_version 1129430 (0.0008) [2023-12-26 08:36:34,940][123091] Updated weights for policy 0, policy_version 1129440 (0.0009) [2023-12-26 08:36:35,002][123091] Updated weights for policy 0, policy_version 1129450 (0.0009) [2023-12-26 08:36:35,370][123090] Updated weights for policy 1, policy_version 1121537 (0.0010) [2023-12-26 08:36:35,419][123090] Updated weights for policy 1, policy_version 1121547 (0.0009) [2023-12-26 08:36:35,474][123090] Updated weights for policy 1, policy_version 1121557 (0.0009) [2023-12-26 08:36:35,531][123090] Updated weights for policy 1, policy_version 1121567 (0.0009) [2023-12-26 08:36:35,835][123091] Updated weights for policy 0, policy_version 1129460 (0.0008) [2023-12-26 08:36:35,886][123091] Updated weights for policy 0, policy_version 1129470 (0.0005) [2023-12-26 08:36:35,933][123091] Updated weights for policy 0, policy_version 1129480 (0.0005) [2023-12-26 08:36:36,436][123090] Updated weights for policy 1, policy_version 1121577 (0.0010) [2023-12-26 08:36:36,495][123090] Updated weights for policy 1, policy_version 1121587 (0.0009) [2023-12-26 08:36:36,550][123090] Updated weights for policy 1, policy_version 1121597 (0.0010) [2023-12-26 08:36:36,646][123091] Updated weights for policy 0, policy_version 1129490 (0.0007) [2023-12-26 08:36:36,708][123091] Updated weights for policy 0, policy_version 1129500 (0.0005) [2023-12-26 08:36:36,767][123091] Updated weights for policy 0, policy_version 1129510 (0.0006) [2023-12-26 08:36:36,832][123091] Updated weights for policy 0, policy_version 1129520 (0.0005) [2023-12-26 08:36:37,397][123090] Updated weights for policy 1, policy_version 1121607 (0.0007) [2023-12-26 08:36:37,431][123091] Updated weights for policy 0, policy_version 1129530 (0.0005) [2023-12-26 08:36:37,475][123090] Updated weights for policy 1, policy_version 1121617 (0.0005) [2023-12-26 08:36:37,493][123091] Updated weights for policy 0, policy_version 1129540 (0.0006) [2023-12-26 08:36:37,550][123090] Updated weights for policy 1, policy_version 1121627 (0.0005) [2023-12-26 08:36:37,556][123091] Updated weights for policy 0, policy_version 1129550 (0.0006) [2023-12-26 08:36:38,294][123091] Updated weights for policy 0, policy_version 1129560 (0.0005) [2023-12-26 08:36:38,326][123090] Updated weights for policy 1, policy_version 1121637 (0.0007) [2023-12-26 08:36:38,368][123091] Updated weights for policy 0, policy_version 1129570 (0.0008) [2023-12-26 08:36:38,396][123090] Updated weights for policy 1, policy_version 1121647 (0.0006) [2023-12-26 08:36:38,430][123091] Updated weights for policy 0, policy_version 1129580 (0.0010) [2023-12-26 08:36:38,460][123090] Updated weights for policy 1, policy_version 1121657 (0.0007) [2023-12-26 08:36:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 576323584. Throughput: 0: 8921.1, 1: 8889.8. Samples: 576295956. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:38,785][121949] Avg episode reward: [(0, '6328.674'), (1, '5738.876')] [2023-12-26 08:36:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001121664_287145984.pth... [2023-12-26 08:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001129584_289177600.pth... [2023-12-26 08:36:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001120608_286875648.pth [2023-12-26 08:36:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001128528_288907264.pth [2023-12-26 08:36:39,165][123091] Updated weights for policy 0, policy_version 1129590 (0.0005) [2023-12-26 08:36:39,232][123091] Updated weights for policy 0, policy_version 1129600 (0.0006) [2023-12-26 08:36:39,284][123090] Updated weights for policy 1, policy_version 1121667 (0.0010) [2023-12-26 08:36:39,301][123091] Updated weights for policy 0, policy_version 1129610 (0.0010) [2023-12-26 08:36:39,343][123090] Updated weights for policy 1, policy_version 1121677 (0.0008) [2023-12-26 08:36:39,407][123090] Updated weights for policy 1, policy_version 1121687 (0.0008) [2023-12-26 08:36:40,154][123091] Updated weights for policy 0, policy_version 1129620 (0.0009) [2023-12-26 08:36:40,214][123091] Updated weights for policy 0, policy_version 1129630 (0.0006) [2023-12-26 08:36:40,263][123090] Updated weights for policy 1, policy_version 1121697 (0.0006) [2023-12-26 08:36:40,268][123091] Updated weights for policy 0, policy_version 1129640 (0.0007) [2023-12-26 08:36:40,333][123090] Updated weights for policy 1, policy_version 1121707 (0.0009) [2023-12-26 08:36:40,401][123090] Updated weights for policy 1, policy_version 1121717 (0.0010) [2023-12-26 08:36:40,452][123090] Updated weights for policy 1, policy_version 1121727 (0.0009) [2023-12-26 08:36:41,066][123091] Updated weights for policy 0, policy_version 1129650 (0.0007) [2023-12-26 08:36:41,126][123091] Updated weights for policy 0, policy_version 1129660 (0.0009) [2023-12-26 08:36:41,196][123091] Updated weights for policy 0, policy_version 1129670 (0.0009) [2023-12-26 08:36:41,262][123091] Updated weights for policy 0, policy_version 1129680 (0.0009) [2023-12-26 08:36:41,297][123090] Updated weights for policy 1, policy_version 1121737 (0.0009) [2023-12-26 08:36:41,374][123090] Updated weights for policy 1, policy_version 1121747 (0.0010) [2023-12-26 08:36:41,442][123090] Updated weights for policy 1, policy_version 1121757 (0.0009) [2023-12-26 08:36:42,063][123091] Updated weights for policy 0, policy_version 1129690 (0.0009) [2023-12-26 08:36:42,127][123091] Updated weights for policy 0, policy_version 1129700 (0.0009) [2023-12-26 08:36:42,182][123091] Updated weights for policy 0, policy_version 1129710 (0.0009) [2023-12-26 08:36:42,305][123090] Updated weights for policy 1, policy_version 1121767 (0.0009) [2023-12-26 08:36:42,378][123090] Updated weights for policy 1, policy_version 1121777 (0.0009) [2023-12-26 08:36:42,440][123090] Updated weights for policy 1, policy_version 1121787 (0.0005) [2023-12-26 08:36:43,045][123091] Updated weights for policy 0, policy_version 1129720 (0.0009) [2023-12-26 08:36:43,097][123091] Updated weights for policy 0, policy_version 1129731 (0.0009) [2023-12-26 08:36:43,151][123091] Updated weights for policy 0, policy_version 1129741 (0.0008) [2023-12-26 08:36:43,252][123090] Updated weights for policy 1, policy_version 1121797 (0.0008) [2023-12-26 08:36:43,309][123090] Updated weights for policy 1, policy_version 1121808 (0.0010) [2023-12-26 08:36:43,360][123090] Updated weights for policy 1, policy_version 1121818 (0.0009) [2023-12-26 08:36:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 576405504. Throughput: 0: 8952.4, 1: 8866.2. Samples: 576401020. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:43,785][121949] Avg episode reward: [(0, '6301.357'), (1, '5783.875')] [2023-12-26 08:36:43,919][123091] Updated weights for policy 0, policy_version 1129751 (0.0008) [2023-12-26 08:36:43,979][123091] Updated weights for policy 0, policy_version 1129761 (0.0009) [2023-12-26 08:36:44,045][123091] Updated weights for policy 0, policy_version 1129771 (0.0008) [2023-12-26 08:36:44,241][123090] Updated weights for policy 1, policy_version 1121828 (0.0010) [2023-12-26 08:36:44,297][123090] Updated weights for policy 1, policy_version 1121838 (0.0009) [2023-12-26 08:36:44,365][123090] Updated weights for policy 1, policy_version 1121848 (0.0010) [2023-12-26 08:36:44,888][123091] Updated weights for policy 0, policy_version 1129781 (0.0010) [2023-12-26 08:36:44,953][123091] Updated weights for policy 0, policy_version 1129791 (0.0009) [2023-12-26 08:36:45,021][123091] Updated weights for policy 0, policy_version 1129801 (0.0010) [2023-12-26 08:36:45,233][123090] Updated weights for policy 1, policy_version 1121858 (0.0010) [2023-12-26 08:36:45,302][123090] Updated weights for policy 1, policy_version 1121868 (0.0009) [2023-12-26 08:36:45,370][123090] Updated weights for policy 1, policy_version 1121878 (0.0009) [2023-12-26 08:36:45,431][123090] Updated weights for policy 1, policy_version 1121888 (0.0009) [2023-12-26 08:36:45,776][123091] Updated weights for policy 0, policy_version 1129811 (0.0011) [2023-12-26 08:36:45,838][123091] Updated weights for policy 0, policy_version 1129821 (0.0011) [2023-12-26 08:36:45,900][123091] Updated weights for policy 0, policy_version 1129831 (0.0010) [2023-12-26 08:36:46,286][123090] Updated weights for policy 1, policy_version 1121898 (0.0009) [2023-12-26 08:36:46,338][123090] Updated weights for policy 1, policy_version 1121908 (0.0009) [2023-12-26 08:36:46,398][123090] Updated weights for policy 1, policy_version 1121918 (0.0008) [2023-12-26 08:36:46,680][123091] Updated weights for policy 0, policy_version 1129841 (0.0009) [2023-12-26 08:36:46,742][123091] Updated weights for policy 0, policy_version 1129851 (0.0005) [2023-12-26 08:36:46,798][123091] Updated weights for policy 0, policy_version 1129861 (0.0005) [2023-12-26 08:36:46,851][123091] Updated weights for policy 0, policy_version 1129871 (0.0005) [2023-12-26 08:36:47,322][123090] Updated weights for policy 1, policy_version 1121928 (0.0010) [2023-12-26 08:36:47,386][123090] Updated weights for policy 1, policy_version 1121938 (0.0009) [2023-12-26 08:36:47,460][123090] Updated weights for policy 1, policy_version 1121948 (0.0010) [2023-12-26 08:36:47,466][123091] Updated weights for policy 0, policy_version 1129881 (0.0010) [2023-12-26 08:36:47,517][123091] Updated weights for policy 0, policy_version 1129891 (0.0010) [2023-12-26 08:36:47,578][123091] Updated weights for policy 0, policy_version 1129901 (0.0010) [2023-12-26 08:36:48,270][123091] Updated weights for policy 0, policy_version 1129911 (0.0007) [2023-12-26 08:36:48,331][123091] Updated weights for policy 0, policy_version 1129921 (0.0006) [2023-12-26 08:36:48,376][123090] Updated weights for policy 1, policy_version 1121958 (0.0007) [2023-12-26 08:36:48,391][123091] Updated weights for policy 0, policy_version 1129931 (0.0007) [2023-12-26 08:36:48,432][123090] Updated weights for policy 1, policy_version 1121968 (0.0009) [2023-12-26 08:36:48,484][123090] Updated weights for policy 1, policy_version 1121978 (0.0009) [2023-12-26 08:36:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 576495616. Throughput: 0: 9058.1, 1: 8747.3. Samples: 576505684. Policy #0 lag: (min: 31.0, avg: 44.5, max: 63.0) [2023-12-26 08:36:48,785][121949] Avg episode reward: [(0, '6183.852'), (1, '5662.529')] [2023-12-26 08:36:49,129][123091] Updated weights for policy 0, policy_version 1129941 (0.0008) [2023-12-26 08:36:49,187][123091] Updated weights for policy 0, policy_version 1129952 (0.0009) [2023-12-26 08:36:49,258][123091] Updated weights for policy 0, policy_version 1129962 (0.0010) [2023-12-26 08:36:49,344][123090] Updated weights for policy 1, policy_version 1121988 (0.0009) [2023-12-26 08:36:49,409][123090] Updated weights for policy 1, policy_version 1121998 (0.0009) [2023-12-26 08:36:49,472][123090] Updated weights for policy 1, policy_version 1122008 (0.0009) [2023-12-26 08:36:50,170][123091] Updated weights for policy 0, policy_version 1129972 (0.0009) [2023-12-26 08:36:50,210][123090] Updated weights for policy 1, policy_version 1122018 (0.0008) [2023-12-26 08:36:50,230][123091] Updated weights for policy 0, policy_version 1129982 (0.0009) [2023-12-26 08:36:50,281][123090] Updated weights for policy 1, policy_version 1122028 (0.0009) [2023-12-26 08:36:50,291][123091] Updated weights for policy 0, policy_version 1129992 (0.0007) [2023-12-26 08:36:50,347][123090] Updated weights for policy 1, policy_version 1122038 (0.0009) [2023-12-26 08:36:50,409][123090] Updated weights for policy 1, policy_version 1122048 (0.0010) [2023-12-26 08:36:51,105][123091] Updated weights for policy 0, policy_version 1130002 (0.0007) [2023-12-26 08:36:51,174][123091] Updated weights for policy 0, policy_version 1130012 (0.0007) [2023-12-26 08:36:51,239][123091] Updated weights for policy 0, policy_version 1130022 (0.0006) [2023-12-26 08:36:51,253][123090] Updated weights for policy 1, policy_version 1122058 (0.0008) [2023-12-26 08:36:51,311][123091] Updated weights for policy 0, policy_version 1130032 (0.0007) [2023-12-26 08:36:51,316][123090] Updated weights for policy 1, policy_version 1122068 (0.0006) [2023-12-26 08:36:51,389][123090] Updated weights for policy 1, policy_version 1122078 (0.0007) [2023-12-26 08:36:52,102][123091] Updated weights for policy 0, policy_version 1130042 (0.0011) [2023-12-26 08:36:52,122][123090] Updated weights for policy 1, policy_version 1122088 (0.0008) [2023-12-26 08:36:52,158][123091] Updated weights for policy 0, policy_version 1130052 (0.0010) [2023-12-26 08:36:52,174][123090] Updated weights for policy 1, policy_version 1122098 (0.0006) [2023-12-26 08:36:52,214][123091] Updated weights for policy 0, policy_version 1130062 (0.0010) [2023-12-26 08:36:52,238][123090] Updated weights for policy 1, policy_version 1122108 (0.0009) [2023-12-26 08:36:53,069][123091] Updated weights for policy 0, policy_version 1130072 (0.0011) [2023-12-26 08:36:53,106][123090] Updated weights for policy 1, policy_version 1122118 (0.0007) [2023-12-26 08:36:53,133][123091] Updated weights for policy 0, policy_version 1130082 (0.0011) [2023-12-26 08:36:53,167][123090] Updated weights for policy 1, policy_version 1122128 (0.0006) [2023-12-26 08:36:53,198][123091] Updated weights for policy 0, policy_version 1130092 (0.0011) [2023-12-26 08:36:53,232][123090] Updated weights for policy 1, policy_version 1122138 (0.0006) [2023-12-26 08:36:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 576577536. Throughput: 0: 9016.6, 1: 8732.8. Samples: 576557328. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:36:53,785][121949] Avg episode reward: [(0, '6192.045'), (1, '5689.562')] [2023-12-26 08:36:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001130096_289308672.pth... [2023-12-26 08:36:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001122144_287268864.pth... [2023-12-26 08:36:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001129040_289038336.pth [2023-12-26 08:36:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001121152_287014912.pth [2023-12-26 08:36:53,991][123090] Updated weights for policy 1, policy_version 1122148 (0.0008) [2023-12-26 08:36:54,009][123091] Updated weights for policy 0, policy_version 1130102 (0.0010) [2023-12-26 08:36:54,049][123090] Updated weights for policy 1, policy_version 1122158 (0.0006) [2023-12-26 08:36:54,068][123091] Updated weights for policy 0, policy_version 1130112 (0.0011) [2023-12-26 08:36:54,113][123090] Updated weights for policy 1, policy_version 1122168 (0.0006) [2023-12-26 08:36:54,123][123091] Updated weights for policy 0, policy_version 1130122 (0.0011) [2023-12-26 08:36:54,809][123090] Updated weights for policy 1, policy_version 1122178 (0.0006) [2023-12-26 08:36:54,857][123090] Updated weights for policy 1, policy_version 1122188 (0.0009) [2023-12-26 08:36:54,910][123090] Updated weights for policy 1, policy_version 1122198 (0.0010) [2023-12-26 08:36:54,946][123091] Updated weights for policy 0, policy_version 1130132 (0.0010) [2023-12-26 08:36:54,970][123090] Updated weights for policy 1, policy_version 1122208 (0.0009) [2023-12-26 08:36:54,995][123091] Updated weights for policy 0, policy_version 1130142 (0.0009) [2023-12-26 08:36:55,056][123091] Updated weights for policy 0, policy_version 1130152 (0.0006) [2023-12-26 08:36:55,745][123091] Updated weights for policy 0, policy_version 1130162 (0.0006) [2023-12-26 08:36:55,808][123091] Updated weights for policy 0, policy_version 1130172 (0.0005) [2023-12-26 08:36:55,870][123091] Updated weights for policy 0, policy_version 1130182 (0.0005) [2023-12-26 08:36:55,908][123090] Updated weights for policy 1, policy_version 1122219 (0.0009) [2023-12-26 08:36:55,928][123091] Updated weights for policy 0, policy_version 1130192 (0.0005) [2023-12-26 08:36:55,957][123090] Updated weights for policy 1, policy_version 1122229 (0.0009) [2023-12-26 08:36:56,696][123091] Updated weights for policy 0, policy_version 1130202 (0.0008) [2023-12-26 08:36:56,759][123091] Updated weights for policy 0, policy_version 1130212 (0.0008) [2023-12-26 08:36:56,777][123090] Updated weights for policy 1, policy_version 1122241 (0.0010) [2023-12-26 08:36:56,831][123091] Updated weights for policy 0, policy_version 1130222 (0.0009) [2023-12-26 08:36:56,833][123090] Updated weights for policy 1, policy_version 1122251 (0.0006) [2023-12-26 08:36:56,896][123090] Updated weights for policy 1, policy_version 1122261 (0.0005) [2023-12-26 08:36:56,954][123090] Updated weights for policy 1, policy_version 1122271 (0.0005) [2023-12-26 08:36:57,485][123091] Updated weights for policy 0, policy_version 1130232 (0.0010) [2023-12-26 08:36:57,540][123091] Updated weights for policy 0, policy_version 1130242 (0.0006) [2023-12-26 08:36:57,571][123090] Updated weights for policy 1, policy_version 1122281 (0.0006) [2023-12-26 08:36:57,598][123091] Updated weights for policy 0, policy_version 1130252 (0.0006) [2023-12-26 08:36:57,628][123090] Updated weights for policy 1, policy_version 1122292 (0.0010) [2023-12-26 08:36:57,679][123090] Updated weights for policy 1, policy_version 1122302 (0.0010) [2023-12-26 08:36:58,252][123091] Updated weights for policy 0, policy_version 1130262 (0.0007) [2023-12-26 08:36:58,308][123091] Updated weights for policy 0, policy_version 1130272 (0.0008) [2023-12-26 08:36:58,376][123091] Updated weights for policy 0, policy_version 1130282 (0.0010) [2023-12-26 08:36:58,545][123090] Updated weights for policy 1, policy_version 1122312 (0.0011) [2023-12-26 08:36:58,613][123090] Updated weights for policy 1, policy_version 1122322 (0.0011) [2023-12-26 08:36:58,683][123090] Updated weights for policy 1, policy_version 1122332 (0.0011) [2023-12-26 08:36:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17886.4, 300 sec: 17828.0). Total num frames: 576675840. Throughput: 0: 9061.8, 1: 8825.6. Samples: 576666368. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:36:58,784][121949] Avg episode reward: [(0, '6271.644'), (1, '5791.009')] [2023-12-26 08:36:59,262][123091] Updated weights for policy 0, policy_version 1130292 (0.0009) [2023-12-26 08:36:59,335][123091] Updated weights for policy 0, policy_version 1130302 (0.0008) [2023-12-26 08:36:59,401][123091] Updated weights for policy 0, policy_version 1130312 (0.0007) [2023-12-26 08:36:59,548][123090] Updated weights for policy 1, policy_version 1122342 (0.0011) [2023-12-26 08:36:59,600][123090] Updated weights for policy 1, policy_version 1122352 (0.0010) [2023-12-26 08:36:59,663][123090] Updated weights for policy 1, policy_version 1122362 (0.0010) [2023-12-26 08:37:00,194][123091] Updated weights for policy 0, policy_version 1130322 (0.0006) [2023-12-26 08:37:00,262][123091] Updated weights for policy 0, policy_version 1130332 (0.0010) [2023-12-26 08:37:00,328][123091] Updated weights for policy 0, policy_version 1130342 (0.0009) [2023-12-26 08:37:00,383][123091] Updated weights for policy 0, policy_version 1130352 (0.0010) [2023-12-26 08:37:00,448][123090] Updated weights for policy 1, policy_version 1122372 (0.0008) [2023-12-26 08:37:00,509][123090] Updated weights for policy 1, policy_version 1122382 (0.0006) [2023-12-26 08:37:00,561][123090] Updated weights for policy 1, policy_version 1122392 (0.0006) [2023-12-26 08:37:01,273][123090] Updated weights for policy 1, policy_version 1122402 (0.0009) [2023-12-26 08:37:01,296][123091] Updated weights for policy 0, policy_version 1130362 (0.0009) [2023-12-26 08:37:01,331][123090] Updated weights for policy 1, policy_version 1122412 (0.0006) [2023-12-26 08:37:01,360][123091] Updated weights for policy 0, policy_version 1130372 (0.0009) [2023-12-26 08:37:01,412][123090] Updated weights for policy 1, policy_version 1122422 (0.0008) [2023-12-26 08:37:01,427][123091] Updated weights for policy 0, policy_version 1130382 (0.0009) [2023-12-26 08:37:01,475][123090] Updated weights for policy 1, policy_version 1122432 (0.0010) [2023-12-26 08:37:02,251][123091] Updated weights for policy 0, policy_version 1130392 (0.0009) [2023-12-26 08:37:02,275][123090] Updated weights for policy 1, policy_version 1122442 (0.0007) [2023-12-26 08:37:02,310][123091] Updated weights for policy 0, policy_version 1130402 (0.0008) [2023-12-26 08:37:02,338][123090] Updated weights for policy 1, policy_version 1122452 (0.0008) [2023-12-26 08:37:02,377][123091] Updated weights for policy 0, policy_version 1130412 (0.0008) [2023-12-26 08:37:02,420][123090] Updated weights for policy 1, policy_version 1122462 (0.0009) [2023-12-26 08:37:03,167][123091] Updated weights for policy 0, policy_version 1130422 (0.0006) [2023-12-26 08:37:03,167][123090] Updated weights for policy 1, policy_version 1122472 (0.0009) [2023-12-26 08:37:03,215][123091] Updated weights for policy 0, policy_version 1130432 (0.0005) [2023-12-26 08:37:03,218][123090] Updated weights for policy 1, policy_version 1122482 (0.0010) [2023-12-26 08:37:03,263][123091] Updated weights for policy 0, policy_version 1130442 (0.0005) [2023-12-26 08:37:03,267][123090] Updated weights for policy 1, policy_version 1122492 (0.0008) [2023-12-26 08:37:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 576757760. Throughput: 0: 9046.9, 1: 8742.5. Samples: 576772260. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:03,785][121949] Avg episode reward: [(0, '6312.535'), (1, '5771.430')] [2023-12-26 08:37:03,895][123091] Updated weights for policy 0, policy_version 1130452 (0.0005) [2023-12-26 08:37:03,954][123091] Updated weights for policy 0, policy_version 1130462 (0.0009) [2023-12-26 08:37:03,989][123090] Updated weights for policy 1, policy_version 1122502 (0.0008) [2023-12-26 08:37:04,006][123091] Updated weights for policy 0, policy_version 1130472 (0.0010) [2023-12-26 08:37:04,053][123090] Updated weights for policy 1, policy_version 1122512 (0.0010) [2023-12-26 08:37:04,116][123090] Updated weights for policy 1, policy_version 1122522 (0.0010) [2023-12-26 08:37:04,739][123091] Updated weights for policy 0, policy_version 1130482 (0.0009) [2023-12-26 08:37:04,795][123091] Updated weights for policy 0, policy_version 1130492 (0.0005) [2023-12-26 08:37:04,855][123090] Updated weights for policy 1, policy_version 1122532 (0.0008) [2023-12-26 08:37:04,856][123091] Updated weights for policy 0, policy_version 1130502 (0.0008) [2023-12-26 08:37:04,907][123091] Updated weights for policy 0, policy_version 1130512 (0.0010) [2023-12-26 08:37:04,917][123090] Updated weights for policy 1, policy_version 1122542 (0.0009) [2023-12-26 08:37:04,986][123090] Updated weights for policy 1, policy_version 1122552 (0.0010) [2023-12-26 08:37:05,614][123090] Updated weights for policy 1, policy_version 1122562 (0.0009) [2023-12-26 08:37:05,668][123090] Updated weights for policy 1, policy_version 1122572 (0.0008) [2023-12-26 08:37:05,709][123091] Updated weights for policy 0, policy_version 1130522 (0.0011) [2023-12-26 08:37:05,720][123090] Updated weights for policy 1, policy_version 1122582 (0.0006) [2023-12-26 08:37:05,765][123091] Updated weights for policy 0, policy_version 1130532 (0.0010) [2023-12-26 08:37:05,771][123090] Updated weights for policy 1, policy_version 1122592 (0.0006) [2023-12-26 08:37:05,831][123091] Updated weights for policy 0, policy_version 1130542 (0.0011) [2023-12-26 08:37:06,589][123091] Updated weights for policy 0, policy_version 1130552 (0.0007) [2023-12-26 08:37:06,642][123090] Updated weights for policy 1, policy_version 1122602 (0.0011) [2023-12-26 08:37:06,656][123091] Updated weights for policy 0, policy_version 1130562 (0.0006) [2023-12-26 08:37:06,697][123090] Updated weights for policy 1, policy_version 1122612 (0.0010) [2023-12-26 08:37:06,722][123091] Updated weights for policy 0, policy_version 1130572 (0.0006) [2023-12-26 08:37:06,752][123090] Updated weights for policy 1, policy_version 1122622 (0.0010) [2023-12-26 08:37:07,459][123091] Updated weights for policy 0, policy_version 1130582 (0.0009) [2023-12-26 08:37:07,510][123091] Updated weights for policy 0, policy_version 1130593 (0.0010) [2023-12-26 08:37:07,569][123091] Updated weights for policy 0, policy_version 1130603 (0.0008) [2023-12-26 08:37:07,579][123090] Updated weights for policy 1, policy_version 1122632 (0.0006) [2023-12-26 08:37:07,640][123090] Updated weights for policy 1, policy_version 1122642 (0.0005) [2023-12-26 08:37:07,701][123090] Updated weights for policy 1, policy_version 1122652 (0.0005) [2023-12-26 08:37:08,289][123091] Updated weights for policy 0, policy_version 1130613 (0.0007) [2023-12-26 08:37:08,359][123091] Updated weights for policy 0, policy_version 1130623 (0.0008) [2023-12-26 08:37:08,414][123091] Updated weights for policy 0, policy_version 1130633 (0.0008) [2023-12-26 08:37:08,455][123090] Updated weights for policy 1, policy_version 1122662 (0.0006) [2023-12-26 08:37:08,505][123090] Updated weights for policy 1, policy_version 1122672 (0.0009) [2023-12-26 08:37:08,555][123090] Updated weights for policy 1, policy_version 1122682 (0.0009) [2023-12-26 08:37:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 576856064. Throughput: 0: 9120.3, 1: 8783.5. Samples: 576828504. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:08,785][121949] Avg episode reward: [(0, '6326.305'), (1, '5768.961')] [2023-12-26 08:37:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001130640_289447936.pth... [2023-12-26 08:37:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001122688_287408128.pth... [2023-12-26 08:37:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001129584_289177600.pth [2023-12-26 08:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001121664_287145984.pth [2023-12-26 08:37:09,079][123091] Updated weights for policy 0, policy_version 1130643 (0.0007) [2023-12-26 08:37:09,126][123091] Updated weights for policy 0, policy_version 1130653 (0.0005) [2023-12-26 08:37:09,186][123091] Updated weights for policy 0, policy_version 1130663 (0.0005) [2023-12-26 08:37:09,476][123090] Updated weights for policy 1, policy_version 1122692 (0.0010) [2023-12-26 08:37:09,547][123090] Updated weights for policy 1, policy_version 1122702 (0.0011) [2023-12-26 08:37:09,612][123090] Updated weights for policy 1, policy_version 1122712 (0.0010) [2023-12-26 08:37:09,872][123091] Updated weights for policy 0, policy_version 1130673 (0.0007) [2023-12-26 08:37:09,942][123091] Updated weights for policy 0, policy_version 1130683 (0.0006) [2023-12-26 08:37:10,009][123091] Updated weights for policy 0, policy_version 1130693 (0.0011) [2023-12-26 08:37:10,074][123091] Updated weights for policy 0, policy_version 1130703 (0.0009) [2023-12-26 08:37:10,459][123090] Updated weights for policy 1, policy_version 1122722 (0.0010) [2023-12-26 08:37:10,529][123090] Updated weights for policy 1, policy_version 1122732 (0.0010) [2023-12-26 08:37:10,595][123090] Updated weights for policy 1, policy_version 1122742 (0.0010) [2023-12-26 08:37:10,658][123090] Updated weights for policy 1, policy_version 1122752 (0.0010) [2023-12-26 08:37:10,863][123091] Updated weights for policy 0, policy_version 1130713 (0.0010) [2023-12-26 08:37:10,929][123091] Updated weights for policy 0, policy_version 1130723 (0.0010) [2023-12-26 08:37:10,999][123091] Updated weights for policy 0, policy_version 1130733 (0.0010) [2023-12-26 08:37:11,427][123090] Updated weights for policy 1, policy_version 1122762 (0.0008) [2023-12-26 08:37:11,489][123090] Updated weights for policy 1, policy_version 1122772 (0.0009) [2023-12-26 08:37:11,560][123090] Updated weights for policy 1, policy_version 1122782 (0.0007) [2023-12-26 08:37:11,844][123091] Updated weights for policy 0, policy_version 1130743 (0.0007) [2023-12-26 08:37:11,916][123091] Updated weights for policy 0, policy_version 1130753 (0.0006) [2023-12-26 08:37:11,983][123091] Updated weights for policy 0, policy_version 1130763 (0.0006) [2023-12-26 08:37:12,289][123090] Updated weights for policy 1, policy_version 1122792 (0.0007) [2023-12-26 08:37:12,361][123090] Updated weights for policy 1, policy_version 1122802 (0.0010) [2023-12-26 08:37:12,434][123090] Updated weights for policy 1, policy_version 1122812 (0.0009) [2023-12-26 08:37:12,717][123091] Updated weights for policy 0, policy_version 1130773 (0.0009) [2023-12-26 08:37:12,778][123091] Updated weights for policy 0, policy_version 1130783 (0.0008) [2023-12-26 08:37:12,842][123091] Updated weights for policy 0, policy_version 1130793 (0.0009) [2023-12-26 08:37:13,166][123090] Updated weights for policy 1, policy_version 1122822 (0.0007) [2023-12-26 08:37:13,219][123090] Updated weights for policy 1, policy_version 1122832 (0.0005) [2023-12-26 08:37:13,267][123090] Updated weights for policy 1, policy_version 1122842 (0.0005) [2023-12-26 08:37:13,616][123091] Updated weights for policy 0, policy_version 1130803 (0.0009) [2023-12-26 08:37:13,668][123091] Updated weights for policy 0, policy_version 1130813 (0.0010) [2023-12-26 08:37:13,722][123091] Updated weights for policy 0, policy_version 1130823 (0.0010) [2023-12-26 08:37:13,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 576946176. Throughput: 0: 9079.0, 1: 8782.5. Samples: 576936224. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:13,785][121949] Avg episode reward: [(0, '6303.274'), (1, '5861.736')] [2023-12-26 08:37:13,941][123090] Updated weights for policy 1, policy_version 1122852 (0.0006) [2023-12-26 08:37:14,005][123090] Updated weights for policy 1, policy_version 1122862 (0.0009) [2023-12-26 08:37:14,065][123090] Updated weights for policy 1, policy_version 1122872 (0.0009) [2023-12-26 08:37:14,546][123091] Updated weights for policy 0, policy_version 1130833 (0.0010) [2023-12-26 08:37:14,615][123091] Updated weights for policy 0, policy_version 1130843 (0.0011) [2023-12-26 08:37:14,669][123091] Updated weights for policy 0, policy_version 1130853 (0.0010) [2023-12-26 08:37:14,733][123091] Updated weights for policy 0, policy_version 1130863 (0.0009) [2023-12-26 08:37:14,910][123090] Updated weights for policy 1, policy_version 1122882 (0.0009) [2023-12-26 08:37:14,977][123090] Updated weights for policy 1, policy_version 1122892 (0.0009) [2023-12-26 08:37:15,043][123090] Updated weights for policy 1, policy_version 1122902 (0.0009) [2023-12-26 08:37:15,097][123090] Updated weights for policy 1, policy_version 1122912 (0.0010) [2023-12-26 08:37:15,489][123091] Updated weights for policy 0, policy_version 1130873 (0.0010) [2023-12-26 08:37:15,557][123091] Updated weights for policy 0, policy_version 1130883 (0.0010) [2023-12-26 08:37:15,626][123091] Updated weights for policy 0, policy_version 1130893 (0.0010) [2023-12-26 08:37:15,915][123090] Updated weights for policy 1, policy_version 1122922 (0.0010) [2023-12-26 08:37:15,975][123090] Updated weights for policy 1, policy_version 1122932 (0.0010) [2023-12-26 08:37:16,034][123090] Updated weights for policy 1, policy_version 1122942 (0.0010) [2023-12-26 08:37:16,468][123091] Updated weights for policy 0, policy_version 1130903 (0.0008) [2023-12-26 08:37:16,522][123091] Updated weights for policy 0, policy_version 1130913 (0.0005) [2023-12-26 08:37:16,566][123091] Updated weights for policy 0, policy_version 1130923 (0.0005) [2023-12-26 08:37:16,872][123090] Updated weights for policy 1, policy_version 1122952 (0.0010) [2023-12-26 08:37:16,916][123090] Updated weights for policy 1, policy_version 1122962 (0.0010) [2023-12-26 08:37:16,964][123090] Updated weights for policy 1, policy_version 1122972 (0.0010) [2023-12-26 08:37:17,340][123091] Updated weights for policy 0, policy_version 1130933 (0.0007) [2023-12-26 08:37:17,413][123091] Updated weights for policy 0, policy_version 1130943 (0.0009) [2023-12-26 08:37:17,470][123091] Updated weights for policy 0, policy_version 1130953 (0.0008) [2023-12-26 08:37:17,826][123090] Updated weights for policy 1, policy_version 1122982 (0.0008) [2023-12-26 08:37:17,882][123090] Updated weights for policy 1, policy_version 1122992 (0.0005) [2023-12-26 08:37:17,932][123090] Updated weights for policy 1, policy_version 1123002 (0.0005) [2023-12-26 08:37:18,155][123091] Updated weights for policy 0, policy_version 1130963 (0.0008) [2023-12-26 08:37:18,211][123091] Updated weights for policy 0, policy_version 1130973 (0.0005) [2023-12-26 08:37:18,263][123091] Updated weights for policy 0, policy_version 1130983 (0.0005) [2023-12-26 08:37:18,638][123090] Updated weights for policy 1, policy_version 1123012 (0.0007) [2023-12-26 08:37:18,697][123090] Updated weights for policy 1, policy_version 1123022 (0.0010) [2023-12-26 08:37:18,756][123090] Updated weights for policy 1, policy_version 1123032 (0.0010) [2023-12-26 08:37:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 577028096. Throughput: 0: 9097.0, 1: 8734.0. Samples: 577044616. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:18,785][121949] Avg episode reward: [(0, '6312.053'), (1, '5794.534')] [2023-12-26 08:37:19,021][123091] Updated weights for policy 0, policy_version 1130993 (0.0006) [2023-12-26 08:37:19,069][123091] Updated weights for policy 0, policy_version 1131003 (0.0009) [2023-12-26 08:37:19,123][123091] Updated weights for policy 0, policy_version 1131013 (0.0009) [2023-12-26 08:37:19,170][123091] Updated weights for policy 0, policy_version 1131023 (0.0009) [2023-12-26 08:37:19,558][123090] Updated weights for policy 1, policy_version 1123042 (0.0010) [2023-12-26 08:37:19,628][123090] Updated weights for policy 1, policy_version 1123052 (0.0006) [2023-12-26 08:37:19,705][123090] Updated weights for policy 1, policy_version 1123062 (0.0005) [2023-12-26 08:37:19,779][123090] Updated weights for policy 1, policy_version 1123072 (0.0005) [2023-12-26 08:37:20,107][123091] Updated weights for policy 0, policy_version 1131033 (0.0009) [2023-12-26 08:37:20,173][123091] Updated weights for policy 0, policy_version 1131043 (0.0006) [2023-12-26 08:37:20,249][123091] Updated weights for policy 0, policy_version 1131053 (0.0005) [2023-12-26 08:37:20,542][123090] Updated weights for policy 1, policy_version 1123082 (0.0011) [2023-12-26 08:37:20,617][123090] Updated weights for policy 1, policy_version 1123092 (0.0010) [2023-12-26 08:37:20,685][123090] Updated weights for policy 1, policy_version 1123102 (0.0011) [2023-12-26 08:37:20,960][123091] Updated weights for policy 0, policy_version 1131063 (0.0005) [2023-12-26 08:37:21,026][123091] Updated weights for policy 0, policy_version 1131073 (0.0006) [2023-12-26 08:37:21,097][123091] Updated weights for policy 0, policy_version 1131083 (0.0009) [2023-12-26 08:37:21,515][123090] Updated weights for policy 1, policy_version 1123112 (0.0010) [2023-12-26 08:37:21,578][123090] Updated weights for policy 1, policy_version 1123122 (0.0009) [2023-12-26 08:37:21,650][123090] Updated weights for policy 1, policy_version 1123132 (0.0007) [2023-12-26 08:37:21,854][123091] Updated weights for policy 0, policy_version 1131093 (0.0009) [2023-12-26 08:37:21,924][123091] Updated weights for policy 0, policy_version 1131103 (0.0010) [2023-12-26 08:37:22,002][123091] Updated weights for policy 0, policy_version 1131113 (0.0010) [2023-12-26 08:37:22,477][123090] Updated weights for policy 1, policy_version 1123142 (0.0008) [2023-12-26 08:37:22,533][123090] Updated weights for policy 1, policy_version 1123152 (0.0009) [2023-12-26 08:37:22,588][123090] Updated weights for policy 1, policy_version 1123162 (0.0009) [2023-12-26 08:37:22,844][123091] Updated weights for policy 0, policy_version 1131123 (0.0010) [2023-12-26 08:37:22,913][123091] Updated weights for policy 0, policy_version 1131133 (0.0010) [2023-12-26 08:37:22,973][123091] Updated weights for policy 0, policy_version 1131143 (0.0010) [2023-12-26 08:37:23,461][123090] Updated weights for policy 1, policy_version 1123172 (0.0009) [2023-12-26 08:37:23,527][123090] Updated weights for policy 1, policy_version 1123182 (0.0010) [2023-12-26 08:37:23,594][123090] Updated weights for policy 1, policy_version 1123192 (0.0010) [2023-12-26 08:37:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 577118208. Throughput: 0: 9068.3, 1: 8726.8. Samples: 577096736. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:23,784][121949] Avg episode reward: [(0, '6235.301'), (1, '5723.363')] [2023-12-26 08:37:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001123200_287539200.pth... [2023-12-26 08:37:23,793][123091] Updated weights for policy 0, policy_version 1131153 (0.0008) [2023-12-26 08:37:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001122144_287268864.pth [2023-12-26 08:37:23,854][123091] Updated weights for policy 0, policy_version 1131163 (0.0006) [2023-12-26 08:37:23,939][123091] Updated weights for policy 0, policy_version 1131173 (0.0008) [2023-12-26 08:37:23,992][123091] Updated weights for policy 0, policy_version 1131183 (0.0011) [2023-12-26 08:37:23,997][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001131184_289587200.pth... [2023-12-26 08:37:24,001][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001130096_289308672.pth [2023-12-26 08:37:24,405][123090] Updated weights for policy 1, policy_version 1123202 (0.0009) [2023-12-26 08:37:24,457][123090] Updated weights for policy 1, policy_version 1123212 (0.0010) [2023-12-26 08:37:24,506][123090] Updated weights for policy 1, policy_version 1123222 (0.0010) [2023-12-26 08:37:24,555][123090] Updated weights for policy 1, policy_version 1123232 (0.0010) [2023-12-26 08:37:24,713][123091] Updated weights for policy 0, policy_version 1131194 (0.0008) [2023-12-26 08:37:24,769][123091] Updated weights for policy 0, policy_version 1131204 (0.0006) [2023-12-26 08:37:24,831][123091] Updated weights for policy 0, policy_version 1131214 (0.0009) [2023-12-26 08:37:25,375][123090] Updated weights for policy 1, policy_version 1123242 (0.0005) [2023-12-26 08:37:25,429][123090] Updated weights for policy 1, policy_version 1123252 (0.0005) [2023-12-26 08:37:25,484][123090] Updated weights for policy 1, policy_version 1123262 (0.0005) [2023-12-26 08:37:25,666][123091] Updated weights for policy 0, policy_version 1131224 (0.0009) [2023-12-26 08:37:25,735][123091] Updated weights for policy 0, policy_version 1131234 (0.0010) [2023-12-26 08:37:25,789][123091] Updated weights for policy 0, policy_version 1131244 (0.0010) [2023-12-26 08:37:26,110][123090] Updated weights for policy 1, policy_version 1123272 (0.0007) [2023-12-26 08:37:26,157][123090] Updated weights for policy 1, policy_version 1123282 (0.0010) [2023-12-26 08:37:26,209][123090] Updated weights for policy 1, policy_version 1123292 (0.0010) [2023-12-26 08:37:26,645][123091] Updated weights for policy 0, policy_version 1131254 (0.0009) [2023-12-26 08:37:26,706][123091] Updated weights for policy 0, policy_version 1131264 (0.0009) [2023-12-26 08:37:26,757][123091] Updated weights for policy 0, policy_version 1131274 (0.0008) [2023-12-26 08:37:27,038][123090] Updated weights for policy 1, policy_version 1123302 (0.0010) [2023-12-26 08:37:27,099][123090] Updated weights for policy 1, policy_version 1123312 (0.0010) [2023-12-26 08:37:27,161][123090] Updated weights for policy 1, policy_version 1123322 (0.0010) [2023-12-26 08:37:27,616][123091] Updated weights for policy 0, policy_version 1131284 (0.0009) [2023-12-26 08:37:27,667][123091] Updated weights for policy 0, policy_version 1131295 (0.0009) [2023-12-26 08:37:27,728][123091] Updated weights for policy 0, policy_version 1131305 (0.0010) [2023-12-26 08:37:27,820][123090] Updated weights for policy 1, policy_version 1123332 (0.0008) [2023-12-26 08:37:27,869][123090] Updated weights for policy 1, policy_version 1123342 (0.0008) [2023-12-26 08:37:27,915][123090] Updated weights for policy 1, policy_version 1123352 (0.0005) [2023-12-26 08:37:28,629][123090] Updated weights for policy 1, policy_version 1123362 (0.0006) [2023-12-26 08:37:28,656][123091] Updated weights for policy 0, policy_version 1131316 (0.0008) [2023-12-26 08:37:28,691][123090] Updated weights for policy 1, policy_version 1123372 (0.0010) [2023-12-26 08:37:28,719][123091] Updated weights for policy 0, policy_version 1131326 (0.0006) [2023-12-26 08:37:28,754][123090] Updated weights for policy 1, policy_version 1123382 (0.0010) [2023-12-26 08:37:28,774][123091] Updated weights for policy 0, policy_version 1131336 (0.0009) [2023-12-26 08:37:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 577200128. Throughput: 0: 9002.9, 1: 8786.3. Samples: 577201532. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:28,784][121949] Avg episode reward: [(0, '6258.444'), (1, '5697.487')] [2023-12-26 08:37:28,816][123090] Updated weights for policy 1, policy_version 1123392 (0.0010) [2023-12-26 08:37:29,594][123090] Updated weights for policy 1, policy_version 1123402 (0.0010) [2023-12-26 08:37:29,605][123091] Updated weights for policy 0, policy_version 1131346 (0.0009) [2023-12-26 08:37:29,660][123090] Updated weights for policy 1, policy_version 1123412 (0.0009) [2023-12-26 08:37:29,661][123091] Updated weights for policy 0, policy_version 1131356 (0.0007) [2023-12-26 08:37:29,719][123091] Updated weights for policy 0, policy_version 1131366 (0.0006) [2023-12-26 08:37:29,724][123090] Updated weights for policy 1, policy_version 1123422 (0.0009) [2023-12-26 08:37:29,777][123091] Updated weights for policy 0, policy_version 1131376 (0.0008) [2023-12-26 08:37:30,526][123090] Updated weights for policy 1, policy_version 1123432 (0.0010) [2023-12-26 08:37:30,581][123090] Updated weights for policy 1, policy_version 1123442 (0.0010) [2023-12-26 08:37:30,588][123091] Updated weights for policy 0, policy_version 1131386 (0.0009) [2023-12-26 08:37:30,633][123090] Updated weights for policy 1, policy_version 1123452 (0.0010) [2023-12-26 08:37:30,636][123091] Updated weights for policy 0, policy_version 1131396 (0.0006) [2023-12-26 08:37:30,690][123091] Updated weights for policy 0, policy_version 1131406 (0.0008) [2023-12-26 08:37:31,471][123090] Updated weights for policy 1, policy_version 1123462 (0.0010) [2023-12-26 08:37:31,534][123090] Updated weights for policy 1, policy_version 1123472 (0.0010) [2023-12-26 08:37:31,580][123091] Updated weights for policy 0, policy_version 1131416 (0.0006) [2023-12-26 08:37:31,592][123090] Updated weights for policy 1, policy_version 1123482 (0.0010) [2023-12-26 08:37:31,641][123091] Updated weights for policy 0, policy_version 1131426 (0.0010) [2023-12-26 08:37:31,693][123091] Updated weights for policy 0, policy_version 1131436 (0.0009) [2023-12-26 08:37:32,449][123090] Updated weights for policy 1, policy_version 1123492 (0.0011) [2023-12-26 08:37:32,513][123090] Updated weights for policy 1, policy_version 1123502 (0.0011) [2023-12-26 08:37:32,527][123091] Updated weights for policy 0, policy_version 1131446 (0.0010) [2023-12-26 08:37:32,577][123090] Updated weights for policy 1, policy_version 1123512 (0.0011) [2023-12-26 08:37:32,584][123091] Updated weights for policy 0, policy_version 1131456 (0.0006) [2023-12-26 08:37:32,640][123091] Updated weights for policy 0, policy_version 1131466 (0.0008) [2023-12-26 08:37:33,360][123090] Updated weights for policy 1, policy_version 1123522 (0.0009) [2023-12-26 08:37:33,408][123090] Updated weights for policy 1, policy_version 1123532 (0.0005) [2023-12-26 08:37:33,458][123090] Updated weights for policy 1, policy_version 1123542 (0.0005) [2023-12-26 08:37:33,498][123091] Updated weights for policy 0, policy_version 1131476 (0.0009) [2023-12-26 08:37:33,518][123090] Updated weights for policy 1, policy_version 1123552 (0.0005) [2023-12-26 08:37:33,549][123091] Updated weights for policy 0, policy_version 1131486 (0.0009) [2023-12-26 08:37:33,606][123091] Updated weights for policy 0, policy_version 1131496 (0.0010) [2023-12-26 08:37:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 577298432. Throughput: 0: 8857.5, 1: 8926.3. Samples: 577305956. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:33,785][121949] Avg episode reward: [(0, '6246.379'), (1, '5564.822')] [2023-12-26 08:37:34,216][123090] Updated weights for policy 1, policy_version 1123562 (0.0010) [2023-12-26 08:37:34,287][123090] Updated weights for policy 1, policy_version 1123572 (0.0011) [2023-12-26 08:37:34,354][123090] Updated weights for policy 1, policy_version 1123582 (0.0010) [2023-12-26 08:37:34,420][123091] Updated weights for policy 0, policy_version 1131507 (0.0008) [2023-12-26 08:37:34,475][123091] Updated weights for policy 0, policy_version 1131517 (0.0006) [2023-12-26 08:37:34,528][123091] Updated weights for policy 0, policy_version 1131527 (0.0009) [2023-12-26 08:37:35,169][123090] Updated weights for policy 1, policy_version 1123592 (0.0009) [2023-12-26 08:37:35,217][123090] Updated weights for policy 1, policy_version 1123602 (0.0009) [2023-12-26 08:37:35,269][123090] Updated weights for policy 1, policy_version 1123612 (0.0009) [2023-12-26 08:37:35,277][123091] Updated weights for policy 0, policy_version 1131537 (0.0008) [2023-12-26 08:37:35,336][123091] Updated weights for policy 0, policy_version 1131547 (0.0010) [2023-12-26 08:37:35,392][123091] Updated weights for policy 0, policy_version 1131557 (0.0009) [2023-12-26 08:37:35,442][123091] Updated weights for policy 0, policy_version 1131567 (0.0005) [2023-12-26 08:37:36,010][123090] Updated weights for policy 1, policy_version 1123622 (0.0007) [2023-12-26 08:37:36,056][123090] Updated weights for policy 1, policy_version 1123632 (0.0005) [2023-12-26 08:37:36,114][123091] Updated weights for policy 0, policy_version 1131577 (0.0006) [2023-12-26 08:37:36,122][123090] Updated weights for policy 1, policy_version 1123642 (0.0006) [2023-12-26 08:37:36,183][123091] Updated weights for policy 0, policy_version 1131587 (0.0008) [2023-12-26 08:37:36,246][123091] Updated weights for policy 0, policy_version 1131597 (0.0009) [2023-12-26 08:37:36,893][123090] Updated weights for policy 1, policy_version 1123652 (0.0009) [2023-12-26 08:37:36,946][123090] Updated weights for policy 1, policy_version 1123662 (0.0009) [2023-12-26 08:37:37,004][123090] Updated weights for policy 1, policy_version 1123672 (0.0010) [2023-12-26 08:37:37,082][123091] Updated weights for policy 0, policy_version 1131607 (0.0009) [2023-12-26 08:37:37,141][123091] Updated weights for policy 0, policy_version 1131617 (0.0010) [2023-12-26 08:37:37,190][123091] Updated weights for policy 0, policy_version 1131627 (0.0009) [2023-12-26 08:37:37,858][123090] Updated weights for policy 1, policy_version 1123682 (0.0009) [2023-12-26 08:37:37,921][123090] Updated weights for policy 1, policy_version 1123692 (0.0010) [2023-12-26 08:37:37,988][123090] Updated weights for policy 1, policy_version 1123702 (0.0010) [2023-12-26 08:37:38,028][123091] Updated weights for policy 0, policy_version 1131637 (0.0008) [2023-12-26 08:37:38,044][123090] Updated weights for policy 1, policy_version 1123712 (0.0010) [2023-12-26 08:37:38,092][123091] Updated weights for policy 0, policy_version 1131647 (0.0008) [2023-12-26 08:37:38,155][123091] Updated weights for policy 0, policy_version 1131657 (0.0009) [2023-12-26 08:37:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 577380352. Throughput: 0: 8899.1, 1: 8962.8. Samples: 577361112. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:38,785][121949] Avg episode reward: [(0, '6320.009'), (1, '5474.399')] [2023-12-26 08:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001131664_289710080.pth... [2023-12-26 08:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001123712_287670272.pth... [2023-12-26 08:37:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001122688_287408128.pth [2023-12-26 08:37:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001130640_289447936.pth [2023-12-26 08:37:38,919][123090] Updated weights for policy 1, policy_version 1123722 (0.0009) [2023-12-26 08:37:38,992][123091] Updated weights for policy 0, policy_version 1131667 (0.0006) [2023-12-26 08:37:38,996][123090] Updated weights for policy 1, policy_version 1123732 (0.0009) [2023-12-26 08:37:39,055][123091] Updated weights for policy 0, policy_version 1131677 (0.0005) [2023-12-26 08:37:39,071][123090] Updated weights for policy 1, policy_version 1123742 (0.0011) [2023-12-26 08:37:39,106][123091] Updated weights for policy 0, policy_version 1131687 (0.0005) [2023-12-26 08:37:39,849][123090] Updated weights for policy 1, policy_version 1123752 (0.0008) [2023-12-26 08:37:39,902][123090] Updated weights for policy 1, policy_version 1123762 (0.0007) [2023-12-26 08:37:39,957][123091] Updated weights for policy 0, policy_version 1131697 (0.0008) [2023-12-26 08:37:39,966][123090] Updated weights for policy 1, policy_version 1123772 (0.0007) [2023-12-26 08:37:40,017][123091] Updated weights for policy 0, policy_version 1131707 (0.0011) [2023-12-26 08:37:40,084][123091] Updated weights for policy 0, policy_version 1131717 (0.0011) [2023-12-26 08:37:40,150][123091] Updated weights for policy 0, policy_version 1131727 (0.0011) [2023-12-26 08:37:40,714][123090] Updated weights for policy 1, policy_version 1123782 (0.0007) [2023-12-26 08:37:40,779][123090] Updated weights for policy 1, policy_version 1123792 (0.0005) [2023-12-26 08:37:40,841][123090] Updated weights for policy 1, policy_version 1123802 (0.0005) [2023-12-26 08:37:40,965][123091] Updated weights for policy 0, policy_version 1131737 (0.0010) [2023-12-26 08:37:41,020][123091] Updated weights for policy 0, policy_version 1131747 (0.0011) [2023-12-26 08:37:41,087][123091] Updated weights for policy 0, policy_version 1131757 (0.0011) [2023-12-26 08:37:41,564][123090] Updated weights for policy 1, policy_version 1123812 (0.0007) [2023-12-26 08:37:41,634][123090] Updated weights for policy 1, policy_version 1123822 (0.0007) [2023-12-26 08:37:41,696][123090] Updated weights for policy 1, policy_version 1123832 (0.0009) [2023-12-26 08:37:41,959][123091] Updated weights for policy 0, policy_version 1131767 (0.0010) [2023-12-26 08:37:42,032][123091] Updated weights for policy 0, policy_version 1131777 (0.0011) [2023-12-26 08:37:42,100][123091] Updated weights for policy 0, policy_version 1131787 (0.0010) [2023-12-26 08:37:42,545][123090] Updated weights for policy 1, policy_version 1123842 (0.0009) [2023-12-26 08:37:42,605][123090] Updated weights for policy 1, policy_version 1123852 (0.0009) [2023-12-26 08:37:42,664][123090] Updated weights for policy 1, policy_version 1123862 (0.0010) [2023-12-26 08:37:42,725][123090] Updated weights for policy 1, policy_version 1123872 (0.0008) [2023-12-26 08:37:42,953][123091] Updated weights for policy 0, policy_version 1131797 (0.0010) [2023-12-26 08:37:43,021][123091] Updated weights for policy 0, policy_version 1131807 (0.0008) [2023-12-26 08:37:43,078][123091] Updated weights for policy 0, policy_version 1131817 (0.0007) [2023-12-26 08:37:43,560][123090] Updated weights for policy 1, policy_version 1123882 (0.0005) [2023-12-26 08:37:43,616][123090] Updated weights for policy 1, policy_version 1123892 (0.0005) [2023-12-26 08:37:43,668][123090] Updated weights for policy 1, policy_version 1123902 (0.0005) [2023-12-26 08:37:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 577470464. Throughput: 0: 8805.0, 1: 8915.9. Samples: 577463808. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:43,785][121949] Avg episode reward: [(0, '6343.834'), (1, '5677.095')] [2023-12-26 08:37:43,794][123091] Updated weights for policy 0, policy_version 1131827 (0.0005) [2023-12-26 08:37:43,862][123091] Updated weights for policy 0, policy_version 1131837 (0.0005) [2023-12-26 08:37:43,910][123091] Updated weights for policy 0, policy_version 1131847 (0.0005) [2023-12-26 08:37:44,361][123090] Updated weights for policy 1, policy_version 1123912 (0.0005) [2023-12-26 08:37:44,430][123090] Updated weights for policy 1, policy_version 1123922 (0.0009) [2023-12-26 08:37:44,493][123090] Updated weights for policy 1, policy_version 1123932 (0.0010) [2023-12-26 08:37:44,648][123091] Updated weights for policy 0, policy_version 1131857 (0.0009) [2023-12-26 08:37:44,721][123091] Updated weights for policy 0, policy_version 1131867 (0.0005) [2023-12-26 08:37:44,792][123091] Updated weights for policy 0, policy_version 1131877 (0.0008) [2023-12-26 08:37:44,850][123091] Updated weights for policy 0, policy_version 1131887 (0.0006) [2023-12-26 08:37:45,288][123090] Updated weights for policy 1, policy_version 1123942 (0.0009) [2023-12-26 08:37:45,350][123090] Updated weights for policy 1, policy_version 1123952 (0.0009) [2023-12-26 08:37:45,416][123090] Updated weights for policy 1, policy_version 1123962 (0.0009) [2023-12-26 08:37:45,655][123091] Updated weights for policy 0, policy_version 1131897 (0.0011) [2023-12-26 08:37:45,698][123091] Updated weights for policy 0, policy_version 1131907 (0.0010) [2023-12-26 08:37:45,746][123091] Updated weights for policy 0, policy_version 1131917 (0.0010) [2023-12-26 08:37:46,157][123090] Updated weights for policy 1, policy_version 1123972 (0.0009) [2023-12-26 08:37:46,218][123090] Updated weights for policy 1, policy_version 1123982 (0.0009) [2023-12-26 08:37:46,282][123090] Updated weights for policy 1, policy_version 1123992 (0.0009) [2023-12-26 08:37:46,575][123091] Updated weights for policy 0, policy_version 1131927 (0.0010) [2023-12-26 08:37:46,633][123091] Updated weights for policy 0, policy_version 1131937 (0.0010) [2023-12-26 08:37:46,677][123091] Updated weights for policy 0, policy_version 1131947 (0.0010) [2023-12-26 08:37:47,125][123090] Updated weights for policy 1, policy_version 1124002 (0.0008) [2023-12-26 08:37:47,196][123090] Updated weights for policy 1, policy_version 1124012 (0.0005) [2023-12-26 08:37:47,275][123090] Updated weights for policy 1, policy_version 1124022 (0.0005) [2023-12-26 08:37:47,344][123090] Updated weights for policy 1, policy_version 1124032 (0.0009) [2023-12-26 08:37:47,393][123091] Updated weights for policy 0, policy_version 1131957 (0.0008) [2023-12-26 08:37:47,457][123091] Updated weights for policy 0, policy_version 1131967 (0.0005) [2023-12-26 08:37:47,511][123091] Updated weights for policy 0, policy_version 1131977 (0.0005) [2023-12-26 08:37:48,128][123091] Updated weights for policy 0, policy_version 1131987 (0.0005) [2023-12-26 08:37:48,158][123090] Updated weights for policy 1, policy_version 1124042 (0.0009) [2023-12-26 08:37:48,197][123091] Updated weights for policy 0, policy_version 1131997 (0.0006) [2023-12-26 08:37:48,219][123090] Updated weights for policy 1, policy_version 1124052 (0.0009) [2023-12-26 08:37:48,261][123091] Updated weights for policy 0, policy_version 1132007 (0.0009) [2023-12-26 08:37:48,276][123090] Updated weights for policy 1, policy_version 1124062 (0.0007) [2023-12-26 08:37:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 577560576. Throughput: 0: 8896.1, 1: 8911.5. Samples: 577573600. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:48,784][121949] Avg episode reward: [(0, '6388.765'), (1, '5668.854')] [2023-12-26 08:37:49,091][123091] Updated weights for policy 0, policy_version 1132017 (0.0010) [2023-12-26 08:37:49,098][123090] Updated weights for policy 1, policy_version 1124072 (0.0008) [2023-12-26 08:37:49,144][123091] Updated weights for policy 0, policy_version 1132027 (0.0007) [2023-12-26 08:37:49,151][123090] Updated weights for policy 1, policy_version 1124082 (0.0009) [2023-12-26 08:37:49,200][123090] Updated weights for policy 1, policy_version 1124092 (0.0008) [2023-12-26 08:37:49,207][123091] Updated weights for policy 0, policy_version 1132037 (0.0009) [2023-12-26 08:37:49,270][123091] Updated weights for policy 0, policy_version 1132047 (0.0010) [2023-12-26 08:37:50,071][123090] Updated weights for policy 1, policy_version 1124102 (0.0008) [2023-12-26 08:37:50,109][123091] Updated weights for policy 0, policy_version 1132057 (0.0007) [2023-12-26 08:37:50,141][123090] Updated weights for policy 1, policy_version 1124112 (0.0009) [2023-12-26 08:37:50,164][123091] Updated weights for policy 0, policy_version 1132067 (0.0007) [2023-12-26 08:37:50,209][123090] Updated weights for policy 1, policy_version 1124122 (0.0008) [2023-12-26 08:37:50,223][123091] Updated weights for policy 0, policy_version 1132077 (0.0009) [2023-12-26 08:37:51,024][123091] Updated weights for policy 0, policy_version 1132087 (0.0008) [2023-12-26 08:37:51,069][123090] Updated weights for policy 1, policy_version 1124132 (0.0009) [2023-12-26 08:37:51,096][123091] Updated weights for policy 0, policy_version 1132097 (0.0008) [2023-12-26 08:37:51,129][123090] Updated weights for policy 1, policy_version 1124142 (0.0007) [2023-12-26 08:37:51,166][123091] Updated weights for policy 0, policy_version 1132107 (0.0008) [2023-12-26 08:37:51,199][123090] Updated weights for policy 1, policy_version 1124152 (0.0007) [2023-12-26 08:37:51,969][123091] Updated weights for policy 0, policy_version 1132117 (0.0009) [2023-12-26 08:37:52,030][123091] Updated weights for policy 0, policy_version 1132127 (0.0009) [2023-12-26 08:37:52,048][123090] Updated weights for policy 1, policy_version 1124162 (0.0009) [2023-12-26 08:37:52,095][123091] Updated weights for policy 0, policy_version 1132137 (0.0009) [2023-12-26 08:37:52,114][123090] Updated weights for policy 1, policy_version 1124172 (0.0009) [2023-12-26 08:37:52,174][123090] Updated weights for policy 1, policy_version 1124182 (0.0009) [2023-12-26 08:37:52,230][123090] Updated weights for policy 1, policy_version 1124192 (0.0009) [2023-12-26 08:37:52,779][123091] Updated weights for policy 0, policy_version 1132147 (0.0007) [2023-12-26 08:37:52,855][123091] Updated weights for policy 0, policy_version 1132157 (0.0011) [2023-12-26 08:37:52,924][123091] Updated weights for policy 0, policy_version 1132167 (0.0011) [2023-12-26 08:37:53,151][123090] Updated weights for policy 1, policy_version 1124202 (0.0010) [2023-12-26 08:37:53,218][123090] Updated weights for policy 1, policy_version 1124212 (0.0010) [2023-12-26 08:37:53,276][123090] Updated weights for policy 1, policy_version 1124222 (0.0009) [2023-12-26 08:37:53,677][123091] Updated weights for policy 0, policy_version 1132177 (0.0010) [2023-12-26 08:37:53,732][123091] Updated weights for policy 0, policy_version 1132187 (0.0007) [2023-12-26 08:37:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 577642496. Throughput: 0: 8833.8, 1: 8856.7. Samples: 577624576. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:53,785][121949] Avg episode reward: [(0, '6391.199'), (1, '5512.087')] [2023-12-26 08:37:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001124224_287801344.pth... [2023-12-26 08:37:53,795][123091] Updated weights for policy 0, policy_version 1132197 (0.0005) [2023-12-26 08:37:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001123200_287539200.pth [2023-12-26 08:37:53,869][123091] Updated weights for policy 0, policy_version 1132207 (0.0005) [2023-12-26 08:37:53,876][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001132208_289849344.pth... [2023-12-26 08:37:53,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001131184_289587200.pth [2023-12-26 08:37:54,101][123090] Updated weights for policy 1, policy_version 1124232 (0.0008) [2023-12-26 08:37:54,170][123090] Updated weights for policy 1, policy_version 1124242 (0.0009) [2023-12-26 08:37:54,242][123090] Updated weights for policy 1, policy_version 1124252 (0.0009) [2023-12-26 08:37:54,637][123091] Updated weights for policy 0, policy_version 1132217 (0.0007) [2023-12-26 08:37:54,693][123091] Updated weights for policy 0, policy_version 1132227 (0.0006) [2023-12-26 08:37:54,756][123091] Updated weights for policy 0, policy_version 1132237 (0.0005) [2023-12-26 08:37:55,061][123090] Updated weights for policy 1, policy_version 1124262 (0.0009) [2023-12-26 08:37:55,109][123090] Updated weights for policy 1, policy_version 1124272 (0.0009) [2023-12-26 08:37:55,162][123090] Updated weights for policy 1, policy_version 1124282 (0.0009) [2023-12-26 08:37:55,371][123091] Updated weights for policy 0, policy_version 1132247 (0.0009) [2023-12-26 08:37:55,418][123091] Updated weights for policy 0, policy_version 1132257 (0.0010) [2023-12-26 08:37:55,466][123091] Updated weights for policy 0, policy_version 1132267 (0.0010) [2023-12-26 08:37:55,897][123090] Updated weights for policy 1, policy_version 1124292 (0.0009) [2023-12-26 08:37:55,957][123090] Updated weights for policy 1, policy_version 1124302 (0.0006) [2023-12-26 08:37:56,018][123090] Updated weights for policy 1, policy_version 1124312 (0.0005) [2023-12-26 08:37:56,265][123091] Updated weights for policy 0, policy_version 1132277 (0.0010) [2023-12-26 08:37:56,327][123091] Updated weights for policy 0, policy_version 1132287 (0.0011) [2023-12-26 08:37:56,381][123091] Updated weights for policy 0, policy_version 1132297 (0.0010) [2023-12-26 08:37:56,672][123090] Updated weights for policy 1, policy_version 1124322 (0.0007) [2023-12-26 08:37:56,727][123090] Updated weights for policy 1, policy_version 1124332 (0.0010) [2023-12-26 08:37:56,778][123090] Updated weights for policy 1, policy_version 1124342 (0.0010) [2023-12-26 08:37:56,829][123090] Updated weights for policy 1, policy_version 1124352 (0.0010) [2023-12-26 08:37:57,058][123091] Updated weights for policy 0, policy_version 1132307 (0.0008) [2023-12-26 08:37:57,117][123091] Updated weights for policy 0, policy_version 1132317 (0.0005) [2023-12-26 08:37:57,173][123091] Updated weights for policy 0, policy_version 1132327 (0.0005) [2023-12-26 08:37:57,718][123090] Updated weights for policy 1, policy_version 1124362 (0.0005) [2023-12-26 08:37:57,762][123091] Updated weights for policy 0, policy_version 1132337 (0.0005) [2023-12-26 08:37:57,779][123090] Updated weights for policy 1, policy_version 1124372 (0.0005) [2023-12-26 08:37:57,817][123091] Updated weights for policy 0, policy_version 1132347 (0.0007) [2023-12-26 08:37:57,845][123090] Updated weights for policy 1, policy_version 1124382 (0.0005) [2023-12-26 08:37:57,874][123091] Updated weights for policy 0, policy_version 1132357 (0.0006) [2023-12-26 08:37:57,927][123091] Updated weights for policy 0, policy_version 1132367 (0.0006) [2023-12-26 08:37:58,489][123090] Updated weights for policy 1, policy_version 1124392 (0.0007) [2023-12-26 08:37:58,552][123090] Updated weights for policy 1, policy_version 1124402 (0.0011) [2023-12-26 08:37:58,620][123090] Updated weights for policy 1, policy_version 1124412 (0.0010) [2023-12-26 08:37:58,690][123091] Updated weights for policy 0, policy_version 1132377 (0.0008) [2023-12-26 08:37:58,763][123091] Updated weights for policy 0, policy_version 1132387 (0.0009) [2023-12-26 08:37:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 577740800. Throughput: 0: 8904.2, 1: 8848.2. Samples: 577735084. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:37:58,785][121949] Avg episode reward: [(0, '6347.004'), (1, '5580.067')] [2023-12-26 08:37:58,840][123091] Updated weights for policy 0, policy_version 1132397 (0.0009) [2023-12-26 08:37:59,523][123090] Updated weights for policy 1, policy_version 1124422 (0.0010) [2023-12-26 08:37:59,589][123090] Updated weights for policy 1, policy_version 1124432 (0.0010) [2023-12-26 08:37:59,659][123090] Updated weights for policy 1, policy_version 1124442 (0.0009) [2023-12-26 08:37:59,681][123091] Updated weights for policy 0, policy_version 1132407 (0.0006) [2023-12-26 08:37:59,739][123091] Updated weights for policy 0, policy_version 1132417 (0.0005) [2023-12-26 08:37:59,788][123091] Updated weights for policy 0, policy_version 1132427 (0.0005) [2023-12-26 08:38:00,469][123090] Updated weights for policy 1, policy_version 1124452 (0.0008) [2023-12-26 08:38:00,500][123091] Updated weights for policy 0, policy_version 1132437 (0.0007) [2023-12-26 08:38:00,540][123090] Updated weights for policy 1, policy_version 1124462 (0.0011) [2023-12-26 08:38:00,546][123091] Updated weights for policy 0, policy_version 1132447 (0.0007) [2023-12-26 08:38:00,602][123091] Updated weights for policy 0, policy_version 1132457 (0.0007) [2023-12-26 08:38:00,607][123090] Updated weights for policy 1, policy_version 1124472 (0.0010) [2023-12-26 08:38:01,308][123091] Updated weights for policy 0, policy_version 1132467 (0.0007) [2023-12-26 08:38:01,376][123091] Updated weights for policy 0, policy_version 1132477 (0.0007) [2023-12-26 08:38:01,431][123090] Updated weights for policy 1, policy_version 1124482 (0.0009) [2023-12-26 08:38:01,445][123091] Updated weights for policy 0, policy_version 1132487 (0.0010) [2023-12-26 08:38:01,489][123090] Updated weights for policy 1, policy_version 1124492 (0.0009) [2023-12-26 08:38:01,550][123090] Updated weights for policy 1, policy_version 1124502 (0.0008) [2023-12-26 08:38:01,623][123090] Updated weights for policy 1, policy_version 1124512 (0.0009) [2023-12-26 08:38:02,065][123091] Updated weights for policy 0, policy_version 1132497 (0.0011) [2023-12-26 08:38:02,119][123091] Updated weights for policy 0, policy_version 1132507 (0.0010) [2023-12-26 08:38:02,178][123091] Updated weights for policy 0, policy_version 1132517 (0.0005) [2023-12-26 08:38:02,247][123091] Updated weights for policy 0, policy_version 1132527 (0.0005) [2023-12-26 08:38:02,443][123090] Updated weights for policy 1, policy_version 1124522 (0.0006) [2023-12-26 08:38:02,496][123090] Updated weights for policy 1, policy_version 1124532 (0.0009) [2023-12-26 08:38:02,544][123090] Updated weights for policy 1, policy_version 1124542 (0.0008) [2023-12-26 08:38:03,048][123091] Updated weights for policy 0, policy_version 1132537 (0.0006) [2023-12-26 08:38:03,117][123091] Updated weights for policy 0, policy_version 1132547 (0.0009) [2023-12-26 08:38:03,181][123091] Updated weights for policy 0, policy_version 1132557 (0.0009) [2023-12-26 08:38:03,246][123090] Updated weights for policy 1, policy_version 1124552 (0.0009) [2023-12-26 08:38:03,299][123090] Updated weights for policy 1, policy_version 1124562 (0.0009) [2023-12-26 08:38:03,347][123090] Updated weights for policy 1, policy_version 1124572 (0.0009) [2023-12-26 08:38:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 577830912. Throughput: 0: 8933.1, 1: 8797.7. Samples: 577842500. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:03,784][121949] Avg episode reward: [(0, '6306.710'), (1, '5597.570')] [2023-12-26 08:38:03,971][123091] Updated weights for policy 0, policy_version 1132567 (0.0009) [2023-12-26 08:38:04,043][123091] Updated weights for policy 0, policy_version 1132577 (0.0009) [2023-12-26 08:38:04,106][123091] Updated weights for policy 0, policy_version 1132587 (0.0009) [2023-12-26 08:38:04,193][123090] Updated weights for policy 1, policy_version 1124582 (0.0010) [2023-12-26 08:38:04,258][123090] Updated weights for policy 1, policy_version 1124592 (0.0011) [2023-12-26 08:38:04,324][123090] Updated weights for policy 1, policy_version 1124602 (0.0011) [2023-12-26 08:38:04,918][123091] Updated weights for policy 0, policy_version 1132597 (0.0010) [2023-12-26 08:38:04,976][123091] Updated weights for policy 0, policy_version 1132607 (0.0010) [2023-12-26 08:38:05,034][123091] Updated weights for policy 0, policy_version 1132617 (0.0010) [2023-12-26 08:38:05,156][123090] Updated weights for policy 1, policy_version 1124612 (0.0011) [2023-12-26 08:38:05,209][123090] Updated weights for policy 1, policy_version 1124622 (0.0010) [2023-12-26 08:38:05,267][123090] Updated weights for policy 1, policy_version 1124632 (0.0010) [2023-12-26 08:38:05,821][123091] Updated weights for policy 0, policy_version 1132627 (0.0010) [2023-12-26 08:38:05,875][123091] Updated weights for policy 0, policy_version 1132637 (0.0010) [2023-12-26 08:38:05,933][123091] Updated weights for policy 0, policy_version 1132647 (0.0010) [2023-12-26 08:38:06,106][123090] Updated weights for policy 1, policy_version 1124642 (0.0010) [2023-12-26 08:38:06,180][123090] Updated weights for policy 1, policy_version 1124652 (0.0011) [2023-12-26 08:38:06,252][123090] Updated weights for policy 1, policy_version 1124662 (0.0011) [2023-12-26 08:38:06,320][123090] Updated weights for policy 1, policy_version 1124672 (0.0011) [2023-12-26 08:38:06,728][123091] Updated weights for policy 0, policy_version 1132657 (0.0010) [2023-12-26 08:38:06,805][123091] Updated weights for policy 0, policy_version 1132667 (0.0005) [2023-12-26 08:38:06,877][123091] Updated weights for policy 0, policy_version 1132677 (0.0005) [2023-12-26 08:38:06,941][123091] Updated weights for policy 0, policy_version 1132687 (0.0009) [2023-12-26 08:38:07,061][123090] Updated weights for policy 1, policy_version 1124682 (0.0008) [2023-12-26 08:38:07,144][123090] Updated weights for policy 1, policy_version 1124692 (0.0010) [2023-12-26 08:38:07,215][123090] Updated weights for policy 1, policy_version 1124702 (0.0009) [2023-12-26 08:38:07,601][123091] Updated weights for policy 0, policy_version 1132697 (0.0006) [2023-12-26 08:38:07,665][123091] Updated weights for policy 0, policy_version 1132707 (0.0009) [2023-12-26 08:38:07,718][123091] Updated weights for policy 0, policy_version 1132717 (0.0009) [2023-12-26 08:38:08,029][123090] Updated weights for policy 1, policy_version 1124712 (0.0009) [2023-12-26 08:38:08,088][123090] Updated weights for policy 1, policy_version 1124722 (0.0010) [2023-12-26 08:38:08,147][123090] Updated weights for policy 1, policy_version 1124732 (0.0010) [2023-12-26 08:38:08,391][123091] Updated weights for policy 0, policy_version 1132727 (0.0007) [2023-12-26 08:38:08,449][123091] Updated weights for policy 0, policy_version 1132737 (0.0009) [2023-12-26 08:38:08,495][123091] Updated weights for policy 0, policy_version 1132747 (0.0010) [2023-12-26 08:38:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 577921024. Throughput: 0: 8930.3, 1: 8800.4. Samples: 577894620. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:08,785][121949] Avg episode reward: [(0, '6354.303'), (1, '5576.112')] [2023-12-26 08:38:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001132752_289988608.pth... [2023-12-26 08:38:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001124736_287932416.pth... [2023-12-26 08:38:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001123712_287670272.pth [2023-12-26 08:38:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001131664_289710080.pth [2023-12-26 08:38:09,039][123090] Updated weights for policy 1, policy_version 1124742 (0.0010) [2023-12-26 08:38:09,095][123090] Updated weights for policy 1, policy_version 1124752 (0.0009) [2023-12-26 08:38:09,144][123090] Updated weights for policy 1, policy_version 1124762 (0.0009) [2023-12-26 08:38:09,324][123091] Updated weights for policy 0, policy_version 1132757 (0.0009) [2023-12-26 08:38:09,400][123091] Updated weights for policy 0, policy_version 1132767 (0.0009) [2023-12-26 08:38:09,463][123091] Updated weights for policy 0, policy_version 1132777 (0.0009) [2023-12-26 08:38:09,977][123090] Updated weights for policy 1, policy_version 1124773 (0.0010) [2023-12-26 08:38:10,041][123090] Updated weights for policy 1, policy_version 1124783 (0.0011) [2023-12-26 08:38:10,103][123090] Updated weights for policy 1, policy_version 1124793 (0.0008) [2023-12-26 08:38:10,327][123091] Updated weights for policy 0, policy_version 1132787 (0.0010) [2023-12-26 08:38:10,395][123091] Updated weights for policy 0, policy_version 1132797 (0.0010) [2023-12-26 08:38:10,464][123091] Updated weights for policy 0, policy_version 1132807 (0.0009) [2023-12-26 08:38:10,882][123090] Updated weights for policy 1, policy_version 1124803 (0.0007) [2023-12-26 08:38:10,933][123090] Updated weights for policy 1, policy_version 1124813 (0.0010) [2023-12-26 08:38:10,985][123090] Updated weights for policy 1, policy_version 1124823 (0.0010) [2023-12-26 08:38:11,264][123091] Updated weights for policy 0, policy_version 1132817 (0.0009) [2023-12-26 08:38:11,331][123091] Updated weights for policy 0, policy_version 1132827 (0.0010) [2023-12-26 08:38:11,406][123091] Updated weights for policy 0, policy_version 1132837 (0.0009) [2023-12-26 08:38:11,475][123091] Updated weights for policy 0, policy_version 1132847 (0.0009) [2023-12-26 08:38:11,863][123090] Updated weights for policy 1, policy_version 1124833 (0.0010) [2023-12-26 08:38:11,928][123090] Updated weights for policy 1, policy_version 1124843 (0.0011) [2023-12-26 08:38:11,989][123090] Updated weights for policy 1, policy_version 1124853 (0.0011) [2023-12-26 08:38:12,052][123090] Updated weights for policy 1, policy_version 1124863 (0.0011) [2023-12-26 08:38:12,320][123091] Updated weights for policy 0, policy_version 1132857 (0.0009) [2023-12-26 08:38:12,391][123091] Updated weights for policy 0, policy_version 1132867 (0.0009) [2023-12-26 08:38:12,458][123091] Updated weights for policy 0, policy_version 1132877 (0.0010) [2023-12-26 08:38:12,841][123090] Updated weights for policy 1, policy_version 1124873 (0.0011) [2023-12-26 08:38:12,897][123090] Updated weights for policy 1, policy_version 1124883 (0.0010) [2023-12-26 08:38:12,960][123090] Updated weights for policy 1, policy_version 1124893 (0.0008) [2023-12-26 08:38:13,277][123091] Updated weights for policy 0, policy_version 1132887 (0.0010) [2023-12-26 08:38:13,324][123091] Updated weights for policy 0, policy_version 1132897 (0.0010) [2023-12-26 08:38:13,390][123091] Updated weights for policy 0, policy_version 1132907 (0.0011) [2023-12-26 08:38:13,723][123090] Updated weights for policy 1, policy_version 1124903 (0.0006) [2023-12-26 08:38:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 578002944. Throughput: 0: 8949.4, 1: 8763.4. Samples: 577998608. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:13,784][121949] Avg episode reward: [(0, '6323.381'), (1, '5600.769')] [2023-12-26 08:38:13,796][123090] Updated weights for policy 1, policy_version 1124913 (0.0009) [2023-12-26 08:38:13,863][123090] Updated weights for policy 1, policy_version 1124923 (0.0009) [2023-12-26 08:38:14,162][123091] Updated weights for policy 0, policy_version 1132917 (0.0008) [2023-12-26 08:38:14,213][123091] Updated weights for policy 0, policy_version 1132927 (0.0005) [2023-12-26 08:38:14,275][123091] Updated weights for policy 0, policy_version 1132937 (0.0005) [2023-12-26 08:38:14,703][123090] Updated weights for policy 1, policy_version 1124933 (0.0010) [2023-12-26 08:38:14,791][123090] Updated weights for policy 1, policy_version 1124943 (0.0010) [2023-12-26 08:38:14,859][123090] Updated weights for policy 1, policy_version 1124953 (0.0010) [2023-12-26 08:38:15,009][123091] Updated weights for policy 0, policy_version 1132947 (0.0006) [2023-12-26 08:38:15,079][123091] Updated weights for policy 0, policy_version 1132957 (0.0006) [2023-12-26 08:38:15,154][123091] Updated weights for policy 0, policy_version 1132967 (0.0005) [2023-12-26 08:38:15,725][123090] Updated weights for policy 1, policy_version 1124963 (0.0009) [2023-12-26 08:38:15,787][123090] Updated weights for policy 1, policy_version 1124973 (0.0009) [2023-12-26 08:38:15,851][123091] Updated weights for policy 0, policy_version 1132977 (0.0006) [2023-12-26 08:38:15,852][123090] Updated weights for policy 1, policy_version 1124983 (0.0010) [2023-12-26 08:38:15,905][123091] Updated weights for policy 0, policy_version 1132987 (0.0005) [2023-12-26 08:38:15,956][123091] Updated weights for policy 0, policy_version 1132997 (0.0005) [2023-12-26 08:38:16,010][123091] Updated weights for policy 0, policy_version 1133007 (0.0005) [2023-12-26 08:38:16,681][123090] Updated weights for policy 1, policy_version 1124993 (0.0008) [2023-12-26 08:38:16,733][123090] Updated weights for policy 1, policy_version 1125003 (0.0009) [2023-12-26 08:38:16,753][123091] Updated weights for policy 0, policy_version 1133017 (0.0008) [2023-12-26 08:38:16,782][123090] Updated weights for policy 1, policy_version 1125013 (0.0006) [2023-12-26 08:38:16,797][123091] Updated weights for policy 0, policy_version 1133027 (0.0008) [2023-12-26 08:38:16,837][123090] Updated weights for policy 1, policy_version 1125023 (0.0008) [2023-12-26 08:38:16,843][123091] Updated weights for policy 0, policy_version 1133037 (0.0007) [2023-12-26 08:38:17,522][123090] Updated weights for policy 1, policy_version 1125033 (0.0006) [2023-12-26 08:38:17,561][123091] Updated weights for policy 0, policy_version 1133047 (0.0008) [2023-12-26 08:38:17,577][123090] Updated weights for policy 1, policy_version 1125043 (0.0005) [2023-12-26 08:38:17,631][123091] Updated weights for policy 0, policy_version 1133057 (0.0009) [2023-12-26 08:38:17,633][123090] Updated weights for policy 1, policy_version 1125053 (0.0006) [2023-12-26 08:38:17,689][123091] Updated weights for policy 0, policy_version 1133067 (0.0008) [2023-12-26 08:38:18,288][123091] Updated weights for policy 0, policy_version 1133077 (0.0007) [2023-12-26 08:38:18,367][123091] Updated weights for policy 0, policy_version 1133087 (0.0007) [2023-12-26 08:38:18,431][123091] Updated weights for policy 0, policy_version 1133097 (0.0009) [2023-12-26 08:38:18,474][123090] Updated weights for policy 1, policy_version 1125063 (0.0009) [2023-12-26 08:38:18,524][123090] Updated weights for policy 1, policy_version 1125073 (0.0009) [2023-12-26 08:38:18,580][123090] Updated weights for policy 1, policy_version 1125083 (0.0009) [2023-12-26 08:38:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 578101248. Throughput: 0: 9147.9, 1: 8700.6. Samples: 578109132. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:18,785][121949] Avg episode reward: [(0, '6186.084'), (1, '5653.832')] [2023-12-26 08:38:19,200][123091] Updated weights for policy 0, policy_version 1133107 (0.0008) [2023-12-26 08:38:19,273][123091] Updated weights for policy 0, policy_version 1133117 (0.0010) [2023-12-26 08:38:19,331][123091] Updated weights for policy 0, policy_version 1133127 (0.0010) [2023-12-26 08:38:19,438][123090] Updated weights for policy 1, policy_version 1125093 (0.0008) [2023-12-26 08:38:19,511][123090] Updated weights for policy 1, policy_version 1125103 (0.0007) [2023-12-26 08:38:19,582][123090] Updated weights for policy 1, policy_version 1125113 (0.0009) [2023-12-26 08:38:20,156][123091] Updated weights for policy 0, policy_version 1133137 (0.0009) [2023-12-26 08:38:20,221][123091] Updated weights for policy 0, policy_version 1133147 (0.0009) [2023-12-26 08:38:20,272][123091] Updated weights for policy 0, policy_version 1133157 (0.0009) [2023-12-26 08:38:20,329][123091] Updated weights for policy 0, policy_version 1133167 (0.0009) [2023-12-26 08:38:20,417][123090] Updated weights for policy 1, policy_version 1125123 (0.0010) [2023-12-26 08:38:20,473][123090] Updated weights for policy 1, policy_version 1125133 (0.0010) [2023-12-26 08:38:20,529][123090] Updated weights for policy 1, policy_version 1125143 (0.0010) [2023-12-26 08:38:21,176][123091] Updated weights for policy 0, policy_version 1133177 (0.0008) [2023-12-26 08:38:21,243][123091] Updated weights for policy 0, policy_version 1133187 (0.0008) [2023-12-26 08:38:21,315][123091] Updated weights for policy 0, policy_version 1133197 (0.0009) [2023-12-26 08:38:21,411][123090] Updated weights for policy 1, policy_version 1125153 (0.0011) [2023-12-26 08:38:21,476][123090] Updated weights for policy 1, policy_version 1125163 (0.0011) [2023-12-26 08:38:21,539][123090] Updated weights for policy 1, policy_version 1125173 (0.0010) [2023-12-26 08:38:21,593][123090] Updated weights for policy 1, policy_version 1125183 (0.0011) [2023-12-26 08:38:22,120][123091] Updated weights for policy 0, policy_version 1133207 (0.0009) [2023-12-26 08:38:22,181][123091] Updated weights for policy 0, policy_version 1133217 (0.0009) [2023-12-26 08:38:22,239][123091] Updated weights for policy 0, policy_version 1133227 (0.0009) [2023-12-26 08:38:22,488][123090] Updated weights for policy 1, policy_version 1125193 (0.0011) [2023-12-26 08:38:22,541][123090] Updated weights for policy 1, policy_version 1125203 (0.0010) [2023-12-26 08:38:22,590][123090] Updated weights for policy 1, policy_version 1125213 (0.0011) [2023-12-26 08:38:23,013][123091] Updated weights for policy 0, policy_version 1133237 (0.0010) [2023-12-26 08:38:23,082][123091] Updated weights for policy 0, policy_version 1133247 (0.0011) [2023-12-26 08:38:23,147][123091] Updated weights for policy 0, policy_version 1133257 (0.0011) [2023-12-26 08:38:23,460][123090] Updated weights for policy 1, policy_version 1125223 (0.0011) [2023-12-26 08:38:23,512][123090] Updated weights for policy 1, policy_version 1125233 (0.0010) [2023-12-26 08:38:23,564][123090] Updated weights for policy 1, policy_version 1125243 (0.0010) [2023-12-26 08:38:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 578183168. Throughput: 0: 9101.8, 1: 8631.9. Samples: 578159128. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:23,785][121949] Avg episode reward: [(0, '6212.650'), (1, '5685.232')] [2023-12-26 08:38:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001133264_290119680.pth... [2023-12-26 08:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001125248_288063488.pth... [2023-12-26 08:38:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001132208_289849344.pth [2023-12-26 08:38:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001124224_287801344.pth [2023-12-26 08:38:23,922][123091] Updated weights for policy 0, policy_version 1133267 (0.0009) [2023-12-26 08:38:23,989][123091] Updated weights for policy 0, policy_version 1133277 (0.0006) [2023-12-26 08:38:24,051][123091] Updated weights for policy 0, policy_version 1133287 (0.0007) [2023-12-26 08:38:24,389][123090] Updated weights for policy 1, policy_version 1125253 (0.0009) [2023-12-26 08:38:24,442][123090] Updated weights for policy 1, policy_version 1125263 (0.0009) [2023-12-26 08:38:24,512][123090] Updated weights for policy 1, policy_version 1125273 (0.0008) [2023-12-26 08:38:24,864][123091] Updated weights for policy 0, policy_version 1133297 (0.0009) [2023-12-26 08:38:24,911][123091] Updated weights for policy 0, policy_version 1133307 (0.0010) [2023-12-26 08:38:24,962][123091] Updated weights for policy 0, policy_version 1133317 (0.0010) [2023-12-26 08:38:25,010][123091] Updated weights for policy 0, policy_version 1133327 (0.0011) [2023-12-26 08:38:25,292][123090] Updated weights for policy 1, policy_version 1125283 (0.0008) [2023-12-26 08:38:25,350][123090] Updated weights for policy 1, policy_version 1125293 (0.0009) [2023-12-26 08:38:25,402][123090] Updated weights for policy 1, policy_version 1125303 (0.0010) [2023-12-26 08:38:25,861][123091] Updated weights for policy 0, policy_version 1133337 (0.0010) [2023-12-26 08:38:25,919][123091] Updated weights for policy 0, policy_version 1133347 (0.0010) [2023-12-26 08:38:25,974][123091] Updated weights for policy 0, policy_version 1133357 (0.0010) [2023-12-26 08:38:26,156][123090] Updated weights for policy 1, policy_version 1125313 (0.0010) [2023-12-26 08:38:26,220][123090] Updated weights for policy 1, policy_version 1125323 (0.0005) [2023-12-26 08:38:26,291][123090] Updated weights for policy 1, policy_version 1125333 (0.0005) [2023-12-26 08:38:26,357][123090] Updated weights for policy 1, policy_version 1125343 (0.0005) [2023-12-26 08:38:26,805][123091] Updated weights for policy 0, policy_version 1133367 (0.0010) [2023-12-26 08:38:26,873][123091] Updated weights for policy 0, policy_version 1133377 (0.0010) [2023-12-26 08:38:26,909][123090] Updated weights for policy 1, policy_version 1125353 (0.0006) [2023-12-26 08:38:26,942][123091] Updated weights for policy 0, policy_version 1133387 (0.0011) [2023-12-26 08:38:26,959][123090] Updated weights for policy 1, policy_version 1125363 (0.0005) [2023-12-26 08:38:27,022][123090] Updated weights for policy 1, policy_version 1125373 (0.0008) [2023-12-26 08:38:27,728][123090] Updated weights for policy 1, policy_version 1125383 (0.0007) [2023-12-26 08:38:27,783][123090] Updated weights for policy 1, policy_version 1125393 (0.0005) [2023-12-26 08:38:27,803][123091] Updated weights for policy 0, policy_version 1133397 (0.0008) [2023-12-26 08:38:27,852][123090] Updated weights for policy 1, policy_version 1125403 (0.0008) [2023-12-26 08:38:27,856][123091] Updated weights for policy 0, policy_version 1133407 (0.0006) [2023-12-26 08:38:27,908][123091] Updated weights for policy 0, policy_version 1133417 (0.0005) [2023-12-26 08:38:28,654][123090] Updated weights for policy 1, policy_version 1125413 (0.0010) [2023-12-26 08:38:28,658][123091] Updated weights for policy 0, policy_version 1133427 (0.0006) [2023-12-26 08:38:28,709][123090] Updated weights for policy 1, policy_version 1125423 (0.0010) [2023-12-26 08:38:28,719][123091] Updated weights for policy 0, policy_version 1133437 (0.0005) [2023-12-26 08:38:28,768][123090] Updated weights for policy 1, policy_version 1125433 (0.0010) [2023-12-26 08:38:28,773][123091] Updated weights for policy 0, policy_version 1133447 (0.0005) [2023-12-26 08:38:28,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 578265088. Throughput: 0: 9131.9, 1: 8682.4. Samples: 578265452. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:28,785][121949] Avg episode reward: [(0, '6335.868'), (1, '5628.274')] [2023-12-26 08:38:29,517][123091] Updated weights for policy 0, policy_version 1133457 (0.0005) [2023-12-26 08:38:29,587][123091] Updated weights for policy 0, policy_version 1133467 (0.0005) [2023-12-26 08:38:29,601][123090] Updated weights for policy 1, policy_version 1125443 (0.0010) [2023-12-26 08:38:29,646][123091] Updated weights for policy 0, policy_version 1133477 (0.0005) [2023-12-26 08:38:29,668][123090] Updated weights for policy 1, policy_version 1125453 (0.0010) [2023-12-26 08:38:29,704][123091] Updated weights for policy 0, policy_version 1133487 (0.0006) [2023-12-26 08:38:29,731][123090] Updated weights for policy 1, policy_version 1125463 (0.0010) [2023-12-26 08:38:30,478][123090] Updated weights for policy 1, policy_version 1125473 (0.0010) [2023-12-26 08:38:30,504][123091] Updated weights for policy 0, policy_version 1133497 (0.0009) [2023-12-26 08:38:30,534][123090] Updated weights for policy 1, policy_version 1125483 (0.0010) [2023-12-26 08:38:30,561][123091] Updated weights for policy 0, policy_version 1133507 (0.0010) [2023-12-26 08:38:30,592][123090] Updated weights for policy 1, policy_version 1125493 (0.0011) [2023-12-26 08:38:30,618][123091] Updated weights for policy 0, policy_version 1133517 (0.0005) [2023-12-26 08:38:30,650][123090] Updated weights for policy 1, policy_version 1125503 (0.0009) [2023-12-26 08:38:31,390][123091] Updated weights for policy 0, policy_version 1133527 (0.0008) [2023-12-26 08:38:31,455][123091] Updated weights for policy 0, policy_version 1133537 (0.0008) [2023-12-26 08:38:31,470][123090] Updated weights for policy 1, policy_version 1125513 (0.0012) [2023-12-26 08:38:31,513][123091] Updated weights for policy 0, policy_version 1133547 (0.0008) [2023-12-26 08:38:31,525][123090] Updated weights for policy 1, policy_version 1125523 (0.0010) [2023-12-26 08:38:31,589][123090] Updated weights for policy 1, policy_version 1125534 (0.0010) [2023-12-26 08:38:32,209][123091] Updated weights for policy 0, policy_version 1133557 (0.0007) [2023-12-26 08:38:32,276][123091] Updated weights for policy 0, policy_version 1133567 (0.0007) [2023-12-26 08:38:32,343][123091] Updated weights for policy 0, policy_version 1133577 (0.0008) [2023-12-26 08:38:32,562][123090] Updated weights for policy 1, policy_version 1125544 (0.0009) [2023-12-26 08:38:32,617][123090] Updated weights for policy 1, policy_version 1125554 (0.0009) [2023-12-26 08:38:32,675][123090] Updated weights for policy 1, policy_version 1125564 (0.0009) [2023-12-26 08:38:33,166][123091] Updated weights for policy 0, policy_version 1133587 (0.0009) [2023-12-26 08:38:33,230][123091] Updated weights for policy 0, policy_version 1133597 (0.0010) [2023-12-26 08:38:33,282][123091] Updated weights for policy 0, policy_version 1133607 (0.0009) [2023-12-26 08:38:33,418][123090] Updated weights for policy 1, policy_version 1125574 (0.0010) [2023-12-26 08:38:33,479][123090] Updated weights for policy 1, policy_version 1125584 (0.0010) [2023-12-26 08:38:33,537][123090] Updated weights for policy 1, policy_version 1125594 (0.0010) [2023-12-26 08:38:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 578363392. Throughput: 0: 9081.4, 1: 8655.8. Samples: 578371776. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:33,785][121949] Avg episode reward: [(0, '6329.154'), (1, '5684.721')] [2023-12-26 08:38:34,011][123091] Updated weights for policy 0, policy_version 1133617 (0.0008) [2023-12-26 08:38:34,085][123091] Updated weights for policy 0, policy_version 1133627 (0.0006) [2023-12-26 08:38:34,144][123091] Updated weights for policy 0, policy_version 1133637 (0.0006) [2023-12-26 08:38:34,201][123091] Updated weights for policy 0, policy_version 1133647 (0.0007) [2023-12-26 08:38:34,448][123090] Updated weights for policy 1, policy_version 1125604 (0.0010) [2023-12-26 08:38:34,506][123090] Updated weights for policy 1, policy_version 1125614 (0.0010) [2023-12-26 08:38:34,579][123090] Updated weights for policy 1, policy_version 1125624 (0.0010) [2023-12-26 08:38:34,855][123091] Updated weights for policy 0, policy_version 1133657 (0.0006) [2023-12-26 08:38:34,910][123091] Updated weights for policy 0, policy_version 1133667 (0.0006) [2023-12-26 08:38:34,977][123091] Updated weights for policy 0, policy_version 1133677 (0.0005) [2023-12-26 08:38:35,353][123090] Updated weights for policy 1, policy_version 1125634 (0.0009) [2023-12-26 08:38:35,417][123090] Updated weights for policy 1, policy_version 1125644 (0.0005) [2023-12-26 08:38:35,474][123090] Updated weights for policy 1, policy_version 1125654 (0.0005) [2023-12-26 08:38:35,553][123090] Updated weights for policy 1, policy_version 1125664 (0.0005) [2023-12-26 08:38:35,687][123091] Updated weights for policy 0, policy_version 1133687 (0.0008) [2023-12-26 08:38:35,750][123091] Updated weights for policy 0, policy_version 1133697 (0.0009) [2023-12-26 08:38:35,822][123091] Updated weights for policy 0, policy_version 1133707 (0.0010) [2023-12-26 08:38:36,261][123090] Updated weights for policy 1, policy_version 1125674 (0.0009) [2023-12-26 08:38:36,318][123090] Updated weights for policy 1, policy_version 1125684 (0.0009) [2023-12-26 08:38:36,383][123090] Updated weights for policy 1, policy_version 1125694 (0.0009) [2023-12-26 08:38:36,644][123091] Updated weights for policy 0, policy_version 1133717 (0.0010) [2023-12-26 08:38:36,704][123091] Updated weights for policy 0, policy_version 1133727 (0.0009) [2023-12-26 08:38:36,755][123091] Updated weights for policy 0, policy_version 1133737 (0.0009) [2023-12-26 08:38:37,233][123090] Updated weights for policy 1, policy_version 1125704 (0.0010) [2023-12-26 08:38:37,290][123090] Updated weights for policy 1, policy_version 1125714 (0.0011) [2023-12-26 08:38:37,354][123090] Updated weights for policy 1, policy_version 1125724 (0.0011) [2023-12-26 08:38:37,628][123091] Updated weights for policy 0, policy_version 1133747 (0.0009) [2023-12-26 08:38:37,688][123091] Updated weights for policy 0, policy_version 1133757 (0.0008) [2023-12-26 08:38:37,755][123091] Updated weights for policy 0, policy_version 1133767 (0.0007) [2023-12-26 08:38:38,147][123090] Updated weights for policy 1, policy_version 1125734 (0.0007) [2023-12-26 08:38:38,216][123090] Updated weights for policy 1, policy_version 1125744 (0.0005) [2023-12-26 08:38:38,284][123090] Updated weights for policy 1, policy_version 1125754 (0.0005) [2023-12-26 08:38:38,504][123091] Updated weights for policy 0, policy_version 1133777 (0.0009) [2023-12-26 08:38:38,563][123091] Updated weights for policy 0, policy_version 1133787 (0.0008) [2023-12-26 08:38:38,619][123091] Updated weights for policy 0, policy_version 1133797 (0.0009) [2023-12-26 08:38:38,678][123091] Updated weights for policy 0, policy_version 1133807 (0.0009) [2023-12-26 08:38:38,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 578453504. Throughput: 0: 9154.0, 1: 8678.4. Samples: 578427032. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:38,785][121949] Avg episode reward: [(0, '6273.193'), (1, '5835.473')] [2023-12-26 08:38:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001125760_288194560.pth... [2023-12-26 08:38:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001133808_290258944.pth... [2023-12-26 08:38:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001124736_287932416.pth [2023-12-26 08:38:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001132752_289988608.pth [2023-12-26 08:38:39,059][123090] Updated weights for policy 1, policy_version 1125764 (0.0010) [2023-12-26 08:38:39,117][123090] Updated weights for policy 1, policy_version 1125774 (0.0009) [2023-12-26 08:38:39,186][123090] Updated weights for policy 1, policy_version 1125784 (0.0010) [2023-12-26 08:38:39,532][123091] Updated weights for policy 0, policy_version 1133817 (0.0009) [2023-12-26 08:38:39,604][123091] Updated weights for policy 0, policy_version 1133827 (0.0008) [2023-12-26 08:38:39,674][123091] Updated weights for policy 0, policy_version 1133837 (0.0008) [2023-12-26 08:38:40,081][123090] Updated weights for policy 1, policy_version 1125794 (0.0008) [2023-12-26 08:38:40,156][123090] Updated weights for policy 1, policy_version 1125804 (0.0006) [2023-12-26 08:38:40,226][123090] Updated weights for policy 1, policy_version 1125814 (0.0008) [2023-12-26 08:38:40,296][123090] Updated weights for policy 1, policy_version 1125824 (0.0007) [2023-12-26 08:38:40,451][123091] Updated weights for policy 0, policy_version 1133847 (0.0007) [2023-12-26 08:38:40,518][123091] Updated weights for policy 0, policy_version 1133857 (0.0006) [2023-12-26 08:38:40,592][123091] Updated weights for policy 0, policy_version 1133867 (0.0005) [2023-12-26 08:38:40,936][123090] Updated weights for policy 1, policy_version 1125834 (0.0005) [2023-12-26 08:38:40,991][123090] Updated weights for policy 1, policy_version 1125844 (0.0005) [2023-12-26 08:38:41,071][123090] Updated weights for policy 1, policy_version 1125854 (0.0009) [2023-12-26 08:38:41,381][123091] Updated weights for policy 0, policy_version 1133877 (0.0008) [2023-12-26 08:38:41,457][123091] Updated weights for policy 0, policy_version 1133887 (0.0010) [2023-12-26 08:38:41,521][123091] Updated weights for policy 0, policy_version 1133897 (0.0009) [2023-12-26 08:38:41,912][123090] Updated weights for policy 1, policy_version 1125864 (0.0009) [2023-12-26 08:38:41,965][123090] Updated weights for policy 1, policy_version 1125874 (0.0009) [2023-12-26 08:38:42,024][123090] Updated weights for policy 1, policy_version 1125884 (0.0009) [2023-12-26 08:38:42,358][123091] Updated weights for policy 0, policy_version 1133907 (0.0009) [2023-12-26 08:38:42,417][123091] Updated weights for policy 0, policy_version 1133917 (0.0008) [2023-12-26 08:38:42,483][123091] Updated weights for policy 0, policy_version 1133927 (0.0010) [2023-12-26 08:38:42,896][123090] Updated weights for policy 1, policy_version 1125894 (0.0010) [2023-12-26 08:38:42,956][123090] Updated weights for policy 1, policy_version 1125904 (0.0010) [2023-12-26 08:38:43,025][123090] Updated weights for policy 1, policy_version 1125914 (0.0010) [2023-12-26 08:38:43,294][123091] Updated weights for policy 0, policy_version 1133937 (0.0011) [2023-12-26 08:38:43,354][123091] Updated weights for policy 0, policy_version 1133947 (0.0008) [2023-12-26 08:38:43,410][123091] Updated weights for policy 0, policy_version 1133957 (0.0009) [2023-12-26 08:38:43,458][123091] Updated weights for policy 0, policy_version 1133967 (0.0009) [2023-12-26 08:38:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 578535424. Throughput: 0: 9000.7, 1: 8699.4. Samples: 578531588. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:43,784][121949] Avg episode reward: [(0, '6284.330'), (1, '5903.629')] [2023-12-26 08:38:43,830][123090] Updated weights for policy 1, policy_version 1125924 (0.0010) [2023-12-26 08:38:43,877][123090] Updated weights for policy 1, policy_version 1125934 (0.0010) [2023-12-26 08:38:43,929][123090] Updated weights for policy 1, policy_version 1125944 (0.0010) [2023-12-26 08:38:44,302][123091] Updated weights for policy 0, policy_version 1133977 (0.0009) [2023-12-26 08:38:44,350][123091] Updated weights for policy 0, policy_version 1133987 (0.0009) [2023-12-26 08:38:44,399][123091] Updated weights for policy 0, policy_version 1133997 (0.0009) [2023-12-26 08:38:44,782][123090] Updated weights for policy 1, policy_version 1125954 (0.0010) [2023-12-26 08:38:44,852][123090] Updated weights for policy 1, policy_version 1125964 (0.0011) [2023-12-26 08:38:44,919][123090] Updated weights for policy 1, policy_version 1125974 (0.0011) [2023-12-26 08:38:44,984][123090] Updated weights for policy 1, policy_version 1125984 (0.0011) [2023-12-26 08:38:45,270][123091] Updated weights for policy 0, policy_version 1134007 (0.0009) [2023-12-26 08:38:45,335][123091] Updated weights for policy 0, policy_version 1134017 (0.0009) [2023-12-26 08:38:45,392][123091] Updated weights for policy 0, policy_version 1134027 (0.0008) [2023-12-26 08:38:45,748][123090] Updated weights for policy 1, policy_version 1125994 (0.0006) [2023-12-26 08:38:45,804][123090] Updated weights for policy 1, policy_version 1126004 (0.0006) [2023-12-26 08:38:45,865][123090] Updated weights for policy 1, policy_version 1126014 (0.0006) [2023-12-26 08:38:46,186][123091] Updated weights for policy 0, policy_version 1134037 (0.0009) [2023-12-26 08:38:46,256][123091] Updated weights for policy 0, policy_version 1134047 (0.0008) [2023-12-26 08:38:46,309][123091] Updated weights for policy 0, policy_version 1134057 (0.0009) [2023-12-26 08:38:46,537][123090] Updated weights for policy 1, policy_version 1126024 (0.0009) [2023-12-26 08:38:46,586][123090] Updated weights for policy 1, policy_version 1126034 (0.0009) [2023-12-26 08:38:46,640][123090] Updated weights for policy 1, policy_version 1126045 (0.0009) [2023-12-26 08:38:47,139][123091] Updated weights for policy 0, policy_version 1134067 (0.0008) [2023-12-26 08:38:47,204][123091] Updated weights for policy 0, policy_version 1134077 (0.0005) [2023-12-26 08:38:47,273][123091] Updated weights for policy 0, policy_version 1134087 (0.0005) [2023-12-26 08:38:47,408][123090] Updated weights for policy 1, policy_version 1126055 (0.0010) [2023-12-26 08:38:47,474][123090] Updated weights for policy 1, policy_version 1126065 (0.0010) [2023-12-26 08:38:47,546][123090] Updated weights for policy 1, policy_version 1126075 (0.0010) [2023-12-26 08:38:47,856][123091] Updated weights for policy 0, policy_version 1134097 (0.0006) [2023-12-26 08:38:47,911][123091] Updated weights for policy 0, policy_version 1134107 (0.0010) [2023-12-26 08:38:47,969][123091] Updated weights for policy 0, policy_version 1134117 (0.0010) [2023-12-26 08:38:48,040][123091] Updated weights for policy 0, policy_version 1134127 (0.0011) [2023-12-26 08:38:48,421][123090] Updated weights for policy 1, policy_version 1126085 (0.0009) [2023-12-26 08:38:48,485][123090] Updated weights for policy 1, policy_version 1126095 (0.0009) [2023-12-26 08:38:48,546][123090] Updated weights for policy 1, policy_version 1126105 (0.0008) [2023-12-26 08:38:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 578625536. Throughput: 0: 8950.4, 1: 8704.4. Samples: 578636968. Policy #0 lag: (min: 35.0, avg: 47.5, max: 48.0) [2023-12-26 08:38:48,785][121949] Avg episode reward: [(0, '6344.378'), (1, '5878.580')] [2023-12-26 08:38:48,844][123091] Updated weights for policy 0, policy_version 1134137 (0.0011) [2023-12-26 08:38:48,900][123091] Updated weights for policy 0, policy_version 1134147 (0.0011) [2023-12-26 08:38:48,956][123091] Updated weights for policy 0, policy_version 1134157 (0.0010) [2023-12-26 08:38:49,408][123090] Updated weights for policy 1, policy_version 1126115 (0.0009) [2023-12-26 08:38:49,477][123090] Updated weights for policy 1, policy_version 1126126 (0.0009) [2023-12-26 08:38:49,531][123090] Updated weights for policy 1, policy_version 1126136 (0.0009) [2023-12-26 08:38:49,778][123091] Updated weights for policy 0, policy_version 1134167 (0.0009) [2023-12-26 08:38:49,841][123091] Updated weights for policy 0, policy_version 1134177 (0.0009) [2023-12-26 08:38:49,904][123091] Updated weights for policy 0, policy_version 1134187 (0.0009) [2023-12-26 08:38:50,397][123090] Updated weights for policy 1, policy_version 1126146 (0.0008) [2023-12-26 08:38:50,454][123090] Updated weights for policy 1, policy_version 1126156 (0.0006) [2023-12-26 08:38:50,505][123090] Updated weights for policy 1, policy_version 1126166 (0.0005) [2023-12-26 08:38:50,555][123090] Updated weights for policy 1, policy_version 1126176 (0.0005) [2023-12-26 08:38:50,791][123091] Updated weights for policy 0, policy_version 1134197 (0.0010) [2023-12-26 08:38:50,858][123091] Updated weights for policy 0, policy_version 1134207 (0.0011) [2023-12-26 08:38:50,916][123091] Updated weights for policy 0, policy_version 1134217 (0.0011) [2023-12-26 08:38:51,405][123090] Updated weights for policy 1, policy_version 1126186 (0.0011) [2023-12-26 08:38:51,465][123090] Updated weights for policy 1, policy_version 1126196 (0.0010) [2023-12-26 08:38:51,532][123090] Updated weights for policy 1, policy_version 1126206 (0.0011) [2023-12-26 08:38:51,745][123091] Updated weights for policy 0, policy_version 1134227 (0.0010) [2023-12-26 08:38:51,827][123091] Updated weights for policy 0, policy_version 1134237 (0.0007) [2023-12-26 08:38:51,897][123091] Updated weights for policy 0, policy_version 1134247 (0.0006) [2023-12-26 08:38:52,397][123090] Updated weights for policy 1, policy_version 1126216 (0.0010) [2023-12-26 08:38:52,466][123090] Updated weights for policy 1, policy_version 1126227 (0.0009) [2023-12-26 08:38:52,495][123091] Updated weights for policy 0, policy_version 1134257 (0.0006) [2023-12-26 08:38:52,533][123090] Updated weights for policy 1, policy_version 1126237 (0.0010) [2023-12-26 08:38:52,560][123091] Updated weights for policy 0, policy_version 1134267 (0.0010) [2023-12-26 08:38:52,622][123091] Updated weights for policy 0, policy_version 1134277 (0.0009) [2023-12-26 08:38:52,689][123091] Updated weights for policy 0, policy_version 1134287 (0.0008) [2023-12-26 08:38:53,365][123090] Updated weights for policy 1, policy_version 1126247 (0.0007) [2023-12-26 08:38:53,417][123090] Updated weights for policy 1, policy_version 1126257 (0.0005) [2023-12-26 08:38:53,463][123090] Updated weights for policy 1, policy_version 1126267 (0.0005) [2023-12-26 08:38:53,475][123091] Updated weights for policy 0, policy_version 1134297 (0.0006) [2023-12-26 08:38:53,536][123091] Updated weights for policy 0, policy_version 1134307 (0.0011) [2023-12-26 08:38:53,580][123091] Updated weights for policy 0, policy_version 1134317 (0.0010) [2023-12-26 08:38:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17800.4). Total num frames: 578715648. Throughput: 0: 8924.8, 1: 8695.1. Samples: 578687516. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:38:53,785][121949] Avg episode reward: [(0, '6337.399'), (1, '5921.812')] [2023-12-26 08:38:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001134320_290390016.pth... [2023-12-26 08:38:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001126272_288325632.pth... [2023-12-26 08:38:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001125248_288063488.pth [2023-12-26 08:38:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001133264_290119680.pth [2023-12-26 08:38:54,282][123090] Updated weights for policy 1, policy_version 1126277 (0.0008) [2023-12-26 08:38:54,343][123090] Updated weights for policy 1, policy_version 1126287 (0.0009) [2023-12-26 08:38:54,392][123091] Updated weights for policy 0, policy_version 1134327 (0.0010) [2023-12-26 08:38:54,404][123090] Updated weights for policy 1, policy_version 1126297 (0.0009) [2023-12-26 08:38:54,449][123091] Updated weights for policy 0, policy_version 1134337 (0.0006) [2023-12-26 08:38:54,502][123091] Updated weights for policy 0, policy_version 1134347 (0.0009) [2023-12-26 08:38:55,213][123090] Updated weights for policy 1, policy_version 1126307 (0.0009) [2023-12-26 08:38:55,274][123090] Updated weights for policy 1, policy_version 1126317 (0.0005) [2023-12-26 08:38:55,348][123090] Updated weights for policy 1, policy_version 1126327 (0.0005) [2023-12-26 08:38:55,387][123091] Updated weights for policy 0, policy_version 1134357 (0.0008) [2023-12-26 08:38:55,454][123091] Updated weights for policy 0, policy_version 1134367 (0.0008) [2023-12-26 08:38:55,523][123091] Updated weights for policy 0, policy_version 1134377 (0.0009) [2023-12-26 08:38:56,031][123090] Updated weights for policy 1, policy_version 1126337 (0.0008) [2023-12-26 08:38:56,093][123090] Updated weights for policy 1, policy_version 1126347 (0.0005) [2023-12-26 08:38:56,148][123090] Updated weights for policy 1, policy_version 1126357 (0.0005) [2023-12-26 08:38:56,209][123090] Updated weights for policy 1, policy_version 1126367 (0.0005) [2023-12-26 08:38:56,388][123091] Updated weights for policy 0, policy_version 1134387 (0.0008) [2023-12-26 08:38:56,435][123091] Updated weights for policy 0, policy_version 1134397 (0.0005) [2023-12-26 08:38:56,483][123091] Updated weights for policy 0, policy_version 1134407 (0.0005) [2023-12-26 08:38:56,880][123090] Updated weights for policy 1, policy_version 1126377 (0.0005) [2023-12-26 08:38:56,942][123090] Updated weights for policy 1, policy_version 1126387 (0.0005) [2023-12-26 08:38:57,008][123090] Updated weights for policy 1, policy_version 1126397 (0.0005) [2023-12-26 08:38:57,182][123091] Updated weights for policy 0, policy_version 1134417 (0.0005) [2023-12-26 08:38:57,233][123091] Updated weights for policy 0, policy_version 1134427 (0.0005) [2023-12-26 08:38:57,293][123091] Updated weights for policy 0, policy_version 1134437 (0.0005) [2023-12-26 08:38:57,346][123091] Updated weights for policy 0, policy_version 1134447 (0.0008) [2023-12-26 08:38:57,658][123090] Updated weights for policy 1, policy_version 1126407 (0.0005) [2023-12-26 08:38:57,716][123090] Updated weights for policy 1, policy_version 1126417 (0.0005) [2023-12-26 08:38:57,773][123090] Updated weights for policy 1, policy_version 1126427 (0.0005) [2023-12-26 08:38:58,099][123091] Updated weights for policy 0, policy_version 1134457 (0.0010) [2023-12-26 08:38:58,162][123091] Updated weights for policy 0, policy_version 1134467 (0.0011) [2023-12-26 08:38:58,218][123091] Updated weights for policy 0, policy_version 1134477 (0.0010) [2023-12-26 08:38:58,565][123090] Updated weights for policy 1, policy_version 1126437 (0.0007) [2023-12-26 08:38:58,639][123090] Updated weights for policy 1, policy_version 1126447 (0.0008) [2023-12-26 08:38:58,709][123090] Updated weights for policy 1, policy_version 1126457 (0.0009) [2023-12-26 08:38:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 578805760. Throughput: 0: 8966.2, 1: 8777.1. Samples: 578797060. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:38:58,785][121949] Avg episode reward: [(0, '6318.109'), (1, '5940.734')] [2023-12-26 08:38:59,173][123091] Updated weights for policy 0, policy_version 1134487 (0.0010) [2023-12-26 08:38:59,239][123091] Updated weights for policy 0, policy_version 1134497 (0.0010) [2023-12-26 08:38:59,304][123091] Updated weights for policy 0, policy_version 1134507 (0.0008) [2023-12-26 08:38:59,551][123090] Updated weights for policy 1, policy_version 1126467 (0.0008) [2023-12-26 08:38:59,618][123090] Updated weights for policy 1, policy_version 1126477 (0.0005) [2023-12-26 08:38:59,691][123090] Updated weights for policy 1, policy_version 1126487 (0.0005) [2023-12-26 08:39:00,104][123091] Updated weights for policy 0, policy_version 1134517 (0.0009) [2023-12-26 08:39:00,178][123091] Updated weights for policy 0, policy_version 1134527 (0.0005) [2023-12-26 08:39:00,233][123091] Updated weights for policy 0, policy_version 1134537 (0.0007) [2023-12-26 08:39:00,339][123090] Updated weights for policy 1, policy_version 1126497 (0.0005) [2023-12-26 08:39:00,411][123090] Updated weights for policy 1, policy_version 1126507 (0.0009) [2023-12-26 08:39:00,473][123090] Updated weights for policy 1, policy_version 1126517 (0.0009) [2023-12-26 08:39:00,523][123090] Updated weights for policy 1, policy_version 1126527 (0.0009) [2023-12-26 08:39:00,902][123091] Updated weights for policy 0, policy_version 1134547 (0.0005) [2023-12-26 08:39:00,966][123091] Updated weights for policy 0, policy_version 1134557 (0.0005) [2023-12-26 08:39:01,029][123091] Updated weights for policy 0, policy_version 1134567 (0.0007) [2023-12-26 08:39:01,393][123090] Updated weights for policy 1, policy_version 1126537 (0.0009) [2023-12-26 08:39:01,455][123090] Updated weights for policy 1, policy_version 1126547 (0.0008) [2023-12-26 08:39:01,504][123090] Updated weights for policy 1, policy_version 1126557 (0.0009) [2023-12-26 08:39:01,755][123091] Updated weights for policy 0, policy_version 1134577 (0.0010) [2023-12-26 08:39:01,818][123091] Updated weights for policy 0, policy_version 1134587 (0.0010) [2023-12-26 08:39:01,880][123091] Updated weights for policy 0, policy_version 1134597 (0.0010) [2023-12-26 08:39:01,935][123091] Updated weights for policy 0, policy_version 1134607 (0.0010) [2023-12-26 08:39:02,367][123090] Updated weights for policy 1, policy_version 1126567 (0.0009) [2023-12-26 08:39:02,430][123090] Updated weights for policy 1, policy_version 1126577 (0.0009) [2023-12-26 08:39:02,482][123090] Updated weights for policy 1, policy_version 1126587 (0.0008) [2023-12-26 08:39:02,755][123091] Updated weights for policy 0, policy_version 1134617 (0.0011) [2023-12-26 08:39:02,806][123091] Updated weights for policy 0, policy_version 1134627 (0.0010) [2023-12-26 08:39:02,853][123091] Updated weights for policy 0, policy_version 1134637 (0.0010) [2023-12-26 08:39:03,312][123090] Updated weights for policy 1, policy_version 1126597 (0.0009) [2023-12-26 08:39:03,366][123090] Updated weights for policy 1, policy_version 1126607 (0.0008) [2023-12-26 08:39:03,414][123090] Updated weights for policy 1, policy_version 1126617 (0.0009) [2023-12-26 08:39:03,689][123091] Updated weights for policy 0, policy_version 1134647 (0.0010) [2023-12-26 08:39:03,754][123091] Updated weights for policy 0, policy_version 1134657 (0.0010) [2023-12-26 08:39:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 578887680. Throughput: 0: 8846.2, 1: 8775.4. Samples: 578902104. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:03,785][121949] Avg episode reward: [(0, '6351.866'), (1, '5810.437')] [2023-12-26 08:39:03,812][123091] Updated weights for policy 0, policy_version 1134667 (0.0010) [2023-12-26 08:39:04,247][123090] Updated weights for policy 1, policy_version 1126627 (0.0008) [2023-12-26 08:39:04,305][123090] Updated weights for policy 1, policy_version 1126637 (0.0008) [2023-12-26 08:39:04,366][123090] Updated weights for policy 1, policy_version 1126647 (0.0006) [2023-12-26 08:39:04,656][123091] Updated weights for policy 0, policy_version 1134677 (0.0011) [2023-12-26 08:39:04,727][123091] Updated weights for policy 0, policy_version 1134687 (0.0011) [2023-12-26 08:39:04,794][123091] Updated weights for policy 0, policy_version 1134697 (0.0011) [2023-12-26 08:39:05,139][123090] Updated weights for policy 1, policy_version 1126657 (0.0006) [2023-12-26 08:39:05,187][123090] Updated weights for policy 1, policy_version 1126667 (0.0006) [2023-12-26 08:39:05,234][123090] Updated weights for policy 1, policy_version 1126677 (0.0009) [2023-12-26 08:39:05,281][123090] Updated weights for policy 1, policy_version 1126687 (0.0007) [2023-12-26 08:39:05,588][123091] Updated weights for policy 0, policy_version 1134707 (0.0011) [2023-12-26 08:39:05,651][123091] Updated weights for policy 0, policy_version 1134717 (0.0011) [2023-12-26 08:39:05,720][123091] Updated weights for policy 0, policy_version 1134727 (0.0010) [2023-12-26 08:39:06,044][123090] Updated weights for policy 1, policy_version 1126697 (0.0007) [2023-12-26 08:39:06,101][123090] Updated weights for policy 1, policy_version 1126707 (0.0006) [2023-12-26 08:39:06,164][123090] Updated weights for policy 1, policy_version 1126717 (0.0009) [2023-12-26 08:39:06,506][123091] Updated weights for policy 0, policy_version 1134737 (0.0010) [2023-12-26 08:39:06,570][123091] Updated weights for policy 0, policy_version 1134747 (0.0011) [2023-12-26 08:39:06,627][123091] Updated weights for policy 0, policy_version 1134757 (0.0006) [2023-12-26 08:39:06,684][123091] Updated weights for policy 0, policy_version 1134767 (0.0007) [2023-12-26 08:39:06,979][123090] Updated weights for policy 1, policy_version 1126727 (0.0010) [2023-12-26 08:39:07,039][123090] Updated weights for policy 1, policy_version 1126737 (0.0010) [2023-12-26 08:39:07,110][123090] Updated weights for policy 1, policy_version 1126747 (0.0009) [2023-12-26 08:39:07,378][123091] Updated weights for policy 0, policy_version 1134777 (0.0006) [2023-12-26 08:39:07,446][123091] Updated weights for policy 0, policy_version 1134787 (0.0006) [2023-12-26 08:39:07,518][123091] Updated weights for policy 0, policy_version 1134797 (0.0005) [2023-12-26 08:39:07,888][123090] Updated weights for policy 1, policy_version 1126757 (0.0008) [2023-12-26 08:39:07,948][123090] Updated weights for policy 1, policy_version 1126767 (0.0005) [2023-12-26 08:39:07,994][123090] Updated weights for policy 1, policy_version 1126777 (0.0005) [2023-12-26 08:39:08,185][123091] Updated weights for policy 0, policy_version 1134807 (0.0009) [2023-12-26 08:39:08,239][123091] Updated weights for policy 0, policy_version 1134817 (0.0007) [2023-12-26 08:39:08,284][123091] Updated weights for policy 0, policy_version 1134827 (0.0005) [2023-12-26 08:39:08,717][123090] Updated weights for policy 1, policy_version 1126787 (0.0007) [2023-12-26 08:39:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 578977792. Throughput: 0: 8857.1, 1: 8844.1. Samples: 578955684. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:08,785][121949] Avg episode reward: [(0, '6312.656'), (1, '5692.424')] [2023-12-26 08:39:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001134832_290521088.pth... [2023-12-26 08:39:08,792][123090] Updated weights for policy 1, policy_version 1126797 (0.0010) [2023-12-26 08:39:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001133808_290258944.pth [2023-12-26 08:39:08,862][123090] Updated weights for policy 1, policy_version 1126807 (0.0009) [2023-12-26 08:39:08,922][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001126816_288464896.pth... [2023-12-26 08:39:08,927][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001125760_288194560.pth [2023-12-26 08:39:09,025][123091] Updated weights for policy 0, policy_version 1134837 (0.0007) [2023-12-26 08:39:09,078][123091] Updated weights for policy 0, policy_version 1134847 (0.0009) [2023-12-26 08:39:09,142][123091] Updated weights for policy 0, policy_version 1134857 (0.0009) [2023-12-26 08:39:09,728][123090] Updated weights for policy 1, policy_version 1126817 (0.0010) [2023-12-26 08:39:09,789][123090] Updated weights for policy 1, policy_version 1126827 (0.0009) [2023-12-26 08:39:09,865][123090] Updated weights for policy 1, policy_version 1126837 (0.0010) [2023-12-26 08:39:09,928][123090] Updated weights for policy 1, policy_version 1126847 (0.0010) [2023-12-26 08:39:09,969][123091] Updated weights for policy 0, policy_version 1134867 (0.0009) [2023-12-26 08:39:10,028][123091] Updated weights for policy 0, policy_version 1134877 (0.0010) [2023-12-26 08:39:10,090][123091] Updated weights for policy 0, policy_version 1134887 (0.0006) [2023-12-26 08:39:10,823][123090] Updated weights for policy 1, policy_version 1126857 (0.0009) [2023-12-26 08:39:10,888][123090] Updated weights for policy 1, policy_version 1126867 (0.0009) [2023-12-26 08:39:10,892][123091] Updated weights for policy 0, policy_version 1134897 (0.0009) [2023-12-26 08:39:10,946][123090] Updated weights for policy 1, policy_version 1126877 (0.0007) [2023-12-26 08:39:10,951][123091] Updated weights for policy 0, policy_version 1134907 (0.0011) [2023-12-26 08:39:11,015][123091] Updated weights for policy 0, policy_version 1134917 (0.0010) [2023-12-26 08:39:11,082][123091] Updated weights for policy 0, policy_version 1134927 (0.0011) [2023-12-26 08:39:11,791][123090] Updated weights for policy 1, policy_version 1126887 (0.0008) [2023-12-26 08:39:11,858][123090] Updated weights for policy 1, policy_version 1126897 (0.0008) [2023-12-26 08:39:11,914][123090] Updated weights for policy 1, policy_version 1126908 (0.0010) [2023-12-26 08:39:11,955][123091] Updated weights for policy 0, policy_version 1134937 (0.0010) [2023-12-26 08:39:12,019][123091] Updated weights for policy 0, policy_version 1134947 (0.0010) [2023-12-26 08:39:12,080][123091] Updated weights for policy 0, policy_version 1134957 (0.0009) [2023-12-26 08:39:12,721][123090] Updated weights for policy 1, policy_version 1126918 (0.0009) [2023-12-26 08:39:12,779][123090] Updated weights for policy 1, policy_version 1126928 (0.0009) [2023-12-26 08:39:12,834][123090] Updated weights for policy 1, policy_version 1126938 (0.0009) [2023-12-26 08:39:12,961][123091] Updated weights for policy 0, policy_version 1134967 (0.0010) [2023-12-26 08:39:13,019][123091] Updated weights for policy 0, policy_version 1134977 (0.0010) [2023-12-26 08:39:13,081][123091] Updated weights for policy 0, policy_version 1134987 (0.0009) [2023-12-26 08:39:13,589][123090] Updated weights for policy 1, policy_version 1126948 (0.0008) [2023-12-26 08:39:13,663][123090] Updated weights for policy 1, policy_version 1126958 (0.0008) [2023-12-26 08:39:13,728][123090] Updated weights for policy 1, policy_version 1126968 (0.0009) [2023-12-26 08:39:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 579067904. Throughput: 0: 8902.4, 1: 8779.9. Samples: 579061148. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:13,785][121949] Avg episode reward: [(0, '6316.179'), (1, '5606.141')] [2023-12-26 08:39:13,932][123091] Updated weights for policy 0, policy_version 1134997 (0.0009) [2023-12-26 08:39:13,990][123091] Updated weights for policy 0, policy_version 1135008 (0.0009) [2023-12-26 08:39:14,045][123091] Updated weights for policy 0, policy_version 1135019 (0.0010) [2023-12-26 08:39:14,417][123090] Updated weights for policy 1, policy_version 1126978 (0.0010) [2023-12-26 08:39:14,475][123090] Updated weights for policy 1, policy_version 1126988 (0.0008) [2023-12-26 08:39:14,538][123090] Updated weights for policy 1, policy_version 1126998 (0.0008) [2023-12-26 08:39:14,594][123090] Updated weights for policy 1, policy_version 1127008 (0.0005) [2023-12-26 08:39:14,926][123091] Updated weights for policy 0, policy_version 1135029 (0.0009) [2023-12-26 08:39:14,994][123091] Updated weights for policy 0, policy_version 1135039 (0.0010) [2023-12-26 08:39:15,058][123091] Updated weights for policy 0, policy_version 1135049 (0.0009) [2023-12-26 08:39:15,350][123090] Updated weights for policy 1, policy_version 1127018 (0.0011) [2023-12-26 08:39:15,410][123090] Updated weights for policy 1, policy_version 1127028 (0.0011) [2023-12-26 08:39:15,470][123090] Updated weights for policy 1, policy_version 1127038 (0.0011) [2023-12-26 08:39:15,893][123091] Updated weights for policy 0, policy_version 1135059 (0.0008) [2023-12-26 08:39:15,952][123091] Updated weights for policy 0, policy_version 1135069 (0.0005) [2023-12-26 08:39:16,012][123091] Updated weights for policy 0, policy_version 1135079 (0.0005) [2023-12-26 08:39:16,263][123090] Updated weights for policy 1, policy_version 1127048 (0.0006) [2023-12-26 08:39:16,307][123090] Updated weights for policy 1, policy_version 1127058 (0.0005) [2023-12-26 08:39:16,358][123090] Updated weights for policy 1, policy_version 1127068 (0.0005) [2023-12-26 08:39:16,831][123091] Updated weights for policy 0, policy_version 1135089 (0.0009) [2023-12-26 08:39:16,885][123091] Updated weights for policy 0, policy_version 1135099 (0.0009) [2023-12-26 08:39:16,938][123091] Updated weights for policy 0, policy_version 1135109 (0.0010) [2023-12-26 08:39:17,001][123091] Updated weights for policy 0, policy_version 1135119 (0.0009) [2023-12-26 08:39:17,096][123090] Updated weights for policy 1, policy_version 1127078 (0.0008) [2023-12-26 08:39:17,152][123090] Updated weights for policy 1, policy_version 1127088 (0.0009) [2023-12-26 08:39:17,205][123090] Updated weights for policy 1, policy_version 1127098 (0.0008) [2023-12-26 08:39:17,862][123091] Updated weights for policy 0, policy_version 1135129 (0.0009) [2023-12-26 08:39:17,898][123090] Updated weights for policy 1, policy_version 1127108 (0.0008) [2023-12-26 08:39:17,925][123091] Updated weights for policy 0, policy_version 1135139 (0.0009) [2023-12-26 08:39:17,960][123090] Updated weights for policy 1, policy_version 1127118 (0.0005) [2023-12-26 08:39:17,985][123091] Updated weights for policy 0, policy_version 1135149 (0.0009) [2023-12-26 08:39:18,009][123090] Updated weights for policy 1, policy_version 1127128 (0.0005) [2023-12-26 08:39:18,669][123090] Updated weights for policy 1, policy_version 1127138 (0.0006) [2023-12-26 08:39:18,731][123090] Updated weights for policy 1, policy_version 1127148 (0.0005) [2023-12-26 08:39:18,752][123091] Updated weights for policy 0, policy_version 1135159 (0.0009) [2023-12-26 08:39:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 579149824. Throughput: 0: 8828.0, 1: 8876.9. Samples: 579168496. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:18,785][121949] Avg episode reward: [(0, '6346.652'), (1, '5379.921')] [2023-12-26 08:39:18,790][123090] Updated weights for policy 1, policy_version 1127158 (0.0005) [2023-12-26 08:39:18,811][123091] Updated weights for policy 0, policy_version 1135169 (0.0008) [2023-12-26 08:39:18,850][123090] Updated weights for policy 1, policy_version 1127168 (0.0006) [2023-12-26 08:39:18,866][123091] Updated weights for policy 0, policy_version 1135179 (0.0009) [2023-12-26 08:39:19,604][123090] Updated weights for policy 1, policy_version 1127178 (0.0010) [2023-12-26 08:39:19,671][123090] Updated weights for policy 1, policy_version 1127188 (0.0010) [2023-12-26 08:39:19,716][123091] Updated weights for policy 0, policy_version 1135189 (0.0009) [2023-12-26 08:39:19,745][123090] Updated weights for policy 1, policy_version 1127198 (0.0008) [2023-12-26 08:39:19,778][123091] Updated weights for policy 0, policy_version 1135199 (0.0009) [2023-12-26 08:39:19,843][123091] Updated weights for policy 0, policy_version 1135209 (0.0010) [2023-12-26 08:39:20,549][123090] Updated weights for policy 1, policy_version 1127208 (0.0007) [2023-12-26 08:39:20,614][123090] Updated weights for policy 1, policy_version 1127218 (0.0010) [2023-12-26 08:39:20,663][123091] Updated weights for policy 0, policy_version 1135219 (0.0009) [2023-12-26 08:39:20,682][123090] Updated weights for policy 1, policy_version 1127228 (0.0008) [2023-12-26 08:39:20,721][123091] Updated weights for policy 0, policy_version 1135229 (0.0009) [2023-12-26 08:39:20,775][123091] Updated weights for policy 0, policy_version 1135239 (0.0010) [2023-12-26 08:39:21,510][123090] Updated weights for policy 1, policy_version 1127238 (0.0008) [2023-12-26 08:39:21,576][123090] Updated weights for policy 1, policy_version 1127248 (0.0008) [2023-12-26 08:39:21,650][123090] Updated weights for policy 1, policy_version 1127258 (0.0009) [2023-12-26 08:39:21,660][123091] Updated weights for policy 0, policy_version 1135249 (0.0010) [2023-12-26 08:39:21,729][123091] Updated weights for policy 0, policy_version 1135259 (0.0011) [2023-12-26 08:39:21,786][123091] Updated weights for policy 0, policy_version 1135269 (0.0010) [2023-12-26 08:39:21,849][123091] Updated weights for policy 0, policy_version 1135279 (0.0006) [2023-12-26 08:39:22,484][123090] Updated weights for policy 1, policy_version 1127268 (0.0008) [2023-12-26 08:39:22,551][123090] Updated weights for policy 1, policy_version 1127278 (0.0009) [2023-12-26 08:39:22,593][123091] Updated weights for policy 0, policy_version 1135289 (0.0007) [2023-12-26 08:39:22,619][123090] Updated weights for policy 1, policy_version 1127288 (0.0008) [2023-12-26 08:39:22,659][123091] Updated weights for policy 0, policy_version 1135299 (0.0011) [2023-12-26 08:39:22,730][123091] Updated weights for policy 0, policy_version 1135309 (0.0010) [2023-12-26 08:39:23,356][123090] Updated weights for policy 1, policy_version 1127298 (0.0008) [2023-12-26 08:39:23,416][123090] Updated weights for policy 1, policy_version 1127308 (0.0006) [2023-12-26 08:39:23,473][123090] Updated weights for policy 1, policy_version 1127318 (0.0005) [2023-12-26 08:39:23,519][123091] Updated weights for policy 0, policy_version 1135319 (0.0010) [2023-12-26 08:39:23,540][123090] Updated weights for policy 1, policy_version 1127328 (0.0006) [2023-12-26 08:39:23,575][123091] Updated weights for policy 0, policy_version 1135329 (0.0009) [2023-12-26 08:39:23,639][123091] Updated weights for policy 0, policy_version 1135339 (0.0009) [2023-12-26 08:39:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 579248128. Throughput: 0: 8738.7, 1: 8885.0. Samples: 579220104. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:23,786][121949] Avg episode reward: [(0, '6382.881'), (1, '5378.834')] [2023-12-26 08:39:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001135344_290652160.pth... [2023-12-26 08:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001127328_288595968.pth... [2023-12-26 08:39:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001134320_290390016.pth [2023-12-26 08:39:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001126272_288325632.pth [2023-12-26 08:39:24,204][123090] Updated weights for policy 1, policy_version 1127338 (0.0008) [2023-12-26 08:39:24,272][123090] Updated weights for policy 1, policy_version 1127348 (0.0009) [2023-12-26 08:39:24,342][123090] Updated weights for policy 1, policy_version 1127358 (0.0009) [2023-12-26 08:39:24,468][123091] Updated weights for policy 0, policy_version 1135349 (0.0010) [2023-12-26 08:39:24,531][123091] Updated weights for policy 0, policy_version 1135359 (0.0011) [2023-12-26 08:39:24,592][123091] Updated weights for policy 0, policy_version 1135369 (0.0011) [2023-12-26 08:39:25,162][123090] Updated weights for policy 1, policy_version 1127368 (0.0009) [2023-12-26 08:39:25,211][123090] Updated weights for policy 1, policy_version 1127378 (0.0009) [2023-12-26 08:39:25,272][123090] Updated weights for policy 1, policy_version 1127388 (0.0008) [2023-12-26 08:39:25,403][123091] Updated weights for policy 0, policy_version 1135379 (0.0010) [2023-12-26 08:39:25,454][123091] Updated weights for policy 0, policy_version 1135389 (0.0010) [2023-12-26 08:39:25,506][123091] Updated weights for policy 0, policy_version 1135399 (0.0010) [2023-12-26 08:39:26,145][123090] Updated weights for policy 1, policy_version 1127398 (0.0009) [2023-12-26 08:39:26,213][123090] Updated weights for policy 1, policy_version 1127408 (0.0010) [2023-12-26 08:39:26,288][123090] Updated weights for policy 1, policy_version 1127418 (0.0010) [2023-12-26 08:39:26,290][123091] Updated weights for policy 0, policy_version 1135409 (0.0009) [2023-12-26 08:39:26,344][123091] Updated weights for policy 0, policy_version 1135419 (0.0010) [2023-12-26 08:39:26,395][123091] Updated weights for policy 0, policy_version 1135429 (0.0010) [2023-12-26 08:39:26,447][123091] Updated weights for policy 0, policy_version 1135439 (0.0010) [2023-12-26 08:39:27,157][123090] Updated weights for policy 1, policy_version 1127428 (0.0010) [2023-12-26 08:39:27,179][123091] Updated weights for policy 0, policy_version 1135449 (0.0006) [2023-12-26 08:39:27,213][123090] Updated weights for policy 1, policy_version 1127438 (0.0008) [2023-12-26 08:39:27,235][123091] Updated weights for policy 0, policy_version 1135459 (0.0005) [2023-12-26 08:39:27,266][123090] Updated weights for policy 1, policy_version 1127448 (0.0008) [2023-12-26 08:39:27,290][123091] Updated weights for policy 0, policy_version 1135469 (0.0005) [2023-12-26 08:39:27,866][123091] Updated weights for policy 0, policy_version 1135479 (0.0005) [2023-12-26 08:39:27,915][123091] Updated weights for policy 0, policy_version 1135489 (0.0005) [2023-12-26 08:39:27,965][123091] Updated weights for policy 0, policy_version 1135499 (0.0005) [2023-12-26 08:39:28,199][123090] Updated weights for policy 1, policy_version 1127458 (0.0009) [2023-12-26 08:39:28,256][123090] Updated weights for policy 1, policy_version 1127468 (0.0009) [2023-12-26 08:39:28,310][123090] Updated weights for policy 1, policy_version 1127478 (0.0010) [2023-12-26 08:39:28,370][123090] Updated weights for policy 1, policy_version 1127488 (0.0009) [2023-12-26 08:39:28,653][123091] Updated weights for policy 0, policy_version 1135509 (0.0008) [2023-12-26 08:39:28,709][123091] Updated weights for policy 0, policy_version 1135519 (0.0009) [2023-12-26 08:39:28,759][123091] Updated weights for policy 0, policy_version 1135529 (0.0005) [2023-12-26 08:39:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 579330048. Throughput: 0: 8805.6, 1: 8861.2. Samples: 579326592. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:28,785][121949] Avg episode reward: [(0, '6258.500'), (1, '5529.044')] [2023-12-26 08:39:29,261][123090] Updated weights for policy 1, policy_version 1127498 (0.0008) [2023-12-26 08:39:29,329][123090] Updated weights for policy 1, policy_version 1127508 (0.0008) [2023-12-26 08:39:29,388][123090] Updated weights for policy 1, policy_version 1127518 (0.0008) [2023-12-26 08:39:29,587][123091] Updated weights for policy 0, policy_version 1135539 (0.0009) [2023-12-26 08:39:29,639][123091] Updated weights for policy 0, policy_version 1135549 (0.0010) [2023-12-26 08:39:29,698][123091] Updated weights for policy 0, policy_version 1135559 (0.0010) [2023-12-26 08:39:30,168][123090] Updated weights for policy 1, policy_version 1127528 (0.0006) [2023-12-26 08:39:30,225][123090] Updated weights for policy 1, policy_version 1127538 (0.0005) [2023-12-26 08:39:30,298][123090] Updated weights for policy 1, policy_version 1127548 (0.0006) [2023-12-26 08:39:30,511][123091] Updated weights for policy 0, policy_version 1135569 (0.0010) [2023-12-26 08:39:30,560][123091] Updated weights for policy 0, policy_version 1135579 (0.0008) [2023-12-26 08:39:30,614][123091] Updated weights for policy 0, policy_version 1135589 (0.0005) [2023-12-26 08:39:30,666][123091] Updated weights for policy 0, policy_version 1135599 (0.0005) [2023-12-26 08:39:31,113][123090] Updated weights for policy 1, policy_version 1127558 (0.0010) [2023-12-26 08:39:31,183][123090] Updated weights for policy 1, policy_version 1127568 (0.0008) [2023-12-26 08:39:31,250][123090] Updated weights for policy 1, policy_version 1127578 (0.0009) [2023-12-26 08:39:31,393][123091] Updated weights for policy 0, policy_version 1135609 (0.0009) [2023-12-26 08:39:31,448][123091] Updated weights for policy 0, policy_version 1135619 (0.0009) [2023-12-26 08:39:31,496][123091] Updated weights for policy 0, policy_version 1135629 (0.0009) [2023-12-26 08:39:32,082][123090] Updated weights for policy 1, policy_version 1127588 (0.0008) [2023-12-26 08:39:32,135][123090] Updated weights for policy 1, policy_version 1127598 (0.0005) [2023-12-26 08:39:32,187][123090] Updated weights for policy 1, policy_version 1127608 (0.0007) [2023-12-26 08:39:32,245][123091] Updated weights for policy 0, policy_version 1135639 (0.0007) [2023-12-26 08:39:32,305][123091] Updated weights for policy 0, policy_version 1135649 (0.0007) [2023-12-26 08:39:32,368][123091] Updated weights for policy 0, policy_version 1135659 (0.0006) [2023-12-26 08:39:33,040][123090] Updated weights for policy 1, policy_version 1127618 (0.0009) [2023-12-26 08:39:33,073][123091] Updated weights for policy 0, policy_version 1135669 (0.0007) [2023-12-26 08:39:33,099][123090] Updated weights for policy 1, policy_version 1127628 (0.0008) [2023-12-26 08:39:33,130][123091] Updated weights for policy 0, policy_version 1135679 (0.0010) [2023-12-26 08:39:33,156][123090] Updated weights for policy 1, policy_version 1127638 (0.0009) [2023-12-26 08:39:33,185][123091] Updated weights for policy 0, policy_version 1135689 (0.0007) [2023-12-26 08:39:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 579420160. Throughput: 0: 8894.8, 1: 8822.4. Samples: 579434244. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:33,784][121949] Avg episode reward: [(0, '6234.980'), (1, '5724.864')] [2023-12-26 08:39:33,942][123091] Updated weights for policy 0, policy_version 1135699 (0.0007) [2023-12-26 08:39:34,007][123091] Updated weights for policy 0, policy_version 1135709 (0.0007) [2023-12-26 08:39:34,017][123090] Updated weights for policy 1, policy_version 1127649 (0.0009) [2023-12-26 08:39:34,067][123091] Updated weights for policy 0, policy_version 1135719 (0.0008) [2023-12-26 08:39:34,071][123090] Updated weights for policy 1, policy_version 1127659 (0.0009) [2023-12-26 08:39:34,133][123090] Updated weights for policy 1, policy_version 1127669 (0.0009) [2023-12-26 08:39:34,206][123090] Updated weights for policy 1, policy_version 1127679 (0.0008) [2023-12-26 08:39:34,855][123091] Updated weights for policy 0, policy_version 1135729 (0.0008) [2023-12-26 08:39:34,917][123091] Updated weights for policy 0, policy_version 1135739 (0.0006) [2023-12-26 08:39:34,982][123091] Updated weights for policy 0, policy_version 1135749 (0.0006) [2023-12-26 08:39:35,029][123090] Updated weights for policy 1, policy_version 1127689 (0.0008) [2023-12-26 08:39:35,040][123091] Updated weights for policy 0, policy_version 1135759 (0.0007) [2023-12-26 08:39:35,093][123090] Updated weights for policy 1, policy_version 1127699 (0.0009) [2023-12-26 08:39:35,140][123090] Updated weights for policy 1, policy_version 1127709 (0.0010) [2023-12-26 08:39:35,831][123091] Updated weights for policy 0, policy_version 1135769 (0.0010) [2023-12-26 08:39:35,885][123091] Updated weights for policy 0, policy_version 1135779 (0.0008) [2023-12-26 08:39:35,946][123091] Updated weights for policy 0, policy_version 1135789 (0.0009) [2023-12-26 08:39:35,964][123090] Updated weights for policy 1, policy_version 1127719 (0.0008) [2023-12-26 08:39:36,029][123090] Updated weights for policy 1, policy_version 1127729 (0.0009) [2023-12-26 08:39:36,080][123090] Updated weights for policy 1, policy_version 1127739 (0.0005) [2023-12-26 08:39:36,837][123091] Updated weights for policy 0, policy_version 1135799 (0.0009) [2023-12-26 08:39:36,882][123090] Updated weights for policy 1, policy_version 1127749 (0.0008) [2023-12-26 08:39:36,895][123091] Updated weights for policy 0, policy_version 1135809 (0.0007) [2023-12-26 08:39:36,941][123090] Updated weights for policy 1, policy_version 1127759 (0.0009) [2023-12-26 08:39:36,960][123091] Updated weights for policy 0, policy_version 1135819 (0.0008) [2023-12-26 08:39:37,004][123090] Updated weights for policy 1, policy_version 1127769 (0.0008) [2023-12-26 08:39:37,741][123091] Updated weights for policy 0, policy_version 1135829 (0.0007) [2023-12-26 08:39:37,807][123091] Updated weights for policy 0, policy_version 1135839 (0.0011) [2023-12-26 08:39:37,850][123090] Updated weights for policy 1, policy_version 1127779 (0.0009) [2023-12-26 08:39:37,879][123091] Updated weights for policy 0, policy_version 1135849 (0.0011) [2023-12-26 08:39:37,913][123090] Updated weights for policy 1, policy_version 1127789 (0.0007) [2023-12-26 08:39:37,980][123090] Updated weights for policy 1, policy_version 1127799 (0.0006) [2023-12-26 08:39:38,633][123091] Updated weights for policy 0, policy_version 1135859 (0.0009) [2023-12-26 08:39:38,653][123090] Updated weights for policy 1, policy_version 1127809 (0.0007) [2023-12-26 08:39:38,697][123091] Updated weights for policy 0, policy_version 1135869 (0.0006) [2023-12-26 08:39:38,721][123090] Updated weights for policy 1, policy_version 1127819 (0.0007) [2023-12-26 08:39:38,761][123091] Updated weights for policy 0, policy_version 1135879 (0.0007) [2023-12-26 08:39:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 579502080. Throughput: 0: 8915.1, 1: 8843.3. Samples: 579486644. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:38,785][121949] Avg episode reward: [(0, '6300.873'), (1, '5659.013')] [2023-12-26 08:39:38,794][123090] Updated weights for policy 1, policy_version 1127829 (0.0007) [2023-12-26 08:39:38,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001135888_290791424.pth... [2023-12-26 08:39:38,823][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001134832_290521088.pth [2023-12-26 08:39:38,860][123090] Updated weights for policy 1, policy_version 1127839 (0.0006) [2023-12-26 08:39:38,866][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001127840_288727040.pth... [2023-12-26 08:39:38,871][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001126816_288464896.pth [2023-12-26 08:39:39,536][123091] Updated weights for policy 0, policy_version 1135889 (0.0007) [2023-12-26 08:39:39,582][123090] Updated weights for policy 1, policy_version 1127849 (0.0008) [2023-12-26 08:39:39,607][123091] Updated weights for policy 0, policy_version 1135899 (0.0010) [2023-12-26 08:39:39,644][123090] Updated weights for policy 1, policy_version 1127859 (0.0008) [2023-12-26 08:39:39,673][123091] Updated weights for policy 0, policy_version 1135909 (0.0007) [2023-12-26 08:39:39,708][123090] Updated weights for policy 1, policy_version 1127869 (0.0008) [2023-12-26 08:39:39,728][123091] Updated weights for policy 0, policy_version 1135919 (0.0006) [2023-12-26 08:39:40,533][123091] Updated weights for policy 0, policy_version 1135929 (0.0009) [2023-12-26 08:39:40,557][123090] Updated weights for policy 1, policy_version 1127879 (0.0008) [2023-12-26 08:39:40,595][123091] Updated weights for policy 0, policy_version 1135939 (0.0010) [2023-12-26 08:39:40,622][123090] Updated weights for policy 1, policy_version 1127889 (0.0010) [2023-12-26 08:39:40,657][123091] Updated weights for policy 0, policy_version 1135949 (0.0007) [2023-12-26 08:39:40,689][123090] Updated weights for policy 1, policy_version 1127899 (0.0007) [2023-12-26 08:39:41,434][123090] Updated weights for policy 1, policy_version 1127909 (0.0009) [2023-12-26 08:39:41,499][123090] Updated weights for policy 1, policy_version 1127919 (0.0009) [2023-12-26 08:39:41,537][123091] Updated weights for policy 0, policy_version 1135959 (0.0006) [2023-12-26 08:39:41,569][123090] Updated weights for policy 1, policy_version 1127929 (0.0009) [2023-12-26 08:39:41,595][123091] Updated weights for policy 0, policy_version 1135969 (0.0006) [2023-12-26 08:39:41,673][123091] Updated weights for policy 0, policy_version 1135979 (0.0008) [2023-12-26 08:39:42,409][123090] Updated weights for policy 1, policy_version 1127939 (0.0009) [2023-12-26 08:39:42,464][123091] Updated weights for policy 0, policy_version 1135989 (0.0007) [2023-12-26 08:39:42,474][123090] Updated weights for policy 1, policy_version 1127949 (0.0008) [2023-12-26 08:39:42,516][123091] Updated weights for policy 0, policy_version 1135999 (0.0007) [2023-12-26 08:39:42,531][123090] Updated weights for policy 1, policy_version 1127959 (0.0010) [2023-12-26 08:39:42,568][123091] Updated weights for policy 0, policy_version 1136009 (0.0008) [2023-12-26 08:39:43,271][123090] Updated weights for policy 1, policy_version 1127969 (0.0009) [2023-12-26 08:39:43,330][123090] Updated weights for policy 1, policy_version 1127979 (0.0009) [2023-12-26 08:39:43,396][123090] Updated weights for policy 1, policy_version 1127989 (0.0009) [2023-12-26 08:39:43,448][123090] Updated weights for policy 1, policy_version 1127999 (0.0010) [2023-12-26 08:39:43,457][123091] Updated weights for policy 0, policy_version 1136019 (0.0009) [2023-12-26 08:39:43,507][123091] Updated weights for policy 0, policy_version 1136029 (0.0010) [2023-12-26 08:39:43,556][123091] Updated weights for policy 0, policy_version 1136039 (0.0008) [2023-12-26 08:39:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 579600384. Throughput: 0: 8875.4, 1: 8770.5. Samples: 579591124. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:43,784][121949] Avg episode reward: [(0, '6291.226'), (1, '5628.083')] [2023-12-26 08:39:44,237][123091] Updated weights for policy 0, policy_version 1136049 (0.0005) [2023-12-26 08:39:44,288][123091] Updated weights for policy 0, policy_version 1136059 (0.0005) [2023-12-26 08:39:44,346][123090] Updated weights for policy 1, policy_version 1128009 (0.0009) [2023-12-26 08:39:44,349][123091] Updated weights for policy 0, policy_version 1136069 (0.0007) [2023-12-26 08:39:44,399][123090] Updated weights for policy 1, policy_version 1128019 (0.0007) [2023-12-26 08:39:44,406][123091] Updated weights for policy 0, policy_version 1136079 (0.0008) [2023-12-26 08:39:44,456][123090] Updated weights for policy 1, policy_version 1128029 (0.0009) [2023-12-26 08:39:45,135][123091] Updated weights for policy 0, policy_version 1136089 (0.0010) [2023-12-26 08:39:45,199][123091] Updated weights for policy 0, policy_version 1136099 (0.0010) [2023-12-26 08:39:45,261][123091] Updated weights for policy 0, policy_version 1136109 (0.0009) [2023-12-26 08:39:45,325][123090] Updated weights for policy 1, policy_version 1128039 (0.0010) [2023-12-26 08:39:45,380][123090] Updated weights for policy 1, policy_version 1128049 (0.0009) [2023-12-26 08:39:45,445][123090] Updated weights for policy 1, policy_version 1128059 (0.0009) [2023-12-26 08:39:46,016][123091] Updated weights for policy 0, policy_version 1136119 (0.0007) [2023-12-26 08:39:46,073][123091] Updated weights for policy 0, policy_version 1136129 (0.0005) [2023-12-26 08:39:46,121][123091] Updated weights for policy 0, policy_version 1136139 (0.0005) [2023-12-26 08:39:46,331][123090] Updated weights for policy 1, policy_version 1128069 (0.0009) [2023-12-26 08:39:46,381][123090] Updated weights for policy 1, policy_version 1128079 (0.0009) [2023-12-26 08:39:46,436][123090] Updated weights for policy 1, policy_version 1128089 (0.0008) [2023-12-26 08:39:46,829][123091] Updated weights for policy 0, policy_version 1136149 (0.0005) [2023-12-26 08:39:46,892][123091] Updated weights for policy 0, policy_version 1136159 (0.0005) [2023-12-26 08:39:46,944][123091] Updated weights for policy 0, policy_version 1136169 (0.0005) [2023-12-26 08:39:47,351][123090] Updated weights for policy 1, policy_version 1128099 (0.0010) [2023-12-26 08:39:47,418][123090] Updated weights for policy 1, policy_version 1128109 (0.0009) [2023-12-26 08:39:47,471][123090] Updated weights for policy 1, policy_version 1128119 (0.0009) [2023-12-26 08:39:47,648][123091] Updated weights for policy 0, policy_version 1136179 (0.0007) [2023-12-26 08:39:47,699][123091] Updated weights for policy 0, policy_version 1136189 (0.0010) [2023-12-26 08:39:47,757][123091] Updated weights for policy 0, policy_version 1136199 (0.0010) [2023-12-26 08:39:48,192][123090] Updated weights for policy 1, policy_version 1128129 (0.0008) [2023-12-26 08:39:48,243][123090] Updated weights for policy 1, policy_version 1128139 (0.0006) [2023-12-26 08:39:48,301][123090] Updated weights for policy 1, policy_version 1128149 (0.0005) [2023-12-26 08:39:48,375][123090] Updated weights for policy 1, policy_version 1128159 (0.0007) [2023-12-26 08:39:48,603][123091] Updated weights for policy 0, policy_version 1136209 (0.0010) [2023-12-26 08:39:48,663][123091] Updated weights for policy 0, policy_version 1136219 (0.0009) [2023-12-26 08:39:48,729][123091] Updated weights for policy 0, policy_version 1136229 (0.0008) [2023-12-26 08:39:48,784][123091] Updated weights for policy 0, policy_version 1136239 (0.0008) [2023-12-26 08:39:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 579682304. Throughput: 0: 8945.1, 1: 8766.6. Samples: 579699136. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:48,785][121949] Avg episode reward: [(0, '6358.107'), (1, '5617.150')] [2023-12-26 08:39:49,089][123090] Updated weights for policy 1, policy_version 1128169 (0.0005) [2023-12-26 08:39:49,155][123090] Updated weights for policy 1, policy_version 1128179 (0.0010) [2023-12-26 08:39:49,213][123090] Updated weights for policy 1, policy_version 1128189 (0.0009) [2023-12-26 08:39:49,543][123091] Updated weights for policy 0, policy_version 1136249 (0.0009) [2023-12-26 08:39:49,592][123091] Updated weights for policy 0, policy_version 1136259 (0.0009) [2023-12-26 08:39:49,647][123091] Updated weights for policy 0, policy_version 1136269 (0.0010) [2023-12-26 08:39:50,023][123090] Updated weights for policy 1, policy_version 1128199 (0.0010) [2023-12-26 08:39:50,091][123090] Updated weights for policy 1, policy_version 1128209 (0.0010) [2023-12-26 08:39:50,154][123090] Updated weights for policy 1, policy_version 1128219 (0.0010) [2023-12-26 08:39:50,511][123091] Updated weights for policy 0, policy_version 1136279 (0.0010) [2023-12-26 08:39:50,577][123091] Updated weights for policy 0, policy_version 1136289 (0.0009) [2023-12-26 08:39:50,644][123091] Updated weights for policy 0, policy_version 1136299 (0.0010) [2023-12-26 08:39:50,985][123090] Updated weights for policy 1, policy_version 1128229 (0.0008) [2023-12-26 08:39:51,065][123090] Updated weights for policy 1, policy_version 1128239 (0.0009) [2023-12-26 08:39:51,133][123090] Updated weights for policy 1, policy_version 1128249 (0.0008) [2023-12-26 08:39:51,428][123091] Updated weights for policy 0, policy_version 1136309 (0.0007) [2023-12-26 08:39:51,478][123091] Updated weights for policy 0, policy_version 1136319 (0.0005) [2023-12-26 08:39:51,531][123091] Updated weights for policy 0, policy_version 1136329 (0.0008) [2023-12-26 08:39:51,934][123090] Updated weights for policy 1, policy_version 1128259 (0.0007) [2023-12-26 08:39:52,001][123090] Updated weights for policy 1, policy_version 1128269 (0.0010) [2023-12-26 08:39:52,066][123090] Updated weights for policy 1, policy_version 1128279 (0.0008) [2023-12-26 08:39:52,348][123091] Updated weights for policy 0, policy_version 1136340 (0.0011) [2023-12-26 08:39:52,406][123091] Updated weights for policy 0, policy_version 1136350 (0.0011) [2023-12-26 08:39:52,470][123091] Updated weights for policy 0, policy_version 1136360 (0.0011) [2023-12-26 08:39:52,897][123090] Updated weights for policy 1, policy_version 1128289 (0.0009) [2023-12-26 08:39:52,968][123090] Updated weights for policy 1, policy_version 1128299 (0.0009) [2023-12-26 08:39:53,028][123090] Updated weights for policy 1, policy_version 1128309 (0.0009) [2023-12-26 08:39:53,088][123090] Updated weights for policy 1, policy_version 1128319 (0.0009) [2023-12-26 08:39:53,287][123091] Updated weights for policy 0, policy_version 1136370 (0.0010) [2023-12-26 08:39:53,347][123091] Updated weights for policy 0, policy_version 1136380 (0.0009) [2023-12-26 08:39:53,400][123091] Updated weights for policy 0, policy_version 1136390 (0.0009) [2023-12-26 08:39:53,455][123091] Updated weights for policy 0, policy_version 1136400 (0.0005) [2023-12-26 08:39:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 579772416. Throughput: 0: 8953.7, 1: 8738.3. Samples: 579751828. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:53,785][121949] Avg episode reward: [(0, '6377.303'), (1, '5587.084')] [2023-12-26 08:39:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001128320_288849920.pth... [2023-12-26 08:39:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001136400_290922496.pth... [2023-12-26 08:39:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001135344_290652160.pth [2023-12-26 08:39:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001127328_288595968.pth [2023-12-26 08:39:53,950][123090] Updated weights for policy 1, policy_version 1128329 (0.0010) [2023-12-26 08:39:54,011][123090] Updated weights for policy 1, policy_version 1128339 (0.0010) [2023-12-26 08:39:54,074][123090] Updated weights for policy 1, policy_version 1128349 (0.0009) [2023-12-26 08:39:54,120][123091] Updated weights for policy 0, policy_version 1136410 (0.0005) [2023-12-26 08:39:54,191][123091] Updated weights for policy 0, policy_version 1136420 (0.0006) [2023-12-26 08:39:54,256][123091] Updated weights for policy 0, policy_version 1136430 (0.0010) [2023-12-26 08:39:54,853][123090] Updated weights for policy 1, policy_version 1128359 (0.0009) [2023-12-26 08:39:54,922][123090] Updated weights for policy 1, policy_version 1128369 (0.0009) [2023-12-26 08:39:54,989][123090] Updated weights for policy 1, policy_version 1128379 (0.0009) [2023-12-26 08:39:55,029][123091] Updated weights for policy 0, policy_version 1136440 (0.0011) [2023-12-26 08:39:55,097][123091] Updated weights for policy 0, policy_version 1136450 (0.0011) [2023-12-26 08:39:55,167][123091] Updated weights for policy 0, policy_version 1136460 (0.0011) [2023-12-26 08:39:55,758][123090] Updated weights for policy 1, policy_version 1128389 (0.0008) [2023-12-26 08:39:55,806][123090] Updated weights for policy 1, policy_version 1128399 (0.0008) [2023-12-26 08:39:55,857][123090] Updated weights for policy 1, policy_version 1128409 (0.0008) [2023-12-26 08:39:55,980][123091] Updated weights for policy 0, policy_version 1136471 (0.0010) [2023-12-26 08:39:56,038][123091] Updated weights for policy 0, policy_version 1136481 (0.0009) [2023-12-26 08:39:56,091][123091] Updated weights for policy 0, policy_version 1136491 (0.0009) [2023-12-26 08:39:56,711][123090] Updated weights for policy 1, policy_version 1128419 (0.0010) [2023-12-26 08:39:56,767][123090] Updated weights for policy 1, policy_version 1128430 (0.0009) [2023-12-26 08:39:56,823][123090] Updated weights for policy 1, policy_version 1128440 (0.0009) [2023-12-26 08:39:56,906][123091] Updated weights for policy 0, policy_version 1136501 (0.0009) [2023-12-26 08:39:56,967][123091] Updated weights for policy 0, policy_version 1136511 (0.0009) [2023-12-26 08:39:57,032][123091] Updated weights for policy 0, policy_version 1136521 (0.0009) [2023-12-26 08:39:57,664][123090] Updated weights for policy 1, policy_version 1128450 (0.0006) [2023-12-26 08:39:57,717][123090] Updated weights for policy 1, policy_version 1128460 (0.0005) [2023-12-26 08:39:57,767][123090] Updated weights for policy 1, policy_version 1128470 (0.0005) [2023-12-26 08:39:57,789][123091] Updated weights for policy 0, policy_version 1136531 (0.0008) [2023-12-26 08:39:57,815][123090] Updated weights for policy 1, policy_version 1128480 (0.0005) [2023-12-26 08:39:57,839][123091] Updated weights for policy 0, policy_version 1136541 (0.0005) [2023-12-26 08:39:57,883][123091] Updated weights for policy 0, policy_version 1136551 (0.0005) [2023-12-26 08:39:58,557][123091] Updated weights for policy 0, policy_version 1136561 (0.0006) [2023-12-26 08:39:58,627][123091] Updated weights for policy 0, policy_version 1136571 (0.0008) [2023-12-26 08:39:58,659][123090] Updated weights for policy 1, policy_version 1128490 (0.0008) [2023-12-26 08:39:58,696][123091] Updated weights for policy 0, policy_version 1136581 (0.0008) [2023-12-26 08:39:58,730][123090] Updated weights for policy 1, policy_version 1128500 (0.0007) [2023-12-26 08:39:58,767][123091] Updated weights for policy 0, policy_version 1136591 (0.0010) [2023-12-26 08:39:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 579862528. Throughput: 0: 8940.7, 1: 8716.6. Samples: 579855728. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:39:58,785][121949] Avg episode reward: [(0, '6302.291'), (1, '5645.522')] [2023-12-26 08:39:58,810][123090] Updated weights for policy 1, policy_version 1128510 (0.0008) [2023-12-26 08:39:59,630][123090] Updated weights for policy 1, policy_version 1128520 (0.0009) [2023-12-26 08:39:59,693][123091] Updated weights for policy 0, policy_version 1136601 (0.0007) [2023-12-26 08:39:59,696][123090] Updated weights for policy 1, policy_version 1128530 (0.0009) [2023-12-26 08:39:59,754][123091] Updated weights for policy 0, policy_version 1136611 (0.0010) [2023-12-26 08:39:59,756][123090] Updated weights for policy 1, policy_version 1128540 (0.0006) [2023-12-26 08:39:59,821][123091] Updated weights for policy 0, policy_version 1136621 (0.0010) [2023-12-26 08:40:00,541][123091] Updated weights for policy 0, policy_version 1136631 (0.0010) [2023-12-26 08:40:00,603][123091] Updated weights for policy 0, policy_version 1136641 (0.0009) [2023-12-26 08:40:00,620][123090] Updated weights for policy 1, policy_version 1128550 (0.0008) [2023-12-26 08:40:00,660][123091] Updated weights for policy 0, policy_version 1136651 (0.0009) [2023-12-26 08:40:00,669][123090] Updated weights for policy 1, policy_version 1128560 (0.0007) [2023-12-26 08:40:00,723][123090] Updated weights for policy 1, policy_version 1128570 (0.0009) [2023-12-26 08:40:01,529][123091] Updated weights for policy 0, policy_version 1136661 (0.0008) [2023-12-26 08:40:01,590][123090] Updated weights for policy 1, policy_version 1128580 (0.0008) [2023-12-26 08:40:01,591][123091] Updated weights for policy 0, policy_version 1136671 (0.0007) [2023-12-26 08:40:01,658][123090] Updated weights for policy 1, policy_version 1128590 (0.0008) [2023-12-26 08:40:01,661][123091] Updated weights for policy 0, policy_version 1136681 (0.0007) [2023-12-26 08:40:01,727][123090] Updated weights for policy 1, policy_version 1128600 (0.0008) [2023-12-26 08:40:02,427][123090] Updated weights for policy 1, policy_version 1128610 (0.0007) [2023-12-26 08:40:02,493][123090] Updated weights for policy 1, policy_version 1128620 (0.0005) [2023-12-26 08:40:02,531][123091] Updated weights for policy 0, policy_version 1136691 (0.0008) [2023-12-26 08:40:02,559][123090] Updated weights for policy 1, policy_version 1128630 (0.0009) [2023-12-26 08:40:02,578][123091] Updated weights for policy 0, policy_version 1136701 (0.0009) [2023-12-26 08:40:02,626][123090] Updated weights for policy 1, policy_version 1128640 (0.0005) [2023-12-26 08:40:02,633][123091] Updated weights for policy 0, policy_version 1136712 (0.0010) [2023-12-26 08:40:03,330][123090] Updated weights for policy 1, policy_version 1128650 (0.0007) [2023-12-26 08:40:03,392][123090] Updated weights for policy 1, policy_version 1128660 (0.0010) [2023-12-26 08:40:03,444][123090] Updated weights for policy 1, policy_version 1128671 (0.0009) [2023-12-26 08:40:03,511][123091] Updated weights for policy 0, policy_version 1136724 (0.0011) [2023-12-26 08:40:03,564][123091] Updated weights for policy 0, policy_version 1136734 (0.0010) [2023-12-26 08:40:03,619][123091] Updated weights for policy 0, policy_version 1136744 (0.0010) [2023-12-26 08:40:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 579952640. Throughput: 0: 8950.8, 1: 8642.6. Samples: 579960204. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:03,785][121949] Avg episode reward: [(0, '6320.344'), (1, '5631.139')] [2023-12-26 08:40:04,174][123090] Updated weights for policy 1, policy_version 1128681 (0.0007) [2023-12-26 08:40:04,224][123090] Updated weights for policy 1, policy_version 1128691 (0.0008) [2023-12-26 08:40:04,298][123090] Updated weights for policy 1, policy_version 1128701 (0.0006) [2023-12-26 08:40:04,498][123091] Updated weights for policy 0, policy_version 1136754 (0.0010) [2023-12-26 08:40:04,551][123091] Updated weights for policy 0, policy_version 1136764 (0.0011) [2023-12-26 08:40:04,599][123091] Updated weights for policy 0, policy_version 1136774 (0.0010) [2023-12-26 08:40:04,656][123091] Updated weights for policy 0, policy_version 1136784 (0.0010) [2023-12-26 08:40:05,070][123090] Updated weights for policy 1, policy_version 1128712 (0.0009) [2023-12-26 08:40:05,131][123090] Updated weights for policy 1, policy_version 1128723 (0.0011) [2023-12-26 08:40:05,187][123090] Updated weights for policy 1, policy_version 1128735 (0.0010) [2023-12-26 08:40:05,345][123091] Updated weights for policy 0, policy_version 1136794 (0.0005) [2023-12-26 08:40:05,404][123091] Updated weights for policy 0, policy_version 1136804 (0.0005) [2023-12-26 08:40:05,469][123091] Updated weights for policy 0, policy_version 1136814 (0.0005) [2023-12-26 08:40:06,109][123090] Updated weights for policy 1, policy_version 1128745 (0.0006) [2023-12-26 08:40:06,148][123091] Updated weights for policy 0, policy_version 1136824 (0.0010) [2023-12-26 08:40:06,172][123090] Updated weights for policy 1, policy_version 1128755 (0.0006) [2023-12-26 08:40:06,200][123091] Updated weights for policy 0, policy_version 1136834 (0.0010) [2023-12-26 08:40:06,233][123090] Updated weights for policy 1, policy_version 1128765 (0.0006) [2023-12-26 08:40:06,260][123091] Updated weights for policy 0, policy_version 1136844 (0.0011) [2023-12-26 08:40:06,967][123090] Updated weights for policy 1, policy_version 1128775 (0.0006) [2023-12-26 08:40:06,983][123091] Updated weights for policy 0, policy_version 1136854 (0.0008) [2023-12-26 08:40:07,025][123090] Updated weights for policy 1, policy_version 1128785 (0.0006) [2023-12-26 08:40:07,040][123091] Updated weights for policy 0, policy_version 1136864 (0.0005) [2023-12-26 08:40:07,084][123090] Updated weights for policy 1, policy_version 1128795 (0.0006) [2023-12-26 08:40:07,090][123091] Updated weights for policy 0, policy_version 1136874 (0.0007) [2023-12-26 08:40:07,693][123090] Updated weights for policy 1, policy_version 1128805 (0.0005) [2023-12-26 08:40:07,748][123090] Updated weights for policy 1, policy_version 1128815 (0.0006) [2023-12-26 08:40:07,805][123090] Updated weights for policy 1, policy_version 1128825 (0.0005) [2023-12-26 08:40:07,898][123091] Updated weights for policy 0, policy_version 1136884 (0.0008) [2023-12-26 08:40:07,945][123091] Updated weights for policy 0, policy_version 1136894 (0.0010) [2023-12-26 08:40:08,004][123091] Updated weights for policy 0, policy_version 1136904 (0.0010) [2023-12-26 08:40:08,655][123090] Updated weights for policy 1, policy_version 1128835 (0.0007) [2023-12-26 08:40:08,711][123090] Updated weights for policy 1, policy_version 1128846 (0.0010) [2023-12-26 08:40:08,742][123091] Updated weights for policy 0, policy_version 1136914 (0.0007) [2023-12-26 08:40:08,770][123090] Updated weights for policy 1, policy_version 1128856 (0.0006) [2023-12-26 08:40:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 580034560. Throughput: 0: 9005.8, 1: 8640.1. Samples: 580014168. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:08,785][121949] Avg episode reward: [(0, '6363.728'), (1, '5545.666')] [2023-12-26 08:40:08,812][123091] Updated weights for policy 0, policy_version 1136924 (0.0006) [2023-12-26 08:40:08,819][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001128864_288989184.pth... [2023-12-26 08:40:08,823][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001127840_288727040.pth [2023-12-26 08:40:08,872][123091] Updated weights for policy 0, policy_version 1136934 (0.0005) [2023-12-26 08:40:08,933][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001136944_291061760.pth... [2023-12-26 08:40:08,934][123091] Updated weights for policy 0, policy_version 1136944 (0.0005) [2023-12-26 08:40:08,936][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001135888_290791424.pth [2023-12-26 08:40:09,628][123090] Updated weights for policy 1, policy_version 1128866 (0.0008) [2023-12-26 08:40:09,689][123090] Updated weights for policy 1, policy_version 1128876 (0.0009) [2023-12-26 08:40:09,722][123091] Updated weights for policy 0, policy_version 1136954 (0.0010) [2023-12-26 08:40:09,755][123090] Updated weights for policy 1, policy_version 1128886 (0.0006) [2023-12-26 08:40:09,791][123091] Updated weights for policy 0, policy_version 1136964 (0.0007) [2023-12-26 08:40:09,833][123090] Updated weights for policy 1, policy_version 1128896 (0.0007) [2023-12-26 08:40:09,861][123091] Updated weights for policy 0, policy_version 1136974 (0.0010) [2023-12-26 08:40:10,578][123090] Updated weights for policy 1, policy_version 1128906 (0.0005) [2023-12-26 08:40:10,646][123090] Updated weights for policy 1, policy_version 1128916 (0.0006) [2023-12-26 08:40:10,662][123091] Updated weights for policy 0, policy_version 1136984 (0.0010) [2023-12-26 08:40:10,703][123090] Updated weights for policy 1, policy_version 1128926 (0.0005) [2023-12-26 08:40:10,725][123091] Updated weights for policy 0, policy_version 1136994 (0.0009) [2023-12-26 08:40:10,773][123091] Updated weights for policy 0, policy_version 1137004 (0.0009) [2023-12-26 08:40:11,517][123090] Updated weights for policy 1, policy_version 1128936 (0.0008) [2023-12-26 08:40:11,583][123090] Updated weights for policy 1, policy_version 1128946 (0.0009) [2023-12-26 08:40:11,665][123090] Updated weights for policy 1, policy_version 1128956 (0.0009) [2023-12-26 08:40:11,689][123091] Updated weights for policy 0, policy_version 1137014 (0.0008) [2023-12-26 08:40:11,762][123091] Updated weights for policy 0, policy_version 1137024 (0.0009) [2023-12-26 08:40:11,826][123091] Updated weights for policy 0, policy_version 1137034 (0.0009) [2023-12-26 08:40:12,463][123090] Updated weights for policy 1, policy_version 1128966 (0.0007) [2023-12-26 08:40:12,543][123090] Updated weights for policy 1, policy_version 1128976 (0.0006) [2023-12-26 08:40:12,612][123090] Updated weights for policy 1, policy_version 1128986 (0.0007) [2023-12-26 08:40:12,683][123091] Updated weights for policy 0, policy_version 1137044 (0.0010) [2023-12-26 08:40:12,750][123091] Updated weights for policy 0, policy_version 1137054 (0.0011) [2023-12-26 08:40:12,812][123091] Updated weights for policy 0, policy_version 1137064 (0.0011) [2023-12-26 08:40:13,310][123090] Updated weights for policy 1, policy_version 1128996 (0.0010) [2023-12-26 08:40:13,376][123090] Updated weights for policy 1, policy_version 1129006 (0.0010) [2023-12-26 08:40:13,437][123090] Updated weights for policy 1, policy_version 1129016 (0.0010) [2023-12-26 08:40:13,671][123091] Updated weights for policy 0, policy_version 1137074 (0.0010) [2023-12-26 08:40:13,726][123091] Updated weights for policy 0, policy_version 1137084 (0.0010) [2023-12-26 08:40:13,774][123091] Updated weights for policy 0, policy_version 1137094 (0.0010) [2023-12-26 08:40:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 580124672. Throughput: 0: 8977.4, 1: 8682.7. Samples: 580121300. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:13,785][121949] Avg episode reward: [(0, '6372.466'), (1, '5459.804')] [2023-12-26 08:40:13,818][123091] Updated weights for policy 0, policy_version 1137104 (0.0010) [2023-12-26 08:40:14,154][123090] Updated weights for policy 1, policy_version 1129026 (0.0009) [2023-12-26 08:40:14,204][123090] Updated weights for policy 1, policy_version 1129036 (0.0005) [2023-12-26 08:40:14,252][123090] Updated weights for policy 1, policy_version 1129046 (0.0006) [2023-12-26 08:40:14,304][123090] Updated weights for policy 1, policy_version 1129056 (0.0008) [2023-12-26 08:40:14,622][123091] Updated weights for policy 0, policy_version 1137114 (0.0005) [2023-12-26 08:40:14,669][123091] Updated weights for policy 0, policy_version 1137124 (0.0005) [2023-12-26 08:40:14,717][123091] Updated weights for policy 0, policy_version 1137134 (0.0006) [2023-12-26 08:40:14,959][123090] Updated weights for policy 1, policy_version 1129066 (0.0006) [2023-12-26 08:40:15,021][123090] Updated weights for policy 1, policy_version 1129076 (0.0007) [2023-12-26 08:40:15,087][123090] Updated weights for policy 1, policy_version 1129086 (0.0011) [2023-12-26 08:40:15,455][123091] Updated weights for policy 0, policy_version 1137144 (0.0008) [2023-12-26 08:40:15,540][123091] Updated weights for policy 0, policy_version 1137154 (0.0011) [2023-12-26 08:40:15,605][123091] Updated weights for policy 0, policy_version 1137164 (0.0007) [2023-12-26 08:40:15,921][123090] Updated weights for policy 1, policy_version 1129096 (0.0010) [2023-12-26 08:40:15,973][123090] Updated weights for policy 1, policy_version 1129106 (0.0010) [2023-12-26 08:40:16,024][123090] Updated weights for policy 1, policy_version 1129116 (0.0010) [2023-12-26 08:40:16,267][123091] Updated weights for policy 0, policy_version 1137174 (0.0005) [2023-12-26 08:40:16,328][123091] Updated weights for policy 0, policy_version 1137184 (0.0005) [2023-12-26 08:40:16,396][123091] Updated weights for policy 0, policy_version 1137194 (0.0005) [2023-12-26 08:40:16,863][123090] Updated weights for policy 1, policy_version 1129126 (0.0010) [2023-12-26 08:40:16,937][123090] Updated weights for policy 1, policy_version 1129136 (0.0010) [2023-12-26 08:40:16,988][123090] Updated weights for policy 1, policy_version 1129146 (0.0010) [2023-12-26 08:40:17,000][123091] Updated weights for policy 0, policy_version 1137204 (0.0006) [2023-12-26 08:40:17,061][123091] Updated weights for policy 0, policy_version 1137214 (0.0006) [2023-12-26 08:40:17,139][123091] Updated weights for policy 0, policy_version 1137224 (0.0005) [2023-12-26 08:40:17,678][123090] Updated weights for policy 1, policy_version 1129156 (0.0007) [2023-12-26 08:40:17,730][123090] Updated weights for policy 1, policy_version 1129166 (0.0005) [2023-12-26 08:40:17,731][123091] Updated weights for policy 0, policy_version 1137234 (0.0009) [2023-12-26 08:40:17,780][123091] Updated weights for policy 0, policy_version 1137244 (0.0005) [2023-12-26 08:40:17,781][123090] Updated weights for policy 1, policy_version 1129176 (0.0005) [2023-12-26 08:40:17,843][123091] Updated weights for policy 0, policy_version 1137254 (0.0005) [2023-12-26 08:40:17,894][123091] Updated weights for policy 0, policy_version 1137264 (0.0005) [2023-12-26 08:40:18,472][123090] Updated weights for policy 1, policy_version 1129186 (0.0006) [2023-12-26 08:40:18,520][123090] Updated weights for policy 1, policy_version 1129196 (0.0009) [2023-12-26 08:40:18,571][123090] Updated weights for policy 1, policy_version 1129206 (0.0010) [2023-12-26 08:40:18,628][123090] Updated weights for policy 1, policy_version 1129216 (0.0010) [2023-12-26 08:40:18,633][123091] Updated weights for policy 0, policy_version 1137274 (0.0011) [2023-12-26 08:40:18,688][123091] Updated weights for policy 0, policy_version 1137284 (0.0010) [2023-12-26 08:40:18,751][123091] Updated weights for policy 0, policy_version 1137294 (0.0010) [2023-12-26 08:40:18,784][121949] Fps is (10 sec: 19660.9, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 580231168. Throughput: 0: 8979.3, 1: 8826.1. Samples: 580235488. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:18,785][121949] Avg episode reward: [(0, '6308.721'), (1, '5477.841')] [2023-12-26 08:40:19,518][123091] Updated weights for policy 0, policy_version 1137304 (0.0009) [2023-12-26 08:40:19,529][123090] Updated weights for policy 1, policy_version 1129226 (0.0008) [2023-12-26 08:40:19,582][123091] Updated weights for policy 0, policy_version 1137314 (0.0008) [2023-12-26 08:40:19,593][123090] Updated weights for policy 1, policy_version 1129236 (0.0009) [2023-12-26 08:40:19,655][123091] Updated weights for policy 0, policy_version 1137324 (0.0007) [2023-12-26 08:40:19,663][123090] Updated weights for policy 1, policy_version 1129246 (0.0010) [2023-12-26 08:40:20,410][123091] Updated weights for policy 0, policy_version 1137334 (0.0010) [2023-12-26 08:40:20,483][123091] Updated weights for policy 0, policy_version 1137344 (0.0010) [2023-12-26 08:40:20,532][123090] Updated weights for policy 1, policy_version 1129256 (0.0007) [2023-12-26 08:40:20,546][123091] Updated weights for policy 0, policy_version 1137354 (0.0009) [2023-12-26 08:40:20,604][123090] Updated weights for policy 1, policy_version 1129266 (0.0008) [2023-12-26 08:40:20,667][123090] Updated weights for policy 1, policy_version 1129276 (0.0008) [2023-12-26 08:40:21,351][123091] Updated weights for policy 0, policy_version 1137364 (0.0010) [2023-12-26 08:40:21,423][123091] Updated weights for policy 0, policy_version 1137374 (0.0009) [2023-12-26 08:40:21,487][123090] Updated weights for policy 1, policy_version 1129286 (0.0007) [2023-12-26 08:40:21,489][123091] Updated weights for policy 0, policy_version 1137384 (0.0009) [2023-12-26 08:40:21,545][123090] Updated weights for policy 1, policy_version 1129296 (0.0007) [2023-12-26 08:40:21,606][123090] Updated weights for policy 1, policy_version 1129306 (0.0006) [2023-12-26 08:40:22,324][123091] Updated weights for policy 0, policy_version 1137394 (0.0009) [2023-12-26 08:40:22,403][123091] Updated weights for policy 0, policy_version 1137404 (0.0011) [2023-12-26 08:40:22,461][123090] Updated weights for policy 1, policy_version 1129316 (0.0007) [2023-12-26 08:40:22,467][123091] Updated weights for policy 0, policy_version 1137414 (0.0011) [2023-12-26 08:40:22,524][123090] Updated weights for policy 1, policy_version 1129326 (0.0006) [2023-12-26 08:40:22,538][123091] Updated weights for policy 0, policy_version 1137424 (0.0011) [2023-12-26 08:40:22,577][123090] Updated weights for policy 1, policy_version 1129336 (0.0006) [2023-12-26 08:40:23,279][123091] Updated weights for policy 0, policy_version 1137434 (0.0009) [2023-12-26 08:40:23,334][123091] Updated weights for policy 0, policy_version 1137444 (0.0010) [2023-12-26 08:40:23,377][123090] Updated weights for policy 1, policy_version 1129346 (0.0006) [2023-12-26 08:40:23,402][123091] Updated weights for policy 0, policy_version 1137454 (0.0010) [2023-12-26 08:40:23,445][123090] Updated weights for policy 1, policy_version 1129356 (0.0009) [2023-12-26 08:40:23,509][123090] Updated weights for policy 1, policy_version 1129366 (0.0010) [2023-12-26 08:40:23,564][123090] Updated weights for policy 1, policy_version 1129376 (0.0010) [2023-12-26 08:40:23,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 580313088. Throughput: 0: 8997.8, 1: 8800.7. Samples: 580287580. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:23,785][121949] Avg episode reward: [(0, '6311.462'), (1, '5546.254')] [2023-12-26 08:40:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001129376_289120256.pth... [2023-12-26 08:40:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001137456_291192832.pth... [2023-12-26 08:40:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001128320_288849920.pth [2023-12-26 08:40:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001136400_290922496.pth [2023-12-26 08:40:24,088][123091] Updated weights for policy 0, policy_version 1137464 (0.0005) [2023-12-26 08:40:24,162][123091] Updated weights for policy 0, policy_version 1137474 (0.0005) [2023-12-26 08:40:24,228][123091] Updated weights for policy 0, policy_version 1137484 (0.0007) [2023-12-26 08:40:24,427][123090] Updated weights for policy 1, policy_version 1129386 (0.0010) [2023-12-26 08:40:24,486][123090] Updated weights for policy 1, policy_version 1129396 (0.0010) [2023-12-26 08:40:24,545][123090] Updated weights for policy 1, policy_version 1129406 (0.0010) [2023-12-26 08:40:24,879][123091] Updated weights for policy 0, policy_version 1137494 (0.0006) [2023-12-26 08:40:24,935][123091] Updated weights for policy 0, policy_version 1137504 (0.0007) [2023-12-26 08:40:24,988][123091] Updated weights for policy 0, policy_version 1137514 (0.0010) [2023-12-26 08:40:25,394][123090] Updated weights for policy 1, policy_version 1129416 (0.0006) [2023-12-26 08:40:25,457][123090] Updated weights for policy 1, policy_version 1129426 (0.0006) [2023-12-26 08:40:25,520][123090] Updated weights for policy 1, policy_version 1129436 (0.0008) [2023-12-26 08:40:25,712][123091] Updated weights for policy 0, policy_version 1137524 (0.0007) [2023-12-26 08:40:25,772][123091] Updated weights for policy 0, policy_version 1137534 (0.0005) [2023-12-26 08:40:25,822][123091] Updated weights for policy 0, policy_version 1137544 (0.0005) [2023-12-26 08:40:26,325][123090] Updated weights for policy 1, policy_version 1129446 (0.0009) [2023-12-26 08:40:26,379][123090] Updated weights for policy 1, policy_version 1129456 (0.0009) [2023-12-26 08:40:26,447][123090] Updated weights for policy 1, policy_version 1129466 (0.0009) [2023-12-26 08:40:26,567][123091] Updated weights for policy 0, policy_version 1137554 (0.0010) [2023-12-26 08:40:26,619][123091] Updated weights for policy 0, policy_version 1137564 (0.0010) [2023-12-26 08:40:26,671][123091] Updated weights for policy 0, policy_version 1137574 (0.0010) [2023-12-26 08:40:26,726][123091] Updated weights for policy 0, policy_version 1137584 (0.0010) [2023-12-26 08:40:27,279][123090] Updated weights for policy 1, policy_version 1129476 (0.0010) [2023-12-26 08:40:27,336][123090] Updated weights for policy 1, policy_version 1129486 (0.0007) [2023-12-26 08:40:27,411][123090] Updated weights for policy 1, policy_version 1129496 (0.0006) [2023-12-26 08:40:27,558][123091] Updated weights for policy 0, policy_version 1137594 (0.0006) [2023-12-26 08:40:27,611][123091] Updated weights for policy 0, policy_version 1137604 (0.0005) [2023-12-26 08:40:27,660][123091] Updated weights for policy 0, policy_version 1137614 (0.0005) [2023-12-26 08:40:28,099][123090] Updated weights for policy 1, policy_version 1129506 (0.0005) [2023-12-26 08:40:28,154][123090] Updated weights for policy 1, policy_version 1129516 (0.0005) [2023-12-26 08:40:28,200][123090] Updated weights for policy 1, policy_version 1129526 (0.0005) [2023-12-26 08:40:28,253][123090] Updated weights for policy 1, policy_version 1129536 (0.0005) [2023-12-26 08:40:28,291][123091] Updated weights for policy 0, policy_version 1137624 (0.0005) [2023-12-26 08:40:28,355][123091] Updated weights for policy 0, policy_version 1137634 (0.0006) [2023-12-26 08:40:28,426][123091] Updated weights for policy 0, policy_version 1137644 (0.0006) [2023-12-26 08:40:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 580403200. Throughput: 0: 9100.3, 1: 8771.9. Samples: 580395376. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:28,785][121949] Avg episode reward: [(0, '6292.149'), (1, '5644.388')] [2023-12-26 08:40:28,990][123090] Updated weights for policy 1, policy_version 1129546 (0.0010) [2023-12-26 08:40:29,057][123090] Updated weights for policy 1, policy_version 1129556 (0.0010) [2023-12-26 08:40:29,085][123091] Updated weights for policy 0, policy_version 1137654 (0.0005) [2023-12-26 08:40:29,117][123090] Updated weights for policy 1, policy_version 1129566 (0.0010) [2023-12-26 08:40:29,143][123091] Updated weights for policy 0, policy_version 1137664 (0.0006) [2023-12-26 08:40:29,196][123091] Updated weights for policy 0, policy_version 1137674 (0.0005) [2023-12-26 08:40:29,858][123090] Updated weights for policy 1, policy_version 1129576 (0.0009) [2023-12-26 08:40:29,914][123090] Updated weights for policy 1, policy_version 1129586 (0.0008) [2023-12-26 08:40:29,938][123091] Updated weights for policy 0, policy_version 1137684 (0.0008) [2023-12-26 08:40:29,977][123090] Updated weights for policy 1, policy_version 1129596 (0.0008) [2023-12-26 08:40:29,989][123091] Updated weights for policy 0, policy_version 1137694 (0.0005) [2023-12-26 08:40:30,042][123091] Updated weights for policy 0, policy_version 1137704 (0.0006) [2023-12-26 08:40:30,696][123091] Updated weights for policy 0, policy_version 1137714 (0.0007) [2023-12-26 08:40:30,703][123090] Updated weights for policy 1, policy_version 1129606 (0.0009) [2023-12-26 08:40:30,747][123091] Updated weights for policy 0, policy_version 1137724 (0.0010) [2023-12-26 08:40:30,765][123090] Updated weights for policy 1, policy_version 1129616 (0.0010) [2023-12-26 08:40:30,808][123091] Updated weights for policy 0, policy_version 1137734 (0.0007) [2023-12-26 08:40:30,820][123090] Updated weights for policy 1, policy_version 1129626 (0.0008) [2023-12-26 08:40:30,872][123091] Updated weights for policy 0, policy_version 1137744 (0.0005) [2023-12-26 08:40:31,602][123091] Updated weights for policy 0, policy_version 1137754 (0.0008) [2023-12-26 08:40:31,615][123090] Updated weights for policy 1, policy_version 1129636 (0.0007) [2023-12-26 08:40:31,672][123091] Updated weights for policy 0, policy_version 1137764 (0.0007) [2023-12-26 08:40:31,682][123090] Updated weights for policy 1, policy_version 1129646 (0.0011) [2023-12-26 08:40:31,745][123091] Updated weights for policy 0, policy_version 1137774 (0.0008) [2023-12-26 08:40:31,747][123090] Updated weights for policy 1, policy_version 1129656 (0.0010) [2023-12-26 08:40:32,518][123090] Updated weights for policy 1, policy_version 1129666 (0.0008) [2023-12-26 08:40:32,562][123091] Updated weights for policy 0, policy_version 1137784 (0.0007) [2023-12-26 08:40:32,569][123090] Updated weights for policy 1, policy_version 1129676 (0.0009) [2023-12-26 08:40:32,618][123090] Updated weights for policy 1, policy_version 1129686 (0.0008) [2023-12-26 08:40:32,621][123091] Updated weights for policy 0, policy_version 1137794 (0.0009) [2023-12-26 08:40:32,667][123090] Updated weights for policy 1, policy_version 1129696 (0.0008) [2023-12-26 08:40:32,673][123091] Updated weights for policy 0, policy_version 1137804 (0.0008) [2023-12-26 08:40:33,454][123091] Updated weights for policy 0, policy_version 1137814 (0.0007) [2023-12-26 08:40:33,514][123091] Updated weights for policy 0, policy_version 1137824 (0.0007) [2023-12-26 08:40:33,555][123090] Updated weights for policy 1, policy_version 1129706 (0.0010) [2023-12-26 08:40:33,575][123091] Updated weights for policy 0, policy_version 1137834 (0.0008) [2023-12-26 08:40:33,611][123090] Updated weights for policy 1, policy_version 1129716 (0.0009) [2023-12-26 08:40:33,663][123090] Updated weights for policy 1, policy_version 1129726 (0.0010) [2023-12-26 08:40:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 580501504. Throughput: 0: 9130.1, 1: 8864.9. Samples: 580508912. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:33,785][121949] Avg episode reward: [(0, '6236.994'), (1, '5744.118')] [2023-12-26 08:40:34,243][123091] Updated weights for policy 0, policy_version 1137844 (0.0009) [2023-12-26 08:40:34,312][123091] Updated weights for policy 0, policy_version 1137854 (0.0011) [2023-12-26 08:40:34,379][123091] Updated weights for policy 0, policy_version 1137864 (0.0010) [2023-12-26 08:40:34,380][123090] Updated weights for policy 1, policy_version 1129736 (0.0008) [2023-12-26 08:40:34,441][123090] Updated weights for policy 1, policy_version 1129746 (0.0006) [2023-12-26 08:40:34,512][123090] Updated weights for policy 1, policy_version 1129756 (0.0006) [2023-12-26 08:40:35,111][123091] Updated weights for policy 0, policy_version 1137874 (0.0010) [2023-12-26 08:40:35,158][123091] Updated weights for policy 0, policy_version 1137884 (0.0010) [2023-12-26 08:40:35,206][123091] Updated weights for policy 0, policy_version 1137894 (0.0010) [2023-12-26 08:40:35,253][123091] Updated weights for policy 0, policy_version 1137904 (0.0010) [2023-12-26 08:40:35,264][123090] Updated weights for policy 1, policy_version 1129766 (0.0007) [2023-12-26 08:40:35,316][123090] Updated weights for policy 1, policy_version 1129776 (0.0009) [2023-12-26 08:40:35,369][123090] Updated weights for policy 1, policy_version 1129786 (0.0009) [2023-12-26 08:40:35,992][123091] Updated weights for policy 0, policy_version 1137914 (0.0005) [2023-12-26 08:40:36,042][123091] Updated weights for policy 0, policy_version 1137924 (0.0005) [2023-12-26 08:40:36,093][123091] Updated weights for policy 0, policy_version 1137934 (0.0006) [2023-12-26 08:40:36,136][123090] Updated weights for policy 1, policy_version 1129796 (0.0009) [2023-12-26 08:40:36,207][123090] Updated weights for policy 1, policy_version 1129806 (0.0010) [2023-12-26 08:40:36,270][123090] Updated weights for policy 1, policy_version 1129816 (0.0009) [2023-12-26 08:40:36,826][123091] Updated weights for policy 0, policy_version 1137944 (0.0010) [2023-12-26 08:40:36,888][123091] Updated weights for policy 0, policy_version 1137954 (0.0010) [2023-12-26 08:40:36,950][123091] Updated weights for policy 0, policy_version 1137964 (0.0010) [2023-12-26 08:40:37,137][123090] Updated weights for policy 1, policy_version 1129826 (0.0008) [2023-12-26 08:40:37,203][123090] Updated weights for policy 1, policy_version 1129836 (0.0009) [2023-12-26 08:40:37,273][123090] Updated weights for policy 1, policy_version 1129846 (0.0009) [2023-12-26 08:40:37,334][123090] Updated weights for policy 1, policy_version 1129856 (0.0009) [2023-12-26 08:40:37,683][123091] Updated weights for policy 0, policy_version 1137974 (0.0011) [2023-12-26 08:40:37,735][123091] Updated weights for policy 0, policy_version 1137984 (0.0011) [2023-12-26 08:40:37,795][123091] Updated weights for policy 0, policy_version 1137994 (0.0010) [2023-12-26 08:40:38,092][123090] Updated weights for policy 1, policy_version 1129866 (0.0009) [2023-12-26 08:40:38,148][123090] Updated weights for policy 1, policy_version 1129876 (0.0008) [2023-12-26 08:40:38,209][123090] Updated weights for policy 1, policy_version 1129886 (0.0010) [2023-12-26 08:40:38,584][123091] Updated weights for policy 0, policy_version 1138004 (0.0009) [2023-12-26 08:40:38,648][123091] Updated weights for policy 0, policy_version 1138014 (0.0007) [2023-12-26 08:40:38,699][123091] Updated weights for policy 0, policy_version 1138024 (0.0005) [2023-12-26 08:40:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 580591616. Throughput: 0: 9198.0, 1: 8890.9. Samples: 580565824. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:38,785][121949] Avg episode reward: [(0, '6342.614'), (1, '5824.564')] [2023-12-26 08:40:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001138032_291340288.pth... [2023-12-26 08:40:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001129888_289251328.pth... [2023-12-26 08:40:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001136944_291061760.pth [2023-12-26 08:40:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001128864_288989184.pth [2023-12-26 08:40:39,104][123090] Updated weights for policy 1, policy_version 1129896 (0.0008) [2023-12-26 08:40:39,156][123090] Updated weights for policy 1, policy_version 1129906 (0.0005) [2023-12-26 08:40:39,214][123090] Updated weights for policy 1, policy_version 1129916 (0.0005) [2023-12-26 08:40:39,427][123091] Updated weights for policy 0, policy_version 1138034 (0.0007) [2023-12-26 08:40:39,487][123091] Updated weights for policy 0, policy_version 1138044 (0.0011) [2023-12-26 08:40:39,543][123091] Updated weights for policy 0, policy_version 1138054 (0.0011) [2023-12-26 08:40:39,600][123091] Updated weights for policy 0, policy_version 1138064 (0.0011) [2023-12-26 08:40:39,999][123090] Updated weights for policy 1, policy_version 1129926 (0.0009) [2023-12-26 08:40:40,062][123090] Updated weights for policy 1, policy_version 1129936 (0.0009) [2023-12-26 08:40:40,115][123090] Updated weights for policy 1, policy_version 1129946 (0.0009) [2023-12-26 08:40:40,425][123091] Updated weights for policy 0, policy_version 1138074 (0.0006) [2023-12-26 08:40:40,494][123091] Updated weights for policy 0, policy_version 1138084 (0.0006) [2023-12-26 08:40:40,564][123091] Updated weights for policy 0, policy_version 1138094 (0.0009) [2023-12-26 08:40:41,009][123090] Updated weights for policy 1, policy_version 1129956 (0.0009) [2023-12-26 08:40:41,085][123090] Updated weights for policy 1, policy_version 1129966 (0.0008) [2023-12-26 08:40:41,159][123090] Updated weights for policy 1, policy_version 1129976 (0.0007) [2023-12-26 08:40:41,341][123091] Updated weights for policy 0, policy_version 1138104 (0.0011) [2023-12-26 08:40:41,413][123091] Updated weights for policy 0, policy_version 1138114 (0.0011) [2023-12-26 08:40:41,473][123091] Updated weights for policy 0, policy_version 1138124 (0.0011) [2023-12-26 08:40:41,943][123090] Updated weights for policy 1, policy_version 1129986 (0.0007) [2023-12-26 08:40:42,009][123090] Updated weights for policy 1, policy_version 1129996 (0.0005) [2023-12-26 08:40:42,067][123090] Updated weights for policy 1, policy_version 1130006 (0.0006) [2023-12-26 08:40:42,130][123090] Updated weights for policy 1, policy_version 1130016 (0.0006) [2023-12-26 08:40:42,334][123091] Updated weights for policy 0, policy_version 1138134 (0.0011) [2023-12-26 08:40:42,400][123091] Updated weights for policy 0, policy_version 1138144 (0.0011) [2023-12-26 08:40:42,463][123091] Updated weights for policy 0, policy_version 1138154 (0.0011) [2023-12-26 08:40:42,807][123090] Updated weights for policy 1, policy_version 1130026 (0.0006) [2023-12-26 08:40:42,870][123090] Updated weights for policy 1, policy_version 1130036 (0.0006) [2023-12-26 08:40:42,937][123090] Updated weights for policy 1, policy_version 1130046 (0.0007) [2023-12-26 08:40:43,193][123091] Updated weights for policy 0, policy_version 1138164 (0.0008) [2023-12-26 08:40:43,240][123091] Updated weights for policy 0, policy_version 1138174 (0.0005) [2023-12-26 08:40:43,291][123091] Updated weights for policy 0, policy_version 1138184 (0.0005) [2023-12-26 08:40:43,670][123090] Updated weights for policy 1, policy_version 1130056 (0.0006) [2023-12-26 08:40:43,727][123090] Updated weights for policy 1, policy_version 1130066 (0.0005) [2023-12-26 08:40:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 580673536. Throughput: 0: 9199.0, 1: 8916.0. Samples: 580670904. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:43,785][121949] Avg episode reward: [(0, '6326.196'), (1, '5692.859')] [2023-12-26 08:40:43,787][123090] Updated weights for policy 1, policy_version 1130076 (0.0005) [2023-12-26 08:40:43,937][123091] Updated weights for policy 0, policy_version 1138194 (0.0005) [2023-12-26 08:40:43,997][123091] Updated weights for policy 0, policy_version 1138204 (0.0011) [2023-12-26 08:40:44,060][123091] Updated weights for policy 0, policy_version 1138214 (0.0011) [2023-12-26 08:40:44,125][123091] Updated weights for policy 0, policy_version 1138224 (0.0007) [2023-12-26 08:40:44,442][123090] Updated weights for policy 1, policy_version 1130086 (0.0005) [2023-12-26 08:40:44,490][123090] Updated weights for policy 1, policy_version 1130096 (0.0005) [2023-12-26 08:40:44,544][123090] Updated weights for policy 1, policy_version 1130106 (0.0006) [2023-12-26 08:40:44,733][123091] Updated weights for policy 0, policy_version 1138234 (0.0005) [2023-12-26 08:40:44,797][123091] Updated weights for policy 0, policy_version 1138244 (0.0007) [2023-12-26 08:40:44,865][123091] Updated weights for policy 0, policy_version 1138254 (0.0010) [2023-12-26 08:40:45,255][123090] Updated weights for policy 1, policy_version 1130116 (0.0005) [2023-12-26 08:40:45,314][123090] Updated weights for policy 1, policy_version 1130126 (0.0006) [2023-12-26 08:40:45,380][123090] Updated weights for policy 1, policy_version 1130136 (0.0010) [2023-12-26 08:40:45,658][123091] Updated weights for policy 0, policy_version 1138264 (0.0006) [2023-12-26 08:40:45,724][123091] Updated weights for policy 0, policy_version 1138274 (0.0006) [2023-12-26 08:40:45,791][123091] Updated weights for policy 0, policy_version 1138284 (0.0010) [2023-12-26 08:40:46,216][123090] Updated weights for policy 1, policy_version 1130146 (0.0010) [2023-12-26 08:40:46,274][123090] Updated weights for policy 1, policy_version 1130156 (0.0009) [2023-12-26 08:40:46,323][123090] Updated weights for policy 1, policy_version 1130166 (0.0009) [2023-12-26 08:40:46,368][123090] Updated weights for policy 1, policy_version 1130176 (0.0010) [2023-12-26 08:40:46,572][123091] Updated weights for policy 0, policy_version 1138294 (0.0010) [2023-12-26 08:40:46,625][123091] Updated weights for policy 0, policy_version 1138304 (0.0010) [2023-12-26 08:40:46,684][123091] Updated weights for policy 0, policy_version 1138314 (0.0010) [2023-12-26 08:40:47,171][123090] Updated weights for policy 1, policy_version 1130186 (0.0010) [2023-12-26 08:40:47,223][123090] Updated weights for policy 1, policy_version 1130196 (0.0010) [2023-12-26 08:40:47,278][123090] Updated weights for policy 1, policy_version 1130206 (0.0010) [2023-12-26 08:40:47,520][123091] Updated weights for policy 0, policy_version 1138324 (0.0010) [2023-12-26 08:40:47,567][123091] Updated weights for policy 0, policy_version 1138334 (0.0010) [2023-12-26 08:40:47,618][123091] Updated weights for policy 0, policy_version 1138344 (0.0010) [2023-12-26 08:40:48,041][123090] Updated weights for policy 1, policy_version 1130216 (0.0009) [2023-12-26 08:40:48,101][123090] Updated weights for policy 1, policy_version 1130226 (0.0009) [2023-12-26 08:40:48,166][123090] Updated weights for policy 1, policy_version 1130236 (0.0009) [2023-12-26 08:40:48,476][123091] Updated weights for policy 0, policy_version 1138354 (0.0009) [2023-12-26 08:40:48,540][123091] Updated weights for policy 0, policy_version 1138364 (0.0008) [2023-12-26 08:40:48,592][123091] Updated weights for policy 0, policy_version 1138374 (0.0010) [2023-12-26 08:40:48,640][123091] Updated weights for policy 0, policy_version 1138384 (0.0010) [2023-12-26 08:40:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 580771840. Throughput: 0: 9291.6, 1: 8979.8. Samples: 580782420. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 08:40:48,785][121949] Avg episode reward: [(0, '6153.063'), (1, '5542.659')] [2023-12-26 08:40:49,026][123090] Updated weights for policy 1, policy_version 1130246 (0.0007) [2023-12-26 08:40:49,090][123090] Updated weights for policy 1, policy_version 1130256 (0.0008) [2023-12-26 08:40:49,142][123090] Updated weights for policy 1, policy_version 1130266 (0.0008) [2023-12-26 08:40:49,441][123091] Updated weights for policy 0, policy_version 1138394 (0.0006) [2023-12-26 08:40:49,509][123091] Updated weights for policy 0, policy_version 1138404 (0.0006) [2023-12-26 08:40:49,579][123091] Updated weights for policy 0, policy_version 1138414 (0.0005) [2023-12-26 08:40:49,864][123090] Updated weights for policy 1, policy_version 1130276 (0.0007) [2023-12-26 08:40:49,938][123090] Updated weights for policy 1, policy_version 1130286 (0.0008) [2023-12-26 08:40:49,989][123090] Updated weights for policy 1, policy_version 1130296 (0.0005) [2023-12-26 08:40:50,295][123091] Updated weights for policy 0, policy_version 1138424 (0.0010) [2023-12-26 08:40:50,358][123091] Updated weights for policy 0, policy_version 1138434 (0.0011) [2023-12-26 08:40:50,425][123091] Updated weights for policy 0, policy_version 1138444 (0.0011) [2023-12-26 08:40:50,724][123090] Updated weights for policy 1, policy_version 1130306 (0.0008) [2023-12-26 08:40:50,786][123090] Updated weights for policy 1, policy_version 1130316 (0.0010) [2023-12-26 08:40:50,839][123090] Updated weights for policy 1, policy_version 1130326 (0.0009) [2023-12-26 08:40:50,898][123090] Updated weights for policy 1, policy_version 1130336 (0.0009) [2023-12-26 08:40:51,228][123091] Updated weights for policy 0, policy_version 1138454 (0.0009) [2023-12-26 08:40:51,290][123091] Updated weights for policy 0, policy_version 1138464 (0.0007) [2023-12-26 08:40:51,351][123091] Updated weights for policy 0, policy_version 1138474 (0.0006) [2023-12-26 08:40:51,679][123090] Updated weights for policy 1, policy_version 1130346 (0.0009) [2023-12-26 08:40:51,751][123090] Updated weights for policy 1, policy_version 1130356 (0.0010) [2023-12-26 08:40:51,815][123090] Updated weights for policy 1, policy_version 1130366 (0.0008) [2023-12-26 08:40:52,155][123091] Updated weights for policy 0, policy_version 1138484 (0.0008) [2023-12-26 08:40:52,219][123091] Updated weights for policy 0, policy_version 1138494 (0.0006) [2023-12-26 08:40:52,291][123091] Updated weights for policy 0, policy_version 1138504 (0.0008) [2023-12-26 08:40:52,589][123090] Updated weights for policy 1, policy_version 1130376 (0.0009) [2023-12-26 08:40:52,651][123090] Updated weights for policy 1, policy_version 1130386 (0.0009) [2023-12-26 08:40:52,715][123090] Updated weights for policy 1, policy_version 1130396 (0.0009) [2023-12-26 08:40:53,032][123091] Updated weights for policy 0, policy_version 1138514 (0.0007) [2023-12-26 08:40:53,093][123091] Updated weights for policy 0, policy_version 1138524 (0.0010) [2023-12-26 08:40:53,152][123091] Updated weights for policy 0, policy_version 1138534 (0.0010) [2023-12-26 08:40:53,532][123090] Updated weights for policy 1, policy_version 1130406 (0.0009) [2023-12-26 08:40:53,598][123090] Updated weights for policy 1, policy_version 1130416 (0.0009) [2023-12-26 08:40:53,645][123090] Updated weights for policy 1, policy_version 1130426 (0.0009) [2023-12-26 08:40:53,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18159.0, 300 sec: 17828.1). Total num frames: 580861952. Throughput: 0: 9287.2, 1: 8987.6. Samples: 580836536. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:40:53,785][121949] Avg episode reward: [(0, '6223.708'), (1, '5605.393')] [2023-12-26 08:40:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001138544_291471360.pth... [2023-12-26 08:40:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001130432_289390592.pth... [2023-12-26 08:40:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001137456_291192832.pth [2023-12-26 08:40:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001129376_289120256.pth [2023-12-26 08:40:53,999][123091] Updated weights for policy 0, policy_version 1138545 (0.0010) [2023-12-26 08:40:54,056][123091] Updated weights for policy 0, policy_version 1138556 (0.0010) [2023-12-26 08:40:54,114][123091] Updated weights for policy 0, policy_version 1138566 (0.0010) [2023-12-26 08:40:54,182][123091] Updated weights for policy 0, policy_version 1138576 (0.0010) [2023-12-26 08:40:54,422][123090] Updated weights for policy 1, policy_version 1130436 (0.0008) [2023-12-26 08:40:54,474][123090] Updated weights for policy 1, policy_version 1130446 (0.0005) [2023-12-26 08:40:54,524][123090] Updated weights for policy 1, policy_version 1130456 (0.0005) [2023-12-26 08:40:55,041][123091] Updated weights for policy 0, policy_version 1138586 (0.0006) [2023-12-26 08:40:55,114][123091] Updated weights for policy 0, policy_version 1138596 (0.0008) [2023-12-26 08:40:55,179][123090] Updated weights for policy 1, policy_version 1130466 (0.0006) [2023-12-26 08:40:55,187][123091] Updated weights for policy 0, policy_version 1138606 (0.0008) [2023-12-26 08:40:55,242][123090] Updated weights for policy 1, policy_version 1130476 (0.0008) [2023-12-26 08:40:55,314][123090] Updated weights for policy 1, policy_version 1130486 (0.0010) [2023-12-26 08:40:55,388][123090] Updated weights for policy 1, policy_version 1130496 (0.0006) [2023-12-26 08:40:55,897][123091] Updated weights for policy 0, policy_version 1138616 (0.0009) [2023-12-26 08:40:55,966][123091] Updated weights for policy 0, policy_version 1138626 (0.0008) [2023-12-26 08:40:56,020][123091] Updated weights for policy 0, policy_version 1138636 (0.0010) [2023-12-26 08:40:56,138][123090] Updated weights for policy 1, policy_version 1130506 (0.0009) [2023-12-26 08:40:56,197][123090] Updated weights for policy 1, policy_version 1130516 (0.0009) [2023-12-26 08:40:56,258][123090] Updated weights for policy 1, policy_version 1130526 (0.0010) [2023-12-26 08:40:56,660][123091] Updated weights for policy 0, policy_version 1138646 (0.0007) [2023-12-26 08:40:56,716][123091] Updated weights for policy 0, policy_version 1138656 (0.0005) [2023-12-26 08:40:56,782][123091] Updated weights for policy 0, policy_version 1138666 (0.0009) [2023-12-26 08:40:57,182][123090] Updated weights for policy 1, policy_version 1130536 (0.0010) [2023-12-26 08:40:57,235][123090] Updated weights for policy 1, policy_version 1130546 (0.0009) [2023-12-26 08:40:57,289][123090] Updated weights for policy 1, policy_version 1130556 (0.0009) [2023-12-26 08:40:57,433][123091] Updated weights for policy 0, policy_version 1138676 (0.0006) [2023-12-26 08:40:57,497][123091] Updated weights for policy 0, policy_version 1138686 (0.0005) [2023-12-26 08:40:57,565][123091] Updated weights for policy 0, policy_version 1138696 (0.0005) [2023-12-26 08:40:58,223][123090] Updated weights for policy 1, policy_version 1130566 (0.0010) [2023-12-26 08:40:58,247][123091] Updated weights for policy 0, policy_version 1138706 (0.0006) [2023-12-26 08:40:58,293][123090] Updated weights for policy 1, policy_version 1130576 (0.0008) [2023-12-26 08:40:58,309][123091] Updated weights for policy 0, policy_version 1138716 (0.0007) [2023-12-26 08:40:58,370][123090] Updated weights for policy 1, policy_version 1130587 (0.0009) [2023-12-26 08:40:58,377][123091] Updated weights for policy 0, policy_version 1138726 (0.0010) [2023-12-26 08:40:58,448][123091] Updated weights for policy 0, policy_version 1138736 (0.0008) [2023-12-26 08:40:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 580952064. Throughput: 0: 9333.2, 1: 8967.7. Samples: 580944840. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:40:58,785][121949] Avg episode reward: [(0, '6335.428'), (1, '5460.009')] [2023-12-26 08:40:59,297][123090] Updated weights for policy 1, policy_version 1130597 (0.0009) [2023-12-26 08:40:59,361][123090] Updated weights for policy 1, policy_version 1130607 (0.0011) [2023-12-26 08:40:59,379][123091] Updated weights for policy 0, policy_version 1138746 (0.0010) [2023-12-26 08:40:59,430][123090] Updated weights for policy 1, policy_version 1130617 (0.0010) [2023-12-26 08:40:59,437][123091] Updated weights for policy 0, policy_version 1138756 (0.0007) [2023-12-26 08:40:59,499][123091] Updated weights for policy 0, policy_version 1138766 (0.0007) [2023-12-26 08:41:00,213][123090] Updated weights for policy 1, policy_version 1130627 (0.0010) [2023-12-26 08:41:00,273][123090] Updated weights for policy 1, policy_version 1130637 (0.0009) [2023-12-26 08:41:00,324][123090] Updated weights for policy 1, policy_version 1130647 (0.0009) [2023-12-26 08:41:00,350][123091] Updated weights for policy 0, policy_version 1138776 (0.0006) [2023-12-26 08:41:00,412][123091] Updated weights for policy 0, policy_version 1138786 (0.0007) [2023-12-26 08:41:00,489][123091] Updated weights for policy 0, policy_version 1138796 (0.0005) [2023-12-26 08:41:01,097][123090] Updated weights for policy 1, policy_version 1130657 (0.0008) [2023-12-26 08:41:01,109][123091] Updated weights for policy 0, policy_version 1138806 (0.0005) [2023-12-26 08:41:01,165][123090] Updated weights for policy 1, policy_version 1130667 (0.0011) [2023-12-26 08:41:01,179][123091] Updated weights for policy 0, policy_version 1138816 (0.0007) [2023-12-26 08:41:01,226][123090] Updated weights for policy 1, policy_version 1130677 (0.0011) [2023-12-26 08:41:01,244][123091] Updated weights for policy 0, policy_version 1138826 (0.0006) [2023-12-26 08:41:01,292][123090] Updated weights for policy 1, policy_version 1130687 (0.0010) [2023-12-26 08:41:02,033][123091] Updated weights for policy 0, policy_version 1138836 (0.0009) [2023-12-26 08:41:02,094][123091] Updated weights for policy 0, policy_version 1138846 (0.0007) [2023-12-26 08:41:02,095][123090] Updated weights for policy 1, policy_version 1130697 (0.0010) [2023-12-26 08:41:02,153][123090] Updated weights for policy 1, policy_version 1130707 (0.0010) [2023-12-26 08:41:02,157][123091] Updated weights for policy 0, policy_version 1138856 (0.0008) [2023-12-26 08:41:02,205][123090] Updated weights for policy 1, policy_version 1130717 (0.0010) [2023-12-26 08:41:02,956][123090] Updated weights for policy 1, policy_version 1130727 (0.0007) [2023-12-26 08:41:02,966][123091] Updated weights for policy 0, policy_version 1138866 (0.0006) [2023-12-26 08:41:03,023][123090] Updated weights for policy 1, policy_version 1130737 (0.0006) [2023-12-26 08:41:03,026][123091] Updated weights for policy 0, policy_version 1138876 (0.0007) [2023-12-26 08:41:03,080][123091] Updated weights for policy 0, policy_version 1138886 (0.0006) [2023-12-26 08:41:03,086][123090] Updated weights for policy 1, policy_version 1130747 (0.0006) [2023-12-26 08:41:03,135][123091] Updated weights for policy 0, policy_version 1138896 (0.0006) [2023-12-26 08:41:03,726][123090] Updated weights for policy 1, policy_version 1130757 (0.0005) [2023-12-26 08:41:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 581033984. Throughput: 0: 9238.9, 1: 8890.0. Samples: 581051292. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:03,785][121949] Avg episode reward: [(0, '6357.967'), (1, '5307.728')] [2023-12-26 08:41:03,796][123090] Updated weights for policy 1, policy_version 1130767 (0.0005) [2023-12-26 08:41:03,832][123091] Updated weights for policy 0, policy_version 1138906 (0.0009) [2023-12-26 08:41:03,859][123090] Updated weights for policy 1, policy_version 1130777 (0.0006) [2023-12-26 08:41:03,900][123091] Updated weights for policy 0, policy_version 1138916 (0.0009) [2023-12-26 08:41:03,965][123091] Updated weights for policy 0, policy_version 1138926 (0.0010) [2023-12-26 08:41:04,514][123090] Updated weights for policy 1, policy_version 1130787 (0.0006) [2023-12-26 08:41:04,569][123090] Updated weights for policy 1, policy_version 1130797 (0.0005) [2023-12-26 08:41:04,642][123090] Updated weights for policy 1, policy_version 1130807 (0.0009) [2023-12-26 08:41:04,863][123091] Updated weights for policy 0, policy_version 1138936 (0.0009) [2023-12-26 08:41:04,922][123091] Updated weights for policy 0, policy_version 1138946 (0.0009) [2023-12-26 08:41:04,985][123091] Updated weights for policy 0, policy_version 1138956 (0.0009) [2023-12-26 08:41:05,459][123090] Updated weights for policy 1, policy_version 1130817 (0.0009) [2023-12-26 08:41:05,514][123090] Updated weights for policy 1, policy_version 1130827 (0.0010) [2023-12-26 08:41:05,578][123090] Updated weights for policy 1, policy_version 1130837 (0.0011) [2023-12-26 08:41:05,642][123090] Updated weights for policy 1, policy_version 1130847 (0.0010) [2023-12-26 08:41:05,824][123091] Updated weights for policy 0, policy_version 1138966 (0.0006) [2023-12-26 08:41:05,879][123091] Updated weights for policy 0, policy_version 1138976 (0.0005) [2023-12-26 08:41:05,940][123091] Updated weights for policy 0, policy_version 1138986 (0.0007) [2023-12-26 08:41:06,423][123090] Updated weights for policy 1, policy_version 1130857 (0.0006) [2023-12-26 08:41:06,487][123090] Updated weights for policy 1, policy_version 1130867 (0.0006) [2023-12-26 08:41:06,558][123090] Updated weights for policy 1, policy_version 1130877 (0.0007) [2023-12-26 08:41:06,696][123091] Updated weights for policy 0, policy_version 1138996 (0.0010) [2023-12-26 08:41:06,748][123091] Updated weights for policy 0, policy_version 1139006 (0.0011) [2023-12-26 08:41:06,800][123091] Updated weights for policy 0, policy_version 1139016 (0.0011) [2023-12-26 08:41:07,362][123090] Updated weights for policy 1, policy_version 1130887 (0.0011) [2023-12-26 08:41:07,425][123090] Updated weights for policy 1, policy_version 1130897 (0.0010) [2023-12-26 08:41:07,475][123090] Updated weights for policy 1, policy_version 1130907 (0.0006) [2023-12-26 08:41:07,552][123091] Updated weights for policy 0, policy_version 1139026 (0.0011) [2023-12-26 08:41:07,618][123091] Updated weights for policy 0, policy_version 1139036 (0.0008) [2023-12-26 08:41:07,679][123091] Updated weights for policy 0, policy_version 1139046 (0.0005) [2023-12-26 08:41:07,735][123091] Updated weights for policy 0, policy_version 1139056 (0.0005) [2023-12-26 08:41:08,164][123090] Updated weights for policy 1, policy_version 1130917 (0.0005) [2023-12-26 08:41:08,226][123090] Updated weights for policy 1, policy_version 1130927 (0.0005) [2023-12-26 08:41:08,280][123090] Updated weights for policy 1, policy_version 1130937 (0.0006) [2023-12-26 08:41:08,431][123091] Updated weights for policy 0, policy_version 1139066 (0.0006) [2023-12-26 08:41:08,494][123091] Updated weights for policy 0, policy_version 1139076 (0.0006) [2023-12-26 08:41:08,562][123091] Updated weights for policy 0, policy_version 1139086 (0.0010) [2023-12-26 08:41:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18295.4, 300 sec: 17855.8). Total num frames: 581132288. Throughput: 0: 9212.9, 1: 8943.2. Samples: 581104604. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:08,785][121949] Avg episode reward: [(0, '6313.695'), (1, '5436.915')] [2023-12-26 08:41:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001130944_289521664.pth... [2023-12-26 08:41:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001139088_291610624.pth... [2023-12-26 08:41:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001129888_289251328.pth [2023-12-26 08:41:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001138032_291340288.pth [2023-12-26 08:41:08,978][123090] Updated weights for policy 1, policy_version 1130947 (0.0006) [2023-12-26 08:41:09,041][123090] Updated weights for policy 1, policy_version 1130957 (0.0005) [2023-12-26 08:41:09,088][123090] Updated weights for policy 1, policy_version 1130967 (0.0005) [2023-12-26 08:41:09,320][123091] Updated weights for policy 0, policy_version 1139096 (0.0011) [2023-12-26 08:41:09,397][123091] Updated weights for policy 0, policy_version 1139107 (0.0010) [2023-12-26 08:41:09,465][123091] Updated weights for policy 0, policy_version 1139117 (0.0006) [2023-12-26 08:41:09,813][123090] Updated weights for policy 1, policy_version 1130977 (0.0005) [2023-12-26 08:41:09,883][123090] Updated weights for policy 1, policy_version 1130987 (0.0009) [2023-12-26 08:41:09,952][123090] Updated weights for policy 1, policy_version 1130997 (0.0009) [2023-12-26 08:41:10,010][123090] Updated weights for policy 1, policy_version 1131007 (0.0009) [2023-12-26 08:41:10,332][123091] Updated weights for policy 0, policy_version 1139127 (0.0006) [2023-12-26 08:41:10,403][123091] Updated weights for policy 0, policy_version 1139137 (0.0007) [2023-12-26 08:41:10,469][123091] Updated weights for policy 0, policy_version 1139147 (0.0009) [2023-12-26 08:41:10,797][123090] Updated weights for policy 1, policy_version 1131017 (0.0010) [2023-12-26 08:41:10,853][123090] Updated weights for policy 1, policy_version 1131027 (0.0010) [2023-12-26 08:41:10,910][123090] Updated weights for policy 1, policy_version 1131037 (0.0009) [2023-12-26 08:41:11,237][123091] Updated weights for policy 0, policy_version 1139157 (0.0010) [2023-12-26 08:41:11,297][123091] Updated weights for policy 0, policy_version 1139167 (0.0009) [2023-12-26 08:41:11,359][123091] Updated weights for policy 0, policy_version 1139177 (0.0009) [2023-12-26 08:41:11,716][123090] Updated weights for policy 1, policy_version 1131047 (0.0007) [2023-12-26 08:41:11,791][123090] Updated weights for policy 1, policy_version 1131057 (0.0010) [2023-12-26 08:41:11,855][123090] Updated weights for policy 1, policy_version 1131067 (0.0010) [2023-12-26 08:41:12,210][123091] Updated weights for policy 0, policy_version 1139187 (0.0008) [2023-12-26 08:41:12,275][123091] Updated weights for policy 0, policy_version 1139197 (0.0009) [2023-12-26 08:41:12,346][123091] Updated weights for policy 0, policy_version 1139207 (0.0006) [2023-12-26 08:41:12,700][123090] Updated weights for policy 1, policy_version 1131077 (0.0007) [2023-12-26 08:41:12,762][123090] Updated weights for policy 1, policy_version 1131087 (0.0005) [2023-12-26 08:41:12,824][123090] Updated weights for policy 1, policy_version 1131097 (0.0006) [2023-12-26 08:41:13,193][123091] Updated weights for policy 0, policy_version 1139217 (0.0009) [2023-12-26 08:41:13,257][123091] Updated weights for policy 0, policy_version 1139227 (0.0005) [2023-12-26 08:41:13,316][123091] Updated weights for policy 0, policy_version 1139237 (0.0005) [2023-12-26 08:41:13,382][123091] Updated weights for policy 0, policy_version 1139247 (0.0008) [2023-12-26 08:41:13,502][123090] Updated weights for policy 1, policy_version 1131107 (0.0005) [2023-12-26 08:41:13,573][123090] Updated weights for policy 1, policy_version 1131117 (0.0005) [2023-12-26 08:41:13,647][123090] Updated weights for policy 1, policy_version 1131127 (0.0008) [2023-12-26 08:41:13,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18295.5, 300 sec: 17828.0). Total num frames: 581222400. Throughput: 0: 9133.3, 1: 9002.9. Samples: 581211508. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:13,784][121949] Avg episode reward: [(0, '6284.545'), (1, '5424.228')] [2023-12-26 08:41:13,988][123091] Updated weights for policy 0, policy_version 1139257 (0.0006) [2023-12-26 08:41:14,043][123091] Updated weights for policy 0, policy_version 1139267 (0.0005) [2023-12-26 08:41:14,088][123091] Updated weights for policy 0, policy_version 1139277 (0.0005) [2023-12-26 08:41:14,514][123090] Updated weights for policy 1, policy_version 1131137 (0.0010) [2023-12-26 08:41:14,581][123090] Updated weights for policy 1, policy_version 1131147 (0.0009) [2023-12-26 08:41:14,647][123090] Updated weights for policy 1, policy_version 1131157 (0.0008) [2023-12-26 08:41:14,711][123090] Updated weights for policy 1, policy_version 1131167 (0.0009) [2023-12-26 08:41:14,833][123091] Updated weights for policy 0, policy_version 1139287 (0.0009) [2023-12-26 08:41:14,892][123091] Updated weights for policy 0, policy_version 1139297 (0.0013) [2023-12-26 08:41:14,944][123091] Updated weights for policy 0, policy_version 1139307 (0.0011) [2023-12-26 08:41:15,490][123090] Updated weights for policy 1, policy_version 1131177 (0.0005) [2023-12-26 08:41:15,541][123090] Updated weights for policy 1, policy_version 1131187 (0.0006) [2023-12-26 08:41:15,588][123090] Updated weights for policy 1, policy_version 1131197 (0.0009) [2023-12-26 08:41:15,796][123091] Updated weights for policy 0, policy_version 1139317 (0.0011) [2023-12-26 08:41:15,869][123091] Updated weights for policy 0, policy_version 1139327 (0.0011) [2023-12-26 08:41:15,920][123091] Updated weights for policy 0, policy_version 1139337 (0.0010) [2023-12-26 08:41:16,333][123090] Updated weights for policy 1, policy_version 1131207 (0.0006) [2023-12-26 08:41:16,378][123090] Updated weights for policy 1, policy_version 1131217 (0.0005) [2023-12-26 08:41:16,427][123090] Updated weights for policy 1, policy_version 1131227 (0.0005) [2023-12-26 08:41:16,751][123091] Updated weights for policy 0, policy_version 1139347 (0.0010) [2023-12-26 08:41:16,800][123091] Updated weights for policy 0, policy_version 1139357 (0.0009) [2023-12-26 08:41:16,848][123091] Updated weights for policy 0, policy_version 1139367 (0.0009) [2023-12-26 08:41:17,230][123090] Updated weights for policy 1, policy_version 1131237 (0.0008) [2023-12-26 08:41:17,289][123090] Updated weights for policy 1, policy_version 1131247 (0.0010) [2023-12-26 08:41:17,347][123090] Updated weights for policy 1, policy_version 1131257 (0.0010) [2023-12-26 08:41:17,690][123091] Updated weights for policy 0, policy_version 1139377 (0.0009) [2023-12-26 08:41:17,738][123091] Updated weights for policy 0, policy_version 1139387 (0.0009) [2023-12-26 08:41:17,786][123091] Updated weights for policy 0, policy_version 1139397 (0.0009) [2023-12-26 08:41:17,843][123091] Updated weights for policy 0, policy_version 1139407 (0.0009) [2023-12-26 08:41:18,122][123090] Updated weights for policy 1, policy_version 1131267 (0.0007) [2023-12-26 08:41:18,188][123090] Updated weights for policy 1, policy_version 1131277 (0.0010) [2023-12-26 08:41:18,257][123090] Updated weights for policy 1, policy_version 1131287 (0.0006) [2023-12-26 08:41:18,727][123091] Updated weights for policy 0, policy_version 1139417 (0.0006) [2023-12-26 08:41:18,784][123091] Updated weights for policy 0, policy_version 1139427 (0.0005) [2023-12-26 08:41:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 581304320. Throughput: 0: 9039.0, 1: 8987.3. Samples: 581320092. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:18,785][121949] Avg episode reward: [(0, '6115.261'), (1, '5355.755')] [2023-12-26 08:41:18,846][123091] Updated weights for policy 0, policy_version 1139437 (0.0008) [2023-12-26 08:41:18,983][123090] Updated weights for policy 1, policy_version 1131297 (0.0009) [2023-12-26 08:41:19,047][123090] Updated weights for policy 1, policy_version 1131307 (0.0006) [2023-12-26 08:41:19,102][123090] Updated weights for policy 1, policy_version 1131317 (0.0005) [2023-12-26 08:41:19,153][123090] Updated weights for policy 1, policy_version 1131327 (0.0005) [2023-12-26 08:41:19,549][123091] Updated weights for policy 0, policy_version 1139447 (0.0009) [2023-12-26 08:41:19,616][123091] Updated weights for policy 0, policy_version 1139457 (0.0005) [2023-12-26 08:41:19,688][123091] Updated weights for policy 0, policy_version 1139467 (0.0006) [2023-12-26 08:41:19,841][123090] Updated weights for policy 1, policy_version 1131337 (0.0007) [2023-12-26 08:41:19,915][123090] Updated weights for policy 1, policy_version 1131347 (0.0008) [2023-12-26 08:41:19,989][123090] Updated weights for policy 1, policy_version 1131357 (0.0008) [2023-12-26 08:41:20,532][123091] Updated weights for policy 0, policy_version 1139477 (0.0010) [2023-12-26 08:41:20,597][123091] Updated weights for policy 0, policy_version 1139487 (0.0009) [2023-12-26 08:41:20,646][123090] Updated weights for policy 1, policy_version 1131367 (0.0008) [2023-12-26 08:41:20,652][123091] Updated weights for policy 0, policy_version 1139497 (0.0008) [2023-12-26 08:41:20,713][123090] Updated weights for policy 1, policy_version 1131377 (0.0008) [2023-12-26 08:41:20,783][123090] Updated weights for policy 1, policy_version 1131387 (0.0009) [2023-12-26 08:41:21,512][123091] Updated weights for policy 0, policy_version 1139507 (0.0009) [2023-12-26 08:41:21,566][123091] Updated weights for policy 0, policy_version 1139517 (0.0009) [2023-12-26 08:41:21,627][123091] Updated weights for policy 0, policy_version 1139527 (0.0009) [2023-12-26 08:41:21,635][123090] Updated weights for policy 1, policy_version 1131397 (0.0009) [2023-12-26 08:41:21,705][123090] Updated weights for policy 1, policy_version 1131407 (0.0008) [2023-12-26 08:41:21,775][123090] Updated weights for policy 1, policy_version 1131417 (0.0009) [2023-12-26 08:41:22,465][123091] Updated weights for policy 0, policy_version 1139537 (0.0008) [2023-12-26 08:41:22,527][123091] Updated weights for policy 0, policy_version 1139547 (0.0010) [2023-12-26 08:41:22,585][123091] Updated weights for policy 0, policy_version 1139557 (0.0009) [2023-12-26 08:41:22,647][123091] Updated weights for policy 0, policy_version 1139567 (0.0008) [2023-12-26 08:41:22,653][123090] Updated weights for policy 1, policy_version 1131427 (0.0009) [2023-12-26 08:41:22,716][123090] Updated weights for policy 1, policy_version 1131437 (0.0009) [2023-12-26 08:41:22,771][123090] Updated weights for policy 1, policy_version 1131447 (0.0009) [2023-12-26 08:41:23,412][123091] Updated weights for policy 0, policy_version 1139577 (0.0008) [2023-12-26 08:41:23,478][123091] Updated weights for policy 0, policy_version 1139587 (0.0008) [2023-12-26 08:41:23,539][123091] Updated weights for policy 0, policy_version 1139597 (0.0009) [2023-12-26 08:41:23,668][123090] Updated weights for policy 1, policy_version 1131457 (0.0009) [2023-12-26 08:41:23,741][123090] Updated weights for policy 1, policy_version 1131467 (0.0005) [2023-12-26 08:41:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 581394432. Throughput: 0: 8956.3, 1: 8984.2. Samples: 581373144. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:23,785][121949] Avg episode reward: [(0, '6074.196'), (1, '5540.676')] [2023-12-26 08:41:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001139600_291741696.pth... [2023-12-26 08:41:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001138544_291471360.pth [2023-12-26 08:41:23,803][123090] Updated weights for policy 1, policy_version 1131477 (0.0005) [2023-12-26 08:41:23,852][123090] Updated weights for policy 1, policy_version 1131487 (0.0005) [2023-12-26 08:41:23,858][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001131488_289660928.pth... [2023-12-26 08:41:23,861][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001130432_289390592.pth [2023-12-26 08:41:24,230][123091] Updated weights for policy 0, policy_version 1139607 (0.0010) [2023-12-26 08:41:24,292][123091] Updated weights for policy 0, policy_version 1139617 (0.0010) [2023-12-26 08:41:24,361][123091] Updated weights for policy 0, policy_version 1139627 (0.0010) [2023-12-26 08:41:24,538][123090] Updated weights for policy 1, policy_version 1131497 (0.0005) [2023-12-26 08:41:24,587][123090] Updated weights for policy 1, policy_version 1131507 (0.0005) [2023-12-26 08:41:24,649][123090] Updated weights for policy 1, policy_version 1131517 (0.0005) [2023-12-26 08:41:25,066][123091] Updated weights for policy 0, policy_version 1139637 (0.0008) [2023-12-26 08:41:25,111][123091] Updated weights for policy 0, policy_version 1139647 (0.0005) [2023-12-26 08:41:25,179][123091] Updated weights for policy 0, policy_version 1139657 (0.0005) [2023-12-26 08:41:25,225][123090] Updated weights for policy 1, policy_version 1131527 (0.0008) [2023-12-26 08:41:25,278][123090] Updated weights for policy 1, policy_version 1131537 (0.0009) [2023-12-26 08:41:25,340][123090] Updated weights for policy 1, policy_version 1131547 (0.0009) [2023-12-26 08:41:25,974][123091] Updated weights for policy 0, policy_version 1139667 (0.0011) [2023-12-26 08:41:26,040][123091] Updated weights for policy 0, policy_version 1139677 (0.0011) [2023-12-26 08:41:26,107][123091] Updated weights for policy 0, policy_version 1139687 (0.0011) [2023-12-26 08:41:26,164][123090] Updated weights for policy 1, policy_version 1131557 (0.0009) [2023-12-26 08:41:26,212][123090] Updated weights for policy 1, policy_version 1131567 (0.0008) [2023-12-26 08:41:26,267][123090] Updated weights for policy 1, policy_version 1131577 (0.0008) [2023-12-26 08:41:26,831][123091] Updated weights for policy 0, policy_version 1139697 (0.0011) [2023-12-26 08:41:26,885][123091] Updated weights for policy 0, policy_version 1139707 (0.0010) [2023-12-26 08:41:26,928][123091] Updated weights for policy 0, policy_version 1139717 (0.0010) [2023-12-26 08:41:26,979][123091] Updated weights for policy 0, policy_version 1139727 (0.0010) [2023-12-26 08:41:27,144][123090] Updated weights for policy 1, policy_version 1131587 (0.0006) [2023-12-26 08:41:27,196][123090] Updated weights for policy 1, policy_version 1131597 (0.0009) [2023-12-26 08:41:27,261][123090] Updated weights for policy 1, policy_version 1131607 (0.0009) [2023-12-26 08:41:27,797][123091] Updated weights for policy 0, policy_version 1139737 (0.0006) [2023-12-26 08:41:27,853][123091] Updated weights for policy 0, policy_version 1139747 (0.0005) [2023-12-26 08:41:27,904][123091] Updated weights for policy 0, policy_version 1139757 (0.0005) [2023-12-26 08:41:28,025][123090] Updated weights for policy 1, policy_version 1131617 (0.0009) [2023-12-26 08:41:28,095][123090] Updated weights for policy 1, policy_version 1131627 (0.0005) [2023-12-26 08:41:28,170][123090] Updated weights for policy 1, policy_version 1131637 (0.0008) [2023-12-26 08:41:28,239][123090] Updated weights for policy 1, policy_version 1131647 (0.0010) [2023-12-26 08:41:28,736][123091] Updated weights for policy 0, policy_version 1139767 (0.0006) [2023-12-26 08:41:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 581484544. Throughput: 0: 9003.8, 1: 9005.4. Samples: 581481312. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:28,784][121949] Avg episode reward: [(0, '6149.348'), (1, '5735.375')] [2023-12-26 08:41:28,790][123091] Updated weights for policy 0, policy_version 1139777 (0.0010) [2023-12-26 08:41:28,851][123091] Updated weights for policy 0, policy_version 1139787 (0.0010) [2023-12-26 08:41:28,960][123090] Updated weights for policy 1, policy_version 1131657 (0.0006) [2023-12-26 08:41:29,024][123090] Updated weights for policy 1, policy_version 1131667 (0.0007) [2023-12-26 08:41:29,089][123090] Updated weights for policy 1, policy_version 1131677 (0.0009) [2023-12-26 08:41:29,801][123091] Updated weights for policy 0, policy_version 1139797 (0.0009) [2023-12-26 08:41:29,841][123090] Updated weights for policy 1, policy_version 1131687 (0.0006) [2023-12-26 08:41:29,868][123091] Updated weights for policy 0, policy_version 1139807 (0.0008) [2023-12-26 08:41:29,912][123090] Updated weights for policy 1, policy_version 1131697 (0.0010) [2023-12-26 08:41:29,938][123091] Updated weights for policy 0, policy_version 1139817 (0.0008) [2023-12-26 08:41:29,977][123090] Updated weights for policy 1, policy_version 1131707 (0.0010) [2023-12-26 08:41:30,706][123091] Updated weights for policy 0, policy_version 1139827 (0.0008) [2023-12-26 08:41:30,759][123091] Updated weights for policy 0, policy_version 1139837 (0.0009) [2023-12-26 08:41:30,786][123090] Updated weights for policy 1, policy_version 1131717 (0.0010) [2023-12-26 08:41:30,804][123091] Updated weights for policy 0, policy_version 1139847 (0.0009) [2023-12-26 08:41:30,836][123090] Updated weights for policy 1, policy_version 1131727 (0.0010) [2023-12-26 08:41:30,901][123090] Updated weights for policy 1, policy_version 1131737 (0.0010) [2023-12-26 08:41:31,624][123091] Updated weights for policy 0, policy_version 1139857 (0.0006) [2023-12-26 08:41:31,678][123091] Updated weights for policy 0, policy_version 1139867 (0.0009) [2023-12-26 08:41:31,715][123090] Updated weights for policy 1, policy_version 1131747 (0.0010) [2023-12-26 08:41:31,745][123091] Updated weights for policy 0, policy_version 1139877 (0.0009) [2023-12-26 08:41:31,777][123090] Updated weights for policy 1, policy_version 1131757 (0.0008) [2023-12-26 08:41:31,798][123091] Updated weights for policy 0, policy_version 1139887 (0.0007) [2023-12-26 08:41:31,835][123090] Updated weights for policy 1, policy_version 1131767 (0.0008) [2023-12-26 08:41:32,560][123091] Updated weights for policy 0, policy_version 1139897 (0.0009) [2023-12-26 08:41:32,611][123091] Updated weights for policy 0, policy_version 1139907 (0.0007) [2023-12-26 08:41:32,624][123090] Updated weights for policy 1, policy_version 1131777 (0.0008) [2023-12-26 08:41:32,659][123091] Updated weights for policy 0, policy_version 1139917 (0.0005) [2023-12-26 08:41:32,679][123090] Updated weights for policy 1, policy_version 1131787 (0.0010) [2023-12-26 08:41:32,730][123090] Updated weights for policy 1, policy_version 1131797 (0.0010) [2023-12-26 08:41:32,788][123090] Updated weights for policy 1, policy_version 1131807 (0.0010) [2023-12-26 08:41:33,418][123091] Updated weights for policy 0, policy_version 1139927 (0.0008) [2023-12-26 08:41:33,470][123091] Updated weights for policy 0, policy_version 1139937 (0.0009) [2023-12-26 08:41:33,526][123091] Updated weights for policy 0, policy_version 1139947 (0.0009) [2023-12-26 08:41:33,622][123090] Updated weights for policy 1, policy_version 1131817 (0.0010) [2023-12-26 08:41:33,682][123090] Updated weights for policy 1, policy_version 1131827 (0.0010) [2023-12-26 08:41:33,747][123090] Updated weights for policy 1, policy_version 1131837 (0.0010) [2023-12-26 08:41:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 581582848. Throughput: 0: 8920.7, 1: 8968.3. Samples: 581587420. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:33,784][121949] Avg episode reward: [(0, '6212.268'), (1, '5635.524')] [2023-12-26 08:41:34,304][123091] Updated weights for policy 0, policy_version 1139957 (0.0009) [2023-12-26 08:41:34,368][123091] Updated weights for policy 0, policy_version 1139967 (0.0011) [2023-12-26 08:41:34,431][123091] Updated weights for policy 0, policy_version 1139977 (0.0009) [2023-12-26 08:41:34,484][123090] Updated weights for policy 1, policy_version 1131847 (0.0010) [2023-12-26 08:41:34,546][123090] Updated weights for policy 1, policy_version 1131857 (0.0010) [2023-12-26 08:41:34,613][123090] Updated weights for policy 1, policy_version 1131867 (0.0010) [2023-12-26 08:41:35,181][123091] Updated weights for policy 0, policy_version 1139987 (0.0009) [2023-12-26 08:41:35,231][123091] Updated weights for policy 0, policy_version 1139997 (0.0010) [2023-12-26 08:41:35,282][123091] Updated weights for policy 0, policy_version 1140007 (0.0010) [2023-12-26 08:41:35,422][123090] Updated weights for policy 1, policy_version 1131877 (0.0010) [2023-12-26 08:41:35,484][123090] Updated weights for policy 1, policy_version 1131887 (0.0006) [2023-12-26 08:41:35,544][123090] Updated weights for policy 1, policy_version 1131897 (0.0010) [2023-12-26 08:41:36,017][123091] Updated weights for policy 0, policy_version 1140017 (0.0010) [2023-12-26 08:41:36,073][123091] Updated weights for policy 0, policy_version 1140027 (0.0006) [2023-12-26 08:41:36,136][123091] Updated weights for policy 0, policy_version 1140037 (0.0007) [2023-12-26 08:41:36,208][123091] Updated weights for policy 0, policy_version 1140047 (0.0006) [2023-12-26 08:41:36,373][123090] Updated weights for policy 1, policy_version 1131907 (0.0010) [2023-12-26 08:41:36,437][123090] Updated weights for policy 1, policy_version 1131917 (0.0008) [2023-12-26 08:41:36,512][123090] Updated weights for policy 1, policy_version 1131927 (0.0007) [2023-12-26 08:41:36,958][123091] Updated weights for policy 0, policy_version 1140057 (0.0010) [2023-12-26 08:41:37,011][123091] Updated weights for policy 0, policy_version 1140067 (0.0007) [2023-12-26 08:41:37,071][123091] Updated weights for policy 0, policy_version 1140077 (0.0006) [2023-12-26 08:41:37,313][123090] Updated weights for policy 1, policy_version 1131937 (0.0006) [2023-12-26 08:41:37,389][123090] Updated weights for policy 1, policy_version 1131947 (0.0009) [2023-12-26 08:41:37,453][123090] Updated weights for policy 1, policy_version 1131957 (0.0006) [2023-12-26 08:41:37,519][123090] Updated weights for policy 1, policy_version 1131967 (0.0007) [2023-12-26 08:41:37,841][123091] Updated weights for policy 0, policy_version 1140087 (0.0010) [2023-12-26 08:41:37,904][123091] Updated weights for policy 0, policy_version 1140097 (0.0011) [2023-12-26 08:41:37,976][123091] Updated weights for policy 0, policy_version 1140107 (0.0011) [2023-12-26 08:41:38,200][123090] Updated weights for policy 1, policy_version 1131977 (0.0009) [2023-12-26 08:41:38,259][123090] Updated weights for policy 1, policy_version 1131987 (0.0009) [2023-12-26 08:41:38,317][123090] Updated weights for policy 1, policy_version 1131997 (0.0010) [2023-12-26 08:41:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 581664768. Throughput: 0: 8949.3, 1: 8949.1. Samples: 581641968. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:38,785][121949] Avg episode reward: [(0, '6227.178'), (1, '5658.894')] [2023-12-26 08:41:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001132000_289792000.pth... [2023-12-26 08:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001130944_289521664.pth [2023-12-26 08:41:38,816][123091] Updated weights for policy 0, policy_version 1140117 (0.0011) [2023-12-26 08:41:38,871][123091] Updated weights for policy 0, policy_version 1140127 (0.0010) [2023-12-26 08:41:38,925][123091] Updated weights for policy 0, policy_version 1140137 (0.0010) [2023-12-26 08:41:38,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001140144_291880960.pth... [2023-12-26 08:41:38,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001139088_291610624.pth [2023-12-26 08:41:39,205][123090] Updated weights for policy 1, policy_version 1132007 (0.0010) [2023-12-26 08:41:39,270][123090] Updated weights for policy 1, policy_version 1132017 (0.0010) [2023-12-26 08:41:39,327][123090] Updated weights for policy 1, policy_version 1132027 (0.0009) [2023-12-26 08:41:39,664][123091] Updated weights for policy 0, policy_version 1140147 (0.0006) [2023-12-26 08:41:39,730][123091] Updated weights for policy 0, policy_version 1140157 (0.0007) [2023-12-26 08:41:39,798][123091] Updated weights for policy 0, policy_version 1140167 (0.0007) [2023-12-26 08:41:40,231][123090] Updated weights for policy 1, policy_version 1132037 (0.0009) [2023-12-26 08:41:40,284][123090] Updated weights for policy 1, policy_version 1132047 (0.0009) [2023-12-26 08:41:40,336][123090] Updated weights for policy 1, policy_version 1132057 (0.0010) [2023-12-26 08:41:40,576][123091] Updated weights for policy 0, policy_version 1140177 (0.0008) [2023-12-26 08:41:40,637][123091] Updated weights for policy 0, policy_version 1140187 (0.0009) [2023-12-26 08:41:40,694][123091] Updated weights for policy 0, policy_version 1140197 (0.0006) [2023-12-26 08:41:40,744][123091] Updated weights for policy 0, policy_version 1140207 (0.0009) [2023-12-26 08:41:41,228][123090] Updated weights for policy 1, policy_version 1132067 (0.0009) [2023-12-26 08:41:41,294][123090] Updated weights for policy 1, policy_version 1132077 (0.0009) [2023-12-26 08:41:41,367][123090] Updated weights for policy 1, policy_version 1132087 (0.0009) [2023-12-26 08:41:41,600][123091] Updated weights for policy 0, policy_version 1140217 (0.0009) [2023-12-26 08:41:41,672][123091] Updated weights for policy 0, policy_version 1140227 (0.0009) [2023-12-26 08:41:41,732][123091] Updated weights for policy 0, policy_version 1140237 (0.0009) [2023-12-26 08:41:42,279][123090] Updated weights for policy 1, policy_version 1132097 (0.0009) [2023-12-26 08:41:42,345][123090] Updated weights for policy 1, policy_version 1132107 (0.0009) [2023-12-26 08:41:42,412][123090] Updated weights for policy 1, policy_version 1132117 (0.0009) [2023-12-26 08:41:42,467][123090] Updated weights for policy 1, policy_version 1132127 (0.0009) [2023-12-26 08:41:42,527][123091] Updated weights for policy 0, policy_version 1140247 (0.0008) [2023-12-26 08:41:42,593][123091] Updated weights for policy 0, policy_version 1140257 (0.0009) [2023-12-26 08:41:42,647][123091] Updated weights for policy 0, policy_version 1140267 (0.0009) [2023-12-26 08:41:43,248][123090] Updated weights for policy 1, policy_version 1132137 (0.0010) [2023-12-26 08:41:43,311][123090] Updated weights for policy 1, policy_version 1132147 (0.0009) [2023-12-26 08:41:43,373][123090] Updated weights for policy 1, policy_version 1132157 (0.0008) [2023-12-26 08:41:43,487][123091] Updated weights for policy 0, policy_version 1140277 (0.0010) [2023-12-26 08:41:43,534][123091] Updated weights for policy 0, policy_version 1140287 (0.0009) [2023-12-26 08:41:43,590][123091] Updated weights for policy 0, policy_version 1140297 (0.0009) [2023-12-26 08:41:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 581754880. Throughput: 0: 8899.4, 1: 8877.9. Samples: 581744816. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:43,785][121949] Avg episode reward: [(0, '6162.071'), (1, '5632.994')] [2023-12-26 08:41:44,154][123090] Updated weights for policy 1, policy_version 1132168 (0.0010) [2023-12-26 08:41:44,216][123090] Updated weights for policy 1, policy_version 1132178 (0.0009) [2023-12-26 08:41:44,273][123090] Updated weights for policy 1, policy_version 1132188 (0.0009) [2023-12-26 08:41:44,362][123091] Updated weights for policy 0, policy_version 1140307 (0.0009) [2023-12-26 08:41:44,431][123091] Updated weights for policy 0, policy_version 1140317 (0.0005) [2023-12-26 08:41:44,496][123091] Updated weights for policy 0, policy_version 1140327 (0.0006) [2023-12-26 08:41:45,203][123091] Updated weights for policy 0, policy_version 1140337 (0.0009) [2023-12-26 08:41:45,210][123090] Updated weights for policy 1, policy_version 1132198 (0.0009) [2023-12-26 08:41:45,258][123091] Updated weights for policy 0, policy_version 1140347 (0.0007) [2023-12-26 08:41:45,280][123090] Updated weights for policy 1, policy_version 1132208 (0.0009) [2023-12-26 08:41:45,319][123091] Updated weights for policy 0, policy_version 1140357 (0.0007) [2023-12-26 08:41:45,343][123090] Updated weights for policy 1, policy_version 1132218 (0.0008) [2023-12-26 08:41:45,379][123091] Updated weights for policy 0, policy_version 1140367 (0.0011) [2023-12-26 08:41:46,065][123091] Updated weights for policy 0, policy_version 1140377 (0.0006) [2023-12-26 08:41:46,127][123091] Updated weights for policy 0, policy_version 1140387 (0.0005) [2023-12-26 08:41:46,180][123091] Updated weights for policy 0, policy_version 1140397 (0.0005) [2023-12-26 08:41:46,291][123090] Updated weights for policy 1, policy_version 1132228 (0.0009) [2023-12-26 08:41:46,353][123090] Updated weights for policy 1, policy_version 1132238 (0.0010) [2023-12-26 08:41:46,417][123090] Updated weights for policy 1, policy_version 1132248 (0.0010) [2023-12-26 08:41:46,852][123091] Updated weights for policy 0, policy_version 1140407 (0.0007) [2023-12-26 08:41:46,904][123091] Updated weights for policy 0, policy_version 1140417 (0.0010) [2023-12-26 08:41:46,952][123091] Updated weights for policy 0, policy_version 1140427 (0.0010) [2023-12-26 08:41:47,148][123090] Updated weights for policy 1, policy_version 1132258 (0.0007) [2023-12-26 08:41:47,200][123090] Updated weights for policy 1, policy_version 1132269 (0.0009) [2023-12-26 08:41:47,250][123090] Updated weights for policy 1, policy_version 1132279 (0.0005) [2023-12-26 08:41:47,690][123091] Updated weights for policy 0, policy_version 1140437 (0.0008) [2023-12-26 08:41:47,750][123091] Updated weights for policy 0, policy_version 1140447 (0.0005) [2023-12-26 08:41:47,799][123091] Updated weights for policy 0, policy_version 1140457 (0.0005) [2023-12-26 08:41:48,058][123090] Updated weights for policy 1, policy_version 1132289 (0.0005) [2023-12-26 08:41:48,112][123090] Updated weights for policy 1, policy_version 1132299 (0.0005) [2023-12-26 08:41:48,171][123090] Updated weights for policy 1, policy_version 1132309 (0.0005) [2023-12-26 08:41:48,229][123090] Updated weights for policy 1, policy_version 1132319 (0.0005) [2023-12-26 08:41:48,560][123091] Updated weights for policy 0, policy_version 1140467 (0.0007) [2023-12-26 08:41:48,616][123091] Updated weights for policy 0, policy_version 1140477 (0.0011) [2023-12-26 08:41:48,679][123091] Updated weights for policy 0, policy_version 1140487 (0.0011) [2023-12-26 08:41:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 581844992. Throughput: 0: 9001.1, 1: 8860.8. Samples: 581855076. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:48,785][121949] Avg episode reward: [(0, '6254.250'), (1, '5599.447')] [2023-12-26 08:41:48,982][123090] Updated weights for policy 1, policy_version 1132329 (0.0009) [2023-12-26 08:41:49,034][123090] Updated weights for policy 1, policy_version 1132339 (0.0009) [2023-12-26 08:41:49,089][123090] Updated weights for policy 1, policy_version 1132349 (0.0010) [2023-12-26 08:41:49,508][123091] Updated weights for policy 0, policy_version 1140497 (0.0009) [2023-12-26 08:41:49,569][123091] Updated weights for policy 0, policy_version 1140507 (0.0010) [2023-12-26 08:41:49,626][123091] Updated weights for policy 0, policy_version 1140517 (0.0010) [2023-12-26 08:41:49,686][123091] Updated weights for policy 0, policy_version 1140527 (0.0009) [2023-12-26 08:41:49,824][123090] Updated weights for policy 1, policy_version 1132359 (0.0009) [2023-12-26 08:41:49,892][123090] Updated weights for policy 1, policy_version 1132369 (0.0009) [2023-12-26 08:41:49,960][123090] Updated weights for policy 1, policy_version 1132379 (0.0007) [2023-12-26 08:41:50,540][123091] Updated weights for policy 0, policy_version 1140537 (0.0010) [2023-12-26 08:41:50,603][123091] Updated weights for policy 0, policy_version 1140547 (0.0010) [2023-12-26 08:41:50,667][123091] Updated weights for policy 0, policy_version 1140557 (0.0009) [2023-12-26 08:41:50,700][123090] Updated weights for policy 1, policy_version 1132389 (0.0008) [2023-12-26 08:41:50,766][123090] Updated weights for policy 1, policy_version 1132400 (0.0009) [2023-12-26 08:41:50,843][123090] Updated weights for policy 1, policy_version 1132410 (0.0007) [2023-12-26 08:41:51,497][123091] Updated weights for policy 0, policy_version 1140567 (0.0007) [2023-12-26 08:41:51,569][123091] Updated weights for policy 0, policy_version 1140577 (0.0005) [2023-12-26 08:41:51,622][123090] Updated weights for policy 1, policy_version 1132420 (0.0007) [2023-12-26 08:41:51,642][123091] Updated weights for policy 0, policy_version 1140587 (0.0006) [2023-12-26 08:41:51,691][123090] Updated weights for policy 1, policy_version 1132430 (0.0010) [2023-12-26 08:41:51,760][123090] Updated weights for policy 1, policy_version 1132440 (0.0009) [2023-12-26 08:41:52,359][123091] Updated weights for policy 0, policy_version 1140597 (0.0008) [2023-12-26 08:41:52,423][123091] Updated weights for policy 0, policy_version 1140607 (0.0008) [2023-12-26 08:41:52,490][123091] Updated weights for policy 0, policy_version 1140617 (0.0009) [2023-12-26 08:41:52,676][123090] Updated weights for policy 1, policy_version 1132451 (0.0009) [2023-12-26 08:41:52,740][123090] Updated weights for policy 1, policy_version 1132461 (0.0006) [2023-12-26 08:41:52,798][123090] Updated weights for policy 1, policy_version 1132471 (0.0006) [2023-12-26 08:41:53,344][123091] Updated weights for policy 0, policy_version 1140627 (0.0009) [2023-12-26 08:41:53,402][123091] Updated weights for policy 0, policy_version 1140637 (0.0009) [2023-12-26 08:41:53,465][123091] Updated weights for policy 0, policy_version 1140647 (0.0009) [2023-12-26 08:41:53,591][123090] Updated weights for policy 1, policy_version 1132481 (0.0008) [2023-12-26 08:41:53,665][123090] Updated weights for policy 1, policy_version 1132491 (0.0006) [2023-12-26 08:41:53,735][123090] Updated weights for policy 1, policy_version 1132501 (0.0005) [2023-12-26 08:41:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 581926912. Throughput: 0: 8993.0, 1: 8857.0. Samples: 581907852. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:53,785][121949] Avg episode reward: [(0, '6335.866'), (1, '5590.045')] [2023-12-26 08:41:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001140656_292012032.pth... [2023-12-26 08:41:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001139600_291741696.pth [2023-12-26 08:41:53,797][123090] Updated weights for policy 1, policy_version 1132511 (0.0005) [2023-12-26 08:41:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001132512_289923072.pth... [2023-12-26 08:41:53,807][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001131488_289660928.pth [2023-12-26 08:41:54,303][123091] Updated weights for policy 0, policy_version 1140657 (0.0009) [2023-12-26 08:41:54,367][123091] Updated weights for policy 0, policy_version 1140667 (0.0007) [2023-12-26 08:41:54,388][123090] Updated weights for policy 1, policy_version 1132521 (0.0010) [2023-12-26 08:41:54,433][123091] Updated weights for policy 0, policy_version 1140677 (0.0009) [2023-12-26 08:41:54,459][123090] Updated weights for policy 1, policy_version 1132531 (0.0010) [2023-12-26 08:41:54,499][123091] Updated weights for policy 0, policy_version 1140687 (0.0006) [2023-12-26 08:41:54,523][123090] Updated weights for policy 1, policy_version 1132541 (0.0010) [2023-12-26 08:41:55,189][123090] Updated weights for policy 1, policy_version 1132551 (0.0005) [2023-12-26 08:41:55,248][123090] Updated weights for policy 1, policy_version 1132561 (0.0005) [2023-12-26 08:41:55,307][123090] Updated weights for policy 1, policy_version 1132571 (0.0006) [2023-12-26 08:41:55,327][123091] Updated weights for policy 0, policy_version 1140697 (0.0007) [2023-12-26 08:41:55,378][123091] Updated weights for policy 0, policy_version 1140707 (0.0009) [2023-12-26 08:41:55,434][123091] Updated weights for policy 0, policy_version 1140717 (0.0009) [2023-12-26 08:41:56,120][123090] Updated weights for policy 1, policy_version 1132581 (0.0010) [2023-12-26 08:41:56,203][123090] Updated weights for policy 1, policy_version 1132591 (0.0011) [2023-12-26 08:41:56,241][123091] Updated weights for policy 0, policy_version 1140727 (0.0007) [2023-12-26 08:41:56,267][123090] Updated weights for policy 1, policy_version 1132601 (0.0010) [2023-12-26 08:41:56,308][123091] Updated weights for policy 0, policy_version 1140737 (0.0007) [2023-12-26 08:41:56,369][123091] Updated weights for policy 0, policy_version 1140747 (0.0010) [2023-12-26 08:41:56,973][123090] Updated weights for policy 1, policy_version 1132611 (0.0010) [2023-12-26 08:41:57,039][123090] Updated weights for policy 1, policy_version 1132621 (0.0010) [2023-12-26 08:41:57,087][123090] Updated weights for policy 1, policy_version 1132631 (0.0010) [2023-12-26 08:41:57,120][123091] Updated weights for policy 0, policy_version 1140757 (0.0009) [2023-12-26 08:41:57,176][123091] Updated weights for policy 0, policy_version 1140767 (0.0009) [2023-12-26 08:41:57,230][123091] Updated weights for policy 0, policy_version 1140777 (0.0009) [2023-12-26 08:41:57,764][123090] Updated weights for policy 1, policy_version 1132641 (0.0010) [2023-12-26 08:41:57,824][123090] Updated weights for policy 1, policy_version 1132651 (0.0005) [2023-12-26 08:41:57,873][123090] Updated weights for policy 1, policy_version 1132661 (0.0005) [2023-12-26 08:41:57,920][123090] Updated weights for policy 1, policy_version 1132671 (0.0005) [2023-12-26 08:41:58,130][123091] Updated weights for policy 0, policy_version 1140787 (0.0009) [2023-12-26 08:41:58,197][123091] Updated weights for policy 0, policy_version 1140797 (0.0008) [2023-12-26 08:41:58,267][123091] Updated weights for policy 0, policy_version 1140807 (0.0008) [2023-12-26 08:41:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 582017024. Throughput: 0: 8955.7, 1: 8912.5. Samples: 582015580. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:41:58,785][121949] Avg episode reward: [(0, '6331.152'), (1, '5682.491')] [2023-12-26 08:41:58,848][123090] Updated weights for policy 1, policy_version 1132681 (0.0008) [2023-12-26 08:41:58,917][123090] Updated weights for policy 1, policy_version 1132691 (0.0008) [2023-12-26 08:41:58,983][123090] Updated weights for policy 1, policy_version 1132701 (0.0008) [2023-12-26 08:41:59,094][123091] Updated weights for policy 0, policy_version 1140817 (0.0008) [2023-12-26 08:41:59,165][123091] Updated weights for policy 0, policy_version 1140827 (0.0008) [2023-12-26 08:41:59,224][123091] Updated weights for policy 0, policy_version 1140837 (0.0008) [2023-12-26 08:41:59,300][123091] Updated weights for policy 0, policy_version 1140847 (0.0008) [2023-12-26 08:41:59,794][123090] Updated weights for policy 1, policy_version 1132711 (0.0008) [2023-12-26 08:41:59,865][123090] Updated weights for policy 1, policy_version 1132721 (0.0007) [2023-12-26 08:41:59,929][123090] Updated weights for policy 1, policy_version 1132731 (0.0010) [2023-12-26 08:42:00,088][123091] Updated weights for policy 0, policy_version 1140857 (0.0008) [2023-12-26 08:42:00,150][123091] Updated weights for policy 0, policy_version 1140867 (0.0008) [2023-12-26 08:42:00,204][123091] Updated weights for policy 0, policy_version 1140877 (0.0007) [2023-12-26 08:42:00,812][123090] Updated weights for policy 1, policy_version 1132741 (0.0009) [2023-12-26 08:42:00,822][123091] Updated weights for policy 0, policy_version 1140887 (0.0005) [2023-12-26 08:42:00,867][123090] Updated weights for policy 1, policy_version 1132751 (0.0008) [2023-12-26 08:42:00,873][123091] Updated weights for policy 0, policy_version 1140897 (0.0007) [2023-12-26 08:42:00,921][123091] Updated weights for policy 0, policy_version 1140907 (0.0007) [2023-12-26 08:42:00,923][123090] Updated weights for policy 1, policy_version 1132761 (0.0008) [2023-12-26 08:42:01,797][123090] Updated weights for policy 1, policy_version 1132771 (0.0009) [2023-12-26 08:42:01,803][123091] Updated weights for policy 0, policy_version 1140917 (0.0007) [2023-12-26 08:42:01,851][123090] Updated weights for policy 1, policy_version 1132781 (0.0009) [2023-12-26 08:42:01,862][123091] Updated weights for policy 0, policy_version 1140927 (0.0009) [2023-12-26 08:42:01,911][123091] Updated weights for policy 0, policy_version 1140937 (0.0009) [2023-12-26 08:42:01,913][123090] Updated weights for policy 1, policy_version 1132791 (0.0009) [2023-12-26 08:42:02,696][123091] Updated weights for policy 0, policy_version 1140947 (0.0008) [2023-12-26 08:42:02,753][123091] Updated weights for policy 0, policy_version 1140957 (0.0006) [2023-12-26 08:42:02,760][123090] Updated weights for policy 1, policy_version 1132801 (0.0009) [2023-12-26 08:42:02,819][123091] Updated weights for policy 0, policy_version 1140967 (0.0009) [2023-12-26 08:42:02,824][123090] Updated weights for policy 1, policy_version 1132811 (0.0011) [2023-12-26 08:42:02,883][123090] Updated weights for policy 1, policy_version 1132821 (0.0010) [2023-12-26 08:42:02,946][123090] Updated weights for policy 1, policy_version 1132831 (0.0007) [2023-12-26 08:42:03,594][123091] Updated weights for policy 0, policy_version 1140977 (0.0011) [2023-12-26 08:42:03,611][123090] Updated weights for policy 1, policy_version 1132841 (0.0005) [2023-12-26 08:42:03,650][123091] Updated weights for policy 0, policy_version 1140987 (0.0010) [2023-12-26 08:42:03,666][123090] Updated weights for policy 1, policy_version 1132851 (0.0005) [2023-12-26 08:42:03,697][123091] Updated weights for policy 0, policy_version 1140997 (0.0010) [2023-12-26 08:42:03,714][123090] Updated weights for policy 1, policy_version 1132861 (0.0010) [2023-12-26 08:42:03,744][123091] Updated weights for policy 0, policy_version 1141007 (0.0010) [2023-12-26 08:42:03,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 582115328. Throughput: 0: 8948.4, 1: 8832.0. Samples: 582120216. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:03,785][121949] Avg episode reward: [(0, '6291.836'), (1, '5743.196')] [2023-12-26 08:42:04,489][123090] Updated weights for policy 1, policy_version 1132871 (0.0007) [2023-12-26 08:42:04,494][123091] Updated weights for policy 0, policy_version 1141017 (0.0011) [2023-12-26 08:42:04,542][123090] Updated weights for policy 1, policy_version 1132881 (0.0009) [2023-12-26 08:42:04,556][123091] Updated weights for policy 0, policy_version 1141027 (0.0005) [2023-12-26 08:42:04,596][123090] Updated weights for policy 1, policy_version 1132891 (0.0010) [2023-12-26 08:42:04,621][123091] Updated weights for policy 0, policy_version 1141037 (0.0006) [2023-12-26 08:42:05,279][123091] Updated weights for policy 0, policy_version 1141047 (0.0009) [2023-12-26 08:42:05,323][123091] Updated weights for policy 0, policy_version 1141057 (0.0010) [2023-12-26 08:42:05,377][123091] Updated weights for policy 0, policy_version 1141067 (0.0006) [2023-12-26 08:42:05,500][123090] Updated weights for policy 1, policy_version 1132901 (0.0009) [2023-12-26 08:42:05,554][123090] Updated weights for policy 1, policy_version 1132912 (0.0010) [2023-12-26 08:42:05,614][123090] Updated weights for policy 1, policy_version 1132923 (0.0011) [2023-12-26 08:42:06,055][123091] Updated weights for policy 0, policy_version 1141077 (0.0008) [2023-12-26 08:42:06,107][123091] Updated weights for policy 0, policy_version 1141087 (0.0011) [2023-12-26 08:42:06,167][123091] Updated weights for policy 0, policy_version 1141097 (0.0011) [2023-12-26 08:42:06,529][123090] Updated weights for policy 1, policy_version 1132933 (0.0009) [2023-12-26 08:42:06,580][123090] Updated weights for policy 1, policy_version 1132943 (0.0009) [2023-12-26 08:42:06,634][123090] Updated weights for policy 1, policy_version 1132953 (0.0008) [2023-12-26 08:42:06,998][123091] Updated weights for policy 0, policy_version 1141107 (0.0009) [2023-12-26 08:42:07,067][123091] Updated weights for policy 0, policy_version 1141117 (0.0007) [2023-12-26 08:42:07,140][123091] Updated weights for policy 0, policy_version 1141127 (0.0007) [2023-12-26 08:42:07,551][123090] Updated weights for policy 1, policy_version 1132963 (0.0009) [2023-12-26 08:42:07,609][123090] Updated weights for policy 1, policy_version 1132973 (0.0010) [2023-12-26 08:42:07,664][123090] Updated weights for policy 1, policy_version 1132983 (0.0010) [2023-12-26 08:42:07,816][123091] Updated weights for policy 0, policy_version 1141137 (0.0006) [2023-12-26 08:42:07,876][123091] Updated weights for policy 0, policy_version 1141147 (0.0009) [2023-12-26 08:42:07,938][123091] Updated weights for policy 0, policy_version 1141157 (0.0007) [2023-12-26 08:42:07,991][123091] Updated weights for policy 0, policy_version 1141167 (0.0007) [2023-12-26 08:42:08,535][123090] Updated weights for policy 1, policy_version 1132993 (0.0010) [2023-12-26 08:42:08,603][123090] Updated weights for policy 1, policy_version 1133003 (0.0010) [2023-12-26 08:42:08,663][123090] Updated weights for policy 1, policy_version 1133013 (0.0009) [2023-12-26 08:42:08,724][123090] Updated weights for policy 1, policy_version 1133023 (0.0009) [2023-12-26 08:42:08,740][123091] Updated weights for policy 0, policy_version 1141177 (0.0008) [2023-12-26 08:42:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 582197248. Throughput: 0: 9018.6, 1: 8772.3. Samples: 582173732. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:08,785][121949] Avg episode reward: [(0, '6294.442'), (1, '5674.138')] [2023-12-26 08:42:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001133024_290054144.pth... [2023-12-26 08:42:08,798][123091] Updated weights for policy 0, policy_version 1141187 (0.0008) [2023-12-26 08:42:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001132000_289792000.pth [2023-12-26 08:42:08,861][123091] Updated weights for policy 0, policy_version 1141197 (0.0009) [2023-12-26 08:42:08,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001141200_292151296.pth... [2023-12-26 08:42:08,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001140144_291880960.pth [2023-12-26 08:42:09,602][123090] Updated weights for policy 1, policy_version 1133033 (0.0009) [2023-12-26 08:42:09,657][123090] Updated weights for policy 1, policy_version 1133043 (0.0009) [2023-12-26 08:42:09,669][123091] Updated weights for policy 0, policy_version 1141207 (0.0010) [2023-12-26 08:42:09,706][123090] Updated weights for policy 1, policy_version 1133053 (0.0007) [2023-12-26 08:42:09,729][123091] Updated weights for policy 0, policy_version 1141217 (0.0011) [2023-12-26 08:42:09,796][123091] Updated weights for policy 0, policy_version 1141227 (0.0011) [2023-12-26 08:42:10,595][123090] Updated weights for policy 1, policy_version 1133063 (0.0009) [2023-12-26 08:42:10,605][123091] Updated weights for policy 0, policy_version 1141237 (0.0010) [2023-12-26 08:42:10,644][123090] Updated weights for policy 1, policy_version 1133073 (0.0008) [2023-12-26 08:42:10,669][123091] Updated weights for policy 0, policy_version 1141247 (0.0006) [2023-12-26 08:42:10,694][123090] Updated weights for policy 1, policy_version 1133083 (0.0010) [2023-12-26 08:42:10,725][123091] Updated weights for policy 0, policy_version 1141257 (0.0006) [2023-12-26 08:42:11,511][123090] Updated weights for policy 1, policy_version 1133093 (0.0009) [2023-12-26 08:42:11,535][123091] Updated weights for policy 0, policy_version 1141267 (0.0007) [2023-12-26 08:42:11,578][123090] Updated weights for policy 1, policy_version 1133103 (0.0009) [2023-12-26 08:42:11,598][123091] Updated weights for policy 0, policy_version 1141277 (0.0010) [2023-12-26 08:42:11,650][123090] Updated weights for policy 1, policy_version 1133113 (0.0012) [2023-12-26 08:42:11,668][123091] Updated weights for policy 0, policy_version 1141287 (0.0010) [2023-12-26 08:42:12,390][123090] Updated weights for policy 1, policy_version 1133123 (0.0009) [2023-12-26 08:42:12,440][123090] Updated weights for policy 1, policy_version 1133133 (0.0009) [2023-12-26 08:42:12,489][123090] Updated weights for policy 1, policy_version 1133143 (0.0009) [2023-12-26 08:42:12,544][123091] Updated weights for policy 0, policy_version 1141297 (0.0009) [2023-12-26 08:42:12,615][123091] Updated weights for policy 0, policy_version 1141307 (0.0009) [2023-12-26 08:42:12,674][123091] Updated weights for policy 0, policy_version 1141317 (0.0011) [2023-12-26 08:42:12,735][123091] Updated weights for policy 0, policy_version 1141327 (0.0011) [2023-12-26 08:42:13,360][123090] Updated weights for policy 1, policy_version 1133153 (0.0009) [2023-12-26 08:42:13,425][123090] Updated weights for policy 1, policy_version 1133163 (0.0009) [2023-12-26 08:42:13,487][123090] Updated weights for policy 1, policy_version 1133173 (0.0009) [2023-12-26 08:42:13,511][123091] Updated weights for policy 0, policy_version 1141337 (0.0006) [2023-12-26 08:42:13,547][123090] Updated weights for policy 1, policy_version 1133183 (0.0010) [2023-12-26 08:42:13,568][123091] Updated weights for policy 0, policy_version 1141347 (0.0005) [2023-12-26 08:42:13,621][123091] Updated weights for policy 0, policy_version 1141357 (0.0005) [2023-12-26 08:42:13,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 582287360. Throughput: 0: 8973.4, 1: 8711.5. Samples: 582277136. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:13,785][121949] Avg episode reward: [(0, '6266.571'), (1, '5646.568')] [2023-12-26 08:42:14,242][123091] Updated weights for policy 0, policy_version 1141367 (0.0005) [2023-12-26 08:42:14,311][123091] Updated weights for policy 0, policy_version 1141377 (0.0007) [2023-12-26 08:42:14,363][123091] Updated weights for policy 0, policy_version 1141387 (0.0010) [2023-12-26 08:42:14,441][123090] Updated weights for policy 1, policy_version 1133193 (0.0007) [2023-12-26 08:42:14,509][123090] Updated weights for policy 1, policy_version 1133203 (0.0005) [2023-12-26 08:42:14,569][123090] Updated weights for policy 1, policy_version 1133213 (0.0005) [2023-12-26 08:42:15,160][123091] Updated weights for policy 0, policy_version 1141397 (0.0008) [2023-12-26 08:42:15,230][123091] Updated weights for policy 0, policy_version 1141407 (0.0006) [2023-12-26 08:42:15,300][123090] Updated weights for policy 1, policy_version 1133223 (0.0007) [2023-12-26 08:42:15,303][123091] Updated weights for policy 0, policy_version 1141417 (0.0006) [2023-12-26 08:42:15,368][123090] Updated weights for policy 1, policy_version 1133233 (0.0006) [2023-12-26 08:42:15,442][123090] Updated weights for policy 1, policy_version 1133243 (0.0008) [2023-12-26 08:42:16,074][123091] Updated weights for policy 0, policy_version 1141427 (0.0008) [2023-12-26 08:42:16,126][123091] Updated weights for policy 0, policy_version 1141437 (0.0009) [2023-12-26 08:42:16,171][123090] Updated weights for policy 1, policy_version 1133253 (0.0008) [2023-12-26 08:42:16,185][123091] Updated weights for policy 0, policy_version 1141447 (0.0008) [2023-12-26 08:42:16,221][123090] Updated weights for policy 1, policy_version 1133263 (0.0005) [2023-12-26 08:42:16,269][123090] Updated weights for policy 1, policy_version 1133273 (0.0005) [2023-12-26 08:42:16,903][123091] Updated weights for policy 0, policy_version 1141457 (0.0009) [2023-12-26 08:42:16,946][123090] Updated weights for policy 1, policy_version 1133283 (0.0005) [2023-12-26 08:42:16,965][123091] Updated weights for policy 0, policy_version 1141467 (0.0009) [2023-12-26 08:42:17,003][123090] Updated weights for policy 1, policy_version 1133293 (0.0005) [2023-12-26 08:42:17,022][123091] Updated weights for policy 0, policy_version 1141477 (0.0009) [2023-12-26 08:42:17,061][123090] Updated weights for policy 1, policy_version 1133303 (0.0005) [2023-12-26 08:42:17,079][123091] Updated weights for policy 0, policy_version 1141487 (0.0006) [2023-12-26 08:42:17,661][123090] Updated weights for policy 1, policy_version 1133313 (0.0005) [2023-12-26 08:42:17,709][123090] Updated weights for policy 1, policy_version 1133323 (0.0005) [2023-12-26 08:42:17,767][123090] Updated weights for policy 1, policy_version 1133333 (0.0008) [2023-12-26 08:42:17,823][123090] Updated weights for policy 1, policy_version 1133343 (0.0009) [2023-12-26 08:42:17,962][123091] Updated weights for policy 0, policy_version 1141497 (0.0006) [2023-12-26 08:42:18,032][123091] Updated weights for policy 0, policy_version 1141507 (0.0006) [2023-12-26 08:42:18,080][123091] Updated weights for policy 0, policy_version 1141517 (0.0009) [2023-12-26 08:42:18,665][123090] Updated weights for policy 1, policy_version 1133353 (0.0010) [2023-12-26 08:42:18,736][123090] Updated weights for policy 1, policy_version 1133363 (0.0011) [2023-12-26 08:42:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 582369280. Throughput: 0: 9043.3, 1: 8743.6. Samples: 582387828. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:18,784][121949] Avg episode reward: [(0, '6275.342'), (1, '5462.491')] [2023-12-26 08:42:18,800][123090] Updated weights for policy 1, policy_version 1133373 (0.0010) [2023-12-26 08:42:18,815][123091] Updated weights for policy 0, policy_version 1141527 (0.0007) [2023-12-26 08:42:18,879][123091] Updated weights for policy 0, policy_version 1141537 (0.0009) [2023-12-26 08:42:18,948][123091] Updated weights for policy 0, policy_version 1141547 (0.0009) [2023-12-26 08:42:19,663][123090] Updated weights for policy 1, policy_version 1133383 (0.0011) [2023-12-26 08:42:19,718][123091] Updated weights for policy 0, policy_version 1141557 (0.0009) [2023-12-26 08:42:19,719][123090] Updated weights for policy 1, policy_version 1133393 (0.0010) [2023-12-26 08:42:19,771][123090] Updated weights for policy 1, policy_version 1133403 (0.0010) [2023-12-26 08:42:19,778][123091] Updated weights for policy 0, policy_version 1141567 (0.0006) [2023-12-26 08:42:19,846][123091] Updated weights for policy 0, policy_version 1141577 (0.0008) [2023-12-26 08:42:20,520][123091] Updated weights for policy 0, policy_version 1141587 (0.0010) [2023-12-26 08:42:20,571][123090] Updated weights for policy 1, policy_version 1133413 (0.0010) [2023-12-26 08:42:20,587][123091] Updated weights for policy 0, policy_version 1141597 (0.0009) [2023-12-26 08:42:20,641][123090] Updated weights for policy 1, policy_version 1133423 (0.0010) [2023-12-26 08:42:20,652][123091] Updated weights for policy 0, policy_version 1141607 (0.0010) [2023-12-26 08:42:20,706][123090] Updated weights for policy 1, policy_version 1133433 (0.0011) [2023-12-26 08:42:21,498][123090] Updated weights for policy 1, policy_version 1133443 (0.0011) [2023-12-26 08:42:21,531][123091] Updated weights for policy 0, policy_version 1141617 (0.0007) [2023-12-26 08:42:21,565][123090] Updated weights for policy 1, policy_version 1133453 (0.0007) [2023-12-26 08:42:21,587][123091] Updated weights for policy 0, policy_version 1141627 (0.0010) [2023-12-26 08:42:21,636][123090] Updated weights for policy 1, policy_version 1133463 (0.0008) [2023-12-26 08:42:21,656][123091] Updated weights for policy 0, policy_version 1141637 (0.0009) [2023-12-26 08:42:21,727][123091] Updated weights for policy 0, policy_version 1141647 (0.0007) [2023-12-26 08:42:22,428][123090] Updated weights for policy 1, policy_version 1133473 (0.0010) [2023-12-26 08:42:22,496][123090] Updated weights for policy 1, policy_version 1133483 (0.0008) [2023-12-26 08:42:22,564][123090] Updated weights for policy 1, policy_version 1133493 (0.0011) [2023-12-26 08:42:22,589][123091] Updated weights for policy 0, policy_version 1141657 (0.0010) [2023-12-26 08:42:22,627][123090] Updated weights for policy 1, policy_version 1133503 (0.0009) [2023-12-26 08:42:22,655][123091] Updated weights for policy 0, policy_version 1141667 (0.0008) [2023-12-26 08:42:22,715][123091] Updated weights for policy 0, policy_version 1141677 (0.0010) [2023-12-26 08:42:23,293][123090] Updated weights for policy 1, policy_version 1133513 (0.0006) [2023-12-26 08:42:23,361][123090] Updated weights for policy 1, policy_version 1133523 (0.0005) [2023-12-26 08:42:23,423][123090] Updated weights for policy 1, policy_version 1133533 (0.0005) [2023-12-26 08:42:23,509][123091] Updated weights for policy 0, policy_version 1141687 (0.0006) [2023-12-26 08:42:23,579][123091] Updated weights for policy 0, policy_version 1141697 (0.0006) [2023-12-26 08:42:23,628][123091] Updated weights for policy 0, policy_version 1141707 (0.0006) [2023-12-26 08:42:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 582467584. Throughput: 0: 8992.7, 1: 8737.2. Samples: 582439808. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:23,785][121949] Avg episode reward: [(0, '6331.918'), (1, '5499.642')] [2023-12-26 08:42:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001141712_292282368.pth... [2023-12-26 08:42:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001133536_290185216.pth... [2023-12-26 08:42:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001140656_292012032.pth [2023-12-26 08:42:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001132512_289923072.pth [2023-12-26 08:42:24,114][123090] Updated weights for policy 1, policy_version 1133543 (0.0005) [2023-12-26 08:42:24,174][123090] Updated weights for policy 1, policy_version 1133553 (0.0008) [2023-12-26 08:42:24,230][123090] Updated weights for policy 1, policy_version 1133563 (0.0010) [2023-12-26 08:42:24,450][123091] Updated weights for policy 0, policy_version 1141717 (0.0008) [2023-12-26 08:42:24,509][123091] Updated weights for policy 0, policy_version 1141727 (0.0009) [2023-12-26 08:42:24,574][123091] Updated weights for policy 0, policy_version 1141737 (0.0010) [2023-12-26 08:42:25,018][123090] Updated weights for policy 1, policy_version 1133573 (0.0010) [2023-12-26 08:42:25,077][123090] Updated weights for policy 1, policy_version 1133583 (0.0009) [2023-12-26 08:42:25,126][123090] Updated weights for policy 1, policy_version 1133593 (0.0009) [2023-12-26 08:42:25,402][123091] Updated weights for policy 0, policy_version 1141747 (0.0009) [2023-12-26 08:42:25,466][123091] Updated weights for policy 0, policy_version 1141757 (0.0007) [2023-12-26 08:42:25,514][123091] Updated weights for policy 0, policy_version 1141767 (0.0008) [2023-12-26 08:42:25,871][123090] Updated weights for policy 1, policy_version 1133603 (0.0008) [2023-12-26 08:42:25,942][123090] Updated weights for policy 1, policy_version 1133613 (0.0010) [2023-12-26 08:42:26,005][123090] Updated weights for policy 1, policy_version 1133623 (0.0009) [2023-12-26 08:42:26,284][123091] Updated weights for policy 0, policy_version 1141779 (0.0008) [2023-12-26 08:42:26,343][123091] Updated weights for policy 0, policy_version 1141789 (0.0006) [2023-12-26 08:42:26,400][123091] Updated weights for policy 0, policy_version 1141799 (0.0009) [2023-12-26 08:42:26,834][123090] Updated weights for policy 1, policy_version 1133633 (0.0009) [2023-12-26 08:42:26,882][123090] Updated weights for policy 1, policy_version 1133643 (0.0009) [2023-12-26 08:42:26,929][123090] Updated weights for policy 1, policy_version 1133653 (0.0008) [2023-12-26 08:42:26,977][123090] Updated weights for policy 1, policy_version 1133663 (0.0009) [2023-12-26 08:42:27,222][123091] Updated weights for policy 0, policy_version 1141809 (0.0009) [2023-12-26 08:42:27,282][123091] Updated weights for policy 0, policy_version 1141819 (0.0009) [2023-12-26 08:42:27,341][123091] Updated weights for policy 0, policy_version 1141829 (0.0009) [2023-12-26 08:42:27,391][123091] Updated weights for policy 0, policy_version 1141839 (0.0009) [2023-12-26 08:42:27,740][123090] Updated weights for policy 1, policy_version 1133673 (0.0008) [2023-12-26 08:42:27,802][123090] Updated weights for policy 1, policy_version 1133683 (0.0010) [2023-12-26 08:42:27,864][123090] Updated weights for policy 1, policy_version 1133693 (0.0009) [2023-12-26 08:42:28,208][123091] Updated weights for policy 0, policy_version 1141849 (0.0010) [2023-12-26 08:42:28,277][123091] Updated weights for policy 0, policy_version 1141859 (0.0008) [2023-12-26 08:42:28,324][123091] Updated weights for policy 0, policy_version 1141869 (0.0009) [2023-12-26 08:42:28,668][123090] Updated weights for policy 1, policy_version 1133703 (0.0007) [2023-12-26 08:42:28,740][123090] Updated weights for policy 1, policy_version 1133713 (0.0010) [2023-12-26 08:42:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 582549504. Throughput: 0: 8965.3, 1: 8879.9. Samples: 582547848. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:28,785][121949] Avg episode reward: [(0, '6359.188'), (1, '5509.146')] [2023-12-26 08:42:28,796][123090] Updated weights for policy 1, policy_version 1133723 (0.0010) [2023-12-26 08:42:29,115][123091] Updated weights for policy 0, policy_version 1141879 (0.0010) [2023-12-26 08:42:29,166][123091] Updated weights for policy 0, policy_version 1141889 (0.0009) [2023-12-26 08:42:29,219][123091] Updated weights for policy 0, policy_version 1141899 (0.0009) [2023-12-26 08:42:29,611][123090] Updated weights for policy 1, policy_version 1133733 (0.0007) [2023-12-26 08:42:29,685][123090] Updated weights for policy 1, policy_version 1133743 (0.0008) [2023-12-26 08:42:29,739][123090] Updated weights for policy 1, policy_version 1133753 (0.0010) [2023-12-26 08:42:30,078][123091] Updated weights for policy 0, policy_version 1141909 (0.0009) [2023-12-26 08:42:30,143][123091] Updated weights for policy 0, policy_version 1141919 (0.0010) [2023-12-26 08:42:30,205][123091] Updated weights for policy 0, policy_version 1141929 (0.0010) [2023-12-26 08:42:30,502][123090] Updated weights for policy 1, policy_version 1133763 (0.0009) [2023-12-26 08:42:30,563][123090] Updated weights for policy 1, policy_version 1133773 (0.0009) [2023-12-26 08:42:30,613][123090] Updated weights for policy 1, policy_version 1133783 (0.0009) [2023-12-26 08:42:30,998][123091] Updated weights for policy 0, policy_version 1141939 (0.0009) [2023-12-26 08:42:31,057][123091] Updated weights for policy 0, policy_version 1141949 (0.0007) [2023-12-26 08:42:31,118][123091] Updated weights for policy 0, policy_version 1141959 (0.0008) [2023-12-26 08:42:31,472][123090] Updated weights for policy 1, policy_version 1133793 (0.0009) [2023-12-26 08:42:31,533][123090] Updated weights for policy 1, policy_version 1133803 (0.0005) [2023-12-26 08:42:31,582][123090] Updated weights for policy 1, policy_version 1133813 (0.0005) [2023-12-26 08:42:31,651][123090] Updated weights for policy 1, policy_version 1133823 (0.0007) [2023-12-26 08:42:31,863][123091] Updated weights for policy 0, policy_version 1141969 (0.0007) [2023-12-26 08:42:31,919][123091] Updated weights for policy 0, policy_version 1141979 (0.0006) [2023-12-26 08:42:31,979][123091] Updated weights for policy 0, policy_version 1141989 (0.0006) [2023-12-26 08:42:32,047][123091] Updated weights for policy 0, policy_version 1141999 (0.0009) [2023-12-26 08:42:32,434][123090] Updated weights for policy 1, policy_version 1133833 (0.0009) [2023-12-26 08:42:32,491][123090] Updated weights for policy 1, policy_version 1133843 (0.0010) [2023-12-26 08:42:32,544][123090] Updated weights for policy 1, policy_version 1133853 (0.0010) [2023-12-26 08:42:32,754][123091] Updated weights for policy 0, policy_version 1142009 (0.0006) [2023-12-26 08:42:32,810][123091] Updated weights for policy 0, policy_version 1142019 (0.0009) [2023-12-26 08:42:32,880][123091] Updated weights for policy 0, policy_version 1142029 (0.0006) [2023-12-26 08:42:33,283][123090] Updated weights for policy 1, policy_version 1133863 (0.0009) [2023-12-26 08:42:33,327][123090] Updated weights for policy 1, policy_version 1133873 (0.0010) [2023-12-26 08:42:33,375][123090] Updated weights for policy 1, policy_version 1133883 (0.0010) [2023-12-26 08:42:33,611][123091] Updated weights for policy 0, policy_version 1142039 (0.0009) [2023-12-26 08:42:33,662][123091] Updated weights for policy 0, policy_version 1142049 (0.0010) [2023-12-26 08:42:33,708][123091] Updated weights for policy 0, policy_version 1142059 (0.0010) [2023-12-26 08:42:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 582647808. Throughput: 0: 8897.8, 1: 8879.3. Samples: 582655044. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:33,785][121949] Avg episode reward: [(0, '6304.556'), (1, '5474.234')] [2023-12-26 08:42:34,238][123090] Updated weights for policy 1, policy_version 1133893 (0.0010) [2023-12-26 08:42:34,305][123090] Updated weights for policy 1, policy_version 1133903 (0.0011) [2023-12-26 08:42:34,372][123090] Updated weights for policy 1, policy_version 1133913 (0.0010) [2023-12-26 08:42:34,443][123091] Updated weights for policy 0, policy_version 1142069 (0.0010) [2023-12-26 08:42:34,498][123091] Updated weights for policy 0, policy_version 1142079 (0.0010) [2023-12-26 08:42:34,554][123091] Updated weights for policy 0, policy_version 1142089 (0.0010) [2023-12-26 08:42:35,144][123090] Updated weights for policy 1, policy_version 1133923 (0.0009) [2023-12-26 08:42:35,193][123090] Updated weights for policy 1, policy_version 1133933 (0.0006) [2023-12-26 08:42:35,237][123090] Updated weights for policy 1, policy_version 1133943 (0.0010) [2023-12-26 08:42:35,323][123091] Updated weights for policy 0, policy_version 1142099 (0.0010) [2023-12-26 08:42:35,377][123091] Updated weights for policy 0, policy_version 1142109 (0.0010) [2023-12-26 08:42:35,431][123091] Updated weights for policy 0, policy_version 1142119 (0.0010) [2023-12-26 08:42:36,070][123090] Updated weights for policy 1, policy_version 1133953 (0.0010) [2023-12-26 08:42:36,137][123090] Updated weights for policy 1, policy_version 1133963 (0.0010) [2023-12-26 08:42:36,186][123091] Updated weights for policy 0, policy_version 1142129 (0.0007) [2023-12-26 08:42:36,208][123090] Updated weights for policy 1, policy_version 1133973 (0.0010) [2023-12-26 08:42:36,246][123091] Updated weights for policy 0, policy_version 1142139 (0.0006) [2023-12-26 08:42:36,276][123090] Updated weights for policy 1, policy_version 1133983 (0.0011) [2023-12-26 08:42:36,309][123091] Updated weights for policy 0, policy_version 1142149 (0.0006) [2023-12-26 08:42:36,375][123091] Updated weights for policy 0, policy_version 1142159 (0.0005) [2023-12-26 08:42:36,999][123090] Updated weights for policy 1, policy_version 1133993 (0.0006) [2023-12-26 08:42:37,065][123090] Updated weights for policy 1, policy_version 1134003 (0.0006) [2023-12-26 08:42:37,113][123091] Updated weights for policy 0, policy_version 1142169 (0.0010) [2023-12-26 08:42:37,131][123090] Updated weights for policy 1, policy_version 1134013 (0.0010) [2023-12-26 08:42:37,168][123091] Updated weights for policy 0, policy_version 1142179 (0.0010) [2023-12-26 08:42:37,212][123091] Updated weights for policy 0, policy_version 1142189 (0.0010) [2023-12-26 08:42:37,861][123090] Updated weights for policy 1, policy_version 1134024 (0.0008) [2023-12-26 08:42:37,913][123090] Updated weights for policy 1, policy_version 1134034 (0.0006) [2023-12-26 08:42:37,980][123090] Updated weights for policy 1, policy_version 1134044 (0.0005) [2023-12-26 08:42:37,986][123091] Updated weights for policy 0, policy_version 1142199 (0.0007) [2023-12-26 08:42:38,049][123091] Updated weights for policy 0, policy_version 1142209 (0.0007) [2023-12-26 08:42:38,109][123091] Updated weights for policy 0, policy_version 1142219 (0.0011) [2023-12-26 08:42:38,774][123090] Updated weights for policy 1, policy_version 1134054 (0.0008) [2023-12-26 08:42:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 582729728. Throughput: 0: 8957.9, 1: 8856.4. Samples: 582709492. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:38,785][121949] Avg episode reward: [(0, '6307.365'), (1, '5582.784')] [2023-12-26 08:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001142224_292413440.pth... [2023-12-26 08:42:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001141200_292151296.pth [2023-12-26 08:42:38,839][123090] Updated weights for policy 1, policy_version 1134064 (0.0009) [2023-12-26 08:42:38,854][123091] Updated weights for policy 0, policy_version 1142229 (0.0010) [2023-12-26 08:42:38,900][123090] Updated weights for policy 1, policy_version 1134074 (0.0008) [2023-12-26 08:42:38,916][123091] Updated weights for policy 0, policy_version 1142239 (0.0008) [2023-12-26 08:42:38,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001134080_290324480.pth... [2023-12-26 08:42:38,941][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001133024_290054144.pth [2023-12-26 08:42:38,986][123091] Updated weights for policy 0, policy_version 1142249 (0.0007) [2023-12-26 08:42:39,775][123091] Updated weights for policy 0, policy_version 1142259 (0.0007) [2023-12-26 08:42:39,840][123091] Updated weights for policy 0, policy_version 1142269 (0.0011) [2023-12-26 08:42:39,843][123090] Updated weights for policy 1, policy_version 1134084 (0.0007) [2023-12-26 08:42:39,908][123090] Updated weights for policy 1, policy_version 1134094 (0.0009) [2023-12-26 08:42:39,909][123091] Updated weights for policy 0, policy_version 1142279 (0.0011) [2023-12-26 08:42:39,976][123090] Updated weights for policy 1, policy_version 1134104 (0.0007) [2023-12-26 08:42:40,735][123091] Updated weights for policy 0, policy_version 1142289 (0.0011) [2023-12-26 08:42:40,782][123090] Updated weights for policy 1, policy_version 1134114 (0.0009) [2023-12-26 08:42:40,794][123091] Updated weights for policy 0, policy_version 1142299 (0.0010) [2023-12-26 08:42:40,837][123090] Updated weights for policy 1, policy_version 1134124 (0.0008) [2023-12-26 08:42:40,851][123091] Updated weights for policy 0, policy_version 1142309 (0.0006) [2023-12-26 08:42:40,895][123090] Updated weights for policy 1, policy_version 1134134 (0.0009) [2023-12-26 08:42:40,905][123091] Updated weights for policy 0, policy_version 1142319 (0.0005) [2023-12-26 08:42:40,959][123090] Updated weights for policy 1, policy_version 1134144 (0.0010) [2023-12-26 08:42:41,731][123091] Updated weights for policy 0, policy_version 1142329 (0.0010) [2023-12-26 08:42:41,796][123091] Updated weights for policy 0, policy_version 1142339 (0.0008) [2023-12-26 08:42:41,841][123090] Updated weights for policy 1, policy_version 1134154 (0.0011) [2023-12-26 08:42:41,858][123091] Updated weights for policy 0, policy_version 1142349 (0.0005) [2023-12-26 08:42:41,905][123090] Updated weights for policy 1, policy_version 1134164 (0.0011) [2023-12-26 08:42:41,967][123090] Updated weights for policy 1, policy_version 1134174 (0.0010) [2023-12-26 08:42:42,653][123091] Updated weights for policy 0, policy_version 1142359 (0.0009) [2023-12-26 08:42:42,704][123091] Updated weights for policy 0, policy_version 1142369 (0.0008) [2023-12-26 08:42:42,750][123090] Updated weights for policy 1, policy_version 1134184 (0.0009) [2023-12-26 08:42:42,757][123091] Updated weights for policy 0, policy_version 1142379 (0.0006) [2023-12-26 08:42:42,798][123090] Updated weights for policy 1, policy_version 1134194 (0.0010) [2023-12-26 08:42:42,845][123090] Updated weights for policy 1, policy_version 1134204 (0.0010) [2023-12-26 08:42:43,586][123091] Updated weights for policy 0, policy_version 1142389 (0.0006) [2023-12-26 08:42:43,662][123091] Updated weights for policy 0, policy_version 1142399 (0.0005) [2023-12-26 08:42:43,690][123090] Updated weights for policy 1, policy_version 1134214 (0.0007) [2023-12-26 08:42:43,725][123091] Updated weights for policy 0, policy_version 1142409 (0.0005) [2023-12-26 08:42:43,753][123090] Updated weights for policy 1, policy_version 1134224 (0.0006) [2023-12-26 08:42:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 582819840. Throughput: 0: 8997.2, 1: 8749.7. Samples: 582814196. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:43,785][121949] Avg episode reward: [(0, '6290.676'), (1, '5702.646')] [2023-12-26 08:42:43,815][123090] Updated weights for policy 1, policy_version 1134234 (0.0006) [2023-12-26 08:42:44,389][123091] Updated weights for policy 0, policy_version 1142419 (0.0007) [2023-12-26 08:42:44,444][123091] Updated weights for policy 0, policy_version 1142429 (0.0009) [2023-12-26 08:42:44,501][123091] Updated weights for policy 0, policy_version 1142439 (0.0009) [2023-12-26 08:42:44,557][123090] Updated weights for policy 1, policy_version 1134244 (0.0006) [2023-12-26 08:42:44,623][123090] Updated weights for policy 1, policy_version 1134254 (0.0008) [2023-12-26 08:42:44,677][123090] Updated weights for policy 1, policy_version 1134264 (0.0009) [2023-12-26 08:42:45,352][123091] Updated weights for policy 0, policy_version 1142449 (0.0010) [2023-12-26 08:42:45,421][123091] Updated weights for policy 0, policy_version 1142459 (0.0009) [2023-12-26 08:42:45,490][123091] Updated weights for policy 0, policy_version 1142469 (0.0009) [2023-12-26 08:42:45,537][123090] Updated weights for policy 1, policy_version 1134274 (0.0010) [2023-12-26 08:42:45,552][123091] Updated weights for policy 0, policy_version 1142479 (0.0009) [2023-12-26 08:42:45,597][123090] Updated weights for policy 1, policy_version 1134284 (0.0008) [2023-12-26 08:42:45,649][123090] Updated weights for policy 1, policy_version 1134294 (0.0009) [2023-12-26 08:42:46,263][123091] Updated weights for policy 0, policy_version 1142489 (0.0006) [2023-12-26 08:42:46,313][123091] Updated weights for policy 0, policy_version 1142499 (0.0006) [2023-12-26 08:42:46,378][123091] Updated weights for policy 0, policy_version 1142509 (0.0008) [2023-12-26 08:42:46,531][123090] Updated weights for policy 1, policy_version 1134305 (0.0010) [2023-12-26 08:42:46,598][123090] Updated weights for policy 1, policy_version 1134315 (0.0009) [2023-12-26 08:42:46,662][123090] Updated weights for policy 1, policy_version 1134325 (0.0009) [2023-12-26 08:42:46,726][123090] Updated weights for policy 1, policy_version 1134335 (0.0010) [2023-12-26 08:42:47,092][123091] Updated weights for policy 0, policy_version 1142519 (0.0007) [2023-12-26 08:42:47,157][123091] Updated weights for policy 0, policy_version 1142529 (0.0008) [2023-12-26 08:42:47,222][123091] Updated weights for policy 0, policy_version 1142539 (0.0010) [2023-12-26 08:42:47,491][123090] Updated weights for policy 1, policy_version 1134345 (0.0006) [2023-12-26 08:42:47,562][123090] Updated weights for policy 1, policy_version 1134356 (0.0008) [2023-12-26 08:42:47,628][123090] Updated weights for policy 1, policy_version 1134366 (0.0010) [2023-12-26 08:42:47,978][123091] Updated weights for policy 0, policy_version 1142549 (0.0010) [2023-12-26 08:42:48,050][123091] Updated weights for policy 0, policy_version 1142559 (0.0010) [2023-12-26 08:42:48,108][123091] Updated weights for policy 0, policy_version 1142569 (0.0010) [2023-12-26 08:42:48,461][123090] Updated weights for policy 1, policy_version 1134376 (0.0008) [2023-12-26 08:42:48,521][123090] Updated weights for policy 1, policy_version 1134386 (0.0008) [2023-12-26 08:42:48,584][123090] Updated weights for policy 1, policy_version 1134396 (0.0008) [2023-12-26 08:42:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 582909952. Throughput: 0: 9049.3, 1: 8755.7. Samples: 582921436. Policy #0 lag: (min: 31.0, avg: 31.1, max: 36.0) [2023-12-26 08:42:48,785][121949] Avg episode reward: [(0, '6296.757'), (1, '5733.212')] [2023-12-26 08:42:48,903][123091] Updated weights for policy 0, policy_version 1142579 (0.0008) [2023-12-26 08:42:48,957][123091] Updated weights for policy 0, policy_version 1142589 (0.0010) [2023-12-26 08:42:49,025][123091] Updated weights for policy 0, policy_version 1142599 (0.0007) [2023-12-26 08:42:49,373][123090] Updated weights for policy 1, policy_version 1134406 (0.0009) [2023-12-26 08:42:49,436][123090] Updated weights for policy 1, policy_version 1134416 (0.0010) [2023-12-26 08:42:49,495][123090] Updated weights for policy 1, policy_version 1134426 (0.0010) [2023-12-26 08:42:49,804][123091] Updated weights for policy 0, policy_version 1142609 (0.0008) [2023-12-26 08:42:49,878][123091] Updated weights for policy 0, policy_version 1142619 (0.0010) [2023-12-26 08:42:49,945][123091] Updated weights for policy 0, policy_version 1142629 (0.0008) [2023-12-26 08:42:50,012][123091] Updated weights for policy 0, policy_version 1142639 (0.0009) [2023-12-26 08:42:50,269][123090] Updated weights for policy 1, policy_version 1134436 (0.0009) [2023-12-26 08:42:50,329][123090] Updated weights for policy 1, policy_version 1134446 (0.0009) [2023-12-26 08:42:50,393][123090] Updated weights for policy 1, policy_version 1134456 (0.0011) [2023-12-26 08:42:50,846][123091] Updated weights for policy 0, policy_version 1142649 (0.0009) [2023-12-26 08:42:50,909][123091] Updated weights for policy 0, policy_version 1142659 (0.0009) [2023-12-26 08:42:50,970][123091] Updated weights for policy 0, policy_version 1142669 (0.0009) [2023-12-26 08:42:51,192][123090] Updated weights for policy 1, policy_version 1134466 (0.0010) [2023-12-26 08:42:51,245][123090] Updated weights for policy 1, policy_version 1134476 (0.0010) [2023-12-26 08:42:51,313][123090] Updated weights for policy 1, policy_version 1134486 (0.0011) [2023-12-26 08:42:51,380][123090] Updated weights for policy 1, policy_version 1134496 (0.0012) [2023-12-26 08:42:51,790][123091] Updated weights for policy 0, policy_version 1142679 (0.0007) [2023-12-26 08:42:51,839][123091] Updated weights for policy 0, policy_version 1142689 (0.0006) [2023-12-26 08:42:51,902][123091] Updated weights for policy 0, policy_version 1142699 (0.0005) [2023-12-26 08:42:52,125][123090] Updated weights for policy 1, policy_version 1134506 (0.0010) [2023-12-26 08:42:52,182][123090] Updated weights for policy 1, policy_version 1134516 (0.0008) [2023-12-26 08:42:52,250][123090] Updated weights for policy 1, policy_version 1134526 (0.0008) [2023-12-26 08:42:52,673][123091] Updated weights for policy 0, policy_version 1142709 (0.0008) [2023-12-26 08:42:52,727][123091] Updated weights for policy 0, policy_version 1142719 (0.0010) [2023-12-26 08:42:52,786][123091] Updated weights for policy 0, policy_version 1142729 (0.0007) [2023-12-26 08:42:52,990][123090] Updated weights for policy 1, policy_version 1134536 (0.0006) [2023-12-26 08:42:53,043][123090] Updated weights for policy 1, policy_version 1134546 (0.0005) [2023-12-26 08:42:53,098][123090] Updated weights for policy 1, policy_version 1134556 (0.0005) [2023-12-26 08:42:53,689][123091] Updated weights for policy 0, policy_version 1142739 (0.0007) [2023-12-26 08:42:53,700][123090] Updated weights for policy 1, policy_version 1134566 (0.0005) [2023-12-26 08:42:53,748][123090] Updated weights for policy 1, policy_version 1134576 (0.0005) [2023-12-26 08:42:53,754][123091] Updated weights for policy 0, policy_version 1142749 (0.0009) [2023-12-26 08:42:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 582991872. Throughput: 0: 8989.6, 1: 8793.3. Samples: 582973964. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:42:53,785][121949] Avg episode reward: [(0, '6337.006'), (1, '5758.491')] [2023-12-26 08:42:53,794][123090] Updated weights for policy 1, policy_version 1134586 (0.0005) [2023-12-26 08:42:53,814][123091] Updated weights for policy 0, policy_version 1142759 (0.0009) [2023-12-26 08:42:53,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001134592_290455552.pth... [2023-12-26 08:42:53,827][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001133536_290185216.pth [2023-12-26 08:42:53,859][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001142768_292552704.pth... [2023-12-26 08:42:53,865][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001141712_292282368.pth [2023-12-26 08:42:54,536][123090] Updated weights for policy 1, policy_version 1134596 (0.0007) [2023-12-26 08:42:54,592][123090] Updated weights for policy 1, policy_version 1134606 (0.0010) [2023-12-26 08:42:54,646][123090] Updated weights for policy 1, policy_version 1134616 (0.0010) [2023-12-26 08:42:54,673][123091] Updated weights for policy 0, policy_version 1142769 (0.0010) [2023-12-26 08:42:54,738][123091] Updated weights for policy 0, policy_version 1142779 (0.0008) [2023-12-26 08:42:54,806][123091] Updated weights for policy 0, policy_version 1142789 (0.0009) [2023-12-26 08:42:54,868][123091] Updated weights for policy 0, policy_version 1142799 (0.0009) [2023-12-26 08:42:55,475][123090] Updated weights for policy 1, policy_version 1134626 (0.0010) [2023-12-26 08:42:55,534][123090] Updated weights for policy 1, policy_version 1134636 (0.0010) [2023-12-26 08:42:55,589][123090] Updated weights for policy 1, policy_version 1134646 (0.0010) [2023-12-26 08:42:55,644][123090] Updated weights for policy 1, policy_version 1134656 (0.0010) [2023-12-26 08:42:55,674][123091] Updated weights for policy 0, policy_version 1142809 (0.0008) [2023-12-26 08:42:55,725][123091] Updated weights for policy 0, policy_version 1142819 (0.0008) [2023-12-26 08:42:55,789][123091] Updated weights for policy 0, policy_version 1142829 (0.0008) [2023-12-26 08:42:56,468][123090] Updated weights for policy 1, policy_version 1134666 (0.0009) [2023-12-26 08:42:56,517][123090] Updated weights for policy 1, policy_version 1134676 (0.0009) [2023-12-26 08:42:56,565][123090] Updated weights for policy 1, policy_version 1134686 (0.0009) [2023-12-26 08:42:56,655][123091] Updated weights for policy 0, policy_version 1142839 (0.0007) [2023-12-26 08:42:56,715][123091] Updated weights for policy 0, policy_version 1142849 (0.0005) [2023-12-26 08:42:56,784][123091] Updated weights for policy 0, policy_version 1142859 (0.0006) [2023-12-26 08:42:57,296][123090] Updated weights for policy 1, policy_version 1134696 (0.0006) [2023-12-26 08:42:57,363][123090] Updated weights for policy 1, policy_version 1134706 (0.0008) [2023-12-26 08:42:57,429][123090] Updated weights for policy 1, policy_version 1134716 (0.0009) [2023-12-26 08:42:57,505][123091] Updated weights for policy 0, policy_version 1142869 (0.0008) [2023-12-26 08:42:57,554][123091] Updated weights for policy 0, policy_version 1142879 (0.0009) [2023-12-26 08:42:57,609][123091] Updated weights for policy 0, policy_version 1142889 (0.0010) [2023-12-26 08:42:58,280][123090] Updated weights for policy 1, policy_version 1134726 (0.0010) [2023-12-26 08:42:58,314][123091] Updated weights for policy 0, policy_version 1142899 (0.0009) [2023-12-26 08:42:58,349][123090] Updated weights for policy 1, policy_version 1134736 (0.0008) [2023-12-26 08:42:58,387][123091] Updated weights for policy 0, policy_version 1142909 (0.0008) [2023-12-26 08:42:58,422][123090] Updated weights for policy 1, policy_version 1134746 (0.0008) [2023-12-26 08:42:58,446][123091] Updated weights for policy 0, policy_version 1142919 (0.0007) [2023-12-26 08:42:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 583090176. Throughput: 0: 8939.9, 1: 8951.6. Samples: 583082252. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:42:58,785][121949] Avg episode reward: [(0, '6322.806'), (1, '5680.123')] [2023-12-26 08:42:59,182][123090] Updated weights for policy 1, policy_version 1134756 (0.0009) [2023-12-26 08:42:59,262][123090] Updated weights for policy 1, policy_version 1134766 (0.0008) [2023-12-26 08:42:59,286][123091] Updated weights for policy 0, policy_version 1142929 (0.0007) [2023-12-26 08:42:59,324][123090] Updated weights for policy 1, policy_version 1134776 (0.0008) [2023-12-26 08:42:59,355][123091] Updated weights for policy 0, policy_version 1142939 (0.0010) [2023-12-26 08:42:59,426][123091] Updated weights for policy 0, policy_version 1142949 (0.0009) [2023-12-26 08:42:59,493][123091] Updated weights for policy 0, policy_version 1142959 (0.0009) [2023-12-26 08:43:00,173][123090] Updated weights for policy 1, policy_version 1134786 (0.0008) [2023-12-26 08:43:00,211][123091] Updated weights for policy 0, policy_version 1142969 (0.0009) [2023-12-26 08:43:00,228][123090] Updated weights for policy 1, policy_version 1134796 (0.0008) [2023-12-26 08:43:00,266][123091] Updated weights for policy 0, policy_version 1142979 (0.0008) [2023-12-26 08:43:00,285][123090] Updated weights for policy 1, policy_version 1134806 (0.0009) [2023-12-26 08:43:00,328][123091] Updated weights for policy 0, policy_version 1142989 (0.0009) [2023-12-26 08:43:00,337][123090] Updated weights for policy 1, policy_version 1134816 (0.0009) [2023-12-26 08:43:01,148][123091] Updated weights for policy 0, policy_version 1142999 (0.0009) [2023-12-26 08:43:01,202][123090] Updated weights for policy 1, policy_version 1134826 (0.0007) [2023-12-26 08:43:01,209][123091] Updated weights for policy 0, policy_version 1143009 (0.0009) [2023-12-26 08:43:01,256][123090] Updated weights for policy 1, policy_version 1134836 (0.0006) [2023-12-26 08:43:01,275][123091] Updated weights for policy 0, policy_version 1143019 (0.0008) [2023-12-26 08:43:01,313][123090] Updated weights for policy 1, policy_version 1134846 (0.0007) [2023-12-26 08:43:02,057][123090] Updated weights for policy 1, policy_version 1134856 (0.0008) [2023-12-26 08:43:02,107][123090] Updated weights for policy 1, policy_version 1134866 (0.0005) [2023-12-26 08:43:02,128][123091] Updated weights for policy 0, policy_version 1143029 (0.0009) [2023-12-26 08:43:02,167][123090] Updated weights for policy 1, policy_version 1134876 (0.0006) [2023-12-26 08:43:02,189][123091] Updated weights for policy 0, policy_version 1143039 (0.0009) [2023-12-26 08:43:02,261][123091] Updated weights for policy 0, policy_version 1143049 (0.0010) [2023-12-26 08:43:02,965][123090] Updated weights for policy 1, policy_version 1134886 (0.0008) [2023-12-26 08:43:03,022][123090] Updated weights for policy 1, policy_version 1134896 (0.0009) [2023-12-26 08:43:03,043][123091] Updated weights for policy 0, policy_version 1143059 (0.0008) [2023-12-26 08:43:03,079][123090] Updated weights for policy 1, policy_version 1134906 (0.0010) [2023-12-26 08:43:03,107][123091] Updated weights for policy 0, policy_version 1143069 (0.0007) [2023-12-26 08:43:03,166][123091] Updated weights for policy 0, policy_version 1143079 (0.0008) [2023-12-26 08:43:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 583172096. Throughput: 0: 8886.8, 1: 8872.0. Samples: 583186972. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:03,785][121949] Avg episode reward: [(0, '6221.266'), (1, '5699.555')] [2023-12-26 08:43:03,908][123090] Updated weights for policy 1, policy_version 1134916 (0.0008) [2023-12-26 08:43:03,974][123090] Updated weights for policy 1, policy_version 1134926 (0.0010) [2023-12-26 08:43:03,976][123091] Updated weights for policy 0, policy_version 1143089 (0.0009) [2023-12-26 08:43:04,035][123090] Updated weights for policy 1, policy_version 1134936 (0.0009) [2023-12-26 08:43:04,039][123091] Updated weights for policy 0, policy_version 1143099 (0.0007) [2023-12-26 08:43:04,107][123091] Updated weights for policy 0, policy_version 1143109 (0.0006) [2023-12-26 08:43:04,175][123091] Updated weights for policy 0, policy_version 1143119 (0.0009) [2023-12-26 08:43:04,890][123090] Updated weights for policy 1, policy_version 1134946 (0.0009) [2023-12-26 08:43:04,956][123090] Updated weights for policy 1, policy_version 1134956 (0.0010) [2023-12-26 08:43:05,011][123091] Updated weights for policy 0, policy_version 1143129 (0.0007) [2023-12-26 08:43:05,021][123090] Updated weights for policy 1, policy_version 1134966 (0.0008) [2023-12-26 08:43:05,066][123091] Updated weights for policy 0, policy_version 1143139 (0.0009) [2023-12-26 08:43:05,083][123090] Updated weights for policy 1, policy_version 1134976 (0.0007) [2023-12-26 08:43:05,149][123091] Updated weights for policy 0, policy_version 1143149 (0.0009) [2023-12-26 08:43:05,859][123090] Updated weights for policy 1, policy_version 1134986 (0.0010) [2023-12-26 08:43:05,917][123090] Updated weights for policy 1, policy_version 1134996 (0.0009) [2023-12-26 08:43:05,920][123091] Updated weights for policy 0, policy_version 1143159 (0.0007) [2023-12-26 08:43:05,974][123091] Updated weights for policy 0, policy_version 1143169 (0.0006) [2023-12-26 08:43:05,977][123090] Updated weights for policy 1, policy_version 1135006 (0.0008) [2023-12-26 08:43:06,026][123091] Updated weights for policy 0, policy_version 1143179 (0.0005) [2023-12-26 08:43:06,830][123090] Updated weights for policy 1, policy_version 1135016 (0.0009) [2023-12-26 08:43:06,845][123091] Updated weights for policy 0, policy_version 1143189 (0.0008) [2023-12-26 08:43:06,887][123090] Updated weights for policy 1, policy_version 1135026 (0.0008) [2023-12-26 08:43:06,899][123091] Updated weights for policy 0, policy_version 1143199 (0.0007) [2023-12-26 08:43:06,947][123090] Updated weights for policy 1, policy_version 1135036 (0.0008) [2023-12-26 08:43:06,952][123091] Updated weights for policy 0, policy_version 1143209 (0.0008) [2023-12-26 08:43:07,772][123090] Updated weights for policy 1, policy_version 1135046 (0.0009) [2023-12-26 08:43:07,803][123091] Updated weights for policy 0, policy_version 1143219 (0.0009) [2023-12-26 08:43:07,824][123090] Updated weights for policy 1, policy_version 1135056 (0.0007) [2023-12-26 08:43:07,853][123091] Updated weights for policy 0, policy_version 1143229 (0.0008) [2023-12-26 08:43:07,873][123090] Updated weights for policy 1, policy_version 1135066 (0.0008) [2023-12-26 08:43:07,901][123091] Updated weights for policy 0, policy_version 1143239 (0.0008) [2023-12-26 08:43:08,721][123090] Updated weights for policy 1, policy_version 1135076 (0.0007) [2023-12-26 08:43:08,776][123091] Updated weights for policy 0, policy_version 1143249 (0.0009) [2023-12-26 08:43:08,780][123090] Updated weights for policy 1, policy_version 1135086 (0.0009) [2023-12-26 08:43:08,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 583254016. Throughput: 0: 8880.4, 1: 8867.4. Samples: 583238464. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:08,785][121949] Avg episode reward: [(0, '6175.488'), (1, '5705.915')] [2023-12-26 08:43:08,838][123090] Updated weights for policy 1, policy_version 1135096 (0.0010) [2023-12-26 08:43:08,845][123091] Updated weights for policy 0, policy_version 1143259 (0.0007) [2023-12-26 08:43:08,879][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001135104_290586624.pth... [2023-12-26 08:43:08,882][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001134080_290324480.pth [2023-12-26 08:43:08,905][123091] Updated weights for policy 0, policy_version 1143269 (0.0008) [2023-12-26 08:43:08,965][123091] Updated weights for policy 0, policy_version 1143279 (0.0010) [2023-12-26 08:43:08,969][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001143280_292683776.pth... [2023-12-26 08:43:08,973][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001142224_292413440.pth [2023-12-26 08:43:09,699][123090] Updated weights for policy 1, policy_version 1135106 (0.0008) [2023-12-26 08:43:09,767][123090] Updated weights for policy 1, policy_version 1135116 (0.0010) [2023-12-26 08:43:09,783][123091] Updated weights for policy 0, policy_version 1143289 (0.0008) [2023-12-26 08:43:09,836][123090] Updated weights for policy 1, policy_version 1135126 (0.0007) [2023-12-26 08:43:09,849][123091] Updated weights for policy 0, policy_version 1143299 (0.0009) [2023-12-26 08:43:09,902][123090] Updated weights for policy 1, policy_version 1135136 (0.0009) [2023-12-26 08:43:09,916][123091] Updated weights for policy 0, policy_version 1143309 (0.0010) [2023-12-26 08:43:10,715][123090] Updated weights for policy 1, policy_version 1135146 (0.0009) [2023-12-26 08:43:10,741][123091] Updated weights for policy 0, policy_version 1143319 (0.0010) [2023-12-26 08:43:10,766][123090] Updated weights for policy 1, policy_version 1135156 (0.0007) [2023-12-26 08:43:10,790][123091] Updated weights for policy 0, policy_version 1143329 (0.0010) [2023-12-26 08:43:10,819][123090] Updated weights for policy 1, policy_version 1135166 (0.0006) [2023-12-26 08:43:10,834][123091] Updated weights for policy 0, policy_version 1143339 (0.0010) [2023-12-26 08:43:11,710][123090] Updated weights for policy 1, policy_version 1135176 (0.0009) [2023-12-26 08:43:11,747][123091] Updated weights for policy 0, policy_version 1143349 (0.0009) [2023-12-26 08:43:11,781][123090] Updated weights for policy 1, policy_version 1135186 (0.0010) [2023-12-26 08:43:11,811][123091] Updated weights for policy 0, policy_version 1143359 (0.0009) [2023-12-26 08:43:11,842][123090] Updated weights for policy 1, policy_version 1135196 (0.0011) [2023-12-26 08:43:11,871][123091] Updated weights for policy 0, policy_version 1143369 (0.0006) [2023-12-26 08:43:12,625][123090] Updated weights for policy 1, policy_version 1135206 (0.0010) [2023-12-26 08:43:12,676][123090] Updated weights for policy 1, policy_version 1135216 (0.0009) [2023-12-26 08:43:12,717][123091] Updated weights for policy 0, policy_version 1143379 (0.0008) [2023-12-26 08:43:12,729][123090] Updated weights for policy 1, policy_version 1135226 (0.0009) [2023-12-26 08:43:12,778][123091] Updated weights for policy 0, policy_version 1143389 (0.0008) [2023-12-26 08:43:12,841][123091] Updated weights for policy 0, policy_version 1143399 (0.0009) [2023-12-26 08:43:13,564][123091] Updated weights for policy 0, policy_version 1143409 (0.0009) [2023-12-26 08:43:13,580][123090] Updated weights for policy 1, policy_version 1135236 (0.0008) [2023-12-26 08:43:13,638][123091] Updated weights for policy 0, policy_version 1143419 (0.0009) [2023-12-26 08:43:13,647][123090] Updated weights for policy 1, policy_version 1135246 (0.0009) [2023-12-26 08:43:13,685][123091] Updated weights for policy 0, policy_version 1143429 (0.0008) [2023-12-26 08:43:13,711][123090] Updated weights for policy 1, policy_version 1135256 (0.0008) [2023-12-26 08:43:13,739][123091] Updated weights for policy 0, policy_version 1143439 (0.0005) [2023-12-26 08:43:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 583352320. Throughput: 0: 8843.5, 1: 8760.0. Samples: 583340004. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:13,785][121949] Avg episode reward: [(0, '6244.112'), (1, '5639.384')] [2023-12-26 08:43:14,425][123091] Updated weights for policy 0, policy_version 1143449 (0.0005) [2023-12-26 08:43:14,490][123091] Updated weights for policy 0, policy_version 1143459 (0.0005) [2023-12-26 08:43:14,554][123091] Updated weights for policy 0, policy_version 1143469 (0.0009) [2023-12-26 08:43:14,566][123090] Updated weights for policy 1, policy_version 1135266 (0.0008) [2023-12-26 08:43:14,627][123090] Updated weights for policy 1, policy_version 1135276 (0.0008) [2023-12-26 08:43:14,678][123090] Updated weights for policy 1, policy_version 1135286 (0.0009) [2023-12-26 08:43:14,732][123090] Updated weights for policy 1, policy_version 1135296 (0.0009) [2023-12-26 08:43:15,297][123091] Updated weights for policy 0, policy_version 1143479 (0.0009) [2023-12-26 08:43:15,359][123091] Updated weights for policy 0, policy_version 1143489 (0.0009) [2023-12-26 08:43:15,434][123091] Updated weights for policy 0, policy_version 1143499 (0.0010) [2023-12-26 08:43:15,617][123090] Updated weights for policy 1, policy_version 1135306 (0.0008) [2023-12-26 08:43:15,665][123090] Updated weights for policy 1, policy_version 1135316 (0.0009) [2023-12-26 08:43:15,727][123090] Updated weights for policy 1, policy_version 1135326 (0.0008) [2023-12-26 08:43:16,143][123091] Updated weights for policy 0, policy_version 1143509 (0.0006) [2023-12-26 08:43:16,189][123091] Updated weights for policy 0, policy_version 1143519 (0.0005) [2023-12-26 08:43:16,244][123091] Updated weights for policy 0, policy_version 1143529 (0.0005) [2023-12-26 08:43:16,374][123090] Updated weights for policy 1, policy_version 1135336 (0.0006) [2023-12-26 08:43:16,432][123090] Updated weights for policy 1, policy_version 1135346 (0.0005) [2023-12-26 08:43:16,512][123090] Updated weights for policy 1, policy_version 1135356 (0.0006) [2023-12-26 08:43:16,906][123091] Updated weights for policy 0, policy_version 1143539 (0.0006) [2023-12-26 08:43:16,960][123091] Updated weights for policy 0, policy_version 1143549 (0.0006) [2023-12-26 08:43:17,004][123091] Updated weights for policy 0, policy_version 1143559 (0.0005) [2023-12-26 08:43:17,217][123090] Updated weights for policy 1, policy_version 1135366 (0.0006) [2023-12-26 08:43:17,275][123090] Updated weights for policy 1, policy_version 1135376 (0.0005) [2023-12-26 08:43:17,327][123090] Updated weights for policy 1, policy_version 1135386 (0.0005) [2023-12-26 08:43:17,819][123091] Updated weights for policy 0, policy_version 1143569 (0.0006) [2023-12-26 08:43:17,872][123091] Updated weights for policy 0, policy_version 1143579 (0.0005) [2023-12-26 08:43:17,921][123091] Updated weights for policy 0, policy_version 1143589 (0.0005) [2023-12-26 08:43:17,968][123091] Updated weights for policy 0, policy_version 1143599 (0.0005) [2023-12-26 08:43:18,060][123090] Updated weights for policy 1, policy_version 1135396 (0.0007) [2023-12-26 08:43:18,129][123090] Updated weights for policy 1, policy_version 1135406 (0.0006) [2023-12-26 08:43:18,188][123090] Updated weights for policy 1, policy_version 1135416 (0.0005) [2023-12-26 08:43:18,636][123091] Updated weights for policy 0, policy_version 1143609 (0.0006) [2023-12-26 08:43:18,694][123091] Updated weights for policy 0, policy_version 1143619 (0.0006) [2023-12-26 08:43:18,761][123091] Updated weights for policy 0, policy_version 1143629 (0.0007) [2023-12-26 08:43:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 583442432. Throughput: 0: 8939.9, 1: 8794.8. Samples: 583453108. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:18,785][121949] Avg episode reward: [(0, '6279.582'), (1, '5512.513')] [2023-12-26 08:43:18,907][123090] Updated weights for policy 1, policy_version 1135426 (0.0005) [2023-12-26 08:43:18,971][123090] Updated weights for policy 1, policy_version 1135436 (0.0006) [2023-12-26 08:43:19,042][123090] Updated weights for policy 1, policy_version 1135446 (0.0007) [2023-12-26 08:43:19,119][123090] Updated weights for policy 1, policy_version 1135456 (0.0005) [2023-12-26 08:43:19,501][123091] Updated weights for policy 0, policy_version 1143639 (0.0009) [2023-12-26 08:43:19,566][123091] Updated weights for policy 0, policy_version 1143649 (0.0010) [2023-12-26 08:43:19,623][123091] Updated weights for policy 0, policy_version 1143659 (0.0010) [2023-12-26 08:43:19,748][123090] Updated weights for policy 1, policy_version 1135466 (0.0007) [2023-12-26 08:43:19,834][123090] Updated weights for policy 1, policy_version 1135476 (0.0006) [2023-12-26 08:43:19,898][123090] Updated weights for policy 1, policy_version 1135486 (0.0005) [2023-12-26 08:43:20,505][123091] Updated weights for policy 0, policy_version 1143669 (0.0008) [2023-12-26 08:43:20,571][123091] Updated weights for policy 0, policy_version 1143679 (0.0010) [2023-12-26 08:43:20,637][123091] Updated weights for policy 0, policy_version 1143689 (0.0009) [2023-12-26 08:43:20,652][123090] Updated weights for policy 1, policy_version 1135496 (0.0009) [2023-12-26 08:43:20,710][123090] Updated weights for policy 1, policy_version 1135506 (0.0008) [2023-12-26 08:43:20,776][123090] Updated weights for policy 1, policy_version 1135516 (0.0009) [2023-12-26 08:43:21,512][123091] Updated weights for policy 0, policy_version 1143699 (0.0008) [2023-12-26 08:43:21,512][123090] Updated weights for policy 1, policy_version 1135526 (0.0008) [2023-12-26 08:43:21,575][123091] Updated weights for policy 0, policy_version 1143709 (0.0009) [2023-12-26 08:43:21,577][123090] Updated weights for policy 1, policy_version 1135536 (0.0007) [2023-12-26 08:43:21,640][123091] Updated weights for policy 0, policy_version 1143719 (0.0008) [2023-12-26 08:43:21,642][123090] Updated weights for policy 1, policy_version 1135546 (0.0008) [2023-12-26 08:43:22,348][123090] Updated weights for policy 1, policy_version 1135556 (0.0009) [2023-12-26 08:43:22,417][123090] Updated weights for policy 1, policy_version 1135566 (0.0010) [2023-12-26 08:43:22,479][123090] Updated weights for policy 1, policy_version 1135576 (0.0007) [2023-12-26 08:43:22,534][123091] Updated weights for policy 0, policy_version 1143729 (0.0008) [2023-12-26 08:43:22,584][123091] Updated weights for policy 0, policy_version 1143739 (0.0009) [2023-12-26 08:43:22,649][123091] Updated weights for policy 0, policy_version 1143749 (0.0008) [2023-12-26 08:43:22,703][123091] Updated weights for policy 0, policy_version 1143759 (0.0009) [2023-12-26 08:43:23,353][123090] Updated weights for policy 1, policy_version 1135586 (0.0007) [2023-12-26 08:43:23,414][123090] Updated weights for policy 1, policy_version 1135596 (0.0009) [2023-12-26 08:43:23,464][123090] Updated weights for policy 1, policy_version 1135606 (0.0008) [2023-12-26 08:43:23,489][123091] Updated weights for policy 0, policy_version 1143769 (0.0008) [2023-12-26 08:43:23,513][123090] Updated weights for policy 1, policy_version 1135616 (0.0007) [2023-12-26 08:43:23,539][123091] Updated weights for policy 0, policy_version 1143779 (0.0009) [2023-12-26 08:43:23,592][123091] Updated weights for policy 0, policy_version 1143789 (0.0010) [2023-12-26 08:43:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 583532544. Throughput: 0: 8862.1, 1: 8828.9. Samples: 583505588. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:23,785][121949] Avg episode reward: [(0, '6329.788'), (1, '5566.718')] [2023-12-26 08:43:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001135616_290717696.pth... [2023-12-26 08:43:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001143792_292814848.pth... [2023-12-26 08:43:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001134592_290455552.pth [2023-12-26 08:43:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001142768_292552704.pth [2023-12-26 08:43:24,204][123091] Updated weights for policy 0, policy_version 1143800 (0.0010) [2023-12-26 08:43:24,259][123091] Updated weights for policy 0, policy_version 1143810 (0.0008) [2023-12-26 08:43:24,310][123091] Updated weights for policy 0, policy_version 1143820 (0.0008) [2023-12-26 08:43:24,372][123090] Updated weights for policy 1, policy_version 1135626 (0.0008) [2023-12-26 08:43:24,435][123090] Updated weights for policy 1, policy_version 1135636 (0.0005) [2023-12-26 08:43:24,499][123090] Updated weights for policy 1, policy_version 1135646 (0.0005) [2023-12-26 08:43:25,173][123091] Updated weights for policy 0, policy_version 1143830 (0.0007) [2023-12-26 08:43:25,208][123090] Updated weights for policy 1, policy_version 1135656 (0.0005) [2023-12-26 08:43:25,244][123091] Updated weights for policy 0, policy_version 1143840 (0.0009) [2023-12-26 08:43:25,269][123090] Updated weights for policy 1, policy_version 1135666 (0.0008) [2023-12-26 08:43:25,313][123091] Updated weights for policy 0, policy_version 1143850 (0.0009) [2023-12-26 08:43:25,317][123090] Updated weights for policy 1, policy_version 1135676 (0.0006) [2023-12-26 08:43:25,987][123090] Updated weights for policy 1, policy_version 1135686 (0.0006) [2023-12-26 08:43:26,056][123090] Updated weights for policy 1, policy_version 1135696 (0.0006) [2023-12-26 08:43:26,111][123090] Updated weights for policy 1, policy_version 1135706 (0.0008) [2023-12-26 08:43:26,198][123091] Updated weights for policy 0, policy_version 1143860 (0.0009) [2023-12-26 08:43:26,245][123091] Updated weights for policy 0, policy_version 1143870 (0.0006) [2023-12-26 08:43:26,306][123091] Updated weights for policy 0, policy_version 1143880 (0.0008) [2023-12-26 08:43:26,752][123090] Updated weights for policy 1, policy_version 1135716 (0.0006) [2023-12-26 08:43:26,807][123090] Updated weights for policy 1, policy_version 1135726 (0.0006) [2023-12-26 08:43:26,863][123090] Updated weights for policy 1, policy_version 1135736 (0.0005) [2023-12-26 08:43:27,112][123091] Updated weights for policy 0, policy_version 1143890 (0.0008) [2023-12-26 08:43:27,170][123091] Updated weights for policy 0, policy_version 1143900 (0.0010) [2023-12-26 08:43:27,226][123091] Updated weights for policy 0, policy_version 1143910 (0.0010) [2023-12-26 08:43:27,283][123091] Updated weights for policy 0, policy_version 1143920 (0.0010) [2023-12-26 08:43:27,586][123090] Updated weights for policy 1, policy_version 1135746 (0.0006) [2023-12-26 08:43:27,642][123090] Updated weights for policy 1, policy_version 1135756 (0.0009) [2023-12-26 08:43:27,689][123090] Updated weights for policy 1, policy_version 1135766 (0.0005) [2023-12-26 08:43:27,740][123090] Updated weights for policy 1, policy_version 1135776 (0.0005) [2023-12-26 08:43:28,069][123091] Updated weights for policy 0, policy_version 1143930 (0.0010) [2023-12-26 08:43:28,115][123091] Updated weights for policy 0, policy_version 1143940 (0.0009) [2023-12-26 08:43:28,163][123091] Updated weights for policy 0, policy_version 1143950 (0.0005) [2023-12-26 08:43:28,442][123090] Updated weights for policy 1, policy_version 1135786 (0.0005) [2023-12-26 08:43:28,498][123090] Updated weights for policy 1, policy_version 1135796 (0.0005) [2023-12-26 08:43:28,547][123090] Updated weights for policy 1, policy_version 1135806 (0.0005) [2023-12-26 08:43:28,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.7, 300 sec: 17828.0). Total num frames: 583622656. Throughput: 0: 8840.9, 1: 8943.8. Samples: 583614512. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:28,786][121949] Avg episode reward: [(0, '6223.164'), (1, '5780.476')] [2023-12-26 08:43:28,847][123091] Updated weights for policy 0, policy_version 1143960 (0.0006) [2023-12-26 08:43:28,909][123091] Updated weights for policy 0, policy_version 1143970 (0.0006) [2023-12-26 08:43:28,977][123091] Updated weights for policy 0, policy_version 1143980 (0.0006) [2023-12-26 08:43:29,286][123090] Updated weights for policy 1, policy_version 1135816 (0.0009) [2023-12-26 08:43:29,361][123090] Updated weights for policy 1, policy_version 1135826 (0.0011) [2023-12-26 08:43:29,427][123090] Updated weights for policy 1, policy_version 1135836 (0.0010) [2023-12-26 08:43:29,626][123091] Updated weights for policy 0, policy_version 1143990 (0.0005) [2023-12-26 08:43:29,683][123091] Updated weights for policy 0, policy_version 1144000 (0.0006) [2023-12-26 08:43:29,743][123091] Updated weights for policy 0, policy_version 1144010 (0.0005) [2023-12-26 08:43:30,224][123090] Updated weights for policy 1, policy_version 1135846 (0.0010) [2023-12-26 08:43:30,279][123090] Updated weights for policy 1, policy_version 1135856 (0.0010) [2023-12-26 08:43:30,339][123090] Updated weights for policy 1, policy_version 1135866 (0.0011) [2023-12-26 08:43:30,446][123091] Updated weights for policy 0, policy_version 1144020 (0.0007) [2023-12-26 08:43:30,509][123091] Updated weights for policy 0, policy_version 1144030 (0.0008) [2023-12-26 08:43:30,572][123091] Updated weights for policy 0, policy_version 1144040 (0.0009) [2023-12-26 08:43:31,057][123090] Updated weights for policy 1, policy_version 1135876 (0.0010) [2023-12-26 08:43:31,119][123090] Updated weights for policy 1, policy_version 1135886 (0.0010) [2023-12-26 08:43:31,187][123090] Updated weights for policy 1, policy_version 1135896 (0.0010) [2023-12-26 08:43:31,339][123091] Updated weights for policy 0, policy_version 1144050 (0.0010) [2023-12-26 08:43:31,409][123091] Updated weights for policy 0, policy_version 1144060 (0.0011) [2023-12-26 08:43:31,475][123091] Updated weights for policy 0, policy_version 1144070 (0.0009) [2023-12-26 08:43:31,535][123091] Updated weights for policy 0, policy_version 1144080 (0.0009) [2023-12-26 08:43:31,975][123090] Updated weights for policy 1, policy_version 1135906 (0.0009) [2023-12-26 08:43:32,049][123090] Updated weights for policy 1, policy_version 1135916 (0.0006) [2023-12-26 08:43:32,118][123090] Updated weights for policy 1, policy_version 1135926 (0.0006) [2023-12-26 08:43:32,169][123090] Updated weights for policy 1, policy_version 1135936 (0.0006) [2023-12-26 08:43:32,360][123091] Updated weights for policy 0, policy_version 1144090 (0.0007) [2023-12-26 08:43:32,427][123091] Updated weights for policy 0, policy_version 1144100 (0.0009) [2023-12-26 08:43:32,497][123091] Updated weights for policy 0, policy_version 1144110 (0.0010) [2023-12-26 08:43:32,845][123090] Updated weights for policy 1, policy_version 1135946 (0.0010) [2023-12-26 08:43:32,905][123090] Updated weights for policy 1, policy_version 1135956 (0.0010) [2023-12-26 08:43:32,968][123090] Updated weights for policy 1, policy_version 1135966 (0.0010) [2023-12-26 08:43:33,148][123091] Updated weights for policy 0, policy_version 1144120 (0.0010) [2023-12-26 08:43:33,198][123091] Updated weights for policy 0, policy_version 1144131 (0.0010) [2023-12-26 08:43:33,249][123091] Updated weights for policy 0, policy_version 1144141 (0.0009) [2023-12-26 08:43:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 583712768. Throughput: 0: 8860.0, 1: 9031.1. Samples: 583726536. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:33,785][121949] Avg episode reward: [(0, '6230.818'), (1, '5723.104')] [2023-12-26 08:43:33,826][123090] Updated weights for policy 1, policy_version 1135976 (0.0009) [2023-12-26 08:43:33,885][123090] Updated weights for policy 1, policy_version 1135986 (0.0009) [2023-12-26 08:43:33,933][123090] Updated weights for policy 1, policy_version 1135996 (0.0008) [2023-12-26 08:43:34,090][123091] Updated weights for policy 0, policy_version 1144151 (0.0009) [2023-12-26 08:43:34,165][123091] Updated weights for policy 0, policy_version 1144161 (0.0009) [2023-12-26 08:43:34,223][123091] Updated weights for policy 0, policy_version 1144171 (0.0010) [2023-12-26 08:43:34,754][123090] Updated weights for policy 1, policy_version 1136006 (0.0007) [2023-12-26 08:43:34,816][123090] Updated weights for policy 1, policy_version 1136016 (0.0008) [2023-12-26 08:43:34,863][123090] Updated weights for policy 1, policy_version 1136026 (0.0007) [2023-12-26 08:43:35,087][123091] Updated weights for policy 0, policy_version 1144181 (0.0008) [2023-12-26 08:43:35,149][123091] Updated weights for policy 0, policy_version 1144191 (0.0005) [2023-12-26 08:43:35,217][123091] Updated weights for policy 0, policy_version 1144201 (0.0005) [2023-12-26 08:43:35,575][123090] Updated weights for policy 1, policy_version 1136036 (0.0009) [2023-12-26 08:43:35,634][123090] Updated weights for policy 1, policy_version 1136046 (0.0009) [2023-12-26 08:43:35,696][123090] Updated weights for policy 1, policy_version 1136056 (0.0009) [2023-12-26 08:43:35,998][123091] Updated weights for policy 0, policy_version 1144211 (0.0007) [2023-12-26 08:43:36,055][123091] Updated weights for policy 0, policy_version 1144221 (0.0009) [2023-12-26 08:43:36,111][123091] Updated weights for policy 0, policy_version 1144231 (0.0008) [2023-12-26 08:43:36,546][123090] Updated weights for policy 1, policy_version 1136066 (0.0010) [2023-12-26 08:43:36,610][123090] Updated weights for policy 1, policy_version 1136076 (0.0007) [2023-12-26 08:43:36,670][123090] Updated weights for policy 1, policy_version 1136086 (0.0009) [2023-12-26 08:43:36,725][123090] Updated weights for policy 1, policy_version 1136096 (0.0009) [2023-12-26 08:43:36,957][123091] Updated weights for policy 0, policy_version 1144241 (0.0010) [2023-12-26 08:43:37,025][123091] Updated weights for policy 0, policy_version 1144251 (0.0006) [2023-12-26 08:43:37,094][123091] Updated weights for policy 0, policy_version 1144261 (0.0005) [2023-12-26 08:43:37,164][123091] Updated weights for policy 0, policy_version 1144271 (0.0007) [2023-12-26 08:43:37,633][123090] Updated weights for policy 1, policy_version 1136106 (0.0010) [2023-12-26 08:43:37,696][123090] Updated weights for policy 1, policy_version 1136116 (0.0010) [2023-12-26 08:43:37,761][123090] Updated weights for policy 1, policy_version 1136126 (0.0009) [2023-12-26 08:43:37,868][123091] Updated weights for policy 0, policy_version 1144281 (0.0010) [2023-12-26 08:43:37,924][123091] Updated weights for policy 0, policy_version 1144291 (0.0010) [2023-12-26 08:43:37,978][123091] Updated weights for policy 0, policy_version 1144301 (0.0009) [2023-12-26 08:43:38,562][123090] Updated weights for policy 1, policy_version 1136137 (0.0010) [2023-12-26 08:43:38,618][123090] Updated weights for policy 1, policy_version 1136148 (0.0011) [2023-12-26 08:43:38,693][123090] Updated weights for policy 1, policy_version 1136158 (0.0010) [2023-12-26 08:43:38,778][123091] Updated weights for policy 0, policy_version 1144311 (0.0008) [2023-12-26 08:43:38,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 583802880. Throughput: 0: 8847.4, 1: 9045.3. Samples: 583779136. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:38,785][121949] Avg episode reward: [(0, '6334.116'), (1, '5698.343')] [2023-12-26 08:43:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001136160_290856960.pth... [2023-12-26 08:43:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001135104_290586624.pth [2023-12-26 08:43:38,845][123091] Updated weights for policy 0, policy_version 1144321 (0.0009) [2023-12-26 08:43:38,898][123091] Updated weights for policy 0, policy_version 1144331 (0.0009) [2023-12-26 08:43:38,928][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001144336_292954112.pth... [2023-12-26 08:43:38,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001143280_292683776.pth [2023-12-26 08:43:39,549][123090] Updated weights for policy 1, policy_version 1136168 (0.0010) [2023-12-26 08:43:39,600][123090] Updated weights for policy 1, policy_version 1136178 (0.0009) [2023-12-26 08:43:39,662][123090] Updated weights for policy 1, policy_version 1136188 (0.0009) [2023-12-26 08:43:39,746][123091] Updated weights for policy 0, policy_version 1144341 (0.0008) [2023-12-26 08:43:39,814][123091] Updated weights for policy 0, policy_version 1144351 (0.0007) [2023-12-26 08:43:39,881][123091] Updated weights for policy 0, policy_version 1144361 (0.0008) [2023-12-26 08:43:40,597][123090] Updated weights for policy 1, policy_version 1136198 (0.0009) [2023-12-26 08:43:40,630][123091] Updated weights for policy 0, policy_version 1144371 (0.0007) [2023-12-26 08:43:40,667][123090] Updated weights for policy 1, policy_version 1136208 (0.0009) [2023-12-26 08:43:40,701][123091] Updated weights for policy 0, policy_version 1144381 (0.0008) [2023-12-26 08:43:40,723][123090] Updated weights for policy 1, policy_version 1136218 (0.0008) [2023-12-26 08:43:40,764][123091] Updated weights for policy 0, policy_version 1144391 (0.0009) [2023-12-26 08:43:41,593][123091] Updated weights for policy 0, policy_version 1144401 (0.0008) [2023-12-26 08:43:41,624][123090] Updated weights for policy 1, policy_version 1136228 (0.0009) [2023-12-26 08:43:41,676][123091] Updated weights for policy 0, policy_version 1144411 (0.0008) [2023-12-26 08:43:41,692][123090] Updated weights for policy 1, policy_version 1136238 (0.0010) [2023-12-26 08:43:41,731][123091] Updated weights for policy 0, policy_version 1144421 (0.0008) [2023-12-26 08:43:41,756][123090] Updated weights for policy 1, policy_version 1136248 (0.0008) [2023-12-26 08:43:41,790][123091] Updated weights for policy 0, policy_version 1144431 (0.0009) [2023-12-26 08:43:42,550][123090] Updated weights for policy 1, policy_version 1136258 (0.0007) [2023-12-26 08:43:42,611][123090] Updated weights for policy 1, policy_version 1136268 (0.0007) [2023-12-26 08:43:42,651][123091] Updated weights for policy 0, policy_version 1144441 (0.0009) [2023-12-26 08:43:42,677][123090] Updated weights for policy 1, policy_version 1136278 (0.0005) [2023-12-26 08:43:42,719][123091] Updated weights for policy 0, policy_version 1144451 (0.0010) [2023-12-26 08:43:42,749][123090] Updated weights for policy 1, policy_version 1136288 (0.0006) [2023-12-26 08:43:42,784][123091] Updated weights for policy 0, policy_version 1144461 (0.0009) [2023-12-26 08:43:43,400][123090] Updated weights for policy 1, policy_version 1136298 (0.0009) [2023-12-26 08:43:43,449][123090] Updated weights for policy 1, policy_version 1136308 (0.0009) [2023-12-26 08:43:43,497][123090] Updated weights for policy 1, policy_version 1136318 (0.0009) [2023-12-26 08:43:43,594][123091] Updated weights for policy 0, policy_version 1144471 (0.0009) [2023-12-26 08:43:43,647][123091] Updated weights for policy 0, policy_version 1144481 (0.0009) [2023-12-26 08:43:43,703][123091] Updated weights for policy 0, policy_version 1144491 (0.0008) [2023-12-26 08:43:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 583892992. Throughput: 0: 8883.5, 1: 8870.4. Samples: 583881180. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:43,785][121949] Avg episode reward: [(0, '6305.096'), (1, '5769.335')] [2023-12-26 08:43:44,367][123090] Updated weights for policy 1, policy_version 1136328 (0.0009) [2023-12-26 08:43:44,427][123090] Updated weights for policy 1, policy_version 1136338 (0.0008) [2023-12-26 08:43:44,484][123090] Updated weights for policy 1, policy_version 1136348 (0.0007) [2023-12-26 08:43:44,494][123091] Updated weights for policy 0, policy_version 1144501 (0.0008) [2023-12-26 08:43:44,552][123091] Updated weights for policy 0, policy_version 1144511 (0.0010) [2023-12-26 08:43:44,622][123091] Updated weights for policy 0, policy_version 1144521 (0.0010) [2023-12-26 08:43:45,339][123091] Updated weights for policy 0, policy_version 1144531 (0.0010) [2023-12-26 08:43:45,380][123090] Updated weights for policy 1, policy_version 1136358 (0.0007) [2023-12-26 08:43:45,406][123091] Updated weights for policy 0, policy_version 1144541 (0.0011) [2023-12-26 08:43:45,430][123090] Updated weights for policy 1, policy_version 1136368 (0.0008) [2023-12-26 08:43:45,462][123091] Updated weights for policy 0, policy_version 1144551 (0.0011) [2023-12-26 08:43:45,479][123090] Updated weights for policy 1, policy_version 1136378 (0.0009) [2023-12-26 08:43:46,224][123091] Updated weights for policy 0, policy_version 1144561 (0.0010) [2023-12-26 08:43:46,256][123090] Updated weights for policy 1, policy_version 1136388 (0.0009) [2023-12-26 08:43:46,292][123091] Updated weights for policy 0, policy_version 1144571 (0.0011) [2023-12-26 08:43:46,308][123090] Updated weights for policy 1, policy_version 1136398 (0.0010) [2023-12-26 08:43:46,355][123091] Updated weights for policy 0, policy_version 1144581 (0.0011) [2023-12-26 08:43:46,361][123090] Updated weights for policy 1, policy_version 1136408 (0.0010) [2023-12-26 08:43:46,417][123091] Updated weights for policy 0, policy_version 1144591 (0.0011) [2023-12-26 08:43:47,026][123091] Updated weights for policy 0, policy_version 1144601 (0.0008) [2023-12-26 08:43:47,078][123090] Updated weights for policy 1, policy_version 1136418 (0.0010) [2023-12-26 08:43:47,089][123091] Updated weights for policy 0, policy_version 1144611 (0.0010) [2023-12-26 08:43:47,131][123090] Updated weights for policy 1, policy_version 1136428 (0.0006) [2023-12-26 08:43:47,156][123091] Updated weights for policy 0, policy_version 1144621 (0.0011) [2023-12-26 08:43:47,187][123090] Updated weights for policy 1, policy_version 1136438 (0.0007) [2023-12-26 08:43:47,253][123090] Updated weights for policy 1, policy_version 1136448 (0.0006) [2023-12-26 08:43:47,961][123091] Updated weights for policy 0, policy_version 1144631 (0.0007) [2023-12-26 08:43:47,985][123090] Updated weights for policy 1, policy_version 1136458 (0.0011) [2023-12-26 08:43:48,010][123091] Updated weights for policy 0, policy_version 1144641 (0.0005) [2023-12-26 08:43:48,042][123090] Updated weights for policy 1, policy_version 1136468 (0.0009) [2023-12-26 08:43:48,062][123091] Updated weights for policy 0, policy_version 1144651 (0.0005) [2023-12-26 08:43:48,101][123090] Updated weights for policy 1, policy_version 1136478 (0.0005) [2023-12-26 08:43:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 583974912. Throughput: 0: 8931.7, 1: 8929.8. Samples: 583990744. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:48,785][121949] Avg episode reward: [(0, '6152.871'), (1, '5851.328')] [2023-12-26 08:43:48,813][123091] Updated weights for policy 0, policy_version 1144661 (0.0008) [2023-12-26 08:43:48,872][123091] Updated weights for policy 0, policy_version 1144671 (0.0010) [2023-12-26 08:43:48,894][123090] Updated weights for policy 1, policy_version 1136488 (0.0011) [2023-12-26 08:43:48,924][123091] Updated weights for policy 0, policy_version 1144681 (0.0010) [2023-12-26 08:43:48,962][123090] Updated weights for policy 1, policy_version 1136498 (0.0010) [2023-12-26 08:43:49,032][123090] Updated weights for policy 1, policy_version 1136508 (0.0010) [2023-12-26 08:43:49,785][123091] Updated weights for policy 0, policy_version 1144691 (0.0010) [2023-12-26 08:43:49,811][123090] Updated weights for policy 1, policy_version 1136518 (0.0007) [2023-12-26 08:43:49,846][123091] Updated weights for policy 0, policy_version 1144701 (0.0010) [2023-12-26 08:43:49,881][123090] Updated weights for policy 1, policy_version 1136528 (0.0009) [2023-12-26 08:43:49,910][123091] Updated weights for policy 0, policy_version 1144711 (0.0009) [2023-12-26 08:43:49,952][123090] Updated weights for policy 1, policy_version 1136538 (0.0009) [2023-12-26 08:43:50,701][123090] Updated weights for policy 1, policy_version 1136548 (0.0008) [2023-12-26 08:43:50,776][123090] Updated weights for policy 1, policy_version 1136558 (0.0006) [2023-12-26 08:43:50,792][123091] Updated weights for policy 0, policy_version 1144721 (0.0009) [2023-12-26 08:43:50,850][123090] Updated weights for policy 1, policy_version 1136568 (0.0007) [2023-12-26 08:43:50,851][123091] Updated weights for policy 0, policy_version 1144731 (0.0007) [2023-12-26 08:43:50,930][123091] Updated weights for policy 0, policy_version 1144741 (0.0008) [2023-12-26 08:43:50,988][123091] Updated weights for policy 0, policy_version 1144751 (0.0009) [2023-12-26 08:43:51,602][123090] Updated weights for policy 1, policy_version 1136578 (0.0011) [2023-12-26 08:43:51,676][123090] Updated weights for policy 1, policy_version 1136588 (0.0009) [2023-12-26 08:43:51,752][123090] Updated weights for policy 1, policy_version 1136598 (0.0009) [2023-12-26 08:43:51,816][123090] Updated weights for policy 1, policy_version 1136608 (0.0008) [2023-12-26 08:43:51,823][123091] Updated weights for policy 0, policy_version 1144761 (0.0010) [2023-12-26 08:43:51,882][123091] Updated weights for policy 0, policy_version 1144771 (0.0010) [2023-12-26 08:43:51,941][123091] Updated weights for policy 0, policy_version 1144781 (0.0009) [2023-12-26 08:43:52,587][123090] Updated weights for policy 1, policy_version 1136618 (0.0010) [2023-12-26 08:43:52,641][123090] Updated weights for policy 1, policy_version 1136628 (0.0009) [2023-12-26 08:43:52,705][123090] Updated weights for policy 1, policy_version 1136638 (0.0008) [2023-12-26 08:43:52,816][123091] Updated weights for policy 0, policy_version 1144791 (0.0007) [2023-12-26 08:43:52,864][123091] Updated weights for policy 0, policy_version 1144801 (0.0005) [2023-12-26 08:43:52,912][123091] Updated weights for policy 0, policy_version 1144811 (0.0005) [2023-12-26 08:43:53,354][123090] Updated weights for policy 1, policy_version 1136648 (0.0006) [2023-12-26 08:43:53,423][123090] Updated weights for policy 1, policy_version 1136658 (0.0005) [2023-12-26 08:43:53,477][123090] Updated weights for policy 1, policy_version 1136668 (0.0005) [2023-12-26 08:43:53,638][123091] Updated weights for policy 0, policy_version 1144821 (0.0005) [2023-12-26 08:43:53,706][123091] Updated weights for policy 0, policy_version 1144831 (0.0009) [2023-12-26 08:43:53,769][123091] Updated weights for policy 0, policy_version 1144841 (0.0010) [2023-12-26 08:43:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 584065024. Throughput: 0: 8903.0, 1: 8948.1. Samples: 584041764. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:53,785][121949] Avg episode reward: [(0, '6167.147'), (1, '5814.465')] [2023-12-26 08:43:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001136672_290988032.pth... [2023-12-26 08:43:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001135616_290717696.pth [2023-12-26 08:43:53,810][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001144848_293085184.pth... [2023-12-26 08:43:53,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001143792_292814848.pth [2023-12-26 08:43:54,186][123090] Updated weights for policy 1, policy_version 1136678 (0.0005) [2023-12-26 08:43:54,237][123090] Updated weights for policy 1, policy_version 1136688 (0.0005) [2023-12-26 08:43:54,290][123090] Updated weights for policy 1, policy_version 1136698 (0.0008) [2023-12-26 08:43:54,640][123091] Updated weights for policy 0, policy_version 1144851 (0.0010) [2023-12-26 08:43:54,689][123091] Updated weights for policy 0, policy_version 1144861 (0.0009) [2023-12-26 08:43:54,741][123091] Updated weights for policy 0, policy_version 1144871 (0.0009) [2023-12-26 08:43:55,081][123090] Updated weights for policy 1, policy_version 1136708 (0.0010) [2023-12-26 08:43:55,139][123090] Updated weights for policy 1, policy_version 1136718 (0.0009) [2023-12-26 08:43:55,198][123090] Updated weights for policy 1, policy_version 1136728 (0.0009) [2023-12-26 08:43:55,598][123091] Updated weights for policy 0, policy_version 1144881 (0.0009) [2023-12-26 08:43:55,652][123091] Updated weights for policy 0, policy_version 1144893 (0.0010) [2023-12-26 08:43:55,706][123091] Updated weights for policy 0, policy_version 1144903 (0.0009) [2023-12-26 08:43:55,931][123090] Updated weights for policy 1, policy_version 1136738 (0.0010) [2023-12-26 08:43:55,987][123090] Updated weights for policy 1, policy_version 1136748 (0.0009) [2023-12-26 08:43:56,040][123090] Updated weights for policy 1, policy_version 1136758 (0.0010) [2023-12-26 08:43:56,104][123090] Updated weights for policy 1, policy_version 1136768 (0.0010) [2023-12-26 08:43:56,379][123091] Updated weights for policy 0, policy_version 1144913 (0.0009) [2023-12-26 08:43:56,425][123091] Updated weights for policy 0, policy_version 1144923 (0.0008) [2023-12-26 08:43:56,489][123091] Updated weights for policy 0, policy_version 1144933 (0.0010) [2023-12-26 08:43:56,551][123091] Updated weights for policy 0, policy_version 1144943 (0.0010) [2023-12-26 08:43:57,011][123090] Updated weights for policy 1, policy_version 1136778 (0.0009) [2023-12-26 08:43:57,080][123090] Updated weights for policy 1, policy_version 1136788 (0.0009) [2023-12-26 08:43:57,152][123090] Updated weights for policy 1, policy_version 1136798 (0.0009) [2023-12-26 08:43:57,371][123091] Updated weights for policy 0, policy_version 1144953 (0.0010) [2023-12-26 08:43:57,426][123091] Updated weights for policy 0, policy_version 1144963 (0.0010) [2023-12-26 08:43:57,479][123091] Updated weights for policy 0, policy_version 1144973 (0.0010) [2023-12-26 08:43:57,950][123090] Updated weights for policy 1, policy_version 1136808 (0.0009) [2023-12-26 08:43:57,998][123090] Updated weights for policy 1, policy_version 1136818 (0.0009) [2023-12-26 08:43:58,068][123090] Updated weights for policy 1, policy_version 1136828 (0.0008) [2023-12-26 08:43:58,327][123091] Updated weights for policy 0, policy_version 1144983 (0.0010) [2023-12-26 08:43:58,386][123091] Updated weights for policy 0, policy_version 1144993 (0.0010) [2023-12-26 08:43:58,452][123091] Updated weights for policy 0, policy_version 1145003 (0.0010) [2023-12-26 08:43:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 584155136. Throughput: 0: 8955.1, 1: 9021.8. Samples: 584148964. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:43:58,785][121949] Avg episode reward: [(0, '6198.727'), (1, '5754.955')] [2023-12-26 08:43:59,009][123090] Updated weights for policy 1, policy_version 1136838 (0.0010) [2023-12-26 08:43:59,072][123090] Updated weights for policy 1, policy_version 1136848 (0.0008) [2023-12-26 08:43:59,143][123090] Updated weights for policy 1, policy_version 1136858 (0.0007) [2023-12-26 08:43:59,407][123091] Updated weights for policy 0, policy_version 1145013 (0.0009) [2023-12-26 08:43:59,472][123091] Updated weights for policy 0, policy_version 1145023 (0.0009) [2023-12-26 08:43:59,538][123091] Updated weights for policy 0, policy_version 1145033 (0.0008) [2023-12-26 08:44:00,037][123090] Updated weights for policy 1, policy_version 1136868 (0.0009) [2023-12-26 08:44:00,097][123090] Updated weights for policy 1, policy_version 1136878 (0.0006) [2023-12-26 08:44:00,149][123090] Updated weights for policy 1, policy_version 1136888 (0.0005) [2023-12-26 08:44:00,251][123091] Updated weights for policy 0, policy_version 1145043 (0.0005) [2023-12-26 08:44:00,321][123091] Updated weights for policy 0, policy_version 1145053 (0.0005) [2023-12-26 08:44:00,382][123091] Updated weights for policy 0, policy_version 1145063 (0.0005) [2023-12-26 08:44:01,004][123090] Updated weights for policy 1, policy_version 1136898 (0.0006) [2023-12-26 08:44:01,053][123091] Updated weights for policy 0, policy_version 1145073 (0.0006) [2023-12-26 08:44:01,074][123090] Updated weights for policy 1, policy_version 1136908 (0.0009) [2023-12-26 08:44:01,107][123091] Updated weights for policy 0, policy_version 1145083 (0.0006) [2023-12-26 08:44:01,142][123090] Updated weights for policy 1, policy_version 1136918 (0.0008) [2023-12-26 08:44:01,177][123091] Updated weights for policy 0, policy_version 1145093 (0.0007) [2023-12-26 08:44:01,209][123090] Updated weights for policy 1, policy_version 1136928 (0.0008) [2023-12-26 08:44:01,243][123091] Updated weights for policy 0, policy_version 1145103 (0.0007) [2023-12-26 08:44:02,016][123091] Updated weights for policy 0, policy_version 1145113 (0.0011) [2023-12-26 08:44:02,062][123090] Updated weights for policy 1, policy_version 1136938 (0.0007) [2023-12-26 08:44:02,076][123091] Updated weights for policy 0, policy_version 1145123 (0.0010) [2023-12-26 08:44:02,121][123090] Updated weights for policy 1, policy_version 1136948 (0.0008) [2023-12-26 08:44:02,136][123091] Updated weights for policy 0, policy_version 1145133 (0.0011) [2023-12-26 08:44:02,183][123090] Updated weights for policy 1, policy_version 1136958 (0.0008) [2023-12-26 08:44:02,966][123091] Updated weights for policy 0, policy_version 1145143 (0.0009) [2023-12-26 08:44:02,997][123090] Updated weights for policy 1, policy_version 1136968 (0.0006) [2023-12-26 08:44:03,024][123091] Updated weights for policy 0, policy_version 1145153 (0.0006) [2023-12-26 08:44:03,066][123090] Updated weights for policy 1, policy_version 1136978 (0.0005) [2023-12-26 08:44:03,091][123091] Updated weights for policy 0, policy_version 1145163 (0.0008) [2023-12-26 08:44:03,130][123090] Updated weights for policy 1, policy_version 1136988 (0.0008) [2023-12-26 08:44:03,759][123090] Updated weights for policy 1, policy_version 1136998 (0.0010) [2023-12-26 08:44:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 584237056. Throughput: 0: 8864.1, 1: 8934.1. Samples: 584254024. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:03,785][121949] Avg episode reward: [(0, '6311.821'), (1, '5748.064')] [2023-12-26 08:44:03,818][123090] Updated weights for policy 1, policy_version 1137008 (0.0005) [2023-12-26 08:44:03,841][123091] Updated weights for policy 0, policy_version 1145173 (0.0010) [2023-12-26 08:44:03,898][123090] Updated weights for policy 1, policy_version 1137018 (0.0006) [2023-12-26 08:44:03,920][123091] Updated weights for policy 0, policy_version 1145183 (0.0006) [2023-12-26 08:44:03,992][123091] Updated weights for policy 0, policy_version 1145193 (0.0007) [2023-12-26 08:44:04,664][123090] Updated weights for policy 1, policy_version 1137028 (0.0006) [2023-12-26 08:44:04,737][123090] Updated weights for policy 1, policy_version 1137038 (0.0006) [2023-12-26 08:44:04,806][123090] Updated weights for policy 1, policy_version 1137048 (0.0007) [2023-12-26 08:44:04,807][123091] Updated weights for policy 0, policy_version 1145203 (0.0008) [2023-12-26 08:44:04,858][123091] Updated weights for policy 0, policy_version 1145213 (0.0010) [2023-12-26 08:44:04,927][123091] Updated weights for policy 0, policy_version 1145223 (0.0010) [2023-12-26 08:44:05,429][123090] Updated weights for policy 1, policy_version 1137058 (0.0008) [2023-12-26 08:44:05,487][123090] Updated weights for policy 1, policy_version 1137068 (0.0006) [2023-12-26 08:44:05,560][123090] Updated weights for policy 1, policy_version 1137078 (0.0008) [2023-12-26 08:44:05,609][123091] Updated weights for policy 0, policy_version 1145233 (0.0010) [2023-12-26 08:44:05,632][123090] Updated weights for policy 1, policy_version 1137088 (0.0008) [2023-12-26 08:44:05,666][123091] Updated weights for policy 0, policy_version 1145243 (0.0009) [2023-12-26 08:44:05,718][123091] Updated weights for policy 0, policy_version 1145253 (0.0008) [2023-12-26 08:44:05,766][123091] Updated weights for policy 0, policy_version 1145263 (0.0009) [2023-12-26 08:44:06,389][123090] Updated weights for policy 1, policy_version 1137098 (0.0010) [2023-12-26 08:44:06,457][123090] Updated weights for policy 1, policy_version 1137108 (0.0011) [2023-12-26 08:44:06,520][123090] Updated weights for policy 1, policy_version 1137118 (0.0010) [2023-12-26 08:44:06,630][123091] Updated weights for policy 0, policy_version 1145273 (0.0009) [2023-12-26 08:44:06,696][123091] Updated weights for policy 0, policy_version 1145283 (0.0009) [2023-12-26 08:44:06,756][123091] Updated weights for policy 0, policy_version 1145293 (0.0009) [2023-12-26 08:44:07,344][123090] Updated weights for policy 1, policy_version 1137128 (0.0011) [2023-12-26 08:44:07,397][123090] Updated weights for policy 1, policy_version 1137138 (0.0010) [2023-12-26 08:44:07,458][123090] Updated weights for policy 1, policy_version 1137148 (0.0011) [2023-12-26 08:44:07,602][123091] Updated weights for policy 0, policy_version 1145303 (0.0009) [2023-12-26 08:44:07,651][123091] Updated weights for policy 0, policy_version 1145313 (0.0009) [2023-12-26 08:44:07,700][123091] Updated weights for policy 0, policy_version 1145323 (0.0009) [2023-12-26 08:44:08,316][123090] Updated weights for policy 1, policy_version 1137158 (0.0009) [2023-12-26 08:44:08,386][123090] Updated weights for policy 1, policy_version 1137168 (0.0009) [2023-12-26 08:44:08,454][123090] Updated weights for policy 1, policy_version 1137178 (0.0008) [2023-12-26 08:44:08,513][123091] Updated weights for policy 0, policy_version 1145333 (0.0010) [2023-12-26 08:44:08,564][123091] Updated weights for policy 0, policy_version 1145343 (0.0011) [2023-12-26 08:44:08,637][123091] Updated weights for policy 0, policy_version 1145353 (0.0010) [2023-12-26 08:44:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 584335360. Throughput: 0: 8907.0, 1: 8941.6. Samples: 584308768. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:08,785][121949] Avg episode reward: [(0, '6344.551'), (1, '5616.808')] [2023-12-26 08:44:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001145360_293216256.pth... [2023-12-26 08:44:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001137184_291119104.pth... [2023-12-26 08:44:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001144336_292954112.pth [2023-12-26 08:44:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001136160_290856960.pth [2023-12-26 08:44:09,171][123090] Updated weights for policy 1, policy_version 1137188 (0.0008) [2023-12-26 08:44:09,226][123090] Updated weights for policy 1, policy_version 1137198 (0.0006) [2023-12-26 08:44:09,290][123090] Updated weights for policy 1, policy_version 1137208 (0.0007) [2023-12-26 08:44:09,538][123091] Updated weights for policy 0, policy_version 1145363 (0.0009) [2023-12-26 08:44:09,603][123091] Updated weights for policy 0, policy_version 1145373 (0.0010) [2023-12-26 08:44:09,665][123091] Updated weights for policy 0, policy_version 1145383 (0.0009) [2023-12-26 08:44:10,114][123090] Updated weights for policy 1, policy_version 1137218 (0.0008) [2023-12-26 08:44:10,183][123090] Updated weights for policy 1, policy_version 1137228 (0.0009) [2023-12-26 08:44:10,255][123090] Updated weights for policy 1, policy_version 1137238 (0.0007) [2023-12-26 08:44:10,324][123090] Updated weights for policy 1, policy_version 1137248 (0.0005) [2023-12-26 08:44:10,498][123091] Updated weights for policy 0, policy_version 1145393 (0.0009) [2023-12-26 08:44:10,564][123091] Updated weights for policy 0, policy_version 1145403 (0.0008) [2023-12-26 08:44:10,627][123091] Updated weights for policy 0, policy_version 1145413 (0.0008) [2023-12-26 08:44:10,690][123091] Updated weights for policy 0, policy_version 1145423 (0.0009) [2023-12-26 08:44:11,015][123090] Updated weights for policy 1, policy_version 1137258 (0.0010) [2023-12-26 08:44:11,087][123090] Updated weights for policy 1, policy_version 1137268 (0.0009) [2023-12-26 08:44:11,158][123090] Updated weights for policy 1, policy_version 1137278 (0.0010) [2023-12-26 08:44:11,513][123091] Updated weights for policy 0, policy_version 1145433 (0.0010) [2023-12-26 08:44:11,567][123091] Updated weights for policy 0, policy_version 1145443 (0.0007) [2023-12-26 08:44:11,635][123091] Updated weights for policy 0, policy_version 1145453 (0.0009) [2023-12-26 08:44:12,045][123090] Updated weights for policy 1, policy_version 1137288 (0.0009) [2023-12-26 08:44:12,110][123090] Updated weights for policy 1, policy_version 1137298 (0.0010) [2023-12-26 08:44:12,180][123090] Updated weights for policy 1, policy_version 1137308 (0.0010) [2023-12-26 08:44:12,456][123091] Updated weights for policy 0, policy_version 1145463 (0.0010) [2023-12-26 08:44:12,515][123091] Updated weights for policy 0, policy_version 1145473 (0.0010) [2023-12-26 08:44:12,563][123091] Updated weights for policy 0, policy_version 1145483 (0.0009) [2023-12-26 08:44:13,010][123090] Updated weights for policy 1, policy_version 1137318 (0.0009) [2023-12-26 08:44:13,066][123090] Updated weights for policy 1, policy_version 1137328 (0.0009) [2023-12-26 08:44:13,122][123090] Updated weights for policy 1, policy_version 1137338 (0.0009) [2023-12-26 08:44:13,439][123091] Updated weights for policy 0, policy_version 1145493 (0.0009) [2023-12-26 08:44:13,506][123091] Updated weights for policy 0, policy_version 1145503 (0.0010) [2023-12-26 08:44:13,572][123091] Updated weights for policy 0, policy_version 1145513 (0.0010) [2023-12-26 08:44:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 584417280. Throughput: 0: 8867.3, 1: 8836.3. Samples: 584411164. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:13,785][121949] Avg episode reward: [(0, '6367.520'), (1, '5544.350')] [2023-12-26 08:44:13,841][123090] Updated weights for policy 1, policy_version 1137348 (0.0008) [2023-12-26 08:44:13,890][123090] Updated weights for policy 1, policy_version 1137358 (0.0005) [2023-12-26 08:44:13,944][123090] Updated weights for policy 1, policy_version 1137368 (0.0007) [2023-12-26 08:44:14,352][123091] Updated weights for policy 0, policy_version 1145523 (0.0009) [2023-12-26 08:44:14,411][123091] Updated weights for policy 0, policy_version 1145533 (0.0006) [2023-12-26 08:44:14,478][123091] Updated weights for policy 0, policy_version 1145543 (0.0006) [2023-12-26 08:44:14,675][123090] Updated weights for policy 1, policy_version 1137378 (0.0009) [2023-12-26 08:44:14,727][123090] Updated weights for policy 1, policy_version 1137388 (0.0005) [2023-12-26 08:44:14,793][123090] Updated weights for policy 1, policy_version 1137398 (0.0009) [2023-12-26 08:44:14,856][123090] Updated weights for policy 1, policy_version 1137408 (0.0010) [2023-12-26 08:44:15,200][123091] Updated weights for policy 0, policy_version 1145553 (0.0006) [2023-12-26 08:44:15,254][123091] Updated weights for policy 0, policy_version 1145563 (0.0009) [2023-12-26 08:44:15,311][123091] Updated weights for policy 0, policy_version 1145573 (0.0009) [2023-12-26 08:44:15,364][123091] Updated weights for policy 0, policy_version 1145583 (0.0009) [2023-12-26 08:44:15,681][123090] Updated weights for policy 1, policy_version 1137418 (0.0010) [2023-12-26 08:44:15,729][123090] Updated weights for policy 1, policy_version 1137428 (0.0010) [2023-12-26 08:44:15,785][123090] Updated weights for policy 1, policy_version 1137438 (0.0010) [2023-12-26 08:44:16,129][123091] Updated weights for policy 0, policy_version 1145593 (0.0010) [2023-12-26 08:44:16,177][123091] Updated weights for policy 0, policy_version 1145603 (0.0011) [2023-12-26 08:44:16,225][123091] Updated weights for policy 0, policy_version 1145613 (0.0010) [2023-12-26 08:44:16,534][123090] Updated weights for policy 1, policy_version 1137448 (0.0006) [2023-12-26 08:44:16,590][123090] Updated weights for policy 1, policy_version 1137458 (0.0005) [2023-12-26 08:44:16,639][123090] Updated weights for policy 1, policy_version 1137468 (0.0005) [2023-12-26 08:44:17,077][123091] Updated weights for policy 0, policy_version 1145623 (0.0010) [2023-12-26 08:44:17,136][123091] Updated weights for policy 0, policy_version 1145633 (0.0010) [2023-12-26 08:44:17,188][123091] Updated weights for policy 0, policy_version 1145643 (0.0011) [2023-12-26 08:44:17,365][123090] Updated weights for policy 1, policy_version 1137478 (0.0008) [2023-12-26 08:44:17,431][123090] Updated weights for policy 1, policy_version 1137488 (0.0010) [2023-12-26 08:44:17,498][123090] Updated weights for policy 1, policy_version 1137498 (0.0011) [2023-12-26 08:44:18,009][123091] Updated weights for policy 0, policy_version 1145653 (0.0009) [2023-12-26 08:44:18,071][123091] Updated weights for policy 0, policy_version 1145663 (0.0007) [2023-12-26 08:44:18,135][123091] Updated weights for policy 0, policy_version 1145673 (0.0005) [2023-12-26 08:44:18,296][123090] Updated weights for policy 1, policy_version 1137508 (0.0010) [2023-12-26 08:44:18,364][123090] Updated weights for policy 1, policy_version 1137518 (0.0009) [2023-12-26 08:44:18,416][123090] Updated weights for policy 1, policy_version 1137528 (0.0008) [2023-12-26 08:44:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 584507392. Throughput: 0: 8806.1, 1: 8835.2. Samples: 584520396. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:18,785][121949] Avg episode reward: [(0, '6293.832'), (1, '5383.341')] [2023-12-26 08:44:18,838][123091] Updated weights for policy 0, policy_version 1145683 (0.0009) [2023-12-26 08:44:18,909][123091] Updated weights for policy 0, policy_version 1145693 (0.0005) [2023-12-26 08:44:18,982][123091] Updated weights for policy 0, policy_version 1145703 (0.0005) [2023-12-26 08:44:19,158][123090] Updated weights for policy 1, policy_version 1137538 (0.0009) [2023-12-26 08:44:19,225][123090] Updated weights for policy 1, policy_version 1137548 (0.0010) [2023-12-26 08:44:19,288][123090] Updated weights for policy 1, policy_version 1137558 (0.0006) [2023-12-26 08:44:19,357][123090] Updated weights for policy 1, policy_version 1137568 (0.0006) [2023-12-26 08:44:19,704][123091] Updated weights for policy 0, policy_version 1145713 (0.0006) [2023-12-26 08:44:19,754][123091] Updated weights for policy 0, policy_version 1145723 (0.0009) [2023-12-26 08:44:19,809][123091] Updated weights for policy 0, policy_version 1145733 (0.0010) [2023-12-26 08:44:19,873][123091] Updated weights for policy 0, policy_version 1145743 (0.0009) [2023-12-26 08:44:20,136][123090] Updated weights for policy 1, policy_version 1137578 (0.0007) [2023-12-26 08:44:20,220][123090] Updated weights for policy 1, policy_version 1137588 (0.0009) [2023-12-26 08:44:20,283][123090] Updated weights for policy 1, policy_version 1137598 (0.0008) [2023-12-26 08:44:20,718][123091] Updated weights for policy 0, policy_version 1145753 (0.0009) [2023-12-26 08:44:20,788][123091] Updated weights for policy 0, policy_version 1145763 (0.0010) [2023-12-26 08:44:20,855][123091] Updated weights for policy 0, policy_version 1145773 (0.0008) [2023-12-26 08:44:21,125][123090] Updated weights for policy 1, policy_version 1137608 (0.0008) [2023-12-26 08:44:21,186][123090] Updated weights for policy 1, policy_version 1137618 (0.0008) [2023-12-26 08:44:21,242][123090] Updated weights for policy 1, policy_version 1137628 (0.0008) [2023-12-26 08:44:21,702][123091] Updated weights for policy 0, policy_version 1145783 (0.0009) [2023-12-26 08:44:21,776][123091] Updated weights for policy 0, policy_version 1145793 (0.0010) [2023-12-26 08:44:21,846][123091] Updated weights for policy 0, policy_version 1145803 (0.0009) [2023-12-26 08:44:22,040][123090] Updated weights for policy 1, policy_version 1137638 (0.0006) [2023-12-26 08:44:22,108][123090] Updated weights for policy 1, policy_version 1137648 (0.0007) [2023-12-26 08:44:22,174][123090] Updated weights for policy 1, policy_version 1137658 (0.0005) [2023-12-26 08:44:22,727][123091] Updated weights for policy 0, policy_version 1145813 (0.0010) [2023-12-26 08:44:22,793][123091] Updated weights for policy 0, policy_version 1145823 (0.0009) [2023-12-26 08:44:22,864][123091] Updated weights for policy 0, policy_version 1145833 (0.0010) [2023-12-26 08:44:22,921][123090] Updated weights for policy 1, policy_version 1137668 (0.0005) [2023-12-26 08:44:22,984][123090] Updated weights for policy 1, policy_version 1137678 (0.0005) [2023-12-26 08:44:23,041][123090] Updated weights for policy 1, policy_version 1137688 (0.0005) [2023-12-26 08:44:23,701][123091] Updated weights for policy 0, policy_version 1145843 (0.0010) [2023-12-26 08:44:23,761][123090] Updated weights for policy 1, policy_version 1137698 (0.0009) [2023-12-26 08:44:23,769][123091] Updated weights for policy 0, policy_version 1145853 (0.0010) [2023-12-26 08:44:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 584589312. Throughput: 0: 8822.7, 1: 8823.7. Samples: 584573224. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:23,785][121949] Avg episode reward: [(0, '6226.515'), (1, '5303.158')] [2023-12-26 08:44:23,827][123090] Updated weights for policy 1, policy_version 1137708 (0.0009) [2023-12-26 08:44:23,834][123091] Updated weights for policy 0, policy_version 1145863 (0.0008) [2023-12-26 08:44:23,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001145872_293347328.pth... [2023-12-26 08:44:23,892][123090] Updated weights for policy 1, policy_version 1137718 (0.0010) [2023-12-26 08:44:23,895][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001144848_293085184.pth [2023-12-26 08:44:23,946][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001137728_291258368.pth... [2023-12-26 08:44:23,946][123090] Updated weights for policy 1, policy_version 1137728 (0.0009) [2023-12-26 08:44:23,949][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001136672_290988032.pth [2023-12-26 08:44:24,662][123091] Updated weights for policy 0, policy_version 1145873 (0.0009) [2023-12-26 08:44:24,722][123090] Updated weights for policy 1, policy_version 1137738 (0.0010) [2023-12-26 08:44:24,722][123091] Updated weights for policy 0, policy_version 1145883 (0.0008) [2023-12-26 08:44:24,774][123090] Updated weights for policy 1, policy_version 1137748 (0.0010) [2023-12-26 08:44:24,785][123091] Updated weights for policy 0, policy_version 1145893 (0.0006) [2023-12-26 08:44:24,827][123090] Updated weights for policy 1, policy_version 1137758 (0.0008) [2023-12-26 08:44:24,844][123091] Updated weights for policy 0, policy_version 1145903 (0.0009) [2023-12-26 08:44:25,636][123090] Updated weights for policy 1, policy_version 1137768 (0.0010) [2023-12-26 08:44:25,677][123091] Updated weights for policy 0, policy_version 1145913 (0.0006) [2023-12-26 08:44:25,698][123090] Updated weights for policy 1, policy_version 1137778 (0.0009) [2023-12-26 08:44:25,734][123091] Updated weights for policy 0, policy_version 1145923 (0.0008) [2023-12-26 08:44:25,749][123090] Updated weights for policy 1, policy_version 1137788 (0.0009) [2023-12-26 08:44:25,791][123091] Updated weights for policy 0, policy_version 1145933 (0.0009) [2023-12-26 08:44:26,498][123090] Updated weights for policy 1, policy_version 1137798 (0.0005) [2023-12-26 08:44:26,545][123090] Updated weights for policy 1, policy_version 1137808 (0.0006) [2023-12-26 08:44:26,602][123090] Updated weights for policy 1, policy_version 1137818 (0.0005) [2023-12-26 08:44:26,693][123091] Updated weights for policy 0, policy_version 1145943 (0.0009) [2023-12-26 08:44:26,755][123091] Updated weights for policy 0, policy_version 1145953 (0.0009) [2023-12-26 08:44:26,807][123091] Updated weights for policy 0, policy_version 1145963 (0.0009) [2023-12-26 08:44:27,279][123090] Updated weights for policy 1, policy_version 1137828 (0.0007) [2023-12-26 08:44:27,340][123090] Updated weights for policy 1, policy_version 1137838 (0.0009) [2023-12-26 08:44:27,397][123090] Updated weights for policy 1, policy_version 1137848 (0.0009) [2023-12-26 08:44:27,664][123091] Updated weights for policy 0, policy_version 1145973 (0.0009) [2023-12-26 08:44:27,719][123091] Updated weights for policy 0, policy_version 1145983 (0.0009) [2023-12-26 08:44:27,775][123091] Updated weights for policy 0, policy_version 1145993 (0.0009) [2023-12-26 08:44:28,181][123090] Updated weights for policy 1, policy_version 1137858 (0.0008) [2023-12-26 08:44:28,246][123090] Updated weights for policy 1, policy_version 1137868 (0.0009) [2023-12-26 08:44:28,311][123090] Updated weights for policy 1, policy_version 1137878 (0.0009) [2023-12-26 08:44:28,377][123090] Updated weights for policy 1, policy_version 1137888 (0.0009) [2023-12-26 08:44:28,547][123091] Updated weights for policy 0, policy_version 1146003 (0.0009) [2023-12-26 08:44:28,618][123091] Updated weights for policy 0, policy_version 1146013 (0.0009) [2023-12-26 08:44:28,682][123091] Updated weights for policy 0, policy_version 1146023 (0.0009) [2023-12-26 08:44:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.5, 300 sec: 17855.8). Total num frames: 584687616. Throughput: 0: 8748.4, 1: 8960.5. Samples: 584678076. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:28,784][121949] Avg episode reward: [(0, '6165.377'), (1, '5569.869')] [2023-12-26 08:44:29,188][123090] Updated weights for policy 1, policy_version 1137898 (0.0009) [2023-12-26 08:44:29,252][123090] Updated weights for policy 1, policy_version 1137908 (0.0009) [2023-12-26 08:44:29,318][123090] Updated weights for policy 1, policy_version 1137918 (0.0009) [2023-12-26 08:44:29,469][123091] Updated weights for policy 0, policy_version 1146033 (0.0009) [2023-12-26 08:44:29,527][123091] Updated weights for policy 0, policy_version 1146043 (0.0009) [2023-12-26 08:44:29,574][123091] Updated weights for policy 0, policy_version 1146053 (0.0009) [2023-12-26 08:44:29,622][123091] Updated weights for policy 0, policy_version 1146063 (0.0009) [2023-12-26 08:44:30,168][123090] Updated weights for policy 1, policy_version 1137928 (0.0006) [2023-12-26 08:44:30,220][123090] Updated weights for policy 1, policy_version 1137938 (0.0005) [2023-12-26 08:44:30,267][123090] Updated weights for policy 1, policy_version 1137948 (0.0005) [2023-12-26 08:44:30,403][123091] Updated weights for policy 0, policy_version 1146073 (0.0006) [2023-12-26 08:44:30,468][123091] Updated weights for policy 0, policy_version 1146083 (0.0005) [2023-12-26 08:44:30,527][123091] Updated weights for policy 0, policy_version 1146093 (0.0005) [2023-12-26 08:44:30,923][123090] Updated weights for policy 1, policy_version 1137958 (0.0008) [2023-12-26 08:44:30,984][123090] Updated weights for policy 1, policy_version 1137968 (0.0009) [2023-12-26 08:44:31,053][123090] Updated weights for policy 1, policy_version 1137978 (0.0010) [2023-12-26 08:44:31,175][123091] Updated weights for policy 0, policy_version 1146103 (0.0007) [2023-12-26 08:44:31,247][123091] Updated weights for policy 0, policy_version 1146113 (0.0008) [2023-12-26 08:44:31,315][123091] Updated weights for policy 0, policy_version 1146123 (0.0007) [2023-12-26 08:44:31,953][123090] Updated weights for policy 1, policy_version 1137988 (0.0008) [2023-12-26 08:44:32,027][123090] Updated weights for policy 1, policy_version 1137998 (0.0005) [2023-12-26 08:44:32,098][123090] Updated weights for policy 1, policy_version 1138008 (0.0005) [2023-12-26 08:44:32,123][123091] Updated weights for policy 0, policy_version 1146133 (0.0008) [2023-12-26 08:44:32,191][123091] Updated weights for policy 0, policy_version 1146143 (0.0005) [2023-12-26 08:44:32,250][123091] Updated weights for policy 0, policy_version 1146153 (0.0010) [2023-12-26 08:44:32,711][123090] Updated weights for policy 1, policy_version 1138018 (0.0006) [2023-12-26 08:44:32,775][123090] Updated weights for policy 1, policy_version 1138028 (0.0009) [2023-12-26 08:44:32,838][123090] Updated weights for policy 1, policy_version 1138038 (0.0010) [2023-12-26 08:44:32,897][123090] Updated weights for policy 1, policy_version 1138048 (0.0010) [2023-12-26 08:44:33,035][123091] Updated weights for policy 0, policy_version 1146163 (0.0009) [2023-12-26 08:44:33,089][123091] Updated weights for policy 0, policy_version 1146173 (0.0010) [2023-12-26 08:44:33,150][123091] Updated weights for policy 0, policy_version 1146183 (0.0009) [2023-12-26 08:44:33,665][123090] Updated weights for policy 1, policy_version 1138058 (0.0005) [2023-12-26 08:44:33,711][123090] Updated weights for policy 1, policy_version 1138068 (0.0005) [2023-12-26 08:44:33,759][123090] Updated weights for policy 1, policy_version 1138078 (0.0005) [2023-12-26 08:44:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 584777728. Throughput: 0: 8715.3, 1: 8952.1. Samples: 584785776. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:33,785][121949] Avg episode reward: [(0, '6127.840'), (1, '5681.380')] [2023-12-26 08:44:34,058][123091] Updated weights for policy 0, policy_version 1146193 (0.0010) [2023-12-26 08:44:34,114][123091] Updated weights for policy 0, policy_version 1146203 (0.0009) [2023-12-26 08:44:34,177][123091] Updated weights for policy 0, policy_version 1146213 (0.0009) [2023-12-26 08:44:34,226][123091] Updated weights for policy 0, policy_version 1146223 (0.0008) [2023-12-26 08:44:34,510][123090] Updated weights for policy 1, policy_version 1138088 (0.0009) [2023-12-26 08:44:34,583][123090] Updated weights for policy 1, policy_version 1138098 (0.0005) [2023-12-26 08:44:34,648][123090] Updated weights for policy 1, policy_version 1138108 (0.0006) [2023-12-26 08:44:35,022][123091] Updated weights for policy 0, policy_version 1146233 (0.0009) [2023-12-26 08:44:35,079][123091] Updated weights for policy 0, policy_version 1146243 (0.0009) [2023-12-26 08:44:35,138][123091] Updated weights for policy 0, policy_version 1146253 (0.0008) [2023-12-26 08:44:35,363][123090] Updated weights for policy 1, policy_version 1138118 (0.0008) [2023-12-26 08:44:35,418][123090] Updated weights for policy 1, policy_version 1138128 (0.0010) [2023-12-26 08:44:35,472][123090] Updated weights for policy 1, policy_version 1138138 (0.0010) [2023-12-26 08:44:35,959][123091] Updated weights for policy 0, policy_version 1146263 (0.0009) [2023-12-26 08:44:36,014][123091] Updated weights for policy 0, policy_version 1146273 (0.0008) [2023-12-26 08:44:36,083][123091] Updated weights for policy 0, policy_version 1146283 (0.0008) [2023-12-26 08:44:36,327][123090] Updated weights for policy 1, policy_version 1138148 (0.0010) [2023-12-26 08:44:36,395][123090] Updated weights for policy 1, policy_version 1138158 (0.0011) [2023-12-26 08:44:36,462][123090] Updated weights for policy 1, policy_version 1138168 (0.0010) [2023-12-26 08:44:36,941][123091] Updated weights for policy 0, policy_version 1146293 (0.0010) [2023-12-26 08:44:37,013][123091] Updated weights for policy 0, policy_version 1146303 (0.0007) [2023-12-26 08:44:37,084][123091] Updated weights for policy 0, policy_version 1146313 (0.0010) [2023-12-26 08:44:37,242][123090] Updated weights for policy 1, policy_version 1138178 (0.0010) [2023-12-26 08:44:37,312][123090] Updated weights for policy 1, policy_version 1138188 (0.0010) [2023-12-26 08:44:37,368][123090] Updated weights for policy 1, policy_version 1138198 (0.0009) [2023-12-26 08:44:37,420][123090] Updated weights for policy 1, policy_version 1138208 (0.0009) [2023-12-26 08:44:37,934][123091] Updated weights for policy 0, policy_version 1146323 (0.0010) [2023-12-26 08:44:37,999][123091] Updated weights for policy 0, policy_version 1146333 (0.0011) [2023-12-26 08:44:38,063][123091] Updated weights for policy 0, policy_version 1146343 (0.0010) [2023-12-26 08:44:38,200][123090] Updated weights for policy 1, policy_version 1138218 (0.0008) [2023-12-26 08:44:38,257][123090] Updated weights for policy 1, policy_version 1138228 (0.0009) [2023-12-26 08:44:38,308][123090] Updated weights for policy 1, policy_version 1138238 (0.0009) [2023-12-26 08:44:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 584859648. Throughput: 0: 8734.3, 1: 8968.1. Samples: 584838372. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:38,785][121949] Avg episode reward: [(0, '6109.866'), (1, '5651.994')] [2023-12-26 08:44:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001138240_291389440.pth... [2023-12-26 08:44:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001146352_293470208.pth... [2023-12-26 08:44:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001145360_293216256.pth [2023-12-26 08:44:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001137184_291119104.pth [2023-12-26 08:44:38,947][123091] Updated weights for policy 0, policy_version 1146353 (0.0010) [2023-12-26 08:44:39,015][123091] Updated weights for policy 0, policy_version 1146363 (0.0010) [2023-12-26 08:44:39,071][123091] Updated weights for policy 0, policy_version 1146373 (0.0010) [2023-12-26 08:44:39,124][123090] Updated weights for policy 1, policy_version 1138248 (0.0010) [2023-12-26 08:44:39,130][123091] Updated weights for policy 0, policy_version 1146383 (0.0008) [2023-12-26 08:44:39,182][123090] Updated weights for policy 1, policy_version 1138258 (0.0006) [2023-12-26 08:44:39,244][123090] Updated weights for policy 1, policy_version 1138268 (0.0008) [2023-12-26 08:44:40,055][123091] Updated weights for policy 0, policy_version 1146393 (0.0007) [2023-12-26 08:44:40,057][123090] Updated weights for policy 1, policy_version 1138278 (0.0011) [2023-12-26 08:44:40,129][123091] Updated weights for policy 0, policy_version 1146403 (0.0006) [2023-12-26 08:44:40,129][123090] Updated weights for policy 1, policy_version 1138288 (0.0008) [2023-12-26 08:44:40,195][123090] Updated weights for policy 1, policy_version 1138298 (0.0009) [2023-12-26 08:44:40,200][123091] Updated weights for policy 0, policy_version 1146413 (0.0006) [2023-12-26 08:44:40,875][123091] Updated weights for policy 0, policy_version 1146423 (0.0007) [2023-12-26 08:44:40,937][123091] Updated weights for policy 0, policy_version 1146433 (0.0007) [2023-12-26 08:44:40,961][123090] Updated weights for policy 1, policy_version 1138308 (0.0007) [2023-12-26 08:44:41,009][123091] Updated weights for policy 0, policy_version 1146443 (0.0008) [2023-12-26 08:44:41,022][123090] Updated weights for policy 1, policy_version 1138318 (0.0010) [2023-12-26 08:44:41,105][123090] Updated weights for policy 1, policy_version 1138328 (0.0011) [2023-12-26 08:44:41,870][123091] Updated weights for policy 0, policy_version 1146453 (0.0008) [2023-12-26 08:44:41,938][123091] Updated weights for policy 0, policy_version 1146463 (0.0009) [2023-12-26 08:44:41,952][123090] Updated weights for policy 1, policy_version 1138338 (0.0010) [2023-12-26 08:44:42,000][123091] Updated weights for policy 0, policy_version 1146473 (0.0007) [2023-12-26 08:44:42,015][123090] Updated weights for policy 1, policy_version 1138348 (0.0010) [2023-12-26 08:44:42,076][123090] Updated weights for policy 1, policy_version 1138358 (0.0008) [2023-12-26 08:44:42,143][123090] Updated weights for policy 1, policy_version 1138368 (0.0009) [2023-12-26 08:44:42,781][123091] Updated weights for policy 0, policy_version 1146483 (0.0008) [2023-12-26 08:44:42,848][123091] Updated weights for policy 0, policy_version 1146493 (0.0006) [2023-12-26 08:44:42,902][123091] Updated weights for policy 0, policy_version 1146503 (0.0005) [2023-12-26 08:44:42,957][123090] Updated weights for policy 1, policy_version 1138378 (0.0009) [2023-12-26 08:44:43,026][123090] Updated weights for policy 1, policy_version 1138388 (0.0009) [2023-12-26 08:44:43,088][123090] Updated weights for policy 1, policy_version 1138398 (0.0009) [2023-12-26 08:44:43,574][123091] Updated weights for policy 0, policy_version 1146513 (0.0005) [2023-12-26 08:44:43,628][123091] Updated weights for policy 0, policy_version 1146523 (0.0005) [2023-12-26 08:44:43,676][123091] Updated weights for policy 0, policy_version 1146533 (0.0005) [2023-12-26 08:44:43,737][123091] Updated weights for policy 0, policy_version 1146543 (0.0005) [2023-12-26 08:44:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 584949760. Throughput: 0: 8668.9, 1: 8918.0. Samples: 584940376. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:43,785][121949] Avg episode reward: [(0, '6216.703'), (1, '5475.670')] [2023-12-26 08:44:43,952][123090] Updated weights for policy 1, policy_version 1138408 (0.0010) [2023-12-26 08:44:44,007][123090] Updated weights for policy 1, policy_version 1138419 (0.0010) [2023-12-26 08:44:44,063][123090] Updated weights for policy 1, policy_version 1138429 (0.0009) [2023-12-26 08:44:44,503][123091] Updated weights for policy 0, policy_version 1146553 (0.0009) [2023-12-26 08:44:44,551][123091] Updated weights for policy 0, policy_version 1146563 (0.0009) [2023-12-26 08:44:44,611][123091] Updated weights for policy 0, policy_version 1146575 (0.0009) [2023-12-26 08:44:44,837][123090] Updated weights for policy 1, policy_version 1138439 (0.0007) [2023-12-26 08:44:44,898][123090] Updated weights for policy 1, policy_version 1138449 (0.0010) [2023-12-26 08:44:44,960][123090] Updated weights for policy 1, policy_version 1138459 (0.0009) [2023-12-26 08:44:45,487][123091] Updated weights for policy 0, policy_version 1146585 (0.0009) [2023-12-26 08:44:45,551][123091] Updated weights for policy 0, policy_version 1146595 (0.0009) [2023-12-26 08:44:45,614][123091] Updated weights for policy 0, policy_version 1146605 (0.0009) [2023-12-26 08:44:45,757][123090] Updated weights for policy 1, policy_version 1138469 (0.0007) [2023-12-26 08:44:45,826][123090] Updated weights for policy 1, policy_version 1138479 (0.0005) [2023-12-26 08:44:45,904][123090] Updated weights for policy 1, policy_version 1138489 (0.0007) [2023-12-26 08:44:46,474][123091] Updated weights for policy 0, policy_version 1146615 (0.0010) [2023-12-26 08:44:46,533][123091] Updated weights for policy 0, policy_version 1146625 (0.0008) [2023-12-26 08:44:46,597][123091] Updated weights for policy 0, policy_version 1146635 (0.0008) [2023-12-26 08:44:46,677][123090] Updated weights for policy 1, policy_version 1138499 (0.0009) [2023-12-26 08:44:46,727][123090] Updated weights for policy 1, policy_version 1138509 (0.0009) [2023-12-26 08:44:46,782][123090] Updated weights for policy 1, policy_version 1138521 (0.0011) [2023-12-26 08:44:47,267][123091] Updated weights for policy 0, policy_version 1146645 (0.0007) [2023-12-26 08:44:47,337][123091] Updated weights for policy 0, policy_version 1146655 (0.0007) [2023-12-26 08:44:47,414][123091] Updated weights for policy 0, policy_version 1146665 (0.0007) [2023-12-26 08:44:47,707][123090] Updated weights for policy 1, policy_version 1138532 (0.0010) [2023-12-26 08:44:47,768][123090] Updated weights for policy 1, policy_version 1138542 (0.0010) [2023-12-26 08:44:47,829][123090] Updated weights for policy 1, policy_version 1138552 (0.0010) [2023-12-26 08:44:48,004][123091] Updated weights for policy 0, policy_version 1146675 (0.0007) [2023-12-26 08:44:48,068][123091] Updated weights for policy 0, policy_version 1146685 (0.0007) [2023-12-26 08:44:48,128][123091] Updated weights for policy 0, policy_version 1146695 (0.0006) [2023-12-26 08:44:48,594][123090] Updated weights for policy 1, policy_version 1138562 (0.0009) [2023-12-26 08:44:48,650][123090] Updated weights for policy 1, policy_version 1138572 (0.0005) [2023-12-26 08:44:48,704][123090] Updated weights for policy 1, policy_version 1138582 (0.0005) [2023-12-26 08:44:48,755][123090] Updated weights for policy 1, policy_version 1138592 (0.0006) [2023-12-26 08:44:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 585039872. Throughput: 0: 8711.4, 1: 8963.3. Samples: 585049384. Policy #0 lag: (min: 31.0, avg: 33.1, max: 63.0) [2023-12-26 08:44:48,785][121949] Avg episode reward: [(0, '6349.969'), (1, '5568.183')] [2023-12-26 08:44:48,876][123091] Updated weights for policy 0, policy_version 1146705 (0.0008) [2023-12-26 08:44:48,943][123091] Updated weights for policy 0, policy_version 1146715 (0.0010) [2023-12-26 08:44:49,006][123091] Updated weights for policy 0, policy_version 1146725 (0.0011) [2023-12-26 08:44:49,057][123091] Updated weights for policy 0, policy_version 1146735 (0.0010) [2023-12-26 08:44:49,532][123090] Updated weights for policy 1, policy_version 1138602 (0.0009) [2023-12-26 08:44:49,585][123090] Updated weights for policy 1, policy_version 1138612 (0.0009) [2023-12-26 08:44:49,638][123090] Updated weights for policy 1, policy_version 1138622 (0.0008) [2023-12-26 08:44:49,919][123091] Updated weights for policy 0, policy_version 1146745 (0.0008) [2023-12-26 08:44:49,983][123091] Updated weights for policy 0, policy_version 1146755 (0.0006) [2023-12-26 08:44:50,035][123091] Updated weights for policy 0, policy_version 1146765 (0.0008) [2023-12-26 08:44:50,510][123090] Updated weights for policy 1, policy_version 1138632 (0.0010) [2023-12-26 08:44:50,563][123090] Updated weights for policy 1, policy_version 1138642 (0.0009) [2023-12-26 08:44:50,628][123090] Updated weights for policy 1, policy_version 1138652 (0.0010) [2023-12-26 08:44:50,789][123091] Updated weights for policy 0, policy_version 1146775 (0.0009) [2023-12-26 08:44:50,851][123091] Updated weights for policy 0, policy_version 1146785 (0.0006) [2023-12-26 08:44:50,904][123091] Updated weights for policy 0, policy_version 1146795 (0.0008) [2023-12-26 08:44:51,510][123090] Updated weights for policy 1, policy_version 1138662 (0.0009) [2023-12-26 08:44:51,582][123090] Updated weights for policy 1, policy_version 1138672 (0.0008) [2023-12-26 08:44:51,654][123090] Updated weights for policy 1, policy_version 1138682 (0.0009) [2023-12-26 08:44:51,719][123091] Updated weights for policy 0, policy_version 1146805 (0.0009) [2023-12-26 08:44:51,786][123091] Updated weights for policy 0, policy_version 1146815 (0.0009) [2023-12-26 08:44:51,853][123091] Updated weights for policy 0, policy_version 1146825 (0.0009) [2023-12-26 08:44:52,436][123090] Updated weights for policy 1, policy_version 1138692 (0.0009) [2023-12-26 08:44:52,511][123090] Updated weights for policy 1, policy_version 1138702 (0.0010) [2023-12-26 08:44:52,583][123090] Updated weights for policy 1, policy_version 1138712 (0.0008) [2023-12-26 08:44:52,640][123091] Updated weights for policy 0, policy_version 1146835 (0.0009) [2023-12-26 08:44:52,692][123091] Updated weights for policy 0, policy_version 1146845 (0.0011) [2023-12-26 08:44:52,756][123091] Updated weights for policy 0, policy_version 1146855 (0.0007) [2023-12-26 08:44:53,455][123090] Updated weights for policy 1, policy_version 1138722 (0.0010) [2023-12-26 08:44:53,483][123091] Updated weights for policy 0, policy_version 1146865 (0.0010) [2023-12-26 08:44:53,517][123090] Updated weights for policy 1, policy_version 1138732 (0.0010) [2023-12-26 08:44:53,538][123091] Updated weights for policy 0, policy_version 1146875 (0.0010) [2023-12-26 08:44:53,580][123090] Updated weights for policy 1, policy_version 1138742 (0.0010) [2023-12-26 08:44:53,603][123091] Updated weights for policy 0, policy_version 1146885 (0.0008) [2023-12-26 08:44:53,638][123090] Updated weights for policy 1, policy_version 1138752 (0.0010) [2023-12-26 08:44:53,666][123091] Updated weights for policy 0, policy_version 1146895 (0.0005) [2023-12-26 08:44:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 585129984. Throughput: 0: 8712.7, 1: 8901.6. Samples: 585101412. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:44:53,785][121949] Avg episode reward: [(0, '6220.558'), (1, '5523.948')] [2023-12-26 08:44:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001146896_293609472.pth... [2023-12-26 08:44:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001138752_291520512.pth... [2023-12-26 08:44:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001145872_293347328.pth [2023-12-26 08:44:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001137728_291258368.pth [2023-12-26 08:44:54,386][123090] Updated weights for policy 1, policy_version 1138762 (0.0005) [2023-12-26 08:44:54,390][123091] Updated weights for policy 0, policy_version 1146905 (0.0010) [2023-12-26 08:44:54,443][123090] Updated weights for policy 1, policy_version 1138772 (0.0005) [2023-12-26 08:44:54,449][123091] Updated weights for policy 0, policy_version 1146915 (0.0011) [2023-12-26 08:44:54,495][123090] Updated weights for policy 1, policy_version 1138782 (0.0006) [2023-12-26 08:44:54,501][123091] Updated weights for policy 0, policy_version 1146925 (0.0008) [2023-12-26 08:44:55,211][123090] Updated weights for policy 1, policy_version 1138792 (0.0005) [2023-12-26 08:44:55,250][123091] Updated weights for policy 0, policy_version 1146935 (0.0008) [2023-12-26 08:44:55,270][123090] Updated weights for policy 1, policy_version 1138802 (0.0005) [2023-12-26 08:44:55,302][123091] Updated weights for policy 0, policy_version 1146945 (0.0007) [2023-12-26 08:44:55,326][123090] Updated weights for policy 1, policy_version 1138812 (0.0005) [2023-12-26 08:44:55,371][123091] Updated weights for policy 0, policy_version 1146955 (0.0006) [2023-12-26 08:44:55,970][123090] Updated weights for policy 1, policy_version 1138822 (0.0008) [2023-12-26 08:44:56,029][123090] Updated weights for policy 1, policy_version 1138832 (0.0010) [2023-12-26 08:44:56,043][123091] Updated weights for policy 0, policy_version 1146965 (0.0006) [2023-12-26 08:44:56,084][123090] Updated weights for policy 1, policy_version 1138842 (0.0010) [2023-12-26 08:44:56,101][123091] Updated weights for policy 0, policy_version 1146975 (0.0009) [2023-12-26 08:44:56,170][123091] Updated weights for policy 0, policy_version 1146985 (0.0010) [2023-12-26 08:44:56,748][123090] Updated weights for policy 1, policy_version 1138852 (0.0008) [2023-12-26 08:44:56,805][123090] Updated weights for policy 1, policy_version 1138862 (0.0005) [2023-12-26 08:44:56,850][123090] Updated weights for policy 1, policy_version 1138872 (0.0007) [2023-12-26 08:44:56,971][123091] Updated weights for policy 0, policy_version 1146995 (0.0009) [2023-12-26 08:44:57,036][123091] Updated weights for policy 0, policy_version 1147005 (0.0008) [2023-12-26 08:44:57,106][123091] Updated weights for policy 0, policy_version 1147015 (0.0010) [2023-12-26 08:44:57,579][123090] Updated weights for policy 1, policy_version 1138882 (0.0007) [2023-12-26 08:44:57,640][123090] Updated weights for policy 1, policy_version 1138892 (0.0006) [2023-12-26 08:44:57,689][123090] Updated weights for policy 1, policy_version 1138902 (0.0005) [2023-12-26 08:44:57,750][123090] Updated weights for policy 1, policy_version 1138912 (0.0006) [2023-12-26 08:44:57,953][123091] Updated weights for policy 0, policy_version 1147025 (0.0009) [2023-12-26 08:44:58,022][123091] Updated weights for policy 0, policy_version 1147035 (0.0009) [2023-12-26 08:44:58,084][123091] Updated weights for policy 0, policy_version 1147045 (0.0009) [2023-12-26 08:44:58,150][123091] Updated weights for policy 0, policy_version 1147055 (0.0010) [2023-12-26 08:44:58,533][123090] Updated weights for policy 1, policy_version 1138922 (0.0011) [2023-12-26 08:44:58,602][123090] Updated weights for policy 1, policy_version 1138932 (0.0011) [2023-12-26 08:44:58,671][123090] Updated weights for policy 1, policy_version 1138942 (0.0011) [2023-12-26 08:44:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 585220096. Throughput: 0: 8827.7, 1: 9006.3. Samples: 585213696. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:44:58,785][121949] Avg episode reward: [(0, '6230.216'), (1, '5368.901')] [2023-12-26 08:44:59,009][123091] Updated weights for policy 0, policy_version 1147065 (0.0009) [2023-12-26 08:44:59,073][123091] Updated weights for policy 0, policy_version 1147075 (0.0009) [2023-12-26 08:44:59,135][123091] Updated weights for policy 0, policy_version 1147085 (0.0009) [2023-12-26 08:44:59,570][123090] Updated weights for policy 1, policy_version 1138952 (0.0010) [2023-12-26 08:44:59,625][123090] Updated weights for policy 1, policy_version 1138962 (0.0009) [2023-12-26 08:44:59,678][123090] Updated weights for policy 1, policy_version 1138972 (0.0009) [2023-12-26 08:44:59,981][123091] Updated weights for policy 0, policy_version 1147095 (0.0009) [2023-12-26 08:45:00,052][123091] Updated weights for policy 0, policy_version 1147105 (0.0010) [2023-12-26 08:45:00,120][123091] Updated weights for policy 0, policy_version 1147115 (0.0010) [2023-12-26 08:45:00,531][123090] Updated weights for policy 1, policy_version 1138982 (0.0009) [2023-12-26 08:45:00,589][123090] Updated weights for policy 1, policy_version 1138992 (0.0010) [2023-12-26 08:45:00,647][123090] Updated weights for policy 1, policy_version 1139003 (0.0010) [2023-12-26 08:45:00,868][123091] Updated weights for policy 0, policy_version 1147125 (0.0007) [2023-12-26 08:45:00,914][123091] Updated weights for policy 0, policy_version 1147135 (0.0005) [2023-12-26 08:45:00,960][123091] Updated weights for policy 0, policy_version 1147145 (0.0006) [2023-12-26 08:45:01,503][123090] Updated weights for policy 1, policy_version 1139013 (0.0009) [2023-12-26 08:45:01,569][123090] Updated weights for policy 1, policy_version 1139023 (0.0009) [2023-12-26 08:45:01,620][123090] Updated weights for policy 1, policy_version 1139034 (0.0009) [2023-12-26 08:45:01,736][123091] Updated weights for policy 0, policy_version 1147155 (0.0007) [2023-12-26 08:45:01,794][123091] Updated weights for policy 0, policy_version 1147165 (0.0006) [2023-12-26 08:45:01,864][123091] Updated weights for policy 0, policy_version 1147175 (0.0005) [2023-12-26 08:45:02,482][123090] Updated weights for policy 1, policy_version 1139044 (0.0007) [2023-12-26 08:45:02,547][123090] Updated weights for policy 1, policy_version 1139054 (0.0009) [2023-12-26 08:45:02,565][123091] Updated weights for policy 0, policy_version 1147185 (0.0006) [2023-12-26 08:45:02,602][123090] Updated weights for policy 1, policy_version 1139064 (0.0007) [2023-12-26 08:45:02,628][123091] Updated weights for policy 0, policy_version 1147195 (0.0010) [2023-12-26 08:45:02,690][123091] Updated weights for policy 0, policy_version 1147205 (0.0010) [2023-12-26 08:45:02,752][123091] Updated weights for policy 0, policy_version 1147215 (0.0010) [2023-12-26 08:45:03,467][123090] Updated weights for policy 1, policy_version 1139074 (0.0007) [2023-12-26 08:45:03,468][123091] Updated weights for policy 0, policy_version 1147225 (0.0010) [2023-12-26 08:45:03,533][123090] Updated weights for policy 1, policy_version 1139084 (0.0006) [2023-12-26 08:45:03,533][123091] Updated weights for policy 0, policy_version 1147235 (0.0010) [2023-12-26 08:45:03,600][123090] Updated weights for policy 1, policy_version 1139094 (0.0009) [2023-12-26 08:45:03,601][123091] Updated weights for policy 0, policy_version 1147245 (0.0011) [2023-12-26 08:45:03,659][123090] Updated weights for policy 1, policy_version 1139104 (0.0008) [2023-12-26 08:45:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 585310208. Throughput: 0: 8825.2, 1: 8878.3. Samples: 585317052. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:03,784][121949] Avg episode reward: [(0, '6269.973'), (1, '5352.713')] [2023-12-26 08:45:04,382][123091] Updated weights for policy 0, policy_version 1147255 (0.0011) [2023-12-26 08:45:04,453][123091] Updated weights for policy 0, policy_version 1147265 (0.0011) [2023-12-26 08:45:04,493][123090] Updated weights for policy 1, policy_version 1139114 (0.0005) [2023-12-26 08:45:04,509][123091] Updated weights for policy 0, policy_version 1147275 (0.0011) [2023-12-26 08:45:04,555][123090] Updated weights for policy 1, policy_version 1139124 (0.0007) [2023-12-26 08:45:04,626][123090] Updated weights for policy 1, policy_version 1139134 (0.0009) [2023-12-26 08:45:05,072][123091] Updated weights for policy 0, policy_version 1147285 (0.0008) [2023-12-26 08:45:05,150][123091] Updated weights for policy 0, policy_version 1147295 (0.0005) [2023-12-26 08:45:05,210][123091] Updated weights for policy 0, policy_version 1147305 (0.0005) [2023-12-26 08:45:05,497][123090] Updated weights for policy 1, policy_version 1139144 (0.0010) [2023-12-26 08:45:05,556][123090] Updated weights for policy 1, policy_version 1139154 (0.0010) [2023-12-26 08:45:05,624][123090] Updated weights for policy 1, policy_version 1139164 (0.0010) [2023-12-26 08:45:05,799][123091] Updated weights for policy 0, policy_version 1147315 (0.0005) [2023-12-26 08:45:05,874][123091] Updated weights for policy 0, policy_version 1147325 (0.0005) [2023-12-26 08:45:05,948][123091] Updated weights for policy 0, policy_version 1147335 (0.0005) [2023-12-26 08:45:06,442][123090] Updated weights for policy 1, policy_version 1139174 (0.0009) [2023-12-26 08:45:06,497][123090] Updated weights for policy 1, policy_version 1139184 (0.0010) [2023-12-26 08:45:06,556][123090] Updated weights for policy 1, policy_version 1139194 (0.0009) [2023-12-26 08:45:06,600][123091] Updated weights for policy 0, policy_version 1147345 (0.0005) [2023-12-26 08:45:06,666][123091] Updated weights for policy 0, policy_version 1147355 (0.0006) [2023-12-26 08:45:06,742][123091] Updated weights for policy 0, policy_version 1147365 (0.0006) [2023-12-26 08:45:06,811][123091] Updated weights for policy 0, policy_version 1147375 (0.0006) [2023-12-26 08:45:07,454][123091] Updated weights for policy 0, policy_version 1147385 (0.0010) [2023-12-26 08:45:07,481][123090] Updated weights for policy 1, policy_version 1139204 (0.0008) [2023-12-26 08:45:07,517][123091] Updated weights for policy 0, policy_version 1147395 (0.0010) [2023-12-26 08:45:07,531][123090] Updated weights for policy 1, policy_version 1139214 (0.0005) [2023-12-26 08:45:07,580][123091] Updated weights for policy 0, policy_version 1147405 (0.0010) [2023-12-26 08:45:07,585][123090] Updated weights for policy 1, policy_version 1139224 (0.0005) [2023-12-26 08:45:08,317][123091] Updated weights for policy 0, policy_version 1147415 (0.0011) [2023-12-26 08:45:08,382][123091] Updated weights for policy 0, policy_version 1147425 (0.0009) [2023-12-26 08:45:08,438][123091] Updated weights for policy 0, policy_version 1147435 (0.0006) [2023-12-26 08:45:08,454][123090] Updated weights for policy 1, policy_version 1139234 (0.0007) [2023-12-26 08:45:08,513][123090] Updated weights for policy 1, policy_version 1139244 (0.0009) [2023-12-26 08:45:08,571][123090] Updated weights for policy 1, policy_version 1139254 (0.0009) [2023-12-26 08:45:08,633][123090] Updated weights for policy 1, policy_version 1139264 (0.0009) [2023-12-26 08:45:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 585400320. Throughput: 0: 8909.9, 1: 8832.9. Samples: 585371652. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:08,785][121949] Avg episode reward: [(0, '6162.721'), (1, '5485.417')] [2023-12-26 08:45:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001147440_293748736.pth... [2023-12-26 08:45:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001139264_291651584.pth... [2023-12-26 08:45:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001138240_291389440.pth [2023-12-26 08:45:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001146352_293470208.pth [2023-12-26 08:45:09,220][123091] Updated weights for policy 0, policy_version 1147445 (0.0009) [2023-12-26 08:45:09,284][123091] Updated weights for policy 0, policy_version 1147455 (0.0010) [2023-12-26 08:45:09,349][123091] Updated weights for policy 0, policy_version 1147465 (0.0011) [2023-12-26 08:45:09,457][123090] Updated weights for policy 1, policy_version 1139274 (0.0008) [2023-12-26 08:45:09,528][123090] Updated weights for policy 1, policy_version 1139284 (0.0007) [2023-12-26 08:45:09,599][123090] Updated weights for policy 1, policy_version 1139294 (0.0010) [2023-12-26 08:45:10,224][123091] Updated weights for policy 0, policy_version 1147475 (0.0009) [2023-12-26 08:45:10,297][123091] Updated weights for policy 0, policy_version 1147485 (0.0006) [2023-12-26 08:45:10,358][123091] Updated weights for policy 0, policy_version 1147495 (0.0008) [2023-12-26 08:45:10,402][123090] Updated weights for policy 1, policy_version 1139304 (0.0008) [2023-12-26 08:45:10,463][123090] Updated weights for policy 1, policy_version 1139314 (0.0011) [2023-12-26 08:45:10,516][123090] Updated weights for policy 1, policy_version 1139324 (0.0010) [2023-12-26 08:45:11,162][123091] Updated weights for policy 0, policy_version 1147505 (0.0008) [2023-12-26 08:45:11,222][123091] Updated weights for policy 0, policy_version 1147515 (0.0009) [2023-12-26 08:45:11,295][123091] Updated weights for policy 0, policy_version 1147525 (0.0009) [2023-12-26 08:45:11,366][123091] Updated weights for policy 0, policy_version 1147535 (0.0009) [2023-12-26 08:45:11,380][123090] Updated weights for policy 1, policy_version 1139334 (0.0009) [2023-12-26 08:45:11,450][123090] Updated weights for policy 1, policy_version 1139344 (0.0009) [2023-12-26 08:45:11,520][123090] Updated weights for policy 1, policy_version 1139354 (0.0010) [2023-12-26 08:45:12,165][123091] Updated weights for policy 0, policy_version 1147545 (0.0010) [2023-12-26 08:45:12,237][123091] Updated weights for policy 0, policy_version 1147555 (0.0009) [2023-12-26 08:45:12,305][123091] Updated weights for policy 0, policy_version 1147565 (0.0010) [2023-12-26 08:45:12,417][123090] Updated weights for policy 1, policy_version 1139364 (0.0010) [2023-12-26 08:45:12,487][123090] Updated weights for policy 1, policy_version 1139374 (0.0009) [2023-12-26 08:45:12,552][123090] Updated weights for policy 1, policy_version 1139384 (0.0009) [2023-12-26 08:45:13,146][123091] Updated weights for policy 0, policy_version 1147575 (0.0010) [2023-12-26 08:45:13,208][123091] Updated weights for policy 0, policy_version 1147585 (0.0009) [2023-12-26 08:45:13,270][123091] Updated weights for policy 0, policy_version 1147595 (0.0008) [2023-12-26 08:45:13,407][123090] Updated weights for policy 1, policy_version 1139394 (0.0010) [2023-12-26 08:45:13,467][123090] Updated weights for policy 1, policy_version 1139404 (0.0011) [2023-12-26 08:45:13,519][123090] Updated weights for policy 1, policy_version 1139414 (0.0010) [2023-12-26 08:45:13,583][123090] Updated weights for policy 1, policy_version 1139424 (0.0010) [2023-12-26 08:45:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 585482240. Throughput: 0: 9000.3, 1: 8702.3. Samples: 585474692. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:13,784][121949] Avg episode reward: [(0, '6085.433'), (1, '5491.071')] [2023-12-26 08:45:14,108][123091] Updated weights for policy 0, policy_version 1147605 (0.0007) [2023-12-26 08:45:14,176][123091] Updated weights for policy 0, policy_version 1147615 (0.0008) [2023-12-26 08:45:14,249][123091] Updated weights for policy 0, policy_version 1147625 (0.0005) [2023-12-26 08:45:14,355][123090] Updated weights for policy 1, policy_version 1139434 (0.0010) [2023-12-26 08:45:14,415][123090] Updated weights for policy 1, policy_version 1139444 (0.0010) [2023-12-26 08:45:14,469][123090] Updated weights for policy 1, policy_version 1139454 (0.0010) [2023-12-26 08:45:14,961][123091] Updated weights for policy 0, policy_version 1147635 (0.0006) [2023-12-26 08:45:15,031][123091] Updated weights for policy 0, policy_version 1147645 (0.0008) [2023-12-26 08:45:15,095][123091] Updated weights for policy 0, policy_version 1147655 (0.0007) [2023-12-26 08:45:15,364][123090] Updated weights for policy 1, policy_version 1139464 (0.0007) [2023-12-26 08:45:15,430][123090] Updated weights for policy 1, policy_version 1139474 (0.0009) [2023-12-26 08:45:15,493][123090] Updated weights for policy 1, policy_version 1139484 (0.0010) [2023-12-26 08:45:15,862][123091] Updated weights for policy 0, policy_version 1147665 (0.0006) [2023-12-26 08:45:15,928][123091] Updated weights for policy 0, policy_version 1147675 (0.0010) [2023-12-26 08:45:15,996][123091] Updated weights for policy 0, policy_version 1147685 (0.0009) [2023-12-26 08:45:16,053][123091] Updated weights for policy 0, policy_version 1147695 (0.0006) [2023-12-26 08:45:16,345][123090] Updated weights for policy 1, policy_version 1139494 (0.0007) [2023-12-26 08:45:16,396][123090] Updated weights for policy 1, policy_version 1139504 (0.0006) [2023-12-26 08:45:16,449][123090] Updated weights for policy 1, policy_version 1139514 (0.0009) [2023-12-26 08:45:16,884][123091] Updated weights for policy 0, policy_version 1147705 (0.0010) [2023-12-26 08:45:16,935][123091] Updated weights for policy 0, policy_version 1147715 (0.0010) [2023-12-26 08:45:16,991][123091] Updated weights for policy 0, policy_version 1147725 (0.0011) [2023-12-26 08:45:17,304][123090] Updated weights for policy 1, policy_version 1139524 (0.0007) [2023-12-26 08:45:17,368][123090] Updated weights for policy 1, policy_version 1139534 (0.0008) [2023-12-26 08:45:17,429][123090] Updated weights for policy 1, policy_version 1139544 (0.0006) [2023-12-26 08:45:17,762][123091] Updated weights for policy 0, policy_version 1147735 (0.0007) [2023-12-26 08:45:17,817][123091] Updated weights for policy 0, policy_version 1147745 (0.0009) [2023-12-26 08:45:17,864][123091] Updated weights for policy 0, policy_version 1147755 (0.0008) [2023-12-26 08:45:18,246][123090] Updated weights for policy 1, policy_version 1139554 (0.0006) [2023-12-26 08:45:18,309][123090] Updated weights for policy 1, policy_version 1139564 (0.0008) [2023-12-26 08:45:18,380][123090] Updated weights for policy 1, policy_version 1139574 (0.0008) [2023-12-26 08:45:18,451][123090] Updated weights for policy 1, policy_version 1139584 (0.0010) [2023-12-26 08:45:18,727][123091] Updated weights for policy 0, policy_version 1147765 (0.0009) [2023-12-26 08:45:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 585564160. Throughput: 0: 9001.3, 1: 8630.6. Samples: 585579212. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:18,785][121949] Avg episode reward: [(0, '6117.870'), (1, '5367.447')] [2023-12-26 08:45:18,788][123091] Updated weights for policy 0, policy_version 1147775 (0.0009) [2023-12-26 08:45:18,854][123091] Updated weights for policy 0, policy_version 1147785 (0.0009) [2023-12-26 08:45:19,197][123090] Updated weights for policy 1, policy_version 1139594 (0.0010) [2023-12-26 08:45:19,262][123090] Updated weights for policy 1, policy_version 1139604 (0.0011) [2023-12-26 08:45:19,326][123090] Updated weights for policy 1, policy_version 1139614 (0.0010) [2023-12-26 08:45:19,747][123091] Updated weights for policy 0, policy_version 1147795 (0.0010) [2023-12-26 08:45:19,816][123091] Updated weights for policy 0, policy_version 1147805 (0.0010) [2023-12-26 08:45:19,891][123091] Updated weights for policy 0, policy_version 1147815 (0.0009) [2023-12-26 08:45:20,234][123090] Updated weights for policy 1, policy_version 1139624 (0.0007) [2023-12-26 08:45:20,296][123090] Updated weights for policy 1, policy_version 1139634 (0.0008) [2023-12-26 08:45:20,364][123090] Updated weights for policy 1, policy_version 1139644 (0.0008) [2023-12-26 08:45:20,715][123091] Updated weights for policy 0, policy_version 1147825 (0.0009) [2023-12-26 08:45:20,785][123091] Updated weights for policy 0, policy_version 1147835 (0.0011) [2023-12-26 08:45:20,872][123091] Updated weights for policy 0, policy_version 1147845 (0.0010) [2023-12-26 08:45:20,943][123091] Updated weights for policy 0, policy_version 1147855 (0.0010) [2023-12-26 08:45:21,263][123090] Updated weights for policy 1, policy_version 1139654 (0.0009) [2023-12-26 08:45:21,336][123090] Updated weights for policy 1, policy_version 1139664 (0.0010) [2023-12-26 08:45:21,414][123090] Updated weights for policy 1, policy_version 1139674 (0.0010) [2023-12-26 08:45:21,778][123091] Updated weights for policy 0, policy_version 1147865 (0.0007) [2023-12-26 08:45:21,852][123091] Updated weights for policy 0, policy_version 1147875 (0.0006) [2023-12-26 08:45:21,923][123091] Updated weights for policy 0, policy_version 1147885 (0.0006) [2023-12-26 08:45:22,235][123090] Updated weights for policy 1, policy_version 1139684 (0.0010) [2023-12-26 08:45:22,309][123090] Updated weights for policy 1, policy_version 1139694 (0.0011) [2023-12-26 08:45:22,377][123090] Updated weights for policy 1, policy_version 1139704 (0.0009) [2023-12-26 08:45:22,657][123091] Updated weights for policy 0, policy_version 1147895 (0.0006) [2023-12-26 08:45:22,722][123091] Updated weights for policy 0, policy_version 1147905 (0.0008) [2023-12-26 08:45:22,789][123091] Updated weights for policy 0, policy_version 1147915 (0.0008) [2023-12-26 08:45:23,153][123090] Updated weights for policy 1, policy_version 1139714 (0.0008) [2023-12-26 08:45:23,210][123090] Updated weights for policy 1, policy_version 1139724 (0.0005) [2023-12-26 08:45:23,265][123090] Updated weights for policy 1, policy_version 1139734 (0.0005) [2023-12-26 08:45:23,318][123090] Updated weights for policy 1, policy_version 1139744 (0.0005) [2023-12-26 08:45:23,606][123091] Updated weights for policy 0, policy_version 1147925 (0.0009) [2023-12-26 08:45:23,661][123091] Updated weights for policy 0, policy_version 1147935 (0.0009) [2023-12-26 08:45:23,718][123091] Updated weights for policy 0, policy_version 1147945 (0.0009) [2023-12-26 08:45:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 585654272. Throughput: 0: 8970.2, 1: 8574.7. Samples: 585627892. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:23,785][121949] Avg episode reward: [(0, '6212.575'), (1, '5371.209')] [2023-12-26 08:45:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001147952_293879808.pth... [2023-12-26 08:45:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001139744_291774464.pth... [2023-12-26 08:45:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001146896_293609472.pth [2023-12-26 08:45:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001138752_291520512.pth [2023-12-26 08:45:24,021][123090] Updated weights for policy 1, policy_version 1139754 (0.0010) [2023-12-26 08:45:24,084][123090] Updated weights for policy 1, policy_version 1139764 (0.0010) [2023-12-26 08:45:24,147][123090] Updated weights for policy 1, policy_version 1139774 (0.0010) [2023-12-26 08:45:24,532][123091] Updated weights for policy 0, policy_version 1147955 (0.0010) [2023-12-26 08:45:24,583][123091] Updated weights for policy 0, policy_version 1147965 (0.0010) [2023-12-26 08:45:24,646][123091] Updated weights for policy 0, policy_version 1147975 (0.0010) [2023-12-26 08:45:24,950][123090] Updated weights for policy 1, policy_version 1139784 (0.0006) [2023-12-26 08:45:25,002][123090] Updated weights for policy 1, policy_version 1139794 (0.0005) [2023-12-26 08:45:25,076][123090] Updated weights for policy 1, policy_version 1139804 (0.0006) [2023-12-26 08:45:25,414][123091] Updated weights for policy 0, policy_version 1147985 (0.0009) [2023-12-26 08:45:25,483][123091] Updated weights for policy 0, policy_version 1147995 (0.0010) [2023-12-26 08:45:25,552][123091] Updated weights for policy 0, policy_version 1148005 (0.0010) [2023-12-26 08:45:25,605][123091] Updated weights for policy 0, policy_version 1148015 (0.0010) [2023-12-26 08:45:25,763][123090] Updated weights for policy 1, policy_version 1139814 (0.0007) [2023-12-26 08:45:25,817][123090] Updated weights for policy 1, policy_version 1139824 (0.0005) [2023-12-26 08:45:25,864][123090] Updated weights for policy 1, policy_version 1139834 (0.0005) [2023-12-26 08:45:26,296][123091] Updated weights for policy 0, policy_version 1148025 (0.0006) [2023-12-26 08:45:26,357][123091] Updated weights for policy 0, policy_version 1148035 (0.0006) [2023-12-26 08:45:26,402][123091] Updated weights for policy 0, policy_version 1148045 (0.0005) [2023-12-26 08:45:26,727][123090] Updated weights for policy 1, policy_version 1139844 (0.0007) [2023-12-26 08:45:26,789][123090] Updated weights for policy 1, policy_version 1139854 (0.0010) [2023-12-26 08:45:26,854][123090] Updated weights for policy 1, policy_version 1139864 (0.0010) [2023-12-26 08:45:27,072][123091] Updated weights for policy 0, policy_version 1148055 (0.0009) [2023-12-26 08:45:27,130][123091] Updated weights for policy 0, policy_version 1148065 (0.0010) [2023-12-26 08:45:27,188][123091] Updated weights for policy 0, policy_version 1148075 (0.0010) [2023-12-26 08:45:27,691][123090] Updated weights for policy 1, policy_version 1139874 (0.0010) [2023-12-26 08:45:27,750][123090] Updated weights for policy 1, policy_version 1139884 (0.0010) [2023-12-26 08:45:27,809][123090] Updated weights for policy 1, policy_version 1139894 (0.0010) [2023-12-26 08:45:27,863][123090] Updated weights for policy 1, policy_version 1139904 (0.0010) [2023-12-26 08:45:27,895][123091] Updated weights for policy 0, policy_version 1148085 (0.0008) [2023-12-26 08:45:27,955][123091] Updated weights for policy 0, policy_version 1148095 (0.0005) [2023-12-26 08:45:28,015][123091] Updated weights for policy 0, policy_version 1148105 (0.0008) [2023-12-26 08:45:28,746][123090] Updated weights for policy 1, policy_version 1139914 (0.0010) [2023-12-26 08:45:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 585736192. Throughput: 0: 9104.1, 1: 8606.9. Samples: 585737372. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:28,785][121949] Avg episode reward: [(0, '6254.414'), (1, '5533.703')] [2023-12-26 08:45:28,804][123091] Updated weights for policy 0, policy_version 1148115 (0.0010) [2023-12-26 08:45:28,804][123090] Updated weights for policy 1, policy_version 1139924 (0.0010) [2023-12-26 08:45:28,862][123090] Updated weights for policy 1, policy_version 1139934 (0.0008) [2023-12-26 08:45:28,868][123091] Updated weights for policy 0, policy_version 1148125 (0.0008) [2023-12-26 08:45:28,927][123091] Updated weights for policy 0, policy_version 1148135 (0.0010) [2023-12-26 08:45:29,634][123091] Updated weights for policy 0, policy_version 1148145 (0.0008) [2023-12-26 08:45:29,678][123091] Updated weights for policy 0, policy_version 1148155 (0.0005) [2023-12-26 08:45:29,725][123091] Updated weights for policy 0, policy_version 1148165 (0.0005) [2023-12-26 08:45:29,730][123090] Updated weights for policy 1, policy_version 1139944 (0.0008) [2023-12-26 08:45:29,782][123091] Updated weights for policy 0, policy_version 1148175 (0.0005) [2023-12-26 08:45:29,793][123090] Updated weights for policy 1, policy_version 1139954 (0.0008) [2023-12-26 08:45:29,854][123090] Updated weights for policy 1, policy_version 1139964 (0.0009) [2023-12-26 08:45:30,525][123091] Updated weights for policy 0, policy_version 1148185 (0.0010) [2023-12-26 08:45:30,579][123091] Updated weights for policy 0, policy_version 1148197 (0.0010) [2023-12-26 08:45:30,606][123090] Updated weights for policy 1, policy_version 1139974 (0.0007) [2023-12-26 08:45:30,643][123091] Updated weights for policy 0, policy_version 1148207 (0.0010) [2023-12-26 08:45:30,670][123090] Updated weights for policy 1, policy_version 1139984 (0.0006) [2023-12-26 08:45:30,739][123090] Updated weights for policy 1, policy_version 1139994 (0.0005) [2023-12-26 08:45:31,449][123090] Updated weights for policy 1, policy_version 1140004 (0.0007) [2023-12-26 08:45:31,513][123090] Updated weights for policy 1, policy_version 1140014 (0.0009) [2023-12-26 08:45:31,526][123091] Updated weights for policy 0, policy_version 1148217 (0.0010) [2023-12-26 08:45:31,570][123090] Updated weights for policy 1, policy_version 1140024 (0.0008) [2023-12-26 08:45:31,592][123091] Updated weights for policy 0, policy_version 1148227 (0.0009) [2023-12-26 08:45:31,656][123091] Updated weights for policy 0, policy_version 1148237 (0.0009) [2023-12-26 08:45:32,332][123090] Updated weights for policy 1, policy_version 1140034 (0.0008) [2023-12-26 08:45:32,401][123090] Updated weights for policy 1, policy_version 1140044 (0.0010) [2023-12-26 08:45:32,459][123091] Updated weights for policy 0, policy_version 1148247 (0.0005) [2023-12-26 08:45:32,470][123090] Updated weights for policy 1, policy_version 1140054 (0.0006) [2023-12-26 08:45:32,507][123091] Updated weights for policy 0, policy_version 1148257 (0.0006) [2023-12-26 08:45:32,546][123090] Updated weights for policy 1, policy_version 1140064 (0.0007) [2023-12-26 08:45:32,555][123091] Updated weights for policy 0, policy_version 1148267 (0.0005) [2023-12-26 08:45:33,303][123091] Updated weights for policy 0, policy_version 1148277 (0.0007) [2023-12-26 08:45:33,338][123090] Updated weights for policy 1, policy_version 1140074 (0.0007) [2023-12-26 08:45:33,360][123091] Updated weights for policy 0, policy_version 1148287 (0.0005) [2023-12-26 08:45:33,400][123090] Updated weights for policy 1, policy_version 1140084 (0.0006) [2023-12-26 08:45:33,418][123091] Updated weights for policy 0, policy_version 1148297 (0.0005) [2023-12-26 08:45:33,459][123090] Updated weights for policy 1, policy_version 1140094 (0.0006) [2023-12-26 08:45:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 585834496. Throughput: 0: 9043.2, 1: 8616.3. Samples: 585844060. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:33,785][121949] Avg episode reward: [(0, '6223.942'), (1, '5537.906')] [2023-12-26 08:45:34,074][123091] Updated weights for policy 0, policy_version 1148307 (0.0006) [2023-12-26 08:45:34,136][123091] Updated weights for policy 0, policy_version 1148317 (0.0009) [2023-12-26 08:45:34,191][123090] Updated weights for policy 1, policy_version 1140104 (0.0007) [2023-12-26 08:45:34,200][123091] Updated weights for policy 0, policy_version 1148327 (0.0008) [2023-12-26 08:45:34,262][123090] Updated weights for policy 1, policy_version 1140114 (0.0008) [2023-12-26 08:45:34,319][123090] Updated weights for policy 1, policy_version 1140124 (0.0009) [2023-12-26 08:45:35,048][123090] Updated weights for policy 1, policy_version 1140134 (0.0010) [2023-12-26 08:45:35,094][123091] Updated weights for policy 0, policy_version 1148337 (0.0009) [2023-12-26 08:45:35,120][123090] Updated weights for policy 1, policy_version 1140144 (0.0009) [2023-12-26 08:45:35,159][123091] Updated weights for policy 0, policy_version 1148347 (0.0009) [2023-12-26 08:45:35,183][123090] Updated weights for policy 1, policy_version 1140154 (0.0008) [2023-12-26 08:45:35,211][123091] Updated weights for policy 0, policy_version 1148357 (0.0007) [2023-12-26 08:45:35,268][123091] Updated weights for policy 0, policy_version 1148367 (0.0005) [2023-12-26 08:45:35,930][123090] Updated weights for policy 1, policy_version 1140164 (0.0008) [2023-12-26 08:45:35,994][123091] Updated weights for policy 0, policy_version 1148377 (0.0005) [2023-12-26 08:45:35,997][123090] Updated weights for policy 1, policy_version 1140174 (0.0005) [2023-12-26 08:45:36,060][123090] Updated weights for policy 1, policy_version 1140184 (0.0009) [2023-12-26 08:45:36,063][123091] Updated weights for policy 0, policy_version 1148387 (0.0005) [2023-12-26 08:45:36,132][123091] Updated weights for policy 0, policy_version 1148397 (0.0006) [2023-12-26 08:45:36,738][123090] Updated weights for policy 1, policy_version 1140194 (0.0009) [2023-12-26 08:45:36,801][123090] Updated weights for policy 1, policy_version 1140204 (0.0007) [2023-12-26 08:45:36,829][123091] Updated weights for policy 0, policy_version 1148407 (0.0007) [2023-12-26 08:45:36,855][123090] Updated weights for policy 1, policy_version 1140214 (0.0007) [2023-12-26 08:45:36,890][123091] Updated weights for policy 0, policy_version 1148417 (0.0005) [2023-12-26 08:45:36,910][123090] Updated weights for policy 1, policy_version 1140224 (0.0007) [2023-12-26 08:45:36,956][123091] Updated weights for policy 0, policy_version 1148427 (0.0005) [2023-12-26 08:45:37,606][123091] Updated weights for policy 0, policy_version 1148437 (0.0005) [2023-12-26 08:45:37,677][123091] Updated weights for policy 0, policy_version 1148447 (0.0009) [2023-12-26 08:45:37,702][123090] Updated weights for policy 1, policy_version 1140234 (0.0006) [2023-12-26 08:45:37,733][123091] Updated weights for policy 0, policy_version 1148457 (0.0010) [2023-12-26 08:45:37,757][123090] Updated weights for policy 1, policy_version 1140244 (0.0007) [2023-12-26 08:45:37,816][123090] Updated weights for policy 1, policy_version 1140254 (0.0009) [2023-12-26 08:45:38,487][123091] Updated weights for policy 0, policy_version 1148467 (0.0009) [2023-12-26 08:45:38,529][123090] Updated weights for policy 1, policy_version 1140264 (0.0008) [2023-12-26 08:45:38,540][123091] Updated weights for policy 0, policy_version 1148477 (0.0005) [2023-12-26 08:45:38,589][123091] Updated weights for policy 0, policy_version 1148487 (0.0005) [2023-12-26 08:45:38,592][123090] Updated weights for policy 1, policy_version 1140274 (0.0009) [2023-12-26 08:45:38,653][123090] Updated weights for policy 1, policy_version 1140284 (0.0009) [2023-12-26 08:45:38,784][121949] Fps is (10 sec: 19660.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 585932800. Throughput: 0: 9068.1, 1: 8681.0. Samples: 585900120. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:38,785][121949] Avg episode reward: [(0, '6266.685'), (1, '5554.315')] [2023-12-26 08:45:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001148496_294019072.pth... [2023-12-26 08:45:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001140288_291913728.pth... [2023-12-26 08:45:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001139264_291651584.pth [2023-12-26 08:45:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001147440_293748736.pth [2023-12-26 08:45:39,357][123091] Updated weights for policy 0, policy_version 1148497 (0.0006) [2023-12-26 08:45:39,429][123091] Updated weights for policy 0, policy_version 1148507 (0.0010) [2023-12-26 08:45:39,489][123091] Updated weights for policy 0, policy_version 1148517 (0.0011) [2023-12-26 08:45:39,542][123091] Updated weights for policy 0, policy_version 1148527 (0.0010) [2023-12-26 08:45:39,550][123090] Updated weights for policy 1, policy_version 1140294 (0.0009) [2023-12-26 08:45:39,625][123090] Updated weights for policy 1, policy_version 1140304 (0.0009) [2023-12-26 08:45:39,692][123090] Updated weights for policy 1, policy_version 1140314 (0.0007) [2023-12-26 08:45:40,420][123091] Updated weights for policy 0, policy_version 1148537 (0.0008) [2023-12-26 08:45:40,437][123090] Updated weights for policy 1, policy_version 1140324 (0.0006) [2023-12-26 08:45:40,474][123091] Updated weights for policy 0, policy_version 1148547 (0.0010) [2023-12-26 08:45:40,485][123090] Updated weights for policy 1, policy_version 1140334 (0.0006) [2023-12-26 08:45:40,524][123091] Updated weights for policy 0, policy_version 1148557 (0.0007) [2023-12-26 08:45:40,539][123090] Updated weights for policy 1, policy_version 1140344 (0.0009) [2023-12-26 08:45:41,327][123091] Updated weights for policy 0, policy_version 1148567 (0.0009) [2023-12-26 08:45:41,395][123091] Updated weights for policy 0, policy_version 1148577 (0.0009) [2023-12-26 08:45:41,438][123090] Updated weights for policy 1, policy_version 1140355 (0.0010) [2023-12-26 08:45:41,462][123091] Updated weights for policy 0, policy_version 1148587 (0.0008) [2023-12-26 08:45:41,501][123090] Updated weights for policy 1, policy_version 1140365 (0.0009) [2023-12-26 08:45:41,571][123090] Updated weights for policy 1, policy_version 1140375 (0.0010) [2023-12-26 08:45:42,315][123091] Updated weights for policy 0, policy_version 1148597 (0.0010) [2023-12-26 08:45:42,393][123091] Updated weights for policy 0, policy_version 1148607 (0.0010) [2023-12-26 08:45:42,434][123090] Updated weights for policy 1, policy_version 1140385 (0.0009) [2023-12-26 08:45:42,458][123091] Updated weights for policy 0, policy_version 1148617 (0.0008) [2023-12-26 08:45:42,500][123090] Updated weights for policy 1, policy_version 1140395 (0.0010) [2023-12-26 08:45:42,570][123090] Updated weights for policy 1, policy_version 1140405 (0.0008) [2023-12-26 08:45:42,630][123090] Updated weights for policy 1, policy_version 1140415 (0.0006) [2023-12-26 08:45:43,342][123091] Updated weights for policy 0, policy_version 1148627 (0.0010) [2023-12-26 08:45:43,389][123090] Updated weights for policy 1, policy_version 1140425 (0.0005) [2023-12-26 08:45:43,400][123091] Updated weights for policy 0, policy_version 1148638 (0.0010) [2023-12-26 08:45:43,447][123090] Updated weights for policy 1, policy_version 1140435 (0.0006) [2023-12-26 08:45:43,459][123091] Updated weights for policy 0, policy_version 1148648 (0.0008) [2023-12-26 08:45:43,508][123090] Updated weights for policy 1, policy_version 1140445 (0.0008) [2023-12-26 08:45:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 586014720. Throughput: 0: 9018.2, 1: 8584.6. Samples: 586005824. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:43,785][121949] Avg episode reward: [(0, '6261.964'), (1, '5569.811')] [2023-12-26 08:45:44,238][123090] Updated weights for policy 1, policy_version 1140455 (0.0006) [2023-12-26 08:45:44,286][123090] Updated weights for policy 1, policy_version 1140465 (0.0005) [2023-12-26 08:45:44,347][123091] Updated weights for policy 0, policy_version 1148658 (0.0008) [2023-12-26 08:45:44,351][123090] Updated weights for policy 1, policy_version 1140475 (0.0005) [2023-12-26 08:45:44,411][123091] Updated weights for policy 0, policy_version 1148668 (0.0010) [2023-12-26 08:45:44,477][123091] Updated weights for policy 0, policy_version 1148678 (0.0010) [2023-12-26 08:45:44,544][123091] Updated weights for policy 0, policy_version 1148688 (0.0009) [2023-12-26 08:45:45,025][123090] Updated weights for policy 1, policy_version 1140485 (0.0006) [2023-12-26 08:45:45,091][123090] Updated weights for policy 1, policy_version 1140495 (0.0005) [2023-12-26 08:45:45,151][123090] Updated weights for policy 1, policy_version 1140505 (0.0005) [2023-12-26 08:45:45,319][123091] Updated weights for policy 0, policy_version 1148698 (0.0010) [2023-12-26 08:45:45,386][123091] Updated weights for policy 0, policy_version 1148708 (0.0010) [2023-12-26 08:45:45,456][123091] Updated weights for policy 0, policy_version 1148718 (0.0010) [2023-12-26 08:45:45,780][123090] Updated weights for policy 1, policy_version 1140515 (0.0007) [2023-12-26 08:45:45,848][123090] Updated weights for policy 1, policy_version 1140525 (0.0011) [2023-12-26 08:45:45,910][123090] Updated weights for policy 1, policy_version 1140535 (0.0010) [2023-12-26 08:45:46,329][123091] Updated weights for policy 0, policy_version 1148728 (0.0009) [2023-12-26 08:45:46,384][123091] Updated weights for policy 0, policy_version 1148738 (0.0008) [2023-12-26 08:45:46,447][123091] Updated weights for policy 0, policy_version 1148748 (0.0010) [2023-12-26 08:45:46,581][123090] Updated weights for policy 1, policy_version 1140545 (0.0010) [2023-12-26 08:45:46,638][123090] Updated weights for policy 1, policy_version 1140555 (0.0006) [2023-12-26 08:45:46,693][123090] Updated weights for policy 1, policy_version 1140565 (0.0010) [2023-12-26 08:45:46,748][123090] Updated weights for policy 1, policy_version 1140575 (0.0010) [2023-12-26 08:45:47,315][123091] Updated weights for policy 0, policy_version 1148758 (0.0009) [2023-12-26 08:45:47,377][123091] Updated weights for policy 0, policy_version 1148768 (0.0009) [2023-12-26 08:45:47,431][123091] Updated weights for policy 0, policy_version 1148778 (0.0009) [2023-12-26 08:45:47,447][123090] Updated weights for policy 1, policy_version 1140585 (0.0008) [2023-12-26 08:45:47,512][123090] Updated weights for policy 1, policy_version 1140595 (0.0009) [2023-12-26 08:45:47,575][123090] Updated weights for policy 1, policy_version 1140605 (0.0010) [2023-12-26 08:45:48,211][123091] Updated weights for policy 0, policy_version 1148788 (0.0006) [2023-12-26 08:45:48,264][123091] Updated weights for policy 0, policy_version 1148798 (0.0005) [2023-12-26 08:45:48,315][123091] Updated weights for policy 0, policy_version 1148808 (0.0005) [2023-12-26 08:45:48,420][123090] Updated weights for policy 1, policy_version 1140615 (0.0009) [2023-12-26 08:45:48,484][123090] Updated weights for policy 1, policy_version 1140625 (0.0009) [2023-12-26 08:45:48,548][123090] Updated weights for policy 1, policy_version 1140635 (0.0010) [2023-12-26 08:45:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 586104832. Throughput: 0: 8946.7, 1: 8746.0. Samples: 586113220. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:48,784][121949] Avg episode reward: [(0, '6177.286'), (1, '5525.238')] [2023-12-26 08:45:49,049][123091] Updated weights for policy 0, policy_version 1148818 (0.0008) [2023-12-26 08:45:49,110][123091] Updated weights for policy 0, policy_version 1148828 (0.0005) [2023-12-26 08:45:49,179][123091] Updated weights for policy 0, policy_version 1148838 (0.0005) [2023-12-26 08:45:49,250][123091] Updated weights for policy 0, policy_version 1148848 (0.0007) [2023-12-26 08:45:49,476][123090] Updated weights for policy 1, policy_version 1140645 (0.0009) [2023-12-26 08:45:49,541][123090] Updated weights for policy 1, policy_version 1140655 (0.0009) [2023-12-26 08:45:49,604][123090] Updated weights for policy 1, policy_version 1140665 (0.0008) [2023-12-26 08:45:50,008][123091] Updated weights for policy 0, policy_version 1148858 (0.0011) [2023-12-26 08:45:50,080][123091] Updated weights for policy 0, policy_version 1148868 (0.0011) [2023-12-26 08:45:50,140][123091] Updated weights for policy 0, policy_version 1148878 (0.0011) [2023-12-26 08:45:50,425][123090] Updated weights for policy 1, policy_version 1140675 (0.0009) [2023-12-26 08:45:50,478][123090] Updated weights for policy 1, policy_version 1140685 (0.0008) [2023-12-26 08:45:50,539][123090] Updated weights for policy 1, policy_version 1140695 (0.0009) [2023-12-26 08:45:50,981][123091] Updated weights for policy 0, policy_version 1148888 (0.0011) [2023-12-26 08:45:51,065][123091] Updated weights for policy 0, policy_version 1148898 (0.0011) [2023-12-26 08:45:51,132][123091] Updated weights for policy 0, policy_version 1148908 (0.0011) [2023-12-26 08:45:51,404][123090] Updated weights for policy 1, policy_version 1140705 (0.0009) [2023-12-26 08:45:51,470][123090] Updated weights for policy 1, policy_version 1140715 (0.0008) [2023-12-26 08:45:51,535][123090] Updated weights for policy 1, policy_version 1140725 (0.0009) [2023-12-26 08:45:51,596][123090] Updated weights for policy 1, policy_version 1140735 (0.0008) [2023-12-26 08:45:51,934][123091] Updated weights for policy 0, policy_version 1148918 (0.0008) [2023-12-26 08:45:51,992][123091] Updated weights for policy 0, policy_version 1148928 (0.0006) [2023-12-26 08:45:52,050][123091] Updated weights for policy 0, policy_version 1148938 (0.0006) [2023-12-26 08:45:52,365][123090] Updated weights for policy 1, policy_version 1140745 (0.0010) [2023-12-26 08:45:52,437][123090] Updated weights for policy 1, policy_version 1140755 (0.0011) [2023-12-26 08:45:52,494][123090] Updated weights for policy 1, policy_version 1140765 (0.0011) [2023-12-26 08:45:52,750][123091] Updated weights for policy 0, policy_version 1148948 (0.0006) [2023-12-26 08:45:52,821][123091] Updated weights for policy 0, policy_version 1148958 (0.0006) [2023-12-26 08:45:52,893][123091] Updated weights for policy 0, policy_version 1148968 (0.0005) [2023-12-26 08:45:53,307][123090] Updated weights for policy 1, policy_version 1140775 (0.0007) [2023-12-26 08:45:53,376][123090] Updated weights for policy 1, policy_version 1140785 (0.0005) [2023-12-26 08:45:53,442][123090] Updated weights for policy 1, policy_version 1140795 (0.0005) [2023-12-26 08:45:53,519][123091] Updated weights for policy 0, policy_version 1148978 (0.0005) [2023-12-26 08:45:53,571][123091] Updated weights for policy 0, policy_version 1148988 (0.0005) [2023-12-26 08:45:53,636][123091] Updated weights for policy 0, policy_version 1148998 (0.0005) [2023-12-26 08:45:53,688][123091] Updated weights for policy 0, policy_version 1149008 (0.0005) [2023-12-26 08:45:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 586194944. Throughput: 0: 8870.5, 1: 8741.2. Samples: 586164180. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:53,785][121949] Avg episode reward: [(0, '6154.782'), (1, '5556.531')] [2023-12-26 08:45:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001149008_294150144.pth... [2023-12-26 08:45:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001140800_292044800.pth... [2023-12-26 08:45:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001147952_293879808.pth [2023-12-26 08:45:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001139744_291774464.pth [2023-12-26 08:45:54,137][123090] Updated weights for policy 1, policy_version 1140805 (0.0008) [2023-12-26 08:45:54,217][123090] Updated weights for policy 1, policy_version 1140815 (0.0010) [2023-12-26 08:45:54,256][123091] Updated weights for policy 0, policy_version 1149018 (0.0005) [2023-12-26 08:45:54,284][123090] Updated weights for policy 1, policy_version 1140825 (0.0010) [2023-12-26 08:45:54,310][123091] Updated weights for policy 0, policy_version 1149028 (0.0005) [2023-12-26 08:45:54,365][123091] Updated weights for policy 0, policy_version 1149038 (0.0005) [2023-12-26 08:45:55,005][123090] Updated weights for policy 1, policy_version 1140835 (0.0010) [2023-12-26 08:45:55,007][123091] Updated weights for policy 0, policy_version 1149048 (0.0006) [2023-12-26 08:45:55,059][123091] Updated weights for policy 0, policy_version 1149058 (0.0006) [2023-12-26 08:45:55,068][123090] Updated weights for policy 1, policy_version 1140845 (0.0010) [2023-12-26 08:45:55,126][123091] Updated weights for policy 0, policy_version 1149068 (0.0007) [2023-12-26 08:45:55,127][123090] Updated weights for policy 1, policy_version 1140855 (0.0010) [2023-12-26 08:45:55,846][123091] Updated weights for policy 0, policy_version 1149078 (0.0006) [2023-12-26 08:45:55,888][123090] Updated weights for policy 1, policy_version 1140865 (0.0010) [2023-12-26 08:45:55,911][123091] Updated weights for policy 0, policy_version 1149088 (0.0007) [2023-12-26 08:45:55,958][123090] Updated weights for policy 1, policy_version 1140875 (0.0010) [2023-12-26 08:45:55,975][123091] Updated weights for policy 0, policy_version 1149098 (0.0006) [2023-12-26 08:45:56,020][123090] Updated weights for policy 1, policy_version 1140885 (0.0010) [2023-12-26 08:45:56,086][123090] Updated weights for policy 1, policy_version 1140895 (0.0010) [2023-12-26 08:45:56,763][123091] Updated weights for policy 0, policy_version 1149108 (0.0008) [2023-12-26 08:45:56,834][123091] Updated weights for policy 0, policy_version 1149118 (0.0006) [2023-12-26 08:45:56,888][123090] Updated weights for policy 1, policy_version 1140905 (0.0010) [2023-12-26 08:45:56,891][123091] Updated weights for policy 0, policy_version 1149128 (0.0006) [2023-12-26 08:45:56,949][123090] Updated weights for policy 1, policy_version 1140915 (0.0010) [2023-12-26 08:45:57,022][123090] Updated weights for policy 1, policy_version 1140925 (0.0011) [2023-12-26 08:45:57,536][123091] Updated weights for policy 0, policy_version 1149138 (0.0007) [2023-12-26 08:45:57,605][123091] Updated weights for policy 0, policy_version 1149148 (0.0009) [2023-12-26 08:45:57,669][123091] Updated weights for policy 0, policy_version 1149158 (0.0010) [2023-12-26 08:45:57,737][123091] Updated weights for policy 0, policy_version 1149168 (0.0010) [2023-12-26 08:45:57,752][123090] Updated weights for policy 1, policy_version 1140935 (0.0009) [2023-12-26 08:45:57,823][123090] Updated weights for policy 1, policy_version 1140945 (0.0010) [2023-12-26 08:45:57,893][123090] Updated weights for policy 1, policy_version 1140955 (0.0010) [2023-12-26 08:45:58,579][123091] Updated weights for policy 0, policy_version 1149178 (0.0009) [2023-12-26 08:45:58,655][123091] Updated weights for policy 0, policy_version 1149188 (0.0011) [2023-12-26 08:45:58,720][123091] Updated weights for policy 0, policy_version 1149198 (0.0008) [2023-12-26 08:45:58,737][123090] Updated weights for policy 1, policy_version 1140965 (0.0009) [2023-12-26 08:45:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 586285056. Throughput: 0: 9025.7, 1: 8864.3. Samples: 586279744. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:45:58,785][121949] Avg episode reward: [(0, '6211.196'), (1, '5539.081')] [2023-12-26 08:45:58,802][123090] Updated weights for policy 1, policy_version 1140975 (0.0008) [2023-12-26 08:45:58,857][123090] Updated weights for policy 1, policy_version 1140985 (0.0008) [2023-12-26 08:45:59,517][123091] Updated weights for policy 0, policy_version 1149208 (0.0011) [2023-12-26 08:45:59,577][123091] Updated weights for policy 0, policy_version 1149218 (0.0011) [2023-12-26 08:45:59,625][123091] Updated weights for policy 0, policy_version 1149228 (0.0010) [2023-12-26 08:45:59,657][123090] Updated weights for policy 1, policy_version 1140995 (0.0007) [2023-12-26 08:45:59,711][123090] Updated weights for policy 1, policy_version 1141005 (0.0005) [2023-12-26 08:45:59,776][123090] Updated weights for policy 1, policy_version 1141015 (0.0005) [2023-12-26 08:46:00,466][123091] Updated weights for policy 0, policy_version 1149238 (0.0010) [2023-12-26 08:46:00,530][123091] Updated weights for policy 0, policy_version 1149248 (0.0008) [2023-12-26 08:46:00,570][123090] Updated weights for policy 1, policy_version 1141025 (0.0008) [2023-12-26 08:46:00,596][123091] Updated weights for policy 0, policy_version 1149258 (0.0009) [2023-12-26 08:46:00,629][123090] Updated weights for policy 1, policy_version 1141035 (0.0008) [2023-12-26 08:46:00,680][123090] Updated weights for policy 1, policy_version 1141045 (0.0010) [2023-12-26 08:46:00,742][123090] Updated weights for policy 1, policy_version 1141055 (0.0010) [2023-12-26 08:46:01,424][123091] Updated weights for policy 0, policy_version 1149268 (0.0007) [2023-12-26 08:46:01,477][123091] Updated weights for policy 0, policy_version 1149278 (0.0009) [2023-12-26 08:46:01,524][123090] Updated weights for policy 1, policy_version 1141065 (0.0009) [2023-12-26 08:46:01,533][123091] Updated weights for policy 0, policy_version 1149288 (0.0009) [2023-12-26 08:46:01,581][123090] Updated weights for policy 1, policy_version 1141075 (0.0009) [2023-12-26 08:46:01,650][123090] Updated weights for policy 1, policy_version 1141085 (0.0009) [2023-12-26 08:46:02,416][123091] Updated weights for policy 0, policy_version 1149298 (0.0009) [2023-12-26 08:46:02,447][123090] Updated weights for policy 1, policy_version 1141095 (0.0008) [2023-12-26 08:46:02,470][123091] Updated weights for policy 0, policy_version 1149308 (0.0006) [2023-12-26 08:46:02,519][123090] Updated weights for policy 1, policy_version 1141105 (0.0008) [2023-12-26 08:46:02,526][123091] Updated weights for policy 0, policy_version 1149318 (0.0005) [2023-12-26 08:46:02,572][123090] Updated weights for policy 1, policy_version 1141115 (0.0008) [2023-12-26 08:46:02,578][123091] Updated weights for policy 0, policy_version 1149328 (0.0008) [2023-12-26 08:46:03,380][123090] Updated weights for policy 1, policy_version 1141125 (0.0009) [2023-12-26 08:46:03,382][123091] Updated weights for policy 0, policy_version 1149338 (0.0006) [2023-12-26 08:46:03,442][123091] Updated weights for policy 0, policy_version 1149348 (0.0006) [2023-12-26 08:46:03,445][123090] Updated weights for policy 1, policy_version 1141135 (0.0008) [2023-12-26 08:46:03,491][123091] Updated weights for policy 0, policy_version 1149358 (0.0008) [2023-12-26 08:46:03,497][123090] Updated weights for policy 1, policy_version 1141145 (0.0010) [2023-12-26 08:46:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 586375168. Throughput: 0: 8962.5, 1: 8892.1. Samples: 586382668. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:03,785][121949] Avg episode reward: [(0, '6262.730'), (1, '5515.217')] [2023-12-26 08:46:04,324][123091] Updated weights for policy 0, policy_version 1149368 (0.0008) [2023-12-26 08:46:04,329][123090] Updated weights for policy 1, policy_version 1141155 (0.0009) [2023-12-26 08:46:04,379][123091] Updated weights for policy 0, policy_version 1149378 (0.0008) [2023-12-26 08:46:04,390][123090] Updated weights for policy 1, policy_version 1141165 (0.0009) [2023-12-26 08:46:04,432][123091] Updated weights for policy 0, policy_version 1149388 (0.0007) [2023-12-26 08:46:04,455][123090] Updated weights for policy 1, policy_version 1141175 (0.0010) [2023-12-26 08:46:05,120][123090] Updated weights for policy 1, policy_version 1141185 (0.0009) [2023-12-26 08:46:05,188][123090] Updated weights for policy 1, policy_version 1141195 (0.0005) [2023-12-26 08:46:05,245][123090] Updated weights for policy 1, policy_version 1141205 (0.0006) [2023-12-26 08:46:05,292][123091] Updated weights for policy 0, policy_version 1149398 (0.0007) [2023-12-26 08:46:05,306][123090] Updated weights for policy 1, policy_version 1141215 (0.0007) [2023-12-26 08:46:05,339][123091] Updated weights for policy 0, policy_version 1149408 (0.0008) [2023-12-26 08:46:05,393][123091] Updated weights for policy 0, policy_version 1149418 (0.0009) [2023-12-26 08:46:06,069][123090] Updated weights for policy 1, policy_version 1141225 (0.0006) [2023-12-26 08:46:06,137][123090] Updated weights for policy 1, policy_version 1141235 (0.0007) [2023-12-26 08:46:06,195][123090] Updated weights for policy 1, policy_version 1141245 (0.0010) [2023-12-26 08:46:06,282][123091] Updated weights for policy 0, policy_version 1149428 (0.0009) [2023-12-26 08:46:06,350][123091] Updated weights for policy 0, policy_version 1149438 (0.0010) [2023-12-26 08:46:06,419][123091] Updated weights for policy 0, policy_version 1149448 (0.0010) [2023-12-26 08:46:06,999][123090] Updated weights for policy 1, policy_version 1141255 (0.0008) [2023-12-26 08:46:07,056][123090] Updated weights for policy 1, policy_version 1141265 (0.0009) [2023-12-26 08:46:07,126][123090] Updated weights for policy 1, policy_version 1141275 (0.0008) [2023-12-26 08:46:07,253][123091] Updated weights for policy 0, policy_version 1149458 (0.0009) [2023-12-26 08:46:07,316][123091] Updated weights for policy 0, policy_version 1149468 (0.0008) [2023-12-26 08:46:07,370][123091] Updated weights for policy 0, policy_version 1149478 (0.0008) [2023-12-26 08:46:07,424][123091] Updated weights for policy 0, policy_version 1149488 (0.0009) [2023-12-26 08:46:07,945][123090] Updated weights for policy 1, policy_version 1141285 (0.0009) [2023-12-26 08:46:08,004][123090] Updated weights for policy 1, policy_version 1141295 (0.0009) [2023-12-26 08:46:08,066][123090] Updated weights for policy 1, policy_version 1141305 (0.0009) [2023-12-26 08:46:08,257][123091] Updated weights for policy 0, policy_version 1149498 (0.0010) [2023-12-26 08:46:08,320][123091] Updated weights for policy 0, policy_version 1149508 (0.0009) [2023-12-26 08:46:08,392][123091] Updated weights for policy 0, policy_version 1149518 (0.0010) [2023-12-26 08:46:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 586457088. Throughput: 0: 8980.0, 1: 8951.3. Samples: 586434800. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:08,785][121949] Avg episode reward: [(0, '6309.747'), (1, '5443.758')] [2023-12-26 08:46:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001149520_294281216.pth... [2023-12-26 08:46:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001141312_292175872.pth... [2023-12-26 08:46:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001140288_291913728.pth [2023-12-26 08:46:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001148496_294019072.pth [2023-12-26 08:46:08,921][123090] Updated weights for policy 1, policy_version 1141315 (0.0009) [2023-12-26 08:46:08,968][123090] Updated weights for policy 1, policy_version 1141325 (0.0008) [2023-12-26 08:46:09,028][123090] Updated weights for policy 1, policy_version 1141335 (0.0010) [2023-12-26 08:46:09,207][123091] Updated weights for policy 0, policy_version 1149528 (0.0010) [2023-12-26 08:46:09,271][123091] Updated weights for policy 0, policy_version 1149538 (0.0010) [2023-12-26 08:46:09,337][123091] Updated weights for policy 0, policy_version 1149548 (0.0010) [2023-12-26 08:46:09,943][123090] Updated weights for policy 1, policy_version 1141345 (0.0009) [2023-12-26 08:46:10,012][123090] Updated weights for policy 1, policy_version 1141355 (0.0009) [2023-12-26 08:46:10,083][123090] Updated weights for policy 1, policy_version 1141365 (0.0010) [2023-12-26 08:46:10,152][123090] Updated weights for policy 1, policy_version 1141375 (0.0009) [2023-12-26 08:46:10,208][123091] Updated weights for policy 0, policy_version 1149558 (0.0009) [2023-12-26 08:46:10,280][123091] Updated weights for policy 0, policy_version 1149568 (0.0010) [2023-12-26 08:46:10,345][123091] Updated weights for policy 0, policy_version 1149578 (0.0009) [2023-12-26 08:46:10,932][123090] Updated weights for policy 1, policy_version 1141385 (0.0008) [2023-12-26 08:46:11,001][123090] Updated weights for policy 1, policy_version 1141395 (0.0005) [2023-12-26 08:46:11,072][123090] Updated weights for policy 1, policy_version 1141405 (0.0008) [2023-12-26 08:46:11,126][123091] Updated weights for policy 0, policy_version 1149588 (0.0010) [2023-12-26 08:46:11,192][123091] Updated weights for policy 0, policy_version 1149598 (0.0010) [2023-12-26 08:46:11,257][123091] Updated weights for policy 0, policy_version 1149608 (0.0010) [2023-12-26 08:46:11,856][123090] Updated weights for policy 1, policy_version 1141415 (0.0009) [2023-12-26 08:46:11,918][123090] Updated weights for policy 1, policy_version 1141425 (0.0009) [2023-12-26 08:46:11,975][123090] Updated weights for policy 1, policy_version 1141435 (0.0009) [2023-12-26 08:46:12,167][123091] Updated weights for policy 0, policy_version 1149618 (0.0009) [2023-12-26 08:46:12,217][123091] Updated weights for policy 0, policy_version 1149628 (0.0009) [2023-12-26 08:46:12,276][123091] Updated weights for policy 0, policy_version 1149638 (0.0009) [2023-12-26 08:46:12,344][123091] Updated weights for policy 0, policy_version 1149648 (0.0010) [2023-12-26 08:46:12,886][123090] Updated weights for policy 1, policy_version 1141445 (0.0011) [2023-12-26 08:46:12,953][123090] Updated weights for policy 1, policy_version 1141455 (0.0010) [2023-12-26 08:46:13,016][123090] Updated weights for policy 1, policy_version 1141465 (0.0010) [2023-12-26 08:46:13,195][123091] Updated weights for policy 0, policy_version 1149658 (0.0005) [2023-12-26 08:46:13,264][123091] Updated weights for policy 0, policy_version 1149668 (0.0008) [2023-12-26 08:46:13,337][123091] Updated weights for policy 0, policy_version 1149678 (0.0006) [2023-12-26 08:46:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 586539008. Throughput: 0: 8857.0, 1: 8884.5. Samples: 586535740. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:13,785][121949] Avg episode reward: [(0, '6223.750'), (1, '5444.572')] [2023-12-26 08:46:13,842][123090] Updated weights for policy 1, policy_version 1141475 (0.0010) [2023-12-26 08:46:13,908][123090] Updated weights for policy 1, policy_version 1141485 (0.0008) [2023-12-26 08:46:13,978][123090] Updated weights for policy 1, policy_version 1141495 (0.0011) [2023-12-26 08:46:14,091][123091] Updated weights for policy 0, policy_version 1149688 (0.0006) [2023-12-26 08:46:14,149][123091] Updated weights for policy 0, policy_version 1149698 (0.0007) [2023-12-26 08:46:14,207][123091] Updated weights for policy 0, policy_version 1149708 (0.0005) [2023-12-26 08:46:14,687][123090] Updated weights for policy 1, policy_version 1141505 (0.0010) [2023-12-26 08:46:14,759][123090] Updated weights for policy 1, policy_version 1141515 (0.0005) [2023-12-26 08:46:14,826][123090] Updated weights for policy 1, policy_version 1141525 (0.0008) [2023-12-26 08:46:14,876][123091] Updated weights for policy 0, policy_version 1149718 (0.0007) [2023-12-26 08:46:14,881][123090] Updated weights for policy 1, policy_version 1141535 (0.0006) [2023-12-26 08:46:14,928][123091] Updated weights for policy 0, policy_version 1149728 (0.0010) [2023-12-26 08:46:14,986][123091] Updated weights for policy 0, policy_version 1149738 (0.0010) [2023-12-26 08:46:15,624][123090] Updated weights for policy 1, policy_version 1141545 (0.0007) [2023-12-26 08:46:15,672][123090] Updated weights for policy 1, policy_version 1141555 (0.0010) [2023-12-26 08:46:15,723][123090] Updated weights for policy 1, policy_version 1141565 (0.0010) [2023-12-26 08:46:15,884][123091] Updated weights for policy 0, policy_version 1149748 (0.0009) [2023-12-26 08:46:15,943][123091] Updated weights for policy 0, policy_version 1149758 (0.0010) [2023-12-26 08:46:16,006][123091] Updated weights for policy 0, policy_version 1149768 (0.0011) [2023-12-26 08:46:16,440][123090] Updated weights for policy 1, policy_version 1141575 (0.0007) [2023-12-26 08:46:16,503][123090] Updated weights for policy 1, policy_version 1141585 (0.0006) [2023-12-26 08:46:16,560][123090] Updated weights for policy 1, policy_version 1141595 (0.0006) [2023-12-26 08:46:16,817][123091] Updated weights for policy 0, policy_version 1149778 (0.0007) [2023-12-26 08:46:16,867][123091] Updated weights for policy 0, policy_version 1149788 (0.0005) [2023-12-26 08:46:16,912][123091] Updated weights for policy 0, policy_version 1149798 (0.0005) [2023-12-26 08:46:16,963][123091] Updated weights for policy 0, policy_version 1149808 (0.0006) [2023-12-26 08:46:17,237][123090] Updated weights for policy 1, policy_version 1141605 (0.0007) [2023-12-26 08:46:17,289][123090] Updated weights for policy 1, policy_version 1141615 (0.0010) [2023-12-26 08:46:17,342][123090] Updated weights for policy 1, policy_version 1141626 (0.0010) [2023-12-26 08:46:17,651][123091] Updated weights for policy 0, policy_version 1149818 (0.0005) [2023-12-26 08:46:17,722][123091] Updated weights for policy 0, policy_version 1149828 (0.0008) [2023-12-26 08:46:17,773][123091] Updated weights for policy 0, policy_version 1149838 (0.0010) [2023-12-26 08:46:18,178][123090] Updated weights for policy 1, policy_version 1141637 (0.0008) [2023-12-26 08:46:18,227][123090] Updated weights for policy 1, policy_version 1141647 (0.0005) [2023-12-26 08:46:18,272][123090] Updated weights for policy 1, policy_version 1141657 (0.0005) [2023-12-26 08:46:18,442][123091] Updated weights for policy 0, policy_version 1149848 (0.0011) [2023-12-26 08:46:18,507][123091] Updated weights for policy 0, policy_version 1149858 (0.0009) [2023-12-26 08:46:18,575][123091] Updated weights for policy 0, policy_version 1149868 (0.0006) [2023-12-26 08:46:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 586637312. Throughput: 0: 8881.8, 1: 8965.4. Samples: 586647184. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:18,785][121949] Avg episode reward: [(0, '6206.726'), (1, '5366.301')] [2023-12-26 08:46:18,924][123090] Updated weights for policy 1, policy_version 1141667 (0.0005) [2023-12-26 08:46:18,972][123090] Updated weights for policy 1, policy_version 1141677 (0.0005) [2023-12-26 08:46:19,019][123090] Updated weights for policy 1, policy_version 1141687 (0.0005) [2023-12-26 08:46:19,383][123091] Updated weights for policy 0, policy_version 1149878 (0.0010) [2023-12-26 08:46:19,446][123091] Updated weights for policy 0, policy_version 1149888 (0.0011) [2023-12-26 08:46:19,526][123091] Updated weights for policy 0, policy_version 1149898 (0.0011) [2023-12-26 08:46:19,800][123090] Updated weights for policy 1, policy_version 1141697 (0.0007) [2023-12-26 08:46:19,871][123090] Updated weights for policy 1, policy_version 1141707 (0.0011) [2023-12-26 08:46:19,944][123090] Updated weights for policy 1, policy_version 1141717 (0.0011) [2023-12-26 08:46:20,010][123090] Updated weights for policy 1, policy_version 1141727 (0.0011) [2023-12-26 08:46:20,367][123091] Updated weights for policy 0, policy_version 1149908 (0.0011) [2023-12-26 08:46:20,431][123091] Updated weights for policy 0, policy_version 1149918 (0.0011) [2023-12-26 08:46:20,490][123091] Updated weights for policy 0, policy_version 1149928 (0.0011) [2023-12-26 08:46:20,804][123090] Updated weights for policy 1, policy_version 1141737 (0.0011) [2023-12-26 08:46:20,873][123090] Updated weights for policy 1, policy_version 1141747 (0.0011) [2023-12-26 08:46:20,938][123090] Updated weights for policy 1, policy_version 1141757 (0.0011) [2023-12-26 08:46:21,349][123091] Updated weights for policy 0, policy_version 1149938 (0.0011) [2023-12-26 08:46:21,432][123091] Updated weights for policy 0, policy_version 1149948 (0.0011) [2023-12-26 08:46:21,502][123091] Updated weights for policy 0, policy_version 1149958 (0.0011) [2023-12-26 08:46:21,563][123091] Updated weights for policy 0, policy_version 1149968 (0.0011) [2023-12-26 08:46:21,757][123090] Updated weights for policy 1, policy_version 1141767 (0.0010) [2023-12-26 08:46:21,826][123090] Updated weights for policy 1, policy_version 1141777 (0.0009) [2023-12-26 08:46:21,901][123090] Updated weights for policy 1, policy_version 1141787 (0.0006) [2023-12-26 08:46:22,391][123091] Updated weights for policy 0, policy_version 1149978 (0.0008) [2023-12-26 08:46:22,453][123091] Updated weights for policy 0, policy_version 1149988 (0.0009) [2023-12-26 08:46:22,523][123091] Updated weights for policy 0, policy_version 1149998 (0.0006) [2023-12-26 08:46:22,652][123090] Updated weights for policy 1, policy_version 1141797 (0.0008) [2023-12-26 08:46:22,723][123090] Updated weights for policy 1, policy_version 1141807 (0.0011) [2023-12-26 08:46:22,783][123090] Updated weights for policy 1, policy_version 1141817 (0.0011) [2023-12-26 08:46:23,268][123091] Updated weights for policy 0, policy_version 1150009 (0.0008) [2023-12-26 08:46:23,324][123091] Updated weights for policy 0, policy_version 1150019 (0.0009) [2023-12-26 08:46:23,376][123091] Updated weights for policy 0, policy_version 1150029 (0.0009) [2023-12-26 08:46:23,611][123090] Updated weights for policy 1, policy_version 1141827 (0.0011) [2023-12-26 08:46:23,673][123090] Updated weights for policy 1, policy_version 1141837 (0.0010) [2023-12-26 08:46:23,739][123090] Updated weights for policy 1, policy_version 1141847 (0.0010) [2023-12-26 08:46:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 586719232. Throughput: 0: 8814.9, 1: 8937.4. Samples: 586698968. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:23,785][121949] Avg episode reward: [(0, '6317.864'), (1, '5323.828')] [2023-12-26 08:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001150032_294412288.pth... [2023-12-26 08:46:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001141856_292315136.pth... [2023-12-26 08:46:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001149008_294150144.pth [2023-12-26 08:46:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001140800_292044800.pth [2023-12-26 08:46:24,211][123091] Updated weights for policy 0, policy_version 1150039 (0.0010) [2023-12-26 08:46:24,264][123091] Updated weights for policy 0, policy_version 1150049 (0.0009) [2023-12-26 08:46:24,325][123091] Updated weights for policy 0, policy_version 1150059 (0.0009) [2023-12-26 08:46:24,521][123090] Updated weights for policy 1, policy_version 1141857 (0.0010) [2023-12-26 08:46:24,577][123090] Updated weights for policy 1, policy_version 1141867 (0.0009) [2023-12-26 08:46:24,645][123090] Updated weights for policy 1, policy_version 1141877 (0.0010) [2023-12-26 08:46:24,704][123090] Updated weights for policy 1, policy_version 1141887 (0.0010) [2023-12-26 08:46:25,072][123091] Updated weights for policy 0, policy_version 1150069 (0.0007) [2023-12-26 08:46:25,119][123091] Updated weights for policy 0, policy_version 1150079 (0.0005) [2023-12-26 08:46:25,172][123091] Updated weights for policy 0, policy_version 1150089 (0.0005) [2023-12-26 08:46:25,526][123090] Updated weights for policy 1, policy_version 1141897 (0.0010) [2023-12-26 08:46:25,586][123090] Updated weights for policy 1, policy_version 1141907 (0.0010) [2023-12-26 08:46:25,647][123090] Updated weights for policy 1, policy_version 1141917 (0.0009) [2023-12-26 08:46:25,939][123091] Updated weights for policy 0, policy_version 1150099 (0.0007) [2023-12-26 08:46:26,003][123091] Updated weights for policy 0, policy_version 1150109 (0.0009) [2023-12-26 08:46:26,063][123091] Updated weights for policy 0, policy_version 1150119 (0.0009) [2023-12-26 08:46:26,472][123090] Updated weights for policy 1, policy_version 1141927 (0.0010) [2023-12-26 08:46:26,527][123090] Updated weights for policy 1, policy_version 1141937 (0.0009) [2023-12-26 08:46:26,582][123090] Updated weights for policy 1, policy_version 1141947 (0.0008) [2023-12-26 08:46:26,870][123091] Updated weights for policy 0, policy_version 1150129 (0.0008) [2023-12-26 08:46:26,933][123091] Updated weights for policy 0, policy_version 1150139 (0.0005) [2023-12-26 08:46:27,002][123091] Updated weights for policy 0, policy_version 1150149 (0.0006) [2023-12-26 08:46:27,053][123091] Updated weights for policy 0, policy_version 1150159 (0.0009) [2023-12-26 08:46:27,298][123090] Updated weights for policy 1, policy_version 1141957 (0.0008) [2023-12-26 08:46:27,356][123090] Updated weights for policy 1, policy_version 1141967 (0.0010) [2023-12-26 08:46:27,419][123090] Updated weights for policy 1, policy_version 1141977 (0.0010) [2023-12-26 08:46:27,764][123091] Updated weights for policy 0, policy_version 1150169 (0.0006) [2023-12-26 08:46:27,812][123091] Updated weights for policy 0, policy_version 1150179 (0.0007) [2023-12-26 08:46:27,868][123091] Updated weights for policy 0, policy_version 1150189 (0.0005) [2023-12-26 08:46:28,279][123090] Updated weights for policy 1, policy_version 1141987 (0.0008) [2023-12-26 08:46:28,333][123090] Updated weights for policy 1, policy_version 1141997 (0.0006) [2023-12-26 08:46:28,396][123090] Updated weights for policy 1, policy_version 1142007 (0.0006) [2023-12-26 08:46:28,560][123091] Updated weights for policy 0, policy_version 1150199 (0.0009) [2023-12-26 08:46:28,614][123091] Updated weights for policy 0, policy_version 1150209 (0.0010) [2023-12-26 08:46:28,666][123091] Updated weights for policy 0, policy_version 1150219 (0.0005) [2023-12-26 08:46:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 586817536. Throughput: 0: 8857.0, 1: 8933.4. Samples: 586806392. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:28,785][121949] Avg episode reward: [(0, '6246.388'), (1, '5285.753')] [2023-12-26 08:46:29,137][123090] Updated weights for policy 1, policy_version 1142017 (0.0006) [2023-12-26 08:46:29,185][123090] Updated weights for policy 1, policy_version 1142027 (0.0009) [2023-12-26 08:46:29,246][123090] Updated weights for policy 1, policy_version 1142037 (0.0007) [2023-12-26 08:46:29,311][123090] Updated weights for policy 1, policy_version 1142047 (0.0007) [2023-12-26 08:46:29,503][123091] Updated weights for policy 0, policy_version 1150229 (0.0008) [2023-12-26 08:46:29,562][123091] Updated weights for policy 0, policy_version 1150239 (0.0011) [2023-12-26 08:46:29,624][123091] Updated weights for policy 0, policy_version 1150249 (0.0010) [2023-12-26 08:46:30,063][123090] Updated weights for policy 1, policy_version 1142057 (0.0006) [2023-12-26 08:46:30,133][123090] Updated weights for policy 1, policy_version 1142067 (0.0007) [2023-12-26 08:46:30,198][123090] Updated weights for policy 1, policy_version 1142077 (0.0006) [2023-12-26 08:46:30,432][123091] Updated weights for policy 0, policy_version 1150259 (0.0009) [2023-12-26 08:46:30,498][123091] Updated weights for policy 0, policy_version 1150269 (0.0005) [2023-12-26 08:46:30,552][123091] Updated weights for policy 0, policy_version 1150279 (0.0005) [2023-12-26 08:46:30,912][123090] Updated weights for policy 1, policy_version 1142087 (0.0008) [2023-12-26 08:46:30,976][123090] Updated weights for policy 1, policy_version 1142097 (0.0008) [2023-12-26 08:46:31,045][123090] Updated weights for policy 1, policy_version 1142107 (0.0009) [2023-12-26 08:46:31,338][123091] Updated weights for policy 0, policy_version 1150289 (0.0008) [2023-12-26 08:46:31,410][123091] Updated weights for policy 0, policy_version 1150299 (0.0010) [2023-12-26 08:46:31,473][123091] Updated weights for policy 0, policy_version 1150309 (0.0010) [2023-12-26 08:46:31,535][123091] Updated weights for policy 0, policy_version 1150319 (0.0010) [2023-12-26 08:46:31,799][123090] Updated weights for policy 1, policy_version 1142117 (0.0008) [2023-12-26 08:46:31,862][123090] Updated weights for policy 1, policy_version 1142127 (0.0009) [2023-12-26 08:46:31,922][123090] Updated weights for policy 1, policy_version 1142137 (0.0009) [2023-12-26 08:46:32,333][123091] Updated weights for policy 0, policy_version 1150329 (0.0010) [2023-12-26 08:46:32,396][123091] Updated weights for policy 0, policy_version 1150339 (0.0012) [2023-12-26 08:46:32,459][123091] Updated weights for policy 0, policy_version 1150349 (0.0009) [2023-12-26 08:46:32,705][123090] Updated weights for policy 1, policy_version 1142147 (0.0008) [2023-12-26 08:46:32,780][123090] Updated weights for policy 1, policy_version 1142157 (0.0005) [2023-12-26 08:46:32,835][123090] Updated weights for policy 1, policy_version 1142168 (0.0006) [2023-12-26 08:46:33,284][123091] Updated weights for policy 0, policy_version 1150359 (0.0007) [2023-12-26 08:46:33,346][123091] Updated weights for policy 0, policy_version 1150369 (0.0005) [2023-12-26 08:46:33,396][123091] Updated weights for policy 0, policy_version 1150379 (0.0005) [2023-12-26 08:46:33,524][123090] Updated weights for policy 1, policy_version 1142178 (0.0008) [2023-12-26 08:46:33,574][123090] Updated weights for policy 1, policy_version 1142188 (0.0005) [2023-12-26 08:46:33,620][123090] Updated weights for policy 1, policy_version 1142198 (0.0005) [2023-12-26 08:46:33,684][123090] Updated weights for policy 1, policy_version 1142208 (0.0005) [2023-12-26 08:46:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 586907648. Throughput: 0: 8943.7, 1: 8911.4. Samples: 586916704. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:33,785][121949] Avg episode reward: [(0, '6213.826'), (1, '5199.329')] [2023-12-26 08:46:33,992][123091] Updated weights for policy 0, policy_version 1150389 (0.0005) [2023-12-26 08:46:34,053][123091] Updated weights for policy 0, policy_version 1150399 (0.0005) [2023-12-26 08:46:34,115][123091] Updated weights for policy 0, policy_version 1150409 (0.0008) [2023-12-26 08:46:34,518][123090] Updated weights for policy 1, policy_version 1142218 (0.0007) [2023-12-26 08:46:34,567][123090] Updated weights for policy 1, policy_version 1142228 (0.0009) [2023-12-26 08:46:34,624][123090] Updated weights for policy 1, policy_version 1142238 (0.0009) [2023-12-26 08:46:34,915][123091] Updated weights for policy 0, policy_version 1150419 (0.0011) [2023-12-26 08:46:34,979][123091] Updated weights for policy 0, policy_version 1150429 (0.0011) [2023-12-26 08:46:35,038][123091] Updated weights for policy 0, policy_version 1150439 (0.0011) [2023-12-26 08:46:35,449][123090] Updated weights for policy 1, policy_version 1142248 (0.0009) [2023-12-26 08:46:35,505][123090] Updated weights for policy 1, policy_version 1142258 (0.0009) [2023-12-26 08:46:35,566][123090] Updated weights for policy 1, policy_version 1142268 (0.0009) [2023-12-26 08:46:35,873][123091] Updated weights for policy 0, policy_version 1150449 (0.0011) [2023-12-26 08:46:35,931][123091] Updated weights for policy 0, policy_version 1150459 (0.0010) [2023-12-26 08:46:35,994][123091] Updated weights for policy 0, policy_version 1150469 (0.0010) [2023-12-26 08:46:36,057][123091] Updated weights for policy 0, policy_version 1150479 (0.0011) [2023-12-26 08:46:36,441][123090] Updated weights for policy 1, policy_version 1142278 (0.0009) [2023-12-26 08:46:36,508][123090] Updated weights for policy 1, policy_version 1142288 (0.0010) [2023-12-26 08:46:36,571][123090] Updated weights for policy 1, policy_version 1142298 (0.0010) [2023-12-26 08:46:36,743][123091] Updated weights for policy 0, policy_version 1150489 (0.0006) [2023-12-26 08:46:36,801][123091] Updated weights for policy 0, policy_version 1150499 (0.0006) [2023-12-26 08:46:36,849][123091] Updated weights for policy 0, policy_version 1150509 (0.0005) [2023-12-26 08:46:37,356][123090] Updated weights for policy 1, policy_version 1142308 (0.0010) [2023-12-26 08:46:37,425][123090] Updated weights for policy 1, policy_version 1142318 (0.0009) [2023-12-26 08:46:37,484][123090] Updated weights for policy 1, policy_version 1142328 (0.0009) [2023-12-26 08:46:37,536][123091] Updated weights for policy 0, policy_version 1150519 (0.0007) [2023-12-26 08:46:37,599][123091] Updated weights for policy 0, policy_version 1150529 (0.0005) [2023-12-26 08:46:37,673][123091] Updated weights for policy 0, policy_version 1150539 (0.0006) [2023-12-26 08:46:38,358][123090] Updated weights for policy 1, policy_version 1142338 (0.0008) [2023-12-26 08:46:38,431][123090] Updated weights for policy 1, policy_version 1142348 (0.0006) [2023-12-26 08:46:38,435][123091] Updated weights for policy 0, policy_version 1150549 (0.0008) [2023-12-26 08:46:38,495][123091] Updated weights for policy 0, policy_version 1150559 (0.0010) [2023-12-26 08:46:38,504][123090] Updated weights for policy 1, policy_version 1142358 (0.0007) [2023-12-26 08:46:38,547][123091] Updated weights for policy 0, policy_version 1150569 (0.0010) [2023-12-26 08:46:38,564][123090] Updated weights for policy 1, policy_version 1142368 (0.0008) [2023-12-26 08:46:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 586997760. Throughput: 0: 8970.1, 1: 8920.7. Samples: 586969264. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:38,785][121949] Avg episode reward: [(0, '6336.496'), (1, '5259.956')] [2023-12-26 08:46:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001142368_292446208.pth... [2023-12-26 08:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001150576_294551552.pth... [2023-12-26 08:46:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001141312_292175872.pth [2023-12-26 08:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001149520_294281216.pth [2023-12-26 08:46:39,357][123091] Updated weights for policy 0, policy_version 1150579 (0.0010) [2023-12-26 08:46:39,370][123090] Updated weights for policy 1, policy_version 1142378 (0.0009) [2023-12-26 08:46:39,425][123091] Updated weights for policy 0, policy_version 1150589 (0.0010) [2023-12-26 08:46:39,446][123090] Updated weights for policy 1, policy_version 1142388 (0.0008) [2023-12-26 08:46:39,482][123091] Updated weights for policy 0, policy_version 1150599 (0.0011) [2023-12-26 08:46:39,511][123090] Updated weights for policy 1, policy_version 1142398 (0.0006) [2023-12-26 08:46:40,250][123091] Updated weights for policy 0, policy_version 1150609 (0.0010) [2023-12-26 08:46:40,306][123091] Updated weights for policy 0, policy_version 1150619 (0.0005) [2023-12-26 08:46:40,366][123090] Updated weights for policy 1, policy_version 1142408 (0.0007) [2023-12-26 08:46:40,368][123091] Updated weights for policy 0, policy_version 1150629 (0.0009) [2023-12-26 08:46:40,422][123090] Updated weights for policy 1, policy_version 1142418 (0.0005) [2023-12-26 08:46:40,432][123091] Updated weights for policy 0, policy_version 1150639 (0.0011) [2023-12-26 08:46:40,490][123090] Updated weights for policy 1, policy_version 1142428 (0.0006) [2023-12-26 08:46:41,186][123091] Updated weights for policy 0, policy_version 1150649 (0.0009) [2023-12-26 08:46:41,252][123091] Updated weights for policy 0, policy_version 1150659 (0.0009) [2023-12-26 08:46:41,283][123090] Updated weights for policy 1, policy_version 1142438 (0.0008) [2023-12-26 08:46:41,326][123091] Updated weights for policy 0, policy_version 1150669 (0.0009) [2023-12-26 08:46:41,345][123090] Updated weights for policy 1, policy_version 1142448 (0.0008) [2023-12-26 08:46:41,420][123090] Updated weights for policy 1, policy_version 1142458 (0.0006) [2023-12-26 08:46:42,089][123091] Updated weights for policy 0, policy_version 1150679 (0.0007) [2023-12-26 08:46:42,140][123091] Updated weights for policy 0, policy_version 1150689 (0.0006) [2023-12-26 08:46:42,187][123091] Updated weights for policy 0, policy_version 1150699 (0.0005) [2023-12-26 08:46:42,232][123090] Updated weights for policy 1, policy_version 1142468 (0.0007) [2023-12-26 08:46:42,307][123090] Updated weights for policy 1, policy_version 1142478 (0.0010) [2023-12-26 08:46:42,385][123090] Updated weights for policy 1, policy_version 1142488 (0.0009) [2023-12-26 08:46:42,919][123091] Updated weights for policy 0, policy_version 1150709 (0.0005) [2023-12-26 08:46:42,979][123091] Updated weights for policy 0, policy_version 1150719 (0.0007) [2023-12-26 08:46:43,035][123091] Updated weights for policy 0, policy_version 1150729 (0.0010) [2023-12-26 08:46:43,152][123090] Updated weights for policy 1, policy_version 1142498 (0.0008) [2023-12-26 08:46:43,216][123090] Updated weights for policy 1, policy_version 1142508 (0.0006) [2023-12-26 08:46:43,291][123090] Updated weights for policy 1, policy_version 1142518 (0.0006) [2023-12-26 08:46:43,355][123090] Updated weights for policy 1, policy_version 1142528 (0.0005) [2023-12-26 08:46:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 587079680. Throughput: 0: 8849.6, 1: 8833.3. Samples: 587075472. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:43,785][121949] Avg episode reward: [(0, '6311.899'), (1, '5359.200')] [2023-12-26 08:46:43,889][123091] Updated weights for policy 0, policy_version 1150739 (0.0009) [2023-12-26 08:46:43,955][123091] Updated weights for policy 0, policy_version 1150749 (0.0006) [2023-12-26 08:46:44,028][123091] Updated weights for policy 0, policy_version 1150759 (0.0008) [2023-12-26 08:46:44,097][123090] Updated weights for policy 1, policy_version 1142538 (0.0009) [2023-12-26 08:46:44,156][123090] Updated weights for policy 1, policy_version 1142548 (0.0010) [2023-12-26 08:46:44,219][123090] Updated weights for policy 1, policy_version 1142558 (0.0010) [2023-12-26 08:46:44,773][123091] Updated weights for policy 0, policy_version 1150772 (0.0009) [2023-12-26 08:46:44,843][123091] Updated weights for policy 0, policy_version 1150784 (0.0007) [2023-12-26 08:46:44,910][123091] Updated weights for policy 0, policy_version 1150794 (0.0006) [2023-12-26 08:46:45,122][123090] Updated weights for policy 1, policy_version 1142568 (0.0010) [2023-12-26 08:46:45,189][123090] Updated weights for policy 1, policy_version 1142578 (0.0010) [2023-12-26 08:46:45,257][123090] Updated weights for policy 1, policy_version 1142588 (0.0010) [2023-12-26 08:46:45,620][123091] Updated weights for policy 0, policy_version 1150804 (0.0007) [2023-12-26 08:46:45,668][123091] Updated weights for policy 0, policy_version 1150814 (0.0005) [2023-12-26 08:46:45,718][123091] Updated weights for policy 0, policy_version 1150824 (0.0005) [2023-12-26 08:46:46,072][123090] Updated weights for policy 1, policy_version 1142598 (0.0010) [2023-12-26 08:46:46,123][123090] Updated weights for policy 1, policy_version 1142608 (0.0010) [2023-12-26 08:46:46,186][123090] Updated weights for policy 1, policy_version 1142618 (0.0010) [2023-12-26 08:46:46,424][123091] Updated weights for policy 0, policy_version 1150834 (0.0009) [2023-12-26 08:46:46,472][123091] Updated weights for policy 0, policy_version 1150844 (0.0010) [2023-12-26 08:46:46,523][123091] Updated weights for policy 0, policy_version 1150854 (0.0010) [2023-12-26 08:46:46,574][123091] Updated weights for policy 0, policy_version 1150864 (0.0010) [2023-12-26 08:46:46,932][123090] Updated weights for policy 1, policy_version 1142628 (0.0009) [2023-12-26 08:46:46,999][123090] Updated weights for policy 1, policy_version 1142638 (0.0005) [2023-12-26 08:46:47,058][123090] Updated weights for policy 1, policy_version 1142648 (0.0006) [2023-12-26 08:46:47,415][123091] Updated weights for policy 0, policy_version 1150874 (0.0005) [2023-12-26 08:46:47,482][123091] Updated weights for policy 0, policy_version 1150884 (0.0007) [2023-12-26 08:46:47,544][123091] Updated weights for policy 0, policy_version 1150894 (0.0008) [2023-12-26 08:46:47,745][123090] Updated weights for policy 1, policy_version 1142658 (0.0006) [2023-12-26 08:46:47,819][123090] Updated weights for policy 1, policy_version 1142668 (0.0006) [2023-12-26 08:46:47,892][123090] Updated weights for policy 1, policy_version 1142678 (0.0006) [2023-12-26 08:46:47,965][123090] Updated weights for policy 1, policy_version 1142688 (0.0005) [2023-12-26 08:46:48,410][123091] Updated weights for policy 0, policy_version 1150904 (0.0009) [2023-12-26 08:46:48,481][123091] Updated weights for policy 0, policy_version 1150914 (0.0010) [2023-12-26 08:46:48,537][123091] Updated weights for policy 0, policy_version 1150924 (0.0009) [2023-12-26 08:46:48,590][123090] Updated weights for policy 1, policy_version 1142698 (0.0006) [2023-12-26 08:46:48,665][123090] Updated weights for policy 1, policy_version 1142708 (0.0005) [2023-12-26 08:46:48,724][123090] Updated weights for policy 1, policy_version 1142718 (0.0009) [2023-12-26 08:46:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 587177984. Throughput: 0: 8910.7, 1: 8911.8. Samples: 587184680. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:48,784][121949] Avg episode reward: [(0, '6168.663'), (1, '5529.642')] [2023-12-26 08:46:49,396][123091] Updated weights for policy 0, policy_version 1150934 (0.0009) [2023-12-26 08:46:49,454][123091] Updated weights for policy 0, policy_version 1150944 (0.0010) [2023-12-26 08:46:49,491][123090] Updated weights for policy 1, policy_version 1142728 (0.0006) [2023-12-26 08:46:49,508][123091] Updated weights for policy 0, policy_version 1150954 (0.0009) [2023-12-26 08:46:49,545][123090] Updated weights for policy 1, policy_version 1142738 (0.0005) [2023-12-26 08:46:49,593][123090] Updated weights for policy 1, policy_version 1142748 (0.0005) [2023-12-26 08:46:50,291][123090] Updated weights for policy 1, policy_version 1142758 (0.0005) [2023-12-26 08:46:50,348][123090] Updated weights for policy 1, policy_version 1142768 (0.0009) [2023-12-26 08:46:50,376][123091] Updated weights for policy 0, policy_version 1150964 (0.0008) [2023-12-26 08:46:50,412][123090] Updated weights for policy 1, policy_version 1142778 (0.0010) [2023-12-26 08:46:50,429][123091] Updated weights for policy 0, policy_version 1150974 (0.0007) [2023-12-26 08:46:50,500][123091] Updated weights for policy 0, policy_version 1150984 (0.0005) [2023-12-26 08:46:51,205][123091] Updated weights for policy 0, policy_version 1150994 (0.0005) [2023-12-26 08:46:51,208][123090] Updated weights for policy 1, policy_version 1142788 (0.0009) [2023-12-26 08:46:51,268][123090] Updated weights for policy 1, policy_version 1142798 (0.0007) [2023-12-26 08:46:51,274][123091] Updated weights for policy 0, policy_version 1151004 (0.0006) [2023-12-26 08:46:51,325][123090] Updated weights for policy 1, policy_version 1142808 (0.0010) [2023-12-26 08:46:51,332][123091] Updated weights for policy 0, policy_version 1151014 (0.0006) [2023-12-26 08:46:51,404][123091] Updated weights for policy 0, policy_version 1151024 (0.0011) [2023-12-26 08:46:52,071][123090] Updated weights for policy 1, policy_version 1142818 (0.0011) [2023-12-26 08:46:52,124][123091] Updated weights for policy 0, policy_version 1151034 (0.0010) [2023-12-26 08:46:52,134][123090] Updated weights for policy 1, policy_version 1142828 (0.0011) [2023-12-26 08:46:52,176][123091] Updated weights for policy 0, policy_version 1151044 (0.0010) [2023-12-26 08:46:52,197][123090] Updated weights for policy 1, policy_version 1142838 (0.0010) [2023-12-26 08:46:52,234][123091] Updated weights for policy 0, policy_version 1151054 (0.0008) [2023-12-26 08:46:52,262][123090] Updated weights for policy 1, policy_version 1142848 (0.0011) [2023-12-26 08:46:53,071][123091] Updated weights for policy 0, policy_version 1151064 (0.0010) [2023-12-26 08:46:53,082][123090] Updated weights for policy 1, policy_version 1142858 (0.0007) [2023-12-26 08:46:53,126][123091] Updated weights for policy 0, policy_version 1151074 (0.0011) [2023-12-26 08:46:53,140][123090] Updated weights for policy 1, policy_version 1142868 (0.0006) [2023-12-26 08:46:53,189][123091] Updated weights for policy 0, policy_version 1151084 (0.0011) [2023-12-26 08:46:53,198][123090] Updated weights for policy 1, policy_version 1142878 (0.0005) [2023-12-26 08:46:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 587259904. Throughput: 0: 8944.1, 1: 8911.0. Samples: 587238280. Policy #0 lag: (min: 14.0, avg: 21.3, max: 46.0) [2023-12-26 08:46:53,785][121949] Avg episode reward: [(0, '6171.608'), (1, '5582.673')] [2023-12-26 08:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001151088_294682624.pth... [2023-12-26 08:46:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001142880_292577280.pth... [2023-12-26 08:46:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001150032_294412288.pth [2023-12-26 08:46:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001141856_292315136.pth [2023-12-26 08:46:53,969][123090] Updated weights for policy 1, policy_version 1142888 (0.0009) [2023-12-26 08:46:54,017][123090] Updated weights for policy 1, policy_version 1142898 (0.0009) [2023-12-26 08:46:54,035][123091] Updated weights for policy 0, policy_version 1151094 (0.0010) [2023-12-26 08:46:54,079][123090] Updated weights for policy 1, policy_version 1142908 (0.0008) [2023-12-26 08:46:54,090][123091] Updated weights for policy 0, policy_version 1151104 (0.0008) [2023-12-26 08:46:54,140][123091] Updated weights for policy 0, policy_version 1151114 (0.0008) [2023-12-26 08:46:54,865][123090] Updated weights for policy 1, policy_version 1142918 (0.0007) [2023-12-26 08:46:54,923][123090] Updated weights for policy 1, policy_version 1142928 (0.0005) [2023-12-26 08:46:54,934][123091] Updated weights for policy 0, policy_version 1151124 (0.0008) [2023-12-26 08:46:54,992][123090] Updated weights for policy 1, policy_version 1142938 (0.0006) [2023-12-26 08:46:55,003][123091] Updated weights for policy 0, policy_version 1151134 (0.0011) [2023-12-26 08:46:55,065][123091] Updated weights for policy 0, policy_version 1151144 (0.0009) [2023-12-26 08:46:55,712][123091] Updated weights for policy 0, policy_version 1151154 (0.0006) [2023-12-26 08:46:55,748][123090] Updated weights for policy 1, policy_version 1142948 (0.0007) [2023-12-26 08:46:55,759][123091] Updated weights for policy 0, policy_version 1151164 (0.0007) [2023-12-26 08:46:55,807][123091] Updated weights for policy 0, policy_version 1151174 (0.0008) [2023-12-26 08:46:55,817][123090] Updated weights for policy 1, policy_version 1142958 (0.0010) [2023-12-26 08:46:55,861][123091] Updated weights for policy 0, policy_version 1151184 (0.0009) [2023-12-26 08:46:55,876][123090] Updated weights for policy 1, policy_version 1142968 (0.0010) [2023-12-26 08:46:56,507][123090] Updated weights for policy 1, policy_version 1142978 (0.0010) [2023-12-26 08:46:56,553][123091] Updated weights for policy 0, policy_version 1151194 (0.0005) [2023-12-26 08:46:56,558][123090] Updated weights for policy 1, policy_version 1142988 (0.0010) [2023-12-26 08:46:56,605][123090] Updated weights for policy 1, policy_version 1142998 (0.0010) [2023-12-26 08:46:56,613][123091] Updated weights for policy 0, policy_version 1151204 (0.0005) [2023-12-26 08:46:56,653][123090] Updated weights for policy 1, policy_version 1143008 (0.0010) [2023-12-26 08:46:56,671][123091] Updated weights for policy 0, policy_version 1151214 (0.0005) [2023-12-26 08:46:57,328][123091] Updated weights for policy 0, policy_version 1151224 (0.0005) [2023-12-26 08:46:57,389][123091] Updated weights for policy 0, policy_version 1151234 (0.0007) [2023-12-26 08:46:57,450][123091] Updated weights for policy 0, policy_version 1151244 (0.0007) [2023-12-26 08:46:57,478][123090] Updated weights for policy 1, policy_version 1143018 (0.0010) [2023-12-26 08:46:57,547][123090] Updated weights for policy 1, policy_version 1143028 (0.0010) [2023-12-26 08:46:57,613][123090] Updated weights for policy 1, policy_version 1143038 (0.0009) [2023-12-26 08:46:58,178][123091] Updated weights for policy 0, policy_version 1151254 (0.0010) [2023-12-26 08:46:58,241][123091] Updated weights for policy 0, policy_version 1151264 (0.0011) [2023-12-26 08:46:58,307][123091] Updated weights for policy 0, policy_version 1151274 (0.0008) [2023-12-26 08:46:58,423][123090] Updated weights for policy 1, policy_version 1143048 (0.0007) [2023-12-26 08:46:58,485][123090] Updated weights for policy 1, policy_version 1143058 (0.0008) [2023-12-26 08:46:58,547][123090] Updated weights for policy 1, policy_version 1143068 (0.0009) [2023-12-26 08:46:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 587358208. Throughput: 0: 9105.1, 1: 8997.8. Samples: 587350372. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:46:58,785][121949] Avg episode reward: [(0, '6277.126'), (1, '5425.199')] [2023-12-26 08:46:59,197][123091] Updated weights for policy 0, policy_version 1151284 (0.0010) [2023-12-26 08:46:59,259][123091] Updated weights for policy 0, policy_version 1151294 (0.0009) [2023-12-26 08:46:59,320][123091] Updated weights for policy 0, policy_version 1151304 (0.0009) [2023-12-26 08:46:59,524][123090] Updated weights for policy 1, policy_version 1143078 (0.0009) [2023-12-26 08:46:59,576][123090] Updated weights for policy 1, policy_version 1143088 (0.0007) [2023-12-26 08:46:59,622][123090] Updated weights for policy 1, policy_version 1143098 (0.0005) [2023-12-26 08:47:00,066][123091] Updated weights for policy 0, policy_version 1151314 (0.0009) [2023-12-26 08:47:00,138][123091] Updated weights for policy 0, policy_version 1151324 (0.0006) [2023-12-26 08:47:00,205][123091] Updated weights for policy 0, policy_version 1151335 (0.0007) [2023-12-26 08:47:00,457][123090] Updated weights for policy 1, policy_version 1143108 (0.0006) [2023-12-26 08:47:00,507][123090] Updated weights for policy 1, policy_version 1143118 (0.0005) [2023-12-26 08:47:00,559][123090] Updated weights for policy 1, policy_version 1143128 (0.0005) [2023-12-26 08:47:00,836][123091] Updated weights for policy 0, policy_version 1151345 (0.0006) [2023-12-26 08:47:00,888][123091] Updated weights for policy 0, policy_version 1151355 (0.0005) [2023-12-26 08:47:00,947][123091] Updated weights for policy 0, policy_version 1151365 (0.0005) [2023-12-26 08:47:00,999][123091] Updated weights for policy 0, policy_version 1151375 (0.0005) [2023-12-26 08:47:01,277][123090] Updated weights for policy 1, policy_version 1143138 (0.0006) [2023-12-26 08:47:01,343][123090] Updated weights for policy 1, policy_version 1143148 (0.0010) [2023-12-26 08:47:01,424][123090] Updated weights for policy 1, policy_version 1143158 (0.0008) [2023-12-26 08:47:01,490][123090] Updated weights for policy 1, policy_version 1143168 (0.0008) [2023-12-26 08:47:01,757][123091] Updated weights for policy 0, policy_version 1151385 (0.0009) [2023-12-26 08:47:01,805][123091] Updated weights for policy 0, policy_version 1151395 (0.0009) [2023-12-26 08:47:01,861][123091] Updated weights for policy 0, policy_version 1151405 (0.0009) [2023-12-26 08:47:02,243][123090] Updated weights for policy 1, policy_version 1143178 (0.0010) [2023-12-26 08:47:02,306][123090] Updated weights for policy 1, policy_version 1143188 (0.0010) [2023-12-26 08:47:02,368][123090] Updated weights for policy 1, policy_version 1143198 (0.0009) [2023-12-26 08:47:02,651][123091] Updated weights for policy 0, policy_version 1151415 (0.0009) [2023-12-26 08:47:02,703][123091] Updated weights for policy 0, policy_version 1151425 (0.0010) [2023-12-26 08:47:02,755][123091] Updated weights for policy 0, policy_version 1151435 (0.0009) [2023-12-26 08:47:03,044][123090] Updated weights for policy 1, policy_version 1143208 (0.0006) [2023-12-26 08:47:03,095][123090] Updated weights for policy 1, policy_version 1143218 (0.0005) [2023-12-26 08:47:03,149][123090] Updated weights for policy 1, policy_version 1143228 (0.0005) [2023-12-26 08:47:03,697][123091] Updated weights for policy 0, policy_version 1151446 (0.0010) [2023-12-26 08:47:03,746][123091] Updated weights for policy 0, policy_version 1151456 (0.0009) [2023-12-26 08:47:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 587440128. Throughput: 0: 9065.8, 1: 8961.9. Samples: 587458436. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:03,785][121949] Avg episode reward: [(0, '6244.300'), (1, '5531.375')] [2023-12-26 08:47:03,801][123091] Updated weights for policy 0, policy_version 1151467 (0.0009) [2023-12-26 08:47:03,815][123090] Updated weights for policy 1, policy_version 1143238 (0.0005) [2023-12-26 08:47:03,874][123090] Updated weights for policy 1, policy_version 1143248 (0.0006) [2023-12-26 08:47:03,924][123090] Updated weights for policy 1, policy_version 1143258 (0.0005) [2023-12-26 08:47:04,585][123090] Updated weights for policy 1, policy_version 1143268 (0.0008) [2023-12-26 08:47:04,650][123090] Updated weights for policy 1, policy_version 1143278 (0.0006) [2023-12-26 08:47:04,717][123090] Updated weights for policy 1, policy_version 1143288 (0.0008) [2023-12-26 08:47:04,726][123091] Updated weights for policy 0, policy_version 1151477 (0.0010) [2023-12-26 08:47:04,784][123091] Updated weights for policy 0, policy_version 1151487 (0.0009) [2023-12-26 08:47:04,832][123091] Updated weights for policy 0, policy_version 1151497 (0.0008) [2023-12-26 08:47:05,477][123090] Updated weights for policy 1, policy_version 1143298 (0.0010) [2023-12-26 08:47:05,533][123090] Updated weights for policy 1, policy_version 1143308 (0.0011) [2023-12-26 08:47:05,603][123090] Updated weights for policy 1, policy_version 1143318 (0.0010) [2023-12-26 08:47:05,672][123090] Updated weights for policy 1, policy_version 1143328 (0.0010) [2023-12-26 08:47:05,683][123091] Updated weights for policy 0, policy_version 1151507 (0.0008) [2023-12-26 08:47:05,742][123091] Updated weights for policy 0, policy_version 1151517 (0.0009) [2023-12-26 08:47:05,806][123091] Updated weights for policy 0, policy_version 1151527 (0.0008) [2023-12-26 08:47:06,485][123090] Updated weights for policy 1, policy_version 1143338 (0.0010) [2023-12-26 08:47:06,553][123090] Updated weights for policy 1, policy_version 1143348 (0.0009) [2023-12-26 08:47:06,619][123090] Updated weights for policy 1, policy_version 1143358 (0.0010) [2023-12-26 08:47:06,676][123091] Updated weights for policy 0, policy_version 1151537 (0.0009) [2023-12-26 08:47:06,727][123091] Updated weights for policy 0, policy_version 1151547 (0.0009) [2023-12-26 08:47:06,788][123091] Updated weights for policy 0, policy_version 1151557 (0.0010) [2023-12-26 08:47:06,860][123091] Updated weights for policy 0, policy_version 1151567 (0.0009) [2023-12-26 08:47:07,457][123090] Updated weights for policy 1, policy_version 1143368 (0.0009) [2023-12-26 08:47:07,512][123090] Updated weights for policy 1, policy_version 1143378 (0.0009) [2023-12-26 08:47:07,564][123090] Updated weights for policy 1, policy_version 1143388 (0.0009) [2023-12-26 08:47:07,691][123091] Updated weights for policy 0, policy_version 1151577 (0.0010) [2023-12-26 08:47:07,744][123091] Updated weights for policy 0, policy_version 1151587 (0.0009) [2023-12-26 08:47:07,792][123091] Updated weights for policy 0, policy_version 1151597 (0.0008) [2023-12-26 08:47:08,416][123090] Updated weights for policy 1, policy_version 1143398 (0.0008) [2023-12-26 08:47:08,483][123090] Updated weights for policy 1, policy_version 1143408 (0.0008) [2023-12-26 08:47:08,554][123090] Updated weights for policy 1, policy_version 1143418 (0.0008) [2023-12-26 08:47:08,605][123091] Updated weights for policy 0, policy_version 1151607 (0.0008) [2023-12-26 08:47:08,661][123091] Updated weights for policy 0, policy_version 1151617 (0.0009) [2023-12-26 08:47:08,718][123091] Updated weights for policy 0, policy_version 1151627 (0.0009) [2023-12-26 08:47:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 587538432. Throughput: 0: 9064.3, 1: 8972.9. Samples: 587510640. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:08,785][121949] Avg episode reward: [(0, '6205.433'), (1, '5523.083')] [2023-12-26 08:47:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001151632_294821888.pth... [2023-12-26 08:47:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001143424_292716544.pth... [2023-12-26 08:47:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001150576_294551552.pth [2023-12-26 08:47:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001142368_292446208.pth [2023-12-26 08:47:09,362][123090] Updated weights for policy 1, policy_version 1143428 (0.0010) [2023-12-26 08:47:09,430][123090] Updated weights for policy 1, policy_version 1143438 (0.0009) [2023-12-26 08:47:09,488][123090] Updated weights for policy 1, policy_version 1143448 (0.0009) [2023-12-26 08:47:09,591][123091] Updated weights for policy 0, policy_version 1151637 (0.0009) [2023-12-26 08:47:09,655][123091] Updated weights for policy 0, policy_version 1151647 (0.0009) [2023-12-26 08:47:09,707][123091] Updated weights for policy 0, policy_version 1151657 (0.0010) [2023-12-26 08:47:10,291][123090] Updated weights for policy 1, policy_version 1143458 (0.0009) [2023-12-26 08:47:10,345][123090] Updated weights for policy 1, policy_version 1143468 (0.0005) [2023-12-26 08:47:10,393][123090] Updated weights for policy 1, policy_version 1143478 (0.0005) [2023-12-26 08:47:10,446][123090] Updated weights for policy 1, policy_version 1143488 (0.0006) [2023-12-26 08:47:10,646][123091] Updated weights for policy 0, policy_version 1151668 (0.0010) [2023-12-26 08:47:10,703][123091] Updated weights for policy 0, policy_version 1151678 (0.0009) [2023-12-26 08:47:10,761][123091] Updated weights for policy 0, policy_version 1151688 (0.0009) [2023-12-26 08:47:11,142][123090] Updated weights for policy 1, policy_version 1143498 (0.0007) [2023-12-26 08:47:11,213][123090] Updated weights for policy 1, policy_version 1143508 (0.0008) [2023-12-26 08:47:11,279][123090] Updated weights for policy 1, policy_version 1143518 (0.0009) [2023-12-26 08:47:11,614][123091] Updated weights for policy 0, policy_version 1151698 (0.0008) [2023-12-26 08:47:11,684][123091] Updated weights for policy 0, policy_version 1151708 (0.0008) [2023-12-26 08:47:11,758][123091] Updated weights for policy 0, policy_version 1151718 (0.0008) [2023-12-26 08:47:11,827][123091] Updated weights for policy 0, policy_version 1151728 (0.0008) [2023-12-26 08:47:12,058][123090] Updated weights for policy 1, policy_version 1143528 (0.0009) [2023-12-26 08:47:12,126][123090] Updated weights for policy 1, policy_version 1143538 (0.0009) [2023-12-26 08:47:12,189][123090] Updated weights for policy 1, policy_version 1143548 (0.0010) [2023-12-26 08:47:12,594][123091] Updated weights for policy 0, policy_version 1151738 (0.0009) [2023-12-26 08:47:12,655][123091] Updated weights for policy 0, policy_version 1151748 (0.0008) [2023-12-26 08:47:12,721][123091] Updated weights for policy 0, policy_version 1151758 (0.0005) [2023-12-26 08:47:13,084][123090] Updated weights for policy 1, policy_version 1143558 (0.0009) [2023-12-26 08:47:13,141][123090] Updated weights for policy 1, policy_version 1143568 (0.0006) [2023-12-26 08:47:13,200][123090] Updated weights for policy 1, policy_version 1143578 (0.0006) [2023-12-26 08:47:13,482][123091] Updated weights for policy 0, policy_version 1151768 (0.0008) [2023-12-26 08:47:13,542][123091] Updated weights for policy 0, policy_version 1151778 (0.0009) [2023-12-26 08:47:13,596][123091] Updated weights for policy 0, policy_version 1151788 (0.0008) [2023-12-26 08:47:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 587620352. Throughput: 0: 8949.1, 1: 8989.3. Samples: 587613620. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:13,784][121949] Avg episode reward: [(0, '6251.289'), (1, '5502.641')] [2023-12-26 08:47:13,961][123090] Updated weights for policy 1, policy_version 1143588 (0.0006) [2023-12-26 08:47:14,022][123090] Updated weights for policy 1, policy_version 1143598 (0.0009) [2023-12-26 08:47:14,088][123090] Updated weights for policy 1, policy_version 1143608 (0.0009) [2023-12-26 08:47:14,261][123091] Updated weights for policy 0, policy_version 1151798 (0.0005) [2023-12-26 08:47:14,320][123091] Updated weights for policy 0, policy_version 1151808 (0.0005) [2023-12-26 08:47:14,383][123091] Updated weights for policy 0, policy_version 1151818 (0.0006) [2023-12-26 08:47:14,899][123090] Updated weights for policy 1, policy_version 1143618 (0.0010) [2023-12-26 08:47:14,973][123090] Updated weights for policy 1, policy_version 1143628 (0.0010) [2023-12-26 08:47:15,041][123090] Updated weights for policy 1, policy_version 1143638 (0.0010) [2023-12-26 08:47:15,110][123090] Updated weights for policy 1, policy_version 1143648 (0.0010) [2023-12-26 08:47:15,183][123091] Updated weights for policy 0, policy_version 1151828 (0.0008) [2023-12-26 08:47:15,244][123091] Updated weights for policy 0, policy_version 1151838 (0.0010) [2023-12-26 08:47:15,307][123091] Updated weights for policy 0, policy_version 1151848 (0.0010) [2023-12-26 08:47:15,896][123090] Updated weights for policy 1, policy_version 1143658 (0.0005) [2023-12-26 08:47:15,953][123090] Updated weights for policy 1, policy_version 1143668 (0.0006) [2023-12-26 08:47:16,022][123090] Updated weights for policy 1, policy_version 1143678 (0.0006) [2023-12-26 08:47:16,127][123091] Updated weights for policy 0, policy_version 1151858 (0.0009) [2023-12-26 08:47:16,188][123091] Updated weights for policy 0, policy_version 1151868 (0.0010) [2023-12-26 08:47:16,243][123091] Updated weights for policy 0, policy_version 1151878 (0.0009) [2023-12-26 08:47:16,297][123091] Updated weights for policy 0, policy_version 1151888 (0.0010) [2023-12-26 08:47:16,750][123090] Updated weights for policy 1, policy_version 1143688 (0.0009) [2023-12-26 08:47:16,814][123090] Updated weights for policy 1, policy_version 1143698 (0.0008) [2023-12-26 08:47:16,870][123090] Updated weights for policy 1, policy_version 1143708 (0.0009) [2023-12-26 08:47:17,169][123091] Updated weights for policy 0, policy_version 1151898 (0.0010) [2023-12-26 08:47:17,229][123091] Updated weights for policy 0, policy_version 1151908 (0.0010) [2023-12-26 08:47:17,282][123091] Updated weights for policy 0, policy_version 1151918 (0.0010) [2023-12-26 08:47:17,624][123090] Updated weights for policy 1, policy_version 1143718 (0.0009) [2023-12-26 08:47:17,683][123090] Updated weights for policy 1, policy_version 1143728 (0.0007) [2023-12-26 08:47:17,751][123090] Updated weights for policy 1, policy_version 1143738 (0.0005) [2023-12-26 08:47:18,077][123091] Updated weights for policy 0, policy_version 1151928 (0.0006) [2023-12-26 08:47:18,125][123091] Updated weights for policy 0, policy_version 1151938 (0.0006) [2023-12-26 08:47:18,180][123091] Updated weights for policy 0, policy_version 1151948 (0.0005) [2023-12-26 08:47:18,479][123090] Updated weights for policy 1, policy_version 1143748 (0.0007) [2023-12-26 08:47:18,531][123090] Updated weights for policy 1, policy_version 1143758 (0.0008) [2023-12-26 08:47:18,590][123090] Updated weights for policy 1, policy_version 1143768 (0.0008) [2023-12-26 08:47:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 587710464. Throughput: 0: 8953.3, 1: 8941.7. Samples: 587721980. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:18,785][121949] Avg episode reward: [(0, '6219.236'), (1, '5585.125')] [2023-12-26 08:47:18,898][123091] Updated weights for policy 0, policy_version 1151958 (0.0009) [2023-12-26 08:47:18,949][123091] Updated weights for policy 0, policy_version 1151968 (0.0010) [2023-12-26 08:47:19,004][123091] Updated weights for policy 0, policy_version 1151978 (0.0011) [2023-12-26 08:47:19,262][123090] Updated weights for policy 1, policy_version 1143778 (0.0006) [2023-12-26 08:47:19,328][123090] Updated weights for policy 1, policy_version 1143788 (0.0006) [2023-12-26 08:47:19,402][123090] Updated weights for policy 1, policy_version 1143798 (0.0007) [2023-12-26 08:47:19,458][123090] Updated weights for policy 1, policy_version 1143808 (0.0005) [2023-12-26 08:47:19,821][123091] Updated weights for policy 0, policy_version 1151988 (0.0010) [2023-12-26 08:47:19,890][123091] Updated weights for policy 0, policy_version 1151998 (0.0010) [2023-12-26 08:47:19,964][123091] Updated weights for policy 0, policy_version 1152008 (0.0010) [2023-12-26 08:47:20,199][123090] Updated weights for policy 1, policy_version 1143818 (0.0009) [2023-12-26 08:47:20,258][123090] Updated weights for policy 1, policy_version 1143828 (0.0009) [2023-12-26 08:47:20,328][123090] Updated weights for policy 1, policy_version 1143838 (0.0008) [2023-12-26 08:47:20,808][123091] Updated weights for policy 0, policy_version 1152018 (0.0010) [2023-12-26 08:47:20,872][123091] Updated weights for policy 0, policy_version 1152028 (0.0010) [2023-12-26 08:47:20,932][123091] Updated weights for policy 0, policy_version 1152038 (0.0008) [2023-12-26 08:47:20,999][123091] Updated weights for policy 0, policy_version 1152048 (0.0009) [2023-12-26 08:47:21,187][123090] Updated weights for policy 1, policy_version 1143848 (0.0009) [2023-12-26 08:47:21,253][123090] Updated weights for policy 1, policy_version 1143858 (0.0008) [2023-12-26 08:47:21,312][123090] Updated weights for policy 1, policy_version 1143868 (0.0008) [2023-12-26 08:47:21,894][123091] Updated weights for policy 0, policy_version 1152058 (0.0010) [2023-12-26 08:47:21,958][123091] Updated weights for policy 0, policy_version 1152068 (0.0010) [2023-12-26 08:47:22,023][123091] Updated weights for policy 0, policy_version 1152078 (0.0010) [2023-12-26 08:47:22,118][123090] Updated weights for policy 1, policy_version 1143878 (0.0009) [2023-12-26 08:47:22,182][123090] Updated weights for policy 1, policy_version 1143888 (0.0010) [2023-12-26 08:47:22,234][123090] Updated weights for policy 1, policy_version 1143898 (0.0009) [2023-12-26 08:47:22,832][123091] Updated weights for policy 0, policy_version 1152088 (0.0010) [2023-12-26 08:47:22,880][123091] Updated weights for policy 0, policy_version 1152098 (0.0010) [2023-12-26 08:47:22,933][123091] Updated weights for policy 0, policy_version 1152108 (0.0010) [2023-12-26 08:47:23,091][123090] Updated weights for policy 1, policy_version 1143908 (0.0009) [2023-12-26 08:47:23,152][123090] Updated weights for policy 1, policy_version 1143918 (0.0009) [2023-12-26 08:47:23,201][123090] Updated weights for policy 1, policy_version 1143928 (0.0009) [2023-12-26 08:47:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 587792384. Throughput: 0: 8895.8, 1: 8997.6. Samples: 587774468. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:23,785][121949] Avg episode reward: [(0, '6188.712'), (1, '5611.104')] [2023-12-26 08:47:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001143936_292847616.pth... [2023-12-26 08:47:23,791][123091] Updated weights for policy 0, policy_version 1152118 (0.0011) [2023-12-26 08:47:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001142880_292577280.pth [2023-12-26 08:47:23,849][123091] Updated weights for policy 0, policy_version 1152128 (0.0010) [2023-12-26 08:47:23,912][123091] Updated weights for policy 0, policy_version 1152138 (0.0011) [2023-12-26 08:47:23,946][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001152144_294952960.pth... [2023-12-26 08:47:23,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001151088_294682624.pth [2023-12-26 08:47:24,043][123090] Updated weights for policy 1, policy_version 1143938 (0.0009) [2023-12-26 08:47:24,106][123090] Updated weights for policy 1, policy_version 1143948 (0.0010) [2023-12-26 08:47:24,165][123090] Updated weights for policy 1, policy_version 1143958 (0.0010) [2023-12-26 08:47:24,231][123090] Updated weights for policy 1, policy_version 1143968 (0.0010) [2023-12-26 08:47:24,734][123091] Updated weights for policy 0, policy_version 1152148 (0.0011) [2023-12-26 08:47:24,781][123091] Updated weights for policy 0, policy_version 1152158 (0.0010) [2023-12-26 08:47:24,829][123091] Updated weights for policy 0, policy_version 1152168 (0.0010) [2023-12-26 08:47:25,004][123090] Updated weights for policy 1, policy_version 1143978 (0.0010) [2023-12-26 08:47:25,070][123090] Updated weights for policy 1, policy_version 1143988 (0.0010) [2023-12-26 08:47:25,140][123090] Updated weights for policy 1, policy_version 1143998 (0.0010) [2023-12-26 08:47:25,596][123091] Updated weights for policy 0, policy_version 1152178 (0.0009) [2023-12-26 08:47:25,652][123091] Updated weights for policy 0, policy_version 1152188 (0.0005) [2023-12-26 08:47:25,721][123091] Updated weights for policy 0, policy_version 1152198 (0.0005) [2023-12-26 08:47:25,788][123091] Updated weights for policy 0, policy_version 1152208 (0.0005) [2023-12-26 08:47:25,973][123090] Updated weights for policy 1, policy_version 1144008 (0.0010) [2023-12-26 08:47:26,033][123090] Updated weights for policy 1, policy_version 1144018 (0.0010) [2023-12-26 08:47:26,096][123090] Updated weights for policy 1, policy_version 1144028 (0.0009) [2023-12-26 08:47:26,452][123091] Updated weights for policy 0, policy_version 1152218 (0.0005) [2023-12-26 08:47:26,503][123091] Updated weights for policy 0, policy_version 1152228 (0.0005) [2023-12-26 08:47:26,562][123091] Updated weights for policy 0, policy_version 1152238 (0.0006) [2023-12-26 08:47:26,936][123090] Updated weights for policy 1, policy_version 1144038 (0.0008) [2023-12-26 08:47:26,984][123090] Updated weights for policy 1, policy_version 1144048 (0.0008) [2023-12-26 08:47:27,035][123090] Updated weights for policy 1, policy_version 1144058 (0.0008) [2023-12-26 08:47:27,317][123091] Updated weights for policy 0, policy_version 1152248 (0.0009) [2023-12-26 08:47:27,379][123091] Updated weights for policy 0, policy_version 1152258 (0.0011) [2023-12-26 08:47:27,425][123091] Updated weights for policy 0, policy_version 1152268 (0.0010) [2023-12-26 08:47:27,824][123090] Updated weights for policy 1, policy_version 1144068 (0.0007) [2023-12-26 08:47:27,888][123090] Updated weights for policy 1, policy_version 1144078 (0.0008) [2023-12-26 08:47:27,958][123090] Updated weights for policy 1, policy_version 1144088 (0.0010) [2023-12-26 08:47:28,221][123091] Updated weights for policy 0, policy_version 1152278 (0.0007) [2023-12-26 08:47:28,294][123091] Updated weights for policy 0, policy_version 1152288 (0.0005) [2023-12-26 08:47:28,356][123091] Updated weights for policy 0, policy_version 1152298 (0.0007) [2023-12-26 08:47:28,633][123090] Updated weights for policy 1, policy_version 1144098 (0.0009) [2023-12-26 08:47:28,703][123090] Updated weights for policy 1, policy_version 1144108 (0.0005) [2023-12-26 08:47:28,774][123090] Updated weights for policy 1, policy_version 1144118 (0.0005) [2023-12-26 08:47:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 587882496. Throughput: 0: 8870.1, 1: 9003.6. Samples: 587879792. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:28,785][121949] Avg episode reward: [(0, '6167.979'), (1, '5558.172')] [2023-12-26 08:47:28,845][123090] Updated weights for policy 1, policy_version 1144128 (0.0008) [2023-12-26 08:47:29,051][123091] Updated weights for policy 0, policy_version 1152308 (0.0006) [2023-12-26 08:47:29,099][123091] Updated weights for policy 0, policy_version 1152318 (0.0009) [2023-12-26 08:47:29,150][123091] Updated weights for policy 0, policy_version 1152328 (0.0005) [2023-12-26 08:47:29,647][123090] Updated weights for policy 1, policy_version 1144138 (0.0010) [2023-12-26 08:47:29,709][123090] Updated weights for policy 1, policy_version 1144148 (0.0009) [2023-12-26 08:47:29,773][123090] Updated weights for policy 1, policy_version 1144158 (0.0009) [2023-12-26 08:47:29,956][123091] Updated weights for policy 0, policy_version 1152338 (0.0006) [2023-12-26 08:47:30,024][123091] Updated weights for policy 0, policy_version 1152348 (0.0007) [2023-12-26 08:47:30,096][123091] Updated weights for policy 0, policy_version 1152358 (0.0009) [2023-12-26 08:47:30,151][123091] Updated weights for policy 0, policy_version 1152368 (0.0009) [2023-12-26 08:47:30,528][123090] Updated weights for policy 1, policy_version 1144168 (0.0006) [2023-12-26 08:47:30,579][123090] Updated weights for policy 1, policy_version 1144178 (0.0005) [2023-12-26 08:47:30,633][123090] Updated weights for policy 1, policy_version 1144188 (0.0008) [2023-12-26 08:47:31,015][123091] Updated weights for policy 0, policy_version 1152378 (0.0009) [2023-12-26 08:47:31,078][123091] Updated weights for policy 0, policy_version 1152389 (0.0008) [2023-12-26 08:47:31,140][123091] Updated weights for policy 0, policy_version 1152399 (0.0010) [2023-12-26 08:47:31,441][123090] Updated weights for policy 1, policy_version 1144198 (0.0009) [2023-12-26 08:47:31,505][123090] Updated weights for policy 1, policy_version 1144208 (0.0009) [2023-12-26 08:47:31,564][123090] Updated weights for policy 1, policy_version 1144218 (0.0009) [2023-12-26 08:47:31,924][123091] Updated weights for policy 0, policy_version 1152409 (0.0006) [2023-12-26 08:47:31,977][123091] Updated weights for policy 0, policy_version 1152419 (0.0005) [2023-12-26 08:47:32,040][123091] Updated weights for policy 0, policy_version 1152429 (0.0005) [2023-12-26 08:47:32,360][123090] Updated weights for policy 1, policy_version 1144228 (0.0010) [2023-12-26 08:47:32,431][123090] Updated weights for policy 1, policy_version 1144238 (0.0009) [2023-12-26 08:47:32,496][123090] Updated weights for policy 1, policy_version 1144248 (0.0009) [2023-12-26 08:47:32,869][123091] Updated weights for policy 0, policy_version 1152439 (0.0010) [2023-12-26 08:47:32,935][123091] Updated weights for policy 0, policy_version 1152449 (0.0009) [2023-12-26 08:47:33,002][123091] Updated weights for policy 0, policy_version 1152459 (0.0009) [2023-12-26 08:47:33,296][123090] Updated weights for policy 1, policy_version 1144258 (0.0010) [2023-12-26 08:47:33,344][123090] Updated weights for policy 1, policy_version 1144268 (0.0009) [2023-12-26 08:47:33,396][123090] Updated weights for policy 1, policy_version 1144278 (0.0009) [2023-12-26 08:47:33,454][123090] Updated weights for policy 1, policy_version 1144288 (0.0008) [2023-12-26 08:47:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 587972608. Throughput: 0: 8857.0, 1: 8950.1. Samples: 587986000. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:33,784][121949] Avg episode reward: [(0, '6191.980'), (1, '5593.424')] [2023-12-26 08:47:33,826][123091] Updated weights for policy 0, policy_version 1152469 (0.0010) [2023-12-26 08:47:33,891][123091] Updated weights for policy 0, policy_version 1152479 (0.0010) [2023-12-26 08:47:33,956][123091] Updated weights for policy 0, policy_version 1152489 (0.0010) [2023-12-26 08:47:34,239][123090] Updated weights for policy 1, policy_version 1144298 (0.0007) [2023-12-26 08:47:34,307][123090] Updated weights for policy 1, policy_version 1144308 (0.0009) [2023-12-26 08:47:34,372][123090] Updated weights for policy 1, policy_version 1144318 (0.0005) [2023-12-26 08:47:34,851][123091] Updated weights for policy 0, policy_version 1152500 (0.0010) [2023-12-26 08:47:34,904][123091] Updated weights for policy 0, policy_version 1152510 (0.0009) [2023-12-26 08:47:34,966][123091] Updated weights for policy 0, policy_version 1152520 (0.0009) [2023-12-26 08:47:35,137][123090] Updated weights for policy 1, policy_version 1144328 (0.0009) [2023-12-26 08:47:35,191][123090] Updated weights for policy 1, policy_version 1144338 (0.0008) [2023-12-26 08:47:35,244][123090] Updated weights for policy 1, policy_version 1144348 (0.0006) [2023-12-26 08:47:35,867][123091] Updated weights for policy 0, policy_version 1152530 (0.0010) [2023-12-26 08:47:35,870][123090] Updated weights for policy 1, policy_version 1144358 (0.0005) [2023-12-26 08:47:35,929][123091] Updated weights for policy 0, policy_version 1152540 (0.0009) [2023-12-26 08:47:35,945][123090] Updated weights for policy 1, policy_version 1144368 (0.0006) [2023-12-26 08:47:35,988][123091] Updated weights for policy 0, policy_version 1152550 (0.0008) [2023-12-26 08:47:36,000][123090] Updated weights for policy 1, policy_version 1144378 (0.0008) [2023-12-26 08:47:36,045][123091] Updated weights for policy 0, policy_version 1152560 (0.0007) [2023-12-26 08:47:36,810][123090] Updated weights for policy 1, policy_version 1144388 (0.0009) [2023-12-26 08:47:36,863][123090] Updated weights for policy 1, policy_version 1144398 (0.0009) [2023-12-26 08:47:36,889][123091] Updated weights for policy 0, policy_version 1152570 (0.0007) [2023-12-26 08:47:36,914][123090] Updated weights for policy 1, policy_version 1144408 (0.0007) [2023-12-26 08:47:36,953][123091] Updated weights for policy 0, policy_version 1152580 (0.0009) [2023-12-26 08:47:37,014][123091] Updated weights for policy 0, policy_version 1152590 (0.0009) [2023-12-26 08:47:37,616][123090] Updated weights for policy 1, policy_version 1144418 (0.0005) [2023-12-26 08:47:37,676][123090] Updated weights for policy 1, policy_version 1144428 (0.0010) [2023-12-26 08:47:37,738][123090] Updated weights for policy 1, policy_version 1144438 (0.0009) [2023-12-26 08:47:37,786][123090] Updated weights for policy 1, policy_version 1144448 (0.0008) [2023-12-26 08:47:37,902][123091] Updated weights for policy 0, policy_version 1152600 (0.0010) [2023-12-26 08:47:37,970][123091] Updated weights for policy 0, policy_version 1152610 (0.0009) [2023-12-26 08:47:38,036][123091] Updated weights for policy 0, policy_version 1152620 (0.0009) [2023-12-26 08:47:38,503][123090] Updated weights for policy 1, policy_version 1144458 (0.0009) [2023-12-26 08:47:38,568][123090] Updated weights for policy 1, policy_version 1144468 (0.0009) [2023-12-26 08:47:38,618][123090] Updated weights for policy 1, policy_version 1144478 (0.0009) [2023-12-26 08:47:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 588062720. Throughput: 0: 8808.3, 1: 8979.0. Samples: 588038708. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:38,785][121949] Avg episode reward: [(0, '6250.095'), (1, '5638.860')] [2023-12-26 08:47:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001152624_295075840.pth... [2023-12-26 08:47:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001144480_292986880.pth... [2023-12-26 08:47:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001151632_294821888.pth [2023-12-26 08:47:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001143424_292716544.pth [2023-12-26 08:47:38,873][123091] Updated weights for policy 0, policy_version 1152630 (0.0010) [2023-12-26 08:47:38,942][123091] Updated weights for policy 0, policy_version 1152640 (0.0010) [2023-12-26 08:47:39,013][123091] Updated weights for policy 0, policy_version 1152650 (0.0011) [2023-12-26 08:47:39,509][123090] Updated weights for policy 1, policy_version 1144488 (0.0009) [2023-12-26 08:47:39,571][123090] Updated weights for policy 1, policy_version 1144498 (0.0009) [2023-12-26 08:47:39,634][123090] Updated weights for policy 1, policy_version 1144508 (0.0010) [2023-12-26 08:47:39,827][123091] Updated weights for policy 0, policy_version 1152660 (0.0011) [2023-12-26 08:47:39,899][123091] Updated weights for policy 0, policy_version 1152670 (0.0011) [2023-12-26 08:47:39,968][123091] Updated weights for policy 0, policy_version 1152680 (0.0011) [2023-12-26 08:47:40,522][123090] Updated weights for policy 1, policy_version 1144518 (0.0009) [2023-12-26 08:47:40,583][123090] Updated weights for policy 1, policy_version 1144528 (0.0009) [2023-12-26 08:47:40,647][123090] Updated weights for policy 1, policy_version 1144538 (0.0008) [2023-12-26 08:47:40,784][123091] Updated weights for policy 0, policy_version 1152690 (0.0011) [2023-12-26 08:47:40,835][123091] Updated weights for policy 0, policy_version 1152700 (0.0010) [2023-12-26 08:47:40,902][123091] Updated weights for policy 0, policy_version 1152710 (0.0008) [2023-12-26 08:47:40,970][123091] Updated weights for policy 0, policy_version 1152720 (0.0007) [2023-12-26 08:47:41,414][123090] Updated weights for policy 1, policy_version 1144548 (0.0007) [2023-12-26 08:47:41,475][123090] Updated weights for policy 1, policy_version 1144558 (0.0007) [2023-12-26 08:47:41,551][123090] Updated weights for policy 1, policy_version 1144568 (0.0007) [2023-12-26 08:47:41,860][123091] Updated weights for policy 0, policy_version 1152730 (0.0011) [2023-12-26 08:47:41,926][123091] Updated weights for policy 0, policy_version 1152740 (0.0011) [2023-12-26 08:47:41,993][123091] Updated weights for policy 0, policy_version 1152750 (0.0010) [2023-12-26 08:47:42,390][123090] Updated weights for policy 1, policy_version 1144578 (0.0009) [2023-12-26 08:47:42,451][123090] Updated weights for policy 1, policy_version 1144588 (0.0009) [2023-12-26 08:47:42,507][123090] Updated weights for policy 1, policy_version 1144598 (0.0009) [2023-12-26 08:47:42,569][123090] Updated weights for policy 1, policy_version 1144608 (0.0009) [2023-12-26 08:47:42,742][123091] Updated weights for policy 0, policy_version 1152760 (0.0008) [2023-12-26 08:47:42,795][123091] Updated weights for policy 0, policy_version 1152770 (0.0009) [2023-12-26 08:47:42,850][123091] Updated weights for policy 0, policy_version 1152780 (0.0008) [2023-12-26 08:47:43,453][123090] Updated weights for policy 1, policy_version 1144618 (0.0008) [2023-12-26 08:47:43,523][123090] Updated weights for policy 1, policy_version 1144628 (0.0009) [2023-12-26 08:47:43,568][123091] Updated weights for policy 0, policy_version 1152790 (0.0007) [2023-12-26 08:47:43,592][123090] Updated weights for policy 1, policy_version 1144638 (0.0009) [2023-12-26 08:47:43,630][123091] Updated weights for policy 0, policy_version 1152800 (0.0005) [2023-12-26 08:47:43,702][123091] Updated weights for policy 0, policy_version 1152810 (0.0006) [2023-12-26 08:47:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 588152832. Throughput: 0: 8653.9, 1: 8914.9. Samples: 588140968. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:43,785][121949] Avg episode reward: [(0, '6321.305'), (1, '5549.944')] [2023-12-26 08:47:44,419][123090] Updated weights for policy 1, policy_version 1144648 (0.0009) [2023-12-26 08:47:44,463][123091] Updated weights for policy 0, policy_version 1152820 (0.0008) [2023-12-26 08:47:44,475][123090] Updated weights for policy 1, policy_version 1144658 (0.0009) [2023-12-26 08:47:44,523][123091] Updated weights for policy 0, policy_version 1152830 (0.0008) [2023-12-26 08:47:44,529][123090] Updated weights for policy 1, policy_version 1144668 (0.0008) [2023-12-26 08:47:44,578][123091] Updated weights for policy 0, policy_version 1152840 (0.0010) [2023-12-26 08:47:45,353][123090] Updated weights for policy 1, policy_version 1144678 (0.0009) [2023-12-26 08:47:45,414][123090] Updated weights for policy 1, policy_version 1144688 (0.0011) [2023-12-26 08:47:45,454][123091] Updated weights for policy 0, policy_version 1152850 (0.0009) [2023-12-26 08:47:45,478][123090] Updated weights for policy 1, policy_version 1144698 (0.0006) [2023-12-26 08:47:45,515][123091] Updated weights for policy 0, policy_version 1152860 (0.0008) [2023-12-26 08:47:45,572][123091] Updated weights for policy 0, policy_version 1152870 (0.0010) [2023-12-26 08:47:45,627][123091] Updated weights for policy 0, policy_version 1152880 (0.0010) [2023-12-26 08:47:46,154][123090] Updated weights for policy 1, policy_version 1144708 (0.0006) [2023-12-26 08:47:46,214][123090] Updated weights for policy 1, policy_version 1144718 (0.0007) [2023-12-26 08:47:46,268][123090] Updated weights for policy 1, policy_version 1144728 (0.0010) [2023-12-26 08:47:46,445][123091] Updated weights for policy 0, policy_version 1152890 (0.0010) [2023-12-26 08:47:46,500][123091] Updated weights for policy 0, policy_version 1152900 (0.0010) [2023-12-26 08:47:46,563][123091] Updated weights for policy 0, policy_version 1152910 (0.0011) [2023-12-26 08:47:46,997][123090] Updated weights for policy 1, policy_version 1144738 (0.0010) [2023-12-26 08:47:47,056][123090] Updated weights for policy 1, policy_version 1144748 (0.0010) [2023-12-26 08:47:47,114][123090] Updated weights for policy 1, policy_version 1144758 (0.0010) [2023-12-26 08:47:47,168][123090] Updated weights for policy 1, policy_version 1144768 (0.0010) [2023-12-26 08:47:47,396][123091] Updated weights for policy 0, policy_version 1152920 (0.0009) [2023-12-26 08:47:47,445][123091] Updated weights for policy 0, policy_version 1152930 (0.0005) [2023-12-26 08:47:47,494][123091] Updated weights for policy 0, policy_version 1152940 (0.0005) [2023-12-26 08:47:47,929][123090] Updated weights for policy 1, policy_version 1144778 (0.0005) [2023-12-26 08:47:47,984][123090] Updated weights for policy 1, policy_version 1144788 (0.0010) [2023-12-26 08:47:48,039][123090] Updated weights for policy 1, policy_version 1144798 (0.0010) [2023-12-26 08:47:48,139][123091] Updated weights for policy 0, policy_version 1152950 (0.0005) [2023-12-26 08:47:48,195][123091] Updated weights for policy 0, policy_version 1152960 (0.0005) [2023-12-26 08:47:48,250][123091] Updated weights for policy 0, policy_version 1152970 (0.0005) [2023-12-26 08:47:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 588234752. Throughput: 0: 8659.3, 1: 8920.6. Samples: 588249528. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:48,784][121949] Avg episode reward: [(0, '6226.031'), (1, '5360.770')] [2023-12-26 08:47:48,821][123090] Updated weights for policy 1, policy_version 1144808 (0.0010) [2023-12-26 08:47:48,886][123090] Updated weights for policy 1, policy_version 1144818 (0.0011) [2023-12-26 08:47:48,955][123090] Updated weights for policy 1, policy_version 1144828 (0.0011) [2023-12-26 08:47:48,967][123091] Updated weights for policy 0, policy_version 1152980 (0.0008) [2023-12-26 08:47:49,032][123091] Updated weights for policy 0, policy_version 1152990 (0.0008) [2023-12-26 08:47:49,086][123091] Updated weights for policy 0, policy_version 1153000 (0.0006) [2023-12-26 08:47:49,776][123090] Updated weights for policy 1, policy_version 1144838 (0.0010) [2023-12-26 08:47:49,828][123091] Updated weights for policy 0, policy_version 1153010 (0.0006) [2023-12-26 08:47:49,844][123090] Updated weights for policy 1, policy_version 1144848 (0.0009) [2023-12-26 08:47:49,893][123091] Updated weights for policy 0, policy_version 1153020 (0.0009) [2023-12-26 08:47:49,917][123090] Updated weights for policy 1, policy_version 1144858 (0.0009) [2023-12-26 08:47:49,960][123091] Updated weights for policy 0, policy_version 1153030 (0.0007) [2023-12-26 08:47:50,028][123091] Updated weights for policy 0, policy_version 1153040 (0.0007) [2023-12-26 08:47:50,654][123090] Updated weights for policy 1, policy_version 1144868 (0.0008) [2023-12-26 08:47:50,723][123090] Updated weights for policy 1, policy_version 1144878 (0.0005) [2023-12-26 08:47:50,794][123090] Updated weights for policy 1, policy_version 1144888 (0.0007) [2023-12-26 08:47:50,857][123091] Updated weights for policy 0, policy_version 1153050 (0.0009) [2023-12-26 08:47:50,910][123091] Updated weights for policy 0, policy_version 1153060 (0.0010) [2023-12-26 08:47:50,973][123091] Updated weights for policy 0, policy_version 1153070 (0.0010) [2023-12-26 08:47:51,529][123090] Updated weights for policy 1, policy_version 1144898 (0.0006) [2023-12-26 08:47:51,589][123090] Updated weights for policy 1, policy_version 1144908 (0.0009) [2023-12-26 08:47:51,662][123090] Updated weights for policy 1, policy_version 1144919 (0.0010) [2023-12-26 08:47:51,813][123091] Updated weights for policy 0, policy_version 1153080 (0.0010) [2023-12-26 08:47:51,881][123091] Updated weights for policy 0, policy_version 1153090 (0.0010) [2023-12-26 08:47:51,951][123091] Updated weights for policy 0, policy_version 1153100 (0.0010) [2023-12-26 08:47:52,505][123090] Updated weights for policy 1, policy_version 1144929 (0.0008) [2023-12-26 08:47:52,570][123090] Updated weights for policy 1, policy_version 1144939 (0.0009) [2023-12-26 08:47:52,631][123090] Updated weights for policy 1, policy_version 1144949 (0.0009) [2023-12-26 08:47:52,688][123090] Updated weights for policy 1, policy_version 1144959 (0.0009) [2023-12-26 08:47:52,787][123091] Updated weights for policy 0, policy_version 1153110 (0.0010) [2023-12-26 08:47:52,839][123091] Updated weights for policy 0, policy_version 1153120 (0.0009) [2023-12-26 08:47:52,890][123091] Updated weights for policy 0, policy_version 1153130 (0.0005) [2023-12-26 08:47:53,501][123090] Updated weights for policy 1, policy_version 1144969 (0.0010) [2023-12-26 08:47:53,554][123090] Updated weights for policy 1, policy_version 1144979 (0.0005) [2023-12-26 08:47:53,580][123091] Updated weights for policy 0, policy_version 1153140 (0.0007) [2023-12-26 08:47:53,610][123090] Updated weights for policy 1, policy_version 1144989 (0.0005) [2023-12-26 08:47:53,643][123091] Updated weights for policy 0, policy_version 1153150 (0.0008) [2023-12-26 08:47:53,708][123091] Updated weights for policy 0, policy_version 1153160 (0.0010) [2023-12-26 08:47:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 588333056. Throughput: 0: 8702.4, 1: 8914.8. Samples: 588303416. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:53,785][121949] Avg episode reward: [(0, '6147.257'), (1, '5251.952')] [2023-12-26 08:47:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001153168_295215104.pth... [2023-12-26 08:47:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001144992_293117952.pth... [2023-12-26 08:47:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001152144_294952960.pth [2023-12-26 08:47:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001143936_292847616.pth [2023-12-26 08:47:54,309][123090] Updated weights for policy 1, policy_version 1144999 (0.0008) [2023-12-26 08:47:54,383][123090] Updated weights for policy 1, policy_version 1145009 (0.0005) [2023-12-26 08:47:54,461][123090] Updated weights for policy 1, policy_version 1145019 (0.0006) [2023-12-26 08:47:54,563][123091] Updated weights for policy 0, policy_version 1153170 (0.0011) [2023-12-26 08:47:54,616][123091] Updated weights for policy 0, policy_version 1153180 (0.0006) [2023-12-26 08:47:54,679][123091] Updated weights for policy 0, policy_version 1153190 (0.0005) [2023-12-26 08:47:54,748][123091] Updated weights for policy 0, policy_version 1153200 (0.0007) [2023-12-26 08:47:55,111][123090] Updated weights for policy 1, policy_version 1145029 (0.0007) [2023-12-26 08:47:55,179][123090] Updated weights for policy 1, policy_version 1145039 (0.0005) [2023-12-26 08:47:55,237][123090] Updated weights for policy 1, policy_version 1145049 (0.0005) [2023-12-26 08:47:55,585][123091] Updated weights for policy 0, policy_version 1153210 (0.0009) [2023-12-26 08:47:55,639][123091] Updated weights for policy 0, policy_version 1153220 (0.0009) [2023-12-26 08:47:55,691][123091] Updated weights for policy 0, policy_version 1153230 (0.0009) [2023-12-26 08:47:55,771][123090] Updated weights for policy 1, policy_version 1145059 (0.0006) [2023-12-26 08:47:55,834][123090] Updated weights for policy 1, policy_version 1145069 (0.0009) [2023-12-26 08:47:55,887][123090] Updated weights for policy 1, policy_version 1145079 (0.0009) [2023-12-26 08:47:56,487][123091] Updated weights for policy 0, policy_version 1153240 (0.0010) [2023-12-26 08:47:56,541][123091] Updated weights for policy 0, policy_version 1153250 (0.0010) [2023-12-26 08:47:56,596][123091] Updated weights for policy 0, policy_version 1153260 (0.0011) [2023-12-26 08:47:56,649][123090] Updated weights for policy 1, policy_version 1145089 (0.0009) [2023-12-26 08:47:56,709][123090] Updated weights for policy 1, policy_version 1145099 (0.0005) [2023-12-26 08:47:56,786][123090] Updated weights for policy 1, policy_version 1145109 (0.0005) [2023-12-26 08:47:56,858][123090] Updated weights for policy 1, policy_version 1145119 (0.0009) [2023-12-26 08:47:57,357][123091] Updated weights for policy 0, policy_version 1153270 (0.0010) [2023-12-26 08:47:57,421][123091] Updated weights for policy 0, policy_version 1153280 (0.0005) [2023-12-26 08:47:57,486][123091] Updated weights for policy 0, policy_version 1153290 (0.0005) [2023-12-26 08:47:57,528][123090] Updated weights for policy 1, policy_version 1145129 (0.0007) [2023-12-26 08:47:57,583][123090] Updated weights for policy 1, policy_version 1145139 (0.0005) [2023-12-26 08:47:57,633][123090] Updated weights for policy 1, policy_version 1145149 (0.0005) [2023-12-26 08:47:58,192][123091] Updated weights for policy 0, policy_version 1153300 (0.0005) [2023-12-26 08:47:58,253][123091] Updated weights for policy 0, policy_version 1153310 (0.0006) [2023-12-26 08:47:58,316][123091] Updated weights for policy 0, policy_version 1153320 (0.0007) [2023-12-26 08:47:58,363][123090] Updated weights for policy 1, policy_version 1145159 (0.0008) [2023-12-26 08:47:58,427][123090] Updated weights for policy 1, policy_version 1145169 (0.0006) [2023-12-26 08:47:58,489][123090] Updated weights for policy 1, policy_version 1145179 (0.0009) [2023-12-26 08:47:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 588423168. Throughput: 0: 8795.6, 1: 8995.3. Samples: 588414212. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:47:58,785][121949] Avg episode reward: [(0, '6245.303'), (1, '5399.566')] [2023-12-26 08:47:59,134][123091] Updated weights for policy 0, policy_version 1153330 (0.0008) [2023-12-26 08:47:59,186][123091] Updated weights for policy 0, policy_version 1153340 (0.0009) [2023-12-26 08:47:59,251][123091] Updated weights for policy 0, policy_version 1153350 (0.0007) [2023-12-26 08:47:59,315][123091] Updated weights for policy 0, policy_version 1153360 (0.0006) [2023-12-26 08:47:59,369][123090] Updated weights for policy 1, policy_version 1145189 (0.0010) [2023-12-26 08:47:59,432][123090] Updated weights for policy 1, policy_version 1145199 (0.0006) [2023-12-26 08:47:59,493][123090] Updated weights for policy 1, policy_version 1145209 (0.0008) [2023-12-26 08:47:59,951][123091] Updated weights for policy 0, policy_version 1153370 (0.0007) [2023-12-26 08:48:00,020][123091] Updated weights for policy 0, policy_version 1153380 (0.0008) [2023-12-26 08:48:00,082][123091] Updated weights for policy 0, policy_version 1153390 (0.0008) [2023-12-26 08:48:00,354][123090] Updated weights for policy 1, policy_version 1145219 (0.0010) [2023-12-26 08:48:00,414][123090] Updated weights for policy 1, policy_version 1145229 (0.0009) [2023-12-26 08:48:00,471][123090] Updated weights for policy 1, policy_version 1145239 (0.0008) [2023-12-26 08:48:00,743][123091] Updated weights for policy 0, policy_version 1153400 (0.0006) [2023-12-26 08:48:00,787][123091] Updated weights for policy 0, policy_version 1153410 (0.0005) [2023-12-26 08:48:00,835][123091] Updated weights for policy 0, policy_version 1153420 (0.0005) [2023-12-26 08:48:01,333][123090] Updated weights for policy 1, policy_version 1145249 (0.0006) [2023-12-26 08:48:01,401][123090] Updated weights for policy 1, policy_version 1145259 (0.0009) [2023-12-26 08:48:01,461][123090] Updated weights for policy 1, policy_version 1145269 (0.0009) [2023-12-26 08:48:01,526][123090] Updated weights for policy 1, policy_version 1145279 (0.0010) [2023-12-26 08:48:01,576][123091] Updated weights for policy 0, policy_version 1153430 (0.0008) [2023-12-26 08:48:01,640][123091] Updated weights for policy 0, policy_version 1153440 (0.0007) [2023-12-26 08:48:01,705][123091] Updated weights for policy 0, policy_version 1153450 (0.0006) [2023-12-26 08:48:02,404][123090] Updated weights for policy 1, policy_version 1145289 (0.0010) [2023-12-26 08:48:02,470][123091] Updated weights for policy 0, policy_version 1153460 (0.0009) [2023-12-26 08:48:02,472][123090] Updated weights for policy 1, policy_version 1145299 (0.0008) [2023-12-26 08:48:02,534][123091] Updated weights for policy 0, policy_version 1153470 (0.0010) [2023-12-26 08:48:02,536][123090] Updated weights for policy 1, policy_version 1145309 (0.0008) [2023-12-26 08:48:02,595][123091] Updated weights for policy 0, policy_version 1153480 (0.0008) [2023-12-26 08:48:03,347][123090] Updated weights for policy 1, policy_version 1145319 (0.0010) [2023-12-26 08:48:03,390][123091] Updated weights for policy 0, policy_version 1153490 (0.0009) [2023-12-26 08:48:03,411][123090] Updated weights for policy 1, policy_version 1145329 (0.0009) [2023-12-26 08:48:03,443][123091] Updated weights for policy 0, policy_version 1153500 (0.0007) [2023-12-26 08:48:03,483][123090] Updated weights for policy 1, policy_version 1145339 (0.0009) [2023-12-26 08:48:03,494][123091] Updated weights for policy 0, policy_version 1153510 (0.0008) [2023-12-26 08:48:03,543][123091] Updated weights for policy 0, policy_version 1153520 (0.0006) [2023-12-26 08:48:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 588513280. Throughput: 0: 8829.8, 1: 8921.4. Samples: 588520780. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:03,785][121949] Avg episode reward: [(0, '6196.037'), (1, '5565.525')] [2023-12-26 08:48:04,213][123091] Updated weights for policy 0, policy_version 1153530 (0.0008) [2023-12-26 08:48:04,275][123091] Updated weights for policy 0, policy_version 1153540 (0.0006) [2023-12-26 08:48:04,332][123091] Updated weights for policy 0, policy_version 1153550 (0.0008) [2023-12-26 08:48:04,371][123090] Updated weights for policy 1, policy_version 1145349 (0.0009) [2023-12-26 08:48:04,446][123090] Updated weights for policy 1, policy_version 1145359 (0.0009) [2023-12-26 08:48:04,512][123090] Updated weights for policy 1, policy_version 1145369 (0.0009) [2023-12-26 08:48:05,053][123091] Updated weights for policy 0, policy_version 1153560 (0.0009) [2023-12-26 08:48:05,105][123091] Updated weights for policy 0, policy_version 1153570 (0.0009) [2023-12-26 08:48:05,163][123091] Updated weights for policy 0, policy_version 1153581 (0.0006) [2023-12-26 08:48:05,296][123090] Updated weights for policy 1, policy_version 1145379 (0.0009) [2023-12-26 08:48:05,368][123090] Updated weights for policy 1, policy_version 1145389 (0.0010) [2023-12-26 08:48:05,441][123090] Updated weights for policy 1, policy_version 1145399 (0.0010) [2023-12-26 08:48:05,905][123091] Updated weights for policy 0, policy_version 1153591 (0.0008) [2023-12-26 08:48:05,968][123091] Updated weights for policy 0, policy_version 1153601 (0.0010) [2023-12-26 08:48:06,035][123091] Updated weights for policy 0, policy_version 1153611 (0.0010) [2023-12-26 08:48:06,273][123090] Updated weights for policy 1, policy_version 1145409 (0.0010) [2023-12-26 08:48:06,332][123090] Updated weights for policy 1, policy_version 1145419 (0.0010) [2023-12-26 08:48:06,384][123090] Updated weights for policy 1, policy_version 1145429 (0.0010) [2023-12-26 08:48:06,451][123090] Updated weights for policy 1, policy_version 1145439 (0.0009) [2023-12-26 08:48:06,865][123091] Updated weights for policy 0, policy_version 1153621 (0.0009) [2023-12-26 08:48:06,919][123091] Updated weights for policy 0, policy_version 1153631 (0.0005) [2023-12-26 08:48:06,975][123091] Updated weights for policy 0, policy_version 1153641 (0.0005) [2023-12-26 08:48:07,340][123090] Updated weights for policy 1, policy_version 1145449 (0.0009) [2023-12-26 08:48:07,402][123090] Updated weights for policy 1, policy_version 1145459 (0.0009) [2023-12-26 08:48:07,460][123090] Updated weights for policy 1, policy_version 1145469 (0.0009) [2023-12-26 08:48:07,740][123091] Updated weights for policy 0, policy_version 1153651 (0.0007) [2023-12-26 08:48:07,802][123091] Updated weights for policy 0, policy_version 1153661 (0.0010) [2023-12-26 08:48:07,868][123091] Updated weights for policy 0, policy_version 1153671 (0.0009) [2023-12-26 08:48:08,335][123090] Updated weights for policy 1, policy_version 1145479 (0.0010) [2023-12-26 08:48:08,397][123090] Updated weights for policy 1, policy_version 1145489 (0.0009) [2023-12-26 08:48:08,462][123090] Updated weights for policy 1, policy_version 1145499 (0.0005) [2023-12-26 08:48:08,675][123091] Updated weights for policy 0, policy_version 1153681 (0.0009) [2023-12-26 08:48:08,723][123091] Updated weights for policy 0, policy_version 1153691 (0.0005) [2023-12-26 08:48:08,770][123091] Updated weights for policy 0, policy_version 1153701 (0.0006) [2023-12-26 08:48:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 588595200. Throughput: 0: 8900.1, 1: 8873.0. Samples: 588574256. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:08,785][121949] Avg episode reward: [(0, '6086.926'), (1, '5527.939')] [2023-12-26 08:48:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001145504_293249024.pth... [2023-12-26 08:48:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001144480_292986880.pth [2023-12-26 08:48:08,819][123091] Updated weights for policy 0, policy_version 1153711 (0.0005) [2023-12-26 08:48:08,823][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001153712_295354368.pth... [2023-12-26 08:48:08,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001152624_295075840.pth [2023-12-26 08:48:09,257][123090] Updated weights for policy 1, policy_version 1145509 (0.0008) [2023-12-26 08:48:09,316][123090] Updated weights for policy 1, policy_version 1145519 (0.0010) [2023-12-26 08:48:09,385][123090] Updated weights for policy 1, policy_version 1145529 (0.0010) [2023-12-26 08:48:09,595][123091] Updated weights for policy 0, policy_version 1153721 (0.0006) [2023-12-26 08:48:09,669][123091] Updated weights for policy 0, policy_version 1153731 (0.0006) [2023-12-26 08:48:09,733][123091] Updated weights for policy 0, policy_version 1153741 (0.0006) [2023-12-26 08:48:10,349][123090] Updated weights for policy 1, policy_version 1145539 (0.0010) [2023-12-26 08:48:10,410][123090] Updated weights for policy 1, policy_version 1145549 (0.0009) [2023-12-26 08:48:10,476][123090] Updated weights for policy 1, policy_version 1145559 (0.0009) [2023-12-26 08:48:10,509][123091] Updated weights for policy 0, policy_version 1153751 (0.0006) [2023-12-26 08:48:10,577][123091] Updated weights for policy 0, policy_version 1153761 (0.0009) [2023-12-26 08:48:10,643][123091] Updated weights for policy 0, policy_version 1153771 (0.0008) [2023-12-26 08:48:11,367][123090] Updated weights for policy 1, policy_version 1145569 (0.0009) [2023-12-26 08:48:11,400][123091] Updated weights for policy 0, policy_version 1153781 (0.0009) [2023-12-26 08:48:11,435][123090] Updated weights for policy 1, policy_version 1145579 (0.0008) [2023-12-26 08:48:11,464][123091] Updated weights for policy 0, policy_version 1153791 (0.0006) [2023-12-26 08:48:11,504][123090] Updated weights for policy 1, policy_version 1145589 (0.0009) [2023-12-26 08:48:11,527][123091] Updated weights for policy 0, policy_version 1153801 (0.0009) [2023-12-26 08:48:11,569][123090] Updated weights for policy 1, policy_version 1145599 (0.0009) [2023-12-26 08:48:12,340][123091] Updated weights for policy 0, policy_version 1153811 (0.0008) [2023-12-26 08:48:12,382][123090] Updated weights for policy 1, policy_version 1145609 (0.0009) [2023-12-26 08:48:12,406][123091] Updated weights for policy 0, policy_version 1153821 (0.0007) [2023-12-26 08:48:12,432][123090] Updated weights for policy 1, policy_version 1145619 (0.0009) [2023-12-26 08:48:12,462][123091] Updated weights for policy 0, policy_version 1153831 (0.0008) [2023-12-26 08:48:12,491][123090] Updated weights for policy 1, policy_version 1145629 (0.0010) [2023-12-26 08:48:13,265][123091] Updated weights for policy 0, policy_version 1153841 (0.0007) [2023-12-26 08:48:13,322][123091] Updated weights for policy 0, policy_version 1153851 (0.0005) [2023-12-26 08:48:13,353][123090] Updated weights for policy 1, policy_version 1145639 (0.0009) [2023-12-26 08:48:13,379][123091] Updated weights for policy 0, policy_version 1153861 (0.0006) [2023-12-26 08:48:13,407][123090] Updated weights for policy 1, policy_version 1145649 (0.0007) [2023-12-26 08:48:13,437][123091] Updated weights for policy 0, policy_version 1153871 (0.0010) [2023-12-26 08:48:13,463][123090] Updated weights for policy 1, policy_version 1145659 (0.0007) [2023-12-26 08:48:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 588685312. Throughput: 0: 8906.7, 1: 8826.5. Samples: 588677784. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:13,785][121949] Avg episode reward: [(0, '6245.227'), (1, '5302.686')] [2023-12-26 08:48:14,219][123090] Updated weights for policy 1, policy_version 1145669 (0.0008) [2023-12-26 08:48:14,246][123091] Updated weights for policy 0, policy_version 1153881 (0.0011) [2023-12-26 08:48:14,292][123090] Updated weights for policy 1, policy_version 1145679 (0.0007) [2023-12-26 08:48:14,318][123091] Updated weights for policy 0, policy_version 1153891 (0.0010) [2023-12-26 08:48:14,357][123090] Updated weights for policy 1, policy_version 1145689 (0.0006) [2023-12-26 08:48:14,374][123091] Updated weights for policy 0, policy_version 1153901 (0.0011) [2023-12-26 08:48:15,141][123090] Updated weights for policy 1, policy_version 1145699 (0.0008) [2023-12-26 08:48:15,161][123091] Updated weights for policy 0, policy_version 1153911 (0.0008) [2023-12-26 08:48:15,205][123090] Updated weights for policy 1, policy_version 1145709 (0.0009) [2023-12-26 08:48:15,228][123091] Updated weights for policy 0, policy_version 1153921 (0.0009) [2023-12-26 08:48:15,268][123090] Updated weights for policy 1, policy_version 1145719 (0.0007) [2023-12-26 08:48:15,295][123091] Updated weights for policy 0, policy_version 1153931 (0.0007) [2023-12-26 08:48:15,868][123091] Updated weights for policy 0, policy_version 1153941 (0.0006) [2023-12-26 08:48:15,927][123091] Updated weights for policy 0, policy_version 1153951 (0.0005) [2023-12-26 08:48:15,989][123091] Updated weights for policy 0, policy_version 1153961 (0.0008) [2023-12-26 08:48:16,046][123090] Updated weights for policy 1, policy_version 1145729 (0.0009) [2023-12-26 08:48:16,103][123090] Updated weights for policy 1, policy_version 1145739 (0.0008) [2023-12-26 08:48:16,159][123090] Updated weights for policy 1, policy_version 1145749 (0.0009) [2023-12-26 08:48:16,213][123090] Updated weights for policy 1, policy_version 1145759 (0.0009) [2023-12-26 08:48:16,798][123091] Updated weights for policy 0, policy_version 1153971 (0.0009) [2023-12-26 08:48:16,846][123091] Updated weights for policy 0, policy_version 1153981 (0.0005) [2023-12-26 08:48:16,906][123091] Updated weights for policy 0, policy_version 1153991 (0.0005) [2023-12-26 08:48:16,935][123090] Updated weights for policy 1, policy_version 1145769 (0.0010) [2023-12-26 08:48:17,000][123090] Updated weights for policy 1, policy_version 1145779 (0.0010) [2023-12-26 08:48:17,058][123090] Updated weights for policy 1, policy_version 1145789 (0.0010) [2023-12-26 08:48:17,613][123091] Updated weights for policy 0, policy_version 1154001 (0.0006) [2023-12-26 08:48:17,662][123091] Updated weights for policy 0, policy_version 1154011 (0.0007) [2023-12-26 08:48:17,716][123091] Updated weights for policy 0, policy_version 1154021 (0.0006) [2023-12-26 08:48:17,767][123091] Updated weights for policy 0, policy_version 1154031 (0.0009) [2023-12-26 08:48:17,882][123090] Updated weights for policy 1, policy_version 1145799 (0.0009) [2023-12-26 08:48:17,958][123090] Updated weights for policy 1, policy_version 1145809 (0.0009) [2023-12-26 08:48:18,026][123090] Updated weights for policy 1, policy_version 1145819 (0.0010) [2023-12-26 08:48:18,575][123091] Updated weights for policy 0, policy_version 1154041 (0.0010) [2023-12-26 08:48:18,629][123091] Updated weights for policy 0, policy_version 1154051 (0.0009) [2023-12-26 08:48:18,698][123091] Updated weights for policy 0, policy_version 1154061 (0.0010) [2023-12-26 08:48:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 588775424. Throughput: 0: 8957.6, 1: 8808.0. Samples: 588785452. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:18,785][121949] Avg episode reward: [(0, '6335.819'), (1, '5317.734')] [2023-12-26 08:48:18,877][123090] Updated weights for policy 1, policy_version 1145829 (0.0009) [2023-12-26 08:48:18,944][123090] Updated weights for policy 1, policy_version 1145839 (0.0009) [2023-12-26 08:48:19,003][123090] Updated weights for policy 1, policy_version 1145849 (0.0010) [2023-12-26 08:48:19,409][123091] Updated weights for policy 0, policy_version 1154071 (0.0010) [2023-12-26 08:48:19,473][123091] Updated weights for policy 0, policy_version 1154081 (0.0009) [2023-12-26 08:48:19,541][123091] Updated weights for policy 0, policy_version 1154091 (0.0009) [2023-12-26 08:48:19,886][123090] Updated weights for policy 1, policy_version 1145859 (0.0010) [2023-12-26 08:48:19,953][123090] Updated weights for policy 1, policy_version 1145869 (0.0009) [2023-12-26 08:48:20,013][123090] Updated weights for policy 1, policy_version 1145879 (0.0009) [2023-12-26 08:48:20,360][123091] Updated weights for policy 0, policy_version 1154101 (0.0007) [2023-12-26 08:48:20,434][123091] Updated weights for policy 0, policy_version 1154111 (0.0006) [2023-12-26 08:48:20,506][123091] Updated weights for policy 0, policy_version 1154121 (0.0009) [2023-12-26 08:48:20,927][123090] Updated weights for policy 1, policy_version 1145889 (0.0010) [2023-12-26 08:48:20,983][123090] Updated weights for policy 1, policy_version 1145899 (0.0010) [2023-12-26 08:48:21,046][123090] Updated weights for policy 1, policy_version 1145909 (0.0010) [2023-12-26 08:48:21,114][123090] Updated weights for policy 1, policy_version 1145919 (0.0010) [2023-12-26 08:48:21,272][123091] Updated weights for policy 0, policy_version 1154131 (0.0010) [2023-12-26 08:48:21,335][123091] Updated weights for policy 0, policy_version 1154141 (0.0009) [2023-12-26 08:48:21,409][123091] Updated weights for policy 0, policy_version 1154151 (0.0010) [2023-12-26 08:48:21,984][123090] Updated weights for policy 1, policy_version 1145929 (0.0009) [2023-12-26 08:48:22,057][123090] Updated weights for policy 1, policy_version 1145939 (0.0010) [2023-12-26 08:48:22,118][123090] Updated weights for policy 1, policy_version 1145949 (0.0009) [2023-12-26 08:48:22,253][123091] Updated weights for policy 0, policy_version 1154161 (0.0009) [2023-12-26 08:48:22,308][123091] Updated weights for policy 0, policy_version 1154171 (0.0010) [2023-12-26 08:48:22,376][123091] Updated weights for policy 0, policy_version 1154181 (0.0009) [2023-12-26 08:48:22,442][123091] Updated weights for policy 0, policy_version 1154191 (0.0010) [2023-12-26 08:48:22,943][123090] Updated weights for policy 1, policy_version 1145959 (0.0010) [2023-12-26 08:48:23,008][123090] Updated weights for policy 1, policy_version 1145969 (0.0010) [2023-12-26 08:48:23,078][123090] Updated weights for policy 1, policy_version 1145979 (0.0010) [2023-12-26 08:48:23,231][123091] Updated weights for policy 0, policy_version 1154201 (0.0006) [2023-12-26 08:48:23,280][123091] Updated weights for policy 0, policy_version 1154211 (0.0005) [2023-12-26 08:48:23,339][123091] Updated weights for policy 0, policy_version 1154221 (0.0007) [2023-12-26 08:48:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 588857344. Throughput: 0: 8996.2, 1: 8715.7. Samples: 588835740. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:23,785][121949] Avg episode reward: [(0, '6304.585'), (1, '5405.676')] [2023-12-26 08:48:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001145984_293371904.pth... [2023-12-26 08:48:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001154224_295485440.pth... [2023-12-26 08:48:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001153168_295215104.pth [2023-12-26 08:48:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001144992_293117952.pth [2023-12-26 08:48:23,858][123090] Updated weights for policy 1, policy_version 1145989 (0.0008) [2023-12-26 08:48:23,912][123090] Updated weights for policy 1, policy_version 1145999 (0.0010) [2023-12-26 08:48:23,970][123090] Updated weights for policy 1, policy_version 1146009 (0.0010) [2023-12-26 08:48:24,031][123091] Updated weights for policy 0, policy_version 1154231 (0.0007) [2023-12-26 08:48:24,088][123091] Updated weights for policy 0, policy_version 1154241 (0.0008) [2023-12-26 08:48:24,142][123091] Updated weights for policy 0, policy_version 1154251 (0.0005) [2023-12-26 08:48:24,861][123091] Updated weights for policy 0, policy_version 1154261 (0.0009) [2023-12-26 08:48:24,882][123090] Updated weights for policy 1, policy_version 1146020 (0.0009) [2023-12-26 08:48:24,915][123091] Updated weights for policy 0, policy_version 1154271 (0.0010) [2023-12-26 08:48:24,935][123090] Updated weights for policy 1, policy_version 1146030 (0.0009) [2023-12-26 08:48:24,974][123091] Updated weights for policy 0, policy_version 1154281 (0.0011) [2023-12-26 08:48:24,987][123090] Updated weights for policy 1, policy_version 1146040 (0.0008) [2023-12-26 08:48:25,758][123091] Updated weights for policy 0, policy_version 1154291 (0.0009) [2023-12-26 08:48:25,830][123091] Updated weights for policy 0, policy_version 1154301 (0.0005) [2023-12-26 08:48:25,838][123090] Updated weights for policy 1, policy_version 1146050 (0.0009) [2023-12-26 08:48:25,898][123091] Updated weights for policy 0, policy_version 1154311 (0.0005) [2023-12-26 08:48:25,900][123090] Updated weights for policy 1, policy_version 1146060 (0.0009) [2023-12-26 08:48:25,953][123090] Updated weights for policy 1, policy_version 1146070 (0.0007) [2023-12-26 08:48:26,020][123090] Updated weights for policy 1, policy_version 1146080 (0.0009) [2023-12-26 08:48:26,536][123091] Updated weights for policy 0, policy_version 1154321 (0.0008) [2023-12-26 08:48:26,604][123091] Updated weights for policy 0, policy_version 1154331 (0.0005) [2023-12-26 08:48:26,675][123091] Updated weights for policy 0, policy_version 1154341 (0.0005) [2023-12-26 08:48:26,736][123091] Updated weights for policy 0, policy_version 1154351 (0.0009) [2023-12-26 08:48:26,924][123090] Updated weights for policy 1, policy_version 1146090 (0.0010) [2023-12-26 08:48:26,979][123090] Updated weights for policy 1, policy_version 1146100 (0.0010) [2023-12-26 08:48:27,034][123090] Updated weights for policy 1, policy_version 1146111 (0.0010) [2023-12-26 08:48:27,490][123091] Updated weights for policy 0, policy_version 1154361 (0.0006) [2023-12-26 08:48:27,536][123091] Updated weights for policy 0, policy_version 1154371 (0.0005) [2023-12-26 08:48:27,590][123091] Updated weights for policy 0, policy_version 1154381 (0.0005) [2023-12-26 08:48:27,964][123090] Updated weights for policy 1, policy_version 1146121 (0.0009) [2023-12-26 08:48:28,023][123090] Updated weights for policy 1, policy_version 1146131 (0.0010) [2023-12-26 08:48:28,095][123090] Updated weights for policy 1, policy_version 1146141 (0.0009) [2023-12-26 08:48:28,203][123091] Updated weights for policy 0, policy_version 1154391 (0.0005) [2023-12-26 08:48:28,249][123091] Updated weights for policy 0, policy_version 1154401 (0.0005) [2023-12-26 08:48:28,308][123091] Updated weights for policy 0, policy_version 1154411 (0.0006) [2023-12-26 08:48:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 588947456. Throughput: 0: 9152.9, 1: 8675.3. Samples: 588943236. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:28,784][121949] Avg episode reward: [(0, '6202.787'), (1, '5167.478')] [2023-12-26 08:48:29,012][123090] Updated weights for policy 1, policy_version 1146151 (0.0009) [2023-12-26 08:48:29,025][123091] Updated weights for policy 0, policy_version 1154421 (0.0007) [2023-12-26 08:48:29,080][123090] Updated weights for policy 1, policy_version 1146161 (0.0009) [2023-12-26 08:48:29,088][123091] Updated weights for policy 0, policy_version 1154431 (0.0007) [2023-12-26 08:48:29,151][123090] Updated weights for policy 1, policy_version 1146171 (0.0009) [2023-12-26 08:48:29,153][123091] Updated weights for policy 0, policy_version 1154441 (0.0007) [2023-12-26 08:48:29,989][123091] Updated weights for policy 0, policy_version 1154451 (0.0006) [2023-12-26 08:48:29,989][123090] Updated weights for policy 1, policy_version 1146181 (0.0009) [2023-12-26 08:48:30,053][123090] Updated weights for policy 1, policy_version 1146191 (0.0007) [2023-12-26 08:48:30,056][123091] Updated weights for policy 0, policy_version 1154461 (0.0007) [2023-12-26 08:48:30,119][123090] Updated weights for policy 1, policy_version 1146201 (0.0006) [2023-12-26 08:48:30,121][123091] Updated weights for policy 0, policy_version 1154471 (0.0008) [2023-12-26 08:48:30,876][123090] Updated weights for policy 1, policy_version 1146211 (0.0006) [2023-12-26 08:48:30,905][123091] Updated weights for policy 0, policy_version 1154481 (0.0010) [2023-12-26 08:48:30,929][123090] Updated weights for policy 1, policy_version 1146221 (0.0007) [2023-12-26 08:48:30,956][123091] Updated weights for policy 0, policy_version 1154491 (0.0010) [2023-12-26 08:48:30,980][123090] Updated weights for policy 1, policy_version 1146231 (0.0005) [2023-12-26 08:48:31,009][123091] Updated weights for policy 0, policy_version 1154501 (0.0010) [2023-12-26 08:48:31,072][123091] Updated weights for policy 0, policy_version 1154511 (0.0011) [2023-12-26 08:48:31,797][123090] Updated weights for policy 1, policy_version 1146241 (0.0009) [2023-12-26 08:48:31,843][123091] Updated weights for policy 0, policy_version 1154521 (0.0006) [2023-12-26 08:48:31,862][123090] Updated weights for policy 1, policy_version 1146251 (0.0009) [2023-12-26 08:48:31,904][123091] Updated weights for policy 0, policy_version 1154531 (0.0005) [2023-12-26 08:48:31,924][123090] Updated weights for policy 1, policy_version 1146261 (0.0008) [2023-12-26 08:48:31,965][123091] Updated weights for policy 0, policy_version 1154541 (0.0010) [2023-12-26 08:48:31,981][123090] Updated weights for policy 1, policy_version 1146271 (0.0007) [2023-12-26 08:48:32,726][123091] Updated weights for policy 0, policy_version 1154551 (0.0010) [2023-12-26 08:48:32,777][123091] Updated weights for policy 0, policy_version 1154561 (0.0010) [2023-12-26 08:48:32,815][123090] Updated weights for policy 1, policy_version 1146281 (0.0010) [2023-12-26 08:48:32,835][123091] Updated weights for policy 0, policy_version 1154571 (0.0010) [2023-12-26 08:48:32,876][123090] Updated weights for policy 1, policy_version 1146291 (0.0007) [2023-12-26 08:48:32,943][123090] Updated weights for policy 1, policy_version 1146301 (0.0008) [2023-12-26 08:48:33,556][123091] Updated weights for policy 0, policy_version 1154581 (0.0008) [2023-12-26 08:48:33,611][123091] Updated weights for policy 0, policy_version 1154591 (0.0006) [2023-12-26 08:48:33,655][123091] Updated weights for policy 0, policy_version 1154601 (0.0005) [2023-12-26 08:48:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 589037568. Throughput: 0: 9223.4, 1: 8562.7. Samples: 589049908. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:33,785][121949] Avg episode reward: [(0, '6133.190'), (1, '5371.058')] [2023-12-26 08:48:33,821][123090] Updated weights for policy 1, policy_version 1146311 (0.0009) [2023-12-26 08:48:33,874][123090] Updated weights for policy 1, policy_version 1146322 (0.0010) [2023-12-26 08:48:33,928][123090] Updated weights for policy 1, policy_version 1146333 (0.0010) [2023-12-26 08:48:34,259][123091] Updated weights for policy 0, policy_version 1154611 (0.0006) [2023-12-26 08:48:34,331][123091] Updated weights for policy 0, policy_version 1154621 (0.0007) [2023-12-26 08:48:34,401][123091] Updated weights for policy 0, policy_version 1154631 (0.0007) [2023-12-26 08:48:34,885][123090] Updated weights for policy 1, policy_version 1146343 (0.0009) [2023-12-26 08:48:34,951][123090] Updated weights for policy 1, policy_version 1146353 (0.0009) [2023-12-26 08:48:35,016][123090] Updated weights for policy 1, policy_version 1146363 (0.0008) [2023-12-26 08:48:35,088][123091] Updated weights for policy 0, policy_version 1154641 (0.0006) [2023-12-26 08:48:35,152][123091] Updated weights for policy 0, policy_version 1154651 (0.0005) [2023-12-26 08:48:35,217][123091] Updated weights for policy 0, policy_version 1154661 (0.0005) [2023-12-26 08:48:35,280][123091] Updated weights for policy 0, policy_version 1154671 (0.0006) [2023-12-26 08:48:35,902][123090] Updated weights for policy 1, policy_version 1146373 (0.0009) [2023-12-26 08:48:35,957][123090] Updated weights for policy 1, policy_version 1146383 (0.0009) [2023-12-26 08:48:35,960][123091] Updated weights for policy 0, policy_version 1154681 (0.0005) [2023-12-26 08:48:36,018][123090] Updated weights for policy 1, policy_version 1146393 (0.0007) [2023-12-26 08:48:36,020][123091] Updated weights for policy 0, policy_version 1154691 (0.0008) [2023-12-26 08:48:36,082][123091] Updated weights for policy 0, policy_version 1154701 (0.0010) [2023-12-26 08:48:36,886][123090] Updated weights for policy 1, policy_version 1146403 (0.0009) [2023-12-26 08:48:36,911][123091] Updated weights for policy 0, policy_version 1154711 (0.0010) [2023-12-26 08:48:36,940][123090] Updated weights for policy 1, policy_version 1146413 (0.0009) [2023-12-26 08:48:36,963][123091] Updated weights for policy 0, policy_version 1154721 (0.0010) [2023-12-26 08:48:36,992][123090] Updated weights for policy 1, policy_version 1146423 (0.0006) [2023-12-26 08:48:37,022][123091] Updated weights for policy 0, policy_version 1154731 (0.0010) [2023-12-26 08:48:37,845][123090] Updated weights for policy 1, policy_version 1146433 (0.0008) [2023-12-26 08:48:37,871][123091] Updated weights for policy 0, policy_version 1154741 (0.0011) [2023-12-26 08:48:37,907][123090] Updated weights for policy 1, policy_version 1146443 (0.0010) [2023-12-26 08:48:37,934][123091] Updated weights for policy 0, policy_version 1154751 (0.0011) [2023-12-26 08:48:37,963][123090] Updated weights for policy 1, policy_version 1146453 (0.0007) [2023-12-26 08:48:37,994][123091] Updated weights for policy 0, policy_version 1154761 (0.0010) [2023-12-26 08:48:38,018][123090] Updated weights for policy 1, policy_version 1146463 (0.0009) [2023-12-26 08:48:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 589119488. Throughput: 0: 9287.5, 1: 8487.8. Samples: 589103304. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:38,785][121949] Avg episode reward: [(0, '6183.274'), (1, '5344.915')] [2023-12-26 08:48:38,789][123091] Updated weights for policy 0, policy_version 1154771 (0.0009) [2023-12-26 08:48:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001146464_293494784.pth... [2023-12-26 08:48:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001145504_293249024.pth [2023-12-26 08:48:38,852][123091] Updated weights for policy 0, policy_version 1154781 (0.0011) [2023-12-26 08:48:38,880][123090] Updated weights for policy 1, policy_version 1146473 (0.0007) [2023-12-26 08:48:38,910][123091] Updated weights for policy 0, policy_version 1154791 (0.0011) [2023-12-26 08:48:38,933][123090] Updated weights for policy 1, policy_version 1146483 (0.0008) [2023-12-26 08:48:38,965][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001154800_295632896.pth... [2023-12-26 08:48:38,969][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001153712_295354368.pth [2023-12-26 08:48:38,992][123090] Updated weights for policy 1, policy_version 1146493 (0.0008) [2023-12-26 08:48:39,750][123091] Updated weights for policy 0, policy_version 1154801 (0.0011) [2023-12-26 08:48:39,819][123091] Updated weights for policy 0, policy_version 1154811 (0.0011) [2023-12-26 08:48:39,883][123090] Updated weights for policy 1, policy_version 1146503 (0.0008) [2023-12-26 08:48:39,885][123091] Updated weights for policy 0, policy_version 1154821 (0.0010) [2023-12-26 08:48:39,949][123090] Updated weights for policy 1, policy_version 1146513 (0.0009) [2023-12-26 08:48:39,955][123091] Updated weights for policy 0, policy_version 1154831 (0.0010) [2023-12-26 08:48:40,016][123090] Updated weights for policy 1, policy_version 1146523 (0.0010) [2023-12-26 08:48:40,686][123091] Updated weights for policy 0, policy_version 1154841 (0.0010) [2023-12-26 08:48:40,750][123091] Updated weights for policy 0, policy_version 1154851 (0.0011) [2023-12-26 08:48:40,813][123091] Updated weights for policy 0, policy_version 1154861 (0.0011) [2023-12-26 08:48:40,896][123090] Updated weights for policy 1, policy_version 1146533 (0.0009) [2023-12-26 08:48:40,965][123090] Updated weights for policy 1, policy_version 1146543 (0.0009) [2023-12-26 08:48:41,029][123090] Updated weights for policy 1, policy_version 1146553 (0.0009) [2023-12-26 08:48:41,592][123091] Updated weights for policy 0, policy_version 1154871 (0.0007) [2023-12-26 08:48:41,669][123091] Updated weights for policy 0, policy_version 1154881 (0.0008) [2023-12-26 08:48:41,740][123091] Updated weights for policy 0, policy_version 1154891 (0.0009) [2023-12-26 08:48:41,904][123090] Updated weights for policy 1, policy_version 1146563 (0.0008) [2023-12-26 08:48:41,970][123090] Updated weights for policy 1, policy_version 1146573 (0.0008) [2023-12-26 08:48:42,041][123090] Updated weights for policy 1, policy_version 1146583 (0.0008) [2023-12-26 08:48:42,551][123091] Updated weights for policy 0, policy_version 1154901 (0.0007) [2023-12-26 08:48:42,621][123091] Updated weights for policy 0, policy_version 1154911 (0.0007) [2023-12-26 08:48:42,676][123091] Updated weights for policy 0, policy_version 1154921 (0.0009) [2023-12-26 08:48:42,797][123090] Updated weights for policy 1, policy_version 1146593 (0.0008) [2023-12-26 08:48:42,852][123090] Updated weights for policy 1, policy_version 1146603 (0.0008) [2023-12-26 08:48:42,906][123090] Updated weights for policy 1, policy_version 1146613 (0.0008) [2023-12-26 08:48:42,960][123090] Updated weights for policy 1, policy_version 1146623 (0.0008) [2023-12-26 08:48:43,459][123091] Updated weights for policy 0, policy_version 1154931 (0.0007) [2023-12-26 08:48:43,503][123091] Updated weights for policy 0, policy_version 1154941 (0.0005) [2023-12-26 08:48:43,556][123091] Updated weights for policy 0, policy_version 1154951 (0.0005) [2023-12-26 08:48:43,755][123090] Updated weights for policy 1, policy_version 1146633 (0.0006) [2023-12-26 08:48:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 589209600. Throughput: 0: 9239.1, 1: 8326.1. Samples: 589204648. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:43,784][121949] Avg episode reward: [(0, '6265.414'), (1, '5280.647')] [2023-12-26 08:48:43,804][123090] Updated weights for policy 1, policy_version 1146643 (0.0005) [2023-12-26 08:48:43,851][123090] Updated weights for policy 1, policy_version 1146653 (0.0005) [2023-12-26 08:48:44,401][123091] Updated weights for policy 0, policy_version 1154961 (0.0007) [2023-12-26 08:48:44,466][123091] Updated weights for policy 0, policy_version 1154971 (0.0009) [2023-12-26 08:48:44,525][123091] Updated weights for policy 0, policy_version 1154981 (0.0008) [2023-12-26 08:48:44,589][123091] Updated weights for policy 0, policy_version 1154991 (0.0008) [2023-12-26 08:48:44,662][123090] Updated weights for policy 1, policy_version 1146663 (0.0009) [2023-12-26 08:48:44,732][123090] Updated weights for policy 1, policy_version 1146673 (0.0010) [2023-12-26 08:48:44,806][123090] Updated weights for policy 1, policy_version 1146683 (0.0009) [2023-12-26 08:48:45,418][123091] Updated weights for policy 0, policy_version 1155001 (0.0010) [2023-12-26 08:48:45,467][123091] Updated weights for policy 0, policy_version 1155011 (0.0009) [2023-12-26 08:48:45,518][123091] Updated weights for policy 0, policy_version 1155022 (0.0010) [2023-12-26 08:48:45,668][123090] Updated weights for policy 1, policy_version 1146693 (0.0009) [2023-12-26 08:48:45,737][123090] Updated weights for policy 1, policy_version 1146703 (0.0010) [2023-12-26 08:48:45,799][123090] Updated weights for policy 1, policy_version 1146713 (0.0010) [2023-12-26 08:48:46,404][123091] Updated weights for policy 0, policy_version 1155032 (0.0006) [2023-12-26 08:48:46,475][123091] Updated weights for policy 0, policy_version 1155042 (0.0005) [2023-12-26 08:48:46,526][123091] Updated weights for policy 0, policy_version 1155052 (0.0005) [2023-12-26 08:48:46,639][123090] Updated weights for policy 1, policy_version 1146723 (0.0009) [2023-12-26 08:48:46,702][123090] Updated weights for policy 1, policy_version 1146733 (0.0009) [2023-12-26 08:48:46,765][123090] Updated weights for policy 1, policy_version 1146743 (0.0009) [2023-12-26 08:48:47,217][123091] Updated weights for policy 0, policy_version 1155063 (0.0008) [2023-12-26 08:48:47,271][123091] Updated weights for policy 0, policy_version 1155073 (0.0009) [2023-12-26 08:48:47,321][123091] Updated weights for policy 0, policy_version 1155083 (0.0009) [2023-12-26 08:48:47,610][123090] Updated weights for policy 1, policy_version 1146753 (0.0009) [2023-12-26 08:48:47,676][123090] Updated weights for policy 1, policy_version 1146763 (0.0009) [2023-12-26 08:48:47,743][123090] Updated weights for policy 1, policy_version 1146773 (0.0009) [2023-12-26 08:48:47,812][123090] Updated weights for policy 1, policy_version 1146783 (0.0009) [2023-12-26 08:48:48,167][123091] Updated weights for policy 0, policy_version 1155093 (0.0010) [2023-12-26 08:48:48,234][123091] Updated weights for policy 0, policy_version 1155103 (0.0010) [2023-12-26 08:48:48,300][123091] Updated weights for policy 0, policy_version 1155113 (0.0010) [2023-12-26 08:48:48,620][123090] Updated weights for policy 1, policy_version 1146793 (0.0010) [2023-12-26 08:48:48,676][123090] Updated weights for policy 1, policy_version 1146803 (0.0009) [2023-12-26 08:48:48,741][123090] Updated weights for policy 1, policy_version 1146813 (0.0008) [2023-12-26 08:48:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 589299712. Throughput: 0: 9164.3, 1: 8342.3. Samples: 589308576. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:48,785][121949] Avg episode reward: [(0, '6326.354'), (1, '5365.047')] [2023-12-26 08:48:49,167][123091] Updated weights for policy 0, policy_version 1155123 (0.0009) [2023-12-26 08:48:49,229][123091] Updated weights for policy 0, policy_version 1155133 (0.0009) [2023-12-26 08:48:49,298][123091] Updated weights for policy 0, policy_version 1155143 (0.0010) [2023-12-26 08:48:49,573][123090] Updated weights for policy 1, policy_version 1146823 (0.0009) [2023-12-26 08:48:49,631][123090] Updated weights for policy 1, policy_version 1146833 (0.0010) [2023-12-26 08:48:49,693][123090] Updated weights for policy 1, policy_version 1146843 (0.0009) [2023-12-26 08:48:50,118][123091] Updated weights for policy 0, policy_version 1155153 (0.0010) [2023-12-26 08:48:50,178][123091] Updated weights for policy 0, policy_version 1155163 (0.0010) [2023-12-26 08:48:50,232][123091] Updated weights for policy 0, policy_version 1155173 (0.0009) [2023-12-26 08:48:50,285][123091] Updated weights for policy 0, policy_version 1155183 (0.0009) [2023-12-26 08:48:50,567][123090] Updated weights for policy 1, policy_version 1146853 (0.0009) [2023-12-26 08:48:50,630][123090] Updated weights for policy 1, policy_version 1146863 (0.0009) [2023-12-26 08:48:50,689][123090] Updated weights for policy 1, policy_version 1146873 (0.0009) [2023-12-26 08:48:51,080][123091] Updated weights for policy 0, policy_version 1155193 (0.0008) [2023-12-26 08:48:51,152][123091] Updated weights for policy 0, policy_version 1155203 (0.0009) [2023-12-26 08:48:51,222][123091] Updated weights for policy 0, policy_version 1155213 (0.0011) [2023-12-26 08:48:51,472][123090] Updated weights for policy 1, policy_version 1146883 (0.0007) [2023-12-26 08:48:51,525][123090] Updated weights for policy 1, policy_version 1146893 (0.0009) [2023-12-26 08:48:51,585][123090] Updated weights for policy 1, policy_version 1146904 (0.0010) [2023-12-26 08:48:52,054][123091] Updated weights for policy 0, policy_version 1155223 (0.0010) [2023-12-26 08:48:52,109][123091] Updated weights for policy 0, policy_version 1155234 (0.0009) [2023-12-26 08:48:52,158][123091] Updated weights for policy 0, policy_version 1155244 (0.0009) [2023-12-26 08:48:52,459][123090] Updated weights for policy 1, policy_version 1146914 (0.0009) [2023-12-26 08:48:52,511][123090] Updated weights for policy 1, policy_version 1146924 (0.0009) [2023-12-26 08:48:52,571][123090] Updated weights for policy 1, policy_version 1146934 (0.0009) [2023-12-26 08:48:52,642][123090] Updated weights for policy 1, policy_version 1146944 (0.0009) [2023-12-26 08:48:52,978][123091] Updated weights for policy 0, policy_version 1155254 (0.0010) [2023-12-26 08:48:53,034][123091] Updated weights for policy 0, policy_version 1155264 (0.0010) [2023-12-26 08:48:53,096][123091] Updated weights for policy 0, policy_version 1155274 (0.0011) [2023-12-26 08:48:53,453][123090] Updated weights for policy 1, policy_version 1146954 (0.0010) [2023-12-26 08:48:53,509][123090] Updated weights for policy 1, policy_version 1146964 (0.0010) [2023-12-26 08:48:53,567][123090] Updated weights for policy 1, policy_version 1146974 (0.0010) [2023-12-26 08:48:53,782][123091] Updated weights for policy 0, policy_version 1155284 (0.0009) [2023-12-26 08:48:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 589381632. Throughput: 0: 9101.1, 1: 8345.5. Samples: 589359352. Policy #0 lag: (min: 31.0, avg: 37.0, max: 63.0) [2023-12-26 08:48:53,785][121949] Avg episode reward: [(0, '6190.457'), (1, '5593.763')] [2023-12-26 08:48:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001146976_293625856.pth... [2023-12-26 08:48:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001145984_293371904.pth [2023-12-26 08:48:53,832][123091] Updated weights for policy 0, policy_version 1155294 (0.0010) [2023-12-26 08:48:53,884][123091] Updated weights for policy 0, policy_version 1155304 (0.0010) [2023-12-26 08:48:53,922][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001155312_295763968.pth... [2023-12-26 08:48:53,925][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001154224_295485440.pth [2023-12-26 08:48:54,275][123090] Updated weights for policy 1, policy_version 1146984 (0.0008) [2023-12-26 08:48:54,348][123090] Updated weights for policy 1, policy_version 1146994 (0.0007) [2023-12-26 08:48:54,411][123090] Updated weights for policy 1, policy_version 1147004 (0.0010) [2023-12-26 08:48:54,648][123091] Updated weights for policy 0, policy_version 1155314 (0.0009) [2023-12-26 08:48:54,697][123091] Updated weights for policy 0, policy_version 1155324 (0.0008) [2023-12-26 08:48:54,745][123091] Updated weights for policy 0, policy_version 1155334 (0.0010) [2023-12-26 08:48:54,799][123091] Updated weights for policy 0, policy_version 1155344 (0.0010) [2023-12-26 08:48:55,164][123090] Updated weights for policy 1, policy_version 1147014 (0.0007) [2023-12-26 08:48:55,209][123090] Updated weights for policy 1, policy_version 1147024 (0.0005) [2023-12-26 08:48:55,264][123090] Updated weights for policy 1, policy_version 1147034 (0.0010) [2023-12-26 08:48:55,578][123091] Updated weights for policy 0, policy_version 1155354 (0.0006) [2023-12-26 08:48:55,625][123091] Updated weights for policy 0, policy_version 1155364 (0.0010) [2023-12-26 08:48:55,672][123091] Updated weights for policy 0, policy_version 1155374 (0.0010) [2023-12-26 08:48:56,084][123090] Updated weights for policy 1, policy_version 1147044 (0.0010) [2023-12-26 08:48:56,147][123090] Updated weights for policy 1, policy_version 1147054 (0.0010) [2023-12-26 08:48:56,222][123090] Updated weights for policy 1, policy_version 1147064 (0.0011) [2023-12-26 08:48:56,437][123091] Updated weights for policy 0, policy_version 1155384 (0.0010) [2023-12-26 08:48:56,483][123091] Updated weights for policy 0, policy_version 1155394 (0.0010) [2023-12-26 08:48:56,533][123091] Updated weights for policy 0, policy_version 1155404 (0.0010) [2023-12-26 08:48:56,934][123090] Updated weights for policy 1, policy_version 1147074 (0.0010) [2023-12-26 08:48:56,994][123090] Updated weights for policy 1, policy_version 1147084 (0.0009) [2023-12-26 08:48:57,047][123090] Updated weights for policy 1, policy_version 1147094 (0.0007) [2023-12-26 08:48:57,094][123090] Updated weights for policy 1, policy_version 1147104 (0.0005) [2023-12-26 08:48:57,370][123091] Updated weights for policy 0, policy_version 1155414 (0.0008) [2023-12-26 08:48:57,435][123091] Updated weights for policy 0, policy_version 1155424 (0.0010) [2023-12-26 08:48:57,497][123091] Updated weights for policy 0, policy_version 1155434 (0.0010) [2023-12-26 08:48:57,811][123090] Updated weights for policy 1, policy_version 1147114 (0.0006) [2023-12-26 08:48:57,860][123090] Updated weights for policy 1, policy_version 1147124 (0.0005) [2023-12-26 08:48:57,911][123090] Updated weights for policy 1, policy_version 1147134 (0.0005) [2023-12-26 08:48:58,289][123091] Updated weights for policy 0, policy_version 1155444 (0.0010) [2023-12-26 08:48:58,354][123091] Updated weights for policy 0, policy_version 1155454 (0.0010) [2023-12-26 08:48:58,422][123091] Updated weights for policy 0, policy_version 1155464 (0.0010) [2023-12-26 08:48:58,699][123090] Updated weights for policy 1, policy_version 1147144 (0.0008) [2023-12-26 08:48:58,762][123090] Updated weights for policy 1, policy_version 1147154 (0.0008) [2023-12-26 08:48:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 589471744. Throughput: 0: 9105.5, 1: 8470.5. Samples: 589468704. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:48:58,785][121949] Avg episode reward: [(0, '6216.463'), (1, '5574.562')] [2023-12-26 08:48:58,824][123090] Updated weights for policy 1, policy_version 1147164 (0.0008) [2023-12-26 08:48:59,260][123091] Updated weights for policy 0, policy_version 1155474 (0.0010) [2023-12-26 08:48:59,319][123091] Updated weights for policy 0, policy_version 1155484 (0.0009) [2023-12-26 08:48:59,388][123091] Updated weights for policy 0, policy_version 1155494 (0.0010) [2023-12-26 08:48:59,445][123091] Updated weights for policy 0, policy_version 1155504 (0.0010) [2023-12-26 08:48:59,627][123090] Updated weights for policy 1, policy_version 1147174 (0.0009) [2023-12-26 08:48:59,689][123090] Updated weights for policy 1, policy_version 1147184 (0.0010) [2023-12-26 08:48:59,748][123090] Updated weights for policy 1, policy_version 1147194 (0.0010) [2023-12-26 08:49:00,298][123091] Updated weights for policy 0, policy_version 1155514 (0.0009) [2023-12-26 08:49:00,364][123091] Updated weights for policy 0, policy_version 1155524 (0.0006) [2023-12-26 08:49:00,425][123091] Updated weights for policy 0, policy_version 1155534 (0.0005) [2023-12-26 08:49:00,553][123090] Updated weights for policy 1, policy_version 1147204 (0.0008) [2023-12-26 08:49:00,606][123090] Updated weights for policy 1, policy_version 1147214 (0.0005) [2023-12-26 08:49:00,659][123090] Updated weights for policy 1, policy_version 1147224 (0.0005) [2023-12-26 08:49:01,101][123091] Updated weights for policy 0, policy_version 1155544 (0.0007) [2023-12-26 08:49:01,175][123091] Updated weights for policy 0, policy_version 1155556 (0.0010) [2023-12-26 08:49:01,234][123091] Updated weights for policy 0, policy_version 1155566 (0.0005) [2023-12-26 08:49:01,372][123090] Updated weights for policy 1, policy_version 1147234 (0.0006) [2023-12-26 08:49:01,441][123090] Updated weights for policy 1, policy_version 1147244 (0.0007) [2023-12-26 08:49:01,512][123090] Updated weights for policy 1, policy_version 1147254 (0.0005) [2023-12-26 08:49:01,581][123090] Updated weights for policy 1, policy_version 1147264 (0.0005) [2023-12-26 08:49:02,032][123091] Updated weights for policy 0, policy_version 1155576 (0.0010) [2023-12-26 08:49:02,088][123091] Updated weights for policy 0, policy_version 1155586 (0.0010) [2023-12-26 08:49:02,136][123091] Updated weights for policy 0, policy_version 1155596 (0.0010) [2023-12-26 08:49:02,400][123090] Updated weights for policy 1, policy_version 1147274 (0.0009) [2023-12-26 08:49:02,456][123090] Updated weights for policy 1, policy_version 1147284 (0.0008) [2023-12-26 08:49:02,521][123090] Updated weights for policy 1, policy_version 1147294 (0.0008) [2023-12-26 08:49:02,943][123091] Updated weights for policy 0, policy_version 1155606 (0.0007) [2023-12-26 08:49:03,003][123091] Updated weights for policy 0, policy_version 1155616 (0.0005) [2023-12-26 08:49:03,060][123091] Updated weights for policy 0, policy_version 1155626 (0.0005) [2023-12-26 08:49:03,406][123090] Updated weights for policy 1, policy_version 1147304 (0.0009) [2023-12-26 08:49:03,463][123090] Updated weights for policy 1, policy_version 1147314 (0.0010) [2023-12-26 08:49:03,529][123090] Updated weights for policy 1, policy_version 1147324 (0.0010) [2023-12-26 08:49:03,645][123091] Updated weights for policy 0, policy_version 1155636 (0.0005) [2023-12-26 08:49:03,696][123091] Updated weights for policy 0, policy_version 1155646 (0.0005) [2023-12-26 08:49:03,752][123091] Updated weights for policy 0, policy_version 1155656 (0.0005) [2023-12-26 08:49:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 589561856. Throughput: 0: 9098.1, 1: 8474.3. Samples: 589576212. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:03,785][121949] Avg episode reward: [(0, '6303.881'), (1, '5669.266')] [2023-12-26 08:49:04,407][123090] Updated weights for policy 1, policy_version 1147335 (0.0009) [2023-12-26 08:49:04,471][123090] Updated weights for policy 1, policy_version 1147345 (0.0009) [2023-12-26 08:49:04,535][123090] Updated weights for policy 1, policy_version 1147355 (0.0009) [2023-12-26 08:49:04,553][123091] Updated weights for policy 0, policy_version 1155666 (0.0006) [2023-12-26 08:49:04,616][123091] Updated weights for policy 0, policy_version 1155676 (0.0010) [2023-12-26 08:49:04,678][123091] Updated weights for policy 0, policy_version 1155686 (0.0010) [2023-12-26 08:49:04,751][123091] Updated weights for policy 0, policy_version 1155696 (0.0010) [2023-12-26 08:49:05,314][123090] Updated weights for policy 1, policy_version 1147365 (0.0009) [2023-12-26 08:49:05,366][123090] Updated weights for policy 1, policy_version 1147375 (0.0008) [2023-12-26 08:49:05,420][123090] Updated weights for policy 1, policy_version 1147385 (0.0009) [2023-12-26 08:49:05,550][123091] Updated weights for policy 0, policy_version 1155706 (0.0010) [2023-12-26 08:49:05,616][123091] Updated weights for policy 0, policy_version 1155716 (0.0010) [2023-12-26 08:49:05,686][123091] Updated weights for policy 0, policy_version 1155726 (0.0007) [2023-12-26 08:49:06,317][123090] Updated weights for policy 1, policy_version 1147395 (0.0009) [2023-12-26 08:49:06,361][123091] Updated weights for policy 0, policy_version 1155736 (0.0010) [2023-12-26 08:49:06,380][123090] Updated weights for policy 1, policy_version 1147405 (0.0006) [2023-12-26 08:49:06,420][123091] Updated weights for policy 0, policy_version 1155746 (0.0011) [2023-12-26 08:49:06,453][123090] Updated weights for policy 1, policy_version 1147415 (0.0007) [2023-12-26 08:49:06,480][123091] Updated weights for policy 0, policy_version 1155756 (0.0011) [2023-12-26 08:49:07,177][123091] Updated weights for policy 0, policy_version 1155766 (0.0010) [2023-12-26 08:49:07,233][123091] Updated weights for policy 0, policy_version 1155776 (0.0011) [2023-12-26 08:49:07,296][123091] Updated weights for policy 0, policy_version 1155786 (0.0010) [2023-12-26 08:49:07,297][123090] Updated weights for policy 1, policy_version 1147425 (0.0006) [2023-12-26 08:49:07,359][123090] Updated weights for policy 1, policy_version 1147435 (0.0008) [2023-12-26 08:49:07,424][123090] Updated weights for policy 1, policy_version 1147445 (0.0009) [2023-12-26 08:49:07,484][123090] Updated weights for policy 1, policy_version 1147455 (0.0009) [2023-12-26 08:49:08,020][123091] Updated weights for policy 0, policy_version 1155796 (0.0008) [2023-12-26 08:49:08,092][123091] Updated weights for policy 0, policy_version 1155806 (0.0005) [2023-12-26 08:49:08,164][123091] Updated weights for policy 0, policy_version 1155816 (0.0008) [2023-12-26 08:49:08,375][123090] Updated weights for policy 1, policy_version 1147465 (0.0008) [2023-12-26 08:49:08,436][123090] Updated weights for policy 1, policy_version 1147475 (0.0010) [2023-12-26 08:49:08,498][123090] Updated weights for policy 1, policy_version 1147485 (0.0010) [2023-12-26 08:49:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 589651968. Throughput: 0: 9123.3, 1: 8491.2. Samples: 589628392. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:08,785][121949] Avg episode reward: [(0, '6304.546'), (1, '5610.057')] [2023-12-26 08:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001147488_293756928.pth... [2023-12-26 08:49:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001155824_295895040.pth... [2023-12-26 08:49:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001154800_295632896.pth [2023-12-26 08:49:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001146464_293494784.pth [2023-12-26 08:49:08,877][123091] Updated weights for policy 0, policy_version 1155826 (0.0006) [2023-12-26 08:49:08,940][123091] Updated weights for policy 0, policy_version 1155836 (0.0008) [2023-12-26 08:49:08,996][123091] Updated weights for policy 0, policy_version 1155846 (0.0005) [2023-12-26 08:49:09,060][123091] Updated weights for policy 0, policy_version 1155856 (0.0009) [2023-12-26 08:49:09,450][123090] Updated weights for policy 1, policy_version 1147495 (0.0010) [2023-12-26 08:49:09,515][123090] Updated weights for policy 1, policy_version 1147505 (0.0011) [2023-12-26 08:49:09,582][123090] Updated weights for policy 1, policy_version 1147515 (0.0011) [2023-12-26 08:49:09,800][123091] Updated weights for policy 0, policy_version 1155866 (0.0007) [2023-12-26 08:49:09,866][123091] Updated weights for policy 0, policy_version 1155876 (0.0008) [2023-12-26 08:49:09,930][123091] Updated weights for policy 0, policy_version 1155886 (0.0008) [2023-12-26 08:49:10,452][123090] Updated weights for policy 1, policy_version 1147525 (0.0010) [2023-12-26 08:49:10,525][123090] Updated weights for policy 1, policy_version 1147535 (0.0009) [2023-12-26 08:49:10,594][123090] Updated weights for policy 1, policy_version 1147545 (0.0009) [2023-12-26 08:49:10,704][123091] Updated weights for policy 0, policy_version 1155896 (0.0010) [2023-12-26 08:49:10,765][123091] Updated weights for policy 0, policy_version 1155906 (0.0010) [2023-12-26 08:49:10,818][123091] Updated weights for policy 0, policy_version 1155916 (0.0010) [2023-12-26 08:49:11,454][123090] Updated weights for policy 1, policy_version 1147555 (0.0009) [2023-12-26 08:49:11,511][123090] Updated weights for policy 1, policy_version 1147565 (0.0009) [2023-12-26 08:49:11,571][123090] Updated weights for policy 1, policy_version 1147575 (0.0009) [2023-12-26 08:49:11,643][123091] Updated weights for policy 0, policy_version 1155926 (0.0009) [2023-12-26 08:49:11,718][123091] Updated weights for policy 0, policy_version 1155936 (0.0008) [2023-12-26 08:49:11,786][123091] Updated weights for policy 0, policy_version 1155946 (0.0009) [2023-12-26 08:49:12,481][123090] Updated weights for policy 1, policy_version 1147585 (0.0009) [2023-12-26 08:49:12,540][123090] Updated weights for policy 1, policy_version 1147596 (0.0010) [2023-12-26 08:49:12,602][123091] Updated weights for policy 0, policy_version 1155956 (0.0009) [2023-12-26 08:49:12,606][123090] Updated weights for policy 1, policy_version 1147606 (0.0008) [2023-12-26 08:49:12,667][123091] Updated weights for policy 0, policy_version 1155966 (0.0010) [2023-12-26 08:49:12,673][123090] Updated weights for policy 1, policy_version 1147616 (0.0007) [2023-12-26 08:49:12,733][123091] Updated weights for policy 0, policy_version 1155976 (0.0009) [2023-12-26 08:49:13,384][123090] Updated weights for policy 1, policy_version 1147626 (0.0005) [2023-12-26 08:49:13,437][123090] Updated weights for policy 1, policy_version 1147636 (0.0005) [2023-12-26 08:49:13,493][123090] Updated weights for policy 1, policy_version 1147646 (0.0005) [2023-12-26 08:49:13,608][123091] Updated weights for policy 0, policy_version 1155986 (0.0010) [2023-12-26 08:49:13,665][123091] Updated weights for policy 0, policy_version 1155996 (0.0010) [2023-12-26 08:49:13,722][123091] Updated weights for policy 0, policy_version 1156006 (0.0010) [2023-12-26 08:49:13,777][123091] Updated weights for policy 0, policy_version 1156016 (0.0009) [2023-12-26 08:49:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 589742080. Throughput: 0: 9067.8, 1: 8444.6. Samples: 589731296. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:13,784][121949] Avg episode reward: [(0, '6336.095'), (1, '5259.866')] [2023-12-26 08:49:14,256][123090] Updated weights for policy 1, policy_version 1147656 (0.0008) [2023-12-26 08:49:14,321][123090] Updated weights for policy 1, policy_version 1147666 (0.0010) [2023-12-26 08:49:14,374][123090] Updated weights for policy 1, policy_version 1147677 (0.0009) [2023-12-26 08:49:14,519][123091] Updated weights for policy 0, policy_version 1156026 (0.0007) [2023-12-26 08:49:14,573][123091] Updated weights for policy 0, policy_version 1156036 (0.0006) [2023-12-26 08:49:14,636][123091] Updated weights for policy 0, policy_version 1156046 (0.0006) [2023-12-26 08:49:15,254][123090] Updated weights for policy 1, policy_version 1147687 (0.0010) [2023-12-26 08:49:15,315][123090] Updated weights for policy 1, policy_version 1147697 (0.0010) [2023-12-26 08:49:15,382][123090] Updated weights for policy 1, policy_version 1147707 (0.0009) [2023-12-26 08:49:15,413][123091] Updated weights for policy 0, policy_version 1156056 (0.0006) [2023-12-26 08:49:15,470][123091] Updated weights for policy 0, policy_version 1156066 (0.0009) [2023-12-26 08:49:15,522][123091] Updated weights for policy 0, policy_version 1156076 (0.0009) [2023-12-26 08:49:16,222][123091] Updated weights for policy 0, policy_version 1156086 (0.0007) [2023-12-26 08:49:16,293][123091] Updated weights for policy 0, policy_version 1156096 (0.0006) [2023-12-26 08:49:16,294][123090] Updated weights for policy 1, policy_version 1147717 (0.0008) [2023-12-26 08:49:16,363][123091] Updated weights for policy 0, policy_version 1156106 (0.0006) [2023-12-26 08:49:16,364][123090] Updated weights for policy 1, policy_version 1147727 (0.0008) [2023-12-26 08:49:16,431][123090] Updated weights for policy 1, policy_version 1147737 (0.0009) [2023-12-26 08:49:17,060][123091] Updated weights for policy 0, policy_version 1156116 (0.0007) [2023-12-26 08:49:17,128][123091] Updated weights for policy 0, policy_version 1156126 (0.0010) [2023-12-26 08:49:17,192][123091] Updated weights for policy 0, policy_version 1156136 (0.0009) [2023-12-26 08:49:17,259][123090] Updated weights for policy 1, policy_version 1147747 (0.0008) [2023-12-26 08:49:17,329][123090] Updated weights for policy 1, policy_version 1147757 (0.0007) [2023-12-26 08:49:17,402][123090] Updated weights for policy 1, policy_version 1147767 (0.0010) [2023-12-26 08:49:17,993][123091] Updated weights for policy 0, policy_version 1156146 (0.0009) [2023-12-26 08:49:18,058][123091] Updated weights for policy 0, policy_version 1156156 (0.0010) [2023-12-26 08:49:18,124][123091] Updated weights for policy 0, policy_version 1156166 (0.0009) [2023-12-26 08:49:18,186][123090] Updated weights for policy 1, policy_version 1147777 (0.0009) [2023-12-26 08:49:18,189][123091] Updated weights for policy 0, policy_version 1156176 (0.0008) [2023-12-26 08:49:18,244][123090] Updated weights for policy 1, policy_version 1147787 (0.0009) [2023-12-26 08:49:18,313][123090] Updated weights for policy 1, policy_version 1147797 (0.0009) [2023-12-26 08:49:18,378][123090] Updated weights for policy 1, policy_version 1147807 (0.0010) [2023-12-26 08:49:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 589824000. Throughput: 0: 9011.4, 1: 8471.8. Samples: 589836652. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:18,785][121949] Avg episode reward: [(0, '6243.446'), (1, '5040.656')] [2023-12-26 08:49:19,001][123091] Updated weights for policy 0, policy_version 1156186 (0.0009) [2023-12-26 08:49:19,060][123091] Updated weights for policy 0, policy_version 1156196 (0.0009) [2023-12-26 08:49:19,113][123091] Updated weights for policy 0, policy_version 1156206 (0.0007) [2023-12-26 08:49:19,224][123090] Updated weights for policy 1, policy_version 1147817 (0.0009) [2023-12-26 08:49:19,289][123090] Updated weights for policy 1, policy_version 1147827 (0.0010) [2023-12-26 08:49:19,346][123090] Updated weights for policy 1, policy_version 1147837 (0.0009) [2023-12-26 08:49:19,929][123091] Updated weights for policy 0, policy_version 1156216 (0.0009) [2023-12-26 08:49:19,988][123091] Updated weights for policy 0, policy_version 1156226 (0.0010) [2023-12-26 08:49:20,054][123091] Updated weights for policy 0, policy_version 1156236 (0.0009) [2023-12-26 08:49:20,112][123090] Updated weights for policy 1, policy_version 1147847 (0.0009) [2023-12-26 08:49:20,163][123090] Updated weights for policy 1, policy_version 1147857 (0.0010) [2023-12-26 08:49:20,224][123090] Updated weights for policy 1, policy_version 1147867 (0.0009) [2023-12-26 08:49:20,834][123091] Updated weights for policy 0, policy_version 1156246 (0.0008) [2023-12-26 08:49:20,897][123091] Updated weights for policy 0, policy_version 1156256 (0.0008) [2023-12-26 08:49:20,963][123091] Updated weights for policy 0, policy_version 1156266 (0.0008) [2023-12-26 08:49:21,069][123090] Updated weights for policy 1, policy_version 1147877 (0.0009) [2023-12-26 08:49:21,136][123090] Updated weights for policy 1, policy_version 1147887 (0.0008) [2023-12-26 08:49:21,202][123090] Updated weights for policy 1, policy_version 1147897 (0.0009) [2023-12-26 08:49:21,849][123091] Updated weights for policy 0, policy_version 1156276 (0.0009) [2023-12-26 08:49:21,905][123091] Updated weights for policy 0, policy_version 1156286 (0.0009) [2023-12-26 08:49:21,965][123091] Updated weights for policy 0, policy_version 1156296 (0.0009) [2023-12-26 08:49:22,016][123090] Updated weights for policy 1, policy_version 1147907 (0.0007) [2023-12-26 08:49:22,076][123090] Updated weights for policy 1, policy_version 1147917 (0.0006) [2023-12-26 08:49:22,142][123090] Updated weights for policy 1, policy_version 1147927 (0.0006) [2023-12-26 08:49:22,812][123090] Updated weights for policy 1, policy_version 1147937 (0.0005) [2023-12-26 08:49:22,837][123091] Updated weights for policy 0, policy_version 1156306 (0.0009) [2023-12-26 08:49:22,882][123090] Updated weights for policy 1, policy_version 1147947 (0.0006) [2023-12-26 08:49:22,901][123091] Updated weights for policy 0, policy_version 1156316 (0.0011) [2023-12-26 08:49:22,946][123090] Updated weights for policy 1, policy_version 1147957 (0.0006) [2023-12-26 08:49:22,967][123091] Updated weights for policy 0, policy_version 1156326 (0.0009) [2023-12-26 08:49:23,015][123090] Updated weights for policy 1, policy_version 1147967 (0.0009) [2023-12-26 08:49:23,035][123091] Updated weights for policy 0, policy_version 1156336 (0.0006) [2023-12-26 08:49:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 589905920. Throughput: 0: 8929.2, 1: 8515.8. Samples: 589888328. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:23,784][121949] Avg episode reward: [(0, '6123.619'), (1, '5107.201')] [2023-12-26 08:49:23,790][123090] Updated weights for policy 1, policy_version 1147977 (0.0007) [2023-12-26 08:49:23,791][123091] Updated weights for policy 0, policy_version 1156346 (0.0011) [2023-12-26 08:49:23,852][123090] Updated weights for policy 1, policy_version 1147987 (0.0009) [2023-12-26 08:49:23,856][123091] Updated weights for policy 0, policy_version 1156356 (0.0008) [2023-12-26 08:49:23,904][123090] Updated weights for policy 1, policy_version 1147997 (0.0009) [2023-12-26 08:49:23,917][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148000_293888000.pth... [2023-12-26 08:49:23,920][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001146976_293625856.pth [2023-12-26 08:49:23,933][123091] Updated weights for policy 0, policy_version 1156366 (0.0005) [2023-12-26 08:49:23,945][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001156368_296034304.pth... [2023-12-26 08:49:23,951][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001155312_295763968.pth [2023-12-26 08:49:24,605][123091] Updated weights for policy 0, policy_version 1156376 (0.0009) [2023-12-26 08:49:24,662][123091] Updated weights for policy 0, policy_version 1156386 (0.0010) [2023-12-26 08:49:24,721][123091] Updated weights for policy 0, policy_version 1156396 (0.0009) [2023-12-26 08:49:24,794][123090] Updated weights for policy 1, policy_version 1148007 (0.0009) [2023-12-26 08:49:24,843][123090] Updated weights for policy 1, policy_version 1148017 (0.0010) [2023-12-26 08:49:24,894][123090] Updated weights for policy 1, policy_version 1148027 (0.0010) [2023-12-26 08:49:25,371][123091] Updated weights for policy 0, policy_version 1156406 (0.0006) [2023-12-26 08:49:25,444][123091] Updated weights for policy 0, policy_version 1156416 (0.0005) [2023-12-26 08:49:25,504][123091] Updated weights for policy 0, policy_version 1156426 (0.0006) [2023-12-26 08:49:25,769][123090] Updated weights for policy 1, policy_version 1148037 (0.0010) [2023-12-26 08:49:25,839][123090] Updated weights for policy 1, policy_version 1148047 (0.0010) [2023-12-26 08:49:25,912][123090] Updated weights for policy 1, policy_version 1148057 (0.0010) [2023-12-26 08:49:26,086][123091] Updated weights for policy 0, policy_version 1156436 (0.0005) [2023-12-26 08:49:26,141][123091] Updated weights for policy 0, policy_version 1156446 (0.0006) [2023-12-26 08:49:26,195][123091] Updated weights for policy 0, policy_version 1156456 (0.0009) [2023-12-26 08:49:26,569][123090] Updated weights for policy 1, policy_version 1148067 (0.0007) [2023-12-26 08:49:26,624][123090] Updated weights for policy 1, policy_version 1148077 (0.0010) [2023-12-26 08:49:26,668][123090] Updated weights for policy 1, policy_version 1148087 (0.0010) [2023-12-26 08:49:26,972][123091] Updated weights for policy 0, policy_version 1156466 (0.0010) [2023-12-26 08:49:27,022][123091] Updated weights for policy 0, policy_version 1156476 (0.0010) [2023-12-26 08:49:27,092][123091] Updated weights for policy 0, policy_version 1156486 (0.0011) [2023-12-26 08:49:27,150][123091] Updated weights for policy 0, policy_version 1156496 (0.0007) [2023-12-26 08:49:27,518][123090] Updated weights for policy 1, policy_version 1148097 (0.0010) [2023-12-26 08:49:27,568][123090] Updated weights for policy 1, policy_version 1148107 (0.0010) [2023-12-26 08:49:27,617][123090] Updated weights for policy 1, policy_version 1148117 (0.0009) [2023-12-26 08:49:27,674][123090] Updated weights for policy 1, policy_version 1148127 (0.0005) [2023-12-26 08:49:27,834][123091] Updated weights for policy 0, policy_version 1156506 (0.0005) [2023-12-26 08:49:27,896][123091] Updated weights for policy 0, policy_version 1156516 (0.0005) [2023-12-26 08:49:27,959][123091] Updated weights for policy 0, policy_version 1156526 (0.0005) [2023-12-26 08:49:28,394][123090] Updated weights for policy 1, policy_version 1148137 (0.0007) [2023-12-26 08:49:28,461][123090] Updated weights for policy 1, policy_version 1148147 (0.0007) [2023-12-26 08:49:28,530][123090] Updated weights for policy 1, policy_version 1148157 (0.0009) [2023-12-26 08:49:28,699][123091] Updated weights for policy 0, policy_version 1156536 (0.0008) [2023-12-26 08:49:28,763][123091] Updated weights for policy 0, policy_version 1156546 (0.0008) [2023-12-26 08:49:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 590004224. Throughput: 0: 9027.9, 1: 8597.6. Samples: 589997796. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:28,784][121949] Avg episode reward: [(0, '6150.209'), (1, '5133.536')] [2023-12-26 08:49:28,824][123091] Updated weights for policy 0, policy_version 1156556 (0.0009) [2023-12-26 08:49:29,317][123090] Updated weights for policy 1, policy_version 1148167 (0.0009) [2023-12-26 08:49:29,388][123090] Updated weights for policy 1, policy_version 1148177 (0.0009) [2023-12-26 08:49:29,456][123090] Updated weights for policy 1, policy_version 1148187 (0.0009) [2023-12-26 08:49:29,661][123091] Updated weights for policy 0, policy_version 1156566 (0.0010) [2023-12-26 08:49:29,723][123091] Updated weights for policy 0, policy_version 1156576 (0.0011) [2023-12-26 08:49:29,778][123091] Updated weights for policy 0, policy_version 1156586 (0.0010) [2023-12-26 08:49:30,295][123090] Updated weights for policy 1, policy_version 1148197 (0.0009) [2023-12-26 08:49:30,378][123090] Updated weights for policy 1, policy_version 1148207 (0.0009) [2023-12-26 08:49:30,438][123090] Updated weights for policy 1, policy_version 1148217 (0.0010) [2023-12-26 08:49:30,612][123091] Updated weights for policy 0, policy_version 1156596 (0.0010) [2023-12-26 08:49:30,679][123091] Updated weights for policy 0, policy_version 1156606 (0.0009) [2023-12-26 08:49:30,732][123091] Updated weights for policy 0, policy_version 1156616 (0.0009) [2023-12-26 08:49:31,196][123090] Updated weights for policy 1, policy_version 1148227 (0.0007) [2023-12-26 08:49:31,248][123090] Updated weights for policy 1, policy_version 1148237 (0.0009) [2023-12-26 08:49:31,308][123090] Updated weights for policy 1, policy_version 1148247 (0.0009) [2023-12-26 08:49:31,582][123091] Updated weights for policy 0, policy_version 1156626 (0.0008) [2023-12-26 08:49:31,652][123091] Updated weights for policy 0, policy_version 1156636 (0.0007) [2023-12-26 08:49:31,713][123091] Updated weights for policy 0, policy_version 1156646 (0.0007) [2023-12-26 08:49:31,782][123091] Updated weights for policy 0, policy_version 1156656 (0.0009) [2023-12-26 08:49:32,072][123090] Updated weights for policy 1, policy_version 1148257 (0.0009) [2023-12-26 08:49:32,124][123090] Updated weights for policy 1, policy_version 1148267 (0.0010) [2023-12-26 08:49:32,177][123090] Updated weights for policy 1, policy_version 1148277 (0.0010) [2023-12-26 08:49:32,224][123090] Updated weights for policy 1, policy_version 1148287 (0.0010) [2023-12-26 08:49:32,515][123091] Updated weights for policy 0, policy_version 1156666 (0.0005) [2023-12-26 08:49:32,583][123091] Updated weights for policy 0, policy_version 1156676 (0.0006) [2023-12-26 08:49:32,656][123091] Updated weights for policy 0, policy_version 1156686 (0.0005) [2023-12-26 08:49:33,071][123090] Updated weights for policy 1, policy_version 1148297 (0.0010) [2023-12-26 08:49:33,140][123090] Updated weights for policy 1, policy_version 1148307 (0.0010) [2023-12-26 08:49:33,211][123090] Updated weights for policy 1, policy_version 1148317 (0.0010) [2023-12-26 08:49:33,306][123091] Updated weights for policy 0, policy_version 1156696 (0.0007) [2023-12-26 08:49:33,358][123091] Updated weights for policy 0, policy_version 1156706 (0.0009) [2023-12-26 08:49:33,408][123091] Updated weights for policy 0, policy_version 1156716 (0.0009) [2023-12-26 08:49:33,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 590094336. Throughput: 0: 9063.2, 1: 8653.4. Samples: 590105824. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:33,785][121949] Avg episode reward: [(0, '6202.572'), (1, '5318.821')] [2023-12-26 08:49:33,904][123090] Updated weights for policy 1, policy_version 1148327 (0.0007) [2023-12-26 08:49:33,950][123090] Updated weights for policy 1, policy_version 1148337 (0.0005) [2023-12-26 08:49:33,996][123090] Updated weights for policy 1, policy_version 1148347 (0.0005) [2023-12-26 08:49:34,050][123091] Updated weights for policy 0, policy_version 1156726 (0.0007) [2023-12-26 08:49:34,121][123091] Updated weights for policy 0, policy_version 1156736 (0.0005) [2023-12-26 08:49:34,188][123091] Updated weights for policy 0, policy_version 1156746 (0.0008) [2023-12-26 08:49:34,740][123090] Updated weights for policy 1, policy_version 1148357 (0.0007) [2023-12-26 08:49:34,808][123090] Updated weights for policy 1, policy_version 1148367 (0.0009) [2023-12-26 08:49:34,875][123090] Updated weights for policy 1, policy_version 1148377 (0.0009) [2023-12-26 08:49:34,900][123091] Updated weights for policy 0, policy_version 1156756 (0.0008) [2023-12-26 08:49:34,968][123091] Updated weights for policy 0, policy_version 1156766 (0.0005) [2023-12-26 08:49:35,040][123091] Updated weights for policy 0, policy_version 1156776 (0.0005) [2023-12-26 08:49:35,680][123090] Updated weights for policy 1, policy_version 1148387 (0.0008) [2023-12-26 08:49:35,705][123091] Updated weights for policy 0, policy_version 1156786 (0.0005) [2023-12-26 08:49:35,738][123090] Updated weights for policy 1, policy_version 1148397 (0.0005) [2023-12-26 08:49:35,781][123091] Updated weights for policy 0, policy_version 1156796 (0.0005) [2023-12-26 08:49:35,800][123090] Updated weights for policy 1, policy_version 1148407 (0.0005) [2023-12-26 08:49:35,841][123091] Updated weights for policy 0, policy_version 1156806 (0.0008) [2023-12-26 08:49:35,915][123091] Updated weights for policy 0, policy_version 1156816 (0.0009) [2023-12-26 08:49:36,516][123090] Updated weights for policy 1, policy_version 1148417 (0.0006) [2023-12-26 08:49:36,579][123090] Updated weights for policy 1, policy_version 1148427 (0.0010) [2023-12-26 08:49:36,640][123090] Updated weights for policy 1, policy_version 1148437 (0.0010) [2023-12-26 08:49:36,652][123091] Updated weights for policy 0, policy_version 1156826 (0.0007) [2023-12-26 08:49:36,704][123090] Updated weights for policy 1, policy_version 1148447 (0.0010) [2023-12-26 08:49:36,714][123091] Updated weights for policy 0, policy_version 1156836 (0.0010) [2023-12-26 08:49:36,762][123091] Updated weights for policy 0, policy_version 1156846 (0.0009) [2023-12-26 08:49:37,533][123090] Updated weights for policy 1, policy_version 1148457 (0.0010) [2023-12-26 08:49:37,591][123091] Updated weights for policy 0, policy_version 1156856 (0.0007) [2023-12-26 08:49:37,596][123090] Updated weights for policy 1, policy_version 1148467 (0.0010) [2023-12-26 08:49:37,655][123091] Updated weights for policy 0, policy_version 1156866 (0.0007) [2023-12-26 08:49:37,661][123090] Updated weights for policy 1, policy_version 1148477 (0.0011) [2023-12-26 08:49:37,720][123091] Updated weights for policy 0, policy_version 1156876 (0.0009) [2023-12-26 08:49:38,372][123090] Updated weights for policy 1, policy_version 1148487 (0.0010) [2023-12-26 08:49:38,431][123090] Updated weights for policy 1, policy_version 1148497 (0.0010) [2023-12-26 08:49:38,483][123090] Updated weights for policy 1, policy_version 1148507 (0.0009) [2023-12-26 08:49:38,535][123091] Updated weights for policy 0, policy_version 1156886 (0.0010) [2023-12-26 08:49:38,587][123091] Updated weights for policy 0, policy_version 1156896 (0.0008) [2023-12-26 08:49:38,648][123091] Updated weights for policy 0, policy_version 1156906 (0.0010) [2023-12-26 08:49:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 590192640. Throughput: 0: 9156.5, 1: 8723.7. Samples: 590163964. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:38,785][121949] Avg episode reward: [(0, '6253.180'), (1, '5451.498')] [2023-12-26 08:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001156912_296173568.pth... [2023-12-26 08:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148512_294019072.pth... [2023-12-26 08:49:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001155824_295895040.pth [2023-12-26 08:49:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001147488_293756928.pth [2023-12-26 08:49:39,330][123090] Updated weights for policy 1, policy_version 1148517 (0.0009) [2023-12-26 08:49:39,405][123090] Updated weights for policy 1, policy_version 1148527 (0.0009) [2023-12-26 08:49:39,476][123090] Updated weights for policy 1, policy_version 1148537 (0.0008) [2023-12-26 08:49:39,586][123091] Updated weights for policy 0, policy_version 1156916 (0.0008) [2023-12-26 08:49:39,653][123091] Updated weights for policy 0, policy_version 1156926 (0.0006) [2023-12-26 08:49:39,723][123091] Updated weights for policy 0, policy_version 1156936 (0.0008) [2023-12-26 08:49:40,303][123090] Updated weights for policy 1, policy_version 1148547 (0.0010) [2023-12-26 08:49:40,376][123090] Updated weights for policy 1, policy_version 1148557 (0.0011) [2023-12-26 08:49:40,444][123090] Updated weights for policy 1, policy_version 1148567 (0.0011) [2023-12-26 08:49:40,462][123091] Updated weights for policy 0, policy_version 1156946 (0.0010) [2023-12-26 08:49:40,532][123091] Updated weights for policy 0, policy_version 1156956 (0.0007) [2023-12-26 08:49:40,597][123091] Updated weights for policy 0, policy_version 1156966 (0.0009) [2023-12-26 08:49:40,653][123091] Updated weights for policy 0, policy_version 1156976 (0.0009) [2023-12-26 08:49:41,283][123090] Updated weights for policy 1, policy_version 1148577 (0.0011) [2023-12-26 08:49:41,346][123090] Updated weights for policy 1, policy_version 1148587 (0.0009) [2023-12-26 08:49:41,416][123090] Updated weights for policy 1, policy_version 1148597 (0.0008) [2023-12-26 08:49:41,483][123091] Updated weights for policy 0, policy_version 1156986 (0.0007) [2023-12-26 08:49:41,485][123090] Updated weights for policy 1, policy_version 1148607 (0.0009) [2023-12-26 08:49:41,549][123091] Updated weights for policy 0, policy_version 1156996 (0.0010) [2023-12-26 08:49:41,622][123091] Updated weights for policy 0, policy_version 1157006 (0.0010) [2023-12-26 08:49:42,298][123090] Updated weights for policy 1, policy_version 1148617 (0.0009) [2023-12-26 08:49:42,371][123090] Updated weights for policy 1, policy_version 1148627 (0.0009) [2023-12-26 08:49:42,443][123090] Updated weights for policy 1, policy_version 1148637 (0.0008) [2023-12-26 08:49:42,466][123091] Updated weights for policy 0, policy_version 1157016 (0.0009) [2023-12-26 08:49:42,529][123091] Updated weights for policy 0, policy_version 1157026 (0.0008) [2023-12-26 08:49:42,580][123091] Updated weights for policy 0, policy_version 1157036 (0.0009) [2023-12-26 08:49:43,248][123090] Updated weights for policy 1, policy_version 1148647 (0.0009) [2023-12-26 08:49:43,297][123090] Updated weights for policy 1, policy_version 1148657 (0.0009) [2023-12-26 08:49:43,346][123090] Updated weights for policy 1, policy_version 1148667 (0.0009) [2023-12-26 08:49:43,396][123091] Updated weights for policy 0, policy_version 1157046 (0.0010) [2023-12-26 08:49:43,452][123091] Updated weights for policy 0, policy_version 1157056 (0.0009) [2023-12-26 08:49:43,514][123091] Updated weights for policy 0, policy_version 1157066 (0.0010) [2023-12-26 08:49:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 590274560. Throughput: 0: 9070.3, 1: 8654.4. Samples: 590266316. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:43,785][121949] Avg episode reward: [(0, '6231.381'), (1, '5571.369')] [2023-12-26 08:49:44,194][123090] Updated weights for policy 1, policy_version 1148677 (0.0007) [2023-12-26 08:49:44,254][123090] Updated weights for policy 1, policy_version 1148687 (0.0006) [2023-12-26 08:49:44,262][123091] Updated weights for policy 0, policy_version 1157076 (0.0008) [2023-12-26 08:49:44,313][123091] Updated weights for policy 0, policy_version 1157086 (0.0005) [2023-12-26 08:49:44,314][123090] Updated weights for policy 1, policy_version 1148697 (0.0009) [2023-12-26 08:49:44,373][123091] Updated weights for policy 0, policy_version 1157096 (0.0005) [2023-12-26 08:49:45,095][123091] Updated weights for policy 0, policy_version 1157106 (0.0006) [2023-12-26 08:49:45,162][123091] Updated weights for policy 0, policy_version 1157116 (0.0009) [2023-12-26 08:49:45,174][123090] Updated weights for policy 1, policy_version 1148707 (0.0009) [2023-12-26 08:49:45,230][123091] Updated weights for policy 0, policy_version 1157126 (0.0010) [2023-12-26 08:49:45,236][123090] Updated weights for policy 1, policy_version 1148717 (0.0010) [2023-12-26 08:49:45,298][123091] Updated weights for policy 0, policy_version 1157136 (0.0009) [2023-12-26 08:49:45,307][123090] Updated weights for policy 1, policy_version 1148727 (0.0009) [2023-12-26 08:49:46,074][123091] Updated weights for policy 0, policy_version 1157146 (0.0008) [2023-12-26 08:49:46,143][123091] Updated weights for policy 0, policy_version 1157156 (0.0007) [2023-12-26 08:49:46,172][123090] Updated weights for policy 1, policy_version 1148737 (0.0009) [2023-12-26 08:49:46,212][123091] Updated weights for policy 0, policy_version 1157166 (0.0007) [2023-12-26 08:49:46,220][123090] Updated weights for policy 1, policy_version 1148747 (0.0008) [2023-12-26 08:49:46,281][123090] Updated weights for policy 1, policy_version 1148757 (0.0009) [2023-12-26 08:49:46,337][123090] Updated weights for policy 1, policy_version 1148768 (0.0011) [2023-12-26 08:49:46,878][123091] Updated weights for policy 0, policy_version 1157176 (0.0009) [2023-12-26 08:49:46,928][123091] Updated weights for policy 0, policy_version 1157186 (0.0008) [2023-12-26 08:49:46,983][123091] Updated weights for policy 0, policy_version 1157196 (0.0009) [2023-12-26 08:49:47,239][123090] Updated weights for policy 1, policy_version 1148778 (0.0010) [2023-12-26 08:49:47,293][123090] Updated weights for policy 1, policy_version 1148789 (0.0010) [2023-12-26 08:49:47,345][123090] Updated weights for policy 1, policy_version 1148799 (0.0009) [2023-12-26 08:49:47,827][123091] Updated weights for policy 0, policy_version 1157206 (0.0009) [2023-12-26 08:49:47,883][123091] Updated weights for policy 0, policy_version 1157216 (0.0009) [2023-12-26 08:49:47,939][123091] Updated weights for policy 0, policy_version 1157226 (0.0009) [2023-12-26 08:49:48,188][123090] Updated weights for policy 1, policy_version 1148809 (0.0008) [2023-12-26 08:49:48,250][123090] Updated weights for policy 1, policy_version 1148819 (0.0009) [2023-12-26 08:49:48,318][123090] Updated weights for policy 1, policy_version 1148829 (0.0009) [2023-12-26 08:49:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 590356480. Throughput: 0: 9061.6, 1: 8608.6. Samples: 590371364. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:48,784][121949] Avg episode reward: [(0, '6179.140'), (1, '5592.026')] [2023-12-26 08:49:48,794][123091] Updated weights for policy 0, policy_version 1157236 (0.0010) [2023-12-26 08:49:48,852][123091] Updated weights for policy 0, policy_version 1157246 (0.0009) [2023-12-26 08:49:48,917][123091] Updated weights for policy 0, policy_version 1157256 (0.0008) [2023-12-26 08:49:49,118][123090] Updated weights for policy 1, policy_version 1148839 (0.0009) [2023-12-26 08:49:49,172][123090] Updated weights for policy 1, policy_version 1148849 (0.0009) [2023-12-26 08:49:49,237][123090] Updated weights for policy 1, policy_version 1148859 (0.0009) [2023-12-26 08:49:49,732][123091] Updated weights for policy 0, policy_version 1157266 (0.0009) [2023-12-26 08:49:49,795][123091] Updated weights for policy 0, policy_version 1157276 (0.0009) [2023-12-26 08:49:49,864][123091] Updated weights for policy 0, policy_version 1157286 (0.0010) [2023-12-26 08:49:49,936][123091] Updated weights for policy 0, policy_version 1157296 (0.0010) [2023-12-26 08:49:50,122][123090] Updated weights for policy 1, policy_version 1148869 (0.0009) [2023-12-26 08:49:50,174][123090] Updated weights for policy 1, policy_version 1148879 (0.0009) [2023-12-26 08:49:50,232][123090] Updated weights for policy 1, policy_version 1148889 (0.0010) [2023-12-26 08:49:50,757][123091] Updated weights for policy 0, policy_version 1157306 (0.0010) [2023-12-26 08:49:50,823][123091] Updated weights for policy 0, policy_version 1157316 (0.0007) [2023-12-26 08:49:50,890][123091] Updated weights for policy 0, policy_version 1157326 (0.0010) [2023-12-26 08:49:51,080][123090] Updated weights for policy 1, policy_version 1148899 (0.0009) [2023-12-26 08:49:51,154][123090] Updated weights for policy 1, policy_version 1148909 (0.0009) [2023-12-26 08:49:51,220][123090] Updated weights for policy 1, policy_version 1148919 (0.0009) [2023-12-26 08:49:51,739][123091] Updated weights for policy 0, policy_version 1157336 (0.0009) [2023-12-26 08:49:51,800][123091] Updated weights for policy 0, policy_version 1157346 (0.0010) [2023-12-26 08:49:51,852][123091] Updated weights for policy 0, policy_version 1157356 (0.0008) [2023-12-26 08:49:52,062][123090] Updated weights for policy 1, policy_version 1148929 (0.0010) [2023-12-26 08:49:52,125][123090] Updated weights for policy 1, policy_version 1148939 (0.0010) [2023-12-26 08:49:52,186][123090] Updated weights for policy 1, policy_version 1148949 (0.0009) [2023-12-26 08:49:52,243][123090] Updated weights for policy 1, policy_version 1148959 (0.0009) [2023-12-26 08:49:52,703][123091] Updated weights for policy 0, policy_version 1157366 (0.0009) [2023-12-26 08:49:52,758][123091] Updated weights for policy 0, policy_version 1157376 (0.0010) [2023-12-26 08:49:52,818][123091] Updated weights for policy 0, policy_version 1157386 (0.0009) [2023-12-26 08:49:53,136][123090] Updated weights for policy 1, policy_version 1148969 (0.0009) [2023-12-26 08:49:53,199][123090] Updated weights for policy 1, policy_version 1148979 (0.0009) [2023-12-26 08:49:53,257][123090] Updated weights for policy 1, policy_version 1148989 (0.0009) [2023-12-26 08:49:53,671][123091] Updated weights for policy 0, policy_version 1157396 (0.0009) [2023-12-26 08:49:53,725][123091] Updated weights for policy 0, policy_version 1157406 (0.0010) [2023-12-26 08:49:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 590438400. Throughput: 0: 9025.1, 1: 8607.6. Samples: 590421860. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:53,785][121949] Avg episode reward: [(0, '6129.721'), (1, '5522.864')] [2023-12-26 08:49:53,790][123091] Updated weights for policy 0, policy_version 1157416 (0.0009) [2023-12-26 08:49:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148992_294141952.pth... [2023-12-26 08:49:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148000_293888000.pth [2023-12-26 08:49:53,830][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001157424_296304640.pth... [2023-12-26 08:49:53,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001156368_296034304.pth [2023-12-26 08:49:53,999][123090] Updated weights for policy 1, policy_version 1148999 (0.0007) [2023-12-26 08:49:54,055][123090] Updated weights for policy 1, policy_version 1149009 (0.0005) [2023-12-26 08:49:54,105][123090] Updated weights for policy 1, policy_version 1149019 (0.0005) [2023-12-26 08:49:54,688][123090] Updated weights for policy 1, policy_version 1149029 (0.0006) [2023-12-26 08:49:54,718][123091] Updated weights for policy 0, policy_version 1157426 (0.0010) [2023-12-26 08:49:54,759][123090] Updated weights for policy 1, policy_version 1149039 (0.0005) [2023-12-26 08:49:54,767][123091] Updated weights for policy 0, policy_version 1157436 (0.0009) [2023-12-26 08:49:54,817][123091] Updated weights for policy 0, policy_version 1157446 (0.0009) [2023-12-26 08:49:54,817][123090] Updated weights for policy 1, policy_version 1149049 (0.0006) [2023-12-26 08:49:54,868][123091] Updated weights for policy 0, policy_version 1157456 (0.0007) [2023-12-26 08:49:55,525][123090] Updated weights for policy 1, policy_version 1149059 (0.0010) [2023-12-26 08:49:55,572][123090] Updated weights for policy 1, policy_version 1149069 (0.0010) [2023-12-26 08:49:55,619][123090] Updated weights for policy 1, policy_version 1149079 (0.0010) [2023-12-26 08:49:55,746][123091] Updated weights for policy 0, policy_version 1157466 (0.0009) [2023-12-26 08:49:55,806][123091] Updated weights for policy 0, policy_version 1157476 (0.0009) [2023-12-26 08:49:55,880][123091] Updated weights for policy 0, policy_version 1157486 (0.0009) [2023-12-26 08:49:56,417][123090] Updated weights for policy 1, policy_version 1149089 (0.0010) [2023-12-26 08:49:56,475][123090] Updated weights for policy 1, policy_version 1149099 (0.0010) [2023-12-26 08:49:56,534][123090] Updated weights for policy 1, policy_version 1149109 (0.0010) [2023-12-26 08:49:56,593][123090] Updated weights for policy 1, policy_version 1149119 (0.0009) [2023-12-26 08:49:56,651][123091] Updated weights for policy 0, policy_version 1157496 (0.0009) [2023-12-26 08:49:56,713][123091] Updated weights for policy 0, policy_version 1157506 (0.0009) [2023-12-26 08:49:56,765][123091] Updated weights for policy 0, policy_version 1157516 (0.0009) [2023-12-26 08:49:57,428][123090] Updated weights for policy 1, policy_version 1149129 (0.0009) [2023-12-26 08:49:57,477][123090] Updated weights for policy 1, policy_version 1149139 (0.0009) [2023-12-26 08:49:57,530][123090] Updated weights for policy 1, policy_version 1149150 (0.0010) [2023-12-26 08:49:57,599][123091] Updated weights for policy 0, policy_version 1157526 (0.0008) [2023-12-26 08:49:57,658][123091] Updated weights for policy 0, policy_version 1157536 (0.0009) [2023-12-26 08:49:57,706][123091] Updated weights for policy 0, policy_version 1157546 (0.0009) [2023-12-26 08:49:58,401][123090] Updated weights for policy 1, policy_version 1149160 (0.0008) [2023-12-26 08:49:58,466][123090] Updated weights for policy 1, policy_version 1149170 (0.0010) [2023-12-26 08:49:58,524][123090] Updated weights for policy 1, policy_version 1149180 (0.0010) [2023-12-26 08:49:58,563][123091] Updated weights for policy 0, policy_version 1157556 (0.0009) [2023-12-26 08:49:58,630][123091] Updated weights for policy 0, policy_version 1157566 (0.0009) [2023-12-26 08:49:58,701][123091] Updated weights for policy 0, policy_version 1157576 (0.0009) [2023-12-26 08:49:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 590536704. Throughput: 0: 8928.3, 1: 8730.2. Samples: 590525932. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:49:58,785][121949] Avg episode reward: [(0, '6082.557'), (1, '5417.717')] [2023-12-26 08:49:59,420][123090] Updated weights for policy 1, policy_version 1149190 (0.0009) [2023-12-26 08:49:59,475][123090] Updated weights for policy 1, policy_version 1149200 (0.0009) [2023-12-26 08:49:59,526][123090] Updated weights for policy 1, policy_version 1149210 (0.0009) [2023-12-26 08:49:59,546][123091] Updated weights for policy 0, policy_version 1157586 (0.0008) [2023-12-26 08:49:59,608][123091] Updated weights for policy 0, policy_version 1157596 (0.0008) [2023-12-26 08:49:59,670][123091] Updated weights for policy 0, policy_version 1157606 (0.0008) [2023-12-26 08:49:59,724][123091] Updated weights for policy 0, policy_version 1157616 (0.0005) [2023-12-26 08:50:00,377][123090] Updated weights for policy 1, policy_version 1149220 (0.0010) [2023-12-26 08:50:00,428][123090] Updated weights for policy 1, policy_version 1149230 (0.0010) [2023-12-26 08:50:00,496][123090] Updated weights for policy 1, policy_version 1149240 (0.0010) [2023-12-26 08:50:00,529][123091] Updated weights for policy 0, policy_version 1157626 (0.0007) [2023-12-26 08:50:00,583][123091] Updated weights for policy 0, policy_version 1157636 (0.0009) [2023-12-26 08:50:00,648][123091] Updated weights for policy 0, policy_version 1157646 (0.0008) [2023-12-26 08:50:01,272][123090] Updated weights for policy 1, policy_version 1149250 (0.0007) [2023-12-26 08:50:01,340][123090] Updated weights for policy 1, policy_version 1149260 (0.0009) [2023-12-26 08:50:01,405][123090] Updated weights for policy 1, policy_version 1149270 (0.0009) [2023-12-26 08:50:01,459][123090] Updated weights for policy 1, policy_version 1149280 (0.0006) [2023-12-26 08:50:01,472][123091] Updated weights for policy 0, policy_version 1157656 (0.0010) [2023-12-26 08:50:01,531][123091] Updated weights for policy 0, policy_version 1157666 (0.0010) [2023-12-26 08:50:01,599][123091] Updated weights for policy 0, policy_version 1157676 (0.0010) [2023-12-26 08:50:02,255][123090] Updated weights for policy 1, policy_version 1149290 (0.0010) [2023-12-26 08:50:02,286][123091] Updated weights for policy 0, policy_version 1157686 (0.0008) [2023-12-26 08:50:02,311][123090] Updated weights for policy 1, policy_version 1149301 (0.0010) [2023-12-26 08:50:02,336][123091] Updated weights for policy 0, policy_version 1157696 (0.0006) [2023-12-26 08:50:02,368][123090] Updated weights for policy 1, policy_version 1149311 (0.0010) [2023-12-26 08:50:02,397][123091] Updated weights for policy 0, policy_version 1157706 (0.0008) [2023-12-26 08:50:03,137][123091] Updated weights for policy 0, policy_version 1157716 (0.0008) [2023-12-26 08:50:03,192][123091] Updated weights for policy 0, policy_version 1157727 (0.0006) [2023-12-26 08:50:03,220][123090] Updated weights for policy 1, policy_version 1149321 (0.0011) [2023-12-26 08:50:03,247][123091] Updated weights for policy 0, policy_version 1157737 (0.0006) [2023-12-26 08:50:03,287][123090] Updated weights for policy 1, policy_version 1149331 (0.0011) [2023-12-26 08:50:03,357][123090] Updated weights for policy 1, policy_version 1149341 (0.0010) [2023-12-26 08:50:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 590618624. Throughput: 0: 8909.1, 1: 8740.3. Samples: 590630880. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:03,785][121949] Avg episode reward: [(0, '6118.409'), (1, '5457.167')] [2023-12-26 08:50:03,966][123091] Updated weights for policy 0, policy_version 1157747 (0.0008) [2023-12-26 08:50:04,042][123091] Updated weights for policy 0, policy_version 1157757 (0.0006) [2023-12-26 08:50:04,101][123090] Updated weights for policy 1, policy_version 1149351 (0.0008) [2023-12-26 08:50:04,115][123091] Updated weights for policy 0, policy_version 1157767 (0.0008) [2023-12-26 08:50:04,171][123090] Updated weights for policy 1, policy_version 1149361 (0.0009) [2023-12-26 08:50:04,230][123090] Updated weights for policy 1, policy_version 1149371 (0.0011) [2023-12-26 08:50:04,746][123091] Updated weights for policy 0, policy_version 1157777 (0.0010) [2023-12-26 08:50:04,826][123091] Updated weights for policy 0, policy_version 1157787 (0.0010) [2023-12-26 08:50:04,884][123091] Updated weights for policy 0, policy_version 1157797 (0.0011) [2023-12-26 08:50:04,922][123090] Updated weights for policy 1, policy_version 1149381 (0.0008) [2023-12-26 08:50:04,934][123091] Updated weights for policy 0, policy_version 1157808 (0.0009) [2023-12-26 08:50:04,967][123090] Updated weights for policy 1, policy_version 1149391 (0.0005) [2023-12-26 08:50:05,014][123090] Updated weights for policy 1, policy_version 1149401 (0.0005) [2023-12-26 08:50:05,661][123090] Updated weights for policy 1, policy_version 1149411 (0.0006) [2023-12-26 08:50:05,711][123090] Updated weights for policy 1, policy_version 1149421 (0.0005) [2023-12-26 08:50:05,775][123090] Updated weights for policy 1, policy_version 1149431 (0.0005) [2023-12-26 08:50:05,832][123091] Updated weights for policy 0, policy_version 1157818 (0.0008) [2023-12-26 08:50:05,884][123091] Updated weights for policy 0, policy_version 1157828 (0.0010) [2023-12-26 08:50:05,939][123091] Updated weights for policy 0, policy_version 1157838 (0.0013) [2023-12-26 08:50:06,477][123090] Updated weights for policy 1, policy_version 1149441 (0.0005) [2023-12-26 08:50:06,549][123090] Updated weights for policy 1, policy_version 1149451 (0.0006) [2023-12-26 08:50:06,621][123090] Updated weights for policy 1, policy_version 1149461 (0.0007) [2023-12-26 08:50:06,685][123090] Updated weights for policy 1, policy_version 1149471 (0.0011) [2023-12-26 08:50:06,872][123091] Updated weights for policy 0, policy_version 1157848 (0.0009) [2023-12-26 08:50:06,940][123091] Updated weights for policy 0, policy_version 1157858 (0.0009) [2023-12-26 08:50:07,012][123091] Updated weights for policy 0, policy_version 1157868 (0.0009) [2023-12-26 08:50:07,468][123090] Updated weights for policy 1, policy_version 1149481 (0.0010) [2023-12-26 08:50:07,539][123090] Updated weights for policy 1, policy_version 1149491 (0.0010) [2023-12-26 08:50:07,594][123090] Updated weights for policy 1, policy_version 1149501 (0.0010) [2023-12-26 08:50:07,847][123091] Updated weights for policy 0, policy_version 1157878 (0.0009) [2023-12-26 08:50:07,896][123091] Updated weights for policy 0, policy_version 1157888 (0.0008) [2023-12-26 08:50:07,943][123091] Updated weights for policy 0, policy_version 1157898 (0.0008) [2023-12-26 08:50:08,386][123090] Updated weights for policy 1, policy_version 1149511 (0.0011) [2023-12-26 08:50:08,453][123090] Updated weights for policy 1, policy_version 1149521 (0.0010) [2023-12-26 08:50:08,520][123090] Updated weights for policy 1, policy_version 1149531 (0.0011) [2023-12-26 08:50:08,753][123091] Updated weights for policy 0, policy_version 1157908 (0.0009) [2023-12-26 08:50:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 590708736. Throughput: 0: 8909.8, 1: 8841.0. Samples: 590687112. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:08,785][121949] Avg episode reward: [(0, '6146.489'), (1, '5545.318')] [2023-12-26 08:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001149536_294281216.pth... [2023-12-26 08:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148512_294019072.pth [2023-12-26 08:50:08,811][123091] Updated weights for policy 0, policy_version 1157918 (0.0009) [2023-12-26 08:50:08,872][123091] Updated weights for policy 0, policy_version 1157928 (0.0009) [2023-12-26 08:50:08,920][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001157936_296435712.pth... [2023-12-26 08:50:08,924][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001156912_296173568.pth [2023-12-26 08:50:09,331][123090] Updated weights for policy 1, policy_version 1149541 (0.0009) [2023-12-26 08:50:09,404][123090] Updated weights for policy 1, policy_version 1149551 (0.0008) [2023-12-26 08:50:09,477][123090] Updated weights for policy 1, policy_version 1149561 (0.0010) [2023-12-26 08:50:09,684][123091] Updated weights for policy 0, policy_version 1157938 (0.0011) [2023-12-26 08:50:09,752][123091] Updated weights for policy 0, policy_version 1157948 (0.0011) [2023-12-26 08:50:09,822][123091] Updated weights for policy 0, policy_version 1157958 (0.0011) [2023-12-26 08:50:09,895][123091] Updated weights for policy 0, policy_version 1157968 (0.0008) [2023-12-26 08:50:10,270][123090] Updated weights for policy 1, policy_version 1149571 (0.0011) [2023-12-26 08:50:10,322][123090] Updated weights for policy 1, policy_version 1149581 (0.0010) [2023-12-26 08:50:10,382][123090] Updated weights for policy 1, policy_version 1149591 (0.0010) [2023-12-26 08:50:10,676][123091] Updated weights for policy 0, policy_version 1157978 (0.0009) [2023-12-26 08:50:10,724][123091] Updated weights for policy 0, policy_version 1157988 (0.0010) [2023-12-26 08:50:10,772][123091] Updated weights for policy 0, policy_version 1157998 (0.0010) [2023-12-26 08:50:11,261][123090] Updated weights for policy 1, policy_version 1149601 (0.0010) [2023-12-26 08:50:11,336][123090] Updated weights for policy 1, policy_version 1149611 (0.0007) [2023-12-26 08:50:11,422][123090] Updated weights for policy 1, policy_version 1149621 (0.0008) [2023-12-26 08:50:11,483][123090] Updated weights for policy 1, policy_version 1149631 (0.0008) [2023-12-26 08:50:11,592][123091] Updated weights for policy 0, policy_version 1158008 (0.0009) [2023-12-26 08:50:11,662][123091] Updated weights for policy 0, policy_version 1158018 (0.0009) [2023-12-26 08:50:11,738][123091] Updated weights for policy 0, policy_version 1158028 (0.0008) [2023-12-26 08:50:12,291][123090] Updated weights for policy 1, policy_version 1149641 (0.0009) [2023-12-26 08:50:12,361][123090] Updated weights for policy 1, policy_version 1149651 (0.0009) [2023-12-26 08:50:12,428][123090] Updated weights for policy 1, policy_version 1149661 (0.0009) [2023-12-26 08:50:12,546][123091] Updated weights for policy 0, policy_version 1158038 (0.0007) [2023-12-26 08:50:12,614][123091] Updated weights for policy 0, policy_version 1158048 (0.0006) [2023-12-26 08:50:12,687][123091] Updated weights for policy 0, policy_version 1158058 (0.0006) [2023-12-26 08:50:13,191][123090] Updated weights for policy 1, policy_version 1149671 (0.0006) [2023-12-26 08:50:13,245][123090] Updated weights for policy 1, policy_version 1149681 (0.0009) [2023-12-26 08:50:13,296][123090] Updated weights for policy 1, policy_version 1149691 (0.0010) [2023-12-26 08:50:13,324][123091] Updated weights for policy 0, policy_version 1158068 (0.0005) [2023-12-26 08:50:13,379][123091] Updated weights for policy 0, policy_version 1158078 (0.0007) [2023-12-26 08:50:13,449][123091] Updated weights for policy 0, policy_version 1158088 (0.0006) [2023-12-26 08:50:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 590798848. Throughput: 0: 8801.9, 1: 8805.2. Samples: 590790112. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:13,784][121949] Avg episode reward: [(0, '6180.670'), (1, '5620.837')] [2023-12-26 08:50:14,021][123090] Updated weights for policy 1, policy_version 1149701 (0.0009) [2023-12-26 08:50:14,071][123090] Updated weights for policy 1, policy_version 1149711 (0.0007) [2023-12-26 08:50:14,131][123090] Updated weights for policy 1, policy_version 1149721 (0.0005) [2023-12-26 08:50:14,252][123091] Updated weights for policy 0, policy_version 1158098 (0.0008) [2023-12-26 08:50:14,326][123091] Updated weights for policy 0, policy_version 1158108 (0.0010) [2023-12-26 08:50:14,394][123091] Updated weights for policy 0, policy_version 1158118 (0.0009) [2023-12-26 08:50:14,461][123091] Updated weights for policy 0, policy_version 1158128 (0.0010) [2023-12-26 08:50:14,856][123090] Updated weights for policy 1, policy_version 1149731 (0.0007) [2023-12-26 08:50:14,922][123090] Updated weights for policy 1, policy_version 1149741 (0.0009) [2023-12-26 08:50:14,991][123090] Updated weights for policy 1, policy_version 1149751 (0.0009) [2023-12-26 08:50:15,293][123091] Updated weights for policy 0, policy_version 1158138 (0.0011) [2023-12-26 08:50:15,358][123091] Updated weights for policy 0, policy_version 1158148 (0.0011) [2023-12-26 08:50:15,422][123091] Updated weights for policy 0, policy_version 1158158 (0.0011) [2023-12-26 08:50:15,830][123090] Updated weights for policy 1, policy_version 1149761 (0.0009) [2023-12-26 08:50:15,878][123090] Updated weights for policy 1, policy_version 1149771 (0.0009) [2023-12-26 08:50:15,934][123090] Updated weights for policy 1, policy_version 1149781 (0.0008) [2023-12-26 08:50:15,986][123090] Updated weights for policy 1, policy_version 1149791 (0.0009) [2023-12-26 08:50:16,250][123091] Updated weights for policy 0, policy_version 1158168 (0.0007) [2023-12-26 08:50:16,318][123091] Updated weights for policy 0, policy_version 1158178 (0.0007) [2023-12-26 08:50:16,383][123091] Updated weights for policy 0, policy_version 1158188 (0.0011) [2023-12-26 08:50:16,801][123090] Updated weights for policy 1, policy_version 1149801 (0.0006) [2023-12-26 08:50:16,864][123090] Updated weights for policy 1, policy_version 1149811 (0.0005) [2023-12-26 08:50:16,920][123090] Updated weights for policy 1, policy_version 1149821 (0.0005) [2023-12-26 08:50:17,170][123091] Updated weights for policy 0, policy_version 1158198 (0.0010) [2023-12-26 08:50:17,218][123091] Updated weights for policy 0, policy_version 1158208 (0.0010) [2023-12-26 08:50:17,270][123091] Updated weights for policy 0, policy_version 1158218 (0.0010) [2023-12-26 08:50:17,654][123090] Updated weights for policy 1, policy_version 1149831 (0.0008) [2023-12-26 08:50:17,726][123090] Updated weights for policy 1, policy_version 1149841 (0.0006) [2023-12-26 08:50:17,809][123090] Updated weights for policy 1, policy_version 1149851 (0.0006) [2023-12-26 08:50:18,034][123091] Updated weights for policy 0, policy_version 1158228 (0.0008) [2023-12-26 08:50:18,097][123091] Updated weights for policy 0, policy_version 1158238 (0.0005) [2023-12-26 08:50:18,166][123091] Updated weights for policy 0, policy_version 1158248 (0.0007) [2023-12-26 08:50:18,580][123090] Updated weights for policy 1, policy_version 1149861 (0.0009) [2023-12-26 08:50:18,645][123090] Updated weights for policy 1, policy_version 1149871 (0.0009) [2023-12-26 08:50:18,708][123090] Updated weights for policy 1, policy_version 1149881 (0.0009) [2023-12-26 08:50:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 590888960. Throughput: 0: 8784.8, 1: 8823.3. Samples: 590898188. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:18,785][121949] Avg episode reward: [(0, '6227.911'), (1, '5652.420')] [2023-12-26 08:50:18,945][123091] Updated weights for policy 0, policy_version 1158258 (0.0010) [2023-12-26 08:50:18,998][123091] Updated weights for policy 0, policy_version 1158268 (0.0010) [2023-12-26 08:50:19,051][123091] Updated weights for policy 0, policy_version 1158278 (0.0011) [2023-12-26 08:50:19,115][123091] Updated weights for policy 0, policy_version 1158288 (0.0011) [2023-12-26 08:50:19,645][123090] Updated weights for policy 1, policy_version 1149891 (0.0010) [2023-12-26 08:50:19,697][123090] Updated weights for policy 1, policy_version 1149901 (0.0009) [2023-12-26 08:50:19,751][123090] Updated weights for policy 1, policy_version 1149912 (0.0010) [2023-12-26 08:50:19,904][123091] Updated weights for policy 0, policy_version 1158298 (0.0009) [2023-12-26 08:50:19,970][123091] Updated weights for policy 0, policy_version 1158308 (0.0010) [2023-12-26 08:50:20,026][123091] Updated weights for policy 0, policy_version 1158318 (0.0009) [2023-12-26 08:50:20,651][123090] Updated weights for policy 1, policy_version 1149922 (0.0009) [2023-12-26 08:50:20,715][123090] Updated weights for policy 1, policy_version 1149932 (0.0010) [2023-12-26 08:50:20,776][123090] Updated weights for policy 1, policy_version 1149942 (0.0009) [2023-12-26 08:50:20,831][123090] Updated weights for policy 1, policy_version 1149952 (0.0009) [2023-12-26 08:50:20,885][123091] Updated weights for policy 0, policy_version 1158328 (0.0010) [2023-12-26 08:50:20,951][123091] Updated weights for policy 0, policy_version 1158338 (0.0009) [2023-12-26 08:50:21,024][123091] Updated weights for policy 0, policy_version 1158348 (0.0009) [2023-12-26 08:50:21,700][123090] Updated weights for policy 1, policy_version 1149962 (0.0010) [2023-12-26 08:50:21,772][123090] Updated weights for policy 1, policy_version 1149972 (0.0010) [2023-12-26 08:50:21,835][123090] Updated weights for policy 1, policy_version 1149982 (0.0011) [2023-12-26 08:50:21,881][123091] Updated weights for policy 0, policy_version 1158358 (0.0009) [2023-12-26 08:50:21,946][123091] Updated weights for policy 0, policy_version 1158368 (0.0010) [2023-12-26 08:50:22,000][123091] Updated weights for policy 0, policy_version 1158378 (0.0009) [2023-12-26 08:50:22,679][123090] Updated weights for policy 1, policy_version 1149992 (0.0011) [2023-12-26 08:50:22,746][123090] Updated weights for policy 1, policy_version 1150002 (0.0011) [2023-12-26 08:50:22,816][123090] Updated weights for policy 1, policy_version 1150012 (0.0007) [2023-12-26 08:50:22,860][123091] Updated weights for policy 0, policy_version 1158388 (0.0009) [2023-12-26 08:50:22,912][123091] Updated weights for policy 0, policy_version 1158398 (0.0010) [2023-12-26 08:50:22,964][123091] Updated weights for policy 0, policy_version 1158408 (0.0009) [2023-12-26 08:50:23,516][123090] Updated weights for policy 1, policy_version 1150022 (0.0009) [2023-12-26 08:50:23,569][123090] Updated weights for policy 1, policy_version 1150032 (0.0009) [2023-12-26 08:50:23,630][123090] Updated weights for policy 1, policy_version 1150042 (0.0010) [2023-12-26 08:50:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 590970880. Throughput: 0: 8693.6, 1: 8727.7. Samples: 590947924. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:23,785][121949] Avg episode reward: [(0, '6190.186'), (1, '5696.469')] [2023-12-26 08:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001158416_296558592.pth... [2023-12-26 08:50:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001150048_294412288.pth... [2023-12-26 08:50:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001148992_294141952.pth [2023-12-26 08:50:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001157424_296304640.pth [2023-12-26 08:50:23,854][123091] Updated weights for policy 0, policy_version 1158418 (0.0010) [2023-12-26 08:50:23,922][123091] Updated weights for policy 0, policy_version 1158428 (0.0009) [2023-12-26 08:50:23,992][123091] Updated weights for policy 0, policy_version 1158438 (0.0010) [2023-12-26 08:50:24,053][123091] Updated weights for policy 0, policy_version 1158448 (0.0010) [2023-12-26 08:50:24,363][123090] Updated weights for policy 1, policy_version 1150052 (0.0010) [2023-12-26 08:50:24,421][123090] Updated weights for policy 1, policy_version 1150062 (0.0009) [2023-12-26 08:50:24,482][123090] Updated weights for policy 1, policy_version 1150072 (0.0009) [2023-12-26 08:50:24,924][123091] Updated weights for policy 0, policy_version 1158458 (0.0009) [2023-12-26 08:50:24,980][123091] Updated weights for policy 0, policy_version 1158468 (0.0009) [2023-12-26 08:50:25,032][123091] Updated weights for policy 0, policy_version 1158478 (0.0010) [2023-12-26 08:50:25,286][123090] Updated weights for policy 1, policy_version 1150082 (0.0009) [2023-12-26 08:50:25,348][123090] Updated weights for policy 1, policy_version 1150092 (0.0010) [2023-12-26 08:50:25,413][123090] Updated weights for policy 1, policy_version 1150102 (0.0010) [2023-12-26 08:50:25,465][123090] Updated weights for policy 1, policy_version 1150112 (0.0010) [2023-12-26 08:50:25,904][123091] Updated weights for policy 0, policy_version 1158488 (0.0008) [2023-12-26 08:50:25,959][123091] Updated weights for policy 0, policy_version 1158498 (0.0009) [2023-12-26 08:50:26,020][123091] Updated weights for policy 0, policy_version 1158508 (0.0009) [2023-12-26 08:50:26,227][123090] Updated weights for policy 1, policy_version 1150122 (0.0010) [2023-12-26 08:50:26,287][123090] Updated weights for policy 1, policy_version 1150132 (0.0009) [2023-12-26 08:50:26,350][123090] Updated weights for policy 1, policy_version 1150142 (0.0010) [2023-12-26 08:50:26,852][123091] Updated weights for policy 0, policy_version 1158518 (0.0009) [2023-12-26 08:50:26,920][123091] Updated weights for policy 0, policy_version 1158528 (0.0009) [2023-12-26 08:50:26,970][123091] Updated weights for policy 0, policy_version 1158538 (0.0009) [2023-12-26 08:50:27,092][123090] Updated weights for policy 1, policy_version 1150153 (0.0009) [2023-12-26 08:50:27,141][123090] Updated weights for policy 1, policy_version 1150163 (0.0005) [2023-12-26 08:50:27,207][123090] Updated weights for policy 1, policy_version 1150173 (0.0007) [2023-12-26 08:50:27,828][123091] Updated weights for policy 0, policy_version 1158548 (0.0009) [2023-12-26 08:50:27,880][123091] Updated weights for policy 0, policy_version 1158558 (0.0010) [2023-12-26 08:50:27,909][123090] Updated weights for policy 1, policy_version 1150183 (0.0007) [2023-12-26 08:50:27,935][123091] Updated weights for policy 0, policy_version 1158568 (0.0008) [2023-12-26 08:50:27,961][123090] Updated weights for policy 1, policy_version 1150193 (0.0005) [2023-12-26 08:50:28,015][123090] Updated weights for policy 1, policy_version 1150203 (0.0007) [2023-12-26 08:50:28,752][123091] Updated weights for policy 0, policy_version 1158578 (0.0009) [2023-12-26 08:50:28,769][123090] Updated weights for policy 1, policy_version 1150213 (0.0010) [2023-12-26 08:50:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 591052800. Throughput: 0: 8667.0, 1: 8790.1. Samples: 591051880. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:28,784][121949] Avg episode reward: [(0, '6293.167'), (1, '5653.980')] [2023-12-26 08:50:28,814][123091] Updated weights for policy 0, policy_version 1158588 (0.0010) [2023-12-26 08:50:28,821][123090] Updated weights for policy 1, policy_version 1150223 (0.0010) [2023-12-26 08:50:28,876][123091] Updated weights for policy 0, policy_version 1158598 (0.0010) [2023-12-26 08:50:28,880][123090] Updated weights for policy 1, policy_version 1150233 (0.0010) [2023-12-26 08:50:28,935][123091] Updated weights for policy 0, policy_version 1158608 (0.0010) [2023-12-26 08:50:29,661][123090] Updated weights for policy 1, policy_version 1150243 (0.0009) [2023-12-26 08:50:29,718][123090] Updated weights for policy 1, policy_version 1150253 (0.0005) [2023-12-26 08:50:29,780][123090] Updated weights for policy 1, policy_version 1150263 (0.0005) [2023-12-26 08:50:29,781][123091] Updated weights for policy 0, policy_version 1158618 (0.0008) [2023-12-26 08:50:29,851][123091] Updated weights for policy 0, policy_version 1158628 (0.0009) [2023-12-26 08:50:29,914][123091] Updated weights for policy 0, policy_version 1158638 (0.0009) [2023-12-26 08:50:30,590][123090] Updated weights for policy 1, policy_version 1150273 (0.0007) [2023-12-26 08:50:30,655][123090] Updated weights for policy 1, policy_version 1150283 (0.0011) [2023-12-26 08:50:30,670][123091] Updated weights for policy 0, policy_version 1158648 (0.0008) [2023-12-26 08:50:30,719][123090] Updated weights for policy 1, policy_version 1150293 (0.0011) [2023-12-26 08:50:30,724][123091] Updated weights for policy 0, policy_version 1158658 (0.0010) [2023-12-26 08:50:30,778][123091] Updated weights for policy 0, policy_version 1158668 (0.0006) [2023-12-26 08:50:30,783][123090] Updated weights for policy 1, policy_version 1150303 (0.0010) [2023-12-26 08:50:31,621][123090] Updated weights for policy 1, policy_version 1150313 (0.0008) [2023-12-26 08:50:31,651][123091] Updated weights for policy 0, policy_version 1158678 (0.0009) [2023-12-26 08:50:31,681][123090] Updated weights for policy 1, policy_version 1150323 (0.0010) [2023-12-26 08:50:31,714][123091] Updated weights for policy 0, policy_version 1158688 (0.0008) [2023-12-26 08:50:31,746][123090] Updated weights for policy 1, policy_version 1150333 (0.0011) [2023-12-26 08:50:31,783][123091] Updated weights for policy 0, policy_version 1158698 (0.0007) [2023-12-26 08:50:32,390][123090] Updated weights for policy 1, policy_version 1150343 (0.0009) [2023-12-26 08:50:32,461][123090] Updated weights for policy 1, policy_version 1150353 (0.0005) [2023-12-26 08:50:32,514][123090] Updated weights for policy 1, policy_version 1150363 (0.0010) [2023-12-26 08:50:32,623][123091] Updated weights for policy 0, policy_version 1158708 (0.0009) [2023-12-26 08:50:32,671][123091] Updated weights for policy 0, policy_version 1158718 (0.0009) [2023-12-26 08:50:32,720][123091] Updated weights for policy 0, policy_version 1158728 (0.0009) [2023-12-26 08:50:33,232][123090] Updated weights for policy 1, policy_version 1150373 (0.0008) [2023-12-26 08:50:33,286][123090] Updated weights for policy 1, policy_version 1150383 (0.0010) [2023-12-26 08:50:33,341][123090] Updated weights for policy 1, policy_version 1150393 (0.0010) [2023-12-26 08:50:33,495][123091] Updated weights for policy 0, policy_version 1158738 (0.0008) [2023-12-26 08:50:33,547][123091] Updated weights for policy 0, policy_version 1158748 (0.0005) [2023-12-26 08:50:33,601][123091] Updated weights for policy 0, policy_version 1158758 (0.0005) [2023-12-26 08:50:33,654][123091] Updated weights for policy 0, policy_version 1158768 (0.0005) [2023-12-26 08:50:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 591151104. Throughput: 0: 8614.6, 1: 8886.9. Samples: 591158932. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:33,784][121949] Avg episode reward: [(0, '6242.790'), (1, '5715.871')] [2023-12-26 08:50:34,159][123090] Updated weights for policy 1, policy_version 1150403 (0.0010) [2023-12-26 08:50:34,213][123090] Updated weights for policy 1, policy_version 1150413 (0.0010) [2023-12-26 08:50:34,280][123090] Updated weights for policy 1, policy_version 1150423 (0.0010) [2023-12-26 08:50:34,443][123091] Updated weights for policy 0, policy_version 1158778 (0.0010) [2023-12-26 08:50:34,505][123091] Updated weights for policy 0, policy_version 1158788 (0.0009) [2023-12-26 08:50:34,580][123091] Updated weights for policy 0, policy_version 1158798 (0.0009) [2023-12-26 08:50:35,084][123090] Updated weights for policy 1, policy_version 1150433 (0.0011) [2023-12-26 08:50:35,142][123090] Updated weights for policy 1, policy_version 1150443 (0.0010) [2023-12-26 08:50:35,196][123090] Updated weights for policy 1, policy_version 1150453 (0.0010) [2023-12-26 08:50:35,251][123090] Updated weights for policy 1, policy_version 1150463 (0.0010) [2023-12-26 08:50:35,407][123091] Updated weights for policy 0, policy_version 1158808 (0.0009) [2023-12-26 08:50:35,459][123091] Updated weights for policy 0, policy_version 1158818 (0.0009) [2023-12-26 08:50:35,518][123091] Updated weights for policy 0, policy_version 1158828 (0.0009) [2023-12-26 08:50:36,093][123090] Updated weights for policy 1, policy_version 1150473 (0.0010) [2023-12-26 08:50:36,161][123090] Updated weights for policy 1, policy_version 1150483 (0.0010) [2023-12-26 08:50:36,229][123090] Updated weights for policy 1, policy_version 1150493 (0.0011) [2023-12-26 08:50:36,382][123091] Updated weights for policy 0, policy_version 1158838 (0.0009) [2023-12-26 08:50:36,436][123091] Updated weights for policy 0, policy_version 1158848 (0.0009) [2023-12-26 08:50:36,484][123091] Updated weights for policy 0, policy_version 1158858 (0.0009) [2023-12-26 08:50:37,019][123090] Updated weights for policy 1, policy_version 1150503 (0.0008) [2023-12-26 08:50:37,079][123090] Updated weights for policy 1, policy_version 1150513 (0.0006) [2023-12-26 08:50:37,142][123090] Updated weights for policy 1, policy_version 1150523 (0.0006) [2023-12-26 08:50:37,426][123091] Updated weights for policy 0, policy_version 1158868 (0.0009) [2023-12-26 08:50:37,496][123091] Updated weights for policy 0, policy_version 1158879 (0.0010) [2023-12-26 08:50:37,560][123091] Updated weights for policy 0, policy_version 1158889 (0.0009) [2023-12-26 08:50:37,819][123090] Updated weights for policy 1, policy_version 1150533 (0.0006) [2023-12-26 08:50:37,878][123090] Updated weights for policy 1, policy_version 1150543 (0.0010) [2023-12-26 08:50:37,946][123090] Updated weights for policy 1, policy_version 1150553 (0.0007) [2023-12-26 08:50:38,392][123091] Updated weights for policy 0, policy_version 1158899 (0.0008) [2023-12-26 08:50:38,461][123091] Updated weights for policy 0, policy_version 1158909 (0.0007) [2023-12-26 08:50:38,537][123091] Updated weights for policy 0, policy_version 1158919 (0.0005) [2023-12-26 08:50:38,666][123090] Updated weights for policy 1, policy_version 1150563 (0.0007) [2023-12-26 08:50:38,734][123090] Updated weights for policy 1, policy_version 1150573 (0.0009) [2023-12-26 08:50:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 591233024. Throughput: 0: 8609.7, 1: 8899.1. Samples: 591209756. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:38,785][121949] Avg episode reward: [(0, '6243.744'), (1, '5675.554')] [2023-12-26 08:50:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001158928_296689664.pth... [2023-12-26 08:50:38,795][123090] Updated weights for policy 1, policy_version 1150583 (0.0006) [2023-12-26 08:50:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001157936_296435712.pth [2023-12-26 08:50:38,855][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001150592_294551552.pth... [2023-12-26 08:50:38,859][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001149536_294281216.pth [2023-12-26 08:50:39,180][123091] Updated weights for policy 0, policy_version 1158929 (0.0006) [2023-12-26 08:50:39,243][123091] Updated weights for policy 0, policy_version 1158939 (0.0007) [2023-12-26 08:50:39,320][123091] Updated weights for policy 0, policy_version 1158949 (0.0007) [2023-12-26 08:50:39,396][123091] Updated weights for policy 0, policy_version 1158959 (0.0008) [2023-12-26 08:50:39,678][123090] Updated weights for policy 1, policy_version 1150593 (0.0007) [2023-12-26 08:50:39,750][123090] Updated weights for policy 1, policy_version 1150603 (0.0010) [2023-12-26 08:50:39,816][123090] Updated weights for policy 1, policy_version 1150613 (0.0009) [2023-12-26 08:50:39,879][123090] Updated weights for policy 1, policy_version 1150623 (0.0010) [2023-12-26 08:50:40,205][123091] Updated weights for policy 0, policy_version 1158969 (0.0010) [2023-12-26 08:50:40,264][123091] Updated weights for policy 0, policy_version 1158979 (0.0010) [2023-12-26 08:50:40,319][123091] Updated weights for policy 0, policy_version 1158989 (0.0010) [2023-12-26 08:50:40,716][123090] Updated weights for policy 1, policy_version 1150633 (0.0010) [2023-12-26 08:50:40,777][123090] Updated weights for policy 1, policy_version 1150643 (0.0011) [2023-12-26 08:50:40,834][123090] Updated weights for policy 1, policy_version 1150653 (0.0011) [2023-12-26 08:50:41,223][123091] Updated weights for policy 0, policy_version 1158999 (0.0009) [2023-12-26 08:50:41,299][123091] Updated weights for policy 0, policy_version 1159009 (0.0009) [2023-12-26 08:50:41,373][123091] Updated weights for policy 0, policy_version 1159019 (0.0010) [2023-12-26 08:50:41,665][123090] Updated weights for policy 1, policy_version 1150663 (0.0008) [2023-12-26 08:50:41,726][123090] Updated weights for policy 1, policy_version 1150673 (0.0009) [2023-12-26 08:50:41,790][123090] Updated weights for policy 1, policy_version 1150683 (0.0009) [2023-12-26 08:50:42,285][123091] Updated weights for policy 0, policy_version 1159029 (0.0010) [2023-12-26 08:50:42,353][123091] Updated weights for policy 0, policy_version 1159039 (0.0008) [2023-12-26 08:50:42,413][123091] Updated weights for policy 0, policy_version 1159049 (0.0009) [2023-12-26 08:50:42,627][123090] Updated weights for policy 1, policy_version 1150693 (0.0010) [2023-12-26 08:50:42,694][123090] Updated weights for policy 1, policy_version 1150703 (0.0009) [2023-12-26 08:50:42,764][123090] Updated weights for policy 1, policy_version 1150713 (0.0010) [2023-12-26 08:50:43,164][123091] Updated weights for policy 0, policy_version 1159059 (0.0008) [2023-12-26 08:50:43,217][123091] Updated weights for policy 0, policy_version 1159069 (0.0009) [2023-12-26 08:50:43,275][123091] Updated weights for policy 0, policy_version 1159079 (0.0009) [2023-12-26 08:50:43,615][123090] Updated weights for policy 1, policy_version 1150723 (0.0009) [2023-12-26 08:50:43,671][123090] Updated weights for policy 1, policy_version 1150733 (0.0009) [2023-12-26 08:50:43,721][123090] Updated weights for policy 1, policy_version 1150743 (0.0009) [2023-12-26 08:50:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 591323136. Throughput: 0: 8598.3, 1: 8903.9. Samples: 591313524. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:43,784][121949] Avg episode reward: [(0, '6202.120'), (1, '5654.688')] [2023-12-26 08:50:44,101][123091] Updated weights for policy 0, policy_version 1159089 (0.0010) [2023-12-26 08:50:44,154][123091] Updated weights for policy 0, policy_version 1159100 (0.0011) [2023-12-26 08:50:44,212][123091] Updated weights for policy 0, policy_version 1159110 (0.0010) [2023-12-26 08:50:44,265][123091] Updated weights for policy 0, policy_version 1159120 (0.0009) [2023-12-26 08:50:44,422][123090] Updated weights for policy 1, policy_version 1150753 (0.0009) [2023-12-26 08:50:44,488][123090] Updated weights for policy 1, policy_version 1150763 (0.0007) [2023-12-26 08:50:44,558][123090] Updated weights for policy 1, policy_version 1150773 (0.0005) [2023-12-26 08:50:44,632][123090] Updated weights for policy 1, policy_version 1150783 (0.0006) [2023-12-26 08:50:45,227][123091] Updated weights for policy 0, policy_version 1159130 (0.0010) [2023-12-26 08:50:45,293][123091] Updated weights for policy 0, policy_version 1159140 (0.0009) [2023-12-26 08:50:45,322][123090] Updated weights for policy 1, policy_version 1150793 (0.0006) [2023-12-26 08:50:45,356][123091] Updated weights for policy 0, policy_version 1159150 (0.0009) [2023-12-26 08:50:45,381][123090] Updated weights for policy 1, policy_version 1150803 (0.0006) [2023-12-26 08:50:45,430][123090] Updated weights for policy 1, policy_version 1150813 (0.0005) [2023-12-26 08:50:46,207][123091] Updated weights for policy 0, policy_version 1159160 (0.0010) [2023-12-26 08:50:46,249][123090] Updated weights for policy 1, policy_version 1150823 (0.0008) [2023-12-26 08:50:46,271][123091] Updated weights for policy 0, policy_version 1159170 (0.0007) [2023-12-26 08:50:46,312][123090] Updated weights for policy 1, policy_version 1150833 (0.0009) [2023-12-26 08:50:46,336][123091] Updated weights for policy 0, policy_version 1159180 (0.0010) [2023-12-26 08:50:46,373][123090] Updated weights for policy 1, policy_version 1150843 (0.0008) [2023-12-26 08:50:46,933][123091] Updated weights for policy 0, policy_version 1159190 (0.0005) [2023-12-26 08:50:47,000][123091] Updated weights for policy 0, policy_version 1159200 (0.0006) [2023-12-26 08:50:47,052][123091] Updated weights for policy 0, policy_version 1159210 (0.0006) [2023-12-26 08:50:47,257][123090] Updated weights for policy 1, policy_version 1150854 (0.0009) [2023-12-26 08:50:47,314][123090] Updated weights for policy 1, policy_version 1150864 (0.0010) [2023-12-26 08:50:47,366][123090] Updated weights for policy 1, policy_version 1150874 (0.0009) [2023-12-26 08:50:47,714][123091] Updated weights for policy 0, policy_version 1159220 (0.0005) [2023-12-26 08:50:47,777][123091] Updated weights for policy 0, policy_version 1159230 (0.0005) [2023-12-26 08:50:47,832][123091] Updated weights for policy 0, policy_version 1159240 (0.0005) [2023-12-26 08:50:48,210][123090] Updated weights for policy 1, policy_version 1150884 (0.0009) [2023-12-26 08:50:48,273][123090] Updated weights for policy 1, policy_version 1150894 (0.0010) [2023-12-26 08:50:48,340][123090] Updated weights for policy 1, policy_version 1150904 (0.0010) [2023-12-26 08:50:48,575][123091] Updated weights for policy 0, policy_version 1159250 (0.0006) [2023-12-26 08:50:48,625][123091] Updated weights for policy 0, policy_version 1159260 (0.0010) [2023-12-26 08:50:48,679][123091] Updated weights for policy 0, policy_version 1159271 (0.0010) [2023-12-26 08:50:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 591413248. Throughput: 0: 8624.6, 1: 8915.0. Samples: 591420164. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:48,785][121949] Avg episode reward: [(0, '6166.360'), (1, '5772.054')] [2023-12-26 08:50:49,084][123090] Updated weights for policy 1, policy_version 1150914 (0.0008) [2023-12-26 08:50:49,135][123090] Updated weights for policy 1, policy_version 1150924 (0.0005) [2023-12-26 08:50:49,184][123090] Updated weights for policy 1, policy_version 1150934 (0.0005) [2023-12-26 08:50:49,251][123090] Updated weights for policy 1, policy_version 1150944 (0.0008) [2023-12-26 08:50:49,646][123091] Updated weights for policy 0, policy_version 1159282 (0.0009) [2023-12-26 08:50:49,713][123091] Updated weights for policy 0, policy_version 1159292 (0.0010) [2023-12-26 08:50:49,781][123091] Updated weights for policy 0, policy_version 1159302 (0.0010) [2023-12-26 08:50:49,847][123091] Updated weights for policy 0, policy_version 1159312 (0.0008) [2023-12-26 08:50:50,036][123090] Updated weights for policy 1, policy_version 1150954 (0.0008) [2023-12-26 08:50:50,098][123090] Updated weights for policy 1, policy_version 1150964 (0.0008) [2023-12-26 08:50:50,153][123090] Updated weights for policy 1, policy_version 1150974 (0.0008) [2023-12-26 08:50:50,763][123091] Updated weights for policy 0, policy_version 1159322 (0.0009) [2023-12-26 08:50:50,830][123091] Updated weights for policy 0, policy_version 1159332 (0.0009) [2023-12-26 08:50:50,833][123090] Updated weights for policy 1, policy_version 1150984 (0.0006) [2023-12-26 08:50:50,891][123091] Updated weights for policy 0, policy_version 1159342 (0.0008) [2023-12-26 08:50:50,901][123090] Updated weights for policy 1, policy_version 1150994 (0.0007) [2023-12-26 08:50:50,961][123090] Updated weights for policy 1, policy_version 1151004 (0.0005) [2023-12-26 08:50:51,740][123090] Updated weights for policy 1, policy_version 1151014 (0.0009) [2023-12-26 08:50:51,789][123091] Updated weights for policy 0, policy_version 1159352 (0.0010) [2023-12-26 08:50:51,803][123090] Updated weights for policy 1, policy_version 1151024 (0.0008) [2023-12-26 08:50:51,844][123091] Updated weights for policy 0, policy_version 1159362 (0.0009) [2023-12-26 08:50:51,867][123090] Updated weights for policy 1, policy_version 1151034 (0.0009) [2023-12-26 08:50:51,901][123091] Updated weights for policy 0, policy_version 1159372 (0.0008) [2023-12-26 08:50:52,612][123090] Updated weights for policy 1, policy_version 1151044 (0.0009) [2023-12-26 08:50:52,670][123090] Updated weights for policy 1, policy_version 1151054 (0.0009) [2023-12-26 08:50:52,736][123090] Updated weights for policy 1, policy_version 1151064 (0.0010) [2023-12-26 08:50:52,810][123091] Updated weights for policy 0, policy_version 1159382 (0.0010) [2023-12-26 08:50:52,874][123091] Updated weights for policy 0, policy_version 1159393 (0.0010) [2023-12-26 08:50:52,935][123091] Updated weights for policy 0, policy_version 1159403 (0.0009) [2023-12-26 08:50:53,472][123090] Updated weights for policy 1, policy_version 1151074 (0.0009) [2023-12-26 08:50:53,532][123090] Updated weights for policy 1, policy_version 1151084 (0.0009) [2023-12-26 08:50:53,593][123090] Updated weights for policy 1, policy_version 1151094 (0.0010) [2023-12-26 08:50:53,653][123090] Updated weights for policy 1, policy_version 1151104 (0.0009) [2023-12-26 08:50:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 591495168. Throughput: 0: 8571.5, 1: 8886.9. Samples: 591472740. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 08:50:53,784][121949] Avg episode reward: [(0, '6233.644'), (1, '5739.585')] [2023-12-26 08:50:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001151104_294682624.pth... [2023-12-26 08:50:53,794][123091] Updated weights for policy 0, policy_version 1159413 (0.0009) [2023-12-26 08:50:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001150048_294412288.pth [2023-12-26 08:50:53,858][123091] Updated weights for policy 0, policy_version 1159423 (0.0009) [2023-12-26 08:50:53,923][123091] Updated weights for policy 0, policy_version 1159433 (0.0009) [2023-12-26 08:50:53,956][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001159440_296820736.pth... [2023-12-26 08:50:53,959][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001158416_296558592.pth [2023-12-26 08:50:54,449][123090] Updated weights for policy 1, policy_version 1151114 (0.0009) [2023-12-26 08:50:54,500][123090] Updated weights for policy 1, policy_version 1151124 (0.0009) [2023-12-26 08:50:54,561][123090] Updated weights for policy 1, policy_version 1151134 (0.0009) [2023-12-26 08:50:54,735][123091] Updated weights for policy 0, policy_version 1159443 (0.0010) [2023-12-26 08:50:54,783][123091] Updated weights for policy 0, policy_version 1159453 (0.0009) [2023-12-26 08:50:54,837][123091] Updated weights for policy 0, policy_version 1159463 (0.0009) [2023-12-26 08:50:55,451][123090] Updated weights for policy 1, policy_version 1151144 (0.0009) [2023-12-26 08:50:55,511][123090] Updated weights for policy 1, policy_version 1151154 (0.0009) [2023-12-26 08:50:55,565][123090] Updated weights for policy 1, policy_version 1151164 (0.0009) [2023-12-26 08:50:55,610][123091] Updated weights for policy 0, policy_version 1159473 (0.0009) [2023-12-26 08:50:55,667][123091] Updated weights for policy 0, policy_version 1159483 (0.0009) [2023-12-26 08:50:55,731][123091] Updated weights for policy 0, policy_version 1159493 (0.0010) [2023-12-26 08:50:55,792][123091] Updated weights for policy 0, policy_version 1159503 (0.0010) [2023-12-26 08:50:56,365][123090] Updated weights for policy 1, policy_version 1151174 (0.0010) [2023-12-26 08:50:56,421][123090] Updated weights for policy 1, policy_version 1151184 (0.0010) [2023-12-26 08:50:56,469][123090] Updated weights for policy 1, policy_version 1151194 (0.0009) [2023-12-26 08:50:56,628][123091] Updated weights for policy 0, policy_version 1159513 (0.0009) [2023-12-26 08:50:56,694][123091] Updated weights for policy 0, policy_version 1159523 (0.0008) [2023-12-26 08:50:56,761][123091] Updated weights for policy 0, policy_version 1159533 (0.0009) [2023-12-26 08:50:57,295][123090] Updated weights for policy 1, policy_version 1151204 (0.0010) [2023-12-26 08:50:57,357][123090] Updated weights for policy 1, policy_version 1151214 (0.0009) [2023-12-26 08:50:57,415][123090] Updated weights for policy 1, policy_version 1151224 (0.0009) [2023-12-26 08:50:57,558][123091] Updated weights for policy 0, policy_version 1159543 (0.0010) [2023-12-26 08:50:57,613][123091] Updated weights for policy 0, policy_version 1159553 (0.0009) [2023-12-26 08:50:57,682][123091] Updated weights for policy 0, policy_version 1159563 (0.0010) [2023-12-26 08:50:58,243][123090] Updated weights for policy 1, policy_version 1151234 (0.0009) [2023-12-26 08:50:58,318][123090] Updated weights for policy 1, policy_version 1151244 (0.0006) [2023-12-26 08:50:58,394][123090] Updated weights for policy 1, policy_version 1151254 (0.0008) [2023-12-26 08:50:58,456][123090] Updated weights for policy 1, policy_version 1151264 (0.0008) [2023-12-26 08:50:58,541][123091] Updated weights for policy 0, policy_version 1159573 (0.0009) [2023-12-26 08:50:58,617][123091] Updated weights for policy 0, policy_version 1159583 (0.0008) [2023-12-26 08:50:58,683][123091] Updated weights for policy 0, policy_version 1159593 (0.0009) [2023-12-26 08:50:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 591585280. Throughput: 0: 8571.0, 1: 8909.0. Samples: 591576712. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:50:58,785][121949] Avg episode reward: [(0, '6272.067'), (1, '5699.080')] [2023-12-26 08:50:59,272][123090] Updated weights for policy 1, policy_version 1151274 (0.0008) [2023-12-26 08:50:59,345][123090] Updated weights for policy 1, policy_version 1151284 (0.0008) [2023-12-26 08:50:59,420][123090] Updated weights for policy 1, policy_version 1151294 (0.0008) [2023-12-26 08:50:59,558][123091] Updated weights for policy 0, policy_version 1159604 (0.0008) [2023-12-26 08:50:59,621][123091] Updated weights for policy 0, policy_version 1159614 (0.0005) [2023-12-26 08:50:59,686][123091] Updated weights for policy 0, policy_version 1159624 (0.0005) [2023-12-26 08:51:00,181][123090] Updated weights for policy 1, policy_version 1151304 (0.0009) [2023-12-26 08:51:00,239][123090] Updated weights for policy 1, policy_version 1151314 (0.0010) [2023-12-26 08:51:00,293][123090] Updated weights for policy 1, policy_version 1151324 (0.0010) [2023-12-26 08:51:00,372][123091] Updated weights for policy 0, policy_version 1159634 (0.0006) [2023-12-26 08:51:00,440][123091] Updated weights for policy 0, policy_version 1159644 (0.0006) [2023-12-26 08:51:00,499][123091] Updated weights for policy 0, policy_version 1159654 (0.0006) [2023-12-26 08:51:00,569][123091] Updated weights for policy 0, policy_version 1159664 (0.0005) [2023-12-26 08:51:01,176][123091] Updated weights for policy 0, policy_version 1159674 (0.0006) [2023-12-26 08:51:01,191][123090] Updated weights for policy 1, policy_version 1151334 (0.0010) [2023-12-26 08:51:01,229][123091] Updated weights for policy 0, policy_version 1159684 (0.0006) [2023-12-26 08:51:01,243][123090] Updated weights for policy 1, policy_version 1151344 (0.0010) [2023-12-26 08:51:01,292][123091] Updated weights for policy 0, policy_version 1159694 (0.0011) [2023-12-26 08:51:01,306][123090] Updated weights for policy 1, policy_version 1151354 (0.0010) [2023-12-26 08:51:02,084][123090] Updated weights for policy 1, policy_version 1151364 (0.0009) [2023-12-26 08:51:02,136][123091] Updated weights for policy 0, policy_version 1159704 (0.0010) [2023-12-26 08:51:02,151][123090] Updated weights for policy 1, policy_version 1151374 (0.0005) [2023-12-26 08:51:02,190][123091] Updated weights for policy 0, policy_version 1159714 (0.0010) [2023-12-26 08:51:02,213][123090] Updated weights for policy 1, policy_version 1151384 (0.0009) [2023-12-26 08:51:02,244][123091] Updated weights for policy 0, policy_version 1159724 (0.0010) [2023-12-26 08:51:03,004][123090] Updated weights for policy 1, policy_version 1151394 (0.0009) [2023-12-26 08:51:03,068][123091] Updated weights for policy 0, policy_version 1159734 (0.0010) [2023-12-26 08:51:03,070][123090] Updated weights for policy 1, policy_version 1151404 (0.0006) [2023-12-26 08:51:03,115][123091] Updated weights for policy 0, policy_version 1159744 (0.0010) [2023-12-26 08:51:03,126][123090] Updated weights for policy 1, policy_version 1151414 (0.0005) [2023-12-26 08:51:03,166][123091] Updated weights for policy 0, policy_version 1159754 (0.0010) [2023-12-26 08:51:03,173][123090] Updated weights for policy 1, policy_version 1151424 (0.0006) [2023-12-26 08:51:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 591667200. Throughput: 0: 8574.9, 1: 8847.7. Samples: 591682204. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:03,784][121949] Avg episode reward: [(0, '6237.404'), (1, '5661.764')] [2023-12-26 08:51:03,867][123091] Updated weights for policy 0, policy_version 1159764 (0.0009) [2023-12-26 08:51:03,933][123091] Updated weights for policy 0, policy_version 1159774 (0.0009) [2023-12-26 08:51:03,994][123091] Updated weights for policy 0, policy_version 1159784 (0.0010) [2023-12-26 08:51:04,025][123090] Updated weights for policy 1, policy_version 1151434 (0.0008) [2023-12-26 08:51:04,082][123090] Updated weights for policy 1, policy_version 1151444 (0.0009) [2023-12-26 08:51:04,150][123090] Updated weights for policy 1, policy_version 1151454 (0.0007) [2023-12-26 08:51:04,764][123090] Updated weights for policy 1, policy_version 1151464 (0.0006) [2023-12-26 08:51:04,801][123091] Updated weights for policy 0, policy_version 1159794 (0.0010) [2023-12-26 08:51:04,819][123090] Updated weights for policy 1, policy_version 1151474 (0.0005) [2023-12-26 08:51:04,852][123091] Updated weights for policy 0, policy_version 1159804 (0.0009) [2023-12-26 08:51:04,876][123090] Updated weights for policy 1, policy_version 1151484 (0.0006) [2023-12-26 08:51:04,902][123091] Updated weights for policy 0, policy_version 1159814 (0.0009) [2023-12-26 08:51:05,623][123090] Updated weights for policy 1, policy_version 1151494 (0.0008) [2023-12-26 08:51:05,686][123090] Updated weights for policy 1, policy_version 1151504 (0.0009) [2023-12-26 08:51:05,748][123090] Updated weights for policy 1, policy_version 1151514 (0.0009) [2023-12-26 08:51:05,804][123091] Updated weights for policy 0, policy_version 1159826 (0.0011) [2023-12-26 08:51:05,870][123091] Updated weights for policy 0, policy_version 1159836 (0.0009) [2023-12-26 08:51:05,929][123091] Updated weights for policy 0, policy_version 1159846 (0.0009) [2023-12-26 08:51:05,980][123091] Updated weights for policy 0, policy_version 1159856 (0.0010) [2023-12-26 08:51:06,513][123090] Updated weights for policy 1, policy_version 1151524 (0.0009) [2023-12-26 08:51:06,573][123090] Updated weights for policy 1, policy_version 1151534 (0.0009) [2023-12-26 08:51:06,626][123090] Updated weights for policy 1, policy_version 1151544 (0.0007) [2023-12-26 08:51:06,880][123091] Updated weights for policy 0, policy_version 1159866 (0.0009) [2023-12-26 08:51:06,937][123091] Updated weights for policy 0, policy_version 1159876 (0.0009) [2023-12-26 08:51:06,985][123091] Updated weights for policy 0, policy_version 1159886 (0.0009) [2023-12-26 08:51:07,486][123090] Updated weights for policy 1, policy_version 1151554 (0.0008) [2023-12-26 08:51:07,539][123090] Updated weights for policy 1, policy_version 1151564 (0.0007) [2023-12-26 08:51:07,594][123090] Updated weights for policy 1, policy_version 1151574 (0.0009) [2023-12-26 08:51:07,647][123090] Updated weights for policy 1, policy_version 1151584 (0.0009) [2023-12-26 08:51:07,837][123091] Updated weights for policy 0, policy_version 1159896 (0.0009) [2023-12-26 08:51:07,896][123091] Updated weights for policy 0, policy_version 1159906 (0.0010) [2023-12-26 08:51:07,950][123091] Updated weights for policy 0, policy_version 1159916 (0.0010) [2023-12-26 08:51:08,436][123090] Updated weights for policy 1, policy_version 1151594 (0.0010) [2023-12-26 08:51:08,492][123090] Updated weights for policy 1, policy_version 1151604 (0.0009) [2023-12-26 08:51:08,543][123090] Updated weights for policy 1, policy_version 1151614 (0.0010) [2023-12-26 08:51:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 591757312. Throughput: 0: 8562.6, 1: 8931.5. Samples: 591735156. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:08,785][121949] Avg episode reward: [(0, '6195.701'), (1, '5637.970')] [2023-12-26 08:51:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001151616_294813696.pth... [2023-12-26 08:51:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001150592_294551552.pth [2023-12-26 08:51:08,812][123091] Updated weights for policy 0, policy_version 1159927 (0.0009) [2023-12-26 08:51:08,869][123091] Updated weights for policy 0, policy_version 1159937 (0.0010) [2023-12-26 08:51:08,934][123091] Updated weights for policy 0, policy_version 1159947 (0.0009) [2023-12-26 08:51:08,972][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001159952_296951808.pth... [2023-12-26 08:51:08,977][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001158928_296689664.pth [2023-12-26 08:51:09,300][123090] Updated weights for policy 1, policy_version 1151624 (0.0008) [2023-12-26 08:51:09,387][123090] Updated weights for policy 1, policy_version 1151634 (0.0008) [2023-12-26 08:51:09,460][123090] Updated weights for policy 1, policy_version 1151644 (0.0006) [2023-12-26 08:51:09,812][123091] Updated weights for policy 0, policy_version 1159957 (0.0009) [2023-12-26 08:51:09,884][123091] Updated weights for policy 0, policy_version 1159967 (0.0009) [2023-12-26 08:51:09,954][123091] Updated weights for policy 0, policy_version 1159977 (0.0009) [2023-12-26 08:51:10,262][123090] Updated weights for policy 1, policy_version 1151654 (0.0008) [2023-12-26 08:51:10,331][123090] Updated weights for policy 1, policy_version 1151664 (0.0009) [2023-12-26 08:51:10,388][123090] Updated weights for policy 1, policy_version 1151674 (0.0007) [2023-12-26 08:51:10,808][123091] Updated weights for policy 0, policy_version 1159987 (0.0008) [2023-12-26 08:51:10,874][123091] Updated weights for policy 0, policy_version 1159997 (0.0006) [2023-12-26 08:51:10,932][123091] Updated weights for policy 0, policy_version 1160007 (0.0009) [2023-12-26 08:51:11,102][123090] Updated weights for policy 1, policy_version 1151684 (0.0006) [2023-12-26 08:51:11,178][123090] Updated weights for policy 1, policy_version 1151694 (0.0008) [2023-12-26 08:51:11,248][123090] Updated weights for policy 1, policy_version 1151704 (0.0008) [2023-12-26 08:51:11,762][123091] Updated weights for policy 0, policy_version 1160017 (0.0010) [2023-12-26 08:51:11,834][123091] Updated weights for policy 0, policy_version 1160027 (0.0009) [2023-12-26 08:51:11,900][123091] Updated weights for policy 0, policy_version 1160037 (0.0009) [2023-12-26 08:51:11,970][123091] Updated weights for policy 0, policy_version 1160047 (0.0010) [2023-12-26 08:51:12,079][123090] Updated weights for policy 1, policy_version 1151714 (0.0009) [2023-12-26 08:51:12,152][123090] Updated weights for policy 1, policy_version 1151724 (0.0009) [2023-12-26 08:51:12,215][123090] Updated weights for policy 1, policy_version 1151734 (0.0009) [2023-12-26 08:51:12,284][123090] Updated weights for policy 1, policy_version 1151744 (0.0010) [2023-12-26 08:51:12,757][123091] Updated weights for policy 0, policy_version 1160057 (0.0007) [2023-12-26 08:51:12,825][123091] Updated weights for policy 0, policy_version 1160067 (0.0010) [2023-12-26 08:51:12,874][123091] Updated weights for policy 0, policy_version 1160077 (0.0009) [2023-12-26 08:51:13,108][123090] Updated weights for policy 1, policy_version 1151754 (0.0010) [2023-12-26 08:51:13,168][123090] Updated weights for policy 1, policy_version 1151764 (0.0009) [2023-12-26 08:51:13,221][123090] Updated weights for policy 1, policy_version 1151774 (0.0009) [2023-12-26 08:51:13,711][123091] Updated weights for policy 0, policy_version 1160088 (0.0006) [2023-12-26 08:51:13,765][123091] Updated weights for policy 0, policy_version 1160098 (0.0010) [2023-12-26 08:51:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 591839232. Throughput: 0: 8578.4, 1: 8886.9. Samples: 591837820. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:13,785][121949] Avg episode reward: [(0, '6084.574'), (1, '5693.884')] [2023-12-26 08:51:13,823][123091] Updated weights for policy 0, policy_version 1160108 (0.0010) [2023-12-26 08:51:14,062][123090] Updated weights for policy 1, policy_version 1151784 (0.0006) [2023-12-26 08:51:14,118][123090] Updated weights for policy 1, policy_version 1151794 (0.0009) [2023-12-26 08:51:14,174][123090] Updated weights for policy 1, policy_version 1151804 (0.0009) [2023-12-26 08:51:14,604][123091] Updated weights for policy 0, policy_version 1160118 (0.0007) [2023-12-26 08:51:14,648][123091] Updated weights for policy 0, policy_version 1160128 (0.0005) [2023-12-26 08:51:14,698][123091] Updated weights for policy 0, policy_version 1160138 (0.0005) [2023-12-26 08:51:14,984][123090] Updated weights for policy 1, policy_version 1151814 (0.0009) [2023-12-26 08:51:15,047][123090] Updated weights for policy 1, policy_version 1151824 (0.0009) [2023-12-26 08:51:15,104][123090] Updated weights for policy 1, policy_version 1151834 (0.0010) [2023-12-26 08:51:15,438][123091] Updated weights for policy 0, policy_version 1160148 (0.0007) [2023-12-26 08:51:15,499][123091] Updated weights for policy 0, policy_version 1160158 (0.0009) [2023-12-26 08:51:15,567][123091] Updated weights for policy 0, policy_version 1160168 (0.0010) [2023-12-26 08:51:15,981][123090] Updated weights for policy 1, policy_version 1151844 (0.0010) [2023-12-26 08:51:16,043][123090] Updated weights for policy 1, policy_version 1151854 (0.0010) [2023-12-26 08:51:16,098][123090] Updated weights for policy 1, policy_version 1151865 (0.0010) [2023-12-26 08:51:16,385][123091] Updated weights for policy 0, policy_version 1160178 (0.0008) [2023-12-26 08:51:16,445][123091] Updated weights for policy 0, policy_version 1160188 (0.0010) [2023-12-26 08:51:16,502][123091] Updated weights for policy 0, policy_version 1160198 (0.0009) [2023-12-26 08:51:16,557][123091] Updated weights for policy 0, policy_version 1160208 (0.0009) [2023-12-26 08:51:16,965][123090] Updated weights for policy 1, policy_version 1151875 (0.0009) [2023-12-26 08:51:17,020][123090] Updated weights for policy 1, policy_version 1151885 (0.0009) [2023-12-26 08:51:17,080][123090] Updated weights for policy 1, policy_version 1151895 (0.0006) [2023-12-26 08:51:17,312][123091] Updated weights for policy 0, policy_version 1160218 (0.0008) [2023-12-26 08:51:17,375][123091] Updated weights for policy 0, policy_version 1160228 (0.0011) [2023-12-26 08:51:17,444][123091] Updated weights for policy 0, policy_version 1160238 (0.0006) [2023-12-26 08:51:17,917][123090] Updated weights for policy 1, policy_version 1151905 (0.0007) [2023-12-26 08:51:17,982][123090] Updated weights for policy 1, policy_version 1151915 (0.0005) [2023-12-26 08:51:18,039][123090] Updated weights for policy 1, policy_version 1151925 (0.0006) [2023-12-26 08:51:18,112][123090] Updated weights for policy 1, policy_version 1151935 (0.0008) [2023-12-26 08:51:18,148][123091] Updated weights for policy 0, policy_version 1160248 (0.0006) [2023-12-26 08:51:18,205][123091] Updated weights for policy 0, policy_version 1160258 (0.0009) [2023-12-26 08:51:18,264][123091] Updated weights for policy 0, policy_version 1160268 (0.0009) [2023-12-26 08:51:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 591929344. Throughput: 0: 8621.2, 1: 8809.0. Samples: 591943292. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:18,784][121949] Avg episode reward: [(0, '5987.183'), (1, '5805.495')] [2023-12-26 08:51:18,861][123090] Updated weights for policy 1, policy_version 1151945 (0.0009) [2023-12-26 08:51:18,932][123090] Updated weights for policy 1, policy_version 1151955 (0.0008) [2023-12-26 08:51:18,993][123090] Updated weights for policy 1, policy_version 1151965 (0.0007) [2023-12-26 08:51:19,093][123091] Updated weights for policy 0, policy_version 1160278 (0.0006) [2023-12-26 08:51:19,140][123091] Updated weights for policy 0, policy_version 1160288 (0.0005) [2023-12-26 08:51:19,187][123091] Updated weights for policy 0, policy_version 1160298 (0.0005) [2023-12-26 08:51:19,691][123090] Updated weights for policy 1, policy_version 1151975 (0.0006) [2023-12-26 08:51:19,760][123090] Updated weights for policy 1, policy_version 1151985 (0.0006) [2023-12-26 08:51:19,825][123090] Updated weights for policy 1, policy_version 1151995 (0.0007) [2023-12-26 08:51:20,063][123091] Updated weights for policy 0, policy_version 1160308 (0.0009) [2023-12-26 08:51:20,122][123091] Updated weights for policy 0, policy_version 1160318 (0.0009) [2023-12-26 08:51:20,183][123091] Updated weights for policy 0, policy_version 1160328 (0.0009) [2023-12-26 08:51:20,554][123090] Updated weights for policy 1, policy_version 1152005 (0.0009) [2023-12-26 08:51:20,622][123090] Updated weights for policy 1, policy_version 1152015 (0.0008) [2023-12-26 08:51:20,697][123090] Updated weights for policy 1, policy_version 1152025 (0.0007) [2023-12-26 08:51:21,093][123091] Updated weights for policy 0, policy_version 1160338 (0.0010) [2023-12-26 08:51:21,168][123091] Updated weights for policy 0, policy_version 1160348 (0.0010) [2023-12-26 08:51:21,236][123091] Updated weights for policy 0, policy_version 1160358 (0.0010) [2023-12-26 08:51:21,305][123091] Updated weights for policy 0, policy_version 1160368 (0.0009) [2023-12-26 08:51:21,548][123090] Updated weights for policy 1, policy_version 1152035 (0.0008) [2023-12-26 08:51:21,624][123090] Updated weights for policy 1, policy_version 1152045 (0.0007) [2023-12-26 08:51:21,697][123090] Updated weights for policy 1, policy_version 1152055 (0.0010) [2023-12-26 08:51:22,184][123091] Updated weights for policy 0, policy_version 1160378 (0.0008) [2023-12-26 08:51:22,249][123091] Updated weights for policy 0, policy_version 1160388 (0.0009) [2023-12-26 08:51:22,322][123091] Updated weights for policy 0, policy_version 1160398 (0.0008) [2023-12-26 08:51:22,552][123090] Updated weights for policy 1, policy_version 1152065 (0.0009) [2023-12-26 08:51:22,624][123090] Updated weights for policy 1, policy_version 1152075 (0.0009) [2023-12-26 08:51:22,691][123090] Updated weights for policy 1, policy_version 1152085 (0.0009) [2023-12-26 08:51:22,755][123090] Updated weights for policy 1, policy_version 1152095 (0.0010) [2023-12-26 08:51:22,966][123091] Updated weights for policy 0, policy_version 1160408 (0.0009) [2023-12-26 08:51:23,023][123091] Updated weights for policy 0, policy_version 1160418 (0.0010) [2023-12-26 08:51:23,073][123091] Updated weights for policy 0, policy_version 1160428 (0.0009) [2023-12-26 08:51:23,570][123090] Updated weights for policy 1, policy_version 1152105 (0.0010) [2023-12-26 08:51:23,620][123090] Updated weights for policy 1, policy_version 1152115 (0.0009) [2023-12-26 08:51:23,669][123090] Updated weights for policy 1, policy_version 1152125 (0.0009) [2023-12-26 08:51:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.4, 300 sec: 17633.6). Total num frames: 592019456. Throughput: 0: 8612.0, 1: 8851.9. Samples: 591995628. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:23,784][121949] Avg episode reward: [(0, '5929.449'), (1, '5800.744')] [2023-12-26 08:51:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001152128_294944768.pth... [2023-12-26 08:51:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001160432_297074688.pth... [2023-12-26 08:51:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001151104_294682624.pth [2023-12-26 08:51:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001159440_296820736.pth [2023-12-26 08:51:23,932][123091] Updated weights for policy 0, policy_version 1160438 (0.0010) [2023-12-26 08:51:23,987][123091] Updated weights for policy 0, policy_version 1160448 (0.0007) [2023-12-26 08:51:24,031][123091] Updated weights for policy 0, policy_version 1160458 (0.0005) [2023-12-26 08:51:24,528][123090] Updated weights for policy 1, policy_version 1152135 (0.0010) [2023-12-26 08:51:24,582][123090] Updated weights for policy 1, policy_version 1152145 (0.0008) [2023-12-26 08:51:24,636][123090] Updated weights for policy 1, policy_version 1152155 (0.0009) [2023-12-26 08:51:24,860][123091] Updated weights for policy 0, policy_version 1160468 (0.0008) [2023-12-26 08:51:24,926][123091] Updated weights for policy 0, policy_version 1160478 (0.0010) [2023-12-26 08:51:24,992][123091] Updated weights for policy 0, policy_version 1160488 (0.0009) [2023-12-26 08:51:25,273][123090] Updated weights for policy 1, policy_version 1152165 (0.0006) [2023-12-26 08:51:25,328][123090] Updated weights for policy 1, policy_version 1152175 (0.0005) [2023-12-26 08:51:25,386][123090] Updated weights for policy 1, policy_version 1152185 (0.0005) [2023-12-26 08:51:25,762][123091] Updated weights for policy 0, policy_version 1160498 (0.0009) [2023-12-26 08:51:25,832][123091] Updated weights for policy 0, policy_version 1160508 (0.0006) [2023-12-26 08:51:25,883][123091] Updated weights for policy 0, policy_version 1160518 (0.0006) [2023-12-26 08:51:25,935][123091] Updated weights for policy 0, policy_version 1160528 (0.0006) [2023-12-26 08:51:26,017][123090] Updated weights for policy 1, policy_version 1152195 (0.0007) [2023-12-26 08:51:26,072][123090] Updated weights for policy 1, policy_version 1152205 (0.0010) [2023-12-26 08:51:26,130][123090] Updated weights for policy 1, policy_version 1152215 (0.0010) [2023-12-26 08:51:26,674][123091] Updated weights for policy 0, policy_version 1160538 (0.0005) [2023-12-26 08:51:26,733][123091] Updated weights for policy 0, policy_version 1160548 (0.0005) [2023-12-26 08:51:26,779][123091] Updated weights for policy 0, policy_version 1160558 (0.0005) [2023-12-26 08:51:26,845][123090] Updated weights for policy 1, policy_version 1152225 (0.0009) [2023-12-26 08:51:26,915][123090] Updated weights for policy 1, policy_version 1152235 (0.0005) [2023-12-26 08:51:26,963][123090] Updated weights for policy 1, policy_version 1152245 (0.0005) [2023-12-26 08:51:27,013][123090] Updated weights for policy 1, policy_version 1152255 (0.0005) [2023-12-26 08:51:27,564][123091] Updated weights for policy 0, policy_version 1160568 (0.0005) [2023-12-26 08:51:27,616][123091] Updated weights for policy 0, policy_version 1160578 (0.0007) [2023-12-26 08:51:27,670][123091] Updated weights for policy 0, policy_version 1160588 (0.0009) [2023-12-26 08:51:27,754][123090] Updated weights for policy 1, policy_version 1152265 (0.0010) [2023-12-26 08:51:27,805][123090] Updated weights for policy 1, policy_version 1152275 (0.0010) [2023-12-26 08:51:27,852][123090] Updated weights for policy 1, policy_version 1152285 (0.0010) [2023-12-26 08:51:28,496][123091] Updated weights for policy 0, policy_version 1160598 (0.0005) [2023-12-26 08:51:28,546][123091] Updated weights for policy 0, policy_version 1160608 (0.0006) [2023-12-26 08:51:28,604][123091] Updated weights for policy 0, policy_version 1160618 (0.0010) [2023-12-26 08:51:28,657][123090] Updated weights for policy 1, policy_version 1152295 (0.0010) [2023-12-26 08:51:28,711][123090] Updated weights for policy 1, policy_version 1152305 (0.0010) [2023-12-26 08:51:28,763][123090] Updated weights for policy 1, policy_version 1152315 (0.0010) [2023-12-26 08:51:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 592109568. Throughput: 0: 8704.3, 1: 8888.4. Samples: 592105196. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:28,784][121949] Avg episode reward: [(0, '5986.038'), (1, '5711.276')] [2023-12-26 08:51:29,305][123091] Updated weights for policy 0, policy_version 1160628 (0.0010) [2023-12-26 08:51:29,373][123091] Updated weights for policy 0, policy_version 1160638 (0.0008) [2023-12-26 08:51:29,442][123091] Updated weights for policy 0, policy_version 1160648 (0.0006) [2023-12-26 08:51:29,578][123090] Updated weights for policy 1, policy_version 1152325 (0.0009) [2023-12-26 08:51:29,643][123090] Updated weights for policy 1, policy_version 1152335 (0.0009) [2023-12-26 08:51:29,695][123090] Updated weights for policy 1, policy_version 1152345 (0.0006) [2023-12-26 08:51:30,226][123091] Updated weights for policy 0, policy_version 1160658 (0.0006) [2023-12-26 08:51:30,288][123091] Updated weights for policy 0, policy_version 1160668 (0.0010) [2023-12-26 08:51:30,339][123091] Updated weights for policy 0, policy_version 1160678 (0.0010) [2023-12-26 08:51:30,368][123090] Updated weights for policy 1, policy_version 1152355 (0.0006) [2023-12-26 08:51:30,400][123091] Updated weights for policy 0, policy_version 1160688 (0.0006) [2023-12-26 08:51:30,428][123090] Updated weights for policy 1, policy_version 1152365 (0.0010) [2023-12-26 08:51:30,483][123090] Updated weights for policy 1, policy_version 1152375 (0.0009) [2023-12-26 08:51:31,183][123091] Updated weights for policy 0, policy_version 1160698 (0.0010) [2023-12-26 08:51:31,242][123091] Updated weights for policy 0, policy_version 1160708 (0.0010) [2023-12-26 08:51:31,314][123091] Updated weights for policy 0, policy_version 1160718 (0.0007) [2023-12-26 08:51:31,347][123090] Updated weights for policy 1, policy_version 1152385 (0.0009) [2023-12-26 08:51:31,415][123090] Updated weights for policy 1, policy_version 1152395 (0.0007) [2023-12-26 08:51:31,481][123090] Updated weights for policy 1, policy_version 1152405 (0.0005) [2023-12-26 08:51:31,559][123090] Updated weights for policy 1, policy_version 1152415 (0.0005) [2023-12-26 08:51:32,119][123091] Updated weights for policy 0, policy_version 1160728 (0.0006) [2023-12-26 08:51:32,174][123091] Updated weights for policy 0, policy_version 1160738 (0.0006) [2023-12-26 08:51:32,231][123090] Updated weights for policy 1, policy_version 1152425 (0.0006) [2023-12-26 08:51:32,244][123091] Updated weights for policy 0, policy_version 1160748 (0.0006) [2023-12-26 08:51:32,291][123090] Updated weights for policy 1, policy_version 1152435 (0.0009) [2023-12-26 08:51:32,348][123090] Updated weights for policy 1, policy_version 1152445 (0.0009) [2023-12-26 08:51:32,965][123091] Updated weights for policy 0, policy_version 1160758 (0.0008) [2023-12-26 08:51:33,021][123091] Updated weights for policy 0, policy_version 1160768 (0.0005) [2023-12-26 08:51:33,071][123091] Updated weights for policy 0, policy_version 1160778 (0.0009) [2023-12-26 08:51:33,130][123090] Updated weights for policy 1, policy_version 1152455 (0.0008) [2023-12-26 08:51:33,195][123090] Updated weights for policy 1, policy_version 1152465 (0.0007) [2023-12-26 08:51:33,260][123090] Updated weights for policy 1, policy_version 1152475 (0.0010) [2023-12-26 08:51:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 592199680. Throughput: 0: 8709.2, 1: 8962.6. Samples: 592215392. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:33,784][121949] Avg episode reward: [(0, '6022.275'), (1, '5810.607')] [2023-12-26 08:51:33,813][123091] Updated weights for policy 0, policy_version 1160788 (0.0007) [2023-12-26 08:51:33,862][123091] Updated weights for policy 0, policy_version 1160798 (0.0010) [2023-12-26 08:51:33,913][123091] Updated weights for policy 0, policy_version 1160808 (0.0010) [2023-12-26 08:51:33,973][123090] Updated weights for policy 1, policy_version 1152485 (0.0010) [2023-12-26 08:51:34,020][123090] Updated weights for policy 1, policy_version 1152495 (0.0010) [2023-12-26 08:51:34,074][123090] Updated weights for policy 1, policy_version 1152505 (0.0010) [2023-12-26 08:51:34,608][123091] Updated weights for policy 0, policy_version 1160818 (0.0009) [2023-12-26 08:51:34,682][123091] Updated weights for policy 0, policy_version 1160828 (0.0006) [2023-12-26 08:51:34,738][123091] Updated weights for policy 0, policy_version 1160838 (0.0009) [2023-12-26 08:51:34,790][123091] Updated weights for policy 0, policy_version 1160848 (0.0010) [2023-12-26 08:51:34,830][123090] Updated weights for policy 1, policy_version 1152515 (0.0006) [2023-12-26 08:51:34,892][123090] Updated weights for policy 1, policy_version 1152525 (0.0006) [2023-12-26 08:51:34,958][123090] Updated weights for policy 1, policy_version 1152535 (0.0008) [2023-12-26 08:51:35,499][123091] Updated weights for policy 0, policy_version 1160858 (0.0005) [2023-12-26 08:51:35,561][123091] Updated weights for policy 0, policy_version 1160868 (0.0006) [2023-12-26 08:51:35,613][123091] Updated weights for policy 0, policy_version 1160878 (0.0008) [2023-12-26 08:51:35,724][123090] Updated weights for policy 1, policy_version 1152545 (0.0008) [2023-12-26 08:51:35,787][123090] Updated weights for policy 1, policy_version 1152555 (0.0007) [2023-12-26 08:51:35,847][123090] Updated weights for policy 1, policy_version 1152565 (0.0007) [2023-12-26 08:51:35,901][123090] Updated weights for policy 1, policy_version 1152575 (0.0006) [2023-12-26 08:51:36,286][123091] Updated weights for policy 0, policy_version 1160888 (0.0007) [2023-12-26 08:51:36,349][123091] Updated weights for policy 0, policy_version 1160898 (0.0009) [2023-12-26 08:51:36,403][123091] Updated weights for policy 0, policy_version 1160908 (0.0010) [2023-12-26 08:51:36,673][123090] Updated weights for policy 1, policy_version 1152585 (0.0009) [2023-12-26 08:51:36,746][123090] Updated weights for policy 1, policy_version 1152595 (0.0009) [2023-12-26 08:51:36,805][123090] Updated weights for policy 1, policy_version 1152605 (0.0007) [2023-12-26 08:51:37,270][123091] Updated weights for policy 0, policy_version 1160918 (0.0010) [2023-12-26 08:51:37,327][123091] Updated weights for policy 0, policy_version 1160928 (0.0010) [2023-12-26 08:51:37,391][123091] Updated weights for policy 0, policy_version 1160938 (0.0009) [2023-12-26 08:51:37,561][123090] Updated weights for policy 1, policy_version 1152615 (0.0009) [2023-12-26 08:51:37,627][123090] Updated weights for policy 1, policy_version 1152625 (0.0009) [2023-12-26 08:51:37,693][123090] Updated weights for policy 1, policy_version 1152635 (0.0009) [2023-12-26 08:51:38,197][123091] Updated weights for policy 0, policy_version 1160948 (0.0009) [2023-12-26 08:51:38,255][123091] Updated weights for policy 0, policy_version 1160958 (0.0010) [2023-12-26 08:51:38,332][123091] Updated weights for policy 0, policy_version 1160968 (0.0010) [2023-12-26 08:51:38,521][123090] Updated weights for policy 1, policy_version 1152645 (0.0008) [2023-12-26 08:51:38,589][123090] Updated weights for policy 1, policy_version 1152655 (0.0009) [2023-12-26 08:51:38,653][123090] Updated weights for policy 1, policy_version 1152665 (0.0009) [2023-12-26 08:51:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 592297984. Throughput: 0: 8824.1, 1: 8936.7. Samples: 592271976. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:38,785][121949] Avg episode reward: [(0, '6212.736'), (1, '5772.597')] [2023-12-26 08:51:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001160976_297213952.pth... [2023-12-26 08:51:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001152672_295084032.pth... [2023-12-26 08:51:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001159952_296951808.pth [2023-12-26 08:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001151616_294813696.pth [2023-12-26 08:51:39,090][123091] Updated weights for policy 0, policy_version 1160978 (0.0010) [2023-12-26 08:51:39,139][123091] Updated weights for policy 0, policy_version 1160988 (0.0005) [2023-12-26 08:51:39,186][123091] Updated weights for policy 0, policy_version 1160998 (0.0009) [2023-12-26 08:51:39,245][123091] Updated weights for policy 0, policy_version 1161008 (0.0010) [2023-12-26 08:51:39,521][123090] Updated weights for policy 1, policy_version 1152675 (0.0009) [2023-12-26 08:51:39,575][123090] Updated weights for policy 1, policy_version 1152685 (0.0009) [2023-12-26 08:51:39,636][123090] Updated weights for policy 1, policy_version 1152695 (0.0008) [2023-12-26 08:51:40,062][123091] Updated weights for policy 0, policy_version 1161018 (0.0006) [2023-12-26 08:51:40,131][123091] Updated weights for policy 0, policy_version 1161028 (0.0006) [2023-12-26 08:51:40,193][123091] Updated weights for policy 0, policy_version 1161038 (0.0006) [2023-12-26 08:51:40,463][123090] Updated weights for policy 1, policy_version 1152705 (0.0007) [2023-12-26 08:51:40,530][123090] Updated weights for policy 1, policy_version 1152715 (0.0007) [2023-12-26 08:51:40,584][123090] Updated weights for policy 1, policy_version 1152725 (0.0010) [2023-12-26 08:51:40,642][123090] Updated weights for policy 1, policy_version 1152735 (0.0009) [2023-12-26 08:51:40,895][123091] Updated weights for policy 0, policy_version 1161048 (0.0009) [2023-12-26 08:51:40,944][123091] Updated weights for policy 0, policy_version 1161058 (0.0009) [2023-12-26 08:51:41,003][123091] Updated weights for policy 0, policy_version 1161069 (0.0010) [2023-12-26 08:51:41,432][123090] Updated weights for policy 1, policy_version 1152745 (0.0009) [2023-12-26 08:51:41,505][123090] Updated weights for policy 1, policy_version 1152755 (0.0010) [2023-12-26 08:51:41,576][123090] Updated weights for policy 1, policy_version 1152765 (0.0011) [2023-12-26 08:51:41,864][123091] Updated weights for policy 0, policy_version 1161079 (0.0009) [2023-12-26 08:51:41,927][123091] Updated weights for policy 0, policy_version 1161089 (0.0009) [2023-12-26 08:51:41,981][123091] Updated weights for policy 0, policy_version 1161099 (0.0009) [2023-12-26 08:51:42,470][123090] Updated weights for policy 1, policy_version 1152775 (0.0010) [2023-12-26 08:51:42,541][123090] Updated weights for policy 1, policy_version 1152785 (0.0010) [2023-12-26 08:51:42,605][123090] Updated weights for policy 1, policy_version 1152795 (0.0010) [2023-12-26 08:51:42,890][123091] Updated weights for policy 0, policy_version 1161109 (0.0010) [2023-12-26 08:51:42,954][123091] Updated weights for policy 0, policy_version 1161119 (0.0011) [2023-12-26 08:51:43,021][123091] Updated weights for policy 0, policy_version 1161129 (0.0010) [2023-12-26 08:51:43,413][123090] Updated weights for policy 1, policy_version 1152805 (0.0010) [2023-12-26 08:51:43,460][123090] Updated weights for policy 1, policy_version 1152815 (0.0010) [2023-12-26 08:51:43,519][123090] Updated weights for policy 1, policy_version 1152825 (0.0010) [2023-12-26 08:51:43,730][123091] Updated weights for policy 0, policy_version 1161139 (0.0010) [2023-12-26 08:51:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 592379904. Throughput: 0: 8836.9, 1: 8900.6. Samples: 592374896. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:43,785][121949] Avg episode reward: [(0, '6176.668'), (1, '5624.695')] [2023-12-26 08:51:43,790][123091] Updated weights for policy 0, policy_version 1161149 (0.0009) [2023-12-26 08:51:43,845][123091] Updated weights for policy 0, policy_version 1161159 (0.0008) [2023-12-26 08:51:44,277][123090] Updated weights for policy 1, policy_version 1152835 (0.0010) [2023-12-26 08:51:44,343][123090] Updated weights for policy 1, policy_version 1152845 (0.0011) [2023-12-26 08:51:44,411][123090] Updated weights for policy 1, policy_version 1152855 (0.0010) [2023-12-26 08:51:44,712][123091] Updated weights for policy 0, policy_version 1161169 (0.0009) [2023-12-26 08:51:44,778][123091] Updated weights for policy 0, policy_version 1161179 (0.0009) [2023-12-26 08:51:44,844][123091] Updated weights for policy 0, policy_version 1161189 (0.0010) [2023-12-26 08:51:44,905][123091] Updated weights for policy 0, policy_version 1161199 (0.0010) [2023-12-26 08:51:45,186][123090] Updated weights for policy 1, policy_version 1152865 (0.0010) [2023-12-26 08:51:45,246][123090] Updated weights for policy 1, policy_version 1152875 (0.0011) [2023-12-26 08:51:45,315][123090] Updated weights for policy 1, policy_version 1152885 (0.0006) [2023-12-26 08:51:45,366][123090] Updated weights for policy 1, policy_version 1152895 (0.0006) [2023-12-26 08:51:45,809][123091] Updated weights for policy 0, policy_version 1161209 (0.0009) [2023-12-26 08:51:45,862][123091] Updated weights for policy 0, policy_version 1161219 (0.0010) [2023-12-26 08:51:45,912][123091] Updated weights for policy 0, policy_version 1161229 (0.0009) [2023-12-26 08:51:46,060][123090] Updated weights for policy 1, policy_version 1152905 (0.0008) [2023-12-26 08:51:46,117][123090] Updated weights for policy 1, policy_version 1152915 (0.0009) [2023-12-26 08:51:46,172][123090] Updated weights for policy 1, policy_version 1152925 (0.0009) [2023-12-26 08:51:46,795][123091] Updated weights for policy 0, policy_version 1161239 (0.0009) [2023-12-26 08:51:46,849][123091] Updated weights for policy 0, policy_version 1161249 (0.0009) [2023-12-26 08:51:46,906][123091] Updated weights for policy 0, policy_version 1161259 (0.0008) [2023-12-26 08:51:46,983][123090] Updated weights for policy 1, policy_version 1152935 (0.0010) [2023-12-26 08:51:47,034][123090] Updated weights for policy 1, policy_version 1152945 (0.0010) [2023-12-26 08:51:47,077][123090] Updated weights for policy 1, policy_version 1152955 (0.0008) [2023-12-26 08:51:47,787][123091] Updated weights for policy 0, policy_version 1161269 (0.0009) [2023-12-26 08:51:47,832][123090] Updated weights for policy 1, policy_version 1152965 (0.0005) [2023-12-26 08:51:47,841][123091] Updated weights for policy 0, policy_version 1161279 (0.0009) [2023-12-26 08:51:47,888][123090] Updated weights for policy 1, policy_version 1152975 (0.0005) [2023-12-26 08:51:47,898][123091] Updated weights for policy 0, policy_version 1161289 (0.0009) [2023-12-26 08:51:47,954][123090] Updated weights for policy 1, policy_version 1152985 (0.0005) [2023-12-26 08:51:48,600][123091] Updated weights for policy 0, policy_version 1161299 (0.0008) [2023-12-26 08:51:48,624][123090] Updated weights for policy 1, policy_version 1152995 (0.0006) [2023-12-26 08:51:48,657][123091] Updated weights for policy 0, policy_version 1161309 (0.0011) [2023-12-26 08:51:48,674][123090] Updated weights for policy 1, policy_version 1153005 (0.0005) [2023-12-26 08:51:48,717][123091] Updated weights for policy 0, policy_version 1161319 (0.0011) [2023-12-26 08:51:48,723][123090] Updated weights for policy 1, policy_version 1153015 (0.0005) [2023-12-26 08:51:48,786][121949] Fps is (10 sec: 18018.5, 60 sec: 17748.7, 300 sec: 17689.0). Total num frames: 592478208. Throughput: 0: 8788.9, 1: 8989.2. Samples: 592482260. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:48,787][121949] Avg episode reward: [(0, '6200.359'), (1, '5408.371')] [2023-12-26 08:51:49,497][123090] Updated weights for policy 1, policy_version 1153025 (0.0007) [2023-12-26 08:51:49,552][123090] Updated weights for policy 1, policy_version 1153035 (0.0010) [2023-12-26 08:51:49,561][123091] Updated weights for policy 0, policy_version 1161329 (0.0011) [2023-12-26 08:51:49,611][123090] Updated weights for policy 1, policy_version 1153045 (0.0010) [2023-12-26 08:51:49,623][123091] Updated weights for policy 0, policy_version 1161339 (0.0010) [2023-12-26 08:51:49,667][123090] Updated weights for policy 1, policy_version 1153055 (0.0010) [2023-12-26 08:51:49,683][123091] Updated weights for policy 0, policy_version 1161349 (0.0011) [2023-12-26 08:51:49,727][123091] Updated weights for policy 0, policy_version 1161359 (0.0010) [2023-12-26 08:51:50,499][123091] Updated weights for policy 0, policy_version 1161369 (0.0006) [2023-12-26 08:51:50,528][123090] Updated weights for policy 1, policy_version 1153065 (0.0008) [2023-12-26 08:51:50,551][123091] Updated weights for policy 0, policy_version 1161379 (0.0006) [2023-12-26 08:51:50,591][123090] Updated weights for policy 1, policy_version 1153075 (0.0009) [2023-12-26 08:51:50,619][123091] Updated weights for policy 0, policy_version 1161389 (0.0010) [2023-12-26 08:51:50,648][123090] Updated weights for policy 1, policy_version 1153085 (0.0008) [2023-12-26 08:51:51,434][123090] Updated weights for policy 1, policy_version 1153095 (0.0010) [2023-12-26 08:51:51,485][123091] Updated weights for policy 0, policy_version 1161399 (0.0007) [2023-12-26 08:51:51,495][123090] Updated weights for policy 1, policy_version 1153105 (0.0011) [2023-12-26 08:51:51,542][123091] Updated weights for policy 0, policy_version 1161409 (0.0007) [2023-12-26 08:51:51,552][123090] Updated weights for policy 1, policy_version 1153115 (0.0010) [2023-12-26 08:51:51,606][123091] Updated weights for policy 0, policy_version 1161419 (0.0010) [2023-12-26 08:51:52,385][123090] Updated weights for policy 1, policy_version 1153125 (0.0009) [2023-12-26 08:51:52,448][123090] Updated weights for policy 1, policy_version 1153135 (0.0010) [2023-12-26 08:51:52,491][123091] Updated weights for policy 0, policy_version 1161429 (0.0008) [2023-12-26 08:51:52,514][123090] Updated weights for policy 1, policy_version 1153145 (0.0010) [2023-12-26 08:51:52,552][123091] Updated weights for policy 0, policy_version 1161439 (0.0008) [2023-12-26 08:51:52,615][123091] Updated weights for policy 0, policy_version 1161449 (0.0009) [2023-12-26 08:51:53,247][123090] Updated weights for policy 1, policy_version 1153155 (0.0009) [2023-12-26 08:51:53,322][123090] Updated weights for policy 1, policy_version 1153165 (0.0009) [2023-12-26 08:51:53,389][123090] Updated weights for policy 1, policy_version 1153175 (0.0006) [2023-12-26 08:51:53,469][123091] Updated weights for policy 0, policy_version 1161459 (0.0009) [2023-12-26 08:51:53,525][123091] Updated weights for policy 0, policy_version 1161470 (0.0010) [2023-12-26 08:51:53,584][123091] Updated weights for policy 0, policy_version 1161480 (0.0009) [2023-12-26 08:51:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 592560128. Throughput: 0: 8793.1, 1: 8953.9. Samples: 592533776. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:53,785][121949] Avg episode reward: [(0, '6145.547'), (1, '5335.027')] [2023-12-26 08:51:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001153184_295215104.pth... [2023-12-26 08:51:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001161488_297345024.pth... [2023-12-26 08:51:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001152128_294944768.pth [2023-12-26 08:51:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001160432_297074688.pth [2023-12-26 08:51:54,085][123090] Updated weights for policy 1, policy_version 1153185 (0.0005) [2023-12-26 08:51:54,155][123090] Updated weights for policy 1, policy_version 1153195 (0.0008) [2023-12-26 08:51:54,215][123090] Updated weights for policy 1, policy_version 1153205 (0.0010) [2023-12-26 08:51:54,270][123090] Updated weights for policy 1, policy_version 1153215 (0.0010) [2023-12-26 08:51:54,479][123091] Updated weights for policy 0, policy_version 1161491 (0.0010) [2023-12-26 08:51:54,539][123091] Updated weights for policy 0, policy_version 1161501 (0.0009) [2023-12-26 08:51:54,592][123091] Updated weights for policy 0, policy_version 1161511 (0.0007) [2023-12-26 08:51:55,055][123090] Updated weights for policy 1, policy_version 1153225 (0.0011) [2023-12-26 08:51:55,122][123090] Updated weights for policy 1, policy_version 1153235 (0.0009) [2023-12-26 08:51:55,184][123090] Updated weights for policy 1, policy_version 1153245 (0.0010) [2023-12-26 08:51:55,371][123091] Updated weights for policy 0, policy_version 1161521 (0.0006) [2023-12-26 08:51:55,424][123091] Updated weights for policy 0, policy_version 1161531 (0.0009) [2023-12-26 08:51:55,472][123091] Updated weights for policy 0, policy_version 1161541 (0.0009) [2023-12-26 08:51:55,516][123091] Updated weights for policy 0, policy_version 1161551 (0.0009) [2023-12-26 08:51:56,006][123090] Updated weights for policy 1, policy_version 1153255 (0.0010) [2023-12-26 08:51:56,066][123090] Updated weights for policy 1, policy_version 1153265 (0.0010) [2023-12-26 08:51:56,125][123090] Updated weights for policy 1, policy_version 1153275 (0.0010) [2023-12-26 08:51:56,241][123091] Updated weights for policy 0, policy_version 1161561 (0.0006) [2023-12-26 08:51:56,287][123091] Updated weights for policy 0, policy_version 1161571 (0.0005) [2023-12-26 08:51:56,340][123091] Updated weights for policy 0, policy_version 1161581 (0.0007) [2023-12-26 08:51:56,927][123090] Updated weights for policy 1, policy_version 1153285 (0.0008) [2023-12-26 08:51:56,998][123090] Updated weights for policy 1, policy_version 1153295 (0.0005) [2023-12-26 08:51:57,052][123090] Updated weights for policy 1, policy_version 1153305 (0.0005) [2023-12-26 08:51:57,096][123091] Updated weights for policy 0, policy_version 1161591 (0.0007) [2023-12-26 08:51:57,141][123091] Updated weights for policy 0, policy_version 1161601 (0.0005) [2023-12-26 08:51:57,186][123091] Updated weights for policy 0, policy_version 1161611 (0.0005) [2023-12-26 08:51:57,678][123090] Updated weights for policy 1, policy_version 1153315 (0.0005) [2023-12-26 08:51:57,728][123090] Updated weights for policy 1, policy_version 1153325 (0.0005) [2023-12-26 08:51:57,781][123090] Updated weights for policy 1, policy_version 1153335 (0.0005) [2023-12-26 08:51:57,908][123091] Updated weights for policy 0, policy_version 1161621 (0.0006) [2023-12-26 08:51:57,968][123091] Updated weights for policy 0, policy_version 1161631 (0.0005) [2023-12-26 08:51:58,041][123091] Updated weights for policy 0, policy_version 1161641 (0.0011) [2023-12-26 08:51:58,500][123090] Updated weights for policy 1, policy_version 1153345 (0.0006) [2023-12-26 08:51:58,572][123090] Updated weights for policy 1, policy_version 1153355 (0.0008) [2023-12-26 08:51:58,642][123090] Updated weights for policy 1, policy_version 1153365 (0.0008) [2023-12-26 08:51:58,730][123090] Updated weights for policy 1, policy_version 1153375 (0.0011) [2023-12-26 08:51:58,784][121949] Fps is (10 sec: 17206.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 592650240. Throughput: 0: 8863.4, 1: 9005.9. Samples: 592641936. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:51:58,785][121949] Avg episode reward: [(0, '6133.920'), (1, '5438.786')] [2023-12-26 08:51:58,855][123091] Updated weights for policy 0, policy_version 1161651 (0.0011) [2023-12-26 08:51:58,923][123091] Updated weights for policy 0, policy_version 1161661 (0.0009) [2023-12-26 08:51:58,990][123091] Updated weights for policy 0, policy_version 1161671 (0.0007) [2023-12-26 08:51:59,567][123090] Updated weights for policy 1, policy_version 1153385 (0.0010) [2023-12-26 08:51:59,620][123090] Updated weights for policy 1, policy_version 1153395 (0.0010) [2023-12-26 08:51:59,673][123090] Updated weights for policy 1, policy_version 1153405 (0.0010) [2023-12-26 08:51:59,787][123091] Updated weights for policy 0, policy_version 1161681 (0.0007) [2023-12-26 08:51:59,852][123091] Updated weights for policy 0, policy_version 1161691 (0.0009) [2023-12-26 08:51:59,903][123091] Updated weights for policy 0, policy_version 1161701 (0.0009) [2023-12-26 08:51:59,981][123091] Updated weights for policy 0, policy_version 1161711 (0.0009) [2023-12-26 08:52:00,550][123090] Updated weights for policy 1, policy_version 1153415 (0.0009) [2023-12-26 08:52:00,620][123090] Updated weights for policy 1, policy_version 1153425 (0.0008) [2023-12-26 08:52:00,686][123090] Updated weights for policy 1, policy_version 1153435 (0.0010) [2023-12-26 08:52:00,740][123091] Updated weights for policy 0, policy_version 1161721 (0.0006) [2023-12-26 08:52:00,790][123091] Updated weights for policy 0, policy_version 1161731 (0.0007) [2023-12-26 08:52:00,844][123091] Updated weights for policy 0, policy_version 1161741 (0.0008) [2023-12-26 08:52:01,574][123090] Updated weights for policy 1, policy_version 1153445 (0.0009) [2023-12-26 08:52:01,630][123090] Updated weights for policy 1, policy_version 1153455 (0.0008) [2023-12-26 08:52:01,646][123091] Updated weights for policy 0, policy_version 1161751 (0.0009) [2023-12-26 08:52:01,694][123090] Updated weights for policy 1, policy_version 1153465 (0.0007) [2023-12-26 08:52:01,713][123091] Updated weights for policy 0, policy_version 1161761 (0.0010) [2023-12-26 08:52:01,774][123091] Updated weights for policy 0, policy_version 1161771 (0.0010) [2023-12-26 08:52:02,550][123090] Updated weights for policy 1, policy_version 1153475 (0.0008) [2023-12-26 08:52:02,580][123091] Updated weights for policy 0, policy_version 1161781 (0.0011) [2023-12-26 08:52:02,614][123090] Updated weights for policy 1, policy_version 1153485 (0.0007) [2023-12-26 08:52:02,647][123091] Updated weights for policy 0, policy_version 1161791 (0.0011) [2023-12-26 08:52:02,669][123090] Updated weights for policy 1, policy_version 1153495 (0.0009) [2023-12-26 08:52:02,709][123091] Updated weights for policy 0, policy_version 1161801 (0.0010) [2023-12-26 08:52:03,402][123090] Updated weights for policy 1, policy_version 1153505 (0.0008) [2023-12-26 08:52:03,461][123090] Updated weights for policy 1, policy_version 1153515 (0.0010) [2023-12-26 08:52:03,500][123091] Updated weights for policy 0, policy_version 1161811 (0.0009) [2023-12-26 08:52:03,520][123090] Updated weights for policy 1, policy_version 1153525 (0.0010) [2023-12-26 08:52:03,555][123091] Updated weights for policy 0, policy_version 1161821 (0.0005) [2023-12-26 08:52:03,588][123090] Updated weights for policy 1, policy_version 1153535 (0.0011) [2023-12-26 08:52:03,620][123091] Updated weights for policy 0, policy_version 1161831 (0.0006) [2023-12-26 08:52:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 592740352. Throughput: 0: 8849.0, 1: 8989.3. Samples: 592746020. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:03,785][121949] Avg episode reward: [(0, '6066.968'), (1, '5412.364')] [2023-12-26 08:52:04,350][123090] Updated weights for policy 1, policy_version 1153545 (0.0011) [2023-12-26 08:52:04,407][123091] Updated weights for policy 0, policy_version 1161841 (0.0010) [2023-12-26 08:52:04,411][123090] Updated weights for policy 1, policy_version 1153555 (0.0010) [2023-12-26 08:52:04,470][123090] Updated weights for policy 1, policy_version 1153565 (0.0010) [2023-12-26 08:52:04,471][123091] Updated weights for policy 0, policy_version 1161851 (0.0011) [2023-12-26 08:52:04,530][123091] Updated weights for policy 0, policy_version 1161861 (0.0011) [2023-12-26 08:52:04,589][123091] Updated weights for policy 0, policy_version 1161871 (0.0010) [2023-12-26 08:52:05,250][123090] Updated weights for policy 1, policy_version 1153575 (0.0007) [2023-12-26 08:52:05,310][123090] Updated weights for policy 1, policy_version 1153585 (0.0005) [2023-12-26 08:52:05,372][123090] Updated weights for policy 1, policy_version 1153595 (0.0005) [2023-12-26 08:52:05,415][123091] Updated weights for policy 0, policy_version 1161881 (0.0010) [2023-12-26 08:52:05,469][123091] Updated weights for policy 0, policy_version 1161891 (0.0010) [2023-12-26 08:52:05,516][123091] Updated weights for policy 0, policy_version 1161901 (0.0010) [2023-12-26 08:52:06,028][123090] Updated weights for policy 1, policy_version 1153605 (0.0005) [2023-12-26 08:52:06,088][123090] Updated weights for policy 1, policy_version 1153615 (0.0005) [2023-12-26 08:52:06,151][123090] Updated weights for policy 1, policy_version 1153625 (0.0007) [2023-12-26 08:52:06,304][123091] Updated weights for policy 0, policy_version 1161911 (0.0009) [2023-12-26 08:52:06,365][123091] Updated weights for policy 0, policy_version 1161921 (0.0009) [2023-12-26 08:52:06,434][123091] Updated weights for policy 0, policy_version 1161931 (0.0009) [2023-12-26 08:52:06,943][123090] Updated weights for policy 1, policy_version 1153635 (0.0006) [2023-12-26 08:52:07,005][123090] Updated weights for policy 1, policy_version 1153645 (0.0008) [2023-12-26 08:52:07,077][123090] Updated weights for policy 1, policy_version 1153655 (0.0009) [2023-12-26 08:52:07,272][123091] Updated weights for policy 0, policy_version 1161941 (0.0008) [2023-12-26 08:52:07,325][123091] Updated weights for policy 0, policy_version 1161951 (0.0009) [2023-12-26 08:52:07,378][123091] Updated weights for policy 0, policy_version 1161961 (0.0009) [2023-12-26 08:52:07,852][123090] Updated weights for policy 1, policy_version 1153665 (0.0006) [2023-12-26 08:52:07,918][123090] Updated weights for policy 1, policy_version 1153675 (0.0005) [2023-12-26 08:52:07,990][123090] Updated weights for policy 1, policy_version 1153685 (0.0006) [2023-12-26 08:52:08,056][123090] Updated weights for policy 1, policy_version 1153695 (0.0005) [2023-12-26 08:52:08,152][123091] Updated weights for policy 0, policy_version 1161971 (0.0008) [2023-12-26 08:52:08,210][123091] Updated weights for policy 0, policy_version 1161981 (0.0005) [2023-12-26 08:52:08,264][123091] Updated weights for policy 0, policy_version 1161991 (0.0005) [2023-12-26 08:52:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 592822272. Throughput: 0: 8879.4, 1: 9013.8. Samples: 592800828. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:08,785][121949] Avg episode reward: [(0, '6042.441'), (1, '5365.522')] [2023-12-26 08:52:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001162000_297476096.pth... [2023-12-26 08:52:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001160976_297213952.pth [2023-12-26 08:52:08,803][123090] Updated weights for policy 1, policy_version 1153705 (0.0010) [2023-12-26 08:52:08,870][123091] Updated weights for policy 0, policy_version 1162001 (0.0005) [2023-12-26 08:52:08,877][123090] Updated weights for policy 1, policy_version 1153715 (0.0010) [2023-12-26 08:52:08,931][123091] Updated weights for policy 0, policy_version 1162011 (0.0005) [2023-12-26 08:52:08,940][123090] Updated weights for policy 1, policy_version 1153725 (0.0010) [2023-12-26 08:52:08,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001153728_295354368.pth... [2023-12-26 08:52:08,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001152672_295084032.pth [2023-12-26 08:52:08,993][123091] Updated weights for policy 0, policy_version 1162021 (0.0010) [2023-12-26 08:52:09,057][123091] Updated weights for policy 0, policy_version 1162031 (0.0010) [2023-12-26 08:52:09,750][123090] Updated weights for policy 1, policy_version 1153735 (0.0010) [2023-12-26 08:52:09,806][123090] Updated weights for policy 1, policy_version 1153745 (0.0009) [2023-12-26 08:52:09,856][123091] Updated weights for policy 0, policy_version 1162041 (0.0009) [2023-12-26 08:52:09,874][123090] Updated weights for policy 1, policy_version 1153755 (0.0009) [2023-12-26 08:52:09,926][123091] Updated weights for policy 0, policy_version 1162051 (0.0007) [2023-12-26 08:52:09,985][123091] Updated weights for policy 0, policy_version 1162061 (0.0011) [2023-12-26 08:52:10,726][123090] Updated weights for policy 1, policy_version 1153765 (0.0010) [2023-12-26 08:52:10,773][123090] Updated weights for policy 1, policy_version 1153775 (0.0008) [2023-12-26 08:52:10,825][123091] Updated weights for policy 0, policy_version 1162071 (0.0009) [2023-12-26 08:52:10,832][123090] Updated weights for policy 1, policy_version 1153785 (0.0005) [2023-12-26 08:52:10,892][123091] Updated weights for policy 0, policy_version 1162081 (0.0009) [2023-12-26 08:52:10,956][123091] Updated weights for policy 0, policy_version 1162091 (0.0010) [2023-12-26 08:52:11,648][123090] Updated weights for policy 1, policy_version 1153795 (0.0006) [2023-12-26 08:52:11,709][123090] Updated weights for policy 1, policy_version 1153805 (0.0009) [2023-12-26 08:52:11,779][123090] Updated weights for policy 1, policy_version 1153815 (0.0009) [2023-12-26 08:52:11,811][123091] Updated weights for policy 0, policy_version 1162101 (0.0008) [2023-12-26 08:52:11,863][123091] Updated weights for policy 0, policy_version 1162111 (0.0009) [2023-12-26 08:52:11,920][123091] Updated weights for policy 0, policy_version 1162121 (0.0009) [2023-12-26 08:52:12,661][123090] Updated weights for policy 1, policy_version 1153825 (0.0009) [2023-12-26 08:52:12,744][123090] Updated weights for policy 1, policy_version 1153835 (0.0009) [2023-12-26 08:52:12,760][123091] Updated weights for policy 0, policy_version 1162131 (0.0009) [2023-12-26 08:52:12,806][123090] Updated weights for policy 1, policy_version 1153845 (0.0007) [2023-12-26 08:52:12,821][123091] Updated weights for policy 0, policy_version 1162141 (0.0009) [2023-12-26 08:52:12,866][123090] Updated weights for policy 1, policy_version 1153855 (0.0008) [2023-12-26 08:52:12,879][123091] Updated weights for policy 0, policy_version 1162151 (0.0007) [2023-12-26 08:52:13,539][123091] Updated weights for policy 0, policy_version 1162161 (0.0006) [2023-12-26 08:52:13,584][123091] Updated weights for policy 0, policy_version 1162171 (0.0005) [2023-12-26 08:52:13,632][123091] Updated weights for policy 0, policy_version 1162181 (0.0005) [2023-12-26 08:52:13,695][123091] Updated weights for policy 0, policy_version 1162191 (0.0005) [2023-12-26 08:52:13,762][123090] Updated weights for policy 1, policy_version 1153865 (0.0009) [2023-12-26 08:52:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 592912384. Throughput: 0: 8854.8, 1: 8945.5. Samples: 592906216. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:13,785][121949] Avg episode reward: [(0, '6124.470'), (1, '5279.757')] [2023-12-26 08:52:13,817][123090] Updated weights for policy 1, policy_version 1153875 (0.0009) [2023-12-26 08:52:13,880][123090] Updated weights for policy 1, policy_version 1153885 (0.0010) [2023-12-26 08:52:14,393][123091] Updated weights for policy 0, policy_version 1162201 (0.0005) [2023-12-26 08:52:14,451][123091] Updated weights for policy 0, policy_version 1162211 (0.0005) [2023-12-26 08:52:14,506][123091] Updated weights for policy 0, policy_version 1162221 (0.0005) [2023-12-26 08:52:14,746][123090] Updated weights for policy 1, policy_version 1153895 (0.0009) [2023-12-26 08:52:14,814][123090] Updated weights for policy 1, policy_version 1153905 (0.0009) [2023-12-26 08:52:14,880][123090] Updated weights for policy 1, policy_version 1153915 (0.0010) [2023-12-26 08:52:15,135][123091] Updated weights for policy 0, policy_version 1162231 (0.0009) [2023-12-26 08:52:15,208][123091] Updated weights for policy 0, policy_version 1162241 (0.0009) [2023-12-26 08:52:15,281][123091] Updated weights for policy 0, policy_version 1162251 (0.0010) [2023-12-26 08:52:15,755][123090] Updated weights for policy 1, policy_version 1153925 (0.0010) [2023-12-26 08:52:15,819][123090] Updated weights for policy 1, policy_version 1153935 (0.0010) [2023-12-26 08:52:15,881][123090] Updated weights for policy 1, policy_version 1153945 (0.0009) [2023-12-26 08:52:16,031][123091] Updated weights for policy 0, policy_version 1162261 (0.0010) [2023-12-26 08:52:16,094][123091] Updated weights for policy 0, policy_version 1162271 (0.0009) [2023-12-26 08:52:16,154][123091] Updated weights for policy 0, policy_version 1162281 (0.0009) [2023-12-26 08:52:16,731][123090] Updated weights for policy 1, policy_version 1153955 (0.0009) [2023-12-26 08:52:16,782][123090] Updated weights for policy 1, policy_version 1153965 (0.0008) [2023-12-26 08:52:16,835][123090] Updated weights for policy 1, policy_version 1153975 (0.0009) [2023-12-26 08:52:16,985][123091] Updated weights for policy 0, policy_version 1162291 (0.0010) [2023-12-26 08:52:17,034][123091] Updated weights for policy 0, policy_version 1162301 (0.0009) [2023-12-26 08:52:17,096][123091] Updated weights for policy 0, policy_version 1162311 (0.0010) [2023-12-26 08:52:17,679][123090] Updated weights for policy 1, policy_version 1153985 (0.0008) [2023-12-26 08:52:17,749][123090] Updated weights for policy 1, policy_version 1153995 (0.0008) [2023-12-26 08:52:17,824][123090] Updated weights for policy 1, policy_version 1154005 (0.0008) [2023-12-26 08:52:17,888][123090] Updated weights for policy 1, policy_version 1154015 (0.0009) [2023-12-26 08:52:17,922][123091] Updated weights for policy 0, policy_version 1162321 (0.0009) [2023-12-26 08:52:17,984][123091] Updated weights for policy 0, policy_version 1162331 (0.0010) [2023-12-26 08:52:18,044][123091] Updated weights for policy 0, policy_version 1162341 (0.0007) [2023-12-26 08:52:18,104][123091] Updated weights for policy 0, policy_version 1162351 (0.0009) [2023-12-26 08:52:18,659][123090] Updated weights for policy 1, policy_version 1154025 (0.0010) [2023-12-26 08:52:18,723][123090] Updated weights for policy 1, policy_version 1154035 (0.0010) [2023-12-26 08:52:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 592994304. Throughput: 0: 8890.7, 1: 8816.8. Samples: 593012228. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:18,784][121949] Avg episode reward: [(0, '6082.292'), (1, '5230.881')] [2023-12-26 08:52:18,786][123090] Updated weights for policy 1, policy_version 1154045 (0.0010) [2023-12-26 08:52:18,931][123091] Updated weights for policy 0, policy_version 1162361 (0.0008) [2023-12-26 08:52:19,001][123091] Updated weights for policy 0, policy_version 1162371 (0.0008) [2023-12-26 08:52:19,065][123091] Updated weights for policy 0, policy_version 1162381 (0.0010) [2023-12-26 08:52:19,614][123090] Updated weights for policy 1, policy_version 1154055 (0.0008) [2023-12-26 08:52:19,693][123090] Updated weights for policy 1, policy_version 1154065 (0.0008) [2023-12-26 08:52:19,770][123090] Updated weights for policy 1, policy_version 1154075 (0.0008) [2023-12-26 08:52:19,851][123091] Updated weights for policy 0, policy_version 1162391 (0.0008) [2023-12-26 08:52:19,921][123091] Updated weights for policy 0, policy_version 1162401 (0.0008) [2023-12-26 08:52:19,985][123091] Updated weights for policy 0, policy_version 1162411 (0.0009) [2023-12-26 08:52:20,564][123090] Updated weights for policy 1, policy_version 1154085 (0.0008) [2023-12-26 08:52:20,628][123090] Updated weights for policy 1, policy_version 1154095 (0.0010) [2023-12-26 08:52:20,698][123090] Updated weights for policy 1, policy_version 1154105 (0.0009) [2023-12-26 08:52:20,781][123091] Updated weights for policy 0, policy_version 1162421 (0.0010) [2023-12-26 08:52:20,844][123091] Updated weights for policy 0, policy_version 1162431 (0.0009) [2023-12-26 08:52:20,910][123091] Updated weights for policy 0, policy_version 1162441 (0.0009) [2023-12-26 08:52:21,542][123090] Updated weights for policy 1, policy_version 1154115 (0.0009) [2023-12-26 08:52:21,600][123090] Updated weights for policy 1, policy_version 1154125 (0.0009) [2023-12-26 08:52:21,670][123090] Updated weights for policy 1, policy_version 1154135 (0.0010) [2023-12-26 08:52:21,714][123091] Updated weights for policy 0, policy_version 1162451 (0.0006) [2023-12-26 08:52:21,775][123091] Updated weights for policy 0, policy_version 1162461 (0.0008) [2023-12-26 08:52:21,851][123091] Updated weights for policy 0, policy_version 1162471 (0.0008) [2023-12-26 08:52:22,566][123091] Updated weights for policy 0, policy_version 1162481 (0.0008) [2023-12-26 08:52:22,612][123090] Updated weights for policy 1, policy_version 1154145 (0.0008) [2023-12-26 08:52:22,627][123091] Updated weights for policy 0, policy_version 1162491 (0.0009) [2023-12-26 08:52:22,671][123090] Updated weights for policy 1, policy_version 1154155 (0.0007) [2023-12-26 08:52:22,682][123091] Updated weights for policy 0, policy_version 1162501 (0.0009) [2023-12-26 08:52:22,737][123090] Updated weights for policy 1, policy_version 1154165 (0.0008) [2023-12-26 08:52:22,744][123091] Updated weights for policy 0, policy_version 1162511 (0.0009) [2023-12-26 08:52:22,795][123090] Updated weights for policy 1, policy_version 1154175 (0.0009) [2023-12-26 08:52:23,511][123091] Updated weights for policy 0, policy_version 1162521 (0.0010) [2023-12-26 08:52:23,562][123091] Updated weights for policy 0, policy_version 1162531 (0.0009) [2023-12-26 08:52:23,611][123091] Updated weights for policy 0, policy_version 1162541 (0.0009) [2023-12-26 08:52:23,684][123090] Updated weights for policy 1, policy_version 1154185 (0.0009) [2023-12-26 08:52:23,744][123090] Updated weights for policy 1, policy_version 1154195 (0.0009) [2023-12-26 08:52:23,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 593084416. Throughput: 0: 8833.9, 1: 8748.2. Samples: 593063168. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:23,785][121949] Avg episode reward: [(0, '6200.670'), (1, '5351.553')] [2023-12-26 08:52:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001162544_297615360.pth... [2023-12-26 08:52:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001161488_297345024.pth [2023-12-26 08:52:23,803][123090] Updated weights for policy 1, policy_version 1154205 (0.0010) [2023-12-26 08:52:23,815][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001154208_295477248.pth... [2023-12-26 08:52:23,820][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001153184_295215104.pth [2023-12-26 08:52:24,513][123090] Updated weights for policy 1, policy_version 1154215 (0.0006) [2023-12-26 08:52:24,531][123091] Updated weights for policy 0, policy_version 1162551 (0.0007) [2023-12-26 08:52:24,561][123090] Updated weights for policy 1, policy_version 1154225 (0.0005) [2023-12-26 08:52:24,591][123091] Updated weights for policy 0, policy_version 1162561 (0.0006) [2023-12-26 08:52:24,613][123090] Updated weights for policy 1, policy_version 1154235 (0.0005) [2023-12-26 08:52:24,652][123091] Updated weights for policy 0, policy_version 1162571 (0.0005) [2023-12-26 08:52:25,278][123090] Updated weights for policy 1, policy_version 1154245 (0.0005) [2023-12-26 08:52:25,334][123090] Updated weights for policy 1, policy_version 1154255 (0.0005) [2023-12-26 08:52:25,391][123090] Updated weights for policy 1, policy_version 1154265 (0.0006) [2023-12-26 08:52:25,462][123091] Updated weights for policy 0, policy_version 1162581 (0.0008) [2023-12-26 08:52:25,530][123091] Updated weights for policy 0, policy_version 1162591 (0.0009) [2023-12-26 08:52:25,593][123091] Updated weights for policy 0, policy_version 1162601 (0.0009) [2023-12-26 08:52:26,179][123090] Updated weights for policy 1, policy_version 1154275 (0.0010) [2023-12-26 08:52:26,231][123090] Updated weights for policy 1, policy_version 1154285 (0.0007) [2023-12-26 08:52:26,277][123090] Updated weights for policy 1, policy_version 1154295 (0.0005) [2023-12-26 08:52:26,383][123091] Updated weights for policy 0, policy_version 1162611 (0.0009) [2023-12-26 08:52:26,427][123091] Updated weights for policy 0, policy_version 1162621 (0.0010) [2023-12-26 08:52:26,489][123091] Updated weights for policy 0, policy_version 1162631 (0.0010) [2023-12-26 08:52:26,961][123090] Updated weights for policy 1, policy_version 1154305 (0.0005) [2023-12-26 08:52:27,009][123090] Updated weights for policy 1, policy_version 1154315 (0.0007) [2023-12-26 08:52:27,056][123090] Updated weights for policy 1, policy_version 1154325 (0.0010) [2023-12-26 08:52:27,122][123090] Updated weights for policy 1, policy_version 1154335 (0.0010) [2023-12-26 08:52:27,180][123091] Updated weights for policy 0, policy_version 1162641 (0.0010) [2023-12-26 08:52:27,244][123091] Updated weights for policy 0, policy_version 1162651 (0.0005) [2023-12-26 08:52:27,315][123091] Updated weights for policy 0, policy_version 1162661 (0.0008) [2023-12-26 08:52:27,374][123091] Updated weights for policy 0, policy_version 1162671 (0.0010) [2023-12-26 08:52:27,861][123090] Updated weights for policy 1, policy_version 1154345 (0.0006) [2023-12-26 08:52:27,932][123090] Updated weights for policy 1, policy_version 1154355 (0.0005) [2023-12-26 08:52:27,986][123090] Updated weights for policy 1, policy_version 1154365 (0.0005) [2023-12-26 08:52:28,051][123091] Updated weights for policy 0, policy_version 1162681 (0.0007) [2023-12-26 08:52:28,107][123091] Updated weights for policy 0, policy_version 1162691 (0.0005) [2023-12-26 08:52:28,168][123091] Updated weights for policy 0, policy_version 1162701 (0.0006) [2023-12-26 08:52:28,735][123090] Updated weights for policy 1, policy_version 1154375 (0.0005) [2023-12-26 08:52:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 593174528. Throughput: 0: 8866.0, 1: 8840.0. Samples: 593171668. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:28,785][121949] Avg episode reward: [(0, '6332.444'), (1, '5550.000')] [2023-12-26 08:52:28,793][123090] Updated weights for policy 1, policy_version 1154385 (0.0005) [2023-12-26 08:52:28,864][123090] Updated weights for policy 1, policy_version 1154395 (0.0007) [2023-12-26 08:52:28,909][123091] Updated weights for policy 0, policy_version 1162711 (0.0006) [2023-12-26 08:52:28,958][123091] Updated weights for policy 0, policy_version 1162721 (0.0005) [2023-12-26 08:52:29,013][123091] Updated weights for policy 0, policy_version 1162731 (0.0006) [2023-12-26 08:52:29,648][123090] Updated weights for policy 1, policy_version 1154405 (0.0008) [2023-12-26 08:52:29,700][123090] Updated weights for policy 1, policy_version 1154415 (0.0008) [2023-12-26 08:52:29,752][123090] Updated weights for policy 1, policy_version 1154425 (0.0009) [2023-12-26 08:52:29,758][123091] Updated weights for policy 0, policy_version 1162741 (0.0008) [2023-12-26 08:52:29,820][123091] Updated weights for policy 0, policy_version 1162751 (0.0010) [2023-12-26 08:52:29,881][123091] Updated weights for policy 0, policy_version 1162761 (0.0011) [2023-12-26 08:52:30,560][123091] Updated weights for policy 0, policy_version 1162771 (0.0009) [2023-12-26 08:52:30,605][123091] Updated weights for policy 0, policy_version 1162781 (0.0005) [2023-12-26 08:52:30,661][123091] Updated weights for policy 0, policy_version 1162791 (0.0009) [2023-12-26 08:52:30,688][123090] Updated weights for policy 1, policy_version 1154435 (0.0006) [2023-12-26 08:52:30,750][123090] Updated weights for policy 1, policy_version 1154445 (0.0008) [2023-12-26 08:52:30,799][123090] Updated weights for policy 1, policy_version 1154455 (0.0009) [2023-12-26 08:52:31,421][123091] Updated weights for policy 0, policy_version 1162801 (0.0010) [2023-12-26 08:52:31,472][123091] Updated weights for policy 0, policy_version 1162811 (0.0005) [2023-12-26 08:52:31,531][123091] Updated weights for policy 0, policy_version 1162821 (0.0007) [2023-12-26 08:52:31,582][123091] Updated weights for policy 0, policy_version 1162831 (0.0009) [2023-12-26 08:52:31,712][123090] Updated weights for policy 1, policy_version 1154466 (0.0010) [2023-12-26 08:52:31,778][123090] Updated weights for policy 1, policy_version 1154476 (0.0010) [2023-12-26 08:52:31,841][123090] Updated weights for policy 1, policy_version 1154486 (0.0009) [2023-12-26 08:52:31,902][123090] Updated weights for policy 1, policy_version 1154496 (0.0009) [2023-12-26 08:52:32,385][123091] Updated weights for policy 0, policy_version 1162841 (0.0010) [2023-12-26 08:52:32,456][123091] Updated weights for policy 0, policy_version 1162851 (0.0009) [2023-12-26 08:52:32,526][123091] Updated weights for policy 0, policy_version 1162861 (0.0008) [2023-12-26 08:52:32,786][123090] Updated weights for policy 1, policy_version 1154506 (0.0010) [2023-12-26 08:52:32,854][123090] Updated weights for policy 1, policy_version 1154516 (0.0010) [2023-12-26 08:52:32,917][123090] Updated weights for policy 1, policy_version 1154526 (0.0009) [2023-12-26 08:52:33,284][123091] Updated weights for policy 0, policy_version 1162871 (0.0008) [2023-12-26 08:52:33,348][123091] Updated weights for policy 0, policy_version 1162881 (0.0008) [2023-12-26 08:52:33,431][123091] Updated weights for policy 0, policy_version 1162891 (0.0008) [2023-12-26 08:52:33,638][123090] Updated weights for policy 1, policy_version 1154536 (0.0006) [2023-12-26 08:52:33,691][123090] Updated weights for policy 1, policy_version 1154546 (0.0005) [2023-12-26 08:52:33,742][123090] Updated weights for policy 1, policy_version 1154556 (0.0005) [2023-12-26 08:52:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 593272832. Throughput: 0: 8993.5, 1: 8739.3. Samples: 593280200. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:33,785][121949] Avg episode reward: [(0, '6266.493'), (1, '5644.902')] [2023-12-26 08:52:34,107][123091] Updated weights for policy 0, policy_version 1162901 (0.0009) [2023-12-26 08:52:34,176][123091] Updated weights for policy 0, policy_version 1162911 (0.0010) [2023-12-26 08:52:34,245][123091] Updated weights for policy 0, policy_version 1162921 (0.0007) [2023-12-26 08:52:34,346][123090] Updated weights for policy 1, policy_version 1154566 (0.0005) [2023-12-26 08:52:34,397][123090] Updated weights for policy 1, policy_version 1154576 (0.0005) [2023-12-26 08:52:34,464][123090] Updated weights for policy 1, policy_version 1154586 (0.0005) [2023-12-26 08:52:35,013][123091] Updated weights for policy 0, policy_version 1162931 (0.0010) [2023-12-26 08:52:35,071][123091] Updated weights for policy 0, policy_version 1162941 (0.0006) [2023-12-26 08:52:35,120][123091] Updated weights for policy 0, policy_version 1162951 (0.0007) [2023-12-26 08:52:35,238][123090] Updated weights for policy 1, policy_version 1154596 (0.0005) [2023-12-26 08:52:35,295][123090] Updated weights for policy 1, policy_version 1154606 (0.0005) [2023-12-26 08:52:35,343][123090] Updated weights for policy 1, policy_version 1154616 (0.0005) [2023-12-26 08:52:35,985][123091] Updated weights for policy 0, policy_version 1162961 (0.0009) [2023-12-26 08:52:36,036][123091] Updated weights for policy 0, policy_version 1162971 (0.0005) [2023-12-26 08:52:36,085][123091] Updated weights for policy 0, policy_version 1162981 (0.0007) [2023-12-26 08:52:36,141][123091] Updated weights for policy 0, policy_version 1162991 (0.0009) [2023-12-26 08:52:36,158][123090] Updated weights for policy 1, policy_version 1154626 (0.0009) [2023-12-26 08:52:36,214][123090] Updated weights for policy 1, policy_version 1154636 (0.0010) [2023-12-26 08:52:36,274][123090] Updated weights for policy 1, policy_version 1154646 (0.0010) [2023-12-26 08:52:36,332][123090] Updated weights for policy 1, policy_version 1154656 (0.0009) [2023-12-26 08:52:36,904][123091] Updated weights for policy 0, policy_version 1163001 (0.0006) [2023-12-26 08:52:36,952][123091] Updated weights for policy 0, policy_version 1163011 (0.0005) [2023-12-26 08:52:36,999][123091] Updated weights for policy 0, policy_version 1163021 (0.0005) [2023-12-26 08:52:37,225][123090] Updated weights for policy 1, policy_version 1154666 (0.0010) [2023-12-26 08:52:37,278][123090] Updated weights for policy 1, policy_version 1154676 (0.0009) [2023-12-26 08:52:37,327][123090] Updated weights for policy 1, policy_version 1154686 (0.0009) [2023-12-26 08:52:37,756][123091] Updated weights for policy 0, policy_version 1163031 (0.0009) [2023-12-26 08:52:37,824][123091] Updated weights for policy 0, policy_version 1163041 (0.0011) [2023-12-26 08:52:37,888][123091] Updated weights for policy 0, policy_version 1163051 (0.0009) [2023-12-26 08:52:38,219][123090] Updated weights for policy 1, policy_version 1154696 (0.0009) [2023-12-26 08:52:38,277][123090] Updated weights for policy 1, policy_version 1154706 (0.0009) [2023-12-26 08:52:38,348][123090] Updated weights for policy 1, policy_version 1154716 (0.0009) [2023-12-26 08:52:38,552][123091] Updated weights for policy 0, policy_version 1163061 (0.0008) [2023-12-26 08:52:38,620][123091] Updated weights for policy 0, policy_version 1163071 (0.0009) [2023-12-26 08:52:38,688][123091] Updated weights for policy 0, policy_version 1163081 (0.0009) [2023-12-26 08:52:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 593362944. Throughput: 0: 9030.5, 1: 8774.1. Samples: 593334988. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:38,785][121949] Avg episode reward: [(0, '6282.533'), (1, '5737.565')] [2023-12-26 08:52:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001163088_297754624.pth... [2023-12-26 08:52:38,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001154720_295608320.pth... [2023-12-26 08:52:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001153728_295354368.pth [2023-12-26 08:52:38,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001162000_297476096.pth [2023-12-26 08:52:39,200][123090] Updated weights for policy 1, policy_version 1154726 (0.0010) [2023-12-26 08:52:39,261][123090] Updated weights for policy 1, policy_version 1154736 (0.0009) [2023-12-26 08:52:39,321][123090] Updated weights for policy 1, policy_version 1154746 (0.0009) [2023-12-26 08:52:39,534][123091] Updated weights for policy 0, policy_version 1163091 (0.0009) [2023-12-26 08:52:39,590][123091] Updated weights for policy 0, policy_version 1163101 (0.0008) [2023-12-26 08:52:39,639][123091] Updated weights for policy 0, policy_version 1163111 (0.0008) [2023-12-26 08:52:40,221][123090] Updated weights for policy 1, policy_version 1154756 (0.0008) [2023-12-26 08:52:40,285][123090] Updated weights for policy 1, policy_version 1154766 (0.0010) [2023-12-26 08:52:40,350][123090] Updated weights for policy 1, policy_version 1154776 (0.0009) [2023-12-26 08:52:40,352][123091] Updated weights for policy 0, policy_version 1163121 (0.0006) [2023-12-26 08:52:40,413][123091] Updated weights for policy 0, policy_version 1163131 (0.0010) [2023-12-26 08:52:40,480][123091] Updated weights for policy 0, policy_version 1163141 (0.0010) [2023-12-26 08:52:40,547][123091] Updated weights for policy 0, policy_version 1163151 (0.0010) [2023-12-26 08:52:41,175][123090] Updated weights for policy 1, policy_version 1154786 (0.0007) [2023-12-26 08:52:41,230][123090] Updated weights for policy 1, policy_version 1154796 (0.0009) [2023-12-26 08:52:41,291][123090] Updated weights for policy 1, policy_version 1154806 (0.0009) [2023-12-26 08:52:41,356][123090] Updated weights for policy 1, policy_version 1154816 (0.0009) [2023-12-26 08:52:41,388][123091] Updated weights for policy 0, policy_version 1163161 (0.0008) [2023-12-26 08:52:41,454][123091] Updated weights for policy 0, policy_version 1163171 (0.0008) [2023-12-26 08:52:41,524][123091] Updated weights for policy 0, policy_version 1163181 (0.0006) [2023-12-26 08:52:42,236][123090] Updated weights for policy 1, policy_version 1154826 (0.0009) [2023-12-26 08:52:42,303][123090] Updated weights for policy 1, policy_version 1154836 (0.0010) [2023-12-26 08:52:42,357][123091] Updated weights for policy 0, policy_version 1163191 (0.0009) [2023-12-26 08:52:42,378][123090] Updated weights for policy 1, policy_version 1154846 (0.0010) [2023-12-26 08:52:42,432][123091] Updated weights for policy 0, policy_version 1163201 (0.0008) [2023-12-26 08:52:42,497][123091] Updated weights for policy 0, policy_version 1163211 (0.0009) [2023-12-26 08:52:43,174][123090] Updated weights for policy 1, policy_version 1154856 (0.0008) [2023-12-26 08:52:43,226][123090] Updated weights for policy 1, policy_version 1154866 (0.0009) [2023-12-26 08:52:43,292][123090] Updated weights for policy 1, policy_version 1154876 (0.0009) [2023-12-26 08:52:43,370][123091] Updated weights for policy 0, policy_version 1163221 (0.0010) [2023-12-26 08:52:43,435][123091] Updated weights for policy 0, policy_version 1163231 (0.0009) [2023-12-26 08:52:43,502][123091] Updated weights for policy 0, policy_version 1163241 (0.0010) [2023-12-26 08:52:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 593444864. Throughput: 0: 9023.9, 1: 8644.0. Samples: 593436992. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:43,785][121949] Avg episode reward: [(0, '6205.787'), (1, '5668.976')] [2023-12-26 08:52:44,117][123090] Updated weights for policy 1, policy_version 1154886 (0.0007) [2023-12-26 08:52:44,182][123090] Updated weights for policy 1, policy_version 1154896 (0.0005) [2023-12-26 08:52:44,236][123091] Updated weights for policy 0, policy_version 1163251 (0.0009) [2023-12-26 08:52:44,246][123090] Updated weights for policy 1, policy_version 1154906 (0.0005) [2023-12-26 08:52:44,292][123091] Updated weights for policy 0, policy_version 1163261 (0.0009) [2023-12-26 08:52:44,349][123091] Updated weights for policy 0, policy_version 1163271 (0.0009) [2023-12-26 08:52:44,960][123090] Updated weights for policy 1, policy_version 1154916 (0.0007) [2023-12-26 08:52:45,020][123090] Updated weights for policy 1, policy_version 1154926 (0.0008) [2023-12-26 08:52:45,086][123090] Updated weights for policy 1, policy_version 1154936 (0.0006) [2023-12-26 08:52:45,215][123091] Updated weights for policy 0, policy_version 1163281 (0.0010) [2023-12-26 08:52:45,276][123091] Updated weights for policy 0, policy_version 1163291 (0.0010) [2023-12-26 08:52:45,331][123091] Updated weights for policy 0, policy_version 1163301 (0.0010) [2023-12-26 08:52:45,399][123091] Updated weights for policy 0, policy_version 1163311 (0.0010) [2023-12-26 08:52:45,899][123090] Updated weights for policy 1, policy_version 1154946 (0.0006) [2023-12-26 08:52:45,950][123090] Updated weights for policy 1, policy_version 1154957 (0.0010) [2023-12-26 08:52:46,007][123090] Updated weights for policy 1, policy_version 1154967 (0.0009) [2023-12-26 08:52:46,233][123091] Updated weights for policy 0, policy_version 1163321 (0.0009) [2023-12-26 08:52:46,288][123091] Updated weights for policy 0, policy_version 1163331 (0.0009) [2023-12-26 08:52:46,341][123091] Updated weights for policy 0, policy_version 1163341 (0.0009) [2023-12-26 08:52:46,938][123090] Updated weights for policy 1, policy_version 1154977 (0.0010) [2023-12-26 08:52:46,994][123090] Updated weights for policy 1, policy_version 1154987 (0.0009) [2023-12-26 08:52:47,055][123090] Updated weights for policy 1, policy_version 1154997 (0.0009) [2023-12-26 08:52:47,085][123091] Updated weights for policy 0, policy_version 1163351 (0.0009) [2023-12-26 08:52:47,114][123090] Updated weights for policy 1, policy_version 1155007 (0.0009) [2023-12-26 08:52:47,131][123091] Updated weights for policy 0, policy_version 1163361 (0.0008) [2023-12-26 08:52:47,182][123091] Updated weights for policy 0, policy_version 1163371 (0.0009) [2023-12-26 08:52:47,912][123090] Updated weights for policy 1, policy_version 1155017 (0.0009) [2023-12-26 08:52:47,970][123090] Updated weights for policy 1, policy_version 1155027 (0.0008) [2023-12-26 08:52:48,034][123090] Updated weights for policy 1, policy_version 1155037 (0.0008) [2023-12-26 08:52:48,038][123091] Updated weights for policy 0, policy_version 1163381 (0.0009) [2023-12-26 08:52:48,094][123091] Updated weights for policy 0, policy_version 1163391 (0.0009) [2023-12-26 08:52:48,152][123091] Updated weights for policy 0, policy_version 1163401 (0.0010) [2023-12-26 08:52:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.8, 300 sec: 17605.9). Total num frames: 593526784. Throughput: 0: 9004.9, 1: 8672.6. Samples: 593541512. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:48,785][121949] Avg episode reward: [(0, '6178.453'), (1, '5320.726')] [2023-12-26 08:52:48,894][123090] Updated weights for policy 1, policy_version 1155047 (0.0009) [2023-12-26 08:52:48,958][123090] Updated weights for policy 1, policy_version 1155057 (0.0009) [2023-12-26 08:52:48,992][123091] Updated weights for policy 0, policy_version 1163411 (0.0009) [2023-12-26 08:52:49,024][123090] Updated weights for policy 1, policy_version 1155067 (0.0008) [2023-12-26 08:52:49,058][123091] Updated weights for policy 0, policy_version 1163421 (0.0008) [2023-12-26 08:52:49,121][123091] Updated weights for policy 0, policy_version 1163431 (0.0009) [2023-12-26 08:52:49,782][123090] Updated weights for policy 1, policy_version 1155077 (0.0007) [2023-12-26 08:52:49,856][123090] Updated weights for policy 1, policy_version 1155087 (0.0007) [2023-12-26 08:52:49,917][123090] Updated weights for policy 1, policy_version 1155097 (0.0006) [2023-12-26 08:52:50,030][123091] Updated weights for policy 0, policy_version 1163441 (0.0010) [2023-12-26 08:52:50,095][123091] Updated weights for policy 0, policy_version 1163451 (0.0009) [2023-12-26 08:52:50,165][123091] Updated weights for policy 0, policy_version 1163461 (0.0010) [2023-12-26 08:52:50,216][123091] Updated weights for policy 0, policy_version 1163471 (0.0010) [2023-12-26 08:52:50,656][123090] Updated weights for policy 1, policy_version 1155107 (0.0007) [2023-12-26 08:52:50,727][123090] Updated weights for policy 1, policy_version 1155117 (0.0006) [2023-12-26 08:52:50,793][123090] Updated weights for policy 1, policy_version 1155127 (0.0006) [2023-12-26 08:52:51,124][123091] Updated weights for policy 0, policy_version 1163481 (0.0010) [2023-12-26 08:52:51,199][123091] Updated weights for policy 0, policy_version 1163491 (0.0011) [2023-12-26 08:52:51,272][123091] Updated weights for policy 0, policy_version 1163501 (0.0009) [2023-12-26 08:52:51,525][123090] Updated weights for policy 1, policy_version 1155137 (0.0006) [2023-12-26 08:52:51,593][123090] Updated weights for policy 1, policy_version 1155147 (0.0009) [2023-12-26 08:52:51,660][123090] Updated weights for policy 1, policy_version 1155157 (0.0009) [2023-12-26 08:52:51,719][123090] Updated weights for policy 1, policy_version 1155167 (0.0010) [2023-12-26 08:52:52,063][123091] Updated weights for policy 0, policy_version 1163511 (0.0009) [2023-12-26 08:52:52,119][123091] Updated weights for policy 0, policy_version 1163521 (0.0010) [2023-12-26 08:52:52,179][123091] Updated weights for policy 0, policy_version 1163531 (0.0009) [2023-12-26 08:52:52,412][123090] Updated weights for policy 1, policy_version 1155177 (0.0007) [2023-12-26 08:52:52,484][123090] Updated weights for policy 1, policy_version 1155187 (0.0006) [2023-12-26 08:52:52,561][123090] Updated weights for policy 1, policy_version 1155197 (0.0007) [2023-12-26 08:52:53,105][123091] Updated weights for policy 0, policy_version 1163541 (0.0009) [2023-12-26 08:52:53,166][123091] Updated weights for policy 0, policy_version 1163551 (0.0009) [2023-12-26 08:52:53,213][123090] Updated weights for policy 1, policy_version 1155207 (0.0009) [2023-12-26 08:52:53,220][123091] Updated weights for policy 0, policy_version 1163561 (0.0007) [2023-12-26 08:52:53,265][123090] Updated weights for policy 1, policy_version 1155217 (0.0010) [2023-12-26 08:52:53,309][123090] Updated weights for policy 1, policy_version 1155227 (0.0010) [2023-12-26 08:52:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 593616896. Throughput: 0: 8964.7, 1: 8646.8. Samples: 593593348. Policy #0 lag: (min: 31.0, avg: 36.0, max: 63.0) [2023-12-26 08:52:53,785][121949] Avg episode reward: [(0, '6152.881'), (1, '5241.296')] [2023-12-26 08:52:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001163568_297877504.pth... [2023-12-26 08:52:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001155232_295739392.pth... [2023-12-26 08:52:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001162544_297615360.pth [2023-12-26 08:52:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001154208_295477248.pth [2023-12-26 08:52:54,070][123091] Updated weights for policy 0, policy_version 1163571 (0.0007) [2023-12-26 08:52:54,119][123091] Updated weights for policy 0, policy_version 1163581 (0.0009) [2023-12-26 08:52:54,176][123090] Updated weights for policy 1, policy_version 1155237 (0.0010) [2023-12-26 08:52:54,184][123091] Updated weights for policy 0, policy_version 1163591 (0.0009) [2023-12-26 08:52:54,228][123090] Updated weights for policy 1, policy_version 1155247 (0.0010) [2023-12-26 08:52:54,279][123090] Updated weights for policy 1, policy_version 1155257 (0.0010) [2023-12-26 08:52:55,035][123091] Updated weights for policy 0, policy_version 1163601 (0.0007) [2023-12-26 08:52:55,088][123091] Updated weights for policy 0, policy_version 1163611 (0.0008) [2023-12-26 08:52:55,113][123090] Updated weights for policy 1, policy_version 1155267 (0.0010) [2023-12-26 08:52:55,142][123091] Updated weights for policy 0, policy_version 1163621 (0.0008) [2023-12-26 08:52:55,169][123090] Updated weights for policy 1, policy_version 1155277 (0.0007) [2023-12-26 08:52:55,202][123091] Updated weights for policy 0, policy_version 1163631 (0.0005) [2023-12-26 08:52:55,237][123090] Updated weights for policy 1, policy_version 1155287 (0.0009) [2023-12-26 08:52:55,975][123091] Updated weights for policy 0, policy_version 1163641 (0.0007) [2023-12-26 08:52:55,993][123090] Updated weights for policy 1, policy_version 1155297 (0.0010) [2023-12-26 08:52:56,029][123091] Updated weights for policy 0, policy_version 1163651 (0.0008) [2023-12-26 08:52:56,056][123090] Updated weights for policy 1, policy_version 1155307 (0.0007) [2023-12-26 08:52:56,089][123091] Updated weights for policy 0, policy_version 1163661 (0.0008) [2023-12-26 08:52:56,122][123090] Updated weights for policy 1, policy_version 1155317 (0.0010) [2023-12-26 08:52:56,192][123090] Updated weights for policy 1, policy_version 1155327 (0.0010) [2023-12-26 08:52:56,838][123090] Updated weights for policy 1, policy_version 1155337 (0.0006) [2023-12-26 08:52:56,858][123091] Updated weights for policy 0, policy_version 1163671 (0.0007) [2023-12-26 08:52:56,895][123090] Updated weights for policy 1, policy_version 1155347 (0.0005) [2023-12-26 08:52:56,914][123091] Updated weights for policy 0, policy_version 1163681 (0.0009) [2023-12-26 08:52:56,949][123090] Updated weights for policy 1, policy_version 1155357 (0.0009) [2023-12-26 08:52:56,973][123091] Updated weights for policy 0, policy_version 1163691 (0.0009) [2023-12-26 08:52:57,663][123090] Updated weights for policy 1, policy_version 1155367 (0.0007) [2023-12-26 08:52:57,699][123091] Updated weights for policy 0, policy_version 1163701 (0.0009) [2023-12-26 08:52:57,721][123090] Updated weights for policy 1, policy_version 1155377 (0.0006) [2023-12-26 08:52:57,762][123091] Updated weights for policy 0, policy_version 1163711 (0.0007) [2023-12-26 08:52:57,778][123090] Updated weights for policy 1, policy_version 1155387 (0.0006) [2023-12-26 08:52:57,825][123091] Updated weights for policy 0, policy_version 1163721 (0.0005) [2023-12-26 08:52:58,519][123090] Updated weights for policy 1, policy_version 1155397 (0.0008) [2023-12-26 08:52:58,584][123090] Updated weights for policy 1, policy_version 1155407 (0.0011) [2023-12-26 08:52:58,633][123091] Updated weights for policy 0, policy_version 1163731 (0.0006) [2023-12-26 08:52:58,656][123090] Updated weights for policy 1, policy_version 1155417 (0.0011) [2023-12-26 08:52:58,702][123091] Updated weights for policy 0, policy_version 1163741 (0.0011) [2023-12-26 08:52:58,774][123091] Updated weights for policy 0, policy_version 1163751 (0.0010) [2023-12-26 08:52:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 593707008. Throughput: 0: 8934.7, 1: 8735.6. Samples: 593701376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:52:58,784][121949] Avg episode reward: [(0, '6081.221'), (1, '5247.219')] [2023-12-26 08:52:59,507][123090] Updated weights for policy 1, policy_version 1155427 (0.0009) [2023-12-26 08:52:59,576][123090] Updated weights for policy 1, policy_version 1155437 (0.0008) [2023-12-26 08:52:59,647][123090] Updated weights for policy 1, policy_version 1155447 (0.0005) [2023-12-26 08:52:59,668][123091] Updated weights for policy 0, policy_version 1163761 (0.0010) [2023-12-26 08:52:59,730][123091] Updated weights for policy 0, policy_version 1163771 (0.0011) [2023-12-26 08:52:59,777][123091] Updated weights for policy 0, policy_version 1163781 (0.0010) [2023-12-26 08:52:59,837][123091] Updated weights for policy 0, policy_version 1163791 (0.0010) [2023-12-26 08:53:00,408][123090] Updated weights for policy 1, policy_version 1155457 (0.0007) [2023-12-26 08:53:00,471][123090] Updated weights for policy 1, policy_version 1155467 (0.0008) [2023-12-26 08:53:00,522][123090] Updated weights for policy 1, policy_version 1155477 (0.0008) [2023-12-26 08:53:00,582][123090] Updated weights for policy 1, policy_version 1155487 (0.0010) [2023-12-26 08:53:00,648][123091] Updated weights for policy 0, policy_version 1163801 (0.0007) [2023-12-26 08:53:00,699][123091] Updated weights for policy 0, policy_version 1163811 (0.0005) [2023-12-26 08:53:00,753][123091] Updated weights for policy 0, policy_version 1163821 (0.0006) [2023-12-26 08:53:01,359][123090] Updated weights for policy 1, policy_version 1155497 (0.0008) [2023-12-26 08:53:01,420][123090] Updated weights for policy 1, policy_version 1155507 (0.0009) [2023-12-26 08:53:01,456][123091] Updated weights for policy 0, policy_version 1163831 (0.0007) [2023-12-26 08:53:01,470][123090] Updated weights for policy 1, policy_version 1155517 (0.0007) [2023-12-26 08:53:01,507][123091] Updated weights for policy 0, policy_version 1163841 (0.0009) [2023-12-26 08:53:01,568][123091] Updated weights for policy 0, policy_version 1163851 (0.0009) [2023-12-26 08:53:02,263][123090] Updated weights for policy 1, policy_version 1155527 (0.0006) [2023-12-26 08:53:02,328][123090] Updated weights for policy 1, policy_version 1155537 (0.0009) [2023-12-26 08:53:02,395][123091] Updated weights for policy 0, policy_version 1163861 (0.0009) [2023-12-26 08:53:02,397][123090] Updated weights for policy 1, policy_version 1155547 (0.0009) [2023-12-26 08:53:02,441][123091] Updated weights for policy 0, policy_version 1163871 (0.0006) [2023-12-26 08:53:02,496][123091] Updated weights for policy 0, policy_version 1163881 (0.0005) [2023-12-26 08:53:03,110][123091] Updated weights for policy 0, policy_version 1163891 (0.0007) [2023-12-26 08:53:03,153][123091] Updated weights for policy 0, policy_version 1163901 (0.0010) [2023-12-26 08:53:03,199][123091] Updated weights for policy 0, policy_version 1163911 (0.0009) [2023-12-26 08:53:03,246][123090] Updated weights for policy 1, policy_version 1155557 (0.0008) [2023-12-26 08:53:03,314][123090] Updated weights for policy 1, policy_version 1155567 (0.0008) [2023-12-26 08:53:03,364][123090] Updated weights for policy 1, policy_version 1155577 (0.0009) [2023-12-26 08:53:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 593797120. Throughput: 0: 8907.5, 1: 8787.3. Samples: 593808496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:03,785][121949] Avg episode reward: [(0, '6272.132'), (1, '4990.726')] [2023-12-26 08:53:03,844][123091] Updated weights for policy 0, policy_version 1163921 (0.0006) [2023-12-26 08:53:03,912][123091] Updated weights for policy 0, policy_version 1163931 (0.0009) [2023-12-26 08:53:03,979][123091] Updated weights for policy 0, policy_version 1163941 (0.0008) [2023-12-26 08:53:04,033][123091] Updated weights for policy 0, policy_version 1163951 (0.0009) [2023-12-26 08:53:04,263][123090] Updated weights for policy 1, policy_version 1155588 (0.0010) [2023-12-26 08:53:04,331][123090] Updated weights for policy 1, policy_version 1155598 (0.0010) [2023-12-26 08:53:04,391][123090] Updated weights for policy 1, policy_version 1155608 (0.0009) [2023-12-26 08:53:04,879][123091] Updated weights for policy 0, policy_version 1163961 (0.0009) [2023-12-26 08:53:04,937][123091] Updated weights for policy 0, policy_version 1163971 (0.0009) [2023-12-26 08:53:04,994][123091] Updated weights for policy 0, policy_version 1163981 (0.0010) [2023-12-26 08:53:05,233][123090] Updated weights for policy 1, policy_version 1155618 (0.0009) [2023-12-26 08:53:05,287][123090] Updated weights for policy 1, policy_version 1155628 (0.0008) [2023-12-26 08:53:05,344][123090] Updated weights for policy 1, policy_version 1155638 (0.0009) [2023-12-26 08:53:05,393][123090] Updated weights for policy 1, policy_version 1155648 (0.0009) [2023-12-26 08:53:05,837][123091] Updated weights for policy 0, policy_version 1163991 (0.0009) [2023-12-26 08:53:05,899][123091] Updated weights for policy 0, policy_version 1164001 (0.0010) [2023-12-26 08:53:05,962][123091] Updated weights for policy 0, policy_version 1164011 (0.0005) [2023-12-26 08:53:06,258][123090] Updated weights for policy 1, policy_version 1155658 (0.0010) [2023-12-26 08:53:06,317][123090] Updated weights for policy 1, policy_version 1155668 (0.0009) [2023-12-26 08:53:06,378][123090] Updated weights for policy 1, policy_version 1155678 (0.0009) [2023-12-26 08:53:06,762][123091] Updated weights for policy 0, policy_version 1164021 (0.0008) [2023-12-26 08:53:06,825][123091] Updated weights for policy 0, policy_version 1164031 (0.0010) [2023-12-26 08:53:06,872][123091] Updated weights for policy 0, policy_version 1164041 (0.0010) [2023-12-26 08:53:07,213][123090] Updated weights for policy 1, policy_version 1155688 (0.0009) [2023-12-26 08:53:07,262][123090] Updated weights for policy 1, policy_version 1155698 (0.0009) [2023-12-26 08:53:07,311][123090] Updated weights for policy 1, policy_version 1155708 (0.0008) [2023-12-26 08:53:07,688][123091] Updated weights for policy 0, policy_version 1164051 (0.0010) [2023-12-26 08:53:07,748][123091] Updated weights for policy 0, policy_version 1164061 (0.0006) [2023-12-26 08:53:07,813][123091] Updated weights for policy 0, policy_version 1164071 (0.0005) [2023-12-26 08:53:08,231][123090] Updated weights for policy 1, policy_version 1155718 (0.0007) [2023-12-26 08:53:08,288][123090] Updated weights for policy 1, policy_version 1155728 (0.0005) [2023-12-26 08:53:08,356][123090] Updated weights for policy 1, policy_version 1155738 (0.0008) [2023-12-26 08:53:08,562][123091] Updated weights for policy 0, policy_version 1164081 (0.0008) [2023-12-26 08:53:08,616][123091] Updated weights for policy 0, policy_version 1164091 (0.0009) [2023-12-26 08:53:08,685][123091] Updated weights for policy 0, policy_version 1164102 (0.0010) [2023-12-26 08:53:08,743][123091] Updated weights for policy 0, policy_version 1164112 (0.0009) [2023-12-26 08:53:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 593887232. Throughput: 0: 8915.3, 1: 8784.4. Samples: 593859656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:08,785][121949] Avg episode reward: [(0, '6386.667'), (1, '4947.708')] [2023-12-26 08:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001164112_298016768.pth... [2023-12-26 08:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001155744_295870464.pth... [2023-12-26 08:53:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001163088_297754624.pth [2023-12-26 08:53:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001154720_295608320.pth [2023-12-26 08:53:09,125][123090] Updated weights for policy 1, policy_version 1155748 (0.0010) [2023-12-26 08:53:09,177][123090] Updated weights for policy 1, policy_version 1155758 (0.0009) [2023-12-26 08:53:09,229][123090] Updated weights for policy 1, policy_version 1155768 (0.0009) [2023-12-26 08:53:09,537][123091] Updated weights for policy 0, policy_version 1164122 (0.0009) [2023-12-26 08:53:09,604][123091] Updated weights for policy 0, policy_version 1164132 (0.0008) [2023-12-26 08:53:09,673][123091] Updated weights for policy 0, policy_version 1164142 (0.0010) [2023-12-26 08:53:10,088][123090] Updated weights for policy 1, policy_version 1155778 (0.0009) [2023-12-26 08:53:10,140][123090] Updated weights for policy 1, policy_version 1155788 (0.0009) [2023-12-26 08:53:10,189][123090] Updated weights for policy 1, policy_version 1155798 (0.0009) [2023-12-26 08:53:10,238][123090] Updated weights for policy 1, policy_version 1155808 (0.0009) [2023-12-26 08:53:10,559][123091] Updated weights for policy 0, policy_version 1164152 (0.0011) [2023-12-26 08:53:10,622][123091] Updated weights for policy 0, policy_version 1164162 (0.0011) [2023-12-26 08:53:10,684][123091] Updated weights for policy 0, policy_version 1164172 (0.0010) [2023-12-26 08:53:11,104][123090] Updated weights for policy 1, policy_version 1155818 (0.0009) [2023-12-26 08:53:11,180][123090] Updated weights for policy 1, policy_version 1155828 (0.0009) [2023-12-26 08:53:11,255][123090] Updated weights for policy 1, policy_version 1155838 (0.0009) [2023-12-26 08:53:11,493][123091] Updated weights for policy 0, policy_version 1164182 (0.0010) [2023-12-26 08:53:11,545][123091] Updated weights for policy 0, policy_version 1164192 (0.0010) [2023-12-26 08:53:11,615][123091] Updated weights for policy 0, policy_version 1164202 (0.0009) [2023-12-26 08:53:12,114][123090] Updated weights for policy 1, policy_version 1155848 (0.0010) [2023-12-26 08:53:12,170][123090] Updated weights for policy 1, policy_version 1155858 (0.0010) [2023-12-26 08:53:12,230][123090] Updated weights for policy 1, policy_version 1155869 (0.0006) [2023-12-26 08:53:12,456][123091] Updated weights for policy 0, policy_version 1164212 (0.0009) [2023-12-26 08:53:12,512][123091] Updated weights for policy 0, policy_version 1164222 (0.0010) [2023-12-26 08:53:12,562][123091] Updated weights for policy 0, policy_version 1164232 (0.0009) [2023-12-26 08:53:13,080][123090] Updated weights for policy 1, policy_version 1155879 (0.0009) [2023-12-26 08:53:13,148][123090] Updated weights for policy 1, policy_version 1155889 (0.0008) [2023-12-26 08:53:13,206][123090] Updated weights for policy 1, policy_version 1155899 (0.0010) [2023-12-26 08:53:13,422][123091] Updated weights for policy 0, policy_version 1164242 (0.0008) [2023-12-26 08:53:13,500][123091] Updated weights for policy 0, policy_version 1164252 (0.0006) [2023-12-26 08:53:13,577][123091] Updated weights for policy 0, policy_version 1164262 (0.0005) [2023-12-26 08:53:13,642][123091] Updated weights for policy 0, policy_version 1164272 (0.0005) [2023-12-26 08:53:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 593969152. Throughput: 0: 8874.3, 1: 8710.0. Samples: 593962960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:13,785][121949] Avg episode reward: [(0, '6463.311'), (1, '5064.504')] [2023-12-26 08:53:13,955][123090] Updated weights for policy 1, policy_version 1155909 (0.0010) [2023-12-26 08:53:14,022][123090] Updated weights for policy 1, policy_version 1155919 (0.0011) [2023-12-26 08:53:14,094][123090] Updated weights for policy 1, policy_version 1155929 (0.0007) [2023-12-26 08:53:14,282][123091] Updated weights for policy 0, policy_version 1164282 (0.0007) [2023-12-26 08:53:14,343][123091] Updated weights for policy 0, policy_version 1164292 (0.0009) [2023-12-26 08:53:14,402][123091] Updated weights for policy 0, policy_version 1164303 (0.0010) [2023-12-26 08:53:14,879][123090] Updated weights for policy 1, policy_version 1155939 (0.0011) [2023-12-26 08:53:14,944][123090] Updated weights for policy 1, policy_version 1155949 (0.0011) [2023-12-26 08:53:15,014][123090] Updated weights for policy 1, policy_version 1155959 (0.0011) [2023-12-26 08:53:15,236][123091] Updated weights for policy 0, policy_version 1164313 (0.0010) [2023-12-26 08:53:15,303][123091] Updated weights for policy 0, policy_version 1164323 (0.0010) [2023-12-26 08:53:15,352][123091] Updated weights for policy 0, policy_version 1164333 (0.0007) [2023-12-26 08:53:15,731][123090] Updated weights for policy 1, policy_version 1155969 (0.0010) [2023-12-26 08:53:15,792][123090] Updated weights for policy 1, policy_version 1155979 (0.0005) [2023-12-26 08:53:15,843][123090] Updated weights for policy 1, policy_version 1155989 (0.0006) [2023-12-26 08:53:15,896][123090] Updated weights for policy 1, policy_version 1155999 (0.0006) [2023-12-26 08:53:16,246][123091] Updated weights for policy 0, policy_version 1164343 (0.0010) [2023-12-26 08:53:16,305][123091] Updated weights for policy 0, policy_version 1164353 (0.0010) [2023-12-26 08:53:16,355][123091] Updated weights for policy 0, policy_version 1164363 (0.0009) [2023-12-26 08:53:16,693][123090] Updated weights for policy 1, policy_version 1156009 (0.0005) [2023-12-26 08:53:16,750][123090] Updated weights for policy 1, policy_version 1156019 (0.0005) [2023-12-26 08:53:16,811][123090] Updated weights for policy 1, policy_version 1156029 (0.0005) [2023-12-26 08:53:17,242][123091] Updated weights for policy 0, policy_version 1164373 (0.0010) [2023-12-26 08:53:17,304][123091] Updated weights for policy 0, policy_version 1164383 (0.0008) [2023-12-26 08:53:17,371][123091] Updated weights for policy 0, policy_version 1164393 (0.0009) [2023-12-26 08:53:17,499][123090] Updated weights for policy 1, policy_version 1156039 (0.0005) [2023-12-26 08:53:17,553][123090] Updated weights for policy 1, policy_version 1156049 (0.0006) [2023-12-26 08:53:17,611][123090] Updated weights for policy 1, policy_version 1156059 (0.0008) [2023-12-26 08:53:18,240][123091] Updated weights for policy 0, policy_version 1164403 (0.0010) [2023-12-26 08:53:18,294][123091] Updated weights for policy 0, policy_version 1164413 (0.0009) [2023-12-26 08:53:18,352][123091] Updated weights for policy 0, policy_version 1164423 (0.0010) [2023-12-26 08:53:18,433][123090] Updated weights for policy 1, policy_version 1156069 (0.0009) [2023-12-26 08:53:18,495][123090] Updated weights for policy 1, policy_version 1156079 (0.0008) [2023-12-26 08:53:18,543][123090] Updated weights for policy 1, policy_version 1156089 (0.0008) [2023-12-26 08:53:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 594059264. Throughput: 0: 8736.8, 1: 8783.0. Samples: 594068588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:18,784][121949] Avg episode reward: [(0, '6473.579'), (1, '5148.967')] [2023-12-26 08:53:19,238][123091] Updated weights for policy 0, policy_version 1164433 (0.0009) [2023-12-26 08:53:19,297][123091] Updated weights for policy 0, policy_version 1164443 (0.0010) [2023-12-26 08:53:19,309][123090] Updated weights for policy 1, policy_version 1156099 (0.0006) [2023-12-26 08:53:19,360][123091] Updated weights for policy 0, policy_version 1164453 (0.0009) [2023-12-26 08:53:19,376][123090] Updated weights for policy 1, policy_version 1156109 (0.0009) [2023-12-26 08:53:19,428][123091] Updated weights for policy 0, policy_version 1164463 (0.0007) [2023-12-26 08:53:19,430][123090] Updated weights for policy 1, policy_version 1156119 (0.0009) [2023-12-26 08:53:20,198][123091] Updated weights for policy 0, policy_version 1164473 (0.0006) [2023-12-26 08:53:20,264][123091] Updated weights for policy 0, policy_version 1164483 (0.0006) [2023-12-26 08:53:20,276][123090] Updated weights for policy 1, policy_version 1156129 (0.0009) [2023-12-26 08:53:20,322][123091] Updated weights for policy 0, policy_version 1164493 (0.0006) [2023-12-26 08:53:20,346][123090] Updated weights for policy 1, policy_version 1156139 (0.0008) [2023-12-26 08:53:20,426][123090] Updated weights for policy 1, policy_version 1156149 (0.0006) [2023-12-26 08:53:20,500][123090] Updated weights for policy 1, policy_version 1156159 (0.0005) [2023-12-26 08:53:21,021][123091] Updated weights for policy 0, policy_version 1164503 (0.0006) [2023-12-26 08:53:21,092][123091] Updated weights for policy 0, policy_version 1164513 (0.0007) [2023-12-26 08:53:21,164][123091] Updated weights for policy 0, policy_version 1164523 (0.0009) [2023-12-26 08:53:21,358][123090] Updated weights for policy 1, policy_version 1156169 (0.0010) [2023-12-26 08:53:21,433][123090] Updated weights for policy 1, policy_version 1156179 (0.0010) [2023-12-26 08:53:21,502][123090] Updated weights for policy 1, policy_version 1156189 (0.0011) [2023-12-26 08:53:21,968][123091] Updated weights for policy 0, policy_version 1164533 (0.0009) [2023-12-26 08:53:22,038][123091] Updated weights for policy 0, policy_version 1164543 (0.0008) [2023-12-26 08:53:22,104][123091] Updated weights for policy 0, policy_version 1164553 (0.0008) [2023-12-26 08:53:22,339][123090] Updated weights for policy 1, policy_version 1156199 (0.0009) [2023-12-26 08:53:22,403][123090] Updated weights for policy 1, policy_version 1156209 (0.0010) [2023-12-26 08:53:22,455][123090] Updated weights for policy 1, policy_version 1156219 (0.0010) [2023-12-26 08:53:22,940][123091] Updated weights for policy 0, policy_version 1164563 (0.0009) [2023-12-26 08:53:23,001][123091] Updated weights for policy 0, policy_version 1164573 (0.0011) [2023-12-26 08:53:23,068][123091] Updated weights for policy 0, policy_version 1164583 (0.0010) [2023-12-26 08:53:23,246][123090] Updated weights for policy 1, policy_version 1156229 (0.0008) [2023-12-26 08:53:23,310][123090] Updated weights for policy 1, policy_version 1156239 (0.0005) [2023-12-26 08:53:23,374][123090] Updated weights for policy 1, policy_version 1156249 (0.0006) [2023-12-26 08:53:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 594141184. Throughput: 0: 8735.8, 1: 8730.8. Samples: 594120984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:23,785][121949] Avg episode reward: [(0, '6276.580'), (1, '5200.186')] [2023-12-26 08:53:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001164592_298139648.pth... [2023-12-26 08:53:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001156256_296001536.pth... [2023-12-26 08:53:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001163568_297877504.pth [2023-12-26 08:53:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001155232_295739392.pth [2023-12-26 08:53:23,871][123091] Updated weights for policy 0, policy_version 1164593 (0.0010) [2023-12-26 08:53:23,923][123091] Updated weights for policy 0, policy_version 1164603 (0.0010) [2023-12-26 08:53:23,977][123091] Updated weights for policy 0, policy_version 1164613 (0.0010) [2023-12-26 08:53:24,025][123091] Updated weights for policy 0, policy_version 1164623 (0.0010) [2023-12-26 08:53:24,059][123090] Updated weights for policy 1, policy_version 1156259 (0.0007) [2023-12-26 08:53:24,114][123090] Updated weights for policy 1, policy_version 1156269 (0.0010) [2023-12-26 08:53:24,185][123090] Updated weights for policy 1, policy_version 1156279 (0.0009) [2023-12-26 08:53:24,752][123091] Updated weights for policy 0, policy_version 1164633 (0.0011) [2023-12-26 08:53:24,810][123091] Updated weights for policy 0, policy_version 1164643 (0.0010) [2023-12-26 08:53:24,875][123091] Updated weights for policy 0, policy_version 1164653 (0.0005) [2023-12-26 08:53:24,875][123090] Updated weights for policy 1, policy_version 1156289 (0.0010) [2023-12-26 08:53:24,946][123090] Updated weights for policy 1, policy_version 1156299 (0.0008) [2023-12-26 08:53:24,998][123090] Updated weights for policy 1, policy_version 1156309 (0.0005) [2023-12-26 08:53:25,053][123090] Updated weights for policy 1, policy_version 1156319 (0.0010) [2023-12-26 08:53:25,596][123091] Updated weights for policy 0, policy_version 1164663 (0.0009) [2023-12-26 08:53:25,658][123091] Updated weights for policy 0, policy_version 1164673 (0.0010) [2023-12-26 08:53:25,709][123091] Updated weights for policy 0, policy_version 1164683 (0.0010) [2023-12-26 08:53:25,841][123090] Updated weights for policy 1, policy_version 1156329 (0.0009) [2023-12-26 08:53:25,908][123090] Updated weights for policy 1, policy_version 1156339 (0.0010) [2023-12-26 08:53:25,968][123090] Updated weights for policy 1, policy_version 1156349 (0.0009) [2023-12-26 08:53:26,503][123091] Updated weights for policy 0, policy_version 1164693 (0.0010) [2023-12-26 08:53:26,546][123091] Updated weights for policy 0, policy_version 1164703 (0.0010) [2023-12-26 08:53:26,593][123091] Updated weights for policy 0, policy_version 1164713 (0.0010) [2023-12-26 08:53:26,738][123090] Updated weights for policy 1, policy_version 1156359 (0.0008) [2023-12-26 08:53:26,789][123090] Updated weights for policy 1, policy_version 1156369 (0.0005) [2023-12-26 08:53:26,837][123090] Updated weights for policy 1, policy_version 1156379 (0.0005) [2023-12-26 08:53:27,439][123091] Updated weights for policy 0, policy_version 1164723 (0.0009) [2023-12-26 08:53:27,495][123091] Updated weights for policy 0, policy_version 1164733 (0.0005) [2023-12-26 08:53:27,556][123091] Updated weights for policy 0, policy_version 1164743 (0.0008) [2023-12-26 08:53:27,558][123090] Updated weights for policy 1, policy_version 1156389 (0.0005) [2023-12-26 08:53:27,613][123090] Updated weights for policy 1, policy_version 1156399 (0.0008) [2023-12-26 08:53:27,672][123090] Updated weights for policy 1, policy_version 1156410 (0.0009) [2023-12-26 08:53:28,369][123090] Updated weights for policy 1, policy_version 1156420 (0.0010) [2023-12-26 08:53:28,387][123091] Updated weights for policy 0, policy_version 1164753 (0.0008) [2023-12-26 08:53:28,420][123090] Updated weights for policy 1, policy_version 1156430 (0.0010) [2023-12-26 08:53:28,448][123091] Updated weights for policy 0, policy_version 1164763 (0.0006) [2023-12-26 08:53:28,479][123090] Updated weights for policy 1, policy_version 1156440 (0.0010) [2023-12-26 08:53:28,507][123091] Updated weights for policy 0, policy_version 1164773 (0.0006) [2023-12-26 08:53:28,568][123091] Updated weights for policy 0, policy_version 1164783 (0.0009) [2023-12-26 08:53:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 594239488. Throughput: 0: 8748.5, 1: 8868.3. Samples: 594229744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:28,785][121949] Avg episode reward: [(0, '6050.138'), (1, '5339.212')] [2023-12-26 08:53:29,318][123090] Updated weights for policy 1, policy_version 1156450 (0.0010) [2023-12-26 08:53:29,384][123091] Updated weights for policy 0, policy_version 1164793 (0.0008) [2023-12-26 08:53:29,384][123090] Updated weights for policy 1, policy_version 1156460 (0.0010) [2023-12-26 08:53:29,439][123090] Updated weights for policy 1, policy_version 1156470 (0.0010) [2023-12-26 08:53:29,454][123091] Updated weights for policy 0, policy_version 1164803 (0.0008) [2023-12-26 08:53:29,502][123090] Updated weights for policy 1, policy_version 1156480 (0.0010) [2023-12-26 08:53:29,517][123091] Updated weights for policy 0, policy_version 1164813 (0.0010) [2023-12-26 08:53:30,257][123091] Updated weights for policy 0, policy_version 1164823 (0.0009) [2023-12-26 08:53:30,321][123091] Updated weights for policy 0, policy_version 1164833 (0.0010) [2023-12-26 08:53:30,343][123090] Updated weights for policy 1, policy_version 1156490 (0.0009) [2023-12-26 08:53:30,388][123091] Updated weights for policy 0, policy_version 1164843 (0.0009) [2023-12-26 08:53:30,407][123090] Updated weights for policy 1, policy_version 1156500 (0.0005) [2023-12-26 08:53:30,466][123090] Updated weights for policy 1, policy_version 1156510 (0.0005) [2023-12-26 08:53:31,085][123090] Updated weights for policy 1, policy_version 1156520 (0.0009) [2023-12-26 08:53:31,093][123091] Updated weights for policy 0, policy_version 1164853 (0.0007) [2023-12-26 08:53:31,134][123090] Updated weights for policy 1, policy_version 1156530 (0.0010) [2023-12-26 08:53:31,154][123091] Updated weights for policy 0, policy_version 1164863 (0.0008) [2023-12-26 08:53:31,201][123090] Updated weights for policy 1, policy_version 1156540 (0.0011) [2023-12-26 08:53:31,218][123091] Updated weights for policy 0, policy_version 1164873 (0.0011) [2023-12-26 08:53:31,960][123091] Updated weights for policy 0, policy_version 1164883 (0.0010) [2023-12-26 08:53:32,010][123090] Updated weights for policy 1, policy_version 1156550 (0.0010) [2023-12-26 08:53:32,029][123091] Updated weights for policy 0, policy_version 1164893 (0.0008) [2023-12-26 08:53:32,070][123090] Updated weights for policy 1, policy_version 1156560 (0.0010) [2023-12-26 08:53:32,089][123091] Updated weights for policy 0, policy_version 1164903 (0.0006) [2023-12-26 08:53:32,133][123090] Updated weights for policy 1, policy_version 1156570 (0.0010) [2023-12-26 08:53:32,751][123091] Updated weights for policy 0, policy_version 1164913 (0.0006) [2023-12-26 08:53:32,816][123091] Updated weights for policy 0, policy_version 1164923 (0.0008) [2023-12-26 08:53:32,874][123091] Updated weights for policy 0, policy_version 1164933 (0.0009) [2023-12-26 08:53:32,907][123090] Updated weights for policy 1, policy_version 1156580 (0.0009) [2023-12-26 08:53:32,935][123091] Updated weights for policy 0, policy_version 1164943 (0.0007) [2023-12-26 08:53:32,974][123090] Updated weights for policy 1, policy_version 1156590 (0.0010) [2023-12-26 08:53:33,042][123090] Updated weights for policy 1, policy_version 1156600 (0.0005) [2023-12-26 08:53:33,684][123091] Updated weights for policy 0, policy_version 1164953 (0.0006) [2023-12-26 08:53:33,731][123091] Updated weights for policy 0, policy_version 1164963 (0.0008) [2023-12-26 08:53:33,751][123090] Updated weights for policy 1, policy_version 1156610 (0.0006) [2023-12-26 08:53:33,779][123091] Updated weights for policy 0, policy_version 1164973 (0.0010) [2023-12-26 08:53:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 594321408. Throughput: 0: 8810.6, 1: 8937.2. Samples: 594340160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:33,784][121949] Avg episode reward: [(0, '6034.112'), (1, '5252.062')] [2023-12-26 08:53:33,803][123090] Updated weights for policy 1, policy_version 1156620 (0.0007) [2023-12-26 08:53:33,864][123090] Updated weights for policy 1, policy_version 1156630 (0.0006) [2023-12-26 08:53:33,925][123090] Updated weights for policy 1, policy_version 1156640 (0.0005) [2023-12-26 08:53:34,490][123091] Updated weights for policy 0, policy_version 1164983 (0.0009) [2023-12-26 08:53:34,560][123091] Updated weights for policy 0, policy_version 1164993 (0.0009) [2023-12-26 08:53:34,625][123091] Updated weights for policy 0, policy_version 1165003 (0.0010) [2023-12-26 08:53:34,721][123090] Updated weights for policy 1, policy_version 1156650 (0.0009) [2023-12-26 08:53:34,775][123090] Updated weights for policy 1, policy_version 1156660 (0.0009) [2023-12-26 08:53:34,829][123090] Updated weights for policy 1, policy_version 1156670 (0.0010) [2023-12-26 08:53:35,476][123091] Updated weights for policy 0, policy_version 1165013 (0.0010) [2023-12-26 08:53:35,542][123091] Updated weights for policy 0, policy_version 1165023 (0.0009) [2023-12-26 08:53:35,585][123090] Updated weights for policy 1, policy_version 1156680 (0.0006) [2023-12-26 08:53:35,604][123091] Updated weights for policy 0, policy_version 1165033 (0.0009) [2023-12-26 08:53:35,646][123090] Updated weights for policy 1, policy_version 1156690 (0.0005) [2023-12-26 08:53:35,701][123090] Updated weights for policy 1, policy_version 1156700 (0.0005) [2023-12-26 08:53:36,425][123090] Updated weights for policy 1, policy_version 1156710 (0.0008) [2023-12-26 08:53:36,484][123090] Updated weights for policy 1, policy_version 1156720 (0.0010) [2023-12-26 08:53:36,536][123091] Updated weights for policy 0, policy_version 1165043 (0.0008) [2023-12-26 08:53:36,537][123090] Updated weights for policy 1, policy_version 1156730 (0.0010) [2023-12-26 08:53:36,593][123091] Updated weights for policy 0, policy_version 1165053 (0.0008) [2023-12-26 08:53:36,649][123091] Updated weights for policy 0, policy_version 1165064 (0.0009) [2023-12-26 08:53:37,371][123090] Updated weights for policy 1, policy_version 1156740 (0.0011) [2023-12-26 08:53:37,443][123090] Updated weights for policy 1, policy_version 1156750 (0.0011) [2023-12-26 08:53:37,497][123091] Updated weights for policy 0, policy_version 1165074 (0.0008) [2023-12-26 08:53:37,498][123090] Updated weights for policy 1, policy_version 1156760 (0.0010) [2023-12-26 08:53:37,558][123091] Updated weights for policy 0, policy_version 1165084 (0.0006) [2023-12-26 08:53:37,631][123091] Updated weights for policy 0, policy_version 1165094 (0.0007) [2023-12-26 08:53:37,691][123091] Updated weights for policy 0, policy_version 1165104 (0.0009) [2023-12-26 08:53:38,321][123090] Updated weights for policy 1, policy_version 1156770 (0.0010) [2023-12-26 08:53:38,387][123090] Updated weights for policy 1, policy_version 1156780 (0.0011) [2023-12-26 08:53:38,446][123090] Updated weights for policy 1, policy_version 1156790 (0.0010) [2023-12-26 08:53:38,476][123091] Updated weights for policy 0, policy_version 1165114 (0.0008) [2023-12-26 08:53:38,508][123090] Updated weights for policy 1, policy_version 1156800 (0.0008) [2023-12-26 08:53:38,539][123091] Updated weights for policy 0, policy_version 1165124 (0.0008) [2023-12-26 08:53:38,601][123091] Updated weights for policy 0, policy_version 1165134 (0.0008) [2023-12-26 08:53:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 594419712. Throughput: 0: 8833.4, 1: 8935.5. Samples: 594392944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:38,785][121949] Avg episode reward: [(0, '6101.692'), (1, '5123.433')] [2023-12-26 08:53:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001165136_298278912.pth... [2023-12-26 08:53:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001156800_296140800.pth... [2023-12-26 08:53:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001164112_298016768.pth [2023-12-26 08:53:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001155744_295870464.pth [2023-12-26 08:53:39,359][123090] Updated weights for policy 1, policy_version 1156810 (0.0010) [2023-12-26 08:53:39,405][123091] Updated weights for policy 0, policy_version 1165144 (0.0009) [2023-12-26 08:53:39,431][123090] Updated weights for policy 1, policy_version 1156820 (0.0013) [2023-12-26 08:53:39,473][123091] Updated weights for policy 0, policy_version 1165154 (0.0007) [2023-12-26 08:53:39,500][123090] Updated weights for policy 1, policy_version 1156830 (0.0011) [2023-12-26 08:53:39,537][123091] Updated weights for policy 0, policy_version 1165164 (0.0006) [2023-12-26 08:53:40,287][123091] Updated weights for policy 0, policy_version 1165174 (0.0006) [2023-12-26 08:53:40,307][123090] Updated weights for policy 1, policy_version 1156840 (0.0011) [2023-12-26 08:53:40,337][123091] Updated weights for policy 0, policy_version 1165184 (0.0007) [2023-12-26 08:53:40,379][123090] Updated weights for policy 1, policy_version 1156850 (0.0011) [2023-12-26 08:53:40,403][123091] Updated weights for policy 0, policy_version 1165194 (0.0006) [2023-12-26 08:53:40,443][123090] Updated weights for policy 1, policy_version 1156860 (0.0011) [2023-12-26 08:53:41,066][123091] Updated weights for policy 0, policy_version 1165204 (0.0007) [2023-12-26 08:53:41,121][123091] Updated weights for policy 0, policy_version 1165214 (0.0009) [2023-12-26 08:53:41,186][123091] Updated weights for policy 0, policy_version 1165224 (0.0008) [2023-12-26 08:53:41,292][123090] Updated weights for policy 1, policy_version 1156870 (0.0009) [2023-12-26 08:53:41,367][123090] Updated weights for policy 1, policy_version 1156880 (0.0010) [2023-12-26 08:53:41,439][123090] Updated weights for policy 1, policy_version 1156890 (0.0010) [2023-12-26 08:53:42,014][123091] Updated weights for policy 0, policy_version 1165234 (0.0008) [2023-12-26 08:53:42,073][123091] Updated weights for policy 0, policy_version 1165244 (0.0008) [2023-12-26 08:53:42,132][123091] Updated weights for policy 0, policy_version 1165254 (0.0008) [2023-12-26 08:53:42,185][123091] Updated weights for policy 0, policy_version 1165264 (0.0005) [2023-12-26 08:53:42,367][123090] Updated weights for policy 1, policy_version 1156900 (0.0009) [2023-12-26 08:53:42,439][123090] Updated weights for policy 1, policy_version 1156910 (0.0009) [2023-12-26 08:53:42,502][123090] Updated weights for policy 1, policy_version 1156920 (0.0010) [2023-12-26 08:53:43,038][123091] Updated weights for policy 0, policy_version 1165274 (0.0009) [2023-12-26 08:53:43,089][123091] Updated weights for policy 0, policy_version 1165284 (0.0005) [2023-12-26 08:53:43,135][123091] Updated weights for policy 0, policy_version 1165294 (0.0005) [2023-12-26 08:53:43,271][123090] Updated weights for policy 1, policy_version 1156930 (0.0010) [2023-12-26 08:53:43,323][123090] Updated weights for policy 1, policy_version 1156940 (0.0010) [2023-12-26 08:53:43,370][123090] Updated weights for policy 1, policy_version 1156950 (0.0010) [2023-12-26 08:53:43,434][123090] Updated weights for policy 1, policy_version 1156960 (0.0010) [2023-12-26 08:53:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 594501632. Throughput: 0: 8873.1, 1: 8788.9. Samples: 594496164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:43,784][121949] Avg episode reward: [(0, '6201.952'), (1, '5138.132')] [2023-12-26 08:53:43,843][123091] Updated weights for policy 0, policy_version 1165304 (0.0008) [2023-12-26 08:53:43,908][123091] Updated weights for policy 0, policy_version 1165314 (0.0009) [2023-12-26 08:53:43,965][123091] Updated weights for policy 0, policy_version 1165324 (0.0009) [2023-12-26 08:53:44,297][123090] Updated weights for policy 1, policy_version 1156970 (0.0005) [2023-12-26 08:53:44,363][123090] Updated weights for policy 1, policy_version 1156980 (0.0008) [2023-12-26 08:53:44,430][123090] Updated weights for policy 1, policy_version 1156990 (0.0011) [2023-12-26 08:53:44,806][123091] Updated weights for policy 0, policy_version 1165334 (0.0009) [2023-12-26 08:53:44,879][123091] Updated weights for policy 0, policy_version 1165344 (0.0007) [2023-12-26 08:53:44,948][123091] Updated weights for policy 0, policy_version 1165354 (0.0009) [2023-12-26 08:53:45,223][123090] Updated weights for policy 1, policy_version 1157000 (0.0011) [2023-12-26 08:53:45,289][123090] Updated weights for policy 1, policy_version 1157010 (0.0011) [2023-12-26 08:53:45,353][123090] Updated weights for policy 1, policy_version 1157020 (0.0011) [2023-12-26 08:53:45,750][123091] Updated weights for policy 0, policy_version 1165364 (0.0009) [2023-12-26 08:53:45,809][123091] Updated weights for policy 0, policy_version 1165374 (0.0008) [2023-12-26 08:53:45,875][123091] Updated weights for policy 0, policy_version 1165384 (0.0009) [2023-12-26 08:53:46,176][123090] Updated weights for policy 1, policy_version 1157030 (0.0010) [2023-12-26 08:53:46,238][123090] Updated weights for policy 1, policy_version 1157040 (0.0010) [2023-12-26 08:53:46,304][123090] Updated weights for policy 1, policy_version 1157050 (0.0010) [2023-12-26 08:53:46,701][123091] Updated weights for policy 0, policy_version 1165394 (0.0008) [2023-12-26 08:53:46,765][123091] Updated weights for policy 0, policy_version 1165404 (0.0009) [2023-12-26 08:53:46,834][123091] Updated weights for policy 0, policy_version 1165414 (0.0009) [2023-12-26 08:53:46,907][123091] Updated weights for policy 0, policy_version 1165424 (0.0009) [2023-12-26 08:53:47,127][123090] Updated weights for policy 1, policy_version 1157060 (0.0010) [2023-12-26 08:53:47,175][123090] Updated weights for policy 1, policy_version 1157070 (0.0010) [2023-12-26 08:53:47,223][123090] Updated weights for policy 1, policy_version 1157080 (0.0010) [2023-12-26 08:53:47,741][123091] Updated weights for policy 0, policy_version 1165434 (0.0009) [2023-12-26 08:53:47,797][123091] Updated weights for policy 0, policy_version 1165444 (0.0009) [2023-12-26 08:53:47,854][123091] Updated weights for policy 0, policy_version 1165454 (0.0009) [2023-12-26 08:53:47,870][123090] Updated weights for policy 1, policy_version 1157090 (0.0009) [2023-12-26 08:53:47,933][123090] Updated weights for policy 1, policy_version 1157100 (0.0006) [2023-12-26 08:53:47,988][123090] Updated weights for policy 1, policy_version 1157110 (0.0009) [2023-12-26 08:53:48,051][123090] Updated weights for policy 1, policy_version 1157120 (0.0009) [2023-12-26 08:53:48,671][123091] Updated weights for policy 0, policy_version 1165464 (0.0006) [2023-12-26 08:53:48,720][123091] Updated weights for policy 0, policy_version 1165474 (0.0006) [2023-12-26 08:53:48,766][123091] Updated weights for policy 0, policy_version 1165484 (0.0005) [2023-12-26 08:53:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 594583552. Throughput: 0: 8805.4, 1: 8816.6. Samples: 594601488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:48,784][121949] Avg episode reward: [(0, '6244.786'), (1, '5322.609')] [2023-12-26 08:53:48,900][123090] Updated weights for policy 1, policy_version 1157130 (0.0009) [2023-12-26 08:53:48,956][123090] Updated weights for policy 1, policy_version 1157140 (0.0010) [2023-12-26 08:53:49,025][123090] Updated weights for policy 1, policy_version 1157150 (0.0009) [2023-12-26 08:53:49,549][123091] Updated weights for policy 0, policy_version 1165494 (0.0007) [2023-12-26 08:53:49,605][123091] Updated weights for policy 0, policy_version 1165504 (0.0008) [2023-12-26 08:53:49,656][123091] Updated weights for policy 0, policy_version 1165514 (0.0010) [2023-12-26 08:53:49,917][123090] Updated weights for policy 1, policy_version 1157160 (0.0010) [2023-12-26 08:53:49,985][123090] Updated weights for policy 1, policy_version 1157170 (0.0008) [2023-12-26 08:53:50,051][123090] Updated weights for policy 1, policy_version 1157180 (0.0009) [2023-12-26 08:53:50,391][123091] Updated weights for policy 0, policy_version 1165524 (0.0008) [2023-12-26 08:53:50,458][123091] Updated weights for policy 0, policy_version 1165534 (0.0007) [2023-12-26 08:53:50,515][123091] Updated weights for policy 0, policy_version 1165544 (0.0010) [2023-12-26 08:53:50,941][123090] Updated weights for policy 1, policy_version 1157190 (0.0010) [2023-12-26 08:53:51,005][123090] Updated weights for policy 1, policy_version 1157200 (0.0010) [2023-12-26 08:53:51,069][123090] Updated weights for policy 1, policy_version 1157210 (0.0011) [2023-12-26 08:53:51,342][123091] Updated weights for policy 0, policy_version 1165554 (0.0008) [2023-12-26 08:53:51,412][123091] Updated weights for policy 0, policy_version 1165564 (0.0009) [2023-12-26 08:53:51,469][123091] Updated weights for policy 0, policy_version 1165574 (0.0009) [2023-12-26 08:53:51,529][123091] Updated weights for policy 0, policy_version 1165584 (0.0010) [2023-12-26 08:53:51,821][123090] Updated weights for policy 1, policy_version 1157220 (0.0010) [2023-12-26 08:53:51,881][123090] Updated weights for policy 1, policy_version 1157230 (0.0009) [2023-12-26 08:53:51,941][123090] Updated weights for policy 1, policy_version 1157240 (0.0010) [2023-12-26 08:53:52,373][123091] Updated weights for policy 0, policy_version 1165594 (0.0010) [2023-12-26 08:53:52,438][123091] Updated weights for policy 0, policy_version 1165604 (0.0010) [2023-12-26 08:53:52,501][123091] Updated weights for policy 0, policy_version 1165614 (0.0011) [2023-12-26 08:53:52,803][123090] Updated weights for policy 1, policy_version 1157250 (0.0008) [2023-12-26 08:53:52,879][123090] Updated weights for policy 1, policy_version 1157260 (0.0005) [2023-12-26 08:53:52,946][123090] Updated weights for policy 1, policy_version 1157270 (0.0005) [2023-12-26 08:53:53,015][123090] Updated weights for policy 1, policy_version 1157280 (0.0007) [2023-12-26 08:53:53,154][123091] Updated weights for policy 0, policy_version 1165624 (0.0010) [2023-12-26 08:53:53,209][123091] Updated weights for policy 0, policy_version 1165634 (0.0005) [2023-12-26 08:53:53,259][123091] Updated weights for policy 0, policy_version 1165644 (0.0005) [2023-12-26 08:53:53,651][123090] Updated weights for policy 1, policy_version 1157290 (0.0005) [2023-12-26 08:53:53,711][123090] Updated weights for policy 1, policy_version 1157300 (0.0005) [2023-12-26 08:53:53,782][123090] Updated weights for policy 1, policy_version 1157310 (0.0005) [2023-12-26 08:53:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 594673664. Throughput: 0: 8808.8, 1: 8819.7. Samples: 594652936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:53,785][121949] Avg episode reward: [(0, '6221.600'), (1, '5445.200')] [2023-12-26 08:53:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001165648_298409984.pth... [2023-12-26 08:53:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001157312_296271872.pth... [2023-12-26 08:53:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001156256_296001536.pth [2023-12-26 08:53:53,796][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001157312_296271872.pth [2023-12-26 08:53:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001164592_298139648.pth [2023-12-26 08:53:53,797][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001165648_298409984.pth [2023-12-26 08:53:53,939][123091] Updated weights for policy 0, policy_version 1165654 (0.0005) [2023-12-26 08:53:54,000][123091] Updated weights for policy 0, policy_version 1165664 (0.0005) [2023-12-26 08:53:54,054][123091] Updated weights for policy 0, policy_version 1165674 (0.0008) [2023-12-26 08:53:54,526][123090] Updated weights for policy 1, policy_version 1157320 (0.0009) [2023-12-26 08:53:54,575][123090] Updated weights for policy 1, policy_version 1157331 (0.0009) [2023-12-26 08:53:54,632][123090] Updated weights for policy 1, policy_version 1157341 (0.0009) [2023-12-26 08:53:54,772][123091] Updated weights for policy 0, policy_version 1165684 (0.0008) [2023-12-26 08:53:54,820][123091] Updated weights for policy 0, policy_version 1165694 (0.0005) [2023-12-26 08:53:54,864][123091] Updated weights for policy 0, policy_version 1165704 (0.0005) [2023-12-26 08:53:55,556][123090] Updated weights for policy 1, policy_version 1157351 (0.0010) [2023-12-26 08:53:55,596][123091] Updated weights for policy 0, policy_version 1165714 (0.0005) [2023-12-26 08:53:55,605][123090] Updated weights for policy 1, policy_version 1157361 (0.0009) [2023-12-26 08:53:55,645][123091] Updated weights for policy 0, policy_version 1165724 (0.0005) [2023-12-26 08:53:55,656][123090] Updated weights for policy 1, policy_version 1157371 (0.0008) [2023-12-26 08:53:55,690][123091] Updated weights for policy 0, policy_version 1165734 (0.0005) [2023-12-26 08:53:55,740][123091] Updated weights for policy 0, policy_version 1165744 (0.0006) [2023-12-26 08:53:56,431][123091] Updated weights for policy 0, policy_version 1165754 (0.0005) [2023-12-26 08:53:56,451][123090] Updated weights for policy 1, policy_version 1157381 (0.0009) [2023-12-26 08:53:56,487][123091] Updated weights for policy 0, policy_version 1165764 (0.0005) [2023-12-26 08:53:56,520][123090] Updated weights for policy 1, policy_version 1157391 (0.0007) [2023-12-26 08:53:56,555][123091] Updated weights for policy 0, policy_version 1165774 (0.0007) [2023-12-26 08:53:56,585][123090] Updated weights for policy 1, policy_version 1157401 (0.0006) [2023-12-26 08:53:57,245][123090] Updated weights for policy 1, policy_version 1157411 (0.0007) [2023-12-26 08:53:57,253][123091] Updated weights for policy 0, policy_version 1165784 (0.0006) [2023-12-26 08:53:57,308][123090] Updated weights for policy 1, policy_version 1157421 (0.0006) [2023-12-26 08:53:57,316][123091] Updated weights for policy 0, policy_version 1165794 (0.0006) [2023-12-26 08:53:57,365][123090] Updated weights for policy 1, policy_version 1157431 (0.0007) [2023-12-26 08:53:57,379][123091] Updated weights for policy 0, policy_version 1165804 (0.0007) [2023-12-26 08:53:58,117][123090] Updated weights for policy 1, policy_version 1157441 (0.0007) [2023-12-26 08:53:58,148][123091] Updated weights for policy 0, policy_version 1165814 (0.0011) [2023-12-26 08:53:58,176][123090] Updated weights for policy 1, policy_version 1157451 (0.0008) [2023-12-26 08:53:58,211][123091] Updated weights for policy 0, policy_version 1165824 (0.0011) [2023-12-26 08:53:58,229][123090] Updated weights for policy 1, policy_version 1157461 (0.0007) [2023-12-26 08:53:58,278][123091] Updated weights for policy 0, policy_version 1165834 (0.0010) [2023-12-26 08:53:58,284][123090] Updated weights for policy 1, policy_version 1157471 (0.0007) [2023-12-26 08:53:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 594771968. Throughput: 0: 8965.4, 1: 8882.1. Samples: 594766096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:53:58,784][121949] Avg episode reward: [(0, '6246.521'), (1, '5044.813')] [2023-12-26 08:53:59,154][123090] Updated weights for policy 1, policy_version 1157481 (0.0009) [2023-12-26 08:53:59,187][123091] Updated weights for policy 0, policy_version 1165844 (0.0009) [2023-12-26 08:53:59,225][123090] Updated weights for policy 1, policy_version 1157491 (0.0008) [2023-12-26 08:53:59,254][123091] Updated weights for policy 0, policy_version 1165854 (0.0007) [2023-12-26 08:53:59,292][123090] Updated weights for policy 1, policy_version 1157501 (0.0007) [2023-12-26 08:53:59,307][123091] Updated weights for policy 0, policy_version 1165864 (0.0007) [2023-12-26 08:53:59,998][123091] Updated weights for policy 0, policy_version 1165874 (0.0006) [2023-12-26 08:54:00,067][123091] Updated weights for policy 0, policy_version 1165884 (0.0008) [2023-12-26 08:54:00,137][123090] Updated weights for policy 1, policy_version 1157511 (0.0008) [2023-12-26 08:54:00,140][123091] Updated weights for policy 0, policy_version 1165894 (0.0006) [2023-12-26 08:54:00,198][123090] Updated weights for policy 1, policy_version 1157521 (0.0009) [2023-12-26 08:54:00,205][123091] Updated weights for policy 0, policy_version 1165904 (0.0006) [2023-12-26 08:54:00,263][123090] Updated weights for policy 1, policy_version 1157531 (0.0009) [2023-12-26 08:54:00,915][123091] Updated weights for policy 0, policy_version 1165914 (0.0009) [2023-12-26 08:54:00,963][123091] Updated weights for policy 0, policy_version 1165924 (0.0009) [2023-12-26 08:54:01,014][123091] Updated weights for policy 0, policy_version 1165934 (0.0009) [2023-12-26 08:54:01,063][123090] Updated weights for policy 1, policy_version 1157542 (0.0009) [2023-12-26 08:54:01,129][123090] Updated weights for policy 1, policy_version 1157552 (0.0009) [2023-12-26 08:54:01,196][123090] Updated weights for policy 1, policy_version 1157562 (0.0009) [2023-12-26 08:54:01,927][123091] Updated weights for policy 0, policy_version 1165944 (0.0009) [2023-12-26 08:54:01,986][123091] Updated weights for policy 0, policy_version 1165954 (0.0010) [2023-12-26 08:54:02,041][123091] Updated weights for policy 0, policy_version 1165964 (0.0009) [2023-12-26 08:54:02,061][123090] Updated weights for policy 1, policy_version 1157572 (0.0009) [2023-12-26 08:54:02,115][123090] Updated weights for policy 1, policy_version 1157582 (0.0009) [2023-12-26 08:54:02,170][123090] Updated weights for policy 1, policy_version 1157592 (0.0010) [2023-12-26 08:54:02,869][123091] Updated weights for policy 0, policy_version 1165974 (0.0008) [2023-12-26 08:54:02,926][123091] Updated weights for policy 0, policy_version 1165984 (0.0009) [2023-12-26 08:54:02,981][123091] Updated weights for policy 0, policy_version 1165994 (0.0009) [2023-12-26 08:54:03,016][123090] Updated weights for policy 1, policy_version 1157602 (0.0008) [2023-12-26 08:54:03,076][123090] Updated weights for policy 1, policy_version 1157612 (0.0010) [2023-12-26 08:54:03,141][123090] Updated weights for policy 1, policy_version 1157622 (0.0008) [2023-12-26 08:54:03,193][123090] Updated weights for policy 1, policy_version 1157632 (0.0009) [2023-12-26 08:54:03,708][123091] Updated weights for policy 0, policy_version 1166004 (0.0008) [2023-12-26 08:54:03,782][123091] Updated weights for policy 0, policy_version 1166014 (0.0006) [2023-12-26 08:54:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 594853888. Throughput: 0: 9013.4, 1: 8823.5. Samples: 594871248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:03,784][121949] Avg episode reward: [(0, '6207.238'), (1, '5150.783')] [2023-12-26 08:54:03,857][123091] Updated weights for policy 0, policy_version 1166024 (0.0007) [2023-12-26 08:54:03,950][123090] Updated weights for policy 1, policy_version 1157642 (0.0008) [2023-12-26 08:54:04,009][123090] Updated weights for policy 1, policy_version 1157652 (0.0009) [2023-12-26 08:54:04,068][123090] Updated weights for policy 1, policy_version 1157662 (0.0009) [2023-12-26 08:54:04,537][123091] Updated weights for policy 0, policy_version 1166034 (0.0009) [2023-12-26 08:54:04,593][123091] Updated weights for policy 0, policy_version 1166044 (0.0009) [2023-12-26 08:54:04,652][123091] Updated weights for policy 0, policy_version 1166054 (0.0009) [2023-12-26 08:54:04,710][123091] Updated weights for policy 0, policy_version 1166064 (0.0010) [2023-12-26 08:54:04,986][123090] Updated weights for policy 1, policy_version 1157672 (0.0010) [2023-12-26 08:54:05,049][123090] Updated weights for policy 1, policy_version 1157683 (0.0009) [2023-12-26 08:54:05,097][123090] Updated weights for policy 1, policy_version 1157693 (0.0009) [2023-12-26 08:54:05,557][123091] Updated weights for policy 0, policy_version 1166074 (0.0008) [2023-12-26 08:54:05,620][123091] Updated weights for policy 0, policy_version 1166084 (0.0006) [2023-12-26 08:54:05,669][123091] Updated weights for policy 0, policy_version 1166094 (0.0010) [2023-12-26 08:54:05,967][123090] Updated weights for policy 1, policy_version 1157703 (0.0009) [2023-12-26 08:54:06,035][123090] Updated weights for policy 1, policy_version 1157713 (0.0009) [2023-12-26 08:54:06,089][123090] Updated weights for policy 1, policy_version 1157723 (0.0009) [2023-12-26 08:54:06,353][123091] Updated weights for policy 0, policy_version 1166105 (0.0010) [2023-12-26 08:54:06,411][123091] Updated weights for policy 0, policy_version 1166115 (0.0010) [2023-12-26 08:54:06,464][123091] Updated weights for policy 0, policy_version 1166125 (0.0010) [2023-12-26 08:54:06,878][123090] Updated weights for policy 1, policy_version 1157733 (0.0009) [2023-12-26 08:54:06,944][123090] Updated weights for policy 1, policy_version 1157743 (0.0009) [2023-12-26 08:54:07,008][123090] Updated weights for policy 1, policy_version 1157753 (0.0010) [2023-12-26 08:54:07,314][123091] Updated weights for policy 0, policy_version 1166135 (0.0010) [2023-12-26 08:54:07,371][123091] Updated weights for policy 0, policy_version 1166145 (0.0009) [2023-12-26 08:54:07,435][123091] Updated weights for policy 0, policy_version 1166155 (0.0008) [2023-12-26 08:54:07,892][123090] Updated weights for policy 1, policy_version 1157763 (0.0010) [2023-12-26 08:54:07,954][123090] Updated weights for policy 1, policy_version 1157773 (0.0010) [2023-12-26 08:54:08,020][123090] Updated weights for policy 1, policy_version 1157783 (0.0009) [2023-12-26 08:54:08,280][123091] Updated weights for policy 0, policy_version 1166165 (0.0010) [2023-12-26 08:54:08,336][123091] Updated weights for policy 0, policy_version 1166175 (0.0009) [2023-12-26 08:54:08,407][123091] Updated weights for policy 0, policy_version 1166185 (0.0010) [2023-12-26 08:54:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 594944000. Throughput: 0: 9020.9, 1: 8808.2. Samples: 594923292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:08,785][121949] Avg episode reward: [(0, '6171.219'), (1, '5451.671')] [2023-12-26 08:54:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001166192_298549248.pth... [2023-12-26 08:54:08,791][123090] Updated weights for policy 1, policy_version 1157793 (0.0007) [2023-12-26 08:54:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001165136_298278912.pth [2023-12-26 08:54:08,855][123090] Updated weights for policy 1, policy_version 1157803 (0.0007) [2023-12-26 08:54:08,908][123090] Updated weights for policy 1, policy_version 1157813 (0.0009) [2023-12-26 08:54:08,973][123090] Updated weights for policy 1, policy_version 1157823 (0.0009) [2023-12-26 08:54:08,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001157824_296402944.pth... [2023-12-26 08:54:08,985][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001156800_296140800.pth [2023-12-26 08:54:09,269][123091] Updated weights for policy 0, policy_version 1166195 (0.0010) [2023-12-26 08:54:09,329][123091] Updated weights for policy 0, policy_version 1166206 (0.0010) [2023-12-26 08:54:09,406][123091] Updated weights for policy 0, policy_version 1166216 (0.0010) [2023-12-26 08:54:09,817][123090] Updated weights for policy 1, policy_version 1157833 (0.0011) [2023-12-26 08:54:09,891][123090] Updated weights for policy 1, policy_version 1157843 (0.0010) [2023-12-26 08:54:09,957][123090] Updated weights for policy 1, policy_version 1157853 (0.0011) [2023-12-26 08:54:10,280][123091] Updated weights for policy 0, policy_version 1166226 (0.0010) [2023-12-26 08:54:10,353][123091] Updated weights for policy 0, policy_version 1166236 (0.0010) [2023-12-26 08:54:10,412][123091] Updated weights for policy 0, policy_version 1166246 (0.0010) [2023-12-26 08:54:10,465][123091] Updated weights for policy 0, policy_version 1166256 (0.0009) [2023-12-26 08:54:10,697][123090] Updated weights for policy 1, policy_version 1157863 (0.0006) [2023-12-26 08:54:10,754][123090] Updated weights for policy 1, policy_version 1157873 (0.0005) [2023-12-26 08:54:10,810][123090] Updated weights for policy 1, policy_version 1157883 (0.0006) [2023-12-26 08:54:11,347][123091] Updated weights for policy 0, policy_version 1166266 (0.0010) [2023-12-26 08:54:11,419][123091] Updated weights for policy 0, policy_version 1166276 (0.0010) [2023-12-26 08:54:11,486][123091] Updated weights for policy 0, policy_version 1166286 (0.0009) [2023-12-26 08:54:11,594][123090] Updated weights for policy 1, policy_version 1157893 (0.0007) [2023-12-26 08:54:11,665][123090] Updated weights for policy 1, policy_version 1157903 (0.0008) [2023-12-26 08:54:11,737][123090] Updated weights for policy 1, policy_version 1157913 (0.0009) [2023-12-26 08:54:12,295][123091] Updated weights for policy 0, policy_version 1166296 (0.0009) [2023-12-26 08:54:12,364][123091] Updated weights for policy 0, policy_version 1166306 (0.0009) [2023-12-26 08:54:12,433][123091] Updated weights for policy 0, policy_version 1166316 (0.0009) [2023-12-26 08:54:12,597][123090] Updated weights for policy 1, policy_version 1157923 (0.0010) [2023-12-26 08:54:12,663][123090] Updated weights for policy 1, policy_version 1157933 (0.0009) [2023-12-26 08:54:12,721][123090] Updated weights for policy 1, policy_version 1157943 (0.0009) [2023-12-26 08:54:13,266][123091] Updated weights for policy 0, policy_version 1166326 (0.0010) [2023-12-26 08:54:13,316][123091] Updated weights for policy 0, policy_version 1166337 (0.0010) [2023-12-26 08:54:13,364][123091] Updated weights for policy 0, policy_version 1166347 (0.0009) [2023-12-26 08:54:13,557][123090] Updated weights for policy 1, policy_version 1157953 (0.0009) [2023-12-26 08:54:13,618][123090] Updated weights for policy 1, policy_version 1157963 (0.0009) [2023-12-26 08:54:13,667][123090] Updated weights for policy 1, policy_version 1157973 (0.0009) [2023-12-26 08:54:13,727][123090] Updated weights for policy 1, policy_version 1157983 (0.0008) [2023-12-26 08:54:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 595034112. Throughput: 0: 8937.0, 1: 8713.9. Samples: 595024036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:13,785][121949] Avg episode reward: [(0, '6141.916'), (1, '5612.450')] [2023-12-26 08:54:14,196][123091] Updated weights for policy 0, policy_version 1166357 (0.0010) [2023-12-26 08:54:14,248][123091] Updated weights for policy 0, policy_version 1166368 (0.0010) [2023-12-26 08:54:14,300][123091] Updated weights for policy 0, policy_version 1166378 (0.0009) [2023-12-26 08:54:14,559][123090] Updated weights for policy 1, policy_version 1157993 (0.0009) [2023-12-26 08:54:14,615][123090] Updated weights for policy 1, policy_version 1158003 (0.0009) [2023-12-26 08:54:14,667][123090] Updated weights for policy 1, policy_version 1158014 (0.0010) [2023-12-26 08:54:15,169][123091] Updated weights for policy 0, policy_version 1166388 (0.0010) [2023-12-26 08:54:15,234][123091] Updated weights for policy 0, policy_version 1166398 (0.0010) [2023-12-26 08:54:15,298][123091] Updated weights for policy 0, policy_version 1166408 (0.0010) [2023-12-26 08:54:15,518][123090] Updated weights for policy 1, policy_version 1158024 (0.0010) [2023-12-26 08:54:15,592][123090] Updated weights for policy 1, policy_version 1158034 (0.0009) [2023-12-26 08:54:15,657][123090] Updated weights for policy 1, policy_version 1158044 (0.0009) [2023-12-26 08:54:16,049][123091] Updated weights for policy 0, policy_version 1166418 (0.0010) [2023-12-26 08:54:16,113][123091] Updated weights for policy 0, policy_version 1166428 (0.0009) [2023-12-26 08:54:16,173][123091] Updated weights for policy 0, policy_version 1166438 (0.0010) [2023-12-26 08:54:16,227][123091] Updated weights for policy 0, policy_version 1166448 (0.0009) [2023-12-26 08:54:16,486][123090] Updated weights for policy 1, policy_version 1158054 (0.0009) [2023-12-26 08:54:16,552][123090] Updated weights for policy 1, policy_version 1158064 (0.0008) [2023-12-26 08:54:16,606][123090] Updated weights for policy 1, policy_version 1158074 (0.0009) [2023-12-26 08:54:17,038][123091] Updated weights for policy 0, policy_version 1166458 (0.0008) [2023-12-26 08:54:17,104][123091] Updated weights for policy 0, policy_version 1166468 (0.0008) [2023-12-26 08:54:17,166][123091] Updated weights for policy 0, policy_version 1166478 (0.0008) [2023-12-26 08:54:17,453][123090] Updated weights for policy 1, policy_version 1158084 (0.0009) [2023-12-26 08:54:17,501][123090] Updated weights for policy 1, policy_version 1158094 (0.0009) [2023-12-26 08:54:17,550][123090] Updated weights for policy 1, policy_version 1158104 (0.0009) [2023-12-26 08:54:17,964][123091] Updated weights for policy 0, policy_version 1166488 (0.0007) [2023-12-26 08:54:18,027][123091] Updated weights for policy 0, policy_version 1166498 (0.0011) [2023-12-26 08:54:18,087][123091] Updated weights for policy 0, policy_version 1166508 (0.0011) [2023-12-26 08:54:18,436][123090] Updated weights for policy 1, policy_version 1158114 (0.0009) [2023-12-26 08:54:18,494][123090] Updated weights for policy 1, policy_version 1158124 (0.0009) [2023-12-26 08:54:18,553][123090] Updated weights for policy 1, policy_version 1158134 (0.0009) [2023-12-26 08:54:18,620][123090] Updated weights for policy 1, policy_version 1158144 (0.0009) [2023-12-26 08:54:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 595116032. Throughput: 0: 8876.7, 1: 8599.9. Samples: 595126608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:18,784][121949] Avg episode reward: [(0, '6157.598'), (1, '5536.907')] [2023-12-26 08:54:18,822][123091] Updated weights for policy 0, policy_version 1166518 (0.0009) [2023-12-26 08:54:18,894][123091] Updated weights for policy 0, policy_version 1166528 (0.0006) [2023-12-26 08:54:18,960][123091] Updated weights for policy 0, policy_version 1166538 (0.0006) [2023-12-26 08:54:19,484][123090] Updated weights for policy 1, policy_version 1158154 (0.0010) [2023-12-26 08:54:19,556][123090] Updated weights for policy 1, policy_version 1158164 (0.0008) [2023-12-26 08:54:19,620][123090] Updated weights for policy 1, policy_version 1158174 (0.0009) [2023-12-26 08:54:19,696][123091] Updated weights for policy 0, policy_version 1166548 (0.0008) [2023-12-26 08:54:19,757][123091] Updated weights for policy 0, policy_version 1166558 (0.0010) [2023-12-26 08:54:19,818][123091] Updated weights for policy 0, policy_version 1166568 (0.0010) [2023-12-26 08:54:20,451][123090] Updated weights for policy 1, policy_version 1158184 (0.0009) [2023-12-26 08:54:20,504][123090] Updated weights for policy 1, policy_version 1158194 (0.0009) [2023-12-26 08:54:20,556][123090] Updated weights for policy 1, policy_version 1158204 (0.0010) [2023-12-26 08:54:20,680][123091] Updated weights for policy 0, policy_version 1166578 (0.0010) [2023-12-26 08:54:20,738][123091] Updated weights for policy 0, policy_version 1166588 (0.0009) [2023-12-26 08:54:20,801][123091] Updated weights for policy 0, policy_version 1166598 (0.0009) [2023-12-26 08:54:20,857][123091] Updated weights for policy 0, policy_version 1166608 (0.0010) [2023-12-26 08:54:21,440][123090] Updated weights for policy 1, policy_version 1158214 (0.0010) [2023-12-26 08:54:21,502][123090] Updated weights for policy 1, policy_version 1158224 (0.0010) [2023-12-26 08:54:21,559][123090] Updated weights for policy 1, policy_version 1158234 (0.0009) [2023-12-26 08:54:21,763][123091] Updated weights for policy 0, policy_version 1166618 (0.0010) [2023-12-26 08:54:21,819][123091] Updated weights for policy 0, policy_version 1166628 (0.0010) [2023-12-26 08:54:21,870][123091] Updated weights for policy 0, policy_version 1166638 (0.0008) [2023-12-26 08:54:22,366][123090] Updated weights for policy 1, policy_version 1158244 (0.0009) [2023-12-26 08:54:22,429][123090] Updated weights for policy 1, policy_version 1158254 (0.0008) [2023-12-26 08:54:22,499][123090] Updated weights for policy 1, policy_version 1158264 (0.0008) [2023-12-26 08:54:22,816][123091] Updated weights for policy 0, policy_version 1166648 (0.0009) [2023-12-26 08:54:22,882][123091] Updated weights for policy 0, policy_version 1166658 (0.0010) [2023-12-26 08:54:22,932][123091] Updated weights for policy 0, policy_version 1166669 (0.0010) [2023-12-26 08:54:23,186][123090] Updated weights for policy 1, policy_version 1158274 (0.0008) [2023-12-26 08:54:23,249][123090] Updated weights for policy 1, policy_version 1158284 (0.0010) [2023-12-26 08:54:23,306][123090] Updated weights for policy 1, policy_version 1158294 (0.0009) [2023-12-26 08:54:23,362][123090] Updated weights for policy 1, policy_version 1158304 (0.0009) [2023-12-26 08:54:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 595197952. Throughput: 0: 8882.9, 1: 8539.9. Samples: 595176972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:23,785][121949] Avg episode reward: [(0, '6213.894'), (1, '5381.822')] [2023-12-26 08:54:23,788][123091] Updated weights for policy 0, policy_version 1166679 (0.0010) [2023-12-26 08:54:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001158304_296525824.pth... [2023-12-26 08:54:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001157312_296271872.pth [2023-12-26 08:54:23,844][123091] Updated weights for policy 0, policy_version 1166689 (0.0009) [2023-12-26 08:54:23,893][123091] Updated weights for policy 0, policy_version 1166699 (0.0009) [2023-12-26 08:54:23,914][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001166704_298680320.pth... [2023-12-26 08:54:23,917][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001165648_298409984.pth [2023-12-26 08:54:24,183][123090] Updated weights for policy 1, policy_version 1158314 (0.0006) [2023-12-26 08:54:24,251][123090] Updated weights for policy 1, policy_version 1158324 (0.0009) [2023-12-26 08:54:24,312][123090] Updated weights for policy 1, policy_version 1158334 (0.0008) [2023-12-26 08:54:24,699][123091] Updated weights for policy 0, policy_version 1166709 (0.0007) [2023-12-26 08:54:24,753][123091] Updated weights for policy 0, policy_version 1166719 (0.0005) [2023-12-26 08:54:24,807][123091] Updated weights for policy 0, policy_version 1166729 (0.0006) [2023-12-26 08:54:24,988][123090] Updated weights for policy 1, policy_version 1158344 (0.0006) [2023-12-26 08:54:25,049][123090] Updated weights for policy 1, policy_version 1158354 (0.0006) [2023-12-26 08:54:25,109][123090] Updated weights for policy 1, policy_version 1158364 (0.0007) [2023-12-26 08:54:25,585][123091] Updated weights for policy 0, policy_version 1166739 (0.0009) [2023-12-26 08:54:25,636][123091] Updated weights for policy 0, policy_version 1166749 (0.0005) [2023-12-26 08:54:25,704][123091] Updated weights for policy 0, policy_version 1166759 (0.0005) [2023-12-26 08:54:25,808][123090] Updated weights for policy 1, policy_version 1158374 (0.0007) [2023-12-26 08:54:25,855][123090] Updated weights for policy 1, policy_version 1158384 (0.0005) [2023-12-26 08:54:25,901][123090] Updated weights for policy 1, policy_version 1158394 (0.0005) [2023-12-26 08:54:26,333][123091] Updated weights for policy 0, policy_version 1166769 (0.0005) [2023-12-26 08:54:26,393][123091] Updated weights for policy 0, policy_version 1166779 (0.0005) [2023-12-26 08:54:26,439][123091] Updated weights for policy 0, policy_version 1166789 (0.0005) [2023-12-26 08:54:26,488][123091] Updated weights for policy 0, policy_version 1166799 (0.0005) [2023-12-26 08:54:26,581][123090] Updated weights for policy 1, policy_version 1158404 (0.0006) [2023-12-26 08:54:26,648][123090] Updated weights for policy 1, policy_version 1158414 (0.0006) [2023-12-26 08:54:26,693][123090] Updated weights for policy 1, policy_version 1158424 (0.0005) [2023-12-26 08:54:27,270][123091] Updated weights for policy 0, policy_version 1166809 (0.0005) [2023-12-26 08:54:27,326][123091] Updated weights for policy 0, policy_version 1166819 (0.0005) [2023-12-26 08:54:27,382][123091] Updated weights for policy 0, policy_version 1166829 (0.0006) [2023-12-26 08:54:27,435][123090] Updated weights for policy 1, policy_version 1158434 (0.0006) [2023-12-26 08:54:27,505][123090] Updated weights for policy 1, policy_version 1158444 (0.0010) [2023-12-26 08:54:27,571][123090] Updated weights for policy 1, policy_version 1158454 (0.0009) [2023-12-26 08:54:27,640][123090] Updated weights for policy 1, policy_version 1158464 (0.0009) [2023-12-26 08:54:28,121][123091] Updated weights for policy 0, policy_version 1166839 (0.0008) [2023-12-26 08:54:28,188][123091] Updated weights for policy 0, policy_version 1166849 (0.0010) [2023-12-26 08:54:28,245][123091] Updated weights for policy 0, policy_version 1166859 (0.0010) [2023-12-26 08:54:28,384][123090] Updated weights for policy 1, policy_version 1158474 (0.0007) [2023-12-26 08:54:28,447][123090] Updated weights for policy 1, policy_version 1158484 (0.0005) [2023-12-26 08:54:28,498][123090] Updated weights for policy 1, policy_version 1158494 (0.0005) [2023-12-26 08:54:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 595296256. Throughput: 0: 8880.1, 1: 8707.3. Samples: 595287596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:28,785][121949] Avg episode reward: [(0, '6259.412'), (1, '5312.900')] [2023-12-26 08:54:28,988][123091] Updated weights for policy 0, policy_version 1166869 (0.0008) [2023-12-26 08:54:29,058][123091] Updated weights for policy 0, policy_version 1166879 (0.0009) [2023-12-26 08:54:29,116][123091] Updated weights for policy 0, policy_version 1166889 (0.0010) [2023-12-26 08:54:29,229][123090] Updated weights for policy 1, policy_version 1158504 (0.0006) [2023-12-26 08:54:29,287][123090] Updated weights for policy 1, policy_version 1158514 (0.0007) [2023-12-26 08:54:29,358][123090] Updated weights for policy 1, policy_version 1158524 (0.0010) [2023-12-26 08:54:29,928][123091] Updated weights for policy 0, policy_version 1166899 (0.0010) [2023-12-26 08:54:29,991][123091] Updated weights for policy 0, policy_version 1166909 (0.0009) [2023-12-26 08:54:30,054][123091] Updated weights for policy 0, policy_version 1166919 (0.0009) [2023-12-26 08:54:30,169][123090] Updated weights for policy 1, policy_version 1158534 (0.0009) [2023-12-26 08:54:30,231][123090] Updated weights for policy 1, policy_version 1158544 (0.0007) [2023-12-26 08:54:30,291][123090] Updated weights for policy 1, policy_version 1158554 (0.0008) [2023-12-26 08:54:30,915][123091] Updated weights for policy 0, policy_version 1166929 (0.0010) [2023-12-26 08:54:30,973][123091] Updated weights for policy 0, policy_version 1166941 (0.0010) [2023-12-26 08:54:31,024][123091] Updated weights for policy 0, policy_version 1166952 (0.0010) [2023-12-26 08:54:31,025][123090] Updated weights for policy 1, policy_version 1158564 (0.0005) [2023-12-26 08:54:31,089][123090] Updated weights for policy 1, policy_version 1158574 (0.0009) [2023-12-26 08:54:31,157][123090] Updated weights for policy 1, policy_version 1158584 (0.0009) [2023-12-26 08:54:31,790][123091] Updated weights for policy 0, policy_version 1166962 (0.0010) [2023-12-26 08:54:31,852][123091] Updated weights for policy 0, policy_version 1166972 (0.0010) [2023-12-26 08:54:31,870][123090] Updated weights for policy 1, policy_version 1158594 (0.0009) [2023-12-26 08:54:31,911][123091] Updated weights for policy 0, policy_version 1166982 (0.0011) [2023-12-26 08:54:31,936][123090] Updated weights for policy 1, policy_version 1158604 (0.0010) [2023-12-26 08:54:31,962][123091] Updated weights for policy 0, policy_version 1166992 (0.0010) [2023-12-26 08:54:32,006][123090] Updated weights for policy 1, policy_version 1158614 (0.0010) [2023-12-26 08:54:32,072][123090] Updated weights for policy 1, policy_version 1158624 (0.0010) [2023-12-26 08:54:32,727][123091] Updated weights for policy 0, policy_version 1167002 (0.0009) [2023-12-26 08:54:32,783][123091] Updated weights for policy 0, policy_version 1167012 (0.0009) [2023-12-26 08:54:32,837][123091] Updated weights for policy 0, policy_version 1167022 (0.0008) [2023-12-26 08:54:32,867][123090] Updated weights for policy 1, policy_version 1158634 (0.0010) [2023-12-26 08:54:32,925][123090] Updated weights for policy 1, policy_version 1158644 (0.0010) [2023-12-26 08:54:32,976][123090] Updated weights for policy 1, policy_version 1158654 (0.0010) [2023-12-26 08:54:33,609][123091] Updated weights for policy 0, policy_version 1167032 (0.0010) [2023-12-26 08:54:33,679][123091] Updated weights for policy 0, policy_version 1167042 (0.0010) [2023-12-26 08:54:33,721][123090] Updated weights for policy 1, policy_version 1158664 (0.0006) [2023-12-26 08:54:33,738][123091] Updated weights for policy 0, policy_version 1167052 (0.0009) [2023-12-26 08:54:33,781][123090] Updated weights for policy 1, policy_version 1158674 (0.0005) [2023-12-26 08:54:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 595386368. Throughput: 0: 8924.3, 1: 8767.8. Samples: 595397636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:33,785][121949] Avg episode reward: [(0, '6135.830'), (1, '5419.964')] [2023-12-26 08:54:33,852][123090] Updated weights for policy 1, policy_version 1158684 (0.0005) [2023-12-26 08:54:34,516][123090] Updated weights for policy 1, policy_version 1158694 (0.0005) [2023-12-26 08:54:34,590][123090] Updated weights for policy 1, policy_version 1158704 (0.0007) [2023-12-26 08:54:34,629][123091] Updated weights for policy 0, policy_version 1167062 (0.0009) [2023-12-26 08:54:34,657][123090] Updated weights for policy 1, policy_version 1158714 (0.0008) [2023-12-26 08:54:34,694][123091] Updated weights for policy 0, policy_version 1167072 (0.0008) [2023-12-26 08:54:34,760][123091] Updated weights for policy 0, policy_version 1167082 (0.0007) [2023-12-26 08:54:35,302][123090] Updated weights for policy 1, policy_version 1158724 (0.0009) [2023-12-26 08:54:35,367][123090] Updated weights for policy 1, policy_version 1158734 (0.0010) [2023-12-26 08:54:35,432][123090] Updated weights for policy 1, policy_version 1158744 (0.0010) [2023-12-26 08:54:35,592][123091] Updated weights for policy 0, policy_version 1167092 (0.0009) [2023-12-26 08:54:35,685][123091] Updated weights for policy 0, policy_version 1167102 (0.0009) [2023-12-26 08:54:35,740][123091] Updated weights for policy 0, policy_version 1167112 (0.0009) [2023-12-26 08:54:36,266][123090] Updated weights for policy 1, policy_version 1158754 (0.0010) [2023-12-26 08:54:36,322][123090] Updated weights for policy 1, policy_version 1158764 (0.0010) [2023-12-26 08:54:36,381][123090] Updated weights for policy 1, policy_version 1158774 (0.0010) [2023-12-26 08:54:36,448][123090] Updated weights for policy 1, policy_version 1158784 (0.0010) [2023-12-26 08:54:36,498][123091] Updated weights for policy 0, policy_version 1167122 (0.0009) [2023-12-26 08:54:36,562][123091] Updated weights for policy 0, policy_version 1167132 (0.0009) [2023-12-26 08:54:36,625][123091] Updated weights for policy 0, policy_version 1167142 (0.0009) [2023-12-26 08:54:36,689][123091] Updated weights for policy 0, policy_version 1167152 (0.0009) [2023-12-26 08:54:37,294][123090] Updated weights for policy 1, policy_version 1158794 (0.0009) [2023-12-26 08:54:37,353][123090] Updated weights for policy 1, policy_version 1158804 (0.0010) [2023-12-26 08:54:37,412][123090] Updated weights for policy 1, policy_version 1158814 (0.0010) [2023-12-26 08:54:37,433][123091] Updated weights for policy 0, policy_version 1167162 (0.0006) [2023-12-26 08:54:37,485][123091] Updated weights for policy 0, policy_version 1167172 (0.0009) [2023-12-26 08:54:37,541][123091] Updated weights for policy 0, policy_version 1167182 (0.0009) [2023-12-26 08:54:38,224][123090] Updated weights for policy 1, policy_version 1158824 (0.0008) [2023-12-26 08:54:38,285][123090] Updated weights for policy 1, policy_version 1158834 (0.0007) [2023-12-26 08:54:38,290][123091] Updated weights for policy 0, policy_version 1167192 (0.0009) [2023-12-26 08:54:38,342][123091] Updated weights for policy 0, policy_version 1167202 (0.0010) [2023-12-26 08:54:38,345][123090] Updated weights for policy 1, policy_version 1158844 (0.0011) [2023-12-26 08:54:38,413][123091] Updated weights for policy 0, policy_version 1167212 (0.0010) [2023-12-26 08:54:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 595476480. Throughput: 0: 8894.7, 1: 8835.4. Samples: 595450796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:38,785][121949] Avg episode reward: [(0, '6122.331'), (1, '5209.235')] [2023-12-26 08:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001167216_298811392.pth... [2023-12-26 08:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001158848_296665088.pth... [2023-12-26 08:54:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001166192_298549248.pth [2023-12-26 08:54:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001157824_296402944.pth [2023-12-26 08:54:39,187][123090] Updated weights for policy 1, policy_version 1158854 (0.0011) [2023-12-26 08:54:39,243][123091] Updated weights for policy 0, policy_version 1167222 (0.0010) [2023-12-26 08:54:39,259][123090] Updated weights for policy 1, policy_version 1158864 (0.0009) [2023-12-26 08:54:39,314][123091] Updated weights for policy 0, policy_version 1167232 (0.0010) [2023-12-26 08:54:39,325][123090] Updated weights for policy 1, policy_version 1158874 (0.0011) [2023-12-26 08:54:39,391][123091] Updated weights for policy 0, policy_version 1167242 (0.0009) [2023-12-26 08:54:40,183][123090] Updated weights for policy 1, policy_version 1158884 (0.0009) [2023-12-26 08:54:40,243][123090] Updated weights for policy 1, policy_version 1158894 (0.0011) [2023-12-26 08:54:40,255][123091] Updated weights for policy 0, policy_version 1167252 (0.0008) [2023-12-26 08:54:40,306][123090] Updated weights for policy 1, policy_version 1158904 (0.0011) [2023-12-26 08:54:40,317][123091] Updated weights for policy 0, policy_version 1167262 (0.0009) [2023-12-26 08:54:40,375][123091] Updated weights for policy 0, policy_version 1167272 (0.0007) [2023-12-26 08:54:41,052][123090] Updated weights for policy 1, policy_version 1158914 (0.0010) [2023-12-26 08:54:41,119][123090] Updated weights for policy 1, policy_version 1158924 (0.0008) [2023-12-26 08:54:41,168][123091] Updated weights for policy 0, policy_version 1167282 (0.0008) [2023-12-26 08:54:41,192][123090] Updated weights for policy 1, policy_version 1158934 (0.0010) [2023-12-26 08:54:41,227][123091] Updated weights for policy 0, policy_version 1167292 (0.0010) [2023-12-26 08:54:41,261][123090] Updated weights for policy 1, policy_version 1158944 (0.0007) [2023-12-26 08:54:41,291][123091] Updated weights for policy 0, policy_version 1167302 (0.0009) [2023-12-26 08:54:41,362][123091] Updated weights for policy 0, policy_version 1167312 (0.0009) [2023-12-26 08:54:42,096][123090] Updated weights for policy 1, policy_version 1158954 (0.0011) [2023-12-26 08:54:42,098][123091] Updated weights for policy 0, policy_version 1167322 (0.0006) [2023-12-26 08:54:42,144][123091] Updated weights for policy 0, policy_version 1167332 (0.0006) [2023-12-26 08:54:42,153][123090] Updated weights for policy 1, policy_version 1158964 (0.0010) [2023-12-26 08:54:42,194][123091] Updated weights for policy 0, policy_version 1167342 (0.0006) [2023-12-26 08:54:42,220][123090] Updated weights for policy 1, policy_version 1158974 (0.0011) [2023-12-26 08:54:42,982][123091] Updated weights for policy 0, policy_version 1167352 (0.0009) [2023-12-26 08:54:43,047][123091] Updated weights for policy 0, policy_version 1167362 (0.0007) [2023-12-26 08:54:43,061][123090] Updated weights for policy 1, policy_version 1158984 (0.0011) [2023-12-26 08:54:43,107][123091] Updated weights for policy 0, policy_version 1167372 (0.0006) [2023-12-26 08:54:43,117][123090] Updated weights for policy 1, policy_version 1158994 (0.0010) [2023-12-26 08:54:43,168][123090] Updated weights for policy 1, policy_version 1159004 (0.0010) [2023-12-26 08:54:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 595558400. Throughput: 0: 8773.2, 1: 8767.8. Samples: 595555444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:43,785][121949] Avg episode reward: [(0, '6136.186'), (1, '5012.000')] [2023-12-26 08:54:43,876][123090] Updated weights for policy 1, policy_version 1159014 (0.0007) [2023-12-26 08:54:43,880][123091] Updated weights for policy 0, policy_version 1167382 (0.0007) [2023-12-26 08:54:43,937][123091] Updated weights for policy 0, policy_version 1167392 (0.0006) [2023-12-26 08:54:43,950][123090] Updated weights for policy 1, policy_version 1159024 (0.0005) [2023-12-26 08:54:44,009][123091] Updated weights for policy 0, policy_version 1167402 (0.0005) [2023-12-26 08:54:44,024][123090] Updated weights for policy 1, policy_version 1159034 (0.0005) [2023-12-26 08:54:44,657][123091] Updated weights for policy 0, policy_version 1167412 (0.0006) [2023-12-26 08:54:44,688][123090] Updated weights for policy 1, policy_version 1159044 (0.0008) [2023-12-26 08:54:44,717][123091] Updated weights for policy 0, policy_version 1167422 (0.0007) [2023-12-26 08:54:44,752][123090] Updated weights for policy 1, policy_version 1159054 (0.0011) [2023-12-26 08:54:44,784][123091] Updated weights for policy 0, policy_version 1167432 (0.0008) [2023-12-26 08:54:44,822][123090] Updated weights for policy 1, policy_version 1159064 (0.0011) [2023-12-26 08:54:45,599][123091] Updated weights for policy 0, policy_version 1167442 (0.0010) [2023-12-26 08:54:45,627][123090] Updated weights for policy 1, policy_version 1159074 (0.0008) [2023-12-26 08:54:45,652][123091] Updated weights for policy 0, policy_version 1167452 (0.0011) [2023-12-26 08:54:45,684][123090] Updated weights for policy 1, policy_version 1159084 (0.0011) [2023-12-26 08:54:45,715][123091] Updated weights for policy 0, policy_version 1167462 (0.0011) [2023-12-26 08:54:45,751][123090] Updated weights for policy 1, policy_version 1159094 (0.0011) [2023-12-26 08:54:45,765][123091] Updated weights for policy 0, policy_version 1167472 (0.0010) [2023-12-26 08:54:45,817][123090] Updated weights for policy 1, policy_version 1159104 (0.0010) [2023-12-26 08:54:46,568][123091] Updated weights for policy 0, policy_version 1167482 (0.0008) [2023-12-26 08:54:46,619][123091] Updated weights for policy 0, policy_version 1167492 (0.0010) [2023-12-26 08:54:46,626][123090] Updated weights for policy 1, policy_version 1159114 (0.0010) [2023-12-26 08:54:46,670][123091] Updated weights for policy 0, policy_version 1167502 (0.0010) [2023-12-26 08:54:46,681][123090] Updated weights for policy 1, policy_version 1159124 (0.0006) [2023-12-26 08:54:46,736][123090] Updated weights for policy 1, policy_version 1159134 (0.0006) [2023-12-26 08:54:47,375][123091] Updated weights for policy 0, policy_version 1167512 (0.0009) [2023-12-26 08:54:47,423][123091] Updated weights for policy 0, policy_version 1167522 (0.0008) [2023-12-26 08:54:47,430][123090] Updated weights for policy 1, policy_version 1159144 (0.0005) [2023-12-26 08:54:47,486][123091] Updated weights for policy 0, policy_version 1167532 (0.0011) [2023-12-26 08:54:47,491][123090] Updated weights for policy 1, policy_version 1159154 (0.0007) [2023-12-26 08:54:47,547][123090] Updated weights for policy 1, policy_version 1159164 (0.0008) [2023-12-26 08:54:48,296][123090] Updated weights for policy 1, policy_version 1159174 (0.0006) [2023-12-26 08:54:48,316][123091] Updated weights for policy 0, policy_version 1167542 (0.0010) [2023-12-26 08:54:48,365][123090] Updated weights for policy 1, policy_version 1159184 (0.0008) [2023-12-26 08:54:48,384][123091] Updated weights for policy 0, policy_version 1167552 (0.0011) [2023-12-26 08:54:48,429][123090] Updated weights for policy 1, policy_version 1159194 (0.0005) [2023-12-26 08:54:48,435][123091] Updated weights for policy 0, policy_version 1167562 (0.0011) [2023-12-26 08:54:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 595656704. Throughput: 0: 8806.9, 1: 8847.7. Samples: 595665708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:48,785][121949] Avg episode reward: [(0, '6226.221'), (1, '5038.868')] [2023-12-26 08:54:49,158][123090] Updated weights for policy 1, policy_version 1159204 (0.0006) [2023-12-26 08:54:49,211][123090] Updated weights for policy 1, policy_version 1159214 (0.0007) [2023-12-26 08:54:49,275][123091] Updated weights for policy 0, policy_version 1167572 (0.0011) [2023-12-26 08:54:49,284][123090] Updated weights for policy 1, policy_version 1159224 (0.0006) [2023-12-26 08:54:49,342][123091] Updated weights for policy 0, policy_version 1167582 (0.0010) [2023-12-26 08:54:49,405][123091] Updated weights for policy 0, policy_version 1167592 (0.0009) [2023-12-26 08:54:49,947][123090] Updated weights for policy 1, policy_version 1159234 (0.0008) [2023-12-26 08:54:50,022][123090] Updated weights for policy 1, policy_version 1159244 (0.0009) [2023-12-26 08:54:50,087][123090] Updated weights for policy 1, policy_version 1159254 (0.0006) [2023-12-26 08:54:50,146][123090] Updated weights for policy 1, policy_version 1159264 (0.0006) [2023-12-26 08:54:50,146][123091] Updated weights for policy 0, policy_version 1167602 (0.0007) [2023-12-26 08:54:50,210][123091] Updated weights for policy 0, policy_version 1167612 (0.0005) [2023-12-26 08:54:50,280][123091] Updated weights for policy 0, policy_version 1167622 (0.0009) [2023-12-26 08:54:50,346][123091] Updated weights for policy 0, policy_version 1167632 (0.0011) [2023-12-26 08:54:50,978][123090] Updated weights for policy 1, policy_version 1159274 (0.0009) [2023-12-26 08:54:51,038][123090] Updated weights for policy 1, policy_version 1159284 (0.0009) [2023-12-26 08:54:51,107][123090] Updated weights for policy 1, policy_version 1159294 (0.0009) [2023-12-26 08:54:51,112][123091] Updated weights for policy 0, policy_version 1167642 (0.0008) [2023-12-26 08:54:51,177][123091] Updated weights for policy 0, policy_version 1167652 (0.0009) [2023-12-26 08:54:51,248][123091] Updated weights for policy 0, policy_version 1167662 (0.0011) [2023-12-26 08:54:51,958][123090] Updated weights for policy 1, policy_version 1159304 (0.0009) [2023-12-26 08:54:52,029][123090] Updated weights for policy 1, policy_version 1159314 (0.0009) [2023-12-26 08:54:52,086][123091] Updated weights for policy 0, policy_version 1167672 (0.0008) [2023-12-26 08:54:52,093][123090] Updated weights for policy 1, policy_version 1159324 (0.0009) [2023-12-26 08:54:52,141][123091] Updated weights for policy 0, policy_version 1167682 (0.0007) [2023-12-26 08:54:52,195][123091] Updated weights for policy 0, policy_version 1167692 (0.0009) [2023-12-26 08:54:52,902][123090] Updated weights for policy 1, policy_version 1159334 (0.0006) [2023-12-26 08:54:52,956][123090] Updated weights for policy 1, policy_version 1159344 (0.0005) [2023-12-26 08:54:53,013][123091] Updated weights for policy 0, policy_version 1167702 (0.0008) [2023-12-26 08:54:53,013][123090] Updated weights for policy 1, policy_version 1159354 (0.0005) [2023-12-26 08:54:53,085][123091] Updated weights for policy 0, policy_version 1167712 (0.0009) [2023-12-26 08:54:53,145][123091] Updated weights for policy 0, policy_version 1167722 (0.0009) [2023-12-26 08:54:53,766][123090] Updated weights for policy 1, policy_version 1159364 (0.0007) [2023-12-26 08:54:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 595738624. Throughput: 0: 8791.5, 1: 8897.1. Samples: 595719280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 08:54:53,785][121949] Avg episode reward: [(0, '6286.265'), (1, '5098.584')] [2023-12-26 08:54:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001167728_298942464.pth... [2023-12-26 08:54:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001166704_298680320.pth [2023-12-26 08:54:53,825][123090] Updated weights for policy 1, policy_version 1159374 (0.0009) [2023-12-26 08:54:53,873][123090] Updated weights for policy 1, policy_version 1159384 (0.0009) [2023-12-26 08:54:53,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001159392_296804352.pth... [2023-12-26 08:54:53,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001158304_296525824.pth [2023-12-26 08:54:53,941][123091] Updated weights for policy 0, policy_version 1167732 (0.0009) [2023-12-26 08:54:53,993][123091] Updated weights for policy 0, policy_version 1167742 (0.0010) [2023-12-26 08:54:54,046][123091] Updated weights for policy 0, policy_version 1167753 (0.0010) [2023-12-26 08:54:54,690][123090] Updated weights for policy 1, policy_version 1159394 (0.0009) [2023-12-26 08:54:54,751][123090] Updated weights for policy 1, policy_version 1159404 (0.0010) [2023-12-26 08:54:54,816][123090] Updated weights for policy 1, policy_version 1159414 (0.0010) [2023-12-26 08:54:54,872][123090] Updated weights for policy 1, policy_version 1159424 (0.0008) [2023-12-26 08:54:54,886][123091] Updated weights for policy 0, policy_version 1167764 (0.0010) [2023-12-26 08:54:54,939][123091] Updated weights for policy 0, policy_version 1167775 (0.0009) [2023-12-26 08:54:54,997][123091] Updated weights for policy 0, policy_version 1167785 (0.0010) [2023-12-26 08:54:55,670][123090] Updated weights for policy 1, policy_version 1159434 (0.0009) [2023-12-26 08:54:55,726][123090] Updated weights for policy 1, policy_version 1159444 (0.0010) [2023-12-26 08:54:55,781][123090] Updated weights for policy 1, policy_version 1159454 (0.0009) [2023-12-26 08:54:55,836][123091] Updated weights for policy 0, policy_version 1167795 (0.0008) [2023-12-26 08:54:55,894][123091] Updated weights for policy 0, policy_version 1167805 (0.0009) [2023-12-26 08:54:55,946][123091] Updated weights for policy 0, policy_version 1167815 (0.0008) [2023-12-26 08:54:56,629][123090] Updated weights for policy 1, policy_version 1159464 (0.0010) [2023-12-26 08:54:56,680][123090] Updated weights for policy 1, policy_version 1159474 (0.0009) [2023-12-26 08:54:56,743][123090] Updated weights for policy 1, policy_version 1159484 (0.0010) [2023-12-26 08:54:56,779][123091] Updated weights for policy 0, policy_version 1167825 (0.0009) [2023-12-26 08:54:56,836][123091] Updated weights for policy 0, policy_version 1167835 (0.0009) [2023-12-26 08:54:56,886][123091] Updated weights for policy 0, policy_version 1167845 (0.0009) [2023-12-26 08:54:56,947][123091] Updated weights for policy 0, policy_version 1167855 (0.0010) [2023-12-26 08:54:57,556][123090] Updated weights for policy 1, policy_version 1159494 (0.0009) [2023-12-26 08:54:57,605][123090] Updated weights for policy 1, policy_version 1159504 (0.0009) [2023-12-26 08:54:57,658][123090] Updated weights for policy 1, policy_version 1159514 (0.0009) [2023-12-26 08:54:57,776][123091] Updated weights for policy 0, policy_version 1167865 (0.0009) [2023-12-26 08:54:57,832][123091] Updated weights for policy 0, policy_version 1167875 (0.0008) [2023-12-26 08:54:57,894][123091] Updated weights for policy 0, policy_version 1167885 (0.0010) [2023-12-26 08:54:58,552][123090] Updated weights for policy 1, policy_version 1159524 (0.0010) [2023-12-26 08:54:58,636][123090] Updated weights for policy 1, policy_version 1159534 (0.0008) [2023-12-26 08:54:58,705][123090] Updated weights for policy 1, policy_version 1159544 (0.0007) [2023-12-26 08:54:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 595828736. Throughput: 0: 8835.4, 1: 8928.4. Samples: 595823404. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:54:58,785][121949] Avg episode reward: [(0, '6359.123'), (1, '5227.120')] [2023-12-26 08:54:58,855][123091] Updated weights for policy 0, policy_version 1167895 (0.0009) [2023-12-26 08:54:58,924][123091] Updated weights for policy 0, policy_version 1167905 (0.0011) [2023-12-26 08:54:58,988][123091] Updated weights for policy 0, policy_version 1167915 (0.0011) [2023-12-26 08:54:59,462][123090] Updated weights for policy 1, policy_version 1159554 (0.0008) [2023-12-26 08:54:59,535][123090] Updated weights for policy 1, policy_version 1159564 (0.0006) [2023-12-26 08:54:59,585][123090] Updated weights for policy 1, policy_version 1159574 (0.0006) [2023-12-26 08:54:59,657][123090] Updated weights for policy 1, policy_version 1159584 (0.0007) [2023-12-26 08:54:59,840][123091] Updated weights for policy 0, policy_version 1167925 (0.0007) [2023-12-26 08:54:59,914][123091] Updated weights for policy 0, policy_version 1167935 (0.0008) [2023-12-26 08:54:59,981][123091] Updated weights for policy 0, policy_version 1167945 (0.0006) [2023-12-26 08:55:00,392][123090] Updated weights for policy 1, policy_version 1159594 (0.0009) [2023-12-26 08:55:00,452][123090] Updated weights for policy 1, policy_version 1159604 (0.0009) [2023-12-26 08:55:00,504][123090] Updated weights for policy 1, policy_version 1159614 (0.0009) [2023-12-26 08:55:00,743][123091] Updated weights for policy 0, policy_version 1167955 (0.0007) [2023-12-26 08:55:00,793][123091] Updated weights for policy 0, policy_version 1167965 (0.0007) [2023-12-26 08:55:00,849][123091] Updated weights for policy 0, policy_version 1167975 (0.0005) [2023-12-26 08:55:01,288][123090] Updated weights for policy 1, policy_version 1159624 (0.0010) [2023-12-26 08:55:01,350][123090] Updated weights for policy 1, policy_version 1159634 (0.0010) [2023-12-26 08:55:01,413][123090] Updated weights for policy 1, policy_version 1159644 (0.0013) [2023-12-26 08:55:01,520][123091] Updated weights for policy 0, policy_version 1167985 (0.0005) [2023-12-26 08:55:01,582][123091] Updated weights for policy 0, policy_version 1167995 (0.0008) [2023-12-26 08:55:01,646][123091] Updated weights for policy 0, policy_version 1168005 (0.0010) [2023-12-26 08:55:01,711][123091] Updated weights for policy 0, policy_version 1168015 (0.0008) [2023-12-26 08:55:02,233][123090] Updated weights for policy 1, policy_version 1159654 (0.0010) [2023-12-26 08:55:02,303][123090] Updated weights for policy 1, policy_version 1159664 (0.0011) [2023-12-26 08:55:02,374][123090] Updated weights for policy 1, policy_version 1159674 (0.0011) [2023-12-26 08:55:02,537][123091] Updated weights for policy 0, policy_version 1168025 (0.0006) [2023-12-26 08:55:02,608][123091] Updated weights for policy 0, policy_version 1168035 (0.0005) [2023-12-26 08:55:02,664][123091] Updated weights for policy 0, policy_version 1168045 (0.0005) [2023-12-26 08:55:03,148][123090] Updated weights for policy 1, policy_version 1159684 (0.0007) [2023-12-26 08:55:03,200][123090] Updated weights for policy 1, policy_version 1159694 (0.0005) [2023-12-26 08:55:03,246][123090] Updated weights for policy 1, policy_version 1159704 (0.0005) [2023-12-26 08:55:03,349][123091] Updated weights for policy 0, policy_version 1168055 (0.0010) [2023-12-26 08:55:03,407][123091] Updated weights for policy 0, policy_version 1168065 (0.0010) [2023-12-26 08:55:03,462][123091] Updated weights for policy 0, policy_version 1168075 (0.0010) [2023-12-26 08:55:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 595918848. Throughput: 0: 8830.5, 1: 9011.6. Samples: 595929508. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:03,785][121949] Avg episode reward: [(0, '6316.289'), (1, '4921.438')] [2023-12-26 08:55:03,934][123090] Updated weights for policy 1, policy_version 1159714 (0.0006) [2023-12-26 08:55:03,999][123090] Updated weights for policy 1, policy_version 1159724 (0.0009) [2023-12-26 08:55:04,056][123090] Updated weights for policy 1, policy_version 1159734 (0.0009) [2023-12-26 08:55:04,108][123090] Updated weights for policy 1, policy_version 1159744 (0.0009) [2023-12-26 08:55:04,352][123091] Updated weights for policy 0, policy_version 1168085 (0.0010) [2023-12-26 08:55:04,427][123091] Updated weights for policy 0, policy_version 1168095 (0.0009) [2023-12-26 08:55:04,491][123091] Updated weights for policy 0, policy_version 1168105 (0.0009) [2023-12-26 08:55:04,962][123090] Updated weights for policy 1, policy_version 1159754 (0.0010) [2023-12-26 08:55:05,014][123090] Updated weights for policy 1, policy_version 1159764 (0.0010) [2023-12-26 08:55:05,073][123090] Updated weights for policy 1, policy_version 1159774 (0.0010) [2023-12-26 08:55:05,302][123091] Updated weights for policy 0, policy_version 1168115 (0.0009) [2023-12-26 08:55:05,350][123091] Updated weights for policy 0, policy_version 1168125 (0.0009) [2023-12-26 08:55:05,398][123091] Updated weights for policy 0, policy_version 1168135 (0.0009) [2023-12-26 08:55:05,907][123090] Updated weights for policy 1, policy_version 1159784 (0.0010) [2023-12-26 08:55:05,967][123090] Updated weights for policy 1, policy_version 1159794 (0.0010) [2023-12-26 08:55:06,030][123090] Updated weights for policy 1, policy_version 1159804 (0.0010) [2023-12-26 08:55:06,268][123091] Updated weights for policy 0, policy_version 1168145 (0.0009) [2023-12-26 08:55:06,317][123091] Updated weights for policy 0, policy_version 1168155 (0.0009) [2023-12-26 08:55:06,370][123091] Updated weights for policy 0, policy_version 1168165 (0.0009) [2023-12-26 08:55:06,438][123091] Updated weights for policy 0, policy_version 1168175 (0.0009) [2023-12-26 08:55:06,883][123090] Updated weights for policy 1, policy_version 1159814 (0.0011) [2023-12-26 08:55:06,943][123090] Updated weights for policy 1, policy_version 1159824 (0.0010) [2023-12-26 08:55:07,003][123090] Updated weights for policy 1, policy_version 1159834 (0.0010) [2023-12-26 08:55:07,283][123091] Updated weights for policy 0, policy_version 1168185 (0.0009) [2023-12-26 08:55:07,335][123091] Updated weights for policy 0, policy_version 1168195 (0.0009) [2023-12-26 08:55:07,391][123091] Updated weights for policy 0, policy_version 1168205 (0.0008) [2023-12-26 08:55:07,818][123090] Updated weights for policy 1, policy_version 1159844 (0.0010) [2023-12-26 08:55:07,903][123090] Updated weights for policy 1, policy_version 1159854 (0.0010) [2023-12-26 08:55:07,959][123090] Updated weights for policy 1, policy_version 1159864 (0.0009) [2023-12-26 08:55:08,239][123091] Updated weights for policy 0, policy_version 1168215 (0.0009) [2023-12-26 08:55:08,290][123091] Updated weights for policy 0, policy_version 1168226 (0.0009) [2023-12-26 08:55:08,353][123091] Updated weights for policy 0, policy_version 1168236 (0.0010) [2023-12-26 08:55:08,766][123090] Updated weights for policy 1, policy_version 1159874 (0.0009) [2023-12-26 08:55:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 596000768. Throughput: 0: 8818.0, 1: 9039.4. Samples: 595980552. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:08,785][121949] Avg episode reward: [(0, '6173.419'), (1, '4547.982')] [2023-12-26 08:55:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001168240_299073536.pth... [2023-12-26 08:55:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001167216_298811392.pth [2023-12-26 08:55:08,836][123090] Updated weights for policy 1, policy_version 1159884 (0.0010) [2023-12-26 08:55:08,899][123090] Updated weights for policy 1, policy_version 1159894 (0.0009) [2023-12-26 08:55:08,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001159904_296935424.pth... [2023-12-26 08:55:08,964][123090] Updated weights for policy 1, policy_version 1159904 (0.0009) [2023-12-26 08:55:08,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001158848_296665088.pth [2023-12-26 08:55:09,198][123091] Updated weights for policy 0, policy_version 1168246 (0.0010) [2023-12-26 08:55:09,268][123091] Updated weights for policy 0, policy_version 1168256 (0.0009) [2023-12-26 08:55:09,336][123091] Updated weights for policy 0, policy_version 1168266 (0.0010) [2023-12-26 08:55:09,835][123090] Updated weights for policy 1, policy_version 1159914 (0.0010) [2023-12-26 08:55:09,903][123090] Updated weights for policy 1, policy_version 1159924 (0.0009) [2023-12-26 08:55:09,970][123090] Updated weights for policy 1, policy_version 1159934 (0.0009) [2023-12-26 08:55:10,221][123091] Updated weights for policy 0, policy_version 1168276 (0.0010) [2023-12-26 08:55:10,285][123091] Updated weights for policy 0, policy_version 1168286 (0.0010) [2023-12-26 08:55:10,344][123091] Updated weights for policy 0, policy_version 1168296 (0.0008) [2023-12-26 08:55:10,860][123090] Updated weights for policy 1, policy_version 1159944 (0.0008) [2023-12-26 08:55:10,932][123090] Updated weights for policy 1, policy_version 1159954 (0.0006) [2023-12-26 08:55:11,003][123090] Updated weights for policy 1, policy_version 1159964 (0.0009) [2023-12-26 08:55:11,187][123091] Updated weights for policy 0, policy_version 1168306 (0.0009) [2023-12-26 08:55:11,263][123091] Updated weights for policy 0, policy_version 1168316 (0.0008) [2023-12-26 08:55:11,323][123091] Updated weights for policy 0, policy_version 1168326 (0.0009) [2023-12-26 08:55:11,398][123091] Updated weights for policy 0, policy_version 1168336 (0.0009) [2023-12-26 08:55:11,873][123090] Updated weights for policy 1, policy_version 1159974 (0.0009) [2023-12-26 08:55:11,935][123090] Updated weights for policy 1, policy_version 1159984 (0.0010) [2023-12-26 08:55:11,993][123090] Updated weights for policy 1, policy_version 1159994 (0.0008) [2023-12-26 08:55:12,211][123091] Updated weights for policy 0, policy_version 1168346 (0.0010) [2023-12-26 08:55:12,279][123091] Updated weights for policy 0, policy_version 1168356 (0.0008) [2023-12-26 08:55:12,345][123091] Updated weights for policy 0, policy_version 1168366 (0.0007) [2023-12-26 08:55:12,861][123090] Updated weights for policy 1, policy_version 1160004 (0.0009) [2023-12-26 08:55:12,931][123090] Updated weights for policy 1, policy_version 1160014 (0.0009) [2023-12-26 08:55:12,992][123090] Updated weights for policy 1, policy_version 1160024 (0.0008) [2023-12-26 08:55:13,160][123091] Updated weights for policy 0, policy_version 1168376 (0.0009) [2023-12-26 08:55:13,220][123091] Updated weights for policy 0, policy_version 1168386 (0.0005) [2023-12-26 08:55:13,272][123091] Updated weights for policy 0, policy_version 1168396 (0.0005) [2023-12-26 08:55:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 596082688. Throughput: 0: 8752.7, 1: 8875.9. Samples: 596080884. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:13,785][121949] Avg episode reward: [(0, '6091.044'), (1, '4337.407')] [2023-12-26 08:55:13,817][123090] Updated weights for policy 1, policy_version 1160034 (0.0006) [2023-12-26 08:55:13,871][123090] Updated weights for policy 1, policy_version 1160044 (0.0010) [2023-12-26 08:55:13,925][123090] Updated weights for policy 1, policy_version 1160055 (0.0010) [2023-12-26 08:55:13,969][123091] Updated weights for policy 0, policy_version 1168406 (0.0008) [2023-12-26 08:55:14,030][123091] Updated weights for policy 0, policy_version 1168416 (0.0009) [2023-12-26 08:55:14,091][123091] Updated weights for policy 0, policy_version 1168426 (0.0009) [2023-12-26 08:55:14,786][123090] Updated weights for policy 1, policy_version 1160065 (0.0007) [2023-12-26 08:55:14,854][123090] Updated weights for policy 1, policy_version 1160075 (0.0006) [2023-12-26 08:55:14,929][123090] Updated weights for policy 1, policy_version 1160085 (0.0006) [2023-12-26 08:55:14,932][123091] Updated weights for policy 0, policy_version 1168436 (0.0008) [2023-12-26 08:55:14,999][123090] Updated weights for policy 1, policy_version 1160095 (0.0007) [2023-12-26 08:55:15,000][123091] Updated weights for policy 0, policy_version 1168446 (0.0006) [2023-12-26 08:55:15,073][123091] Updated weights for policy 0, policy_version 1168456 (0.0007) [2023-12-26 08:55:15,786][123090] Updated weights for policy 1, policy_version 1160105 (0.0009) [2023-12-26 08:55:15,818][123091] Updated weights for policy 0, policy_version 1168466 (0.0008) [2023-12-26 08:55:15,847][123090] Updated weights for policy 1, policy_version 1160115 (0.0008) [2023-12-26 08:55:15,866][123091] Updated weights for policy 0, policy_version 1168476 (0.0009) [2023-12-26 08:55:15,908][123090] Updated weights for policy 1, policy_version 1160125 (0.0005) [2023-12-26 08:55:15,923][123091] Updated weights for policy 0, policy_version 1168486 (0.0009) [2023-12-26 08:55:15,984][123091] Updated weights for policy 0, policy_version 1168496 (0.0009) [2023-12-26 08:55:16,634][123090] Updated weights for policy 1, policy_version 1160135 (0.0009) [2023-12-26 08:55:16,683][123090] Updated weights for policy 1, policy_version 1160145 (0.0009) [2023-12-26 08:55:16,731][123090] Updated weights for policy 1, policy_version 1160155 (0.0009) [2023-12-26 08:55:16,873][123091] Updated weights for policy 0, policy_version 1168506 (0.0009) [2023-12-26 08:55:16,941][123091] Updated weights for policy 0, policy_version 1168516 (0.0009) [2023-12-26 08:55:17,012][123091] Updated weights for policy 0, policy_version 1168526 (0.0009) [2023-12-26 08:55:17,506][123090] Updated weights for policy 1, policy_version 1160165 (0.0008) [2023-12-26 08:55:17,576][123090] Updated weights for policy 1, policy_version 1160175 (0.0006) [2023-12-26 08:55:17,641][123090] Updated weights for policy 1, policy_version 1160185 (0.0008) [2023-12-26 08:55:17,767][123091] Updated weights for policy 0, policy_version 1168537 (0.0010) [2023-12-26 08:55:17,834][123091] Updated weights for policy 0, policy_version 1168547 (0.0009) [2023-12-26 08:55:17,892][123091] Updated weights for policy 0, policy_version 1168557 (0.0010) [2023-12-26 08:55:18,344][123090] Updated weights for policy 1, policy_version 1160195 (0.0009) [2023-12-26 08:55:18,410][123090] Updated weights for policy 1, policy_version 1160205 (0.0010) [2023-12-26 08:55:18,473][123090] Updated weights for policy 1, policy_version 1160215 (0.0010) [2023-12-26 08:55:18,758][123091] Updated weights for policy 0, policy_version 1168567 (0.0010) [2023-12-26 08:55:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 596172800. Throughput: 0: 8727.8, 1: 8810.9. Samples: 596186880. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:18,785][121949] Avg episode reward: [(0, '6218.886'), (1, '4230.307')] [2023-12-26 08:55:18,816][123091] Updated weights for policy 0, policy_version 1168577 (0.0009) [2023-12-26 08:55:18,873][123091] Updated weights for policy 0, policy_version 1168587 (0.0010) [2023-12-26 08:55:19,281][123090] Updated weights for policy 1, policy_version 1160225 (0.0011) [2023-12-26 08:55:19,349][123090] Updated weights for policy 1, policy_version 1160235 (0.0011) [2023-12-26 08:55:19,415][123090] Updated weights for policy 1, policy_version 1160245 (0.0010) [2023-12-26 08:55:19,474][123090] Updated weights for policy 1, policy_version 1160255 (0.0010) [2023-12-26 08:55:19,685][123091] Updated weights for policy 0, policy_version 1168597 (0.0008) [2023-12-26 08:55:19,751][123091] Updated weights for policy 0, policy_version 1168607 (0.0006) [2023-12-26 08:55:19,810][123091] Updated weights for policy 0, policy_version 1168617 (0.0006) [2023-12-26 08:55:20,315][123090] Updated weights for policy 1, policy_version 1160265 (0.0011) [2023-12-26 08:55:20,385][123090] Updated weights for policy 1, policy_version 1160275 (0.0010) [2023-12-26 08:55:20,455][123090] Updated weights for policy 1, policy_version 1160285 (0.0011) [2023-12-26 08:55:20,611][123091] Updated weights for policy 0, policy_version 1168627 (0.0009) [2023-12-26 08:55:20,676][123091] Updated weights for policy 0, policy_version 1168637 (0.0009) [2023-12-26 08:55:20,738][123091] Updated weights for policy 0, policy_version 1168647 (0.0009) [2023-12-26 08:55:21,277][123090] Updated weights for policy 1, policy_version 1160295 (0.0010) [2023-12-26 08:55:21,346][123090] Updated weights for policy 1, policy_version 1160305 (0.0010) [2023-12-26 08:55:21,415][123090] Updated weights for policy 1, policy_version 1160315 (0.0009) [2023-12-26 08:55:21,661][123091] Updated weights for policy 0, policy_version 1168657 (0.0009) [2023-12-26 08:55:21,729][123091] Updated weights for policy 0, policy_version 1168667 (0.0010) [2023-12-26 08:55:21,790][123091] Updated weights for policy 0, policy_version 1168677 (0.0009) [2023-12-26 08:55:21,859][123091] Updated weights for policy 0, policy_version 1168687 (0.0009) [2023-12-26 08:55:22,169][123090] Updated weights for policy 1, policy_version 1160325 (0.0006) [2023-12-26 08:55:22,224][123090] Updated weights for policy 1, policy_version 1160335 (0.0006) [2023-12-26 08:55:22,293][123090] Updated weights for policy 1, policy_version 1160345 (0.0010) [2023-12-26 08:55:22,786][123091] Updated weights for policy 0, policy_version 1168697 (0.0009) [2023-12-26 08:55:22,842][123091] Updated weights for policy 0, policy_version 1168707 (0.0008) [2023-12-26 08:55:22,915][123091] Updated weights for policy 0, policy_version 1168717 (0.0009) [2023-12-26 08:55:23,046][123090] Updated weights for policy 1, policy_version 1160355 (0.0010) [2023-12-26 08:55:23,117][123090] Updated weights for policy 1, policy_version 1160365 (0.0010) [2023-12-26 08:55:23,180][123090] Updated weights for policy 1, policy_version 1160375 (0.0010) [2023-12-26 08:55:23,745][123091] Updated weights for policy 0, policy_version 1168727 (0.0008) [2023-12-26 08:55:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 596254720. Throughput: 0: 8734.8, 1: 8757.5. Samples: 596237944. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:23,785][121949] Avg episode reward: [(0, '6324.098'), (1, '4151.428')] [2023-12-26 08:55:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001160384_297058304.pth... [2023-12-26 08:55:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001159392_296804352.pth [2023-12-26 08:55:23,817][123091] Updated weights for policy 0, policy_version 1168737 (0.0006) [2023-12-26 08:55:23,893][123091] Updated weights for policy 0, policy_version 1168747 (0.0005) [2023-12-26 08:55:23,919][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001168752_299204608.pth... [2023-12-26 08:55:23,922][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001167728_298942464.pth [2023-12-26 08:55:23,984][123090] Updated weights for policy 1, policy_version 1160385 (0.0010) [2023-12-26 08:55:24,036][123090] Updated weights for policy 1, policy_version 1160395 (0.0010) [2023-12-26 08:55:24,098][123090] Updated weights for policy 1, policy_version 1160405 (0.0010) [2023-12-26 08:55:24,157][123090] Updated weights for policy 1, policy_version 1160415 (0.0010) [2023-12-26 08:55:24,620][123091] Updated weights for policy 0, policy_version 1168757 (0.0008) [2023-12-26 08:55:24,673][123091] Updated weights for policy 0, policy_version 1168768 (0.0009) [2023-12-26 08:55:24,733][123091] Updated weights for policy 0, policy_version 1168778 (0.0009) [2023-12-26 08:55:24,976][123090] Updated weights for policy 1, policy_version 1160425 (0.0010) [2023-12-26 08:55:25,032][123090] Updated weights for policy 1, policy_version 1160435 (0.0010) [2023-12-26 08:55:25,097][123090] Updated weights for policy 1, policy_version 1160445 (0.0010) [2023-12-26 08:55:25,570][123091] Updated weights for policy 0, policy_version 1168788 (0.0009) [2023-12-26 08:55:25,619][123091] Updated weights for policy 0, policy_version 1168798 (0.0009) [2023-12-26 08:55:25,679][123091] Updated weights for policy 0, policy_version 1168808 (0.0009) [2023-12-26 08:55:25,915][123090] Updated weights for policy 1, policy_version 1160455 (0.0010) [2023-12-26 08:55:25,982][123090] Updated weights for policy 1, policy_version 1160465 (0.0010) [2023-12-26 08:55:26,054][123090] Updated weights for policy 1, policy_version 1160475 (0.0011) [2023-12-26 08:55:26,482][123091] Updated weights for policy 0, policy_version 1168818 (0.0008) [2023-12-26 08:55:26,540][123091] Updated weights for policy 0, policy_version 1168828 (0.0008) [2023-12-26 08:55:26,607][123091] Updated weights for policy 0, policy_version 1168838 (0.0008) [2023-12-26 08:55:26,677][123091] Updated weights for policy 0, policy_version 1168848 (0.0009) [2023-12-26 08:55:26,859][123090] Updated weights for policy 1, policy_version 1160485 (0.0010) [2023-12-26 08:55:26,921][123090] Updated weights for policy 1, policy_version 1160495 (0.0009) [2023-12-26 08:55:26,986][123090] Updated weights for policy 1, policy_version 1160505 (0.0006) [2023-12-26 08:55:27,491][123091] Updated weights for policy 0, policy_version 1168858 (0.0009) [2023-12-26 08:55:27,542][123091] Updated weights for policy 0, policy_version 1168868 (0.0008) [2023-12-26 08:55:27,606][123091] Updated weights for policy 0, policy_version 1168878 (0.0009) [2023-12-26 08:55:27,784][123090] Updated weights for policy 1, policy_version 1160515 (0.0010) [2023-12-26 08:55:27,845][123090] Updated weights for policy 1, policy_version 1160525 (0.0010) [2023-12-26 08:55:27,913][123090] Updated weights for policy 1, policy_version 1160535 (0.0010) [2023-12-26 08:55:28,475][123091] Updated weights for policy 0, policy_version 1168888 (0.0009) [2023-12-26 08:55:28,523][123091] Updated weights for policy 0, policy_version 1168898 (0.0009) [2023-12-26 08:55:28,566][123090] Updated weights for policy 1, policy_version 1160545 (0.0010) [2023-12-26 08:55:28,572][123091] Updated weights for policy 0, policy_version 1168908 (0.0009) [2023-12-26 08:55:28,628][123090] Updated weights for policy 1, policy_version 1160555 (0.0010) [2023-12-26 08:55:28,683][123090] Updated weights for policy 1, policy_version 1160565 (0.0010) [2023-12-26 08:55:28,733][123090] Updated weights for policy 1, policy_version 1160575 (0.0010) [2023-12-26 08:55:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 596353024. Throughput: 0: 8677.3, 1: 8790.8. Samples: 596341504. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:28,784][121949] Avg episode reward: [(0, '6240.837'), (1, '4061.771')] [2023-12-26 08:55:29,410][123091] Updated weights for policy 0, policy_version 1168918 (0.0007) [2023-12-26 08:55:29,470][123091] Updated weights for policy 0, policy_version 1168928 (0.0007) [2023-12-26 08:55:29,532][123091] Updated weights for policy 0, policy_version 1168938 (0.0010) [2023-12-26 08:55:29,592][123090] Updated weights for policy 1, policy_version 1160585 (0.0009) [2023-12-26 08:55:29,661][123090] Updated weights for policy 1, policy_version 1160595 (0.0009) [2023-12-26 08:55:29,727][123090] Updated weights for policy 1, policy_version 1160605 (0.0009) [2023-12-26 08:55:30,373][123091] Updated weights for policy 0, policy_version 1168948 (0.0009) [2023-12-26 08:55:30,424][123091] Updated weights for policy 0, policy_version 1168958 (0.0009) [2023-12-26 08:55:30,480][123091] Updated weights for policy 0, policy_version 1168968 (0.0009) [2023-12-26 08:55:30,531][123090] Updated weights for policy 1, policy_version 1160615 (0.0006) [2023-12-26 08:55:30,606][123090] Updated weights for policy 1, policy_version 1160625 (0.0005) [2023-12-26 08:55:30,683][123090] Updated weights for policy 1, policy_version 1160635 (0.0005) [2023-12-26 08:55:31,058][123091] Updated weights for policy 0, policy_version 1168978 (0.0005) [2023-12-26 08:55:31,120][123091] Updated weights for policy 0, policy_version 1168988 (0.0006) [2023-12-26 08:55:31,186][123091] Updated weights for policy 0, policy_version 1168998 (0.0009) [2023-12-26 08:55:31,247][123091] Updated weights for policy 0, policy_version 1169008 (0.0009) [2023-12-26 08:55:31,347][123090] Updated weights for policy 1, policy_version 1160645 (0.0006) [2023-12-26 08:55:31,415][123090] Updated weights for policy 1, policy_version 1160655 (0.0009) [2023-12-26 08:55:31,475][123090] Updated weights for policy 1, policy_version 1160665 (0.0010) [2023-12-26 08:55:31,975][123091] Updated weights for policy 0, policy_version 1169018 (0.0005) [2023-12-26 08:55:32,029][123091] Updated weights for policy 0, policy_version 1169028 (0.0005) [2023-12-26 08:55:32,089][123091] Updated weights for policy 0, policy_version 1169038 (0.0007) [2023-12-26 08:55:32,321][123090] Updated weights for policy 1, policy_version 1160675 (0.0010) [2023-12-26 08:55:32,385][123090] Updated weights for policy 1, policy_version 1160685 (0.0008) [2023-12-26 08:55:32,450][123090] Updated weights for policy 1, policy_version 1160695 (0.0006) [2023-12-26 08:55:32,944][123091] Updated weights for policy 0, policy_version 1169048 (0.0007) [2023-12-26 08:55:33,015][123091] Updated weights for policy 0, policy_version 1169058 (0.0006) [2023-12-26 08:55:33,088][123091] Updated weights for policy 0, policy_version 1169068 (0.0006) [2023-12-26 08:55:33,229][123090] Updated weights for policy 1, policy_version 1160705 (0.0008) [2023-12-26 08:55:33,281][123090] Updated weights for policy 1, policy_version 1160715 (0.0005) [2023-12-26 08:55:33,332][123090] Updated weights for policy 1, policy_version 1160725 (0.0005) [2023-12-26 08:55:33,376][123090] Updated weights for policy 1, policy_version 1160735 (0.0005) [2023-12-26 08:55:33,707][123091] Updated weights for policy 0, policy_version 1169078 (0.0008) [2023-12-26 08:55:33,751][123091] Updated weights for policy 0, policy_version 1169088 (0.0010) [2023-12-26 08:55:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 596434944. Throughput: 0: 8668.5, 1: 8766.3. Samples: 596450276. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:33,785][121949] Avg episode reward: [(0, '6222.394'), (1, '4445.009')] [2023-12-26 08:55:33,797][123091] Updated weights for policy 0, policy_version 1169098 (0.0010) [2023-12-26 08:55:33,937][123090] Updated weights for policy 1, policy_version 1160745 (0.0005) [2023-12-26 08:55:33,985][123090] Updated weights for policy 1, policy_version 1160755 (0.0005) [2023-12-26 08:55:34,038][123090] Updated weights for policy 1, policy_version 1160765 (0.0005) [2023-12-26 08:55:34,660][123091] Updated weights for policy 0, policy_version 1169108 (0.0010) [2023-12-26 08:55:34,714][123091] Updated weights for policy 0, policy_version 1169118 (0.0009) [2023-12-26 08:55:34,763][123091] Updated weights for policy 0, policy_version 1169128 (0.0009) [2023-12-26 08:55:34,840][123090] Updated weights for policy 1, policy_version 1160775 (0.0009) [2023-12-26 08:55:34,896][123090] Updated weights for policy 1, policy_version 1160785 (0.0009) [2023-12-26 08:55:34,950][123090] Updated weights for policy 1, policy_version 1160795 (0.0009) [2023-12-26 08:55:35,583][123091] Updated weights for policy 0, policy_version 1169138 (0.0008) [2023-12-26 08:55:35,630][123091] Updated weights for policy 0, policy_version 1169148 (0.0005) [2023-12-26 08:55:35,676][123091] Updated weights for policy 0, policy_version 1169158 (0.0005) [2023-12-26 08:55:35,722][123091] Updated weights for policy 0, policy_version 1169168 (0.0005) [2023-12-26 08:55:35,833][123090] Updated weights for policy 1, policy_version 1160805 (0.0010) [2023-12-26 08:55:35,895][123090] Updated weights for policy 1, policy_version 1160815 (0.0009) [2023-12-26 08:55:35,948][123090] Updated weights for policy 1, policy_version 1160825 (0.0009) [2023-12-26 08:55:36,486][123091] Updated weights for policy 0, policy_version 1169178 (0.0010) [2023-12-26 08:55:36,553][123091] Updated weights for policy 0, policy_version 1169188 (0.0011) [2023-12-26 08:55:36,620][123091] Updated weights for policy 0, policy_version 1169198 (0.0011) [2023-12-26 08:55:36,807][123090] Updated weights for policy 1, policy_version 1160835 (0.0009) [2023-12-26 08:55:36,871][123090] Updated weights for policy 1, policy_version 1160845 (0.0009) [2023-12-26 08:55:36,932][123090] Updated weights for policy 1, policy_version 1160855 (0.0009) [2023-12-26 08:55:37,396][123091] Updated weights for policy 0, policy_version 1169208 (0.0006) [2023-12-26 08:55:37,444][123091] Updated weights for policy 0, policy_version 1169218 (0.0005) [2023-12-26 08:55:37,494][123091] Updated weights for policy 0, policy_version 1169228 (0.0005) [2023-12-26 08:55:37,818][123090] Updated weights for policy 1, policy_version 1160865 (0.0009) [2023-12-26 08:55:37,873][123090] Updated weights for policy 1, policy_version 1160875 (0.0009) [2023-12-26 08:55:37,926][123090] Updated weights for policy 1, policy_version 1160885 (0.0010) [2023-12-26 08:55:37,980][123090] Updated weights for policy 1, policy_version 1160895 (0.0010) [2023-12-26 08:55:38,166][123091] Updated weights for policy 0, policy_version 1169238 (0.0006) [2023-12-26 08:55:38,223][123091] Updated weights for policy 0, policy_version 1169248 (0.0009) [2023-12-26 08:55:38,275][123091] Updated weights for policy 0, policy_version 1169258 (0.0009) [2023-12-26 08:55:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 596525056. Throughput: 0: 8684.6, 1: 8752.0. Samples: 596503924. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:38,785][121949] Avg episode reward: [(0, '6192.112'), (1, '4650.786')] [2023-12-26 08:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001169264_299335680.pth... [2023-12-26 08:55:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001168240_299073536.pth [2023-12-26 08:55:38,817][123090] Updated weights for policy 1, policy_version 1160905 (0.0006) [2023-12-26 08:55:38,874][123090] Updated weights for policy 1, policy_version 1160915 (0.0006) [2023-12-26 08:55:38,931][123090] Updated weights for policy 1, policy_version 1160925 (0.0005) [2023-12-26 08:55:38,945][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001160928_297197568.pth... [2023-12-26 08:55:38,950][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001159904_296935424.pth [2023-12-26 08:55:39,021][123091] Updated weights for policy 0, policy_version 1169268 (0.0009) [2023-12-26 08:55:39,072][123091] Updated weights for policy 0, policy_version 1169278 (0.0008) [2023-12-26 08:55:39,132][123091] Updated weights for policy 0, policy_version 1169288 (0.0006) [2023-12-26 08:55:39,650][123090] Updated weights for policy 1, policy_version 1160935 (0.0008) [2023-12-26 08:55:39,715][123090] Updated weights for policy 1, policy_version 1160945 (0.0009) [2023-12-26 08:55:39,777][123090] Updated weights for policy 1, policy_version 1160955 (0.0009) [2023-12-26 08:55:39,926][123091] Updated weights for policy 0, policy_version 1169298 (0.0006) [2023-12-26 08:55:39,994][123091] Updated weights for policy 0, policy_version 1169308 (0.0010) [2023-12-26 08:55:40,062][123091] Updated weights for policy 0, policy_version 1169318 (0.0011) [2023-12-26 08:55:40,125][123091] Updated weights for policy 0, policy_version 1169328 (0.0011) [2023-12-26 08:55:40,569][123090] Updated weights for policy 1, policy_version 1160965 (0.0009) [2023-12-26 08:55:40,628][123090] Updated weights for policy 1, policy_version 1160975 (0.0005) [2023-12-26 08:55:40,686][123090] Updated weights for policy 1, policy_version 1160985 (0.0005) [2023-12-26 08:55:40,882][123091] Updated weights for policy 0, policy_version 1169338 (0.0010) [2023-12-26 08:55:40,944][123091] Updated weights for policy 0, policy_version 1169348 (0.0010) [2023-12-26 08:55:41,009][123091] Updated weights for policy 0, policy_version 1169358 (0.0010) [2023-12-26 08:55:41,478][123090] Updated weights for policy 1, policy_version 1160995 (0.0006) [2023-12-26 08:55:41,548][123090] Updated weights for policy 1, policy_version 1161005 (0.0010) [2023-12-26 08:55:41,610][123090] Updated weights for policy 1, policy_version 1161015 (0.0010) [2023-12-26 08:55:41,859][123091] Updated weights for policy 0, policy_version 1169368 (0.0007) [2023-12-26 08:55:41,925][123091] Updated weights for policy 0, policy_version 1169378 (0.0008) [2023-12-26 08:55:41,990][123091] Updated weights for policy 0, policy_version 1169388 (0.0008) [2023-12-26 08:55:42,447][123090] Updated weights for policy 1, policy_version 1161025 (0.0009) [2023-12-26 08:55:42,511][123090] Updated weights for policy 1, policy_version 1161035 (0.0011) [2023-12-26 08:55:42,583][123090] Updated weights for policy 1, policy_version 1161045 (0.0011) [2023-12-26 08:55:42,649][123090] Updated weights for policy 1, policy_version 1161055 (0.0011) [2023-12-26 08:55:42,715][123091] Updated weights for policy 0, policy_version 1169398 (0.0006) [2023-12-26 08:55:42,780][123091] Updated weights for policy 0, policy_version 1169408 (0.0006) [2023-12-26 08:55:42,854][123091] Updated weights for policy 0, policy_version 1169418 (0.0010) [2023-12-26 08:55:43,473][123090] Updated weights for policy 1, policy_version 1161065 (0.0010) [2023-12-26 08:55:43,516][123091] Updated weights for policy 0, policy_version 1169428 (0.0009) [2023-12-26 08:55:43,541][123090] Updated weights for policy 1, policy_version 1161075 (0.0008) [2023-12-26 08:55:43,569][123091] Updated weights for policy 0, policy_version 1169438 (0.0005) [2023-12-26 08:55:43,598][123090] Updated weights for policy 1, policy_version 1161085 (0.0005) [2023-12-26 08:55:43,617][123091] Updated weights for policy 0, policy_version 1169448 (0.0005) [2023-12-26 08:55:43,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 596623360. Throughput: 0: 8752.2, 1: 8729.6. Samples: 596610084. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:43,785][121949] Avg episode reward: [(0, '6280.783'), (1, '4727.828')] [2023-12-26 08:55:44,281][123090] Updated weights for policy 1, policy_version 1161095 (0.0005) [2023-12-26 08:55:44,318][123091] Updated weights for policy 0, policy_version 1169458 (0.0005) [2023-12-26 08:55:44,347][123090] Updated weights for policy 1, policy_version 1161105 (0.0005) [2023-12-26 08:55:44,373][123091] Updated weights for policy 0, policy_version 1169468 (0.0005) [2023-12-26 08:55:44,423][123090] Updated weights for policy 1, policy_version 1161115 (0.0005) [2023-12-26 08:55:44,430][123091] Updated weights for policy 0, policy_version 1169478 (0.0005) [2023-12-26 08:55:44,486][123091] Updated weights for policy 0, policy_version 1169488 (0.0006) [2023-12-26 08:55:45,079][123091] Updated weights for policy 0, policy_version 1169498 (0.0006) [2023-12-26 08:55:45,120][123090] Updated weights for policy 1, policy_version 1161125 (0.0005) [2023-12-26 08:55:45,137][123091] Updated weights for policy 0, policy_version 1169508 (0.0006) [2023-12-26 08:55:45,183][123090] Updated weights for policy 1, policy_version 1161135 (0.0010) [2023-12-26 08:55:45,203][123091] Updated weights for policy 0, policy_version 1169518 (0.0011) [2023-12-26 08:55:45,241][123090] Updated weights for policy 1, policy_version 1161145 (0.0012) [2023-12-26 08:55:46,008][123091] Updated weights for policy 0, policy_version 1169528 (0.0010) [2023-12-26 08:55:46,072][123091] Updated weights for policy 0, policy_version 1169538 (0.0006) [2023-12-26 08:55:46,076][123090] Updated weights for policy 1, policy_version 1161155 (0.0010) [2023-12-26 08:55:46,127][123090] Updated weights for policy 1, policy_version 1161165 (0.0010) [2023-12-26 08:55:46,133][123091] Updated weights for policy 0, policy_version 1169548 (0.0009) [2023-12-26 08:55:46,183][123090] Updated weights for policy 1, policy_version 1161175 (0.0006) [2023-12-26 08:55:46,928][123090] Updated weights for policy 1, policy_version 1161185 (0.0005) [2023-12-26 08:55:46,938][123091] Updated weights for policy 0, policy_version 1169558 (0.0008) [2023-12-26 08:55:46,992][123090] Updated weights for policy 1, policy_version 1161195 (0.0007) [2023-12-26 08:55:46,997][123091] Updated weights for policy 0, policy_version 1169568 (0.0007) [2023-12-26 08:55:47,049][123090] Updated weights for policy 1, policy_version 1161205 (0.0006) [2023-12-26 08:55:47,061][123091] Updated weights for policy 0, policy_version 1169578 (0.0006) [2023-12-26 08:55:47,111][123090] Updated weights for policy 1, policy_version 1161215 (0.0005) [2023-12-26 08:55:47,719][123090] Updated weights for policy 1, policy_version 1161225 (0.0009) [2023-12-26 08:55:47,790][123090] Updated weights for policy 1, policy_version 1161235 (0.0009) [2023-12-26 08:55:47,855][123090] Updated weights for policy 1, policy_version 1161245 (0.0009) [2023-12-26 08:55:47,890][123091] Updated weights for policy 0, policy_version 1169588 (0.0008) [2023-12-26 08:55:47,944][123091] Updated weights for policy 0, policy_version 1169599 (0.0010) [2023-12-26 08:55:47,992][123091] Updated weights for policy 0, policy_version 1169609 (0.0008) [2023-12-26 08:55:48,699][123090] Updated weights for policy 1, policy_version 1161255 (0.0007) [2023-12-26 08:55:48,763][123090] Updated weights for policy 1, policy_version 1161265 (0.0005) [2023-12-26 08:55:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 596705280. Throughput: 0: 8816.1, 1: 8784.1. Samples: 596721516. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:48,784][121949] Avg episode reward: [(0, '6240.152'), (1, '4632.149')] [2023-12-26 08:55:48,813][123090] Updated weights for policy 1, policy_version 1161275 (0.0005) [2023-12-26 08:55:48,874][123091] Updated weights for policy 0, policy_version 1169619 (0.0008) [2023-12-26 08:55:48,935][123091] Updated weights for policy 0, policy_version 1169629 (0.0005) [2023-12-26 08:55:48,986][123091] Updated weights for policy 0, policy_version 1169639 (0.0005) [2023-12-26 08:55:49,523][123090] Updated weights for policy 1, policy_version 1161285 (0.0008) [2023-12-26 08:55:49,579][123090] Updated weights for policy 1, policy_version 1161295 (0.0010) [2023-12-26 08:55:49,631][123090] Updated weights for policy 1, policy_version 1161305 (0.0010) [2023-12-26 08:55:49,785][123091] Updated weights for policy 0, policy_version 1169649 (0.0006) [2023-12-26 08:55:49,853][123091] Updated weights for policy 0, policy_version 1169659 (0.0007) [2023-12-26 08:55:49,917][123091] Updated weights for policy 0, policy_version 1169669 (0.0007) [2023-12-26 08:55:49,985][123091] Updated weights for policy 0, policy_version 1169679 (0.0009) [2023-12-26 08:55:50,470][123090] Updated weights for policy 1, policy_version 1161315 (0.0010) [2023-12-26 08:55:50,529][123090] Updated weights for policy 1, policy_version 1161325 (0.0009) [2023-12-26 08:55:50,599][123090] Updated weights for policy 1, policy_version 1161335 (0.0010) [2023-12-26 08:55:50,793][123091] Updated weights for policy 0, policy_version 1169689 (0.0009) [2023-12-26 08:55:50,864][123091] Updated weights for policy 0, policy_version 1169699 (0.0010) [2023-12-26 08:55:50,933][123091] Updated weights for policy 0, policy_version 1169709 (0.0009) [2023-12-26 08:55:51,412][123090] Updated weights for policy 1, policy_version 1161345 (0.0010) [2023-12-26 08:55:51,479][123090] Updated weights for policy 1, policy_version 1161355 (0.0010) [2023-12-26 08:55:51,534][123090] Updated weights for policy 1, policy_version 1161365 (0.0009) [2023-12-26 08:55:51,589][123090] Updated weights for policy 1, policy_version 1161375 (0.0010) [2023-12-26 08:55:51,794][123091] Updated weights for policy 0, policy_version 1169719 (0.0010) [2023-12-26 08:55:51,855][123091] Updated weights for policy 0, policy_version 1169729 (0.0009) [2023-12-26 08:55:51,911][123091] Updated weights for policy 0, policy_version 1169739 (0.0010) [2023-12-26 08:55:52,409][123090] Updated weights for policy 1, policy_version 1161385 (0.0008) [2023-12-26 08:55:52,461][123090] Updated weights for policy 1, policy_version 1161395 (0.0008) [2023-12-26 08:55:52,515][123090] Updated weights for policy 1, policy_version 1161405 (0.0008) [2023-12-26 08:55:52,768][123091] Updated weights for policy 0, policy_version 1169749 (0.0009) [2023-12-26 08:55:52,828][123091] Updated weights for policy 0, policy_version 1169759 (0.0009) [2023-12-26 08:55:52,884][123091] Updated weights for policy 0, policy_version 1169769 (0.0009) [2023-12-26 08:55:53,262][123090] Updated weights for policy 1, policy_version 1161415 (0.0009) [2023-12-26 08:55:53,314][123090] Updated weights for policy 1, policy_version 1161425 (0.0009) [2023-12-26 08:55:53,380][123090] Updated weights for policy 1, policy_version 1161435 (0.0010) [2023-12-26 08:55:53,673][123091] Updated weights for policy 0, policy_version 1169779 (0.0008) [2023-12-26 08:55:53,726][123091] Updated weights for policy 0, policy_version 1169789 (0.0005) [2023-12-26 08:55:53,784][123091] Updated weights for policy 0, policy_version 1169799 (0.0007) [2023-12-26 08:55:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 596795392. Throughput: 0: 8832.5, 1: 8799.6. Samples: 596774000. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:53,785][121949] Avg episode reward: [(0, '6177.712'), (1, '4746.379')] [2023-12-26 08:55:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001161440_297328640.pth... [2023-12-26 08:55:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001160384_297058304.pth [2023-12-26 08:55:53,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001169808_299474944.pth... [2023-12-26 08:55:53,837][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001168752_299204608.pth [2023-12-26 08:55:54,304][123090] Updated weights for policy 1, policy_version 1161445 (0.0009) [2023-12-26 08:55:54,358][123090] Updated weights for policy 1, policy_version 1161457 (0.0010) [2023-12-26 08:55:54,390][123091] Updated weights for policy 0, policy_version 1169809 (0.0005) [2023-12-26 08:55:54,408][123090] Updated weights for policy 1, policy_version 1161467 (0.0008) [2023-12-26 08:55:54,440][123091] Updated weights for policy 0, policy_version 1169819 (0.0010) [2023-12-26 08:55:54,499][123091] Updated weights for policy 0, policy_version 1169829 (0.0006) [2023-12-26 08:55:54,560][123091] Updated weights for policy 0, policy_version 1169839 (0.0005) [2023-12-26 08:55:55,214][123091] Updated weights for policy 0, policy_version 1169849 (0.0005) [2023-12-26 08:55:55,263][123091] Updated weights for policy 0, policy_version 1169859 (0.0005) [2023-12-26 08:55:55,314][123091] Updated weights for policy 0, policy_version 1169869 (0.0005) [2023-12-26 08:55:55,356][123090] Updated weights for policy 1, policy_version 1161477 (0.0008) [2023-12-26 08:55:55,410][123090] Updated weights for policy 1, policy_version 1161488 (0.0010) [2023-12-26 08:55:55,463][123090] Updated weights for policy 1, policy_version 1161498 (0.0010) [2023-12-26 08:55:56,007][123091] Updated weights for policy 0, policy_version 1169879 (0.0009) [2023-12-26 08:55:56,067][123091] Updated weights for policy 0, policy_version 1169889 (0.0008) [2023-12-26 08:55:56,127][123091] Updated weights for policy 0, policy_version 1169899 (0.0008) [2023-12-26 08:55:56,376][123090] Updated weights for policy 1, policy_version 1161508 (0.0009) [2023-12-26 08:55:56,425][123090] Updated weights for policy 1, policy_version 1161518 (0.0009) [2023-12-26 08:55:56,473][123090] Updated weights for policy 1, policy_version 1161528 (0.0008) [2023-12-26 08:55:56,850][123091] Updated weights for policy 0, policy_version 1169909 (0.0010) [2023-12-26 08:55:56,905][123091] Updated weights for policy 0, policy_version 1169919 (0.0010) [2023-12-26 08:55:56,956][123091] Updated weights for policy 0, policy_version 1169929 (0.0010) [2023-12-26 08:55:57,347][123090] Updated weights for policy 1, policy_version 1161538 (0.0009) [2023-12-26 08:55:57,411][123090] Updated weights for policy 1, policy_version 1161548 (0.0005) [2023-12-26 08:55:57,478][123090] Updated weights for policy 1, policy_version 1161558 (0.0005) [2023-12-26 08:55:57,546][123090] Updated weights for policy 1, policy_version 1161568 (0.0005) [2023-12-26 08:55:57,780][123091] Updated weights for policy 0, policy_version 1169939 (0.0009) [2023-12-26 08:55:57,839][123091] Updated weights for policy 0, policy_version 1169949 (0.0007) [2023-12-26 08:55:57,903][123091] Updated weights for policy 0, policy_version 1169959 (0.0008) [2023-12-26 08:55:58,205][123090] Updated weights for policy 1, policy_version 1161578 (0.0010) [2023-12-26 08:55:58,267][123090] Updated weights for policy 1, policy_version 1161588 (0.0009) [2023-12-26 08:55:58,324][123090] Updated weights for policy 1, policy_version 1161598 (0.0009) [2023-12-26 08:55:58,680][123091] Updated weights for policy 0, policy_version 1169969 (0.0008) [2023-12-26 08:55:58,745][123091] Updated weights for policy 0, policy_version 1169979 (0.0009) [2023-12-26 08:55:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 596885504. Throughput: 0: 8993.0, 1: 8822.2. Samples: 596882564. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:55:58,784][121949] Avg episode reward: [(0, '6282.308'), (1, '5008.505')] [2023-12-26 08:55:58,815][123091] Updated weights for policy 0, policy_version 1169989 (0.0008) [2023-12-26 08:55:58,891][123091] Updated weights for policy 0, policy_version 1169999 (0.0008) [2023-12-26 08:55:59,213][123090] Updated weights for policy 1, policy_version 1161608 (0.0011) [2023-12-26 08:55:59,281][123090] Updated weights for policy 1, policy_version 1161618 (0.0009) [2023-12-26 08:55:59,338][123090] Updated weights for policy 1, policy_version 1161628 (0.0009) [2023-12-26 08:55:59,756][123091] Updated weights for policy 0, policy_version 1170009 (0.0006) [2023-12-26 08:55:59,818][123091] Updated weights for policy 0, policy_version 1170019 (0.0007) [2023-12-26 08:55:59,888][123091] Updated weights for policy 0, policy_version 1170029 (0.0010) [2023-12-26 08:56:00,229][123090] Updated weights for policy 1, policy_version 1161638 (0.0008) [2023-12-26 08:56:00,298][123090] Updated weights for policy 1, policy_version 1161648 (0.0006) [2023-12-26 08:56:00,370][123090] Updated weights for policy 1, policy_version 1161658 (0.0006) [2023-12-26 08:56:00,546][123091] Updated weights for policy 0, policy_version 1170039 (0.0006) [2023-12-26 08:56:00,603][123091] Updated weights for policy 0, policy_version 1170049 (0.0005) [2023-12-26 08:56:00,664][123091] Updated weights for policy 0, policy_version 1170059 (0.0005) [2023-12-26 08:56:01,012][123090] Updated weights for policy 1, policy_version 1161668 (0.0005) [2023-12-26 08:56:01,082][123090] Updated weights for policy 1, policy_version 1161678 (0.0008) [2023-12-26 08:56:01,144][123090] Updated weights for policy 1, policy_version 1161688 (0.0008) [2023-12-26 08:56:01,394][123091] Updated weights for policy 0, policy_version 1170069 (0.0007) [2023-12-26 08:56:01,456][123091] Updated weights for policy 0, policy_version 1170079 (0.0008) [2023-12-26 08:56:01,510][123091] Updated weights for policy 0, policy_version 1170089 (0.0008) [2023-12-26 08:56:01,944][123090] Updated weights for policy 1, policy_version 1161698 (0.0010) [2023-12-26 08:56:02,006][123090] Updated weights for policy 1, policy_version 1161708 (0.0008) [2023-12-26 08:56:02,082][123090] Updated weights for policy 1, policy_version 1161718 (0.0007) [2023-12-26 08:56:02,152][123090] Updated weights for policy 1, policy_version 1161728 (0.0005) [2023-12-26 08:56:02,278][123091] Updated weights for policy 0, policy_version 1170099 (0.0006) [2023-12-26 08:56:02,326][123091] Updated weights for policy 0, policy_version 1170109 (0.0008) [2023-12-26 08:56:02,390][123091] Updated weights for policy 0, policy_version 1170119 (0.0008) [2023-12-26 08:56:02,909][123090] Updated weights for policy 1, policy_version 1161738 (0.0010) [2023-12-26 08:56:02,972][123090] Updated weights for policy 1, policy_version 1161748 (0.0010) [2023-12-26 08:56:03,024][123090] Updated weights for policy 1, policy_version 1161758 (0.0010) [2023-12-26 08:56:03,227][123091] Updated weights for policy 0, policy_version 1170129 (0.0008) [2023-12-26 08:56:03,291][123091] Updated weights for policy 0, policy_version 1170139 (0.0008) [2023-12-26 08:56:03,360][123091] Updated weights for policy 0, policy_version 1170149 (0.0009) [2023-12-26 08:56:03,422][123091] Updated weights for policy 0, policy_version 1170159 (0.0009) [2023-12-26 08:56:03,718][123090] Updated weights for policy 1, policy_version 1161768 (0.0006) [2023-12-26 08:56:03,772][123090] Updated weights for policy 1, policy_version 1161778 (0.0005) [2023-12-26 08:56:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 596975616. Throughput: 0: 8981.1, 1: 8848.6. Samples: 596989216. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:03,785][121949] Avg episode reward: [(0, '6229.406'), (1, '4965.230')] [2023-12-26 08:56:03,834][123090] Updated weights for policy 1, policy_version 1161788 (0.0006) [2023-12-26 08:56:04,239][123091] Updated weights for policy 0, policy_version 1170169 (0.0010) [2023-12-26 08:56:04,308][123091] Updated weights for policy 0, policy_version 1170179 (0.0010) [2023-12-26 08:56:04,368][123091] Updated weights for policy 0, policy_version 1170189 (0.0010) [2023-12-26 08:56:04,615][123090] Updated weights for policy 1, policy_version 1161798 (0.0009) [2023-12-26 08:56:04,674][123090] Updated weights for policy 1, policy_version 1161808 (0.0009) [2023-12-26 08:56:04,724][123090] Updated weights for policy 1, policy_version 1161818 (0.0009) [2023-12-26 08:56:05,187][123091] Updated weights for policy 0, policy_version 1170199 (0.0009) [2023-12-26 08:56:05,236][123091] Updated weights for policy 0, policy_version 1170209 (0.0009) [2023-12-26 08:56:05,283][123091] Updated weights for policy 0, policy_version 1170219 (0.0009) [2023-12-26 08:56:05,560][123090] Updated weights for policy 1, policy_version 1161828 (0.0009) [2023-12-26 08:56:05,621][123090] Updated weights for policy 1, policy_version 1161838 (0.0007) [2023-12-26 08:56:05,681][123090] Updated weights for policy 1, policy_version 1161848 (0.0009) [2023-12-26 08:56:06,144][123091] Updated weights for policy 0, policy_version 1170229 (0.0010) [2023-12-26 08:56:06,198][123091] Updated weights for policy 0, policy_version 1170239 (0.0009) [2023-12-26 08:56:06,265][123091] Updated weights for policy 0, policy_version 1170249 (0.0008) [2023-12-26 08:56:06,525][123090] Updated weights for policy 1, policy_version 1161858 (0.0009) [2023-12-26 08:56:06,600][123090] Updated weights for policy 1, policy_version 1161868 (0.0006) [2023-12-26 08:56:06,666][123090] Updated weights for policy 1, policy_version 1161878 (0.0008) [2023-12-26 08:56:06,737][123090] Updated weights for policy 1, policy_version 1161888 (0.0008) [2023-12-26 08:56:07,093][123091] Updated weights for policy 0, policy_version 1170259 (0.0009) [2023-12-26 08:56:07,143][123091] Updated weights for policy 0, policy_version 1170269 (0.0010) [2023-12-26 08:56:07,194][123091] Updated weights for policy 0, policy_version 1170279 (0.0009) [2023-12-26 08:56:07,507][123090] Updated weights for policy 1, policy_version 1161898 (0.0005) [2023-12-26 08:56:07,562][123090] Updated weights for policy 1, policy_version 1161908 (0.0005) [2023-12-26 08:56:07,624][123090] Updated weights for policy 1, policy_version 1161918 (0.0005) [2023-12-26 08:56:07,987][123091] Updated weights for policy 0, policy_version 1170289 (0.0009) [2023-12-26 08:56:08,044][123091] Updated weights for policy 0, policy_version 1170299 (0.0007) [2023-12-26 08:56:08,093][123091] Updated weights for policy 0, policy_version 1170310 (0.0005) [2023-12-26 08:56:08,139][123091] Updated weights for policy 0, policy_version 1170320 (0.0005) [2023-12-26 08:56:08,411][123090] Updated weights for policy 1, policy_version 1161928 (0.0009) [2023-12-26 08:56:08,460][123090] Updated weights for policy 1, policy_version 1161938 (0.0007) [2023-12-26 08:56:08,523][123090] Updated weights for policy 1, policy_version 1161948 (0.0005) [2023-12-26 08:56:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 597065728. Throughput: 0: 8985.5, 1: 8858.0. Samples: 597040900. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:08,785][121949] Avg episode reward: [(0, '6220.078'), (1, '5139.650')] [2023-12-26 08:56:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001170320_299606016.pth... [2023-12-26 08:56:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001161952_297459712.pth... [2023-12-26 08:56:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001160928_297197568.pth [2023-12-26 08:56:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001169264_299335680.pth [2023-12-26 08:56:08,922][123091] Updated weights for policy 0, policy_version 1170330 (0.0009) [2023-12-26 08:56:08,968][123091] Updated weights for policy 0, policy_version 1170340 (0.0005) [2023-12-26 08:56:09,015][123091] Updated weights for policy 0, policy_version 1170350 (0.0005) [2023-12-26 08:56:09,215][123090] Updated weights for policy 1, policy_version 1161958 (0.0006) [2023-12-26 08:56:09,289][123090] Updated weights for policy 1, policy_version 1161968 (0.0009) [2023-12-26 08:56:09,363][123090] Updated weights for policy 1, policy_version 1161978 (0.0010) [2023-12-26 08:56:09,816][123091] Updated weights for policy 0, policy_version 1170360 (0.0008) [2023-12-26 08:56:09,889][123091] Updated weights for policy 0, policy_version 1170370 (0.0009) [2023-12-26 08:56:09,956][123091] Updated weights for policy 0, policy_version 1170380 (0.0008) [2023-12-26 08:56:10,244][123090] Updated weights for policy 1, policy_version 1161988 (0.0007) [2023-12-26 08:56:10,311][123090] Updated weights for policy 1, policy_version 1161998 (0.0009) [2023-12-26 08:56:10,378][123090] Updated weights for policy 1, policy_version 1162008 (0.0010) [2023-12-26 08:56:10,777][123091] Updated weights for policy 0, policy_version 1170390 (0.0009) [2023-12-26 08:56:10,836][123091] Updated weights for policy 0, policy_version 1170400 (0.0009) [2023-12-26 08:56:10,899][123091] Updated weights for policy 0, policy_version 1170410 (0.0009) [2023-12-26 08:56:11,163][123090] Updated weights for policy 1, policy_version 1162018 (0.0010) [2023-12-26 08:56:11,224][123090] Updated weights for policy 1, policy_version 1162028 (0.0009) [2023-12-26 08:56:11,279][123090] Updated weights for policy 1, policy_version 1162038 (0.0009) [2023-12-26 08:56:11,333][123090] Updated weights for policy 1, policy_version 1162048 (0.0010) [2023-12-26 08:56:11,704][123091] Updated weights for policy 0, policy_version 1170420 (0.0008) [2023-12-26 08:56:11,771][123091] Updated weights for policy 0, policy_version 1170430 (0.0008) [2023-12-26 08:56:11,834][123091] Updated weights for policy 0, policy_version 1170440 (0.0008) [2023-12-26 08:56:12,283][123090] Updated weights for policy 1, policy_version 1162058 (0.0010) [2023-12-26 08:56:12,349][123090] Updated weights for policy 1, policy_version 1162068 (0.0007) [2023-12-26 08:56:12,423][123090] Updated weights for policy 1, policy_version 1162078 (0.0009) [2023-12-26 08:56:12,693][123091] Updated weights for policy 0, policy_version 1170450 (0.0009) [2023-12-26 08:56:12,748][123091] Updated weights for policy 0, policy_version 1170460 (0.0009) [2023-12-26 08:56:12,814][123091] Updated weights for policy 0, policy_version 1170470 (0.0010) [2023-12-26 08:56:12,870][123091] Updated weights for policy 0, policy_version 1170480 (0.0009) [2023-12-26 08:56:13,165][123090] Updated weights for policy 1, policy_version 1162088 (0.0009) [2023-12-26 08:56:13,224][123090] Updated weights for policy 1, policy_version 1162098 (0.0010) [2023-12-26 08:56:13,290][123090] Updated weights for policy 1, policy_version 1162109 (0.0010) [2023-12-26 08:56:13,709][123091] Updated weights for policy 0, policy_version 1170490 (0.0010) [2023-12-26 08:56:13,770][123091] Updated weights for policy 0, policy_version 1170500 (0.0010) [2023-12-26 08:56:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 597147648. Throughput: 0: 9032.3, 1: 8846.3. Samples: 597146044. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:13,785][121949] Avg episode reward: [(0, '6257.730'), (1, '5084.772')] [2023-12-26 08:56:13,828][123091] Updated weights for policy 0, policy_version 1170510 (0.0009) [2023-12-26 08:56:14,145][123090] Updated weights for policy 1, policy_version 1162119 (0.0009) [2023-12-26 08:56:14,209][123090] Updated weights for policy 1, policy_version 1162129 (0.0008) [2023-12-26 08:56:14,274][123090] Updated weights for policy 1, policy_version 1162139 (0.0009) [2023-12-26 08:56:14,654][123091] Updated weights for policy 0, policy_version 1170520 (0.0006) [2023-12-26 08:56:14,728][123091] Updated weights for policy 0, policy_version 1170530 (0.0006) [2023-12-26 08:56:14,808][123091] Updated weights for policy 0, policy_version 1170540 (0.0010) [2023-12-26 08:56:15,131][123090] Updated weights for policy 1, policy_version 1162149 (0.0009) [2023-12-26 08:56:15,185][123090] Updated weights for policy 1, policy_version 1162159 (0.0009) [2023-12-26 08:56:15,250][123090] Updated weights for policy 1, policy_version 1162169 (0.0008) [2023-12-26 08:56:15,605][123091] Updated weights for policy 0, policy_version 1170550 (0.0011) [2023-12-26 08:56:15,660][123091] Updated weights for policy 0, policy_version 1170560 (0.0011) [2023-12-26 08:56:15,727][123091] Updated weights for policy 0, policy_version 1170570 (0.0011) [2023-12-26 08:56:16,107][123090] Updated weights for policy 1, policy_version 1162179 (0.0008) [2023-12-26 08:56:16,167][123090] Updated weights for policy 1, policy_version 1162189 (0.0009) [2023-12-26 08:56:16,231][123090] Updated weights for policy 1, policy_version 1162199 (0.0009) [2023-12-26 08:56:16,561][123091] Updated weights for policy 0, policy_version 1170580 (0.0011) [2023-12-26 08:56:16,624][123091] Updated weights for policy 0, policy_version 1170590 (0.0010) [2023-12-26 08:56:16,690][123091] Updated weights for policy 0, policy_version 1170600 (0.0010) [2023-12-26 08:56:17,061][123090] Updated weights for policy 1, policy_version 1162209 (0.0008) [2023-12-26 08:56:17,130][123090] Updated weights for policy 1, policy_version 1162219 (0.0009) [2023-12-26 08:56:17,190][123090] Updated weights for policy 1, policy_version 1162229 (0.0008) [2023-12-26 08:56:17,253][123090] Updated weights for policy 1, policy_version 1162239 (0.0007) [2023-12-26 08:56:17,467][123091] Updated weights for policy 0, policy_version 1170610 (0.0011) [2023-12-26 08:56:17,527][123091] Updated weights for policy 0, policy_version 1170620 (0.0011) [2023-12-26 08:56:17,580][123091] Updated weights for policy 0, policy_version 1170630 (0.0010) [2023-12-26 08:56:17,632][123091] Updated weights for policy 0, policy_version 1170640 (0.0010) [2023-12-26 08:56:18,030][123090] Updated weights for policy 1, policy_version 1162249 (0.0009) [2023-12-26 08:56:18,093][123090] Updated weights for policy 1, policy_version 1162259 (0.0008) [2023-12-26 08:56:18,154][123090] Updated weights for policy 1, policy_version 1162269 (0.0009) [2023-12-26 08:56:18,404][123091] Updated weights for policy 0, policy_version 1170650 (0.0006) [2023-12-26 08:56:18,468][123091] Updated weights for policy 0, policy_version 1170660 (0.0009) [2023-12-26 08:56:18,541][123091] Updated weights for policy 0, policy_version 1170670 (0.0007) [2023-12-26 08:56:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 597237760. Throughput: 0: 8983.7, 1: 8753.5. Samples: 597248448. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:18,784][121949] Avg episode reward: [(0, '6295.192'), (1, '5121.347')] [2023-12-26 08:56:19,007][123090] Updated weights for policy 1, policy_version 1162279 (0.0009) [2023-12-26 08:56:19,067][123090] Updated weights for policy 1, policy_version 1162289 (0.0005) [2023-12-26 08:56:19,125][123090] Updated weights for policy 1, policy_version 1162299 (0.0006) [2023-12-26 08:56:19,318][123091] Updated weights for policy 0, policy_version 1170680 (0.0008) [2023-12-26 08:56:19,390][123091] Updated weights for policy 0, policy_version 1170690 (0.0008) [2023-12-26 08:56:19,457][123091] Updated weights for policy 0, policy_version 1170700 (0.0008) [2023-12-26 08:56:19,838][123090] Updated weights for policy 1, policy_version 1162309 (0.0007) [2023-12-26 08:56:19,903][123090] Updated weights for policy 1, policy_version 1162319 (0.0010) [2023-12-26 08:56:19,966][123090] Updated weights for policy 1, policy_version 1162329 (0.0009) [2023-12-26 08:56:20,212][123091] Updated weights for policy 0, policy_version 1170710 (0.0010) [2023-12-26 08:56:20,271][123091] Updated weights for policy 0, policy_version 1170720 (0.0009) [2023-12-26 08:56:20,324][123091] Updated weights for policy 0, policy_version 1170730 (0.0011) [2023-12-26 08:56:20,867][123090] Updated weights for policy 1, policy_version 1162339 (0.0009) [2023-12-26 08:56:20,921][123090] Updated weights for policy 1, policy_version 1162349 (0.0009) [2023-12-26 08:56:20,971][123090] Updated weights for policy 1, policy_version 1162359 (0.0009) [2023-12-26 08:56:21,161][123091] Updated weights for policy 0, policy_version 1170740 (0.0011) [2023-12-26 08:56:21,210][123091] Updated weights for policy 0, policy_version 1170750 (0.0011) [2023-12-26 08:56:21,276][123091] Updated weights for policy 0, policy_version 1170760 (0.0011) [2023-12-26 08:56:21,819][123090] Updated weights for policy 1, policy_version 1162369 (0.0007) [2023-12-26 08:56:21,869][123090] Updated weights for policy 1, policy_version 1162379 (0.0010) [2023-12-26 08:56:21,925][123090] Updated weights for policy 1, policy_version 1162389 (0.0010) [2023-12-26 08:56:21,986][123090] Updated weights for policy 1, policy_version 1162399 (0.0010) [2023-12-26 08:56:22,170][123091] Updated weights for policy 0, policy_version 1170770 (0.0009) [2023-12-26 08:56:22,231][123091] Updated weights for policy 0, policy_version 1170780 (0.0006) [2023-12-26 08:56:22,295][123091] Updated weights for policy 0, policy_version 1170790 (0.0010) [2023-12-26 08:56:22,367][123091] Updated weights for policy 0, policy_version 1170800 (0.0011) [2023-12-26 08:56:22,883][123090] Updated weights for policy 1, policy_version 1162409 (0.0010) [2023-12-26 08:56:22,942][123090] Updated weights for policy 1, policy_version 1162419 (0.0010) [2023-12-26 08:56:23,008][123090] Updated weights for policy 1, policy_version 1162429 (0.0009) [2023-12-26 08:56:23,077][123091] Updated weights for policy 0, policy_version 1170810 (0.0010) [2023-12-26 08:56:23,132][123091] Updated weights for policy 0, policy_version 1170820 (0.0009) [2023-12-26 08:56:23,186][123091] Updated weights for policy 0, policy_version 1170830 (0.0009) [2023-12-26 08:56:23,737][123090] Updated weights for policy 1, policy_version 1162439 (0.0007) [2023-12-26 08:56:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 597319680. Throughput: 0: 8955.1, 1: 8738.7. Samples: 597300148. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:23,785][121949] Avg episode reward: [(0, '6195.387'), (1, '5384.551')] [2023-12-26 08:56:23,787][123090] Updated weights for policy 1, policy_version 1162449 (0.0006) [2023-12-26 08:56:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001170832_299737088.pth... [2023-12-26 08:56:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001169808_299474944.pth [2023-12-26 08:56:23,841][123090] Updated weights for policy 1, policy_version 1162459 (0.0010) [2023-12-26 08:56:23,865][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001162464_297590784.pth... [2023-12-26 08:56:23,868][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001161440_297328640.pth [2023-12-26 08:56:23,910][123091] Updated weights for policy 0, policy_version 1170840 (0.0005) [2023-12-26 08:56:23,962][123091] Updated weights for policy 0, policy_version 1170850 (0.0006) [2023-12-26 08:56:24,008][123091] Updated weights for policy 0, policy_version 1170860 (0.0005) [2023-12-26 08:56:24,634][123090] Updated weights for policy 1, policy_version 1162469 (0.0009) [2023-12-26 08:56:24,676][123091] Updated weights for policy 0, policy_version 1170870 (0.0007) [2023-12-26 08:56:24,682][123090] Updated weights for policy 1, policy_version 1162479 (0.0008) [2023-12-26 08:56:24,736][123090] Updated weights for policy 1, policy_version 1162489 (0.0009) [2023-12-26 08:56:24,738][123091] Updated weights for policy 0, policy_version 1170880 (0.0008) [2023-12-26 08:56:24,796][123091] Updated weights for policy 0, policy_version 1170890 (0.0009) [2023-12-26 08:56:25,544][123091] Updated weights for policy 0, policy_version 1170900 (0.0009) [2023-12-26 08:56:25,603][123091] Updated weights for policy 0, policy_version 1170910 (0.0010) [2023-12-26 08:56:25,607][123090] Updated weights for policy 1, policy_version 1162499 (0.0008) [2023-12-26 08:56:25,647][123091] Updated weights for policy 0, policy_version 1170920 (0.0010) [2023-12-26 08:56:25,662][123090] Updated weights for policy 1, policy_version 1162509 (0.0010) [2023-12-26 08:56:25,721][123090] Updated weights for policy 1, policy_version 1162519 (0.0010) [2023-12-26 08:56:26,446][123090] Updated weights for policy 1, policy_version 1162529 (0.0010) [2023-12-26 08:56:26,503][123091] Updated weights for policy 0, policy_version 1170930 (0.0009) [2023-12-26 08:56:26,505][123090] Updated weights for policy 1, policy_version 1162539 (0.0005) [2023-12-26 08:56:26,565][123091] Updated weights for policy 0, policy_version 1170940 (0.0006) [2023-12-26 08:56:26,570][123090] Updated weights for policy 1, policy_version 1162549 (0.0010) [2023-12-26 08:56:26,619][123091] Updated weights for policy 0, policy_version 1170950 (0.0006) [2023-12-26 08:56:26,629][123090] Updated weights for policy 1, policy_version 1162559 (0.0010) [2023-12-26 08:56:26,670][123091] Updated weights for policy 0, policy_version 1170960 (0.0008) [2023-12-26 08:56:27,394][123090] Updated weights for policy 1, policy_version 1162569 (0.0010) [2023-12-26 08:56:27,394][123091] Updated weights for policy 0, policy_version 1170970 (0.0007) [2023-12-26 08:56:27,458][123090] Updated weights for policy 1, policy_version 1162579 (0.0008) [2023-12-26 08:56:27,466][123091] Updated weights for policy 0, policy_version 1170980 (0.0006) [2023-12-26 08:56:27,520][123090] Updated weights for policy 1, policy_version 1162589 (0.0008) [2023-12-26 08:56:27,528][123091] Updated weights for policy 0, policy_version 1170990 (0.0006) [2023-12-26 08:56:28,176][123091] Updated weights for policy 0, policy_version 1171000 (0.0009) [2023-12-26 08:56:28,229][123091] Updated weights for policy 0, policy_version 1171010 (0.0009) [2023-12-26 08:56:28,276][123091] Updated weights for policy 0, policy_version 1171020 (0.0008) [2023-12-26 08:56:28,282][123090] Updated weights for policy 1, policy_version 1162599 (0.0008) [2023-12-26 08:56:28,360][123090] Updated weights for policy 1, policy_version 1162609 (0.0008) [2023-12-26 08:56:28,411][123090] Updated weights for policy 1, policy_version 1162619 (0.0006) [2023-12-26 08:56:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 597417984. Throughput: 0: 8995.4, 1: 8786.2. Samples: 597410260. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:28,785][121949] Avg episode reward: [(0, '6122.589'), (1, '5372.886')] [2023-12-26 08:56:29,154][123090] Updated weights for policy 1, policy_version 1162629 (0.0005) [2023-12-26 08:56:29,170][123091] Updated weights for policy 0, policy_version 1171030 (0.0009) [2023-12-26 08:56:29,217][123090] Updated weights for policy 1, policy_version 1162639 (0.0006) [2023-12-26 08:56:29,228][123091] Updated weights for policy 0, policy_version 1171040 (0.0008) [2023-12-26 08:56:29,287][123090] Updated weights for policy 1, policy_version 1162649 (0.0009) [2023-12-26 08:56:29,287][123091] Updated weights for policy 0, policy_version 1171050 (0.0008) [2023-12-26 08:56:30,080][123090] Updated weights for policy 1, policy_version 1162659 (0.0009) [2023-12-26 08:56:30,128][123090] Updated weights for policy 1, policy_version 1162669 (0.0008) [2023-12-26 08:56:30,168][123091] Updated weights for policy 0, policy_version 1171060 (0.0010) [2023-12-26 08:56:30,186][123090] Updated weights for policy 1, policy_version 1162679 (0.0008) [2023-12-26 08:56:30,225][123091] Updated weights for policy 0, policy_version 1171070 (0.0009) [2023-12-26 08:56:30,292][123091] Updated weights for policy 0, policy_version 1171080 (0.0010) [2023-12-26 08:56:30,915][123090] Updated weights for policy 1, policy_version 1162689 (0.0006) [2023-12-26 08:56:30,972][123090] Updated weights for policy 1, policy_version 1162699 (0.0010) [2023-12-26 08:56:31,033][123090] Updated weights for policy 1, policy_version 1162709 (0.0006) [2023-12-26 08:56:31,098][123090] Updated weights for policy 1, policy_version 1162719 (0.0010) [2023-12-26 08:56:31,112][123091] Updated weights for policy 0, policy_version 1171090 (0.0009) [2023-12-26 08:56:31,174][123091] Updated weights for policy 0, policy_version 1171100 (0.0009) [2023-12-26 08:56:31,247][123091] Updated weights for policy 0, policy_version 1171110 (0.0009) [2023-12-26 08:56:31,325][123091] Updated weights for policy 0, policy_version 1171120 (0.0011) [2023-12-26 08:56:31,888][123090] Updated weights for policy 1, policy_version 1162729 (0.0008) [2023-12-26 08:56:31,950][123090] Updated weights for policy 1, policy_version 1162739 (0.0008) [2023-12-26 08:56:32,003][123090] Updated weights for policy 1, policy_version 1162749 (0.0010) [2023-12-26 08:56:32,064][123091] Updated weights for policy 0, policy_version 1171130 (0.0007) [2023-12-26 08:56:32,127][123091] Updated weights for policy 0, policy_version 1171140 (0.0009) [2023-12-26 08:56:32,182][123091] Updated weights for policy 0, policy_version 1171150 (0.0010) [2023-12-26 08:56:32,735][123090] Updated weights for policy 1, policy_version 1162759 (0.0007) [2023-12-26 08:56:32,783][123090] Updated weights for policy 1, policy_version 1162769 (0.0005) [2023-12-26 08:56:32,836][123090] Updated weights for policy 1, policy_version 1162779 (0.0006) [2023-12-26 08:56:32,960][123091] Updated weights for policy 0, policy_version 1171160 (0.0010) [2023-12-26 08:56:33,006][123091] Updated weights for policy 0, policy_version 1171170 (0.0010) [2023-12-26 08:56:33,057][123091] Updated weights for policy 0, policy_version 1171181 (0.0010) [2023-12-26 08:56:33,555][123090] Updated weights for policy 1, policy_version 1162789 (0.0007) [2023-12-26 08:56:33,612][123090] Updated weights for policy 1, policy_version 1162799 (0.0006) [2023-12-26 08:56:33,675][123090] Updated weights for policy 1, policy_version 1162809 (0.0006) [2023-12-26 08:56:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 597508096. Throughput: 0: 8947.3, 1: 8782.7. Samples: 597519372. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:33,785][121949] Avg episode reward: [(0, '6089.564'), (1, '5111.088')] [2023-12-26 08:56:33,826][123091] Updated weights for policy 0, policy_version 1171191 (0.0006) [2023-12-26 08:56:33,893][123091] Updated weights for policy 0, policy_version 1171201 (0.0005) [2023-12-26 08:56:33,969][123091] Updated weights for policy 0, policy_version 1171211 (0.0005) [2023-12-26 08:56:34,255][123090] Updated weights for policy 1, policy_version 1162819 (0.0005) [2023-12-26 08:56:34,319][123090] Updated weights for policy 1, policy_version 1162829 (0.0005) [2023-12-26 08:56:34,383][123090] Updated weights for policy 1, policy_version 1162839 (0.0009) [2023-12-26 08:56:34,692][123091] Updated weights for policy 0, policy_version 1171221 (0.0008) [2023-12-26 08:56:34,770][123091] Updated weights for policy 0, policy_version 1171231 (0.0011) [2023-12-26 08:56:34,848][123091] Updated weights for policy 0, policy_version 1171241 (0.0011) [2023-12-26 08:56:35,041][123090] Updated weights for policy 1, policy_version 1162849 (0.0008) [2023-12-26 08:56:35,101][123090] Updated weights for policy 1, policy_version 1162859 (0.0009) [2023-12-26 08:56:35,169][123090] Updated weights for policy 1, policy_version 1162869 (0.0006) [2023-12-26 08:56:35,234][123090] Updated weights for policy 1, policy_version 1162879 (0.0005) [2023-12-26 08:56:35,635][123091] Updated weights for policy 0, policy_version 1171251 (0.0010) [2023-12-26 08:56:35,711][123091] Updated weights for policy 0, policy_version 1171261 (0.0005) [2023-12-26 08:56:35,779][123091] Updated weights for policy 0, policy_version 1171271 (0.0007) [2023-12-26 08:56:36,025][123090] Updated weights for policy 1, policy_version 1162889 (0.0010) [2023-12-26 08:56:36,092][123090] Updated weights for policy 1, policy_version 1162899 (0.0009) [2023-12-26 08:56:36,172][123090] Updated weights for policy 1, policy_version 1162909 (0.0007) [2023-12-26 08:56:36,445][123091] Updated weights for policy 0, policy_version 1171281 (0.0008) [2023-12-26 08:56:36,509][123091] Updated weights for policy 0, policy_version 1171291 (0.0006) [2023-12-26 08:56:36,581][123091] Updated weights for policy 0, policy_version 1171301 (0.0006) [2023-12-26 08:56:36,643][123091] Updated weights for policy 0, policy_version 1171311 (0.0006) [2023-12-26 08:56:36,951][123090] Updated weights for policy 1, policy_version 1162919 (0.0008) [2023-12-26 08:56:37,007][123090] Updated weights for policy 1, policy_version 1162929 (0.0009) [2023-12-26 08:56:37,060][123090] Updated weights for policy 1, policy_version 1162939 (0.0010) [2023-12-26 08:56:37,276][123091] Updated weights for policy 0, policy_version 1171321 (0.0006) [2023-12-26 08:56:37,325][123091] Updated weights for policy 0, policy_version 1171331 (0.0006) [2023-12-26 08:56:37,379][123091] Updated weights for policy 0, policy_version 1171341 (0.0007) [2023-12-26 08:56:37,838][123090] Updated weights for policy 1, policy_version 1162949 (0.0007) [2023-12-26 08:56:37,902][123090] Updated weights for policy 1, policy_version 1162959 (0.0005) [2023-12-26 08:56:37,970][123090] Updated weights for policy 1, policy_version 1162969 (0.0005) [2023-12-26 08:56:38,053][123091] Updated weights for policy 0, policy_version 1171351 (0.0007) [2023-12-26 08:56:38,124][123091] Updated weights for policy 0, policy_version 1171361 (0.0005) [2023-12-26 08:56:38,191][123091] Updated weights for policy 0, policy_version 1171371 (0.0005) [2023-12-26 08:56:38,772][123090] Updated weights for policy 1, policy_version 1162979 (0.0007) [2023-12-26 08:56:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 597598208. Throughput: 0: 8989.7, 1: 8837.2. Samples: 597576212. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:38,785][121949] Avg episode reward: [(0, '6177.489'), (1, '5188.749')] [2023-12-26 08:56:38,818][123091] Updated weights for policy 0, policy_version 1171381 (0.0008) [2023-12-26 08:56:38,829][123090] Updated weights for policy 1, policy_version 1162989 (0.0007) [2023-12-26 08:56:38,863][123091] Updated weights for policy 0, policy_version 1171391 (0.0007) [2023-12-26 08:56:38,883][123090] Updated weights for policy 1, policy_version 1162999 (0.0008) [2023-12-26 08:56:38,908][123091] Updated weights for policy 0, policy_version 1171401 (0.0006) [2023-12-26 08:56:38,922][123008] Early stopping after 4 epochs (32 sgd steps), loss delta 0.0000008 [2023-12-26 08:56:38,923][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001163008_297730048.pth... [2023-12-26 08:56:38,926][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001161952_297459712.pth [2023-12-26 08:56:38,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001171408_299884544.pth... [2023-12-26 08:56:38,942][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001170320_299606016.pth [2023-12-26 08:56:39,735][123090] Updated weights for policy 1, policy_version 1163009 (0.0008) [2023-12-26 08:56:39,766][123091] Updated weights for policy 0, policy_version 1171411 (0.0008) [2023-12-26 08:56:39,802][123090] Updated weights for policy 1, policy_version 1163019 (0.0009) [2023-12-26 08:56:39,833][123091] Updated weights for policy 0, policy_version 1171421 (0.0008) [2023-12-26 08:56:39,873][123090] Updated weights for policy 1, policy_version 1163029 (0.0007) [2023-12-26 08:56:39,901][123091] Updated weights for policy 0, policy_version 1171431 (0.0007) [2023-12-26 08:56:39,940][123090] Updated weights for policy 1, policy_version 1163039 (0.0009) [2023-12-26 08:56:40,696][123091] Updated weights for policy 0, policy_version 1171441 (0.0011) [2023-12-26 08:56:40,720][123090] Updated weights for policy 1, policy_version 1163049 (0.0006) [2023-12-26 08:56:40,762][123091] Updated weights for policy 0, policy_version 1171451 (0.0010) [2023-12-26 08:56:40,781][123090] Updated weights for policy 1, policy_version 1163059 (0.0005) [2023-12-26 08:56:40,818][123091] Updated weights for policy 0, policy_version 1171461 (0.0011) [2023-12-26 08:56:40,837][123090] Updated weights for policy 1, policy_version 1163069 (0.0005) [2023-12-26 08:56:40,874][123091] Updated weights for policy 0, policy_version 1171471 (0.0011) [2023-12-26 08:56:41,640][123090] Updated weights for policy 1, policy_version 1163079 (0.0006) [2023-12-26 08:56:41,688][123091] Updated weights for policy 0, policy_version 1171481 (0.0008) [2023-12-26 08:56:41,705][123090] Updated weights for policy 1, policy_version 1163089 (0.0007) [2023-12-26 08:56:41,760][123091] Updated weights for policy 0, policy_version 1171491 (0.0008) [2023-12-26 08:56:41,791][123090] Updated weights for policy 1, policy_version 1163099 (0.0008) [2023-12-26 08:56:41,822][123091] Updated weights for policy 0, policy_version 1171501 (0.0008) [2023-12-26 08:56:42,605][123090] Updated weights for policy 1, policy_version 1163109 (0.0007) [2023-12-26 08:56:42,617][123091] Updated weights for policy 0, policy_version 1171511 (0.0010) [2023-12-26 08:56:42,664][123090] Updated weights for policy 1, policy_version 1163119 (0.0005) [2023-12-26 08:56:42,672][123091] Updated weights for policy 0, policy_version 1171521 (0.0010) [2023-12-26 08:56:42,718][123090] Updated weights for policy 1, policy_version 1163129 (0.0007) [2023-12-26 08:56:42,731][123091] Updated weights for policy 0, policy_version 1171531 (0.0011) [2023-12-26 08:56:43,474][123091] Updated weights for policy 0, policy_version 1171541 (0.0011) [2023-12-26 08:56:43,521][123091] Updated weights for policy 0, policy_version 1171551 (0.0010) [2023-12-26 08:56:43,572][123091] Updated weights for policy 0, policy_version 1171561 (0.0010) [2023-12-26 08:56:43,598][123090] Updated weights for policy 1, policy_version 1163139 (0.0010) [2023-12-26 08:56:43,653][123090] Updated weights for policy 1, policy_version 1163149 (0.0009) [2023-12-26 08:56:43,702][123090] Updated weights for policy 1, policy_version 1163159 (0.0009) [2023-12-26 08:56:43,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.8, 300 sec: 17689.3). Total num frames: 597696512. Throughput: 0: 8939.6, 1: 8860.6. Samples: 597683576. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:43,785][121949] Avg episode reward: [(0, '6069.045'), (1, '5179.453')] [2023-12-26 08:56:44,344][123091] Updated weights for policy 0, policy_version 1171571 (0.0009) [2023-12-26 08:56:44,398][123091] Updated weights for policy 0, policy_version 1171581 (0.0006) [2023-12-26 08:56:44,467][123091] Updated weights for policy 0, policy_version 1171591 (0.0005) [2023-12-26 08:56:44,528][123090] Updated weights for policy 1, policy_version 1163169 (0.0009) [2023-12-26 08:56:44,576][123090] Updated weights for policy 1, policy_version 1163179 (0.0008) [2023-12-26 08:56:44,642][123090] Updated weights for policy 1, policy_version 1163189 (0.0006) [2023-12-26 08:56:44,717][123090] Updated weights for policy 1, policy_version 1163199 (0.0005) [2023-12-26 08:56:45,169][123091] Updated weights for policy 0, policy_version 1171601 (0.0006) [2023-12-26 08:56:45,235][123091] Updated weights for policy 0, policy_version 1171611 (0.0006) [2023-12-26 08:56:45,308][123091] Updated weights for policy 0, policy_version 1171621 (0.0008) [2023-12-26 08:56:45,379][123091] Updated weights for policy 0, policy_version 1171631 (0.0009) [2023-12-26 08:56:45,521][123090] Updated weights for policy 1, policy_version 1163209 (0.0008) [2023-12-26 08:56:45,572][123090] Updated weights for policy 1, policy_version 1163219 (0.0009) [2023-12-26 08:56:45,632][123090] Updated weights for policy 1, policy_version 1163230 (0.0010) [2023-12-26 08:56:46,015][123091] Updated weights for policy 0, policy_version 1171641 (0.0005) [2023-12-26 08:56:46,069][123091] Updated weights for policy 0, policy_version 1171651 (0.0005) [2023-12-26 08:56:46,115][123091] Updated weights for policy 0, policy_version 1171661 (0.0005) [2023-12-26 08:56:46,593][123090] Updated weights for policy 1, policy_version 1163240 (0.0010) [2023-12-26 08:56:46,656][123090] Updated weights for policy 1, policy_version 1163250 (0.0010) [2023-12-26 08:56:46,704][123090] Updated weights for policy 1, policy_version 1163260 (0.0010) [2023-12-26 08:56:46,748][123091] Updated weights for policy 0, policy_version 1171671 (0.0007) [2023-12-26 08:56:46,808][123091] Updated weights for policy 0, policy_version 1171681 (0.0009) [2023-12-26 08:56:46,871][123091] Updated weights for policy 0, policy_version 1171691 (0.0009) [2023-12-26 08:56:47,498][123090] Updated weights for policy 1, policy_version 1163270 (0.0010) [2023-12-26 08:56:47,554][123090] Updated weights for policy 1, policy_version 1163280 (0.0010) [2023-12-26 08:56:47,617][123090] Updated weights for policy 1, policy_version 1163290 (0.0010) [2023-12-26 08:56:47,713][123091] Updated weights for policy 0, policy_version 1171701 (0.0010) [2023-12-26 08:56:47,768][123091] Updated weights for policy 0, policy_version 1171711 (0.0010) [2023-12-26 08:56:47,822][123091] Updated weights for policy 0, policy_version 1171721 (0.0010) [2023-12-26 08:56:48,425][123090] Updated weights for policy 1, policy_version 1163300 (0.0010) [2023-12-26 08:56:48,489][123090] Updated weights for policy 1, policy_version 1163310 (0.0011) [2023-12-26 08:56:48,545][123090] Updated weights for policy 1, policy_version 1163320 (0.0010) [2023-12-26 08:56:48,641][123091] Updated weights for policy 0, policy_version 1171731 (0.0011) [2023-12-26 08:56:48,708][123091] Updated weights for policy 0, policy_version 1171741 (0.0011) [2023-12-26 08:56:48,774][123091] Updated weights for policy 0, policy_version 1171751 (0.0011) [2023-12-26 08:56:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 597778432. Throughput: 0: 9060.4, 1: 8770.5. Samples: 597791604. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:48,784][121949] Avg episode reward: [(0, '6002.060'), (1, '5140.350')] [2023-12-26 08:56:49,370][123090] Updated weights for policy 1, policy_version 1163330 (0.0010) [2023-12-26 08:56:49,438][123090] Updated weights for policy 1, policy_version 1163340 (0.0007) [2023-12-26 08:56:49,482][123091] Updated weights for policy 0, policy_version 1171761 (0.0010) [2023-12-26 08:56:49,501][123090] Updated weights for policy 1, policy_version 1163350 (0.0005) [2023-12-26 08:56:49,544][123091] Updated weights for policy 0, policy_version 1171771 (0.0006) [2023-12-26 08:56:49,570][123090] Updated weights for policy 1, policy_version 1163360 (0.0007) [2023-12-26 08:56:49,605][123091] Updated weights for policy 0, policy_version 1171781 (0.0008) [2023-12-26 08:56:49,669][123091] Updated weights for policy 0, policy_version 1171791 (0.0010) [2023-12-26 08:56:50,310][123090] Updated weights for policy 1, policy_version 1163370 (0.0010) [2023-12-26 08:56:50,364][123090] Updated weights for policy 1, policy_version 1163380 (0.0009) [2023-12-26 08:56:50,421][123090] Updated weights for policy 1, policy_version 1163390 (0.0009) [2023-12-26 08:56:50,505][123091] Updated weights for policy 0, policy_version 1171801 (0.0010) [2023-12-26 08:56:50,570][123091] Updated weights for policy 0, policy_version 1171811 (0.0009) [2023-12-26 08:56:50,631][123091] Updated weights for policy 0, policy_version 1171821 (0.0009) [2023-12-26 08:56:51,287][123090] Updated weights for policy 1, policy_version 1163400 (0.0010) [2023-12-26 08:56:51,356][123090] Updated weights for policy 1, policy_version 1163410 (0.0009) [2023-12-26 08:56:51,429][123090] Updated weights for policy 1, policy_version 1163420 (0.0009) [2023-12-26 08:56:51,493][123091] Updated weights for policy 0, policy_version 1171831 (0.0010) [2023-12-26 08:56:51,564][123091] Updated weights for policy 0, policy_version 1171841 (0.0008) [2023-12-26 08:56:51,628][123091] Updated weights for policy 0, policy_version 1171851 (0.0009) [2023-12-26 08:56:52,260][123090] Updated weights for policy 1, policy_version 1163430 (0.0009) [2023-12-26 08:56:52,320][123090] Updated weights for policy 1, policy_version 1163440 (0.0009) [2023-12-26 08:56:52,384][123090] Updated weights for policy 1, policy_version 1163450 (0.0010) [2023-12-26 08:56:52,447][123091] Updated weights for policy 0, policy_version 1171861 (0.0009) [2023-12-26 08:56:52,514][123091] Updated weights for policy 0, policy_version 1171871 (0.0008) [2023-12-26 08:56:52,581][123091] Updated weights for policy 0, policy_version 1171881 (0.0008) [2023-12-26 08:56:53,294][123090] Updated weights for policy 1, policy_version 1163460 (0.0009) [2023-12-26 08:56:53,314][123091] Updated weights for policy 0, policy_version 1171891 (0.0007) [2023-12-26 08:56:53,349][123090] Updated weights for policy 1, policy_version 1163470 (0.0010) [2023-12-26 08:56:53,365][123091] Updated weights for policy 0, policy_version 1171901 (0.0008) [2023-12-26 08:56:53,415][123090] Updated weights for policy 1, policy_version 1163480 (0.0007) [2023-12-26 08:56:53,421][123091] Updated weights for policy 0, policy_version 1171911 (0.0009) [2023-12-26 08:56:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 597868544. Throughput: 0: 9059.2, 1: 8770.7. Samples: 597843244. Policy #0 lag: (min: 1.0, avg: 13.9, max: 33.0) [2023-12-26 08:56:53,785][121949] Avg episode reward: [(0, '6017.263'), (1, '5273.803')] [2023-12-26 08:56:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001171920_300015616.pth... [2023-12-26 08:56:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001163488_297852928.pth... [2023-12-26 08:56:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001162464_297590784.pth [2023-12-26 08:56:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001170832_299737088.pth [2023-12-26 08:56:54,180][123090] Updated weights for policy 1, policy_version 1163490 (0.0008) [2023-12-26 08:56:54,241][123090] Updated weights for policy 1, policy_version 1163500 (0.0008) [2023-12-26 08:56:54,287][123091] Updated weights for policy 0, policy_version 1171921 (0.0007) [2023-12-26 08:56:54,307][123090] Updated weights for policy 1, policy_version 1163510 (0.0009) [2023-12-26 08:56:54,335][123091] Updated weights for policy 0, policy_version 1171931 (0.0007) [2023-12-26 08:56:54,366][123090] Updated weights for policy 1, policy_version 1163520 (0.0008) [2023-12-26 08:56:54,390][123091] Updated weights for policy 0, policy_version 1171942 (0.0009) [2023-12-26 08:56:54,444][123091] Updated weights for policy 0, policy_version 1171952 (0.0009) [2023-12-26 08:56:55,142][123090] Updated weights for policy 1, policy_version 1163530 (0.0005) [2023-12-26 08:56:55,196][123090] Updated weights for policy 1, policy_version 1163540 (0.0006) [2023-12-26 08:56:55,244][123090] Updated weights for policy 1, policy_version 1163550 (0.0005) [2023-12-26 08:56:55,262][123091] Updated weights for policy 0, policy_version 1171962 (0.0008) [2023-12-26 08:56:55,314][123091] Updated weights for policy 0, policy_version 1171972 (0.0010) [2023-12-26 08:56:55,366][123091] Updated weights for policy 0, policy_version 1171983 (0.0009) [2023-12-26 08:56:55,895][123090] Updated weights for policy 1, policy_version 1163560 (0.0006) [2023-12-26 08:56:55,950][123090] Updated weights for policy 1, policy_version 1163570 (0.0006) [2023-12-26 08:56:56,013][123090] Updated weights for policy 1, policy_version 1163580 (0.0005) [2023-12-26 08:56:56,188][123091] Updated weights for policy 0, policy_version 1171993 (0.0006) [2023-12-26 08:56:56,242][123091] Updated weights for policy 0, policy_version 1172003 (0.0009) [2023-12-26 08:56:56,299][123091] Updated weights for policy 0, policy_version 1172014 (0.0010) [2023-12-26 08:56:56,656][123090] Updated weights for policy 1, policy_version 1163590 (0.0007) [2023-12-26 08:56:56,714][123090] Updated weights for policy 1, policy_version 1163600 (0.0010) [2023-12-26 08:56:56,778][123090] Updated weights for policy 1, policy_version 1163610 (0.0005) [2023-12-26 08:56:56,961][123091] Updated weights for policy 0, policy_version 1172024 (0.0010) [2023-12-26 08:56:57,020][123091] Updated weights for policy 0, policy_version 1172034 (0.0010) [2023-12-26 08:56:57,083][123091] Updated weights for policy 0, policy_version 1172044 (0.0010) [2023-12-26 08:56:57,470][123090] Updated weights for policy 1, policy_version 1163620 (0.0006) [2023-12-26 08:56:57,519][123090] Updated weights for policy 1, policy_version 1163630 (0.0005) [2023-12-26 08:56:57,573][123090] Updated weights for policy 1, policy_version 1163640 (0.0006) [2023-12-26 08:56:57,823][123091] Updated weights for policy 0, policy_version 1172054 (0.0007) [2023-12-26 08:56:57,879][123091] Updated weights for policy 0, policy_version 1172064 (0.0005) [2023-12-26 08:56:57,931][123091] Updated weights for policy 0, policy_version 1172074 (0.0005) [2023-12-26 08:56:58,401][123090] Updated weights for policy 1, policy_version 1163650 (0.0010) [2023-12-26 08:56:58,471][123090] Updated weights for policy 1, policy_version 1163660 (0.0010) [2023-12-26 08:56:58,555][123090] Updated weights for policy 1, policy_version 1163670 (0.0009) [2023-12-26 08:56:58,627][123090] Updated weights for policy 1, policy_version 1163680 (0.0009) [2023-12-26 08:56:58,737][123091] Updated weights for policy 0, policy_version 1172084 (0.0006) [2023-12-26 08:56:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 597958656. Throughput: 0: 9083.0, 1: 8861.7. Samples: 597953556. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:56:58,785][121949] Avg episode reward: [(0, '6052.451'), (1, '5414.549')] [2023-12-26 08:56:58,816][123091] Updated weights for policy 0, policy_version 1172094 (0.0010) [2023-12-26 08:56:58,880][123091] Updated weights for policy 0, policy_version 1172104 (0.0011) [2023-12-26 08:56:59,584][123090] Updated weights for policy 1, policy_version 1163690 (0.0009) [2023-12-26 08:56:59,647][123090] Updated weights for policy 1, policy_version 1163700 (0.0008) [2023-12-26 08:56:59,709][123090] Updated weights for policy 1, policy_version 1163710 (0.0006) [2023-12-26 08:56:59,785][123091] Updated weights for policy 0, policy_version 1172114 (0.0011) [2023-12-26 08:56:59,856][123091] Updated weights for policy 0, policy_version 1172124 (0.0010) [2023-12-26 08:56:59,924][123091] Updated weights for policy 0, policy_version 1172134 (0.0010) [2023-12-26 08:57:00,000][123091] Updated weights for policy 0, policy_version 1172144 (0.0010) [2023-12-26 08:57:00,513][123090] Updated weights for policy 1, policy_version 1163720 (0.0009) [2023-12-26 08:57:00,579][123090] Updated weights for policy 1, policy_version 1163731 (0.0009) [2023-12-26 08:57:00,630][123090] Updated weights for policy 1, policy_version 1163741 (0.0009) [2023-12-26 08:57:00,796][123091] Updated weights for policy 0, policy_version 1172154 (0.0009) [2023-12-26 08:57:00,847][123091] Updated weights for policy 0, policy_version 1172164 (0.0009) [2023-12-26 08:57:00,905][123091] Updated weights for policy 0, policy_version 1172174 (0.0009) [2023-12-26 08:57:01,437][123090] Updated weights for policy 1, policy_version 1163751 (0.0006) [2023-12-26 08:57:01,503][123090] Updated weights for policy 1, policy_version 1163761 (0.0005) [2023-12-26 08:57:01,566][123090] Updated weights for policy 1, policy_version 1163771 (0.0010) [2023-12-26 08:57:01,703][123091] Updated weights for policy 0, policy_version 1172184 (0.0009) [2023-12-26 08:57:01,773][123091] Updated weights for policy 0, policy_version 1172194 (0.0010) [2023-12-26 08:57:01,835][123091] Updated weights for policy 0, policy_version 1172204 (0.0010) [2023-12-26 08:57:02,285][123090] Updated weights for policy 1, policy_version 1163781 (0.0010) [2023-12-26 08:57:02,337][123090] Updated weights for policy 1, policy_version 1163791 (0.0009) [2023-12-26 08:57:02,411][123090] Updated weights for policy 1, policy_version 1163801 (0.0010) [2023-12-26 08:57:02,593][123091] Updated weights for policy 0, policy_version 1172214 (0.0009) [2023-12-26 08:57:02,647][123091] Updated weights for policy 0, policy_version 1172224 (0.0009) [2023-12-26 08:57:02,699][123091] Updated weights for policy 0, policy_version 1172234 (0.0009) [2023-12-26 08:57:03,306][123090] Updated weights for policy 1, policy_version 1163811 (0.0008) [2023-12-26 08:57:03,309][123091] Updated weights for policy 0, policy_version 1172244 (0.0005) [2023-12-26 08:57:03,364][123091] Updated weights for policy 0, policy_version 1172254 (0.0007) [2023-12-26 08:57:03,367][123090] Updated weights for policy 1, policy_version 1163821 (0.0007) [2023-12-26 08:57:03,419][123090] Updated weights for policy 1, policy_version 1163831 (0.0008) [2023-12-26 08:57:03,420][123091] Updated weights for policy 0, policy_version 1172264 (0.0008) [2023-12-26 08:57:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 598048768. Throughput: 0: 9099.3, 1: 8863.1. Samples: 598056756. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:03,784][121949] Avg episode reward: [(0, '6086.549'), (1, '5031.670')] [2023-12-26 08:57:04,147][123091] Updated weights for policy 0, policy_version 1172274 (0.0007) [2023-12-26 08:57:04,212][123091] Updated weights for policy 0, policy_version 1172284 (0.0006) [2023-12-26 08:57:04,283][123091] Updated weights for policy 0, policy_version 1172294 (0.0011) [2023-12-26 08:57:04,302][123090] Updated weights for policy 1, policy_version 1163841 (0.0008) [2023-12-26 08:57:04,349][123091] Updated weights for policy 0, policy_version 1172304 (0.0010) [2023-12-26 08:57:04,369][123090] Updated weights for policy 1, policy_version 1163851 (0.0008) [2023-12-26 08:57:04,434][123090] Updated weights for policy 1, policy_version 1163861 (0.0009) [2023-12-26 08:57:04,497][123090] Updated weights for policy 1, policy_version 1163872 (0.0009) [2023-12-26 08:57:05,025][123091] Updated weights for policy 0, policy_version 1172314 (0.0010) [2023-12-26 08:57:05,079][123091] Updated weights for policy 0, policy_version 1172324 (0.0010) [2023-12-26 08:57:05,139][123091] Updated weights for policy 0, policy_version 1172334 (0.0010) [2023-12-26 08:57:05,295][123090] Updated weights for policy 1, policy_version 1163882 (0.0006) [2023-12-26 08:57:05,361][123090] Updated weights for policy 1, policy_version 1163892 (0.0007) [2023-12-26 08:57:05,432][123090] Updated weights for policy 1, policy_version 1163902 (0.0005) [2023-12-26 08:57:05,970][123091] Updated weights for policy 0, policy_version 1172344 (0.0011) [2023-12-26 08:57:05,989][123090] Updated weights for policy 1, policy_version 1163912 (0.0005) [2023-12-26 08:57:06,028][123091] Updated weights for policy 0, policy_version 1172354 (0.0010) [2023-12-26 08:57:06,035][123090] Updated weights for policy 1, policy_version 1163922 (0.0005) [2023-12-26 08:57:06,083][123090] Updated weights for policy 1, policy_version 1163932 (0.0006) [2023-12-26 08:57:06,098][123091] Updated weights for policy 0, policy_version 1172364 (0.0010) [2023-12-26 08:57:06,904][123091] Updated weights for policy 0, policy_version 1172374 (0.0008) [2023-12-26 08:57:06,933][123090] Updated weights for policy 1, policy_version 1163942 (0.0010) [2023-12-26 08:57:06,950][123091] Updated weights for policy 0, policy_version 1172384 (0.0007) [2023-12-26 08:57:07,000][123090] Updated weights for policy 1, policy_version 1163952 (0.0010) [2023-12-26 08:57:07,003][123091] Updated weights for policy 0, policy_version 1172394 (0.0006) [2023-12-26 08:57:07,076][123090] Updated weights for policy 1, policy_version 1163962 (0.0011) [2023-12-26 08:57:07,664][123091] Updated weights for policy 0, policy_version 1172404 (0.0006) [2023-12-26 08:57:07,737][123091] Updated weights for policy 0, policy_version 1172414 (0.0006) [2023-12-26 08:57:07,807][123090] Updated weights for policy 1, policy_version 1163972 (0.0009) [2023-12-26 08:57:07,812][123091] Updated weights for policy 0, policy_version 1172424 (0.0006) [2023-12-26 08:57:07,877][123090] Updated weights for policy 1, policy_version 1163982 (0.0006) [2023-12-26 08:57:07,947][123090] Updated weights for policy 1, policy_version 1163992 (0.0008) [2023-12-26 08:57:08,410][123091] Updated weights for policy 0, policy_version 1172434 (0.0007) [2023-12-26 08:57:08,479][123091] Updated weights for policy 0, policy_version 1172444 (0.0009) [2023-12-26 08:57:08,542][123091] Updated weights for policy 0, policy_version 1172454 (0.0009) [2023-12-26 08:57:08,604][123091] Updated weights for policy 0, policy_version 1172464 (0.0010) [2023-12-26 08:57:08,717][123090] Updated weights for policy 1, policy_version 1164002 (0.0010) [2023-12-26 08:57:08,771][123090] Updated weights for policy 1, policy_version 1164012 (0.0009) [2023-12-26 08:57:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 598138880. Throughput: 0: 9149.7, 1: 8902.7. Samples: 598112504. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:08,785][121949] Avg episode reward: [(0, '6097.425'), (1, '4854.929')] [2023-12-26 08:57:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001172464_300154880.pth... [2023-12-26 08:57:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001171408_299884544.pth [2023-12-26 08:57:08,841][123090] Updated weights for policy 1, policy_version 1164022 (0.0010) [2023-12-26 08:57:08,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001164032_297992192.pth... [2023-12-26 08:57:08,916][123090] Updated weights for policy 1, policy_version 1164032 (0.0010) [2023-12-26 08:57:08,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001163008_297730048.pth [2023-12-26 08:57:09,400][123091] Updated weights for policy 0, policy_version 1172474 (0.0008) [2023-12-26 08:57:09,462][123091] Updated weights for policy 0, policy_version 1172484 (0.0008) [2023-12-26 08:57:09,520][123091] Updated weights for policy 0, policy_version 1172494 (0.0009) [2023-12-26 08:57:09,762][123090] Updated weights for policy 1, policy_version 1164042 (0.0009) [2023-12-26 08:57:09,832][123090] Updated weights for policy 1, policy_version 1164052 (0.0006) [2023-12-26 08:57:09,898][123090] Updated weights for policy 1, policy_version 1164062 (0.0007) [2023-12-26 08:57:10,396][123091] Updated weights for policy 0, policy_version 1172504 (0.0009) [2023-12-26 08:57:10,451][123091] Updated weights for policy 0, policy_version 1172514 (0.0006) [2023-12-26 08:57:10,508][123091] Updated weights for policy 0, policy_version 1172524 (0.0006) [2023-12-26 08:57:10,703][123090] Updated weights for policy 1, policy_version 1164072 (0.0009) [2023-12-26 08:57:10,767][123090] Updated weights for policy 1, policy_version 1164082 (0.0010) [2023-12-26 08:57:10,829][123090] Updated weights for policy 1, policy_version 1164092 (0.0009) [2023-12-26 08:57:11,292][123091] Updated weights for policy 0, policy_version 1172534 (0.0010) [2023-12-26 08:57:11,361][123091] Updated weights for policy 0, policy_version 1172544 (0.0009) [2023-12-26 08:57:11,431][123091] Updated weights for policy 0, policy_version 1172554 (0.0008) [2023-12-26 08:57:11,713][123090] Updated weights for policy 1, policy_version 1164102 (0.0008) [2023-12-26 08:57:11,777][123090] Updated weights for policy 1, policy_version 1164112 (0.0009) [2023-12-26 08:57:11,832][123090] Updated weights for policy 1, policy_version 1164122 (0.0010) [2023-12-26 08:57:12,188][123091] Updated weights for policy 0, policy_version 1172564 (0.0009) [2023-12-26 08:57:12,250][123091] Updated weights for policy 0, policy_version 1172574 (0.0009) [2023-12-26 08:57:12,312][123091] Updated weights for policy 0, policy_version 1172584 (0.0010) [2023-12-26 08:57:12,743][123090] Updated weights for policy 1, policy_version 1164132 (0.0009) [2023-12-26 08:57:12,809][123090] Updated weights for policy 1, policy_version 1164142 (0.0009) [2023-12-26 08:57:12,875][123090] Updated weights for policy 1, policy_version 1164152 (0.0011) [2023-12-26 08:57:13,134][123091] Updated weights for policy 0, policy_version 1172594 (0.0008) [2023-12-26 08:57:13,197][123091] Updated weights for policy 0, policy_version 1172604 (0.0010) [2023-12-26 08:57:13,254][123091] Updated weights for policy 0, policy_version 1172614 (0.0010) [2023-12-26 08:57:13,309][123091] Updated weights for policy 0, policy_version 1172624 (0.0010) [2023-12-26 08:57:13,543][123090] Updated weights for policy 1, policy_version 1164162 (0.0011) [2023-12-26 08:57:13,605][123090] Updated weights for policy 1, policy_version 1164172 (0.0010) [2023-12-26 08:57:13,660][123090] Updated weights for policy 1, policy_version 1164182 (0.0010) [2023-12-26 08:57:13,711][123090] Updated weights for policy 1, policy_version 1164192 (0.0010) [2023-12-26 08:57:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 598228992. Throughput: 0: 9112.7, 1: 8837.6. Samples: 598218024. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:13,784][121949] Avg episode reward: [(0, '6079.752'), (1, '5196.950')] [2023-12-26 08:57:14,148][123091] Updated weights for policy 0, policy_version 1172634 (0.0007) [2023-12-26 08:57:14,199][123091] Updated weights for policy 0, policy_version 1172644 (0.0010) [2023-12-26 08:57:14,257][123091] Updated weights for policy 0, policy_version 1172654 (0.0010) [2023-12-26 08:57:14,542][123090] Updated weights for policy 1, policy_version 1164202 (0.0010) [2023-12-26 08:57:14,603][123090] Updated weights for policy 1, policy_version 1164212 (0.0010) [2023-12-26 08:57:14,652][123090] Updated weights for policy 1, policy_version 1164222 (0.0007) [2023-12-26 08:57:15,030][123091] Updated weights for policy 0, policy_version 1172664 (0.0010) [2023-12-26 08:57:15,086][123091] Updated weights for policy 0, policy_version 1172674 (0.0010) [2023-12-26 08:57:15,147][123091] Updated weights for policy 0, policy_version 1172684 (0.0010) [2023-12-26 08:57:15,442][123090] Updated weights for policy 1, policy_version 1164232 (0.0009) [2023-12-26 08:57:15,494][123090] Updated weights for policy 1, policy_version 1164242 (0.0009) [2023-12-26 08:57:15,549][123090] Updated weights for policy 1, policy_version 1164252 (0.0009) [2023-12-26 08:57:15,994][123091] Updated weights for policy 0, policy_version 1172694 (0.0008) [2023-12-26 08:57:16,052][123091] Updated weights for policy 0, policy_version 1172704 (0.0010) [2023-12-26 08:57:16,116][123091] Updated weights for policy 0, policy_version 1172714 (0.0009) [2023-12-26 08:57:16,391][123090] Updated weights for policy 1, policy_version 1164262 (0.0010) [2023-12-26 08:57:16,440][123090] Updated weights for policy 1, policy_version 1164272 (0.0009) [2023-12-26 08:57:16,489][123090] Updated weights for policy 1, policy_version 1164282 (0.0009) [2023-12-26 08:57:16,961][123091] Updated weights for policy 0, policy_version 1172724 (0.0009) [2023-12-26 08:57:17,011][123091] Updated weights for policy 0, policy_version 1172734 (0.0009) [2023-12-26 08:57:17,062][123091] Updated weights for policy 0, policy_version 1172744 (0.0010) [2023-12-26 08:57:17,327][123090] Updated weights for policy 1, policy_version 1164292 (0.0007) [2023-12-26 08:57:17,387][123090] Updated weights for policy 1, policy_version 1164302 (0.0008) [2023-12-26 08:57:17,447][123090] Updated weights for policy 1, policy_version 1164312 (0.0009) [2023-12-26 08:57:17,941][123091] Updated weights for policy 0, policy_version 1172755 (0.0010) [2023-12-26 08:57:18,002][123091] Updated weights for policy 0, policy_version 1172765 (0.0009) [2023-12-26 08:57:18,064][123091] Updated weights for policy 0, policy_version 1172775 (0.0009) [2023-12-26 08:57:18,263][123090] Updated weights for policy 1, policy_version 1164322 (0.0009) [2023-12-26 08:57:18,348][123090] Updated weights for policy 1, policy_version 1164332 (0.0010) [2023-12-26 08:57:18,416][123090] Updated weights for policy 1, policy_version 1164342 (0.0011) [2023-12-26 08:57:18,500][123090] Updated weights for policy 1, policy_version 1164352 (0.0010) [2023-12-26 08:57:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 598310912. Throughput: 0: 9065.6, 1: 8769.4. Samples: 598321940. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:18,784][121949] Avg episode reward: [(0, '6296.369'), (1, '5334.538')] [2023-12-26 08:57:18,946][123091] Updated weights for policy 0, policy_version 1172785 (0.0009) [2023-12-26 08:57:19,009][123091] Updated weights for policy 0, policy_version 1172795 (0.0009) [2023-12-26 08:57:19,078][123091] Updated weights for policy 0, policy_version 1172805 (0.0009) [2023-12-26 08:57:19,146][123091] Updated weights for policy 0, policy_version 1172815 (0.0008) [2023-12-26 08:57:19,290][123090] Updated weights for policy 1, policy_version 1164362 (0.0008) [2023-12-26 08:57:19,353][123090] Updated weights for policy 1, policy_version 1164372 (0.0009) [2023-12-26 08:57:19,423][123090] Updated weights for policy 1, policy_version 1164382 (0.0009) [2023-12-26 08:57:19,964][123091] Updated weights for policy 0, policy_version 1172825 (0.0010) [2023-12-26 08:57:20,025][123091] Updated weights for policy 0, policy_version 1172835 (0.0011) [2023-12-26 08:57:20,077][123091] Updated weights for policy 0, policy_version 1172845 (0.0010) [2023-12-26 08:57:20,292][123090] Updated weights for policy 1, policy_version 1164392 (0.0009) [2023-12-26 08:57:20,356][123090] Updated weights for policy 1, policy_version 1164402 (0.0008) [2023-12-26 08:57:20,413][123090] Updated weights for policy 1, policy_version 1164412 (0.0009) [2023-12-26 08:57:20,938][123091] Updated weights for policy 0, policy_version 1172855 (0.0011) [2023-12-26 08:57:20,991][123091] Updated weights for policy 0, policy_version 1172865 (0.0011) [2023-12-26 08:57:21,061][123091] Updated weights for policy 0, policy_version 1172875 (0.0011) [2023-12-26 08:57:21,293][123090] Updated weights for policy 1, policy_version 1164422 (0.0008) [2023-12-26 08:57:21,360][123090] Updated weights for policy 1, policy_version 1164432 (0.0009) [2023-12-26 08:57:21,425][123090] Updated weights for policy 1, policy_version 1164442 (0.0009) [2023-12-26 08:57:21,902][123091] Updated weights for policy 0, policy_version 1172885 (0.0008) [2023-12-26 08:57:21,963][123091] Updated weights for policy 0, policy_version 1172895 (0.0006) [2023-12-26 08:57:22,026][123091] Updated weights for policy 0, policy_version 1172905 (0.0006) [2023-12-26 08:57:22,283][123090] Updated weights for policy 1, policy_version 1164452 (0.0009) [2023-12-26 08:57:22,332][123090] Updated weights for policy 1, policy_version 1164462 (0.0009) [2023-12-26 08:57:22,396][123090] Updated weights for policy 1, policy_version 1164472 (0.0008) [2023-12-26 08:57:22,810][123091] Updated weights for policy 0, policy_version 1172915 (0.0009) [2023-12-26 08:57:22,876][123091] Updated weights for policy 0, policy_version 1172925 (0.0010) [2023-12-26 08:57:22,939][123091] Updated weights for policy 0, policy_version 1172935 (0.0010) [2023-12-26 08:57:23,254][123090] Updated weights for policy 1, policy_version 1164482 (0.0010) [2023-12-26 08:57:23,306][123090] Updated weights for policy 1, policy_version 1164492 (0.0009) [2023-12-26 08:57:23,361][123090] Updated weights for policy 1, policy_version 1164502 (0.0009) [2023-12-26 08:57:23,429][123090] Updated weights for policy 1, policy_version 1164512 (0.0010) [2023-12-26 08:57:23,702][123091] Updated weights for policy 0, policy_version 1172945 (0.0008) [2023-12-26 08:57:23,768][123091] Updated weights for policy 0, policy_version 1172955 (0.0005) [2023-12-26 08:57:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 598392832. Throughput: 0: 9012.0, 1: 8674.5. Samples: 598372104. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:23,785][121949] Avg episode reward: [(0, '6288.584'), (1, '5253.997')] [2023-12-26 08:57:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001164512_298115072.pth... [2023-12-26 08:57:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001163488_297852928.pth [2023-12-26 08:57:23,831][123091] Updated weights for policy 0, policy_version 1172965 (0.0009) [2023-12-26 08:57:23,891][123091] Updated weights for policy 0, policy_version 1172975 (0.0009) [2023-12-26 08:57:23,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001172976_300285952.pth... [2023-12-26 08:57:23,897][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001171920_300015616.pth [2023-12-26 08:57:24,297][123090] Updated weights for policy 1, policy_version 1164522 (0.0010) [2023-12-26 08:57:24,353][123090] Updated weights for policy 1, policy_version 1164532 (0.0009) [2023-12-26 08:57:24,409][123090] Updated weights for policy 1, policy_version 1164542 (0.0007) [2023-12-26 08:57:24,676][123091] Updated weights for policy 0, policy_version 1172985 (0.0009) [2023-12-26 08:57:24,733][123091] Updated weights for policy 0, policy_version 1172995 (0.0009) [2023-12-26 08:57:24,792][123091] Updated weights for policy 0, policy_version 1173005 (0.0009) [2023-12-26 08:57:25,229][123090] Updated weights for policy 1, policy_version 1164552 (0.0009) [2023-12-26 08:57:25,280][123090] Updated weights for policy 1, policy_version 1164562 (0.0009) [2023-12-26 08:57:25,336][123090] Updated weights for policy 1, policy_version 1164572 (0.0009) [2023-12-26 08:57:25,566][123091] Updated weights for policy 0, policy_version 1173015 (0.0008) [2023-12-26 08:57:25,620][123091] Updated weights for policy 0, policy_version 1173025 (0.0010) [2023-12-26 08:57:25,677][123091] Updated weights for policy 0, policy_version 1173035 (0.0010) [2023-12-26 08:57:26,136][123090] Updated weights for policy 1, policy_version 1164582 (0.0006) [2023-12-26 08:57:26,189][123090] Updated weights for policy 1, policy_version 1164592 (0.0009) [2023-12-26 08:57:26,237][123090] Updated weights for policy 1, policy_version 1164602 (0.0010) [2023-12-26 08:57:26,586][123091] Updated weights for policy 0, policy_version 1173045 (0.0009) [2023-12-26 08:57:26,641][123091] Updated weights for policy 0, policy_version 1173056 (0.0010) [2023-12-26 08:57:26,695][123091] Updated weights for policy 0, policy_version 1173067 (0.0010) [2023-12-26 08:57:26,974][123090] Updated weights for policy 1, policy_version 1164612 (0.0008) [2023-12-26 08:57:27,045][123090] Updated weights for policy 1, policy_version 1164622 (0.0005) [2023-12-26 08:57:27,108][123090] Updated weights for policy 1, policy_version 1164632 (0.0005) [2023-12-26 08:57:27,638][123091] Updated weights for policy 0, policy_version 1173078 (0.0009) [2023-12-26 08:57:27,710][123091] Updated weights for policy 0, policy_version 1173089 (0.0010) [2023-12-26 08:57:27,739][123090] Updated weights for policy 1, policy_version 1164642 (0.0006) [2023-12-26 08:57:27,766][123091] Updated weights for policy 0, policy_version 1173099 (0.0009) [2023-12-26 08:57:27,790][123090] Updated weights for policy 1, policy_version 1164652 (0.0007) [2023-12-26 08:57:27,842][123090] Updated weights for policy 1, policy_version 1164662 (0.0009) [2023-12-26 08:57:27,906][123090] Updated weights for policy 1, policy_version 1164672 (0.0008) [2023-12-26 08:57:28,551][123091] Updated weights for policy 0, policy_version 1173109 (0.0008) [2023-12-26 08:57:28,612][123091] Updated weights for policy 0, policy_version 1173119 (0.0008) [2023-12-26 08:57:28,675][123091] Updated weights for policy 0, policy_version 1173129 (0.0009) [2023-12-26 08:57:28,696][123090] Updated weights for policy 1, policy_version 1164682 (0.0010) [2023-12-26 08:57:28,759][123090] Updated weights for policy 1, policy_version 1164692 (0.0011) [2023-12-26 08:57:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 598482944. Throughput: 0: 8925.2, 1: 8719.4. Samples: 598477580. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:28,785][121949] Avg episode reward: [(0, '6301.402'), (1, '5301.286')] [2023-12-26 08:57:28,828][123090] Updated weights for policy 1, policy_version 1164702 (0.0011) [2023-12-26 08:57:29,561][123090] Updated weights for policy 1, policy_version 1164712 (0.0010) [2023-12-26 08:57:29,581][123091] Updated weights for policy 0, policy_version 1173139 (0.0007) [2023-12-26 08:57:29,628][123090] Updated weights for policy 1, policy_version 1164722 (0.0010) [2023-12-26 08:57:29,647][123091] Updated weights for policy 0, policy_version 1173149 (0.0006) [2023-12-26 08:57:29,687][123090] Updated weights for policy 1, policy_version 1164732 (0.0010) [2023-12-26 08:57:29,710][123091] Updated weights for policy 0, policy_version 1173159 (0.0005) [2023-12-26 08:57:30,434][123090] Updated weights for policy 1, policy_version 1164742 (0.0007) [2023-12-26 08:57:30,503][123090] Updated weights for policy 1, policy_version 1164752 (0.0005) [2023-12-26 08:57:30,565][123091] Updated weights for policy 0, policy_version 1173169 (0.0010) [2023-12-26 08:57:30,570][123090] Updated weights for policy 1, policy_version 1164762 (0.0006) [2023-12-26 08:57:30,628][123091] Updated weights for policy 0, policy_version 1173179 (0.0009) [2023-12-26 08:57:30,690][123091] Updated weights for policy 0, policy_version 1173189 (0.0009) [2023-12-26 08:57:30,755][123091] Updated weights for policy 0, policy_version 1173199 (0.0009) [2023-12-26 08:57:31,229][123090] Updated weights for policy 1, policy_version 1164772 (0.0008) [2023-12-26 08:57:31,293][123090] Updated weights for policy 1, policy_version 1164782 (0.0007) [2023-12-26 08:57:31,359][123090] Updated weights for policy 1, policy_version 1164792 (0.0010) [2023-12-26 08:57:31,611][123091] Updated weights for policy 0, policy_version 1173209 (0.0006) [2023-12-26 08:57:31,676][123091] Updated weights for policy 0, policy_version 1173219 (0.0008) [2023-12-26 08:57:31,743][123091] Updated weights for policy 0, policy_version 1173229 (0.0009) [2023-12-26 08:57:32,139][123090] Updated weights for policy 1, policy_version 1164802 (0.0008) [2023-12-26 08:57:32,187][123090] Updated weights for policy 1, policy_version 1164812 (0.0009) [2023-12-26 08:57:32,240][123090] Updated weights for policy 1, policy_version 1164822 (0.0008) [2023-12-26 08:57:32,301][123090] Updated weights for policy 1, policy_version 1164832 (0.0009) [2023-12-26 08:57:32,593][123091] Updated weights for policy 0, policy_version 1173239 (0.0007) [2023-12-26 08:57:32,648][123091] Updated weights for policy 0, policy_version 1173249 (0.0005) [2023-12-26 08:57:32,708][123091] Updated weights for policy 0, policy_version 1173259 (0.0005) [2023-12-26 08:57:33,118][123090] Updated weights for policy 1, policy_version 1164842 (0.0005) [2023-12-26 08:57:33,163][123090] Updated weights for policy 1, policy_version 1164852 (0.0005) [2023-12-26 08:57:33,213][123090] Updated weights for policy 1, policy_version 1164862 (0.0005) [2023-12-26 08:57:33,504][123091] Updated weights for policy 0, policy_version 1173269 (0.0008) [2023-12-26 08:57:33,557][123091] Updated weights for policy 0, policy_version 1173280 (0.0010) [2023-12-26 08:57:33,619][123091] Updated weights for policy 0, policy_version 1173291 (0.0010) [2023-12-26 08:57:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 598573056. Throughput: 0: 8741.8, 1: 8844.8. Samples: 598583008. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:33,786][121949] Avg episode reward: [(0, '6305.804'), (1, '5368.215')] [2023-12-26 08:57:33,959][123090] Updated weights for policy 1, policy_version 1164873 (0.0009) [2023-12-26 08:57:34,011][123090] Updated weights for policy 1, policy_version 1164883 (0.0009) [2023-12-26 08:57:34,081][123090] Updated weights for policy 1, policy_version 1164893 (0.0010) [2023-12-26 08:57:34,515][123091] Updated weights for policy 0, policy_version 1173301 (0.0010) [2023-12-26 08:57:34,583][123091] Updated weights for policy 0, policy_version 1173311 (0.0009) [2023-12-26 08:57:34,645][123091] Updated weights for policy 0, policy_version 1173321 (0.0010) [2023-12-26 08:57:34,844][123090] Updated weights for policy 1, policy_version 1164903 (0.0010) [2023-12-26 08:57:34,893][123090] Updated weights for policy 1, policy_version 1164913 (0.0009) [2023-12-26 08:57:34,945][123090] Updated weights for policy 1, policy_version 1164923 (0.0009) [2023-12-26 08:57:35,451][123091] Updated weights for policy 0, policy_version 1173331 (0.0009) [2023-12-26 08:57:35,504][123091] Updated weights for policy 0, policy_version 1173341 (0.0005) [2023-12-26 08:57:35,573][123091] Updated weights for policy 0, policy_version 1173351 (0.0005) [2023-12-26 08:57:35,801][123090] Updated weights for policy 1, policy_version 1164933 (0.0007) [2023-12-26 08:57:35,868][123090] Updated weights for policy 1, policy_version 1164943 (0.0006) [2023-12-26 08:57:35,936][123090] Updated weights for policy 1, policy_version 1164953 (0.0005) [2023-12-26 08:57:36,173][123091] Updated weights for policy 0, policy_version 1173361 (0.0006) [2023-12-26 08:57:36,226][123091] Updated weights for policy 0, policy_version 1173371 (0.0010) [2023-12-26 08:57:36,279][123091] Updated weights for policy 0, policy_version 1173381 (0.0010) [2023-12-26 08:57:36,328][123091] Updated weights for policy 0, policy_version 1173391 (0.0009) [2023-12-26 08:57:36,598][123090] Updated weights for policy 1, policy_version 1164963 (0.0007) [2023-12-26 08:57:36,665][123090] Updated weights for policy 1, policy_version 1164973 (0.0010) [2023-12-26 08:57:36,731][123090] Updated weights for policy 1, policy_version 1164983 (0.0009) [2023-12-26 08:57:37,212][123091] Updated weights for policy 0, policy_version 1173401 (0.0009) [2023-12-26 08:57:37,278][123091] Updated weights for policy 0, policy_version 1173411 (0.0009) [2023-12-26 08:57:37,342][123091] Updated weights for policy 0, policy_version 1173421 (0.0009) [2023-12-26 08:57:37,539][123090] Updated weights for policy 1, policy_version 1164993 (0.0009) [2023-12-26 08:57:37,593][123090] Updated weights for policy 1, policy_version 1165003 (0.0010) [2023-12-26 08:57:37,651][123090] Updated weights for policy 1, policy_version 1165013 (0.0009) [2023-12-26 08:57:37,711][123090] Updated weights for policy 1, policy_version 1165023 (0.0010) [2023-12-26 08:57:38,159][123091] Updated weights for policy 0, policy_version 1173431 (0.0009) [2023-12-26 08:57:38,211][123091] Updated weights for policy 0, policy_version 1173441 (0.0010) [2023-12-26 08:57:38,264][123091] Updated weights for policy 0, policy_version 1173451 (0.0009) [2023-12-26 08:57:38,537][123090] Updated weights for policy 1, policy_version 1165033 (0.0006) [2023-12-26 08:57:38,608][123090] Updated weights for policy 1, policy_version 1165043 (0.0008) [2023-12-26 08:57:38,658][123090] Updated weights for policy 1, policy_version 1165053 (0.0009) [2023-12-26 08:57:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 598663168. Throughput: 0: 8767.7, 1: 8872.2. Samples: 598637036. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:38,785][121949] Avg episode reward: [(0, '6331.219'), (1, '5250.267')] [2023-12-26 08:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001165056_298254336.pth... [2023-12-26 08:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001173456_300408832.pth... [2023-12-26 08:57:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001164032_297992192.pth [2023-12-26 08:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001172464_300154880.pth [2023-12-26 08:57:39,153][123091] Updated weights for policy 0, policy_version 1173461 (0.0009) [2023-12-26 08:57:39,219][123091] Updated weights for policy 0, policy_version 1173471 (0.0010) [2023-12-26 08:57:39,282][123091] Updated weights for policy 0, policy_version 1173481 (0.0009) [2023-12-26 08:57:39,462][123090] Updated weights for policy 1, policy_version 1165063 (0.0009) [2023-12-26 08:57:39,526][123090] Updated weights for policy 1, policy_version 1165073 (0.0009) [2023-12-26 08:57:39,591][123090] Updated weights for policy 1, policy_version 1165083 (0.0006) [2023-12-26 08:57:40,119][123091] Updated weights for policy 0, policy_version 1173491 (0.0010) [2023-12-26 08:57:40,182][123091] Updated weights for policy 0, policy_version 1173501 (0.0008) [2023-12-26 08:57:40,238][123091] Updated weights for policy 0, policy_version 1173511 (0.0008) [2023-12-26 08:57:40,465][123090] Updated weights for policy 1, policy_version 1165093 (0.0008) [2023-12-26 08:57:40,532][123090] Updated weights for policy 1, policy_version 1165103 (0.0005) [2023-12-26 08:57:40,595][123090] Updated weights for policy 1, policy_version 1165113 (0.0006) [2023-12-26 08:57:41,125][123091] Updated weights for policy 0, policy_version 1173521 (0.0009) [2023-12-26 08:57:41,200][123091] Updated weights for policy 0, policy_version 1173531 (0.0009) [2023-12-26 08:57:41,257][123091] Updated weights for policy 0, policy_version 1173541 (0.0010) [2023-12-26 08:57:41,306][123090] Updated weights for policy 1, policy_version 1165123 (0.0007) [2023-12-26 08:57:41,313][123091] Updated weights for policy 0, policy_version 1173551 (0.0009) [2023-12-26 08:57:41,367][123090] Updated weights for policy 1, policy_version 1165133 (0.0009) [2023-12-26 08:57:41,445][123090] Updated weights for policy 1, policy_version 1165143 (0.0009) [2023-12-26 08:57:42,214][123090] Updated weights for policy 1, policy_version 1165153 (0.0008) [2023-12-26 08:57:42,226][123091] Updated weights for policy 0, policy_version 1173561 (0.0009) [2023-12-26 08:57:42,278][123090] Updated weights for policy 1, policy_version 1165163 (0.0008) [2023-12-26 08:57:42,289][123091] Updated weights for policy 0, policy_version 1173571 (0.0010) [2023-12-26 08:57:42,351][123090] Updated weights for policy 1, policy_version 1165173 (0.0009) [2023-12-26 08:57:42,358][123091] Updated weights for policy 0, policy_version 1173581 (0.0007) [2023-12-26 08:57:42,420][123090] Updated weights for policy 1, policy_version 1165183 (0.0009) [2023-12-26 08:57:43,139][123091] Updated weights for policy 0, policy_version 1173591 (0.0007) [2023-12-26 08:57:43,189][123091] Updated weights for policy 0, policy_version 1173601 (0.0010) [2023-12-26 08:57:43,238][123090] Updated weights for policy 1, policy_version 1165193 (0.0007) [2023-12-26 08:57:43,245][123091] Updated weights for policy 0, policy_version 1173611 (0.0009) [2023-12-26 08:57:43,292][123090] Updated weights for policy 1, policy_version 1165203 (0.0007) [2023-12-26 08:57:43,341][123090] Updated weights for policy 1, policy_version 1165213 (0.0009) [2023-12-26 08:57:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 598745088. Throughput: 0: 8662.4, 1: 8774.9. Samples: 598738236. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:43,785][121949] Avg episode reward: [(0, '6326.433'), (1, '5271.934')] [2023-12-26 08:57:44,027][123091] Updated weights for policy 0, policy_version 1173621 (0.0010) [2023-12-26 08:57:44,081][123091] Updated weights for policy 0, policy_version 1173631 (0.0010) [2023-12-26 08:57:44,136][123091] Updated weights for policy 0, policy_version 1173641 (0.0010) [2023-12-26 08:57:44,214][123090] Updated weights for policy 1, policy_version 1165223 (0.0009) [2023-12-26 08:57:44,276][123090] Updated weights for policy 1, policy_version 1165233 (0.0009) [2023-12-26 08:57:44,330][123090] Updated weights for policy 1, policy_version 1165243 (0.0010) [2023-12-26 08:57:44,856][123091] Updated weights for policy 0, policy_version 1173651 (0.0009) [2023-12-26 08:57:44,922][123091] Updated weights for policy 0, policy_version 1173661 (0.0007) [2023-12-26 08:57:44,995][123091] Updated weights for policy 0, policy_version 1173671 (0.0008) [2023-12-26 08:57:45,243][123090] Updated weights for policy 1, policy_version 1165253 (0.0008) [2023-12-26 08:57:45,323][123090] Updated weights for policy 1, policy_version 1165263 (0.0006) [2023-12-26 08:57:45,399][123090] Updated weights for policy 1, policy_version 1165273 (0.0006) [2023-12-26 08:57:45,677][123091] Updated weights for policy 0, policy_version 1173681 (0.0008) [2023-12-26 08:57:45,731][123091] Updated weights for policy 0, policy_version 1173691 (0.0005) [2023-12-26 08:57:45,782][123091] Updated weights for policy 0, policy_version 1173701 (0.0006) [2023-12-26 08:57:45,842][123091] Updated weights for policy 0, policy_version 1173711 (0.0005) [2023-12-26 08:57:46,043][123090] Updated weights for policy 1, policy_version 1165283 (0.0005) [2023-12-26 08:57:46,112][123090] Updated weights for policy 1, policy_version 1165293 (0.0005) [2023-12-26 08:57:46,159][123090] Updated weights for policy 1, policy_version 1165303 (0.0005) [2023-12-26 08:57:46,511][123091] Updated weights for policy 0, policy_version 1173721 (0.0006) [2023-12-26 08:57:46,560][123091] Updated weights for policy 0, policy_version 1173731 (0.0005) [2023-12-26 08:57:46,614][123091] Updated weights for policy 0, policy_version 1173741 (0.0009) [2023-12-26 08:57:46,898][123090] Updated weights for policy 1, policy_version 1165313 (0.0006) [2023-12-26 08:57:46,951][123090] Updated weights for policy 1, policy_version 1165323 (0.0010) [2023-12-26 08:57:47,011][123090] Updated weights for policy 1, policy_version 1165333 (0.0009) [2023-12-26 08:57:47,065][123090] Updated weights for policy 1, policy_version 1165344 (0.0010) [2023-12-26 08:57:47,166][123091] Updated weights for policy 0, policy_version 1173751 (0.0007) [2023-12-26 08:57:47,217][123091] Updated weights for policy 0, policy_version 1173761 (0.0005) [2023-12-26 08:57:47,287][123091] Updated weights for policy 0, policy_version 1173771 (0.0006) [2023-12-26 08:57:47,856][123090] Updated weights for policy 1, policy_version 1165354 (0.0006) [2023-12-26 08:57:47,935][123090] Updated weights for policy 1, policy_version 1165364 (0.0005) [2023-12-26 08:57:47,952][123091] Updated weights for policy 0, policy_version 1173781 (0.0005) [2023-12-26 08:57:48,002][123090] Updated weights for policy 1, policy_version 1165374 (0.0006) [2023-12-26 08:57:48,006][123091] Updated weights for policy 0, policy_version 1173791 (0.0006) [2023-12-26 08:57:48,054][123091] Updated weights for policy 0, policy_version 1173801 (0.0006) [2023-12-26 08:57:48,636][123090] Updated weights for policy 1, policy_version 1165384 (0.0005) [2023-12-26 08:57:48,709][123090] Updated weights for policy 1, policy_version 1165394 (0.0006) [2023-12-26 08:57:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 598835200. Throughput: 0: 8828.9, 1: 8866.0. Samples: 598853028. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:48,785][121949] Avg episode reward: [(0, '6176.859'), (1, '5401.424')] [2023-12-26 08:57:48,789][123090] Updated weights for policy 1, policy_version 1165404 (0.0010) [2023-12-26 08:57:48,852][123091] Updated weights for policy 0, policy_version 1173811 (0.0007) [2023-12-26 08:57:48,913][123091] Updated weights for policy 0, policy_version 1173821 (0.0011) [2023-12-26 08:57:48,980][123091] Updated weights for policy 0, policy_version 1173831 (0.0009) [2023-12-26 08:57:49,589][123090] Updated weights for policy 1, policy_version 1165414 (0.0008) [2023-12-26 08:57:49,654][123090] Updated weights for policy 1, policy_version 1165424 (0.0009) [2023-12-26 08:57:49,715][123090] Updated weights for policy 1, policy_version 1165434 (0.0009) [2023-12-26 08:57:49,835][123091] Updated weights for policy 0, policy_version 1173841 (0.0010) [2023-12-26 08:57:49,910][123091] Updated weights for policy 0, policy_version 1173851 (0.0011) [2023-12-26 08:57:49,976][123091] Updated weights for policy 0, policy_version 1173861 (0.0010) [2023-12-26 08:57:50,040][123091] Updated weights for policy 0, policy_version 1173871 (0.0009) [2023-12-26 08:57:50,542][123090] Updated weights for policy 1, policy_version 1165444 (0.0009) [2023-12-26 08:57:50,606][123090] Updated weights for policy 1, policy_version 1165454 (0.0008) [2023-12-26 08:57:50,669][123090] Updated weights for policy 1, policy_version 1165464 (0.0009) [2023-12-26 08:57:50,882][123091] Updated weights for policy 0, policy_version 1173881 (0.0008) [2023-12-26 08:57:50,949][123091] Updated weights for policy 0, policy_version 1173891 (0.0008) [2023-12-26 08:57:51,025][123091] Updated weights for policy 0, policy_version 1173901 (0.0006) [2023-12-26 08:57:51,578][123090] Updated weights for policy 1, policy_version 1165474 (0.0008) [2023-12-26 08:57:51,643][123090] Updated weights for policy 1, policy_version 1165484 (0.0009) [2023-12-26 08:57:51,714][123090] Updated weights for policy 1, policy_version 1165494 (0.0009) [2023-12-26 08:57:51,786][123090] Updated weights for policy 1, policy_version 1165504 (0.0009) [2023-12-26 08:57:51,816][123091] Updated weights for policy 0, policy_version 1173911 (0.0008) [2023-12-26 08:57:51,884][123091] Updated weights for policy 0, policy_version 1173921 (0.0008) [2023-12-26 08:57:51,936][123091] Updated weights for policy 0, policy_version 1173931 (0.0008) [2023-12-26 08:57:52,581][123090] Updated weights for policy 1, policy_version 1165514 (0.0009) [2023-12-26 08:57:52,637][123090] Updated weights for policy 1, policy_version 1165524 (0.0009) [2023-12-26 08:57:52,694][123090] Updated weights for policy 1, policy_version 1165534 (0.0010) [2023-12-26 08:57:52,750][123091] Updated weights for policy 0, policy_version 1173941 (0.0009) [2023-12-26 08:57:52,823][123091] Updated weights for policy 0, policy_version 1173951 (0.0008) [2023-12-26 08:57:52,889][123091] Updated weights for policy 0, policy_version 1173961 (0.0010) [2023-12-26 08:57:53,525][123090] Updated weights for policy 1, policy_version 1165544 (0.0006) [2023-12-26 08:57:53,583][123090] Updated weights for policy 1, policy_version 1165554 (0.0005) [2023-12-26 08:57:53,638][123090] Updated weights for policy 1, policy_version 1165564 (0.0005) [2023-12-26 08:57:53,661][123091] Updated weights for policy 0, policy_version 1173971 (0.0008) [2023-12-26 08:57:53,715][123091] Updated weights for policy 0, policy_version 1173981 (0.0005) [2023-12-26 08:57:53,774][123091] Updated weights for policy 0, policy_version 1173991 (0.0005) [2023-12-26 08:57:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 598925312. Throughput: 0: 8760.1, 1: 8798.0. Samples: 598902616. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:53,785][121949] Avg episode reward: [(0, '6202.522'), (1, '5231.606')] [2023-12-26 08:57:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001165568_298385408.pth... [2023-12-26 08:57:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001164512_298115072.pth [2023-12-26 08:57:53,825][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001174000_300548096.pth... [2023-12-26 08:57:53,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001172976_300285952.pth [2023-12-26 08:57:54,422][123090] Updated weights for policy 1, policy_version 1165574 (0.0008) [2023-12-26 08:57:54,455][123091] Updated weights for policy 0, policy_version 1174001 (0.0006) [2023-12-26 08:57:54,480][123090] Updated weights for policy 1, policy_version 1165584 (0.0009) [2023-12-26 08:57:54,510][123091] Updated weights for policy 0, policy_version 1174011 (0.0007) [2023-12-26 08:57:54,535][123090] Updated weights for policy 1, policy_version 1165594 (0.0009) [2023-12-26 08:57:54,562][123091] Updated weights for policy 0, policy_version 1174021 (0.0009) [2023-12-26 08:57:54,616][123091] Updated weights for policy 0, policy_version 1174031 (0.0009) [2023-12-26 08:57:55,359][123090] Updated weights for policy 1, policy_version 1165604 (0.0006) [2023-12-26 08:57:55,428][123090] Updated weights for policy 1, policy_version 1165614 (0.0007) [2023-12-26 08:57:55,473][123091] Updated weights for policy 0, policy_version 1174041 (0.0007) [2023-12-26 08:57:55,492][123090] Updated weights for policy 1, policy_version 1165624 (0.0007) [2023-12-26 08:57:55,536][123091] Updated weights for policy 0, policy_version 1174051 (0.0008) [2023-12-26 08:57:55,596][123091] Updated weights for policy 0, policy_version 1174061 (0.0008) [2023-12-26 08:57:56,145][123090] Updated weights for policy 1, policy_version 1165634 (0.0007) [2023-12-26 08:57:56,201][123090] Updated weights for policy 1, policy_version 1165644 (0.0007) [2023-12-26 08:57:56,255][123090] Updated weights for policy 1, policy_version 1165656 (0.0010) [2023-12-26 08:57:56,304][123091] Updated weights for policy 0, policy_version 1174071 (0.0007) [2023-12-26 08:57:56,368][123091] Updated weights for policy 0, policy_version 1174081 (0.0006) [2023-12-26 08:57:56,422][123091] Updated weights for policy 0, policy_version 1174091 (0.0005) [2023-12-26 08:57:57,139][123091] Updated weights for policy 0, policy_version 1174101 (0.0007) [2023-12-26 08:57:57,160][123090] Updated weights for policy 1, policy_version 1165666 (0.0009) [2023-12-26 08:57:57,189][123091] Updated weights for policy 0, policy_version 1174111 (0.0009) [2023-12-26 08:57:57,210][123090] Updated weights for policy 1, policy_version 1165676 (0.0009) [2023-12-26 08:57:57,254][123091] Updated weights for policy 0, policy_version 1174121 (0.0005) [2023-12-26 08:57:57,258][123090] Updated weights for policy 1, policy_version 1165686 (0.0009) [2023-12-26 08:57:57,319][123090] Updated weights for policy 1, policy_version 1165696 (0.0007) [2023-12-26 08:57:57,963][123091] Updated weights for policy 0, policy_version 1174131 (0.0008) [2023-12-26 08:57:58,022][123091] Updated weights for policy 0, policy_version 1174141 (0.0007) [2023-12-26 08:57:58,091][123091] Updated weights for policy 0, policy_version 1174151 (0.0010) [2023-12-26 08:57:58,188][123090] Updated weights for policy 1, policy_version 1165706 (0.0007) [2023-12-26 08:57:58,258][123090] Updated weights for policy 1, policy_version 1165716 (0.0007) [2023-12-26 08:57:58,321][123090] Updated weights for policy 1, policy_version 1165726 (0.0008) [2023-12-26 08:57:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 599015424. Throughput: 0: 8773.6, 1: 8845.4. Samples: 599010880. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:57:58,784][121949] Avg episode reward: [(0, '6216.877'), (1, '5319.188')] [2023-12-26 08:57:58,961][123091] Updated weights for policy 0, policy_version 1174161 (0.0011) [2023-12-26 08:57:59,033][123091] Updated weights for policy 0, policy_version 1174171 (0.0011) [2023-12-26 08:57:59,094][123091] Updated weights for policy 0, policy_version 1174181 (0.0007) [2023-12-26 08:57:59,155][123091] Updated weights for policy 0, policy_version 1174191 (0.0007) [2023-12-26 08:57:59,187][123090] Updated weights for policy 1, policy_version 1165736 (0.0010) [2023-12-26 08:57:59,248][123090] Updated weights for policy 1, policy_version 1165746 (0.0010) [2023-12-26 08:57:59,307][123090] Updated weights for policy 1, policy_version 1165756 (0.0010) [2023-12-26 08:57:59,974][123091] Updated weights for policy 0, policy_version 1174201 (0.0010) [2023-12-26 08:58:00,040][123091] Updated weights for policy 0, policy_version 1174211 (0.0008) [2023-12-26 08:58:00,078][123090] Updated weights for policy 1, policy_version 1165766 (0.0007) [2023-12-26 08:58:00,109][123091] Updated weights for policy 0, policy_version 1174221 (0.0010) [2023-12-26 08:58:00,129][123090] Updated weights for policy 1, policy_version 1165776 (0.0006) [2023-12-26 08:58:00,187][123090] Updated weights for policy 1, policy_version 1165786 (0.0010) [2023-12-26 08:58:00,884][123091] Updated weights for policy 0, policy_version 1174231 (0.0006) [2023-12-26 08:58:00,938][123091] Updated weights for policy 0, policy_version 1174241 (0.0005) [2023-12-26 08:58:00,961][123090] Updated weights for policy 1, policy_version 1165796 (0.0010) [2023-12-26 08:58:00,989][123091] Updated weights for policy 0, policy_version 1174251 (0.0005) [2023-12-26 08:58:01,012][123090] Updated weights for policy 1, policy_version 1165806 (0.0009) [2023-12-26 08:58:01,074][123090] Updated weights for policy 1, policy_version 1165816 (0.0008) [2023-12-26 08:58:01,753][123091] Updated weights for policy 0, policy_version 1174261 (0.0007) [2023-12-26 08:58:01,814][123091] Updated weights for policy 0, policy_version 1174271 (0.0009) [2023-12-26 08:58:01,878][123091] Updated weights for policy 0, policy_version 1174281 (0.0009) [2023-12-26 08:58:01,911][123090] Updated weights for policy 1, policy_version 1165826 (0.0009) [2023-12-26 08:58:01,978][123090] Updated weights for policy 1, policy_version 1165836 (0.0010) [2023-12-26 08:58:02,045][123090] Updated weights for policy 1, policy_version 1165846 (0.0011) [2023-12-26 08:58:02,141][123090] Updated weights for policy 1, policy_version 1165856 (0.0010) [2023-12-26 08:58:02,660][123091] Updated weights for policy 0, policy_version 1174291 (0.0006) [2023-12-26 08:58:02,709][123091] Updated weights for policy 0, policy_version 1174301 (0.0005) [2023-12-26 08:58:02,774][123091] Updated weights for policy 0, policy_version 1174311 (0.0005) [2023-12-26 08:58:02,898][123090] Updated weights for policy 1, policy_version 1165866 (0.0005) [2023-12-26 08:58:02,943][123090] Updated weights for policy 1, policy_version 1165876 (0.0005) [2023-12-26 08:58:02,991][123090] Updated weights for policy 1, policy_version 1165886 (0.0005) [2023-12-26 08:58:03,414][123091] Updated weights for policy 0, policy_version 1174321 (0.0005) [2023-12-26 08:58:03,479][123091] Updated weights for policy 0, policy_version 1174331 (0.0005) [2023-12-26 08:58:03,540][123091] Updated weights for policy 0, policy_version 1174341 (0.0008) [2023-12-26 08:58:03,602][123091] Updated weights for policy 0, policy_version 1174351 (0.0010) [2023-12-26 08:58:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 599105536. Throughput: 0: 8845.2, 1: 8843.1. Samples: 599117916. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:03,785][121949] Avg episode reward: [(0, '6149.745'), (1, '5463.934')] [2023-12-26 08:58:03,814][123090] Updated weights for policy 1, policy_version 1165896 (0.0008) [2023-12-26 08:58:03,876][123090] Updated weights for policy 1, policy_version 1165906 (0.0009) [2023-12-26 08:58:03,937][123090] Updated weights for policy 1, policy_version 1165916 (0.0009) [2023-12-26 08:58:04,427][123091] Updated weights for policy 0, policy_version 1174361 (0.0010) [2023-12-26 08:58:04,493][123091] Updated weights for policy 0, policy_version 1174371 (0.0009) [2023-12-26 08:58:04,555][123091] Updated weights for policy 0, policy_version 1174381 (0.0008) [2023-12-26 08:58:04,644][123090] Updated weights for policy 1, policy_version 1165926 (0.0007) [2023-12-26 08:58:04,711][123090] Updated weights for policy 1, policy_version 1165936 (0.0005) [2023-12-26 08:58:04,771][123090] Updated weights for policy 1, policy_version 1165946 (0.0007) [2023-12-26 08:58:05,360][123091] Updated weights for policy 0, policy_version 1174391 (0.0009) [2023-12-26 08:58:05,411][123091] Updated weights for policy 0, policy_version 1174401 (0.0010) [2023-12-26 08:58:05,429][123090] Updated weights for policy 1, policy_version 1165956 (0.0007) [2023-12-26 08:58:05,473][123091] Updated weights for policy 0, policy_version 1174411 (0.0010) [2023-12-26 08:58:05,488][123090] Updated weights for policy 1, policy_version 1165966 (0.0005) [2023-12-26 08:58:05,543][123090] Updated weights for policy 1, policy_version 1165976 (0.0008) [2023-12-26 08:58:06,303][123091] Updated weights for policy 0, policy_version 1174421 (0.0011) [2023-12-26 08:58:06,366][123091] Updated weights for policy 0, policy_version 1174431 (0.0011) [2023-12-26 08:58:06,391][123090] Updated weights for policy 1, policy_version 1165986 (0.0008) [2023-12-26 08:58:06,422][123091] Updated weights for policy 0, policy_version 1174441 (0.0011) [2023-12-26 08:58:06,454][123090] Updated weights for policy 1, policy_version 1165996 (0.0006) [2023-12-26 08:58:06,519][123090] Updated weights for policy 1, policy_version 1166006 (0.0009) [2023-12-26 08:58:06,581][123090] Updated weights for policy 1, policy_version 1166016 (0.0009) [2023-12-26 08:58:07,191][123091] Updated weights for policy 0, policy_version 1174451 (0.0010) [2023-12-26 08:58:07,260][123091] Updated weights for policy 0, policy_version 1174461 (0.0010) [2023-12-26 08:58:07,319][123091] Updated weights for policy 0, policy_version 1174471 (0.0010) [2023-12-26 08:58:07,392][123090] Updated weights for policy 1, policy_version 1166026 (0.0008) [2023-12-26 08:58:07,448][123090] Updated weights for policy 1, policy_version 1166036 (0.0006) [2023-12-26 08:58:07,506][123090] Updated weights for policy 1, policy_version 1166046 (0.0006) [2023-12-26 08:58:08,001][123091] Updated weights for policy 0, policy_version 1174481 (0.0010) [2023-12-26 08:58:08,080][123091] Updated weights for policy 0, policy_version 1174491 (0.0007) [2023-12-26 08:58:08,148][123090] Updated weights for policy 1, policy_version 1166056 (0.0006) [2023-12-26 08:58:08,152][123091] Updated weights for policy 0, policy_version 1174501 (0.0009) [2023-12-26 08:58:08,197][123090] Updated weights for policy 1, policy_version 1166066 (0.0006) [2023-12-26 08:58:08,215][123091] Updated weights for policy 0, policy_version 1174511 (0.0009) [2023-12-26 08:58:08,257][123090] Updated weights for policy 1, policy_version 1166076 (0.0009) [2023-12-26 08:58:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 599195648. Throughput: 0: 8851.0, 1: 8900.3. Samples: 599170912. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:08,785][121949] Avg episode reward: [(0, '6311.221'), (1, '5579.987')] [2023-12-26 08:58:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001174512_300679168.pth... [2023-12-26 08:58:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001166080_298516480.pth... [2023-12-26 08:58:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001173456_300408832.pth [2023-12-26 08:58:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001165056_298254336.pth [2023-12-26 08:58:08,898][123091] Updated weights for policy 0, policy_version 1174521 (0.0010) [2023-12-26 08:58:08,957][123091] Updated weights for policy 0, policy_version 1174531 (0.0011) [2023-12-26 08:58:09,012][123091] Updated weights for policy 0, policy_version 1174541 (0.0010) [2023-12-26 08:58:09,133][123090] Updated weights for policy 1, policy_version 1166086 (0.0009) [2023-12-26 08:58:09,199][123090] Updated weights for policy 1, policy_version 1166096 (0.0007) [2023-12-26 08:58:09,275][123090] Updated weights for policy 1, policy_version 1166106 (0.0009) [2023-12-26 08:58:09,782][123091] Updated weights for policy 0, policy_version 1174551 (0.0008) [2023-12-26 08:58:09,851][123091] Updated weights for policy 0, policy_version 1174561 (0.0010) [2023-12-26 08:58:09,912][123091] Updated weights for policy 0, policy_version 1174571 (0.0010) [2023-12-26 08:58:10,124][123090] Updated weights for policy 1, policy_version 1166116 (0.0010) [2023-12-26 08:58:10,196][123090] Updated weights for policy 1, policy_version 1166126 (0.0009) [2023-12-26 08:58:10,261][123090] Updated weights for policy 1, policy_version 1166136 (0.0010) [2023-12-26 08:58:10,770][123091] Updated weights for policy 0, policy_version 1174581 (0.0008) [2023-12-26 08:58:10,840][123091] Updated weights for policy 0, policy_version 1174591 (0.0006) [2023-12-26 08:58:10,913][123091] Updated weights for policy 0, policy_version 1174601 (0.0010) [2023-12-26 08:58:11,072][123090] Updated weights for policy 1, policy_version 1166146 (0.0009) [2023-12-26 08:58:11,134][123090] Updated weights for policy 1, policy_version 1166156 (0.0009) [2023-12-26 08:58:11,207][123090] Updated weights for policy 1, policy_version 1166166 (0.0010) [2023-12-26 08:58:11,270][123090] Updated weights for policy 1, policy_version 1166176 (0.0008) [2023-12-26 08:58:11,754][123091] Updated weights for policy 0, policy_version 1174611 (0.0009) [2023-12-26 08:58:11,817][123091] Updated weights for policy 0, policy_version 1174621 (0.0009) [2023-12-26 08:58:11,881][123091] Updated weights for policy 0, policy_version 1174631 (0.0010) [2023-12-26 08:58:12,147][123090] Updated weights for policy 1, policy_version 1166186 (0.0009) [2023-12-26 08:58:12,210][123090] Updated weights for policy 1, policy_version 1166196 (0.0009) [2023-12-26 08:58:12,272][123090] Updated weights for policy 1, policy_version 1166206 (0.0009) [2023-12-26 08:58:12,725][123091] Updated weights for policy 0, policy_version 1174641 (0.0009) [2023-12-26 08:58:12,779][123091] Updated weights for policy 0, policy_version 1174651 (0.0009) [2023-12-26 08:58:12,834][123091] Updated weights for policy 0, policy_version 1174661 (0.0009) [2023-12-26 08:58:12,894][123091] Updated weights for policy 0, policy_version 1174671 (0.0009) [2023-12-26 08:58:13,061][123090] Updated weights for policy 1, policy_version 1166216 (0.0007) [2023-12-26 08:58:13,120][123090] Updated weights for policy 1, policy_version 1166226 (0.0005) [2023-12-26 08:58:13,177][123090] Updated weights for policy 1, policy_version 1166236 (0.0005) [2023-12-26 08:58:13,605][123091] Updated weights for policy 0, policy_version 1174681 (0.0005) [2023-12-26 08:58:13,664][123091] Updated weights for policy 0, policy_version 1174691 (0.0005) [2023-12-26 08:58:13,712][123091] Updated weights for policy 0, policy_version 1174701 (0.0005) [2023-12-26 08:58:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 599285760. Throughput: 0: 8898.4, 1: 8848.1. Samples: 599276172. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:13,785][121949] Avg episode reward: [(0, '6375.136'), (1, '5750.230')] [2023-12-26 08:58:13,853][123090] Updated weights for policy 1, policy_version 1166246 (0.0005) [2023-12-26 08:58:13,914][123090] Updated weights for policy 1, policy_version 1166256 (0.0005) [2023-12-26 08:58:13,977][123090] Updated weights for policy 1, policy_version 1166266 (0.0007) [2023-12-26 08:58:14,459][123091] Updated weights for policy 0, policy_version 1174711 (0.0008) [2023-12-26 08:58:14,517][123091] Updated weights for policy 0, policy_version 1174721 (0.0009) [2023-12-26 08:58:14,577][123091] Updated weights for policy 0, policy_version 1174731 (0.0009) [2023-12-26 08:58:14,706][123090] Updated weights for policy 1, policy_version 1166276 (0.0006) [2023-12-26 08:58:14,771][123090] Updated weights for policy 1, policy_version 1166286 (0.0007) [2023-12-26 08:58:14,839][123090] Updated weights for policy 1, policy_version 1166296 (0.0009) [2023-12-26 08:58:15,413][123091] Updated weights for policy 0, policy_version 1174741 (0.0010) [2023-12-26 08:58:15,476][123091] Updated weights for policy 0, policy_version 1174751 (0.0008) [2023-12-26 08:58:15,537][123091] Updated weights for policy 0, policy_version 1174761 (0.0009) [2023-12-26 08:58:15,604][123090] Updated weights for policy 1, policy_version 1166306 (0.0007) [2023-12-26 08:58:15,661][123090] Updated weights for policy 1, policy_version 1166316 (0.0009) [2023-12-26 08:58:15,718][123090] Updated weights for policy 1, policy_version 1166326 (0.0009) [2023-12-26 08:58:15,781][123090] Updated weights for policy 1, policy_version 1166336 (0.0010) [2023-12-26 08:58:16,320][123091] Updated weights for policy 0, policy_version 1174771 (0.0008) [2023-12-26 08:58:16,366][123091] Updated weights for policy 0, policy_version 1174781 (0.0005) [2023-12-26 08:58:16,425][123091] Updated weights for policy 0, policy_version 1174791 (0.0005) [2023-12-26 08:58:16,633][123090] Updated weights for policy 1, policy_version 1166346 (0.0006) [2023-12-26 08:58:16,694][123090] Updated weights for policy 1, policy_version 1166356 (0.0005) [2023-12-26 08:58:16,745][123090] Updated weights for policy 1, policy_version 1166366 (0.0009) [2023-12-26 08:58:17,226][123091] Updated weights for policy 0, policy_version 1174801 (0.0006) [2023-12-26 08:58:17,282][123091] Updated weights for policy 0, policy_version 1174812 (0.0010) [2023-12-26 08:58:17,330][123091] Updated weights for policy 0, policy_version 1174822 (0.0009) [2023-12-26 08:58:17,379][123091] Updated weights for policy 0, policy_version 1174832 (0.0010) [2023-12-26 08:58:17,574][123090] Updated weights for policy 1, policy_version 1166376 (0.0009) [2023-12-26 08:58:17,626][123090] Updated weights for policy 1, policy_version 1166386 (0.0008) [2023-12-26 08:58:17,688][123090] Updated weights for policy 1, policy_version 1166396 (0.0009) [2023-12-26 08:58:18,242][123091] Updated weights for policy 0, policy_version 1174842 (0.0006) [2023-12-26 08:58:18,311][123091] Updated weights for policy 0, policy_version 1174852 (0.0008) [2023-12-26 08:58:18,380][123091] Updated weights for policy 0, policy_version 1174862 (0.0009) [2023-12-26 08:58:18,553][123090] Updated weights for policy 1, policy_version 1166406 (0.0009) [2023-12-26 08:58:18,612][123090] Updated weights for policy 1, policy_version 1166416 (0.0009) [2023-12-26 08:58:18,671][123090] Updated weights for policy 1, policy_version 1166426 (0.0009) [2023-12-26 08:58:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 599375872. Throughput: 0: 8987.3, 1: 8816.1. Samples: 599384152. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:18,784][121949] Avg episode reward: [(0, '6264.792'), (1, '5798.231')] [2023-12-26 08:58:19,186][123091] Updated weights for policy 0, policy_version 1174872 (0.0010) [2023-12-26 08:58:19,248][123091] Updated weights for policy 0, policy_version 1174882 (0.0010) [2023-12-26 08:58:19,318][123091] Updated weights for policy 0, policy_version 1174892 (0.0010) [2023-12-26 08:58:19,531][123090] Updated weights for policy 1, policy_version 1166436 (0.0010) [2023-12-26 08:58:19,602][123090] Updated weights for policy 1, policy_version 1166446 (0.0010) [2023-12-26 08:58:19,673][123090] Updated weights for policy 1, policy_version 1166456 (0.0009) [2023-12-26 08:58:20,210][123091] Updated weights for policy 0, policy_version 1174902 (0.0011) [2023-12-26 08:58:20,276][123091] Updated weights for policy 0, policy_version 1174912 (0.0007) [2023-12-26 08:58:20,348][123091] Updated weights for policy 0, policy_version 1174922 (0.0007) [2023-12-26 08:58:20,487][123090] Updated weights for policy 1, policy_version 1166466 (0.0010) [2023-12-26 08:58:20,551][123090] Updated weights for policy 1, policy_version 1166476 (0.0008) [2023-12-26 08:58:20,631][123090] Updated weights for policy 1, policy_version 1166486 (0.0008) [2023-12-26 08:58:20,703][123090] Updated weights for policy 1, policy_version 1166496 (0.0008) [2023-12-26 08:58:21,195][123091] Updated weights for policy 0, policy_version 1174932 (0.0007) [2023-12-26 08:58:21,254][123091] Updated weights for policy 0, policy_version 1174942 (0.0008) [2023-12-26 08:58:21,316][123091] Updated weights for policy 0, policy_version 1174952 (0.0010) [2023-12-26 08:58:21,477][123090] Updated weights for policy 1, policy_version 1166506 (0.0005) [2023-12-26 08:58:21,528][123090] Updated weights for policy 1, policy_version 1166516 (0.0010) [2023-12-26 08:58:21,581][123090] Updated weights for policy 1, policy_version 1166526 (0.0010) [2023-12-26 08:58:22,212][123091] Updated weights for policy 0, policy_version 1174962 (0.0009) [2023-12-26 08:58:22,274][123091] Updated weights for policy 0, policy_version 1174972 (0.0010) [2023-12-26 08:58:22,341][123091] Updated weights for policy 0, policy_version 1174982 (0.0009) [2023-12-26 08:58:22,413][123091] Updated weights for policy 0, policy_version 1174992 (0.0009) [2023-12-26 08:58:22,434][123090] Updated weights for policy 1, policy_version 1166536 (0.0011) [2023-12-26 08:58:22,495][123090] Updated weights for policy 1, policy_version 1166546 (0.0009) [2023-12-26 08:58:22,558][123090] Updated weights for policy 1, policy_version 1166556 (0.0008) [2023-12-26 08:58:23,282][123091] Updated weights for policy 0, policy_version 1175002 (0.0010) [2023-12-26 08:58:23,340][123090] Updated weights for policy 1, policy_version 1166566 (0.0007) [2023-12-26 08:58:23,343][123091] Updated weights for policy 0, policy_version 1175012 (0.0009) [2023-12-26 08:58:23,395][123090] Updated weights for policy 1, policy_version 1166576 (0.0008) [2023-12-26 08:58:23,401][123091] Updated weights for policy 0, policy_version 1175022 (0.0007) [2023-12-26 08:58:23,444][123090] Updated weights for policy 1, policy_version 1166586 (0.0005) [2023-12-26 08:58:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 599457792. Throughput: 0: 8928.0, 1: 8766.4. Samples: 599433292. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:23,785][121949] Avg episode reward: [(0, '6226.084'), (1, '5745.538')] [2023-12-26 08:58:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001175024_300810240.pth... [2023-12-26 08:58:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001166592_298647552.pth... [2023-12-26 08:58:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001174000_300548096.pth [2023-12-26 08:58:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001165568_298385408.pth [2023-12-26 08:58:24,192][123091] Updated weights for policy 0, policy_version 1175033 (0.0010) [2023-12-26 08:58:24,236][123090] Updated weights for policy 1, policy_version 1166596 (0.0007) [2023-12-26 08:58:24,242][123091] Updated weights for policy 0, policy_version 1175043 (0.0010) [2023-12-26 08:58:24,289][123091] Updated weights for policy 0, policy_version 1175054 (0.0009) [2023-12-26 08:58:24,307][123090] Updated weights for policy 1, policy_version 1166606 (0.0006) [2023-12-26 08:58:24,365][123090] Updated weights for policy 1, policy_version 1166616 (0.0007) [2023-12-26 08:58:25,010][123091] Updated weights for policy 0, policy_version 1175064 (0.0006) [2023-12-26 08:58:25,064][123091] Updated weights for policy 0, policy_version 1175074 (0.0006) [2023-12-26 08:58:25,092][123090] Updated weights for policy 1, policy_version 1166626 (0.0005) [2023-12-26 08:58:25,112][123091] Updated weights for policy 0, policy_version 1175084 (0.0005) [2023-12-26 08:58:25,155][123090] Updated weights for policy 1, policy_version 1166636 (0.0005) [2023-12-26 08:58:25,212][123090] Updated weights for policy 1, policy_version 1166646 (0.0005) [2023-12-26 08:58:25,277][123090] Updated weights for policy 1, policy_version 1166656 (0.0005) [2023-12-26 08:58:25,715][123091] Updated weights for policy 0, policy_version 1175094 (0.0005) [2023-12-26 08:58:25,765][123091] Updated weights for policy 0, policy_version 1175104 (0.0005) [2023-12-26 08:58:25,819][123091] Updated weights for policy 0, policy_version 1175114 (0.0005) [2023-12-26 08:58:25,928][123090] Updated weights for policy 1, policy_version 1166666 (0.0007) [2023-12-26 08:58:25,981][123090] Updated weights for policy 1, policy_version 1166676 (0.0010) [2023-12-26 08:58:26,035][123090] Updated weights for policy 1, policy_version 1166686 (0.0010) [2023-12-26 08:58:26,444][123091] Updated weights for policy 0, policy_version 1175124 (0.0005) [2023-12-26 08:58:26,488][123091] Updated weights for policy 0, policy_version 1175134 (0.0005) [2023-12-26 08:58:26,540][123091] Updated weights for policy 0, policy_version 1175144 (0.0005) [2023-12-26 08:58:26,730][123090] Updated weights for policy 1, policy_version 1166697 (0.0006) [2023-12-26 08:58:26,776][123090] Updated weights for policy 1, policy_version 1166707 (0.0005) [2023-12-26 08:58:26,831][123090] Updated weights for policy 1, policy_version 1166717 (0.0005) [2023-12-26 08:58:27,234][123091] Updated weights for policy 0, policy_version 1175154 (0.0005) [2023-12-26 08:58:27,291][123091] Updated weights for policy 0, policy_version 1175164 (0.0006) [2023-12-26 08:58:27,354][123091] Updated weights for policy 0, policy_version 1175174 (0.0006) [2023-12-26 08:58:27,504][123090] Updated weights for policy 1, policy_version 1166727 (0.0005) [2023-12-26 08:58:27,568][123090] Updated weights for policy 1, policy_version 1166737 (0.0005) [2023-12-26 08:58:27,643][123090] Updated weights for policy 1, policy_version 1166747 (0.0005) [2023-12-26 08:58:28,100][123091] Updated weights for policy 0, policy_version 1175185 (0.0009) [2023-12-26 08:58:28,160][123091] Updated weights for policy 0, policy_version 1175195 (0.0005) [2023-12-26 08:58:28,229][123091] Updated weights for policy 0, policy_version 1175205 (0.0005) [2023-12-26 08:58:28,258][123090] Updated weights for policy 1, policy_version 1166757 (0.0005) [2023-12-26 08:58:28,300][123091] Updated weights for policy 0, policy_version 1175215 (0.0005) [2023-12-26 08:58:28,306][123090] Updated weights for policy 1, policy_version 1166767 (0.0008) [2023-12-26 08:58:28,369][123090] Updated weights for policy 1, policy_version 1166777 (0.0009) [2023-12-26 08:58:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 599556096. Throughput: 0: 9091.1, 1: 8895.1. Samples: 599547608. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:28,784][121949] Avg episode reward: [(0, '6105.711'), (1, '5639.627')] [2023-12-26 08:58:28,981][123091] Updated weights for policy 0, policy_version 1175225 (0.0005) [2023-12-26 08:58:29,053][123091] Updated weights for policy 0, policy_version 1175235 (0.0005) [2023-12-26 08:58:29,116][123091] Updated weights for policy 0, policy_version 1175245 (0.0005) [2023-12-26 08:58:29,156][123090] Updated weights for policy 1, policy_version 1166787 (0.0008) [2023-12-26 08:58:29,224][123090] Updated weights for policy 1, policy_version 1166797 (0.0006) [2023-12-26 08:58:29,294][123090] Updated weights for policy 1, policy_version 1166807 (0.0009) [2023-12-26 08:58:29,805][123091] Updated weights for policy 0, policy_version 1175255 (0.0006) [2023-12-26 08:58:29,871][123091] Updated weights for policy 0, policy_version 1175265 (0.0008) [2023-12-26 08:58:29,948][123091] Updated weights for policy 0, policy_version 1175275 (0.0007) [2023-12-26 08:58:30,153][123090] Updated weights for policy 1, policy_version 1166817 (0.0010) [2023-12-26 08:58:30,224][123090] Updated weights for policy 1, policy_version 1166827 (0.0006) [2023-12-26 08:58:30,286][123090] Updated weights for policy 1, policy_version 1166837 (0.0008) [2023-12-26 08:58:30,353][123090] Updated weights for policy 1, policy_version 1166847 (0.0006) [2023-12-26 08:58:30,699][123091] Updated weights for policy 0, policy_version 1175285 (0.0008) [2023-12-26 08:58:30,750][123091] Updated weights for policy 0, policy_version 1175296 (0.0010) [2023-12-26 08:58:30,804][123091] Updated weights for policy 0, policy_version 1175307 (0.0009) [2023-12-26 08:58:30,939][123090] Updated weights for policy 1, policy_version 1166857 (0.0009) [2023-12-26 08:58:30,995][123090] Updated weights for policy 1, policy_version 1166867 (0.0008) [2023-12-26 08:58:31,054][123090] Updated weights for policy 1, policy_version 1166877 (0.0010) [2023-12-26 08:58:31,566][123091] Updated weights for policy 0, policy_version 1175317 (0.0009) [2023-12-26 08:58:31,631][123091] Updated weights for policy 0, policy_version 1175327 (0.0009) [2023-12-26 08:58:31,686][123091] Updated weights for policy 0, policy_version 1175337 (0.0009) [2023-12-26 08:58:31,934][123090] Updated weights for policy 1, policy_version 1166887 (0.0010) [2023-12-26 08:58:31,997][123090] Updated weights for policy 1, policy_version 1166897 (0.0010) [2023-12-26 08:58:32,055][123090] Updated weights for policy 1, policy_version 1166907 (0.0007) [2023-12-26 08:58:32,382][123091] Updated weights for policy 0, policy_version 1175347 (0.0009) [2023-12-26 08:58:32,448][123091] Updated weights for policy 0, policy_version 1175357 (0.0010) [2023-12-26 08:58:32,498][123091] Updated weights for policy 0, policy_version 1175367 (0.0009) [2023-12-26 08:58:32,881][123090] Updated weights for policy 1, policy_version 1166917 (0.0009) [2023-12-26 08:58:32,948][123090] Updated weights for policy 1, policy_version 1166927 (0.0009) [2023-12-26 08:58:33,012][123090] Updated weights for policy 1, policy_version 1166937 (0.0009) [2023-12-26 08:58:33,302][123091] Updated weights for policy 0, policy_version 1175377 (0.0009) [2023-12-26 08:58:33,351][123091] Updated weights for policy 0, policy_version 1175387 (0.0005) [2023-12-26 08:58:33,406][123091] Updated weights for policy 0, policy_version 1175397 (0.0005) [2023-12-26 08:58:33,465][123091] Updated weights for policy 0, policy_version 1175407 (0.0005) [2023-12-26 08:58:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 599646208. Throughput: 0: 9039.5, 1: 8868.0. Samples: 599658868. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:33,785][121949] Avg episode reward: [(0, '5982.788'), (1, '5535.186')] [2023-12-26 08:58:33,829][123090] Updated weights for policy 1, policy_version 1166947 (0.0008) [2023-12-26 08:58:33,886][123090] Updated weights for policy 1, policy_version 1166957 (0.0009) [2023-12-26 08:58:33,933][123090] Updated weights for policy 1, policy_version 1166967 (0.0010) [2023-12-26 08:58:34,156][123091] Updated weights for policy 0, policy_version 1175417 (0.0009) [2023-12-26 08:58:34,231][123091] Updated weights for policy 0, policy_version 1175427 (0.0008) [2023-12-26 08:58:34,293][123091] Updated weights for policy 0, policy_version 1175437 (0.0009) [2023-12-26 08:58:34,747][123090] Updated weights for policy 1, policy_version 1166977 (0.0010) [2023-12-26 08:58:34,821][123090] Updated weights for policy 1, policy_version 1166987 (0.0008) [2023-12-26 08:58:34,884][123090] Updated weights for policy 1, policy_version 1166997 (0.0009) [2023-12-26 08:58:34,946][123090] Updated weights for policy 1, policy_version 1167007 (0.0009) [2023-12-26 08:58:35,041][123091] Updated weights for policy 0, policy_version 1175447 (0.0010) [2023-12-26 08:58:35,089][123091] Updated weights for policy 0, policy_version 1175457 (0.0009) [2023-12-26 08:58:35,146][123091] Updated weights for policy 0, policy_version 1175467 (0.0009) [2023-12-26 08:58:35,739][123090] Updated weights for policy 1, policy_version 1167017 (0.0009) [2023-12-26 08:58:35,803][123090] Updated weights for policy 1, policy_version 1167027 (0.0009) [2023-12-26 08:58:35,851][123090] Updated weights for policy 1, policy_version 1167037 (0.0009) [2023-12-26 08:58:35,900][123091] Updated weights for policy 0, policy_version 1175477 (0.0010) [2023-12-26 08:58:35,969][123091] Updated weights for policy 0, policy_version 1175487 (0.0010) [2023-12-26 08:58:36,038][123091] Updated weights for policy 0, policy_version 1175497 (0.0011) [2023-12-26 08:58:36,711][123090] Updated weights for policy 1, policy_version 1167047 (0.0010) [2023-12-26 08:58:36,759][123090] Updated weights for policy 1, policy_version 1167057 (0.0009) [2023-12-26 08:58:36,824][123090] Updated weights for policy 1, policy_version 1167067 (0.0010) [2023-12-26 08:58:36,834][123091] Updated weights for policy 0, policy_version 1175507 (0.0009) [2023-12-26 08:58:36,893][123091] Updated weights for policy 0, policy_version 1175517 (0.0009) [2023-12-26 08:58:36,947][123091] Updated weights for policy 0, policy_version 1175527 (0.0009) [2023-12-26 08:58:37,648][123091] Updated weights for policy 0, policy_version 1175537 (0.0006) [2023-12-26 08:58:37,709][123090] Updated weights for policy 1, policy_version 1167077 (0.0009) [2023-12-26 08:58:37,712][123091] Updated weights for policy 0, policy_version 1175547 (0.0009) [2023-12-26 08:58:37,763][123090] Updated weights for policy 1, policy_version 1167087 (0.0007) [2023-12-26 08:58:37,777][123091] Updated weights for policy 0, policy_version 1175557 (0.0010) [2023-12-26 08:58:37,824][123090] Updated weights for policy 1, policy_version 1167097 (0.0007) [2023-12-26 08:58:37,839][123091] Updated weights for policy 0, policy_version 1175567 (0.0010) [2023-12-26 08:58:38,667][123091] Updated weights for policy 0, policy_version 1175577 (0.0008) [2023-12-26 08:58:38,669][123090] Updated weights for policy 1, policy_version 1167107 (0.0008) [2023-12-26 08:58:38,716][123091] Updated weights for policy 0, policy_version 1175587 (0.0007) [2023-12-26 08:58:38,726][123090] Updated weights for policy 1, policy_version 1167117 (0.0009) [2023-12-26 08:58:38,779][123091] Updated weights for policy 0, policy_version 1175597 (0.0008) [2023-12-26 08:58:38,781][123090] Updated weights for policy 1, policy_version 1167127 (0.0008) [2023-12-26 08:58:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 599728128. Throughput: 0: 9098.8, 1: 8903.5. Samples: 599712716. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:38,785][121949] Avg episode reward: [(0, '6128.929'), (1, '5607.502')] [2023-12-26 08:58:38,799][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001175600_300957696.pth... [2023-12-26 08:58:38,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001174512_300679168.pth [2023-12-26 08:58:38,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001167136_298786816.pth... [2023-12-26 08:58:38,849][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001166080_298516480.pth [2023-12-26 08:58:39,583][123090] Updated weights for policy 1, policy_version 1167137 (0.0006) [2023-12-26 08:58:39,646][123091] Updated weights for policy 0, policy_version 1175607 (0.0009) [2023-12-26 08:58:39,648][123090] Updated weights for policy 1, policy_version 1167147 (0.0008) [2023-12-26 08:58:39,709][123091] Updated weights for policy 0, policy_version 1175617 (0.0010) [2023-12-26 08:58:39,709][123090] Updated weights for policy 1, policy_version 1167157 (0.0009) [2023-12-26 08:58:39,773][123091] Updated weights for policy 0, policy_version 1175627 (0.0006) [2023-12-26 08:58:39,774][123090] Updated weights for policy 1, policy_version 1167167 (0.0010) [2023-12-26 08:58:40,509][123091] Updated weights for policy 0, policy_version 1175637 (0.0008) [2023-12-26 08:58:40,568][123091] Updated weights for policy 0, policy_version 1175647 (0.0009) [2023-12-26 08:58:40,624][123091] Updated weights for policy 0, policy_version 1175657 (0.0010) [2023-12-26 08:58:40,649][123090] Updated weights for policy 1, policy_version 1167177 (0.0009) [2023-12-26 08:58:40,709][123090] Updated weights for policy 1, policy_version 1167187 (0.0009) [2023-12-26 08:58:40,769][123090] Updated weights for policy 1, policy_version 1167197 (0.0010) [2023-12-26 08:58:41,464][123091] Updated weights for policy 0, policy_version 1175667 (0.0009) [2023-12-26 08:58:41,524][123091] Updated weights for policy 0, policy_version 1175677 (0.0010) [2023-12-26 08:58:41,580][123091] Updated weights for policy 0, policy_version 1175687 (0.0008) [2023-12-26 08:58:41,639][123090] Updated weights for policy 1, policy_version 1167207 (0.0008) [2023-12-26 08:58:41,708][123090] Updated weights for policy 1, policy_version 1167217 (0.0008) [2023-12-26 08:58:41,778][123090] Updated weights for policy 1, policy_version 1167227 (0.0009) [2023-12-26 08:58:42,400][123091] Updated weights for policy 0, policy_version 1175697 (0.0010) [2023-12-26 08:58:42,465][123091] Updated weights for policy 0, policy_version 1175707 (0.0009) [2023-12-26 08:58:42,520][123091] Updated weights for policy 0, policy_version 1175717 (0.0010) [2023-12-26 08:58:42,581][123091] Updated weights for policy 0, policy_version 1175727 (0.0010) [2023-12-26 08:58:42,633][123090] Updated weights for policy 1, policy_version 1167237 (0.0010) [2023-12-26 08:58:42,698][123090] Updated weights for policy 1, policy_version 1167247 (0.0010) [2023-12-26 08:58:42,767][123090] Updated weights for policy 1, policy_version 1167257 (0.0009) [2023-12-26 08:58:43,361][123091] Updated weights for policy 0, policy_version 1175737 (0.0007) [2023-12-26 08:58:43,409][123091] Updated weights for policy 0, policy_version 1175747 (0.0006) [2023-12-26 08:58:43,456][123091] Updated weights for policy 0, policy_version 1175757 (0.0005) [2023-12-26 08:58:43,610][123090] Updated weights for policy 1, policy_version 1167267 (0.0008) [2023-12-26 08:58:43,661][123090] Updated weights for policy 1, policy_version 1167277 (0.0005) [2023-12-26 08:58:43,710][123090] Updated weights for policy 1, policy_version 1167287 (0.0005) [2023-12-26 08:58:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 599826432. Throughput: 0: 9025.0, 1: 8838.7. Samples: 599814752. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:43,785][121949] Avg episode reward: [(0, '6216.940'), (1, '5698.295')] [2023-12-26 08:58:44,102][123091] Updated weights for policy 0, policy_version 1175767 (0.0008) [2023-12-26 08:58:44,166][123091] Updated weights for policy 0, policy_version 1175777 (0.0009) [2023-12-26 08:58:44,230][123091] Updated weights for policy 0, policy_version 1175787 (0.0010) [2023-12-26 08:58:44,471][123090] Updated weights for policy 1, policy_version 1167297 (0.0006) [2023-12-26 08:58:44,535][123090] Updated weights for policy 1, policy_version 1167307 (0.0009) [2023-12-26 08:58:44,605][123090] Updated weights for policy 1, policy_version 1167317 (0.0009) [2023-12-26 08:58:44,663][123090] Updated weights for policy 1, policy_version 1167327 (0.0010) [2023-12-26 08:58:45,008][123091] Updated weights for policy 0, policy_version 1175797 (0.0007) [2023-12-26 08:58:45,069][123091] Updated weights for policy 0, policy_version 1175807 (0.0006) [2023-12-26 08:58:45,123][123091] Updated weights for policy 0, policy_version 1175817 (0.0007) [2023-12-26 08:58:45,390][123090] Updated weights for policy 1, policy_version 1167337 (0.0006) [2023-12-26 08:58:45,442][123090] Updated weights for policy 1, policy_version 1167347 (0.0005) [2023-12-26 08:58:45,499][123090] Updated weights for policy 1, policy_version 1167357 (0.0008) [2023-12-26 08:58:45,906][123091] Updated weights for policy 0, policy_version 1175827 (0.0007) [2023-12-26 08:58:45,966][123091] Updated weights for policy 0, policy_version 1175837 (0.0005) [2023-12-26 08:58:46,021][123091] Updated weights for policy 0, policy_version 1175847 (0.0005) [2023-12-26 08:58:46,346][123090] Updated weights for policy 1, policy_version 1167367 (0.0009) [2023-12-26 08:58:46,399][123090] Updated weights for policy 1, policy_version 1167377 (0.0009) [2023-12-26 08:58:46,449][123090] Updated weights for policy 1, policy_version 1167388 (0.0009) [2023-12-26 08:58:46,665][123091] Updated weights for policy 0, policy_version 1175857 (0.0006) [2023-12-26 08:58:46,717][123091] Updated weights for policy 0, policy_version 1175867 (0.0009) [2023-12-26 08:58:46,765][123091] Updated weights for policy 0, policy_version 1175877 (0.0006) [2023-12-26 08:58:46,813][123091] Updated weights for policy 0, policy_version 1175887 (0.0010) [2023-12-26 08:58:47,338][123090] Updated weights for policy 1, policy_version 1167398 (0.0009) [2023-12-26 08:58:47,387][123090] Updated weights for policy 1, policy_version 1167408 (0.0009) [2023-12-26 08:58:47,436][123090] Updated weights for policy 1, policy_version 1167418 (0.0009) [2023-12-26 08:58:47,601][123091] Updated weights for policy 0, policy_version 1175897 (0.0006) [2023-12-26 08:58:47,648][123091] Updated weights for policy 0, policy_version 1175907 (0.0005) [2023-12-26 08:58:47,694][123091] Updated weights for policy 0, policy_version 1175917 (0.0005) [2023-12-26 08:58:48,271][123090] Updated weights for policy 1, policy_version 1167428 (0.0007) [2023-12-26 08:58:48,362][123090] Updated weights for policy 1, policy_version 1167438 (0.0006) [2023-12-26 08:58:48,376][123091] Updated weights for policy 0, policy_version 1175927 (0.0008) [2023-12-26 08:58:48,432][123090] Updated weights for policy 1, policy_version 1167448 (0.0008) [2023-12-26 08:58:48,444][123091] Updated weights for policy 0, policy_version 1175937 (0.0008) [2023-12-26 08:58:48,508][123091] Updated weights for policy 0, policy_version 1175947 (0.0010) [2023-12-26 08:58:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 599916544. Throughput: 0: 9100.0, 1: 8832.2. Samples: 599924864. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:48,785][121949] Avg episode reward: [(0, '6133.966'), (1, '5584.874')] [2023-12-26 08:58:49,095][123090] Updated weights for policy 1, policy_version 1167458 (0.0008) [2023-12-26 08:58:49,152][123090] Updated weights for policy 1, policy_version 1167468 (0.0006) [2023-12-26 08:58:49,219][123090] Updated weights for policy 1, policy_version 1167478 (0.0007) [2023-12-26 08:58:49,288][123090] Updated weights for policy 1, policy_version 1167488 (0.0008) [2023-12-26 08:58:49,307][123091] Updated weights for policy 0, policy_version 1175957 (0.0009) [2023-12-26 08:58:49,379][123091] Updated weights for policy 0, policy_version 1175967 (0.0009) [2023-12-26 08:58:49,441][123091] Updated weights for policy 0, policy_version 1175977 (0.0010) [2023-12-26 08:58:50,009][123090] Updated weights for policy 1, policy_version 1167498 (0.0006) [2023-12-26 08:58:50,063][123090] Updated weights for policy 1, policy_version 1167508 (0.0006) [2023-12-26 08:58:50,144][123090] Updated weights for policy 1, policy_version 1167518 (0.0008) [2023-12-26 08:58:50,270][123091] Updated weights for policy 0, policy_version 1175987 (0.0009) [2023-12-26 08:58:50,322][123091] Updated weights for policy 0, policy_version 1175997 (0.0010) [2023-12-26 08:58:50,377][123091] Updated weights for policy 0, policy_version 1176007 (0.0009) [2023-12-26 08:58:50,908][123090] Updated weights for policy 1, policy_version 1167528 (0.0009) [2023-12-26 08:58:50,960][123090] Updated weights for policy 1, policy_version 1167538 (0.0008) [2023-12-26 08:58:51,029][123090] Updated weights for policy 1, policy_version 1167548 (0.0008) [2023-12-26 08:58:51,298][123091] Updated weights for policy 0, policy_version 1176017 (0.0010) [2023-12-26 08:58:51,370][123091] Updated weights for policy 0, policy_version 1176027 (0.0009) [2023-12-26 08:58:51,441][123091] Updated weights for policy 0, policy_version 1176037 (0.0010) [2023-12-26 08:58:51,505][123091] Updated weights for policy 0, policy_version 1176047 (0.0010) [2023-12-26 08:58:51,873][123090] Updated weights for policy 1, policy_version 1167558 (0.0008) [2023-12-26 08:58:51,930][123090] Updated weights for policy 1, policy_version 1167568 (0.0008) [2023-12-26 08:58:51,990][123090] Updated weights for policy 1, policy_version 1167578 (0.0008) [2023-12-26 08:58:52,421][123091] Updated weights for policy 0, policy_version 1176057 (0.0010) [2023-12-26 08:58:52,489][123091] Updated weights for policy 0, policy_version 1176067 (0.0009) [2023-12-26 08:58:52,555][123091] Updated weights for policy 0, policy_version 1176077 (0.0010) [2023-12-26 08:58:52,726][123090] Updated weights for policy 1, policy_version 1167588 (0.0009) [2023-12-26 08:58:52,797][123090] Updated weights for policy 1, policy_version 1167598 (0.0010) [2023-12-26 08:58:52,853][123090] Updated weights for policy 1, policy_version 1167608 (0.0010) [2023-12-26 08:58:53,452][123091] Updated weights for policy 0, policy_version 1176087 (0.0010) [2023-12-26 08:58:53,506][123091] Updated weights for policy 0, policy_version 1176097 (0.0010) [2023-12-26 08:58:53,562][123091] Updated weights for policy 0, policy_version 1176107 (0.0010) [2023-12-26 08:58:53,666][123090] Updated weights for policy 1, policy_version 1167618 (0.0010) [2023-12-26 08:58:53,715][123090] Updated weights for policy 1, policy_version 1167628 (0.0010) [2023-12-26 08:58:53,768][123090] Updated weights for policy 1, policy_version 1167638 (0.0010) [2023-12-26 08:58:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 599998464. Throughput: 0: 9075.7, 1: 8845.4. Samples: 599977356. Policy #0 lag: (min: 30.0, avg: 30.1, max: 36.0) [2023-12-26 08:58:53,785][121949] Avg episode reward: [(0, '6250.951'), (1, '5475.999')] [2023-12-26 08:58:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001176112_301088768.pth... [2023-12-26 08:58:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001175024_300810240.pth [2023-12-26 08:58:53,825][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001167648_298917888.pth... [2023-12-26 08:58:53,827][123090] Updated weights for policy 1, policy_version 1167648 (0.0010) [2023-12-26 08:58:53,830][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001166592_298647552.pth [2023-12-26 08:58:54,272][123091] Updated weights for policy 0, policy_version 1176117 (0.0008) [2023-12-26 08:58:54,318][123091] Updated weights for policy 0, policy_version 1176127 (0.0005) [2023-12-26 08:58:54,367][123091] Updated weights for policy 0, policy_version 1176137 (0.0006) [2023-12-26 08:58:54,576][123090] Updated weights for policy 1, policy_version 1167658 (0.0008) [2023-12-26 08:58:54,641][123090] Updated weights for policy 1, policy_version 1167668 (0.0005) [2023-12-26 08:58:54,702][123090] Updated weights for policy 1, policy_version 1167678 (0.0006) [2023-12-26 08:58:55,108][123091] Updated weights for policy 0, policy_version 1176147 (0.0006) [2023-12-26 08:58:55,172][123091] Updated weights for policy 0, policy_version 1176157 (0.0008) [2023-12-26 08:58:55,238][123091] Updated weights for policy 0, policy_version 1176167 (0.0010) [2023-12-26 08:58:55,459][123090] Updated weights for policy 1, policy_version 1167688 (0.0009) [2023-12-26 08:58:55,521][123090] Updated weights for policy 1, policy_version 1167698 (0.0008) [2023-12-26 08:58:55,587][123090] Updated weights for policy 1, policy_version 1167708 (0.0005) [2023-12-26 08:58:56,048][123091] Updated weights for policy 0, policy_version 1176177 (0.0009) [2023-12-26 08:58:56,100][123091] Updated weights for policy 0, policy_version 1176187 (0.0010) [2023-12-26 08:58:56,158][123091] Updated weights for policy 0, policy_version 1176198 (0.0011) [2023-12-26 08:58:56,286][123090] Updated weights for policy 1, policy_version 1167718 (0.0008) [2023-12-26 08:58:56,350][123090] Updated weights for policy 1, policy_version 1167728 (0.0009) [2023-12-26 08:58:56,416][123090] Updated weights for policy 1, policy_version 1167738 (0.0010) [2023-12-26 08:58:56,879][123091] Updated weights for policy 0, policy_version 1176209 (0.0010) [2023-12-26 08:58:56,939][123091] Updated weights for policy 0, policy_version 1176219 (0.0007) [2023-12-26 08:58:56,990][123091] Updated weights for policy 0, policy_version 1176229 (0.0009) [2023-12-26 08:58:57,037][123091] Updated weights for policy 0, policy_version 1176239 (0.0009) [2023-12-26 08:58:57,274][123090] Updated weights for policy 1, policy_version 1167748 (0.0010) [2023-12-26 08:58:57,330][123090] Updated weights for policy 1, policy_version 1167758 (0.0006) [2023-12-26 08:58:57,388][123090] Updated weights for policy 1, policy_version 1167768 (0.0006) [2023-12-26 08:58:57,867][123091] Updated weights for policy 0, policy_version 1176249 (0.0009) [2023-12-26 08:58:57,921][123091] Updated weights for policy 0, policy_version 1176259 (0.0010) [2023-12-26 08:58:57,975][123091] Updated weights for policy 0, policy_version 1176270 (0.0009) [2023-12-26 08:58:58,174][123090] Updated weights for policy 1, policy_version 1167778 (0.0008) [2023-12-26 08:58:58,246][123090] Updated weights for policy 1, policy_version 1167788 (0.0008) [2023-12-26 08:58:58,314][123090] Updated weights for policy 1, policy_version 1167798 (0.0008) [2023-12-26 08:58:58,392][123090] Updated weights for policy 1, policy_version 1167808 (0.0008) [2023-12-26 08:58:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 600088576. Throughput: 0: 9072.3, 1: 8911.5. Samples: 600085448. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:58:58,785][121949] Avg episode reward: [(0, '6241.596'), (1, '5550.306')] [2023-12-26 08:58:58,916][123091] Updated weights for policy 0, policy_version 1176280 (0.0009) [2023-12-26 08:58:58,978][123091] Updated weights for policy 0, policy_version 1176290 (0.0009) [2023-12-26 08:58:59,042][123091] Updated weights for policy 0, policy_version 1176300 (0.0009) [2023-12-26 08:58:59,230][123090] Updated weights for policy 1, policy_version 1167818 (0.0011) [2023-12-26 08:58:59,301][123090] Updated weights for policy 1, policy_version 1167828 (0.0010) [2023-12-26 08:58:59,373][123090] Updated weights for policy 1, policy_version 1167838 (0.0010) [2023-12-26 08:58:59,866][123091] Updated weights for policy 0, policy_version 1176310 (0.0010) [2023-12-26 08:58:59,926][123091] Updated weights for policy 0, policy_version 1176320 (0.0009) [2023-12-26 08:58:59,991][123091] Updated weights for policy 0, policy_version 1176330 (0.0008) [2023-12-26 08:59:00,109][123090] Updated weights for policy 1, policy_version 1167848 (0.0006) [2023-12-26 08:59:00,177][123090] Updated weights for policy 1, policy_version 1167858 (0.0006) [2023-12-26 08:59:00,234][123090] Updated weights for policy 1, policy_version 1167868 (0.0005) [2023-12-26 08:59:00,854][123090] Updated weights for policy 1, policy_version 1167878 (0.0005) [2023-12-26 08:59:00,894][123091] Updated weights for policy 0, policy_version 1176340 (0.0007) [2023-12-26 08:59:00,917][123090] Updated weights for policy 1, policy_version 1167888 (0.0006) [2023-12-26 08:59:00,953][123091] Updated weights for policy 0, policy_version 1176350 (0.0005) [2023-12-26 08:59:00,969][123090] Updated weights for policy 1, policy_version 1167898 (0.0006) [2023-12-26 08:59:01,012][123091] Updated weights for policy 0, policy_version 1176360 (0.0006) [2023-12-26 08:59:01,746][123091] Updated weights for policy 0, policy_version 1176370 (0.0008) [2023-12-26 08:59:01,759][123090] Updated weights for policy 1, policy_version 1167908 (0.0007) [2023-12-26 08:59:01,809][123091] Updated weights for policy 0, policy_version 1176380 (0.0007) [2023-12-26 08:59:01,818][123090] Updated weights for policy 1, policy_version 1167918 (0.0008) [2023-12-26 08:59:01,869][123091] Updated weights for policy 0, policy_version 1176390 (0.0010) [2023-12-26 08:59:01,876][123090] Updated weights for policy 1, policy_version 1167928 (0.0008) [2023-12-26 08:59:01,934][123091] Updated weights for policy 0, policy_version 1176400 (0.0009) [2023-12-26 08:59:02,602][123090] Updated weights for policy 1, policy_version 1167938 (0.0007) [2023-12-26 08:59:02,663][123090] Updated weights for policy 1, policy_version 1167948 (0.0005) [2023-12-26 08:59:02,724][123090] Updated weights for policy 1, policy_version 1167958 (0.0006) [2023-12-26 08:59:02,735][123091] Updated weights for policy 0, policy_version 1176410 (0.0005) [2023-12-26 08:59:02,776][123090] Updated weights for policy 1, policy_version 1167968 (0.0005) [2023-12-26 08:59:02,786][123091] Updated weights for policy 0, policy_version 1176420 (0.0007) [2023-12-26 08:59:02,839][123091] Updated weights for policy 0, policy_version 1176430 (0.0010) [2023-12-26 08:59:03,453][123090] Updated weights for policy 1, policy_version 1167978 (0.0010) [2023-12-26 08:59:03,503][123090] Updated weights for policy 1, policy_version 1167988 (0.0009) [2023-12-26 08:59:03,556][123090] Updated weights for policy 1, policy_version 1167998 (0.0008) [2023-12-26 08:59:03,571][123091] Updated weights for policy 0, policy_version 1176440 (0.0006) [2023-12-26 08:59:03,625][123091] Updated weights for policy 0, policy_version 1176450 (0.0005) [2023-12-26 08:59:03,681][123091] Updated weights for policy 0, policy_version 1176460 (0.0005) [2023-12-26 08:59:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 600186880. Throughput: 0: 9036.1, 1: 8938.7. Samples: 600193024. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:03,785][121949] Avg episode reward: [(0, '6204.873'), (1, '5680.431')] [2023-12-26 08:59:04,362][123090] Updated weights for policy 1, policy_version 1168008 (0.0011) [2023-12-26 08:59:04,428][123090] Updated weights for policy 1, policy_version 1168018 (0.0009) [2023-12-26 08:59:04,431][123091] Updated weights for policy 0, policy_version 1176470 (0.0006) [2023-12-26 08:59:04,491][123091] Updated weights for policy 0, policy_version 1176480 (0.0007) [2023-12-26 08:59:04,493][123090] Updated weights for policy 1, policy_version 1168028 (0.0010) [2023-12-26 08:59:04,558][123091] Updated weights for policy 0, policy_version 1176490 (0.0006) [2023-12-26 08:59:05,263][123090] Updated weights for policy 1, policy_version 1168038 (0.0007) [2023-12-26 08:59:05,314][123090] Updated weights for policy 1, policy_version 1168048 (0.0005) [2023-12-26 08:59:05,332][123091] Updated weights for policy 0, policy_version 1176500 (0.0009) [2023-12-26 08:59:05,363][123090] Updated weights for policy 1, policy_version 1168058 (0.0005) [2023-12-26 08:59:05,393][123091] Updated weights for policy 0, policy_version 1176510 (0.0008) [2023-12-26 08:59:05,448][123091] Updated weights for policy 0, policy_version 1176520 (0.0009) [2023-12-26 08:59:06,091][123090] Updated weights for policy 1, policy_version 1168068 (0.0007) [2023-12-26 08:59:06,149][123090] Updated weights for policy 1, policy_version 1168078 (0.0009) [2023-12-26 08:59:06,213][123090] Updated weights for policy 1, policy_version 1168088 (0.0011) [2023-12-26 08:59:06,250][123091] Updated weights for policy 0, policy_version 1176530 (0.0009) [2023-12-26 08:59:06,317][123091] Updated weights for policy 0, policy_version 1176540 (0.0008) [2023-12-26 08:59:06,370][123091] Updated weights for policy 0, policy_version 1176550 (0.0009) [2023-12-26 08:59:06,431][123091] Updated weights for policy 0, policy_version 1176560 (0.0010) [2023-12-26 08:59:07,044][123090] Updated weights for policy 1, policy_version 1168098 (0.0010) [2023-12-26 08:59:07,097][123090] Updated weights for policy 1, policy_version 1168108 (0.0010) [2023-12-26 08:59:07,149][123090] Updated weights for policy 1, policy_version 1168118 (0.0010) [2023-12-26 08:59:07,211][123090] Updated weights for policy 1, policy_version 1168128 (0.0010) [2023-12-26 08:59:07,248][123091] Updated weights for policy 0, policy_version 1176570 (0.0009) [2023-12-26 08:59:07,300][123091] Updated weights for policy 0, policy_version 1176580 (0.0009) [2023-12-26 08:59:07,356][123091] Updated weights for policy 0, policy_version 1176590 (0.0008) [2023-12-26 08:59:07,972][123090] Updated weights for policy 1, policy_version 1168138 (0.0005) [2023-12-26 08:59:08,037][123090] Updated weights for policy 1, policy_version 1168148 (0.0006) [2023-12-26 08:59:08,101][123090] Updated weights for policy 1, policy_version 1168158 (0.0005) [2023-12-26 08:59:08,254][123091] Updated weights for policy 0, policy_version 1176600 (0.0009) [2023-12-26 08:59:08,307][123091] Updated weights for policy 0, policy_version 1176610 (0.0009) [2023-12-26 08:59:08,370][123091] Updated weights for policy 0, policy_version 1176620 (0.0009) [2023-12-26 08:59:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 600268800. Throughput: 0: 9096.1, 1: 8984.2. Samples: 600246900. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:08,785][121949] Avg episode reward: [(0, '6326.990'), (1, '5721.111')] [2023-12-26 08:59:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001176624_301219840.pth... [2023-12-26 08:59:08,793][123090] Updated weights for policy 1, policy_version 1168168 (0.0006) [2023-12-26 08:59:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001175600_300957696.pth [2023-12-26 08:59:08,853][123090] Updated weights for policy 1, policy_version 1168178 (0.0005) [2023-12-26 08:59:08,916][123090] Updated weights for policy 1, policy_version 1168188 (0.0006) [2023-12-26 08:59:08,933][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001168192_299057152.pth... [2023-12-26 08:59:08,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001167136_298786816.pth [2023-12-26 08:59:09,282][123091] Updated weights for policy 0, policy_version 1176630 (0.0009) [2023-12-26 08:59:09,350][123091] Updated weights for policy 0, policy_version 1176640 (0.0009) [2023-12-26 08:59:09,420][123091] Updated weights for policy 0, policy_version 1176650 (0.0010) [2023-12-26 08:59:09,699][123090] Updated weights for policy 1, policy_version 1168198 (0.0007) [2023-12-26 08:59:09,768][123090] Updated weights for policy 1, policy_version 1168208 (0.0008) [2023-12-26 08:59:09,824][123090] Updated weights for policy 1, policy_version 1168218 (0.0009) [2023-12-26 08:59:10,263][123091] Updated weights for policy 0, policy_version 1176660 (0.0009) [2023-12-26 08:59:10,329][123091] Updated weights for policy 0, policy_version 1176670 (0.0010) [2023-12-26 08:59:10,389][123091] Updated weights for policy 0, policy_version 1176680 (0.0009) [2023-12-26 08:59:10,626][123090] Updated weights for policy 1, policy_version 1168228 (0.0008) [2023-12-26 08:59:10,673][123090] Updated weights for policy 1, policy_version 1168238 (0.0005) [2023-12-26 08:59:10,733][123090] Updated weights for policy 1, policy_version 1168248 (0.0005) [2023-12-26 08:59:11,264][123091] Updated weights for policy 0, policy_version 1176690 (0.0009) [2023-12-26 08:59:11,328][123091] Updated weights for policy 0, policy_version 1176700 (0.0009) [2023-12-26 08:59:11,400][123091] Updated weights for policy 0, policy_version 1176710 (0.0010) [2023-12-26 08:59:11,460][123091] Updated weights for policy 0, policy_version 1176720 (0.0010) [2023-12-26 08:59:11,484][123090] Updated weights for policy 1, policy_version 1168258 (0.0006) [2023-12-26 08:59:11,540][123090] Updated weights for policy 1, policy_version 1168268 (0.0007) [2023-12-26 08:59:11,595][123090] Updated weights for policy 1, policy_version 1168278 (0.0006) [2023-12-26 08:59:11,679][123090] Updated weights for policy 1, policy_version 1168288 (0.0008) [2023-12-26 08:59:12,303][123091] Updated weights for policy 0, policy_version 1176730 (0.0009) [2023-12-26 08:59:12,370][123091] Updated weights for policy 0, policy_version 1176740 (0.0010) [2023-12-26 08:59:12,429][123091] Updated weights for policy 0, policy_version 1176750 (0.0010) [2023-12-26 08:59:12,530][123090] Updated weights for policy 1, policy_version 1168298 (0.0005) [2023-12-26 08:59:12,603][123090] Updated weights for policy 1, policy_version 1168308 (0.0006) [2023-12-26 08:59:12,673][123090] Updated weights for policy 1, policy_version 1168318 (0.0006) [2023-12-26 08:59:13,336][123090] Updated weights for policy 1, policy_version 1168328 (0.0005) [2023-12-26 08:59:13,365][123091] Updated weights for policy 0, policy_version 1176760 (0.0009) [2023-12-26 08:59:13,384][123090] Updated weights for policy 1, policy_version 1168338 (0.0005) [2023-12-26 08:59:13,420][123091] Updated weights for policy 0, policy_version 1176770 (0.0009) [2023-12-26 08:59:13,447][123090] Updated weights for policy 1, policy_version 1168348 (0.0009) [2023-12-26 08:59:13,478][123091] Updated weights for policy 0, policy_version 1176780 (0.0006) [2023-12-26 08:59:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 600358912. Throughput: 0: 8919.7, 1: 8918.4. Samples: 600350324. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:13,785][121949] Avg episode reward: [(0, '6292.901'), (1, '5596.198')] [2023-12-26 08:59:14,120][123090] Updated weights for policy 1, policy_version 1168358 (0.0007) [2023-12-26 08:59:14,174][123090] Updated weights for policy 1, policy_version 1168368 (0.0007) [2023-12-26 08:59:14,234][123090] Updated weights for policy 1, policy_version 1168378 (0.0010) [2023-12-26 08:59:14,249][123091] Updated weights for policy 0, policy_version 1176790 (0.0008) [2023-12-26 08:59:14,299][123091] Updated weights for policy 0, policy_version 1176800 (0.0008) [2023-12-26 08:59:14,347][123091] Updated weights for policy 0, policy_version 1176810 (0.0009) [2023-12-26 08:59:15,012][123090] Updated weights for policy 1, policy_version 1168388 (0.0010) [2023-12-26 08:59:15,078][123090] Updated weights for policy 1, policy_version 1168398 (0.0009) [2023-12-26 08:59:15,152][123090] Updated weights for policy 1, policy_version 1168408 (0.0009) [2023-12-26 08:59:15,259][123091] Updated weights for policy 0, policy_version 1176820 (0.0009) [2023-12-26 08:59:15,318][123091] Updated weights for policy 0, policy_version 1176830 (0.0008) [2023-12-26 08:59:15,383][123091] Updated weights for policy 0, policy_version 1176840 (0.0009) [2023-12-26 08:59:15,903][123090] Updated weights for policy 1, policy_version 1168418 (0.0009) [2023-12-26 08:59:15,955][123090] Updated weights for policy 1, policy_version 1168428 (0.0005) [2023-12-26 08:59:16,007][123090] Updated weights for policy 1, policy_version 1168438 (0.0005) [2023-12-26 08:59:16,061][123090] Updated weights for policy 1, policy_version 1168448 (0.0005) [2023-12-26 08:59:16,154][123091] Updated weights for policy 0, policy_version 1176850 (0.0008) [2023-12-26 08:59:16,230][123091] Updated weights for policy 0, policy_version 1176860 (0.0005) [2023-12-26 08:59:16,298][123091] Updated weights for policy 0, policy_version 1176870 (0.0005) [2023-12-26 08:59:16,345][123091] Updated weights for policy 0, policy_version 1176880 (0.0005) [2023-12-26 08:59:16,838][123090] Updated weights for policy 1, policy_version 1168458 (0.0010) [2023-12-26 08:59:16,900][123090] Updated weights for policy 1, policy_version 1168468 (0.0010) [2023-12-26 08:59:16,962][123091] Updated weights for policy 0, policy_version 1176890 (0.0006) [2023-12-26 08:59:16,965][123090] Updated weights for policy 1, policy_version 1168478 (0.0009) [2023-12-26 08:59:17,018][123091] Updated weights for policy 0, policy_version 1176900 (0.0009) [2023-12-26 08:59:17,084][123091] Updated weights for policy 0, policy_version 1176910 (0.0009) [2023-12-26 08:59:17,788][123090] Updated weights for policy 1, policy_version 1168488 (0.0006) [2023-12-26 08:59:17,822][123091] Updated weights for policy 0, policy_version 1176920 (0.0006) [2023-12-26 08:59:17,842][123090] Updated weights for policy 1, policy_version 1168498 (0.0010) [2023-12-26 08:59:17,874][123091] Updated weights for policy 0, policy_version 1176930 (0.0008) [2023-12-26 08:59:17,897][123090] Updated weights for policy 1, policy_version 1168508 (0.0010) [2023-12-26 08:59:17,922][123091] Updated weights for policy 0, policy_version 1176940 (0.0006) [2023-12-26 08:59:18,717][123090] Updated weights for policy 1, policy_version 1168518 (0.0010) [2023-12-26 08:59:18,754][123091] Updated weights for policy 0, policy_version 1176950 (0.0010) [2023-12-26 08:59:18,779][123090] Updated weights for policy 1, policy_version 1168528 (0.0006) [2023-12-26 08:59:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 600440832. Throughput: 0: 8821.3, 1: 8960.0. Samples: 600459024. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:18,785][121949] Avg episode reward: [(0, '6322.167'), (1, '5520.412')] [2023-12-26 08:59:18,812][123091] Updated weights for policy 0, policy_version 1176960 (0.0009) [2023-12-26 08:59:18,832][123090] Updated weights for policy 1, policy_version 1168538 (0.0007) [2023-12-26 08:59:18,874][123091] Updated weights for policy 0, policy_version 1176970 (0.0008) [2023-12-26 08:59:19,670][123091] Updated weights for policy 0, policy_version 1176980 (0.0009) [2023-12-26 08:59:19,672][123090] Updated weights for policy 1, policy_version 1168548 (0.0010) [2023-12-26 08:59:19,734][123091] Updated weights for policy 0, policy_version 1176990 (0.0007) [2023-12-26 08:59:19,737][123090] Updated weights for policy 1, policy_version 1168558 (0.0011) [2023-12-26 08:59:19,792][123091] Updated weights for policy 0, policy_version 1177000 (0.0006) [2023-12-26 08:59:19,801][123090] Updated weights for policy 1, policy_version 1168568 (0.0011) [2023-12-26 08:59:20,608][123091] Updated weights for policy 0, policy_version 1177010 (0.0008) [2023-12-26 08:59:20,648][123090] Updated weights for policy 1, policy_version 1168578 (0.0011) [2023-12-26 08:59:20,668][123091] Updated weights for policy 0, policy_version 1177021 (0.0008) [2023-12-26 08:59:20,696][123090] Updated weights for policy 1, policy_version 1168588 (0.0010) [2023-12-26 08:59:20,713][123091] Updated weights for policy 0, policy_version 1177031 (0.0006) [2023-12-26 08:59:20,753][123090] Updated weights for policy 1, policy_version 1168598 (0.0010) [2023-12-26 08:59:20,813][123090] Updated weights for policy 1, policy_version 1168608 (0.0011) [2023-12-26 08:59:21,592][123091] Updated weights for policy 0, policy_version 1177041 (0.0010) [2023-12-26 08:59:21,670][123091] Updated weights for policy 0, policy_version 1177051 (0.0010) [2023-12-26 08:59:21,735][123090] Updated weights for policy 1, policy_version 1168618 (0.0009) [2023-12-26 08:59:21,743][123091] Updated weights for policy 0, policy_version 1177061 (0.0007) [2023-12-26 08:59:21,804][123090] Updated weights for policy 1, policy_version 1168628 (0.0011) [2023-12-26 08:59:21,812][123091] Updated weights for policy 0, policy_version 1177071 (0.0008) [2023-12-26 08:59:21,865][123090] Updated weights for policy 1, policy_version 1168638 (0.0011) [2023-12-26 08:59:22,693][123090] Updated weights for policy 1, policy_version 1168648 (0.0006) [2023-12-26 08:59:22,704][123091] Updated weights for policy 0, policy_version 1177081 (0.0009) [2023-12-26 08:59:22,755][123090] Updated weights for policy 1, policy_version 1168658 (0.0008) [2023-12-26 08:59:22,762][123091] Updated weights for policy 0, policy_version 1177091 (0.0007) [2023-12-26 08:59:22,819][123091] Updated weights for policy 0, policy_version 1177101 (0.0008) [2023-12-26 08:59:22,825][123090] Updated weights for policy 1, policy_version 1168668 (0.0008) [2023-12-26 08:59:23,671][123091] Updated weights for policy 0, policy_version 1177111 (0.0008) [2023-12-26 08:59:23,686][123090] Updated weights for policy 1, policy_version 1168678 (0.0010) [2023-12-26 08:59:23,726][123091] Updated weights for policy 0, policy_version 1177121 (0.0009) [2023-12-26 08:59:23,749][123090] Updated weights for policy 1, policy_version 1168688 (0.0009) [2023-12-26 08:59:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 600522752. Throughput: 0: 8762.8, 1: 8936.4. Samples: 600509180. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:23,784][121949] Avg episode reward: [(0, '6344.389'), (1, '5593.612')] [2023-12-26 08:59:23,786][123091] Updated weights for policy 0, policy_version 1177131 (0.0006) [2023-12-26 08:59:23,816][123090] Updated weights for policy 1, policy_version 1168698 (0.0010) [2023-12-26 08:59:23,817][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001177136_301350912.pth... [2023-12-26 08:59:23,821][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001176112_301088768.pth [2023-12-26 08:59:23,856][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001168704_299188224.pth... [2023-12-26 08:59:23,860][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001167648_298917888.pth [2023-12-26 08:59:24,573][123091] Updated weights for policy 0, policy_version 1177141 (0.0007) [2023-12-26 08:59:24,635][123091] Updated weights for policy 0, policy_version 1177151 (0.0008) [2023-12-26 08:59:24,638][123090] Updated weights for policy 1, policy_version 1168708 (0.0009) [2023-12-26 08:59:24,690][123090] Updated weights for policy 1, policy_version 1168718 (0.0007) [2023-12-26 08:59:24,696][123091] Updated weights for policy 0, policy_version 1177161 (0.0008) [2023-12-26 08:59:24,739][123090] Updated weights for policy 1, policy_version 1168728 (0.0008) [2023-12-26 08:59:25,445][123090] Updated weights for policy 1, policy_version 1168738 (0.0009) [2023-12-26 08:59:25,514][123090] Updated weights for policy 1, policy_version 1168748 (0.0005) [2023-12-26 08:59:25,530][123091] Updated weights for policy 0, policy_version 1177171 (0.0009) [2023-12-26 08:59:25,563][123090] Updated weights for policy 1, policy_version 1168758 (0.0010) [2023-12-26 08:59:25,594][123091] Updated weights for policy 0, policy_version 1177181 (0.0006) [2023-12-26 08:59:25,625][123090] Updated weights for policy 1, policy_version 1168768 (0.0010) [2023-12-26 08:59:25,659][123091] Updated weights for policy 0, policy_version 1177191 (0.0008) [2023-12-26 08:59:26,378][123090] Updated weights for policy 1, policy_version 1168778 (0.0010) [2023-12-26 08:59:26,437][123090] Updated weights for policy 1, policy_version 1168788 (0.0010) [2023-12-26 08:59:26,478][123091] Updated weights for policy 0, policy_version 1177201 (0.0008) [2023-12-26 08:59:26,500][123090] Updated weights for policy 1, policy_version 1168798 (0.0011) [2023-12-26 08:59:26,530][123091] Updated weights for policy 0, policy_version 1177211 (0.0008) [2023-12-26 08:59:26,589][123091] Updated weights for policy 0, policy_version 1177221 (0.0009) [2023-12-26 08:59:26,646][123091] Updated weights for policy 0, policy_version 1177231 (0.0009) [2023-12-26 08:59:27,334][123090] Updated weights for policy 1, policy_version 1168808 (0.0010) [2023-12-26 08:59:27,401][123090] Updated weights for policy 1, policy_version 1168818 (0.0010) [2023-12-26 08:59:27,470][123090] Updated weights for policy 1, policy_version 1168828 (0.0010) [2023-12-26 08:59:27,489][123091] Updated weights for policy 0, policy_version 1177241 (0.0009) [2023-12-26 08:59:27,532][123091] Updated weights for policy 0, policy_version 1177251 (0.0007) [2023-12-26 08:59:27,584][123091] Updated weights for policy 0, policy_version 1177261 (0.0007) [2023-12-26 08:59:28,251][123090] Updated weights for policy 1, policy_version 1168838 (0.0010) [2023-12-26 08:59:28,320][123090] Updated weights for policy 1, policy_version 1168848 (0.0010) [2023-12-26 08:59:28,371][123091] Updated weights for policy 0, policy_version 1177271 (0.0008) [2023-12-26 08:59:28,383][123090] Updated weights for policy 1, policy_version 1168858 (0.0008) [2023-12-26 08:59:28,434][123091] Updated weights for policy 0, policy_version 1177281 (0.0007) [2023-12-26 08:59:28,503][123091] Updated weights for policy 0, policy_version 1177291 (0.0009) [2023-12-26 08:59:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 600621056. Throughput: 0: 8724.8, 1: 8977.9. Samples: 600611372. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:28,785][121949] Avg episode reward: [(0, '6308.627'), (1, '5633.696')] [2023-12-26 08:59:29,207][123090] Updated weights for policy 1, policy_version 1168868 (0.0010) [2023-12-26 08:59:29,274][123090] Updated weights for policy 1, policy_version 1168878 (0.0010) [2023-12-26 08:59:29,323][123091] Updated weights for policy 0, policy_version 1177301 (0.0007) [2023-12-26 08:59:29,341][123090] Updated weights for policy 1, policy_version 1168888 (0.0011) [2023-12-26 08:59:29,386][123091] Updated weights for policy 0, policy_version 1177311 (0.0008) [2023-12-26 08:59:29,440][123091] Updated weights for policy 0, policy_version 1177321 (0.0006) [2023-12-26 08:59:30,074][123090] Updated weights for policy 1, policy_version 1168898 (0.0010) [2023-12-26 08:59:30,134][123090] Updated weights for policy 1, policy_version 1168908 (0.0005) [2023-12-26 08:59:30,196][123090] Updated weights for policy 1, policy_version 1168918 (0.0006) [2023-12-26 08:59:30,214][123091] Updated weights for policy 0, policy_version 1177331 (0.0008) [2023-12-26 08:59:30,262][123090] Updated weights for policy 1, policy_version 1168928 (0.0009) [2023-12-26 08:59:30,278][123091] Updated weights for policy 0, policy_version 1177341 (0.0006) [2023-12-26 08:59:30,353][123091] Updated weights for policy 0, policy_version 1177351 (0.0005) [2023-12-26 08:59:31,020][123090] Updated weights for policy 1, policy_version 1168938 (0.0010) [2023-12-26 08:59:31,084][123090] Updated weights for policy 1, policy_version 1168948 (0.0009) [2023-12-26 08:59:31,127][123091] Updated weights for policy 0, policy_version 1177361 (0.0006) [2023-12-26 08:59:31,152][123090] Updated weights for policy 1, policy_version 1168958 (0.0007) [2023-12-26 08:59:31,197][123091] Updated weights for policy 0, policy_version 1177371 (0.0009) [2023-12-26 08:59:31,263][123091] Updated weights for policy 0, policy_version 1177381 (0.0010) [2023-12-26 08:59:31,323][123091] Updated weights for policy 0, policy_version 1177391 (0.0009) [2023-12-26 08:59:31,865][123090] Updated weights for policy 1, policy_version 1168968 (0.0005) [2023-12-26 08:59:31,917][123090] Updated weights for policy 1, policy_version 1168978 (0.0007) [2023-12-26 08:59:31,972][123090] Updated weights for policy 1, policy_version 1168988 (0.0007) [2023-12-26 08:59:32,211][123091] Updated weights for policy 0, policy_version 1177401 (0.0009) [2023-12-26 08:59:32,268][123091] Updated weights for policy 0, policy_version 1177411 (0.0009) [2023-12-26 08:59:32,332][123091] Updated weights for policy 0, policy_version 1177421 (0.0009) [2023-12-26 08:59:32,773][123090] Updated weights for policy 1, policy_version 1168998 (0.0010) [2023-12-26 08:59:32,831][123090] Updated weights for policy 1, policy_version 1169008 (0.0010) [2023-12-26 08:59:32,886][123090] Updated weights for policy 1, policy_version 1169018 (0.0010) [2023-12-26 08:59:33,110][123091] Updated weights for policy 0, policy_version 1177431 (0.0007) [2023-12-26 08:59:33,158][123091] Updated weights for policy 0, policy_version 1177441 (0.0005) [2023-12-26 08:59:33,217][123091] Updated weights for policy 0, policy_version 1177451 (0.0005) [2023-12-26 08:59:33,663][123090] Updated weights for policy 1, policy_version 1169028 (0.0008) [2023-12-26 08:59:33,707][123090] Updated weights for policy 1, policy_version 1169038 (0.0005) [2023-12-26 08:59:33,755][123090] Updated weights for policy 1, policy_version 1169048 (0.0005) [2023-12-26 08:59:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 600702976. Throughput: 0: 8628.2, 1: 9014.6. Samples: 600718792. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:33,785][121949] Avg episode reward: [(0, '6240.084'), (1, '5567.393')] [2023-12-26 08:59:33,926][123091] Updated weights for policy 0, policy_version 1177461 (0.0005) [2023-12-26 08:59:33,973][123091] Updated weights for policy 0, policy_version 1177471 (0.0006) [2023-12-26 08:59:34,024][123091] Updated weights for policy 0, policy_version 1177481 (0.0005) [2023-12-26 08:59:34,667][123090] Updated weights for policy 1, policy_version 1169058 (0.0007) [2023-12-26 08:59:34,731][123090] Updated weights for policy 1, policy_version 1169068 (0.0008) [2023-12-26 08:59:34,735][123091] Updated weights for policy 0, policy_version 1177491 (0.0006) [2023-12-26 08:59:34,787][123090] Updated weights for policy 1, policy_version 1169078 (0.0008) [2023-12-26 08:59:34,797][123091] Updated weights for policy 0, policy_version 1177501 (0.0008) [2023-12-26 08:59:34,845][123090] Updated weights for policy 1, policy_version 1169088 (0.0007) [2023-12-26 08:59:34,859][123091] Updated weights for policy 0, policy_version 1177511 (0.0007) [2023-12-26 08:59:35,623][123090] Updated weights for policy 1, policy_version 1169098 (0.0005) [2023-12-26 08:59:35,662][123091] Updated weights for policy 0, policy_version 1177521 (0.0010) [2023-12-26 08:59:35,686][123090] Updated weights for policy 1, policy_version 1169108 (0.0006) [2023-12-26 08:59:35,725][123091] Updated weights for policy 0, policy_version 1177531 (0.0011) [2023-12-26 08:59:35,753][123090] Updated weights for policy 1, policy_version 1169118 (0.0010) [2023-12-26 08:59:35,784][123091] Updated weights for policy 0, policy_version 1177541 (0.0011) [2023-12-26 08:59:35,851][123091] Updated weights for policy 0, policy_version 1177551 (0.0011) [2023-12-26 08:59:36,524][123090] Updated weights for policy 1, policy_version 1169128 (0.0010) [2023-12-26 08:59:36,587][123090] Updated weights for policy 1, policy_version 1169138 (0.0010) [2023-12-26 08:59:36,651][123090] Updated weights for policy 1, policy_version 1169148 (0.0010) [2023-12-26 08:59:36,680][123091] Updated weights for policy 0, policy_version 1177561 (0.0011) [2023-12-26 08:59:36,736][123091] Updated weights for policy 0, policy_version 1177571 (0.0011) [2023-12-26 08:59:36,792][123091] Updated weights for policy 0, policy_version 1177581 (0.0011) [2023-12-26 08:59:37,426][123090] Updated weights for policy 1, policy_version 1169158 (0.0006) [2023-12-26 08:59:37,486][123090] Updated weights for policy 1, policy_version 1169168 (0.0005) [2023-12-26 08:59:37,534][123090] Updated weights for policy 1, policy_version 1169178 (0.0006) [2023-12-26 08:59:37,630][123091] Updated weights for policy 0, policy_version 1177591 (0.0007) [2023-12-26 08:59:37,700][123091] Updated weights for policy 0, policy_version 1177601 (0.0005) [2023-12-26 08:59:37,768][123091] Updated weights for policy 0, policy_version 1177611 (0.0010) [2023-12-26 08:59:38,175][123090] Updated weights for policy 1, policy_version 1169188 (0.0010) [2023-12-26 08:59:38,231][123090] Updated weights for policy 1, policy_version 1169198 (0.0009) [2023-12-26 08:59:38,280][123090] Updated weights for policy 1, policy_version 1169208 (0.0008) [2023-12-26 08:59:38,548][123091] Updated weights for policy 0, policy_version 1177621 (0.0011) [2023-12-26 08:59:38,609][123091] Updated weights for policy 0, policy_version 1177631 (0.0012) [2023-12-26 08:59:38,676][123091] Updated weights for policy 0, policy_version 1177641 (0.0011) [2023-12-26 08:59:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 600801280. Throughput: 0: 8695.7, 1: 8975.6. Samples: 600772564. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:38,785][121949] Avg episode reward: [(0, '6129.915'), (1, '5760.532')] [2023-12-26 08:59:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001177648_301481984.pth... [2023-12-26 08:59:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001169216_299319296.pth... [2023-12-26 08:59:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001176624_301219840.pth [2023-12-26 08:59:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001168192_299057152.pth [2023-12-26 08:59:39,146][123090] Updated weights for policy 1, policy_version 1169218 (0.0007) [2023-12-26 08:59:39,200][123090] Updated weights for policy 1, policy_version 1169228 (0.0010) [2023-12-26 08:59:39,266][123090] Updated weights for policy 1, policy_version 1169238 (0.0010) [2023-12-26 08:59:39,321][123090] Updated weights for policy 1, policy_version 1169248 (0.0010) [2023-12-26 08:59:39,388][123091] Updated weights for policy 0, policy_version 1177651 (0.0010) [2023-12-26 08:59:39,453][123091] Updated weights for policy 0, policy_version 1177661 (0.0008) [2023-12-26 08:59:39,519][123091] Updated weights for policy 0, policy_version 1177671 (0.0007) [2023-12-26 08:59:40,190][123090] Updated weights for policy 1, policy_version 1169258 (0.0009) [2023-12-26 08:59:40,255][123090] Updated weights for policy 1, policy_version 1169268 (0.0008) [2023-12-26 08:59:40,297][123091] Updated weights for policy 0, policy_version 1177681 (0.0011) [2023-12-26 08:59:40,324][123090] Updated weights for policy 1, policy_version 1169278 (0.0009) [2023-12-26 08:59:40,357][123091] Updated weights for policy 0, policy_version 1177691 (0.0011) [2023-12-26 08:59:40,417][123091] Updated weights for policy 0, policy_version 1177701 (0.0011) [2023-12-26 08:59:40,484][123091] Updated weights for policy 0, policy_version 1177711 (0.0011) [2023-12-26 08:59:41,046][123090] Updated weights for policy 1, policy_version 1169288 (0.0009) [2023-12-26 08:59:41,122][123090] Updated weights for policy 1, policy_version 1169298 (0.0009) [2023-12-26 08:59:41,191][123090] Updated weights for policy 1, policy_version 1169308 (0.0010) [2023-12-26 08:59:41,333][123091] Updated weights for policy 0, policy_version 1177721 (0.0009) [2023-12-26 08:59:41,402][123091] Updated weights for policy 0, policy_version 1177731 (0.0008) [2023-12-26 08:59:41,469][123091] Updated weights for policy 0, policy_version 1177741 (0.0008) [2023-12-26 08:59:42,072][123090] Updated weights for policy 1, policy_version 1169318 (0.0009) [2023-12-26 08:59:42,129][123090] Updated weights for policy 1, policy_version 1169328 (0.0009) [2023-12-26 08:59:42,193][123090] Updated weights for policy 1, policy_version 1169338 (0.0010) [2023-12-26 08:59:42,263][123091] Updated weights for policy 0, policy_version 1177751 (0.0009) [2023-12-26 08:59:42,323][123091] Updated weights for policy 0, policy_version 1177761 (0.0010) [2023-12-26 08:59:42,393][123091] Updated weights for policy 0, policy_version 1177771 (0.0010) [2023-12-26 08:59:42,934][123090] Updated weights for policy 1, policy_version 1169348 (0.0008) [2023-12-26 08:59:42,989][123090] Updated weights for policy 1, policy_version 1169358 (0.0005) [2023-12-26 08:59:43,039][123090] Updated weights for policy 1, policy_version 1169368 (0.0005) [2023-12-26 08:59:43,199][123091] Updated weights for policy 0, policy_version 1177781 (0.0007) [2023-12-26 08:59:43,259][123091] Updated weights for policy 0, policy_version 1177791 (0.0008) [2023-12-26 08:59:43,315][123091] Updated weights for policy 0, policy_version 1177802 (0.0010) [2023-12-26 08:59:43,697][123090] Updated weights for policy 1, policy_version 1169378 (0.0005) [2023-12-26 08:59:43,755][123090] Updated weights for policy 1, policy_version 1169388 (0.0005) [2023-12-26 08:59:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 600883200. Throughput: 0: 8664.2, 1: 8947.0. Samples: 600877952. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:43,785][121949] Avg episode reward: [(0, '6230.048'), (1, '5617.841')] [2023-12-26 08:59:43,810][123090] Updated weights for policy 1, policy_version 1169398 (0.0005) [2023-12-26 08:59:43,866][123090] Updated weights for policy 1, policy_version 1169408 (0.0005) [2023-12-26 08:59:44,156][123091] Updated weights for policy 0, policy_version 1177812 (0.0008) [2023-12-26 08:59:44,209][123091] Updated weights for policy 0, policy_version 1177822 (0.0005) [2023-12-26 08:59:44,269][123091] Updated weights for policy 0, policy_version 1177832 (0.0005) [2023-12-26 08:59:44,521][123090] Updated weights for policy 1, policy_version 1169418 (0.0008) [2023-12-26 08:59:44,588][123090] Updated weights for policy 1, policy_version 1169428 (0.0007) [2023-12-26 08:59:44,647][123090] Updated weights for policy 1, policy_version 1169438 (0.0005) [2023-12-26 08:59:45,083][123091] Updated weights for policy 0, policy_version 1177842 (0.0006) [2023-12-26 08:59:45,149][123091] Updated weights for policy 0, policy_version 1177852 (0.0010) [2023-12-26 08:59:45,212][123091] Updated weights for policy 0, policy_version 1177862 (0.0010) [2023-12-26 08:59:45,275][123091] Updated weights for policy 0, policy_version 1177872 (0.0010) [2023-12-26 08:59:45,358][123090] Updated weights for policy 1, policy_version 1169448 (0.0008) [2023-12-26 08:59:45,415][123090] Updated weights for policy 1, policy_version 1169458 (0.0010) [2023-12-26 08:59:45,475][123090] Updated weights for policy 1, policy_version 1169468 (0.0010) [2023-12-26 08:59:45,993][123091] Updated weights for policy 0, policy_version 1177882 (0.0009) [2023-12-26 08:59:46,044][123091] Updated weights for policy 0, policy_version 1177892 (0.0006) [2023-12-26 08:59:46,103][123091] Updated weights for policy 0, policy_version 1177902 (0.0005) [2023-12-26 08:59:46,244][123090] Updated weights for policy 1, policy_version 1169478 (0.0007) [2023-12-26 08:59:46,294][123090] Updated weights for policy 1, policy_version 1169488 (0.0005) [2023-12-26 08:59:46,340][123090] Updated weights for policy 1, policy_version 1169498 (0.0005) [2023-12-26 08:59:46,822][123091] Updated weights for policy 0, policy_version 1177912 (0.0009) [2023-12-26 08:59:46,880][123091] Updated weights for policy 0, policy_version 1177922 (0.0010) [2023-12-26 08:59:46,938][123091] Updated weights for policy 0, policy_version 1177932 (0.0010) [2023-12-26 08:59:47,047][123090] Updated weights for policy 1, policy_version 1169508 (0.0005) [2023-12-26 08:59:47,108][123090] Updated weights for policy 1, policy_version 1169518 (0.0005) [2023-12-26 08:59:47,155][123090] Updated weights for policy 1, policy_version 1169528 (0.0005) [2023-12-26 08:59:47,676][123091] Updated weights for policy 0, policy_version 1177942 (0.0010) [2023-12-26 08:59:47,731][123091] Updated weights for policy 0, policy_version 1177952 (0.0010) [2023-12-26 08:59:47,800][123091] Updated weights for policy 0, policy_version 1177962 (0.0010) [2023-12-26 08:59:47,999][123090] Updated weights for policy 1, policy_version 1169538 (0.0009) [2023-12-26 08:59:48,069][123090] Updated weights for policy 1, policy_version 1169548 (0.0010) [2023-12-26 08:59:48,147][123090] Updated weights for policy 1, policy_version 1169558 (0.0010) [2023-12-26 08:59:48,201][123090] Updated weights for policy 1, policy_version 1169568 (0.0010) [2023-12-26 08:59:48,538][123091] Updated weights for policy 0, policy_version 1177972 (0.0010) [2023-12-26 08:59:48,598][123091] Updated weights for policy 0, policy_version 1177982 (0.0010) [2023-12-26 08:59:48,660][123091] Updated weights for policy 0, policy_version 1177992 (0.0010) [2023-12-26 08:59:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 600981504. Throughput: 0: 8745.0, 1: 9010.0. Samples: 600991996. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:48,785][121949] Avg episode reward: [(0, '6380.163'), (1, '5382.381')] [2023-12-26 08:59:49,046][123090] Updated weights for policy 1, policy_version 1169578 (0.0010) [2023-12-26 08:59:49,102][123090] Updated weights for policy 1, policy_version 1169588 (0.0009) [2023-12-26 08:59:49,154][123090] Updated weights for policy 1, policy_version 1169598 (0.0009) [2023-12-26 08:59:49,441][123091] Updated weights for policy 0, policy_version 1178002 (0.0009) [2023-12-26 08:59:49,502][123091] Updated weights for policy 0, policy_version 1178012 (0.0009) [2023-12-26 08:59:49,563][123091] Updated weights for policy 0, policy_version 1178022 (0.0009) [2023-12-26 08:59:49,623][123091] Updated weights for policy 0, policy_version 1178032 (0.0009) [2023-12-26 08:59:50,005][123090] Updated weights for policy 1, policy_version 1169608 (0.0008) [2023-12-26 08:59:50,071][123090] Updated weights for policy 1, policy_version 1169618 (0.0008) [2023-12-26 08:59:50,144][123090] Updated weights for policy 1, policy_version 1169628 (0.0009) [2023-12-26 08:59:50,430][123091] Updated weights for policy 0, policy_version 1178042 (0.0010) [2023-12-26 08:59:50,488][123091] Updated weights for policy 0, policy_version 1178052 (0.0009) [2023-12-26 08:59:50,541][123091] Updated weights for policy 0, policy_version 1178062 (0.0010) [2023-12-26 08:59:50,902][123090] Updated weights for policy 1, policy_version 1169638 (0.0007) [2023-12-26 08:59:50,975][123090] Updated weights for policy 1, policy_version 1169648 (0.0006) [2023-12-26 08:59:51,050][123090] Updated weights for policy 1, policy_version 1169658 (0.0006) [2023-12-26 08:59:51,485][123091] Updated weights for policy 0, policy_version 1178072 (0.0010) [2023-12-26 08:59:51,561][123091] Updated weights for policy 0, policy_version 1178082 (0.0008) [2023-12-26 08:59:51,631][123091] Updated weights for policy 0, policy_version 1178092 (0.0006) [2023-12-26 08:59:51,679][123090] Updated weights for policy 1, policy_version 1169668 (0.0006) [2023-12-26 08:59:51,740][123090] Updated weights for policy 1, policy_version 1169678 (0.0006) [2023-12-26 08:59:51,811][123090] Updated weights for policy 1, policy_version 1169688 (0.0009) [2023-12-26 08:59:52,443][123091] Updated weights for policy 0, policy_version 1178102 (0.0009) [2023-12-26 08:59:52,515][123091] Updated weights for policy 0, policy_version 1178112 (0.0008) [2023-12-26 08:59:52,579][123091] Updated weights for policy 0, policy_version 1178122 (0.0008) [2023-12-26 08:59:52,648][123090] Updated weights for policy 1, policy_version 1169698 (0.0010) [2023-12-26 08:59:52,710][123090] Updated weights for policy 1, policy_version 1169708 (0.0009) [2023-12-26 08:59:52,771][123090] Updated weights for policy 1, policy_version 1169718 (0.0009) [2023-12-26 08:59:52,838][123090] Updated weights for policy 1, policy_version 1169728 (0.0008) [2023-12-26 08:59:53,361][123091] Updated weights for policy 0, policy_version 1178132 (0.0007) [2023-12-26 08:59:53,409][123091] Updated weights for policy 0, policy_version 1178142 (0.0005) [2023-12-26 08:59:53,461][123091] Updated weights for policy 0, policy_version 1178152 (0.0005) [2023-12-26 08:59:53,564][123090] Updated weights for policy 1, policy_version 1169738 (0.0010) [2023-12-26 08:59:53,632][123090] Updated weights for policy 1, policy_version 1169748 (0.0010) [2023-12-26 08:59:53,690][123090] Updated weights for policy 1, policy_version 1169759 (0.0010) [2023-12-26 08:59:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 601071616. Throughput: 0: 8704.5, 1: 9000.5. Samples: 601043628. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:53,785][121949] Avg episode reward: [(0, '6266.485'), (1, '5452.967')] [2023-12-26 08:59:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001178160_301613056.pth... [2023-12-26 08:59:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001169760_299458560.pth... [2023-12-26 08:59:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001177136_301350912.pth [2023-12-26 08:59:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001168704_299188224.pth [2023-12-26 08:59:54,194][123091] Updated weights for policy 0, policy_version 1178162 (0.0008) [2023-12-26 08:59:54,260][123091] Updated weights for policy 0, policy_version 1178172 (0.0009) [2023-12-26 08:59:54,323][123091] Updated weights for policy 0, policy_version 1178182 (0.0010) [2023-12-26 08:59:54,389][123091] Updated weights for policy 0, policy_version 1178192 (0.0010) [2023-12-26 08:59:54,570][123090] Updated weights for policy 1, policy_version 1169769 (0.0009) [2023-12-26 08:59:54,629][123090] Updated weights for policy 1, policy_version 1169779 (0.0009) [2023-12-26 08:59:54,698][123090] Updated weights for policy 1, policy_version 1169790 (0.0011) [2023-12-26 08:59:55,159][123091] Updated weights for policy 0, policy_version 1178202 (0.0008) [2023-12-26 08:59:55,237][123091] Updated weights for policy 0, policy_version 1178212 (0.0006) [2023-12-26 08:59:55,288][123091] Updated weights for policy 0, policy_version 1178222 (0.0006) [2023-12-26 08:59:55,589][123090] Updated weights for policy 1, policy_version 1169800 (0.0009) [2023-12-26 08:59:55,639][123090] Updated weights for policy 1, policy_version 1169810 (0.0009) [2023-12-26 08:59:55,688][123090] Updated weights for policy 1, policy_version 1169820 (0.0009) [2023-12-26 08:59:55,932][123091] Updated weights for policy 0, policy_version 1178232 (0.0005) [2023-12-26 08:59:55,988][123091] Updated weights for policy 0, policy_version 1178242 (0.0006) [2023-12-26 08:59:56,038][123091] Updated weights for policy 0, policy_version 1178252 (0.0010) [2023-12-26 08:59:56,526][123090] Updated weights for policy 1, policy_version 1169830 (0.0007) [2023-12-26 08:59:56,578][123090] Updated weights for policy 1, policy_version 1169840 (0.0005) [2023-12-26 08:59:56,640][123090] Updated weights for policy 1, policy_version 1169850 (0.0005) [2023-12-26 08:59:56,744][123091] Updated weights for policy 0, policy_version 1178262 (0.0007) [2023-12-26 08:59:56,808][123091] Updated weights for policy 0, policy_version 1178272 (0.0006) [2023-12-26 08:59:56,867][123091] Updated weights for policy 0, policy_version 1178282 (0.0006) [2023-12-26 08:59:57,293][123090] Updated weights for policy 1, policy_version 1169860 (0.0005) [2023-12-26 08:59:57,354][123090] Updated weights for policy 1, policy_version 1169870 (0.0008) [2023-12-26 08:59:57,397][123090] Updated weights for policy 1, policy_version 1169880 (0.0010) [2023-12-26 08:59:57,628][123091] Updated weights for policy 0, policy_version 1178292 (0.0008) [2023-12-26 08:59:57,682][123091] Updated weights for policy 0, policy_version 1178302 (0.0010) [2023-12-26 08:59:57,732][123091] Updated weights for policy 0, policy_version 1178312 (0.0010) [2023-12-26 08:59:58,171][123090] Updated weights for policy 1, policy_version 1169890 (0.0009) [2023-12-26 08:59:58,243][123090] Updated weights for policy 1, policy_version 1169900 (0.0008) [2023-12-26 08:59:58,309][123090] Updated weights for policy 1, policy_version 1169910 (0.0007) [2023-12-26 08:59:58,383][123090] Updated weights for policy 1, policy_version 1169920 (0.0010) [2023-12-26 08:59:58,604][123091] Updated weights for policy 0, policy_version 1178322 (0.0010) [2023-12-26 08:59:58,672][123091] Updated weights for policy 0, policy_version 1178332 (0.0009) [2023-12-26 08:59:58,738][123091] Updated weights for policy 0, policy_version 1178342 (0.0009) [2023-12-26 08:59:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 601153536. Throughput: 0: 8870.3, 1: 8946.9. Samples: 601152092. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 08:59:58,785][121949] Avg episode reward: [(0, '6117.584'), (1, '5475.619')] [2023-12-26 08:59:58,814][123091] Updated weights for policy 0, policy_version 1178352 (0.0009) [2023-12-26 08:59:59,243][123090] Updated weights for policy 1, policy_version 1169930 (0.0008) [2023-12-26 08:59:59,315][123090] Updated weights for policy 1, policy_version 1169940 (0.0009) [2023-12-26 08:59:59,388][123090] Updated weights for policy 1, policy_version 1169950 (0.0008) [2023-12-26 08:59:59,583][123091] Updated weights for policy 0, policy_version 1178362 (0.0006) [2023-12-26 08:59:59,646][123091] Updated weights for policy 0, policy_version 1178372 (0.0009) [2023-12-26 08:59:59,700][123091] Updated weights for policy 0, policy_version 1178382 (0.0005) [2023-12-26 09:00:00,189][123090] Updated weights for policy 1, policy_version 1169960 (0.0009) [2023-12-26 09:00:00,256][123090] Updated weights for policy 1, policy_version 1169970 (0.0009) [2023-12-26 09:00:00,322][123090] Updated weights for policy 1, policy_version 1169982 (0.0010) [2023-12-26 09:00:00,515][123091] Updated weights for policy 0, policy_version 1178392 (0.0009) [2023-12-26 09:00:00,580][123091] Updated weights for policy 0, policy_version 1178402 (0.0009) [2023-12-26 09:00:00,637][123091] Updated weights for policy 0, policy_version 1178412 (0.0009) [2023-12-26 09:00:01,089][123090] Updated weights for policy 1, policy_version 1169992 (0.0007) [2023-12-26 09:00:01,156][123090] Updated weights for policy 1, policy_version 1170002 (0.0008) [2023-12-26 09:00:01,231][123090] Updated weights for policy 1, policy_version 1170012 (0.0008) [2023-12-26 09:00:01,388][123091] Updated weights for policy 0, policy_version 1178422 (0.0009) [2023-12-26 09:00:01,456][123091] Updated weights for policy 0, policy_version 1178432 (0.0010) [2023-12-26 09:00:01,518][123091] Updated weights for policy 0, policy_version 1178442 (0.0010) [2023-12-26 09:00:02,045][123090] Updated weights for policy 1, policy_version 1170022 (0.0009) [2023-12-26 09:00:02,096][123090] Updated weights for policy 1, policy_version 1170032 (0.0009) [2023-12-26 09:00:02,148][123090] Updated weights for policy 1, policy_version 1170042 (0.0009) [2023-12-26 09:00:02,288][123091] Updated weights for policy 0, policy_version 1178452 (0.0008) [2023-12-26 09:00:02,344][123091] Updated weights for policy 0, policy_version 1178462 (0.0008) [2023-12-26 09:00:02,410][123091] Updated weights for policy 0, policy_version 1178472 (0.0008) [2023-12-26 09:00:03,023][123090] Updated weights for policy 1, policy_version 1170052 (0.0009) [2023-12-26 09:00:03,071][123090] Updated weights for policy 1, policy_version 1170062 (0.0009) [2023-12-26 09:00:03,118][123090] Updated weights for policy 1, policy_version 1170072 (0.0009) [2023-12-26 09:00:03,186][123091] Updated weights for policy 0, policy_version 1178482 (0.0008) [2023-12-26 09:00:03,241][123091] Updated weights for policy 0, policy_version 1178492 (0.0009) [2023-12-26 09:00:03,306][123091] Updated weights for policy 0, policy_version 1178502 (0.0009) [2023-12-26 09:00:03,369][123091] Updated weights for policy 0, policy_version 1178512 (0.0009) [2023-12-26 09:00:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 601243648. Throughput: 0: 8841.8, 1: 8884.8. Samples: 601256720. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:03,785][121949] Avg episode reward: [(0, '6222.917'), (1, '5462.763')] [2023-12-26 09:00:03,861][123090] Updated weights for policy 1, policy_version 1170083 (0.0010) [2023-12-26 09:00:03,922][123090] Updated weights for policy 1, policy_version 1170093 (0.0009) [2023-12-26 09:00:03,973][123090] Updated weights for policy 1, policy_version 1170103 (0.0009) [2023-12-26 09:00:04,218][123091] Updated weights for policy 0, policy_version 1178522 (0.0008) [2023-12-26 09:00:04,278][123091] Updated weights for policy 0, policy_version 1178532 (0.0006) [2023-12-26 09:00:04,345][123091] Updated weights for policy 0, policy_version 1178542 (0.0007) [2023-12-26 09:00:04,871][123090] Updated weights for policy 1, policy_version 1170113 (0.0009) [2023-12-26 09:00:04,938][123090] Updated weights for policy 1, policy_version 1170123 (0.0009) [2023-12-26 09:00:04,992][123090] Updated weights for policy 1, policy_version 1170133 (0.0009) [2023-12-26 09:00:05,051][123090] Updated weights for policy 1, policy_version 1170143 (0.0008) [2023-12-26 09:00:05,057][123091] Updated weights for policy 0, policy_version 1178552 (0.0009) [2023-12-26 09:00:05,123][123091] Updated weights for policy 0, policy_version 1178562 (0.0006) [2023-12-26 09:00:05,191][123091] Updated weights for policy 0, policy_version 1178572 (0.0009) [2023-12-26 09:00:05,762][123090] Updated weights for policy 1, policy_version 1170153 (0.0006) [2023-12-26 09:00:05,815][123090] Updated weights for policy 1, policy_version 1170163 (0.0005) [2023-12-26 09:00:05,862][123090] Updated weights for policy 1, policy_version 1170173 (0.0005) [2023-12-26 09:00:06,015][123091] Updated weights for policy 0, policy_version 1178582 (0.0010) [2023-12-26 09:00:06,068][123091] Updated weights for policy 0, policy_version 1178592 (0.0009) [2023-12-26 09:00:06,127][123091] Updated weights for policy 0, policy_version 1178602 (0.0009) [2023-12-26 09:00:06,593][123090] Updated weights for policy 1, policy_version 1170183 (0.0005) [2023-12-26 09:00:06,660][123090] Updated weights for policy 1, policy_version 1170193 (0.0005) [2023-12-26 09:00:06,729][123090] Updated weights for policy 1, policy_version 1170203 (0.0007) [2023-12-26 09:00:06,988][123091] Updated weights for policy 0, policy_version 1178612 (0.0008) [2023-12-26 09:00:07,040][123091] Updated weights for policy 0, policy_version 1178622 (0.0009) [2023-12-26 09:00:07,100][123091] Updated weights for policy 0, policy_version 1178632 (0.0006) [2023-12-26 09:00:07,420][123090] Updated weights for policy 1, policy_version 1170213 (0.0005) [2023-12-26 09:00:07,475][123090] Updated weights for policy 1, policy_version 1170223 (0.0007) [2023-12-26 09:00:07,537][123090] Updated weights for policy 1, policy_version 1170233 (0.0009) [2023-12-26 09:00:07,803][123091] Updated weights for policy 0, policy_version 1178642 (0.0006) [2023-12-26 09:00:07,876][123091] Updated weights for policy 0, policy_version 1178652 (0.0006) [2023-12-26 09:00:07,936][123091] Updated weights for policy 0, policy_version 1178662 (0.0005) [2023-12-26 09:00:07,986][123091] Updated weights for policy 0, policy_version 1178672 (0.0005) [2023-12-26 09:00:08,297][123090] Updated weights for policy 1, policy_version 1170243 (0.0008) [2023-12-26 09:00:08,359][123090] Updated weights for policy 1, policy_version 1170253 (0.0007) [2023-12-26 09:00:08,426][123090] Updated weights for policy 1, policy_version 1170263 (0.0008) [2023-12-26 09:00:08,683][123091] Updated weights for policy 0, policy_version 1178682 (0.0011) [2023-12-26 09:00:08,743][123091] Updated weights for policy 0, policy_version 1178692 (0.0011) [2023-12-26 09:00:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 601333760. Throughput: 0: 8867.7, 1: 8931.7. Samples: 601310156. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:08,785][121949] Avg episode reward: [(0, '6263.481'), (1, '5485.789')] [2023-12-26 09:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001170272_299589632.pth... [2023-12-26 09:00:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001169216_299319296.pth [2023-12-26 09:00:08,809][123091] Updated weights for policy 0, policy_version 1178702 (0.0006) [2023-12-26 09:00:08,822][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001178704_301752320.pth... [2023-12-26 09:00:08,827][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001177648_301481984.pth [2023-12-26 09:00:09,133][123090] Updated weights for policy 1, policy_version 1170273 (0.0008) [2023-12-26 09:00:09,193][123090] Updated weights for policy 1, policy_version 1170283 (0.0006) [2023-12-26 09:00:09,254][123090] Updated weights for policy 1, policy_version 1170293 (0.0007) [2023-12-26 09:00:09,322][123090] Updated weights for policy 1, policy_version 1170303 (0.0008) [2023-12-26 09:00:09,580][123091] Updated weights for policy 0, policy_version 1178712 (0.0010) [2023-12-26 09:00:09,635][123091] Updated weights for policy 0, policy_version 1178722 (0.0008) [2023-12-26 09:00:09,687][123091] Updated weights for policy 0, policy_version 1178732 (0.0006) [2023-12-26 09:00:10,129][123090] Updated weights for policy 1, policy_version 1170313 (0.0010) [2023-12-26 09:00:10,186][123090] Updated weights for policy 1, policy_version 1170323 (0.0010) [2023-12-26 09:00:10,246][123090] Updated weights for policy 1, policy_version 1170333 (0.0011) [2023-12-26 09:00:10,513][123091] Updated weights for policy 0, policy_version 1178742 (0.0006) [2023-12-26 09:00:10,562][123091] Updated weights for policy 0, policy_version 1178752 (0.0006) [2023-12-26 09:00:10,610][123091] Updated weights for policy 0, policy_version 1178762 (0.0005) [2023-12-26 09:00:11,000][123090] Updated weights for policy 1, policy_version 1170343 (0.0007) [2023-12-26 09:00:11,067][123090] Updated weights for policy 1, policy_version 1170353 (0.0009) [2023-12-26 09:00:11,132][123090] Updated weights for policy 1, policy_version 1170363 (0.0010) [2023-12-26 09:00:11,402][123091] Updated weights for policy 0, policy_version 1178772 (0.0006) [2023-12-26 09:00:11,454][123091] Updated weights for policy 0, policy_version 1178782 (0.0010) [2023-12-26 09:00:11,511][123091] Updated weights for policy 0, policy_version 1178792 (0.0010) [2023-12-26 09:00:11,995][123090] Updated weights for policy 1, policy_version 1170373 (0.0008) [2023-12-26 09:00:12,066][123090] Updated weights for policy 1, policy_version 1170383 (0.0007) [2023-12-26 09:00:12,126][123090] Updated weights for policy 1, policy_version 1170393 (0.0006) [2023-12-26 09:00:12,390][123091] Updated weights for policy 0, policy_version 1178803 (0.0008) [2023-12-26 09:00:12,444][123091] Updated weights for policy 0, policy_version 1178813 (0.0008) [2023-12-26 09:00:12,502][123091] Updated weights for policy 0, policy_version 1178823 (0.0005) [2023-12-26 09:00:12,908][123090] Updated weights for policy 1, policy_version 1170403 (0.0008) [2023-12-26 09:00:12,973][123090] Updated weights for policy 1, policy_version 1170413 (0.0011) [2023-12-26 09:00:13,030][123090] Updated weights for policy 1, policy_version 1170423 (0.0011) [2023-12-26 09:00:13,305][123091] Updated weights for policy 0, policy_version 1178833 (0.0008) [2023-12-26 09:00:13,360][123091] Updated weights for policy 0, policy_version 1178843 (0.0008) [2023-12-26 09:00:13,408][123091] Updated weights for policy 0, policy_version 1178853 (0.0008) [2023-12-26 09:00:13,468][123091] Updated weights for policy 0, policy_version 1178863 (0.0009) [2023-12-26 09:00:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 601423872. Throughput: 0: 8950.9, 1: 8987.6. Samples: 601418604. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:13,785][121949] Avg episode reward: [(0, '6093.714'), (1, '5418.379')] [2023-12-26 09:00:13,815][123090] Updated weights for policy 1, policy_version 1170433 (0.0011) [2023-12-26 09:00:13,873][123090] Updated weights for policy 1, policy_version 1170443 (0.0010) [2023-12-26 09:00:13,920][123090] Updated weights for policy 1, policy_version 1170453 (0.0010) [2023-12-26 09:00:13,968][123090] Updated weights for policy 1, policy_version 1170463 (0.0010) [2023-12-26 09:00:14,345][123091] Updated weights for policy 0, policy_version 1178873 (0.0010) [2023-12-26 09:00:14,407][123091] Updated weights for policy 0, policy_version 1178883 (0.0010) [2023-12-26 09:00:14,467][123091] Updated weights for policy 0, policy_version 1178893 (0.0010) [2023-12-26 09:00:14,752][123090] Updated weights for policy 1, policy_version 1170473 (0.0006) [2023-12-26 09:00:14,839][123090] Updated weights for policy 1, policy_version 1170483 (0.0008) [2023-12-26 09:00:14,909][123090] Updated weights for policy 1, policy_version 1170493 (0.0007) [2023-12-26 09:00:15,365][123091] Updated weights for policy 0, policy_version 1178903 (0.0010) [2023-12-26 09:00:15,431][123091] Updated weights for policy 0, policy_version 1178913 (0.0008) [2023-12-26 09:00:15,497][123091] Updated weights for policy 0, policy_version 1178923 (0.0009) [2023-12-26 09:00:15,691][123090] Updated weights for policy 1, policy_version 1170503 (0.0009) [2023-12-26 09:00:15,762][123090] Updated weights for policy 1, policy_version 1170513 (0.0007) [2023-12-26 09:00:15,830][123090] Updated weights for policy 1, policy_version 1170523 (0.0005) [2023-12-26 09:00:16,300][123091] Updated weights for policy 0, policy_version 1178933 (0.0010) [2023-12-26 09:00:16,367][123091] Updated weights for policy 0, policy_version 1178943 (0.0009) [2023-12-26 09:00:16,430][123091] Updated weights for policy 0, policy_version 1178953 (0.0010) [2023-12-26 09:00:16,527][123090] Updated weights for policy 1, policy_version 1170533 (0.0007) [2023-12-26 09:00:16,599][123090] Updated weights for policy 1, policy_version 1170543 (0.0008) [2023-12-26 09:00:16,651][123090] Updated weights for policy 1, policy_version 1170553 (0.0010) [2023-12-26 09:00:17,288][123091] Updated weights for policy 0, policy_version 1178963 (0.0010) [2023-12-26 09:00:17,346][123091] Updated weights for policy 0, policy_version 1178973 (0.0010) [2023-12-26 09:00:17,402][123091] Updated weights for policy 0, policy_version 1178983 (0.0010) [2023-12-26 09:00:17,432][123090] Updated weights for policy 1, policy_version 1170563 (0.0009) [2023-12-26 09:00:17,491][123090] Updated weights for policy 1, policy_version 1170573 (0.0009) [2023-12-26 09:00:17,545][123090] Updated weights for policy 1, policy_version 1170583 (0.0010) [2023-12-26 09:00:18,279][123091] Updated weights for policy 0, policy_version 1178993 (0.0009) [2023-12-26 09:00:18,336][123091] Updated weights for policy 0, policy_version 1179003 (0.0009) [2023-12-26 09:00:18,355][123090] Updated weights for policy 1, policy_version 1170593 (0.0010) [2023-12-26 09:00:18,408][123091] Updated weights for policy 0, policy_version 1179013 (0.0009) [2023-12-26 09:00:18,421][123090] Updated weights for policy 1, policy_version 1170603 (0.0007) [2023-12-26 09:00:18,471][123091] Updated weights for policy 0, policy_version 1179023 (0.0008) [2023-12-26 09:00:18,492][123090] Updated weights for policy 1, policy_version 1170613 (0.0006) [2023-12-26 09:00:18,558][123090] Updated weights for policy 1, policy_version 1170623 (0.0006) [2023-12-26 09:00:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 601513984. Throughput: 0: 8869.1, 1: 8990.6. Samples: 601522476. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:18,784][121949] Avg episode reward: [(0, '6089.397'), (1, '5526.093')] [2023-12-26 09:00:19,298][123091] Updated weights for policy 0, policy_version 1179033 (0.0010) [2023-12-26 09:00:19,362][123091] Updated weights for policy 0, policy_version 1179043 (0.0009) [2023-12-26 09:00:19,372][123090] Updated weights for policy 1, policy_version 1170633 (0.0010) [2023-12-26 09:00:19,428][123091] Updated weights for policy 0, policy_version 1179053 (0.0007) [2023-12-26 09:00:19,442][123090] Updated weights for policy 1, policy_version 1170643 (0.0011) [2023-12-26 09:00:19,515][123090] Updated weights for policy 1, policy_version 1170653 (0.0010) [2023-12-26 09:00:20,320][123091] Updated weights for policy 0, policy_version 1179063 (0.0010) [2023-12-26 09:00:20,344][123090] Updated weights for policy 1, policy_version 1170663 (0.0010) [2023-12-26 09:00:20,380][123091] Updated weights for policy 0, policy_version 1179073 (0.0006) [2023-12-26 09:00:20,411][123090] Updated weights for policy 1, policy_version 1170673 (0.0011) [2023-12-26 09:00:20,457][123091] Updated weights for policy 0, policy_version 1179083 (0.0007) [2023-12-26 09:00:20,475][123090] Updated weights for policy 1, policy_version 1170683 (0.0011) [2023-12-26 09:00:21,330][123090] Updated weights for policy 1, policy_version 1170693 (0.0011) [2023-12-26 09:00:21,370][123091] Updated weights for policy 0, policy_version 1179093 (0.0008) [2023-12-26 09:00:21,409][123090] Updated weights for policy 1, policy_version 1170703 (0.0010) [2023-12-26 09:00:21,445][123091] Updated weights for policy 0, policy_version 1179103 (0.0008) [2023-12-26 09:00:21,475][123090] Updated weights for policy 1, policy_version 1170713 (0.0008) [2023-12-26 09:00:21,509][123091] Updated weights for policy 0, policy_version 1179113 (0.0009) [2023-12-26 09:00:22,359][123091] Updated weights for policy 0, policy_version 1179123 (0.0010) [2023-12-26 09:00:22,423][123091] Updated weights for policy 0, policy_version 1179133 (0.0009) [2023-12-26 09:00:22,436][123090] Updated weights for policy 1, policy_version 1170723 (0.0008) [2023-12-26 09:00:22,486][123091] Updated weights for policy 0, policy_version 1179143 (0.0008) [2023-12-26 09:00:22,493][123090] Updated weights for policy 1, policy_version 1170733 (0.0009) [2023-12-26 09:00:22,557][123090] Updated weights for policy 1, policy_version 1170743 (0.0009) [2023-12-26 09:00:23,331][123091] Updated weights for policy 0, policy_version 1179153 (0.0008) [2023-12-26 09:00:23,401][123091] Updated weights for policy 0, policy_version 1179163 (0.0009) [2023-12-26 09:00:23,427][123090] Updated weights for policy 1, policy_version 1170753 (0.0009) [2023-12-26 09:00:23,464][123091] Updated weights for policy 0, policy_version 1179173 (0.0009) [2023-12-26 09:00:23,491][123090] Updated weights for policy 1, policy_version 1170763 (0.0008) [2023-12-26 09:00:23,527][123091] Updated weights for policy 0, policy_version 1179183 (0.0009) [2023-12-26 09:00:23,560][123090] Updated weights for policy 1, policy_version 1170773 (0.0008) [2023-12-26 09:00:23,623][123090] Updated weights for policy 1, policy_version 1170783 (0.0008) [2023-12-26 09:00:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 601595904. Throughput: 0: 8793.1, 1: 8948.0. Samples: 601570912. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:23,785][121949] Avg episode reward: [(0, '6290.017'), (1, '5543.974')] [2023-12-26 09:00:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001179184_301875200.pth... [2023-12-26 09:00:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001170784_299720704.pth... [2023-12-26 09:00:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001178160_301613056.pth [2023-12-26 09:00:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001169760_299458560.pth [2023-12-26 09:00:24,354][123090] Updated weights for policy 1, policy_version 1170793 (0.0007) [2023-12-26 09:00:24,370][123091] Updated weights for policy 0, policy_version 1179193 (0.0007) [2023-12-26 09:00:24,414][123090] Updated weights for policy 1, policy_version 1170803 (0.0010) [2023-12-26 09:00:24,430][123091] Updated weights for policy 0, policy_version 1179203 (0.0007) [2023-12-26 09:00:24,470][123090] Updated weights for policy 1, policy_version 1170813 (0.0010) [2023-12-26 09:00:24,498][123091] Updated weights for policy 0, policy_version 1179213 (0.0007) [2023-12-26 09:00:25,206][123091] Updated weights for policy 0, policy_version 1179223 (0.0009) [2023-12-26 09:00:25,242][123090] Updated weights for policy 1, policy_version 1170823 (0.0011) [2023-12-26 09:00:25,263][123091] Updated weights for policy 0, policy_version 1179233 (0.0008) [2023-12-26 09:00:25,310][123090] Updated weights for policy 1, policy_version 1170833 (0.0011) [2023-12-26 09:00:25,320][123091] Updated weights for policy 0, policy_version 1179243 (0.0005) [2023-12-26 09:00:25,369][123090] Updated weights for policy 1, policy_version 1170843 (0.0010) [2023-12-26 09:00:26,135][123091] Updated weights for policy 0, policy_version 1179253 (0.0007) [2023-12-26 09:00:26,153][123090] Updated weights for policy 1, policy_version 1170853 (0.0008) [2023-12-26 09:00:26,194][123091] Updated weights for policy 0, policy_version 1179263 (0.0006) [2023-12-26 09:00:26,206][123090] Updated weights for policy 1, policy_version 1170863 (0.0007) [2023-12-26 09:00:26,249][123091] Updated weights for policy 0, policy_version 1179273 (0.0005) [2023-12-26 09:00:26,262][123090] Updated weights for policy 1, policy_version 1170873 (0.0005) [2023-12-26 09:00:27,020][123091] Updated weights for policy 0, policy_version 1179283 (0.0006) [2023-12-26 09:00:27,056][123090] Updated weights for policy 1, policy_version 1170883 (0.0005) [2023-12-26 09:00:27,079][123091] Updated weights for policy 0, policy_version 1179293 (0.0009) [2023-12-26 09:00:27,109][123090] Updated weights for policy 1, policy_version 1170893 (0.0005) [2023-12-26 09:00:27,136][123091] Updated weights for policy 0, policy_version 1179303 (0.0008) [2023-12-26 09:00:27,169][123090] Updated weights for policy 1, policy_version 1170903 (0.0006) [2023-12-26 09:00:27,834][123090] Updated weights for policy 1, policy_version 1170913 (0.0005) [2023-12-26 09:00:27,884][123090] Updated weights for policy 1, policy_version 1170923 (0.0005) [2023-12-26 09:00:27,904][123091] Updated weights for policy 0, policy_version 1179313 (0.0008) [2023-12-26 09:00:27,937][123090] Updated weights for policy 1, policy_version 1170933 (0.0006) [2023-12-26 09:00:27,950][123091] Updated weights for policy 0, policy_version 1179323 (0.0005) [2023-12-26 09:00:27,996][123090] Updated weights for policy 1, policy_version 1170943 (0.0005) [2023-12-26 09:00:28,003][123091] Updated weights for policy 0, policy_version 1179333 (0.0005) [2023-12-26 09:00:28,056][123091] Updated weights for policy 0, policy_version 1179343 (0.0008) [2023-12-26 09:00:28,677][123090] Updated weights for policy 1, policy_version 1170953 (0.0006) [2023-12-26 09:00:28,738][123090] Updated weights for policy 1, policy_version 1170963 (0.0006) [2023-12-26 09:00:28,757][123091] Updated weights for policy 0, policy_version 1179353 (0.0010) [2023-12-26 09:00:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 601677824. Throughput: 0: 8789.7, 1: 8947.4. Samples: 601676120. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:28,784][121949] Avg episode reward: [(0, '6320.990'), (1, '5692.492')] [2023-12-26 09:00:28,799][123090] Updated weights for policy 1, policy_version 1170973 (0.0007) [2023-12-26 09:00:28,823][123091] Updated weights for policy 0, policy_version 1179363 (0.0008) [2023-12-26 09:00:28,878][123091] Updated weights for policy 0, policy_version 1179373 (0.0009) [2023-12-26 09:00:29,550][123090] Updated weights for policy 1, policy_version 1170983 (0.0008) [2023-12-26 09:00:29,598][123090] Updated weights for policy 1, policy_version 1170993 (0.0009) [2023-12-26 09:00:29,651][123090] Updated weights for policy 1, policy_version 1171003 (0.0009) [2023-12-26 09:00:29,755][123091] Updated weights for policy 0, policy_version 1179383 (0.0010) [2023-12-26 09:00:29,811][123091] Updated weights for policy 0, policy_version 1179393 (0.0010) [2023-12-26 09:00:29,880][123091] Updated weights for policy 0, policy_version 1179403 (0.0010) [2023-12-26 09:00:30,506][123090] Updated weights for policy 1, policy_version 1171013 (0.0010) [2023-12-26 09:00:30,568][123090] Updated weights for policy 1, policy_version 1171023 (0.0010) [2023-12-26 09:00:30,635][123090] Updated weights for policy 1, policy_version 1171033 (0.0009) [2023-12-26 09:00:30,717][123091] Updated weights for policy 0, policy_version 1179413 (0.0009) [2023-12-26 09:00:30,771][123091] Updated weights for policy 0, policy_version 1179423 (0.0010) [2023-12-26 09:00:30,827][123091] Updated weights for policy 0, policy_version 1179433 (0.0008) [2023-12-26 09:00:31,460][123090] Updated weights for policy 1, policy_version 1171043 (0.0010) [2023-12-26 09:00:31,514][123090] Updated weights for policy 1, policy_version 1171053 (0.0009) [2023-12-26 09:00:31,568][123090] Updated weights for policy 1, policy_version 1171063 (0.0010) [2023-12-26 09:00:31,654][123091] Updated weights for policy 0, policy_version 1179443 (0.0007) [2023-12-26 09:00:31,703][123091] Updated weights for policy 0, policy_version 1179453 (0.0009) [2023-12-26 09:00:31,761][123091] Updated weights for policy 0, policy_version 1179463 (0.0009) [2023-12-26 09:00:32,437][123090] Updated weights for policy 1, policy_version 1171073 (0.0010) [2023-12-26 09:00:32,497][123090] Updated weights for policy 1, policy_version 1171083 (0.0009) [2023-12-26 09:00:32,552][123090] Updated weights for policy 1, policy_version 1171093 (0.0010) [2023-12-26 09:00:32,611][123090] Updated weights for policy 1, policy_version 1171103 (0.0010) [2023-12-26 09:00:32,634][123091] Updated weights for policy 0, policy_version 1179473 (0.0008) [2023-12-26 09:00:32,703][123091] Updated weights for policy 0, policy_version 1179483 (0.0009) [2023-12-26 09:00:32,756][123091] Updated weights for policy 0, policy_version 1179493 (0.0009) [2023-12-26 09:00:32,808][123091] Updated weights for policy 0, policy_version 1179503 (0.0009) [2023-12-26 09:00:33,450][123090] Updated weights for policy 1, policy_version 1171113 (0.0010) [2023-12-26 09:00:33,494][123090] Updated weights for policy 1, policy_version 1171123 (0.0010) [2023-12-26 09:00:33,541][123090] Updated weights for policy 1, policy_version 1171133 (0.0010) [2023-12-26 09:00:33,647][123091] Updated weights for policy 0, policy_version 1179513 (0.0009) [2023-12-26 09:00:33,699][123091] Updated weights for policy 0, policy_version 1179523 (0.0008) [2023-12-26 09:00:33,759][123091] Updated weights for policy 0, policy_version 1179533 (0.0005) [2023-12-26 09:00:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 601776128. Throughput: 0: 8724.9, 1: 8837.5. Samples: 601782304. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:33,785][121949] Avg episode reward: [(0, '6296.556'), (1, '5683.995')] [2023-12-26 09:00:34,373][123090] Updated weights for policy 1, policy_version 1171143 (0.0010) [2023-12-26 09:00:34,436][123091] Updated weights for policy 0, policy_version 1179543 (0.0006) [2023-12-26 09:00:34,441][123090] Updated weights for policy 1, policy_version 1171153 (0.0010) [2023-12-26 09:00:34,496][123091] Updated weights for policy 0, policy_version 1179553 (0.0009) [2023-12-26 09:00:34,497][123090] Updated weights for policy 1, policy_version 1171163 (0.0007) [2023-12-26 09:00:34,558][123091] Updated weights for policy 0, policy_version 1179563 (0.0009) [2023-12-26 09:00:35,128][123090] Updated weights for policy 1, policy_version 1171173 (0.0006) [2023-12-26 09:00:35,176][123090] Updated weights for policy 1, policy_version 1171183 (0.0005) [2023-12-26 09:00:35,243][123090] Updated weights for policy 1, policy_version 1171193 (0.0011) [2023-12-26 09:00:35,327][123091] Updated weights for policy 0, policy_version 1179573 (0.0009) [2023-12-26 09:00:35,379][123091] Updated weights for policy 0, policy_version 1179583 (0.0010) [2023-12-26 09:00:35,442][123091] Updated weights for policy 0, policy_version 1179593 (0.0009) [2023-12-26 09:00:35,975][123090] Updated weights for policy 1, policy_version 1171203 (0.0011) [2023-12-26 09:00:36,030][123090] Updated weights for policy 1, policy_version 1171213 (0.0010) [2023-12-26 09:00:36,107][123090] Updated weights for policy 1, policy_version 1171223 (0.0010) [2023-12-26 09:00:36,353][123091] Updated weights for policy 0, policy_version 1179603 (0.0010) [2023-12-26 09:00:36,415][123091] Updated weights for policy 0, policy_version 1179613 (0.0010) [2023-12-26 09:00:36,481][123091] Updated weights for policy 0, policy_version 1179623 (0.0009) [2023-12-26 09:00:36,864][123090] Updated weights for policy 1, policy_version 1171233 (0.0010) [2023-12-26 09:00:36,933][123090] Updated weights for policy 1, policy_version 1171243 (0.0005) [2023-12-26 09:00:37,009][123090] Updated weights for policy 1, policy_version 1171253 (0.0009) [2023-12-26 09:00:37,079][123090] Updated weights for policy 1, policy_version 1171263 (0.0011) [2023-12-26 09:00:37,377][123091] Updated weights for policy 0, policy_version 1179633 (0.0009) [2023-12-26 09:00:37,448][123091] Updated weights for policy 0, policy_version 1179643 (0.0010) [2023-12-26 09:00:37,511][123091] Updated weights for policy 0, policy_version 1179653 (0.0008) [2023-12-26 09:00:37,577][123091] Updated weights for policy 0, policy_version 1179663 (0.0008) [2023-12-26 09:00:37,783][123090] Updated weights for policy 1, policy_version 1171273 (0.0006) [2023-12-26 09:00:37,842][123090] Updated weights for policy 1, policy_version 1171283 (0.0005) [2023-12-26 09:00:37,909][123090] Updated weights for policy 1, policy_version 1171293 (0.0009) [2023-12-26 09:00:38,291][123091] Updated weights for policy 0, policy_version 1179673 (0.0006) [2023-12-26 09:00:38,362][123091] Updated weights for policy 0, policy_version 1179683 (0.0007) [2023-12-26 09:00:38,418][123091] Updated weights for policy 0, policy_version 1179693 (0.0006) [2023-12-26 09:00:38,690][123090] Updated weights for policy 1, policy_version 1171303 (0.0011) [2023-12-26 09:00:38,754][123090] Updated weights for policy 1, policy_version 1171313 (0.0011) [2023-12-26 09:00:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 601858048. Throughput: 0: 8749.7, 1: 8874.8. Samples: 601836728. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:38,785][121949] Avg episode reward: [(0, '6248.949'), (1, '5704.386')] [2023-12-26 09:00:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001179696_302006272.pth... [2023-12-26 09:00:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001178704_301752320.pth [2023-12-26 09:00:38,821][123090] Updated weights for policy 1, policy_version 1171323 (0.0010) [2023-12-26 09:00:38,847][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001171328_299859968.pth... [2023-12-26 09:00:38,852][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001170272_299589632.pth [2023-12-26 09:00:39,238][123091] Updated weights for policy 0, policy_version 1179703 (0.0008) [2023-12-26 09:00:39,295][123091] Updated weights for policy 0, policy_version 1179713 (0.0009) [2023-12-26 09:00:39,353][123091] Updated weights for policy 0, policy_version 1179723 (0.0009) [2023-12-26 09:00:39,626][123090] Updated weights for policy 1, policy_version 1171333 (0.0010) [2023-12-26 09:00:39,686][123090] Updated weights for policy 1, policy_version 1171343 (0.0009) [2023-12-26 09:00:39,744][123090] Updated weights for policy 1, policy_version 1171353 (0.0009) [2023-12-26 09:00:40,256][123091] Updated weights for policy 0, policy_version 1179733 (0.0010) [2023-12-26 09:00:40,314][123091] Updated weights for policy 0, policy_version 1179743 (0.0009) [2023-12-26 09:00:40,367][123091] Updated weights for policy 0, policy_version 1179753 (0.0009) [2023-12-26 09:00:40,617][123090] Updated weights for policy 1, policy_version 1171363 (0.0010) [2023-12-26 09:00:40,682][123090] Updated weights for policy 1, policy_version 1171373 (0.0010) [2023-12-26 09:00:40,747][123090] Updated weights for policy 1, policy_version 1171383 (0.0010) [2023-12-26 09:00:41,208][123091] Updated weights for policy 0, policy_version 1179763 (0.0009) [2023-12-26 09:00:41,277][123091] Updated weights for policy 0, policy_version 1179773 (0.0009) [2023-12-26 09:00:41,330][123091] Updated weights for policy 0, policy_version 1179783 (0.0010) [2023-12-26 09:00:41,609][123090] Updated weights for policy 1, policy_version 1171393 (0.0009) [2023-12-26 09:00:41,679][123090] Updated weights for policy 1, policy_version 1171403 (0.0009) [2023-12-26 09:00:41,745][123090] Updated weights for policy 1, policy_version 1171413 (0.0009) [2023-12-26 09:00:41,806][123090] Updated weights for policy 1, policy_version 1171423 (0.0008) [2023-12-26 09:00:42,207][123091] Updated weights for policy 0, policy_version 1179793 (0.0009) [2023-12-26 09:00:42,276][123091] Updated weights for policy 0, policy_version 1179803 (0.0011) [2023-12-26 09:00:42,340][123091] Updated weights for policy 0, policy_version 1179813 (0.0010) [2023-12-26 09:00:42,407][123091] Updated weights for policy 0, policy_version 1179823 (0.0010) [2023-12-26 09:00:42,503][123090] Updated weights for policy 1, policy_version 1171433 (0.0008) [2023-12-26 09:00:42,571][123090] Updated weights for policy 1, policy_version 1171443 (0.0009) [2023-12-26 09:00:42,629][123090] Updated weights for policy 1, policy_version 1171453 (0.0008) [2023-12-26 09:00:43,220][123091] Updated weights for policy 0, policy_version 1179833 (0.0009) [2023-12-26 09:00:43,277][123091] Updated weights for policy 0, policy_version 1179843 (0.0010) [2023-12-26 09:00:43,333][123091] Updated weights for policy 0, policy_version 1179854 (0.0009) [2023-12-26 09:00:43,349][123090] Updated weights for policy 1, policy_version 1171463 (0.0006) [2023-12-26 09:00:43,413][123090] Updated weights for policy 1, policy_version 1171473 (0.0005) [2023-12-26 09:00:43,476][123090] Updated weights for policy 1, policy_version 1171483 (0.0008) [2023-12-26 09:00:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 601948160. Throughput: 0: 8619.4, 1: 8890.4. Samples: 601940032. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:43,785][121949] Avg episode reward: [(0, '6230.320'), (1, '5608.378')] [2023-12-26 09:00:44,143][123090] Updated weights for policy 1, policy_version 1171493 (0.0010) [2023-12-26 09:00:44,196][123091] Updated weights for policy 0, policy_version 1179864 (0.0010) [2023-12-26 09:00:44,198][123090] Updated weights for policy 1, policy_version 1171503 (0.0010) [2023-12-26 09:00:44,258][123091] Updated weights for policy 0, policy_version 1179874 (0.0010) [2023-12-26 09:00:44,261][123090] Updated weights for policy 1, policy_version 1171513 (0.0010) [2023-12-26 09:00:44,319][123091] Updated weights for policy 0, policy_version 1179884 (0.0010) [2023-12-26 09:00:45,066][123090] Updated weights for policy 1, policy_version 1171523 (0.0011) [2023-12-26 09:00:45,139][123090] Updated weights for policy 1, policy_version 1171533 (0.0007) [2023-12-26 09:00:45,161][123091] Updated weights for policy 0, policy_version 1179894 (0.0011) [2023-12-26 09:00:45,212][123090] Updated weights for policy 1, policy_version 1171543 (0.0006) [2023-12-26 09:00:45,228][123091] Updated weights for policy 0, policy_version 1179904 (0.0011) [2023-12-26 09:00:45,288][123091] Updated weights for policy 0, policy_version 1179914 (0.0011) [2023-12-26 09:00:45,934][123090] Updated weights for policy 1, policy_version 1171553 (0.0006) [2023-12-26 09:00:45,985][123090] Updated weights for policy 1, policy_version 1171563 (0.0010) [2023-12-26 09:00:46,025][123091] Updated weights for policy 0, policy_version 1179924 (0.0009) [2023-12-26 09:00:46,055][123090] Updated weights for policy 1, policy_version 1171573 (0.0010) [2023-12-26 09:00:46,077][123091] Updated weights for policy 0, policy_version 1179934 (0.0007) [2023-12-26 09:00:46,115][123090] Updated weights for policy 1, policy_version 1171583 (0.0010) [2023-12-26 09:00:46,149][123091] Updated weights for policy 0, policy_version 1179944 (0.0006) [2023-12-26 09:00:46,719][123091] Updated weights for policy 0, policy_version 1179954 (0.0005) [2023-12-26 09:00:46,770][123091] Updated weights for policy 0, policy_version 1179964 (0.0005) [2023-12-26 09:00:46,819][123091] Updated weights for policy 0, policy_version 1179974 (0.0005) [2023-12-26 09:00:46,874][123091] Updated weights for policy 0, policy_version 1179984 (0.0006) [2023-12-26 09:00:46,926][123090] Updated weights for policy 1, policy_version 1171593 (0.0008) [2023-12-26 09:00:46,975][123090] Updated weights for policy 1, policy_version 1171603 (0.0009) [2023-12-26 09:00:47,024][123090] Updated weights for policy 1, policy_version 1171613 (0.0005) [2023-12-26 09:00:47,694][123090] Updated weights for policy 1, policy_version 1171623 (0.0005) [2023-12-26 09:00:47,714][123091] Updated weights for policy 0, policy_version 1179994 (0.0008) [2023-12-26 09:00:47,747][123090] Updated weights for policy 1, policy_version 1171633 (0.0006) [2023-12-26 09:00:47,775][123091] Updated weights for policy 0, policy_version 1180004 (0.0009) [2023-12-26 09:00:47,813][123090] Updated weights for policy 1, policy_version 1171643 (0.0005) [2023-12-26 09:00:47,841][123091] Updated weights for policy 0, policy_version 1180014 (0.0009) [2023-12-26 09:00:48,506][123090] Updated weights for policy 1, policy_version 1171653 (0.0008) [2023-12-26 09:00:48,562][123090] Updated weights for policy 1, policy_version 1171663 (0.0010) [2023-12-26 09:00:48,616][123090] Updated weights for policy 1, policy_version 1171673 (0.0010) [2023-12-26 09:00:48,636][123091] Updated weights for policy 0, policy_version 1180024 (0.0007) [2023-12-26 09:00:48,705][123091] Updated weights for policy 0, policy_version 1180034 (0.0008) [2023-12-26 09:00:48,776][123091] Updated weights for policy 0, policy_version 1180044 (0.0009) [2023-12-26 09:00:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 602038272. Throughput: 0: 8652.3, 1: 9000.9. Samples: 602051112. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:48,785][121949] Avg episode reward: [(0, '6237.706'), (1, '5491.586')] [2023-12-26 09:00:49,453][123090] Updated weights for policy 1, policy_version 1171683 (0.0010) [2023-12-26 09:00:49,506][123090] Updated weights for policy 1, policy_version 1171693 (0.0009) [2023-12-26 09:00:49,563][123090] Updated weights for policy 1, policy_version 1171703 (0.0009) [2023-12-26 09:00:49,593][123091] Updated weights for policy 0, policy_version 1180054 (0.0008) [2023-12-26 09:00:49,651][123091] Updated weights for policy 0, policy_version 1180064 (0.0009) [2023-12-26 09:00:49,701][123091] Updated weights for policy 0, policy_version 1180074 (0.0009) [2023-12-26 09:00:50,455][123090] Updated weights for policy 1, policy_version 1171713 (0.0009) [2023-12-26 09:00:50,514][123091] Updated weights for policy 0, policy_version 1180084 (0.0009) [2023-12-26 09:00:50,518][123090] Updated weights for policy 1, policy_version 1171723 (0.0009) [2023-12-26 09:00:50,585][123091] Updated weights for policy 0, policy_version 1180094 (0.0008) [2023-12-26 09:00:50,588][123090] Updated weights for policy 1, policy_version 1171733 (0.0009) [2023-12-26 09:00:50,643][123091] Updated weights for policy 0, policy_version 1180104 (0.0008) [2023-12-26 09:00:50,655][123090] Updated weights for policy 1, policy_version 1171743 (0.0006) [2023-12-26 09:00:51,369][123091] Updated weights for policy 0, policy_version 1180114 (0.0008) [2023-12-26 09:00:51,433][123091] Updated weights for policy 0, policy_version 1180124 (0.0011) [2023-12-26 09:00:51,492][123091] Updated weights for policy 0, policy_version 1180134 (0.0007) [2023-12-26 09:00:51,506][123090] Updated weights for policy 1, policy_version 1171753 (0.0009) [2023-12-26 09:00:51,544][123091] Updated weights for policy 0, policy_version 1180144 (0.0006) [2023-12-26 09:00:51,564][123090] Updated weights for policy 1, policy_version 1171763 (0.0006) [2023-12-26 09:00:51,631][123090] Updated weights for policy 1, policy_version 1171773 (0.0007) [2023-12-26 09:00:52,364][123091] Updated weights for policy 0, policy_version 1180154 (0.0011) [2023-12-26 09:00:52,433][123091] Updated weights for policy 0, policy_version 1180164 (0.0011) [2023-12-26 09:00:52,461][123090] Updated weights for policy 1, policy_version 1171783 (0.0010) [2023-12-26 09:00:52,493][123091] Updated weights for policy 0, policy_version 1180174 (0.0011) [2023-12-26 09:00:52,518][123090] Updated weights for policy 1, policy_version 1171793 (0.0007) [2023-12-26 09:00:52,579][123090] Updated weights for policy 1, policy_version 1171803 (0.0009) [2023-12-26 09:00:53,234][123091] Updated weights for policy 0, policy_version 1180184 (0.0010) [2023-12-26 09:00:53,286][123091] Updated weights for policy 0, policy_version 1180194 (0.0009) [2023-12-26 09:00:53,336][123091] Updated weights for policy 0, policy_version 1180204 (0.0009) [2023-12-26 09:00:53,446][123090] Updated weights for policy 1, policy_version 1171813 (0.0009) [2023-12-26 09:00:53,512][123090] Updated weights for policy 1, policy_version 1171823 (0.0009) [2023-12-26 09:00:53,573][123090] Updated weights for policy 1, policy_version 1171833 (0.0010) [2023-12-26 09:00:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 602128384. Throughput: 0: 8659.5, 1: 8948.6. Samples: 602102520. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:53,784][121949] Avg episode reward: [(0, '6132.689'), (1, '5478.661')] [2023-12-26 09:00:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001171840_299991040.pth... [2023-12-26 09:00:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001180208_302137344.pth... [2023-12-26 09:00:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001179184_301875200.pth [2023-12-26 09:00:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001170784_299720704.pth [2023-12-26 09:00:54,098][123091] Updated weights for policy 0, policy_version 1180214 (0.0008) [2023-12-26 09:00:54,162][123091] Updated weights for policy 0, policy_version 1180224 (0.0007) [2023-12-26 09:00:54,226][123091] Updated weights for policy 0, policy_version 1180234 (0.0008) [2023-12-26 09:00:54,475][123090] Updated weights for policy 1, policy_version 1171843 (0.0008) [2023-12-26 09:00:54,526][123090] Updated weights for policy 1, policy_version 1171853 (0.0009) [2023-12-26 09:00:54,584][123090] Updated weights for policy 1, policy_version 1171863 (0.0009) [2023-12-26 09:00:54,988][123091] Updated weights for policy 0, policy_version 1180244 (0.0009) [2023-12-26 09:00:55,048][123091] Updated weights for policy 0, policy_version 1180254 (0.0012) [2023-12-26 09:00:55,111][123091] Updated weights for policy 0, policy_version 1180264 (0.0010) [2023-12-26 09:00:55,363][123090] Updated weights for policy 1, policy_version 1171874 (0.0009) [2023-12-26 09:00:55,438][123090] Updated weights for policy 1, policy_version 1171884 (0.0005) [2023-12-26 09:00:55,501][123090] Updated weights for policy 1, policy_version 1171894 (0.0005) [2023-12-26 09:00:55,556][123090] Updated weights for policy 1, policy_version 1171904 (0.0007) [2023-12-26 09:00:55,946][123091] Updated weights for policy 0, policy_version 1180274 (0.0008) [2023-12-26 09:00:55,995][123091] Updated weights for policy 0, policy_version 1180284 (0.0005) [2023-12-26 09:00:56,049][123091] Updated weights for policy 0, policy_version 1180294 (0.0005) [2023-12-26 09:00:56,115][123091] Updated weights for policy 0, policy_version 1180304 (0.0006) [2023-12-26 09:00:56,162][123090] Updated weights for policy 1, policy_version 1171914 (0.0007) [2023-12-26 09:00:56,242][123090] Updated weights for policy 1, policy_version 1171924 (0.0005) [2023-12-26 09:00:56,307][123090] Updated weights for policy 1, policy_version 1171934 (0.0005) [2023-12-26 09:00:56,853][123090] Updated weights for policy 1, policy_version 1171944 (0.0005) [2023-12-26 09:00:56,890][123091] Updated weights for policy 0, policy_version 1180314 (0.0006) [2023-12-26 09:00:56,920][123090] Updated weights for policy 1, policy_version 1171954 (0.0005) [2023-12-26 09:00:56,950][123091] Updated weights for policy 0, policy_version 1180324 (0.0005) [2023-12-26 09:00:56,977][123090] Updated weights for policy 1, policy_version 1171964 (0.0006) [2023-12-26 09:00:56,995][123091] Updated weights for policy 0, policy_version 1180334 (0.0005) [2023-12-26 09:00:57,609][123090] Updated weights for policy 1, policy_version 1171974 (0.0007) [2023-12-26 09:00:57,660][123090] Updated weights for policy 1, policy_version 1171984 (0.0005) [2023-12-26 09:00:57,694][123091] Updated weights for policy 0, policy_version 1180344 (0.0005) [2023-12-26 09:00:57,722][123090] Updated weights for policy 1, policy_version 1171994 (0.0006) [2023-12-26 09:00:57,757][123091] Updated weights for policy 0, policy_version 1180354 (0.0005) [2023-12-26 09:00:57,808][123091] Updated weights for policy 0, policy_version 1180364 (0.0005) [2023-12-26 09:00:58,435][123090] Updated weights for policy 1, policy_version 1172004 (0.0006) [2023-12-26 09:00:58,502][123090] Updated weights for policy 1, policy_version 1172014 (0.0008) [2023-12-26 09:00:58,575][123090] Updated weights for policy 1, policy_version 1172024 (0.0008) [2023-12-26 09:00:58,595][123091] Updated weights for policy 0, policy_version 1180374 (0.0007) [2023-12-26 09:00:58,680][123091] Updated weights for policy 0, policy_version 1180384 (0.0008) [2023-12-26 09:00:58,748][123091] Updated weights for policy 0, policy_version 1180394 (0.0008) [2023-12-26 09:00:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 602218496. Throughput: 0: 8679.9, 1: 8971.7. Samples: 602212928. Policy #0 lag: (min: 19.0, avg: 21.1, max: 48.0) [2023-12-26 09:00:58,785][121949] Avg episode reward: [(0, '6140.872'), (1, '5598.980')] [2023-12-26 09:00:59,523][123090] Updated weights for policy 1, policy_version 1172034 (0.0008) [2023-12-26 09:00:59,582][123090] Updated weights for policy 1, policy_version 1172044 (0.0005) [2023-12-26 09:00:59,636][123091] Updated weights for policy 0, policy_version 1180404 (0.0008) [2023-12-26 09:00:59,645][123090] Updated weights for policy 1, policy_version 1172054 (0.0008) [2023-12-26 09:00:59,696][123091] Updated weights for policy 0, policy_version 1180414 (0.0006) [2023-12-26 09:00:59,698][123090] Updated weights for policy 1, policy_version 1172064 (0.0010) [2023-12-26 09:00:59,756][123091] Updated weights for policy 0, policy_version 1180424 (0.0008) [2023-12-26 09:01:00,485][123090] Updated weights for policy 1, policy_version 1172074 (0.0005) [2023-12-26 09:01:00,547][123090] Updated weights for policy 1, policy_version 1172084 (0.0008) [2023-12-26 09:01:00,604][123090] Updated weights for policy 1, policy_version 1172094 (0.0010) [2023-12-26 09:01:00,645][123091] Updated weights for policy 0, policy_version 1180434 (0.0009) [2023-12-26 09:01:00,697][123091] Updated weights for policy 0, policy_version 1180444 (0.0009) [2023-12-26 09:01:00,747][123091] Updated weights for policy 0, policy_version 1180454 (0.0009) [2023-12-26 09:01:00,798][123091] Updated weights for policy 0, policy_version 1180464 (0.0009) [2023-12-26 09:01:01,359][123090] Updated weights for policy 1, policy_version 1172104 (0.0010) [2023-12-26 09:01:01,424][123090] Updated weights for policy 1, policy_version 1172114 (0.0010) [2023-12-26 09:01:01,482][123090] Updated weights for policy 1, policy_version 1172124 (0.0009) [2023-12-26 09:01:01,623][123091] Updated weights for policy 0, policy_version 1180474 (0.0010) [2023-12-26 09:01:01,691][123091] Updated weights for policy 0, policy_version 1180484 (0.0011) [2023-12-26 09:01:01,758][123091] Updated weights for policy 0, policy_version 1180494 (0.0010) [2023-12-26 09:01:02,305][123090] Updated weights for policy 1, policy_version 1172134 (0.0010) [2023-12-26 09:01:02,378][123090] Updated weights for policy 1, policy_version 1172144 (0.0010) [2023-12-26 09:01:02,443][123090] Updated weights for policy 1, policy_version 1172154 (0.0010) [2023-12-26 09:01:02,528][123091] Updated weights for policy 0, policy_version 1180504 (0.0007) [2023-12-26 09:01:02,587][123091] Updated weights for policy 0, policy_version 1180514 (0.0008) [2023-12-26 09:01:02,642][123091] Updated weights for policy 0, policy_version 1180524 (0.0006) [2023-12-26 09:01:03,211][123090] Updated weights for policy 1, policy_version 1172164 (0.0010) [2023-12-26 09:01:03,264][123090] Updated weights for policy 1, policy_version 1172174 (0.0010) [2023-12-26 09:01:03,314][123090] Updated weights for policy 1, policy_version 1172184 (0.0009) [2023-12-26 09:01:03,336][123091] Updated weights for policy 0, policy_version 1180534 (0.0007) [2023-12-26 09:01:03,392][123091] Updated weights for policy 0, policy_version 1180544 (0.0009) [2023-12-26 09:01:03,449][123091] Updated weights for policy 0, policy_version 1180554 (0.0009) [2023-12-26 09:01:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 602308608. Throughput: 0: 8728.0, 1: 8934.8. Samples: 602317300. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:03,785][121949] Avg episode reward: [(0, '6139.417'), (1, '5588.040')] [2023-12-26 09:01:04,150][123090] Updated weights for policy 1, policy_version 1172194 (0.0009) [2023-12-26 09:01:04,155][123091] Updated weights for policy 0, policy_version 1180564 (0.0010) [2023-12-26 09:01:04,215][123091] Updated weights for policy 0, policy_version 1180574 (0.0007) [2023-12-26 09:01:04,219][123090] Updated weights for policy 1, policy_version 1172204 (0.0011) [2023-12-26 09:01:04,283][123090] Updated weights for policy 1, policy_version 1172214 (0.0011) [2023-12-26 09:01:04,284][123091] Updated weights for policy 0, policy_version 1180584 (0.0006) [2023-12-26 09:01:04,352][123090] Updated weights for policy 1, policy_version 1172224 (0.0009) [2023-12-26 09:01:04,966][123091] Updated weights for policy 0, policy_version 1180594 (0.0007) [2023-12-26 09:01:05,022][123091] Updated weights for policy 0, policy_version 1180604 (0.0005) [2023-12-26 09:01:05,081][123090] Updated weights for policy 1, policy_version 1172234 (0.0005) [2023-12-26 09:01:05,086][123091] Updated weights for policy 0, policy_version 1180614 (0.0005) [2023-12-26 09:01:05,146][123091] Updated weights for policy 0, policy_version 1180624 (0.0007) [2023-12-26 09:01:05,149][123090] Updated weights for policy 1, policy_version 1172244 (0.0010) [2023-12-26 09:01:05,211][123090] Updated weights for policy 1, policy_version 1172254 (0.0010) [2023-12-26 09:01:05,888][123091] Updated weights for policy 0, policy_version 1180634 (0.0009) [2023-12-26 09:01:05,944][123091] Updated weights for policy 0, policy_version 1180644 (0.0009) [2023-12-26 09:01:06,002][123091] Updated weights for policy 0, policy_version 1180654 (0.0008) [2023-12-26 09:01:06,027][123090] Updated weights for policy 1, policy_version 1172264 (0.0011) [2023-12-26 09:01:06,099][123090] Updated weights for policy 1, policy_version 1172274 (0.0011) [2023-12-26 09:01:06,172][123090] Updated weights for policy 1, policy_version 1172284 (0.0011) [2023-12-26 09:01:06,861][123091] Updated weights for policy 0, policy_version 1180664 (0.0009) [2023-12-26 09:01:06,918][123091] Updated weights for policy 0, policy_version 1180674 (0.0008) [2023-12-26 09:01:06,974][123091] Updated weights for policy 0, policy_version 1180684 (0.0009) [2023-12-26 09:01:06,990][123090] Updated weights for policy 1, policy_version 1172294 (0.0010) [2023-12-26 09:01:07,038][123090] Updated weights for policy 1, policy_version 1172304 (0.0010) [2023-12-26 09:01:07,090][123090] Updated weights for policy 1, policy_version 1172314 (0.0010) [2023-12-26 09:01:07,834][123090] Updated weights for policy 1, policy_version 1172324 (0.0008) [2023-12-26 09:01:07,840][123091] Updated weights for policy 0, policy_version 1180694 (0.0009) [2023-12-26 09:01:07,895][123090] Updated weights for policy 1, policy_version 1172334 (0.0005) [2023-12-26 09:01:07,904][123091] Updated weights for policy 0, policy_version 1180704 (0.0009) [2023-12-26 09:01:07,950][123090] Updated weights for policy 1, policy_version 1172344 (0.0005) [2023-12-26 09:01:07,956][123091] Updated weights for policy 0, policy_version 1180714 (0.0009) [2023-12-26 09:01:08,716][123090] Updated weights for policy 1, policy_version 1172354 (0.0007) [2023-12-26 09:01:08,781][123090] Updated weights for policy 1, policy_version 1172364 (0.0005) [2023-12-26 09:01:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 602390528. Throughput: 0: 8826.2, 1: 8983.2. Samples: 602372336. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:08,786][121949] Avg episode reward: [(0, '6097.430'), (1, '5631.498')] [2023-12-26 09:01:08,824][123091] Updated weights for policy 0, policy_version 1180724 (0.0007) [2023-12-26 09:01:08,851][123090] Updated weights for policy 1, policy_version 1172374 (0.0011) [2023-12-26 09:01:08,887][123091] Updated weights for policy 0, policy_version 1180734 (0.0006) [2023-12-26 09:01:08,911][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001172384_300130304.pth... [2023-12-26 09:01:08,915][123090] Updated weights for policy 1, policy_version 1172384 (0.0010) [2023-12-26 09:01:08,916][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001171328_299859968.pth [2023-12-26 09:01:08,947][123091] Updated weights for policy 0, policy_version 1180744 (0.0007) [2023-12-26 09:01:09,003][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001180752_302276608.pth... [2023-12-26 09:01:09,008][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001179696_302006272.pth [2023-12-26 09:01:09,651][123090] Updated weights for policy 1, policy_version 1172394 (0.0010) [2023-12-26 09:01:09,696][123091] Updated weights for policy 0, policy_version 1180754 (0.0009) [2023-12-26 09:01:09,711][123090] Updated weights for policy 1, policy_version 1172404 (0.0011) [2023-12-26 09:01:09,756][123091] Updated weights for policy 0, policy_version 1180764 (0.0011) [2023-12-26 09:01:09,768][123090] Updated weights for policy 1, policy_version 1172414 (0.0011) [2023-12-26 09:01:09,824][123091] Updated weights for policy 0, policy_version 1180774 (0.0011) [2023-12-26 09:01:09,892][123091] Updated weights for policy 0, policy_version 1180784 (0.0009) [2023-12-26 09:01:10,600][123090] Updated weights for policy 1, policy_version 1172424 (0.0007) [2023-12-26 09:01:10,654][123091] Updated weights for policy 0, policy_version 1180794 (0.0011) [2023-12-26 09:01:10,674][123090] Updated weights for policy 1, policy_version 1172434 (0.0006) [2023-12-26 09:01:10,714][123091] Updated weights for policy 0, policy_version 1180804 (0.0011) [2023-12-26 09:01:10,740][123090] Updated weights for policy 1, policy_version 1172444 (0.0011) [2023-12-26 09:01:10,774][123091] Updated weights for policy 0, policy_version 1180814 (0.0011) [2023-12-26 09:01:11,535][123090] Updated weights for policy 1, policy_version 1172454 (0.0010) [2023-12-26 09:01:11,596][123090] Updated weights for policy 1, policy_version 1172464 (0.0011) [2023-12-26 09:01:11,650][123091] Updated weights for policy 0, policy_version 1180824 (0.0009) [2023-12-26 09:01:11,666][123090] Updated weights for policy 1, policy_version 1172474 (0.0010) [2023-12-26 09:01:11,725][123091] Updated weights for policy 0, policy_version 1180834 (0.0010) [2023-12-26 09:01:11,786][123091] Updated weights for policy 0, policy_version 1180844 (0.0011) [2023-12-26 09:01:12,507][123090] Updated weights for policy 1, policy_version 1172484 (0.0010) [2023-12-26 09:01:12,560][123090] Updated weights for policy 1, policy_version 1172494 (0.0010) [2023-12-26 09:01:12,588][123091] Updated weights for policy 0, policy_version 1180854 (0.0008) [2023-12-26 09:01:12,623][123090] Updated weights for policy 1, policy_version 1172504 (0.0009) [2023-12-26 09:01:12,650][123091] Updated weights for policy 0, policy_version 1180864 (0.0006) [2023-12-26 09:01:12,718][123091] Updated weights for policy 0, policy_version 1180874 (0.0010) [2023-12-26 09:01:13,456][123090] Updated weights for policy 1, policy_version 1172514 (0.0008) [2023-12-26 09:01:13,509][123090] Updated weights for policy 1, policy_version 1172524 (0.0005) [2023-12-26 09:01:13,514][123091] Updated weights for policy 0, policy_version 1180884 (0.0010) [2023-12-26 09:01:13,567][123090] Updated weights for policy 1, policy_version 1172534 (0.0008) [2023-12-26 09:01:13,574][123091] Updated weights for policy 0, policy_version 1180894 (0.0007) [2023-12-26 09:01:13,628][123090] Updated weights for policy 1, policy_version 1172544 (0.0008) [2023-12-26 09:01:13,633][123091] Updated weights for policy 0, policy_version 1180904 (0.0010) [2023-12-26 09:01:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 602488832. Throughput: 0: 8826.6, 1: 8977.7. Samples: 602477312. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:13,785][121949] Avg episode reward: [(0, '6114.341'), (1, '5625.012')] [2023-12-26 09:01:14,444][123091] Updated weights for policy 0, policy_version 1180914 (0.0010) [2023-12-26 09:01:14,450][123090] Updated weights for policy 1, policy_version 1172554 (0.0009) [2023-12-26 09:01:14,506][123090] Updated weights for policy 1, policy_version 1172564 (0.0005) [2023-12-26 09:01:14,509][123091] Updated weights for policy 0, policy_version 1180924 (0.0010) [2023-12-26 09:01:14,564][123090] Updated weights for policy 1, policy_version 1172574 (0.0005) [2023-12-26 09:01:14,579][123091] Updated weights for policy 0, policy_version 1180934 (0.0011) [2023-12-26 09:01:14,648][123091] Updated weights for policy 0, policy_version 1180944 (0.0010) [2023-12-26 09:01:15,316][123090] Updated weights for policy 1, policy_version 1172584 (0.0008) [2023-12-26 09:01:15,391][123090] Updated weights for policy 1, policy_version 1172594 (0.0006) [2023-12-26 09:01:15,440][123091] Updated weights for policy 0, policy_version 1180954 (0.0011) [2023-12-26 09:01:15,460][123090] Updated weights for policy 1, policy_version 1172604 (0.0007) [2023-12-26 09:01:15,507][123091] Updated weights for policy 0, policy_version 1180964 (0.0011) [2023-12-26 09:01:15,574][123091] Updated weights for policy 0, policy_version 1180974 (0.0011) [2023-12-26 09:01:16,216][123090] Updated weights for policy 1, policy_version 1172614 (0.0008) [2023-12-26 09:01:16,279][123090] Updated weights for policy 1, policy_version 1172624 (0.0005) [2023-12-26 09:01:16,315][123091] Updated weights for policy 0, policy_version 1180984 (0.0006) [2023-12-26 09:01:16,347][123090] Updated weights for policy 1, policy_version 1172634 (0.0005) [2023-12-26 09:01:16,371][123091] Updated weights for policy 0, policy_version 1180994 (0.0005) [2023-12-26 09:01:16,427][123091] Updated weights for policy 0, policy_version 1181004 (0.0006) [2023-12-26 09:01:17,043][123091] Updated weights for policy 0, policy_version 1181014 (0.0008) [2023-12-26 09:01:17,094][123091] Updated weights for policy 0, policy_version 1181024 (0.0008) [2023-12-26 09:01:17,094][123090] Updated weights for policy 1, policy_version 1172644 (0.0008) [2023-12-26 09:01:17,157][123091] Updated weights for policy 0, policy_version 1181034 (0.0010) [2023-12-26 09:01:17,160][123090] Updated weights for policy 1, policy_version 1172654 (0.0008) [2023-12-26 09:01:17,232][123090] Updated weights for policy 1, policy_version 1172664 (0.0005) [2023-12-26 09:01:17,881][123090] Updated weights for policy 1, policy_version 1172674 (0.0005) [2023-12-26 09:01:17,938][123090] Updated weights for policy 1, policy_version 1172684 (0.0006) [2023-12-26 09:01:17,993][123090] Updated weights for policy 1, policy_version 1172694 (0.0010) [2023-12-26 09:01:18,020][123091] Updated weights for policy 0, policy_version 1181044 (0.0007) [2023-12-26 09:01:18,056][123090] Updated weights for policy 1, policy_version 1172704 (0.0010) [2023-12-26 09:01:18,078][123091] Updated weights for policy 0, policy_version 1181054 (0.0005) [2023-12-26 09:01:18,136][123091] Updated weights for policy 0, policy_version 1181064 (0.0005) [2023-12-26 09:01:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 602570752. Throughput: 0: 8864.4, 1: 9015.6. Samples: 602586900. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:18,785][121949] Avg episode reward: [(0, '6147.877'), (1, '5611.877')] [2023-12-26 09:01:18,821][123091] Updated weights for policy 0, policy_version 1181074 (0.0005) [2023-12-26 09:01:18,861][123090] Updated weights for policy 1, policy_version 1172714 (0.0010) [2023-12-26 09:01:18,876][123091] Updated weights for policy 0, policy_version 1181084 (0.0006) [2023-12-26 09:01:18,917][123090] Updated weights for policy 1, policy_version 1172724 (0.0010) [2023-12-26 09:01:18,937][123091] Updated weights for policy 0, policy_version 1181094 (0.0006) [2023-12-26 09:01:18,983][123090] Updated weights for policy 1, policy_version 1172734 (0.0010) [2023-12-26 09:01:18,992][123091] Updated weights for policy 0, policy_version 1181104 (0.0006) [2023-12-26 09:01:19,772][123091] Updated weights for policy 0, policy_version 1181114 (0.0011) [2023-12-26 09:01:19,810][123090] Updated weights for policy 1, policy_version 1172744 (0.0010) [2023-12-26 09:01:19,829][123091] Updated weights for policy 0, policy_version 1181124 (0.0011) [2023-12-26 09:01:19,871][123090] Updated weights for policy 1, policy_version 1172754 (0.0010) [2023-12-26 09:01:19,898][123091] Updated weights for policy 0, policy_version 1181134 (0.0009) [2023-12-26 09:01:19,948][123090] Updated weights for policy 1, policy_version 1172764 (0.0009) [2023-12-26 09:01:20,620][123091] Updated weights for policy 0, policy_version 1181144 (0.0010) [2023-12-26 09:01:20,686][123091] Updated weights for policy 0, policy_version 1181154 (0.0011) [2023-12-26 09:01:20,746][123091] Updated weights for policy 0, policy_version 1181164 (0.0011) [2023-12-26 09:01:20,758][123090] Updated weights for policy 1, policy_version 1172774 (0.0010) [2023-12-26 09:01:20,818][123090] Updated weights for policy 1, policy_version 1172784 (0.0010) [2023-12-26 09:01:20,882][123090] Updated weights for policy 1, policy_version 1172794 (0.0010) [2023-12-26 09:01:21,545][123091] Updated weights for policy 0, policy_version 1181174 (0.0011) [2023-12-26 09:01:21,609][123091] Updated weights for policy 0, policy_version 1181184 (0.0011) [2023-12-26 09:01:21,677][123091] Updated weights for policy 0, policy_version 1181194 (0.0007) [2023-12-26 09:01:21,772][123090] Updated weights for policy 1, policy_version 1172804 (0.0010) [2023-12-26 09:01:21,840][123090] Updated weights for policy 1, policy_version 1172814 (0.0011) [2023-12-26 09:01:21,904][123090] Updated weights for policy 1, policy_version 1172824 (0.0011) [2023-12-26 09:01:22,507][123091] Updated weights for policy 0, policy_version 1181204 (0.0006) [2023-12-26 09:01:22,577][123091] Updated weights for policy 0, policy_version 1181214 (0.0006) [2023-12-26 09:01:22,641][123091] Updated weights for policy 0, policy_version 1181224 (0.0005) [2023-12-26 09:01:22,743][123090] Updated weights for policy 1, policy_version 1172834 (0.0009) [2023-12-26 09:01:22,815][123090] Updated weights for policy 1, policy_version 1172844 (0.0005) [2023-12-26 09:01:22,894][123090] Updated weights for policy 1, policy_version 1172854 (0.0005) [2023-12-26 09:01:22,958][123090] Updated weights for policy 1, policy_version 1172864 (0.0006) [2023-12-26 09:01:23,353][123091] Updated weights for policy 0, policy_version 1181234 (0.0006) [2023-12-26 09:01:23,408][123091] Updated weights for policy 0, policy_version 1181244 (0.0005) [2023-12-26 09:01:23,462][123091] Updated weights for policy 0, policy_version 1181254 (0.0009) [2023-12-26 09:01:23,684][123090] Updated weights for policy 1, policy_version 1172874 (0.0009) [2023-12-26 09:01:23,746][123090] Updated weights for policy 1, policy_version 1172885 (0.0010) [2023-12-26 09:01:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 602660864. Throughput: 0: 8902.2, 1: 8950.8. Samples: 602640108. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:23,785][121949] Avg episode reward: [(0, '6013.282'), (1, '5661.696')] [2023-12-26 09:01:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001181264_302407680.pth... [2023-12-26 09:01:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001180208_302137344.pth [2023-12-26 09:01:23,804][123090] Updated weights for policy 1, policy_version 1172895 (0.0009) [2023-12-26 09:01:23,805][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001172896_300261376.pth... [2023-12-26 09:01:23,808][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001171840_299991040.pth [2023-12-26 09:01:24,217][123091] Updated weights for policy 0, policy_version 1181265 (0.0009) [2023-12-26 09:01:24,279][123091] Updated weights for policy 0, policy_version 1181275 (0.0005) [2023-12-26 09:01:24,355][123091] Updated weights for policy 0, policy_version 1181285 (0.0006) [2023-12-26 09:01:24,429][123091] Updated weights for policy 0, policy_version 1181295 (0.0006) [2023-12-26 09:01:24,507][123090] Updated weights for policy 1, policy_version 1172905 (0.0006) [2023-12-26 09:01:24,563][123090] Updated weights for policy 1, policy_version 1172915 (0.0007) [2023-12-26 09:01:24,624][123090] Updated weights for policy 1, policy_version 1172925 (0.0009) [2023-12-26 09:01:25,052][123091] Updated weights for policy 0, policy_version 1181305 (0.0005) [2023-12-26 09:01:25,098][123091] Updated weights for policy 0, policy_version 1181315 (0.0005) [2023-12-26 09:01:25,158][123091] Updated weights for policy 0, policy_version 1181325 (0.0005) [2023-12-26 09:01:25,415][123090] Updated weights for policy 1, policy_version 1172935 (0.0007) [2023-12-26 09:01:25,486][123090] Updated weights for policy 1, policy_version 1172945 (0.0007) [2023-12-26 09:01:25,555][123090] Updated weights for policy 1, policy_version 1172955 (0.0009) [2023-12-26 09:01:25,981][123091] Updated weights for policy 0, policy_version 1181335 (0.0010) [2023-12-26 09:01:26,040][123091] Updated weights for policy 0, policy_version 1181345 (0.0008) [2023-12-26 09:01:26,103][123091] Updated weights for policy 0, policy_version 1181355 (0.0009) [2023-12-26 09:01:26,308][123090] Updated weights for policy 1, policy_version 1172965 (0.0010) [2023-12-26 09:01:26,360][123090] Updated weights for policy 1, policy_version 1172975 (0.0010) [2023-12-26 09:01:26,411][123090] Updated weights for policy 1, policy_version 1172985 (0.0010) [2023-12-26 09:01:26,921][123091] Updated weights for policy 0, policy_version 1181365 (0.0009) [2023-12-26 09:01:26,979][123091] Updated weights for policy 0, policy_version 1181375 (0.0010) [2023-12-26 09:01:27,038][123091] Updated weights for policy 0, policy_version 1181385 (0.0011) [2023-12-26 09:01:27,202][123090] Updated weights for policy 1, policy_version 1172995 (0.0009) [2023-12-26 09:01:27,268][123090] Updated weights for policy 1, policy_version 1173005 (0.0008) [2023-12-26 09:01:27,323][123090] Updated weights for policy 1, policy_version 1173015 (0.0008) [2023-12-26 09:01:27,858][123091] Updated weights for policy 0, policy_version 1181395 (0.0011) [2023-12-26 09:01:27,923][123091] Updated weights for policy 0, policy_version 1181405 (0.0010) [2023-12-26 09:01:27,969][123091] Updated weights for policy 0, policy_version 1181415 (0.0010) [2023-12-26 09:01:28,099][123090] Updated weights for policy 1, policy_version 1173025 (0.0009) [2023-12-26 09:01:28,146][123090] Updated weights for policy 1, policy_version 1173035 (0.0005) [2023-12-26 09:01:28,193][123090] Updated weights for policy 1, policy_version 1173045 (0.0005) [2023-12-26 09:01:28,247][123090] Updated weights for policy 1, policy_version 1173055 (0.0005) [2023-12-26 09:01:28,721][123091] Updated weights for policy 0, policy_version 1181425 (0.0008) [2023-12-26 09:01:28,779][123091] Updated weights for policy 0, policy_version 1181435 (0.0008) [2023-12-26 09:01:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 602750976. Throughput: 0: 8978.5, 1: 8966.8. Samples: 602747572. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:28,785][121949] Avg episode reward: [(0, '6002.334'), (1, '5561.725')] [2023-12-26 09:01:28,841][123091] Updated weights for policy 0, policy_version 1181445 (0.0008) [2023-12-26 09:01:28,907][123091] Updated weights for policy 0, policy_version 1181455 (0.0007) [2023-12-26 09:01:28,963][123090] Updated weights for policy 1, policy_version 1173065 (0.0010) [2023-12-26 09:01:29,011][123090] Updated weights for policy 1, policy_version 1173075 (0.0010) [2023-12-26 09:01:29,059][123090] Updated weights for policy 1, policy_version 1173085 (0.0010) [2023-12-26 09:01:29,657][123091] Updated weights for policy 0, policy_version 1181465 (0.0008) [2023-12-26 09:01:29,709][123091] Updated weights for policy 0, policy_version 1181475 (0.0006) [2023-12-26 09:01:29,769][123091] Updated weights for policy 0, policy_version 1181485 (0.0006) [2023-12-26 09:01:29,942][123090] Updated weights for policy 1, policy_version 1173095 (0.0010) [2023-12-26 09:01:30,011][123090] Updated weights for policy 1, policy_version 1173105 (0.0009) [2023-12-26 09:01:30,071][123090] Updated weights for policy 1, policy_version 1173115 (0.0008) [2023-12-26 09:01:30,565][123091] Updated weights for policy 0, policy_version 1181495 (0.0010) [2023-12-26 09:01:30,622][123091] Updated weights for policy 0, policy_version 1181505 (0.0007) [2023-12-26 09:01:30,690][123091] Updated weights for policy 0, policy_version 1181515 (0.0005) [2023-12-26 09:01:30,920][123090] Updated weights for policy 1, policy_version 1173125 (0.0009) [2023-12-26 09:01:30,967][123090] Updated weights for policy 1, policy_version 1173135 (0.0010) [2023-12-26 09:01:31,018][123090] Updated weights for policy 1, policy_version 1173145 (0.0010) [2023-12-26 09:01:31,398][123091] Updated weights for policy 0, policy_version 1181525 (0.0008) [2023-12-26 09:01:31,454][123091] Updated weights for policy 0, policy_version 1181535 (0.0009) [2023-12-26 09:01:31,500][123091] Updated weights for policy 0, policy_version 1181545 (0.0005) [2023-12-26 09:01:31,832][123090] Updated weights for policy 1, policy_version 1173155 (0.0010) [2023-12-26 09:01:31,900][123090] Updated weights for policy 1, policy_version 1173165 (0.0008) [2023-12-26 09:01:31,948][123090] Updated weights for policy 1, policy_version 1173175 (0.0009) [2023-12-26 09:01:32,305][123091] Updated weights for policy 0, policy_version 1181555 (0.0006) [2023-12-26 09:01:32,375][123091] Updated weights for policy 0, policy_version 1181565 (0.0008) [2023-12-26 09:01:32,440][123091] Updated weights for policy 0, policy_version 1181575 (0.0006) [2023-12-26 09:01:32,748][123090] Updated weights for policy 1, policy_version 1173185 (0.0008) [2023-12-26 09:01:32,819][123090] Updated weights for policy 1, policy_version 1173195 (0.0006) [2023-12-26 09:01:32,884][123090] Updated weights for policy 1, policy_version 1173205 (0.0008) [2023-12-26 09:01:32,948][123090] Updated weights for policy 1, policy_version 1173215 (0.0008) [2023-12-26 09:01:33,093][123091] Updated weights for policy 0, policy_version 1181585 (0.0007) [2023-12-26 09:01:33,152][123091] Updated weights for policy 0, policy_version 1181595 (0.0010) [2023-12-26 09:01:33,214][123091] Updated weights for policy 0, policy_version 1181605 (0.0011) [2023-12-26 09:01:33,275][123091] Updated weights for policy 0, policy_version 1181615 (0.0006) [2023-12-26 09:01:33,611][123090] Updated weights for policy 1, policy_version 1173225 (0.0006) [2023-12-26 09:01:33,678][123090] Updated weights for policy 1, policy_version 1173235 (0.0007) [2023-12-26 09:01:33,745][123090] Updated weights for policy 1, policy_version 1173245 (0.0010) [2023-12-26 09:01:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 602849280. Throughput: 0: 9047.1, 1: 8904.4. Samples: 602858928. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:33,785][121949] Avg episode reward: [(0, '6116.047'), (1, '5515.000')] [2023-12-26 09:01:33,990][123091] Updated weights for policy 0, policy_version 1181625 (0.0010) [2023-12-26 09:01:34,058][123091] Updated weights for policy 0, policy_version 1181635 (0.0011) [2023-12-26 09:01:34,120][123091] Updated weights for policy 0, policy_version 1181645 (0.0010) [2023-12-26 09:01:34,472][123090] Updated weights for policy 1, policy_version 1173255 (0.0011) [2023-12-26 09:01:34,524][123090] Updated weights for policy 1, policy_version 1173265 (0.0010) [2023-12-26 09:01:34,585][123090] Updated weights for policy 1, policy_version 1173275 (0.0010) [2023-12-26 09:01:34,827][123091] Updated weights for policy 0, policy_version 1181655 (0.0007) [2023-12-26 09:01:34,897][123091] Updated weights for policy 0, policy_version 1181665 (0.0006) [2023-12-26 09:01:34,966][123091] Updated weights for policy 0, policy_version 1181675 (0.0006) [2023-12-26 09:01:35,437][123090] Updated weights for policy 1, policy_version 1173285 (0.0010) [2023-12-26 09:01:35,489][123090] Updated weights for policy 1, policy_version 1173295 (0.0010) [2023-12-26 09:01:35,517][123091] Updated weights for policy 0, policy_version 1181685 (0.0005) [2023-12-26 09:01:35,541][123090] Updated weights for policy 1, policy_version 1173305 (0.0010) [2023-12-26 09:01:35,575][123091] Updated weights for policy 0, policy_version 1181695 (0.0009) [2023-12-26 09:01:35,631][123091] Updated weights for policy 0, policy_version 1181705 (0.0009) [2023-12-26 09:01:36,311][123090] Updated weights for policy 1, policy_version 1173315 (0.0010) [2023-12-26 09:01:36,379][123090] Updated weights for policy 1, policy_version 1173325 (0.0010) [2023-12-26 09:01:36,441][123091] Updated weights for policy 0, policy_version 1181715 (0.0009) [2023-12-26 09:01:36,446][123090] Updated weights for policy 1, policy_version 1173335 (0.0010) [2023-12-26 09:01:36,509][123091] Updated weights for policy 0, policy_version 1181725 (0.0006) [2023-12-26 09:01:36,577][123091] Updated weights for policy 0, policy_version 1181735 (0.0007) [2023-12-26 09:01:37,289][123090] Updated weights for policy 1, policy_version 1173345 (0.0007) [2023-12-26 09:01:37,302][123091] Updated weights for policy 0, policy_version 1181745 (0.0008) [2023-12-26 09:01:37,355][123091] Updated weights for policy 0, policy_version 1181755 (0.0005) [2023-12-26 09:01:37,358][123090] Updated weights for policy 1, policy_version 1173355 (0.0008) [2023-12-26 09:01:37,407][123090] Updated weights for policy 1, policy_version 1173365 (0.0009) [2023-12-26 09:01:37,408][123091] Updated weights for policy 0, policy_version 1181765 (0.0006) [2023-12-26 09:01:37,468][123091] Updated weights for policy 0, policy_version 1181775 (0.0009) [2023-12-26 09:01:37,472][123090] Updated weights for policy 1, policy_version 1173375 (0.0007) [2023-12-26 09:01:38,262][123091] Updated weights for policy 0, policy_version 1181785 (0.0008) [2023-12-26 09:01:38,315][123090] Updated weights for policy 1, policy_version 1173385 (0.0010) [2023-12-26 09:01:38,325][123091] Updated weights for policy 0, policy_version 1181795 (0.0006) [2023-12-26 09:01:38,381][123090] Updated weights for policy 1, policy_version 1173395 (0.0009) [2023-12-26 09:01:38,398][123091] Updated weights for policy 0, policy_version 1181805 (0.0008) [2023-12-26 09:01:38,445][123090] Updated weights for policy 1, policy_version 1173405 (0.0006) [2023-12-26 09:01:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 602939392. Throughput: 0: 9109.4, 1: 8934.4. Samples: 602914492. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:38,785][121949] Avg episode reward: [(0, '6110.125'), (1, '5400.540')] [2023-12-26 09:01:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001181808_302546944.pth... [2023-12-26 09:01:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001173408_300392448.pth... [2023-12-26 09:01:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001180752_302276608.pth [2023-12-26 09:01:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001172384_300130304.pth [2023-12-26 09:01:39,155][123090] Updated weights for policy 1, policy_version 1173415 (0.0008) [2023-12-26 09:01:39,207][123090] Updated weights for policy 1, policy_version 1173425 (0.0009) [2023-12-26 09:01:39,272][123090] Updated weights for policy 1, policy_version 1173435 (0.0009) [2023-12-26 09:01:39,276][123091] Updated weights for policy 0, policy_version 1181815 (0.0009) [2023-12-26 09:01:39,354][123091] Updated weights for policy 0, policy_version 1181825 (0.0007) [2023-12-26 09:01:39,422][123091] Updated weights for policy 0, policy_version 1181835 (0.0008) [2023-12-26 09:01:40,118][123090] Updated weights for policy 1, policy_version 1173445 (0.0009) [2023-12-26 09:01:40,181][123090] Updated weights for policy 1, policy_version 1173455 (0.0008) [2023-12-26 09:01:40,220][123091] Updated weights for policy 0, policy_version 1181845 (0.0008) [2023-12-26 09:01:40,243][123090] Updated weights for policy 1, policy_version 1173465 (0.0008) [2023-12-26 09:01:40,280][123091] Updated weights for policy 0, policy_version 1181855 (0.0007) [2023-12-26 09:01:40,349][123091] Updated weights for policy 0, policy_version 1181865 (0.0010) [2023-12-26 09:01:40,947][123090] Updated weights for policy 1, policy_version 1173475 (0.0009) [2023-12-26 09:01:40,996][123090] Updated weights for policy 1, policy_version 1173485 (0.0006) [2023-12-26 09:01:41,055][123090] Updated weights for policy 1, policy_version 1173495 (0.0009) [2023-12-26 09:01:41,170][123091] Updated weights for policy 0, policy_version 1181875 (0.0008) [2023-12-26 09:01:41,230][123091] Updated weights for policy 0, policy_version 1181885 (0.0006) [2023-12-26 09:01:41,292][123091] Updated weights for policy 0, policy_version 1181895 (0.0007) [2023-12-26 09:01:41,937][123090] Updated weights for policy 1, policy_version 1173505 (0.0010) [2023-12-26 09:01:42,009][123090] Updated weights for policy 1, policy_version 1173515 (0.0011) [2023-12-26 09:01:42,080][123090] Updated weights for policy 1, policy_version 1173525 (0.0011) [2023-12-26 09:01:42,102][123091] Updated weights for policy 0, policy_version 1181905 (0.0007) [2023-12-26 09:01:42,145][123090] Updated weights for policy 1, policy_version 1173535 (0.0011) [2023-12-26 09:01:42,167][123091] Updated weights for policy 0, policy_version 1181915 (0.0009) [2023-12-26 09:01:42,236][123091] Updated weights for policy 0, policy_version 1181925 (0.0007) [2023-12-26 09:01:42,294][123091] Updated weights for policy 0, policy_version 1181935 (0.0009) [2023-12-26 09:01:42,999][123090] Updated weights for policy 1, policy_version 1173545 (0.0007) [2023-12-26 09:01:43,051][123090] Updated weights for policy 1, policy_version 1173555 (0.0010) [2023-12-26 09:01:43,106][123090] Updated weights for policy 1, policy_version 1173565 (0.0010) [2023-12-26 09:01:43,153][123091] Updated weights for policy 0, policy_version 1181945 (0.0008) [2023-12-26 09:01:43,217][123091] Updated weights for policy 0, policy_version 1181955 (0.0008) [2023-12-26 09:01:43,276][123091] Updated weights for policy 0, policy_version 1181965 (0.0009) [2023-12-26 09:01:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 603021312. Throughput: 0: 9032.4, 1: 8859.2. Samples: 603018052. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:43,785][121949] Avg episode reward: [(0, '6155.138'), (1, '5268.884')] [2023-12-26 09:01:43,841][123090] Updated weights for policy 1, policy_version 1173575 (0.0010) [2023-12-26 09:01:43,911][123090] Updated weights for policy 1, policy_version 1173585 (0.0010) [2023-12-26 09:01:43,969][123090] Updated weights for policy 1, policy_version 1173595 (0.0010) [2023-12-26 09:01:44,153][123091] Updated weights for policy 0, policy_version 1181975 (0.0009) [2023-12-26 09:01:44,212][123091] Updated weights for policy 0, policy_version 1181986 (0.0009) [2023-12-26 09:01:44,272][123091] Updated weights for policy 0, policy_version 1181996 (0.0009) [2023-12-26 09:01:44,774][123090] Updated weights for policy 1, policy_version 1173605 (0.0011) [2023-12-26 09:01:44,842][123090] Updated weights for policy 1, policy_version 1173615 (0.0009) [2023-12-26 09:01:44,903][123090] Updated weights for policy 1, policy_version 1173625 (0.0009) [2023-12-26 09:01:45,154][123091] Updated weights for policy 0, policy_version 1182006 (0.0009) [2023-12-26 09:01:45,225][123091] Updated weights for policy 0, policy_version 1182016 (0.0009) [2023-12-26 09:01:45,292][123091] Updated weights for policy 0, policy_version 1182026 (0.0009) [2023-12-26 09:01:45,698][123090] Updated weights for policy 1, policy_version 1173635 (0.0009) [2023-12-26 09:01:45,753][123090] Updated weights for policy 1, policy_version 1173645 (0.0005) [2023-12-26 09:01:45,807][123090] Updated weights for policy 1, policy_version 1173655 (0.0005) [2023-12-26 09:01:46,130][123091] Updated weights for policy 0, policy_version 1182036 (0.0009) [2023-12-26 09:01:46,192][123091] Updated weights for policy 0, policy_version 1182046 (0.0009) [2023-12-26 09:01:46,254][123091] Updated weights for policy 0, policy_version 1182056 (0.0009) [2023-12-26 09:01:46,532][123090] Updated weights for policy 1, policy_version 1173665 (0.0006) [2023-12-26 09:01:46,603][123090] Updated weights for policy 1, policy_version 1173675 (0.0009) [2023-12-26 09:01:46,671][123090] Updated weights for policy 1, policy_version 1173685 (0.0009) [2023-12-26 09:01:46,738][123090] Updated weights for policy 1, policy_version 1173695 (0.0009) [2023-12-26 09:01:47,093][123091] Updated weights for policy 0, policy_version 1182066 (0.0009) [2023-12-26 09:01:47,143][123091] Updated weights for policy 0, policy_version 1182076 (0.0009) [2023-12-26 09:01:47,194][123091] Updated weights for policy 0, policy_version 1182087 (0.0010) [2023-12-26 09:01:47,415][123090] Updated weights for policy 1, policy_version 1173705 (0.0009) [2023-12-26 09:01:47,476][123090] Updated weights for policy 1, policy_version 1173715 (0.0009) [2023-12-26 09:01:47,524][123090] Updated weights for policy 1, policy_version 1173725 (0.0009) [2023-12-26 09:01:48,094][123091] Updated weights for policy 0, policy_version 1182098 (0.0010) [2023-12-26 09:01:48,148][123091] Updated weights for policy 0, policy_version 1182108 (0.0010) [2023-12-26 09:01:48,203][123091] Updated weights for policy 0, policy_version 1182119 (0.0010) [2023-12-26 09:01:48,292][123090] Updated weights for policy 1, policy_version 1173735 (0.0009) [2023-12-26 09:01:48,362][123090] Updated weights for policy 1, policy_version 1173745 (0.0009) [2023-12-26 09:01:48,430][123090] Updated weights for policy 1, policy_version 1173755 (0.0010) [2023-12-26 09:01:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 603111424. Throughput: 0: 8979.0, 1: 8921.9. Samples: 603122844. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:48,785][121949] Avg episode reward: [(0, '6248.199'), (1, '5228.566')] [2023-12-26 09:01:49,076][123091] Updated weights for policy 0, policy_version 1182129 (0.0009) [2023-12-26 09:01:49,131][123091] Updated weights for policy 0, policy_version 1182139 (0.0010) [2023-12-26 09:01:49,186][123091] Updated weights for policy 0, policy_version 1182149 (0.0010) [2023-12-26 09:01:49,235][123090] Updated weights for policy 1, policy_version 1173765 (0.0009) [2023-12-26 09:01:49,255][123091] Updated weights for policy 0, policy_version 1182159 (0.0008) [2023-12-26 09:01:49,295][123090] Updated weights for policy 1, policy_version 1173775 (0.0008) [2023-12-26 09:01:49,376][123090] Updated weights for policy 1, policy_version 1173785 (0.0010) [2023-12-26 09:01:50,119][123091] Updated weights for policy 0, policy_version 1182169 (0.0010) [2023-12-26 09:01:50,181][123091] Updated weights for policy 0, policy_version 1182179 (0.0010) [2023-12-26 09:01:50,239][123090] Updated weights for policy 1, policy_version 1173795 (0.0008) [2023-12-26 09:01:50,243][123091] Updated weights for policy 0, policy_version 1182189 (0.0010) [2023-12-26 09:01:50,291][123090] Updated weights for policy 1, policy_version 1173805 (0.0005) [2023-12-26 09:01:50,358][123090] Updated weights for policy 1, policy_version 1173815 (0.0008) [2023-12-26 09:01:51,084][123091] Updated weights for policy 0, policy_version 1182199 (0.0009) [2023-12-26 09:01:51,151][123091] Updated weights for policy 0, policy_version 1182209 (0.0009) [2023-12-26 09:01:51,193][123090] Updated weights for policy 1, policy_version 1173825 (0.0009) [2023-12-26 09:01:51,214][123091] Updated weights for policy 0, policy_version 1182219 (0.0009) [2023-12-26 09:01:51,247][123090] Updated weights for policy 1, policy_version 1173835 (0.0008) [2023-12-26 09:01:51,306][123090] Updated weights for policy 1, policy_version 1173845 (0.0009) [2023-12-26 09:01:51,374][123090] Updated weights for policy 1, policy_version 1173855 (0.0009) [2023-12-26 09:01:52,003][123091] Updated weights for policy 0, policy_version 1182229 (0.0008) [2023-12-26 09:01:52,060][123091] Updated weights for policy 0, policy_version 1182239 (0.0009) [2023-12-26 09:01:52,123][123091] Updated weights for policy 0, policy_version 1182249 (0.0009) [2023-12-26 09:01:52,200][123090] Updated weights for policy 1, policy_version 1173865 (0.0009) [2023-12-26 09:01:52,249][123090] Updated weights for policy 1, policy_version 1173875 (0.0009) [2023-12-26 09:01:52,317][123090] Updated weights for policy 1, policy_version 1173885 (0.0008) [2023-12-26 09:01:52,952][123091] Updated weights for policy 0, policy_version 1182259 (0.0009) [2023-12-26 09:01:53,024][123091] Updated weights for policy 0, policy_version 1182269 (0.0006) [2023-12-26 09:01:53,095][123091] Updated weights for policy 0, policy_version 1182279 (0.0006) [2023-12-26 09:01:53,187][123090] Updated weights for policy 1, policy_version 1173895 (0.0006) [2023-12-26 09:01:53,242][123090] Updated weights for policy 1, policy_version 1173905 (0.0008) [2023-12-26 09:01:53,310][123090] Updated weights for policy 1, policy_version 1173915 (0.0009) [2023-12-26 09:01:53,766][123091] Updated weights for policy 0, policy_version 1182289 (0.0005) [2023-12-26 09:01:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 603193344. Throughput: 0: 8902.0, 1: 8901.9. Samples: 603173508. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:53,785][121949] Avg episode reward: [(0, '6306.109'), (1, '5443.409')] [2023-12-26 09:01:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001173920_300523520.pth... [2023-12-26 09:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001172896_300261376.pth [2023-12-26 09:01:53,822][123091] Updated weights for policy 0, policy_version 1182299 (0.0006) [2023-12-26 09:01:53,886][123091] Updated weights for policy 0, policy_version 1182309 (0.0005) [2023-12-26 09:01:53,901][123090] Updated weights for policy 1, policy_version 1173925 (0.0009) [2023-12-26 09:01:53,934][123091] Updated weights for policy 0, policy_version 1182319 (0.0007) [2023-12-26 09:01:53,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001182320_302678016.pth... [2023-12-26 09:01:53,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001181264_302407680.pth [2023-12-26 09:01:53,961][123090] Updated weights for policy 1, policy_version 1173935 (0.0009) [2023-12-26 09:01:54,017][123090] Updated weights for policy 1, policy_version 1173945 (0.0009) [2023-12-26 09:01:54,665][123091] Updated weights for policy 0, policy_version 1182329 (0.0010) [2023-12-26 09:01:54,725][123091] Updated weights for policy 0, policy_version 1182339 (0.0009) [2023-12-26 09:01:54,790][123091] Updated weights for policy 0, policy_version 1182349 (0.0009) [2023-12-26 09:01:54,828][123090] Updated weights for policy 1, policy_version 1173955 (0.0009) [2023-12-26 09:01:54,892][123090] Updated weights for policy 1, policy_version 1173965 (0.0009) [2023-12-26 09:01:54,965][123090] Updated weights for policy 1, policy_version 1173976 (0.0009) [2023-12-26 09:01:55,606][123091] Updated weights for policy 0, policy_version 1182359 (0.0010) [2023-12-26 09:01:55,666][123091] Updated weights for policy 0, policy_version 1182369 (0.0009) [2023-12-26 09:01:55,676][123090] Updated weights for policy 1, policy_version 1173986 (0.0009) [2023-12-26 09:01:55,721][123091] Updated weights for policy 0, policy_version 1182379 (0.0007) [2023-12-26 09:01:55,722][123090] Updated weights for policy 1, policy_version 1173996 (0.0007) [2023-12-26 09:01:55,778][123090] Updated weights for policy 1, policy_version 1174006 (0.0005) [2023-12-26 09:01:55,829][123090] Updated weights for policy 1, policy_version 1174016 (0.0005) [2023-12-26 09:01:56,572][123090] Updated weights for policy 1, policy_version 1174026 (0.0005) [2023-12-26 09:01:56,632][123091] Updated weights for policy 0, policy_version 1182389 (0.0009) [2023-12-26 09:01:56,636][123090] Updated weights for policy 1, policy_version 1174036 (0.0006) [2023-12-26 09:01:56,698][123090] Updated weights for policy 1, policy_version 1174046 (0.0005) [2023-12-26 09:01:56,698][123091] Updated weights for policy 0, policy_version 1182399 (0.0009) [2023-12-26 09:01:56,758][123091] Updated weights for policy 0, policy_version 1182409 (0.0009) [2023-12-26 09:01:57,280][123090] Updated weights for policy 1, policy_version 1174056 (0.0006) [2023-12-26 09:01:57,344][123090] Updated weights for policy 1, policy_version 1174066 (0.0009) [2023-12-26 09:01:57,393][123090] Updated weights for policy 1, policy_version 1174076 (0.0009) [2023-12-26 09:01:57,635][123091] Updated weights for policy 0, policy_version 1182419 (0.0010) [2023-12-26 09:01:57,681][123091] Updated weights for policy 0, policy_version 1182429 (0.0009) [2023-12-26 09:01:57,730][123091] Updated weights for policy 0, policy_version 1182439 (0.0010) [2023-12-26 09:01:58,181][123090] Updated weights for policy 1, policy_version 1174087 (0.0011) [2023-12-26 09:01:58,253][123090] Updated weights for policy 1, policy_version 1174097 (0.0011) [2023-12-26 09:01:58,320][123090] Updated weights for policy 1, policy_version 1174107 (0.0011) [2023-12-26 09:01:58,624][123091] Updated weights for policy 0, policy_version 1182449 (0.0009) [2023-12-26 09:01:58,696][123091] Updated weights for policy 0, policy_version 1182459 (0.0009) [2023-12-26 09:01:58,778][123091] Updated weights for policy 0, policy_version 1182469 (0.0008) [2023-12-26 09:01:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 603283456. Throughput: 0: 8898.7, 1: 8983.1. Samples: 603281992. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:01:58,785][121949] Avg episode reward: [(0, '6165.357'), (1, '5517.838')] [2023-12-26 09:01:58,847][123091] Updated weights for policy 0, policy_version 1182479 (0.0007) [2023-12-26 09:01:59,181][123090] Updated weights for policy 1, policy_version 1174117 (0.0009) [2023-12-26 09:01:59,261][123090] Updated weights for policy 1, policy_version 1174127 (0.0006) [2023-12-26 09:01:59,326][123090] Updated weights for policy 1, policy_version 1174137 (0.0007) [2023-12-26 09:01:59,765][123091] Updated weights for policy 0, policy_version 1182489 (0.0006) [2023-12-26 09:01:59,835][123091] Updated weights for policy 0, policy_version 1182499 (0.0006) [2023-12-26 09:01:59,894][123091] Updated weights for policy 0, policy_version 1182509 (0.0006) [2023-12-26 09:02:00,025][123090] Updated weights for policy 1, policy_version 1174147 (0.0006) [2023-12-26 09:02:00,096][123090] Updated weights for policy 1, policy_version 1174157 (0.0005) [2023-12-26 09:02:00,168][123090] Updated weights for policy 1, policy_version 1174167 (0.0005) [2023-12-26 09:02:00,653][123091] Updated weights for policy 0, policy_version 1182519 (0.0006) [2023-12-26 09:02:00,705][123091] Updated weights for policy 0, policy_version 1182529 (0.0005) [2023-12-26 09:02:00,758][123091] Updated weights for policy 0, policy_version 1182539 (0.0005) [2023-12-26 09:02:00,797][123090] Updated weights for policy 1, policy_version 1174177 (0.0005) [2023-12-26 09:02:00,861][123090] Updated weights for policy 1, policy_version 1174187 (0.0006) [2023-12-26 09:02:00,928][123090] Updated weights for policy 1, policy_version 1174197 (0.0006) [2023-12-26 09:02:00,992][123090] Updated weights for policy 1, policy_version 1174207 (0.0005) [2023-12-26 09:02:01,504][123091] Updated weights for policy 0, policy_version 1182549 (0.0007) [2023-12-26 09:02:01,576][123091] Updated weights for policy 0, policy_version 1182559 (0.0006) [2023-12-26 09:02:01,648][123091] Updated weights for policy 0, policy_version 1182569 (0.0009) [2023-12-26 09:02:01,728][123090] Updated weights for policy 1, policy_version 1174217 (0.0009) [2023-12-26 09:02:01,802][123090] Updated weights for policy 1, policy_version 1174227 (0.0010) [2023-12-26 09:02:01,873][123090] Updated weights for policy 1, policy_version 1174237 (0.0011) [2023-12-26 09:02:02,368][123091] Updated weights for policy 0, policy_version 1182579 (0.0008) [2023-12-26 09:02:02,429][123091] Updated weights for policy 0, policy_version 1182589 (0.0008) [2023-12-26 09:02:02,488][123091] Updated weights for policy 0, policy_version 1182599 (0.0009) [2023-12-26 09:02:02,673][123090] Updated weights for policy 1, policy_version 1174247 (0.0010) [2023-12-26 09:02:02,739][123090] Updated weights for policy 1, policy_version 1174257 (0.0010) [2023-12-26 09:02:02,801][123090] Updated weights for policy 1, policy_version 1174267 (0.0010) [2023-12-26 09:02:03,248][123091] Updated weights for policy 0, policy_version 1182609 (0.0009) [2023-12-26 09:02:03,306][123091] Updated weights for policy 0, policy_version 1182619 (0.0005) [2023-12-26 09:02:03,355][123091] Updated weights for policy 0, policy_version 1182629 (0.0005) [2023-12-26 09:02:03,400][123091] Updated weights for policy 0, policy_version 1182639 (0.0005) [2023-12-26 09:02:03,611][123090] Updated weights for policy 1, policy_version 1174277 (0.0010) [2023-12-26 09:02:03,662][123090] Updated weights for policy 1, policy_version 1174287 (0.0010) [2023-12-26 09:02:03,709][123090] Updated weights for policy 1, policy_version 1174297 (0.0010) [2023-12-26 09:02:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 603381760. Throughput: 0: 8876.7, 1: 8964.5. Samples: 603389756. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:03,785][121949] Avg episode reward: [(0, '6136.770'), (1, '5509.012')] [2023-12-26 09:02:04,100][123091] Updated weights for policy 0, policy_version 1182649 (0.0006) [2023-12-26 09:02:04,178][123091] Updated weights for policy 0, policy_version 1182659 (0.0007) [2023-12-26 09:02:04,249][123091] Updated weights for policy 0, policy_version 1182669 (0.0010) [2023-12-26 09:02:04,524][123090] Updated weights for policy 1, policy_version 1174307 (0.0009) [2023-12-26 09:02:04,589][123090] Updated weights for policy 1, policy_version 1174317 (0.0006) [2023-12-26 09:02:04,645][123090] Updated weights for policy 1, policy_version 1174327 (0.0010) [2023-12-26 09:02:05,044][123091] Updated weights for policy 0, policy_version 1182679 (0.0009) [2023-12-26 09:02:05,099][123091] Updated weights for policy 0, policy_version 1182689 (0.0005) [2023-12-26 09:02:05,154][123091] Updated weights for policy 0, policy_version 1182699 (0.0005) [2023-12-26 09:02:05,402][123090] Updated weights for policy 1, policy_version 1174337 (0.0010) [2023-12-26 09:02:05,464][123090] Updated weights for policy 1, policy_version 1174347 (0.0010) [2023-12-26 09:02:05,522][123090] Updated weights for policy 1, policy_version 1174357 (0.0010) [2023-12-26 09:02:05,576][123090] Updated weights for policy 1, policy_version 1174367 (0.0010) [2023-12-26 09:02:05,837][123091] Updated weights for policy 0, policy_version 1182709 (0.0008) [2023-12-26 09:02:05,895][123091] Updated weights for policy 0, policy_version 1182719 (0.0010) [2023-12-26 09:02:05,953][123091] Updated weights for policy 0, policy_version 1182729 (0.0010) [2023-12-26 09:02:06,378][123090] Updated weights for policy 1, policy_version 1174377 (0.0008) [2023-12-26 09:02:06,453][123090] Updated weights for policy 1, policy_version 1174387 (0.0010) [2023-12-26 09:02:06,525][123090] Updated weights for policy 1, policy_version 1174397 (0.0011) [2023-12-26 09:02:06,766][123091] Updated weights for policy 0, policy_version 1182739 (0.0007) [2023-12-26 09:02:06,820][123091] Updated weights for policy 0, policy_version 1182749 (0.0007) [2023-12-26 09:02:06,866][123091] Updated weights for policy 0, policy_version 1182759 (0.0008) [2023-12-26 09:02:07,330][123090] Updated weights for policy 1, policy_version 1174407 (0.0010) [2023-12-26 09:02:07,397][123090] Updated weights for policy 1, policy_version 1174417 (0.0011) [2023-12-26 09:02:07,450][123090] Updated weights for policy 1, policy_version 1174427 (0.0009) [2023-12-26 09:02:07,613][123091] Updated weights for policy 0, policy_version 1182769 (0.0008) [2023-12-26 09:02:07,669][123091] Updated weights for policy 0, policy_version 1182779 (0.0005) [2023-12-26 09:02:07,724][123091] Updated weights for policy 0, policy_version 1182789 (0.0006) [2023-12-26 09:02:07,780][123091] Updated weights for policy 0, policy_version 1182799 (0.0009) [2023-12-26 09:02:08,137][123090] Updated weights for policy 1, policy_version 1174437 (0.0007) [2023-12-26 09:02:08,195][123090] Updated weights for policy 1, policy_version 1174447 (0.0005) [2023-12-26 09:02:08,266][123090] Updated weights for policy 1, policy_version 1174457 (0.0005) [2023-12-26 09:02:08,611][123091] Updated weights for policy 0, policy_version 1182809 (0.0010) [2023-12-26 09:02:08,677][123091] Updated weights for policy 0, policy_version 1182819 (0.0009) [2023-12-26 09:02:08,741][123091] Updated weights for policy 0, policy_version 1182829 (0.0009) [2023-12-26 09:02:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 603471872. Throughput: 0: 8874.5, 1: 8994.8. Samples: 603444228. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:08,785][121949] Avg episode reward: [(0, '6198.746'), (1, '5757.227')] [2023-12-26 09:02:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001182832_302809088.pth... [2023-12-26 09:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001174464_300662784.pth... [2023-12-26 09:02:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001173408_300392448.pth [2023-12-26 09:02:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001181808_302546944.pth [2023-12-26 09:02:08,958][123090] Updated weights for policy 1, policy_version 1174467 (0.0006) [2023-12-26 09:02:09,022][123090] Updated weights for policy 1, policy_version 1174477 (0.0010) [2023-12-26 09:02:09,082][123090] Updated weights for policy 1, policy_version 1174487 (0.0010) [2023-12-26 09:02:09,631][123091] Updated weights for policy 0, policy_version 1182839 (0.0009) [2023-12-26 09:02:09,694][123091] Updated weights for policy 0, policy_version 1182849 (0.0009) [2023-12-26 09:02:09,760][123091] Updated weights for policy 0, policy_version 1182859 (0.0009) [2023-12-26 09:02:09,919][123090] Updated weights for policy 1, policy_version 1174497 (0.0010) [2023-12-26 09:02:09,986][123090] Updated weights for policy 1, policy_version 1174507 (0.0010) [2023-12-26 09:02:10,054][123090] Updated weights for policy 1, policy_version 1174517 (0.0009) [2023-12-26 09:02:10,116][123090] Updated weights for policy 1, policy_version 1174527 (0.0009) [2023-12-26 09:02:10,628][123091] Updated weights for policy 0, policy_version 1182869 (0.0010) [2023-12-26 09:02:10,690][123091] Updated weights for policy 0, policy_version 1182879 (0.0010) [2023-12-26 09:02:10,746][123091] Updated weights for policy 0, policy_version 1182889 (0.0009) [2023-12-26 09:02:10,923][123090] Updated weights for policy 1, policy_version 1174537 (0.0009) [2023-12-26 09:02:10,980][123090] Updated weights for policy 1, policy_version 1174547 (0.0010) [2023-12-26 09:02:11,047][123090] Updated weights for policy 1, policy_version 1174557 (0.0010) [2023-12-26 09:02:11,590][123091] Updated weights for policy 0, policy_version 1182899 (0.0010) [2023-12-26 09:02:11,659][123091] Updated weights for policy 0, policy_version 1182909 (0.0008) [2023-12-26 09:02:11,727][123091] Updated weights for policy 0, policy_version 1182919 (0.0009) [2023-12-26 09:02:11,939][123090] Updated weights for policy 1, policy_version 1174567 (0.0010) [2023-12-26 09:02:12,010][123090] Updated weights for policy 1, policy_version 1174577 (0.0009) [2023-12-26 09:02:12,077][123090] Updated weights for policy 1, policy_version 1174587 (0.0010) [2023-12-26 09:02:12,559][123091] Updated weights for policy 0, policy_version 1182929 (0.0010) [2023-12-26 09:02:12,624][123091] Updated weights for policy 0, policy_version 1182939 (0.0009) [2023-12-26 09:02:12,677][123091] Updated weights for policy 0, policy_version 1182949 (0.0009) [2023-12-26 09:02:12,730][123091] Updated weights for policy 0, policy_version 1182959 (0.0009) [2023-12-26 09:02:12,896][123090] Updated weights for policy 1, policy_version 1174597 (0.0009) [2023-12-26 09:02:12,955][123090] Updated weights for policy 1, policy_version 1174607 (0.0009) [2023-12-26 09:02:13,006][123090] Updated weights for policy 1, policy_version 1174617 (0.0008) [2023-12-26 09:02:13,602][123091] Updated weights for policy 0, policy_version 1182969 (0.0010) [2023-12-26 09:02:13,656][123091] Updated weights for policy 0, policy_version 1182979 (0.0009) [2023-12-26 09:02:13,716][123091] Updated weights for policy 0, policy_version 1182990 (0.0011) [2023-12-26 09:02:13,769][123090] Updated weights for policy 1, policy_version 1174627 (0.0007) [2023-12-26 09:02:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 603553792. Throughput: 0: 8809.3, 1: 8969.8. Samples: 603547636. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:13,785][121949] Avg episode reward: [(0, '6212.271'), (1, '5844.565')] [2023-12-26 09:02:13,825][123090] Updated weights for policy 1, policy_version 1174637 (0.0005) [2023-12-26 09:02:13,878][123090] Updated weights for policy 1, policy_version 1174647 (0.0005) [2023-12-26 09:02:14,579][123090] Updated weights for policy 1, policy_version 1174657 (0.0006) [2023-12-26 09:02:14,621][123091] Updated weights for policy 0, policy_version 1183000 (0.0007) [2023-12-26 09:02:14,646][123090] Updated weights for policy 1, policy_version 1174667 (0.0009) [2023-12-26 09:02:14,682][123091] Updated weights for policy 0, policy_version 1183010 (0.0010) [2023-12-26 09:02:14,699][123090] Updated weights for policy 1, policy_version 1174677 (0.0007) [2023-12-26 09:02:14,742][123091] Updated weights for policy 0, policy_version 1183020 (0.0009) [2023-12-26 09:02:14,744][123090] Updated weights for policy 1, policy_version 1174687 (0.0009) [2023-12-26 09:02:15,547][123091] Updated weights for policy 0, policy_version 1183030 (0.0007) [2023-12-26 09:02:15,604][123090] Updated weights for policy 1, policy_version 1174697 (0.0009) [2023-12-26 09:02:15,608][123091] Updated weights for policy 0, policy_version 1183040 (0.0005) [2023-12-26 09:02:15,660][123090] Updated weights for policy 1, policy_version 1174707 (0.0009) [2023-12-26 09:02:15,680][123091] Updated weights for policy 0, policy_version 1183050 (0.0007) [2023-12-26 09:02:15,713][123090] Updated weights for policy 1, policy_version 1174717 (0.0007) [2023-12-26 09:02:16,450][123090] Updated weights for policy 1, policy_version 1174727 (0.0006) [2023-12-26 09:02:16,496][123091] Updated weights for policy 0, policy_version 1183060 (0.0009) [2023-12-26 09:02:16,502][123090] Updated weights for policy 1, policy_version 1174737 (0.0005) [2023-12-26 09:02:16,557][123090] Updated weights for policy 1, policy_version 1174747 (0.0005) [2023-12-26 09:02:16,561][123091] Updated weights for policy 0, policy_version 1183070 (0.0008) [2023-12-26 09:02:16,626][123091] Updated weights for policy 0, policy_version 1183080 (0.0009) [2023-12-26 09:02:17,218][123090] Updated weights for policy 1, policy_version 1174757 (0.0005) [2023-12-26 09:02:17,276][123090] Updated weights for policy 1, policy_version 1174767 (0.0005) [2023-12-26 09:02:17,330][123090] Updated weights for policy 1, policy_version 1174777 (0.0005) [2023-12-26 09:02:17,549][123091] Updated weights for policy 0, policy_version 1183090 (0.0010) [2023-12-26 09:02:17,603][123091] Updated weights for policy 0, policy_version 1183100 (0.0010) [2023-12-26 09:02:17,651][123091] Updated weights for policy 0, policy_version 1183110 (0.0009) [2023-12-26 09:02:17,703][123091] Updated weights for policy 0, policy_version 1183120 (0.0009) [2023-12-26 09:02:18,058][123090] Updated weights for policy 1, policy_version 1174787 (0.0006) [2023-12-26 09:02:18,106][123090] Updated weights for policy 1, policy_version 1174797 (0.0005) [2023-12-26 09:02:18,164][123090] Updated weights for policy 1, policy_version 1174807 (0.0006) [2023-12-26 09:02:18,581][123091] Updated weights for policy 0, policy_version 1183130 (0.0010) [2023-12-26 09:02:18,646][123091] Updated weights for policy 0, policy_version 1183140 (0.0009) [2023-12-26 09:02:18,699][123091] Updated weights for policy 0, policy_version 1183150 (0.0009) [2023-12-26 09:02:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 603643904. Throughput: 0: 8642.2, 1: 9024.8. Samples: 603653948. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:18,785][121949] Avg episode reward: [(0, '6163.487'), (1, '5647.095')] [2023-12-26 09:02:18,898][123090] Updated weights for policy 1, policy_version 1174817 (0.0005) [2023-12-26 09:02:18,953][123090] Updated weights for policy 1, policy_version 1174827 (0.0005) [2023-12-26 09:02:19,013][123090] Updated weights for policy 1, policy_version 1174837 (0.0005) [2023-12-26 09:02:19,078][123090] Updated weights for policy 1, policy_version 1174847 (0.0005) [2023-12-26 09:02:19,566][123091] Updated weights for policy 0, policy_version 1183160 (0.0010) [2023-12-26 09:02:19,632][123091] Updated weights for policy 0, policy_version 1183170 (0.0009) [2023-12-26 09:02:19,694][123091] Updated weights for policy 0, policy_version 1183180 (0.0010) [2023-12-26 09:02:19,929][123090] Updated weights for policy 1, policy_version 1174857 (0.0010) [2023-12-26 09:02:20,004][123090] Updated weights for policy 1, policy_version 1174867 (0.0009) [2023-12-26 09:02:20,073][123090] Updated weights for policy 1, policy_version 1174877 (0.0008) [2023-12-26 09:02:20,523][123091] Updated weights for policy 0, policy_version 1183190 (0.0010) [2023-12-26 09:02:20,579][123091] Updated weights for policy 0, policy_version 1183200 (0.0010) [2023-12-26 09:02:20,641][123091] Updated weights for policy 0, policy_version 1183210 (0.0009) [2023-12-26 09:02:20,908][123090] Updated weights for policy 1, policy_version 1174887 (0.0009) [2023-12-26 09:02:20,968][123090] Updated weights for policy 1, policy_version 1174897 (0.0010) [2023-12-26 09:02:21,030][123090] Updated weights for policy 1, policy_version 1174907 (0.0009) [2023-12-26 09:02:21,506][123091] Updated weights for policy 0, policy_version 1183220 (0.0009) [2023-12-26 09:02:21,577][123091] Updated weights for policy 0, policy_version 1183230 (0.0009) [2023-12-26 09:02:21,644][123091] Updated weights for policy 0, policy_version 1183240 (0.0010) [2023-12-26 09:02:21,920][123090] Updated weights for policy 1, policy_version 1174917 (0.0007) [2023-12-26 09:02:21,990][123090] Updated weights for policy 1, policy_version 1174927 (0.0008) [2023-12-26 09:02:22,070][123090] Updated weights for policy 1, policy_version 1174937 (0.0011) [2023-12-26 09:02:22,443][123091] Updated weights for policy 0, policy_version 1183250 (0.0009) [2023-12-26 09:02:22,512][123091] Updated weights for policy 0, policy_version 1183260 (0.0006) [2023-12-26 09:02:22,580][123091] Updated weights for policy 0, policy_version 1183270 (0.0008) [2023-12-26 09:02:22,644][123091] Updated weights for policy 0, policy_version 1183280 (0.0009) [2023-12-26 09:02:22,880][123090] Updated weights for policy 1, policy_version 1174947 (0.0011) [2023-12-26 09:02:22,947][123090] Updated weights for policy 1, policy_version 1174957 (0.0010) [2023-12-26 09:02:23,011][123090] Updated weights for policy 1, policy_version 1174967 (0.0010) [2023-12-26 09:02:23,445][123091] Updated weights for policy 0, policy_version 1183290 (0.0011) [2023-12-26 09:02:23,515][123091] Updated weights for policy 0, policy_version 1183300 (0.0011) [2023-12-26 09:02:23,570][123091] Updated weights for policy 0, policy_version 1183310 (0.0011) [2023-12-26 09:02:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 603725824. Throughput: 0: 8537.4, 1: 9007.7. Samples: 603704024. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:23,785][121949] Avg episode reward: [(0, '6256.379'), (1, '5743.569')] [2023-12-26 09:02:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001183312_302931968.pth... [2023-12-26 09:02:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001174976_300793856.pth... [2023-12-26 09:02:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001182320_302678016.pth [2023-12-26 09:02:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001173920_300523520.pth [2023-12-26 09:02:23,825][123090] Updated weights for policy 1, policy_version 1174977 (0.0009) [2023-12-26 09:02:23,891][123090] Updated weights for policy 1, policy_version 1174987 (0.0010) [2023-12-26 09:02:23,953][123090] Updated weights for policy 1, policy_version 1174997 (0.0010) [2023-12-26 09:02:24,022][123090] Updated weights for policy 1, policy_version 1175007 (0.0010) [2023-12-26 09:02:24,298][123091] Updated weights for policy 0, policy_version 1183320 (0.0006) [2023-12-26 09:02:24,350][123091] Updated weights for policy 0, policy_version 1183330 (0.0008) [2023-12-26 09:02:24,405][123091] Updated weights for policy 0, policy_version 1183340 (0.0009) [2023-12-26 09:02:24,876][123090] Updated weights for policy 1, policy_version 1175017 (0.0010) [2023-12-26 09:02:24,935][123090] Updated weights for policy 1, policy_version 1175027 (0.0009) [2023-12-26 09:02:25,002][123090] Updated weights for policy 1, policy_version 1175037 (0.0010) [2023-12-26 09:02:25,210][123091] Updated weights for policy 0, policy_version 1183350 (0.0010) [2023-12-26 09:02:25,265][123091] Updated weights for policy 0, policy_version 1183360 (0.0010) [2023-12-26 09:02:25,328][123091] Updated weights for policy 0, policy_version 1183370 (0.0010) [2023-12-26 09:02:25,785][123090] Updated weights for policy 1, policy_version 1175047 (0.0010) [2023-12-26 09:02:25,848][123090] Updated weights for policy 1, policy_version 1175057 (0.0010) [2023-12-26 09:02:25,916][123090] Updated weights for policy 1, policy_version 1175067 (0.0010) [2023-12-26 09:02:26,245][123091] Updated weights for policy 0, policy_version 1183380 (0.0010) [2023-12-26 09:02:26,308][123091] Updated weights for policy 0, policy_version 1183390 (0.0009) [2023-12-26 09:02:26,369][123091] Updated weights for policy 0, policy_version 1183400 (0.0009) [2023-12-26 09:02:26,750][123090] Updated weights for policy 1, policy_version 1175077 (0.0010) [2023-12-26 09:02:26,801][123090] Updated weights for policy 1, policy_version 1175087 (0.0010) [2023-12-26 09:02:26,853][123090] Updated weights for policy 1, policy_version 1175097 (0.0010) [2023-12-26 09:02:27,126][123091] Updated weights for policy 0, policy_version 1183410 (0.0008) [2023-12-26 09:02:27,189][123091] Updated weights for policy 0, policy_version 1183420 (0.0005) [2023-12-26 09:02:27,252][123091] Updated weights for policy 0, policy_version 1183430 (0.0009) [2023-12-26 09:02:27,319][123091] Updated weights for policy 0, policy_version 1183440 (0.0009) [2023-12-26 09:02:27,614][123090] Updated weights for policy 1, policy_version 1175107 (0.0009) [2023-12-26 09:02:27,683][123090] Updated weights for policy 1, policy_version 1175117 (0.0005) [2023-12-26 09:02:27,737][123090] Updated weights for policy 1, policy_version 1175127 (0.0005) [2023-12-26 09:02:27,986][123091] Updated weights for policy 0, policy_version 1183450 (0.0005) [2023-12-26 09:02:28,036][123091] Updated weights for policy 0, policy_version 1183460 (0.0005) [2023-12-26 09:02:28,089][123091] Updated weights for policy 0, policy_version 1183470 (0.0006) [2023-12-26 09:02:28,497][123090] Updated weights for policy 1, policy_version 1175137 (0.0005) [2023-12-26 09:02:28,567][123090] Updated weights for policy 1, policy_version 1175147 (0.0005) [2023-12-26 09:02:28,642][123090] Updated weights for policy 1, policy_version 1175157 (0.0005) [2023-12-26 09:02:28,702][123090] Updated weights for policy 1, policy_version 1175167 (0.0005) [2023-12-26 09:02:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 603815936. Throughput: 0: 8573.7, 1: 9002.3. Samples: 603808968. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:28,785][121949] Avg episode reward: [(0, '6241.324'), (1, '5798.374')] [2023-12-26 09:02:28,856][123091] Updated weights for policy 0, policy_version 1183480 (0.0006) [2023-12-26 09:02:28,922][123091] Updated weights for policy 0, policy_version 1183490 (0.0005) [2023-12-26 09:02:28,994][123091] Updated weights for policy 0, policy_version 1183500 (0.0009) [2023-12-26 09:02:29,370][123090] Updated weights for policy 1, policy_version 1175177 (0.0009) [2023-12-26 09:02:29,428][123090] Updated weights for policy 1, policy_version 1175187 (0.0008) [2023-12-26 09:02:29,486][123090] Updated weights for policy 1, policy_version 1175197 (0.0009) [2023-12-26 09:02:29,773][123091] Updated weights for policy 0, policy_version 1183510 (0.0010) [2023-12-26 09:02:29,837][123091] Updated weights for policy 0, policy_version 1183520 (0.0011) [2023-12-26 09:02:29,904][123091] Updated weights for policy 0, policy_version 1183530 (0.0011) [2023-12-26 09:02:30,301][123090] Updated weights for policy 1, policy_version 1175207 (0.0008) [2023-12-26 09:02:30,362][123090] Updated weights for policy 1, policy_version 1175217 (0.0009) [2023-12-26 09:02:30,430][123090] Updated weights for policy 1, policy_version 1175227 (0.0005) [2023-12-26 09:02:30,731][123091] Updated weights for policy 0, policy_version 1183540 (0.0009) [2023-12-26 09:02:30,785][123091] Updated weights for policy 0, policy_version 1183550 (0.0009) [2023-12-26 09:02:30,838][123091] Updated weights for policy 0, policy_version 1183560 (0.0008) [2023-12-26 09:02:31,177][123090] Updated weights for policy 1, policy_version 1175237 (0.0007) [2023-12-26 09:02:31,233][123090] Updated weights for policy 1, policy_version 1175247 (0.0009) [2023-12-26 09:02:31,296][123090] Updated weights for policy 1, policy_version 1175257 (0.0009) [2023-12-26 09:02:31,503][123091] Updated weights for policy 0, policy_version 1183570 (0.0005) [2023-12-26 09:02:31,567][123091] Updated weights for policy 0, policy_version 1183580 (0.0009) [2023-12-26 09:02:31,627][123091] Updated weights for policy 0, policy_version 1183590 (0.0010) [2023-12-26 09:02:31,682][123091] Updated weights for policy 0, policy_version 1183600 (0.0005) [2023-12-26 09:02:32,045][123090] Updated weights for policy 1, policy_version 1175267 (0.0008) [2023-12-26 09:02:32,107][123090] Updated weights for policy 1, policy_version 1175277 (0.0006) [2023-12-26 09:02:32,169][123090] Updated weights for policy 1, policy_version 1175287 (0.0010) [2023-12-26 09:02:32,420][123091] Updated weights for policy 0, policy_version 1183610 (0.0009) [2023-12-26 09:02:32,494][123091] Updated weights for policy 0, policy_version 1183620 (0.0006) [2023-12-26 09:02:32,569][123091] Updated weights for policy 0, policy_version 1183630 (0.0005) [2023-12-26 09:02:32,875][123090] Updated weights for policy 1, policy_version 1175297 (0.0009) [2023-12-26 09:02:32,934][123090] Updated weights for policy 1, policy_version 1175307 (0.0006) [2023-12-26 09:02:32,991][123090] Updated weights for policy 1, policy_version 1175317 (0.0005) [2023-12-26 09:02:33,056][123090] Updated weights for policy 1, policy_version 1175327 (0.0005) [2023-12-26 09:02:33,180][123091] Updated weights for policy 0, policy_version 1183640 (0.0009) [2023-12-26 09:02:33,238][123091] Updated weights for policy 0, policy_version 1183651 (0.0011) [2023-12-26 09:02:33,297][123091] Updated weights for policy 0, policy_version 1183661 (0.0010) [2023-12-26 09:02:33,683][123090] Updated weights for policy 1, policy_version 1175337 (0.0005) [2023-12-26 09:02:33,728][123090] Updated weights for policy 1, policy_version 1175347 (0.0005) [2023-12-26 09:02:33,780][123090] Updated weights for policy 1, policy_version 1175357 (0.0005) [2023-12-26 09:02:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 603906048. Throughput: 0: 8708.9, 1: 9029.8. Samples: 603921084. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:33,785][121949] Avg episode reward: [(0, '6221.225'), (1, '5789.807')] [2023-12-26 09:02:34,238][123091] Updated weights for policy 0, policy_version 1183671 (0.0009) [2023-12-26 09:02:34,302][123091] Updated weights for policy 0, policy_version 1183681 (0.0009) [2023-12-26 09:02:34,365][123091] Updated weights for policy 0, policy_version 1183691 (0.0009) [2023-12-26 09:02:34,495][123090] Updated weights for policy 1, policy_version 1175367 (0.0009) [2023-12-26 09:02:34,562][123090] Updated weights for policy 1, policy_version 1175377 (0.0011) [2023-12-26 09:02:34,629][123090] Updated weights for policy 1, policy_version 1175387 (0.0010) [2023-12-26 09:02:35,201][123091] Updated weights for policy 0, policy_version 1183701 (0.0010) [2023-12-26 09:02:35,248][123091] Updated weights for policy 0, policy_version 1183711 (0.0011) [2023-12-26 09:02:35,307][123091] Updated weights for policy 0, policy_version 1183721 (0.0010) [2023-12-26 09:02:35,370][123090] Updated weights for policy 1, policy_version 1175397 (0.0006) [2023-12-26 09:02:35,421][123090] Updated weights for policy 1, policy_version 1175407 (0.0010) [2023-12-26 09:02:35,469][123090] Updated weights for policy 1, policy_version 1175417 (0.0010) [2023-12-26 09:02:36,007][123091] Updated weights for policy 0, policy_version 1183731 (0.0010) [2023-12-26 09:02:36,051][123091] Updated weights for policy 0, policy_version 1183741 (0.0010) [2023-12-26 09:02:36,094][123091] Updated weights for policy 0, policy_version 1183751 (0.0010) [2023-12-26 09:02:36,223][123090] Updated weights for policy 1, policy_version 1175427 (0.0005) [2023-12-26 09:02:36,295][123090] Updated weights for policy 1, policy_version 1175437 (0.0008) [2023-12-26 09:02:36,355][123090] Updated weights for policy 1, policy_version 1175447 (0.0009) [2023-12-26 09:02:36,987][123091] Updated weights for policy 0, policy_version 1183761 (0.0011) [2023-12-26 09:02:37,049][123091] Updated weights for policy 0, policy_version 1183771 (0.0010) [2023-12-26 09:02:37,097][123091] Updated weights for policy 0, policy_version 1183781 (0.0010) [2023-12-26 09:02:37,118][123090] Updated weights for policy 1, policy_version 1175457 (0.0009) [2023-12-26 09:02:37,149][123091] Updated weights for policy 0, policy_version 1183791 (0.0010) [2023-12-26 09:02:37,175][123090] Updated weights for policy 1, policy_version 1175467 (0.0007) [2023-12-26 09:02:37,223][123090] Updated weights for policy 1, policy_version 1175477 (0.0009) [2023-12-26 09:02:37,275][123090] Updated weights for policy 1, policy_version 1175487 (0.0009) [2023-12-26 09:02:37,994][123091] Updated weights for policy 0, policy_version 1183801 (0.0010) [2023-12-26 09:02:38,045][123091] Updated weights for policy 0, policy_version 1183811 (0.0010) [2023-12-26 09:02:38,092][123091] Updated weights for policy 0, policy_version 1183821 (0.0010) [2023-12-26 09:02:38,139][123090] Updated weights for policy 1, policy_version 1175497 (0.0008) [2023-12-26 09:02:38,211][123090] Updated weights for policy 1, policy_version 1175507 (0.0009) [2023-12-26 09:02:38,281][123090] Updated weights for policy 1, policy_version 1175517 (0.0009) [2023-12-26 09:02:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 603996160. Throughput: 0: 8734.0, 1: 9086.9. Samples: 603975452. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:38,785][121949] Avg episode reward: [(0, '6140.442'), (1, '5879.729')] [2023-12-26 09:02:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001183824_303063040.pth... [2023-12-26 09:02:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001175520_300933120.pth... [2023-12-26 09:02:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001182832_302809088.pth [2023-12-26 09:02:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001174464_300662784.pth [2023-12-26 09:02:38,958][123091] Updated weights for policy 0, policy_version 1183831 (0.0010) [2023-12-26 09:02:39,020][123091] Updated weights for policy 0, policy_version 1183841 (0.0010) [2023-12-26 09:02:39,082][123090] Updated weights for policy 1, policy_version 1175527 (0.0007) [2023-12-26 09:02:39,087][123091] Updated weights for policy 0, policy_version 1183851 (0.0010) [2023-12-26 09:02:39,147][123090] Updated weights for policy 1, policy_version 1175537 (0.0009) [2023-12-26 09:02:39,198][123090] Updated weights for policy 1, policy_version 1175547 (0.0008) [2023-12-26 09:02:39,900][123091] Updated weights for policy 0, policy_version 1183861 (0.0009) [2023-12-26 09:02:39,970][123091] Updated weights for policy 0, policy_version 1183871 (0.0008) [2023-12-26 09:02:40,036][123091] Updated weights for policy 0, policy_version 1183881 (0.0008) [2023-12-26 09:02:40,086][123090] Updated weights for policy 1, policy_version 1175557 (0.0008) [2023-12-26 09:02:40,136][123090] Updated weights for policy 1, policy_version 1175567 (0.0008) [2023-12-26 09:02:40,191][123090] Updated weights for policy 1, policy_version 1175577 (0.0009) [2023-12-26 09:02:40,741][123091] Updated weights for policy 0, policy_version 1183891 (0.0009) [2023-12-26 09:02:40,804][123091] Updated weights for policy 0, policy_version 1183901 (0.0010) [2023-12-26 09:02:40,862][123091] Updated weights for policy 0, policy_version 1183911 (0.0010) [2023-12-26 09:02:41,084][123090] Updated weights for policy 1, policy_version 1175587 (0.0009) [2023-12-26 09:02:41,153][123090] Updated weights for policy 1, policy_version 1175597 (0.0008) [2023-12-26 09:02:41,213][123090] Updated weights for policy 1, policy_version 1175607 (0.0009) [2023-12-26 09:02:41,679][123091] Updated weights for policy 0, policy_version 1183921 (0.0010) [2023-12-26 09:02:41,750][123091] Updated weights for policy 0, policy_version 1183931 (0.0008) [2023-12-26 09:02:41,812][123091] Updated weights for policy 0, policy_version 1183941 (0.0007) [2023-12-26 09:02:41,885][123091] Updated weights for policy 0, policy_version 1183951 (0.0006) [2023-12-26 09:02:42,106][123090] Updated weights for policy 1, policy_version 1175617 (0.0009) [2023-12-26 09:02:42,158][123090] Updated weights for policy 1, policy_version 1175627 (0.0009) [2023-12-26 09:02:42,207][123090] Updated weights for policy 1, policy_version 1175637 (0.0009) [2023-12-26 09:02:42,269][123090] Updated weights for policy 1, policy_version 1175647 (0.0009) [2023-12-26 09:02:42,638][123091] Updated weights for policy 0, policy_version 1183961 (0.0010) [2023-12-26 09:02:42,704][123091] Updated weights for policy 0, policy_version 1183971 (0.0009) [2023-12-26 09:02:42,776][123091] Updated weights for policy 0, policy_version 1183981 (0.0010) [2023-12-26 09:02:43,091][123090] Updated weights for policy 1, policy_version 1175657 (0.0010) [2023-12-26 09:02:43,158][123090] Updated weights for policy 1, policy_version 1175667 (0.0010) [2023-12-26 09:02:43,227][123090] Updated weights for policy 1, policy_version 1175677 (0.0010) [2023-12-26 09:02:43,685][123091] Updated weights for policy 0, policy_version 1183991 (0.0010) [2023-12-26 09:02:43,751][123091] Updated weights for policy 0, policy_version 1184001 (0.0010) [2023-12-26 09:02:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 604078080. Throughput: 0: 8755.0, 1: 8934.1. Samples: 604078004. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:43,785][121949] Avg episode reward: [(0, '6164.850'), (1, '5854.774')] [2023-12-26 09:02:43,818][123091] Updated weights for policy 0, policy_version 1184011 (0.0006) [2023-12-26 09:02:43,838][123090] Updated weights for policy 1, policy_version 1175687 (0.0005) [2023-12-26 09:02:43,886][123090] Updated weights for policy 1, policy_version 1175697 (0.0005) [2023-12-26 09:02:43,948][123090] Updated weights for policy 1, policy_version 1175707 (0.0005) [2023-12-26 09:02:44,530][123091] Updated weights for policy 0, policy_version 1184021 (0.0007) [2023-12-26 09:02:44,589][123091] Updated weights for policy 0, policy_version 1184031 (0.0010) [2023-12-26 09:02:44,616][123090] Updated weights for policy 1, policy_version 1175717 (0.0008) [2023-12-26 09:02:44,640][123091] Updated weights for policy 0, policy_version 1184041 (0.0008) [2023-12-26 09:02:44,669][123090] Updated weights for policy 1, policy_version 1175727 (0.0009) [2023-12-26 09:02:44,719][123090] Updated weights for policy 1, policy_version 1175737 (0.0009) [2023-12-26 09:02:45,409][123091] Updated weights for policy 0, policy_version 1184051 (0.0008) [2023-12-26 09:02:45,459][123091] Updated weights for policy 0, policy_version 1184061 (0.0009) [2023-12-26 09:02:45,508][123091] Updated weights for policy 0, policy_version 1184071 (0.0009) [2023-12-26 09:02:45,601][123090] Updated weights for policy 1, policy_version 1175747 (0.0009) [2023-12-26 09:02:45,671][123090] Updated weights for policy 1, policy_version 1175757 (0.0011) [2023-12-26 09:02:45,722][123090] Updated weights for policy 1, policy_version 1175767 (0.0010) [2023-12-26 09:02:46,310][123091] Updated weights for policy 0, policy_version 1184081 (0.0009) [2023-12-26 09:02:46,377][123091] Updated weights for policy 0, policy_version 1184091 (0.0010) [2023-12-26 09:02:46,441][123091] Updated weights for policy 0, policy_version 1184101 (0.0009) [2023-12-26 09:02:46,494][123091] Updated weights for policy 0, policy_version 1184111 (0.0009) [2023-12-26 09:02:46,526][123090] Updated weights for policy 1, policy_version 1175777 (0.0010) [2023-12-26 09:02:46,589][123090] Updated weights for policy 1, policy_version 1175787 (0.0010) [2023-12-26 09:02:46,642][123090] Updated weights for policy 1, policy_version 1175797 (0.0010) [2023-12-26 09:02:46,693][123090] Updated weights for policy 1, policy_version 1175807 (0.0010) [2023-12-26 09:02:47,341][123091] Updated weights for policy 0, policy_version 1184121 (0.0009) [2023-12-26 09:02:47,402][123091] Updated weights for policy 0, policy_version 1184131 (0.0009) [2023-12-26 09:02:47,451][123091] Updated weights for policy 0, policy_version 1184141 (0.0009) [2023-12-26 09:02:47,515][123090] Updated weights for policy 1, policy_version 1175817 (0.0010) [2023-12-26 09:02:47,562][123090] Updated weights for policy 1, policy_version 1175827 (0.0010) [2023-12-26 09:02:47,614][123090] Updated weights for policy 1, policy_version 1175837 (0.0010) [2023-12-26 09:02:48,273][123090] Updated weights for policy 1, policy_version 1175847 (0.0006) [2023-12-26 09:02:48,329][123090] Updated weights for policy 1, policy_version 1175857 (0.0006) [2023-12-26 09:02:48,348][123091] Updated weights for policy 0, policy_version 1184151 (0.0009) [2023-12-26 09:02:48,387][123090] Updated weights for policy 1, policy_version 1175867 (0.0008) [2023-12-26 09:02:48,413][123091] Updated weights for policy 0, policy_version 1184161 (0.0007) [2023-12-26 09:02:48,468][123091] Updated weights for policy 0, policy_version 1184171 (0.0009) [2023-12-26 09:02:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 604176384. Throughput: 0: 8704.9, 1: 8996.2. Samples: 604186304. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:48,785][121949] Avg episode reward: [(0, '6184.831'), (1, '5877.478')] [2023-12-26 09:02:49,110][123090] Updated weights for policy 1, policy_version 1175877 (0.0008) [2023-12-26 09:02:49,170][123090] Updated weights for policy 1, policy_version 1175887 (0.0010) [2023-12-26 09:02:49,253][123090] Updated weights for policy 1, policy_version 1175897 (0.0010) [2023-12-26 09:02:49,312][123091] Updated weights for policy 0, policy_version 1184181 (0.0009) [2023-12-26 09:02:49,380][123091] Updated weights for policy 0, policy_version 1184191 (0.0010) [2023-12-26 09:02:49,454][123091] Updated weights for policy 0, policy_version 1184201 (0.0009) [2023-12-26 09:02:50,063][123090] Updated weights for policy 1, policy_version 1175907 (0.0011) [2023-12-26 09:02:50,123][123090] Updated weights for policy 1, policy_version 1175917 (0.0010) [2023-12-26 09:02:50,175][123090] Updated weights for policy 1, policy_version 1175927 (0.0010) [2023-12-26 09:02:50,305][123091] Updated weights for policy 0, policy_version 1184211 (0.0009) [2023-12-26 09:02:50,366][123091] Updated weights for policy 0, policy_version 1184221 (0.0009) [2023-12-26 09:02:50,423][123091] Updated weights for policy 0, policy_version 1184231 (0.0009) [2023-12-26 09:02:51,019][123090] Updated weights for policy 1, policy_version 1175937 (0.0010) [2023-12-26 09:02:51,091][123090] Updated weights for policy 1, policy_version 1175947 (0.0011) [2023-12-26 09:02:51,159][123090] Updated weights for policy 1, policy_version 1175957 (0.0011) [2023-12-26 09:02:51,227][123090] Updated weights for policy 1, policy_version 1175967 (0.0010) [2023-12-26 09:02:51,277][123091] Updated weights for policy 0, policy_version 1184241 (0.0009) [2023-12-26 09:02:51,327][123091] Updated weights for policy 0, policy_version 1184251 (0.0009) [2023-12-26 09:02:51,396][123091] Updated weights for policy 0, policy_version 1184261 (0.0010) [2023-12-26 09:02:51,465][123091] Updated weights for policy 0, policy_version 1184271 (0.0009) [2023-12-26 09:02:52,051][123090] Updated weights for policy 1, policy_version 1175977 (0.0010) [2023-12-26 09:02:52,120][123090] Updated weights for policy 1, policy_version 1175987 (0.0010) [2023-12-26 09:02:52,197][123090] Updated weights for policy 1, policy_version 1175997 (0.0009) [2023-12-26 09:02:52,252][123091] Updated weights for policy 0, policy_version 1184281 (0.0006) [2023-12-26 09:02:52,323][123091] Updated weights for policy 0, policy_version 1184291 (0.0007) [2023-12-26 09:02:52,390][123091] Updated weights for policy 0, policy_version 1184301 (0.0007) [2023-12-26 09:02:53,014][123091] Updated weights for policy 0, policy_version 1184311 (0.0005) [2023-12-26 09:02:53,066][123091] Updated weights for policy 0, policy_version 1184321 (0.0005) [2023-12-26 09:02:53,066][123090] Updated weights for policy 1, policy_version 1176007 (0.0006) [2023-12-26 09:02:53,116][123091] Updated weights for policy 0, policy_version 1184331 (0.0005) [2023-12-26 09:02:53,136][123090] Updated weights for policy 1, policy_version 1176017 (0.0008) [2023-12-26 09:02:53,205][123090] Updated weights for policy 1, policy_version 1176027 (0.0009) [2023-12-26 09:02:53,770][123091] Updated weights for policy 0, policy_version 1184341 (0.0005) [2023-12-26 09:02:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 604258304. Throughput: 0: 8638.0, 1: 8985.1. Samples: 604237272. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:53,786][121949] Avg episode reward: [(0, '5987.811'), (1, '5980.364')] [2023-12-26 09:02:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001176032_301064192.pth... [2023-12-26 09:02:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001174976_300793856.pth [2023-12-26 09:02:53,831][123091] Updated weights for policy 0, policy_version 1184351 (0.0005) [2023-12-26 09:02:53,891][123091] Updated weights for policy 0, policy_version 1184361 (0.0005) [2023-12-26 09:02:53,933][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001184368_303202304.pth... [2023-12-26 09:02:53,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001183312_302931968.pth [2023-12-26 09:02:54,086][123090] Updated weights for policy 1, policy_version 1176037 (0.0009) [2023-12-26 09:02:54,139][123090] Updated weights for policy 1, policy_version 1176047 (0.0010) [2023-12-26 09:02:54,193][123090] Updated weights for policy 1, policy_version 1176057 (0.0010) [2023-12-26 09:02:54,542][123091] Updated weights for policy 0, policy_version 1184371 (0.0005) [2023-12-26 09:02:54,597][123091] Updated weights for policy 0, policy_version 1184381 (0.0005) [2023-12-26 09:02:54,655][123091] Updated weights for policy 0, policy_version 1184391 (0.0008) [2023-12-26 09:02:55,133][123090] Updated weights for policy 1, policy_version 1176068 (0.0010) [2023-12-26 09:02:55,185][123090] Updated weights for policy 1, policy_version 1176078 (0.0009) [2023-12-26 09:02:55,238][123090] Updated weights for policy 1, policy_version 1176088 (0.0009) [2023-12-26 09:02:55,331][123091] Updated weights for policy 0, policy_version 1184401 (0.0009) [2023-12-26 09:02:55,395][123091] Updated weights for policy 0, policy_version 1184411 (0.0005) [2023-12-26 09:02:55,454][123091] Updated weights for policy 0, policy_version 1184421 (0.0009) [2023-12-26 09:02:55,511][123091] Updated weights for policy 0, policy_version 1184431 (0.0009) [2023-12-26 09:02:56,082][123090] Updated weights for policy 1, policy_version 1176099 (0.0010) [2023-12-26 09:02:56,130][123090] Updated weights for policy 1, policy_version 1176109 (0.0009) [2023-12-26 09:02:56,191][123090] Updated weights for policy 1, policy_version 1176119 (0.0009) [2023-12-26 09:02:56,314][123091] Updated weights for policy 0, policy_version 1184441 (0.0011) [2023-12-26 09:02:56,377][123091] Updated weights for policy 0, policy_version 1184451 (0.0010) [2023-12-26 09:02:56,437][123091] Updated weights for policy 0, policy_version 1184461 (0.0011) [2023-12-26 09:02:57,055][123090] Updated weights for policy 1, policy_version 1176129 (0.0009) [2023-12-26 09:02:57,116][123090] Updated weights for policy 1, policy_version 1176139 (0.0009) [2023-12-26 09:02:57,176][123090] Updated weights for policy 1, policy_version 1176149 (0.0008) [2023-12-26 09:02:57,238][123090] Updated weights for policy 1, policy_version 1176159 (0.0009) [2023-12-26 09:02:57,254][123091] Updated weights for policy 0, policy_version 1184471 (0.0007) [2023-12-26 09:02:57,328][123091] Updated weights for policy 0, policy_version 1184481 (0.0007) [2023-12-26 09:02:57,386][123091] Updated weights for policy 0, policy_version 1184491 (0.0006) [2023-12-26 09:02:58,101][123091] Updated weights for policy 0, policy_version 1184501 (0.0007) [2023-12-26 09:02:58,151][123090] Updated weights for policy 1, policy_version 1176169 (0.0009) [2023-12-26 09:02:58,171][123091] Updated weights for policy 0, policy_version 1184511 (0.0007) [2023-12-26 09:02:58,206][123090] Updated weights for policy 1, policy_version 1176179 (0.0008) [2023-12-26 09:02:58,236][123091] Updated weights for policy 0, policy_version 1184521 (0.0006) [2023-12-26 09:02:58,271][123090] Updated weights for policy 1, policy_version 1176189 (0.0008) [2023-12-26 09:02:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 604348416. Throughput: 0: 8798.4, 1: 8897.9. Samples: 604343968. Policy #0 lag: (min: 15.0, avg: 15.0, max: 15.0) [2023-12-26 09:02:58,784][121949] Avg episode reward: [(0, '6009.774'), (1, '6020.139')] [2023-12-26 09:02:59,086][123091] Updated weights for policy 0, policy_version 1184531 (0.0009) [2023-12-26 09:02:59,139][123091] Updated weights for policy 0, policy_version 1184541 (0.0007) [2023-12-26 09:02:59,206][123091] Updated weights for policy 0, policy_version 1184551 (0.0007) [2023-12-26 09:02:59,222][123090] Updated weights for policy 1, policy_version 1176199 (0.0010) [2023-12-26 09:02:59,286][123090] Updated weights for policy 1, policy_version 1176209 (0.0010) [2023-12-26 09:02:59,348][123090] Updated weights for policy 1, policy_version 1176219 (0.0012) [2023-12-26 09:02:59,904][123091] Updated weights for policy 0, policy_version 1184561 (0.0009) [2023-12-26 09:02:59,972][123091] Updated weights for policy 0, policy_version 1184571 (0.0010) [2023-12-26 09:03:00,032][123091] Updated weights for policy 0, policy_version 1184581 (0.0011) [2023-12-26 09:03:00,079][123091] Updated weights for policy 0, policy_version 1184591 (0.0010) [2023-12-26 09:03:00,172][123090] Updated weights for policy 1, policy_version 1176229 (0.0009) [2023-12-26 09:03:00,240][123090] Updated weights for policy 1, policy_version 1176239 (0.0005) [2023-12-26 09:03:00,293][123090] Updated weights for policy 1, policy_version 1176249 (0.0005) [2023-12-26 09:03:00,816][123091] Updated weights for policy 0, policy_version 1184601 (0.0007) [2023-12-26 09:03:00,864][123091] Updated weights for policy 0, policy_version 1184611 (0.0005) [2023-12-26 09:03:00,909][123091] Updated weights for policy 0, policy_version 1184621 (0.0005) [2023-12-26 09:03:01,147][123090] Updated weights for policy 1, policy_version 1176259 (0.0006) [2023-12-26 09:03:01,208][123090] Updated weights for policy 1, policy_version 1176269 (0.0009) [2023-12-26 09:03:01,279][123090] Updated weights for policy 1, policy_version 1176279 (0.0010) [2023-12-26 09:03:01,656][123091] Updated weights for policy 0, policy_version 1184631 (0.0007) [2023-12-26 09:03:01,730][123091] Updated weights for policy 0, policy_version 1184641 (0.0006) [2023-12-26 09:03:01,792][123091] Updated weights for policy 0, policy_version 1184651 (0.0008) [2023-12-26 09:03:02,024][123090] Updated weights for policy 1, policy_version 1176289 (0.0008) [2023-12-26 09:03:02,095][123090] Updated weights for policy 1, policy_version 1176299 (0.0010) [2023-12-26 09:03:02,167][123090] Updated weights for policy 1, policy_version 1176309 (0.0010) [2023-12-26 09:03:02,236][123090] Updated weights for policy 1, policy_version 1176319 (0.0010) [2023-12-26 09:03:02,542][123091] Updated weights for policy 0, policy_version 1184661 (0.0008) [2023-12-26 09:03:02,602][123091] Updated weights for policy 0, policy_version 1184671 (0.0010) [2023-12-26 09:03:02,663][123091] Updated weights for policy 0, policy_version 1184681 (0.0009) [2023-12-26 09:03:02,978][123090] Updated weights for policy 1, policy_version 1176329 (0.0008) [2023-12-26 09:03:03,031][123090] Updated weights for policy 1, policy_version 1176339 (0.0008) [2023-12-26 09:03:03,097][123090] Updated weights for policy 1, policy_version 1176349 (0.0005) [2023-12-26 09:03:03,382][123091] Updated weights for policy 0, policy_version 1184691 (0.0008) [2023-12-26 09:03:03,431][123091] Updated weights for policy 0, policy_version 1184701 (0.0005) [2023-12-26 09:03:03,480][123091] Updated weights for policy 0, policy_version 1184711 (0.0005) [2023-12-26 09:03:03,780][123090] Updated weights for policy 1, policy_version 1176359 (0.0009) [2023-12-26 09:03:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 604438528. Throughput: 0: 8955.6, 1: 8764.9. Samples: 604451372. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:03,785][121949] Avg episode reward: [(0, '6231.445'), (1, '6007.675')] [2023-12-26 09:03:03,825][123090] Updated weights for policy 1, policy_version 1176369 (0.0010) [2023-12-26 09:03:03,884][123090] Updated weights for policy 1, policy_version 1176379 (0.0009) [2023-12-26 09:03:04,176][123091] Updated weights for policy 0, policy_version 1184721 (0.0005) [2023-12-26 09:03:04,246][123091] Updated weights for policy 0, policy_version 1184731 (0.0010) [2023-12-26 09:03:04,306][123091] Updated weights for policy 0, policy_version 1184741 (0.0008) [2023-12-26 09:03:04,373][123091] Updated weights for policy 0, policy_version 1184751 (0.0006) [2023-12-26 09:03:04,703][123090] Updated weights for policy 1, policy_version 1176389 (0.0008) [2023-12-26 09:03:04,775][123090] Updated weights for policy 1, policy_version 1176399 (0.0010) [2023-12-26 09:03:04,850][123090] Updated weights for policy 1, policy_version 1176409 (0.0010) [2023-12-26 09:03:05,055][123091] Updated weights for policy 0, policy_version 1184761 (0.0009) [2023-12-26 09:03:05,104][123091] Updated weights for policy 0, policy_version 1184771 (0.0009) [2023-12-26 09:03:05,153][123091] Updated weights for policy 0, policy_version 1184781 (0.0009) [2023-12-26 09:03:05,664][123090] Updated weights for policy 1, policy_version 1176419 (0.0010) [2023-12-26 09:03:05,729][123090] Updated weights for policy 1, policy_version 1176429 (0.0007) [2023-12-26 09:03:05,781][123090] Updated weights for policy 1, policy_version 1176439 (0.0009) [2023-12-26 09:03:05,975][123091] Updated weights for policy 0, policy_version 1184791 (0.0009) [2023-12-26 09:03:06,024][123091] Updated weights for policy 0, policy_version 1184802 (0.0009) [2023-12-26 09:03:06,078][123091] Updated weights for policy 0, policy_version 1184812 (0.0009) [2023-12-26 09:03:06,593][123090] Updated weights for policy 1, policy_version 1176449 (0.0010) [2023-12-26 09:03:06,655][123090] Updated weights for policy 1, policy_version 1176459 (0.0009) [2023-12-26 09:03:06,708][123090] Updated weights for policy 1, policy_version 1176469 (0.0009) [2023-12-26 09:03:06,761][123090] Updated weights for policy 1, policy_version 1176479 (0.0008) [2023-12-26 09:03:06,974][123091] Updated weights for policy 0, policy_version 1184822 (0.0008) [2023-12-26 09:03:07,029][123091] Updated weights for policy 0, policy_version 1184832 (0.0006) [2023-12-26 09:03:07,091][123091] Updated weights for policy 0, policy_version 1184842 (0.0006) [2023-12-26 09:03:07,636][123090] Updated weights for policy 1, policy_version 1176489 (0.0010) [2023-12-26 09:03:07,701][123090] Updated weights for policy 1, policy_version 1176499 (0.0009) [2023-12-26 09:03:07,770][123090] Updated weights for policy 1, policy_version 1176509 (0.0009) [2023-12-26 09:03:07,781][123091] Updated weights for policy 0, policy_version 1184852 (0.0007) [2023-12-26 09:03:07,842][123091] Updated weights for policy 0, policy_version 1184862 (0.0010) [2023-12-26 09:03:07,911][123091] Updated weights for policy 0, policy_version 1184872 (0.0009) [2023-12-26 09:03:08,487][123090] Updated weights for policy 1, policy_version 1176519 (0.0007) [2023-12-26 09:03:08,560][123090] Updated weights for policy 1, policy_version 1176529 (0.0006) [2023-12-26 09:03:08,596][123091] Updated weights for policy 0, policy_version 1184882 (0.0010) [2023-12-26 09:03:08,627][123090] Updated weights for policy 1, policy_version 1176539 (0.0007) [2023-12-26 09:03:08,654][123091] Updated weights for policy 0, policy_version 1184892 (0.0008) [2023-12-26 09:03:08,703][123091] Updated weights for policy 0, policy_version 1184902 (0.0005) [2023-12-26 09:03:08,760][123091] Updated weights for policy 0, policy_version 1184912 (0.0005) [2023-12-26 09:03:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 604536832. Throughput: 0: 9010.0, 1: 8786.6. Samples: 604504872. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:08,785][121949] Avg episode reward: [(0, '6290.266'), (1, '5886.544')] [2023-12-26 09:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001184912_303341568.pth... [2023-12-26 09:03:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001176544_301195264.pth... [2023-12-26 09:03:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001175520_300933120.pth [2023-12-26 09:03:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001183824_303063040.pth [2023-12-26 09:03:09,388][123090] Updated weights for policy 1, policy_version 1176549 (0.0008) [2023-12-26 09:03:09,422][123091] Updated weights for policy 0, policy_version 1184922 (0.0009) [2023-12-26 09:03:09,462][123090] Updated weights for policy 1, policy_version 1176559 (0.0008) [2023-12-26 09:03:09,486][123091] Updated weights for policy 0, policy_version 1184932 (0.0007) [2023-12-26 09:03:09,535][123090] Updated weights for policy 1, policy_version 1176569 (0.0008) [2023-12-26 09:03:09,547][123091] Updated weights for policy 0, policy_version 1184942 (0.0007) [2023-12-26 09:03:10,307][123090] Updated weights for policy 1, policy_version 1176579 (0.0008) [2023-12-26 09:03:10,371][123090] Updated weights for policy 1, policy_version 1176589 (0.0008) [2023-12-26 09:03:10,400][123091] Updated weights for policy 0, policy_version 1184952 (0.0009) [2023-12-26 09:03:10,420][123090] Updated weights for policy 1, policy_version 1176599 (0.0008) [2023-12-26 09:03:10,462][123091] Updated weights for policy 0, policy_version 1184962 (0.0008) [2023-12-26 09:03:10,513][123091] Updated weights for policy 0, policy_version 1184972 (0.0009) [2023-12-26 09:03:11,270][123090] Updated weights for policy 1, policy_version 1176609 (0.0008) [2023-12-26 09:03:11,329][123091] Updated weights for policy 0, policy_version 1184982 (0.0007) [2023-12-26 09:03:11,339][123090] Updated weights for policy 1, policy_version 1176619 (0.0011) [2023-12-26 09:03:11,408][123090] Updated weights for policy 1, policy_version 1176629 (0.0010) [2023-12-26 09:03:11,408][123091] Updated weights for policy 0, policy_version 1184992 (0.0007) [2023-12-26 09:03:11,465][123090] Updated weights for policy 1, policy_version 1176639 (0.0011) [2023-12-26 09:03:11,478][123091] Updated weights for policy 0, policy_version 1185002 (0.0006) [2023-12-26 09:03:12,160][123091] Updated weights for policy 0, policy_version 1185012 (0.0007) [2023-12-26 09:03:12,225][123091] Updated weights for policy 0, policy_version 1185022 (0.0008) [2023-12-26 09:03:12,231][123090] Updated weights for policy 1, policy_version 1176649 (0.0011) [2023-12-26 09:03:12,294][123091] Updated weights for policy 0, policy_version 1185032 (0.0007) [2023-12-26 09:03:12,299][123090] Updated weights for policy 1, policy_version 1176659 (0.0010) [2023-12-26 09:03:12,372][123090] Updated weights for policy 1, policy_version 1176670 (0.0008) [2023-12-26 09:03:13,060][123090] Updated weights for policy 1, policy_version 1176680 (0.0007) [2023-12-26 09:03:13,125][123090] Updated weights for policy 1, policy_version 1176690 (0.0008) [2023-12-26 09:03:13,158][123091] Updated weights for policy 0, policy_version 1185042 (0.0008) [2023-12-26 09:03:13,182][123090] Updated weights for policy 1, policy_version 1176700 (0.0006) [2023-12-26 09:03:13,207][123091] Updated weights for policy 0, policy_version 1185052 (0.0005) [2023-12-26 09:03:13,257][123091] Updated weights for policy 0, policy_version 1185062 (0.0005) [2023-12-26 09:03:13,342][123091] Updated weights for policy 0, policy_version 1185072 (0.0005) [2023-12-26 09:03:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 604618752. Throughput: 0: 9057.3, 1: 8802.0. Samples: 604612636. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:13,784][121949] Avg episode reward: [(0, '6168.174'), (1, '5848.762')] [2023-12-26 09:03:13,926][123090] Updated weights for policy 1, policy_version 1176710 (0.0007) [2023-12-26 09:03:13,990][123091] Updated weights for policy 0, policy_version 1185082 (0.0005) [2023-12-26 09:03:13,993][123090] Updated weights for policy 1, policy_version 1176720 (0.0005) [2023-12-26 09:03:14,049][123090] Updated weights for policy 1, policy_version 1176730 (0.0005) [2023-12-26 09:03:14,060][123091] Updated weights for policy 0, policy_version 1185092 (0.0005) [2023-12-26 09:03:14,125][123091] Updated weights for policy 0, policy_version 1185102 (0.0008) [2023-12-26 09:03:14,825][123091] Updated weights for policy 0, policy_version 1185112 (0.0009) [2023-12-26 09:03:14,891][123091] Updated weights for policy 0, policy_version 1185122 (0.0009) [2023-12-26 09:03:14,910][123090] Updated weights for policy 1, policy_version 1176740 (0.0008) [2023-12-26 09:03:14,952][123091] Updated weights for policy 0, policy_version 1185132 (0.0008) [2023-12-26 09:03:14,959][123090] Updated weights for policy 1, policy_version 1176750 (0.0006) [2023-12-26 09:03:15,015][123090] Updated weights for policy 1, policy_version 1176760 (0.0009) [2023-12-26 09:03:15,769][123091] Updated weights for policy 0, policy_version 1185142 (0.0009) [2023-12-26 09:03:15,840][123091] Updated weights for policy 0, policy_version 1185152 (0.0010) [2023-12-26 09:03:15,844][123090] Updated weights for policy 1, policy_version 1176770 (0.0008) [2023-12-26 09:03:15,901][123090] Updated weights for policy 1, policy_version 1176780 (0.0005) [2023-12-26 09:03:15,907][123091] Updated weights for policy 0, policy_version 1185162 (0.0009) [2023-12-26 09:03:15,956][123090] Updated weights for policy 1, policy_version 1176790 (0.0006) [2023-12-26 09:03:16,023][123090] Updated weights for policy 1, policy_version 1176800 (0.0005) [2023-12-26 09:03:16,767][123090] Updated weights for policy 1, policy_version 1176810 (0.0005) [2023-12-26 09:03:16,771][123091] Updated weights for policy 0, policy_version 1185172 (0.0009) [2023-12-26 09:03:16,828][123091] Updated weights for policy 0, policy_version 1185182 (0.0008) [2023-12-26 09:03:16,835][123090] Updated weights for policy 1, policy_version 1176820 (0.0005) [2023-12-26 09:03:16,888][123090] Updated weights for policy 1, policy_version 1176830 (0.0009) [2023-12-26 09:03:16,891][123091] Updated weights for policy 0, policy_version 1185192 (0.0008) [2023-12-26 09:03:17,513][123090] Updated weights for policy 1, policy_version 1176840 (0.0005) [2023-12-26 09:03:17,584][123090] Updated weights for policy 1, policy_version 1176850 (0.0005) [2023-12-26 09:03:17,650][123090] Updated weights for policy 1, policy_version 1176860 (0.0005) [2023-12-26 09:03:17,801][123091] Updated weights for policy 0, policy_version 1185202 (0.0009) [2023-12-26 09:03:17,867][123091] Updated weights for policy 0, policy_version 1185212 (0.0009) [2023-12-26 09:03:17,930][123091] Updated weights for policy 0, policy_version 1185222 (0.0005) [2023-12-26 09:03:17,999][123091] Updated weights for policy 0, policy_version 1185232 (0.0005) [2023-12-26 09:03:18,236][123090] Updated weights for policy 1, policy_version 1176870 (0.0005) [2023-12-26 09:03:18,293][123090] Updated weights for policy 1, policy_version 1176880 (0.0005) [2023-12-26 09:03:18,353][123090] Updated weights for policy 1, policy_version 1176890 (0.0008) [2023-12-26 09:03:18,678][123091] Updated weights for policy 0, policy_version 1185242 (0.0010) [2023-12-26 09:03:18,725][123091] Updated weights for policy 0, policy_version 1185252 (0.0009) [2023-12-26 09:03:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 604708864. Throughput: 0: 9021.0, 1: 8826.9. Samples: 604724236. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:18,785][123091] Updated weights for policy 0, policy_version 1185262 (0.0009) [2023-12-26 09:03:18,785][121949] Avg episode reward: [(0, '6154.768'), (1, '5867.621')] [2023-12-26 09:03:19,154][123090] Updated weights for policy 1, policy_version 1176900 (0.0010) [2023-12-26 09:03:19,221][123090] Updated weights for policy 1, policy_version 1176910 (0.0010) [2023-12-26 09:03:19,296][123090] Updated weights for policy 1, policy_version 1176920 (0.0009) [2023-12-26 09:03:19,617][123091] Updated weights for policy 0, policy_version 1185272 (0.0007) [2023-12-26 09:03:19,673][123091] Updated weights for policy 0, policy_version 1185282 (0.0009) [2023-12-26 09:03:19,746][123091] Updated weights for policy 0, policy_version 1185292 (0.0009) [2023-12-26 09:03:20,108][123090] Updated weights for policy 1, policy_version 1176930 (0.0010) [2023-12-26 09:03:20,176][123090] Updated weights for policy 1, policy_version 1176940 (0.0009) [2023-12-26 09:03:20,230][123090] Updated weights for policy 1, policy_version 1176950 (0.0009) [2023-12-26 09:03:20,295][123090] Updated weights for policy 1, policy_version 1176960 (0.0009) [2023-12-26 09:03:20,518][123091] Updated weights for policy 0, policy_version 1185302 (0.0009) [2023-12-26 09:03:20,582][123091] Updated weights for policy 0, policy_version 1185312 (0.0009) [2023-12-26 09:03:20,652][123091] Updated weights for policy 0, policy_version 1185322 (0.0010) [2023-12-26 09:03:21,151][123090] Updated weights for policy 1, policy_version 1176970 (0.0009) [2023-12-26 09:03:21,224][123090] Updated weights for policy 1, policy_version 1176980 (0.0010) [2023-12-26 09:03:21,289][123090] Updated weights for policy 1, policy_version 1176990 (0.0009) [2023-12-26 09:03:21,489][123091] Updated weights for policy 0, policy_version 1185332 (0.0011) [2023-12-26 09:03:21,551][123091] Updated weights for policy 0, policy_version 1185342 (0.0009) [2023-12-26 09:03:21,612][123091] Updated weights for policy 0, policy_version 1185352 (0.0010) [2023-12-26 09:03:22,066][123090] Updated weights for policy 1, policy_version 1177000 (0.0009) [2023-12-26 09:03:22,131][123090] Updated weights for policy 1, policy_version 1177010 (0.0009) [2023-12-26 09:03:22,198][123090] Updated weights for policy 1, policy_version 1177020 (0.0009) [2023-12-26 09:03:22,491][123091] Updated weights for policy 0, policy_version 1185362 (0.0009) [2023-12-26 09:03:22,554][123091] Updated weights for policy 0, policy_version 1185372 (0.0009) [2023-12-26 09:03:22,625][123091] Updated weights for policy 0, policy_version 1185382 (0.0010) [2023-12-26 09:03:22,691][123091] Updated weights for policy 0, policy_version 1185392 (0.0010) [2023-12-26 09:03:23,040][123090] Updated weights for policy 1, policy_version 1177030 (0.0010) [2023-12-26 09:03:23,105][123090] Updated weights for policy 1, policy_version 1177040 (0.0009) [2023-12-26 09:03:23,165][123090] Updated weights for policy 1, policy_version 1177050 (0.0009) [2023-12-26 09:03:23,518][123091] Updated weights for policy 0, policy_version 1185402 (0.0011) [2023-12-26 09:03:23,585][123091] Updated weights for policy 0, policy_version 1185412 (0.0011) [2023-12-26 09:03:23,647][123091] Updated weights for policy 0, policy_version 1185422 (0.0011) [2023-12-26 09:03:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 604798976. Throughput: 0: 9009.1, 1: 8760.5. Samples: 604775080. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:23,784][121949] Avg episode reward: [(0, '6140.728'), (1, '5819.620')] [2023-12-26 09:03:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001185424_303472640.pth... [2023-12-26 09:03:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001177056_301326336.pth... [2023-12-26 09:03:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001184368_303202304.pth [2023-12-26 09:03:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001176032_301064192.pth [2023-12-26 09:03:23,975][123090] Updated weights for policy 1, policy_version 1177060 (0.0008) [2023-12-26 09:03:24,038][123090] Updated weights for policy 1, policy_version 1177070 (0.0009) [2023-12-26 09:03:24,099][123090] Updated weights for policy 1, policy_version 1177080 (0.0007) [2023-12-26 09:03:24,424][123091] Updated weights for policy 0, policy_version 1185432 (0.0008) [2023-12-26 09:03:24,474][123091] Updated weights for policy 0, policy_version 1185442 (0.0008) [2023-12-26 09:03:24,527][123091] Updated weights for policy 0, policy_version 1185452 (0.0008) [2023-12-26 09:03:24,933][123090] Updated weights for policy 1, policy_version 1177090 (0.0006) [2023-12-26 09:03:24,991][123090] Updated weights for policy 1, policy_version 1177100 (0.0010) [2023-12-26 09:03:25,046][123090] Updated weights for policy 1, policy_version 1177110 (0.0010) [2023-12-26 09:03:25,103][123090] Updated weights for policy 1, policy_version 1177120 (0.0010) [2023-12-26 09:03:25,218][123091] Updated weights for policy 0, policy_version 1185462 (0.0006) [2023-12-26 09:03:25,276][123091] Updated weights for policy 0, policy_version 1185472 (0.0005) [2023-12-26 09:03:25,336][123091] Updated weights for policy 0, policy_version 1185482 (0.0005) [2023-12-26 09:03:26,008][123090] Updated weights for policy 1, policy_version 1177130 (0.0009) [2023-12-26 09:03:26,070][123090] Updated weights for policy 1, policy_version 1177140 (0.0008) [2023-12-26 09:03:26,080][123091] Updated weights for policy 0, policy_version 1185492 (0.0011) [2023-12-26 09:03:26,130][123090] Updated weights for policy 1, policy_version 1177150 (0.0007) [2023-12-26 09:03:26,142][123091] Updated weights for policy 0, policy_version 1185502 (0.0010) [2023-12-26 09:03:26,197][123091] Updated weights for policy 0, policy_version 1185512 (0.0010) [2023-12-26 09:03:26,952][123090] Updated weights for policy 1, policy_version 1177160 (0.0009) [2023-12-26 09:03:27,018][123091] Updated weights for policy 0, policy_version 1185522 (0.0011) [2023-12-26 09:03:27,020][123090] Updated weights for policy 1, policy_version 1177170 (0.0008) [2023-12-26 09:03:27,069][123090] Updated weights for policy 1, policy_version 1177180 (0.0007) [2023-12-26 09:03:27,078][123091] Updated weights for policy 0, policy_version 1185532 (0.0011) [2023-12-26 09:03:27,134][123091] Updated weights for policy 0, policy_version 1185542 (0.0011) [2023-12-26 09:03:27,181][123091] Updated weights for policy 0, policy_version 1185552 (0.0010) [2023-12-26 09:03:27,858][123090] Updated weights for policy 1, policy_version 1177190 (0.0009) [2023-12-26 09:03:27,922][123090] Updated weights for policy 1, policy_version 1177200 (0.0008) [2023-12-26 09:03:27,959][123091] Updated weights for policy 0, policy_version 1185562 (0.0006) [2023-12-26 09:03:27,989][123090] Updated weights for policy 1, policy_version 1177210 (0.0008) [2023-12-26 09:03:28,019][123091] Updated weights for policy 0, policy_version 1185572 (0.0008) [2023-12-26 09:03:28,083][123091] Updated weights for policy 0, policy_version 1185582 (0.0011) [2023-12-26 09:03:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 604880896. Throughput: 0: 9031.5, 1: 8793.8. Samples: 604880140. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:28,784][121949] Avg episode reward: [(0, '6107.228'), (1, '5808.425')] [2023-12-26 09:03:28,811][123090] Updated weights for policy 1, policy_version 1177220 (0.0008) [2023-12-26 09:03:28,813][123091] Updated weights for policy 0, policy_version 1185592 (0.0011) [2023-12-26 09:03:28,865][123090] Updated weights for policy 1, policy_version 1177230 (0.0008) [2023-12-26 09:03:28,877][123091] Updated weights for policy 0, policy_version 1185602 (0.0011) [2023-12-26 09:03:28,936][123090] Updated weights for policy 1, policy_version 1177240 (0.0008) [2023-12-26 09:03:28,941][123091] Updated weights for policy 0, policy_version 1185612 (0.0010) [2023-12-26 09:03:29,747][123091] Updated weights for policy 0, policy_version 1185622 (0.0010) [2023-12-26 09:03:29,796][123090] Updated weights for policy 1, policy_version 1177250 (0.0005) [2023-12-26 09:03:29,801][123091] Updated weights for policy 0, policy_version 1185632 (0.0010) [2023-12-26 09:03:29,861][123090] Updated weights for policy 1, policy_version 1177260 (0.0007) [2023-12-26 09:03:29,867][123091] Updated weights for policy 0, policy_version 1185642 (0.0009) [2023-12-26 09:03:29,929][123090] Updated weights for policy 1, policy_version 1177270 (0.0008) [2023-12-26 09:03:29,987][123090] Updated weights for policy 1, policy_version 1177280 (0.0009) [2023-12-26 09:03:30,619][123091] Updated weights for policy 0, policy_version 1185652 (0.0009) [2023-12-26 09:03:30,680][123091] Updated weights for policy 0, policy_version 1185662 (0.0009) [2023-12-26 09:03:30,732][123091] Updated weights for policy 0, policy_version 1185672 (0.0009) [2023-12-26 09:03:30,877][123090] Updated weights for policy 1, policy_version 1177290 (0.0008) [2023-12-26 09:03:30,931][123090] Updated weights for policy 1, policy_version 1177300 (0.0008) [2023-12-26 09:03:30,986][123090] Updated weights for policy 1, policy_version 1177310 (0.0009) [2023-12-26 09:03:31,581][123091] Updated weights for policy 0, policy_version 1185683 (0.0008) [2023-12-26 09:03:31,641][123091] Updated weights for policy 0, policy_version 1185693 (0.0006) [2023-12-26 09:03:31,698][123091] Updated weights for policy 0, policy_version 1185703 (0.0009) [2023-12-26 09:03:31,860][123090] Updated weights for policy 1, policy_version 1177320 (0.0009) [2023-12-26 09:03:31,930][123090] Updated weights for policy 1, policy_version 1177330 (0.0007) [2023-12-26 09:03:31,989][123090] Updated weights for policy 1, policy_version 1177340 (0.0005) [2023-12-26 09:03:32,508][123091] Updated weights for policy 0, policy_version 1185713 (0.0009) [2023-12-26 09:03:32,577][123091] Updated weights for policy 0, policy_version 1185723 (0.0005) [2023-12-26 09:03:32,645][123091] Updated weights for policy 0, policy_version 1185733 (0.0005) [2023-12-26 09:03:32,650][123090] Updated weights for policy 1, policy_version 1177350 (0.0007) [2023-12-26 09:03:32,707][123090] Updated weights for policy 1, policy_version 1177360 (0.0008) [2023-12-26 09:03:32,709][123091] Updated weights for policy 0, policy_version 1185743 (0.0006) [2023-12-26 09:03:32,763][123090] Updated weights for policy 1, policy_version 1177370 (0.0008) [2023-12-26 09:03:33,507][123091] Updated weights for policy 0, policy_version 1185753 (0.0006) [2023-12-26 09:03:33,511][123090] Updated weights for policy 1, policy_version 1177380 (0.0008) [2023-12-26 09:03:33,560][123091] Updated weights for policy 0, policy_version 1185763 (0.0005) [2023-12-26 09:03:33,579][123090] Updated weights for policy 1, policy_version 1177390 (0.0008) [2023-12-26 09:03:33,614][123091] Updated weights for policy 0, policy_version 1185773 (0.0005) [2023-12-26 09:03:33,636][123090] Updated weights for policy 1, policy_version 1177400 (0.0009) [2023-12-26 09:03:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 604979200. Throughput: 0: 9098.0, 1: 8682.4. Samples: 604986420. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:33,785][121949] Avg episode reward: [(0, '6043.395'), (1, '5628.828')] [2023-12-26 09:03:34,319][123091] Updated weights for policy 0, policy_version 1185783 (0.0005) [2023-12-26 09:03:34,376][123091] Updated weights for policy 0, policy_version 1185793 (0.0005) [2023-12-26 09:03:34,424][123091] Updated weights for policy 0, policy_version 1185803 (0.0006) [2023-12-26 09:03:34,506][123090] Updated weights for policy 1, policy_version 1177410 (0.0009) [2023-12-26 09:03:34,571][123090] Updated weights for policy 1, policy_version 1177420 (0.0009) [2023-12-26 09:03:34,635][123090] Updated weights for policy 1, policy_version 1177430 (0.0009) [2023-12-26 09:03:34,703][123090] Updated weights for policy 1, policy_version 1177440 (0.0008) [2023-12-26 09:03:35,164][123091] Updated weights for policy 0, policy_version 1185813 (0.0006) [2023-12-26 09:03:35,234][123091] Updated weights for policy 0, policy_version 1185823 (0.0005) [2023-12-26 09:03:35,292][123091] Updated weights for policy 0, policy_version 1185833 (0.0006) [2023-12-26 09:03:35,528][123090] Updated weights for policy 1, policy_version 1177450 (0.0005) [2023-12-26 09:03:35,595][123090] Updated weights for policy 1, policy_version 1177460 (0.0009) [2023-12-26 09:03:35,653][123090] Updated weights for policy 1, policy_version 1177470 (0.0010) [2023-12-26 09:03:35,970][123091] Updated weights for policy 0, policy_version 1185843 (0.0008) [2023-12-26 09:03:36,029][123091] Updated weights for policy 0, policy_version 1185853 (0.0008) [2023-12-26 09:03:36,083][123091] Updated weights for policy 0, policy_version 1185863 (0.0010) [2023-12-26 09:03:36,374][123090] Updated weights for policy 1, policy_version 1177480 (0.0009) [2023-12-26 09:03:36,442][123090] Updated weights for policy 1, policy_version 1177490 (0.0008) [2023-12-26 09:03:36,509][123090] Updated weights for policy 1, policy_version 1177500 (0.0008) [2023-12-26 09:03:36,968][123091] Updated weights for policy 0, policy_version 1185873 (0.0009) [2023-12-26 09:03:37,035][123091] Updated weights for policy 0, policy_version 1185883 (0.0009) [2023-12-26 09:03:37,093][123091] Updated weights for policy 0, policy_version 1185893 (0.0009) [2023-12-26 09:03:37,151][123091] Updated weights for policy 0, policy_version 1185903 (0.0009) [2023-12-26 09:03:37,331][123090] Updated weights for policy 1, policy_version 1177510 (0.0009) [2023-12-26 09:03:37,397][123090] Updated weights for policy 1, policy_version 1177520 (0.0010) [2023-12-26 09:03:37,461][123090] Updated weights for policy 1, policy_version 1177530 (0.0009) [2023-12-26 09:03:37,984][123091] Updated weights for policy 0, policy_version 1185913 (0.0011) [2023-12-26 09:03:38,046][123091] Updated weights for policy 0, policy_version 1185923 (0.0008) [2023-12-26 09:03:38,104][123091] Updated weights for policy 0, policy_version 1185933 (0.0005) [2023-12-26 09:03:38,319][123090] Updated weights for policy 1, policy_version 1177540 (0.0008) [2023-12-26 09:03:38,392][123090] Updated weights for policy 1, policy_version 1177550 (0.0009) [2023-12-26 09:03:38,455][123090] Updated weights for policy 1, policy_version 1177560 (0.0010) [2023-12-26 09:03:38,767][123091] Updated weights for policy 0, policy_version 1185943 (0.0005) [2023-12-26 09:03:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 605061120. Throughput: 0: 9157.8, 1: 8672.2. Samples: 605039612. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:38,784][121949] Avg episode reward: [(0, '6157.189'), (1, '5561.683')] [2023-12-26 09:03:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001177568_301457408.pth... [2023-12-26 09:03:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001176544_301195264.pth [2023-12-26 09:03:38,839][123091] Updated weights for policy 0, policy_version 1185953 (0.0007) [2023-12-26 09:03:38,905][123091] Updated weights for policy 0, policy_version 1185963 (0.0011) [2023-12-26 09:03:38,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001185968_303611904.pth... [2023-12-26 09:03:38,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001184912_303341568.pth [2023-12-26 09:03:39,357][123090] Updated weights for policy 1, policy_version 1177570 (0.0009) [2023-12-26 09:03:39,430][123090] Updated weights for policy 1, policy_version 1177580 (0.0009) [2023-12-26 09:03:39,496][123090] Updated weights for policy 1, policy_version 1177590 (0.0009) [2023-12-26 09:03:39,570][123090] Updated weights for policy 1, policy_version 1177600 (0.0007) [2023-12-26 09:03:39,659][123091] Updated weights for policy 0, policy_version 1185973 (0.0008) [2023-12-26 09:03:39,734][123091] Updated weights for policy 0, policy_version 1185983 (0.0009) [2023-12-26 09:03:39,805][123091] Updated weights for policy 0, policy_version 1185993 (0.0011) [2023-12-26 09:03:40,323][123090] Updated weights for policy 1, policy_version 1177610 (0.0005) [2023-12-26 09:03:40,382][123090] Updated weights for policy 1, policy_version 1177620 (0.0008) [2023-12-26 09:03:40,441][123090] Updated weights for policy 1, policy_version 1177630 (0.0010) [2023-12-26 09:03:40,563][123091] Updated weights for policy 0, policy_version 1186003 (0.0009) [2023-12-26 09:03:40,618][123091] Updated weights for policy 0, policy_version 1186013 (0.0005) [2023-12-26 09:03:40,680][123091] Updated weights for policy 0, policy_version 1186023 (0.0007) [2023-12-26 09:03:41,329][123090] Updated weights for policy 1, policy_version 1177640 (0.0010) [2023-12-26 09:03:41,397][123090] Updated weights for policy 1, policy_version 1177650 (0.0010) [2023-12-26 09:03:41,464][123090] Updated weights for policy 1, policy_version 1177660 (0.0008) [2023-12-26 09:03:41,499][123091] Updated weights for policy 0, policy_version 1186033 (0.0010) [2023-12-26 09:03:41,567][123091] Updated weights for policy 0, policy_version 1186043 (0.0010) [2023-12-26 09:03:41,639][123091] Updated weights for policy 0, policy_version 1186053 (0.0007) [2023-12-26 09:03:41,707][123091] Updated weights for policy 0, policy_version 1186063 (0.0008) [2023-12-26 09:03:42,337][123090] Updated weights for policy 1, policy_version 1177670 (0.0009) [2023-12-26 09:03:42,405][123090] Updated weights for policy 1, policy_version 1177680 (0.0009) [2023-12-26 09:03:42,466][123091] Updated weights for policy 0, policy_version 1186073 (0.0009) [2023-12-26 09:03:42,468][123090] Updated weights for policy 1, policy_version 1177690 (0.0008) [2023-12-26 09:03:42,519][123091] Updated weights for policy 0, policy_version 1186083 (0.0008) [2023-12-26 09:03:42,589][123091] Updated weights for policy 0, policy_version 1186093 (0.0009) [2023-12-26 09:03:43,296][123090] Updated weights for policy 1, policy_version 1177700 (0.0009) [2023-12-26 09:03:43,347][123090] Updated weights for policy 1, policy_version 1177710 (0.0009) [2023-12-26 09:03:43,403][123090] Updated weights for policy 1, policy_version 1177720 (0.0009) [2023-12-26 09:03:43,452][123091] Updated weights for policy 0, policy_version 1186103 (0.0008) [2023-12-26 09:03:43,500][123091] Updated weights for policy 0, policy_version 1186113 (0.0009) [2023-12-26 09:03:43,553][123091] Updated weights for policy 0, policy_version 1186123 (0.0009) [2023-12-26 09:03:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 605151232. Throughput: 0: 9041.5, 1: 8690.4. Samples: 605141904. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:43,785][121949] Avg episode reward: [(0, '6269.653'), (1, '5616.693')] [2023-12-26 09:03:44,258][123091] Updated weights for policy 0, policy_version 1186133 (0.0008) [2023-12-26 09:03:44,306][123091] Updated weights for policy 0, policy_version 1186143 (0.0009) [2023-12-26 09:03:44,327][123090] Updated weights for policy 1, policy_version 1177730 (0.0008) [2023-12-26 09:03:44,359][123091] Updated weights for policy 0, policy_version 1186153 (0.0007) [2023-12-26 09:03:44,389][123090] Updated weights for policy 1, policy_version 1177740 (0.0007) [2023-12-26 09:03:44,444][123090] Updated weights for policy 1, policy_version 1177750 (0.0009) [2023-12-26 09:03:44,496][123090] Updated weights for policy 1, policy_version 1177760 (0.0008) [2023-12-26 09:03:45,194][123091] Updated weights for policy 0, policy_version 1186163 (0.0009) [2023-12-26 09:03:45,243][123090] Updated weights for policy 1, policy_version 1177770 (0.0008) [2023-12-26 09:03:45,258][123091] Updated weights for policy 0, policy_version 1186173 (0.0008) [2023-12-26 09:03:45,293][123090] Updated weights for policy 1, policy_version 1177780 (0.0007) [2023-12-26 09:03:45,327][123091] Updated weights for policy 0, policy_version 1186183 (0.0009) [2023-12-26 09:03:45,345][123090] Updated weights for policy 1, policy_version 1177790 (0.0006) [2023-12-26 09:03:46,067][123091] Updated weights for policy 0, policy_version 1186193 (0.0009) [2023-12-26 09:03:46,073][123090] Updated weights for policy 1, policy_version 1177800 (0.0009) [2023-12-26 09:03:46,132][123091] Updated weights for policy 0, policy_version 1186203 (0.0006) [2023-12-26 09:03:46,133][123090] Updated weights for policy 1, policy_version 1177810 (0.0009) [2023-12-26 09:03:46,196][123091] Updated weights for policy 0, policy_version 1186213 (0.0005) [2023-12-26 09:03:46,198][123090] Updated weights for policy 1, policy_version 1177820 (0.0009) [2023-12-26 09:03:46,262][123091] Updated weights for policy 0, policy_version 1186223 (0.0005) [2023-12-26 09:03:46,818][123090] Updated weights for policy 1, policy_version 1177830 (0.0005) [2023-12-26 09:03:46,883][123090] Updated weights for policy 1, policy_version 1177840 (0.0008) [2023-12-26 09:03:46,906][123091] Updated weights for policy 0, policy_version 1186233 (0.0005) [2023-12-26 09:03:46,940][123090] Updated weights for policy 1, policy_version 1177850 (0.0009) [2023-12-26 09:03:46,958][123091] Updated weights for policy 0, policy_version 1186243 (0.0005) [2023-12-26 09:03:47,007][123091] Updated weights for policy 0, policy_version 1186253 (0.0005) [2023-12-26 09:03:47,622][123090] Updated weights for policy 1, policy_version 1177860 (0.0009) [2023-12-26 09:03:47,677][123090] Updated weights for policy 1, policy_version 1177870 (0.0008) [2023-12-26 09:03:47,730][123090] Updated weights for policy 1, policy_version 1177880 (0.0009) [2023-12-26 09:03:47,833][123091] Updated weights for policy 0, policy_version 1186263 (0.0009) [2023-12-26 09:03:47,888][123091] Updated weights for policy 0, policy_version 1186273 (0.0010) [2023-12-26 09:03:47,947][123091] Updated weights for policy 0, policy_version 1186283 (0.0010) [2023-12-26 09:03:48,650][123090] Updated weights for policy 1, policy_version 1177890 (0.0009) [2023-12-26 09:03:48,666][123091] Updated weights for policy 0, policy_version 1186293 (0.0007) [2023-12-26 09:03:48,711][123090] Updated weights for policy 1, policy_version 1177900 (0.0008) [2023-12-26 09:03:48,718][123091] Updated weights for policy 0, policy_version 1186303 (0.0008) [2023-12-26 09:03:48,769][123090] Updated weights for policy 1, policy_version 1177910 (0.0006) [2023-12-26 09:03:48,770][123091] Updated weights for policy 0, policy_version 1186313 (0.0009) [2023-12-26 09:03:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 605233152. Throughput: 0: 9038.2, 1: 8749.7. Samples: 605251820. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:48,784][121949] Avg episode reward: [(0, '6327.466'), (1, '5646.526')] [2023-12-26 09:03:48,834][123090] Updated weights for policy 1, policy_version 1177920 (0.0007) [2023-12-26 09:03:49,624][123091] Updated weights for policy 0, policy_version 1186323 (0.0010) [2023-12-26 09:03:49,679][123091] Updated weights for policy 0, policy_version 1186333 (0.0011) [2023-12-26 09:03:49,686][123090] Updated weights for policy 1, policy_version 1177930 (0.0009) [2023-12-26 09:03:49,735][123091] Updated weights for policy 0, policy_version 1186343 (0.0011) [2023-12-26 09:03:49,742][123090] Updated weights for policy 1, policy_version 1177940 (0.0006) [2023-12-26 09:03:49,806][123090] Updated weights for policy 1, policy_version 1177950 (0.0010) [2023-12-26 09:03:50,529][123091] Updated weights for policy 0, policy_version 1186353 (0.0011) [2023-12-26 09:03:50,591][123091] Updated weights for policy 0, policy_version 1186363 (0.0009) [2023-12-26 09:03:50,656][123091] Updated weights for policy 0, policy_version 1186373 (0.0009) [2023-12-26 09:03:50,674][123090] Updated weights for policy 1, policy_version 1177960 (0.0008) [2023-12-26 09:03:50,722][123091] Updated weights for policy 0, policy_version 1186383 (0.0009) [2023-12-26 09:03:50,738][123090] Updated weights for policy 1, policy_version 1177970 (0.0008) [2023-12-26 09:03:50,792][123090] Updated weights for policy 1, policy_version 1177980 (0.0009) [2023-12-26 09:03:51,570][123091] Updated weights for policy 0, policy_version 1186393 (0.0009) [2023-12-26 09:03:51,599][123090] Updated weights for policy 1, policy_version 1177990 (0.0008) [2023-12-26 09:03:51,632][123091] Updated weights for policy 0, policy_version 1186403 (0.0008) [2023-12-26 09:03:51,674][123090] Updated weights for policy 1, policy_version 1178000 (0.0007) [2023-12-26 09:03:51,696][123091] Updated weights for policy 0, policy_version 1186413 (0.0008) [2023-12-26 09:03:51,749][123090] Updated weights for policy 1, policy_version 1178010 (0.0007) [2023-12-26 09:03:52,566][123090] Updated weights for policy 1, policy_version 1178020 (0.0009) [2023-12-26 09:03:52,568][123091] Updated weights for policy 0, policy_version 1186423 (0.0008) [2023-12-26 09:03:52,622][123090] Updated weights for policy 1, policy_version 1178030 (0.0007) [2023-12-26 09:03:52,632][123091] Updated weights for policy 0, policy_version 1186433 (0.0009) [2023-12-26 09:03:52,675][123090] Updated weights for policy 1, policy_version 1178040 (0.0007) [2023-12-26 09:03:52,689][123091] Updated weights for policy 0, policy_version 1186443 (0.0009) [2023-12-26 09:03:53,442][123091] Updated weights for policy 0, policy_version 1186453 (0.0008) [2023-12-26 09:03:53,513][123091] Updated weights for policy 0, policy_version 1186463 (0.0009) [2023-12-26 09:03:53,548][123090] Updated weights for policy 1, policy_version 1178050 (0.0008) [2023-12-26 09:03:53,579][123091] Updated weights for policy 0, policy_version 1186473 (0.0008) [2023-12-26 09:03:53,617][123090] Updated weights for policy 1, policy_version 1178060 (0.0007) [2023-12-26 09:03:53,677][123090] Updated weights for policy 1, policy_version 1178070 (0.0008) [2023-12-26 09:03:53,730][123090] Updated weights for policy 1, policy_version 1178080 (0.0008) [2023-12-26 09:03:53,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17885.8, 300 sec: 17772.4). Total num frames: 605331456. Throughput: 0: 9003.7, 1: 8721.4. Samples: 605302512. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:53,786][121949] Avg episode reward: [(0, '6270.969'), (1, '5587.174')] [2023-12-26 09:03:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001186480_303742976.pth... [2023-12-26 09:03:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001178080_301588480.pth... [2023-12-26 09:03:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001185424_303472640.pth [2023-12-26 09:03:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001177056_301326336.pth [2023-12-26 09:03:54,292][123091] Updated weights for policy 0, policy_version 1186483 (0.0005) [2023-12-26 09:03:54,354][123091] Updated weights for policy 0, policy_version 1186493 (0.0008) [2023-12-26 09:03:54,410][123091] Updated weights for policy 0, policy_version 1186503 (0.0009) [2023-12-26 09:03:54,513][123090] Updated weights for policy 1, policy_version 1178090 (0.0009) [2023-12-26 09:03:54,566][123090] Updated weights for policy 1, policy_version 1178100 (0.0009) [2023-12-26 09:03:54,634][123090] Updated weights for policy 1, policy_version 1178110 (0.0009) [2023-12-26 09:03:55,220][123091] Updated weights for policy 0, policy_version 1186513 (0.0009) [2023-12-26 09:03:55,275][123091] Updated weights for policy 0, policy_version 1186523 (0.0009) [2023-12-26 09:03:55,344][123091] Updated weights for policy 0, policy_version 1186533 (0.0009) [2023-12-26 09:03:55,420][123091] Updated weights for policy 0, policy_version 1186543 (0.0009) [2023-12-26 09:03:55,477][123090] Updated weights for policy 1, policy_version 1178120 (0.0008) [2023-12-26 09:03:55,536][123090] Updated weights for policy 1, policy_version 1178130 (0.0009) [2023-12-26 09:03:55,600][123090] Updated weights for policy 1, policy_version 1178140 (0.0009) [2023-12-26 09:03:56,226][123091] Updated weights for policy 0, policy_version 1186553 (0.0010) [2023-12-26 09:03:56,282][123091] Updated weights for policy 0, policy_version 1186563 (0.0009) [2023-12-26 09:03:56,337][123091] Updated weights for policy 0, policy_version 1186573 (0.0009) [2023-12-26 09:03:56,411][123090] Updated weights for policy 1, policy_version 1178150 (0.0009) [2023-12-26 09:03:56,467][123090] Updated weights for policy 1, policy_version 1178160 (0.0008) [2023-12-26 09:03:56,525][123090] Updated weights for policy 1, policy_version 1178170 (0.0009) [2023-12-26 09:03:57,164][123091] Updated weights for policy 0, policy_version 1186583 (0.0009) [2023-12-26 09:03:57,221][123091] Updated weights for policy 0, policy_version 1186593 (0.0008) [2023-12-26 09:03:57,291][123091] Updated weights for policy 0, policy_version 1186603 (0.0009) [2023-12-26 09:03:57,364][123090] Updated weights for policy 1, policy_version 1178180 (0.0009) [2023-12-26 09:03:57,413][123090] Updated weights for policy 1, policy_version 1178190 (0.0009) [2023-12-26 09:03:57,462][123090] Updated weights for policy 1, policy_version 1178200 (0.0009) [2023-12-26 09:03:58,123][123091] Updated weights for policy 0, policy_version 1186613 (0.0009) [2023-12-26 09:03:58,196][123091] Updated weights for policy 0, policy_version 1186623 (0.0007) [2023-12-26 09:03:58,267][123091] Updated weights for policy 0, policy_version 1186633 (0.0008) [2023-12-26 09:03:58,427][123090] Updated weights for policy 1, policy_version 1178211 (0.0010) [2023-12-26 09:03:58,498][123090] Updated weights for policy 1, policy_version 1178221 (0.0010) [2023-12-26 09:03:58,566][123090] Updated weights for policy 1, policy_version 1178231 (0.0009) [2023-12-26 09:03:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 605413376. Throughput: 0: 8943.2, 1: 8692.7. Samples: 605406252. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:03:58,785][121949] Avg episode reward: [(0, '6084.094'), (1, '5485.286')] [2023-12-26 09:03:59,099][123091] Updated weights for policy 0, policy_version 1186643 (0.0007) [2023-12-26 09:03:59,167][123091] Updated weights for policy 0, policy_version 1186653 (0.0010) [2023-12-26 09:03:59,225][123091] Updated weights for policy 0, policy_version 1186663 (0.0010) [2023-12-26 09:03:59,460][123090] Updated weights for policy 1, policy_version 1178241 (0.0009) [2023-12-26 09:03:59,515][123090] Updated weights for policy 1, policy_version 1178251 (0.0009) [2023-12-26 09:03:59,570][123090] Updated weights for policy 1, policy_version 1178261 (0.0009) [2023-12-26 09:03:59,630][123090] Updated weights for policy 1, policy_version 1178271 (0.0009) [2023-12-26 09:04:00,038][123091] Updated weights for policy 0, policy_version 1186673 (0.0008) [2023-12-26 09:04:00,115][123091] Updated weights for policy 0, policy_version 1186683 (0.0009) [2023-12-26 09:04:00,180][123091] Updated weights for policy 0, policy_version 1186693 (0.0011) [2023-12-26 09:04:00,235][123091] Updated weights for policy 0, policy_version 1186703 (0.0009) [2023-12-26 09:04:00,505][123090] Updated weights for policy 1, policy_version 1178281 (0.0010) [2023-12-26 09:04:00,561][123090] Updated weights for policy 1, policy_version 1178291 (0.0009) [2023-12-26 09:04:00,611][123090] Updated weights for policy 1, policy_version 1178301 (0.0009) [2023-12-26 09:04:01,087][123091] Updated weights for policy 0, policy_version 1186713 (0.0007) [2023-12-26 09:04:01,145][123091] Updated weights for policy 0, policy_version 1186723 (0.0006) [2023-12-26 09:04:01,207][123091] Updated weights for policy 0, policy_version 1186733 (0.0006) [2023-12-26 09:04:01,413][123090] Updated weights for policy 1, policy_version 1178311 (0.0008) [2023-12-26 09:04:01,475][123090] Updated weights for policy 1, policy_version 1178321 (0.0005) [2023-12-26 09:04:01,532][123090] Updated weights for policy 1, policy_version 1178331 (0.0005) [2023-12-26 09:04:01,931][123091] Updated weights for policy 0, policy_version 1186743 (0.0005) [2023-12-26 09:04:01,988][123091] Updated weights for policy 0, policy_version 1186753 (0.0005) [2023-12-26 09:04:02,040][123091] Updated weights for policy 0, policy_version 1186763 (0.0005) [2023-12-26 09:04:02,189][123090] Updated weights for policy 1, policy_version 1178341 (0.0007) [2023-12-26 09:04:02,245][123090] Updated weights for policy 1, policy_version 1178351 (0.0006) [2023-12-26 09:04:02,315][123090] Updated weights for policy 1, policy_version 1178361 (0.0006) [2023-12-26 09:04:02,776][123091] Updated weights for policy 0, policy_version 1186773 (0.0008) [2023-12-26 09:04:02,838][123091] Updated weights for policy 0, policy_version 1186783 (0.0010) [2023-12-26 09:04:02,900][123091] Updated weights for policy 0, policy_version 1186793 (0.0011) [2023-12-26 09:04:03,069][123090] Updated weights for policy 1, policy_version 1178371 (0.0008) [2023-12-26 09:04:03,119][123090] Updated weights for policy 1, policy_version 1178381 (0.0010) [2023-12-26 09:04:03,175][123090] Updated weights for policy 1, policy_version 1178391 (0.0010) [2023-12-26 09:04:03,706][123091] Updated weights for policy 0, policy_version 1186803 (0.0010) [2023-12-26 09:04:03,764][123091] Updated weights for policy 0, policy_version 1186813 (0.0010) [2023-12-26 09:04:03,784][121949] Fps is (10 sec: 16384.8, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 605495296. Throughput: 0: 8913.5, 1: 8586.8. Samples: 605511748. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:03,785][121949] Avg episode reward: [(0, '5945.899'), (1, '5536.561')] [2023-12-26 09:04:03,817][123091] Updated weights for policy 0, policy_version 1186823 (0.0010) [2023-12-26 09:04:03,930][123090] Updated weights for policy 1, policy_version 1178401 (0.0008) [2023-12-26 09:04:03,990][123090] Updated weights for policy 1, policy_version 1178411 (0.0006) [2023-12-26 09:04:04,050][123090] Updated weights for policy 1, policy_version 1178421 (0.0006) [2023-12-26 09:04:04,109][123090] Updated weights for policy 1, policy_version 1178431 (0.0006) [2023-12-26 09:04:04,624][123091] Updated weights for policy 0, policy_version 1186833 (0.0011) [2023-12-26 09:04:04,687][123091] Updated weights for policy 0, policy_version 1186843 (0.0011) [2023-12-26 09:04:04,751][123091] Updated weights for policy 0, policy_version 1186853 (0.0010) [2023-12-26 09:04:04,817][123091] Updated weights for policy 0, policy_version 1186863 (0.0010) [2023-12-26 09:04:04,861][123090] Updated weights for policy 1, policy_version 1178441 (0.0010) [2023-12-26 09:04:04,931][123090] Updated weights for policy 1, policy_version 1178451 (0.0010) [2023-12-26 09:04:05,005][123090] Updated weights for policy 1, policy_version 1178461 (0.0010) [2023-12-26 09:04:05,618][123091] Updated weights for policy 0, policy_version 1186873 (0.0011) [2023-12-26 09:04:05,670][123091] Updated weights for policy 0, policy_version 1186883 (0.0010) [2023-12-26 09:04:05,685][123090] Updated weights for policy 1, policy_version 1178471 (0.0010) [2023-12-26 09:04:05,729][123091] Updated weights for policy 0, policy_version 1186893 (0.0010) [2023-12-26 09:04:05,745][123090] Updated weights for policy 1, policy_version 1178481 (0.0010) [2023-12-26 09:04:05,802][123090] Updated weights for policy 1, policy_version 1178491 (0.0010) [2023-12-26 09:04:06,558][123091] Updated weights for policy 0, policy_version 1186903 (0.0010) [2023-12-26 09:04:06,596][123090] Updated weights for policy 1, policy_version 1178501 (0.0011) [2023-12-26 09:04:06,619][123091] Updated weights for policy 0, policy_version 1186913 (0.0011) [2023-12-26 09:04:06,664][123090] Updated weights for policy 1, policy_version 1178511 (0.0011) [2023-12-26 09:04:06,675][123091] Updated weights for policy 0, policy_version 1186923 (0.0010) [2023-12-26 09:04:06,717][123090] Updated weights for policy 1, policy_version 1178521 (0.0010) [2023-12-26 09:04:07,463][123091] Updated weights for policy 0, policy_version 1186933 (0.0008) [2023-12-26 09:04:07,532][123090] Updated weights for policy 1, policy_version 1178531 (0.0011) [2023-12-26 09:04:07,534][123091] Updated weights for policy 0, policy_version 1186943 (0.0011) [2023-12-26 09:04:07,596][123090] Updated weights for policy 1, policy_version 1178541 (0.0011) [2023-12-26 09:04:07,605][123091] Updated weights for policy 0, policy_version 1186953 (0.0011) [2023-12-26 09:04:07,659][123090] Updated weights for policy 1, policy_version 1178551 (0.0010) [2023-12-26 09:04:08,350][123091] Updated weights for policy 0, policy_version 1186963 (0.0011) [2023-12-26 09:04:08,425][123091] Updated weights for policy 0, policy_version 1186973 (0.0011) [2023-12-26 09:04:08,472][123090] Updated weights for policy 1, policy_version 1178561 (0.0008) [2023-12-26 09:04:08,489][123091] Updated weights for policy 0, policy_version 1186983 (0.0011) [2023-12-26 09:04:08,534][123090] Updated weights for policy 1, policy_version 1178571 (0.0010) [2023-12-26 09:04:08,609][123090] Updated weights for policy 1, policy_version 1178581 (0.0007) [2023-12-26 09:04:08,683][123090] Updated weights for policy 1, policy_version 1178591 (0.0006) [2023-12-26 09:04:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 605593600. Throughput: 0: 8918.1, 1: 8651.3. Samples: 605565704. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:08,785][121949] Avg episode reward: [(0, '5986.679'), (1, '5702.496')] [2023-12-26 09:04:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001178592_301719552.pth... [2023-12-26 09:04:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001186992_303874048.pth... [2023-12-26 09:04:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001185968_303611904.pth [2023-12-26 09:04:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001177568_301457408.pth [2023-12-26 09:04:09,232][123091] Updated weights for policy 0, policy_version 1186993 (0.0011) [2023-12-26 09:04:09,303][123091] Updated weights for policy 0, policy_version 1187003 (0.0009) [2023-12-26 09:04:09,374][123091] Updated weights for policy 0, policy_version 1187013 (0.0011) [2023-12-26 09:04:09,439][123091] Updated weights for policy 0, policy_version 1187023 (0.0008) [2023-12-26 09:04:09,500][123090] Updated weights for policy 1, policy_version 1178601 (0.0009) [2023-12-26 09:04:09,573][123090] Updated weights for policy 1, policy_version 1178611 (0.0009) [2023-12-26 09:04:09,645][123090] Updated weights for policy 1, policy_version 1178621 (0.0008) [2023-12-26 09:04:10,258][123091] Updated weights for policy 0, policy_version 1187033 (0.0009) [2023-12-26 09:04:10,315][123091] Updated weights for policy 0, policy_version 1187043 (0.0009) [2023-12-26 09:04:10,368][123091] Updated weights for policy 0, policy_version 1187053 (0.0008) [2023-12-26 09:04:10,427][123090] Updated weights for policy 1, policy_version 1178631 (0.0009) [2023-12-26 09:04:10,499][123090] Updated weights for policy 1, policy_version 1178641 (0.0009) [2023-12-26 09:04:10,566][123090] Updated weights for policy 1, policy_version 1178651 (0.0008) [2023-12-26 09:04:11,265][123091] Updated weights for policy 0, policy_version 1187063 (0.0009) [2023-12-26 09:04:11,323][123091] Updated weights for policy 0, policy_version 1187073 (0.0009) [2023-12-26 09:04:11,370][123090] Updated weights for policy 1, policy_version 1178661 (0.0008) [2023-12-26 09:04:11,392][123091] Updated weights for policy 0, policy_version 1187083 (0.0009) [2023-12-26 09:04:11,431][123090] Updated weights for policy 1, policy_version 1178671 (0.0008) [2023-12-26 09:04:11,496][123090] Updated weights for policy 1, policy_version 1178681 (0.0005) [2023-12-26 09:04:12,279][123091] Updated weights for policy 0, policy_version 1187093 (0.0008) [2023-12-26 09:04:12,280][123090] Updated weights for policy 1, policy_version 1178691 (0.0007) [2023-12-26 09:04:12,335][123091] Updated weights for policy 0, policy_version 1187103 (0.0007) [2023-12-26 09:04:12,347][123090] Updated weights for policy 1, policy_version 1178701 (0.0010) [2023-12-26 09:04:12,399][123091] Updated weights for policy 0, policy_version 1187113 (0.0008) [2023-12-26 09:04:12,408][123090] Updated weights for policy 1, policy_version 1178711 (0.0009) [2023-12-26 09:04:13,211][123090] Updated weights for policy 1, policy_version 1178721 (0.0007) [2023-12-26 09:04:13,266][123091] Updated weights for policy 0, policy_version 1187123 (0.0009) [2023-12-26 09:04:13,266][123090] Updated weights for policy 1, policy_version 1178731 (0.0010) [2023-12-26 09:04:13,309][123091] Updated weights for policy 0, policy_version 1187133 (0.0007) [2023-12-26 09:04:13,313][123090] Updated weights for policy 1, policy_version 1178741 (0.0010) [2023-12-26 09:04:13,358][123091] Updated weights for policy 0, policy_version 1187143 (0.0008) [2023-12-26 09:04:13,372][123090] Updated weights for policy 1, policy_version 1178751 (0.0010) [2023-12-26 09:04:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 605675520. Throughput: 0: 8869.4, 1: 8670.3. Samples: 605669428. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:13,785][121949] Avg episode reward: [(0, '6116.062'), (1, '5535.964')] [2023-12-26 09:04:14,136][123090] Updated weights for policy 1, policy_version 1178761 (0.0009) [2023-12-26 09:04:14,187][123090] Updated weights for policy 1, policy_version 1178771 (0.0010) [2023-12-26 09:04:14,250][123091] Updated weights for policy 0, policy_version 1187153 (0.0007) [2023-12-26 09:04:14,261][123090] Updated weights for policy 1, policy_version 1178781 (0.0006) [2023-12-26 09:04:14,315][123091] Updated weights for policy 0, policy_version 1187163 (0.0010) [2023-12-26 09:04:14,373][123091] Updated weights for policy 0, policy_version 1187173 (0.0008) [2023-12-26 09:04:14,425][123091] Updated weights for policy 0, policy_version 1187183 (0.0007) [2023-12-26 09:04:14,913][123090] Updated weights for policy 1, policy_version 1178791 (0.0007) [2023-12-26 09:04:14,984][123090] Updated weights for policy 1, policy_version 1178801 (0.0008) [2023-12-26 09:04:15,047][123090] Updated weights for policy 1, policy_version 1178811 (0.0008) [2023-12-26 09:04:15,204][123091] Updated weights for policy 0, policy_version 1187193 (0.0009) [2023-12-26 09:04:15,259][123091] Updated weights for policy 0, policy_version 1187203 (0.0005) [2023-12-26 09:04:15,329][123091] Updated weights for policy 0, policy_version 1187213 (0.0006) [2023-12-26 09:04:15,739][123090] Updated weights for policy 1, policy_version 1178821 (0.0008) [2023-12-26 09:04:15,786][123090] Updated weights for policy 1, policy_version 1178831 (0.0009) [2023-12-26 09:04:15,843][123090] Updated weights for policy 1, policy_version 1178841 (0.0005) [2023-12-26 09:04:15,969][123091] Updated weights for policy 0, policy_version 1187223 (0.0006) [2023-12-26 09:04:16,038][123091] Updated weights for policy 0, policy_version 1187233 (0.0006) [2023-12-26 09:04:16,101][123091] Updated weights for policy 0, policy_version 1187243 (0.0005) [2023-12-26 09:04:16,635][123090] Updated weights for policy 1, policy_version 1178851 (0.0007) [2023-12-26 09:04:16,688][123091] Updated weights for policy 0, policy_version 1187253 (0.0005) [2023-12-26 09:04:16,689][123090] Updated weights for policy 1, policy_version 1178861 (0.0005) [2023-12-26 09:04:16,740][123090] Updated weights for policy 1, policy_version 1178871 (0.0005) [2023-12-26 09:04:16,743][123091] Updated weights for policy 0, policy_version 1187263 (0.0005) [2023-12-26 09:04:16,791][123091] Updated weights for policy 0, policy_version 1187273 (0.0005) [2023-12-26 09:04:17,540][123090] Updated weights for policy 1, policy_version 1178881 (0.0007) [2023-12-26 09:04:17,553][123091] Updated weights for policy 0, policy_version 1187283 (0.0006) [2023-12-26 09:04:17,595][123090] Updated weights for policy 1, policy_version 1178891 (0.0010) [2023-12-26 09:04:17,602][123091] Updated weights for policy 0, policy_version 1187293 (0.0005) [2023-12-26 09:04:17,643][123090] Updated weights for policy 1, policy_version 1178901 (0.0010) [2023-12-26 09:04:17,651][123091] Updated weights for policy 0, policy_version 1187303 (0.0007) [2023-12-26 09:04:17,712][123090] Updated weights for policy 1, policy_version 1178911 (0.0010) [2023-12-26 09:04:18,464][123091] Updated weights for policy 0, policy_version 1187313 (0.0007) [2023-12-26 09:04:18,527][123091] Updated weights for policy 0, policy_version 1187323 (0.0010) [2023-12-26 09:04:18,556][123090] Updated weights for policy 1, policy_version 1178921 (0.0010) [2023-12-26 09:04:18,586][123091] Updated weights for policy 0, policy_version 1187333 (0.0010) [2023-12-26 09:04:18,620][123090] Updated weights for policy 1, policy_version 1178931 (0.0010) [2023-12-26 09:04:18,634][123091] Updated weights for policy 0, policy_version 1187343 (0.0009) [2023-12-26 09:04:18,687][123090] Updated weights for policy 1, policy_version 1178941 (0.0011) [2023-12-26 09:04:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 605773824. Throughput: 0: 8886.7, 1: 8739.5. Samples: 605779596. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:18,785][121949] Avg episode reward: [(0, '6282.314'), (1, '5557.761')] [2023-12-26 09:04:19,417][123091] Updated weights for policy 0, policy_version 1187353 (0.0007) [2023-12-26 09:04:19,473][123091] Updated weights for policy 0, policy_version 1187363 (0.0007) [2023-12-26 09:04:19,515][123090] Updated weights for policy 1, policy_version 1178951 (0.0009) [2023-12-26 09:04:19,538][123091] Updated weights for policy 0, policy_version 1187373 (0.0008) [2023-12-26 09:04:19,577][123090] Updated weights for policy 1, policy_version 1178961 (0.0006) [2023-12-26 09:04:19,646][123090] Updated weights for policy 1, policy_version 1178971 (0.0005) [2023-12-26 09:04:20,291][123091] Updated weights for policy 0, policy_version 1187383 (0.0007) [2023-12-26 09:04:20,360][123091] Updated weights for policy 0, policy_version 1187393 (0.0008) [2023-12-26 09:04:20,391][123090] Updated weights for policy 1, policy_version 1178981 (0.0008) [2023-12-26 09:04:20,424][123091] Updated weights for policy 0, policy_version 1187403 (0.0009) [2023-12-26 09:04:20,452][123090] Updated weights for policy 1, policy_version 1178991 (0.0007) [2023-12-26 09:04:20,522][123090] Updated weights for policy 1, policy_version 1179001 (0.0005) [2023-12-26 09:04:21,289][123090] Updated weights for policy 1, policy_version 1179011 (0.0007) [2023-12-26 09:04:21,296][123091] Updated weights for policy 0, policy_version 1187413 (0.0009) [2023-12-26 09:04:21,355][123090] Updated weights for policy 1, policy_version 1179021 (0.0009) [2023-12-26 09:04:21,367][123091] Updated weights for policy 0, policy_version 1187423 (0.0008) [2023-12-26 09:04:21,424][123090] Updated weights for policy 1, policy_version 1179031 (0.0008) [2023-12-26 09:04:21,436][123091] Updated weights for policy 0, policy_version 1187433 (0.0007) [2023-12-26 09:04:22,242][123091] Updated weights for policy 0, policy_version 1187443 (0.0007) [2023-12-26 09:04:22,305][123091] Updated weights for policy 0, policy_version 1187453 (0.0010) [2023-12-26 09:04:22,338][123090] Updated weights for policy 1, policy_version 1179041 (0.0009) [2023-12-26 09:04:22,378][123091] Updated weights for policy 0, policy_version 1187463 (0.0009) [2023-12-26 09:04:22,410][123090] Updated weights for policy 1, policy_version 1179051 (0.0007) [2023-12-26 09:04:22,471][123090] Updated weights for policy 1, policy_version 1179061 (0.0007) [2023-12-26 09:04:22,528][123090] Updated weights for policy 1, policy_version 1179071 (0.0008) [2023-12-26 09:04:23,214][123091] Updated weights for policy 0, policy_version 1187473 (0.0010) [2023-12-26 09:04:23,261][123090] Updated weights for policy 1, policy_version 1179081 (0.0009) [2023-12-26 09:04:23,271][123091] Updated weights for policy 0, policy_version 1187483 (0.0008) [2023-12-26 09:04:23,319][123090] Updated weights for policy 1, policy_version 1179091 (0.0007) [2023-12-26 09:04:23,326][123091] Updated weights for policy 0, policy_version 1187493 (0.0009) [2023-12-26 09:04:23,384][123090] Updated weights for policy 1, policy_version 1179101 (0.0008) [2023-12-26 09:04:23,389][123091] Updated weights for policy 0, policy_version 1187503 (0.0009) [2023-12-26 09:04:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 605855744. Throughput: 0: 8854.6, 1: 8757.7. Samples: 605832164. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:23,785][121949] Avg episode reward: [(0, '6384.507'), (1, '5724.335')] [2023-12-26 09:04:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001187504_304005120.pth... [2023-12-26 09:04:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001179104_301850624.pth... [2023-12-26 09:04:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001186480_303742976.pth [2023-12-26 09:04:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001178080_301588480.pth [2023-12-26 09:04:24,121][123090] Updated weights for policy 1, policy_version 1179111 (0.0007) [2023-12-26 09:04:24,147][123091] Updated weights for policy 0, policy_version 1187513 (0.0006) [2023-12-26 09:04:24,187][123090] Updated weights for policy 1, policy_version 1179121 (0.0006) [2023-12-26 09:04:24,212][123091] Updated weights for policy 0, policy_version 1187523 (0.0007) [2023-12-26 09:04:24,259][123090] Updated weights for policy 1, policy_version 1179131 (0.0005) [2023-12-26 09:04:24,271][123091] Updated weights for policy 0, policy_version 1187533 (0.0008) [2023-12-26 09:04:24,919][123090] Updated weights for policy 1, policy_version 1179141 (0.0005) [2023-12-26 09:04:24,965][123090] Updated weights for policy 1, policy_version 1179151 (0.0005) [2023-12-26 09:04:25,016][123090] Updated weights for policy 1, policy_version 1179161 (0.0009) [2023-12-26 09:04:25,088][123091] Updated weights for policy 0, policy_version 1187543 (0.0010) [2023-12-26 09:04:25,149][123091] Updated weights for policy 0, policy_version 1187553 (0.0010) [2023-12-26 09:04:25,200][123091] Updated weights for policy 0, policy_version 1187563 (0.0010) [2023-12-26 09:04:25,742][123090] Updated weights for policy 1, policy_version 1179171 (0.0009) [2023-12-26 09:04:25,803][123090] Updated weights for policy 1, policy_version 1179181 (0.0005) [2023-12-26 09:04:25,861][123090] Updated weights for policy 1, policy_version 1179191 (0.0005) [2023-12-26 09:04:25,992][123091] Updated weights for policy 0, policy_version 1187573 (0.0008) [2023-12-26 09:04:26,048][123091] Updated weights for policy 0, policy_version 1187583 (0.0005) [2023-12-26 09:04:26,103][123091] Updated weights for policy 0, policy_version 1187593 (0.0005) [2023-12-26 09:04:26,504][123090] Updated weights for policy 1, policy_version 1179201 (0.0005) [2023-12-26 09:04:26,567][123090] Updated weights for policy 1, policy_version 1179211 (0.0006) [2023-12-26 09:04:26,621][123090] Updated weights for policy 1, policy_version 1179221 (0.0008) [2023-12-26 09:04:26,680][123090] Updated weights for policy 1, policy_version 1179231 (0.0010) [2023-12-26 09:04:26,769][123091] Updated weights for policy 0, policy_version 1187603 (0.0005) [2023-12-26 09:04:26,821][123091] Updated weights for policy 0, policy_version 1187613 (0.0005) [2023-12-26 09:04:26,875][123091] Updated weights for policy 0, policy_version 1187623 (0.0005) [2023-12-26 09:04:27,453][123090] Updated weights for policy 1, policy_version 1179241 (0.0010) [2023-12-26 09:04:27,519][123090] Updated weights for policy 1, policy_version 1179251 (0.0010) [2023-12-26 09:04:27,550][123091] Updated weights for policy 0, policy_version 1187633 (0.0005) [2023-12-26 09:04:27,583][123090] Updated weights for policy 1, policy_version 1179261 (0.0010) [2023-12-26 09:04:27,603][123091] Updated weights for policy 0, policy_version 1187643 (0.0005) [2023-12-26 09:04:27,651][123091] Updated weights for policy 0, policy_version 1187653 (0.0005) [2023-12-26 09:04:27,698][123091] Updated weights for policy 0, policy_version 1187663 (0.0005) [2023-12-26 09:04:28,322][123090] Updated weights for policy 1, policy_version 1179271 (0.0007) [2023-12-26 09:04:28,382][123091] Updated weights for policy 0, policy_version 1187673 (0.0008) [2023-12-26 09:04:28,385][123090] Updated weights for policy 1, policy_version 1179281 (0.0010) [2023-12-26 09:04:28,432][123090] Updated weights for policy 1, policy_version 1179291 (0.0009) [2023-12-26 09:04:28,433][123091] Updated weights for policy 0, policy_version 1187683 (0.0008) [2023-12-26 09:04:28,481][123091] Updated weights for policy 0, policy_version 1187693 (0.0008) [2023-12-26 09:04:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 605954048. Throughput: 0: 8915.0, 1: 8910.9. Samples: 605944072. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:28,785][121949] Avg episode reward: [(0, '6271.540'), (1, '5743.569')] [2023-12-26 09:04:29,112][123090] Updated weights for policy 1, policy_version 1179301 (0.0005) [2023-12-26 09:04:29,164][123090] Updated weights for policy 1, policy_version 1179311 (0.0005) [2023-12-26 09:04:29,211][123090] Updated weights for policy 1, policy_version 1179321 (0.0005) [2023-12-26 09:04:29,369][123091] Updated weights for policy 0, policy_version 1187704 (0.0010) [2023-12-26 09:04:29,435][123091] Updated weights for policy 0, policy_version 1187714 (0.0009) [2023-12-26 09:04:29,502][123091] Updated weights for policy 0, policy_version 1187724 (0.0010) [2023-12-26 09:04:30,004][123090] Updated weights for policy 1, policy_version 1179331 (0.0009) [2023-12-26 09:04:30,071][123090] Updated weights for policy 1, policy_version 1179341 (0.0009) [2023-12-26 09:04:30,127][123090] Updated weights for policy 1, policy_version 1179351 (0.0009) [2023-12-26 09:04:30,362][123091] Updated weights for policy 0, policy_version 1187734 (0.0010) [2023-12-26 09:04:30,411][123091] Updated weights for policy 0, policy_version 1187744 (0.0008) [2023-12-26 09:04:30,468][123091] Updated weights for policy 0, policy_version 1187754 (0.0008) [2023-12-26 09:04:30,956][123090] Updated weights for policy 1, policy_version 1179361 (0.0009) [2023-12-26 09:04:31,007][123090] Updated weights for policy 1, policy_version 1179371 (0.0008) [2023-12-26 09:04:31,073][123090] Updated weights for policy 1, policy_version 1179381 (0.0009) [2023-12-26 09:04:31,144][123090] Updated weights for policy 1, policy_version 1179391 (0.0009) [2023-12-26 09:04:31,249][123091] Updated weights for policy 0, policy_version 1187764 (0.0007) [2023-12-26 09:04:31,305][123091] Updated weights for policy 0, policy_version 1187774 (0.0007) [2023-12-26 09:04:31,376][123091] Updated weights for policy 0, policy_version 1187784 (0.0007) [2023-12-26 09:04:32,011][123090] Updated weights for policy 1, policy_version 1179401 (0.0009) [2023-12-26 09:04:32,076][123090] Updated weights for policy 1, policy_version 1179411 (0.0007) [2023-12-26 09:04:32,148][123090] Updated weights for policy 1, policy_version 1179421 (0.0006) [2023-12-26 09:04:32,148][123091] Updated weights for policy 0, policy_version 1187794 (0.0005) [2023-12-26 09:04:32,223][123091] Updated weights for policy 0, policy_version 1187804 (0.0005) [2023-12-26 09:04:32,295][123091] Updated weights for policy 0, policy_version 1187814 (0.0010) [2023-12-26 09:04:32,363][123091] Updated weights for policy 0, policy_version 1187824 (0.0010) [2023-12-26 09:04:32,888][123090] Updated weights for policy 1, policy_version 1179431 (0.0009) [2023-12-26 09:04:32,953][123090] Updated weights for policy 1, policy_version 1179441 (0.0008) [2023-12-26 09:04:33,022][123090] Updated weights for policy 1, policy_version 1179451 (0.0009) [2023-12-26 09:04:33,146][123091] Updated weights for policy 0, policy_version 1187834 (0.0009) [2023-12-26 09:04:33,195][123091] Updated weights for policy 0, policy_version 1187844 (0.0009) [2023-12-26 09:04:33,242][123091] Updated weights for policy 0, policy_version 1187854 (0.0005) [2023-12-26 09:04:33,736][123090] Updated weights for policy 1, policy_version 1179461 (0.0008) [2023-12-26 09:04:33,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 606035968. Throughput: 0: 8861.8, 1: 8927.9. Samples: 606052364. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:33,785][123090] Updated weights for policy 1, policy_version 1179471 (0.0008) [2023-12-26 09:04:33,785][121949] Avg episode reward: [(0, '6298.636'), (1, '5819.627')] [2023-12-26 09:04:33,841][123090] Updated weights for policy 1, policy_version 1179481 (0.0009) [2023-12-26 09:04:33,927][123091] Updated weights for policy 0, policy_version 1187864 (0.0007) [2023-12-26 09:04:33,982][123091] Updated weights for policy 0, policy_version 1187874 (0.0010) [2023-12-26 09:04:34,036][123091] Updated weights for policy 0, policy_version 1187884 (0.0009) [2023-12-26 09:04:34,676][123090] Updated weights for policy 1, policy_version 1179491 (0.0010) [2023-12-26 09:04:34,733][123090] Updated weights for policy 1, policy_version 1179502 (0.0009) [2023-12-26 09:04:34,781][123090] Updated weights for policy 1, policy_version 1179512 (0.0009) [2023-12-26 09:04:34,895][123091] Updated weights for policy 0, policy_version 1187894 (0.0007) [2023-12-26 09:04:34,961][123091] Updated weights for policy 0, policy_version 1187904 (0.0006) [2023-12-26 09:04:35,026][123091] Updated weights for policy 0, policy_version 1187914 (0.0005) [2023-12-26 09:04:35,606][123091] Updated weights for policy 0, policy_version 1187924 (0.0005) [2023-12-26 09:04:35,624][123090] Updated weights for policy 1, policy_version 1179522 (0.0008) [2023-12-26 09:04:35,664][123091] Updated weights for policy 0, policy_version 1187934 (0.0005) [2023-12-26 09:04:35,681][123090] Updated weights for policy 1, policy_version 1179532 (0.0005) [2023-12-26 09:04:35,729][123091] Updated weights for policy 0, policy_version 1187944 (0.0005) [2023-12-26 09:04:35,753][123090] Updated weights for policy 1, policy_version 1179542 (0.0006) [2023-12-26 09:04:35,807][123090] Updated weights for policy 1, policy_version 1179552 (0.0006) [2023-12-26 09:04:36,308][123091] Updated weights for policy 0, policy_version 1187954 (0.0006) [2023-12-26 09:04:36,378][123091] Updated weights for policy 0, policy_version 1187964 (0.0007) [2023-12-26 09:04:36,443][123090] Updated weights for policy 1, policy_version 1179562 (0.0008) [2023-12-26 09:04:36,445][123091] Updated weights for policy 0, policy_version 1187974 (0.0008) [2023-12-26 09:04:36,506][123090] Updated weights for policy 1, policy_version 1179572 (0.0009) [2023-12-26 09:04:36,508][123091] Updated weights for policy 0, policy_version 1187984 (0.0008) [2023-12-26 09:04:36,574][123090] Updated weights for policy 1, policy_version 1179582 (0.0009) [2023-12-26 09:04:37,224][123091] Updated weights for policy 0, policy_version 1187994 (0.0008) [2023-12-26 09:04:37,288][123091] Updated weights for policy 0, policy_version 1188004 (0.0007) [2023-12-26 09:04:37,344][123091] Updated weights for policy 0, policy_version 1188014 (0.0008) [2023-12-26 09:04:37,409][123090] Updated weights for policy 1, policy_version 1179592 (0.0008) [2023-12-26 09:04:37,475][123090] Updated weights for policy 1, policy_version 1179602 (0.0008) [2023-12-26 09:04:37,532][123090] Updated weights for policy 1, policy_version 1179612 (0.0008) [2023-12-26 09:04:38,063][123091] Updated weights for policy 0, policy_version 1188024 (0.0006) [2023-12-26 09:04:38,116][123091] Updated weights for policy 0, policy_version 1188034 (0.0006) [2023-12-26 09:04:38,167][123091] Updated weights for policy 0, policy_version 1188044 (0.0005) [2023-12-26 09:04:38,326][123090] Updated weights for policy 1, policy_version 1179622 (0.0007) [2023-12-26 09:04:38,395][123090] Updated weights for policy 1, policy_version 1179632 (0.0008) [2023-12-26 09:04:38,460][123090] Updated weights for policy 1, policy_version 1179642 (0.0008) [2023-12-26 09:04:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 606134272. Throughput: 0: 8953.6, 1: 8962.7. Samples: 606108736. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:38,785][121949] Avg episode reward: [(0, '6353.924'), (1, '5928.603')] [2023-12-26 09:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001188048_304144384.pth... [2023-12-26 09:04:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001179648_301989888.pth... [2023-12-26 09:04:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001178592_301719552.pth [2023-12-26 09:04:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001186992_303874048.pth [2023-12-26 09:04:38,981][123091] Updated weights for policy 0, policy_version 1188054 (0.0008) [2023-12-26 09:04:39,038][123091] Updated weights for policy 0, policy_version 1188064 (0.0010) [2023-12-26 09:04:39,098][123091] Updated weights for policy 0, policy_version 1188074 (0.0009) [2023-12-26 09:04:39,211][123090] Updated weights for policy 1, policy_version 1179652 (0.0007) [2023-12-26 09:04:39,284][123090] Updated weights for policy 1, policy_version 1179662 (0.0009) [2023-12-26 09:04:39,355][123090] Updated weights for policy 1, policy_version 1179672 (0.0007) [2023-12-26 09:04:39,942][123091] Updated weights for policy 0, policy_version 1188085 (0.0010) [2023-12-26 09:04:40,016][123091] Updated weights for policy 0, policy_version 1188095 (0.0010) [2023-12-26 09:04:40,080][123091] Updated weights for policy 0, policy_version 1188105 (0.0009) [2023-12-26 09:04:40,180][123090] Updated weights for policy 1, policy_version 1179682 (0.0009) [2023-12-26 09:04:40,249][123090] Updated weights for policy 1, policy_version 1179692 (0.0009) [2023-12-26 09:04:40,315][123090] Updated weights for policy 1, policy_version 1179702 (0.0009) [2023-12-26 09:04:40,388][123090] Updated weights for policy 1, policy_version 1179712 (0.0009) [2023-12-26 09:04:40,867][123091] Updated weights for policy 0, policy_version 1188115 (0.0008) [2023-12-26 09:04:40,940][123091] Updated weights for policy 0, policy_version 1188125 (0.0010) [2023-12-26 09:04:41,004][123091] Updated weights for policy 0, policy_version 1188135 (0.0010) [2023-12-26 09:04:41,145][123090] Updated weights for policy 1, policy_version 1179722 (0.0008) [2023-12-26 09:04:41,216][123090] Updated weights for policy 1, policy_version 1179732 (0.0011) [2023-12-26 09:04:41,288][123090] Updated weights for policy 1, policy_version 1179742 (0.0012) [2023-12-26 09:04:41,863][123091] Updated weights for policy 0, policy_version 1188145 (0.0009) [2023-12-26 09:04:41,937][123091] Updated weights for policy 0, policy_version 1188155 (0.0007) [2023-12-26 09:04:42,013][123091] Updated weights for policy 0, policy_version 1188165 (0.0005) [2023-12-26 09:04:42,088][123091] Updated weights for policy 0, policy_version 1188175 (0.0006) [2023-12-26 09:04:42,170][123090] Updated weights for policy 1, policy_version 1179752 (0.0010) [2023-12-26 09:04:42,232][123090] Updated weights for policy 1, policy_version 1179762 (0.0009) [2023-12-26 09:04:42,303][123090] Updated weights for policy 1, policy_version 1179772 (0.0009) [2023-12-26 09:04:42,829][123091] Updated weights for policy 0, policy_version 1188185 (0.0009) [2023-12-26 09:04:42,884][123091] Updated weights for policy 0, policy_version 1188195 (0.0008) [2023-12-26 09:04:42,942][123091] Updated weights for policy 0, policy_version 1188205 (0.0010) [2023-12-26 09:04:43,154][123090] Updated weights for policy 1, policy_version 1179782 (0.0010) [2023-12-26 09:04:43,222][123090] Updated weights for policy 1, policy_version 1179792 (0.0009) [2023-12-26 09:04:43,285][123090] Updated weights for policy 1, policy_version 1179802 (0.0010) [2023-12-26 09:04:43,743][123091] Updated weights for policy 0, policy_version 1188215 (0.0006) [2023-12-26 09:04:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 606216192. Throughput: 0: 8970.6, 1: 8977.7. Samples: 606213932. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:43,786][121949] Avg episode reward: [(0, '6363.089'), (1, '5879.425')] [2023-12-26 09:04:43,807][123091] Updated weights for policy 0, policy_version 1188225 (0.0005) [2023-12-26 09:04:43,857][123091] Updated weights for policy 0, policy_version 1188235 (0.0006) [2023-12-26 09:04:43,998][123090] Updated weights for policy 1, policy_version 1179812 (0.0008) [2023-12-26 09:04:44,066][123090] Updated weights for policy 1, policy_version 1179822 (0.0009) [2023-12-26 09:04:44,125][123090] Updated weights for policy 1, policy_version 1179832 (0.0010) [2023-12-26 09:04:44,608][123091] Updated weights for policy 0, policy_version 1188245 (0.0007) [2023-12-26 09:04:44,669][123091] Updated weights for policy 0, policy_version 1188255 (0.0006) [2023-12-26 09:04:44,728][123091] Updated weights for policy 0, policy_version 1188265 (0.0007) [2023-12-26 09:04:44,970][123090] Updated weights for policy 1, policy_version 1179842 (0.0009) [2023-12-26 09:04:45,041][123090] Updated weights for policy 1, policy_version 1179852 (0.0009) [2023-12-26 09:04:45,103][123090] Updated weights for policy 1, policy_version 1179862 (0.0011) [2023-12-26 09:04:45,168][123090] Updated weights for policy 1, policy_version 1179872 (0.0011) [2023-12-26 09:04:45,455][123091] Updated weights for policy 0, policy_version 1188275 (0.0007) [2023-12-26 09:04:45,518][123091] Updated weights for policy 0, policy_version 1188285 (0.0006) [2023-12-26 09:04:45,585][123091] Updated weights for policy 0, policy_version 1188295 (0.0006) [2023-12-26 09:04:45,980][123090] Updated weights for policy 1, policy_version 1179882 (0.0009) [2023-12-26 09:04:46,029][123090] Updated weights for policy 1, policy_version 1179892 (0.0008) [2023-12-26 09:04:46,081][123090] Updated weights for policy 1, policy_version 1179902 (0.0010) [2023-12-26 09:04:46,369][123091] Updated weights for policy 0, policy_version 1188305 (0.0007) [2023-12-26 09:04:46,427][123091] Updated weights for policy 0, policy_version 1188315 (0.0010) [2023-12-26 09:04:46,489][123091] Updated weights for policy 0, policy_version 1188325 (0.0011) [2023-12-26 09:04:46,543][123091] Updated weights for policy 0, policy_version 1188335 (0.0010) [2023-12-26 09:04:46,849][123090] Updated weights for policy 1, policy_version 1179912 (0.0007) [2023-12-26 09:04:46,919][123090] Updated weights for policy 1, policy_version 1179922 (0.0006) [2023-12-26 09:04:46,989][123090] Updated weights for policy 1, policy_version 1179932 (0.0006) [2023-12-26 09:04:47,355][123091] Updated weights for policy 0, policy_version 1188345 (0.0008) [2023-12-26 09:04:47,399][123091] Updated weights for policy 0, policy_version 1188355 (0.0010) [2023-12-26 09:04:47,447][123091] Updated weights for policy 0, policy_version 1188365 (0.0010) [2023-12-26 09:04:47,645][123090] Updated weights for policy 1, policy_version 1179942 (0.0005) [2023-12-26 09:04:47,700][123090] Updated weights for policy 1, policy_version 1179952 (0.0005) [2023-12-26 09:04:47,771][123090] Updated weights for policy 1, policy_version 1179962 (0.0008) [2023-12-26 09:04:48,203][123091] Updated weights for policy 0, policy_version 1188375 (0.0010) [2023-12-26 09:04:48,263][123091] Updated weights for policy 0, policy_version 1188385 (0.0011) [2023-12-26 09:04:48,335][123091] Updated weights for policy 0, policy_version 1188395 (0.0010) [2023-12-26 09:04:48,478][123090] Updated weights for policy 1, policy_version 1179972 (0.0010) [2023-12-26 09:04:48,535][123090] Updated weights for policy 1, policy_version 1179982 (0.0010) [2023-12-26 09:04:48,600][123090] Updated weights for policy 1, policy_version 1179992 (0.0011) [2023-12-26 09:04:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 606314496. Throughput: 0: 9016.7, 1: 9015.5. Samples: 606323196. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:48,785][121949] Avg episode reward: [(0, '6251.987'), (1, '5912.289')] [2023-12-26 09:04:49,168][123091] Updated weights for policy 0, policy_version 1188405 (0.0008) [2023-12-26 09:04:49,253][123091] Updated weights for policy 0, policy_version 1188415 (0.0008) [2023-12-26 09:04:49,320][123091] Updated weights for policy 0, policy_version 1188425 (0.0010) [2023-12-26 09:04:49,342][123090] Updated weights for policy 1, policy_version 1180002 (0.0009) [2023-12-26 09:04:49,421][123090] Updated weights for policy 1, policy_version 1180012 (0.0007) [2023-12-26 09:04:49,472][123090] Updated weights for policy 1, policy_version 1180022 (0.0006) [2023-12-26 09:04:49,536][123090] Updated weights for policy 1, policy_version 1180032 (0.0006) [2023-12-26 09:04:50,130][123091] Updated weights for policy 0, policy_version 1188435 (0.0009) [2023-12-26 09:04:50,132][123090] Updated weights for policy 1, policy_version 1180042 (0.0007) [2023-12-26 09:04:50,194][123091] Updated weights for policy 0, policy_version 1188445 (0.0008) [2023-12-26 09:04:50,196][123090] Updated weights for policy 1, policy_version 1180052 (0.0007) [2023-12-26 09:04:50,261][123090] Updated weights for policy 1, policy_version 1180062 (0.0006) [2023-12-26 09:04:50,264][123091] Updated weights for policy 0, policy_version 1188455 (0.0009) [2023-12-26 09:04:51,022][123090] Updated weights for policy 1, policy_version 1180072 (0.0010) [2023-12-26 09:04:51,093][123090] Updated weights for policy 1, policy_version 1180082 (0.0007) [2023-12-26 09:04:51,122][123091] Updated weights for policy 0, policy_version 1188465 (0.0009) [2023-12-26 09:04:51,154][123090] Updated weights for policy 1, policy_version 1180092 (0.0007) [2023-12-26 09:04:51,194][123091] Updated weights for policy 0, policy_version 1188475 (0.0009) [2023-12-26 09:04:51,260][123091] Updated weights for policy 0, policy_version 1188485 (0.0010) [2023-12-26 09:04:51,320][123091] Updated weights for policy 0, policy_version 1188495 (0.0009) [2023-12-26 09:04:51,919][123090] Updated weights for policy 1, policy_version 1180102 (0.0009) [2023-12-26 09:04:51,971][123090] Updated weights for policy 1, policy_version 1180113 (0.0006) [2023-12-26 09:04:52,021][123090] Updated weights for policy 1, policy_version 1180123 (0.0006) [2023-12-26 09:04:52,208][123091] Updated weights for policy 0, policy_version 1188505 (0.0008) [2023-12-26 09:04:52,271][123091] Updated weights for policy 0, policy_version 1188515 (0.0007) [2023-12-26 09:04:52,331][123091] Updated weights for policy 0, policy_version 1188525 (0.0008) [2023-12-26 09:04:52,776][123090] Updated weights for policy 1, policy_version 1180133 (0.0006) [2023-12-26 09:04:52,832][123090] Updated weights for policy 1, policy_version 1180143 (0.0009) [2023-12-26 09:04:52,892][123090] Updated weights for policy 1, policy_version 1180153 (0.0010) [2023-12-26 09:04:53,108][123091] Updated weights for policy 0, policy_version 1188535 (0.0009) [2023-12-26 09:04:53,162][123091] Updated weights for policy 0, policy_version 1188545 (0.0010) [2023-12-26 09:04:53,214][123091] Updated weights for policy 0, policy_version 1188555 (0.0010) [2023-12-26 09:04:53,509][123090] Updated weights for policy 1, policy_version 1180163 (0.0009) [2023-12-26 09:04:53,571][123090] Updated weights for policy 1, policy_version 1180173 (0.0007) [2023-12-26 09:04:53,634][123090] Updated weights for policy 1, policy_version 1180183 (0.0008) [2023-12-26 09:04:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 606404608. Throughput: 0: 8983.4, 1: 9040.7. Samples: 606376796. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:53,785][121949] Avg episode reward: [(0, '6028.540'), (1, '5909.322')] [2023-12-26 09:04:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001188560_304275456.pth... [2023-12-26 09:04:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001180192_302129152.pth... [2023-12-26 09:04:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001179104_301850624.pth [2023-12-26 09:04:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001187504_304005120.pth [2023-12-26 09:04:54,020][123091] Updated weights for policy 0, policy_version 1188566 (0.0008) [2023-12-26 09:04:54,065][123091] Updated weights for policy 0, policy_version 1188576 (0.0005) [2023-12-26 09:04:54,135][123091] Updated weights for policy 0, policy_version 1188586 (0.0005) [2023-12-26 09:04:54,315][123090] Updated weights for policy 1, policy_version 1180193 (0.0009) [2023-12-26 09:04:54,363][123090] Updated weights for policy 1, policy_version 1180203 (0.0009) [2023-12-26 09:04:54,420][123090] Updated weights for policy 1, policy_version 1180213 (0.0010) [2023-12-26 09:04:54,474][123090] Updated weights for policy 1, policy_version 1180224 (0.0010) [2023-12-26 09:04:54,885][123091] Updated weights for policy 0, policy_version 1188596 (0.0007) [2023-12-26 09:04:54,954][123091] Updated weights for policy 0, policy_version 1188606 (0.0006) [2023-12-26 09:04:55,021][123091] Updated weights for policy 0, policy_version 1188616 (0.0006) [2023-12-26 09:04:55,346][123090] Updated weights for policy 1, policy_version 1180234 (0.0008) [2023-12-26 09:04:55,395][123090] Updated weights for policy 1, policy_version 1180244 (0.0005) [2023-12-26 09:04:55,450][123090] Updated weights for policy 1, policy_version 1180254 (0.0005) [2023-12-26 09:04:55,661][123091] Updated weights for policy 0, policy_version 1188626 (0.0006) [2023-12-26 09:04:55,722][123091] Updated weights for policy 0, policy_version 1188636 (0.0006) [2023-12-26 09:04:55,784][123091] Updated weights for policy 0, policy_version 1188646 (0.0006) [2023-12-26 09:04:55,840][123091] Updated weights for policy 0, policy_version 1188656 (0.0006) [2023-12-26 09:04:56,147][123090] Updated weights for policy 1, policy_version 1180264 (0.0005) [2023-12-26 09:04:56,202][123090] Updated weights for policy 1, policy_version 1180274 (0.0005) [2023-12-26 09:04:56,260][123090] Updated weights for policy 1, policy_version 1180284 (0.0005) [2023-12-26 09:04:56,407][123091] Updated weights for policy 0, policy_version 1188666 (0.0007) [2023-12-26 09:04:56,474][123091] Updated weights for policy 0, policy_version 1188676 (0.0006) [2023-12-26 09:04:56,536][123091] Updated weights for policy 0, policy_version 1188686 (0.0005) [2023-12-26 09:04:56,885][123090] Updated weights for policy 1, policy_version 1180294 (0.0005) [2023-12-26 09:04:56,933][123090] Updated weights for policy 1, policy_version 1180304 (0.0005) [2023-12-26 09:04:56,986][123090] Updated weights for policy 1, policy_version 1180314 (0.0005) [2023-12-26 09:04:57,164][123091] Updated weights for policy 0, policy_version 1188696 (0.0005) [2023-12-26 09:04:57,221][123091] Updated weights for policy 0, policy_version 1188706 (0.0005) [2023-12-26 09:04:57,277][123091] Updated weights for policy 0, policy_version 1188716 (0.0005) [2023-12-26 09:04:57,757][123090] Updated weights for policy 1, policy_version 1180324 (0.0007) [2023-12-26 09:04:57,818][123090] Updated weights for policy 1, policy_version 1180334 (0.0010) [2023-12-26 09:04:57,881][123090] Updated weights for policy 1, policy_version 1180344 (0.0009) [2023-12-26 09:04:57,924][123091] Updated weights for policy 0, policy_version 1188726 (0.0006) [2023-12-26 09:04:57,983][123091] Updated weights for policy 0, policy_version 1188736 (0.0007) [2023-12-26 09:04:58,060][123091] Updated weights for policy 0, policy_version 1188746 (0.0007) [2023-12-26 09:04:58,768][123090] Updated weights for policy 1, policy_version 1180354 (0.0010) [2023-12-26 09:04:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 606494720. Throughput: 0: 9131.9, 1: 9188.9. Samples: 606493864. Policy #0 lag: (min: 31.0, avg: 43.6, max: 63.0) [2023-12-26 09:04:58,785][121949] Avg episode reward: [(0, '6099.444'), (1, '5947.580')] [2023-12-26 09:04:58,841][123090] Updated weights for policy 1, policy_version 1180364 (0.0009) [2023-12-26 09:04:58,904][123090] Updated weights for policy 1, policy_version 1180374 (0.0008) [2023-12-26 09:04:58,977][123090] Updated weights for policy 1, policy_version 1180384 (0.0008) [2023-12-26 09:04:58,980][123091] Updated weights for policy 0, policy_version 1188756 (0.0007) [2023-12-26 09:04:59,044][123091] Updated weights for policy 0, policy_version 1188766 (0.0009) [2023-12-26 09:04:59,106][123091] Updated weights for policy 0, policy_version 1188776 (0.0010) [2023-12-26 09:04:59,757][123090] Updated weights for policy 1, policy_version 1180394 (0.0006) [2023-12-26 09:04:59,823][123090] Updated weights for policy 1, policy_version 1180404 (0.0008) [2023-12-26 09:04:59,890][123090] Updated weights for policy 1, policy_version 1180414 (0.0011) [2023-12-26 09:05:00,005][123091] Updated weights for policy 0, policy_version 1188786 (0.0009) [2023-12-26 09:05:00,066][123091] Updated weights for policy 0, policy_version 1188796 (0.0009) [2023-12-26 09:05:00,132][123091] Updated weights for policy 0, policy_version 1188806 (0.0009) [2023-12-26 09:05:00,200][123091] Updated weights for policy 0, policy_version 1188816 (0.0008) [2023-12-26 09:05:00,691][123090] Updated weights for policy 1, policy_version 1180424 (0.0006) [2023-12-26 09:05:00,743][123090] Updated weights for policy 1, policy_version 1180434 (0.0005) [2023-12-26 09:05:00,800][123090] Updated weights for policy 1, policy_version 1180444 (0.0005) [2023-12-26 09:05:01,069][123091] Updated weights for policy 0, policy_version 1188826 (0.0009) [2023-12-26 09:05:01,120][123091] Updated weights for policy 0, policy_version 1188836 (0.0009) [2023-12-26 09:05:01,182][123091] Updated weights for policy 0, policy_version 1188846 (0.0009) [2023-12-26 09:05:01,524][123090] Updated weights for policy 1, policy_version 1180454 (0.0005) [2023-12-26 09:05:01,579][123090] Updated weights for policy 1, policy_version 1180464 (0.0005) [2023-12-26 09:05:01,652][123090] Updated weights for policy 1, policy_version 1180474 (0.0007) [2023-12-26 09:05:01,998][123091] Updated weights for policy 0, policy_version 1188856 (0.0006) [2023-12-26 09:05:02,049][123091] Updated weights for policy 0, policy_version 1188866 (0.0006) [2023-12-26 09:05:02,108][123091] Updated weights for policy 0, policy_version 1188876 (0.0006) [2023-12-26 09:05:02,305][123090] Updated weights for policy 1, policy_version 1180484 (0.0006) [2023-12-26 09:05:02,375][123090] Updated weights for policy 1, policy_version 1180494 (0.0009) [2023-12-26 09:05:02,423][123090] Updated weights for policy 1, policy_version 1180504 (0.0010) [2023-12-26 09:05:02,883][123091] Updated weights for policy 0, policy_version 1188886 (0.0006) [2023-12-26 09:05:02,950][123091] Updated weights for policy 0, policy_version 1188896 (0.0005) [2023-12-26 09:05:03,006][123091] Updated weights for policy 0, policy_version 1188906 (0.0007) [2023-12-26 09:05:03,121][123090] Updated weights for policy 1, policy_version 1180514 (0.0009) [2023-12-26 09:05:03,180][123090] Updated weights for policy 1, policy_version 1180524 (0.0007) [2023-12-26 09:05:03,241][123090] Updated weights for policy 1, policy_version 1180534 (0.0010) [2023-12-26 09:05:03,299][123090] Updated weights for policy 1, policy_version 1180544 (0.0010) [2023-12-26 09:05:03,654][123091] Updated weights for policy 0, policy_version 1188916 (0.0007) [2023-12-26 09:05:03,713][123091] Updated weights for policy 0, policy_version 1188926 (0.0005) [2023-12-26 09:05:03,783][123091] Updated weights for policy 0, policy_version 1188936 (0.0005) [2023-12-26 09:05:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18159.0, 300 sec: 17800.3). Total num frames: 606584832. Throughput: 0: 9073.0, 1: 9186.7. Samples: 606601280. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:03,784][121949] Avg episode reward: [(0, '6109.811'), (1, '5969.268')] [2023-12-26 09:05:04,109][123090] Updated weights for policy 1, policy_version 1180554 (0.0010) [2023-12-26 09:05:04,188][123090] Updated weights for policy 1, policy_version 1180565 (0.0008) [2023-12-26 09:05:04,252][123090] Updated weights for policy 1, policy_version 1180575 (0.0008) [2023-12-26 09:05:04,550][123091] Updated weights for policy 0, policy_version 1188946 (0.0007) [2023-12-26 09:05:04,598][123091] Updated weights for policy 0, policy_version 1188956 (0.0006) [2023-12-26 09:05:04,663][123091] Updated weights for policy 0, policy_version 1188966 (0.0008) [2023-12-26 09:05:04,741][123091] Updated weights for policy 0, policy_version 1188976 (0.0008) [2023-12-26 09:05:04,974][123090] Updated weights for policy 1, policy_version 1180585 (0.0008) [2023-12-26 09:05:05,036][123090] Updated weights for policy 1, policy_version 1180595 (0.0008) [2023-12-26 09:05:05,088][123090] Updated weights for policy 1, policy_version 1180605 (0.0009) [2023-12-26 09:05:05,432][123091] Updated weights for policy 0, policy_version 1188986 (0.0005) [2023-12-26 09:05:05,502][123091] Updated weights for policy 0, policy_version 1188996 (0.0005) [2023-12-26 09:05:05,571][123091] Updated weights for policy 0, policy_version 1189006 (0.0005) [2023-12-26 09:05:05,834][123090] Updated weights for policy 1, policy_version 1180615 (0.0006) [2023-12-26 09:05:05,908][123090] Updated weights for policy 1, policy_version 1180625 (0.0005) [2023-12-26 09:05:05,962][123090] Updated weights for policy 1, policy_version 1180635 (0.0005) [2023-12-26 09:05:06,198][123091] Updated weights for policy 0, policy_version 1189016 (0.0006) [2023-12-26 09:05:06,274][123091] Updated weights for policy 0, policy_version 1189026 (0.0006) [2023-12-26 09:05:06,339][123091] Updated weights for policy 0, policy_version 1189036 (0.0007) [2023-12-26 09:05:06,750][123090] Updated weights for policy 1, policy_version 1180645 (0.0007) [2023-12-26 09:05:06,806][123090] Updated weights for policy 1, policy_version 1180655 (0.0009) [2023-12-26 09:05:06,858][123090] Updated weights for policy 1, policy_version 1180665 (0.0009) [2023-12-26 09:05:07,050][123091] Updated weights for policy 0, policy_version 1189046 (0.0008) [2023-12-26 09:05:07,114][123091] Updated weights for policy 0, policy_version 1189056 (0.0008) [2023-12-26 09:05:07,182][123091] Updated weights for policy 0, policy_version 1189066 (0.0009) [2023-12-26 09:05:07,743][123090] Updated weights for policy 1, policy_version 1180675 (0.0009) [2023-12-26 09:05:07,805][123090] Updated weights for policy 1, policy_version 1180685 (0.0009) [2023-12-26 09:05:07,863][123090] Updated weights for policy 1, policy_version 1180695 (0.0009) [2023-12-26 09:05:08,021][123091] Updated weights for policy 0, policy_version 1189076 (0.0010) [2023-12-26 09:05:08,080][123091] Updated weights for policy 0, policy_version 1189086 (0.0010) [2023-12-26 09:05:08,142][123091] Updated weights for policy 0, policy_version 1189096 (0.0010) [2023-12-26 09:05:08,709][123090] Updated weights for policy 1, policy_version 1180705 (0.0009) [2023-12-26 09:05:08,774][123090] Updated weights for policy 1, policy_version 1180715 (0.0009) [2023-12-26 09:05:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 606674944. Throughput: 0: 9139.9, 1: 9208.8. Samples: 606657856. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:08,785][121949] Avg episode reward: [(0, '5959.533'), (1, '5880.831')] [2023-12-26 09:05:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001189104_304414720.pth... [2023-12-26 09:05:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001188048_304144384.pth [2023-12-26 09:05:08,836][123090] Updated weights for policy 1, policy_version 1180725 (0.0009) [2023-12-26 09:05:08,894][123090] Updated weights for policy 1, policy_version 1180735 (0.0009) [2023-12-26 09:05:08,899][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001180736_302268416.pth... [2023-12-26 09:05:08,902][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001179648_301989888.pth [2023-12-26 09:05:08,959][123091] Updated weights for policy 0, policy_version 1189106 (0.0011) [2023-12-26 09:05:09,010][123091] Updated weights for policy 0, policy_version 1189116 (0.0010) [2023-12-26 09:05:09,065][123091] Updated weights for policy 0, policy_version 1189126 (0.0010) [2023-12-26 09:05:09,113][123091] Updated weights for policy 0, policy_version 1189136 (0.0010) [2023-12-26 09:05:09,762][123090] Updated weights for policy 1, policy_version 1180745 (0.0006) [2023-12-26 09:05:09,840][123090] Updated weights for policy 1, policy_version 1180755 (0.0009) [2023-12-26 09:05:09,900][123090] Updated weights for policy 1, policy_version 1180765 (0.0009) [2023-12-26 09:05:09,967][123091] Updated weights for policy 0, policy_version 1189146 (0.0009) [2023-12-26 09:05:10,030][123091] Updated weights for policy 0, policy_version 1189156 (0.0010) [2023-12-26 09:05:10,101][123091] Updated weights for policy 0, policy_version 1189166 (0.0010) [2023-12-26 09:05:10,736][123090] Updated weights for policy 1, policy_version 1180775 (0.0006) [2023-12-26 09:05:10,786][123091] Updated weights for policy 0, policy_version 1189176 (0.0009) [2023-12-26 09:05:10,788][123090] Updated weights for policy 1, policy_version 1180785 (0.0006) [2023-12-26 09:05:10,840][123090] Updated weights for policy 1, policy_version 1180795 (0.0008) [2023-12-26 09:05:10,852][123091] Updated weights for policy 0, policy_version 1189186 (0.0007) [2023-12-26 09:05:10,913][123091] Updated weights for policy 0, policy_version 1189196 (0.0009) [2023-12-26 09:05:11,742][123090] Updated weights for policy 1, policy_version 1180805 (0.0009) [2023-12-26 09:05:11,776][123091] Updated weights for policy 0, policy_version 1189206 (0.0008) [2023-12-26 09:05:11,806][123090] Updated weights for policy 1, policy_version 1180815 (0.0008) [2023-12-26 09:05:11,844][123091] Updated weights for policy 0, policy_version 1189216 (0.0010) [2023-12-26 09:05:11,872][123090] Updated weights for policy 1, policy_version 1180825 (0.0007) [2023-12-26 09:05:11,908][123091] Updated weights for policy 0, policy_version 1189226 (0.0009) [2023-12-26 09:05:12,706][123091] Updated weights for policy 0, policy_version 1189236 (0.0009) [2023-12-26 09:05:12,765][123090] Updated weights for policy 1, policy_version 1180835 (0.0007) [2023-12-26 09:05:12,769][123091] Updated weights for policy 0, policy_version 1189246 (0.0009) [2023-12-26 09:05:12,826][123090] Updated weights for policy 1, policy_version 1180845 (0.0008) [2023-12-26 09:05:12,831][123091] Updated weights for policy 0, policy_version 1189256 (0.0010) [2023-12-26 09:05:12,888][123090] Updated weights for policy 1, policy_version 1180855 (0.0008) [2023-12-26 09:05:13,575][123091] Updated weights for policy 0, policy_version 1189266 (0.0007) [2023-12-26 09:05:13,643][123091] Updated weights for policy 0, policy_version 1189276 (0.0009) [2023-12-26 09:05:13,708][123091] Updated weights for policy 0, policy_version 1189286 (0.0009) [2023-12-26 09:05:13,729][123090] Updated weights for policy 1, policy_version 1180865 (0.0009) [2023-12-26 09:05:13,766][123091] Updated weights for policy 0, policy_version 1189296 (0.0009) [2023-12-26 09:05:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 606765056. Throughput: 0: 9085.3, 1: 9039.7. Samples: 606759692. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:13,785][121949] Avg episode reward: [(0, '6170.944'), (1, '5873.832')] [2023-12-26 09:05:13,798][123090] Updated weights for policy 1, policy_version 1180875 (0.0009) [2023-12-26 09:05:13,868][123090] Updated weights for policy 1, policy_version 1180885 (0.0009) [2023-12-26 09:05:13,929][123090] Updated weights for policy 1, policy_version 1180895 (0.0010) [2023-12-26 09:05:14,551][123091] Updated weights for policy 0, policy_version 1189306 (0.0008) [2023-12-26 09:05:14,607][123091] Updated weights for policy 0, policy_version 1189316 (0.0007) [2023-12-26 09:05:14,680][123091] Updated weights for policy 0, policy_version 1189326 (0.0009) [2023-12-26 09:05:14,698][123090] Updated weights for policy 1, policy_version 1180905 (0.0009) [2023-12-26 09:05:14,752][123090] Updated weights for policy 1, policy_version 1180915 (0.0009) [2023-12-26 09:05:14,825][123090] Updated weights for policy 1, policy_version 1180925 (0.0009) [2023-12-26 09:05:15,502][123091] Updated weights for policy 0, policy_version 1189336 (0.0010) [2023-12-26 09:05:15,568][123091] Updated weights for policy 0, policy_version 1189346 (0.0011) [2023-12-26 09:05:15,624][123091] Updated weights for policy 0, policy_version 1189356 (0.0010) [2023-12-26 09:05:15,706][123090] Updated weights for policy 1, policy_version 1180935 (0.0007) [2023-12-26 09:05:15,766][123090] Updated weights for policy 1, policy_version 1180945 (0.0009) [2023-12-26 09:05:15,828][123090] Updated weights for policy 1, policy_version 1180955 (0.0010) [2023-12-26 09:05:16,410][123090] Updated weights for policy 1, policy_version 1180965 (0.0008) [2023-12-26 09:05:16,416][123091] Updated weights for policy 0, policy_version 1189366 (0.0007) [2023-12-26 09:05:16,474][123090] Updated weights for policy 1, policy_version 1180975 (0.0007) [2023-12-26 09:05:16,475][123091] Updated weights for policy 0, policy_version 1189376 (0.0005) [2023-12-26 09:05:16,524][123091] Updated weights for policy 0, policy_version 1189386 (0.0006) [2023-12-26 09:05:16,535][123090] Updated weights for policy 1, policy_version 1180985 (0.0005) [2023-12-26 09:05:17,173][123091] Updated weights for policy 0, policy_version 1189396 (0.0006) [2023-12-26 09:05:17,225][123091] Updated weights for policy 0, policy_version 1189406 (0.0010) [2023-12-26 09:05:17,231][123090] Updated weights for policy 1, policy_version 1180995 (0.0006) [2023-12-26 09:05:17,286][123090] Updated weights for policy 1, policy_version 1181005 (0.0006) [2023-12-26 09:05:17,288][123091] Updated weights for policy 0, policy_version 1189416 (0.0011) [2023-12-26 09:05:17,343][123090] Updated weights for policy 1, policy_version 1181015 (0.0007) [2023-12-26 09:05:17,936][123091] Updated weights for policy 0, policy_version 1189426 (0.0009) [2023-12-26 09:05:17,999][123091] Updated weights for policy 0, policy_version 1189436 (0.0006) [2023-12-26 09:05:18,058][123091] Updated weights for policy 0, policy_version 1189446 (0.0010) [2023-12-26 09:05:18,098][123090] Updated weights for policy 1, policy_version 1181025 (0.0009) [2023-12-26 09:05:18,120][123091] Updated weights for policy 0, policy_version 1189456 (0.0010) [2023-12-26 09:05:18,156][123090] Updated weights for policy 1, policy_version 1181035 (0.0009) [2023-12-26 09:05:18,211][123090] Updated weights for policy 1, policy_version 1181045 (0.0009) [2023-12-26 09:05:18,271][123090] Updated weights for policy 1, policy_version 1181055 (0.0009) [2023-12-26 09:05:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 606855168. Throughput: 0: 9122.6, 1: 9025.2. Samples: 606869012. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:18,785][121949] Avg episode reward: [(0, '6230.721'), (1, '5829.637')] [2023-12-26 09:05:18,901][123091] Updated weights for policy 0, policy_version 1189466 (0.0010) [2023-12-26 09:05:18,962][123091] Updated weights for policy 0, policy_version 1189476 (0.0010) [2023-12-26 09:05:19,008][123091] Updated weights for policy 0, policy_version 1189486 (0.0008) [2023-12-26 09:05:19,126][123090] Updated weights for policy 1, policy_version 1181065 (0.0008) [2023-12-26 09:05:19,190][123090] Updated weights for policy 1, policy_version 1181075 (0.0009) [2023-12-26 09:05:19,250][123090] Updated weights for policy 1, policy_version 1181085 (0.0009) [2023-12-26 09:05:19,889][123091] Updated weights for policy 0, policy_version 1189496 (0.0009) [2023-12-26 09:05:19,953][123091] Updated weights for policy 0, policy_version 1189506 (0.0010) [2023-12-26 09:05:20,023][123091] Updated weights for policy 0, policy_version 1189516 (0.0009) [2023-12-26 09:05:20,099][123090] Updated weights for policy 1, policy_version 1181095 (0.0007) [2023-12-26 09:05:20,164][123090] Updated weights for policy 1, policy_version 1181105 (0.0006) [2023-12-26 09:05:20,230][123090] Updated weights for policy 1, policy_version 1181115 (0.0006) [2023-12-26 09:05:20,906][123091] Updated weights for policy 0, policy_version 1189526 (0.0008) [2023-12-26 09:05:20,924][123090] Updated weights for policy 1, policy_version 1181125 (0.0007) [2023-12-26 09:05:20,972][123091] Updated weights for policy 0, policy_version 1189536 (0.0008) [2023-12-26 09:05:20,982][123090] Updated weights for policy 1, policy_version 1181135 (0.0009) [2023-12-26 09:05:21,039][123091] Updated weights for policy 0, policy_version 1189546 (0.0007) [2023-12-26 09:05:21,042][123090] Updated weights for policy 1, policy_version 1181145 (0.0009) [2023-12-26 09:05:21,865][123091] Updated weights for policy 0, policy_version 1189556 (0.0007) [2023-12-26 09:05:21,880][123090] Updated weights for policy 1, policy_version 1181155 (0.0008) [2023-12-26 09:05:21,935][123091] Updated weights for policy 0, policy_version 1189566 (0.0006) [2023-12-26 09:05:21,950][123090] Updated weights for policy 1, policy_version 1181165 (0.0006) [2023-12-26 09:05:21,998][123091] Updated weights for policy 0, policy_version 1189576 (0.0006) [2023-12-26 09:05:22,016][123090] Updated weights for policy 1, policy_version 1181175 (0.0008) [2023-12-26 09:05:22,729][123091] Updated weights for policy 0, policy_version 1189586 (0.0006) [2023-12-26 09:05:22,782][123091] Updated weights for policy 0, policy_version 1189596 (0.0006) [2023-12-26 09:05:22,848][123091] Updated weights for policy 0, policy_version 1189606 (0.0006) [2023-12-26 09:05:22,882][123090] Updated weights for policy 1, policy_version 1181185 (0.0009) [2023-12-26 09:05:22,914][123091] Updated weights for policy 0, policy_version 1189616 (0.0009) [2023-12-26 09:05:22,947][123090] Updated weights for policy 1, policy_version 1181195 (0.0008) [2023-12-26 09:05:23,014][123090] Updated weights for policy 1, policy_version 1181205 (0.0009) [2023-12-26 09:05:23,087][123090] Updated weights for policy 1, policy_version 1181215 (0.0010) [2023-12-26 09:05:23,591][123091] Updated weights for policy 0, policy_version 1189626 (0.0007) [2023-12-26 09:05:23,642][123091] Updated weights for policy 0, policy_version 1189636 (0.0005) [2023-12-26 09:05:23,693][123091] Updated weights for policy 0, policy_version 1189646 (0.0005) [2023-12-26 09:05:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 606945280. Throughput: 0: 9005.9, 1: 9018.2. Samples: 606919816. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:23,785][121949] Avg episode reward: [(0, '6194.399'), (1, '5805.744')] [2023-12-26 09:05:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001189648_304553984.pth... [2023-12-26 09:05:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001181216_302391296.pth... [2023-12-26 09:05:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001188560_304275456.pth [2023-12-26 09:05:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001180192_302129152.pth [2023-12-26 09:05:23,974][123090] Updated weights for policy 1, policy_version 1181225 (0.0009) [2023-12-26 09:05:24,035][123090] Updated weights for policy 1, policy_version 1181235 (0.0010) [2023-12-26 09:05:24,095][123090] Updated weights for policy 1, policy_version 1181245 (0.0007) [2023-12-26 09:05:24,402][123091] Updated weights for policy 0, policy_version 1189656 (0.0006) [2023-12-26 09:05:24,458][123091] Updated weights for policy 0, policy_version 1189666 (0.0006) [2023-12-26 09:05:24,518][123091] Updated weights for policy 0, policy_version 1189676 (0.0006) [2023-12-26 09:05:24,832][123090] Updated weights for policy 1, policy_version 1181255 (0.0005) [2023-12-26 09:05:24,882][123090] Updated weights for policy 1, policy_version 1181265 (0.0005) [2023-12-26 09:05:24,938][123090] Updated weights for policy 1, policy_version 1181275 (0.0005) [2023-12-26 09:05:25,211][123091] Updated weights for policy 0, policy_version 1189686 (0.0005) [2023-12-26 09:05:25,273][123091] Updated weights for policy 0, policy_version 1189696 (0.0005) [2023-12-26 09:05:25,342][123091] Updated weights for policy 0, policy_version 1189706 (0.0007) [2023-12-26 09:05:25,566][123090] Updated weights for policy 1, policy_version 1181285 (0.0006) [2023-12-26 09:05:25,628][123090] Updated weights for policy 1, policy_version 1181295 (0.0009) [2023-12-26 09:05:25,680][123090] Updated weights for policy 1, policy_version 1181305 (0.0010) [2023-12-26 09:05:26,018][123091] Updated weights for policy 0, policy_version 1189716 (0.0008) [2023-12-26 09:05:26,084][123091] Updated weights for policy 0, policy_version 1189726 (0.0010) [2023-12-26 09:05:26,128][123091] Updated weights for policy 0, policy_version 1189736 (0.0010) [2023-12-26 09:05:26,388][123090] Updated weights for policy 1, policy_version 1181315 (0.0010) [2023-12-26 09:05:26,437][123090] Updated weights for policy 1, policy_version 1181325 (0.0009) [2023-12-26 09:05:26,485][123090] Updated weights for policy 1, policy_version 1181335 (0.0008) [2023-12-26 09:05:26,957][123091] Updated weights for policy 0, policy_version 1189746 (0.0010) [2023-12-26 09:05:27,004][123091] Updated weights for policy 0, policy_version 1189756 (0.0010) [2023-12-26 09:05:27,047][123091] Updated weights for policy 0, policy_version 1189766 (0.0010) [2023-12-26 09:05:27,101][123091] Updated weights for policy 0, policy_version 1189776 (0.0009) [2023-12-26 09:05:27,211][123090] Updated weights for policy 1, policy_version 1181345 (0.0006) [2023-12-26 09:05:27,272][123090] Updated weights for policy 1, policy_version 1181355 (0.0005) [2023-12-26 09:05:27,334][123090] Updated weights for policy 1, policy_version 1181365 (0.0005) [2023-12-26 09:05:27,398][123090] Updated weights for policy 1, policy_version 1181375 (0.0010) [2023-12-26 09:05:27,901][123091] Updated weights for policy 0, policy_version 1189786 (0.0007) [2023-12-26 09:05:27,955][123091] Updated weights for policy 0, policy_version 1189796 (0.0005) [2023-12-26 09:05:28,007][123091] Updated weights for policy 0, policy_version 1189806 (0.0008) [2023-12-26 09:05:28,218][123090] Updated weights for policy 1, policy_version 1181385 (0.0009) [2023-12-26 09:05:28,276][123090] Updated weights for policy 1, policy_version 1181396 (0.0010) [2023-12-26 09:05:28,329][123090] Updated weights for policy 1, policy_version 1181407 (0.0009) [2023-12-26 09:05:28,686][123091] Updated weights for policy 0, policy_version 1189816 (0.0009) [2023-12-26 09:05:28,745][123091] Updated weights for policy 0, policy_version 1189826 (0.0009) [2023-12-26 09:05:28,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 607035392. Throughput: 0: 9085.8, 1: 9084.0. Samples: 607031572. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:28,786][121949] Avg episode reward: [(0, '6137.835'), (1, '5598.315')] [2023-12-26 09:05:28,808][123091] Updated weights for policy 0, policy_version 1189836 (0.0009) [2023-12-26 09:05:29,146][123090] Updated weights for policy 1, policy_version 1181417 (0.0009) [2023-12-26 09:05:29,198][123090] Updated weights for policy 1, policy_version 1181427 (0.0009) [2023-12-26 09:05:29,264][123090] Updated weights for policy 1, policy_version 1181437 (0.0008) [2023-12-26 09:05:29,621][123091] Updated weights for policy 0, policy_version 1189846 (0.0007) [2023-12-26 09:05:29,681][123091] Updated weights for policy 0, policy_version 1189856 (0.0006) [2023-12-26 09:05:29,743][123091] Updated weights for policy 0, policy_version 1189866 (0.0006) [2023-12-26 09:05:30,106][123090] Updated weights for policy 1, policy_version 1181447 (0.0010) [2023-12-26 09:05:30,159][123090] Updated weights for policy 1, policy_version 1181457 (0.0010) [2023-12-26 09:05:30,211][123090] Updated weights for policy 1, policy_version 1181467 (0.0009) [2023-12-26 09:05:30,492][123091] Updated weights for policy 0, policy_version 1189876 (0.0008) [2023-12-26 09:05:30,553][123091] Updated weights for policy 0, policy_version 1189886 (0.0011) [2023-12-26 09:05:30,606][123091] Updated weights for policy 0, policy_version 1189896 (0.0011) [2023-12-26 09:05:31,101][123090] Updated weights for policy 1, policy_version 1181477 (0.0010) [2023-12-26 09:05:31,163][123090] Updated weights for policy 1, policy_version 1181487 (0.0009) [2023-12-26 09:05:31,234][123090] Updated weights for policy 1, policy_version 1181497 (0.0007) [2023-12-26 09:05:31,466][123091] Updated weights for policy 0, policy_version 1189906 (0.0010) [2023-12-26 09:05:31,518][123091] Updated weights for policy 0, policy_version 1189916 (0.0008) [2023-12-26 09:05:31,566][123091] Updated weights for policy 0, policy_version 1189926 (0.0009) [2023-12-26 09:05:31,624][123091] Updated weights for policy 0, policy_version 1189936 (0.0009) [2023-12-26 09:05:32,061][123090] Updated weights for policy 1, policy_version 1181507 (0.0008) [2023-12-26 09:05:32,129][123090] Updated weights for policy 1, policy_version 1181517 (0.0010) [2023-12-26 09:05:32,194][123090] Updated weights for policy 1, policy_version 1181527 (0.0009) [2023-12-26 09:05:32,465][123091] Updated weights for policy 0, policy_version 1189946 (0.0009) [2023-12-26 09:05:32,533][123091] Updated weights for policy 0, policy_version 1189956 (0.0010) [2023-12-26 09:05:32,600][123091] Updated weights for policy 0, policy_version 1189966 (0.0010) [2023-12-26 09:05:32,988][123090] Updated weights for policy 1, policy_version 1181537 (0.0009) [2023-12-26 09:05:33,039][123090] Updated weights for policy 1, policy_version 1181547 (0.0008) [2023-12-26 09:05:33,093][123090] Updated weights for policy 1, policy_version 1181557 (0.0009) [2023-12-26 09:05:33,144][123090] Updated weights for policy 1, policy_version 1181567 (0.0009) [2023-12-26 09:05:33,406][123091] Updated weights for policy 0, policy_version 1189976 (0.0006) [2023-12-26 09:05:33,457][123091] Updated weights for policy 0, policy_version 1189986 (0.0005) [2023-12-26 09:05:33,512][123091] Updated weights for policy 0, policy_version 1189996 (0.0010) [2023-12-26 09:05:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18159.0, 300 sec: 17855.8). Total num frames: 607125504. Throughput: 0: 9074.1, 1: 9001.2. Samples: 607136588. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:33,785][121949] Avg episode reward: [(0, '5971.746'), (1, '5606.851')] [2023-12-26 09:05:34,029][123090] Updated weights for policy 1, policy_version 1181577 (0.0009) [2023-12-26 09:05:34,100][123090] Updated weights for policy 1, policy_version 1181587 (0.0009) [2023-12-26 09:05:34,160][123091] Updated weights for policy 0, policy_version 1190006 (0.0008) [2023-12-26 09:05:34,168][123090] Updated weights for policy 1, policy_version 1181597 (0.0008) [2023-12-26 09:05:34,228][123091] Updated weights for policy 0, policy_version 1190016 (0.0006) [2023-12-26 09:05:34,291][123091] Updated weights for policy 0, policy_version 1190026 (0.0006) [2023-12-26 09:05:35,018][123090] Updated weights for policy 1, policy_version 1181607 (0.0010) [2023-12-26 09:05:35,030][123091] Updated weights for policy 0, policy_version 1190036 (0.0008) [2023-12-26 09:05:35,079][123090] Updated weights for policy 1, policy_version 1181617 (0.0009) [2023-12-26 09:05:35,082][123091] Updated weights for policy 0, policy_version 1190046 (0.0005) [2023-12-26 09:05:35,132][123090] Updated weights for policy 1, policy_version 1181627 (0.0008) [2023-12-26 09:05:35,135][123091] Updated weights for policy 0, policy_version 1190056 (0.0005) [2023-12-26 09:05:35,904][123091] Updated weights for policy 0, policy_version 1190066 (0.0008) [2023-12-26 09:05:35,968][123091] Updated weights for policy 0, policy_version 1190076 (0.0011) [2023-12-26 09:05:35,998][123090] Updated weights for policy 1, policy_version 1181637 (0.0009) [2023-12-26 09:05:36,028][123091] Updated weights for policy 0, policy_version 1190086 (0.0011) [2023-12-26 09:05:36,052][123090] Updated weights for policy 1, policy_version 1181647 (0.0007) [2023-12-26 09:05:36,080][123091] Updated weights for policy 0, policy_version 1190096 (0.0010) [2023-12-26 09:05:36,107][123090] Updated weights for policy 1, policy_version 1181657 (0.0008) [2023-12-26 09:05:36,872][123091] Updated weights for policy 0, policy_version 1190106 (0.0005) [2023-12-26 09:05:36,917][123091] Updated weights for policy 0, policy_version 1190116 (0.0005) [2023-12-26 09:05:36,968][123091] Updated weights for policy 0, policy_version 1190126 (0.0005) [2023-12-26 09:05:37,000][123090] Updated weights for policy 1, policy_version 1181667 (0.0008) [2023-12-26 09:05:37,056][123090] Updated weights for policy 1, policy_version 1181677 (0.0006) [2023-12-26 09:05:37,115][123090] Updated weights for policy 1, policy_version 1181687 (0.0006) [2023-12-26 09:05:37,699][123091] Updated weights for policy 0, policy_version 1190136 (0.0006) [2023-12-26 09:05:37,762][123091] Updated weights for policy 0, policy_version 1190146 (0.0007) [2023-12-26 09:05:37,825][123091] Updated weights for policy 0, policy_version 1190156 (0.0009) [2023-12-26 09:05:37,975][123090] Updated weights for policy 1, policy_version 1181697 (0.0006) [2023-12-26 09:05:38,040][123090] Updated weights for policy 1, policy_version 1181707 (0.0009) [2023-12-26 09:05:38,110][123090] Updated weights for policy 1, policy_version 1181717 (0.0010) [2023-12-26 09:05:38,171][123090] Updated weights for policy 1, policy_version 1181727 (0.0010) [2023-12-26 09:05:38,589][123091] Updated weights for policy 0, policy_version 1190166 (0.0010) [2023-12-26 09:05:38,660][123091] Updated weights for policy 0, policy_version 1190176 (0.0009) [2023-12-26 09:05:38,729][123091] Updated weights for policy 0, policy_version 1190186 (0.0009) [2023-12-26 09:05:38,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 607215616. Throughput: 0: 9158.6, 1: 8896.7. Samples: 607189280. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:38,784][121949] Avg episode reward: [(0, '6122.119'), (1, '5749.061')] [2023-12-26 09:05:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001190192_304693248.pth... [2023-12-26 09:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001181728_302522368.pth... [2023-12-26 09:05:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001189104_304414720.pth [2023-12-26 09:05:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001180736_302268416.pth [2023-12-26 09:05:39,028][123090] Updated weights for policy 1, policy_version 1181737 (0.0009) [2023-12-26 09:05:39,095][123090] Updated weights for policy 1, policy_version 1181747 (0.0008) [2023-12-26 09:05:39,160][123090] Updated weights for policy 1, policy_version 1181757 (0.0008) [2023-12-26 09:05:39,529][123091] Updated weights for policy 0, policy_version 1190196 (0.0009) [2023-12-26 09:05:39,593][123091] Updated weights for policy 0, policy_version 1190206 (0.0009) [2023-12-26 09:05:39,658][123091] Updated weights for policy 0, policy_version 1190216 (0.0010) [2023-12-26 09:05:39,950][123090] Updated weights for policy 1, policy_version 1181767 (0.0007) [2023-12-26 09:05:40,018][123090] Updated weights for policy 1, policy_version 1181777 (0.0009) [2023-12-26 09:05:40,085][123090] Updated weights for policy 1, policy_version 1181787 (0.0006) [2023-12-26 09:05:40,537][123091] Updated weights for policy 0, policy_version 1190226 (0.0010) [2023-12-26 09:05:40,596][123091] Updated weights for policy 0, policy_version 1190236 (0.0011) [2023-12-26 09:05:40,662][123091] Updated weights for policy 0, policy_version 1190246 (0.0011) [2023-12-26 09:05:40,721][123091] Updated weights for policy 0, policy_version 1190256 (0.0011) [2023-12-26 09:05:40,824][123090] Updated weights for policy 1, policy_version 1181797 (0.0007) [2023-12-26 09:05:40,895][123090] Updated weights for policy 1, policy_version 1181807 (0.0006) [2023-12-26 09:05:40,961][123090] Updated weights for policy 1, policy_version 1181817 (0.0008) [2023-12-26 09:05:41,540][123091] Updated weights for policy 0, policy_version 1190266 (0.0008) [2023-12-26 09:05:41,603][123091] Updated weights for policy 0, policy_version 1190276 (0.0008) [2023-12-26 09:05:41,678][123091] Updated weights for policy 0, policy_version 1190286 (0.0008) [2023-12-26 09:05:41,743][123090] Updated weights for policy 1, policy_version 1181828 (0.0011) [2023-12-26 09:05:41,817][123090] Updated weights for policy 1, policy_version 1181838 (0.0009) [2023-12-26 09:05:41,887][123090] Updated weights for policy 1, policy_version 1181848 (0.0009) [2023-12-26 09:05:42,397][123091] Updated weights for policy 0, policy_version 1190296 (0.0009) [2023-12-26 09:05:42,460][123091] Updated weights for policy 0, policy_version 1190306 (0.0009) [2023-12-26 09:05:42,530][123091] Updated weights for policy 0, policy_version 1190316 (0.0010) [2023-12-26 09:05:42,672][123090] Updated weights for policy 1, policy_version 1181858 (0.0006) [2023-12-26 09:05:42,749][123090] Updated weights for policy 1, policy_version 1181868 (0.0011) [2023-12-26 09:05:42,817][123090] Updated weights for policy 1, policy_version 1181878 (0.0010) [2023-12-26 09:05:42,869][123090] Updated weights for policy 1, policy_version 1181888 (0.0009) [2023-12-26 09:05:43,362][123091] Updated weights for policy 0, policy_version 1190326 (0.0010) [2023-12-26 09:05:43,418][123091] Updated weights for policy 0, policy_version 1190336 (0.0009) [2023-12-26 09:05:43,466][123091] Updated weights for policy 0, policy_version 1190346 (0.0008) [2023-12-26 09:05:43,649][123090] Updated weights for policy 1, policy_version 1181898 (0.0010) [2023-12-26 09:05:43,702][123090] Updated weights for policy 1, policy_version 1181909 (0.0010) [2023-12-26 09:05:43,754][123090] Updated weights for policy 1, policy_version 1181919 (0.0010) [2023-12-26 09:05:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18159.0, 300 sec: 17855.8). Total num frames: 607305728. Throughput: 0: 9034.8, 1: 8745.1. Samples: 607293956. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:43,784][121949] Avg episode reward: [(0, '6193.366'), (1, '5797.886')] [2023-12-26 09:05:44,168][123091] Updated weights for policy 0, policy_version 1190356 (0.0005) [2023-12-26 09:05:44,226][123091] Updated weights for policy 0, policy_version 1190366 (0.0005) [2023-12-26 09:05:44,294][123091] Updated weights for policy 0, policy_version 1190376 (0.0007) [2023-12-26 09:05:44,622][123090] Updated weights for policy 1, policy_version 1181929 (0.0006) [2023-12-26 09:05:44,691][123090] Updated weights for policy 1, policy_version 1181939 (0.0006) [2023-12-26 09:05:44,738][123090] Updated weights for policy 1, policy_version 1181949 (0.0005) [2023-12-26 09:05:45,024][123091] Updated weights for policy 0, policy_version 1190386 (0.0008) [2023-12-26 09:05:45,080][123091] Updated weights for policy 0, policy_version 1190396 (0.0006) [2023-12-26 09:05:45,137][123091] Updated weights for policy 0, policy_version 1190406 (0.0006) [2023-12-26 09:05:45,196][123091] Updated weights for policy 0, policy_version 1190416 (0.0006) [2023-12-26 09:05:45,515][123090] Updated weights for policy 1, policy_version 1181959 (0.0007) [2023-12-26 09:05:45,585][123090] Updated weights for policy 1, policy_version 1181969 (0.0007) [2023-12-26 09:05:45,643][123090] Updated weights for policy 1, policy_version 1181979 (0.0010) [2023-12-26 09:05:45,812][123091] Updated weights for policy 0, policy_version 1190426 (0.0011) [2023-12-26 09:05:45,876][123091] Updated weights for policy 0, policy_version 1190436 (0.0011) [2023-12-26 09:05:45,934][123091] Updated weights for policy 0, policy_version 1190446 (0.0010) [2023-12-26 09:05:46,520][123090] Updated weights for policy 1, policy_version 1181989 (0.0009) [2023-12-26 09:05:46,582][123090] Updated weights for policy 1, policy_version 1181999 (0.0009) [2023-12-26 09:05:46,617][123091] Updated weights for policy 0, policy_version 1190456 (0.0010) [2023-12-26 09:05:46,648][123090] Updated weights for policy 1, policy_version 1182009 (0.0006) [2023-12-26 09:05:46,683][123091] Updated weights for policy 0, policy_version 1190466 (0.0011) [2023-12-26 09:05:46,733][123091] Updated weights for policy 0, policy_version 1190476 (0.0010) [2023-12-26 09:05:47,484][123090] Updated weights for policy 1, policy_version 1182019 (0.0007) [2023-12-26 09:05:47,488][123091] Updated weights for policy 0, policy_version 1190486 (0.0007) [2023-12-26 09:05:47,535][123090] Updated weights for policy 1, policy_version 1182029 (0.0008) [2023-12-26 09:05:47,541][123091] Updated weights for policy 0, policy_version 1190496 (0.0007) [2023-12-26 09:05:47,581][123090] Updated weights for policy 1, policy_version 1182039 (0.0007) [2023-12-26 09:05:47,588][123091] Updated weights for policy 0, policy_version 1190506 (0.0010) [2023-12-26 09:05:48,304][123091] Updated weights for policy 0, policy_version 1190516 (0.0010) [2023-12-26 09:05:48,392][123091] Updated weights for policy 0, policy_version 1190526 (0.0007) [2023-12-26 09:05:48,456][123091] Updated weights for policy 0, policy_version 1190536 (0.0009) [2023-12-26 09:05:48,480][123090] Updated weights for policy 1, policy_version 1182049 (0.0006) [2023-12-26 09:05:48,534][123090] Updated weights for policy 1, policy_version 1182059 (0.0008) [2023-12-26 09:05:48,595][123090] Updated weights for policy 1, policy_version 1182069 (0.0009) [2023-12-26 09:05:48,659][123090] Updated weights for policy 1, policy_version 1182079 (0.0009) [2023-12-26 09:05:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 607395840. Throughput: 0: 9166.5, 1: 8634.4. Samples: 607402324. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:48,785][121949] Avg episode reward: [(0, '6133.100'), (1, '5691.453')] [2023-12-26 09:05:49,160][123091] Updated weights for policy 0, policy_version 1190546 (0.0010) [2023-12-26 09:05:49,221][123091] Updated weights for policy 0, policy_version 1190556 (0.0006) [2023-12-26 09:05:49,289][123091] Updated weights for policy 0, policy_version 1190566 (0.0008) [2023-12-26 09:05:49,359][123091] Updated weights for policy 0, policy_version 1190576 (0.0008) [2023-12-26 09:05:49,506][123090] Updated weights for policy 1, policy_version 1182089 (0.0006) [2023-12-26 09:05:49,554][123090] Updated weights for policy 1, policy_version 1182099 (0.0005) [2023-12-26 09:05:49,610][123090] Updated weights for policy 1, policy_version 1182109 (0.0006) [2023-12-26 09:05:50,185][123091] Updated weights for policy 0, policy_version 1190586 (0.0010) [2023-12-26 09:05:50,246][123091] Updated weights for policy 0, policy_version 1190596 (0.0009) [2023-12-26 09:05:50,306][123091] Updated weights for policy 0, policy_version 1190606 (0.0010) [2023-12-26 09:05:50,381][123090] Updated weights for policy 1, policy_version 1182119 (0.0008) [2023-12-26 09:05:50,446][123090] Updated weights for policy 1, policy_version 1182129 (0.0009) [2023-12-26 09:05:50,503][123090] Updated weights for policy 1, policy_version 1182139 (0.0009) [2023-12-26 09:05:51,173][123091] Updated weights for policy 0, policy_version 1190616 (0.0010) [2023-12-26 09:05:51,241][123091] Updated weights for policy 0, policy_version 1190626 (0.0011) [2023-12-26 09:05:51,307][123091] Updated weights for policy 0, policy_version 1190636 (0.0009) [2023-12-26 09:05:51,358][123090] Updated weights for policy 1, policy_version 1182149 (0.0009) [2023-12-26 09:05:51,424][123090] Updated weights for policy 1, policy_version 1182159 (0.0008) [2023-12-26 09:05:51,491][123090] Updated weights for policy 1, policy_version 1182169 (0.0008) [2023-12-26 09:05:52,073][123091] Updated weights for policy 0, policy_version 1190646 (0.0009) [2023-12-26 09:05:52,134][123091] Updated weights for policy 0, policy_version 1190656 (0.0008) [2023-12-26 09:05:52,208][123091] Updated weights for policy 0, policy_version 1190666 (0.0010) [2023-12-26 09:05:52,363][123090] Updated weights for policy 1, policy_version 1182179 (0.0008) [2023-12-26 09:05:52,431][123090] Updated weights for policy 1, policy_version 1182189 (0.0009) [2023-12-26 09:05:52,488][123090] Updated weights for policy 1, policy_version 1182199 (0.0009) [2023-12-26 09:05:53,037][123091] Updated weights for policy 0, policy_version 1190676 (0.0010) [2023-12-26 09:05:53,086][123091] Updated weights for policy 0, policy_version 1190686 (0.0009) [2023-12-26 09:05:53,137][123091] Updated weights for policy 0, policy_version 1190696 (0.0009) [2023-12-26 09:05:53,249][123090] Updated weights for policy 1, policy_version 1182209 (0.0009) [2023-12-26 09:05:53,309][123090] Updated weights for policy 1, policy_version 1182219 (0.0006) [2023-12-26 09:05:53,369][123090] Updated weights for policy 1, policy_version 1182229 (0.0005) [2023-12-26 09:05:53,430][123090] Updated weights for policy 1, policy_version 1182239 (0.0005) [2023-12-26 09:05:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 607477760. Throughput: 0: 9106.5, 1: 8600.5. Samples: 607454672. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:53,785][121949] Avg episode reward: [(0, '6156.396'), (1, '5628.036')] [2023-12-26 09:05:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001190704_304824320.pth... [2023-12-26 09:05:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001182240_302653440.pth... [2023-12-26 09:05:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001189648_304553984.pth [2023-12-26 09:05:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001181216_302391296.pth [2023-12-26 09:05:54,005][123091] Updated weights for policy 0, policy_version 1190706 (0.0010) [2023-12-26 09:05:54,060][123091] Updated weights for policy 0, policy_version 1190716 (0.0005) [2023-12-26 09:05:54,104][123090] Updated weights for policy 1, policy_version 1182249 (0.0006) [2023-12-26 09:05:54,112][123091] Updated weights for policy 0, policy_version 1190726 (0.0006) [2023-12-26 09:05:54,171][123091] Updated weights for policy 0, policy_version 1190736 (0.0007) [2023-12-26 09:05:54,172][123090] Updated weights for policy 1, policy_version 1182259 (0.0009) [2023-12-26 09:05:54,227][123090] Updated weights for policy 1, policy_version 1182269 (0.0008) [2023-12-26 09:05:54,862][123091] Updated weights for policy 0, policy_version 1190746 (0.0006) [2023-12-26 09:05:54,938][123091] Updated weights for policy 0, policy_version 1190756 (0.0006) [2023-12-26 09:05:55,002][123091] Updated weights for policy 0, policy_version 1190766 (0.0006) [2023-12-26 09:05:55,101][123090] Updated weights for policy 1, policy_version 1182279 (0.0009) [2023-12-26 09:05:55,157][123090] Updated weights for policy 1, policy_version 1182289 (0.0008) [2023-12-26 09:05:55,213][123090] Updated weights for policy 1, policy_version 1182299 (0.0009) [2023-12-26 09:05:55,725][123091] Updated weights for policy 0, policy_version 1190776 (0.0008) [2023-12-26 09:05:55,772][123091] Updated weights for policy 0, policy_version 1190786 (0.0005) [2023-12-26 09:05:55,837][123091] Updated weights for policy 0, policy_version 1190796 (0.0008) [2023-12-26 09:05:56,082][123090] Updated weights for policy 1, policy_version 1182309 (0.0007) [2023-12-26 09:05:56,129][123090] Updated weights for policy 1, policy_version 1182319 (0.0005) [2023-12-26 09:05:56,193][123090] Updated weights for policy 1, policy_version 1182329 (0.0005) [2023-12-26 09:05:56,631][123091] Updated weights for policy 0, policy_version 1190806 (0.0011) [2023-12-26 09:05:56,689][123091] Updated weights for policy 0, policy_version 1190816 (0.0010) [2023-12-26 09:05:56,751][123091] Updated weights for policy 0, policy_version 1190826 (0.0011) [2023-12-26 09:05:56,793][123090] Updated weights for policy 1, policy_version 1182339 (0.0007) [2023-12-26 09:05:56,851][123090] Updated weights for policy 1, policy_version 1182349 (0.0008) [2023-12-26 09:05:56,910][123090] Updated weights for policy 1, policy_version 1182359 (0.0008) [2023-12-26 09:05:57,529][123091] Updated weights for policy 0, policy_version 1190836 (0.0010) [2023-12-26 09:05:57,589][123091] Updated weights for policy 0, policy_version 1190846 (0.0009) [2023-12-26 09:05:57,644][123091] Updated weights for policy 0, policy_version 1190857 (0.0009) [2023-12-26 09:05:57,741][123090] Updated weights for policy 1, policy_version 1182369 (0.0008) [2023-12-26 09:05:57,805][123090] Updated weights for policy 1, policy_version 1182379 (0.0009) [2023-12-26 09:05:57,863][123090] Updated weights for policy 1, policy_version 1182389 (0.0010) [2023-12-26 09:05:57,931][123090] Updated weights for policy 1, policy_version 1182399 (0.0009) [2023-12-26 09:05:58,447][123091] Updated weights for policy 0, policy_version 1190867 (0.0010) [2023-12-26 09:05:58,517][123091] Updated weights for policy 0, policy_version 1190877 (0.0010) [2023-12-26 09:05:58,581][123091] Updated weights for policy 0, policy_version 1190887 (0.0010) [2023-12-26 09:05:58,767][123090] Updated weights for policy 1, policy_version 1182409 (0.0007) [2023-12-26 09:05:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 607567872. Throughput: 0: 9131.6, 1: 8718.9. Samples: 607562968. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:05:58,785][121949] Avg episode reward: [(0, '6208.705'), (1, '5600.328')] [2023-12-26 09:05:58,839][123090] Updated weights for policy 1, policy_version 1182419 (0.0007) [2023-12-26 09:05:58,905][123090] Updated weights for policy 1, policy_version 1182429 (0.0006) [2023-12-26 09:05:59,464][123091] Updated weights for policy 0, policy_version 1190897 (0.0009) [2023-12-26 09:05:59,519][123091] Updated weights for policy 0, policy_version 1190907 (0.0009) [2023-12-26 09:05:59,577][123091] Updated weights for policy 0, policy_version 1190917 (0.0009) [2023-12-26 09:05:59,634][123091] Updated weights for policy 0, policy_version 1190927 (0.0009) [2023-12-26 09:05:59,741][123090] Updated weights for policy 1, policy_version 1182439 (0.0008) [2023-12-26 09:05:59,797][123090] Updated weights for policy 1, policy_version 1182449 (0.0009) [2023-12-26 09:05:59,864][123090] Updated weights for policy 1, policy_version 1182459 (0.0010) [2023-12-26 09:06:00,489][123091] Updated weights for policy 0, policy_version 1190937 (0.0010) [2023-12-26 09:06:00,554][123091] Updated weights for policy 0, policy_version 1190947 (0.0009) [2023-12-26 09:06:00,613][123091] Updated weights for policy 0, policy_version 1190957 (0.0009) [2023-12-26 09:06:00,668][123090] Updated weights for policy 1, policy_version 1182469 (0.0010) [2023-12-26 09:06:00,733][123090] Updated weights for policy 1, policy_version 1182479 (0.0006) [2023-12-26 09:06:00,794][123090] Updated weights for policy 1, policy_version 1182489 (0.0006) [2023-12-26 09:06:01,405][123091] Updated weights for policy 0, policy_version 1190967 (0.0009) [2023-12-26 09:06:01,464][123091] Updated weights for policy 0, policy_version 1190977 (0.0009) [2023-12-26 09:06:01,530][123091] Updated weights for policy 0, policy_version 1190987 (0.0010) [2023-12-26 09:06:01,704][123090] Updated weights for policy 1, policy_version 1182499 (0.0009) [2023-12-26 09:06:01,782][123090] Updated weights for policy 1, policy_version 1182509 (0.0007) [2023-12-26 09:06:01,846][123090] Updated weights for policy 1, policy_version 1182519 (0.0007) [2023-12-26 09:06:02,394][123091] Updated weights for policy 0, policy_version 1190997 (0.0010) [2023-12-26 09:06:02,447][123091] Updated weights for policy 0, policy_version 1191007 (0.0009) [2023-12-26 09:06:02,506][123091] Updated weights for policy 0, policy_version 1191017 (0.0010) [2023-12-26 09:06:02,568][123090] Updated weights for policy 1, policy_version 1182529 (0.0008) [2023-12-26 09:06:02,619][123090] Updated weights for policy 1, policy_version 1182539 (0.0009) [2023-12-26 09:06:02,674][123090] Updated weights for policy 1, policy_version 1182549 (0.0009) [2023-12-26 09:06:02,738][123090] Updated weights for policy 1, policy_version 1182559 (0.0009) [2023-12-26 09:06:03,336][123091] Updated weights for policy 0, policy_version 1191027 (0.0008) [2023-12-26 09:06:03,386][123091] Updated weights for policy 0, policy_version 1191037 (0.0005) [2023-12-26 09:06:03,439][123091] Updated weights for policy 0, policy_version 1191047 (0.0010) [2023-12-26 09:06:03,588][123090] Updated weights for policy 1, policy_version 1182569 (0.0009) [2023-12-26 09:06:03,638][123090] Updated weights for policy 1, policy_version 1182579 (0.0009) [2023-12-26 09:06:03,693][123090] Updated weights for policy 1, policy_version 1182589 (0.0009) [2023-12-26 09:06:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 607657984. Throughput: 0: 9027.9, 1: 8657.6. Samples: 607664860. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:03,785][121949] Avg episode reward: [(0, '6218.557'), (1, '5673.354')] [2023-12-26 09:06:04,195][123091] Updated weights for policy 0, policy_version 1191057 (0.0010) [2023-12-26 09:06:04,264][123091] Updated weights for policy 0, policy_version 1191067 (0.0008) [2023-12-26 09:06:04,329][123091] Updated weights for policy 0, policy_version 1191077 (0.0007) [2023-12-26 09:06:04,391][123091] Updated weights for policy 0, policy_version 1191087 (0.0006) [2023-12-26 09:06:04,518][123090] Updated weights for policy 1, policy_version 1182599 (0.0009) [2023-12-26 09:06:04,574][123090] Updated weights for policy 1, policy_version 1182609 (0.0010) [2023-12-26 09:06:04,634][123090] Updated weights for policy 1, policy_version 1182619 (0.0006) [2023-12-26 09:06:05,107][123091] Updated weights for policy 0, policy_version 1191097 (0.0010) [2023-12-26 09:06:05,155][123091] Updated weights for policy 0, policy_version 1191107 (0.0009) [2023-12-26 09:06:05,203][123091] Updated weights for policy 0, policy_version 1191117 (0.0005) [2023-12-26 09:06:05,325][123090] Updated weights for policy 1, policy_version 1182629 (0.0006) [2023-12-26 09:06:05,386][123090] Updated weights for policy 1, policy_version 1182639 (0.0005) [2023-12-26 09:06:05,444][123090] Updated weights for policy 1, policy_version 1182649 (0.0007) [2023-12-26 09:06:05,996][123091] Updated weights for policy 0, policy_version 1191127 (0.0009) [2023-12-26 09:06:06,044][123091] Updated weights for policy 0, policy_version 1191137 (0.0010) [2023-12-26 09:06:06,106][123091] Updated weights for policy 0, policy_version 1191148 (0.0007) [2023-12-26 09:06:06,128][123090] Updated weights for policy 1, policy_version 1182659 (0.0007) [2023-12-26 09:06:06,198][123090] Updated weights for policy 1, policy_version 1182669 (0.0007) [2023-12-26 09:06:06,270][123090] Updated weights for policy 1, policy_version 1182679 (0.0006) [2023-12-26 09:06:06,903][123091] Updated weights for policy 0, policy_version 1191158 (0.0009) [2023-12-26 09:06:06,978][123091] Updated weights for policy 0, policy_version 1191168 (0.0011) [2023-12-26 09:06:06,991][123090] Updated weights for policy 1, policy_version 1182689 (0.0006) [2023-12-26 09:06:07,037][123091] Updated weights for policy 0, policy_version 1191179 (0.0009) [2023-12-26 09:06:07,057][123090] Updated weights for policy 1, policy_version 1182699 (0.0006) [2023-12-26 09:06:07,115][123090] Updated weights for policy 1, policy_version 1182709 (0.0006) [2023-12-26 09:06:07,177][123090] Updated weights for policy 1, policy_version 1182719 (0.0006) [2023-12-26 09:06:07,890][123090] Updated weights for policy 1, policy_version 1182729 (0.0005) [2023-12-26 09:06:07,911][123091] Updated weights for policy 0, policy_version 1191189 (0.0007) [2023-12-26 09:06:07,949][123090] Updated weights for policy 1, policy_version 1182739 (0.0005) [2023-12-26 09:06:07,969][123091] Updated weights for policy 0, policy_version 1191199 (0.0009) [2023-12-26 09:06:08,017][123090] Updated weights for policy 1, policy_version 1182749 (0.0006) [2023-12-26 09:06:08,036][123091] Updated weights for policy 0, policy_version 1191209 (0.0009) [2023-12-26 09:06:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 607739904. Throughput: 0: 9089.6, 1: 8719.2. Samples: 607721212. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:08,784][121949] Avg episode reward: [(0, '6236.521'), (1, '5651.724')] [2023-12-26 09:06:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001191216_304955392.pth... [2023-12-26 09:06:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001190192_304693248.pth [2023-12-26 09:06:08,812][123090] Updated weights for policy 1, policy_version 1182759 (0.0010) [2023-12-26 09:06:08,879][123090] Updated weights for policy 1, policy_version 1182769 (0.0011) [2023-12-26 09:06:08,885][123091] Updated weights for policy 0, policy_version 1191219 (0.0010) [2023-12-26 09:06:08,943][123091] Updated weights for policy 0, policy_version 1191229 (0.0008) [2023-12-26 09:06:08,943][123090] Updated weights for policy 1, policy_version 1182779 (0.0011) [2023-12-26 09:06:08,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001182784_302792704.pth... [2023-12-26 09:06:08,975][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001181728_302522368.pth [2023-12-26 09:06:09,005][123091] Updated weights for policy 0, policy_version 1191239 (0.0008) [2023-12-26 09:06:09,728][123091] Updated weights for policy 0, policy_version 1191249 (0.0008) [2023-12-26 09:06:09,798][123091] Updated weights for policy 0, policy_version 1191259 (0.0006) [2023-12-26 09:06:09,830][123090] Updated weights for policy 1, policy_version 1182789 (0.0009) [2023-12-26 09:06:09,864][123091] Updated weights for policy 0, policy_version 1191269 (0.0010) [2023-12-26 09:06:09,894][123090] Updated weights for policy 1, policy_version 1182799 (0.0008) [2023-12-26 09:06:09,928][123091] Updated weights for policy 0, policy_version 1191279 (0.0008) [2023-12-26 09:06:09,962][123090] Updated weights for policy 1, policy_version 1182809 (0.0010) [2023-12-26 09:06:10,732][123091] Updated weights for policy 0, policy_version 1191289 (0.0010) [2023-12-26 09:06:10,775][123090] Updated weights for policy 1, policy_version 1182819 (0.0010) [2023-12-26 09:06:10,788][123091] Updated weights for policy 0, policy_version 1191299 (0.0010) [2023-12-26 09:06:10,835][123090] Updated weights for policy 1, policy_version 1182829 (0.0009) [2023-12-26 09:06:10,848][123091] Updated weights for policy 0, policy_version 1191309 (0.0006) [2023-12-26 09:06:10,894][123090] Updated weights for policy 1, policy_version 1182839 (0.0009) [2023-12-26 09:06:11,675][123091] Updated weights for policy 0, policy_version 1191319 (0.0009) [2023-12-26 09:06:11,739][123090] Updated weights for policy 1, policy_version 1182849 (0.0009) [2023-12-26 09:06:11,745][123091] Updated weights for policy 0, policy_version 1191329 (0.0010) [2023-12-26 09:06:11,804][123090] Updated weights for policy 1, policy_version 1182859 (0.0010) [2023-12-26 09:06:11,812][123091] Updated weights for policy 0, policy_version 1191339 (0.0007) [2023-12-26 09:06:11,868][123090] Updated weights for policy 1, policy_version 1182869 (0.0009) [2023-12-26 09:06:11,936][123090] Updated weights for policy 1, policy_version 1182879 (0.0009) [2023-12-26 09:06:12,595][123091] Updated weights for policy 0, policy_version 1191349 (0.0007) [2023-12-26 09:06:12,655][123091] Updated weights for policy 0, policy_version 1191359 (0.0006) [2023-12-26 09:06:12,720][123091] Updated weights for policy 0, policy_version 1191369 (0.0005) [2023-12-26 09:06:12,764][123090] Updated weights for policy 1, policy_version 1182889 (0.0009) [2023-12-26 09:06:12,831][123090] Updated weights for policy 1, policy_version 1182899 (0.0009) [2023-12-26 09:06:12,894][123090] Updated weights for policy 1, policy_version 1182909 (0.0009) [2023-12-26 09:06:13,434][123091] Updated weights for policy 0, policy_version 1191379 (0.0007) [2023-12-26 09:06:13,501][123091] Updated weights for policy 0, policy_version 1191389 (0.0009) [2023-12-26 09:06:13,551][123091] Updated weights for policy 0, policy_version 1191399 (0.0008) [2023-12-26 09:06:13,662][123090] Updated weights for policy 1, policy_version 1182919 (0.0009) [2023-12-26 09:06:13,718][123090] Updated weights for policy 1, policy_version 1182929 (0.0009) [2023-12-26 09:06:13,770][123090] Updated weights for policy 1, policy_version 1182939 (0.0009) [2023-12-26 09:06:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 607830016. Throughput: 0: 8975.7, 1: 8663.7. Samples: 607825340. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:13,785][121949] Avg episode reward: [(0, '6318.809'), (1, '5587.987')] [2023-12-26 09:06:14,337][123091] Updated weights for policy 0, policy_version 1191409 (0.0005) [2023-12-26 09:06:14,386][123091] Updated weights for policy 0, policy_version 1191419 (0.0008) [2023-12-26 09:06:14,436][123091] Updated weights for policy 0, policy_version 1191429 (0.0008) [2023-12-26 09:06:14,483][123091] Updated weights for policy 0, policy_version 1191439 (0.0005) [2023-12-26 09:06:14,533][123090] Updated weights for policy 1, policy_version 1182949 (0.0010) [2023-12-26 09:06:14,603][123090] Updated weights for policy 1, policy_version 1182959 (0.0010) [2023-12-26 09:06:14,661][123090] Updated weights for policy 1, policy_version 1182969 (0.0010) [2023-12-26 09:06:15,317][123091] Updated weights for policy 0, policy_version 1191449 (0.0010) [2023-12-26 09:06:15,345][123090] Updated weights for policy 1, policy_version 1182980 (0.0009) [2023-12-26 09:06:15,381][123091] Updated weights for policy 0, policy_version 1191459 (0.0011) [2023-12-26 09:06:15,413][123090] Updated weights for policy 1, policy_version 1182990 (0.0006) [2023-12-26 09:06:15,445][123091] Updated weights for policy 0, policy_version 1191469 (0.0011) [2023-12-26 09:06:15,474][123090] Updated weights for policy 1, policy_version 1183000 (0.0006) [2023-12-26 09:06:16,171][123090] Updated weights for policy 1, policy_version 1183010 (0.0008) [2023-12-26 09:06:16,227][123090] Updated weights for policy 1, policy_version 1183020 (0.0005) [2023-12-26 09:06:16,254][123091] Updated weights for policy 0, policy_version 1191479 (0.0011) [2023-12-26 09:06:16,278][123090] Updated weights for policy 1, policy_version 1183030 (0.0005) [2023-12-26 09:06:16,313][123091] Updated weights for policy 0, policy_version 1191489 (0.0010) [2023-12-26 09:06:16,354][123090] Updated weights for policy 1, policy_version 1183040 (0.0005) [2023-12-26 09:06:16,383][123091] Updated weights for policy 0, policy_version 1191499 (0.0011) [2023-12-26 09:06:17,023][123090] Updated weights for policy 1, policy_version 1183050 (0.0009) [2023-12-26 09:06:17,086][123090] Updated weights for policy 1, policy_version 1183060 (0.0009) [2023-12-26 09:06:17,158][123090] Updated weights for policy 1, policy_version 1183070 (0.0009) [2023-12-26 09:06:17,200][123091] Updated weights for policy 0, policy_version 1191509 (0.0011) [2023-12-26 09:06:17,259][123091] Updated weights for policy 0, policy_version 1191519 (0.0011) [2023-12-26 09:06:17,324][123091] Updated weights for policy 0, policy_version 1191529 (0.0010) [2023-12-26 09:06:17,970][123090] Updated weights for policy 1, policy_version 1183080 (0.0009) [2023-12-26 09:06:18,031][123090] Updated weights for policy 1, policy_version 1183090 (0.0009) [2023-12-26 09:06:18,066][123091] Updated weights for policy 0, policy_version 1191539 (0.0010) [2023-12-26 09:06:18,081][123090] Updated weights for policy 1, policy_version 1183100 (0.0009) [2023-12-26 09:06:18,126][123091] Updated weights for policy 0, policy_version 1191549 (0.0008) [2023-12-26 09:06:18,194][123091] Updated weights for policy 0, policy_version 1191559 (0.0010) [2023-12-26 09:06:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 607920128. Throughput: 0: 8972.8, 1: 8764.2. Samples: 607934752. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:18,784][121949] Avg episode reward: [(0, '6223.597'), (1, '5517.399')] [2023-12-26 09:06:18,918][123090] Updated weights for policy 1, policy_version 1183110 (0.0009) [2023-12-26 09:06:18,980][123090] Updated weights for policy 1, policy_version 1183120 (0.0008) [2023-12-26 09:06:19,040][123090] Updated weights for policy 1, policy_version 1183130 (0.0008) [2023-12-26 09:06:19,052][123091] Updated weights for policy 0, policy_version 1191569 (0.0009) [2023-12-26 09:06:19,118][123091] Updated weights for policy 0, policy_version 1191579 (0.0009) [2023-12-26 09:06:19,173][123091] Updated weights for policy 0, policy_version 1191589 (0.0009) [2023-12-26 09:06:19,239][123091] Updated weights for policy 0, policy_version 1191599 (0.0009) [2023-12-26 09:06:19,877][123090] Updated weights for policy 1, policy_version 1183140 (0.0009) [2023-12-26 09:06:19,952][123090] Updated weights for policy 1, policy_version 1183150 (0.0010) [2023-12-26 09:06:20,011][123090] Updated weights for policy 1, policy_version 1183160 (0.0009) [2023-12-26 09:06:20,136][123091] Updated weights for policy 0, policy_version 1191609 (0.0010) [2023-12-26 09:06:20,199][123091] Updated weights for policy 0, policy_version 1191619 (0.0010) [2023-12-26 09:06:20,258][123091] Updated weights for policy 0, policy_version 1191629 (0.0010) [2023-12-26 09:06:20,838][123090] Updated weights for policy 1, policy_version 1183170 (0.0007) [2023-12-26 09:06:20,912][123090] Updated weights for policy 1, policy_version 1183180 (0.0009) [2023-12-26 09:06:20,976][123090] Updated weights for policy 1, policy_version 1183190 (0.0010) [2023-12-26 09:06:21,044][123090] Updated weights for policy 1, policy_version 1183200 (0.0010) [2023-12-26 09:06:21,107][123091] Updated weights for policy 0, policy_version 1191639 (0.0009) [2023-12-26 09:06:21,175][123091] Updated weights for policy 0, policy_version 1191649 (0.0008) [2023-12-26 09:06:21,233][123091] Updated weights for policy 0, policy_version 1191659 (0.0008) [2023-12-26 09:06:21,926][123090] Updated weights for policy 1, policy_version 1183210 (0.0010) [2023-12-26 09:06:21,998][123090] Updated weights for policy 1, policy_version 1183220 (0.0009) [2023-12-26 09:06:22,068][123090] Updated weights for policy 1, policy_version 1183230 (0.0009) [2023-12-26 09:06:22,075][123091] Updated weights for policy 0, policy_version 1191669 (0.0009) [2023-12-26 09:06:22,127][123091] Updated weights for policy 0, policy_version 1191679 (0.0010) [2023-12-26 09:06:22,184][123091] Updated weights for policy 0, policy_version 1191689 (0.0009) [2023-12-26 09:06:22,840][123090] Updated weights for policy 1, policy_version 1183240 (0.0006) [2023-12-26 09:06:22,889][123090] Updated weights for policy 1, policy_version 1183250 (0.0005) [2023-12-26 09:06:22,938][123090] Updated weights for policy 1, policy_version 1183260 (0.0006) [2023-12-26 09:06:23,074][123091] Updated weights for policy 0, policy_version 1191699 (0.0008) [2023-12-26 09:06:23,153][123091] Updated weights for policy 0, policy_version 1191709 (0.0007) [2023-12-26 09:06:23,219][123091] Updated weights for policy 0, policy_version 1191719 (0.0008) [2023-12-26 09:06:23,753][123090] Updated weights for policy 1, policy_version 1183270 (0.0010) [2023-12-26 09:06:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 608002048. Throughput: 0: 8896.0, 1: 8774.8. Samples: 607984468. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:23,785][121949] Avg episode reward: [(0, '6020.435'), (1, '5526.216')] [2023-12-26 09:06:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001191728_305086464.pth... [2023-12-26 09:06:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001190704_304824320.pth [2023-12-26 09:06:23,810][123090] Updated weights for policy 1, policy_version 1183280 (0.0009) [2023-12-26 09:06:23,867][123090] Updated weights for policy 1, policy_version 1183290 (0.0009) [2023-12-26 09:06:23,899][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001183296_302923776.pth... [2023-12-26 09:06:23,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001182240_302653440.pth [2023-12-26 09:06:23,987][123091] Updated weights for policy 0, policy_version 1191729 (0.0008) [2023-12-26 09:06:24,041][123091] Updated weights for policy 0, policy_version 1191739 (0.0010) [2023-12-26 09:06:24,104][123091] Updated weights for policy 0, policy_version 1191749 (0.0011) [2023-12-26 09:06:24,170][123091] Updated weights for policy 0, policy_version 1191759 (0.0011) [2023-12-26 09:06:24,651][123090] Updated weights for policy 1, policy_version 1183300 (0.0007) [2023-12-26 09:06:24,726][123090] Updated weights for policy 1, policy_version 1183310 (0.0005) [2023-12-26 09:06:24,800][123090] Updated weights for policy 1, policy_version 1183320 (0.0009) [2023-12-26 09:06:24,931][123091] Updated weights for policy 0, policy_version 1191769 (0.0006) [2023-12-26 09:06:25,001][123091] Updated weights for policy 0, policy_version 1191779 (0.0006) [2023-12-26 09:06:25,067][123091] Updated weights for policy 0, policy_version 1191789 (0.0005) [2023-12-26 09:06:25,551][123090] Updated weights for policy 1, policy_version 1183330 (0.0010) [2023-12-26 09:06:25,612][123090] Updated weights for policy 1, policy_version 1183340 (0.0007) [2023-12-26 09:06:25,638][123091] Updated weights for policy 0, policy_version 1191799 (0.0005) [2023-12-26 09:06:25,662][123090] Updated weights for policy 1, policy_version 1183350 (0.0005) [2023-12-26 09:06:25,697][123091] Updated weights for policy 0, policy_version 1191809 (0.0006) [2023-12-26 09:06:25,717][123090] Updated weights for policy 1, policy_version 1183360 (0.0005) [2023-12-26 09:06:25,750][123091] Updated weights for policy 0, policy_version 1191819 (0.0006) [2023-12-26 09:06:26,344][123090] Updated weights for policy 1, policy_version 1183370 (0.0005) [2023-12-26 09:06:26,394][123090] Updated weights for policy 1, policy_version 1183380 (0.0005) [2023-12-26 09:06:26,400][123091] Updated weights for policy 0, policy_version 1191829 (0.0008) [2023-12-26 09:06:26,439][123090] Updated weights for policy 1, policy_version 1183390 (0.0005) [2023-12-26 09:06:26,451][123091] Updated weights for policy 0, policy_version 1191839 (0.0010) [2023-12-26 09:06:26,499][123091] Updated weights for policy 0, policy_version 1191849 (0.0010) [2023-12-26 09:06:27,135][123090] Updated weights for policy 1, policy_version 1183400 (0.0005) [2023-12-26 09:06:27,199][123090] Updated weights for policy 1, policy_version 1183410 (0.0005) [2023-12-26 09:06:27,250][123091] Updated weights for policy 0, policy_version 1191859 (0.0009) [2023-12-26 09:06:27,264][123090] Updated weights for policy 1, policy_version 1183420 (0.0006) [2023-12-26 09:06:27,300][123091] Updated weights for policy 0, policy_version 1191869 (0.0005) [2023-12-26 09:06:27,360][123091] Updated weights for policy 0, policy_version 1191879 (0.0011) [2023-12-26 09:06:27,940][123090] Updated weights for policy 1, policy_version 1183430 (0.0006) [2023-12-26 09:06:27,998][123091] Updated weights for policy 0, policy_version 1191889 (0.0010) [2023-12-26 09:06:28,003][123090] Updated weights for policy 1, policy_version 1183440 (0.0006) [2023-12-26 09:06:28,053][123090] Updated weights for policy 1, policy_version 1183450 (0.0005) [2023-12-26 09:06:28,063][123091] Updated weights for policy 0, policy_version 1191899 (0.0010) [2023-12-26 09:06:28,132][123091] Updated weights for policy 0, policy_version 1191909 (0.0005) [2023-12-26 09:06:28,189][123091] Updated weights for policy 0, policy_version 1191919 (0.0005) [2023-12-26 09:06:28,782][123090] Updated weights for policy 1, policy_version 1183460 (0.0007) [2023-12-26 09:06:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.5, 300 sec: 17800.2). Total num frames: 608100352. Throughput: 0: 8965.9, 1: 8881.6. Samples: 608097092. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:28,784][121949] Avg episode reward: [(0, '6036.301'), (1, '5692.663')] [2023-12-26 09:06:28,830][123091] Updated weights for policy 0, policy_version 1191929 (0.0010) [2023-12-26 09:06:28,853][123090] Updated weights for policy 1, policy_version 1183470 (0.0006) [2023-12-26 09:06:28,905][123091] Updated weights for policy 0, policy_version 1191939 (0.0011) [2023-12-26 09:06:28,922][123090] Updated weights for policy 1, policy_version 1183480 (0.0006) [2023-12-26 09:06:28,969][123091] Updated weights for policy 0, policy_version 1191949 (0.0011) [2023-12-26 09:06:29,704][123090] Updated weights for policy 1, policy_version 1183490 (0.0010) [2023-12-26 09:06:29,766][123090] Updated weights for policy 1, policy_version 1183500 (0.0010) [2023-12-26 09:06:29,781][123091] Updated weights for policy 0, policy_version 1191959 (0.0009) [2023-12-26 09:06:29,826][123090] Updated weights for policy 1, policy_version 1183510 (0.0010) [2023-12-26 09:06:29,836][123091] Updated weights for policy 0, policy_version 1191969 (0.0007) [2023-12-26 09:06:29,892][123090] Updated weights for policy 1, policy_version 1183520 (0.0010) [2023-12-26 09:06:29,899][123091] Updated weights for policy 0, policy_version 1191979 (0.0006) [2023-12-26 09:06:30,706][123090] Updated weights for policy 1, policy_version 1183530 (0.0010) [2023-12-26 09:06:30,726][123091] Updated weights for policy 0, policy_version 1191989 (0.0009) [2023-12-26 09:06:30,753][123090] Updated weights for policy 1, policy_version 1183540 (0.0010) [2023-12-26 09:06:30,773][123091] Updated weights for policy 0, policy_version 1191999 (0.0006) [2023-12-26 09:06:30,800][123090] Updated weights for policy 1, policy_version 1183550 (0.0010) [2023-12-26 09:06:30,828][123091] Updated weights for policy 0, policy_version 1192009 (0.0006) [2023-12-26 09:06:31,687][123090] Updated weights for policy 1, policy_version 1183560 (0.0010) [2023-12-26 09:06:31,704][123091] Updated weights for policy 0, policy_version 1192019 (0.0009) [2023-12-26 09:06:31,758][123090] Updated weights for policy 1, policy_version 1183570 (0.0010) [2023-12-26 09:06:31,769][123091] Updated weights for policy 0, policy_version 1192029 (0.0008) [2023-12-26 09:06:31,819][123090] Updated weights for policy 1, policy_version 1183580 (0.0010) [2023-12-26 09:06:31,834][123091] Updated weights for policy 0, policy_version 1192039 (0.0006) [2023-12-26 09:06:32,652][123090] Updated weights for policy 1, policy_version 1183590 (0.0010) [2023-12-26 09:06:32,664][123091] Updated weights for policy 0, policy_version 1192049 (0.0008) [2023-12-26 09:06:32,716][123090] Updated weights for policy 1, policy_version 1183600 (0.0010) [2023-12-26 09:06:32,718][123091] Updated weights for policy 0, policy_version 1192059 (0.0009) [2023-12-26 09:06:32,768][123090] Updated weights for policy 1, policy_version 1183610 (0.0010) [2023-12-26 09:06:32,774][123091] Updated weights for policy 0, policy_version 1192069 (0.0007) [2023-12-26 09:06:32,835][123091] Updated weights for policy 0, policy_version 1192079 (0.0007) [2023-12-26 09:06:33,602][123090] Updated weights for policy 1, policy_version 1183620 (0.0010) [2023-12-26 09:06:33,653][123090] Updated weights for policy 1, policy_version 1183630 (0.0010) [2023-12-26 09:06:33,677][123091] Updated weights for policy 0, policy_version 1192089 (0.0006) [2023-12-26 09:06:33,714][123090] Updated weights for policy 1, policy_version 1183640 (0.0009) [2023-12-26 09:06:33,733][123091] Updated weights for policy 0, policy_version 1192099 (0.0009) [2023-12-26 09:06:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 608190464. Throughput: 0: 8848.9, 1: 8938.9. Samples: 608202772. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:33,785][121949] Avg episode reward: [(0, '6307.884'), (1, '5857.697')] [2023-12-26 09:06:33,786][123091] Updated weights for policy 0, policy_version 1192109 (0.0008) [2023-12-26 09:06:34,543][123090] Updated weights for policy 1, policy_version 1183650 (0.0008) [2023-12-26 09:06:34,615][123090] Updated weights for policy 1, policy_version 1183660 (0.0011) [2023-12-26 09:06:34,664][123091] Updated weights for policy 0, policy_version 1192119 (0.0008) [2023-12-26 09:06:34,687][123090] Updated weights for policy 1, policy_version 1183670 (0.0011) [2023-12-26 09:06:34,733][123091] Updated weights for policy 0, policy_version 1192129 (0.0006) [2023-12-26 09:06:34,748][123090] Updated weights for policy 1, policy_version 1183680 (0.0011) [2023-12-26 09:06:34,797][123091] Updated weights for policy 0, policy_version 1192139 (0.0008) [2023-12-26 09:06:35,549][123090] Updated weights for policy 1, policy_version 1183690 (0.0008) [2023-12-26 09:06:35,607][123090] Updated weights for policy 1, policy_version 1183700 (0.0005) [2023-12-26 09:06:35,623][123091] Updated weights for policy 0, policy_version 1192149 (0.0009) [2023-12-26 09:06:35,662][123090] Updated weights for policy 1, policy_version 1183710 (0.0008) [2023-12-26 09:06:35,685][123091] Updated weights for policy 0, policy_version 1192159 (0.0008) [2023-12-26 09:06:35,737][123091] Updated weights for policy 0, policy_version 1192169 (0.0009) [2023-12-26 09:06:36,432][123090] Updated weights for policy 1, policy_version 1183720 (0.0006) [2023-12-26 09:06:36,503][123090] Updated weights for policy 1, policy_version 1183730 (0.0007) [2023-12-26 09:06:36,524][123091] Updated weights for policy 0, policy_version 1192179 (0.0008) [2023-12-26 09:06:36,558][123090] Updated weights for policy 1, policy_version 1183740 (0.0009) [2023-12-26 09:06:36,587][123091] Updated weights for policy 0, policy_version 1192189 (0.0008) [2023-12-26 09:06:36,652][123091] Updated weights for policy 0, policy_version 1192199 (0.0009) [2023-12-26 09:06:37,212][123090] Updated weights for policy 1, policy_version 1183750 (0.0008) [2023-12-26 09:06:37,267][123090] Updated weights for policy 1, policy_version 1183760 (0.0009) [2023-12-26 09:06:37,322][123090] Updated weights for policy 1, policy_version 1183770 (0.0010) [2023-12-26 09:06:37,390][123091] Updated weights for policy 0, policy_version 1192209 (0.0010) [2023-12-26 09:06:37,437][123091] Updated weights for policy 0, policy_version 1192219 (0.0010) [2023-12-26 09:06:37,489][123091] Updated weights for policy 0, policy_version 1192229 (0.0010) [2023-12-26 09:06:37,541][123091] Updated weights for policy 0, policy_version 1192239 (0.0010) [2023-12-26 09:06:38,212][123090] Updated weights for policy 1, policy_version 1183780 (0.0008) [2023-12-26 09:06:38,275][123090] Updated weights for policy 1, policy_version 1183790 (0.0007) [2023-12-26 09:06:38,283][123091] Updated weights for policy 0, policy_version 1192249 (0.0008) [2023-12-26 09:06:38,339][123091] Updated weights for policy 0, policy_version 1192259 (0.0010) [2023-12-26 09:06:38,343][123090] Updated weights for policy 1, policy_version 1183800 (0.0011) [2023-12-26 09:06:38,400][123091] Updated weights for policy 0, policy_version 1192269 (0.0010) [2023-12-26 09:06:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 608280576. Throughput: 0: 8832.3, 1: 8944.0. Samples: 608254608. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:38,785][121949] Avg episode reward: [(0, '6307.217'), (1, '5791.057')] [2023-12-26 09:06:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001192272_305225728.pth... [2023-12-26 09:06:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001183808_303054848.pth... [2023-12-26 09:06:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001182784_302792704.pth [2023-12-26 09:06:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001191216_304955392.pth [2023-12-26 09:06:39,156][123090] Updated weights for policy 1, policy_version 1183810 (0.0010) [2023-12-26 09:06:39,196][123091] Updated weights for policy 0, policy_version 1192279 (0.0011) [2023-12-26 09:06:39,254][123090] Updated weights for policy 1, policy_version 1183820 (0.0010) [2023-12-26 09:06:39,264][123091] Updated weights for policy 0, policy_version 1192289 (0.0009) [2023-12-26 09:06:39,329][123090] Updated weights for policy 1, policy_version 1183830 (0.0009) [2023-12-26 09:06:39,340][123091] Updated weights for policy 0, policy_version 1192299 (0.0011) [2023-12-26 09:06:39,398][123090] Updated weights for policy 1, policy_version 1183840 (0.0009) [2023-12-26 09:06:40,141][123091] Updated weights for policy 0, policy_version 1192309 (0.0008) [2023-12-26 09:06:40,205][123091] Updated weights for policy 0, policy_version 1192319 (0.0011) [2023-12-26 09:06:40,233][123090] Updated weights for policy 1, policy_version 1183850 (0.0006) [2023-12-26 09:06:40,277][123091] Updated weights for policy 0, policy_version 1192329 (0.0011) [2023-12-26 09:06:40,305][123090] Updated weights for policy 1, policy_version 1183860 (0.0006) [2023-12-26 09:06:40,375][123090] Updated weights for policy 1, policy_version 1183870 (0.0006) [2023-12-26 09:06:41,009][123091] Updated weights for policy 0, policy_version 1192339 (0.0011) [2023-12-26 09:06:41,083][123091] Updated weights for policy 0, policy_version 1192349 (0.0009) [2023-12-26 09:06:41,098][123090] Updated weights for policy 1, policy_version 1183880 (0.0009) [2023-12-26 09:06:41,156][123091] Updated weights for policy 0, policy_version 1192359 (0.0008) [2023-12-26 09:06:41,175][123090] Updated weights for policy 1, policy_version 1183890 (0.0007) [2023-12-26 09:06:41,242][123090] Updated weights for policy 1, policy_version 1183900 (0.0006) [2023-12-26 09:06:41,934][123090] Updated weights for policy 1, policy_version 1183910 (0.0009) [2023-12-26 09:06:41,975][123091] Updated weights for policy 0, policy_version 1192369 (0.0007) [2023-12-26 09:06:41,989][123090] Updated weights for policy 1, policy_version 1183920 (0.0009) [2023-12-26 09:06:42,038][123091] Updated weights for policy 0, policy_version 1192379 (0.0005) [2023-12-26 09:06:42,047][123090] Updated weights for policy 1, policy_version 1183930 (0.0008) [2023-12-26 09:06:42,101][123091] Updated weights for policy 0, policy_version 1192389 (0.0006) [2023-12-26 09:06:42,164][123091] Updated weights for policy 0, policy_version 1192399 (0.0010) [2023-12-26 09:06:42,866][123090] Updated weights for policy 1, policy_version 1183940 (0.0009) [2023-12-26 09:06:42,927][123091] Updated weights for policy 0, policy_version 1192409 (0.0009) [2023-12-26 09:06:42,928][123090] Updated weights for policy 1, policy_version 1183950 (0.0008) [2023-12-26 09:06:42,977][123090] Updated weights for policy 1, policy_version 1183960 (0.0007) [2023-12-26 09:06:42,993][123091] Updated weights for policy 0, policy_version 1192419 (0.0009) [2023-12-26 09:06:43,057][123091] Updated weights for policy 0, policy_version 1192429 (0.0008) [2023-12-26 09:06:43,619][123090] Updated weights for policy 1, policy_version 1183970 (0.0007) [2023-12-26 09:06:43,666][123090] Updated weights for policy 1, policy_version 1183980 (0.0005) [2023-12-26 09:06:43,718][123090] Updated weights for policy 1, policy_version 1183991 (0.0007) [2023-12-26 09:06:43,751][123091] Updated weights for policy 0, policy_version 1192439 (0.0005) [2023-12-26 09:06:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 608370688. Throughput: 0: 8834.8, 1: 8918.1. Samples: 608361848. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:43,785][121949] Avg episode reward: [(0, '6169.514'), (1, '5609.385')] [2023-12-26 09:06:43,798][123091] Updated weights for policy 0, policy_version 1192449 (0.0005) [2023-12-26 09:06:43,852][123091] Updated weights for policy 0, policy_version 1192459 (0.0005) [2023-12-26 09:06:44,377][123090] Updated weights for policy 1, policy_version 1184001 (0.0005) [2023-12-26 09:06:44,436][123091] Updated weights for policy 0, policy_version 1192469 (0.0006) [2023-12-26 09:06:44,453][123090] Updated weights for policy 1, policy_version 1184011 (0.0005) [2023-12-26 09:06:44,493][123091] Updated weights for policy 0, policy_version 1192479 (0.0007) [2023-12-26 09:06:44,526][123090] Updated weights for policy 1, policy_version 1184021 (0.0006) [2023-12-26 09:06:44,559][123091] Updated weights for policy 0, policy_version 1192489 (0.0008) [2023-12-26 09:06:44,597][123090] Updated weights for policy 1, policy_version 1184031 (0.0009) [2023-12-26 09:06:45,288][123090] Updated weights for policy 1, policy_version 1184041 (0.0011) [2023-12-26 09:06:45,359][123090] Updated weights for policy 1, policy_version 1184051 (0.0011) [2023-12-26 09:06:45,400][123091] Updated weights for policy 0, policy_version 1192499 (0.0007) [2023-12-26 09:06:45,430][123090] Updated weights for policy 1, policy_version 1184061 (0.0011) [2023-12-26 09:06:45,463][123091] Updated weights for policy 0, policy_version 1192509 (0.0008) [2023-12-26 09:06:45,522][123091] Updated weights for policy 0, policy_version 1192519 (0.0009) [2023-12-26 09:06:46,228][123090] Updated weights for policy 1, policy_version 1184071 (0.0010) [2023-12-26 09:06:46,252][123091] Updated weights for policy 0, policy_version 1192529 (0.0009) [2023-12-26 09:06:46,295][123090] Updated weights for policy 1, policy_version 1184081 (0.0011) [2023-12-26 09:06:46,303][123091] Updated weights for policy 0, policy_version 1192539 (0.0005) [2023-12-26 09:06:46,355][123091] Updated weights for policy 0, policy_version 1192549 (0.0005) [2023-12-26 09:06:46,358][123090] Updated weights for policy 1, policy_version 1184091 (0.0010) [2023-12-26 09:06:46,401][123091] Updated weights for policy 0, policy_version 1192559 (0.0006) [2023-12-26 09:06:47,113][123090] Updated weights for policy 1, policy_version 1184101 (0.0010) [2023-12-26 09:06:47,156][123090] Updated weights for policy 1, policy_version 1184111 (0.0010) [2023-12-26 09:06:47,219][123090] Updated weights for policy 1, policy_version 1184121 (0.0010) [2023-12-26 09:06:47,247][123091] Updated weights for policy 0, policy_version 1192569 (0.0006) [2023-12-26 09:06:47,305][123091] Updated weights for policy 0, policy_version 1192579 (0.0008) [2023-12-26 09:06:47,357][123091] Updated weights for policy 0, policy_version 1192589 (0.0009) [2023-12-26 09:06:47,988][123090] Updated weights for policy 1, policy_version 1184131 (0.0009) [2023-12-26 09:06:48,046][123090] Updated weights for policy 1, policy_version 1184141 (0.0006) [2023-12-26 09:06:48,105][123090] Updated weights for policy 1, policy_version 1184151 (0.0009) [2023-12-26 09:06:48,248][123091] Updated weights for policy 0, policy_version 1192599 (0.0009) [2023-12-26 09:06:48,300][123091] Updated weights for policy 0, policy_version 1192609 (0.0009) [2023-12-26 09:06:48,370][123091] Updated weights for policy 0, policy_version 1192619 (0.0009) [2023-12-26 09:06:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 608460800. Throughput: 0: 8920.9, 1: 9037.4. Samples: 608472984. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:48,785][121949] Avg episode reward: [(0, '6185.509'), (1, '5379.780')] [2023-12-26 09:06:48,830][123090] Updated weights for policy 1, policy_version 1184161 (0.0010) [2023-12-26 09:06:48,880][123090] Updated weights for policy 1, policy_version 1184171 (0.0009) [2023-12-26 09:06:48,929][123090] Updated weights for policy 1, policy_version 1184181 (0.0007) [2023-12-26 09:06:48,983][123090] Updated weights for policy 1, policy_version 1184191 (0.0010) [2023-12-26 09:06:49,224][123091] Updated weights for policy 0, policy_version 1192629 (0.0010) [2023-12-26 09:06:49,283][123091] Updated weights for policy 0, policy_version 1192639 (0.0011) [2023-12-26 09:06:49,350][123091] Updated weights for policy 0, policy_version 1192649 (0.0013) [2023-12-26 09:06:49,891][123090] Updated weights for policy 1, policy_version 1184201 (0.0009) [2023-12-26 09:06:49,950][123090] Updated weights for policy 1, policy_version 1184211 (0.0009) [2023-12-26 09:06:50,013][123090] Updated weights for policy 1, policy_version 1184221 (0.0010) [2023-12-26 09:06:50,078][123091] Updated weights for policy 0, policy_version 1192659 (0.0011) [2023-12-26 09:06:50,142][123091] Updated weights for policy 0, policy_version 1192669 (0.0010) [2023-12-26 09:06:50,202][123091] Updated weights for policy 0, policy_version 1192679 (0.0011) [2023-12-26 09:06:50,904][123090] Updated weights for policy 1, policy_version 1184231 (0.0010) [2023-12-26 09:06:50,936][123091] Updated weights for policy 0, policy_version 1192689 (0.0010) [2023-12-26 09:06:50,971][123090] Updated weights for policy 1, policy_version 1184241 (0.0010) [2023-12-26 09:06:51,007][123091] Updated weights for policy 0, policy_version 1192699 (0.0007) [2023-12-26 09:06:51,042][123090] Updated weights for policy 1, policy_version 1184251 (0.0009) [2023-12-26 09:06:51,071][123091] Updated weights for policy 0, policy_version 1192709 (0.0009) [2023-12-26 09:06:51,138][123091] Updated weights for policy 0, policy_version 1192719 (0.0008) [2023-12-26 09:06:51,853][123090] Updated weights for policy 1, policy_version 1184261 (0.0010) [2023-12-26 09:06:51,913][123090] Updated weights for policy 1, policy_version 1184271 (0.0006) [2023-12-26 09:06:51,940][123091] Updated weights for policy 0, policy_version 1192729 (0.0010) [2023-12-26 09:06:51,973][123090] Updated weights for policy 1, policy_version 1184281 (0.0005) [2023-12-26 09:06:52,003][123091] Updated weights for policy 0, policy_version 1192739 (0.0009) [2023-12-26 09:06:52,071][123091] Updated weights for policy 0, policy_version 1192749 (0.0008) [2023-12-26 09:06:52,739][123090] Updated weights for policy 1, policy_version 1184291 (0.0006) [2023-12-26 09:06:52,788][123090] Updated weights for policy 1, policy_version 1184301 (0.0009) [2023-12-26 09:06:52,837][123090] Updated weights for policy 1, policy_version 1184311 (0.0009) [2023-12-26 09:06:52,910][123091] Updated weights for policy 0, policy_version 1192759 (0.0010) [2023-12-26 09:06:52,971][123091] Updated weights for policy 0, policy_version 1192769 (0.0009) [2023-12-26 09:06:53,027][123091] Updated weights for policy 0, policy_version 1192779 (0.0009) [2023-12-26 09:06:53,701][123090] Updated weights for policy 1, policy_version 1184321 (0.0009) [2023-12-26 09:06:53,753][123090] Updated weights for policy 1, policy_version 1184331 (0.0009) [2023-12-26 09:06:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 608542720. Throughput: 0: 8922.6, 1: 8948.0. Samples: 608525396. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:53,785][121949] Avg episode reward: [(0, '6032.797'), (1, '5469.578')] [2023-12-26 09:06:53,817][123090] Updated weights for policy 1, policy_version 1184341 (0.0009) [2023-12-26 09:06:53,819][123091] Updated weights for policy 0, policy_version 1192789 (0.0008) [2023-12-26 09:06:53,867][123090] Updated weights for policy 1, policy_version 1184351 (0.0009) [2023-12-26 09:06:53,871][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001184352_303194112.pth... [2023-12-26 09:06:53,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001183296_302923776.pth [2023-12-26 09:06:53,880][123091] Updated weights for policy 0, policy_version 1192799 (0.0005) [2023-12-26 09:06:53,947][123091] Updated weights for policy 0, policy_version 1192809 (0.0009) [2023-12-26 09:06:53,983][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001192816_305364992.pth... [2023-12-26 09:06:53,988][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001191728_305086464.pth [2023-12-26 09:06:54,735][123090] Updated weights for policy 1, policy_version 1184361 (0.0009) [2023-12-26 09:06:54,736][123091] Updated weights for policy 0, policy_version 1192819 (0.0008) [2023-12-26 09:06:54,784][123090] Updated weights for policy 1, policy_version 1184371 (0.0009) [2023-12-26 09:06:54,788][123091] Updated weights for policy 0, policy_version 1192829 (0.0005) [2023-12-26 09:06:54,842][123090] Updated weights for policy 1, policy_version 1184381 (0.0010) [2023-12-26 09:06:54,848][123091] Updated weights for policy 0, policy_version 1192839 (0.0005) [2023-12-26 09:06:55,513][123091] Updated weights for policy 0, policy_version 1192849 (0.0006) [2023-12-26 09:06:55,564][123091] Updated weights for policy 0, policy_version 1192859 (0.0008) [2023-12-26 09:06:55,614][123091] Updated weights for policy 0, policy_version 1192869 (0.0007) [2023-12-26 09:06:55,658][123091] Updated weights for policy 0, policy_version 1192879 (0.0010) [2023-12-26 09:06:55,720][123090] Updated weights for policy 1, policy_version 1184391 (0.0009) [2023-12-26 09:06:55,780][123090] Updated weights for policy 1, policy_version 1184401 (0.0009) [2023-12-26 09:06:55,843][123090] Updated weights for policy 1, policy_version 1184411 (0.0008) [2023-12-26 09:06:56,497][123091] Updated weights for policy 0, policy_version 1192889 (0.0011) [2023-12-26 09:06:56,559][123091] Updated weights for policy 0, policy_version 1192899 (0.0011) [2023-12-26 09:06:56,620][123091] Updated weights for policy 0, policy_version 1192909 (0.0010) [2023-12-26 09:06:56,676][123090] Updated weights for policy 1, policy_version 1184421 (0.0009) [2023-12-26 09:06:56,735][123090] Updated weights for policy 1, policy_version 1184431 (0.0009) [2023-12-26 09:06:56,795][123090] Updated weights for policy 1, policy_version 1184441 (0.0008) [2023-12-26 09:06:57,285][123091] Updated weights for policy 0, policy_version 1192919 (0.0009) [2023-12-26 09:06:57,333][123091] Updated weights for policy 0, policy_version 1192929 (0.0007) [2023-12-26 09:06:57,385][123091] Updated weights for policy 0, policy_version 1192939 (0.0005) [2023-12-26 09:06:57,548][123090] Updated weights for policy 1, policy_version 1184451 (0.0006) [2023-12-26 09:06:57,608][123090] Updated weights for policy 1, policy_version 1184461 (0.0006) [2023-12-26 09:06:57,678][123090] Updated weights for policy 1, policy_version 1184471 (0.0005) [2023-12-26 09:06:58,170][123091] Updated weights for policy 0, policy_version 1192949 (0.0006) [2023-12-26 09:06:58,238][123091] Updated weights for policy 0, policy_version 1192959 (0.0007) [2023-12-26 09:06:58,299][123091] Updated weights for policy 0, policy_version 1192969 (0.0007) [2023-12-26 09:06:58,381][123090] Updated weights for policy 1, policy_version 1184481 (0.0006) [2023-12-26 09:06:58,442][123090] Updated weights for policy 1, policy_version 1184491 (0.0010) [2023-12-26 09:06:58,510][123090] Updated weights for policy 1, policy_version 1184501 (0.0010) [2023-12-26 09:06:58,574][123090] Updated weights for policy 1, policy_version 1184511 (0.0008) [2023-12-26 09:06:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 608641024. Throughput: 0: 8987.5, 1: 8939.1. Samples: 608632032. Policy #0 lag: (min: 31.0, avg: 35.8, max: 63.0) [2023-12-26 09:06:58,785][121949] Avg episode reward: [(0, '5875.342'), (1, '5515.791')] [2023-12-26 09:06:59,165][123091] Updated weights for policy 0, policy_version 1192979 (0.0009) [2023-12-26 09:06:59,231][123091] Updated weights for policy 0, policy_version 1192989 (0.0009) [2023-12-26 09:06:59,290][123091] Updated weights for policy 0, policy_version 1192999 (0.0009) [2023-12-26 09:06:59,335][123090] Updated weights for policy 1, policy_version 1184521 (0.0008) [2023-12-26 09:06:59,399][123090] Updated weights for policy 1, policy_version 1184531 (0.0009) [2023-12-26 09:06:59,461][123090] Updated weights for policy 1, policy_version 1184541 (0.0010) [2023-12-26 09:07:00,111][123091] Updated weights for policy 0, policy_version 1193009 (0.0009) [2023-12-26 09:07:00,185][123091] Updated weights for policy 0, policy_version 1193019 (0.0006) [2023-12-26 09:07:00,246][123091] Updated weights for policy 0, policy_version 1193029 (0.0005) [2023-12-26 09:07:00,276][123090] Updated weights for policy 1, policy_version 1184551 (0.0009) [2023-12-26 09:07:00,316][123091] Updated weights for policy 0, policy_version 1193039 (0.0005) [2023-12-26 09:07:00,325][123090] Updated weights for policy 1, policy_version 1184561 (0.0008) [2023-12-26 09:07:00,394][123090] Updated weights for policy 1, policy_version 1184571 (0.0007) [2023-12-26 09:07:00,976][123091] Updated weights for policy 0, policy_version 1193049 (0.0005) [2023-12-26 09:07:01,043][123091] Updated weights for policy 0, policy_version 1193059 (0.0006) [2023-12-26 09:07:01,109][123091] Updated weights for policy 0, policy_version 1193069 (0.0010) [2023-12-26 09:07:01,254][123090] Updated weights for policy 1, policy_version 1184581 (0.0007) [2023-12-26 09:07:01,320][123090] Updated weights for policy 1, policy_version 1184591 (0.0008) [2023-12-26 09:07:01,395][123090] Updated weights for policy 1, policy_version 1184601 (0.0008) [2023-12-26 09:07:01,895][123091] Updated weights for policy 0, policy_version 1193079 (0.0009) [2023-12-26 09:07:01,953][123091] Updated weights for policy 0, policy_version 1193089 (0.0009) [2023-12-26 09:07:02,004][123091] Updated weights for policy 0, policy_version 1193099 (0.0009) [2023-12-26 09:07:02,181][123090] Updated weights for policy 1, policy_version 1184611 (0.0008) [2023-12-26 09:07:02,248][123090] Updated weights for policy 1, policy_version 1184621 (0.0009) [2023-12-26 09:07:02,308][123090] Updated weights for policy 1, policy_version 1184631 (0.0009) [2023-12-26 09:07:02,851][123091] Updated weights for policy 0, policy_version 1193109 (0.0010) [2023-12-26 09:07:02,914][123091] Updated weights for policy 0, policy_version 1193119 (0.0009) [2023-12-26 09:07:02,974][123091] Updated weights for policy 0, policy_version 1193129 (0.0010) [2023-12-26 09:07:03,157][123090] Updated weights for policy 1, policy_version 1184641 (0.0009) [2023-12-26 09:07:03,221][123090] Updated weights for policy 1, policy_version 1184651 (0.0008) [2023-12-26 09:07:03,273][123090] Updated weights for policy 1, policy_version 1184661 (0.0009) [2023-12-26 09:07:03,336][123090] Updated weights for policy 1, policy_version 1184671 (0.0009) [2023-12-26 09:07:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 608722944. Throughput: 0: 8962.8, 1: 8872.9. Samples: 608737360. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:03,784][121949] Avg episode reward: [(0, '5935.916'), (1, '5192.932')] [2023-12-26 09:07:03,798][123091] Updated weights for policy 0, policy_version 1193139 (0.0010) [2023-12-26 09:07:03,855][123091] Updated weights for policy 0, policy_version 1193149 (0.0009) [2023-12-26 09:07:03,908][123091] Updated weights for policy 0, policy_version 1193159 (0.0009) [2023-12-26 09:07:04,185][123090] Updated weights for policy 1, policy_version 1184681 (0.0008) [2023-12-26 09:07:04,242][123090] Updated weights for policy 1, policy_version 1184691 (0.0008) [2023-12-26 09:07:04,311][123090] Updated weights for policy 1, policy_version 1184701 (0.0009) [2023-12-26 09:07:04,773][123091] Updated weights for policy 0, policy_version 1193169 (0.0008) [2023-12-26 09:07:04,842][123091] Updated weights for policy 0, policy_version 1193179 (0.0005) [2023-12-26 09:07:04,911][123091] Updated weights for policy 0, policy_version 1193189 (0.0005) [2023-12-26 09:07:04,977][123091] Updated weights for policy 0, policy_version 1193199 (0.0005) [2023-12-26 09:07:05,111][123090] Updated weights for policy 1, policy_version 1184711 (0.0007) [2023-12-26 09:07:05,156][123090] Updated weights for policy 1, policy_version 1184721 (0.0005) [2023-12-26 09:07:05,205][123090] Updated weights for policy 1, policy_version 1184731 (0.0006) [2023-12-26 09:07:05,709][123091] Updated weights for policy 0, policy_version 1193209 (0.0005) [2023-12-26 09:07:05,766][123091] Updated weights for policy 0, policy_version 1193219 (0.0005) [2023-12-26 09:07:05,827][123091] Updated weights for policy 0, policy_version 1193229 (0.0006) [2023-12-26 09:07:05,853][123090] Updated weights for policy 1, policy_version 1184741 (0.0007) [2023-12-26 09:07:05,926][123090] Updated weights for policy 1, policy_version 1184751 (0.0008) [2023-12-26 09:07:05,991][123090] Updated weights for policy 1, policy_version 1184761 (0.0006) [2023-12-26 09:07:06,569][123091] Updated weights for policy 0, policy_version 1193239 (0.0010) [2023-12-26 09:07:06,626][123091] Updated weights for policy 0, policy_version 1193249 (0.0011) [2023-12-26 09:07:06,693][123091] Updated weights for policy 0, policy_version 1193259 (0.0010) [2023-12-26 09:07:06,793][123090] Updated weights for policy 1, policy_version 1184771 (0.0007) [2023-12-26 09:07:06,861][123090] Updated weights for policy 1, policy_version 1184781 (0.0011) [2023-12-26 09:07:06,935][123090] Updated weights for policy 1, policy_version 1184791 (0.0011) [2023-12-26 09:07:07,491][123091] Updated weights for policy 0, policy_version 1193269 (0.0011) [2023-12-26 09:07:07,558][123091] Updated weights for policy 0, policy_version 1193279 (0.0011) [2023-12-26 09:07:07,616][123091] Updated weights for policy 0, policy_version 1193289 (0.0010) [2023-12-26 09:07:07,699][123090] Updated weights for policy 1, policy_version 1184801 (0.0010) [2023-12-26 09:07:07,768][123090] Updated weights for policy 1, policy_version 1184811 (0.0007) [2023-12-26 09:07:07,815][123090] Updated weights for policy 1, policy_version 1184821 (0.0010) [2023-12-26 09:07:07,870][123090] Updated weights for policy 1, policy_version 1184831 (0.0010) [2023-12-26 09:07:08,428][123091] Updated weights for policy 0, policy_version 1193299 (0.0011) [2023-12-26 09:07:08,498][123091] Updated weights for policy 0, policy_version 1193309 (0.0011) [2023-12-26 09:07:08,572][123091] Updated weights for policy 0, policy_version 1193319 (0.0010) [2023-12-26 09:07:08,611][123090] Updated weights for policy 1, policy_version 1184841 (0.0011) [2023-12-26 09:07:08,683][123090] Updated weights for policy 1, policy_version 1184851 (0.0011) [2023-12-26 09:07:08,751][123090] Updated weights for policy 1, policy_version 1184861 (0.0011) [2023-12-26 09:07:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 608821248. Throughput: 0: 9013.6, 1: 8926.5. Samples: 608791772. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:08,784][121949] Avg episode reward: [(0, '6137.254'), (1, '5238.153')] [2023-12-26 09:07:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001193328_305496064.pth... [2023-12-26 09:07:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001184864_303325184.pth... [2023-12-26 09:07:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001192272_305225728.pth [2023-12-26 09:07:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001183808_303054848.pth [2023-12-26 09:07:09,364][123091] Updated weights for policy 0, policy_version 1193329 (0.0009) [2023-12-26 09:07:09,435][123091] Updated weights for policy 0, policy_version 1193339 (0.0008) [2023-12-26 09:07:09,505][123091] Updated weights for policy 0, policy_version 1193349 (0.0006) [2023-12-26 09:07:09,571][123091] Updated weights for policy 0, policy_version 1193359 (0.0008) [2023-12-26 09:07:09,593][123090] Updated weights for policy 1, policy_version 1184871 (0.0010) [2023-12-26 09:07:09,652][123090] Updated weights for policy 1, policy_version 1184881 (0.0010) [2023-12-26 09:07:09,717][123090] Updated weights for policy 1, policy_version 1184891 (0.0010) [2023-12-26 09:07:10,367][123091] Updated weights for policy 0, policy_version 1193369 (0.0009) [2023-12-26 09:07:10,423][123091] Updated weights for policy 0, policy_version 1193379 (0.0010) [2023-12-26 09:07:10,484][123091] Updated weights for policy 0, policy_version 1193389 (0.0009) [2023-12-26 09:07:10,512][123090] Updated weights for policy 1, policy_version 1184901 (0.0010) [2023-12-26 09:07:10,571][123090] Updated weights for policy 1, policy_version 1184911 (0.0010) [2023-12-26 09:07:10,638][123090] Updated weights for policy 1, policy_version 1184921 (0.0010) [2023-12-26 09:07:11,214][123091] Updated weights for policy 0, policy_version 1193399 (0.0009) [2023-12-26 09:07:11,283][123091] Updated weights for policy 0, policy_version 1193409 (0.0008) [2023-12-26 09:07:11,350][123091] Updated weights for policy 0, policy_version 1193419 (0.0008) [2023-12-26 09:07:11,386][123090] Updated weights for policy 1, policy_version 1184931 (0.0009) [2023-12-26 09:07:11,455][123090] Updated weights for policy 1, policy_version 1184941 (0.0009) [2023-12-26 09:07:11,531][123090] Updated weights for policy 1, policy_version 1184951 (0.0006) [2023-12-26 09:07:12,108][123091] Updated weights for policy 0, policy_version 1193429 (0.0010) [2023-12-26 09:07:12,162][123091] Updated weights for policy 0, policy_version 1193439 (0.0011) [2023-12-26 09:07:12,219][123091] Updated weights for policy 0, policy_version 1193449 (0.0011) [2023-12-26 09:07:12,357][123090] Updated weights for policy 1, policy_version 1184961 (0.0008) [2023-12-26 09:07:12,429][123090] Updated weights for policy 1, policy_version 1184971 (0.0006) [2023-12-26 09:07:12,499][123090] Updated weights for policy 1, policy_version 1184981 (0.0008) [2023-12-26 09:07:12,569][123090] Updated weights for policy 1, policy_version 1184991 (0.0009) [2023-12-26 09:07:12,964][123091] Updated weights for policy 0, policy_version 1193459 (0.0011) [2023-12-26 09:07:13,040][123091] Updated weights for policy 0, policy_version 1193469 (0.0005) [2023-12-26 09:07:13,113][123091] Updated weights for policy 0, policy_version 1193479 (0.0006) [2023-12-26 09:07:13,447][123090] Updated weights for policy 1, policy_version 1185001 (0.0009) [2023-12-26 09:07:13,513][123090] Updated weights for policy 1, policy_version 1185011 (0.0010) [2023-12-26 09:07:13,571][123090] Updated weights for policy 1, policy_version 1185021 (0.0010) [2023-12-26 09:07:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 608903168. Throughput: 0: 8939.9, 1: 8829.9. Samples: 608896740. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:13,785][121949] Avg episode reward: [(0, '6204.085'), (1, '5182.240')] [2023-12-26 09:07:13,811][123091] Updated weights for policy 0, policy_version 1193489 (0.0006) [2023-12-26 09:07:13,876][123091] Updated weights for policy 0, policy_version 1193499 (0.0005) [2023-12-26 09:07:13,930][123091] Updated weights for policy 0, policy_version 1193509 (0.0006) [2023-12-26 09:07:13,981][123091] Updated weights for policy 0, policy_version 1193519 (0.0005) [2023-12-26 09:07:14,301][123090] Updated weights for policy 1, policy_version 1185031 (0.0007) [2023-12-26 09:07:14,357][123090] Updated weights for policy 1, policy_version 1185041 (0.0010) [2023-12-26 09:07:14,405][123090] Updated weights for policy 1, policy_version 1185051 (0.0010) [2023-12-26 09:07:14,670][123091] Updated weights for policy 0, policy_version 1193529 (0.0005) [2023-12-26 09:07:14,721][123091] Updated weights for policy 0, policy_version 1193539 (0.0005) [2023-12-26 09:07:14,778][123091] Updated weights for policy 0, policy_version 1193549 (0.0006) [2023-12-26 09:07:15,185][123090] Updated weights for policy 1, policy_version 1185061 (0.0007) [2023-12-26 09:07:15,264][123090] Updated weights for policy 1, policy_version 1185071 (0.0006) [2023-12-26 09:07:15,333][123090] Updated weights for policy 1, policy_version 1185081 (0.0006) [2023-12-26 09:07:15,572][123091] Updated weights for policy 0, policy_version 1193559 (0.0010) [2023-12-26 09:07:15,631][123091] Updated weights for policy 0, policy_version 1193569 (0.0010) [2023-12-26 09:07:15,686][123091] Updated weights for policy 0, policy_version 1193579 (0.0010) [2023-12-26 09:07:15,998][123090] Updated weights for policy 1, policy_version 1185091 (0.0007) [2023-12-26 09:07:16,067][123090] Updated weights for policy 1, policy_version 1185101 (0.0005) [2023-12-26 09:07:16,139][123090] Updated weights for policy 1, policy_version 1185111 (0.0006) [2023-12-26 09:07:16,379][123091] Updated weights for policy 0, policy_version 1193589 (0.0008) [2023-12-26 09:07:16,433][123091] Updated weights for policy 0, policy_version 1193599 (0.0009) [2023-12-26 09:07:16,495][123091] Updated weights for policy 0, policy_version 1193609 (0.0010) [2023-12-26 09:07:16,949][123090] Updated weights for policy 1, policy_version 1185121 (0.0011) [2023-12-26 09:07:17,001][123090] Updated weights for policy 1, policy_version 1185131 (0.0009) [2023-12-26 09:07:17,059][123090] Updated weights for policy 1, policy_version 1185141 (0.0009) [2023-12-26 09:07:17,112][123090] Updated weights for policy 1, policy_version 1185151 (0.0008) [2023-12-26 09:07:17,284][123091] Updated weights for policy 0, policy_version 1193619 (0.0010) [2023-12-26 09:07:17,339][123091] Updated weights for policy 0, policy_version 1193629 (0.0011) [2023-12-26 09:07:17,390][123091] Updated weights for policy 0, policy_version 1193639 (0.0010) [2023-12-26 09:07:17,985][123090] Updated weights for policy 1, policy_version 1185161 (0.0009) [2023-12-26 09:07:18,033][123090] Updated weights for policy 1, policy_version 1185171 (0.0007) [2023-12-26 09:07:18,081][123090] Updated weights for policy 1, policy_version 1185181 (0.0008) [2023-12-26 09:07:18,194][123091] Updated weights for policy 0, policy_version 1193649 (0.0010) [2023-12-26 09:07:18,260][123091] Updated weights for policy 0, policy_version 1193659 (0.0011) [2023-12-26 09:07:18,312][123091] Updated weights for policy 0, policy_version 1193669 (0.0011) [2023-12-26 09:07:18,371][123091] Updated weights for policy 0, policy_version 1193679 (0.0010) [2023-12-26 09:07:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 608993280. Throughput: 0: 9017.3, 1: 8837.4. Samples: 609006236. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:18,785][121949] Avg episode reward: [(0, '6136.533'), (1, '5005.213')] [2023-12-26 09:07:18,963][123090] Updated weights for policy 1, policy_version 1185191 (0.0006) [2023-12-26 09:07:19,029][123090] Updated weights for policy 1, policy_version 1185201 (0.0005) [2023-12-26 09:07:19,091][123090] Updated weights for policy 1, policy_version 1185211 (0.0009) [2023-12-26 09:07:19,140][123091] Updated weights for policy 0, policy_version 1193689 (0.0006) [2023-12-26 09:07:19,209][123091] Updated weights for policy 0, policy_version 1193699 (0.0007) [2023-12-26 09:07:19,284][123091] Updated weights for policy 0, policy_version 1193709 (0.0011) [2023-12-26 09:07:19,879][123090] Updated weights for policy 1, policy_version 1185221 (0.0008) [2023-12-26 09:07:19,947][123090] Updated weights for policy 1, policy_version 1185231 (0.0006) [2023-12-26 09:07:20,017][123091] Updated weights for policy 0, policy_version 1193719 (0.0011) [2023-12-26 09:07:20,019][123090] Updated weights for policy 1, policy_version 1185241 (0.0006) [2023-12-26 09:07:20,081][123091] Updated weights for policy 0, policy_version 1193729 (0.0011) [2023-12-26 09:07:20,146][123091] Updated weights for policy 0, policy_version 1193739 (0.0011) [2023-12-26 09:07:20,683][123090] Updated weights for policy 1, policy_version 1185251 (0.0006) [2023-12-26 09:07:20,754][123090] Updated weights for policy 1, policy_version 1185261 (0.0008) [2023-12-26 09:07:20,829][123090] Updated weights for policy 1, policy_version 1185271 (0.0008) [2023-12-26 09:07:20,945][123091] Updated weights for policy 0, policy_version 1193749 (0.0011) [2023-12-26 09:07:21,006][123091] Updated weights for policy 0, policy_version 1193759 (0.0011) [2023-12-26 09:07:21,083][123091] Updated weights for policy 0, policy_version 1193769 (0.0011) [2023-12-26 09:07:21,667][123090] Updated weights for policy 1, policy_version 1185281 (0.0008) [2023-12-26 09:07:21,733][123090] Updated weights for policy 1, policy_version 1185291 (0.0007) [2023-12-26 09:07:21,791][123090] Updated weights for policy 1, policy_version 1185301 (0.0009) [2023-12-26 09:07:21,850][123090] Updated weights for policy 1, policy_version 1185311 (0.0009) [2023-12-26 09:07:21,944][123091] Updated weights for policy 0, policy_version 1193779 (0.0010) [2023-12-26 09:07:21,999][123091] Updated weights for policy 0, policy_version 1193789 (0.0008) [2023-12-26 09:07:22,059][123091] Updated weights for policy 0, policy_version 1193799 (0.0006) [2023-12-26 09:07:22,683][123090] Updated weights for policy 1, policy_version 1185321 (0.0010) [2023-12-26 09:07:22,750][123090] Updated weights for policy 1, policy_version 1185331 (0.0008) [2023-12-26 09:07:22,814][123090] Updated weights for policy 1, policy_version 1185341 (0.0009) [2023-12-26 09:07:22,875][123091] Updated weights for policy 0, policy_version 1193809 (0.0006) [2023-12-26 09:07:22,942][123091] Updated weights for policy 0, policy_version 1193819 (0.0008) [2023-12-26 09:07:23,012][123091] Updated weights for policy 0, policy_version 1193829 (0.0008) [2023-12-26 09:07:23,083][123091] Updated weights for policy 0, policy_version 1193839 (0.0009) [2023-12-26 09:07:23,647][123090] Updated weights for policy 1, policy_version 1185351 (0.0009) [2023-12-26 09:07:23,714][123090] Updated weights for policy 1, policy_version 1185361 (0.0010) [2023-12-26 09:07:23,770][123090] Updated weights for policy 1, policy_version 1185371 (0.0009) [2023-12-26 09:07:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 609075200. Throughput: 0: 9032.3, 1: 8843.2. Samples: 609059000. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:23,785][121949] Avg episode reward: [(0, '6180.373'), (1, '4891.527')] [2023-12-26 09:07:23,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001185376_303456256.pth... [2023-12-26 09:07:23,807][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001184352_303194112.pth [2023-12-26 09:07:23,824][123091] Updated weights for policy 0, policy_version 1193849 (0.0008) [2023-12-26 09:07:23,889][123091] Updated weights for policy 0, policy_version 1193859 (0.0007) [2023-12-26 09:07:23,951][123091] Updated weights for policy 0, policy_version 1193869 (0.0011) [2023-12-26 09:07:23,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001193872_305635328.pth... [2023-12-26 09:07:23,969][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001192816_305364992.pth [2023-12-26 09:07:24,618][123090] Updated weights for policy 1, policy_version 1185381 (0.0008) [2023-12-26 09:07:24,671][123090] Updated weights for policy 1, policy_version 1185391 (0.0009) [2023-12-26 09:07:24,720][123090] Updated weights for policy 1, policy_version 1185401 (0.0008) [2023-12-26 09:07:24,759][123091] Updated weights for policy 0, policy_version 1193879 (0.0010) [2023-12-26 09:07:24,814][123091] Updated weights for policy 0, policy_version 1193889 (0.0010) [2023-12-26 09:07:24,869][123091] Updated weights for policy 0, policy_version 1193899 (0.0010) [2023-12-26 09:07:25,574][123090] Updated weights for policy 1, policy_version 1185411 (0.0009) [2023-12-26 09:07:25,630][123090] Updated weights for policy 1, policy_version 1185421 (0.0009) [2023-12-26 09:07:25,678][123090] Updated weights for policy 1, policy_version 1185431 (0.0009) [2023-12-26 09:07:25,694][123091] Updated weights for policy 0, policy_version 1193909 (0.0011) [2023-12-26 09:07:25,759][123091] Updated weights for policy 0, policy_version 1193919 (0.0010) [2023-12-26 09:07:25,806][123091] Updated weights for policy 0, policy_version 1193929 (0.0010) [2023-12-26 09:07:26,405][123090] Updated weights for policy 1, policy_version 1185441 (0.0006) [2023-12-26 09:07:26,462][123090] Updated weights for policy 1, policy_version 1185451 (0.0006) [2023-12-26 09:07:26,529][123090] Updated weights for policy 1, policy_version 1185461 (0.0005) [2023-12-26 09:07:26,559][123091] Updated weights for policy 0, policy_version 1193939 (0.0010) [2023-12-26 09:07:26,581][123090] Updated weights for policy 1, policy_version 1185471 (0.0005) [2023-12-26 09:07:26,607][123091] Updated weights for policy 0, policy_version 1193949 (0.0010) [2023-12-26 09:07:26,661][123091] Updated weights for policy 0, policy_version 1193959 (0.0010) [2023-12-26 09:07:27,197][123090] Updated weights for policy 1, policy_version 1185481 (0.0005) [2023-12-26 09:07:27,254][123090] Updated weights for policy 1, policy_version 1185491 (0.0005) [2023-12-26 09:07:27,314][123090] Updated weights for policy 1, policy_version 1185501 (0.0005) [2023-12-26 09:07:27,417][123091] Updated weights for policy 0, policy_version 1193969 (0.0010) [2023-12-26 09:07:27,473][123091] Updated weights for policy 0, policy_version 1193979 (0.0009) [2023-12-26 09:07:27,534][123091] Updated weights for policy 0, policy_version 1193989 (0.0010) [2023-12-26 09:07:27,591][123091] Updated weights for policy 0, policy_version 1193999 (0.0010) [2023-12-26 09:07:28,017][123090] Updated weights for policy 1, policy_version 1185511 (0.0008) [2023-12-26 09:07:28,071][123090] Updated weights for policy 1, policy_version 1185521 (0.0009) [2023-12-26 09:07:28,123][123090] Updated weights for policy 1, policy_version 1185532 (0.0009) [2023-12-26 09:07:28,373][123091] Updated weights for policy 0, policy_version 1194009 (0.0010) [2023-12-26 09:07:28,425][123091] Updated weights for policy 0, policy_version 1194019 (0.0005) [2023-12-26 09:07:28,478][123091] Updated weights for policy 0, policy_version 1194029 (0.0006) [2023-12-26 09:07:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 609173504. Throughput: 0: 9021.0, 1: 8871.3. Samples: 609167000. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:28,785][121949] Avg episode reward: [(0, '6262.783'), (1, '4845.430')] [2023-12-26 09:07:29,023][123090] Updated weights for policy 1, policy_version 1185542 (0.0010) [2023-12-26 09:07:29,089][123090] Updated weights for policy 1, policy_version 1185552 (0.0010) [2023-12-26 09:07:29,143][123090] Updated weights for policy 1, policy_version 1185562 (0.0008) [2023-12-26 09:07:29,159][123091] Updated weights for policy 0, policy_version 1194039 (0.0007) [2023-12-26 09:07:29,221][123091] Updated weights for policy 0, policy_version 1194049 (0.0009) [2023-12-26 09:07:29,292][123091] Updated weights for policy 0, policy_version 1194059 (0.0009) [2023-12-26 09:07:29,976][123090] Updated weights for policy 1, policy_version 1185572 (0.0008) [2023-12-26 09:07:30,032][123090] Updated weights for policy 1, policy_version 1185582 (0.0009) [2023-12-26 09:07:30,088][123090] Updated weights for policy 1, policy_version 1185592 (0.0009) [2023-12-26 09:07:30,135][123091] Updated weights for policy 0, policy_version 1194069 (0.0011) [2023-12-26 09:07:30,193][123091] Updated weights for policy 0, policy_version 1194079 (0.0010) [2023-12-26 09:07:30,264][123091] Updated weights for policy 0, policy_version 1194089 (0.0011) [2023-12-26 09:07:30,964][123090] Updated weights for policy 1, policy_version 1185602 (0.0008) [2023-12-26 09:07:31,016][123090] Updated weights for policy 1, policy_version 1185612 (0.0009) [2023-12-26 09:07:31,021][123091] Updated weights for policy 0, policy_version 1194099 (0.0009) [2023-12-26 09:07:31,075][123090] Updated weights for policy 1, policy_version 1185622 (0.0007) [2023-12-26 09:07:31,089][123091] Updated weights for policy 0, policy_version 1194109 (0.0011) [2023-12-26 09:07:31,138][123090] Updated weights for policy 1, policy_version 1185632 (0.0007) [2023-12-26 09:07:31,176][123091] Updated weights for policy 0, policy_version 1194119 (0.0011) [2023-12-26 09:07:31,861][123091] Updated weights for policy 0, policy_version 1194129 (0.0010) [2023-12-26 09:07:31,902][123090] Updated weights for policy 1, policy_version 1185642 (0.0006) [2023-12-26 09:07:31,922][123091] Updated weights for policy 0, policy_version 1194139 (0.0007) [2023-12-26 09:07:31,960][123090] Updated weights for policy 1, policy_version 1185652 (0.0005) [2023-12-26 09:07:31,984][123091] Updated weights for policy 0, policy_version 1194149 (0.0008) [2023-12-26 09:07:32,013][123090] Updated weights for policy 1, policy_version 1185662 (0.0006) [2023-12-26 09:07:32,038][123091] Updated weights for policy 0, policy_version 1194159 (0.0010) [2023-12-26 09:07:32,731][123090] Updated weights for policy 1, policy_version 1185672 (0.0006) [2023-12-26 09:07:32,792][123090] Updated weights for policy 1, policy_version 1185682 (0.0009) [2023-12-26 09:07:32,847][123090] Updated weights for policy 1, policy_version 1185692 (0.0007) [2023-12-26 09:07:32,872][123091] Updated weights for policy 0, policy_version 1194169 (0.0007) [2023-12-26 09:07:32,936][123091] Updated weights for policy 0, policy_version 1194179 (0.0010) [2023-12-26 09:07:32,984][123091] Updated weights for policy 0, policy_version 1194189 (0.0010) [2023-12-26 09:07:33,572][123090] Updated weights for policy 1, policy_version 1185702 (0.0006) [2023-12-26 09:07:33,617][123090] Updated weights for policy 1, policy_version 1185712 (0.0005) [2023-12-26 09:07:33,658][123091] Updated weights for policy 0, policy_version 1194199 (0.0007) [2023-12-26 09:07:33,670][123090] Updated weights for policy 1, policy_version 1185722 (0.0006) [2023-12-26 09:07:33,702][123091] Updated weights for policy 0, policy_version 1194209 (0.0005) [2023-12-26 09:07:33,752][123091] Updated weights for policy 0, policy_version 1194219 (0.0005) [2023-12-26 09:07:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 609263616. Throughput: 0: 9025.2, 1: 8805.7. Samples: 609275372. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:33,784][121949] Avg episode reward: [(0, '6123.149'), (1, '4985.548')] [2023-12-26 09:07:34,436][123090] Updated weights for policy 1, policy_version 1185732 (0.0009) [2023-12-26 09:07:34,489][123091] Updated weights for policy 0, policy_version 1194229 (0.0008) [2023-12-26 09:07:34,507][123090] Updated weights for policy 1, policy_version 1185742 (0.0011) [2023-12-26 09:07:34,562][123091] Updated weights for policy 0, policy_version 1194239 (0.0007) [2023-12-26 09:07:34,579][123090] Updated weights for policy 1, policy_version 1185752 (0.0011) [2023-12-26 09:07:34,626][123091] Updated weights for policy 0, policy_version 1194249 (0.0007) [2023-12-26 09:07:35,312][123091] Updated weights for policy 0, policy_version 1194259 (0.0007) [2023-12-26 09:07:35,343][123090] Updated weights for policy 1, policy_version 1185762 (0.0009) [2023-12-26 09:07:35,373][123091] Updated weights for policy 0, policy_version 1194269 (0.0010) [2023-12-26 09:07:35,408][123090] Updated weights for policy 1, policy_version 1185772 (0.0005) [2023-12-26 09:07:35,426][123091] Updated weights for policy 0, policy_version 1194279 (0.0008) [2023-12-26 09:07:35,469][123090] Updated weights for policy 1, policy_version 1185782 (0.0005) [2023-12-26 09:07:35,545][123090] Updated weights for policy 1, policy_version 1185792 (0.0007) [2023-12-26 09:07:36,140][123091] Updated weights for policy 0, policy_version 1194289 (0.0008) [2023-12-26 09:07:36,202][123091] Updated weights for policy 0, policy_version 1194299 (0.0006) [2023-12-26 09:07:36,207][123090] Updated weights for policy 1, policy_version 1185802 (0.0011) [2023-12-26 09:07:36,266][123091] Updated weights for policy 0, policy_version 1194309 (0.0008) [2023-12-26 09:07:36,271][123090] Updated weights for policy 1, policy_version 1185812 (0.0011) [2023-12-26 09:07:36,330][123091] Updated weights for policy 0, policy_version 1194319 (0.0007) [2023-12-26 09:07:36,335][123090] Updated weights for policy 1, policy_version 1185822 (0.0011) [2023-12-26 09:07:37,113][123090] Updated weights for policy 1, policy_version 1185832 (0.0010) [2023-12-26 09:07:37,177][123090] Updated weights for policy 1, policy_version 1185842 (0.0009) [2023-12-26 09:07:37,178][123091] Updated weights for policy 0, policy_version 1194329 (0.0009) [2023-12-26 09:07:37,231][123091] Updated weights for policy 0, policy_version 1194339 (0.0011) [2023-12-26 09:07:37,233][123090] Updated weights for policy 1, policy_version 1185852 (0.0005) [2023-12-26 09:07:37,290][123091] Updated weights for policy 0, policy_version 1194349 (0.0011) [2023-12-26 09:07:38,097][123091] Updated weights for policy 0, policy_version 1194359 (0.0007) [2023-12-26 09:07:38,120][123090] Updated weights for policy 1, policy_version 1185862 (0.0008) [2023-12-26 09:07:38,149][123091] Updated weights for policy 0, policy_version 1194369 (0.0005) [2023-12-26 09:07:38,182][123090] Updated weights for policy 1, policy_version 1185872 (0.0009) [2023-12-26 09:07:38,215][123091] Updated weights for policy 0, policy_version 1194379 (0.0006) [2023-12-26 09:07:38,248][123090] Updated weights for policy 1, policy_version 1185882 (0.0007) [2023-12-26 09:07:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 609353728. Throughput: 0: 9049.3, 1: 8876.9. Samples: 609332072. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:38,785][121949] Avg episode reward: [(0, '6086.808'), (1, '5114.128')] [2023-12-26 09:07:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001194384_305766400.pth... [2023-12-26 09:07:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001185888_303587328.pth... [2023-12-26 09:07:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001184864_303325184.pth [2023-12-26 09:07:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001193328_305496064.pth [2023-12-26 09:07:38,998][123091] Updated weights for policy 0, policy_version 1194389 (0.0008) [2023-12-26 09:07:39,063][123091] Updated weights for policy 0, policy_version 1194399 (0.0006) [2023-12-26 09:07:39,108][123090] Updated weights for policy 1, policy_version 1185892 (0.0009) [2023-12-26 09:07:39,125][123091] Updated weights for policy 0, policy_version 1194409 (0.0006) [2023-12-26 09:07:39,177][123090] Updated weights for policy 1, policy_version 1185902 (0.0009) [2023-12-26 09:07:39,242][123090] Updated weights for policy 1, policy_version 1185912 (0.0010) [2023-12-26 09:07:39,876][123091] Updated weights for policy 0, policy_version 1194419 (0.0007) [2023-12-26 09:07:39,940][123091] Updated weights for policy 0, policy_version 1194429 (0.0011) [2023-12-26 09:07:40,012][123091] Updated weights for policy 0, policy_version 1194439 (0.0011) [2023-12-26 09:07:40,062][123090] Updated weights for policy 1, policy_version 1185922 (0.0009) [2023-12-26 09:07:40,134][123090] Updated weights for policy 1, policy_version 1185932 (0.0006) [2023-12-26 09:07:40,205][123090] Updated weights for policy 1, policy_version 1185942 (0.0008) [2023-12-26 09:07:40,279][123090] Updated weights for policy 1, policy_version 1185952 (0.0009) [2023-12-26 09:07:40,807][123091] Updated weights for policy 0, policy_version 1194449 (0.0010) [2023-12-26 09:07:40,872][123091] Updated weights for policy 0, policy_version 1194459 (0.0005) [2023-12-26 09:07:40,938][123091] Updated weights for policy 0, policy_version 1194469 (0.0005) [2023-12-26 09:07:40,966][123090] Updated weights for policy 1, policy_version 1185962 (0.0006) [2023-12-26 09:07:41,007][123091] Updated weights for policy 0, policy_version 1194479 (0.0006) [2023-12-26 09:07:41,031][123090] Updated weights for policy 1, policy_version 1185972 (0.0008) [2023-12-26 09:07:41,106][123090] Updated weights for policy 1, policy_version 1185982 (0.0007) [2023-12-26 09:07:41,830][123091] Updated weights for policy 0, policy_version 1194489 (0.0009) [2023-12-26 09:07:41,858][123090] Updated weights for policy 1, policy_version 1185992 (0.0009) [2023-12-26 09:07:41,891][123091] Updated weights for policy 0, policy_version 1194499 (0.0008) [2023-12-26 09:07:41,915][123090] Updated weights for policy 1, policy_version 1186002 (0.0010) [2023-12-26 09:07:41,956][123091] Updated weights for policy 0, policy_version 1194509 (0.0006) [2023-12-26 09:07:41,992][123090] Updated weights for policy 1, policy_version 1186012 (0.0009) [2023-12-26 09:07:42,679][123091] Updated weights for policy 0, policy_version 1194519 (0.0008) [2023-12-26 09:07:42,737][123091] Updated weights for policy 0, policy_version 1194529 (0.0008) [2023-12-26 09:07:42,787][123091] Updated weights for policy 0, policy_version 1194539 (0.0009) [2023-12-26 09:07:42,880][123090] Updated weights for policy 1, policy_version 1186022 (0.0010) [2023-12-26 09:07:42,935][123090] Updated weights for policy 1, policy_version 1186032 (0.0007) [2023-12-26 09:07:42,987][123090] Updated weights for policy 1, policy_version 1186042 (0.0005) [2023-12-26 09:07:43,571][123091] Updated weights for policy 0, policy_version 1194549 (0.0008) [2023-12-26 09:07:43,630][123091] Updated weights for policy 0, policy_version 1194559 (0.0007) [2023-12-26 09:07:43,679][123091] Updated weights for policy 0, policy_version 1194569 (0.0005) [2023-12-26 09:07:43,761][123090] Updated weights for policy 1, policy_version 1186052 (0.0007) [2023-12-26 09:07:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 609443840. Throughput: 0: 9020.0, 1: 8852.7. Samples: 609436304. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:43,784][121949] Avg episode reward: [(0, '6108.522'), (1, '5132.999')] [2023-12-26 09:07:43,831][123090] Updated weights for policy 1, policy_version 1186062 (0.0010) [2023-12-26 09:07:43,897][123090] Updated weights for policy 1, policy_version 1186072 (0.0010) [2023-12-26 09:07:44,459][123091] Updated weights for policy 0, policy_version 1194579 (0.0007) [2023-12-26 09:07:44,517][123091] Updated weights for policy 0, policy_version 1194589 (0.0009) [2023-12-26 09:07:44,585][123091] Updated weights for policy 0, policy_version 1194599 (0.0009) [2023-12-26 09:07:44,696][123090] Updated weights for policy 1, policy_version 1186082 (0.0008) [2023-12-26 09:07:44,757][123090] Updated weights for policy 1, policy_version 1186092 (0.0009) [2023-12-26 09:07:44,821][123090] Updated weights for policy 1, policy_version 1186102 (0.0010) [2023-12-26 09:07:45,307][123091] Updated weights for policy 0, policy_version 1194609 (0.0010) [2023-12-26 09:07:45,371][123091] Updated weights for policy 0, policy_version 1194619 (0.0011) [2023-12-26 09:07:45,438][123091] Updated weights for policy 0, policy_version 1194629 (0.0011) [2023-12-26 09:07:45,503][123091] Updated weights for policy 0, policy_version 1194639 (0.0006) [2023-12-26 09:07:45,726][123090] Updated weights for policy 1, policy_version 1186113 (0.0009) [2023-12-26 09:07:45,786][123090] Updated weights for policy 1, policy_version 1186123 (0.0010) [2023-12-26 09:07:45,838][123090] Updated weights for policy 1, policy_version 1186133 (0.0010) [2023-12-26 09:07:45,907][123090] Updated weights for policy 1, policy_version 1186143 (0.0006) [2023-12-26 09:07:46,252][123091] Updated weights for policy 0, policy_version 1194649 (0.0007) [2023-12-26 09:07:46,312][123091] Updated weights for policy 0, policy_version 1194659 (0.0011) [2023-12-26 09:07:46,374][123091] Updated weights for policy 0, policy_version 1194669 (0.0010) [2023-12-26 09:07:46,685][123090] Updated weights for policy 1, policy_version 1186153 (0.0005) [2023-12-26 09:07:46,737][123090] Updated weights for policy 1, policy_version 1186163 (0.0005) [2023-12-26 09:07:46,793][123090] Updated weights for policy 1, policy_version 1186173 (0.0006) [2023-12-26 09:07:47,060][123091] Updated weights for policy 0, policy_version 1194679 (0.0007) [2023-12-26 09:07:47,118][123091] Updated weights for policy 0, policy_version 1194689 (0.0005) [2023-12-26 09:07:47,177][123091] Updated weights for policy 0, policy_version 1194699 (0.0007) [2023-12-26 09:07:47,514][123090] Updated weights for policy 1, policy_version 1186183 (0.0008) [2023-12-26 09:07:47,562][123090] Updated weights for policy 1, policy_version 1186193 (0.0008) [2023-12-26 09:07:47,609][123090] Updated weights for policy 1, policy_version 1186203 (0.0008) [2023-12-26 09:07:47,952][123091] Updated weights for policy 0, policy_version 1194709 (0.0010) [2023-12-26 09:07:48,007][123091] Updated weights for policy 0, policy_version 1194719 (0.0010) [2023-12-26 09:07:48,062][123091] Updated weights for policy 0, policy_version 1194729 (0.0011) [2023-12-26 09:07:48,492][123090] Updated weights for policy 1, policy_version 1186213 (0.0010) [2023-12-26 09:07:48,558][123090] Updated weights for policy 1, policy_version 1186223 (0.0010) [2023-12-26 09:07:48,630][123090] Updated weights for policy 1, policy_version 1186233 (0.0005) [2023-12-26 09:07:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 609533952. Throughput: 0: 9086.9, 1: 8860.2. Samples: 609544984. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:48,785][121949] Avg episode reward: [(0, '6179.888'), (1, '5096.525')] [2023-12-26 09:07:48,900][123091] Updated weights for policy 0, policy_version 1194739 (0.0010) [2023-12-26 09:07:48,960][123091] Updated weights for policy 0, policy_version 1194749 (0.0010) [2023-12-26 09:07:49,012][123091] Updated weights for policy 0, policy_version 1194759 (0.0010) [2023-12-26 09:07:49,359][123090] Updated weights for policy 1, policy_version 1186243 (0.0006) [2023-12-26 09:07:49,433][123090] Updated weights for policy 1, policy_version 1186253 (0.0009) [2023-12-26 09:07:49,498][123090] Updated weights for policy 1, policy_version 1186263 (0.0009) [2023-12-26 09:07:49,895][123091] Updated weights for policy 0, policy_version 1194769 (0.0011) [2023-12-26 09:07:49,960][123091] Updated weights for policy 0, policy_version 1194779 (0.0008) [2023-12-26 09:07:50,019][123091] Updated weights for policy 0, policy_version 1194789 (0.0008) [2023-12-26 09:07:50,082][123091] Updated weights for policy 0, policy_version 1194799 (0.0008) [2023-12-26 09:07:50,348][123090] Updated weights for policy 1, policy_version 1186273 (0.0009) [2023-12-26 09:07:50,411][123090] Updated weights for policy 1, policy_version 1186283 (0.0007) [2023-12-26 09:07:50,481][123090] Updated weights for policy 1, policy_version 1186293 (0.0005) [2023-12-26 09:07:50,545][123090] Updated weights for policy 1, policy_version 1186303 (0.0006) [2023-12-26 09:07:50,809][123091] Updated weights for policy 0, policy_version 1194809 (0.0006) [2023-12-26 09:07:50,886][123091] Updated weights for policy 0, policy_version 1194819 (0.0005) [2023-12-26 09:07:50,964][123091] Updated weights for policy 0, policy_version 1194829 (0.0006) [2023-12-26 09:07:51,337][123090] Updated weights for policy 1, policy_version 1186313 (0.0009) [2023-12-26 09:07:51,410][123090] Updated weights for policy 1, policy_version 1186323 (0.0010) [2023-12-26 09:07:51,472][123090] Updated weights for policy 1, policy_version 1186333 (0.0009) [2023-12-26 09:07:51,661][123091] Updated weights for policy 0, policy_version 1194839 (0.0008) [2023-12-26 09:07:51,730][123091] Updated weights for policy 0, policy_version 1194849 (0.0009) [2023-12-26 09:07:51,791][123091] Updated weights for policy 0, policy_version 1194859 (0.0010) [2023-12-26 09:07:52,308][123090] Updated weights for policy 1, policy_version 1186343 (0.0010) [2023-12-26 09:07:52,377][123090] Updated weights for policy 1, policy_version 1186353 (0.0010) [2023-12-26 09:07:52,432][123090] Updated weights for policy 1, policy_version 1186363 (0.0008) [2023-12-26 09:07:52,585][123091] Updated weights for policy 0, policy_version 1194869 (0.0010) [2023-12-26 09:07:52,654][123091] Updated weights for policy 0, policy_version 1194879 (0.0009) [2023-12-26 09:07:52,718][123091] Updated weights for policy 0, policy_version 1194889 (0.0009) [2023-12-26 09:07:53,243][123090] Updated weights for policy 1, policy_version 1186373 (0.0009) [2023-12-26 09:07:53,318][123090] Updated weights for policy 1, policy_version 1186383 (0.0009) [2023-12-26 09:07:53,373][123090] Updated weights for policy 1, policy_version 1186393 (0.0008) [2023-12-26 09:07:53,459][123091] Updated weights for policy 0, policy_version 1194899 (0.0009) [2023-12-26 09:07:53,525][123091] Updated weights for policy 0, policy_version 1194909 (0.0010) [2023-12-26 09:07:53,580][123091] Updated weights for policy 0, policy_version 1194919 (0.0010) [2023-12-26 09:07:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17883.6). Total num frames: 609624064. Throughput: 0: 9083.8, 1: 8831.6. Samples: 609597968. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:53,785][121949] Avg episode reward: [(0, '6091.297'), (1, '5246.618')] [2023-12-26 09:07:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001186400_303718400.pth... [2023-12-26 09:07:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001194928_305905664.pth... [2023-12-26 09:07:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001193872_305635328.pth [2023-12-26 09:07:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001185376_303456256.pth [2023-12-26 09:07:54,101][123090] Updated weights for policy 1, policy_version 1186403 (0.0009) [2023-12-26 09:07:54,167][123090] Updated weights for policy 1, policy_version 1186413 (0.0009) [2023-12-26 09:07:54,223][123090] Updated weights for policy 1, policy_version 1186425 (0.0010) [2023-12-26 09:07:54,342][123091] Updated weights for policy 0, policy_version 1194929 (0.0010) [2023-12-26 09:07:54,396][123091] Updated weights for policy 0, policy_version 1194939 (0.0010) [2023-12-26 09:07:54,450][123091] Updated weights for policy 0, policy_version 1194949 (0.0009) [2023-12-26 09:07:54,500][123091] Updated weights for policy 0, policy_version 1194959 (0.0010) [2023-12-26 09:07:55,102][123090] Updated weights for policy 1, policy_version 1186435 (0.0010) [2023-12-26 09:07:55,175][123090] Updated weights for policy 1, policy_version 1186445 (0.0010) [2023-12-26 09:07:55,227][123090] Updated weights for policy 1, policy_version 1186455 (0.0010) [2023-12-26 09:07:55,372][123091] Updated weights for policy 0, policy_version 1194969 (0.0009) [2023-12-26 09:07:55,420][123091] Updated weights for policy 0, policy_version 1194979 (0.0009) [2023-12-26 09:07:55,469][123091] Updated weights for policy 0, policy_version 1194989 (0.0009) [2023-12-26 09:07:55,956][123090] Updated weights for policy 1, policy_version 1186465 (0.0010) [2023-12-26 09:07:56,015][123090] Updated weights for policy 1, policy_version 1186476 (0.0007) [2023-12-26 09:07:56,067][123090] Updated weights for policy 1, policy_version 1186486 (0.0009) [2023-12-26 09:07:56,131][123090] Updated weights for policy 1, policy_version 1186496 (0.0010) [2023-12-26 09:07:56,383][123091] Updated weights for policy 0, policy_version 1194999 (0.0009) [2023-12-26 09:07:56,433][123091] Updated weights for policy 0, policy_version 1195009 (0.0008) [2023-12-26 09:07:56,489][123091] Updated weights for policy 0, policy_version 1195019 (0.0009) [2023-12-26 09:07:56,869][123090] Updated weights for policy 1, policy_version 1186506 (0.0005) [2023-12-26 09:07:56,921][123090] Updated weights for policy 1, policy_version 1186516 (0.0005) [2023-12-26 09:07:56,975][123090] Updated weights for policy 1, policy_version 1186526 (0.0005) [2023-12-26 09:07:57,407][123091] Updated weights for policy 0, policy_version 1195029 (0.0010) [2023-12-26 09:07:57,457][123091] Updated weights for policy 0, policy_version 1195040 (0.0011) [2023-12-26 09:07:57,506][123091] Updated weights for policy 0, policy_version 1195050 (0.0009) [2023-12-26 09:07:57,724][123090] Updated weights for policy 1, policy_version 1186536 (0.0009) [2023-12-26 09:07:57,787][123090] Updated weights for policy 1, policy_version 1186546 (0.0005) [2023-12-26 09:07:57,852][123090] Updated weights for policy 1, policy_version 1186556 (0.0005) [2023-12-26 09:07:58,384][123091] Updated weights for policy 0, policy_version 1195060 (0.0008) [2023-12-26 09:07:58,458][123091] Updated weights for policy 0, policy_version 1195070 (0.0007) [2023-12-26 09:07:58,531][123091] Updated weights for policy 0, policy_version 1195080 (0.0008) [2023-12-26 09:07:58,617][123090] Updated weights for policy 1, policy_version 1186566 (0.0007) [2023-12-26 09:07:58,695][123090] Updated weights for policy 1, policy_version 1186576 (0.0009) [2023-12-26 09:07:58,764][123090] Updated weights for policy 1, policy_version 1186586 (0.0008) [2023-12-26 09:07:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 609705984. Throughput: 0: 9023.0, 1: 8887.4. Samples: 609702704. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:07:58,785][121949] Avg episode reward: [(0, '5953.776'), (1, '5300.855')] [2023-12-26 09:07:59,270][123091] Updated weights for policy 0, policy_version 1195090 (0.0008) [2023-12-26 09:07:59,329][123091] Updated weights for policy 0, policy_version 1195100 (0.0007) [2023-12-26 09:07:59,397][123091] Updated weights for policy 0, policy_version 1195110 (0.0007) [2023-12-26 09:07:59,455][123091] Updated weights for policy 0, policy_version 1195120 (0.0006) [2023-12-26 09:07:59,575][123090] Updated weights for policy 1, policy_version 1186596 (0.0007) [2023-12-26 09:07:59,635][123090] Updated weights for policy 1, policy_version 1186606 (0.0005) [2023-12-26 09:07:59,690][123090] Updated weights for policy 1, policy_version 1186616 (0.0005) [2023-12-26 09:08:00,184][123091] Updated weights for policy 0, policy_version 1195130 (0.0005) [2023-12-26 09:08:00,250][123091] Updated weights for policy 0, policy_version 1195140 (0.0007) [2023-12-26 09:08:00,318][123091] Updated weights for policy 0, policy_version 1195150 (0.0008) [2023-12-26 09:08:00,545][123090] Updated weights for policy 1, policy_version 1186626 (0.0009) [2023-12-26 09:08:00,601][123090] Updated weights for policy 1, policy_version 1186636 (0.0010) [2023-12-26 09:08:00,653][123090] Updated weights for policy 1, policy_version 1186646 (0.0010) [2023-12-26 09:08:00,711][123090] Updated weights for policy 1, policy_version 1186656 (0.0010) [2023-12-26 09:08:00,986][123091] Updated weights for policy 0, policy_version 1195160 (0.0007) [2023-12-26 09:08:01,042][123091] Updated weights for policy 0, policy_version 1195170 (0.0008) [2023-12-26 09:08:01,111][123091] Updated weights for policy 0, policy_version 1195180 (0.0009) [2023-12-26 09:08:01,603][123090] Updated weights for policy 1, policy_version 1186666 (0.0006) [2023-12-26 09:08:01,676][123090] Updated weights for policy 1, policy_version 1186676 (0.0010) [2023-12-26 09:08:01,751][123090] Updated weights for policy 1, policy_version 1186686 (0.0010) [2023-12-26 09:08:01,875][123091] Updated weights for policy 0, policy_version 1195190 (0.0010) [2023-12-26 09:08:01,934][123091] Updated weights for policy 0, policy_version 1195200 (0.0009) [2023-12-26 09:08:01,998][123091] Updated weights for policy 0, policy_version 1195210 (0.0009) [2023-12-26 09:08:02,564][123090] Updated weights for policy 1, policy_version 1186696 (0.0009) [2023-12-26 09:08:02,628][123090] Updated weights for policy 1, policy_version 1186706 (0.0009) [2023-12-26 09:08:02,692][123090] Updated weights for policy 1, policy_version 1186716 (0.0009) [2023-12-26 09:08:02,812][123091] Updated weights for policy 0, policy_version 1195220 (0.0010) [2023-12-26 09:08:02,871][123091] Updated weights for policy 0, policy_version 1195230 (0.0009) [2023-12-26 09:08:02,935][123091] Updated weights for policy 0, policy_version 1195240 (0.0009) [2023-12-26 09:08:03,578][123090] Updated weights for policy 1, policy_version 1186726 (0.0010) [2023-12-26 09:08:03,602][123091] Updated weights for policy 0, policy_version 1195250 (0.0009) [2023-12-26 09:08:03,639][123090] Updated weights for policy 1, policy_version 1186736 (0.0008) [2023-12-26 09:08:03,667][123091] Updated weights for policy 0, policy_version 1195260 (0.0005) [2023-12-26 09:08:03,691][123090] Updated weights for policy 1, policy_version 1186746 (0.0008) [2023-12-26 09:08:03,732][123091] Updated weights for policy 0, policy_version 1195270 (0.0009) [2023-12-26 09:08:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 609796096. Throughput: 0: 9018.2, 1: 8824.1. Samples: 609809140. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:03,785][121949] Avg episode reward: [(0, '6016.081'), (1, '5387.962')] [2023-12-26 09:08:03,795][123091] Updated weights for policy 0, policy_version 1195280 (0.0011) [2023-12-26 09:08:04,569][123090] Updated weights for policy 1, policy_version 1186756 (0.0009) [2023-12-26 09:08:04,605][123091] Updated weights for policy 0, policy_version 1195290 (0.0011) [2023-12-26 09:08:04,625][123090] Updated weights for policy 1, policy_version 1186766 (0.0005) [2023-12-26 09:08:04,668][123091] Updated weights for policy 0, policy_version 1195300 (0.0011) [2023-12-26 09:08:04,687][123090] Updated weights for policy 1, policy_version 1186776 (0.0010) [2023-12-26 09:08:04,727][123091] Updated weights for policy 0, policy_version 1195310 (0.0011) [2023-12-26 09:08:05,366][123090] Updated weights for policy 1, policy_version 1186786 (0.0006) [2023-12-26 09:08:05,426][123090] Updated weights for policy 1, policy_version 1186796 (0.0005) [2023-12-26 09:08:05,496][123090] Updated weights for policy 1, policy_version 1186806 (0.0009) [2023-12-26 09:08:05,519][123091] Updated weights for policy 0, policy_version 1195320 (0.0011) [2023-12-26 09:08:05,558][123090] Updated weights for policy 1, policy_version 1186816 (0.0010) [2023-12-26 09:08:05,567][123091] Updated weights for policy 0, policy_version 1195330 (0.0010) [2023-12-26 09:08:05,619][123091] Updated weights for policy 0, policy_version 1195340 (0.0006) [2023-12-26 09:08:06,262][123090] Updated weights for policy 1, policy_version 1186826 (0.0008) [2023-12-26 09:08:06,312][123091] Updated weights for policy 0, policy_version 1195350 (0.0007) [2023-12-26 09:08:06,318][123090] Updated weights for policy 1, policy_version 1186836 (0.0009) [2023-12-26 09:08:06,374][123091] Updated weights for policy 0, policy_version 1195360 (0.0007) [2023-12-26 09:08:06,391][123090] Updated weights for policy 1, policy_version 1186846 (0.0007) [2023-12-26 09:08:06,443][123091] Updated weights for policy 0, policy_version 1195370 (0.0009) [2023-12-26 09:08:07,164][123091] Updated weights for policy 0, policy_version 1195380 (0.0008) [2023-12-26 09:08:07,183][123090] Updated weights for policy 1, policy_version 1186856 (0.0006) [2023-12-26 09:08:07,220][123091] Updated weights for policy 0, policy_version 1195390 (0.0011) [2023-12-26 09:08:07,241][123090] Updated weights for policy 1, policy_version 1186866 (0.0009) [2023-12-26 09:08:07,284][123091] Updated weights for policy 0, policy_version 1195400 (0.0011) [2023-12-26 09:08:07,305][123090] Updated weights for policy 1, policy_version 1186876 (0.0010) [2023-12-26 09:08:08,066][123091] Updated weights for policy 0, policy_version 1195410 (0.0010) [2023-12-26 09:08:08,087][123090] Updated weights for policy 1, policy_version 1186886 (0.0008) [2023-12-26 09:08:08,117][123091] Updated weights for policy 0, policy_version 1195420 (0.0010) [2023-12-26 09:08:08,155][123090] Updated weights for policy 1, policy_version 1186896 (0.0005) [2023-12-26 09:08:08,168][123091] Updated weights for policy 0, policy_version 1195430 (0.0010) [2023-12-26 09:08:08,222][123090] Updated weights for policy 1, policy_version 1186906 (0.0005) [2023-12-26 09:08:08,235][123091] Updated weights for policy 0, policy_version 1195440 (0.0011) [2023-12-26 09:08:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 609886208. Throughput: 0: 9048.9, 1: 8818.5. Samples: 609863040. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:08,785][121949] Avg episode reward: [(0, '6197.104'), (1, '5463.052')] [2023-12-26 09:08:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001186912_303849472.pth... [2023-12-26 09:08:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001195440_306036736.pth... [2023-12-26 09:08:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001185888_303587328.pth [2023-12-26 09:08:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001194384_305766400.pth [2023-12-26 09:08:08,922][123090] Updated weights for policy 1, policy_version 1186916 (0.0007) [2023-12-26 09:08:08,983][123090] Updated weights for policy 1, policy_version 1186926 (0.0010) [2023-12-26 09:08:09,011][123091] Updated weights for policy 0, policy_version 1195450 (0.0007) [2023-12-26 09:08:09,035][123090] Updated weights for policy 1, policy_version 1186936 (0.0010) [2023-12-26 09:08:09,072][123091] Updated weights for policy 0, policy_version 1195460 (0.0006) [2023-12-26 09:08:09,151][123091] Updated weights for policy 0, policy_version 1195471 (0.0007) [2023-12-26 09:08:09,873][123090] Updated weights for policy 1, policy_version 1186946 (0.0010) [2023-12-26 09:08:09,945][123090] Updated weights for policy 1, policy_version 1186956 (0.0008) [2023-12-26 09:08:10,018][123090] Updated weights for policy 1, policy_version 1186966 (0.0008) [2023-12-26 09:08:10,035][123091] Updated weights for policy 0, policy_version 1195481 (0.0008) [2023-12-26 09:08:10,085][123090] Updated weights for policy 1, policy_version 1186976 (0.0008) [2023-12-26 09:08:10,102][123091] Updated weights for policy 0, policy_version 1195491 (0.0008) [2023-12-26 09:08:10,162][123091] Updated weights for policy 0, policy_version 1195501 (0.0009) [2023-12-26 09:08:10,798][123090] Updated weights for policy 1, policy_version 1186986 (0.0006) [2023-12-26 09:08:10,864][123090] Updated weights for policy 1, policy_version 1186996 (0.0010) [2023-12-26 09:08:10,927][123090] Updated weights for policy 1, policy_version 1187006 (0.0010) [2023-12-26 09:08:11,069][123091] Updated weights for policy 0, policy_version 1195511 (0.0009) [2023-12-26 09:08:11,139][123091] Updated weights for policy 0, policy_version 1195521 (0.0015) [2023-12-26 09:08:11,207][123091] Updated weights for policy 0, policy_version 1195531 (0.0010) [2023-12-26 09:08:11,794][123090] Updated weights for policy 1, policy_version 1187016 (0.0009) [2023-12-26 09:08:11,866][123090] Updated weights for policy 1, policy_version 1187026 (0.0008) [2023-12-26 09:08:11,939][123090] Updated weights for policy 1, policy_version 1187036 (0.0011) [2023-12-26 09:08:12,059][123091] Updated weights for policy 0, policy_version 1195541 (0.0008) [2023-12-26 09:08:12,128][123091] Updated weights for policy 0, policy_version 1195551 (0.0007) [2023-12-26 09:08:12,189][123091] Updated weights for policy 0, policy_version 1195561 (0.0009) [2023-12-26 09:08:12,725][123090] Updated weights for policy 1, policy_version 1187046 (0.0010) [2023-12-26 09:08:12,781][123090] Updated weights for policy 1, policy_version 1187056 (0.0010) [2023-12-26 09:08:12,829][123090] Updated weights for policy 1, policy_version 1187066 (0.0010) [2023-12-26 09:08:12,883][123091] Updated weights for policy 0, policy_version 1195571 (0.0007) [2023-12-26 09:08:12,949][123091] Updated weights for policy 0, policy_version 1195581 (0.0009) [2023-12-26 09:08:13,015][123091] Updated weights for policy 0, policy_version 1195591 (0.0010) [2023-12-26 09:08:13,542][123090] Updated weights for policy 1, policy_version 1187076 (0.0008) [2023-12-26 09:08:13,596][123090] Updated weights for policy 1, policy_version 1187086 (0.0005) [2023-12-26 09:08:13,652][123090] Updated weights for policy 1, policy_version 1187096 (0.0006) [2023-12-26 09:08:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 609976320. Throughput: 0: 9002.9, 1: 8812.0. Samples: 609968672. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:13,785][121949] Avg episode reward: [(0, '6129.929'), (1, '5458.830')] [2023-12-26 09:08:13,874][123091] Updated weights for policy 0, policy_version 1195601 (0.0010) [2023-12-26 09:08:13,940][123091] Updated weights for policy 0, policy_version 1195611 (0.0009) [2023-12-26 09:08:13,995][123091] Updated weights for policy 0, policy_version 1195621 (0.0005) [2023-12-26 09:08:14,053][123091] Updated weights for policy 0, policy_version 1195631 (0.0009) [2023-12-26 09:08:14,493][123090] Updated weights for policy 1, policy_version 1187106 (0.0009) [2023-12-26 09:08:14,556][123090] Updated weights for policy 1, policy_version 1187116 (0.0009) [2023-12-26 09:08:14,623][123090] Updated weights for policy 1, policy_version 1187126 (0.0008) [2023-12-26 09:08:14,677][123090] Updated weights for policy 1, policy_version 1187136 (0.0009) [2023-12-26 09:08:14,845][123091] Updated weights for policy 0, policy_version 1195641 (0.0009) [2023-12-26 09:08:14,912][123091] Updated weights for policy 0, policy_version 1195651 (0.0010) [2023-12-26 09:08:14,974][123091] Updated weights for policy 0, policy_version 1195661 (0.0009) [2023-12-26 09:08:15,444][123090] Updated weights for policy 1, policy_version 1187146 (0.0010) [2023-12-26 09:08:15,500][123090] Updated weights for policy 1, policy_version 1187156 (0.0008) [2023-12-26 09:08:15,558][123090] Updated weights for policy 1, policy_version 1187166 (0.0007) [2023-12-26 09:08:15,841][123091] Updated weights for policy 0, policy_version 1195671 (0.0007) [2023-12-26 09:08:15,923][123091] Updated weights for policy 0, policy_version 1195681 (0.0007) [2023-12-26 09:08:15,992][123091] Updated weights for policy 0, policy_version 1195691 (0.0010) [2023-12-26 09:08:16,320][123090] Updated weights for policy 1, policy_version 1187176 (0.0010) [2023-12-26 09:08:16,372][123090] Updated weights for policy 1, policy_version 1187186 (0.0009) [2023-12-26 09:08:16,423][123090] Updated weights for policy 1, policy_version 1187196 (0.0009) [2023-12-26 09:08:16,669][123091] Updated weights for policy 0, policy_version 1195701 (0.0010) [2023-12-26 09:08:16,734][123091] Updated weights for policy 0, policy_version 1195711 (0.0009) [2023-12-26 09:08:16,798][123091] Updated weights for policy 0, policy_version 1195721 (0.0009) [2023-12-26 09:08:17,284][123090] Updated weights for policy 1, policy_version 1187206 (0.0009) [2023-12-26 09:08:17,333][123090] Updated weights for policy 1, policy_version 1187216 (0.0009) [2023-12-26 09:08:17,387][123090] Updated weights for policy 1, policy_version 1187226 (0.0010) [2023-12-26 09:08:17,625][123091] Updated weights for policy 0, policy_version 1195731 (0.0009) [2023-12-26 09:08:17,675][123091] Updated weights for policy 0, policy_version 1195741 (0.0009) [2023-12-26 09:08:17,722][123091] Updated weights for policy 0, policy_version 1195751 (0.0009) [2023-12-26 09:08:18,259][123090] Updated weights for policy 1, policy_version 1187236 (0.0008) [2023-12-26 09:08:18,306][123090] Updated weights for policy 1, policy_version 1187246 (0.0009) [2023-12-26 09:08:18,371][123090] Updated weights for policy 1, policy_version 1187256 (0.0010) [2023-12-26 09:08:18,537][123091] Updated weights for policy 0, policy_version 1195761 (0.0009) [2023-12-26 09:08:18,586][123091] Updated weights for policy 0, policy_version 1195771 (0.0009) [2023-12-26 09:08:18,640][123091] Updated weights for policy 0, policy_version 1195781 (0.0007) [2023-12-26 09:08:18,711][123091] Updated weights for policy 0, policy_version 1195791 (0.0007) [2023-12-26 09:08:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 610066432. Throughput: 0: 8948.2, 1: 8806.0. Samples: 610074312. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:18,785][121949] Avg episode reward: [(0, '6148.835'), (1, '5398.654')] [2023-12-26 09:08:19,213][123090] Updated weights for policy 1, policy_version 1187266 (0.0010) [2023-12-26 09:08:19,284][123090] Updated weights for policy 1, policy_version 1187276 (0.0011) [2023-12-26 09:08:19,344][123090] Updated weights for policy 1, policy_version 1187286 (0.0011) [2023-12-26 09:08:19,415][123090] Updated weights for policy 1, policy_version 1187296 (0.0011) [2023-12-26 09:08:19,553][123091] Updated weights for policy 0, policy_version 1195801 (0.0009) [2023-12-26 09:08:19,628][123091] Updated weights for policy 0, policy_version 1195811 (0.0008) [2023-12-26 09:08:19,700][123091] Updated weights for policy 0, policy_version 1195821 (0.0009) [2023-12-26 09:08:20,258][123090] Updated weights for policy 1, policy_version 1187306 (0.0011) [2023-12-26 09:08:20,326][123090] Updated weights for policy 1, policy_version 1187316 (0.0010) [2023-12-26 09:08:20,399][123090] Updated weights for policy 1, policy_version 1187326 (0.0011) [2023-12-26 09:08:20,574][123091] Updated weights for policy 0, policy_version 1195831 (0.0009) [2023-12-26 09:08:20,638][123091] Updated weights for policy 0, policy_version 1195841 (0.0010) [2023-12-26 09:08:20,707][123091] Updated weights for policy 0, policy_version 1195851 (0.0010) [2023-12-26 09:08:21,220][123090] Updated weights for policy 1, policy_version 1187336 (0.0011) [2023-12-26 09:08:21,290][123090] Updated weights for policy 1, policy_version 1187346 (0.0008) [2023-12-26 09:08:21,357][123090] Updated weights for policy 1, policy_version 1187356 (0.0008) [2023-12-26 09:08:21,609][123091] Updated weights for policy 0, policy_version 1195861 (0.0008) [2023-12-26 09:08:21,683][123091] Updated weights for policy 0, policy_version 1195871 (0.0007) [2023-12-26 09:08:21,755][123091] Updated weights for policy 0, policy_version 1195881 (0.0008) [2023-12-26 09:08:22,194][123090] Updated weights for policy 1, policy_version 1187366 (0.0010) [2023-12-26 09:08:22,259][123090] Updated weights for policy 1, policy_version 1187376 (0.0011) [2023-12-26 09:08:22,320][123090] Updated weights for policy 1, policy_version 1187386 (0.0011) [2023-12-26 09:08:22,615][123091] Updated weights for policy 0, policy_version 1195891 (0.0009) [2023-12-26 09:08:22,667][123091] Updated weights for policy 0, policy_version 1195901 (0.0007) [2023-12-26 09:08:22,737][123091] Updated weights for policy 0, policy_version 1195911 (0.0005) [2023-12-26 09:08:23,056][123090] Updated weights for policy 1, policy_version 1187396 (0.0008) [2023-12-26 09:08:23,125][123090] Updated weights for policy 1, policy_version 1187406 (0.0005) [2023-12-26 09:08:23,191][123090] Updated weights for policy 1, policy_version 1187416 (0.0009) [2023-12-26 09:08:23,383][123091] Updated weights for policy 0, policy_version 1195921 (0.0006) [2023-12-26 09:08:23,444][123091] Updated weights for policy 0, policy_version 1195931 (0.0010) [2023-12-26 09:08:23,499][123091] Updated weights for policy 0, policy_version 1195941 (0.0010) [2023-12-26 09:08:23,550][123091] Updated weights for policy 0, policy_version 1195951 (0.0010) [2023-12-26 09:08:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 610148352. Throughput: 0: 8864.9, 1: 8729.7. Samples: 610123828. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:23,785][121949] Avg episode reward: [(0, '6287.139'), (1, '5448.910')] [2023-12-26 09:08:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001187424_303980544.pth... [2023-12-26 09:08:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001195952_306167808.pth... [2023-12-26 09:08:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001186400_303718400.pth [2023-12-26 09:08:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001194928_305905664.pth [2023-12-26 09:08:24,022][123090] Updated weights for policy 1, policy_version 1187426 (0.0010) [2023-12-26 09:08:24,085][123090] Updated weights for policy 1, policy_version 1187436 (0.0010) [2023-12-26 09:08:24,138][123090] Updated weights for policy 1, policy_version 1187446 (0.0009) [2023-12-26 09:08:24,205][123090] Updated weights for policy 1, policy_version 1187456 (0.0007) [2023-12-26 09:08:24,266][123091] Updated weights for policy 0, policy_version 1195961 (0.0010) [2023-12-26 09:08:24,336][123091] Updated weights for policy 0, policy_version 1195971 (0.0009) [2023-12-26 09:08:24,403][123091] Updated weights for policy 0, policy_version 1195981 (0.0010) [2023-12-26 09:08:24,984][123090] Updated weights for policy 1, policy_version 1187466 (0.0005) [2023-12-26 09:08:25,049][123090] Updated weights for policy 1, policy_version 1187476 (0.0008) [2023-12-26 09:08:25,114][123090] Updated weights for policy 1, policy_version 1187486 (0.0009) [2023-12-26 09:08:25,240][123091] Updated weights for policy 0, policy_version 1195991 (0.0009) [2023-12-26 09:08:25,299][123091] Updated weights for policy 0, policy_version 1196001 (0.0010) [2023-12-26 09:08:25,350][123091] Updated weights for policy 0, policy_version 1196011 (0.0009) [2023-12-26 09:08:25,847][123090] Updated weights for policy 1, policy_version 1187496 (0.0006) [2023-12-26 09:08:25,901][123090] Updated weights for policy 1, policy_version 1187506 (0.0005) [2023-12-26 09:08:25,974][123090] Updated weights for policy 1, policy_version 1187516 (0.0005) [2023-12-26 09:08:26,184][123091] Updated weights for policy 0, policy_version 1196021 (0.0009) [2023-12-26 09:08:26,248][123091] Updated weights for policy 0, policy_version 1196031 (0.0008) [2023-12-26 09:08:26,314][123091] Updated weights for policy 0, policy_version 1196041 (0.0010) [2023-12-26 09:08:26,734][123090] Updated weights for policy 1, policy_version 1187526 (0.0006) [2023-12-26 09:08:26,817][123090] Updated weights for policy 1, policy_version 1187536 (0.0005) [2023-12-26 09:08:26,889][123090] Updated weights for policy 1, policy_version 1187546 (0.0005) [2023-12-26 09:08:27,174][123091] Updated weights for policy 0, policy_version 1196051 (0.0009) [2023-12-26 09:08:27,232][123091] Updated weights for policy 0, policy_version 1196062 (0.0009) [2023-12-26 09:08:27,290][123091] Updated weights for policy 0, policy_version 1196072 (0.0010) [2023-12-26 09:08:27,461][123090] Updated weights for policy 1, policy_version 1187556 (0.0005) [2023-12-26 09:08:27,519][123090] Updated weights for policy 1, policy_version 1187566 (0.0006) [2023-12-26 09:08:27,570][123090] Updated weights for policy 1, policy_version 1187576 (0.0008) [2023-12-26 09:08:27,997][123091] Updated weights for policy 0, policy_version 1196082 (0.0008) [2023-12-26 09:08:28,049][123091] Updated weights for policy 0, policy_version 1196092 (0.0006) [2023-12-26 09:08:28,104][123091] Updated weights for policy 0, policy_version 1196102 (0.0005) [2023-12-26 09:08:28,153][123091] Updated weights for policy 0, policy_version 1196112 (0.0005) [2023-12-26 09:08:28,325][123090] Updated weights for policy 1, policy_version 1187587 (0.0009) [2023-12-26 09:08:28,390][123090] Updated weights for policy 1, policy_version 1187597 (0.0007) [2023-12-26 09:08:28,458][123090] Updated weights for policy 1, policy_version 1187607 (0.0006) [2023-12-26 09:08:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 610238464. Throughput: 0: 8839.5, 1: 8823.5. Samples: 610231136. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:28,784][121949] Avg episode reward: [(0, '6343.263'), (1, '5622.215')] [2023-12-26 09:08:28,844][123091] Updated weights for policy 0, policy_version 1196122 (0.0011) [2023-12-26 09:08:28,889][123091] Updated weights for policy 0, policy_version 1196132 (0.0008) [2023-12-26 09:08:28,934][123091] Updated weights for policy 0, policy_version 1196142 (0.0005) [2023-12-26 09:08:29,074][123090] Updated weights for policy 1, policy_version 1187617 (0.0005) [2023-12-26 09:08:29,125][123090] Updated weights for policy 1, policy_version 1187627 (0.0009) [2023-12-26 09:08:29,174][123090] Updated weights for policy 1, policy_version 1187637 (0.0009) [2023-12-26 09:08:29,229][123090] Updated weights for policy 1, policy_version 1187647 (0.0009) [2023-12-26 09:08:29,764][123091] Updated weights for policy 0, policy_version 1196152 (0.0010) [2023-12-26 09:08:29,834][123091] Updated weights for policy 0, policy_version 1196162 (0.0010) [2023-12-26 09:08:29,897][123091] Updated weights for policy 0, policy_version 1196172 (0.0010) [2023-12-26 09:08:30,117][123090] Updated weights for policy 1, policy_version 1187657 (0.0006) [2023-12-26 09:08:30,195][123090] Updated weights for policy 1, policy_version 1187667 (0.0006) [2023-12-26 09:08:30,267][123090] Updated weights for policy 1, policy_version 1187677 (0.0006) [2023-12-26 09:08:30,664][123091] Updated weights for policy 0, policy_version 1196182 (0.0010) [2023-12-26 09:08:30,717][123091] Updated weights for policy 0, policy_version 1196192 (0.0010) [2023-12-26 09:08:30,767][123091] Updated weights for policy 0, policy_version 1196202 (0.0010) [2023-12-26 09:08:30,990][123090] Updated weights for policy 1, policy_version 1187687 (0.0008) [2023-12-26 09:08:31,056][123090] Updated weights for policy 1, policy_version 1187697 (0.0009) [2023-12-26 09:08:31,118][123090] Updated weights for policy 1, policy_version 1187707 (0.0009) [2023-12-26 09:08:31,580][123091] Updated weights for policy 0, policy_version 1196212 (0.0009) [2023-12-26 09:08:31,644][123091] Updated weights for policy 0, policy_version 1196222 (0.0009) [2023-12-26 09:08:31,694][123091] Updated weights for policy 0, policy_version 1196232 (0.0006) [2023-12-26 09:08:31,994][123090] Updated weights for policy 1, policy_version 1187717 (0.0009) [2023-12-26 09:08:32,050][123090] Updated weights for policy 1, policy_version 1187727 (0.0008) [2023-12-26 09:08:32,102][123090] Updated weights for policy 1, policy_version 1187737 (0.0008) [2023-12-26 09:08:32,448][123091] Updated weights for policy 0, policy_version 1196242 (0.0007) [2023-12-26 09:08:32,515][123091] Updated weights for policy 0, policy_version 1196252 (0.0011) [2023-12-26 09:08:32,562][123091] Updated weights for policy 0, policy_version 1196262 (0.0010) [2023-12-26 09:08:32,616][123091] Updated weights for policy 0, policy_version 1196272 (0.0010) [2023-12-26 09:08:32,946][123090] Updated weights for policy 1, policy_version 1187747 (0.0008) [2023-12-26 09:08:32,992][123090] Updated weights for policy 1, policy_version 1187757 (0.0005) [2023-12-26 09:08:33,052][123090] Updated weights for policy 1, policy_version 1187767 (0.0005) [2023-12-26 09:08:33,469][123091] Updated weights for policy 0, policy_version 1196282 (0.0010) [2023-12-26 09:08:33,523][123091] Updated weights for policy 0, policy_version 1196292 (0.0010) [2023-12-26 09:08:33,588][123091] Updated weights for policy 0, policy_version 1196302 (0.0010) [2023-12-26 09:08:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 610328576. Throughput: 0: 8816.1, 1: 8864.0. Samples: 610340588. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:33,784][121949] Avg episode reward: [(0, '6195.313'), (1, '5657.501')] [2023-12-26 09:08:33,803][123090] Updated weights for policy 1, policy_version 1187777 (0.0005) [2023-12-26 09:08:33,851][123090] Updated weights for policy 1, policy_version 1187787 (0.0005) [2023-12-26 09:08:33,897][123090] Updated weights for policy 1, policy_version 1187797 (0.0005) [2023-12-26 09:08:33,941][123090] Updated weights for policy 1, policy_version 1187807 (0.0005) [2023-12-26 09:08:34,398][123091] Updated weights for policy 0, policy_version 1196312 (0.0010) [2023-12-26 09:08:34,446][123091] Updated weights for policy 0, policy_version 1196322 (0.0010) [2023-12-26 09:08:34,503][123091] Updated weights for policy 0, policy_version 1196332 (0.0011) [2023-12-26 09:08:34,714][123090] Updated weights for policy 1, policy_version 1187817 (0.0006) [2023-12-26 09:08:34,769][123090] Updated weights for policy 1, policy_version 1187827 (0.0006) [2023-12-26 09:08:34,824][123090] Updated weights for policy 1, policy_version 1187837 (0.0006) [2023-12-26 09:08:35,353][123091] Updated weights for policy 0, policy_version 1196342 (0.0011) [2023-12-26 09:08:35,405][123091] Updated weights for policy 0, policy_version 1196352 (0.0010) [2023-12-26 09:08:35,466][123091] Updated weights for policy 0, policy_version 1196362 (0.0010) [2023-12-26 09:08:35,614][123090] Updated weights for policy 1, policy_version 1187847 (0.0009) [2023-12-26 09:08:35,661][123090] Updated weights for policy 1, policy_version 1187857 (0.0006) [2023-12-26 09:08:35,717][123090] Updated weights for policy 1, policy_version 1187867 (0.0005) [2023-12-26 09:08:36,287][123091] Updated weights for policy 0, policy_version 1196372 (0.0011) [2023-12-26 09:08:36,335][123091] Updated weights for policy 0, policy_version 1196382 (0.0010) [2023-12-26 09:08:36,390][123091] Updated weights for policy 0, policy_version 1196392 (0.0010) [2023-12-26 09:08:36,521][123090] Updated weights for policy 1, policy_version 1187877 (0.0007) [2023-12-26 09:08:36,586][123090] Updated weights for policy 1, policy_version 1187887 (0.0008) [2023-12-26 09:08:36,649][123090] Updated weights for policy 1, policy_version 1187897 (0.0009) [2023-12-26 09:08:37,228][123091] Updated weights for policy 0, policy_version 1196402 (0.0011) [2023-12-26 09:08:37,279][123091] Updated weights for policy 0, policy_version 1196412 (0.0010) [2023-12-26 09:08:37,327][123091] Updated weights for policy 0, policy_version 1196422 (0.0010) [2023-12-26 09:08:37,374][123091] Updated weights for policy 0, policy_version 1196432 (0.0010) [2023-12-26 09:08:37,483][123090] Updated weights for policy 1, policy_version 1187907 (0.0009) [2023-12-26 09:08:37,544][123090] Updated weights for policy 1, policy_version 1187917 (0.0009) [2023-12-26 09:08:37,610][123090] Updated weights for policy 1, policy_version 1187927 (0.0005) [2023-12-26 09:08:38,111][123091] Updated weights for policy 0, policy_version 1196442 (0.0005) [2023-12-26 09:08:38,184][123091] Updated weights for policy 0, policy_version 1196452 (0.0006) [2023-12-26 09:08:38,266][123091] Updated weights for policy 0, policy_version 1196462 (0.0005) [2023-12-26 09:08:38,498][123090] Updated weights for policy 1, policy_version 1187937 (0.0008) [2023-12-26 09:08:38,570][123090] Updated weights for policy 1, policy_version 1187947 (0.0008) [2023-12-26 09:08:38,647][123090] Updated weights for policy 1, policy_version 1187957 (0.0005) [2023-12-26 09:08:38,719][123090] Updated weights for policy 1, policy_version 1187967 (0.0009) [2023-12-26 09:08:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 610418688. Throughput: 0: 8787.6, 1: 8881.0. Samples: 610393056. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:38,785][121949] Avg episode reward: [(0, '6197.933'), (1, '5618.646')] [2023-12-26 09:08:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001196464_306298880.pth... [2023-12-26 09:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001187968_304119808.pth... [2023-12-26 09:08:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001195440_306036736.pth [2023-12-26 09:08:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001186912_303849472.pth [2023-12-26 09:08:39,020][123091] Updated weights for policy 0, policy_version 1196472 (0.0009) [2023-12-26 09:08:39,093][123091] Updated weights for policy 0, policy_version 1196482 (0.0009) [2023-12-26 09:08:39,160][123091] Updated weights for policy 0, policy_version 1196492 (0.0009) [2023-12-26 09:08:39,470][123090] Updated weights for policy 1, policy_version 1187977 (0.0009) [2023-12-26 09:08:39,527][123090] Updated weights for policy 1, policy_version 1187987 (0.0010) [2023-12-26 09:08:39,593][123090] Updated weights for policy 1, policy_version 1187997 (0.0010) [2023-12-26 09:08:40,071][123091] Updated weights for policy 0, policy_version 1196502 (0.0010) [2023-12-26 09:08:40,138][123091] Updated weights for policy 0, policy_version 1196512 (0.0011) [2023-12-26 09:08:40,203][123091] Updated weights for policy 0, policy_version 1196522 (0.0010) [2023-12-26 09:08:40,351][123090] Updated weights for policy 1, policy_version 1188007 (0.0007) [2023-12-26 09:08:40,407][123090] Updated weights for policy 1, policy_version 1188017 (0.0007) [2023-12-26 09:08:40,462][123090] Updated weights for policy 1, policy_version 1188027 (0.0008) [2023-12-26 09:08:41,053][123091] Updated weights for policy 0, policy_version 1196532 (0.0010) [2023-12-26 09:08:41,129][123091] Updated weights for policy 0, policy_version 1196542 (0.0009) [2023-12-26 09:08:41,190][123091] Updated weights for policy 0, policy_version 1196552 (0.0009) [2023-12-26 09:08:41,343][123090] Updated weights for policy 1, policy_version 1188037 (0.0010) [2023-12-26 09:08:41,412][123090] Updated weights for policy 1, policy_version 1188047 (0.0009) [2023-12-26 09:08:41,472][123090] Updated weights for policy 1, policy_version 1188057 (0.0010) [2023-12-26 09:08:42,023][123091] Updated weights for policy 0, policy_version 1196562 (0.0010) [2023-12-26 09:08:42,091][123091] Updated weights for policy 0, policy_version 1196572 (0.0011) [2023-12-26 09:08:42,159][123091] Updated weights for policy 0, policy_version 1196582 (0.0011) [2023-12-26 09:08:42,227][123091] Updated weights for policy 0, policy_version 1196592 (0.0011) [2023-12-26 09:08:42,380][123090] Updated weights for policy 1, policy_version 1188067 (0.0009) [2023-12-26 09:08:42,435][123090] Updated weights for policy 1, policy_version 1188077 (0.0009) [2023-12-26 09:08:42,485][123090] Updated weights for policy 1, policy_version 1188087 (0.0008) [2023-12-26 09:08:43,067][123091] Updated weights for policy 0, policy_version 1196602 (0.0010) [2023-12-26 09:08:43,114][123091] Updated weights for policy 0, policy_version 1196612 (0.0010) [2023-12-26 09:08:43,158][123091] Updated weights for policy 0, policy_version 1196622 (0.0010) [2023-12-26 09:08:43,256][123090] Updated weights for policy 1, policy_version 1188097 (0.0008) [2023-12-26 09:08:43,304][123090] Updated weights for policy 1, policy_version 1188107 (0.0009) [2023-12-26 09:08:43,357][123090] Updated weights for policy 1, policy_version 1188117 (0.0008) [2023-12-26 09:08:43,405][123090] Updated weights for policy 1, policy_version 1188127 (0.0009) [2023-12-26 09:08:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 610500608. Throughput: 0: 8821.7, 1: 8769.5. Samples: 610494312. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:43,785][121949] Avg episode reward: [(0, '6228.017'), (1, '5546.621')] [2023-12-26 09:08:43,964][123091] Updated weights for policy 0, policy_version 1196632 (0.0006) [2023-12-26 09:08:44,026][123091] Updated weights for policy 0, policy_version 1196642 (0.0006) [2023-12-26 09:08:44,092][123091] Updated weights for policy 0, policy_version 1196652 (0.0008) [2023-12-26 09:08:44,321][123090] Updated weights for policy 1, policy_version 1188137 (0.0009) [2023-12-26 09:08:44,384][123090] Updated weights for policy 1, policy_version 1188147 (0.0008) [2023-12-26 09:08:44,440][123090] Updated weights for policy 1, policy_version 1188157 (0.0009) [2023-12-26 09:08:44,798][123091] Updated weights for policy 0, policy_version 1196662 (0.0008) [2023-12-26 09:08:44,863][123091] Updated weights for policy 0, policy_version 1196672 (0.0009) [2023-12-26 09:08:44,927][123091] Updated weights for policy 0, policy_version 1196682 (0.0010) [2023-12-26 09:08:45,274][123090] Updated weights for policy 1, policy_version 1188167 (0.0009) [2023-12-26 09:08:45,335][123090] Updated weights for policy 1, policy_version 1188177 (0.0010) [2023-12-26 09:08:45,399][123090] Updated weights for policy 1, policy_version 1188187 (0.0009) [2023-12-26 09:08:45,696][123091] Updated weights for policy 0, policy_version 1196692 (0.0010) [2023-12-26 09:08:45,763][123091] Updated weights for policy 0, policy_version 1196702 (0.0008) [2023-12-26 09:08:45,818][123091] Updated weights for policy 0, policy_version 1196712 (0.0005) [2023-12-26 09:08:46,257][123090] Updated weights for policy 1, policy_version 1188197 (0.0007) [2023-12-26 09:08:46,325][123090] Updated weights for policy 1, policy_version 1188207 (0.0005) [2023-12-26 09:08:46,396][123090] Updated weights for policy 1, policy_version 1188217 (0.0007) [2023-12-26 09:08:46,406][123091] Updated weights for policy 0, policy_version 1196722 (0.0006) [2023-12-26 09:08:46,473][123091] Updated weights for policy 0, policy_version 1196732 (0.0006) [2023-12-26 09:08:46,526][123091] Updated weights for policy 0, policy_version 1196742 (0.0005) [2023-12-26 09:08:46,589][123091] Updated weights for policy 0, policy_version 1196752 (0.0007) [2023-12-26 09:08:47,083][123090] Updated weights for policy 1, policy_version 1188227 (0.0007) [2023-12-26 09:08:47,149][123090] Updated weights for policy 1, policy_version 1188237 (0.0005) [2023-12-26 09:08:47,222][123090] Updated weights for policy 1, policy_version 1188247 (0.0005) [2023-12-26 09:08:47,265][123091] Updated weights for policy 0, policy_version 1196762 (0.0010) [2023-12-26 09:08:47,323][123091] Updated weights for policy 0, policy_version 1196772 (0.0010) [2023-12-26 09:08:47,389][123091] Updated weights for policy 0, policy_version 1196782 (0.0010) [2023-12-26 09:08:48,024][123090] Updated weights for policy 1, policy_version 1188257 (0.0005) [2023-12-26 09:08:48,087][123090] Updated weights for policy 1, policy_version 1188267 (0.0008) [2023-12-26 09:08:48,103][123091] Updated weights for policy 0, policy_version 1196792 (0.0010) [2023-12-26 09:08:48,158][123090] Updated weights for policy 1, policy_version 1188277 (0.0007) [2023-12-26 09:08:48,161][123091] Updated weights for policy 0, policy_version 1196802 (0.0007) [2023-12-26 09:08:48,218][123090] Updated weights for policy 1, policy_version 1188287 (0.0009) [2023-12-26 09:08:48,220][123091] Updated weights for policy 0, policy_version 1196812 (0.0006) [2023-12-26 09:08:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 610590720. Throughput: 0: 8849.9, 1: 8817.6. Samples: 610604180. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:48,785][121949] Avg episode reward: [(0, '6095.434'), (1, '5512.943')] [2023-12-26 09:08:48,998][123091] Updated weights for policy 0, policy_version 1196822 (0.0007) [2023-12-26 09:08:49,055][123091] Updated weights for policy 0, policy_version 1196832 (0.0007) [2023-12-26 09:08:49,074][123090] Updated weights for policy 1, policy_version 1188297 (0.0010) [2023-12-26 09:08:49,103][123091] Updated weights for policy 0, policy_version 1196842 (0.0006) [2023-12-26 09:08:49,124][123090] Updated weights for policy 1, policy_version 1188307 (0.0009) [2023-12-26 09:08:49,177][123090] Updated weights for policy 1, policy_version 1188317 (0.0010) [2023-12-26 09:08:49,880][123091] Updated weights for policy 0, policy_version 1196852 (0.0007) [2023-12-26 09:08:49,945][123091] Updated weights for policy 0, policy_version 1196862 (0.0010) [2023-12-26 09:08:50,012][123091] Updated weights for policy 0, policy_version 1196872 (0.0010) [2023-12-26 09:08:50,071][123090] Updated weights for policy 1, policy_version 1188327 (0.0009) [2023-12-26 09:08:50,141][123090] Updated weights for policy 1, policy_version 1188337 (0.0009) [2023-12-26 09:08:50,210][123090] Updated weights for policy 1, policy_version 1188347 (0.0010) [2023-12-26 09:08:50,810][123091] Updated weights for policy 0, policy_version 1196882 (0.0007) [2023-12-26 09:08:50,863][123091] Updated weights for policy 0, policy_version 1196893 (0.0010) [2023-12-26 09:08:50,915][123091] Updated weights for policy 0, policy_version 1196903 (0.0009) [2023-12-26 09:08:51,037][123090] Updated weights for policy 1, policy_version 1188357 (0.0009) [2023-12-26 09:08:51,102][123090] Updated weights for policy 1, policy_version 1188367 (0.0009) [2023-12-26 09:08:51,157][123090] Updated weights for policy 1, policy_version 1188377 (0.0009) [2023-12-26 09:08:51,784][123091] Updated weights for policy 0, policy_version 1196913 (0.0009) [2023-12-26 09:08:51,857][123091] Updated weights for policy 0, policy_version 1196923 (0.0006) [2023-12-26 09:08:51,925][123091] Updated weights for policy 0, policy_version 1196933 (0.0006) [2023-12-26 09:08:51,975][123091] Updated weights for policy 0, policy_version 1196943 (0.0009) [2023-12-26 09:08:52,014][123090] Updated weights for policy 1, policy_version 1188387 (0.0009) [2023-12-26 09:08:52,084][123090] Updated weights for policy 1, policy_version 1188397 (0.0011) [2023-12-26 09:08:52,158][123090] Updated weights for policy 1, policy_version 1188407 (0.0011) [2023-12-26 09:08:52,742][123091] Updated weights for policy 0, policy_version 1196953 (0.0009) [2023-12-26 09:08:52,795][123091] Updated weights for policy 0, policy_version 1196963 (0.0009) [2023-12-26 09:08:52,852][123091] Updated weights for policy 0, policy_version 1196973 (0.0009) [2023-12-26 09:08:52,975][123090] Updated weights for policy 1, policy_version 1188417 (0.0011) [2023-12-26 09:08:53,049][123090] Updated weights for policy 1, policy_version 1188427 (0.0011) [2023-12-26 09:08:53,108][123090] Updated weights for policy 1, policy_version 1188437 (0.0010) [2023-12-26 09:08:53,172][123090] Updated weights for policy 1, policy_version 1188447 (0.0011) [2023-12-26 09:08:53,695][123091] Updated weights for policy 0, policy_version 1196983 (0.0009) [2023-12-26 09:08:53,743][123091] Updated weights for policy 0, policy_version 1196993 (0.0009) [2023-12-26 09:08:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.1, 300 sec: 17828.0). Total num frames: 610672640. Throughput: 0: 8825.2, 1: 8786.3. Samples: 610655560. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:53,786][121949] Avg episode reward: [(0, '6080.408'), (1, '5440.007')] [2023-12-26 09:08:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001188448_304242688.pth... [2023-12-26 09:08:53,793][123091] Updated weights for policy 0, policy_version 1197003 (0.0009) [2023-12-26 09:08:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001187424_303980544.pth [2023-12-26 09:08:53,813][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001197008_306438144.pth... [2023-12-26 09:08:53,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001195952_306167808.pth [2023-12-26 09:08:53,964][123090] Updated weights for policy 1, policy_version 1188457 (0.0009) [2023-12-26 09:08:54,021][123090] Updated weights for policy 1, policy_version 1188467 (0.0009) [2023-12-26 09:08:54,085][123090] Updated weights for policy 1, policy_version 1188477 (0.0008) [2023-12-26 09:08:54,673][123091] Updated weights for policy 0, policy_version 1197014 (0.0010) [2023-12-26 09:08:54,723][123091] Updated weights for policy 0, policy_version 1197024 (0.0009) [2023-12-26 09:08:54,785][123091] Updated weights for policy 0, policy_version 1197034 (0.0010) [2023-12-26 09:08:54,918][123090] Updated weights for policy 1, policy_version 1188487 (0.0009) [2023-12-26 09:08:54,989][123090] Updated weights for policy 1, policy_version 1188497 (0.0009) [2023-12-26 09:08:55,055][123090] Updated weights for policy 1, policy_version 1188507 (0.0010) [2023-12-26 09:08:55,642][123091] Updated weights for policy 0, policy_version 1197044 (0.0009) [2023-12-26 09:08:55,694][123091] Updated weights for policy 0, policy_version 1197055 (0.0009) [2023-12-26 09:08:55,741][123091] Updated weights for policy 0, policy_version 1197065 (0.0008) [2023-12-26 09:08:55,873][123090] Updated weights for policy 1, policy_version 1188517 (0.0010) [2023-12-26 09:08:55,935][123090] Updated weights for policy 1, policy_version 1188527 (0.0010) [2023-12-26 09:08:55,984][123090] Updated weights for policy 1, policy_version 1188537 (0.0010) [2023-12-26 09:08:56,623][123091] Updated weights for policy 0, policy_version 1197075 (0.0009) [2023-12-26 09:08:56,676][123091] Updated weights for policy 0, policy_version 1197085 (0.0009) [2023-12-26 09:08:56,697][123090] Updated weights for policy 1, policy_version 1188547 (0.0009) [2023-12-26 09:08:56,724][123091] Updated weights for policy 0, policy_version 1197095 (0.0008) [2023-12-26 09:08:56,752][123090] Updated weights for policy 1, policy_version 1188557 (0.0005) [2023-12-26 09:08:56,808][123090] Updated weights for policy 1, policy_version 1188567 (0.0005) [2023-12-26 09:08:57,370][123090] Updated weights for policy 1, policy_version 1188577 (0.0005) [2023-12-26 09:08:57,429][123090] Updated weights for policy 1, policy_version 1188587 (0.0005) [2023-12-26 09:08:57,485][123090] Updated weights for policy 1, policy_version 1188597 (0.0005) [2023-12-26 09:08:57,535][123090] Updated weights for policy 1, policy_version 1188607 (0.0005) [2023-12-26 09:08:57,567][123091] Updated weights for policy 0, policy_version 1197105 (0.0008) [2023-12-26 09:08:57,612][123091] Updated weights for policy 0, policy_version 1197115 (0.0005) [2023-12-26 09:08:57,660][123091] Updated weights for policy 0, policy_version 1197125 (0.0005) [2023-12-26 09:08:57,708][123091] Updated weights for policy 0, policy_version 1197135 (0.0005) [2023-12-26 09:08:58,363][123090] Updated weights for policy 1, policy_version 1188617 (0.0007) [2023-12-26 09:08:58,435][123090] Updated weights for policy 1, policy_version 1188627 (0.0008) [2023-12-26 09:08:58,452][123091] Updated weights for policy 0, policy_version 1197145 (0.0007) [2023-12-26 09:08:58,499][123090] Updated weights for policy 1, policy_version 1188637 (0.0008) [2023-12-26 09:08:58,528][123091] Updated weights for policy 0, policy_version 1197155 (0.0010) [2023-12-26 09:08:58,588][123091] Updated weights for policy 0, policy_version 1197165 (0.0011) [2023-12-26 09:08:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 17748.8, 300 sec: 17883.4). Total num frames: 610770944. Throughput: 0: 8807.6, 1: 8792.9. Samples: 610760724. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 09:08:58,787][121949] Avg episode reward: [(0, '6182.213'), (1, '5390.438')] [2023-12-26 09:08:59,421][123090] Updated weights for policy 1, policy_version 1188647 (0.0008) [2023-12-26 09:08:59,426][123091] Updated weights for policy 0, policy_version 1197175 (0.0011) [2023-12-26 09:08:59,471][123090] Updated weights for policy 1, policy_version 1188657 (0.0009) [2023-12-26 09:08:59,485][123091] Updated weights for policy 0, policy_version 1197185 (0.0010) [2023-12-26 09:08:59,535][123090] Updated weights for policy 1, policy_version 1188667 (0.0006) [2023-12-26 09:08:59,546][123091] Updated weights for policy 0, policy_version 1197195 (0.0011) [2023-12-26 09:09:00,351][123090] Updated weights for policy 1, policy_version 1188677 (0.0005) [2023-12-26 09:09:00,397][123091] Updated weights for policy 0, policy_version 1197205 (0.0010) [2023-12-26 09:09:00,413][123090] Updated weights for policy 1, policy_version 1188687 (0.0008) [2023-12-26 09:09:00,458][123091] Updated weights for policy 0, policy_version 1197215 (0.0009) [2023-12-26 09:09:00,477][123090] Updated weights for policy 1, policy_version 1188697 (0.0008) [2023-12-26 09:09:00,518][123091] Updated weights for policy 0, policy_version 1197225 (0.0009) [2023-12-26 09:09:01,300][123090] Updated weights for policy 1, policy_version 1188707 (0.0007) [2023-12-26 09:09:01,354][123091] Updated weights for policy 0, policy_version 1197235 (0.0009) [2023-12-26 09:09:01,366][123090] Updated weights for policy 1, policy_version 1188717 (0.0008) [2023-12-26 09:09:01,421][123091] Updated weights for policy 0, policy_version 1197245 (0.0009) [2023-12-26 09:09:01,433][123090] Updated weights for policy 1, policy_version 1188727 (0.0009) [2023-12-26 09:09:01,482][123091] Updated weights for policy 0, policy_version 1197255 (0.0006) [2023-12-26 09:09:02,182][123090] Updated weights for policy 1, policy_version 1188737 (0.0009) [2023-12-26 09:09:02,205][123091] Updated weights for policy 0, policy_version 1197265 (0.0006) [2023-12-26 09:09:02,240][123090] Updated weights for policy 1, policy_version 1188747 (0.0009) [2023-12-26 09:09:02,271][123091] Updated weights for policy 0, policy_version 1197275 (0.0008) [2023-12-26 09:09:02,305][123090] Updated weights for policy 1, policy_version 1188757 (0.0008) [2023-12-26 09:09:02,335][123091] Updated weights for policy 0, policy_version 1197285 (0.0010) [2023-12-26 09:09:02,368][123090] Updated weights for policy 1, policy_version 1188767 (0.0009) [2023-12-26 09:09:02,405][123091] Updated weights for policy 0, policy_version 1197296 (0.0010) [2023-12-26 09:09:03,190][123091] Updated weights for policy 0, policy_version 1197306 (0.0009) [2023-12-26 09:09:03,222][123090] Updated weights for policy 1, policy_version 1188777 (0.0008) [2023-12-26 09:09:03,253][123091] Updated weights for policy 0, policy_version 1197316 (0.0008) [2023-12-26 09:09:03,282][123090] Updated weights for policy 1, policy_version 1188787 (0.0008) [2023-12-26 09:09:03,314][123091] Updated weights for policy 0, policy_version 1197326 (0.0008) [2023-12-26 09:09:03,346][123090] Updated weights for policy 1, policy_version 1188797 (0.0007) [2023-12-26 09:09:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 610852864. Throughput: 0: 8823.0, 1: 8738.2. Samples: 610864568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:03,785][121949] Avg episode reward: [(0, '6312.342'), (1, '5419.654')] [2023-12-26 09:09:04,105][123091] Updated weights for policy 0, policy_version 1197336 (0.0009) [2023-12-26 09:09:04,166][123091] Updated weights for policy 0, policy_version 1197346 (0.0008) [2023-12-26 09:09:04,168][123090] Updated weights for policy 1, policy_version 1188807 (0.0009) [2023-12-26 09:09:04,227][123091] Updated weights for policy 0, policy_version 1197356 (0.0008) [2023-12-26 09:09:04,234][123090] Updated weights for policy 1, policy_version 1188817 (0.0008) [2023-12-26 09:09:04,299][123090] Updated weights for policy 1, policy_version 1188827 (0.0010) [2023-12-26 09:09:05,039][123091] Updated weights for policy 0, policy_version 1197366 (0.0008) [2023-12-26 09:09:05,106][123091] Updated weights for policy 0, policy_version 1197376 (0.0010) [2023-12-26 09:09:05,140][123090] Updated weights for policy 1, policy_version 1188837 (0.0010) [2023-12-26 09:09:05,169][123091] Updated weights for policy 0, policy_version 1197386 (0.0008) [2023-12-26 09:09:05,198][123090] Updated weights for policy 1, policy_version 1188847 (0.0006) [2023-12-26 09:09:05,251][123090] Updated weights for policy 1, policy_version 1188857 (0.0010) [2023-12-26 09:09:05,968][123091] Updated weights for policy 0, policy_version 1197396 (0.0009) [2023-12-26 09:09:06,027][123091] Updated weights for policy 0, policy_version 1197406 (0.0009) [2023-12-26 09:09:06,083][123091] Updated weights for policy 0, policy_version 1197416 (0.0010) [2023-12-26 09:09:06,111][123090] Updated weights for policy 1, policy_version 1188867 (0.0009) [2023-12-26 09:09:06,183][123090] Updated weights for policy 1, policy_version 1188877 (0.0007) [2023-12-26 09:09:06,242][123090] Updated weights for policy 1, policy_version 1188887 (0.0009) [2023-12-26 09:09:06,941][123091] Updated weights for policy 0, policy_version 1197426 (0.0009) [2023-12-26 09:09:07,007][123091] Updated weights for policy 0, policy_version 1197436 (0.0009) [2023-12-26 09:09:07,009][123090] Updated weights for policy 1, policy_version 1188897 (0.0009) [2023-12-26 09:09:07,062][123091] Updated weights for policy 0, policy_version 1197446 (0.0008) [2023-12-26 09:09:07,073][123090] Updated weights for policy 1, policy_version 1188907 (0.0009) [2023-12-26 09:09:07,123][123090] Updated weights for policy 1, policy_version 1188917 (0.0008) [2023-12-26 09:09:07,130][123091] Updated weights for policy 0, policy_version 1197456 (0.0008) [2023-12-26 09:09:07,180][123090] Updated weights for policy 1, policy_version 1188927 (0.0009) [2023-12-26 09:09:07,967][123091] Updated weights for policy 0, policy_version 1197466 (0.0009) [2023-12-26 09:09:08,027][123091] Updated weights for policy 0, policy_version 1197476 (0.0008) [2023-12-26 09:09:08,033][123090] Updated weights for policy 1, policy_version 1188937 (0.0007) [2023-12-26 09:09:08,087][123091] Updated weights for policy 0, policy_version 1197486 (0.0007) [2023-12-26 09:09:08,090][123090] Updated weights for policy 1, policy_version 1188947 (0.0009) [2023-12-26 09:09:08,155][123090] Updated weights for policy 1, policy_version 1188957 (0.0009) [2023-12-26 09:09:08,784][121949] Fps is (10 sec: 16387.0, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 610934784. Throughput: 0: 8848.0, 1: 8745.4. Samples: 610915528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:08,784][121949] Avg episode reward: [(0, '6325.381'), (1, '5381.503')] [2023-12-26 09:09:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001197488_306561024.pth... [2023-12-26 09:09:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001188960_304373760.pth... [2023-12-26 09:09:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001196464_306298880.pth [2023-12-26 09:09:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001187968_304119808.pth [2023-12-26 09:09:08,926][123091] Updated weights for policy 0, policy_version 1197496 (0.0009) [2023-12-26 09:09:08,969][123090] Updated weights for policy 1, policy_version 1188967 (0.0009) [2023-12-26 09:09:08,986][123091] Updated weights for policy 0, policy_version 1197506 (0.0005) [2023-12-26 09:09:09,033][123090] Updated weights for policy 1, policy_version 1188977 (0.0008) [2023-12-26 09:09:09,051][123091] Updated weights for policy 0, policy_version 1197516 (0.0009) [2023-12-26 09:09:09,096][123090] Updated weights for policy 1, policy_version 1188987 (0.0008) [2023-12-26 09:09:09,843][123091] Updated weights for policy 0, policy_version 1197526 (0.0008) [2023-12-26 09:09:09,909][123091] Updated weights for policy 0, policy_version 1197536 (0.0010) [2023-12-26 09:09:09,966][123090] Updated weights for policy 1, policy_version 1188997 (0.0009) [2023-12-26 09:09:09,973][123091] Updated weights for policy 0, policy_version 1197546 (0.0009) [2023-12-26 09:09:10,034][123090] Updated weights for policy 1, policy_version 1189007 (0.0009) [2023-12-26 09:09:10,093][123090] Updated weights for policy 1, policy_version 1189017 (0.0010) [2023-12-26 09:09:10,779][123091] Updated weights for policy 0, policy_version 1197556 (0.0008) [2023-12-26 09:09:10,841][123091] Updated weights for policy 0, policy_version 1197566 (0.0010) [2023-12-26 09:09:10,906][123091] Updated weights for policy 0, policy_version 1197576 (0.0010) [2023-12-26 09:09:10,976][123090] Updated weights for policy 1, policy_version 1189027 (0.0009) [2023-12-26 09:09:11,040][123090] Updated weights for policy 1, policy_version 1189037 (0.0009) [2023-12-26 09:09:11,102][123090] Updated weights for policy 1, policy_version 1189047 (0.0006) [2023-12-26 09:09:11,732][123091] Updated weights for policy 0, policy_version 1197586 (0.0009) [2023-12-26 09:09:11,800][123091] Updated weights for policy 0, policy_version 1197596 (0.0008) [2023-12-26 09:09:11,865][123091] Updated weights for policy 0, policy_version 1197606 (0.0010) [2023-12-26 09:09:11,928][123091] Updated weights for policy 0, policy_version 1197616 (0.0010) [2023-12-26 09:09:12,011][123090] Updated weights for policy 1, policy_version 1189057 (0.0009) [2023-12-26 09:09:12,071][123090] Updated weights for policy 1, policy_version 1189067 (0.0006) [2023-12-26 09:09:12,134][123090] Updated weights for policy 1, policy_version 1189077 (0.0008) [2023-12-26 09:09:12,208][123090] Updated weights for policy 1, policy_version 1189087 (0.0009) [2023-12-26 09:09:12,819][123091] Updated weights for policy 0, policy_version 1197626 (0.0009) [2023-12-26 09:09:12,884][123090] Updated weights for policy 1, policy_version 1189097 (0.0010) [2023-12-26 09:09:12,888][123091] Updated weights for policy 0, policy_version 1197636 (0.0009) [2023-12-26 09:09:12,937][123090] Updated weights for policy 1, policy_version 1189107 (0.0009) [2023-12-26 09:09:12,952][123091] Updated weights for policy 0, policy_version 1197646 (0.0008) [2023-12-26 09:09:12,995][123090] Updated weights for policy 1, policy_version 1189117 (0.0009) [2023-12-26 09:09:13,765][123091] Updated weights for policy 0, policy_version 1197656 (0.0009) [2023-12-26 09:09:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17772.5). Total num frames: 611016704. Throughput: 0: 8812.6, 1: 8646.6. Samples: 611016800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:13,785][121949] Avg episode reward: [(0, '6283.731'), (1, '5558.186')] [2023-12-26 09:09:13,819][123091] Updated weights for policy 0, policy_version 1197666 (0.0009) [2023-12-26 09:09:13,842][123090] Updated weights for policy 1, policy_version 1189127 (0.0009) [2023-12-26 09:09:13,877][123091] Updated weights for policy 0, policy_version 1197676 (0.0007) [2023-12-26 09:09:13,892][123090] Updated weights for policy 1, policy_version 1189137 (0.0009) [2023-12-26 09:09:13,939][123090] Updated weights for policy 1, policy_version 1189147 (0.0009) [2023-12-26 09:09:14,712][123091] Updated weights for policy 0, policy_version 1197686 (0.0008) [2023-12-26 09:09:14,769][123091] Updated weights for policy 0, policy_version 1197696 (0.0009) [2023-12-26 09:09:14,797][123090] Updated weights for policy 1, policy_version 1189157 (0.0008) [2023-12-26 09:09:14,837][123091] Updated weights for policy 0, policy_version 1197706 (0.0009) [2023-12-26 09:09:14,857][123090] Updated weights for policy 1, policy_version 1189167 (0.0009) [2023-12-26 09:09:14,913][123090] Updated weights for policy 1, policy_version 1189177 (0.0010) [2023-12-26 09:09:15,654][123091] Updated weights for policy 0, policy_version 1197716 (0.0009) [2023-12-26 09:09:15,712][123091] Updated weights for policy 0, policy_version 1197726 (0.0009) [2023-12-26 09:09:15,739][123090] Updated weights for policy 1, policy_version 1189187 (0.0009) [2023-12-26 09:09:15,773][123091] Updated weights for policy 0, policy_version 1197736 (0.0009) [2023-12-26 09:09:15,801][123090] Updated weights for policy 1, policy_version 1189197 (0.0010) [2023-12-26 09:09:15,867][123090] Updated weights for policy 1, policy_version 1189207 (0.0005) [2023-12-26 09:09:16,615][123091] Updated weights for policy 0, policy_version 1197746 (0.0008) [2023-12-26 09:09:16,651][123090] Updated weights for policy 1, policy_version 1189217 (0.0006) [2023-12-26 09:09:16,669][123091] Updated weights for policy 0, policy_version 1197756 (0.0010) [2023-12-26 09:09:16,705][123090] Updated weights for policy 1, policy_version 1189227 (0.0007) [2023-12-26 09:09:16,729][123091] Updated weights for policy 0, policy_version 1197766 (0.0007) [2023-12-26 09:09:16,755][123090] Updated weights for policy 1, policy_version 1189237 (0.0008) [2023-12-26 09:09:16,783][123091] Updated weights for policy 0, policy_version 1197776 (0.0007) [2023-12-26 09:09:16,801][123090] Updated weights for policy 1, policy_version 1189247 (0.0008) [2023-12-26 09:09:17,587][123091] Updated weights for policy 0, policy_version 1197786 (0.0010) [2023-12-26 09:09:17,621][123090] Updated weights for policy 1, policy_version 1189257 (0.0010) [2023-12-26 09:09:17,650][123091] Updated weights for policy 0, policy_version 1197796 (0.0010) [2023-12-26 09:09:17,674][123090] Updated weights for policy 1, policy_version 1189267 (0.0008) [2023-12-26 09:09:17,706][123091] Updated weights for policy 0, policy_version 1197806 (0.0009) [2023-12-26 09:09:17,726][123090] Updated weights for policy 1, policy_version 1189277 (0.0010) [2023-12-26 09:09:18,417][123091] Updated weights for policy 0, policy_version 1197816 (0.0008) [2023-12-26 09:09:18,480][123091] Updated weights for policy 0, policy_version 1197826 (0.0010) [2023-12-26 09:09:18,529][123091] Updated weights for policy 0, policy_version 1197836 (0.0008) [2023-12-26 09:09:18,548][123090] Updated weights for policy 1, policy_version 1189287 (0.0009) [2023-12-26 09:09:18,609][123090] Updated weights for policy 1, policy_version 1189297 (0.0009) [2023-12-26 09:09:18,675][123090] Updated weights for policy 1, policy_version 1189307 (0.0010) [2023-12-26 09:09:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 611115008. Throughput: 0: 8741.2, 1: 8599.6. Samples: 611120924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:18,785][121949] Avg episode reward: [(0, '6270.310'), (1, '5733.986')] [2023-12-26 09:09:19,410][123091] Updated weights for policy 0, policy_version 1197846 (0.0008) [2023-12-26 09:09:19,478][123091] Updated weights for policy 0, policy_version 1197856 (0.0009) [2023-12-26 09:09:19,493][123090] Updated weights for policy 1, policy_version 1189317 (0.0009) [2023-12-26 09:09:19,554][123091] Updated weights for policy 0, policy_version 1197866 (0.0009) [2023-12-26 09:09:19,559][123090] Updated weights for policy 1, policy_version 1189327 (0.0007) [2023-12-26 09:09:19,630][123090] Updated weights for policy 1, policy_version 1189337 (0.0008) [2023-12-26 09:09:20,407][123091] Updated weights for policy 0, policy_version 1197876 (0.0009) [2023-12-26 09:09:20,442][123090] Updated weights for policy 1, policy_version 1189347 (0.0009) [2023-12-26 09:09:20,458][123091] Updated weights for policy 0, policy_version 1197886 (0.0007) [2023-12-26 09:09:20,502][123090] Updated weights for policy 1, policy_version 1189357 (0.0009) [2023-12-26 09:09:20,524][123091] Updated weights for policy 0, policy_version 1197896 (0.0008) [2023-12-26 09:09:20,569][123090] Updated weights for policy 1, policy_version 1189367 (0.0007) [2023-12-26 09:09:21,338][123090] Updated weights for policy 1, policy_version 1189377 (0.0010) [2023-12-26 09:09:21,418][123090] Updated weights for policy 1, policy_version 1189387 (0.0011) [2023-12-26 09:09:21,452][123091] Updated weights for policy 0, policy_version 1197906 (0.0009) [2023-12-26 09:09:21,479][123090] Updated weights for policy 1, policy_version 1189397 (0.0009) [2023-12-26 09:09:21,515][123091] Updated weights for policy 0, policy_version 1197916 (0.0008) [2023-12-26 09:09:21,526][123090] Updated weights for policy 1, policy_version 1189407 (0.0009) [2023-12-26 09:09:21,578][123091] Updated weights for policy 0, policy_version 1197926 (0.0009) [2023-12-26 09:09:21,648][123091] Updated weights for policy 0, policy_version 1197936 (0.0009) [2023-12-26 09:09:22,360][123090] Updated weights for policy 1, policy_version 1189417 (0.0007) [2023-12-26 09:09:22,431][123090] Updated weights for policy 1, policy_version 1189427 (0.0008) [2023-12-26 09:09:22,475][123091] Updated weights for policy 0, policy_version 1197946 (0.0006) [2023-12-26 09:09:22,496][123090] Updated weights for policy 1, policy_version 1189437 (0.0009) [2023-12-26 09:09:22,541][123091] Updated weights for policy 0, policy_version 1197956 (0.0005) [2023-12-26 09:09:22,599][123091] Updated weights for policy 0, policy_version 1197966 (0.0005) [2023-12-26 09:09:23,197][123091] Updated weights for policy 0, policy_version 1197976 (0.0006) [2023-12-26 09:09:23,261][123091] Updated weights for policy 0, policy_version 1197986 (0.0007) [2023-12-26 09:09:23,321][123091] Updated weights for policy 0, policy_version 1197996 (0.0009) [2023-12-26 09:09:23,360][123090] Updated weights for policy 1, policy_version 1189447 (0.0008) [2023-12-26 09:09:23,420][123090] Updated weights for policy 1, policy_version 1189457 (0.0009) [2023-12-26 09:09:23,482][123090] Updated weights for policy 1, policy_version 1189467 (0.0009) [2023-12-26 09:09:23,785][121949] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 611196928. Throughput: 0: 8709.3, 1: 8580.5. Samples: 611171104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:23,786][121949] Avg episode reward: [(0, '6264.630'), (1, '5546.641')] [2023-12-26 09:09:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001198000_306692096.pth... [2023-12-26 09:09:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001189472_304504832.pth... [2023-12-26 09:09:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001197008_306438144.pth [2023-12-26 09:09:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001188448_304242688.pth [2023-12-26 09:09:24,044][123091] Updated weights for policy 0, policy_version 1198006 (0.0007) [2023-12-26 09:09:24,103][123091] Updated weights for policy 0, policy_version 1198016 (0.0007) [2023-12-26 09:09:24,163][123091] Updated weights for policy 0, policy_version 1198026 (0.0007) [2023-12-26 09:09:24,380][123090] Updated weights for policy 1, policy_version 1189477 (0.0009) [2023-12-26 09:09:24,441][123090] Updated weights for policy 1, policy_version 1189487 (0.0009) [2023-12-26 09:09:24,503][123090] Updated weights for policy 1, policy_version 1189497 (0.0009) [2023-12-26 09:09:24,885][123091] Updated weights for policy 0, policy_version 1198036 (0.0008) [2023-12-26 09:09:24,956][123091] Updated weights for policy 0, policy_version 1198046 (0.0011) [2023-12-26 09:09:25,027][123091] Updated weights for policy 0, policy_version 1198056 (0.0011) [2023-12-26 09:09:25,327][123090] Updated weights for policy 1, policy_version 1189507 (0.0009) [2023-12-26 09:09:25,397][123090] Updated weights for policy 1, policy_version 1189517 (0.0010) [2023-12-26 09:09:25,465][123090] Updated weights for policy 1, policy_version 1189527 (0.0010) [2023-12-26 09:09:25,761][123091] Updated weights for policy 0, policy_version 1198066 (0.0009) [2023-12-26 09:09:25,833][123091] Updated weights for policy 0, policy_version 1198076 (0.0005) [2023-12-26 09:09:25,893][123091] Updated weights for policy 0, policy_version 1198086 (0.0005) [2023-12-26 09:09:25,941][123091] Updated weights for policy 0, policy_version 1198096 (0.0005) [2023-12-26 09:09:26,396][123090] Updated weights for policy 1, policy_version 1189537 (0.0009) [2023-12-26 09:09:26,444][123090] Updated weights for policy 1, policy_version 1189547 (0.0009) [2023-12-26 09:09:26,498][123090] Updated weights for policy 1, policy_version 1189557 (0.0008) [2023-12-26 09:09:26,546][123090] Updated weights for policy 1, policy_version 1189567 (0.0008) [2023-12-26 09:09:26,625][123091] Updated weights for policy 0, policy_version 1198106 (0.0010) [2023-12-26 09:09:26,676][123091] Updated weights for policy 0, policy_version 1198116 (0.0010) [2023-12-26 09:09:26,731][123091] Updated weights for policy 0, policy_version 1198126 (0.0010) [2023-12-26 09:09:27,412][123091] Updated weights for policy 0, policy_version 1198136 (0.0007) [2023-12-26 09:09:27,451][123090] Updated weights for policy 1, policy_version 1189577 (0.0005) [2023-12-26 09:09:27,474][123091] Updated weights for policy 0, policy_version 1198146 (0.0006) [2023-12-26 09:09:27,512][123090] Updated weights for policy 1, policy_version 1189587 (0.0005) [2023-12-26 09:09:27,531][123091] Updated weights for policy 0, policy_version 1198156 (0.0006) [2023-12-26 09:09:27,567][123090] Updated weights for policy 1, policy_version 1189597 (0.0009) [2023-12-26 09:09:28,204][123091] Updated weights for policy 0, policy_version 1198166 (0.0007) [2023-12-26 09:09:28,271][123091] Updated weights for policy 0, policy_version 1198176 (0.0006) [2023-12-26 09:09:28,314][123090] Updated weights for policy 1, policy_version 1189607 (0.0009) [2023-12-26 09:09:28,329][123091] Updated weights for policy 0, policy_version 1198186 (0.0006) [2023-12-26 09:09:28,378][123090] Updated weights for policy 1, policy_version 1189617 (0.0008) [2023-12-26 09:09:28,429][123090] Updated weights for policy 1, policy_version 1189627 (0.0009) [2023-12-26 09:09:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17800.3). Total num frames: 611287040. Throughput: 0: 8872.9, 1: 8567.3. Samples: 611279120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:28,785][121949] Avg episode reward: [(0, '6260.088'), (1, '5462.369')] [2023-12-26 09:09:29,104][123091] Updated weights for policy 0, policy_version 1198196 (0.0007) [2023-12-26 09:09:29,149][123091] Updated weights for policy 0, policy_version 1198206 (0.0005) [2023-12-26 09:09:29,194][123091] Updated weights for policy 0, policy_version 1198216 (0.0005) [2023-12-26 09:09:29,259][123090] Updated weights for policy 1, policy_version 1189637 (0.0009) [2023-12-26 09:09:29,323][123090] Updated weights for policy 1, policy_version 1189647 (0.0010) [2023-12-26 09:09:29,391][123090] Updated weights for policy 1, policy_version 1189657 (0.0009) [2023-12-26 09:09:30,012][123091] Updated weights for policy 0, policy_version 1198226 (0.0008) [2023-12-26 09:09:30,078][123091] Updated weights for policy 0, policy_version 1198236 (0.0008) [2023-12-26 09:09:30,140][123091] Updated weights for policy 0, policy_version 1198246 (0.0009) [2023-12-26 09:09:30,200][123091] Updated weights for policy 0, policy_version 1198256 (0.0009) [2023-12-26 09:09:30,252][123090] Updated weights for policy 1, policy_version 1189667 (0.0008) [2023-12-26 09:09:30,319][123090] Updated weights for policy 1, policy_version 1189677 (0.0005) [2023-12-26 09:09:30,382][123090] Updated weights for policy 1, policy_version 1189687 (0.0008) [2023-12-26 09:09:31,026][123091] Updated weights for policy 0, policy_version 1198266 (0.0010) [2023-12-26 09:09:31,088][123091] Updated weights for policy 0, policy_version 1198276 (0.0010) [2023-12-26 09:09:31,144][123090] Updated weights for policy 1, policy_version 1189697 (0.0009) [2023-12-26 09:09:31,158][123091] Updated weights for policy 0, policy_version 1198286 (0.0010) [2023-12-26 09:09:31,198][123090] Updated weights for policy 1, policy_version 1189707 (0.0007) [2023-12-26 09:09:31,261][123090] Updated weights for policy 1, policy_version 1189717 (0.0009) [2023-12-26 09:09:31,325][123090] Updated weights for policy 1, policy_version 1189727 (0.0008) [2023-12-26 09:09:31,992][123091] Updated weights for policy 0, policy_version 1198296 (0.0010) [2023-12-26 09:09:32,055][123091] Updated weights for policy 0, policy_version 1198306 (0.0009) [2023-12-26 09:09:32,124][123091] Updated weights for policy 0, policy_version 1198316 (0.0008) [2023-12-26 09:09:32,125][123090] Updated weights for policy 1, policy_version 1189737 (0.0006) [2023-12-26 09:09:32,183][123090] Updated weights for policy 1, policy_version 1189747 (0.0005) [2023-12-26 09:09:32,237][123090] Updated weights for policy 1, policy_version 1189757 (0.0008) [2023-12-26 09:09:32,812][123091] Updated weights for policy 0, policy_version 1198326 (0.0008) [2023-12-26 09:09:32,884][123091] Updated weights for policy 0, policy_version 1198336 (0.0008) [2023-12-26 09:09:32,931][123091] Updated weights for policy 0, policy_version 1198346 (0.0005) [2023-12-26 09:09:33,002][123090] Updated weights for policy 1, policy_version 1189767 (0.0006) [2023-12-26 09:09:33,058][123090] Updated weights for policy 1, policy_version 1189777 (0.0005) [2023-12-26 09:09:33,107][123090] Updated weights for policy 1, policy_version 1189787 (0.0006) [2023-12-26 09:09:33,724][123091] Updated weights for policy 0, policy_version 1198356 (0.0009) [2023-12-26 09:09:33,748][123090] Updated weights for policy 1, policy_version 1189797 (0.0008) [2023-12-26 09:09:33,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17339.7, 300 sec: 17744.7). Total num frames: 611368960. Throughput: 0: 8800.7, 1: 8606.9. Samples: 611387524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:33,784][121949] Avg episode reward: [(0, '6274.801'), (1, '5564.816')] [2023-12-26 09:09:33,785][123091] Updated weights for policy 0, policy_version 1198366 (0.0010) [2023-12-26 09:09:33,825][123090] Updated weights for policy 1, policy_version 1189807 (0.0010) [2023-12-26 09:09:33,848][123091] Updated weights for policy 0, policy_version 1198376 (0.0010) [2023-12-26 09:09:33,883][123090] Updated weights for policy 1, policy_version 1189817 (0.0010) [2023-12-26 09:09:34,615][123091] Updated weights for policy 0, policy_version 1198386 (0.0009) [2023-12-26 09:09:34,675][123091] Updated weights for policy 0, policy_version 1198396 (0.0005) [2023-12-26 09:09:34,732][123090] Updated weights for policy 1, policy_version 1189827 (0.0010) [2023-12-26 09:09:34,741][123091] Updated weights for policy 0, policy_version 1198406 (0.0010) [2023-12-26 09:09:34,795][123090] Updated weights for policy 1, policy_version 1189837 (0.0011) [2023-12-26 09:09:34,804][123091] Updated weights for policy 0, policy_version 1198416 (0.0011) [2023-12-26 09:09:34,859][123090] Updated weights for policy 1, policy_version 1189847 (0.0010) [2023-12-26 09:09:35,500][123091] Updated weights for policy 0, policy_version 1198426 (0.0008) [2023-12-26 09:09:35,548][123090] Updated weights for policy 1, policy_version 1189857 (0.0010) [2023-12-26 09:09:35,566][123091] Updated weights for policy 0, policy_version 1198436 (0.0008) [2023-12-26 09:09:35,605][123090] Updated weights for policy 1, policy_version 1189867 (0.0009) [2023-12-26 09:09:35,634][123091] Updated weights for policy 0, policy_version 1198446 (0.0005) [2023-12-26 09:09:35,670][123090] Updated weights for policy 1, policy_version 1189877 (0.0009) [2023-12-26 09:09:35,722][123090] Updated weights for policy 1, policy_version 1189887 (0.0009) [2023-12-26 09:09:36,432][123091] Updated weights for policy 0, policy_version 1198456 (0.0009) [2023-12-26 09:09:36,498][123091] Updated weights for policy 0, policy_version 1198466 (0.0009) [2023-12-26 09:09:36,564][123091] Updated weights for policy 0, policy_version 1198476 (0.0009) [2023-12-26 09:09:36,565][123090] Updated weights for policy 1, policy_version 1189897 (0.0008) [2023-12-26 09:09:36,622][123090] Updated weights for policy 1, policy_version 1189907 (0.0008) [2023-12-26 09:09:36,674][123090] Updated weights for policy 1, policy_version 1189917 (0.0008) [2023-12-26 09:09:37,379][123091] Updated weights for policy 0, policy_version 1198486 (0.0010) [2023-12-26 09:09:37,442][123091] Updated weights for policy 0, policy_version 1198496 (0.0010) [2023-12-26 09:09:37,499][123090] Updated weights for policy 1, policy_version 1189927 (0.0007) [2023-12-26 09:09:37,502][123091] Updated weights for policy 0, policy_version 1198506 (0.0011) [2023-12-26 09:09:37,563][123090] Updated weights for policy 1, policy_version 1189937 (0.0007) [2023-12-26 09:09:37,611][123090] Updated weights for policy 1, policy_version 1189947 (0.0005) [2023-12-26 09:09:38,256][123091] Updated weights for policy 0, policy_version 1198516 (0.0009) [2023-12-26 09:09:38,311][123091] Updated weights for policy 0, policy_version 1198526 (0.0011) [2023-12-26 09:09:38,380][123091] Updated weights for policy 0, policy_version 1198536 (0.0008) [2023-12-26 09:09:38,438][123090] Updated weights for policy 1, policy_version 1189957 (0.0007) [2023-12-26 09:09:38,506][123090] Updated weights for policy 1, policy_version 1189967 (0.0008) [2023-12-26 09:09:38,568][123090] Updated weights for policy 1, policy_version 1189977 (0.0006) [2023-12-26 09:09:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 611467264. Throughput: 0: 8809.4, 1: 8647.2. Samples: 611441100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:38,785][121949] Avg episode reward: [(0, '6289.345'), (1, '5258.104')] [2023-12-26 09:09:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001198544_306831360.pth... [2023-12-26 09:09:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001189984_304635904.pth... [2023-12-26 09:09:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001188960_304373760.pth [2023-12-26 09:09:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001197488_306561024.pth [2023-12-26 09:09:39,080][123091] Updated weights for policy 0, policy_version 1198546 (0.0009) [2023-12-26 09:09:39,153][123091] Updated weights for policy 0, policy_version 1198556 (0.0011) [2023-12-26 09:09:39,211][123091] Updated weights for policy 0, policy_version 1198566 (0.0011) [2023-12-26 09:09:39,282][123091] Updated weights for policy 0, policy_version 1198576 (0.0011) [2023-12-26 09:09:39,363][123090] Updated weights for policy 1, policy_version 1189987 (0.0008) [2023-12-26 09:09:39,432][123090] Updated weights for policy 1, policy_version 1189997 (0.0009) [2023-12-26 09:09:39,494][123090] Updated weights for policy 1, policy_version 1190007 (0.0006) [2023-12-26 09:09:40,108][123091] Updated weights for policy 0, policy_version 1198586 (0.0008) [2023-12-26 09:09:40,178][123091] Updated weights for policy 0, policy_version 1198596 (0.0009) [2023-12-26 09:09:40,250][123091] Updated weights for policy 0, policy_version 1198606 (0.0010) [2023-12-26 09:09:40,291][123090] Updated weights for policy 1, policy_version 1190017 (0.0009) [2023-12-26 09:09:40,357][123090] Updated weights for policy 1, policy_version 1190028 (0.0010) [2023-12-26 09:09:40,419][123090] Updated weights for policy 1, policy_version 1190038 (0.0007) [2023-12-26 09:09:40,490][123090] Updated weights for policy 1, policy_version 1190048 (0.0006) [2023-12-26 09:09:40,972][123091] Updated weights for policy 0, policy_version 1198616 (0.0009) [2023-12-26 09:09:41,027][123091] Updated weights for policy 0, policy_version 1198626 (0.0009) [2023-12-26 09:09:41,088][123091] Updated weights for policy 0, policy_version 1198636 (0.0009) [2023-12-26 09:09:41,290][123090] Updated weights for policy 1, policy_version 1190058 (0.0010) [2023-12-26 09:09:41,364][123090] Updated weights for policy 1, policy_version 1190068 (0.0009) [2023-12-26 09:09:41,423][123090] Updated weights for policy 1, policy_version 1190078 (0.0009) [2023-12-26 09:09:41,949][123091] Updated weights for policy 0, policy_version 1198646 (0.0009) [2023-12-26 09:09:42,015][123091] Updated weights for policy 0, policy_version 1198656 (0.0008) [2023-12-26 09:09:42,070][123091] Updated weights for policy 0, policy_version 1198666 (0.0008) [2023-12-26 09:09:42,279][123090] Updated weights for policy 1, policy_version 1190088 (0.0009) [2023-12-26 09:09:42,346][123090] Updated weights for policy 1, policy_version 1190098 (0.0009) [2023-12-26 09:09:42,402][123090] Updated weights for policy 1, policy_version 1190108 (0.0009) [2023-12-26 09:09:42,896][123091] Updated weights for policy 0, policy_version 1198676 (0.0009) [2023-12-26 09:09:42,950][123091] Updated weights for policy 0, policy_version 1198686 (0.0010) [2023-12-26 09:09:43,014][123091] Updated weights for policy 0, policy_version 1198696 (0.0009) [2023-12-26 09:09:43,117][123090] Updated weights for policy 1, policy_version 1190118 (0.0009) [2023-12-26 09:09:43,171][123090] Updated weights for policy 1, policy_version 1190128 (0.0009) [2023-12-26 09:09:43,235][123090] Updated weights for policy 1, policy_version 1190138 (0.0008) [2023-12-26 09:09:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 611549184. Throughput: 0: 8863.9, 1: 8580.7. Samples: 611545700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:43,785][121949] Avg episode reward: [(0, '6239.928'), (1, '5176.401')] [2023-12-26 09:09:43,855][123091] Updated weights for policy 0, policy_version 1198706 (0.0009) [2023-12-26 09:09:43,907][123091] Updated weights for policy 0, policy_version 1198716 (0.0006) [2023-12-26 09:09:43,961][123091] Updated weights for policy 0, policy_version 1198726 (0.0007) [2023-12-26 09:09:44,018][123091] Updated weights for policy 0, policy_version 1198736 (0.0009) [2023-12-26 09:09:44,084][123090] Updated weights for policy 1, policy_version 1190148 (0.0009) [2023-12-26 09:09:44,148][123090] Updated weights for policy 1, policy_version 1190158 (0.0010) [2023-12-26 09:09:44,199][123090] Updated weights for policy 1, policy_version 1190168 (0.0009) [2023-12-26 09:09:44,874][123091] Updated weights for policy 0, policy_version 1198746 (0.0009) [2023-12-26 09:09:44,940][123091] Updated weights for policy 0, policy_version 1198756 (0.0009) [2023-12-26 09:09:44,973][123090] Updated weights for policy 1, policy_version 1190178 (0.0009) [2023-12-26 09:09:45,008][123091] Updated weights for policy 0, policy_version 1198766 (0.0009) [2023-12-26 09:09:45,040][123090] Updated weights for policy 1, policy_version 1190188 (0.0010) [2023-12-26 09:09:45,104][123090] Updated weights for policy 1, policy_version 1190198 (0.0009) [2023-12-26 09:09:45,170][123090] Updated weights for policy 1, policy_version 1190208 (0.0009) [2023-12-26 09:09:45,831][123091] Updated weights for policy 0, policy_version 1198776 (0.0009) [2023-12-26 09:09:45,894][123091] Updated weights for policy 0, policy_version 1198786 (0.0011) [2023-12-26 09:09:45,918][123090] Updated weights for policy 1, policy_version 1190218 (0.0006) [2023-12-26 09:09:45,954][123091] Updated weights for policy 0, policy_version 1198796 (0.0009) [2023-12-26 09:09:45,977][123090] Updated weights for policy 1, policy_version 1190228 (0.0005) [2023-12-26 09:09:46,027][123090] Updated weights for policy 1, policy_version 1190238 (0.0005) [2023-12-26 09:09:46,657][123091] Updated weights for policy 0, policy_version 1198806 (0.0010) [2023-12-26 09:09:46,729][123091] Updated weights for policy 0, policy_version 1198816 (0.0009) [2023-12-26 09:09:46,757][123090] Updated weights for policy 1, policy_version 1190248 (0.0006) [2023-12-26 09:09:46,786][123091] Updated weights for policy 0, policy_version 1198826 (0.0008) [2023-12-26 09:09:46,807][123090] Updated weights for policy 1, policy_version 1190258 (0.0007) [2023-12-26 09:09:46,872][123090] Updated weights for policy 1, policy_version 1190268 (0.0005) [2023-12-26 09:09:47,616][123090] Updated weights for policy 1, policy_version 1190278 (0.0008) [2023-12-26 09:09:47,627][123091] Updated weights for policy 0, policy_version 1198836 (0.0008) [2023-12-26 09:09:47,677][123090] Updated weights for policy 1, policy_version 1190288 (0.0010) [2023-12-26 09:09:47,688][123091] Updated weights for policy 0, policy_version 1198846 (0.0006) [2023-12-26 09:09:47,751][123091] Updated weights for policy 0, policy_version 1198856 (0.0009) [2023-12-26 09:09:47,752][123090] Updated weights for policy 1, policy_version 1190298 (0.0008) [2023-12-26 09:09:48,523][123090] Updated weights for policy 1, policy_version 1190308 (0.0010) [2023-12-26 09:09:48,548][123091] Updated weights for policy 0, policy_version 1198866 (0.0007) [2023-12-26 09:09:48,595][123090] Updated weights for policy 1, policy_version 1190318 (0.0008) [2023-12-26 09:09:48,613][123091] Updated weights for policy 0, policy_version 1198876 (0.0005) [2023-12-26 09:09:48,668][123090] Updated weights for policy 1, policy_version 1190328 (0.0007) [2023-12-26 09:09:48,674][123091] Updated weights for policy 0, policy_version 1198886 (0.0007) [2023-12-26 09:09:48,738][123091] Updated weights for policy 0, policy_version 1198896 (0.0007) [2023-12-26 09:09:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 611647488. Throughput: 0: 8843.4, 1: 8689.0. Samples: 611653524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:48,784][121949] Avg episode reward: [(0, '6296.384'), (1, '5266.517')] [2023-12-26 09:09:49,353][123090] Updated weights for policy 1, policy_version 1190338 (0.0008) [2023-12-26 09:09:49,428][123090] Updated weights for policy 1, policy_version 1190348 (0.0008) [2023-12-26 09:09:49,484][123090] Updated weights for policy 1, policy_version 1190358 (0.0010) [2023-12-26 09:09:49,541][123090] Updated weights for policy 1, policy_version 1190368 (0.0009) [2023-12-26 09:09:49,580][123091] Updated weights for policy 0, policy_version 1198906 (0.0011) [2023-12-26 09:09:49,643][123091] Updated weights for policy 0, policy_version 1198916 (0.0010) [2023-12-26 09:09:49,708][123091] Updated weights for policy 0, policy_version 1198926 (0.0005) [2023-12-26 09:09:50,317][123090] Updated weights for policy 1, policy_version 1190378 (0.0009) [2023-12-26 09:09:50,387][123090] Updated weights for policy 1, policy_version 1190388 (0.0007) [2023-12-26 09:09:50,390][123091] Updated weights for policy 0, policy_version 1198936 (0.0009) [2023-12-26 09:09:50,441][123090] Updated weights for policy 1, policy_version 1190398 (0.0006) [2023-12-26 09:09:50,446][123091] Updated weights for policy 0, policy_version 1198946 (0.0011) [2023-12-26 09:09:50,514][123091] Updated weights for policy 0, policy_version 1198956 (0.0006) [2023-12-26 09:09:51,176][123090] Updated weights for policy 1, policy_version 1190408 (0.0007) [2023-12-26 09:09:51,249][123090] Updated weights for policy 1, policy_version 1190418 (0.0006) [2023-12-26 09:09:51,295][123091] Updated weights for policy 0, policy_version 1198966 (0.0008) [2023-12-26 09:09:51,316][123090] Updated weights for policy 1, policy_version 1190428 (0.0007) [2023-12-26 09:09:51,370][123091] Updated weights for policy 0, policy_version 1198976 (0.0011) [2023-12-26 09:09:51,440][123091] Updated weights for policy 0, policy_version 1198986 (0.0011) [2023-12-26 09:09:51,976][123090] Updated weights for policy 1, policy_version 1190438 (0.0008) [2023-12-26 09:09:52,040][123090] Updated weights for policy 1, policy_version 1190448 (0.0010) [2023-12-26 09:09:52,105][123090] Updated weights for policy 1, policy_version 1190458 (0.0009) [2023-12-26 09:09:52,220][123091] Updated weights for policy 0, policy_version 1198996 (0.0007) [2023-12-26 09:09:52,271][123091] Updated weights for policy 0, policy_version 1199006 (0.0006) [2023-12-26 09:09:52,319][123091] Updated weights for policy 0, policy_version 1199016 (0.0007) [2023-12-26 09:09:52,981][123090] Updated weights for policy 1, policy_version 1190468 (0.0009) [2023-12-26 09:09:53,025][123091] Updated weights for policy 0, policy_version 1199026 (0.0007) [2023-12-26 09:09:53,041][123090] Updated weights for policy 1, policy_version 1190478 (0.0008) [2023-12-26 09:09:53,079][123091] Updated weights for policy 0, policy_version 1199036 (0.0008) [2023-12-26 09:09:53,090][123090] Updated weights for policy 1, policy_version 1190488 (0.0007) [2023-12-26 09:09:53,140][123091] Updated weights for policy 0, policy_version 1199046 (0.0009) [2023-12-26 09:09:53,194][123091] Updated weights for policy 0, policy_version 1199056 (0.0010) [2023-12-26 09:09:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 611729408. Throughput: 0: 8849.9, 1: 8762.0. Samples: 611708060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:53,784][121949] Avg episode reward: [(0, '6294.951'), (1, '5343.152')] [2023-12-26 09:09:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001199056_306962432.pth... [2023-12-26 09:09:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001190496_304766976.pth... [2023-12-26 09:09:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001189472_304504832.pth [2023-12-26 09:09:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001198000_306692096.pth [2023-12-26 09:09:53,956][123090] Updated weights for policy 1, policy_version 1190498 (0.0007) [2023-12-26 09:09:53,967][123091] Updated weights for policy 0, policy_version 1199066 (0.0007) [2023-12-26 09:09:54,011][123090] Updated weights for policy 1, policy_version 1190508 (0.0009) [2023-12-26 09:09:54,021][123091] Updated weights for policy 0, policy_version 1199076 (0.0007) [2023-12-26 09:09:54,060][123090] Updated weights for policy 1, policy_version 1190518 (0.0008) [2023-12-26 09:09:54,080][123091] Updated weights for policy 0, policy_version 1199086 (0.0008) [2023-12-26 09:09:54,114][123090] Updated weights for policy 1, policy_version 1190528 (0.0008) [2023-12-26 09:09:54,901][123091] Updated weights for policy 0, policy_version 1199096 (0.0009) [2023-12-26 09:09:54,969][123091] Updated weights for policy 0, policy_version 1199106 (0.0010) [2023-12-26 09:09:54,998][123090] Updated weights for policy 1, policy_version 1190538 (0.0008) [2023-12-26 09:09:55,033][123091] Updated weights for policy 0, policy_version 1199116 (0.0008) [2023-12-26 09:09:55,066][123090] Updated weights for policy 1, policy_version 1190548 (0.0008) [2023-12-26 09:09:55,137][123090] Updated weights for policy 1, policy_version 1190558 (0.0008) [2023-12-26 09:09:55,808][123091] Updated weights for policy 0, policy_version 1199126 (0.0009) [2023-12-26 09:09:55,862][123091] Updated weights for policy 0, policy_version 1199136 (0.0009) [2023-12-26 09:09:55,934][123091] Updated weights for policy 0, policy_version 1199146 (0.0009) [2023-12-26 09:09:55,951][123090] Updated weights for policy 1, policy_version 1190568 (0.0006) [2023-12-26 09:09:56,017][123090] Updated weights for policy 1, policy_version 1190578 (0.0006) [2023-12-26 09:09:56,097][123090] Updated weights for policy 1, policy_version 1190588 (0.0006) [2023-12-26 09:09:56,730][123091] Updated weights for policy 0, policy_version 1199156 (0.0008) [2023-12-26 09:09:56,778][123090] Updated weights for policy 1, policy_version 1190598 (0.0006) [2023-12-26 09:09:56,801][123091] Updated weights for policy 0, policy_version 1199166 (0.0006) [2023-12-26 09:09:56,833][123090] Updated weights for policy 1, policy_version 1190608 (0.0009) [2023-12-26 09:09:56,852][123091] Updated weights for policy 0, policy_version 1199176 (0.0005) [2023-12-26 09:09:56,880][123090] Updated weights for policy 1, policy_version 1190618 (0.0008) [2023-12-26 09:09:57,606][123090] Updated weights for policy 1, policy_version 1190628 (0.0007) [2023-12-26 09:09:57,609][123091] Updated weights for policy 0, policy_version 1199186 (0.0009) [2023-12-26 09:09:57,657][123090] Updated weights for policy 1, policy_version 1190638 (0.0005) [2023-12-26 09:09:57,660][123091] Updated weights for policy 0, policy_version 1199196 (0.0008) [2023-12-26 09:09:57,710][123090] Updated weights for policy 1, policy_version 1190648 (0.0006) [2023-12-26 09:09:57,723][123091] Updated weights for policy 0, policy_version 1199206 (0.0009) [2023-12-26 09:09:57,773][123091] Updated weights for policy 0, policy_version 1199216 (0.0006) [2023-12-26 09:09:58,565][123090] Updated weights for policy 1, policy_version 1190658 (0.0006) [2023-12-26 09:09:58,606][123091] Updated weights for policy 0, policy_version 1199226 (0.0007) [2023-12-26 09:09:58,634][123090] Updated weights for policy 1, policy_version 1190668 (0.0009) [2023-12-26 09:09:58,682][123091] Updated weights for policy 0, policy_version 1199236 (0.0008) [2023-12-26 09:09:58,706][123090] Updated weights for policy 1, policy_version 1190678 (0.0009) [2023-12-26 09:09:58,753][123091] Updated weights for policy 0, policy_version 1199246 (0.0008) [2023-12-26 09:09:58,776][123090] Updated weights for policy 1, policy_version 1190688 (0.0008) [2023-12-26 09:09:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17613.3, 300 sec: 17772.5). Total num frames: 611827712. Throughput: 0: 8933.6, 1: 8801.3. Samples: 611814872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:09:58,785][121949] Avg episode reward: [(0, '6300.486'), (1, '5397.809')] [2023-12-26 09:09:59,637][123090] Updated weights for policy 1, policy_version 1190698 (0.0008) [2023-12-26 09:09:59,650][123091] Updated weights for policy 0, policy_version 1199256 (0.0009) [2023-12-26 09:09:59,687][123090] Updated weights for policy 1, policy_version 1190708 (0.0008) [2023-12-26 09:09:59,712][123091] Updated weights for policy 0, policy_version 1199266 (0.0009) [2023-12-26 09:09:59,766][123090] Updated weights for policy 1, policy_version 1190718 (0.0005) [2023-12-26 09:09:59,770][123091] Updated weights for policy 0, policy_version 1199276 (0.0009) [2023-12-26 09:10:00,420][123091] Updated weights for policy 0, policy_version 1199286 (0.0007) [2023-12-26 09:10:00,489][123091] Updated weights for policy 0, policy_version 1199296 (0.0005) [2023-12-26 09:10:00,503][123090] Updated weights for policy 1, policy_version 1190728 (0.0008) [2023-12-26 09:10:00,553][123091] Updated weights for policy 0, policy_version 1199306 (0.0008) [2023-12-26 09:10:00,562][123090] Updated weights for policy 1, policy_version 1190738 (0.0009) [2023-12-26 09:10:00,615][123090] Updated weights for policy 1, policy_version 1190749 (0.0009) [2023-12-26 09:10:01,316][123091] Updated weights for policy 0, policy_version 1199316 (0.0008) [2023-12-26 09:10:01,386][123091] Updated weights for policy 0, policy_version 1199326 (0.0008) [2023-12-26 09:10:01,451][123091] Updated weights for policy 0, policy_version 1199336 (0.0008) [2023-12-26 09:10:01,464][123090] Updated weights for policy 1, policy_version 1190759 (0.0008) [2023-12-26 09:10:01,526][123090] Updated weights for policy 1, policy_version 1190769 (0.0008) [2023-12-26 09:10:01,580][123090] Updated weights for policy 1, policy_version 1190779 (0.0010) [2023-12-26 09:10:02,147][123091] Updated weights for policy 0, policy_version 1199346 (0.0007) [2023-12-26 09:10:02,207][123091] Updated weights for policy 0, policy_version 1199356 (0.0006) [2023-12-26 09:10:02,258][123091] Updated weights for policy 0, policy_version 1199366 (0.0005) [2023-12-26 09:10:02,309][123091] Updated weights for policy 0, policy_version 1199376 (0.0009) [2023-12-26 09:10:02,486][123090] Updated weights for policy 1, policy_version 1190789 (0.0010) [2023-12-26 09:10:02,541][123090] Updated weights for policy 1, policy_version 1190799 (0.0009) [2023-12-26 09:10:02,595][123090] Updated weights for policy 1, policy_version 1190809 (0.0010) [2023-12-26 09:10:03,079][123091] Updated weights for policy 0, policy_version 1199386 (0.0005) [2023-12-26 09:10:03,126][123091] Updated weights for policy 0, policy_version 1199396 (0.0005) [2023-12-26 09:10:03,170][123091] Updated weights for policy 0, policy_version 1199406 (0.0005) [2023-12-26 09:10:03,471][123090] Updated weights for policy 1, policy_version 1190820 (0.0010) [2023-12-26 09:10:03,519][123090] Updated weights for policy 1, policy_version 1190830 (0.0009) [2023-12-26 09:10:03,568][123090] Updated weights for policy 1, policy_version 1190841 (0.0010) [2023-12-26 09:10:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 611909632. Throughput: 0: 8989.0, 1: 8754.0. Samples: 611919356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:03,784][121949] Avg episode reward: [(0, '6242.116'), (1, '5273.933')] [2023-12-26 09:10:03,957][123091] Updated weights for policy 0, policy_version 1199416 (0.0006) [2023-12-26 09:10:04,013][123091] Updated weights for policy 0, policy_version 1199426 (0.0005) [2023-12-26 09:10:04,068][123091] Updated weights for policy 0, policy_version 1199436 (0.0006) [2023-12-26 09:10:04,373][123090] Updated weights for policy 1, policy_version 1190852 (0.0008) [2023-12-26 09:10:04,431][123090] Updated weights for policy 1, policy_version 1190862 (0.0005) [2023-12-26 09:10:04,488][123090] Updated weights for policy 1, policy_version 1190872 (0.0006) [2023-12-26 09:10:04,893][123091] Updated weights for policy 0, policy_version 1199446 (0.0008) [2023-12-26 09:10:04,956][123091] Updated weights for policy 0, policy_version 1199456 (0.0011) [2023-12-26 09:10:05,006][123091] Updated weights for policy 0, policy_version 1199467 (0.0009) [2023-12-26 09:10:05,151][123090] Updated weights for policy 1, policy_version 1190882 (0.0005) [2023-12-26 09:10:05,201][123090] Updated weights for policy 1, policy_version 1190892 (0.0006) [2023-12-26 09:10:05,245][123090] Updated weights for policy 1, policy_version 1190902 (0.0010) [2023-12-26 09:10:05,302][123090] Updated weights for policy 1, policy_version 1190912 (0.0007) [2023-12-26 09:10:05,920][123091] Updated weights for policy 0, policy_version 1199478 (0.0010) [2023-12-26 09:10:05,977][123091] Updated weights for policy 0, policy_version 1199488 (0.0009) [2023-12-26 09:10:06,026][123091] Updated weights for policy 0, policy_version 1199498 (0.0009) [2023-12-26 09:10:06,075][123090] Updated weights for policy 1, policy_version 1190922 (0.0008) [2023-12-26 09:10:06,147][123090] Updated weights for policy 1, policy_version 1190933 (0.0011) [2023-12-26 09:10:06,204][123090] Updated weights for policy 1, policy_version 1190943 (0.0009) [2023-12-26 09:10:06,927][123091] Updated weights for policy 0, policy_version 1199508 (0.0010) [2023-12-26 09:10:06,998][123091] Updated weights for policy 0, policy_version 1199518 (0.0010) [2023-12-26 09:10:07,031][123090] Updated weights for policy 1, policy_version 1190953 (0.0008) [2023-12-26 09:10:07,065][123091] Updated weights for policy 0, policy_version 1199528 (0.0008) [2023-12-26 09:10:07,093][123090] Updated weights for policy 1, policy_version 1190963 (0.0009) [2023-12-26 09:10:07,156][123090] Updated weights for policy 1, policy_version 1190973 (0.0010) [2023-12-26 09:10:07,802][123091] Updated weights for policy 0, policy_version 1199538 (0.0007) [2023-12-26 09:10:07,868][123091] Updated weights for policy 0, policy_version 1199548 (0.0005) [2023-12-26 09:10:07,875][123090] Updated weights for policy 1, policy_version 1190983 (0.0006) [2023-12-26 09:10:07,927][123090] Updated weights for policy 1, policy_version 1190993 (0.0006) [2023-12-26 09:10:07,936][123091] Updated weights for policy 0, policy_version 1199558 (0.0008) [2023-12-26 09:10:07,976][123090] Updated weights for policy 1, policy_version 1191003 (0.0006) [2023-12-26 09:10:07,998][123091] Updated weights for policy 0, policy_version 1199568 (0.0009) [2023-12-26 09:10:08,736][123090] Updated weights for policy 1, policy_version 1191013 (0.0007) [2023-12-26 09:10:08,781][123091] Updated weights for policy 0, policy_version 1199578 (0.0009) [2023-12-26 09:10:08,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 611991552. Throughput: 0: 9011.5, 1: 8798.4. Samples: 611972540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:08,784][121949] Avg episode reward: [(0, '6127.362'), (1, '5317.965')] [2023-12-26 09:10:08,792][123090] Updated weights for policy 1, policy_version 1191023 (0.0006) [2023-12-26 09:10:08,843][123091] Updated weights for policy 0, policy_version 1199588 (0.0008) [2023-12-26 09:10:08,849][123090] Updated weights for policy 1, policy_version 1191033 (0.0008) [2023-12-26 09:10:08,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001191040_304906240.pth... [2023-12-26 09:10:08,895][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001189984_304635904.pth [2023-12-26 09:10:08,902][123091] Updated weights for policy 0, policy_version 1199598 (0.0009) [2023-12-26 09:10:08,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001199600_307101696.pth... [2023-12-26 09:10:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001198544_306831360.pth [2023-12-26 09:10:09,688][123090] Updated weights for policy 1, policy_version 1191043 (0.0006) [2023-12-26 09:10:09,748][123091] Updated weights for policy 0, policy_version 1199608 (0.0009) [2023-12-26 09:10:09,754][123090] Updated weights for policy 1, policy_version 1191053 (0.0005) [2023-12-26 09:10:09,819][123091] Updated weights for policy 0, policy_version 1199618 (0.0009) [2023-12-26 09:10:09,837][123090] Updated weights for policy 1, policy_version 1191063 (0.0006) [2023-12-26 09:10:09,892][123091] Updated weights for policy 0, policy_version 1199628 (0.0009) [2023-12-26 09:10:10,575][123090] Updated weights for policy 1, policy_version 1191073 (0.0009) [2023-12-26 09:10:10,633][123090] Updated weights for policy 1, policy_version 1191083 (0.0007) [2023-12-26 09:10:10,685][123091] Updated weights for policy 0, policy_version 1199638 (0.0008) [2023-12-26 09:10:10,708][123090] Updated weights for policy 1, policy_version 1191093 (0.0008) [2023-12-26 09:10:10,740][123091] Updated weights for policy 0, policy_version 1199648 (0.0006) [2023-12-26 09:10:10,776][123090] Updated weights for policy 1, policy_version 1191103 (0.0009) [2023-12-26 09:10:10,795][123091] Updated weights for policy 0, policy_version 1199658 (0.0006) [2023-12-26 09:10:11,527][123091] Updated weights for policy 0, policy_version 1199668 (0.0005) [2023-12-26 09:10:11,576][123091] Updated weights for policy 0, policy_version 1199678 (0.0006) [2023-12-26 09:10:11,598][123090] Updated weights for policy 1, policy_version 1191113 (0.0010) [2023-12-26 09:10:11,647][123091] Updated weights for policy 0, policy_version 1199688 (0.0007) [2023-12-26 09:10:11,672][123090] Updated weights for policy 1, policy_version 1191123 (0.0010) [2023-12-26 09:10:11,739][123090] Updated weights for policy 1, policy_version 1191133 (0.0009) [2023-12-26 09:10:12,516][123091] Updated weights for policy 0, policy_version 1199698 (0.0007) [2023-12-26 09:10:12,559][123090] Updated weights for policy 1, policy_version 1191143 (0.0007) [2023-12-26 09:10:12,574][123091] Updated weights for policy 0, policy_version 1199708 (0.0009) [2023-12-26 09:10:12,628][123090] Updated weights for policy 1, policy_version 1191153 (0.0006) [2023-12-26 09:10:12,630][123091] Updated weights for policy 0, policy_version 1199718 (0.0008) [2023-12-26 09:10:12,699][123090] Updated weights for policy 1, policy_version 1191163 (0.0008) [2023-12-26 09:10:13,434][123090] Updated weights for policy 1, policy_version 1191173 (0.0005) [2023-12-26 09:10:13,495][123091] Updated weights for policy 0, policy_version 1199729 (0.0009) [2023-12-26 09:10:13,513][123090] Updated weights for policy 1, policy_version 1191183 (0.0006) [2023-12-26 09:10:13,560][123091] Updated weights for policy 0, policy_version 1199739 (0.0009) [2023-12-26 09:10:13,578][123090] Updated weights for policy 1, policy_version 1191193 (0.0006) [2023-12-26 09:10:13,623][123091] Updated weights for policy 0, policy_version 1199749 (0.0011) [2023-12-26 09:10:13,674][123091] Updated weights for policy 0, policy_version 1199759 (0.0010) [2023-12-26 09:10:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 612089856. Throughput: 0: 8880.0, 1: 8896.1. Samples: 612079044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:13,785][121949] Avg episode reward: [(0, '6108.347'), (1, '5291.844')] [2023-12-26 09:10:14,173][123090] Updated weights for policy 1, policy_version 1191203 (0.0008) [2023-12-26 09:10:14,246][123090] Updated weights for policy 1, policy_version 1191213 (0.0009) [2023-12-26 09:10:14,303][123090] Updated weights for policy 1, policy_version 1191223 (0.0009) [2023-12-26 09:10:14,424][123091] Updated weights for policy 0, policy_version 1199769 (0.0006) [2023-12-26 09:10:14,488][123091] Updated weights for policy 0, policy_version 1199779 (0.0006) [2023-12-26 09:10:14,550][123091] Updated weights for policy 0, policy_version 1199789 (0.0006) [2023-12-26 09:10:15,046][123090] Updated weights for policy 1, policy_version 1191233 (0.0008) [2023-12-26 09:10:15,113][123090] Updated weights for policy 1, policy_version 1191243 (0.0009) [2023-12-26 09:10:15,180][123090] Updated weights for policy 1, policy_version 1191253 (0.0009) [2023-12-26 09:10:15,250][123090] Updated weights for policy 1, policy_version 1191263 (0.0009) [2023-12-26 09:10:15,269][123091] Updated weights for policy 0, policy_version 1199799 (0.0007) [2023-12-26 09:10:15,330][123091] Updated weights for policy 0, policy_version 1199809 (0.0009) [2023-12-26 09:10:15,385][123091] Updated weights for policy 0, policy_version 1199819 (0.0010) [2023-12-26 09:10:16,064][123090] Updated weights for policy 1, policy_version 1191273 (0.0009) [2023-12-26 09:10:16,132][123090] Updated weights for policy 1, policy_version 1191283 (0.0010) [2023-12-26 09:10:16,181][123090] Updated weights for policy 1, policy_version 1191293 (0.0009) [2023-12-26 09:10:16,251][123091] Updated weights for policy 0, policy_version 1199829 (0.0007) [2023-12-26 09:10:16,320][123091] Updated weights for policy 0, policy_version 1199839 (0.0005) [2023-12-26 09:10:16,393][123091] Updated weights for policy 0, policy_version 1199849 (0.0005) [2023-12-26 09:10:17,037][123091] Updated weights for policy 0, policy_version 1199859 (0.0009) [2023-12-26 09:10:17,055][123090] Updated weights for policy 1, policy_version 1191303 (0.0007) [2023-12-26 09:10:17,096][123091] Updated weights for policy 0, policy_version 1199869 (0.0007) [2023-12-26 09:10:17,122][123090] Updated weights for policy 1, policy_version 1191313 (0.0008) [2023-12-26 09:10:17,146][123091] Updated weights for policy 0, policy_version 1199879 (0.0008) [2023-12-26 09:10:17,184][123090] Updated weights for policy 1, policy_version 1191323 (0.0009) [2023-12-26 09:10:17,909][123091] Updated weights for policy 0, policy_version 1199889 (0.0008) [2023-12-26 09:10:17,926][123090] Updated weights for policy 1, policy_version 1191333 (0.0009) [2023-12-26 09:10:17,977][123090] Updated weights for policy 1, policy_version 1191343 (0.0008) [2023-12-26 09:10:17,986][123091] Updated weights for policy 0, policy_version 1199899 (0.0006) [2023-12-26 09:10:18,036][123090] Updated weights for policy 1, policy_version 1191353 (0.0009) [2023-12-26 09:10:18,043][123091] Updated weights for policy 0, policy_version 1199909 (0.0006) [2023-12-26 09:10:18,102][123091] Updated weights for policy 0, policy_version 1199919 (0.0006) [2023-12-26 09:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 612171776. Throughput: 0: 8902.1, 1: 8889.1. Samples: 612188128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:18,785][121949] Avg episode reward: [(0, '6212.520'), (1, '5305.772')] [2023-12-26 09:10:18,791][123091] Updated weights for policy 0, policy_version 1199929 (0.0009) [2023-12-26 09:10:18,849][123091] Updated weights for policy 0, policy_version 1199939 (0.0006) [2023-12-26 09:10:18,898][123091] Updated weights for policy 0, policy_version 1199949 (0.0005) [2023-12-26 09:10:18,967][123090] Updated weights for policy 1, policy_version 1191363 (0.0010) [2023-12-26 09:10:19,021][123090] Updated weights for policy 1, policy_version 1191373 (0.0010) [2023-12-26 09:10:19,079][123090] Updated weights for policy 1, policy_version 1191384 (0.0010) [2023-12-26 09:10:19,534][123091] Updated weights for policy 0, policy_version 1199959 (0.0006) [2023-12-26 09:10:19,594][123091] Updated weights for policy 0, policy_version 1199969 (0.0005) [2023-12-26 09:10:19,651][123091] Updated weights for policy 0, policy_version 1199979 (0.0005) [2023-12-26 09:10:20,006][123090] Updated weights for policy 1, policy_version 1191394 (0.0009) [2023-12-26 09:10:20,076][123090] Updated weights for policy 1, policy_version 1191404 (0.0007) [2023-12-26 09:10:20,137][123090] Updated weights for policy 1, policy_version 1191414 (0.0005) [2023-12-26 09:10:20,200][123090] Updated weights for policy 1, policy_version 1191424 (0.0007) [2023-12-26 09:10:20,387][123091] Updated weights for policy 0, policy_version 1199989 (0.0009) [2023-12-26 09:10:20,455][123091] Updated weights for policy 0, policy_version 1199999 (0.0006) [2023-12-26 09:10:20,516][123091] Updated weights for policy 0, policy_version 1200009 (0.0006) [2023-12-26 09:10:20,978][123090] Updated weights for policy 1, policy_version 1191434 (0.0010) [2023-12-26 09:10:21,052][123090] Updated weights for policy 1, policy_version 1191444 (0.0009) [2023-12-26 09:10:21,119][123090] Updated weights for policy 1, policy_version 1191454 (0.0010) [2023-12-26 09:10:21,306][123091] Updated weights for policy 0, policy_version 1200019 (0.0006) [2023-12-26 09:10:21,377][123091] Updated weights for policy 0, policy_version 1200029 (0.0007) [2023-12-26 09:10:21,440][123091] Updated weights for policy 0, policy_version 1200039 (0.0011) [2023-12-26 09:10:21,863][123090] Updated weights for policy 1, policy_version 1191464 (0.0010) [2023-12-26 09:10:21,937][123090] Updated weights for policy 1, policy_version 1191474 (0.0009) [2023-12-26 09:10:22,009][123090] Updated weights for policy 1, policy_version 1191484 (0.0009) [2023-12-26 09:10:22,290][123091] Updated weights for policy 0, policy_version 1200049 (0.0011) [2023-12-26 09:10:22,347][123091] Updated weights for policy 0, policy_version 1200059 (0.0009) [2023-12-26 09:10:22,420][123091] Updated weights for policy 0, policy_version 1200069 (0.0010) [2023-12-26 09:10:22,485][123091] Updated weights for policy 0, policy_version 1200079 (0.0009) [2023-12-26 09:10:22,861][123090] Updated weights for policy 1, policy_version 1191494 (0.0011) [2023-12-26 09:10:22,917][123090] Updated weights for policy 1, policy_version 1191504 (0.0010) [2023-12-26 09:10:22,969][123090] Updated weights for policy 1, policy_version 1191514 (0.0010) [2023-12-26 09:10:23,272][123091] Updated weights for policy 0, policy_version 1200089 (0.0010) [2023-12-26 09:10:23,325][123091] Updated weights for policy 0, policy_version 1200099 (0.0010) [2023-12-26 09:10:23,384][123091] Updated weights for policy 0, policy_version 1200109 (0.0010) [2023-12-26 09:10:23,679][123090] Updated weights for policy 1, policy_version 1191524 (0.0005) [2023-12-26 09:10:23,752][123090] Updated weights for policy 1, policy_version 1191534 (0.0005) [2023-12-26 09:10:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.5, 300 sec: 17717.0). Total num frames: 612261888. Throughput: 0: 8920.9, 1: 8857.0. Samples: 612241104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:23,784][121949] Avg episode reward: [(0, '6207.884'), (1, '5465.902')] [2023-12-26 09:10:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001200112_307232768.pth... [2023-12-26 09:10:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001199056_306962432.pth [2023-12-26 09:10:23,807][123090] Updated weights for policy 1, policy_version 1191544 (0.0005) [2023-12-26 09:10:23,864][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001191552_305037312.pth... [2023-12-26 09:10:23,867][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001190496_304766976.pth [2023-12-26 09:10:24,113][123091] Updated weights for policy 0, policy_version 1200119 (0.0006) [2023-12-26 09:10:24,191][123091] Updated weights for policy 0, policy_version 1200129 (0.0005) [2023-12-26 09:10:24,265][123091] Updated weights for policy 0, policy_version 1200139 (0.0005) [2023-12-26 09:10:24,514][123090] Updated weights for policy 1, policy_version 1191554 (0.0006) [2023-12-26 09:10:24,573][123090] Updated weights for policy 1, policy_version 1191564 (0.0005) [2023-12-26 09:10:24,637][123090] Updated weights for policy 1, policy_version 1191574 (0.0005) [2023-12-26 09:10:24,699][123090] Updated weights for policy 1, policy_version 1191584 (0.0005) [2023-12-26 09:10:25,034][123091] Updated weights for policy 0, policy_version 1200149 (0.0007) [2023-12-26 09:10:25,097][123091] Updated weights for policy 0, policy_version 1200159 (0.0005) [2023-12-26 09:10:25,159][123091] Updated weights for policy 0, policy_version 1200169 (0.0005) [2023-12-26 09:10:25,370][123090] Updated weights for policy 1, policy_version 1191594 (0.0010) [2023-12-26 09:10:25,430][123090] Updated weights for policy 1, policy_version 1191604 (0.0010) [2023-12-26 09:10:25,493][123090] Updated weights for policy 1, policy_version 1191614 (0.0010) [2023-12-26 09:10:25,831][123091] Updated weights for policy 0, policy_version 1200179 (0.0005) [2023-12-26 09:10:25,899][123091] Updated weights for policy 0, policy_version 1200189 (0.0005) [2023-12-26 09:10:25,967][123091] Updated weights for policy 0, policy_version 1200199 (0.0005) [2023-12-26 09:10:26,245][123090] Updated weights for policy 1, policy_version 1191624 (0.0008) [2023-12-26 09:10:26,293][123090] Updated weights for policy 1, policy_version 1191634 (0.0008) [2023-12-26 09:10:26,339][123090] Updated weights for policy 1, policy_version 1191644 (0.0008) [2023-12-26 09:10:26,636][123091] Updated weights for policy 0, policy_version 1200209 (0.0006) [2023-12-26 09:10:26,685][123091] Updated weights for policy 0, policy_version 1200219 (0.0005) [2023-12-26 09:10:26,739][123091] Updated weights for policy 0, policy_version 1200229 (0.0005) [2023-12-26 09:10:26,787][123091] Updated weights for policy 0, policy_version 1200239 (0.0006) [2023-12-26 09:10:27,086][123090] Updated weights for policy 1, policy_version 1191654 (0.0009) [2023-12-26 09:10:27,143][123090] Updated weights for policy 1, policy_version 1191664 (0.0010) [2023-12-26 09:10:27,203][123090] Updated weights for policy 1, policy_version 1191674 (0.0010) [2023-12-26 09:10:27,549][123091] Updated weights for policy 0, policy_version 1200249 (0.0008) [2023-12-26 09:10:27,615][123091] Updated weights for policy 0, policy_version 1200259 (0.0005) [2023-12-26 09:10:27,676][123091] Updated weights for policy 0, policy_version 1200269 (0.0009) [2023-12-26 09:10:27,946][123090] Updated weights for policy 1, policy_version 1191684 (0.0009) [2023-12-26 09:10:28,011][123090] Updated weights for policy 1, policy_version 1191694 (0.0009) [2023-12-26 09:10:28,084][123090] Updated weights for policy 1, policy_version 1191704 (0.0008) [2023-12-26 09:10:28,438][123091] Updated weights for policy 0, policy_version 1200279 (0.0007) [2023-12-26 09:10:28,490][123091] Updated weights for policy 0, policy_version 1200289 (0.0005) [2023-12-26 09:10:28,547][123091] Updated weights for policy 0, policy_version 1200299 (0.0005) [2023-12-26 09:10:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 612360192. Throughput: 0: 8978.6, 1: 8968.5. Samples: 612353316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:28,784][121949] Avg episode reward: [(0, '6188.228'), (1, '5234.734')] [2023-12-26 09:10:28,918][123090] Updated weights for policy 1, policy_version 1191714 (0.0007) [2023-12-26 09:10:28,984][123090] Updated weights for policy 1, policy_version 1191724 (0.0009) [2023-12-26 09:10:29,058][123090] Updated weights for policy 1, policy_version 1191734 (0.0010) [2023-12-26 09:10:29,123][123090] Updated weights for policy 1, policy_version 1191744 (0.0010) [2023-12-26 09:10:29,157][123091] Updated weights for policy 0, policy_version 1200309 (0.0005) [2023-12-26 09:10:29,217][123091] Updated weights for policy 0, policy_version 1200319 (0.0006) [2023-12-26 09:10:29,284][123091] Updated weights for policy 0, policy_version 1200329 (0.0007) [2023-12-26 09:10:29,933][123090] Updated weights for policy 1, policy_version 1191754 (0.0006) [2023-12-26 09:10:29,947][123091] Updated weights for policy 0, policy_version 1200339 (0.0008) [2023-12-26 09:10:29,995][123090] Updated weights for policy 1, policy_version 1191764 (0.0008) [2023-12-26 09:10:30,011][123091] Updated weights for policy 0, policy_version 1200349 (0.0011) [2023-12-26 09:10:30,050][123090] Updated weights for policy 1, policy_version 1191774 (0.0008) [2023-12-26 09:10:30,070][123091] Updated weights for policy 0, policy_version 1200359 (0.0010) [2023-12-26 09:10:30,750][123090] Updated weights for policy 1, policy_version 1191784 (0.0007) [2023-12-26 09:10:30,809][123090] Updated weights for policy 1, policy_version 1191794 (0.0005) [2023-12-26 09:10:30,867][123090] Updated weights for policy 1, policy_version 1191804 (0.0005) [2023-12-26 09:10:30,898][123091] Updated weights for policy 0, policy_version 1200369 (0.0010) [2023-12-26 09:10:30,953][123091] Updated weights for policy 0, policy_version 1200379 (0.0009) [2023-12-26 09:10:31,017][123091] Updated weights for policy 0, policy_version 1200389 (0.0009) [2023-12-26 09:10:31,082][123091] Updated weights for policy 0, policy_version 1200399 (0.0010) [2023-12-26 09:10:31,689][123090] Updated weights for policy 1, policy_version 1191814 (0.0009) [2023-12-26 09:10:31,751][123090] Updated weights for policy 1, policy_version 1191824 (0.0012) [2023-12-26 09:10:31,829][123090] Updated weights for policy 1, policy_version 1191834 (0.0009) [2023-12-26 09:10:31,888][123091] Updated weights for policy 0, policy_version 1200409 (0.0006) [2023-12-26 09:10:31,949][123091] Updated weights for policy 0, policy_version 1200419 (0.0005) [2023-12-26 09:10:32,013][123091] Updated weights for policy 0, policy_version 1200429 (0.0005) [2023-12-26 09:10:32,670][123090] Updated weights for policy 1, policy_version 1191844 (0.0008) [2023-12-26 09:10:32,710][123091] Updated weights for policy 0, policy_version 1200439 (0.0005) [2023-12-26 09:10:32,727][123090] Updated weights for policy 1, policy_version 1191854 (0.0006) [2023-12-26 09:10:32,776][123091] Updated weights for policy 0, policy_version 1200449 (0.0006) [2023-12-26 09:10:32,788][123090] Updated weights for policy 1, policy_version 1191864 (0.0009) [2023-12-26 09:10:32,842][123091] Updated weights for policy 0, policy_version 1200459 (0.0006) [2023-12-26 09:10:33,462][123091] Updated weights for policy 0, policy_version 1200469 (0.0005) [2023-12-26 09:10:33,515][123091] Updated weights for policy 0, policy_version 1200479 (0.0005) [2023-12-26 09:10:33,515][123090] Updated weights for policy 1, policy_version 1191874 (0.0009) [2023-12-26 09:10:33,572][123090] Updated weights for policy 1, policy_version 1191884 (0.0005) [2023-12-26 09:10:33,577][123091] Updated weights for policy 0, policy_version 1200489 (0.0005) [2023-12-26 09:10:33,632][123090] Updated weights for policy 1, policy_version 1191894 (0.0005) [2023-12-26 09:10:33,681][123090] Updated weights for policy 1, policy_version 1191904 (0.0005) [2023-12-26 09:10:33,784][121949] Fps is (10 sec: 19660.4, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 612458496. Throughput: 0: 9119.2, 1: 8930.1. Samples: 612465748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:33,785][121949] Avg episode reward: [(0, '6195.324'), (1, '5015.403')] [2023-12-26 09:10:34,293][123091] Updated weights for policy 0, policy_version 1200499 (0.0006) [2023-12-26 09:10:34,356][123091] Updated weights for policy 0, policy_version 1200509 (0.0010) [2023-12-26 09:10:34,418][123091] Updated weights for policy 0, policy_version 1200519 (0.0009) [2023-12-26 09:10:34,444][123090] Updated weights for policy 1, policy_version 1191914 (0.0006) [2023-12-26 09:10:34,507][123090] Updated weights for policy 1, policy_version 1191924 (0.0009) [2023-12-26 09:10:34,563][123090] Updated weights for policy 1, policy_version 1191934 (0.0009) [2023-12-26 09:10:35,247][123091] Updated weights for policy 0, policy_version 1200529 (0.0010) [2023-12-26 09:10:35,296][123091] Updated weights for policy 0, policy_version 1200539 (0.0010) [2023-12-26 09:10:35,347][123091] Updated weights for policy 0, policy_version 1200549 (0.0010) [2023-12-26 09:10:35,374][123090] Updated weights for policy 1, policy_version 1191944 (0.0007) [2023-12-26 09:10:35,402][123091] Updated weights for policy 0, policy_version 1200559 (0.0009) [2023-12-26 09:10:35,435][123090] Updated weights for policy 1, policy_version 1191954 (0.0008) [2023-12-26 09:10:35,493][123090] Updated weights for policy 1, policy_version 1191964 (0.0009) [2023-12-26 09:10:36,163][123091] Updated weights for policy 0, policy_version 1200569 (0.0008) [2023-12-26 09:10:36,228][123091] Updated weights for policy 0, policy_version 1200579 (0.0006) [2023-12-26 09:10:36,244][123090] Updated weights for policy 1, policy_version 1191974 (0.0010) [2023-12-26 09:10:36,286][123091] Updated weights for policy 0, policy_version 1200589 (0.0005) [2023-12-26 09:10:36,307][123090] Updated weights for policy 1, policy_version 1191984 (0.0010) [2023-12-26 09:10:36,367][123090] Updated weights for policy 1, policy_version 1191994 (0.0010) [2023-12-26 09:10:36,990][123091] Updated weights for policy 0, policy_version 1200599 (0.0009) [2023-12-26 09:10:37,058][123091] Updated weights for policy 0, policy_version 1200609 (0.0011) [2023-12-26 09:10:37,126][123091] Updated weights for policy 0, policy_version 1200619 (0.0011) [2023-12-26 09:10:37,205][123090] Updated weights for policy 1, policy_version 1192004 (0.0011) [2023-12-26 09:10:37,269][123090] Updated weights for policy 1, policy_version 1192014 (0.0011) [2023-12-26 09:10:37,337][123090] Updated weights for policy 1, policy_version 1192024 (0.0011) [2023-12-26 09:10:37,949][123091] Updated weights for policy 0, policy_version 1200629 (0.0011) [2023-12-26 09:10:38,000][123091] Updated weights for policy 0, policy_version 1200639 (0.0011) [2023-12-26 09:10:38,049][123091] Updated weights for policy 0, policy_version 1200649 (0.0011) [2023-12-26 09:10:38,068][123090] Updated weights for policy 1, policy_version 1192034 (0.0010) [2023-12-26 09:10:38,137][123090] Updated weights for policy 1, policy_version 1192044 (0.0006) [2023-12-26 09:10:38,201][123090] Updated weights for policy 1, policy_version 1192054 (0.0005) [2023-12-26 09:10:38,264][123090] Updated weights for policy 1, policy_version 1192064 (0.0006) [2023-12-26 09:10:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 612540416. Throughput: 0: 9153.6, 1: 8895.2. Samples: 612520256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:38,785][121949] Avg episode reward: [(0, '6161.956'), (1, '5305.049')] [2023-12-26 09:10:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001200656_307372032.pth... [2023-12-26 09:10:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001192064_305168384.pth... [2023-12-26 09:10:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001199600_307101696.pth [2023-12-26 09:10:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001191040_304906240.pth [2023-12-26 09:10:38,908][123091] Updated weights for policy 0, policy_version 1200659 (0.0011) [2023-12-26 09:10:38,945][123090] Updated weights for policy 1, policy_version 1192074 (0.0006) [2023-12-26 09:10:38,971][123091] Updated weights for policy 0, policy_version 1200669 (0.0011) [2023-12-26 09:10:39,014][123090] Updated weights for policy 1, policy_version 1192084 (0.0006) [2023-12-26 09:10:39,032][123091] Updated weights for policy 0, policy_version 1200679 (0.0011) [2023-12-26 09:10:39,081][123090] Updated weights for policy 1, policy_version 1192094 (0.0006) [2023-12-26 09:10:39,767][123090] Updated weights for policy 1, policy_version 1192104 (0.0005) [2023-12-26 09:10:39,830][123090] Updated weights for policy 1, policy_version 1192114 (0.0007) [2023-12-26 09:10:39,873][123091] Updated weights for policy 0, policy_version 1200689 (0.0011) [2023-12-26 09:10:39,901][123090] Updated weights for policy 1, policy_version 1192124 (0.0008) [2023-12-26 09:10:39,936][123091] Updated weights for policy 0, policy_version 1200699 (0.0010) [2023-12-26 09:10:39,981][123091] Updated weights for policy 0, policy_version 1200709 (0.0010) [2023-12-26 09:10:40,044][123091] Updated weights for policy 0, policy_version 1200719 (0.0011) [2023-12-26 09:10:40,705][123090] Updated weights for policy 1, policy_version 1192134 (0.0010) [2023-12-26 09:10:40,773][123090] Updated weights for policy 1, policy_version 1192144 (0.0007) [2023-12-26 09:10:40,847][123090] Updated weights for policy 1, policy_version 1192154 (0.0005) [2023-12-26 09:10:40,859][123091] Updated weights for policy 0, policy_version 1200729 (0.0006) [2023-12-26 09:10:40,927][123091] Updated weights for policy 0, policy_version 1200739 (0.0006) [2023-12-26 09:10:40,997][123091] Updated weights for policy 0, policy_version 1200749 (0.0006) [2023-12-26 09:10:41,620][123090] Updated weights for policy 1, policy_version 1192164 (0.0008) [2023-12-26 09:10:41,678][123091] Updated weights for policy 0, policy_version 1200759 (0.0007) [2023-12-26 09:10:41,696][123090] Updated weights for policy 1, policy_version 1192174 (0.0009) [2023-12-26 09:10:41,740][123091] Updated weights for policy 0, policy_version 1200769 (0.0008) [2023-12-26 09:10:41,781][123090] Updated weights for policy 1, policy_version 1192184 (0.0009) [2023-12-26 09:10:41,816][123091] Updated weights for policy 0, policy_version 1200779 (0.0008) [2023-12-26 09:10:42,611][123090] Updated weights for policy 1, policy_version 1192194 (0.0008) [2023-12-26 09:10:42,637][123091] Updated weights for policy 0, policy_version 1200789 (0.0007) [2023-12-26 09:10:42,674][123090] Updated weights for policy 1, policy_version 1192204 (0.0008) [2023-12-26 09:10:42,702][123091] Updated weights for policy 0, policy_version 1200799 (0.0009) [2023-12-26 09:10:42,734][123090] Updated weights for policy 1, policy_version 1192214 (0.0005) [2023-12-26 09:10:42,766][123091] Updated weights for policy 0, policy_version 1200809 (0.0010) [2023-12-26 09:10:42,804][123090] Updated weights for policy 1, policy_version 1192224 (0.0007) [2023-12-26 09:10:43,573][123091] Updated weights for policy 0, policy_version 1200819 (0.0010) [2023-12-26 09:10:43,601][123090] Updated weights for policy 1, policy_version 1192234 (0.0008) [2023-12-26 09:10:43,625][123091] Updated weights for policy 0, policy_version 1200829 (0.0009) [2023-12-26 09:10:43,656][123090] Updated weights for policy 1, policy_version 1192244 (0.0008) [2023-12-26 09:10:43,682][123091] Updated weights for policy 0, policy_version 1200839 (0.0006) [2023-12-26 09:10:43,709][123090] Updated weights for policy 1, policy_version 1192254 (0.0009) [2023-12-26 09:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 612638720. Throughput: 0: 9099.1, 1: 8930.6. Samples: 612626212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:43,785][121949] Avg episode reward: [(0, '6237.987'), (1, '5415.663')] [2023-12-26 09:10:44,420][123091] Updated weights for policy 0, policy_version 1200849 (0.0006) [2023-12-26 09:10:44,474][123091] Updated weights for policy 0, policy_version 1200859 (0.0008) [2023-12-26 09:10:44,534][123091] Updated weights for policy 0, policy_version 1200869 (0.0008) [2023-12-26 09:10:44,589][123091] Updated weights for policy 0, policy_version 1200879 (0.0006) [2023-12-26 09:10:44,606][123090] Updated weights for policy 1, policy_version 1192264 (0.0008) [2023-12-26 09:10:44,665][123090] Updated weights for policy 1, policy_version 1192274 (0.0009) [2023-12-26 09:10:44,721][123090] Updated weights for policy 1, policy_version 1192284 (0.0008) [2023-12-26 09:10:45,331][123091] Updated weights for policy 0, policy_version 1200889 (0.0006) [2023-12-26 09:10:45,383][123091] Updated weights for policy 0, policy_version 1200899 (0.0006) [2023-12-26 09:10:45,453][123091] Updated weights for policy 0, policy_version 1200909 (0.0005) [2023-12-26 09:10:45,547][123090] Updated weights for policy 1, policy_version 1192294 (0.0009) [2023-12-26 09:10:45,610][123090] Updated weights for policy 1, policy_version 1192305 (0.0010) [2023-12-26 09:10:45,665][123090] Updated weights for policy 1, policy_version 1192315 (0.0010) [2023-12-26 09:10:46,234][123091] Updated weights for policy 0, policy_version 1200919 (0.0008) [2023-12-26 09:10:46,292][123091] Updated weights for policy 0, policy_version 1200929 (0.0009) [2023-12-26 09:10:46,337][123091] Updated weights for policy 0, policy_version 1200939 (0.0008) [2023-12-26 09:10:46,508][123090] Updated weights for policy 1, policy_version 1192325 (0.0009) [2023-12-26 09:10:46,564][123090] Updated weights for policy 1, policy_version 1192335 (0.0009) [2023-12-26 09:10:46,616][123090] Updated weights for policy 1, policy_version 1192345 (0.0009) [2023-12-26 09:10:47,189][123091] Updated weights for policy 0, policy_version 1200949 (0.0010) [2023-12-26 09:10:47,239][123091] Updated weights for policy 0, policy_version 1200960 (0.0010) [2023-12-26 09:10:47,291][123091] Updated weights for policy 0, policy_version 1200970 (0.0009) [2023-12-26 09:10:47,483][123090] Updated weights for policy 1, policy_version 1192355 (0.0009) [2023-12-26 09:10:47,542][123090] Updated weights for policy 1, policy_version 1192366 (0.0009) [2023-12-26 09:10:47,589][123090] Updated weights for policy 1, policy_version 1192376 (0.0009) [2023-12-26 09:10:48,113][123091] Updated weights for policy 0, policy_version 1200980 (0.0010) [2023-12-26 09:10:48,171][123091] Updated weights for policy 0, policy_version 1200990 (0.0009) [2023-12-26 09:10:48,235][123091] Updated weights for policy 0, policy_version 1201000 (0.0010) [2023-12-26 09:10:48,477][123090] Updated weights for policy 1, policy_version 1192386 (0.0009) [2023-12-26 09:10:48,548][123090] Updated weights for policy 1, policy_version 1192396 (0.0006) [2023-12-26 09:10:48,613][123090] Updated weights for policy 1, policy_version 1192406 (0.0006) [2023-12-26 09:10:48,680][123090] Updated weights for policy 1, policy_version 1192416 (0.0006) [2023-12-26 09:10:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 612720640. Throughput: 0: 9088.2, 1: 8924.4. Samples: 612729928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:48,785][121949] Avg episode reward: [(0, '6233.053'), (1, '5461.689')] [2023-12-26 09:10:49,169][123091] Updated weights for policy 0, policy_version 1201010 (0.0010) [2023-12-26 09:10:49,234][123091] Updated weights for policy 0, policy_version 1201020 (0.0009) [2023-12-26 09:10:49,276][123090] Updated weights for policy 1, policy_version 1192426 (0.0008) [2023-12-26 09:10:49,295][123091] Updated weights for policy 0, policy_version 1201030 (0.0010) [2023-12-26 09:10:49,349][123090] Updated weights for policy 1, policy_version 1192436 (0.0008) [2023-12-26 09:10:49,367][123091] Updated weights for policy 0, policy_version 1201040 (0.0011) [2023-12-26 09:10:49,412][123090] Updated weights for policy 1, policy_version 1192446 (0.0010) [2023-12-26 09:10:50,206][123091] Updated weights for policy 0, policy_version 1201050 (0.0011) [2023-12-26 09:10:50,245][123090] Updated weights for policy 1, policy_version 1192456 (0.0010) [2023-12-26 09:10:50,270][123091] Updated weights for policy 0, policy_version 1201060 (0.0011) [2023-12-26 09:10:50,308][123090] Updated weights for policy 1, policy_version 1192466 (0.0011) [2023-12-26 09:10:50,318][123091] Updated weights for policy 0, policy_version 1201070 (0.0010) [2023-12-26 09:10:50,363][123090] Updated weights for policy 1, policy_version 1192476 (0.0010) [2023-12-26 09:10:51,090][123090] Updated weights for policy 1, policy_version 1192486 (0.0011) [2023-12-26 09:10:51,148][123091] Updated weights for policy 0, policy_version 1201080 (0.0010) [2023-12-26 09:10:51,157][123090] Updated weights for policy 1, policy_version 1192496 (0.0009) [2023-12-26 09:10:51,211][123091] Updated weights for policy 0, policy_version 1201090 (0.0011) [2023-12-26 09:10:51,225][123090] Updated weights for policy 1, policy_version 1192506 (0.0005) [2023-12-26 09:10:51,276][123091] Updated weights for policy 0, policy_version 1201100 (0.0011) [2023-12-26 09:10:51,935][123090] Updated weights for policy 1, policy_version 1192516 (0.0006) [2023-12-26 09:10:52,010][123090] Updated weights for policy 1, policy_version 1192526 (0.0005) [2023-12-26 09:10:52,078][123090] Updated weights for policy 1, policy_version 1192536 (0.0007) [2023-12-26 09:10:52,096][123091] Updated weights for policy 0, policy_version 1201110 (0.0011) [2023-12-26 09:10:52,148][123091] Updated weights for policy 0, policy_version 1201120 (0.0010) [2023-12-26 09:10:52,204][123091] Updated weights for policy 0, policy_version 1201130 (0.0011) [2023-12-26 09:10:52,869][123090] Updated weights for policy 1, policy_version 1192546 (0.0010) [2023-12-26 09:10:52,940][123090] Updated weights for policy 1, policy_version 1192556 (0.0009) [2023-12-26 09:10:52,999][123090] Updated weights for policy 1, policy_version 1192566 (0.0009) [2023-12-26 09:10:53,028][123091] Updated weights for policy 0, policy_version 1201140 (0.0008) [2023-12-26 09:10:53,052][123090] Updated weights for policy 1, policy_version 1192576 (0.0009) [2023-12-26 09:10:53,079][123091] Updated weights for policy 0, policy_version 1201150 (0.0007) [2023-12-26 09:10:53,145][123091] Updated weights for policy 0, policy_version 1201160 (0.0007) [2023-12-26 09:10:53,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 612802560. Throughput: 0: 9084.9, 1: 8927.9. Samples: 612783120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:53,785][121949] Avg episode reward: [(0, '6173.688'), (1, '5536.368')] [2023-12-26 09:10:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001201168_307503104.pth... [2023-12-26 09:10:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001192576_305299456.pth... [2023-12-26 09:10:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001200112_307232768.pth [2023-12-26 09:10:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001191552_305037312.pth [2023-12-26 09:10:53,888][123091] Updated weights for policy 0, policy_version 1201170 (0.0006) [2023-12-26 09:10:53,915][123090] Updated weights for policy 1, policy_version 1192586 (0.0007) [2023-12-26 09:10:53,946][123091] Updated weights for policy 0, policy_version 1201180 (0.0010) [2023-12-26 09:10:53,970][123090] Updated weights for policy 1, policy_version 1192596 (0.0006) [2023-12-26 09:10:54,001][123091] Updated weights for policy 0, policy_version 1201190 (0.0010) [2023-12-26 09:10:54,019][123090] Updated weights for policy 1, policy_version 1192606 (0.0008) [2023-12-26 09:10:54,047][123091] Updated weights for policy 0, policy_version 1201200 (0.0005) [2023-12-26 09:10:54,807][123090] Updated weights for policy 1, policy_version 1192616 (0.0006) [2023-12-26 09:10:54,814][123091] Updated weights for policy 0, policy_version 1201210 (0.0010) [2023-12-26 09:10:54,867][123090] Updated weights for policy 1, policy_version 1192626 (0.0009) [2023-12-26 09:10:54,878][123091] Updated weights for policy 0, policy_version 1201220 (0.0005) [2023-12-26 09:10:54,924][123090] Updated weights for policy 1, policy_version 1192636 (0.0009) [2023-12-26 09:10:54,939][123091] Updated weights for policy 0, policy_version 1201230 (0.0006) [2023-12-26 09:10:55,670][123091] Updated weights for policy 0, policy_version 1201240 (0.0011) [2023-12-26 09:10:55,737][123091] Updated weights for policy 0, policy_version 1201250 (0.0011) [2023-12-26 09:10:55,742][123090] Updated weights for policy 1, policy_version 1192646 (0.0007) [2023-12-26 09:10:55,798][123091] Updated weights for policy 0, policy_version 1201260 (0.0010) [2023-12-26 09:10:55,805][123090] Updated weights for policy 1, policy_version 1192656 (0.0006) [2023-12-26 09:10:55,872][123090] Updated weights for policy 1, policy_version 1192666 (0.0009) [2023-12-26 09:10:56,392][123091] Updated weights for policy 0, policy_version 1201270 (0.0009) [2023-12-26 09:10:56,447][123091] Updated weights for policy 0, policy_version 1201280 (0.0010) [2023-12-26 09:10:56,498][123091] Updated weights for policy 0, policy_version 1201290 (0.0010) [2023-12-26 09:10:56,598][123090] Updated weights for policy 1, policy_version 1192676 (0.0010) [2023-12-26 09:10:56,667][123090] Updated weights for policy 1, policy_version 1192686 (0.0010) [2023-12-26 09:10:56,739][123090] Updated weights for policy 1, policy_version 1192696 (0.0009) [2023-12-26 09:10:57,236][123091] Updated weights for policy 0, policy_version 1201300 (0.0008) [2023-12-26 09:10:57,295][123091] Updated weights for policy 0, policy_version 1201310 (0.0009) [2023-12-26 09:10:57,344][123091] Updated weights for policy 0, policy_version 1201320 (0.0009) [2023-12-26 09:10:57,555][123090] Updated weights for policy 1, policy_version 1192706 (0.0009) [2023-12-26 09:10:57,606][123090] Updated weights for policy 1, policy_version 1192716 (0.0009) [2023-12-26 09:10:57,653][123090] Updated weights for policy 1, policy_version 1192726 (0.0009) [2023-12-26 09:10:57,710][123090] Updated weights for policy 1, policy_version 1192736 (0.0008) [2023-12-26 09:10:58,190][123091] Updated weights for policy 0, policy_version 1201330 (0.0008) [2023-12-26 09:10:58,258][123091] Updated weights for policy 0, policy_version 1201340 (0.0010) [2023-12-26 09:10:58,316][123091] Updated weights for policy 0, policy_version 1201350 (0.0010) [2023-12-26 09:10:58,382][123091] Updated weights for policy 0, policy_version 1201360 (0.0009) [2023-12-26 09:10:58,533][123090] Updated weights for policy 1, policy_version 1192746 (0.0009) [2023-12-26 09:10:58,599][123090] Updated weights for policy 1, policy_version 1192756 (0.0009) [2023-12-26 09:10:58,678][123090] Updated weights for policy 1, policy_version 1192766 (0.0008) [2023-12-26 09:10:58,786][121949] Fps is (10 sec: 18019.4, 60 sec: 17885.4, 300 sec: 17772.4). Total num frames: 612900864. Throughput: 0: 9153.6, 1: 8906.7. Samples: 612891788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:10:58,786][121949] Avg episode reward: [(0, '6187.034'), (1, '5540.172')] [2023-12-26 09:10:59,315][123091] Updated weights for policy 0, policy_version 1201370 (0.0008) [2023-12-26 09:10:59,393][123091] Updated weights for policy 0, policy_version 1201381 (0.0008) [2023-12-26 09:10:59,453][123091] Updated weights for policy 0, policy_version 1201391 (0.0011) [2023-12-26 09:10:59,577][123090] Updated weights for policy 1, policy_version 1192776 (0.0010) [2023-12-26 09:10:59,645][123090] Updated weights for policy 1, policy_version 1192786 (0.0011) [2023-12-26 09:10:59,693][123090] Updated weights for policy 1, policy_version 1192796 (0.0010) [2023-12-26 09:11:00,265][123091] Updated weights for policy 0, policy_version 1201401 (0.0009) [2023-12-26 09:11:00,327][123091] Updated weights for policy 0, policy_version 1201411 (0.0011) [2023-12-26 09:11:00,394][123091] Updated weights for policy 0, policy_version 1201421 (0.0011) [2023-12-26 09:11:00,451][123090] Updated weights for policy 1, policy_version 1192806 (0.0007) [2023-12-26 09:11:00,509][123090] Updated weights for policy 1, policy_version 1192816 (0.0006) [2023-12-26 09:11:00,556][123090] Updated weights for policy 1, policy_version 1192826 (0.0005) [2023-12-26 09:11:01,179][123091] Updated weights for policy 0, policy_version 1201431 (0.0008) [2023-12-26 09:11:01,239][123091] Updated weights for policy 0, policy_version 1201441 (0.0007) [2023-12-26 09:11:01,285][123090] Updated weights for policy 1, policy_version 1192836 (0.0008) [2023-12-26 09:11:01,300][123091] Updated weights for policy 0, policy_version 1201451 (0.0011) [2023-12-26 09:11:01,343][123090] Updated weights for policy 1, policy_version 1192846 (0.0011) [2023-12-26 09:11:01,403][123090] Updated weights for policy 1, policy_version 1192856 (0.0011) [2023-12-26 09:11:02,112][123091] Updated weights for policy 0, policy_version 1201461 (0.0011) [2023-12-26 09:11:02,175][123091] Updated weights for policy 0, policy_version 1201471 (0.0011) [2023-12-26 09:11:02,178][123090] Updated weights for policy 1, policy_version 1192866 (0.0009) [2023-12-26 09:11:02,242][123091] Updated weights for policy 0, policy_version 1201481 (0.0010) [2023-12-26 09:11:02,242][123090] Updated weights for policy 1, policy_version 1192876 (0.0005) [2023-12-26 09:11:02,313][123090] Updated weights for policy 1, policy_version 1192886 (0.0010) [2023-12-26 09:11:02,376][123090] Updated weights for policy 1, policy_version 1192896 (0.0011) [2023-12-26 09:11:03,045][123091] Updated weights for policy 0, policy_version 1201491 (0.0011) [2023-12-26 09:11:03,099][123091] Updated weights for policy 0, policy_version 1201501 (0.0010) [2023-12-26 09:11:03,134][123090] Updated weights for policy 1, policy_version 1192906 (0.0010) [2023-12-26 09:11:03,153][123091] Updated weights for policy 0, policy_version 1201511 (0.0010) [2023-12-26 09:11:03,192][123090] Updated weights for policy 1, policy_version 1192916 (0.0010) [2023-12-26 09:11:03,252][123090] Updated weights for policy 1, policy_version 1192926 (0.0009) [2023-12-26 09:11:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 612982784. Throughput: 0: 9052.6, 1: 8902.0. Samples: 612996088. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:03,785][121949] Avg episode reward: [(0, '6203.947'), (1, '5497.231')] [2023-12-26 09:11:03,968][123090] Updated weights for policy 1, policy_version 1192936 (0.0005) [2023-12-26 09:11:03,981][123091] Updated weights for policy 0, policy_version 1201521 (0.0010) [2023-12-26 09:11:04,033][123090] Updated weights for policy 1, policy_version 1192946 (0.0008) [2023-12-26 09:11:04,040][123091] Updated weights for policy 0, policy_version 1201531 (0.0011) [2023-12-26 09:11:04,101][123090] Updated weights for policy 1, policy_version 1192956 (0.0008) [2023-12-26 09:11:04,105][123091] Updated weights for policy 0, policy_version 1201541 (0.0011) [2023-12-26 09:11:04,166][123091] Updated weights for policy 0, policy_version 1201551 (0.0011) [2023-12-26 09:11:04,921][123090] Updated weights for policy 1, policy_version 1192966 (0.0009) [2023-12-26 09:11:04,965][123091] Updated weights for policy 0, policy_version 1201561 (0.0006) [2023-12-26 09:11:04,980][123090] Updated weights for policy 1, policy_version 1192976 (0.0008) [2023-12-26 09:11:05,013][123091] Updated weights for policy 0, policy_version 1201571 (0.0005) [2023-12-26 09:11:05,045][123090] Updated weights for policy 1, policy_version 1192986 (0.0006) [2023-12-26 09:11:05,073][123091] Updated weights for policy 0, policy_version 1201581 (0.0007) [2023-12-26 09:11:05,739][123090] Updated weights for policy 1, policy_version 1192996 (0.0006) [2023-12-26 09:11:05,746][123091] Updated weights for policy 0, policy_version 1201591 (0.0006) [2023-12-26 09:11:05,784][123090] Updated weights for policy 1, policy_version 1193006 (0.0009) [2023-12-26 09:11:05,801][123091] Updated weights for policy 0, policy_version 1201601 (0.0007) [2023-12-26 09:11:05,834][123090] Updated weights for policy 1, policy_version 1193016 (0.0009) [2023-12-26 09:11:05,846][123091] Updated weights for policy 0, policy_version 1201611 (0.0006) [2023-12-26 09:11:06,544][123091] Updated weights for policy 0, policy_version 1201621 (0.0008) [2023-12-26 09:11:06,608][123091] Updated weights for policy 0, policy_version 1201631 (0.0011) [2023-12-26 09:11:06,671][123091] Updated weights for policy 0, policy_version 1201641 (0.0011) [2023-12-26 09:11:06,761][123090] Updated weights for policy 1, policy_version 1193026 (0.0009) [2023-12-26 09:11:06,826][123090] Updated weights for policy 1, policy_version 1193036 (0.0009) [2023-12-26 09:11:06,896][123090] Updated weights for policy 1, policy_version 1193046 (0.0009) [2023-12-26 09:11:06,969][123090] Updated weights for policy 1, policy_version 1193056 (0.0009) [2023-12-26 09:11:07,496][123091] Updated weights for policy 0, policy_version 1201651 (0.0011) [2023-12-26 09:11:07,566][123091] Updated weights for policy 0, policy_version 1201661 (0.0011) [2023-12-26 09:11:07,632][123091] Updated weights for policy 0, policy_version 1201671 (0.0010) [2023-12-26 09:11:07,769][123090] Updated weights for policy 1, policy_version 1193066 (0.0009) [2023-12-26 09:11:07,830][123090] Updated weights for policy 1, policy_version 1193076 (0.0009) [2023-12-26 09:11:07,901][123090] Updated weights for policy 1, policy_version 1193086 (0.0009) [2023-12-26 09:11:08,437][123091] Updated weights for policy 0, policy_version 1201681 (0.0011) [2023-12-26 09:11:08,489][123091] Updated weights for policy 0, policy_version 1201691 (0.0010) [2023-12-26 09:11:08,547][123091] Updated weights for policy 0, policy_version 1201701 (0.0010) [2023-12-26 09:11:08,604][123091] Updated weights for policy 0, policy_version 1201711 (0.0009) [2023-12-26 09:11:08,652][123090] Updated weights for policy 1, policy_version 1193096 (0.0010) [2023-12-26 09:11:08,719][123090] Updated weights for policy 1, policy_version 1193106 (0.0011) [2023-12-26 09:11:08,784][121949] Fps is (10 sec: 17205.9, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 613072896. Throughput: 0: 9076.1, 1: 8944.1. Samples: 613052020. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:08,785][123090] Updated weights for policy 1, policy_version 1193116 (0.0010) [2023-12-26 09:11:08,785][121949] Avg episode reward: [(0, '6215.197'), (1, '5458.387')] [2023-12-26 09:11:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001201712_307642368.pth... [2023-12-26 09:11:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001200656_307372032.pth [2023-12-26 09:11:08,816][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001193120_305438720.pth... [2023-12-26 09:11:08,820][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001192064_305168384.pth [2023-12-26 09:11:09,488][123091] Updated weights for policy 0, policy_version 1201721 (0.0009) [2023-12-26 09:11:09,561][123091] Updated weights for policy 0, policy_version 1201731 (0.0006) [2023-12-26 09:11:09,568][123090] Updated weights for policy 1, policy_version 1193126 (0.0010) [2023-12-26 09:11:09,619][123091] Updated weights for policy 0, policy_version 1201741 (0.0008) [2023-12-26 09:11:09,623][123090] Updated weights for policy 1, policy_version 1193136 (0.0006) [2023-12-26 09:11:09,685][123090] Updated weights for policy 1, policy_version 1193146 (0.0006) [2023-12-26 09:11:10,400][123091] Updated weights for policy 0, policy_version 1201751 (0.0006) [2023-12-26 09:11:10,462][123090] Updated weights for policy 1, policy_version 1193156 (0.0006) [2023-12-26 09:11:10,468][123091] Updated weights for policy 0, policy_version 1201761 (0.0006) [2023-12-26 09:11:10,532][123090] Updated weights for policy 1, policy_version 1193166 (0.0007) [2023-12-26 09:11:10,537][123091] Updated weights for policy 0, policy_version 1201771 (0.0008) [2023-12-26 09:11:10,595][123090] Updated weights for policy 1, policy_version 1193176 (0.0006) [2023-12-26 09:11:11,383][123091] Updated weights for policy 0, policy_version 1201781 (0.0009) [2023-12-26 09:11:11,387][123090] Updated weights for policy 1, policy_version 1193186 (0.0009) [2023-12-26 09:11:11,444][123091] Updated weights for policy 0, policy_version 1201791 (0.0009) [2023-12-26 09:11:11,454][123090] Updated weights for policy 1, policy_version 1193196 (0.0009) [2023-12-26 09:11:11,500][123091] Updated weights for policy 0, policy_version 1201801 (0.0010) [2023-12-26 09:11:11,515][123090] Updated weights for policy 1, policy_version 1193206 (0.0008) [2023-12-26 09:11:11,578][123090] Updated weights for policy 1, policy_version 1193216 (0.0007) [2023-12-26 09:11:12,344][123090] Updated weights for policy 1, policy_version 1193226 (0.0011) [2023-12-26 09:11:12,382][123091] Updated weights for policy 0, policy_version 1201811 (0.0008) [2023-12-26 09:11:12,418][123090] Updated weights for policy 1, policy_version 1193236 (0.0009) [2023-12-26 09:11:12,447][123091] Updated weights for policy 0, policy_version 1201821 (0.0007) [2023-12-26 09:11:12,481][123090] Updated weights for policy 1, policy_version 1193246 (0.0011) [2023-12-26 09:11:12,494][123091] Updated weights for policy 0, policy_version 1201831 (0.0009) [2023-12-26 09:11:13,312][123090] Updated weights for policy 1, policy_version 1193256 (0.0007) [2023-12-26 09:11:13,351][123091] Updated weights for policy 0, policy_version 1201841 (0.0010) [2023-12-26 09:11:13,359][123090] Updated weights for policy 1, policy_version 1193266 (0.0007) [2023-12-26 09:11:13,401][123091] Updated weights for policy 0, policy_version 1201851 (0.0009) [2023-12-26 09:11:13,410][123090] Updated weights for policy 1, policy_version 1193276 (0.0007) [2023-12-26 09:11:13,450][123091] Updated weights for policy 0, policy_version 1201861 (0.0007) [2023-12-26 09:11:13,512][123091] Updated weights for policy 0, policy_version 1201871 (0.0009) [2023-12-26 09:11:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 613163008. Throughput: 0: 8948.0, 1: 8874.6. Samples: 613155336. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:13,785][121949] Avg episode reward: [(0, '6155.807'), (1, '5383.836')] [2023-12-26 09:11:14,187][123090] Updated weights for policy 1, policy_version 1193286 (0.0009) [2023-12-26 09:11:14,189][123091] Updated weights for policy 0, policy_version 1201881 (0.0006) [2023-12-26 09:11:14,244][123091] Updated weights for policy 0, policy_version 1201891 (0.0007) [2023-12-26 09:11:14,250][123090] Updated weights for policy 1, policy_version 1193296 (0.0010) [2023-12-26 09:11:14,303][123091] Updated weights for policy 0, policy_version 1201901 (0.0006) [2023-12-26 09:11:14,313][123090] Updated weights for policy 1, policy_version 1193306 (0.0010) [2023-12-26 09:11:15,049][123090] Updated weights for policy 1, policy_version 1193316 (0.0010) [2023-12-26 09:11:15,058][123091] Updated weights for policy 0, policy_version 1201911 (0.0007) [2023-12-26 09:11:15,109][123090] Updated weights for policy 1, policy_version 1193326 (0.0008) [2023-12-26 09:11:15,119][123091] Updated weights for policy 0, policy_version 1201921 (0.0010) [2023-12-26 09:11:15,170][123090] Updated weights for policy 1, policy_version 1193336 (0.0006) [2023-12-26 09:11:15,184][123091] Updated weights for policy 0, policy_version 1201931 (0.0009) [2023-12-26 09:11:15,965][123090] Updated weights for policy 1, policy_version 1193346 (0.0006) [2023-12-26 09:11:16,011][123091] Updated weights for policy 0, policy_version 1201941 (0.0008) [2023-12-26 09:11:16,038][123090] Updated weights for policy 1, policy_version 1193356 (0.0008) [2023-12-26 09:11:16,076][123091] Updated weights for policy 0, policy_version 1201951 (0.0009) [2023-12-26 09:11:16,099][123090] Updated weights for policy 1, policy_version 1193366 (0.0010) [2023-12-26 09:11:16,138][123091] Updated weights for policy 0, policy_version 1201961 (0.0008) [2023-12-26 09:11:16,161][123090] Updated weights for policy 1, policy_version 1193376 (0.0009) [2023-12-26 09:11:16,912][123090] Updated weights for policy 1, policy_version 1193386 (0.0009) [2023-12-26 09:11:16,955][123091] Updated weights for policy 0, policy_version 1201971 (0.0007) [2023-12-26 09:11:16,977][123090] Updated weights for policy 1, policy_version 1193396 (0.0008) [2023-12-26 09:11:17,019][123091] Updated weights for policy 0, policy_version 1201981 (0.0005) [2023-12-26 09:11:17,038][123090] Updated weights for policy 1, policy_version 1193406 (0.0009) [2023-12-26 09:11:17,074][123091] Updated weights for policy 0, policy_version 1201991 (0.0008) [2023-12-26 09:11:17,722][123091] Updated weights for policy 0, policy_version 1202001 (0.0010) [2023-12-26 09:11:17,789][123091] Updated weights for policy 0, policy_version 1202011 (0.0011) [2023-12-26 09:11:17,857][123091] Updated weights for policy 0, policy_version 1202021 (0.0009) [2023-12-26 09:11:17,898][123090] Updated weights for policy 1, policy_version 1193416 (0.0008) [2023-12-26 09:11:17,913][123091] Updated weights for policy 0, policy_version 1202031 (0.0006) [2023-12-26 09:11:17,949][123090] Updated weights for policy 1, policy_version 1193426 (0.0009) [2023-12-26 09:11:17,996][123090] Updated weights for policy 1, policy_version 1193436 (0.0008) [2023-12-26 09:11:18,730][123091] Updated weights for policy 0, policy_version 1202041 (0.0009) [2023-12-26 09:11:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 613244928. Throughput: 0: 8864.7, 1: 8849.1. Samples: 613262868. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:18,785][121949] Avg episode reward: [(0, '6071.811'), (1, '5323.940')] [2023-12-26 09:11:18,797][123091] Updated weights for policy 0, policy_version 1202051 (0.0010) [2023-12-26 09:11:18,857][123090] Updated weights for policy 1, policy_version 1193446 (0.0008) [2023-12-26 09:11:18,865][123091] Updated weights for policy 0, policy_version 1202061 (0.0010) [2023-12-26 09:11:18,924][123090] Updated weights for policy 1, policy_version 1193456 (0.0009) [2023-12-26 09:11:18,996][123090] Updated weights for policy 1, policy_version 1193466 (0.0007) [2023-12-26 09:11:19,683][123091] Updated weights for policy 0, policy_version 1202071 (0.0007) [2023-12-26 09:11:19,747][123091] Updated weights for policy 0, policy_version 1202081 (0.0005) [2023-12-26 09:11:19,800][123091] Updated weights for policy 0, policy_version 1202091 (0.0005) [2023-12-26 09:11:19,859][123090] Updated weights for policy 1, policy_version 1193476 (0.0008) [2023-12-26 09:11:19,924][123090] Updated weights for policy 1, policy_version 1193486 (0.0008) [2023-12-26 09:11:19,995][123090] Updated weights for policy 1, policy_version 1193496 (0.0008) [2023-12-26 09:11:20,646][123091] Updated weights for policy 0, policy_version 1202101 (0.0007) [2023-12-26 09:11:20,712][123091] Updated weights for policy 0, policy_version 1202111 (0.0009) [2023-12-26 09:11:20,776][123091] Updated weights for policy 0, policy_version 1202121 (0.0009) [2023-12-26 09:11:20,804][123090] Updated weights for policy 1, policy_version 1193506 (0.0008) [2023-12-26 09:11:20,863][123090] Updated weights for policy 1, policy_version 1193516 (0.0008) [2023-12-26 09:11:20,923][123090] Updated weights for policy 1, policy_version 1193526 (0.0010) [2023-12-26 09:11:20,993][123090] Updated weights for policy 1, policy_version 1193536 (0.0006) [2023-12-26 09:11:21,511][123091] Updated weights for policy 0, policy_version 1202131 (0.0009) [2023-12-26 09:11:21,575][123091] Updated weights for policy 0, policy_version 1202141 (0.0006) [2023-12-26 09:11:21,648][123091] Updated weights for policy 0, policy_version 1202151 (0.0009) [2023-12-26 09:11:21,780][123090] Updated weights for policy 1, policy_version 1193546 (0.0007) [2023-12-26 09:11:21,852][123090] Updated weights for policy 1, policy_version 1193556 (0.0005) [2023-12-26 09:11:21,927][123090] Updated weights for policy 1, policy_version 1193566 (0.0007) [2023-12-26 09:11:22,516][123091] Updated weights for policy 0, policy_version 1202161 (0.0009) [2023-12-26 09:11:22,565][123091] Updated weights for policy 0, policy_version 1202171 (0.0009) [2023-12-26 09:11:22,619][123091] Updated weights for policy 0, policy_version 1202181 (0.0009) [2023-12-26 09:11:22,659][123090] Updated weights for policy 1, policy_version 1193576 (0.0007) [2023-12-26 09:11:22,687][123091] Updated weights for policy 0, policy_version 1202191 (0.0006) [2023-12-26 09:11:22,723][123090] Updated weights for policy 1, policy_version 1193586 (0.0010) [2023-12-26 09:11:22,787][123090] Updated weights for policy 1, policy_version 1193596 (0.0010) [2023-12-26 09:11:23,400][123091] Updated weights for policy 0, policy_version 1202201 (0.0010) [2023-12-26 09:11:23,448][123091] Updated weights for policy 0, policy_version 1202211 (0.0010) [2023-12-26 09:11:23,496][123091] Updated weights for policy 0, policy_version 1202221 (0.0010) [2023-12-26 09:11:23,614][123090] Updated weights for policy 1, policy_version 1193606 (0.0010) [2023-12-26 09:11:23,666][123090] Updated weights for policy 1, policy_version 1193616 (0.0010) [2023-12-26 09:11:23,724][123090] Updated weights for policy 1, policy_version 1193626 (0.0010) [2023-12-26 09:11:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 613343232. Throughput: 0: 8835.7, 1: 8825.0. Samples: 613314984. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:23,784][121949] Avg episode reward: [(0, '6137.621'), (1, '5324.141')] [2023-12-26 09:11:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001193632_305569792.pth... [2023-12-26 09:11:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001202224_307773440.pth... [2023-12-26 09:11:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001192576_305299456.pth [2023-12-26 09:11:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001201168_307503104.pth [2023-12-26 09:11:24,329][123091] Updated weights for policy 0, policy_version 1202231 (0.0010) [2023-12-26 09:11:24,381][123091] Updated weights for policy 0, policy_version 1202241 (0.0009) [2023-12-26 09:11:24,437][123091] Updated weights for policy 0, policy_version 1202251 (0.0007) [2023-12-26 09:11:24,469][123090] Updated weights for policy 1, policy_version 1193636 (0.0008) [2023-12-26 09:11:24,533][123090] Updated weights for policy 1, policy_version 1193646 (0.0006) [2023-12-26 09:11:24,587][123090] Updated weights for policy 1, policy_version 1193656 (0.0005) [2023-12-26 09:11:25,236][123090] Updated weights for policy 1, policy_version 1193666 (0.0006) [2023-12-26 09:11:25,292][123090] Updated weights for policy 1, policy_version 1193676 (0.0005) [2023-12-26 09:11:25,331][123091] Updated weights for policy 0, policy_version 1202261 (0.0009) [2023-12-26 09:11:25,348][123090] Updated weights for policy 1, policy_version 1193686 (0.0005) [2023-12-26 09:11:25,396][123091] Updated weights for policy 0, policy_version 1202271 (0.0009) [2023-12-26 09:11:25,401][123090] Updated weights for policy 1, policy_version 1193696 (0.0007) [2023-12-26 09:11:25,461][123091] Updated weights for policy 0, policy_version 1202281 (0.0009) [2023-12-26 09:11:26,099][123091] Updated weights for policy 0, policy_version 1202291 (0.0009) [2023-12-26 09:11:26,165][123091] Updated weights for policy 0, policy_version 1202301 (0.0010) [2023-12-26 09:11:26,228][123091] Updated weights for policy 0, policy_version 1202311 (0.0010) [2023-12-26 09:11:26,230][123090] Updated weights for policy 1, policy_version 1193706 (0.0006) [2023-12-26 09:11:26,288][123090] Updated weights for policy 1, policy_version 1193716 (0.0008) [2023-12-26 09:11:26,345][123090] Updated weights for policy 1, policy_version 1193726 (0.0008) [2023-12-26 09:11:27,009][123090] Updated weights for policy 1, policy_version 1193736 (0.0005) [2023-12-26 09:11:27,030][123091] Updated weights for policy 0, policy_version 1202321 (0.0009) [2023-12-26 09:11:27,061][123090] Updated weights for policy 1, policy_version 1193746 (0.0005) [2023-12-26 09:11:27,092][123091] Updated weights for policy 0, policy_version 1202331 (0.0005) [2023-12-26 09:11:27,109][123090] Updated weights for policy 1, policy_version 1193756 (0.0005) [2023-12-26 09:11:27,144][123091] Updated weights for policy 0, policy_version 1202341 (0.0005) [2023-12-26 09:11:27,194][123091] Updated weights for policy 0, policy_version 1202351 (0.0005) [2023-12-26 09:11:27,707][123090] Updated weights for policy 1, policy_version 1193766 (0.0005) [2023-12-26 09:11:27,755][123090] Updated weights for policy 1, policy_version 1193776 (0.0005) [2023-12-26 09:11:27,808][123090] Updated weights for policy 1, policy_version 1193786 (0.0005) [2023-12-26 09:11:27,877][123091] Updated weights for policy 0, policy_version 1202361 (0.0005) [2023-12-26 09:11:27,929][123091] Updated weights for policy 0, policy_version 1202371 (0.0006) [2023-12-26 09:11:27,981][123091] Updated weights for policy 0, policy_version 1202381 (0.0007) [2023-12-26 09:11:28,521][123090] Updated weights for policy 1, policy_version 1193796 (0.0006) [2023-12-26 09:11:28,575][123090] Updated weights for policy 1, policy_version 1193806 (0.0009) [2023-12-26 09:11:28,633][123090] Updated weights for policy 1, policy_version 1193817 (0.0010) [2023-12-26 09:11:28,714][123091] Updated weights for policy 0, policy_version 1202391 (0.0005) [2023-12-26 09:11:28,773][123091] Updated weights for policy 0, policy_version 1202401 (0.0005) [2023-12-26 09:11:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 613433344. Throughput: 0: 8868.1, 1: 8896.7. Samples: 613425624. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:28,784][121949] Avg episode reward: [(0, '6182.348'), (1, '4942.721')] [2023-12-26 09:11:28,829][123091] Updated weights for policy 0, policy_version 1202411 (0.0005) [2023-12-26 09:11:29,572][123091] Updated weights for policy 0, policy_version 1202421 (0.0008) [2023-12-26 09:11:29,582][123090] Updated weights for policy 1, policy_version 1193827 (0.0009) [2023-12-26 09:11:29,627][123091] Updated weights for policy 0, policy_version 1202431 (0.0009) [2023-12-26 09:11:29,637][123090] Updated weights for policy 1, policy_version 1193837 (0.0008) [2023-12-26 09:11:29,689][123091] Updated weights for policy 0, policy_version 1202441 (0.0006) [2023-12-26 09:11:29,705][123090] Updated weights for policy 1, policy_version 1193847 (0.0009) [2023-12-26 09:11:30,524][123091] Updated weights for policy 0, policy_version 1202451 (0.0007) [2023-12-26 09:11:30,585][123091] Updated weights for policy 0, policy_version 1202461 (0.0009) [2023-12-26 09:11:30,602][123090] Updated weights for policy 1, policy_version 1193857 (0.0009) [2023-12-26 09:11:30,638][123091] Updated weights for policy 0, policy_version 1202471 (0.0009) [2023-12-26 09:11:30,661][123090] Updated weights for policy 1, policy_version 1193867 (0.0009) [2023-12-26 09:11:30,720][123090] Updated weights for policy 1, policy_version 1193877 (0.0009) [2023-12-26 09:11:30,781][123090] Updated weights for policy 1, policy_version 1193887 (0.0009) [2023-12-26 09:11:31,476][123091] Updated weights for policy 0, policy_version 1202481 (0.0009) [2023-12-26 09:11:31,537][123091] Updated weights for policy 0, policy_version 1202491 (0.0009) [2023-12-26 09:11:31,589][123091] Updated weights for policy 0, policy_version 1202501 (0.0009) [2023-12-26 09:11:31,624][123090] Updated weights for policy 1, policy_version 1193897 (0.0009) [2023-12-26 09:11:31,654][123091] Updated weights for policy 0, policy_version 1202511 (0.0008) [2023-12-26 09:11:31,697][123090] Updated weights for policy 1, policy_version 1193907 (0.0009) [2023-12-26 09:11:31,767][123090] Updated weights for policy 1, policy_version 1193917 (0.0009) [2023-12-26 09:11:32,480][123091] Updated weights for policy 0, policy_version 1202521 (0.0009) [2023-12-26 09:11:32,528][123091] Updated weights for policy 0, policy_version 1202531 (0.0009) [2023-12-26 09:11:32,575][123090] Updated weights for policy 1, policy_version 1193927 (0.0009) [2023-12-26 09:11:32,590][123091] Updated weights for policy 0, policy_version 1202541 (0.0008) [2023-12-26 09:11:32,632][123090] Updated weights for policy 1, policy_version 1193937 (0.0008) [2023-12-26 09:11:32,687][123090] Updated weights for policy 1, policy_version 1193947 (0.0009) [2023-12-26 09:11:33,241][123091] Updated weights for policy 0, policy_version 1202551 (0.0007) [2023-12-26 09:11:33,290][123091] Updated weights for policy 0, policy_version 1202561 (0.0005) [2023-12-26 09:11:33,348][123091] Updated weights for policy 0, policy_version 1202571 (0.0005) [2023-12-26 09:11:33,525][123090] Updated weights for policy 1, policy_version 1193957 (0.0007) [2023-12-26 09:11:33,577][123090] Updated weights for policy 1, policy_version 1193967 (0.0005) [2023-12-26 09:11:33,632][123090] Updated weights for policy 1, policy_version 1193977 (0.0006) [2023-12-26 09:11:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 613523456. Throughput: 0: 8913.8, 1: 8921.4. Samples: 613532512. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:33,785][121949] Avg episode reward: [(0, '6192.131'), (1, '4593.140')] [2023-12-26 09:11:34,085][123091] Updated weights for policy 0, policy_version 1202581 (0.0008) [2023-12-26 09:11:34,148][123091] Updated weights for policy 0, policy_version 1202591 (0.0010) [2023-12-26 09:11:34,209][123091] Updated weights for policy 0, policy_version 1202601 (0.0011) [2023-12-26 09:11:34,368][123090] Updated weights for policy 1, policy_version 1193987 (0.0009) [2023-12-26 09:11:34,417][123090] Updated weights for policy 1, policy_version 1193997 (0.0010) [2023-12-26 09:11:34,477][123090] Updated weights for policy 1, policy_version 1194007 (0.0011) [2023-12-26 09:11:35,029][123091] Updated weights for policy 0, policy_version 1202611 (0.0010) [2023-12-26 09:11:35,088][123091] Updated weights for policy 0, policy_version 1202621 (0.0010) [2023-12-26 09:11:35,135][123091] Updated weights for policy 0, policy_version 1202631 (0.0010) [2023-12-26 09:11:35,298][123090] Updated weights for policy 1, policy_version 1194017 (0.0010) [2023-12-26 09:11:35,354][123090] Updated weights for policy 1, policy_version 1194027 (0.0005) [2023-12-26 09:11:35,402][123090] Updated weights for policy 1, policy_version 1194037 (0.0005) [2023-12-26 09:11:35,460][123090] Updated weights for policy 1, policy_version 1194047 (0.0005) [2023-12-26 09:11:35,850][123091] Updated weights for policy 0, policy_version 1202641 (0.0010) [2023-12-26 09:11:35,916][123091] Updated weights for policy 0, policy_version 1202651 (0.0005) [2023-12-26 09:11:35,976][123091] Updated weights for policy 0, policy_version 1202661 (0.0005) [2023-12-26 09:11:36,043][123091] Updated weights for policy 0, policy_version 1202671 (0.0006) [2023-12-26 09:11:36,110][123090] Updated weights for policy 1, policy_version 1194057 (0.0006) [2023-12-26 09:11:36,181][123090] Updated weights for policy 1, policy_version 1194067 (0.0007) [2023-12-26 09:11:36,246][123090] Updated weights for policy 1, policy_version 1194077 (0.0005) [2023-12-26 09:11:36,848][123091] Updated weights for policy 0, policy_version 1202681 (0.0011) [2023-12-26 09:11:36,911][123091] Updated weights for policy 0, policy_version 1202691 (0.0011) [2023-12-26 09:11:36,978][123091] Updated weights for policy 0, policy_version 1202701 (0.0011) [2023-12-26 09:11:37,033][123090] Updated weights for policy 1, policy_version 1194087 (0.0008) [2023-12-26 09:11:37,108][123090] Updated weights for policy 1, policy_version 1194097 (0.0006) [2023-12-26 09:11:37,177][123090] Updated weights for policy 1, policy_version 1194107 (0.0006) [2023-12-26 09:11:37,787][123091] Updated weights for policy 0, policy_version 1202711 (0.0011) [2023-12-26 09:11:37,819][123090] Updated weights for policy 1, policy_version 1194117 (0.0005) [2023-12-26 09:11:37,838][123091] Updated weights for policy 0, policy_version 1202721 (0.0010) [2023-12-26 09:11:37,879][123090] Updated weights for policy 1, policy_version 1194127 (0.0005) [2023-12-26 09:11:37,901][123091] Updated weights for policy 0, policy_version 1202731 (0.0010) [2023-12-26 09:11:37,942][123090] Updated weights for policy 1, policy_version 1194137 (0.0006) [2023-12-26 09:11:38,658][123090] Updated weights for policy 1, policy_version 1194147 (0.0005) [2023-12-26 09:11:38,729][123091] Updated weights for policy 0, policy_version 1202741 (0.0011) [2023-12-26 09:11:38,730][123090] Updated weights for policy 1, policy_version 1194157 (0.0008) [2023-12-26 09:11:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 613605376. Throughput: 0: 8962.1, 1: 8921.2. Samples: 613587864. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:38,785][121949] Avg episode reward: [(0, '6256.633'), (1, '4650.202')] [2023-12-26 09:11:38,789][123091] Updated weights for policy 0, policy_version 1202751 (0.0011) [2023-12-26 09:11:38,793][123090] Updated weights for policy 1, policy_version 1194167 (0.0007) [2023-12-26 09:11:38,844][123091] Updated weights for policy 0, policy_version 1202761 (0.0011) [2023-12-26 09:11:38,855][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001194176_305709056.pth... [2023-12-26 09:11:38,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001193120_305438720.pth [2023-12-26 09:11:38,889][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001202768_307912704.pth... [2023-12-26 09:11:38,894][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001201712_307642368.pth [2023-12-26 09:11:39,524][123090] Updated weights for policy 1, policy_version 1194177 (0.0008) [2023-12-26 09:11:39,596][123090] Updated weights for policy 1, policy_version 1194187 (0.0011) [2023-12-26 09:11:39,649][123090] Updated weights for policy 1, policy_version 1194197 (0.0010) [2023-12-26 09:11:39,710][123091] Updated weights for policy 0, policy_version 1202771 (0.0011) [2023-12-26 09:11:39,712][123090] Updated weights for policy 1, policy_version 1194207 (0.0011) [2023-12-26 09:11:39,770][123091] Updated weights for policy 0, policy_version 1202781 (0.0011) [2023-12-26 09:11:39,838][123091] Updated weights for policy 0, policy_version 1202791 (0.0010) [2023-12-26 09:11:40,487][123090] Updated weights for policy 1, policy_version 1194217 (0.0011) [2023-12-26 09:11:40,539][123090] Updated weights for policy 1, policy_version 1194227 (0.0011) [2023-12-26 09:11:40,581][123091] Updated weights for policy 0, policy_version 1202801 (0.0008) [2023-12-26 09:11:40,596][123090] Updated weights for policy 1, policy_version 1194237 (0.0009) [2023-12-26 09:11:40,643][123091] Updated weights for policy 0, policy_version 1202811 (0.0005) [2023-12-26 09:11:40,710][123091] Updated weights for policy 0, policy_version 1202821 (0.0006) [2023-12-26 09:11:40,770][123091] Updated weights for policy 0, policy_version 1202831 (0.0009) [2023-12-26 09:11:41,389][123090] Updated weights for policy 1, policy_version 1194247 (0.0009) [2023-12-26 09:11:41,456][123090] Updated weights for policy 1, policy_version 1194257 (0.0010) [2023-12-26 09:11:41,526][123090] Updated weights for policy 1, policy_version 1194267 (0.0010) [2023-12-26 09:11:41,581][123091] Updated weights for policy 0, policy_version 1202841 (0.0010) [2023-12-26 09:11:41,657][123091] Updated weights for policy 0, policy_version 1202851 (0.0009) [2023-12-26 09:11:41,708][123091] Updated weights for policy 0, policy_version 1202861 (0.0009) [2023-12-26 09:11:42,327][123090] Updated weights for policy 1, policy_version 1194277 (0.0010) [2023-12-26 09:11:42,391][123090] Updated weights for policy 1, policy_version 1194287 (0.0010) [2023-12-26 09:11:42,443][123090] Updated weights for policy 1, policy_version 1194297 (0.0009) [2023-12-26 09:11:42,592][123091] Updated weights for policy 0, policy_version 1202871 (0.0010) [2023-12-26 09:11:42,645][123091] Updated weights for policy 0, policy_version 1202881 (0.0009) [2023-12-26 09:11:42,714][123091] Updated weights for policy 0, policy_version 1202891 (0.0006) [2023-12-26 09:11:43,211][123090] Updated weights for policy 1, policy_version 1194307 (0.0008) [2023-12-26 09:11:43,264][123090] Updated weights for policy 1, policy_version 1194318 (0.0008) [2023-12-26 09:11:43,316][123090] Updated weights for policy 1, policy_version 1194328 (0.0009) [2023-12-26 09:11:43,558][123091] Updated weights for policy 0, policy_version 1202901 (0.0009) [2023-12-26 09:11:43,624][123091] Updated weights for policy 0, policy_version 1202911 (0.0010) [2023-12-26 09:11:43,679][123091] Updated weights for policy 0, policy_version 1202921 (0.0010) [2023-12-26 09:11:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 613703680. Throughput: 0: 8856.8, 1: 8960.1. Samples: 613693524. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:43,785][121949] Avg episode reward: [(0, '6246.507'), (1, '4476.440')] [2023-12-26 09:11:44,097][123090] Updated weights for policy 1, policy_version 1194338 (0.0009) [2023-12-26 09:11:44,168][123090] Updated weights for policy 1, policy_version 1194348 (0.0011) [2023-12-26 09:11:44,249][123090] Updated weights for policy 1, policy_version 1194358 (0.0010) [2023-12-26 09:11:44,322][123090] Updated weights for policy 1, policy_version 1194368 (0.0011) [2023-12-26 09:11:44,399][123091] Updated weights for policy 0, policy_version 1202931 (0.0010) [2023-12-26 09:11:44,455][123091] Updated weights for policy 0, policy_version 1202941 (0.0009) [2023-12-26 09:11:44,520][123091] Updated weights for policy 0, policy_version 1202951 (0.0009) [2023-12-26 09:11:45,099][123090] Updated weights for policy 1, policy_version 1194378 (0.0010) [2023-12-26 09:11:45,170][123090] Updated weights for policy 1, policy_version 1194388 (0.0007) [2023-12-26 09:11:45,237][123090] Updated weights for policy 1, policy_version 1194398 (0.0005) [2023-12-26 09:11:45,304][123091] Updated weights for policy 0, policy_version 1202961 (0.0009) [2023-12-26 09:11:45,361][123091] Updated weights for policy 0, policy_version 1202971 (0.0010) [2023-12-26 09:11:45,414][123091] Updated weights for policy 0, policy_version 1202981 (0.0009) [2023-12-26 09:11:45,478][123091] Updated weights for policy 0, policy_version 1202991 (0.0010) [2023-12-26 09:11:45,969][123090] Updated weights for policy 1, policy_version 1194408 (0.0006) [2023-12-26 09:11:46,037][123090] Updated weights for policy 1, policy_version 1194418 (0.0008) [2023-12-26 09:11:46,100][123090] Updated weights for policy 1, policy_version 1194428 (0.0008) [2023-12-26 09:11:46,377][123091] Updated weights for policy 0, policy_version 1203001 (0.0009) [2023-12-26 09:11:46,428][123091] Updated weights for policy 0, policy_version 1203011 (0.0009) [2023-12-26 09:11:46,501][123091] Updated weights for policy 0, policy_version 1203021 (0.0009) [2023-12-26 09:11:46,766][123090] Updated weights for policy 1, policy_version 1194438 (0.0008) [2023-12-26 09:11:46,834][123090] Updated weights for policy 1, policy_version 1194448 (0.0008) [2023-12-26 09:11:46,902][123090] Updated weights for policy 1, policy_version 1194458 (0.0007) [2023-12-26 09:11:47,449][123091] Updated weights for policy 0, policy_version 1203031 (0.0009) [2023-12-26 09:11:47,521][123091] Updated weights for policy 0, policy_version 1203041 (0.0006) [2023-12-26 09:11:47,581][123091] Updated weights for policy 0, policy_version 1203051 (0.0005) [2023-12-26 09:11:47,595][123090] Updated weights for policy 1, policy_version 1194468 (0.0008) [2023-12-26 09:11:47,647][123090] Updated weights for policy 1, policy_version 1194478 (0.0006) [2023-12-26 09:11:47,697][123090] Updated weights for policy 1, policy_version 1194488 (0.0005) [2023-12-26 09:11:48,178][123091] Updated weights for policy 0, policy_version 1203061 (0.0005) [2023-12-26 09:11:48,223][123091] Updated weights for policy 0, policy_version 1203071 (0.0005) [2023-12-26 09:11:48,270][123091] Updated weights for policy 0, policy_version 1203081 (0.0007) [2023-12-26 09:11:48,373][123090] Updated weights for policy 1, policy_version 1194498 (0.0006) [2023-12-26 09:11:48,436][123090] Updated weights for policy 1, policy_version 1194508 (0.0008) [2023-12-26 09:11:48,487][123090] Updated weights for policy 1, policy_version 1194518 (0.0008) [2023-12-26 09:11:48,536][123090] Updated weights for policy 1, policy_version 1194528 (0.0008) [2023-12-26 09:11:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 613793792. Throughput: 0: 8901.2, 1: 9054.9. Samples: 613804108. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:48,784][121949] Avg episode reward: [(0, '6228.911'), (1, '4574.765')] [2023-12-26 09:11:49,059][123091] Updated weights for policy 0, policy_version 1203091 (0.0005) [2023-12-26 09:11:49,136][123091] Updated weights for policy 0, policy_version 1203101 (0.0007) [2023-12-26 09:11:49,187][123091] Updated weights for policy 0, policy_version 1203111 (0.0010) [2023-12-26 09:11:49,393][123090] Updated weights for policy 1, policy_version 1194538 (0.0007) [2023-12-26 09:11:49,457][123090] Updated weights for policy 1, policy_version 1194548 (0.0008) [2023-12-26 09:11:49,524][123090] Updated weights for policy 1, policy_version 1194558 (0.0011) [2023-12-26 09:11:49,989][123091] Updated weights for policy 0, policy_version 1203121 (0.0013) [2023-12-26 09:11:50,058][123091] Updated weights for policy 0, policy_version 1203131 (0.0007) [2023-12-26 09:11:50,125][123091] Updated weights for policy 0, policy_version 1203141 (0.0008) [2023-12-26 09:11:50,181][123091] Updated weights for policy 0, policy_version 1203151 (0.0009) [2023-12-26 09:11:50,335][123090] Updated weights for policy 1, policy_version 1194568 (0.0010) [2023-12-26 09:11:50,386][123090] Updated weights for policy 1, policy_version 1194578 (0.0010) [2023-12-26 09:11:50,442][123090] Updated weights for policy 1, policy_version 1194588 (0.0010) [2023-12-26 09:11:50,994][123091] Updated weights for policy 0, policy_version 1203161 (0.0009) [2023-12-26 09:11:51,064][123091] Updated weights for policy 0, policy_version 1203171 (0.0008) [2023-12-26 09:11:51,135][123091] Updated weights for policy 0, policy_version 1203181 (0.0008) [2023-12-26 09:11:51,273][123090] Updated weights for policy 1, policy_version 1194598 (0.0009) [2023-12-26 09:11:51,343][123090] Updated weights for policy 1, policy_version 1194608 (0.0007) [2023-12-26 09:11:51,412][123090] Updated weights for policy 1, policy_version 1194618 (0.0011) [2023-12-26 09:11:51,922][123091] Updated weights for policy 0, policy_version 1203191 (0.0009) [2023-12-26 09:11:51,992][123091] Updated weights for policy 0, policy_version 1203201 (0.0010) [2023-12-26 09:11:52,064][123091] Updated weights for policy 0, policy_version 1203211 (0.0009) [2023-12-26 09:11:52,271][123090] Updated weights for policy 1, policy_version 1194628 (0.0009) [2023-12-26 09:11:52,335][123090] Updated weights for policy 1, policy_version 1194638 (0.0009) [2023-12-26 09:11:52,404][123090] Updated weights for policy 1, policy_version 1194648 (0.0010) [2023-12-26 09:11:52,809][123091] Updated weights for policy 0, policy_version 1203221 (0.0007) [2023-12-26 09:11:52,877][123091] Updated weights for policy 0, policy_version 1203231 (0.0006) [2023-12-26 09:11:52,931][123091] Updated weights for policy 0, policy_version 1203241 (0.0005) [2023-12-26 09:11:53,289][123090] Updated weights for policy 1, policy_version 1194658 (0.0009) [2023-12-26 09:11:53,345][123090] Updated weights for policy 1, policy_version 1194669 (0.0010) [2023-12-26 09:11:53,402][123090] Updated weights for policy 1, policy_version 1194679 (0.0009) [2023-12-26 09:11:53,571][123091] Updated weights for policy 0, policy_version 1203251 (0.0006) [2023-12-26 09:11:53,631][123091] Updated weights for policy 0, policy_version 1203261 (0.0009) [2023-12-26 09:11:53,679][123091] Updated weights for policy 0, policy_version 1203271 (0.0009) [2023-12-26 09:11:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 613883904. Throughput: 0: 8852.6, 1: 9022.8. Samples: 613856412. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:53,785][121949] Avg episode reward: [(0, '6100.627'), (1, '4660.252')] [2023-12-26 09:11:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001203280_308043776.pth... [2023-12-26 09:11:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001194688_305840128.pth... [2023-12-26 09:11:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001202224_307773440.pth [2023-12-26 09:11:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001193632_305569792.pth [2023-12-26 09:11:54,270][123090] Updated weights for policy 1, policy_version 1194689 (0.0009) [2023-12-26 09:11:54,328][123090] Updated weights for policy 1, policy_version 1194699 (0.0009) [2023-12-26 09:11:54,380][123090] Updated weights for policy 1, policy_version 1194709 (0.0009) [2023-12-26 09:11:54,383][123091] Updated weights for policy 0, policy_version 1203281 (0.0009) [2023-12-26 09:11:54,437][123090] Updated weights for policy 1, policy_version 1194719 (0.0010) [2023-12-26 09:11:54,444][123091] Updated weights for policy 0, policy_version 1203291 (0.0007) [2023-12-26 09:11:54,501][123091] Updated weights for policy 0, policy_version 1203301 (0.0009) [2023-12-26 09:11:54,564][123091] Updated weights for policy 0, policy_version 1203311 (0.0010) [2023-12-26 09:11:55,252][123090] Updated weights for policy 1, policy_version 1194729 (0.0009) [2023-12-26 09:11:55,300][123090] Updated weights for policy 1, policy_version 1194739 (0.0010) [2023-12-26 09:11:55,356][123090] Updated weights for policy 1, policy_version 1194750 (0.0008) [2023-12-26 09:11:55,401][123091] Updated weights for policy 0, policy_version 1203321 (0.0009) [2023-12-26 09:11:55,459][123091] Updated weights for policy 0, policy_version 1203331 (0.0009) [2023-12-26 09:11:55,532][123091] Updated weights for policy 0, policy_version 1203341 (0.0009) [2023-12-26 09:11:56,190][123090] Updated weights for policy 1, policy_version 1194760 (0.0009) [2023-12-26 09:11:56,264][123090] Updated weights for policy 1, policy_version 1194770 (0.0009) [2023-12-26 09:11:56,328][123090] Updated weights for policy 1, policy_version 1194780 (0.0006) [2023-12-26 09:11:56,332][123091] Updated weights for policy 0, policy_version 1203351 (0.0009) [2023-12-26 09:11:56,399][123091] Updated weights for policy 0, policy_version 1203361 (0.0006) [2023-12-26 09:11:56,456][123091] Updated weights for policy 0, policy_version 1203371 (0.0009) [2023-12-26 09:11:57,126][123090] Updated weights for policy 1, policy_version 1194790 (0.0008) [2023-12-26 09:11:57,185][123090] Updated weights for policy 1, policy_version 1194800 (0.0010) [2023-12-26 09:11:57,235][123090] Updated weights for policy 1, policy_version 1194810 (0.0009) [2023-12-26 09:11:57,266][123091] Updated weights for policy 0, policy_version 1203381 (0.0010) [2023-12-26 09:11:57,326][123091] Updated weights for policy 0, policy_version 1203391 (0.0009) [2023-12-26 09:11:57,385][123091] Updated weights for policy 0, policy_version 1203401 (0.0010) [2023-12-26 09:11:58,098][123090] Updated weights for policy 1, policy_version 1194820 (0.0008) [2023-12-26 09:11:58,153][123091] Updated weights for policy 0, policy_version 1203411 (0.0010) [2023-12-26 09:11:58,156][123090] Updated weights for policy 1, policy_version 1194830 (0.0009) [2023-12-26 09:11:58,220][123091] Updated weights for policy 0, policy_version 1203421 (0.0011) [2023-12-26 09:11:58,227][123090] Updated weights for policy 1, policy_version 1194840 (0.0007) [2023-12-26 09:11:58,284][123091] Updated weights for policy 0, policy_version 1203431 (0.0010) [2023-12-26 09:11:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.9, 300 sec: 17772.5). Total num frames: 613965824. Throughput: 0: 8944.6, 1: 8956.8. Samples: 613960896. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:11:58,784][121949] Avg episode reward: [(0, '6032.389'), (1, '4713.526')] [2023-12-26 09:11:59,108][123091] Updated weights for policy 0, policy_version 1203441 (0.0010) [2023-12-26 09:11:59,141][123090] Updated weights for policy 1, policy_version 1194850 (0.0007) [2023-12-26 09:11:59,168][123091] Updated weights for policy 0, policy_version 1203451 (0.0008) [2023-12-26 09:11:59,199][123090] Updated weights for policy 1, policy_version 1194860 (0.0007) [2023-12-26 09:11:59,226][123091] Updated weights for policy 0, policy_version 1203461 (0.0008) [2023-12-26 09:11:59,270][123090] Updated weights for policy 1, policy_version 1194870 (0.0008) [2023-12-26 09:11:59,300][123091] Updated weights for policy 0, policy_version 1203471 (0.0008) [2023-12-26 09:11:59,341][123090] Updated weights for policy 1, policy_version 1194880 (0.0007) [2023-12-26 09:12:00,133][123091] Updated weights for policy 0, policy_version 1203481 (0.0010) [2023-12-26 09:12:00,191][123090] Updated weights for policy 1, policy_version 1194890 (0.0006) [2023-12-26 09:12:00,192][123091] Updated weights for policy 0, policy_version 1203491 (0.0010) [2023-12-26 09:12:00,254][123090] Updated weights for policy 1, policy_version 1194900 (0.0007) [2023-12-26 09:12:00,255][123091] Updated weights for policy 0, policy_version 1203501 (0.0011) [2023-12-26 09:12:00,308][123090] Updated weights for policy 1, policy_version 1194910 (0.0007) [2023-12-26 09:12:01,084][123091] Updated weights for policy 0, policy_version 1203511 (0.0011) [2023-12-26 09:12:01,147][123091] Updated weights for policy 0, policy_version 1203521 (0.0011) [2023-12-26 09:12:01,161][123090] Updated weights for policy 1, policy_version 1194920 (0.0010) [2023-12-26 09:12:01,207][123091] Updated weights for policy 0, policy_version 1203531 (0.0011) [2023-12-26 09:12:01,223][123090] Updated weights for policy 1, policy_version 1194930 (0.0007) [2023-12-26 09:12:01,280][123090] Updated weights for policy 1, policy_version 1194940 (0.0010) [2023-12-26 09:12:02,039][123091] Updated weights for policy 0, policy_version 1203541 (0.0010) [2023-12-26 09:12:02,104][123091] Updated weights for policy 0, policy_version 1203551 (0.0009) [2023-12-26 09:12:02,146][123090] Updated weights for policy 1, policy_version 1194950 (0.0008) [2023-12-26 09:12:02,164][123091] Updated weights for policy 0, policy_version 1203561 (0.0009) [2023-12-26 09:12:02,210][123090] Updated weights for policy 1, policy_version 1194960 (0.0009) [2023-12-26 09:12:02,275][123090] Updated weights for policy 1, policy_version 1194970 (0.0010) [2023-12-26 09:12:03,003][123091] Updated weights for policy 0, policy_version 1203571 (0.0006) [2023-12-26 09:12:03,057][123091] Updated weights for policy 0, policy_version 1203581 (0.0006) [2023-12-26 09:12:03,070][123090] Updated weights for policy 1, policy_version 1194980 (0.0009) [2023-12-26 09:12:03,113][123091] Updated weights for policy 0, policy_version 1203591 (0.0005) [2023-12-26 09:12:03,123][123090] Updated weights for policy 1, policy_version 1194991 (0.0009) [2023-12-26 09:12:03,180][123090] Updated weights for policy 1, policy_version 1195001 (0.0006) [2023-12-26 09:12:03,728][123091] Updated weights for policy 0, policy_version 1203601 (0.0005) [2023-12-26 09:12:03,783][123091] Updated weights for policy 0, policy_version 1203611 (0.0005) [2023-12-26 09:12:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 614047744. Throughput: 0: 8917.6, 1: 8904.0. Samples: 614064840. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:03,784][121949] Avg episode reward: [(0, '6121.436'), (1, '4859.901')] [2023-12-26 09:12:03,834][123091] Updated weights for policy 0, policy_version 1203621 (0.0007) [2023-12-26 09:12:03,870][123090] Updated weights for policy 1, policy_version 1195011 (0.0006) [2023-12-26 09:12:03,896][123091] Updated weights for policy 0, policy_version 1203631 (0.0008) [2023-12-26 09:12:03,941][123090] Updated weights for policy 1, policy_version 1195021 (0.0008) [2023-12-26 09:12:04,010][123090] Updated weights for policy 1, policy_version 1195031 (0.0008) [2023-12-26 09:12:04,635][123091] Updated weights for policy 0, policy_version 1203641 (0.0006) [2023-12-26 09:12:04,690][123090] Updated weights for policy 1, policy_version 1195041 (0.0008) [2023-12-26 09:12:04,691][123091] Updated weights for policy 0, policy_version 1203651 (0.0005) [2023-12-26 09:12:04,740][123091] Updated weights for policy 0, policy_version 1203661 (0.0010) [2023-12-26 09:12:04,756][123090] Updated weights for policy 1, policy_version 1195051 (0.0005) [2023-12-26 09:12:04,830][123090] Updated weights for policy 1, policy_version 1195061 (0.0006) [2023-12-26 09:12:04,898][123090] Updated weights for policy 1, policy_version 1195071 (0.0006) [2023-12-26 09:12:05,559][123091] Updated weights for policy 0, policy_version 1203671 (0.0010) [2023-12-26 09:12:05,600][123090] Updated weights for policy 1, policy_version 1195081 (0.0010) [2023-12-26 09:12:05,614][123091] Updated weights for policy 0, policy_version 1203681 (0.0010) [2023-12-26 09:12:05,664][123090] Updated weights for policy 1, policy_version 1195091 (0.0010) [2023-12-26 09:12:05,676][123091] Updated weights for policy 0, policy_version 1203691 (0.0010) [2023-12-26 09:12:05,726][123090] Updated weights for policy 1, policy_version 1195101 (0.0010) [2023-12-26 09:12:06,401][123091] Updated weights for policy 0, policy_version 1203701 (0.0011) [2023-12-26 09:12:06,472][123091] Updated weights for policy 0, policy_version 1203711 (0.0011) [2023-12-26 09:12:06,535][123091] Updated weights for policy 0, policy_version 1203721 (0.0011) [2023-12-26 09:12:06,542][123090] Updated weights for policy 1, policy_version 1195111 (0.0011) [2023-12-26 09:12:06,610][123090] Updated weights for policy 1, policy_version 1195121 (0.0011) [2023-12-26 09:12:06,671][123090] Updated weights for policy 1, policy_version 1195131 (0.0011) [2023-12-26 09:12:07,257][123091] Updated weights for policy 0, policy_version 1203731 (0.0009) [2023-12-26 09:12:07,314][123091] Updated weights for policy 0, policy_version 1203741 (0.0007) [2023-12-26 09:12:07,366][123091] Updated weights for policy 0, policy_version 1203751 (0.0011) [2023-12-26 09:12:07,430][123090] Updated weights for policy 1, policy_version 1195141 (0.0008) [2023-12-26 09:12:07,498][123090] Updated weights for policy 1, policy_version 1195151 (0.0005) [2023-12-26 09:12:07,563][123090] Updated weights for policy 1, policy_version 1195161 (0.0009) [2023-12-26 09:12:08,191][123091] Updated weights for policy 0, policy_version 1203761 (0.0011) [2023-12-26 09:12:08,245][123091] Updated weights for policy 0, policy_version 1203771 (0.0010) [2023-12-26 09:12:08,296][123091] Updated weights for policy 0, policy_version 1203781 (0.0010) [2023-12-26 09:12:08,319][123090] Updated weights for policy 1, policy_version 1195171 (0.0010) [2023-12-26 09:12:08,360][123091] Updated weights for policy 0, policy_version 1203791 (0.0011) [2023-12-26 09:12:08,393][123090] Updated weights for policy 1, policy_version 1195181 (0.0008) [2023-12-26 09:12:08,458][123090] Updated weights for policy 1, policy_version 1195191 (0.0008) [2023-12-26 09:12:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 614146048. Throughput: 0: 8939.2, 1: 8944.0. Samples: 614119732. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:08,785][121949] Avg episode reward: [(0, '6234.037'), (1, '4598.089')] [2023-12-26 09:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001203792_308174848.pth... [2023-12-26 09:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001195200_305971200.pth... [2023-12-26 09:12:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001202768_307912704.pth [2023-12-26 09:12:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001194176_305709056.pth [2023-12-26 09:12:09,179][123091] Updated weights for policy 0, policy_version 1203801 (0.0006) [2023-12-26 09:12:09,216][123090] Updated weights for policy 1, policy_version 1195201 (0.0008) [2023-12-26 09:12:09,250][123091] Updated weights for policy 0, policy_version 1203811 (0.0007) [2023-12-26 09:12:09,283][123090] Updated weights for policy 1, policy_version 1195211 (0.0008) [2023-12-26 09:12:09,322][123091] Updated weights for policy 0, policy_version 1203821 (0.0011) [2023-12-26 09:12:09,351][123090] Updated weights for policy 1, policy_version 1195221 (0.0008) [2023-12-26 09:12:09,423][123090] Updated weights for policy 1, policy_version 1195231 (0.0009) [2023-12-26 09:12:10,125][123091] Updated weights for policy 0, policy_version 1203831 (0.0009) [2023-12-26 09:12:10,181][123091] Updated weights for policy 0, policy_version 1203841 (0.0008) [2023-12-26 09:12:10,248][123091] Updated weights for policy 0, policy_version 1203851 (0.0008) [2023-12-26 09:12:10,249][123090] Updated weights for policy 1, policy_version 1195241 (0.0009) [2023-12-26 09:12:10,314][123090] Updated weights for policy 1, policy_version 1195251 (0.0008) [2023-12-26 09:12:10,380][123090] Updated weights for policy 1, policy_version 1195261 (0.0010) [2023-12-26 09:12:10,965][123091] Updated weights for policy 0, policy_version 1203861 (0.0008) [2023-12-26 09:12:11,039][123091] Updated weights for policy 0, policy_version 1203871 (0.0011) [2023-12-26 09:12:11,103][123091] Updated weights for policy 0, policy_version 1203881 (0.0011) [2023-12-26 09:12:11,289][123090] Updated weights for policy 1, policy_version 1195271 (0.0007) [2023-12-26 09:12:11,359][123090] Updated weights for policy 1, policy_version 1195281 (0.0007) [2023-12-26 09:12:11,435][123090] Updated weights for policy 1, policy_version 1195291 (0.0007) [2023-12-26 09:12:11,851][123091] Updated weights for policy 0, policy_version 1203891 (0.0010) [2023-12-26 09:12:11,921][123091] Updated weights for policy 0, policy_version 1203901 (0.0008) [2023-12-26 09:12:11,976][123091] Updated weights for policy 0, policy_version 1203911 (0.0006) [2023-12-26 09:12:12,289][123090] Updated weights for policy 1, policy_version 1195301 (0.0007) [2023-12-26 09:12:12,358][123090] Updated weights for policy 1, policy_version 1195311 (0.0007) [2023-12-26 09:12:12,430][123090] Updated weights for policy 1, policy_version 1195321 (0.0009) [2023-12-26 09:12:12,738][123091] Updated weights for policy 0, policy_version 1203921 (0.0008) [2023-12-26 09:12:12,792][123091] Updated weights for policy 0, policy_version 1203931 (0.0006) [2023-12-26 09:12:12,845][123091] Updated weights for policy 0, policy_version 1203941 (0.0005) [2023-12-26 09:12:12,906][123091] Updated weights for policy 0, policy_version 1203951 (0.0006) [2023-12-26 09:12:13,250][123090] Updated weights for policy 1, policy_version 1195331 (0.0008) [2023-12-26 09:12:13,302][123090] Updated weights for policy 1, policy_version 1195341 (0.0007) [2023-12-26 09:12:13,351][123090] Updated weights for policy 1, policy_version 1195351 (0.0009) [2023-12-26 09:12:13,671][123091] Updated weights for policy 0, policy_version 1203961 (0.0009) [2023-12-26 09:12:13,737][123091] Updated weights for policy 0, policy_version 1203971 (0.0009) [2023-12-26 09:12:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 614227968. Throughput: 0: 8944.5, 1: 8809.8. Samples: 614224568. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:13,785][121949] Avg episode reward: [(0, '6309.967'), (1, '4717.219')] [2023-12-26 09:12:13,798][123091] Updated weights for policy 0, policy_version 1203981 (0.0009) [2023-12-26 09:12:14,214][123090] Updated weights for policy 1, policy_version 1195361 (0.0008) [2023-12-26 09:12:14,270][123090] Updated weights for policy 1, policy_version 1195371 (0.0008) [2023-12-26 09:12:14,325][123090] Updated weights for policy 1, policy_version 1195381 (0.0009) [2023-12-26 09:12:14,386][123090] Updated weights for policy 1, policy_version 1195391 (0.0009) [2023-12-26 09:12:14,616][123091] Updated weights for policy 0, policy_version 1203991 (0.0010) [2023-12-26 09:12:14,676][123091] Updated weights for policy 0, policy_version 1204001 (0.0009) [2023-12-26 09:12:14,737][123091] Updated weights for policy 0, policy_version 1204011 (0.0005) [2023-12-26 09:12:15,263][123090] Updated weights for policy 1, policy_version 1195401 (0.0010) [2023-12-26 09:12:15,322][123090] Updated weights for policy 1, policy_version 1195411 (0.0010) [2023-12-26 09:12:15,383][123090] Updated weights for policy 1, policy_version 1195421 (0.0010) [2023-12-26 09:12:15,444][123091] Updated weights for policy 0, policy_version 1204021 (0.0008) [2023-12-26 09:12:15,500][123091] Updated weights for policy 0, policy_version 1204031 (0.0010) [2023-12-26 09:12:15,574][123091] Updated weights for policy 0, policy_version 1204041 (0.0008) [2023-12-26 09:12:16,287][123091] Updated weights for policy 0, policy_version 1204051 (0.0008) [2023-12-26 09:12:16,320][123090] Updated weights for policy 1, policy_version 1195431 (0.0009) [2023-12-26 09:12:16,344][123091] Updated weights for policy 0, policy_version 1204061 (0.0006) [2023-12-26 09:12:16,389][123090] Updated weights for policy 1, policy_version 1195441 (0.0009) [2023-12-26 09:12:16,406][123091] Updated weights for policy 0, policy_version 1204071 (0.0005) [2023-12-26 09:12:16,452][123090] Updated weights for policy 1, policy_version 1195451 (0.0009) [2023-12-26 09:12:17,066][123091] Updated weights for policy 0, policy_version 1204081 (0.0006) [2023-12-26 09:12:17,139][123091] Updated weights for policy 0, policy_version 1204091 (0.0007) [2023-12-26 09:12:17,214][123091] Updated weights for policy 0, policy_version 1204101 (0.0011) [2023-12-26 09:12:17,274][123091] Updated weights for policy 0, policy_version 1204111 (0.0011) [2023-12-26 09:12:17,298][123090] Updated weights for policy 1, policy_version 1195461 (0.0008) [2023-12-26 09:12:17,370][123090] Updated weights for policy 1, policy_version 1195471 (0.0005) [2023-12-26 09:12:17,440][123090] Updated weights for policy 1, policy_version 1195481 (0.0005) [2023-12-26 09:12:17,926][123091] Updated weights for policy 0, policy_version 1204121 (0.0006) [2023-12-26 09:12:17,993][123091] Updated weights for policy 0, policy_version 1204131 (0.0005) [2023-12-26 09:12:18,053][123091] Updated weights for policy 0, policy_version 1204141 (0.0005) [2023-12-26 09:12:18,107][123090] Updated weights for policy 1, policy_version 1195491 (0.0005) [2023-12-26 09:12:18,166][123090] Updated weights for policy 1, policy_version 1195501 (0.0006) [2023-12-26 09:12:18,231][123090] Updated weights for policy 1, policy_version 1195511 (0.0006) [2023-12-26 09:12:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 614318080. Throughput: 0: 8984.8, 1: 8829.6. Samples: 614334160. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:18,784][121949] Avg episode reward: [(0, '6301.809'), (1, '5061.541')] [2023-12-26 09:12:18,797][123091] Updated weights for policy 0, policy_version 1204151 (0.0009) [2023-12-26 09:12:18,867][123091] Updated weights for policy 0, policy_version 1204161 (0.0011) [2023-12-26 09:12:18,930][123091] Updated weights for policy 0, policy_version 1204171 (0.0011) [2023-12-26 09:12:18,967][123090] Updated weights for policy 1, policy_version 1195521 (0.0006) [2023-12-26 09:12:19,042][123090] Updated weights for policy 1, policy_version 1195531 (0.0006) [2023-12-26 09:12:19,100][123090] Updated weights for policy 1, policy_version 1195541 (0.0005) [2023-12-26 09:12:19,159][123090] Updated weights for policy 1, policy_version 1195551 (0.0006) [2023-12-26 09:12:19,782][123091] Updated weights for policy 0, policy_version 1204181 (0.0010) [2023-12-26 09:12:19,851][123090] Updated weights for policy 1, policy_version 1195561 (0.0010) [2023-12-26 09:12:19,851][123091] Updated weights for policy 0, policy_version 1204191 (0.0014) [2023-12-26 09:12:19,910][123091] Updated weights for policy 0, policy_version 1204201 (0.0011) [2023-12-26 09:12:19,919][123090] Updated weights for policy 1, policy_version 1195571 (0.0011) [2023-12-26 09:12:19,981][123090] Updated weights for policy 1, policy_version 1195581 (0.0010) [2023-12-26 09:12:20,756][123091] Updated weights for policy 0, policy_version 1204211 (0.0009) [2023-12-26 09:12:20,826][123091] Updated weights for policy 0, policy_version 1204221 (0.0006) [2023-12-26 09:12:20,838][123090] Updated weights for policy 1, policy_version 1195591 (0.0011) [2023-12-26 09:12:20,894][123091] Updated weights for policy 0, policy_version 1204231 (0.0006) [2023-12-26 09:12:20,903][123090] Updated weights for policy 1, policy_version 1195601 (0.0010) [2023-12-26 09:12:20,955][123090] Updated weights for policy 1, policy_version 1195611 (0.0010) [2023-12-26 09:12:21,676][123091] Updated weights for policy 0, policy_version 1204241 (0.0005) [2023-12-26 09:12:21,749][123091] Updated weights for policy 0, policy_version 1204251 (0.0009) [2023-12-26 09:12:21,755][123090] Updated weights for policy 1, policy_version 1195621 (0.0010) [2023-12-26 09:12:21,817][123091] Updated weights for policy 0, policy_version 1204261 (0.0007) [2023-12-26 09:12:21,820][123090] Updated weights for policy 1, policy_version 1195631 (0.0009) [2023-12-26 09:12:21,878][123091] Updated weights for policy 0, policy_version 1204271 (0.0005) [2023-12-26 09:12:21,881][123090] Updated weights for policy 1, policy_version 1195641 (0.0009) [2023-12-26 09:12:22,622][123091] Updated weights for policy 0, policy_version 1204281 (0.0010) [2023-12-26 09:12:22,684][123091] Updated weights for policy 0, policy_version 1204291 (0.0011) [2023-12-26 09:12:22,738][123090] Updated weights for policy 1, policy_version 1195651 (0.0008) [2023-12-26 09:12:22,740][123091] Updated weights for policy 0, policy_version 1204301 (0.0010) [2023-12-26 09:12:22,801][123090] Updated weights for policy 1, policy_version 1195661 (0.0008) [2023-12-26 09:12:22,870][123090] Updated weights for policy 1, policy_version 1195671 (0.0009) [2023-12-26 09:12:23,389][123091] Updated weights for policy 0, policy_version 1204311 (0.0007) [2023-12-26 09:12:23,435][123091] Updated weights for policy 0, policy_version 1204321 (0.0005) [2023-12-26 09:12:23,487][123091] Updated weights for policy 0, policy_version 1204332 (0.0007) [2023-12-26 09:12:23,740][123090] Updated weights for policy 1, policy_version 1195681 (0.0009) [2023-12-26 09:12:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 614408192. Throughput: 0: 8956.8, 1: 8792.9. Samples: 614386600. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:23,785][121949] Avg episode reward: [(0, '6288.864'), (1, '4650.255')] [2023-12-26 09:12:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001204336_308314112.pth... [2023-12-26 09:12:23,795][123090] Updated weights for policy 1, policy_version 1195691 (0.0008) [2023-12-26 09:12:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001203280_308043776.pth [2023-12-26 09:12:23,859][123090] Updated weights for policy 1, policy_version 1195701 (0.0010) [2023-12-26 09:12:23,931][123090] Updated weights for policy 1, policy_version 1195711 (0.0009) [2023-12-26 09:12:23,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001195712_306102272.pth... [2023-12-26 09:12:23,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001194688_305840128.pth [2023-12-26 09:12:24,206][123091] Updated weights for policy 0, policy_version 1204342 (0.0006) [2023-12-26 09:12:24,273][123091] Updated weights for policy 0, policy_version 1204352 (0.0005) [2023-12-26 09:12:24,325][123091] Updated weights for policy 0, policy_version 1204362 (0.0009) [2023-12-26 09:12:24,750][123090] Updated weights for policy 1, policy_version 1195721 (0.0008) [2023-12-26 09:12:24,802][123090] Updated weights for policy 1, policy_version 1195731 (0.0010) [2023-12-26 09:12:24,859][123090] Updated weights for policy 1, policy_version 1195741 (0.0010) [2023-12-26 09:12:25,059][123091] Updated weights for policy 0, policy_version 1204372 (0.0010) [2023-12-26 09:12:25,114][123091] Updated weights for policy 0, policy_version 1204382 (0.0009) [2023-12-26 09:12:25,174][123091] Updated weights for policy 0, policy_version 1204392 (0.0010) [2023-12-26 09:12:25,746][123090] Updated weights for policy 1, policy_version 1195751 (0.0009) [2023-12-26 09:12:25,814][123090] Updated weights for policy 1, policy_version 1195761 (0.0010) [2023-12-26 09:12:25,863][123091] Updated weights for policy 0, policy_version 1204402 (0.0006) [2023-12-26 09:12:25,874][123090] Updated weights for policy 1, policy_version 1195771 (0.0010) [2023-12-26 09:12:25,919][123091] Updated weights for policy 0, policy_version 1204412 (0.0006) [2023-12-26 09:12:25,974][123091] Updated weights for policy 0, policy_version 1204422 (0.0005) [2023-12-26 09:12:26,027][123091] Updated weights for policy 0, policy_version 1204432 (0.0005) [2023-12-26 09:12:26,713][123090] Updated weights for policy 1, policy_version 1195781 (0.0009) [2023-12-26 09:12:26,799][123090] Updated weights for policy 1, policy_version 1195791 (0.0008) [2023-12-26 09:12:26,837][123091] Updated weights for policy 0, policy_version 1204442 (0.0010) [2023-12-26 09:12:26,853][123090] Updated weights for policy 1, policy_version 1195801 (0.0007) [2023-12-26 09:12:26,896][123091] Updated weights for policy 0, policy_version 1204452 (0.0008) [2023-12-26 09:12:26,953][123091] Updated weights for policy 0, policy_version 1204462 (0.0008) [2023-12-26 09:12:27,614][123091] Updated weights for policy 0, policy_version 1204472 (0.0008) [2023-12-26 09:12:27,636][123090] Updated weights for policy 1, policy_version 1195811 (0.0008) [2023-12-26 09:12:27,676][123091] Updated weights for policy 0, policy_version 1204482 (0.0007) [2023-12-26 09:12:27,695][123090] Updated weights for policy 1, policy_version 1195821 (0.0005) [2023-12-26 09:12:27,735][123091] Updated weights for policy 0, policy_version 1204492 (0.0006) [2023-12-26 09:12:27,757][123090] Updated weights for policy 1, policy_version 1195831 (0.0005) [2023-12-26 09:12:28,379][123090] Updated weights for policy 1, policy_version 1195841 (0.0005) [2023-12-26 09:12:28,395][123091] Updated weights for policy 0, policy_version 1204502 (0.0006) [2023-12-26 09:12:28,445][123090] Updated weights for policy 1, policy_version 1195851 (0.0006) [2023-12-26 09:12:28,455][123091] Updated weights for policy 0, policy_version 1204512 (0.0010) [2023-12-26 09:12:28,503][123090] Updated weights for policy 1, policy_version 1195861 (0.0005) [2023-12-26 09:12:28,508][123091] Updated weights for policy 0, policy_version 1204522 (0.0010) [2023-12-26 09:12:28,569][123090] Updated weights for policy 1, policy_version 1195871 (0.0007) [2023-12-26 09:12:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 614506496. Throughput: 0: 9100.9, 1: 8690.8. Samples: 614494144. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:28,784][121949] Avg episode reward: [(0, '6248.069'), (1, '4400.334')] [2023-12-26 09:12:29,280][123090] Updated weights for policy 1, policy_version 1195881 (0.0007) [2023-12-26 09:12:29,281][123091] Updated weights for policy 0, policy_version 1204532 (0.0006) [2023-12-26 09:12:29,342][123090] Updated weights for policy 1, policy_version 1195891 (0.0007) [2023-12-26 09:12:29,344][123091] Updated weights for policy 0, policy_version 1204542 (0.0009) [2023-12-26 09:12:29,407][123090] Updated weights for policy 1, policy_version 1195901 (0.0007) [2023-12-26 09:12:29,409][123091] Updated weights for policy 0, policy_version 1204552 (0.0009) [2023-12-26 09:12:30,141][123090] Updated weights for policy 1, policy_version 1195911 (0.0006) [2023-12-26 09:12:30,192][123090] Updated weights for policy 1, policy_version 1195921 (0.0010) [2023-12-26 09:12:30,244][123090] Updated weights for policy 1, policy_version 1195931 (0.0010) [2023-12-26 09:12:30,279][123091] Updated weights for policy 0, policy_version 1204562 (0.0010) [2023-12-26 09:12:30,341][123091] Updated weights for policy 0, policy_version 1204572 (0.0009) [2023-12-26 09:12:30,404][123091] Updated weights for policy 0, policy_version 1204582 (0.0009) [2023-12-26 09:12:30,471][123091] Updated weights for policy 0, policy_version 1204592 (0.0010) [2023-12-26 09:12:30,987][123090] Updated weights for policy 1, policy_version 1195941 (0.0008) [2023-12-26 09:12:31,042][123090] Updated weights for policy 1, policy_version 1195951 (0.0006) [2023-12-26 09:12:31,098][123090] Updated weights for policy 1, policy_version 1195961 (0.0007) [2023-12-26 09:12:31,250][123091] Updated weights for policy 0, policy_version 1204602 (0.0008) [2023-12-26 09:12:31,309][123091] Updated weights for policy 0, policy_version 1204612 (0.0008) [2023-12-26 09:12:31,372][123091] Updated weights for policy 0, policy_version 1204622 (0.0010) [2023-12-26 09:12:31,918][123090] Updated weights for policy 1, policy_version 1195971 (0.0007) [2023-12-26 09:12:31,963][123090] Updated weights for policy 1, policy_version 1195981 (0.0005) [2023-12-26 09:12:32,020][123090] Updated weights for policy 1, policy_version 1195991 (0.0008) [2023-12-26 09:12:32,187][123091] Updated weights for policy 0, policy_version 1204632 (0.0008) [2023-12-26 09:12:32,241][123091] Updated weights for policy 0, policy_version 1204642 (0.0007) [2023-12-26 09:12:32,302][123091] Updated weights for policy 0, policy_version 1204652 (0.0006) [2023-12-26 09:12:32,809][123090] Updated weights for policy 1, policy_version 1196001 (0.0010) [2023-12-26 09:12:32,862][123090] Updated weights for policy 1, policy_version 1196011 (0.0005) [2023-12-26 09:12:32,917][123090] Updated weights for policy 1, policy_version 1196021 (0.0008) [2023-12-26 09:12:32,972][123090] Updated weights for policy 1, policy_version 1196031 (0.0010) [2023-12-26 09:12:33,049][123091] Updated weights for policy 0, policy_version 1204662 (0.0005) [2023-12-26 09:12:33,099][123091] Updated weights for policy 0, policy_version 1204672 (0.0005) [2023-12-26 09:12:33,152][123091] Updated weights for policy 0, policy_version 1204682 (0.0005) [2023-12-26 09:12:33,767][123091] Updated weights for policy 0, policy_version 1204692 (0.0005) [2023-12-26 09:12:33,775][123090] Updated weights for policy 1, policy_version 1196041 (0.0006) [2023-12-26 09:12:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 614588416. Throughput: 0: 9147.7, 1: 8650.7. Samples: 614605040. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:33,785][121949] Avg episode reward: [(0, '6272.174'), (1, '4493.111')] [2023-12-26 09:12:33,826][123090] Updated weights for policy 1, policy_version 1196051 (0.0005) [2023-12-26 09:12:33,829][123091] Updated weights for policy 0, policy_version 1204702 (0.0005) [2023-12-26 09:12:33,874][123090] Updated weights for policy 1, policy_version 1196061 (0.0005) [2023-12-26 09:12:33,884][123091] Updated weights for policy 0, policy_version 1204712 (0.0005) [2023-12-26 09:12:34,632][123091] Updated weights for policy 0, policy_version 1204722 (0.0006) [2023-12-26 09:12:34,644][123090] Updated weights for policy 1, policy_version 1196071 (0.0007) [2023-12-26 09:12:34,690][123091] Updated weights for policy 0, policy_version 1204732 (0.0008) [2023-12-26 09:12:34,701][123090] Updated weights for policy 1, policy_version 1196081 (0.0009) [2023-12-26 09:12:34,749][123091] Updated weights for policy 0, policy_version 1204742 (0.0007) [2023-12-26 09:12:34,751][123090] Updated weights for policy 1, policy_version 1196091 (0.0009) [2023-12-26 09:12:34,809][123091] Updated weights for policy 0, policy_version 1204752 (0.0007) [2023-12-26 09:12:35,444][123090] Updated weights for policy 1, policy_version 1196101 (0.0007) [2023-12-26 09:12:35,494][123090] Updated weights for policy 1, policy_version 1196111 (0.0007) [2023-12-26 09:12:35,552][123090] Updated weights for policy 1, policy_version 1196121 (0.0009) [2023-12-26 09:12:35,632][123091] Updated weights for policy 0, policy_version 1204762 (0.0005) [2023-12-26 09:12:35,686][123091] Updated weights for policy 0, policy_version 1204772 (0.0006) [2023-12-26 09:12:35,741][123091] Updated weights for policy 0, policy_version 1204782 (0.0009) [2023-12-26 09:12:36,401][123090] Updated weights for policy 1, policy_version 1196132 (0.0010) [2023-12-26 09:12:36,459][123090] Updated weights for policy 1, policy_version 1196142 (0.0009) [2023-12-26 09:12:36,514][123090] Updated weights for policy 1, policy_version 1196152 (0.0009) [2023-12-26 09:12:36,559][123091] Updated weights for policy 0, policy_version 1204792 (0.0009) [2023-12-26 09:12:36,625][123091] Updated weights for policy 0, policy_version 1204802 (0.0009) [2023-12-26 09:12:36,695][123091] Updated weights for policy 0, policy_version 1204812 (0.0009) [2023-12-26 09:12:37,345][123090] Updated weights for policy 1, policy_version 1196162 (0.0007) [2023-12-26 09:12:37,401][123090] Updated weights for policy 1, policy_version 1196173 (0.0010) [2023-12-26 09:12:37,467][123090] Updated weights for policy 1, policy_version 1196183 (0.0009) [2023-12-26 09:12:37,521][123091] Updated weights for policy 0, policy_version 1204822 (0.0008) [2023-12-26 09:12:37,572][123091] Updated weights for policy 0, policy_version 1204832 (0.0010) [2023-12-26 09:12:37,621][123091] Updated weights for policy 0, policy_version 1204842 (0.0009) [2023-12-26 09:12:38,279][123090] Updated weights for policy 1, policy_version 1196193 (0.0008) [2023-12-26 09:12:38,343][123090] Updated weights for policy 1, policy_version 1196203 (0.0007) [2023-12-26 09:12:38,401][123090] Updated weights for policy 1, policy_version 1196213 (0.0009) [2023-12-26 09:12:38,466][123090] Updated weights for policy 1, policy_version 1196223 (0.0008) [2023-12-26 09:12:38,481][123091] Updated weights for policy 0, policy_version 1204853 (0.0009) [2023-12-26 09:12:38,546][123091] Updated weights for policy 0, policy_version 1204863 (0.0010) [2023-12-26 09:12:38,613][123091] Updated weights for policy 0, policy_version 1204873 (0.0010) [2023-12-26 09:12:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 614686720. Throughput: 0: 9149.8, 1: 8678.1. Samples: 614658668. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:38,785][121949] Avg episode reward: [(0, '6341.175'), (1, '4704.704')] [2023-12-26 09:12:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001204880_308453376.pth... [2023-12-26 09:12:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001196224_306233344.pth... [2023-12-26 09:12:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001203792_308174848.pth [2023-12-26 09:12:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001195200_305971200.pth [2023-12-26 09:12:39,299][123090] Updated weights for policy 1, policy_version 1196233 (0.0009) [2023-12-26 09:12:39,377][123090] Updated weights for policy 1, policy_version 1196243 (0.0008) [2023-12-26 09:12:39,443][123090] Updated weights for policy 1, policy_version 1196253 (0.0008) [2023-12-26 09:12:39,465][123091] Updated weights for policy 0, policy_version 1204883 (0.0010) [2023-12-26 09:12:39,520][123091] Updated weights for policy 0, policy_version 1204893 (0.0009) [2023-12-26 09:12:39,578][123091] Updated weights for policy 0, policy_version 1204903 (0.0009) [2023-12-26 09:12:40,264][123090] Updated weights for policy 1, policy_version 1196263 (0.0009) [2023-12-26 09:12:40,328][123090] Updated weights for policy 1, policy_version 1196273 (0.0009) [2023-12-26 09:12:40,400][123090] Updated weights for policy 1, policy_version 1196283 (0.0011) [2023-12-26 09:12:40,438][123091] Updated weights for policy 0, policy_version 1204913 (0.0009) [2023-12-26 09:12:40,504][123091] Updated weights for policy 0, policy_version 1204923 (0.0008) [2023-12-26 09:12:40,559][123091] Updated weights for policy 0, policy_version 1204933 (0.0008) [2023-12-26 09:12:40,622][123091] Updated weights for policy 0, policy_version 1204943 (0.0009) [2023-12-26 09:12:41,273][123090] Updated weights for policy 1, policy_version 1196293 (0.0011) [2023-12-26 09:12:41,325][123090] Updated weights for policy 1, policy_version 1196303 (0.0010) [2023-12-26 09:12:41,402][123090] Updated weights for policy 1, policy_version 1196313 (0.0011) [2023-12-26 09:12:41,423][123091] Updated weights for policy 0, policy_version 1204953 (0.0008) [2023-12-26 09:12:41,475][123091] Updated weights for policy 0, policy_version 1204963 (0.0008) [2023-12-26 09:12:41,524][123091] Updated weights for policy 0, policy_version 1204973 (0.0009) [2023-12-26 09:12:42,225][123090] Updated weights for policy 1, policy_version 1196323 (0.0009) [2023-12-26 09:12:42,303][123090] Updated weights for policy 1, policy_version 1196333 (0.0008) [2023-12-26 09:12:42,350][123091] Updated weights for policy 0, policy_version 1204983 (0.0008) [2023-12-26 09:12:42,373][123090] Updated weights for policy 1, policy_version 1196343 (0.0009) [2023-12-26 09:12:42,412][123091] Updated weights for policy 0, policy_version 1204993 (0.0008) [2023-12-26 09:12:42,475][123091] Updated weights for policy 0, policy_version 1205003 (0.0008) [2023-12-26 09:12:43,153][123090] Updated weights for policy 1, policy_version 1196353 (0.0009) [2023-12-26 09:12:43,205][123090] Updated weights for policy 1, policy_version 1196363 (0.0005) [2023-12-26 09:12:43,253][123090] Updated weights for policy 1, policy_version 1196373 (0.0005) [2023-12-26 09:12:43,261][123091] Updated weights for policy 0, policy_version 1205014 (0.0009) [2023-12-26 09:12:43,308][123090] Updated weights for policy 1, policy_version 1196383 (0.0007) [2023-12-26 09:12:43,310][123091] Updated weights for policy 0, policy_version 1205024 (0.0008) [2023-12-26 09:12:43,358][123091] Updated weights for policy 0, policy_version 1205034 (0.0009) [2023-12-26 09:12:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 614768640. Throughput: 0: 9068.2, 1: 8697.2. Samples: 614760340. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:43,784][121949] Avg episode reward: [(0, '6319.456'), (1, '4544.382')] [2023-12-26 09:12:44,059][123091] Updated weights for policy 0, policy_version 1205044 (0.0006) [2023-12-26 09:12:44,113][123091] Updated weights for policy 0, policy_version 1205054 (0.0006) [2023-12-26 09:12:44,164][123091] Updated weights for policy 0, policy_version 1205064 (0.0006) [2023-12-26 09:12:44,206][123090] Updated weights for policy 1, policy_version 1196393 (0.0008) [2023-12-26 09:12:44,259][123090] Updated weights for policy 1, policy_version 1196403 (0.0009) [2023-12-26 09:12:44,311][123090] Updated weights for policy 1, policy_version 1196413 (0.0009) [2023-12-26 09:12:44,970][123091] Updated weights for policy 0, policy_version 1205074 (0.0005) [2023-12-26 09:12:45,039][123091] Updated weights for policy 0, policy_version 1205084 (0.0011) [2023-12-26 09:12:45,099][123091] Updated weights for policy 0, policy_version 1205094 (0.0011) [2023-12-26 09:12:45,152][123090] Updated weights for policy 1, policy_version 1196423 (0.0008) [2023-12-26 09:12:45,166][123091] Updated weights for policy 0, policy_version 1205104 (0.0009) [2023-12-26 09:12:45,220][123090] Updated weights for policy 1, policy_version 1196433 (0.0010) [2023-12-26 09:12:45,277][123090] Updated weights for policy 1, policy_version 1196443 (0.0009) [2023-12-26 09:12:45,984][123091] Updated weights for policy 0, policy_version 1205114 (0.0009) [2023-12-26 09:12:46,033][123091] Updated weights for policy 0, policy_version 1205124 (0.0009) [2023-12-26 09:12:46,091][123091] Updated weights for policy 0, policy_version 1205134 (0.0009) [2023-12-26 09:12:46,103][123090] Updated weights for policy 1, policy_version 1196453 (0.0008) [2023-12-26 09:12:46,155][123090] Updated weights for policy 1, policy_version 1196463 (0.0010) [2023-12-26 09:12:46,205][123090] Updated weights for policy 1, policy_version 1196473 (0.0009) [2023-12-26 09:12:46,913][123091] Updated weights for policy 0, policy_version 1205144 (0.0010) [2023-12-26 09:12:46,962][123091] Updated weights for policy 0, policy_version 1205154 (0.0009) [2023-12-26 09:12:47,021][123091] Updated weights for policy 0, policy_version 1205164 (0.0006) [2023-12-26 09:12:47,064][123090] Updated weights for policy 1, policy_version 1196483 (0.0008) [2023-12-26 09:12:47,118][123090] Updated weights for policy 1, policy_version 1196493 (0.0010) [2023-12-26 09:12:47,193][123090] Updated weights for policy 1, policy_version 1196503 (0.0010) [2023-12-26 09:12:47,738][123091] Updated weights for policy 0, policy_version 1205174 (0.0008) [2023-12-26 09:12:47,793][123091] Updated weights for policy 0, policy_version 1205184 (0.0009) [2023-12-26 09:12:47,847][123091] Updated weights for policy 0, policy_version 1205194 (0.0009) [2023-12-26 09:12:48,084][123090] Updated weights for policy 1, policy_version 1196513 (0.0010) [2023-12-26 09:12:48,146][123090] Updated weights for policy 1, policy_version 1196523 (0.0009) [2023-12-26 09:12:48,212][123090] Updated weights for policy 1, policy_version 1196533 (0.0010) [2023-12-26 09:12:48,274][123090] Updated weights for policy 1, policy_version 1196543 (0.0009) [2023-12-26 09:12:48,747][123091] Updated weights for policy 0, policy_version 1205204 (0.0009) [2023-12-26 09:12:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 614850560. Throughput: 0: 9103.9, 1: 8700.4. Samples: 614866032. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:48,785][121949] Avg episode reward: [(0, '6253.242'), (1, '4584.624')] [2023-12-26 09:12:48,809][123091] Updated weights for policy 0, policy_version 1205214 (0.0010) [2023-12-26 09:12:48,876][123091] Updated weights for policy 0, policy_version 1205224 (0.0011) [2023-12-26 09:12:49,139][123090] Updated weights for policy 1, policy_version 1196553 (0.0009) [2023-12-26 09:12:49,210][123090] Updated weights for policy 1, policy_version 1196563 (0.0008) [2023-12-26 09:12:49,279][123090] Updated weights for policy 1, policy_version 1196573 (0.0008) [2023-12-26 09:12:49,619][123091] Updated weights for policy 0, policy_version 1205234 (0.0009) [2023-12-26 09:12:49,687][123091] Updated weights for policy 0, policy_version 1205244 (0.0006) [2023-12-26 09:12:49,756][123091] Updated weights for policy 0, policy_version 1205254 (0.0010) [2023-12-26 09:12:49,823][123091] Updated weights for policy 0, policy_version 1205264 (0.0009) [2023-12-26 09:12:50,038][123090] Updated weights for policy 1, policy_version 1196583 (0.0010) [2023-12-26 09:12:50,109][123090] Updated weights for policy 1, policy_version 1196593 (0.0010) [2023-12-26 09:12:50,161][123090] Updated weights for policy 1, policy_version 1196603 (0.0010) [2023-12-26 09:12:50,572][123091] Updated weights for policy 0, policy_version 1205274 (0.0006) [2023-12-26 09:12:50,643][123091] Updated weights for policy 0, policy_version 1205284 (0.0009) [2023-12-26 09:12:50,700][123091] Updated weights for policy 0, policy_version 1205294 (0.0009) [2023-12-26 09:12:51,043][123090] Updated weights for policy 1, policy_version 1196613 (0.0009) [2023-12-26 09:12:51,114][123090] Updated weights for policy 1, policy_version 1196623 (0.0009) [2023-12-26 09:12:51,183][123090] Updated weights for policy 1, policy_version 1196633 (0.0009) [2023-12-26 09:12:51,451][123091] Updated weights for policy 0, policy_version 1205304 (0.0010) [2023-12-26 09:12:51,520][123091] Updated weights for policy 0, policy_version 1205314 (0.0009) [2023-12-26 09:12:51,584][123091] Updated weights for policy 0, policy_version 1205324 (0.0009) [2023-12-26 09:12:52,066][123090] Updated weights for policy 1, policy_version 1196643 (0.0010) [2023-12-26 09:12:52,122][123090] Updated weights for policy 1, policy_version 1196653 (0.0009) [2023-12-26 09:12:52,182][123090] Updated weights for policy 1, policy_version 1196663 (0.0010) [2023-12-26 09:12:52,295][123091] Updated weights for policy 0, policy_version 1205334 (0.0007) [2023-12-26 09:12:52,357][123091] Updated weights for policy 0, policy_version 1205344 (0.0007) [2023-12-26 09:12:52,410][123091] Updated weights for policy 0, policy_version 1205354 (0.0009) [2023-12-26 09:12:52,978][123090] Updated weights for policy 1, policy_version 1196673 (0.0009) [2023-12-26 09:12:53,046][123090] Updated weights for policy 1, policy_version 1196683 (0.0009) [2023-12-26 09:12:53,107][123090] Updated weights for policy 1, policy_version 1196693 (0.0009) [2023-12-26 09:12:53,163][123090] Updated weights for policy 1, policy_version 1196703 (0.0009) [2023-12-26 09:12:53,256][123091] Updated weights for policy 0, policy_version 1205364 (0.0008) [2023-12-26 09:12:53,318][123091] Updated weights for policy 0, policy_version 1205374 (0.0005) [2023-12-26 09:12:53,381][123091] Updated weights for policy 0, policy_version 1205384 (0.0005) [2023-12-26 09:12:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 614940672. Throughput: 0: 9085.8, 1: 8646.8. Samples: 614917696. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:53,785][121949] Avg episode reward: [(0, '6335.673'), (1, '4719.961')] [2023-12-26 09:12:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001205392_308584448.pth... [2023-12-26 09:12:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001196704_306356224.pth... [2023-12-26 09:12:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001195712_306102272.pth [2023-12-26 09:12:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001204336_308314112.pth [2023-12-26 09:12:54,018][123091] Updated weights for policy 0, policy_version 1205394 (0.0005) [2023-12-26 09:12:54,038][123090] Updated weights for policy 1, policy_version 1196713 (0.0008) [2023-12-26 09:12:54,073][123091] Updated weights for policy 0, policy_version 1205404 (0.0005) [2023-12-26 09:12:54,099][123090] Updated weights for policy 1, policy_version 1196723 (0.0009) [2023-12-26 09:12:54,131][123091] Updated weights for policy 0, policy_version 1205414 (0.0007) [2023-12-26 09:12:54,155][123090] Updated weights for policy 1, policy_version 1196733 (0.0008) [2023-12-26 09:12:54,184][123091] Updated weights for policy 0, policy_version 1205424 (0.0008) [2023-12-26 09:12:54,931][123091] Updated weights for policy 0, policy_version 1205434 (0.0010) [2023-12-26 09:12:54,994][123091] Updated weights for policy 0, policy_version 1205444 (0.0008) [2023-12-26 09:12:55,006][123090] Updated weights for policy 1, policy_version 1196743 (0.0008) [2023-12-26 09:12:55,057][123091] Updated weights for policy 0, policy_version 1205454 (0.0009) [2023-12-26 09:12:55,069][123090] Updated weights for policy 1, policy_version 1196753 (0.0008) [2023-12-26 09:12:55,123][123090] Updated weights for policy 1, policy_version 1196763 (0.0009) [2023-12-26 09:12:55,817][123091] Updated weights for policy 0, policy_version 1205464 (0.0007) [2023-12-26 09:12:55,867][123091] Updated weights for policy 0, policy_version 1205474 (0.0010) [2023-12-26 09:12:55,916][123091] Updated weights for policy 0, policy_version 1205484 (0.0009) [2023-12-26 09:12:56,007][123090] Updated weights for policy 1, policy_version 1196773 (0.0009) [2023-12-26 09:12:56,058][123090] Updated weights for policy 1, policy_version 1196784 (0.0008) [2023-12-26 09:12:56,115][123090] Updated weights for policy 1, policy_version 1196794 (0.0009) [2023-12-26 09:12:56,783][123091] Updated weights for policy 0, policy_version 1205494 (0.0009) [2023-12-26 09:12:56,835][123091] Updated weights for policy 0, policy_version 1205504 (0.0009) [2023-12-26 09:12:56,883][123091] Updated weights for policy 0, policy_version 1205514 (0.0009) [2023-12-26 09:12:56,889][123090] Updated weights for policy 1, policy_version 1196804 (0.0010) [2023-12-26 09:12:56,954][123090] Updated weights for policy 1, policy_version 1196814 (0.0010) [2023-12-26 09:12:57,014][123090] Updated weights for policy 1, policy_version 1196824 (0.0010) [2023-12-26 09:12:57,735][123091] Updated weights for policy 0, policy_version 1205524 (0.0008) [2023-12-26 09:12:57,779][123090] Updated weights for policy 1, policy_version 1196834 (0.0009) [2023-12-26 09:12:57,785][123091] Updated weights for policy 0, policy_version 1205534 (0.0009) [2023-12-26 09:12:57,832][123091] Updated weights for policy 0, policy_version 1205544 (0.0008) [2023-12-26 09:12:57,846][123090] Updated weights for policy 1, policy_version 1196844 (0.0005) [2023-12-26 09:12:57,899][123090] Updated weights for policy 1, policy_version 1196854 (0.0005) [2023-12-26 09:12:57,947][123090] Updated weights for policy 1, policy_version 1196864 (0.0006) [2023-12-26 09:12:58,720][123091] Updated weights for policy 0, policy_version 1205554 (0.0009) [2023-12-26 09:12:58,733][123090] Updated weights for policy 1, policy_version 1196874 (0.0007) [2023-12-26 09:12:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 615022592. Throughput: 0: 9117.1, 1: 8651.3. Samples: 615024148. Policy #0 lag: (min: 31.0, avg: 34.4, max: 63.0) [2023-12-26 09:12:58,785][121949] Avg episode reward: [(0, '6196.417'), (1, '4623.328')] [2023-12-26 09:12:58,787][123091] Updated weights for policy 0, policy_version 1205564 (0.0008) [2023-12-26 09:12:58,797][123090] Updated weights for policy 1, policy_version 1196884 (0.0008) [2023-12-26 09:12:58,847][123091] Updated weights for policy 0, policy_version 1205574 (0.0009) [2023-12-26 09:12:58,863][123090] Updated weights for policy 1, policy_version 1196894 (0.0006) [2023-12-26 09:12:58,915][123091] Updated weights for policy 0, policy_version 1205584 (0.0010) [2023-12-26 09:12:59,561][123090] Updated weights for policy 1, policy_version 1196904 (0.0007) [2023-12-26 09:12:59,621][123090] Updated weights for policy 1, policy_version 1196914 (0.0010) [2023-12-26 09:12:59,673][123090] Updated weights for policy 1, policy_version 1196924 (0.0010) [2023-12-26 09:12:59,706][123091] Updated weights for policy 0, policy_version 1205594 (0.0011) [2023-12-26 09:12:59,757][123091] Updated weights for policy 0, policy_version 1205604 (0.0010) [2023-12-26 09:12:59,804][123091] Updated weights for policy 0, policy_version 1205614 (0.0010) [2023-12-26 09:13:00,443][123090] Updated weights for policy 1, policy_version 1196934 (0.0007) [2023-12-26 09:13:00,497][123090] Updated weights for policy 1, policy_version 1196944 (0.0006) [2023-12-26 09:13:00,547][123090] Updated weights for policy 1, policy_version 1196954 (0.0010) [2023-12-26 09:13:00,625][123091] Updated weights for policy 0, policy_version 1205625 (0.0010) [2023-12-26 09:13:00,676][123091] Updated weights for policy 0, policy_version 1205636 (0.0010) [2023-12-26 09:13:00,743][123091] Updated weights for policy 0, policy_version 1205646 (0.0011) [2023-12-26 09:13:01,239][123090] Updated weights for policy 1, policy_version 1196964 (0.0007) [2023-12-26 09:13:01,299][123090] Updated weights for policy 1, policy_version 1196974 (0.0010) [2023-12-26 09:13:01,367][123090] Updated weights for policy 1, policy_version 1196984 (0.0010) [2023-12-26 09:13:01,602][123091] Updated weights for policy 0, policy_version 1205656 (0.0008) [2023-12-26 09:13:01,671][123091] Updated weights for policy 0, policy_version 1205666 (0.0011) [2023-12-26 09:13:01,741][123091] Updated weights for policy 0, policy_version 1205676 (0.0013) [2023-12-26 09:13:02,144][123090] Updated weights for policy 1, policy_version 1196994 (0.0006) [2023-12-26 09:13:02,192][123090] Updated weights for policy 1, policy_version 1197004 (0.0005) [2023-12-26 09:13:02,239][123090] Updated weights for policy 1, policy_version 1197014 (0.0005) [2023-12-26 09:13:02,301][123090] Updated weights for policy 1, policy_version 1197024 (0.0010) [2023-12-26 09:13:02,518][123091] Updated weights for policy 0, policy_version 1205686 (0.0008) [2023-12-26 09:13:02,576][123091] Updated weights for policy 0, policy_version 1205696 (0.0009) [2023-12-26 09:13:02,636][123091] Updated weights for policy 0, policy_version 1205706 (0.0009) [2023-12-26 09:13:03,046][123090] Updated weights for policy 1, policy_version 1197034 (0.0010) [2023-12-26 09:13:03,104][123090] Updated weights for policy 1, policy_version 1197044 (0.0010) [2023-12-26 09:13:03,168][123090] Updated weights for policy 1, policy_version 1197054 (0.0010) [2023-12-26 09:13:03,404][123091] Updated weights for policy 0, policy_version 1205716 (0.0008) [2023-12-26 09:13:03,453][123091] Updated weights for policy 0, policy_version 1205726 (0.0008) [2023-12-26 09:13:03,501][123091] Updated weights for policy 0, policy_version 1205736 (0.0010) [2023-12-26 09:13:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 615120896. Throughput: 0: 9007.8, 1: 8738.1. Samples: 615132728. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:03,785][121949] Avg episode reward: [(0, '6054.336'), (1, '4781.150')] [2023-12-26 09:13:03,995][123090] Updated weights for policy 1, policy_version 1197064 (0.0010) [2023-12-26 09:13:04,062][123090] Updated weights for policy 1, policy_version 1197074 (0.0011) [2023-12-26 09:13:04,118][123090] Updated weights for policy 1, policy_version 1197084 (0.0010) [2023-12-26 09:13:04,131][123091] Updated weights for policy 0, policy_version 1205746 (0.0009) [2023-12-26 09:13:04,201][123091] Updated weights for policy 0, policy_version 1205756 (0.0005) [2023-12-26 09:13:04,263][123091] Updated weights for policy 0, policy_version 1205766 (0.0005) [2023-12-26 09:13:04,320][123091] Updated weights for policy 0, policy_version 1205776 (0.0006) [2023-12-26 09:13:04,971][123090] Updated weights for policy 1, policy_version 1197094 (0.0010) [2023-12-26 09:13:05,042][123090] Updated weights for policy 1, policy_version 1197104 (0.0009) [2023-12-26 09:13:05,080][123091] Updated weights for policy 0, policy_version 1205786 (0.0009) [2023-12-26 09:13:05,106][123090] Updated weights for policy 1, policy_version 1197114 (0.0009) [2023-12-26 09:13:05,137][123091] Updated weights for policy 0, policy_version 1205796 (0.0007) [2023-12-26 09:13:05,196][123091] Updated weights for policy 0, policy_version 1205806 (0.0005) [2023-12-26 09:13:05,906][123091] Updated weights for policy 0, policy_version 1205816 (0.0008) [2023-12-26 09:13:05,946][123090] Updated weights for policy 1, policy_version 1197124 (0.0008) [2023-12-26 09:13:05,971][123091] Updated weights for policy 0, policy_version 1205826 (0.0007) [2023-12-26 09:13:05,996][123090] Updated weights for policy 1, policy_version 1197134 (0.0005) [2023-12-26 09:13:06,035][123091] Updated weights for policy 0, policy_version 1205836 (0.0006) [2023-12-26 09:13:06,048][123090] Updated weights for policy 1, policy_version 1197144 (0.0005) [2023-12-26 09:13:06,767][123091] Updated weights for policy 0, policy_version 1205846 (0.0008) [2023-12-26 09:13:06,827][123091] Updated weights for policy 0, policy_version 1205856 (0.0007) [2023-12-26 09:13:06,835][123090] Updated weights for policy 1, policy_version 1197154 (0.0006) [2023-12-26 09:13:06,884][123091] Updated weights for policy 0, policy_version 1205866 (0.0005) [2023-12-26 09:13:06,902][123090] Updated weights for policy 1, policy_version 1197164 (0.0008) [2023-12-26 09:13:06,971][123090] Updated weights for policy 1, policy_version 1197174 (0.0009) [2023-12-26 09:13:07,042][123090] Updated weights for policy 1, policy_version 1197184 (0.0009) [2023-12-26 09:13:07,540][123091] Updated weights for policy 0, policy_version 1205876 (0.0005) [2023-12-26 09:13:07,599][123091] Updated weights for policy 0, policy_version 1205886 (0.0005) [2023-12-26 09:13:07,654][123091] Updated weights for policy 0, policy_version 1205896 (0.0005) [2023-12-26 09:13:07,763][123090] Updated weights for policy 1, policy_version 1197194 (0.0006) [2023-12-26 09:13:07,820][123090] Updated weights for policy 1, policy_version 1197204 (0.0005) [2023-12-26 09:13:07,880][123090] Updated weights for policy 1, policy_version 1197214 (0.0005) [2023-12-26 09:13:08,347][123091] Updated weights for policy 0, policy_version 1205906 (0.0005) [2023-12-26 09:13:08,419][123091] Updated weights for policy 0, policy_version 1205916 (0.0010) [2023-12-26 09:13:08,486][123091] Updated weights for policy 0, policy_version 1205926 (0.0007) [2023-12-26 09:13:08,552][123091] Updated weights for policy 0, policy_version 1205936 (0.0009) [2023-12-26 09:13:08,658][123090] Updated weights for policy 1, policy_version 1197224 (0.0009) [2023-12-26 09:13:08,719][123090] Updated weights for policy 1, policy_version 1197234 (0.0010) [2023-12-26 09:13:08,784][123090] Updated weights for policy 1, policy_version 1197244 (0.0010) [2023-12-26 09:13:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 615211008. Throughput: 0: 9088.0, 1: 8717.6. Samples: 615187860. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:08,785][121949] Avg episode reward: [(0, '6118.764'), (1, '5051.392')] [2023-12-26 09:13:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001205936_308723712.pth... [2023-12-26 09:13:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001204880_308453376.pth [2023-12-26 09:13:08,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001197248_306495488.pth... [2023-12-26 09:13:08,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001196224_306233344.pth [2023-12-26 09:13:09,292][123091] Updated weights for policy 0, policy_version 1205946 (0.0010) [2023-12-26 09:13:09,356][123091] Updated weights for policy 0, policy_version 1205956 (0.0010) [2023-12-26 09:13:09,423][123091] Updated weights for policy 0, policy_version 1205966 (0.0009) [2023-12-26 09:13:09,517][123090] Updated weights for policy 1, policy_version 1197254 (0.0009) [2023-12-26 09:13:09,589][123090] Updated weights for policy 1, policy_version 1197264 (0.0009) [2023-12-26 09:13:09,654][123090] Updated weights for policy 1, policy_version 1197274 (0.0010) [2023-12-26 09:13:10,295][123091] Updated weights for policy 0, policy_version 1205976 (0.0010) [2023-12-26 09:13:10,362][123091] Updated weights for policy 0, policy_version 1205986 (0.0009) [2023-12-26 09:13:10,416][123091] Updated weights for policy 0, policy_version 1205996 (0.0010) [2023-12-26 09:13:10,485][123090] Updated weights for policy 1, policy_version 1197284 (0.0009) [2023-12-26 09:13:10,558][123090] Updated weights for policy 1, policy_version 1197294 (0.0009) [2023-12-26 09:13:10,619][123090] Updated weights for policy 1, policy_version 1197304 (0.0009) [2023-12-26 09:13:11,273][123091] Updated weights for policy 0, policy_version 1206006 (0.0010) [2023-12-26 09:13:11,333][123091] Updated weights for policy 0, policy_version 1206016 (0.0011) [2023-12-26 09:13:11,396][123091] Updated weights for policy 0, policy_version 1206026 (0.0009) [2023-12-26 09:13:11,472][123090] Updated weights for policy 1, policy_version 1197314 (0.0009) [2023-12-26 09:13:11,536][123090] Updated weights for policy 1, policy_version 1197324 (0.0009) [2023-12-26 09:13:11,599][123090] Updated weights for policy 1, policy_version 1197334 (0.0009) [2023-12-26 09:13:11,675][123090] Updated weights for policy 1, policy_version 1197344 (0.0010) [2023-12-26 09:13:12,298][123091] Updated weights for policy 0, policy_version 1206036 (0.0009) [2023-12-26 09:13:12,359][123091] Updated weights for policy 0, policy_version 1206046 (0.0010) [2023-12-26 09:13:12,435][123091] Updated weights for policy 0, policy_version 1206056 (0.0007) [2023-12-26 09:13:12,496][123090] Updated weights for policy 1, policy_version 1197354 (0.0005) [2023-12-26 09:13:12,554][123090] Updated weights for policy 1, policy_version 1197364 (0.0006) [2023-12-26 09:13:12,616][123090] Updated weights for policy 1, policy_version 1197374 (0.0006) [2023-12-26 09:13:13,214][123091] Updated weights for policy 0, policy_version 1206066 (0.0006) [2023-12-26 09:13:13,277][123091] Updated weights for policy 0, policy_version 1206076 (0.0005) [2023-12-26 09:13:13,328][123090] Updated weights for policy 1, policy_version 1197384 (0.0006) [2023-12-26 09:13:13,333][123091] Updated weights for policy 0, policy_version 1206086 (0.0005) [2023-12-26 09:13:13,385][123090] Updated weights for policy 1, policy_version 1197394 (0.0005) [2023-12-26 09:13:13,392][123091] Updated weights for policy 0, policy_version 1206096 (0.0005) [2023-12-26 09:13:13,442][123090] Updated weights for policy 1, policy_version 1197404 (0.0005) [2023-12-26 09:13:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 615301120. Throughput: 0: 8976.7, 1: 8780.0. Samples: 615293196. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:13,785][121949] Avg episode reward: [(0, '6173.819'), (1, '5082.183')] [2023-12-26 09:13:14,079][123091] Updated weights for policy 0, policy_version 1206106 (0.0005) [2023-12-26 09:13:14,109][123090] Updated weights for policy 1, policy_version 1197414 (0.0006) [2023-12-26 09:13:14,139][123091] Updated weights for policy 0, policy_version 1206116 (0.0005) [2023-12-26 09:13:14,162][123090] Updated weights for policy 1, policy_version 1197424 (0.0008) [2023-12-26 09:13:14,196][123091] Updated weights for policy 0, policy_version 1206126 (0.0007) [2023-12-26 09:13:14,225][123090] Updated weights for policy 1, policy_version 1197434 (0.0006) [2023-12-26 09:13:14,836][123090] Updated weights for policy 1, policy_version 1197444 (0.0006) [2023-12-26 09:13:14,864][123091] Updated weights for policy 0, policy_version 1206136 (0.0007) [2023-12-26 09:13:14,905][123090] Updated weights for policy 1, policy_version 1197454 (0.0006) [2023-12-26 09:13:14,934][123091] Updated weights for policy 0, policy_version 1206146 (0.0008) [2023-12-26 09:13:14,976][123090] Updated weights for policy 1, policy_version 1197464 (0.0008) [2023-12-26 09:13:14,993][123091] Updated weights for policy 0, policy_version 1206156 (0.0008) [2023-12-26 09:13:15,677][123091] Updated weights for policy 0, policy_version 1206166 (0.0006) [2023-12-26 09:13:15,732][123091] Updated weights for policy 0, policy_version 1206176 (0.0005) [2023-12-26 09:13:15,791][123091] Updated weights for policy 0, policy_version 1206186 (0.0009) [2023-12-26 09:13:15,830][123090] Updated weights for policy 1, policy_version 1197474 (0.0009) [2023-12-26 09:13:15,884][123090] Updated weights for policy 1, policy_version 1197484 (0.0009) [2023-12-26 09:13:15,939][123090] Updated weights for policy 1, policy_version 1197494 (0.0010) [2023-12-26 09:13:15,999][123090] Updated weights for policy 1, policy_version 1197504 (0.0009) [2023-12-26 09:13:16,586][123091] Updated weights for policy 0, policy_version 1206196 (0.0010) [2023-12-26 09:13:16,639][123091] Updated weights for policy 0, policy_version 1206206 (0.0010) [2023-12-26 09:13:16,691][123091] Updated weights for policy 0, policy_version 1206216 (0.0010) [2023-12-26 09:13:16,810][123090] Updated weights for policy 1, policy_version 1197514 (0.0010) [2023-12-26 09:13:16,868][123090] Updated weights for policy 1, policy_version 1197524 (0.0010) [2023-12-26 09:13:16,953][123090] Updated weights for policy 1, policy_version 1197534 (0.0010) [2023-12-26 09:13:17,405][123091] Updated weights for policy 0, policy_version 1206226 (0.0006) [2023-12-26 09:13:17,469][123091] Updated weights for policy 0, policy_version 1206236 (0.0007) [2023-12-26 09:13:17,519][123091] Updated weights for policy 0, policy_version 1206246 (0.0008) [2023-12-26 09:13:17,567][123091] Updated weights for policy 0, policy_version 1206256 (0.0007) [2023-12-26 09:13:17,846][123090] Updated weights for policy 1, policy_version 1197544 (0.0008) [2023-12-26 09:13:17,915][123090] Updated weights for policy 1, policy_version 1197554 (0.0008) [2023-12-26 09:13:17,985][123090] Updated weights for policy 1, policy_version 1197564 (0.0007) [2023-12-26 09:13:18,295][123091] Updated weights for policy 0, policy_version 1206266 (0.0011) [2023-12-26 09:13:18,363][123091] Updated weights for policy 0, policy_version 1206276 (0.0011) [2023-12-26 09:13:18,431][123091] Updated weights for policy 0, policy_version 1206286 (0.0011) [2023-12-26 09:13:18,724][123090] Updated weights for policy 1, policy_version 1197574 (0.0007) [2023-12-26 09:13:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 615391232. Throughput: 0: 9038.9, 1: 8756.2. Samples: 615405820. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:18,785][121949] Avg episode reward: [(0, '6343.957'), (1, '5209.526')] [2023-12-26 09:13:18,792][123090] Updated weights for policy 1, policy_version 1197584 (0.0008) [2023-12-26 09:13:18,864][123090] Updated weights for policy 1, policy_version 1197594 (0.0007) [2023-12-26 09:13:19,254][123091] Updated weights for policy 0, policy_version 1206296 (0.0010) [2023-12-26 09:13:19,310][123091] Updated weights for policy 0, policy_version 1206306 (0.0008) [2023-12-26 09:13:19,383][123091] Updated weights for policy 0, policy_version 1206316 (0.0008) [2023-12-26 09:13:19,580][123090] Updated weights for policy 1, policy_version 1197604 (0.0007) [2023-12-26 09:13:19,645][123090] Updated weights for policy 1, policy_version 1197614 (0.0009) [2023-12-26 09:13:19,708][123090] Updated weights for policy 1, policy_version 1197624 (0.0009) [2023-12-26 09:13:20,233][123091] Updated weights for policy 0, policy_version 1206326 (0.0009) [2023-12-26 09:13:20,284][123091] Updated weights for policy 0, policy_version 1206336 (0.0009) [2023-12-26 09:13:20,336][123091] Updated weights for policy 0, policy_version 1206346 (0.0009) [2023-12-26 09:13:20,500][123090] Updated weights for policy 1, policy_version 1197634 (0.0009) [2023-12-26 09:13:20,569][123090] Updated weights for policy 1, policy_version 1197644 (0.0006) [2023-12-26 09:13:20,638][123090] Updated weights for policy 1, policy_version 1197654 (0.0007) [2023-12-26 09:13:20,709][123090] Updated weights for policy 1, policy_version 1197664 (0.0007) [2023-12-26 09:13:21,185][123091] Updated weights for policy 0, policy_version 1206356 (0.0008) [2023-12-26 09:13:21,246][123091] Updated weights for policy 0, policy_version 1206366 (0.0011) [2023-12-26 09:13:21,306][123091] Updated weights for policy 0, policy_version 1206376 (0.0011) [2023-12-26 09:13:21,522][123090] Updated weights for policy 1, policy_version 1197674 (0.0008) [2023-12-26 09:13:21,591][123090] Updated weights for policy 1, policy_version 1197684 (0.0009) [2023-12-26 09:13:21,662][123090] Updated weights for policy 1, policy_version 1197694 (0.0009) [2023-12-26 09:13:22,162][123091] Updated weights for policy 0, policy_version 1206386 (0.0010) [2023-12-26 09:13:22,219][123091] Updated weights for policy 0, policy_version 1206396 (0.0010) [2023-12-26 09:13:22,281][123091] Updated weights for policy 0, policy_version 1206406 (0.0009) [2023-12-26 09:13:22,345][123091] Updated weights for policy 0, policy_version 1206416 (0.0009) [2023-12-26 09:13:22,465][123090] Updated weights for policy 1, policy_version 1197704 (0.0010) [2023-12-26 09:13:22,528][123090] Updated weights for policy 1, policy_version 1197714 (0.0010) [2023-12-26 09:13:22,593][123090] Updated weights for policy 1, policy_version 1197724 (0.0011) [2023-12-26 09:13:23,117][123091] Updated weights for policy 0, policy_version 1206426 (0.0010) [2023-12-26 09:13:23,171][123091] Updated weights for policy 0, policy_version 1206436 (0.0010) [2023-12-26 09:13:23,225][123091] Updated weights for policy 0, policy_version 1206446 (0.0010) [2023-12-26 09:13:23,383][123090] Updated weights for policy 1, policy_version 1197734 (0.0007) [2023-12-26 09:13:23,446][123090] Updated weights for policy 1, policy_version 1197744 (0.0008) [2023-12-26 09:13:23,493][123090] Updated weights for policy 1, policy_version 1197754 (0.0010) [2023-12-26 09:13:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 615481344. Throughput: 0: 9009.9, 1: 8744.5. Samples: 615457612. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:23,785][121949] Avg episode reward: [(0, '6330.699'), (1, '5384.856')] [2023-12-26 09:13:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001206448_308854784.pth... [2023-12-26 09:13:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001197760_306626560.pth... [2023-12-26 09:13:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001205392_308584448.pth [2023-12-26 09:13:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001196704_306356224.pth [2023-12-26 09:13:24,026][123091] Updated weights for policy 0, policy_version 1206456 (0.0009) [2023-12-26 09:13:24,079][123091] Updated weights for policy 0, policy_version 1206466 (0.0009) [2023-12-26 09:13:24,140][123091] Updated weights for policy 0, policy_version 1206476 (0.0010) [2023-12-26 09:13:24,280][123090] Updated weights for policy 1, policy_version 1197764 (0.0010) [2023-12-26 09:13:24,340][123090] Updated weights for policy 1, policy_version 1197774 (0.0010) [2023-12-26 09:13:24,403][123090] Updated weights for policy 1, policy_version 1197784 (0.0010) [2023-12-26 09:13:24,847][123091] Updated weights for policy 0, policy_version 1206486 (0.0009) [2023-12-26 09:13:24,907][123091] Updated weights for policy 0, policy_version 1206496 (0.0009) [2023-12-26 09:13:24,954][123091] Updated weights for policy 0, policy_version 1206506 (0.0008) [2023-12-26 09:13:25,233][123090] Updated weights for policy 1, policy_version 1197794 (0.0010) [2023-12-26 09:13:25,280][123090] Updated weights for policy 1, policy_version 1197804 (0.0010) [2023-12-26 09:13:25,328][123090] Updated weights for policy 1, policy_version 1197814 (0.0010) [2023-12-26 09:13:25,379][123090] Updated weights for policy 1, policy_version 1197824 (0.0010) [2023-12-26 09:13:25,789][123091] Updated weights for policy 0, policy_version 1206516 (0.0009) [2023-12-26 09:13:25,837][123091] Updated weights for policy 0, policy_version 1206526 (0.0009) [2023-12-26 09:13:25,887][123091] Updated weights for policy 0, policy_version 1206536 (0.0007) [2023-12-26 09:13:26,160][123090] Updated weights for policy 1, policy_version 1197834 (0.0010) [2023-12-26 09:13:26,215][123090] Updated weights for policy 1, policy_version 1197844 (0.0006) [2023-12-26 09:13:26,266][123090] Updated weights for policy 1, policy_version 1197854 (0.0005) [2023-12-26 09:13:26,764][123091] Updated weights for policy 0, policy_version 1206546 (0.0006) [2023-12-26 09:13:26,815][123091] Updated weights for policy 0, policy_version 1206556 (0.0009) [2023-12-26 09:13:26,870][123091] Updated weights for policy 0, policy_version 1206566 (0.0009) [2023-12-26 09:13:26,923][123091] Updated weights for policy 0, policy_version 1206576 (0.0007) [2023-12-26 09:13:26,996][123090] Updated weights for policy 1, policy_version 1197864 (0.0007) [2023-12-26 09:13:27,064][123090] Updated weights for policy 1, policy_version 1197874 (0.0010) [2023-12-26 09:13:27,128][123090] Updated weights for policy 1, policy_version 1197884 (0.0009) [2023-12-26 09:13:27,774][123091] Updated weights for policy 0, policy_version 1206586 (0.0005) [2023-12-26 09:13:27,843][123091] Updated weights for policy 0, policy_version 1206596 (0.0005) [2023-12-26 09:13:27,856][123090] Updated weights for policy 1, policy_version 1197894 (0.0005) [2023-12-26 09:13:27,898][123091] Updated weights for policy 0, policy_version 1206606 (0.0007) [2023-12-26 09:13:27,902][123090] Updated weights for policy 1, policy_version 1197904 (0.0005) [2023-12-26 09:13:27,949][123090] Updated weights for policy 1, policy_version 1197914 (0.0005) [2023-12-26 09:13:28,642][123091] Updated weights for policy 0, policy_version 1206616 (0.0010) [2023-12-26 09:13:28,702][123091] Updated weights for policy 0, policy_version 1206626 (0.0009) [2023-12-26 09:13:28,716][123090] Updated weights for policy 1, policy_version 1197924 (0.0007) [2023-12-26 09:13:28,765][123091] Updated weights for policy 0, policy_version 1206636 (0.0009) [2023-12-26 09:13:28,768][123090] Updated weights for policy 1, policy_version 1197934 (0.0006) [2023-12-26 09:13:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 615563264. Throughput: 0: 9049.2, 1: 8810.6. Samples: 615564028. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:28,784][121949] Avg episode reward: [(0, '6388.432'), (1, '5471.167')] [2023-12-26 09:13:28,825][123090] Updated weights for policy 1, policy_version 1197944 (0.0008) [2023-12-26 09:13:29,595][123091] Updated weights for policy 0, policy_version 1206646 (0.0010) [2023-12-26 09:13:29,623][123090] Updated weights for policy 1, policy_version 1197954 (0.0010) [2023-12-26 09:13:29,652][123091] Updated weights for policy 0, policy_version 1206656 (0.0008) [2023-12-26 09:13:29,683][123090] Updated weights for policy 1, policy_version 1197964 (0.0009) [2023-12-26 09:13:29,719][123091] Updated weights for policy 0, policy_version 1206666 (0.0007) [2023-12-26 09:13:29,744][123090] Updated weights for policy 1, policy_version 1197974 (0.0008) [2023-12-26 09:13:29,812][123090] Updated weights for policy 1, policy_version 1197984 (0.0009) [2023-12-26 09:13:30,528][123091] Updated weights for policy 0, policy_version 1206676 (0.0010) [2023-12-26 09:13:30,591][123091] Updated weights for policy 0, policy_version 1206686 (0.0010) [2023-12-26 09:13:30,640][123090] Updated weights for policy 1, policy_version 1197994 (0.0007) [2023-12-26 09:13:30,655][123091] Updated weights for policy 0, policy_version 1206696 (0.0007) [2023-12-26 09:13:30,691][123090] Updated weights for policy 1, policy_version 1198004 (0.0006) [2023-12-26 09:13:30,746][123090] Updated weights for policy 1, policy_version 1198014 (0.0009) [2023-12-26 09:13:31,476][123091] Updated weights for policy 0, policy_version 1206706 (0.0009) [2023-12-26 09:13:31,525][123091] Updated weights for policy 0, policy_version 1206716 (0.0009) [2023-12-26 09:13:31,581][123091] Updated weights for policy 0, policy_version 1206726 (0.0009) [2023-12-26 09:13:31,591][123090] Updated weights for policy 1, policy_version 1198024 (0.0009) [2023-12-26 09:13:31,642][123091] Updated weights for policy 0, policy_version 1206736 (0.0007) [2023-12-26 09:13:31,655][123090] Updated weights for policy 1, policy_version 1198034 (0.0010) [2023-12-26 09:13:31,718][123090] Updated weights for policy 1, policy_version 1198044 (0.0009) [2023-12-26 09:13:32,419][123091] Updated weights for policy 0, policy_version 1206746 (0.0010) [2023-12-26 09:13:32,475][123091] Updated weights for policy 0, policy_version 1206756 (0.0009) [2023-12-26 09:13:32,532][123091] Updated weights for policy 0, policy_version 1206766 (0.0009) [2023-12-26 09:13:32,576][123090] Updated weights for policy 1, policy_version 1198054 (0.0009) [2023-12-26 09:13:32,631][123090] Updated weights for policy 1, policy_version 1198064 (0.0009) [2023-12-26 09:13:32,689][123090] Updated weights for policy 1, policy_version 1198075 (0.0009) [2023-12-26 09:13:33,358][123091] Updated weights for policy 0, policy_version 1206776 (0.0009) [2023-12-26 09:13:33,408][123091] Updated weights for policy 0, policy_version 1206786 (0.0009) [2023-12-26 09:13:33,458][123091] Updated weights for policy 0, policy_version 1206796 (0.0010) [2023-12-26 09:13:33,524][123090] Updated weights for policy 1, policy_version 1198085 (0.0010) [2023-12-26 09:13:33,589][123090] Updated weights for policy 1, policy_version 1198095 (0.0008) [2023-12-26 09:13:33,642][123090] Updated weights for policy 1, policy_version 1198105 (0.0009) [2023-12-26 09:13:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 615661568. Throughput: 0: 8987.1, 1: 8848.3. Samples: 615668628. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:33,785][121949] Avg episode reward: [(0, '6359.625'), (1, '5290.171')] [2023-12-26 09:13:34,314][123091] Updated weights for policy 0, policy_version 1206806 (0.0010) [2023-12-26 09:13:34,377][123091] Updated weights for policy 0, policy_version 1206816 (0.0010) [2023-12-26 09:13:34,432][123091] Updated weights for policy 0, policy_version 1206826 (0.0008) [2023-12-26 09:13:34,469][123090] Updated weights for policy 1, policy_version 1198115 (0.0009) [2023-12-26 09:13:34,539][123090] Updated weights for policy 1, policy_version 1198125 (0.0008) [2023-12-26 09:13:34,608][123090] Updated weights for policy 1, policy_version 1198135 (0.0007) [2023-12-26 09:13:35,170][123091] Updated weights for policy 0, policy_version 1206836 (0.0008) [2023-12-26 09:13:35,239][123091] Updated weights for policy 0, policy_version 1206846 (0.0009) [2023-12-26 09:13:35,304][123091] Updated weights for policy 0, policy_version 1206856 (0.0009) [2023-12-26 09:13:35,444][123090] Updated weights for policy 1, policy_version 1198145 (0.0009) [2023-12-26 09:13:35,519][123090] Updated weights for policy 1, policy_version 1198155 (0.0009) [2023-12-26 09:13:35,577][123090] Updated weights for policy 1, policy_version 1198165 (0.0010) [2023-12-26 09:13:35,625][123090] Updated weights for policy 1, policy_version 1198175 (0.0009) [2023-12-26 09:13:36,043][123091] Updated weights for policy 0, policy_version 1206866 (0.0010) [2023-12-26 09:13:36,106][123091] Updated weights for policy 0, policy_version 1206876 (0.0009) [2023-12-26 09:13:36,168][123091] Updated weights for policy 0, policy_version 1206886 (0.0010) [2023-12-26 09:13:36,234][123091] Updated weights for policy 0, policy_version 1206896 (0.0010) [2023-12-26 09:13:36,491][123090] Updated weights for policy 1, policy_version 1198185 (0.0009) [2023-12-26 09:13:36,559][123090] Updated weights for policy 1, policy_version 1198195 (0.0010) [2023-12-26 09:13:36,624][123090] Updated weights for policy 1, policy_version 1198205 (0.0009) [2023-12-26 09:13:37,069][123091] Updated weights for policy 0, policy_version 1206906 (0.0007) [2023-12-26 09:13:37,129][123091] Updated weights for policy 0, policy_version 1206916 (0.0007) [2023-12-26 09:13:37,186][123091] Updated weights for policy 0, policy_version 1206926 (0.0006) [2023-12-26 09:13:37,510][123090] Updated weights for policy 1, policy_version 1198215 (0.0010) [2023-12-26 09:13:37,564][123090] Updated weights for policy 1, policy_version 1198225 (0.0010) [2023-12-26 09:13:37,619][123090] Updated weights for policy 1, policy_version 1198235 (0.0010) [2023-12-26 09:13:37,833][123091] Updated weights for policy 0, policy_version 1206936 (0.0009) [2023-12-26 09:13:37,899][123091] Updated weights for policy 0, policy_version 1206946 (0.0009) [2023-12-26 09:13:37,959][123091] Updated weights for policy 0, policy_version 1206956 (0.0010) [2023-12-26 09:13:38,528][123090] Updated weights for policy 1, policy_version 1198245 (0.0009) [2023-12-26 09:13:38,600][123090] Updated weights for policy 1, policy_version 1198255 (0.0009) [2023-12-26 09:13:38,660][123090] Updated weights for policy 1, policy_version 1198265 (0.0009) [2023-12-26 09:13:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 615743488. Throughput: 0: 8990.5, 1: 8846.1. Samples: 615720348. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:38,785][121949] Avg episode reward: [(0, '6383.206'), (1, '5278.772')] [2023-12-26 09:13:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001198272_306757632.pth... [2023-12-26 09:13:38,795][123091] Updated weights for policy 0, policy_version 1206966 (0.0010) [2023-12-26 09:13:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001197248_306495488.pth [2023-12-26 09:13:38,848][123091] Updated weights for policy 0, policy_version 1206976 (0.0009) [2023-12-26 09:13:38,910][123091] Updated weights for policy 0, policy_version 1206986 (0.0009) [2023-12-26 09:13:38,948][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001206992_308994048.pth... [2023-12-26 09:13:38,953][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001205936_308723712.pth [2023-12-26 09:13:39,487][123090] Updated weights for policy 1, policy_version 1198275 (0.0009) [2023-12-26 09:13:39,554][123090] Updated weights for policy 1, policy_version 1198285 (0.0009) [2023-12-26 09:13:39,615][123090] Updated weights for policy 1, policy_version 1198295 (0.0009) [2023-12-26 09:13:39,776][123091] Updated weights for policy 0, policy_version 1206996 (0.0009) [2023-12-26 09:13:39,845][123091] Updated weights for policy 0, policy_version 1207006 (0.0010) [2023-12-26 09:13:39,914][123091] Updated weights for policy 0, policy_version 1207016 (0.0010) [2023-12-26 09:13:40,448][123090] Updated weights for policy 1, policy_version 1198305 (0.0009) [2023-12-26 09:13:40,523][123090] Updated weights for policy 1, policy_version 1198315 (0.0005) [2023-12-26 09:13:40,590][123090] Updated weights for policy 1, policy_version 1198325 (0.0009) [2023-12-26 09:13:40,650][123090] Updated weights for policy 1, policy_version 1198335 (0.0009) [2023-12-26 09:13:40,743][123091] Updated weights for policy 0, policy_version 1207026 (0.0010) [2023-12-26 09:13:40,790][123091] Updated weights for policy 0, policy_version 1207036 (0.0010) [2023-12-26 09:13:40,841][123091] Updated weights for policy 0, policy_version 1207046 (0.0010) [2023-12-26 09:13:40,911][123091] Updated weights for policy 0, policy_version 1207056 (0.0011) [2023-12-26 09:13:41,496][123090] Updated weights for policy 1, policy_version 1198345 (0.0009) [2023-12-26 09:13:41,561][123090] Updated weights for policy 1, policy_version 1198355 (0.0009) [2023-12-26 09:13:41,644][123090] Updated weights for policy 1, policy_version 1198365 (0.0009) [2023-12-26 09:13:41,794][123091] Updated weights for policy 0, policy_version 1207066 (0.0009) [2023-12-26 09:13:41,866][123091] Updated weights for policy 0, policy_version 1207076 (0.0010) [2023-12-26 09:13:41,936][123091] Updated weights for policy 0, policy_version 1207086 (0.0010) [2023-12-26 09:13:42,472][123090] Updated weights for policy 1, policy_version 1198375 (0.0007) [2023-12-26 09:13:42,536][123090] Updated weights for policy 1, policy_version 1198385 (0.0006) [2023-12-26 09:13:42,598][123090] Updated weights for policy 1, policy_version 1198395 (0.0007) [2023-12-26 09:13:42,799][123091] Updated weights for policy 0, policy_version 1207096 (0.0009) [2023-12-26 09:13:42,851][123091] Updated weights for policy 0, policy_version 1207106 (0.0009) [2023-12-26 09:13:42,902][123091] Updated weights for policy 0, policy_version 1207116 (0.0008) [2023-12-26 09:13:43,375][123090] Updated weights for policy 1, policy_version 1198405 (0.0009) [2023-12-26 09:13:43,426][123090] Updated weights for policy 1, policy_version 1198415 (0.0009) [2023-12-26 09:13:43,484][123090] Updated weights for policy 1, policy_version 1198425 (0.0010) [2023-12-26 09:13:43,683][123091] Updated weights for policy 0, policy_version 1207126 (0.0007) [2023-12-26 09:13:43,743][123091] Updated weights for policy 0, policy_version 1207136 (0.0005) [2023-12-26 09:13:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 615825408. Throughput: 0: 8903.0, 1: 8813.3. Samples: 615821384. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:43,785][121949] Avg episode reward: [(0, '6287.281'), (1, '5423.417')] [2023-12-26 09:13:43,805][123091] Updated weights for policy 0, policy_version 1207146 (0.0008) [2023-12-26 09:13:44,398][123090] Updated weights for policy 1, policy_version 1198435 (0.0009) [2023-12-26 09:13:44,466][123090] Updated weights for policy 1, policy_version 1198445 (0.0009) [2023-12-26 09:13:44,510][123091] Updated weights for policy 0, policy_version 1207156 (0.0010) [2023-12-26 09:13:44,529][123090] Updated weights for policy 1, policy_version 1198455 (0.0008) [2023-12-26 09:13:44,575][123091] Updated weights for policy 0, policy_version 1207166 (0.0008) [2023-12-26 09:13:44,636][123091] Updated weights for policy 0, policy_version 1207176 (0.0008) [2023-12-26 09:13:45,328][123090] Updated weights for policy 1, policy_version 1198465 (0.0007) [2023-12-26 09:13:45,396][123090] Updated weights for policy 1, policy_version 1198475 (0.0007) [2023-12-26 09:13:45,460][123090] Updated weights for policy 1, policy_version 1198485 (0.0008) [2023-12-26 09:13:45,472][123091] Updated weights for policy 0, policy_version 1207186 (0.0008) [2023-12-26 09:13:45,523][123090] Updated weights for policy 1, policy_version 1198495 (0.0007) [2023-12-26 09:13:45,534][123091] Updated weights for policy 0, policy_version 1207196 (0.0007) [2023-12-26 09:13:45,598][123091] Updated weights for policy 0, policy_version 1207206 (0.0009) [2023-12-26 09:13:45,666][123091] Updated weights for policy 0, policy_version 1207216 (0.0010) [2023-12-26 09:13:46,210][123090] Updated weights for policy 1, policy_version 1198505 (0.0006) [2023-12-26 09:13:46,258][123090] Updated weights for policy 1, policy_version 1198515 (0.0005) [2023-12-26 09:13:46,307][123090] Updated weights for policy 1, policy_version 1198525 (0.0005) [2023-12-26 09:13:46,557][123091] Updated weights for policy 0, policy_version 1207226 (0.0010) [2023-12-26 09:13:46,608][123091] Updated weights for policy 0, policy_version 1207236 (0.0009) [2023-12-26 09:13:46,661][123091] Updated weights for policy 0, policy_version 1207248 (0.0010) [2023-12-26 09:13:46,984][123090] Updated weights for policy 1, policy_version 1198535 (0.0005) [2023-12-26 09:13:47,061][123090] Updated weights for policy 1, policy_version 1198545 (0.0006) [2023-12-26 09:13:47,131][123090] Updated weights for policy 1, policy_version 1198555 (0.0007) [2023-12-26 09:13:47,573][123091] Updated weights for policy 0, policy_version 1207258 (0.0009) [2023-12-26 09:13:47,627][123091] Updated weights for policy 0, policy_version 1207269 (0.0010) [2023-12-26 09:13:47,675][123091] Updated weights for policy 0, policy_version 1207279 (0.0009) [2023-12-26 09:13:47,752][123090] Updated weights for policy 1, policy_version 1198565 (0.0009) [2023-12-26 09:13:47,808][123090] Updated weights for policy 1, policy_version 1198575 (0.0009) [2023-12-26 09:13:47,865][123090] Updated weights for policy 1, policy_version 1198585 (0.0009) [2023-12-26 09:13:48,580][123091] Updated weights for policy 0, policy_version 1207289 (0.0010) [2023-12-26 09:13:48,586][123090] Updated weights for policy 1, policy_version 1198595 (0.0008) [2023-12-26 09:13:48,633][123091] Updated weights for policy 0, policy_version 1207299 (0.0009) [2023-12-26 09:13:48,644][123090] Updated weights for policy 1, policy_version 1198605 (0.0006) [2023-12-26 09:13:48,695][123091] Updated weights for policy 0, policy_version 1207309 (0.0007) [2023-12-26 09:13:48,706][123090] Updated weights for policy 1, policy_version 1198615 (0.0009) [2023-12-26 09:13:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 615923712. Throughput: 0: 8878.0, 1: 8802.0. Samples: 615928324. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:48,785][121949] Avg episode reward: [(0, '6081.466'), (1, '5227.971')] [2023-12-26 09:13:49,520][123090] Updated weights for policy 1, policy_version 1198625 (0.0010) [2023-12-26 09:13:49,591][123090] Updated weights for policy 1, policy_version 1198635 (0.0008) [2023-12-26 09:13:49,601][123091] Updated weights for policy 0, policy_version 1207319 (0.0007) [2023-12-26 09:13:49,653][123090] Updated weights for policy 1, policy_version 1198645 (0.0008) [2023-12-26 09:13:49,661][123091] Updated weights for policy 0, policy_version 1207329 (0.0006) [2023-12-26 09:13:49,711][123090] Updated weights for policy 1, policy_version 1198655 (0.0008) [2023-12-26 09:13:49,724][123091] Updated weights for policy 0, policy_version 1207339 (0.0009) [2023-12-26 09:13:50,472][123090] Updated weights for policy 1, policy_version 1198665 (0.0010) [2023-12-26 09:13:50,523][123091] Updated weights for policy 0, policy_version 1207349 (0.0008) [2023-12-26 09:13:50,532][123090] Updated weights for policy 1, policy_version 1198675 (0.0010) [2023-12-26 09:13:50,584][123091] Updated weights for policy 0, policy_version 1207359 (0.0006) [2023-12-26 09:13:50,598][123090] Updated weights for policy 1, policy_version 1198685 (0.0011) [2023-12-26 09:13:50,650][123091] Updated weights for policy 0, policy_version 1207369 (0.0006) [2023-12-26 09:13:51,439][123090] Updated weights for policy 1, policy_version 1198695 (0.0011) [2023-12-26 09:13:51,441][123091] Updated weights for policy 0, policy_version 1207379 (0.0007) [2023-12-26 09:13:51,504][123091] Updated weights for policy 0, policy_version 1207389 (0.0007) [2023-12-26 09:13:51,515][123090] Updated weights for policy 1, policy_version 1198706 (0.0011) [2023-12-26 09:13:51,569][123091] Updated weights for policy 0, policy_version 1207399 (0.0008) [2023-12-26 09:13:51,578][123090] Updated weights for policy 1, policy_version 1198716 (0.0010) [2023-12-26 09:13:52,239][123091] Updated weights for policy 0, policy_version 1207409 (0.0007) [2023-12-26 09:13:52,306][123091] Updated weights for policy 0, policy_version 1207419 (0.0006) [2023-12-26 09:13:52,374][123091] Updated weights for policy 0, policy_version 1207429 (0.0007) [2023-12-26 09:13:52,438][123091] Updated weights for policy 0, policy_version 1207439 (0.0007) [2023-12-26 09:13:52,478][123090] Updated weights for policy 1, policy_version 1198726 (0.0009) [2023-12-26 09:13:52,535][123090] Updated weights for policy 1, policy_version 1198736 (0.0009) [2023-12-26 09:13:52,586][123090] Updated weights for policy 1, policy_version 1198746 (0.0010) [2023-12-26 09:13:53,082][123091] Updated weights for policy 0, policy_version 1207449 (0.0009) [2023-12-26 09:13:53,137][123091] Updated weights for policy 0, policy_version 1207459 (0.0009) [2023-12-26 09:13:53,199][123091] Updated weights for policy 0, policy_version 1207469 (0.0009) [2023-12-26 09:13:53,465][123090] Updated weights for policy 1, policy_version 1198757 (0.0010) [2023-12-26 09:13:53,526][123090] Updated weights for policy 1, policy_version 1198767 (0.0010) [2023-12-26 09:13:53,585][123090] Updated weights for policy 1, policy_version 1198777 (0.0009) [2023-12-26 09:13:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.8). Total num frames: 616005632. Throughput: 0: 8790.0, 1: 8806.1. Samples: 615979684. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:53,785][121949] Avg episode reward: [(0, '6078.248'), (1, '4930.393')] [2023-12-26 09:13:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001207472_309116928.pth... [2023-12-26 09:13:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001198784_306888704.pth... [2023-12-26 09:13:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001206448_308854784.pth [2023-12-26 09:13:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001207472_309116928.pth [2023-12-26 09:13:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001197760_306626560.pth [2023-12-26 09:13:53,800][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001198784_306888704.pth [2023-12-26 09:13:54,000][123091] Updated weights for policy 0, policy_version 1207479 (0.0007) [2023-12-26 09:13:54,050][123091] Updated weights for policy 0, policy_version 1207489 (0.0005) [2023-12-26 09:13:54,097][123091] Updated weights for policy 0, policy_version 1207499 (0.0005) [2023-12-26 09:13:54,481][123090] Updated weights for policy 1, policy_version 1198787 (0.0010) [2023-12-26 09:13:54,542][123090] Updated weights for policy 1, policy_version 1198797 (0.0009) [2023-12-26 09:13:54,610][123090] Updated weights for policy 1, policy_version 1198807 (0.0010) [2023-12-26 09:13:54,790][123091] Updated weights for policy 0, policy_version 1207509 (0.0005) [2023-12-26 09:13:54,846][123091] Updated weights for policy 0, policy_version 1207519 (0.0008) [2023-12-26 09:13:54,900][123091] Updated weights for policy 0, policy_version 1207529 (0.0009) [2023-12-26 09:13:55,462][123090] Updated weights for policy 1, policy_version 1198818 (0.0010) [2023-12-26 09:13:55,511][123090] Updated weights for policy 1, policy_version 1198828 (0.0009) [2023-12-26 09:13:55,559][123090] Updated weights for policy 1, policy_version 1198838 (0.0009) [2023-12-26 09:13:55,611][123090] Updated weights for policy 1, policy_version 1198848 (0.0009) [2023-12-26 09:13:55,718][123091] Updated weights for policy 0, policy_version 1207539 (0.0010) [2023-12-26 09:13:55,782][123091] Updated weights for policy 0, policy_version 1207549 (0.0009) [2023-12-26 09:13:55,833][123091] Updated weights for policy 0, policy_version 1207559 (0.0009) [2023-12-26 09:13:56,471][123090] Updated weights for policy 1, policy_version 1198858 (0.0009) [2023-12-26 09:13:56,528][123090] Updated weights for policy 1, policy_version 1198868 (0.0009) [2023-12-26 09:13:56,559][123091] Updated weights for policy 0, policy_version 1207569 (0.0010) [2023-12-26 09:13:56,588][123090] Updated weights for policy 1, policy_version 1198878 (0.0009) [2023-12-26 09:13:56,626][123091] Updated weights for policy 0, policy_version 1207579 (0.0009) [2023-12-26 09:13:56,688][123091] Updated weights for policy 0, policy_version 1207589 (0.0009) [2023-12-26 09:13:56,747][123091] Updated weights for policy 0, policy_version 1207599 (0.0010) [2023-12-26 09:13:57,417][123090] Updated weights for policy 1, policy_version 1198888 (0.0009) [2023-12-26 09:13:57,471][123090] Updated weights for policy 1, policy_version 1198898 (0.0009) [2023-12-26 09:13:57,525][123090] Updated weights for policy 1, policy_version 1198908 (0.0009) [2023-12-26 09:13:57,611][123091] Updated weights for policy 0, policy_version 1207609 (0.0010) [2023-12-26 09:13:57,676][123091] Updated weights for policy 0, policy_version 1207619 (0.0008) [2023-12-26 09:13:57,730][123091] Updated weights for policy 0, policy_version 1207629 (0.0009) [2023-12-26 09:13:58,311][123090] Updated weights for policy 1, policy_version 1198918 (0.0009) [2023-12-26 09:13:58,377][123090] Updated weights for policy 1, policy_version 1198928 (0.0008) [2023-12-26 09:13:58,442][123090] Updated weights for policy 1, policy_version 1198938 (0.0008) [2023-12-26 09:13:58,597][123091] Updated weights for policy 0, policy_version 1207639 (0.0009) [2023-12-26 09:13:58,670][123091] Updated weights for policy 0, policy_version 1207649 (0.0009) [2023-12-26 09:13:58,735][123091] Updated weights for policy 0, policy_version 1207659 (0.0007) [2023-12-26 09:13:58,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 616095744. Throughput: 0: 8876.6, 1: 8728.6. Samples: 616085432. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:13:58,785][121949] Avg episode reward: [(0, '6295.344'), (1, '4863.778')] [2023-12-26 09:13:59,300][123090] Updated weights for policy 1, policy_version 1198948 (0.0008) [2023-12-26 09:13:59,371][123090] Updated weights for policy 1, policy_version 1198958 (0.0008) [2023-12-26 09:13:59,439][123090] Updated weights for policy 1, policy_version 1198968 (0.0009) [2023-12-26 09:13:59,646][123091] Updated weights for policy 0, policy_version 1207669 (0.0008) [2023-12-26 09:13:59,708][123091] Updated weights for policy 0, policy_version 1207679 (0.0010) [2023-12-26 09:13:59,777][123091] Updated weights for policy 0, policy_version 1207689 (0.0009) [2023-12-26 09:14:00,267][123090] Updated weights for policy 1, policy_version 1198978 (0.0009) [2023-12-26 09:14:00,318][123090] Updated weights for policy 1, policy_version 1198988 (0.0008) [2023-12-26 09:14:00,381][123090] Updated weights for policy 1, policy_version 1198998 (0.0009) [2023-12-26 09:14:00,449][123090] Updated weights for policy 1, policy_version 1199008 (0.0006) [2023-12-26 09:14:00,641][123091] Updated weights for policy 0, policy_version 1207699 (0.0009) [2023-12-26 09:14:00,696][123091] Updated weights for policy 0, policy_version 1207709 (0.0010) [2023-12-26 09:14:00,747][123091] Updated weights for policy 0, policy_version 1207719 (0.0010) [2023-12-26 09:14:01,243][123090] Updated weights for policy 1, policy_version 1199018 (0.0005) [2023-12-26 09:14:01,317][123090] Updated weights for policy 1, policy_version 1199028 (0.0005) [2023-12-26 09:14:01,384][123090] Updated weights for policy 1, policy_version 1199038 (0.0006) [2023-12-26 09:14:01,558][123091] Updated weights for policy 0, policy_version 1207729 (0.0010) [2023-12-26 09:14:01,616][123091] Updated weights for policy 0, policy_version 1207739 (0.0008) [2023-12-26 09:14:01,685][123091] Updated weights for policy 0, policy_version 1207749 (0.0010) [2023-12-26 09:14:01,756][123091] Updated weights for policy 0, policy_version 1207759 (0.0007) [2023-12-26 09:14:02,124][123090] Updated weights for policy 1, policy_version 1199048 (0.0006) [2023-12-26 09:14:02,182][123090] Updated weights for policy 1, policy_version 1199058 (0.0010) [2023-12-26 09:14:02,245][123090] Updated weights for policy 1, policy_version 1199068 (0.0010) [2023-12-26 09:14:02,508][123091] Updated weights for policy 0, policy_version 1207769 (0.0009) [2023-12-26 09:14:02,575][123091] Updated weights for policy 0, policy_version 1207779 (0.0010) [2023-12-26 09:14:02,647][123091] Updated weights for policy 0, policy_version 1207789 (0.0008) [2023-12-26 09:14:02,973][123090] Updated weights for policy 1, policy_version 1199078 (0.0009) [2023-12-26 09:14:03,029][123090] Updated weights for policy 1, policy_version 1199088 (0.0008) [2023-12-26 09:14:03,097][123090] Updated weights for policy 1, policy_version 1199098 (0.0009) [2023-12-26 09:14:03,430][123091] Updated weights for policy 0, policy_version 1207799 (0.0007) [2023-12-26 09:14:03,475][123091] Updated weights for policy 0, policy_version 1207809 (0.0005) [2023-12-26 09:14:03,525][123091] Updated weights for policy 0, policy_version 1207819 (0.0005) [2023-12-26 09:14:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 616177664. Throughput: 0: 8721.2, 1: 8702.6. Samples: 616189888. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:03,784][121949] Avg episode reward: [(0, '6240.145'), (1, '5137.445')] [2023-12-26 09:14:03,843][123090] Updated weights for policy 1, policy_version 1199108 (0.0010) [2023-12-26 09:14:03,913][123090] Updated weights for policy 1, policy_version 1199118 (0.0011) [2023-12-26 09:14:03,984][123090] Updated weights for policy 1, policy_version 1199128 (0.0011) [2023-12-26 09:14:04,233][123091] Updated weights for policy 0, policy_version 1207829 (0.0007) [2023-12-26 09:14:04,285][123091] Updated weights for policy 0, policy_version 1207839 (0.0010) [2023-12-26 09:14:04,353][123091] Updated weights for policy 0, policy_version 1207849 (0.0011) [2023-12-26 09:14:04,759][123090] Updated weights for policy 1, policy_version 1199138 (0.0009) [2023-12-26 09:14:04,820][123090] Updated weights for policy 1, policy_version 1199148 (0.0006) [2023-12-26 09:14:04,896][123090] Updated weights for policy 1, policy_version 1199158 (0.0006) [2023-12-26 09:14:04,960][123090] Updated weights for policy 1, policy_version 1199168 (0.0005) [2023-12-26 09:14:05,162][123091] Updated weights for policy 0, policy_version 1207859 (0.0010) [2023-12-26 09:14:05,231][123091] Updated weights for policy 0, policy_version 1207869 (0.0010) [2023-12-26 09:14:05,301][123091] Updated weights for policy 0, policy_version 1207879 (0.0010) [2023-12-26 09:14:05,615][123090] Updated weights for policy 1, policy_version 1199178 (0.0005) [2023-12-26 09:14:05,672][123090] Updated weights for policy 1, policy_version 1199188 (0.0005) [2023-12-26 09:14:05,729][123090] Updated weights for policy 1, policy_version 1199198 (0.0005) [2023-12-26 09:14:06,082][123091] Updated weights for policy 0, policy_version 1207889 (0.0010) [2023-12-26 09:14:06,147][123091] Updated weights for policy 0, policy_version 1207899 (0.0009) [2023-12-26 09:14:06,213][123091] Updated weights for policy 0, policy_version 1207909 (0.0008) [2023-12-26 09:14:06,277][123091] Updated weights for policy 0, policy_version 1207919 (0.0006) [2023-12-26 09:14:06,415][123090] Updated weights for policy 1, policy_version 1199208 (0.0008) [2023-12-26 09:14:06,487][123090] Updated weights for policy 1, policy_version 1199218 (0.0009) [2023-12-26 09:14:06,560][123090] Updated weights for policy 1, policy_version 1199228 (0.0010) [2023-12-26 09:14:07,016][123091] Updated weights for policy 0, policy_version 1207929 (0.0008) [2023-12-26 09:14:07,067][123091] Updated weights for policy 0, policy_version 1207939 (0.0007) [2023-12-26 09:14:07,136][123091] Updated weights for policy 0, policy_version 1207949 (0.0007) [2023-12-26 09:14:07,417][123090] Updated weights for policy 1, policy_version 1199238 (0.0011) [2023-12-26 09:14:07,466][123090] Updated weights for policy 1, policy_version 1199248 (0.0011) [2023-12-26 09:14:07,511][123090] Updated weights for policy 1, policy_version 1199258 (0.0010) [2023-12-26 09:14:07,910][123091] Updated weights for policy 0, policy_version 1207959 (0.0005) [2023-12-26 09:14:07,967][123091] Updated weights for policy 0, policy_version 1207969 (0.0005) [2023-12-26 09:14:08,018][123091] Updated weights for policy 0, policy_version 1207979 (0.0006) [2023-12-26 09:14:08,385][123090] Updated weights for policy 1, policy_version 1199268 (0.0010) [2023-12-26 09:14:08,442][123090] Updated weights for policy 1, policy_version 1199278 (0.0009) [2023-12-26 09:14:08,505][123090] Updated weights for policy 1, policy_version 1199288 (0.0008) [2023-12-26 09:14:08,726][123091] Updated weights for policy 0, policy_version 1207989 (0.0008) [2023-12-26 09:14:08,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 616267776. Throughput: 0: 8762.6, 1: 8755.0. Samples: 616245900. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:08,784][121949] Avg episode reward: [(0, '6167.201'), (1, '5139.854')] [2023-12-26 09:14:08,786][123091] Updated weights for policy 0, policy_version 1207999 (0.0009) [2023-12-26 09:14:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001199296_307019776.pth... [2023-12-26 09:14:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001198272_306757632.pth [2023-12-26 09:14:08,853][123091] Updated weights for policy 0, policy_version 1208009 (0.0009) [2023-12-26 09:14:08,897][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001208016_309256192.pth... [2023-12-26 09:14:08,901][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001206992_308994048.pth [2023-12-26 09:14:09,328][123090] Updated weights for policy 1, policy_version 1199298 (0.0008) [2023-12-26 09:14:09,400][123090] Updated weights for policy 1, policy_version 1199308 (0.0008) [2023-12-26 09:14:09,464][123090] Updated weights for policy 1, policy_version 1199318 (0.0009) [2023-12-26 09:14:09,520][123090] Updated weights for policy 1, policy_version 1199328 (0.0009) [2023-12-26 09:14:09,726][123091] Updated weights for policy 0, policy_version 1208019 (0.0008) [2023-12-26 09:14:09,793][123091] Updated weights for policy 0, policy_version 1208029 (0.0010) [2023-12-26 09:14:09,850][123091] Updated weights for policy 0, policy_version 1208039 (0.0009) [2023-12-26 09:14:10,348][123090] Updated weights for policy 1, policy_version 1199338 (0.0010) [2023-12-26 09:14:10,404][123090] Updated weights for policy 1, policy_version 1199348 (0.0010) [2023-12-26 09:14:10,458][123090] Updated weights for policy 1, policy_version 1199358 (0.0010) [2023-12-26 09:14:10,587][123091] Updated weights for policy 0, policy_version 1208049 (0.0008) [2023-12-26 09:14:10,641][123091] Updated weights for policy 0, policy_version 1208059 (0.0006) [2023-12-26 09:14:10,693][123091] Updated weights for policy 0, policy_version 1208069 (0.0006) [2023-12-26 09:14:10,755][123091] Updated weights for policy 0, policy_version 1208079 (0.0005) [2023-12-26 09:14:11,402][123090] Updated weights for policy 1, policy_version 1199368 (0.0009) [2023-12-26 09:14:11,466][123090] Updated weights for policy 1, policy_version 1199378 (0.0008) [2023-12-26 09:14:11,494][123091] Updated weights for policy 0, policy_version 1208089 (0.0007) [2023-12-26 09:14:11,529][123090] Updated weights for policy 1, policy_version 1199388 (0.0008) [2023-12-26 09:14:11,559][123091] Updated weights for policy 0, policy_version 1208099 (0.0010) [2023-12-26 09:14:11,620][123091] Updated weights for policy 0, policy_version 1208109 (0.0010) [2023-12-26 09:14:12,411][123090] Updated weights for policy 1, policy_version 1199398 (0.0008) [2023-12-26 09:14:12,470][123090] Updated weights for policy 1, policy_version 1199408 (0.0009) [2023-12-26 09:14:12,499][123091] Updated weights for policy 0, policy_version 1208119 (0.0008) [2023-12-26 09:14:12,538][123090] Updated weights for policy 1, policy_version 1199418 (0.0010) [2023-12-26 09:14:12,563][123091] Updated weights for policy 0, policy_version 1208129 (0.0009) [2023-12-26 09:14:12,626][123091] Updated weights for policy 0, policy_version 1208139 (0.0009) [2023-12-26 09:14:13,357][123090] Updated weights for policy 1, policy_version 1199428 (0.0009) [2023-12-26 09:14:13,409][123090] Updated weights for policy 1, policy_version 1199438 (0.0009) [2023-12-26 09:14:13,455][123091] Updated weights for policy 0, policy_version 1208149 (0.0008) [2023-12-26 09:14:13,457][123090] Updated weights for policy 1, policy_version 1199448 (0.0008) [2023-12-26 09:14:13,519][123091] Updated weights for policy 0, policy_version 1208159 (0.0009) [2023-12-26 09:14:13,572][123091] Updated weights for policy 0, policy_version 1208170 (0.0010) [2023-12-26 09:14:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 616357888. Throughput: 0: 8802.2, 1: 8650.8. Samples: 616349416. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:13,785][121949] Avg episode reward: [(0, '6328.948'), (1, '4974.146')] [2023-12-26 09:14:14,265][123090] Updated weights for policy 1, policy_version 1199458 (0.0007) [2023-12-26 09:14:14,335][123090] Updated weights for policy 1, policy_version 1199468 (0.0005) [2023-12-26 09:14:14,404][123090] Updated weights for policy 1, policy_version 1199478 (0.0010) [2023-12-26 09:14:14,432][123091] Updated weights for policy 0, policy_version 1208180 (0.0008) [2023-12-26 09:14:14,452][123090] Updated weights for policy 1, policy_version 1199488 (0.0010) [2023-12-26 09:14:14,477][123091] Updated weights for policy 0, policy_version 1208190 (0.0006) [2023-12-26 09:14:14,526][123091] Updated weights for policy 0, policy_version 1208200 (0.0009) [2023-12-26 09:14:15,239][123090] Updated weights for policy 1, policy_version 1199498 (0.0006) [2023-12-26 09:14:15,300][123090] Updated weights for policy 1, policy_version 1199508 (0.0005) [2023-12-26 09:14:15,372][123090] Updated weights for policy 1, policy_version 1199518 (0.0007) [2023-12-26 09:14:15,379][123091] Updated weights for policy 0, policy_version 1208210 (0.0008) [2023-12-26 09:14:15,443][123091] Updated weights for policy 0, policy_version 1208220 (0.0009) [2023-12-26 09:14:15,499][123091] Updated weights for policy 0, policy_version 1208230 (0.0009) [2023-12-26 09:14:15,555][123091] Updated weights for policy 0, policy_version 1208240 (0.0009) [2023-12-26 09:14:16,113][123090] Updated weights for policy 1, policy_version 1199528 (0.0010) [2023-12-26 09:14:16,164][123090] Updated weights for policy 1, policy_version 1199538 (0.0010) [2023-12-26 09:14:16,215][123090] Updated weights for policy 1, policy_version 1199548 (0.0010) [2023-12-26 09:14:16,394][123091] Updated weights for policy 0, policy_version 1208250 (0.0010) [2023-12-26 09:14:16,461][123091] Updated weights for policy 0, policy_version 1208260 (0.0009) [2023-12-26 09:14:16,514][123091] Updated weights for policy 0, policy_version 1208270 (0.0007) [2023-12-26 09:14:17,039][123090] Updated weights for policy 1, policy_version 1199558 (0.0010) [2023-12-26 09:14:17,099][123090] Updated weights for policy 1, policy_version 1199568 (0.0009) [2023-12-26 09:14:17,156][123090] Updated weights for policy 1, policy_version 1199578 (0.0005) [2023-12-26 09:14:17,246][123091] Updated weights for policy 0, policy_version 1208280 (0.0009) [2023-12-26 09:14:17,295][123091] Updated weights for policy 0, policy_version 1208291 (0.0010) [2023-12-26 09:14:17,343][123091] Updated weights for policy 0, policy_version 1208301 (0.0009) [2023-12-26 09:14:17,940][123090] Updated weights for policy 1, policy_version 1199588 (0.0008) [2023-12-26 09:14:17,988][123090] Updated weights for policy 1, policy_version 1199598 (0.0007) [2023-12-26 09:14:18,052][123090] Updated weights for policy 1, policy_version 1199608 (0.0010) [2023-12-26 09:14:18,218][123091] Updated weights for policy 0, policy_version 1208311 (0.0010) [2023-12-26 09:14:18,274][123091] Updated weights for policy 0, policy_version 1208321 (0.0009) [2023-12-26 09:14:18,330][123091] Updated weights for policy 0, policy_version 1208331 (0.0010) [2023-12-26 09:14:18,732][123090] Updated weights for policy 1, policy_version 1199618 (0.0010) [2023-12-26 09:14:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 616439808. Throughput: 0: 8767.3, 1: 8699.1. Samples: 616454616. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:18,785][121949] Avg episode reward: [(0, '6205.474'), (1, '4931.991')] [2023-12-26 09:14:18,797][123090] Updated weights for policy 1, policy_version 1199628 (0.0005) [2023-12-26 09:14:18,861][123090] Updated weights for policy 1, policy_version 1199638 (0.0005) [2023-12-26 09:14:18,918][123090] Updated weights for policy 1, policy_version 1199648 (0.0005) [2023-12-26 09:14:19,288][123091] Updated weights for policy 0, policy_version 1208341 (0.0010) [2023-12-26 09:14:19,351][123091] Updated weights for policy 0, policy_version 1208351 (0.0010) [2023-12-26 09:14:19,420][123091] Updated weights for policy 0, policy_version 1208361 (0.0007) [2023-12-26 09:14:19,560][123090] Updated weights for policy 1, policy_version 1199658 (0.0008) [2023-12-26 09:14:19,616][123090] Updated weights for policy 1, policy_version 1199668 (0.0008) [2023-12-26 09:14:19,665][123090] Updated weights for policy 1, policy_version 1199678 (0.0008) [2023-12-26 09:14:20,256][123091] Updated weights for policy 0, policy_version 1208371 (0.0008) [2023-12-26 09:14:20,316][123091] Updated weights for policy 0, policy_version 1208381 (0.0011) [2023-12-26 09:14:20,379][123091] Updated weights for policy 0, policy_version 1208391 (0.0010) [2023-12-26 09:14:20,510][123090] Updated weights for policy 1, policy_version 1199688 (0.0008) [2023-12-26 09:14:20,571][123090] Updated weights for policy 1, policy_version 1199698 (0.0009) [2023-12-26 09:14:20,642][123090] Updated weights for policy 1, policy_version 1199708 (0.0009) [2023-12-26 09:14:21,242][123091] Updated weights for policy 0, policy_version 1208401 (0.0010) [2023-12-26 09:14:21,311][123091] Updated weights for policy 0, policy_version 1208411 (0.0008) [2023-12-26 09:14:21,381][123091] Updated weights for policy 0, policy_version 1208421 (0.0008) [2023-12-26 09:14:21,451][123091] Updated weights for policy 0, policy_version 1208431 (0.0006) [2023-12-26 09:14:21,494][123090] Updated weights for policy 1, policy_version 1199718 (0.0010) [2023-12-26 09:14:21,560][123090] Updated weights for policy 1, policy_version 1199728 (0.0009) [2023-12-26 09:14:21,628][123090] Updated weights for policy 1, policy_version 1199738 (0.0009) [2023-12-26 09:14:22,246][123091] Updated weights for policy 0, policy_version 1208441 (0.0010) [2023-12-26 09:14:22,316][123091] Updated weights for policy 0, policy_version 1208451 (0.0011) [2023-12-26 09:14:22,388][123091] Updated weights for policy 0, policy_version 1208461 (0.0009) [2023-12-26 09:14:22,522][123090] Updated weights for policy 1, policy_version 1199748 (0.0010) [2023-12-26 09:14:22,584][123090] Updated weights for policy 1, policy_version 1199758 (0.0010) [2023-12-26 09:14:22,632][123090] Updated weights for policy 1, policy_version 1199768 (0.0009) [2023-12-26 09:14:23,177][123091] Updated weights for policy 0, policy_version 1208471 (0.0006) [2023-12-26 09:14:23,252][123091] Updated weights for policy 0, policy_version 1208481 (0.0005) [2023-12-26 09:14:23,315][123091] Updated weights for policy 0, policy_version 1208491 (0.0005) [2023-12-26 09:14:23,517][123090] Updated weights for policy 1, policy_version 1199778 (0.0009) [2023-12-26 09:14:23,578][123090] Updated weights for policy 1, policy_version 1199788 (0.0007) [2023-12-26 09:14:23,627][123090] Updated weights for policy 1, policy_version 1199798 (0.0005) [2023-12-26 09:14:23,691][123090] Updated weights for policy 1, policy_version 1199808 (0.0005) [2023-12-26 09:14:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 616529920. Throughput: 0: 8721.5, 1: 8736.4. Samples: 616505952. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:23,785][121949] Avg episode reward: [(0, '6166.518'), (1, '5080.752')] [2023-12-26 09:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001199808_307150848.pth... [2023-12-26 09:14:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001208496_309379072.pth... [2023-12-26 09:14:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001207472_309116928.pth [2023-12-26 09:14:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001198784_306888704.pth [2023-12-26 09:14:23,910][123091] Updated weights for policy 0, policy_version 1208501 (0.0005) [2023-12-26 09:14:23,964][123091] Updated weights for policy 0, policy_version 1208511 (0.0005) [2023-12-26 09:14:24,020][123091] Updated weights for policy 0, policy_version 1208521 (0.0009) [2023-12-26 09:14:24,441][123090] Updated weights for policy 1, policy_version 1199818 (0.0009) [2023-12-26 09:14:24,494][123090] Updated weights for policy 1, policy_version 1199828 (0.0009) [2023-12-26 09:14:24,546][123090] Updated weights for policy 1, policy_version 1199838 (0.0008) [2023-12-26 09:14:24,792][123091] Updated weights for policy 0, policy_version 1208531 (0.0010) [2023-12-26 09:14:24,841][123091] Updated weights for policy 0, policy_version 1208541 (0.0009) [2023-12-26 09:14:24,897][123091] Updated weights for policy 0, policy_version 1208551 (0.0009) [2023-12-26 09:14:25,392][123090] Updated weights for policy 1, policy_version 1199848 (0.0009) [2023-12-26 09:14:25,450][123090] Updated weights for policy 1, policy_version 1199858 (0.0009) [2023-12-26 09:14:25,523][123090] Updated weights for policy 1, policy_version 1199868 (0.0010) [2023-12-26 09:14:25,739][123091] Updated weights for policy 0, policy_version 1208561 (0.0009) [2023-12-26 09:14:25,804][123091] Updated weights for policy 0, policy_version 1208571 (0.0008) [2023-12-26 09:14:25,860][123091] Updated weights for policy 0, policy_version 1208581 (0.0009) [2023-12-26 09:14:25,920][123091] Updated weights for policy 0, policy_version 1208591 (0.0009) [2023-12-26 09:14:26,360][123090] Updated weights for policy 1, policy_version 1199878 (0.0009) [2023-12-26 09:14:26,429][123090] Updated weights for policy 1, policy_version 1199888 (0.0009) [2023-12-26 09:14:26,493][123090] Updated weights for policy 1, policy_version 1199898 (0.0009) [2023-12-26 09:14:26,723][123091] Updated weights for policy 0, policy_version 1208601 (0.0005) [2023-12-26 09:14:26,770][123091] Updated weights for policy 0, policy_version 1208611 (0.0005) [2023-12-26 09:14:26,821][123091] Updated weights for policy 0, policy_version 1208621 (0.0005) [2023-12-26 09:14:27,346][123090] Updated weights for policy 1, policy_version 1199908 (0.0010) [2023-12-26 09:14:27,409][123090] Updated weights for policy 1, policy_version 1199918 (0.0010) [2023-12-26 09:14:27,477][123090] Updated weights for policy 1, policy_version 1199928 (0.0009) [2023-12-26 09:14:27,599][123091] Updated weights for policy 0, policy_version 1208631 (0.0007) [2023-12-26 09:14:27,656][123091] Updated weights for policy 0, policy_version 1208641 (0.0009) [2023-12-26 09:14:27,717][123091] Updated weights for policy 0, policy_version 1208652 (0.0009) [2023-12-26 09:14:28,284][123090] Updated weights for policy 1, policy_version 1199938 (0.0009) [2023-12-26 09:14:28,351][123090] Updated weights for policy 1, policy_version 1199948 (0.0010) [2023-12-26 09:14:28,418][123090] Updated weights for policy 1, policy_version 1199958 (0.0010) [2023-12-26 09:14:28,469][123090] Updated weights for policy 1, policy_version 1199968 (0.0010) [2023-12-26 09:14:28,584][123091] Updated weights for policy 0, policy_version 1208662 (0.0009) [2023-12-26 09:14:28,640][123091] Updated weights for policy 0, policy_version 1208672 (0.0009) [2023-12-26 09:14:28,687][123091] Updated weights for policy 0, policy_version 1208682 (0.0008) [2023-12-26 09:14:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 616620032. Throughput: 0: 8792.9, 1: 8753.5. Samples: 616610976. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:28,785][121949] Avg episode reward: [(0, '6285.702'), (1, '5057.621')] [2023-12-26 09:14:29,118][123090] Updated weights for policy 1, policy_version 1199978 (0.0005) [2023-12-26 09:14:29,180][123090] Updated weights for policy 1, policy_version 1199988 (0.0005) [2023-12-26 09:14:29,244][123090] Updated weights for policy 1, policy_version 1199998 (0.0007) [2023-12-26 09:14:29,589][123091] Updated weights for policy 0, policy_version 1208693 (0.0009) [2023-12-26 09:14:29,652][123091] Updated weights for policy 0, policy_version 1208703 (0.0010) [2023-12-26 09:14:29,705][123091] Updated weights for policy 0, policy_version 1208713 (0.0010) [2023-12-26 09:14:29,953][123090] Updated weights for policy 1, policy_version 1200008 (0.0008) [2023-12-26 09:14:30,013][123090] Updated weights for policy 1, policy_version 1200018 (0.0010) [2023-12-26 09:14:30,068][123090] Updated weights for policy 1, policy_version 1200028 (0.0010) [2023-12-26 09:14:30,538][123091] Updated weights for policy 0, policy_version 1208723 (0.0010) [2023-12-26 09:14:30,597][123091] Updated weights for policy 0, policy_version 1208733 (0.0010) [2023-12-26 09:14:30,656][123091] Updated weights for policy 0, policy_version 1208743 (0.0011) [2023-12-26 09:14:30,837][123090] Updated weights for policy 1, policy_version 1200038 (0.0010) [2023-12-26 09:14:30,887][123090] Updated weights for policy 1, policy_version 1200048 (0.0010) [2023-12-26 09:14:30,934][123090] Updated weights for policy 1, policy_version 1200058 (0.0010) [2023-12-26 09:14:31,490][123091] Updated weights for policy 0, policy_version 1208753 (0.0010) [2023-12-26 09:14:31,537][123091] Updated weights for policy 0, policy_version 1208763 (0.0010) [2023-12-26 09:14:31,584][123091] Updated weights for policy 0, policy_version 1208773 (0.0010) [2023-12-26 09:14:31,639][123091] Updated weights for policy 0, policy_version 1208783 (0.0010) [2023-12-26 09:14:31,786][123090] Updated weights for policy 1, policy_version 1200068 (0.0009) [2023-12-26 09:14:31,857][123090] Updated weights for policy 1, policy_version 1200078 (0.0005) [2023-12-26 09:14:31,916][123090] Updated weights for policy 1, policy_version 1200088 (0.0006) [2023-12-26 09:14:32,461][123091] Updated weights for policy 0, policy_version 1208793 (0.0006) [2023-12-26 09:14:32,516][123091] Updated weights for policy 0, policy_version 1208803 (0.0005) [2023-12-26 09:14:32,564][123091] Updated weights for policy 0, policy_version 1208813 (0.0005) [2023-12-26 09:14:32,662][123090] Updated weights for policy 1, policy_version 1200098 (0.0007) [2023-12-26 09:14:32,723][123090] Updated weights for policy 1, policy_version 1200108 (0.0009) [2023-12-26 09:14:32,776][123090] Updated weights for policy 1, policy_version 1200118 (0.0010) [2023-12-26 09:14:32,829][123090] Updated weights for policy 1, policy_version 1200128 (0.0010) [2023-12-26 09:14:33,161][123091] Updated weights for policy 0, policy_version 1208823 (0.0005) [2023-12-26 09:14:33,206][123091] Updated weights for policy 0, policy_version 1208833 (0.0005) [2023-12-26 09:14:33,252][123091] Updated weights for policy 0, policy_version 1208843 (0.0005) [2023-12-26 09:14:33,763][123090] Updated weights for policy 1, policy_version 1200138 (0.0005) [2023-12-26 09:14:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17744.7). Total num frames: 616701952. Throughput: 0: 8837.4, 1: 8708.4. Samples: 616717884. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:33,785][121949] Avg episode reward: [(0, '6190.797'), (1, '5126.201')] [2023-12-26 09:14:33,831][123090] Updated weights for policy 1, policy_version 1200148 (0.0008) [2023-12-26 09:14:33,889][123091] Updated weights for policy 0, policy_version 1208853 (0.0005) [2023-12-26 09:14:33,902][123090] Updated weights for policy 1, policy_version 1200158 (0.0005) [2023-12-26 09:14:33,956][123091] Updated weights for policy 0, policy_version 1208863 (0.0007) [2023-12-26 09:14:34,016][123091] Updated weights for policy 0, policy_version 1208873 (0.0009) [2023-12-26 09:14:34,628][123090] Updated weights for policy 1, policy_version 1200168 (0.0008) [2023-12-26 09:14:34,680][123090] Updated weights for policy 1, policy_version 1200178 (0.0009) [2023-12-26 09:14:34,733][123090] Updated weights for policy 1, policy_version 1200189 (0.0009) [2023-12-26 09:14:34,823][123091] Updated weights for policy 0, policy_version 1208883 (0.0010) [2023-12-26 09:14:34,875][123091] Updated weights for policy 0, policy_version 1208893 (0.0010) [2023-12-26 09:14:34,923][123091] Updated weights for policy 0, policy_version 1208903 (0.0010) [2023-12-26 09:14:35,600][123090] Updated weights for policy 1, policy_version 1200199 (0.0009) [2023-12-26 09:14:35,648][123090] Updated weights for policy 1, policy_version 1200209 (0.0009) [2023-12-26 09:14:35,697][123090] Updated weights for policy 1, policy_version 1200220 (0.0009) [2023-12-26 09:14:35,760][123091] Updated weights for policy 0, policy_version 1208913 (0.0010) [2023-12-26 09:14:35,819][123091] Updated weights for policy 0, policy_version 1208923 (0.0010) [2023-12-26 09:14:35,879][123091] Updated weights for policy 0, policy_version 1208933 (0.0011) [2023-12-26 09:14:35,931][123091] Updated weights for policy 0, policy_version 1208943 (0.0010) [2023-12-26 09:14:36,584][123090] Updated weights for policy 1, policy_version 1200230 (0.0010) [2023-12-26 09:14:36,647][123090] Updated weights for policy 1, policy_version 1200240 (0.0007) [2023-12-26 09:14:36,711][123090] Updated weights for policy 1, policy_version 1200250 (0.0005) [2023-12-26 09:14:36,757][123091] Updated weights for policy 0, policy_version 1208953 (0.0010) [2023-12-26 09:14:36,807][123091] Updated weights for policy 0, policy_version 1208963 (0.0010) [2023-12-26 09:14:36,859][123091] Updated weights for policy 0, policy_version 1208973 (0.0010) [2023-12-26 09:14:37,523][123090] Updated weights for policy 1, policy_version 1200260 (0.0008) [2023-12-26 09:14:37,587][123090] Updated weights for policy 1, policy_version 1200270 (0.0009) [2023-12-26 09:14:37,647][123090] Updated weights for policy 1, policy_version 1200280 (0.0010) [2023-12-26 09:14:37,735][123091] Updated weights for policy 0, policy_version 1208983 (0.0010) [2023-12-26 09:14:37,793][123091] Updated weights for policy 0, policy_version 1208994 (0.0010) [2023-12-26 09:14:37,845][123091] Updated weights for policy 0, policy_version 1209004 (0.0009) [2023-12-26 09:14:38,389][123090] Updated weights for policy 1, policy_version 1200290 (0.0009) [2023-12-26 09:14:38,457][123090] Updated weights for policy 1, policy_version 1200300 (0.0006) [2023-12-26 09:14:38,515][123090] Updated weights for policy 1, policy_version 1200310 (0.0006) [2023-12-26 09:14:38,573][123090] Updated weights for policy 1, policy_version 1200320 (0.0008) [2023-12-26 09:14:38,766][123091] Updated weights for policy 0, policy_version 1209014 (0.0010) [2023-12-26 09:14:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 616792064. Throughput: 0: 8858.5, 1: 8711.7. Samples: 616770340. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:38,785][121949] Avg episode reward: [(0, '6151.408'), (1, '5034.806')] [2023-12-26 09:14:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001200320_307281920.pth... [2023-12-26 09:14:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001199296_307019776.pth [2023-12-26 09:14:38,848][123091] Updated weights for policy 0, policy_version 1209024 (0.0010) [2023-12-26 09:14:38,902][123091] Updated weights for policy 0, policy_version 1209034 (0.0009) [2023-12-26 09:14:38,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001209040_309518336.pth... [2023-12-26 09:14:38,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001208016_309256192.pth [2023-12-26 09:14:39,338][123090] Updated weights for policy 1, policy_version 1200330 (0.0006) [2023-12-26 09:14:39,413][123090] Updated weights for policy 1, policy_version 1200340 (0.0008) [2023-12-26 09:14:39,485][123090] Updated weights for policy 1, policy_version 1200350 (0.0006) [2023-12-26 09:14:39,792][123091] Updated weights for policy 0, policy_version 1209044 (0.0010) [2023-12-26 09:14:39,858][123091] Updated weights for policy 0, policy_version 1209054 (0.0009) [2023-12-26 09:14:39,930][123091] Updated weights for policy 0, policy_version 1209064 (0.0008) [2023-12-26 09:14:40,270][123090] Updated weights for policy 1, policy_version 1200360 (0.0009) [2023-12-26 09:14:40,339][123090] Updated weights for policy 1, policy_version 1200370 (0.0010) [2023-12-26 09:14:40,409][123090] Updated weights for policy 1, policy_version 1200380 (0.0010) [2023-12-26 09:14:40,770][123091] Updated weights for policy 0, policy_version 1209074 (0.0007) [2023-12-26 09:14:40,823][123091] Updated weights for policy 0, policy_version 1209084 (0.0009) [2023-12-26 09:14:40,877][123091] Updated weights for policy 0, policy_version 1209094 (0.0009) [2023-12-26 09:14:40,926][123091] Updated weights for policy 0, policy_version 1209104 (0.0009) [2023-12-26 09:14:41,180][123090] Updated weights for policy 1, policy_version 1200390 (0.0008) [2023-12-26 09:14:41,245][123090] Updated weights for policy 1, policy_version 1200400 (0.0010) [2023-12-26 09:14:41,312][123090] Updated weights for policy 1, policy_version 1200410 (0.0010) [2023-12-26 09:14:41,814][123091] Updated weights for policy 0, policy_version 1209114 (0.0010) [2023-12-26 09:14:41,865][123091] Updated weights for policy 0, policy_version 1209124 (0.0010) [2023-12-26 09:14:41,923][123091] Updated weights for policy 0, policy_version 1209134 (0.0010) [2023-12-26 09:14:42,173][123090] Updated weights for policy 1, policy_version 1200420 (0.0011) [2023-12-26 09:14:42,229][123090] Updated weights for policy 1, policy_version 1200430 (0.0010) [2023-12-26 09:14:42,294][123090] Updated weights for policy 1, policy_version 1200440 (0.0010) [2023-12-26 09:14:42,819][123091] Updated weights for policy 0, policy_version 1209144 (0.0009) [2023-12-26 09:14:42,892][123091] Updated weights for policy 0, policy_version 1209154 (0.0009) [2023-12-26 09:14:42,952][123091] Updated weights for policy 0, policy_version 1209164 (0.0010) [2023-12-26 09:14:43,157][123090] Updated weights for policy 1, policy_version 1200450 (0.0010) [2023-12-26 09:14:43,225][123090] Updated weights for policy 1, policy_version 1200460 (0.0009) [2023-12-26 09:14:43,292][123090] Updated weights for policy 1, policy_version 1200470 (0.0010) [2023-12-26 09:14:43,360][123090] Updated weights for policy 1, policy_version 1200480 (0.0010) [2023-12-26 09:14:43,783][123091] Updated weights for policy 0, policy_version 1209174 (0.0009) [2023-12-26 09:14:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 616873984. Throughput: 0: 8691.0, 1: 8783.9. Samples: 616871796. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:43,784][121949] Avg episode reward: [(0, '6175.729'), (1, '4698.969')] [2023-12-26 09:14:43,844][123091] Updated weights for policy 0, policy_version 1209184 (0.0009) [2023-12-26 09:14:43,912][123091] Updated weights for policy 0, policy_version 1209194 (0.0010) [2023-12-26 09:14:44,198][123090] Updated weights for policy 1, policy_version 1200490 (0.0010) [2023-12-26 09:14:44,258][123090] Updated weights for policy 1, policy_version 1200500 (0.0009) [2023-12-26 09:14:44,315][123090] Updated weights for policy 1, policy_version 1200510 (0.0009) [2023-12-26 09:14:44,746][123091] Updated weights for policy 0, policy_version 1209204 (0.0010) [2023-12-26 09:14:44,816][123091] Updated weights for policy 0, policy_version 1209214 (0.0010) [2023-12-26 09:14:44,877][123091] Updated weights for policy 0, policy_version 1209225 (0.0009) [2023-12-26 09:14:45,147][123090] Updated weights for policy 1, policy_version 1200520 (0.0010) [2023-12-26 09:14:45,208][123090] Updated weights for policy 1, policy_version 1200530 (0.0010) [2023-12-26 09:14:45,268][123090] Updated weights for policy 1, policy_version 1200540 (0.0010) [2023-12-26 09:14:45,731][123091] Updated weights for policy 0, policy_version 1209235 (0.0010) [2023-12-26 09:14:45,794][123091] Updated weights for policy 0, policy_version 1209245 (0.0010) [2023-12-26 09:14:45,858][123091] Updated weights for policy 0, policy_version 1209255 (0.0009) [2023-12-26 09:14:46,036][123090] Updated weights for policy 1, policy_version 1200550 (0.0008) [2023-12-26 09:14:46,101][123090] Updated weights for policy 1, policy_version 1200560 (0.0010) [2023-12-26 09:14:46,166][123090] Updated weights for policy 1, policy_version 1200570 (0.0010) [2023-12-26 09:14:46,715][123091] Updated weights for policy 0, policy_version 1209265 (0.0009) [2023-12-26 09:14:46,774][123091] Updated weights for policy 0, policy_version 1209275 (0.0009) [2023-12-26 09:14:46,828][123091] Updated weights for policy 0, policy_version 1209285 (0.0010) [2023-12-26 09:14:46,885][123091] Updated weights for policy 0, policy_version 1209295 (0.0010) [2023-12-26 09:14:46,907][123090] Updated weights for policy 1, policy_version 1200580 (0.0010) [2023-12-26 09:14:46,970][123090] Updated weights for policy 1, policy_version 1200590 (0.0008) [2023-12-26 09:14:47,036][123090] Updated weights for policy 1, policy_version 1200600 (0.0009) [2023-12-26 09:14:47,734][123091] Updated weights for policy 0, policy_version 1209305 (0.0005) [2023-12-26 09:14:47,781][123091] Updated weights for policy 0, policy_version 1209315 (0.0005) [2023-12-26 09:14:47,833][123091] Updated weights for policy 0, policy_version 1209325 (0.0008) [2023-12-26 09:14:47,871][123090] Updated weights for policy 1, policy_version 1200610 (0.0010) [2023-12-26 09:14:47,924][123090] Updated weights for policy 1, policy_version 1200620 (0.0009) [2023-12-26 09:14:47,978][123090] Updated weights for policy 1, policy_version 1200630 (0.0010) [2023-12-26 09:14:48,053][123090] Updated weights for policy 1, policy_version 1200640 (0.0010) [2023-12-26 09:14:48,621][123091] Updated weights for policy 0, policy_version 1209335 (0.0010) [2023-12-26 09:14:48,670][123091] Updated weights for policy 0, policy_version 1209345 (0.0009) [2023-12-26 09:14:48,720][123091] Updated weights for policy 0, policy_version 1209355 (0.0010) [2023-12-26 09:14:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17744.7). Total num frames: 616964096. Throughput: 0: 8695.2, 1: 8734.6. Samples: 616974236. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:48,785][121949] Avg episode reward: [(0, '6168.933'), (1, '4929.216')] [2023-12-26 09:14:48,893][123090] Updated weights for policy 1, policy_version 1200650 (0.0009) [2023-12-26 09:14:48,950][123090] Updated weights for policy 1, policy_version 1200660 (0.0009) [2023-12-26 09:14:49,007][123090] Updated weights for policy 1, policy_version 1200670 (0.0009) [2023-12-26 09:14:49,638][123091] Updated weights for policy 0, policy_version 1209365 (0.0010) [2023-12-26 09:14:49,700][123091] Updated weights for policy 0, policy_version 1209375 (0.0010) [2023-12-26 09:14:49,768][123091] Updated weights for policy 0, policy_version 1209385 (0.0010) [2023-12-26 09:14:49,848][123090] Updated weights for policy 1, policy_version 1200680 (0.0009) [2023-12-26 09:14:49,918][123090] Updated weights for policy 1, policy_version 1200690 (0.0009) [2023-12-26 09:14:49,984][123090] Updated weights for policy 1, policy_version 1200700 (0.0009) [2023-12-26 09:14:50,534][123091] Updated weights for policy 0, policy_version 1209395 (0.0009) [2023-12-26 09:14:50,592][123091] Updated weights for policy 0, policy_version 1209405 (0.0009) [2023-12-26 09:14:50,647][123091] Updated weights for policy 0, policy_version 1209415 (0.0008) [2023-12-26 09:14:50,895][123090] Updated weights for policy 1, policy_version 1200710 (0.0010) [2023-12-26 09:14:50,965][123090] Updated weights for policy 1, policy_version 1200720 (0.0010) [2023-12-26 09:14:51,033][123090] Updated weights for policy 1, policy_version 1200730 (0.0009) [2023-12-26 09:14:51,482][123091] Updated weights for policy 0, policy_version 1209425 (0.0006) [2023-12-26 09:14:51,549][123091] Updated weights for policy 0, policy_version 1209435 (0.0010) [2023-12-26 09:14:51,618][123091] Updated weights for policy 0, policy_version 1209445 (0.0009) [2023-12-26 09:14:51,690][123091] Updated weights for policy 0, policy_version 1209455 (0.0009) [2023-12-26 09:14:51,832][123090] Updated weights for policy 1, policy_version 1200740 (0.0009) [2023-12-26 09:14:51,899][123090] Updated weights for policy 1, policy_version 1200750 (0.0008) [2023-12-26 09:14:51,965][123090] Updated weights for policy 1, policy_version 1200760 (0.0008) [2023-12-26 09:14:52,524][123091] Updated weights for policy 0, policy_version 1209465 (0.0010) [2023-12-26 09:14:52,592][123091] Updated weights for policy 0, policy_version 1209475 (0.0010) [2023-12-26 09:14:52,662][123091] Updated weights for policy 0, policy_version 1209485 (0.0010) [2023-12-26 09:14:52,688][123090] Updated weights for policy 1, policy_version 1200770 (0.0008) [2023-12-26 09:14:52,743][123090] Updated weights for policy 1, policy_version 1200780 (0.0005) [2023-12-26 09:14:52,803][123090] Updated weights for policy 1, policy_version 1200790 (0.0005) [2023-12-26 09:14:52,866][123090] Updated weights for policy 1, policy_version 1200800 (0.0006) [2023-12-26 09:14:53,485][123091] Updated weights for policy 0, policy_version 1209495 (0.0008) [2023-12-26 09:14:53,530][123090] Updated weights for policy 1, policy_version 1200810 (0.0008) [2023-12-26 09:14:53,548][123091] Updated weights for policy 0, policy_version 1209505 (0.0008) [2023-12-26 09:14:53,595][123090] Updated weights for policy 1, policy_version 1200820 (0.0008) [2023-12-26 09:14:53,609][123091] Updated weights for policy 0, policy_version 1209515 (0.0009) [2023-12-26 09:14:53,657][123090] Updated weights for policy 1, policy_version 1200830 (0.0008) [2023-12-26 09:14:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 617054208. Throughput: 0: 8653.2, 1: 8652.4. Samples: 617024656. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:53,785][121949] Avg episode reward: [(0, '6229.097'), (1, '5575.044')] [2023-12-26 09:14:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001209520_309641216.pth... [2023-12-26 09:14:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001200832_307412992.pth... [2023-12-26 09:14:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001199808_307150848.pth [2023-12-26 09:14:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001208496_309379072.pth [2023-12-26 09:14:54,366][123090] Updated weights for policy 1, policy_version 1200840 (0.0008) [2023-12-26 09:14:54,434][123090] Updated weights for policy 1, policy_version 1200850 (0.0008) [2023-12-26 09:14:54,483][123091] Updated weights for policy 0, policy_version 1209525 (0.0008) [2023-12-26 09:14:54,500][123090] Updated weights for policy 1, policy_version 1200860 (0.0009) [2023-12-26 09:14:54,531][123091] Updated weights for policy 0, policy_version 1209535 (0.0008) [2023-12-26 09:14:54,594][123091] Updated weights for policy 0, policy_version 1209545 (0.0008) [2023-12-26 09:14:55,236][123090] Updated weights for policy 1, policy_version 1200870 (0.0007) [2023-12-26 09:14:55,268][123091] Updated weights for policy 0, policy_version 1209555 (0.0006) [2023-12-26 09:14:55,302][123090] Updated weights for policy 1, policy_version 1200880 (0.0005) [2023-12-26 09:14:55,327][123091] Updated weights for policy 0, policy_version 1209565 (0.0005) [2023-12-26 09:14:55,372][123090] Updated weights for policy 1, policy_version 1200890 (0.0005) [2023-12-26 09:14:55,374][123091] Updated weights for policy 0, policy_version 1209575 (0.0005) [2023-12-26 09:14:56,094][123090] Updated weights for policy 1, policy_version 1200900 (0.0006) [2023-12-26 09:14:56,135][123091] Updated weights for policy 0, policy_version 1209585 (0.0006) [2023-12-26 09:14:56,155][123090] Updated weights for policy 1, policy_version 1200910 (0.0008) [2023-12-26 09:14:56,179][123091] Updated weights for policy 0, policy_version 1209595 (0.0010) [2023-12-26 09:14:56,232][123090] Updated weights for policy 1, policy_version 1200920 (0.0008) [2023-12-26 09:14:56,243][123091] Updated weights for policy 0, policy_version 1209605 (0.0007) [2023-12-26 09:14:56,303][123091] Updated weights for policy 0, policy_version 1209615 (0.0008) [2023-12-26 09:14:56,947][123090] Updated weights for policy 1, policy_version 1200930 (0.0009) [2023-12-26 09:14:56,999][123090] Updated weights for policy 1, policy_version 1200941 (0.0010) [2023-12-26 09:14:57,056][123090] Updated weights for policy 1, policy_version 1200951 (0.0005) [2023-12-26 09:14:57,058][123091] Updated weights for policy 0, policy_version 1209625 (0.0011) [2023-12-26 09:14:57,114][123091] Updated weights for policy 0, policy_version 1209635 (0.0010) [2023-12-26 09:14:57,176][123091] Updated weights for policy 0, policy_version 1209645 (0.0010) [2023-12-26 09:14:57,834][123090] Updated weights for policy 1, policy_version 1200961 (0.0006) [2023-12-26 09:14:57,886][123090] Updated weights for policy 1, policy_version 1200971 (0.0005) [2023-12-26 09:14:57,893][123091] Updated weights for policy 0, policy_version 1209655 (0.0007) [2023-12-26 09:14:57,957][123091] Updated weights for policy 0, policy_version 1209665 (0.0006) [2023-12-26 09:14:57,958][123090] Updated weights for policy 1, policy_version 1200981 (0.0006) [2023-12-26 09:14:58,017][123091] Updated weights for policy 0, policy_version 1209675 (0.0007) [2023-12-26 09:14:58,030][123090] Updated weights for policy 1, policy_version 1200991 (0.0006) [2023-12-26 09:14:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17716.9). Total num frames: 617136128. Throughput: 0: 8638.0, 1: 8822.7. Samples: 617135144. Policy #0 lag: (min: 34.0, avg: 55.2, max: 56.0) [2023-12-26 09:14:58,785][121949] Avg episode reward: [(0, '6244.531'), (1, '5450.896')] [2023-12-26 09:14:58,789][123090] Updated weights for policy 1, policy_version 1201001 (0.0008) [2023-12-26 09:14:58,845][123091] Updated weights for policy 0, policy_version 1209685 (0.0008) [2023-12-26 09:14:58,860][123090] Updated weights for policy 1, policy_version 1201011 (0.0010) [2023-12-26 09:14:58,906][123091] Updated weights for policy 0, policy_version 1209695 (0.0007) [2023-12-26 09:14:58,927][123090] Updated weights for policy 1, policy_version 1201021 (0.0010) [2023-12-26 09:14:58,969][123091] Updated weights for policy 0, policy_version 1209705 (0.0008) [2023-12-26 09:14:59,728][123091] Updated weights for policy 0, policy_version 1209715 (0.0009) [2023-12-26 09:14:59,778][123090] Updated weights for policy 1, policy_version 1201031 (0.0007) [2023-12-26 09:14:59,786][123091] Updated weights for policy 0, policy_version 1209725 (0.0009) [2023-12-26 09:14:59,848][123091] Updated weights for policy 0, policy_version 1209735 (0.0007) [2023-12-26 09:14:59,848][123090] Updated weights for policy 1, policy_version 1201041 (0.0007) [2023-12-26 09:14:59,907][123090] Updated weights for policy 1, policy_version 1201051 (0.0008) [2023-12-26 09:15:00,565][123091] Updated weights for policy 0, policy_version 1209745 (0.0005) [2023-12-26 09:15:00,575][123090] Updated weights for policy 1, policy_version 1201061 (0.0007) [2023-12-26 09:15:00,627][123091] Updated weights for policy 0, policy_version 1209755 (0.0009) [2023-12-26 09:15:00,634][123090] Updated weights for policy 1, policy_version 1201071 (0.0005) [2023-12-26 09:15:00,690][123091] Updated weights for policy 0, policy_version 1209765 (0.0009) [2023-12-26 09:15:00,699][123090] Updated weights for policy 1, policy_version 1201081 (0.0006) [2023-12-26 09:15:00,743][123091] Updated weights for policy 0, policy_version 1209775 (0.0009) [2023-12-26 09:15:01,382][123090] Updated weights for policy 1, policy_version 1201091 (0.0008) [2023-12-26 09:15:01,448][123090] Updated weights for policy 1, policy_version 1201101 (0.0008) [2023-12-26 09:15:01,495][123090] Updated weights for policy 1, policy_version 1201111 (0.0008) [2023-12-26 09:15:01,593][123091] Updated weights for policy 0, policy_version 1209785 (0.0010) [2023-12-26 09:15:01,659][123091] Updated weights for policy 0, policy_version 1209795 (0.0009) [2023-12-26 09:15:01,729][123091] Updated weights for policy 0, policy_version 1209805 (0.0008) [2023-12-26 09:15:02,274][123090] Updated weights for policy 1, policy_version 1201121 (0.0007) [2023-12-26 09:15:02,331][123090] Updated weights for policy 1, policy_version 1201131 (0.0010) [2023-12-26 09:15:02,395][123090] Updated weights for policy 1, policy_version 1201141 (0.0010) [2023-12-26 09:15:02,453][123090] Updated weights for policy 1, policy_version 1201151 (0.0009) [2023-12-26 09:15:02,541][123091] Updated weights for policy 0, policy_version 1209815 (0.0009) [2023-12-26 09:15:02,590][123091] Updated weights for policy 0, policy_version 1209825 (0.0009) [2023-12-26 09:15:02,644][123091] Updated weights for policy 0, policy_version 1209836 (0.0010) [2023-12-26 09:15:03,176][123090] Updated weights for policy 1, policy_version 1201161 (0.0008) [2023-12-26 09:15:03,238][123090] Updated weights for policy 1, policy_version 1201171 (0.0008) [2023-12-26 09:15:03,292][123090] Updated weights for policy 1, policy_version 1201181 (0.0009) [2023-12-26 09:15:03,585][123091] Updated weights for policy 0, policy_version 1209846 (0.0009) [2023-12-26 09:15:03,635][123091] Updated weights for policy 0, policy_version 1209856 (0.0009) [2023-12-26 09:15:03,684][123091] Updated weights for policy 0, policy_version 1209866 (0.0009) [2023-12-26 09:15:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 617234432. Throughput: 0: 8672.0, 1: 8836.5. Samples: 617242500. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:03,786][121949] Avg episode reward: [(0, '6194.641'), (1, '5264.361')] [2023-12-26 09:15:04,070][123090] Updated weights for policy 1, policy_version 1201191 (0.0007) [2023-12-26 09:15:04,133][123090] Updated weights for policy 1, policy_version 1201201 (0.0007) [2023-12-26 09:15:04,190][123090] Updated weights for policy 1, policy_version 1201211 (0.0007) [2023-12-26 09:15:04,598][123091] Updated weights for policy 0, policy_version 1209876 (0.0009) [2023-12-26 09:15:04,653][123091] Updated weights for policy 0, policy_version 1209886 (0.0010) [2023-12-26 09:15:04,715][123091] Updated weights for policy 0, policy_version 1209896 (0.0009) [2023-12-26 09:15:04,980][123090] Updated weights for policy 1, policy_version 1201221 (0.0009) [2023-12-26 09:15:05,043][123090] Updated weights for policy 1, policy_version 1201231 (0.0010) [2023-12-26 09:15:05,106][123090] Updated weights for policy 1, policy_version 1201241 (0.0010) [2023-12-26 09:15:05,466][123091] Updated weights for policy 0, policy_version 1209906 (0.0008) [2023-12-26 09:15:05,509][123091] Updated weights for policy 0, policy_version 1209916 (0.0005) [2023-12-26 09:15:05,557][123091] Updated weights for policy 0, policy_version 1209926 (0.0005) [2023-12-26 09:15:05,600][123091] Updated weights for policy 0, policy_version 1209936 (0.0005) [2023-12-26 09:15:05,992][123090] Updated weights for policy 1, policy_version 1201251 (0.0009) [2023-12-26 09:15:06,051][123090] Updated weights for policy 1, policy_version 1201261 (0.0009) [2023-12-26 09:15:06,117][123090] Updated weights for policy 1, policy_version 1201271 (0.0009) [2023-12-26 09:15:06,349][123091] Updated weights for policy 0, policy_version 1209946 (0.0009) [2023-12-26 09:15:06,415][123091] Updated weights for policy 0, policy_version 1209957 (0.0009) [2023-12-26 09:15:06,466][123091] Updated weights for policy 0, policy_version 1209967 (0.0010) [2023-12-26 09:15:06,917][123090] Updated weights for policy 1, policy_version 1201281 (0.0010) [2023-12-26 09:15:06,982][123090] Updated weights for policy 1, policy_version 1201291 (0.0008) [2023-12-26 09:15:07,051][123090] Updated weights for policy 1, policy_version 1201301 (0.0010) [2023-12-26 09:15:07,112][123090] Updated weights for policy 1, policy_version 1201311 (0.0009) [2023-12-26 09:15:07,336][123091] Updated weights for policy 0, policy_version 1209977 (0.0009) [2023-12-26 09:15:07,397][123091] Updated weights for policy 0, policy_version 1209987 (0.0017) [2023-12-26 09:15:07,454][123091] Updated weights for policy 0, policy_version 1209998 (0.0012) [2023-12-26 09:15:07,846][123090] Updated weights for policy 1, policy_version 1201321 (0.0009) [2023-12-26 09:15:07,901][123090] Updated weights for policy 1, policy_version 1201332 (0.0009) [2023-12-26 09:15:07,953][123090] Updated weights for policy 1, policy_version 1201342 (0.0009) [2023-12-26 09:15:08,356][123091] Updated weights for policy 0, policy_version 1210008 (0.0010) [2023-12-26 09:15:08,412][123091] Updated weights for policy 0, policy_version 1210018 (0.0009) [2023-12-26 09:15:08,469][123091] Updated weights for policy 0, policy_version 1210028 (0.0009) [2023-12-26 09:15:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 617316352. Throughput: 0: 8708.4, 1: 8810.8. Samples: 617294316. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:08,785][121949] Avg episode reward: [(0, '6213.536'), (1, '5308.599')] [2023-12-26 09:15:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001210032_309772288.pth... [2023-12-26 09:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001209040_309518336.pth [2023-12-26 09:15:08,801][123090] Updated weights for policy 1, policy_version 1201352 (0.0010) [2023-12-26 09:15:08,869][123090] Updated weights for policy 1, policy_version 1201362 (0.0011) [2023-12-26 09:15:08,928][123090] Updated weights for policy 1, policy_version 1201372 (0.0010) [2023-12-26 09:15:08,952][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001201376_307552256.pth... [2023-12-26 09:15:08,958][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001200320_307281920.pth [2023-12-26 09:15:09,367][123091] Updated weights for policy 0, policy_version 1210038 (0.0009) [2023-12-26 09:15:09,431][123091] Updated weights for policy 0, policy_version 1210048 (0.0009) [2023-12-26 09:15:09,512][123091] Updated weights for policy 0, policy_version 1210058 (0.0006) [2023-12-26 09:15:09,729][123090] Updated weights for policy 1, policy_version 1201382 (0.0010) [2023-12-26 09:15:09,800][123090] Updated weights for policy 1, policy_version 1201392 (0.0009) [2023-12-26 09:15:09,882][123090] Updated weights for policy 1, policy_version 1201402 (0.0009) [2023-12-26 09:15:10,282][123091] Updated weights for policy 0, policy_version 1210068 (0.0009) [2023-12-26 09:15:10,340][123091] Updated weights for policy 0, policy_version 1210078 (0.0010) [2023-12-26 09:15:10,394][123091] Updated weights for policy 0, policy_version 1210088 (0.0009) [2023-12-26 09:15:10,602][123090] Updated weights for policy 1, policy_version 1201412 (0.0008) [2023-12-26 09:15:10,659][123090] Updated weights for policy 1, policy_version 1201422 (0.0005) [2023-12-26 09:15:10,718][123090] Updated weights for policy 1, policy_version 1201432 (0.0005) [2023-12-26 09:15:11,287][123091] Updated weights for policy 0, policy_version 1210098 (0.0008) [2023-12-26 09:15:11,347][123091] Updated weights for policy 0, policy_version 1210108 (0.0010) [2023-12-26 09:15:11,422][123091] Updated weights for policy 0, policy_version 1210118 (0.0010) [2023-12-26 09:15:11,442][123090] Updated weights for policy 1, policy_version 1201442 (0.0007) [2023-12-26 09:15:11,485][123091] Updated weights for policy 0, policy_version 1210128 (0.0008) [2023-12-26 09:15:11,509][123090] Updated weights for policy 1, policy_version 1201452 (0.0008) [2023-12-26 09:15:11,573][123090] Updated weights for policy 1, policy_version 1201462 (0.0008) [2023-12-26 09:15:11,641][123090] Updated weights for policy 1, policy_version 1201472 (0.0007) [2023-12-26 09:15:12,352][123091] Updated weights for policy 0, policy_version 1210138 (0.0010) [2023-12-26 09:15:12,426][123091] Updated weights for policy 0, policy_version 1210148 (0.0008) [2023-12-26 09:15:12,486][123091] Updated weights for policy 0, policy_version 1210158 (0.0010) [2023-12-26 09:15:12,549][123090] Updated weights for policy 1, policy_version 1201482 (0.0009) [2023-12-26 09:15:12,614][123090] Updated weights for policy 1, policy_version 1201492 (0.0010) [2023-12-26 09:15:12,683][123090] Updated weights for policy 1, policy_version 1201502 (0.0009) [2023-12-26 09:15:13,353][123091] Updated weights for policy 0, policy_version 1210168 (0.0010) [2023-12-26 09:15:13,418][123091] Updated weights for policy 0, policy_version 1210178 (0.0009) [2023-12-26 09:15:13,479][123091] Updated weights for policy 0, policy_version 1210188 (0.0010) [2023-12-26 09:15:13,518][123090] Updated weights for policy 1, policy_version 1201512 (0.0009) [2023-12-26 09:15:13,584][123090] Updated weights for policy 1, policy_version 1201522 (0.0009) [2023-12-26 09:15:13,651][123090] Updated weights for policy 1, policy_version 1201532 (0.0010) [2023-12-26 09:15:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 617406464. Throughput: 0: 8589.9, 1: 8869.3. Samples: 617396636. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:13,785][121949] Avg episode reward: [(0, '6172.516'), (1, '5205.530')] [2023-12-26 09:15:14,296][123091] Updated weights for policy 0, policy_version 1210198 (0.0008) [2023-12-26 09:15:14,359][123091] Updated weights for policy 0, policy_version 1210208 (0.0010) [2023-12-26 09:15:14,411][123091] Updated weights for policy 0, policy_version 1210218 (0.0009) [2023-12-26 09:15:14,502][123090] Updated weights for policy 1, policy_version 1201542 (0.0007) [2023-12-26 09:15:14,573][123090] Updated weights for policy 1, policy_version 1201552 (0.0009) [2023-12-26 09:15:14,632][123090] Updated weights for policy 1, policy_version 1201562 (0.0009) [2023-12-26 09:15:15,255][123091] Updated weights for policy 0, policy_version 1210228 (0.0008) [2023-12-26 09:15:15,311][123091] Updated weights for policy 0, policy_version 1210238 (0.0006) [2023-12-26 09:15:15,368][123091] Updated weights for policy 0, policy_version 1210248 (0.0010) [2023-12-26 09:15:15,472][123090] Updated weights for policy 1, policy_version 1201572 (0.0010) [2023-12-26 09:15:15,524][123090] Updated weights for policy 1, policy_version 1201582 (0.0009) [2023-12-26 09:15:15,590][123090] Updated weights for policy 1, policy_version 1201593 (0.0010) [2023-12-26 09:15:16,211][123091] Updated weights for policy 0, policy_version 1210258 (0.0010) [2023-12-26 09:15:16,264][123091] Updated weights for policy 0, policy_version 1210268 (0.0009) [2023-12-26 09:15:16,316][123091] Updated weights for policy 0, policy_version 1210278 (0.0010) [2023-12-26 09:15:16,372][123091] Updated weights for policy 0, policy_version 1210288 (0.0010) [2023-12-26 09:15:16,403][123090] Updated weights for policy 1, policy_version 1201603 (0.0008) [2023-12-26 09:15:16,457][123090] Updated weights for policy 1, policy_version 1201613 (0.0005) [2023-12-26 09:15:16,507][123090] Updated weights for policy 1, policy_version 1201623 (0.0005) [2023-12-26 09:15:17,228][123091] Updated weights for policy 0, policy_version 1210298 (0.0009) [2023-12-26 09:15:17,288][123091] Updated weights for policy 0, policy_version 1210308 (0.0010) [2023-12-26 09:15:17,336][123090] Updated weights for policy 1, policy_version 1201633 (0.0008) [2023-12-26 09:15:17,343][123091] Updated weights for policy 0, policy_version 1210318 (0.0009) [2023-12-26 09:15:17,407][123090] Updated weights for policy 1, policy_version 1201643 (0.0010) [2023-12-26 09:15:17,476][123090] Updated weights for policy 1, policy_version 1201653 (0.0009) [2023-12-26 09:15:17,532][123090] Updated weights for policy 1, policy_version 1201663 (0.0010) [2023-12-26 09:15:18,186][123091] Updated weights for policy 0, policy_version 1210328 (0.0009) [2023-12-26 09:15:18,247][123091] Updated weights for policy 0, policy_version 1210338 (0.0010) [2023-12-26 09:15:18,314][123091] Updated weights for policy 0, policy_version 1210348 (0.0010) [2023-12-26 09:15:18,376][123090] Updated weights for policy 1, policy_version 1201673 (0.0007) [2023-12-26 09:15:18,443][123090] Updated weights for policy 1, policy_version 1201683 (0.0008) [2023-12-26 09:15:18,501][123090] Updated weights for policy 1, policy_version 1201693 (0.0008) [2023-12-26 09:15:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 617488384. Throughput: 0: 8540.0, 1: 8802.9. Samples: 617498316. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:18,785][121949] Avg episode reward: [(0, '6131.444'), (1, '5232.298')] [2023-12-26 09:15:19,108][123091] Updated weights for policy 0, policy_version 1210358 (0.0009) [2023-12-26 09:15:19,162][123091] Updated weights for policy 0, policy_version 1210368 (0.0008) [2023-12-26 09:15:19,225][123090] Updated weights for policy 1, policy_version 1201703 (0.0008) [2023-12-26 09:15:19,229][123091] Updated weights for policy 0, policy_version 1210378 (0.0008) [2023-12-26 09:15:19,297][123090] Updated weights for policy 1, policy_version 1201713 (0.0009) [2023-12-26 09:15:19,368][123090] Updated weights for policy 1, policy_version 1201723 (0.0009) [2023-12-26 09:15:20,015][123091] Updated weights for policy 0, policy_version 1210388 (0.0009) [2023-12-26 09:15:20,079][123091] Updated weights for policy 0, policy_version 1210398 (0.0006) [2023-12-26 09:15:20,141][123091] Updated weights for policy 0, policy_version 1210408 (0.0007) [2023-12-26 09:15:20,319][123090] Updated weights for policy 1, policy_version 1201733 (0.0009) [2023-12-26 09:15:20,388][123090] Updated weights for policy 1, policy_version 1201743 (0.0008) [2023-12-26 09:15:20,453][123090] Updated weights for policy 1, policy_version 1201753 (0.0008) [2023-12-26 09:15:20,953][123091] Updated weights for policy 0, policy_version 1210418 (0.0007) [2023-12-26 09:15:21,020][123091] Updated weights for policy 0, policy_version 1210428 (0.0009) [2023-12-26 09:15:21,100][123091] Updated weights for policy 0, policy_version 1210438 (0.0009) [2023-12-26 09:15:21,180][123091] Updated weights for policy 0, policy_version 1210448 (0.0010) [2023-12-26 09:15:21,348][123090] Updated weights for policy 1, policy_version 1201763 (0.0008) [2023-12-26 09:15:21,433][123090] Updated weights for policy 1, policy_version 1201773 (0.0008) [2023-12-26 09:15:21,509][123090] Updated weights for policy 1, policy_version 1201783 (0.0007) [2023-12-26 09:15:22,127][123091] Updated weights for policy 0, policy_version 1210458 (0.0009) [2023-12-26 09:15:22,194][123091] Updated weights for policy 0, policy_version 1210468 (0.0010) [2023-12-26 09:15:22,262][123091] Updated weights for policy 0, policy_version 1210478 (0.0010) [2023-12-26 09:15:22,343][123090] Updated weights for policy 1, policy_version 1201793 (0.0008) [2023-12-26 09:15:22,414][123090] Updated weights for policy 1, policy_version 1201803 (0.0010) [2023-12-26 09:15:22,469][123090] Updated weights for policy 1, policy_version 1201813 (0.0009) [2023-12-26 09:15:22,540][123090] Updated weights for policy 1, policy_version 1201824 (0.0009) [2023-12-26 09:15:23,095][123091] Updated weights for policy 0, policy_version 1210488 (0.0010) [2023-12-26 09:15:23,157][123091] Updated weights for policy 0, policy_version 1210498 (0.0009) [2023-12-26 09:15:23,214][123091] Updated weights for policy 0, policy_version 1210508 (0.0009) [2023-12-26 09:15:23,382][123090] Updated weights for policy 1, policy_version 1201834 (0.0006) [2023-12-26 09:15:23,441][123090] Updated weights for policy 1, policy_version 1201844 (0.0005) [2023-12-26 09:15:23,494][123090] Updated weights for policy 1, policy_version 1201854 (0.0007) [2023-12-26 09:15:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 617570304. Throughput: 0: 8515.6, 1: 8770.3. Samples: 617548204. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:23,785][121949] Avg episode reward: [(0, '6245.645'), (1, '5201.974')] [2023-12-26 09:15:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001210512_309895168.pth... [2023-12-26 09:15:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001201856_307675136.pth... [2023-12-26 09:15:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001200832_307412992.pth [2023-12-26 09:15:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001209520_309641216.pth [2023-12-26 09:15:24,107][123091] Updated weights for policy 0, policy_version 1210518 (0.0009) [2023-12-26 09:15:24,161][123091] Updated weights for policy 0, policy_version 1210528 (0.0010) [2023-12-26 09:15:24,226][123091] Updated weights for policy 0, policy_version 1210538 (0.0008) [2023-12-26 09:15:24,230][123090] Updated weights for policy 1, policy_version 1201864 (0.0008) [2023-12-26 09:15:24,291][123090] Updated weights for policy 1, policy_version 1201874 (0.0010) [2023-12-26 09:15:24,344][123090] Updated weights for policy 1, policy_version 1201884 (0.0010) [2023-12-26 09:15:25,098][123091] Updated weights for policy 0, policy_version 1210548 (0.0010) [2023-12-26 09:15:25,150][123091] Updated weights for policy 0, policy_version 1210558 (0.0009) [2023-12-26 09:15:25,189][123090] Updated weights for policy 1, policy_version 1201894 (0.0008) [2023-12-26 09:15:25,215][123091] Updated weights for policy 0, policy_version 1210568 (0.0008) [2023-12-26 09:15:25,264][123090] Updated weights for policy 1, policy_version 1201904 (0.0010) [2023-12-26 09:15:25,323][123090] Updated weights for policy 1, policy_version 1201914 (0.0010) [2023-12-26 09:15:26,062][123090] Updated weights for policy 1, policy_version 1201924 (0.0007) [2023-12-26 09:15:26,077][123091] Updated weights for policy 0, policy_version 1210578 (0.0009) [2023-12-26 09:15:26,122][123091] Updated weights for policy 0, policy_version 1210588 (0.0008) [2023-12-26 09:15:26,124][123090] Updated weights for policy 1, policy_version 1201934 (0.0007) [2023-12-26 09:15:26,172][123090] Updated weights for policy 1, policy_version 1201944 (0.0006) [2023-12-26 09:15:26,172][123091] Updated weights for policy 0, policy_version 1210598 (0.0008) [2023-12-26 09:15:26,228][123091] Updated weights for policy 0, policy_version 1210608 (0.0009) [2023-12-26 09:15:26,946][123090] Updated weights for policy 1, policy_version 1201954 (0.0008) [2023-12-26 09:15:26,994][123090] Updated weights for policy 1, policy_version 1201964 (0.0010) [2023-12-26 09:15:27,045][123090] Updated weights for policy 1, policy_version 1201974 (0.0010) [2023-12-26 09:15:27,074][123091] Updated weights for policy 0, policy_version 1210618 (0.0005) [2023-12-26 09:15:27,100][123090] Updated weights for policy 1, policy_version 1201984 (0.0010) [2023-12-26 09:15:27,135][123091] Updated weights for policy 0, policy_version 1210628 (0.0010) [2023-12-26 09:15:27,201][123091] Updated weights for policy 0, policy_version 1210638 (0.0009) [2023-12-26 09:15:27,846][123090] Updated weights for policy 1, policy_version 1201994 (0.0005) [2023-12-26 09:15:27,916][123090] Updated weights for policy 1, policy_version 1202004 (0.0005) [2023-12-26 09:15:27,990][123090] Updated weights for policy 1, policy_version 1202014 (0.0006) [2023-12-26 09:15:27,999][123091] Updated weights for policy 0, policy_version 1210648 (0.0011) [2023-12-26 09:15:28,055][123091] Updated weights for policy 0, policy_version 1210658 (0.0011) [2023-12-26 09:15:28,106][123091] Updated weights for policy 0, policy_version 1210668 (0.0010) [2023-12-26 09:15:28,754][123090] Updated weights for policy 1, policy_version 1202024 (0.0006) [2023-12-26 09:15:28,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17203.3, 300 sec: 17605.9). Total num frames: 617652224. Throughput: 0: 8518.7, 1: 8800.6. Samples: 617651164. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:28,784][121949] Avg episode reward: [(0, '6250.746'), (1, '5120.468')] [2023-12-26 09:15:28,822][123090] Updated weights for policy 1, policy_version 1202034 (0.0006) [2023-12-26 09:15:28,866][123091] Updated weights for policy 0, policy_version 1210678 (0.0010) [2023-12-26 09:15:28,891][123090] Updated weights for policy 1, policy_version 1202044 (0.0006) [2023-12-26 09:15:28,923][123091] Updated weights for policy 0, policy_version 1210688 (0.0007) [2023-12-26 09:15:28,981][123091] Updated weights for policy 0, policy_version 1210698 (0.0005) [2023-12-26 09:15:29,582][123090] Updated weights for policy 1, policy_version 1202054 (0.0006) [2023-12-26 09:15:29,643][123090] Updated weights for policy 1, policy_version 1202064 (0.0005) [2023-12-26 09:15:29,702][123090] Updated weights for policy 1, policy_version 1202074 (0.0006) [2023-12-26 09:15:29,709][123091] Updated weights for policy 0, policy_version 1210708 (0.0005) [2023-12-26 09:15:29,767][123091] Updated weights for policy 0, policy_version 1210718 (0.0005) [2023-12-26 09:15:29,831][123091] Updated weights for policy 0, policy_version 1210728 (0.0006) [2023-12-26 09:15:30,385][123090] Updated weights for policy 1, policy_version 1202084 (0.0006) [2023-12-26 09:15:30,440][123090] Updated weights for policy 1, policy_version 1202094 (0.0005) [2023-12-26 09:15:30,441][123091] Updated weights for policy 0, policy_version 1210738 (0.0006) [2023-12-26 09:15:30,490][123090] Updated weights for policy 1, policy_version 1202104 (0.0005) [2023-12-26 09:15:30,507][123091] Updated weights for policy 0, policy_version 1210748 (0.0005) [2023-12-26 09:15:30,580][123091] Updated weights for policy 0, policy_version 1210758 (0.0005) [2023-12-26 09:15:30,657][123091] Updated weights for policy 0, policy_version 1210768 (0.0005) [2023-12-26 09:15:31,258][123090] Updated weights for policy 1, policy_version 1202114 (0.0006) [2023-12-26 09:15:31,326][123090] Updated weights for policy 1, policy_version 1202124 (0.0008) [2023-12-26 09:15:31,329][123091] Updated weights for policy 0, policy_version 1210778 (0.0010) [2023-12-26 09:15:31,390][123090] Updated weights for policy 1, policy_version 1202134 (0.0009) [2023-12-26 09:15:31,396][123091] Updated weights for policy 0, policy_version 1210788 (0.0008) [2023-12-26 09:15:31,455][123090] Updated weights for policy 1, policy_version 1202144 (0.0008) [2023-12-26 09:15:31,465][123091] Updated weights for policy 0, policy_version 1210798 (0.0008) [2023-12-26 09:15:32,291][123090] Updated weights for policy 1, policy_version 1202154 (0.0009) [2023-12-26 09:15:32,301][123091] Updated weights for policy 0, policy_version 1210808 (0.0011) [2023-12-26 09:15:32,354][123090] Updated weights for policy 1, policy_version 1202164 (0.0006) [2023-12-26 09:15:32,357][123091] Updated weights for policy 0, policy_version 1210818 (0.0010) [2023-12-26 09:15:32,416][123091] Updated weights for policy 0, policy_version 1210828 (0.0011) [2023-12-26 09:15:32,422][123090] Updated weights for policy 1, policy_version 1202174 (0.0007) [2023-12-26 09:15:33,238][123091] Updated weights for policy 0, policy_version 1210838 (0.0010) [2023-12-26 09:15:33,262][123090] Updated weights for policy 1, policy_version 1202184 (0.0006) [2023-12-26 09:15:33,282][123091] Updated weights for policy 0, policy_version 1210848 (0.0010) [2023-12-26 09:15:33,323][123090] Updated weights for policy 1, policy_version 1202194 (0.0008) [2023-12-26 09:15:33,330][123091] Updated weights for policy 0, policy_version 1210858 (0.0010) [2023-12-26 09:15:33,382][123090] Updated weights for policy 1, policy_version 1202204 (0.0009) [2023-12-26 09:15:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 617750528. Throughput: 0: 8614.4, 1: 8872.6. Samples: 617761152. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:33,785][121949] Avg episode reward: [(0, '6192.734'), (1, '5358.471')] [2023-12-26 09:15:34,157][123091] Updated weights for policy 0, policy_version 1210868 (0.0009) [2023-12-26 09:15:34,190][123090] Updated weights for policy 1, policy_version 1202214 (0.0008) [2023-12-26 09:15:34,216][123091] Updated weights for policy 0, policy_version 1210878 (0.0011) [2023-12-26 09:15:34,253][123090] Updated weights for policy 1, policy_version 1202224 (0.0008) [2023-12-26 09:15:34,276][123091] Updated weights for policy 0, policy_version 1210888 (0.0011) [2023-12-26 09:15:34,321][123090] Updated weights for policy 1, policy_version 1202234 (0.0008) [2023-12-26 09:15:34,946][123090] Updated weights for policy 1, policy_version 1202244 (0.0007) [2023-12-26 09:15:34,995][123090] Updated weights for policy 1, policy_version 1202254 (0.0005) [2023-12-26 09:15:35,062][123091] Updated weights for policy 0, policy_version 1210898 (0.0011) [2023-12-26 09:15:35,062][123090] Updated weights for policy 1, policy_version 1202264 (0.0006) [2023-12-26 09:15:35,109][123091] Updated weights for policy 0, policy_version 1210908 (0.0010) [2023-12-26 09:15:35,172][123091] Updated weights for policy 0, policy_version 1210918 (0.0010) [2023-12-26 09:15:35,223][123091] Updated weights for policy 0, policy_version 1210928 (0.0010) [2023-12-26 09:15:35,670][123090] Updated weights for policy 1, policy_version 1202274 (0.0009) [2023-12-26 09:15:35,728][123090] Updated weights for policy 1, policy_version 1202284 (0.0005) [2023-12-26 09:15:35,803][123090] Updated weights for policy 1, policy_version 1202294 (0.0005) [2023-12-26 09:15:35,864][123090] Updated weights for policy 1, policy_version 1202304 (0.0008) [2023-12-26 09:15:35,914][123091] Updated weights for policy 0, policy_version 1210938 (0.0005) [2023-12-26 09:15:35,978][123091] Updated weights for policy 0, policy_version 1210948 (0.0005) [2023-12-26 09:15:36,037][123091] Updated weights for policy 0, policy_version 1210958 (0.0005) [2023-12-26 09:15:36,577][123090] Updated weights for policy 1, policy_version 1202314 (0.0011) [2023-12-26 09:15:36,649][123090] Updated weights for policy 1, policy_version 1202324 (0.0011) [2023-12-26 09:15:36,709][123090] Updated weights for policy 1, policy_version 1202334 (0.0008) [2023-12-26 09:15:36,888][123091] Updated weights for policy 0, policy_version 1210968 (0.0007) [2023-12-26 09:15:36,957][123091] Updated weights for policy 0, policy_version 1210978 (0.0005) [2023-12-26 09:15:37,022][123091] Updated weights for policy 0, policy_version 1210988 (0.0006) [2023-12-26 09:15:37,512][123090] Updated weights for policy 1, policy_version 1202344 (0.0010) [2023-12-26 09:15:37,573][123090] Updated weights for policy 1, policy_version 1202355 (0.0009) [2023-12-26 09:15:37,650][123090] Updated weights for policy 1, policy_version 1202365 (0.0005) [2023-12-26 09:15:37,801][123091] Updated weights for policy 0, policy_version 1210998 (0.0007) [2023-12-26 09:15:37,857][123091] Updated weights for policy 0, policy_version 1211008 (0.0005) [2023-12-26 09:15:37,912][123091] Updated weights for policy 0, policy_version 1211018 (0.0005) [2023-12-26 09:15:38,380][123090] Updated weights for policy 1, policy_version 1202375 (0.0008) [2023-12-26 09:15:38,440][123090] Updated weights for policy 1, policy_version 1202385 (0.0010) [2023-12-26 09:15:38,506][123090] Updated weights for policy 1, policy_version 1202395 (0.0010) [2023-12-26 09:15:38,650][123091] Updated weights for policy 0, policy_version 1211028 (0.0007) [2023-12-26 09:15:38,713][123091] Updated weights for policy 0, policy_version 1211038 (0.0011) [2023-12-26 09:15:38,777][123091] Updated weights for policy 0, policy_version 1211048 (0.0011) [2023-12-26 09:15:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 617840640. Throughput: 0: 8664.3, 1: 8967.6. Samples: 617818096. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:38,785][121949] Avg episode reward: [(0, '6243.695'), (1, '5485.964')] [2023-12-26 09:15:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001202400_307814400.pth... [2023-12-26 09:15:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001201376_307552256.pth [2023-12-26 09:15:38,827][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001211056_310034432.pth... [2023-12-26 09:15:38,831][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001210032_309772288.pth [2023-12-26 09:15:39,254][123090] Updated weights for policy 1, policy_version 1202405 (0.0009) [2023-12-26 09:15:39,321][123090] Updated weights for policy 1, policy_version 1202415 (0.0007) [2023-12-26 09:15:39,393][123090] Updated weights for policy 1, policy_version 1202425 (0.0010) [2023-12-26 09:15:39,590][123091] Updated weights for policy 0, policy_version 1211058 (0.0011) [2023-12-26 09:15:39,653][123091] Updated weights for policy 0, policy_version 1211068 (0.0010) [2023-12-26 09:15:39,715][123091] Updated weights for policy 0, policy_version 1211079 (0.0011) [2023-12-26 09:15:40,205][123090] Updated weights for policy 1, policy_version 1202435 (0.0009) [2023-12-26 09:15:40,257][123090] Updated weights for policy 1, policy_version 1202445 (0.0010) [2023-12-26 09:15:40,316][123090] Updated weights for policy 1, policy_version 1202455 (0.0010) [2023-12-26 09:15:40,372][123091] Updated weights for policy 0, policy_version 1211089 (0.0010) [2023-12-26 09:15:40,444][123091] Updated weights for policy 0, policy_version 1211099 (0.0006) [2023-12-26 09:15:40,515][123091] Updated weights for policy 0, policy_version 1211109 (0.0009) [2023-12-26 09:15:40,586][123091] Updated weights for policy 0, policy_version 1211119 (0.0010) [2023-12-26 09:15:41,120][123090] Updated weights for policy 1, policy_version 1202465 (0.0011) [2023-12-26 09:15:41,187][123090] Updated weights for policy 1, policy_version 1202475 (0.0011) [2023-12-26 09:15:41,262][123090] Updated weights for policy 1, policy_version 1202485 (0.0011) [2023-12-26 09:15:41,322][123090] Updated weights for policy 1, policy_version 1202495 (0.0010) [2023-12-26 09:15:41,410][123091] Updated weights for policy 0, policy_version 1211129 (0.0010) [2023-12-26 09:15:41,468][123091] Updated weights for policy 0, policy_version 1211139 (0.0011) [2023-12-26 09:15:41,525][123091] Updated weights for policy 0, policy_version 1211149 (0.0011) [2023-12-26 09:15:42,108][123090] Updated weights for policy 1, policy_version 1202505 (0.0010) [2023-12-26 09:15:42,163][123090] Updated weights for policy 1, policy_version 1202515 (0.0010) [2023-12-26 09:15:42,224][123090] Updated weights for policy 1, policy_version 1202525 (0.0007) [2023-12-26 09:15:42,337][123091] Updated weights for policy 0, policy_version 1211159 (0.0010) [2023-12-26 09:15:42,412][123091] Updated weights for policy 0, policy_version 1211169 (0.0009) [2023-12-26 09:15:42,475][123091] Updated weights for policy 0, policy_version 1211179 (0.0010) [2023-12-26 09:15:43,047][123090] Updated weights for policy 1, policy_version 1202535 (0.0007) [2023-12-26 09:15:43,119][123090] Updated weights for policy 1, policy_version 1202545 (0.0006) [2023-12-26 09:15:43,181][123090] Updated weights for policy 1, policy_version 1202555 (0.0006) [2023-12-26 09:15:43,406][123091] Updated weights for policy 0, policy_version 1211189 (0.0009) [2023-12-26 09:15:43,459][123091] Updated weights for policy 0, policy_version 1211199 (0.0009) [2023-12-26 09:15:43,516][123091] Updated weights for policy 0, policy_version 1211209 (0.0009) [2023-12-26 09:15:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 617930752. Throughput: 0: 8664.3, 1: 8875.1. Samples: 617924416. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:43,784][121949] Avg episode reward: [(0, '6289.638'), (1, '5370.214')] [2023-12-26 09:15:43,972][123090] Updated weights for policy 1, policy_version 1202565 (0.0009) [2023-12-26 09:15:44,038][123090] Updated weights for policy 1, policy_version 1202575 (0.0008) [2023-12-26 09:15:44,098][123090] Updated weights for policy 1, policy_version 1202585 (0.0010) [2023-12-26 09:15:44,397][123091] Updated weights for policy 0, policy_version 1211219 (0.0009) [2023-12-26 09:15:44,444][123091] Updated weights for policy 0, policy_version 1211229 (0.0010) [2023-12-26 09:15:44,496][123091] Updated weights for policy 0, policy_version 1211239 (0.0011) [2023-12-26 09:15:44,940][123090] Updated weights for policy 1, policy_version 1202595 (0.0010) [2023-12-26 09:15:44,995][123090] Updated weights for policy 1, policy_version 1202605 (0.0009) [2023-12-26 09:15:45,061][123090] Updated weights for policy 1, policy_version 1202615 (0.0009) [2023-12-26 09:15:45,356][123091] Updated weights for policy 0, policy_version 1211249 (0.0011) [2023-12-26 09:15:45,416][123091] Updated weights for policy 0, policy_version 1211259 (0.0011) [2023-12-26 09:15:45,479][123091] Updated weights for policy 0, policy_version 1211269 (0.0011) [2023-12-26 09:15:45,546][123091] Updated weights for policy 0, policy_version 1211279 (0.0011) [2023-12-26 09:15:45,903][123090] Updated weights for policy 1, policy_version 1202625 (0.0008) [2023-12-26 09:15:45,959][123090] Updated weights for policy 1, policy_version 1202635 (0.0005) [2023-12-26 09:15:46,008][123090] Updated weights for policy 1, policy_version 1202645 (0.0005) [2023-12-26 09:15:46,058][123090] Updated weights for policy 1, policy_version 1202655 (0.0007) [2023-12-26 09:15:46,252][123091] Updated weights for policy 0, policy_version 1211289 (0.0006) [2023-12-26 09:15:46,305][123091] Updated weights for policy 0, policy_version 1211299 (0.0008) [2023-12-26 09:15:46,360][123091] Updated weights for policy 0, policy_version 1211309 (0.0010) [2023-12-26 09:15:46,905][123090] Updated weights for policy 1, policy_version 1202665 (0.0009) [2023-12-26 09:15:46,967][123090] Updated weights for policy 1, policy_version 1202675 (0.0010) [2023-12-26 09:15:47,019][123090] Updated weights for policy 1, policy_version 1202685 (0.0009) [2023-12-26 09:15:47,059][123091] Updated weights for policy 0, policy_version 1211319 (0.0007) [2023-12-26 09:15:47,129][123091] Updated weights for policy 0, policy_version 1211329 (0.0005) [2023-12-26 09:15:47,197][123091] Updated weights for policy 0, policy_version 1211339 (0.0009) [2023-12-26 09:15:47,831][123091] Updated weights for policy 0, policy_version 1211349 (0.0008) [2023-12-26 09:15:47,880][123090] Updated weights for policy 1, policy_version 1202695 (0.0009) [2023-12-26 09:15:47,882][123091] Updated weights for policy 0, policy_version 1211359 (0.0006) [2023-12-26 09:15:47,933][123091] Updated weights for policy 0, policy_version 1211369 (0.0006) [2023-12-26 09:15:47,952][123090] Updated weights for policy 1, policy_version 1202705 (0.0009) [2023-12-26 09:15:48,019][123090] Updated weights for policy 1, policy_version 1202715 (0.0010) [2023-12-26 09:15:48,685][123091] Updated weights for policy 0, policy_version 1211379 (0.0006) [2023-12-26 09:15:48,748][123091] Updated weights for policy 0, policy_version 1211389 (0.0008) [2023-12-26 09:15:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 618012672. Throughput: 0: 8715.7, 1: 8782.4. Samples: 618029908. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:48,785][121949] Avg episode reward: [(0, '6243.680'), (1, '5349.131')] [2023-12-26 09:15:48,815][123091] Updated weights for policy 0, policy_version 1211399 (0.0008) [2023-12-26 09:15:48,875][123090] Updated weights for policy 1, policy_version 1202725 (0.0008) [2023-12-26 09:15:48,942][123090] Updated weights for policy 1, policy_version 1202735 (0.0010) [2023-12-26 09:15:48,995][123090] Updated weights for policy 1, policy_version 1202745 (0.0009) [2023-12-26 09:15:49,538][123091] Updated weights for policy 0, policy_version 1211409 (0.0006) [2023-12-26 09:15:49,592][123091] Updated weights for policy 0, policy_version 1211419 (0.0009) [2023-12-26 09:15:49,643][123091] Updated weights for policy 0, policy_version 1211429 (0.0010) [2023-12-26 09:15:49,696][123091] Updated weights for policy 0, policy_version 1211439 (0.0009) [2023-12-26 09:15:49,807][123090] Updated weights for policy 1, policy_version 1202755 (0.0009) [2023-12-26 09:15:49,875][123090] Updated weights for policy 1, policy_version 1202765 (0.0007) [2023-12-26 09:15:49,947][123090] Updated weights for policy 1, policy_version 1202775 (0.0008) [2023-12-26 09:15:50,557][123091] Updated weights for policy 0, policy_version 1211449 (0.0006) [2023-12-26 09:15:50,629][123091] Updated weights for policy 0, policy_version 1211459 (0.0009) [2023-12-26 09:15:50,668][123090] Updated weights for policy 1, policy_version 1202785 (0.0009) [2023-12-26 09:15:50,685][123091] Updated weights for policy 0, policy_version 1211469 (0.0010) [2023-12-26 09:15:50,739][123090] Updated weights for policy 1, policy_version 1202795 (0.0005) [2023-12-26 09:15:50,802][123090] Updated weights for policy 1, policy_version 1202805 (0.0008) [2023-12-26 09:15:50,867][123090] Updated weights for policy 1, policy_version 1202815 (0.0008) [2023-12-26 09:15:51,525][123091] Updated weights for policy 0, policy_version 1211479 (0.0010) [2023-12-26 09:15:51,583][123091] Updated weights for policy 0, policy_version 1211489 (0.0009) [2023-12-26 09:15:51,600][123090] Updated weights for policy 1, policy_version 1202825 (0.0007) [2023-12-26 09:15:51,651][123091] Updated weights for policy 0, policy_version 1211499 (0.0008) [2023-12-26 09:15:51,671][123090] Updated weights for policy 1, policy_version 1202835 (0.0008) [2023-12-26 09:15:51,743][123090] Updated weights for policy 1, policy_version 1202845 (0.0008) [2023-12-26 09:15:52,504][123091] Updated weights for policy 0, policy_version 1211509 (0.0008) [2023-12-26 09:15:52,520][123090] Updated weights for policy 1, policy_version 1202855 (0.0006) [2023-12-26 09:15:52,556][123091] Updated weights for policy 0, policy_version 1211519 (0.0008) [2023-12-26 09:15:52,579][123090] Updated weights for policy 1, policy_version 1202865 (0.0007) [2023-12-26 09:15:52,621][123091] Updated weights for policy 0, policy_version 1211529 (0.0007) [2023-12-26 09:15:52,641][123090] Updated weights for policy 1, policy_version 1202875 (0.0008) [2023-12-26 09:15:53,429][123090] Updated weights for policy 1, policy_version 1202885 (0.0008) [2023-12-26 09:15:53,467][123091] Updated weights for policy 0, policy_version 1211539 (0.0008) [2023-12-26 09:15:53,487][123090] Updated weights for policy 1, policy_version 1202895 (0.0008) [2023-12-26 09:15:53,529][123091] Updated weights for policy 0, policy_version 1211549 (0.0009) [2023-12-26 09:15:53,542][123090] Updated weights for policy 1, policy_version 1202905 (0.0007) [2023-12-26 09:15:53,590][123091] Updated weights for policy 0, policy_version 1211559 (0.0008) [2023-12-26 09:15:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.5). Total num frames: 618110976. Throughput: 0: 8698.5, 1: 8828.9. Samples: 618083048. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:53,785][121949] Avg episode reward: [(0, '6279.770'), (1, '5387.129')] [2023-12-26 09:15:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001211568_310165504.pth... [2023-12-26 09:15:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001202912_307945472.pth... [2023-12-26 09:15:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001210512_309895168.pth [2023-12-26 09:15:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001201856_307675136.pth [2023-12-26 09:15:54,277][123090] Updated weights for policy 1, policy_version 1202915 (0.0008) [2023-12-26 09:15:54,345][123090] Updated weights for policy 1, policy_version 1202925 (0.0007) [2023-12-26 09:15:54,412][123090] Updated weights for policy 1, policy_version 1202935 (0.0008) [2023-12-26 09:15:54,479][123091] Updated weights for policy 0, policy_version 1211569 (0.0010) [2023-12-26 09:15:54,530][123091] Updated weights for policy 0, policy_version 1211579 (0.0009) [2023-12-26 09:15:54,585][123091] Updated weights for policy 0, policy_version 1211589 (0.0009) [2023-12-26 09:15:54,645][123091] Updated weights for policy 0, policy_version 1211600 (0.0011) [2023-12-26 09:15:55,130][123090] Updated weights for policy 1, policy_version 1202945 (0.0008) [2023-12-26 09:15:55,198][123090] Updated weights for policy 1, policy_version 1202955 (0.0006) [2023-12-26 09:15:55,269][123090] Updated weights for policy 1, policy_version 1202965 (0.0006) [2023-12-26 09:15:55,317][123090] Updated weights for policy 1, policy_version 1202975 (0.0010) [2023-12-26 09:15:55,553][123091] Updated weights for policy 0, policy_version 1211610 (0.0009) [2023-12-26 09:15:55,617][123091] Updated weights for policy 0, policy_version 1211620 (0.0008) [2023-12-26 09:15:55,664][123091] Updated weights for policy 0, policy_version 1211630 (0.0008) [2023-12-26 09:15:56,056][123090] Updated weights for policy 1, policy_version 1202985 (0.0010) [2023-12-26 09:15:56,119][123090] Updated weights for policy 1, policy_version 1202995 (0.0010) [2023-12-26 09:15:56,178][123090] Updated weights for policy 1, policy_version 1203005 (0.0010) [2023-12-26 09:15:56,541][123091] Updated weights for policy 0, policy_version 1211640 (0.0010) [2023-12-26 09:15:56,595][123091] Updated weights for policy 0, policy_version 1211650 (0.0010) [2023-12-26 09:15:56,653][123091] Updated weights for policy 0, policy_version 1211660 (0.0010) [2023-12-26 09:15:56,832][123090] Updated weights for policy 1, policy_version 1203015 (0.0010) [2023-12-26 09:15:56,884][123090] Updated weights for policy 1, policy_version 1203025 (0.0009) [2023-12-26 09:15:56,940][123090] Updated weights for policy 1, policy_version 1203035 (0.0009) [2023-12-26 09:15:57,518][123091] Updated weights for policy 0, policy_version 1211670 (0.0007) [2023-12-26 09:15:57,571][123091] Updated weights for policy 0, policy_version 1211680 (0.0005) [2023-12-26 09:15:57,632][123091] Updated weights for policy 0, policy_version 1211690 (0.0005) [2023-12-26 09:15:57,807][123090] Updated weights for policy 1, policy_version 1203045 (0.0007) [2023-12-26 09:15:57,871][123090] Updated weights for policy 1, policy_version 1203055 (0.0009) [2023-12-26 09:15:57,941][123090] Updated weights for policy 1, policy_version 1203065 (0.0010) [2023-12-26 09:15:58,293][123091] Updated weights for policy 0, policy_version 1211700 (0.0007) [2023-12-26 09:15:58,363][123091] Updated weights for policy 0, policy_version 1211710 (0.0009) [2023-12-26 09:15:58,436][123091] Updated weights for policy 0, policy_version 1211720 (0.0008) [2023-12-26 09:15:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 618192896. Throughput: 0: 8707.4, 1: 8883.0. Samples: 618188204. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:15:58,785][121949] Avg episode reward: [(0, '6248.391'), (1, '5529.359')] [2023-12-26 09:15:58,845][123090] Updated weights for policy 1, policy_version 1203075 (0.0010) [2023-12-26 09:15:58,907][123090] Updated weights for policy 1, policy_version 1203085 (0.0009) [2023-12-26 09:15:58,975][123090] Updated weights for policy 1, policy_version 1203095 (0.0006) [2023-12-26 09:15:59,279][123091] Updated weights for policy 0, policy_version 1211730 (0.0008) [2023-12-26 09:15:59,344][123091] Updated weights for policy 0, policy_version 1211740 (0.0010) [2023-12-26 09:15:59,404][123091] Updated weights for policy 0, policy_version 1211750 (0.0010) [2023-12-26 09:15:59,471][123091] Updated weights for policy 0, policy_version 1211760 (0.0005) [2023-12-26 09:15:59,786][123090] Updated weights for policy 1, policy_version 1203105 (0.0006) [2023-12-26 09:15:59,857][123090] Updated weights for policy 1, policy_version 1203115 (0.0009) [2023-12-26 09:15:59,920][123090] Updated weights for policy 1, policy_version 1203125 (0.0007) [2023-12-26 09:15:59,979][123090] Updated weights for policy 1, policy_version 1203135 (0.0006) [2023-12-26 09:16:00,277][123091] Updated weights for policy 0, policy_version 1211770 (0.0005) [2023-12-26 09:16:00,345][123091] Updated weights for policy 0, policy_version 1211780 (0.0006) [2023-12-26 09:16:00,415][123091] Updated weights for policy 0, policy_version 1211790 (0.0005) [2023-12-26 09:16:00,835][123090] Updated weights for policy 1, policy_version 1203145 (0.0008) [2023-12-26 09:16:00,894][123090] Updated weights for policy 1, policy_version 1203155 (0.0009) [2023-12-26 09:16:00,954][123090] Updated weights for policy 1, policy_version 1203165 (0.0010) [2023-12-26 09:16:01,107][123091] Updated weights for policy 0, policy_version 1211801 (0.0008) [2023-12-26 09:16:01,179][123091] Updated weights for policy 0, policy_version 1211811 (0.0010) [2023-12-26 09:16:01,246][123091] Updated weights for policy 0, policy_version 1211821 (0.0009) [2023-12-26 09:16:01,811][123090] Updated weights for policy 1, policy_version 1203175 (0.0009) [2023-12-26 09:16:01,876][123090] Updated weights for policy 1, policy_version 1203185 (0.0010) [2023-12-26 09:16:01,940][123090] Updated weights for policy 1, policy_version 1203195 (0.0010) [2023-12-26 09:16:01,999][123091] Updated weights for policy 0, policy_version 1211831 (0.0008) [2023-12-26 09:16:02,061][123091] Updated weights for policy 0, policy_version 1211841 (0.0008) [2023-12-26 09:16:02,122][123091] Updated weights for policy 0, policy_version 1211851 (0.0008) [2023-12-26 09:16:02,737][123090] Updated weights for policy 1, policy_version 1203205 (0.0008) [2023-12-26 09:16:02,800][123090] Updated weights for policy 1, policy_version 1203215 (0.0005) [2023-12-26 09:16:02,871][123090] Updated weights for policy 1, policy_version 1203225 (0.0007) [2023-12-26 09:16:02,960][123091] Updated weights for policy 0, policy_version 1211861 (0.0009) [2023-12-26 09:16:03,018][123091] Updated weights for policy 0, policy_version 1211871 (0.0010) [2023-12-26 09:16:03,077][123091] Updated weights for policy 0, policy_version 1211881 (0.0011) [2023-12-26 09:16:03,540][123090] Updated weights for policy 1, policy_version 1203235 (0.0009) [2023-12-26 09:16:03,594][123090] Updated weights for policy 1, policy_version 1203245 (0.0007) [2023-12-26 09:16:03,652][123090] Updated weights for policy 1, policy_version 1203255 (0.0005) [2023-12-26 09:16:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17661.4). Total num frames: 618283008. Throughput: 0: 8744.9, 1: 8895.1. Samples: 618292116. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:03,784][121949] Avg episode reward: [(0, '6109.201'), (1, '5764.121')] [2023-12-26 09:16:03,943][123091] Updated weights for policy 0, policy_version 1211891 (0.0009) [2023-12-26 09:16:04,010][123091] Updated weights for policy 0, policy_version 1211901 (0.0011) [2023-12-26 09:16:04,066][123091] Updated weights for policy 0, policy_version 1211911 (0.0011) [2023-12-26 09:16:04,442][123090] Updated weights for policy 1, policy_version 1203265 (0.0006) [2023-12-26 09:16:04,503][123090] Updated weights for policy 1, policy_version 1203275 (0.0010) [2023-12-26 09:16:04,565][123090] Updated weights for policy 1, policy_version 1203285 (0.0009) [2023-12-26 09:16:04,625][123090] Updated weights for policy 1, policy_version 1203295 (0.0009) [2023-12-26 09:16:04,908][123091] Updated weights for policy 0, policy_version 1211921 (0.0011) [2023-12-26 09:16:04,974][123091] Updated weights for policy 0, policy_version 1211931 (0.0009) [2023-12-26 09:16:05,037][123091] Updated weights for policy 0, policy_version 1211941 (0.0009) [2023-12-26 09:16:05,104][123091] Updated weights for policy 0, policy_version 1211951 (0.0010) [2023-12-26 09:16:05,411][123090] Updated weights for policy 1, policy_version 1203305 (0.0009) [2023-12-26 09:16:05,464][123090] Updated weights for policy 1, policy_version 1203315 (0.0009) [2023-12-26 09:16:05,520][123090] Updated weights for policy 1, policy_version 1203325 (0.0009) [2023-12-26 09:16:05,943][123091] Updated weights for policy 0, policy_version 1211961 (0.0008) [2023-12-26 09:16:05,999][123091] Updated weights for policy 0, policy_version 1211971 (0.0009) [2023-12-26 09:16:06,057][123091] Updated weights for policy 0, policy_version 1211981 (0.0009) [2023-12-26 09:16:06,234][123090] Updated weights for policy 1, policy_version 1203335 (0.0007) [2023-12-26 09:16:06,301][123090] Updated weights for policy 1, policy_version 1203345 (0.0006) [2023-12-26 09:16:06,355][123090] Updated weights for policy 1, policy_version 1203355 (0.0010) [2023-12-26 09:16:06,839][123091] Updated weights for policy 0, policy_version 1211991 (0.0009) [2023-12-26 09:16:06,897][123091] Updated weights for policy 0, policy_version 1212001 (0.0009) [2023-12-26 09:16:06,948][123091] Updated weights for policy 0, policy_version 1212011 (0.0010) [2023-12-26 09:16:07,134][123090] Updated weights for policy 1, policy_version 1203365 (0.0010) [2023-12-26 09:16:07,200][123090] Updated weights for policy 1, policy_version 1203375 (0.0009) [2023-12-26 09:16:07,263][123090] Updated weights for policy 1, policy_version 1203385 (0.0010) [2023-12-26 09:16:07,824][123091] Updated weights for policy 0, policy_version 1212021 (0.0010) [2023-12-26 09:16:07,874][123091] Updated weights for policy 0, policy_version 1212031 (0.0009) [2023-12-26 09:16:07,930][123091] Updated weights for policy 0, policy_version 1212041 (0.0005) [2023-12-26 09:16:08,066][123090] Updated weights for policy 1, policy_version 1203395 (0.0008) [2023-12-26 09:16:08,140][123090] Updated weights for policy 1, policy_version 1203405 (0.0005) [2023-12-26 09:16:08,201][123090] Updated weights for policy 1, policy_version 1203415 (0.0006) [2023-12-26 09:16:08,733][123091] Updated weights for policy 0, policy_version 1212051 (0.0009) [2023-12-26 09:16:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 618364928. Throughput: 0: 8753.6, 1: 8945.6. Samples: 618344668. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:08,785][121949] Avg episode reward: [(0, '6239.752'), (1, '5665.656')] [2023-12-26 09:16:08,789][123091] Updated weights for policy 0, policy_version 1212061 (0.0010) [2023-12-26 09:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001203424_308076544.pth... [2023-12-26 09:16:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001202400_307814400.pth [2023-12-26 09:16:08,861][123091] Updated weights for policy 0, policy_version 1212071 (0.0009) [2023-12-26 09:16:08,921][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001212080_310296576.pth... [2023-12-26 09:16:08,926][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001211056_310034432.pth [2023-12-26 09:16:08,938][123090] Updated weights for policy 1, policy_version 1203425 (0.0006) [2023-12-26 09:16:08,998][123090] Updated weights for policy 1, policy_version 1203435 (0.0010) [2023-12-26 09:16:09,057][123090] Updated weights for policy 1, policy_version 1203445 (0.0009) [2023-12-26 09:16:09,121][123090] Updated weights for policy 1, policy_version 1203455 (0.0009) [2023-12-26 09:16:09,676][123091] Updated weights for policy 0, policy_version 1212081 (0.0010) [2023-12-26 09:16:09,740][123091] Updated weights for policy 0, policy_version 1212091 (0.0005) [2023-12-26 09:16:09,809][123091] Updated weights for policy 0, policy_version 1212101 (0.0010) [2023-12-26 09:16:09,881][123091] Updated weights for policy 0, policy_version 1212111 (0.0008) [2023-12-26 09:16:09,961][123090] Updated weights for policy 1, policy_version 1203465 (0.0006) [2023-12-26 09:16:10,034][123090] Updated weights for policy 1, policy_version 1203475 (0.0009) [2023-12-26 09:16:10,104][123090] Updated weights for policy 1, policy_version 1203485 (0.0010) [2023-12-26 09:16:10,699][123091] Updated weights for policy 0, policy_version 1212121 (0.0009) [2023-12-26 09:16:10,751][123091] Updated weights for policy 0, policy_version 1212131 (0.0010) [2023-12-26 09:16:10,816][123091] Updated weights for policy 0, policy_version 1212141 (0.0009) [2023-12-26 09:16:10,824][123090] Updated weights for policy 1, policy_version 1203495 (0.0008) [2023-12-26 09:16:10,879][123090] Updated weights for policy 1, policy_version 1203505 (0.0008) [2023-12-26 09:16:10,931][123090] Updated weights for policy 1, policy_version 1203515 (0.0010) [2023-12-26 09:16:11,764][123091] Updated weights for policy 0, policy_version 1212151 (0.0009) [2023-12-26 09:16:11,811][123090] Updated weights for policy 1, policy_version 1203525 (0.0009) [2023-12-26 09:16:11,823][123091] Updated weights for policy 0, policy_version 1212161 (0.0009) [2023-12-26 09:16:11,878][123091] Updated weights for policy 0, policy_version 1212171 (0.0009) [2023-12-26 09:16:11,878][123090] Updated weights for policy 1, policy_version 1203535 (0.0009) [2023-12-26 09:16:11,940][123090] Updated weights for policy 1, policy_version 1203545 (0.0008) [2023-12-26 09:16:12,640][123091] Updated weights for policy 0, policy_version 1212181 (0.0007) [2023-12-26 09:16:12,709][123091] Updated weights for policy 0, policy_version 1212191 (0.0006) [2023-12-26 09:16:12,776][123091] Updated weights for policy 0, policy_version 1212201 (0.0008) [2023-12-26 09:16:12,838][123090] Updated weights for policy 1, policy_version 1203555 (0.0009) [2023-12-26 09:16:12,897][123090] Updated weights for policy 1, policy_version 1203565 (0.0008) [2023-12-26 09:16:12,963][123090] Updated weights for policy 1, policy_version 1203575 (0.0008) [2023-12-26 09:16:13,619][123091] Updated weights for policy 0, policy_version 1212211 (0.0011) [2023-12-26 09:16:13,678][123091] Updated weights for policy 0, policy_version 1212221 (0.0010) [2023-12-26 09:16:13,741][123091] Updated weights for policy 0, policy_version 1212231 (0.0011) [2023-12-26 09:16:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 618446848. Throughput: 0: 8787.5, 1: 8925.7. Samples: 618448256. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:13,784][121949] Avg episode reward: [(0, '6221.561'), (1, '5665.931')] [2023-12-26 09:16:13,844][123090] Updated weights for policy 1, policy_version 1203585 (0.0009) [2023-12-26 09:16:13,908][123090] Updated weights for policy 1, policy_version 1203595 (0.0009) [2023-12-26 09:16:13,972][123090] Updated weights for policy 1, policy_version 1203605 (0.0008) [2023-12-26 09:16:14,038][123090] Updated weights for policy 1, policy_version 1203615 (0.0009) [2023-12-26 09:16:14,561][123091] Updated weights for policy 0, policy_version 1212241 (0.0011) [2023-12-26 09:16:14,630][123091] Updated weights for policy 0, policy_version 1212251 (0.0011) [2023-12-26 09:16:14,692][123091] Updated weights for policy 0, policy_version 1212261 (0.0008) [2023-12-26 09:16:14,760][123091] Updated weights for policy 0, policy_version 1212271 (0.0007) [2023-12-26 09:16:14,889][123090] Updated weights for policy 1, policy_version 1203625 (0.0009) [2023-12-26 09:16:14,958][123090] Updated weights for policy 1, policy_version 1203635 (0.0007) [2023-12-26 09:16:15,034][123090] Updated weights for policy 1, policy_version 1203645 (0.0009) [2023-12-26 09:16:15,492][123091] Updated weights for policy 0, policy_version 1212281 (0.0010) [2023-12-26 09:16:15,555][123091] Updated weights for policy 0, policy_version 1212291 (0.0011) [2023-12-26 09:16:15,623][123091] Updated weights for policy 0, policy_version 1212301 (0.0008) [2023-12-26 09:16:15,847][123090] Updated weights for policy 1, policy_version 1203655 (0.0006) [2023-12-26 09:16:15,917][123090] Updated weights for policy 1, policy_version 1203665 (0.0008) [2023-12-26 09:16:15,986][123090] Updated weights for policy 1, policy_version 1203675 (0.0006) [2023-12-26 09:16:16,386][123091] Updated weights for policy 0, policy_version 1212311 (0.0007) [2023-12-26 09:16:16,451][123091] Updated weights for policy 0, policy_version 1212321 (0.0007) [2023-12-26 09:16:16,511][123091] Updated weights for policy 0, policy_version 1212331 (0.0011) [2023-12-26 09:16:16,767][123090] Updated weights for policy 1, policy_version 1203685 (0.0006) [2023-12-26 09:16:16,834][123090] Updated weights for policy 1, policy_version 1203695 (0.0009) [2023-12-26 09:16:16,897][123090] Updated weights for policy 1, policy_version 1203705 (0.0010) [2023-12-26 09:16:17,307][123091] Updated weights for policy 0, policy_version 1212341 (0.0010) [2023-12-26 09:16:17,358][123091] Updated weights for policy 0, policy_version 1212351 (0.0010) [2023-12-26 09:16:17,409][123091] Updated weights for policy 0, policy_version 1212361 (0.0010) [2023-12-26 09:16:17,666][123090] Updated weights for policy 1, policy_version 1203715 (0.0010) [2023-12-26 09:16:17,720][123090] Updated weights for policy 1, policy_version 1203725 (0.0010) [2023-12-26 09:16:17,776][123090] Updated weights for policy 1, policy_version 1203736 (0.0011) [2023-12-26 09:16:18,129][123091] Updated weights for policy 0, policy_version 1212371 (0.0010) [2023-12-26 09:16:18,191][123091] Updated weights for policy 0, policy_version 1212381 (0.0011) [2023-12-26 09:16:18,249][123091] Updated weights for policy 0, policy_version 1212391 (0.0010) [2023-12-26 09:16:18,696][123090] Updated weights for policy 1, policy_version 1203746 (0.0010) [2023-12-26 09:16:18,760][123090] Updated weights for policy 1, policy_version 1203756 (0.0009) [2023-12-26 09:16:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 618536960. Throughput: 0: 8769.9, 1: 8828.0. Samples: 618553056. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:18,785][121949] Avg episode reward: [(0, '6209.966'), (1, '5692.784')] [2023-12-26 09:16:18,819][123090] Updated weights for policy 1, policy_version 1203766 (0.0009) [2023-12-26 09:16:18,878][123090] Updated weights for policy 1, policy_version 1203776 (0.0009) [2023-12-26 09:16:19,030][123091] Updated weights for policy 0, policy_version 1212401 (0.0010) [2023-12-26 09:16:19,089][123091] Updated weights for policy 0, policy_version 1212411 (0.0009) [2023-12-26 09:16:19,138][123091] Updated weights for policy 0, policy_version 1212421 (0.0009) [2023-12-26 09:16:19,188][123091] Updated weights for policy 0, policy_version 1212431 (0.0009) [2023-12-26 09:16:19,704][123090] Updated weights for policy 1, policy_version 1203786 (0.0006) [2023-12-26 09:16:19,767][123090] Updated weights for policy 1, policy_version 1203796 (0.0005) [2023-12-26 09:16:19,834][123090] Updated weights for policy 1, policy_version 1203806 (0.0007) [2023-12-26 09:16:20,118][123091] Updated weights for policy 0, policy_version 1212441 (0.0010) [2023-12-26 09:16:20,176][123091] Updated weights for policy 0, policy_version 1212451 (0.0008) [2023-12-26 09:16:20,234][123091] Updated weights for policy 0, policy_version 1212461 (0.0007) [2023-12-26 09:16:20,532][123090] Updated weights for policy 1, policy_version 1203816 (0.0009) [2023-12-26 09:16:20,603][123090] Updated weights for policy 1, policy_version 1203826 (0.0009) [2023-12-26 09:16:20,681][123090] Updated weights for policy 1, policy_version 1203836 (0.0009) [2023-12-26 09:16:21,053][123091] Updated weights for policy 0, policy_version 1212471 (0.0010) [2023-12-26 09:16:21,114][123091] Updated weights for policy 0, policy_version 1212481 (0.0009) [2023-12-26 09:16:21,184][123091] Updated weights for policy 0, policy_version 1212491 (0.0009) [2023-12-26 09:16:21,504][123090] Updated weights for policy 1, policy_version 1203846 (0.0010) [2023-12-26 09:16:21,554][123090] Updated weights for policy 1, policy_version 1203856 (0.0009) [2023-12-26 09:16:21,604][123090] Updated weights for policy 1, policy_version 1203866 (0.0009) [2023-12-26 09:16:22,006][123091] Updated weights for policy 0, policy_version 1212501 (0.0010) [2023-12-26 09:16:22,075][123091] Updated weights for policy 0, policy_version 1212511 (0.0011) [2023-12-26 09:16:22,147][123091] Updated weights for policy 0, policy_version 1212521 (0.0011) [2023-12-26 09:16:22,537][123090] Updated weights for policy 1, policy_version 1203876 (0.0009) [2023-12-26 09:16:22,613][123090] Updated weights for policy 1, policy_version 1203886 (0.0010) [2023-12-26 09:16:22,677][123090] Updated weights for policy 1, policy_version 1203896 (0.0010) [2023-12-26 09:16:22,912][123091] Updated weights for policy 0, policy_version 1212531 (0.0009) [2023-12-26 09:16:22,982][123091] Updated weights for policy 0, policy_version 1212541 (0.0009) [2023-12-26 09:16:23,047][123091] Updated weights for policy 0, policy_version 1212551 (0.0010) [2023-12-26 09:16:23,554][123090] Updated weights for policy 1, policy_version 1203906 (0.0009) [2023-12-26 09:16:23,613][123090] Updated weights for policy 1, policy_version 1203916 (0.0009) [2023-12-26 09:16:23,665][123090] Updated weights for policy 1, policy_version 1203926 (0.0008) [2023-12-26 09:16:23,721][123090] Updated weights for policy 1, policy_version 1203936 (0.0009) [2023-12-26 09:16:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 618627072. Throughput: 0: 8705.2, 1: 8739.6. Samples: 618603108. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:23,785][121949] Avg episode reward: [(0, '6276.141'), (1, '5846.045')] [2023-12-26 09:16:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001203936_308207616.pth... [2023-12-26 09:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001212560_310419456.pth... [2023-12-26 09:16:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001202912_307945472.pth [2023-12-26 09:16:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001211568_310165504.pth [2023-12-26 09:16:23,852][123091] Updated weights for policy 0, policy_version 1212561 (0.0011) [2023-12-26 09:16:23,900][123091] Updated weights for policy 0, policy_version 1212571 (0.0010) [2023-12-26 09:16:23,958][123091] Updated weights for policy 0, policy_version 1212581 (0.0010) [2023-12-26 09:16:24,027][123091] Updated weights for policy 0, policy_version 1212591 (0.0010) [2023-12-26 09:16:24,593][123090] Updated weights for policy 1, policy_version 1203946 (0.0010) [2023-12-26 09:16:24,666][123090] Updated weights for policy 1, policy_version 1203956 (0.0010) [2023-12-26 09:16:24,719][123091] Updated weights for policy 0, policy_version 1212601 (0.0008) [2023-12-26 09:16:24,725][123090] Updated weights for policy 1, policy_version 1203966 (0.0010) [2023-12-26 09:16:24,773][123091] Updated weights for policy 0, policy_version 1212611 (0.0009) [2023-12-26 09:16:24,832][123091] Updated weights for policy 0, policy_version 1212621 (0.0009) [2023-12-26 09:16:25,487][123090] Updated weights for policy 1, policy_version 1203976 (0.0010) [2023-12-26 09:16:25,542][123090] Updated weights for policy 1, policy_version 1203986 (0.0005) [2023-12-26 09:16:25,608][123091] Updated weights for policy 0, policy_version 1212631 (0.0006) [2023-12-26 09:16:25,609][123090] Updated weights for policy 1, policy_version 1203996 (0.0008) [2023-12-26 09:16:25,659][123091] Updated weights for policy 0, policy_version 1212641 (0.0005) [2023-12-26 09:16:25,714][123091] Updated weights for policy 0, policy_version 1212651 (0.0009) [2023-12-26 09:16:26,368][123090] Updated weights for policy 1, policy_version 1204006 (0.0010) [2023-12-26 09:16:26,420][123090] Updated weights for policy 1, policy_version 1204016 (0.0009) [2023-12-26 09:16:26,471][123090] Updated weights for policy 1, policy_version 1204026 (0.0009) [2023-12-26 09:16:26,535][123091] Updated weights for policy 0, policy_version 1212661 (0.0009) [2023-12-26 09:16:26,588][123091] Updated weights for policy 0, policy_version 1212671 (0.0009) [2023-12-26 09:16:26,640][123091] Updated weights for policy 0, policy_version 1212681 (0.0009) [2023-12-26 09:16:27,323][123090] Updated weights for policy 1, policy_version 1204036 (0.0008) [2023-12-26 09:16:27,374][123090] Updated weights for policy 1, policy_version 1204046 (0.0009) [2023-12-26 09:16:27,420][123090] Updated weights for policy 1, policy_version 1204056 (0.0009) [2023-12-26 09:16:27,472][123091] Updated weights for policy 0, policy_version 1212691 (0.0009) [2023-12-26 09:16:27,524][123091] Updated weights for policy 0, policy_version 1212701 (0.0009) [2023-12-26 09:16:27,582][123091] Updated weights for policy 0, policy_version 1212711 (0.0009) [2023-12-26 09:16:28,308][123090] Updated weights for policy 1, policy_version 1204066 (0.0010) [2023-12-26 09:16:28,378][123091] Updated weights for policy 0, policy_version 1212722 (0.0008) [2023-12-26 09:16:28,379][123090] Updated weights for policy 1, policy_version 1204076 (0.0009) [2023-12-26 09:16:28,435][123090] Updated weights for policy 1, policy_version 1204086 (0.0008) [2023-12-26 09:16:28,436][123091] Updated weights for policy 0, policy_version 1212732 (0.0007) [2023-12-26 09:16:28,489][123091] Updated weights for policy 0, policy_version 1212742 (0.0009) [2023-12-26 09:16:28,501][123090] Updated weights for policy 1, policy_version 1204096 (0.0005) [2023-12-26 09:16:28,549][123091] Updated weights for policy 0, policy_version 1212752 (0.0010) [2023-12-26 09:16:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 618717184. Throughput: 0: 8717.0, 1: 8696.7. Samples: 618708036. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:28,785][121949] Avg episode reward: [(0, '6269.503'), (1, '5777.069')] [2023-12-26 09:16:29,324][123090] Updated weights for policy 1, policy_version 1204106 (0.0009) [2023-12-26 09:16:29,375][123091] Updated weights for policy 0, policy_version 1212762 (0.0008) [2023-12-26 09:16:29,395][123090] Updated weights for policy 1, policy_version 1204116 (0.0006) [2023-12-26 09:16:29,431][123091] Updated weights for policy 0, policy_version 1212772 (0.0008) [2023-12-26 09:16:29,456][123090] Updated weights for policy 1, policy_version 1204126 (0.0007) [2023-12-26 09:16:29,482][123091] Updated weights for policy 0, policy_version 1212782 (0.0010) [2023-12-26 09:16:30,210][123090] Updated weights for policy 1, policy_version 1204136 (0.0009) [2023-12-26 09:16:30,275][123090] Updated weights for policy 1, policy_version 1204146 (0.0008) [2023-12-26 09:16:30,289][123091] Updated weights for policy 0, policy_version 1212792 (0.0010) [2023-12-26 09:16:30,326][123090] Updated weights for policy 1, policy_version 1204156 (0.0009) [2023-12-26 09:16:30,356][123091] Updated weights for policy 0, policy_version 1212802 (0.0006) [2023-12-26 09:16:30,423][123091] Updated weights for policy 0, policy_version 1212812 (0.0005) [2023-12-26 09:16:30,942][123091] Updated weights for policy 0, policy_version 1212822 (0.0005) [2023-12-26 09:16:30,988][123091] Updated weights for policy 0, policy_version 1212832 (0.0005) [2023-12-26 09:16:31,058][123091] Updated weights for policy 0, policy_version 1212842 (0.0007) [2023-12-26 09:16:31,213][123090] Updated weights for policy 1, policy_version 1204166 (0.0008) [2023-12-26 09:16:31,282][123090] Updated weights for policy 1, policy_version 1204176 (0.0007) [2023-12-26 09:16:31,354][123090] Updated weights for policy 1, policy_version 1204186 (0.0008) [2023-12-26 09:16:31,862][123091] Updated weights for policy 0, policy_version 1212852 (0.0010) [2023-12-26 09:16:31,920][123091] Updated weights for policy 0, policy_version 1212862 (0.0009) [2023-12-26 09:16:31,992][123091] Updated weights for policy 0, policy_version 1212872 (0.0005) [2023-12-26 09:16:32,126][123090] Updated weights for policy 1, policy_version 1204196 (0.0007) [2023-12-26 09:16:32,197][123090] Updated weights for policy 1, policy_version 1204206 (0.0008) [2023-12-26 09:16:32,267][123090] Updated weights for policy 1, policy_version 1204216 (0.0009) [2023-12-26 09:16:32,752][123091] Updated weights for policy 0, policy_version 1212882 (0.0005) [2023-12-26 09:16:32,810][123091] Updated weights for policy 0, policy_version 1212892 (0.0007) [2023-12-26 09:16:32,869][123091] Updated weights for policy 0, policy_version 1212902 (0.0010) [2023-12-26 09:16:32,921][123091] Updated weights for policy 0, policy_version 1212912 (0.0009) [2023-12-26 09:16:33,119][123090] Updated weights for policy 1, policy_version 1204226 (0.0008) [2023-12-26 09:16:33,165][123090] Updated weights for policy 1, policy_version 1204236 (0.0005) [2023-12-26 09:16:33,220][123090] Updated weights for policy 1, policy_version 1204246 (0.0005) [2023-12-26 09:16:33,283][123090] Updated weights for policy 1, policy_version 1204256 (0.0005) [2023-12-26 09:16:33,594][123091] Updated weights for policy 0, policy_version 1212922 (0.0009) [2023-12-26 09:16:33,656][123091] Updated weights for policy 0, policy_version 1212932 (0.0006) [2023-12-26 09:16:33,718][123091] Updated weights for policy 0, policy_version 1212942 (0.0005) [2023-12-26 09:16:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 618807296. Throughput: 0: 8751.8, 1: 8721.0. Samples: 618816188. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:33,785][121949] Avg episode reward: [(0, '6297.358'), (1, '5770.502')] [2023-12-26 09:16:34,096][123090] Updated weights for policy 1, policy_version 1204266 (0.0009) [2023-12-26 09:16:34,163][123090] Updated weights for policy 1, policy_version 1204277 (0.0010) [2023-12-26 09:16:34,225][123090] Updated weights for policy 1, policy_version 1204287 (0.0010) [2023-12-26 09:16:34,418][123091] Updated weights for policy 0, policy_version 1212952 (0.0005) [2023-12-26 09:16:34,476][123091] Updated weights for policy 0, policy_version 1212962 (0.0007) [2023-12-26 09:16:34,528][123091] Updated weights for policy 0, policy_version 1212972 (0.0010) [2023-12-26 09:16:35,053][123090] Updated weights for policy 1, policy_version 1204297 (0.0006) [2023-12-26 09:16:35,112][123090] Updated weights for policy 1, policy_version 1204307 (0.0005) [2023-12-26 09:16:35,161][123090] Updated weights for policy 1, policy_version 1204317 (0.0005) [2023-12-26 09:16:35,237][123091] Updated weights for policy 0, policy_version 1212983 (0.0007) [2023-12-26 09:16:35,299][123091] Updated weights for policy 0, policy_version 1212993 (0.0005) [2023-12-26 09:16:35,372][123091] Updated weights for policy 0, policy_version 1213003 (0.0005) [2023-12-26 09:16:35,780][123090] Updated weights for policy 1, policy_version 1204327 (0.0005) [2023-12-26 09:16:35,826][123090] Updated weights for policy 1, policy_version 1204337 (0.0010) [2023-12-26 09:16:35,877][123090] Updated weights for policy 1, policy_version 1204347 (0.0010) [2023-12-26 09:16:36,003][123091] Updated weights for policy 0, policy_version 1213013 (0.0005) [2023-12-26 09:16:36,049][123091] Updated weights for policy 0, policy_version 1213023 (0.0005) [2023-12-26 09:16:36,105][123091] Updated weights for policy 0, policy_version 1213033 (0.0007) [2023-12-26 09:16:36,766][123090] Updated weights for policy 1, policy_version 1204357 (0.0010) [2023-12-26 09:16:36,816][123091] Updated weights for policy 0, policy_version 1213043 (0.0007) [2023-12-26 09:16:36,825][123090] Updated weights for policy 1, policy_version 1204367 (0.0010) [2023-12-26 09:16:36,866][123091] Updated weights for policy 0, policy_version 1213053 (0.0006) [2023-12-26 09:16:36,896][123090] Updated weights for policy 1, policy_version 1204377 (0.0011) [2023-12-26 09:16:36,917][123091] Updated weights for policy 0, policy_version 1213063 (0.0010) [2023-12-26 09:16:37,680][123091] Updated weights for policy 0, policy_version 1213073 (0.0010) [2023-12-26 09:16:37,729][123090] Updated weights for policy 1, policy_version 1204387 (0.0010) [2023-12-26 09:16:37,739][123091] Updated weights for policy 0, policy_version 1213083 (0.0006) [2023-12-26 09:16:37,780][123090] Updated weights for policy 1, policy_version 1204397 (0.0008) [2023-12-26 09:16:37,807][123091] Updated weights for policy 0, policy_version 1213093 (0.0007) [2023-12-26 09:16:37,846][123090] Updated weights for policy 1, policy_version 1204407 (0.0006) [2023-12-26 09:16:37,866][123091] Updated weights for policy 0, policy_version 1213103 (0.0009) [2023-12-26 09:16:38,621][123091] Updated weights for policy 0, policy_version 1213113 (0.0011) [2023-12-26 09:16:38,684][123091] Updated weights for policy 0, policy_version 1213123 (0.0011) [2023-12-26 09:16:38,692][123090] Updated weights for policy 1, policy_version 1204417 (0.0008) [2023-12-26 09:16:38,747][123091] Updated weights for policy 0, policy_version 1213133 (0.0011) [2023-12-26 09:16:38,758][123090] Updated weights for policy 1, policy_version 1204427 (0.0007) [2023-12-26 09:16:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 618897408. Throughput: 0: 8859.6, 1: 8711.6. Samples: 618873748. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:38,785][121949] Avg episode reward: [(0, '6176.780'), (1, '5594.632')] [2023-12-26 09:16:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001213136_310566912.pth... [2023-12-26 09:16:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001212080_310296576.pth [2023-12-26 09:16:38,817][123090] Updated weights for policy 1, policy_version 1204437 (0.0008) [2023-12-26 09:16:38,889][123090] Updated weights for policy 1, policy_version 1204447 (0.0009) [2023-12-26 09:16:38,893][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001204448_308338688.pth... [2023-12-26 09:16:38,898][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001203424_308076544.pth [2023-12-26 09:16:39,549][123091] Updated weights for policy 0, policy_version 1213143 (0.0008) [2023-12-26 09:16:39,608][123091] Updated weights for policy 0, policy_version 1213153 (0.0006) [2023-12-26 09:16:39,676][123091] Updated weights for policy 0, policy_version 1213163 (0.0005) [2023-12-26 09:16:39,712][123090] Updated weights for policy 1, policy_version 1204457 (0.0009) [2023-12-26 09:16:39,778][123090] Updated weights for policy 1, policy_version 1204467 (0.0008) [2023-12-26 09:16:39,842][123090] Updated weights for policy 1, policy_version 1204477 (0.0009) [2023-12-26 09:16:40,483][123091] Updated weights for policy 0, policy_version 1213173 (0.0008) [2023-12-26 09:16:40,552][123091] Updated weights for policy 0, policy_version 1213183 (0.0010) [2023-12-26 09:16:40,620][123091] Updated weights for policy 0, policy_version 1213193 (0.0009) [2023-12-26 09:16:40,712][123090] Updated weights for policy 1, policy_version 1204487 (0.0009) [2023-12-26 09:16:40,775][123090] Updated weights for policy 1, policy_version 1204497 (0.0010) [2023-12-26 09:16:40,825][123090] Updated weights for policy 1, policy_version 1204507 (0.0009) [2023-12-26 09:16:41,509][123091] Updated weights for policy 0, policy_version 1213203 (0.0010) [2023-12-26 09:16:41,578][123091] Updated weights for policy 0, policy_version 1213213 (0.0010) [2023-12-26 09:16:41,651][123091] Updated weights for policy 0, policy_version 1213223 (0.0011) [2023-12-26 09:16:41,654][123090] Updated weights for policy 1, policy_version 1204517 (0.0008) [2023-12-26 09:16:41,722][123090] Updated weights for policy 1, policy_version 1204527 (0.0007) [2023-12-26 09:16:41,792][123090] Updated weights for policy 1, policy_version 1204537 (0.0010) [2023-12-26 09:16:42,495][123091] Updated weights for policy 0, policy_version 1213233 (0.0009) [2023-12-26 09:16:42,565][123091] Updated weights for policy 0, policy_version 1213243 (0.0006) [2023-12-26 09:16:42,606][123090] Updated weights for policy 1, policy_version 1204547 (0.0009) [2023-12-26 09:16:42,641][123091] Updated weights for policy 0, policy_version 1213253 (0.0009) [2023-12-26 09:16:42,672][123090] Updated weights for policy 1, policy_version 1204557 (0.0006) [2023-12-26 09:16:42,705][123091] Updated weights for policy 0, policy_version 1213263 (0.0009) [2023-12-26 09:16:42,729][123090] Updated weights for policy 1, policy_version 1204567 (0.0006) [2023-12-26 09:16:43,388][123091] Updated weights for policy 0, policy_version 1213273 (0.0008) [2023-12-26 09:16:43,459][123091] Updated weights for policy 0, policy_version 1213283 (0.0010) [2023-12-26 09:16:43,500][123090] Updated weights for policy 1, policy_version 1204577 (0.0008) [2023-12-26 09:16:43,523][123091] Updated weights for policy 0, policy_version 1213293 (0.0009) [2023-12-26 09:16:43,558][123090] Updated weights for policy 1, policy_version 1204587 (0.0008) [2023-12-26 09:16:43,608][123090] Updated weights for policy 1, policy_version 1204597 (0.0009) [2023-12-26 09:16:43,668][123090] Updated weights for policy 1, policy_version 1204608 (0.0010) [2023-12-26 09:16:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 618987520. Throughput: 0: 8922.9, 1: 8593.6. Samples: 618976448. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:43,784][121949] Avg episode reward: [(0, '6182.605'), (1, '5753.273')] [2023-12-26 09:16:44,331][123091] Updated weights for policy 0, policy_version 1213303 (0.0007) [2023-12-26 09:16:44,390][123091] Updated weights for policy 0, policy_version 1213313 (0.0006) [2023-12-26 09:16:44,445][123091] Updated weights for policy 0, policy_version 1213323 (0.0008) [2023-12-26 09:16:44,523][123090] Updated weights for policy 1, policy_version 1204618 (0.0008) [2023-12-26 09:16:44,586][123090] Updated weights for policy 1, policy_version 1204628 (0.0010) [2023-12-26 09:16:44,642][123090] Updated weights for policy 1, policy_version 1204638 (0.0009) [2023-12-26 09:16:45,276][123091] Updated weights for policy 0, policy_version 1213333 (0.0009) [2023-12-26 09:16:45,342][123091] Updated weights for policy 0, policy_version 1213343 (0.0010) [2023-12-26 09:16:45,397][123091] Updated weights for policy 0, policy_version 1213353 (0.0010) [2023-12-26 09:16:45,447][123090] Updated weights for policy 1, policy_version 1204648 (0.0009) [2023-12-26 09:16:45,514][123090] Updated weights for policy 1, policy_version 1204658 (0.0009) [2023-12-26 09:16:45,577][123090] Updated weights for policy 1, policy_version 1204668 (0.0010) [2023-12-26 09:16:46,236][123091] Updated weights for policy 0, policy_version 1213363 (0.0009) [2023-12-26 09:16:46,289][123091] Updated weights for policy 0, policy_version 1213373 (0.0010) [2023-12-26 09:16:46,344][123091] Updated weights for policy 0, policy_version 1213383 (0.0010) [2023-12-26 09:16:46,396][123090] Updated weights for policy 1, policy_version 1204678 (0.0009) [2023-12-26 09:16:46,446][123090] Updated weights for policy 1, policy_version 1204688 (0.0009) [2023-12-26 09:16:46,505][123090] Updated weights for policy 1, policy_version 1204698 (0.0009) [2023-12-26 09:16:47,184][123091] Updated weights for policy 0, policy_version 1213393 (0.0010) [2023-12-26 09:16:47,245][123091] Updated weights for policy 0, policy_version 1213403 (0.0009) [2023-12-26 09:16:47,309][123091] Updated weights for policy 0, policy_version 1213413 (0.0009) [2023-12-26 09:16:47,335][123090] Updated weights for policy 1, policy_version 1204708 (0.0010) [2023-12-26 09:16:47,363][123091] Updated weights for policy 0, policy_version 1213423 (0.0008) [2023-12-26 09:16:47,392][123090] Updated weights for policy 1, policy_version 1204718 (0.0009) [2023-12-26 09:16:47,451][123090] Updated weights for policy 1, policy_version 1204728 (0.0010) [2023-12-26 09:16:48,208][123090] Updated weights for policy 1, policy_version 1204738 (0.0009) [2023-12-26 09:16:48,243][123091] Updated weights for policy 0, policy_version 1213433 (0.0010) [2023-12-26 09:16:48,275][123090] Updated weights for policy 1, policy_version 1204748 (0.0008) [2023-12-26 09:16:48,304][123091] Updated weights for policy 0, policy_version 1213443 (0.0007) [2023-12-26 09:16:48,340][123090] Updated weights for policy 1, policy_version 1204758 (0.0009) [2023-12-26 09:16:48,375][123091] Updated weights for policy 0, policy_version 1213453 (0.0008) [2023-12-26 09:16:48,413][123090] Updated weights for policy 1, policy_version 1204768 (0.0007) [2023-12-26 09:16:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 619069440. Throughput: 0: 8897.8, 1: 8612.5. Samples: 619080080. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:48,785][121949] Avg episode reward: [(0, '6204.801'), (1, '5577.334')] [2023-12-26 09:16:49,144][123090] Updated weights for policy 1, policy_version 1204778 (0.0008) [2023-12-26 09:16:49,194][123090] Updated weights for policy 1, policy_version 1204788 (0.0005) [2023-12-26 09:16:49,208][123091] Updated weights for policy 0, policy_version 1213463 (0.0007) [2023-12-26 09:16:49,258][123090] Updated weights for policy 1, policy_version 1204798 (0.0007) [2023-12-26 09:16:49,274][123091] Updated weights for policy 0, policy_version 1213473 (0.0008) [2023-12-26 09:16:49,337][123091] Updated weights for policy 0, policy_version 1213483 (0.0009) [2023-12-26 09:16:50,102][123090] Updated weights for policy 1, policy_version 1204808 (0.0010) [2023-12-26 09:16:50,166][123091] Updated weights for policy 0, policy_version 1213493 (0.0009) [2023-12-26 09:16:50,192][123090] Updated weights for policy 1, policy_version 1204818 (0.0009) [2023-12-26 09:16:50,215][123091] Updated weights for policy 0, policy_version 1213503 (0.0008) [2023-12-26 09:16:50,244][123090] Updated weights for policy 1, policy_version 1204828 (0.0007) [2023-12-26 09:16:50,267][123091] Updated weights for policy 0, policy_version 1213513 (0.0008) [2023-12-26 09:16:51,079][123091] Updated weights for policy 0, policy_version 1213523 (0.0009) [2023-12-26 09:16:51,132][123090] Updated weights for policy 1, policy_version 1204838 (0.0008) [2023-12-26 09:16:51,142][123091] Updated weights for policy 0, policy_version 1213533 (0.0008) [2023-12-26 09:16:51,198][123090] Updated weights for policy 1, policy_version 1204848 (0.0007) [2023-12-26 09:16:51,207][123091] Updated weights for policy 0, policy_version 1213543 (0.0010) [2023-12-26 09:16:51,261][123090] Updated weights for policy 1, policy_version 1204858 (0.0007) [2023-12-26 09:16:52,044][123090] Updated weights for policy 1, policy_version 1204868 (0.0010) [2023-12-26 09:16:52,051][123091] Updated weights for policy 0, policy_version 1213553 (0.0009) [2023-12-26 09:16:52,092][123090] Updated weights for policy 1, policy_version 1204878 (0.0010) [2023-12-26 09:16:52,116][123091] Updated weights for policy 0, policy_version 1213563 (0.0007) [2023-12-26 09:16:52,145][123090] Updated weights for policy 1, policy_version 1204888 (0.0010) [2023-12-26 09:16:52,178][123091] Updated weights for policy 0, policy_version 1213573 (0.0006) [2023-12-26 09:16:52,229][123091] Updated weights for policy 0, policy_version 1213583 (0.0008) [2023-12-26 09:16:52,880][123090] Updated weights for policy 1, policy_version 1204898 (0.0010) [2023-12-26 09:16:52,955][123090] Updated weights for policy 1, policy_version 1204908 (0.0006) [2023-12-26 09:16:53,023][123090] Updated weights for policy 1, policy_version 1204918 (0.0007) [2023-12-26 09:16:53,086][123090] Updated weights for policy 1, policy_version 1204928 (0.0009) [2023-12-26 09:16:53,137][123091] Updated weights for policy 0, policy_version 1213593 (0.0008) [2023-12-26 09:16:53,201][123091] Updated weights for policy 0, policy_version 1213603 (0.0009) [2023-12-26 09:16:53,253][123091] Updated weights for policy 0, policy_version 1213613 (0.0010) [2023-12-26 09:16:53,753][123090] Updated weights for policy 1, policy_version 1204938 (0.0005) [2023-12-26 09:16:53,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 619151360. Throughput: 0: 8885.6, 1: 8593.8. Samples: 619131240. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:53,785][121949] Avg episode reward: [(0, '6213.215'), (1, '5465.530')] [2023-12-26 09:16:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001213616_310689792.pth... [2023-12-26 09:16:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001212560_310419456.pth [2023-12-26 09:16:53,820][123090] Updated weights for policy 1, policy_version 1204948 (0.0005) [2023-12-26 09:16:53,891][123090] Updated weights for policy 1, policy_version 1204958 (0.0005) [2023-12-26 09:16:53,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001204960_308469760.pth... [2023-12-26 09:16:53,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001203936_308207616.pth [2023-12-26 09:16:54,174][123091] Updated weights for policy 0, policy_version 1213623 (0.0008) [2023-12-26 09:16:54,234][123091] Updated weights for policy 0, policy_version 1213633 (0.0010) [2023-12-26 09:16:54,303][123091] Updated weights for policy 0, policy_version 1213643 (0.0006) [2023-12-26 09:16:54,617][123090] Updated weights for policy 1, policy_version 1204968 (0.0010) [2023-12-26 09:16:54,687][123090] Updated weights for policy 1, policy_version 1204978 (0.0010) [2023-12-26 09:16:54,742][123090] Updated weights for policy 1, policy_version 1204988 (0.0010) [2023-12-26 09:16:55,140][123091] Updated weights for policy 0, policy_version 1213653 (0.0007) [2023-12-26 09:16:55,190][123091] Updated weights for policy 0, policy_version 1213663 (0.0005) [2023-12-26 09:16:55,236][123091] Updated weights for policy 0, policy_version 1213673 (0.0007) [2023-12-26 09:16:55,476][123090] Updated weights for policy 1, policy_version 1204998 (0.0007) [2023-12-26 09:16:55,533][123090] Updated weights for policy 1, policy_version 1205008 (0.0005) [2023-12-26 09:16:55,586][123090] Updated weights for policy 1, policy_version 1205018 (0.0006) [2023-12-26 09:16:56,047][123091] Updated weights for policy 0, policy_version 1213683 (0.0009) [2023-12-26 09:16:56,108][123091] Updated weights for policy 0, policy_version 1213693 (0.0010) [2023-12-26 09:16:56,156][123091] Updated weights for policy 0, policy_version 1213703 (0.0010) [2023-12-26 09:16:56,352][123090] Updated weights for policy 1, policy_version 1205028 (0.0007) [2023-12-26 09:16:56,418][123090] Updated weights for policy 1, policy_version 1205038 (0.0006) [2023-12-26 09:16:56,496][123090] Updated weights for policy 1, policy_version 1205048 (0.0005) [2023-12-26 09:16:56,984][123091] Updated weights for policy 0, policy_version 1213713 (0.0009) [2023-12-26 09:16:57,049][123091] Updated weights for policy 0, policy_version 1213723 (0.0005) [2023-12-26 09:16:57,113][123091] Updated weights for policy 0, policy_version 1213733 (0.0005) [2023-12-26 09:16:57,178][123091] Updated weights for policy 0, policy_version 1213743 (0.0005) [2023-12-26 09:16:57,239][123090] Updated weights for policy 1, policy_version 1205058 (0.0007) [2023-12-26 09:16:57,297][123090] Updated weights for policy 1, policy_version 1205068 (0.0010) [2023-12-26 09:16:57,351][123090] Updated weights for policy 1, policy_version 1205078 (0.0009) [2023-12-26 09:16:57,409][123090] Updated weights for policy 1, policy_version 1205088 (0.0008) [2023-12-26 09:16:57,890][123091] Updated weights for policy 0, policy_version 1213753 (0.0010) [2023-12-26 09:16:57,941][123091] Updated weights for policy 0, policy_version 1213763 (0.0010) [2023-12-26 09:16:57,992][123091] Updated weights for policy 0, policy_version 1213773 (0.0010) [2023-12-26 09:16:58,270][123090] Updated weights for policy 1, policy_version 1205098 (0.0009) [2023-12-26 09:16:58,340][123090] Updated weights for policy 1, policy_version 1205108 (0.0009) [2023-12-26 09:16:58,406][123090] Updated weights for policy 1, policy_version 1205118 (0.0009) [2023-12-26 09:16:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 619241472. Throughput: 0: 8887.8, 1: 8655.0. Samples: 619237684. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:16:58,785][121949] Avg episode reward: [(0, '6200.413'), (1, '5405.175')] [2023-12-26 09:16:58,876][123091] Updated weights for policy 0, policy_version 1213783 (0.0009) [2023-12-26 09:16:58,959][123091] Updated weights for policy 0, policy_version 1213793 (0.0007) [2023-12-26 09:16:59,029][123091] Updated weights for policy 0, policy_version 1213803 (0.0008) [2023-12-26 09:16:59,361][123090] Updated weights for policy 1, policy_version 1205128 (0.0008) [2023-12-26 09:16:59,422][123090] Updated weights for policy 1, policy_version 1205138 (0.0008) [2023-12-26 09:16:59,491][123090] Updated weights for policy 1, policy_version 1205148 (0.0008) [2023-12-26 09:16:59,837][123091] Updated weights for policy 0, policy_version 1213813 (0.0009) [2023-12-26 09:16:59,898][123091] Updated weights for policy 0, policy_version 1213823 (0.0011) [2023-12-26 09:16:59,960][123091] Updated weights for policy 0, policy_version 1213833 (0.0008) [2023-12-26 09:17:00,312][123090] Updated weights for policy 1, policy_version 1205158 (0.0009) [2023-12-26 09:17:00,363][123090] Updated weights for policy 1, policy_version 1205168 (0.0010) [2023-12-26 09:17:00,415][123090] Updated weights for policy 1, policy_version 1205178 (0.0008) [2023-12-26 09:17:00,757][123091] Updated weights for policy 0, policy_version 1213843 (0.0008) [2023-12-26 09:17:00,827][123091] Updated weights for policy 0, policy_version 1213853 (0.0009) [2023-12-26 09:17:00,879][123091] Updated weights for policy 0, policy_version 1213863 (0.0009) [2023-12-26 09:17:01,209][123090] Updated weights for policy 1, policy_version 1205188 (0.0009) [2023-12-26 09:17:01,271][123090] Updated weights for policy 1, policy_version 1205198 (0.0009) [2023-12-26 09:17:01,337][123090] Updated weights for policy 1, policy_version 1205208 (0.0009) [2023-12-26 09:17:01,711][123091] Updated weights for policy 0, policy_version 1213873 (0.0010) [2023-12-26 09:17:01,780][123091] Updated weights for policy 0, policy_version 1213883 (0.0010) [2023-12-26 09:17:01,847][123091] Updated weights for policy 0, policy_version 1213893 (0.0009) [2023-12-26 09:17:01,904][123091] Updated weights for policy 0, policy_version 1213903 (0.0009) [2023-12-26 09:17:02,144][123090] Updated weights for policy 1, policy_version 1205218 (0.0008) [2023-12-26 09:17:02,217][123090] Updated weights for policy 1, policy_version 1205228 (0.0007) [2023-12-26 09:17:02,279][123090] Updated weights for policy 1, policy_version 1205238 (0.0006) [2023-12-26 09:17:02,350][123090] Updated weights for policy 1, policy_version 1205248 (0.0006) [2023-12-26 09:17:02,736][123091] Updated weights for policy 0, policy_version 1213913 (0.0010) [2023-12-26 09:17:02,797][123091] Updated weights for policy 0, policy_version 1213923 (0.0010) [2023-12-26 09:17:02,851][123091] Updated weights for policy 0, policy_version 1213933 (0.0010) [2023-12-26 09:17:03,057][123090] Updated weights for policy 1, policy_version 1205258 (0.0009) [2023-12-26 09:17:03,103][123090] Updated weights for policy 1, policy_version 1205268 (0.0007) [2023-12-26 09:17:03,169][123090] Updated weights for policy 1, policy_version 1205278 (0.0005) [2023-12-26 09:17:03,656][123091] Updated weights for policy 0, policy_version 1213943 (0.0010) [2023-12-26 09:17:03,703][123091] Updated weights for policy 0, policy_version 1213953 (0.0010) [2023-12-26 09:17:03,750][123091] Updated weights for policy 0, policy_version 1213963 (0.0010) [2023-12-26 09:17:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 619331584. Throughput: 0: 8809.3, 1: 8699.7. Samples: 619340964. Policy #0 lag: (min: 31.0, avg: 44.3, max: 63.0) [2023-12-26 09:17:03,784][121949] Avg episode reward: [(0, '6192.681'), (1, '5388.609')] [2023-12-26 09:17:03,837][123090] Updated weights for policy 1, policy_version 1205288 (0.0006) [2023-12-26 09:17:03,896][123090] Updated weights for policy 1, policy_version 1205298 (0.0007) [2023-12-26 09:17:03,963][123090] Updated weights for policy 1, policy_version 1205308 (0.0005) [2023-12-26 09:17:04,585][123091] Updated weights for policy 0, policy_version 1213973 (0.0008) [2023-12-26 09:17:04,650][123091] Updated weights for policy 0, policy_version 1213983 (0.0005) [2023-12-26 09:17:04,721][123091] Updated weights for policy 0, policy_version 1213993 (0.0007) [2023-12-26 09:17:04,766][123090] Updated weights for policy 1, policy_version 1205318 (0.0006) [2023-12-26 09:17:04,820][123090] Updated weights for policy 1, policy_version 1205328 (0.0008) [2023-12-26 09:17:04,881][123090] Updated weights for policy 1, policy_version 1205338 (0.0005) [2023-12-26 09:17:05,469][123091] Updated weights for policy 0, policy_version 1214003 (0.0010) [2023-12-26 09:17:05,515][123091] Updated weights for policy 0, policy_version 1214013 (0.0010) [2023-12-26 09:17:05,566][123091] Updated weights for policy 0, policy_version 1214023 (0.0010) [2023-12-26 09:17:05,678][123090] Updated weights for policy 1, policy_version 1205348 (0.0006) [2023-12-26 09:17:05,738][123090] Updated weights for policy 1, policy_version 1205358 (0.0009) [2023-12-26 09:17:05,790][123090] Updated weights for policy 1, policy_version 1205368 (0.0009) [2023-12-26 09:17:06,366][123091] Updated weights for policy 0, policy_version 1214033 (0.0010) [2023-12-26 09:17:06,422][123091] Updated weights for policy 0, policy_version 1214043 (0.0007) [2023-12-26 09:17:06,487][123091] Updated weights for policy 0, policy_version 1214053 (0.0011) [2023-12-26 09:17:06,550][123091] Updated weights for policy 0, policy_version 1214063 (0.0011) [2023-12-26 09:17:06,564][123090] Updated weights for policy 1, policy_version 1205378 (0.0008) [2023-12-26 09:17:06,625][123090] Updated weights for policy 1, policy_version 1205388 (0.0011) [2023-12-26 09:17:06,689][123090] Updated weights for policy 1, policy_version 1205398 (0.0011) [2023-12-26 09:17:06,749][123090] Updated weights for policy 1, policy_version 1205408 (0.0010) [2023-12-26 09:17:07,218][123091] Updated weights for policy 0, policy_version 1214073 (0.0006) [2023-12-26 09:17:07,281][123091] Updated weights for policy 0, policy_version 1214083 (0.0006) [2023-12-26 09:17:07,328][123091] Updated weights for policy 0, policy_version 1214093 (0.0006) [2023-12-26 09:17:07,496][123090] Updated weights for policy 1, policy_version 1205418 (0.0006) [2023-12-26 09:17:07,551][123090] Updated weights for policy 1, policy_version 1205428 (0.0006) [2023-12-26 09:17:07,616][123090] Updated weights for policy 1, policy_version 1205438 (0.0006) [2023-12-26 09:17:08,030][123091] Updated weights for policy 0, policy_version 1214103 (0.0006) [2023-12-26 09:17:08,091][123091] Updated weights for policy 0, policy_version 1214113 (0.0006) [2023-12-26 09:17:08,147][123091] Updated weights for policy 0, policy_version 1214123 (0.0008) [2023-12-26 09:17:08,245][123090] Updated weights for policy 1, policy_version 1205448 (0.0005) [2023-12-26 09:17:08,299][123090] Updated weights for policy 1, policy_version 1205458 (0.0005) [2023-12-26 09:17:08,367][123090] Updated weights for policy 1, policy_version 1205468 (0.0009) [2023-12-26 09:17:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 619421696. Throughput: 0: 8863.1, 1: 8739.3. Samples: 619395216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:08,785][121949] Avg episode reward: [(0, '6245.884'), (1, '5634.743')] [2023-12-26 09:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001214128_310820864.pth... [2023-12-26 09:17:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001205472_308600832.pth... [2023-12-26 09:17:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001213136_310566912.pth [2023-12-26 09:17:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001204448_308338688.pth [2023-12-26 09:17:08,949][123091] Updated weights for policy 0, policy_version 1214133 (0.0010) [2023-12-26 09:17:09,008][123091] Updated weights for policy 0, policy_version 1214143 (0.0010) [2023-12-26 09:17:09,062][123091] Updated weights for policy 0, policy_version 1214153 (0.0010) [2023-12-26 09:17:09,090][123090] Updated weights for policy 1, policy_version 1205478 (0.0007) [2023-12-26 09:17:09,156][123090] Updated weights for policy 1, policy_version 1205488 (0.0009) [2023-12-26 09:17:09,212][123090] Updated weights for policy 1, policy_version 1205498 (0.0008) [2023-12-26 09:17:09,939][123091] Updated weights for policy 0, policy_version 1214163 (0.0007) [2023-12-26 09:17:09,990][123090] Updated weights for policy 1, policy_version 1205508 (0.0006) [2023-12-26 09:17:09,997][123091] Updated weights for policy 0, policy_version 1214173 (0.0007) [2023-12-26 09:17:10,048][123090] Updated weights for policy 1, policy_version 1205518 (0.0008) [2023-12-26 09:17:10,054][123091] Updated weights for policy 0, policy_version 1214183 (0.0008) [2023-12-26 09:17:10,103][123090] Updated weights for policy 1, policy_version 1205528 (0.0006) [2023-12-26 09:17:10,859][123091] Updated weights for policy 0, policy_version 1214193 (0.0009) [2023-12-26 09:17:10,876][123090] Updated weights for policy 1, policy_version 1205538 (0.0008) [2023-12-26 09:17:10,914][123091] Updated weights for policy 0, policy_version 1214203 (0.0007) [2023-12-26 09:17:10,942][123090] Updated weights for policy 1, policy_version 1205548 (0.0008) [2023-12-26 09:17:10,965][123091] Updated weights for policy 0, policy_version 1214213 (0.0006) [2023-12-26 09:17:11,005][123090] Updated weights for policy 1, policy_version 1205558 (0.0008) [2023-12-26 09:17:11,012][123091] Updated weights for policy 0, policy_version 1214223 (0.0006) [2023-12-26 09:17:11,069][123090] Updated weights for policy 1, policy_version 1205568 (0.0010) [2023-12-26 09:17:11,846][123091] Updated weights for policy 0, policy_version 1214233 (0.0008) [2023-12-26 09:17:11,862][123090] Updated weights for policy 1, policy_version 1205578 (0.0008) [2023-12-26 09:17:11,893][123091] Updated weights for policy 0, policy_version 1214243 (0.0005) [2023-12-26 09:17:11,935][123090] Updated weights for policy 1, policy_version 1205588 (0.0008) [2023-12-26 09:17:11,946][123091] Updated weights for policy 0, policy_version 1214253 (0.0006) [2023-12-26 09:17:11,996][123090] Updated weights for policy 1, policy_version 1205598 (0.0009) [2023-12-26 09:17:12,744][123091] Updated weights for policy 0, policy_version 1214263 (0.0007) [2023-12-26 09:17:12,806][123090] Updated weights for policy 1, policy_version 1205608 (0.0008) [2023-12-26 09:17:12,817][123091] Updated weights for policy 0, policy_version 1214273 (0.0008) [2023-12-26 09:17:12,873][123090] Updated weights for policy 1, policy_version 1205618 (0.0006) [2023-12-26 09:17:12,874][123091] Updated weights for policy 0, policy_version 1214283 (0.0009) [2023-12-26 09:17:12,931][123090] Updated weights for policy 1, policy_version 1205628 (0.0008) [2023-12-26 09:17:13,596][123091] Updated weights for policy 0, policy_version 1214293 (0.0007) [2023-12-26 09:17:13,657][123091] Updated weights for policy 0, policy_version 1214303 (0.0005) [2023-12-26 09:17:13,722][123091] Updated weights for policy 0, policy_version 1214313 (0.0006) [2023-12-26 09:17:13,735][123090] Updated weights for policy 1, policy_version 1205638 (0.0007) [2023-12-26 09:17:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 619511808. Throughput: 0: 8871.6, 1: 8842.7. Samples: 619505176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:13,785][121949] Avg episode reward: [(0, '6276.438'), (1, '5740.434')] [2023-12-26 09:17:13,801][123090] Updated weights for policy 1, policy_version 1205648 (0.0005) [2023-12-26 09:17:13,865][123090] Updated weights for policy 1, policy_version 1205658 (0.0005) [2023-12-26 09:17:14,405][123091] Updated weights for policy 0, policy_version 1214323 (0.0007) [2023-12-26 09:17:14,462][123091] Updated weights for policy 0, policy_version 1214333 (0.0006) [2023-12-26 09:17:14,515][123091] Updated weights for policy 0, policy_version 1214343 (0.0006) [2023-12-26 09:17:14,554][123090] Updated weights for policy 1, policy_version 1205668 (0.0005) [2023-12-26 09:17:14,622][123090] Updated weights for policy 1, policy_version 1205678 (0.0005) [2023-12-26 09:17:14,693][123090] Updated weights for policy 1, policy_version 1205688 (0.0006) [2023-12-26 09:17:15,321][123091] Updated weights for policy 0, policy_version 1214353 (0.0006) [2023-12-26 09:17:15,379][123091] Updated weights for policy 0, policy_version 1214363 (0.0010) [2023-12-26 09:17:15,440][123090] Updated weights for policy 1, policy_version 1205698 (0.0008) [2023-12-26 09:17:15,442][123091] Updated weights for policy 0, policy_version 1214373 (0.0010) [2023-12-26 09:17:15,499][123090] Updated weights for policy 1, policy_version 1205708 (0.0006) [2023-12-26 09:17:15,499][123091] Updated weights for policy 0, policy_version 1214383 (0.0009) [2023-12-26 09:17:15,553][123090] Updated weights for policy 1, policy_version 1205718 (0.0005) [2023-12-26 09:17:15,609][123090] Updated weights for policy 1, policy_version 1205728 (0.0006) [2023-12-26 09:17:16,210][123091] Updated weights for policy 0, policy_version 1214393 (0.0010) [2023-12-26 09:17:16,273][123091] Updated weights for policy 0, policy_version 1214403 (0.0010) [2023-12-26 09:17:16,311][123090] Updated weights for policy 1, policy_version 1205738 (0.0008) [2023-12-26 09:17:16,330][123091] Updated weights for policy 0, policy_version 1214413 (0.0007) [2023-12-26 09:17:16,374][123090] Updated weights for policy 1, policy_version 1205748 (0.0008) [2023-12-26 09:17:16,448][123090] Updated weights for policy 1, policy_version 1205758 (0.0010) [2023-12-26 09:17:17,079][123091] Updated weights for policy 0, policy_version 1214423 (0.0011) [2023-12-26 09:17:17,135][123091] Updated weights for policy 0, policy_version 1214433 (0.0011) [2023-12-26 09:17:17,194][123091] Updated weights for policy 0, policy_version 1214443 (0.0011) [2023-12-26 09:17:17,335][123090] Updated weights for policy 1, policy_version 1205768 (0.0010) [2023-12-26 09:17:17,388][123090] Updated weights for policy 1, policy_version 1205778 (0.0011) [2023-12-26 09:17:17,450][123090] Updated weights for policy 1, policy_version 1205788 (0.0010) [2023-12-26 09:17:18,030][123091] Updated weights for policy 0, policy_version 1214453 (0.0010) [2023-12-26 09:17:18,080][123091] Updated weights for policy 0, policy_version 1214463 (0.0009) [2023-12-26 09:17:18,134][123091] Updated weights for policy 0, policy_version 1214473 (0.0009) [2023-12-26 09:17:18,301][123090] Updated weights for policy 1, policy_version 1205798 (0.0010) [2023-12-26 09:17:18,362][123090] Updated weights for policy 1, policy_version 1205808 (0.0011) [2023-12-26 09:17:18,413][123090] Updated weights for policy 1, policy_version 1205818 (0.0013) [2023-12-26 09:17:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 619601920. Throughput: 0: 8859.0, 1: 8879.0. Samples: 619614396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:18,785][121949] Avg episode reward: [(0, '6268.629'), (1, '5616.422')] [2023-12-26 09:17:18,949][123091] Updated weights for policy 0, policy_version 1214483 (0.0009) [2023-12-26 09:17:18,998][123091] Updated weights for policy 0, policy_version 1214493 (0.0009) [2023-12-26 09:17:19,065][123091] Updated weights for policy 0, policy_version 1214503 (0.0008) [2023-12-26 09:17:19,260][123090] Updated weights for policy 1, policy_version 1205828 (0.0010) [2023-12-26 09:17:19,320][123090] Updated weights for policy 1, policy_version 1205838 (0.0011) [2023-12-26 09:17:19,387][123090] Updated weights for policy 1, policy_version 1205848 (0.0010) [2023-12-26 09:17:19,967][123091] Updated weights for policy 0, policy_version 1214513 (0.0009) [2023-12-26 09:17:20,032][123091] Updated weights for policy 0, policy_version 1214523 (0.0006) [2023-12-26 09:17:20,098][123091] Updated weights for policy 0, policy_version 1214533 (0.0008) [2023-12-26 09:17:20,156][123091] Updated weights for policy 0, policy_version 1214543 (0.0008) [2023-12-26 09:17:20,239][123090] Updated weights for policy 1, policy_version 1205858 (0.0010) [2023-12-26 09:17:20,304][123090] Updated weights for policy 1, policy_version 1205868 (0.0011) [2023-12-26 09:17:20,371][123090] Updated weights for policy 1, policy_version 1205878 (0.0011) [2023-12-26 09:17:20,442][123090] Updated weights for policy 1, policy_version 1205888 (0.0011) [2023-12-26 09:17:20,842][123091] Updated weights for policy 0, policy_version 1214553 (0.0010) [2023-12-26 09:17:20,908][123091] Updated weights for policy 0, policy_version 1214563 (0.0010) [2023-12-26 09:17:20,977][123091] Updated weights for policy 0, policy_version 1214573 (0.0008) [2023-12-26 09:17:21,275][123090] Updated weights for policy 1, policy_version 1205898 (0.0010) [2023-12-26 09:17:21,350][123090] Updated weights for policy 1, policy_version 1205908 (0.0009) [2023-12-26 09:17:21,422][123090] Updated weights for policy 1, policy_version 1205918 (0.0010) [2023-12-26 09:17:21,828][123091] Updated weights for policy 0, policy_version 1214583 (0.0010) [2023-12-26 09:17:21,891][123091] Updated weights for policy 0, policy_version 1214593 (0.0011) [2023-12-26 09:17:21,947][123091] Updated weights for policy 0, policy_version 1214603 (0.0011) [2023-12-26 09:17:22,252][123090] Updated weights for policy 1, policy_version 1205928 (0.0008) [2023-12-26 09:17:22,320][123090] Updated weights for policy 1, policy_version 1205938 (0.0009) [2023-12-26 09:17:22,394][123090] Updated weights for policy 1, policy_version 1205948 (0.0009) [2023-12-26 09:17:22,787][123091] Updated weights for policy 0, policy_version 1214613 (0.0011) [2023-12-26 09:17:22,853][123091] Updated weights for policy 0, policy_version 1214623 (0.0011) [2023-12-26 09:17:22,916][123091] Updated weights for policy 0, policy_version 1214633 (0.0011) [2023-12-26 09:17:23,226][123090] Updated weights for policy 1, policy_version 1205958 (0.0009) [2023-12-26 09:17:23,287][123090] Updated weights for policy 1, policy_version 1205968 (0.0008) [2023-12-26 09:17:23,348][123090] Updated weights for policy 1, policy_version 1205978 (0.0009) [2023-12-26 09:17:23,737][123091] Updated weights for policy 0, policy_version 1214643 (0.0011) [2023-12-26 09:17:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 619683840. Throughput: 0: 8758.6, 1: 8823.3. Samples: 619664936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:23,785][121949] Avg episode reward: [(0, '6269.355'), (1, '5709.855')] [2023-12-26 09:17:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001205984_308731904.pth... [2023-12-26 09:17:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001204960_308469760.pth [2023-12-26 09:17:23,796][123091] Updated weights for policy 0, policy_version 1214653 (0.0011) [2023-12-26 09:17:23,858][123091] Updated weights for policy 0, policy_version 1214663 (0.0010) [2023-12-26 09:17:23,905][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001214672_310960128.pth... [2023-12-26 09:17:23,908][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001213616_310689792.pth [2023-12-26 09:17:24,177][123090] Updated weights for policy 1, policy_version 1205988 (0.0009) [2023-12-26 09:17:24,226][123090] Updated weights for policy 1, policy_version 1205998 (0.0009) [2023-12-26 09:17:24,278][123090] Updated weights for policy 1, policy_version 1206008 (0.0009) [2023-12-26 09:17:24,679][123091] Updated weights for policy 0, policy_version 1214673 (0.0010) [2023-12-26 09:17:24,731][123091] Updated weights for policy 0, policy_version 1214683 (0.0010) [2023-12-26 09:17:24,778][123091] Updated weights for policy 0, policy_version 1214693 (0.0010) [2023-12-26 09:17:24,830][123091] Updated weights for policy 0, policy_version 1214703 (0.0011) [2023-12-26 09:17:25,146][123090] Updated weights for policy 1, policy_version 1206018 (0.0008) [2023-12-26 09:17:25,209][123090] Updated weights for policy 1, policy_version 1206028 (0.0009) [2023-12-26 09:17:25,272][123090] Updated weights for policy 1, policy_version 1206038 (0.0009) [2023-12-26 09:17:25,328][123090] Updated weights for policy 1, policy_version 1206048 (0.0008) [2023-12-26 09:17:25,686][123091] Updated weights for policy 0, policy_version 1214713 (0.0011) [2023-12-26 09:17:25,736][123091] Updated weights for policy 0, policy_version 1214723 (0.0010) [2023-12-26 09:17:25,783][123091] Updated weights for policy 0, policy_version 1214733 (0.0010) [2023-12-26 09:17:26,166][123090] Updated weights for policy 1, policy_version 1206058 (0.0010) [2023-12-26 09:17:26,216][123090] Updated weights for policy 1, policy_version 1206068 (0.0009) [2023-12-26 09:17:26,265][123090] Updated weights for policy 1, policy_version 1206078 (0.0009) [2023-12-26 09:17:26,576][123091] Updated weights for policy 0, policy_version 1214743 (0.0010) [2023-12-26 09:17:26,646][123091] Updated weights for policy 0, policy_version 1214753 (0.0009) [2023-12-26 09:17:26,708][123091] Updated weights for policy 0, policy_version 1214763 (0.0009) [2023-12-26 09:17:27,119][123090] Updated weights for policy 1, policy_version 1206088 (0.0008) [2023-12-26 09:17:27,180][123090] Updated weights for policy 1, policy_version 1206098 (0.0009) [2023-12-26 09:17:27,239][123090] Updated weights for policy 1, policy_version 1206108 (0.0009) [2023-12-26 09:17:27,481][123091] Updated weights for policy 0, policy_version 1214773 (0.0008) [2023-12-26 09:17:27,540][123091] Updated weights for policy 0, policy_version 1214783 (0.0005) [2023-12-26 09:17:27,598][123091] Updated weights for policy 0, policy_version 1214793 (0.0005) [2023-12-26 09:17:27,979][123090] Updated weights for policy 1, policy_version 1206118 (0.0007) [2023-12-26 09:17:28,034][123090] Updated weights for policy 1, policy_version 1206128 (0.0005) [2023-12-26 09:17:28,086][123090] Updated weights for policy 1, policy_version 1206138 (0.0005) [2023-12-26 09:17:28,315][123091] Updated weights for policy 0, policy_version 1214803 (0.0007) [2023-12-26 09:17:28,390][123091] Updated weights for policy 0, policy_version 1214813 (0.0009) [2023-12-26 09:17:28,448][123091] Updated weights for policy 0, policy_version 1214823 (0.0006) [2023-12-26 09:17:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 619773952. Throughput: 0: 8758.5, 1: 8824.5. Samples: 619767684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:28,784][121949] Avg episode reward: [(0, '6353.688'), (1, '5787.631')] [2023-12-26 09:17:28,894][123090] Updated weights for policy 1, policy_version 1206148 (0.0006) [2023-12-26 09:17:28,954][123090] Updated weights for policy 1, policy_version 1206158 (0.0006) [2023-12-26 09:17:29,004][123090] Updated weights for policy 1, policy_version 1206168 (0.0005) [2023-12-26 09:17:29,106][123091] Updated weights for policy 0, policy_version 1214833 (0.0005) [2023-12-26 09:17:29,181][123091] Updated weights for policy 0, policy_version 1214843 (0.0007) [2023-12-26 09:17:29,254][123091] Updated weights for policy 0, policy_version 1214853 (0.0007) [2023-12-26 09:17:29,324][123091] Updated weights for policy 0, policy_version 1214863 (0.0009) [2023-12-26 09:17:29,726][123090] Updated weights for policy 1, policy_version 1206178 (0.0006) [2023-12-26 09:17:29,788][123090] Updated weights for policy 1, policy_version 1206188 (0.0010) [2023-12-26 09:17:29,862][123090] Updated weights for policy 1, policy_version 1206198 (0.0010) [2023-12-26 09:17:29,930][123090] Updated weights for policy 1, policy_version 1206208 (0.0010) [2023-12-26 09:17:30,056][123091] Updated weights for policy 0, policy_version 1214873 (0.0008) [2023-12-26 09:17:30,111][123091] Updated weights for policy 0, policy_version 1214883 (0.0008) [2023-12-26 09:17:30,162][123091] Updated weights for policy 0, policy_version 1214893 (0.0008) [2023-12-26 09:17:30,740][123090] Updated weights for policy 1, policy_version 1206218 (0.0010) [2023-12-26 09:17:30,811][123090] Updated weights for policy 1, policy_version 1206228 (0.0009) [2023-12-26 09:17:30,850][123091] Updated weights for policy 0, policy_version 1214903 (0.0006) [2023-12-26 09:17:30,892][123090] Updated weights for policy 1, policy_version 1206238 (0.0006) [2023-12-26 09:17:30,919][123091] Updated weights for policy 0, policy_version 1214913 (0.0005) [2023-12-26 09:17:30,984][123091] Updated weights for policy 0, policy_version 1214923 (0.0005) [2023-12-26 09:17:31,659][123090] Updated weights for policy 1, policy_version 1206248 (0.0007) [2023-12-26 09:17:31,713][123090] Updated weights for policy 1, policy_version 1206258 (0.0008) [2023-12-26 09:17:31,761][123091] Updated weights for policy 0, policy_version 1214933 (0.0011) [2023-12-26 09:17:31,780][123090] Updated weights for policy 1, policy_version 1206268 (0.0007) [2023-12-26 09:17:31,828][123091] Updated weights for policy 0, policy_version 1214943 (0.0010) [2023-12-26 09:17:31,894][123091] Updated weights for policy 0, policy_version 1214953 (0.0010) [2023-12-26 09:17:32,453][123090] Updated weights for policy 1, policy_version 1206278 (0.0007) [2023-12-26 09:17:32,503][123090] Updated weights for policy 1, policy_version 1206288 (0.0008) [2023-12-26 09:17:32,547][123090] Updated weights for policy 1, policy_version 1206298 (0.0008) [2023-12-26 09:17:32,717][123091] Updated weights for policy 0, policy_version 1214963 (0.0010) [2023-12-26 09:17:32,779][123091] Updated weights for policy 0, policy_version 1214973 (0.0011) [2023-12-26 09:17:32,837][123091] Updated weights for policy 0, policy_version 1214983 (0.0010) [2023-12-26 09:17:33,443][123090] Updated weights for policy 1, policy_version 1206308 (0.0008) [2023-12-26 09:17:33,491][123091] Updated weights for policy 0, policy_version 1214993 (0.0010) [2023-12-26 09:17:33,500][123090] Updated weights for policy 1, policy_version 1206318 (0.0005) [2023-12-26 09:17:33,544][123091] Updated weights for policy 0, policy_version 1215003 (0.0010) [2023-12-26 09:17:33,560][123090] Updated weights for policy 1, policy_version 1206328 (0.0008) [2023-12-26 09:17:33,632][123091] Updated weights for policy 0, policy_version 1215013 (0.0010) [2023-12-26 09:17:33,689][123091] Updated weights for policy 0, policy_version 1215023 (0.0010) [2023-12-26 09:17:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 619872256. Throughput: 0: 8864.3, 1: 8885.4. Samples: 619878820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:33,785][121949] Avg episode reward: [(0, '6317.162'), (1, '5850.170')] [2023-12-26 09:17:34,275][123090] Updated weights for policy 1, policy_version 1206338 (0.0006) [2023-12-26 09:17:34,338][123090] Updated weights for policy 1, policy_version 1206348 (0.0010) [2023-12-26 09:17:34,397][123090] Updated weights for policy 1, policy_version 1206358 (0.0010) [2023-12-26 09:17:34,461][123090] Updated weights for policy 1, policy_version 1206368 (0.0010) [2023-12-26 09:17:34,482][123091] Updated weights for policy 0, policy_version 1215033 (0.0007) [2023-12-26 09:17:34,552][123091] Updated weights for policy 0, policy_version 1215043 (0.0011) [2023-12-26 09:17:34,619][123091] Updated weights for policy 0, policy_version 1215053 (0.0011) [2023-12-26 09:17:35,211][123090] Updated weights for policy 1, policy_version 1206378 (0.0005) [2023-12-26 09:17:35,233][123091] Updated weights for policy 0, policy_version 1215063 (0.0006) [2023-12-26 09:17:35,259][123090] Updated weights for policy 1, policy_version 1206388 (0.0005) [2023-12-26 09:17:35,291][123091] Updated weights for policy 0, policy_version 1215073 (0.0005) [2023-12-26 09:17:35,325][123090] Updated weights for policy 1, policy_version 1206398 (0.0005) [2023-12-26 09:17:35,364][123091] Updated weights for policy 0, policy_version 1215083 (0.0005) [2023-12-26 09:17:35,990][123090] Updated weights for policy 1, policy_version 1206408 (0.0009) [2023-12-26 09:17:36,056][123090] Updated weights for policy 1, policy_version 1206418 (0.0010) [2023-12-26 09:17:36,121][123090] Updated weights for policy 1, policy_version 1206428 (0.0009) [2023-12-26 09:17:36,163][123091] Updated weights for policy 0, policy_version 1215093 (0.0006) [2023-12-26 09:17:36,224][123091] Updated weights for policy 0, policy_version 1215103 (0.0006) [2023-12-26 09:17:36,304][123091] Updated weights for policy 0, policy_version 1215113 (0.0006) [2023-12-26 09:17:36,962][123090] Updated weights for policy 1, policy_version 1206438 (0.0010) [2023-12-26 09:17:36,982][123091] Updated weights for policy 0, policy_version 1215123 (0.0005) [2023-12-26 09:17:37,006][123090] Updated weights for policy 1, policy_version 1206448 (0.0010) [2023-12-26 09:17:37,035][123091] Updated weights for policy 0, policy_version 1215133 (0.0005) [2023-12-26 09:17:37,055][123090] Updated weights for policy 1, policy_version 1206458 (0.0010) [2023-12-26 09:17:37,090][123091] Updated weights for policy 0, policy_version 1215143 (0.0006) [2023-12-26 09:17:37,764][123091] Updated weights for policy 0, policy_version 1215153 (0.0005) [2023-12-26 09:17:37,818][123091] Updated weights for policy 0, policy_version 1215163 (0.0005) [2023-12-26 09:17:37,873][123090] Updated weights for policy 1, policy_version 1206468 (0.0009) [2023-12-26 09:17:37,876][123091] Updated weights for policy 0, policy_version 1215173 (0.0005) [2023-12-26 09:17:37,931][123090] Updated weights for policy 1, policy_version 1206478 (0.0010) [2023-12-26 09:17:37,933][123091] Updated weights for policy 0, policy_version 1215183 (0.0005) [2023-12-26 09:17:37,993][123090] Updated weights for policy 1, policy_version 1206488 (0.0010) [2023-12-26 09:17:38,597][123091] Updated weights for policy 0, policy_version 1215193 (0.0005) [2023-12-26 09:17:38,656][123091] Updated weights for policy 0, policy_version 1215203 (0.0005) [2023-12-26 09:17:38,724][123091] Updated weights for policy 0, policy_version 1215213 (0.0010) [2023-12-26 09:17:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 619962368. Throughput: 0: 8923.9, 1: 8942.8. Samples: 619935240. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:38,785][121949] Avg episode reward: [(0, '6244.149'), (1, '5728.148')] [2023-12-26 09:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001215216_311099392.pth... [2023-12-26 09:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001206496_308862976.pth... [2023-12-26 09:17:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001205472_308600832.pth [2023-12-26 09:17:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001214128_310820864.pth [2023-12-26 09:17:38,844][123090] Updated weights for policy 1, policy_version 1206498 (0.0008) [2023-12-26 09:17:38,903][123090] Updated weights for policy 1, policy_version 1206508 (0.0010) [2023-12-26 09:17:38,971][123090] Updated weights for policy 1, policy_version 1206518 (0.0010) [2023-12-26 09:17:39,034][123090] Updated weights for policy 1, policy_version 1206528 (0.0010) [2023-12-26 09:17:39,471][123091] Updated weights for policy 0, policy_version 1215223 (0.0010) [2023-12-26 09:17:39,542][123091] Updated weights for policy 0, policy_version 1215233 (0.0009) [2023-12-26 09:17:39,609][123091] Updated weights for policy 0, policy_version 1215243 (0.0009) [2023-12-26 09:17:39,848][123090] Updated weights for policy 1, policy_version 1206538 (0.0007) [2023-12-26 09:17:39,907][123090] Updated weights for policy 1, policy_version 1206548 (0.0007) [2023-12-26 09:17:39,973][123090] Updated weights for policy 1, policy_version 1206558 (0.0009) [2023-12-26 09:17:40,441][123091] Updated weights for policy 0, policy_version 1215253 (0.0010) [2023-12-26 09:17:40,491][123091] Updated weights for policy 0, policy_version 1215263 (0.0009) [2023-12-26 09:17:40,556][123091] Updated weights for policy 0, policy_version 1215273 (0.0010) [2023-12-26 09:17:40,763][123090] Updated weights for policy 1, policy_version 1206568 (0.0010) [2023-12-26 09:17:40,834][123090] Updated weights for policy 1, policy_version 1206578 (0.0009) [2023-12-26 09:17:40,901][123090] Updated weights for policy 1, policy_version 1206588 (0.0009) [2023-12-26 09:17:41,358][123091] Updated weights for policy 0, policy_version 1215283 (0.0009) [2023-12-26 09:17:41,434][123091] Updated weights for policy 0, policy_version 1215293 (0.0010) [2023-12-26 09:17:41,497][123091] Updated weights for policy 0, policy_version 1215303 (0.0010) [2023-12-26 09:17:41,796][123090] Updated weights for policy 1, policy_version 1206598 (0.0009) [2023-12-26 09:17:41,848][123090] Updated weights for policy 1, policy_version 1206608 (0.0007) [2023-12-26 09:17:41,909][123090] Updated weights for policy 1, policy_version 1206618 (0.0009) [2023-12-26 09:17:42,305][123091] Updated weights for policy 0, policy_version 1215313 (0.0010) [2023-12-26 09:17:42,373][123091] Updated weights for policy 0, policy_version 1215323 (0.0009) [2023-12-26 09:17:42,432][123091] Updated weights for policy 0, policy_version 1215333 (0.0008) [2023-12-26 09:17:42,489][123091] Updated weights for policy 0, policy_version 1215343 (0.0010) [2023-12-26 09:17:42,726][123090] Updated weights for policy 1, policy_version 1206628 (0.0009) [2023-12-26 09:17:42,793][123090] Updated weights for policy 1, policy_version 1206638 (0.0011) [2023-12-26 09:17:42,845][123090] Updated weights for policy 1, policy_version 1206648 (0.0010) [2023-12-26 09:17:43,207][123091] Updated weights for policy 0, policy_version 1215353 (0.0009) [2023-12-26 09:17:43,262][123091] Updated weights for policy 0, policy_version 1215363 (0.0009) [2023-12-26 09:17:43,310][123091] Updated weights for policy 0, policy_version 1215373 (0.0009) [2023-12-26 09:17:43,635][123090] Updated weights for policy 1, policy_version 1206658 (0.0010) [2023-12-26 09:17:43,701][123090] Updated weights for policy 1, policy_version 1206668 (0.0010) [2023-12-26 09:17:43,764][123090] Updated weights for policy 1, policy_version 1206678 (0.0011) [2023-12-26 09:17:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 620044288. Throughput: 0: 9008.3, 1: 8846.9. Samples: 620041168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:43,785][121949] Avg episode reward: [(0, '6272.038'), (1, '5673.314')] [2023-12-26 09:17:43,827][123090] Updated weights for policy 1, policy_version 1206688 (0.0010) [2023-12-26 09:17:44,151][123091] Updated weights for policy 0, policy_version 1215383 (0.0008) [2023-12-26 09:17:44,221][123091] Updated weights for policy 0, policy_version 1215393 (0.0008) [2023-12-26 09:17:44,289][123091] Updated weights for policy 0, policy_version 1215403 (0.0008) [2023-12-26 09:17:44,616][123090] Updated weights for policy 1, policy_version 1206698 (0.0009) [2023-12-26 09:17:44,679][123090] Updated weights for policy 1, policy_version 1206708 (0.0010) [2023-12-26 09:17:44,745][123090] Updated weights for policy 1, policy_version 1206718 (0.0010) [2023-12-26 09:17:45,041][123091] Updated weights for policy 0, policy_version 1215413 (0.0007) [2023-12-26 09:17:45,106][123091] Updated weights for policy 0, policy_version 1215423 (0.0006) [2023-12-26 09:17:45,172][123091] Updated weights for policy 0, policy_version 1215433 (0.0006) [2023-12-26 09:17:45,452][123090] Updated weights for policy 1, policy_version 1206728 (0.0010) [2023-12-26 09:17:45,504][123090] Updated weights for policy 1, policy_version 1206738 (0.0010) [2023-12-26 09:17:45,556][123090] Updated weights for policy 1, policy_version 1206748 (0.0010) [2023-12-26 09:17:45,865][123091] Updated weights for policy 0, policy_version 1215443 (0.0009) [2023-12-26 09:17:45,916][123091] Updated weights for policy 0, policy_version 1215453 (0.0010) [2023-12-26 09:17:45,971][123091] Updated weights for policy 0, policy_version 1215463 (0.0010) [2023-12-26 09:17:46,322][123090] Updated weights for policy 1, policy_version 1206758 (0.0007) [2023-12-26 09:17:46,369][123090] Updated weights for policy 1, policy_version 1206768 (0.0005) [2023-12-26 09:17:46,426][123090] Updated weights for policy 1, policy_version 1206778 (0.0005) [2023-12-26 09:17:46,724][123091] Updated weights for policy 0, policy_version 1215473 (0.0010) [2023-12-26 09:17:46,791][123091] Updated weights for policy 0, policy_version 1215483 (0.0006) [2023-12-26 09:17:46,844][123091] Updated weights for policy 0, policy_version 1215493 (0.0006) [2023-12-26 09:17:46,912][123091] Updated weights for policy 0, policy_version 1215503 (0.0005) [2023-12-26 09:17:47,160][123090] Updated weights for policy 1, policy_version 1206788 (0.0007) [2023-12-26 09:17:47,228][123090] Updated weights for policy 1, policy_version 1206798 (0.0009) [2023-12-26 09:17:47,289][123090] Updated weights for policy 1, policy_version 1206808 (0.0005) [2023-12-26 09:17:47,639][123091] Updated weights for policy 0, policy_version 1215513 (0.0006) [2023-12-26 09:17:47,698][123091] Updated weights for policy 0, policy_version 1215523 (0.0006) [2023-12-26 09:17:47,775][123091] Updated weights for policy 0, policy_version 1215533 (0.0006) [2023-12-26 09:17:47,917][123090] Updated weights for policy 1, policy_version 1206818 (0.0005) [2023-12-26 09:17:47,997][123090] Updated weights for policy 1, policy_version 1206828 (0.0006) [2023-12-26 09:17:48,065][123090] Updated weights for policy 1, policy_version 1206838 (0.0006) [2023-12-26 09:17:48,137][123090] Updated weights for policy 1, policy_version 1206848 (0.0006) [2023-12-26 09:17:48,417][123091] Updated weights for policy 0, policy_version 1215543 (0.0009) [2023-12-26 09:17:48,481][123091] Updated weights for policy 0, policy_version 1215553 (0.0009) [2023-12-26 09:17:48,542][123091] Updated weights for policy 0, policy_version 1215563 (0.0010) [2023-12-26 09:17:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 620142592. Throughput: 0: 9144.4, 1: 8938.6. Samples: 620154700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:48,785][121949] Avg episode reward: [(0, '6145.469'), (1, '5688.206')] [2023-12-26 09:17:48,817][123090] Updated weights for policy 1, policy_version 1206858 (0.0011) [2023-12-26 09:17:48,877][123090] Updated weights for policy 1, policy_version 1206868 (0.0011) [2023-12-26 09:17:48,938][123090] Updated weights for policy 1, policy_version 1206878 (0.0011) [2023-12-26 09:17:49,374][123091] Updated weights for policy 0, policy_version 1215573 (0.0010) [2023-12-26 09:17:49,437][123091] Updated weights for policy 0, policy_version 1215583 (0.0011) [2023-12-26 09:17:49,497][123091] Updated weights for policy 0, policy_version 1215593 (0.0010) [2023-12-26 09:17:49,824][123090] Updated weights for policy 1, policy_version 1206888 (0.0009) [2023-12-26 09:17:49,896][123090] Updated weights for policy 1, policy_version 1206898 (0.0009) [2023-12-26 09:17:49,969][123090] Updated weights for policy 1, policy_version 1206908 (0.0009) [2023-12-26 09:17:50,326][123091] Updated weights for policy 0, policy_version 1215603 (0.0009) [2023-12-26 09:17:50,402][123091] Updated weights for policy 0, policy_version 1215613 (0.0005) [2023-12-26 09:17:50,479][123091] Updated weights for policy 0, policy_version 1215623 (0.0006) [2023-12-26 09:17:50,818][123090] Updated weights for policy 1, policy_version 1206918 (0.0010) [2023-12-26 09:17:50,880][123090] Updated weights for policy 1, policy_version 1206928 (0.0008) [2023-12-26 09:17:50,946][123090] Updated weights for policy 1, policy_version 1206938 (0.0005) [2023-12-26 09:17:51,072][123091] Updated weights for policy 0, policy_version 1215633 (0.0006) [2023-12-26 09:17:51,142][123091] Updated weights for policy 0, policy_version 1215643 (0.0006) [2023-12-26 09:17:51,203][123091] Updated weights for policy 0, policy_version 1215653 (0.0006) [2023-12-26 09:17:51,267][123091] Updated weights for policy 0, policy_version 1215663 (0.0007) [2023-12-26 09:17:51,746][123090] Updated weights for policy 1, policy_version 1206948 (0.0007) [2023-12-26 09:17:51,806][123090] Updated weights for policy 1, policy_version 1206958 (0.0010) [2023-12-26 09:17:51,875][123090] Updated weights for policy 1, policy_version 1206968 (0.0010) [2023-12-26 09:17:52,073][123091] Updated weights for policy 0, policy_version 1215673 (0.0008) [2023-12-26 09:17:52,147][123091] Updated weights for policy 0, policy_version 1215683 (0.0006) [2023-12-26 09:17:52,207][123091] Updated weights for policy 0, policy_version 1215693 (0.0005) [2023-12-26 09:17:52,605][123090] Updated weights for policy 1, policy_version 1206978 (0.0009) [2023-12-26 09:17:52,673][123090] Updated weights for policy 1, policy_version 1206988 (0.0010) [2023-12-26 09:17:52,735][123090] Updated weights for policy 1, policy_version 1206998 (0.0009) [2023-12-26 09:17:52,786][123090] Updated weights for policy 1, policy_version 1207008 (0.0009) [2023-12-26 09:17:52,972][123091] Updated weights for policy 0, policy_version 1215704 (0.0008) [2023-12-26 09:17:53,035][123091] Updated weights for policy 0, policy_version 1215714 (0.0009) [2023-12-26 09:17:53,094][123091] Updated weights for policy 0, policy_version 1215724 (0.0009) [2023-12-26 09:17:53,457][123090] Updated weights for policy 1, policy_version 1207018 (0.0005) [2023-12-26 09:17:53,505][123090] Updated weights for policy 1, policy_version 1207028 (0.0005) [2023-12-26 09:17:53,556][123090] Updated weights for policy 1, policy_version 1207038 (0.0008) [2023-12-26 09:17:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17661.4). Total num frames: 620232704. Throughput: 0: 9141.2, 1: 8899.4. Samples: 620207040. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:53,784][121949] Avg episode reward: [(0, '6172.277'), (1, '5601.042')] [2023-12-26 09:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001215728_311230464.pth... [2023-12-26 09:17:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001207040_309002240.pth... [2023-12-26 09:17:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001205984_308731904.pth [2023-12-26 09:17:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001214672_310960128.pth [2023-12-26 09:17:53,983][123091] Updated weights for policy 0, policy_version 1215734 (0.0010) [2023-12-26 09:17:54,040][123091] Updated weights for policy 0, policy_version 1215744 (0.0009) [2023-12-26 09:17:54,091][123091] Updated weights for policy 0, policy_version 1215754 (0.0009) [2023-12-26 09:17:54,294][123090] Updated weights for policy 1, policy_version 1207048 (0.0008) [2023-12-26 09:17:54,356][123090] Updated weights for policy 1, policy_version 1207058 (0.0009) [2023-12-26 09:17:54,422][123090] Updated weights for policy 1, policy_version 1207068 (0.0009) [2023-12-26 09:17:54,954][123091] Updated weights for policy 0, policy_version 1215764 (0.0009) [2023-12-26 09:17:55,026][123091] Updated weights for policy 0, policy_version 1215774 (0.0008) [2023-12-26 09:17:55,079][123091] Updated weights for policy 0, policy_version 1215784 (0.0009) [2023-12-26 09:17:55,226][123090] Updated weights for policy 1, policy_version 1207078 (0.0009) [2023-12-26 09:17:55,280][123090] Updated weights for policy 1, policy_version 1207088 (0.0009) [2023-12-26 09:17:55,340][123090] Updated weights for policy 1, policy_version 1207098 (0.0009) [2023-12-26 09:17:55,835][123091] Updated weights for policy 0, policy_version 1215794 (0.0009) [2023-12-26 09:17:55,883][123091] Updated weights for policy 0, policy_version 1215804 (0.0008) [2023-12-26 09:17:55,932][123091] Updated weights for policy 0, policy_version 1215814 (0.0007) [2023-12-26 09:17:55,984][123091] Updated weights for policy 0, policy_version 1215824 (0.0005) [2023-12-26 09:17:56,248][123090] Updated weights for policy 1, policy_version 1207108 (0.0010) [2023-12-26 09:17:56,319][123090] Updated weights for policy 1, policy_version 1207118 (0.0010) [2023-12-26 09:17:56,389][123090] Updated weights for policy 1, policy_version 1207128 (0.0010) [2023-12-26 09:17:56,705][123091] Updated weights for policy 0, policy_version 1215834 (0.0010) [2023-12-26 09:17:56,757][123091] Updated weights for policy 0, policy_version 1215845 (0.0009) [2023-12-26 09:17:56,813][123091] Updated weights for policy 0, policy_version 1215855 (0.0009) [2023-12-26 09:17:57,127][123090] Updated weights for policy 1, policy_version 1207138 (0.0010) [2023-12-26 09:17:57,178][123090] Updated weights for policy 1, policy_version 1207148 (0.0005) [2023-12-26 09:17:57,229][123090] Updated weights for policy 1, policy_version 1207158 (0.0005) [2023-12-26 09:17:57,278][123090] Updated weights for policy 1, policy_version 1207168 (0.0005) [2023-12-26 09:17:57,563][123091] Updated weights for policy 0, policy_version 1215865 (0.0006) [2023-12-26 09:17:57,617][123091] Updated weights for policy 0, policy_version 1215875 (0.0007) [2023-12-26 09:17:57,671][123091] Updated weights for policy 0, policy_version 1215886 (0.0010) [2023-12-26 09:17:57,980][123090] Updated weights for policy 1, policy_version 1207178 (0.0008) [2023-12-26 09:17:58,049][123090] Updated weights for policy 1, policy_version 1207188 (0.0010) [2023-12-26 09:17:58,113][123090] Updated weights for policy 1, policy_version 1207198 (0.0011) [2023-12-26 09:17:58,432][123091] Updated weights for policy 0, policy_version 1215896 (0.0010) [2023-12-26 09:17:58,502][123091] Updated weights for policy 0, policy_version 1215906 (0.0010) [2023-12-26 09:17:58,566][123091] Updated weights for policy 0, policy_version 1215916 (0.0010) [2023-12-26 09:17:58,785][121949] Fps is (10 sec: 18019.8, 60 sec: 18022.0, 300 sec: 17633.5). Total num frames: 620322816. Throughput: 0: 9124.6, 1: 8883.2. Samples: 620315552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:17:58,786][121949] Avg episode reward: [(0, '6244.146'), (1, '5531.670')] [2023-12-26 09:17:58,985][123090] Updated weights for policy 1, policy_version 1207208 (0.0009) [2023-12-26 09:17:59,050][123090] Updated weights for policy 1, policy_version 1207218 (0.0010) [2023-12-26 09:17:59,109][123090] Updated weights for policy 1, policy_version 1207228 (0.0007) [2023-12-26 09:17:59,550][123091] Updated weights for policy 0, policy_version 1215926 (0.0009) [2023-12-26 09:17:59,604][123091] Updated weights for policy 0, policy_version 1215936 (0.0009) [2023-12-26 09:17:59,656][123091] Updated weights for policy 0, policy_version 1215946 (0.0008) [2023-12-26 09:17:59,984][123090] Updated weights for policy 1, policy_version 1207238 (0.0010) [2023-12-26 09:18:00,037][123090] Updated weights for policy 1, policy_version 1207248 (0.0011) [2023-12-26 09:18:00,090][123090] Updated weights for policy 1, policy_version 1207258 (0.0011) [2023-12-26 09:18:00,392][123091] Updated weights for policy 0, policy_version 1215956 (0.0005) [2023-12-26 09:18:00,442][123091] Updated weights for policy 0, policy_version 1215966 (0.0008) [2023-12-26 09:18:00,493][123091] Updated weights for policy 0, policy_version 1215976 (0.0010) [2023-12-26 09:18:00,933][123090] Updated weights for policy 1, policy_version 1207268 (0.0010) [2023-12-26 09:18:00,999][123090] Updated weights for policy 1, policy_version 1207278 (0.0010) [2023-12-26 09:18:01,065][123090] Updated weights for policy 1, policy_version 1207288 (0.0009) [2023-12-26 09:18:01,274][123091] Updated weights for policy 0, policy_version 1215986 (0.0010) [2023-12-26 09:18:01,331][123091] Updated weights for policy 0, policy_version 1215996 (0.0010) [2023-12-26 09:18:01,391][123091] Updated weights for policy 0, policy_version 1216006 (0.0011) [2023-12-26 09:18:01,443][123091] Updated weights for policy 0, policy_version 1216016 (0.0010) [2023-12-26 09:18:01,909][123090] Updated weights for policy 1, policy_version 1207298 (0.0008) [2023-12-26 09:18:01,966][123090] Updated weights for policy 1, policy_version 1207308 (0.0011) [2023-12-26 09:18:02,023][123090] Updated weights for policy 1, policy_version 1207318 (0.0010) [2023-12-26 09:18:02,093][123090] Updated weights for policy 1, policy_version 1207328 (0.0007) [2023-12-26 09:18:02,280][123091] Updated weights for policy 0, policy_version 1216026 (0.0009) [2023-12-26 09:18:02,333][123091] Updated weights for policy 0, policy_version 1216036 (0.0011) [2023-12-26 09:18:02,398][123091] Updated weights for policy 0, policy_version 1216046 (0.0012) [2023-12-26 09:18:02,838][123090] Updated weights for policy 1, policy_version 1207338 (0.0010) [2023-12-26 09:18:02,904][123090] Updated weights for policy 1, policy_version 1207348 (0.0010) [2023-12-26 09:18:02,959][123090] Updated weights for policy 1, policy_version 1207358 (0.0010) [2023-12-26 09:18:03,120][123091] Updated weights for policy 0, policy_version 1216056 (0.0006) [2023-12-26 09:18:03,167][123091] Updated weights for policy 0, policy_version 1216066 (0.0005) [2023-12-26 09:18:03,213][123091] Updated weights for policy 0, policy_version 1216076 (0.0005) [2023-12-26 09:18:03,700][123090] Updated weights for policy 1, policy_version 1207368 (0.0006) [2023-12-26 09:18:03,744][123090] Updated weights for policy 1, policy_version 1207378 (0.0005) [2023-12-26 09:18:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 620404736. Throughput: 0: 9099.5, 1: 8864.2. Samples: 620422760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:03,785][121949] Avg episode reward: [(0, '6213.526'), (1, '5766.977')] [2023-12-26 09:18:03,791][123090] Updated weights for policy 1, policy_version 1207388 (0.0005) [2023-12-26 09:18:03,833][123091] Updated weights for policy 0, policy_version 1216086 (0.0006) [2023-12-26 09:18:03,903][123091] Updated weights for policy 0, policy_version 1216096 (0.0010) [2023-12-26 09:18:03,974][123091] Updated weights for policy 0, policy_version 1216106 (0.0011) [2023-12-26 09:18:04,472][123090] Updated weights for policy 1, policy_version 1207398 (0.0008) [2023-12-26 09:18:04,539][123090] Updated weights for policy 1, policy_version 1207408 (0.0010) [2023-12-26 09:18:04,595][123090] Updated weights for policy 1, policy_version 1207418 (0.0010) [2023-12-26 09:18:04,800][123091] Updated weights for policy 0, policy_version 1216116 (0.0011) [2023-12-26 09:18:04,862][123091] Updated weights for policy 0, policy_version 1216126 (0.0011) [2023-12-26 09:18:04,916][123091] Updated weights for policy 0, policy_version 1216136 (0.0010) [2023-12-26 09:18:05,386][123090] Updated weights for policy 1, policy_version 1207428 (0.0008) [2023-12-26 09:18:05,433][123090] Updated weights for policy 1, policy_version 1207438 (0.0005) [2023-12-26 09:18:05,487][123090] Updated weights for policy 1, policy_version 1207448 (0.0005) [2023-12-26 09:18:05,649][123091] Updated weights for policy 0, policy_version 1216146 (0.0009) [2023-12-26 09:18:05,697][123091] Updated weights for policy 0, policy_version 1216156 (0.0005) [2023-12-26 09:18:05,742][123091] Updated weights for policy 0, policy_version 1216166 (0.0005) [2023-12-26 09:18:05,789][123091] Updated weights for policy 0, policy_version 1216176 (0.0005) [2023-12-26 09:18:06,083][123090] Updated weights for policy 1, policy_version 1207458 (0.0006) [2023-12-26 09:18:06,146][123090] Updated weights for policy 1, policy_version 1207468 (0.0007) [2023-12-26 09:18:06,209][123090] Updated weights for policy 1, policy_version 1207478 (0.0005) [2023-12-26 09:18:06,276][123090] Updated weights for policy 1, policy_version 1207488 (0.0006) [2023-12-26 09:18:06,534][123091] Updated weights for policy 0, policy_version 1216186 (0.0006) [2023-12-26 09:18:06,595][123091] Updated weights for policy 0, policy_version 1216196 (0.0006) [2023-12-26 09:18:06,654][123091] Updated weights for policy 0, policy_version 1216206 (0.0008) [2023-12-26 09:18:06,931][123090] Updated weights for policy 1, policy_version 1207498 (0.0005) [2023-12-26 09:18:06,985][123090] Updated weights for policy 1, policy_version 1207508 (0.0006) [2023-12-26 09:18:07,043][123090] Updated weights for policy 1, policy_version 1207518 (0.0005) [2023-12-26 09:18:07,432][123091] Updated weights for policy 0, policy_version 1216216 (0.0010) [2023-12-26 09:18:07,488][123091] Updated weights for policy 0, policy_version 1216226 (0.0010) [2023-12-26 09:18:07,543][123091] Updated weights for policy 0, policy_version 1216236 (0.0010) [2023-12-26 09:18:07,728][123090] Updated weights for policy 1, policy_version 1207528 (0.0006) [2023-12-26 09:18:07,781][123090] Updated weights for policy 1, policy_version 1207538 (0.0006) [2023-12-26 09:18:07,854][123090] Updated weights for policy 1, policy_version 1207548 (0.0006) [2023-12-26 09:18:08,388][123091] Updated weights for policy 0, policy_version 1216246 (0.0010) [2023-12-26 09:18:08,451][123091] Updated weights for policy 0, policy_version 1216256 (0.0011) [2023-12-26 09:18:08,483][123090] Updated weights for policy 1, policy_version 1207558 (0.0007) [2023-12-26 09:18:08,515][123091] Updated weights for policy 0, policy_version 1216266 (0.0011) [2023-12-26 09:18:08,549][123090] Updated weights for policy 1, policy_version 1207568 (0.0007) [2023-12-26 09:18:08,623][123090] Updated weights for policy 1, policy_version 1207578 (0.0006) [2023-12-26 09:18:08,784][121949] Fps is (10 sec: 18844.4, 60 sec: 18159.0, 300 sec: 17661.4). Total num frames: 620511232. Throughput: 0: 9153.5, 1: 8974.4. Samples: 620480692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:08,785][121949] Avg episode reward: [(0, '6185.445'), (1, '5828.722')] [2023-12-26 09:18:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001216272_311369728.pth... [2023-12-26 09:18:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001207584_309141504.pth... [2023-12-26 09:18:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001215216_311099392.pth [2023-12-26 09:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001206496_308862976.pth [2023-12-26 09:18:09,270][123090] Updated weights for policy 1, policy_version 1207588 (0.0008) [2023-12-26 09:18:09,335][123091] Updated weights for policy 0, policy_version 1216276 (0.0010) [2023-12-26 09:18:09,339][123090] Updated weights for policy 1, policy_version 1207598 (0.0006) [2023-12-26 09:18:09,409][123091] Updated weights for policy 0, policy_version 1216286 (0.0008) [2023-12-26 09:18:09,416][123090] Updated weights for policy 1, policy_version 1207608 (0.0009) [2023-12-26 09:18:09,478][123091] Updated weights for policy 0, policy_version 1216296 (0.0009) [2023-12-26 09:18:10,205][123090] Updated weights for policy 1, policy_version 1207618 (0.0009) [2023-12-26 09:18:10,240][123091] Updated weights for policy 0, policy_version 1216306 (0.0008) [2023-12-26 09:18:10,265][123090] Updated weights for policy 1, policy_version 1207628 (0.0010) [2023-12-26 09:18:10,304][123091] Updated weights for policy 0, policy_version 1216316 (0.0011) [2023-12-26 09:18:10,325][123090] Updated weights for policy 1, policy_version 1207638 (0.0010) [2023-12-26 09:18:10,369][123091] Updated weights for policy 0, policy_version 1216326 (0.0010) [2023-12-26 09:18:10,392][123090] Updated weights for policy 1, policy_version 1207648 (0.0011) [2023-12-26 09:18:10,436][123091] Updated weights for policy 0, policy_version 1216336 (0.0011) [2023-12-26 09:18:11,162][123090] Updated weights for policy 1, policy_version 1207658 (0.0010) [2023-12-26 09:18:11,223][123091] Updated weights for policy 0, policy_version 1216346 (0.0007) [2023-12-26 09:18:11,234][123090] Updated weights for policy 1, policy_version 1207668 (0.0010) [2023-12-26 09:18:11,287][123091] Updated weights for policy 0, policy_version 1216356 (0.0008) [2023-12-26 09:18:11,300][123090] Updated weights for policy 1, policy_version 1207678 (0.0007) [2023-12-26 09:18:11,340][123091] Updated weights for policy 0, policy_version 1216366 (0.0008) [2023-12-26 09:18:12,098][123091] Updated weights for policy 0, policy_version 1216376 (0.0007) [2023-12-26 09:18:12,136][123090] Updated weights for policy 1, policy_version 1207688 (0.0010) [2023-12-26 09:18:12,165][123091] Updated weights for policy 0, policy_version 1216386 (0.0008) [2023-12-26 09:18:12,199][123090] Updated weights for policy 1, policy_version 1207698 (0.0011) [2023-12-26 09:18:12,225][123091] Updated weights for policy 0, policy_version 1216396 (0.0011) [2023-12-26 09:18:12,259][123090] Updated weights for policy 1, policy_version 1207708 (0.0010) [2023-12-26 09:18:13,089][123091] Updated weights for policy 0, policy_version 1216406 (0.0011) [2023-12-26 09:18:13,097][123090] Updated weights for policy 1, policy_version 1207718 (0.0011) [2023-12-26 09:18:13,137][123091] Updated weights for policy 0, policy_version 1216416 (0.0010) [2023-12-26 09:18:13,161][123090] Updated weights for policy 1, policy_version 1207728 (0.0010) [2023-12-26 09:18:13,185][123091] Updated weights for policy 0, policy_version 1216426 (0.0010) [2023-12-26 09:18:13,225][123090] Updated weights for policy 1, policy_version 1207738 (0.0010) [2023-12-26 09:18:13,784][121949] Fps is (10 sec: 18840.9, 60 sec: 18022.3, 300 sec: 17633.6). Total num frames: 620593152. Throughput: 0: 9146.4, 1: 9087.9. Samples: 620588236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:13,786][121949] Avg episode reward: [(0, '6174.597'), (1, '5833.006')] [2023-12-26 09:18:13,956][123091] Updated weights for policy 0, policy_version 1216436 (0.0008) [2023-12-26 09:18:14,006][123090] Updated weights for policy 1, policy_version 1207748 (0.0010) [2023-12-26 09:18:14,018][123091] Updated weights for policy 0, policy_version 1216446 (0.0005) [2023-12-26 09:18:14,065][123090] Updated weights for policy 1, policy_version 1207758 (0.0010) [2023-12-26 09:18:14,086][123091] Updated weights for policy 0, policy_version 1216456 (0.0005) [2023-12-26 09:18:14,128][123090] Updated weights for policy 1, policy_version 1207768 (0.0010) [2023-12-26 09:18:14,850][123091] Updated weights for policy 0, policy_version 1216466 (0.0007) [2023-12-26 09:18:14,878][123090] Updated weights for policy 1, policy_version 1207778 (0.0010) [2023-12-26 09:18:14,914][123091] Updated weights for policy 0, policy_version 1216476 (0.0009) [2023-12-26 09:18:14,944][123090] Updated weights for policy 1, policy_version 1207788 (0.0007) [2023-12-26 09:18:14,970][123091] Updated weights for policy 0, policy_version 1216486 (0.0010) [2023-12-26 09:18:15,013][123090] Updated weights for policy 1, policy_version 1207798 (0.0006) [2023-12-26 09:18:15,030][123091] Updated weights for policy 0, policy_version 1216496 (0.0009) [2023-12-26 09:18:15,086][123090] Updated weights for policy 1, policy_version 1207808 (0.0006) [2023-12-26 09:18:15,772][123091] Updated weights for policy 0, policy_version 1216506 (0.0011) [2023-12-26 09:18:15,819][123090] Updated weights for policy 1, policy_version 1207818 (0.0005) [2023-12-26 09:18:15,835][123091] Updated weights for policy 0, policy_version 1216516 (0.0011) [2023-12-26 09:18:15,873][123090] Updated weights for policy 1, policy_version 1207828 (0.0005) [2023-12-26 09:18:15,889][123091] Updated weights for policy 0, policy_version 1216526 (0.0010) [2023-12-26 09:18:15,926][123090] Updated weights for policy 1, policy_version 1207838 (0.0009) [2023-12-26 09:18:16,605][123091] Updated weights for policy 0, policy_version 1216536 (0.0007) [2023-12-26 09:18:16,626][123090] Updated weights for policy 1, policy_version 1207848 (0.0009) [2023-12-26 09:18:16,662][123091] Updated weights for policy 0, policy_version 1216546 (0.0008) [2023-12-26 09:18:16,687][123090] Updated weights for policy 1, policy_version 1207858 (0.0008) [2023-12-26 09:18:16,719][123091] Updated weights for policy 0, policy_version 1216556 (0.0009) [2023-12-26 09:18:16,746][123090] Updated weights for policy 1, policy_version 1207868 (0.0008) [2023-12-26 09:18:17,508][123090] Updated weights for policy 1, policy_version 1207878 (0.0009) [2023-12-26 09:18:17,560][123090] Updated weights for policy 1, policy_version 1207889 (0.0010) [2023-12-26 09:18:17,571][123091] Updated weights for policy 0, policy_version 1216566 (0.0009) [2023-12-26 09:18:17,613][123090] Updated weights for policy 1, policy_version 1207899 (0.0005) [2023-12-26 09:18:17,638][123091] Updated weights for policy 0, policy_version 1216576 (0.0011) [2023-12-26 09:18:17,686][123091] Updated weights for policy 0, policy_version 1216586 (0.0010) [2023-12-26 09:18:18,315][123090] Updated weights for policy 1, policy_version 1207909 (0.0007) [2023-12-26 09:18:18,387][123090] Updated weights for policy 1, policy_version 1207919 (0.0009) [2023-12-26 09:18:18,451][123090] Updated weights for policy 1, policy_version 1207929 (0.0009) [2023-12-26 09:18:18,474][123091] Updated weights for policy 0, policy_version 1216596 (0.0011) [2023-12-26 09:18:18,530][123091] Updated weights for policy 0, policy_version 1216606 (0.0011) [2023-12-26 09:18:18,594][123091] Updated weights for policy 0, policy_version 1216616 (0.0011) [2023-12-26 09:18:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18159.0, 300 sec: 17661.4). Total num frames: 620691456. Throughput: 0: 9110.2, 1: 9125.2. Samples: 620699412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:18,785][121949] Avg episode reward: [(0, '6231.732'), (1, '5765.031')] [2023-12-26 09:18:19,276][123090] Updated weights for policy 1, policy_version 1207939 (0.0009) [2023-12-26 09:18:19,344][123090] Updated weights for policy 1, policy_version 1207949 (0.0009) [2023-12-26 09:18:19,413][123090] Updated weights for policy 1, policy_version 1207959 (0.0008) [2023-12-26 09:18:19,431][123091] Updated weights for policy 0, policy_version 1216626 (0.0011) [2023-12-26 09:18:19,499][123091] Updated weights for policy 0, policy_version 1216636 (0.0011) [2023-12-26 09:18:19,569][123091] Updated weights for policy 0, policy_version 1216646 (0.0010) [2023-12-26 09:18:19,624][123091] Updated weights for policy 0, policy_version 1216656 (0.0011) [2023-12-26 09:18:20,166][123090] Updated weights for policy 1, policy_version 1207969 (0.0005) [2023-12-26 09:18:20,236][123090] Updated weights for policy 1, policy_version 1207979 (0.0006) [2023-12-26 09:18:20,305][123090] Updated weights for policy 1, policy_version 1207989 (0.0009) [2023-12-26 09:18:20,372][123090] Updated weights for policy 1, policy_version 1207999 (0.0009) [2023-12-26 09:18:20,496][123091] Updated weights for policy 0, policy_version 1216666 (0.0011) [2023-12-26 09:18:20,558][123091] Updated weights for policy 0, policy_version 1216676 (0.0011) [2023-12-26 09:18:20,630][123091] Updated weights for policy 0, policy_version 1216686 (0.0011) [2023-12-26 09:18:21,175][123090] Updated weights for policy 1, policy_version 1208009 (0.0008) [2023-12-26 09:18:21,245][123090] Updated weights for policy 1, policy_version 1208019 (0.0008) [2023-12-26 09:18:21,309][123090] Updated weights for policy 1, policy_version 1208029 (0.0008) [2023-12-26 09:18:21,468][123091] Updated weights for policy 0, policy_version 1216696 (0.0007) [2023-12-26 09:18:21,536][123091] Updated weights for policy 0, policy_version 1216706 (0.0006) [2023-12-26 09:18:21,610][123091] Updated weights for policy 0, policy_version 1216716 (0.0006) [2023-12-26 09:18:22,108][123090] Updated weights for policy 1, policy_version 1208039 (0.0008) [2023-12-26 09:18:22,189][123090] Updated weights for policy 1, policy_version 1208049 (0.0006) [2023-12-26 09:18:22,259][123090] Updated weights for policy 1, policy_version 1208059 (0.0007) [2023-12-26 09:18:22,376][123091] Updated weights for policy 0, policy_version 1216726 (0.0009) [2023-12-26 09:18:22,439][123091] Updated weights for policy 0, policy_version 1216736 (0.0009) [2023-12-26 09:18:22,505][123091] Updated weights for policy 0, policy_version 1216746 (0.0009) [2023-12-26 09:18:23,058][123090] Updated weights for policy 1, policy_version 1208069 (0.0009) [2023-12-26 09:18:23,122][123090] Updated weights for policy 1, policy_version 1208079 (0.0011) [2023-12-26 09:18:23,183][123090] Updated weights for policy 1, policy_version 1208089 (0.0011) [2023-12-26 09:18:23,276][123091] Updated weights for policy 0, policy_version 1216756 (0.0007) [2023-12-26 09:18:23,323][123091] Updated weights for policy 0, policy_version 1216766 (0.0006) [2023-12-26 09:18:23,382][123091] Updated weights for policy 0, policy_version 1216776 (0.0006) [2023-12-26 09:18:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17661.4). Total num frames: 620773376. Throughput: 0: 9057.3, 1: 9057.2. Samples: 620750388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:23,785][121949] Avg episode reward: [(0, '6292.476'), (1, '5798.797')] [2023-12-26 09:18:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001208096_309272576.pth... [2023-12-26 09:18:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001216784_311500800.pth... [2023-12-26 09:18:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001207040_309002240.pth [2023-12-26 09:18:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001215728_311230464.pth [2023-12-26 09:18:23,993][123090] Updated weights for policy 1, policy_version 1208099 (0.0009) [2023-12-26 09:18:24,067][123090] Updated weights for policy 1, policy_version 1208109 (0.0005) [2023-12-26 09:18:24,085][123091] Updated weights for policy 0, policy_version 1216786 (0.0006) [2023-12-26 09:18:24,129][123090] Updated weights for policy 1, policy_version 1208119 (0.0005) [2023-12-26 09:18:24,157][123091] Updated weights for policy 0, policy_version 1216796 (0.0007) [2023-12-26 09:18:24,229][123091] Updated weights for policy 0, policy_version 1216806 (0.0006) [2023-12-26 09:18:24,290][123091] Updated weights for policy 0, policy_version 1216816 (0.0005) [2023-12-26 09:18:24,806][123090] Updated weights for policy 1, policy_version 1208129 (0.0006) [2023-12-26 09:18:24,862][123090] Updated weights for policy 1, policy_version 1208139 (0.0005) [2023-12-26 09:18:24,918][123090] Updated weights for policy 1, policy_version 1208149 (0.0005) [2023-12-26 09:18:24,937][123091] Updated weights for policy 0, policy_version 1216826 (0.0005) [2023-12-26 09:18:24,966][123090] Updated weights for policy 1, policy_version 1208159 (0.0005) [2023-12-26 09:18:24,992][123091] Updated weights for policy 0, policy_version 1216836 (0.0005) [2023-12-26 09:18:25,042][123091] Updated weights for policy 0, policy_version 1216846 (0.0005) [2023-12-26 09:18:25,664][123090] Updated weights for policy 1, policy_version 1208169 (0.0006) [2023-12-26 09:18:25,725][123090] Updated weights for policy 1, policy_version 1208179 (0.0005) [2023-12-26 09:18:25,775][123091] Updated weights for policy 0, policy_version 1216856 (0.0006) [2023-12-26 09:18:25,778][123090] Updated weights for policy 1, policy_version 1208189 (0.0005) [2023-12-26 09:18:25,822][123091] Updated weights for policy 0, policy_version 1216866 (0.0010) [2023-12-26 09:18:25,869][123091] Updated weights for policy 0, policy_version 1216876 (0.0008) [2023-12-26 09:18:26,477][123091] Updated weights for policy 0, policy_version 1216886 (0.0005) [2023-12-26 09:18:26,529][123091] Updated weights for policy 0, policy_version 1216896 (0.0005) [2023-12-26 09:18:26,574][123091] Updated weights for policy 0, policy_version 1216906 (0.0005) [2023-12-26 09:18:26,663][123090] Updated weights for policy 1, policy_version 1208199 (0.0008) [2023-12-26 09:18:26,728][123090] Updated weights for policy 1, policy_version 1208209 (0.0008) [2023-12-26 09:18:26,793][123090] Updated weights for policy 1, policy_version 1208219 (0.0008) [2023-12-26 09:18:27,254][123091] Updated weights for policy 0, policy_version 1216916 (0.0006) [2023-12-26 09:18:27,320][123091] Updated weights for policy 0, policy_version 1216926 (0.0010) [2023-12-26 09:18:27,381][123091] Updated weights for policy 0, policy_version 1216936 (0.0009) [2023-12-26 09:18:27,617][123090] Updated weights for policy 1, policy_version 1208229 (0.0007) [2023-12-26 09:18:27,661][123090] Updated weights for policy 1, policy_version 1208239 (0.0005) [2023-12-26 09:18:27,706][123090] Updated weights for policy 1, policy_version 1208249 (0.0005) [2023-12-26 09:18:28,064][123091] Updated weights for policy 0, policy_version 1216946 (0.0010) [2023-12-26 09:18:28,117][123091] Updated weights for policy 0, policy_version 1216956 (0.0009) [2023-12-26 09:18:28,170][123091] Updated weights for policy 0, policy_version 1216967 (0.0010) [2023-12-26 09:18:28,468][123090] Updated weights for policy 1, policy_version 1208259 (0.0006) [2023-12-26 09:18:28,527][123090] Updated weights for policy 1, policy_version 1208269 (0.0008) [2023-12-26 09:18:28,590][123090] Updated weights for policy 1, policy_version 1208279 (0.0009) [2023-12-26 09:18:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18295.5, 300 sec: 17661.4). Total num frames: 620871680. Throughput: 0: 9139.6, 1: 9116.7. Samples: 620862704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:28,785][121949] Avg episode reward: [(0, '6244.357'), (1, '5812.257')] [2023-12-26 09:18:28,962][123091] Updated weights for policy 0, policy_version 1216978 (0.0010) [2023-12-26 09:18:29,026][123091] Updated weights for policy 0, policy_version 1216988 (0.0009) [2023-12-26 09:18:29,078][123091] Updated weights for policy 0, policy_version 1216998 (0.0007) [2023-12-26 09:18:29,134][123091] Updated weights for policy 0, policy_version 1217008 (0.0005) [2023-12-26 09:18:29,475][123090] Updated weights for policy 1, policy_version 1208289 (0.0009) [2023-12-26 09:18:29,531][123090] Updated weights for policy 1, policy_version 1208299 (0.0009) [2023-12-26 09:18:29,597][123090] Updated weights for policy 1, policy_version 1208309 (0.0008) [2023-12-26 09:18:29,656][123090] Updated weights for policy 1, policy_version 1208319 (0.0009) [2023-12-26 09:18:29,921][123091] Updated weights for policy 0, policy_version 1217018 (0.0006) [2023-12-26 09:18:29,972][123091] Updated weights for policy 0, policy_version 1217028 (0.0006) [2023-12-26 09:18:30,027][123091] Updated weights for policy 0, policy_version 1217038 (0.0006) [2023-12-26 09:18:30,503][123090] Updated weights for policy 1, policy_version 1208329 (0.0009) [2023-12-26 09:18:30,572][123090] Updated weights for policy 1, policy_version 1208339 (0.0008) [2023-12-26 09:18:30,641][123090] Updated weights for policy 1, policy_version 1208349 (0.0006) [2023-12-26 09:18:30,689][123091] Updated weights for policy 0, policy_version 1217048 (0.0005) [2023-12-26 09:18:30,748][123091] Updated weights for policy 0, policy_version 1217058 (0.0005) [2023-12-26 09:18:30,809][123091] Updated weights for policy 0, policy_version 1217068 (0.0005) [2023-12-26 09:18:31,383][123090] Updated weights for policy 1, policy_version 1208359 (0.0010) [2023-12-26 09:18:31,435][123090] Updated weights for policy 1, policy_version 1208369 (0.0010) [2023-12-26 09:18:31,491][123090] Updated weights for policy 1, policy_version 1208379 (0.0010) [2023-12-26 09:18:31,494][123091] Updated weights for policy 0, policy_version 1217078 (0.0006) [2023-12-26 09:18:31,559][123091] Updated weights for policy 0, policy_version 1217088 (0.0007) [2023-12-26 09:18:31,620][123091] Updated weights for policy 0, policy_version 1217098 (0.0009) [2023-12-26 09:18:32,299][123091] Updated weights for policy 0, policy_version 1217108 (0.0008) [2023-12-26 09:18:32,355][123091] Updated weights for policy 0, policy_version 1217118 (0.0009) [2023-12-26 09:18:32,390][123090] Updated weights for policy 1, policy_version 1208389 (0.0010) [2023-12-26 09:18:32,422][123091] Updated weights for policy 0, policy_version 1217128 (0.0007) [2023-12-26 09:18:32,447][123090] Updated weights for policy 1, policy_version 1208399 (0.0009) [2023-12-26 09:18:32,498][123090] Updated weights for policy 1, policy_version 1208409 (0.0009) [2023-12-26 09:18:33,156][123091] Updated weights for policy 0, policy_version 1217138 (0.0006) [2023-12-26 09:18:33,217][123091] Updated weights for policy 0, policy_version 1217148 (0.0008) [2023-12-26 09:18:33,266][123091] Updated weights for policy 0, policy_version 1217158 (0.0009) [2023-12-26 09:18:33,318][123091] Updated weights for policy 0, policy_version 1217168 (0.0009) [2023-12-26 09:18:33,378][123090] Updated weights for policy 1, policy_version 1208419 (0.0010) [2023-12-26 09:18:33,426][123090] Updated weights for policy 1, policy_version 1208429 (0.0009) [2023-12-26 09:18:33,482][123090] Updated weights for policy 1, policy_version 1208440 (0.0009) [2023-12-26 09:18:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 620961792. Throughput: 0: 9153.6, 1: 8990.2. Samples: 620971172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:33,785][121949] Avg episode reward: [(0, '6319.845'), (1, '5731.150')] [2023-12-26 09:18:34,172][123091] Updated weights for policy 0, policy_version 1217178 (0.0009) [2023-12-26 09:18:34,230][123091] Updated weights for policy 0, policy_version 1217188 (0.0009) [2023-12-26 09:18:34,287][123091] Updated weights for policy 0, policy_version 1217198 (0.0009) [2023-12-26 09:18:34,315][123090] Updated weights for policy 1, policy_version 1208450 (0.0010) [2023-12-26 09:18:34,375][123090] Updated weights for policy 1, policy_version 1208460 (0.0010) [2023-12-26 09:18:34,439][123090] Updated weights for policy 1, policy_version 1208470 (0.0010) [2023-12-26 09:18:34,496][123090] Updated weights for policy 1, policy_version 1208480 (0.0007) [2023-12-26 09:18:35,175][123091] Updated weights for policy 0, policy_version 1217208 (0.0010) [2023-12-26 09:18:35,234][123091] Updated weights for policy 0, policy_version 1217218 (0.0008) [2023-12-26 09:18:35,235][123090] Updated weights for policy 1, policy_version 1208490 (0.0009) [2023-12-26 09:18:35,290][123090] Updated weights for policy 1, policy_version 1208500 (0.0010) [2023-12-26 09:18:35,293][123091] Updated weights for policy 0, policy_version 1217228 (0.0006) [2023-12-26 09:18:35,349][123090] Updated weights for policy 1, policy_version 1208510 (0.0010) [2023-12-26 09:18:36,040][123091] Updated weights for policy 0, policy_version 1217238 (0.0008) [2023-12-26 09:18:36,095][123091] Updated weights for policy 0, policy_version 1217248 (0.0010) [2023-12-26 09:18:36,157][123090] Updated weights for policy 1, policy_version 1208520 (0.0010) [2023-12-26 09:18:36,166][123091] Updated weights for policy 0, policy_version 1217258 (0.0009) [2023-12-26 09:18:36,225][123090] Updated weights for policy 1, policy_version 1208530 (0.0011) [2023-12-26 09:18:36,294][123090] Updated weights for policy 1, policy_version 1208540 (0.0009) [2023-12-26 09:18:36,909][123091] Updated weights for policy 0, policy_version 1217268 (0.0007) [2023-12-26 09:18:36,976][123091] Updated weights for policy 0, policy_version 1217278 (0.0008) [2023-12-26 09:18:37,042][123091] Updated weights for policy 0, policy_version 1217288 (0.0010) [2023-12-26 09:18:37,056][123090] Updated weights for policy 1, policy_version 1208550 (0.0007) [2023-12-26 09:18:37,121][123090] Updated weights for policy 1, policy_version 1208560 (0.0007) [2023-12-26 09:18:37,180][123090] Updated weights for policy 1, policy_version 1208570 (0.0008) [2023-12-26 09:18:37,801][123091] Updated weights for policy 0, policy_version 1217298 (0.0010) [2023-12-26 09:18:37,867][123091] Updated weights for policy 0, policy_version 1217308 (0.0010) [2023-12-26 09:18:37,917][123090] Updated weights for policy 1, policy_version 1208580 (0.0006) [2023-12-26 09:18:37,934][123091] Updated weights for policy 0, policy_version 1217318 (0.0011) [2023-12-26 09:18:37,988][123090] Updated weights for policy 1, policy_version 1208590 (0.0007) [2023-12-26 09:18:37,998][123091] Updated weights for policy 0, policy_version 1217328 (0.0010) [2023-12-26 09:18:38,043][123090] Updated weights for policy 1, policy_version 1208600 (0.0008) [2023-12-26 09:18:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 621043712. Throughput: 0: 9147.3, 1: 9033.6. Samples: 621025188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:38,786][121949] Avg episode reward: [(0, '6319.761'), (1, '5770.699')] [2023-12-26 09:18:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001208608_309403648.pth... [2023-12-26 09:18:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001207584_309141504.pth [2023-12-26 09:18:38,832][123091] Updated weights for policy 0, policy_version 1217338 (0.0011) [2023-12-26 09:18:38,868][123090] Updated weights for policy 1, policy_version 1208610 (0.0008) [2023-12-26 09:18:38,889][123091] Updated weights for policy 0, policy_version 1217348 (0.0010) [2023-12-26 09:18:38,935][123090] Updated weights for policy 1, policy_version 1208620 (0.0008) [2023-12-26 09:18:38,945][123091] Updated weights for policy 0, policy_version 1217358 (0.0008) [2023-12-26 09:18:38,956][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001217360_311648256.pth... [2023-12-26 09:18:38,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001216272_311369728.pth [2023-12-26 09:18:38,992][123090] Updated weights for policy 1, policy_version 1208630 (0.0008) [2023-12-26 09:18:39,055][123090] Updated weights for policy 1, policy_version 1208640 (0.0010) [2023-12-26 09:18:39,747][123091] Updated weights for policy 0, policy_version 1217368 (0.0007) [2023-12-26 09:18:39,816][123091] Updated weights for policy 0, policy_version 1217378 (0.0006) [2023-12-26 09:18:39,886][123091] Updated weights for policy 0, policy_version 1217388 (0.0008) [2023-12-26 09:18:39,957][123090] Updated weights for policy 1, policy_version 1208650 (0.0006) [2023-12-26 09:18:40,023][123090] Updated weights for policy 1, policy_version 1208660 (0.0006) [2023-12-26 09:18:40,076][123090] Updated weights for policy 1, policy_version 1208670 (0.0006) [2023-12-26 09:18:40,676][123091] Updated weights for policy 0, policy_version 1217398 (0.0009) [2023-12-26 09:18:40,739][123091] Updated weights for policy 0, policy_version 1217408 (0.0011) [2023-12-26 09:18:40,797][123091] Updated weights for policy 0, policy_version 1217418 (0.0010) [2023-12-26 09:18:40,864][123090] Updated weights for policy 1, policy_version 1208680 (0.0008) [2023-12-26 09:18:40,912][123090] Updated weights for policy 1, policy_version 1208690 (0.0008) [2023-12-26 09:18:40,979][123090] Updated weights for policy 1, policy_version 1208700 (0.0009) [2023-12-26 09:18:41,648][123091] Updated weights for policy 0, policy_version 1217428 (0.0010) [2023-12-26 09:18:41,716][123091] Updated weights for policy 0, policy_version 1217438 (0.0011) [2023-12-26 09:18:41,795][123091] Updated weights for policy 0, policy_version 1217448 (0.0011) [2023-12-26 09:18:41,901][123090] Updated weights for policy 1, policy_version 1208710 (0.0009) [2023-12-26 09:18:41,969][123090] Updated weights for policy 1, policy_version 1208720 (0.0009) [2023-12-26 09:18:42,029][123090] Updated weights for policy 1, policy_version 1208730 (0.0009) [2023-12-26 09:18:42,641][123091] Updated weights for policy 0, policy_version 1217458 (0.0010) [2023-12-26 09:18:42,693][123091] Updated weights for policy 0, policy_version 1217468 (0.0010) [2023-12-26 09:18:42,748][123091] Updated weights for policy 0, policy_version 1217478 (0.0010) [2023-12-26 09:18:42,801][123091] Updated weights for policy 0, policy_version 1217488 (0.0010) [2023-12-26 09:18:42,871][123090] Updated weights for policy 1, policy_version 1208740 (0.0009) [2023-12-26 09:18:42,920][123090] Updated weights for policy 1, policy_version 1208750 (0.0009) [2023-12-26 09:18:42,967][123090] Updated weights for policy 1, policy_version 1208760 (0.0008) [2023-12-26 09:18:43,651][123091] Updated weights for policy 0, policy_version 1217498 (0.0010) [2023-12-26 09:18:43,714][123091] Updated weights for policy 0, policy_version 1217508 (0.0010) [2023-12-26 09:18:43,780][123091] Updated weights for policy 0, policy_version 1217518 (0.0010) [2023-12-26 09:18:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 621125632. Throughput: 0: 9097.2, 1: 8938.8. Samples: 621127144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:43,784][121949] Avg episode reward: [(0, '6336.094'), (1, '5749.450')] [2023-12-26 09:18:43,809][123090] Updated weights for policy 1, policy_version 1208770 (0.0008) [2023-12-26 09:18:43,858][123090] Updated weights for policy 1, policy_version 1208780 (0.0009) [2023-12-26 09:18:43,907][123090] Updated weights for policy 1, policy_version 1208790 (0.0009) [2023-12-26 09:18:43,954][123090] Updated weights for policy 1, policy_version 1208800 (0.0008) [2023-12-26 09:18:44,582][123091] Updated weights for policy 0, policy_version 1217528 (0.0010) [2023-12-26 09:18:44,638][123091] Updated weights for policy 0, policy_version 1217538 (0.0010) [2023-12-26 09:18:44,699][123091] Updated weights for policy 0, policy_version 1217548 (0.0010) [2023-12-26 09:18:44,828][123090] Updated weights for policy 1, policy_version 1208810 (0.0009) [2023-12-26 09:18:44,896][123090] Updated weights for policy 1, policy_version 1208820 (0.0010) [2023-12-26 09:18:44,957][123090] Updated weights for policy 1, policy_version 1208830 (0.0009) [2023-12-26 09:18:45,549][123091] Updated weights for policy 0, policy_version 1217558 (0.0010) [2023-12-26 09:18:45,596][123091] Updated weights for policy 0, policy_version 1217568 (0.0010) [2023-12-26 09:18:45,641][123091] Updated weights for policy 0, policy_version 1217578 (0.0010) [2023-12-26 09:18:45,803][123090] Updated weights for policy 1, policy_version 1208840 (0.0009) [2023-12-26 09:18:45,859][123090] Updated weights for policy 1, policy_version 1208850 (0.0009) [2023-12-26 09:18:45,920][123090] Updated weights for policy 1, policy_version 1208860 (0.0008) [2023-12-26 09:18:46,379][123091] Updated weights for policy 0, policy_version 1217588 (0.0008) [2023-12-26 09:18:46,427][123091] Updated weights for policy 0, policy_version 1217598 (0.0005) [2023-12-26 09:18:46,473][123091] Updated weights for policy 0, policy_version 1217608 (0.0005) [2023-12-26 09:18:46,644][123090] Updated weights for policy 1, policy_version 1208870 (0.0009) [2023-12-26 09:18:46,698][123090] Updated weights for policy 1, policy_version 1208881 (0.0010) [2023-12-26 09:18:46,753][123090] Updated weights for policy 1, policy_version 1208892 (0.0010) [2023-12-26 09:18:47,215][123091] Updated weights for policy 0, policy_version 1217618 (0.0005) [2023-12-26 09:18:47,262][123091] Updated weights for policy 0, policy_version 1217628 (0.0005) [2023-12-26 09:18:47,310][123091] Updated weights for policy 0, policy_version 1217638 (0.0006) [2023-12-26 09:18:47,365][123091] Updated weights for policy 0, policy_version 1217648 (0.0010) [2023-12-26 09:18:47,488][123090] Updated weights for policy 1, policy_version 1208902 (0.0007) [2023-12-26 09:18:47,550][123090] Updated weights for policy 1, policy_version 1208912 (0.0006) [2023-12-26 09:18:47,624][123090] Updated weights for policy 1, policy_version 1208922 (0.0005) [2023-12-26 09:18:48,194][123091] Updated weights for policy 0, policy_version 1217658 (0.0011) [2023-12-26 09:18:48,257][123091] Updated weights for policy 0, policy_version 1217668 (0.0011) [2023-12-26 09:18:48,278][123090] Updated weights for policy 1, policy_version 1208932 (0.0005) [2023-12-26 09:18:48,320][123091] Updated weights for policy 0, policy_version 1217678 (0.0011) [2023-12-26 09:18:48,345][123090] Updated weights for policy 1, policy_version 1208942 (0.0006) [2023-12-26 09:18:48,414][123090] Updated weights for policy 1, policy_version 1208952 (0.0006) [2023-12-26 09:18:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 621223936. Throughput: 0: 9068.1, 1: 8971.9. Samples: 621234560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:48,784][121949] Avg episode reward: [(0, '6298.830'), (1, '5722.420')] [2023-12-26 09:18:49,127][123090] Updated weights for policy 1, policy_version 1208962 (0.0005) [2023-12-26 09:18:49,131][123091] Updated weights for policy 0, policy_version 1217688 (0.0011) [2023-12-26 09:18:49,197][123090] Updated weights for policy 1, policy_version 1208972 (0.0006) [2023-12-26 09:18:49,202][123091] Updated weights for policy 0, policy_version 1217698 (0.0011) [2023-12-26 09:18:49,271][123091] Updated weights for policy 0, policy_version 1217708 (0.0010) [2023-12-26 09:18:49,272][123090] Updated weights for policy 1, policy_version 1208982 (0.0010) [2023-12-26 09:18:49,345][123090] Updated weights for policy 1, policy_version 1208992 (0.0010) [2023-12-26 09:18:50,132][123091] Updated weights for policy 0, policy_version 1217718 (0.0008) [2023-12-26 09:18:50,147][123090] Updated weights for policy 1, policy_version 1209002 (0.0010) [2023-12-26 09:18:50,197][123091] Updated weights for policy 0, policy_version 1217728 (0.0007) [2023-12-26 09:18:50,207][123090] Updated weights for policy 1, policy_version 1209012 (0.0010) [2023-12-26 09:18:50,259][123091] Updated weights for policy 0, policy_version 1217738 (0.0007) [2023-12-26 09:18:50,275][123090] Updated weights for policy 1, policy_version 1209022 (0.0009) [2023-12-26 09:18:50,987][123091] Updated weights for policy 0, policy_version 1217748 (0.0008) [2023-12-26 09:18:51,052][123091] Updated weights for policy 0, policy_version 1217758 (0.0009) [2023-12-26 09:18:51,118][123091] Updated weights for policy 0, policy_version 1217768 (0.0009) [2023-12-26 09:18:51,142][123090] Updated weights for policy 1, policy_version 1209032 (0.0010) [2023-12-26 09:18:51,208][123090] Updated weights for policy 1, policy_version 1209042 (0.0010) [2023-12-26 09:18:51,270][123090] Updated weights for policy 1, policy_version 1209052 (0.0009) [2023-12-26 09:18:51,960][123091] Updated weights for policy 0, policy_version 1217778 (0.0008) [2023-12-26 09:18:52,018][123091] Updated weights for policy 0, policy_version 1217788 (0.0009) [2023-12-26 09:18:52,073][123091] Updated weights for policy 0, policy_version 1217798 (0.0008) [2023-12-26 09:18:52,128][123091] Updated weights for policy 0, policy_version 1217808 (0.0010) [2023-12-26 09:18:52,145][123090] Updated weights for policy 1, policy_version 1209062 (0.0009) [2023-12-26 09:18:52,212][123090] Updated weights for policy 1, policy_version 1209072 (0.0008) [2023-12-26 09:18:52,289][123090] Updated weights for policy 1, policy_version 1209082 (0.0008) [2023-12-26 09:18:52,999][123091] Updated weights for policy 0, policy_version 1217818 (0.0009) [2023-12-26 09:18:53,060][123091] Updated weights for policy 0, policy_version 1217828 (0.0009) [2023-12-26 09:18:53,085][123090] Updated weights for policy 1, policy_version 1209092 (0.0009) [2023-12-26 09:18:53,126][123091] Updated weights for policy 0, policy_version 1217838 (0.0006) [2023-12-26 09:18:53,131][123090] Updated weights for policy 1, policy_version 1209102 (0.0010) [2023-12-26 09:18:53,177][123090] Updated weights for policy 1, policy_version 1209112 (0.0010) [2023-12-26 09:18:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 621305856. Throughput: 0: 9016.3, 1: 8868.2. Samples: 621285492. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:53,785][121949] Avg episode reward: [(0, '6305.300'), (1, '5644.600')] [2023-12-26 09:18:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001217840_311771136.pth... [2023-12-26 09:18:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001209120_309534720.pth... [2023-12-26 09:18:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001216784_311500800.pth [2023-12-26 09:18:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001208096_309272576.pth [2023-12-26 09:18:53,934][123090] Updated weights for policy 1, policy_version 1209122 (0.0009) [2023-12-26 09:18:53,975][123091] Updated weights for policy 0, policy_version 1217848 (0.0009) [2023-12-26 09:18:53,990][123090] Updated weights for policy 1, policy_version 1209132 (0.0007) [2023-12-26 09:18:54,039][123091] Updated weights for policy 0, policy_version 1217858 (0.0007) [2023-12-26 09:18:54,042][123090] Updated weights for policy 1, policy_version 1209142 (0.0008) [2023-12-26 09:18:54,090][123091] Updated weights for policy 0, policy_version 1217868 (0.0006) [2023-12-26 09:18:54,110][123090] Updated weights for policy 1, policy_version 1209152 (0.0008) [2023-12-26 09:18:54,801][123091] Updated weights for policy 0, policy_version 1217878 (0.0006) [2023-12-26 09:18:54,810][123090] Updated weights for policy 1, policy_version 1209162 (0.0006) [2023-12-26 09:18:54,862][123091] Updated weights for policy 0, policy_version 1217888 (0.0005) [2023-12-26 09:18:54,878][123090] Updated weights for policy 1, policy_version 1209172 (0.0006) [2023-12-26 09:18:54,917][123091] Updated weights for policy 0, policy_version 1217898 (0.0006) [2023-12-26 09:18:54,947][123090] Updated weights for policy 1, policy_version 1209182 (0.0008) [2023-12-26 09:18:55,615][123090] Updated weights for policy 1, policy_version 1209192 (0.0006) [2023-12-26 09:18:55,661][123090] Updated weights for policy 1, policy_version 1209202 (0.0005) [2023-12-26 09:18:55,706][123090] Updated weights for policy 1, policy_version 1209212 (0.0005) [2023-12-26 09:18:55,775][123091] Updated weights for policy 0, policy_version 1217908 (0.0008) [2023-12-26 09:18:55,841][123091] Updated weights for policy 0, policy_version 1217918 (0.0009) [2023-12-26 09:18:55,911][123091] Updated weights for policy 0, policy_version 1217928 (0.0010) [2023-12-26 09:18:56,428][123090] Updated weights for policy 1, policy_version 1209222 (0.0008) [2023-12-26 09:18:56,476][123090] Updated weights for policy 1, policy_version 1209232 (0.0009) [2023-12-26 09:18:56,523][123090] Updated weights for policy 1, policy_version 1209242 (0.0008) [2023-12-26 09:18:56,784][123091] Updated weights for policy 0, policy_version 1217938 (0.0010) [2023-12-26 09:18:56,847][123091] Updated weights for policy 0, policy_version 1217948 (0.0011) [2023-12-26 09:18:56,911][123091] Updated weights for policy 0, policy_version 1217958 (0.0011) [2023-12-26 09:18:56,978][123091] Updated weights for policy 0, policy_version 1217968 (0.0010) [2023-12-26 09:18:57,255][123090] Updated weights for policy 1, policy_version 1209252 (0.0007) [2023-12-26 09:18:57,309][123090] Updated weights for policy 1, policy_version 1209262 (0.0008) [2023-12-26 09:18:57,370][123090] Updated weights for policy 1, policy_version 1209272 (0.0009) [2023-12-26 09:18:57,644][123091] Updated weights for policy 0, policy_version 1217978 (0.0009) [2023-12-26 09:18:57,707][123091] Updated weights for policy 0, policy_version 1217988 (0.0009) [2023-12-26 09:18:57,769][123091] Updated weights for policy 0, policy_version 1217998 (0.0009) [2023-12-26 09:18:58,232][123090] Updated weights for policy 1, policy_version 1209282 (0.0009) [2023-12-26 09:18:58,298][123090] Updated weights for policy 1, policy_version 1209292 (0.0009) [2023-12-26 09:18:58,366][123090] Updated weights for policy 1, policy_version 1209302 (0.0009) [2023-12-26 09:18:58,426][123090] Updated weights for policy 1, policy_version 1209312 (0.0009) [2023-12-26 09:18:58,511][123091] Updated weights for policy 0, policy_version 1218008 (0.0008) [2023-12-26 09:18:58,578][123091] Updated weights for policy 0, policy_version 1218018 (0.0009) [2023-12-26 09:18:58,643][123091] Updated weights for policy 0, policy_version 1218028 (0.0008) [2023-12-26 09:18:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.9, 300 sec: 17716.9). Total num frames: 621404160. Throughput: 0: 9010.0, 1: 8898.0. Samples: 621394092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:18:58,785][121949] Avg episode reward: [(0, '6146.670'), (1, '5653.376')] [2023-12-26 09:18:59,198][123090] Updated weights for policy 1, policy_version 1209322 (0.0007) [2023-12-26 09:18:59,272][123090] Updated weights for policy 1, policy_version 1209332 (0.0007) [2023-12-26 09:18:59,342][123090] Updated weights for policy 1, policy_version 1209342 (0.0007) [2023-12-26 09:18:59,408][123091] Updated weights for policy 0, policy_version 1218038 (0.0007) [2023-12-26 09:18:59,463][123091] Updated weights for policy 0, policy_version 1218048 (0.0005) [2023-12-26 09:18:59,519][123091] Updated weights for policy 0, policy_version 1218058 (0.0005) [2023-12-26 09:19:00,041][123090] Updated weights for policy 1, policy_version 1209352 (0.0009) [2023-12-26 09:19:00,105][123090] Updated weights for policy 1, policy_version 1209362 (0.0009) [2023-12-26 09:19:00,161][123090] Updated weights for policy 1, policy_version 1209373 (0.0010) [2023-12-26 09:19:00,196][123091] Updated weights for policy 0, policy_version 1218068 (0.0006) [2023-12-26 09:19:00,260][123091] Updated weights for policy 0, policy_version 1218078 (0.0005) [2023-12-26 09:19:00,328][123091] Updated weights for policy 0, policy_version 1218088 (0.0006) [2023-12-26 09:19:01,035][123091] Updated weights for policy 0, policy_version 1218098 (0.0007) [2023-12-26 09:19:01,064][123090] Updated weights for policy 1, policy_version 1209383 (0.0008) [2023-12-26 09:19:01,103][123091] Updated weights for policy 0, policy_version 1218108 (0.0011) [2023-12-26 09:19:01,127][123090] Updated weights for policy 1, policy_version 1209393 (0.0009) [2023-12-26 09:19:01,172][123091] Updated weights for policy 0, policy_version 1218118 (0.0008) [2023-12-26 09:19:01,195][123090] Updated weights for policy 1, policy_version 1209403 (0.0008) [2023-12-26 09:19:01,239][123091] Updated weights for policy 0, policy_version 1218128 (0.0008) [2023-12-26 09:19:02,037][123090] Updated weights for policy 1, policy_version 1209413 (0.0008) [2023-12-26 09:19:02,081][123091] Updated weights for policy 0, policy_version 1218138 (0.0009) [2023-12-26 09:19:02,097][123090] Updated weights for policy 1, policy_version 1209423 (0.0007) [2023-12-26 09:19:02,146][123091] Updated weights for policy 0, policy_version 1218148 (0.0009) [2023-12-26 09:19:02,153][123090] Updated weights for policy 1, policy_version 1209433 (0.0009) [2023-12-26 09:19:02,195][123091] Updated weights for policy 0, policy_version 1218158 (0.0008) [2023-12-26 09:19:02,875][123091] Updated weights for policy 0, policy_version 1218168 (0.0006) [2023-12-26 09:19:02,922][123091] Updated weights for policy 0, policy_version 1218178 (0.0005) [2023-12-26 09:19:02,967][123091] Updated weights for policy 0, policy_version 1218188 (0.0006) [2023-12-26 09:19:03,041][123090] Updated weights for policy 1, policy_version 1209443 (0.0008) [2023-12-26 09:19:03,094][123090] Updated weights for policy 1, policy_version 1209453 (0.0010) [2023-12-26 09:19:03,151][123090] Updated weights for policy 1, policy_version 1209463 (0.0009) [2023-12-26 09:19:03,730][123091] Updated weights for policy 0, policy_version 1218198 (0.0005) [2023-12-26 09:19:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17689.2). Total num frames: 621486080. Throughput: 0: 9052.4, 1: 8783.4. Samples: 621502028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:19:03,785][123091] Updated weights for policy 0, policy_version 1218208 (0.0005) [2023-12-26 09:19:03,785][121949] Avg episode reward: [(0, '6164.415'), (1, '5609.000')] [2023-12-26 09:19:03,839][123091] Updated weights for policy 0, policy_version 1218218 (0.0006) [2023-12-26 09:19:03,955][123090] Updated weights for policy 1, policy_version 1209473 (0.0009) [2023-12-26 09:19:04,017][123090] Updated weights for policy 1, policy_version 1209483 (0.0008) [2023-12-26 09:19:04,081][123090] Updated weights for policy 1, policy_version 1209493 (0.0005) [2023-12-26 09:19:04,151][123090] Updated weights for policy 1, policy_version 1209503 (0.0006) [2023-12-26 09:19:04,632][123091] Updated weights for policy 0, policy_version 1218228 (0.0009) [2023-12-26 09:19:04,686][123091] Updated weights for policy 0, policy_version 1218238 (0.0009) [2023-12-26 09:19:04,739][123091] Updated weights for policy 0, policy_version 1218248 (0.0009) [2023-12-26 09:19:04,954][123090] Updated weights for policy 1, policy_version 1209513 (0.0009) [2023-12-26 09:19:05,018][123090] Updated weights for policy 1, policy_version 1209523 (0.0005) [2023-12-26 09:19:05,073][123090] Updated weights for policy 1, policy_version 1209533 (0.0005) [2023-12-26 09:19:05,527][123091] Updated weights for policy 0, policy_version 1218258 (0.0009) [2023-12-26 09:19:05,583][123091] Updated weights for policy 0, policy_version 1218268 (0.0010) [2023-12-26 09:19:05,652][123091] Updated weights for policy 0, policy_version 1218278 (0.0009) [2023-12-26 09:19:05,709][123091] Updated weights for policy 0, policy_version 1218288 (0.0009) [2023-12-26 09:19:05,883][123090] Updated weights for policy 1, policy_version 1209543 (0.0008) [2023-12-26 09:19:05,947][123090] Updated weights for policy 1, policy_version 1209553 (0.0010) [2023-12-26 09:19:06,012][123090] Updated weights for policy 1, policy_version 1209563 (0.0010) [2023-12-26 09:19:06,544][123091] Updated weights for policy 0, policy_version 1218298 (0.0010) [2023-12-26 09:19:06,598][123091] Updated weights for policy 0, policy_version 1218308 (0.0009) [2023-12-26 09:19:06,653][123091] Updated weights for policy 0, policy_version 1218318 (0.0009) [2023-12-26 09:19:06,773][123090] Updated weights for policy 1, policy_version 1209573 (0.0009) [2023-12-26 09:19:06,834][123090] Updated weights for policy 1, policy_version 1209583 (0.0010) [2023-12-26 09:19:06,907][123090] Updated weights for policy 1, policy_version 1209593 (0.0009) [2023-12-26 09:19:07,576][123091] Updated weights for policy 0, policy_version 1218328 (0.0010) [2023-12-26 09:19:07,602][123090] Updated weights for policy 1, policy_version 1209603 (0.0008) [2023-12-26 09:19:07,634][123091] Updated weights for policy 0, policy_version 1218338 (0.0008) [2023-12-26 09:19:07,660][123090] Updated weights for policy 1, policy_version 1209613 (0.0007) [2023-12-26 09:19:07,692][123091] Updated weights for policy 0, policy_version 1218348 (0.0009) [2023-12-26 09:19:07,723][123090] Updated weights for policy 1, policy_version 1209623 (0.0007) [2023-12-26 09:19:08,400][123090] Updated weights for policy 1, policy_version 1209633 (0.0006) [2023-12-26 09:19:08,461][123090] Updated weights for policy 1, policy_version 1209643 (0.0009) [2023-12-26 09:19:08,520][123090] Updated weights for policy 1, policy_version 1209653 (0.0009) [2023-12-26 09:19:08,530][123091] Updated weights for policy 0, policy_version 1218358 (0.0009) [2023-12-26 09:19:08,573][123090] Updated weights for policy 1, policy_version 1209663 (0.0007) [2023-12-26 09:19:08,591][123091] Updated weights for policy 0, policy_version 1218368 (0.0009) [2023-12-26 09:19:08,648][123091] Updated weights for policy 0, policy_version 1218378 (0.0010) [2023-12-26 09:19:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 621584384. Throughput: 0: 9073.8, 1: 8817.3. Samples: 621555484. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:08,785][121949] Avg episode reward: [(0, '6266.942'), (1, '5732.996')] [2023-12-26 09:19:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001218384_311910400.pth... [2023-12-26 09:19:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001209664_309673984.pth... [2023-12-26 09:19:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001217360_311648256.pth [2023-12-26 09:19:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001208608_309403648.pth [2023-12-26 09:19:09,416][123090] Updated weights for policy 1, policy_version 1209673 (0.0009) [2023-12-26 09:19:09,483][123091] Updated weights for policy 0, policy_version 1218388 (0.0009) [2023-12-26 09:19:09,486][123090] Updated weights for policy 1, policy_version 1209683 (0.0008) [2023-12-26 09:19:09,547][123091] Updated weights for policy 0, policy_version 1218398 (0.0009) [2023-12-26 09:19:09,553][123090] Updated weights for policy 1, policy_version 1209693 (0.0006) [2023-12-26 09:19:09,616][123091] Updated weights for policy 0, policy_version 1218408 (0.0009) [2023-12-26 09:19:10,370][123090] Updated weights for policy 1, policy_version 1209703 (0.0009) [2023-12-26 09:19:10,394][123091] Updated weights for policy 0, policy_version 1218418 (0.0009) [2023-12-26 09:19:10,438][123090] Updated weights for policy 1, policy_version 1209713 (0.0011) [2023-12-26 09:19:10,452][123091] Updated weights for policy 0, policy_version 1218428 (0.0009) [2023-12-26 09:19:10,491][123090] Updated weights for policy 1, policy_version 1209723 (0.0010) [2023-12-26 09:19:10,506][123091] Updated weights for policy 0, policy_version 1218438 (0.0006) [2023-12-26 09:19:10,553][123091] Updated weights for policy 0, policy_version 1218448 (0.0008) [2023-12-26 09:19:11,252][123090] Updated weights for policy 1, policy_version 1209733 (0.0009) [2023-12-26 09:19:11,317][123091] Updated weights for policy 0, policy_version 1218458 (0.0008) [2023-12-26 09:19:11,327][123090] Updated weights for policy 1, policy_version 1209743 (0.0007) [2023-12-26 09:19:11,388][123091] Updated weights for policy 0, policy_version 1218468 (0.0009) [2023-12-26 09:19:11,400][123090] Updated weights for policy 1, policy_version 1209753 (0.0007) [2023-12-26 09:19:11,450][123091] Updated weights for policy 0, policy_version 1218478 (0.0006) [2023-12-26 09:19:12,174][123090] Updated weights for policy 1, policy_version 1209763 (0.0006) [2023-12-26 09:19:12,227][123091] Updated weights for policy 0, policy_version 1218488 (0.0009) [2023-12-26 09:19:12,241][123090] Updated weights for policy 1, policy_version 1209773 (0.0008) [2023-12-26 09:19:12,297][123091] Updated weights for policy 0, policy_version 1218498 (0.0009) [2023-12-26 09:19:12,310][123090] Updated weights for policy 1, policy_version 1209783 (0.0008) [2023-12-26 09:19:12,367][123091] Updated weights for policy 0, policy_version 1218508 (0.0009) [2023-12-26 09:19:13,103][123090] Updated weights for policy 1, policy_version 1209793 (0.0008) [2023-12-26 09:19:13,176][123090] Updated weights for policy 1, policy_version 1209803 (0.0006) [2023-12-26 09:19:13,179][123091] Updated weights for policy 0, policy_version 1218518 (0.0007) [2023-12-26 09:19:13,235][123090] Updated weights for policy 1, policy_version 1209813 (0.0006) [2023-12-26 09:19:13,238][123091] Updated weights for policy 0, policy_version 1218528 (0.0005) [2023-12-26 09:19:13,297][123090] Updated weights for policy 1, policy_version 1209823 (0.0005) [2023-12-26 09:19:13,302][123091] Updated weights for policy 0, policy_version 1218538 (0.0006) [2023-12-26 09:19:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 621666304. Throughput: 0: 8929.2, 1: 8807.2. Samples: 621660844. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:13,785][121949] Avg episode reward: [(0, '6323.914'), (1, '5709.754')] [2023-12-26 09:19:13,988][123090] Updated weights for policy 1, policy_version 1209833 (0.0005) [2023-12-26 09:19:14,048][123090] Updated weights for policy 1, policy_version 1209843 (0.0005) [2023-12-26 09:19:14,060][123091] Updated weights for policy 0, policy_version 1218548 (0.0009) [2023-12-26 09:19:14,108][123090] Updated weights for policy 1, policy_version 1209853 (0.0006) [2023-12-26 09:19:14,127][123091] Updated weights for policy 0, policy_version 1218558 (0.0009) [2023-12-26 09:19:14,192][123091] Updated weights for policy 0, policy_version 1218568 (0.0010) [2023-12-26 09:19:14,722][123090] Updated weights for policy 1, policy_version 1209863 (0.0006) [2023-12-26 09:19:14,780][123090] Updated weights for policy 1, policy_version 1209873 (0.0006) [2023-12-26 09:19:14,849][123090] Updated weights for policy 1, policy_version 1209883 (0.0006) [2023-12-26 09:19:15,055][123091] Updated weights for policy 0, policy_version 1218578 (0.0010) [2023-12-26 09:19:15,111][123091] Updated weights for policy 0, policy_version 1218588 (0.0008) [2023-12-26 09:19:15,182][123091] Updated weights for policy 0, policy_version 1218598 (0.0010) [2023-12-26 09:19:15,252][123091] Updated weights for policy 0, policy_version 1218608 (0.0008) [2023-12-26 09:19:15,638][123090] Updated weights for policy 1, policy_version 1209893 (0.0008) [2023-12-26 09:19:15,712][123090] Updated weights for policy 1, policy_version 1209903 (0.0008) [2023-12-26 09:19:15,779][123090] Updated weights for policy 1, policy_version 1209913 (0.0009) [2023-12-26 09:19:16,070][123091] Updated weights for policy 0, policy_version 1218618 (0.0005) [2023-12-26 09:19:16,122][123091] Updated weights for policy 0, policy_version 1218628 (0.0005) [2023-12-26 09:19:16,184][123091] Updated weights for policy 0, policy_version 1218638 (0.0008) [2023-12-26 09:19:16,621][123090] Updated weights for policy 1, policy_version 1209923 (0.0008) [2023-12-26 09:19:16,678][123090] Updated weights for policy 1, policy_version 1209933 (0.0005) [2023-12-26 09:19:16,729][123090] Updated weights for policy 1, policy_version 1209943 (0.0005) [2023-12-26 09:19:16,935][123091] Updated weights for policy 0, policy_version 1218648 (0.0006) [2023-12-26 09:19:16,993][123091] Updated weights for policy 0, policy_version 1218658 (0.0006) [2023-12-26 09:19:17,046][123091] Updated weights for policy 0, policy_version 1218668 (0.0010) [2023-12-26 09:19:17,436][123090] Updated weights for policy 1, policy_version 1209953 (0.0005) [2023-12-26 09:19:17,505][123090] Updated weights for policy 1, policy_version 1209963 (0.0005) [2023-12-26 09:19:17,577][123090] Updated weights for policy 1, policy_version 1209973 (0.0005) [2023-12-26 09:19:17,643][123090] Updated weights for policy 1, policy_version 1209983 (0.0005) [2023-12-26 09:19:17,798][123091] Updated weights for policy 0, policy_version 1218678 (0.0009) [2023-12-26 09:19:17,856][123091] Updated weights for policy 0, policy_version 1218688 (0.0010) [2023-12-26 09:19:17,909][123091] Updated weights for policy 0, policy_version 1218698 (0.0009) [2023-12-26 09:19:18,238][123090] Updated weights for policy 1, policy_version 1209993 (0.0007) [2023-12-26 09:19:18,289][123090] Updated weights for policy 1, policy_version 1210003 (0.0010) [2023-12-26 09:19:18,343][123090] Updated weights for policy 1, policy_version 1210013 (0.0009) [2023-12-26 09:19:18,747][123091] Updated weights for policy 0, policy_version 1218709 (0.0010) [2023-12-26 09:19:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 621756416. Throughput: 0: 8825.1, 1: 8947.0. Samples: 621770916. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:18,785][121949] Avg episode reward: [(0, '6201.782'), (1, '5603.117')] [2023-12-26 09:19:18,801][123091] Updated weights for policy 0, policy_version 1218720 (0.0011) [2023-12-26 09:19:18,853][123091] Updated weights for policy 0, policy_version 1218730 (0.0009) [2023-12-26 09:19:19,104][123090] Updated weights for policy 1, policy_version 1210023 (0.0007) [2023-12-26 09:19:19,158][123090] Updated weights for policy 1, policy_version 1210033 (0.0008) [2023-12-26 09:19:19,219][123090] Updated weights for policy 1, policy_version 1210043 (0.0006) [2023-12-26 09:19:19,772][123091] Updated weights for policy 0, policy_version 1218740 (0.0010) [2023-12-26 09:19:19,835][123091] Updated weights for policy 0, policy_version 1218750 (0.0009) [2023-12-26 09:19:19,905][123091] Updated weights for policy 0, policy_version 1218760 (0.0009) [2023-12-26 09:19:20,095][123090] Updated weights for policy 1, policy_version 1210053 (0.0008) [2023-12-26 09:19:20,162][123090] Updated weights for policy 1, policy_version 1210063 (0.0008) [2023-12-26 09:19:20,230][123090] Updated weights for policy 1, policy_version 1210073 (0.0008) [2023-12-26 09:19:20,781][123091] Updated weights for policy 0, policy_version 1218770 (0.0010) [2023-12-26 09:19:20,838][123091] Updated weights for policy 0, policy_version 1218780 (0.0010) [2023-12-26 09:19:20,897][123091] Updated weights for policy 0, policy_version 1218790 (0.0010) [2023-12-26 09:19:20,991][123090] Updated weights for policy 1, policy_version 1210083 (0.0009) [2023-12-26 09:19:21,066][123090] Updated weights for policy 1, policy_version 1210093 (0.0012) [2023-12-26 09:19:21,134][123090] Updated weights for policy 1, policy_version 1210103 (0.0008) [2023-12-26 09:19:21,805][123091] Updated weights for policy 0, policy_version 1218801 (0.0010) [2023-12-26 09:19:21,856][123091] Updated weights for policy 0, policy_version 1218811 (0.0009) [2023-12-26 09:19:21,907][123091] Updated weights for policy 0, policy_version 1218821 (0.0010) [2023-12-26 09:19:21,945][123090] Updated weights for policy 1, policy_version 1210113 (0.0007) [2023-12-26 09:19:21,964][123091] Updated weights for policy 0, policy_version 1218831 (0.0010) [2023-12-26 09:19:22,013][123090] Updated weights for policy 1, policy_version 1210123 (0.0008) [2023-12-26 09:19:22,081][123090] Updated weights for policy 1, policy_version 1210133 (0.0010) [2023-12-26 09:19:22,145][123090] Updated weights for policy 1, policy_version 1210143 (0.0009) [2023-12-26 09:19:22,852][123091] Updated weights for policy 0, policy_version 1218841 (0.0010) [2023-12-26 09:19:22,903][123091] Updated weights for policy 0, policy_version 1218851 (0.0009) [2023-12-26 09:19:22,955][123091] Updated weights for policy 0, policy_version 1218861 (0.0009) [2023-12-26 09:19:22,986][123090] Updated weights for policy 1, policy_version 1210153 (0.0008) [2023-12-26 09:19:23,055][123090] Updated weights for policy 1, policy_version 1210163 (0.0005) [2023-12-26 09:19:23,123][123090] Updated weights for policy 1, policy_version 1210173 (0.0006) [2023-12-26 09:19:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 621838336. Throughput: 0: 8763.1, 1: 8937.4. Samples: 621821704. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:23,785][121949] Avg episode reward: [(0, '6132.375'), (1, '5519.146')] [2023-12-26 09:19:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001210176_309805056.pth... [2023-12-26 09:19:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001209120_309534720.pth [2023-12-26 09:19:23,830][123091] Updated weights for policy 0, policy_version 1218871 (0.0009) [2023-12-26 09:19:23,885][123091] Updated weights for policy 0, policy_version 1218881 (0.0008) [2023-12-26 09:19:23,890][123090] Updated weights for policy 1, policy_version 1210183 (0.0007) [2023-12-26 09:19:23,931][123091] Updated weights for policy 0, policy_version 1218891 (0.0008) [2023-12-26 09:19:23,951][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001218896_312041472.pth... [2023-12-26 09:19:23,952][123090] Updated weights for policy 1, policy_version 1210193 (0.0008) [2023-12-26 09:19:23,954][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001217840_311771136.pth [2023-12-26 09:19:24,008][123090] Updated weights for policy 1, policy_version 1210203 (0.0009) [2023-12-26 09:19:24,793][123091] Updated weights for policy 0, policy_version 1218901 (0.0009) [2023-12-26 09:19:24,842][123091] Updated weights for policy 0, policy_version 1218911 (0.0010) [2023-12-26 09:19:24,847][123090] Updated weights for policy 1, policy_version 1210213 (0.0010) [2023-12-26 09:19:24,896][123091] Updated weights for policy 0, policy_version 1218921 (0.0008) [2023-12-26 09:19:24,900][123090] Updated weights for policy 1, policy_version 1210223 (0.0008) [2023-12-26 09:19:24,964][123090] Updated weights for policy 1, policy_version 1210233 (0.0009) [2023-12-26 09:19:25,735][123091] Updated weights for policy 0, policy_version 1218931 (0.0009) [2023-12-26 09:19:25,785][123090] Updated weights for policy 1, policy_version 1210243 (0.0009) [2023-12-26 09:19:25,803][123091] Updated weights for policy 0, policy_version 1218941 (0.0008) [2023-12-26 09:19:25,840][123090] Updated weights for policy 1, policy_version 1210253 (0.0010) [2023-12-26 09:19:25,869][123091] Updated weights for policy 0, policy_version 1218951 (0.0008) [2023-12-26 09:19:25,899][123090] Updated weights for policy 1, policy_version 1210263 (0.0010) [2023-12-26 09:19:26,529][123091] Updated weights for policy 0, policy_version 1218961 (0.0006) [2023-12-26 09:19:26,586][123091] Updated weights for policy 0, policy_version 1218971 (0.0005) [2023-12-26 09:19:26,641][123090] Updated weights for policy 1, policy_version 1210273 (0.0010) [2023-12-26 09:19:26,645][123091] Updated weights for policy 0, policy_version 1218981 (0.0005) [2023-12-26 09:19:26,692][123090] Updated weights for policy 1, policy_version 1210283 (0.0006) [2023-12-26 09:19:26,711][123091] Updated weights for policy 0, policy_version 1218991 (0.0005) [2023-12-26 09:19:26,763][123090] Updated weights for policy 1, policy_version 1210293 (0.0006) [2023-12-26 09:19:26,831][123090] Updated weights for policy 1, policy_version 1210303 (0.0006) [2023-12-26 09:19:27,368][123091] Updated weights for policy 0, policy_version 1219001 (0.0008) [2023-12-26 09:19:27,430][123091] Updated weights for policy 0, policy_version 1219011 (0.0010) [2023-12-26 09:19:27,487][123091] Updated weights for policy 0, policy_version 1219021 (0.0009) [2023-12-26 09:19:27,497][123090] Updated weights for policy 1, policy_version 1210313 (0.0008) [2023-12-26 09:19:27,551][123090] Updated weights for policy 1, policy_version 1210323 (0.0008) [2023-12-26 09:19:27,602][123090] Updated weights for policy 1, policy_version 1210333 (0.0010) [2023-12-26 09:19:28,326][123091] Updated weights for policy 0, policy_version 1219031 (0.0007) [2023-12-26 09:19:28,362][123090] Updated weights for policy 1, policy_version 1210343 (0.0009) [2023-12-26 09:19:28,384][123091] Updated weights for policy 0, policy_version 1219041 (0.0008) [2023-12-26 09:19:28,424][123090] Updated weights for policy 1, policy_version 1210353 (0.0008) [2023-12-26 09:19:28,449][123091] Updated weights for policy 0, policy_version 1219051 (0.0008) [2023-12-26 09:19:28,482][123090] Updated weights for policy 1, policy_version 1210363 (0.0008) [2023-12-26 09:19:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 621936640. Throughput: 0: 8796.2, 1: 8989.2. Samples: 621927492. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:28,785][121949] Avg episode reward: [(0, '6181.311'), (1, '5645.044')] [2023-12-26 09:19:29,237][123091] Updated weights for policy 0, policy_version 1219061 (0.0009) [2023-12-26 09:19:29,291][123090] Updated weights for policy 1, policy_version 1210373 (0.0008) [2023-12-26 09:19:29,300][123091] Updated weights for policy 0, policy_version 1219071 (0.0009) [2023-12-26 09:19:29,349][123090] Updated weights for policy 1, policy_version 1210383 (0.0008) [2023-12-26 09:19:29,374][123091] Updated weights for policy 0, policy_version 1219081 (0.0009) [2023-12-26 09:19:29,415][123090] Updated weights for policy 1, policy_version 1210393 (0.0008) [2023-12-26 09:19:30,073][123090] Updated weights for policy 1, policy_version 1210403 (0.0008) [2023-12-26 09:19:30,141][123090] Updated weights for policy 1, policy_version 1210413 (0.0011) [2023-12-26 09:19:30,197][123090] Updated weights for policy 1, policy_version 1210423 (0.0010) [2023-12-26 09:19:30,204][123091] Updated weights for policy 0, policy_version 1219091 (0.0008) [2023-12-26 09:19:30,272][123091] Updated weights for policy 0, policy_version 1219101 (0.0007) [2023-12-26 09:19:30,335][123091] Updated weights for policy 0, policy_version 1219111 (0.0009) [2023-12-26 09:19:30,933][123090] Updated weights for policy 1, policy_version 1210433 (0.0010) [2023-12-26 09:19:30,987][123090] Updated weights for policy 1, policy_version 1210443 (0.0005) [2023-12-26 09:19:31,001][123091] Updated weights for policy 0, policy_version 1219121 (0.0008) [2023-12-26 09:19:31,060][123090] Updated weights for policy 1, policy_version 1210453 (0.0007) [2023-12-26 09:19:31,070][123091] Updated weights for policy 0, policy_version 1219131 (0.0007) [2023-12-26 09:19:31,121][123090] Updated weights for policy 1, policy_version 1210463 (0.0009) [2023-12-26 09:19:31,138][123091] Updated weights for policy 0, policy_version 1219141 (0.0008) [2023-12-26 09:19:31,206][123091] Updated weights for policy 0, policy_version 1219151 (0.0009) [2023-12-26 09:19:31,943][123090] Updated weights for policy 1, policy_version 1210473 (0.0005) [2023-12-26 09:19:32,005][123090] Updated weights for policy 1, policy_version 1210483 (0.0005) [2023-12-26 09:19:32,066][123090] Updated weights for policy 1, policy_version 1210493 (0.0006) [2023-12-26 09:19:32,080][123091] Updated weights for policy 0, policy_version 1219161 (0.0009) [2023-12-26 09:19:32,147][123091] Updated weights for policy 0, policy_version 1219171 (0.0010) [2023-12-26 09:19:32,206][123091] Updated weights for policy 0, policy_version 1219181 (0.0009) [2023-12-26 09:19:32,826][123090] Updated weights for policy 1, policy_version 1210503 (0.0006) [2023-12-26 09:19:32,893][123090] Updated weights for policy 1, policy_version 1210513 (0.0005) [2023-12-26 09:19:32,952][123090] Updated weights for policy 1, policy_version 1210523 (0.0005) [2023-12-26 09:19:33,084][123091] Updated weights for policy 0, policy_version 1219191 (0.0009) [2023-12-26 09:19:33,137][123091] Updated weights for policy 0, policy_version 1219201 (0.0010) [2023-12-26 09:19:33,191][123091] Updated weights for policy 0, policy_version 1219211 (0.0010) [2023-12-26 09:19:33,622][123090] Updated weights for policy 1, policy_version 1210533 (0.0008) [2023-12-26 09:19:33,684][123090] Updated weights for policy 1, policy_version 1210543 (0.0008) [2023-12-26 09:19:33,737][123090] Updated weights for policy 1, policy_version 1210553 (0.0005) [2023-12-26 09:19:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 622026752. Throughput: 0: 8773.1, 1: 9042.2. Samples: 622036248. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:33,784][121949] Avg episode reward: [(0, '6117.639'), (1, '5825.641')] [2023-12-26 09:19:34,066][123091] Updated weights for policy 0, policy_version 1219221 (0.0007) [2023-12-26 09:19:34,132][123091] Updated weights for policy 0, policy_version 1219231 (0.0005) [2023-12-26 09:19:34,202][123091] Updated weights for policy 0, policy_version 1219241 (0.0008) [2023-12-26 09:19:34,428][123090] Updated weights for policy 1, policy_version 1210563 (0.0005) [2023-12-26 09:19:34,488][123090] Updated weights for policy 1, policy_version 1210573 (0.0006) [2023-12-26 09:19:34,549][123090] Updated weights for policy 1, policy_version 1210583 (0.0005) [2023-12-26 09:19:34,978][123091] Updated weights for policy 0, policy_version 1219251 (0.0008) [2023-12-26 09:19:35,037][123091] Updated weights for policy 0, policy_version 1219261 (0.0008) [2023-12-26 09:19:35,104][123091] Updated weights for policy 0, policy_version 1219271 (0.0006) [2023-12-26 09:19:35,307][123090] Updated weights for policy 1, policy_version 1210593 (0.0006) [2023-12-26 09:19:35,360][123090] Updated weights for policy 1, policy_version 1210603 (0.0009) [2023-12-26 09:19:35,417][123090] Updated weights for policy 1, policy_version 1210613 (0.0006) [2023-12-26 09:19:35,469][123090] Updated weights for policy 1, policy_version 1210623 (0.0005) [2023-12-26 09:19:35,886][123091] Updated weights for policy 0, policy_version 1219281 (0.0009) [2023-12-26 09:19:35,950][123091] Updated weights for policy 0, policy_version 1219291 (0.0009) [2023-12-26 09:19:36,010][123091] Updated weights for policy 0, policy_version 1219301 (0.0006) [2023-12-26 09:19:36,070][123091] Updated weights for policy 0, policy_version 1219311 (0.0006) [2023-12-26 09:19:36,212][123090] Updated weights for policy 1, policy_version 1210633 (0.0008) [2023-12-26 09:19:36,267][123090] Updated weights for policy 1, policy_version 1210643 (0.0008) [2023-12-26 09:19:36,328][123090] Updated weights for policy 1, policy_version 1210653 (0.0009) [2023-12-26 09:19:36,910][123091] Updated weights for policy 0, policy_version 1219321 (0.0011) [2023-12-26 09:19:36,984][123091] Updated weights for policy 0, policy_version 1219331 (0.0011) [2023-12-26 09:19:37,053][123091] Updated weights for policy 0, policy_version 1219341 (0.0011) [2023-12-26 09:19:37,199][123090] Updated weights for policy 1, policy_version 1210663 (0.0009) [2023-12-26 09:19:37,249][123090] Updated weights for policy 1, policy_version 1210673 (0.0009) [2023-12-26 09:19:37,299][123090] Updated weights for policy 1, policy_version 1210683 (0.0009) [2023-12-26 09:19:37,851][123091] Updated weights for policy 0, policy_version 1219351 (0.0011) [2023-12-26 09:19:37,914][123091] Updated weights for policy 0, policy_version 1219361 (0.0010) [2023-12-26 09:19:37,982][123091] Updated weights for policy 0, policy_version 1219371 (0.0011) [2023-12-26 09:19:38,199][123090] Updated weights for policy 1, policy_version 1210693 (0.0009) [2023-12-26 09:19:38,265][123090] Updated weights for policy 1, policy_version 1210703 (0.0008) [2023-12-26 09:19:38,330][123090] Updated weights for policy 1, policy_version 1210713 (0.0009) [2023-12-26 09:19:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 622108672. Throughput: 0: 8786.5, 1: 9098.6. Samples: 622090324. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:38,785][121949] Avg episode reward: [(0, '6151.983'), (1, '5768.165')] [2023-12-26 09:19:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001210720_309944320.pth... [2023-12-26 09:19:38,792][123091] Updated weights for policy 0, policy_version 1219381 (0.0011) [2023-12-26 09:19:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001209664_309673984.pth [2023-12-26 09:19:38,859][123091] Updated weights for policy 0, policy_version 1219391 (0.0011) [2023-12-26 09:19:38,903][123091] Updated weights for policy 0, policy_version 1219401 (0.0011) [2023-12-26 09:19:38,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001219408_312172544.pth... [2023-12-26 09:19:38,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001218384_311910400.pth [2023-12-26 09:19:39,180][123090] Updated weights for policy 1, policy_version 1210723 (0.0009) [2023-12-26 09:19:39,248][123090] Updated weights for policy 1, policy_version 1210733 (0.0009) [2023-12-26 09:19:39,321][123090] Updated weights for policy 1, policy_version 1210743 (0.0010) [2023-12-26 09:19:39,701][123091] Updated weights for policy 0, policy_version 1219411 (0.0010) [2023-12-26 09:19:39,768][123091] Updated weights for policy 0, policy_version 1219421 (0.0009) [2023-12-26 09:19:39,833][123091] Updated weights for policy 0, policy_version 1219431 (0.0009) [2023-12-26 09:19:40,180][123090] Updated weights for policy 1, policy_version 1210753 (0.0010) [2023-12-26 09:19:40,237][123090] Updated weights for policy 1, policy_version 1210763 (0.0009) [2023-12-26 09:19:40,299][123090] Updated weights for policy 1, policy_version 1210773 (0.0008) [2023-12-26 09:19:40,363][123090] Updated weights for policy 1, policy_version 1210783 (0.0008) [2023-12-26 09:19:40,659][123091] Updated weights for policy 0, policy_version 1219441 (0.0010) [2023-12-26 09:19:40,720][123091] Updated weights for policy 0, policy_version 1219451 (0.0009) [2023-12-26 09:19:40,782][123091] Updated weights for policy 0, policy_version 1219461 (0.0010) [2023-12-26 09:19:40,849][123091] Updated weights for policy 0, policy_version 1219471 (0.0010) [2023-12-26 09:19:41,153][123090] Updated weights for policy 1, policy_version 1210793 (0.0007) [2023-12-26 09:19:41,252][123090] Updated weights for policy 1, policy_version 1210803 (0.0009) [2023-12-26 09:19:41,313][123090] Updated weights for policy 1, policy_version 1210813 (0.0010) [2023-12-26 09:19:41,710][123091] Updated weights for policy 0, policy_version 1219481 (0.0008) [2023-12-26 09:19:41,781][123091] Updated weights for policy 0, policy_version 1219491 (0.0008) [2023-12-26 09:19:41,854][123091] Updated weights for policy 0, policy_version 1219501 (0.0007) [2023-12-26 09:19:42,105][123090] Updated weights for policy 1, policy_version 1210823 (0.0010) [2023-12-26 09:19:42,174][123090] Updated weights for policy 1, policy_version 1210833 (0.0011) [2023-12-26 09:19:42,244][123090] Updated weights for policy 1, policy_version 1210843 (0.0011) [2023-12-26 09:19:42,641][123091] Updated weights for policy 0, policy_version 1219511 (0.0008) [2023-12-26 09:19:42,709][123091] Updated weights for policy 0, policy_version 1219521 (0.0009) [2023-12-26 09:19:42,765][123091] Updated weights for policy 0, policy_version 1219531 (0.0008) [2023-12-26 09:19:43,082][123090] Updated weights for policy 1, policy_version 1210853 (0.0010) [2023-12-26 09:19:43,140][123090] Updated weights for policy 1, policy_version 1210863 (0.0009) [2023-12-26 09:19:43,189][123090] Updated weights for policy 1, policy_version 1210873 (0.0009) [2023-12-26 09:19:43,618][123091] Updated weights for policy 0, policy_version 1219541 (0.0009) [2023-12-26 09:19:43,689][123091] Updated weights for policy 0, policy_version 1219551 (0.0009) [2023-12-26 09:19:43,748][123091] Updated weights for policy 0, policy_version 1219561 (0.0009) [2023-12-26 09:19:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 622198784. Throughput: 0: 8769.8, 1: 8947.4. Samples: 622191364. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:43,784][121949] Avg episode reward: [(0, '6175.073'), (1, '5864.643')] [2023-12-26 09:19:43,949][123090] Updated weights for policy 1, policy_version 1210883 (0.0008) [2023-12-26 09:19:44,002][123090] Updated weights for policy 1, policy_version 1210893 (0.0005) [2023-12-26 09:19:44,052][123090] Updated weights for policy 1, policy_version 1210903 (0.0006) [2023-12-26 09:19:44,484][123091] Updated weights for policy 0, policy_version 1219571 (0.0008) [2023-12-26 09:19:44,546][123091] Updated weights for policy 0, policy_version 1219581 (0.0009) [2023-12-26 09:19:44,599][123091] Updated weights for policy 0, policy_version 1219592 (0.0010) [2023-12-26 09:19:44,770][123090] Updated weights for policy 1, policy_version 1210913 (0.0006) [2023-12-26 09:19:44,835][123090] Updated weights for policy 1, policy_version 1210923 (0.0008) [2023-12-26 09:19:44,901][123090] Updated weights for policy 1, policy_version 1210933 (0.0006) [2023-12-26 09:19:44,969][123090] Updated weights for policy 1, policy_version 1210943 (0.0011) [2023-12-26 09:19:45,358][123091] Updated weights for policy 0, policy_version 1219602 (0.0008) [2023-12-26 09:19:45,427][123091] Updated weights for policy 0, policy_version 1219612 (0.0006) [2023-12-26 09:19:45,499][123091] Updated weights for policy 0, policy_version 1219622 (0.0007) [2023-12-26 09:19:45,569][123091] Updated weights for policy 0, policy_version 1219632 (0.0008) [2023-12-26 09:19:45,718][123090] Updated weights for policy 1, policy_version 1210953 (0.0010) [2023-12-26 09:19:45,773][123090] Updated weights for policy 1, policy_version 1210963 (0.0008) [2023-12-26 09:19:45,827][123090] Updated weights for policy 1, policy_version 1210973 (0.0005) [2023-12-26 09:19:46,323][123091] Updated weights for policy 0, policy_version 1219642 (0.0006) [2023-12-26 09:19:46,387][123091] Updated weights for policy 0, policy_version 1219652 (0.0005) [2023-12-26 09:19:46,452][123091] Updated weights for policy 0, policy_version 1219662 (0.0007) [2023-12-26 09:19:46,508][123090] Updated weights for policy 1, policy_version 1210983 (0.0005) [2023-12-26 09:19:46,566][123090] Updated weights for policy 1, policy_version 1210993 (0.0005) [2023-12-26 09:19:46,623][123090] Updated weights for policy 1, policy_version 1211003 (0.0005) [2023-12-26 09:19:47,148][123091] Updated weights for policy 0, policy_version 1219672 (0.0006) [2023-12-26 09:19:47,210][123091] Updated weights for policy 0, policy_version 1219682 (0.0005) [2023-12-26 09:19:47,264][123091] Updated weights for policy 0, policy_version 1219692 (0.0005) [2023-12-26 09:19:47,441][123090] Updated weights for policy 1, policy_version 1211013 (0.0005) [2023-12-26 09:19:47,500][123090] Updated weights for policy 1, policy_version 1211023 (0.0005) [2023-12-26 09:19:47,575][123090] Updated weights for policy 1, policy_version 1211033 (0.0005) [2023-12-26 09:19:47,834][123091] Updated weights for policy 0, policy_version 1219702 (0.0006) [2023-12-26 09:19:47,907][123091] Updated weights for policy 0, policy_version 1219712 (0.0005) [2023-12-26 09:19:47,974][123091] Updated weights for policy 0, policy_version 1219722 (0.0005) [2023-12-26 09:19:48,369][123090] Updated weights for policy 1, policy_version 1211043 (0.0007) [2023-12-26 09:19:48,425][123090] Updated weights for policy 1, policy_version 1211053 (0.0010) [2023-12-26 09:19:48,484][123090] Updated weights for policy 1, policy_version 1211063 (0.0011) [2023-12-26 09:19:48,581][123091] Updated weights for policy 0, policy_version 1219732 (0.0006) [2023-12-26 09:19:48,633][123091] Updated weights for policy 0, policy_version 1219742 (0.0010) [2023-12-26 09:19:48,682][123091] Updated weights for policy 0, policy_version 1219752 (0.0010) [2023-12-26 09:19:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 622297088. Throughput: 0: 8771.1, 1: 9051.5. Samples: 622304044. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:48,785][121949] Avg episode reward: [(0, '6094.389'), (1, '5751.776')] [2023-12-26 09:19:49,260][123090] Updated weights for policy 1, policy_version 1211073 (0.0010) [2023-12-26 09:19:49,329][123090] Updated weights for policy 1, policy_version 1211083 (0.0010) [2023-12-26 09:19:49,399][123090] Updated weights for policy 1, policy_version 1211093 (0.0009) [2023-12-26 09:19:49,461][123090] Updated weights for policy 1, policy_version 1211103 (0.0009) [2023-12-26 09:19:49,546][123091] Updated weights for policy 0, policy_version 1219762 (0.0011) [2023-12-26 09:19:49,609][123091] Updated weights for policy 0, policy_version 1219772 (0.0010) [2023-12-26 09:19:49,668][123091] Updated weights for policy 0, policy_version 1219782 (0.0008) [2023-12-26 09:19:49,725][123091] Updated weights for policy 0, policy_version 1219792 (0.0011) [2023-12-26 09:19:50,324][123090] Updated weights for policy 1, policy_version 1211113 (0.0010) [2023-12-26 09:19:50,382][123090] Updated weights for policy 1, policy_version 1211123 (0.0010) [2023-12-26 09:19:50,446][123090] Updated weights for policy 1, policy_version 1211133 (0.0009) [2023-12-26 09:19:50,591][123091] Updated weights for policy 0, policy_version 1219802 (0.0010) [2023-12-26 09:19:50,660][123091] Updated weights for policy 0, policy_version 1219812 (0.0010) [2023-12-26 09:19:50,727][123091] Updated weights for policy 0, policy_version 1219822 (0.0009) [2023-12-26 09:19:51,246][123090] Updated weights for policy 1, policy_version 1211143 (0.0010) [2023-12-26 09:19:51,302][123090] Updated weights for policy 1, policy_version 1211153 (0.0010) [2023-12-26 09:19:51,364][123090] Updated weights for policy 1, policy_version 1211163 (0.0010) [2023-12-26 09:19:51,592][123091] Updated weights for policy 0, policy_version 1219832 (0.0009) [2023-12-26 09:19:51,666][123091] Updated weights for policy 0, policy_version 1219842 (0.0008) [2023-12-26 09:19:51,730][123091] Updated weights for policy 0, policy_version 1219852 (0.0008) [2023-12-26 09:19:52,120][123090] Updated weights for policy 1, policy_version 1211173 (0.0009) [2023-12-26 09:19:52,199][123090] Updated weights for policy 1, policy_version 1211183 (0.0005) [2023-12-26 09:19:52,268][123090] Updated weights for policy 1, policy_version 1211193 (0.0007) [2023-12-26 09:19:52,529][123091] Updated weights for policy 0, policy_version 1219862 (0.0009) [2023-12-26 09:19:52,584][123091] Updated weights for policy 0, policy_version 1219873 (0.0010) [2023-12-26 09:19:52,637][123091] Updated weights for policy 0, policy_version 1219883 (0.0009) [2023-12-26 09:19:52,926][123090] Updated weights for policy 1, policy_version 1211203 (0.0009) [2023-12-26 09:19:52,980][123090] Updated weights for policy 1, policy_version 1211213 (0.0005) [2023-12-26 09:19:53,037][123090] Updated weights for policy 1, policy_version 1211223 (0.0005) [2023-12-26 09:19:53,503][123091] Updated weights for policy 0, policy_version 1219893 (0.0009) [2023-12-26 09:19:53,572][123091] Updated weights for policy 0, policy_version 1219903 (0.0008) [2023-12-26 09:19:53,632][123091] Updated weights for policy 0, policy_version 1219913 (0.0008) [2023-12-26 09:19:53,727][123090] Updated weights for policy 1, policy_version 1211233 (0.0005) [2023-12-26 09:19:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 622379008. Throughput: 0: 8732.7, 1: 9021.1. Samples: 622354404. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:53,785][121949] Avg episode reward: [(0, '6166.979'), (1, '5604.583')] [2023-12-26 09:19:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001219920_312303616.pth... [2023-12-26 09:19:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001218896_312041472.pth [2023-12-26 09:19:53,795][123090] Updated weights for policy 1, policy_version 1211243 (0.0006) [2023-12-26 09:19:53,861][123090] Updated weights for policy 1, policy_version 1211253 (0.0005) [2023-12-26 09:19:53,928][123090] Updated weights for policy 1, policy_version 1211263 (0.0005) [2023-12-26 09:19:53,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001211264_310083584.pth... [2023-12-26 09:19:53,940][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001210176_309805056.pth [2023-12-26 09:19:54,391][123091] Updated weights for policy 0, policy_version 1219923 (0.0008) [2023-12-26 09:19:54,447][123091] Updated weights for policy 0, policy_version 1219933 (0.0009) [2023-12-26 09:19:54,509][123091] Updated weights for policy 0, policy_version 1219943 (0.0009) [2023-12-26 09:19:54,575][123090] Updated weights for policy 1, policy_version 1211273 (0.0008) [2023-12-26 09:19:54,633][123090] Updated weights for policy 1, policy_version 1211283 (0.0009) [2023-12-26 09:19:54,693][123090] Updated weights for policy 1, policy_version 1211293 (0.0008) [2023-12-26 09:19:55,311][123091] Updated weights for policy 0, policy_version 1219953 (0.0009) [2023-12-26 09:19:55,363][123091] Updated weights for policy 0, policy_version 1219963 (0.0005) [2023-12-26 09:19:55,422][123091] Updated weights for policy 0, policy_version 1219973 (0.0008) [2023-12-26 09:19:55,472][123091] Updated weights for policy 0, policy_version 1219983 (0.0008) [2023-12-26 09:19:55,576][123090] Updated weights for policy 1, policy_version 1211303 (0.0007) [2023-12-26 09:19:55,653][123090] Updated weights for policy 1, policy_version 1211313 (0.0005) [2023-12-26 09:19:55,732][123090] Updated weights for policy 1, policy_version 1211323 (0.0005) [2023-12-26 09:19:56,150][123091] Updated weights for policy 0, policy_version 1219993 (0.0006) [2023-12-26 09:19:56,216][123091] Updated weights for policy 0, policy_version 1220003 (0.0005) [2023-12-26 09:19:56,290][123091] Updated weights for policy 0, policy_version 1220013 (0.0005) [2023-12-26 09:19:56,396][123090] Updated weights for policy 1, policy_version 1211333 (0.0005) [2023-12-26 09:19:56,464][123090] Updated weights for policy 1, policy_version 1211343 (0.0006) [2023-12-26 09:19:56,530][123090] Updated weights for policy 1, policy_version 1211353 (0.0006) [2023-12-26 09:19:56,862][123091] Updated weights for policy 0, policy_version 1220023 (0.0006) [2023-12-26 09:19:56,912][123091] Updated weights for policy 0, policy_version 1220033 (0.0005) [2023-12-26 09:19:56,961][123091] Updated weights for policy 0, policy_version 1220043 (0.0005) [2023-12-26 09:19:57,127][123090] Updated weights for policy 1, policy_version 1211363 (0.0005) [2023-12-26 09:19:57,177][123090] Updated weights for policy 1, policy_version 1211373 (0.0005) [2023-12-26 09:19:57,239][123090] Updated weights for policy 1, policy_version 1211383 (0.0005) [2023-12-26 09:19:57,643][123091] Updated weights for policy 0, policy_version 1220053 (0.0005) [2023-12-26 09:19:57,689][123091] Updated weights for policy 0, policy_version 1220063 (0.0005) [2023-12-26 09:19:57,742][123091] Updated weights for policy 0, policy_version 1220073 (0.0006) [2023-12-26 09:19:57,888][123090] Updated weights for policy 1, policy_version 1211393 (0.0005) [2023-12-26 09:19:57,951][123090] Updated weights for policy 1, policy_version 1211403 (0.0006) [2023-12-26 09:19:58,010][123090] Updated weights for policy 1, policy_version 1211413 (0.0008) [2023-12-26 09:19:58,073][123090] Updated weights for policy 1, policy_version 1211423 (0.0009) [2023-12-26 09:19:58,560][123091] Updated weights for policy 0, policy_version 1220083 (0.0007) [2023-12-26 09:19:58,635][123091] Updated weights for policy 0, policy_version 1220093 (0.0010) [2023-12-26 09:19:58,707][123091] Updated weights for policy 0, policy_version 1220103 (0.0009) [2023-12-26 09:19:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 622477312. Throughput: 0: 8835.5, 1: 9154.2. Samples: 622470380. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:19:58,785][121949] Avg episode reward: [(0, '6190.476'), (1, '5750.901')] [2023-12-26 09:19:58,961][123090] Updated weights for policy 1, policy_version 1211433 (0.0009) [2023-12-26 09:19:59,025][123090] Updated weights for policy 1, policy_version 1211443 (0.0009) [2023-12-26 09:19:59,092][123090] Updated weights for policy 1, policy_version 1211453 (0.0009) [2023-12-26 09:19:59,639][123091] Updated weights for policy 0, policy_version 1220113 (0.0009) [2023-12-26 09:19:59,690][123091] Updated weights for policy 0, policy_version 1220123 (0.0007) [2023-12-26 09:19:59,744][123091] Updated weights for policy 0, policy_version 1220133 (0.0006) [2023-12-26 09:19:59,796][123091] Updated weights for policy 0, policy_version 1220143 (0.0005) [2023-12-26 09:19:59,904][123090] Updated weights for policy 1, policy_version 1211463 (0.0009) [2023-12-26 09:19:59,971][123090] Updated weights for policy 1, policy_version 1211473 (0.0009) [2023-12-26 09:20:00,036][123090] Updated weights for policy 1, policy_version 1211483 (0.0010) [2023-12-26 09:20:00,545][123091] Updated weights for policy 0, policy_version 1220153 (0.0010) [2023-12-26 09:20:00,592][123091] Updated weights for policy 0, policy_version 1220163 (0.0010) [2023-12-26 09:20:00,651][123091] Updated weights for policy 0, policy_version 1220173 (0.0010) [2023-12-26 09:20:00,915][123090] Updated weights for policy 1, policy_version 1211493 (0.0009) [2023-12-26 09:20:00,972][123090] Updated weights for policy 1, policy_version 1211503 (0.0010) [2023-12-26 09:20:01,027][123090] Updated weights for policy 1, policy_version 1211513 (0.0008) [2023-12-26 09:20:01,495][123091] Updated weights for policy 0, policy_version 1220183 (0.0010) [2023-12-26 09:20:01,556][123091] Updated weights for policy 0, policy_version 1220193 (0.0009) [2023-12-26 09:20:01,623][123091] Updated weights for policy 0, policy_version 1220203 (0.0009) [2023-12-26 09:20:01,931][123090] Updated weights for policy 1, policy_version 1211523 (0.0010) [2023-12-26 09:20:01,993][123090] Updated weights for policy 1, policy_version 1211533 (0.0010) [2023-12-26 09:20:02,045][123090] Updated weights for policy 1, policy_version 1211544 (0.0010) [2023-12-26 09:20:02,291][123091] Updated weights for policy 0, policy_version 1220213 (0.0009) [2023-12-26 09:20:02,361][123091] Updated weights for policy 0, policy_version 1220223 (0.0013) [2023-12-26 09:20:02,416][123091] Updated weights for policy 0, policy_version 1220233 (0.0010) [2023-12-26 09:20:02,816][123090] Updated weights for policy 1, policy_version 1211554 (0.0009) [2023-12-26 09:20:02,889][123090] Updated weights for policy 1, policy_version 1211564 (0.0006) [2023-12-26 09:20:02,956][123090] Updated weights for policy 1, policy_version 1211574 (0.0009) [2023-12-26 09:20:03,023][123090] Updated weights for policy 1, policy_version 1211584 (0.0008) [2023-12-26 09:20:03,108][123091] Updated weights for policy 0, policy_version 1220243 (0.0009) [2023-12-26 09:20:03,183][123091] Updated weights for policy 0, policy_version 1220253 (0.0005) [2023-12-26 09:20:03,255][123091] Updated weights for policy 0, policy_version 1220263 (0.0005) [2023-12-26 09:20:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 622559232. Throughput: 0: 8874.6, 1: 9015.5. Samples: 622575976. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:03,785][121949] Avg episode reward: [(0, '6243.225'), (1, '5789.921')] [2023-12-26 09:20:03,843][123091] Updated weights for policy 0, policy_version 1220273 (0.0006) [2023-12-26 09:20:03,870][123090] Updated weights for policy 1, policy_version 1211594 (0.0008) [2023-12-26 09:20:03,912][123091] Updated weights for policy 0, policy_version 1220284 (0.0007) [2023-12-26 09:20:03,925][123090] Updated weights for policy 1, policy_version 1211604 (0.0008) [2023-12-26 09:20:03,975][123091] Updated weights for policy 0, policy_version 1220294 (0.0009) [2023-12-26 09:20:03,981][123090] Updated weights for policy 1, policy_version 1211614 (0.0006) [2023-12-26 09:20:04,042][123091] Updated weights for policy 0, policy_version 1220304 (0.0007) [2023-12-26 09:20:04,722][123090] Updated weights for policy 1, policy_version 1211624 (0.0006) [2023-12-26 09:20:04,769][123090] Updated weights for policy 1, policy_version 1211634 (0.0005) [2023-12-26 09:20:04,834][123090] Updated weights for policy 1, policy_version 1211644 (0.0007) [2023-12-26 09:20:04,927][123091] Updated weights for policy 0, policy_version 1220314 (0.0010) [2023-12-26 09:20:04,998][123091] Updated weights for policy 0, policy_version 1220324 (0.0010) [2023-12-26 09:20:05,055][123091] Updated weights for policy 0, policy_version 1220334 (0.0009) [2023-12-26 09:20:05,496][123090] Updated weights for policy 1, policy_version 1211654 (0.0005) [2023-12-26 09:20:05,550][123090] Updated weights for policy 1, policy_version 1211664 (0.0005) [2023-12-26 09:20:05,615][123090] Updated weights for policy 1, policy_version 1211674 (0.0006) [2023-12-26 09:20:05,912][123091] Updated weights for policy 0, policy_version 1220344 (0.0008) [2023-12-26 09:20:05,963][123091] Updated weights for policy 0, policy_version 1220354 (0.0009) [2023-12-26 09:20:06,026][123091] Updated weights for policy 0, policy_version 1220364 (0.0010) [2023-12-26 09:20:06,360][123090] Updated weights for policy 1, policy_version 1211684 (0.0010) [2023-12-26 09:20:06,426][123090] Updated weights for policy 1, policy_version 1211694 (0.0010) [2023-12-26 09:20:06,492][123090] Updated weights for policy 1, policy_version 1211704 (0.0009) [2023-12-26 09:20:06,907][123091] Updated weights for policy 0, policy_version 1220374 (0.0007) [2023-12-26 09:20:06,970][123091] Updated weights for policy 0, policy_version 1220384 (0.0009) [2023-12-26 09:20:07,037][123091] Updated weights for policy 0, policy_version 1220394 (0.0009) [2023-12-26 09:20:07,327][123090] Updated weights for policy 1, policy_version 1211714 (0.0010) [2023-12-26 09:20:07,388][123090] Updated weights for policy 1, policy_version 1211724 (0.0009) [2023-12-26 09:20:07,450][123090] Updated weights for policy 1, policy_version 1211734 (0.0010) [2023-12-26 09:20:07,503][123090] Updated weights for policy 1, policy_version 1211744 (0.0009) [2023-12-26 09:20:07,858][123091] Updated weights for policy 0, policy_version 1220404 (0.0009) [2023-12-26 09:20:07,920][123091] Updated weights for policy 0, policy_version 1220414 (0.0009) [2023-12-26 09:20:07,975][123091] Updated weights for policy 0, policy_version 1220424 (0.0009) [2023-12-26 09:20:08,319][123090] Updated weights for policy 1, policy_version 1211754 (0.0009) [2023-12-26 09:20:08,386][123090] Updated weights for policy 1, policy_version 1211764 (0.0010) [2023-12-26 09:20:08,453][123090] Updated weights for policy 1, policy_version 1211774 (0.0010) [2023-12-26 09:20:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 622649344. Throughput: 0: 8901.7, 1: 9020.8. Samples: 622628216. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:08,785][121949] Avg episode reward: [(0, '6333.264'), (1, '5823.115')] [2023-12-26 09:20:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001211776_310214656.pth... [2023-12-26 09:20:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001210720_309944320.pth [2023-12-26 09:20:08,809][123091] Updated weights for policy 0, policy_version 1220434 (0.0010) [2023-12-26 09:20:08,863][123091] Updated weights for policy 0, policy_version 1220444 (0.0010) [2023-12-26 09:20:08,917][123091] Updated weights for policy 0, policy_version 1220454 (0.0009) [2023-12-26 09:20:08,963][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001220464_312442880.pth... [2023-12-26 09:20:08,965][123091] Updated weights for policy 0, policy_version 1220464 (0.0009) [2023-12-26 09:20:08,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001219408_312172544.pth [2023-12-26 09:20:09,252][123090] Updated weights for policy 1, policy_version 1211784 (0.0009) [2023-12-26 09:20:09,316][123090] Updated weights for policy 1, policy_version 1211794 (0.0006) [2023-12-26 09:20:09,391][123090] Updated weights for policy 1, policy_version 1211804 (0.0009) [2023-12-26 09:20:09,882][123091] Updated weights for policy 0, policy_version 1220474 (0.0010) [2023-12-26 09:20:09,949][123091] Updated weights for policy 0, policy_version 1220484 (0.0009) [2023-12-26 09:20:10,020][123091] Updated weights for policy 0, policy_version 1220494 (0.0010) [2023-12-26 09:20:10,251][123090] Updated weights for policy 1, policy_version 1211814 (0.0008) [2023-12-26 09:20:10,303][123090] Updated weights for policy 1, policy_version 1211824 (0.0008) [2023-12-26 09:20:10,362][123090] Updated weights for policy 1, policy_version 1211834 (0.0008) [2023-12-26 09:20:10,876][123091] Updated weights for policy 0, policy_version 1220504 (0.0010) [2023-12-26 09:20:10,923][123091] Updated weights for policy 0, policy_version 1220514 (0.0008) [2023-12-26 09:20:10,974][123091] Updated weights for policy 0, policy_version 1220524 (0.0009) [2023-12-26 09:20:11,126][123090] Updated weights for policy 1, policy_version 1211844 (0.0010) [2023-12-26 09:20:11,201][123090] Updated weights for policy 1, policy_version 1211854 (0.0008) [2023-12-26 09:20:11,275][123090] Updated weights for policy 1, policy_version 1211864 (0.0008) [2023-12-26 09:20:11,841][123091] Updated weights for policy 0, policy_version 1220534 (0.0008) [2023-12-26 09:20:11,916][123091] Updated weights for policy 0, policy_version 1220544 (0.0006) [2023-12-26 09:20:11,989][123091] Updated weights for policy 0, policy_version 1220554 (0.0006) [2023-12-26 09:20:12,106][123090] Updated weights for policy 1, policy_version 1211874 (0.0008) [2023-12-26 09:20:12,162][123090] Updated weights for policy 1, policy_version 1211884 (0.0005) [2023-12-26 09:20:12,229][123090] Updated weights for policy 1, policy_version 1211894 (0.0005) [2023-12-26 09:20:12,306][123090] Updated weights for policy 1, policy_version 1211904 (0.0006) [2023-12-26 09:20:12,710][123091] Updated weights for policy 0, policy_version 1220564 (0.0008) [2023-12-26 09:20:12,766][123091] Updated weights for policy 0, policy_version 1220574 (0.0007) [2023-12-26 09:20:12,842][123091] Updated weights for policy 0, policy_version 1220584 (0.0007) [2023-12-26 09:20:13,061][123090] Updated weights for policy 1, policy_version 1211914 (0.0007) [2023-12-26 09:20:13,131][123090] Updated weights for policy 1, policy_version 1211924 (0.0008) [2023-12-26 09:20:13,191][123090] Updated weights for policy 1, policy_version 1211934 (0.0009) [2023-12-26 09:20:13,573][123091] Updated weights for policy 0, policy_version 1220594 (0.0006) [2023-12-26 09:20:13,634][123091] Updated weights for policy 0, policy_version 1220604 (0.0006) [2023-12-26 09:20:13,689][123091] Updated weights for policy 0, policy_version 1220614 (0.0010) [2023-12-26 09:20:13,741][123091] Updated weights for policy 0, policy_version 1220624 (0.0010) [2023-12-26 09:20:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 622739456. Throughput: 0: 8847.9, 1: 8999.2. Samples: 622730612. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:13,785][121949] Avg episode reward: [(0, '6311.611'), (1, '5875.000')] [2023-12-26 09:20:13,978][123090] Updated weights for policy 1, policy_version 1211944 (0.0006) [2023-12-26 09:20:14,029][123090] Updated weights for policy 1, policy_version 1211954 (0.0008) [2023-12-26 09:20:14,074][123090] Updated weights for policy 1, policy_version 1211964 (0.0010) [2023-12-26 09:20:14,537][123091] Updated weights for policy 0, policy_version 1220634 (0.0006) [2023-12-26 09:20:14,604][123091] Updated weights for policy 0, policy_version 1220644 (0.0005) [2023-12-26 09:20:14,674][123091] Updated weights for policy 0, policy_version 1220654 (0.0007) [2023-12-26 09:20:14,923][123090] Updated weights for policy 1, policy_version 1211974 (0.0010) [2023-12-26 09:20:14,984][123090] Updated weights for policy 1, policy_version 1211984 (0.0011) [2023-12-26 09:20:15,044][123090] Updated weights for policy 1, policy_version 1211994 (0.0010) [2023-12-26 09:20:15,496][123091] Updated weights for policy 0, policy_version 1220664 (0.0010) [2023-12-26 09:20:15,562][123091] Updated weights for policy 0, policy_version 1220674 (0.0007) [2023-12-26 09:20:15,631][123091] Updated weights for policy 0, policy_version 1220684 (0.0005) [2023-12-26 09:20:15,895][123090] Updated weights for policy 1, policy_version 1212004 (0.0008) [2023-12-26 09:20:15,958][123090] Updated weights for policy 1, policy_version 1212014 (0.0008) [2023-12-26 09:20:16,029][123090] Updated weights for policy 1, policy_version 1212024 (0.0010) [2023-12-26 09:20:16,282][123091] Updated weights for policy 0, policy_version 1220694 (0.0008) [2023-12-26 09:20:16,341][123091] Updated weights for policy 0, policy_version 1220704 (0.0010) [2023-12-26 09:20:16,419][123091] Updated weights for policy 0, policy_version 1220714 (0.0011) [2023-12-26 09:20:16,757][123090] Updated weights for policy 1, policy_version 1212034 (0.0010) [2023-12-26 09:20:16,811][123090] Updated weights for policy 1, policy_version 1212044 (0.0010) [2023-12-26 09:20:16,865][123090] Updated weights for policy 1, policy_version 1212054 (0.0010) [2023-12-26 09:20:16,918][123090] Updated weights for policy 1, policy_version 1212064 (0.0010) [2023-12-26 09:20:17,147][123091] Updated weights for policy 0, policy_version 1220724 (0.0008) [2023-12-26 09:20:17,201][123091] Updated weights for policy 0, policy_version 1220734 (0.0005) [2023-12-26 09:20:17,260][123091] Updated weights for policy 0, policy_version 1220744 (0.0007) [2023-12-26 09:20:17,734][123090] Updated weights for policy 1, policy_version 1212074 (0.0010) [2023-12-26 09:20:17,795][123090] Updated weights for policy 1, policy_version 1212084 (0.0009) [2023-12-26 09:20:17,849][123090] Updated weights for policy 1, policy_version 1212095 (0.0009) [2023-12-26 09:20:18,005][123091] Updated weights for policy 0, policy_version 1220754 (0.0010) [2023-12-26 09:20:18,052][123091] Updated weights for policy 0, policy_version 1220764 (0.0009) [2023-12-26 09:20:18,114][123091] Updated weights for policy 0, policy_version 1220774 (0.0008) [2023-12-26 09:20:18,181][123091] Updated weights for policy 0, policy_version 1220784 (0.0008) [2023-12-26 09:20:18,743][123090] Updated weights for policy 1, policy_version 1212105 (0.0006) [2023-12-26 09:20:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 622821376. Throughput: 0: 8932.6, 1: 8903.6. Samples: 622838880. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:18,785][121949] Avg episode reward: [(0, '6140.989'), (1, '5906.221')] [2023-12-26 09:20:18,814][123090] Updated weights for policy 1, policy_version 1212115 (0.0005) [2023-12-26 09:20:18,874][123091] Updated weights for policy 0, policy_version 1220794 (0.0011) [2023-12-26 09:20:18,881][123090] Updated weights for policy 1, policy_version 1212125 (0.0006) [2023-12-26 09:20:18,931][123091] Updated weights for policy 0, policy_version 1220804 (0.0011) [2023-12-26 09:20:18,998][123091] Updated weights for policy 0, policy_version 1220814 (0.0011) [2023-12-26 09:20:19,649][123090] Updated weights for policy 1, policy_version 1212135 (0.0009) [2023-12-26 09:20:19,719][123090] Updated weights for policy 1, policy_version 1212145 (0.0009) [2023-12-26 09:20:19,790][123090] Updated weights for policy 1, policy_version 1212155 (0.0009) [2023-12-26 09:20:19,811][123091] Updated weights for policy 0, policy_version 1220824 (0.0008) [2023-12-26 09:20:19,884][123091] Updated weights for policy 0, policy_version 1220834 (0.0010) [2023-12-26 09:20:19,961][123091] Updated weights for policy 0, policy_version 1220844 (0.0009) [2023-12-26 09:20:20,675][123090] Updated weights for policy 1, policy_version 1212165 (0.0010) [2023-12-26 09:20:20,740][123090] Updated weights for policy 1, policy_version 1212175 (0.0008) [2023-12-26 09:20:20,749][123091] Updated weights for policy 0, policy_version 1220854 (0.0010) [2023-12-26 09:20:20,792][123090] Updated weights for policy 1, policy_version 1212185 (0.0008) [2023-12-26 09:20:20,816][123091] Updated weights for policy 0, policy_version 1220864 (0.0011) [2023-12-26 09:20:20,872][123091] Updated weights for policy 0, policy_version 1220874 (0.0009) [2023-12-26 09:20:21,610][123090] Updated weights for policy 1, policy_version 1212195 (0.0008) [2023-12-26 09:20:21,687][123090] Updated weights for policy 1, policy_version 1212205 (0.0009) [2023-12-26 09:20:21,758][123090] Updated weights for policy 1, policy_version 1212215 (0.0008) [2023-12-26 09:20:21,792][123091] Updated weights for policy 0, policy_version 1220884 (0.0010) [2023-12-26 09:20:21,866][123091] Updated weights for policy 0, policy_version 1220894 (0.0010) [2023-12-26 09:20:21,926][123091] Updated weights for policy 0, policy_version 1220904 (0.0010) [2023-12-26 09:20:22,574][123090] Updated weights for policy 1, policy_version 1212225 (0.0008) [2023-12-26 09:20:22,629][123090] Updated weights for policy 1, policy_version 1212235 (0.0010) [2023-12-26 09:20:22,686][123090] Updated weights for policy 1, policy_version 1212245 (0.0009) [2023-12-26 09:20:22,743][123090] Updated weights for policy 1, policy_version 1212255 (0.0009) [2023-12-26 09:20:22,794][123091] Updated weights for policy 0, policy_version 1220914 (0.0009) [2023-12-26 09:20:22,847][123091] Updated weights for policy 0, policy_version 1220924 (0.0009) [2023-12-26 09:20:22,901][123091] Updated weights for policy 0, policy_version 1220934 (0.0009) [2023-12-26 09:20:22,954][123091] Updated weights for policy 0, policy_version 1220944 (0.0009) [2023-12-26 09:20:23,604][123090] Updated weights for policy 1, policy_version 1212265 (0.0007) [2023-12-26 09:20:23,661][123090] Updated weights for policy 1, policy_version 1212275 (0.0010) [2023-12-26 09:20:23,709][123090] Updated weights for policy 1, policy_version 1212285 (0.0010) [2023-12-26 09:20:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 622911488. Throughput: 0: 8903.1, 1: 8866.3. Samples: 622889944. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:23,785][121949] Avg episode reward: [(0, '6109.095'), (1, '5679.584')] [2023-12-26 09:20:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001212288_310345728.pth... [2023-12-26 09:20:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001211264_310083584.pth [2023-12-26 09:20:23,835][123091] Updated weights for policy 0, policy_version 1220954 (0.0010) [2023-12-26 09:20:23,893][123091] Updated weights for policy 0, policy_version 1220964 (0.0009) [2023-12-26 09:20:23,951][123091] Updated weights for policy 0, policy_version 1220974 (0.0010) [2023-12-26 09:20:23,958][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001220976_312573952.pth... [2023-12-26 09:20:23,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001219920_312303616.pth [2023-12-26 09:20:24,396][123090] Updated weights for policy 1, policy_version 1212295 (0.0007) [2023-12-26 09:20:24,459][123090] Updated weights for policy 1, policy_version 1212305 (0.0006) [2023-12-26 09:20:24,516][123090] Updated weights for policy 1, policy_version 1212315 (0.0006) [2023-12-26 09:20:24,881][123091] Updated weights for policy 0, policy_version 1220984 (0.0010) [2023-12-26 09:20:24,957][123091] Updated weights for policy 0, policy_version 1220994 (0.0010) [2023-12-26 09:20:25,022][123091] Updated weights for policy 0, policy_version 1221004 (0.0009) [2023-12-26 09:20:25,193][123090] Updated weights for policy 1, policy_version 1212325 (0.0008) [2023-12-26 09:20:25,248][123090] Updated weights for policy 1, policy_version 1212335 (0.0010) [2023-12-26 09:20:25,312][123090] Updated weights for policy 1, policy_version 1212345 (0.0011) [2023-12-26 09:20:25,860][123091] Updated weights for policy 0, policy_version 1221014 (0.0008) [2023-12-26 09:20:25,920][123091] Updated weights for policy 0, policy_version 1221024 (0.0008) [2023-12-26 09:20:25,970][123091] Updated weights for policy 0, policy_version 1221034 (0.0009) [2023-12-26 09:20:26,122][123090] Updated weights for policy 1, policy_version 1212355 (0.0010) [2023-12-26 09:20:26,181][123090] Updated weights for policy 1, policy_version 1212365 (0.0010) [2023-12-26 09:20:26,232][123090] Updated weights for policy 1, policy_version 1212375 (0.0010) [2023-12-26 09:20:26,757][123091] Updated weights for policy 0, policy_version 1221044 (0.0007) [2023-12-26 09:20:26,825][123091] Updated weights for policy 0, policy_version 1221054 (0.0009) [2023-12-26 09:20:26,890][123091] Updated weights for policy 0, policy_version 1221064 (0.0010) [2023-12-26 09:20:27,047][123090] Updated weights for policy 1, policy_version 1212385 (0.0010) [2023-12-26 09:20:27,102][123090] Updated weights for policy 1, policy_version 1212395 (0.0005) [2023-12-26 09:20:27,149][123090] Updated weights for policy 1, policy_version 1212405 (0.0005) [2023-12-26 09:20:27,197][123090] Updated weights for policy 1, policy_version 1212415 (0.0005) [2023-12-26 09:20:27,592][123091] Updated weights for policy 0, policy_version 1221074 (0.0009) [2023-12-26 09:20:27,650][123091] Updated weights for policy 0, policy_version 1221084 (0.0005) [2023-12-26 09:20:27,695][123091] Updated weights for policy 0, policy_version 1221094 (0.0005) [2023-12-26 09:20:27,762][123091] Updated weights for policy 0, policy_version 1221104 (0.0005) [2023-12-26 09:20:27,953][123090] Updated weights for policy 1, policy_version 1212425 (0.0010) [2023-12-26 09:20:28,023][123090] Updated weights for policy 1, policy_version 1212435 (0.0010) [2023-12-26 09:20:28,090][123090] Updated weights for policy 1, policy_version 1212445 (0.0010) [2023-12-26 09:20:28,545][123091] Updated weights for policy 0, policy_version 1221114 (0.0011) [2023-12-26 09:20:28,614][123091] Updated weights for policy 0, policy_version 1221124 (0.0011) [2023-12-26 09:20:28,674][123091] Updated weights for policy 0, policy_version 1221134 (0.0011) [2023-12-26 09:20:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 623001600. Throughput: 0: 8897.4, 1: 8960.2. Samples: 622994956. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:28,785][121949] Avg episode reward: [(0, '6205.167'), (1, '5445.001')] [2023-12-26 09:20:28,828][123090] Updated weights for policy 1, policy_version 1212455 (0.0007) [2023-12-26 09:20:28,886][123090] Updated weights for policy 1, policy_version 1212465 (0.0005) [2023-12-26 09:20:28,943][123090] Updated weights for policy 1, policy_version 1212475 (0.0008) [2023-12-26 09:20:29,477][123091] Updated weights for policy 0, policy_version 1221144 (0.0007) [2023-12-26 09:20:29,545][123091] Updated weights for policy 0, policy_version 1221154 (0.0005) [2023-12-26 09:20:29,609][123091] Updated weights for policy 0, policy_version 1221164 (0.0006) [2023-12-26 09:20:29,695][123090] Updated weights for policy 1, policy_version 1212485 (0.0010) [2023-12-26 09:20:29,755][123090] Updated weights for policy 1, policy_version 1212495 (0.0008) [2023-12-26 09:20:29,827][123090] Updated weights for policy 1, policy_version 1212505 (0.0008) [2023-12-26 09:20:30,282][123091] Updated weights for policy 0, policy_version 1221174 (0.0005) [2023-12-26 09:20:30,350][123091] Updated weights for policy 0, policy_version 1221184 (0.0008) [2023-12-26 09:20:30,406][123091] Updated weights for policy 0, policy_version 1221194 (0.0009) [2023-12-26 09:20:30,693][123090] Updated weights for policy 1, policy_version 1212515 (0.0010) [2023-12-26 09:20:30,751][123090] Updated weights for policy 1, policy_version 1212525 (0.0010) [2023-12-26 09:20:30,807][123090] Updated weights for policy 1, policy_version 1212535 (0.0009) [2023-12-26 09:20:31,207][123091] Updated weights for policy 0, policy_version 1221204 (0.0009) [2023-12-26 09:20:31,279][123091] Updated weights for policy 0, policy_version 1221214 (0.0009) [2023-12-26 09:20:31,342][123091] Updated weights for policy 0, policy_version 1221224 (0.0010) [2023-12-26 09:20:31,626][123090] Updated weights for policy 1, policy_version 1212545 (0.0009) [2023-12-26 09:20:31,685][123090] Updated weights for policy 1, policy_version 1212555 (0.0007) [2023-12-26 09:20:31,749][123090] Updated weights for policy 1, policy_version 1212565 (0.0009) [2023-12-26 09:20:31,814][123090] Updated weights for policy 1, policy_version 1212575 (0.0010) [2023-12-26 09:20:32,213][123091] Updated weights for policy 0, policy_version 1221234 (0.0010) [2023-12-26 09:20:32,271][123091] Updated weights for policy 0, policy_version 1221244 (0.0010) [2023-12-26 09:20:32,321][123091] Updated weights for policy 0, policy_version 1221254 (0.0009) [2023-12-26 09:20:32,388][123091] Updated weights for policy 0, policy_version 1221264 (0.0008) [2023-12-26 09:20:32,560][123090] Updated weights for policy 1, policy_version 1212585 (0.0011) [2023-12-26 09:20:32,619][123090] Updated weights for policy 1, policy_version 1212595 (0.0010) [2023-12-26 09:20:32,682][123090] Updated weights for policy 1, policy_version 1212605 (0.0010) [2023-12-26 09:20:33,255][123091] Updated weights for policy 0, policy_version 1221274 (0.0009) [2023-12-26 09:20:33,315][123091] Updated weights for policy 0, policy_version 1221284 (0.0009) [2023-12-26 09:20:33,374][123091] Updated weights for policy 0, policy_version 1221294 (0.0008) [2023-12-26 09:20:33,494][123090] Updated weights for policy 1, policy_version 1212615 (0.0010) [2023-12-26 09:20:33,546][123090] Updated weights for policy 1, policy_version 1212625 (0.0010) [2023-12-26 09:20:33,601][123090] Updated weights for policy 1, policy_version 1212635 (0.0010) [2023-12-26 09:20:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 623091712. Throughput: 0: 8803.8, 1: 8886.4. Samples: 623100104. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:33,785][121949] Avg episode reward: [(0, '6201.172'), (1, '5727.576')] [2023-12-26 09:20:34,181][123091] Updated weights for policy 0, policy_version 1221304 (0.0007) [2023-12-26 09:20:34,236][123091] Updated weights for policy 0, policy_version 1221315 (0.0008) [2023-12-26 09:20:34,291][123091] Updated weights for policy 0, policy_version 1221325 (0.0008) [2023-12-26 09:20:34,333][123090] Updated weights for policy 1, policy_version 1212645 (0.0010) [2023-12-26 09:20:34,400][123090] Updated weights for policy 1, policy_version 1212655 (0.0011) [2023-12-26 09:20:34,464][123090] Updated weights for policy 1, policy_version 1212665 (0.0011) [2023-12-26 09:20:35,144][123091] Updated weights for policy 0, policy_version 1221335 (0.0010) [2023-12-26 09:20:35,191][123090] Updated weights for policy 1, policy_version 1212675 (0.0011) [2023-12-26 09:20:35,200][123091] Updated weights for policy 0, policy_version 1221345 (0.0011) [2023-12-26 09:20:35,243][123090] Updated weights for policy 1, policy_version 1212685 (0.0010) [2023-12-26 09:20:35,251][123091] Updated weights for policy 0, policy_version 1221355 (0.0010) [2023-12-26 09:20:35,294][123090] Updated weights for policy 1, policy_version 1212695 (0.0010) [2023-12-26 09:20:36,009][123091] Updated weights for policy 0, policy_version 1221365 (0.0010) [2023-12-26 09:20:36,065][123091] Updated weights for policy 0, policy_version 1221375 (0.0006) [2023-12-26 09:20:36,116][123091] Updated weights for policy 0, policy_version 1221385 (0.0008) [2023-12-26 09:20:36,147][123090] Updated weights for policy 1, policy_version 1212705 (0.0010) [2023-12-26 09:20:36,207][123090] Updated weights for policy 1, policy_version 1212715 (0.0009) [2023-12-26 09:20:36,263][123090] Updated weights for policy 1, policy_version 1212725 (0.0010) [2023-12-26 09:20:36,319][123090] Updated weights for policy 1, policy_version 1212735 (0.0009) [2023-12-26 09:20:36,935][123091] Updated weights for policy 0, policy_version 1221395 (0.0010) [2023-12-26 09:20:36,996][123091] Updated weights for policy 0, policy_version 1221405 (0.0009) [2023-12-26 09:20:37,052][123091] Updated weights for policy 0, policy_version 1221415 (0.0010) [2023-12-26 09:20:37,165][123090] Updated weights for policy 1, policy_version 1212745 (0.0010) [2023-12-26 09:20:37,214][123090] Updated weights for policy 1, policy_version 1212755 (0.0009) [2023-12-26 09:20:37,272][123090] Updated weights for policy 1, policy_version 1212765 (0.0009) [2023-12-26 09:20:37,891][123091] Updated weights for policy 0, policy_version 1221425 (0.0009) [2023-12-26 09:20:37,946][123091] Updated weights for policy 0, policy_version 1221435 (0.0006) [2023-12-26 09:20:37,997][123091] Updated weights for policy 0, policy_version 1221445 (0.0005) [2023-12-26 09:20:38,039][123090] Updated weights for policy 1, policy_version 1212775 (0.0006) [2023-12-26 09:20:38,073][123091] Updated weights for policy 0, policy_version 1221456 (0.0010) [2023-12-26 09:20:38,111][123090] Updated weights for policy 1, policy_version 1212785 (0.0006) [2023-12-26 09:20:38,181][123090] Updated weights for policy 1, policy_version 1212795 (0.0005) [2023-12-26 09:20:38,785][121949] Fps is (10 sec: 17202.3, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 623173632. Throughput: 0: 8842.8, 1: 8912.5. Samples: 623153404. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:38,786][121949] Avg episode reward: [(0, '6127.897'), (1, '5923.736')] [2023-12-26 09:20:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001212800_310476800.pth... [2023-12-26 09:20:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001221456_312696832.pth... [2023-12-26 09:20:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001211776_310214656.pth [2023-12-26 09:20:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001220464_312442880.pth [2023-12-26 09:20:38,843][123090] Updated weights for policy 1, policy_version 1212805 (0.0006) [2023-12-26 09:20:38,880][123091] Updated weights for policy 0, policy_version 1221466 (0.0009) [2023-12-26 09:20:38,911][123090] Updated weights for policy 1, policy_version 1212815 (0.0008) [2023-12-26 09:20:38,940][123091] Updated weights for policy 0, policy_version 1221476 (0.0009) [2023-12-26 09:20:38,980][123090] Updated weights for policy 1, policy_version 1212825 (0.0009) [2023-12-26 09:20:39,004][123091] Updated weights for policy 0, policy_version 1221486 (0.0007) [2023-12-26 09:20:39,799][123090] Updated weights for policy 1, policy_version 1212835 (0.0010) [2023-12-26 09:20:39,860][123090] Updated weights for policy 1, policy_version 1212845 (0.0010) [2023-12-26 09:20:39,863][123091] Updated weights for policy 0, policy_version 1221496 (0.0008) [2023-12-26 09:20:39,930][123090] Updated weights for policy 1, policy_version 1212855 (0.0011) [2023-12-26 09:20:39,932][123091] Updated weights for policy 0, policy_version 1221506 (0.0006) [2023-12-26 09:20:40,002][123091] Updated weights for policy 0, policy_version 1221516 (0.0006) [2023-12-26 09:20:40,765][123090] Updated weights for policy 1, policy_version 1212865 (0.0010) [2023-12-26 09:20:40,793][123091] Updated weights for policy 0, policy_version 1221526 (0.0008) [2023-12-26 09:20:40,828][123090] Updated weights for policy 1, policy_version 1212875 (0.0009) [2023-12-26 09:20:40,852][123091] Updated weights for policy 0, policy_version 1221536 (0.0007) [2023-12-26 09:20:40,885][123090] Updated weights for policy 1, policy_version 1212885 (0.0007) [2023-12-26 09:20:40,914][123091] Updated weights for policy 0, policy_version 1221546 (0.0009) [2023-12-26 09:20:40,942][123090] Updated weights for policy 1, policy_version 1212895 (0.0005) [2023-12-26 09:20:41,806][123091] Updated weights for policy 0, policy_version 1221556 (0.0009) [2023-12-26 09:20:41,812][123090] Updated weights for policy 1, policy_version 1212905 (0.0009) [2023-12-26 09:20:41,874][123090] Updated weights for policy 1, policy_version 1212915 (0.0007) [2023-12-26 09:20:41,874][123091] Updated weights for policy 0, policy_version 1221566 (0.0010) [2023-12-26 09:20:41,936][123091] Updated weights for policy 0, policy_version 1221576 (0.0008) [2023-12-26 09:20:41,941][123090] Updated weights for policy 1, policy_version 1212925 (0.0008) [2023-12-26 09:20:42,778][123091] Updated weights for policy 0, policy_version 1221586 (0.0009) [2023-12-26 09:20:42,793][123090] Updated weights for policy 1, policy_version 1212935 (0.0010) [2023-12-26 09:20:42,837][123091] Updated weights for policy 0, policy_version 1221596 (0.0008) [2023-12-26 09:20:42,842][123090] Updated weights for policy 1, policy_version 1212945 (0.0008) [2023-12-26 09:20:42,888][123090] Updated weights for policy 1, policy_version 1212955 (0.0008) [2023-12-26 09:20:42,899][123091] Updated weights for policy 0, policy_version 1221606 (0.0007) [2023-12-26 09:20:42,950][123091] Updated weights for policy 0, policy_version 1221616 (0.0009) [2023-12-26 09:20:43,673][123091] Updated weights for policy 0, policy_version 1221626 (0.0009) [2023-12-26 09:20:43,740][123091] Updated weights for policy 0, policy_version 1221636 (0.0008) [2023-12-26 09:20:43,777][123090] Updated weights for policy 1, policy_version 1212965 (0.0007) [2023-12-26 09:20:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 623255552. Throughput: 0: 8711.8, 1: 8774.2. Samples: 623257252. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:43,785][121949] Avg episode reward: [(0, '6234.696'), (1, '5902.602')] [2023-12-26 09:20:43,805][123091] Updated weights for policy 0, policy_version 1221646 (0.0008) [2023-12-26 09:20:43,842][123090] Updated weights for policy 1, policy_version 1212975 (0.0005) [2023-12-26 09:20:43,907][123090] Updated weights for policy 1, policy_version 1212985 (0.0005) [2023-12-26 09:20:44,513][123091] Updated weights for policy 0, policy_version 1221656 (0.0006) [2023-12-26 09:20:44,561][123091] Updated weights for policy 0, policy_version 1221666 (0.0005) [2023-12-26 09:20:44,617][123091] Updated weights for policy 0, policy_version 1221676 (0.0006) [2023-12-26 09:20:44,628][123090] Updated weights for policy 1, policy_version 1212995 (0.0006) [2023-12-26 09:20:44,680][123090] Updated weights for policy 1, policy_version 1213005 (0.0010) [2023-12-26 09:20:44,738][123090] Updated weights for policy 1, policy_version 1213015 (0.0010) [2023-12-26 09:20:45,378][123091] Updated weights for policy 0, policy_version 1221686 (0.0008) [2023-12-26 09:20:45,441][123091] Updated weights for policy 0, policy_version 1221696 (0.0010) [2023-12-26 09:20:45,494][123091] Updated weights for policy 0, policy_version 1221706 (0.0009) [2023-12-26 09:20:45,658][123090] Updated weights for policy 1, policy_version 1213025 (0.0010) [2023-12-26 09:20:45,719][123090] Updated weights for policy 1, policy_version 1213035 (0.0009) [2023-12-26 09:20:45,767][123090] Updated weights for policy 1, policy_version 1213045 (0.0009) [2023-12-26 09:20:45,827][123090] Updated weights for policy 1, policy_version 1213055 (0.0009) [2023-12-26 09:20:46,322][123091] Updated weights for policy 0, policy_version 1221716 (0.0007) [2023-12-26 09:20:46,377][123091] Updated weights for policy 0, policy_version 1221726 (0.0009) [2023-12-26 09:20:46,431][123091] Updated weights for policy 0, policy_version 1221736 (0.0010) [2023-12-26 09:20:46,535][123090] Updated weights for policy 1, policy_version 1213065 (0.0009) [2023-12-26 09:20:46,596][123090] Updated weights for policy 1, policy_version 1213075 (0.0009) [2023-12-26 09:20:46,650][123090] Updated weights for policy 1, policy_version 1213085 (0.0009) [2023-12-26 09:20:47,221][123091] Updated weights for policy 0, policy_version 1221746 (0.0009) [2023-12-26 09:20:47,275][123091] Updated weights for policy 0, policy_version 1221756 (0.0010) [2023-12-26 09:20:47,329][123091] Updated weights for policy 0, policy_version 1221766 (0.0009) [2023-12-26 09:20:47,371][123090] Updated weights for policy 1, policy_version 1213095 (0.0007) [2023-12-26 09:20:47,377][123091] Updated weights for policy 0, policy_version 1221776 (0.0010) [2023-12-26 09:20:47,431][123090] Updated weights for policy 1, policy_version 1213105 (0.0009) [2023-12-26 09:20:47,496][123090] Updated weights for policy 1, policy_version 1213115 (0.0010) [2023-12-26 09:20:48,251][123090] Updated weights for policy 1, policy_version 1213125 (0.0007) [2023-12-26 09:20:48,263][123091] Updated weights for policy 0, policy_version 1221786 (0.0008) [2023-12-26 09:20:48,312][123091] Updated weights for policy 0, policy_version 1221796 (0.0009) [2023-12-26 09:20:48,315][123090] Updated weights for policy 1, policy_version 1213135 (0.0006) [2023-12-26 09:20:48,370][123091] Updated weights for policy 0, policy_version 1221806 (0.0009) [2023-12-26 09:20:48,380][123090] Updated weights for policy 1, policy_version 1213145 (0.0009) [2023-12-26 09:20:48,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 623353856. Throughput: 0: 8705.3, 1: 8823.5. Samples: 623364772. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:48,785][121949] Avg episode reward: [(0, '6272.033'), (1, '5812.335')] [2023-12-26 09:20:49,176][123091] Updated weights for policy 0, policy_version 1221816 (0.0010) [2023-12-26 09:20:49,247][123091] Updated weights for policy 0, policy_version 1221826 (0.0010) [2023-12-26 09:20:49,253][123090] Updated weights for policy 1, policy_version 1213155 (0.0009) [2023-12-26 09:20:49,313][123090] Updated weights for policy 1, policy_version 1213165 (0.0009) [2023-12-26 09:20:49,320][123091] Updated weights for policy 0, policy_version 1221836 (0.0006) [2023-12-26 09:20:49,385][123090] Updated weights for policy 1, policy_version 1213175 (0.0009) [2023-12-26 09:20:49,957][123091] Updated weights for policy 0, policy_version 1221846 (0.0009) [2023-12-26 09:20:50,026][123091] Updated weights for policy 0, policy_version 1221856 (0.0009) [2023-12-26 09:20:50,089][123091] Updated weights for policy 0, policy_version 1221866 (0.0009) [2023-12-26 09:20:50,163][123090] Updated weights for policy 1, policy_version 1213185 (0.0010) [2023-12-26 09:20:50,217][123090] Updated weights for policy 1, policy_version 1213195 (0.0009) [2023-12-26 09:20:50,277][123090] Updated weights for policy 1, policy_version 1213205 (0.0009) [2023-12-26 09:20:50,339][123090] Updated weights for policy 1, policy_version 1213215 (0.0008) [2023-12-26 09:20:50,925][123091] Updated weights for policy 0, policy_version 1221876 (0.0008) [2023-12-26 09:20:50,996][123091] Updated weights for policy 0, policy_version 1221886 (0.0005) [2023-12-26 09:20:51,068][123091] Updated weights for policy 0, policy_version 1221896 (0.0009) [2023-12-26 09:20:51,231][123090] Updated weights for policy 1, policy_version 1213225 (0.0009) [2023-12-26 09:20:51,302][123090] Updated weights for policy 1, policy_version 1213235 (0.0009) [2023-12-26 09:20:51,379][123090] Updated weights for policy 1, policy_version 1213245 (0.0009) [2023-12-26 09:20:51,866][123091] Updated weights for policy 0, policy_version 1221906 (0.0010) [2023-12-26 09:20:51,921][123091] Updated weights for policy 0, policy_version 1221916 (0.0008) [2023-12-26 09:20:51,981][123091] Updated weights for policy 0, policy_version 1221926 (0.0008) [2023-12-26 09:20:52,037][123091] Updated weights for policy 0, policy_version 1221936 (0.0008) [2023-12-26 09:20:52,260][123090] Updated weights for policy 1, policy_version 1213255 (0.0009) [2023-12-26 09:20:52,330][123090] Updated weights for policy 1, policy_version 1213265 (0.0010) [2023-12-26 09:20:52,399][123090] Updated weights for policy 1, policy_version 1213275 (0.0009) [2023-12-26 09:20:52,832][123091] Updated weights for policy 0, policy_version 1221946 (0.0006) [2023-12-26 09:20:52,892][123091] Updated weights for policy 0, policy_version 1221956 (0.0010) [2023-12-26 09:20:52,944][123091] Updated weights for policy 0, policy_version 1221966 (0.0009) [2023-12-26 09:20:53,249][123090] Updated weights for policy 1, policy_version 1213285 (0.0009) [2023-12-26 09:20:53,311][123090] Updated weights for policy 1, policy_version 1213295 (0.0009) [2023-12-26 09:20:53,366][123090] Updated weights for policy 1, policy_version 1213305 (0.0008) [2023-12-26 09:20:53,738][123091] Updated weights for policy 0, policy_version 1221976 (0.0006) [2023-12-26 09:20:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 623435776. Throughput: 0: 8746.5, 1: 8771.4. Samples: 623416520. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:53,785][121949] Avg episode reward: [(0, '6258.057'), (1, '5852.281')] [2023-12-26 09:20:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001213312_310607872.pth... [2023-12-26 09:20:53,796][123091] Updated weights for policy 0, policy_version 1221986 (0.0005) [2023-12-26 09:20:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001212288_310345728.pth [2023-12-26 09:20:53,872][123091] Updated weights for policy 0, policy_version 1221996 (0.0008) [2023-12-26 09:20:53,894][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001222000_312836096.pth... [2023-12-26 09:20:53,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001220976_312573952.pth [2023-12-26 09:20:54,228][123090] Updated weights for policy 1, policy_version 1213315 (0.0009) [2023-12-26 09:20:54,288][123090] Updated weights for policy 1, policy_version 1213326 (0.0010) [2023-12-26 09:20:54,339][123090] Updated weights for policy 1, policy_version 1213336 (0.0010) [2023-12-26 09:20:54,591][123091] Updated weights for policy 0, policy_version 1222006 (0.0006) [2023-12-26 09:20:54,644][123091] Updated weights for policy 0, policy_version 1222016 (0.0005) [2023-12-26 09:20:54,696][123091] Updated weights for policy 0, policy_version 1222026 (0.0005) [2023-12-26 09:20:55,297][123090] Updated weights for policy 1, policy_version 1213346 (0.0010) [2023-12-26 09:20:55,346][123090] Updated weights for policy 1, policy_version 1213356 (0.0009) [2023-12-26 09:20:55,405][123091] Updated weights for policy 0, policy_version 1222036 (0.0007) [2023-12-26 09:20:55,412][123090] Updated weights for policy 1, policy_version 1213366 (0.0007) [2023-12-26 09:20:55,467][123091] Updated weights for policy 0, policy_version 1222046 (0.0010) [2023-12-26 09:20:55,470][123090] Updated weights for policy 1, policy_version 1213376 (0.0006) [2023-12-26 09:20:55,528][123091] Updated weights for policy 0, policy_version 1222056 (0.0010) [2023-12-26 09:20:56,251][123091] Updated weights for policy 0, policy_version 1222066 (0.0009) [2023-12-26 09:20:56,302][123091] Updated weights for policy 0, policy_version 1222076 (0.0005) [2023-12-26 09:20:56,354][123091] Updated weights for policy 0, policy_version 1222086 (0.0008) [2023-12-26 09:20:56,356][123090] Updated weights for policy 1, policy_version 1213386 (0.0011) [2023-12-26 09:20:56,408][123090] Updated weights for policy 1, policy_version 1213396 (0.0010) [2023-12-26 09:20:56,412][123091] Updated weights for policy 0, policy_version 1222096 (0.0010) [2023-12-26 09:20:56,456][123090] Updated weights for policy 1, policy_version 1213406 (0.0010) [2023-12-26 09:20:57,078][123091] Updated weights for policy 0, policy_version 1222106 (0.0005) [2023-12-26 09:20:57,134][123091] Updated weights for policy 0, policy_version 1222116 (0.0005) [2023-12-26 09:20:57,187][123091] Updated weights for policy 0, policy_version 1222126 (0.0005) [2023-12-26 09:20:57,198][123090] Updated weights for policy 1, policy_version 1213416 (0.0006) [2023-12-26 09:20:57,263][123090] Updated weights for policy 1, policy_version 1213426 (0.0005) [2023-12-26 09:20:57,327][123090] Updated weights for policy 1, policy_version 1213436 (0.0008) [2023-12-26 09:20:57,788][123091] Updated weights for policy 0, policy_version 1222136 (0.0005) [2023-12-26 09:20:57,836][123091] Updated weights for policy 0, policy_version 1222146 (0.0005) [2023-12-26 09:20:57,883][123091] Updated weights for policy 0, policy_version 1222156 (0.0005) [2023-12-26 09:20:57,968][123090] Updated weights for policy 1, policy_version 1213446 (0.0007) [2023-12-26 09:20:58,015][123090] Updated weights for policy 1, policy_version 1213456 (0.0005) [2023-12-26 09:20:58,075][123090] Updated weights for policy 1, policy_version 1213466 (0.0007) [2023-12-26 09:20:58,720][123091] Updated weights for policy 0, policy_version 1222166 (0.0007) [2023-12-26 09:20:58,784][123091] Updated weights for policy 0, policy_version 1222176 (0.0008) [2023-12-26 09:20:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 623525888. Throughput: 0: 8905.4, 1: 8742.4. Samples: 623524764. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:20:58,785][121949] Avg episode reward: [(0, '6284.700'), (1, '5808.216')] [2023-12-26 09:20:58,848][123091] Updated weights for policy 0, policy_version 1222186 (0.0008) [2023-12-26 09:20:58,877][123090] Updated weights for policy 1, policy_version 1213476 (0.0009) [2023-12-26 09:20:58,949][123090] Updated weights for policy 1, policy_version 1213486 (0.0008) [2023-12-26 09:20:59,026][123090] Updated weights for policy 1, policy_version 1213496 (0.0009) [2023-12-26 09:20:59,666][123091] Updated weights for policy 0, policy_version 1222196 (0.0009) [2023-12-26 09:20:59,734][123091] Updated weights for policy 0, policy_version 1222206 (0.0009) [2023-12-26 09:20:59,799][123091] Updated weights for policy 0, policy_version 1222216 (0.0009) [2023-12-26 09:20:59,845][123090] Updated weights for policy 1, policy_version 1213506 (0.0010) [2023-12-26 09:20:59,910][123090] Updated weights for policy 1, policy_version 1213516 (0.0011) [2023-12-26 09:20:59,982][123090] Updated weights for policy 1, policy_version 1213526 (0.0010) [2023-12-26 09:21:00,044][123090] Updated weights for policy 1, policy_version 1213536 (0.0005) [2023-12-26 09:21:00,581][123091] Updated weights for policy 0, policy_version 1222226 (0.0009) [2023-12-26 09:21:00,644][123091] Updated weights for policy 0, policy_version 1222236 (0.0007) [2023-12-26 09:21:00,695][123091] Updated weights for policy 0, policy_version 1222246 (0.0005) [2023-12-26 09:21:00,760][123091] Updated weights for policy 0, policy_version 1222256 (0.0005) [2023-12-26 09:21:00,806][123090] Updated weights for policy 1, policy_version 1213546 (0.0008) [2023-12-26 09:21:00,874][123090] Updated weights for policy 1, policy_version 1213556 (0.0008) [2023-12-26 09:21:00,943][123090] Updated weights for policy 1, policy_version 1213566 (0.0006) [2023-12-26 09:21:01,473][123091] Updated weights for policy 0, policy_version 1222266 (0.0008) [2023-12-26 09:21:01,541][123091] Updated weights for policy 0, policy_version 1222276 (0.0008) [2023-12-26 09:21:01,576][123090] Updated weights for policy 1, policy_version 1213576 (0.0006) [2023-12-26 09:21:01,605][123091] Updated weights for policy 0, policy_version 1222286 (0.0008) [2023-12-26 09:21:01,642][123090] Updated weights for policy 1, policy_version 1213586 (0.0006) [2023-12-26 09:21:01,718][123090] Updated weights for policy 1, policy_version 1213596 (0.0007) [2023-12-26 09:21:02,252][123091] Updated weights for policy 0, policy_version 1222296 (0.0006) [2023-12-26 09:21:02,313][123091] Updated weights for policy 0, policy_version 1222306 (0.0009) [2023-12-26 09:21:02,318][123090] Updated weights for policy 1, policy_version 1213606 (0.0006) [2023-12-26 09:21:02,385][123091] Updated weights for policy 0, policy_version 1222316 (0.0009) [2023-12-26 09:21:02,385][123090] Updated weights for policy 1, policy_version 1213616 (0.0009) [2023-12-26 09:21:02,448][123090] Updated weights for policy 1, policy_version 1213626 (0.0007) [2023-12-26 09:21:03,051][123091] Updated weights for policy 0, policy_version 1222326 (0.0006) [2023-12-26 09:21:03,107][123091] Updated weights for policy 0, policy_version 1222336 (0.0005) [2023-12-26 09:21:03,162][123090] Updated weights for policy 1, policy_version 1213636 (0.0005) [2023-12-26 09:21:03,167][123091] Updated weights for policy 0, policy_version 1222346 (0.0006) [2023-12-26 09:21:03,216][123090] Updated weights for policy 1, policy_version 1213646 (0.0006) [2023-12-26 09:21:03,266][123090] Updated weights for policy 1, policy_version 1213656 (0.0005) [2023-12-26 09:21:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 623624192. Throughput: 0: 8886.0, 1: 8852.8. Samples: 623637124. Policy #0 lag: (min: 19.0, avg: 22.1, max: 51.0) [2023-12-26 09:21:03,785][121949] Avg episode reward: [(0, '6164.439'), (1, '5853.218')] [2023-12-26 09:21:03,977][123090] Updated weights for policy 1, policy_version 1213666 (0.0006) [2023-12-26 09:21:03,982][123091] Updated weights for policy 0, policy_version 1222356 (0.0007) [2023-12-26 09:21:04,042][123090] Updated weights for policy 1, policy_version 1213676 (0.0007) [2023-12-26 09:21:04,043][123091] Updated weights for policy 0, policy_version 1222366 (0.0006) [2023-12-26 09:21:04,104][123090] Updated weights for policy 1, policy_version 1213686 (0.0006) [2023-12-26 09:21:04,109][123091] Updated weights for policy 0, policy_version 1222376 (0.0006) [2023-12-26 09:21:04,172][123090] Updated weights for policy 1, policy_version 1213696 (0.0006) [2023-12-26 09:21:04,876][123091] Updated weights for policy 0, policy_version 1222386 (0.0007) [2023-12-26 09:21:04,913][123090] Updated weights for policy 1, policy_version 1213706 (0.0009) [2023-12-26 09:21:04,939][123091] Updated weights for policy 0, policy_version 1222396 (0.0007) [2023-12-26 09:21:04,966][123090] Updated weights for policy 1, policy_version 1213716 (0.0009) [2023-12-26 09:21:05,010][123091] Updated weights for policy 0, policy_version 1222406 (0.0007) [2023-12-26 09:21:05,014][123090] Updated weights for policy 1, policy_version 1213726 (0.0008) [2023-12-26 09:21:05,078][123091] Updated weights for policy 0, policy_version 1222416 (0.0006) [2023-12-26 09:21:05,757][123091] Updated weights for policy 0, policy_version 1222426 (0.0009) [2023-12-26 09:21:05,758][123090] Updated weights for policy 1, policy_version 1213736 (0.0006) [2023-12-26 09:21:05,814][123091] Updated weights for policy 0, policy_version 1222436 (0.0009) [2023-12-26 09:21:05,822][123090] Updated weights for policy 1, policy_version 1213746 (0.0005) [2023-12-26 09:21:05,865][123091] Updated weights for policy 0, policy_version 1222446 (0.0010) [2023-12-26 09:21:05,873][123090] Updated weights for policy 1, policy_version 1213756 (0.0005) [2023-12-26 09:21:06,572][123090] Updated weights for policy 1, policy_version 1213766 (0.0008) [2023-12-26 09:21:06,629][123090] Updated weights for policy 1, policy_version 1213776 (0.0009) [2023-12-26 09:21:06,687][123090] Updated weights for policy 1, policy_version 1213786 (0.0009) [2023-12-26 09:21:06,694][123091] Updated weights for policy 0, policy_version 1222456 (0.0009) [2023-12-26 09:21:06,762][123091] Updated weights for policy 0, policy_version 1222466 (0.0009) [2023-12-26 09:21:06,827][123091] Updated weights for policy 0, policy_version 1222476 (0.0009) [2023-12-26 09:21:07,448][123090] Updated weights for policy 1, policy_version 1213796 (0.0009) [2023-12-26 09:21:07,505][123090] Updated weights for policy 1, policy_version 1213806 (0.0010) [2023-12-26 09:21:07,561][123090] Updated weights for policy 1, policy_version 1213816 (0.0010) [2023-12-26 09:21:07,603][123091] Updated weights for policy 0, policy_version 1222486 (0.0007) [2023-12-26 09:21:07,664][123091] Updated weights for policy 0, policy_version 1222496 (0.0006) [2023-12-26 09:21:07,732][123091] Updated weights for policy 0, policy_version 1222506 (0.0006) [2023-12-26 09:21:08,386][123090] Updated weights for policy 1, policy_version 1213826 (0.0009) [2023-12-26 09:21:08,447][123090] Updated weights for policy 1, policy_version 1213836 (0.0010) [2023-12-26 09:21:08,498][123090] Updated weights for policy 1, policy_version 1213846 (0.0009) [2023-12-26 09:21:08,528][123091] Updated weights for policy 0, policy_version 1222516 (0.0009) [2023-12-26 09:21:08,562][123090] Updated weights for policy 1, policy_version 1213856 (0.0008) [2023-12-26 09:21:08,584][123091] Updated weights for policy 0, policy_version 1222526 (0.0010) [2023-12-26 09:21:08,646][123091] Updated weights for policy 0, policy_version 1222536 (0.0010) [2023-12-26 09:21:08,784][121949] Fps is (10 sec: 19661.0, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 623722496. Throughput: 0: 8939.5, 1: 8914.2. Samples: 623693360. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:08,785][121949] Avg episode reward: [(0, '6075.230'), (1, '5974.438')] [2023-12-26 09:21:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001222544_312975360.pth... [2023-12-26 09:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001213856_310747136.pth... [2023-12-26 09:21:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001212800_310476800.pth [2023-12-26 09:21:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001221456_312696832.pth [2023-12-26 09:21:09,329][123090] Updated weights for policy 1, policy_version 1213866 (0.0007) [2023-12-26 09:21:09,401][123090] Updated weights for policy 1, policy_version 1213876 (0.0007) [2023-12-26 09:21:09,458][123090] Updated weights for policy 1, policy_version 1213886 (0.0007) [2023-12-26 09:21:09,555][123091] Updated weights for policy 0, policy_version 1222546 (0.0009) [2023-12-26 09:21:09,622][123091] Updated weights for policy 0, policy_version 1222556 (0.0009) [2023-12-26 09:21:09,691][123091] Updated weights for policy 0, policy_version 1222566 (0.0010) [2023-12-26 09:21:09,758][123091] Updated weights for policy 0, policy_version 1222576 (0.0009) [2023-12-26 09:21:10,265][123090] Updated weights for policy 1, policy_version 1213896 (0.0009) [2023-12-26 09:21:10,329][123090] Updated weights for policy 1, policy_version 1213906 (0.0009) [2023-12-26 09:21:10,395][123090] Updated weights for policy 1, policy_version 1213916 (0.0011) [2023-12-26 09:21:10,605][123091] Updated weights for policy 0, policy_version 1222586 (0.0005) [2023-12-26 09:21:10,683][123091] Updated weights for policy 0, policy_version 1222596 (0.0007) [2023-12-26 09:21:10,755][123091] Updated weights for policy 0, policy_version 1222606 (0.0010) [2023-12-26 09:21:11,191][123090] Updated weights for policy 1, policy_version 1213926 (0.0009) [2023-12-26 09:21:11,265][123090] Updated weights for policy 1, policy_version 1213936 (0.0009) [2023-12-26 09:21:11,333][123090] Updated weights for policy 1, policy_version 1213946 (0.0010) [2023-12-26 09:21:11,541][123091] Updated weights for policy 0, policy_version 1222616 (0.0009) [2023-12-26 09:21:11,604][123091] Updated weights for policy 0, policy_version 1222626 (0.0010) [2023-12-26 09:21:11,676][123091] Updated weights for policy 0, policy_version 1222636 (0.0010) [2023-12-26 09:21:12,127][123090] Updated weights for policy 1, policy_version 1213956 (0.0008) [2023-12-26 09:21:12,205][123090] Updated weights for policy 1, policy_version 1213966 (0.0005) [2023-12-26 09:21:12,273][123090] Updated weights for policy 1, policy_version 1213976 (0.0006) [2023-12-26 09:21:12,591][123091] Updated weights for policy 0, policy_version 1222646 (0.0010) [2023-12-26 09:21:12,651][123091] Updated weights for policy 0, policy_version 1222656 (0.0009) [2023-12-26 09:21:12,709][123091] Updated weights for policy 0, policy_version 1222666 (0.0010) [2023-12-26 09:21:13,022][123090] Updated weights for policy 1, policy_version 1213986 (0.0008) [2023-12-26 09:21:13,084][123090] Updated weights for policy 1, policy_version 1213996 (0.0009) [2023-12-26 09:21:13,145][123090] Updated weights for policy 1, policy_version 1214006 (0.0010) [2023-12-26 09:21:13,209][123090] Updated weights for policy 1, policy_version 1214016 (0.0008) [2023-12-26 09:21:13,626][123091] Updated weights for policy 0, policy_version 1222676 (0.0010) [2023-12-26 09:21:13,674][123091] Updated weights for policy 0, policy_version 1222686 (0.0009) [2023-12-26 09:21:13,735][123091] Updated weights for policy 0, policy_version 1222696 (0.0010) [2023-12-26 09:21:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 623804416. Throughput: 0: 8917.4, 1: 8884.9. Samples: 623796060. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:13,785][121949] Avg episode reward: [(0, '6061.575'), (1, '5888.024')] [2023-12-26 09:21:13,909][123090] Updated weights for policy 1, policy_version 1214026 (0.0005) [2023-12-26 09:21:13,963][123090] Updated weights for policy 1, policy_version 1214036 (0.0005) [2023-12-26 09:21:14,018][123090] Updated weights for policy 1, policy_version 1214046 (0.0005) [2023-12-26 09:21:14,622][123091] Updated weights for policy 0, policy_version 1222706 (0.0010) [2023-12-26 09:21:14,680][123091] Updated weights for policy 0, policy_version 1222716 (0.0010) [2023-12-26 09:21:14,721][123090] Updated weights for policy 1, policy_version 1214056 (0.0005) [2023-12-26 09:21:14,738][123091] Updated weights for policy 0, policy_version 1222726 (0.0009) [2023-12-26 09:21:14,788][123090] Updated weights for policy 1, policy_version 1214066 (0.0008) [2023-12-26 09:21:14,812][123091] Updated weights for policy 0, policy_version 1222736 (0.0008) [2023-12-26 09:21:14,846][123090] Updated weights for policy 1, policy_version 1214076 (0.0006) [2023-12-26 09:21:15,632][123090] Updated weights for policy 1, policy_version 1214086 (0.0008) [2023-12-26 09:21:15,691][123090] Updated weights for policy 1, policy_version 1214096 (0.0010) [2023-12-26 09:21:15,695][123091] Updated weights for policy 0, policy_version 1222746 (0.0008) [2023-12-26 09:21:15,738][123090] Updated weights for policy 1, policy_version 1214106 (0.0010) [2023-12-26 09:21:15,746][123091] Updated weights for policy 0, policy_version 1222756 (0.0007) [2023-12-26 09:21:15,808][123091] Updated weights for policy 0, policy_version 1222766 (0.0007) [2023-12-26 09:21:16,552][123090] Updated weights for policy 1, policy_version 1214116 (0.0010) [2023-12-26 09:21:16,608][123090] Updated weights for policy 1, policy_version 1214126 (0.0010) [2023-12-26 09:21:16,674][123091] Updated weights for policy 0, policy_version 1222776 (0.0006) [2023-12-26 09:21:16,676][123090] Updated weights for policy 1, policy_version 1214136 (0.0011) [2023-12-26 09:21:16,734][123091] Updated weights for policy 0, policy_version 1222786 (0.0007) [2023-12-26 09:21:16,782][123091] Updated weights for policy 0, policy_version 1222796 (0.0009) [2023-12-26 09:21:17,466][123090] Updated weights for policy 1, policy_version 1214146 (0.0009) [2023-12-26 09:21:17,521][123090] Updated weights for policy 1, policy_version 1214156 (0.0007) [2023-12-26 09:21:17,583][123090] Updated weights for policy 1, policy_version 1214166 (0.0005) [2023-12-26 09:21:17,618][123091] Updated weights for policy 0, policy_version 1222806 (0.0008) [2023-12-26 09:21:17,635][123090] Updated weights for policy 1, policy_version 1214176 (0.0005) [2023-12-26 09:21:17,680][123091] Updated weights for policy 0, policy_version 1222816 (0.0009) [2023-12-26 09:21:17,737][123091] Updated weights for policy 0, policy_version 1222826 (0.0009) [2023-12-26 09:21:18,365][123090] Updated weights for policy 1, policy_version 1214186 (0.0011) [2023-12-26 09:21:18,425][123090] Updated weights for policy 1, policy_version 1214196 (0.0011) [2023-12-26 09:21:18,487][123090] Updated weights for policy 1, policy_version 1214206 (0.0010) [2023-12-26 09:21:18,648][123091] Updated weights for policy 0, policy_version 1222836 (0.0010) [2023-12-26 09:21:18,713][123091] Updated weights for policy 0, policy_version 1222846 (0.0009) [2023-12-26 09:21:18,772][123091] Updated weights for policy 0, policy_version 1222856 (0.0010) [2023-12-26 09:21:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 623886336. Throughput: 0: 8840.0, 1: 8952.0. Samples: 623900744. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:18,785][121949] Avg episode reward: [(0, '6155.262'), (1, '5845.612')] [2023-12-26 09:21:19,293][123090] Updated weights for policy 1, policy_version 1214216 (0.0010) [2023-12-26 09:21:19,345][123090] Updated weights for policy 1, policy_version 1214226 (0.0009) [2023-12-26 09:21:19,409][123090] Updated weights for policy 1, policy_version 1214236 (0.0010) [2023-12-26 09:21:19,565][123091] Updated weights for policy 0, policy_version 1222866 (0.0010) [2023-12-26 09:21:19,621][123091] Updated weights for policy 0, policy_version 1222876 (0.0010) [2023-12-26 09:21:19,687][123091] Updated weights for policy 0, policy_version 1222886 (0.0010) [2023-12-26 09:21:19,743][123091] Updated weights for policy 0, policy_version 1222896 (0.0006) [2023-12-26 09:21:20,246][123090] Updated weights for policy 1, policy_version 1214246 (0.0007) [2023-12-26 09:21:20,318][123090] Updated weights for policy 1, policy_version 1214256 (0.0006) [2023-12-26 09:21:20,381][123090] Updated weights for policy 1, policy_version 1214266 (0.0006) [2023-12-26 09:21:20,685][123091] Updated weights for policy 0, policy_version 1222906 (0.0010) [2023-12-26 09:21:20,752][123091] Updated weights for policy 0, policy_version 1222916 (0.0010) [2023-12-26 09:21:20,810][123091] Updated weights for policy 0, policy_version 1222926 (0.0010) [2023-12-26 09:21:21,049][123090] Updated weights for policy 1, policy_version 1214276 (0.0006) [2023-12-26 09:21:21,115][123090] Updated weights for policy 1, policy_version 1214286 (0.0007) [2023-12-26 09:21:21,192][123090] Updated weights for policy 1, policy_version 1214296 (0.0008) [2023-12-26 09:21:21,669][123091] Updated weights for policy 0, policy_version 1222936 (0.0010) [2023-12-26 09:21:21,736][123091] Updated weights for policy 0, policy_version 1222946 (0.0009) [2023-12-26 09:21:21,798][123091] Updated weights for policy 0, policy_version 1222956 (0.0010) [2023-12-26 09:21:21,985][123090] Updated weights for policy 1, policy_version 1214306 (0.0008) [2023-12-26 09:21:22,045][123090] Updated weights for policy 1, policy_version 1214316 (0.0010) [2023-12-26 09:21:22,113][123090] Updated weights for policy 1, policy_version 1214326 (0.0010) [2023-12-26 09:21:22,181][123090] Updated weights for policy 1, policy_version 1214336 (0.0010) [2023-12-26 09:21:22,661][123091] Updated weights for policy 0, policy_version 1222966 (0.0010) [2023-12-26 09:21:22,719][123091] Updated weights for policy 0, policy_version 1222976 (0.0009) [2023-12-26 09:21:22,780][123091] Updated weights for policy 0, policy_version 1222986 (0.0009) [2023-12-26 09:21:23,008][123090] Updated weights for policy 1, policy_version 1214346 (0.0011) [2023-12-26 09:21:23,072][123090] Updated weights for policy 1, policy_version 1214356 (0.0011) [2023-12-26 09:21:23,142][123090] Updated weights for policy 1, policy_version 1214366 (0.0011) [2023-12-26 09:21:23,615][123091] Updated weights for policy 0, policy_version 1222996 (0.0010) [2023-12-26 09:21:23,667][123091] Updated weights for policy 0, policy_version 1223006 (0.0009) [2023-12-26 09:21:23,713][123091] Updated weights for policy 0, policy_version 1223016 (0.0005) [2023-12-26 09:21:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 623976448. Throughput: 0: 8793.1, 1: 8957.6. Samples: 623952176. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:23,785][121949] Avg episode reward: [(0, '6133.791'), (1, '5843.964')] [2023-12-26 09:21:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001223024_313098240.pth... [2023-12-26 09:21:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001214368_310878208.pth... [2023-12-26 09:21:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001222000_312836096.pth [2023-12-26 09:21:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001213312_310607872.pth [2023-12-26 09:21:23,964][123090] Updated weights for policy 1, policy_version 1214376 (0.0011) [2023-12-26 09:21:24,027][123090] Updated weights for policy 1, policy_version 1214386 (0.0010) [2023-12-26 09:21:24,098][123090] Updated weights for policy 1, policy_version 1214396 (0.0010) [2023-12-26 09:21:24,421][123091] Updated weights for policy 0, policy_version 1223026 (0.0005) [2023-12-26 09:21:24,482][123091] Updated weights for policy 0, policy_version 1223036 (0.0007) [2023-12-26 09:21:24,542][123091] Updated weights for policy 0, policy_version 1223046 (0.0009) [2023-12-26 09:21:24,591][123091] Updated weights for policy 0, policy_version 1223056 (0.0009) [2023-12-26 09:21:24,943][123090] Updated weights for policy 1, policy_version 1214406 (0.0010) [2023-12-26 09:21:24,998][123090] Updated weights for policy 1, policy_version 1214416 (0.0010) [2023-12-26 09:21:25,060][123090] Updated weights for policy 1, policy_version 1214426 (0.0010) [2023-12-26 09:21:25,423][123091] Updated weights for policy 0, policy_version 1223066 (0.0008) [2023-12-26 09:21:25,480][123091] Updated weights for policy 0, policy_version 1223076 (0.0009) [2023-12-26 09:21:25,527][123091] Updated weights for policy 0, policy_version 1223086 (0.0008) [2023-12-26 09:21:25,881][123090] Updated weights for policy 1, policy_version 1214436 (0.0010) [2023-12-26 09:21:25,932][123090] Updated weights for policy 1, policy_version 1214446 (0.0010) [2023-12-26 09:21:25,990][123090] Updated weights for policy 1, policy_version 1214456 (0.0010) [2023-12-26 09:21:26,319][123091] Updated weights for policy 0, policy_version 1223096 (0.0009) [2023-12-26 09:21:26,367][123091] Updated weights for policy 0, policy_version 1223106 (0.0009) [2023-12-26 09:21:26,419][123091] Updated weights for policy 0, policy_version 1223116 (0.0009) [2023-12-26 09:21:26,815][123090] Updated weights for policy 1, policy_version 1214466 (0.0010) [2023-12-26 09:21:26,865][123090] Updated weights for policy 1, policy_version 1214476 (0.0010) [2023-12-26 09:21:26,915][123090] Updated weights for policy 1, policy_version 1214486 (0.0008) [2023-12-26 09:21:26,966][123090] Updated weights for policy 1, policy_version 1214496 (0.0005) [2023-12-26 09:21:27,198][123091] Updated weights for policy 0, policy_version 1223126 (0.0007) [2023-12-26 09:21:27,248][123091] Updated weights for policy 0, policy_version 1223136 (0.0005) [2023-12-26 09:21:27,300][123091] Updated weights for policy 0, policy_version 1223146 (0.0006) [2023-12-26 09:21:27,630][123090] Updated weights for policy 1, policy_version 1214506 (0.0005) [2023-12-26 09:21:27,686][123090] Updated weights for policy 1, policy_version 1214516 (0.0005) [2023-12-26 09:21:27,748][123090] Updated weights for policy 1, policy_version 1214526 (0.0007) [2023-12-26 09:21:28,072][123091] Updated weights for policy 0, policy_version 1223156 (0.0006) [2023-12-26 09:21:28,121][123091] Updated weights for policy 0, policy_version 1223166 (0.0005) [2023-12-26 09:21:28,167][123091] Updated weights for policy 0, policy_version 1223176 (0.0010) [2023-12-26 09:21:28,455][123090] Updated weights for policy 1, policy_version 1214536 (0.0010) [2023-12-26 09:21:28,513][123090] Updated weights for policy 1, policy_version 1214546 (0.0010) [2023-12-26 09:21:28,584][123090] Updated weights for policy 1, policy_version 1214556 (0.0006) [2023-12-26 09:21:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 624066560. Throughput: 0: 8854.9, 1: 8960.4. Samples: 624058940. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:28,785][121949] Avg episode reward: [(0, '6103.743'), (1, '5831.303')] [2023-12-26 09:21:28,929][123091] Updated weights for policy 0, policy_version 1223186 (0.0010) [2023-12-26 09:21:28,987][123091] Updated weights for policy 0, policy_version 1223196 (0.0007) [2023-12-26 09:21:29,035][123091] Updated weights for policy 0, policy_version 1223206 (0.0005) [2023-12-26 09:21:29,092][123091] Updated weights for policy 0, policy_version 1223216 (0.0005) [2023-12-26 09:21:29,232][123090] Updated weights for policy 1, policy_version 1214566 (0.0006) [2023-12-26 09:21:29,286][123090] Updated weights for policy 1, policy_version 1214576 (0.0007) [2023-12-26 09:21:29,351][123090] Updated weights for policy 1, policy_version 1214586 (0.0006) [2023-12-26 09:21:29,871][123091] Updated weights for policy 0, policy_version 1223226 (0.0011) [2023-12-26 09:21:29,942][123091] Updated weights for policy 0, policy_version 1223236 (0.0009) [2023-12-26 09:21:30,010][123091] Updated weights for policy 0, policy_version 1223246 (0.0009) [2023-12-26 09:21:30,193][123090] Updated weights for policy 1, policy_version 1214596 (0.0010) [2023-12-26 09:21:30,257][123090] Updated weights for policy 1, policy_version 1214606 (0.0009) [2023-12-26 09:21:30,316][123090] Updated weights for policy 1, policy_version 1214616 (0.0007) [2023-12-26 09:21:30,833][123091] Updated weights for policy 0, policy_version 1223256 (0.0009) [2023-12-26 09:21:30,913][123091] Updated weights for policy 0, policy_version 1223266 (0.0010) [2023-12-26 09:21:30,972][123091] Updated weights for policy 0, policy_version 1223276 (0.0009) [2023-12-26 09:21:31,010][123090] Updated weights for policy 1, policy_version 1214626 (0.0008) [2023-12-26 09:21:31,074][123090] Updated weights for policy 1, policy_version 1214636 (0.0011) [2023-12-26 09:21:31,142][123090] Updated weights for policy 1, policy_version 1214646 (0.0011) [2023-12-26 09:21:31,213][123090] Updated weights for policy 1, policy_version 1214656 (0.0011) [2023-12-26 09:21:31,812][123091] Updated weights for policy 0, policy_version 1223286 (0.0009) [2023-12-26 09:21:31,861][123091] Updated weights for policy 0, policy_version 1223296 (0.0009) [2023-12-26 09:21:31,915][123091] Updated weights for policy 0, policy_version 1223306 (0.0006) [2023-12-26 09:21:32,103][123090] Updated weights for policy 1, policy_version 1214666 (0.0011) [2023-12-26 09:21:32,150][123090] Updated weights for policy 1, policy_version 1214676 (0.0008) [2023-12-26 09:21:32,199][123090] Updated weights for policy 1, policy_version 1214686 (0.0005) [2023-12-26 09:21:32,722][123091] Updated weights for policy 0, policy_version 1223316 (0.0006) [2023-12-26 09:21:32,789][123091] Updated weights for policy 0, policy_version 1223326 (0.0006) [2023-12-26 09:21:32,848][123091] Updated weights for policy 0, policy_version 1223336 (0.0011) [2023-12-26 09:21:33,009][123090] Updated weights for policy 1, policy_version 1214696 (0.0009) [2023-12-26 09:21:33,056][123090] Updated weights for policy 1, policy_version 1214706 (0.0010) [2023-12-26 09:21:33,121][123090] Updated weights for policy 1, policy_version 1214716 (0.0010) [2023-12-26 09:21:33,532][123091] Updated weights for policy 0, policy_version 1223346 (0.0009) [2023-12-26 09:21:33,584][123091] Updated weights for policy 0, policy_version 1223356 (0.0005) [2023-12-26 09:21:33,641][123091] Updated weights for policy 0, policy_version 1223366 (0.0005) [2023-12-26 09:21:33,701][123091] Updated weights for policy 0, policy_version 1223376 (0.0005) [2023-12-26 09:21:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 624156672. Throughput: 0: 8857.7, 1: 8979.6. Samples: 624167448. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:33,784][121949] Avg episode reward: [(0, '6180.712'), (1, '5788.251')] [2023-12-26 09:21:33,960][123090] Updated weights for policy 1, policy_version 1214726 (0.0010) [2023-12-26 09:21:34,013][123090] Updated weights for policy 1, policy_version 1214736 (0.0008) [2023-12-26 09:21:34,070][123090] Updated weights for policy 1, policy_version 1214746 (0.0009) [2023-12-26 09:21:34,386][123091] Updated weights for policy 0, policy_version 1223386 (0.0011) [2023-12-26 09:21:34,450][123091] Updated weights for policy 0, policy_version 1223396 (0.0011) [2023-12-26 09:21:34,519][123091] Updated weights for policy 0, policy_version 1223406 (0.0006) [2023-12-26 09:21:34,827][123090] Updated weights for policy 1, policy_version 1214756 (0.0009) [2023-12-26 09:21:34,883][123090] Updated weights for policy 1, policy_version 1214766 (0.0009) [2023-12-26 09:21:34,938][123090] Updated weights for policy 1, policy_version 1214776 (0.0009) [2023-12-26 09:21:35,208][123091] Updated weights for policy 0, policy_version 1223416 (0.0005) [2023-12-26 09:21:35,269][123091] Updated weights for policy 0, policy_version 1223426 (0.0005) [2023-12-26 09:21:35,329][123091] Updated weights for policy 0, policy_version 1223436 (0.0005) [2023-12-26 09:21:35,655][123090] Updated weights for policy 1, policy_version 1214786 (0.0008) [2023-12-26 09:21:35,729][123090] Updated weights for policy 1, policy_version 1214796 (0.0005) [2023-12-26 09:21:35,800][123090] Updated weights for policy 1, policy_version 1214806 (0.0007) [2023-12-26 09:21:35,864][123090] Updated weights for policy 1, policy_version 1214816 (0.0010) [2023-12-26 09:21:35,976][123091] Updated weights for policy 0, policy_version 1223446 (0.0009) [2023-12-26 09:21:36,026][123091] Updated weights for policy 0, policy_version 1223456 (0.0009) [2023-12-26 09:21:36,075][123091] Updated weights for policy 0, policy_version 1223466 (0.0009) [2023-12-26 09:21:36,584][123090] Updated weights for policy 1, policy_version 1214826 (0.0010) [2023-12-26 09:21:36,645][123090] Updated weights for policy 1, policy_version 1214836 (0.0006) [2023-12-26 09:21:36,716][123090] Updated weights for policy 1, policy_version 1214846 (0.0006) [2023-12-26 09:21:36,959][123091] Updated weights for policy 0, policy_version 1223476 (0.0008) [2023-12-26 09:21:37,029][123091] Updated weights for policy 0, policy_version 1223486 (0.0009) [2023-12-26 09:21:37,092][123091] Updated weights for policy 0, policy_version 1223496 (0.0010) [2023-12-26 09:21:37,452][123090] Updated weights for policy 1, policy_version 1214856 (0.0006) [2023-12-26 09:21:37,505][123090] Updated weights for policy 1, policy_version 1214866 (0.0005) [2023-12-26 09:21:37,558][123090] Updated weights for policy 1, policy_version 1214876 (0.0007) [2023-12-26 09:21:37,890][123091] Updated weights for policy 0, policy_version 1223506 (0.0010) [2023-12-26 09:21:37,948][123091] Updated weights for policy 0, policy_version 1223516 (0.0010) [2023-12-26 09:21:38,017][123091] Updated weights for policy 0, policy_version 1223527 (0.0009) [2023-12-26 09:21:38,165][123090] Updated weights for policy 1, policy_version 1214886 (0.0009) [2023-12-26 09:21:38,228][123090] Updated weights for policy 1, policy_version 1214896 (0.0009) [2023-12-26 09:21:38,284][123090] Updated weights for policy 1, policy_version 1214906 (0.0005) [2023-12-26 09:21:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 624246784. Throughput: 0: 8911.9, 1: 9039.8. Samples: 624224344. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:38,785][121949] Avg episode reward: [(0, '6051.439'), (1, '5807.426')] [2023-12-26 09:21:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001223536_313229312.pth... [2023-12-26 09:21:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001214912_311017472.pth... [2023-12-26 09:21:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001222544_312975360.pth [2023-12-26 09:21:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001213856_310747136.pth [2023-12-26 09:21:38,892][123091] Updated weights for policy 0, policy_version 1223537 (0.0009) [2023-12-26 09:21:38,944][123091] Updated weights for policy 0, policy_version 1223547 (0.0009) [2023-12-26 09:21:38,993][123091] Updated weights for policy 0, policy_version 1223557 (0.0009) [2023-12-26 09:21:39,055][123090] Updated weights for policy 1, policy_version 1214916 (0.0007) [2023-12-26 09:21:39,057][123091] Updated weights for policy 0, policy_version 1223567 (0.0008) [2023-12-26 09:21:39,116][123090] Updated weights for policy 1, policy_version 1214926 (0.0005) [2023-12-26 09:21:39,184][123090] Updated weights for policy 1, policy_version 1214936 (0.0005) [2023-12-26 09:21:39,922][123091] Updated weights for policy 0, policy_version 1223577 (0.0007) [2023-12-26 09:21:39,995][123091] Updated weights for policy 0, policy_version 1223587 (0.0007) [2023-12-26 09:21:40,045][123090] Updated weights for policy 1, policy_version 1214946 (0.0008) [2023-12-26 09:21:40,061][123091] Updated weights for policy 0, policy_version 1223597 (0.0008) [2023-12-26 09:21:40,108][123090] Updated weights for policy 1, policy_version 1214956 (0.0010) [2023-12-26 09:21:40,174][123090] Updated weights for policy 1, policy_version 1214966 (0.0009) [2023-12-26 09:21:40,246][123090] Updated weights for policy 1, policy_version 1214976 (0.0009) [2023-12-26 09:21:40,768][123091] Updated weights for policy 0, policy_version 1223607 (0.0008) [2023-12-26 09:21:40,828][123091] Updated weights for policy 0, policy_version 1223617 (0.0009) [2023-12-26 09:21:40,891][123091] Updated weights for policy 0, policy_version 1223627 (0.0010) [2023-12-26 09:21:41,039][123090] Updated weights for policy 1, policy_version 1214986 (0.0006) [2023-12-26 09:21:41,100][123090] Updated weights for policy 1, policy_version 1214996 (0.0010) [2023-12-26 09:21:41,170][123090] Updated weights for policy 1, policy_version 1215006 (0.0007) [2023-12-26 09:21:41,804][123091] Updated weights for policy 0, policy_version 1223637 (0.0010) [2023-12-26 09:21:41,869][123091] Updated weights for policy 0, policy_version 1223647 (0.0010) [2023-12-26 09:21:41,935][123091] Updated weights for policy 0, policy_version 1223657 (0.0009) [2023-12-26 09:21:41,996][123090] Updated weights for policy 1, policy_version 1215016 (0.0010) [2023-12-26 09:21:42,058][123090] Updated weights for policy 1, policy_version 1215026 (0.0010) [2023-12-26 09:21:42,108][123090] Updated weights for policy 1, policy_version 1215036 (0.0009) [2023-12-26 09:21:42,850][123091] Updated weights for policy 0, policy_version 1223667 (0.0009) [2023-12-26 09:21:42,874][123090] Updated weights for policy 1, policy_version 1215046 (0.0010) [2023-12-26 09:21:42,914][123091] Updated weights for policy 0, policy_version 1223677 (0.0006) [2023-12-26 09:21:42,929][123090] Updated weights for policy 1, policy_version 1215056 (0.0010) [2023-12-26 09:21:42,966][123091] Updated weights for policy 0, policy_version 1223687 (0.0006) [2023-12-26 09:21:42,988][123090] Updated weights for policy 1, policy_version 1215066 (0.0010) [2023-12-26 09:21:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 624328704. Throughput: 0: 8745.4, 1: 9122.8. Samples: 624328832. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:43,785][121949] Avg episode reward: [(0, '6083.090'), (1, '5889.871')] [2023-12-26 09:21:43,790][123091] Updated weights for policy 0, policy_version 1223697 (0.0010) [2023-12-26 09:21:43,801][123090] Updated weights for policy 1, policy_version 1215076 (0.0008) [2023-12-26 09:21:43,848][123091] Updated weights for policy 0, policy_version 1223707 (0.0006) [2023-12-26 09:21:43,856][123090] Updated weights for policy 1, policy_version 1215086 (0.0009) [2023-12-26 09:21:43,894][123091] Updated weights for policy 0, policy_version 1223717 (0.0005) [2023-12-26 09:21:43,904][123090] Updated weights for policy 1, policy_version 1215096 (0.0010) [2023-12-26 09:21:43,940][123091] Updated weights for policy 0, policy_version 1223727 (0.0005) [2023-12-26 09:21:44,690][123090] Updated weights for policy 1, policy_version 1215106 (0.0009) [2023-12-26 09:21:44,746][123090] Updated weights for policy 1, policy_version 1215116 (0.0006) [2023-12-26 09:21:44,786][123091] Updated weights for policy 0, policy_version 1223737 (0.0009) [2023-12-26 09:21:44,811][123090] Updated weights for policy 1, policy_version 1215126 (0.0008) [2023-12-26 09:21:44,851][123091] Updated weights for policy 0, policy_version 1223747 (0.0010) [2023-12-26 09:21:44,886][123090] Updated weights for policy 1, policy_version 1215136 (0.0009) [2023-12-26 09:21:44,909][123091] Updated weights for policy 0, policy_version 1223757 (0.0008) [2023-12-26 09:21:45,677][123091] Updated weights for policy 0, policy_version 1223767 (0.0007) [2023-12-26 09:21:45,686][123090] Updated weights for policy 1, policy_version 1215146 (0.0011) [2023-12-26 09:21:45,724][123091] Updated weights for policy 0, policy_version 1223777 (0.0008) [2023-12-26 09:21:45,746][123090] Updated weights for policy 1, policy_version 1215156 (0.0010) [2023-12-26 09:21:45,784][123091] Updated weights for policy 0, policy_version 1223787 (0.0010) [2023-12-26 09:21:45,809][123090] Updated weights for policy 1, policy_version 1215166 (0.0010) [2023-12-26 09:21:46,491][123091] Updated weights for policy 0, policy_version 1223797 (0.0008) [2023-12-26 09:21:46,550][123091] Updated weights for policy 0, policy_version 1223807 (0.0009) [2023-12-26 09:21:46,617][123091] Updated weights for policy 0, policy_version 1223817 (0.0008) [2023-12-26 09:21:46,627][123090] Updated weights for policy 1, policy_version 1215176 (0.0010) [2023-12-26 09:21:46,693][123090] Updated weights for policy 1, policy_version 1215186 (0.0010) [2023-12-26 09:21:46,745][123090] Updated weights for policy 1, policy_version 1215196 (0.0010) [2023-12-26 09:21:47,450][123091] Updated weights for policy 0, policy_version 1223827 (0.0006) [2023-12-26 09:21:47,460][123090] Updated weights for policy 1, policy_version 1215206 (0.0010) [2023-12-26 09:21:47,507][123090] Updated weights for policy 1, policy_version 1215216 (0.0009) [2023-12-26 09:21:47,511][123091] Updated weights for policy 0, policy_version 1223837 (0.0006) [2023-12-26 09:21:47,561][123090] Updated weights for policy 1, policy_version 1215226 (0.0005) [2023-12-26 09:21:47,576][123091] Updated weights for policy 0, policy_version 1223847 (0.0008) [2023-12-26 09:21:48,264][123090] Updated weights for policy 1, policy_version 1215236 (0.0007) [2023-12-26 09:21:48,274][123091] Updated weights for policy 0, policy_version 1223857 (0.0006) [2023-12-26 09:21:48,323][123090] Updated weights for policy 1, policy_version 1215246 (0.0008) [2023-12-26 09:21:48,338][123091] Updated weights for policy 0, policy_version 1223867 (0.0008) [2023-12-26 09:21:48,393][123090] Updated weights for policy 1, policy_version 1215256 (0.0007) [2023-12-26 09:21:48,404][123091] Updated weights for policy 0, policy_version 1223877 (0.0008) [2023-12-26 09:21:48,466][123091] Updated weights for policy 0, policy_version 1223887 (0.0008) [2023-12-26 09:21:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17883.6). Total num frames: 624427008. Throughput: 0: 8709.5, 1: 9067.7. Samples: 624437100. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:48,785][121949] Avg episode reward: [(0, '6166.261'), (1, '5785.449')] [2023-12-26 09:21:49,086][123090] Updated weights for policy 1, policy_version 1215266 (0.0006) [2023-12-26 09:21:49,143][123090] Updated weights for policy 1, policy_version 1215276 (0.0005) [2023-12-26 09:21:49,171][123091] Updated weights for policy 0, policy_version 1223897 (0.0009) [2023-12-26 09:21:49,198][123090] Updated weights for policy 1, policy_version 1215286 (0.0007) [2023-12-26 09:21:49,227][123091] Updated weights for policy 0, policy_version 1223907 (0.0009) [2023-12-26 09:21:49,265][123090] Updated weights for policy 1, policy_version 1215296 (0.0008) [2023-12-26 09:21:49,281][123091] Updated weights for policy 0, policy_version 1223917 (0.0010) [2023-12-26 09:21:50,106][123091] Updated weights for policy 0, policy_version 1223927 (0.0007) [2023-12-26 09:21:50,148][123090] Updated weights for policy 1, policy_version 1215306 (0.0010) [2023-12-26 09:21:50,171][123091] Updated weights for policy 0, policy_version 1223937 (0.0005) [2023-12-26 09:21:50,201][123090] Updated weights for policy 1, policy_version 1215316 (0.0010) [2023-12-26 09:21:50,238][123091] Updated weights for policy 0, policy_version 1223947 (0.0006) [2023-12-26 09:21:50,254][123090] Updated weights for policy 1, policy_version 1215326 (0.0010) [2023-12-26 09:21:50,934][123091] Updated weights for policy 0, policy_version 1223957 (0.0007) [2023-12-26 09:21:50,984][123091] Updated weights for policy 0, policy_version 1223967 (0.0006) [2023-12-26 09:21:51,054][123091] Updated weights for policy 0, policy_version 1223977 (0.0007) [2023-12-26 09:21:51,069][123090] Updated weights for policy 1, policy_version 1215336 (0.0009) [2023-12-26 09:21:51,140][123090] Updated weights for policy 1, policy_version 1215346 (0.0009) [2023-12-26 09:21:51,205][123090] Updated weights for policy 1, policy_version 1215356 (0.0009) [2023-12-26 09:21:51,871][123091] Updated weights for policy 0, policy_version 1223987 (0.0008) [2023-12-26 09:21:51,943][123091] Updated weights for policy 0, policy_version 1223997 (0.0010) [2023-12-26 09:21:52,007][123091] Updated weights for policy 0, policy_version 1224007 (0.0010) [2023-12-26 09:21:52,060][123090] Updated weights for policy 1, policy_version 1215366 (0.0010) [2023-12-26 09:21:52,120][123090] Updated weights for policy 1, policy_version 1215376 (0.0009) [2023-12-26 09:21:52,175][123090] Updated weights for policy 1, policy_version 1215386 (0.0010) [2023-12-26 09:21:52,825][123091] Updated weights for policy 0, policy_version 1224017 (0.0007) [2023-12-26 09:21:52,879][123091] Updated weights for policy 0, policy_version 1224027 (0.0009) [2023-12-26 09:21:52,940][123091] Updated weights for policy 0, policy_version 1224037 (0.0010) [2023-12-26 09:21:52,989][123090] Updated weights for policy 1, policy_version 1215396 (0.0009) [2023-12-26 09:21:53,003][123091] Updated weights for policy 0, policy_version 1224047 (0.0008) [2023-12-26 09:21:53,062][123090] Updated weights for policy 1, policy_version 1215406 (0.0009) [2023-12-26 09:21:53,141][123090] Updated weights for policy 1, policy_version 1215416 (0.0006) [2023-12-26 09:21:53,777][123090] Updated weights for policy 1, policy_version 1215426 (0.0006) [2023-12-26 09:21:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 624508928. Throughput: 0: 8706.9, 1: 9020.0. Samples: 624491072. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:53,785][121949] Avg episode reward: [(0, '6105.250'), (1, '5748.222')] [2023-12-26 09:21:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001224048_313360384.pth... [2023-12-26 09:21:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001223024_313098240.pth [2023-12-26 09:21:53,836][123090] Updated weights for policy 1, policy_version 1215436 (0.0006) [2023-12-26 09:21:53,903][123090] Updated weights for policy 1, policy_version 1215446 (0.0006) [2023-12-26 09:21:53,904][123091] Updated weights for policy 0, policy_version 1224057 (0.0009) [2023-12-26 09:21:53,954][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001215456_311156736.pth... [2023-12-26 09:21:53,955][123090] Updated weights for policy 1, policy_version 1215456 (0.0006) [2023-12-26 09:21:53,959][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001214368_310878208.pth [2023-12-26 09:21:53,973][123091] Updated weights for policy 0, policy_version 1224067 (0.0009) [2023-12-26 09:21:54,046][123091] Updated weights for policy 0, policy_version 1224077 (0.0010) [2023-12-26 09:21:54,751][123090] Updated weights for policy 1, policy_version 1215466 (0.0010) [2023-12-26 09:21:54,810][123090] Updated weights for policy 1, policy_version 1215476 (0.0007) [2023-12-26 09:21:54,857][123090] Updated weights for policy 1, policy_version 1215486 (0.0009) [2023-12-26 09:21:54,877][123091] Updated weights for policy 0, policy_version 1224087 (0.0010) [2023-12-26 09:21:54,936][123091] Updated weights for policy 0, policy_version 1224097 (0.0009) [2023-12-26 09:21:54,999][123091] Updated weights for policy 0, policy_version 1224107 (0.0007) [2023-12-26 09:21:55,540][123090] Updated weights for policy 1, policy_version 1215496 (0.0008) [2023-12-26 09:21:55,587][123090] Updated weights for policy 1, policy_version 1215506 (0.0009) [2023-12-26 09:21:55,638][123090] Updated weights for policy 1, policy_version 1215516 (0.0009) [2023-12-26 09:21:55,881][123091] Updated weights for policy 0, policy_version 1224117 (0.0010) [2023-12-26 09:21:55,935][123091] Updated weights for policy 0, policy_version 1224127 (0.0009) [2023-12-26 09:21:56,001][123091] Updated weights for policy 0, policy_version 1224137 (0.0009) [2023-12-26 09:21:56,344][123090] Updated weights for policy 1, policy_version 1215527 (0.0007) [2023-12-26 09:21:56,408][123090] Updated weights for policy 1, policy_version 1215537 (0.0005) [2023-12-26 09:21:56,475][123090] Updated weights for policy 1, policy_version 1215547 (0.0005) [2023-12-26 09:21:56,881][123091] Updated weights for policy 0, policy_version 1224147 (0.0009) [2023-12-26 09:21:56,936][123091] Updated weights for policy 0, policy_version 1224157 (0.0005) [2023-12-26 09:21:56,990][123091] Updated weights for policy 0, policy_version 1224167 (0.0007) [2023-12-26 09:21:57,077][123090] Updated weights for policy 1, policy_version 1215557 (0.0007) [2023-12-26 09:21:57,130][123090] Updated weights for policy 1, policy_version 1215567 (0.0009) [2023-12-26 09:21:57,179][123090] Updated weights for policy 1, policy_version 1215577 (0.0009) [2023-12-26 09:21:57,721][123091] Updated weights for policy 0, policy_version 1224177 (0.0007) [2023-12-26 09:21:57,787][123091] Updated weights for policy 0, policy_version 1224187 (0.0011) [2023-12-26 09:21:57,845][123091] Updated weights for policy 0, policy_version 1224197 (0.0010) [2023-12-26 09:21:57,896][123091] Updated weights for policy 0, policy_version 1224207 (0.0010) [2023-12-26 09:21:57,964][123090] Updated weights for policy 1, policy_version 1215587 (0.0006) [2023-12-26 09:21:58,020][123090] Updated weights for policy 1, policy_version 1215597 (0.0008) [2023-12-26 09:21:58,092][123090] Updated weights for policy 1, policy_version 1215607 (0.0008) [2023-12-26 09:21:58,766][123091] Updated weights for policy 0, policy_version 1224217 (0.0008) [2023-12-26 09:21:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 624599040. Throughput: 0: 8717.3, 1: 9117.4. Samples: 624598624. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:21:58,785][121949] Avg episode reward: [(0, '6079.375'), (1, '5832.745')] [2023-12-26 09:21:58,837][123091] Updated weights for policy 0, policy_version 1224227 (0.0008) [2023-12-26 09:21:58,914][123091] Updated weights for policy 0, policy_version 1224237 (0.0008) [2023-12-26 09:21:58,994][123090] Updated weights for policy 1, policy_version 1215617 (0.0009) [2023-12-26 09:21:59,063][123090] Updated weights for policy 1, policy_version 1215627 (0.0008) [2023-12-26 09:21:59,133][123090] Updated weights for policy 1, policy_version 1215637 (0.0008) [2023-12-26 09:21:59,209][123090] Updated weights for policy 1, policy_version 1215647 (0.0008) [2023-12-26 09:21:59,781][123091] Updated weights for policy 0, policy_version 1224247 (0.0005) [2023-12-26 09:21:59,839][123091] Updated weights for policy 0, policy_version 1224257 (0.0006) [2023-12-26 09:21:59,899][123091] Updated weights for policy 0, policy_version 1224267 (0.0010) [2023-12-26 09:21:59,975][123090] Updated weights for policy 1, policy_version 1215657 (0.0008) [2023-12-26 09:22:00,041][123090] Updated weights for policy 1, policy_version 1215667 (0.0008) [2023-12-26 09:22:00,106][123090] Updated weights for policy 1, policy_version 1215677 (0.0008) [2023-12-26 09:22:00,682][123091] Updated weights for policy 0, policy_version 1224277 (0.0011) [2023-12-26 09:22:00,738][123091] Updated weights for policy 0, policy_version 1224287 (0.0010) [2023-12-26 09:22:00,800][123091] Updated weights for policy 0, policy_version 1224297 (0.0010) [2023-12-26 09:22:00,842][123090] Updated weights for policy 1, policy_version 1215687 (0.0009) [2023-12-26 09:22:00,891][123090] Updated weights for policy 1, policy_version 1215697 (0.0009) [2023-12-26 09:22:00,939][123090] Updated weights for policy 1, policy_version 1215707 (0.0009) [2023-12-26 09:22:01,623][123091] Updated weights for policy 0, policy_version 1224307 (0.0008) [2023-12-26 09:22:01,697][123091] Updated weights for policy 0, policy_version 1224317 (0.0007) [2023-12-26 09:22:01,764][123091] Updated weights for policy 0, policy_version 1224327 (0.0008) [2023-12-26 09:22:01,786][123090] Updated weights for policy 1, policy_version 1215717 (0.0008) [2023-12-26 09:22:01,847][123090] Updated weights for policy 1, policy_version 1215727 (0.0008) [2023-12-26 09:22:01,915][123090] Updated weights for policy 1, policy_version 1215737 (0.0009) [2023-12-26 09:22:02,501][123091] Updated weights for policy 0, policy_version 1224337 (0.0010) [2023-12-26 09:22:02,567][123091] Updated weights for policy 0, policy_version 1224347 (0.0010) [2023-12-26 09:22:02,632][123091] Updated weights for policy 0, policy_version 1224357 (0.0009) [2023-12-26 09:22:02,690][123091] Updated weights for policy 0, policy_version 1224367 (0.0009) [2023-12-26 09:22:02,727][123090] Updated weights for policy 1, policy_version 1215747 (0.0009) [2023-12-26 09:22:02,783][123090] Updated weights for policy 1, policy_version 1215757 (0.0009) [2023-12-26 09:22:02,843][123090] Updated weights for policy 1, policy_version 1215767 (0.0010) [2023-12-26 09:22:03,441][123091] Updated weights for policy 0, policy_version 1224377 (0.0005) [2023-12-26 09:22:03,513][123091] Updated weights for policy 0, policy_version 1224387 (0.0005) [2023-12-26 09:22:03,581][123091] Updated weights for policy 0, policy_version 1224397 (0.0005) [2023-12-26 09:22:03,761][123090] Updated weights for policy 1, policy_version 1215777 (0.0010) [2023-12-26 09:22:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 624689152. Throughput: 0: 8804.3, 1: 9029.4. Samples: 624703264. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:03,785][121949] Avg episode reward: [(0, '6078.661'), (1, '5800.549')] [2023-12-26 09:22:03,814][123090] Updated weights for policy 1, policy_version 1215787 (0.0010) [2023-12-26 09:22:03,874][123090] Updated weights for policy 1, policy_version 1215797 (0.0010) [2023-12-26 09:22:03,945][123090] Updated weights for policy 1, policy_version 1215807 (0.0009) [2023-12-26 09:22:04,168][123091] Updated weights for policy 0, policy_version 1224407 (0.0006) [2023-12-26 09:22:04,218][123091] Updated weights for policy 0, policy_version 1224417 (0.0006) [2023-12-26 09:22:04,275][123091] Updated weights for policy 0, policy_version 1224427 (0.0008) [2023-12-26 09:22:04,880][123090] Updated weights for policy 1, policy_version 1215817 (0.0010) [2023-12-26 09:22:04,950][123090] Updated weights for policy 1, policy_version 1215827 (0.0009) [2023-12-26 09:22:04,998][123091] Updated weights for policy 0, policy_version 1224437 (0.0007) [2023-12-26 09:22:05,019][123090] Updated weights for policy 1, policy_version 1215837 (0.0008) [2023-12-26 09:22:05,050][123091] Updated weights for policy 0, policy_version 1224447 (0.0005) [2023-12-26 09:22:05,105][123091] Updated weights for policy 0, policy_version 1224457 (0.0008) [2023-12-26 09:22:05,789][123090] Updated weights for policy 1, policy_version 1215847 (0.0006) [2023-12-26 09:22:05,854][123090] Updated weights for policy 1, policy_version 1215857 (0.0005) [2023-12-26 09:22:05,881][123091] Updated weights for policy 0, policy_version 1224467 (0.0008) [2023-12-26 09:22:05,916][123090] Updated weights for policy 1, policy_version 1215867 (0.0010) [2023-12-26 09:22:05,937][123091] Updated weights for policy 0, policy_version 1224477 (0.0008) [2023-12-26 09:22:05,988][123091] Updated weights for policy 0, policy_version 1224487 (0.0009) [2023-12-26 09:22:06,652][123090] Updated weights for policy 1, policy_version 1215877 (0.0009) [2023-12-26 09:22:06,712][123090] Updated weights for policy 1, policy_version 1215887 (0.0009) [2023-12-26 09:22:06,779][123090] Updated weights for policy 1, policy_version 1215897 (0.0009) [2023-12-26 09:22:06,816][123091] Updated weights for policy 0, policy_version 1224497 (0.0008) [2023-12-26 09:22:06,872][123091] Updated weights for policy 0, policy_version 1224507 (0.0009) [2023-12-26 09:22:06,930][123091] Updated weights for policy 0, policy_version 1224517 (0.0009) [2023-12-26 09:22:06,988][123091] Updated weights for policy 0, policy_version 1224527 (0.0010) [2023-12-26 09:22:07,468][123090] Updated weights for policy 1, policy_version 1215907 (0.0008) [2023-12-26 09:22:07,538][123090] Updated weights for policy 1, policy_version 1215917 (0.0005) [2023-12-26 09:22:07,602][123090] Updated weights for policy 1, policy_version 1215927 (0.0005) [2023-12-26 09:22:07,890][123091] Updated weights for policy 0, policy_version 1224537 (0.0009) [2023-12-26 09:22:07,964][123091] Updated weights for policy 0, policy_version 1224547 (0.0009) [2023-12-26 09:22:08,039][123091] Updated weights for policy 0, policy_version 1224557 (0.0006) [2023-12-26 09:22:08,202][123090] Updated weights for policy 1, policy_version 1215937 (0.0005) [2023-12-26 09:22:08,272][123090] Updated weights for policy 1, policy_version 1215947 (0.0006) [2023-12-26 09:22:08,339][123090] Updated weights for policy 1, policy_version 1215957 (0.0007) [2023-12-26 09:22:08,412][123090] Updated weights for policy 1, policy_version 1215967 (0.0006) [2023-12-26 09:22:08,722][123091] Updated weights for policy 0, policy_version 1224567 (0.0006) [2023-12-26 09:22:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 624779264. Throughput: 0: 8880.8, 1: 8993.6. Samples: 624756524. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:08,786][121949] Avg episode reward: [(0, '6143.295'), (1, '5632.288')] [2023-12-26 09:22:08,791][123091] Updated weights for policy 0, policy_version 1224577 (0.0006) [2023-12-26 09:22:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001215968_311287808.pth... [2023-12-26 09:22:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001214912_311017472.pth [2023-12-26 09:22:08,864][123091] Updated weights for policy 0, policy_version 1224587 (0.0006) [2023-12-26 09:22:08,894][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001224592_313499648.pth... [2023-12-26 09:22:08,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001223536_313229312.pth [2023-12-26 09:22:09,080][123090] Updated weights for policy 1, policy_version 1215977 (0.0007) [2023-12-26 09:22:09,140][123090] Updated weights for policy 1, policy_version 1215987 (0.0009) [2023-12-26 09:22:09,202][123090] Updated weights for policy 1, policy_version 1215997 (0.0009) [2023-12-26 09:22:09,597][123091] Updated weights for policy 0, policy_version 1224597 (0.0008) [2023-12-26 09:22:09,657][123091] Updated weights for policy 0, policy_version 1224607 (0.0010) [2023-12-26 09:22:09,712][123091] Updated weights for policy 0, policy_version 1224617 (0.0011) [2023-12-26 09:22:10,090][123090] Updated weights for policy 1, policy_version 1216007 (0.0009) [2023-12-26 09:22:10,158][123090] Updated weights for policy 1, policy_version 1216017 (0.0009) [2023-12-26 09:22:10,222][123090] Updated weights for policy 1, policy_version 1216027 (0.0009) [2023-12-26 09:22:10,542][123091] Updated weights for policy 0, policy_version 1224627 (0.0011) [2023-12-26 09:22:10,609][123091] Updated weights for policy 0, policy_version 1224637 (0.0011) [2023-12-26 09:22:10,673][123091] Updated weights for policy 0, policy_version 1224647 (0.0011) [2023-12-26 09:22:11,066][123090] Updated weights for policy 1, policy_version 1216037 (0.0009) [2023-12-26 09:22:11,134][123090] Updated weights for policy 1, policy_version 1216047 (0.0009) [2023-12-26 09:22:11,205][123090] Updated weights for policy 1, policy_version 1216057 (0.0009) [2023-12-26 09:22:11,528][123091] Updated weights for policy 0, policy_version 1224657 (0.0011) [2023-12-26 09:22:11,595][123091] Updated weights for policy 0, policy_version 1224667 (0.0009) [2023-12-26 09:22:11,667][123091] Updated weights for policy 0, policy_version 1224677 (0.0007) [2023-12-26 09:22:11,733][123091] Updated weights for policy 0, policy_version 1224687 (0.0007) [2023-12-26 09:22:12,077][123090] Updated weights for policy 1, policy_version 1216067 (0.0009) [2023-12-26 09:22:12,127][123090] Updated weights for policy 1, policy_version 1216077 (0.0009) [2023-12-26 09:22:12,185][123090] Updated weights for policy 1, policy_version 1216087 (0.0009) [2023-12-26 09:22:12,577][123091] Updated weights for policy 0, policy_version 1224697 (0.0009) [2023-12-26 09:22:12,642][123091] Updated weights for policy 0, policy_version 1224707 (0.0009) [2023-12-26 09:22:12,709][123091] Updated weights for policy 0, policy_version 1224717 (0.0009) [2023-12-26 09:22:13,022][123090] Updated weights for policy 1, policy_version 1216097 (0.0009) [2023-12-26 09:22:13,089][123090] Updated weights for policy 1, policy_version 1216107 (0.0010) [2023-12-26 09:22:13,151][123090] Updated weights for policy 1, policy_version 1216117 (0.0010) [2023-12-26 09:22:13,218][123090] Updated weights for policy 1, policy_version 1216127 (0.0010) [2023-12-26 09:22:13,542][123091] Updated weights for policy 0, policy_version 1224727 (0.0009) [2023-12-26 09:22:13,611][123091] Updated weights for policy 0, policy_version 1224737 (0.0009) [2023-12-26 09:22:13,676][123091] Updated weights for policy 0, policy_version 1224747 (0.0009) [2023-12-26 09:22:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 624869376. Throughput: 0: 8846.0, 1: 9003.6. Samples: 624862168. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:13,785][121949] Avg episode reward: [(0, '6226.434'), (1, '5704.271')] [2023-12-26 09:22:14,045][123090] Updated weights for policy 1, policy_version 1216137 (0.0010) [2023-12-26 09:22:14,096][123090] Updated weights for policy 1, policy_version 1216147 (0.0010) [2023-12-26 09:22:14,157][123090] Updated weights for policy 1, policy_version 1216157 (0.0010) [2023-12-26 09:22:14,391][123091] Updated weights for policy 0, policy_version 1224757 (0.0009) [2023-12-26 09:22:14,439][123091] Updated weights for policy 0, policy_version 1224767 (0.0009) [2023-12-26 09:22:14,490][123091] Updated weights for policy 0, policy_version 1224777 (0.0008) [2023-12-26 09:22:15,003][123090] Updated weights for policy 1, policy_version 1216167 (0.0011) [2023-12-26 09:22:15,071][123090] Updated weights for policy 1, policy_version 1216177 (0.0011) [2023-12-26 09:22:15,132][123090] Updated weights for policy 1, policy_version 1216187 (0.0011) [2023-12-26 09:22:15,346][123091] Updated weights for policy 0, policy_version 1224787 (0.0009) [2023-12-26 09:22:15,399][123091] Updated weights for policy 0, policy_version 1224797 (0.0010) [2023-12-26 09:22:15,452][123091] Updated weights for policy 0, policy_version 1224807 (0.0010) [2023-12-26 09:22:15,830][123090] Updated weights for policy 1, policy_version 1216197 (0.0008) [2023-12-26 09:22:15,898][123090] Updated weights for policy 1, policy_version 1216207 (0.0005) [2023-12-26 09:22:15,976][123090] Updated weights for policy 1, policy_version 1216217 (0.0005) [2023-12-26 09:22:16,399][123091] Updated weights for policy 0, policy_version 1224817 (0.0010) [2023-12-26 09:22:16,471][123091] Updated weights for policy 0, policy_version 1224827 (0.0009) [2023-12-26 09:22:16,526][123091] Updated weights for policy 0, policy_version 1224837 (0.0009) [2023-12-26 09:22:16,535][123090] Updated weights for policy 1, policy_version 1216227 (0.0007) [2023-12-26 09:22:16,580][123091] Updated weights for policy 0, policy_version 1224847 (0.0008) [2023-12-26 09:22:16,595][123090] Updated weights for policy 1, policy_version 1216237 (0.0010) [2023-12-26 09:22:16,664][123090] Updated weights for policy 1, policy_version 1216247 (0.0009) [2023-12-26 09:22:17,422][123090] Updated weights for policy 1, policy_version 1216257 (0.0010) [2023-12-26 09:22:17,456][123091] Updated weights for policy 0, policy_version 1224857 (0.0009) [2023-12-26 09:22:17,477][123090] Updated weights for policy 1, policy_version 1216267 (0.0008) [2023-12-26 09:22:17,519][123091] Updated weights for policy 0, policy_version 1224867 (0.0008) [2023-12-26 09:22:17,537][123090] Updated weights for policy 1, policy_version 1216277 (0.0008) [2023-12-26 09:22:17,580][123091] Updated weights for policy 0, policy_version 1224877 (0.0007) [2023-12-26 09:22:17,589][123090] Updated weights for policy 1, policy_version 1216287 (0.0007) [2023-12-26 09:22:18,328][123090] Updated weights for policy 1, policy_version 1216297 (0.0009) [2023-12-26 09:22:18,383][123091] Updated weights for policy 0, policy_version 1224887 (0.0008) [2023-12-26 09:22:18,400][123090] Updated weights for policy 1, policy_version 1216307 (0.0008) [2023-12-26 09:22:18,439][123091] Updated weights for policy 0, policy_version 1224897 (0.0006) [2023-12-26 09:22:18,469][123090] Updated weights for policy 1, policy_version 1216317 (0.0009) [2023-12-26 09:22:18,502][123091] Updated weights for policy 0, policy_version 1224907 (0.0005) [2023-12-26 09:22:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 624959488. Throughput: 0: 8770.5, 1: 9026.4. Samples: 624968316. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:18,785][121949] Avg episode reward: [(0, '6277.684'), (1, '5822.112')] [2023-12-26 09:22:19,228][123091] Updated weights for policy 0, policy_version 1224917 (0.0008) [2023-12-26 09:22:19,301][123091] Updated weights for policy 0, policy_version 1224927 (0.0009) [2023-12-26 09:22:19,315][123090] Updated weights for policy 1, policy_version 1216327 (0.0009) [2023-12-26 09:22:19,365][123091] Updated weights for policy 0, policy_version 1224937 (0.0007) [2023-12-26 09:22:19,387][123090] Updated weights for policy 1, policy_version 1216337 (0.0009) [2023-12-26 09:22:19,450][123090] Updated weights for policy 1, policy_version 1216347 (0.0006) [2023-12-26 09:22:20,221][123091] Updated weights for policy 0, policy_version 1224947 (0.0010) [2023-12-26 09:22:20,279][123091] Updated weights for policy 0, policy_version 1224957 (0.0008) [2023-12-26 09:22:20,281][123090] Updated weights for policy 1, policy_version 1216357 (0.0011) [2023-12-26 09:22:20,329][123090] Updated weights for policy 1, policy_version 1216367 (0.0010) [2023-12-26 09:22:20,343][123091] Updated weights for policy 0, policy_version 1224967 (0.0009) [2023-12-26 09:22:20,386][123090] Updated weights for policy 1, policy_version 1216377 (0.0011) [2023-12-26 09:22:21,188][123091] Updated weights for policy 0, policy_version 1224977 (0.0008) [2023-12-26 09:22:21,242][123090] Updated weights for policy 1, policy_version 1216387 (0.0011) [2023-12-26 09:22:21,258][123091] Updated weights for policy 0, policy_version 1224987 (0.0009) [2023-12-26 09:22:21,303][123090] Updated weights for policy 1, policy_version 1216397 (0.0011) [2023-12-26 09:22:21,323][123091] Updated weights for policy 0, policy_version 1224997 (0.0007) [2023-12-26 09:22:21,366][123090] Updated weights for policy 1, policy_version 1216407 (0.0010) [2023-12-26 09:22:21,396][123091] Updated weights for policy 0, policy_version 1225007 (0.0009) [2023-12-26 09:22:22,211][123090] Updated weights for policy 1, policy_version 1216417 (0.0010) [2023-12-26 09:22:22,218][123091] Updated weights for policy 0, policy_version 1225017 (0.0009) [2023-12-26 09:22:22,275][123090] Updated weights for policy 1, policy_version 1216427 (0.0011) [2023-12-26 09:22:22,277][123091] Updated weights for policy 0, policy_version 1225027 (0.0006) [2023-12-26 09:22:22,335][123091] Updated weights for policy 0, policy_version 1225037 (0.0006) [2023-12-26 09:22:22,340][123090] Updated weights for policy 1, policy_version 1216437 (0.0011) [2023-12-26 09:22:22,407][123090] Updated weights for policy 1, policy_version 1216447 (0.0011) [2023-12-26 09:22:23,177][123091] Updated weights for policy 0, policy_version 1225047 (0.0008) [2023-12-26 09:22:23,226][123091] Updated weights for policy 0, policy_version 1225057 (0.0010) [2023-12-26 09:22:23,228][123090] Updated weights for policy 1, policy_version 1216457 (0.0010) [2023-12-26 09:22:23,273][123091] Updated weights for policy 0, policy_version 1225067 (0.0006) [2023-12-26 09:22:23,283][123090] Updated weights for policy 1, policy_version 1216467 (0.0010) [2023-12-26 09:22:23,345][123090] Updated weights for policy 1, policy_version 1216477 (0.0010) [2023-12-26 09:22:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 625041408. Throughput: 0: 8670.8, 1: 8977.4. Samples: 625018516. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:23,785][121949] Avg episode reward: [(0, '6331.311'), (1, '5764.694')] [2023-12-26 09:22:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001225072_313622528.pth... [2023-12-26 09:22:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001216480_311418880.pth... [2023-12-26 09:22:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001224048_313360384.pth [2023-12-26 09:22:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001215456_311156736.pth [2023-12-26 09:22:24,129][123091] Updated weights for policy 0, policy_version 1225077 (0.0009) [2023-12-26 09:22:24,176][123090] Updated weights for policy 1, policy_version 1216487 (0.0010) [2023-12-26 09:22:24,184][123091] Updated weights for policy 0, policy_version 1225087 (0.0009) [2023-12-26 09:22:24,236][123090] Updated weights for policy 1, policy_version 1216497 (0.0011) [2023-12-26 09:22:24,242][123091] Updated weights for policy 0, policy_version 1225097 (0.0010) [2023-12-26 09:22:24,303][123090] Updated weights for policy 1, policy_version 1216507 (0.0011) [2023-12-26 09:22:25,012][123091] Updated weights for policy 0, policy_version 1225107 (0.0008) [2023-12-26 09:22:25,073][123091] Updated weights for policy 0, policy_version 1225117 (0.0009) [2023-12-26 09:22:25,114][123090] Updated weights for policy 1, policy_version 1216517 (0.0010) [2023-12-26 09:22:25,135][123091] Updated weights for policy 0, policy_version 1225127 (0.0008) [2023-12-26 09:22:25,169][123090] Updated weights for policy 1, policy_version 1216527 (0.0009) [2023-12-26 09:22:25,222][123090] Updated weights for policy 1, policy_version 1216537 (0.0009) [2023-12-26 09:22:25,946][123091] Updated weights for policy 0, policy_version 1225137 (0.0007) [2023-12-26 09:22:26,010][123091] Updated weights for policy 0, policy_version 1225148 (0.0010) [2023-12-26 09:22:26,042][123090] Updated weights for policy 1, policy_version 1216547 (0.0008) [2023-12-26 09:22:26,069][123091] Updated weights for policy 0, policy_version 1225158 (0.0009) [2023-12-26 09:22:26,091][123090] Updated weights for policy 1, policy_version 1216557 (0.0005) [2023-12-26 09:22:26,119][123091] Updated weights for policy 0, policy_version 1225168 (0.0008) [2023-12-26 09:22:26,142][123090] Updated weights for policy 1, policy_version 1216567 (0.0010) [2023-12-26 09:22:26,899][123090] Updated weights for policy 1, policy_version 1216577 (0.0007) [2023-12-26 09:22:26,961][123090] Updated weights for policy 1, policy_version 1216587 (0.0008) [2023-12-26 09:22:26,998][123091] Updated weights for policy 0, policy_version 1225178 (0.0009) [2023-12-26 09:22:27,022][123090] Updated weights for policy 1, policy_version 1216597 (0.0009) [2023-12-26 09:22:27,051][123091] Updated weights for policy 0, policy_version 1225188 (0.0008) [2023-12-26 09:22:27,079][123090] Updated weights for policy 1, policy_version 1216607 (0.0008) [2023-12-26 09:22:27,113][123091] Updated weights for policy 0, policy_version 1225198 (0.0008) [2023-12-26 09:22:27,906][123090] Updated weights for policy 1, policy_version 1216617 (0.0008) [2023-12-26 09:22:27,916][123091] Updated weights for policy 0, policy_version 1225208 (0.0009) [2023-12-26 09:22:27,961][123090] Updated weights for policy 1, policy_version 1216627 (0.0009) [2023-12-26 09:22:27,979][123091] Updated weights for policy 0, policy_version 1225218 (0.0008) [2023-12-26 09:22:28,012][123090] Updated weights for policy 1, policy_version 1216637 (0.0009) [2023-12-26 09:22:28,032][123091] Updated weights for policy 0, policy_version 1225228 (0.0008) [2023-12-26 09:22:28,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 625123328. Throughput: 0: 8691.3, 1: 8934.0. Samples: 625121972. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:28,785][121949] Avg episode reward: [(0, '6291.619'), (1, '5805.942')] [2023-12-26 09:22:28,837][123090] Updated weights for policy 1, policy_version 1216647 (0.0009) [2023-12-26 09:22:28,866][123091] Updated weights for policy 0, policy_version 1225238 (0.0007) [2023-12-26 09:22:28,891][123090] Updated weights for policy 1, policy_version 1216657 (0.0009) [2023-12-26 09:22:28,928][123091] Updated weights for policy 0, policy_version 1225248 (0.0008) [2023-12-26 09:22:28,945][123090] Updated weights for policy 1, policy_version 1216667 (0.0007) [2023-12-26 09:22:28,997][123091] Updated weights for policy 0, policy_version 1225258 (0.0008) [2023-12-26 09:22:29,791][123090] Updated weights for policy 1, policy_version 1216677 (0.0009) [2023-12-26 09:22:29,801][123091] Updated weights for policy 0, policy_version 1225268 (0.0009) [2023-12-26 09:22:29,860][123090] Updated weights for policy 1, policy_version 1216688 (0.0010) [2023-12-26 09:22:29,860][123091] Updated weights for policy 0, policy_version 1225278 (0.0008) [2023-12-26 09:22:29,929][123090] Updated weights for policy 1, policy_version 1216698 (0.0009) [2023-12-26 09:22:29,931][123091] Updated weights for policy 0, policy_version 1225288 (0.0007) [2023-12-26 09:22:30,757][123090] Updated weights for policy 1, policy_version 1216708 (0.0009) [2023-12-26 09:22:30,764][123091] Updated weights for policy 0, policy_version 1225298 (0.0008) [2023-12-26 09:22:30,806][123090] Updated weights for policy 1, policy_version 1216718 (0.0008) [2023-12-26 09:22:30,812][123091] Updated weights for policy 0, policy_version 1225308 (0.0008) [2023-12-26 09:22:30,858][123090] Updated weights for policy 1, policy_version 1216728 (0.0007) [2023-12-26 09:22:30,865][123091] Updated weights for policy 0, policy_version 1225318 (0.0008) [2023-12-26 09:22:30,915][123091] Updated weights for policy 0, policy_version 1225328 (0.0009) [2023-12-26 09:22:31,657][123090] Updated weights for policy 1, policy_version 1216738 (0.0008) [2023-12-26 09:22:31,713][123090] Updated weights for policy 1, policy_version 1216748 (0.0010) [2023-12-26 09:22:31,786][123090] Updated weights for policy 1, policy_version 1216758 (0.0008) [2023-12-26 09:22:31,794][123091] Updated weights for policy 0, policy_version 1225338 (0.0008) [2023-12-26 09:22:31,846][123090] Updated weights for policy 1, policy_version 1216768 (0.0008) [2023-12-26 09:22:31,857][123091] Updated weights for policy 0, policy_version 1225348 (0.0006) [2023-12-26 09:22:31,925][123091] Updated weights for policy 0, policy_version 1225358 (0.0007) [2023-12-26 09:22:32,676][123090] Updated weights for policy 1, policy_version 1216778 (0.0009) [2023-12-26 09:22:32,751][123091] Updated weights for policy 0, policy_version 1225368 (0.0010) [2023-12-26 09:22:32,757][123090] Updated weights for policy 1, policy_version 1216789 (0.0007) [2023-12-26 09:22:32,807][123091] Updated weights for policy 0, policy_version 1225378 (0.0011) [2023-12-26 09:22:32,818][123090] Updated weights for policy 1, policy_version 1216799 (0.0006) [2023-12-26 09:22:32,863][123091] Updated weights for policy 0, policy_version 1225388 (0.0011) [2023-12-26 09:22:33,496][123090] Updated weights for policy 1, policy_version 1216809 (0.0008) [2023-12-26 09:22:33,543][123090] Updated weights for policy 1, policy_version 1216819 (0.0009) [2023-12-26 09:22:33,596][123090] Updated weights for policy 1, policy_version 1216829 (0.0009) [2023-12-26 09:22:33,706][123091] Updated weights for policy 0, policy_version 1225398 (0.0010) [2023-12-26 09:22:33,779][123091] Updated weights for policy 0, policy_version 1225408 (0.0010) [2023-12-26 09:22:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 625213440. Throughput: 0: 8654.6, 1: 8863.1. Samples: 625225396. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:33,785][121949] Avg episode reward: [(0, '6227.340'), (1, '5933.295')] [2023-12-26 09:22:33,834][123091] Updated weights for policy 0, policy_version 1225418 (0.0010) [2023-12-26 09:22:34,544][123090] Updated weights for policy 1, policy_version 1216839 (0.0009) [2023-12-26 09:22:34,574][123091] Updated weights for policy 0, policy_version 1225428 (0.0008) [2023-12-26 09:22:34,607][123090] Updated weights for policy 1, policy_version 1216849 (0.0007) [2023-12-26 09:22:34,634][123091] Updated weights for policy 0, policy_version 1225438 (0.0011) [2023-12-26 09:22:34,668][123090] Updated weights for policy 1, policy_version 1216859 (0.0006) [2023-12-26 09:22:34,702][123091] Updated weights for policy 0, policy_version 1225448 (0.0011) [2023-12-26 09:22:35,404][123090] Updated weights for policy 1, policy_version 1216869 (0.0008) [2023-12-26 09:22:35,471][123090] Updated weights for policy 1, policy_version 1216879 (0.0005) [2023-12-26 09:22:35,546][123091] Updated weights for policy 0, policy_version 1225458 (0.0011) [2023-12-26 09:22:35,550][123090] Updated weights for policy 1, policy_version 1216889 (0.0005) [2023-12-26 09:22:35,594][123091] Updated weights for policy 0, policy_version 1225468 (0.0010) [2023-12-26 09:22:35,649][123091] Updated weights for policy 0, policy_version 1225478 (0.0010) [2023-12-26 09:22:35,704][123091] Updated weights for policy 0, policy_version 1225488 (0.0010) [2023-12-26 09:22:36,154][123090] Updated weights for policy 1, policy_version 1216899 (0.0007) [2023-12-26 09:22:36,229][123090] Updated weights for policy 1, policy_version 1216909 (0.0006) [2023-12-26 09:22:36,300][123090] Updated weights for policy 1, policy_version 1216919 (0.0007) [2023-12-26 09:22:36,444][123091] Updated weights for policy 0, policy_version 1225498 (0.0006) [2023-12-26 09:22:36,517][123091] Updated weights for policy 0, policy_version 1225508 (0.0007) [2023-12-26 09:22:36,586][123091] Updated weights for policy 0, policy_version 1225518 (0.0010) [2023-12-26 09:22:37,092][123090] Updated weights for policy 1, policy_version 1216929 (0.0007) [2023-12-26 09:22:37,157][123090] Updated weights for policy 1, policy_version 1216939 (0.0009) [2023-12-26 09:22:37,223][123090] Updated weights for policy 1, policy_version 1216949 (0.0008) [2023-12-26 09:22:37,286][123090] Updated weights for policy 1, policy_version 1216959 (0.0010) [2023-12-26 09:22:37,319][123091] Updated weights for policy 0, policy_version 1225528 (0.0010) [2023-12-26 09:22:37,369][123091] Updated weights for policy 0, policy_version 1225538 (0.0009) [2023-12-26 09:22:37,416][123091] Updated weights for policy 0, policy_version 1225548 (0.0008) [2023-12-26 09:22:38,074][123090] Updated weights for policy 1, policy_version 1216969 (0.0006) [2023-12-26 09:22:38,148][123090] Updated weights for policy 1, policy_version 1216979 (0.0006) [2023-12-26 09:22:38,201][123090] Updated weights for policy 1, policy_version 1216989 (0.0005) [2023-12-26 09:22:38,267][123091] Updated weights for policy 0, policy_version 1225558 (0.0009) [2023-12-26 09:22:38,330][123091] Updated weights for policy 0, policy_version 1225568 (0.0011) [2023-12-26 09:22:38,396][123091] Updated weights for policy 0, policy_version 1225578 (0.0012) [2023-12-26 09:22:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 625303552. Throughput: 0: 8645.8, 1: 8888.2. Samples: 625280104. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:38,785][121949] Avg episode reward: [(0, '6245.489'), (1, '5805.400')] [2023-12-26 09:22:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001225584_313753600.pth... [2023-12-26 09:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001216992_311549952.pth... [2023-12-26 09:22:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001224592_313499648.pth [2023-12-26 09:22:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001215968_311287808.pth [2023-12-26 09:22:38,949][123090] Updated weights for policy 1, policy_version 1216999 (0.0009) [2023-12-26 09:22:39,008][123090] Updated weights for policy 1, policy_version 1217009 (0.0010) [2023-12-26 09:22:39,064][123090] Updated weights for policy 1, policy_version 1217019 (0.0010) [2023-12-26 09:22:39,214][123091] Updated weights for policy 0, policy_version 1225588 (0.0011) [2023-12-26 09:22:39,278][123091] Updated weights for policy 0, policy_version 1225598 (0.0011) [2023-12-26 09:22:39,330][123091] Updated weights for policy 0, policy_version 1225608 (0.0011) [2023-12-26 09:22:39,873][123090] Updated weights for policy 1, policy_version 1217029 (0.0010) [2023-12-26 09:22:39,941][123090] Updated weights for policy 1, policy_version 1217039 (0.0010) [2023-12-26 09:22:39,997][123090] Updated weights for policy 1, policy_version 1217049 (0.0009) [2023-12-26 09:22:40,136][123091] Updated weights for policy 0, policy_version 1225618 (0.0011) [2023-12-26 09:22:40,192][123091] Updated weights for policy 0, policy_version 1225628 (0.0011) [2023-12-26 09:22:40,263][123091] Updated weights for policy 0, policy_version 1225638 (0.0011) [2023-12-26 09:22:40,329][123091] Updated weights for policy 0, policy_version 1225648 (0.0010) [2023-12-26 09:22:40,823][123090] Updated weights for policy 1, policy_version 1217059 (0.0008) [2023-12-26 09:22:40,904][123090] Updated weights for policy 1, policy_version 1217069 (0.0007) [2023-12-26 09:22:40,968][123090] Updated weights for policy 1, policy_version 1217079 (0.0010) [2023-12-26 09:22:41,073][123091] Updated weights for policy 0, policy_version 1225658 (0.0010) [2023-12-26 09:22:41,133][123091] Updated weights for policy 0, policy_version 1225668 (0.0008) [2023-12-26 09:22:41,206][123091] Updated weights for policy 0, policy_version 1225678 (0.0008) [2023-12-26 09:22:41,755][123090] Updated weights for policy 1, policy_version 1217089 (0.0008) [2023-12-26 09:22:41,816][123090] Updated weights for policy 1, policy_version 1217099 (0.0009) [2023-12-26 09:22:41,876][123090] Updated weights for policy 1, policy_version 1217109 (0.0009) [2023-12-26 09:22:41,937][123090] Updated weights for policy 1, policy_version 1217119 (0.0009) [2023-12-26 09:22:42,057][123091] Updated weights for policy 0, policy_version 1225688 (0.0009) [2023-12-26 09:22:42,114][123091] Updated weights for policy 0, policy_version 1225698 (0.0009) [2023-12-26 09:22:42,169][123091] Updated weights for policy 0, policy_version 1225708 (0.0009) [2023-12-26 09:22:42,755][123090] Updated weights for policy 1, policy_version 1217129 (0.0009) [2023-12-26 09:22:42,820][123090] Updated weights for policy 1, policy_version 1217139 (0.0010) [2023-12-26 09:22:42,878][123090] Updated weights for policy 1, policy_version 1217149 (0.0009) [2023-12-26 09:22:43,059][123091] Updated weights for policy 0, policy_version 1225718 (0.0009) [2023-12-26 09:22:43,119][123091] Updated weights for policy 0, policy_version 1225728 (0.0009) [2023-12-26 09:22:43,177][123091] Updated weights for policy 0, policy_version 1225738 (0.0009) [2023-12-26 09:22:43,685][123090] Updated weights for policy 1, policy_version 1217159 (0.0010) [2023-12-26 09:22:43,747][123090] Updated weights for policy 1, policy_version 1217169 (0.0009) [2023-12-26 09:22:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 625385472. Throughput: 0: 8677.4, 1: 8785.3. Samples: 625384444. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:43,785][121949] Avg episode reward: [(0, '6247.666'), (1, '5717.295')] [2023-12-26 09:22:43,810][123090] Updated weights for policy 1, policy_version 1217179 (0.0009) [2023-12-26 09:22:44,006][123091] Updated weights for policy 0, policy_version 1225748 (0.0010) [2023-12-26 09:22:44,063][123091] Updated weights for policy 0, policy_version 1225758 (0.0010) [2023-12-26 09:22:44,114][123091] Updated weights for policy 0, policy_version 1225768 (0.0009) [2023-12-26 09:22:44,644][123090] Updated weights for policy 1, policy_version 1217189 (0.0009) [2023-12-26 09:22:44,694][123090] Updated weights for policy 1, policy_version 1217199 (0.0009) [2023-12-26 09:22:44,753][123090] Updated weights for policy 1, policy_version 1217209 (0.0010) [2023-12-26 09:22:44,957][123091] Updated weights for policy 0, policy_version 1225778 (0.0010) [2023-12-26 09:22:45,010][123091] Updated weights for policy 0, policy_version 1225788 (0.0010) [2023-12-26 09:22:45,064][123091] Updated weights for policy 0, policy_version 1225798 (0.0009) [2023-12-26 09:22:45,121][123091] Updated weights for policy 0, policy_version 1225808 (0.0009) [2023-12-26 09:22:45,607][123090] Updated weights for policy 1, policy_version 1217219 (0.0008) [2023-12-26 09:22:45,676][123090] Updated weights for policy 1, policy_version 1217229 (0.0009) [2023-12-26 09:22:45,728][123090] Updated weights for policy 1, policy_version 1217239 (0.0010) [2023-12-26 09:22:45,977][123091] Updated weights for policy 0, policy_version 1225818 (0.0009) [2023-12-26 09:22:46,028][123091] Updated weights for policy 0, policy_version 1225828 (0.0009) [2023-12-26 09:22:46,077][123091] Updated weights for policy 0, policy_version 1225838 (0.0009) [2023-12-26 09:22:46,529][123090] Updated weights for policy 1, policy_version 1217249 (0.0010) [2023-12-26 09:22:46,586][123090] Updated weights for policy 1, policy_version 1217259 (0.0008) [2023-12-26 09:22:46,637][123090] Updated weights for policy 1, policy_version 1217269 (0.0008) [2023-12-26 09:22:46,690][123090] Updated weights for policy 1, policy_version 1217279 (0.0008) [2023-12-26 09:22:46,945][123091] Updated weights for policy 0, policy_version 1225848 (0.0009) [2023-12-26 09:22:47,003][123091] Updated weights for policy 0, policy_version 1225858 (0.0009) [2023-12-26 09:22:47,057][123091] Updated weights for policy 0, policy_version 1225868 (0.0010) [2023-12-26 09:22:47,533][123090] Updated weights for policy 1, policy_version 1217289 (0.0009) [2023-12-26 09:22:47,596][123090] Updated weights for policy 1, policy_version 1217299 (0.0005) [2023-12-26 09:22:47,646][123090] Updated weights for policy 1, policy_version 1217309 (0.0005) [2023-12-26 09:22:47,910][123091] Updated weights for policy 0, policy_version 1225878 (0.0010) [2023-12-26 09:22:47,970][123091] Updated weights for policy 0, policy_version 1225888 (0.0010) [2023-12-26 09:22:48,032][123091] Updated weights for policy 0, policy_version 1225898 (0.0007) [2023-12-26 09:22:48,455][123090] Updated weights for policy 1, policy_version 1217319 (0.0008) [2023-12-26 09:22:48,516][123090] Updated weights for policy 1, policy_version 1217329 (0.0009) [2023-12-26 09:22:48,574][123090] Updated weights for policy 1, policy_version 1217339 (0.0009) [2023-12-26 09:22:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 625475584. Throughput: 0: 8633.6, 1: 8778.2. Samples: 625486796. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:48,785][121949] Avg episode reward: [(0, '6291.132'), (1, '5760.850')] [2023-12-26 09:22:48,842][123091] Updated weights for policy 0, policy_version 1225908 (0.0008) [2023-12-26 09:22:48,901][123091] Updated weights for policy 0, policy_version 1225918 (0.0005) [2023-12-26 09:22:48,948][123091] Updated weights for policy 0, policy_version 1225928 (0.0005) [2023-12-26 09:22:49,294][123090] Updated weights for policy 1, policy_version 1217349 (0.0009) [2023-12-26 09:22:49,348][123090] Updated weights for policy 1, policy_version 1217360 (0.0010) [2023-12-26 09:22:49,420][123090] Updated weights for policy 1, policy_version 1217370 (0.0008) [2023-12-26 09:22:49,699][123091] Updated weights for policy 0, policy_version 1225938 (0.0007) [2023-12-26 09:22:49,753][123091] Updated weights for policy 0, policy_version 1225948 (0.0009) [2023-12-26 09:22:49,813][123091] Updated weights for policy 0, policy_version 1225958 (0.0007) [2023-12-26 09:22:49,885][123091] Updated weights for policy 0, policy_version 1225968 (0.0007) [2023-12-26 09:22:50,258][123090] Updated weights for policy 1, policy_version 1217380 (0.0007) [2023-12-26 09:22:50,310][123090] Updated weights for policy 1, policy_version 1217390 (0.0010) [2023-12-26 09:22:50,364][123090] Updated weights for policy 1, policy_version 1217400 (0.0008) [2023-12-26 09:22:50,616][123091] Updated weights for policy 0, policy_version 1225978 (0.0009) [2023-12-26 09:22:50,681][123091] Updated weights for policy 0, policy_version 1225988 (0.0009) [2023-12-26 09:22:50,747][123091] Updated weights for policy 0, policy_version 1225998 (0.0009) [2023-12-26 09:22:51,207][123090] Updated weights for policy 1, policy_version 1217410 (0.0010) [2023-12-26 09:22:51,269][123090] Updated weights for policy 1, policy_version 1217420 (0.0009) [2023-12-26 09:22:51,331][123090] Updated weights for policy 1, policy_version 1217430 (0.0009) [2023-12-26 09:22:51,399][123090] Updated weights for policy 1, policy_version 1217440 (0.0009) [2023-12-26 09:22:51,562][123091] Updated weights for policy 0, policy_version 1226008 (0.0009) [2023-12-26 09:22:51,624][123091] Updated weights for policy 0, policy_version 1226018 (0.0007) [2023-12-26 09:22:51,699][123091] Updated weights for policy 0, policy_version 1226028 (0.0007) [2023-12-26 09:22:52,217][123090] Updated weights for policy 1, policy_version 1217450 (0.0005) [2023-12-26 09:22:52,293][123090] Updated weights for policy 1, policy_version 1217460 (0.0005) [2023-12-26 09:22:52,365][123090] Updated weights for policy 1, policy_version 1217470 (0.0006) [2023-12-26 09:22:52,411][123091] Updated weights for policy 0, policy_version 1226038 (0.0006) [2023-12-26 09:22:52,480][123091] Updated weights for policy 0, policy_version 1226048 (0.0005) [2023-12-26 09:22:52,550][123091] Updated weights for policy 0, policy_version 1226058 (0.0005) [2023-12-26 09:22:53,106][123090] Updated weights for policy 1, policy_version 1217480 (0.0009) [2023-12-26 09:22:53,160][123090] Updated weights for policy 1, policy_version 1217490 (0.0010) [2023-12-26 09:22:53,218][123090] Updated weights for policy 1, policy_version 1217500 (0.0009) [2023-12-26 09:22:53,247][123091] Updated weights for policy 0, policy_version 1226068 (0.0006) [2023-12-26 09:22:53,305][123091] Updated weights for policy 0, policy_version 1226078 (0.0005) [2023-12-26 09:22:53,371][123091] Updated weights for policy 0, policy_version 1226088 (0.0005) [2023-12-26 09:22:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.6). Total num frames: 625565696. Throughput: 0: 8620.7, 1: 8790.1. Samples: 625540004. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:53,785][121949] Avg episode reward: [(0, '6319.308'), (1, '5789.725')] [2023-12-26 09:22:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001226096_313884672.pth... [2023-12-26 09:22:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001217504_311681024.pth... [2023-12-26 09:22:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001216480_311418880.pth [2023-12-26 09:22:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001225072_313622528.pth [2023-12-26 09:22:54,098][123091] Updated weights for policy 0, policy_version 1226098 (0.0007) [2023-12-26 09:22:54,115][123090] Updated weights for policy 1, policy_version 1217510 (0.0008) [2023-12-26 09:22:54,155][123091] Updated weights for policy 0, policy_version 1226108 (0.0009) [2023-12-26 09:22:54,172][123090] Updated weights for policy 1, policy_version 1217520 (0.0007) [2023-12-26 09:22:54,223][123091] Updated weights for policy 0, policy_version 1226118 (0.0006) [2023-12-26 09:22:54,226][123090] Updated weights for policy 1, policy_version 1217530 (0.0009) [2023-12-26 09:22:54,280][123091] Updated weights for policy 0, policy_version 1226128 (0.0005) [2023-12-26 09:22:54,949][123090] Updated weights for policy 1, policy_version 1217540 (0.0008) [2023-12-26 09:22:55,005][123090] Updated weights for policy 1, policy_version 1217550 (0.0010) [2023-12-26 09:22:55,057][123090] Updated weights for policy 1, policy_version 1217560 (0.0010) [2023-12-26 09:22:55,085][123091] Updated weights for policy 0, policy_version 1226138 (0.0006) [2023-12-26 09:22:55,147][123091] Updated weights for policy 0, policy_version 1226148 (0.0006) [2023-12-26 09:22:55,223][123091] Updated weights for policy 0, policy_version 1226158 (0.0006) [2023-12-26 09:22:55,868][123091] Updated weights for policy 0, policy_version 1226168 (0.0008) [2023-12-26 09:22:55,914][123090] Updated weights for policy 1, policy_version 1217570 (0.0010) [2023-12-26 09:22:55,918][123091] Updated weights for policy 0, policy_version 1226178 (0.0006) [2023-12-26 09:22:55,968][123091] Updated weights for policy 0, policy_version 1226188 (0.0005) [2023-12-26 09:22:55,972][123090] Updated weights for policy 1, policy_version 1217580 (0.0007) [2023-12-26 09:22:56,036][123090] Updated weights for policy 1, policy_version 1217590 (0.0010) [2023-12-26 09:22:56,091][123090] Updated weights for policy 1, policy_version 1217600 (0.0010) [2023-12-26 09:22:56,641][123091] Updated weights for policy 0, policy_version 1226198 (0.0008) [2023-12-26 09:22:56,695][123091] Updated weights for policy 0, policy_version 1226208 (0.0009) [2023-12-26 09:22:56,749][123091] Updated weights for policy 0, policy_version 1226218 (0.0009) [2023-12-26 09:22:56,914][123090] Updated weights for policy 1, policy_version 1217610 (0.0010) [2023-12-26 09:22:56,975][123090] Updated weights for policy 1, policy_version 1217620 (0.0010) [2023-12-26 09:22:57,030][123090] Updated weights for policy 1, policy_version 1217630 (0.0010) [2023-12-26 09:22:57,528][123091] Updated weights for policy 0, policy_version 1226228 (0.0009) [2023-12-26 09:22:57,583][123091] Updated weights for policy 0, policy_version 1226238 (0.0009) [2023-12-26 09:22:57,643][123091] Updated weights for policy 0, policy_version 1226248 (0.0008) [2023-12-26 09:22:57,850][123090] Updated weights for policy 1, policy_version 1217640 (0.0010) [2023-12-26 09:22:57,904][123090] Updated weights for policy 1, policy_version 1217650 (0.0010) [2023-12-26 09:22:57,958][123090] Updated weights for policy 1, policy_version 1217660 (0.0010) [2023-12-26 09:22:58,491][123091] Updated weights for policy 0, policy_version 1226258 (0.0008) [2023-12-26 09:22:58,561][123091] Updated weights for policy 0, policy_version 1226268 (0.0008) [2023-12-26 09:22:58,634][123091] Updated weights for policy 0, policy_version 1226278 (0.0007) [2023-12-26 09:22:58,707][123091] Updated weights for policy 0, policy_version 1226288 (0.0008) [2023-12-26 09:22:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 625655808. Throughput: 0: 8741.2, 1: 8766.9. Samples: 625650036. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:22:58,785][121949] Avg episode reward: [(0, '6205.678'), (1, '5841.031')] [2023-12-26 09:22:58,899][123090] Updated weights for policy 1, policy_version 1217670 (0.0009) [2023-12-26 09:22:58,969][123090] Updated weights for policy 1, policy_version 1217680 (0.0006) [2023-12-26 09:22:59,044][123090] Updated weights for policy 1, policy_version 1217690 (0.0008) [2023-12-26 09:22:59,532][123091] Updated weights for policy 0, policy_version 1226298 (0.0009) [2023-12-26 09:22:59,595][123091] Updated weights for policy 0, policy_version 1226308 (0.0010) [2023-12-26 09:22:59,654][123091] Updated weights for policy 0, policy_version 1226318 (0.0009) [2023-12-26 09:22:59,801][123090] Updated weights for policy 1, policy_version 1217700 (0.0008) [2023-12-26 09:22:59,870][123090] Updated weights for policy 1, policy_version 1217710 (0.0008) [2023-12-26 09:22:59,962][123090] Updated weights for policy 1, policy_version 1217720 (0.0008) [2023-12-26 09:23:00,470][123091] Updated weights for policy 0, policy_version 1226328 (0.0010) [2023-12-26 09:23:00,540][123091] Updated weights for policy 0, policy_version 1226338 (0.0010) [2023-12-26 09:23:00,594][123091] Updated weights for policy 0, policy_version 1226348 (0.0009) [2023-12-26 09:23:00,626][123090] Updated weights for policy 1, policy_version 1217730 (0.0007) [2023-12-26 09:23:00,684][123090] Updated weights for policy 1, policy_version 1217740 (0.0005) [2023-12-26 09:23:00,753][123090] Updated weights for policy 1, policy_version 1217750 (0.0005) [2023-12-26 09:23:00,808][123090] Updated weights for policy 1, policy_version 1217760 (0.0005) [2023-12-26 09:23:01,509][123091] Updated weights for policy 0, policy_version 1226358 (0.0009) [2023-12-26 09:23:01,542][123090] Updated weights for policy 1, policy_version 1217770 (0.0005) [2023-12-26 09:23:01,573][123091] Updated weights for policy 0, policy_version 1226368 (0.0009) [2023-12-26 09:23:01,603][123090] Updated weights for policy 1, policy_version 1217780 (0.0006) [2023-12-26 09:23:01,637][123091] Updated weights for policy 0, policy_version 1226378 (0.0009) [2023-12-26 09:23:01,669][123090] Updated weights for policy 1, policy_version 1217790 (0.0008) [2023-12-26 09:23:02,481][123090] Updated weights for policy 1, policy_version 1217800 (0.0005) [2023-12-26 09:23:02,497][123091] Updated weights for policy 0, policy_version 1226388 (0.0007) [2023-12-26 09:23:02,551][123090] Updated weights for policy 1, policy_version 1217810 (0.0007) [2023-12-26 09:23:02,555][123091] Updated weights for policy 0, policy_version 1226398 (0.0005) [2023-12-26 09:23:02,617][123090] Updated weights for policy 1, policy_version 1217820 (0.0006) [2023-12-26 09:23:02,625][123091] Updated weights for policy 0, policy_version 1226408 (0.0009) [2023-12-26 09:23:03,191][123090] Updated weights for policy 1, policy_version 1217830 (0.0006) [2023-12-26 09:23:03,243][123090] Updated weights for policy 1, policy_version 1217840 (0.0005) [2023-12-26 09:23:03,302][123090] Updated weights for policy 1, policy_version 1217850 (0.0005) [2023-12-26 09:23:03,458][123091] Updated weights for policy 0, policy_version 1226418 (0.0008) [2023-12-26 09:23:03,522][123091] Updated weights for policy 0, policy_version 1226428 (0.0009) [2023-12-26 09:23:03,579][123091] Updated weights for policy 0, policy_version 1226438 (0.0010) [2023-12-26 09:23:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 625745920. Throughput: 0: 8701.6, 1: 8788.6. Samples: 625755376. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 09:23:03,785][121949] Avg episode reward: [(0, '6204.913'), (1, '5687.003')] [2023-12-26 09:23:03,916][123090] Updated weights for policy 1, policy_version 1217860 (0.0005) [2023-12-26 09:23:03,986][123090] Updated weights for policy 1, policy_version 1217870 (0.0005) [2023-12-26 09:23:04,045][123090] Updated weights for policy 1, policy_version 1217880 (0.0006) [2023-12-26 09:23:04,380][123091] Updated weights for policy 0, policy_version 1226449 (0.0010) [2023-12-26 09:23:04,448][123091] Updated weights for policy 0, policy_version 1226459 (0.0010) [2023-12-26 09:23:04,510][123091] Updated weights for policy 0, policy_version 1226469 (0.0009) [2023-12-26 09:23:04,562][123091] Updated weights for policy 0, policy_version 1226479 (0.0009) [2023-12-26 09:23:04,763][123090] Updated weights for policy 1, policy_version 1217890 (0.0006) [2023-12-26 09:23:04,823][123090] Updated weights for policy 1, policy_version 1217900 (0.0010) [2023-12-26 09:23:04,879][123090] Updated weights for policy 1, policy_version 1217910 (0.0009) [2023-12-26 09:23:04,940][123090] Updated weights for policy 1, policy_version 1217920 (0.0009) [2023-12-26 09:23:05,391][123091] Updated weights for policy 0, policy_version 1226489 (0.0010) [2023-12-26 09:23:05,446][123091] Updated weights for policy 0, policy_version 1226499 (0.0010) [2023-12-26 09:23:05,501][123091] Updated weights for policy 0, policy_version 1226509 (0.0010) [2023-12-26 09:23:05,699][123090] Updated weights for policy 1, policy_version 1217930 (0.0008) [2023-12-26 09:23:05,760][123090] Updated weights for policy 1, policy_version 1217940 (0.0009) [2023-12-26 09:23:05,812][123090] Updated weights for policy 1, policy_version 1217950 (0.0010) [2023-12-26 09:23:06,398][123091] Updated weights for policy 0, policy_version 1226519 (0.0010) [2023-12-26 09:23:06,465][123091] Updated weights for policy 0, policy_version 1226529 (0.0009) [2023-12-26 09:23:06,527][123091] Updated weights for policy 0, policy_version 1226539 (0.0010) [2023-12-26 09:23:06,659][123090] Updated weights for policy 1, policy_version 1217960 (0.0010) [2023-12-26 09:23:06,722][123090] Updated weights for policy 1, policy_version 1217970 (0.0009) [2023-12-26 09:23:06,788][123090] Updated weights for policy 1, policy_version 1217980 (0.0010) [2023-12-26 09:23:07,360][123091] Updated weights for policy 0, policy_version 1226549 (0.0009) [2023-12-26 09:23:07,421][123091] Updated weights for policy 0, policy_version 1226559 (0.0009) [2023-12-26 09:23:07,485][123091] Updated weights for policy 0, policy_version 1226569 (0.0010) [2023-12-26 09:23:07,624][123090] Updated weights for policy 1, policy_version 1217990 (0.0009) [2023-12-26 09:23:07,677][123090] Updated weights for policy 1, policy_version 1218000 (0.0009) [2023-12-26 09:23:07,733][123090] Updated weights for policy 1, policy_version 1218011 (0.0009) [2023-12-26 09:23:08,360][123091] Updated weights for policy 0, policy_version 1226579 (0.0010) [2023-12-26 09:23:08,419][123091] Updated weights for policy 0, policy_version 1226589 (0.0009) [2023-12-26 09:23:08,487][123090] Updated weights for policy 1, policy_version 1218021 (0.0008) [2023-12-26 09:23:08,488][123091] Updated weights for policy 0, policy_version 1226599 (0.0009) [2023-12-26 09:23:08,544][123090] Updated weights for policy 1, policy_version 1218031 (0.0006) [2023-12-26 09:23:08,608][123090] Updated weights for policy 1, policy_version 1218041 (0.0005) [2023-12-26 09:23:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 625836032. Throughput: 0: 8706.3, 1: 8855.3. Samples: 625808784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:08,784][121949] Avg episode reward: [(0, '6319.997'), (1, '5498.559')] [2023-12-26 09:23:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001226608_314015744.pth... [2023-12-26 09:23:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001218048_311820288.pth... [2023-12-26 09:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001225584_313753600.pth [2023-12-26 09:23:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001216992_311549952.pth [2023-12-26 09:23:09,333][123091] Updated weights for policy 0, policy_version 1226609 (0.0009) [2023-12-26 09:23:09,401][123090] Updated weights for policy 1, policy_version 1218051 (0.0008) [2023-12-26 09:23:09,415][123091] Updated weights for policy 0, policy_version 1226619 (0.0010) [2023-12-26 09:23:09,471][123090] Updated weights for policy 1, policy_version 1218061 (0.0007) [2023-12-26 09:23:09,477][123091] Updated weights for policy 0, policy_version 1226629 (0.0008) [2023-12-26 09:23:09,539][123090] Updated weights for policy 1, policy_version 1218071 (0.0008) [2023-12-26 09:23:09,544][123091] Updated weights for policy 0, policy_version 1226639 (0.0008) [2023-12-26 09:23:10,357][123090] Updated weights for policy 1, policy_version 1218081 (0.0010) [2023-12-26 09:23:10,417][123090] Updated weights for policy 1, policy_version 1218091 (0.0006) [2023-12-26 09:23:10,420][123091] Updated weights for policy 0, policy_version 1226649 (0.0009) [2023-12-26 09:23:10,474][123090] Updated weights for policy 1, policy_version 1218101 (0.0006) [2023-12-26 09:23:10,478][123091] Updated weights for policy 0, policy_version 1226659 (0.0008) [2023-12-26 09:23:10,526][123090] Updated weights for policy 1, policy_version 1218111 (0.0005) [2023-12-26 09:23:10,540][123091] Updated weights for policy 0, policy_version 1226669 (0.0009) [2023-12-26 09:23:11,343][123090] Updated weights for policy 1, policy_version 1218121 (0.0008) [2023-12-26 09:23:11,413][123090] Updated weights for policy 1, policy_version 1218131 (0.0008) [2023-12-26 09:23:11,438][123091] Updated weights for policy 0, policy_version 1226679 (0.0009) [2023-12-26 09:23:11,467][123090] Updated weights for policy 1, policy_version 1218141 (0.0009) [2023-12-26 09:23:11,499][123091] Updated weights for policy 0, policy_version 1226689 (0.0009) [2023-12-26 09:23:11,563][123091] Updated weights for policy 0, policy_version 1226699 (0.0010) [2023-12-26 09:23:12,330][123090] Updated weights for policy 1, policy_version 1218151 (0.0007) [2023-12-26 09:23:12,354][123091] Updated weights for policy 0, policy_version 1226709 (0.0007) [2023-12-26 09:23:12,401][123090] Updated weights for policy 1, policy_version 1218161 (0.0008) [2023-12-26 09:23:12,426][123091] Updated weights for policy 0, policy_version 1226719 (0.0007) [2023-12-26 09:23:12,472][123090] Updated weights for policy 1, policy_version 1218171 (0.0007) [2023-12-26 09:23:12,501][123091] Updated weights for policy 0, policy_version 1226729 (0.0008) [2023-12-26 09:23:13,187][123091] Updated weights for policy 0, policy_version 1226739 (0.0010) [2023-12-26 09:23:13,235][123091] Updated weights for policy 0, policy_version 1226749 (0.0009) [2023-12-26 09:23:13,278][123090] Updated weights for policy 1, policy_version 1218181 (0.0007) [2023-12-26 09:23:13,290][123091] Updated weights for policy 0, policy_version 1226759 (0.0008) [2023-12-26 09:23:13,336][123090] Updated weights for policy 1, policy_version 1218191 (0.0009) [2023-12-26 09:23:13,393][123090] Updated weights for policy 1, policy_version 1218201 (0.0010) [2023-12-26 09:23:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 625917952. Throughput: 0: 8674.8, 1: 8841.2. Samples: 625910188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:13,785][121949] Avg episode reward: [(0, '6267.902'), (1, '5425.056')] [2023-12-26 09:23:14,127][123091] Updated weights for policy 0, policy_version 1226769 (0.0007) [2023-12-26 09:23:14,191][123091] Updated weights for policy 0, policy_version 1226779 (0.0009) [2023-12-26 09:23:14,232][123090] Updated weights for policy 1, policy_version 1218211 (0.0009) [2023-12-26 09:23:14,242][123091] Updated weights for policy 0, policy_version 1226789 (0.0009) [2023-12-26 09:23:14,280][123090] Updated weights for policy 1, policy_version 1218221 (0.0010) [2023-12-26 09:23:14,297][123091] Updated weights for policy 0, policy_version 1226799 (0.0008) [2023-12-26 09:23:14,335][123090] Updated weights for policy 1, policy_version 1218232 (0.0010) [2023-12-26 09:23:15,189][123091] Updated weights for policy 0, policy_version 1226809 (0.0009) [2023-12-26 09:23:15,190][123090] Updated weights for policy 1, policy_version 1218242 (0.0009) [2023-12-26 09:23:15,248][123090] Updated weights for policy 1, policy_version 1218252 (0.0006) [2023-12-26 09:23:15,257][123091] Updated weights for policy 0, policy_version 1226819 (0.0008) [2023-12-26 09:23:15,306][123090] Updated weights for policy 1, policy_version 1218262 (0.0008) [2023-12-26 09:23:15,327][123091] Updated weights for policy 0, policy_version 1226829 (0.0009) [2023-12-26 09:23:15,363][123090] Updated weights for policy 1, policy_version 1218272 (0.0006) [2023-12-26 09:23:15,973][123090] Updated weights for policy 1, policy_version 1218282 (0.0005) [2023-12-26 09:23:16,033][123090] Updated weights for policy 1, policy_version 1218292 (0.0005) [2023-12-26 09:23:16,083][123090] Updated weights for policy 1, policy_version 1218302 (0.0005) [2023-12-26 09:23:16,163][123091] Updated weights for policy 0, policy_version 1226839 (0.0009) [2023-12-26 09:23:16,221][123091] Updated weights for policy 0, policy_version 1226849 (0.0009) [2023-12-26 09:23:16,287][123091] Updated weights for policy 0, policy_version 1226859 (0.0009) [2023-12-26 09:23:16,815][123090] Updated weights for policy 1, policy_version 1218312 (0.0005) [2023-12-26 09:23:16,881][123090] Updated weights for policy 1, policy_version 1218322 (0.0005) [2023-12-26 09:23:16,946][123090] Updated weights for policy 1, policy_version 1218332 (0.0005) [2023-12-26 09:23:17,169][123091] Updated weights for policy 0, policy_version 1226869 (0.0008) [2023-12-26 09:23:17,219][123091] Updated weights for policy 0, policy_version 1226879 (0.0005) [2023-12-26 09:23:17,286][123091] Updated weights for policy 0, policy_version 1226889 (0.0008) [2023-12-26 09:23:17,650][123090] Updated weights for policy 1, policy_version 1218342 (0.0006) [2023-12-26 09:23:17,716][123090] Updated weights for policy 1, policy_version 1218352 (0.0006) [2023-12-26 09:23:17,785][123090] Updated weights for policy 1, policy_version 1218362 (0.0006) [2023-12-26 09:23:18,162][123091] Updated weights for policy 0, policy_version 1226899 (0.0009) [2023-12-26 09:23:18,210][123091] Updated weights for policy 0, policy_version 1226909 (0.0009) [2023-12-26 09:23:18,266][123091] Updated weights for policy 0, policy_version 1226919 (0.0009) [2023-12-26 09:23:18,472][123090] Updated weights for policy 1, policy_version 1218372 (0.0006) [2023-12-26 09:23:18,529][123090] Updated weights for policy 1, policy_version 1218382 (0.0006) [2023-12-26 09:23:18,592][123090] Updated weights for policy 1, policy_version 1218392 (0.0008) [2023-12-26 09:23:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 626008064. Throughput: 0: 8640.9, 1: 8936.8. Samples: 626016392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:18,784][121949] Avg episode reward: [(0, '6259.146'), (1, '5571.617')] [2023-12-26 09:23:19,144][123091] Updated weights for policy 0, policy_version 1226929 (0.0009) [2023-12-26 09:23:19,201][123091] Updated weights for policy 0, policy_version 1226939 (0.0009) [2023-12-26 09:23:19,267][123091] Updated weights for policy 0, policy_version 1226949 (0.0009) [2023-12-26 09:23:19,333][123091] Updated weights for policy 0, policy_version 1226959 (0.0009) [2023-12-26 09:23:19,391][123090] Updated weights for policy 1, policy_version 1218402 (0.0009) [2023-12-26 09:23:19,458][123090] Updated weights for policy 1, policy_version 1218412 (0.0009) [2023-12-26 09:23:19,528][123090] Updated weights for policy 1, policy_version 1218422 (0.0009) [2023-12-26 09:23:19,592][123090] Updated weights for policy 1, policy_version 1218432 (0.0008) [2023-12-26 09:23:20,193][123091] Updated weights for policy 0, policy_version 1226969 (0.0010) [2023-12-26 09:23:20,246][123091] Updated weights for policy 0, policy_version 1226979 (0.0009) [2023-12-26 09:23:20,321][123091] Updated weights for policy 0, policy_version 1226989 (0.0009) [2023-12-26 09:23:20,420][123090] Updated weights for policy 1, policy_version 1218442 (0.0010) [2023-12-26 09:23:20,483][123090] Updated weights for policy 1, policy_version 1218452 (0.0009) [2023-12-26 09:23:20,544][123090] Updated weights for policy 1, policy_version 1218462 (0.0007) [2023-12-26 09:23:21,182][123091] Updated weights for policy 0, policy_version 1226999 (0.0008) [2023-12-26 09:23:21,239][123091] Updated weights for policy 0, policy_version 1227009 (0.0009) [2023-12-26 09:23:21,297][123091] Updated weights for policy 0, policy_version 1227019 (0.0009) [2023-12-26 09:23:21,394][123090] Updated weights for policy 1, policy_version 1218472 (0.0012) [2023-12-26 09:23:21,462][123090] Updated weights for policy 1, policy_version 1218482 (0.0011) [2023-12-26 09:23:21,533][123090] Updated weights for policy 1, policy_version 1218492 (0.0011) [2023-12-26 09:23:22,109][123091] Updated weights for policy 0, policy_version 1227029 (0.0010) [2023-12-26 09:23:22,174][123091] Updated weights for policy 0, policy_version 1227039 (0.0011) [2023-12-26 09:23:22,244][123091] Updated weights for policy 0, policy_version 1227049 (0.0009) [2023-12-26 09:23:22,392][123090] Updated weights for policy 1, policy_version 1218502 (0.0010) [2023-12-26 09:23:22,449][123090] Updated weights for policy 1, policy_version 1218512 (0.0009) [2023-12-26 09:23:22,508][123090] Updated weights for policy 1, policy_version 1218522 (0.0007) [2023-12-26 09:23:22,959][123091] Updated weights for policy 0, policy_version 1227059 (0.0009) [2023-12-26 09:23:23,038][123091] Updated weights for policy 0, policy_version 1227069 (0.0007) [2023-12-26 09:23:23,105][123091] Updated weights for policy 0, policy_version 1227079 (0.0011) [2023-12-26 09:23:23,339][123090] Updated weights for policy 1, policy_version 1218532 (0.0007) [2023-12-26 09:23:23,387][123090] Updated weights for policy 1, policy_version 1218542 (0.0009) [2023-12-26 09:23:23,440][123090] Updated weights for policy 1, policy_version 1218552 (0.0009) [2023-12-26 09:23:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 626089984. Throughput: 0: 8596.3, 1: 8882.5. Samples: 626066648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:23,785][121949] Avg episode reward: [(0, '6295.776'), (1, '5643.514')] [2023-12-26 09:23:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001218560_311951360.pth... [2023-12-26 09:23:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001227088_314138624.pth... [2023-12-26 09:23:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001217504_311681024.pth [2023-12-26 09:23:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001226096_313884672.pth [2023-12-26 09:23:23,824][123091] Updated weights for policy 0, policy_version 1227089 (0.0010) [2023-12-26 09:23:23,875][123091] Updated weights for policy 0, policy_version 1227099 (0.0005) [2023-12-26 09:23:23,924][123091] Updated weights for policy 0, policy_version 1227109 (0.0005) [2023-12-26 09:23:23,982][123091] Updated weights for policy 0, policy_version 1227119 (0.0005) [2023-12-26 09:23:24,248][123090] Updated weights for policy 1, policy_version 1218563 (0.0010) [2023-12-26 09:23:24,316][123090] Updated weights for policy 1, policy_version 1218573 (0.0009) [2023-12-26 09:23:24,379][123090] Updated weights for policy 1, policy_version 1218583 (0.0008) [2023-12-26 09:23:24,739][123091] Updated weights for policy 0, policy_version 1227129 (0.0010) [2023-12-26 09:23:24,797][123091] Updated weights for policy 0, policy_version 1227139 (0.0006) [2023-12-26 09:23:24,866][123091] Updated weights for policy 0, policy_version 1227149 (0.0005) [2023-12-26 09:23:25,203][123090] Updated weights for policy 1, policy_version 1218593 (0.0009) [2023-12-26 09:23:25,268][123090] Updated weights for policy 1, policy_version 1218603 (0.0009) [2023-12-26 09:23:25,334][123090] Updated weights for policy 1, policy_version 1218613 (0.0009) [2023-12-26 09:23:25,387][123090] Updated weights for policy 1, policy_version 1218623 (0.0010) [2023-12-26 09:23:25,562][123091] Updated weights for policy 0, policy_version 1227159 (0.0007) [2023-12-26 09:23:25,625][123091] Updated weights for policy 0, policy_version 1227169 (0.0006) [2023-12-26 09:23:25,691][123091] Updated weights for policy 0, policy_version 1227179 (0.0006) [2023-12-26 09:23:26,263][123090] Updated weights for policy 1, policy_version 1218633 (0.0010) [2023-12-26 09:23:26,325][123090] Updated weights for policy 1, policy_version 1218643 (0.0011) [2023-12-26 09:23:26,387][123090] Updated weights for policy 1, policy_version 1218653 (0.0009) [2023-12-26 09:23:26,443][123091] Updated weights for policy 0, policy_version 1227189 (0.0008) [2023-12-26 09:23:26,496][123091] Updated weights for policy 0, policy_version 1227199 (0.0009) [2023-12-26 09:23:26,546][123091] Updated weights for policy 0, policy_version 1227209 (0.0009) [2023-12-26 09:23:27,233][123090] Updated weights for policy 1, policy_version 1218663 (0.0010) [2023-12-26 09:23:27,289][123090] Updated weights for policy 1, policy_version 1218673 (0.0009) [2023-12-26 09:23:27,337][123090] Updated weights for policy 1, policy_version 1218683 (0.0009) [2023-12-26 09:23:27,341][123091] Updated weights for policy 0, policy_version 1227219 (0.0009) [2023-12-26 09:23:27,399][123091] Updated weights for policy 0, policy_version 1227229 (0.0006) [2023-12-26 09:23:27,455][123091] Updated weights for policy 0, policy_version 1227239 (0.0008) [2023-12-26 09:23:28,144][123090] Updated weights for policy 1, policy_version 1218693 (0.0010) [2023-12-26 09:23:28,196][123090] Updated weights for policy 1, policy_version 1218703 (0.0009) [2023-12-26 09:23:28,251][123090] Updated weights for policy 1, policy_version 1218714 (0.0009) [2023-12-26 09:23:28,264][123091] Updated weights for policy 0, policy_version 1227249 (0.0009) [2023-12-26 09:23:28,313][123091] Updated weights for policy 0, policy_version 1227259 (0.0007) [2023-12-26 09:23:28,376][123091] Updated weights for policy 0, policy_version 1227269 (0.0010) [2023-12-26 09:23:28,436][123091] Updated weights for policy 0, policy_version 1227279 (0.0009) [2023-12-26 09:23:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 626180096. Throughput: 0: 8682.0, 1: 8836.3. Samples: 626172772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:28,785][121949] Avg episode reward: [(0, '6320.598'), (1, '5620.223')] [2023-12-26 09:23:29,107][123090] Updated weights for policy 1, policy_version 1218724 (0.0009) [2023-12-26 09:23:29,166][123090] Updated weights for policy 1, policy_version 1218734 (0.0009) [2023-12-26 09:23:29,218][123090] Updated weights for policy 1, policy_version 1218744 (0.0009) [2023-12-26 09:23:29,283][123091] Updated weights for policy 0, policy_version 1227289 (0.0008) [2023-12-26 09:23:29,353][123091] Updated weights for policy 0, policy_version 1227299 (0.0010) [2023-12-26 09:23:29,406][123091] Updated weights for policy 0, policy_version 1227309 (0.0010) [2023-12-26 09:23:30,076][123090] Updated weights for policy 1, policy_version 1218754 (0.0010) [2023-12-26 09:23:30,135][123090] Updated weights for policy 1, policy_version 1218765 (0.0009) [2023-12-26 09:23:30,196][123090] Updated weights for policy 1, policy_version 1218775 (0.0009) [2023-12-26 09:23:30,284][123091] Updated weights for policy 0, policy_version 1227319 (0.0009) [2023-12-26 09:23:30,347][123091] Updated weights for policy 0, policy_version 1227329 (0.0009) [2023-12-26 09:23:30,399][123091] Updated weights for policy 0, policy_version 1227339 (0.0009) [2023-12-26 09:23:30,939][123090] Updated weights for policy 1, policy_version 1218785 (0.0008) [2023-12-26 09:23:31,003][123090] Updated weights for policy 1, policy_version 1218795 (0.0006) [2023-12-26 09:23:31,073][123090] Updated weights for policy 1, policy_version 1218805 (0.0008) [2023-12-26 09:23:31,143][123090] Updated weights for policy 1, policy_version 1218815 (0.0011) [2023-12-26 09:23:31,268][123091] Updated weights for policy 0, policy_version 1227349 (0.0009) [2023-12-26 09:23:31,335][123091] Updated weights for policy 0, policy_version 1227359 (0.0008) [2023-12-26 09:23:31,408][123091] Updated weights for policy 0, policy_version 1227369 (0.0009) [2023-12-26 09:23:31,862][123090] Updated weights for policy 1, policy_version 1218825 (0.0006) [2023-12-26 09:23:31,927][123090] Updated weights for policy 1, policy_version 1218835 (0.0008) [2023-12-26 09:23:31,995][123090] Updated weights for policy 1, policy_version 1218845 (0.0008) [2023-12-26 09:23:32,294][123091] Updated weights for policy 0, policy_version 1227380 (0.0010) [2023-12-26 09:23:32,362][123091] Updated weights for policy 0, policy_version 1227390 (0.0010) [2023-12-26 09:23:32,430][123091] Updated weights for policy 0, policy_version 1227400 (0.0009) [2023-12-26 09:23:32,742][123090] Updated weights for policy 1, policy_version 1218855 (0.0008) [2023-12-26 09:23:32,802][123090] Updated weights for policy 1, policy_version 1218865 (0.0005) [2023-12-26 09:23:32,857][123090] Updated weights for policy 1, policy_version 1218875 (0.0005) [2023-12-26 09:23:33,278][123091] Updated weights for policy 0, policy_version 1227410 (0.0009) [2023-12-26 09:23:33,337][123091] Updated weights for policy 0, policy_version 1227420 (0.0010) [2023-12-26 09:23:33,388][123091] Updated weights for policy 0, policy_version 1227430 (0.0008) [2023-12-26 09:23:33,449][123091] Updated weights for policy 0, policy_version 1227440 (0.0008) [2023-12-26 09:23:33,626][123090] Updated weights for policy 1, policy_version 1218885 (0.0010) [2023-12-26 09:23:33,680][123090] Updated weights for policy 1, policy_version 1218895 (0.0010) [2023-12-26 09:23:33,727][123090] Updated weights for policy 1, policy_version 1218905 (0.0010) [2023-12-26 09:23:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 626270208. Throughput: 0: 8657.2, 1: 8896.0. Samples: 626276688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:33,785][121949] Avg episode reward: [(0, '6215.717'), (1, '5481.730')] [2023-12-26 09:23:34,305][123091] Updated weights for policy 0, policy_version 1227450 (0.0010) [2023-12-26 09:23:34,362][123091] Updated weights for policy 0, policy_version 1227460 (0.0009) [2023-12-26 09:23:34,418][123091] Updated weights for policy 0, policy_version 1227470 (0.0009) [2023-12-26 09:23:34,543][123090] Updated weights for policy 1, policy_version 1218915 (0.0010) [2023-12-26 09:23:34,607][123090] Updated weights for policy 1, policy_version 1218925 (0.0009) [2023-12-26 09:23:34,674][123090] Updated weights for policy 1, policy_version 1218935 (0.0008) [2023-12-26 09:23:35,331][123091] Updated weights for policy 0, policy_version 1227480 (0.0009) [2023-12-26 09:23:35,342][123090] Updated weights for policy 1, policy_version 1218945 (0.0006) [2023-12-26 09:23:35,394][123091] Updated weights for policy 0, policy_version 1227490 (0.0008) [2023-12-26 09:23:35,399][123090] Updated weights for policy 1, policy_version 1218955 (0.0008) [2023-12-26 09:23:35,450][123090] Updated weights for policy 1, policy_version 1218965 (0.0007) [2023-12-26 09:23:35,455][123091] Updated weights for policy 0, policy_version 1227500 (0.0009) [2023-12-26 09:23:35,499][123090] Updated weights for policy 1, policy_version 1218975 (0.0005) [2023-12-26 09:23:36,276][123090] Updated weights for policy 1, policy_version 1218985 (0.0010) [2023-12-26 09:23:36,322][123091] Updated weights for policy 0, policy_version 1227510 (0.0009) [2023-12-26 09:23:36,342][123090] Updated weights for policy 1, policy_version 1218995 (0.0008) [2023-12-26 09:23:36,383][123091] Updated weights for policy 0, policy_version 1227520 (0.0009) [2023-12-26 09:23:36,393][123090] Updated weights for policy 1, policy_version 1219005 (0.0005) [2023-12-26 09:23:36,448][123091] Updated weights for policy 0, policy_version 1227530 (0.0010) [2023-12-26 09:23:37,201][123090] Updated weights for policy 1, policy_version 1219015 (0.0008) [2023-12-26 09:23:37,246][123091] Updated weights for policy 0, policy_version 1227540 (0.0008) [2023-12-26 09:23:37,263][123090] Updated weights for policy 1, policy_version 1219025 (0.0010) [2023-12-26 09:23:37,301][123091] Updated weights for policy 0, policy_version 1227550 (0.0008) [2023-12-26 09:23:37,322][123090] Updated weights for policy 1, policy_version 1219035 (0.0007) [2023-12-26 09:23:37,359][123091] Updated weights for policy 0, policy_version 1227560 (0.0009) [2023-12-26 09:23:38,095][123090] Updated weights for policy 1, policy_version 1219045 (0.0006) [2023-12-26 09:23:38,146][123090] Updated weights for policy 1, policy_version 1219055 (0.0006) [2023-12-26 09:23:38,210][123090] Updated weights for policy 1, policy_version 1219065 (0.0009) [2023-12-26 09:23:38,234][123091] Updated weights for policy 0, policy_version 1227570 (0.0009) [2023-12-26 09:23:38,298][123091] Updated weights for policy 0, policy_version 1227580 (0.0009) [2023-12-26 09:23:38,367][123091] Updated weights for policy 0, policy_version 1227590 (0.0008) [2023-12-26 09:23:38,432][123091] Updated weights for policy 0, policy_version 1227600 (0.0010) [2023-12-26 09:23:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 626352128. Throughput: 0: 8593.1, 1: 8949.3. Samples: 626329416. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:38,785][121949] Avg episode reward: [(0, '6117.119'), (1, '5311.310')] [2023-12-26 09:23:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001227600_314269696.pth... [2023-12-26 09:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001219072_312082432.pth... [2023-12-26 09:23:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001226608_314015744.pth [2023-12-26 09:23:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001218048_311820288.pth [2023-12-26 09:23:39,008][123090] Updated weights for policy 1, policy_version 1219075 (0.0008) [2023-12-26 09:23:39,060][123090] Updated weights for policy 1, policy_version 1219085 (0.0009) [2023-12-26 09:23:39,117][123090] Updated weights for policy 1, policy_version 1219095 (0.0009) [2023-12-26 09:23:39,266][123091] Updated weights for policy 0, policy_version 1227610 (0.0010) [2023-12-26 09:23:39,323][123091] Updated weights for policy 0, policy_version 1227620 (0.0009) [2023-12-26 09:23:39,397][123091] Updated weights for policy 0, policy_version 1227630 (0.0009) [2023-12-26 09:23:39,956][123090] Updated weights for policy 1, policy_version 1219105 (0.0009) [2023-12-26 09:23:40,024][123090] Updated weights for policy 1, policy_version 1219115 (0.0010) [2023-12-26 09:23:40,101][123090] Updated weights for policy 1, policy_version 1219125 (0.0009) [2023-12-26 09:23:40,167][123090] Updated weights for policy 1, policy_version 1219135 (0.0009) [2023-12-26 09:23:40,271][123091] Updated weights for policy 0, policy_version 1227640 (0.0009) [2023-12-26 09:23:40,330][123091] Updated weights for policy 0, policy_version 1227650 (0.0010) [2023-12-26 09:23:40,390][123091] Updated weights for policy 0, policy_version 1227660 (0.0010) [2023-12-26 09:23:40,906][123090] Updated weights for policy 1, policy_version 1219145 (0.0006) [2023-12-26 09:23:40,963][123090] Updated weights for policy 1, policy_version 1219155 (0.0005) [2023-12-26 09:23:41,054][123090] Updated weights for policy 1, policy_version 1219165 (0.0006) [2023-12-26 09:23:41,311][123091] Updated weights for policy 0, policy_version 1227670 (0.0008) [2023-12-26 09:23:41,378][123091] Updated weights for policy 0, policy_version 1227680 (0.0009) [2023-12-26 09:23:41,452][123091] Updated weights for policy 0, policy_version 1227690 (0.0008) [2023-12-26 09:23:41,855][123090] Updated weights for policy 1, policy_version 1219175 (0.0007) [2023-12-26 09:23:41,928][123090] Updated weights for policy 1, policy_version 1219185 (0.0006) [2023-12-26 09:23:41,979][123090] Updated weights for policy 1, policy_version 1219195 (0.0005) [2023-12-26 09:23:42,308][123091] Updated weights for policy 0, policy_version 1227700 (0.0010) [2023-12-26 09:23:42,387][123091] Updated weights for policy 0, policy_version 1227710 (0.0011) [2023-12-26 09:23:42,454][123091] Updated weights for policy 0, policy_version 1227720 (0.0010) [2023-12-26 09:23:42,700][123090] Updated weights for policy 1, policy_version 1219205 (0.0007) [2023-12-26 09:23:42,766][123090] Updated weights for policy 1, policy_version 1219215 (0.0009) [2023-12-26 09:23:42,824][123090] Updated weights for policy 1, policy_version 1219225 (0.0007) [2023-12-26 09:23:43,262][123091] Updated weights for policy 0, policy_version 1227730 (0.0011) [2023-12-26 09:23:43,313][123091] Updated weights for policy 0, policy_version 1227740 (0.0010) [2023-12-26 09:23:43,363][123091] Updated weights for policy 0, policy_version 1227750 (0.0008) [2023-12-26 09:23:43,419][123090] Updated weights for policy 1, policy_version 1219235 (0.0005) [2023-12-26 09:23:43,420][123091] Updated weights for policy 0, policy_version 1227760 (0.0005) [2023-12-26 09:23:43,479][123090] Updated weights for policy 1, policy_version 1219245 (0.0005) [2023-12-26 09:23:43,535][123090] Updated weights for policy 1, policy_version 1219255 (0.0005) [2023-12-26 09:23:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 626442240. Throughput: 0: 8412.2, 1: 8964.6. Samples: 626431992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:43,785][121949] Avg episode reward: [(0, '6077.007'), (1, '5218.729')] [2023-12-26 09:23:44,098][123091] Updated weights for policy 0, policy_version 1227770 (0.0006) [2023-12-26 09:23:44,141][123090] Updated weights for policy 1, policy_version 1219265 (0.0005) [2023-12-26 09:23:44,155][123091] Updated weights for policy 0, policy_version 1227780 (0.0005) [2023-12-26 09:23:44,199][123090] Updated weights for policy 1, policy_version 1219275 (0.0005) [2023-12-26 09:23:44,219][123091] Updated weights for policy 0, policy_version 1227790 (0.0005) [2023-12-26 09:23:44,248][123090] Updated weights for policy 1, policy_version 1219285 (0.0005) [2023-12-26 09:23:44,303][123090] Updated weights for policy 1, policy_version 1219295 (0.0005) [2023-12-26 09:23:44,873][123091] Updated weights for policy 0, policy_version 1227800 (0.0005) [2023-12-26 09:23:44,943][123091] Updated weights for policy 0, policy_version 1227810 (0.0005) [2023-12-26 09:23:45,011][123091] Updated weights for policy 0, policy_version 1227820 (0.0006) [2023-12-26 09:23:45,151][123090] Updated weights for policy 1, policy_version 1219305 (0.0009) [2023-12-26 09:23:45,211][123090] Updated weights for policy 1, policy_version 1219315 (0.0009) [2023-12-26 09:23:45,272][123090] Updated weights for policy 1, policy_version 1219325 (0.0009) [2023-12-26 09:23:45,748][123091] Updated weights for policy 0, policy_version 1227830 (0.0010) [2023-12-26 09:23:45,807][123091] Updated weights for policy 0, policy_version 1227840 (0.0010) [2023-12-26 09:23:45,858][123091] Updated weights for policy 0, policy_version 1227850 (0.0010) [2023-12-26 09:23:46,140][123090] Updated weights for policy 1, policy_version 1219335 (0.0008) [2023-12-26 09:23:46,189][123090] Updated weights for policy 1, policy_version 1219345 (0.0008) [2023-12-26 09:23:46,244][123090] Updated weights for policy 1, policy_version 1219355 (0.0010) [2023-12-26 09:23:46,634][123091] Updated weights for policy 0, policy_version 1227860 (0.0010) [2023-12-26 09:23:46,684][123091] Updated weights for policy 0, policy_version 1227870 (0.0007) [2023-12-26 09:23:46,744][123091] Updated weights for policy 0, policy_version 1227880 (0.0005) [2023-12-26 09:23:47,004][123090] Updated weights for policy 1, policy_version 1219365 (0.0008) [2023-12-26 09:23:47,072][123090] Updated weights for policy 1, policy_version 1219375 (0.0005) [2023-12-26 09:23:47,127][123090] Updated weights for policy 1, policy_version 1219385 (0.0005) [2023-12-26 09:23:47,521][123091] Updated weights for policy 0, policy_version 1227890 (0.0007) [2023-12-26 09:23:47,574][123091] Updated weights for policy 0, policy_version 1227900 (0.0009) [2023-12-26 09:23:47,627][123091] Updated weights for policy 0, policy_version 1227910 (0.0009) [2023-12-26 09:23:47,680][123091] Updated weights for policy 0, policy_version 1227920 (0.0009) [2023-12-26 09:23:47,873][123090] Updated weights for policy 1, policy_version 1219395 (0.0007) [2023-12-26 09:23:47,939][123090] Updated weights for policy 1, policy_version 1219405 (0.0008) [2023-12-26 09:23:48,011][123090] Updated weights for policy 1, policy_version 1219415 (0.0008) [2023-12-26 09:23:48,535][123091] Updated weights for policy 0, policy_version 1227930 (0.0006) [2023-12-26 09:23:48,604][123091] Updated weights for policy 0, policy_version 1227940 (0.0006) [2023-12-26 09:23:48,651][123090] Updated weights for policy 1, policy_version 1219425 (0.0007) [2023-12-26 09:23:48,667][123091] Updated weights for policy 0, policy_version 1227950 (0.0005) [2023-12-26 09:23:48,717][123090] Updated weights for policy 1, policy_version 1219435 (0.0007) [2023-12-26 09:23:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 626532352. Throughput: 0: 8568.8, 1: 8976.4. Samples: 626544908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:48,784][121949] Avg episode reward: [(0, '6208.208'), (1, '5154.587')] [2023-12-26 09:23:48,786][123090] Updated weights for policy 1, policy_version 1219445 (0.0008) [2023-12-26 09:23:48,848][123090] Updated weights for policy 1, policy_version 1219455 (0.0005) [2023-12-26 09:23:49,354][123091] Updated weights for policy 0, policy_version 1227960 (0.0010) [2023-12-26 09:23:49,421][123091] Updated weights for policy 0, policy_version 1227970 (0.0006) [2023-12-26 09:23:49,481][123091] Updated weights for policy 0, policy_version 1227980 (0.0005) [2023-12-26 09:23:49,650][123090] Updated weights for policy 1, policy_version 1219465 (0.0009) [2023-12-26 09:23:49,715][123090] Updated weights for policy 1, policy_version 1219475 (0.0009) [2023-12-26 09:23:49,777][123090] Updated weights for policy 1, policy_version 1219485 (0.0009) [2023-12-26 09:23:50,300][123091] Updated weights for policy 0, policy_version 1227990 (0.0007) [2023-12-26 09:23:50,347][123091] Updated weights for policy 0, policy_version 1228000 (0.0009) [2023-12-26 09:23:50,403][123091] Updated weights for policy 0, policy_version 1228010 (0.0009) [2023-12-26 09:23:50,622][123090] Updated weights for policy 1, policy_version 1219495 (0.0010) [2023-12-26 09:23:50,688][123090] Updated weights for policy 1, policy_version 1219505 (0.0009) [2023-12-26 09:23:50,756][123090] Updated weights for policy 1, policy_version 1219515 (0.0010) [2023-12-26 09:23:51,275][123091] Updated weights for policy 0, policy_version 1228020 (0.0010) [2023-12-26 09:23:51,346][123091] Updated weights for policy 0, policy_version 1228030 (0.0009) [2023-12-26 09:23:51,413][123091] Updated weights for policy 0, policy_version 1228040 (0.0007) [2023-12-26 09:23:51,640][123090] Updated weights for policy 1, policy_version 1219525 (0.0009) [2023-12-26 09:23:51,698][123090] Updated weights for policy 1, policy_version 1219535 (0.0009) [2023-12-26 09:23:51,770][123090] Updated weights for policy 1, policy_version 1219545 (0.0010) [2023-12-26 09:23:52,234][123091] Updated weights for policy 0, policy_version 1228050 (0.0009) [2023-12-26 09:23:52,298][123091] Updated weights for policy 0, policy_version 1228060 (0.0011) [2023-12-26 09:23:52,361][123091] Updated weights for policy 0, policy_version 1228070 (0.0008) [2023-12-26 09:23:52,423][123091] Updated weights for policy 0, policy_version 1228080 (0.0007) [2023-12-26 09:23:52,628][123090] Updated weights for policy 1, policy_version 1219555 (0.0010) [2023-12-26 09:23:52,699][123090] Updated weights for policy 1, policy_version 1219565 (0.0010) [2023-12-26 09:23:52,780][123090] Updated weights for policy 1, policy_version 1219575 (0.0010) [2023-12-26 09:23:53,136][123091] Updated weights for policy 0, policy_version 1228090 (0.0005) [2023-12-26 09:23:53,205][123091] Updated weights for policy 0, policy_version 1228100 (0.0006) [2023-12-26 09:23:53,263][123091] Updated weights for policy 0, policy_version 1228110 (0.0010) [2023-12-26 09:23:53,595][123090] Updated weights for policy 1, policy_version 1219585 (0.0008) [2023-12-26 09:23:53,653][123090] Updated weights for policy 1, policy_version 1219595 (0.0010) [2023-12-26 09:23:53,715][123090] Updated weights for policy 1, policy_version 1219605 (0.0010) [2023-12-26 09:23:53,771][123090] Updated weights for policy 1, policy_version 1219615 (0.0010) [2023-12-26 09:23:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 626622464. Throughput: 0: 8585.9, 1: 8914.4. Samples: 626596304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:53,786][121949] Avg episode reward: [(0, '6260.990'), (1, '5133.748')] [2023-12-26 09:23:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001228112_314400768.pth... [2023-12-26 09:23:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001219616_312221696.pth... [2023-12-26 09:23:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001227088_314138624.pth [2023-12-26 09:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001218560_311951360.pth [2023-12-26 09:23:53,903][123091] Updated weights for policy 0, policy_version 1228120 (0.0006) [2023-12-26 09:23:53,949][123091] Updated weights for policy 0, policy_version 1228130 (0.0005) [2023-12-26 09:23:53,994][123091] Updated weights for policy 0, policy_version 1228140 (0.0005) [2023-12-26 09:23:54,639][123091] Updated weights for policy 0, policy_version 1228150 (0.0006) [2023-12-26 09:23:54,693][123091] Updated weights for policy 0, policy_version 1228160 (0.0005) [2023-12-26 09:23:54,711][123090] Updated weights for policy 1, policy_version 1219625 (0.0009) [2023-12-26 09:23:54,738][123091] Updated weights for policy 0, policy_version 1228170 (0.0005) [2023-12-26 09:23:54,769][123090] Updated weights for policy 1, policy_version 1219635 (0.0007) [2023-12-26 09:23:54,838][123090] Updated weights for policy 1, policy_version 1219645 (0.0009) [2023-12-26 09:23:55,507][123091] Updated weights for policy 0, policy_version 1228180 (0.0009) [2023-12-26 09:23:55,551][123091] Updated weights for policy 0, policy_version 1228190 (0.0010) [2023-12-26 09:23:55,612][123091] Updated weights for policy 0, policy_version 1228200 (0.0010) [2023-12-26 09:23:55,679][123090] Updated weights for policy 1, policy_version 1219655 (0.0010) [2023-12-26 09:23:55,730][123090] Updated weights for policy 1, policy_version 1219665 (0.0008) [2023-12-26 09:23:55,785][123090] Updated weights for policy 1, policy_version 1219675 (0.0008) [2023-12-26 09:23:56,447][123091] Updated weights for policy 0, policy_version 1228210 (0.0010) [2023-12-26 09:23:56,506][123091] Updated weights for policy 0, policy_version 1228220 (0.0010) [2023-12-26 09:23:56,568][123091] Updated weights for policy 0, policy_version 1228230 (0.0010) [2023-12-26 09:23:56,630][123091] Updated weights for policy 0, policy_version 1228240 (0.0006) [2023-12-26 09:23:56,653][123090] Updated weights for policy 1, policy_version 1219685 (0.0009) [2023-12-26 09:23:56,724][123090] Updated weights for policy 1, policy_version 1219695 (0.0009) [2023-12-26 09:23:56,796][123090] Updated weights for policy 1, policy_version 1219705 (0.0009) [2023-12-26 09:23:57,433][123091] Updated weights for policy 0, policy_version 1228250 (0.0010) [2023-12-26 09:23:57,476][123091] Updated weights for policy 0, policy_version 1228260 (0.0010) [2023-12-26 09:23:57,523][123091] Updated weights for policy 0, policy_version 1228270 (0.0010) [2023-12-26 09:23:57,558][123090] Updated weights for policy 1, policy_version 1219715 (0.0009) [2023-12-26 09:23:57,613][123090] Updated weights for policy 1, policy_version 1219725 (0.0008) [2023-12-26 09:23:57,664][123090] Updated weights for policy 1, policy_version 1219735 (0.0008) [2023-12-26 09:23:58,389][123091] Updated weights for policy 0, policy_version 1228280 (0.0008) [2023-12-26 09:23:58,421][123090] Updated weights for policy 1, policy_version 1219745 (0.0009) [2023-12-26 09:23:58,459][123091] Updated weights for policy 0, policy_version 1228290 (0.0010) [2023-12-26 09:23:58,486][123090] Updated weights for policy 1, policy_version 1219755 (0.0010) [2023-12-26 09:23:58,523][123091] Updated weights for policy 0, policy_version 1228300 (0.0010) [2023-12-26 09:23:58,547][123090] Updated weights for policy 1, policy_version 1219765 (0.0011) [2023-12-26 09:23:58,612][123090] Updated weights for policy 1, policy_version 1219775 (0.0011) [2023-12-26 09:23:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 626712576. Throughput: 0: 8715.4, 1: 8872.1. Samples: 626701624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:23:58,785][121949] Avg episode reward: [(0, '6171.139'), (1, '5100.567')] [2023-12-26 09:23:59,457][123091] Updated weights for policy 0, policy_version 1228310 (0.0010) [2023-12-26 09:23:59,517][123091] Updated weights for policy 0, policy_version 1228320 (0.0010) [2023-12-26 09:23:59,545][123090] Updated weights for policy 1, policy_version 1219785 (0.0008) [2023-12-26 09:23:59,578][123091] Updated weights for policy 0, policy_version 1228330 (0.0008) [2023-12-26 09:23:59,594][123090] Updated weights for policy 1, policy_version 1219795 (0.0009) [2023-12-26 09:23:59,649][123090] Updated weights for policy 1, policy_version 1219805 (0.0008) [2023-12-26 09:24:00,407][123091] Updated weights for policy 0, policy_version 1228340 (0.0008) [2023-12-26 09:24:00,456][123091] Updated weights for policy 0, policy_version 1228351 (0.0009) [2023-12-26 09:24:00,511][123091] Updated weights for policy 0, policy_version 1228361 (0.0009) [2023-12-26 09:24:00,534][123090] Updated weights for policy 1, policy_version 1219815 (0.0010) [2023-12-26 09:24:00,593][123090] Updated weights for policy 1, policy_version 1219825 (0.0010) [2023-12-26 09:24:00,644][123090] Updated weights for policy 1, policy_version 1219835 (0.0010) [2023-12-26 09:24:01,268][123091] Updated weights for policy 0, policy_version 1228371 (0.0007) [2023-12-26 09:24:01,329][123091] Updated weights for policy 0, policy_version 1228381 (0.0009) [2023-12-26 09:24:01,401][123091] Updated weights for policy 0, policy_version 1228391 (0.0009) [2023-12-26 09:24:01,456][123090] Updated weights for policy 1, policy_version 1219845 (0.0009) [2023-12-26 09:24:01,517][123090] Updated weights for policy 1, policy_version 1219855 (0.0010) [2023-12-26 09:24:01,582][123090] Updated weights for policy 1, policy_version 1219865 (0.0007) [2023-12-26 09:24:02,195][123091] Updated weights for policy 0, policy_version 1228401 (0.0008) [2023-12-26 09:24:02,262][123091] Updated weights for policy 0, policy_version 1228411 (0.0008) [2023-12-26 09:24:02,331][123091] Updated weights for policy 0, policy_version 1228421 (0.0009) [2023-12-26 09:24:02,355][123090] Updated weights for policy 1, policy_version 1219875 (0.0008) [2023-12-26 09:24:02,385][123091] Updated weights for policy 0, policy_version 1228431 (0.0009) [2023-12-26 09:24:02,415][123090] Updated weights for policy 1, policy_version 1219885 (0.0008) [2023-12-26 09:24:02,470][123090] Updated weights for policy 1, policy_version 1219895 (0.0008) [2023-12-26 09:24:03,135][123091] Updated weights for policy 0, policy_version 1228441 (0.0010) [2023-12-26 09:24:03,203][123091] Updated weights for policy 0, policy_version 1228451 (0.0011) [2023-12-26 09:24:03,262][123091] Updated weights for policy 0, policy_version 1228461 (0.0010) [2023-12-26 09:24:03,294][123090] Updated weights for policy 1, policy_version 1219905 (0.0008) [2023-12-26 09:24:03,364][123090] Updated weights for policy 1, policy_version 1219915 (0.0007) [2023-12-26 09:24:03,431][123090] Updated weights for policy 1, policy_version 1219925 (0.0008) [2023-12-26 09:24:03,502][123090] Updated weights for policy 1, policy_version 1219935 (0.0008) [2023-12-26 09:24:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 626794496. Throughput: 0: 8768.1, 1: 8772.1. Samples: 626805704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:03,785][121949] Avg episode reward: [(0, '6147.431'), (1, '5127.250')] [2023-12-26 09:24:03,984][123091] Updated weights for policy 0, policy_version 1228471 (0.0007) [2023-12-26 09:24:04,056][123091] Updated weights for policy 0, policy_version 1228481 (0.0005) [2023-12-26 09:24:04,065][123090] Updated weights for policy 1, policy_version 1219945 (0.0006) [2023-12-26 09:24:04,123][123091] Updated weights for policy 0, policy_version 1228491 (0.0006) [2023-12-26 09:24:04,133][123090] Updated weights for policy 1, policy_version 1219955 (0.0009) [2023-12-26 09:24:04,208][123090] Updated weights for policy 1, policy_version 1219965 (0.0009) [2023-12-26 09:24:04,780][123091] Updated weights for policy 0, policy_version 1228501 (0.0006) [2023-12-26 09:24:04,840][123091] Updated weights for policy 0, policy_version 1228511 (0.0006) [2023-12-26 09:24:04,896][123090] Updated weights for policy 1, policy_version 1219975 (0.0006) [2023-12-26 09:24:04,898][123091] Updated weights for policy 0, policy_version 1228521 (0.0005) [2023-12-26 09:24:04,945][123090] Updated weights for policy 1, policy_version 1219985 (0.0005) [2023-12-26 09:24:04,993][123090] Updated weights for policy 1, policy_version 1219995 (0.0005) [2023-12-26 09:24:05,548][123091] Updated weights for policy 0, policy_version 1228531 (0.0007) [2023-12-26 09:24:05,602][123091] Updated weights for policy 0, policy_version 1228541 (0.0008) [2023-12-26 09:24:05,650][123091] Updated weights for policy 0, policy_version 1228551 (0.0005) [2023-12-26 09:24:05,766][123090] Updated weights for policy 1, policy_version 1220005 (0.0005) [2023-12-26 09:24:05,830][123090] Updated weights for policy 1, policy_version 1220015 (0.0005) [2023-12-26 09:24:05,877][123090] Updated weights for policy 1, policy_version 1220025 (0.0005) [2023-12-26 09:24:06,417][123091] Updated weights for policy 0, policy_version 1228561 (0.0006) [2023-12-26 09:24:06,481][123091] Updated weights for policy 0, policy_version 1228571 (0.0009) [2023-12-26 09:24:06,544][123091] Updated weights for policy 0, policy_version 1228581 (0.0011) [2023-12-26 09:24:06,609][123091] Updated weights for policy 0, policy_version 1228591 (0.0011) [2023-12-26 09:24:06,653][123090] Updated weights for policy 1, policy_version 1220035 (0.0007) [2023-12-26 09:24:06,703][123090] Updated weights for policy 1, policy_version 1220045 (0.0011) [2023-12-26 09:24:06,759][123090] Updated weights for policy 1, policy_version 1220055 (0.0010) [2023-12-26 09:24:07,418][123091] Updated weights for policy 0, policy_version 1228601 (0.0011) [2023-12-26 09:24:07,481][123091] Updated weights for policy 0, policy_version 1228611 (0.0008) [2023-12-26 09:24:07,542][123091] Updated weights for policy 0, policy_version 1228621 (0.0009) [2023-12-26 09:24:07,583][123090] Updated weights for policy 1, policy_version 1220065 (0.0011) [2023-12-26 09:24:07,643][123090] Updated weights for policy 1, policy_version 1220075 (0.0011) [2023-12-26 09:24:07,692][123090] Updated weights for policy 1, policy_version 1220085 (0.0010) [2023-12-26 09:24:07,755][123090] Updated weights for policy 1, policy_version 1220095 (0.0011) [2023-12-26 09:24:08,357][123091] Updated weights for policy 0, policy_version 1228631 (0.0008) [2023-12-26 09:24:08,435][123091] Updated weights for policy 0, policy_version 1228641 (0.0007) [2023-12-26 09:24:08,512][123091] Updated weights for policy 0, policy_version 1228651 (0.0005) [2023-12-26 09:24:08,566][123090] Updated weights for policy 1, policy_version 1220105 (0.0006) [2023-12-26 09:24:08,631][123090] Updated weights for policy 1, policy_version 1220115 (0.0009) [2023-12-26 09:24:08,686][123090] Updated weights for policy 1, policy_version 1220125 (0.0009) [2023-12-26 09:24:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 626892800. Throughput: 0: 8876.0, 1: 8875.2. Samples: 626865460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:08,785][121949] Avg episode reward: [(0, '6251.253'), (1, '5383.306')] [2023-12-26 09:24:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001228656_314540032.pth... [2023-12-26 09:24:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001220128_312352768.pth... [2023-12-26 09:24:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001227600_314269696.pth [2023-12-26 09:24:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001219072_312082432.pth [2023-12-26 09:24:09,218][123091] Updated weights for policy 0, policy_version 1228661 (0.0006) [2023-12-26 09:24:09,287][123091] Updated weights for policy 0, policy_version 1228671 (0.0008) [2023-12-26 09:24:09,357][123091] Updated weights for policy 0, policy_version 1228681 (0.0011) [2023-12-26 09:24:09,467][123090] Updated weights for policy 1, policy_version 1220135 (0.0008) [2023-12-26 09:24:09,532][123090] Updated weights for policy 1, policy_version 1220145 (0.0011) [2023-12-26 09:24:09,608][123090] Updated weights for policy 1, policy_version 1220155 (0.0011) [2023-12-26 09:24:10,108][123091] Updated weights for policy 0, policy_version 1228691 (0.0010) [2023-12-26 09:24:10,169][123091] Updated weights for policy 0, policy_version 1228701 (0.0009) [2023-12-26 09:24:10,234][123091] Updated weights for policy 0, policy_version 1228711 (0.0009) [2023-12-26 09:24:10,442][123090] Updated weights for policy 1, policy_version 1220165 (0.0011) [2023-12-26 09:24:10,516][123090] Updated weights for policy 1, policy_version 1220175 (0.0009) [2023-12-26 09:24:10,587][123090] Updated weights for policy 1, policy_version 1220185 (0.0007) [2023-12-26 09:24:11,036][123091] Updated weights for policy 0, policy_version 1228721 (0.0008) [2023-12-26 09:24:11,096][123091] Updated weights for policy 0, policy_version 1228731 (0.0009) [2023-12-26 09:24:11,155][123091] Updated weights for policy 0, policy_version 1228741 (0.0009) [2023-12-26 09:24:11,211][123091] Updated weights for policy 0, policy_version 1228751 (0.0007) [2023-12-26 09:24:11,311][123090] Updated weights for policy 1, policy_version 1220195 (0.0007) [2023-12-26 09:24:11,383][123090] Updated weights for policy 1, policy_version 1220205 (0.0011) [2023-12-26 09:24:11,458][123090] Updated weights for policy 1, policy_version 1220215 (0.0006) [2023-12-26 09:24:11,976][123091] Updated weights for policy 0, policy_version 1228761 (0.0009) [2023-12-26 09:24:12,042][123091] Updated weights for policy 0, policy_version 1228771 (0.0009) [2023-12-26 09:24:12,114][123091] Updated weights for policy 0, policy_version 1228781 (0.0009) [2023-12-26 09:24:12,281][123090] Updated weights for policy 1, policy_version 1220225 (0.0006) [2023-12-26 09:24:12,347][123090] Updated weights for policy 1, policy_version 1220235 (0.0009) [2023-12-26 09:24:12,418][123090] Updated weights for policy 1, policy_version 1220245 (0.0012) [2023-12-26 09:24:12,491][123090] Updated weights for policy 1, policy_version 1220255 (0.0006) [2023-12-26 09:24:12,945][123091] Updated weights for policy 0, policy_version 1228791 (0.0010) [2023-12-26 09:24:13,000][123091] Updated weights for policy 0, policy_version 1228801 (0.0011) [2023-12-26 09:24:13,048][123091] Updated weights for policy 0, policy_version 1228811 (0.0010) [2023-12-26 09:24:13,239][123090] Updated weights for policy 1, policy_version 1220265 (0.0005) [2023-12-26 09:24:13,305][123090] Updated weights for policy 1, policy_version 1220275 (0.0005) [2023-12-26 09:24:13,374][123090] Updated weights for policy 1, policy_version 1220285 (0.0005) [2023-12-26 09:24:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 626974720. Throughput: 0: 8815.9, 1: 8902.7. Samples: 626970104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:13,785][121949] Avg episode reward: [(0, '6124.219'), (1, '5312.763')] [2023-12-26 09:24:13,832][123091] Updated weights for policy 0, policy_version 1228821 (0.0010) [2023-12-26 09:24:13,888][123091] Updated weights for policy 0, policy_version 1228831 (0.0009) [2023-12-26 09:24:13,949][123091] Updated weights for policy 0, policy_version 1228841 (0.0008) [2023-12-26 09:24:13,975][123090] Updated weights for policy 1, policy_version 1220295 (0.0006) [2023-12-26 09:24:14,026][123090] Updated weights for policy 1, policy_version 1220305 (0.0009) [2023-12-26 09:24:14,086][123090] Updated weights for policy 1, policy_version 1220315 (0.0008) [2023-12-26 09:24:14,716][123091] Updated weights for policy 0, policy_version 1228851 (0.0007) [2023-12-26 09:24:14,781][123091] Updated weights for policy 0, policy_version 1228861 (0.0009) [2023-12-26 09:24:14,842][123091] Updated weights for policy 0, policy_version 1228871 (0.0009) [2023-12-26 09:24:14,935][123090] Updated weights for policy 1, policy_version 1220325 (0.0008) [2023-12-26 09:24:14,990][123090] Updated weights for policy 1, policy_version 1220335 (0.0008) [2023-12-26 09:24:15,047][123090] Updated weights for policy 1, policy_version 1220345 (0.0006) [2023-12-26 09:24:15,621][123091] Updated weights for policy 0, policy_version 1228881 (0.0009) [2023-12-26 09:24:15,677][123091] Updated weights for policy 0, policy_version 1228891 (0.0005) [2023-12-26 09:24:15,734][123091] Updated weights for policy 0, policy_version 1228901 (0.0007) [2023-12-26 09:24:15,799][123091] Updated weights for policy 0, policy_version 1228911 (0.0010) [2023-12-26 09:24:15,893][123090] Updated weights for policy 1, policy_version 1220355 (0.0005) [2023-12-26 09:24:15,962][123090] Updated weights for policy 1, policy_version 1220365 (0.0005) [2023-12-26 09:24:16,019][123090] Updated weights for policy 1, policy_version 1220375 (0.0006) [2023-12-26 09:24:16,604][123091] Updated weights for policy 0, policy_version 1228921 (0.0008) [2023-12-26 09:24:16,657][123091] Updated weights for policy 0, policy_version 1228931 (0.0010) [2023-12-26 09:24:16,714][123091] Updated weights for policy 0, policy_version 1228941 (0.0009) [2023-12-26 09:24:16,729][123090] Updated weights for policy 1, policy_version 1220385 (0.0006) [2023-12-26 09:24:16,780][123090] Updated weights for policy 1, policy_version 1220395 (0.0005) [2023-12-26 09:24:16,828][123090] Updated weights for policy 1, policy_version 1220405 (0.0007) [2023-12-26 09:24:16,872][123090] Updated weights for policy 1, policy_version 1220415 (0.0010) [2023-12-26 09:24:17,406][123091] Updated weights for policy 0, policy_version 1228951 (0.0007) [2023-12-26 09:24:17,453][123091] Updated weights for policy 0, policy_version 1228961 (0.0005) [2023-12-26 09:24:17,509][123091] Updated weights for policy 0, policy_version 1228971 (0.0005) [2023-12-26 09:24:17,546][123090] Updated weights for policy 1, policy_version 1220425 (0.0010) [2023-12-26 09:24:17,593][123090] Updated weights for policy 1, policy_version 1220435 (0.0010) [2023-12-26 09:24:17,641][123090] Updated weights for policy 1, policy_version 1220445 (0.0010) [2023-12-26 09:24:18,245][123091] Updated weights for policy 0, policy_version 1228981 (0.0006) [2023-12-26 09:24:18,300][123091] Updated weights for policy 0, policy_version 1228991 (0.0007) [2023-12-26 09:24:18,364][123091] Updated weights for policy 0, policy_version 1229001 (0.0008) [2023-12-26 09:24:18,491][123090] Updated weights for policy 1, policy_version 1220455 (0.0010) [2023-12-26 09:24:18,543][123090] Updated weights for policy 1, policy_version 1220465 (0.0010) [2023-12-26 09:24:18,607][123090] Updated weights for policy 1, policy_version 1220475 (0.0010) [2023-12-26 09:24:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 627073024. Throughput: 0: 8925.1, 1: 8952.1. Samples: 627081160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:18,785][121949] Avg episode reward: [(0, '6040.105'), (1, '5117.220')] [2023-12-26 09:24:19,167][123091] Updated weights for policy 0, policy_version 1229011 (0.0010) [2023-12-26 09:24:19,220][123091] Updated weights for policy 0, policy_version 1229021 (0.0009) [2023-12-26 09:24:19,281][123091] Updated weights for policy 0, policy_version 1229031 (0.0009) [2023-12-26 09:24:19,432][123090] Updated weights for policy 1, policy_version 1220485 (0.0010) [2023-12-26 09:24:19,508][123090] Updated weights for policy 1, policy_version 1220495 (0.0011) [2023-12-26 09:24:19,569][123090] Updated weights for policy 1, policy_version 1220505 (0.0011) [2023-12-26 09:24:20,074][123091] Updated weights for policy 0, policy_version 1229041 (0.0009) [2023-12-26 09:24:20,132][123091] Updated weights for policy 0, policy_version 1229051 (0.0009) [2023-12-26 09:24:20,182][123091] Updated weights for policy 0, policy_version 1229061 (0.0009) [2023-12-26 09:24:20,246][123091] Updated weights for policy 0, policy_version 1229071 (0.0009) [2023-12-26 09:24:20,367][123090] Updated weights for policy 1, policy_version 1220515 (0.0011) [2023-12-26 09:24:20,431][123090] Updated weights for policy 1, policy_version 1220525 (0.0010) [2023-12-26 09:24:20,498][123090] Updated weights for policy 1, policy_version 1220535 (0.0011) [2023-12-26 09:24:21,030][123091] Updated weights for policy 0, policy_version 1229081 (0.0007) [2023-12-26 09:24:21,091][123091] Updated weights for policy 0, policy_version 1229091 (0.0008) [2023-12-26 09:24:21,151][123091] Updated weights for policy 0, policy_version 1229101 (0.0010) [2023-12-26 09:24:21,317][123090] Updated weights for policy 1, policy_version 1220545 (0.0010) [2023-12-26 09:24:21,393][123090] Updated weights for policy 1, policy_version 1220555 (0.0009) [2023-12-26 09:24:21,450][123090] Updated weights for policy 1, policy_version 1220565 (0.0010) [2023-12-26 09:24:21,506][123090] Updated weights for policy 1, policy_version 1220575 (0.0010) [2023-12-26 09:24:21,994][123091] Updated weights for policy 0, policy_version 1229111 (0.0009) [2023-12-26 09:24:22,054][123091] Updated weights for policy 0, policy_version 1229121 (0.0009) [2023-12-26 09:24:22,115][123091] Updated weights for policy 0, policy_version 1229131 (0.0009) [2023-12-26 09:24:22,332][123090] Updated weights for policy 1, policy_version 1220585 (0.0010) [2023-12-26 09:24:22,399][123090] Updated weights for policy 1, policy_version 1220595 (0.0011) [2023-12-26 09:24:22,462][123090] Updated weights for policy 1, policy_version 1220605 (0.0010) [2023-12-26 09:24:22,968][123091] Updated weights for policy 0, policy_version 1229141 (0.0009) [2023-12-26 09:24:23,042][123091] Updated weights for policy 0, policy_version 1229151 (0.0010) [2023-12-26 09:24:23,095][123091] Updated weights for policy 0, policy_version 1229161 (0.0010) [2023-12-26 09:24:23,266][123090] Updated weights for policy 1, policy_version 1220615 (0.0011) [2023-12-26 09:24:23,331][123090] Updated weights for policy 1, policy_version 1220625 (0.0010) [2023-12-26 09:24:23,390][123090] Updated weights for policy 1, policy_version 1220635 (0.0010) [2023-12-26 09:24:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 627154944. Throughput: 0: 8969.6, 1: 8891.6. Samples: 627133172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:23,785][121949] Avg episode reward: [(0, '6169.959'), (1, '5080.415')] [2023-12-26 09:24:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001229168_314671104.pth... [2023-12-26 09:24:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001220640_312483840.pth... [2023-12-26 09:24:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001228112_314400768.pth [2023-12-26 09:24:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001219616_312221696.pth [2023-12-26 09:24:23,904][123091] Updated weights for policy 0, policy_version 1229171 (0.0008) [2023-12-26 09:24:23,973][123091] Updated weights for policy 0, policy_version 1229181 (0.0006) [2023-12-26 09:24:24,034][123091] Updated weights for policy 0, policy_version 1229191 (0.0005) [2023-12-26 09:24:24,239][123090] Updated weights for policy 1, policy_version 1220645 (0.0007) [2023-12-26 09:24:24,295][123090] Updated weights for policy 1, policy_version 1220655 (0.0005) [2023-12-26 09:24:24,357][123090] Updated weights for policy 1, policy_version 1220665 (0.0005) [2023-12-26 09:24:24,659][123091] Updated weights for policy 0, policy_version 1229201 (0.0005) [2023-12-26 09:24:24,718][123091] Updated weights for policy 0, policy_version 1229211 (0.0006) [2023-12-26 09:24:24,775][123091] Updated weights for policy 0, policy_version 1229221 (0.0010) [2023-12-26 09:24:24,826][123091] Updated weights for policy 0, policy_version 1229231 (0.0010) [2023-12-26 09:24:25,040][123090] Updated weights for policy 1, policy_version 1220675 (0.0005) [2023-12-26 09:24:25,095][123090] Updated weights for policy 1, policy_version 1220685 (0.0006) [2023-12-26 09:24:25,150][123090] Updated weights for policy 1, policy_version 1220695 (0.0010) [2023-12-26 09:24:25,584][123091] Updated weights for policy 0, policy_version 1229241 (0.0006) [2023-12-26 09:24:25,658][123091] Updated weights for policy 0, policy_version 1229251 (0.0005) [2023-12-26 09:24:25,727][123091] Updated weights for policy 0, policy_version 1229261 (0.0010) [2023-12-26 09:24:25,903][123090] Updated weights for policy 1, policy_version 1220705 (0.0010) [2023-12-26 09:24:25,970][123090] Updated weights for policy 1, policy_version 1220715 (0.0010) [2023-12-26 09:24:26,040][123090] Updated weights for policy 1, policy_version 1220725 (0.0010) [2023-12-26 09:24:26,103][123090] Updated weights for policy 1, policy_version 1220735 (0.0010) [2023-12-26 09:24:26,366][123091] Updated weights for policy 0, policy_version 1229271 (0.0007) [2023-12-26 09:24:26,426][123091] Updated weights for policy 0, policy_version 1229281 (0.0006) [2023-12-26 09:24:26,483][123091] Updated weights for policy 0, policy_version 1229291 (0.0010) [2023-12-26 09:24:26,921][123090] Updated weights for policy 1, policy_version 1220745 (0.0011) [2023-12-26 09:24:26,992][123090] Updated weights for policy 1, policy_version 1220755 (0.0011) [2023-12-26 09:24:27,056][123090] Updated weights for policy 1, policy_version 1220765 (0.0010) [2023-12-26 09:24:27,157][123091] Updated weights for policy 0, policy_version 1229301 (0.0010) [2023-12-26 09:24:27,213][123091] Updated weights for policy 0, policy_version 1229311 (0.0010) [2023-12-26 09:24:27,266][123091] Updated weights for policy 0, policy_version 1229321 (0.0010) [2023-12-26 09:24:27,816][123090] Updated weights for policy 1, policy_version 1220775 (0.0007) [2023-12-26 09:24:27,872][123090] Updated weights for policy 1, policy_version 1220785 (0.0005) [2023-12-26 09:24:27,933][123090] Updated weights for policy 1, policy_version 1220795 (0.0005) [2023-12-26 09:24:28,115][123091] Updated weights for policy 0, policy_version 1229331 (0.0008) [2023-12-26 09:24:28,171][123091] Updated weights for policy 0, policy_version 1229341 (0.0009) [2023-12-26 09:24:28,234][123091] Updated weights for policy 0, policy_version 1229351 (0.0009) [2023-12-26 09:24:28,675][123090] Updated weights for policy 1, policy_version 1220805 (0.0006) [2023-12-26 09:24:28,735][123090] Updated weights for policy 1, policy_version 1220815 (0.0009) [2023-12-26 09:24:28,782][123090] Updated weights for policy 1, policy_version 1220825 (0.0009) [2023-12-26 09:24:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 627245056. Throughput: 0: 9133.3, 1: 8894.8. Samples: 627243252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:28,784][121949] Avg episode reward: [(0, '6196.783'), (1, '5230.158')] [2023-12-26 09:24:29,084][123091] Updated weights for policy 0, policy_version 1229361 (0.0009) [2023-12-26 09:24:29,142][123091] Updated weights for policy 0, policy_version 1229371 (0.0005) [2023-12-26 09:24:29,188][123091] Updated weights for policy 0, policy_version 1229381 (0.0005) [2023-12-26 09:24:29,248][123091] Updated weights for policy 0, policy_version 1229391 (0.0006) [2023-12-26 09:24:29,592][123090] Updated weights for policy 1, policy_version 1220835 (0.0008) [2023-12-26 09:24:29,645][123090] Updated weights for policy 1, policy_version 1220846 (0.0008) [2023-12-26 09:24:29,693][123090] Updated weights for policy 1, policy_version 1220856 (0.0009) [2023-12-26 09:24:30,061][123091] Updated weights for policy 0, policy_version 1229401 (0.0006) [2023-12-26 09:24:30,123][123091] Updated weights for policy 0, policy_version 1229411 (0.0006) [2023-12-26 09:24:30,194][123091] Updated weights for policy 0, policy_version 1229421 (0.0007) [2023-12-26 09:24:30,552][123090] Updated weights for policy 1, policy_version 1220867 (0.0009) [2023-12-26 09:24:30,611][123090] Updated weights for policy 1, policy_version 1220877 (0.0006) [2023-12-26 09:24:30,665][123090] Updated weights for policy 1, policy_version 1220887 (0.0006) [2023-12-26 09:24:30,819][123091] Updated weights for policy 0, policy_version 1229431 (0.0006) [2023-12-26 09:24:30,864][123091] Updated weights for policy 0, policy_version 1229441 (0.0005) [2023-12-26 09:24:30,925][123091] Updated weights for policy 0, policy_version 1229451 (0.0009) [2023-12-26 09:24:31,408][123090] Updated weights for policy 1, policy_version 1220897 (0.0006) [2023-12-26 09:24:31,468][123090] Updated weights for policy 1, policy_version 1220907 (0.0009) [2023-12-26 09:24:31,523][123090] Updated weights for policy 1, policy_version 1220917 (0.0008) [2023-12-26 09:24:31,581][123090] Updated weights for policy 1, policy_version 1220927 (0.0009) [2023-12-26 09:24:31,793][123091] Updated weights for policy 0, policy_version 1229461 (0.0009) [2023-12-26 09:24:31,860][123091] Updated weights for policy 0, policy_version 1229471 (0.0009) [2023-12-26 09:24:31,916][123091] Updated weights for policy 0, policy_version 1229481 (0.0009) [2023-12-26 09:24:32,394][123090] Updated weights for policy 1, policy_version 1220937 (0.0009) [2023-12-26 09:24:32,447][123090] Updated weights for policy 1, policy_version 1220947 (0.0009) [2023-12-26 09:24:32,501][123090] Updated weights for policy 1, policy_version 1220957 (0.0009) [2023-12-26 09:24:32,754][123091] Updated weights for policy 0, policy_version 1229491 (0.0009) [2023-12-26 09:24:32,815][123091] Updated weights for policy 0, policy_version 1229501 (0.0009) [2023-12-26 09:24:32,886][123091] Updated weights for policy 0, policy_version 1229511 (0.0010) [2023-12-26 09:24:33,309][123090] Updated weights for policy 1, policy_version 1220967 (0.0009) [2023-12-26 09:24:33,359][123090] Updated weights for policy 1, policy_version 1220977 (0.0008) [2023-12-26 09:24:33,410][123090] Updated weights for policy 1, policy_version 1220987 (0.0008) [2023-12-26 09:24:33,734][123091] Updated weights for policy 0, policy_version 1229521 (0.0010) [2023-12-26 09:24:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 627335168. Throughput: 0: 9039.7, 1: 8822.4. Samples: 627348708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:33,786][121949] Avg episode reward: [(0, '6203.915'), (1, '5303.652')] [2023-12-26 09:24:33,799][123091] Updated weights for policy 0, policy_version 1229531 (0.0008) [2023-12-26 09:24:33,863][123091] Updated weights for policy 0, policy_version 1229541 (0.0009) [2023-12-26 09:24:33,917][123091] Updated weights for policy 0, policy_version 1229551 (0.0010) [2023-12-26 09:24:34,212][123090] Updated weights for policy 1, policy_version 1220997 (0.0009) [2023-12-26 09:24:34,272][123090] Updated weights for policy 1, policy_version 1221007 (0.0010) [2023-12-26 09:24:34,341][123090] Updated weights for policy 1, policy_version 1221017 (0.0008) [2023-12-26 09:24:34,715][123091] Updated weights for policy 0, policy_version 1229561 (0.0006) [2023-12-26 09:24:34,763][123091] Updated weights for policy 0, policy_version 1229571 (0.0005) [2023-12-26 09:24:34,818][123091] Updated weights for policy 0, policy_version 1229581 (0.0006) [2023-12-26 09:24:35,040][123090] Updated weights for policy 1, policy_version 1221027 (0.0005) [2023-12-26 09:24:35,099][123090] Updated weights for policy 1, policy_version 1221037 (0.0006) [2023-12-26 09:24:35,158][123090] Updated weights for policy 1, policy_version 1221047 (0.0007) [2023-12-26 09:24:35,498][123091] Updated weights for policy 0, policy_version 1229591 (0.0005) [2023-12-26 09:24:35,555][123091] Updated weights for policy 0, policy_version 1229601 (0.0005) [2023-12-26 09:24:35,608][123091] Updated weights for policy 0, policy_version 1229611 (0.0005) [2023-12-26 09:24:35,820][123090] Updated weights for policy 1, policy_version 1221057 (0.0006) [2023-12-26 09:24:35,888][123090] Updated weights for policy 1, policy_version 1221067 (0.0009) [2023-12-26 09:24:35,941][123090] Updated weights for policy 1, policy_version 1221077 (0.0010) [2023-12-26 09:24:35,995][123090] Updated weights for policy 1, policy_version 1221087 (0.0009) [2023-12-26 09:24:36,350][123091] Updated weights for policy 0, policy_version 1229621 (0.0005) [2023-12-26 09:24:36,421][123091] Updated weights for policy 0, policy_version 1229631 (0.0007) [2023-12-26 09:24:36,494][123091] Updated weights for policy 0, policy_version 1229641 (0.0008) [2023-12-26 09:24:36,801][123090] Updated weights for policy 1, policy_version 1221097 (0.0009) [2023-12-26 09:24:36,865][123090] Updated weights for policy 1, policy_version 1221107 (0.0009) [2023-12-26 09:24:36,929][123090] Updated weights for policy 1, policy_version 1221117 (0.0009) [2023-12-26 09:24:37,228][123091] Updated weights for policy 0, policy_version 1229651 (0.0007) [2023-12-26 09:24:37,293][123091] Updated weights for policy 0, policy_version 1229661 (0.0005) [2023-12-26 09:24:37,360][123091] Updated weights for policy 0, policy_version 1229671 (0.0005) [2023-12-26 09:24:37,643][123090] Updated weights for policy 1, policy_version 1221127 (0.0006) [2023-12-26 09:24:37,705][123090] Updated weights for policy 1, policy_version 1221137 (0.0008) [2023-12-26 09:24:37,770][123090] Updated weights for policy 1, policy_version 1221147 (0.0009) [2023-12-26 09:24:38,031][123091] Updated weights for policy 0, policy_version 1229681 (0.0006) [2023-12-26 09:24:38,097][123091] Updated weights for policy 0, policy_version 1229691 (0.0007) [2023-12-26 09:24:38,164][123091] Updated weights for policy 0, policy_version 1229701 (0.0005) [2023-12-26 09:24:38,229][123091] Updated weights for policy 0, policy_version 1229711 (0.0005) [2023-12-26 09:24:38,676][123090] Updated weights for policy 1, policy_version 1221157 (0.0009) [2023-12-26 09:24:38,738][123090] Updated weights for policy 1, policy_version 1221167 (0.0010) [2023-12-26 09:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 627425280. Throughput: 0: 9090.9, 1: 8908.4. Samples: 627406268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:38,785][121949] Avg episode reward: [(0, '6270.222'), (1, '5278.484')] [2023-12-26 09:24:38,793][123090] Updated weights for policy 1, policy_version 1221177 (0.0010) [2023-12-26 09:24:38,829][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001221184_312623104.pth... [2023-12-26 09:24:38,832][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001220128_312352768.pth [2023-12-26 09:24:38,845][123091] Updated weights for policy 0, policy_version 1229721 (0.0005) [2023-12-26 09:24:38,902][123091] Updated weights for policy 0, policy_version 1229731 (0.0006) [2023-12-26 09:24:38,951][123091] Updated weights for policy 0, policy_version 1229741 (0.0005) [2023-12-26 09:24:38,964][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001229744_314818560.pth... [2023-12-26 09:24:38,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001228656_314540032.pth [2023-12-26 09:24:39,668][123090] Updated weights for policy 1, policy_version 1221187 (0.0009) [2023-12-26 09:24:39,725][123090] Updated weights for policy 1, policy_version 1221197 (0.0009) [2023-12-26 09:24:39,774][123091] Updated weights for policy 0, policy_version 1229751 (0.0009) [2023-12-26 09:24:39,789][123090] Updated weights for policy 1, policy_version 1221207 (0.0010) [2023-12-26 09:24:39,852][123091] Updated weights for policy 0, policy_version 1229761 (0.0010) [2023-12-26 09:24:39,925][123091] Updated weights for policy 0, policy_version 1229771 (0.0009) [2023-12-26 09:24:40,642][123090] Updated weights for policy 1, policy_version 1221217 (0.0007) [2023-12-26 09:24:40,707][123090] Updated weights for policy 1, policy_version 1221227 (0.0009) [2023-12-26 09:24:40,728][123091] Updated weights for policy 0, policy_version 1229781 (0.0011) [2023-12-26 09:24:40,764][123090] Updated weights for policy 1, policy_version 1221237 (0.0007) [2023-12-26 09:24:40,791][123091] Updated weights for policy 0, policy_version 1229791 (0.0011) [2023-12-26 09:24:40,827][123090] Updated weights for policy 1, policy_version 1221247 (0.0007) [2023-12-26 09:24:40,854][123091] Updated weights for policy 0, policy_version 1229801 (0.0011) [2023-12-26 09:24:41,702][123091] Updated weights for policy 0, policy_version 1229811 (0.0011) [2023-12-26 09:24:41,712][123090] Updated weights for policy 1, policy_version 1221257 (0.0009) [2023-12-26 09:24:41,774][123091] Updated weights for policy 0, policy_version 1229821 (0.0010) [2023-12-26 09:24:41,785][123090] Updated weights for policy 1, policy_version 1221267 (0.0007) [2023-12-26 09:24:41,844][123091] Updated weights for policy 0, policy_version 1229831 (0.0008) [2023-12-26 09:24:41,854][123090] Updated weights for policy 1, policy_version 1221277 (0.0008) [2023-12-26 09:24:42,671][123090] Updated weights for policy 1, policy_version 1221287 (0.0010) [2023-12-26 09:24:42,690][123091] Updated weights for policy 0, policy_version 1229841 (0.0009) [2023-12-26 09:24:42,735][123090] Updated weights for policy 1, policy_version 1221297 (0.0008) [2023-12-26 09:24:42,758][123091] Updated weights for policy 0, policy_version 1229851 (0.0009) [2023-12-26 09:24:42,803][123090] Updated weights for policy 1, policy_version 1221307 (0.0007) [2023-12-26 09:24:42,819][123091] Updated weights for policy 0, policy_version 1229861 (0.0010) [2023-12-26 09:24:42,894][123091] Updated weights for policy 0, policy_version 1229871 (0.0008) [2023-12-26 09:24:43,583][123090] Updated weights for policy 1, policy_version 1221317 (0.0006) [2023-12-26 09:24:43,632][123091] Updated weights for policy 0, policy_version 1229881 (0.0006) [2023-12-26 09:24:43,637][123090] Updated weights for policy 1, policy_version 1221327 (0.0005) [2023-12-26 09:24:43,689][123091] Updated weights for policy 0, policy_version 1229891 (0.0005) [2023-12-26 09:24:43,693][123090] Updated weights for policy 1, policy_version 1221337 (0.0006) [2023-12-26 09:24:43,744][123091] Updated weights for policy 0, policy_version 1229901 (0.0005) [2023-12-26 09:24:43,784][121949] Fps is (10 sec: 18842.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 627523584. Throughput: 0: 9063.7, 1: 8908.1. Samples: 627510352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:43,784][121949] Avg episode reward: [(0, '6225.290'), (1, '5339.594')] [2023-12-26 09:24:44,365][123090] Updated weights for policy 1, policy_version 1221347 (0.0006) [2023-12-26 09:24:44,388][123091] Updated weights for policy 0, policy_version 1229911 (0.0008) [2023-12-26 09:24:44,422][123090] Updated weights for policy 1, policy_version 1221357 (0.0005) [2023-12-26 09:24:44,451][123091] Updated weights for policy 0, policy_version 1229921 (0.0008) [2023-12-26 09:24:44,484][123090] Updated weights for policy 1, policy_version 1221367 (0.0006) [2023-12-26 09:24:44,519][123091] Updated weights for policy 0, policy_version 1229931 (0.0006) [2023-12-26 09:24:45,247][123091] Updated weights for policy 0, policy_version 1229941 (0.0008) [2023-12-26 09:24:45,309][123091] Updated weights for policy 0, policy_version 1229951 (0.0009) [2023-12-26 09:24:45,327][123090] Updated weights for policy 1, policy_version 1221377 (0.0006) [2023-12-26 09:24:45,378][123091] Updated weights for policy 0, policy_version 1229961 (0.0007) [2023-12-26 09:24:45,395][123090] Updated weights for policy 1, policy_version 1221387 (0.0009) [2023-12-26 09:24:45,456][123090] Updated weights for policy 1, policy_version 1221397 (0.0008) [2023-12-26 09:24:45,509][123090] Updated weights for policy 1, policy_version 1221407 (0.0009) [2023-12-26 09:24:46,110][123091] Updated weights for policy 0, policy_version 1229971 (0.0009) [2023-12-26 09:24:46,158][123091] Updated weights for policy 0, policy_version 1229981 (0.0011) [2023-12-26 09:24:46,202][123091] Updated weights for policy 0, policy_version 1229991 (0.0010) [2023-12-26 09:24:46,367][123090] Updated weights for policy 1, policy_version 1221417 (0.0009) [2023-12-26 09:24:46,416][123090] Updated weights for policy 1, policy_version 1221427 (0.0007) [2023-12-26 09:24:46,464][123090] Updated weights for policy 1, policy_version 1221437 (0.0005) [2023-12-26 09:24:46,957][123091] Updated weights for policy 0, policy_version 1230001 (0.0010) [2023-12-26 09:24:47,009][123091] Updated weights for policy 0, policy_version 1230011 (0.0005) [2023-12-26 09:24:47,059][123091] Updated weights for policy 0, policy_version 1230021 (0.0005) [2023-12-26 09:24:47,104][123091] Updated weights for policy 0, policy_version 1230031 (0.0006) [2023-12-26 09:24:47,118][123090] Updated weights for policy 1, policy_version 1221447 (0.0005) [2023-12-26 09:24:47,175][123090] Updated weights for policy 1, policy_version 1221457 (0.0005) [2023-12-26 09:24:47,246][123090] Updated weights for policy 1, policy_version 1221467 (0.0005) [2023-12-26 09:24:47,894][123090] Updated weights for policy 1, policy_version 1221477 (0.0009) [2023-12-26 09:24:47,912][123091] Updated weights for policy 0, policy_version 1230041 (0.0006) [2023-12-26 09:24:47,960][123090] Updated weights for policy 1, policy_version 1221487 (0.0009) [2023-12-26 09:24:47,977][123091] Updated weights for policy 0, policy_version 1230051 (0.0009) [2023-12-26 09:24:48,020][123090] Updated weights for policy 1, policy_version 1221497 (0.0008) [2023-12-26 09:24:48,040][123091] Updated weights for policy 0, policy_version 1230061 (0.0011) [2023-12-26 09:24:48,748][123090] Updated weights for policy 1, policy_version 1221507 (0.0007) [2023-12-26 09:24:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 627605504. Throughput: 0: 9140.6, 1: 9008.4. Samples: 627622404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:48,785][121949] Avg episode reward: [(0, '6189.326'), (1, '5267.996')] [2023-12-26 09:24:48,815][123090] Updated weights for policy 1, policy_version 1221517 (0.0005) [2023-12-26 09:24:48,839][123091] Updated weights for policy 0, policy_version 1230071 (0.0010) [2023-12-26 09:24:48,891][123090] Updated weights for policy 1, policy_version 1221527 (0.0005) [2023-12-26 09:24:48,897][123091] Updated weights for policy 0, policy_version 1230081 (0.0006) [2023-12-26 09:24:48,955][123091] Updated weights for policy 0, policy_version 1230091 (0.0005) [2023-12-26 09:24:49,578][123090] Updated weights for policy 1, policy_version 1221537 (0.0006) [2023-12-26 09:24:49,646][123090] Updated weights for policy 1, policy_version 1221547 (0.0011) [2023-12-26 09:24:49,718][123090] Updated weights for policy 1, policy_version 1221557 (0.0011) [2023-12-26 09:24:49,719][123091] Updated weights for policy 0, policy_version 1230101 (0.0009) [2023-12-26 09:24:49,788][123090] Updated weights for policy 1, policy_version 1221567 (0.0011) [2023-12-26 09:24:49,789][123091] Updated weights for policy 0, policy_version 1230111 (0.0010) [2023-12-26 09:24:49,863][123091] Updated weights for policy 0, policy_version 1230121 (0.0012) [2023-12-26 09:24:50,613][123090] Updated weights for policy 1, policy_version 1221577 (0.0008) [2023-12-26 09:24:50,647][123091] Updated weights for policy 0, policy_version 1230131 (0.0009) [2023-12-26 09:24:50,668][123090] Updated weights for policy 1, policy_version 1221587 (0.0005) [2023-12-26 09:24:50,709][123091] Updated weights for policy 0, policy_version 1230141 (0.0007) [2023-12-26 09:24:50,720][123090] Updated weights for policy 1, policy_version 1221597 (0.0010) [2023-12-26 09:24:50,768][123091] Updated weights for policy 0, policy_version 1230151 (0.0007) [2023-12-26 09:24:51,536][123090] Updated weights for policy 1, policy_version 1221607 (0.0010) [2023-12-26 09:24:51,593][123090] Updated weights for policy 1, policy_version 1221617 (0.0011) [2023-12-26 09:24:51,609][123091] Updated weights for policy 0, policy_version 1230161 (0.0008) [2023-12-26 09:24:51,657][123090] Updated weights for policy 1, policy_version 1221627 (0.0010) [2023-12-26 09:24:51,669][123091] Updated weights for policy 0, policy_version 1230171 (0.0006) [2023-12-26 09:24:51,732][123091] Updated weights for policy 0, policy_version 1230181 (0.0009) [2023-12-26 09:24:51,791][123091] Updated weights for policy 0, policy_version 1230191 (0.0009) [2023-12-26 09:24:52,474][123090] Updated weights for policy 1, policy_version 1221637 (0.0010) [2023-12-26 09:24:52,527][123090] Updated weights for policy 1, policy_version 1221647 (0.0009) [2023-12-26 09:24:52,585][123090] Updated weights for policy 1, policy_version 1221657 (0.0009) [2023-12-26 09:24:52,654][123091] Updated weights for policy 0, policy_version 1230201 (0.0008) [2023-12-26 09:24:52,734][123091] Updated weights for policy 0, policy_version 1230211 (0.0009) [2023-12-26 09:24:52,808][123091] Updated weights for policy 0, policy_version 1230221 (0.0010) [2023-12-26 09:24:53,226][123090] Updated weights for policy 1, policy_version 1221667 (0.0009) [2023-12-26 09:24:53,296][123090] Updated weights for policy 1, policy_version 1221677 (0.0010) [2023-12-26 09:24:53,359][123090] Updated weights for policy 1, policy_version 1221687 (0.0010) [2023-12-26 09:24:53,632][123091] Updated weights for policy 0, policy_version 1230231 (0.0008) [2023-12-26 09:24:53,696][123091] Updated weights for policy 0, policy_version 1230241 (0.0008) [2023-12-26 09:24:53,763][123091] Updated weights for policy 0, policy_version 1230251 (0.0009) [2023-12-26 09:24:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 627695616. Throughput: 0: 9058.8, 1: 8943.1. Samples: 627675540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:53,785][121949] Avg episode reward: [(0, '6219.658'), (1, '5200.000')] [2023-12-26 09:24:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001221696_312754176.pth... [2023-12-26 09:24:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001230256_314949632.pth... [2023-12-26 09:24:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001220640_312483840.pth [2023-12-26 09:24:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001229168_314671104.pth [2023-12-26 09:24:54,070][123090] Updated weights for policy 1, policy_version 1221697 (0.0010) [2023-12-26 09:24:54,119][123090] Updated weights for policy 1, policy_version 1221707 (0.0009) [2023-12-26 09:24:54,169][123090] Updated weights for policy 1, policy_version 1221717 (0.0009) [2023-12-26 09:24:54,220][123090] Updated weights for policy 1, policy_version 1221727 (0.0007) [2023-12-26 09:24:54,604][123091] Updated weights for policy 0, policy_version 1230261 (0.0009) [2023-12-26 09:24:54,668][123091] Updated weights for policy 0, policy_version 1230271 (0.0009) [2023-12-26 09:24:54,721][123091] Updated weights for policy 0, policy_version 1230281 (0.0009) [2023-12-26 09:24:55,015][123090] Updated weights for policy 1, policy_version 1221737 (0.0006) [2023-12-26 09:24:55,080][123090] Updated weights for policy 1, policy_version 1221747 (0.0008) [2023-12-26 09:24:55,140][123090] Updated weights for policy 1, policy_version 1221757 (0.0008) [2023-12-26 09:24:55,546][123091] Updated weights for policy 0, policy_version 1230291 (0.0007) [2023-12-26 09:24:55,593][123091] Updated weights for policy 0, policy_version 1230301 (0.0008) [2023-12-26 09:24:55,660][123091] Updated weights for policy 0, policy_version 1230311 (0.0009) [2023-12-26 09:24:55,835][123090] Updated weights for policy 1, policy_version 1221767 (0.0007) [2023-12-26 09:24:55,896][123090] Updated weights for policy 1, policy_version 1221777 (0.0009) [2023-12-26 09:24:55,959][123090] Updated weights for policy 1, policy_version 1221787 (0.0009) [2023-12-26 09:24:56,497][123091] Updated weights for policy 0, policy_version 1230321 (0.0009) [2023-12-26 09:24:56,545][123091] Updated weights for policy 0, policy_version 1230331 (0.0008) [2023-12-26 09:24:56,599][123091] Updated weights for policy 0, policy_version 1230342 (0.0010) [2023-12-26 09:24:56,740][123090] Updated weights for policy 1, policy_version 1221797 (0.0010) [2023-12-26 09:24:56,803][123090] Updated weights for policy 1, policy_version 1221807 (0.0009) [2023-12-26 09:24:56,867][123090] Updated weights for policy 1, policy_version 1221817 (0.0009) [2023-12-26 09:24:57,496][123091] Updated weights for policy 0, policy_version 1230353 (0.0010) [2023-12-26 09:24:57,546][123091] Updated weights for policy 0, policy_version 1230363 (0.0009) [2023-12-26 09:24:57,596][123091] Updated weights for policy 0, policy_version 1230373 (0.0009) [2023-12-26 09:24:57,636][123090] Updated weights for policy 1, policy_version 1221827 (0.0010) [2023-12-26 09:24:57,653][123091] Updated weights for policy 0, policy_version 1230383 (0.0008) [2023-12-26 09:24:57,701][123090] Updated weights for policy 1, policy_version 1221837 (0.0009) [2023-12-26 09:24:57,759][123090] Updated weights for policy 1, policy_version 1221847 (0.0010) [2023-12-26 09:24:58,452][123091] Updated weights for policy 0, policy_version 1230393 (0.0008) [2023-12-26 09:24:58,521][123091] Updated weights for policy 0, policy_version 1230403 (0.0010) [2023-12-26 09:24:58,587][123091] Updated weights for policy 0, policy_version 1230413 (0.0009) [2023-12-26 09:24:58,680][123090] Updated weights for policy 1, policy_version 1221857 (0.0010) [2023-12-26 09:24:58,751][123090] Updated weights for policy 1, policy_version 1221867 (0.0011) [2023-12-26 09:24:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 627785728. Throughput: 0: 8994.6, 1: 9040.6. Samples: 627781692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:24:58,785][121949] Avg episode reward: [(0, '6194.124'), (1, '5361.600')] [2023-12-26 09:24:58,827][123090] Updated weights for policy 1, policy_version 1221877 (0.0011) [2023-12-26 09:24:58,894][123090] Updated weights for policy 1, policy_version 1221887 (0.0011) [2023-12-26 09:24:59,502][123091] Updated weights for policy 0, policy_version 1230423 (0.0010) [2023-12-26 09:24:59,557][123091] Updated weights for policy 0, policy_version 1230434 (0.0010) [2023-12-26 09:24:59,615][123091] Updated weights for policy 0, policy_version 1230444 (0.0009) [2023-12-26 09:24:59,725][123090] Updated weights for policy 1, policy_version 1221897 (0.0009) [2023-12-26 09:24:59,787][123090] Updated weights for policy 1, policy_version 1221907 (0.0010) [2023-12-26 09:24:59,857][123090] Updated weights for policy 1, policy_version 1221917 (0.0009) [2023-12-26 09:25:00,436][123091] Updated weights for policy 0, policy_version 1230454 (0.0009) [2023-12-26 09:25:00,483][123091] Updated weights for policy 0, policy_version 1230464 (0.0009) [2023-12-26 09:25:00,538][123091] Updated weights for policy 0, policy_version 1230474 (0.0009) [2023-12-26 09:25:00,623][123090] Updated weights for policy 1, policy_version 1221927 (0.0006) [2023-12-26 09:25:00,674][123090] Updated weights for policy 1, policy_version 1221937 (0.0005) [2023-12-26 09:25:00,726][123090] Updated weights for policy 1, policy_version 1221947 (0.0005) [2023-12-26 09:25:01,456][123091] Updated weights for policy 0, policy_version 1230484 (0.0008) [2023-12-26 09:25:01,462][123090] Updated weights for policy 1, policy_version 1221957 (0.0008) [2023-12-26 09:25:01,524][123091] Updated weights for policy 0, policy_version 1230494 (0.0007) [2023-12-26 09:25:01,531][123090] Updated weights for policy 1, policy_version 1221967 (0.0009) [2023-12-26 09:25:01,586][123091] Updated weights for policy 0, policy_version 1230504 (0.0007) [2023-12-26 09:25:01,595][123090] Updated weights for policy 1, policy_version 1221977 (0.0010) [2023-12-26 09:25:02,306][123091] Updated weights for policy 0, policy_version 1230514 (0.0007) [2023-12-26 09:25:02,366][123091] Updated weights for policy 0, policy_version 1230524 (0.0007) [2023-12-26 09:25:02,402][123090] Updated weights for policy 1, policy_version 1221987 (0.0009) [2023-12-26 09:25:02,431][123091] Updated weights for policy 0, policy_version 1230534 (0.0007) [2023-12-26 09:25:02,466][123090] Updated weights for policy 1, policy_version 1221997 (0.0009) [2023-12-26 09:25:02,480][123091] Updated weights for policy 0, policy_version 1230544 (0.0009) [2023-12-26 09:25:02,521][123090] Updated weights for policy 1, policy_version 1222007 (0.0009) [2023-12-26 09:25:03,222][123091] Updated weights for policy 0, policy_version 1230554 (0.0009) [2023-12-26 09:25:03,272][123091] Updated weights for policy 0, policy_version 1230564 (0.0009) [2023-12-26 09:25:03,289][123090] Updated weights for policy 1, policy_version 1222017 (0.0009) [2023-12-26 09:25:03,322][123091] Updated weights for policy 0, policy_version 1230574 (0.0007) [2023-12-26 09:25:03,352][123090] Updated weights for policy 1, policy_version 1222027 (0.0010) [2023-12-26 09:25:03,405][123090] Updated weights for policy 1, policy_version 1222037 (0.0006) [2023-12-26 09:25:03,462][123090] Updated weights for policy 1, policy_version 1222047 (0.0005) [2023-12-26 09:25:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 627875840. Throughput: 0: 8941.5, 1: 8947.1. Samples: 627886148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:25:03,785][121949] Avg episode reward: [(0, '6211.040'), (1, '5545.732')] [2023-12-26 09:25:04,089][123091] Updated weights for policy 0, policy_version 1230584 (0.0007) [2023-12-26 09:25:04,152][123091] Updated weights for policy 0, policy_version 1230594 (0.0006) [2023-12-26 09:25:04,171][123090] Updated weights for policy 1, policy_version 1222057 (0.0009) [2023-12-26 09:25:04,213][123091] Updated weights for policy 0, policy_version 1230604 (0.0008) [2023-12-26 09:25:04,233][123090] Updated weights for policy 1, policy_version 1222067 (0.0009) [2023-12-26 09:25:04,287][123090] Updated weights for policy 1, policy_version 1222077 (0.0009) [2023-12-26 09:25:05,030][123090] Updated weights for policy 1, policy_version 1222087 (0.0007) [2023-12-26 09:25:05,064][123091] Updated weights for policy 0, policy_version 1230614 (0.0009) [2023-12-26 09:25:05,080][123090] Updated weights for policy 1, policy_version 1222097 (0.0005) [2023-12-26 09:25:05,114][123091] Updated weights for policy 0, policy_version 1230624 (0.0006) [2023-12-26 09:25:05,138][123090] Updated weights for policy 1, policy_version 1222107 (0.0005) [2023-12-26 09:25:05,170][123091] Updated weights for policy 0, policy_version 1230634 (0.0005) [2023-12-26 09:25:05,920][123090] Updated weights for policy 1, policy_version 1222117 (0.0008) [2023-12-26 09:25:05,955][123091] Updated weights for policy 0, policy_version 1230644 (0.0007) [2023-12-26 09:25:05,976][123090] Updated weights for policy 1, policy_version 1222127 (0.0010) [2023-12-26 09:25:06,004][123091] Updated weights for policy 0, policy_version 1230654 (0.0007) [2023-12-26 09:25:06,035][123090] Updated weights for policy 1, policy_version 1222137 (0.0010) [2023-12-26 09:25:06,059][123091] Updated weights for policy 0, policy_version 1230664 (0.0008) [2023-12-26 09:25:06,869][123090] Updated weights for policy 1, policy_version 1222147 (0.0010) [2023-12-26 09:25:06,921][123090] Updated weights for policy 1, policy_version 1222157 (0.0010) [2023-12-26 09:25:06,922][123091] Updated weights for policy 0, policy_version 1230674 (0.0009) [2023-12-26 09:25:06,976][123091] Updated weights for policy 0, policy_version 1230684 (0.0007) [2023-12-26 09:25:06,978][123090] Updated weights for policy 1, policy_version 1222167 (0.0011) [2023-12-26 09:25:07,032][123091] Updated weights for policy 0, policy_version 1230694 (0.0006) [2023-12-26 09:25:07,089][123091] Updated weights for policy 0, policy_version 1230704 (0.0009) [2023-12-26 09:25:07,809][123090] Updated weights for policy 1, policy_version 1222177 (0.0010) [2023-12-26 09:25:07,883][123090] Updated weights for policy 1, policy_version 1222187 (0.0011) [2023-12-26 09:25:07,943][123090] Updated weights for policy 1, policy_version 1222197 (0.0011) [2023-12-26 09:25:07,943][123091] Updated weights for policy 0, policy_version 1230714 (0.0008) [2023-12-26 09:25:07,997][123091] Updated weights for policy 0, policy_version 1230724 (0.0009) [2023-12-26 09:25:08,003][123090] Updated weights for policy 1, policy_version 1222207 (0.0011) [2023-12-26 09:25:08,058][123091] Updated weights for policy 0, policy_version 1230734 (0.0008) [2023-12-26 09:25:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 627957760. Throughput: 0: 8935.2, 1: 9005.7. Samples: 627940508. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:08,785][121949] Avg episode reward: [(0, '6178.159'), (1, '5365.760')] [2023-12-26 09:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001230736_315072512.pth... [2023-12-26 09:25:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001229744_314818560.pth [2023-12-26 09:25:08,844][123090] Updated weights for policy 1, policy_version 1222217 (0.0010) [2023-12-26 09:25:08,896][123090] Updated weights for policy 1, policy_version 1222227 (0.0010) [2023-12-26 09:25:08,907][123091] Updated weights for policy 0, policy_version 1230744 (0.0008) [2023-12-26 09:25:08,950][123090] Updated weights for policy 1, policy_version 1222237 (0.0008) [2023-12-26 09:25:08,967][123091] Updated weights for policy 0, policy_version 1230754 (0.0011) [2023-12-26 09:25:08,968][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001222240_312893440.pth... [2023-12-26 09:25:08,972][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001221184_312623104.pth [2023-12-26 09:25:09,027][123091] Updated weights for policy 0, policy_version 1230764 (0.0011) [2023-12-26 09:25:09,789][123090] Updated weights for policy 1, policy_version 1222247 (0.0009) [2023-12-26 09:25:09,850][123090] Updated weights for policy 1, policy_version 1222257 (0.0009) [2023-12-26 09:25:09,910][123090] Updated weights for policy 1, policy_version 1222267 (0.0006) [2023-12-26 09:25:09,915][123091] Updated weights for policy 0, policy_version 1230774 (0.0010) [2023-12-26 09:25:09,995][123091] Updated weights for policy 0, policy_version 1230784 (0.0011) [2023-12-26 09:25:10,066][123091] Updated weights for policy 0, policy_version 1230794 (0.0011) [2023-12-26 09:25:10,599][123090] Updated weights for policy 1, policy_version 1222277 (0.0007) [2023-12-26 09:25:10,665][123090] Updated weights for policy 1, policy_version 1222287 (0.0009) [2023-12-26 09:25:10,723][123090] Updated weights for policy 1, policy_version 1222297 (0.0006) [2023-12-26 09:25:10,776][123091] Updated weights for policy 0, policy_version 1230804 (0.0009) [2023-12-26 09:25:10,846][123091] Updated weights for policy 0, policy_version 1230814 (0.0008) [2023-12-26 09:25:10,911][123091] Updated weights for policy 0, policy_version 1230824 (0.0009) [2023-12-26 09:25:11,554][123090] Updated weights for policy 1, policy_version 1222307 (0.0007) [2023-12-26 09:25:11,609][123090] Updated weights for policy 1, policy_version 1222317 (0.0009) [2023-12-26 09:25:11,672][123090] Updated weights for policy 1, policy_version 1222327 (0.0009) [2023-12-26 09:25:11,704][123091] Updated weights for policy 0, policy_version 1230834 (0.0008) [2023-12-26 09:25:11,776][123091] Updated weights for policy 0, policy_version 1230844 (0.0009) [2023-12-26 09:25:11,840][123091] Updated weights for policy 0, policy_version 1230854 (0.0010) [2023-12-26 09:25:11,902][123091] Updated weights for policy 0, policy_version 1230864 (0.0009) [2023-12-26 09:25:12,469][123090] Updated weights for policy 1, policy_version 1222337 (0.0009) [2023-12-26 09:25:12,532][123090] Updated weights for policy 1, policy_version 1222347 (0.0010) [2023-12-26 09:25:12,586][123090] Updated weights for policy 1, policy_version 1222357 (0.0008) [2023-12-26 09:25:12,654][123090] Updated weights for policy 1, policy_version 1222367 (0.0006) [2023-12-26 09:25:12,741][123091] Updated weights for policy 0, policy_version 1230874 (0.0008) [2023-12-26 09:25:12,802][123091] Updated weights for policy 0, policy_version 1230884 (0.0009) [2023-12-26 09:25:12,855][123091] Updated weights for policy 0, policy_version 1230894 (0.0010) [2023-12-26 09:25:13,444][123090] Updated weights for policy 1, policy_version 1222377 (0.0010) [2023-12-26 09:25:13,500][123090] Updated weights for policy 1, policy_version 1222388 (0.0010) [2023-12-26 09:25:13,560][123090] Updated weights for policy 1, policy_version 1222398 (0.0010) [2023-12-26 09:25:13,579][123091] Updated weights for policy 0, policy_version 1230904 (0.0008) [2023-12-26 09:25:13,631][123091] Updated weights for policy 0, policy_version 1230914 (0.0008) [2023-12-26 09:25:13,686][123091] Updated weights for policy 0, policy_version 1230924 (0.0009) [2023-12-26 09:25:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 628056064. Throughput: 0: 8819.4, 1: 8978.8. Samples: 628044176. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:13,785][121949] Avg episode reward: [(0, '6257.005'), (1, '5158.850')] [2023-12-26 09:25:14,418][123090] Updated weights for policy 1, policy_version 1222408 (0.0010) [2023-12-26 09:25:14,473][123090] Updated weights for policy 1, policy_version 1222418 (0.0010) [2023-12-26 09:25:14,525][123090] Updated weights for policy 1, policy_version 1222428 (0.0010) [2023-12-26 09:25:14,540][123091] Updated weights for policy 0, policy_version 1230934 (0.0007) [2023-12-26 09:25:14,591][123091] Updated weights for policy 0, policy_version 1230944 (0.0009) [2023-12-26 09:25:14,651][123091] Updated weights for policy 0, policy_version 1230954 (0.0009) [2023-12-26 09:25:15,385][123090] Updated weights for policy 1, policy_version 1222438 (0.0011) [2023-12-26 09:25:15,456][123090] Updated weights for policy 1, policy_version 1222448 (0.0011) [2023-12-26 09:25:15,505][123091] Updated weights for policy 0, policy_version 1230964 (0.0009) [2023-12-26 09:25:15,528][123090] Updated weights for policy 1, policy_version 1222458 (0.0011) [2023-12-26 09:25:15,565][123091] Updated weights for policy 0, policy_version 1230974 (0.0006) [2023-12-26 09:25:15,630][123091] Updated weights for policy 0, policy_version 1230984 (0.0009) [2023-12-26 09:25:16,350][123090] Updated weights for policy 1, policy_version 1222468 (0.0010) [2023-12-26 09:25:16,412][123090] Updated weights for policy 1, policy_version 1222478 (0.0008) [2023-12-26 09:25:16,456][123091] Updated weights for policy 0, policy_version 1230994 (0.0009) [2023-12-26 09:25:16,487][123090] Updated weights for policy 1, policy_version 1222488 (0.0005) [2023-12-26 09:25:16,514][123091] Updated weights for policy 0, policy_version 1231004 (0.0010) [2023-12-26 09:25:16,571][123091] Updated weights for policy 0, policy_version 1231014 (0.0009) [2023-12-26 09:25:16,632][123091] Updated weights for policy 0, policy_version 1231024 (0.0010) [2023-12-26 09:25:17,167][123090] Updated weights for policy 1, policy_version 1222498 (0.0005) [2023-12-26 09:25:17,219][123090] Updated weights for policy 1, policy_version 1222508 (0.0006) [2023-12-26 09:25:17,269][123090] Updated weights for policy 1, policy_version 1222518 (0.0005) [2023-12-26 09:25:17,335][123090] Updated weights for policy 1, policy_version 1222528 (0.0006) [2023-12-26 09:25:17,522][123091] Updated weights for policy 0, policy_version 1231034 (0.0010) [2023-12-26 09:25:17,586][123091] Updated weights for policy 0, policy_version 1231044 (0.0010) [2023-12-26 09:25:17,644][123091] Updated weights for policy 0, policy_version 1231054 (0.0009) [2023-12-26 09:25:17,989][123090] Updated weights for policy 1, policy_version 1222538 (0.0005) [2023-12-26 09:25:18,059][123090] Updated weights for policy 1, policy_version 1222548 (0.0009) [2023-12-26 09:25:18,123][123090] Updated weights for policy 1, policy_version 1222558 (0.0008) [2023-12-26 09:25:18,501][123091] Updated weights for policy 0, policy_version 1231064 (0.0009) [2023-12-26 09:25:18,560][123091] Updated weights for policy 0, policy_version 1231074 (0.0009) [2023-12-26 09:25:18,626][123091] Updated weights for policy 0, policy_version 1231085 (0.0011) [2023-12-26 09:25:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 628137984. Throughput: 0: 8786.5, 1: 8992.0. Samples: 628148732. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:18,784][121949] Avg episode reward: [(0, '6239.091'), (1, '5380.518')] [2023-12-26 09:25:18,885][123090] Updated weights for policy 1, policy_version 1222568 (0.0007) [2023-12-26 09:25:18,950][123090] Updated weights for policy 1, policy_version 1222578 (0.0005) [2023-12-26 09:25:19,012][123090] Updated weights for policy 1, policy_version 1222588 (0.0006) [2023-12-26 09:25:19,573][123091] Updated weights for policy 0, policy_version 1231095 (0.0010) [2023-12-26 09:25:19,643][123091] Updated weights for policy 0, policy_version 1231105 (0.0009) [2023-12-26 09:25:19,674][123090] Updated weights for policy 1, policy_version 1222598 (0.0008) [2023-12-26 09:25:19,707][123091] Updated weights for policy 0, policy_version 1231115 (0.0008) [2023-12-26 09:25:19,736][123090] Updated weights for policy 1, policy_version 1222608 (0.0008) [2023-12-26 09:25:19,812][123090] Updated weights for policy 1, policy_version 1222618 (0.0009) [2023-12-26 09:25:20,468][123091] Updated weights for policy 0, policy_version 1231125 (0.0006) [2023-12-26 09:25:20,534][123091] Updated weights for policy 0, policy_version 1231135 (0.0007) [2023-12-26 09:25:20,606][123091] Updated weights for policy 0, policy_version 1231145 (0.0009) [2023-12-26 09:25:20,652][123090] Updated weights for policy 1, policy_version 1222628 (0.0009) [2023-12-26 09:25:20,720][123090] Updated weights for policy 1, policy_version 1222638 (0.0010) [2023-12-26 09:25:20,787][123090] Updated weights for policy 1, policy_version 1222648 (0.0010) [2023-12-26 09:25:21,403][123091] Updated weights for policy 0, policy_version 1231155 (0.0008) [2023-12-26 09:25:21,482][123091] Updated weights for policy 0, policy_version 1231165 (0.0009) [2023-12-26 09:25:21,552][123091] Updated weights for policy 0, policy_version 1231175 (0.0010) [2023-12-26 09:25:21,617][123090] Updated weights for policy 1, policy_version 1222658 (0.0009) [2023-12-26 09:25:21,684][123090] Updated weights for policy 1, policy_version 1222668 (0.0007) [2023-12-26 09:25:21,757][123090] Updated weights for policy 1, policy_version 1222678 (0.0008) [2023-12-26 09:25:21,829][123090] Updated weights for policy 1, policy_version 1222688 (0.0007) [2023-12-26 09:25:22,426][123091] Updated weights for policy 0, policy_version 1231185 (0.0009) [2023-12-26 09:25:22,497][123091] Updated weights for policy 0, policy_version 1231195 (0.0007) [2023-12-26 09:25:22,555][123091] Updated weights for policy 0, policy_version 1231205 (0.0010) [2023-12-26 09:25:22,610][123091] Updated weights for policy 0, policy_version 1231215 (0.0008) [2023-12-26 09:25:22,636][123090] Updated weights for policy 1, policy_version 1222698 (0.0008) [2023-12-26 09:25:22,698][123090] Updated weights for policy 1, policy_version 1222708 (0.0008) [2023-12-26 09:25:22,762][123090] Updated weights for policy 1, policy_version 1222718 (0.0010) [2023-12-26 09:25:23,358][123091] Updated weights for policy 0, policy_version 1231225 (0.0005) [2023-12-26 09:25:23,410][123091] Updated weights for policy 0, policy_version 1231235 (0.0005) [2023-12-26 09:25:23,475][123091] Updated weights for policy 0, policy_version 1231245 (0.0005) [2023-12-26 09:25:23,601][123090] Updated weights for policy 1, policy_version 1222728 (0.0006) [2023-12-26 09:25:23,666][123090] Updated weights for policy 1, policy_version 1222738 (0.0008) [2023-12-26 09:25:23,730][123090] Updated weights for policy 1, policy_version 1222748 (0.0009) [2023-12-26 09:25:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 628228096. Throughput: 0: 8711.9, 1: 8933.1. Samples: 628200296. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:23,785][121949] Avg episode reward: [(0, '6164.167'), (1, '5438.604')] [2023-12-26 09:25:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001231248_315203584.pth... [2023-12-26 09:25:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001222752_313024512.pth... [2023-12-26 09:25:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001221696_312754176.pth [2023-12-26 09:25:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001230256_314949632.pth [2023-12-26 09:25:24,273][123091] Updated weights for policy 0, policy_version 1231255 (0.0007) [2023-12-26 09:25:24,340][123091] Updated weights for policy 0, policy_version 1231265 (0.0006) [2023-12-26 09:25:24,404][123091] Updated weights for policy 0, policy_version 1231275 (0.0006) [2023-12-26 09:25:24,537][123090] Updated weights for policy 1, policy_version 1222758 (0.0009) [2023-12-26 09:25:24,630][123090] Updated weights for policy 1, policy_version 1222768 (0.0009) [2023-12-26 09:25:24,681][123090] Updated weights for policy 1, policy_version 1222778 (0.0005) [2023-12-26 09:25:25,041][123091] Updated weights for policy 0, policy_version 1231285 (0.0005) [2023-12-26 09:25:25,097][123091] Updated weights for policy 0, policy_version 1231295 (0.0005) [2023-12-26 09:25:25,144][123091] Updated weights for policy 0, policy_version 1231305 (0.0005) [2023-12-26 09:25:25,400][123090] Updated weights for policy 1, policy_version 1222788 (0.0007) [2023-12-26 09:25:25,446][123090] Updated weights for policy 1, policy_version 1222798 (0.0010) [2023-12-26 09:25:25,498][123090] Updated weights for policy 1, policy_version 1222808 (0.0009) [2023-12-26 09:25:25,917][123091] Updated weights for policy 0, policy_version 1231315 (0.0005) [2023-12-26 09:25:25,963][123091] Updated weights for policy 0, policy_version 1231325 (0.0005) [2023-12-26 09:25:26,020][123091] Updated weights for policy 0, policy_version 1231335 (0.0005) [2023-12-26 09:25:26,350][123090] Updated weights for policy 1, policy_version 1222818 (0.0008) [2023-12-26 09:25:26,415][123090] Updated weights for policy 1, policy_version 1222828 (0.0009) [2023-12-26 09:25:26,480][123090] Updated weights for policy 1, policy_version 1222838 (0.0009) [2023-12-26 09:25:26,538][123090] Updated weights for policy 1, policy_version 1222848 (0.0009) [2023-12-26 09:25:26,801][123091] Updated weights for policy 0, policy_version 1231345 (0.0006) [2023-12-26 09:25:26,860][123091] Updated weights for policy 0, policy_version 1231355 (0.0009) [2023-12-26 09:25:26,914][123091] Updated weights for policy 0, policy_version 1231365 (0.0010) [2023-12-26 09:25:26,968][123091] Updated weights for policy 0, policy_version 1231376 (0.0007) [2023-12-26 09:25:27,264][123090] Updated weights for policy 1, policy_version 1222858 (0.0009) [2023-12-26 09:25:27,314][123090] Updated weights for policy 1, policy_version 1222868 (0.0009) [2023-12-26 09:25:27,368][123090] Updated weights for policy 1, policy_version 1222878 (0.0005) [2023-12-26 09:25:27,795][123091] Updated weights for policy 0, policy_version 1231386 (0.0005) [2023-12-26 09:25:27,863][123091] Updated weights for policy 0, policy_version 1231396 (0.0005) [2023-12-26 09:25:27,930][123091] Updated weights for policy 0, policy_version 1231406 (0.0006) [2023-12-26 09:25:28,032][123090] Updated weights for policy 1, policy_version 1222888 (0.0005) [2023-12-26 09:25:28,098][123090] Updated weights for policy 1, policy_version 1222898 (0.0005) [2023-12-26 09:25:28,153][123090] Updated weights for policy 1, policy_version 1222908 (0.0005) [2023-12-26 09:25:28,569][123091] Updated weights for policy 0, policy_version 1231416 (0.0010) [2023-12-26 09:25:28,628][123091] Updated weights for policy 0, policy_version 1231426 (0.0010) [2023-12-26 09:25:28,696][123091] Updated weights for policy 0, policy_version 1231436 (0.0011) [2023-12-26 09:25:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 628318208. Throughput: 0: 8721.1, 1: 9009.8. Samples: 628308244. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:28,785][121949] Avg episode reward: [(0, '6193.534'), (1, '5292.279')] [2023-12-26 09:25:28,863][123090] Updated weights for policy 1, policy_version 1222918 (0.0007) [2023-12-26 09:25:28,920][123090] Updated weights for policy 1, policy_version 1222928 (0.0009) [2023-12-26 09:25:28,981][123090] Updated weights for policy 1, policy_version 1222938 (0.0009) [2023-12-26 09:25:29,478][123091] Updated weights for policy 0, policy_version 1231446 (0.0008) [2023-12-26 09:25:29,536][123091] Updated weights for policy 0, policy_version 1231456 (0.0008) [2023-12-26 09:25:29,591][123091] Updated weights for policy 0, policy_version 1231466 (0.0010) [2023-12-26 09:25:29,786][123090] Updated weights for policy 1, policy_version 1222948 (0.0009) [2023-12-26 09:25:29,855][123090] Updated weights for policy 1, policy_version 1222958 (0.0009) [2023-12-26 09:25:29,913][123090] Updated weights for policy 1, policy_version 1222968 (0.0010) [2023-12-26 09:25:30,333][123091] Updated weights for policy 0, policy_version 1231476 (0.0009) [2023-12-26 09:25:30,385][123091] Updated weights for policy 0, policy_version 1231486 (0.0005) [2023-12-26 09:25:30,442][123091] Updated weights for policy 0, policy_version 1231496 (0.0005) [2023-12-26 09:25:30,838][123090] Updated weights for policy 1, policy_version 1222978 (0.0009) [2023-12-26 09:25:30,891][123090] Updated weights for policy 1, policy_version 1222988 (0.0010) [2023-12-26 09:25:30,943][123090] Updated weights for policy 1, policy_version 1222998 (0.0009) [2023-12-26 09:25:30,997][123090] Updated weights for policy 1, policy_version 1223008 (0.0009) [2023-12-26 09:25:31,103][123091] Updated weights for policy 0, policy_version 1231506 (0.0006) [2023-12-26 09:25:31,167][123091] Updated weights for policy 0, policy_version 1231516 (0.0010) [2023-12-26 09:25:31,219][123091] Updated weights for policy 0, policy_version 1231526 (0.0010) [2023-12-26 09:25:31,279][123091] Updated weights for policy 0, policy_version 1231536 (0.0011) [2023-12-26 09:25:31,862][123090] Updated weights for policy 1, policy_version 1223018 (0.0005) [2023-12-26 09:25:31,928][123090] Updated weights for policy 1, policy_version 1223028 (0.0008) [2023-12-26 09:25:31,992][123090] Updated weights for policy 1, policy_version 1223038 (0.0009) [2023-12-26 09:25:32,085][123091] Updated weights for policy 0, policy_version 1231546 (0.0009) [2023-12-26 09:25:32,141][123091] Updated weights for policy 0, policy_version 1231556 (0.0009) [2023-12-26 09:25:32,194][123091] Updated weights for policy 0, policy_version 1231566 (0.0009) [2023-12-26 09:25:32,779][123090] Updated weights for policy 1, policy_version 1223048 (0.0008) [2023-12-26 09:25:32,861][123090] Updated weights for policy 1, policy_version 1223058 (0.0006) [2023-12-26 09:25:32,921][123090] Updated weights for policy 1, policy_version 1223068 (0.0009) [2023-12-26 09:25:33,055][123091] Updated weights for policy 0, policy_version 1231576 (0.0009) [2023-12-26 09:25:33,109][123091] Updated weights for policy 0, policy_version 1231586 (0.0009) [2023-12-26 09:25:33,172][123091] Updated weights for policy 0, policy_version 1231596 (0.0009) [2023-12-26 09:25:33,740][123090] Updated weights for policy 1, policy_version 1223078 (0.0010) [2023-12-26 09:25:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 628400128. Throughput: 0: 8712.0, 1: 8945.0. Samples: 628416968. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:33,785][121949] Avg episode reward: [(0, '6278.529'), (1, '5443.484')] [2023-12-26 09:25:33,806][123090] Updated weights for policy 1, policy_version 1223088 (0.0009) [2023-12-26 09:25:33,870][123090] Updated weights for policy 1, policy_version 1223098 (0.0009) [2023-12-26 09:25:33,945][123091] Updated weights for policy 0, policy_version 1231606 (0.0010) [2023-12-26 09:25:34,001][123091] Updated weights for policy 0, policy_version 1231616 (0.0009) [2023-12-26 09:25:34,061][123091] Updated weights for policy 0, policy_version 1231626 (0.0009) [2023-12-26 09:25:34,736][123090] Updated weights for policy 1, policy_version 1223108 (0.0009) [2023-12-26 09:25:34,787][123090] Updated weights for policy 1, policy_version 1223118 (0.0009) [2023-12-26 09:25:34,845][123091] Updated weights for policy 0, policy_version 1231636 (0.0009) [2023-12-26 09:25:34,850][123090] Updated weights for policy 1, policy_version 1223128 (0.0009) [2023-12-26 09:25:34,908][123091] Updated weights for policy 0, policy_version 1231646 (0.0010) [2023-12-26 09:25:34,972][123091] Updated weights for policy 0, policy_version 1231656 (0.0010) [2023-12-26 09:25:35,667][123090] Updated weights for policy 1, policy_version 1223138 (0.0010) [2023-12-26 09:25:35,736][123090] Updated weights for policy 1, policy_version 1223148 (0.0010) [2023-12-26 09:25:35,790][123091] Updated weights for policy 0, policy_version 1231666 (0.0010) [2023-12-26 09:25:35,797][123090] Updated weights for policy 1, policy_version 1223158 (0.0008) [2023-12-26 09:25:35,838][123091] Updated weights for policy 0, policy_version 1231676 (0.0010) [2023-12-26 09:25:35,849][123090] Updated weights for policy 1, policy_version 1223168 (0.0006) [2023-12-26 09:25:35,893][123091] Updated weights for policy 0, policy_version 1231686 (0.0010) [2023-12-26 09:25:35,944][123091] Updated weights for policy 0, policy_version 1231696 (0.0010) [2023-12-26 09:25:36,703][123090] Updated weights for policy 1, policy_version 1223178 (0.0010) [2023-12-26 09:25:36,770][123090] Updated weights for policy 1, policy_version 1223188 (0.0010) [2023-12-26 09:25:36,772][123091] Updated weights for policy 0, policy_version 1231706 (0.0008) [2023-12-26 09:25:36,826][123090] Updated weights for policy 1, policy_version 1223198 (0.0009) [2023-12-26 09:25:36,827][123091] Updated weights for policy 0, policy_version 1231716 (0.0006) [2023-12-26 09:25:36,896][123091] Updated weights for policy 0, policy_version 1231726 (0.0009) [2023-12-26 09:25:37,653][123090] Updated weights for policy 1, policy_version 1223208 (0.0007) [2023-12-26 09:25:37,675][123091] Updated weights for policy 0, policy_version 1231736 (0.0010) [2023-12-26 09:25:37,714][123090] Updated weights for policy 1, policy_version 1223218 (0.0008) [2023-12-26 09:25:37,735][123091] Updated weights for policy 0, policy_version 1231746 (0.0008) [2023-12-26 09:25:37,777][123090] Updated weights for policy 1, policy_version 1223228 (0.0010) [2023-12-26 09:25:37,787][123091] Updated weights for policy 0, policy_version 1231756 (0.0008) [2023-12-26 09:25:38,542][123090] Updated weights for policy 1, policy_version 1223238 (0.0007) [2023-12-26 09:25:38,592][123091] Updated weights for policy 0, policy_version 1231766 (0.0006) [2023-12-26 09:25:38,604][123090] Updated weights for policy 1, policy_version 1223248 (0.0009) [2023-12-26 09:25:38,654][123091] Updated weights for policy 0, policy_version 1231776 (0.0005) [2023-12-26 09:25:38,672][123090] Updated weights for policy 1, policy_version 1223258 (0.0008) [2023-12-26 09:25:38,719][123091] Updated weights for policy 0, policy_version 1231786 (0.0010) [2023-12-26 09:25:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 628498432. Throughput: 0: 8724.8, 1: 8901.3. Samples: 628468716. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:38,785][121949] Avg episode reward: [(0, '6276.756'), (1, '5180.452')] [2023-12-26 09:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001231792_315342848.pth... [2023-12-26 09:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001223264_313155584.pth... [2023-12-26 09:25:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001230736_315072512.pth [2023-12-26 09:25:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001222240_312893440.pth [2023-12-26 09:25:39,400][123090] Updated weights for policy 1, policy_version 1223268 (0.0007) [2023-12-26 09:25:39,456][123090] Updated weights for policy 1, policy_version 1223278 (0.0009) [2023-12-26 09:25:39,508][123090] Updated weights for policy 1, policy_version 1223288 (0.0008) [2023-12-26 09:25:39,515][123091] Updated weights for policy 0, policy_version 1231796 (0.0009) [2023-12-26 09:25:39,582][123091] Updated weights for policy 0, policy_version 1231806 (0.0007) [2023-12-26 09:25:39,645][123091] Updated weights for policy 0, policy_version 1231816 (0.0010) [2023-12-26 09:25:40,365][123090] Updated weights for policy 1, policy_version 1223298 (0.0008) [2023-12-26 09:25:40,425][123090] Updated weights for policy 1, policy_version 1223308 (0.0009) [2023-12-26 09:25:40,496][123090] Updated weights for policy 1, policy_version 1223318 (0.0009) [2023-12-26 09:25:40,507][123091] Updated weights for policy 0, policy_version 1231826 (0.0010) [2023-12-26 09:25:40,560][123091] Updated weights for policy 0, policy_version 1231836 (0.0006) [2023-12-26 09:25:40,562][123090] Updated weights for policy 1, policy_version 1223328 (0.0009) [2023-12-26 09:25:40,620][123091] Updated weights for policy 0, policy_version 1231846 (0.0009) [2023-12-26 09:25:40,668][123091] Updated weights for policy 0, policy_version 1231856 (0.0009) [2023-12-26 09:25:41,397][123090] Updated weights for policy 1, policy_version 1223338 (0.0009) [2023-12-26 09:25:41,460][123090] Updated weights for policy 1, policy_version 1223348 (0.0008) [2023-12-26 09:25:41,492][123091] Updated weights for policy 0, policy_version 1231866 (0.0006) [2023-12-26 09:25:41,521][123090] Updated weights for policy 1, policy_version 1223358 (0.0008) [2023-12-26 09:25:41,555][123091] Updated weights for policy 0, policy_version 1231876 (0.0009) [2023-12-26 09:25:41,625][123091] Updated weights for policy 0, policy_version 1231886 (0.0010) [2023-12-26 09:25:42,372][123090] Updated weights for policy 1, policy_version 1223368 (0.0009) [2023-12-26 09:25:42,428][123090] Updated weights for policy 1, policy_version 1223378 (0.0010) [2023-12-26 09:25:42,447][123091] Updated weights for policy 0, policy_version 1231896 (0.0009) [2023-12-26 09:25:42,485][123090] Updated weights for policy 1, policy_version 1223388 (0.0009) [2023-12-26 09:25:42,511][123091] Updated weights for policy 0, policy_version 1231906 (0.0009) [2023-12-26 09:25:42,578][123091] Updated weights for policy 0, policy_version 1231916 (0.0011) [2023-12-26 09:25:43,340][123090] Updated weights for policy 1, policy_version 1223398 (0.0008) [2023-12-26 09:25:43,347][123091] Updated weights for policy 0, policy_version 1231926 (0.0009) [2023-12-26 09:25:43,402][123090] Updated weights for policy 1, policy_version 1223408 (0.0008) [2023-12-26 09:25:43,404][123091] Updated weights for policy 0, policy_version 1231936 (0.0007) [2023-12-26 09:25:43,464][123091] Updated weights for policy 0, policy_version 1231946 (0.0007) [2023-12-26 09:25:43,466][123090] Updated weights for policy 1, policy_version 1223418 (0.0010) [2023-12-26 09:25:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 628580352. Throughput: 0: 8757.8, 1: 8781.5. Samples: 628570956. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:43,784][121949] Avg episode reward: [(0, '6120.728'), (1, '4901.078')] [2023-12-26 09:25:44,255][123091] Updated weights for policy 0, policy_version 1231956 (0.0007) [2023-12-26 09:25:44,298][123090] Updated weights for policy 1, policy_version 1223428 (0.0008) [2023-12-26 09:25:44,322][123091] Updated weights for policy 0, policy_version 1231966 (0.0010) [2023-12-26 09:25:44,351][123090] Updated weights for policy 1, policy_version 1223438 (0.0007) [2023-12-26 09:25:44,383][123091] Updated weights for policy 0, policy_version 1231976 (0.0008) [2023-12-26 09:25:44,408][123090] Updated weights for policy 1, policy_version 1223448 (0.0009) [2023-12-26 09:25:45,153][123091] Updated weights for policy 0, policy_version 1231986 (0.0007) [2023-12-26 09:25:45,218][123091] Updated weights for policy 0, policy_version 1231996 (0.0009) [2023-12-26 09:25:45,252][123090] Updated weights for policy 1, policy_version 1223458 (0.0009) [2023-12-26 09:25:45,282][123091] Updated weights for policy 0, policy_version 1232006 (0.0010) [2023-12-26 09:25:45,311][123090] Updated weights for policy 1, policy_version 1223468 (0.0009) [2023-12-26 09:25:45,340][123091] Updated weights for policy 0, policy_version 1232016 (0.0007) [2023-12-26 09:25:45,379][123090] Updated weights for policy 1, policy_version 1223478 (0.0010) [2023-12-26 09:25:45,446][123090] Updated weights for policy 1, policy_version 1223488 (0.0010) [2023-12-26 09:25:46,156][123091] Updated weights for policy 0, policy_version 1232026 (0.0008) [2023-12-26 09:25:46,225][123091] Updated weights for policy 0, policy_version 1232036 (0.0007) [2023-12-26 09:25:46,238][123090] Updated weights for policy 1, policy_version 1223498 (0.0006) [2023-12-26 09:25:46,289][123090] Updated weights for policy 1, policy_version 1223508 (0.0005) [2023-12-26 09:25:46,290][123091] Updated weights for policy 0, policy_version 1232046 (0.0008) [2023-12-26 09:25:46,337][123090] Updated weights for policy 1, policy_version 1223518 (0.0005) [2023-12-26 09:25:47,015][123091] Updated weights for policy 0, policy_version 1232056 (0.0009) [2023-12-26 09:25:47,020][123090] Updated weights for policy 1, policy_version 1223528 (0.0006) [2023-12-26 09:25:47,071][123090] Updated weights for policy 1, policy_version 1223538 (0.0010) [2023-12-26 09:25:47,074][123091] Updated weights for policy 0, policy_version 1232066 (0.0006) [2023-12-26 09:25:47,127][123090] Updated weights for policy 1, policy_version 1223548 (0.0010) [2023-12-26 09:25:47,133][123091] Updated weights for policy 0, policy_version 1232076 (0.0005) [2023-12-26 09:25:47,829][123091] Updated weights for policy 0, policy_version 1232086 (0.0008) [2023-12-26 09:25:47,871][123090] Updated weights for policy 1, policy_version 1223558 (0.0008) [2023-12-26 09:25:47,885][123091] Updated weights for policy 0, policy_version 1232096 (0.0009) [2023-12-26 09:25:47,930][123090] Updated weights for policy 1, policy_version 1223568 (0.0006) [2023-12-26 09:25:47,941][123091] Updated weights for policy 0, policy_version 1232106 (0.0008) [2023-12-26 09:25:47,991][123090] Updated weights for policy 1, policy_version 1223578 (0.0006) [2023-12-26 09:25:48,708][123090] Updated weights for policy 1, policy_version 1223588 (0.0006) [2023-12-26 09:25:48,745][123091] Updated weights for policy 0, policy_version 1232116 (0.0009) [2023-12-26 09:25:48,773][123090] Updated weights for policy 1, policy_version 1223598 (0.0007) [2023-12-26 09:25:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 628662272. Throughput: 0: 8810.3, 1: 8836.3. Samples: 628680240. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:48,784][121949] Avg episode reward: [(0, '6072.815'), (1, '5154.708')] [2023-12-26 09:25:48,806][123091] Updated weights for policy 0, policy_version 1232126 (0.0007) [2023-12-26 09:25:48,844][123090] Updated weights for policy 1, policy_version 1223608 (0.0008) [2023-12-26 09:25:48,870][123091] Updated weights for policy 0, policy_version 1232136 (0.0007) [2023-12-26 09:25:49,575][123090] Updated weights for policy 1, policy_version 1223618 (0.0008) [2023-12-26 09:25:49,587][123091] Updated weights for policy 0, policy_version 1232146 (0.0007) [2023-12-26 09:25:49,633][123090] Updated weights for policy 1, policy_version 1223628 (0.0005) [2023-12-26 09:25:49,654][123091] Updated weights for policy 0, policy_version 1232156 (0.0011) [2023-12-26 09:25:49,698][123090] Updated weights for policy 1, policy_version 1223638 (0.0007) [2023-12-26 09:25:49,712][123091] Updated weights for policy 0, policy_version 1232166 (0.0006) [2023-12-26 09:25:49,762][123090] Updated weights for policy 1, policy_version 1223648 (0.0009) [2023-12-26 09:25:49,774][123091] Updated weights for policy 0, policy_version 1232176 (0.0009) [2023-12-26 09:25:50,482][123091] Updated weights for policy 0, policy_version 1232186 (0.0010) [2023-12-26 09:25:50,512][123090] Updated weights for policy 1, policy_version 1223658 (0.0005) [2023-12-26 09:25:50,533][123091] Updated weights for policy 0, policy_version 1232196 (0.0010) [2023-12-26 09:25:50,570][123090] Updated weights for policy 1, policy_version 1223668 (0.0006) [2023-12-26 09:25:50,599][123091] Updated weights for policy 0, policy_version 1232206 (0.0009) [2023-12-26 09:25:50,634][123090] Updated weights for policy 1, policy_version 1223678 (0.0008) [2023-12-26 09:25:51,303][123090] Updated weights for policy 1, policy_version 1223688 (0.0006) [2023-12-26 09:25:51,379][123090] Updated weights for policy 1, policy_version 1223698 (0.0008) [2023-12-26 09:25:51,437][123090] Updated weights for policy 1, policy_version 1223708 (0.0006) [2023-12-26 09:25:51,460][123091] Updated weights for policy 0, policy_version 1232216 (0.0011) [2023-12-26 09:25:51,530][123091] Updated weights for policy 0, policy_version 1232226 (0.0011) [2023-12-26 09:25:51,592][123091] Updated weights for policy 0, policy_version 1232236 (0.0010) [2023-12-26 09:25:52,252][123090] Updated weights for policy 1, policy_version 1223718 (0.0007) [2023-12-26 09:25:52,317][123090] Updated weights for policy 1, policy_version 1223728 (0.0009) [2023-12-26 09:25:52,389][123090] Updated weights for policy 1, policy_version 1223738 (0.0008) [2023-12-26 09:25:52,411][123091] Updated weights for policy 0, policy_version 1232246 (0.0011) [2023-12-26 09:25:52,470][123091] Updated weights for policy 0, policy_version 1232256 (0.0011) [2023-12-26 09:25:52,537][123091] Updated weights for policy 0, policy_version 1232266 (0.0011) [2023-12-26 09:25:53,226][123090] Updated weights for policy 1, policy_version 1223748 (0.0007) [2023-12-26 09:25:53,278][123090] Updated weights for policy 1, policy_version 1223758 (0.0009) [2023-12-26 09:25:53,335][123090] Updated weights for policy 1, policy_version 1223768 (0.0009) [2023-12-26 09:25:53,354][123091] Updated weights for policy 0, policy_version 1232276 (0.0011) [2023-12-26 09:25:53,401][123091] Updated weights for policy 0, policy_version 1232286 (0.0010) [2023-12-26 09:25:53,445][123091] Updated weights for policy 0, policy_version 1232296 (0.0010) [2023-12-26 09:25:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 628760576. Throughput: 0: 8837.8, 1: 8826.9. Samples: 628735420. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:53,785][121949] Avg episode reward: [(0, '6202.603'), (1, '5144.751')] [2023-12-26 09:25:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001223776_313286656.pth... [2023-12-26 09:25:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001232304_315473920.pth... [2023-12-26 09:25:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001222752_313024512.pth [2023-12-26 09:25:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001231248_315203584.pth [2023-12-26 09:25:54,114][123090] Updated weights for policy 1, policy_version 1223778 (0.0006) [2023-12-26 09:25:54,182][123090] Updated weights for policy 1, policy_version 1223788 (0.0005) [2023-12-26 09:25:54,235][123091] Updated weights for policy 0, policy_version 1232306 (0.0009) [2023-12-26 09:25:54,252][123090] Updated weights for policy 1, policy_version 1223798 (0.0005) [2023-12-26 09:25:54,295][123091] Updated weights for policy 0, policy_version 1232316 (0.0005) [2023-12-26 09:25:54,320][123090] Updated weights for policy 1, policy_version 1223808 (0.0006) [2023-12-26 09:25:54,354][123091] Updated weights for policy 0, policy_version 1232326 (0.0010) [2023-12-26 09:25:54,408][123091] Updated weights for policy 0, policy_version 1232336 (0.0010) [2023-12-26 09:25:55,006][123090] Updated weights for policy 1, policy_version 1223818 (0.0009) [2023-12-26 09:25:55,071][123090] Updated weights for policy 1, policy_version 1223828 (0.0009) [2023-12-26 09:25:55,142][123090] Updated weights for policy 1, policy_version 1223838 (0.0010) [2023-12-26 09:25:55,149][123091] Updated weights for policy 0, policy_version 1232346 (0.0005) [2023-12-26 09:25:55,196][123091] Updated weights for policy 0, policy_version 1232356 (0.0005) [2023-12-26 09:25:55,247][123091] Updated weights for policy 0, policy_version 1232366 (0.0005) [2023-12-26 09:25:55,973][123090] Updated weights for policy 1, policy_version 1223848 (0.0009) [2023-12-26 09:25:56,024][123090] Updated weights for policy 1, policy_version 1223858 (0.0009) [2023-12-26 09:25:56,040][123091] Updated weights for policy 0, policy_version 1232376 (0.0010) [2023-12-26 09:25:56,088][123090] Updated weights for policy 1, policy_version 1223868 (0.0008) [2023-12-26 09:25:56,098][123091] Updated weights for policy 0, policy_version 1232386 (0.0010) [2023-12-26 09:25:56,157][123091] Updated weights for policy 0, policy_version 1232396 (0.0011) [2023-12-26 09:25:56,921][123090] Updated weights for policy 1, policy_version 1223878 (0.0008) [2023-12-26 09:25:56,975][123090] Updated weights for policy 1, policy_version 1223888 (0.0008) [2023-12-26 09:25:56,984][123091] Updated weights for policy 0, policy_version 1232406 (0.0010) [2023-12-26 09:25:57,034][123090] Updated weights for policy 1, policy_version 1223898 (0.0006) [2023-12-26 09:25:57,035][123091] Updated weights for policy 0, policy_version 1232416 (0.0010) [2023-12-26 09:25:57,096][123091] Updated weights for policy 0, policy_version 1232426 (0.0010) [2023-12-26 09:25:57,867][123090] Updated weights for policy 1, policy_version 1223908 (0.0008) [2023-12-26 09:25:57,918][123091] Updated weights for policy 0, policy_version 1232436 (0.0010) [2023-12-26 09:25:57,921][123090] Updated weights for policy 1, policy_version 1223918 (0.0007) [2023-12-26 09:25:57,969][123091] Updated weights for policy 0, policy_version 1232446 (0.0010) [2023-12-26 09:25:57,972][123090] Updated weights for policy 1, policy_version 1223928 (0.0006) [2023-12-26 09:25:58,024][123091] Updated weights for policy 0, policy_version 1232456 (0.0010) [2023-12-26 09:25:58,786][121949] Fps is (10 sec: 18018.9, 60 sec: 17612.3, 300 sec: 17689.1). Total num frames: 628842496. Throughput: 0: 8889.5, 1: 8813.8. Samples: 628840856. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:25:58,787][121949] Avg episode reward: [(0, '6122.114'), (1, '5214.022')] [2023-12-26 09:25:58,924][123091] Updated weights for policy 0, policy_version 1232466 (0.0010) [2023-12-26 09:25:58,940][123090] Updated weights for policy 1, policy_version 1223938 (0.0006) [2023-12-26 09:25:58,986][123091] Updated weights for policy 0, policy_version 1232476 (0.0010) [2023-12-26 09:25:59,012][123090] Updated weights for policy 1, policy_version 1223948 (0.0007) [2023-12-26 09:25:59,052][123091] Updated weights for policy 0, policy_version 1232486 (0.0010) [2023-12-26 09:25:59,076][123090] Updated weights for policy 1, policy_version 1223958 (0.0008) [2023-12-26 09:25:59,115][123091] Updated weights for policy 0, policy_version 1232496 (0.0011) [2023-12-26 09:25:59,145][123090] Updated weights for policy 1, policy_version 1223968 (0.0009) [2023-12-26 09:25:59,905][123091] Updated weights for policy 0, policy_version 1232506 (0.0009) [2023-12-26 09:25:59,974][123091] Updated weights for policy 0, policy_version 1232516 (0.0008) [2023-12-26 09:25:59,997][123090] Updated weights for policy 1, policy_version 1223978 (0.0008) [2023-12-26 09:26:00,037][123091] Updated weights for policy 0, policy_version 1232526 (0.0008) [2023-12-26 09:26:00,062][123090] Updated weights for policy 1, policy_version 1223988 (0.0009) [2023-12-26 09:26:00,119][123090] Updated weights for policy 1, policy_version 1223998 (0.0010) [2023-12-26 09:26:00,654][123091] Updated weights for policy 0, policy_version 1232536 (0.0006) [2023-12-26 09:26:00,705][123091] Updated weights for policy 0, policy_version 1232546 (0.0005) [2023-12-26 09:26:00,761][123091] Updated weights for policy 0, policy_version 1232556 (0.0005) [2023-12-26 09:26:00,957][123090] Updated weights for policy 1, policy_version 1224008 (0.0008) [2023-12-26 09:26:01,009][123090] Updated weights for policy 1, policy_version 1224018 (0.0009) [2023-12-26 09:26:01,087][123090] Updated weights for policy 1, policy_version 1224028 (0.0010) [2023-12-26 09:26:01,514][123091] Updated weights for policy 0, policy_version 1232566 (0.0008) [2023-12-26 09:26:01,562][123091] Updated weights for policy 0, policy_version 1232576 (0.0010) [2023-12-26 09:26:01,621][123091] Updated weights for policy 0, policy_version 1232586 (0.0010) [2023-12-26 09:26:01,967][123090] Updated weights for policy 1, policy_version 1224038 (0.0009) [2023-12-26 09:26:02,019][123090] Updated weights for policy 1, policy_version 1224048 (0.0009) [2023-12-26 09:26:02,092][123090] Updated weights for policy 1, policy_version 1224058 (0.0007) [2023-12-26 09:26:02,479][123091] Updated weights for policy 0, policy_version 1232597 (0.0008) [2023-12-26 09:26:02,545][123091] Updated weights for policy 0, policy_version 1232607 (0.0005) [2023-12-26 09:26:02,595][123091] Updated weights for policy 0, policy_version 1232617 (0.0005) [2023-12-26 09:26:02,797][123090] Updated weights for policy 1, policy_version 1224068 (0.0007) [2023-12-26 09:26:02,848][123090] Updated weights for policy 1, policy_version 1224078 (0.0009) [2023-12-26 09:26:02,898][123090] Updated weights for policy 1, policy_version 1224088 (0.0009) [2023-12-26 09:26:03,176][123091] Updated weights for policy 0, policy_version 1232627 (0.0005) [2023-12-26 09:26:03,239][123091] Updated weights for policy 0, policy_version 1232637 (0.0008) [2023-12-26 09:26:03,283][123091] Updated weights for policy 0, policy_version 1232647 (0.0010) [2023-12-26 09:26:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 628932608. Throughput: 0: 8983.4, 1: 8729.6. Samples: 628945816. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:03,785][121949] Avg episode reward: [(0, '6071.661'), (1, '5245.902')] [2023-12-26 09:26:03,815][123090] Updated weights for policy 1, policy_version 1224098 (0.0009) [2023-12-26 09:26:03,886][123090] Updated weights for policy 1, policy_version 1224108 (0.0010) [2023-12-26 09:26:03,947][123090] Updated weights for policy 1, policy_version 1224118 (0.0010) [2023-12-26 09:26:04,015][123090] Updated weights for policy 1, policy_version 1224128 (0.0009) [2023-12-26 09:26:04,029][123091] Updated weights for policy 0, policy_version 1232657 (0.0010) [2023-12-26 09:26:04,092][123091] Updated weights for policy 0, policy_version 1232667 (0.0009) [2023-12-26 09:26:04,160][123091] Updated weights for policy 0, policy_version 1232677 (0.0009) [2023-12-26 09:26:04,221][123091] Updated weights for policy 0, policy_version 1232687 (0.0009) [2023-12-26 09:26:04,837][123090] Updated weights for policy 1, policy_version 1224138 (0.0011) [2023-12-26 09:26:04,902][123090] Updated weights for policy 1, policy_version 1224148 (0.0010) [2023-12-26 09:26:04,963][123091] Updated weights for policy 0, policy_version 1232697 (0.0006) [2023-12-26 09:26:04,972][123090] Updated weights for policy 1, policy_version 1224158 (0.0009) [2023-12-26 09:26:05,015][123091] Updated weights for policy 0, policy_version 1232707 (0.0005) [2023-12-26 09:26:05,066][123091] Updated weights for policy 0, policy_version 1232717 (0.0005) [2023-12-26 09:26:05,740][123090] Updated weights for policy 1, policy_version 1224168 (0.0008) [2023-12-26 09:26:05,765][123091] Updated weights for policy 0, policy_version 1232727 (0.0009) [2023-12-26 09:26:05,789][123090] Updated weights for policy 1, policy_version 1224178 (0.0007) [2023-12-26 09:26:05,824][123091] Updated weights for policy 0, policy_version 1232737 (0.0009) [2023-12-26 09:26:05,836][123090] Updated weights for policy 1, policy_version 1224188 (0.0005) [2023-12-26 09:26:05,886][123091] Updated weights for policy 0, policy_version 1232747 (0.0006) [2023-12-26 09:26:06,630][123091] Updated weights for policy 0, policy_version 1232757 (0.0006) [2023-12-26 09:26:06,680][123090] Updated weights for policy 1, policy_version 1224198 (0.0006) [2023-12-26 09:26:06,698][123091] Updated weights for policy 0, policy_version 1232767 (0.0011) [2023-12-26 09:26:06,745][123090] Updated weights for policy 1, policy_version 1224208 (0.0008) [2023-12-26 09:26:06,756][123091] Updated weights for policy 0, policy_version 1232777 (0.0009) [2023-12-26 09:26:06,801][123090] Updated weights for policy 1, policy_version 1224218 (0.0008) [2023-12-26 09:26:07,458][123091] Updated weights for policy 0, policy_version 1232787 (0.0006) [2023-12-26 09:26:07,527][123091] Updated weights for policy 0, policy_version 1232797 (0.0006) [2023-12-26 09:26:07,596][123091] Updated weights for policy 0, policy_version 1232807 (0.0007) [2023-12-26 09:26:07,659][123090] Updated weights for policy 1, policy_version 1224228 (0.0010) [2023-12-26 09:26:07,719][123090] Updated weights for policy 1, policy_version 1224238 (0.0009) [2023-12-26 09:26:07,779][123090] Updated weights for policy 1, policy_version 1224248 (0.0006) [2023-12-26 09:26:08,235][123091] Updated weights for policy 0, policy_version 1232817 (0.0010) [2023-12-26 09:26:08,284][123091] Updated weights for policy 0, policy_version 1232827 (0.0005) [2023-12-26 09:26:08,347][123091] Updated weights for policy 0, policy_version 1232837 (0.0007) [2023-12-26 09:26:08,405][123091] Updated weights for policy 0, policy_version 1232847 (0.0008) [2023-12-26 09:26:08,524][123090] Updated weights for policy 1, policy_version 1224258 (0.0006) [2023-12-26 09:26:08,589][123090] Updated weights for policy 1, policy_version 1224268 (0.0009) [2023-12-26 09:26:08,657][123090] Updated weights for policy 1, policy_version 1224278 (0.0009) [2023-12-26 09:26:08,731][123090] Updated weights for policy 1, policy_version 1224288 (0.0010) [2023-12-26 09:26:08,784][121949] Fps is (10 sec: 18845.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 629030912. Throughput: 0: 9081.6, 1: 8715.3. Samples: 629001148. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:08,784][121949] Avg episode reward: [(0, '6149.597'), (1, '5302.965')] [2023-12-26 09:26:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001232848_315613184.pth... [2023-12-26 09:26:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001224288_313417728.pth... [2023-12-26 09:26:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001231792_315342848.pth [2023-12-26 09:26:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001223264_313155584.pth [2023-12-26 09:26:09,131][123091] Updated weights for policy 0, policy_version 1232857 (0.0008) [2023-12-26 09:26:09,181][123091] Updated weights for policy 0, policy_version 1232867 (0.0010) [2023-12-26 09:26:09,235][123091] Updated weights for policy 0, policy_version 1232877 (0.0007) [2023-12-26 09:26:09,589][123090] Updated weights for policy 1, policy_version 1224298 (0.0010) [2023-12-26 09:26:09,652][123090] Updated weights for policy 1, policy_version 1224308 (0.0009) [2023-12-26 09:26:09,715][123090] Updated weights for policy 1, policy_version 1224318 (0.0010) [2023-12-26 09:26:10,125][123091] Updated weights for policy 0, policy_version 1232887 (0.0009) [2023-12-26 09:26:10,185][123091] Updated weights for policy 0, policy_version 1232897 (0.0009) [2023-12-26 09:26:10,242][123091] Updated weights for policy 0, policy_version 1232907 (0.0009) [2023-12-26 09:26:10,569][123090] Updated weights for policy 1, policy_version 1224328 (0.0010) [2023-12-26 09:26:10,620][123090] Updated weights for policy 1, policy_version 1224338 (0.0009) [2023-12-26 09:26:10,671][123090] Updated weights for policy 1, policy_version 1224348 (0.0009) [2023-12-26 09:26:11,086][123091] Updated weights for policy 0, policy_version 1232917 (0.0009) [2023-12-26 09:26:11,154][123091] Updated weights for policy 0, policy_version 1232927 (0.0009) [2023-12-26 09:26:11,219][123091] Updated weights for policy 0, policy_version 1232937 (0.0009) [2023-12-26 09:26:11,490][123090] Updated weights for policy 1, policy_version 1224358 (0.0010) [2023-12-26 09:26:11,554][123090] Updated weights for policy 1, policy_version 1224368 (0.0010) [2023-12-26 09:26:11,613][123090] Updated weights for policy 1, policy_version 1224378 (0.0010) [2023-12-26 09:26:12,127][123091] Updated weights for policy 0, policy_version 1232947 (0.0010) [2023-12-26 09:26:12,189][123091] Updated weights for policy 0, policy_version 1232957 (0.0010) [2023-12-26 09:26:12,253][123091] Updated weights for policy 0, policy_version 1232967 (0.0010) [2023-12-26 09:26:12,468][123090] Updated weights for policy 1, policy_version 1224388 (0.0009) [2023-12-26 09:26:12,529][123090] Updated weights for policy 1, policy_version 1224398 (0.0009) [2023-12-26 09:26:12,595][123090] Updated weights for policy 1, policy_version 1224408 (0.0008) [2023-12-26 09:26:13,067][123091] Updated weights for policy 0, policy_version 1232977 (0.0008) [2023-12-26 09:26:13,142][123091] Updated weights for policy 0, policy_version 1232987 (0.0007) [2023-12-26 09:26:13,207][123091] Updated weights for policy 0, policy_version 1232997 (0.0008) [2023-12-26 09:26:13,277][123091] Updated weights for policy 0, policy_version 1233007 (0.0008) [2023-12-26 09:26:13,449][123090] Updated weights for policy 1, policy_version 1224418 (0.0010) [2023-12-26 09:26:13,505][123090] Updated weights for policy 1, policy_version 1224428 (0.0008) [2023-12-26 09:26:13,571][123090] Updated weights for policy 1, policy_version 1224438 (0.0008) [2023-12-26 09:26:13,642][123090] Updated weights for policy 1, policy_version 1224448 (0.0009) [2023-12-26 09:26:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 629112832. Throughput: 0: 9046.7, 1: 8678.7. Samples: 629105892. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:13,785][121949] Avg episode reward: [(0, '6025.507'), (1, '5641.116')] [2023-12-26 09:26:13,925][123091] Updated weights for policy 0, policy_version 1233017 (0.0005) [2023-12-26 09:26:13,997][123091] Updated weights for policy 0, policy_version 1233027 (0.0005) [2023-12-26 09:26:14,065][123091] Updated weights for policy 0, policy_version 1233037 (0.0005) [2023-12-26 09:26:14,467][123090] Updated weights for policy 1, policy_version 1224458 (0.0010) [2023-12-26 09:26:14,529][123090] Updated weights for policy 1, policy_version 1224468 (0.0009) [2023-12-26 09:26:14,588][123090] Updated weights for policy 1, policy_version 1224478 (0.0009) [2023-12-26 09:26:14,683][123091] Updated weights for policy 0, policy_version 1233047 (0.0005) [2023-12-26 09:26:14,746][123091] Updated weights for policy 0, policy_version 1233057 (0.0010) [2023-12-26 09:26:14,815][123091] Updated weights for policy 0, policy_version 1233067 (0.0011) [2023-12-26 09:26:15,398][123090] Updated weights for policy 1, policy_version 1224488 (0.0011) [2023-12-26 09:26:15,463][123091] Updated weights for policy 0, policy_version 1233077 (0.0009) [2023-12-26 09:26:15,466][123090] Updated weights for policy 1, policy_version 1224498 (0.0010) [2023-12-26 09:26:15,520][123091] Updated weights for policy 0, policy_version 1233087 (0.0007) [2023-12-26 09:26:15,533][123090] Updated weights for policy 1, policy_version 1224508 (0.0011) [2023-12-26 09:26:15,576][123091] Updated weights for policy 0, policy_version 1233097 (0.0011) [2023-12-26 09:26:16,344][123090] Updated weights for policy 1, policy_version 1224518 (0.0010) [2023-12-26 09:26:16,398][123090] Updated weights for policy 1, policy_version 1224528 (0.0010) [2023-12-26 09:26:16,409][123091] Updated weights for policy 0, policy_version 1233107 (0.0010) [2023-12-26 09:26:16,446][123090] Updated weights for policy 1, policy_version 1224538 (0.0010) [2023-12-26 09:26:16,454][123091] Updated weights for policy 0, policy_version 1233117 (0.0006) [2023-12-26 09:26:16,500][123091] Updated weights for policy 0, policy_version 1233127 (0.0009) [2023-12-26 09:26:17,169][123090] Updated weights for policy 1, policy_version 1224548 (0.0008) [2023-12-26 09:26:17,227][123090] Updated weights for policy 1, policy_version 1224558 (0.0006) [2023-12-26 09:26:17,297][123090] Updated weights for policy 1, policy_version 1224568 (0.0008) [2023-12-26 09:26:17,305][123091] Updated weights for policy 0, policy_version 1233137 (0.0008) [2023-12-26 09:26:17,364][123091] Updated weights for policy 0, policy_version 1233147 (0.0005) [2023-12-26 09:26:17,412][123091] Updated weights for policy 0, policy_version 1233157 (0.0005) [2023-12-26 09:26:17,464][123091] Updated weights for policy 0, policy_version 1233167 (0.0005) [2023-12-26 09:26:18,110][123090] Updated weights for policy 1, policy_version 1224578 (0.0010) [2023-12-26 09:26:18,130][123091] Updated weights for policy 0, policy_version 1233177 (0.0006) [2023-12-26 09:26:18,164][123090] Updated weights for policy 1, policy_version 1224588 (0.0005) [2023-12-26 09:26:18,179][123091] Updated weights for policy 0, policy_version 1233187 (0.0006) [2023-12-26 09:26:18,218][123090] Updated weights for policy 1, policy_version 1224598 (0.0005) [2023-12-26 09:26:18,229][123091] Updated weights for policy 0, policy_version 1233197 (0.0007) [2023-12-26 09:26:18,265][123090] Updated weights for policy 1, policy_version 1224608 (0.0006) [2023-12-26 09:26:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 629202944. Throughput: 0: 9077.2, 1: 8685.3. Samples: 629216284. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:18,785][121949] Avg episode reward: [(0, '5933.980'), (1, '5754.243')] [2023-12-26 09:26:18,928][123090] Updated weights for policy 1, policy_version 1224618 (0.0008) [2023-12-26 09:26:18,979][123090] Updated weights for policy 1, policy_version 1224628 (0.0008) [2023-12-26 09:26:19,034][123091] Updated weights for policy 0, policy_version 1233207 (0.0008) [2023-12-26 09:26:19,039][123090] Updated weights for policy 1, policy_version 1224638 (0.0007) [2023-12-26 09:26:19,090][123091] Updated weights for policy 0, policy_version 1233217 (0.0008) [2023-12-26 09:26:19,149][123091] Updated weights for policy 0, policy_version 1233227 (0.0008) [2023-12-26 09:26:19,814][123090] Updated weights for policy 1, policy_version 1224648 (0.0006) [2023-12-26 09:26:19,884][123090] Updated weights for policy 1, policy_version 1224658 (0.0008) [2023-12-26 09:26:19,958][123090] Updated weights for policy 1, policy_version 1224669 (0.0009) [2023-12-26 09:26:19,979][123091] Updated weights for policy 0, policy_version 1233237 (0.0009) [2023-12-26 09:26:20,050][123091] Updated weights for policy 0, policy_version 1233247 (0.0008) [2023-12-26 09:26:20,105][123091] Updated weights for policy 0, policy_version 1233257 (0.0008) [2023-12-26 09:26:20,742][123090] Updated weights for policy 1, policy_version 1224679 (0.0010) [2023-12-26 09:26:20,813][123090] Updated weights for policy 1, policy_version 1224689 (0.0009) [2023-12-26 09:26:20,881][123090] Updated weights for policy 1, policy_version 1224699 (0.0009) [2023-12-26 09:26:20,906][123091] Updated weights for policy 0, policy_version 1233267 (0.0008) [2023-12-26 09:26:20,978][123091] Updated weights for policy 0, policy_version 1233277 (0.0006) [2023-12-26 09:26:21,049][123091] Updated weights for policy 0, policy_version 1233287 (0.0007) [2023-12-26 09:26:21,688][123090] Updated weights for policy 1, policy_version 1224709 (0.0009) [2023-12-26 09:26:21,754][123090] Updated weights for policy 1, policy_version 1224719 (0.0008) [2023-12-26 09:26:21,814][123090] Updated weights for policy 1, policy_version 1224729 (0.0008) [2023-12-26 09:26:21,856][123091] Updated weights for policy 0, policy_version 1233297 (0.0008) [2023-12-26 09:26:21,924][123091] Updated weights for policy 0, policy_version 1233307 (0.0009) [2023-12-26 09:26:21,980][123091] Updated weights for policy 0, policy_version 1233317 (0.0010) [2023-12-26 09:26:22,040][123091] Updated weights for policy 0, policy_version 1233327 (0.0011) [2023-12-26 09:26:22,647][123090] Updated weights for policy 1, policy_version 1224739 (0.0009) [2023-12-26 09:26:22,713][123090] Updated weights for policy 1, policy_version 1224749 (0.0009) [2023-12-26 09:26:22,776][123090] Updated weights for policy 1, policy_version 1224759 (0.0009) [2023-12-26 09:26:22,854][123091] Updated weights for policy 0, policy_version 1233337 (0.0011) [2023-12-26 09:26:22,905][123091] Updated weights for policy 0, policy_version 1233347 (0.0010) [2023-12-26 09:26:22,957][123091] Updated weights for policy 0, policy_version 1233357 (0.0010) [2023-12-26 09:26:23,570][123090] Updated weights for policy 1, policy_version 1224769 (0.0009) [2023-12-26 09:26:23,630][123090] Updated weights for policy 1, policy_version 1224779 (0.0007) [2023-12-26 09:26:23,632][123091] Updated weights for policy 0, policy_version 1233367 (0.0007) [2023-12-26 09:26:23,695][123091] Updated weights for policy 0, policy_version 1233377 (0.0005) [2023-12-26 09:26:23,706][123090] Updated weights for policy 1, policy_version 1224789 (0.0007) [2023-12-26 09:26:23,762][123091] Updated weights for policy 0, policy_version 1233387 (0.0006) [2023-12-26 09:26:23,768][123090] Updated weights for policy 1, policy_version 1224799 (0.0006) [2023-12-26 09:26:23,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 629301248. Throughput: 0: 9076.7, 1: 8730.2. Samples: 629270020. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:23,784][121949] Avg episode reward: [(0, '5909.677'), (1, '5715.056')] [2023-12-26 09:26:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001233392_315752448.pth... [2023-12-26 09:26:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001224800_313548800.pth... [2023-12-26 09:26:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001232304_315473920.pth [2023-12-26 09:26:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001223776_313286656.pth [2023-12-26 09:26:24,496][123090] Updated weights for policy 1, policy_version 1224809 (0.0009) [2023-12-26 09:26:24,543][123091] Updated weights for policy 0, policy_version 1233397 (0.0009) [2023-12-26 09:26:24,554][123090] Updated weights for policy 1, policy_version 1224819 (0.0008) [2023-12-26 09:26:24,597][123091] Updated weights for policy 0, policy_version 1233407 (0.0007) [2023-12-26 09:26:24,601][123090] Updated weights for policy 1, policy_version 1224829 (0.0008) [2023-12-26 09:26:24,660][123091] Updated weights for policy 0, policy_version 1233417 (0.0009) [2023-12-26 09:26:25,362][123090] Updated weights for policy 1, policy_version 1224839 (0.0006) [2023-12-26 09:26:25,408][123091] Updated weights for policy 0, policy_version 1233427 (0.0009) [2023-12-26 09:26:25,413][123090] Updated weights for policy 1, policy_version 1224849 (0.0005) [2023-12-26 09:26:25,467][123091] Updated weights for policy 0, policy_version 1233437 (0.0009) [2023-12-26 09:26:25,477][123090] Updated weights for policy 1, policy_version 1224859 (0.0007) [2023-12-26 09:26:25,523][123091] Updated weights for policy 0, policy_version 1233447 (0.0009) [2023-12-26 09:26:26,177][123090] Updated weights for policy 1, policy_version 1224869 (0.0005) [2023-12-26 09:26:26,248][123090] Updated weights for policy 1, policy_version 1224879 (0.0005) [2023-12-26 09:26:26,313][123090] Updated weights for policy 1, policy_version 1224889 (0.0008) [2023-12-26 09:26:26,422][123091] Updated weights for policy 0, policy_version 1233457 (0.0009) [2023-12-26 09:26:26,467][123091] Updated weights for policy 0, policy_version 1233467 (0.0007) [2023-12-26 09:26:26,536][123091] Updated weights for policy 0, policy_version 1233477 (0.0005) [2023-12-26 09:26:26,608][123091] Updated weights for policy 0, policy_version 1233487 (0.0005) [2023-12-26 09:26:26,886][123090] Updated weights for policy 1, policy_version 1224899 (0.0007) [2023-12-26 09:26:26,937][123090] Updated weights for policy 1, policy_version 1224909 (0.0005) [2023-12-26 09:26:26,988][123090] Updated weights for policy 1, policy_version 1224919 (0.0005) [2023-12-26 09:26:27,216][123091] Updated weights for policy 0, policy_version 1233497 (0.0009) [2023-12-26 09:26:27,273][123091] Updated weights for policy 0, policy_version 1233507 (0.0009) [2023-12-26 09:26:27,326][123091] Updated weights for policy 0, policy_version 1233517 (0.0007) [2023-12-26 09:26:27,654][123090] Updated weights for policy 1, policy_version 1224929 (0.0005) [2023-12-26 09:26:27,700][123090] Updated weights for policy 1, policy_version 1224939 (0.0005) [2023-12-26 09:26:27,775][123090] Updated weights for policy 1, policy_version 1224949 (0.0005) [2023-12-26 09:26:27,834][123090] Updated weights for policy 1, policy_version 1224959 (0.0005) [2023-12-26 09:26:28,124][123091] Updated weights for policy 0, policy_version 1233527 (0.0007) [2023-12-26 09:26:28,179][123091] Updated weights for policy 0, policy_version 1233537 (0.0010) [2023-12-26 09:26:28,226][123091] Updated weights for policy 0, policy_version 1233547 (0.0010) [2023-12-26 09:26:28,393][123090] Updated weights for policy 1, policy_version 1224969 (0.0006) [2023-12-26 09:26:28,458][123090] Updated weights for policy 1, policy_version 1224979 (0.0007) [2023-12-26 09:26:28,531][123090] Updated weights for policy 1, policy_version 1224989 (0.0006) [2023-12-26 09:26:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 629391360. Throughput: 0: 9137.4, 1: 8879.5. Samples: 629381716. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:28,785][121949] Avg episode reward: [(0, '6076.177'), (1, '5762.870')] [2023-12-26 09:26:29,056][123091] Updated weights for policy 0, policy_version 1233557 (0.0010) [2023-12-26 09:26:29,116][123091] Updated weights for policy 0, policy_version 1233567 (0.0008) [2023-12-26 09:26:29,175][123091] Updated weights for policy 0, policy_version 1233577 (0.0009) [2023-12-26 09:26:29,328][123090] Updated weights for policy 1, policy_version 1224999 (0.0010) [2023-12-26 09:26:29,395][123090] Updated weights for policy 1, policy_version 1225009 (0.0009) [2023-12-26 09:26:29,450][123090] Updated weights for policy 1, policy_version 1225019 (0.0009) [2023-12-26 09:26:29,994][123091] Updated weights for policy 0, policy_version 1233587 (0.0008) [2023-12-26 09:26:30,058][123091] Updated weights for policy 0, policy_version 1233597 (0.0010) [2023-12-26 09:26:30,120][123091] Updated weights for policy 0, policy_version 1233607 (0.0009) [2023-12-26 09:26:30,283][123090] Updated weights for policy 1, policy_version 1225029 (0.0009) [2023-12-26 09:26:30,350][123090] Updated weights for policy 1, policy_version 1225039 (0.0010) [2023-12-26 09:26:30,423][123090] Updated weights for policy 1, policy_version 1225049 (0.0010) [2023-12-26 09:26:30,977][123091] Updated weights for policy 0, policy_version 1233617 (0.0010) [2023-12-26 09:26:31,023][123091] Updated weights for policy 0, policy_version 1233627 (0.0009) [2023-12-26 09:26:31,091][123091] Updated weights for policy 0, policy_version 1233637 (0.0009) [2023-12-26 09:26:31,152][123091] Updated weights for policy 0, policy_version 1233647 (0.0010) [2023-12-26 09:26:31,257][123090] Updated weights for policy 1, policy_version 1225059 (0.0010) [2023-12-26 09:26:31,311][123090] Updated weights for policy 1, policy_version 1225069 (0.0009) [2023-12-26 09:26:31,382][123090] Updated weights for policy 1, policy_version 1225079 (0.0008) [2023-12-26 09:26:31,932][123091] Updated weights for policy 0, policy_version 1233657 (0.0009) [2023-12-26 09:26:31,983][123091] Updated weights for policy 0, policy_version 1233667 (0.0009) [2023-12-26 09:26:32,031][123091] Updated weights for policy 0, policy_version 1233677 (0.0009) [2023-12-26 09:26:32,225][123090] Updated weights for policy 1, policy_version 1225089 (0.0011) [2023-12-26 09:26:32,293][123090] Updated weights for policy 1, policy_version 1225099 (0.0006) [2023-12-26 09:26:32,363][123090] Updated weights for policy 1, policy_version 1225109 (0.0010) [2023-12-26 09:26:32,428][123090] Updated weights for policy 1, policy_version 1225119 (0.0010) [2023-12-26 09:26:32,916][123091] Updated weights for policy 0, policy_version 1233687 (0.0009) [2023-12-26 09:26:32,986][123091] Updated weights for policy 0, policy_version 1233697 (0.0008) [2023-12-26 09:26:33,058][123091] Updated weights for policy 0, policy_version 1233707 (0.0008) [2023-12-26 09:26:33,187][123090] Updated weights for policy 1, policy_version 1225129 (0.0008) [2023-12-26 09:26:33,239][123090] Updated weights for policy 1, policy_version 1225139 (0.0009) [2023-12-26 09:26:33,291][123090] Updated weights for policy 1, policy_version 1225150 (0.0009) [2023-12-26 09:26:33,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 629473280. Throughput: 0: 9077.3, 1: 8851.4. Samples: 629487036. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:33,785][121949] Avg episode reward: [(0, '6266.966'), (1, '5616.875')] [2023-12-26 09:26:33,823][123091] Updated weights for policy 0, policy_version 1233717 (0.0008) [2023-12-26 09:26:33,876][123091] Updated weights for policy 0, policy_version 1233727 (0.0005) [2023-12-26 09:26:33,922][123091] Updated weights for policy 0, policy_version 1233737 (0.0005) [2023-12-26 09:26:34,195][123090] Updated weights for policy 1, policy_version 1225160 (0.0009) [2023-12-26 09:26:34,262][123090] Updated weights for policy 1, policy_version 1225170 (0.0010) [2023-12-26 09:26:34,330][123090] Updated weights for policy 1, policy_version 1225180 (0.0009) [2023-12-26 09:26:34,610][123091] Updated weights for policy 0, policy_version 1233747 (0.0005) [2023-12-26 09:26:34,678][123091] Updated weights for policy 0, policy_version 1233757 (0.0008) [2023-12-26 09:26:34,742][123091] Updated weights for policy 0, policy_version 1233767 (0.0008) [2023-12-26 09:26:35,243][123090] Updated weights for policy 1, policy_version 1225190 (0.0010) [2023-12-26 09:26:35,302][123090] Updated weights for policy 1, policy_version 1225200 (0.0008) [2023-12-26 09:26:35,360][123090] Updated weights for policy 1, policy_version 1225210 (0.0005) [2023-12-26 09:26:35,398][123091] Updated weights for policy 0, policy_version 1233777 (0.0006) [2023-12-26 09:26:35,459][123091] Updated weights for policy 0, policy_version 1233787 (0.0005) [2023-12-26 09:26:35,529][123091] Updated weights for policy 0, policy_version 1233797 (0.0005) [2023-12-26 09:26:35,605][123091] Updated weights for policy 0, policy_version 1233807 (0.0005) [2023-12-26 09:26:36,152][123090] Updated weights for policy 1, policy_version 1225220 (0.0009) [2023-12-26 09:26:36,209][123090] Updated weights for policy 1, policy_version 1225230 (0.0010) [2023-12-26 09:26:36,238][123091] Updated weights for policy 0, policy_version 1233817 (0.0008) [2023-12-26 09:26:36,262][123090] Updated weights for policy 1, policy_version 1225240 (0.0011) [2023-12-26 09:26:36,290][123091] Updated weights for policy 0, policy_version 1233827 (0.0008) [2023-12-26 09:26:36,353][123091] Updated weights for policy 0, policy_version 1233837 (0.0008) [2023-12-26 09:26:37,067][123090] Updated weights for policy 1, policy_version 1225250 (0.0011) [2023-12-26 09:26:37,085][123091] Updated weights for policy 0, policy_version 1233847 (0.0009) [2023-12-26 09:26:37,132][123090] Updated weights for policy 1, policy_version 1225260 (0.0010) [2023-12-26 09:26:37,149][123091] Updated weights for policy 0, policy_version 1233857 (0.0011) [2023-12-26 09:26:37,196][123090] Updated weights for policy 1, policy_version 1225270 (0.0010) [2023-12-26 09:26:37,212][123091] Updated weights for policy 0, policy_version 1233867 (0.0007) [2023-12-26 09:26:37,264][123090] Updated weights for policy 1, policy_version 1225280 (0.0011) [2023-12-26 09:26:38,037][123091] Updated weights for policy 0, policy_version 1233877 (0.0010) [2023-12-26 09:26:38,089][123090] Updated weights for policy 1, policy_version 1225290 (0.0011) [2023-12-26 09:26:38,096][123091] Updated weights for policy 0, policy_version 1233887 (0.0006) [2023-12-26 09:26:38,142][123090] Updated weights for policy 1, policy_version 1225300 (0.0010) [2023-12-26 09:26:38,157][123091] Updated weights for policy 0, policy_version 1233897 (0.0006) [2023-12-26 09:26:38,190][123090] Updated weights for policy 1, policy_version 1225310 (0.0010) [2023-12-26 09:26:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 629563392. Throughput: 0: 9146.0, 1: 8783.8. Samples: 629542264. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:38,785][121949] Avg episode reward: [(0, '6357.495'), (1, '5447.038')] [2023-12-26 09:26:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001233904_315883520.pth... [2023-12-26 09:26:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001225312_313679872.pth... [2023-12-26 09:26:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001232848_315613184.pth [2023-12-26 09:26:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001224288_313417728.pth [2023-12-26 09:26:39,009][123091] Updated weights for policy 0, policy_version 1233907 (0.0006) [2023-12-26 09:26:39,011][123090] Updated weights for policy 1, policy_version 1225320 (0.0008) [2023-12-26 09:26:39,076][123091] Updated weights for policy 0, policy_version 1233917 (0.0006) [2023-12-26 09:26:39,076][123090] Updated weights for policy 1, policy_version 1225330 (0.0007) [2023-12-26 09:26:39,134][123090] Updated weights for policy 1, policy_version 1225340 (0.0010) [2023-12-26 09:26:39,140][123091] Updated weights for policy 0, policy_version 1233927 (0.0006) [2023-12-26 09:26:39,923][123091] Updated weights for policy 0, policy_version 1233937 (0.0008) [2023-12-26 09:26:39,990][123090] Updated weights for policy 1, policy_version 1225350 (0.0008) [2023-12-26 09:26:39,996][123091] Updated weights for policy 0, policy_version 1233947 (0.0008) [2023-12-26 09:26:40,043][123090] Updated weights for policy 1, policy_version 1225360 (0.0006) [2023-12-26 09:26:40,059][123091] Updated weights for policy 0, policy_version 1233957 (0.0008) [2023-12-26 09:26:40,111][123090] Updated weights for policy 1, policy_version 1225370 (0.0011) [2023-12-26 09:26:40,124][123091] Updated weights for policy 0, policy_version 1233967 (0.0008) [2023-12-26 09:26:40,919][123091] Updated weights for policy 0, policy_version 1233977 (0.0009) [2023-12-26 09:26:40,941][123090] Updated weights for policy 1, policy_version 1225380 (0.0011) [2023-12-26 09:26:40,980][123091] Updated weights for policy 0, policy_version 1233987 (0.0010) [2023-12-26 09:26:41,005][123090] Updated weights for policy 1, policy_version 1225390 (0.0011) [2023-12-26 09:26:41,049][123091] Updated weights for policy 0, policy_version 1233997 (0.0009) [2023-12-26 09:26:41,073][123090] Updated weights for policy 1, policy_version 1225400 (0.0010) [2023-12-26 09:26:41,930][123090] Updated weights for policy 1, policy_version 1225410 (0.0010) [2023-12-26 09:26:41,957][123091] Updated weights for policy 0, policy_version 1234007 (0.0008) [2023-12-26 09:26:41,989][123090] Updated weights for policy 1, policy_version 1225420 (0.0010) [2023-12-26 09:26:42,021][123091] Updated weights for policy 0, policy_version 1234017 (0.0006) [2023-12-26 09:26:42,049][123090] Updated weights for policy 1, policy_version 1225430 (0.0011) [2023-12-26 09:26:42,075][123091] Updated weights for policy 0, policy_version 1234027 (0.0008) [2023-12-26 09:26:42,112][123090] Updated weights for policy 1, policy_version 1225440 (0.0010) [2023-12-26 09:26:42,936][123091] Updated weights for policy 0, policy_version 1234037 (0.0008) [2023-12-26 09:26:42,950][123090] Updated weights for policy 1, policy_version 1225450 (0.0011) [2023-12-26 09:26:42,989][123091] Updated weights for policy 0, policy_version 1234047 (0.0008) [2023-12-26 09:26:43,016][123090] Updated weights for policy 1, policy_version 1225460 (0.0011) [2023-12-26 09:26:43,049][123091] Updated weights for policy 0, policy_version 1234057 (0.0007) [2023-12-26 09:26:43,075][123090] Updated weights for policy 1, policy_version 1225470 (0.0010) [2023-12-26 09:26:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 629645312. Throughput: 0: 9097.2, 1: 8771.4. Samples: 629644908. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:43,785][121949] Avg episode reward: [(0, '6272.132'), (1, '5411.064')] [2023-12-26 09:26:43,876][123091] Updated weights for policy 0, policy_version 1234067 (0.0007) [2023-12-26 09:26:43,894][123090] Updated weights for policy 1, policy_version 1225480 (0.0010) [2023-12-26 09:26:43,927][123091] Updated weights for policy 0, policy_version 1234077 (0.0006) [2023-12-26 09:26:43,942][123090] Updated weights for policy 1, policy_version 1225490 (0.0010) [2023-12-26 09:26:43,984][123091] Updated weights for policy 0, policy_version 1234087 (0.0007) [2023-12-26 09:26:43,994][123090] Updated weights for policy 1, policy_version 1225500 (0.0010) [2023-12-26 09:26:44,795][123091] Updated weights for policy 0, policy_version 1234097 (0.0007) [2023-12-26 09:26:44,855][123091] Updated weights for policy 0, policy_version 1234107 (0.0008) [2023-12-26 09:26:44,865][123090] Updated weights for policy 1, policy_version 1225510 (0.0010) [2023-12-26 09:26:44,919][123091] Updated weights for policy 0, policy_version 1234117 (0.0008) [2023-12-26 09:26:44,933][123090] Updated weights for policy 1, policy_version 1225520 (0.0011) [2023-12-26 09:26:44,979][123091] Updated weights for policy 0, policy_version 1234127 (0.0010) [2023-12-26 09:26:45,000][123090] Updated weights for policy 1, policy_version 1225530 (0.0011) [2023-12-26 09:26:45,808][123091] Updated weights for policy 0, policy_version 1234137 (0.0007) [2023-12-26 09:26:45,810][123090] Updated weights for policy 1, policy_version 1225540 (0.0011) [2023-12-26 09:26:45,857][123090] Updated weights for policy 1, policy_version 1225550 (0.0010) [2023-12-26 09:26:45,865][123091] Updated weights for policy 0, policy_version 1234147 (0.0005) [2023-12-26 09:26:45,917][123090] Updated weights for policy 1, policy_version 1225560 (0.0010) [2023-12-26 09:26:45,926][123091] Updated weights for policy 0, policy_version 1234157 (0.0005) [2023-12-26 09:26:46,581][123091] Updated weights for policy 0, policy_version 1234167 (0.0005) [2023-12-26 09:26:46,626][123091] Updated weights for policy 0, policy_version 1234177 (0.0005) [2023-12-26 09:26:46,671][123091] Updated weights for policy 0, policy_version 1234187 (0.0005) [2023-12-26 09:26:46,771][123090] Updated weights for policy 1, policy_version 1225570 (0.0010) [2023-12-26 09:26:46,827][123090] Updated weights for policy 1, policy_version 1225580 (0.0010) [2023-12-26 09:26:46,881][123090] Updated weights for policy 1, policy_version 1225590 (0.0010) [2023-12-26 09:26:46,933][123090] Updated weights for policy 1, policy_version 1225600 (0.0010) [2023-12-26 09:26:47,431][123091] Updated weights for policy 0, policy_version 1234197 (0.0005) [2023-12-26 09:26:47,496][123091] Updated weights for policy 0, policy_version 1234207 (0.0011) [2023-12-26 09:26:47,566][123091] Updated weights for policy 0, policy_version 1234217 (0.0011) [2023-12-26 09:26:47,717][123090] Updated weights for policy 1, policy_version 1225610 (0.0006) [2023-12-26 09:26:47,797][123090] Updated weights for policy 1, policy_version 1225620 (0.0005) [2023-12-26 09:26:47,871][123090] Updated weights for policy 1, policy_version 1225630 (0.0006) [2023-12-26 09:26:48,311][123091] Updated weights for policy 0, policy_version 1234227 (0.0011) [2023-12-26 09:26:48,380][123091] Updated weights for policy 0, policy_version 1234237 (0.0009) [2023-12-26 09:26:48,442][123091] Updated weights for policy 0, policy_version 1234247 (0.0009) [2023-12-26 09:26:48,571][123090] Updated weights for policy 1, policy_version 1225640 (0.0005) [2023-12-26 09:26:48,633][123090] Updated weights for policy 1, policy_version 1225650 (0.0005) [2023-12-26 09:26:48,706][123090] Updated weights for policy 1, policy_version 1225660 (0.0005) [2023-12-26 09:26:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 629743616. Throughput: 0: 9081.4, 1: 8827.8. Samples: 629751724. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:48,784][121949] Avg episode reward: [(0, '6102.998'), (1, '5502.091')] [2023-12-26 09:26:49,117][123091] Updated weights for policy 0, policy_version 1234257 (0.0009) [2023-12-26 09:26:49,187][123091] Updated weights for policy 0, policy_version 1234267 (0.0009) [2023-12-26 09:26:49,258][123091] Updated weights for policy 0, policy_version 1234277 (0.0008) [2023-12-26 09:26:49,332][123091] Updated weights for policy 0, policy_version 1234287 (0.0007) [2023-12-26 09:26:49,498][123090] Updated weights for policy 1, policy_version 1225670 (0.0010) [2023-12-26 09:26:49,558][123090] Updated weights for policy 1, policy_version 1225680 (0.0009) [2023-12-26 09:26:49,617][123090] Updated weights for policy 1, policy_version 1225690 (0.0009) [2023-12-26 09:26:50,018][123091] Updated weights for policy 0, policy_version 1234297 (0.0007) [2023-12-26 09:26:50,086][123091] Updated weights for policy 0, policy_version 1234307 (0.0009) [2023-12-26 09:26:50,149][123091] Updated weights for policy 0, policy_version 1234317 (0.0008) [2023-12-26 09:26:50,524][123090] Updated weights for policy 1, policy_version 1225700 (0.0010) [2023-12-26 09:26:50,597][123090] Updated weights for policy 1, policy_version 1225710 (0.0010) [2023-12-26 09:26:50,653][123090] Updated weights for policy 1, policy_version 1225720 (0.0010) [2023-12-26 09:26:50,873][123091] Updated weights for policy 0, policy_version 1234327 (0.0006) [2023-12-26 09:26:50,946][123091] Updated weights for policy 0, policy_version 1234337 (0.0009) [2023-12-26 09:26:51,018][123091] Updated weights for policy 0, policy_version 1234347 (0.0007) [2023-12-26 09:26:51,448][123090] Updated weights for policy 1, policy_version 1225730 (0.0009) [2023-12-26 09:26:51,516][123090] Updated weights for policy 1, policy_version 1225740 (0.0010) [2023-12-26 09:26:51,582][123090] Updated weights for policy 1, policy_version 1225750 (0.0009) [2023-12-26 09:26:51,658][123090] Updated weights for policy 1, policy_version 1225760 (0.0006) [2023-12-26 09:26:51,849][123091] Updated weights for policy 0, policy_version 1234357 (0.0007) [2023-12-26 09:26:51,916][123091] Updated weights for policy 0, policy_version 1234367 (0.0006) [2023-12-26 09:26:51,980][123091] Updated weights for policy 0, policy_version 1234377 (0.0005) [2023-12-26 09:26:52,531][123090] Updated weights for policy 1, policy_version 1225770 (0.0009) [2023-12-26 09:26:52,595][123091] Updated weights for policy 0, policy_version 1234387 (0.0007) [2023-12-26 09:26:52,597][123090] Updated weights for policy 1, policy_version 1225780 (0.0010) [2023-12-26 09:26:52,656][123091] Updated weights for policy 0, policy_version 1234397 (0.0008) [2023-12-26 09:26:52,658][123090] Updated weights for policy 1, policy_version 1225790 (0.0009) [2023-12-26 09:26:52,724][123091] Updated weights for policy 0, policy_version 1234407 (0.0010) [2023-12-26 09:26:53,401][123090] Updated weights for policy 1, policy_version 1225800 (0.0006) [2023-12-26 09:26:53,452][123090] Updated weights for policy 1, policy_version 1225810 (0.0005) [2023-12-26 09:26:53,479][123091] Updated weights for policy 0, policy_version 1234417 (0.0006) [2023-12-26 09:26:53,509][123090] Updated weights for policy 1, policy_version 1225820 (0.0005) [2023-12-26 09:26:53,535][123091] Updated weights for policy 0, policy_version 1234427 (0.0005) [2023-12-26 09:26:53,589][123091] Updated weights for policy 0, policy_version 1234437 (0.0005) [2023-12-26 09:26:53,642][123091] Updated weights for policy 0, policy_version 1234447 (0.0005) [2023-12-26 09:26:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 629833728. Throughput: 0: 9064.0, 1: 8796.0. Samples: 629804848. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:53,785][121949] Avg episode reward: [(0, '6138.705'), (1, '5155.127')] [2023-12-26 09:26:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001234448_316022784.pth... [2023-12-26 09:26:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001225824_313810944.pth... [2023-12-26 09:26:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001233392_315752448.pth [2023-12-26 09:26:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001224800_313548800.pth [2023-12-26 09:26:54,150][123090] Updated weights for policy 1, policy_version 1225830 (0.0005) [2023-12-26 09:26:54,212][123090] Updated weights for policy 1, policy_version 1225840 (0.0005) [2023-12-26 09:26:54,272][123090] Updated weights for policy 1, policy_version 1225850 (0.0005) [2023-12-26 09:26:54,351][123091] Updated weights for policy 0, policy_version 1234457 (0.0010) [2023-12-26 09:26:54,422][123091] Updated weights for policy 0, policy_version 1234467 (0.0009) [2023-12-26 09:26:54,479][123091] Updated weights for policy 0, policy_version 1234477 (0.0010) [2023-12-26 09:26:54,943][123090] Updated weights for policy 1, policy_version 1225860 (0.0007) [2023-12-26 09:26:55,013][123090] Updated weights for policy 1, policy_version 1225870 (0.0007) [2023-12-26 09:26:55,079][123090] Updated weights for policy 1, policy_version 1225880 (0.0005) [2023-12-26 09:26:55,340][123091] Updated weights for policy 0, policy_version 1234487 (0.0007) [2023-12-26 09:26:55,399][123091] Updated weights for policy 0, policy_version 1234497 (0.0005) [2023-12-26 09:26:55,453][123091] Updated weights for policy 0, policy_version 1234507 (0.0006) [2023-12-26 09:26:55,686][123090] Updated weights for policy 1, policy_version 1225890 (0.0006) [2023-12-26 09:26:55,740][123090] Updated weights for policy 1, policy_version 1225900 (0.0010) [2023-12-26 09:26:55,795][123090] Updated weights for policy 1, policy_version 1225910 (0.0010) [2023-12-26 09:26:55,846][123090] Updated weights for policy 1, policy_version 1225920 (0.0010) [2023-12-26 09:26:56,122][123091] Updated weights for policy 0, policy_version 1234517 (0.0005) [2023-12-26 09:26:56,169][123091] Updated weights for policy 0, policy_version 1234527 (0.0005) [2023-12-26 09:26:56,222][123091] Updated weights for policy 0, policy_version 1234537 (0.0005) [2023-12-26 09:26:56,583][123090] Updated weights for policy 1, policy_version 1225930 (0.0006) [2023-12-26 09:26:56,638][123090] Updated weights for policy 1, policy_version 1225940 (0.0010) [2023-12-26 09:26:56,688][123090] Updated weights for policy 1, policy_version 1225950 (0.0010) [2023-12-26 09:26:56,937][123091] Updated weights for policy 0, policy_version 1234547 (0.0005) [2023-12-26 09:26:56,991][123091] Updated weights for policy 0, policy_version 1234557 (0.0005) [2023-12-26 09:26:57,040][123091] Updated weights for policy 0, policy_version 1234567 (0.0005) [2023-12-26 09:26:57,422][123090] Updated weights for policy 1, policy_version 1225960 (0.0006) [2023-12-26 09:26:57,480][123090] Updated weights for policy 1, policy_version 1225970 (0.0005) [2023-12-26 09:26:57,536][123090] Updated weights for policy 1, policy_version 1225980 (0.0005) [2023-12-26 09:26:57,713][123091] Updated weights for policy 0, policy_version 1234577 (0.0005) [2023-12-26 09:26:57,768][123091] Updated weights for policy 0, policy_version 1234587 (0.0007) [2023-12-26 09:26:57,823][123091] Updated weights for policy 0, policy_version 1234597 (0.0009) [2023-12-26 09:26:57,886][123091] Updated weights for policy 0, policy_version 1234607 (0.0008) [2023-12-26 09:26:58,349][123090] Updated weights for policy 1, policy_version 1225990 (0.0010) [2023-12-26 09:26:58,419][123090] Updated weights for policy 1, policy_version 1226000 (0.0009) [2023-12-26 09:26:58,488][123090] Updated weights for policy 1, policy_version 1226010 (0.0010) [2023-12-26 09:26:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.9, 300 sec: 17744.7). Total num frames: 629923840. Throughput: 0: 9161.1, 1: 8940.5. Samples: 629920460. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:26:58,785][121949] Avg episode reward: [(0, '6310.252'), (1, '5078.754')] [2023-12-26 09:26:58,807][123091] Updated weights for policy 0, policy_version 1234617 (0.0009) [2023-12-26 09:26:58,874][123091] Updated weights for policy 0, policy_version 1234627 (0.0010) [2023-12-26 09:26:58,939][123091] Updated weights for policy 0, policy_version 1234637 (0.0011) [2023-12-26 09:26:59,455][123090] Updated weights for policy 1, policy_version 1226020 (0.0010) [2023-12-26 09:26:59,510][123090] Updated weights for policy 1, policy_version 1226030 (0.0010) [2023-12-26 09:26:59,562][123090] Updated weights for policy 1, policy_version 1226040 (0.0010) [2023-12-26 09:26:59,656][123091] Updated weights for policy 0, policy_version 1234647 (0.0010) [2023-12-26 09:26:59,700][123091] Updated weights for policy 0, policy_version 1234657 (0.0010) [2023-12-26 09:26:59,748][123091] Updated weights for policy 0, policy_version 1234667 (0.0010) [2023-12-26 09:27:00,397][123090] Updated weights for policy 1, policy_version 1226050 (0.0010) [2023-12-26 09:27:00,469][123090] Updated weights for policy 1, policy_version 1226060 (0.0010) [2023-12-26 09:27:00,540][123090] Updated weights for policy 1, policy_version 1226070 (0.0009) [2023-12-26 09:27:00,572][123091] Updated weights for policy 0, policy_version 1234677 (0.0008) [2023-12-26 09:27:00,597][123090] Updated weights for policy 1, policy_version 1226080 (0.0009) [2023-12-26 09:27:00,629][123091] Updated weights for policy 0, policy_version 1234687 (0.0009) [2023-12-26 09:27:00,684][123091] Updated weights for policy 0, policy_version 1234697 (0.0010) [2023-12-26 09:27:01,389][123091] Updated weights for policy 0, policy_version 1234707 (0.0009) [2023-12-26 09:27:01,455][123091] Updated weights for policy 0, policy_version 1234717 (0.0010) [2023-12-26 09:27:01,504][123090] Updated weights for policy 1, policy_version 1226090 (0.0009) [2023-12-26 09:27:01,514][123091] Updated weights for policy 0, policy_version 1234727 (0.0010) [2023-12-26 09:27:01,566][123090] Updated weights for policy 1, policy_version 1226100 (0.0006) [2023-12-26 09:27:01,635][123090] Updated weights for policy 1, policy_version 1226110 (0.0009) [2023-12-26 09:27:02,297][123091] Updated weights for policy 0, policy_version 1234737 (0.0010) [2023-12-26 09:27:02,371][123091] Updated weights for policy 0, policy_version 1234747 (0.0007) [2023-12-26 09:27:02,441][123091] Updated weights for policy 0, policy_version 1234757 (0.0008) [2023-12-26 09:27:02,489][123090] Updated weights for policy 1, policy_version 1226120 (0.0009) [2023-12-26 09:27:02,498][123091] Updated weights for policy 0, policy_version 1234767 (0.0009) [2023-12-26 09:27:02,554][123090] Updated weights for policy 1, policy_version 1226130 (0.0008) [2023-12-26 09:27:02,607][123090] Updated weights for policy 1, policy_version 1226140 (0.0008) [2023-12-26 09:27:03,276][123091] Updated weights for policy 0, policy_version 1234777 (0.0010) [2023-12-26 09:27:03,326][123091] Updated weights for policy 0, policy_version 1234787 (0.0010) [2023-12-26 09:27:03,358][123090] Updated weights for policy 1, policy_version 1226150 (0.0009) [2023-12-26 09:27:03,377][123091] Updated weights for policy 0, policy_version 1234797 (0.0010) [2023-12-26 09:27:03,411][123090] Updated weights for policy 1, policy_version 1226160 (0.0007) [2023-12-26 09:27:03,463][123090] Updated weights for policy 1, policy_version 1226170 (0.0009) [2023-12-26 09:27:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 630013952. Throughput: 0: 9084.2, 1: 8850.0. Samples: 630023324. Policy #0 lag: (min: 14.0, avg: 14.0, max: 15.0) [2023-12-26 09:27:03,785][121949] Avg episode reward: [(0, '6315.372'), (1, '5261.506')] [2023-12-26 09:27:04,139][123091] Updated weights for policy 0, policy_version 1234807 (0.0009) [2023-12-26 09:27:04,203][123091] Updated weights for policy 0, policy_version 1234817 (0.0008) [2023-12-26 09:27:04,281][123091] Updated weights for policy 0, policy_version 1234827 (0.0010) [2023-12-26 09:27:04,330][123090] Updated weights for policy 1, policy_version 1226180 (0.0008) [2023-12-26 09:27:04,403][123090] Updated weights for policy 1, policy_version 1226190 (0.0009) [2023-12-26 09:27:04,477][123090] Updated weights for policy 1, policy_version 1226200 (0.0011) [2023-12-26 09:27:04,951][123091] Updated weights for policy 0, policy_version 1234837 (0.0009) [2023-12-26 09:27:05,010][123091] Updated weights for policy 0, policy_version 1234847 (0.0006) [2023-12-26 09:27:05,071][123091] Updated weights for policy 0, policy_version 1234857 (0.0011) [2023-12-26 09:27:05,226][123090] Updated weights for policy 1, policy_version 1226210 (0.0010) [2023-12-26 09:27:05,282][123090] Updated weights for policy 1, policy_version 1226220 (0.0009) [2023-12-26 09:27:05,340][123090] Updated weights for policy 1, policy_version 1226230 (0.0006) [2023-12-26 09:27:05,406][123090] Updated weights for policy 1, policy_version 1226240 (0.0005) [2023-12-26 09:27:05,794][123091] Updated weights for policy 0, policy_version 1234867 (0.0010) [2023-12-26 09:27:05,848][123091] Updated weights for policy 0, policy_version 1234877 (0.0012) [2023-12-26 09:27:05,903][123091] Updated weights for policy 0, policy_version 1234887 (0.0011) [2023-12-26 09:27:06,148][123090] Updated weights for policy 1, policy_version 1226250 (0.0015) [2023-12-26 09:27:06,217][123090] Updated weights for policy 1, policy_version 1226260 (0.0008) [2023-12-26 09:27:06,285][123090] Updated weights for policy 1, policy_version 1226270 (0.0009) [2023-12-26 09:27:06,721][123091] Updated weights for policy 0, policy_version 1234897 (0.0010) [2023-12-26 09:27:06,777][123091] Updated weights for policy 0, policy_version 1234907 (0.0011) [2023-12-26 09:27:06,833][123091] Updated weights for policy 0, policy_version 1234917 (0.0011) [2023-12-26 09:27:06,895][123091] Updated weights for policy 0, policy_version 1234927 (0.0010) [2023-12-26 09:27:07,048][123090] Updated weights for policy 1, policy_version 1226280 (0.0006) [2023-12-26 09:27:07,105][123090] Updated weights for policy 1, policy_version 1226290 (0.0005) [2023-12-26 09:27:07,153][123090] Updated weights for policy 1, policy_version 1226300 (0.0005) [2023-12-26 09:27:07,696][123091] Updated weights for policy 0, policy_version 1234937 (0.0011) [2023-12-26 09:27:07,756][123091] Updated weights for policy 0, policy_version 1234947 (0.0011) [2023-12-26 09:27:07,802][123091] Updated weights for policy 0, policy_version 1234957 (0.0010) [2023-12-26 09:27:07,968][123090] Updated weights for policy 1, policy_version 1226310 (0.0009) [2023-12-26 09:27:08,031][123090] Updated weights for policy 1, policy_version 1226320 (0.0010) [2023-12-26 09:27:08,091][123090] Updated weights for policy 1, policy_version 1226330 (0.0011) [2023-12-26 09:27:08,549][123091] Updated weights for policy 0, policy_version 1234967 (0.0009) [2023-12-26 09:27:08,604][123091] Updated weights for policy 0, policy_version 1234977 (0.0010) [2023-12-26 09:27:08,663][123091] Updated weights for policy 0, policy_version 1234987 (0.0010) [2023-12-26 09:27:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 630104064. Throughput: 0: 9119.5, 1: 8836.9. Samples: 630078064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:08,785][121949] Avg episode reward: [(0, '6204.477'), (1, '5114.350')] [2023-12-26 09:27:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001226336_313942016.pth... [2023-12-26 09:27:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001234992_316162048.pth... [2023-12-26 09:27:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001225312_313679872.pth [2023-12-26 09:27:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001233904_315883520.pth [2023-12-26 09:27:08,901][123090] Updated weights for policy 1, policy_version 1226340 (0.0010) [2023-12-26 09:27:08,955][123090] Updated weights for policy 1, policy_version 1226350 (0.0009) [2023-12-26 09:27:09,005][123090] Updated weights for policy 1, policy_version 1226360 (0.0009) [2023-12-26 09:27:09,511][123091] Updated weights for policy 0, policy_version 1234997 (0.0009) [2023-12-26 09:27:09,585][123091] Updated weights for policy 0, policy_version 1235007 (0.0009) [2023-12-26 09:27:09,656][123091] Updated weights for policy 0, policy_version 1235017 (0.0010) [2023-12-26 09:27:09,892][123090] Updated weights for policy 1, policy_version 1226371 (0.0010) [2023-12-26 09:27:09,959][123090] Updated weights for policy 1, policy_version 1226381 (0.0009) [2023-12-26 09:27:10,020][123090] Updated weights for policy 1, policy_version 1226391 (0.0010) [2023-12-26 09:27:10,506][123091] Updated weights for policy 0, policy_version 1235027 (0.0009) [2023-12-26 09:27:10,564][123091] Updated weights for policy 0, policy_version 1235037 (0.0006) [2023-12-26 09:27:10,635][123091] Updated weights for policy 0, policy_version 1235047 (0.0005) [2023-12-26 09:27:10,849][123090] Updated weights for policy 1, policy_version 1226401 (0.0010) [2023-12-26 09:27:10,906][123090] Updated weights for policy 1, policy_version 1226411 (0.0009) [2023-12-26 09:27:10,967][123090] Updated weights for policy 1, policy_version 1226421 (0.0009) [2023-12-26 09:27:11,022][123090] Updated weights for policy 1, policy_version 1226431 (0.0008) [2023-12-26 09:27:11,465][123091] Updated weights for policy 0, policy_version 1235057 (0.0006) [2023-12-26 09:27:11,534][123091] Updated weights for policy 0, policy_version 1235067 (0.0008) [2023-12-26 09:27:11,610][123091] Updated weights for policy 0, policy_version 1235077 (0.0008) [2023-12-26 09:27:11,672][123091] Updated weights for policy 0, policy_version 1235087 (0.0008) [2023-12-26 09:27:11,873][123090] Updated weights for policy 1, policy_version 1226441 (0.0009) [2023-12-26 09:27:11,927][123090] Updated weights for policy 1, policy_version 1226451 (0.0008) [2023-12-26 09:27:11,982][123090] Updated weights for policy 1, policy_version 1226461 (0.0008) [2023-12-26 09:27:12,414][123091] Updated weights for policy 0, policy_version 1235097 (0.0008) [2023-12-26 09:27:12,478][123091] Updated weights for policy 0, policy_version 1235107 (0.0009) [2023-12-26 09:27:12,546][123091] Updated weights for policy 0, policy_version 1235117 (0.0010) [2023-12-26 09:27:12,855][123090] Updated weights for policy 1, policy_version 1226471 (0.0009) [2023-12-26 09:27:12,921][123090] Updated weights for policy 1, policy_version 1226481 (0.0009) [2023-12-26 09:27:12,987][123090] Updated weights for policy 1, policy_version 1226491 (0.0010) [2023-12-26 09:27:13,319][123091] Updated weights for policy 0, policy_version 1235127 (0.0007) [2023-12-26 09:27:13,385][123091] Updated weights for policy 0, policy_version 1235137 (0.0010) [2023-12-26 09:27:13,437][123091] Updated weights for policy 0, policy_version 1235147 (0.0006) [2023-12-26 09:27:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 630185984. Throughput: 0: 9071.5, 1: 8703.3. Samples: 630181588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:13,785][121949] Avg episode reward: [(0, '6198.450'), (1, '5063.111')] [2023-12-26 09:27:13,883][123090] Updated weights for policy 1, policy_version 1226501 (0.0010) [2023-12-26 09:27:13,936][123090] Updated weights for policy 1, policy_version 1226511 (0.0009) [2023-12-26 09:27:13,990][123090] Updated weights for policy 1, policy_version 1226522 (0.0010) [2023-12-26 09:27:14,149][123091] Updated weights for policy 0, policy_version 1235157 (0.0005) [2023-12-26 09:27:14,219][123091] Updated weights for policy 0, policy_version 1235167 (0.0006) [2023-12-26 09:27:14,288][123091] Updated weights for policy 0, policy_version 1235177 (0.0005) [2023-12-26 09:27:14,826][123090] Updated weights for policy 1, policy_version 1226532 (0.0010) [2023-12-26 09:27:14,871][123091] Updated weights for policy 0, policy_version 1235187 (0.0006) [2023-12-26 09:27:14,903][123090] Updated weights for policy 1, policy_version 1226542 (0.0008) [2023-12-26 09:27:14,939][123091] Updated weights for policy 0, policy_version 1235197 (0.0008) [2023-12-26 09:27:14,976][123090] Updated weights for policy 1, policy_version 1226552 (0.0008) [2023-12-26 09:27:15,010][123091] Updated weights for policy 0, policy_version 1235207 (0.0008) [2023-12-26 09:27:15,688][123090] Updated weights for policy 1, policy_version 1226562 (0.0007) [2023-12-26 09:27:15,752][123090] Updated weights for policy 1, policy_version 1226572 (0.0008) [2023-12-26 09:27:15,793][123091] Updated weights for policy 0, policy_version 1235217 (0.0009) [2023-12-26 09:27:15,811][123090] Updated weights for policy 1, policy_version 1226582 (0.0010) [2023-12-26 09:27:15,844][123091] Updated weights for policy 0, policy_version 1235227 (0.0010) [2023-12-26 09:27:15,864][123090] Updated weights for policy 1, policy_version 1226592 (0.0006) [2023-12-26 09:27:15,895][123091] Updated weights for policy 0, policy_version 1235237 (0.0010) [2023-12-26 09:27:15,957][123091] Updated weights for policy 0, policy_version 1235247 (0.0010) [2023-12-26 09:27:16,548][123090] Updated weights for policy 1, policy_version 1226602 (0.0008) [2023-12-26 09:27:16,612][123090] Updated weights for policy 1, policy_version 1226612 (0.0008) [2023-12-26 09:27:16,677][123090] Updated weights for policy 1, policy_version 1226622 (0.0008) [2023-12-26 09:27:16,795][123091] Updated weights for policy 0, policy_version 1235257 (0.0006) [2023-12-26 09:27:16,845][123091] Updated weights for policy 0, policy_version 1235267 (0.0005) [2023-12-26 09:27:16,899][123091] Updated weights for policy 0, policy_version 1235277 (0.0005) [2023-12-26 09:27:17,451][123090] Updated weights for policy 1, policy_version 1226632 (0.0008) [2023-12-26 09:27:17,516][123090] Updated weights for policy 1, policy_version 1226642 (0.0009) [2023-12-26 09:27:17,579][123090] Updated weights for policy 1, policy_version 1226652 (0.0009) [2023-12-26 09:27:17,590][123091] Updated weights for policy 0, policy_version 1235287 (0.0008) [2023-12-26 09:27:17,654][123091] Updated weights for policy 0, policy_version 1235297 (0.0009) [2023-12-26 09:27:17,719][123091] Updated weights for policy 0, policy_version 1235307 (0.0005) [2023-12-26 09:27:18,361][123091] Updated weights for policy 0, policy_version 1235317 (0.0006) [2023-12-26 09:27:18,413][123091] Updated weights for policy 0, policy_version 1235327 (0.0007) [2023-12-26 09:27:18,428][123090] Updated weights for policy 1, policy_version 1226662 (0.0008) [2023-12-26 09:27:18,475][123091] Updated weights for policy 0, policy_version 1235337 (0.0009) [2023-12-26 09:27:18,486][123090] Updated weights for policy 1, policy_version 1226672 (0.0009) [2023-12-26 09:27:18,543][123090] Updated weights for policy 1, policy_version 1226682 (0.0009) [2023-12-26 09:27:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 630284288. Throughput: 0: 9196.3, 1: 8699.2. Samples: 630292332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:18,785][121949] Avg episode reward: [(0, '6298.293'), (1, '5088.514')] [2023-12-26 09:27:19,419][123091] Updated weights for policy 0, policy_version 1235347 (0.0009) [2023-12-26 09:27:19,428][123090] Updated weights for policy 1, policy_version 1226692 (0.0010) [2023-12-26 09:27:19,491][123091] Updated weights for policy 0, policy_version 1235357 (0.0007) [2023-12-26 09:27:19,498][123090] Updated weights for policy 1, policy_version 1226702 (0.0011) [2023-12-26 09:27:19,559][123091] Updated weights for policy 0, policy_version 1235367 (0.0009) [2023-12-26 09:27:19,560][123090] Updated weights for policy 1, policy_version 1226712 (0.0011) [2023-12-26 09:27:20,263][123091] Updated weights for policy 0, policy_version 1235377 (0.0007) [2023-12-26 09:27:20,333][123091] Updated weights for policy 0, policy_version 1235387 (0.0005) [2023-12-26 09:27:20,397][123090] Updated weights for policy 1, policy_version 1226722 (0.0011) [2023-12-26 09:27:20,403][123091] Updated weights for policy 0, policy_version 1235397 (0.0006) [2023-12-26 09:27:20,459][123090] Updated weights for policy 1, policy_version 1226732 (0.0007) [2023-12-26 09:27:20,459][123091] Updated weights for policy 0, policy_version 1235407 (0.0006) [2023-12-26 09:27:20,507][123090] Updated weights for policy 1, policy_version 1226742 (0.0006) [2023-12-26 09:27:20,575][123090] Updated weights for policy 1, policy_version 1226752 (0.0007) [2023-12-26 09:27:21,164][123091] Updated weights for policy 0, policy_version 1235417 (0.0010) [2023-12-26 09:27:21,228][123091] Updated weights for policy 0, policy_version 1235427 (0.0011) [2023-12-26 09:27:21,298][123091] Updated weights for policy 0, policy_version 1235437 (0.0011) [2023-12-26 09:27:21,407][123090] Updated weights for policy 1, policy_version 1226762 (0.0013) [2023-12-26 09:27:21,481][123090] Updated weights for policy 1, policy_version 1226772 (0.0009) [2023-12-26 09:27:21,551][123090] Updated weights for policy 1, policy_version 1226782 (0.0010) [2023-12-26 09:27:22,164][123091] Updated weights for policy 0, policy_version 1235447 (0.0010) [2023-12-26 09:27:22,217][123091] Updated weights for policy 0, policy_version 1235457 (0.0009) [2023-12-26 09:27:22,280][123091] Updated weights for policy 0, policy_version 1235467 (0.0010) [2023-12-26 09:27:22,411][123090] Updated weights for policy 1, policy_version 1226792 (0.0007) [2023-12-26 09:27:22,475][123090] Updated weights for policy 1, policy_version 1226802 (0.0006) [2023-12-26 09:27:22,543][123090] Updated weights for policy 1, policy_version 1226812 (0.0008) [2023-12-26 09:27:23,209][123091] Updated weights for policy 0, policy_version 1235477 (0.0009) [2023-12-26 09:27:23,260][123090] Updated weights for policy 1, policy_version 1226822 (0.0009) [2023-12-26 09:27:23,265][123091] Updated weights for policy 0, policy_version 1235487 (0.0009) [2023-12-26 09:27:23,314][123091] Updated weights for policy 0, policy_version 1235497 (0.0008) [2023-12-26 09:27:23,325][123090] Updated weights for policy 1, policy_version 1226832 (0.0009) [2023-12-26 09:27:23,393][123090] Updated weights for policy 1, policy_version 1226842 (0.0011) [2023-12-26 09:27:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 630366208. Throughput: 0: 9107.6, 1: 8696.1. Samples: 630343424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:23,785][121949] Avg episode reward: [(0, '6193.981'), (1, '5060.241')] [2023-12-26 09:27:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001235504_316293120.pth... [2023-12-26 09:27:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001226848_314073088.pth... [2023-12-26 09:27:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001234448_316022784.pth [2023-12-26 09:27:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001225824_313810944.pth [2023-12-26 09:27:24,081][123091] Updated weights for policy 0, policy_version 1235507 (0.0008) [2023-12-26 09:27:24,131][123090] Updated weights for policy 1, policy_version 1226852 (0.0010) [2023-12-26 09:27:24,138][123091] Updated weights for policy 0, policy_version 1235517 (0.0008) [2023-12-26 09:27:24,181][123090] Updated weights for policy 1, policy_version 1226862 (0.0006) [2023-12-26 09:27:24,196][123091] Updated weights for policy 0, policy_version 1235527 (0.0008) [2023-12-26 09:27:24,236][123090] Updated weights for policy 1, policy_version 1226872 (0.0006) [2023-12-26 09:27:24,895][123090] Updated weights for policy 1, policy_version 1226882 (0.0006) [2023-12-26 09:27:24,943][123090] Updated weights for policy 1, policy_version 1226892 (0.0005) [2023-12-26 09:27:25,005][123090] Updated weights for policy 1, policy_version 1226902 (0.0005) [2023-12-26 09:27:25,067][123090] Updated weights for policy 1, policy_version 1226912 (0.0005) [2023-12-26 09:27:25,119][123091] Updated weights for policy 0, policy_version 1235537 (0.0009) [2023-12-26 09:27:25,187][123091] Updated weights for policy 0, policy_version 1235547 (0.0010) [2023-12-26 09:27:25,240][123091] Updated weights for policy 0, policy_version 1235557 (0.0009) [2023-12-26 09:27:25,298][123091] Updated weights for policy 0, policy_version 1235567 (0.0009) [2023-12-26 09:27:25,803][123090] Updated weights for policy 1, policy_version 1226922 (0.0006) [2023-12-26 09:27:25,860][123090] Updated weights for policy 1, policy_version 1226932 (0.0005) [2023-12-26 09:27:25,914][123090] Updated weights for policy 1, policy_version 1226942 (0.0005) [2023-12-26 09:27:26,072][123091] Updated weights for policy 0, policy_version 1235577 (0.0010) [2023-12-26 09:27:26,126][123091] Updated weights for policy 0, policy_version 1235588 (0.0010) [2023-12-26 09:27:26,180][123091] Updated weights for policy 0, policy_version 1235598 (0.0010) [2023-12-26 09:27:26,509][123090] Updated weights for policy 1, policy_version 1226952 (0.0005) [2023-12-26 09:27:26,571][123090] Updated weights for policy 1, policy_version 1226962 (0.0005) [2023-12-26 09:27:26,619][123090] Updated weights for policy 1, policy_version 1226972 (0.0008) [2023-12-26 09:27:27,073][123091] Updated weights for policy 0, policy_version 1235608 (0.0009) [2023-12-26 09:27:27,139][123091] Updated weights for policy 0, policy_version 1235618 (0.0009) [2023-12-26 09:27:27,197][123091] Updated weights for policy 0, policy_version 1235628 (0.0009) [2023-12-26 09:27:27,433][123090] Updated weights for policy 1, policy_version 1226982 (0.0009) [2023-12-26 09:27:27,498][123090] Updated weights for policy 1, policy_version 1226992 (0.0005) [2023-12-26 09:27:27,561][123090] Updated weights for policy 1, policy_version 1227002 (0.0005) [2023-12-26 09:27:28,066][123091] Updated weights for policy 0, policy_version 1235638 (0.0009) [2023-12-26 09:27:28,122][123091] Updated weights for policy 0, policy_version 1235648 (0.0009) [2023-12-26 09:27:28,129][123090] Updated weights for policy 1, policy_version 1227012 (0.0007) [2023-12-26 09:27:28,170][123091] Updated weights for policy 0, policy_version 1235658 (0.0006) [2023-12-26 09:27:28,187][123090] Updated weights for policy 1, policy_version 1227022 (0.0010) [2023-12-26 09:27:28,233][123090] Updated weights for policy 1, policy_version 1227032 (0.0010) [2023-12-26 09:27:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 630456320. Throughput: 0: 9076.5, 1: 8849.6. Samples: 630451584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:28,785][121949] Avg episode reward: [(0, '6180.695'), (1, '5141.761')] [2023-12-26 09:27:29,010][123091] Updated weights for policy 0, policy_version 1235668 (0.0009) [2023-12-26 09:27:29,032][123090] Updated weights for policy 1, policy_version 1227042 (0.0010) [2023-12-26 09:27:29,075][123091] Updated weights for policy 0, policy_version 1235678 (0.0010) [2023-12-26 09:27:29,088][123090] Updated weights for policy 1, policy_version 1227052 (0.0010) [2023-12-26 09:27:29,129][123091] Updated weights for policy 0, policy_version 1235688 (0.0008) [2023-12-26 09:27:29,135][123090] Updated weights for policy 1, policy_version 1227062 (0.0010) [2023-12-26 09:27:29,194][123090] Updated weights for policy 1, policy_version 1227072 (0.0010) [2023-12-26 09:27:29,935][123090] Updated weights for policy 1, policy_version 1227082 (0.0006) [2023-12-26 09:27:29,990][123091] Updated weights for policy 0, policy_version 1235698 (0.0006) [2023-12-26 09:27:30,000][123090] Updated weights for policy 1, policy_version 1227092 (0.0007) [2023-12-26 09:27:30,048][123090] Updated weights for policy 1, policy_version 1227102 (0.0007) [2023-12-26 09:27:30,049][123091] Updated weights for policy 0, policy_version 1235708 (0.0008) [2023-12-26 09:27:30,112][123091] Updated weights for policy 0, policy_version 1235718 (0.0008) [2023-12-26 09:27:30,167][123091] Updated weights for policy 0, policy_version 1235728 (0.0008) [2023-12-26 09:27:30,718][123090] Updated weights for policy 1, policy_version 1227112 (0.0005) [2023-12-26 09:27:30,782][123090] Updated weights for policy 1, policy_version 1227122 (0.0007) [2023-12-26 09:27:30,845][123090] Updated weights for policy 1, policy_version 1227132 (0.0006) [2023-12-26 09:27:30,985][123091] Updated weights for policy 0, policy_version 1235738 (0.0010) [2023-12-26 09:27:31,038][123091] Updated weights for policy 0, policy_version 1235748 (0.0009) [2023-12-26 09:27:31,105][123091] Updated weights for policy 0, policy_version 1235758 (0.0010) [2023-12-26 09:27:31,542][123090] Updated weights for policy 1, policy_version 1227142 (0.0007) [2023-12-26 09:27:31,597][123090] Updated weights for policy 1, policy_version 1227152 (0.0008) [2023-12-26 09:27:31,670][123090] Updated weights for policy 1, policy_version 1227162 (0.0008) [2023-12-26 09:27:32,030][123091] Updated weights for policy 0, policy_version 1235768 (0.0006) [2023-12-26 09:27:32,080][123091] Updated weights for policy 0, policy_version 1235778 (0.0006) [2023-12-26 09:27:32,132][123091] Updated weights for policy 0, policy_version 1235788 (0.0006) [2023-12-26 09:27:32,509][123090] Updated weights for policy 1, policy_version 1227172 (0.0008) [2023-12-26 09:27:32,565][123090] Updated weights for policy 1, policy_version 1227182 (0.0008) [2023-12-26 09:27:32,617][123090] Updated weights for policy 1, policy_version 1227192 (0.0007) [2023-12-26 09:27:32,964][123091] Updated weights for policy 0, policy_version 1235798 (0.0008) [2023-12-26 09:27:33,021][123091] Updated weights for policy 0, policy_version 1235810 (0.0010) [2023-12-26 09:27:33,070][123091] Updated weights for policy 0, policy_version 1235820 (0.0009) [2023-12-26 09:27:33,353][123090] Updated weights for policy 1, policy_version 1227202 (0.0006) [2023-12-26 09:27:33,414][123090] Updated weights for policy 1, policy_version 1227212 (0.0008) [2023-12-26 09:27:33,478][123090] Updated weights for policy 1, policy_version 1227222 (0.0009) [2023-12-26 09:27:33,543][123090] Updated weights for policy 1, policy_version 1227232 (0.0009) [2023-12-26 09:27:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 630546432. Throughput: 0: 8985.9, 1: 8925.8. Samples: 630557752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:33,785][121949] Avg episode reward: [(0, '6215.045'), (1, '4695.936')] [2023-12-26 09:27:33,975][123091] Updated weights for policy 0, policy_version 1235830 (0.0009) [2023-12-26 09:27:34,032][123091] Updated weights for policy 0, policy_version 1235842 (0.0009) [2023-12-26 09:27:34,084][123091] Updated weights for policy 0, policy_version 1235853 (0.0009) [2023-12-26 09:27:34,286][123090] Updated weights for policy 1, policy_version 1227242 (0.0010) [2023-12-26 09:27:34,346][123090] Updated weights for policy 1, policy_version 1227252 (0.0010) [2023-12-26 09:27:34,414][123090] Updated weights for policy 1, policy_version 1227262 (0.0010) [2023-12-26 09:27:34,957][123091] Updated weights for policy 0, policy_version 1235863 (0.0010) [2023-12-26 09:27:35,021][123091] Updated weights for policy 0, policy_version 1235873 (0.0009) [2023-12-26 09:27:35,077][123091] Updated weights for policy 0, policy_version 1235883 (0.0009) [2023-12-26 09:27:35,235][123090] Updated weights for policy 1, policy_version 1227272 (0.0009) [2023-12-26 09:27:35,279][123090] Updated weights for policy 1, policy_version 1227282 (0.0007) [2023-12-26 09:27:35,326][123090] Updated weights for policy 1, policy_version 1227292 (0.0009) [2023-12-26 09:27:35,962][123091] Updated weights for policy 0, policy_version 1235893 (0.0009) [2023-12-26 09:27:36,017][123091] Updated weights for policy 0, policy_version 1235903 (0.0009) [2023-12-26 09:27:36,022][123090] Updated weights for policy 1, policy_version 1227302 (0.0007) [2023-12-26 09:27:36,072][123090] Updated weights for policy 1, policy_version 1227312 (0.0005) [2023-12-26 09:27:36,075][123091] Updated weights for policy 0, policy_version 1235913 (0.0009) [2023-12-26 09:27:36,136][123090] Updated weights for policy 1, policy_version 1227322 (0.0008) [2023-12-26 09:27:36,915][123090] Updated weights for policy 1, policy_version 1227332 (0.0009) [2023-12-26 09:27:36,949][123091] Updated weights for policy 0, policy_version 1235923 (0.0010) [2023-12-26 09:27:36,986][123090] Updated weights for policy 1, policy_version 1227342 (0.0008) [2023-12-26 09:27:37,010][123091] Updated weights for policy 0, policy_version 1235933 (0.0009) [2023-12-26 09:27:37,054][123090] Updated weights for policy 1, policy_version 1227352 (0.0008) [2023-12-26 09:27:37,063][123091] Updated weights for policy 0, policy_version 1235943 (0.0009) [2023-12-26 09:27:37,803][123090] Updated weights for policy 1, policy_version 1227362 (0.0007) [2023-12-26 09:27:37,870][123090] Updated weights for policy 1, policy_version 1227372 (0.0008) [2023-12-26 09:27:37,907][123091] Updated weights for policy 0, policy_version 1235953 (0.0009) [2023-12-26 09:27:37,934][123090] Updated weights for policy 1, policy_version 1227382 (0.0005) [2023-12-26 09:27:37,968][123091] Updated weights for policy 0, policy_version 1235963 (0.0009) [2023-12-26 09:27:37,992][123090] Updated weights for policy 1, policy_version 1227392 (0.0005) [2023-12-26 09:27:38,024][123091] Updated weights for policy 0, policy_version 1235973 (0.0009) [2023-12-26 09:27:38,085][123091] Updated weights for policy 0, policy_version 1235983 (0.0010) [2023-12-26 09:27:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 630628352. Throughput: 0: 8888.0, 1: 9011.5. Samples: 630610328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:38,785][121949] Avg episode reward: [(0, '6361.104'), (1, '4078.527')] [2023-12-26 09:27:38,788][123090] Updated weights for policy 1, policy_version 1227402 (0.0011) [2023-12-26 09:27:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001235984_316416000.pth... [2023-12-26 09:27:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001234992_316162048.pth [2023-12-26 09:27:38,840][123090] Updated weights for policy 1, policy_version 1227412 (0.0010) [2023-12-26 09:27:38,892][123090] Updated weights for policy 1, policy_version 1227422 (0.0010) [2023-12-26 09:27:38,903][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001227424_314220544.pth... [2023-12-26 09:27:38,908][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001226336_313942016.pth [2023-12-26 09:27:38,934][123091] Updated weights for policy 0, policy_version 1235993 (0.0009) [2023-12-26 09:27:38,982][123091] Updated weights for policy 0, policy_version 1236003 (0.0008) [2023-12-26 09:27:39,029][123091] Updated weights for policy 0, policy_version 1236013 (0.0009) [2023-12-26 09:27:39,773][123090] Updated weights for policy 1, policy_version 1227432 (0.0011) [2023-12-26 09:27:39,842][123090] Updated weights for policy 1, policy_version 1227442 (0.0010) [2023-12-26 09:27:39,905][123090] Updated weights for policy 1, policy_version 1227452 (0.0011) [2023-12-26 09:27:39,943][123091] Updated weights for policy 0, policy_version 1236023 (0.0009) [2023-12-26 09:27:40,000][123091] Updated weights for policy 0, policy_version 1236033 (0.0008) [2023-12-26 09:27:40,055][123091] Updated weights for policy 0, policy_version 1236043 (0.0008) [2023-12-26 09:27:40,727][123090] Updated weights for policy 1, policy_version 1227462 (0.0011) [2023-12-26 09:27:40,775][123091] Updated weights for policy 0, policy_version 1236053 (0.0009) [2023-12-26 09:27:40,783][123090] Updated weights for policy 1, policy_version 1227472 (0.0006) [2023-12-26 09:27:40,832][123091] Updated weights for policy 0, policy_version 1236063 (0.0010) [2023-12-26 09:27:40,839][123090] Updated weights for policy 1, policy_version 1227482 (0.0005) [2023-12-26 09:27:40,885][123091] Updated weights for policy 0, policy_version 1236073 (0.0009) [2023-12-26 09:27:41,630][123090] Updated weights for policy 1, policy_version 1227492 (0.0008) [2023-12-26 09:27:41,662][123091] Updated weights for policy 0, policy_version 1236083 (0.0008) [2023-12-26 09:27:41,697][123090] Updated weights for policy 1, policy_version 1227502 (0.0010) [2023-12-26 09:27:41,727][123091] Updated weights for policy 0, policy_version 1236093 (0.0008) [2023-12-26 09:27:41,773][123090] Updated weights for policy 1, policy_version 1227512 (0.0008) [2023-12-26 09:27:41,801][123091] Updated weights for policy 0, policy_version 1236103 (0.0006) [2023-12-26 09:27:42,492][123090] Updated weights for policy 1, policy_version 1227522 (0.0006) [2023-12-26 09:27:42,552][123090] Updated weights for policy 1, policy_version 1227532 (0.0006) [2023-12-26 09:27:42,562][123091] Updated weights for policy 0, policy_version 1236113 (0.0006) [2023-12-26 09:27:42,610][123090] Updated weights for policy 1, policy_version 1227542 (0.0005) [2023-12-26 09:27:42,623][123091] Updated weights for policy 0, policy_version 1236123 (0.0009) [2023-12-26 09:27:42,674][123090] Updated weights for policy 1, policy_version 1227552 (0.0007) [2023-12-26 09:27:42,683][123091] Updated weights for policy 0, policy_version 1236133 (0.0010) [2023-12-26 09:27:42,757][123091] Updated weights for policy 0, policy_version 1236143 (0.0010) [2023-12-26 09:27:43,407][123090] Updated weights for policy 1, policy_version 1227562 (0.0006) [2023-12-26 09:27:43,457][123090] Updated weights for policy 1, policy_version 1227572 (0.0006) [2023-12-26 09:27:43,504][123090] Updated weights for policy 1, policy_version 1227582 (0.0009) [2023-12-26 09:27:43,622][123091] Updated weights for policy 0, policy_version 1236153 (0.0006) [2023-12-26 09:27:43,690][123091] Updated weights for policy 0, policy_version 1236163 (0.0009) [2023-12-26 09:27:43,765][123091] Updated weights for policy 0, policy_version 1236173 (0.0010) [2023-12-26 09:27:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.5, 300 sec: 17800.3). Total num frames: 630726656. Throughput: 0: 8768.8, 1: 8905.6. Samples: 630715808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:43,784][121949] Avg episode reward: [(0, '6267.663'), (1, '4284.386')] [2023-12-26 09:27:44,146][123090] Updated weights for policy 1, policy_version 1227592 (0.0006) [2023-12-26 09:27:44,199][123090] Updated weights for policy 1, policy_version 1227602 (0.0006) [2023-12-26 09:27:44,265][123090] Updated weights for policy 1, policy_version 1227612 (0.0005) [2023-12-26 09:27:44,562][123091] Updated weights for policy 0, policy_version 1236183 (0.0009) [2023-12-26 09:27:44,629][123091] Updated weights for policy 0, policy_version 1236193 (0.0010) [2023-12-26 09:27:44,697][123091] Updated weights for policy 0, policy_version 1236203 (0.0009) [2023-12-26 09:27:45,035][123090] Updated weights for policy 1, policy_version 1227622 (0.0008) [2023-12-26 09:27:45,102][123090] Updated weights for policy 1, policy_version 1227632 (0.0010) [2023-12-26 09:27:45,164][123090] Updated weights for policy 1, policy_version 1227642 (0.0010) [2023-12-26 09:27:45,471][123091] Updated weights for policy 0, policy_version 1236213 (0.0008) [2023-12-26 09:27:45,540][123091] Updated weights for policy 0, policy_version 1236223 (0.0007) [2023-12-26 09:27:45,600][123091] Updated weights for policy 0, policy_version 1236234 (0.0010) [2023-12-26 09:27:46,025][123090] Updated weights for policy 1, policy_version 1227652 (0.0008) [2023-12-26 09:27:46,083][123090] Updated weights for policy 1, policy_version 1227662 (0.0005) [2023-12-26 09:27:46,146][123090] Updated weights for policy 1, policy_version 1227672 (0.0005) [2023-12-26 09:27:46,475][123091] Updated weights for policy 0, policy_version 1236244 (0.0009) [2023-12-26 09:27:46,537][123091] Updated weights for policy 0, policy_version 1236254 (0.0010) [2023-12-26 09:27:46,599][123091] Updated weights for policy 0, policy_version 1236264 (0.0011) [2023-12-26 09:27:46,790][123090] Updated weights for policy 1, policy_version 1227682 (0.0006) [2023-12-26 09:27:46,840][123090] Updated weights for policy 1, policy_version 1227692 (0.0010) [2023-12-26 09:27:46,901][123090] Updated weights for policy 1, policy_version 1227702 (0.0010) [2023-12-26 09:27:46,962][123090] Updated weights for policy 1, policy_version 1227712 (0.0010) [2023-12-26 09:27:47,334][123091] Updated weights for policy 0, policy_version 1236274 (0.0007) [2023-12-26 09:27:47,403][123091] Updated weights for policy 0, policy_version 1236284 (0.0008) [2023-12-26 09:27:47,457][123091] Updated weights for policy 0, policy_version 1236294 (0.0010) [2023-12-26 09:27:47,515][123091] Updated weights for policy 0, policy_version 1236304 (0.0010) [2023-12-26 09:27:47,649][123090] Updated weights for policy 1, policy_version 1227722 (0.0005) [2023-12-26 09:27:47,695][123090] Updated weights for policy 1, policy_version 1227732 (0.0005) [2023-12-26 09:27:47,751][123090] Updated weights for policy 1, policy_version 1227742 (0.0005) [2023-12-26 09:27:48,299][123091] Updated weights for policy 0, policy_version 1236314 (0.0005) [2023-12-26 09:27:48,360][123091] Updated weights for policy 0, policy_version 1236324 (0.0012) [2023-12-26 09:27:48,423][123091] Updated weights for policy 0, policy_version 1236334 (0.0006) [2023-12-26 09:27:48,511][123090] Updated weights for policy 1, policy_version 1227752 (0.0008) [2023-12-26 09:27:48,581][123090] Updated weights for policy 1, policy_version 1227762 (0.0009) [2023-12-26 09:27:48,653][123090] Updated weights for policy 1, policy_version 1227772 (0.0010) [2023-12-26 09:27:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 630816768. Throughput: 0: 8744.6, 1: 9082.5. Samples: 630825544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:48,785][121949] Avg episode reward: [(0, '6055.694'), (1, '4802.718')] [2023-12-26 09:27:49,196][123091] Updated weights for policy 0, policy_version 1236344 (0.0008) [2023-12-26 09:27:49,272][123091] Updated weights for policy 0, policy_version 1236354 (0.0007) [2023-12-26 09:27:49,346][123091] Updated weights for policy 0, policy_version 1236364 (0.0007) [2023-12-26 09:27:49,470][123090] Updated weights for policy 1, policy_version 1227782 (0.0011) [2023-12-26 09:27:49,522][123090] Updated weights for policy 1, policy_version 1227792 (0.0010) [2023-12-26 09:27:49,571][123090] Updated weights for policy 1, policy_version 1227802 (0.0010) [2023-12-26 09:27:50,152][123091] Updated weights for policy 0, policy_version 1236374 (0.0007) [2023-12-26 09:27:50,223][123091] Updated weights for policy 0, policy_version 1236384 (0.0008) [2023-12-26 09:27:50,285][123091] Updated weights for policy 0, policy_version 1236394 (0.0011) [2023-12-26 09:27:50,384][123090] Updated weights for policy 1, policy_version 1227812 (0.0011) [2023-12-26 09:27:50,442][123090] Updated weights for policy 1, policy_version 1227822 (0.0011) [2023-12-26 09:27:50,494][123090] Updated weights for policy 1, policy_version 1227832 (0.0010) [2023-12-26 09:27:51,022][123091] Updated weights for policy 0, policy_version 1236404 (0.0009) [2023-12-26 09:27:51,093][123091] Updated weights for policy 0, policy_version 1236414 (0.0007) [2023-12-26 09:27:51,163][123091] Updated weights for policy 0, policy_version 1236424 (0.0006) [2023-12-26 09:27:51,324][123090] Updated weights for policy 1, policy_version 1227842 (0.0010) [2023-12-26 09:27:51,398][123090] Updated weights for policy 1, policy_version 1227852 (0.0008) [2023-12-26 09:27:51,466][123090] Updated weights for policy 1, policy_version 1227862 (0.0007) [2023-12-26 09:27:51,529][123090] Updated weights for policy 1, policy_version 1227872 (0.0009) [2023-12-26 09:27:51,914][123091] Updated weights for policy 0, policy_version 1236434 (0.0006) [2023-12-26 09:27:51,982][123091] Updated weights for policy 0, policy_version 1236444 (0.0005) [2023-12-26 09:27:52,053][123091] Updated weights for policy 0, policy_version 1236454 (0.0006) [2023-12-26 09:27:52,117][123091] Updated weights for policy 0, policy_version 1236464 (0.0009) [2023-12-26 09:27:52,243][123090] Updated weights for policy 1, policy_version 1227882 (0.0006) [2023-12-26 09:27:52,300][123090] Updated weights for policy 1, policy_version 1227892 (0.0005) [2023-12-26 09:27:52,359][123090] Updated weights for policy 1, policy_version 1227902 (0.0007) [2023-12-26 09:27:52,898][123091] Updated weights for policy 0, policy_version 1236474 (0.0011) [2023-12-26 09:27:52,954][123091] Updated weights for policy 0, policy_version 1236484 (0.0010) [2023-12-26 09:27:53,016][123091] Updated weights for policy 0, policy_version 1236494 (0.0010) [2023-12-26 09:27:53,165][123090] Updated weights for policy 1, policy_version 1227912 (0.0010) [2023-12-26 09:27:53,227][123090] Updated weights for policy 1, policy_version 1227922 (0.0006) [2023-12-26 09:27:53,292][123090] Updated weights for policy 1, policy_version 1227932 (0.0005) [2023-12-26 09:27:53,770][123091] Updated weights for policy 0, policy_version 1236504 (0.0006) [2023-12-26 09:27:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 630898688. Throughput: 0: 8711.9, 1: 9066.1. Samples: 630878072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:53,785][121949] Avg episode reward: [(0, '6077.111'), (1, '4726.740')] [2023-12-26 09:27:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001227936_314351616.pth... [2023-12-26 09:27:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001226848_314073088.pth [2023-12-26 09:27:53,839][123091] Updated weights for policy 0, policy_version 1236514 (0.0006) [2023-12-26 09:27:53,891][123091] Updated weights for policy 0, policy_version 1236524 (0.0005) [2023-12-26 09:27:53,908][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001236528_316555264.pth... [2023-12-26 09:27:53,912][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001235504_316293120.pth [2023-12-26 09:27:53,953][123090] Updated weights for policy 1, policy_version 1227942 (0.0005) [2023-12-26 09:27:54,010][123090] Updated weights for policy 1, policy_version 1227952 (0.0005) [2023-12-26 09:27:54,080][123090] Updated weights for policy 1, policy_version 1227962 (0.0010) [2023-12-26 09:27:54,543][123091] Updated weights for policy 0, policy_version 1236534 (0.0006) [2023-12-26 09:27:54,609][123091] Updated weights for policy 0, policy_version 1236544 (0.0006) [2023-12-26 09:27:54,678][123091] Updated weights for policy 0, policy_version 1236554 (0.0005) [2023-12-26 09:27:54,765][123090] Updated weights for policy 1, policy_version 1227972 (0.0007) [2023-12-26 09:27:54,822][123090] Updated weights for policy 1, policy_version 1227982 (0.0005) [2023-12-26 09:27:54,875][123090] Updated weights for policy 1, policy_version 1227992 (0.0005) [2023-12-26 09:27:55,310][123091] Updated weights for policy 0, policy_version 1236564 (0.0005) [2023-12-26 09:27:55,359][123091] Updated weights for policy 0, policy_version 1236574 (0.0010) [2023-12-26 09:27:55,411][123091] Updated weights for policy 0, policy_version 1236584 (0.0010) [2023-12-26 09:27:55,659][123090] Updated weights for policy 1, policy_version 1228002 (0.0006) [2023-12-26 09:27:55,722][123090] Updated weights for policy 1, policy_version 1228012 (0.0009) [2023-12-26 09:27:55,781][123090] Updated weights for policy 1, policy_version 1228022 (0.0008) [2023-12-26 09:27:55,829][123090] Updated weights for policy 1, policy_version 1228032 (0.0008) [2023-12-26 09:27:56,251][123091] Updated weights for policy 0, policy_version 1236594 (0.0009) [2023-12-26 09:27:56,300][123091] Updated weights for policy 0, policy_version 1236604 (0.0005) [2023-12-26 09:27:56,345][123091] Updated weights for policy 0, policy_version 1236614 (0.0005) [2023-12-26 09:27:56,402][123091] Updated weights for policy 0, policy_version 1236624 (0.0005) [2023-12-26 09:27:56,614][123090] Updated weights for policy 1, policy_version 1228042 (0.0010) [2023-12-26 09:27:56,664][123090] Updated weights for policy 1, policy_version 1228052 (0.0010) [2023-12-26 09:27:56,715][123090] Updated weights for policy 1, policy_version 1228062 (0.0010) [2023-12-26 09:27:57,039][123091] Updated weights for policy 0, policy_version 1236634 (0.0005) [2023-12-26 09:27:57,093][123091] Updated weights for policy 0, policy_version 1236644 (0.0005) [2023-12-26 09:27:57,157][123091] Updated weights for policy 0, policy_version 1236654 (0.0005) [2023-12-26 09:27:57,521][123090] Updated weights for policy 1, policy_version 1228072 (0.0006) [2023-12-26 09:27:57,586][123090] Updated weights for policy 1, policy_version 1228082 (0.0005) [2023-12-26 09:27:57,650][123090] Updated weights for policy 1, policy_version 1228092 (0.0005) [2023-12-26 09:27:57,807][123091] Updated weights for policy 0, policy_version 1236664 (0.0005) [2023-12-26 09:27:57,862][123091] Updated weights for policy 0, policy_version 1236674 (0.0005) [2023-12-26 09:27:57,918][123091] Updated weights for policy 0, policy_version 1236684 (0.0005) [2023-12-26 09:27:58,327][123090] Updated weights for policy 1, policy_version 1228102 (0.0008) [2023-12-26 09:27:58,400][123090] Updated weights for policy 1, policy_version 1228112 (0.0007) [2023-12-26 09:27:58,468][123090] Updated weights for policy 1, policy_version 1228122 (0.0008) [2023-12-26 09:27:58,758][123091] Updated weights for policy 0, policy_version 1236694 (0.0007) [2023-12-26 09:27:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 630996992. Throughput: 0: 8853.0, 1: 9169.8. Samples: 630992612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:27:58,784][121949] Avg episode reward: [(0, '6224.104'), (1, '4298.299')] [2023-12-26 09:27:58,827][123091] Updated weights for policy 0, policy_version 1236704 (0.0009) [2023-12-26 09:27:58,887][123091] Updated weights for policy 0, policy_version 1236714 (0.0009) [2023-12-26 09:27:59,251][123090] Updated weights for policy 1, policy_version 1228132 (0.0007) [2023-12-26 09:27:59,320][123090] Updated weights for policy 1, policy_version 1228142 (0.0006) [2023-12-26 09:27:59,393][123090] Updated weights for policy 1, policy_version 1228152 (0.0007) [2023-12-26 09:27:59,758][123091] Updated weights for policy 0, policy_version 1236724 (0.0010) [2023-12-26 09:27:59,821][123091] Updated weights for policy 0, policy_version 1236734 (0.0010) [2023-12-26 09:27:59,891][123091] Updated weights for policy 0, policy_version 1236744 (0.0011) [2023-12-26 09:28:00,134][123090] Updated weights for policy 1, policy_version 1228162 (0.0006) [2023-12-26 09:28:00,181][123090] Updated weights for policy 1, policy_version 1228172 (0.0010) [2023-12-26 09:28:00,236][123090] Updated weights for policy 1, policy_version 1228182 (0.0010) [2023-12-26 09:28:00,284][123090] Updated weights for policy 1, policy_version 1228192 (0.0010) [2023-12-26 09:28:00,691][123091] Updated weights for policy 0, policy_version 1236754 (0.0010) [2023-12-26 09:28:00,751][123091] Updated weights for policy 0, policy_version 1236764 (0.0006) [2023-12-26 09:28:00,800][123091] Updated weights for policy 0, policy_version 1236774 (0.0008) [2023-12-26 09:28:00,848][123091] Updated weights for policy 0, policy_version 1236784 (0.0005) [2023-12-26 09:28:01,058][123090] Updated weights for policy 1, policy_version 1228202 (0.0006) [2023-12-26 09:28:01,132][123090] Updated weights for policy 1, policy_version 1228212 (0.0008) [2023-12-26 09:28:01,193][123090] Updated weights for policy 1, policy_version 1228222 (0.0010) [2023-12-26 09:28:01,549][123091] Updated weights for policy 0, policy_version 1236794 (0.0005) [2023-12-26 09:28:01,608][123091] Updated weights for policy 0, policy_version 1236804 (0.0006) [2023-12-26 09:28:01,677][123091] Updated weights for policy 0, policy_version 1236814 (0.0007) [2023-12-26 09:28:01,983][123090] Updated weights for policy 1, policy_version 1228232 (0.0011) [2023-12-26 09:28:02,060][123090] Updated weights for policy 1, policy_version 1228242 (0.0011) [2023-12-26 09:28:02,136][123090] Updated weights for policy 1, policy_version 1228252 (0.0011) [2023-12-26 09:28:02,349][123091] Updated weights for policy 0, policy_version 1236824 (0.0011) [2023-12-26 09:28:02,406][123091] Updated weights for policy 0, policy_version 1236834 (0.0009) [2023-12-26 09:28:02,464][123091] Updated weights for policy 0, policy_version 1236844 (0.0009) [2023-12-26 09:28:02,939][123090] Updated weights for policy 1, policy_version 1228262 (0.0010) [2023-12-26 09:28:02,993][123090] Updated weights for policy 1, policy_version 1228272 (0.0010) [2023-12-26 09:28:03,048][123090] Updated weights for policy 1, policy_version 1228282 (0.0010) [2023-12-26 09:28:03,282][123091] Updated weights for policy 0, policy_version 1236854 (0.0007) [2023-12-26 09:28:03,345][123091] Updated weights for policy 0, policy_version 1236864 (0.0006) [2023-12-26 09:28:03,402][123091] Updated weights for policy 0, policy_version 1236874 (0.0009) [2023-12-26 09:28:03,772][123090] Updated weights for policy 1, policy_version 1228292 (0.0008) [2023-12-26 09:28:03,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 631087104. Throughput: 0: 8759.1, 1: 9206.7. Samples: 631100796. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:03,785][121949] Avg episode reward: [(0, '6049.692'), (1, '4462.942')] [2023-12-26 09:28:03,831][123090] Updated weights for policy 1, policy_version 1228302 (0.0005) [2023-12-26 09:28:03,897][123090] Updated weights for policy 1, policy_version 1228312 (0.0006) [2023-12-26 09:28:04,286][123091] Updated weights for policy 0, policy_version 1236884 (0.0009) [2023-12-26 09:28:04,352][123091] Updated weights for policy 0, policy_version 1236894 (0.0009) [2023-12-26 09:28:04,420][123091] Updated weights for policy 0, policy_version 1236904 (0.0009) [2023-12-26 09:28:04,623][123090] Updated weights for policy 1, policy_version 1228322 (0.0007) [2023-12-26 09:28:04,700][123090] Updated weights for policy 1, policy_version 1228332 (0.0010) [2023-12-26 09:28:04,770][123090] Updated weights for policy 1, policy_version 1228342 (0.0008) [2023-12-26 09:28:04,837][123090] Updated weights for policy 1, policy_version 1228352 (0.0010) [2023-12-26 09:28:05,134][123091] Updated weights for policy 0, policy_version 1236914 (0.0008) [2023-12-26 09:28:05,186][123091] Updated weights for policy 0, policy_version 1236924 (0.0008) [2023-12-26 09:28:05,242][123091] Updated weights for policy 0, policy_version 1236934 (0.0009) [2023-12-26 09:28:05,303][123091] Updated weights for policy 0, policy_version 1236944 (0.0009) [2023-12-26 09:28:05,598][123090] Updated weights for policy 1, policy_version 1228362 (0.0008) [2023-12-26 09:28:05,663][123090] Updated weights for policy 1, policy_version 1228372 (0.0007) [2023-12-26 09:28:05,728][123090] Updated weights for policy 1, policy_version 1228382 (0.0008) [2023-12-26 09:28:06,097][123091] Updated weights for policy 0, policy_version 1236954 (0.0009) [2023-12-26 09:28:06,171][123091] Updated weights for policy 0, policy_version 1236964 (0.0007) [2023-12-26 09:28:06,233][123091] Updated weights for policy 0, policy_version 1236974 (0.0010) [2023-12-26 09:28:06,417][123090] Updated weights for policy 1, policy_version 1228392 (0.0006) [2023-12-26 09:28:06,493][123090] Updated weights for policy 1, policy_version 1228402 (0.0009) [2023-12-26 09:28:06,562][123090] Updated weights for policy 1, policy_version 1228412 (0.0010) [2023-12-26 09:28:07,002][123091] Updated weights for policy 0, policy_version 1236984 (0.0006) [2023-12-26 09:28:07,065][123091] Updated weights for policy 0, policy_version 1236994 (0.0005) [2023-12-26 09:28:07,129][123091] Updated weights for policy 0, policy_version 1237004 (0.0005) [2023-12-26 09:28:07,291][123090] Updated weights for policy 1, policy_version 1228422 (0.0006) [2023-12-26 09:28:07,340][123090] Updated weights for policy 1, policy_version 1228432 (0.0005) [2023-12-26 09:28:07,393][123090] Updated weights for policy 1, policy_version 1228442 (0.0005) [2023-12-26 09:28:07,765][123091] Updated weights for policy 0, policy_version 1237014 (0.0005) [2023-12-26 09:28:07,819][123091] Updated weights for policy 0, policy_version 1237024 (0.0005) [2023-12-26 09:28:07,871][123091] Updated weights for policy 0, policy_version 1237034 (0.0005) [2023-12-26 09:28:08,072][123090] Updated weights for policy 1, policy_version 1228452 (0.0007) [2023-12-26 09:28:08,126][123090] Updated weights for policy 1, policy_version 1228462 (0.0009) [2023-12-26 09:28:08,190][123090] Updated weights for policy 1, policy_version 1228472 (0.0009) [2023-12-26 09:28:08,662][123091] Updated weights for policy 0, policy_version 1237044 (0.0007) [2023-12-26 09:28:08,726][123091] Updated weights for policy 0, policy_version 1237054 (0.0008) [2023-12-26 09:28:08,779][123091] Updated weights for policy 0, policy_version 1237064 (0.0009) [2023-12-26 09:28:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 631177216. Throughput: 0: 8749.7, 1: 9290.3. Samples: 631155228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:08,785][121949] Avg episode reward: [(0, '6027.510'), (1, '4710.634')] [2023-12-26 09:28:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001228480_314490880.pth... [2023-12-26 09:28:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001227424_314220544.pth [2023-12-26 09:28:08,827][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001237072_316694528.pth... [2023-12-26 09:28:08,830][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001235984_316416000.pth [2023-12-26 09:28:08,989][123090] Updated weights for policy 1, policy_version 1228482 (0.0009) [2023-12-26 09:28:09,045][123090] Updated weights for policy 1, policy_version 1228492 (0.0011) [2023-12-26 09:28:09,105][123090] Updated weights for policy 1, policy_version 1228502 (0.0010) [2023-12-26 09:28:09,169][123090] Updated weights for policy 1, policy_version 1228512 (0.0011) [2023-12-26 09:28:09,637][123091] Updated weights for policy 0, policy_version 1237074 (0.0009) [2023-12-26 09:28:09,715][123091] Updated weights for policy 0, policy_version 1237084 (0.0006) [2023-12-26 09:28:09,789][123091] Updated weights for policy 0, policy_version 1237094 (0.0006) [2023-12-26 09:28:09,863][123091] Updated weights for policy 0, policy_version 1237104 (0.0008) [2023-12-26 09:28:10,040][123090] Updated weights for policy 1, policy_version 1228522 (0.0011) [2023-12-26 09:28:10,101][123090] Updated weights for policy 1, policy_version 1228532 (0.0011) [2023-12-26 09:28:10,166][123090] Updated weights for policy 1, policy_version 1228542 (0.0008) [2023-12-26 09:28:10,596][123091] Updated weights for policy 0, policy_version 1237114 (0.0005) [2023-12-26 09:28:10,655][123091] Updated weights for policy 0, policy_version 1237124 (0.0006) [2023-12-26 09:28:10,716][123091] Updated weights for policy 0, policy_version 1237134 (0.0005) [2023-12-26 09:28:10,853][123090] Updated weights for policy 1, policy_version 1228552 (0.0007) [2023-12-26 09:28:10,908][123090] Updated weights for policy 1, policy_version 1228562 (0.0007) [2023-12-26 09:28:10,967][123090] Updated weights for policy 1, policy_version 1228572 (0.0010) [2023-12-26 09:28:11,458][123091] Updated weights for policy 0, policy_version 1237144 (0.0006) [2023-12-26 09:28:11,521][123091] Updated weights for policy 0, policy_version 1237154 (0.0005) [2023-12-26 09:28:11,590][123091] Updated weights for policy 0, policy_version 1237164 (0.0005) [2023-12-26 09:28:11,841][123090] Updated weights for policy 1, policy_version 1228582 (0.0010) [2023-12-26 09:28:11,904][123090] Updated weights for policy 1, policy_version 1228592 (0.0011) [2023-12-26 09:28:11,961][123090] Updated weights for policy 1, policy_version 1228602 (0.0011) [2023-12-26 09:28:12,325][123091] Updated weights for policy 0, policy_version 1237174 (0.0008) [2023-12-26 09:28:12,393][123091] Updated weights for policy 0, policy_version 1237184 (0.0009) [2023-12-26 09:28:12,457][123091] Updated weights for policy 0, policy_version 1237194 (0.0011) [2023-12-26 09:28:12,814][123090] Updated weights for policy 1, policy_version 1228612 (0.0011) [2023-12-26 09:28:12,872][123090] Updated weights for policy 1, policy_version 1228622 (0.0010) [2023-12-26 09:28:12,924][123090] Updated weights for policy 1, policy_version 1228632 (0.0010) [2023-12-26 09:28:13,273][123091] Updated weights for policy 0, policy_version 1237204 (0.0011) [2023-12-26 09:28:13,335][123091] Updated weights for policy 0, policy_version 1237214 (0.0010) [2023-12-26 09:28:13,392][123091] Updated weights for policy 0, policy_version 1237224 (0.0008) [2023-12-26 09:28:13,706][123090] Updated weights for policy 1, policy_version 1228642 (0.0009) [2023-12-26 09:28:13,773][123090] Updated weights for policy 1, policy_version 1228652 (0.0005) [2023-12-26 09:28:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 631267328. Throughput: 0: 8876.1, 1: 9185.1. Samples: 631264340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:13,785][121949] Avg episode reward: [(0, '6196.333'), (1, '4706.210')] [2023-12-26 09:28:13,838][123090] Updated weights for policy 1, policy_version 1228662 (0.0005) [2023-12-26 09:28:13,885][123090] Updated weights for policy 1, policy_version 1228672 (0.0005) [2023-12-26 09:28:14,124][123091] Updated weights for policy 0, policy_version 1237234 (0.0007) [2023-12-26 09:28:14,186][123091] Updated weights for policy 0, policy_version 1237244 (0.0010) [2023-12-26 09:28:14,247][123091] Updated weights for policy 0, policy_version 1237254 (0.0010) [2023-12-26 09:28:14,303][123091] Updated weights for policy 0, policy_version 1237264 (0.0010) [2023-12-26 09:28:14,515][123090] Updated weights for policy 1, policy_version 1228682 (0.0010) [2023-12-26 09:28:14,573][123090] Updated weights for policy 1, policy_version 1228692 (0.0010) [2023-12-26 09:28:14,616][123090] Updated weights for policy 1, policy_version 1228702 (0.0010) [2023-12-26 09:28:15,097][123091] Updated weights for policy 0, policy_version 1237274 (0.0005) [2023-12-26 09:28:15,173][123091] Updated weights for policy 0, policy_version 1237284 (0.0006) [2023-12-26 09:28:15,232][123091] Updated weights for policy 0, policy_version 1237294 (0.0006) [2023-12-26 09:28:15,446][123090] Updated weights for policy 1, policy_version 1228712 (0.0010) [2023-12-26 09:28:15,501][123090] Updated weights for policy 1, policy_version 1228722 (0.0010) [2023-12-26 09:28:15,550][123090] Updated weights for policy 1, policy_version 1228732 (0.0010) [2023-12-26 09:28:15,973][123091] Updated weights for policy 0, policy_version 1237304 (0.0006) [2023-12-26 09:28:16,040][123091] Updated weights for policy 0, policy_version 1237314 (0.0005) [2023-12-26 09:28:16,101][123091] Updated weights for policy 0, policy_version 1237324 (0.0006) [2023-12-26 09:28:16,232][123090] Updated weights for policy 1, policy_version 1228742 (0.0007) [2023-12-26 09:28:16,292][123090] Updated weights for policy 1, policy_version 1228752 (0.0005) [2023-12-26 09:28:16,389][123090] Updated weights for policy 1, policy_version 1228762 (0.0005) [2023-12-26 09:28:16,846][123091] Updated weights for policy 0, policy_version 1237334 (0.0007) [2023-12-26 09:28:16,896][123091] Updated weights for policy 0, policy_version 1237344 (0.0005) [2023-12-26 09:28:16,965][123091] Updated weights for policy 0, policy_version 1237354 (0.0008) [2023-12-26 09:28:17,059][123090] Updated weights for policy 1, policy_version 1228772 (0.0007) [2023-12-26 09:28:17,126][123090] Updated weights for policy 1, policy_version 1228782 (0.0008) [2023-12-26 09:28:17,185][123090] Updated weights for policy 1, policy_version 1228792 (0.0010) [2023-12-26 09:28:17,691][123091] Updated weights for policy 0, policy_version 1237364 (0.0006) [2023-12-26 09:28:17,755][123091] Updated weights for policy 0, policy_version 1237374 (0.0009) [2023-12-26 09:28:17,813][123091] Updated weights for policy 0, policy_version 1237384 (0.0009) [2023-12-26 09:28:17,965][123090] Updated weights for policy 1, policy_version 1228802 (0.0009) [2023-12-26 09:28:18,034][123090] Updated weights for policy 1, policy_version 1228812 (0.0009) [2023-12-26 09:28:18,087][123090] Updated weights for policy 1, policy_version 1228822 (0.0009) [2023-12-26 09:28:18,141][123090] Updated weights for policy 1, policy_version 1228832 (0.0009) [2023-12-26 09:28:18,585][123091] Updated weights for policy 0, policy_version 1237394 (0.0008) [2023-12-26 09:28:18,649][123091] Updated weights for policy 0, policy_version 1237404 (0.0006) [2023-12-26 09:28:18,717][123091] Updated weights for policy 0, policy_version 1237414 (0.0010) [2023-12-26 09:28:18,779][123091] Updated weights for policy 0, policy_version 1237424 (0.0009) [2023-12-26 09:28:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 631365632. Throughput: 0: 9011.2, 1: 9189.7. Samples: 631376792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:18,784][121949] Avg episode reward: [(0, '6063.669'), (1, '4820.825')] [2023-12-26 09:28:19,007][123090] Updated weights for policy 1, policy_version 1228842 (0.0010) [2023-12-26 09:28:19,059][123090] Updated weights for policy 1, policy_version 1228852 (0.0010) [2023-12-26 09:28:19,112][123090] Updated weights for policy 1, policy_version 1228862 (0.0009) [2023-12-26 09:28:19,544][123091] Updated weights for policy 0, policy_version 1237434 (0.0009) [2023-12-26 09:28:19,593][123091] Updated weights for policy 0, policy_version 1237444 (0.0009) [2023-12-26 09:28:19,662][123091] Updated weights for policy 0, policy_version 1237454 (0.0009) [2023-12-26 09:28:20,008][123090] Updated weights for policy 1, policy_version 1228872 (0.0010) [2023-12-26 09:28:20,077][123090] Updated weights for policy 1, policy_version 1228882 (0.0009) [2023-12-26 09:28:20,136][123090] Updated weights for policy 1, policy_version 1228892 (0.0010) [2023-12-26 09:28:20,511][123091] Updated weights for policy 0, policy_version 1237464 (0.0007) [2023-12-26 09:28:20,580][123091] Updated weights for policy 0, policy_version 1237474 (0.0007) [2023-12-26 09:28:20,646][123091] Updated weights for policy 0, policy_version 1237484 (0.0008) [2023-12-26 09:28:20,969][123090] Updated weights for policy 1, policy_version 1228902 (0.0010) [2023-12-26 09:28:21,032][123090] Updated weights for policy 1, policy_version 1228912 (0.0010) [2023-12-26 09:28:21,102][123090] Updated weights for policy 1, policy_version 1228922 (0.0009) [2023-12-26 09:28:21,428][123091] Updated weights for policy 0, policy_version 1237494 (0.0010) [2023-12-26 09:28:21,492][123091] Updated weights for policy 0, policy_version 1237504 (0.0010) [2023-12-26 09:28:21,542][123091] Updated weights for policy 0, policy_version 1237514 (0.0009) [2023-12-26 09:28:21,968][123090] Updated weights for policy 1, policy_version 1228932 (0.0010) [2023-12-26 09:28:22,037][123090] Updated weights for policy 1, policy_version 1228942 (0.0010) [2023-12-26 09:28:22,102][123090] Updated weights for policy 1, policy_version 1228952 (0.0010) [2023-12-26 09:28:22,478][123091] Updated weights for policy 0, policy_version 1237524 (0.0009) [2023-12-26 09:28:22,549][123091] Updated weights for policy 0, policy_version 1237534 (0.0008) [2023-12-26 09:28:22,619][123091] Updated weights for policy 0, policy_version 1237544 (0.0006) [2023-12-26 09:28:22,934][123090] Updated weights for policy 1, policy_version 1228962 (0.0009) [2023-12-26 09:28:22,994][123090] Updated weights for policy 1, policy_version 1228972 (0.0010) [2023-12-26 09:28:23,055][123090] Updated weights for policy 1, policy_version 1228982 (0.0010) [2023-12-26 09:28:23,127][123090] Updated weights for policy 1, policy_version 1228992 (0.0009) [2023-12-26 09:28:23,390][123091] Updated weights for policy 0, policy_version 1237554 (0.0008) [2023-12-26 09:28:23,446][123091] Updated weights for policy 0, policy_version 1237564 (0.0006) [2023-12-26 09:28:23,491][123091] Updated weights for policy 0, policy_version 1237574 (0.0005) [2023-12-26 09:28:23,542][123091] Updated weights for policy 0, policy_version 1237584 (0.0007) [2023-12-26 09:28:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 631447552. Throughput: 0: 9028.6, 1: 9107.2. Samples: 631426436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:23,785][121949] Avg episode reward: [(0, '5963.022'), (1, '5054.107')] [2023-12-26 09:28:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001237584_316825600.pth... [2023-12-26 09:28:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001228992_314621952.pth... [2023-12-26 09:28:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001236528_316555264.pth [2023-12-26 09:28:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001227936_314351616.pth [2023-12-26 09:28:23,887][123090] Updated weights for policy 1, policy_version 1229002 (0.0005) [2023-12-26 09:28:23,947][123090] Updated weights for policy 1, policy_version 1229012 (0.0005) [2023-12-26 09:28:24,012][123090] Updated weights for policy 1, policy_version 1229022 (0.0005) [2023-12-26 09:28:24,291][123091] Updated weights for policy 0, policy_version 1237594 (0.0008) [2023-12-26 09:28:24,346][123091] Updated weights for policy 0, policy_version 1237605 (0.0010) [2023-12-26 09:28:24,397][123091] Updated weights for policy 0, policy_version 1237615 (0.0010) [2023-12-26 09:28:24,698][123090] Updated weights for policy 1, policy_version 1229032 (0.0009) [2023-12-26 09:28:24,762][123090] Updated weights for policy 1, policy_version 1229042 (0.0009) [2023-12-26 09:28:24,827][123090] Updated weights for policy 1, policy_version 1229052 (0.0005) [2023-12-26 09:28:25,262][123091] Updated weights for policy 0, policy_version 1237625 (0.0008) [2023-12-26 09:28:25,326][123091] Updated weights for policy 0, policy_version 1237635 (0.0009) [2023-12-26 09:28:25,381][123091] Updated weights for policy 0, policy_version 1237645 (0.0008) [2023-12-26 09:28:25,528][123090] Updated weights for policy 1, policy_version 1229062 (0.0008) [2023-12-26 09:28:25,575][123090] Updated weights for policy 1, policy_version 1229072 (0.0010) [2023-12-26 09:28:25,623][123090] Updated weights for policy 1, policy_version 1229082 (0.0010) [2023-12-26 09:28:26,190][123091] Updated weights for policy 0, policy_version 1237655 (0.0009) [2023-12-26 09:28:26,240][123091] Updated weights for policy 0, policy_version 1237666 (0.0010) [2023-12-26 09:28:26,292][123091] Updated weights for policy 0, policy_version 1237676 (0.0008) [2023-12-26 09:28:26,450][123090] Updated weights for policy 1, policy_version 1229092 (0.0010) [2023-12-26 09:28:26,517][123090] Updated weights for policy 1, policy_version 1229102 (0.0010) [2023-12-26 09:28:26,566][123090] Updated weights for policy 1, policy_version 1229112 (0.0007) [2023-12-26 09:28:27,175][123091] Updated weights for policy 0, policy_version 1237686 (0.0010) [2023-12-26 09:28:27,239][123091] Updated weights for policy 0, policy_version 1237696 (0.0009) [2023-12-26 09:28:27,247][123090] Updated weights for policy 1, policy_version 1229122 (0.0006) [2023-12-26 09:28:27,290][123091] Updated weights for policy 0, policy_version 1237706 (0.0010) [2023-12-26 09:28:27,306][123090] Updated weights for policy 1, policy_version 1229132 (0.0010) [2023-12-26 09:28:27,364][123090] Updated weights for policy 1, policy_version 1229142 (0.0005) [2023-12-26 09:28:27,435][123090] Updated weights for policy 1, policy_version 1229152 (0.0005) [2023-12-26 09:28:28,103][123091] Updated weights for policy 0, policy_version 1237716 (0.0010) [2023-12-26 09:28:28,129][123090] Updated weights for policy 1, policy_version 1229162 (0.0005) [2023-12-26 09:28:28,161][123091] Updated weights for policy 0, policy_version 1237726 (0.0010) [2023-12-26 09:28:28,180][123090] Updated weights for policy 1, policy_version 1229172 (0.0005) [2023-12-26 09:28:28,220][123091] Updated weights for policy 0, policy_version 1237736 (0.0010) [2023-12-26 09:28:28,239][123090] Updated weights for policy 1, policy_version 1229182 (0.0005) [2023-12-26 09:28:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 631537664. Throughput: 0: 8998.1, 1: 9133.1. Samples: 631531712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:28,784][121949] Avg episode reward: [(0, '6274.605'), (1, '5178.925')] [2023-12-26 09:28:28,967][123090] Updated weights for policy 1, policy_version 1229192 (0.0005) [2023-12-26 09:28:29,025][123090] Updated weights for policy 1, policy_version 1229202 (0.0005) [2023-12-26 09:28:29,040][123091] Updated weights for policy 0, policy_version 1237746 (0.0010) [2023-12-26 09:28:29,085][123090] Updated weights for policy 1, policy_version 1229212 (0.0005) [2023-12-26 09:28:29,098][123091] Updated weights for policy 0, policy_version 1237756 (0.0011) [2023-12-26 09:28:29,153][123091] Updated weights for policy 0, policy_version 1237766 (0.0010) [2023-12-26 09:28:29,219][123091] Updated weights for policy 0, policy_version 1237776 (0.0009) [2023-12-26 09:28:29,786][123090] Updated weights for policy 1, policy_version 1229222 (0.0007) [2023-12-26 09:28:29,852][123090] Updated weights for policy 1, policy_version 1229232 (0.0009) [2023-12-26 09:28:29,926][123090] Updated weights for policy 1, policy_version 1229242 (0.0009) [2023-12-26 09:28:29,997][123091] Updated weights for policy 0, policy_version 1237786 (0.0008) [2023-12-26 09:28:30,061][123091] Updated weights for policy 0, policy_version 1237796 (0.0009) [2023-12-26 09:28:30,120][123091] Updated weights for policy 0, policy_version 1237806 (0.0009) [2023-12-26 09:28:30,647][123090] Updated weights for policy 1, policy_version 1229252 (0.0008) [2023-12-26 09:28:30,703][123090] Updated weights for policy 1, policy_version 1229262 (0.0005) [2023-12-26 09:28:30,757][123090] Updated weights for policy 1, policy_version 1229272 (0.0005) [2023-12-26 09:28:30,784][123091] Updated weights for policy 0, policy_version 1237816 (0.0009) [2023-12-26 09:28:30,839][123091] Updated weights for policy 0, policy_version 1237826 (0.0009) [2023-12-26 09:28:30,900][123091] Updated weights for policy 0, policy_version 1237836 (0.0010) [2023-12-26 09:28:31,444][123090] Updated weights for policy 1, policy_version 1229282 (0.0006) [2023-12-26 09:28:31,505][123090] Updated weights for policy 1, policy_version 1229292 (0.0008) [2023-12-26 09:28:31,571][123090] Updated weights for policy 1, policy_version 1229302 (0.0008) [2023-12-26 09:28:31,635][123090] Updated weights for policy 1, policy_version 1229312 (0.0008) [2023-12-26 09:28:31,784][123091] Updated weights for policy 0, policy_version 1237846 (0.0007) [2023-12-26 09:28:31,848][123091] Updated weights for policy 0, policy_version 1237856 (0.0005) [2023-12-26 09:28:31,906][123091] Updated weights for policy 0, policy_version 1237866 (0.0005) [2023-12-26 09:28:32,482][123090] Updated weights for policy 1, policy_version 1229322 (0.0009) [2023-12-26 09:28:32,545][123090] Updated weights for policy 1, policy_version 1229332 (0.0010) [2023-12-26 09:28:32,610][123090] Updated weights for policy 1, policy_version 1229342 (0.0009) [2023-12-26 09:28:32,636][123091] Updated weights for policy 0, policy_version 1237876 (0.0007) [2023-12-26 09:28:32,699][123091] Updated weights for policy 0, policy_version 1237886 (0.0010) [2023-12-26 09:28:32,756][123091] Updated weights for policy 0, policy_version 1237896 (0.0009) [2023-12-26 09:28:33,392][123090] Updated weights for policy 1, policy_version 1229352 (0.0006) [2023-12-26 09:28:33,459][123090] Updated weights for policy 1, policy_version 1229362 (0.0007) [2023-12-26 09:28:33,492][123091] Updated weights for policy 0, policy_version 1237906 (0.0010) [2023-12-26 09:28:33,516][123090] Updated weights for policy 1, policy_version 1229372 (0.0008) [2023-12-26 09:28:33,552][123091] Updated weights for policy 0, policy_version 1237916 (0.0009) [2023-12-26 09:28:33,626][123091] Updated weights for policy 0, policy_version 1237926 (0.0009) [2023-12-26 09:28:33,694][123091] Updated weights for policy 0, policy_version 1237936 (0.0009) [2023-12-26 09:28:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 631635968. Throughput: 0: 9030.9, 1: 9128.7. Samples: 631642728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:33,785][121949] Avg episode reward: [(0, '6228.362'), (1, '5043.738')] [2023-12-26 09:28:34,172][123090] Updated weights for policy 1, policy_version 1229382 (0.0008) [2023-12-26 09:28:34,246][123090] Updated weights for policy 1, policy_version 1229392 (0.0010) [2023-12-26 09:28:34,316][123090] Updated weights for policy 1, policy_version 1229402 (0.0010) [2023-12-26 09:28:34,524][123091] Updated weights for policy 0, policy_version 1237946 (0.0005) [2023-12-26 09:28:34,592][123091] Updated weights for policy 0, policy_version 1237956 (0.0006) [2023-12-26 09:28:34,665][123091] Updated weights for policy 0, policy_version 1237966 (0.0006) [2023-12-26 09:28:35,221][123090] Updated weights for policy 1, policy_version 1229412 (0.0009) [2023-12-26 09:28:35,285][123090] Updated weights for policy 1, policy_version 1229422 (0.0009) [2023-12-26 09:28:35,337][123091] Updated weights for policy 0, policy_version 1237976 (0.0007) [2023-12-26 09:28:35,350][123090] Updated weights for policy 1, policy_version 1229432 (0.0009) [2023-12-26 09:28:35,399][123091] Updated weights for policy 0, policy_version 1237986 (0.0009) [2023-12-26 09:28:35,464][123091] Updated weights for policy 0, policy_version 1237996 (0.0009) [2023-12-26 09:28:36,140][123090] Updated weights for policy 1, policy_version 1229442 (0.0008) [2023-12-26 09:28:36,208][123090] Updated weights for policy 1, policy_version 1229452 (0.0007) [2023-12-26 09:28:36,261][123091] Updated weights for policy 0, policy_version 1238006 (0.0009) [2023-12-26 09:28:36,271][123090] Updated weights for policy 1, policy_version 1229462 (0.0006) [2023-12-26 09:28:36,329][123091] Updated weights for policy 0, policy_version 1238016 (0.0009) [2023-12-26 09:28:36,342][123090] Updated weights for policy 1, policy_version 1229472 (0.0005) [2023-12-26 09:28:36,396][123091] Updated weights for policy 0, policy_version 1238026 (0.0009) [2023-12-26 09:28:37,071][123090] Updated weights for policy 1, policy_version 1229482 (0.0009) [2023-12-26 09:28:37,132][123090] Updated weights for policy 1, policy_version 1229492 (0.0008) [2023-12-26 09:28:37,196][123090] Updated weights for policy 1, policy_version 1229502 (0.0010) [2023-12-26 09:28:37,223][123091] Updated weights for policy 0, policy_version 1238036 (0.0010) [2023-12-26 09:28:37,279][123091] Updated weights for policy 0, policy_version 1238046 (0.0010) [2023-12-26 09:28:37,346][123091] Updated weights for policy 0, policy_version 1238056 (0.0010) [2023-12-26 09:28:38,019][123090] Updated weights for policy 1, policy_version 1229512 (0.0007) [2023-12-26 09:28:38,083][123090] Updated weights for policy 1, policy_version 1229522 (0.0011) [2023-12-26 09:28:38,144][123090] Updated weights for policy 1, policy_version 1229532 (0.0007) [2023-12-26 09:28:38,171][123091] Updated weights for policy 0, policy_version 1238066 (0.0011) [2023-12-26 09:28:38,227][123091] Updated weights for policy 0, policy_version 1238076 (0.0011) [2023-12-26 09:28:38,297][123091] Updated weights for policy 0, policy_version 1238086 (0.0005) [2023-12-26 09:28:38,372][123091] Updated weights for policy 0, policy_version 1238096 (0.0008) [2023-12-26 09:28:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18158.9, 300 sec: 17883.5). Total num frames: 631717888. Throughput: 0: 9035.2, 1: 9150.0. Samples: 631696408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:38,786][121949] Avg episode reward: [(0, '6115.131'), (1, '4995.474')] [2023-12-26 09:28:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001229536_314761216.pth... [2023-12-26 09:28:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001238096_316956672.pth... [2023-12-26 09:28:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001228480_314490880.pth [2023-12-26 09:28:38,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001237072_316694528.pth [2023-12-26 09:28:38,884][123090] Updated weights for policy 1, policy_version 1229542 (0.0006) [2023-12-26 09:28:38,942][123090] Updated weights for policy 1, policy_version 1229552 (0.0007) [2023-12-26 09:28:38,994][123090] Updated weights for policy 1, policy_version 1229562 (0.0010) [2023-12-26 09:28:39,047][123091] Updated weights for policy 0, policy_version 1238106 (0.0006) [2023-12-26 09:28:39,096][123091] Updated weights for policy 0, policy_version 1238116 (0.0009) [2023-12-26 09:28:39,141][123091] Updated weights for policy 0, policy_version 1238126 (0.0006) [2023-12-26 09:28:39,872][123090] Updated weights for policy 1, policy_version 1229572 (0.0009) [2023-12-26 09:28:39,939][123091] Updated weights for policy 0, policy_version 1238136 (0.0008) [2023-12-26 09:28:39,942][123090] Updated weights for policy 1, policy_version 1229582 (0.0008) [2023-12-26 09:28:40,002][123091] Updated weights for policy 0, policy_version 1238146 (0.0006) [2023-12-26 09:28:40,008][123090] Updated weights for policy 1, policy_version 1229592 (0.0009) [2023-12-26 09:28:40,067][123091] Updated weights for policy 0, policy_version 1238156 (0.0007) [2023-12-26 09:28:40,762][123090] Updated weights for policy 1, policy_version 1229602 (0.0009) [2023-12-26 09:28:40,820][123090] Updated weights for policy 1, policy_version 1229612 (0.0009) [2023-12-26 09:28:40,859][123091] Updated weights for policy 0, policy_version 1238166 (0.0009) [2023-12-26 09:28:40,876][123090] Updated weights for policy 1, policy_version 1229622 (0.0007) [2023-12-26 09:28:40,913][123091] Updated weights for policy 0, policy_version 1238176 (0.0010) [2023-12-26 09:28:40,928][123090] Updated weights for policy 1, policy_version 1229632 (0.0007) [2023-12-26 09:28:40,969][123091] Updated weights for policy 0, policy_version 1238186 (0.0009) [2023-12-26 09:28:41,762][123091] Updated weights for policy 0, policy_version 1238196 (0.0009) [2023-12-26 09:28:41,816][123091] Updated weights for policy 0, policy_version 1238206 (0.0008) [2023-12-26 09:28:41,819][123090] Updated weights for policy 1, policy_version 1229642 (0.0008) [2023-12-26 09:28:41,867][123091] Updated weights for policy 0, policy_version 1238216 (0.0009) [2023-12-26 09:28:41,886][123090] Updated weights for policy 1, policy_version 1229652 (0.0008) [2023-12-26 09:28:41,949][123090] Updated weights for policy 1, policy_version 1229662 (0.0010) [2023-12-26 09:28:42,678][123090] Updated weights for policy 1, policy_version 1229672 (0.0009) [2023-12-26 09:28:42,728][123091] Updated weights for policy 0, policy_version 1238226 (0.0009) [2023-12-26 09:28:42,745][123090] Updated weights for policy 1, policy_version 1229682 (0.0008) [2023-12-26 09:28:42,778][123091] Updated weights for policy 0, policy_version 1238236 (0.0007) [2023-12-26 09:28:42,809][123090] Updated weights for policy 1, policy_version 1229692 (0.0009) [2023-12-26 09:28:42,834][123091] Updated weights for policy 0, policy_version 1238246 (0.0007) [2023-12-26 09:28:42,900][123091] Updated weights for policy 0, policy_version 1238256 (0.0009) [2023-12-26 09:28:43,638][123090] Updated weights for policy 1, policy_version 1229702 (0.0010) [2023-12-26 09:28:43,700][123091] Updated weights for policy 0, policy_version 1238266 (0.0006) [2023-12-26 09:28:43,707][123090] Updated weights for policy 1, policy_version 1229712 (0.0009) [2023-12-26 09:28:43,767][123091] Updated weights for policy 0, policy_version 1238276 (0.0005) [2023-12-26 09:28:43,773][123090] Updated weights for policy 1, policy_version 1229722 (0.0009) [2023-12-26 09:28:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 631799808. Throughput: 0: 8912.2, 1: 9075.5. Samples: 631802064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:43,785][121949] Avg episode reward: [(0, '6266.875'), (1, '5063.462')] [2023-12-26 09:28:43,837][123091] Updated weights for policy 0, policy_version 1238286 (0.0005) [2023-12-26 09:28:44,477][123091] Updated weights for policy 0, policy_version 1238296 (0.0006) [2023-12-26 09:28:44,544][123091] Updated weights for policy 0, policy_version 1238306 (0.0006) [2023-12-26 09:28:44,610][123091] Updated weights for policy 0, policy_version 1238316 (0.0006) [2023-12-26 09:28:44,710][123090] Updated weights for policy 1, policy_version 1229732 (0.0009) [2023-12-26 09:28:44,763][123090] Updated weights for policy 1, policy_version 1229742 (0.0009) [2023-12-26 09:28:44,832][123090] Updated weights for policy 1, policy_version 1229752 (0.0010) [2023-12-26 09:28:45,341][123091] Updated weights for policy 0, policy_version 1238326 (0.0006) [2023-12-26 09:28:45,410][123091] Updated weights for policy 0, policy_version 1238336 (0.0010) [2023-12-26 09:28:45,474][123091] Updated weights for policy 0, policy_version 1238346 (0.0011) [2023-12-26 09:28:45,723][123090] Updated weights for policy 1, policy_version 1229762 (0.0009) [2023-12-26 09:28:45,775][123090] Updated weights for policy 1, policy_version 1229772 (0.0006) [2023-12-26 09:28:45,832][123090] Updated weights for policy 1, policy_version 1229782 (0.0009) [2023-12-26 09:28:45,885][123090] Updated weights for policy 1, policy_version 1229792 (0.0009) [2023-12-26 09:28:46,275][123091] Updated weights for policy 0, policy_version 1238356 (0.0011) [2023-12-26 09:28:46,337][123091] Updated weights for policy 0, policy_version 1238366 (0.0009) [2023-12-26 09:28:46,394][123091] Updated weights for policy 0, policy_version 1238376 (0.0005) [2023-12-26 09:28:46,551][123090] Updated weights for policy 1, policy_version 1229802 (0.0006) [2023-12-26 09:28:46,605][123090] Updated weights for policy 1, policy_version 1229812 (0.0005) [2023-12-26 09:28:46,654][123090] Updated weights for policy 1, policy_version 1229822 (0.0009) [2023-12-26 09:28:47,156][123091] Updated weights for policy 0, policy_version 1238386 (0.0009) [2023-12-26 09:28:47,200][123091] Updated weights for policy 0, policy_version 1238396 (0.0010) [2023-12-26 09:28:47,254][123091] Updated weights for policy 0, policy_version 1238406 (0.0010) [2023-12-26 09:28:47,301][123091] Updated weights for policy 0, policy_version 1238416 (0.0010) [2023-12-26 09:28:47,411][123090] Updated weights for policy 1, policy_version 1229832 (0.0007) [2023-12-26 09:28:47,472][123090] Updated weights for policy 1, policy_version 1229842 (0.0006) [2023-12-26 09:28:47,542][123090] Updated weights for policy 1, policy_version 1229852 (0.0006) [2023-12-26 09:28:48,055][123091] Updated weights for policy 0, policy_version 1238426 (0.0007) [2023-12-26 09:28:48,103][123091] Updated weights for policy 0, policy_version 1238436 (0.0010) [2023-12-26 09:28:48,163][123091] Updated weights for policy 0, policy_version 1238446 (0.0011) [2023-12-26 09:28:48,289][123090] Updated weights for policy 1, policy_version 1229862 (0.0009) [2023-12-26 09:28:48,361][123090] Updated weights for policy 1, policy_version 1229872 (0.0011) [2023-12-26 09:28:48,433][123090] Updated weights for policy 1, policy_version 1229882 (0.0006) [2023-12-26 09:28:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 631898112. Throughput: 0: 8977.6, 1: 9026.9. Samples: 631910996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:48,785][121949] Avg episode reward: [(0, '6341.480'), (1, '5245.893')] [2023-12-26 09:28:49,011][123091] Updated weights for policy 0, policy_version 1238456 (0.0009) [2023-12-26 09:28:49,071][123091] Updated weights for policy 0, policy_version 1238466 (0.0009) [2023-12-26 09:28:49,121][123091] Updated weights for policy 0, policy_version 1238476 (0.0006) [2023-12-26 09:28:49,194][123090] Updated weights for policy 1, policy_version 1229892 (0.0008) [2023-12-26 09:28:49,260][123090] Updated weights for policy 1, policy_version 1229902 (0.0011) [2023-12-26 09:28:49,319][123090] Updated weights for policy 1, policy_version 1229912 (0.0010) [2023-12-26 09:28:49,837][123091] Updated weights for policy 0, policy_version 1238486 (0.0008) [2023-12-26 09:28:49,906][123091] Updated weights for policy 0, policy_version 1238496 (0.0010) [2023-12-26 09:28:49,971][123091] Updated weights for policy 0, policy_version 1238506 (0.0009) [2023-12-26 09:28:50,082][123090] Updated weights for policy 1, policy_version 1229922 (0.0009) [2023-12-26 09:28:50,154][123090] Updated weights for policy 1, policy_version 1229932 (0.0010) [2023-12-26 09:28:50,217][123090] Updated weights for policy 1, policy_version 1229942 (0.0009) [2023-12-26 09:28:50,277][123090] Updated weights for policy 1, policy_version 1229952 (0.0009) [2023-12-26 09:28:50,804][123091] Updated weights for policy 0, policy_version 1238516 (0.0010) [2023-12-26 09:28:50,873][123091] Updated weights for policy 0, policy_version 1238526 (0.0009) [2023-12-26 09:28:50,932][123091] Updated weights for policy 0, policy_version 1238536 (0.0010) [2023-12-26 09:28:51,138][123090] Updated weights for policy 1, policy_version 1229962 (0.0010) [2023-12-26 09:28:51,205][123090] Updated weights for policy 1, policy_version 1229972 (0.0010) [2023-12-26 09:28:51,272][123090] Updated weights for policy 1, policy_version 1229982 (0.0010) [2023-12-26 09:28:51,833][123091] Updated weights for policy 0, policy_version 1238546 (0.0009) [2023-12-26 09:28:51,893][123091] Updated weights for policy 0, policy_version 1238556 (0.0009) [2023-12-26 09:28:51,943][123091] Updated weights for policy 0, policy_version 1238566 (0.0009) [2023-12-26 09:28:51,993][123091] Updated weights for policy 0, policy_version 1238576 (0.0009) [2023-12-26 09:28:52,131][123090] Updated weights for policy 1, policy_version 1229992 (0.0009) [2023-12-26 09:28:52,196][123090] Updated weights for policy 1, policy_version 1230002 (0.0009) [2023-12-26 09:28:52,266][123090] Updated weights for policy 1, policy_version 1230012 (0.0009) [2023-12-26 09:28:52,842][123091] Updated weights for policy 0, policy_version 1238586 (0.0009) [2023-12-26 09:28:52,891][123091] Updated weights for policy 0, policy_version 1238596 (0.0009) [2023-12-26 09:28:52,944][123091] Updated weights for policy 0, policy_version 1238606 (0.0010) [2023-12-26 09:28:53,077][123090] Updated weights for policy 1, policy_version 1230022 (0.0010) [2023-12-26 09:28:53,139][123090] Updated weights for policy 1, policy_version 1230032 (0.0009) [2023-12-26 09:28:53,201][123090] Updated weights for policy 1, policy_version 1230042 (0.0010) [2023-12-26 09:28:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 631980032. Throughput: 0: 8966.2, 1: 8964.6. Samples: 631962112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:53,785][121949] Avg episode reward: [(0, '6122.084'), (1, '5491.676')] [2023-12-26 09:28:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001230048_314892288.pth... [2023-12-26 09:28:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001228992_314621952.pth [2023-12-26 09:28:53,804][123091] Updated weights for policy 0, policy_version 1238616 (0.0010) [2023-12-26 09:28:53,856][123091] Updated weights for policy 0, policy_version 1238626 (0.0009) [2023-12-26 09:28:53,906][123091] Updated weights for policy 0, policy_version 1238636 (0.0009) [2023-12-26 09:28:53,923][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001238640_317095936.pth... [2023-12-26 09:28:53,926][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001237584_316825600.pth [2023-12-26 09:28:54,032][123090] Updated weights for policy 1, policy_version 1230052 (0.0009) [2023-12-26 09:28:54,102][123090] Updated weights for policy 1, policy_version 1230062 (0.0008) [2023-12-26 09:28:54,166][123090] Updated weights for policy 1, policy_version 1230072 (0.0009) [2023-12-26 09:28:54,686][123091] Updated weights for policy 0, policy_version 1238646 (0.0010) [2023-12-26 09:28:54,748][123091] Updated weights for policy 0, policy_version 1238656 (0.0010) [2023-12-26 09:28:54,806][123091] Updated weights for policy 0, policy_version 1238666 (0.0009) [2023-12-26 09:28:55,020][123090] Updated weights for policy 1, policy_version 1230082 (0.0009) [2023-12-26 09:28:55,074][123090] Updated weights for policy 1, policy_version 1230092 (0.0010) [2023-12-26 09:28:55,129][123090] Updated weights for policy 1, policy_version 1230102 (0.0009) [2023-12-26 09:28:55,184][123090] Updated weights for policy 1, policy_version 1230112 (0.0005) [2023-12-26 09:28:55,597][123091] Updated weights for policy 0, policy_version 1238676 (0.0008) [2023-12-26 09:28:55,667][123091] Updated weights for policy 0, policy_version 1238686 (0.0005) [2023-12-26 09:28:55,713][123091] Updated weights for policy 0, policy_version 1238696 (0.0005) [2023-12-26 09:28:55,969][123090] Updated weights for policy 1, policy_version 1230122 (0.0005) [2023-12-26 09:28:56,019][123090] Updated weights for policy 1, policy_version 1230132 (0.0005) [2023-12-26 09:28:56,068][123090] Updated weights for policy 1, policy_version 1230142 (0.0005) [2023-12-26 09:28:56,351][123091] Updated weights for policy 0, policy_version 1238706 (0.0005) [2023-12-26 09:28:56,421][123091] Updated weights for policy 0, policy_version 1238716 (0.0005) [2023-12-26 09:28:56,481][123091] Updated weights for policy 0, policy_version 1238727 (0.0009) [2023-12-26 09:28:56,745][123090] Updated weights for policy 1, policy_version 1230152 (0.0005) [2023-12-26 09:28:56,801][123090] Updated weights for policy 1, policy_version 1230162 (0.0005) [2023-12-26 09:28:56,856][123090] Updated weights for policy 1, policy_version 1230172 (0.0005) [2023-12-26 09:28:57,211][123091] Updated weights for policy 0, policy_version 1238737 (0.0010) [2023-12-26 09:28:57,275][123091] Updated weights for policy 0, policy_version 1238747 (0.0008) [2023-12-26 09:28:57,341][123091] Updated weights for policy 0, policy_version 1238757 (0.0008) [2023-12-26 09:28:57,408][123091] Updated weights for policy 0, policy_version 1238767 (0.0008) [2023-12-26 09:28:57,465][123090] Updated weights for policy 1, policy_version 1230182 (0.0005) [2023-12-26 09:28:57,524][123090] Updated weights for policy 1, policy_version 1230192 (0.0005) [2023-12-26 09:28:57,585][123090] Updated weights for policy 1, policy_version 1230202 (0.0005) [2023-12-26 09:28:58,097][123091] Updated weights for policy 0, policy_version 1238777 (0.0009) [2023-12-26 09:28:58,164][123091] Updated weights for policy 0, policy_version 1238787 (0.0011) [2023-12-26 09:28:58,228][123091] Updated weights for policy 0, policy_version 1238797 (0.0010) [2023-12-26 09:28:58,286][123090] Updated weights for policy 1, policy_version 1230212 (0.0006) [2023-12-26 09:28:58,379][123090] Updated weights for policy 1, policy_version 1230222 (0.0007) [2023-12-26 09:28:58,450][123090] Updated weights for policy 1, policy_version 1230232 (0.0008) [2023-12-26 09:28:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 632078336. Throughput: 0: 8940.7, 1: 8997.8. Samples: 632071572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:28:58,785][121949] Avg episode reward: [(0, '5996.420'), (1, '5548.489')] [2023-12-26 09:28:59,076][123091] Updated weights for policy 0, policy_version 1238807 (0.0010) [2023-12-26 09:28:59,126][123091] Updated weights for policy 0, policy_version 1238817 (0.0010) [2023-12-26 09:28:59,176][123091] Updated weights for policy 0, policy_version 1238827 (0.0010) [2023-12-26 09:28:59,249][123090] Updated weights for policy 1, policy_version 1230242 (0.0009) [2023-12-26 09:28:59,321][123090] Updated weights for policy 1, policy_version 1230252 (0.0007) [2023-12-26 09:28:59,394][123090] Updated weights for policy 1, policy_version 1230262 (0.0007) [2023-12-26 09:28:59,465][123090] Updated weights for policy 1, policy_version 1230272 (0.0008) [2023-12-26 09:28:59,978][123091] Updated weights for policy 0, policy_version 1238837 (0.0008) [2023-12-26 09:29:00,038][123091] Updated weights for policy 0, policy_version 1238847 (0.0005) [2023-12-26 09:29:00,094][123090] Updated weights for policy 1, policy_version 1230282 (0.0006) [2023-12-26 09:29:00,096][123091] Updated weights for policy 0, policy_version 1238857 (0.0011) [2023-12-26 09:29:00,146][123090] Updated weights for policy 1, policy_version 1230292 (0.0005) [2023-12-26 09:29:00,197][123090] Updated weights for policy 1, policy_version 1230302 (0.0005) [2023-12-26 09:29:00,866][123090] Updated weights for policy 1, policy_version 1230312 (0.0005) [2023-12-26 09:29:00,919][123090] Updated weights for policy 1, policy_version 1230322 (0.0005) [2023-12-26 09:29:00,971][123090] Updated weights for policy 1, policy_version 1230332 (0.0005) [2023-12-26 09:29:00,985][123091] Updated weights for policy 0, policy_version 1238867 (0.0010) [2023-12-26 09:29:01,046][123091] Updated weights for policy 0, policy_version 1238877 (0.0009) [2023-12-26 09:29:01,111][123091] Updated weights for policy 0, policy_version 1238887 (0.0006) [2023-12-26 09:29:01,788][123090] Updated weights for policy 1, policy_version 1230342 (0.0008) [2023-12-26 09:29:01,851][123090] Updated weights for policy 1, policy_version 1230352 (0.0010) [2023-12-26 09:29:01,879][123091] Updated weights for policy 0, policy_version 1238897 (0.0008) [2023-12-26 09:29:01,916][123090] Updated weights for policy 1, policy_version 1230362 (0.0008) [2023-12-26 09:29:01,943][123091] Updated weights for policy 0, policy_version 1238907 (0.0007) [2023-12-26 09:29:02,013][123091] Updated weights for policy 0, policy_version 1238917 (0.0006) [2023-12-26 09:29:02,079][123091] Updated weights for policy 0, policy_version 1238927 (0.0007) [2023-12-26 09:29:02,734][123090] Updated weights for policy 1, policy_version 1230372 (0.0009) [2023-12-26 09:29:02,792][123091] Updated weights for policy 0, policy_version 1238937 (0.0009) [2023-12-26 09:29:02,802][123090] Updated weights for policy 1, policy_version 1230382 (0.0005) [2023-12-26 09:29:02,852][123090] Updated weights for policy 1, policy_version 1230392 (0.0008) [2023-12-26 09:29:02,857][123091] Updated weights for policy 0, policy_version 1238947 (0.0006) [2023-12-26 09:29:02,943][123091] Updated weights for policy 0, policy_version 1238957 (0.0005) [2023-12-26 09:29:03,588][123090] Updated weights for policy 1, policy_version 1230402 (0.0010) [2023-12-26 09:29:03,588][123091] Updated weights for policy 0, policy_version 1238967 (0.0007) [2023-12-26 09:29:03,643][123091] Updated weights for policy 0, policy_version 1238977 (0.0009) [2023-12-26 09:29:03,652][123090] Updated weights for policy 1, policy_version 1230412 (0.0010) [2023-12-26 09:29:03,705][123091] Updated weights for policy 0, policy_version 1238987 (0.0007) [2023-12-26 09:29:03,715][123090] Updated weights for policy 1, policy_version 1230422 (0.0010) [2023-12-26 09:29:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17883.6). Total num frames: 632168448. Throughput: 0: 8885.1, 1: 8984.3. Samples: 632180912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:29:03,784][121949] Avg episode reward: [(0, '6143.275'), (1, '5504.581')] [2023-12-26 09:29:03,786][123090] Updated weights for policy 1, policy_version 1230432 (0.0011) [2023-12-26 09:29:04,529][123090] Updated weights for policy 1, policy_version 1230442 (0.0005) [2023-12-26 09:29:04,547][123091] Updated weights for policy 0, policy_version 1238997 (0.0008) [2023-12-26 09:29:04,591][123090] Updated weights for policy 1, policy_version 1230452 (0.0008) [2023-12-26 09:29:04,600][123091] Updated weights for policy 0, policy_version 1239007 (0.0009) [2023-12-26 09:29:04,651][123090] Updated weights for policy 1, policy_version 1230462 (0.0010) [2023-12-26 09:29:04,658][123091] Updated weights for policy 0, policy_version 1239017 (0.0007) [2023-12-26 09:29:05,378][123090] Updated weights for policy 1, policy_version 1230472 (0.0011) [2023-12-26 09:29:05,448][123090] Updated weights for policy 1, policy_version 1230482 (0.0005) [2023-12-26 09:29:05,515][123090] Updated weights for policy 1, policy_version 1230492 (0.0005) [2023-12-26 09:29:05,519][123091] Updated weights for policy 0, policy_version 1239027 (0.0009) [2023-12-26 09:29:05,569][123091] Updated weights for policy 0, policy_version 1239037 (0.0009) [2023-12-26 09:29:05,623][123091] Updated weights for policy 0, policy_version 1239047 (0.0010) [2023-12-26 09:29:06,223][123090] Updated weights for policy 1, policy_version 1230502 (0.0005) [2023-12-26 09:29:06,291][123090] Updated weights for policy 1, policy_version 1230512 (0.0005) [2023-12-26 09:29:06,362][123090] Updated weights for policy 1, policy_version 1230522 (0.0006) [2023-12-26 09:29:06,503][123091] Updated weights for policy 0, policy_version 1239057 (0.0009) [2023-12-26 09:29:06,552][123091] Updated weights for policy 0, policy_version 1239067 (0.0009) [2023-12-26 09:29:06,606][123091] Updated weights for policy 0, policy_version 1239077 (0.0008) [2023-12-26 09:29:06,673][123091] Updated weights for policy 0, policy_version 1239087 (0.0009) [2023-12-26 09:29:07,154][123090] Updated weights for policy 1, policy_version 1230532 (0.0008) [2023-12-26 09:29:07,222][123090] Updated weights for policy 1, policy_version 1230542 (0.0010) [2023-12-26 09:29:07,277][123090] Updated weights for policy 1, policy_version 1230552 (0.0010) [2023-12-26 09:29:07,496][123091] Updated weights for policy 0, policy_version 1239097 (0.0008) [2023-12-26 09:29:07,554][123091] Updated weights for policy 0, policy_version 1239107 (0.0005) [2023-12-26 09:29:07,597][123091] Updated weights for policy 0, policy_version 1239117 (0.0005) [2023-12-26 09:29:08,016][123090] Updated weights for policy 1, policy_version 1230562 (0.0010) [2023-12-26 09:29:08,069][123090] Updated weights for policy 1, policy_version 1230572 (0.0010) [2023-12-26 09:29:08,128][123090] Updated weights for policy 1, policy_version 1230582 (0.0010) [2023-12-26 09:29:08,180][123090] Updated weights for policy 1, policy_version 1230592 (0.0010) [2023-12-26 09:29:08,290][123091] Updated weights for policy 0, policy_version 1239127 (0.0005) [2023-12-26 09:29:08,363][123091] Updated weights for policy 0, policy_version 1239137 (0.0007) [2023-12-26 09:29:08,431][123091] Updated weights for policy 0, policy_version 1239147 (0.0009) [2023-12-26 09:29:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 632258560. Throughput: 0: 8878.6, 1: 9048.3. Samples: 632233152. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:08,785][121949] Avg episode reward: [(0, '6243.011'), (1, '5572.272')] [2023-12-26 09:29:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001239152_317227008.pth... [2023-12-26 09:29:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001230592_315031552.pth... [2023-12-26 09:29:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001238096_316956672.pth [2023-12-26 09:29:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001229536_314761216.pth [2023-12-26 09:29:09,038][123090] Updated weights for policy 1, policy_version 1230602 (0.0010) [2023-12-26 09:29:09,096][123091] Updated weights for policy 0, policy_version 1239157 (0.0008) [2023-12-26 09:29:09,096][123090] Updated weights for policy 1, policy_version 1230612 (0.0010) [2023-12-26 09:29:09,159][123091] Updated weights for policy 0, policy_version 1239167 (0.0006) [2023-12-26 09:29:09,160][123090] Updated weights for policy 1, policy_version 1230622 (0.0008) [2023-12-26 09:29:09,226][123091] Updated weights for policy 0, policy_version 1239177 (0.0009) [2023-12-26 09:29:10,012][123090] Updated weights for policy 1, policy_version 1230632 (0.0008) [2023-12-26 09:29:10,080][123091] Updated weights for policy 0, policy_version 1239187 (0.0008) [2023-12-26 09:29:10,083][123090] Updated weights for policy 1, policy_version 1230642 (0.0006) [2023-12-26 09:29:10,143][123091] Updated weights for policy 0, policy_version 1239197 (0.0008) [2023-12-26 09:29:10,144][123090] Updated weights for policy 1, policy_version 1230652 (0.0009) [2023-12-26 09:29:10,219][123091] Updated weights for policy 0, policy_version 1239207 (0.0009) [2023-12-26 09:29:10,972][123090] Updated weights for policy 1, policy_version 1230662 (0.0009) [2023-12-26 09:29:11,033][123090] Updated weights for policy 1, policy_version 1230672 (0.0010) [2023-12-26 09:29:11,036][123091] Updated weights for policy 0, policy_version 1239217 (0.0009) [2023-12-26 09:29:11,100][123091] Updated weights for policy 0, policy_version 1239227 (0.0008) [2023-12-26 09:29:11,101][123090] Updated weights for policy 1, policy_version 1230682 (0.0011) [2023-12-26 09:29:11,168][123091] Updated weights for policy 0, policy_version 1239237 (0.0008) [2023-12-26 09:29:11,222][123091] Updated weights for policy 0, policy_version 1239247 (0.0009) [2023-12-26 09:29:11,956][123090] Updated weights for policy 1, policy_version 1230692 (0.0010) [2023-12-26 09:29:12,021][123090] Updated weights for policy 1, policy_version 1230702 (0.0007) [2023-12-26 09:29:12,085][123090] Updated weights for policy 1, policy_version 1230712 (0.0008) [2023-12-26 09:29:12,109][123091] Updated weights for policy 0, policy_version 1239257 (0.0009) [2023-12-26 09:29:12,173][123091] Updated weights for policy 0, policy_version 1239267 (0.0010) [2023-12-26 09:29:12,231][123091] Updated weights for policy 0, policy_version 1239277 (0.0010) [2023-12-26 09:29:12,898][123090] Updated weights for policy 1, policy_version 1230722 (0.0007) [2023-12-26 09:29:12,949][123090] Updated weights for policy 1, policy_version 1230732 (0.0008) [2023-12-26 09:29:13,000][123090] Updated weights for policy 1, policy_version 1230742 (0.0008) [2023-12-26 09:29:13,041][123091] Updated weights for policy 0, policy_version 1239287 (0.0006) [2023-12-26 09:29:13,057][123090] Updated weights for policy 1, policy_version 1230752 (0.0010) [2023-12-26 09:29:13,093][123091] Updated weights for policy 0, policy_version 1239297 (0.0008) [2023-12-26 09:29:13,143][123091] Updated weights for policy 0, policy_version 1239307 (0.0010) [2023-12-26 09:29:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 632340480. Throughput: 0: 8934.1, 1: 8980.2. Samples: 632337856. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:13,784][121949] Avg episode reward: [(0, '6185.444'), (1, '5556.346')] [2023-12-26 09:29:13,849][123090] Updated weights for policy 1, policy_version 1230762 (0.0008) [2023-12-26 09:29:13,914][123090] Updated weights for policy 1, policy_version 1230772 (0.0008) [2023-12-26 09:29:13,978][123090] Updated weights for policy 1, policy_version 1230782 (0.0007) [2023-12-26 09:29:14,003][123091] Updated weights for policy 0, policy_version 1239317 (0.0008) [2023-12-26 09:29:14,049][123091] Updated weights for policy 0, policy_version 1239327 (0.0006) [2023-12-26 09:29:14,111][123091] Updated weights for policy 0, policy_version 1239337 (0.0005) [2023-12-26 09:29:14,658][123090] Updated weights for policy 1, policy_version 1230792 (0.0005) [2023-12-26 09:29:14,707][123090] Updated weights for policy 1, policy_version 1230802 (0.0005) [2023-12-26 09:29:14,762][123090] Updated weights for policy 1, policy_version 1230812 (0.0006) [2023-12-26 09:29:14,812][123091] Updated weights for policy 0, policy_version 1239347 (0.0006) [2023-12-26 09:29:14,882][123091] Updated weights for policy 0, policy_version 1239357 (0.0009) [2023-12-26 09:29:14,949][123091] Updated weights for policy 0, policy_version 1239367 (0.0009) [2023-12-26 09:29:15,603][123090] Updated weights for policy 1, policy_version 1230822 (0.0009) [2023-12-26 09:29:15,668][123090] Updated weights for policy 1, policy_version 1230832 (0.0010) [2023-12-26 09:29:15,675][123091] Updated weights for policy 0, policy_version 1239377 (0.0009) [2023-12-26 09:29:15,732][123090] Updated weights for policy 1, policy_version 1230842 (0.0011) [2023-12-26 09:29:15,739][123091] Updated weights for policy 0, policy_version 1239387 (0.0006) [2023-12-26 09:29:15,796][123091] Updated weights for policy 0, policy_version 1239397 (0.0007) [2023-12-26 09:29:15,852][123091] Updated weights for policy 0, policy_version 1239407 (0.0008) [2023-12-26 09:29:16,465][123090] Updated weights for policy 1, policy_version 1230852 (0.0008) [2023-12-26 09:29:16,511][123090] Updated weights for policy 1, policy_version 1230862 (0.0005) [2023-12-26 09:29:16,569][123090] Updated weights for policy 1, policy_version 1230872 (0.0006) [2023-12-26 09:29:16,580][123091] Updated weights for policy 0, policy_version 1239417 (0.0006) [2023-12-26 09:29:16,637][123091] Updated weights for policy 0, policy_version 1239427 (0.0005) [2023-12-26 09:29:16,693][123091] Updated weights for policy 0, policy_version 1239437 (0.0005) [2023-12-26 09:29:17,299][123090] Updated weights for policy 1, policy_version 1230882 (0.0006) [2023-12-26 09:29:17,348][123090] Updated weights for policy 1, policy_version 1230892 (0.0005) [2023-12-26 09:29:17,407][123090] Updated weights for policy 1, policy_version 1230902 (0.0005) [2023-12-26 09:29:17,465][123090] Updated weights for policy 1, policy_version 1230912 (0.0006) [2023-12-26 09:29:17,467][123091] Updated weights for policy 0, policy_version 1239447 (0.0009) [2023-12-26 09:29:17,528][123091] Updated weights for policy 0, policy_version 1239457 (0.0006) [2023-12-26 09:29:17,585][123091] Updated weights for policy 0, policy_version 1239467 (0.0005) [2023-12-26 09:29:18,079][123090] Updated weights for policy 1, policy_version 1230922 (0.0005) [2023-12-26 09:29:18,139][123090] Updated weights for policy 1, policy_version 1230932 (0.0005) [2023-12-26 09:29:18,208][123090] Updated weights for policy 1, policy_version 1230942 (0.0005) [2023-12-26 09:29:18,232][123091] Updated weights for policy 0, policy_version 1239477 (0.0006) [2023-12-26 09:29:18,300][123091] Updated weights for policy 0, policy_version 1239487 (0.0005) [2023-12-26 09:29:18,374][123091] Updated weights for policy 0, policy_version 1239497 (0.0008) [2023-12-26 09:29:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 632438784. Throughput: 0: 8984.1, 1: 8981.4. Samples: 632451172. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:18,785][121949] Avg episode reward: [(0, '6206.092'), (1, '5409.919')] [2023-12-26 09:29:18,936][123090] Updated weights for policy 1, policy_version 1230952 (0.0009) [2023-12-26 09:29:18,984][123090] Updated weights for policy 1, policy_version 1230962 (0.0010) [2023-12-26 09:29:19,046][123090] Updated weights for policy 1, policy_version 1230972 (0.0010) [2023-12-26 09:29:19,136][123091] Updated weights for policy 0, policy_version 1239507 (0.0008) [2023-12-26 09:29:19,185][123091] Updated weights for policy 0, policy_version 1239517 (0.0009) [2023-12-26 09:29:19,248][123091] Updated weights for policy 0, policy_version 1239527 (0.0007) [2023-12-26 09:29:19,908][123090] Updated weights for policy 1, policy_version 1230982 (0.0008) [2023-12-26 09:29:19,986][123090] Updated weights for policy 1, policy_version 1230992 (0.0007) [2023-12-26 09:29:20,058][123090] Updated weights for policy 1, policy_version 1231002 (0.0007) [2023-12-26 09:29:20,079][123091] Updated weights for policy 0, policy_version 1239537 (0.0008) [2023-12-26 09:29:20,144][123091] Updated weights for policy 0, policy_version 1239547 (0.0011) [2023-12-26 09:29:20,209][123091] Updated weights for policy 0, policy_version 1239557 (0.0007) [2023-12-26 09:29:20,275][123091] Updated weights for policy 0, policy_version 1239567 (0.0005) [2023-12-26 09:29:20,882][123090] Updated weights for policy 1, policy_version 1231012 (0.0009) [2023-12-26 09:29:20,948][123090] Updated weights for policy 1, policy_version 1231022 (0.0009) [2023-12-26 09:29:21,021][123090] Updated weights for policy 1, policy_version 1231032 (0.0008) [2023-12-26 09:29:21,034][123091] Updated weights for policy 0, policy_version 1239577 (0.0010) [2023-12-26 09:29:21,092][123091] Updated weights for policy 0, policy_version 1239587 (0.0009) [2023-12-26 09:29:21,162][123091] Updated weights for policy 0, policy_version 1239597 (0.0007) [2023-12-26 09:29:21,876][123090] Updated weights for policy 1, policy_version 1231042 (0.0007) [2023-12-26 09:29:21,914][123091] Updated weights for policy 0, policy_version 1239607 (0.0009) [2023-12-26 09:29:21,938][123090] Updated weights for policy 1, policy_version 1231052 (0.0006) [2023-12-26 09:29:21,970][123091] Updated weights for policy 0, policy_version 1239617 (0.0007) [2023-12-26 09:29:22,010][123090] Updated weights for policy 1, policy_version 1231062 (0.0009) [2023-12-26 09:29:22,025][123091] Updated weights for policy 0, policy_version 1239627 (0.0006) [2023-12-26 09:29:22,076][123090] Updated weights for policy 1, policy_version 1231072 (0.0009) [2023-12-26 09:29:22,761][123091] Updated weights for policy 0, policy_version 1239637 (0.0006) [2023-12-26 09:29:22,834][123091] Updated weights for policy 0, policy_version 1239647 (0.0008) [2023-12-26 09:29:22,904][123091] Updated weights for policy 0, policy_version 1239657 (0.0009) [2023-12-26 09:29:22,973][123090] Updated weights for policy 1, policy_version 1231082 (0.0010) [2023-12-26 09:29:23,038][123090] Updated weights for policy 1, policy_version 1231092 (0.0010) [2023-12-26 09:29:23,090][123090] Updated weights for policy 1, policy_version 1231102 (0.0010) [2023-12-26 09:29:23,641][123091] Updated weights for policy 0, policy_version 1239667 (0.0009) [2023-12-26 09:29:23,696][123091] Updated weights for policy 0, policy_version 1239677 (0.0009) [2023-12-26 09:29:23,744][123091] Updated weights for policy 0, policy_version 1239687 (0.0009) [2023-12-26 09:29:23,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 632520704. Throughput: 0: 8978.8, 1: 8950.1. Samples: 632503212. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:23,785][121949] Avg episode reward: [(0, '6223.451'), (1, '5285.917')] [2023-12-26 09:29:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001239696_317366272.pth... [2023-12-26 09:29:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001238640_317095936.pth [2023-12-26 09:29:23,843][123090] Updated weights for policy 1, policy_version 1231112 (0.0010) [2023-12-26 09:29:23,890][123090] Updated weights for policy 1, policy_version 1231122 (0.0010) [2023-12-26 09:29:23,938][123090] Updated weights for policy 1, policy_version 1231132 (0.0010) [2023-12-26 09:29:23,960][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001231136_315170816.pth... [2023-12-26 09:29:23,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001230048_314892288.pth [2023-12-26 09:29:24,581][123091] Updated weights for policy 0, policy_version 1239697 (0.0008) [2023-12-26 09:29:24,643][123091] Updated weights for policy 0, policy_version 1239707 (0.0009) [2023-12-26 09:29:24,702][123091] Updated weights for policy 0, policy_version 1239717 (0.0008) [2023-12-26 09:29:24,754][123091] Updated weights for policy 0, policy_version 1239727 (0.0009) [2023-12-26 09:29:24,780][123090] Updated weights for policy 1, policy_version 1231142 (0.0010) [2023-12-26 09:29:24,827][123090] Updated weights for policy 1, policy_version 1231152 (0.0010) [2023-12-26 09:29:24,871][123090] Updated weights for policy 1, policy_version 1231162 (0.0010) [2023-12-26 09:29:25,601][123091] Updated weights for policy 0, policy_version 1239737 (0.0009) [2023-12-26 09:29:25,656][123091] Updated weights for policy 0, policy_version 1239747 (0.0009) [2023-12-26 09:29:25,708][123091] Updated weights for policy 0, policy_version 1239757 (0.0009) [2023-12-26 09:29:25,734][123090] Updated weights for policy 1, policy_version 1231172 (0.0010) [2023-12-26 09:29:25,796][123090] Updated weights for policy 1, policy_version 1231182 (0.0010) [2023-12-26 09:29:25,859][123090] Updated weights for policy 1, policy_version 1231192 (0.0010) [2023-12-26 09:29:26,541][123091] Updated weights for policy 0, policy_version 1239767 (0.0010) [2023-12-26 09:29:26,598][123091] Updated weights for policy 0, policy_version 1239777 (0.0010) [2023-12-26 09:29:26,657][123091] Updated weights for policy 0, policy_version 1239787 (0.0010) [2023-12-26 09:29:26,670][123090] Updated weights for policy 1, policy_version 1231202 (0.0010) [2023-12-26 09:29:26,714][123090] Updated weights for policy 1, policy_version 1231212 (0.0010) [2023-12-26 09:29:26,769][123090] Updated weights for policy 1, policy_version 1231222 (0.0010) [2023-12-26 09:29:26,824][123090] Updated weights for policy 1, policy_version 1231232 (0.0010) [2023-12-26 09:29:27,489][123091] Updated weights for policy 0, policy_version 1239797 (0.0010) [2023-12-26 09:29:27,543][123091] Updated weights for policy 0, policy_version 1239808 (0.0010) [2023-12-26 09:29:27,593][123091] Updated weights for policy 0, policy_version 1239818 (0.0008) [2023-12-26 09:29:27,605][123090] Updated weights for policy 1, policy_version 1231242 (0.0010) [2023-12-26 09:29:27,652][123090] Updated weights for policy 1, policy_version 1231252 (0.0010) [2023-12-26 09:29:27,699][123090] Updated weights for policy 1, policy_version 1231262 (0.0010) [2023-12-26 09:29:28,383][123091] Updated weights for policy 0, policy_version 1239828 (0.0007) [2023-12-26 09:29:28,432][123091] Updated weights for policy 0, policy_version 1239838 (0.0009) [2023-12-26 09:29:28,470][123090] Updated weights for policy 1, policy_version 1231272 (0.0008) [2023-12-26 09:29:28,482][123091] Updated weights for policy 0, policy_version 1239848 (0.0009) [2023-12-26 09:29:28,535][123090] Updated weights for policy 1, policy_version 1231282 (0.0008) [2023-12-26 09:29:28,606][123090] Updated weights for policy 1, policy_version 1231292 (0.0010) [2023-12-26 09:29:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17911.3). Total num frames: 632619008. Throughput: 0: 8968.9, 1: 8920.1. Samples: 632607068. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:28,785][121949] Avg episode reward: [(0, '6203.422'), (1, '5427.488')] [2023-12-26 09:29:29,141][123091] Updated weights for policy 0, policy_version 1239858 (0.0005) [2023-12-26 09:29:29,192][123091] Updated weights for policy 0, policy_version 1239868 (0.0005) [2023-12-26 09:29:29,247][123091] Updated weights for policy 0, policy_version 1239878 (0.0007) [2023-12-26 09:29:29,302][123091] Updated weights for policy 0, policy_version 1239888 (0.0008) [2023-12-26 09:29:29,431][123090] Updated weights for policy 1, policy_version 1231302 (0.0011) [2023-12-26 09:29:29,486][123090] Updated weights for policy 1, policy_version 1231312 (0.0010) [2023-12-26 09:29:29,541][123090] Updated weights for policy 1, policy_version 1231322 (0.0010) [2023-12-26 09:29:30,104][123091] Updated weights for policy 0, policy_version 1239898 (0.0006) [2023-12-26 09:29:30,173][123091] Updated weights for policy 0, policy_version 1239908 (0.0006) [2023-12-26 09:29:30,229][123091] Updated weights for policy 0, policy_version 1239918 (0.0009) [2023-12-26 09:29:30,384][123090] Updated weights for policy 1, policy_version 1231332 (0.0010) [2023-12-26 09:29:30,438][123090] Updated weights for policy 1, policy_version 1231342 (0.0010) [2023-12-26 09:29:30,500][123090] Updated weights for policy 1, policy_version 1231352 (0.0010) [2023-12-26 09:29:30,920][123091] Updated weights for policy 0, policy_version 1239928 (0.0008) [2023-12-26 09:29:30,971][123091] Updated weights for policy 0, policy_version 1239938 (0.0007) [2023-12-26 09:29:31,018][123091] Updated weights for policy 0, policy_version 1239948 (0.0005) [2023-12-26 09:29:31,350][123090] Updated weights for policy 1, policy_version 1231362 (0.0011) [2023-12-26 09:29:31,418][123090] Updated weights for policy 1, policy_version 1231372 (0.0011) [2023-12-26 09:29:31,480][123090] Updated weights for policy 1, policy_version 1231382 (0.0010) [2023-12-26 09:29:31,546][123090] Updated weights for policy 1, policy_version 1231392 (0.0010) [2023-12-26 09:29:31,818][123091] Updated weights for policy 0, policy_version 1239958 (0.0007) [2023-12-26 09:29:31,882][123091] Updated weights for policy 0, policy_version 1239968 (0.0008) [2023-12-26 09:29:31,944][123091] Updated weights for policy 0, policy_version 1239978 (0.0008) [2023-12-26 09:29:32,300][123090] Updated weights for policy 1, policy_version 1231402 (0.0008) [2023-12-26 09:29:32,368][123090] Updated weights for policy 1, policy_version 1231412 (0.0006) [2023-12-26 09:29:32,435][123090] Updated weights for policy 1, policy_version 1231422 (0.0011) [2023-12-26 09:29:32,720][123091] Updated weights for policy 0, policy_version 1239988 (0.0007) [2023-12-26 09:29:32,793][123091] Updated weights for policy 0, policy_version 1239998 (0.0005) [2023-12-26 09:29:32,854][123091] Updated weights for policy 0, policy_version 1240008 (0.0005) [2023-12-26 09:29:33,225][123090] Updated weights for policy 1, policy_version 1231432 (0.0010) [2023-12-26 09:29:33,282][123090] Updated weights for policy 1, policy_version 1231442 (0.0010) [2023-12-26 09:29:33,334][123090] Updated weights for policy 1, policy_version 1231452 (0.0010) [2023-12-26 09:29:33,405][123091] Updated weights for policy 0, policy_version 1240018 (0.0005) [2023-12-26 09:29:33,464][123091] Updated weights for policy 0, policy_version 1240028 (0.0009) [2023-12-26 09:29:33,522][123091] Updated weights for policy 0, policy_version 1240038 (0.0010) [2023-12-26 09:29:33,587][123091] Updated weights for policy 0, policy_version 1240048 (0.0010) [2023-12-26 09:29:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 632709120. Throughput: 0: 9001.0, 1: 8915.7. Samples: 632717248. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:33,785][121949] Avg episode reward: [(0, '6276.337'), (1, '5401.529')] [2023-12-26 09:29:34,071][123090] Updated weights for policy 1, policy_version 1231462 (0.0010) [2023-12-26 09:29:34,135][123090] Updated weights for policy 1, policy_version 1231472 (0.0010) [2023-12-26 09:29:34,214][123090] Updated weights for policy 1, policy_version 1231482 (0.0010) [2023-12-26 09:29:34,395][123091] Updated weights for policy 0, policy_version 1240058 (0.0011) [2023-12-26 09:29:34,456][123091] Updated weights for policy 0, policy_version 1240068 (0.0011) [2023-12-26 09:29:34,507][123091] Updated weights for policy 0, policy_version 1240078 (0.0011) [2023-12-26 09:29:35,021][123090] Updated weights for policy 1, policy_version 1231492 (0.0010) [2023-12-26 09:29:35,073][123090] Updated weights for policy 1, policy_version 1231502 (0.0010) [2023-12-26 09:29:35,128][123090] Updated weights for policy 1, policy_version 1231512 (0.0010) [2023-12-26 09:29:35,265][123091] Updated weights for policy 0, policy_version 1240088 (0.0007) [2023-12-26 09:29:35,327][123091] Updated weights for policy 0, policy_version 1240098 (0.0005) [2023-12-26 09:29:35,395][123091] Updated weights for policy 0, policy_version 1240108 (0.0005) [2023-12-26 09:29:35,960][123090] Updated weights for policy 1, policy_version 1231522 (0.0010) [2023-12-26 09:29:36,017][123090] Updated weights for policy 1, policy_version 1231532 (0.0010) [2023-12-26 09:29:36,078][123090] Updated weights for policy 1, policy_version 1231542 (0.0006) [2023-12-26 09:29:36,141][123091] Updated weights for policy 0, policy_version 1240118 (0.0009) [2023-12-26 09:29:36,148][123090] Updated weights for policy 1, policy_version 1231552 (0.0008) [2023-12-26 09:29:36,206][123091] Updated weights for policy 0, policy_version 1240128 (0.0010) [2023-12-26 09:29:36,269][123091] Updated weights for policy 0, policy_version 1240138 (0.0006) [2023-12-26 09:29:36,939][123091] Updated weights for policy 0, policy_version 1240148 (0.0005) [2023-12-26 09:29:36,989][123091] Updated weights for policy 0, policy_version 1240158 (0.0009) [2023-12-26 09:29:37,042][123091] Updated weights for policy 0, policy_version 1240168 (0.0009) [2023-12-26 09:29:37,057][123090] Updated weights for policy 1, policy_version 1231562 (0.0006) [2023-12-26 09:29:37,116][123090] Updated weights for policy 1, policy_version 1231572 (0.0006) [2023-12-26 09:29:37,184][123090] Updated weights for policy 1, policy_version 1231582 (0.0005) [2023-12-26 09:29:37,810][123091] Updated weights for policy 0, policy_version 1240178 (0.0010) [2023-12-26 09:29:37,880][123091] Updated weights for policy 0, policy_version 1240188 (0.0009) [2023-12-26 09:29:37,941][123091] Updated weights for policy 0, policy_version 1240198 (0.0010) [2023-12-26 09:29:37,942][123090] Updated weights for policy 1, policy_version 1231592 (0.0007) [2023-12-26 09:29:37,988][123091] Updated weights for policy 0, policy_version 1240208 (0.0006) [2023-12-26 09:29:37,995][123090] Updated weights for policy 1, policy_version 1231602 (0.0009) [2023-12-26 09:29:38,058][123090] Updated weights for policy 1, policy_version 1231612 (0.0009) [2023-12-26 09:29:38,722][123091] Updated weights for policy 0, policy_version 1240218 (0.0008) [2023-12-26 09:29:38,778][123091] Updated weights for policy 0, policy_version 1240228 (0.0008) [2023-12-26 09:29:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 632791040. Throughput: 0: 9050.0, 1: 8927.7. Samples: 632771112. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:38,785][121949] Avg episode reward: [(0, '6174.753'), (1, '5460.093')] [2023-12-26 09:29:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001231616_315293696.pth... [2023-12-26 09:29:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001230592_315031552.pth [2023-12-26 09:29:38,842][123091] Updated weights for policy 0, policy_version 1240238 (0.0009) [2023-12-26 09:29:38,849][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001240240_317505536.pth... [2023-12-26 09:29:38,852][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001239152_317227008.pth [2023-12-26 09:29:38,901][123090] Updated weights for policy 1, policy_version 1231622 (0.0009) [2023-12-26 09:29:38,958][123090] Updated weights for policy 1, policy_version 1231632 (0.0008) [2023-12-26 09:29:39,027][123090] Updated weights for policy 1, policy_version 1231642 (0.0008) [2023-12-26 09:29:39,658][123091] Updated weights for policy 0, policy_version 1240248 (0.0007) [2023-12-26 09:29:39,733][123091] Updated weights for policy 0, policy_version 1240258 (0.0005) [2023-12-26 09:29:39,803][123091] Updated weights for policy 0, policy_version 1240268 (0.0005) [2023-12-26 09:29:39,895][123090] Updated weights for policy 1, policy_version 1231652 (0.0009) [2023-12-26 09:29:39,964][123090] Updated weights for policy 1, policy_version 1231662 (0.0009) [2023-12-26 09:29:40,037][123090] Updated weights for policy 1, policy_version 1231672 (0.0010) [2023-12-26 09:29:40,572][123091] Updated weights for policy 0, policy_version 1240278 (0.0009) [2023-12-26 09:29:40,647][123091] Updated weights for policy 0, policy_version 1240288 (0.0009) [2023-12-26 09:29:40,715][123091] Updated weights for policy 0, policy_version 1240298 (0.0010) [2023-12-26 09:29:40,830][123090] Updated weights for policy 1, policy_version 1231682 (0.0008) [2023-12-26 09:29:40,886][123090] Updated weights for policy 1, policy_version 1231692 (0.0008) [2023-12-26 09:29:40,946][123090] Updated weights for policy 1, policy_version 1231702 (0.0008) [2023-12-26 09:29:41,002][123090] Updated weights for policy 1, policy_version 1231712 (0.0009) [2023-12-26 09:29:41,632][123091] Updated weights for policy 0, policy_version 1240308 (0.0009) [2023-12-26 09:29:41,699][123091] Updated weights for policy 0, policy_version 1240318 (0.0010) [2023-12-26 09:29:41,771][123091] Updated weights for policy 0, policy_version 1240328 (0.0007) [2023-12-26 09:29:41,909][123090] Updated weights for policy 1, policy_version 1231722 (0.0010) [2023-12-26 09:29:41,975][123090] Updated weights for policy 1, policy_version 1231732 (0.0010) [2023-12-26 09:29:42,029][123090] Updated weights for policy 1, policy_version 1231742 (0.0009) [2023-12-26 09:29:42,530][123091] Updated weights for policy 0, policy_version 1240338 (0.0006) [2023-12-26 09:29:42,584][123091] Updated weights for policy 0, policy_version 1240348 (0.0005) [2023-12-26 09:29:42,639][123091] Updated weights for policy 0, policy_version 1240358 (0.0006) [2023-12-26 09:29:42,686][123091] Updated weights for policy 0, policy_version 1240368 (0.0005) [2023-12-26 09:29:42,843][123090] Updated weights for policy 1, policy_version 1231752 (0.0006) [2023-12-26 09:29:42,928][123090] Updated weights for policy 1, policy_version 1231762 (0.0005) [2023-12-26 09:29:43,005][123090] Updated weights for policy 1, policy_version 1231772 (0.0005) [2023-12-26 09:29:43,382][123091] Updated weights for policy 0, policy_version 1240378 (0.0010) [2023-12-26 09:29:43,454][123091] Updated weights for policy 0, policy_version 1240388 (0.0010) [2023-12-26 09:29:43,521][123091] Updated weights for policy 0, policy_version 1240398 (0.0010) [2023-12-26 09:29:43,527][123090] Updated weights for policy 1, policy_version 1231782 (0.0005) [2023-12-26 09:29:43,584][123090] Updated weights for policy 1, policy_version 1231792 (0.0005) [2023-12-26 09:29:43,643][123090] Updated weights for policy 1, policy_version 1231802 (0.0006) [2023-12-26 09:29:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 632889344. Throughput: 0: 9033.9, 1: 8833.8. Samples: 632875624. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:43,785][121949] Avg episode reward: [(0, '6087.802'), (1, '5447.627')] [2023-12-26 09:29:44,238][123091] Updated weights for policy 0, policy_version 1240408 (0.0010) [2023-12-26 09:29:44,301][123091] Updated weights for policy 0, policy_version 1240418 (0.0007) [2023-12-26 09:29:44,340][123090] Updated weights for policy 1, policy_version 1231812 (0.0005) [2023-12-26 09:29:44,362][123091] Updated weights for policy 0, policy_version 1240428 (0.0006) [2023-12-26 09:29:44,402][123090] Updated weights for policy 1, policy_version 1231822 (0.0007) [2023-12-26 09:29:44,457][123090] Updated weights for policy 1, policy_version 1231832 (0.0008) [2023-12-26 09:29:45,171][123091] Updated weights for policy 0, policy_version 1240438 (0.0010) [2023-12-26 09:29:45,176][123090] Updated weights for policy 1, policy_version 1231842 (0.0005) [2023-12-26 09:29:45,234][123091] Updated weights for policy 0, policy_version 1240448 (0.0011) [2023-12-26 09:29:45,241][123090] Updated weights for policy 1, policy_version 1231852 (0.0006) [2023-12-26 09:29:45,301][123091] Updated weights for policy 0, policy_version 1240458 (0.0010) [2023-12-26 09:29:45,313][123090] Updated weights for policy 1, policy_version 1231862 (0.0006) [2023-12-26 09:29:45,370][123090] Updated weights for policy 1, policy_version 1231872 (0.0008) [2023-12-26 09:29:46,099][123090] Updated weights for policy 1, policy_version 1231882 (0.0009) [2023-12-26 09:29:46,159][123091] Updated weights for policy 0, policy_version 1240468 (0.0009) [2023-12-26 09:29:46,161][123090] Updated weights for policy 1, policy_version 1231892 (0.0009) [2023-12-26 09:29:46,220][123091] Updated weights for policy 0, policy_version 1240478 (0.0009) [2023-12-26 09:29:46,225][123090] Updated weights for policy 1, policy_version 1231902 (0.0008) [2023-12-26 09:29:46,286][123091] Updated weights for policy 0, policy_version 1240488 (0.0010) [2023-12-26 09:29:46,978][123090] Updated weights for policy 1, policy_version 1231912 (0.0006) [2023-12-26 09:29:47,047][123090] Updated weights for policy 1, policy_version 1231922 (0.0008) [2023-12-26 09:29:47,103][123090] Updated weights for policy 1, policy_version 1231932 (0.0009) [2023-12-26 09:29:47,114][123091] Updated weights for policy 0, policy_version 1240498 (0.0011) [2023-12-26 09:29:47,162][123091] Updated weights for policy 0, policy_version 1240508 (0.0010) [2023-12-26 09:29:47,220][123091] Updated weights for policy 0, policy_version 1240518 (0.0010) [2023-12-26 09:29:47,271][123091] Updated weights for policy 0, policy_version 1240528 (0.0010) [2023-12-26 09:29:47,923][123090] Updated weights for policy 1, policy_version 1231942 (0.0005) [2023-12-26 09:29:47,978][123090] Updated weights for policy 1, policy_version 1231952 (0.0005) [2023-12-26 09:29:48,006][123091] Updated weights for policy 0, policy_version 1240538 (0.0008) [2023-12-26 09:29:48,045][123090] Updated weights for policy 1, policy_version 1231962 (0.0008) [2023-12-26 09:29:48,062][123091] Updated weights for policy 0, policy_version 1240548 (0.0009) [2023-12-26 09:29:48,121][123091] Updated weights for policy 0, policy_version 1240558 (0.0010) [2023-12-26 09:29:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 632971264. Throughput: 0: 9054.8, 1: 8847.6. Samples: 632986520. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:48,784][121949] Avg episode reward: [(0, '6147.393'), (1, '5548.678')] [2023-12-26 09:29:48,895][123090] Updated weights for policy 1, policy_version 1231972 (0.0009) [2023-12-26 09:29:48,902][123091] Updated weights for policy 0, policy_version 1240568 (0.0006) [2023-12-26 09:29:48,951][123090] Updated weights for policy 1, policy_version 1231982 (0.0008) [2023-12-26 09:29:48,961][123091] Updated weights for policy 0, policy_version 1240578 (0.0007) [2023-12-26 09:29:49,007][123090] Updated weights for policy 1, policy_version 1231992 (0.0009) [2023-12-26 09:29:49,026][123091] Updated weights for policy 0, policy_version 1240588 (0.0006) [2023-12-26 09:29:49,801][123090] Updated weights for policy 1, policy_version 1232002 (0.0008) [2023-12-26 09:29:49,811][123091] Updated weights for policy 0, policy_version 1240598 (0.0009) [2023-12-26 09:29:49,871][123090] Updated weights for policy 1, policy_version 1232012 (0.0008) [2023-12-26 09:29:49,881][123091] Updated weights for policy 0, policy_version 1240608 (0.0007) [2023-12-26 09:29:49,941][123090] Updated weights for policy 1, policy_version 1232022 (0.0008) [2023-12-26 09:29:49,952][123091] Updated weights for policy 0, policy_version 1240618 (0.0007) [2023-12-26 09:29:50,007][123090] Updated weights for policy 1, policy_version 1232032 (0.0008) [2023-12-26 09:29:50,761][123090] Updated weights for policy 1, policy_version 1232042 (0.0010) [2023-12-26 09:29:50,793][123091] Updated weights for policy 0, policy_version 1240628 (0.0009) [2023-12-26 09:29:50,826][123090] Updated weights for policy 1, policy_version 1232052 (0.0009) [2023-12-26 09:29:50,846][123091] Updated weights for policy 0, policy_version 1240638 (0.0009) [2023-12-26 09:29:50,883][123090] Updated weights for policy 1, policy_version 1232062 (0.0008) [2023-12-26 09:29:50,906][123091] Updated weights for policy 0, policy_version 1240648 (0.0009) [2023-12-26 09:29:51,634][123090] Updated weights for policy 1, policy_version 1232072 (0.0009) [2023-12-26 09:29:51,710][123090] Updated weights for policy 1, policy_version 1232082 (0.0010) [2023-12-26 09:29:51,761][123091] Updated weights for policy 0, policy_version 1240658 (0.0008) [2023-12-26 09:29:51,776][123090] Updated weights for policy 1, policy_version 1232092 (0.0009) [2023-12-26 09:29:51,828][123091] Updated weights for policy 0, policy_version 1240668 (0.0009) [2023-12-26 09:29:51,898][123091] Updated weights for policy 0, policy_version 1240678 (0.0010) [2023-12-26 09:29:51,961][123091] Updated weights for policy 0, policy_version 1240688 (0.0010) [2023-12-26 09:29:52,522][123090] Updated weights for policy 1, policy_version 1232102 (0.0006) [2023-12-26 09:29:52,592][123090] Updated weights for policy 1, policy_version 1232112 (0.0007) [2023-12-26 09:29:52,651][123090] Updated weights for policy 1, policy_version 1232122 (0.0010) [2023-12-26 09:29:52,835][123091] Updated weights for policy 0, policy_version 1240698 (0.0010) [2023-12-26 09:29:52,901][123091] Updated weights for policy 0, policy_version 1240708 (0.0009) [2023-12-26 09:29:52,954][123091] Updated weights for policy 0, policy_version 1240718 (0.0009) [2023-12-26 09:29:53,427][123090] Updated weights for policy 1, policy_version 1232132 (0.0007) [2023-12-26 09:29:53,494][123090] Updated weights for policy 1, policy_version 1232142 (0.0005) [2023-12-26 09:29:53,557][123090] Updated weights for policy 1, policy_version 1232152 (0.0006) [2023-12-26 09:29:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 633061376. Throughput: 0: 9081.4, 1: 8833.2. Samples: 633039308. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:53,785][121949] Avg episode reward: [(0, '6164.128'), (1, '5593.482')] [2023-12-26 09:29:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001232160_315432960.pth... [2023-12-26 09:29:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001231136_315170816.pth [2023-12-26 09:29:53,825][123091] Updated weights for policy 0, policy_version 1240728 (0.0010) [2023-12-26 09:29:53,905][123091] Updated weights for policy 0, policy_version 1240738 (0.0009) [2023-12-26 09:29:53,974][123091] Updated weights for policy 0, policy_version 1240748 (0.0010) [2023-12-26 09:29:53,992][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001240752_317636608.pth... [2023-12-26 09:29:53,995][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001239696_317366272.pth [2023-12-26 09:29:54,217][123090] Updated weights for policy 1, policy_version 1232162 (0.0006) [2023-12-26 09:29:54,268][123090] Updated weights for policy 1, policy_version 1232172 (0.0008) [2023-12-26 09:29:54,324][123090] Updated weights for policy 1, policy_version 1232182 (0.0008) [2023-12-26 09:29:54,379][123090] Updated weights for policy 1, policy_version 1232192 (0.0008) [2023-12-26 09:29:54,807][123091] Updated weights for policy 0, policy_version 1240758 (0.0010) [2023-12-26 09:29:54,875][123091] Updated weights for policy 0, policy_version 1240768 (0.0010) [2023-12-26 09:29:54,947][123091] Updated weights for policy 0, policy_version 1240778 (0.0009) [2023-12-26 09:29:55,197][123090] Updated weights for policy 1, policy_version 1232202 (0.0009) [2023-12-26 09:29:55,254][123090] Updated weights for policy 1, policy_version 1232212 (0.0009) [2023-12-26 09:29:55,311][123090] Updated weights for policy 1, policy_version 1232222 (0.0009) [2023-12-26 09:29:55,610][123091] Updated weights for policy 0, policy_version 1240788 (0.0005) [2023-12-26 09:29:55,656][123091] Updated weights for policy 0, policy_version 1240798 (0.0006) [2023-12-26 09:29:55,708][123091] Updated weights for policy 0, policy_version 1240808 (0.0008) [2023-12-26 09:29:56,167][123090] Updated weights for policy 1, policy_version 1232232 (0.0010) [2023-12-26 09:29:56,225][123090] Updated weights for policy 1, policy_version 1232242 (0.0009) [2023-12-26 09:29:56,285][123090] Updated weights for policy 1, policy_version 1232252 (0.0010) [2023-12-26 09:29:56,497][123091] Updated weights for policy 0, policy_version 1240818 (0.0008) [2023-12-26 09:29:56,545][123091] Updated weights for policy 0, policy_version 1240828 (0.0006) [2023-12-26 09:29:56,597][123091] Updated weights for policy 0, policy_version 1240838 (0.0009) [2023-12-26 09:29:56,653][123091] Updated weights for policy 0, policy_version 1240848 (0.0010) [2023-12-26 09:29:57,068][123090] Updated weights for policy 1, policy_version 1232262 (0.0007) [2023-12-26 09:29:57,133][123090] Updated weights for policy 1, policy_version 1232272 (0.0005) [2023-12-26 09:29:57,202][123090] Updated weights for policy 1, policy_version 1232282 (0.0008) [2023-12-26 09:29:57,513][123091] Updated weights for policy 0, policy_version 1240858 (0.0010) [2023-12-26 09:29:57,557][123091] Updated weights for policy 0, policy_version 1240868 (0.0010) [2023-12-26 09:29:57,602][123091] Updated weights for policy 0, policy_version 1240878 (0.0009) [2023-12-26 09:29:57,804][123090] Updated weights for policy 1, policy_version 1232292 (0.0007) [2023-12-26 09:29:57,872][123090] Updated weights for policy 1, policy_version 1232302 (0.0006) [2023-12-26 09:29:57,925][123090] Updated weights for policy 1, policy_version 1232312 (0.0005) [2023-12-26 09:29:58,496][123091] Updated weights for policy 0, policy_version 1240888 (0.0007) [2023-12-26 09:29:58,569][123091] Updated weights for policy 0, policy_version 1240898 (0.0007) [2023-12-26 09:29:58,636][123091] Updated weights for policy 0, policy_version 1240908 (0.0008) [2023-12-26 09:29:58,699][123090] Updated weights for policy 1, policy_version 1232322 (0.0008) [2023-12-26 09:29:58,767][123090] Updated weights for policy 1, policy_version 1232332 (0.0008) [2023-12-26 09:29:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 633151488. Throughput: 0: 9029.9, 1: 8929.1. Samples: 633146012. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:29:58,785][121949] Avg episode reward: [(0, '6157.708'), (1, '5592.534')] [2023-12-26 09:29:58,837][123090] Updated weights for policy 1, policy_version 1232342 (0.0008) [2023-12-26 09:29:58,904][123090] Updated weights for policy 1, policy_version 1232352 (0.0008) [2023-12-26 09:29:59,410][123091] Updated weights for policy 0, policy_version 1240918 (0.0007) [2023-12-26 09:29:59,468][123091] Updated weights for policy 0, policy_version 1240928 (0.0005) [2023-12-26 09:29:59,534][123091] Updated weights for policy 0, policy_version 1240938 (0.0006) [2023-12-26 09:29:59,652][123090] Updated weights for policy 1, policy_version 1232362 (0.0010) [2023-12-26 09:29:59,701][123090] Updated weights for policy 1, policy_version 1232372 (0.0009) [2023-12-26 09:29:59,766][123090] Updated weights for policy 1, policy_version 1232382 (0.0009) [2023-12-26 09:30:00,287][123091] Updated weights for policy 0, policy_version 1240948 (0.0007) [2023-12-26 09:30:00,353][123091] Updated weights for policy 0, policy_version 1240958 (0.0009) [2023-12-26 09:30:00,422][123091] Updated weights for policy 0, policy_version 1240968 (0.0011) [2023-12-26 09:30:00,643][123090] Updated weights for policy 1, policy_version 1232392 (0.0008) [2023-12-26 09:30:00,691][123090] Updated weights for policy 1, policy_version 1232402 (0.0009) [2023-12-26 09:30:00,741][123090] Updated weights for policy 1, policy_version 1232412 (0.0008) [2023-12-26 09:30:01,138][123091] Updated weights for policy 0, policy_version 1240978 (0.0010) [2023-12-26 09:30:01,200][123091] Updated weights for policy 0, policy_version 1240988 (0.0008) [2023-12-26 09:30:01,265][123091] Updated weights for policy 0, policy_version 1240998 (0.0009) [2023-12-26 09:30:01,335][123091] Updated weights for policy 0, policy_version 1241008 (0.0010) [2023-12-26 09:30:01,651][123090] Updated weights for policy 1, policy_version 1232422 (0.0008) [2023-12-26 09:30:01,713][123090] Updated weights for policy 1, policy_version 1232432 (0.0009) [2023-12-26 09:30:01,774][123090] Updated weights for policy 1, policy_version 1232442 (0.0010) [2023-12-26 09:30:02,085][123091] Updated weights for policy 0, policy_version 1241018 (0.0005) [2023-12-26 09:30:02,161][123091] Updated weights for policy 0, policy_version 1241028 (0.0006) [2023-12-26 09:30:02,227][123091] Updated weights for policy 0, policy_version 1241038 (0.0006) [2023-12-26 09:30:02,581][123090] Updated weights for policy 1, policy_version 1232452 (0.0008) [2023-12-26 09:30:02,651][123090] Updated weights for policy 1, policy_version 1232462 (0.0005) [2023-12-26 09:30:02,719][123090] Updated weights for policy 1, policy_version 1232472 (0.0005) [2023-12-26 09:30:02,904][123091] Updated weights for policy 0, policy_version 1241048 (0.0006) [2023-12-26 09:30:02,953][123091] Updated weights for policy 0, policy_version 1241058 (0.0005) [2023-12-26 09:30:03,016][123091] Updated weights for policy 0, policy_version 1241068 (0.0009) [2023-12-26 09:30:03,506][123090] Updated weights for policy 1, policy_version 1232482 (0.0010) [2023-12-26 09:30:03,564][123090] Updated weights for policy 1, policy_version 1232492 (0.0010) [2023-12-26 09:30:03,638][123090] Updated weights for policy 1, policy_version 1232502 (0.0005) [2023-12-26 09:30:03,696][123090] Updated weights for policy 1, policy_version 1232512 (0.0007) [2023-12-26 09:30:03,702][123091] Updated weights for policy 0, policy_version 1241078 (0.0010) [2023-12-26 09:30:03,756][123091] Updated weights for policy 0, policy_version 1241088 (0.0010) [2023-12-26 09:30:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 633241600. Throughput: 0: 9019.5, 1: 8821.8. Samples: 633254028. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:03,785][121949] Avg episode reward: [(0, '6269.236'), (1, '5696.542')] [2023-12-26 09:30:03,821][123091] Updated weights for policy 0, policy_version 1241098 (0.0010) [2023-12-26 09:30:04,471][123090] Updated weights for policy 1, policy_version 1232522 (0.0008) [2023-12-26 09:30:04,529][123090] Updated weights for policy 1, policy_version 1232532 (0.0008) [2023-12-26 09:30:04,578][123090] Updated weights for policy 1, policy_version 1232542 (0.0008) [2023-12-26 09:30:04,663][123091] Updated weights for policy 0, policy_version 1241108 (0.0010) [2023-12-26 09:30:04,735][123091] Updated weights for policy 0, policy_version 1241118 (0.0011) [2023-12-26 09:30:04,801][123091] Updated weights for policy 0, policy_version 1241128 (0.0010) [2023-12-26 09:30:05,324][123090] Updated weights for policy 1, policy_version 1232552 (0.0008) [2023-12-26 09:30:05,376][123090] Updated weights for policy 1, policy_version 1232562 (0.0009) [2023-12-26 09:30:05,426][123090] Updated weights for policy 1, policy_version 1232572 (0.0009) [2023-12-26 09:30:05,604][123091] Updated weights for policy 0, policy_version 1241138 (0.0011) [2023-12-26 09:30:05,667][123091] Updated weights for policy 0, policy_version 1241148 (0.0011) [2023-12-26 09:30:05,741][123091] Updated weights for policy 0, policy_version 1241158 (0.0011) [2023-12-26 09:30:05,803][123091] Updated weights for policy 0, policy_version 1241168 (0.0010) [2023-12-26 09:30:06,252][123090] Updated weights for policy 1, policy_version 1232582 (0.0008) [2023-12-26 09:30:06,319][123090] Updated weights for policy 1, policy_version 1232592 (0.0008) [2023-12-26 09:30:06,384][123090] Updated weights for policy 1, policy_version 1232602 (0.0009) [2023-12-26 09:30:06,617][123091] Updated weights for policy 0, policy_version 1241178 (0.0011) [2023-12-26 09:30:06,688][123091] Updated weights for policy 0, policy_version 1241188 (0.0008) [2023-12-26 09:30:06,758][123091] Updated weights for policy 0, policy_version 1241198 (0.0008) [2023-12-26 09:30:07,221][123090] Updated weights for policy 1, policy_version 1232612 (0.0009) [2023-12-26 09:30:07,275][123090] Updated weights for policy 1, policy_version 1232622 (0.0009) [2023-12-26 09:30:07,329][123090] Updated weights for policy 1, policy_version 1232632 (0.0010) [2023-12-26 09:30:07,432][123091] Updated weights for policy 0, policy_version 1241208 (0.0008) [2023-12-26 09:30:07,496][123091] Updated weights for policy 0, policy_version 1241218 (0.0009) [2023-12-26 09:30:07,553][123091] Updated weights for policy 0, policy_version 1241228 (0.0009) [2023-12-26 09:30:08,221][123090] Updated weights for policy 1, policy_version 1232642 (0.0010) [2023-12-26 09:30:08,276][123090] Updated weights for policy 1, policy_version 1232652 (0.0009) [2023-12-26 09:30:08,335][123090] Updated weights for policy 1, policy_version 1232662 (0.0009) [2023-12-26 09:30:08,350][123091] Updated weights for policy 0, policy_version 1241238 (0.0009) [2023-12-26 09:30:08,403][123090] Updated weights for policy 1, policy_version 1232672 (0.0008) [2023-12-26 09:30:08,418][123091] Updated weights for policy 0, policy_version 1241248 (0.0008) [2023-12-26 09:30:08,484][123091] Updated weights for policy 0, policy_version 1241258 (0.0005) [2023-12-26 09:30:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 633331712. Throughput: 0: 8985.9, 1: 8866.4. Samples: 633306560. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:08,785][121949] Avg episode reward: [(0, '6165.602'), (1, '5799.460')] [2023-12-26 09:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001232672_315564032.pth... [2023-12-26 09:30:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001241264_317767680.pth... [2023-12-26 09:30:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001240240_317505536.pth [2023-12-26 09:30:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001231616_315293696.pth [2023-12-26 09:30:09,184][123091] Updated weights for policy 0, policy_version 1241268 (0.0007) [2023-12-26 09:30:09,241][123091] Updated weights for policy 0, policy_version 1241278 (0.0009) [2023-12-26 09:30:09,303][123091] Updated weights for policy 0, policy_version 1241288 (0.0009) [2023-12-26 09:30:09,305][123090] Updated weights for policy 1, policy_version 1232682 (0.0008) [2023-12-26 09:30:09,379][123090] Updated weights for policy 1, policy_version 1232692 (0.0009) [2023-12-26 09:30:09,457][123090] Updated weights for policy 1, policy_version 1232702 (0.0009) [2023-12-26 09:30:10,128][123091] Updated weights for policy 0, policy_version 1241298 (0.0008) [2023-12-26 09:30:10,202][123091] Updated weights for policy 0, policy_version 1241308 (0.0008) [2023-12-26 09:30:10,274][123091] Updated weights for policy 0, policy_version 1241318 (0.0009) [2023-12-26 09:30:10,324][123090] Updated weights for policy 1, policy_version 1232712 (0.0009) [2023-12-26 09:30:10,338][123091] Updated weights for policy 0, policy_version 1241328 (0.0008) [2023-12-26 09:30:10,388][123090] Updated weights for policy 1, policy_version 1232722 (0.0009) [2023-12-26 09:30:10,463][123090] Updated weights for policy 1, policy_version 1232732 (0.0010) [2023-12-26 09:30:11,127][123091] Updated weights for policy 0, policy_version 1241338 (0.0010) [2023-12-26 09:30:11,203][123090] Updated weights for policy 1, policy_version 1232742 (0.0007) [2023-12-26 09:30:11,205][123091] Updated weights for policy 0, policy_version 1241348 (0.0009) [2023-12-26 09:30:11,271][123091] Updated weights for policy 0, policy_version 1241358 (0.0008) [2023-12-26 09:30:11,272][123090] Updated weights for policy 1, policy_version 1232752 (0.0006) [2023-12-26 09:30:11,336][123090] Updated weights for policy 1, policy_version 1232762 (0.0008) [2023-12-26 09:30:12,107][123090] Updated weights for policy 1, policy_version 1232772 (0.0008) [2023-12-26 09:30:12,173][123091] Updated weights for policy 0, policy_version 1241368 (0.0008) [2023-12-26 09:30:12,175][123090] Updated weights for policy 1, policy_version 1232782 (0.0007) [2023-12-26 09:30:12,230][123091] Updated weights for policy 0, policy_version 1241378 (0.0008) [2023-12-26 09:30:12,238][123090] Updated weights for policy 1, policy_version 1232792 (0.0007) [2023-12-26 09:30:12,287][123091] Updated weights for policy 0, policy_version 1241388 (0.0009) [2023-12-26 09:30:13,088][123090] Updated weights for policy 1, policy_version 1232802 (0.0010) [2023-12-26 09:30:13,148][123090] Updated weights for policy 1, policy_version 1232812 (0.0008) [2023-12-26 09:30:13,150][123091] Updated weights for policy 0, policy_version 1241398 (0.0009) [2023-12-26 09:30:13,206][123090] Updated weights for policy 1, policy_version 1232822 (0.0007) [2023-12-26 09:30:13,208][123091] Updated weights for policy 0, policy_version 1241408 (0.0009) [2023-12-26 09:30:13,263][123090] Updated weights for policy 1, policy_version 1232832 (0.0006) [2023-12-26 09:30:13,265][123091] Updated weights for policy 0, policy_version 1241418 (0.0009) [2023-12-26 09:30:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 633413632. Throughput: 0: 8994.6, 1: 8832.6. Samples: 633409288. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:13,785][121949] Avg episode reward: [(0, '6151.800'), (1, '5778.899')] [2023-12-26 09:30:14,037][123091] Updated weights for policy 0, policy_version 1241428 (0.0007) [2023-12-26 09:30:14,104][123091] Updated weights for policy 0, policy_version 1241438 (0.0007) [2023-12-26 09:30:14,164][123091] Updated weights for policy 0, policy_version 1241448 (0.0006) [2023-12-26 09:30:14,166][123090] Updated weights for policy 1, policy_version 1232842 (0.0010) [2023-12-26 09:30:14,229][123090] Updated weights for policy 1, policy_version 1232852 (0.0009) [2023-12-26 09:30:14,298][123090] Updated weights for policy 1, policy_version 1232862 (0.0010) [2023-12-26 09:30:14,884][123091] Updated weights for policy 0, policy_version 1241458 (0.0007) [2023-12-26 09:30:14,933][123091] Updated weights for policy 0, policy_version 1241468 (0.0009) [2023-12-26 09:30:14,988][123091] Updated weights for policy 0, policy_version 1241478 (0.0009) [2023-12-26 09:30:15,046][123091] Updated weights for policy 0, policy_version 1241488 (0.0009) [2023-12-26 09:30:15,113][123090] Updated weights for policy 1, policy_version 1232872 (0.0009) [2023-12-26 09:30:15,182][123090] Updated weights for policy 1, policy_version 1232882 (0.0010) [2023-12-26 09:30:15,246][123090] Updated weights for policy 1, policy_version 1232892 (0.0011) [2023-12-26 09:30:15,919][123091] Updated weights for policy 0, policy_version 1241498 (0.0010) [2023-12-26 09:30:15,971][123091] Updated weights for policy 0, policy_version 1241508 (0.0009) [2023-12-26 09:30:16,019][123091] Updated weights for policy 0, policy_version 1241518 (0.0006) [2023-12-26 09:30:16,076][123090] Updated weights for policy 1, policy_version 1232902 (0.0011) [2023-12-26 09:30:16,150][123090] Updated weights for policy 1, policy_version 1232912 (0.0010) [2023-12-26 09:30:16,212][123090] Updated weights for policy 1, policy_version 1232922 (0.0010) [2023-12-26 09:30:16,724][123091] Updated weights for policy 0, policy_version 1241528 (0.0009) [2023-12-26 09:30:16,782][123091] Updated weights for policy 0, policy_version 1241538 (0.0010) [2023-12-26 09:30:16,845][123091] Updated weights for policy 0, policy_version 1241548 (0.0010) [2023-12-26 09:30:16,980][123090] Updated weights for policy 1, policy_version 1232932 (0.0010) [2023-12-26 09:30:17,039][123090] Updated weights for policy 1, policy_version 1232942 (0.0010) [2023-12-26 09:30:17,096][123090] Updated weights for policy 1, policy_version 1232952 (0.0011) [2023-12-26 09:30:17,655][123091] Updated weights for policy 0, policy_version 1241558 (0.0010) [2023-12-26 09:30:17,703][123091] Updated weights for policy 0, policy_version 1241568 (0.0010) [2023-12-26 09:30:17,754][123091] Updated weights for policy 0, policy_version 1241578 (0.0010) [2023-12-26 09:30:17,922][123090] Updated weights for policy 1, policy_version 1232962 (0.0009) [2023-12-26 09:30:17,973][123090] Updated weights for policy 1, policy_version 1232972 (0.0005) [2023-12-26 09:30:18,037][123090] Updated weights for policy 1, policy_version 1232982 (0.0007) [2023-12-26 09:30:18,099][123090] Updated weights for policy 1, policy_version 1232992 (0.0010) [2023-12-26 09:30:18,649][123091] Updated weights for policy 0, policy_version 1241588 (0.0010) [2023-12-26 09:30:18,715][123091] Updated weights for policy 0, policy_version 1241598 (0.0011) [2023-12-26 09:30:18,778][123091] Updated weights for policy 0, policy_version 1241608 (0.0011) [2023-12-26 09:30:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 633495552. Throughput: 0: 8910.0, 1: 8814.9. Samples: 633514864. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:18,785][121949] Avg episode reward: [(0, '6256.091'), (1, '5828.739')] [2023-12-26 09:30:18,833][123090] Updated weights for policy 1, policy_version 1233002 (0.0008) [2023-12-26 09:30:18,904][123090] Updated weights for policy 1, policy_version 1233012 (0.0009) [2023-12-26 09:30:18,968][123090] Updated weights for policy 1, policy_version 1233022 (0.0009) [2023-12-26 09:30:19,645][123091] Updated weights for policy 0, policy_version 1241618 (0.0010) [2023-12-26 09:30:19,711][123091] Updated weights for policy 0, policy_version 1241628 (0.0009) [2023-12-26 09:30:19,771][123091] Updated weights for policy 0, policy_version 1241638 (0.0009) [2023-12-26 09:30:19,805][123090] Updated weights for policy 1, policy_version 1233032 (0.0008) [2023-12-26 09:30:19,835][123091] Updated weights for policy 0, policy_version 1241648 (0.0009) [2023-12-26 09:30:19,871][123090] Updated weights for policy 1, policy_version 1233042 (0.0009) [2023-12-26 09:30:19,937][123090] Updated weights for policy 1, policy_version 1233052 (0.0008) [2023-12-26 09:30:20,729][123091] Updated weights for policy 0, policy_version 1241658 (0.0009) [2023-12-26 09:30:20,732][123090] Updated weights for policy 1, policy_version 1233062 (0.0008) [2023-12-26 09:30:20,798][123091] Updated weights for policy 0, policy_version 1241668 (0.0009) [2023-12-26 09:30:20,804][123090] Updated weights for policy 1, policy_version 1233072 (0.0007) [2023-12-26 09:30:20,866][123091] Updated weights for policy 0, policy_version 1241678 (0.0010) [2023-12-26 09:30:20,873][123090] Updated weights for policy 1, policy_version 1233082 (0.0007) [2023-12-26 09:30:21,679][123091] Updated weights for policy 0, policy_version 1241688 (0.0009) [2023-12-26 09:30:21,735][123091] Updated weights for policy 0, policy_version 1241698 (0.0008) [2023-12-26 09:30:21,742][123090] Updated weights for policy 1, policy_version 1233092 (0.0010) [2023-12-26 09:30:21,805][123091] Updated weights for policy 0, policy_version 1241708 (0.0010) [2023-12-26 09:30:21,810][123090] Updated weights for policy 1, policy_version 1233102 (0.0008) [2023-12-26 09:30:21,867][123090] Updated weights for policy 1, policy_version 1233112 (0.0007) [2023-12-26 09:30:22,687][123090] Updated weights for policy 1, policy_version 1233122 (0.0006) [2023-12-26 09:30:22,706][123091] Updated weights for policy 0, policy_version 1241718 (0.0011) [2023-12-26 09:30:22,748][123090] Updated weights for policy 1, policy_version 1233132 (0.0007) [2023-12-26 09:30:22,770][123091] Updated weights for policy 0, policy_version 1241728 (0.0011) [2023-12-26 09:30:22,812][123090] Updated weights for policy 1, policy_version 1233142 (0.0006) [2023-12-26 09:30:22,831][123091] Updated weights for policy 0, policy_version 1241738 (0.0011) [2023-12-26 09:30:22,874][123090] Updated weights for policy 1, policy_version 1233152 (0.0007) [2023-12-26 09:30:23,642][123091] Updated weights for policy 0, policy_version 1241748 (0.0011) [2023-12-26 09:30:23,706][123091] Updated weights for policy 0, policy_version 1241758 (0.0007) [2023-12-26 09:30:23,734][123090] Updated weights for policy 1, policy_version 1233162 (0.0009) [2023-12-26 09:30:23,760][123091] Updated weights for policy 0, policy_version 1241768 (0.0007) [2023-12-26 09:30:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 633577472. Throughput: 0: 8835.2, 1: 8795.6. Samples: 633564496. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:23,785][121949] Avg episode reward: [(0, '6262.780'), (1, '5913.569')] [2023-12-26 09:30:23,802][123090] Updated weights for policy 1, policy_version 1233172 (0.0009) [2023-12-26 09:30:23,803][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001241776_317898752.pth... [2023-12-26 09:30:23,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001240752_317636608.pth [2023-12-26 09:30:23,856][123090] Updated weights for policy 1, policy_version 1233182 (0.0005) [2023-12-26 09:30:23,870][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001233184_315695104.pth... [2023-12-26 09:30:23,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001232160_315432960.pth [2023-12-26 09:30:24,485][123091] Updated weights for policy 0, policy_version 1241778 (0.0007) [2023-12-26 09:30:24,554][123091] Updated weights for policy 0, policy_version 1241788 (0.0010) [2023-12-26 09:30:24,587][123090] Updated weights for policy 1, policy_version 1233192 (0.0007) [2023-12-26 09:30:24,613][123091] Updated weights for policy 0, policy_version 1241798 (0.0009) [2023-12-26 09:30:24,640][123090] Updated weights for policy 1, policy_version 1233202 (0.0007) [2023-12-26 09:30:24,677][123091] Updated weights for policy 0, policy_version 1241808 (0.0009) [2023-12-26 09:30:24,702][123090] Updated weights for policy 1, policy_version 1233212 (0.0008) [2023-12-26 09:30:25,504][123091] Updated weights for policy 0, policy_version 1241818 (0.0010) [2023-12-26 09:30:25,514][123090] Updated weights for policy 1, policy_version 1233222 (0.0009) [2023-12-26 09:30:25,561][123091] Updated weights for policy 0, policy_version 1241828 (0.0007) [2023-12-26 09:30:25,563][123090] Updated weights for policy 1, policy_version 1233232 (0.0008) [2023-12-26 09:30:25,617][123091] Updated weights for policy 0, policy_version 1241838 (0.0007) [2023-12-26 09:30:25,626][123090] Updated weights for policy 1, policy_version 1233242 (0.0009) [2023-12-26 09:30:26,464][123091] Updated weights for policy 0, policy_version 1241848 (0.0009) [2023-12-26 09:30:26,494][123090] Updated weights for policy 1, policy_version 1233252 (0.0008) [2023-12-26 09:30:26,523][123091] Updated weights for policy 0, policy_version 1241858 (0.0008) [2023-12-26 09:30:26,563][123090] Updated weights for policy 1, policy_version 1233262 (0.0008) [2023-12-26 09:30:26,584][123091] Updated weights for policy 0, policy_version 1241868 (0.0009) [2023-12-26 09:30:26,609][123090] Updated weights for policy 1, policy_version 1233272 (0.0009) [2023-12-26 09:30:27,413][123091] Updated weights for policy 0, policy_version 1241878 (0.0008) [2023-12-26 09:30:27,456][123090] Updated weights for policy 1, policy_version 1233282 (0.0009) [2023-12-26 09:30:27,462][123091] Updated weights for policy 0, policy_version 1241888 (0.0009) [2023-12-26 09:30:27,503][123090] Updated weights for policy 1, policy_version 1233292 (0.0009) [2023-12-26 09:30:27,510][123091] Updated weights for policy 0, policy_version 1241898 (0.0008) [2023-12-26 09:30:27,555][123090] Updated weights for policy 1, policy_version 1233302 (0.0009) [2023-12-26 09:30:27,613][123090] Updated weights for policy 1, policy_version 1233312 (0.0009) [2023-12-26 09:30:28,383][123091] Updated weights for policy 0, policy_version 1241908 (0.0008) [2023-12-26 09:30:28,426][123090] Updated weights for policy 1, policy_version 1233322 (0.0007) [2023-12-26 09:30:28,448][123091] Updated weights for policy 0, policy_version 1241918 (0.0008) [2023-12-26 09:30:28,490][123090] Updated weights for policy 1, policy_version 1233332 (0.0006) [2023-12-26 09:30:28,511][123091] Updated weights for policy 0, policy_version 1241928 (0.0010) [2023-12-26 09:30:28,552][123090] Updated weights for policy 1, policy_version 1233342 (0.0005) [2023-12-26 09:30:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17883.6). Total num frames: 633675776. Throughput: 0: 8774.3, 1: 8809.2. Samples: 633666876. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:28,784][121949] Avg episode reward: [(0, '6317.029'), (1, '5913.904')] [2023-12-26 09:30:29,297][123090] Updated weights for policy 1, policy_version 1233352 (0.0010) [2023-12-26 09:30:29,364][123090] Updated weights for policy 1, policy_version 1233362 (0.0008) [2023-12-26 09:30:29,407][123091] Updated weights for policy 0, policy_version 1241938 (0.0009) [2023-12-26 09:30:29,433][123090] Updated weights for policy 1, policy_version 1233372 (0.0009) [2023-12-26 09:30:29,466][123091] Updated weights for policy 0, policy_version 1241948 (0.0006) [2023-12-26 09:30:29,526][123091] Updated weights for policy 0, policy_version 1241958 (0.0005) [2023-12-26 09:30:29,587][123091] Updated weights for policy 0, policy_version 1241968 (0.0005) [2023-12-26 09:30:30,204][123090] Updated weights for policy 1, policy_version 1233382 (0.0007) [2023-12-26 09:30:30,237][123091] Updated weights for policy 0, policy_version 1241978 (0.0006) [2023-12-26 09:30:30,270][123090] Updated weights for policy 1, policy_version 1233392 (0.0007) [2023-12-26 09:30:30,293][123091] Updated weights for policy 0, policy_version 1241988 (0.0005) [2023-12-26 09:30:30,323][123090] Updated weights for policy 1, policy_version 1233402 (0.0009) [2023-12-26 09:30:30,348][123091] Updated weights for policy 0, policy_version 1241998 (0.0005) [2023-12-26 09:30:30,935][123091] Updated weights for policy 0, policy_version 1242008 (0.0005) [2023-12-26 09:30:30,995][123091] Updated weights for policy 0, policy_version 1242018 (0.0009) [2023-12-26 09:30:31,055][123091] Updated weights for policy 0, policy_version 1242028 (0.0010) [2023-12-26 09:30:31,083][123090] Updated weights for policy 1, policy_version 1233412 (0.0007) [2023-12-26 09:30:31,150][123090] Updated weights for policy 1, policy_version 1233422 (0.0008) [2023-12-26 09:30:31,221][123090] Updated weights for policy 1, policy_version 1233432 (0.0006) [2023-12-26 09:30:31,889][123091] Updated weights for policy 0, policy_version 1242038 (0.0009) [2023-12-26 09:30:31,938][123091] Updated weights for policy 0, policy_version 1242049 (0.0009) [2023-12-26 09:30:31,984][123091] Updated weights for policy 0, policy_version 1242059 (0.0005) [2023-12-26 09:30:32,010][123090] Updated weights for policy 1, policy_version 1233442 (0.0008) [2023-12-26 09:30:32,069][123090] Updated weights for policy 1, policy_version 1233452 (0.0009) [2023-12-26 09:30:32,126][123090] Updated weights for policy 1, policy_version 1233462 (0.0010) [2023-12-26 09:30:32,189][123090] Updated weights for policy 1, policy_version 1233472 (0.0006) [2023-12-26 09:30:32,854][123091] Updated weights for policy 0, policy_version 1242069 (0.0007) [2023-12-26 09:30:32,898][123090] Updated weights for policy 1, policy_version 1233482 (0.0008) [2023-12-26 09:30:32,902][123091] Updated weights for policy 0, policy_version 1242079 (0.0007) [2023-12-26 09:30:32,947][123090] Updated weights for policy 1, policy_version 1233492 (0.0009) [2023-12-26 09:30:32,963][123091] Updated weights for policy 0, policy_version 1242089 (0.0005) [2023-12-26 09:30:33,003][123090] Updated weights for policy 1, policy_version 1233502 (0.0009) [2023-12-26 09:30:33,728][123091] Updated weights for policy 0, policy_version 1242099 (0.0006) [2023-12-26 09:30:33,739][123090] Updated weights for policy 1, policy_version 1233512 (0.0010) [2023-12-26 09:30:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 633757696. Throughput: 0: 8765.4, 1: 8784.7. Samples: 633776276. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:33,784][121949] Avg episode reward: [(0, '6328.676'), (1, '5873.916')] [2023-12-26 09:30:33,787][123091] Updated weights for policy 0, policy_version 1242109 (0.0008) [2023-12-26 09:30:33,803][123090] Updated weights for policy 1, policy_version 1233522 (0.0009) [2023-12-26 09:30:33,842][123091] Updated weights for policy 0, policy_version 1242119 (0.0008) [2023-12-26 09:30:33,865][123090] Updated weights for policy 1, policy_version 1233532 (0.0009) [2023-12-26 09:30:34,658][123090] Updated weights for policy 1, policy_version 1233542 (0.0010) [2023-12-26 09:30:34,696][123091] Updated weights for policy 0, policy_version 1242129 (0.0008) [2023-12-26 09:30:34,715][123090] Updated weights for policy 1, policy_version 1233552 (0.0010) [2023-12-26 09:30:34,759][123091] Updated weights for policy 0, policy_version 1242139 (0.0008) [2023-12-26 09:30:34,762][123090] Updated weights for policy 1, policy_version 1233562 (0.0009) [2023-12-26 09:30:34,823][123091] Updated weights for policy 0, policy_version 1242149 (0.0008) [2023-12-26 09:30:34,875][123091] Updated weights for policy 0, policy_version 1242159 (0.0009) [2023-12-26 09:30:35,611][123090] Updated weights for policy 1, policy_version 1233572 (0.0008) [2023-12-26 09:30:35,667][123090] Updated weights for policy 1, policy_version 1233582 (0.0009) [2023-12-26 09:30:35,731][123090] Updated weights for policy 1, policy_version 1233592 (0.0009) [2023-12-26 09:30:35,741][123091] Updated weights for policy 0, policy_version 1242169 (0.0008) [2023-12-26 09:30:35,807][123091] Updated weights for policy 0, policy_version 1242179 (0.0010) [2023-12-26 09:30:35,873][123091] Updated weights for policy 0, policy_version 1242189 (0.0010) [2023-12-26 09:30:36,581][123090] Updated weights for policy 1, policy_version 1233602 (0.0007) [2023-12-26 09:30:36,637][123090] Updated weights for policy 1, policy_version 1233612 (0.0009) [2023-12-26 09:30:36,690][123091] Updated weights for policy 0, policy_version 1242199 (0.0007) [2023-12-26 09:30:36,693][123090] Updated weights for policy 1, policy_version 1233622 (0.0009) [2023-12-26 09:30:36,745][123090] Updated weights for policy 1, policy_version 1233632 (0.0009) [2023-12-26 09:30:36,755][123091] Updated weights for policy 0, policy_version 1242209 (0.0007) [2023-12-26 09:30:36,825][123091] Updated weights for policy 0, policy_version 1242219 (0.0011) [2023-12-26 09:30:37,613][123090] Updated weights for policy 1, policy_version 1233642 (0.0010) [2023-12-26 09:30:37,619][123091] Updated weights for policy 0, policy_version 1242229 (0.0011) [2023-12-26 09:30:37,670][123091] Updated weights for policy 0, policy_version 1242239 (0.0010) [2023-12-26 09:30:37,673][123090] Updated weights for policy 1, policy_version 1233652 (0.0010) [2023-12-26 09:30:37,736][123091] Updated weights for policy 0, policy_version 1242249 (0.0008) [2023-12-26 09:30:37,740][123090] Updated weights for policy 1, policy_version 1233662 (0.0010) [2023-12-26 09:30:38,487][123090] Updated weights for policy 1, policy_version 1233672 (0.0008) [2023-12-26 09:30:38,515][123091] Updated weights for policy 0, policy_version 1242259 (0.0011) [2023-12-26 09:30:38,556][123090] Updated weights for policy 1, policy_version 1233682 (0.0007) [2023-12-26 09:30:38,571][123091] Updated weights for policy 0, policy_version 1242269 (0.0011) [2023-12-26 09:30:38,620][123090] Updated weights for policy 1, policy_version 1233692 (0.0006) [2023-12-26 09:30:38,626][123091] Updated weights for policy 0, policy_version 1242279 (0.0010) [2023-12-26 09:30:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17883.5). Total num frames: 633856000. Throughput: 0: 8754.3, 1: 8758.3. Samples: 633827372. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:38,785][121949] Avg episode reward: [(0, '6366.180'), (1, '5863.912')] [2023-12-26 09:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001242288_318029824.pth... [2023-12-26 09:30:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001233696_315826176.pth... [2023-12-26 09:30:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001241264_317767680.pth [2023-12-26 09:30:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001232672_315564032.pth [2023-12-26 09:30:39,207][123091] Updated weights for policy 0, policy_version 1242289 (0.0007) [2023-12-26 09:30:39,275][123091] Updated weights for policy 0, policy_version 1242299 (0.0008) [2023-12-26 09:30:39,339][123091] Updated weights for policy 0, policy_version 1242309 (0.0009) [2023-12-26 09:30:39,411][123091] Updated weights for policy 0, policy_version 1242319 (0.0011) [2023-12-26 09:30:39,419][123090] Updated weights for policy 1, policy_version 1233702 (0.0007) [2023-12-26 09:30:39,486][123090] Updated weights for policy 1, policy_version 1233712 (0.0009) [2023-12-26 09:30:39,549][123090] Updated weights for policy 1, policy_version 1233722 (0.0009) [2023-12-26 09:30:40,253][123091] Updated weights for policy 0, policy_version 1242329 (0.0008) [2023-12-26 09:30:40,308][123091] Updated weights for policy 0, policy_version 1242339 (0.0008) [2023-12-26 09:30:40,367][123091] Updated weights for policy 0, policy_version 1242349 (0.0010) [2023-12-26 09:30:40,406][123090] Updated weights for policy 1, policy_version 1233732 (0.0010) [2023-12-26 09:30:40,466][123090] Updated weights for policy 1, policy_version 1233742 (0.0009) [2023-12-26 09:30:40,526][123090] Updated weights for policy 1, policy_version 1233752 (0.0009) [2023-12-26 09:30:41,241][123091] Updated weights for policy 0, policy_version 1242359 (0.0009) [2023-12-26 09:30:41,299][123091] Updated weights for policy 0, policy_version 1242369 (0.0009) [2023-12-26 09:30:41,344][123090] Updated weights for policy 1, policy_version 1233762 (0.0010) [2023-12-26 09:30:41,356][123091] Updated weights for policy 0, policy_version 1242379 (0.0009) [2023-12-26 09:30:41,424][123090] Updated weights for policy 1, policy_version 1233772 (0.0009) [2023-12-26 09:30:41,488][123090] Updated weights for policy 1, policy_version 1233782 (0.0009) [2023-12-26 09:30:41,546][123090] Updated weights for policy 1, policy_version 1233792 (0.0009) [2023-12-26 09:30:42,257][123091] Updated weights for policy 0, policy_version 1242389 (0.0009) [2023-12-26 09:30:42,322][123091] Updated weights for policy 0, policy_version 1242399 (0.0008) [2023-12-26 09:30:42,335][123090] Updated weights for policy 1, policy_version 1233802 (0.0008) [2023-12-26 09:30:42,392][123091] Updated weights for policy 0, policy_version 1242409 (0.0009) [2023-12-26 09:30:42,403][123090] Updated weights for policy 1, policy_version 1233812 (0.0008) [2023-12-26 09:30:42,463][123090] Updated weights for policy 1, policy_version 1233822 (0.0007) [2023-12-26 09:30:43,208][123090] Updated weights for policy 1, policy_version 1233832 (0.0009) [2023-12-26 09:30:43,261][123091] Updated weights for policy 0, policy_version 1242419 (0.0008) [2023-12-26 09:30:43,273][123090] Updated weights for policy 1, policy_version 1233842 (0.0008) [2023-12-26 09:30:43,322][123091] Updated weights for policy 0, policy_version 1242429 (0.0010) [2023-12-26 09:30:43,336][123090] Updated weights for policy 1, policy_version 1233852 (0.0007) [2023-12-26 09:30:43,380][123091] Updated weights for policy 0, policy_version 1242439 (0.0009) [2023-12-26 09:30:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17883.5). Total num frames: 633937920. Throughput: 0: 8759.4, 1: 8672.9. Samples: 633930464. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:43,784][121949] Avg episode reward: [(0, '6310.021'), (1, '5818.440')] [2023-12-26 09:30:44,133][123090] Updated weights for policy 1, policy_version 1233862 (0.0009) [2023-12-26 09:30:44,196][123090] Updated weights for policy 1, policy_version 1233872 (0.0010) [2023-12-26 09:30:44,222][123091] Updated weights for policy 0, policy_version 1242449 (0.0008) [2023-12-26 09:30:44,259][123090] Updated weights for policy 1, policy_version 1233882 (0.0009) [2023-12-26 09:30:44,287][123091] Updated weights for policy 0, policy_version 1242459 (0.0009) [2023-12-26 09:30:44,350][123091] Updated weights for policy 0, policy_version 1242469 (0.0008) [2023-12-26 09:30:44,414][123091] Updated weights for policy 0, policy_version 1242479 (0.0009) [2023-12-26 09:30:45,103][123090] Updated weights for policy 1, policy_version 1233892 (0.0008) [2023-12-26 09:30:45,172][123090] Updated weights for policy 1, policy_version 1233902 (0.0009) [2023-12-26 09:30:45,238][123091] Updated weights for policy 0, policy_version 1242489 (0.0009) [2023-12-26 09:30:45,240][123090] Updated weights for policy 1, policy_version 1233912 (0.0007) [2023-12-26 09:30:45,309][123091] Updated weights for policy 0, policy_version 1242499 (0.0010) [2023-12-26 09:30:45,372][123091] Updated weights for policy 0, policy_version 1242509 (0.0010) [2023-12-26 09:30:46,051][123090] Updated weights for policy 1, policy_version 1233922 (0.0008) [2023-12-26 09:30:46,124][123090] Updated weights for policy 1, policy_version 1233932 (0.0009) [2023-12-26 09:30:46,190][123090] Updated weights for policy 1, policy_version 1233942 (0.0008) [2023-12-26 09:30:46,213][123091] Updated weights for policy 0, policy_version 1242519 (0.0010) [2023-12-26 09:30:46,253][123090] Updated weights for policy 1, policy_version 1233952 (0.0008) [2023-12-26 09:30:46,263][123091] Updated weights for policy 0, policy_version 1242529 (0.0008) [2023-12-26 09:30:46,322][123091] Updated weights for policy 0, policy_version 1242539 (0.0010) [2023-12-26 09:30:47,051][123090] Updated weights for policy 1, policy_version 1233962 (0.0010) [2023-12-26 09:30:47,111][123090] Updated weights for policy 1, policy_version 1233972 (0.0009) [2023-12-26 09:30:47,162][123091] Updated weights for policy 0, policy_version 1242549 (0.0006) [2023-12-26 09:30:47,176][123090] Updated weights for policy 1, policy_version 1233982 (0.0009) [2023-12-26 09:30:47,214][123091] Updated weights for policy 0, policy_version 1242559 (0.0005) [2023-12-26 09:30:47,267][123091] Updated weights for policy 0, policy_version 1242569 (0.0005) [2023-12-26 09:30:47,933][123091] Updated weights for policy 0, policy_version 1242579 (0.0005) [2023-12-26 09:30:47,984][123091] Updated weights for policy 0, policy_version 1242589 (0.0005) [2023-12-26 09:30:48,043][123091] Updated weights for policy 0, policy_version 1242599 (0.0007) [2023-12-26 09:30:48,085][123090] Updated weights for policy 1, policy_version 1233992 (0.0006) [2023-12-26 09:30:48,147][123090] Updated weights for policy 1, policy_version 1234002 (0.0009) [2023-12-26 09:30:48,211][123090] Updated weights for policy 1, policy_version 1234012 (0.0009) [2023-12-26 09:30:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 634019840. Throughput: 0: 8693.9, 1: 8637.4. Samples: 634033936. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:48,785][121949] Avg episode reward: [(0, '6249.270'), (1, '5719.879')] [2023-12-26 09:30:48,817][123091] Updated weights for policy 0, policy_version 1242609 (0.0010) [2023-12-26 09:30:48,879][123091] Updated weights for policy 0, policy_version 1242619 (0.0007) [2023-12-26 09:30:48,937][123091] Updated weights for policy 0, policy_version 1242629 (0.0005) [2023-12-26 09:30:48,987][123091] Updated weights for policy 0, policy_version 1242639 (0.0007) [2023-12-26 09:30:49,030][123090] Updated weights for policy 1, policy_version 1234022 (0.0009) [2023-12-26 09:30:49,103][123090] Updated weights for policy 1, policy_version 1234032 (0.0009) [2023-12-26 09:30:49,164][123090] Updated weights for policy 1, policy_version 1234042 (0.0009) [2023-12-26 09:30:49,802][123091] Updated weights for policy 0, policy_version 1242649 (0.0010) [2023-12-26 09:30:49,875][123091] Updated weights for policy 0, policy_version 1242659 (0.0009) [2023-12-26 09:30:49,881][123090] Updated weights for policy 1, policy_version 1234052 (0.0008) [2023-12-26 09:30:49,958][123091] Updated weights for policy 0, policy_version 1242669 (0.0009) [2023-12-26 09:30:49,961][123090] Updated weights for policy 1, policy_version 1234062 (0.0008) [2023-12-26 09:30:50,052][123090] Updated weights for policy 1, policy_version 1234072 (0.0008) [2023-12-26 09:30:50,846][123090] Updated weights for policy 1, policy_version 1234082 (0.0007) [2023-12-26 09:30:50,847][123091] Updated weights for policy 0, policy_version 1242679 (0.0010) [2023-12-26 09:30:50,911][123091] Updated weights for policy 0, policy_version 1242689 (0.0011) [2023-12-26 09:30:50,915][123090] Updated weights for policy 1, policy_version 1234092 (0.0008) [2023-12-26 09:30:50,974][123091] Updated weights for policy 0, policy_version 1242699 (0.0011) [2023-12-26 09:30:50,980][123090] Updated weights for policy 1, policy_version 1234102 (0.0011) [2023-12-26 09:30:51,040][123090] Updated weights for policy 1, policy_version 1234112 (0.0011) [2023-12-26 09:30:51,785][123091] Updated weights for policy 0, policy_version 1242709 (0.0011) [2023-12-26 09:30:51,844][123091] Updated weights for policy 0, policy_version 1242719 (0.0011) [2023-12-26 09:30:51,885][123090] Updated weights for policy 1, policy_version 1234122 (0.0007) [2023-12-26 09:30:51,903][123091] Updated weights for policy 0, policy_version 1242729 (0.0010) [2023-12-26 09:30:51,935][123090] Updated weights for policy 1, policy_version 1234132 (0.0009) [2023-12-26 09:30:51,985][123090] Updated weights for policy 1, policy_version 1234142 (0.0009) [2023-12-26 09:30:52,744][123091] Updated weights for policy 0, policy_version 1242739 (0.0010) [2023-12-26 09:30:52,811][123091] Updated weights for policy 0, policy_version 1242749 (0.0011) [2023-12-26 09:30:52,849][123090] Updated weights for policy 1, policy_version 1234152 (0.0007) [2023-12-26 09:30:52,867][123091] Updated weights for policy 0, policy_version 1242759 (0.0010) [2023-12-26 09:30:52,901][123090] Updated weights for policy 1, policy_version 1234162 (0.0010) [2023-12-26 09:30:52,960][123090] Updated weights for policy 1, policy_version 1234172 (0.0009) [2023-12-26 09:30:53,582][123091] Updated weights for policy 0, policy_version 1242769 (0.0010) [2023-12-26 09:30:53,644][123091] Updated weights for policy 0, policy_version 1242779 (0.0007) [2023-12-26 09:30:53,700][123091] Updated weights for policy 0, policy_version 1242789 (0.0009) [2023-12-26 09:30:53,754][123091] Updated weights for policy 0, policy_version 1242799 (0.0009) [2023-12-26 09:30:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17855.9). Total num frames: 634109952. Throughput: 0: 8694.2, 1: 8622.1. Samples: 634085796. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:53,785][121949] Avg episode reward: [(0, '6261.436'), (1, '5713.285')] [2023-12-26 09:30:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001234176_315949056.pth... [2023-12-26 09:30:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001242800_318160896.pth... [2023-12-26 09:30:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001233184_315695104.pth [2023-12-26 09:30:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001241776_317898752.pth [2023-12-26 09:30:53,838][123090] Updated weights for policy 1, policy_version 1234182 (0.0009) [2023-12-26 09:30:53,890][123090] Updated weights for policy 1, policy_version 1234192 (0.0009) [2023-12-26 09:30:53,953][123090] Updated weights for policy 1, policy_version 1234202 (0.0008) [2023-12-26 09:30:54,517][123091] Updated weights for policy 0, policy_version 1242809 (0.0007) [2023-12-26 09:30:54,563][123091] Updated weights for policy 0, policy_version 1242819 (0.0005) [2023-12-26 09:30:54,602][123090] Updated weights for policy 1, policy_version 1234212 (0.0007) [2023-12-26 09:30:54,627][123091] Updated weights for policy 0, policy_version 1242829 (0.0008) [2023-12-26 09:30:54,669][123090] Updated weights for policy 1, policy_version 1234222 (0.0010) [2023-12-26 09:30:54,731][123090] Updated weights for policy 1, policy_version 1234232 (0.0009) [2023-12-26 09:30:55,311][123091] Updated weights for policy 0, policy_version 1242839 (0.0006) [2023-12-26 09:30:55,359][123091] Updated weights for policy 0, policy_version 1242849 (0.0009) [2023-12-26 09:30:55,410][123091] Updated weights for policy 0, policy_version 1242859 (0.0009) [2023-12-26 09:30:55,547][123090] Updated weights for policy 1, policy_version 1234242 (0.0010) [2023-12-26 09:30:55,596][123090] Updated weights for policy 1, policy_version 1234252 (0.0009) [2023-12-26 09:30:55,644][123090] Updated weights for policy 1, policy_version 1234262 (0.0009) [2023-12-26 09:30:55,698][123090] Updated weights for policy 1, policy_version 1234272 (0.0009) [2023-12-26 09:30:56,220][123091] Updated weights for policy 0, policy_version 1242869 (0.0010) [2023-12-26 09:30:56,271][123091] Updated weights for policy 0, policy_version 1242879 (0.0010) [2023-12-26 09:30:56,322][123091] Updated weights for policy 0, policy_version 1242889 (0.0009) [2023-12-26 09:30:56,545][123090] Updated weights for policy 1, policy_version 1234282 (0.0010) [2023-12-26 09:30:56,591][123090] Updated weights for policy 1, policy_version 1234292 (0.0009) [2023-12-26 09:30:56,640][123090] Updated weights for policy 1, policy_version 1234302 (0.0009) [2023-12-26 09:30:57,064][123091] Updated weights for policy 0, policy_version 1242899 (0.0008) [2023-12-26 09:30:57,127][123091] Updated weights for policy 0, policy_version 1242909 (0.0005) [2023-12-26 09:30:57,177][123091] Updated weights for policy 0, policy_version 1242919 (0.0005) [2023-12-26 09:30:57,559][123090] Updated weights for policy 1, policy_version 1234312 (0.0009) [2023-12-26 09:30:57,612][123090] Updated weights for policy 1, policy_version 1234323 (0.0010) [2023-12-26 09:30:57,665][123090] Updated weights for policy 1, policy_version 1234333 (0.0009) [2023-12-26 09:30:57,878][123091] Updated weights for policy 0, policy_version 1242929 (0.0005) [2023-12-26 09:30:57,930][123091] Updated weights for policy 0, policy_version 1242939 (0.0005) [2023-12-26 09:30:57,983][123091] Updated weights for policy 0, policy_version 1242949 (0.0005) [2023-12-26 09:30:58,037][123091] Updated weights for policy 0, policy_version 1242959 (0.0006) [2023-12-26 09:30:58,581][123090] Updated weights for policy 1, policy_version 1234343 (0.0008) [2023-12-26 09:30:58,654][123090] Updated weights for policy 1, policy_version 1234353 (0.0009) [2023-12-26 09:30:58,725][123090] Updated weights for policy 1, policy_version 1234363 (0.0010) [2023-12-26 09:30:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 634200064. Throughput: 0: 8774.9, 1: 8662.9. Samples: 634193992. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:30:58,785][121949] Avg episode reward: [(0, '6341.514'), (1, '5667.239')] [2023-12-26 09:30:58,833][123091] Updated weights for policy 0, policy_version 1242969 (0.0011) [2023-12-26 09:30:58,892][123091] Updated weights for policy 0, policy_version 1242979 (0.0011) [2023-12-26 09:30:58,954][123091] Updated weights for policy 0, policy_version 1242989 (0.0010) [2023-12-26 09:30:59,560][123090] Updated weights for policy 1, policy_version 1234373 (0.0009) [2023-12-26 09:30:59,628][123090] Updated weights for policy 1, policy_version 1234383 (0.0009) [2023-12-26 09:30:59,689][123090] Updated weights for policy 1, policy_version 1234393 (0.0009) [2023-12-26 09:30:59,760][123091] Updated weights for policy 0, policy_version 1242999 (0.0009) [2023-12-26 09:30:59,831][123091] Updated weights for policy 0, policy_version 1243009 (0.0011) [2023-12-26 09:30:59,902][123091] Updated weights for policy 0, policy_version 1243019 (0.0008) [2023-12-26 09:31:00,471][123090] Updated weights for policy 1, policy_version 1234403 (0.0009) [2023-12-26 09:31:00,543][123090] Updated weights for policy 1, policy_version 1234413 (0.0008) [2023-12-26 09:31:00,615][123090] Updated weights for policy 1, policy_version 1234423 (0.0008) [2023-12-26 09:31:00,715][123091] Updated weights for policy 0, policy_version 1243029 (0.0010) [2023-12-26 09:31:00,779][123091] Updated weights for policy 0, policy_version 1243039 (0.0011) [2023-12-26 09:31:00,834][123091] Updated weights for policy 0, policy_version 1243049 (0.0010) [2023-12-26 09:31:01,388][123090] Updated weights for policy 1, policy_version 1234433 (0.0009) [2023-12-26 09:31:01,447][123090] Updated weights for policy 1, policy_version 1234443 (0.0010) [2023-12-26 09:31:01,509][123090] Updated weights for policy 1, policy_version 1234453 (0.0006) [2023-12-26 09:31:01,572][123090] Updated weights for policy 1, policy_version 1234463 (0.0005) [2023-12-26 09:31:01,668][123091] Updated weights for policy 0, policy_version 1243059 (0.0010) [2023-12-26 09:31:01,732][123091] Updated weights for policy 0, policy_version 1243069 (0.0010) [2023-12-26 09:31:01,801][123091] Updated weights for policy 0, policy_version 1243079 (0.0011) [2023-12-26 09:31:02,212][123090] Updated weights for policy 1, policy_version 1234473 (0.0005) [2023-12-26 09:31:02,278][123090] Updated weights for policy 1, policy_version 1234483 (0.0011) [2023-12-26 09:31:02,346][123090] Updated weights for policy 1, policy_version 1234493 (0.0010) [2023-12-26 09:31:02,512][123091] Updated weights for policy 0, policy_version 1243089 (0.0006) [2023-12-26 09:31:02,577][123091] Updated weights for policy 0, policy_version 1243099 (0.0010) [2023-12-26 09:31:02,636][123091] Updated weights for policy 0, policy_version 1243109 (0.0010) [2023-12-26 09:31:02,694][123091] Updated weights for policy 0, policy_version 1243119 (0.0010) [2023-12-26 09:31:03,125][123090] Updated weights for policy 1, policy_version 1234503 (0.0007) [2023-12-26 09:31:03,185][123090] Updated weights for policy 1, policy_version 1234513 (0.0009) [2023-12-26 09:31:03,236][123090] Updated weights for policy 1, policy_version 1234523 (0.0010) [2023-12-26 09:31:03,472][123091] Updated weights for policy 0, policy_version 1243129 (0.0007) [2023-12-26 09:31:03,522][123091] Updated weights for policy 0, policy_version 1243139 (0.0006) [2023-12-26 09:31:03,577][123091] Updated weights for policy 0, policy_version 1243149 (0.0006) [2023-12-26 09:31:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 634290176. Throughput: 0: 8771.6, 1: 8695.8. Samples: 634300892. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:31:03,784][121949] Avg episode reward: [(0, '6246.005'), (1, '5695.562')] [2023-12-26 09:31:03,974][123090] Updated weights for policy 1, policy_version 1234533 (0.0008) [2023-12-26 09:31:04,033][123090] Updated weights for policy 1, policy_version 1234543 (0.0008) [2023-12-26 09:31:04,101][123090] Updated weights for policy 1, policy_version 1234553 (0.0008) [2023-12-26 09:31:04,218][123091] Updated weights for policy 0, policy_version 1243159 (0.0009) [2023-12-26 09:31:04,279][123091] Updated weights for policy 0, policy_version 1243169 (0.0010) [2023-12-26 09:31:04,354][123091] Updated weights for policy 0, policy_version 1243179 (0.0011) [2023-12-26 09:31:04,865][123090] Updated weights for policy 1, policy_version 1234563 (0.0007) [2023-12-26 09:31:04,914][123090] Updated weights for policy 1, policy_version 1234573 (0.0008) [2023-12-26 09:31:04,971][123090] Updated weights for policy 1, policy_version 1234583 (0.0009) [2023-12-26 09:31:05,109][123091] Updated weights for policy 0, policy_version 1243189 (0.0008) [2023-12-26 09:31:05,162][123091] Updated weights for policy 0, policy_version 1243199 (0.0006) [2023-12-26 09:31:05,217][123091] Updated weights for policy 0, policy_version 1243209 (0.0010) [2023-12-26 09:31:05,748][123090] Updated weights for policy 1, policy_version 1234593 (0.0009) [2023-12-26 09:31:05,820][123090] Updated weights for policy 1, policy_version 1234603 (0.0006) [2023-12-26 09:31:05,885][123090] Updated weights for policy 1, policy_version 1234613 (0.0006) [2023-12-26 09:31:05,958][123090] Updated weights for policy 1, policy_version 1234623 (0.0006) [2023-12-26 09:31:06,050][123091] Updated weights for policy 0, policy_version 1243219 (0.0009) [2023-12-26 09:31:06,123][123091] Updated weights for policy 0, policy_version 1243229 (0.0009) [2023-12-26 09:31:06,185][123091] Updated weights for policy 0, policy_version 1243239 (0.0010) [2023-12-26 09:31:06,751][123090] Updated weights for policy 1, policy_version 1234633 (0.0007) [2023-12-26 09:31:06,827][123090] Updated weights for policy 1, policy_version 1234643 (0.0009) [2023-12-26 09:31:06,904][123090] Updated weights for policy 1, policy_version 1234653 (0.0010) [2023-12-26 09:31:07,047][123091] Updated weights for policy 0, policy_version 1243249 (0.0009) [2023-12-26 09:31:07,104][123091] Updated weights for policy 0, policy_version 1243259 (0.0005) [2023-12-26 09:31:07,162][123091] Updated weights for policy 0, policy_version 1243269 (0.0005) [2023-12-26 09:31:07,218][123091] Updated weights for policy 0, policy_version 1243279 (0.0005) [2023-12-26 09:31:07,644][123090] Updated weights for policy 1, policy_version 1234663 (0.0009) [2023-12-26 09:31:07,704][123090] Updated weights for policy 1, policy_version 1234673 (0.0006) [2023-12-26 09:31:07,758][123090] Updated weights for policy 1, policy_version 1234683 (0.0007) [2023-12-26 09:31:08,042][123091] Updated weights for policy 0, policy_version 1243289 (0.0010) [2023-12-26 09:31:08,112][123091] Updated weights for policy 0, policy_version 1243299 (0.0007) [2023-12-26 09:31:08,170][123091] Updated weights for policy 0, policy_version 1243309 (0.0005) [2023-12-26 09:31:08,411][123090] Updated weights for policy 1, policy_version 1234693 (0.0005) [2023-12-26 09:31:08,473][123090] Updated weights for policy 1, policy_version 1234703 (0.0009) [2023-12-26 09:31:08,538][123090] Updated weights for policy 1, policy_version 1234713 (0.0008) [2023-12-26 09:31:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17855.8). Total num frames: 634380288. Throughput: 0: 8814.6, 1: 8741.9. Samples: 634354544. Policy #0 lag: (min: 13.0, avg: 13.9, max: 37.0) [2023-12-26 09:31:08,785][121949] Avg episode reward: [(0, '6181.288'), (1, '5644.976')] [2023-12-26 09:31:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001243312_318291968.pth... [2023-12-26 09:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001234720_316088320.pth... [2023-12-26 09:31:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001233696_315826176.pth [2023-12-26 09:31:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001242288_318029824.pth [2023-12-26 09:31:08,902][123091] Updated weights for policy 0, policy_version 1243319 (0.0008) [2023-12-26 09:31:08,962][123091] Updated weights for policy 0, policy_version 1243329 (0.0009) [2023-12-26 09:31:09,015][123091] Updated weights for policy 0, policy_version 1243339 (0.0010) [2023-12-26 09:31:09,228][123090] Updated weights for policy 1, policy_version 1234723 (0.0008) [2023-12-26 09:31:09,294][123090] Updated weights for policy 1, policy_version 1234733 (0.0007) [2023-12-26 09:31:09,397][123090] Updated weights for policy 1, policy_version 1234743 (0.0007) [2023-12-26 09:31:09,937][123091] Updated weights for policy 0, policy_version 1243349 (0.0010) [2023-12-26 09:31:10,007][123091] Updated weights for policy 0, policy_version 1243359 (0.0009) [2023-12-26 09:31:10,072][123091] Updated weights for policy 0, policy_version 1243369 (0.0009) [2023-12-26 09:31:10,182][123090] Updated weights for policy 1, policy_version 1234753 (0.0010) [2023-12-26 09:31:10,244][123090] Updated weights for policy 1, policy_version 1234763 (0.0009) [2023-12-26 09:31:10,307][123090] Updated weights for policy 1, policy_version 1234773 (0.0010) [2023-12-26 09:31:10,363][123090] Updated weights for policy 1, policy_version 1234783 (0.0009) [2023-12-26 09:31:10,889][123091] Updated weights for policy 0, policy_version 1243379 (0.0010) [2023-12-26 09:31:10,948][123091] Updated weights for policy 0, policy_version 1243389 (0.0009) [2023-12-26 09:31:11,004][123091] Updated weights for policy 0, policy_version 1243399 (0.0009) [2023-12-26 09:31:11,232][123090] Updated weights for policy 1, policy_version 1234793 (0.0009) [2023-12-26 09:31:11,295][123090] Updated weights for policy 1, policy_version 1234803 (0.0009) [2023-12-26 09:31:11,360][123090] Updated weights for policy 1, policy_version 1234813 (0.0008) [2023-12-26 09:31:11,842][123091] Updated weights for policy 0, policy_version 1243409 (0.0010) [2023-12-26 09:31:11,895][123091] Updated weights for policy 0, policy_version 1243419 (0.0009) [2023-12-26 09:31:11,950][123091] Updated weights for policy 0, policy_version 1243429 (0.0006) [2023-12-26 09:31:12,015][123091] Updated weights for policy 0, policy_version 1243439 (0.0005) [2023-12-26 09:31:12,253][123090] Updated weights for policy 1, policy_version 1234823 (0.0009) [2023-12-26 09:31:12,321][123090] Updated weights for policy 1, policy_version 1234833 (0.0010) [2023-12-26 09:31:12,397][123090] Updated weights for policy 1, policy_version 1234843 (0.0010) [2023-12-26 09:31:12,758][123091] Updated weights for policy 0, policy_version 1243449 (0.0006) [2023-12-26 09:31:12,827][123091] Updated weights for policy 0, policy_version 1243459 (0.0005) [2023-12-26 09:31:12,897][123091] Updated weights for policy 0, policy_version 1243469 (0.0007) [2023-12-26 09:31:13,244][123090] Updated weights for policy 1, policy_version 1234853 (0.0009) [2023-12-26 09:31:13,303][123090] Updated weights for policy 1, policy_version 1234863 (0.0010) [2023-12-26 09:31:13,359][123090] Updated weights for policy 1, policy_version 1234873 (0.0010) [2023-12-26 09:31:13,699][123091] Updated weights for policy 0, policy_version 1243479 (0.0010) [2023-12-26 09:31:13,750][123091] Updated weights for policy 0, policy_version 1243489 (0.0011) [2023-12-26 09:31:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 634462208. Throughput: 0: 8842.1, 1: 8766.7. Samples: 634459276. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:13,785][121949] Avg episode reward: [(0, '6234.424'), (1, '5615.261')] [2023-12-26 09:31:13,798][123091] Updated weights for policy 0, policy_version 1243499 (0.0010) [2023-12-26 09:31:14,180][123090] Updated weights for policy 1, policy_version 1234883 (0.0009) [2023-12-26 09:31:14,255][123090] Updated weights for policy 1, policy_version 1234893 (0.0005) [2023-12-26 09:31:14,315][123090] Updated weights for policy 1, policy_version 1234903 (0.0006) [2023-12-26 09:31:14,606][123091] Updated weights for policy 0, policy_version 1243509 (0.0011) [2023-12-26 09:31:14,672][123091] Updated weights for policy 0, policy_version 1243519 (0.0010) [2023-12-26 09:31:14,735][123091] Updated weights for policy 0, policy_version 1243529 (0.0008) [2023-12-26 09:31:15,058][123090] Updated weights for policy 1, policy_version 1234913 (0.0005) [2023-12-26 09:31:15,112][123090] Updated weights for policy 1, policy_version 1234923 (0.0006) [2023-12-26 09:31:15,179][123090] Updated weights for policy 1, policy_version 1234933 (0.0008) [2023-12-26 09:31:15,240][123090] Updated weights for policy 1, policy_version 1234943 (0.0011) [2023-12-26 09:31:15,546][123091] Updated weights for policy 0, policy_version 1243539 (0.0009) [2023-12-26 09:31:15,610][123091] Updated weights for policy 0, policy_version 1243549 (0.0011) [2023-12-26 09:31:15,665][123091] Updated weights for policy 0, policy_version 1243559 (0.0010) [2023-12-26 09:31:15,997][123090] Updated weights for policy 1, policy_version 1234953 (0.0010) [2023-12-26 09:31:16,075][123090] Updated weights for policy 1, policy_version 1234963 (0.0005) [2023-12-26 09:31:16,151][123090] Updated weights for policy 1, policy_version 1234973 (0.0006) [2023-12-26 09:31:16,379][123091] Updated weights for policy 0, policy_version 1243569 (0.0010) [2023-12-26 09:31:16,450][123091] Updated weights for policy 0, policy_version 1243579 (0.0006) [2023-12-26 09:31:16,520][123091] Updated weights for policy 0, policy_version 1243589 (0.0010) [2023-12-26 09:31:16,579][123091] Updated weights for policy 0, policy_version 1243599 (0.0010) [2023-12-26 09:31:16,813][123090] Updated weights for policy 1, policy_version 1234983 (0.0008) [2023-12-26 09:31:16,879][123090] Updated weights for policy 1, policy_version 1234993 (0.0008) [2023-12-26 09:31:16,944][123090] Updated weights for policy 1, policy_version 1235003 (0.0008) [2023-12-26 09:31:17,313][123091] Updated weights for policy 0, policy_version 1243609 (0.0009) [2023-12-26 09:31:17,371][123091] Updated weights for policy 0, policy_version 1243619 (0.0009) [2023-12-26 09:31:17,438][123091] Updated weights for policy 0, policy_version 1243629 (0.0005) [2023-12-26 09:31:17,665][123090] Updated weights for policy 1, policy_version 1235013 (0.0006) [2023-12-26 09:31:17,725][123090] Updated weights for policy 1, policy_version 1235023 (0.0005) [2023-12-26 09:31:17,779][123090] Updated weights for policy 1, policy_version 1235033 (0.0005) [2023-12-26 09:31:18,118][123091] Updated weights for policy 0, policy_version 1243639 (0.0006) [2023-12-26 09:31:18,179][123091] Updated weights for policy 0, policy_version 1243649 (0.0005) [2023-12-26 09:31:18,223][123091] Updated weights for policy 0, policy_version 1243659 (0.0005) [2023-12-26 09:31:18,551][123090] Updated weights for policy 1, policy_version 1235043 (0.0007) [2023-12-26 09:31:18,612][123090] Updated weights for policy 1, policy_version 1235053 (0.0011) [2023-12-26 09:31:18,678][123090] Updated weights for policy 1, policy_version 1235063 (0.0010) [2023-12-26 09:31:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 634560512. Throughput: 0: 8872.9, 1: 8774.5. Samples: 634570408. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:18,785][121949] Avg episode reward: [(0, '6214.464'), (1, '5702.138')] [2023-12-26 09:31:18,926][123091] Updated weights for policy 0, policy_version 1243669 (0.0006) [2023-12-26 09:31:18,977][123091] Updated weights for policy 0, policy_version 1243679 (0.0008) [2023-12-26 09:31:19,025][123091] Updated weights for policy 0, policy_version 1243689 (0.0010) [2023-12-26 09:31:19,517][123090] Updated weights for policy 1, policy_version 1235073 (0.0010) [2023-12-26 09:31:19,581][123090] Updated weights for policy 1, policy_version 1235083 (0.0011) [2023-12-26 09:31:19,634][123090] Updated weights for policy 1, policy_version 1235093 (0.0008) [2023-12-26 09:31:19,683][123090] Updated weights for policy 1, policy_version 1235103 (0.0008) [2023-12-26 09:31:19,819][123091] Updated weights for policy 0, policy_version 1243699 (0.0009) [2023-12-26 09:31:19,881][123091] Updated weights for policy 0, policy_version 1243709 (0.0013) [2023-12-26 09:31:19,940][123091] Updated weights for policy 0, policy_version 1243719 (0.0011) [2023-12-26 09:31:20,618][123090] Updated weights for policy 1, policy_version 1235113 (0.0010) [2023-12-26 09:31:20,642][123091] Updated weights for policy 0, policy_version 1243729 (0.0010) [2023-12-26 09:31:20,679][123090] Updated weights for policy 1, policy_version 1235123 (0.0009) [2023-12-26 09:31:20,707][123091] Updated weights for policy 0, policy_version 1243739 (0.0006) [2023-12-26 09:31:20,749][123090] Updated weights for policy 1, policy_version 1235133 (0.0008) [2023-12-26 09:31:20,768][123091] Updated weights for policy 0, policy_version 1243749 (0.0006) [2023-12-26 09:31:20,835][123091] Updated weights for policy 0, policy_version 1243759 (0.0007) [2023-12-26 09:31:21,551][123091] Updated weights for policy 0, policy_version 1243769 (0.0008) [2023-12-26 09:31:21,617][123091] Updated weights for policy 0, policy_version 1243779 (0.0010) [2023-12-26 09:31:21,653][123090] Updated weights for policy 1, policy_version 1235143 (0.0009) [2023-12-26 09:31:21,683][123091] Updated weights for policy 0, policy_version 1243789 (0.0007) [2023-12-26 09:31:21,719][123090] Updated weights for policy 1, policy_version 1235153 (0.0008) [2023-12-26 09:31:21,787][123090] Updated weights for policy 1, policy_version 1235163 (0.0008) [2023-12-26 09:31:22,541][123091] Updated weights for policy 0, policy_version 1243799 (0.0009) [2023-12-26 09:31:22,601][123090] Updated weights for policy 1, policy_version 1235173 (0.0007) [2023-12-26 09:31:22,605][123091] Updated weights for policy 0, policy_version 1243809 (0.0010) [2023-12-26 09:31:22,649][123090] Updated weights for policy 1, policy_version 1235183 (0.0009) [2023-12-26 09:31:22,666][123091] Updated weights for policy 0, policy_version 1243820 (0.0009) [2023-12-26 09:31:22,701][123090] Updated weights for policy 1, policy_version 1235193 (0.0007) [2023-12-26 09:31:23,502][123091] Updated weights for policy 0, policy_version 1243830 (0.0010) [2023-12-26 09:31:23,554][123091] Updated weights for policy 0, policy_version 1243840 (0.0009) [2023-12-26 09:31:23,558][123090] Updated weights for policy 1, policy_version 1235203 (0.0010) [2023-12-26 09:31:23,612][123091] Updated weights for policy 0, policy_version 1243850 (0.0009) [2023-12-26 09:31:23,621][123090] Updated weights for policy 1, policy_version 1235213 (0.0010) [2023-12-26 09:31:23,687][123090] Updated weights for policy 1, policy_version 1235223 (0.0010) [2023-12-26 09:31:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 634650624. Throughput: 0: 8938.0, 1: 8738.5. Samples: 634622816. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:23,785][121949] Avg episode reward: [(0, '6222.469'), (1, '5635.812')] [2023-12-26 09:31:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001243856_318431232.pth... [2023-12-26 09:31:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001235232_316219392.pth... [2023-12-26 09:31:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001234176_315949056.pth [2023-12-26 09:31:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001242800_318160896.pth [2023-12-26 09:31:24,340][123091] Updated weights for policy 0, policy_version 1243860 (0.0009) [2023-12-26 09:31:24,402][123091] Updated weights for policy 0, policy_version 1243870 (0.0011) [2023-12-26 09:31:24,469][123091] Updated weights for policy 0, policy_version 1243880 (0.0010) [2023-12-26 09:31:24,538][123090] Updated weights for policy 1, policy_version 1235233 (0.0009) [2023-12-26 09:31:24,586][123090] Updated weights for policy 1, policy_version 1235243 (0.0009) [2023-12-26 09:31:24,642][123090] Updated weights for policy 1, policy_version 1235253 (0.0009) [2023-12-26 09:31:24,705][123090] Updated weights for policy 1, policy_version 1235263 (0.0009) [2023-12-26 09:31:25,284][123091] Updated weights for policy 0, policy_version 1243890 (0.0010) [2023-12-26 09:31:25,331][123091] Updated weights for policy 0, policy_version 1243900 (0.0010) [2023-12-26 09:31:25,396][123091] Updated weights for policy 0, policy_version 1243910 (0.0010) [2023-12-26 09:31:25,458][123091] Updated weights for policy 0, policy_version 1243920 (0.0011) [2023-12-26 09:31:25,556][123090] Updated weights for policy 1, policy_version 1235273 (0.0009) [2023-12-26 09:31:25,607][123090] Updated weights for policy 1, policy_version 1235283 (0.0009) [2023-12-26 09:31:25,658][123090] Updated weights for policy 1, policy_version 1235294 (0.0009) [2023-12-26 09:31:26,284][123091] Updated weights for policy 0, policy_version 1243930 (0.0010) [2023-12-26 09:31:26,342][123091] Updated weights for policy 0, policy_version 1243940 (0.0010) [2023-12-26 09:31:26,412][123091] Updated weights for policy 0, policy_version 1243950 (0.0010) [2023-12-26 09:31:26,526][123090] Updated weights for policy 1, policy_version 1235304 (0.0009) [2023-12-26 09:31:26,583][123090] Updated weights for policy 1, policy_version 1235314 (0.0008) [2023-12-26 09:31:26,647][123090] Updated weights for policy 1, policy_version 1235324 (0.0009) [2023-12-26 09:31:27,213][123091] Updated weights for policy 0, policy_version 1243960 (0.0010) [2023-12-26 09:31:27,264][123091] Updated weights for policy 0, policy_version 1243970 (0.0010) [2023-12-26 09:31:27,315][123091] Updated weights for policy 0, policy_version 1243980 (0.0009) [2023-12-26 09:31:27,475][123090] Updated weights for policy 1, policy_version 1235334 (0.0010) [2023-12-26 09:31:27,538][123090] Updated weights for policy 1, policy_version 1235344 (0.0010) [2023-12-26 09:31:27,598][123090] Updated weights for policy 1, policy_version 1235354 (0.0010) [2023-12-26 09:31:28,044][123091] Updated weights for policy 0, policy_version 1243990 (0.0008) [2023-12-26 09:31:28,094][123091] Updated weights for policy 0, policy_version 1244000 (0.0008) [2023-12-26 09:31:28,151][123091] Updated weights for policy 0, policy_version 1244010 (0.0008) [2023-12-26 09:31:28,427][123090] Updated weights for policy 1, policy_version 1235364 (0.0010) [2023-12-26 09:31:28,473][123090] Updated weights for policy 1, policy_version 1235374 (0.0005) [2023-12-26 09:31:28,518][123090] Updated weights for policy 1, policy_version 1235384 (0.0005) [2023-12-26 09:31:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 634732544. Throughput: 0: 8965.3, 1: 8707.9. Samples: 634725760. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:28,785][121949] Avg episode reward: [(0, '6369.741'), (1, '5583.540')] [2023-12-26 09:31:28,873][123091] Updated weights for policy 0, policy_version 1244020 (0.0007) [2023-12-26 09:31:28,944][123091] Updated weights for policy 0, policy_version 1244030 (0.0005) [2023-12-26 09:31:29,013][123091] Updated weights for policy 0, policy_version 1244040 (0.0007) [2023-12-26 09:31:29,353][123090] Updated weights for policy 1, policy_version 1235394 (0.0008) [2023-12-26 09:31:29,418][123090] Updated weights for policy 1, policy_version 1235404 (0.0011) [2023-12-26 09:31:29,490][123090] Updated weights for policy 1, policy_version 1235414 (0.0009) [2023-12-26 09:31:29,541][123090] Updated weights for policy 1, policy_version 1235424 (0.0007) [2023-12-26 09:31:29,756][123091] Updated weights for policy 0, policy_version 1244050 (0.0009) [2023-12-26 09:31:29,826][123091] Updated weights for policy 0, policy_version 1244060 (0.0006) [2023-12-26 09:31:29,887][123091] Updated weights for policy 0, policy_version 1244070 (0.0009) [2023-12-26 09:31:29,949][123091] Updated weights for policy 0, policy_version 1244080 (0.0009) [2023-12-26 09:31:30,350][123090] Updated weights for policy 1, policy_version 1235434 (0.0006) [2023-12-26 09:31:30,409][123090] Updated weights for policy 1, policy_version 1235444 (0.0006) [2023-12-26 09:31:30,458][123090] Updated weights for policy 1, policy_version 1235454 (0.0005) [2023-12-26 09:31:30,679][123091] Updated weights for policy 0, policy_version 1244090 (0.0011) [2023-12-26 09:31:30,734][123091] Updated weights for policy 0, policy_version 1244100 (0.0011) [2023-12-26 09:31:30,797][123091] Updated weights for policy 0, policy_version 1244110 (0.0010) [2023-12-26 09:31:31,129][123090] Updated weights for policy 1, policy_version 1235464 (0.0006) [2023-12-26 09:31:31,195][123090] Updated weights for policy 1, policy_version 1235474 (0.0009) [2023-12-26 09:31:31,265][123090] Updated weights for policy 1, policy_version 1235484 (0.0010) [2023-12-26 09:31:31,542][123091] Updated weights for policy 0, policy_version 1244120 (0.0007) [2023-12-26 09:31:31,606][123091] Updated weights for policy 0, policy_version 1244130 (0.0010) [2023-12-26 09:31:31,674][123091] Updated weights for policy 0, policy_version 1244140 (0.0010) [2023-12-26 09:31:32,106][123090] Updated weights for policy 1, policy_version 1235494 (0.0007) [2023-12-26 09:31:32,155][123090] Updated weights for policy 1, policy_version 1235504 (0.0008) [2023-12-26 09:31:32,211][123090] Updated weights for policy 1, policy_version 1235514 (0.0005) [2023-12-26 09:31:32,449][123091] Updated weights for policy 0, policy_version 1244150 (0.0008) [2023-12-26 09:31:32,519][123091] Updated weights for policy 0, policy_version 1244160 (0.0007) [2023-12-26 09:31:32,593][123091] Updated weights for policy 0, policy_version 1244170 (0.0006) [2023-12-26 09:31:32,915][123090] Updated weights for policy 1, policy_version 1235524 (0.0006) [2023-12-26 09:31:32,972][123090] Updated weights for policy 1, policy_version 1235534 (0.0006) [2023-12-26 09:31:33,041][123090] Updated weights for policy 1, policy_version 1235544 (0.0006) [2023-12-26 09:31:33,250][123091] Updated weights for policy 0, policy_version 1244180 (0.0006) [2023-12-26 09:31:33,295][123091] Updated weights for policy 0, policy_version 1244190 (0.0005) [2023-12-26 09:31:33,342][123091] Updated weights for policy 0, policy_version 1244200 (0.0005) [2023-12-26 09:31:33,695][123090] Updated weights for policy 1, policy_version 1235554 (0.0006) [2023-12-26 09:31:33,758][123090] Updated weights for policy 1, policy_version 1235564 (0.0005) [2023-12-26 09:31:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 634822656. Throughput: 0: 9057.3, 1: 8805.6. Samples: 634837768. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:33,785][121949] Avg episode reward: [(0, '6351.207'), (1, '5461.565')] [2023-12-26 09:31:33,821][123090] Updated weights for policy 1, policy_version 1235574 (0.0006) [2023-12-26 09:31:33,873][123090] Updated weights for policy 1, policy_version 1235584 (0.0006) [2023-12-26 09:31:34,023][123091] Updated weights for policy 0, policy_version 1244210 (0.0005) [2023-12-26 09:31:34,075][123091] Updated weights for policy 0, policy_version 1244220 (0.0007) [2023-12-26 09:31:34,133][123091] Updated weights for policy 0, policy_version 1244230 (0.0010) [2023-12-26 09:31:34,196][123091] Updated weights for policy 0, policy_version 1244240 (0.0011) [2023-12-26 09:31:34,531][123090] Updated weights for policy 1, policy_version 1235594 (0.0007) [2023-12-26 09:31:34,593][123090] Updated weights for policy 1, policy_version 1235604 (0.0009) [2023-12-26 09:31:34,662][123090] Updated weights for policy 1, policy_version 1235614 (0.0008) [2023-12-26 09:31:34,911][123091] Updated weights for policy 0, policy_version 1244250 (0.0005) [2023-12-26 09:31:34,986][123091] Updated weights for policy 0, policy_version 1244260 (0.0005) [2023-12-26 09:31:35,049][123091] Updated weights for policy 0, policy_version 1244270 (0.0005) [2023-12-26 09:31:35,338][123090] Updated weights for policy 1, policy_version 1235624 (0.0007) [2023-12-26 09:31:35,403][123090] Updated weights for policy 1, policy_version 1235634 (0.0008) [2023-12-26 09:31:35,472][123090] Updated weights for policy 1, policy_version 1235644 (0.0006) [2023-12-26 09:31:35,772][123091] Updated weights for policy 0, policy_version 1244280 (0.0005) [2023-12-26 09:31:35,825][123091] Updated weights for policy 0, policy_version 1244290 (0.0005) [2023-12-26 09:31:35,873][123091] Updated weights for policy 0, policy_version 1244300 (0.0005) [2023-12-26 09:31:36,066][123090] Updated weights for policy 1, policy_version 1235654 (0.0009) [2023-12-26 09:31:36,127][123090] Updated weights for policy 1, policy_version 1235664 (0.0009) [2023-12-26 09:31:36,191][123090] Updated weights for policy 1, policy_version 1235674 (0.0010) [2023-12-26 09:31:36,567][123091] Updated weights for policy 0, policy_version 1244310 (0.0005) [2023-12-26 09:31:36,631][123091] Updated weights for policy 0, policy_version 1244320 (0.0007) [2023-12-26 09:31:36,700][123091] Updated weights for policy 0, policy_version 1244330 (0.0010) [2023-12-26 09:31:37,042][123090] Updated weights for policy 1, policy_version 1235684 (0.0011) [2023-12-26 09:31:37,103][123090] Updated weights for policy 1, policy_version 1235694 (0.0011) [2023-12-26 09:31:37,156][123090] Updated weights for policy 1, policy_version 1235704 (0.0011) [2023-12-26 09:31:37,485][123091] Updated weights for policy 0, policy_version 1244340 (0.0009) [2023-12-26 09:31:37,544][123091] Updated weights for policy 0, policy_version 1244350 (0.0006) [2023-12-26 09:31:37,613][123091] Updated weights for policy 0, policy_version 1244360 (0.0008) [2023-12-26 09:31:38,012][123090] Updated weights for policy 1, policy_version 1235714 (0.0010) [2023-12-26 09:31:38,082][123090] Updated weights for policy 1, policy_version 1235724 (0.0008) [2023-12-26 09:31:38,156][123090] Updated weights for policy 1, policy_version 1235734 (0.0008) [2023-12-26 09:31:38,228][123090] Updated weights for policy 1, policy_version 1235744 (0.0008) [2023-12-26 09:31:38,422][123091] Updated weights for policy 0, policy_version 1244370 (0.0008) [2023-12-26 09:31:38,485][123091] Updated weights for policy 0, policy_version 1244380 (0.0010) [2023-12-26 09:31:38,554][123091] Updated weights for policy 0, policy_version 1244390 (0.0010) [2023-12-26 09:31:38,607][123091] Updated weights for policy 0, policy_version 1244400 (0.0009) [2023-12-26 09:31:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 634920960. Throughput: 0: 9161.8, 1: 8873.1. Samples: 634897364. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:38,785][121949] Avg episode reward: [(0, '6300.402'), (1, '5575.857')] [2023-12-26 09:31:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001244400_318570496.pth... [2023-12-26 09:31:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001235744_316350464.pth... [2023-12-26 09:31:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001243312_318291968.pth [2023-12-26 09:31:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001234720_316088320.pth [2023-12-26 09:31:38,999][123090] Updated weights for policy 1, policy_version 1235754 (0.0010) [2023-12-26 09:31:39,061][123090] Updated weights for policy 1, policy_version 1235764 (0.0009) [2023-12-26 09:31:39,129][123090] Updated weights for policy 1, policy_version 1235774 (0.0009) [2023-12-26 09:31:39,453][123091] Updated weights for policy 0, policy_version 1244410 (0.0010) [2023-12-26 09:31:39,513][123091] Updated weights for policy 0, policy_version 1244420 (0.0009) [2023-12-26 09:31:39,564][123091] Updated weights for policy 0, policy_version 1244430 (0.0010) [2023-12-26 09:31:39,961][123090] Updated weights for policy 1, policy_version 1235784 (0.0010) [2023-12-26 09:31:40,023][123090] Updated weights for policy 1, policy_version 1235794 (0.0008) [2023-12-26 09:31:40,079][123090] Updated weights for policy 1, policy_version 1235804 (0.0010) [2023-12-26 09:31:40,466][123091] Updated weights for policy 0, policy_version 1244440 (0.0010) [2023-12-26 09:31:40,526][123091] Updated weights for policy 0, policy_version 1244450 (0.0009) [2023-12-26 09:31:40,577][123091] Updated weights for policy 0, policy_version 1244460 (0.0010) [2023-12-26 09:31:40,897][123090] Updated weights for policy 1, policy_version 1235814 (0.0009) [2023-12-26 09:31:40,954][123090] Updated weights for policy 1, policy_version 1235824 (0.0009) [2023-12-26 09:31:41,009][123090] Updated weights for policy 1, policy_version 1235834 (0.0009) [2023-12-26 09:31:41,434][123091] Updated weights for policy 0, policy_version 1244470 (0.0010) [2023-12-26 09:31:41,490][123091] Updated weights for policy 0, policy_version 1244480 (0.0009) [2023-12-26 09:31:41,543][123091] Updated weights for policy 0, policy_version 1244490 (0.0009) [2023-12-26 09:31:41,877][123090] Updated weights for policy 1, policy_version 1235844 (0.0009) [2023-12-26 09:31:41,930][123090] Updated weights for policy 1, policy_version 1235855 (0.0009) [2023-12-26 09:31:41,984][123090] Updated weights for policy 1, policy_version 1235865 (0.0009) [2023-12-26 09:31:42,420][123091] Updated weights for policy 0, policy_version 1244500 (0.0009) [2023-12-26 09:31:42,476][123091] Updated weights for policy 0, policy_version 1244510 (0.0009) [2023-12-26 09:31:42,533][123091] Updated weights for policy 0, policy_version 1244520 (0.0010) [2023-12-26 09:31:42,856][123090] Updated weights for policy 1, policy_version 1235875 (0.0009) [2023-12-26 09:31:42,915][123090] Updated weights for policy 1, policy_version 1235885 (0.0010) [2023-12-26 09:31:42,979][123090] Updated weights for policy 1, policy_version 1235895 (0.0010) [2023-12-26 09:31:43,316][123091] Updated weights for policy 0, policy_version 1244530 (0.0010) [2023-12-26 09:31:43,379][123091] Updated weights for policy 0, policy_version 1244540 (0.0005) [2023-12-26 09:31:43,449][123091] Updated weights for policy 0, policy_version 1244550 (0.0005) [2023-12-26 09:31:43,506][123091] Updated weights for policy 0, policy_version 1244560 (0.0005) [2023-12-26 09:31:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 635002880. Throughput: 0: 9015.0, 1: 8847.6. Samples: 634997808. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:43,785][121949] Avg episode reward: [(0, '6268.652'), (1, '5709.041')] [2023-12-26 09:31:43,864][123090] Updated weights for policy 1, policy_version 1235905 (0.0010) [2023-12-26 09:31:43,926][123090] Updated weights for policy 1, policy_version 1235915 (0.0009) [2023-12-26 09:31:43,984][123090] Updated weights for policy 1, policy_version 1235925 (0.0008) [2023-12-26 09:31:44,046][123090] Updated weights for policy 1, policy_version 1235935 (0.0008) [2023-12-26 09:31:44,232][123091] Updated weights for policy 0, policy_version 1244570 (0.0007) [2023-12-26 09:31:44,293][123091] Updated weights for policy 0, policy_version 1244580 (0.0005) [2023-12-26 09:31:44,359][123091] Updated weights for policy 0, policy_version 1244590 (0.0006) [2023-12-26 09:31:44,737][123090] Updated weights for policy 1, policy_version 1235945 (0.0008) [2023-12-26 09:31:44,815][123090] Updated weights for policy 1, policy_version 1235955 (0.0007) [2023-12-26 09:31:44,884][123090] Updated weights for policy 1, policy_version 1235965 (0.0006) [2023-12-26 09:31:45,054][123091] Updated weights for policy 0, policy_version 1244600 (0.0008) [2023-12-26 09:31:45,125][123091] Updated weights for policy 0, policy_version 1244610 (0.0011) [2023-12-26 09:31:45,194][123091] Updated weights for policy 0, policy_version 1244620 (0.0011) [2023-12-26 09:31:45,662][123090] Updated weights for policy 1, policy_version 1235975 (0.0008) [2023-12-26 09:31:45,731][123090] Updated weights for policy 1, policy_version 1235985 (0.0009) [2023-12-26 09:31:45,796][123090] Updated weights for policy 1, policy_version 1235995 (0.0008) [2023-12-26 09:31:45,916][123091] Updated weights for policy 0, policy_version 1244630 (0.0011) [2023-12-26 09:31:45,967][123091] Updated weights for policy 0, policy_version 1244640 (0.0007) [2023-12-26 09:31:46,028][123091] Updated weights for policy 0, policy_version 1244650 (0.0005) [2023-12-26 09:31:46,665][123091] Updated weights for policy 0, policy_version 1244660 (0.0005) [2023-12-26 09:31:46,692][123090] Updated weights for policy 1, policy_version 1236005 (0.0007) [2023-12-26 09:31:46,726][123091] Updated weights for policy 0, policy_version 1244670 (0.0005) [2023-12-26 09:31:46,746][123090] Updated weights for policy 1, policy_version 1236015 (0.0009) [2023-12-26 09:31:46,793][123091] Updated weights for policy 0, policy_version 1244680 (0.0005) [2023-12-26 09:31:46,801][123090] Updated weights for policy 1, policy_version 1236025 (0.0009) [2023-12-26 09:31:47,508][123091] Updated weights for policy 0, policy_version 1244690 (0.0006) [2023-12-26 09:31:47,572][123091] Updated weights for policy 0, policy_version 1244700 (0.0010) [2023-12-26 09:31:47,636][123091] Updated weights for policy 0, policy_version 1244710 (0.0009) [2023-12-26 09:31:47,667][123090] Updated weights for policy 1, policy_version 1236035 (0.0008) [2023-12-26 09:31:47,700][123091] Updated weights for policy 0, policy_version 1244720 (0.0009) [2023-12-26 09:31:47,718][123090] Updated weights for policy 1, policy_version 1236045 (0.0009) [2023-12-26 09:31:47,776][123090] Updated weights for policy 1, policy_version 1236055 (0.0008) [2023-12-26 09:31:48,431][123091] Updated weights for policy 0, policy_version 1244730 (0.0006) [2023-12-26 09:31:48,495][123091] Updated weights for policy 0, policy_version 1244740 (0.0007) [2023-12-26 09:31:48,561][123091] Updated weights for policy 0, policy_version 1244750 (0.0009) [2023-12-26 09:31:48,693][123090] Updated weights for policy 1, policy_version 1236065 (0.0010) [2023-12-26 09:31:48,753][123090] Updated weights for policy 1, policy_version 1236075 (0.0010) [2023-12-26 09:31:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 635092992. Throughput: 0: 9099.0, 1: 8791.6. Samples: 635105968. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:48,784][121949] Avg episode reward: [(0, '6187.611'), (1, '5734.709')] [2023-12-26 09:31:48,809][123090] Updated weights for policy 1, policy_version 1236085 (0.0010) [2023-12-26 09:31:48,860][123090] Updated weights for policy 1, policy_version 1236095 (0.0010) [2023-12-26 09:31:49,358][123091] Updated weights for policy 0, policy_version 1244760 (0.0008) [2023-12-26 09:31:49,424][123091] Updated weights for policy 0, policy_version 1244770 (0.0009) [2023-12-26 09:31:49,491][123091] Updated weights for policy 0, policy_version 1244780 (0.0011) [2023-12-26 09:31:49,756][123090] Updated weights for policy 1, policy_version 1236105 (0.0005) [2023-12-26 09:31:49,827][123090] Updated weights for policy 1, policy_version 1236115 (0.0006) [2023-12-26 09:31:49,898][123090] Updated weights for policy 1, policy_version 1236125 (0.0007) [2023-12-26 09:31:50,246][123091] Updated weights for policy 0, policy_version 1244790 (0.0009) [2023-12-26 09:31:50,320][123091] Updated weights for policy 0, policy_version 1244800 (0.0009) [2023-12-26 09:31:50,376][123091] Updated weights for policy 0, policy_version 1244810 (0.0009) [2023-12-26 09:31:50,690][123090] Updated weights for policy 1, policy_version 1236135 (0.0010) [2023-12-26 09:31:50,760][123090] Updated weights for policy 1, policy_version 1236145 (0.0010) [2023-12-26 09:31:50,825][123090] Updated weights for policy 1, policy_version 1236155 (0.0010) [2023-12-26 09:31:51,222][123091] Updated weights for policy 0, policy_version 1244820 (0.0010) [2023-12-26 09:31:51,294][123091] Updated weights for policy 0, policy_version 1244830 (0.0010) [2023-12-26 09:31:51,362][123091] Updated weights for policy 0, policy_version 1244840 (0.0010) [2023-12-26 09:31:51,653][123090] Updated weights for policy 1, policy_version 1236165 (0.0009) [2023-12-26 09:31:51,724][123090] Updated weights for policy 1, policy_version 1236175 (0.0008) [2023-12-26 09:31:51,796][123090] Updated weights for policy 1, policy_version 1236185 (0.0010) [2023-12-26 09:31:52,193][123091] Updated weights for policy 0, policy_version 1244850 (0.0009) [2023-12-26 09:31:52,246][123091] Updated weights for policy 0, policy_version 1244860 (0.0009) [2023-12-26 09:31:52,304][123091] Updated weights for policy 0, policy_version 1244870 (0.0009) [2023-12-26 09:31:52,373][123091] Updated weights for policy 0, policy_version 1244880 (0.0007) [2023-12-26 09:31:52,666][123090] Updated weights for policy 1, policy_version 1236195 (0.0010) [2023-12-26 09:31:52,725][123090] Updated weights for policy 1, policy_version 1236205 (0.0010) [2023-12-26 09:31:52,790][123090] Updated weights for policy 1, policy_version 1236215 (0.0007) [2023-12-26 09:31:53,114][123091] Updated weights for policy 0, policy_version 1244890 (0.0009) [2023-12-26 09:31:53,182][123091] Updated weights for policy 0, policy_version 1244900 (0.0007) [2023-12-26 09:31:53,256][123091] Updated weights for policy 0, policy_version 1244910 (0.0005) [2023-12-26 09:31:53,578][123090] Updated weights for policy 1, policy_version 1236225 (0.0009) [2023-12-26 09:31:53,627][123090] Updated weights for policy 1, policy_version 1236235 (0.0005) [2023-12-26 09:31:53,676][123090] Updated weights for policy 1, policy_version 1236245 (0.0005) [2023-12-26 09:31:53,727][123090] Updated weights for policy 1, policy_version 1236255 (0.0005) [2023-12-26 09:31:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 635183104. Throughput: 0: 9079.0, 1: 8752.8. Samples: 635156976. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:53,785][121949] Avg episode reward: [(0, '6232.166'), (1, '5681.924')] [2023-12-26 09:31:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001236256_316481536.pth... [2023-12-26 09:31:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001244912_318701568.pth... [2023-12-26 09:31:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001235232_316219392.pth [2023-12-26 09:31:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001243856_318431232.pth [2023-12-26 09:31:53,911][123091] Updated weights for policy 0, policy_version 1244920 (0.0005) [2023-12-26 09:31:53,981][123091] Updated weights for policy 0, policy_version 1244930 (0.0006) [2023-12-26 09:31:54,052][123091] Updated weights for policy 0, policy_version 1244940 (0.0005) [2023-12-26 09:31:54,451][123090] Updated weights for policy 1, policy_version 1236265 (0.0008) [2023-12-26 09:31:54,516][123090] Updated weights for policy 1, policy_version 1236275 (0.0009) [2023-12-26 09:31:54,584][123090] Updated weights for policy 1, policy_version 1236285 (0.0010) [2023-12-26 09:31:54,757][123091] Updated weights for policy 0, policy_version 1244950 (0.0008) [2023-12-26 09:31:54,805][123091] Updated weights for policy 0, policy_version 1244960 (0.0010) [2023-12-26 09:31:54,856][123091] Updated weights for policy 0, policy_version 1244970 (0.0010) [2023-12-26 09:31:55,291][123090] Updated weights for policy 1, policy_version 1236295 (0.0006) [2023-12-26 09:31:55,337][123090] Updated weights for policy 1, policy_version 1236305 (0.0005) [2023-12-26 09:31:55,387][123090] Updated weights for policy 1, policy_version 1236315 (0.0005) [2023-12-26 09:31:55,533][123091] Updated weights for policy 0, policy_version 1244980 (0.0008) [2023-12-26 09:31:55,602][123091] Updated weights for policy 0, policy_version 1244990 (0.0005) [2023-12-26 09:31:55,679][123091] Updated weights for policy 0, policy_version 1245000 (0.0005) [2023-12-26 09:31:55,995][123090] Updated weights for policy 1, policy_version 1236325 (0.0005) [2023-12-26 09:31:56,043][123090] Updated weights for policy 1, policy_version 1236335 (0.0005) [2023-12-26 09:31:56,093][123090] Updated weights for policy 1, policy_version 1236345 (0.0005) [2023-12-26 09:31:56,316][123091] Updated weights for policy 0, policy_version 1245010 (0.0006) [2023-12-26 09:31:56,375][123091] Updated weights for policy 0, policy_version 1245020 (0.0005) [2023-12-26 09:31:56,424][123091] Updated weights for policy 0, policy_version 1245030 (0.0005) [2023-12-26 09:31:56,477][123091] Updated weights for policy 0, policy_version 1245040 (0.0005) [2023-12-26 09:31:56,774][123090] Updated weights for policy 1, policy_version 1236355 (0.0005) [2023-12-26 09:31:56,825][123090] Updated weights for policy 1, policy_version 1236365 (0.0005) [2023-12-26 09:31:56,870][123090] Updated weights for policy 1, policy_version 1236375 (0.0005) [2023-12-26 09:31:57,249][123091] Updated weights for policy 0, policy_version 1245050 (0.0010) [2023-12-26 09:31:57,295][123091] Updated weights for policy 0, policy_version 1245060 (0.0010) [2023-12-26 09:31:57,346][123091] Updated weights for policy 0, policy_version 1245070 (0.0010) [2023-12-26 09:31:57,514][123090] Updated weights for policy 1, policy_version 1236385 (0.0005) [2023-12-26 09:31:57,570][123090] Updated weights for policy 1, policy_version 1236395 (0.0009) [2023-12-26 09:31:57,629][123090] Updated weights for policy 1, policy_version 1236405 (0.0009) [2023-12-26 09:31:57,680][123090] Updated weights for policy 1, policy_version 1236415 (0.0009) [2023-12-26 09:31:58,090][123091] Updated weights for policy 0, policy_version 1245080 (0.0008) [2023-12-26 09:31:58,156][123091] Updated weights for policy 0, policy_version 1245090 (0.0009) [2023-12-26 09:31:58,224][123091] Updated weights for policy 0, policy_version 1245100 (0.0010) [2023-12-26 09:31:58,569][123090] Updated weights for policy 1, policy_version 1236425 (0.0010) [2023-12-26 09:31:58,642][123090] Updated weights for policy 1, policy_version 1236435 (0.0010) [2023-12-26 09:31:58,709][123090] Updated weights for policy 1, policy_version 1236445 (0.0006) [2023-12-26 09:31:58,784][121949] Fps is (10 sec: 18841.1, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 635281408. Throughput: 0: 9211.4, 1: 8868.9. Samples: 635272888. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:31:58,785][121949] Avg episode reward: [(0, '6277.594'), (1, '5742.445')] [2023-12-26 09:31:59,082][123091] Updated weights for policy 0, policy_version 1245110 (0.0009) [2023-12-26 09:31:59,152][123091] Updated weights for policy 0, policy_version 1245120 (0.0006) [2023-12-26 09:31:59,211][123091] Updated weights for policy 0, policy_version 1245130 (0.0009) [2023-12-26 09:31:59,550][123090] Updated weights for policy 1, policy_version 1236455 (0.0009) [2023-12-26 09:31:59,599][123090] Updated weights for policy 1, policy_version 1236465 (0.0009) [2023-12-26 09:31:59,648][123090] Updated weights for policy 1, policy_version 1236475 (0.0009) [2023-12-26 09:32:00,043][123091] Updated weights for policy 0, policy_version 1245140 (0.0009) [2023-12-26 09:32:00,101][123091] Updated weights for policy 0, policy_version 1245151 (0.0010) [2023-12-26 09:32:00,153][123091] Updated weights for policy 0, policy_version 1245161 (0.0010) [2023-12-26 09:32:00,482][123090] Updated weights for policy 1, policy_version 1236485 (0.0009) [2023-12-26 09:32:00,538][123090] Updated weights for policy 1, policy_version 1236495 (0.0009) [2023-12-26 09:32:00,596][123090] Updated weights for policy 1, policy_version 1236505 (0.0009) [2023-12-26 09:32:00,922][123091] Updated weights for policy 0, policy_version 1245171 (0.0008) [2023-12-26 09:32:00,967][123091] Updated weights for policy 0, policy_version 1245181 (0.0005) [2023-12-26 09:32:01,018][123091] Updated weights for policy 0, policy_version 1245191 (0.0005) [2023-12-26 09:32:01,522][123090] Updated weights for policy 1, policy_version 1236515 (0.0009) [2023-12-26 09:32:01,588][123090] Updated weights for policy 1, policy_version 1236525 (0.0009) [2023-12-26 09:32:01,661][123090] Updated weights for policy 1, policy_version 1236535 (0.0008) [2023-12-26 09:32:01,822][123091] Updated weights for policy 0, policy_version 1245201 (0.0008) [2023-12-26 09:32:01,879][123091] Updated weights for policy 0, policy_version 1245211 (0.0010) [2023-12-26 09:32:01,933][123091] Updated weights for policy 0, policy_version 1245221 (0.0007) [2023-12-26 09:32:01,996][123091] Updated weights for policy 0, policy_version 1245231 (0.0006) [2023-12-26 09:32:02,414][123090] Updated weights for policy 1, policy_version 1236545 (0.0007) [2023-12-26 09:32:02,469][123090] Updated weights for policy 1, policy_version 1236555 (0.0010) [2023-12-26 09:32:02,524][123090] Updated weights for policy 1, policy_version 1236565 (0.0010) [2023-12-26 09:32:02,576][123090] Updated weights for policy 1, policy_version 1236575 (0.0010) [2023-12-26 09:32:02,789][123091] Updated weights for policy 0, policy_version 1245241 (0.0009) [2023-12-26 09:32:02,845][123091] Updated weights for policy 0, policy_version 1245251 (0.0009) [2023-12-26 09:32:02,916][123091] Updated weights for policy 0, policy_version 1245261 (0.0010) [2023-12-26 09:32:03,303][123090] Updated weights for policy 1, policy_version 1236585 (0.0006) [2023-12-26 09:32:03,354][123090] Updated weights for policy 1, policy_version 1236595 (0.0005) [2023-12-26 09:32:03,404][123090] Updated weights for policy 1, policy_version 1236605 (0.0009) [2023-12-26 09:32:03,780][123091] Updated weights for policy 0, policy_version 1245271 (0.0009) [2023-12-26 09:32:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 635363328. Throughput: 0: 9149.7, 1: 8802.1. Samples: 635378240. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:03,785][121949] Avg episode reward: [(0, '6351.561'), (1, '5838.053')] [2023-12-26 09:32:03,837][123091] Updated weights for policy 0, policy_version 1245281 (0.0009) [2023-12-26 09:32:03,904][123091] Updated weights for policy 0, policy_version 1245291 (0.0008) [2023-12-26 09:32:04,219][123090] Updated weights for policy 1, policy_version 1236615 (0.0010) [2023-12-26 09:32:04,281][123090] Updated weights for policy 1, policy_version 1236625 (0.0009) [2023-12-26 09:32:04,345][123090] Updated weights for policy 1, policy_version 1236635 (0.0009) [2023-12-26 09:32:04,775][123091] Updated weights for policy 0, policy_version 1245301 (0.0009) [2023-12-26 09:32:04,826][123091] Updated weights for policy 0, policy_version 1245311 (0.0009) [2023-12-26 09:32:04,875][123091] Updated weights for policy 0, policy_version 1245321 (0.0009) [2023-12-26 09:32:05,106][123090] Updated weights for policy 1, policy_version 1236645 (0.0009) [2023-12-26 09:32:05,173][123090] Updated weights for policy 1, policy_version 1236655 (0.0010) [2023-12-26 09:32:05,236][123090] Updated weights for policy 1, policy_version 1236665 (0.0009) [2023-12-26 09:32:05,726][123091] Updated weights for policy 0, policy_version 1245331 (0.0008) [2023-12-26 09:32:05,784][123091] Updated weights for policy 0, policy_version 1245341 (0.0005) [2023-12-26 09:32:05,857][123091] Updated weights for policy 0, policy_version 1245351 (0.0005) [2023-12-26 09:32:06,023][123090] Updated weights for policy 1, policy_version 1236675 (0.0008) [2023-12-26 09:32:06,070][123090] Updated weights for policy 1, policy_version 1236685 (0.0005) [2023-12-26 09:32:06,131][123090] Updated weights for policy 1, policy_version 1236695 (0.0007) [2023-12-26 09:32:06,602][123091] Updated weights for policy 0, policy_version 1245361 (0.0006) [2023-12-26 09:32:06,666][123091] Updated weights for policy 0, policy_version 1245371 (0.0007) [2023-12-26 09:32:06,732][123091] Updated weights for policy 0, policy_version 1245381 (0.0009) [2023-12-26 09:32:06,799][123091] Updated weights for policy 0, policy_version 1245391 (0.0009) [2023-12-26 09:32:06,880][123090] Updated weights for policy 1, policy_version 1236705 (0.0007) [2023-12-26 09:32:06,950][123090] Updated weights for policy 1, policy_version 1236715 (0.0010) [2023-12-26 09:32:07,005][123090] Updated weights for policy 1, policy_version 1236725 (0.0007) [2023-12-26 09:32:07,064][123090] Updated weights for policy 1, policy_version 1236735 (0.0009) [2023-12-26 09:32:07,646][123091] Updated weights for policy 0, policy_version 1245401 (0.0010) [2023-12-26 09:32:07,714][123091] Updated weights for policy 0, policy_version 1245411 (0.0009) [2023-12-26 09:32:07,790][123091] Updated weights for policy 0, policy_version 1245421 (0.0009) [2023-12-26 09:32:07,889][123090] Updated weights for policy 1, policy_version 1236745 (0.0010) [2023-12-26 09:32:07,943][123090] Updated weights for policy 1, policy_version 1236755 (0.0010) [2023-12-26 09:32:07,998][123090] Updated weights for policy 1, policy_version 1236765 (0.0010) [2023-12-26 09:32:08,453][123091] Updated weights for policy 0, policy_version 1245431 (0.0007) [2023-12-26 09:32:08,507][123091] Updated weights for policy 0, policy_version 1245441 (0.0010) [2023-12-26 09:32:08,562][123091] Updated weights for policy 0, policy_version 1245451 (0.0011) [2023-12-26 09:32:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 635453440. Throughput: 0: 9096.0, 1: 8860.5. Samples: 635430856. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:08,784][121949] Avg episode reward: [(0, '6356.040'), (1, '5856.001')] [2023-12-26 09:32:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001245456_318840832.pth... [2023-12-26 09:32:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001236768_316612608.pth... [2023-12-26 09:32:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001244400_318570496.pth [2023-12-26 09:32:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001235744_316350464.pth [2023-12-26 09:32:08,914][123090] Updated weights for policy 1, policy_version 1236775 (0.0010) [2023-12-26 09:32:08,965][123090] Updated weights for policy 1, policy_version 1236785 (0.0010) [2023-12-26 09:32:09,020][123090] Updated weights for policy 1, policy_version 1236795 (0.0010) [2023-12-26 09:32:09,442][123091] Updated weights for policy 0, policy_version 1245461 (0.0009) [2023-12-26 09:32:09,510][123091] Updated weights for policy 0, policy_version 1245471 (0.0006) [2023-12-26 09:32:09,580][123091] Updated weights for policy 0, policy_version 1245481 (0.0006) [2023-12-26 09:32:09,816][123090] Updated weights for policy 1, policy_version 1236805 (0.0009) [2023-12-26 09:32:09,887][123090] Updated weights for policy 1, policy_version 1236815 (0.0008) [2023-12-26 09:32:09,953][123090] Updated weights for policy 1, policy_version 1236825 (0.0009) [2023-12-26 09:32:10,309][123091] Updated weights for policy 0, policy_version 1245491 (0.0007) [2023-12-26 09:32:10,371][123091] Updated weights for policy 0, policy_version 1245501 (0.0008) [2023-12-26 09:32:10,440][123091] Updated weights for policy 0, policy_version 1245511 (0.0005) [2023-12-26 09:32:10,785][123090] Updated weights for policy 1, policy_version 1236835 (0.0009) [2023-12-26 09:32:10,852][123090] Updated weights for policy 1, policy_version 1236845 (0.0011) [2023-12-26 09:32:10,919][123090] Updated weights for policy 1, policy_version 1236855 (0.0010) [2023-12-26 09:32:11,076][123091] Updated weights for policy 0, policy_version 1245521 (0.0006) [2023-12-26 09:32:11,146][123091] Updated weights for policy 0, policy_version 1245531 (0.0009) [2023-12-26 09:32:11,207][123091] Updated weights for policy 0, policy_version 1245541 (0.0009) [2023-12-26 09:32:11,272][123091] Updated weights for policy 0, policy_version 1245551 (0.0010) [2023-12-26 09:32:11,724][123090] Updated weights for policy 1, policy_version 1236865 (0.0010) [2023-12-26 09:32:11,793][123090] Updated weights for policy 1, policy_version 1236875 (0.0008) [2023-12-26 09:32:11,858][123090] Updated weights for policy 1, policy_version 1236885 (0.0006) [2023-12-26 09:32:11,909][123090] Updated weights for policy 1, policy_version 1236895 (0.0005) [2023-12-26 09:32:12,120][123091] Updated weights for policy 0, policy_version 1245561 (0.0006) [2023-12-26 09:32:12,187][123091] Updated weights for policy 0, policy_version 1245571 (0.0006) [2023-12-26 09:32:12,244][123091] Updated weights for policy 0, policy_version 1245581 (0.0008) [2023-12-26 09:32:12,783][123090] Updated weights for policy 1, policy_version 1236905 (0.0009) [2023-12-26 09:32:12,838][123090] Updated weights for policy 1, policy_version 1236915 (0.0009) [2023-12-26 09:32:12,902][123090] Updated weights for policy 1, policy_version 1236925 (0.0009) [2023-12-26 09:32:13,105][123091] Updated weights for policy 0, policy_version 1245591 (0.0009) [2023-12-26 09:32:13,163][123091] Updated weights for policy 0, policy_version 1245601 (0.0008) [2023-12-26 09:32:13,225][123091] Updated weights for policy 0, policy_version 1245611 (0.0006) [2023-12-26 09:32:13,757][123090] Updated weights for policy 1, policy_version 1236935 (0.0009) [2023-12-26 09:32:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 635535360. Throughput: 0: 9112.5, 1: 8863.7. Samples: 635534688. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:13,785][121949] Avg episode reward: [(0, '6264.921'), (1, '5836.351')] [2023-12-26 09:32:13,808][123090] Updated weights for policy 1, policy_version 1236945 (0.0009) [2023-12-26 09:32:13,864][123090] Updated weights for policy 1, policy_version 1236955 (0.0008) [2023-12-26 09:32:13,932][123091] Updated weights for policy 0, policy_version 1245621 (0.0007) [2023-12-26 09:32:13,983][123091] Updated weights for policy 0, policy_version 1245632 (0.0010) [2023-12-26 09:32:14,035][123091] Updated weights for policy 0, policy_version 1245643 (0.0010) [2023-12-26 09:32:14,717][123090] Updated weights for policy 1, policy_version 1236965 (0.0008) [2023-12-26 09:32:14,788][123090] Updated weights for policy 1, policy_version 1236975 (0.0010) [2023-12-26 09:32:14,859][123090] Updated weights for policy 1, policy_version 1236985 (0.0010) [2023-12-26 09:32:14,909][123091] Updated weights for policy 0, policy_version 1245653 (0.0010) [2023-12-26 09:32:14,976][123091] Updated weights for policy 0, policy_version 1245663 (0.0010) [2023-12-26 09:32:15,045][123091] Updated weights for policy 0, policy_version 1245673 (0.0009) [2023-12-26 09:32:15,673][123090] Updated weights for policy 1, policy_version 1236995 (0.0009) [2023-12-26 09:32:15,741][123090] Updated weights for policy 1, policy_version 1237005 (0.0009) [2023-12-26 09:32:15,807][123090] Updated weights for policy 1, policy_version 1237015 (0.0009) [2023-12-26 09:32:15,866][123091] Updated weights for policy 0, policy_version 1245683 (0.0010) [2023-12-26 09:32:15,921][123091] Updated weights for policy 0, policy_version 1245693 (0.0010) [2023-12-26 09:32:15,983][123091] Updated weights for policy 0, policy_version 1245703 (0.0009) [2023-12-26 09:32:16,554][123090] Updated weights for policy 1, policy_version 1237025 (0.0008) [2023-12-26 09:32:16,606][123090] Updated weights for policy 1, policy_version 1237035 (0.0006) [2023-12-26 09:32:16,662][123090] Updated weights for policy 1, policy_version 1237045 (0.0009) [2023-12-26 09:32:16,717][123090] Updated weights for policy 1, policy_version 1237055 (0.0009) [2023-12-26 09:32:16,844][123091] Updated weights for policy 0, policy_version 1245713 (0.0010) [2023-12-26 09:32:16,900][123091] Updated weights for policy 0, policy_version 1245723 (0.0009) [2023-12-26 09:32:16,952][123091] Updated weights for policy 0, policy_version 1245734 (0.0009) [2023-12-26 09:32:17,013][123091] Updated weights for policy 0, policy_version 1245744 (0.0006) [2023-12-26 09:32:17,516][123090] Updated weights for policy 1, policy_version 1237066 (0.0010) [2023-12-26 09:32:17,570][123090] Updated weights for policy 1, policy_version 1237077 (0.0010) [2023-12-26 09:32:17,625][123090] Updated weights for policy 1, policy_version 1237088 (0.0010) [2023-12-26 09:32:17,778][123091] Updated weights for policy 0, policy_version 1245754 (0.0006) [2023-12-26 09:32:17,825][123091] Updated weights for policy 0, policy_version 1245764 (0.0008) [2023-12-26 09:32:17,884][123091] Updated weights for policy 0, policy_version 1245774 (0.0010) [2023-12-26 09:32:18,524][123090] Updated weights for policy 1, policy_version 1237098 (0.0009) [2023-12-26 09:32:18,592][123090] Updated weights for policy 1, policy_version 1237108 (0.0009) [2023-12-26 09:32:18,650][123090] Updated weights for policy 1, policy_version 1237118 (0.0007) [2023-12-26 09:32:18,709][123091] Updated weights for policy 0, policy_version 1245784 (0.0010) [2023-12-26 09:32:18,780][123091] Updated weights for policy 0, policy_version 1245794 (0.0009) [2023-12-26 09:32:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 635625472. Throughput: 0: 9010.9, 1: 8776.6. Samples: 635638208. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:18,785][121949] Avg episode reward: [(0, '6301.390'), (1, '5838.359')] [2023-12-26 09:32:18,843][123091] Updated weights for policy 0, policy_version 1245804 (0.0011) [2023-12-26 09:32:19,391][123090] Updated weights for policy 1, policy_version 1237128 (0.0008) [2023-12-26 09:32:19,451][123090] Updated weights for policy 1, policy_version 1237138 (0.0008) [2023-12-26 09:32:19,523][123090] Updated weights for policy 1, policy_version 1237148 (0.0008) [2023-12-26 09:32:19,661][123091] Updated weights for policy 0, policy_version 1245814 (0.0011) [2023-12-26 09:32:19,724][123091] Updated weights for policy 0, policy_version 1245824 (0.0011) [2023-12-26 09:32:19,792][123091] Updated weights for policy 0, policy_version 1245834 (0.0011) [2023-12-26 09:32:20,358][123090] Updated weights for policy 1, policy_version 1237158 (0.0008) [2023-12-26 09:32:20,426][123090] Updated weights for policy 1, policy_version 1237168 (0.0009) [2023-12-26 09:32:20,488][123090] Updated weights for policy 1, policy_version 1237178 (0.0009) [2023-12-26 09:32:20,601][123091] Updated weights for policy 0, policy_version 1245844 (0.0011) [2023-12-26 09:32:20,655][123091] Updated weights for policy 0, policy_version 1245854 (0.0010) [2023-12-26 09:32:20,718][123091] Updated weights for policy 0, policy_version 1245864 (0.0010) [2023-12-26 09:32:21,383][123090] Updated weights for policy 1, policy_version 1237188 (0.0009) [2023-12-26 09:32:21,450][123090] Updated weights for policy 1, policy_version 1237198 (0.0010) [2023-12-26 09:32:21,513][123090] Updated weights for policy 1, policy_version 1237208 (0.0009) [2023-12-26 09:32:21,541][123091] Updated weights for policy 0, policy_version 1245874 (0.0008) [2023-12-26 09:32:21,614][123091] Updated weights for policy 0, policy_version 1245884 (0.0008) [2023-12-26 09:32:21,682][123091] Updated weights for policy 0, policy_version 1245894 (0.0009) [2023-12-26 09:32:21,752][123091] Updated weights for policy 0, policy_version 1245904 (0.0009) [2023-12-26 09:32:22,364][123090] Updated weights for policy 1, policy_version 1237218 (0.0007) [2023-12-26 09:32:22,434][123090] Updated weights for policy 1, policy_version 1237228 (0.0010) [2023-12-26 09:32:22,500][123090] Updated weights for policy 1, policy_version 1237238 (0.0010) [2023-12-26 09:32:22,553][123091] Updated weights for policy 0, policy_version 1245914 (0.0008) [2023-12-26 09:32:22,564][123090] Updated weights for policy 1, policy_version 1237248 (0.0009) [2023-12-26 09:32:22,617][123091] Updated weights for policy 0, policy_version 1245924 (0.0010) [2023-12-26 09:32:22,681][123091] Updated weights for policy 0, policy_version 1245934 (0.0009) [2023-12-26 09:32:23,372][123090] Updated weights for policy 1, policy_version 1237258 (0.0009) [2023-12-26 09:32:23,438][123090] Updated weights for policy 1, policy_version 1237268 (0.0009) [2023-12-26 09:32:23,499][123090] Updated weights for policy 1, policy_version 1237279 (0.0009) [2023-12-26 09:32:23,510][123091] Updated weights for policy 0, policy_version 1245944 (0.0009) [2023-12-26 09:32:23,562][123091] Updated weights for policy 0, policy_version 1245954 (0.0009) [2023-12-26 09:32:23,623][123091] Updated weights for policy 0, policy_version 1245964 (0.0009) [2023-12-26 09:32:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 635715584. Throughput: 0: 8912.5, 1: 8683.1. Samples: 635689164. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:23,784][121949] Avg episode reward: [(0, '6327.504'), (1, '5887.202')] [2023-12-26 09:32:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001245968_318971904.pth... [2023-12-26 09:32:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001237280_316743680.pth... [2023-12-26 09:32:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001244912_318701568.pth [2023-12-26 09:32:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001236256_316481536.pth [2023-12-26 09:32:24,352][123090] Updated weights for policy 1, policy_version 1237289 (0.0008) [2023-12-26 09:32:24,413][123090] Updated weights for policy 1, policy_version 1237299 (0.0009) [2023-12-26 09:32:24,469][123090] Updated weights for policy 1, policy_version 1237309 (0.0008) [2023-12-26 09:32:24,471][123091] Updated weights for policy 0, policy_version 1245974 (0.0009) [2023-12-26 09:32:24,523][123091] Updated weights for policy 0, policy_version 1245984 (0.0009) [2023-12-26 09:32:24,589][123091] Updated weights for policy 0, policy_version 1245994 (0.0009) [2023-12-26 09:32:25,224][123090] Updated weights for policy 1, policy_version 1237319 (0.0006) [2023-12-26 09:32:25,282][123090] Updated weights for policy 1, policy_version 1237329 (0.0006) [2023-12-26 09:32:25,336][123090] Updated weights for policy 1, policy_version 1237339 (0.0009) [2023-12-26 09:32:25,459][123091] Updated weights for policy 0, policy_version 1246004 (0.0009) [2023-12-26 09:32:25,509][123091] Updated weights for policy 0, policy_version 1246014 (0.0009) [2023-12-26 09:32:25,561][123091] Updated weights for policy 0, policy_version 1246024 (0.0009) [2023-12-26 09:32:26,179][123090] Updated weights for policy 1, policy_version 1237349 (0.0009) [2023-12-26 09:32:26,229][123090] Updated weights for policy 1, policy_version 1237359 (0.0009) [2023-12-26 09:32:26,277][123090] Updated weights for policy 1, policy_version 1237369 (0.0009) [2023-12-26 09:32:26,349][123091] Updated weights for policy 0, policy_version 1246034 (0.0008) [2023-12-26 09:32:26,395][123091] Updated weights for policy 0, policy_version 1246044 (0.0007) [2023-12-26 09:32:26,438][123091] Updated weights for policy 0, policy_version 1246054 (0.0010) [2023-12-26 09:32:26,489][123091] Updated weights for policy 0, policy_version 1246064 (0.0010) [2023-12-26 09:32:27,142][123090] Updated weights for policy 1, policy_version 1237379 (0.0009) [2023-12-26 09:32:27,208][123090] Updated weights for policy 1, policy_version 1237389 (0.0010) [2023-12-26 09:32:27,273][123090] Updated weights for policy 1, policy_version 1237399 (0.0010) [2023-12-26 09:32:27,340][123091] Updated weights for policy 0, policy_version 1246074 (0.0010) [2023-12-26 09:32:27,402][123091] Updated weights for policy 0, policy_version 1246084 (0.0010) [2023-12-26 09:32:27,466][123091] Updated weights for policy 0, policy_version 1246094 (0.0010) [2023-12-26 09:32:28,032][123090] Updated weights for policy 1, policy_version 1237409 (0.0010) [2023-12-26 09:32:28,098][123090] Updated weights for policy 1, policy_version 1237419 (0.0006) [2023-12-26 09:32:28,159][123090] Updated weights for policy 1, policy_version 1237429 (0.0005) [2023-12-26 09:32:28,221][123090] Updated weights for policy 1, policy_version 1237439 (0.0006) [2023-12-26 09:32:28,273][123091] Updated weights for policy 0, policy_version 1246104 (0.0010) [2023-12-26 09:32:28,341][123091] Updated weights for policy 0, policy_version 1246114 (0.0010) [2023-12-26 09:32:28,404][123091] Updated weights for policy 0, policy_version 1246124 (0.0010) [2023-12-26 09:32:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 635797504. Throughput: 0: 8946.9, 1: 8700.3. Samples: 635791928. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:28,785][121949] Avg episode reward: [(0, '6208.623'), (1, '5907.919')] [2023-12-26 09:32:28,847][123090] Updated weights for policy 1, policy_version 1237449 (0.0008) [2023-12-26 09:32:28,916][123090] Updated weights for policy 1, policy_version 1237459 (0.0009) [2023-12-26 09:32:28,964][123090] Updated weights for policy 1, policy_version 1237469 (0.0009) [2023-12-26 09:32:29,208][123091] Updated weights for policy 0, policy_version 1246134 (0.0010) [2023-12-26 09:32:29,279][123091] Updated weights for policy 0, policy_version 1246144 (0.0011) [2023-12-26 09:32:29,348][123091] Updated weights for policy 0, policy_version 1246154 (0.0013) [2023-12-26 09:32:29,776][123090] Updated weights for policy 1, policy_version 1237479 (0.0006) [2023-12-26 09:32:29,834][123090] Updated weights for policy 1, policy_version 1237489 (0.0007) [2023-12-26 09:32:29,898][123090] Updated weights for policy 1, policy_version 1237499 (0.0008) [2023-12-26 09:32:30,137][123091] Updated weights for policy 0, policy_version 1246164 (0.0009) [2023-12-26 09:32:30,204][123091] Updated weights for policy 0, policy_version 1246174 (0.0008) [2023-12-26 09:32:30,273][123091] Updated weights for policy 0, policy_version 1246184 (0.0006) [2023-12-26 09:32:30,716][123090] Updated weights for policy 1, policy_version 1237509 (0.0008) [2023-12-26 09:32:30,770][123090] Updated weights for policy 1, policy_version 1237519 (0.0010) [2023-12-26 09:32:30,825][123090] Updated weights for policy 1, policy_version 1237529 (0.0009) [2023-12-26 09:32:30,958][123091] Updated weights for policy 0, policy_version 1246194 (0.0008) [2023-12-26 09:32:31,012][123091] Updated weights for policy 0, policy_version 1246204 (0.0010) [2023-12-26 09:32:31,071][123091] Updated weights for policy 0, policy_version 1246214 (0.0010) [2023-12-26 09:32:31,138][123091] Updated weights for policy 0, policy_version 1246224 (0.0011) [2023-12-26 09:32:31,722][123090] Updated weights for policy 1, policy_version 1237539 (0.0009) [2023-12-26 09:32:31,781][123090] Updated weights for policy 1, policy_version 1237549 (0.0009) [2023-12-26 09:32:31,840][123090] Updated weights for policy 1, policy_version 1237559 (0.0010) [2023-12-26 09:32:31,894][123091] Updated weights for policy 0, policy_version 1246234 (0.0005) [2023-12-26 09:32:31,959][123091] Updated weights for policy 0, policy_version 1246244 (0.0006) [2023-12-26 09:32:32,022][123091] Updated weights for policy 0, policy_version 1246254 (0.0008) [2023-12-26 09:32:32,706][123091] Updated weights for policy 0, policy_version 1246264 (0.0005) [2023-12-26 09:32:32,744][123090] Updated weights for policy 1, policy_version 1237569 (0.0008) [2023-12-26 09:32:32,760][123091] Updated weights for policy 0, policy_version 1246274 (0.0006) [2023-12-26 09:32:32,814][123091] Updated weights for policy 0, policy_version 1246284 (0.0007) [2023-12-26 09:32:32,815][123090] Updated weights for policy 1, policy_version 1237579 (0.0007) [2023-12-26 09:32:32,869][123090] Updated weights for policy 1, policy_version 1237589 (0.0009) [2023-12-26 09:32:32,927][123090] Updated weights for policy 1, policy_version 1237599 (0.0009) [2023-12-26 09:32:33,528][123091] Updated weights for policy 0, policy_version 1246294 (0.0006) [2023-12-26 09:32:33,573][123091] Updated weights for policy 0, policy_version 1246304 (0.0005) [2023-12-26 09:32:33,632][123091] Updated weights for policy 0, policy_version 1246314 (0.0007) [2023-12-26 09:32:33,773][123090] Updated weights for policy 1, policy_version 1237609 (0.0009) [2023-12-26 09:32:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 635887616. Throughput: 0: 8905.0, 1: 8731.5. Samples: 635899608. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:33,784][121949] Avg episode reward: [(0, '6247.392'), (1, '5847.359')] [2023-12-26 09:32:33,833][123090] Updated weights for policy 1, policy_version 1237619 (0.0009) [2023-12-26 09:32:33,898][123090] Updated weights for policy 1, policy_version 1237629 (0.0010) [2023-12-26 09:32:34,313][123091] Updated weights for policy 0, policy_version 1246325 (0.0009) [2023-12-26 09:32:34,365][123091] Updated weights for policy 0, policy_version 1246335 (0.0011) [2023-12-26 09:32:34,417][123091] Updated weights for policy 0, policy_version 1246345 (0.0011) [2023-12-26 09:32:34,816][123090] Updated weights for policy 1, policy_version 1237640 (0.0010) [2023-12-26 09:32:34,876][123090] Updated weights for policy 1, policy_version 1237650 (0.0009) [2023-12-26 09:32:34,938][123090] Updated weights for policy 1, policy_version 1237660 (0.0009) [2023-12-26 09:32:35,266][123091] Updated weights for policy 0, policy_version 1246355 (0.0011) [2023-12-26 09:32:35,317][123091] Updated weights for policy 0, policy_version 1246365 (0.0010) [2023-12-26 09:32:35,364][123091] Updated weights for policy 0, policy_version 1246375 (0.0010) [2023-12-26 09:32:35,785][123090] Updated weights for policy 1, policy_version 1237670 (0.0009) [2023-12-26 09:32:35,848][123090] Updated weights for policy 1, policy_version 1237680 (0.0008) [2023-12-26 09:32:35,905][123090] Updated weights for policy 1, policy_version 1237690 (0.0009) [2023-12-26 09:32:36,178][123091] Updated weights for policy 0, policy_version 1246385 (0.0010) [2023-12-26 09:32:36,241][123091] Updated weights for policy 0, policy_version 1246395 (0.0007) [2023-12-26 09:32:36,300][123091] Updated weights for policy 0, policy_version 1246405 (0.0010) [2023-12-26 09:32:36,357][123091] Updated weights for policy 0, policy_version 1246416 (0.0009) [2023-12-26 09:32:36,776][123090] Updated weights for policy 1, policy_version 1237700 (0.0009) [2023-12-26 09:32:36,849][123090] Updated weights for policy 1, policy_version 1237710 (0.0010) [2023-12-26 09:32:36,920][123090] Updated weights for policy 1, policy_version 1237720 (0.0008) [2023-12-26 09:32:37,084][123091] Updated weights for policy 0, policy_version 1246426 (0.0006) [2023-12-26 09:32:37,133][123091] Updated weights for policy 0, policy_version 1246436 (0.0006) [2023-12-26 09:32:37,200][123091] Updated weights for policy 0, policy_version 1246446 (0.0008) [2023-12-26 09:32:37,821][123090] Updated weights for policy 1, policy_version 1237730 (0.0007) [2023-12-26 09:32:37,856][123091] Updated weights for policy 0, policy_version 1246456 (0.0010) [2023-12-26 09:32:37,882][123090] Updated weights for policy 1, policy_version 1237740 (0.0007) [2023-12-26 09:32:37,927][123091] Updated weights for policy 0, policy_version 1246466 (0.0008) [2023-12-26 09:32:37,934][123090] Updated weights for policy 1, policy_version 1237750 (0.0008) [2023-12-26 09:32:37,990][123091] Updated weights for policy 0, policy_version 1246476 (0.0008) [2023-12-26 09:32:37,997][123090] Updated weights for policy 1, policy_version 1237760 (0.0009) [2023-12-26 09:32:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 635969536. Throughput: 0: 8948.7, 1: 8707.4. Samples: 635951500. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:38,785][121949] Avg episode reward: [(0, '6201.000'), (1, '5883.161')] [2023-12-26 09:32:38,836][123091] Updated weights for policy 0, policy_version 1246486 (0.0010) [2023-12-26 09:32:38,842][123090] Updated weights for policy 1, policy_version 1237770 (0.0009) [2023-12-26 09:32:38,897][123091] Updated weights for policy 0, policy_version 1246496 (0.0011) [2023-12-26 09:32:38,908][123090] Updated weights for policy 1, policy_version 1237780 (0.0007) [2023-12-26 09:32:38,955][123091] Updated weights for policy 0, policy_version 1246506 (0.0006) [2023-12-26 09:32:38,972][123090] Updated weights for policy 1, policy_version 1237790 (0.0010) [2023-12-26 09:32:38,981][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001237792_316874752.pth... [2023-12-26 09:32:38,984][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001246512_319111168.pth... [2023-12-26 09:32:38,985][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001236768_316612608.pth [2023-12-26 09:32:38,988][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001245456_318840832.pth [2023-12-26 09:32:39,663][123091] Updated weights for policy 0, policy_version 1246516 (0.0005) [2023-12-26 09:32:39,726][123091] Updated weights for policy 0, policy_version 1246526 (0.0006) [2023-12-26 09:32:39,772][123090] Updated weights for policy 1, policy_version 1237800 (0.0009) [2023-12-26 09:32:39,792][123091] Updated weights for policy 0, policy_version 1246536 (0.0005) [2023-12-26 09:32:39,836][123090] Updated weights for policy 1, policy_version 1237810 (0.0008) [2023-12-26 09:32:39,906][123090] Updated weights for policy 1, policy_version 1237820 (0.0006) [2023-12-26 09:32:40,456][123091] Updated weights for policy 0, policy_version 1246546 (0.0007) [2023-12-26 09:32:40,506][123091] Updated weights for policy 0, policy_version 1246556 (0.0005) [2023-12-26 09:32:40,555][123091] Updated weights for policy 0, policy_version 1246566 (0.0005) [2023-12-26 09:32:40,602][123091] Updated weights for policy 0, policy_version 1246576 (0.0005) [2023-12-26 09:32:40,745][123090] Updated weights for policy 1, policy_version 1237830 (0.0009) [2023-12-26 09:32:40,809][123090] Updated weights for policy 1, policy_version 1237840 (0.0010) [2023-12-26 09:32:40,864][123090] Updated weights for policy 1, policy_version 1237850 (0.0010) [2023-12-26 09:32:41,358][123091] Updated weights for policy 0, policy_version 1246586 (0.0010) [2023-12-26 09:32:41,425][123091] Updated weights for policy 0, policy_version 1246597 (0.0009) [2023-12-26 09:32:41,478][123091] Updated weights for policy 0, policy_version 1246607 (0.0006) [2023-12-26 09:32:41,841][123090] Updated weights for policy 1, policy_version 1237860 (0.0009) [2023-12-26 09:32:41,903][123090] Updated weights for policy 1, policy_version 1237870 (0.0005) [2023-12-26 09:32:41,958][123090] Updated weights for policy 1, policy_version 1237880 (0.0006) [2023-12-26 09:32:42,272][123091] Updated weights for policy 0, policy_version 1246617 (0.0007) [2023-12-26 09:32:42,331][123091] Updated weights for policy 0, policy_version 1246627 (0.0010) [2023-12-26 09:32:42,398][123091] Updated weights for policy 0, policy_version 1246637 (0.0009) [2023-12-26 09:32:42,723][123090] Updated weights for policy 1, policy_version 1237890 (0.0007) [2023-12-26 09:32:42,791][123090] Updated weights for policy 1, policy_version 1237900 (0.0009) [2023-12-26 09:32:42,858][123090] Updated weights for policy 1, policy_version 1237910 (0.0009) [2023-12-26 09:32:42,922][123090] Updated weights for policy 1, policy_version 1237920 (0.0009) [2023-12-26 09:32:43,159][123091] Updated weights for policy 0, policy_version 1246647 (0.0006) [2023-12-26 09:32:43,223][123091] Updated weights for policy 0, policy_version 1246657 (0.0006) [2023-12-26 09:32:43,278][123091] Updated weights for policy 0, policy_version 1246667 (0.0005) [2023-12-26 09:32:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 636059648. Throughput: 0: 8896.0, 1: 8529.4. Samples: 636057028. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:43,785][121949] Avg episode reward: [(0, '6258.143'), (1, '5713.565')] [2023-12-26 09:32:43,834][123090] Updated weights for policy 1, policy_version 1237930 (0.0005) [2023-12-26 09:32:43,883][123090] Updated weights for policy 1, policy_version 1237940 (0.0006) [2023-12-26 09:32:43,915][123091] Updated weights for policy 0, policy_version 1246677 (0.0005) [2023-12-26 09:32:43,933][123090] Updated weights for policy 1, policy_version 1237950 (0.0009) [2023-12-26 09:32:43,975][123091] Updated weights for policy 0, policy_version 1246687 (0.0006) [2023-12-26 09:32:44,048][123091] Updated weights for policy 0, policy_version 1246697 (0.0005) [2023-12-26 09:32:44,708][123091] Updated weights for policy 0, policy_version 1246707 (0.0007) [2023-12-26 09:32:44,763][123091] Updated weights for policy 0, policy_version 1246717 (0.0006) [2023-12-26 09:32:44,806][123090] Updated weights for policy 1, policy_version 1237960 (0.0008) [2023-12-26 09:32:44,837][123091] Updated weights for policy 0, policy_version 1246727 (0.0010) [2023-12-26 09:32:44,871][123090] Updated weights for policy 1, policy_version 1237970 (0.0007) [2023-12-26 09:32:44,937][123090] Updated weights for policy 1, policy_version 1237980 (0.0008) [2023-12-26 09:32:45,659][123091] Updated weights for policy 0, policy_version 1246737 (0.0010) [2023-12-26 09:32:45,715][123091] Updated weights for policy 0, policy_version 1246747 (0.0011) [2023-12-26 09:32:45,764][123090] Updated weights for policy 1, policy_version 1237990 (0.0007) [2023-12-26 09:32:45,778][123091] Updated weights for policy 0, policy_version 1246757 (0.0010) [2023-12-26 09:32:45,827][123090] Updated weights for policy 1, policy_version 1238000 (0.0006) [2023-12-26 09:32:45,837][123091] Updated weights for policy 0, policy_version 1246767 (0.0010) [2023-12-26 09:32:45,886][123090] Updated weights for policy 1, policy_version 1238010 (0.0008) [2023-12-26 09:32:46,610][123090] Updated weights for policy 1, policy_version 1238020 (0.0007) [2023-12-26 09:32:46,665][123091] Updated weights for policy 0, policy_version 1246777 (0.0011) [2023-12-26 09:32:46,680][123090] Updated weights for policy 1, policy_version 1238030 (0.0005) [2023-12-26 09:32:46,735][123090] Updated weights for policy 1, policy_version 1238040 (0.0008) [2023-12-26 09:32:46,735][123091] Updated weights for policy 0, policy_version 1246787 (0.0010) [2023-12-26 09:32:46,801][123091] Updated weights for policy 0, policy_version 1246797 (0.0010) [2023-12-26 09:32:47,454][123090] Updated weights for policy 1, policy_version 1238050 (0.0009) [2023-12-26 09:32:47,512][123090] Updated weights for policy 1, policy_version 1238060 (0.0005) [2023-12-26 09:32:47,557][123090] Updated weights for policy 1, policy_version 1238070 (0.0005) [2023-12-26 09:32:47,615][123090] Updated weights for policy 1, policy_version 1238080 (0.0005) [2023-12-26 09:32:47,619][123091] Updated weights for policy 0, policy_version 1246807 (0.0010) [2023-12-26 09:32:47,681][123091] Updated weights for policy 0, policy_version 1246817 (0.0010) [2023-12-26 09:32:47,739][123091] Updated weights for policy 0, policy_version 1246827 (0.0006) [2023-12-26 09:32:48,293][123090] Updated weights for policy 1, policy_version 1238090 (0.0009) [2023-12-26 09:32:48,355][123091] Updated weights for policy 0, policy_version 1246837 (0.0007) [2023-12-26 09:32:48,357][123090] Updated weights for policy 1, policy_version 1238101 (0.0009) [2023-12-26 09:32:48,417][123091] Updated weights for policy 0, policy_version 1246847 (0.0006) [2023-12-26 09:32:48,417][123090] Updated weights for policy 1, policy_version 1238111 (0.0009) [2023-12-26 09:32:48,491][123091] Updated weights for policy 0, policy_version 1246857 (0.0009) [2023-12-26 09:32:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 636157952. Throughput: 0: 8975.7, 1: 8534.1. Samples: 636166180. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:48,785][121949] Avg episode reward: [(0, '6221.814'), (1, '5654.193')] [2023-12-26 09:32:49,190][123091] Updated weights for policy 0, policy_version 1246867 (0.0010) [2023-12-26 09:32:49,255][123091] Updated weights for policy 0, policy_version 1246877 (0.0008) [2023-12-26 09:32:49,268][123090] Updated weights for policy 1, policy_version 1238121 (0.0009) [2023-12-26 09:32:49,313][123091] Updated weights for policy 0, policy_version 1246887 (0.0009) [2023-12-26 09:32:49,329][123090] Updated weights for policy 1, policy_version 1238131 (0.0008) [2023-12-26 09:32:49,397][123090] Updated weights for policy 1, policy_version 1238141 (0.0009) [2023-12-26 09:32:50,159][123091] Updated weights for policy 0, policy_version 1246897 (0.0008) [2023-12-26 09:32:50,204][123090] Updated weights for policy 1, policy_version 1238151 (0.0010) [2023-12-26 09:32:50,223][123091] Updated weights for policy 0, policy_version 1246907 (0.0006) [2023-12-26 09:32:50,263][123090] Updated weights for policy 1, policy_version 1238161 (0.0010) [2023-12-26 09:32:50,287][123091] Updated weights for policy 0, policy_version 1246917 (0.0007) [2023-12-26 09:32:50,328][123090] Updated weights for policy 1, policy_version 1238171 (0.0010) [2023-12-26 09:32:50,349][123091] Updated weights for policy 0, policy_version 1246927 (0.0006) [2023-12-26 09:32:51,047][123091] Updated weights for policy 0, policy_version 1246937 (0.0007) [2023-12-26 09:32:51,116][123091] Updated weights for policy 0, policy_version 1246947 (0.0007) [2023-12-26 09:32:51,180][123090] Updated weights for policy 1, policy_version 1238181 (0.0008) [2023-12-26 09:32:51,192][123091] Updated weights for policy 0, policy_version 1246957 (0.0011) [2023-12-26 09:32:51,241][123090] Updated weights for policy 1, policy_version 1238191 (0.0006) [2023-12-26 09:32:51,306][123090] Updated weights for policy 1, policy_version 1238201 (0.0007) [2023-12-26 09:32:51,960][123091] Updated weights for policy 0, policy_version 1246967 (0.0010) [2023-12-26 09:32:52,010][123091] Updated weights for policy 0, policy_version 1246977 (0.0009) [2023-12-26 09:32:52,067][123091] Updated weights for policy 0, policy_version 1246987 (0.0010) [2023-12-26 09:32:52,092][123090] Updated weights for policy 1, policy_version 1238211 (0.0006) [2023-12-26 09:32:52,160][123090] Updated weights for policy 1, policy_version 1238221 (0.0009) [2023-12-26 09:32:52,227][123090] Updated weights for policy 1, policy_version 1238231 (0.0009) [2023-12-26 09:32:52,924][123091] Updated weights for policy 0, policy_version 1246997 (0.0008) [2023-12-26 09:32:52,976][123091] Updated weights for policy 0, policy_version 1247007 (0.0010) [2023-12-26 09:32:53,021][123091] Updated weights for policy 0, policy_version 1247017 (0.0007) [2023-12-26 09:32:53,065][123090] Updated weights for policy 1, policy_version 1238241 (0.0009) [2023-12-26 09:32:53,132][123090] Updated weights for policy 1, policy_version 1238251 (0.0008) [2023-12-26 09:32:53,194][123090] Updated weights for policy 1, policy_version 1238261 (0.0009) [2023-12-26 09:32:53,255][123090] Updated weights for policy 1, policy_version 1238271 (0.0009) [2023-12-26 09:32:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 636239872. Throughput: 0: 9021.9, 1: 8508.7. Samples: 636219732. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:53,785][121949] Avg episode reward: [(0, '6211.931'), (1, '5759.502')] [2023-12-26 09:32:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001238272_316997632.pth... [2023-12-26 09:32:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001247024_319242240.pth... [2023-12-26 09:32:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001237280_316743680.pth [2023-12-26 09:32:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001245968_318971904.pth [2023-12-26 09:32:53,843][123091] Updated weights for policy 0, policy_version 1247027 (0.0007) [2023-12-26 09:32:53,907][123091] Updated weights for policy 0, policy_version 1247037 (0.0009) [2023-12-26 09:32:53,958][123091] Updated weights for policy 0, policy_version 1247047 (0.0009) [2023-12-26 09:32:54,056][123090] Updated weights for policy 1, policy_version 1238281 (0.0006) [2023-12-26 09:32:54,115][123090] Updated weights for policy 1, policy_version 1238291 (0.0005) [2023-12-26 09:32:54,176][123090] Updated weights for policy 1, policy_version 1238301 (0.0005) [2023-12-26 09:32:54,834][123091] Updated weights for policy 0, policy_version 1247057 (0.0009) [2023-12-26 09:32:54,873][123090] Updated weights for policy 1, policy_version 1238311 (0.0007) [2023-12-26 09:32:54,896][123091] Updated weights for policy 0, policy_version 1247067 (0.0009) [2023-12-26 09:32:54,937][123090] Updated weights for policy 1, policy_version 1238321 (0.0009) [2023-12-26 09:32:54,953][123091] Updated weights for policy 0, policy_version 1247077 (0.0007) [2023-12-26 09:32:54,991][123090] Updated weights for policy 1, policy_version 1238331 (0.0008) [2023-12-26 09:32:55,017][123091] Updated weights for policy 0, policy_version 1247087 (0.0008) [2023-12-26 09:32:55,803][123090] Updated weights for policy 1, policy_version 1238341 (0.0009) [2023-12-26 09:32:55,826][123091] Updated weights for policy 0, policy_version 1247097 (0.0009) [2023-12-26 09:32:55,852][123090] Updated weights for policy 1, policy_version 1238351 (0.0009) [2023-12-26 09:32:55,887][123091] Updated weights for policy 0, policy_version 1247107 (0.0008) [2023-12-26 09:32:55,908][123090] Updated weights for policy 1, policy_version 1238361 (0.0009) [2023-12-26 09:32:55,947][123091] Updated weights for policy 0, policy_version 1247117 (0.0008) [2023-12-26 09:32:56,689][123090] Updated weights for policy 1, policy_version 1238371 (0.0009) [2023-12-26 09:32:56,758][123090] Updated weights for policy 1, policy_version 1238381 (0.0009) [2023-12-26 09:32:56,787][123091] Updated weights for policy 0, policy_version 1247127 (0.0009) [2023-12-26 09:32:56,824][123090] Updated weights for policy 1, policy_version 1238391 (0.0009) [2023-12-26 09:32:56,836][123091] Updated weights for policy 0, policy_version 1247137 (0.0008) [2023-12-26 09:32:56,886][123091] Updated weights for policy 0, policy_version 1247148 (0.0007) [2023-12-26 09:32:57,546][123090] Updated weights for policy 1, policy_version 1238401 (0.0010) [2023-12-26 09:32:57,606][123090] Updated weights for policy 1, policy_version 1238411 (0.0008) [2023-12-26 09:32:57,660][123090] Updated weights for policy 1, policy_version 1238421 (0.0009) [2023-12-26 09:32:57,719][123090] Updated weights for policy 1, policy_version 1238431 (0.0009) [2023-12-26 09:32:57,779][123091] Updated weights for policy 0, policy_version 1247158 (0.0009) [2023-12-26 09:32:57,834][123091] Updated weights for policy 0, policy_version 1247168 (0.0009) [2023-12-26 09:32:57,886][123091] Updated weights for policy 0, policy_version 1247178 (0.0010) [2023-12-26 09:32:58,563][123090] Updated weights for policy 1, policy_version 1238441 (0.0010) [2023-12-26 09:32:58,621][123090] Updated weights for policy 1, policy_version 1238451 (0.0009) [2023-12-26 09:32:58,690][123090] Updated weights for policy 1, policy_version 1238461 (0.0009) [2023-12-26 09:32:58,752][123091] Updated weights for policy 0, policy_version 1247188 (0.0009) [2023-12-26 09:32:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 636329984. Throughput: 0: 8971.7, 1: 8592.4. Samples: 636325076. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:32:58,785][121949] Avg episode reward: [(0, '6373.384'), (1, '5810.263')] [2023-12-26 09:32:58,827][123091] Updated weights for policy 0, policy_version 1247198 (0.0010) [2023-12-26 09:32:58,889][123091] Updated weights for policy 0, policy_version 1247208 (0.0008) [2023-12-26 09:32:59,534][123090] Updated weights for policy 1, policy_version 1238471 (0.0009) [2023-12-26 09:32:59,585][123090] Updated weights for policy 1, policy_version 1238481 (0.0008) [2023-12-26 09:32:59,641][123090] Updated weights for policy 1, policy_version 1238491 (0.0006) [2023-12-26 09:32:59,678][123091] Updated weights for policy 0, policy_version 1247218 (0.0007) [2023-12-26 09:32:59,742][123091] Updated weights for policy 0, policy_version 1247228 (0.0009) [2023-12-26 09:32:59,815][123091] Updated weights for policy 0, policy_version 1247238 (0.0008) [2023-12-26 09:32:59,879][123091] Updated weights for policy 0, policy_version 1247248 (0.0007) [2023-12-26 09:33:00,378][123090] Updated weights for policy 1, policy_version 1238501 (0.0008) [2023-12-26 09:33:00,429][123090] Updated weights for policy 1, policy_version 1238511 (0.0005) [2023-12-26 09:33:00,478][123090] Updated weights for policy 1, policy_version 1238521 (0.0005) [2023-12-26 09:33:00,537][123091] Updated weights for policy 0, policy_version 1247258 (0.0005) [2023-12-26 09:33:00,587][123091] Updated weights for policy 0, policy_version 1247268 (0.0005) [2023-12-26 09:33:00,648][123091] Updated weights for policy 0, policy_version 1247278 (0.0006) [2023-12-26 09:33:01,218][123090] Updated weights for policy 1, policy_version 1238531 (0.0006) [2023-12-26 09:33:01,278][123090] Updated weights for policy 1, policy_version 1238541 (0.0009) [2023-12-26 09:33:01,346][123091] Updated weights for policy 0, policy_version 1247288 (0.0010) [2023-12-26 09:33:01,349][123090] Updated weights for policy 1, policy_version 1238551 (0.0007) [2023-12-26 09:33:01,418][123091] Updated weights for policy 0, policy_version 1247298 (0.0007) [2023-12-26 09:33:01,481][123091] Updated weights for policy 0, policy_version 1247308 (0.0010) [2023-12-26 09:33:02,217][123090] Updated weights for policy 1, policy_version 1238561 (0.0009) [2023-12-26 09:33:02,249][123091] Updated weights for policy 0, policy_version 1247318 (0.0008) [2023-12-26 09:33:02,276][123090] Updated weights for policy 1, policy_version 1238571 (0.0009) [2023-12-26 09:33:02,314][123091] Updated weights for policy 0, policy_version 1247328 (0.0010) [2023-12-26 09:33:02,335][123090] Updated weights for policy 1, policy_version 1238581 (0.0009) [2023-12-26 09:33:02,381][123091] Updated weights for policy 0, policy_version 1247338 (0.0010) [2023-12-26 09:33:02,407][123090] Updated weights for policy 1, policy_version 1238591 (0.0008) [2023-12-26 09:33:03,081][123091] Updated weights for policy 0, policy_version 1247348 (0.0009) [2023-12-26 09:33:03,129][123090] Updated weights for policy 1, policy_version 1238601 (0.0008) [2023-12-26 09:33:03,137][123091] Updated weights for policy 0, policy_version 1247358 (0.0005) [2023-12-26 09:33:03,179][123090] Updated weights for policy 1, policy_version 1238611 (0.0008) [2023-12-26 09:33:03,186][123091] Updated weights for policy 0, policy_version 1247368 (0.0005) [2023-12-26 09:33:03,242][123090] Updated weights for policy 1, policy_version 1238621 (0.0008) [2023-12-26 09:33:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 636420096. Throughput: 0: 9039.9, 1: 8616.8. Samples: 636432760. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:33:03,785][121949] Avg episode reward: [(0, '6335.293'), (1, '5815.075')] [2023-12-26 09:33:03,930][123091] Updated weights for policy 0, policy_version 1247378 (0.0006) [2023-12-26 09:33:03,989][123091] Updated weights for policy 0, policy_version 1247388 (0.0010) [2023-12-26 09:33:04,041][123091] Updated weights for policy 0, policy_version 1247398 (0.0010) [2023-12-26 09:33:04,091][123090] Updated weights for policy 1, policy_version 1238631 (0.0008) [2023-12-26 09:33:04,108][123091] Updated weights for policy 0, policy_version 1247408 (0.0011) [2023-12-26 09:33:04,160][123090] Updated weights for policy 1, policy_version 1238641 (0.0009) [2023-12-26 09:33:04,221][123090] Updated weights for policy 1, policy_version 1238651 (0.0009) [2023-12-26 09:33:04,930][123091] Updated weights for policy 0, policy_version 1247418 (0.0010) [2023-12-26 09:33:04,980][123091] Updated weights for policy 0, policy_version 1247428 (0.0010) [2023-12-26 09:33:05,042][123091] Updated weights for policy 0, policy_version 1247438 (0.0010) [2023-12-26 09:33:05,062][123090] Updated weights for policy 1, policy_version 1238661 (0.0008) [2023-12-26 09:33:05,125][123090] Updated weights for policy 1, policy_version 1238671 (0.0009) [2023-12-26 09:33:05,193][123090] Updated weights for policy 1, policy_version 1238681 (0.0009) [2023-12-26 09:33:05,880][123091] Updated weights for policy 0, policy_version 1247448 (0.0010) [2023-12-26 09:33:05,941][123091] Updated weights for policy 0, policy_version 1247458 (0.0010) [2023-12-26 09:33:06,003][123091] Updated weights for policy 0, policy_version 1247468 (0.0010) [2023-12-26 09:33:06,026][123090] Updated weights for policy 1, policy_version 1238691 (0.0009) [2023-12-26 09:33:06,078][123090] Updated weights for policy 1, policy_version 1238701 (0.0009) [2023-12-26 09:33:06,141][123090] Updated weights for policy 1, policy_version 1238711 (0.0009) [2023-12-26 09:33:06,814][123091] Updated weights for policy 0, policy_version 1247478 (0.0010) [2023-12-26 09:33:06,873][123091] Updated weights for policy 0, policy_version 1247488 (0.0011) [2023-12-26 09:33:06,935][123091] Updated weights for policy 0, policy_version 1247498 (0.0011) [2023-12-26 09:33:07,012][123090] Updated weights for policy 1, policy_version 1238721 (0.0009) [2023-12-26 09:33:07,081][123090] Updated weights for policy 1, policy_version 1238731 (0.0009) [2023-12-26 09:33:07,146][123090] Updated weights for policy 1, policy_version 1238741 (0.0009) [2023-12-26 09:33:07,212][123090] Updated weights for policy 1, policy_version 1238751 (0.0009) [2023-12-26 09:33:07,773][123091] Updated weights for policy 0, policy_version 1247508 (0.0011) [2023-12-26 09:33:07,841][123091] Updated weights for policy 0, policy_version 1247518 (0.0011) [2023-12-26 09:33:07,912][123091] Updated weights for policy 0, policy_version 1247528 (0.0011) [2023-12-26 09:33:08,072][123090] Updated weights for policy 1, policy_version 1238761 (0.0009) [2023-12-26 09:33:08,143][123090] Updated weights for policy 1, policy_version 1238771 (0.0009) [2023-12-26 09:33:08,219][123090] Updated weights for policy 1, policy_version 1238781 (0.0008) [2023-12-26 09:33:08,741][123091] Updated weights for policy 0, policy_version 1247538 (0.0011) [2023-12-26 09:33:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 636502016. Throughput: 0: 9051.7, 1: 8611.5. Samples: 636484008. Policy #0 lag: (min: 28.0, avg: 33.5, max: 60.0) [2023-12-26 09:33:08,785][121949] Avg episode reward: [(0, '6314.811'), (1, '5864.730')] [2023-12-26 09:33:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001238784_317128704.pth... [2023-12-26 09:33:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001237792_316874752.pth [2023-12-26 09:33:08,805][123091] Updated weights for policy 0, policy_version 1247548 (0.0011) [2023-12-26 09:33:08,865][123091] Updated weights for policy 0, policy_version 1247558 (0.0011) [2023-12-26 09:33:08,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001247568_319381504.pth... [2023-12-26 09:33:08,921][123091] Updated weights for policy 0, policy_version 1247568 (0.0011) [2023-12-26 09:33:08,923][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001246512_319111168.pth [2023-12-26 09:33:09,000][123090] Updated weights for policy 1, policy_version 1238791 (0.0008) [2023-12-26 09:33:09,060][123090] Updated weights for policy 1, policy_version 1238801 (0.0011) [2023-12-26 09:33:09,124][123090] Updated weights for policy 1, policy_version 1238811 (0.0010) [2023-12-26 09:33:09,697][123091] Updated weights for policy 0, policy_version 1247578 (0.0006) [2023-12-26 09:33:09,767][123091] Updated weights for policy 0, policy_version 1247588 (0.0006) [2023-12-26 09:33:09,826][123091] Updated weights for policy 0, policy_version 1247598 (0.0007) [2023-12-26 09:33:09,947][123090] Updated weights for policy 1, policy_version 1238821 (0.0010) [2023-12-26 09:33:10,016][123090] Updated weights for policy 1, policy_version 1238831 (0.0010) [2023-12-26 09:33:10,093][123090] Updated weights for policy 1, policy_version 1238841 (0.0010) [2023-12-26 09:33:10,530][123091] Updated weights for policy 0, policy_version 1247608 (0.0010) [2023-12-26 09:33:10,581][123091] Updated weights for policy 0, policy_version 1247618 (0.0010) [2023-12-26 09:33:10,636][123091] Updated weights for policy 0, policy_version 1247628 (0.0011) [2023-12-26 09:33:10,868][123090] Updated weights for policy 1, policy_version 1238851 (0.0008) [2023-12-26 09:33:10,917][123090] Updated weights for policy 1, policy_version 1238861 (0.0009) [2023-12-26 09:33:10,971][123090] Updated weights for policy 1, policy_version 1238871 (0.0005) [2023-12-26 09:33:11,464][123091] Updated weights for policy 0, policy_version 1247638 (0.0011) [2023-12-26 09:33:11,524][123091] Updated weights for policy 0, policy_version 1247648 (0.0011) [2023-12-26 09:33:11,584][123091] Updated weights for policy 0, policy_version 1247658 (0.0011) [2023-12-26 09:33:11,802][123090] Updated weights for policy 1, policy_version 1238881 (0.0008) [2023-12-26 09:33:11,863][123090] Updated weights for policy 1, policy_version 1238891 (0.0010) [2023-12-26 09:33:11,922][123090] Updated weights for policy 1, policy_version 1238901 (0.0009) [2023-12-26 09:33:11,981][123090] Updated weights for policy 1, policy_version 1238911 (0.0009) [2023-12-26 09:33:12,338][123091] Updated weights for policy 0, policy_version 1247668 (0.0011) [2023-12-26 09:33:12,409][123091] Updated weights for policy 0, policy_version 1247678 (0.0010) [2023-12-26 09:33:12,478][123091] Updated weights for policy 0, policy_version 1247688 (0.0010) [2023-12-26 09:33:12,852][123090] Updated weights for policy 1, policy_version 1238921 (0.0010) [2023-12-26 09:33:12,916][123090] Updated weights for policy 1, policy_version 1238931 (0.0010) [2023-12-26 09:33:12,981][123090] Updated weights for policy 1, policy_version 1238941 (0.0010) [2023-12-26 09:33:13,315][123091] Updated weights for policy 0, policy_version 1247698 (0.0009) [2023-12-26 09:33:13,371][123091] Updated weights for policy 0, policy_version 1247708 (0.0009) [2023-12-26 09:33:13,438][123091] Updated weights for policy 0, policy_version 1247718 (0.0010) [2023-12-26 09:33:13,491][123091] Updated weights for policy 0, policy_version 1247728 (0.0010) [2023-12-26 09:33:13,729][123090] Updated weights for policy 1, policy_version 1238951 (0.0007) [2023-12-26 09:33:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 636592128. Throughput: 0: 9069.3, 1: 8608.9. Samples: 636587448. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:13,784][121949] Avg episode reward: [(0, '6364.556'), (1, '5821.969')] [2023-12-26 09:33:13,792][123090] Updated weights for policy 1, policy_version 1238961 (0.0006) [2023-12-26 09:33:13,862][123090] Updated weights for policy 1, policy_version 1238971 (0.0009) [2023-12-26 09:33:14,385][123091] Updated weights for policy 0, policy_version 1247738 (0.0009) [2023-12-26 09:33:14,448][123091] Updated weights for policy 0, policy_version 1247748 (0.0010) [2023-12-26 09:33:14,502][123091] Updated weights for policy 0, policy_version 1247758 (0.0010) [2023-12-26 09:33:14,565][123090] Updated weights for policy 1, policy_version 1238981 (0.0007) [2023-12-26 09:33:14,627][123090] Updated weights for policy 1, policy_version 1238991 (0.0005) [2023-12-26 09:33:14,705][123090] Updated weights for policy 1, policy_version 1239001 (0.0005) [2023-12-26 09:33:15,414][123090] Updated weights for policy 1, policy_version 1239011 (0.0006) [2023-12-26 09:33:15,430][123091] Updated weights for policy 0, policy_version 1247768 (0.0010) [2023-12-26 09:33:15,479][123090] Updated weights for policy 1, policy_version 1239021 (0.0008) [2023-12-26 09:33:15,494][123091] Updated weights for policy 0, policy_version 1247778 (0.0008) [2023-12-26 09:33:15,544][123090] Updated weights for policy 1, policy_version 1239031 (0.0009) [2023-12-26 09:33:15,550][123091] Updated weights for policy 0, policy_version 1247788 (0.0006) [2023-12-26 09:33:16,345][123090] Updated weights for policy 1, policy_version 1239041 (0.0009) [2023-12-26 09:33:16,395][123090] Updated weights for policy 1, policy_version 1239051 (0.0007) [2023-12-26 09:33:16,399][123091] Updated weights for policy 0, policy_version 1247798 (0.0009) [2023-12-26 09:33:16,450][123090] Updated weights for policy 1, policy_version 1239061 (0.0005) [2023-12-26 09:33:16,460][123091] Updated weights for policy 0, policy_version 1247808 (0.0009) [2023-12-26 09:33:16,502][123090] Updated weights for policy 1, policy_version 1239071 (0.0005) [2023-12-26 09:33:16,513][123091] Updated weights for policy 0, policy_version 1247818 (0.0010) [2023-12-26 09:33:17,191][123090] Updated weights for policy 1, policy_version 1239081 (0.0005) [2023-12-26 09:33:17,261][123090] Updated weights for policy 1, policy_version 1239091 (0.0005) [2023-12-26 09:33:17,336][123091] Updated weights for policy 0, policy_version 1247829 (0.0007) [2023-12-26 09:33:17,338][123090] Updated weights for policy 1, policy_version 1239101 (0.0006) [2023-12-26 09:33:17,391][123091] Updated weights for policy 0, policy_version 1247839 (0.0005) [2023-12-26 09:33:17,454][123091] Updated weights for policy 0, policy_version 1247849 (0.0005) [2023-12-26 09:33:17,980][123090] Updated weights for policy 1, policy_version 1239111 (0.0008) [2023-12-26 09:33:18,034][123090] Updated weights for policy 1, policy_version 1239121 (0.0009) [2023-12-26 09:33:18,095][123090] Updated weights for policy 1, policy_version 1239131 (0.0009) [2023-12-26 09:33:18,192][123091] Updated weights for policy 0, policy_version 1247859 (0.0007) [2023-12-26 09:33:18,247][123091] Updated weights for policy 0, policy_version 1247869 (0.0008) [2023-12-26 09:33:18,304][123091] Updated weights for policy 0, policy_version 1247879 (0.0009) [2023-12-26 09:33:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 636682240. Throughput: 0: 8955.1, 1: 8714.6. Samples: 636694744. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:18,784][121949] Avg episode reward: [(0, '6282.663'), (1, '5851.224')] [2023-12-26 09:33:18,894][123090] Updated weights for policy 1, policy_version 1239141 (0.0009) [2023-12-26 09:33:18,957][123090] Updated weights for policy 1, policy_version 1239151 (0.0009) [2023-12-26 09:33:19,018][123090] Updated weights for policy 1, policy_version 1239161 (0.0010) [2023-12-26 09:33:19,156][123091] Updated weights for policy 0, policy_version 1247889 (0.0009) [2023-12-26 09:33:19,209][123091] Updated weights for policy 0, policy_version 1247899 (0.0009) [2023-12-26 09:33:19,274][123091] Updated weights for policy 0, policy_version 1247909 (0.0010) [2023-12-26 09:33:19,339][123091] Updated weights for policy 0, policy_version 1247919 (0.0010) [2023-12-26 09:33:19,820][123090] Updated weights for policy 1, policy_version 1239171 (0.0009) [2023-12-26 09:33:19,890][123090] Updated weights for policy 1, policy_version 1239181 (0.0010) [2023-12-26 09:33:19,961][123090] Updated weights for policy 1, policy_version 1239191 (0.0006) [2023-12-26 09:33:20,213][123091] Updated weights for policy 0, policy_version 1247929 (0.0009) [2023-12-26 09:33:20,271][123091] Updated weights for policy 0, policy_version 1247939 (0.0009) [2023-12-26 09:33:20,330][123091] Updated weights for policy 0, policy_version 1247949 (0.0010) [2023-12-26 09:33:20,768][123090] Updated weights for policy 1, policy_version 1239201 (0.0006) [2023-12-26 09:33:20,838][123090] Updated weights for policy 1, policy_version 1239211 (0.0009) [2023-12-26 09:33:20,896][123090] Updated weights for policy 1, policy_version 1239221 (0.0009) [2023-12-26 09:33:20,959][123090] Updated weights for policy 1, policy_version 1239231 (0.0009) [2023-12-26 09:33:21,192][123091] Updated weights for policy 0, policy_version 1247959 (0.0008) [2023-12-26 09:33:21,266][123091] Updated weights for policy 0, policy_version 1247969 (0.0007) [2023-12-26 09:33:21,325][123091] Updated weights for policy 0, policy_version 1247979 (0.0010) [2023-12-26 09:33:21,776][123090] Updated weights for policy 1, policy_version 1239241 (0.0009) [2023-12-26 09:33:21,840][123090] Updated weights for policy 1, policy_version 1239251 (0.0009) [2023-12-26 09:33:21,896][123090] Updated weights for policy 1, policy_version 1239261 (0.0009) [2023-12-26 09:33:22,188][123091] Updated weights for policy 0, policy_version 1247989 (0.0010) [2023-12-26 09:33:22,248][123091] Updated weights for policy 0, policy_version 1247999 (0.0010) [2023-12-26 09:33:22,303][123091] Updated weights for policy 0, policy_version 1248009 (0.0009) [2023-12-26 09:33:22,757][123090] Updated weights for policy 1, policy_version 1239271 (0.0008) [2023-12-26 09:33:22,826][123090] Updated weights for policy 1, policy_version 1239281 (0.0009) [2023-12-26 09:33:22,883][123090] Updated weights for policy 1, policy_version 1239291 (0.0009) [2023-12-26 09:33:23,173][123091] Updated weights for policy 0, policy_version 1248019 (0.0009) [2023-12-26 09:33:23,239][123091] Updated weights for policy 0, policy_version 1248029 (0.0009) [2023-12-26 09:33:23,296][123091] Updated weights for policy 0, policy_version 1248039 (0.0009) [2023-12-26 09:33:23,659][123090] Updated weights for policy 1, policy_version 1239301 (0.0007) [2023-12-26 09:33:23,728][123090] Updated weights for policy 1, policy_version 1239311 (0.0005) [2023-12-26 09:33:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 636764160. Throughput: 0: 8890.4, 1: 8742.6. Samples: 636744984. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:23,785][121949] Avg episode reward: [(0, '6262.712'), (1, '5765.282')] [2023-12-26 09:33:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001248048_319504384.pth... [2023-12-26 09:33:23,797][123090] Updated weights for policy 1, policy_version 1239321 (0.0007) [2023-12-26 09:33:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001247024_319242240.pth [2023-12-26 09:33:23,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001239328_317267968.pth... [2023-12-26 09:33:23,840][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001238272_316997632.pth [2023-12-26 09:33:24,163][123091] Updated weights for policy 0, policy_version 1248049 (0.0010) [2023-12-26 09:33:24,230][123091] Updated weights for policy 0, policy_version 1248059 (0.0010) [2023-12-26 09:33:24,289][123091] Updated weights for policy 0, policy_version 1248069 (0.0009) [2023-12-26 09:33:24,346][123091] Updated weights for policy 0, policy_version 1248079 (0.0009) [2023-12-26 09:33:24,578][123090] Updated weights for policy 1, policy_version 1239331 (0.0009) [2023-12-26 09:33:24,628][123090] Updated weights for policy 1, policy_version 1239341 (0.0009) [2023-12-26 09:33:24,677][123090] Updated weights for policy 1, policy_version 1239352 (0.0009) [2023-12-26 09:33:25,200][123091] Updated weights for policy 0, policy_version 1248089 (0.0009) [2023-12-26 09:33:25,259][123091] Updated weights for policy 0, policy_version 1248099 (0.0010) [2023-12-26 09:33:25,316][123091] Updated weights for policy 0, policy_version 1248109 (0.0008) [2023-12-26 09:33:25,442][123090] Updated weights for policy 1, policy_version 1239363 (0.0009) [2023-12-26 09:33:25,499][123090] Updated weights for policy 1, policy_version 1239373 (0.0005) [2023-12-26 09:33:25,560][123090] Updated weights for policy 1, policy_version 1239383 (0.0005) [2023-12-26 09:33:26,048][123091] Updated weights for policy 0, policy_version 1248119 (0.0009) [2023-12-26 09:33:26,092][123091] Updated weights for policy 0, policy_version 1248129 (0.0010) [2023-12-26 09:33:26,152][123091] Updated weights for policy 0, policy_version 1248139 (0.0010) [2023-12-26 09:33:26,229][123090] Updated weights for policy 1, policy_version 1239393 (0.0007) [2023-12-26 09:33:26,284][123090] Updated weights for policy 1, policy_version 1239403 (0.0005) [2023-12-26 09:33:26,337][123090] Updated weights for policy 1, policy_version 1239413 (0.0005) [2023-12-26 09:33:26,393][123090] Updated weights for policy 1, policy_version 1239423 (0.0005) [2023-12-26 09:33:26,937][123091] Updated weights for policy 0, policy_version 1248149 (0.0008) [2023-12-26 09:33:26,956][123090] Updated weights for policy 1, policy_version 1239433 (0.0010) [2023-12-26 09:33:26,998][123091] Updated weights for policy 0, policy_version 1248159 (0.0008) [2023-12-26 09:33:27,015][123090] Updated weights for policy 1, policy_version 1239443 (0.0010) [2023-12-26 09:33:27,057][123091] Updated weights for policy 0, policy_version 1248169 (0.0007) [2023-12-26 09:33:27,078][123090] Updated weights for policy 1, policy_version 1239453 (0.0010) [2023-12-26 09:33:27,874][123091] Updated weights for policy 0, policy_version 1248179 (0.0008) [2023-12-26 09:33:27,899][123090] Updated weights for policy 1, policy_version 1239463 (0.0010) [2023-12-26 09:33:27,927][123091] Updated weights for policy 0, policy_version 1248189 (0.0007) [2023-12-26 09:33:27,960][123090] Updated weights for policy 1, policy_version 1239473 (0.0010) [2023-12-26 09:33:27,989][123091] Updated weights for policy 0, policy_version 1248199 (0.0007) [2023-12-26 09:33:28,023][123090] Updated weights for policy 1, policy_version 1239483 (0.0010) [2023-12-26 09:33:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 636854272. Throughput: 0: 8797.2, 1: 8879.6. Samples: 636852484. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:28,785][121949] Avg episode reward: [(0, '6355.239'), (1, '5751.073')] [2023-12-26 09:33:28,813][123091] Updated weights for policy 0, policy_version 1248209 (0.0008) [2023-12-26 09:33:28,843][123090] Updated weights for policy 1, policy_version 1239493 (0.0010) [2023-12-26 09:33:28,868][123091] Updated weights for policy 0, policy_version 1248219 (0.0007) [2023-12-26 09:33:28,903][123090] Updated weights for policy 1, policy_version 1239503 (0.0010) [2023-12-26 09:33:28,923][123091] Updated weights for policy 0, policy_version 1248229 (0.0008) [2023-12-26 09:33:28,962][123090] Updated weights for policy 1, policy_version 1239513 (0.0010) [2023-12-26 09:33:28,985][123091] Updated weights for policy 0, policy_version 1248239 (0.0006) [2023-12-26 09:33:29,782][123090] Updated weights for policy 1, policy_version 1239523 (0.0010) [2023-12-26 09:33:29,820][123091] Updated weights for policy 0, policy_version 1248249 (0.0007) [2023-12-26 09:33:29,846][123090] Updated weights for policy 1, policy_version 1239533 (0.0010) [2023-12-26 09:33:29,886][123091] Updated weights for policy 0, policy_version 1248259 (0.0008) [2023-12-26 09:33:29,909][123090] Updated weights for policy 1, policy_version 1239543 (0.0010) [2023-12-26 09:33:29,942][123091] Updated weights for policy 0, policy_version 1248269 (0.0006) [2023-12-26 09:33:30,748][123090] Updated weights for policy 1, policy_version 1239553 (0.0010) [2023-12-26 09:33:30,799][123090] Updated weights for policy 1, policy_version 1239563 (0.0010) [2023-12-26 09:33:30,805][123091] Updated weights for policy 0, policy_version 1248279 (0.0007) [2023-12-26 09:33:30,849][123090] Updated weights for policy 1, policy_version 1239573 (0.0010) [2023-12-26 09:33:30,864][123091] Updated weights for policy 0, policy_version 1248289 (0.0006) [2023-12-26 09:33:30,911][123090] Updated weights for policy 1, policy_version 1239583 (0.0010) [2023-12-26 09:33:30,923][123091] Updated weights for policy 0, policy_version 1248299 (0.0009) [2023-12-26 09:33:31,773][123090] Updated weights for policy 1, policy_version 1239593 (0.0011) [2023-12-26 09:33:31,801][123091] Updated weights for policy 0, policy_version 1248309 (0.0007) [2023-12-26 09:33:31,828][123090] Updated weights for policy 1, policy_version 1239603 (0.0010) [2023-12-26 09:33:31,857][123091] Updated weights for policy 0, policy_version 1248319 (0.0006) [2023-12-26 09:33:31,876][123090] Updated weights for policy 1, policy_version 1239613 (0.0010) [2023-12-26 09:33:31,914][123091] Updated weights for policy 0, policy_version 1248329 (0.0006) [2023-12-26 09:33:32,711][123090] Updated weights for policy 1, policy_version 1239623 (0.0009) [2023-12-26 09:33:32,765][123090] Updated weights for policy 1, policy_version 1239633 (0.0009) [2023-12-26 09:33:32,784][123091] Updated weights for policy 0, policy_version 1248339 (0.0008) [2023-12-26 09:33:32,824][123090] Updated weights for policy 1, policy_version 1239643 (0.0009) [2023-12-26 09:33:32,835][123091] Updated weights for policy 0, policy_version 1248349 (0.0007) [2023-12-26 09:33:32,895][123091] Updated weights for policy 0, policy_version 1248359 (0.0008) [2023-12-26 09:33:33,650][123090] Updated weights for policy 1, policy_version 1239653 (0.0009) [2023-12-26 09:33:33,701][123090] Updated weights for policy 1, policy_version 1239664 (0.0010) [2023-12-26 09:33:33,736][123091] Updated weights for policy 0, policy_version 1248369 (0.0009) [2023-12-26 09:33:33,749][123090] Updated weights for policy 1, policy_version 1239674 (0.0008) [2023-12-26 09:33:33,784][123091] Updated weights for policy 0, policy_version 1248380 (0.0009) [2023-12-26 09:33:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 636944384. Throughput: 0: 8673.6, 1: 8845.4. Samples: 636954536. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:33,786][121949] Avg episode reward: [(0, '6344.615'), (1, '5802.189')] [2023-12-26 09:33:33,848][123091] Updated weights for policy 0, policy_version 1248391 (0.0010) [2023-12-26 09:33:34,531][123091] Updated weights for policy 0, policy_version 1248401 (0.0009) [2023-12-26 09:33:34,592][123091] Updated weights for policy 0, policy_version 1248411 (0.0007) [2023-12-26 09:33:34,619][123090] Updated weights for policy 1, policy_version 1239684 (0.0006) [2023-12-26 09:33:34,639][123091] Updated weights for policy 0, policy_version 1248421 (0.0009) [2023-12-26 09:33:34,681][123090] Updated weights for policy 1, policy_version 1239694 (0.0008) [2023-12-26 09:33:34,687][123091] Updated weights for policy 0, policy_version 1248431 (0.0009) [2023-12-26 09:33:34,742][123090] Updated weights for policy 1, policy_version 1239704 (0.0009) [2023-12-26 09:33:35,524][123091] Updated weights for policy 0, policy_version 1248441 (0.0010) [2023-12-26 09:33:35,572][123090] Updated weights for policy 1, policy_version 1239714 (0.0010) [2023-12-26 09:33:35,576][123091] Updated weights for policy 0, policy_version 1248451 (0.0010) [2023-12-26 09:33:35,622][123090] Updated weights for policy 1, policy_version 1239724 (0.0008) [2023-12-26 09:33:35,632][123091] Updated weights for policy 0, policy_version 1248461 (0.0011) [2023-12-26 09:33:35,673][123090] Updated weights for policy 1, policy_version 1239734 (0.0008) [2023-12-26 09:33:35,721][123090] Updated weights for policy 1, policy_version 1239744 (0.0008) [2023-12-26 09:33:36,408][123091] Updated weights for policy 0, policy_version 1248471 (0.0011) [2023-12-26 09:33:36,468][123091] Updated weights for policy 0, policy_version 1248481 (0.0011) [2023-12-26 09:33:36,536][123091] Updated weights for policy 0, policy_version 1248491 (0.0011) [2023-12-26 09:33:36,613][123090] Updated weights for policy 1, policy_version 1239754 (0.0007) [2023-12-26 09:33:36,683][123090] Updated weights for policy 1, policy_version 1239764 (0.0009) [2023-12-26 09:33:36,744][123090] Updated weights for policy 1, policy_version 1239774 (0.0009) [2023-12-26 09:33:37,339][123091] Updated weights for policy 0, policy_version 1248501 (0.0011) [2023-12-26 09:33:37,386][123091] Updated weights for policy 0, policy_version 1248511 (0.0010) [2023-12-26 09:33:37,450][123091] Updated weights for policy 0, policy_version 1248521 (0.0011) [2023-12-26 09:33:37,576][123090] Updated weights for policy 1, policy_version 1239784 (0.0008) [2023-12-26 09:33:37,641][123090] Updated weights for policy 1, policy_version 1239794 (0.0009) [2023-12-26 09:33:37,703][123090] Updated weights for policy 1, policy_version 1239804 (0.0009) [2023-12-26 09:33:38,323][123091] Updated weights for policy 0, policy_version 1248531 (0.0009) [2023-12-26 09:33:38,391][123091] Updated weights for policy 0, policy_version 1248541 (0.0008) [2023-12-26 09:33:38,446][123091] Updated weights for policy 0, policy_version 1248551 (0.0008) [2023-12-26 09:33:38,493][123090] Updated weights for policy 1, policy_version 1239814 (0.0009) [2023-12-26 09:33:38,557][123090] Updated weights for policy 1, policy_version 1239824 (0.0009) [2023-12-26 09:33:38,619][123090] Updated weights for policy 1, policy_version 1239834 (0.0010) [2023-12-26 09:33:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 637034496. Throughput: 0: 8656.3, 1: 8841.2. Samples: 637007124. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:38,785][121949] Avg episode reward: [(0, '6305.225'), (1, '5855.823')] [2023-12-26 09:33:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001248560_319635456.pth... [2023-12-26 09:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001239840_317399040.pth... [2023-12-26 09:33:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001247568_319381504.pth [2023-12-26 09:33:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001238784_317128704.pth [2023-12-26 09:33:39,250][123091] Updated weights for policy 0, policy_version 1248561 (0.0008) [2023-12-26 09:33:39,316][123091] Updated weights for policy 0, policy_version 1248571 (0.0012) [2023-12-26 09:33:39,393][123091] Updated weights for policy 0, policy_version 1248581 (0.0009) [2023-12-26 09:33:39,472][123091] Updated weights for policy 0, policy_version 1248591 (0.0009) [2023-12-26 09:33:39,548][123090] Updated weights for policy 1, policy_version 1239844 (0.0009) [2023-12-26 09:33:39,604][123090] Updated weights for policy 1, policy_version 1239854 (0.0008) [2023-12-26 09:33:39,666][123090] Updated weights for policy 1, policy_version 1239864 (0.0010) [2023-12-26 09:33:40,313][123091] Updated weights for policy 0, policy_version 1248601 (0.0011) [2023-12-26 09:33:40,380][123091] Updated weights for policy 0, policy_version 1248611 (0.0011) [2023-12-26 09:33:40,443][123091] Updated weights for policy 0, policy_version 1248621 (0.0011) [2023-12-26 09:33:40,492][123090] Updated weights for policy 1, policy_version 1239874 (0.0009) [2023-12-26 09:33:40,560][123090] Updated weights for policy 1, policy_version 1239884 (0.0009) [2023-12-26 09:33:40,612][123090] Updated weights for policy 1, policy_version 1239894 (0.0009) [2023-12-26 09:33:40,676][123090] Updated weights for policy 1, policy_version 1239904 (0.0009) [2023-12-26 09:33:41,218][123091] Updated weights for policy 0, policy_version 1248631 (0.0011) [2023-12-26 09:33:41,285][123091] Updated weights for policy 0, policy_version 1248641 (0.0011) [2023-12-26 09:33:41,359][123091] Updated weights for policy 0, policy_version 1248651 (0.0011) [2023-12-26 09:33:41,608][123090] Updated weights for policy 1, policy_version 1239914 (0.0009) [2023-12-26 09:33:41,680][123090] Updated weights for policy 1, policy_version 1239924 (0.0009) [2023-12-26 09:33:41,752][123090] Updated weights for policy 1, policy_version 1239934 (0.0009) [2023-12-26 09:33:42,240][123091] Updated weights for policy 0, policy_version 1248661 (0.0011) [2023-12-26 09:33:42,314][123091] Updated weights for policy 0, policy_version 1248671 (0.0009) [2023-12-26 09:33:42,382][123091] Updated weights for policy 0, policy_version 1248681 (0.0009) [2023-12-26 09:33:42,602][123090] Updated weights for policy 1, policy_version 1239944 (0.0010) [2023-12-26 09:33:42,659][123090] Updated weights for policy 1, policy_version 1239954 (0.0009) [2023-12-26 09:33:42,722][123090] Updated weights for policy 1, policy_version 1239964 (0.0010) [2023-12-26 09:33:43,222][123091] Updated weights for policy 0, policy_version 1248691 (0.0009) [2023-12-26 09:33:43,275][123091] Updated weights for policy 0, policy_version 1248701 (0.0009) [2023-12-26 09:33:43,328][123091] Updated weights for policy 0, policy_version 1248711 (0.0010) [2023-12-26 09:33:43,568][123090] Updated weights for policy 1, policy_version 1239974 (0.0007) [2023-12-26 09:33:43,620][123090] Updated weights for policy 1, policy_version 1239984 (0.0005) [2023-12-26 09:33:43,663][123090] Updated weights for policy 1, policy_version 1239994 (0.0005) [2023-12-26 09:33:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 637116416. Throughput: 0: 8651.4, 1: 8722.7. Samples: 637106912. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:43,785][121949] Avg episode reward: [(0, '6294.750'), (1, '5807.420')] [2023-12-26 09:33:44,044][123091] Updated weights for policy 0, policy_version 1248721 (0.0009) [2023-12-26 09:33:44,105][123091] Updated weights for policy 0, policy_version 1248731 (0.0008) [2023-12-26 09:33:44,169][123091] Updated weights for policy 0, policy_version 1248741 (0.0006) [2023-12-26 09:33:44,217][123091] Updated weights for policy 0, policy_version 1248752 (0.0009) [2023-12-26 09:33:44,442][123090] Updated weights for policy 1, policy_version 1240004 (0.0006) [2023-12-26 09:33:44,505][123090] Updated weights for policy 1, policy_version 1240014 (0.0005) [2023-12-26 09:33:44,563][123090] Updated weights for policy 1, policy_version 1240024 (0.0005) [2023-12-26 09:33:44,943][123091] Updated weights for policy 0, policy_version 1248762 (0.0006) [2023-12-26 09:33:45,014][123091] Updated weights for policy 0, policy_version 1248772 (0.0006) [2023-12-26 09:33:45,085][123091] Updated weights for policy 0, policy_version 1248782 (0.0005) [2023-12-26 09:33:45,394][123090] Updated weights for policy 1, policy_version 1240034 (0.0006) [2023-12-26 09:33:45,455][123090] Updated weights for policy 1, policy_version 1240044 (0.0011) [2023-12-26 09:33:45,519][123090] Updated weights for policy 1, policy_version 1240054 (0.0011) [2023-12-26 09:33:45,579][123090] Updated weights for policy 1, policy_version 1240064 (0.0010) [2023-12-26 09:33:45,799][123091] Updated weights for policy 0, policy_version 1248792 (0.0010) [2023-12-26 09:33:45,857][123091] Updated weights for policy 0, policy_version 1248802 (0.0010) [2023-12-26 09:33:45,916][123091] Updated weights for policy 0, policy_version 1248812 (0.0008) [2023-12-26 09:33:46,393][123090] Updated weights for policy 1, policy_version 1240074 (0.0010) [2023-12-26 09:33:46,441][123090] Updated weights for policy 1, policy_version 1240084 (0.0010) [2023-12-26 09:33:46,498][123090] Updated weights for policy 1, policy_version 1240094 (0.0010) [2023-12-26 09:33:46,621][123091] Updated weights for policy 0, policy_version 1248822 (0.0005) [2023-12-26 09:33:46,686][123091] Updated weights for policy 0, policy_version 1248832 (0.0006) [2023-12-26 09:33:46,746][123091] Updated weights for policy 0, policy_version 1248842 (0.0006) [2023-12-26 09:33:47,255][123090] Updated weights for policy 1, policy_version 1240104 (0.0010) [2023-12-26 09:33:47,320][123090] Updated weights for policy 1, policy_version 1240114 (0.0010) [2023-12-26 09:33:47,381][123090] Updated weights for policy 1, policy_version 1240124 (0.0007) [2023-12-26 09:33:47,472][123091] Updated weights for policy 0, policy_version 1248852 (0.0007) [2023-12-26 09:33:47,539][123091] Updated weights for policy 0, policy_version 1248862 (0.0011) [2023-12-26 09:33:47,598][123091] Updated weights for policy 0, policy_version 1248872 (0.0010) [2023-12-26 09:33:48,026][123090] Updated weights for policy 1, policy_version 1240134 (0.0006) [2023-12-26 09:33:48,082][123090] Updated weights for policy 1, policy_version 1240144 (0.0005) [2023-12-26 09:33:48,145][123090] Updated weights for policy 1, policy_version 1240154 (0.0005) [2023-12-26 09:33:48,265][123091] Updated weights for policy 0, policy_version 1248882 (0.0010) [2023-12-26 09:33:48,317][123091] Updated weights for policy 0, policy_version 1248892 (0.0005) [2023-12-26 09:33:48,384][123091] Updated weights for policy 0, policy_version 1248902 (0.0008) [2023-12-26 09:33:48,445][123091] Updated weights for policy 0, policy_version 1248912 (0.0009) [2023-12-26 09:33:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 637206528. Throughput: 0: 8692.7, 1: 8778.6. Samples: 637218968. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:48,785][121949] Avg episode reward: [(0, '6290.330'), (1, '5769.984')] [2023-12-26 09:33:48,892][123090] Updated weights for policy 1, policy_version 1240164 (0.0007) [2023-12-26 09:33:48,952][123090] Updated weights for policy 1, policy_version 1240174 (0.0009) [2023-12-26 09:33:49,016][123090] Updated weights for policy 1, policy_version 1240184 (0.0010) [2023-12-26 09:33:49,262][123091] Updated weights for policy 0, policy_version 1248922 (0.0009) [2023-12-26 09:33:49,323][123091] Updated weights for policy 0, policy_version 1248932 (0.0006) [2023-12-26 09:33:49,391][123091] Updated weights for policy 0, policy_version 1248942 (0.0008) [2023-12-26 09:33:49,810][123090] Updated weights for policy 1, policy_version 1240194 (0.0010) [2023-12-26 09:33:49,880][123090] Updated weights for policy 1, policy_version 1240204 (0.0008) [2023-12-26 09:33:49,944][123090] Updated weights for policy 1, policy_version 1240214 (0.0009) [2023-12-26 09:33:50,019][123090] Updated weights for policy 1, policy_version 1240224 (0.0009) [2023-12-26 09:33:50,244][123091] Updated weights for policy 0, policy_version 1248952 (0.0011) [2023-12-26 09:33:50,308][123091] Updated weights for policy 0, policy_version 1248962 (0.0010) [2023-12-26 09:33:50,382][123091] Updated weights for policy 0, policy_version 1248972 (0.0011) [2023-12-26 09:33:50,855][123090] Updated weights for policy 1, policy_version 1240234 (0.0009) [2023-12-26 09:33:50,928][123090] Updated weights for policy 1, policy_version 1240244 (0.0009) [2023-12-26 09:33:50,988][123090] Updated weights for policy 1, policy_version 1240254 (0.0009) [2023-12-26 09:33:51,206][123091] Updated weights for policy 0, policy_version 1248982 (0.0011) [2023-12-26 09:33:51,269][123091] Updated weights for policy 0, policy_version 1248992 (0.0010) [2023-12-26 09:33:51,325][123091] Updated weights for policy 0, policy_version 1249002 (0.0010) [2023-12-26 09:33:51,855][123090] Updated weights for policy 1, policy_version 1240264 (0.0009) [2023-12-26 09:33:51,914][123090] Updated weights for policy 1, policy_version 1240274 (0.0008) [2023-12-26 09:33:51,973][123090] Updated weights for policy 1, policy_version 1240284 (0.0009) [2023-12-26 09:33:52,228][123091] Updated weights for policy 0, policy_version 1249012 (0.0010) [2023-12-26 09:33:52,287][123091] Updated weights for policy 0, policy_version 1249022 (0.0010) [2023-12-26 09:33:52,342][123091] Updated weights for policy 0, policy_version 1249032 (0.0010) [2023-12-26 09:33:52,791][123090] Updated weights for policy 1, policy_version 1240294 (0.0009) [2023-12-26 09:33:52,859][123090] Updated weights for policy 1, policy_version 1240304 (0.0010) [2023-12-26 09:33:52,930][123090] Updated weights for policy 1, policy_version 1240314 (0.0010) [2023-12-26 09:33:53,138][123091] Updated weights for policy 0, policy_version 1249042 (0.0009) [2023-12-26 09:33:53,202][123091] Updated weights for policy 0, policy_version 1249052 (0.0008) [2023-12-26 09:33:53,268][123091] Updated weights for policy 0, policy_version 1249062 (0.0009) [2023-12-26 09:33:53,326][123091] Updated weights for policy 0, policy_version 1249072 (0.0009) [2023-12-26 09:33:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 637288448. Throughput: 0: 8670.6, 1: 8784.0. Samples: 637269464. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:53,785][121949] Avg episode reward: [(0, '6311.654'), (1, '5778.054')] [2023-12-26 09:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001249072_319766528.pth... [2023-12-26 09:33:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001240320_317521920.pth... [2023-12-26 09:33:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001248048_319504384.pth [2023-12-26 09:33:53,795][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001249072_319766528.pth [2023-12-26 09:33:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001239328_317267968.pth [2023-12-26 09:33:53,801][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001240320_317521920.pth [2023-12-26 09:33:53,846][123090] Updated weights for policy 1, policy_version 1240324 (0.0009) [2023-12-26 09:33:53,904][123090] Updated weights for policy 1, policy_version 1240335 (0.0010) [2023-12-26 09:33:53,958][123090] Updated weights for policy 1, policy_version 1240345 (0.0009) [2023-12-26 09:33:54,047][123091] Updated weights for policy 0, policy_version 1249082 (0.0009) [2023-12-26 09:33:54,111][123091] Updated weights for policy 0, policy_version 1249092 (0.0010) [2023-12-26 09:33:54,171][123091] Updated weights for policy 0, policy_version 1249102 (0.0009) [2023-12-26 09:33:54,830][123090] Updated weights for policy 1, policy_version 1240355 (0.0009) [2023-12-26 09:33:54,897][123090] Updated weights for policy 1, policy_version 1240365 (0.0009) [2023-12-26 09:33:54,915][123091] Updated weights for policy 0, policy_version 1249112 (0.0007) [2023-12-26 09:33:54,965][123090] Updated weights for policy 1, policy_version 1240375 (0.0009) [2023-12-26 09:33:54,971][123091] Updated weights for policy 0, policy_version 1249122 (0.0007) [2023-12-26 09:33:55,026][123091] Updated weights for policy 0, policy_version 1249132 (0.0009) [2023-12-26 09:33:55,761][123091] Updated weights for policy 0, policy_version 1249142 (0.0008) [2023-12-26 09:33:55,829][123091] Updated weights for policy 0, policy_version 1249152 (0.0005) [2023-12-26 09:33:55,848][123090] Updated weights for policy 1, policy_version 1240385 (0.0008) [2023-12-26 09:33:55,892][123091] Updated weights for policy 0, policy_version 1249162 (0.0006) [2023-12-26 09:33:55,902][123090] Updated weights for policy 1, policy_version 1240395 (0.0009) [2023-12-26 09:33:55,965][123090] Updated weights for policy 1, policy_version 1240405 (0.0010) [2023-12-26 09:33:56,020][123090] Updated weights for policy 1, policy_version 1240415 (0.0010) [2023-12-26 09:33:56,597][123091] Updated weights for policy 0, policy_version 1249172 (0.0007) [2023-12-26 09:33:56,655][123091] Updated weights for policy 0, policy_version 1249183 (0.0009) [2023-12-26 09:33:56,715][123091] Updated weights for policy 0, policy_version 1249193 (0.0008) [2023-12-26 09:33:56,917][123090] Updated weights for policy 1, policy_version 1240425 (0.0009) [2023-12-26 09:33:56,981][123090] Updated weights for policy 1, policy_version 1240435 (0.0009) [2023-12-26 09:33:57,048][123090] Updated weights for policy 1, policy_version 1240445 (0.0009) [2023-12-26 09:33:57,451][123091] Updated weights for policy 0, policy_version 1249203 (0.0005) [2023-12-26 09:33:57,522][123091] Updated weights for policy 0, policy_version 1249213 (0.0005) [2023-12-26 09:33:57,581][123091] Updated weights for policy 0, policy_version 1249223 (0.0005) [2023-12-26 09:33:57,925][123090] Updated weights for policy 1, policy_version 1240455 (0.0009) [2023-12-26 09:33:57,991][123090] Updated weights for policy 1, policy_version 1240465 (0.0010) [2023-12-26 09:33:58,060][123090] Updated weights for policy 1, policy_version 1240476 (0.0008) [2023-12-26 09:33:58,133][123091] Updated weights for policy 0, policy_version 1249233 (0.0006) [2023-12-26 09:33:58,195][123091] Updated weights for policy 0, policy_version 1249243 (0.0007) [2023-12-26 09:33:58,258][123091] Updated weights for policy 0, policy_version 1249253 (0.0006) [2023-12-26 09:33:58,331][123091] Updated weights for policy 0, policy_version 1249263 (0.0007) [2023-12-26 09:33:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 637378560. Throughput: 0: 8758.4, 1: 8730.8. Samples: 637374464. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:33:58,785][121949] Avg episode reward: [(0, '6376.625'), (1, '5679.791')] [2023-12-26 09:33:58,949][123090] Updated weights for policy 1, policy_version 1240486 (0.0006) [2023-12-26 09:33:59,018][123090] Updated weights for policy 1, policy_version 1240496 (0.0009) [2023-12-26 09:33:59,087][123090] Updated weights for policy 1, policy_version 1240506 (0.0009) [2023-12-26 09:33:59,213][123091] Updated weights for policy 0, policy_version 1249273 (0.0009) [2023-12-26 09:33:59,274][123091] Updated weights for policy 0, policy_version 1249283 (0.0009) [2023-12-26 09:33:59,333][123091] Updated weights for policy 0, policy_version 1249293 (0.0010) [2023-12-26 09:33:59,869][123090] Updated weights for policy 1, policy_version 1240516 (0.0009) [2023-12-26 09:33:59,924][123090] Updated weights for policy 1, policy_version 1240526 (0.0005) [2023-12-26 09:33:59,991][123090] Updated weights for policy 1, policy_version 1240536 (0.0007) [2023-12-26 09:34:00,221][123091] Updated weights for policy 0, policy_version 1249303 (0.0010) [2023-12-26 09:34:00,274][123091] Updated weights for policy 0, policy_version 1249313 (0.0010) [2023-12-26 09:34:00,327][123091] Updated weights for policy 0, policy_version 1249323 (0.0009) [2023-12-26 09:34:00,589][123090] Updated weights for policy 1, policy_version 1240546 (0.0008) [2023-12-26 09:34:00,643][123090] Updated weights for policy 1, policy_version 1240556 (0.0010) [2023-12-26 09:34:00,696][123090] Updated weights for policy 1, policy_version 1240566 (0.0010) [2023-12-26 09:34:00,748][123090] Updated weights for policy 1, policy_version 1240576 (0.0009) [2023-12-26 09:34:01,068][123091] Updated weights for policy 0, policy_version 1249333 (0.0009) [2023-12-26 09:34:01,123][123091] Updated weights for policy 0, policy_version 1249343 (0.0010) [2023-12-26 09:34:01,187][123091] Updated weights for policy 0, policy_version 1249353 (0.0011) [2023-12-26 09:34:01,654][123090] Updated weights for policy 1, policy_version 1240586 (0.0009) [2023-12-26 09:34:01,718][123090] Updated weights for policy 1, policy_version 1240596 (0.0009) [2023-12-26 09:34:01,787][123090] Updated weights for policy 1, policy_version 1240606 (0.0009) [2023-12-26 09:34:02,008][123091] Updated weights for policy 0, policy_version 1249363 (0.0010) [2023-12-26 09:34:02,075][123091] Updated weights for policy 0, policy_version 1249373 (0.0010) [2023-12-26 09:34:02,130][123091] Updated weights for policy 0, policy_version 1249383 (0.0009) [2023-12-26 09:34:02,576][123090] Updated weights for policy 1, policy_version 1240616 (0.0009) [2023-12-26 09:34:02,630][123090] Updated weights for policy 1, policy_version 1240626 (0.0009) [2023-12-26 09:34:02,676][123090] Updated weights for policy 1, policy_version 1240636 (0.0009) [2023-12-26 09:34:02,966][123091] Updated weights for policy 0, policy_version 1249393 (0.0009) [2023-12-26 09:34:03,027][123091] Updated weights for policy 0, policy_version 1249403 (0.0010) [2023-12-26 09:34:03,087][123091] Updated weights for policy 0, policy_version 1249413 (0.0009) [2023-12-26 09:34:03,155][123091] Updated weights for policy 0, policy_version 1249423 (0.0009) [2023-12-26 09:34:03,543][123090] Updated weights for policy 1, policy_version 1240646 (0.0010) [2023-12-26 09:34:03,603][123090] Updated weights for policy 1, policy_version 1240656 (0.0010) [2023-12-26 09:34:03,667][123090] Updated weights for policy 1, policy_version 1240666 (0.0007) [2023-12-26 09:34:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 637468672. Throughput: 0: 8786.5, 1: 8609.3. Samples: 637477556. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:03,784][121949] Avg episode reward: [(0, '6325.279'), (1, '5646.101')] [2023-12-26 09:34:03,986][123091] Updated weights for policy 0, policy_version 1249433 (0.0010) [2023-12-26 09:34:04,054][123091] Updated weights for policy 0, policy_version 1249443 (0.0006) [2023-12-26 09:34:04,130][123091] Updated weights for policy 0, policy_version 1249453 (0.0008) [2023-12-26 09:34:04,385][123090] Updated weights for policy 1, policy_version 1240676 (0.0005) [2023-12-26 09:34:04,453][123090] Updated weights for policy 1, policy_version 1240686 (0.0009) [2023-12-26 09:34:04,505][123090] Updated weights for policy 1, policy_version 1240696 (0.0009) [2023-12-26 09:34:04,836][123091] Updated weights for policy 0, policy_version 1249463 (0.0009) [2023-12-26 09:34:04,892][123091] Updated weights for policy 0, policy_version 1249473 (0.0010) [2023-12-26 09:34:04,948][123091] Updated weights for policy 0, policy_version 1249483 (0.0009) [2023-12-26 09:34:05,234][123090] Updated weights for policy 1, policy_version 1240706 (0.0006) [2023-12-26 09:34:05,285][123090] Updated weights for policy 1, policy_version 1240716 (0.0005) [2023-12-26 09:34:05,332][123090] Updated weights for policy 1, policy_version 1240726 (0.0005) [2023-12-26 09:34:05,404][123090] Updated weights for policy 1, policy_version 1240736 (0.0005) [2023-12-26 09:34:05,869][123091] Updated weights for policy 0, policy_version 1249493 (0.0010) [2023-12-26 09:34:05,927][123091] Updated weights for policy 0, policy_version 1249503 (0.0010) [2023-12-26 09:34:05,987][123091] Updated weights for policy 0, policy_version 1249513 (0.0009) [2023-12-26 09:34:06,070][123090] Updated weights for policy 1, policy_version 1240746 (0.0009) [2023-12-26 09:34:06,137][123090] Updated weights for policy 1, policy_version 1240756 (0.0010) [2023-12-26 09:34:06,199][123090] Updated weights for policy 1, policy_version 1240766 (0.0010) [2023-12-26 09:34:06,906][123091] Updated weights for policy 0, policy_version 1249523 (0.0009) [2023-12-26 09:34:06,970][123091] Updated weights for policy 0, policy_version 1249533 (0.0010) [2023-12-26 09:34:07,036][123090] Updated weights for policy 1, policy_version 1240776 (0.0007) [2023-12-26 09:34:07,040][123091] Updated weights for policy 0, policy_version 1249543 (0.0010) [2023-12-26 09:34:07,096][123090] Updated weights for policy 1, policy_version 1240786 (0.0008) [2023-12-26 09:34:07,153][123090] Updated weights for policy 1, policy_version 1240796 (0.0009) [2023-12-26 09:34:07,855][123091] Updated weights for policy 0, policy_version 1249553 (0.0009) [2023-12-26 09:34:07,927][123091] Updated weights for policy 0, policy_version 1249563 (0.0008) [2023-12-26 09:34:07,992][123091] Updated weights for policy 0, policy_version 1249573 (0.0009) [2023-12-26 09:34:08,012][123090] Updated weights for policy 1, policy_version 1240806 (0.0008) [2023-12-26 09:34:08,055][123091] Updated weights for policy 0, policy_version 1249583 (0.0007) [2023-12-26 09:34:08,076][123090] Updated weights for policy 1, policy_version 1240816 (0.0008) [2023-12-26 09:34:08,144][123090] Updated weights for policy 1, policy_version 1240826 (0.0010) [2023-12-26 09:34:08,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 637550592. Throughput: 0: 8802.1, 1: 8677.6. Samples: 637531576. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:08,786][121949] Avg episode reward: [(0, '6338.666'), (1, '5735.963')] [2023-12-26 09:34:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001240832_317652992.pth... [2023-12-26 09:34:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001239840_317399040.pth [2023-12-26 09:34:08,858][123091] Updated weights for policy 0, policy_version 1249593 (0.0009) [2023-12-26 09:34:08,922][123091] Updated weights for policy 0, policy_version 1249603 (0.0009) [2023-12-26 09:34:08,983][123091] Updated weights for policy 0, policy_version 1249613 (0.0008) [2023-12-26 09:34:08,989][123090] Updated weights for policy 1, policy_version 1240836 (0.0009) [2023-12-26 09:34:08,996][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001249616_319905792.pth... [2023-12-26 09:34:09,001][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001248560_319635456.pth [2023-12-26 09:34:09,036][123090] Updated weights for policy 1, policy_version 1240846 (0.0009) [2023-12-26 09:34:09,099][123090] Updated weights for policy 1, policy_version 1240856 (0.0010) [2023-12-26 09:34:09,818][123091] Updated weights for policy 0, policy_version 1249623 (0.0008) [2023-12-26 09:34:09,888][123091] Updated weights for policy 0, policy_version 1249633 (0.0008) [2023-12-26 09:34:09,956][123091] Updated weights for policy 0, policy_version 1249643 (0.0009) [2023-12-26 09:34:09,998][123090] Updated weights for policy 1, policy_version 1240866 (0.0009) [2023-12-26 09:34:10,067][123090] Updated weights for policy 1, policy_version 1240876 (0.0006) [2023-12-26 09:34:10,140][123090] Updated weights for policy 1, policy_version 1240886 (0.0006) [2023-12-26 09:34:10,212][123090] Updated weights for policy 1, policy_version 1240896 (0.0006) [2023-12-26 09:34:10,846][123091] Updated weights for policy 0, policy_version 1249653 (0.0009) [2023-12-26 09:34:10,908][123091] Updated weights for policy 0, policy_version 1249663 (0.0008) [2023-12-26 09:34:10,931][123090] Updated weights for policy 1, policy_version 1240906 (0.0011) [2023-12-26 09:34:10,968][123091] Updated weights for policy 0, policy_version 1249673 (0.0006) [2023-12-26 09:34:10,991][123090] Updated weights for policy 1, policy_version 1240916 (0.0011) [2023-12-26 09:34:11,061][123090] Updated weights for policy 1, policy_version 1240926 (0.0009) [2023-12-26 09:34:11,830][123091] Updated weights for policy 0, policy_version 1249683 (0.0008) [2023-12-26 09:34:11,891][123091] Updated weights for policy 0, policy_version 1249693 (0.0009) [2023-12-26 09:34:11,944][123090] Updated weights for policy 1, policy_version 1240936 (0.0009) [2023-12-26 09:34:11,947][123091] Updated weights for policy 0, policy_version 1249703 (0.0007) [2023-12-26 09:34:12,012][123090] Updated weights for policy 1, policy_version 1240946 (0.0008) [2023-12-26 09:34:12,075][123090] Updated weights for policy 1, policy_version 1240956 (0.0010) [2023-12-26 09:34:12,816][123091] Updated weights for policy 0, policy_version 1249713 (0.0008) [2023-12-26 09:34:12,875][123091] Updated weights for policy 0, policy_version 1249723 (0.0010) [2023-12-26 09:34:12,930][123090] Updated weights for policy 1, policy_version 1240966 (0.0009) [2023-12-26 09:34:12,937][123091] Updated weights for policy 0, policy_version 1249733 (0.0007) [2023-12-26 09:34:12,993][123090] Updated weights for policy 1, policy_version 1240976 (0.0008) [2023-12-26 09:34:13,004][123091] Updated weights for policy 0, policy_version 1249743 (0.0008) [2023-12-26 09:34:13,056][123090] Updated weights for policy 1, policy_version 1240986 (0.0009) [2023-12-26 09:34:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 637632512. Throughput: 0: 8758.5, 1: 8555.8. Samples: 637631628. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:13,784][121949] Avg episode reward: [(0, '6260.567'), (1, '5738.988')] [2023-12-26 09:34:13,825][123091] Updated weights for policy 0, policy_version 1249753 (0.0005) [2023-12-26 09:34:13,881][123090] Updated weights for policy 1, policy_version 1240996 (0.0010) [2023-12-26 09:34:13,888][123091] Updated weights for policy 0, policy_version 1249763 (0.0006) [2023-12-26 09:34:13,933][123090] Updated weights for policy 1, policy_version 1241006 (0.0010) [2023-12-26 09:34:13,945][123091] Updated weights for policy 0, policy_version 1249773 (0.0006) [2023-12-26 09:34:13,984][123090] Updated weights for policy 1, policy_version 1241016 (0.0009) [2023-12-26 09:34:14,622][123091] Updated weights for policy 0, policy_version 1249783 (0.0006) [2023-12-26 09:34:14,687][123091] Updated weights for policy 0, policy_version 1249793 (0.0005) [2023-12-26 09:34:14,753][123091] Updated weights for policy 0, policy_version 1249803 (0.0010) [2023-12-26 09:34:14,796][123090] Updated weights for policy 1, policy_version 1241027 (0.0010) [2023-12-26 09:34:14,859][123090] Updated weights for policy 1, policy_version 1241037 (0.0010) [2023-12-26 09:34:14,929][123090] Updated weights for policy 1, policy_version 1241047 (0.0010) [2023-12-26 09:34:15,483][123091] Updated weights for policy 0, policy_version 1249813 (0.0007) [2023-12-26 09:34:15,550][123091] Updated weights for policy 0, policy_version 1249823 (0.0010) [2023-12-26 09:34:15,616][123091] Updated weights for policy 0, policy_version 1249833 (0.0010) [2023-12-26 09:34:15,627][123090] Updated weights for policy 1, policy_version 1241057 (0.0006) [2023-12-26 09:34:15,683][123090] Updated weights for policy 1, policy_version 1241067 (0.0010) [2023-12-26 09:34:15,742][123090] Updated weights for policy 1, policy_version 1241077 (0.0010) [2023-12-26 09:34:15,798][123090] Updated weights for policy 1, policy_version 1241087 (0.0010) [2023-12-26 09:34:16,401][123091] Updated weights for policy 0, policy_version 1249843 (0.0011) [2023-12-26 09:34:16,457][123091] Updated weights for policy 0, policy_version 1249853 (0.0011) [2023-12-26 09:34:16,516][123091] Updated weights for policy 0, policy_version 1249863 (0.0011) [2023-12-26 09:34:16,615][123090] Updated weights for policy 1, policy_version 1241097 (0.0010) [2023-12-26 09:34:16,678][123090] Updated weights for policy 1, policy_version 1241107 (0.0010) [2023-12-26 09:34:16,751][123090] Updated weights for policy 1, policy_version 1241117 (0.0010) [2023-12-26 09:34:17,347][123091] Updated weights for policy 0, policy_version 1249873 (0.0010) [2023-12-26 09:34:17,398][123091] Updated weights for policy 0, policy_version 1249883 (0.0010) [2023-12-26 09:34:17,453][123091] Updated weights for policy 0, policy_version 1249893 (0.0010) [2023-12-26 09:34:17,511][123091] Updated weights for policy 0, policy_version 1249903 (0.0010) [2023-12-26 09:34:17,557][123090] Updated weights for policy 1, policy_version 1241127 (0.0010) [2023-12-26 09:34:17,622][123090] Updated weights for policy 1, policy_version 1241137 (0.0010) [2023-12-26 09:34:17,684][123090] Updated weights for policy 1, policy_version 1241147 (0.0010) [2023-12-26 09:34:18,351][123091] Updated weights for policy 0, policy_version 1249913 (0.0010) [2023-12-26 09:34:18,404][123090] Updated weights for policy 1, policy_version 1241157 (0.0010) [2023-12-26 09:34:18,416][123091] Updated weights for policy 0, policy_version 1249923 (0.0006) [2023-12-26 09:34:18,472][123090] Updated weights for policy 1, policy_version 1241167 (0.0011) [2023-12-26 09:34:18,478][123091] Updated weights for policy 0, policy_version 1249933 (0.0006) [2023-12-26 09:34:18,539][123090] Updated weights for policy 1, policy_version 1241177 (0.0011) [2023-12-26 09:34:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 637730816. Throughput: 0: 8819.1, 1: 8600.9. Samples: 637738432. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:18,785][121949] Avg episode reward: [(0, '6209.230'), (1, '5678.053')] [2023-12-26 09:34:19,260][123091] Updated weights for policy 0, policy_version 1249943 (0.0007) [2023-12-26 09:34:19,311][123090] Updated weights for policy 1, policy_version 1241187 (0.0010) [2023-12-26 09:34:19,322][123091] Updated weights for policy 0, policy_version 1249953 (0.0010) [2023-12-26 09:34:19,382][123090] Updated weights for policy 1, policy_version 1241197 (0.0009) [2023-12-26 09:34:19,389][123091] Updated weights for policy 0, policy_version 1249963 (0.0008) [2023-12-26 09:34:19,442][123090] Updated weights for policy 1, policy_version 1241207 (0.0008) [2023-12-26 09:34:20,086][123091] Updated weights for policy 0, policy_version 1249973 (0.0007) [2023-12-26 09:34:20,152][123091] Updated weights for policy 0, policy_version 1249983 (0.0008) [2023-12-26 09:34:20,208][123091] Updated weights for policy 0, policy_version 1249993 (0.0011) [2023-12-26 09:34:20,347][123090] Updated weights for policy 1, policy_version 1241217 (0.0009) [2023-12-26 09:34:20,419][123090] Updated weights for policy 1, policy_version 1241227 (0.0009) [2023-12-26 09:34:20,487][123090] Updated weights for policy 1, policy_version 1241237 (0.0009) [2023-12-26 09:34:20,556][123090] Updated weights for policy 1, policy_version 1241247 (0.0009) [2023-12-26 09:34:21,062][123091] Updated weights for policy 0, policy_version 1250003 (0.0011) [2023-12-26 09:34:21,128][123091] Updated weights for policy 0, policy_version 1250013 (0.0007) [2023-12-26 09:34:21,194][123091] Updated weights for policy 0, policy_version 1250023 (0.0008) [2023-12-26 09:34:21,420][123090] Updated weights for policy 1, policy_version 1241257 (0.0007) [2023-12-26 09:34:21,495][123090] Updated weights for policy 1, policy_version 1241267 (0.0006) [2023-12-26 09:34:21,573][123090] Updated weights for policy 1, policy_version 1241277 (0.0006) [2023-12-26 09:34:21,998][123091] Updated weights for policy 0, policy_version 1250033 (0.0008) [2023-12-26 09:34:22,059][123091] Updated weights for policy 0, policy_version 1250043 (0.0009) [2023-12-26 09:34:22,128][123091] Updated weights for policy 0, policy_version 1250053 (0.0010) [2023-12-26 09:34:22,194][123091] Updated weights for policy 0, policy_version 1250063 (0.0011) [2023-12-26 09:34:22,319][123090] Updated weights for policy 1, policy_version 1241287 (0.0008) [2023-12-26 09:34:22,387][123090] Updated weights for policy 1, policy_version 1241297 (0.0009) [2023-12-26 09:34:22,444][123090] Updated weights for policy 1, policy_version 1241307 (0.0009) [2023-12-26 09:34:22,993][123091] Updated weights for policy 0, policy_version 1250073 (0.0006) [2023-12-26 09:34:23,051][123091] Updated weights for policy 0, policy_version 1250083 (0.0008) [2023-12-26 09:34:23,104][123091] Updated weights for policy 0, policy_version 1250093 (0.0010) [2023-12-26 09:34:23,295][123090] Updated weights for policy 1, policy_version 1241317 (0.0009) [2023-12-26 09:34:23,365][123090] Updated weights for policy 1, policy_version 1241327 (0.0007) [2023-12-26 09:34:23,429][123090] Updated weights for policy 1, policy_version 1241337 (0.0007) [2023-12-26 09:34:23,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17605.8). Total num frames: 637812736. Throughput: 0: 8812.8, 1: 8598.6. Samples: 637790644. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:23,786][121949] Avg episode reward: [(0, '6307.342'), (1, '5658.701')] [2023-12-26 09:34:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001250096_320028672.pth... [2023-12-26 09:34:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001241344_317784064.pth... [2023-12-26 09:34:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001249072_319766528.pth [2023-12-26 09:34:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001240320_317521920.pth [2023-12-26 09:34:23,910][123091] Updated weights for policy 0, policy_version 1250103 (0.0007) [2023-12-26 09:34:23,965][123091] Updated weights for policy 0, policy_version 1250113 (0.0005) [2023-12-26 09:34:24,019][123091] Updated weights for policy 0, policy_version 1250123 (0.0005) [2023-12-26 09:34:24,245][123090] Updated weights for policy 1, policy_version 1241347 (0.0009) [2023-12-26 09:34:24,287][123090] Updated weights for policy 1, policy_version 1241357 (0.0009) [2023-12-26 09:34:24,343][123090] Updated weights for policy 1, policy_version 1241368 (0.0007) [2023-12-26 09:34:24,682][123091] Updated weights for policy 0, policy_version 1250133 (0.0008) [2023-12-26 09:34:24,726][123091] Updated weights for policy 0, policy_version 1250143 (0.0010) [2023-12-26 09:34:24,777][123091] Updated weights for policy 0, policy_version 1250153 (0.0009) [2023-12-26 09:34:25,091][123090] Updated weights for policy 1, policy_version 1241378 (0.0007) [2023-12-26 09:34:25,143][123090] Updated weights for policy 1, policy_version 1241388 (0.0010) [2023-12-26 09:34:25,194][123090] Updated weights for policy 1, policy_version 1241398 (0.0010) [2023-12-26 09:34:25,257][123090] Updated weights for policy 1, policy_version 1241408 (0.0010) [2023-12-26 09:34:25,510][123091] Updated weights for policy 0, policy_version 1250163 (0.0007) [2023-12-26 09:34:25,573][123091] Updated weights for policy 0, policy_version 1250173 (0.0005) [2023-12-26 09:34:25,628][123091] Updated weights for policy 0, policy_version 1250183 (0.0005) [2023-12-26 09:34:25,963][123090] Updated weights for policy 1, policy_version 1241418 (0.0007) [2023-12-26 09:34:26,027][123090] Updated weights for policy 1, policy_version 1241428 (0.0005) [2023-12-26 09:34:26,086][123090] Updated weights for policy 1, policy_version 1241438 (0.0005) [2023-12-26 09:34:26,346][123091] Updated weights for policy 0, policy_version 1250193 (0.0006) [2023-12-26 09:34:26,397][123091] Updated weights for policy 0, policy_version 1250203 (0.0010) [2023-12-26 09:34:26,455][123091] Updated weights for policy 0, policy_version 1250213 (0.0010) [2023-12-26 09:34:26,514][123091] Updated weights for policy 0, policy_version 1250223 (0.0007) [2023-12-26 09:34:26,745][123090] Updated weights for policy 1, policy_version 1241448 (0.0009) [2023-12-26 09:34:26,796][123090] Updated weights for policy 1, policy_version 1241458 (0.0010) [2023-12-26 09:34:26,865][123090] Updated weights for policy 1, policy_version 1241468 (0.0010) [2023-12-26 09:34:27,249][123091] Updated weights for policy 0, policy_version 1250233 (0.0010) [2023-12-26 09:34:27,321][123091] Updated weights for policy 0, policy_version 1250243 (0.0010) [2023-12-26 09:34:27,376][123091] Updated weights for policy 0, policy_version 1250253 (0.0010) [2023-12-26 09:34:27,621][123090] Updated weights for policy 1, policy_version 1241478 (0.0010) [2023-12-26 09:34:27,667][123090] Updated weights for policy 1, policy_version 1241488 (0.0009) [2023-12-26 09:34:27,713][123090] Updated weights for policy 1, policy_version 1241498 (0.0005) [2023-12-26 09:34:28,164][123091] Updated weights for policy 0, policy_version 1250263 (0.0010) [2023-12-26 09:34:28,222][123091] Updated weights for policy 0, policy_version 1250273 (0.0010) [2023-12-26 09:34:28,276][123091] Updated weights for policy 0, policy_version 1250283 (0.0010) [2023-12-26 09:34:28,415][123090] Updated weights for policy 1, policy_version 1241508 (0.0007) [2023-12-26 09:34:28,485][123090] Updated weights for policy 1, policy_version 1241518 (0.0010) [2023-12-26 09:34:28,555][123090] Updated weights for policy 1, policy_version 1241528 (0.0010) [2023-12-26 09:34:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 637911040. Throughput: 0: 8937.9, 1: 8740.7. Samples: 637902448. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:28,785][121949] Avg episode reward: [(0, '6255.131'), (1, '5838.013')] [2023-12-26 09:34:29,097][123091] Updated weights for policy 0, policy_version 1250293 (0.0008) [2023-12-26 09:34:29,164][123091] Updated weights for policy 0, policy_version 1250303 (0.0005) [2023-12-26 09:34:29,239][123091] Updated weights for policy 0, policy_version 1250313 (0.0007) [2023-12-26 09:34:29,279][123090] Updated weights for policy 1, policy_version 1241538 (0.0009) [2023-12-26 09:34:29,345][123090] Updated weights for policy 1, policy_version 1241548 (0.0006) [2023-12-26 09:34:29,414][123090] Updated weights for policy 1, policy_version 1241558 (0.0009) [2023-12-26 09:34:29,471][123090] Updated weights for policy 1, policy_version 1241568 (0.0009) [2023-12-26 09:34:30,012][123091] Updated weights for policy 0, policy_version 1250323 (0.0008) [2023-12-26 09:34:30,069][123091] Updated weights for policy 0, policy_version 1250333 (0.0006) [2023-12-26 09:34:30,140][123091] Updated weights for policy 0, policy_version 1250343 (0.0006) [2023-12-26 09:34:30,245][123090] Updated weights for policy 1, policy_version 1241578 (0.0009) [2023-12-26 09:34:30,298][123090] Updated weights for policy 1, policy_version 1241588 (0.0005) [2023-12-26 09:34:30,365][123090] Updated weights for policy 1, policy_version 1241598 (0.0006) [2023-12-26 09:34:30,911][123091] Updated weights for policy 0, policy_version 1250353 (0.0010) [2023-12-26 09:34:30,960][123091] Updated weights for policy 0, policy_version 1250363 (0.0009) [2023-12-26 09:34:31,012][123091] Updated weights for policy 0, policy_version 1250373 (0.0009) [2023-12-26 09:34:31,077][123090] Updated weights for policy 1, policy_version 1241608 (0.0010) [2023-12-26 09:34:31,080][123091] Updated weights for policy 0, policy_version 1250383 (0.0008) [2023-12-26 09:34:31,138][123090] Updated weights for policy 1, policy_version 1241618 (0.0010) [2023-12-26 09:34:31,194][123090] Updated weights for policy 1, policy_version 1241628 (0.0010) [2023-12-26 09:34:31,934][123091] Updated weights for policy 0, policy_version 1250393 (0.0009) [2023-12-26 09:34:31,990][123091] Updated weights for policy 0, policy_version 1250403 (0.0009) [2023-12-26 09:34:32,053][123091] Updated weights for policy 0, policy_version 1250413 (0.0009) [2023-12-26 09:34:32,070][123090] Updated weights for policy 1, policy_version 1241638 (0.0010) [2023-12-26 09:34:32,129][123090] Updated weights for policy 1, policy_version 1241648 (0.0010) [2023-12-26 09:34:32,192][123090] Updated weights for policy 1, policy_version 1241658 (0.0010) [2023-12-26 09:34:32,846][123091] Updated weights for policy 0, policy_version 1250423 (0.0007) [2023-12-26 09:34:32,917][123091] Updated weights for policy 0, policy_version 1250433 (0.0005) [2023-12-26 09:34:32,979][123091] Updated weights for policy 0, policy_version 1250443 (0.0005) [2023-12-26 09:34:33,041][123090] Updated weights for policy 1, policy_version 1241668 (0.0010) [2023-12-26 09:34:33,111][123090] Updated weights for policy 1, policy_version 1241678 (0.0010) [2023-12-26 09:34:33,187][123090] Updated weights for policy 1, policy_version 1241688 (0.0009) [2023-12-26 09:34:33,726][123091] Updated weights for policy 0, policy_version 1250453 (0.0008) [2023-12-26 09:34:33,779][123091] Updated weights for policy 0, policy_version 1250463 (0.0010) [2023-12-26 09:34:33,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 637992960. Throughput: 0: 8850.7, 1: 8738.5. Samples: 638010480. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:33,785][121949] Avg episode reward: [(0, '6268.178'), (1, '5893.237')] [2023-12-26 09:34:33,834][123091] Updated weights for policy 0, policy_version 1250474 (0.0009) [2023-12-26 09:34:33,844][123090] Updated weights for policy 1, policy_version 1241698 (0.0005) [2023-12-26 09:34:33,892][123090] Updated weights for policy 1, policy_version 1241708 (0.0005) [2023-12-26 09:34:33,942][123090] Updated weights for policy 1, policy_version 1241718 (0.0005) [2023-12-26 09:34:33,998][123090] Updated weights for policy 1, policy_version 1241728 (0.0005) [2023-12-26 09:34:34,657][123091] Updated weights for policy 0, policy_version 1250485 (0.0010) [2023-12-26 09:34:34,709][123091] Updated weights for policy 0, policy_version 1250495 (0.0009) [2023-12-26 09:34:34,746][123090] Updated weights for policy 1, policy_version 1241738 (0.0009) [2023-12-26 09:34:34,771][123091] Updated weights for policy 0, policy_version 1250505 (0.0009) [2023-12-26 09:34:34,804][123090] Updated weights for policy 1, policy_version 1241748 (0.0006) [2023-12-26 09:34:34,869][123090] Updated weights for policy 1, policy_version 1241758 (0.0008) [2023-12-26 09:34:35,575][123091] Updated weights for policy 0, policy_version 1250515 (0.0010) [2023-12-26 09:34:35,622][123091] Updated weights for policy 0, policy_version 1250525 (0.0009) [2023-12-26 09:34:35,691][123091] Updated weights for policy 0, policy_version 1250535 (0.0009) [2023-12-26 09:34:35,736][123090] Updated weights for policy 1, policy_version 1241768 (0.0008) [2023-12-26 09:34:35,787][123090] Updated weights for policy 1, policy_version 1241778 (0.0009) [2023-12-26 09:34:35,845][123090] Updated weights for policy 1, policy_version 1241789 (0.0010) [2023-12-26 09:34:36,491][123091] Updated weights for policy 0, policy_version 1250545 (0.0010) [2023-12-26 09:34:36,540][123091] Updated weights for policy 0, policy_version 1250555 (0.0009) [2023-12-26 09:34:36,591][123091] Updated weights for policy 0, policy_version 1250565 (0.0009) [2023-12-26 09:34:36,649][123091] Updated weights for policy 0, policy_version 1250576 (0.0010) [2023-12-26 09:34:36,726][123090] Updated weights for policy 1, policy_version 1241800 (0.0010) [2023-12-26 09:34:36,791][123090] Updated weights for policy 1, policy_version 1241810 (0.0009) [2023-12-26 09:34:36,843][123090] Updated weights for policy 1, policy_version 1241820 (0.0009) [2023-12-26 09:34:37,539][123091] Updated weights for policy 0, policy_version 1250586 (0.0010) [2023-12-26 09:34:37,607][123091] Updated weights for policy 0, policy_version 1250596 (0.0009) [2023-12-26 09:34:37,655][123090] Updated weights for policy 1, policy_version 1241830 (0.0008) [2023-12-26 09:34:37,666][123091] Updated weights for policy 0, policy_version 1250606 (0.0009) [2023-12-26 09:34:37,716][123090] Updated weights for policy 1, policy_version 1241840 (0.0008) [2023-12-26 09:34:37,777][123090] Updated weights for policy 1, policy_version 1241850 (0.0011) [2023-12-26 09:34:38,506][123091] Updated weights for policy 0, policy_version 1250616 (0.0009) [2023-12-26 09:34:38,562][123091] Updated weights for policy 0, policy_version 1250626 (0.0009) [2023-12-26 09:34:38,616][123091] Updated weights for policy 0, policy_version 1250636 (0.0008) [2023-12-26 09:34:38,618][123090] Updated weights for policy 1, policy_version 1241860 (0.0011) [2023-12-26 09:34:38,678][123090] Updated weights for policy 1, policy_version 1241870 (0.0010) [2023-12-26 09:34:38,738][123090] Updated weights for policy 1, policy_version 1241880 (0.0011) [2023-12-26 09:34:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 638091264. Throughput: 0: 8862.1, 1: 8769.4. Samples: 638062884. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:38,785][121949] Avg episode reward: [(0, '6337.433'), (1, '5879.005')] [2023-12-26 09:34:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001250640_320167936.pth... [2023-12-26 09:34:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001241888_317923328.pth... [2023-12-26 09:34:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001249616_319905792.pth [2023-12-26 09:34:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001240832_317652992.pth [2023-12-26 09:34:39,479][123091] Updated weights for policy 0, policy_version 1250646 (0.0008) [2023-12-26 09:34:39,538][123091] Updated weights for policy 0, policy_version 1250656 (0.0009) [2023-12-26 09:34:39,546][123090] Updated weights for policy 1, policy_version 1241890 (0.0010) [2023-12-26 09:34:39,605][123091] Updated weights for policy 0, policy_version 1250666 (0.0008) [2023-12-26 09:34:39,610][123090] Updated weights for policy 1, policy_version 1241900 (0.0008) [2023-12-26 09:34:39,670][123090] Updated weights for policy 1, policy_version 1241910 (0.0009) [2023-12-26 09:34:39,734][123090] Updated weights for policy 1, policy_version 1241920 (0.0009) [2023-12-26 09:34:40,453][123091] Updated weights for policy 0, policy_version 1250676 (0.0008) [2023-12-26 09:34:40,523][123091] Updated weights for policy 0, policy_version 1250686 (0.0009) [2023-12-26 09:34:40,587][123091] Updated weights for policy 0, policy_version 1250696 (0.0006) [2023-12-26 09:34:40,588][123090] Updated weights for policy 1, policy_version 1241930 (0.0010) [2023-12-26 09:34:40,658][123090] Updated weights for policy 1, policy_version 1241940 (0.0006) [2023-12-26 09:34:40,722][123090] Updated weights for policy 1, policy_version 1241950 (0.0005) [2023-12-26 09:34:41,493][123091] Updated weights for policy 0, policy_version 1250706 (0.0009) [2023-12-26 09:34:41,530][123090] Updated weights for policy 1, policy_version 1241960 (0.0010) [2023-12-26 09:34:41,550][123091] Updated weights for policy 0, policy_version 1250716 (0.0006) [2023-12-26 09:34:41,602][123091] Updated weights for policy 0, policy_version 1250726 (0.0009) [2023-12-26 09:34:41,603][123090] Updated weights for policy 1, policy_version 1241970 (0.0011) [2023-12-26 09:34:41,672][123090] Updated weights for policy 1, policy_version 1241980 (0.0009) [2023-12-26 09:34:41,674][123091] Updated weights for policy 0, policy_version 1250736 (0.0008) [2023-12-26 09:34:42,455][123091] Updated weights for policy 0, policy_version 1250746 (0.0009) [2023-12-26 09:34:42,506][123091] Updated weights for policy 0, policy_version 1250756 (0.0009) [2023-12-26 09:34:42,561][123090] Updated weights for policy 1, policy_version 1241990 (0.0009) [2023-12-26 09:34:42,562][123091] Updated weights for policy 0, policy_version 1250766 (0.0009) [2023-12-26 09:34:42,620][123090] Updated weights for policy 1, policy_version 1242000 (0.0007) [2023-12-26 09:34:42,686][123090] Updated weights for policy 1, policy_version 1242010 (0.0009) [2023-12-26 09:34:43,295][123091] Updated weights for policy 0, policy_version 1250776 (0.0006) [2023-12-26 09:34:43,346][123091] Updated weights for policy 0, policy_version 1250786 (0.0005) [2023-12-26 09:34:43,394][123091] Updated weights for policy 0, policy_version 1250796 (0.0005) [2023-12-26 09:34:43,481][123090] Updated weights for policy 1, policy_version 1242020 (0.0008) [2023-12-26 09:34:43,541][123090] Updated weights for policy 1, policy_version 1242030 (0.0006) [2023-12-26 09:34:43,595][123090] Updated weights for policy 1, policy_version 1242040 (0.0009) [2023-12-26 09:34:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 638173184. Throughput: 0: 8716.9, 1: 8804.0. Samples: 638162904. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:43,785][121949] Avg episode reward: [(0, '6398.281'), (1, '5749.359')] [2023-12-26 09:34:44,056][123091] Updated weights for policy 0, policy_version 1250806 (0.0006) [2023-12-26 09:34:44,121][123091] Updated weights for policy 0, policy_version 1250816 (0.0009) [2023-12-26 09:34:44,190][123091] Updated weights for policy 0, policy_version 1250826 (0.0009) [2023-12-26 09:34:44,451][123090] Updated weights for policy 1, policy_version 1242050 (0.0010) [2023-12-26 09:34:44,503][123090] Updated weights for policy 1, policy_version 1242061 (0.0009) [2023-12-26 09:34:44,551][123090] Updated weights for policy 1, policy_version 1242071 (0.0009) [2023-12-26 09:34:44,931][123091] Updated weights for policy 0, policy_version 1250836 (0.0008) [2023-12-26 09:34:44,999][123091] Updated weights for policy 0, policy_version 1250846 (0.0010) [2023-12-26 09:34:45,054][123091] Updated weights for policy 0, policy_version 1250856 (0.0009) [2023-12-26 09:34:45,395][123090] Updated weights for policy 1, policy_version 1242081 (0.0009) [2023-12-26 09:34:45,464][123090] Updated weights for policy 1, policy_version 1242091 (0.0008) [2023-12-26 09:34:45,531][123090] Updated weights for policy 1, policy_version 1242101 (0.0005) [2023-12-26 09:34:45,597][123090] Updated weights for policy 1, policy_version 1242111 (0.0005) [2023-12-26 09:34:45,931][123091] Updated weights for policy 0, policy_version 1250866 (0.0008) [2023-12-26 09:34:46,000][123091] Updated weights for policy 0, policy_version 1250876 (0.0006) [2023-12-26 09:34:46,065][123091] Updated weights for policy 0, policy_version 1250886 (0.0008) [2023-12-26 09:34:46,125][123091] Updated weights for policy 0, policy_version 1250896 (0.0006) [2023-12-26 09:34:46,257][123090] Updated weights for policy 1, policy_version 1242121 (0.0005) [2023-12-26 09:34:46,331][123090] Updated weights for policy 1, policy_version 1242131 (0.0007) [2023-12-26 09:34:46,394][123090] Updated weights for policy 1, policy_version 1242141 (0.0010) [2023-12-26 09:34:46,852][123091] Updated weights for policy 0, policy_version 1250906 (0.0005) [2023-12-26 09:34:46,918][123091] Updated weights for policy 0, policy_version 1250916 (0.0005) [2023-12-26 09:34:46,965][123091] Updated weights for policy 0, policy_version 1250926 (0.0005) [2023-12-26 09:34:47,029][123090] Updated weights for policy 1, policy_version 1242151 (0.0007) [2023-12-26 09:34:47,079][123090] Updated weights for policy 1, policy_version 1242161 (0.0006) [2023-12-26 09:34:47,156][123090] Updated weights for policy 1, policy_version 1242171 (0.0006) [2023-12-26 09:34:47,636][123091] Updated weights for policy 0, policy_version 1250936 (0.0005) [2023-12-26 09:34:47,704][123091] Updated weights for policy 0, policy_version 1250946 (0.0005) [2023-12-26 09:34:47,764][123091] Updated weights for policy 0, policy_version 1250956 (0.0005) [2023-12-26 09:34:47,788][123090] Updated weights for policy 1, policy_version 1242181 (0.0007) [2023-12-26 09:34:47,859][123090] Updated weights for policy 1, policy_version 1242191 (0.0010) [2023-12-26 09:34:47,921][123090] Updated weights for policy 1, policy_version 1242201 (0.0010) [2023-12-26 09:34:48,331][123091] Updated weights for policy 0, policy_version 1250966 (0.0006) [2023-12-26 09:34:48,394][123091] Updated weights for policy 0, policy_version 1250976 (0.0008) [2023-12-26 09:34:48,445][123091] Updated weights for policy 0, policy_version 1250986 (0.0008) [2023-12-26 09:34:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 638263296. Throughput: 0: 8854.8, 1: 8884.9. Samples: 638275848. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:48,785][121949] Avg episode reward: [(0, '6330.250'), (1, '5506.979')] [2023-12-26 09:34:48,821][123090] Updated weights for policy 1, policy_version 1242212 (0.0010) [2023-12-26 09:34:48,895][123090] Updated weights for policy 1, policy_version 1242222 (0.0008) [2023-12-26 09:34:48,958][123090] Updated weights for policy 1, policy_version 1242232 (0.0010) [2023-12-26 09:34:49,209][123091] Updated weights for policy 0, policy_version 1250996 (0.0008) [2023-12-26 09:34:49,279][123091] Updated weights for policy 0, policy_version 1251006 (0.0008) [2023-12-26 09:34:49,341][123091] Updated weights for policy 0, policy_version 1251016 (0.0009) [2023-12-26 09:34:49,814][123090] Updated weights for policy 1, policy_version 1242242 (0.0009) [2023-12-26 09:34:49,886][123090] Updated weights for policy 1, policy_version 1242252 (0.0010) [2023-12-26 09:34:49,965][123090] Updated weights for policy 1, policy_version 1242262 (0.0010) [2023-12-26 09:34:50,030][123090] Updated weights for policy 1, policy_version 1242272 (0.0006) [2023-12-26 09:34:50,162][123091] Updated weights for policy 0, policy_version 1251026 (0.0009) [2023-12-26 09:34:50,220][123091] Updated weights for policy 0, policy_version 1251036 (0.0009) [2023-12-26 09:34:50,273][123091] Updated weights for policy 0, policy_version 1251046 (0.0009) [2023-12-26 09:34:50,326][123091] Updated weights for policy 0, policy_version 1251056 (0.0009) [2023-12-26 09:34:50,809][123090] Updated weights for policy 1, policy_version 1242282 (0.0010) [2023-12-26 09:34:50,873][123090] Updated weights for policy 1, policy_version 1242292 (0.0011) [2023-12-26 09:34:50,936][123090] Updated weights for policy 1, policy_version 1242302 (0.0011) [2023-12-26 09:34:51,186][123091] Updated weights for policy 0, policy_version 1251066 (0.0009) [2023-12-26 09:34:51,246][123091] Updated weights for policy 0, policy_version 1251076 (0.0009) [2023-12-26 09:34:51,314][123091] Updated weights for policy 0, policy_version 1251086 (0.0009) [2023-12-26 09:34:51,809][123090] Updated weights for policy 1, policy_version 1242312 (0.0010) [2023-12-26 09:34:51,879][123090] Updated weights for policy 1, policy_version 1242323 (0.0010) [2023-12-26 09:34:51,929][123090] Updated weights for policy 1, policy_version 1242333 (0.0008) [2023-12-26 09:34:52,160][123091] Updated weights for policy 0, policy_version 1251096 (0.0006) [2023-12-26 09:34:52,214][123091] Updated weights for policy 0, policy_version 1251106 (0.0005) [2023-12-26 09:34:52,282][123091] Updated weights for policy 0, policy_version 1251116 (0.0007) [2023-12-26 09:34:52,712][123090] Updated weights for policy 1, policy_version 1242343 (0.0009) [2023-12-26 09:34:52,762][123090] Updated weights for policy 1, policy_version 1242353 (0.0009) [2023-12-26 09:34:52,814][123090] Updated weights for policy 1, policy_version 1242363 (0.0008) [2023-12-26 09:34:53,132][123091] Updated weights for policy 0, policy_version 1251126 (0.0008) [2023-12-26 09:34:53,189][123091] Updated weights for policy 0, policy_version 1251136 (0.0007) [2023-12-26 09:34:53,245][123091] Updated weights for policy 0, policy_version 1251146 (0.0006) [2023-12-26 09:34:53,523][123090] Updated weights for policy 1, policy_version 1242373 (0.0010) [2023-12-26 09:34:53,586][123090] Updated weights for policy 1, policy_version 1242383 (0.0010) [2023-12-26 09:34:53,648][123090] Updated weights for policy 1, policy_version 1242393 (0.0010) [2023-12-26 09:34:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 638353408. Throughput: 0: 8879.6, 1: 8800.2. Samples: 638327164. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:53,785][121949] Avg episode reward: [(0, '6241.007'), (1, '5545.939')] [2023-12-26 09:34:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001251152_320299008.pth... [2023-12-26 09:34:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001242400_318054400.pth... [2023-12-26 09:34:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001250096_320028672.pth [2023-12-26 09:34:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001241344_317784064.pth [2023-12-26 09:34:54,014][123091] Updated weights for policy 0, policy_version 1251156 (0.0008) [2023-12-26 09:34:54,077][123091] Updated weights for policy 0, policy_version 1251166 (0.0009) [2023-12-26 09:34:54,146][123091] Updated weights for policy 0, policy_version 1251176 (0.0009) [2023-12-26 09:34:54,354][123090] Updated weights for policy 1, policy_version 1242403 (0.0010) [2023-12-26 09:34:54,407][123090] Updated weights for policy 1, policy_version 1242413 (0.0009) [2023-12-26 09:34:54,468][123090] Updated weights for policy 1, policy_version 1242423 (0.0009) [2023-12-26 09:34:54,943][123091] Updated weights for policy 0, policy_version 1251186 (0.0009) [2023-12-26 09:34:55,012][123091] Updated weights for policy 0, policy_version 1251196 (0.0009) [2023-12-26 09:34:55,077][123091] Updated weights for policy 0, policy_version 1251206 (0.0010) [2023-12-26 09:34:55,152][123091] Updated weights for policy 0, policy_version 1251216 (0.0009) [2023-12-26 09:34:55,302][123090] Updated weights for policy 1, policy_version 1242433 (0.0010) [2023-12-26 09:34:55,350][123090] Updated weights for policy 1, policy_version 1242443 (0.0009) [2023-12-26 09:34:55,397][123090] Updated weights for policy 1, policy_version 1242453 (0.0008) [2023-12-26 09:34:55,448][123090] Updated weights for policy 1, policy_version 1242463 (0.0009) [2023-12-26 09:34:55,925][123091] Updated weights for policy 0, policy_version 1251226 (0.0009) [2023-12-26 09:34:55,979][123091] Updated weights for policy 0, policy_version 1251237 (0.0009) [2023-12-26 09:34:56,037][123091] Updated weights for policy 0, policy_version 1251247 (0.0009) [2023-12-26 09:34:56,306][123090] Updated weights for policy 1, policy_version 1242473 (0.0010) [2023-12-26 09:34:56,363][123090] Updated weights for policy 1, policy_version 1242483 (0.0009) [2023-12-26 09:34:56,436][123090] Updated weights for policy 1, policy_version 1242493 (0.0008) [2023-12-26 09:34:56,887][123091] Updated weights for policy 0, policy_version 1251257 (0.0010) [2023-12-26 09:34:56,946][123091] Updated weights for policy 0, policy_version 1251267 (0.0010) [2023-12-26 09:34:56,998][123091] Updated weights for policy 0, policy_version 1251278 (0.0009) [2023-12-26 09:34:57,264][123090] Updated weights for policy 1, policy_version 1242503 (0.0009) [2023-12-26 09:34:57,327][123090] Updated weights for policy 1, policy_version 1242513 (0.0006) [2023-12-26 09:34:57,383][123090] Updated weights for policy 1, policy_version 1242523 (0.0009) [2023-12-26 09:34:57,760][123091] Updated weights for policy 0, policy_version 1251288 (0.0006) [2023-12-26 09:34:57,807][123091] Updated weights for policy 0, policy_version 1251298 (0.0007) [2023-12-26 09:34:57,857][123091] Updated weights for policy 0, policy_version 1251309 (0.0010) [2023-12-26 09:34:58,240][123090] Updated weights for policy 1, policy_version 1242533 (0.0009) [2023-12-26 09:34:58,302][123090] Updated weights for policy 1, policy_version 1242543 (0.0010) [2023-12-26 09:34:58,370][123090] Updated weights for policy 1, policy_version 1242553 (0.0009) [2023-12-26 09:34:58,779][123091] Updated weights for policy 0, policy_version 1251319 (0.0008) [2023-12-26 09:34:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 638435328. Throughput: 0: 8934.9, 1: 8862.4. Samples: 638432508. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:34:58,785][121949] Avg episode reward: [(0, '6362.685'), (1, '5648.567')] [2023-12-26 09:34:58,844][123091] Updated weights for policy 0, policy_version 1251329 (0.0010) [2023-12-26 09:34:58,909][123091] Updated weights for policy 0, policy_version 1251339 (0.0010) [2023-12-26 09:34:59,339][123090] Updated weights for policy 1, policy_version 1242563 (0.0009) [2023-12-26 09:34:59,410][123090] Updated weights for policy 1, policy_version 1242573 (0.0008) [2023-12-26 09:34:59,476][123090] Updated weights for policy 1, policy_version 1242583 (0.0009) [2023-12-26 09:34:59,757][123091] Updated weights for policy 0, policy_version 1251349 (0.0010) [2023-12-26 09:34:59,800][123091] Updated weights for policy 0, policy_version 1251359 (0.0010) [2023-12-26 09:34:59,868][123091] Updated weights for policy 0, policy_version 1251370 (0.0010) [2023-12-26 09:35:00,268][123090] Updated weights for policy 1, policy_version 1242593 (0.0009) [2023-12-26 09:35:00,326][123090] Updated weights for policy 1, policy_version 1242603 (0.0008) [2023-12-26 09:35:00,387][123090] Updated weights for policy 1, policy_version 1242613 (0.0008) [2023-12-26 09:35:00,445][123090] Updated weights for policy 1, policy_version 1242623 (0.0007) [2023-12-26 09:35:00,730][123091] Updated weights for policy 0, policy_version 1251380 (0.0010) [2023-12-26 09:35:00,777][123091] Updated weights for policy 0, policy_version 1251390 (0.0010) [2023-12-26 09:35:00,831][123091] Updated weights for policy 0, policy_version 1251400 (0.0010) [2023-12-26 09:35:01,214][123090] Updated weights for policy 1, policy_version 1242633 (0.0008) [2023-12-26 09:35:01,270][123090] Updated weights for policy 1, policy_version 1242643 (0.0008) [2023-12-26 09:35:01,334][123090] Updated weights for policy 1, policy_version 1242653 (0.0009) [2023-12-26 09:35:01,682][123091] Updated weights for policy 0, policy_version 1251410 (0.0009) [2023-12-26 09:35:01,754][123091] Updated weights for policy 0, policy_version 1251420 (0.0009) [2023-12-26 09:35:01,816][123091] Updated weights for policy 0, policy_version 1251430 (0.0010) [2023-12-26 09:35:01,878][123091] Updated weights for policy 0, policy_version 1251440 (0.0010) [2023-12-26 09:35:02,200][123090] Updated weights for policy 1, policy_version 1242663 (0.0009) [2023-12-26 09:35:02,262][123090] Updated weights for policy 1, policy_version 1242673 (0.0009) [2023-12-26 09:35:02,329][123090] Updated weights for policy 1, policy_version 1242683 (0.0008) [2023-12-26 09:35:02,664][123091] Updated weights for policy 0, policy_version 1251450 (0.0010) [2023-12-26 09:35:02,711][123091] Updated weights for policy 0, policy_version 1251460 (0.0010) [2023-12-26 09:35:02,762][123091] Updated weights for policy 0, policy_version 1251470 (0.0010) [2023-12-26 09:35:03,155][123090] Updated weights for policy 1, policy_version 1242693 (0.0009) [2023-12-26 09:35:03,205][123090] Updated weights for policy 1, policy_version 1242703 (0.0008) [2023-12-26 09:35:03,256][123090] Updated weights for policy 1, policy_version 1242713 (0.0008) [2023-12-26 09:35:03,588][123091] Updated weights for policy 0, policy_version 1251480 (0.0010) [2023-12-26 09:35:03,640][123091] Updated weights for policy 0, policy_version 1251490 (0.0010) [2023-12-26 09:35:03,691][123091] Updated weights for policy 0, policy_version 1251500 (0.0010) [2023-12-26 09:35:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 638525440. Throughput: 0: 8876.7, 1: 8799.1. Samples: 638533844. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:35:03,784][121949] Avg episode reward: [(0, '6428.174'), (1, '5534.607')] [2023-12-26 09:35:04,090][123090] Updated weights for policy 1, policy_version 1242723 (0.0008) [2023-12-26 09:35:04,158][123090] Updated weights for policy 1, policy_version 1242733 (0.0009) [2023-12-26 09:35:04,230][123090] Updated weights for policy 1, policy_version 1242743 (0.0010) [2023-12-26 09:35:04,528][123091] Updated weights for policy 0, policy_version 1251510 (0.0010) [2023-12-26 09:35:04,585][123091] Updated weights for policy 0, policy_version 1251520 (0.0009) [2023-12-26 09:35:04,637][123091] Updated weights for policy 0, policy_version 1251530 (0.0009) [2023-12-26 09:35:05,073][123090] Updated weights for policy 1, policy_version 1242753 (0.0009) [2023-12-26 09:35:05,141][123090] Updated weights for policy 1, policy_version 1242763 (0.0009) [2023-12-26 09:35:05,192][123090] Updated weights for policy 1, policy_version 1242773 (0.0010) [2023-12-26 09:35:05,244][123090] Updated weights for policy 1, policy_version 1242783 (0.0009) [2023-12-26 09:35:05,436][123091] Updated weights for policy 0, policy_version 1251540 (0.0010) [2023-12-26 09:35:05,497][123091] Updated weights for policy 0, policy_version 1251550 (0.0009) [2023-12-26 09:35:05,551][123091] Updated weights for policy 0, policy_version 1251560 (0.0009) [2023-12-26 09:35:06,108][123090] Updated weights for policy 1, policy_version 1242793 (0.0010) [2023-12-26 09:35:06,182][123090] Updated weights for policy 1, policy_version 1242803 (0.0008) [2023-12-26 09:35:06,256][123090] Updated weights for policy 1, policy_version 1242813 (0.0008) [2023-12-26 09:35:06,353][123091] Updated weights for policy 0, policy_version 1251570 (0.0009) [2023-12-26 09:35:06,412][123091] Updated weights for policy 0, policy_version 1251580 (0.0006) [2023-12-26 09:35:06,468][123091] Updated weights for policy 0, policy_version 1251590 (0.0006) [2023-12-26 09:35:06,521][123091] Updated weights for policy 0, policy_version 1251600 (0.0005) [2023-12-26 09:35:07,071][123090] Updated weights for policy 1, policy_version 1242823 (0.0007) [2023-12-26 09:35:07,137][123090] Updated weights for policy 1, policy_version 1242833 (0.0005) [2023-12-26 09:35:07,139][123091] Updated weights for policy 0, policy_version 1251610 (0.0010) [2023-12-26 09:35:07,193][123090] Updated weights for policy 1, policy_version 1242843 (0.0005) [2023-12-26 09:35:07,195][123091] Updated weights for policy 0, policy_version 1251620 (0.0011) [2023-12-26 09:35:07,257][123091] Updated weights for policy 0, policy_version 1251630 (0.0011) [2023-12-26 09:35:07,883][123090] Updated weights for policy 1, policy_version 1242853 (0.0006) [2023-12-26 09:35:07,955][123090] Updated weights for policy 1, policy_version 1242863 (0.0005) [2023-12-26 09:35:08,016][123090] Updated weights for policy 1, policy_version 1242873 (0.0005) [2023-12-26 09:35:08,023][123091] Updated weights for policy 0, policy_version 1251640 (0.0007) [2023-12-26 09:35:08,078][123091] Updated weights for policy 0, policy_version 1251650 (0.0010) [2023-12-26 09:35:08,122][123091] Updated weights for policy 0, policy_version 1251660 (0.0010) [2023-12-26 09:35:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 638607360. Throughput: 0: 8871.8, 1: 8793.0. Samples: 638585552. Policy #0 lag: (min: 11.0, avg: 17.2, max: 43.0) [2023-12-26 09:35:08,785][121949] Avg episode reward: [(0, '6319.696'), (1, '5508.920')] [2023-12-26 09:35:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001251664_320430080.pth... [2023-12-26 09:35:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001250640_320167936.pth [2023-12-26 09:35:08,805][123090] Updated weights for policy 1, policy_version 1242883 (0.0007) [2023-12-26 09:35:08,849][123090] Updated weights for policy 1, policy_version 1242893 (0.0010) [2023-12-26 09:35:08,897][123090] Updated weights for policy 1, policy_version 1242903 (0.0010) [2023-12-26 09:35:08,943][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001242912_318185472.pth... [2023-12-26 09:35:08,946][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001241888_317923328.pth [2023-12-26 09:35:08,998][123091] Updated weights for policy 0, policy_version 1251670 (0.0010) [2023-12-26 09:35:09,053][123091] Updated weights for policy 0, policy_version 1251682 (0.0010) [2023-12-26 09:35:09,103][123091] Updated weights for policy 0, policy_version 1251692 (0.0006) [2023-12-26 09:35:09,754][123090] Updated weights for policy 1, policy_version 1242913 (0.0010) [2023-12-26 09:35:09,815][123090] Updated weights for policy 1, policy_version 1242923 (0.0011) [2023-12-26 09:35:09,881][123090] Updated weights for policy 1, policy_version 1242933 (0.0010) [2023-12-26 09:35:09,954][123090] Updated weights for policy 1, policy_version 1242943 (0.0010) [2023-12-26 09:35:09,962][123091] Updated weights for policy 0, policy_version 1251702 (0.0008) [2023-12-26 09:35:10,022][123091] Updated weights for policy 0, policy_version 1251712 (0.0008) [2023-12-26 09:35:10,081][123091] Updated weights for policy 0, policy_version 1251722 (0.0007) [2023-12-26 09:35:10,815][123091] Updated weights for policy 0, policy_version 1251732 (0.0007) [2023-12-26 09:35:10,843][123090] Updated weights for policy 1, policy_version 1242953 (0.0009) [2023-12-26 09:35:10,880][123091] Updated weights for policy 0, policy_version 1251742 (0.0006) [2023-12-26 09:35:10,913][123090] Updated weights for policy 1, policy_version 1242963 (0.0008) [2023-12-26 09:35:10,936][123091] Updated weights for policy 0, policy_version 1251752 (0.0010) [2023-12-26 09:35:10,976][123090] Updated weights for policy 1, policy_version 1242973 (0.0007) [2023-12-26 09:35:11,804][123091] Updated weights for policy 0, policy_version 1251762 (0.0009) [2023-12-26 09:35:11,804][123090] Updated weights for policy 1, policy_version 1242983 (0.0009) [2023-12-26 09:35:11,868][123090] Updated weights for policy 1, policy_version 1242993 (0.0009) [2023-12-26 09:35:11,871][123091] Updated weights for policy 0, policy_version 1251772 (0.0009) [2023-12-26 09:35:11,933][123090] Updated weights for policy 1, policy_version 1243003 (0.0009) [2023-12-26 09:35:11,935][123091] Updated weights for policy 0, policy_version 1251782 (0.0008) [2023-12-26 09:35:11,992][123091] Updated weights for policy 0, policy_version 1251792 (0.0008) [2023-12-26 09:35:12,724][123090] Updated weights for policy 1, policy_version 1243013 (0.0009) [2023-12-26 09:35:12,773][123090] Updated weights for policy 1, policy_version 1243023 (0.0008) [2023-12-26 09:35:12,797][123091] Updated weights for policy 0, policy_version 1251802 (0.0006) [2023-12-26 09:35:12,829][123090] Updated weights for policy 1, policy_version 1243033 (0.0008) [2023-12-26 09:35:12,858][123091] Updated weights for policy 0, policy_version 1251812 (0.0007) [2023-12-26 09:35:12,912][123091] Updated weights for policy 0, policy_version 1251822 (0.0010) [2023-12-26 09:35:13,602][123090] Updated weights for policy 1, policy_version 1243043 (0.0009) [2023-12-26 09:35:13,659][123090] Updated weights for policy 1, policy_version 1243053 (0.0009) [2023-12-26 09:35:13,707][123090] Updated weights for policy 1, policy_version 1243063 (0.0009) [2023-12-26 09:35:13,765][123091] Updated weights for policy 0, policy_version 1251832 (0.0009) [2023-12-26 09:35:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 638697472. Throughput: 0: 8813.7, 1: 8728.8. Samples: 638691860. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:13,785][121949] Avg episode reward: [(0, '6227.255'), (1, '5601.477')] [2023-12-26 09:35:13,828][123091] Updated weights for policy 0, policy_version 1251842 (0.0009) [2023-12-26 09:35:13,881][123091] Updated weights for policy 0, policy_version 1251852 (0.0009) [2023-12-26 09:35:14,562][123090] Updated weights for policy 1, policy_version 1243073 (0.0009) [2023-12-26 09:35:14,626][123090] Updated weights for policy 1, policy_version 1243083 (0.0010) [2023-12-26 09:35:14,627][123091] Updated weights for policy 0, policy_version 1251862 (0.0010) [2023-12-26 09:35:14,688][123091] Updated weights for policy 0, policy_version 1251872 (0.0006) [2023-12-26 09:35:14,690][123090] Updated weights for policy 1, policy_version 1243093 (0.0010) [2023-12-26 09:35:14,747][123090] Updated weights for policy 1, policy_version 1243103 (0.0010) [2023-12-26 09:35:14,748][123091] Updated weights for policy 0, policy_version 1251882 (0.0006) [2023-12-26 09:35:15,417][123091] Updated weights for policy 0, policy_version 1251892 (0.0007) [2023-12-26 09:35:15,477][123091] Updated weights for policy 0, policy_version 1251902 (0.0006) [2023-12-26 09:35:15,539][123091] Updated weights for policy 0, policy_version 1251912 (0.0010) [2023-12-26 09:35:15,579][123090] Updated weights for policy 1, policy_version 1243113 (0.0011) [2023-12-26 09:35:15,635][123090] Updated weights for policy 1, policy_version 1243123 (0.0010) [2023-12-26 09:35:15,702][123090] Updated weights for policy 1, policy_version 1243133 (0.0010) [2023-12-26 09:35:16,333][123091] Updated weights for policy 0, policy_version 1251922 (0.0010) [2023-12-26 09:35:16,396][123091] Updated weights for policy 0, policy_version 1251932 (0.0006) [2023-12-26 09:35:16,440][123090] Updated weights for policy 1, policy_version 1243143 (0.0007) [2023-12-26 09:35:16,455][123091] Updated weights for policy 0, policy_version 1251942 (0.0006) [2023-12-26 09:35:16,502][123090] Updated weights for policy 1, policy_version 1243153 (0.0006) [2023-12-26 09:35:16,505][123091] Updated weights for policy 0, policy_version 1251952 (0.0005) [2023-12-26 09:35:16,563][123090] Updated weights for policy 1, policy_version 1243163 (0.0006) [2023-12-26 09:35:17,176][123091] Updated weights for policy 0, policy_version 1251962 (0.0005) [2023-12-26 09:35:17,242][123091] Updated weights for policy 0, policy_version 1251972 (0.0005) [2023-12-26 09:35:17,308][123091] Updated weights for policy 0, policy_version 1251982 (0.0005) [2023-12-26 09:35:17,317][123090] Updated weights for policy 1, policy_version 1243173 (0.0006) [2023-12-26 09:35:17,364][123090] Updated weights for policy 1, policy_version 1243183 (0.0005) [2023-12-26 09:35:17,411][123090] Updated weights for policy 1, policy_version 1243193 (0.0005) [2023-12-26 09:35:18,016][123091] Updated weights for policy 0, policy_version 1251992 (0.0010) [2023-12-26 09:35:18,067][123091] Updated weights for policy 0, policy_version 1252002 (0.0010) [2023-12-26 09:35:18,111][123091] Updated weights for policy 0, policy_version 1252012 (0.0010) [2023-12-26 09:35:18,144][123090] Updated weights for policy 1, policy_version 1243203 (0.0006) [2023-12-26 09:35:18,200][123090] Updated weights for policy 1, policy_version 1243213 (0.0009) [2023-12-26 09:35:18,254][123090] Updated weights for policy 1, policy_version 1243223 (0.0009) [2023-12-26 09:35:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 638787584. Throughput: 0: 8871.8, 1: 8710.1. Samples: 638801668. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:18,785][121949] Avg episode reward: [(0, '6295.619'), (1, '5582.987')] [2023-12-26 09:35:18,928][123091] Updated weights for policy 0, policy_version 1252022 (0.0007) [2023-12-26 09:35:18,987][123091] Updated weights for policy 0, policy_version 1252032 (0.0005) [2023-12-26 09:35:19,051][123091] Updated weights for policy 0, policy_version 1252042 (0.0006) [2023-12-26 09:35:19,181][123090] Updated weights for policy 1, policy_version 1243234 (0.0010) [2023-12-26 09:35:19,248][123090] Updated weights for policy 1, policy_version 1243244 (0.0009) [2023-12-26 09:35:19,314][123090] Updated weights for policy 1, policy_version 1243254 (0.0009) [2023-12-26 09:35:19,383][123090] Updated weights for policy 1, policy_version 1243264 (0.0008) [2023-12-26 09:35:19,839][123091] Updated weights for policy 0, policy_version 1252052 (0.0007) [2023-12-26 09:35:19,901][123091] Updated weights for policy 0, policy_version 1252062 (0.0009) [2023-12-26 09:35:19,964][123091] Updated weights for policy 0, policy_version 1252072 (0.0010) [2023-12-26 09:35:20,224][123090] Updated weights for policy 1, policy_version 1243274 (0.0006) [2023-12-26 09:35:20,286][123090] Updated weights for policy 1, policy_version 1243284 (0.0007) [2023-12-26 09:35:20,357][123090] Updated weights for policy 1, policy_version 1243294 (0.0010) [2023-12-26 09:35:20,831][123091] Updated weights for policy 0, policy_version 1252082 (0.0010) [2023-12-26 09:35:20,894][123091] Updated weights for policy 0, policy_version 1252092 (0.0009) [2023-12-26 09:35:20,948][123091] Updated weights for policy 0, policy_version 1252102 (0.0008) [2023-12-26 09:35:20,997][123091] Updated weights for policy 0, policy_version 1252112 (0.0005) [2023-12-26 09:35:21,218][123090] Updated weights for policy 1, policy_version 1243304 (0.0010) [2023-12-26 09:35:21,288][123090] Updated weights for policy 1, policy_version 1243314 (0.0009) [2023-12-26 09:35:21,347][123090] Updated weights for policy 1, policy_version 1243324 (0.0010) [2023-12-26 09:35:21,810][123091] Updated weights for policy 0, policy_version 1252122 (0.0009) [2023-12-26 09:35:21,876][123091] Updated weights for policy 0, policy_version 1252132 (0.0008) [2023-12-26 09:35:21,938][123091] Updated weights for policy 0, policy_version 1252142 (0.0010) [2023-12-26 09:35:22,187][123090] Updated weights for policy 1, policy_version 1243334 (0.0010) [2023-12-26 09:35:22,261][123090] Updated weights for policy 1, policy_version 1243344 (0.0007) [2023-12-26 09:35:22,328][123090] Updated weights for policy 1, policy_version 1243354 (0.0009) [2023-12-26 09:35:22,794][123091] Updated weights for policy 0, policy_version 1252152 (0.0011) [2023-12-26 09:35:22,868][123091] Updated weights for policy 0, policy_version 1252162 (0.0011) [2023-12-26 09:35:22,936][123091] Updated weights for policy 0, policy_version 1252172 (0.0011) [2023-12-26 09:35:23,082][123090] Updated weights for policy 1, policy_version 1243364 (0.0008) [2023-12-26 09:35:23,132][123090] Updated weights for policy 1, policy_version 1243374 (0.0005) [2023-12-26 09:35:23,179][123090] Updated weights for policy 1, policy_version 1243384 (0.0005) [2023-12-26 09:35:23,712][123091] Updated weights for policy 0, policy_version 1252182 (0.0010) [2023-12-26 09:35:23,780][123091] Updated weights for policy 0, policy_version 1252192 (0.0010) [2023-12-26 09:35:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 638869504. Throughput: 0: 8875.6, 1: 8655.8. Samples: 638851796. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:23,785][121949] Avg episode reward: [(0, '6299.534'), (1, '5648.147')] [2023-12-26 09:35:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001243392_318308352.pth... [2023-12-26 09:35:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001242400_318054400.pth [2023-12-26 09:35:23,841][123091] Updated weights for policy 0, policy_version 1252202 (0.0009) [2023-12-26 09:35:23,872][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001252208_320569344.pth... [2023-12-26 09:35:23,876][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001251152_320299008.pth [2023-12-26 09:35:23,973][123090] Updated weights for policy 1, policy_version 1243394 (0.0007) [2023-12-26 09:35:24,035][123090] Updated weights for policy 1, policy_version 1243404 (0.0008) [2023-12-26 09:35:24,104][123090] Updated weights for policy 1, policy_version 1243414 (0.0008) [2023-12-26 09:35:24,169][123090] Updated weights for policy 1, policy_version 1243424 (0.0008) [2023-12-26 09:35:24,706][123091] Updated weights for policy 0, policy_version 1252212 (0.0009) [2023-12-26 09:35:24,777][123091] Updated weights for policy 0, policy_version 1252222 (0.0008) [2023-12-26 09:35:24,844][123091] Updated weights for policy 0, policy_version 1252232 (0.0009) [2023-12-26 09:35:24,870][123090] Updated weights for policy 1, policy_version 1243434 (0.0010) [2023-12-26 09:35:24,926][123090] Updated weights for policy 1, policy_version 1243444 (0.0010) [2023-12-26 09:35:24,984][123090] Updated weights for policy 1, policy_version 1243454 (0.0010) [2023-12-26 09:35:25,643][123090] Updated weights for policy 1, policy_version 1243464 (0.0006) [2023-12-26 09:35:25,688][123091] Updated weights for policy 0, policy_version 1252242 (0.0009) [2023-12-26 09:35:25,709][123090] Updated weights for policy 1, policy_version 1243474 (0.0005) [2023-12-26 09:35:25,742][123091] Updated weights for policy 0, policy_version 1252252 (0.0010) [2023-12-26 09:35:25,769][123090] Updated weights for policy 1, policy_version 1243484 (0.0005) [2023-12-26 09:35:25,796][123091] Updated weights for policy 0, policy_version 1252262 (0.0008) [2023-12-26 09:35:25,846][123091] Updated weights for policy 0, policy_version 1252272 (0.0005) [2023-12-26 09:35:26,524][123091] Updated weights for policy 0, policy_version 1252282 (0.0006) [2023-12-26 09:35:26,527][123090] Updated weights for policy 1, policy_version 1243494 (0.0007) [2023-12-26 09:35:26,572][123091] Updated weights for policy 0, policy_version 1252292 (0.0005) [2023-12-26 09:35:26,585][123090] Updated weights for policy 1, policy_version 1243504 (0.0009) [2023-12-26 09:35:26,625][123091] Updated weights for policy 0, policy_version 1252302 (0.0005) [2023-12-26 09:35:26,645][123090] Updated weights for policy 1, policy_version 1243514 (0.0009) [2023-12-26 09:35:27,319][123091] Updated weights for policy 0, policy_version 1252312 (0.0006) [2023-12-26 09:35:27,366][123091] Updated weights for policy 0, policy_version 1252322 (0.0005) [2023-12-26 09:35:27,412][123091] Updated weights for policy 0, policy_version 1252332 (0.0005) [2023-12-26 09:35:27,562][123090] Updated weights for policy 1, policy_version 1243524 (0.0010) [2023-12-26 09:35:27,618][123090] Updated weights for policy 1, policy_version 1243534 (0.0007) [2023-12-26 09:35:27,667][123090] Updated weights for policy 1, policy_version 1243544 (0.0005) [2023-12-26 09:35:28,179][123091] Updated weights for policy 0, policy_version 1252342 (0.0008) [2023-12-26 09:35:28,233][123091] Updated weights for policy 0, policy_version 1252352 (0.0010) [2023-12-26 09:35:28,277][123091] Updated weights for policy 0, policy_version 1252362 (0.0009) [2023-12-26 09:35:28,341][123090] Updated weights for policy 1, policy_version 1243554 (0.0005) [2023-12-26 09:35:28,410][123090] Updated weights for policy 1, policy_version 1243564 (0.0006) [2023-12-26 09:35:28,482][123090] Updated weights for policy 1, policy_version 1243574 (0.0006) [2023-12-26 09:35:28,546][123090] Updated weights for policy 1, policy_version 1243584 (0.0006) [2023-12-26 09:35:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 638967808. Throughput: 0: 8973.0, 1: 8734.8. Samples: 638959752. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:28,784][121949] Avg episode reward: [(0, '6352.713'), (1, '5722.166')] [2023-12-26 09:35:29,046][123091] Updated weights for policy 0, policy_version 1252372 (0.0005) [2023-12-26 09:35:29,106][123091] Updated weights for policy 0, policy_version 1252382 (0.0010) [2023-12-26 09:35:29,171][123091] Updated weights for policy 0, policy_version 1252392 (0.0010) [2023-12-26 09:35:29,248][123090] Updated weights for policy 1, policy_version 1243594 (0.0007) [2023-12-26 09:35:29,300][123090] Updated weights for policy 1, policy_version 1243604 (0.0008) [2023-12-26 09:35:29,365][123090] Updated weights for policy 1, policy_version 1243614 (0.0008) [2023-12-26 09:35:29,988][123091] Updated weights for policy 0, policy_version 1252402 (0.0011) [2023-12-26 09:35:30,039][123091] Updated weights for policy 0, policy_version 1252412 (0.0010) [2023-12-26 09:35:30,098][123091] Updated weights for policy 0, policy_version 1252422 (0.0010) [2023-12-26 09:35:30,154][123091] Updated weights for policy 0, policy_version 1252432 (0.0010) [2023-12-26 09:35:30,213][123090] Updated weights for policy 1, policy_version 1243624 (0.0009) [2023-12-26 09:35:30,276][123090] Updated weights for policy 1, policy_version 1243634 (0.0009) [2023-12-26 09:35:30,323][123090] Updated weights for policy 1, policy_version 1243644 (0.0008) [2023-12-26 09:35:30,991][123091] Updated weights for policy 0, policy_version 1252442 (0.0010) [2023-12-26 09:35:31,058][123091] Updated weights for policy 0, policy_version 1252452 (0.0011) [2023-12-26 09:35:31,118][123091] Updated weights for policy 0, policy_version 1252462 (0.0011) [2023-12-26 09:35:31,121][123090] Updated weights for policy 1, policy_version 1243654 (0.0008) [2023-12-26 09:35:31,194][123090] Updated weights for policy 1, policy_version 1243664 (0.0008) [2023-12-26 09:35:31,255][123090] Updated weights for policy 1, policy_version 1243674 (0.0008) [2023-12-26 09:35:31,943][123091] Updated weights for policy 0, policy_version 1252472 (0.0011) [2023-12-26 09:35:32,006][123091] Updated weights for policy 0, policy_version 1252482 (0.0010) [2023-12-26 09:35:32,047][123090] Updated weights for policy 1, policy_version 1243684 (0.0009) [2023-12-26 09:35:32,068][123091] Updated weights for policy 0, policy_version 1252492 (0.0010) [2023-12-26 09:35:32,095][123090] Updated weights for policy 1, policy_version 1243694 (0.0010) [2023-12-26 09:35:32,143][123090] Updated weights for policy 1, policy_version 1243704 (0.0010) [2023-12-26 09:35:32,818][123091] Updated weights for policy 0, policy_version 1252502 (0.0007) [2023-12-26 09:35:32,871][123090] Updated weights for policy 1, policy_version 1243714 (0.0009) [2023-12-26 09:35:32,885][123091] Updated weights for policy 0, policy_version 1252512 (0.0005) [2023-12-26 09:35:32,924][123090] Updated weights for policy 1, policy_version 1243724 (0.0007) [2023-12-26 09:35:32,955][123091] Updated weights for policy 0, policy_version 1252522 (0.0009) [2023-12-26 09:35:32,979][123090] Updated weights for policy 1, policy_version 1243734 (0.0007) [2023-12-26 09:35:33,036][123090] Updated weights for policy 1, policy_version 1243744 (0.0008) [2023-12-26 09:35:33,573][123091] Updated weights for policy 0, policy_version 1252532 (0.0007) [2023-12-26 09:35:33,642][123091] Updated weights for policy 0, policy_version 1252542 (0.0005) [2023-12-26 09:35:33,719][123091] Updated weights for policy 0, policy_version 1252552 (0.0005) [2023-12-26 09:35:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 639057920. Throughput: 0: 8881.2, 1: 8734.1. Samples: 639068540. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:33,785][121949] Avg episode reward: [(0, '6427.564'), (1, '5801.649')] [2023-12-26 09:35:33,890][123090] Updated weights for policy 1, policy_version 1243754 (0.0005) [2023-12-26 09:35:33,940][123090] Updated weights for policy 1, policy_version 1243764 (0.0005) [2023-12-26 09:35:33,996][123090] Updated weights for policy 1, policy_version 1243774 (0.0005) [2023-12-26 09:35:34,443][123091] Updated weights for policy 0, policy_version 1252562 (0.0008) [2023-12-26 09:35:34,508][123091] Updated weights for policy 0, policy_version 1252572 (0.0008) [2023-12-26 09:35:34,570][123091] Updated weights for policy 0, policy_version 1252582 (0.0008) [2023-12-26 09:35:34,628][123090] Updated weights for policy 1, policy_version 1243784 (0.0008) [2023-12-26 09:35:34,629][123091] Updated weights for policy 0, policy_version 1252592 (0.0008) [2023-12-26 09:35:34,678][123090] Updated weights for policy 1, policy_version 1243794 (0.0006) [2023-12-26 09:35:34,734][123090] Updated weights for policy 1, policy_version 1243804 (0.0006) [2023-12-26 09:35:35,414][123091] Updated weights for policy 0, policy_version 1252602 (0.0010) [2023-12-26 09:35:35,472][123091] Updated weights for policy 0, policy_version 1252612 (0.0010) [2023-12-26 09:35:35,512][123090] Updated weights for policy 1, policy_version 1243814 (0.0008) [2023-12-26 09:35:35,530][123091] Updated weights for policy 0, policy_version 1252622 (0.0010) [2023-12-26 09:35:35,565][123090] Updated weights for policy 1, policy_version 1243824 (0.0007) [2023-12-26 09:35:35,613][123090] Updated weights for policy 1, policy_version 1243834 (0.0008) [2023-12-26 09:35:36,275][123091] Updated weights for policy 0, policy_version 1252632 (0.0009) [2023-12-26 09:35:36,346][123091] Updated weights for policy 0, policy_version 1252642 (0.0008) [2023-12-26 09:35:36,405][123091] Updated weights for policy 0, policy_version 1252652 (0.0011) [2023-12-26 09:35:36,456][123090] Updated weights for policy 1, policy_version 1243844 (0.0007) [2023-12-26 09:35:36,530][123090] Updated weights for policy 1, policy_version 1243854 (0.0006) [2023-12-26 09:35:36,603][123090] Updated weights for policy 1, policy_version 1243864 (0.0005) [2023-12-26 09:35:37,215][123091] Updated weights for policy 0, policy_version 1252662 (0.0011) [2023-12-26 09:35:37,275][123091] Updated weights for policy 0, policy_version 1252672 (0.0011) [2023-12-26 09:35:37,300][123090] Updated weights for policy 1, policy_version 1243874 (0.0007) [2023-12-26 09:35:37,334][123091] Updated weights for policy 0, policy_version 1252682 (0.0011) [2023-12-26 09:35:37,352][123090] Updated weights for policy 1, policy_version 1243884 (0.0011) [2023-12-26 09:35:37,401][123090] Updated weights for policy 1, policy_version 1243894 (0.0010) [2023-12-26 09:35:37,453][123090] Updated weights for policy 1, policy_version 1243904 (0.0010) [2023-12-26 09:35:38,155][123091] Updated weights for policy 0, policy_version 1252692 (0.0009) [2023-12-26 09:35:38,207][123091] Updated weights for policy 0, policy_version 1252702 (0.0005) [2023-12-26 09:35:38,261][123091] Updated weights for policy 0, policy_version 1252712 (0.0005) [2023-12-26 09:35:38,329][123090] Updated weights for policy 1, policy_version 1243914 (0.0008) [2023-12-26 09:35:38,405][123090] Updated weights for policy 1, policy_version 1243924 (0.0008) [2023-12-26 09:35:38,472][123090] Updated weights for policy 1, policy_version 1243934 (0.0009) [2023-12-26 09:35:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 639148032. Throughput: 0: 8902.1, 1: 8794.9. Samples: 639123532. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:38,785][121949] Avg episode reward: [(0, '6407.116'), (1, '5780.281')] [2023-12-26 09:35:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001252720_320700416.pth... [2023-12-26 09:35:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001243936_318447616.pth... [2023-12-26 09:35:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001251664_320430080.pth [2023-12-26 09:35:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001242912_318185472.pth [2023-12-26 09:35:39,021][123091] Updated weights for policy 0, policy_version 1252722 (0.0006) [2023-12-26 09:35:39,091][123091] Updated weights for policy 0, policy_version 1252732 (0.0006) [2023-12-26 09:35:39,158][123091] Updated weights for policy 0, policy_version 1252742 (0.0007) [2023-12-26 09:35:39,210][123091] Updated weights for policy 0, policy_version 1252752 (0.0009) [2023-12-26 09:35:39,303][123090] Updated weights for policy 1, policy_version 1243944 (0.0008) [2023-12-26 09:35:39,382][123090] Updated weights for policy 1, policy_version 1243954 (0.0008) [2023-12-26 09:35:39,460][123090] Updated weights for policy 1, policy_version 1243964 (0.0008) [2023-12-26 09:35:40,015][123091] Updated weights for policy 0, policy_version 1252762 (0.0010) [2023-12-26 09:35:40,080][123091] Updated weights for policy 0, policy_version 1252772 (0.0009) [2023-12-26 09:35:40,141][123091] Updated weights for policy 0, policy_version 1252782 (0.0011) [2023-12-26 09:35:40,260][123090] Updated weights for policy 1, policy_version 1243974 (0.0008) [2023-12-26 09:35:40,329][123090] Updated weights for policy 1, policy_version 1243984 (0.0009) [2023-12-26 09:35:40,394][123090] Updated weights for policy 1, policy_version 1243994 (0.0009) [2023-12-26 09:35:40,976][123091] Updated weights for policy 0, policy_version 1252792 (0.0011) [2023-12-26 09:35:41,033][123091] Updated weights for policy 0, policy_version 1252802 (0.0011) [2023-12-26 09:35:41,101][123091] Updated weights for policy 0, policy_version 1252812 (0.0011) [2023-12-26 09:35:41,216][123090] Updated weights for policy 1, policy_version 1244004 (0.0009) [2023-12-26 09:35:41,286][123090] Updated weights for policy 1, policy_version 1244014 (0.0008) [2023-12-26 09:35:41,343][123090] Updated weights for policy 1, policy_version 1244024 (0.0009) [2023-12-26 09:35:41,936][123091] Updated weights for policy 0, policy_version 1252822 (0.0008) [2023-12-26 09:35:42,004][123091] Updated weights for policy 0, policy_version 1252832 (0.0007) [2023-12-26 09:35:42,072][123091] Updated weights for policy 0, policy_version 1252842 (0.0010) [2023-12-26 09:35:42,240][123090] Updated weights for policy 1, policy_version 1244034 (0.0009) [2023-12-26 09:35:42,311][123090] Updated weights for policy 1, policy_version 1244044 (0.0009) [2023-12-26 09:35:42,389][123090] Updated weights for policy 1, policy_version 1244054 (0.0008) [2023-12-26 09:35:42,457][123090] Updated weights for policy 1, policy_version 1244064 (0.0008) [2023-12-26 09:35:42,904][123091] Updated weights for policy 0, policy_version 1252852 (0.0010) [2023-12-26 09:35:42,968][123091] Updated weights for policy 0, policy_version 1252862 (0.0010) [2023-12-26 09:35:43,021][123091] Updated weights for policy 0, policy_version 1252872 (0.0009) [2023-12-26 09:35:43,251][123090] Updated weights for policy 1, policy_version 1244074 (0.0009) [2023-12-26 09:35:43,312][123090] Updated weights for policy 1, policy_version 1244084 (0.0009) [2023-12-26 09:35:43,381][123090] Updated weights for policy 1, policy_version 1244094 (0.0009) [2023-12-26 09:35:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 639229952. Throughput: 0: 8903.7, 1: 8747.4. Samples: 639226808. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:43,785][121949] Avg episode reward: [(0, '6379.483'), (1, '5710.689')] [2023-12-26 09:35:43,815][123091] Updated weights for policy 0, policy_version 1252882 (0.0009) [2023-12-26 09:35:43,866][123091] Updated weights for policy 0, policy_version 1252892 (0.0007) [2023-12-26 09:35:43,922][123091] Updated weights for policy 0, policy_version 1252902 (0.0006) [2023-12-26 09:35:43,987][123091] Updated weights for policy 0, policy_version 1252912 (0.0007) [2023-12-26 09:35:44,196][123090] Updated weights for policy 1, policy_version 1244104 (0.0010) [2023-12-26 09:35:44,262][123090] Updated weights for policy 1, policy_version 1244114 (0.0006) [2023-12-26 09:35:44,333][123090] Updated weights for policy 1, policy_version 1244124 (0.0008) [2023-12-26 09:35:44,785][123091] Updated weights for policy 0, policy_version 1252922 (0.0007) [2023-12-26 09:35:44,856][123091] Updated weights for policy 0, policy_version 1252932 (0.0008) [2023-12-26 09:35:44,916][123091] Updated weights for policy 0, policy_version 1252942 (0.0008) [2023-12-26 09:35:45,091][123090] Updated weights for policy 1, policy_version 1244134 (0.0007) [2023-12-26 09:35:45,156][123090] Updated weights for policy 1, policy_version 1244144 (0.0010) [2023-12-26 09:35:45,221][123090] Updated weights for policy 1, policy_version 1244154 (0.0011) [2023-12-26 09:35:45,678][123091] Updated weights for policy 0, policy_version 1252952 (0.0009) [2023-12-26 09:35:45,743][123091] Updated weights for policy 0, policy_version 1252962 (0.0009) [2023-12-26 09:35:45,797][123091] Updated weights for policy 0, policy_version 1252973 (0.0010) [2023-12-26 09:35:46,038][123090] Updated weights for policy 1, policy_version 1244164 (0.0009) [2023-12-26 09:35:46,109][123090] Updated weights for policy 1, policy_version 1244174 (0.0005) [2023-12-26 09:35:46,171][123090] Updated weights for policy 1, policy_version 1244184 (0.0005) [2023-12-26 09:35:46,516][123091] Updated weights for policy 0, policy_version 1252983 (0.0007) [2023-12-26 09:35:46,580][123091] Updated weights for policy 0, policy_version 1252993 (0.0006) [2023-12-26 09:35:46,643][123091] Updated weights for policy 0, policy_version 1253003 (0.0006) [2023-12-26 09:35:46,925][123090] Updated weights for policy 1, policy_version 1244194 (0.0008) [2023-12-26 09:35:46,992][123090] Updated weights for policy 1, policy_version 1244204 (0.0010) [2023-12-26 09:35:47,044][123090] Updated weights for policy 1, policy_version 1244214 (0.0010) [2023-12-26 09:35:47,101][123090] Updated weights for policy 1, policy_version 1244224 (0.0009) [2023-12-26 09:35:47,340][123091] Updated weights for policy 0, policy_version 1253013 (0.0008) [2023-12-26 09:35:47,386][123091] Updated weights for policy 0, policy_version 1253023 (0.0009) [2023-12-26 09:35:47,440][123091] Updated weights for policy 0, policy_version 1253033 (0.0010) [2023-12-26 09:35:47,954][123090] Updated weights for policy 1, policy_version 1244234 (0.0009) [2023-12-26 09:35:48,010][123090] Updated weights for policy 1, policy_version 1244244 (0.0009) [2023-12-26 09:35:48,059][123090] Updated weights for policy 1, policy_version 1244254 (0.0008) [2023-12-26 09:35:48,135][123091] Updated weights for policy 0, policy_version 1253043 (0.0010) [2023-12-26 09:35:48,197][123091] Updated weights for policy 0, policy_version 1253053 (0.0010) [2023-12-26 09:35:48,263][123091] Updated weights for policy 0, policy_version 1253063 (0.0011) [2023-12-26 09:35:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 639320064. Throughput: 0: 9008.0, 1: 8778.9. Samples: 639334256. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:48,785][121949] Avg episode reward: [(0, '6337.424'), (1, '5785.272')] [2023-12-26 09:35:48,890][123090] Updated weights for policy 1, policy_version 1244264 (0.0006) [2023-12-26 09:35:48,940][123090] Updated weights for policy 1, policy_version 1244274 (0.0005) [2023-12-26 09:35:49,001][123091] Updated weights for policy 0, policy_version 1253073 (0.0010) [2023-12-26 09:35:49,010][123090] Updated weights for policy 1, policy_version 1244284 (0.0006) [2023-12-26 09:35:49,082][123091] Updated weights for policy 0, policy_version 1253083 (0.0007) [2023-12-26 09:35:49,165][123091] Updated weights for policy 0, policy_version 1253093 (0.0011) [2023-12-26 09:35:49,238][123091] Updated weights for policy 0, policy_version 1253103 (0.0009) [2023-12-26 09:35:49,735][123090] Updated weights for policy 1, policy_version 1244294 (0.0006) [2023-12-26 09:35:49,812][123090] Updated weights for policy 1, policy_version 1244304 (0.0006) [2023-12-26 09:35:49,881][123090] Updated weights for policy 1, policy_version 1244314 (0.0008) [2023-12-26 09:35:49,925][123091] Updated weights for policy 0, policy_version 1253113 (0.0009) [2023-12-26 09:35:49,992][123091] Updated weights for policy 0, policy_version 1253123 (0.0009) [2023-12-26 09:35:50,056][123091] Updated weights for policy 0, policy_version 1253133 (0.0009) [2023-12-26 09:35:50,632][123090] Updated weights for policy 1, policy_version 1244324 (0.0009) [2023-12-26 09:35:50,694][123090] Updated weights for policy 1, policy_version 1244334 (0.0011) [2023-12-26 09:35:50,765][123090] Updated weights for policy 1, policy_version 1244344 (0.0011) [2023-12-26 09:35:50,832][123091] Updated weights for policy 0, policy_version 1253143 (0.0009) [2023-12-26 09:35:50,896][123091] Updated weights for policy 0, policy_version 1253153 (0.0009) [2023-12-26 09:35:50,949][123091] Updated weights for policy 0, policy_version 1253163 (0.0009) [2023-12-26 09:35:51,595][123090] Updated weights for policy 1, policy_version 1244354 (0.0009) [2023-12-26 09:35:51,661][123090] Updated weights for policy 1, policy_version 1244364 (0.0010) [2023-12-26 09:35:51,727][123090] Updated weights for policy 1, policy_version 1244374 (0.0010) [2023-12-26 09:35:51,795][123090] Updated weights for policy 1, policy_version 1244384 (0.0011) [2023-12-26 09:35:51,849][123091] Updated weights for policy 0, policy_version 1253173 (0.0009) [2023-12-26 09:35:51,901][123091] Updated weights for policy 0, policy_version 1253183 (0.0009) [2023-12-26 09:35:51,958][123091] Updated weights for policy 0, policy_version 1253193 (0.0009) [2023-12-26 09:35:52,629][123090] Updated weights for policy 1, policy_version 1244394 (0.0010) [2023-12-26 09:35:52,694][123090] Updated weights for policy 1, policy_version 1244404 (0.0009) [2023-12-26 09:35:52,766][123090] Updated weights for policy 1, policy_version 1244414 (0.0009) [2023-12-26 09:35:52,832][123091] Updated weights for policy 0, policy_version 1253203 (0.0009) [2023-12-26 09:35:52,884][123091] Updated weights for policy 0, policy_version 1253213 (0.0009) [2023-12-26 09:35:52,946][123091] Updated weights for policy 0, policy_version 1253223 (0.0009) [2023-12-26 09:35:53,573][123090] Updated weights for policy 1, policy_version 1244424 (0.0009) [2023-12-26 09:35:53,622][123090] Updated weights for policy 1, policy_version 1244434 (0.0009) [2023-12-26 09:35:53,677][123090] Updated weights for policy 1, policy_version 1244444 (0.0005) [2023-12-26 09:35:53,745][123091] Updated weights for policy 0, policy_version 1253233 (0.0009) [2023-12-26 09:35:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 639410176. Throughput: 0: 9015.4, 1: 8836.0. Samples: 639388864. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:53,785][121949] Avg episode reward: [(0, '6324.579'), (1, '5744.381')] [2023-12-26 09:35:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001244448_318578688.pth... [2023-12-26 09:35:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001243392_318308352.pth [2023-12-26 09:35:53,797][123091] Updated weights for policy 0, policy_version 1253243 (0.0010) [2023-12-26 09:35:53,868][123091] Updated weights for policy 0, policy_version 1253253 (0.0005) [2023-12-26 09:35:53,940][123091] Updated weights for policy 0, policy_version 1253263 (0.0008) [2023-12-26 09:35:53,946][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001253264_320839680.pth... [2023-12-26 09:35:53,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001252208_320569344.pth [2023-12-26 09:35:54,460][123090] Updated weights for policy 1, policy_version 1244454 (0.0007) [2023-12-26 09:35:54,524][123090] Updated weights for policy 1, policy_version 1244464 (0.0008) [2023-12-26 09:35:54,584][123090] Updated weights for policy 1, policy_version 1244474 (0.0007) [2023-12-26 09:35:54,721][123091] Updated weights for policy 0, policy_version 1253273 (0.0010) [2023-12-26 09:35:54,782][123091] Updated weights for policy 0, policy_version 1253283 (0.0010) [2023-12-26 09:35:54,850][123091] Updated weights for policy 0, policy_version 1253293 (0.0009) [2023-12-26 09:35:55,194][123090] Updated weights for policy 1, policy_version 1244484 (0.0006) [2023-12-26 09:35:55,254][123090] Updated weights for policy 1, policy_version 1244494 (0.0006) [2023-12-26 09:35:55,303][123090] Updated weights for policy 1, policy_version 1244504 (0.0005) [2023-12-26 09:35:55,556][123091] Updated weights for policy 0, policy_version 1253303 (0.0009) [2023-12-26 09:35:55,610][123091] Updated weights for policy 0, policy_version 1253313 (0.0010) [2023-12-26 09:35:55,661][123091] Updated weights for policy 0, policy_version 1253323 (0.0010) [2023-12-26 09:35:56,007][123090] Updated weights for policy 1, policy_version 1244514 (0.0005) [2023-12-26 09:35:56,075][123090] Updated weights for policy 1, policy_version 1244524 (0.0005) [2023-12-26 09:35:56,149][123090] Updated weights for policy 1, policy_version 1244534 (0.0006) [2023-12-26 09:35:56,214][123090] Updated weights for policy 1, policy_version 1244544 (0.0006) [2023-12-26 09:35:56,430][123091] Updated weights for policy 0, policy_version 1253333 (0.0008) [2023-12-26 09:35:56,480][123091] Updated weights for policy 0, policy_version 1253343 (0.0009) [2023-12-26 09:35:56,531][123091] Updated weights for policy 0, policy_version 1253353 (0.0010) [2023-12-26 09:35:56,908][123090] Updated weights for policy 1, policy_version 1244554 (0.0005) [2023-12-26 09:35:56,960][123090] Updated weights for policy 1, policy_version 1244564 (0.0005) [2023-12-26 09:35:57,013][123090] Updated weights for policy 1, policy_version 1244574 (0.0005) [2023-12-26 09:35:57,349][123091] Updated weights for policy 0, policy_version 1253363 (0.0009) [2023-12-26 09:35:57,408][123091] Updated weights for policy 0, policy_version 1253373 (0.0010) [2023-12-26 09:35:57,470][123091] Updated weights for policy 0, policy_version 1253383 (0.0010) [2023-12-26 09:35:57,734][123090] Updated weights for policy 1, policy_version 1244584 (0.0009) [2023-12-26 09:35:57,796][123090] Updated weights for policy 1, policy_version 1244594 (0.0010) [2023-12-26 09:35:57,862][123090] Updated weights for policy 1, policy_version 1244604 (0.0010) [2023-12-26 09:35:58,251][123091] Updated weights for policy 0, policy_version 1253393 (0.0010) [2023-12-26 09:35:58,313][123091] Updated weights for policy 0, policy_version 1253403 (0.0008) [2023-12-26 09:35:58,385][123091] Updated weights for policy 0, policy_version 1253413 (0.0008) [2023-12-26 09:35:58,448][123091] Updated weights for policy 0, policy_version 1253423 (0.0007) [2023-12-26 09:35:58,621][123090] Updated weights for policy 1, policy_version 1244614 (0.0009) [2023-12-26 09:35:58,697][123090] Updated weights for policy 1, policy_version 1244624 (0.0009) [2023-12-26 09:35:58,782][123090] Updated weights for policy 1, policy_version 1244634 (0.0015) [2023-12-26 09:35:58,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.1, 300 sec: 17661.4). Total num frames: 639500288. Throughput: 0: 9009.0, 1: 8924.2. Samples: 639498864. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:35:58,786][121949] Avg episode reward: [(0, '6345.640'), (1, '5703.842')] [2023-12-26 09:35:59,287][123091] Updated weights for policy 0, policy_version 1253433 (0.0009) [2023-12-26 09:35:59,361][123091] Updated weights for policy 0, policy_version 1253443 (0.0008) [2023-12-26 09:35:59,431][123091] Updated weights for policy 0, policy_version 1253453 (0.0007) [2023-12-26 09:35:59,677][123090] Updated weights for policy 1, policy_version 1244644 (0.0007) [2023-12-26 09:35:59,756][123090] Updated weights for policy 1, policy_version 1244654 (0.0005) [2023-12-26 09:35:59,836][123090] Updated weights for policy 1, policy_version 1244664 (0.0007) [2023-12-26 09:36:00,226][123091] Updated weights for policy 0, policy_version 1253463 (0.0009) [2023-12-26 09:36:00,274][123091] Updated weights for policy 0, policy_version 1253473 (0.0008) [2023-12-26 09:36:00,335][123091] Updated weights for policy 0, policy_version 1253483 (0.0009) [2023-12-26 09:36:00,583][123090] Updated weights for policy 1, policy_version 1244674 (0.0007) [2023-12-26 09:36:00,654][123090] Updated weights for policy 1, policy_version 1244684 (0.0005) [2023-12-26 09:36:00,724][123090] Updated weights for policy 1, policy_version 1244694 (0.0005) [2023-12-26 09:36:00,779][123090] Updated weights for policy 1, policy_version 1244704 (0.0005) [2023-12-26 09:36:01,024][123091] Updated weights for policy 0, policy_version 1253493 (0.0008) [2023-12-26 09:36:01,090][123091] Updated weights for policy 0, policy_version 1253503 (0.0006) [2023-12-26 09:36:01,156][123091] Updated weights for policy 0, policy_version 1253513 (0.0006) [2023-12-26 09:36:01,461][123090] Updated weights for policy 1, policy_version 1244714 (0.0007) [2023-12-26 09:36:01,517][123090] Updated weights for policy 1, policy_version 1244724 (0.0010) [2023-12-26 09:36:01,569][123090] Updated weights for policy 1, policy_version 1244734 (0.0010) [2023-12-26 09:36:01,848][123091] Updated weights for policy 0, policy_version 1253523 (0.0007) [2023-12-26 09:36:01,910][123091] Updated weights for policy 0, policy_version 1253533 (0.0008) [2023-12-26 09:36:01,973][123091] Updated weights for policy 0, policy_version 1253543 (0.0010) [2023-12-26 09:36:02,254][123090] Updated weights for policy 1, policy_version 1244744 (0.0007) [2023-12-26 09:36:02,322][123090] Updated weights for policy 1, policy_version 1244754 (0.0010) [2023-12-26 09:36:02,391][123090] Updated weights for policy 1, policy_version 1244764 (0.0009) [2023-12-26 09:36:02,785][123091] Updated weights for policy 0, policy_version 1253553 (0.0011) [2023-12-26 09:36:02,843][123091] Updated weights for policy 0, policy_version 1253563 (0.0010) [2023-12-26 09:36:02,907][123091] Updated weights for policy 0, policy_version 1253573 (0.0007) [2023-12-26 09:36:02,978][123091] Updated weights for policy 0, policy_version 1253583 (0.0005) [2023-12-26 09:36:03,206][123090] Updated weights for policy 1, policy_version 1244774 (0.0006) [2023-12-26 09:36:03,259][123090] Updated weights for policy 1, policy_version 1244784 (0.0008) [2023-12-26 09:36:03,313][123090] Updated weights for policy 1, policy_version 1244795 (0.0011) [2023-12-26 09:36:03,671][123091] Updated weights for policy 0, policy_version 1253593 (0.0010) [2023-12-26 09:36:03,714][123091] Updated weights for policy 0, policy_version 1253603 (0.0007) [2023-12-26 09:36:03,769][123091] Updated weights for policy 0, policy_version 1253613 (0.0005) [2023-12-26 09:36:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 639590400. Throughput: 0: 8976.7, 1: 8910.1. Samples: 639606576. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:03,784][121949] Avg episode reward: [(0, '6350.530'), (1, '5644.150')] [2023-12-26 09:36:04,101][123090] Updated weights for policy 1, policy_version 1244805 (0.0008) [2023-12-26 09:36:04,169][123090] Updated weights for policy 1, policy_version 1244815 (0.0011) [2023-12-26 09:36:04,242][123090] Updated weights for policy 1, policy_version 1244825 (0.0010) [2023-12-26 09:36:04,560][123091] Updated weights for policy 0, policy_version 1253623 (0.0007) [2023-12-26 09:36:04,625][123091] Updated weights for policy 0, policy_version 1253633 (0.0009) [2023-12-26 09:36:04,689][123091] Updated weights for policy 0, policy_version 1253643 (0.0008) [2023-12-26 09:36:05,012][123090] Updated weights for policy 1, policy_version 1244835 (0.0006) [2023-12-26 09:36:05,084][123090] Updated weights for policy 1, policy_version 1244845 (0.0005) [2023-12-26 09:36:05,151][123090] Updated weights for policy 1, policy_version 1244855 (0.0005) [2023-12-26 09:36:05,451][123091] Updated weights for policy 0, policy_version 1253653 (0.0009) [2023-12-26 09:36:05,503][123091] Updated weights for policy 0, policy_version 1253663 (0.0009) [2023-12-26 09:36:05,552][123091] Updated weights for policy 0, policy_version 1253673 (0.0009) [2023-12-26 09:36:05,773][123090] Updated weights for policy 1, policy_version 1244865 (0.0006) [2023-12-26 09:36:05,835][123090] Updated weights for policy 1, policy_version 1244875 (0.0010) [2023-12-26 09:36:05,897][123090] Updated weights for policy 1, policy_version 1244885 (0.0010) [2023-12-26 09:36:05,955][123090] Updated weights for policy 1, policy_version 1244895 (0.0010) [2023-12-26 09:36:06,391][123091] Updated weights for policy 0, policy_version 1253683 (0.0009) [2023-12-26 09:36:06,439][123091] Updated weights for policy 0, policy_version 1253693 (0.0009) [2023-12-26 09:36:06,501][123091] Updated weights for policy 0, policy_version 1253703 (0.0009) [2023-12-26 09:36:06,791][123090] Updated weights for policy 1, policy_version 1244905 (0.0010) [2023-12-26 09:36:06,844][123090] Updated weights for policy 1, policy_version 1244915 (0.0009) [2023-12-26 09:36:06,899][123090] Updated weights for policy 1, policy_version 1244925 (0.0010) [2023-12-26 09:36:07,343][123091] Updated weights for policy 0, policy_version 1253713 (0.0008) [2023-12-26 09:36:07,403][123091] Updated weights for policy 0, policy_version 1253723 (0.0009) [2023-12-26 09:36:07,462][123091] Updated weights for policy 0, policy_version 1253733 (0.0006) [2023-12-26 09:36:07,514][123091] Updated weights for policy 0, policy_version 1253743 (0.0010) [2023-12-26 09:36:07,694][123090] Updated weights for policy 1, policy_version 1244935 (0.0010) [2023-12-26 09:36:07,751][123090] Updated weights for policy 1, policy_version 1244945 (0.0010) [2023-12-26 09:36:07,804][123090] Updated weights for policy 1, policy_version 1244955 (0.0006) [2023-12-26 09:36:08,281][123091] Updated weights for policy 0, policy_version 1253753 (0.0011) [2023-12-26 09:36:08,352][123091] Updated weights for policy 0, policy_version 1253763 (0.0011) [2023-12-26 09:36:08,419][123091] Updated weights for policy 0, policy_version 1253773 (0.0011) [2023-12-26 09:36:08,603][123090] Updated weights for policy 1, policy_version 1244965 (0.0008) [2023-12-26 09:36:08,663][123090] Updated weights for policy 1, policy_version 1244975 (0.0010) [2023-12-26 09:36:08,735][123090] Updated weights for policy 1, policy_version 1244985 (0.0009) [2023-12-26 09:36:08,784][121949] Fps is (10 sec: 18842.6, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 639688704. Throughput: 0: 8988.6, 1: 8983.2. Samples: 639660528. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:08,785][121949] Avg episode reward: [(0, '6248.103'), (1, '5738.391')] [2023-12-26 09:36:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001253776_320970752.pth... [2023-12-26 09:36:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001244992_318717952.pth... [2023-12-26 09:36:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001252720_320700416.pth [2023-12-26 09:36:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001243936_318447616.pth [2023-12-26 09:36:09,234][123091] Updated weights for policy 0, policy_version 1253783 (0.0011) [2023-12-26 09:36:09,308][123091] Updated weights for policy 0, policy_version 1253793 (0.0010) [2023-12-26 09:36:09,380][123091] Updated weights for policy 0, policy_version 1253803 (0.0011) [2023-12-26 09:36:09,570][123090] Updated weights for policy 1, policy_version 1244995 (0.0010) [2023-12-26 09:36:09,635][123090] Updated weights for policy 1, policy_version 1245005 (0.0008) [2023-12-26 09:36:09,700][123090] Updated weights for policy 1, policy_version 1245015 (0.0009) [2023-12-26 09:36:10,206][123091] Updated weights for policy 0, policy_version 1253813 (0.0010) [2023-12-26 09:36:10,273][123091] Updated weights for policy 0, policy_version 1253823 (0.0011) [2023-12-26 09:36:10,325][123091] Updated weights for policy 0, policy_version 1253833 (0.0011) [2023-12-26 09:36:10,538][123090] Updated weights for policy 1, policy_version 1245025 (0.0009) [2023-12-26 09:36:10,587][123090] Updated weights for policy 1, policy_version 1245035 (0.0009) [2023-12-26 09:36:10,656][123090] Updated weights for policy 1, policy_version 1245045 (0.0009) [2023-12-26 09:36:10,720][123090] Updated weights for policy 1, policy_version 1245055 (0.0009) [2023-12-26 09:36:11,211][123091] Updated weights for policy 0, policy_version 1253843 (0.0011) [2023-12-26 09:36:11,275][123091] Updated weights for policy 0, policy_version 1253853 (0.0010) [2023-12-26 09:36:11,330][123091] Updated weights for policy 0, policy_version 1253863 (0.0011) [2023-12-26 09:36:11,610][123090] Updated weights for policy 1, policy_version 1245065 (0.0009) [2023-12-26 09:36:11,680][123090] Updated weights for policy 1, policy_version 1245075 (0.0009) [2023-12-26 09:36:11,753][123090] Updated weights for policy 1, policy_version 1245085 (0.0010) [2023-12-26 09:36:12,178][123091] Updated weights for policy 0, policy_version 1253873 (0.0010) [2023-12-26 09:36:12,244][123091] Updated weights for policy 0, policy_version 1253883 (0.0009) [2023-12-26 09:36:12,312][123091] Updated weights for policy 0, policy_version 1253893 (0.0010) [2023-12-26 09:36:12,388][123091] Updated weights for policy 0, policy_version 1253903 (0.0008) [2023-12-26 09:36:12,591][123090] Updated weights for policy 1, policy_version 1245095 (0.0007) [2023-12-26 09:36:12,656][123090] Updated weights for policy 1, policy_version 1245105 (0.0008) [2023-12-26 09:36:12,726][123090] Updated weights for policy 1, policy_version 1245115 (0.0007) [2023-12-26 09:36:13,124][123091] Updated weights for policy 0, policy_version 1253913 (0.0010) [2023-12-26 09:36:13,182][123091] Updated weights for policy 0, policy_version 1253923 (0.0009) [2023-12-26 09:36:13,236][123091] Updated weights for policy 0, policy_version 1253933 (0.0010) [2023-12-26 09:36:13,510][123090] Updated weights for policy 1, policy_version 1245125 (0.0009) [2023-12-26 09:36:13,562][123090] Updated weights for policy 1, policy_version 1245135 (0.0009) [2023-12-26 09:36:13,610][123090] Updated weights for policy 1, policy_version 1245145 (0.0007) [2023-12-26 09:36:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 639770624. Throughput: 0: 8931.6, 1: 8919.4. Samples: 639763048. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:13,785][121949] Avg episode reward: [(0, '6192.151'), (1, '5791.949')] [2023-12-26 09:36:14,023][123091] Updated weights for policy 0, policy_version 1253943 (0.0007) [2023-12-26 09:36:14,069][123091] Updated weights for policy 0, policy_version 1253953 (0.0005) [2023-12-26 09:36:14,122][123091] Updated weights for policy 0, policy_version 1253963 (0.0005) [2023-12-26 09:36:14,553][123090] Updated weights for policy 1, policy_version 1245155 (0.0009) [2023-12-26 09:36:14,613][123090] Updated weights for policy 1, policy_version 1245165 (0.0010) [2023-12-26 09:36:14,678][123090] Updated weights for policy 1, policy_version 1245175 (0.0010) [2023-12-26 09:36:14,920][123091] Updated weights for policy 0, policy_version 1253973 (0.0008) [2023-12-26 09:36:14,991][123091] Updated weights for policy 0, policy_version 1253983 (0.0011) [2023-12-26 09:36:15,048][123091] Updated weights for policy 0, policy_version 1253993 (0.0011) [2023-12-26 09:36:15,417][123090] Updated weights for policy 1, policy_version 1245185 (0.0008) [2023-12-26 09:36:15,487][123090] Updated weights for policy 1, policy_version 1245195 (0.0005) [2023-12-26 09:36:15,561][123090] Updated weights for policy 1, policy_version 1245205 (0.0005) [2023-12-26 09:36:15,636][123090] Updated weights for policy 1, policy_version 1245215 (0.0010) [2023-12-26 09:36:15,857][123091] Updated weights for policy 0, policy_version 1254003 (0.0011) [2023-12-26 09:36:15,908][123091] Updated weights for policy 0, policy_version 1254013 (0.0010) [2023-12-26 09:36:15,960][123091] Updated weights for policy 0, policy_version 1254023 (0.0010) [2023-12-26 09:36:16,413][123090] Updated weights for policy 1, policy_version 1245225 (0.0008) [2023-12-26 09:36:16,468][123090] Updated weights for policy 1, policy_version 1245235 (0.0010) [2023-12-26 09:36:16,522][123090] Updated weights for policy 1, policy_version 1245245 (0.0010) [2023-12-26 09:36:16,608][123091] Updated weights for policy 0, policy_version 1254033 (0.0005) [2023-12-26 09:36:16,683][123091] Updated weights for policy 0, policy_version 1254043 (0.0005) [2023-12-26 09:36:16,753][123091] Updated weights for policy 0, policy_version 1254053 (0.0005) [2023-12-26 09:36:16,817][123091] Updated weights for policy 0, policy_version 1254063 (0.0005) [2023-12-26 09:36:17,354][123090] Updated weights for policy 1, policy_version 1245255 (0.0007) [2023-12-26 09:36:17,425][123090] Updated weights for policy 1, policy_version 1245265 (0.0009) [2023-12-26 09:36:17,482][123091] Updated weights for policy 0, policy_version 1254073 (0.0010) [2023-12-26 09:36:17,493][123090] Updated weights for policy 1, policy_version 1245275 (0.0006) [2023-12-26 09:36:17,540][123091] Updated weights for policy 0, policy_version 1254083 (0.0010) [2023-12-26 09:36:17,601][123091] Updated weights for policy 0, policy_version 1254093 (0.0006) [2023-12-26 09:36:18,275][123091] Updated weights for policy 0, policy_version 1254103 (0.0009) [2023-12-26 09:36:18,336][123090] Updated weights for policy 1, policy_version 1245285 (0.0006) [2023-12-26 09:36:18,342][123091] Updated weights for policy 0, policy_version 1254113 (0.0010) [2023-12-26 09:36:18,399][123090] Updated weights for policy 1, policy_version 1245295 (0.0006) [2023-12-26 09:36:18,408][123091] Updated weights for policy 0, policy_version 1254123 (0.0011) [2023-12-26 09:36:18,470][123090] Updated weights for policy 1, policy_version 1245305 (0.0006) [2023-12-26 09:36:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 639860736. Throughput: 0: 8984.0, 1: 8838.4. Samples: 639870548. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:18,785][121949] Avg episode reward: [(0, '6195.229'), (1, '5769.504')] [2023-12-26 09:36:19,141][123090] Updated weights for policy 1, policy_version 1245315 (0.0005) [2023-12-26 09:36:19,203][123090] Updated weights for policy 1, policy_version 1245325 (0.0006) [2023-12-26 09:36:19,220][123091] Updated weights for policy 0, policy_version 1254133 (0.0011) [2023-12-26 09:36:19,279][123090] Updated weights for policy 1, policy_version 1245335 (0.0007) [2023-12-26 09:36:19,282][123091] Updated weights for policy 0, policy_version 1254143 (0.0011) [2023-12-26 09:36:19,350][123091] Updated weights for policy 0, policy_version 1254153 (0.0011) [2023-12-26 09:36:20,100][123090] Updated weights for policy 1, policy_version 1245345 (0.0007) [2023-12-26 09:36:20,158][123090] Updated weights for policy 1, policy_version 1245355 (0.0009) [2023-12-26 09:36:20,220][123090] Updated weights for policy 1, policy_version 1245365 (0.0009) [2023-12-26 09:36:20,243][123091] Updated weights for policy 0, policy_version 1254163 (0.0011) [2023-12-26 09:36:20,288][123090] Updated weights for policy 1, policy_version 1245375 (0.0006) [2023-12-26 09:36:20,307][123091] Updated weights for policy 0, policy_version 1254173 (0.0011) [2023-12-26 09:36:20,367][123091] Updated weights for policy 0, policy_version 1254183 (0.0011) [2023-12-26 09:36:21,116][123090] Updated weights for policy 1, policy_version 1245385 (0.0007) [2023-12-26 09:36:21,191][123090] Updated weights for policy 1, policy_version 1245395 (0.0010) [2023-12-26 09:36:21,200][123091] Updated weights for policy 0, policy_version 1254193 (0.0010) [2023-12-26 09:36:21,258][123090] Updated weights for policy 1, policy_version 1245405 (0.0007) [2023-12-26 09:36:21,269][123091] Updated weights for policy 0, policy_version 1254203 (0.0008) [2023-12-26 09:36:21,332][123091] Updated weights for policy 0, policy_version 1254213 (0.0009) [2023-12-26 09:36:21,401][123091] Updated weights for policy 0, policy_version 1254223 (0.0010) [2023-12-26 09:36:22,051][123090] Updated weights for policy 1, policy_version 1245415 (0.0006) [2023-12-26 09:36:22,111][123090] Updated weights for policy 1, policy_version 1245425 (0.0006) [2023-12-26 09:36:22,169][123090] Updated weights for policy 1, policy_version 1245435 (0.0007) [2023-12-26 09:36:22,335][123091] Updated weights for policy 0, policy_version 1254233 (0.0009) [2023-12-26 09:36:22,402][123091] Updated weights for policy 0, policy_version 1254243 (0.0010) [2023-12-26 09:36:22,460][123091] Updated weights for policy 0, policy_version 1254253 (0.0009) [2023-12-26 09:36:22,979][123090] Updated weights for policy 1, policy_version 1245445 (0.0008) [2023-12-26 09:36:23,034][123090] Updated weights for policy 1, policy_version 1245455 (0.0010) [2023-12-26 09:36:23,094][123090] Updated weights for policy 1, policy_version 1245465 (0.0005) [2023-12-26 09:36:23,309][123091] Updated weights for policy 0, policy_version 1254263 (0.0009) [2023-12-26 09:36:23,366][123091] Updated weights for policy 0, policy_version 1254273 (0.0009) [2023-12-26 09:36:23,420][123091] Updated weights for policy 0, policy_version 1254283 (0.0009) [2023-12-26 09:36:23,785][121949] Fps is (10 sec: 17202.4, 60 sec: 17885.7, 300 sec: 17661.4). Total num frames: 639942656. Throughput: 0: 8930.1, 1: 8817.3. Samples: 639922172. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:23,786][121949] Avg episode reward: [(0, '6185.058'), (1, '5620.676')] [2023-12-26 09:36:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001254288_321101824.pth... [2023-12-26 09:36:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001245472_318840832.pth... [2023-12-26 09:36:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001253264_320839680.pth [2023-12-26 09:36:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001244448_318578688.pth [2023-12-26 09:36:23,916][123090] Updated weights for policy 1, policy_version 1245475 (0.0007) [2023-12-26 09:36:23,964][123090] Updated weights for policy 1, policy_version 1245485 (0.0008) [2023-12-26 09:36:24,019][123090] Updated weights for policy 1, policy_version 1245495 (0.0005) [2023-12-26 09:36:24,138][123091] Updated weights for policy 0, policy_version 1254293 (0.0007) [2023-12-26 09:36:24,222][123091] Updated weights for policy 0, policy_version 1254303 (0.0007) [2023-12-26 09:36:24,288][123091] Updated weights for policy 0, policy_version 1254313 (0.0008) [2023-12-26 09:36:24,741][123090] Updated weights for policy 1, policy_version 1245505 (0.0006) [2023-12-26 09:36:24,794][123090] Updated weights for policy 1, policy_version 1245515 (0.0009) [2023-12-26 09:36:24,850][123090] Updated weights for policy 1, policy_version 1245526 (0.0010) [2023-12-26 09:36:24,915][123090] Updated weights for policy 1, policy_version 1245536 (0.0009) [2023-12-26 09:36:24,971][123091] Updated weights for policy 0, policy_version 1254323 (0.0005) [2023-12-26 09:36:25,039][123091] Updated weights for policy 0, policy_version 1254333 (0.0006) [2023-12-26 09:36:25,092][123091] Updated weights for policy 0, policy_version 1254344 (0.0010) [2023-12-26 09:36:25,636][123090] Updated weights for policy 1, policy_version 1245546 (0.0010) [2023-12-26 09:36:25,691][123090] Updated weights for policy 1, policy_version 1245556 (0.0010) [2023-12-26 09:36:25,742][123090] Updated weights for policy 1, policy_version 1245566 (0.0010) [2023-12-26 09:36:25,850][123091] Updated weights for policy 0, policy_version 1254354 (0.0007) [2023-12-26 09:36:25,902][123091] Updated weights for policy 0, policy_version 1254364 (0.0010) [2023-12-26 09:36:25,960][123091] Updated weights for policy 0, policy_version 1254374 (0.0010) [2023-12-26 09:36:26,021][123091] Updated weights for policy 0, policy_version 1254384 (0.0008) [2023-12-26 09:36:26,544][123090] Updated weights for policy 1, policy_version 1245576 (0.0007) [2023-12-26 09:36:26,617][123090] Updated weights for policy 1, policy_version 1245586 (0.0007) [2023-12-26 09:36:26,688][123090] Updated weights for policy 1, policy_version 1245596 (0.0010) [2023-12-26 09:36:26,737][123091] Updated weights for policy 0, policy_version 1254394 (0.0005) [2023-12-26 09:36:26,789][123091] Updated weights for policy 0, policy_version 1254404 (0.0009) [2023-12-26 09:36:26,844][123091] Updated weights for policy 0, policy_version 1254414 (0.0010) [2023-12-26 09:36:27,390][123090] Updated weights for policy 1, policy_version 1245606 (0.0008) [2023-12-26 09:36:27,444][123090] Updated weights for policy 1, policy_version 1245616 (0.0005) [2023-12-26 09:36:27,509][123090] Updated weights for policy 1, policy_version 1245626 (0.0005) [2023-12-26 09:36:27,629][123091] Updated weights for policy 0, policy_version 1254424 (0.0006) [2023-12-26 09:36:27,691][123091] Updated weights for policy 0, policy_version 1254434 (0.0005) [2023-12-26 09:36:27,743][123091] Updated weights for policy 0, policy_version 1254444 (0.0005) [2023-12-26 09:36:28,201][123090] Updated weights for policy 1, policy_version 1245636 (0.0005) [2023-12-26 09:36:28,254][123090] Updated weights for policy 1, policy_version 1245646 (0.0005) [2023-12-26 09:36:28,312][123090] Updated weights for policy 1, policy_version 1245656 (0.0007) [2023-12-26 09:36:28,424][123091] Updated weights for policy 0, policy_version 1254454 (0.0008) [2023-12-26 09:36:28,487][123091] Updated weights for policy 0, policy_version 1254464 (0.0009) [2023-12-26 09:36:28,550][123091] Updated weights for policy 0, policy_version 1254474 (0.0009) [2023-12-26 09:36:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 640040960. Throughput: 0: 8977.6, 1: 8916.5. Samples: 640032044. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:28,785][121949] Avg episode reward: [(0, '6231.891'), (1, '5604.395')] [2023-12-26 09:36:29,025][123090] Updated weights for policy 1, policy_version 1245666 (0.0008) [2023-12-26 09:36:29,096][123090] Updated weights for policy 1, policy_version 1245676 (0.0005) [2023-12-26 09:36:29,165][123090] Updated weights for policy 1, policy_version 1245686 (0.0008) [2023-12-26 09:36:29,230][123090] Updated weights for policy 1, policy_version 1245696 (0.0009) [2023-12-26 09:36:29,430][123091] Updated weights for policy 0, policy_version 1254484 (0.0010) [2023-12-26 09:36:29,493][123091] Updated weights for policy 0, policy_version 1254494 (0.0009) [2023-12-26 09:36:29,557][123091] Updated weights for policy 0, policy_version 1254504 (0.0010) [2023-12-26 09:36:29,979][123090] Updated weights for policy 1, policy_version 1245706 (0.0009) [2023-12-26 09:36:30,041][123090] Updated weights for policy 1, policy_version 1245716 (0.0008) [2023-12-26 09:36:30,102][123090] Updated weights for policy 1, policy_version 1245726 (0.0005) [2023-12-26 09:36:30,342][123091] Updated weights for policy 0, policy_version 1254514 (0.0008) [2023-12-26 09:36:30,405][123091] Updated weights for policy 0, policy_version 1254524 (0.0006) [2023-12-26 09:36:30,476][123091] Updated weights for policy 0, policy_version 1254534 (0.0005) [2023-12-26 09:36:30,549][123091] Updated weights for policy 0, policy_version 1254544 (0.0006) [2023-12-26 09:36:30,742][123090] Updated weights for policy 1, policy_version 1245736 (0.0005) [2023-12-26 09:36:30,789][123090] Updated weights for policy 1, policy_version 1245746 (0.0005) [2023-12-26 09:36:30,835][123090] Updated weights for policy 1, policy_version 1245756 (0.0005) [2023-12-26 09:36:31,194][123091] Updated weights for policy 0, policy_version 1254554 (0.0008) [2023-12-26 09:36:31,257][123091] Updated weights for policy 0, policy_version 1254564 (0.0007) [2023-12-26 09:36:31,329][123091] Updated weights for policy 0, policy_version 1254574 (0.0008) [2023-12-26 09:36:31,569][123090] Updated weights for policy 1, policy_version 1245766 (0.0008) [2023-12-26 09:36:31,629][123090] Updated weights for policy 1, policy_version 1245776 (0.0010) [2023-12-26 09:36:31,691][123090] Updated weights for policy 1, policy_version 1245786 (0.0010) [2023-12-26 09:36:32,093][123091] Updated weights for policy 0, policy_version 1254584 (0.0008) [2023-12-26 09:36:32,153][123091] Updated weights for policy 0, policy_version 1254594 (0.0009) [2023-12-26 09:36:32,212][123091] Updated weights for policy 0, policy_version 1254604 (0.0009) [2023-12-26 09:36:32,530][123090] Updated weights for policy 1, policy_version 1245796 (0.0014) [2023-12-26 09:36:32,593][123090] Updated weights for policy 1, policy_version 1245806 (0.0010) [2023-12-26 09:36:32,655][123090] Updated weights for policy 1, policy_version 1245816 (0.0010) [2023-12-26 09:36:32,989][123091] Updated weights for policy 0, policy_version 1254614 (0.0007) [2023-12-26 09:36:33,038][123091] Updated weights for policy 0, policy_version 1254624 (0.0005) [2023-12-26 09:36:33,089][123091] Updated weights for policy 0, policy_version 1254634 (0.0005) [2023-12-26 09:36:33,404][123090] Updated weights for policy 1, policy_version 1245826 (0.0009) [2023-12-26 09:36:33,453][123090] Updated weights for policy 1, policy_version 1245836 (0.0005) [2023-12-26 09:36:33,499][123090] Updated weights for policy 1, policy_version 1245846 (0.0005) [2023-12-26 09:36:33,545][123090] Updated weights for policy 1, policy_version 1245856 (0.0005) [2023-12-26 09:36:33,784][121949] Fps is (10 sec: 18842.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 640131072. Throughput: 0: 8960.1, 1: 9028.9. Samples: 640143760. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:33,785][121949] Avg episode reward: [(0, '6307.931'), (1, '5662.822')] [2023-12-26 09:36:33,883][123091] Updated weights for policy 0, policy_version 1254644 (0.0007) [2023-12-26 09:36:33,926][123091] Updated weights for policy 0, policy_version 1254654 (0.0010) [2023-12-26 09:36:33,974][123091] Updated weights for policy 0, policy_version 1254664 (0.0010) [2023-12-26 09:36:34,197][123090] Updated weights for policy 1, policy_version 1245866 (0.0011) [2023-12-26 09:36:34,269][123090] Updated weights for policy 1, policy_version 1245876 (0.0011) [2023-12-26 09:36:34,337][123090] Updated weights for policy 1, policy_version 1245886 (0.0010) [2023-12-26 09:36:34,811][123091] Updated weights for policy 0, policy_version 1254674 (0.0010) [2023-12-26 09:36:34,870][123091] Updated weights for policy 0, policy_version 1254684 (0.0009) [2023-12-26 09:36:34,935][123091] Updated weights for policy 0, policy_version 1254694 (0.0009) [2023-12-26 09:36:34,999][123091] Updated weights for policy 0, policy_version 1254704 (0.0008) [2023-12-26 09:36:35,166][123090] Updated weights for policy 1, policy_version 1245896 (0.0009) [2023-12-26 09:36:35,229][123090] Updated weights for policy 1, policy_version 1245906 (0.0005) [2023-12-26 09:36:35,284][123090] Updated weights for policy 1, policy_version 1245916 (0.0005) [2023-12-26 09:36:35,838][123091] Updated weights for policy 0, policy_version 1254714 (0.0009) [2023-12-26 09:36:35,898][123091] Updated weights for policy 0, policy_version 1254724 (0.0007) [2023-12-26 09:36:35,953][123090] Updated weights for policy 1, policy_version 1245926 (0.0005) [2023-12-26 09:36:35,977][123091] Updated weights for policy 0, policy_version 1254734 (0.0005) [2023-12-26 09:36:36,011][123090] Updated weights for policy 1, policy_version 1245936 (0.0007) [2023-12-26 09:36:36,061][123090] Updated weights for policy 1, policy_version 1245946 (0.0009) [2023-12-26 09:36:36,768][123091] Updated weights for policy 0, policy_version 1254744 (0.0009) [2023-12-26 09:36:36,826][123091] Updated weights for policy 0, policy_version 1254754 (0.0007) [2023-12-26 09:36:36,862][123090] Updated weights for policy 1, policy_version 1245956 (0.0009) [2023-12-26 09:36:36,893][123091] Updated weights for policy 0, policy_version 1254764 (0.0007) [2023-12-26 09:36:36,925][123090] Updated weights for policy 1, policy_version 1245966 (0.0006) [2023-12-26 09:36:36,976][123090] Updated weights for policy 1, policy_version 1245976 (0.0008) [2023-12-26 09:36:37,682][123090] Updated weights for policy 1, policy_version 1245986 (0.0006) [2023-12-26 09:36:37,740][123090] Updated weights for policy 1, policy_version 1245996 (0.0006) [2023-12-26 09:36:37,768][123091] Updated weights for policy 0, policy_version 1254774 (0.0007) [2023-12-26 09:36:37,810][123090] Updated weights for policy 1, policy_version 1246006 (0.0010) [2023-12-26 09:36:37,822][123091] Updated weights for policy 0, policy_version 1254784 (0.0008) [2023-12-26 09:36:37,872][123091] Updated weights for policy 0, policy_version 1254794 (0.0009) [2023-12-26 09:36:37,874][123090] Updated weights for policy 1, policy_version 1246016 (0.0011) [2023-12-26 09:36:38,556][123090] Updated weights for policy 1, policy_version 1246026 (0.0006) [2023-12-26 09:36:38,619][123090] Updated weights for policy 1, policy_version 1246036 (0.0005) [2023-12-26 09:36:38,677][123090] Updated weights for policy 1, policy_version 1246046 (0.0005) [2023-12-26 09:36:38,711][123091] Updated weights for policy 0, policy_version 1254804 (0.0008) [2023-12-26 09:36:38,768][123091] Updated weights for policy 0, policy_version 1254814 (0.0009) [2023-12-26 09:36:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 640221184. Throughput: 0: 8936.9, 1: 9027.3. Samples: 640197252. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:38,785][121949] Avg episode reward: [(0, '6297.723'), (1, '5465.083')] [2023-12-26 09:36:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001246048_318988288.pth... [2023-12-26 09:36:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001244992_318717952.pth [2023-12-26 09:36:38,821][123091] Updated weights for policy 0, policy_version 1254824 (0.0010) [2023-12-26 09:36:38,864][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001254832_321241088.pth... [2023-12-26 09:36:38,867][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001253776_320970752.pth [2023-12-26 09:36:39,397][123090] Updated weights for policy 1, policy_version 1246056 (0.0008) [2023-12-26 09:36:39,471][123090] Updated weights for policy 1, policy_version 1246066 (0.0009) [2023-12-26 09:36:39,534][123090] Updated weights for policy 1, policy_version 1246076 (0.0009) [2023-12-26 09:36:39,779][123091] Updated weights for policy 0, policy_version 1254834 (0.0009) [2023-12-26 09:36:39,845][123091] Updated weights for policy 0, policy_version 1254844 (0.0009) [2023-12-26 09:36:39,899][123091] Updated weights for policy 0, policy_version 1254854 (0.0009) [2023-12-26 09:36:39,957][123091] Updated weights for policy 0, policy_version 1254864 (0.0009) [2023-12-26 09:36:40,408][123090] Updated weights for policy 1, policy_version 1246086 (0.0009) [2023-12-26 09:36:40,464][123090] Updated weights for policy 1, policy_version 1246096 (0.0011) [2023-12-26 09:36:40,524][123090] Updated weights for policy 1, policy_version 1246106 (0.0010) [2023-12-26 09:36:40,726][123091] Updated weights for policy 0, policy_version 1254874 (0.0005) [2023-12-26 09:36:40,792][123091] Updated weights for policy 0, policy_version 1254884 (0.0008) [2023-12-26 09:36:40,852][123091] Updated weights for policy 0, policy_version 1254894 (0.0009) [2023-12-26 09:36:41,367][123090] Updated weights for policy 1, policy_version 1246116 (0.0010) [2023-12-26 09:36:41,449][123090] Updated weights for policy 1, policy_version 1246126 (0.0008) [2023-12-26 09:36:41,520][123090] Updated weights for policy 1, policy_version 1246136 (0.0009) [2023-12-26 09:36:41,693][123091] Updated weights for policy 0, policy_version 1254904 (0.0009) [2023-12-26 09:36:41,766][123091] Updated weights for policy 0, policy_version 1254914 (0.0010) [2023-12-26 09:36:41,828][123091] Updated weights for policy 0, policy_version 1254924 (0.0009) [2023-12-26 09:36:42,285][123090] Updated weights for policy 1, policy_version 1246146 (0.0007) [2023-12-26 09:36:42,356][123090] Updated weights for policy 1, policy_version 1246156 (0.0009) [2023-12-26 09:36:42,426][123090] Updated weights for policy 1, policy_version 1246166 (0.0010) [2023-12-26 09:36:42,491][123090] Updated weights for policy 1, policy_version 1246176 (0.0008) [2023-12-26 09:36:42,739][123091] Updated weights for policy 0, policy_version 1254934 (0.0010) [2023-12-26 09:36:42,802][123091] Updated weights for policy 0, policy_version 1254944 (0.0010) [2023-12-26 09:36:42,869][123091] Updated weights for policy 0, policy_version 1254954 (0.0010) [2023-12-26 09:36:43,178][123090] Updated weights for policy 1, policy_version 1246186 (0.0005) [2023-12-26 09:36:43,243][123090] Updated weights for policy 1, policy_version 1246196 (0.0005) [2023-12-26 09:36:43,307][123090] Updated weights for policy 1, policy_version 1246206 (0.0005) [2023-12-26 09:36:43,732][123091] Updated weights for policy 0, policy_version 1254964 (0.0007) [2023-12-26 09:36:43,784][123091] Updated weights for policy 0, policy_version 1254974 (0.0005) [2023-12-26 09:36:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 640303104. Throughput: 0: 8829.8, 1: 8988.4. Samples: 640300672. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:43,785][121949] Avg episode reward: [(0, '6263.939'), (1, '5289.754')] [2023-12-26 09:36:43,844][123091] Updated weights for policy 0, policy_version 1254984 (0.0006) [2023-12-26 09:36:43,922][123090] Updated weights for policy 1, policy_version 1246216 (0.0006) [2023-12-26 09:36:43,992][123090] Updated weights for policy 1, policy_version 1246226 (0.0005) [2023-12-26 09:36:44,060][123090] Updated weights for policy 1, policy_version 1246236 (0.0005) [2023-12-26 09:36:44,591][123091] Updated weights for policy 0, policy_version 1254994 (0.0006) [2023-12-26 09:36:44,660][123091] Updated weights for policy 0, policy_version 1255004 (0.0009) [2023-12-26 09:36:44,727][123091] Updated weights for policy 0, policy_version 1255014 (0.0011) [2023-12-26 09:36:44,729][123090] Updated weights for policy 1, policy_version 1246246 (0.0006) [2023-12-26 09:36:44,796][123091] Updated weights for policy 0, policy_version 1255024 (0.0011) [2023-12-26 09:36:44,799][123090] Updated weights for policy 1, policy_version 1246256 (0.0007) [2023-12-26 09:36:44,867][123090] Updated weights for policy 1, policy_version 1246266 (0.0005) [2023-12-26 09:36:45,493][123091] Updated weights for policy 0, policy_version 1255034 (0.0007) [2023-12-26 09:36:45,561][123091] Updated weights for policy 0, policy_version 1255044 (0.0008) [2023-12-26 09:36:45,626][123091] Updated weights for policy 0, policy_version 1255054 (0.0006) [2023-12-26 09:36:45,632][123090] Updated weights for policy 1, policy_version 1246276 (0.0009) [2023-12-26 09:36:45,699][123090] Updated weights for policy 1, policy_version 1246286 (0.0011) [2023-12-26 09:36:45,770][123090] Updated weights for policy 1, policy_version 1246296 (0.0011) [2023-12-26 09:36:46,387][123091] Updated weights for policy 0, policy_version 1255064 (0.0010) [2023-12-26 09:36:46,455][123091] Updated weights for policy 0, policy_version 1255074 (0.0007) [2023-12-26 09:36:46,516][123091] Updated weights for policy 0, policy_version 1255084 (0.0005) [2023-12-26 09:36:46,529][123090] Updated weights for policy 1, policy_version 1246306 (0.0011) [2023-12-26 09:36:46,599][123090] Updated weights for policy 1, policy_version 1246316 (0.0011) [2023-12-26 09:36:46,670][123090] Updated weights for policy 1, policy_version 1246326 (0.0011) [2023-12-26 09:36:46,726][123090] Updated weights for policy 1, policy_version 1246336 (0.0010) [2023-12-26 09:36:47,132][123091] Updated weights for policy 0, policy_version 1255094 (0.0006) [2023-12-26 09:36:47,182][123091] Updated weights for policy 0, policy_version 1255104 (0.0010) [2023-12-26 09:36:47,229][123091] Updated weights for policy 0, policy_version 1255114 (0.0010) [2023-12-26 09:36:47,478][123090] Updated weights for policy 1, policy_version 1246346 (0.0009) [2023-12-26 09:36:47,535][123090] Updated weights for policy 1, policy_version 1246356 (0.0009) [2023-12-26 09:36:47,584][123090] Updated weights for policy 1, policy_version 1246366 (0.0009) [2023-12-26 09:36:48,048][123091] Updated weights for policy 0, policy_version 1255124 (0.0008) [2023-12-26 09:36:48,122][123091] Updated weights for policy 0, policy_version 1255134 (0.0005) [2023-12-26 09:36:48,186][123091] Updated weights for policy 0, policy_version 1255144 (0.0006) [2023-12-26 09:36:48,364][123090] Updated weights for policy 1, policy_version 1246376 (0.0008) [2023-12-26 09:36:48,427][123090] Updated weights for policy 1, policy_version 1246386 (0.0008) [2023-12-26 09:36:48,493][123090] Updated weights for policy 1, policy_version 1246396 (0.0008) [2023-12-26 09:36:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 640401408. Throughput: 0: 8850.7, 1: 9057.9. Samples: 640412468. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:48,785][121949] Avg episode reward: [(0, '6189.065'), (1, '5470.655')] [2023-12-26 09:36:48,922][123091] Updated weights for policy 0, policy_version 1255154 (0.0006) [2023-12-26 09:36:48,992][123091] Updated weights for policy 0, policy_version 1255164 (0.0011) [2023-12-26 09:36:49,055][123091] Updated weights for policy 0, policy_version 1255174 (0.0011) [2023-12-26 09:36:49,118][123091] Updated weights for policy 0, policy_version 1255184 (0.0011) [2023-12-26 09:36:49,179][123090] Updated weights for policy 1, policy_version 1246406 (0.0007) [2023-12-26 09:36:49,249][123090] Updated weights for policy 1, policy_version 1246416 (0.0007) [2023-12-26 09:36:49,307][123090] Updated weights for policy 1, policy_version 1246426 (0.0010) [2023-12-26 09:36:49,922][123091] Updated weights for policy 0, policy_version 1255194 (0.0009) [2023-12-26 09:36:49,984][123091] Updated weights for policy 0, policy_version 1255204 (0.0009) [2023-12-26 09:36:50,048][123091] Updated weights for policy 0, policy_version 1255214 (0.0009) [2023-12-26 09:36:50,141][123090] Updated weights for policy 1, policy_version 1246436 (0.0010) [2023-12-26 09:36:50,213][123090] Updated weights for policy 1, policy_version 1246446 (0.0011) [2023-12-26 09:36:50,285][123090] Updated weights for policy 1, policy_version 1246456 (0.0011) [2023-12-26 09:36:50,873][123091] Updated weights for policy 0, policy_version 1255224 (0.0009) [2023-12-26 09:36:50,922][123091] Updated weights for policy 0, policy_version 1255234 (0.0009) [2023-12-26 09:36:50,987][123091] Updated weights for policy 0, policy_version 1255244 (0.0009) [2023-12-26 09:36:51,111][123090] Updated weights for policy 1, policy_version 1246466 (0.0010) [2023-12-26 09:36:51,174][123090] Updated weights for policy 1, policy_version 1246476 (0.0011) [2023-12-26 09:36:51,238][123090] Updated weights for policy 1, policy_version 1246486 (0.0010) [2023-12-26 09:36:51,293][123090] Updated weights for policy 1, policy_version 1246496 (0.0010) [2023-12-26 09:36:51,869][123091] Updated weights for policy 0, policy_version 1255254 (0.0008) [2023-12-26 09:36:51,933][123091] Updated weights for policy 0, policy_version 1255264 (0.0006) [2023-12-26 09:36:52,002][123091] Updated weights for policy 0, policy_version 1255274 (0.0006) [2023-12-26 09:36:52,131][123090] Updated weights for policy 1, policy_version 1246506 (0.0011) [2023-12-26 09:36:52,187][123090] Updated weights for policy 1, policy_version 1246516 (0.0011) [2023-12-26 09:36:52,241][123090] Updated weights for policy 1, policy_version 1246526 (0.0010) [2023-12-26 09:36:52,756][123091] Updated weights for policy 0, policy_version 1255284 (0.0005) [2023-12-26 09:36:52,815][123091] Updated weights for policy 0, policy_version 1255294 (0.0005) [2023-12-26 09:36:52,869][123091] Updated weights for policy 0, policy_version 1255304 (0.0005) [2023-12-26 09:36:52,994][123090] Updated weights for policy 1, policy_version 1246536 (0.0009) [2023-12-26 09:36:53,054][123090] Updated weights for policy 1, policy_version 1246546 (0.0009) [2023-12-26 09:36:53,129][123090] Updated weights for policy 1, policy_version 1246556 (0.0009) [2023-12-26 09:36:53,541][123091] Updated weights for policy 0, policy_version 1255314 (0.0005) [2023-12-26 09:36:53,592][123091] Updated weights for policy 0, policy_version 1255324 (0.0005) [2023-12-26 09:36:53,642][123091] Updated weights for policy 0, policy_version 1255334 (0.0005) [2023-12-26 09:36:53,699][123091] Updated weights for policy 0, policy_version 1255344 (0.0005) [2023-12-26 09:36:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 640491520. Throughput: 0: 8822.1, 1: 9035.7. Samples: 640464132. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:53,786][121949] Avg episode reward: [(0, '6154.953'), (1, '5686.306')] [2023-12-26 09:36:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001255344_321372160.pth... [2023-12-26 09:36:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001254288_321101824.pth [2023-12-26 09:36:53,804][123090] Updated weights for policy 1, policy_version 1246566 (0.0007) [2023-12-26 09:36:53,858][123090] Updated weights for policy 1, policy_version 1246576 (0.0005) [2023-12-26 09:36:53,920][123090] Updated weights for policy 1, policy_version 1246586 (0.0005) [2023-12-26 09:36:53,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001246592_319127552.pth... [2023-12-26 09:36:53,965][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001245472_318840832.pth [2023-12-26 09:36:54,351][123091] Updated weights for policy 0, policy_version 1255354 (0.0007) [2023-12-26 09:36:54,406][123091] Updated weights for policy 0, policy_version 1255364 (0.0011) [2023-12-26 09:36:54,476][123091] Updated weights for policy 0, policy_version 1255374 (0.0009) [2023-12-26 09:36:54,687][123090] Updated weights for policy 1, policy_version 1246596 (0.0007) [2023-12-26 09:36:54,740][123090] Updated weights for policy 1, policy_version 1246606 (0.0009) [2023-12-26 09:36:54,789][123090] Updated weights for policy 1, policy_version 1246616 (0.0009) [2023-12-26 09:36:55,293][123091] Updated weights for policy 0, policy_version 1255384 (0.0011) [2023-12-26 09:36:55,357][123091] Updated weights for policy 0, policy_version 1255394 (0.0011) [2023-12-26 09:36:55,431][123091] Updated weights for policy 0, policy_version 1255404 (0.0011) [2023-12-26 09:36:55,616][123090] Updated weights for policy 1, policy_version 1246626 (0.0008) [2023-12-26 09:36:55,660][123090] Updated weights for policy 1, policy_version 1246636 (0.0005) [2023-12-26 09:36:55,710][123090] Updated weights for policy 1, policy_version 1246646 (0.0005) [2023-12-26 09:36:55,778][123090] Updated weights for policy 1, policy_version 1246656 (0.0005) [2023-12-26 09:36:56,242][123091] Updated weights for policy 0, policy_version 1255414 (0.0008) [2023-12-26 09:36:56,307][123091] Updated weights for policy 0, policy_version 1255424 (0.0005) [2023-12-26 09:36:56,371][123091] Updated weights for policy 0, policy_version 1255434 (0.0006) [2023-12-26 09:36:56,427][123090] Updated weights for policy 1, policy_version 1246666 (0.0005) [2023-12-26 09:36:56,480][123090] Updated weights for policy 1, policy_version 1246676 (0.0005) [2023-12-26 09:36:56,526][123090] Updated weights for policy 1, policy_version 1246686 (0.0005) [2023-12-26 09:36:56,981][123091] Updated weights for policy 0, policy_version 1255444 (0.0007) [2023-12-26 09:36:57,037][123091] Updated weights for policy 0, policy_version 1255454 (0.0009) [2023-12-26 09:36:57,100][123091] Updated weights for policy 0, policy_version 1255464 (0.0010) [2023-12-26 09:36:57,237][123090] Updated weights for policy 1, policy_version 1246696 (0.0009) [2023-12-26 09:36:57,291][123090] Updated weights for policy 1, policy_version 1246706 (0.0010) [2023-12-26 09:36:57,348][123090] Updated weights for policy 1, policy_version 1246716 (0.0008) [2023-12-26 09:36:57,988][123091] Updated weights for policy 0, policy_version 1255474 (0.0010) [2023-12-26 09:36:58,050][123091] Updated weights for policy 0, policy_version 1255484 (0.0010) [2023-12-26 09:36:58,096][123090] Updated weights for policy 1, policy_version 1246726 (0.0009) [2023-12-26 09:36:58,109][123091] Updated weights for policy 0, policy_version 1255494 (0.0009) [2023-12-26 09:36:58,158][123090] Updated weights for policy 1, policy_version 1246736 (0.0007) [2023-12-26 09:36:58,160][123091] Updated weights for policy 0, policy_version 1255504 (0.0008) [2023-12-26 09:36:58,212][123090] Updated weights for policy 1, policy_version 1246746 (0.0009) [2023-12-26 09:36:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.6, 300 sec: 17689.2). Total num frames: 640581632. Throughput: 0: 8935.7, 1: 9163.2. Samples: 640577496. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:36:58,785][121949] Avg episode reward: [(0, '6264.418'), (1, '5724.038')] [2023-12-26 09:36:59,059][123091] Updated weights for policy 0, policy_version 1255514 (0.0010) [2023-12-26 09:36:59,118][123091] Updated weights for policy 0, policy_version 1255524 (0.0010) [2023-12-26 09:36:59,147][123090] Updated weights for policy 1, policy_version 1246756 (0.0009) [2023-12-26 09:36:59,183][123091] Updated weights for policy 0, policy_version 1255534 (0.0007) [2023-12-26 09:36:59,208][123090] Updated weights for policy 1, policy_version 1246766 (0.0009) [2023-12-26 09:36:59,291][123090] Updated weights for policy 1, policy_version 1246776 (0.0010) [2023-12-26 09:36:59,997][123091] Updated weights for policy 0, policy_version 1255544 (0.0008) [2023-12-26 09:37:00,051][123090] Updated weights for policy 1, policy_version 1246786 (0.0007) [2023-12-26 09:37:00,059][123091] Updated weights for policy 0, policy_version 1255554 (0.0008) [2023-12-26 09:37:00,105][123090] Updated weights for policy 1, policy_version 1246796 (0.0008) [2023-12-26 09:37:00,107][123091] Updated weights for policy 0, policy_version 1255564 (0.0008) [2023-12-26 09:37:00,160][123090] Updated weights for policy 1, policy_version 1246806 (0.0008) [2023-12-26 09:37:00,210][123090] Updated weights for policy 1, policy_version 1246816 (0.0008) [2023-12-26 09:37:00,861][123090] Updated weights for policy 1, policy_version 1246826 (0.0005) [2023-12-26 09:37:00,918][123090] Updated weights for policy 1, policy_version 1246836 (0.0008) [2023-12-26 09:37:00,958][123091] Updated weights for policy 0, policy_version 1255574 (0.0006) [2023-12-26 09:37:00,980][123090] Updated weights for policy 1, policy_version 1246846 (0.0010) [2023-12-26 09:37:01,011][123091] Updated weights for policy 0, policy_version 1255584 (0.0008) [2023-12-26 09:37:01,073][123091] Updated weights for policy 0, policy_version 1255594 (0.0009) [2023-12-26 09:37:01,781][123090] Updated weights for policy 1, policy_version 1246856 (0.0010) [2023-12-26 09:37:01,858][123090] Updated weights for policy 1, policy_version 1246866 (0.0011) [2023-12-26 09:37:01,885][123091] Updated weights for policy 0, policy_version 1255604 (0.0009) [2023-12-26 09:37:01,922][123090] Updated weights for policy 1, policy_version 1246876 (0.0010) [2023-12-26 09:37:01,937][123091] Updated weights for policy 0, policy_version 1255614 (0.0005) [2023-12-26 09:37:01,983][123091] Updated weights for policy 0, policy_version 1255624 (0.0008) [2023-12-26 09:37:02,717][123090] Updated weights for policy 1, policy_version 1246886 (0.0010) [2023-12-26 09:37:02,782][123090] Updated weights for policy 1, policy_version 1246896 (0.0010) [2023-12-26 09:37:02,831][123091] Updated weights for policy 0, policy_version 1255634 (0.0008) [2023-12-26 09:37:02,841][123090] Updated weights for policy 1, policy_version 1246906 (0.0010) [2023-12-26 09:37:02,878][123091] Updated weights for policy 0, policy_version 1255644 (0.0006) [2023-12-26 09:37:02,930][123091] Updated weights for policy 0, policy_version 1255654 (0.0009) [2023-12-26 09:37:02,986][123091] Updated weights for policy 0, policy_version 1255664 (0.0010) [2023-12-26 09:37:03,634][123090] Updated weights for policy 1, policy_version 1246916 (0.0008) [2023-12-26 09:37:03,680][123090] Updated weights for policy 1, policy_version 1246926 (0.0007) [2023-12-26 09:37:03,731][123090] Updated weights for policy 1, policy_version 1246937 (0.0009) [2023-12-26 09:37:03,733][123091] Updated weights for policy 0, policy_version 1255674 (0.0005) [2023-12-26 09:37:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.3, 300 sec: 17689.2). Total num frames: 640671744. Throughput: 0: 8818.4, 1: 9214.3. Samples: 640682020. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:37:03,785][121949] Avg episode reward: [(0, '6243.090'), (1, '5740.245')] [2023-12-26 09:37:03,798][123091] Updated weights for policy 0, policy_version 1255684 (0.0005) [2023-12-26 09:37:03,868][123091] Updated weights for policy 0, policy_version 1255694 (0.0007) [2023-12-26 09:37:04,577][123090] Updated weights for policy 1, policy_version 1246947 (0.0009) [2023-12-26 09:37:04,633][123090] Updated weights for policy 1, policy_version 1246957 (0.0010) [2023-12-26 09:37:04,635][123091] Updated weights for policy 0, policy_version 1255704 (0.0007) [2023-12-26 09:37:04,689][123091] Updated weights for policy 0, policy_version 1255714 (0.0007) [2023-12-26 09:37:04,693][123090] Updated weights for policy 1, policy_version 1246967 (0.0010) [2023-12-26 09:37:04,742][123091] Updated weights for policy 0, policy_version 1255724 (0.0007) [2023-12-26 09:37:05,503][123090] Updated weights for policy 1, policy_version 1246977 (0.0010) [2023-12-26 09:37:05,573][123090] Updated weights for policy 1, policy_version 1246987 (0.0005) [2023-12-26 09:37:05,606][123091] Updated weights for policy 0, policy_version 1255734 (0.0009) [2023-12-26 09:37:05,645][123090] Updated weights for policy 1, policy_version 1246997 (0.0006) [2023-12-26 09:37:05,655][123091] Updated weights for policy 0, policy_version 1255744 (0.0008) [2023-12-26 09:37:05,714][123091] Updated weights for policy 0, policy_version 1255754 (0.0009) [2023-12-26 09:37:05,716][123090] Updated weights for policy 1, policy_version 1247007 (0.0005) [2023-12-26 09:37:06,502][123090] Updated weights for policy 1, policy_version 1247017 (0.0008) [2023-12-26 09:37:06,540][123091] Updated weights for policy 0, policy_version 1255764 (0.0009) [2023-12-26 09:37:06,559][123090] Updated weights for policy 1, policy_version 1247027 (0.0007) [2023-12-26 09:37:06,600][123091] Updated weights for policy 0, policy_version 1255774 (0.0010) [2023-12-26 09:37:06,621][123090] Updated weights for policy 1, policy_version 1247037 (0.0006) [2023-12-26 09:37:06,654][123091] Updated weights for policy 0, policy_version 1255784 (0.0011) [2023-12-26 09:37:07,485][123091] Updated weights for policy 0, policy_version 1255794 (0.0010) [2023-12-26 09:37:07,485][123090] Updated weights for policy 1, policy_version 1247047 (0.0008) [2023-12-26 09:37:07,538][123091] Updated weights for policy 0, policy_version 1255804 (0.0010) [2023-12-26 09:37:07,547][123090] Updated weights for policy 1, policy_version 1247057 (0.0010) [2023-12-26 09:37:07,585][123091] Updated weights for policy 0, policy_version 1255814 (0.0005) [2023-12-26 09:37:07,610][123090] Updated weights for policy 1, policy_version 1247067 (0.0009) [2023-12-26 09:37:07,648][123091] Updated weights for policy 0, policy_version 1255824 (0.0008) [2023-12-26 09:37:08,234][123090] Updated weights for policy 1, policy_version 1247077 (0.0005) [2023-12-26 09:37:08,286][123090] Updated weights for policy 1, policy_version 1247087 (0.0005) [2023-12-26 09:37:08,348][123090] Updated weights for policy 1, policy_version 1247097 (0.0006) [2023-12-26 09:37:08,422][123091] Updated weights for policy 0, policy_version 1255834 (0.0010) [2023-12-26 09:37:08,477][123091] Updated weights for policy 0, policy_version 1255844 (0.0011) [2023-12-26 09:37:08,541][123091] Updated weights for policy 0, policy_version 1255854 (0.0011) [2023-12-26 09:37:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 640761856. Throughput: 0: 8851.7, 1: 9196.9. Samples: 640734352. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 09:37:08,785][121949] Avg episode reward: [(0, '6343.590'), (1, '5754.072')] [2023-12-26 09:37:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001247104_319258624.pth... [2023-12-26 09:37:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001255856_321503232.pth... [2023-12-26 09:37:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001246048_318988288.pth [2023-12-26 09:37:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001254832_321241088.pth [2023-12-26 09:37:09,149][123091] Updated weights for policy 0, policy_version 1255864 (0.0006) [2023-12-26 09:37:09,203][123090] Updated weights for policy 1, policy_version 1247107 (0.0007) [2023-12-26 09:37:09,218][123091] Updated weights for policy 0, policy_version 1255874 (0.0006) [2023-12-26 09:37:09,266][123090] Updated weights for policy 1, policy_version 1247117 (0.0007) [2023-12-26 09:37:09,285][123091] Updated weights for policy 0, policy_version 1255884 (0.0010) [2023-12-26 09:37:09,332][123090] Updated weights for policy 1, policy_version 1247127 (0.0009) [2023-12-26 09:37:09,997][123091] Updated weights for policy 0, policy_version 1255894 (0.0007) [2023-12-26 09:37:10,071][123091] Updated weights for policy 0, policy_version 1255904 (0.0008) [2023-12-26 09:37:10,137][123091] Updated weights for policy 0, policy_version 1255914 (0.0008) [2023-12-26 09:37:10,234][123090] Updated weights for policy 1, policy_version 1247137 (0.0009) [2023-12-26 09:37:10,286][123090] Updated weights for policy 1, policy_version 1247147 (0.0009) [2023-12-26 09:37:10,346][123090] Updated weights for policy 1, policy_version 1247157 (0.0010) [2023-12-26 09:37:10,407][123090] Updated weights for policy 1, policy_version 1247167 (0.0010) [2023-12-26 09:37:10,829][123091] Updated weights for policy 0, policy_version 1255924 (0.0007) [2023-12-26 09:37:10,894][123091] Updated weights for policy 0, policy_version 1255934 (0.0005) [2023-12-26 09:37:10,946][123091] Updated weights for policy 0, policy_version 1255944 (0.0006) [2023-12-26 09:37:11,302][123090] Updated weights for policy 1, policy_version 1247177 (0.0008) [2023-12-26 09:37:11,374][123090] Updated weights for policy 1, policy_version 1247187 (0.0009) [2023-12-26 09:37:11,441][123090] Updated weights for policy 1, policy_version 1247197 (0.0009) [2023-12-26 09:37:11,785][123091] Updated weights for policy 0, policy_version 1255954 (0.0010) [2023-12-26 09:37:11,847][123091] Updated weights for policy 0, policy_version 1255964 (0.0010) [2023-12-26 09:37:11,902][123091] Updated weights for policy 0, policy_version 1255974 (0.0010) [2023-12-26 09:37:11,956][123091] Updated weights for policy 0, policy_version 1255984 (0.0009) [2023-12-26 09:37:12,247][123090] Updated weights for policy 1, policy_version 1247207 (0.0009) [2023-12-26 09:37:12,314][123090] Updated weights for policy 1, policy_version 1247217 (0.0009) [2023-12-26 09:37:12,386][123090] Updated weights for policy 1, policy_version 1247227 (0.0008) [2023-12-26 09:37:12,844][123091] Updated weights for policy 0, policy_version 1255994 (0.0010) [2023-12-26 09:37:12,900][123091] Updated weights for policy 0, policy_version 1256004 (0.0009) [2023-12-26 09:37:12,956][123091] Updated weights for policy 0, policy_version 1256014 (0.0010) [2023-12-26 09:37:13,206][123090] Updated weights for policy 1, policy_version 1247237 (0.0009) [2023-12-26 09:37:13,273][123090] Updated weights for policy 1, policy_version 1247247 (0.0009) [2023-12-26 09:37:13,339][123090] Updated weights for policy 1, policy_version 1247257 (0.0010) [2023-12-26 09:37:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 640843776. Throughput: 0: 8859.4, 1: 9083.9. Samples: 640839492. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:13,784][121949] Avg episode reward: [(0, '6352.959'), (1, '5763.215')] [2023-12-26 09:37:13,809][123091] Updated weights for policy 0, policy_version 1256024 (0.0010) [2023-12-26 09:37:13,868][123091] Updated weights for policy 0, policy_version 1256034 (0.0010) [2023-12-26 09:37:13,927][123091] Updated weights for policy 0, policy_version 1256044 (0.0010) [2023-12-26 09:37:14,167][123090] Updated weights for policy 1, policy_version 1247267 (0.0010) [2023-12-26 09:37:14,233][123090] Updated weights for policy 1, policy_version 1247277 (0.0007) [2023-12-26 09:37:14,305][123090] Updated weights for policy 1, policy_version 1247287 (0.0005) [2023-12-26 09:37:14,814][123091] Updated weights for policy 0, policy_version 1256054 (0.0009) [2023-12-26 09:37:14,872][123091] Updated weights for policy 0, policy_version 1256064 (0.0009) [2023-12-26 09:37:14,942][123091] Updated weights for policy 0, policy_version 1256074 (0.0009) [2023-12-26 09:37:15,087][123090] Updated weights for policy 1, policy_version 1247297 (0.0009) [2023-12-26 09:37:15,147][123090] Updated weights for policy 1, policy_version 1247307 (0.0011) [2023-12-26 09:37:15,219][123090] Updated weights for policy 1, policy_version 1247317 (0.0011) [2023-12-26 09:37:15,287][123090] Updated weights for policy 1, policy_version 1247327 (0.0011) [2023-12-26 09:37:15,806][123091] Updated weights for policy 0, policy_version 1256084 (0.0009) [2023-12-26 09:37:15,857][123091] Updated weights for policy 0, policy_version 1256095 (0.0009) [2023-12-26 09:37:15,907][123091] Updated weights for policy 0, policy_version 1256105 (0.0009) [2023-12-26 09:37:16,053][123090] Updated weights for policy 1, policy_version 1247337 (0.0009) [2023-12-26 09:37:16,118][123090] Updated weights for policy 1, policy_version 1247347 (0.0008) [2023-12-26 09:37:16,183][123090] Updated weights for policy 1, policy_version 1247357 (0.0006) [2023-12-26 09:37:16,851][123091] Updated weights for policy 0, policy_version 1256116 (0.0009) [2023-12-26 09:37:16,877][123090] Updated weights for policy 1, policy_version 1247367 (0.0006) [2023-12-26 09:37:16,904][123091] Updated weights for policy 0, policy_version 1256126 (0.0009) [2023-12-26 09:37:16,928][123090] Updated weights for policy 1, policy_version 1247377 (0.0008) [2023-12-26 09:37:16,953][123091] Updated weights for policy 0, policy_version 1256136 (0.0008) [2023-12-26 09:37:16,984][123090] Updated weights for policy 1, policy_version 1247387 (0.0009) [2023-12-26 09:37:17,789][123091] Updated weights for policy 0, policy_version 1256146 (0.0009) [2023-12-26 09:37:17,809][123090] Updated weights for policy 1, policy_version 1247397 (0.0009) [2023-12-26 09:37:17,842][123091] Updated weights for policy 0, policy_version 1256156 (0.0008) [2023-12-26 09:37:17,862][123090] Updated weights for policy 1, policy_version 1247407 (0.0009) [2023-12-26 09:37:17,888][123091] Updated weights for policy 0, policy_version 1256166 (0.0007) [2023-12-26 09:37:17,908][123090] Updated weights for policy 1, policy_version 1247417 (0.0010) [2023-12-26 09:37:17,933][123091] Updated weights for policy 0, policy_version 1256176 (0.0006) [2023-12-26 09:37:18,698][123090] Updated weights for policy 1, policy_version 1247427 (0.0009) [2023-12-26 09:37:18,760][123090] Updated weights for policy 1, policy_version 1247437 (0.0009) [2023-12-26 09:37:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 640925696. Throughput: 0: 8743.5, 1: 9005.8. Samples: 640942476. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:18,785][121949] Avg episode reward: [(0, '6195.987'), (1, '5830.429')] [2023-12-26 09:37:18,814][123091] Updated weights for policy 0, policy_version 1256186 (0.0008) [2023-12-26 09:37:18,817][123090] Updated weights for policy 1, policy_version 1247447 (0.0008) [2023-12-26 09:37:18,878][123091] Updated weights for policy 0, policy_version 1256196 (0.0008) [2023-12-26 09:37:18,952][123091] Updated weights for policy 0, policy_version 1256206 (0.0007) [2023-12-26 09:37:19,677][123090] Updated weights for policy 1, policy_version 1247457 (0.0009) [2023-12-26 09:37:19,740][123090] Updated weights for policy 1, policy_version 1247467 (0.0009) [2023-12-26 09:37:19,760][123091] Updated weights for policy 0, policy_version 1256216 (0.0008) [2023-12-26 09:37:19,810][123090] Updated weights for policy 1, policy_version 1247477 (0.0009) [2023-12-26 09:37:19,831][123091] Updated weights for policy 0, policy_version 1256226 (0.0008) [2023-12-26 09:37:19,881][123090] Updated weights for policy 1, policy_version 1247487 (0.0010) [2023-12-26 09:37:19,899][123091] Updated weights for policy 0, policy_version 1256236 (0.0008) [2023-12-26 09:37:20,736][123091] Updated weights for policy 0, policy_version 1256246 (0.0008) [2023-12-26 09:37:20,743][123090] Updated weights for policy 1, policy_version 1247497 (0.0007) [2023-12-26 09:37:20,797][123091] Updated weights for policy 0, policy_version 1256256 (0.0008) [2023-12-26 09:37:20,810][123090] Updated weights for policy 1, policy_version 1247507 (0.0006) [2023-12-26 09:37:20,852][123091] Updated weights for policy 0, policy_version 1256266 (0.0008) [2023-12-26 09:37:20,874][123090] Updated weights for policy 1, policy_version 1247517 (0.0008) [2023-12-26 09:37:21,656][123091] Updated weights for policy 0, policy_version 1256276 (0.0009) [2023-12-26 09:37:21,729][123090] Updated weights for policy 1, policy_version 1247527 (0.0010) [2023-12-26 09:37:21,734][123091] Updated weights for policy 0, policy_version 1256286 (0.0009) [2023-12-26 09:37:21,793][123090] Updated weights for policy 1, policy_version 1247537 (0.0008) [2023-12-26 09:37:21,796][123091] Updated weights for policy 0, policy_version 1256296 (0.0007) [2023-12-26 09:37:21,855][123090] Updated weights for policy 1, policy_version 1247547 (0.0009) [2023-12-26 09:37:22,632][123091] Updated weights for policy 0, policy_version 1256306 (0.0008) [2023-12-26 09:37:22,652][123090] Updated weights for policy 1, policy_version 1247557 (0.0009) [2023-12-26 09:37:22,690][123091] Updated weights for policy 0, policy_version 1256316 (0.0008) [2023-12-26 09:37:22,715][123090] Updated weights for policy 1, policy_version 1247567 (0.0008) [2023-12-26 09:37:22,745][123091] Updated weights for policy 0, policy_version 1256326 (0.0007) [2023-12-26 09:37:22,771][123090] Updated weights for policy 1, policy_version 1247577 (0.0008) [2023-12-26 09:37:22,808][123091] Updated weights for policy 0, policy_version 1256336 (0.0009) [2023-12-26 09:37:23,505][123090] Updated weights for policy 1, policy_version 1247587 (0.0006) [2023-12-26 09:37:23,567][123090] Updated weights for policy 1, policy_version 1247597 (0.0006) [2023-12-26 09:37:23,633][123091] Updated weights for policy 0, policy_version 1256346 (0.0009) [2023-12-26 09:37:23,642][123090] Updated weights for policy 1, policy_version 1247607 (0.0005) [2023-12-26 09:37:23,692][123091] Updated weights for policy 0, policy_version 1256356 (0.0009) [2023-12-26 09:37:23,770][123091] Updated weights for policy 0, policy_version 1256366 (0.0009) [2023-12-26 09:37:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 641024000. Throughput: 0: 8743.1, 1: 8944.0. Samples: 640993172. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:23,785][121949] Avg episode reward: [(0, '6203.213'), (1, '5797.555')] [2023-12-26 09:37:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001247616_319389696.pth... [2023-12-26 09:37:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001256368_321634304.pth... [2023-12-26 09:37:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001246592_319127552.pth [2023-12-26 09:37:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001255344_321372160.pth [2023-12-26 09:37:24,367][123090] Updated weights for policy 1, policy_version 1247617 (0.0006) [2023-12-26 09:37:24,421][123090] Updated weights for policy 1, policy_version 1247628 (0.0009) [2023-12-26 09:37:24,466][123090] Updated weights for policy 1, policy_version 1247638 (0.0008) [2023-12-26 09:37:24,523][123090] Updated weights for policy 1, policy_version 1247648 (0.0008) [2023-12-26 09:37:24,608][123091] Updated weights for policy 0, policy_version 1256376 (0.0010) [2023-12-26 09:37:24,655][123091] Updated weights for policy 0, policy_version 1256386 (0.0010) [2023-12-26 09:37:24,735][123091] Updated weights for policy 0, policy_version 1256396 (0.0011) [2023-12-26 09:37:25,318][123090] Updated weights for policy 1, policy_version 1247658 (0.0005) [2023-12-26 09:37:25,389][123090] Updated weights for policy 1, policy_version 1247668 (0.0006) [2023-12-26 09:37:25,446][123090] Updated weights for policy 1, policy_version 1247678 (0.0007) [2023-12-26 09:37:25,565][123091] Updated weights for policy 0, policy_version 1256406 (0.0011) [2023-12-26 09:37:25,611][123091] Updated weights for policy 0, policy_version 1256416 (0.0010) [2023-12-26 09:37:25,666][123091] Updated weights for policy 0, policy_version 1256426 (0.0005) [2023-12-26 09:37:26,073][123090] Updated weights for policy 1, policy_version 1247688 (0.0007) [2023-12-26 09:37:26,140][123090] Updated weights for policy 1, policy_version 1247698 (0.0010) [2023-12-26 09:37:26,201][123090] Updated weights for policy 1, policy_version 1247708 (0.0010) [2023-12-26 09:37:26,418][123091] Updated weights for policy 0, policy_version 1256436 (0.0006) [2023-12-26 09:37:26,480][123091] Updated weights for policy 0, policy_version 1256446 (0.0007) [2023-12-26 09:37:26,527][123091] Updated weights for policy 0, policy_version 1256456 (0.0005) [2023-12-26 09:37:27,090][123090] Updated weights for policy 1, policy_version 1247718 (0.0008) [2023-12-26 09:37:27,150][123090] Updated weights for policy 1, policy_version 1247728 (0.0006) [2023-12-26 09:37:27,172][123091] Updated weights for policy 0, policy_version 1256466 (0.0006) [2023-12-26 09:37:27,214][123090] Updated weights for policy 1, policy_version 1247738 (0.0005) [2023-12-26 09:37:27,227][123091] Updated weights for policy 0, policy_version 1256476 (0.0010) [2023-12-26 09:37:27,283][123091] Updated weights for policy 0, policy_version 1256486 (0.0011) [2023-12-26 09:37:27,341][123091] Updated weights for policy 0, policy_version 1256496 (0.0010) [2023-12-26 09:37:28,058][123091] Updated weights for policy 0, policy_version 1256506 (0.0006) [2023-12-26 09:37:28,071][123090] Updated weights for policy 1, policy_version 1247748 (0.0007) [2023-12-26 09:37:28,119][123091] Updated weights for policy 0, policy_version 1256516 (0.0005) [2023-12-26 09:37:28,136][123090] Updated weights for policy 1, policy_version 1247758 (0.0008) [2023-12-26 09:37:28,164][123091] Updated weights for policy 0, policy_version 1256526 (0.0005) [2023-12-26 09:37:28,202][123090] Updated weights for policy 1, policy_version 1247768 (0.0008) [2023-12-26 09:37:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 641105920. Throughput: 0: 8851.8, 1: 8968.6. Samples: 641102584. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:28,785][121949] Avg episode reward: [(0, '6242.538'), (1, '5588.977')] [2023-12-26 09:37:28,891][123091] Updated weights for policy 0, policy_version 1256536 (0.0009) [2023-12-26 09:37:28,928][123090] Updated weights for policy 1, policy_version 1247778 (0.0006) [2023-12-26 09:37:28,945][123091] Updated weights for policy 0, policy_version 1256546 (0.0010) [2023-12-26 09:37:28,989][123090] Updated weights for policy 1, policy_version 1247788 (0.0008) [2023-12-26 09:37:29,003][123091] Updated weights for policy 0, policy_version 1256556 (0.0010) [2023-12-26 09:37:29,045][123090] Updated weights for policy 1, policy_version 1247798 (0.0009) [2023-12-26 09:37:29,111][123090] Updated weights for policy 1, policy_version 1247808 (0.0009) [2023-12-26 09:37:29,692][123091] Updated weights for policy 0, policy_version 1256566 (0.0007) [2023-12-26 09:37:29,761][123091] Updated weights for policy 0, policy_version 1256576 (0.0008) [2023-12-26 09:37:29,832][123091] Updated weights for policy 0, policy_version 1256586 (0.0006) [2023-12-26 09:37:29,967][123090] Updated weights for policy 1, policy_version 1247818 (0.0010) [2023-12-26 09:37:30,031][123090] Updated weights for policy 1, policy_version 1247829 (0.0010) [2023-12-26 09:37:30,091][123090] Updated weights for policy 1, policy_version 1247839 (0.0009) [2023-12-26 09:37:30,601][123091] Updated weights for policy 0, policy_version 1256596 (0.0009) [2023-12-26 09:37:30,654][123091] Updated weights for policy 0, policy_version 1256606 (0.0010) [2023-12-26 09:37:30,720][123091] Updated weights for policy 0, policy_version 1256616 (0.0009) [2023-12-26 09:37:30,848][123090] Updated weights for policy 1, policy_version 1247849 (0.0009) [2023-12-26 09:37:30,909][123090] Updated weights for policy 1, policy_version 1247859 (0.0009) [2023-12-26 09:37:30,970][123090] Updated weights for policy 1, policy_version 1247869 (0.0009) [2023-12-26 09:37:31,540][123091] Updated weights for policy 0, policy_version 1256626 (0.0008) [2023-12-26 09:37:31,608][123091] Updated weights for policy 0, policy_version 1256636 (0.0005) [2023-12-26 09:37:31,673][123091] Updated weights for policy 0, policy_version 1256646 (0.0009) [2023-12-26 09:37:31,751][123091] Updated weights for policy 0, policy_version 1256656 (0.0010) [2023-12-26 09:37:31,833][123090] Updated weights for policy 1, policy_version 1247879 (0.0009) [2023-12-26 09:37:31,894][123090] Updated weights for policy 1, policy_version 1247889 (0.0009) [2023-12-26 09:37:31,954][123090] Updated weights for policy 1, policy_version 1247899 (0.0010) [2023-12-26 09:37:32,508][123091] Updated weights for policy 0, policy_version 1256666 (0.0007) [2023-12-26 09:37:32,572][123091] Updated weights for policy 0, policy_version 1256676 (0.0010) [2023-12-26 09:37:32,631][123091] Updated weights for policy 0, policy_version 1256686 (0.0009) [2023-12-26 09:37:32,797][123090] Updated weights for policy 1, policy_version 1247909 (0.0009) [2023-12-26 09:37:32,858][123090] Updated weights for policy 1, policy_version 1247919 (0.0009) [2023-12-26 09:37:32,927][123090] Updated weights for policy 1, policy_version 1247929 (0.0010) [2023-12-26 09:37:33,458][123091] Updated weights for policy 0, policy_version 1256696 (0.0009) [2023-12-26 09:37:33,521][123091] Updated weights for policy 0, policy_version 1256706 (0.0009) [2023-12-26 09:37:33,586][123091] Updated weights for policy 0, policy_version 1256716 (0.0009) [2023-12-26 09:37:33,669][123090] Updated weights for policy 1, policy_version 1247939 (0.0009) [2023-12-26 09:37:33,728][123090] Updated weights for policy 1, policy_version 1247949 (0.0009) [2023-12-26 09:37:33,783][123090] Updated weights for policy 1, policy_version 1247959 (0.0008) [2023-12-26 09:37:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 641196032. Throughput: 0: 8832.1, 1: 8864.4. Samples: 641208808. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:33,785][121949] Avg episode reward: [(0, '6146.329'), (1, '5578.636')] [2023-12-26 09:37:34,400][123091] Updated weights for policy 0, policy_version 1256726 (0.0009) [2023-12-26 09:37:34,455][123091] Updated weights for policy 0, policy_version 1256736 (0.0010) [2023-12-26 09:37:34,514][123091] Updated weights for policy 0, policy_version 1256746 (0.0007) [2023-12-26 09:37:34,627][123090] Updated weights for policy 1, policy_version 1247969 (0.0008) [2023-12-26 09:37:34,699][123090] Updated weights for policy 1, policy_version 1247979 (0.0010) [2023-12-26 09:37:34,760][123090] Updated weights for policy 1, policy_version 1247989 (0.0008) [2023-12-26 09:37:34,831][123090] Updated weights for policy 1, policy_version 1247999 (0.0009) [2023-12-26 09:37:35,311][123091] Updated weights for policy 0, policy_version 1256756 (0.0007) [2023-12-26 09:37:35,361][123091] Updated weights for policy 0, policy_version 1256766 (0.0009) [2023-12-26 09:37:35,413][123091] Updated weights for policy 0, policy_version 1256776 (0.0008) [2023-12-26 09:37:35,648][123090] Updated weights for policy 1, policy_version 1248009 (0.0010) [2023-12-26 09:37:35,698][123090] Updated weights for policy 1, policy_version 1248019 (0.0009) [2023-12-26 09:37:35,758][123090] Updated weights for policy 1, policy_version 1248029 (0.0009) [2023-12-26 09:37:36,270][123091] Updated weights for policy 0, policy_version 1256786 (0.0009) [2023-12-26 09:37:36,329][123091] Updated weights for policy 0, policy_version 1256796 (0.0010) [2023-12-26 09:37:36,394][123091] Updated weights for policy 0, policy_version 1256806 (0.0009) [2023-12-26 09:37:36,455][123091] Updated weights for policy 0, policy_version 1256816 (0.0009) [2023-12-26 09:37:36,620][123090] Updated weights for policy 1, policy_version 1248039 (0.0009) [2023-12-26 09:37:36,688][123090] Updated weights for policy 1, policy_version 1248049 (0.0009) [2023-12-26 09:37:36,755][123090] Updated weights for policy 1, policy_version 1248059 (0.0009) [2023-12-26 09:37:37,256][123091] Updated weights for policy 0, policy_version 1256826 (0.0005) [2023-12-26 09:37:37,307][123091] Updated weights for policy 0, policy_version 1256836 (0.0006) [2023-12-26 09:37:37,359][123091] Updated weights for policy 0, policy_version 1256846 (0.0010) [2023-12-26 09:37:37,595][123090] Updated weights for policy 1, policy_version 1248069 (0.0009) [2023-12-26 09:37:37,657][123090] Updated weights for policy 1, policy_version 1248079 (0.0009) [2023-12-26 09:37:37,713][123090] Updated weights for policy 1, policy_version 1248089 (0.0010) [2023-12-26 09:37:38,183][123091] Updated weights for policy 0, policy_version 1256856 (0.0009) [2023-12-26 09:37:38,239][123091] Updated weights for policy 0, policy_version 1256866 (0.0010) [2023-12-26 09:37:38,290][123091] Updated weights for policy 0, policy_version 1256876 (0.0010) [2023-12-26 09:37:38,570][123090] Updated weights for policy 1, policy_version 1248099 (0.0010) [2023-12-26 09:37:38,627][123090] Updated weights for policy 1, policy_version 1248109 (0.0009) [2023-12-26 09:37:38,683][123090] Updated weights for policy 1, policy_version 1248119 (0.0009) [2023-12-26 09:37:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 641286144. Throughput: 0: 8847.3, 1: 8839.5. Samples: 641260036. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:38,785][121949] Avg episode reward: [(0, '6125.042'), (1, '5673.890')] [2023-12-26 09:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001256880_321765376.pth... [2023-12-26 09:37:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001248128_319520768.pth... [2023-12-26 09:37:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001255856_321503232.pth [2023-12-26 09:37:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001247104_319258624.pth [2023-12-26 09:37:39,144][123091] Updated weights for policy 0, policy_version 1256886 (0.0007) [2023-12-26 09:37:39,194][123091] Updated weights for policy 0, policy_version 1256896 (0.0005) [2023-12-26 09:37:39,255][123091] Updated weights for policy 0, policy_version 1256906 (0.0007) [2023-12-26 09:37:39,507][123090] Updated weights for policy 1, policy_version 1248129 (0.0010) [2023-12-26 09:37:39,574][123090] Updated weights for policy 1, policy_version 1248139 (0.0009) [2023-12-26 09:37:39,645][123090] Updated weights for policy 1, policy_version 1248149 (0.0008) [2023-12-26 09:37:39,702][123090] Updated weights for policy 1, policy_version 1248159 (0.0009) [2023-12-26 09:37:40,030][123091] Updated weights for policy 0, policy_version 1256916 (0.0007) [2023-12-26 09:37:40,126][123091] Updated weights for policy 0, policy_version 1256926 (0.0009) [2023-12-26 09:37:40,192][123091] Updated weights for policy 0, policy_version 1256936 (0.0010) [2023-12-26 09:37:40,550][123090] Updated weights for policy 1, policy_version 1248169 (0.0009) [2023-12-26 09:37:40,617][123090] Updated weights for policy 1, policy_version 1248179 (0.0009) [2023-12-26 09:37:40,681][123090] Updated weights for policy 1, policy_version 1248189 (0.0010) [2023-12-26 09:37:40,851][123091] Updated weights for policy 0, policy_version 1256946 (0.0009) [2023-12-26 09:37:40,908][123091] Updated weights for policy 0, policy_version 1256956 (0.0005) [2023-12-26 09:37:40,962][123091] Updated weights for policy 0, policy_version 1256966 (0.0009) [2023-12-26 09:37:41,011][123091] Updated weights for policy 0, policy_version 1256976 (0.0009) [2023-12-26 09:37:41,581][123090] Updated weights for policy 1, policy_version 1248199 (0.0009) [2023-12-26 09:37:41,653][123090] Updated weights for policy 1, policy_version 1248209 (0.0009) [2023-12-26 09:37:41,723][123090] Updated weights for policy 1, policy_version 1248219 (0.0008) [2023-12-26 09:37:41,885][123091] Updated weights for policy 0, policy_version 1256986 (0.0005) [2023-12-26 09:37:41,957][123091] Updated weights for policy 0, policy_version 1256996 (0.0005) [2023-12-26 09:37:42,034][123091] Updated weights for policy 0, policy_version 1257006 (0.0006) [2023-12-26 09:37:42,546][123090] Updated weights for policy 1, policy_version 1248229 (0.0008) [2023-12-26 09:37:42,605][123090] Updated weights for policy 1, policy_version 1248239 (0.0008) [2023-12-26 09:37:42,673][123090] Updated weights for policy 1, policy_version 1248249 (0.0008) [2023-12-26 09:37:42,726][123091] Updated weights for policy 0, policy_version 1257016 (0.0005) [2023-12-26 09:37:42,793][123091] Updated weights for policy 0, policy_version 1257026 (0.0005) [2023-12-26 09:37:42,869][123091] Updated weights for policy 0, policy_version 1257036 (0.0006) [2023-12-26 09:37:43,504][123090] Updated weights for policy 1, policy_version 1248259 (0.0008) [2023-12-26 09:37:43,521][123091] Updated weights for policy 0, policy_version 1257046 (0.0009) [2023-12-26 09:37:43,557][123090] Updated weights for policy 1, policy_version 1248269 (0.0007) [2023-12-26 09:37:43,580][123091] Updated weights for policy 0, policy_version 1257056 (0.0010) [2023-12-26 09:37:43,616][123090] Updated weights for policy 1, policy_version 1248279 (0.0006) [2023-12-26 09:37:43,646][123091] Updated weights for policy 0, policy_version 1257066 (0.0011) [2023-12-26 09:37:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 641376256. Throughput: 0: 8791.8, 1: 8676.6. Samples: 641363576. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:43,785][121949] Avg episode reward: [(0, '6180.592'), (1, '5575.730')] [2023-12-26 09:37:44,450][123090] Updated weights for policy 1, policy_version 1248289 (0.0006) [2023-12-26 09:37:44,460][123091] Updated weights for policy 0, policy_version 1257076 (0.0010) [2023-12-26 09:37:44,505][123090] Updated weights for policy 1, policy_version 1248299 (0.0005) [2023-12-26 09:37:44,511][123091] Updated weights for policy 0, policy_version 1257086 (0.0010) [2023-12-26 09:37:44,561][123090] Updated weights for policy 1, policy_version 1248309 (0.0006) [2023-12-26 09:37:44,571][123091] Updated weights for policy 0, policy_version 1257096 (0.0010) [2023-12-26 09:37:44,618][123090] Updated weights for policy 1, policy_version 1248319 (0.0006) [2023-12-26 09:37:45,384][123091] Updated weights for policy 0, policy_version 1257106 (0.0011) [2023-12-26 09:37:45,440][123091] Updated weights for policy 0, policy_version 1257116 (0.0011) [2023-12-26 09:37:45,505][123091] Updated weights for policy 0, policy_version 1257126 (0.0011) [2023-12-26 09:37:45,512][123090] Updated weights for policy 1, policy_version 1248329 (0.0008) [2023-12-26 09:37:45,572][123091] Updated weights for policy 0, policy_version 1257136 (0.0011) [2023-12-26 09:37:45,573][123090] Updated weights for policy 1, policy_version 1248339 (0.0006) [2023-12-26 09:37:45,624][123090] Updated weights for policy 1, policy_version 1248349 (0.0007) [2023-12-26 09:37:46,329][123090] Updated weights for policy 1, policy_version 1248359 (0.0007) [2023-12-26 09:37:46,389][123090] Updated weights for policy 1, policy_version 1248369 (0.0007) [2023-12-26 09:37:46,396][123091] Updated weights for policy 0, policy_version 1257146 (0.0011) [2023-12-26 09:37:46,437][123090] Updated weights for policy 1, policy_version 1248379 (0.0008) [2023-12-26 09:37:46,451][123091] Updated weights for policy 0, policy_version 1257156 (0.0010) [2023-12-26 09:37:46,509][123091] Updated weights for policy 0, policy_version 1257166 (0.0010) [2023-12-26 09:37:47,186][123090] Updated weights for policy 1, policy_version 1248389 (0.0007) [2023-12-26 09:37:47,257][123090] Updated weights for policy 1, policy_version 1248399 (0.0008) [2023-12-26 09:37:47,321][123090] Updated weights for policy 1, policy_version 1248409 (0.0005) [2023-12-26 09:37:47,337][123091] Updated weights for policy 0, policy_version 1257176 (0.0010) [2023-12-26 09:37:47,392][123091] Updated weights for policy 0, policy_version 1257186 (0.0010) [2023-12-26 09:37:47,455][123091] Updated weights for policy 0, policy_version 1257196 (0.0005) [2023-12-26 09:37:47,903][123090] Updated weights for policy 1, policy_version 1248419 (0.0006) [2023-12-26 09:37:47,960][123090] Updated weights for policy 1, policy_version 1248429 (0.0005) [2023-12-26 09:37:48,018][123090] Updated weights for policy 1, policy_version 1248439 (0.0008) [2023-12-26 09:37:48,113][123091] Updated weights for policy 0, policy_version 1257206 (0.0005) [2023-12-26 09:37:48,173][123091] Updated weights for policy 0, policy_version 1257216 (0.0005) [2023-12-26 09:37:48,228][123091] Updated weights for policy 0, policy_version 1257226 (0.0005) [2023-12-26 09:37:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 641458176. Throughput: 0: 8879.3, 1: 8708.6. Samples: 641473472. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:48,785][121949] Avg episode reward: [(0, '6241.393'), (1, '5446.965')] [2023-12-26 09:37:48,836][123090] Updated weights for policy 1, policy_version 1248449 (0.0010) [2023-12-26 09:37:48,908][123090] Updated weights for policy 1, policy_version 1248459 (0.0010) [2023-12-26 09:37:48,928][123091] Updated weights for policy 0, policy_version 1257236 (0.0005) [2023-12-26 09:37:48,964][123090] Updated weights for policy 1, policy_version 1248469 (0.0010) [2023-12-26 09:37:48,984][123091] Updated weights for policy 0, policy_version 1257246 (0.0007) [2023-12-26 09:37:49,020][123090] Updated weights for policy 1, policy_version 1248479 (0.0010) [2023-12-26 09:37:49,041][123091] Updated weights for policy 0, policy_version 1257256 (0.0009) [2023-12-26 09:37:49,881][123090] Updated weights for policy 1, policy_version 1248489 (0.0007) [2023-12-26 09:37:49,882][123091] Updated weights for policy 0, policy_version 1257266 (0.0008) [2023-12-26 09:37:49,949][123090] Updated weights for policy 1, policy_version 1248499 (0.0008) [2023-12-26 09:37:49,957][123091] Updated weights for policy 0, policy_version 1257276 (0.0007) [2023-12-26 09:37:50,012][123090] Updated weights for policy 1, policy_version 1248509 (0.0009) [2023-12-26 09:37:50,020][123091] Updated weights for policy 0, policy_version 1257286 (0.0007) [2023-12-26 09:37:50,075][123091] Updated weights for policy 0, policy_version 1257296 (0.0009) [2023-12-26 09:37:50,789][123090] Updated weights for policy 1, policy_version 1248519 (0.0010) [2023-12-26 09:37:50,858][123090] Updated weights for policy 1, policy_version 1248529 (0.0009) [2023-12-26 09:37:50,893][123091] Updated weights for policy 0, policy_version 1257306 (0.0008) [2023-12-26 09:37:50,922][123090] Updated weights for policy 1, policy_version 1248539 (0.0009) [2023-12-26 09:37:50,948][123091] Updated weights for policy 0, policy_version 1257316 (0.0008) [2023-12-26 09:37:51,004][123091] Updated weights for policy 0, policy_version 1257326 (0.0010) [2023-12-26 09:37:51,770][123090] Updated weights for policy 1, policy_version 1248549 (0.0008) [2023-12-26 09:37:51,842][123090] Updated weights for policy 1, policy_version 1248559 (0.0007) [2023-12-26 09:37:51,884][123091] Updated weights for policy 0, policy_version 1257336 (0.0008) [2023-12-26 09:37:51,913][123090] Updated weights for policy 1, policy_version 1248569 (0.0010) [2023-12-26 09:37:51,949][123091] Updated weights for policy 0, policy_version 1257346 (0.0008) [2023-12-26 09:37:52,015][123091] Updated weights for policy 0, policy_version 1257356 (0.0009) [2023-12-26 09:37:52,716][123090] Updated weights for policy 1, policy_version 1248579 (0.0008) [2023-12-26 09:37:52,766][123090] Updated weights for policy 1, policy_version 1248589 (0.0010) [2023-12-26 09:37:52,823][123090] Updated weights for policy 1, policy_version 1248599 (0.0009) [2023-12-26 09:37:52,871][123091] Updated weights for policy 0, policy_version 1257366 (0.0009) [2023-12-26 09:37:52,937][123091] Updated weights for policy 0, policy_version 1257376 (0.0010) [2023-12-26 09:37:52,995][123091] Updated weights for policy 0, policy_version 1257386 (0.0009) [2023-12-26 09:37:53,705][123090] Updated weights for policy 1, policy_version 1248609 (0.0009) [2023-12-26 09:37:53,710][123091] Updated weights for policy 0, policy_version 1257396 (0.0008) [2023-12-26 09:37:53,783][123090] Updated weights for policy 1, policy_version 1248619 (0.0006) [2023-12-26 09:37:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 641540096. Throughput: 0: 8865.6, 1: 8699.7. Samples: 641524792. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:53,785][121949] Avg episode reward: [(0, '6346.494'), (1, '5376.954')] [2023-12-26 09:37:53,787][123091] Updated weights for policy 0, policy_version 1257406 (0.0006) [2023-12-26 09:37:53,857][123091] Updated weights for policy 0, policy_version 1257416 (0.0005) [2023-12-26 09:37:53,858][123090] Updated weights for policy 1, policy_version 1248629 (0.0007) [2023-12-26 09:37:53,911][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001257424_321904640.pth... [2023-12-26 09:37:53,915][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001256368_321634304.pth [2023-12-26 09:37:53,928][123090] Updated weights for policy 1, policy_version 1248639 (0.0009) [2023-12-26 09:37:53,932][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001248640_319651840.pth... [2023-12-26 09:37:53,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001247616_319389696.pth [2023-12-26 09:37:54,495][123090] Updated weights for policy 1, policy_version 1248649 (0.0008) [2023-12-26 09:37:54,548][123090] Updated weights for policy 1, policy_version 1248659 (0.0010) [2023-12-26 09:37:54,602][123090] Updated weights for policy 1, policy_version 1248669 (0.0005) [2023-12-26 09:37:54,631][123091] Updated weights for policy 0, policy_version 1257426 (0.0007) [2023-12-26 09:37:54,703][123091] Updated weights for policy 0, policy_version 1257436 (0.0009) [2023-12-26 09:37:54,772][123091] Updated weights for policy 0, policy_version 1257446 (0.0009) [2023-12-26 09:37:54,838][123091] Updated weights for policy 0, policy_version 1257456 (0.0010) [2023-12-26 09:37:55,351][123090] Updated weights for policy 1, policy_version 1248679 (0.0006) [2023-12-26 09:37:55,408][123090] Updated weights for policy 1, policy_version 1248689 (0.0009) [2023-12-26 09:37:55,461][123090] Updated weights for policy 1, policy_version 1248699 (0.0009) [2023-12-26 09:37:55,701][123091] Updated weights for policy 0, policy_version 1257466 (0.0009) [2023-12-26 09:37:55,759][123091] Updated weights for policy 0, policy_version 1257476 (0.0009) [2023-12-26 09:37:55,821][123091] Updated weights for policy 0, policy_version 1257486 (0.0009) [2023-12-26 09:37:56,273][123090] Updated weights for policy 1, policy_version 1248709 (0.0011) [2023-12-26 09:37:56,328][123090] Updated weights for policy 1, policy_version 1248719 (0.0010) [2023-12-26 09:37:56,390][123090] Updated weights for policy 1, policy_version 1248729 (0.0010) [2023-12-26 09:37:56,636][123091] Updated weights for policy 0, policy_version 1257496 (0.0009) [2023-12-26 09:37:56,695][123091] Updated weights for policy 0, policy_version 1257506 (0.0009) [2023-12-26 09:37:56,752][123091] Updated weights for policy 0, policy_version 1257516 (0.0008) [2023-12-26 09:37:57,205][123090] Updated weights for policy 1, policy_version 1248739 (0.0010) [2023-12-26 09:37:57,269][123090] Updated weights for policy 1, policy_version 1248749 (0.0009) [2023-12-26 09:37:57,336][123090] Updated weights for policy 1, policy_version 1248759 (0.0008) [2023-12-26 09:37:57,524][123091] Updated weights for policy 0, policy_version 1257526 (0.0007) [2023-12-26 09:37:57,578][123091] Updated weights for policy 0, policy_version 1257536 (0.0005) [2023-12-26 09:37:57,624][123091] Updated weights for policy 0, policy_version 1257546 (0.0005) [2023-12-26 09:37:57,976][123090] Updated weights for policy 1, policy_version 1248769 (0.0009) [2023-12-26 09:37:58,039][123090] Updated weights for policy 1, policy_version 1248779 (0.0007) [2023-12-26 09:37:58,104][123090] Updated weights for policy 1, policy_version 1248789 (0.0007) [2023-12-26 09:37:58,167][123090] Updated weights for policy 1, policy_version 1248799 (0.0007) [2023-12-26 09:37:58,362][123091] Updated weights for policy 0, policy_version 1257556 (0.0007) [2023-12-26 09:37:58,430][123091] Updated weights for policy 0, policy_version 1257566 (0.0007) [2023-12-26 09:37:58,492][123091] Updated weights for policy 0, policy_version 1257576 (0.0007) [2023-12-26 09:37:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 641638400. Throughput: 0: 8815.5, 1: 8773.4. Samples: 641630996. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:37:58,785][121949] Avg episode reward: [(0, '6415.583'), (1, '5326.391')] [2023-12-26 09:37:58,995][123090] Updated weights for policy 1, policy_version 1248809 (0.0008) [2023-12-26 09:37:59,053][123090] Updated weights for policy 1, policy_version 1248819 (0.0008) [2023-12-26 09:37:59,121][123090] Updated weights for policy 1, policy_version 1248829 (0.0008) [2023-12-26 09:37:59,358][123091] Updated weights for policy 0, policy_version 1257586 (0.0009) [2023-12-26 09:37:59,424][123091] Updated weights for policy 0, policy_version 1257596 (0.0012) [2023-12-26 09:37:59,475][123091] Updated weights for policy 0, policy_version 1257606 (0.0008) [2023-12-26 09:37:59,529][123091] Updated weights for policy 0, policy_version 1257616 (0.0009) [2023-12-26 09:37:59,925][123090] Updated weights for policy 1, policy_version 1248839 (0.0009) [2023-12-26 09:37:59,989][123090] Updated weights for policy 1, policy_version 1248849 (0.0008) [2023-12-26 09:38:00,052][123090] Updated weights for policy 1, policy_version 1248859 (0.0008) [2023-12-26 09:38:00,271][123091] Updated weights for policy 0, policy_version 1257626 (0.0009) [2023-12-26 09:38:00,329][123091] Updated weights for policy 0, policy_version 1257637 (0.0008) [2023-12-26 09:38:00,387][123091] Updated weights for policy 0, policy_version 1257647 (0.0008) [2023-12-26 09:38:00,800][123090] Updated weights for policy 1, policy_version 1248869 (0.0009) [2023-12-26 09:38:00,843][123090] Updated weights for policy 1, policy_version 1248879 (0.0010) [2023-12-26 09:38:00,890][123090] Updated weights for policy 1, policy_version 1248889 (0.0005) [2023-12-26 09:38:01,089][123091] Updated weights for policy 0, policy_version 1257657 (0.0010) [2023-12-26 09:38:01,164][123091] Updated weights for policy 0, policy_version 1257667 (0.0010) [2023-12-26 09:38:01,226][123091] Updated weights for policy 0, policy_version 1257677 (0.0010) [2023-12-26 09:38:01,756][123090] Updated weights for policy 1, policy_version 1248899 (0.0007) [2023-12-26 09:38:01,826][123090] Updated weights for policy 1, policy_version 1248909 (0.0009) [2023-12-26 09:38:01,896][123090] Updated weights for policy 1, policy_version 1248919 (0.0009) [2023-12-26 09:38:02,008][123091] Updated weights for policy 0, policy_version 1257687 (0.0009) [2023-12-26 09:38:02,062][123091] Updated weights for policy 0, policy_version 1257697 (0.0007) [2023-12-26 09:38:02,125][123091] Updated weights for policy 0, policy_version 1257707 (0.0008) [2023-12-26 09:38:02,738][123090] Updated weights for policy 1, policy_version 1248929 (0.0009) [2023-12-26 09:38:02,806][123090] Updated weights for policy 1, policy_version 1248939 (0.0008) [2023-12-26 09:38:02,863][123090] Updated weights for policy 1, policy_version 1248949 (0.0009) [2023-12-26 09:38:02,929][123090] Updated weights for policy 1, policy_version 1248959 (0.0009) [2023-12-26 09:38:02,932][123091] Updated weights for policy 0, policy_version 1257717 (0.0008) [2023-12-26 09:38:02,997][123091] Updated weights for policy 0, policy_version 1257727 (0.0007) [2023-12-26 09:38:03,055][123091] Updated weights for policy 0, policy_version 1257737 (0.0009) [2023-12-26 09:38:03,771][123090] Updated weights for policy 1, policy_version 1248970 (0.0010) [2023-12-26 09:38:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 641720320. Throughput: 0: 8918.0, 1: 8760.1. Samples: 641737988. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:03,785][121949] Avg episode reward: [(0, '6299.660'), (1, '5462.783')] [2023-12-26 09:38:03,799][123091] Updated weights for policy 0, policy_version 1257747 (0.0006) [2023-12-26 09:38:03,820][123090] Updated weights for policy 1, policy_version 1248980 (0.0010) [2023-12-26 09:38:03,861][123091] Updated weights for policy 0, policy_version 1257757 (0.0007) [2023-12-26 09:38:03,884][123090] Updated weights for policy 1, policy_version 1248990 (0.0010) [2023-12-26 09:38:03,922][123091] Updated weights for policy 0, policy_version 1257767 (0.0007) [2023-12-26 09:38:04,646][123090] Updated weights for policy 1, policy_version 1249000 (0.0009) [2023-12-26 09:38:04,714][123090] Updated weights for policy 1, policy_version 1249010 (0.0009) [2023-12-26 09:38:04,773][123090] Updated weights for policy 1, policy_version 1249020 (0.0009) [2023-12-26 09:38:04,786][123091] Updated weights for policy 0, policy_version 1257777 (0.0009) [2023-12-26 09:38:04,849][123091] Updated weights for policy 0, policy_version 1257787 (0.0009) [2023-12-26 09:38:04,902][123091] Updated weights for policy 0, policy_version 1257798 (0.0008) [2023-12-26 09:38:04,962][123091] Updated weights for policy 0, policy_version 1257808 (0.0006) [2023-12-26 09:38:05,603][123090] Updated weights for policy 1, policy_version 1249030 (0.0008) [2023-12-26 09:38:05,621][123091] Updated weights for policy 0, policy_version 1257818 (0.0005) [2023-12-26 09:38:05,654][123090] Updated weights for policy 1, policy_version 1249040 (0.0009) [2023-12-26 09:38:05,673][123091] Updated weights for policy 0, policy_version 1257828 (0.0005) [2023-12-26 09:38:05,705][123090] Updated weights for policy 1, policy_version 1249051 (0.0009) [2023-12-26 09:38:05,723][123091] Updated weights for policy 0, policy_version 1257838 (0.0005) [2023-12-26 09:38:06,456][123091] Updated weights for policy 0, policy_version 1257848 (0.0009) [2023-12-26 09:38:06,525][123091] Updated weights for policy 0, policy_version 1257858 (0.0009) [2023-12-26 09:38:06,588][123091] Updated weights for policy 0, policy_version 1257868 (0.0009) [2023-12-26 09:38:06,594][123090] Updated weights for policy 1, policy_version 1249062 (0.0008) [2023-12-26 09:38:06,657][123090] Updated weights for policy 1, policy_version 1249072 (0.0008) [2023-12-26 09:38:06,720][123090] Updated weights for policy 1, policy_version 1249082 (0.0008) [2023-12-26 09:38:07,424][123091] Updated weights for policy 0, policy_version 1257878 (0.0007) [2023-12-26 09:38:07,483][123091] Updated weights for policy 0, policy_version 1257888 (0.0007) [2023-12-26 09:38:07,534][123090] Updated weights for policy 1, policy_version 1249092 (0.0007) [2023-12-26 09:38:07,546][123091] Updated weights for policy 0, policy_version 1257898 (0.0009) [2023-12-26 09:38:07,595][123090] Updated weights for policy 1, policy_version 1249102 (0.0005) [2023-12-26 09:38:07,655][123090] Updated weights for policy 1, policy_version 1249112 (0.0005) [2023-12-26 09:38:08,368][123091] Updated weights for policy 0, policy_version 1257908 (0.0009) [2023-12-26 09:38:08,404][123090] Updated weights for policy 1, policy_version 1249122 (0.0006) [2023-12-26 09:38:08,438][123091] Updated weights for policy 0, policy_version 1257918 (0.0008) [2023-12-26 09:38:08,473][123090] Updated weights for policy 1, policy_version 1249132 (0.0010) [2023-12-26 09:38:08,493][123091] Updated weights for policy 0, policy_version 1257928 (0.0006) [2023-12-26 09:38:08,533][123090] Updated weights for policy 1, policy_version 1249142 (0.0010) [2023-12-26 09:38:08,600][123090] Updated weights for policy 1, policy_version 1249152 (0.0010) [2023-12-26 09:38:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 641818624. Throughput: 0: 8962.3, 1: 8781.7. Samples: 641791652. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:08,785][121949] Avg episode reward: [(0, '6289.189'), (1, '5377.846')] [2023-12-26 09:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001257936_322035712.pth... [2023-12-26 09:38:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001249152_319782912.pth... [2023-12-26 09:38:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001256880_321765376.pth [2023-12-26 09:38:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001248128_319520768.pth [2023-12-26 09:38:09,236][123091] Updated weights for policy 0, policy_version 1257938 (0.0006) [2023-12-26 09:38:09,306][123091] Updated weights for policy 0, policy_version 1257948 (0.0007) [2023-12-26 09:38:09,373][123091] Updated weights for policy 0, policy_version 1257958 (0.0008) [2023-12-26 09:38:09,428][123090] Updated weights for policy 1, policy_version 1249162 (0.0008) [2023-12-26 09:38:09,447][123091] Updated weights for policy 0, policy_version 1257968 (0.0009) [2023-12-26 09:38:09,501][123090] Updated weights for policy 1, policy_version 1249172 (0.0008) [2023-12-26 09:38:09,566][123090] Updated weights for policy 1, policy_version 1249182 (0.0010) [2023-12-26 09:38:10,279][123091] Updated weights for policy 0, policy_version 1257978 (0.0009) [2023-12-26 09:38:10,352][123091] Updated weights for policy 0, policy_version 1257988 (0.0007) [2023-12-26 09:38:10,395][123090] Updated weights for policy 1, policy_version 1249192 (0.0007) [2023-12-26 09:38:10,415][123091] Updated weights for policy 0, policy_version 1257998 (0.0008) [2023-12-26 09:38:10,459][123090] Updated weights for policy 1, policy_version 1249202 (0.0011) [2023-12-26 09:38:10,526][123090] Updated weights for policy 1, policy_version 1249212 (0.0009) [2023-12-26 09:38:11,106][123091] Updated weights for policy 0, policy_version 1258008 (0.0011) [2023-12-26 09:38:11,170][123091] Updated weights for policy 0, policy_version 1258018 (0.0010) [2023-12-26 09:38:11,236][123091] Updated weights for policy 0, policy_version 1258028 (0.0011) [2023-12-26 09:38:11,298][123090] Updated weights for policy 1, policy_version 1249222 (0.0009) [2023-12-26 09:38:11,352][123090] Updated weights for policy 1, policy_version 1249232 (0.0009) [2023-12-26 09:38:11,419][123090] Updated weights for policy 1, policy_version 1249242 (0.0010) [2023-12-26 09:38:12,085][123091] Updated weights for policy 0, policy_version 1258038 (0.0008) [2023-12-26 09:38:12,140][123091] Updated weights for policy 0, policy_version 1258048 (0.0006) [2023-12-26 09:38:12,190][123091] Updated weights for policy 0, policy_version 1258058 (0.0006) [2023-12-26 09:38:12,300][123090] Updated weights for policy 1, policy_version 1249252 (0.0008) [2023-12-26 09:38:12,378][123090] Updated weights for policy 1, policy_version 1249262 (0.0008) [2023-12-26 09:38:12,445][123090] Updated weights for policy 1, policy_version 1249272 (0.0008) [2023-12-26 09:38:12,970][123091] Updated weights for policy 0, policy_version 1258068 (0.0008) [2023-12-26 09:38:13,035][123091] Updated weights for policy 0, policy_version 1258078 (0.0005) [2023-12-26 09:38:13,088][123091] Updated weights for policy 0, policy_version 1258088 (0.0006) [2023-12-26 09:38:13,266][123090] Updated weights for policy 1, policy_version 1249282 (0.0007) [2023-12-26 09:38:13,335][123090] Updated weights for policy 1, policy_version 1249292 (0.0009) [2023-12-26 09:38:13,398][123090] Updated weights for policy 1, policy_version 1249302 (0.0010) [2023-12-26 09:38:13,459][123090] Updated weights for policy 1, policy_version 1249312 (0.0009) [2023-12-26 09:38:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 641900544. Throughput: 0: 8943.5, 1: 8687.8. Samples: 641895996. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:13,785][121949] Avg episode reward: [(0, '6380.496'), (1, '5308.520')] [2023-12-26 09:38:13,815][123091] Updated weights for policy 0, policy_version 1258098 (0.0006) [2023-12-26 09:38:13,865][123091] Updated weights for policy 0, policy_version 1258108 (0.0009) [2023-12-26 09:38:13,926][123091] Updated weights for policy 0, policy_version 1258118 (0.0009) [2023-12-26 09:38:13,984][123091] Updated weights for policy 0, policy_version 1258128 (0.0009) [2023-12-26 09:38:14,282][123090] Updated weights for policy 1, policy_version 1249322 (0.0010) [2023-12-26 09:38:14,347][123090] Updated weights for policy 1, policy_version 1249332 (0.0010) [2023-12-26 09:38:14,401][123090] Updated weights for policy 1, policy_version 1249342 (0.0009) [2023-12-26 09:38:14,778][123091] Updated weights for policy 0, policy_version 1258138 (0.0009) [2023-12-26 09:38:14,831][123091] Updated weights for policy 0, policy_version 1258148 (0.0009) [2023-12-26 09:38:14,887][123091] Updated weights for policy 0, policy_version 1258158 (0.0010) [2023-12-26 09:38:15,199][123090] Updated weights for policy 1, policy_version 1249352 (0.0008) [2023-12-26 09:38:15,263][123090] Updated weights for policy 1, policy_version 1249362 (0.0009) [2023-12-26 09:38:15,325][123090] Updated weights for policy 1, policy_version 1249372 (0.0009) [2023-12-26 09:38:15,774][123091] Updated weights for policy 0, policy_version 1258168 (0.0010) [2023-12-26 09:38:15,836][123091] Updated weights for policy 0, policy_version 1258178 (0.0010) [2023-12-26 09:38:15,907][123091] Updated weights for policy 0, policy_version 1258188 (0.0009) [2023-12-26 09:38:16,166][123090] Updated weights for policy 1, policy_version 1249382 (0.0007) [2023-12-26 09:38:16,230][123090] Updated weights for policy 1, policy_version 1249392 (0.0008) [2023-12-26 09:38:16,290][123090] Updated weights for policy 1, policy_version 1249402 (0.0009) [2023-12-26 09:38:16,761][123091] Updated weights for policy 0, policy_version 1258198 (0.0009) [2023-12-26 09:38:16,822][123091] Updated weights for policy 0, policy_version 1258208 (0.0009) [2023-12-26 09:38:16,872][123091] Updated weights for policy 0, policy_version 1258218 (0.0010) [2023-12-26 09:38:17,085][123090] Updated weights for policy 1, policy_version 1249412 (0.0008) [2023-12-26 09:38:17,137][123090] Updated weights for policy 1, policy_version 1249422 (0.0009) [2023-12-26 09:38:17,193][123090] Updated weights for policy 1, policy_version 1249432 (0.0009) [2023-12-26 09:38:17,667][123091] Updated weights for policy 0, policy_version 1258228 (0.0010) [2023-12-26 09:38:17,714][123091] Updated weights for policy 0, policy_version 1258238 (0.0008) [2023-12-26 09:38:17,764][123091] Updated weights for policy 0, policy_version 1258248 (0.0009) [2023-12-26 09:38:17,964][123090] Updated weights for policy 1, policy_version 1249442 (0.0009) [2023-12-26 09:38:18,019][123090] Updated weights for policy 1, policy_version 1249452 (0.0010) [2023-12-26 09:38:18,075][123090] Updated weights for policy 1, policy_version 1249462 (0.0010) [2023-12-26 09:38:18,127][123090] Updated weights for policy 1, policy_version 1249472 (0.0008) [2023-12-26 09:38:18,534][123091] Updated weights for policy 0, policy_version 1258258 (0.0010) [2023-12-26 09:38:18,598][123091] Updated weights for policy 0, policy_version 1258268 (0.0009) [2023-12-26 09:38:18,659][123091] Updated weights for policy 0, policy_version 1258278 (0.0009) [2023-12-26 09:38:18,721][123091] Updated weights for policy 0, policy_version 1258288 (0.0010) [2023-12-26 09:38:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 641990656. Throughput: 0: 8900.6, 1: 8685.8. Samples: 642000192. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:18,785][121949] Avg episode reward: [(0, '6351.098'), (1, '5392.904')] [2023-12-26 09:38:18,948][123090] Updated weights for policy 1, policy_version 1249482 (0.0010) [2023-12-26 09:38:19,018][123090] Updated weights for policy 1, policy_version 1249492 (0.0009) [2023-12-26 09:38:19,084][123090] Updated weights for policy 1, policy_version 1249502 (0.0009) [2023-12-26 09:38:19,580][123091] Updated weights for policy 0, policy_version 1258298 (0.0010) [2023-12-26 09:38:19,641][123091] Updated weights for policy 0, policy_version 1258308 (0.0010) [2023-12-26 09:38:19,714][123091] Updated weights for policy 0, policy_version 1258318 (0.0009) [2023-12-26 09:38:19,899][123090] Updated weights for policy 1, policy_version 1249512 (0.0009) [2023-12-26 09:38:19,968][123090] Updated weights for policy 1, policy_version 1249522 (0.0010) [2023-12-26 09:38:20,042][123090] Updated weights for policy 1, policy_version 1249532 (0.0011) [2023-12-26 09:38:20,533][123091] Updated weights for policy 0, policy_version 1258328 (0.0008) [2023-12-26 09:38:20,599][123091] Updated weights for policy 0, policy_version 1258338 (0.0011) [2023-12-26 09:38:20,668][123091] Updated weights for policy 0, policy_version 1258348 (0.0009) [2023-12-26 09:38:20,894][123090] Updated weights for policy 1, policy_version 1249542 (0.0010) [2023-12-26 09:38:20,961][123090] Updated weights for policy 1, policy_version 1249552 (0.0010) [2023-12-26 09:38:21,028][123090] Updated weights for policy 1, policy_version 1249562 (0.0009) [2023-12-26 09:38:21,517][123091] Updated weights for policy 0, policy_version 1258358 (0.0010) [2023-12-26 09:38:21,576][123091] Updated weights for policy 0, policy_version 1258368 (0.0010) [2023-12-26 09:38:21,644][123091] Updated weights for policy 0, policy_version 1258378 (0.0009) [2023-12-26 09:38:21,844][123090] Updated weights for policy 1, policy_version 1249572 (0.0010) [2023-12-26 09:38:21,910][123090] Updated weights for policy 1, policy_version 1249582 (0.0009) [2023-12-26 09:38:21,984][123090] Updated weights for policy 1, policy_version 1249592 (0.0009) [2023-12-26 09:38:22,495][123091] Updated weights for policy 0, policy_version 1258388 (0.0009) [2023-12-26 09:38:22,566][123091] Updated weights for policy 0, policy_version 1258398 (0.0009) [2023-12-26 09:38:22,635][123091] Updated weights for policy 0, policy_version 1258408 (0.0005) [2023-12-26 09:38:22,786][123090] Updated weights for policy 1, policy_version 1249602 (0.0009) [2023-12-26 09:38:22,849][123090] Updated weights for policy 1, policy_version 1249612 (0.0010) [2023-12-26 09:38:22,917][123090] Updated weights for policy 1, policy_version 1249622 (0.0010) [2023-12-26 09:38:22,986][123090] Updated weights for policy 1, policy_version 1249632 (0.0009) [2023-12-26 09:38:23,377][123091] Updated weights for policy 0, policy_version 1258418 (0.0007) [2023-12-26 09:38:23,433][123091] Updated weights for policy 0, policy_version 1258428 (0.0009) [2023-12-26 09:38:23,497][123091] Updated weights for policy 0, policy_version 1258438 (0.0010) [2023-12-26 09:38:23,553][123091] Updated weights for policy 0, policy_version 1258448 (0.0009) [2023-12-26 09:38:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 642072576. Throughput: 0: 8877.3, 1: 8687.2. Samples: 642050444. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:23,786][121949] Avg episode reward: [(0, '6365.556'), (1, '5494.368')] [2023-12-26 09:38:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001258448_322166784.pth... [2023-12-26 09:38:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001257424_321904640.pth [2023-12-26 09:38:23,812][123090] Updated weights for policy 1, policy_version 1249642 (0.0006) [2023-12-26 09:38:23,878][123090] Updated weights for policy 1, policy_version 1249652 (0.0006) [2023-12-26 09:38:23,941][123090] Updated weights for policy 1, policy_version 1249662 (0.0005) [2023-12-26 09:38:23,953][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001249664_319913984.pth... [2023-12-26 09:38:23,958][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001248640_319651840.pth [2023-12-26 09:38:24,295][123091] Updated weights for policy 0, policy_version 1258458 (0.0005) [2023-12-26 09:38:24,364][123091] Updated weights for policy 0, policy_version 1258468 (0.0005) [2023-12-26 09:38:24,428][123091] Updated weights for policy 0, policy_version 1258478 (0.0008) [2023-12-26 09:38:24,634][123090] Updated weights for policy 1, policy_version 1249672 (0.0009) [2023-12-26 09:38:24,682][123090] Updated weights for policy 1, policy_version 1249682 (0.0010) [2023-12-26 09:38:24,730][123090] Updated weights for policy 1, policy_version 1249692 (0.0010) [2023-12-26 09:38:25,201][123091] Updated weights for policy 0, policy_version 1258488 (0.0009) [2023-12-26 09:38:25,268][123091] Updated weights for policy 0, policy_version 1258498 (0.0010) [2023-12-26 09:38:25,322][123091] Updated weights for policy 0, policy_version 1258508 (0.0009) [2023-12-26 09:38:25,601][123090] Updated weights for policy 1, policy_version 1249702 (0.0010) [2023-12-26 09:38:25,656][123090] Updated weights for policy 1, policy_version 1249712 (0.0010) [2023-12-26 09:38:25,704][123090] Updated weights for policy 1, policy_version 1249722 (0.0010) [2023-12-26 09:38:26,161][123091] Updated weights for policy 0, policy_version 1258518 (0.0009) [2023-12-26 09:38:26,209][123091] Updated weights for policy 0, policy_version 1258528 (0.0009) [2023-12-26 09:38:26,258][123091] Updated weights for policy 0, policy_version 1258538 (0.0008) [2023-12-26 09:38:26,543][123090] Updated weights for policy 1, policy_version 1249732 (0.0008) [2023-12-26 09:38:26,592][123090] Updated weights for policy 1, policy_version 1249742 (0.0006) [2023-12-26 09:38:26,639][123090] Updated weights for policy 1, policy_version 1249752 (0.0010) [2023-12-26 09:38:27,010][123091] Updated weights for policy 0, policy_version 1258548 (0.0010) [2023-12-26 09:38:27,063][123091] Updated weights for policy 0, policy_version 1258558 (0.0010) [2023-12-26 09:38:27,128][123091] Updated weights for policy 0, policy_version 1258568 (0.0009) [2023-12-26 09:38:27,286][123090] Updated weights for policy 1, policy_version 1249762 (0.0009) [2023-12-26 09:38:27,345][123090] Updated weights for policy 1, policy_version 1249772 (0.0010) [2023-12-26 09:38:27,400][123090] Updated weights for policy 1, policy_version 1249782 (0.0010) [2023-12-26 09:38:27,454][123090] Updated weights for policy 1, policy_version 1249792 (0.0010) [2023-12-26 09:38:27,983][123091] Updated weights for policy 0, policy_version 1258578 (0.0009) [2023-12-26 09:38:28,041][123091] Updated weights for policy 0, policy_version 1258588 (0.0006) [2023-12-26 09:38:28,101][123091] Updated weights for policy 0, policy_version 1258598 (0.0006) [2023-12-26 09:38:28,153][123090] Updated weights for policy 1, policy_version 1249802 (0.0006) [2023-12-26 09:38:28,156][123091] Updated weights for policy 0, policy_version 1258608 (0.0005) [2023-12-26 09:38:28,205][123090] Updated weights for policy 1, policy_version 1249812 (0.0005) [2023-12-26 09:38:28,264][123090] Updated weights for policy 1, policy_version 1249822 (0.0005) [2023-12-26 09:38:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 642162688. Throughput: 0: 8861.8, 1: 8784.6. Samples: 642157660. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:28,784][121949] Avg episode reward: [(0, '6203.480'), (1, '5494.841')] [2023-12-26 09:38:28,834][123091] Updated weights for policy 0, policy_version 1258618 (0.0007) [2023-12-26 09:38:28,884][123091] Updated weights for policy 0, policy_version 1258628 (0.0005) [2023-12-26 09:38:28,932][123091] Updated weights for policy 0, policy_version 1258638 (0.0005) [2023-12-26 09:38:29,009][123090] Updated weights for policy 1, policy_version 1249832 (0.0009) [2023-12-26 09:38:29,071][123090] Updated weights for policy 1, policy_version 1249842 (0.0009) [2023-12-26 09:38:29,128][123090] Updated weights for policy 1, policy_version 1249852 (0.0009) [2023-12-26 09:38:29,659][123091] Updated weights for policy 0, policy_version 1258648 (0.0007) [2023-12-26 09:38:29,713][123091] Updated weights for policy 0, policy_version 1258658 (0.0007) [2023-12-26 09:38:29,775][123091] Updated weights for policy 0, policy_version 1258668 (0.0010) [2023-12-26 09:38:30,036][123090] Updated weights for policy 1, policy_version 1249862 (0.0009) [2023-12-26 09:38:30,092][123090] Updated weights for policy 1, policy_version 1249872 (0.0009) [2023-12-26 09:38:30,152][123090] Updated weights for policy 1, policy_version 1249882 (0.0009) [2023-12-26 09:38:30,556][123091] Updated weights for policy 0, policy_version 1258678 (0.0010) [2023-12-26 09:38:30,614][123091] Updated weights for policy 0, policy_version 1258688 (0.0010) [2023-12-26 09:38:30,665][123091] Updated weights for policy 0, policy_version 1258698 (0.0011) [2023-12-26 09:38:31,039][123090] Updated weights for policy 1, policy_version 1249892 (0.0009) [2023-12-26 09:38:31,100][123090] Updated weights for policy 1, policy_version 1249902 (0.0009) [2023-12-26 09:38:31,162][123090] Updated weights for policy 1, policy_version 1249912 (0.0009) [2023-12-26 09:38:31,425][123091] Updated weights for policy 0, policy_version 1258708 (0.0010) [2023-12-26 09:38:31,486][123091] Updated weights for policy 0, policy_version 1258718 (0.0009) [2023-12-26 09:38:31,547][123091] Updated weights for policy 0, policy_version 1258728 (0.0006) [2023-12-26 09:38:32,003][123090] Updated weights for policy 1, policy_version 1249922 (0.0009) [2023-12-26 09:38:32,056][123090] Updated weights for policy 1, policy_version 1249932 (0.0009) [2023-12-26 09:38:32,113][123090] Updated weights for policy 1, policy_version 1249942 (0.0010) [2023-12-26 09:38:32,165][123090] Updated weights for policy 1, policy_version 1249952 (0.0009) [2023-12-26 09:38:32,292][123091] Updated weights for policy 0, policy_version 1258738 (0.0006) [2023-12-26 09:38:32,352][123091] Updated weights for policy 0, policy_version 1258748 (0.0007) [2023-12-26 09:38:32,421][123091] Updated weights for policy 0, policy_version 1258758 (0.0007) [2023-12-26 09:38:32,478][123091] Updated weights for policy 0, policy_version 1258768 (0.0007) [2023-12-26 09:38:32,973][123090] Updated weights for policy 1, policy_version 1249962 (0.0005) [2023-12-26 09:38:33,023][123090] Updated weights for policy 1, policy_version 1249972 (0.0005) [2023-12-26 09:38:33,077][123090] Updated weights for policy 1, policy_version 1249982 (0.0006) [2023-12-26 09:38:33,131][123091] Updated weights for policy 0, policy_version 1258778 (0.0010) [2023-12-26 09:38:33,187][123091] Updated weights for policy 0, policy_version 1258788 (0.0005) [2023-12-26 09:38:33,238][123091] Updated weights for policy 0, policy_version 1258798 (0.0005) [2023-12-26 09:38:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 642252800. Throughput: 0: 8923.8, 1: 8726.6. Samples: 642267744. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:33,785][121949] Avg episode reward: [(0, '6166.679'), (1, '5504.937')] [2023-12-26 09:38:33,869][123090] Updated weights for policy 1, policy_version 1249992 (0.0005) [2023-12-26 09:38:33,913][123091] Updated weights for policy 0, policy_version 1258808 (0.0009) [2023-12-26 09:38:33,920][123090] Updated weights for policy 1, policy_version 1250002 (0.0005) [2023-12-26 09:38:33,964][123091] Updated weights for policy 0, policy_version 1258818 (0.0010) [2023-12-26 09:38:33,973][123090] Updated weights for policy 1, policy_version 1250012 (0.0005) [2023-12-26 09:38:34,011][123091] Updated weights for policy 0, policy_version 1258828 (0.0010) [2023-12-26 09:38:34,707][123090] Updated weights for policy 1, policy_version 1250022 (0.0007) [2023-12-26 09:38:34,767][123091] Updated weights for policy 0, policy_version 1258838 (0.0007) [2023-12-26 09:38:34,778][123090] Updated weights for policy 1, policy_version 1250032 (0.0010) [2023-12-26 09:38:34,824][123091] Updated weights for policy 0, policy_version 1258848 (0.0006) [2023-12-26 09:38:34,839][123090] Updated weights for policy 1, policy_version 1250042 (0.0008) [2023-12-26 09:38:34,878][123091] Updated weights for policy 0, policy_version 1258858 (0.0008) [2023-12-26 09:38:35,484][123090] Updated weights for policy 1, policy_version 1250052 (0.0007) [2023-12-26 09:38:35,533][123090] Updated weights for policy 1, policy_version 1250062 (0.0006) [2023-12-26 09:38:35,565][123091] Updated weights for policy 0, policy_version 1258868 (0.0008) [2023-12-26 09:38:35,590][123090] Updated weights for policy 1, policy_version 1250072 (0.0005) [2023-12-26 09:38:35,626][123091] Updated weights for policy 0, policy_version 1258878 (0.0008) [2023-12-26 09:38:35,695][123091] Updated weights for policy 0, policy_version 1258888 (0.0009) [2023-12-26 09:38:36,351][123090] Updated weights for policy 1, policy_version 1250082 (0.0005) [2023-12-26 09:38:36,429][123090] Updated weights for policy 1, policy_version 1250092 (0.0006) [2023-12-26 09:38:36,505][123090] Updated weights for policy 1, policy_version 1250102 (0.0005) [2023-12-26 09:38:36,542][123091] Updated weights for policy 0, policy_version 1258898 (0.0009) [2023-12-26 09:38:36,581][123090] Updated weights for policy 1, policy_version 1250112 (0.0007) [2023-12-26 09:38:36,616][123091] Updated weights for policy 0, policy_version 1258908 (0.0007) [2023-12-26 09:38:36,694][123091] Updated weights for policy 0, policy_version 1258918 (0.0006) [2023-12-26 09:38:36,756][123091] Updated weights for policy 0, policy_version 1258928 (0.0010) [2023-12-26 09:38:37,249][123090] Updated weights for policy 1, policy_version 1250122 (0.0010) [2023-12-26 09:38:37,319][123090] Updated weights for policy 1, policy_version 1250132 (0.0007) [2023-12-26 09:38:37,379][123090] Updated weights for policy 1, policy_version 1250142 (0.0006) [2023-12-26 09:38:37,401][123091] Updated weights for policy 0, policy_version 1258938 (0.0006) [2023-12-26 09:38:37,472][123091] Updated weights for policy 0, policy_version 1258948 (0.0008) [2023-12-26 09:38:37,538][123091] Updated weights for policy 0, policy_version 1258958 (0.0005) [2023-12-26 09:38:38,151][123090] Updated weights for policy 1, policy_version 1250152 (0.0005) [2023-12-26 09:38:38,201][123090] Updated weights for policy 1, policy_version 1250162 (0.0006) [2023-12-26 09:38:38,229][123091] Updated weights for policy 0, policy_version 1258968 (0.0005) [2023-12-26 09:38:38,256][123090] Updated weights for policy 1, policy_version 1250172 (0.0005) [2023-12-26 09:38:38,278][123091] Updated weights for policy 0, policy_version 1258978 (0.0005) [2023-12-26 09:38:38,342][123091] Updated weights for policy 0, policy_version 1258988 (0.0009) [2023-12-26 09:38:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 642351104. Throughput: 0: 8987.0, 1: 8806.4. Samples: 642325492. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:38,784][121949] Avg episode reward: [(0, '6224.475'), (1, '5438.067')] [2023-12-26 09:38:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001258992_322306048.pth... [2023-12-26 09:38:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001250176_320045056.pth... [2023-12-26 09:38:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001249152_319782912.pth [2023-12-26 09:38:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001257936_322035712.pth [2023-12-26 09:38:39,063][123090] Updated weights for policy 1, policy_version 1250182 (0.0006) [2023-12-26 09:38:39,075][123091] Updated weights for policy 0, policy_version 1258998 (0.0007) [2023-12-26 09:38:39,108][123090] Updated weights for policy 1, policy_version 1250192 (0.0006) [2023-12-26 09:38:39,135][123091] Updated weights for policy 0, policy_version 1259008 (0.0007) [2023-12-26 09:38:39,167][123090] Updated weights for policy 1, policy_version 1250202 (0.0006) [2023-12-26 09:38:39,190][123091] Updated weights for policy 0, policy_version 1259018 (0.0009) [2023-12-26 09:38:39,949][123090] Updated weights for policy 1, policy_version 1250212 (0.0008) [2023-12-26 09:38:39,989][123091] Updated weights for policy 0, policy_version 1259028 (0.0006) [2023-12-26 09:38:40,017][123090] Updated weights for policy 1, policy_version 1250222 (0.0009) [2023-12-26 09:38:40,056][123091] Updated weights for policy 0, policy_version 1259038 (0.0009) [2023-12-26 09:38:40,084][123090] Updated weights for policy 1, policy_version 1250232 (0.0007) [2023-12-26 09:38:40,123][123091] Updated weights for policy 0, policy_version 1259048 (0.0011) [2023-12-26 09:38:40,837][123091] Updated weights for policy 0, policy_version 1259058 (0.0011) [2023-12-26 09:38:40,905][123091] Updated weights for policy 0, policy_version 1259068 (0.0011) [2023-12-26 09:38:40,968][123091] Updated weights for policy 0, policy_version 1259078 (0.0011) [2023-12-26 09:38:40,970][123090] Updated weights for policy 1, policy_version 1250242 (0.0007) [2023-12-26 09:38:41,032][123091] Updated weights for policy 0, policy_version 1259088 (0.0011) [2023-12-26 09:38:41,034][123090] Updated weights for policy 1, policy_version 1250252 (0.0006) [2023-12-26 09:38:41,112][123090] Updated weights for policy 1, policy_version 1250262 (0.0008) [2023-12-26 09:38:41,192][123090] Updated weights for policy 1, policy_version 1250272 (0.0008) [2023-12-26 09:38:41,872][123091] Updated weights for policy 0, policy_version 1259098 (0.0007) [2023-12-26 09:38:41,932][123091] Updated weights for policy 0, policy_version 1259108 (0.0009) [2023-12-26 09:38:41,936][123090] Updated weights for policy 1, policy_version 1250282 (0.0007) [2023-12-26 09:38:42,001][123091] Updated weights for policy 0, policy_version 1259118 (0.0009) [2023-12-26 09:38:42,002][123090] Updated weights for policy 1, policy_version 1250292 (0.0007) [2023-12-26 09:38:42,063][123090] Updated weights for policy 1, policy_version 1250302 (0.0009) [2023-12-26 09:38:42,823][123090] Updated weights for policy 1, policy_version 1250312 (0.0010) [2023-12-26 09:38:42,857][123091] Updated weights for policy 0, policy_version 1259128 (0.0006) [2023-12-26 09:38:42,881][123090] Updated weights for policy 1, policy_version 1250322 (0.0010) [2023-12-26 09:38:42,910][123091] Updated weights for policy 0, policy_version 1259138 (0.0008) [2023-12-26 09:38:42,935][123090] Updated weights for policy 1, policy_version 1250332 (0.0008) [2023-12-26 09:38:42,966][123091] Updated weights for policy 0, policy_version 1259148 (0.0009) [2023-12-26 09:38:43,737][123090] Updated weights for policy 1, policy_version 1250342 (0.0007) [2023-12-26 09:38:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 642433024. Throughput: 0: 9046.1, 1: 8796.6. Samples: 642433916. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:43,784][121949] Avg episode reward: [(0, '6247.404'), (1, '5367.476')] [2023-12-26 09:38:43,791][123090] Updated weights for policy 1, policy_version 1250352 (0.0005) [2023-12-26 09:38:43,822][123091] Updated weights for policy 0, policy_version 1259158 (0.0009) [2023-12-26 09:38:43,846][123090] Updated weights for policy 1, policy_version 1250362 (0.0005) [2023-12-26 09:38:43,880][123091] Updated weights for policy 0, policy_version 1259168 (0.0009) [2023-12-26 09:38:43,935][123091] Updated weights for policy 0, policy_version 1259179 (0.0011) [2023-12-26 09:38:44,449][123090] Updated weights for policy 1, policy_version 1250372 (0.0007) [2023-12-26 09:38:44,512][123090] Updated weights for policy 1, policy_version 1250382 (0.0010) [2023-12-26 09:38:44,564][123090] Updated weights for policy 1, policy_version 1250392 (0.0010) [2023-12-26 09:38:44,853][123091] Updated weights for policy 0, policy_version 1259190 (0.0011) [2023-12-26 09:38:44,917][123091] Updated weights for policy 0, policy_version 1259200 (0.0010) [2023-12-26 09:38:44,977][123091] Updated weights for policy 0, policy_version 1259210 (0.0010) [2023-12-26 09:38:45,364][123090] Updated weights for policy 1, policy_version 1250402 (0.0010) [2023-12-26 09:38:45,422][123090] Updated weights for policy 1, policy_version 1250412 (0.0009) [2023-12-26 09:38:45,495][123090] Updated weights for policy 1, policy_version 1250422 (0.0010) [2023-12-26 09:38:45,561][123090] Updated weights for policy 1, policy_version 1250432 (0.0009) [2023-12-26 09:38:45,867][123091] Updated weights for policy 0, policy_version 1259220 (0.0010) [2023-12-26 09:38:45,929][123091] Updated weights for policy 0, policy_version 1259230 (0.0009) [2023-12-26 09:38:45,986][123091] Updated weights for policy 0, policy_version 1259240 (0.0010) [2023-12-26 09:38:46,277][123090] Updated weights for policy 1, policy_version 1250442 (0.0005) [2023-12-26 09:38:46,337][123090] Updated weights for policy 1, policy_version 1250452 (0.0005) [2023-12-26 09:38:46,395][123090] Updated weights for policy 1, policy_version 1250462 (0.0005) [2023-12-26 09:38:46,820][123091] Updated weights for policy 0, policy_version 1259250 (0.0009) [2023-12-26 09:38:46,890][123091] Updated weights for policy 0, policy_version 1259260 (0.0008) [2023-12-26 09:38:46,954][123091] Updated weights for policy 0, policy_version 1259270 (0.0009) [2023-12-26 09:38:47,018][123091] Updated weights for policy 0, policy_version 1259280 (0.0008) [2023-12-26 09:38:47,111][123090] Updated weights for policy 1, policy_version 1250472 (0.0009) [2023-12-26 09:38:47,159][123090] Updated weights for policy 1, policy_version 1250482 (0.0010) [2023-12-26 09:38:47,207][123090] Updated weights for policy 1, policy_version 1250492 (0.0010) [2023-12-26 09:38:47,758][123091] Updated weights for policy 0, policy_version 1259290 (0.0005) [2023-12-26 09:38:47,833][123091] Updated weights for policy 0, policy_version 1259300 (0.0008) [2023-12-26 09:38:47,893][123091] Updated weights for policy 0, policy_version 1259310 (0.0010) [2023-12-26 09:38:48,056][123090] Updated weights for policy 1, policy_version 1250502 (0.0010) [2023-12-26 09:38:48,126][123090] Updated weights for policy 1, policy_version 1250512 (0.0011) [2023-12-26 09:38:48,196][123090] Updated weights for policy 1, policy_version 1250522 (0.0010) [2023-12-26 09:38:48,674][123091] Updated weights for policy 0, policy_version 1259320 (0.0010) [2023-12-26 09:38:48,735][123091] Updated weights for policy 0, policy_version 1259330 (0.0005) [2023-12-26 09:38:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 642523136. Throughput: 0: 8975.6, 1: 8858.9. Samples: 642540540. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:48,785][121949] Avg episode reward: [(0, '6202.675'), (1, '5447.311')] [2023-12-26 09:38:48,796][123091] Updated weights for policy 0, policy_version 1259340 (0.0006) [2023-12-26 09:38:48,934][123090] Updated weights for policy 1, policy_version 1250532 (0.0009) [2023-12-26 09:38:48,991][123090] Updated weights for policy 1, policy_version 1250542 (0.0005) [2023-12-26 09:38:49,049][123090] Updated weights for policy 1, policy_version 1250552 (0.0005) [2023-12-26 09:38:49,554][123091] Updated weights for policy 0, policy_version 1259350 (0.0005) [2023-12-26 09:38:49,604][123091] Updated weights for policy 0, policy_version 1259360 (0.0006) [2023-12-26 09:38:49,673][123091] Updated weights for policy 0, policy_version 1259370 (0.0005) [2023-12-26 09:38:49,850][123090] Updated weights for policy 1, policy_version 1250562 (0.0006) [2023-12-26 09:38:49,925][123090] Updated weights for policy 1, policy_version 1250572 (0.0007) [2023-12-26 09:38:49,985][123090] Updated weights for policy 1, policy_version 1250582 (0.0011) [2023-12-26 09:38:50,045][123090] Updated weights for policy 1, policy_version 1250592 (0.0010) [2023-12-26 09:38:50,393][123091] Updated weights for policy 0, policy_version 1259380 (0.0007) [2023-12-26 09:38:50,452][123091] Updated weights for policy 0, policy_version 1259390 (0.0011) [2023-12-26 09:38:50,503][123091] Updated weights for policy 0, policy_version 1259400 (0.0010) [2023-12-26 09:38:50,893][123090] Updated weights for policy 1, policy_version 1250602 (0.0005) [2023-12-26 09:38:50,958][123090] Updated weights for policy 1, policy_version 1250612 (0.0005) [2023-12-26 09:38:51,032][123090] Updated weights for policy 1, policy_version 1250622 (0.0006) [2023-12-26 09:38:51,301][123091] Updated weights for policy 0, policy_version 1259410 (0.0010) [2023-12-26 09:38:51,358][123091] Updated weights for policy 0, policy_version 1259420 (0.0011) [2023-12-26 09:38:51,422][123091] Updated weights for policy 0, policy_version 1259430 (0.0011) [2023-12-26 09:38:51,477][123091] Updated weights for policy 0, policy_version 1259440 (0.0011) [2023-12-26 09:38:51,762][123090] Updated weights for policy 1, policy_version 1250632 (0.0009) [2023-12-26 09:38:51,830][123090] Updated weights for policy 1, policy_version 1250642 (0.0009) [2023-12-26 09:38:51,895][123090] Updated weights for policy 1, policy_version 1250652 (0.0005) [2023-12-26 09:38:52,272][123091] Updated weights for policy 0, policy_version 1259450 (0.0008) [2023-12-26 09:38:52,324][123091] Updated weights for policy 0, policy_version 1259460 (0.0010) [2023-12-26 09:38:52,390][123091] Updated weights for policy 0, policy_version 1259470 (0.0007) [2023-12-26 09:38:52,601][123090] Updated weights for policy 1, policy_version 1250662 (0.0005) [2023-12-26 09:38:52,676][123090] Updated weights for policy 1, policy_version 1250672 (0.0007) [2023-12-26 09:38:52,738][123090] Updated weights for policy 1, policy_version 1250682 (0.0010) [2023-12-26 09:38:53,096][123091] Updated weights for policy 0, policy_version 1259480 (0.0010) [2023-12-26 09:38:53,147][123091] Updated weights for policy 0, policy_version 1259490 (0.0010) [2023-12-26 09:38:53,199][123091] Updated weights for policy 0, policy_version 1259500 (0.0010) [2023-12-26 09:38:53,469][123090] Updated weights for policy 1, policy_version 1250692 (0.0007) [2023-12-26 09:38:53,524][123090] Updated weights for policy 1, policy_version 1250702 (0.0008) [2023-12-26 09:38:53,577][123090] Updated weights for policy 1, policy_version 1250712 (0.0009) [2023-12-26 09:38:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 642621440. Throughput: 0: 8954.2, 1: 8899.7. Samples: 642595076. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:53,785][121949] Avg episode reward: [(0, '6248.310'), (1, '5364.261')] [2023-12-26 09:38:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001259504_322437120.pth... [2023-12-26 09:38:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001250720_320184320.pth... [2023-12-26 09:38:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001258448_322166784.pth [2023-12-26 09:38:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001249664_319913984.pth [2023-12-26 09:38:54,039][123091] Updated weights for policy 0, policy_version 1259510 (0.0010) [2023-12-26 09:38:54,091][123091] Updated weights for policy 0, policy_version 1259520 (0.0011) [2023-12-26 09:38:54,151][123091] Updated weights for policy 0, policy_version 1259530 (0.0010) [2023-12-26 09:38:54,402][123090] Updated weights for policy 1, policy_version 1250722 (0.0008) [2023-12-26 09:38:54,474][123090] Updated weights for policy 1, policy_version 1250732 (0.0005) [2023-12-26 09:38:54,544][123090] Updated weights for policy 1, policy_version 1250742 (0.0005) [2023-12-26 09:38:54,610][123090] Updated weights for policy 1, policy_version 1250752 (0.0005) [2023-12-26 09:38:54,934][123091] Updated weights for policy 0, policy_version 1259540 (0.0009) [2023-12-26 09:38:55,001][123091] Updated weights for policy 0, policy_version 1259550 (0.0006) [2023-12-26 09:38:55,053][123091] Updated weights for policy 0, policy_version 1259560 (0.0006) [2023-12-26 09:38:55,298][123090] Updated weights for policy 1, policy_version 1250762 (0.0010) [2023-12-26 09:38:55,358][123090] Updated weights for policy 1, policy_version 1250772 (0.0010) [2023-12-26 09:38:55,419][123090] Updated weights for policy 1, policy_version 1250782 (0.0009) [2023-12-26 09:38:55,779][123091] Updated weights for policy 0, policy_version 1259570 (0.0007) [2023-12-26 09:38:55,837][123091] Updated weights for policy 0, policy_version 1259580 (0.0010) [2023-12-26 09:38:55,885][123091] Updated weights for policy 0, policy_version 1259590 (0.0010) [2023-12-26 09:38:55,937][123091] Updated weights for policy 0, policy_version 1259600 (0.0010) [2023-12-26 09:38:56,270][123090] Updated weights for policy 1, policy_version 1250792 (0.0009) [2023-12-26 09:38:56,326][123090] Updated weights for policy 1, policy_version 1250802 (0.0009) [2023-12-26 09:38:56,383][123090] Updated weights for policy 1, policy_version 1250813 (0.0009) [2023-12-26 09:38:56,703][123091] Updated weights for policy 0, policy_version 1259610 (0.0005) [2023-12-26 09:38:56,761][123091] Updated weights for policy 0, policy_version 1259620 (0.0007) [2023-12-26 09:38:56,809][123091] Updated weights for policy 0, policy_version 1259630 (0.0008) [2023-12-26 09:38:57,339][123090] Updated weights for policy 1, policy_version 1250823 (0.0009) [2023-12-26 09:38:57,398][123090] Updated weights for policy 1, policy_version 1250833 (0.0009) [2023-12-26 09:38:57,405][123091] Updated weights for policy 0, policy_version 1259640 (0.0005) [2023-12-26 09:38:57,446][123090] Updated weights for policy 1, policy_version 1250843 (0.0008) [2023-12-26 09:38:57,464][123091] Updated weights for policy 0, policy_version 1259650 (0.0005) [2023-12-26 09:38:57,531][123091] Updated weights for policy 0, policy_version 1259660 (0.0006) [2023-12-26 09:38:58,101][123091] Updated weights for policy 0, policy_version 1259670 (0.0009) [2023-12-26 09:38:58,166][123091] Updated weights for policy 0, policy_version 1259680 (0.0008) [2023-12-26 09:38:58,227][123091] Updated weights for policy 0, policy_version 1259690 (0.0008) [2023-12-26 09:38:58,395][123090] Updated weights for policy 1, policy_version 1250854 (0.0010) [2023-12-26 09:38:58,470][123090] Updated weights for policy 1, policy_version 1250865 (0.0009) [2023-12-26 09:38:58,537][123090] Updated weights for policy 1, policy_version 1250875 (0.0007) [2023-12-26 09:38:58,785][121949] Fps is (10 sec: 18839.1, 60 sec: 17885.5, 300 sec: 17772.4). Total num frames: 642711552. Throughput: 0: 9054.7, 1: 8909.7. Samples: 642704416. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:38:58,786][121949] Avg episode reward: [(0, '6305.896'), (1, '5159.677')] [2023-12-26 09:38:59,038][123091] Updated weights for policy 0, policy_version 1259700 (0.0008) [2023-12-26 09:38:59,094][123091] Updated weights for policy 0, policy_version 1259710 (0.0008) [2023-12-26 09:38:59,156][123091] Updated weights for policy 0, policy_version 1259720 (0.0006) [2023-12-26 09:38:59,430][123090] Updated weights for policy 1, policy_version 1250885 (0.0007) [2023-12-26 09:38:59,495][123090] Updated weights for policy 1, policy_version 1250895 (0.0006) [2023-12-26 09:38:59,568][123090] Updated weights for policy 1, policy_version 1250905 (0.0009) [2023-12-26 09:38:59,978][123091] Updated weights for policy 0, policy_version 1259730 (0.0008) [2023-12-26 09:39:00,030][123091] Updated weights for policy 0, policy_version 1259740 (0.0011) [2023-12-26 09:39:00,082][123091] Updated weights for policy 0, policy_version 1259750 (0.0010) [2023-12-26 09:39:00,133][123091] Updated weights for policy 0, policy_version 1259760 (0.0010) [2023-12-26 09:39:00,355][123090] Updated weights for policy 1, policy_version 1250915 (0.0010) [2023-12-26 09:39:00,416][123090] Updated weights for policy 1, policy_version 1250925 (0.0010) [2023-12-26 09:39:00,474][123090] Updated weights for policy 1, policy_version 1250935 (0.0010) [2023-12-26 09:39:00,881][123091] Updated weights for policy 0, policy_version 1259770 (0.0009) [2023-12-26 09:39:00,943][123091] Updated weights for policy 0, policy_version 1259780 (0.0009) [2023-12-26 09:39:01,000][123091] Updated weights for policy 0, policy_version 1259790 (0.0010) [2023-12-26 09:39:01,270][123090] Updated weights for policy 1, policy_version 1250945 (0.0009) [2023-12-26 09:39:01,333][123090] Updated weights for policy 1, policy_version 1250955 (0.0009) [2023-12-26 09:39:01,404][123090] Updated weights for policy 1, policy_version 1250965 (0.0010) [2023-12-26 09:39:01,459][123090] Updated weights for policy 1, policy_version 1250975 (0.0006) [2023-12-26 09:39:01,895][123091] Updated weights for policy 0, policy_version 1259800 (0.0009) [2023-12-26 09:39:01,950][123091] Updated weights for policy 0, policy_version 1259810 (0.0009) [2023-12-26 09:39:02,001][123091] Updated weights for policy 0, policy_version 1259820 (0.0009) [2023-12-26 09:39:02,270][123090] Updated weights for policy 1, policy_version 1250985 (0.0010) [2023-12-26 09:39:02,334][123090] Updated weights for policy 1, policy_version 1250995 (0.0010) [2023-12-26 09:39:02,404][123090] Updated weights for policy 1, policy_version 1251005 (0.0011) [2023-12-26 09:39:02,841][123091] Updated weights for policy 0, policy_version 1259830 (0.0009) [2023-12-26 09:39:02,896][123091] Updated weights for policy 0, policy_version 1259840 (0.0008) [2023-12-26 09:39:02,951][123091] Updated weights for policy 0, policy_version 1259850 (0.0009) [2023-12-26 09:39:03,241][123090] Updated weights for policy 1, policy_version 1251015 (0.0012) [2023-12-26 09:39:03,307][123090] Updated weights for policy 1, policy_version 1251025 (0.0010) [2023-12-26 09:39:03,373][123090] Updated weights for policy 1, policy_version 1251035 (0.0010) [2023-12-26 09:39:03,686][123091] Updated weights for policy 0, policy_version 1259860 (0.0010) [2023-12-26 09:39:03,737][123091] Updated weights for policy 0, policy_version 1259870 (0.0010) [2023-12-26 09:39:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 642793472. Throughput: 0: 9086.3, 1: 8876.1. Samples: 642808504. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:39:03,785][121949] Avg episode reward: [(0, '6361.412'), (1, '5323.565')] [2023-12-26 09:39:03,792][123091] Updated weights for policy 0, policy_version 1259880 (0.0010) [2023-12-26 09:39:04,122][123090] Updated weights for policy 1, policy_version 1251045 (0.0009) [2023-12-26 09:39:04,182][123090] Updated weights for policy 1, policy_version 1251055 (0.0008) [2023-12-26 09:39:04,247][123090] Updated weights for policy 1, policy_version 1251065 (0.0008) [2023-12-26 09:39:04,563][123091] Updated weights for policy 0, policy_version 1259890 (0.0009) [2023-12-26 09:39:04,627][123091] Updated weights for policy 0, policy_version 1259900 (0.0007) [2023-12-26 09:39:04,690][123091] Updated weights for policy 0, policy_version 1259910 (0.0009) [2023-12-26 09:39:04,745][123091] Updated weights for policy 0, policy_version 1259920 (0.0010) [2023-12-26 09:39:04,982][123090] Updated weights for policy 1, policy_version 1251075 (0.0008) [2023-12-26 09:39:05,047][123090] Updated weights for policy 1, policy_version 1251085 (0.0010) [2023-12-26 09:39:05,105][123090] Updated weights for policy 1, policy_version 1251095 (0.0010) [2023-12-26 09:39:05,545][123091] Updated weights for policy 0, policy_version 1259930 (0.0009) [2023-12-26 09:39:05,605][123091] Updated weights for policy 0, policy_version 1259940 (0.0009) [2023-12-26 09:39:05,672][123091] Updated weights for policy 0, policy_version 1259950 (0.0008) [2023-12-26 09:39:05,878][123090] Updated weights for policy 1, policy_version 1251105 (0.0010) [2023-12-26 09:39:05,939][123090] Updated weights for policy 1, policy_version 1251115 (0.0010) [2023-12-26 09:39:05,997][123090] Updated weights for policy 1, policy_version 1251125 (0.0010) [2023-12-26 09:39:06,066][123090] Updated weights for policy 1, policy_version 1251135 (0.0010) [2023-12-26 09:39:06,445][123091] Updated weights for policy 0, policy_version 1259960 (0.0008) [2023-12-26 09:39:06,508][123091] Updated weights for policy 0, policy_version 1259970 (0.0010) [2023-12-26 09:39:06,568][123091] Updated weights for policy 0, policy_version 1259980 (0.0010) [2023-12-26 09:39:06,852][123090] Updated weights for policy 1, policy_version 1251145 (0.0010) [2023-12-26 09:39:06,918][123090] Updated weights for policy 1, policy_version 1251155 (0.0011) [2023-12-26 09:39:06,984][123090] Updated weights for policy 1, policy_version 1251165 (0.0010) [2023-12-26 09:39:07,387][123091] Updated weights for policy 0, policy_version 1259990 (0.0010) [2023-12-26 09:39:07,458][123091] Updated weights for policy 0, policy_version 1260000 (0.0008) [2023-12-26 09:39:07,524][123091] Updated weights for policy 0, policy_version 1260010 (0.0008) [2023-12-26 09:39:07,756][123090] Updated weights for policy 1, policy_version 1251175 (0.0011) [2023-12-26 09:39:07,823][123090] Updated weights for policy 1, policy_version 1251185 (0.0010) [2023-12-26 09:39:07,885][123090] Updated weights for policy 1, policy_version 1251195 (0.0010) [2023-12-26 09:39:08,246][123091] Updated weights for policy 0, policy_version 1260020 (0.0007) [2023-12-26 09:39:08,292][123091] Updated weights for policy 0, policy_version 1260030 (0.0007) [2023-12-26 09:39:08,353][123091] Updated weights for policy 0, policy_version 1260040 (0.0007) [2023-12-26 09:39:08,678][123090] Updated weights for policy 1, policy_version 1251205 (0.0010) [2023-12-26 09:39:08,741][123090] Updated weights for policy 1, policy_version 1251215 (0.0010) [2023-12-26 09:39:08,784][121949] Fps is (10 sec: 17205.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 642883584. Throughput: 0: 9123.3, 1: 8922.2. Samples: 642862492. Policy #0 lag: (min: 5.0, avg: 11.5, max: 37.0) [2023-12-26 09:39:08,785][121949] Avg episode reward: [(0, '6310.789'), (1, '5425.905')] [2023-12-26 09:39:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001260048_322576384.pth... [2023-12-26 09:39:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001258992_322306048.pth [2023-12-26 09:39:08,807][123090] Updated weights for policy 1, policy_version 1251225 (0.0010) [2023-12-26 09:39:08,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001251232_320315392.pth... [2023-12-26 09:39:08,846][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001250176_320045056.pth [2023-12-26 09:39:09,185][123091] Updated weights for policy 0, policy_version 1260050 (0.0009) [2023-12-26 09:39:09,256][123091] Updated weights for policy 0, policy_version 1260060 (0.0009) [2023-12-26 09:39:09,317][123091] Updated weights for policy 0, policy_version 1260070 (0.0009) [2023-12-26 09:39:09,392][123091] Updated weights for policy 0, policy_version 1260080 (0.0008) [2023-12-26 09:39:09,659][123090] Updated weights for policy 1, policy_version 1251235 (0.0010) [2023-12-26 09:39:09,713][123090] Updated weights for policy 1, policy_version 1251245 (0.0010) [2023-12-26 09:39:09,767][123090] Updated weights for policy 1, policy_version 1251255 (0.0009) [2023-12-26 09:39:10,249][123091] Updated weights for policy 0, policy_version 1260090 (0.0007) [2023-12-26 09:39:10,308][123091] Updated weights for policy 0, policy_version 1260100 (0.0009) [2023-12-26 09:39:10,380][123091] Updated weights for policy 0, policy_version 1260110 (0.0009) [2023-12-26 09:39:10,608][123090] Updated weights for policy 1, policy_version 1251265 (0.0010) [2023-12-26 09:39:10,668][123090] Updated weights for policy 1, policy_version 1251275 (0.0007) [2023-12-26 09:39:10,726][123090] Updated weights for policy 1, policy_version 1251285 (0.0010) [2023-12-26 09:39:10,790][123090] Updated weights for policy 1, policy_version 1251295 (0.0010) [2023-12-26 09:39:11,114][123091] Updated weights for policy 0, policy_version 1260120 (0.0009) [2023-12-26 09:39:11,173][123091] Updated weights for policy 0, policy_version 1260130 (0.0011) [2023-12-26 09:39:11,221][123091] Updated weights for policy 0, policy_version 1260140 (0.0008) [2023-12-26 09:39:11,683][123090] Updated weights for policy 1, policy_version 1251305 (0.0009) [2023-12-26 09:39:11,757][123090] Updated weights for policy 1, policy_version 1251315 (0.0009) [2023-12-26 09:39:11,825][123090] Updated weights for policy 1, policy_version 1251325 (0.0009) [2023-12-26 09:39:12,106][123091] Updated weights for policy 0, policy_version 1260150 (0.0009) [2023-12-26 09:39:12,176][123091] Updated weights for policy 0, policy_version 1260160 (0.0009) [2023-12-26 09:39:12,243][123091] Updated weights for policy 0, policy_version 1260170 (0.0010) [2023-12-26 09:39:12,621][123090] Updated weights for policy 1, policy_version 1251335 (0.0007) [2023-12-26 09:39:12,679][123090] Updated weights for policy 1, policy_version 1251345 (0.0005) [2023-12-26 09:39:12,739][123090] Updated weights for policy 1, policy_version 1251355 (0.0006) [2023-12-26 09:39:13,028][123091] Updated weights for policy 0, policy_version 1260180 (0.0009) [2023-12-26 09:39:13,086][123091] Updated weights for policy 0, policy_version 1260190 (0.0009) [2023-12-26 09:39:13,151][123091] Updated weights for policy 0, policy_version 1260200 (0.0009) [2023-12-26 09:39:13,503][123090] Updated weights for policy 1, policy_version 1251365 (0.0009) [2023-12-26 09:39:13,556][123090] Updated weights for policy 1, policy_version 1251375 (0.0009) [2023-12-26 09:39:13,613][123090] Updated weights for policy 1, policy_version 1251385 (0.0009) [2023-12-26 09:39:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 642973696. Throughput: 0: 9093.3, 1: 8856.8. Samples: 642965420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:13,785][121949] Avg episode reward: [(0, '6308.319'), (1, '5361.762')] [2023-12-26 09:39:13,996][123091] Updated weights for policy 0, policy_version 1260210 (0.0010) [2023-12-26 09:39:14,047][123091] Updated weights for policy 0, policy_version 1260220 (0.0010) [2023-12-26 09:39:14,102][123091] Updated weights for policy 0, policy_version 1260230 (0.0010) [2023-12-26 09:39:14,157][123091] Updated weights for policy 0, policy_version 1260240 (0.0010) [2023-12-26 09:39:14,458][123090] Updated weights for policy 1, policy_version 1251395 (0.0008) [2023-12-26 09:39:14,517][123090] Updated weights for policy 1, policy_version 1251405 (0.0007) [2023-12-26 09:39:14,576][123090] Updated weights for policy 1, policy_version 1251415 (0.0010) [2023-12-26 09:39:15,018][123091] Updated weights for policy 0, policy_version 1260250 (0.0010) [2023-12-26 09:39:15,076][123091] Updated weights for policy 0, policy_version 1260260 (0.0009) [2023-12-26 09:39:15,136][123091] Updated weights for policy 0, policy_version 1260270 (0.0010) [2023-12-26 09:39:15,320][123090] Updated weights for policy 1, policy_version 1251425 (0.0010) [2023-12-26 09:39:15,396][123090] Updated weights for policy 1, policy_version 1251435 (0.0005) [2023-12-26 09:39:15,464][123090] Updated weights for policy 1, policy_version 1251445 (0.0005) [2023-12-26 09:39:15,518][123090] Updated weights for policy 1, policy_version 1251455 (0.0007) [2023-12-26 09:39:15,922][123091] Updated weights for policy 0, policy_version 1260280 (0.0009) [2023-12-26 09:39:15,969][123091] Updated weights for policy 0, policy_version 1260290 (0.0005) [2023-12-26 09:39:16,016][123091] Updated weights for policy 0, policy_version 1260300 (0.0005) [2023-12-26 09:39:16,306][123090] Updated weights for policy 1, policy_version 1251465 (0.0009) [2023-12-26 09:39:16,374][123090] Updated weights for policy 1, policy_version 1251475 (0.0010) [2023-12-26 09:39:16,425][123090] Updated weights for policy 1, policy_version 1251485 (0.0009) [2023-12-26 09:39:16,628][123091] Updated weights for policy 0, policy_version 1260310 (0.0008) [2023-12-26 09:39:16,678][123091] Updated weights for policy 0, policy_version 1260320 (0.0006) [2023-12-26 09:39:16,728][123091] Updated weights for policy 0, policy_version 1260330 (0.0005) [2023-12-26 09:39:17,319][123090] Updated weights for policy 1, policy_version 1251495 (0.0010) [2023-12-26 09:39:17,373][123090] Updated weights for policy 1, policy_version 1251505 (0.0009) [2023-12-26 09:39:17,431][123090] Updated weights for policy 1, policy_version 1251515 (0.0010) [2023-12-26 09:39:17,487][123091] Updated weights for policy 0, policy_version 1260340 (0.0007) [2023-12-26 09:39:17,552][123091] Updated weights for policy 0, policy_version 1260350 (0.0009) [2023-12-26 09:39:17,612][123091] Updated weights for policy 0, policy_version 1260360 (0.0010) [2023-12-26 09:39:18,301][123090] Updated weights for policy 1, policy_version 1251525 (0.0010) [2023-12-26 09:39:18,350][123091] Updated weights for policy 0, policy_version 1260370 (0.0010) [2023-12-26 09:39:18,376][123090] Updated weights for policy 1, policy_version 1251535 (0.0009) [2023-12-26 09:39:18,406][123091] Updated weights for policy 0, policy_version 1260380 (0.0009) [2023-12-26 09:39:18,443][123090] Updated weights for policy 1, policy_version 1251545 (0.0006) [2023-12-26 09:39:18,464][123091] Updated weights for policy 0, policy_version 1260390 (0.0008) [2023-12-26 09:39:18,526][123091] Updated weights for policy 0, policy_version 1260400 (0.0008) [2023-12-26 09:39:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 643063808. Throughput: 0: 9031.0, 1: 8840.3. Samples: 643071948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:18,785][121949] Avg episode reward: [(0, '6335.374'), (1, '5192.348')] [2023-12-26 09:39:19,272][123091] Updated weights for policy 0, policy_version 1260410 (0.0008) [2023-12-26 09:39:19,329][123091] Updated weights for policy 0, policy_version 1260420 (0.0011) [2023-12-26 09:39:19,343][123090] Updated weights for policy 1, policy_version 1251555 (0.0008) [2023-12-26 09:39:19,394][123091] Updated weights for policy 0, policy_version 1260430 (0.0010) [2023-12-26 09:39:19,402][123090] Updated weights for policy 1, policy_version 1251565 (0.0007) [2023-12-26 09:39:19,452][123090] Updated weights for policy 1, policy_version 1251575 (0.0009) [2023-12-26 09:39:20,208][123091] Updated weights for policy 0, policy_version 1260440 (0.0010) [2023-12-26 09:39:20,259][123091] Updated weights for policy 0, policy_version 1260450 (0.0007) [2023-12-26 09:39:20,299][123090] Updated weights for policy 1, policy_version 1251585 (0.0009) [2023-12-26 09:39:20,310][123091] Updated weights for policy 0, policy_version 1260460 (0.0007) [2023-12-26 09:39:20,361][123090] Updated weights for policy 1, policy_version 1251595 (0.0008) [2023-12-26 09:39:20,437][123090] Updated weights for policy 1, policy_version 1251605 (0.0005) [2023-12-26 09:39:20,505][123090] Updated weights for policy 1, policy_version 1251615 (0.0009) [2023-12-26 09:39:21,134][123091] Updated weights for policy 0, policy_version 1260470 (0.0008) [2023-12-26 09:39:21,204][123091] Updated weights for policy 0, policy_version 1260480 (0.0008) [2023-12-26 09:39:21,270][123091] Updated weights for policy 0, policy_version 1260490 (0.0007) [2023-12-26 09:39:21,353][123090] Updated weights for policy 1, policy_version 1251625 (0.0008) [2023-12-26 09:39:21,422][123090] Updated weights for policy 1, policy_version 1251635 (0.0010) [2023-12-26 09:39:21,479][123090] Updated weights for policy 1, policy_version 1251645 (0.0009) [2023-12-26 09:39:22,094][123091] Updated weights for policy 0, policy_version 1260500 (0.0009) [2023-12-26 09:39:22,156][123091] Updated weights for policy 0, policy_version 1260510 (0.0009) [2023-12-26 09:39:22,218][123091] Updated weights for policy 0, policy_version 1260520 (0.0009) [2023-12-26 09:39:22,350][123090] Updated weights for policy 1, policy_version 1251655 (0.0009) [2023-12-26 09:39:22,415][123090] Updated weights for policy 1, policy_version 1251665 (0.0009) [2023-12-26 09:39:22,477][123090] Updated weights for policy 1, policy_version 1251675 (0.0009) [2023-12-26 09:39:23,002][123091] Updated weights for policy 0, policy_version 1260530 (0.0010) [2023-12-26 09:39:23,072][123091] Updated weights for policy 0, policy_version 1260540 (0.0009) [2023-12-26 09:39:23,140][123091] Updated weights for policy 0, policy_version 1260550 (0.0010) [2023-12-26 09:39:23,199][123091] Updated weights for policy 0, policy_version 1260560 (0.0009) [2023-12-26 09:39:23,323][123090] Updated weights for policy 1, policy_version 1251685 (0.0010) [2023-12-26 09:39:23,387][123090] Updated weights for policy 1, policy_version 1251695 (0.0009) [2023-12-26 09:39:23,451][123090] Updated weights for policy 1, policy_version 1251705 (0.0010) [2023-12-26 09:39:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 643145728. Throughput: 0: 8990.5, 1: 8729.5. Samples: 643122900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:23,785][121949] Avg episode reward: [(0, '6340.501'), (1, '5219.739')] [2023-12-26 09:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001251712_320438272.pth... [2023-12-26 09:39:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001260560_322707456.pth... [2023-12-26 09:39:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001250720_320184320.pth [2023-12-26 09:39:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001259504_322437120.pth [2023-12-26 09:39:23,974][123091] Updated weights for policy 0, policy_version 1260570 (0.0007) [2023-12-26 09:39:24,043][123091] Updated weights for policy 0, policy_version 1260580 (0.0008) [2023-12-26 09:39:24,123][123091] Updated weights for policy 0, policy_version 1260590 (0.0009) [2023-12-26 09:39:24,303][123090] Updated weights for policy 1, policy_version 1251715 (0.0008) [2023-12-26 09:39:24,364][123090] Updated weights for policy 1, policy_version 1251725 (0.0005) [2023-12-26 09:39:24,431][123090] Updated weights for policy 1, policy_version 1251735 (0.0005) [2023-12-26 09:39:24,872][123091] Updated weights for policy 0, policy_version 1260600 (0.0010) [2023-12-26 09:39:24,920][123091] Updated weights for policy 0, policy_version 1260610 (0.0010) [2023-12-26 09:39:24,971][123091] Updated weights for policy 0, policy_version 1260620 (0.0010) [2023-12-26 09:39:25,112][123090] Updated weights for policy 1, policy_version 1251745 (0.0005) [2023-12-26 09:39:25,179][123090] Updated weights for policy 1, policy_version 1251755 (0.0005) [2023-12-26 09:39:25,239][123090] Updated weights for policy 1, policy_version 1251765 (0.0005) [2023-12-26 09:39:25,287][123090] Updated weights for policy 1, policy_version 1251775 (0.0005) [2023-12-26 09:39:25,823][123091] Updated weights for policy 0, policy_version 1260630 (0.0010) [2023-12-26 09:39:25,875][123091] Updated weights for policy 0, policy_version 1260640 (0.0010) [2023-12-26 09:39:25,936][123091] Updated weights for policy 0, policy_version 1260650 (0.0011) [2023-12-26 09:39:25,943][123090] Updated weights for policy 1, policy_version 1251785 (0.0008) [2023-12-26 09:39:26,006][123090] Updated weights for policy 1, policy_version 1251795 (0.0008) [2023-12-26 09:39:26,069][123090] Updated weights for policy 1, policy_version 1251805 (0.0008) [2023-12-26 09:39:26,651][123091] Updated weights for policy 0, policy_version 1260660 (0.0009) [2023-12-26 09:39:26,709][123091] Updated weights for policy 0, policy_version 1260670 (0.0005) [2023-12-26 09:39:26,769][123091] Updated weights for policy 0, policy_version 1260680 (0.0005) [2023-12-26 09:39:26,778][123090] Updated weights for policy 1, policy_version 1251815 (0.0008) [2023-12-26 09:39:26,841][123090] Updated weights for policy 1, policy_version 1251825 (0.0010) [2023-12-26 09:39:26,907][123090] Updated weights for policy 1, policy_version 1251835 (0.0006) [2023-12-26 09:39:27,429][123091] Updated weights for policy 0, policy_version 1260690 (0.0006) [2023-12-26 09:39:27,481][123091] Updated weights for policy 0, policy_version 1260700 (0.0006) [2023-12-26 09:39:27,555][123090] Updated weights for policy 1, policy_version 1251845 (0.0007) [2023-12-26 09:39:27,560][123091] Updated weights for policy 0, policy_version 1260710 (0.0006) [2023-12-26 09:39:27,607][123090] Updated weights for policy 1, policy_version 1251855 (0.0010) [2023-12-26 09:39:27,621][123091] Updated weights for policy 0, policy_version 1260720 (0.0005) [2023-12-26 09:39:27,666][123090] Updated weights for policy 1, policy_version 1251865 (0.0006) [2023-12-26 09:39:28,284][123090] Updated weights for policy 1, policy_version 1251875 (0.0006) [2023-12-26 09:39:28,308][123091] Updated weights for policy 0, policy_version 1260730 (0.0006) [2023-12-26 09:39:28,343][123090] Updated weights for policy 1, policy_version 1251885 (0.0010) [2023-12-26 09:39:28,380][123091] Updated weights for policy 0, policy_version 1260740 (0.0008) [2023-12-26 09:39:28,407][123090] Updated weights for policy 1, policy_version 1251895 (0.0011) [2023-12-26 09:39:28,439][123091] Updated weights for policy 0, policy_version 1260750 (0.0006) [2023-12-26 09:39:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 643244032. Throughput: 0: 8992.2, 1: 8780.5. Samples: 643233688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:28,785][121949] Avg episode reward: [(0, '6317.277'), (1, '5205.091')] [2023-12-26 09:39:29,246][123090] Updated weights for policy 1, policy_version 1251905 (0.0010) [2023-12-26 09:39:29,262][123091] Updated weights for policy 0, policy_version 1260760 (0.0009) [2023-12-26 09:39:29,308][123090] Updated weights for policy 1, policy_version 1251915 (0.0010) [2023-12-26 09:39:29,321][123091] Updated weights for policy 0, policy_version 1260770 (0.0010) [2023-12-26 09:39:29,378][123090] Updated weights for policy 1, policy_version 1251925 (0.0011) [2023-12-26 09:39:29,388][123091] Updated weights for policy 0, policy_version 1260780 (0.0010) [2023-12-26 09:39:29,444][123090] Updated weights for policy 1, policy_version 1251935 (0.0010) [2023-12-26 09:39:30,219][123090] Updated weights for policy 1, policy_version 1251945 (0.0007) [2023-12-26 09:39:30,256][123091] Updated weights for policy 0, policy_version 1260790 (0.0008) [2023-12-26 09:39:30,283][123090] Updated weights for policy 1, policy_version 1251955 (0.0005) [2023-12-26 09:39:30,322][123091] Updated weights for policy 0, policy_version 1260800 (0.0007) [2023-12-26 09:39:30,341][123090] Updated weights for policy 1, policy_version 1251965 (0.0010) [2023-12-26 09:39:30,386][123091] Updated weights for policy 0, policy_version 1260810 (0.0005) [2023-12-26 09:39:31,074][123090] Updated weights for policy 1, policy_version 1251975 (0.0011) [2023-12-26 09:39:31,133][123090] Updated weights for policy 1, policy_version 1251985 (0.0010) [2023-12-26 09:39:31,189][123090] Updated weights for policy 1, policy_version 1251995 (0.0010) [2023-12-26 09:39:31,200][123091] Updated weights for policy 0, policy_version 1260820 (0.0006) [2023-12-26 09:39:31,260][123091] Updated weights for policy 0, policy_version 1260830 (0.0009) [2023-12-26 09:39:31,324][123091] Updated weights for policy 0, policy_version 1260840 (0.0009) [2023-12-26 09:39:31,959][123090] Updated weights for policy 1, policy_version 1252005 (0.0010) [2023-12-26 09:39:32,007][123090] Updated weights for policy 1, policy_version 1252015 (0.0010) [2023-12-26 09:39:32,062][123090] Updated weights for policy 1, policy_version 1252025 (0.0010) [2023-12-26 09:39:32,204][123091] Updated weights for policy 0, policy_version 1260850 (0.0010) [2023-12-26 09:39:32,260][123091] Updated weights for policy 0, policy_version 1260860 (0.0009) [2023-12-26 09:39:32,317][123091] Updated weights for policy 0, policy_version 1260870 (0.0009) [2023-12-26 09:39:32,379][123091] Updated weights for policy 0, policy_version 1260880 (0.0009) [2023-12-26 09:39:32,834][123090] Updated weights for policy 1, policy_version 1252035 (0.0009) [2023-12-26 09:39:32,889][123090] Updated weights for policy 1, policy_version 1252045 (0.0005) [2023-12-26 09:39:32,948][123090] Updated weights for policy 1, policy_version 1252055 (0.0005) [2023-12-26 09:39:33,278][123091] Updated weights for policy 0, policy_version 1260890 (0.0005) [2023-12-26 09:39:33,330][123091] Updated weights for policy 0, policy_version 1260900 (0.0005) [2023-12-26 09:39:33,384][123091] Updated weights for policy 0, policy_version 1260910 (0.0005) [2023-12-26 09:39:33,591][123090] Updated weights for policy 1, policy_version 1252065 (0.0005) [2023-12-26 09:39:33,642][123090] Updated weights for policy 1, policy_version 1252075 (0.0005) [2023-12-26 09:39:33,695][123090] Updated weights for policy 1, policy_version 1252085 (0.0005) [2023-12-26 09:39:33,742][123090] Updated weights for policy 1, policy_version 1252095 (0.0005) [2023-12-26 09:39:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 643334144. Throughput: 0: 9007.3, 1: 8820.1. Samples: 643342772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:33,785][121949] Avg episode reward: [(0, '6301.197'), (1, '5235.031')] [2023-12-26 09:39:34,041][123091] Updated weights for policy 0, policy_version 1260920 (0.0006) [2023-12-26 09:39:34,102][123091] Updated weights for policy 0, policy_version 1260930 (0.0006) [2023-12-26 09:39:34,172][123091] Updated weights for policy 0, policy_version 1260940 (0.0008) [2023-12-26 09:39:34,493][123090] Updated weights for policy 1, policy_version 1252105 (0.0009) [2023-12-26 09:39:34,556][123090] Updated weights for policy 1, policy_version 1252118 (0.0010) [2023-12-26 09:39:34,871][123091] Updated weights for policy 0, policy_version 1260950 (0.0007) [2023-12-26 09:39:34,938][123091] Updated weights for policy 0, policy_version 1260960 (0.0010) [2023-12-26 09:39:35,005][123091] Updated weights for policy 0, policy_version 1260970 (0.0008) [2023-12-26 09:39:35,375][123090] Updated weights for policy 1, policy_version 1252129 (0.0009) [2023-12-26 09:39:35,426][123090] Updated weights for policy 1, policy_version 1252139 (0.0005) [2023-12-26 09:39:35,472][123090] Updated weights for policy 1, policy_version 1252149 (0.0005) [2023-12-26 09:39:35,518][123090] Updated weights for policy 1, policy_version 1252159 (0.0005) [2023-12-26 09:39:35,570][123091] Updated weights for policy 0, policy_version 1260980 (0.0006) [2023-12-26 09:39:35,617][123091] Updated weights for policy 0, policy_version 1260990 (0.0009) [2023-12-26 09:39:35,672][123091] Updated weights for policy 0, policy_version 1261000 (0.0010) [2023-12-26 09:39:36,202][123090] Updated weights for policy 1, policy_version 1252169 (0.0009) [2023-12-26 09:39:36,259][123090] Updated weights for policy 1, policy_version 1252179 (0.0009) [2023-12-26 09:39:36,316][123090] Updated weights for policy 1, policy_version 1252189 (0.0010) [2023-12-26 09:39:36,517][123091] Updated weights for policy 0, policy_version 1261010 (0.0011) [2023-12-26 09:39:36,580][123091] Updated weights for policy 0, policy_version 1261020 (0.0011) [2023-12-26 09:39:36,645][123091] Updated weights for policy 0, policy_version 1261030 (0.0010) [2023-12-26 09:39:36,715][123091] Updated weights for policy 0, policy_version 1261040 (0.0011) [2023-12-26 09:39:37,176][123090] Updated weights for policy 1, policy_version 1252199 (0.0010) [2023-12-26 09:39:37,234][123090] Updated weights for policy 1, policy_version 1252209 (0.0010) [2023-12-26 09:39:37,290][123090] Updated weights for policy 1, policy_version 1252219 (0.0010) [2023-12-26 09:39:37,537][123091] Updated weights for policy 0, policy_version 1261050 (0.0011) [2023-12-26 09:39:37,608][123091] Updated weights for policy 0, policy_version 1261060 (0.0011) [2023-12-26 09:39:37,657][123091] Updated weights for policy 0, policy_version 1261070 (0.0010) [2023-12-26 09:39:37,960][123090] Updated weights for policy 1, policy_version 1252229 (0.0006) [2023-12-26 09:39:38,027][123090] Updated weights for policy 1, policy_version 1252239 (0.0006) [2023-12-26 09:39:38,081][123090] Updated weights for policy 1, policy_version 1252249 (0.0005) [2023-12-26 09:39:38,475][123091] Updated weights for policy 0, policy_version 1261080 (0.0010) [2023-12-26 09:39:38,534][123091] Updated weights for policy 0, policy_version 1261090 (0.0010) [2023-12-26 09:39:38,589][123091] Updated weights for policy 0, policy_version 1261100 (0.0010) [2023-12-26 09:39:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 643424256. Throughput: 0: 9052.1, 1: 8829.8. Samples: 643399764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:38,785][121949] Avg episode reward: [(0, '6320.466'), (1, '5095.150')] [2023-12-26 09:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001261104_322846720.pth... [2023-12-26 09:39:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001260048_322576384.pth [2023-12-26 09:39:38,812][123090] Updated weights for policy 1, policy_version 1252259 (0.0007) [2023-12-26 09:39:38,883][123090] Updated weights for policy 1, policy_version 1252269 (0.0011) [2023-12-26 09:39:38,950][123090] Updated weights for policy 1, policy_version 1252279 (0.0011) [2023-12-26 09:39:38,998][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001252288_320585728.pth... [2023-12-26 09:39:39,001][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001251232_320315392.pth [2023-12-26 09:39:39,456][123091] Updated weights for policy 0, policy_version 1261110 (0.0009) [2023-12-26 09:39:39,524][123091] Updated weights for policy 0, policy_version 1261120 (0.0006) [2023-12-26 09:39:39,590][123091] Updated weights for policy 0, policy_version 1261130 (0.0006) [2023-12-26 09:39:39,751][123090] Updated weights for policy 1, policy_version 1252289 (0.0010) [2023-12-26 09:39:39,822][123090] Updated weights for policy 1, policy_version 1252299 (0.0011) [2023-12-26 09:39:39,894][123090] Updated weights for policy 1, policy_version 1252309 (0.0010) [2023-12-26 09:39:39,965][123090] Updated weights for policy 1, policy_version 1252319 (0.0011) [2023-12-26 09:39:40,356][123091] Updated weights for policy 0, policy_version 1261140 (0.0008) [2023-12-26 09:39:40,407][123091] Updated weights for policy 0, policy_version 1261150 (0.0010) [2023-12-26 09:39:40,458][123091] Updated weights for policy 0, policy_version 1261160 (0.0010) [2023-12-26 09:39:40,767][123090] Updated weights for policy 1, policy_version 1252329 (0.0008) [2023-12-26 09:39:40,839][123090] Updated weights for policy 1, policy_version 1252339 (0.0009) [2023-12-26 09:39:40,891][123090] Updated weights for policy 1, policy_version 1252349 (0.0009) [2023-12-26 09:39:41,206][123091] Updated weights for policy 0, policy_version 1261170 (0.0010) [2023-12-26 09:39:41,267][123091] Updated weights for policy 0, policy_version 1261180 (0.0010) [2023-12-26 09:39:41,340][123091] Updated weights for policy 0, policy_version 1261190 (0.0008) [2023-12-26 09:39:41,415][123091] Updated weights for policy 0, policy_version 1261200 (0.0008) [2023-12-26 09:39:41,803][123090] Updated weights for policy 1, policy_version 1252359 (0.0010) [2023-12-26 09:39:41,865][123090] Updated weights for policy 1, policy_version 1252369 (0.0008) [2023-12-26 09:39:41,925][123090] Updated weights for policy 1, policy_version 1252379 (0.0008) [2023-12-26 09:39:42,212][123091] Updated weights for policy 0, policy_version 1261210 (0.0011) [2023-12-26 09:39:42,277][123091] Updated weights for policy 0, policy_version 1261220 (0.0011) [2023-12-26 09:39:42,341][123091] Updated weights for policy 0, policy_version 1261230 (0.0010) [2023-12-26 09:39:42,826][123090] Updated weights for policy 1, policy_version 1252389 (0.0009) [2023-12-26 09:39:42,886][123090] Updated weights for policy 1, policy_version 1252399 (0.0009) [2023-12-26 09:39:42,947][123090] Updated weights for policy 1, policy_version 1252409 (0.0009) [2023-12-26 09:39:43,153][123091] Updated weights for policy 0, policy_version 1261240 (0.0006) [2023-12-26 09:39:43,199][123091] Updated weights for policy 0, policy_version 1261250 (0.0005) [2023-12-26 09:39:43,244][123091] Updated weights for policy 0, policy_version 1261260 (0.0005) [2023-12-26 09:39:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 643506176. Throughput: 0: 8939.0, 1: 8831.1. Samples: 643504056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:43,786][121949] Avg episode reward: [(0, '6407.867'), (1, '5087.114')] [2023-12-26 09:39:43,839][123090] Updated weights for policy 1, policy_version 1252419 (0.0009) [2023-12-26 09:39:43,896][123090] Updated weights for policy 1, policy_version 1252429 (0.0009) [2023-12-26 09:39:43,917][123091] Updated weights for policy 0, policy_version 1261270 (0.0008) [2023-12-26 09:39:43,949][123090] Updated weights for policy 1, policy_version 1252439 (0.0008) [2023-12-26 09:39:43,968][123091] Updated weights for policy 0, policy_version 1261280 (0.0010) [2023-12-26 09:39:44,030][123091] Updated weights for policy 0, policy_version 1261290 (0.0010) [2023-12-26 09:39:44,780][123091] Updated weights for policy 0, policy_version 1261300 (0.0010) [2023-12-26 09:39:44,790][123090] Updated weights for policy 1, policy_version 1252449 (0.0006) [2023-12-26 09:39:44,844][123091] Updated weights for policy 0, policy_version 1261310 (0.0007) [2023-12-26 09:39:44,857][123090] Updated weights for policy 1, policy_version 1252459 (0.0009) [2023-12-26 09:39:44,914][123091] Updated weights for policy 0, policy_version 1261320 (0.0007) [2023-12-26 09:39:44,931][123090] Updated weights for policy 1, policy_version 1252469 (0.0009) [2023-12-26 09:39:44,998][123090] Updated weights for policy 1, policy_version 1252479 (0.0008) [2023-12-26 09:39:45,669][123091] Updated weights for policy 0, policy_version 1261330 (0.0008) [2023-12-26 09:39:45,731][123091] Updated weights for policy 0, policy_version 1261340 (0.0007) [2023-12-26 09:39:45,794][123091] Updated weights for policy 0, policy_version 1261350 (0.0005) [2023-12-26 09:39:45,858][123090] Updated weights for policy 1, policy_version 1252489 (0.0009) [2023-12-26 09:39:45,861][123091] Updated weights for policy 0, policy_version 1261360 (0.0006) [2023-12-26 09:39:45,913][123090] Updated weights for policy 1, policy_version 1252499 (0.0010) [2023-12-26 09:39:45,969][123090] Updated weights for policy 1, policy_version 1252509 (0.0009) [2023-12-26 09:39:46,498][123091] Updated weights for policy 0, policy_version 1261370 (0.0009) [2023-12-26 09:39:46,556][123091] Updated weights for policy 0, policy_version 1261380 (0.0009) [2023-12-26 09:39:46,608][123091] Updated weights for policy 0, policy_version 1261390 (0.0009) [2023-12-26 09:39:46,823][123090] Updated weights for policy 1, policy_version 1252519 (0.0009) [2023-12-26 09:39:46,890][123090] Updated weights for policy 1, policy_version 1252529 (0.0009) [2023-12-26 09:39:46,957][123090] Updated weights for policy 1, policy_version 1252539 (0.0009) [2023-12-26 09:39:47,446][123091] Updated weights for policy 0, policy_version 1261400 (0.0006) [2023-12-26 09:39:47,499][123091] Updated weights for policy 0, policy_version 1261410 (0.0005) [2023-12-26 09:39:47,557][123091] Updated weights for policy 0, policy_version 1261420 (0.0005) [2023-12-26 09:39:47,744][123090] Updated weights for policy 1, policy_version 1252549 (0.0009) [2023-12-26 09:39:47,807][123090] Updated weights for policy 1, policy_version 1252560 (0.0010) [2023-12-26 09:39:47,861][123090] Updated weights for policy 1, policy_version 1252570 (0.0010) [2023-12-26 09:39:48,219][123091] Updated weights for policy 0, policy_version 1261430 (0.0008) [2023-12-26 09:39:48,272][123091] Updated weights for policy 0, policy_version 1261440 (0.0010) [2023-12-26 09:39:48,338][123091] Updated weights for policy 0, policy_version 1261450 (0.0009) [2023-12-26 09:39:48,714][123090] Updated weights for policy 1, policy_version 1252580 (0.0010) [2023-12-26 09:39:48,769][123090] Updated weights for policy 1, policy_version 1252590 (0.0010) [2023-12-26 09:39:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 643596288. Throughput: 0: 8995.7, 1: 8832.7. Samples: 643610780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:48,785][121949] Avg episode reward: [(0, '6392.135'), (1, '5074.997')] [2023-12-26 09:39:48,833][123090] Updated weights for policy 1, policy_version 1252600 (0.0010) [2023-12-26 09:39:49,176][123091] Updated weights for policy 0, policy_version 1261460 (0.0009) [2023-12-26 09:39:49,233][123091] Updated weights for policy 0, policy_version 1261470 (0.0009) [2023-12-26 09:39:49,287][123091] Updated weights for policy 0, policy_version 1261480 (0.0009) [2023-12-26 09:39:49,766][123090] Updated weights for policy 1, policy_version 1252610 (0.0009) [2023-12-26 09:39:49,835][123090] Updated weights for policy 1, policy_version 1252620 (0.0010) [2023-12-26 09:39:49,897][123090] Updated weights for policy 1, policy_version 1252630 (0.0009) [2023-12-26 09:39:49,964][123090] Updated weights for policy 1, policy_version 1252640 (0.0009) [2023-12-26 09:39:50,097][123091] Updated weights for policy 0, policy_version 1261490 (0.0009) [2023-12-26 09:39:50,165][123091] Updated weights for policy 0, policy_version 1261501 (0.0009) [2023-12-26 09:39:50,228][123091] Updated weights for policy 0, policy_version 1261511 (0.0009) [2023-12-26 09:39:50,735][123090] Updated weights for policy 1, policy_version 1252650 (0.0011) [2023-12-26 09:39:50,795][123090] Updated weights for policy 1, policy_version 1252660 (0.0011) [2023-12-26 09:39:50,857][123090] Updated weights for policy 1, policy_version 1252670 (0.0011) [2023-12-26 09:39:50,895][123091] Updated weights for policy 0, policy_version 1261521 (0.0008) [2023-12-26 09:39:50,959][123091] Updated weights for policy 0, policy_version 1261531 (0.0007) [2023-12-26 09:39:51,019][123091] Updated weights for policy 0, policy_version 1261541 (0.0009) [2023-12-26 09:39:51,087][123091] Updated weights for policy 0, policy_version 1261551 (0.0009) [2023-12-26 09:39:51,759][123090] Updated weights for policy 1, policy_version 1252680 (0.0011) [2023-12-26 09:39:51,826][123090] Updated weights for policy 1, policy_version 1252690 (0.0011) [2023-12-26 09:39:51,874][123091] Updated weights for policy 0, policy_version 1261561 (0.0009) [2023-12-26 09:39:51,890][123090] Updated weights for policy 1, policy_version 1252700 (0.0007) [2023-12-26 09:39:51,934][123091] Updated weights for policy 0, policy_version 1261571 (0.0009) [2023-12-26 09:39:51,995][123091] Updated weights for policy 0, policy_version 1261581 (0.0009) [2023-12-26 09:39:52,669][123090] Updated weights for policy 1, policy_version 1252710 (0.0006) [2023-12-26 09:39:52,730][123090] Updated weights for policy 1, policy_version 1252720 (0.0011) [2023-12-26 09:39:52,789][123090] Updated weights for policy 1, policy_version 1252730 (0.0010) [2023-12-26 09:39:52,854][123091] Updated weights for policy 0, policy_version 1261591 (0.0007) [2023-12-26 09:39:52,925][123091] Updated weights for policy 0, policy_version 1261601 (0.0006) [2023-12-26 09:39:52,993][123091] Updated weights for policy 0, policy_version 1261611 (0.0006) [2023-12-26 09:39:53,591][123090] Updated weights for policy 1, policy_version 1252740 (0.0011) [2023-12-26 09:39:53,648][123090] Updated weights for policy 1, policy_version 1252750 (0.0007) [2023-12-26 09:39:53,654][123091] Updated weights for policy 0, policy_version 1261621 (0.0006) [2023-12-26 09:39:53,712][123091] Updated weights for policy 0, policy_version 1261631 (0.0005) [2023-12-26 09:39:53,714][123090] Updated weights for policy 1, policy_version 1252760 (0.0005) [2023-12-26 09:39:53,782][123091] Updated weights for policy 0, policy_version 1261641 (0.0006) [2023-12-26 09:39:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 643686400. Throughput: 0: 9017.5, 1: 8767.1. Samples: 643662800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:53,785][121949] Avg episode reward: [(0, '6375.098'), (1, '5144.128')] [2023-12-26 09:39:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001252768_320708608.pth... [2023-12-26 09:39:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001251712_320438272.pth [2023-12-26 09:39:53,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001261648_322985984.pth... [2023-12-26 09:39:53,839][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001260560_322707456.pth [2023-12-26 09:39:54,413][123090] Updated weights for policy 1, policy_version 1252770 (0.0005) [2023-12-26 09:39:54,466][123091] Updated weights for policy 0, policy_version 1261651 (0.0006) [2023-12-26 09:39:54,481][123090] Updated weights for policy 1, policy_version 1252780 (0.0006) [2023-12-26 09:39:54,518][123091] Updated weights for policy 0, policy_version 1261661 (0.0008) [2023-12-26 09:39:54,543][123090] Updated weights for policy 1, policy_version 1252790 (0.0007) [2023-12-26 09:39:54,587][123091] Updated weights for policy 0, policy_version 1261671 (0.0009) [2023-12-26 09:39:54,605][123090] Updated weights for policy 1, policy_version 1252800 (0.0006) [2023-12-26 09:39:55,280][123090] Updated weights for policy 1, policy_version 1252810 (0.0010) [2023-12-26 09:39:55,351][123090] Updated weights for policy 1, policy_version 1252820 (0.0009) [2023-12-26 09:39:55,409][123091] Updated weights for policy 0, policy_version 1261681 (0.0009) [2023-12-26 09:39:55,417][123090] Updated weights for policy 1, policy_version 1252831 (0.0010) [2023-12-26 09:39:55,466][123091] Updated weights for policy 0, policy_version 1261691 (0.0009) [2023-12-26 09:39:55,525][123091] Updated weights for policy 0, policy_version 1261701 (0.0010) [2023-12-26 09:39:55,581][123091] Updated weights for policy 0, policy_version 1261711 (0.0008) [2023-12-26 09:39:56,257][123090] Updated weights for policy 1, policy_version 1252841 (0.0009) [2023-12-26 09:39:56,320][123090] Updated weights for policy 1, policy_version 1252851 (0.0009) [2023-12-26 09:39:56,387][123090] Updated weights for policy 1, policy_version 1252861 (0.0009) [2023-12-26 09:39:56,408][123091] Updated weights for policy 0, policy_version 1261721 (0.0007) [2023-12-26 09:39:56,460][123091] Updated weights for policy 0, policy_version 1261731 (0.0009) [2023-12-26 09:39:56,514][123091] Updated weights for policy 0, policy_version 1261742 (0.0009) [2023-12-26 09:39:57,101][123090] Updated weights for policy 1, policy_version 1252871 (0.0007) [2023-12-26 09:39:57,165][123090] Updated weights for policy 1, policy_version 1252881 (0.0007) [2023-12-26 09:39:57,222][123090] Updated weights for policy 1, policy_version 1252892 (0.0009) [2023-12-26 09:39:57,413][123091] Updated weights for policy 0, policy_version 1261752 (0.0009) [2023-12-26 09:39:57,474][123091] Updated weights for policy 0, policy_version 1261762 (0.0009) [2023-12-26 09:39:57,537][123091] Updated weights for policy 0, policy_version 1261772 (0.0009) [2023-12-26 09:39:57,942][123090] Updated weights for policy 1, policy_version 1252902 (0.0008) [2023-12-26 09:39:57,992][123090] Updated weights for policy 1, policy_version 1252912 (0.0009) [2023-12-26 09:39:58,056][123090] Updated weights for policy 1, policy_version 1252922 (0.0009) [2023-12-26 09:39:58,430][123091] Updated weights for policy 0, policy_version 1261782 (0.0009) [2023-12-26 09:39:58,496][123091] Updated weights for policy 0, policy_version 1261792 (0.0009) [2023-12-26 09:39:58,569][123091] Updated weights for policy 0, policy_version 1261802 (0.0008) [2023-12-26 09:39:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.7, 300 sec: 17800.2). Total num frames: 643776512. Throughput: 0: 9050.8, 1: 8865.4. Samples: 643771648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:39:58,785][121949] Avg episode reward: [(0, '6388.908'), (1, '5344.816')] [2023-12-26 09:39:58,877][123090] Updated weights for policy 1, policy_version 1252932 (0.0008) [2023-12-26 09:39:58,943][123090] Updated weights for policy 1, policy_version 1252942 (0.0008) [2023-12-26 09:39:59,009][123090] Updated weights for policy 1, policy_version 1252952 (0.0008) [2023-12-26 09:39:59,354][123091] Updated weights for policy 0, policy_version 1261812 (0.0008) [2023-12-26 09:39:59,419][123091] Updated weights for policy 0, policy_version 1261822 (0.0010) [2023-12-26 09:39:59,477][123091] Updated weights for policy 0, policy_version 1261832 (0.0010) [2023-12-26 09:39:59,790][123090] Updated weights for policy 1, policy_version 1252962 (0.0008) [2023-12-26 09:39:59,856][123090] Updated weights for policy 1, policy_version 1252972 (0.0007) [2023-12-26 09:39:59,912][123090] Updated weights for policy 1, policy_version 1252982 (0.0009) [2023-12-26 09:39:59,975][123090] Updated weights for policy 1, policy_version 1252992 (0.0009) [2023-12-26 09:40:00,345][123091] Updated weights for policy 0, policy_version 1261842 (0.0009) [2023-12-26 09:40:00,405][123091] Updated weights for policy 0, policy_version 1261852 (0.0010) [2023-12-26 09:40:00,457][123091] Updated weights for policy 0, policy_version 1261863 (0.0010) [2023-12-26 09:40:00,706][123090] Updated weights for policy 1, policy_version 1253002 (0.0005) [2023-12-26 09:40:00,764][123090] Updated weights for policy 1, policy_version 1253012 (0.0005) [2023-12-26 09:40:00,821][123090] Updated weights for policy 1, policy_version 1253022 (0.0009) [2023-12-26 09:40:01,289][123091] Updated weights for policy 0, policy_version 1261873 (0.0010) [2023-12-26 09:40:01,349][123091] Updated weights for policy 0, policy_version 1261883 (0.0009) [2023-12-26 09:40:01,412][123091] Updated weights for policy 0, policy_version 1261893 (0.0009) [2023-12-26 09:40:01,465][123091] Updated weights for policy 0, policy_version 1261903 (0.0009) [2023-12-26 09:40:01,576][123090] Updated weights for policy 1, policy_version 1253032 (0.0010) [2023-12-26 09:40:01,642][123090] Updated weights for policy 1, policy_version 1253042 (0.0014) [2023-12-26 09:40:01,700][123090] Updated weights for policy 1, policy_version 1253052 (0.0009) [2023-12-26 09:40:02,270][123091] Updated weights for policy 0, policy_version 1261913 (0.0007) [2023-12-26 09:40:02,331][123091] Updated weights for policy 0, policy_version 1261923 (0.0008) [2023-12-26 09:40:02,395][123091] Updated weights for policy 0, policy_version 1261933 (0.0008) [2023-12-26 09:40:02,486][123090] Updated weights for policy 1, policy_version 1253062 (0.0009) [2023-12-26 09:40:02,538][123090] Updated weights for policy 1, policy_version 1253072 (0.0008) [2023-12-26 09:40:02,585][123090] Updated weights for policy 1, policy_version 1253082 (0.0009) [2023-12-26 09:40:03,109][123091] Updated weights for policy 0, policy_version 1261943 (0.0009) [2023-12-26 09:40:03,173][123091] Updated weights for policy 0, policy_version 1261953 (0.0009) [2023-12-26 09:40:03,236][123091] Updated weights for policy 0, policy_version 1261963 (0.0009) [2023-12-26 09:40:03,418][123090] Updated weights for policy 1, policy_version 1253092 (0.0010) [2023-12-26 09:40:03,483][123090] Updated weights for policy 1, policy_version 1253102 (0.0010) [2023-12-26 09:40:03,534][123090] Updated weights for policy 1, policy_version 1253112 (0.0010) [2023-12-26 09:40:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 643866624. Throughput: 0: 8983.9, 1: 8927.6. Samples: 643877968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:03,785][121949] Avg episode reward: [(0, '6333.699'), (1, '5444.571')] [2023-12-26 09:40:03,966][123091] Updated weights for policy 0, policy_version 1261973 (0.0009) [2023-12-26 09:40:04,016][123091] Updated weights for policy 0, policy_version 1261983 (0.0009) [2023-12-26 09:40:04,085][123091] Updated weights for policy 0, policy_version 1261993 (0.0010) [2023-12-26 09:40:04,366][123090] Updated weights for policy 1, policy_version 1253122 (0.0010) [2023-12-26 09:40:04,421][123090] Updated weights for policy 1, policy_version 1253132 (0.0010) [2023-12-26 09:40:04,469][123090] Updated weights for policy 1, policy_version 1253142 (0.0010) [2023-12-26 09:40:04,521][123090] Updated weights for policy 1, policy_version 1253152 (0.0010) [2023-12-26 09:40:04,925][123091] Updated weights for policy 0, policy_version 1262003 (0.0009) [2023-12-26 09:40:04,975][123091] Updated weights for policy 0, policy_version 1262013 (0.0009) [2023-12-26 09:40:05,026][123091] Updated weights for policy 0, policy_version 1262023 (0.0009) [2023-12-26 09:40:05,351][123090] Updated weights for policy 1, policy_version 1253162 (0.0010) [2023-12-26 09:40:05,409][123090] Updated weights for policy 1, policy_version 1253172 (0.0010) [2023-12-26 09:40:05,456][123090] Updated weights for policy 1, policy_version 1253182 (0.0010) [2023-12-26 09:40:05,879][123091] Updated weights for policy 0, policy_version 1262033 (0.0009) [2023-12-26 09:40:05,932][123091] Updated weights for policy 0, policy_version 1262043 (0.0009) [2023-12-26 09:40:05,990][123091] Updated weights for policy 0, policy_version 1262055 (0.0009) [2023-12-26 09:40:06,303][123090] Updated weights for policy 1, policy_version 1253192 (0.0009) [2023-12-26 09:40:06,371][123090] Updated weights for policy 1, policy_version 1253202 (0.0010) [2023-12-26 09:40:06,439][123090] Updated weights for policy 1, policy_version 1253212 (0.0009) [2023-12-26 09:40:06,871][123091] Updated weights for policy 0, policy_version 1262065 (0.0009) [2023-12-26 09:40:06,921][123091] Updated weights for policy 0, policy_version 1262075 (0.0005) [2023-12-26 09:40:06,998][123091] Updated weights for policy 0, policy_version 1262085 (0.0006) [2023-12-26 09:40:07,065][123091] Updated weights for policy 0, policy_version 1262095 (0.0006) [2023-12-26 09:40:07,170][123090] Updated weights for policy 1, policy_version 1253222 (0.0010) [2023-12-26 09:40:07,223][123090] Updated weights for policy 1, policy_version 1253232 (0.0009) [2023-12-26 09:40:07,274][123090] Updated weights for policy 1, policy_version 1253242 (0.0010) [2023-12-26 09:40:07,794][123091] Updated weights for policy 0, policy_version 1262105 (0.0008) [2023-12-26 09:40:07,853][123091] Updated weights for policy 0, policy_version 1262115 (0.0009) [2023-12-26 09:40:07,913][123091] Updated weights for policy 0, policy_version 1262125 (0.0009) [2023-12-26 09:40:08,126][123090] Updated weights for policy 1, policy_version 1253252 (0.0010) [2023-12-26 09:40:08,188][123090] Updated weights for policy 1, policy_version 1253262 (0.0010) [2023-12-26 09:40:08,240][123090] Updated weights for policy 1, policy_version 1253272 (0.0010) [2023-12-26 09:40:08,771][123091] Updated weights for policy 0, policy_version 1262135 (0.0007) [2023-12-26 09:40:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 643948544. Throughput: 0: 8958.1, 1: 8960.0. Samples: 643929216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:08,786][121949] Avg episode reward: [(0, '6296.353'), (1, '5290.308')] [2023-12-26 09:40:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001253280_320839680.pth... [2023-12-26 09:40:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001252288_320585728.pth [2023-12-26 09:40:08,837][123091] Updated weights for policy 0, policy_version 1262145 (0.0008) [2023-12-26 09:40:08,902][123091] Updated weights for policy 0, policy_version 1262155 (0.0008) [2023-12-26 09:40:08,932][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001262160_323117056.pth... [2023-12-26 09:40:08,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001261104_322846720.pth [2023-12-26 09:40:09,018][123090] Updated weights for policy 1, policy_version 1253282 (0.0009) [2023-12-26 09:40:09,070][123090] Updated weights for policy 1, policy_version 1253292 (0.0007) [2023-12-26 09:40:09,145][123090] Updated weights for policy 1, policy_version 1253302 (0.0011) [2023-12-26 09:40:09,213][123090] Updated weights for policy 1, policy_version 1253312 (0.0011) [2023-12-26 09:40:09,712][123091] Updated weights for policy 0, policy_version 1262165 (0.0009) [2023-12-26 09:40:09,769][123091] Updated weights for policy 0, policy_version 1262175 (0.0009) [2023-12-26 09:40:09,837][123091] Updated weights for policy 0, policy_version 1262185 (0.0010) [2023-12-26 09:40:09,965][123090] Updated weights for policy 1, policy_version 1253322 (0.0011) [2023-12-26 09:40:10,030][123090] Updated weights for policy 1, policy_version 1253332 (0.0011) [2023-12-26 09:40:10,094][123090] Updated weights for policy 1, policy_version 1253342 (0.0011) [2023-12-26 09:40:10,710][123091] Updated weights for policy 0, policy_version 1262195 (0.0008) [2023-12-26 09:40:10,725][123090] Updated weights for policy 1, policy_version 1253352 (0.0007) [2023-12-26 09:40:10,776][123091] Updated weights for policy 0, policy_version 1262205 (0.0007) [2023-12-26 09:40:10,780][123090] Updated weights for policy 1, policy_version 1253362 (0.0007) [2023-12-26 09:40:10,828][123090] Updated weights for policy 1, policy_version 1253372 (0.0007) [2023-12-26 09:40:10,842][123091] Updated weights for policy 0, policy_version 1262215 (0.0008) [2023-12-26 09:40:11,568][123090] Updated weights for policy 1, policy_version 1253382 (0.0006) [2023-12-26 09:40:11,648][123090] Updated weights for policy 1, policy_version 1253392 (0.0008) [2023-12-26 09:40:11,716][123090] Updated weights for policy 1, policy_version 1253402 (0.0011) [2023-12-26 09:40:11,764][123091] Updated weights for policy 0, policy_version 1262225 (0.0009) [2023-12-26 09:40:11,821][123091] Updated weights for policy 0, policy_version 1262235 (0.0005) [2023-12-26 09:40:11,877][123091] Updated weights for policy 0, policy_version 1262245 (0.0007) [2023-12-26 09:40:11,934][123091] Updated weights for policy 0, policy_version 1262255 (0.0010) [2023-12-26 09:40:12,532][123090] Updated weights for policy 1, policy_version 1253412 (0.0010) [2023-12-26 09:40:12,608][123090] Updated weights for policy 1, policy_version 1253422 (0.0009) [2023-12-26 09:40:12,676][123090] Updated weights for policy 1, policy_version 1253432 (0.0009) [2023-12-26 09:40:12,747][123091] Updated weights for policy 0, policy_version 1262265 (0.0010) [2023-12-26 09:40:12,813][123091] Updated weights for policy 0, policy_version 1262275 (0.0010) [2023-12-26 09:40:12,880][123091] Updated weights for policy 0, policy_version 1262285 (0.0011) [2023-12-26 09:40:13,419][123090] Updated weights for policy 1, policy_version 1253442 (0.0007) [2023-12-26 09:40:13,478][123090] Updated weights for policy 1, policy_version 1253452 (0.0009) [2023-12-26 09:40:13,542][123090] Updated weights for policy 1, policy_version 1253462 (0.0010) [2023-12-26 09:40:13,613][123090] Updated weights for policy 1, policy_version 1253472 (0.0007) [2023-12-26 09:40:13,669][123091] Updated weights for policy 0, policy_version 1262295 (0.0009) [2023-12-26 09:40:13,730][123091] Updated weights for policy 0, policy_version 1262305 (0.0009) [2023-12-26 09:40:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 644038656. Throughput: 0: 8861.8, 1: 8918.7. Samples: 644033808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:13,785][121949] Avg episode reward: [(0, '6305.065'), (1, '5136.512')] [2023-12-26 09:40:13,799][123091] Updated weights for policy 0, policy_version 1262315 (0.0010) [2023-12-26 09:40:14,414][123090] Updated weights for policy 1, policy_version 1253482 (0.0011) [2023-12-26 09:40:14,484][123090] Updated weights for policy 1, policy_version 1253492 (0.0010) [2023-12-26 09:40:14,554][123090] Updated weights for policy 1, policy_version 1253502 (0.0007) [2023-12-26 09:40:14,640][123091] Updated weights for policy 0, policy_version 1262325 (0.0007) [2023-12-26 09:40:14,696][123091] Updated weights for policy 0, policy_version 1262335 (0.0005) [2023-12-26 09:40:14,759][123091] Updated weights for policy 0, policy_version 1262345 (0.0005) [2023-12-26 09:40:15,294][123090] Updated weights for policy 1, policy_version 1253512 (0.0009) [2023-12-26 09:40:15,359][123090] Updated weights for policy 1, policy_version 1253522 (0.0010) [2023-12-26 09:40:15,419][123090] Updated weights for policy 1, policy_version 1253532 (0.0009) [2023-12-26 09:40:15,536][123091] Updated weights for policy 0, policy_version 1262355 (0.0009) [2023-12-26 09:40:15,585][123091] Updated weights for policy 0, policy_version 1262365 (0.0009) [2023-12-26 09:40:15,637][123091] Updated weights for policy 0, policy_version 1262375 (0.0010) [2023-12-26 09:40:16,244][123090] Updated weights for policy 1, policy_version 1253542 (0.0010) [2023-12-26 09:40:16,296][123090] Updated weights for policy 1, policy_version 1253552 (0.0009) [2023-12-26 09:40:16,352][123090] Updated weights for policy 1, policy_version 1253562 (0.0009) [2023-12-26 09:40:16,468][123091] Updated weights for policy 0, policy_version 1262385 (0.0009) [2023-12-26 09:40:16,536][123091] Updated weights for policy 0, policy_version 1262396 (0.0010) [2023-12-26 09:40:16,607][123091] Updated weights for policy 0, policy_version 1262406 (0.0011) [2023-12-26 09:40:16,680][123091] Updated weights for policy 0, policy_version 1262416 (0.0006) [2023-12-26 09:40:17,088][123090] Updated weights for policy 1, policy_version 1253572 (0.0008) [2023-12-26 09:40:17,149][123090] Updated weights for policy 1, policy_version 1253582 (0.0009) [2023-12-26 09:40:17,209][123090] Updated weights for policy 1, policy_version 1253592 (0.0009) [2023-12-26 09:40:17,353][123091] Updated weights for policy 0, policy_version 1262426 (0.0010) [2023-12-26 09:40:17,416][123091] Updated weights for policy 0, policy_version 1262436 (0.0010) [2023-12-26 09:40:17,478][123091] Updated weights for policy 0, policy_version 1262446 (0.0011) [2023-12-26 09:40:18,044][123090] Updated weights for policy 1, policy_version 1253602 (0.0009) [2023-12-26 09:40:18,092][123090] Updated weights for policy 1, policy_version 1253612 (0.0008) [2023-12-26 09:40:18,157][123091] Updated weights for policy 0, policy_version 1262456 (0.0010) [2023-12-26 09:40:18,164][123090] Updated weights for policy 1, policy_version 1253622 (0.0008) [2023-12-26 09:40:18,216][123091] Updated weights for policy 0, policy_version 1262466 (0.0010) [2023-12-26 09:40:18,224][123090] Updated weights for policy 1, policy_version 1253632 (0.0006) [2023-12-26 09:40:18,282][123091] Updated weights for policy 0, policy_version 1262476 (0.0010) [2023-12-26 09:40:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 644128768. Throughput: 0: 8901.4, 1: 8848.2. Samples: 644141504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:18,785][121949] Avg episode reward: [(0, '6348.573'), (1, '5156.810')] [2023-12-26 09:40:19,086][123090] Updated weights for policy 1, policy_version 1253642 (0.0010) [2023-12-26 09:40:19,127][123091] Updated weights for policy 0, policy_version 1262486 (0.0010) [2023-12-26 09:40:19,147][123090] Updated weights for policy 1, policy_version 1253652 (0.0008) [2023-12-26 09:40:19,193][123091] Updated weights for policy 0, policy_version 1262496 (0.0008) [2023-12-26 09:40:19,215][123090] Updated weights for policy 1, policy_version 1253662 (0.0010) [2023-12-26 09:40:19,261][123091] Updated weights for policy 0, policy_version 1262506 (0.0010) [2023-12-26 09:40:20,039][123090] Updated weights for policy 1, policy_version 1253672 (0.0010) [2023-12-26 09:40:20,095][123091] Updated weights for policy 0, policy_version 1262516 (0.0008) [2023-12-26 09:40:20,108][123090] Updated weights for policy 1, policy_version 1253682 (0.0010) [2023-12-26 09:40:20,148][123091] Updated weights for policy 0, policy_version 1262526 (0.0010) [2023-12-26 09:40:20,175][123090] Updated weights for policy 1, policy_version 1253692 (0.0009) [2023-12-26 09:40:20,214][123091] Updated weights for policy 0, policy_version 1262536 (0.0010) [2023-12-26 09:40:20,995][123090] Updated weights for policy 1, policy_version 1253702 (0.0010) [2023-12-26 09:40:21,049][123090] Updated weights for policy 1, policy_version 1253712 (0.0010) [2023-12-26 09:40:21,091][123091] Updated weights for policy 0, policy_version 1262546 (0.0010) [2023-12-26 09:40:21,123][123090] Updated weights for policy 1, policy_version 1253722 (0.0007) [2023-12-26 09:40:21,156][123091] Updated weights for policy 0, policy_version 1262556 (0.0009) [2023-12-26 09:40:21,215][123091] Updated weights for policy 0, policy_version 1262566 (0.0010) [2023-12-26 09:40:21,278][123091] Updated weights for policy 0, policy_version 1262576 (0.0009) [2023-12-26 09:40:21,975][123090] Updated weights for policy 1, policy_version 1253732 (0.0008) [2023-12-26 09:40:22,027][123090] Updated weights for policy 1, policy_version 1253742 (0.0008) [2023-12-26 09:40:22,078][123090] Updated weights for policy 1, policy_version 1253752 (0.0008) [2023-12-26 09:40:22,191][123091] Updated weights for policy 0, policy_version 1262586 (0.0009) [2023-12-26 09:40:22,251][123091] Updated weights for policy 0, policy_version 1262596 (0.0009) [2023-12-26 09:40:22,313][123091] Updated weights for policy 0, policy_version 1262606 (0.0007) [2023-12-26 09:40:22,998][123090] Updated weights for policy 1, policy_version 1253762 (0.0010) [2023-12-26 09:40:23,050][123090] Updated weights for policy 1, policy_version 1253772 (0.0009) [2023-12-26 09:40:23,100][123090] Updated weights for policy 1, policy_version 1253782 (0.0009) [2023-12-26 09:40:23,120][123091] Updated weights for policy 0, policy_version 1262616 (0.0007) [2023-12-26 09:40:23,149][123090] Updated weights for policy 1, policy_version 1253792 (0.0009) [2023-12-26 09:40:23,171][123091] Updated weights for policy 0, policy_version 1262626 (0.0007) [2023-12-26 09:40:23,230][123091] Updated weights for policy 0, policy_version 1262636 (0.0009) [2023-12-26 09:40:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 644210688. Throughput: 0: 8814.8, 1: 8785.6. Samples: 644191788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:23,785][121949] Avg episode reward: [(0, '6248.072'), (1, '5047.371')] [2023-12-26 09:40:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001262640_323239936.pth... [2023-12-26 09:40:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001253792_320970752.pth... [2023-12-26 09:40:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001252768_320708608.pth [2023-12-26 09:40:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001261648_322985984.pth [2023-12-26 09:40:23,973][123090] Updated weights for policy 1, policy_version 1253802 (0.0005) [2023-12-26 09:40:24,038][123090] Updated weights for policy 1, policy_version 1253812 (0.0005) [2023-12-26 09:40:24,048][123091] Updated weights for policy 0, policy_version 1262646 (0.0006) [2023-12-26 09:40:24,095][123090] Updated weights for policy 1, policy_version 1253822 (0.0005) [2023-12-26 09:40:24,110][123091] Updated weights for policy 0, policy_version 1262656 (0.0008) [2023-12-26 09:40:24,180][123091] Updated weights for policy 0, policy_version 1262666 (0.0010) [2023-12-26 09:40:24,742][123090] Updated weights for policy 1, policy_version 1253832 (0.0006) [2023-12-26 09:40:24,813][123090] Updated weights for policy 1, policy_version 1253842 (0.0005) [2023-12-26 09:40:24,882][123090] Updated weights for policy 1, policy_version 1253852 (0.0005) [2023-12-26 09:40:25,022][123091] Updated weights for policy 0, policy_version 1262676 (0.0010) [2023-12-26 09:40:25,092][123091] Updated weights for policy 0, policy_version 1262686 (0.0009) [2023-12-26 09:40:25,154][123091] Updated weights for policy 0, policy_version 1262696 (0.0006) [2023-12-26 09:40:25,525][123090] Updated weights for policy 1, policy_version 1253862 (0.0007) [2023-12-26 09:40:25,572][123090] Updated weights for policy 1, policy_version 1253872 (0.0006) [2023-12-26 09:40:25,621][123090] Updated weights for policy 1, policy_version 1253882 (0.0009) [2023-12-26 09:40:25,806][123091] Updated weights for policy 0, policy_version 1262706 (0.0005) [2023-12-26 09:40:25,876][123091] Updated weights for policy 0, policy_version 1262716 (0.0005) [2023-12-26 09:40:25,943][123091] Updated weights for policy 0, policy_version 1262726 (0.0007) [2023-12-26 09:40:26,004][123091] Updated weights for policy 0, policy_version 1262736 (0.0005) [2023-12-26 09:40:26,395][123090] Updated weights for policy 1, policy_version 1253892 (0.0007) [2023-12-26 09:40:26,460][123090] Updated weights for policy 1, policy_version 1253902 (0.0008) [2023-12-26 09:40:26,522][123090] Updated weights for policy 1, policy_version 1253912 (0.0009) [2023-12-26 09:40:26,745][123091] Updated weights for policy 0, policy_version 1262746 (0.0011) [2023-12-26 09:40:26,801][123091] Updated weights for policy 0, policy_version 1262756 (0.0011) [2023-12-26 09:40:26,865][123091] Updated weights for policy 0, policy_version 1262766 (0.0011) [2023-12-26 09:40:27,293][123090] Updated weights for policy 1, policy_version 1253922 (0.0008) [2023-12-26 09:40:27,352][123090] Updated weights for policy 1, policy_version 1253932 (0.0006) [2023-12-26 09:40:27,409][123090] Updated weights for policy 1, policy_version 1253942 (0.0006) [2023-12-26 09:40:27,469][123090] Updated weights for policy 1, policy_version 1253952 (0.0005) [2023-12-26 09:40:27,721][123091] Updated weights for policy 0, policy_version 1262776 (0.0010) [2023-12-26 09:40:27,792][123091] Updated weights for policy 0, policy_version 1262786 (0.0010) [2023-12-26 09:40:27,865][123091] Updated weights for policy 0, policy_version 1262796 (0.0009) [2023-12-26 09:40:28,188][123090] Updated weights for policy 1, policy_version 1253962 (0.0009) [2023-12-26 09:40:28,245][123090] Updated weights for policy 1, policy_version 1253972 (0.0009) [2023-12-26 09:40:28,290][123090] Updated weights for policy 1, policy_version 1253982 (0.0009) [2023-12-26 09:40:28,706][123091] Updated weights for policy 0, policy_version 1262806 (0.0009) [2023-12-26 09:40:28,756][123091] Updated weights for policy 0, policy_version 1262816 (0.0009) [2023-12-26 09:40:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 644300800. Throughput: 0: 8823.6, 1: 8850.3. Samples: 644299376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:28,785][121949] Avg episode reward: [(0, '6255.030'), (1, '5018.768')] [2023-12-26 09:40:28,813][123091] Updated weights for policy 0, policy_version 1262826 (0.0010) [2023-12-26 09:40:29,093][123090] Updated weights for policy 1, policy_version 1253992 (0.0010) [2023-12-26 09:40:29,159][123090] Updated weights for policy 1, policy_version 1254002 (0.0010) [2023-12-26 09:40:29,218][123090] Updated weights for policy 1, policy_version 1254012 (0.0010) [2023-12-26 09:40:29,662][123091] Updated weights for policy 0, policy_version 1262836 (0.0008) [2023-12-26 09:40:29,730][123091] Updated weights for policy 0, policy_version 1262846 (0.0008) [2023-12-26 09:40:29,790][123091] Updated weights for policy 0, policy_version 1262856 (0.0010) [2023-12-26 09:40:30,033][123090] Updated weights for policy 1, policy_version 1254022 (0.0010) [2023-12-26 09:40:30,091][123090] Updated weights for policy 1, policy_version 1254032 (0.0009) [2023-12-26 09:40:30,148][123090] Updated weights for policy 1, policy_version 1254042 (0.0010) [2023-12-26 09:40:30,659][123091] Updated weights for policy 0, policy_version 1262866 (0.0009) [2023-12-26 09:40:30,724][123091] Updated weights for policy 0, policy_version 1262876 (0.0009) [2023-12-26 09:40:30,779][123091] Updated weights for policy 0, policy_version 1262886 (0.0009) [2023-12-26 09:40:30,835][123091] Updated weights for policy 0, policy_version 1262896 (0.0009) [2023-12-26 09:40:30,879][123090] Updated weights for policy 1, policy_version 1254052 (0.0008) [2023-12-26 09:40:30,941][123090] Updated weights for policy 1, policy_version 1254062 (0.0008) [2023-12-26 09:40:31,001][123090] Updated weights for policy 1, policy_version 1254072 (0.0009) [2023-12-26 09:40:31,713][123091] Updated weights for policy 0, policy_version 1262906 (0.0007) [2023-12-26 09:40:31,750][123090] Updated weights for policy 1, policy_version 1254082 (0.0009) [2023-12-26 09:40:31,787][123091] Updated weights for policy 0, policy_version 1262916 (0.0007) [2023-12-26 09:40:31,822][123090] Updated weights for policy 1, policy_version 1254092 (0.0007) [2023-12-26 09:40:31,854][123091] Updated weights for policy 0, policy_version 1262926 (0.0006) [2023-12-26 09:40:31,884][123090] Updated weights for policy 1, policy_version 1254102 (0.0007) [2023-12-26 09:40:31,956][123090] Updated weights for policy 1, policy_version 1254112 (0.0008) [2023-12-26 09:40:32,556][123091] Updated weights for policy 0, policy_version 1262936 (0.0008) [2023-12-26 09:40:32,615][123091] Updated weights for policy 0, policy_version 1262946 (0.0009) [2023-12-26 09:40:32,683][123091] Updated weights for policy 0, policy_version 1262956 (0.0006) [2023-12-26 09:40:32,790][123090] Updated weights for policy 1, policy_version 1254122 (0.0010) [2023-12-26 09:40:32,844][123090] Updated weights for policy 1, policy_version 1254132 (0.0010) [2023-12-26 09:40:32,896][123090] Updated weights for policy 1, policy_version 1254142 (0.0009) [2023-12-26 09:40:33,423][123091] Updated weights for policy 0, policy_version 1262966 (0.0008) [2023-12-26 09:40:33,469][123091] Updated weights for policy 0, policy_version 1262976 (0.0010) [2023-12-26 09:40:33,523][123091] Updated weights for policy 0, policy_version 1262986 (0.0010) [2023-12-26 09:40:33,621][123090] Updated weights for policy 1, policy_version 1254152 (0.0007) [2023-12-26 09:40:33,668][123090] Updated weights for policy 1, policy_version 1254162 (0.0010) [2023-12-26 09:40:33,712][123090] Updated weights for policy 1, policy_version 1254172 (0.0010) [2023-12-26 09:40:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 644399104. Throughput: 0: 8720.0, 1: 8937.6. Samples: 644405372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:33,785][121949] Avg episode reward: [(0, '6290.345'), (1, '5369.476')] [2023-12-26 09:40:34,330][123091] Updated weights for policy 0, policy_version 1262996 (0.0011) [2023-12-26 09:40:34,390][123091] Updated weights for policy 0, policy_version 1263006 (0.0011) [2023-12-26 09:40:34,450][123091] Updated weights for policy 0, policy_version 1263016 (0.0010) [2023-12-26 09:40:34,573][123090] Updated weights for policy 1, policy_version 1254182 (0.0009) [2023-12-26 09:40:34,632][123090] Updated weights for policy 1, policy_version 1254192 (0.0009) [2023-12-26 09:40:34,689][123090] Updated weights for policy 1, policy_version 1254202 (0.0009) [2023-12-26 09:40:35,285][123091] Updated weights for policy 0, policy_version 1263026 (0.0011) [2023-12-26 09:40:35,340][123091] Updated weights for policy 0, policy_version 1263036 (0.0010) [2023-12-26 09:40:35,391][123091] Updated weights for policy 0, policy_version 1263046 (0.0008) [2023-12-26 09:40:35,444][123091] Updated weights for policy 0, policy_version 1263056 (0.0006) [2023-12-26 09:40:35,444][123090] Updated weights for policy 1, policy_version 1254212 (0.0010) [2023-12-26 09:40:35,500][123090] Updated weights for policy 1, policy_version 1254222 (0.0010) [2023-12-26 09:40:35,561][123090] Updated weights for policy 1, policy_version 1254232 (0.0010) [2023-12-26 09:40:36,210][123091] Updated weights for policy 0, policy_version 1263066 (0.0008) [2023-12-26 09:40:36,276][123091] Updated weights for policy 0, policy_version 1263076 (0.0008) [2023-12-26 09:40:36,339][123091] Updated weights for policy 0, policy_version 1263086 (0.0009) [2023-12-26 09:40:36,405][123090] Updated weights for policy 1, policy_version 1254242 (0.0010) [2023-12-26 09:40:36,477][123090] Updated weights for policy 1, policy_version 1254252 (0.0009) [2023-12-26 09:40:36,545][123090] Updated weights for policy 1, policy_version 1254262 (0.0009) [2023-12-26 09:40:36,608][123090] Updated weights for policy 1, policy_version 1254272 (0.0009) [2023-12-26 09:40:37,083][123091] Updated weights for policy 0, policy_version 1263096 (0.0006) [2023-12-26 09:40:37,153][123091] Updated weights for policy 0, policy_version 1263106 (0.0005) [2023-12-26 09:40:37,224][123091] Updated weights for policy 0, policy_version 1263116 (0.0005) [2023-12-26 09:40:37,492][123090] Updated weights for policy 1, policy_version 1254282 (0.0010) [2023-12-26 09:40:37,547][123090] Updated weights for policy 1, policy_version 1254292 (0.0010) [2023-12-26 09:40:37,604][123090] Updated weights for policy 1, policy_version 1254303 (0.0010) [2023-12-26 09:40:37,774][123091] Updated weights for policy 0, policy_version 1263126 (0.0009) [2023-12-26 09:40:37,834][123091] Updated weights for policy 0, policy_version 1263136 (0.0010) [2023-12-26 09:40:37,891][123091] Updated weights for policy 0, policy_version 1263146 (0.0009) [2023-12-26 09:40:38,500][123090] Updated weights for policy 1, policy_version 1254313 (0.0009) [2023-12-26 09:40:38,567][123090] Updated weights for policy 1, policy_version 1254323 (0.0007) [2023-12-26 09:40:38,644][123090] Updated weights for policy 1, policy_version 1254333 (0.0005) [2023-12-26 09:40:38,659][123091] Updated weights for policy 0, policy_version 1263156 (0.0009) [2023-12-26 09:40:38,707][123091] Updated weights for policy 0, policy_version 1263166 (0.0005) [2023-12-26 09:40:38,759][123091] Updated weights for policy 0, policy_version 1263176 (0.0009) [2023-12-26 09:40:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 644481024. Throughput: 0: 8706.4, 1: 8961.5. Samples: 644457856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:38,785][121949] Avg episode reward: [(0, '6318.662'), (1, '5389.312')] [2023-12-26 09:40:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001254336_321110016.pth... [2023-12-26 09:40:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001253280_320839680.pth [2023-12-26 09:40:38,800][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001263184_323379200.pth... [2023-12-26 09:40:38,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001262160_323117056.pth [2023-12-26 09:40:39,354][123090] Updated weights for policy 1, policy_version 1254343 (0.0008) [2023-12-26 09:40:39,430][123090] Updated weights for policy 1, policy_version 1254353 (0.0009) [2023-12-26 09:40:39,498][123090] Updated weights for policy 1, policy_version 1254364 (0.0007) [2023-12-26 09:40:39,541][123091] Updated weights for policy 0, policy_version 1263186 (0.0009) [2023-12-26 09:40:39,602][123091] Updated weights for policy 0, policy_version 1263196 (0.0011) [2023-12-26 09:40:39,664][123091] Updated weights for policy 0, policy_version 1263206 (0.0011) [2023-12-26 09:40:39,715][123091] Updated weights for policy 0, policy_version 1263216 (0.0010) [2023-12-26 09:40:40,263][123090] Updated weights for policy 1, policy_version 1254374 (0.0006) [2023-12-26 09:40:40,332][123090] Updated weights for policy 1, policy_version 1254384 (0.0006) [2023-12-26 09:40:40,393][123090] Updated weights for policy 1, policy_version 1254394 (0.0009) [2023-12-26 09:40:40,561][123091] Updated weights for policy 0, policy_version 1263226 (0.0008) [2023-12-26 09:40:40,608][123091] Updated weights for policy 0, policy_version 1263236 (0.0010) [2023-12-26 09:40:40,656][123091] Updated weights for policy 0, policy_version 1263246 (0.0010) [2023-12-26 09:40:41,240][123090] Updated weights for policy 1, policy_version 1254404 (0.0010) [2023-12-26 09:40:41,319][123090] Updated weights for policy 1, policy_version 1254414 (0.0010) [2023-12-26 09:40:41,384][123090] Updated weights for policy 1, policy_version 1254424 (0.0010) [2023-12-26 09:40:41,509][123091] Updated weights for policy 0, policy_version 1263256 (0.0011) [2023-12-26 09:40:41,581][123091] Updated weights for policy 0, policy_version 1263266 (0.0011) [2023-12-26 09:40:41,640][123091] Updated weights for policy 0, policy_version 1263276 (0.0011) [2023-12-26 09:40:42,187][123090] Updated weights for policy 1, policy_version 1254434 (0.0007) [2023-12-26 09:40:42,256][123090] Updated weights for policy 1, policy_version 1254444 (0.0010) [2023-12-26 09:40:42,324][123090] Updated weights for policy 1, policy_version 1254454 (0.0011) [2023-12-26 09:40:42,394][123090] Updated weights for policy 1, policy_version 1254464 (0.0011) [2023-12-26 09:40:42,455][123091] Updated weights for policy 0, policy_version 1263286 (0.0011) [2023-12-26 09:40:42,515][123091] Updated weights for policy 0, policy_version 1263296 (0.0011) [2023-12-26 09:40:42,567][123091] Updated weights for policy 0, policy_version 1263306 (0.0011) [2023-12-26 09:40:43,207][123090] Updated weights for policy 1, policy_version 1254474 (0.0008) [2023-12-26 09:40:43,272][123090] Updated weights for policy 1, policy_version 1254484 (0.0009) [2023-12-26 09:40:43,335][123090] Updated weights for policy 1, policy_version 1254494 (0.0009) [2023-12-26 09:40:43,367][123091] Updated weights for policy 0, policy_version 1263316 (0.0010) [2023-12-26 09:40:43,414][123091] Updated weights for policy 0, policy_version 1263326 (0.0008) [2023-12-26 09:40:43,463][123091] Updated weights for policy 0, policy_version 1263336 (0.0005) [2023-12-26 09:40:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.5, 300 sec: 17800.3). Total num frames: 644571136. Throughput: 0: 8722.6, 1: 8874.7. Samples: 644563524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:43,784][121949] Avg episode reward: [(0, '6274.422'), (1, '5128.430')] [2023-12-26 09:40:44,187][123091] Updated weights for policy 0, policy_version 1263346 (0.0005) [2023-12-26 09:40:44,213][123090] Updated weights for policy 1, policy_version 1254504 (0.0009) [2023-12-26 09:40:44,232][123091] Updated weights for policy 0, policy_version 1263356 (0.0008) [2023-12-26 09:40:44,278][123091] Updated weights for policy 0, policy_version 1263366 (0.0009) [2023-12-26 09:40:44,281][123090] Updated weights for policy 1, policy_version 1254514 (0.0008) [2023-12-26 09:40:44,324][123091] Updated weights for policy 0, policy_version 1263376 (0.0009) [2023-12-26 09:40:44,350][123090] Updated weights for policy 1, policy_version 1254524 (0.0008) [2023-12-26 09:40:45,089][123091] Updated weights for policy 0, policy_version 1263386 (0.0009) [2023-12-26 09:40:45,158][123091] Updated weights for policy 0, policy_version 1263396 (0.0010) [2023-12-26 09:40:45,191][123090] Updated weights for policy 1, policy_version 1254534 (0.0007) [2023-12-26 09:40:45,219][123091] Updated weights for policy 0, policy_version 1263406 (0.0010) [2023-12-26 09:40:45,255][123090] Updated weights for policy 1, policy_version 1254544 (0.0008) [2023-12-26 09:40:45,322][123090] Updated weights for policy 1, policy_version 1254554 (0.0008) [2023-12-26 09:40:46,061][123091] Updated weights for policy 0, policy_version 1263416 (0.0008) [2023-12-26 09:40:46,131][123091] Updated weights for policy 0, policy_version 1263426 (0.0009) [2023-12-26 09:40:46,135][123090] Updated weights for policy 1, policy_version 1254564 (0.0008) [2023-12-26 09:40:46,191][123090] Updated weights for policy 1, policy_version 1254574 (0.0005) [2023-12-26 09:40:46,194][123091] Updated weights for policy 0, policy_version 1263436 (0.0008) [2023-12-26 09:40:46,241][123090] Updated weights for policy 1, policy_version 1254584 (0.0005) [2023-12-26 09:40:46,932][123090] Updated weights for policy 1, policy_version 1254594 (0.0005) [2023-12-26 09:40:46,991][123090] Updated weights for policy 1, policy_version 1254604 (0.0006) [2023-12-26 09:40:47,004][123091] Updated weights for policy 0, policy_version 1263446 (0.0009) [2023-12-26 09:40:47,050][123090] Updated weights for policy 1, policy_version 1254614 (0.0009) [2023-12-26 09:40:47,061][123091] Updated weights for policy 0, policy_version 1263456 (0.0007) [2023-12-26 09:40:47,102][123090] Updated weights for policy 1, policy_version 1254624 (0.0010) [2023-12-26 09:40:47,121][123091] Updated weights for policy 0, policy_version 1263466 (0.0006) [2023-12-26 09:40:47,848][123090] Updated weights for policy 1, policy_version 1254634 (0.0010) [2023-12-26 09:40:47,917][123090] Updated weights for policy 1, policy_version 1254644 (0.0008) [2023-12-26 09:40:47,975][123090] Updated weights for policy 1, policy_version 1254654 (0.0008) [2023-12-26 09:40:47,979][123091] Updated weights for policy 0, policy_version 1263476 (0.0008) [2023-12-26 09:40:48,030][123091] Updated weights for policy 0, policy_version 1263486 (0.0009) [2023-12-26 09:40:48,087][123091] Updated weights for policy 0, policy_version 1263496 (0.0009) [2023-12-26 09:40:48,708][123090] Updated weights for policy 1, policy_version 1254664 (0.0010) [2023-12-26 09:40:48,779][123090] Updated weights for policy 1, policy_version 1254674 (0.0010) [2023-12-26 09:40:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 644653056. Throughput: 0: 8768.1, 1: 8870.0. Samples: 644671680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:48,785][121949] Avg episode reward: [(0, '6236.672'), (1, '5106.388')] [2023-12-26 09:40:48,838][123090] Updated weights for policy 1, policy_version 1254684 (0.0010) [2023-12-26 09:40:48,867][123091] Updated weights for policy 0, policy_version 1263506 (0.0010) [2023-12-26 09:40:48,932][123091] Updated weights for policy 0, policy_version 1263516 (0.0009) [2023-12-26 09:40:48,992][123091] Updated weights for policy 0, policy_version 1263526 (0.0009) [2023-12-26 09:40:49,041][123091] Updated weights for policy 0, policy_version 1263536 (0.0008) [2023-12-26 09:40:49,679][123090] Updated weights for policy 1, policy_version 1254694 (0.0009) [2023-12-26 09:40:49,740][123090] Updated weights for policy 1, policy_version 1254704 (0.0009) [2023-12-26 09:40:49,801][123090] Updated weights for policy 1, policy_version 1254714 (0.0009) [2023-12-26 09:40:49,962][123091] Updated weights for policy 0, policy_version 1263546 (0.0009) [2023-12-26 09:40:50,034][123091] Updated weights for policy 0, policy_version 1263556 (0.0010) [2023-12-26 09:40:50,102][123091] Updated weights for policy 0, policy_version 1263566 (0.0010) [2023-12-26 09:40:50,652][123090] Updated weights for policy 1, policy_version 1254724 (0.0010) [2023-12-26 09:40:50,722][123090] Updated weights for policy 1, policy_version 1254734 (0.0008) [2023-12-26 09:40:50,786][123090] Updated weights for policy 1, policy_version 1254744 (0.0008) [2023-12-26 09:40:50,914][123091] Updated weights for policy 0, policy_version 1263576 (0.0009) [2023-12-26 09:40:50,973][123091] Updated weights for policy 0, policy_version 1263586 (0.0009) [2023-12-26 09:40:51,036][123091] Updated weights for policy 0, policy_version 1263596 (0.0010) [2023-12-26 09:40:51,594][123090] Updated weights for policy 1, policy_version 1254754 (0.0009) [2023-12-26 09:40:51,660][123090] Updated weights for policy 1, policy_version 1254764 (0.0010) [2023-12-26 09:40:51,730][123090] Updated weights for policy 1, policy_version 1254774 (0.0010) [2023-12-26 09:40:51,792][123090] Updated weights for policy 1, policy_version 1254784 (0.0009) [2023-12-26 09:40:51,954][123091] Updated weights for policy 0, policy_version 1263606 (0.0009) [2023-12-26 09:40:52,011][123091] Updated weights for policy 0, policy_version 1263616 (0.0009) [2023-12-26 09:40:52,067][123091] Updated weights for policy 0, policy_version 1263626 (0.0010) [2023-12-26 09:40:52,582][123090] Updated weights for policy 1, policy_version 1254794 (0.0005) [2023-12-26 09:40:52,649][123090] Updated weights for policy 1, policy_version 1254804 (0.0008) [2023-12-26 09:40:52,720][123090] Updated weights for policy 1, policy_version 1254814 (0.0006) [2023-12-26 09:40:52,866][123091] Updated weights for policy 0, policy_version 1263636 (0.0009) [2023-12-26 09:40:52,921][123091] Updated weights for policy 0, policy_version 1263646 (0.0010) [2023-12-26 09:40:52,988][123091] Updated weights for policy 0, policy_version 1263656 (0.0010) [2023-12-26 09:40:53,359][123090] Updated weights for policy 1, policy_version 1254824 (0.0005) [2023-12-26 09:40:53,415][123090] Updated weights for policy 1, policy_version 1254834 (0.0005) [2023-12-26 09:40:53,464][123090] Updated weights for policy 1, policy_version 1254844 (0.0006) [2023-12-26 09:40:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 644743168. Throughput: 0: 8739.8, 1: 8857.3. Samples: 644721080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:53,785][121949] Avg episode reward: [(0, '6266.861'), (1, '5082.932')] [2023-12-26 09:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001254848_321241088.pth... [2023-12-26 09:40:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001263664_323502080.pth... [2023-12-26 09:40:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001253792_320970752.pth [2023-12-26 09:40:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001262640_323239936.pth [2023-12-26 09:40:53,890][123091] Updated weights for policy 0, policy_version 1263666 (0.0009) [2023-12-26 09:40:53,948][123091] Updated weights for policy 0, policy_version 1263676 (0.0005) [2023-12-26 09:40:54,007][123091] Updated weights for policy 0, policy_version 1263686 (0.0009) [2023-12-26 09:40:54,069][123090] Updated weights for policy 1, policy_version 1254854 (0.0008) [2023-12-26 09:40:54,073][123091] Updated weights for policy 0, policy_version 1263696 (0.0006) [2023-12-26 09:40:54,136][123090] Updated weights for policy 1, policy_version 1254864 (0.0010) [2023-12-26 09:40:54,210][123090] Updated weights for policy 1, policy_version 1254874 (0.0010) [2023-12-26 09:40:54,893][123091] Updated weights for policy 0, policy_version 1263706 (0.0010) [2023-12-26 09:40:54,893][123090] Updated weights for policy 1, policy_version 1254884 (0.0009) [2023-12-26 09:40:54,955][123090] Updated weights for policy 1, policy_version 1254894 (0.0007) [2023-12-26 09:40:54,960][123091] Updated weights for policy 0, policy_version 1263716 (0.0011) [2023-12-26 09:40:55,022][123090] Updated weights for policy 1, policy_version 1254904 (0.0010) [2023-12-26 09:40:55,025][123091] Updated weights for policy 0, policy_version 1263726 (0.0009) [2023-12-26 09:40:55,805][123091] Updated weights for policy 0, policy_version 1263736 (0.0006) [2023-12-26 09:40:55,807][123090] Updated weights for policy 1, policy_version 1254914 (0.0010) [2023-12-26 09:40:55,854][123091] Updated weights for policy 0, policy_version 1263746 (0.0005) [2023-12-26 09:40:55,859][123090] Updated weights for policy 1, policy_version 1254924 (0.0010) [2023-12-26 09:40:55,903][123091] Updated weights for policy 0, policy_version 1263756 (0.0005) [2023-12-26 09:40:55,911][123090] Updated weights for policy 1, policy_version 1254934 (0.0010) [2023-12-26 09:40:55,963][123090] Updated weights for policy 1, policy_version 1254944 (0.0011) [2023-12-26 09:40:56,518][123091] Updated weights for policy 0, policy_version 1263766 (0.0007) [2023-12-26 09:40:56,566][123091] Updated weights for policy 0, policy_version 1263776 (0.0010) [2023-12-26 09:40:56,617][123091] Updated weights for policy 0, policy_version 1263786 (0.0010) [2023-12-26 09:40:56,797][123090] Updated weights for policy 1, policy_version 1254954 (0.0008) [2023-12-26 09:40:56,860][123090] Updated weights for policy 1, policy_version 1254964 (0.0009) [2023-12-26 09:40:56,918][123090] Updated weights for policy 1, policy_version 1254974 (0.0010) [2023-12-26 09:40:57,320][123091] Updated weights for policy 0, policy_version 1263796 (0.0010) [2023-12-26 09:40:57,376][123091] Updated weights for policy 0, policy_version 1263806 (0.0006) [2023-12-26 09:40:57,440][123091] Updated weights for policy 0, policy_version 1263816 (0.0005) [2023-12-26 09:40:57,647][123090] Updated weights for policy 1, policy_version 1254984 (0.0006) [2023-12-26 09:40:57,706][123090] Updated weights for policy 1, policy_version 1254994 (0.0005) [2023-12-26 09:40:57,761][123090] Updated weights for policy 1, policy_version 1255004 (0.0009) [2023-12-26 09:40:58,113][123091] Updated weights for policy 0, policy_version 1263826 (0.0005) [2023-12-26 09:40:58,168][123091] Updated weights for policy 0, policy_version 1263836 (0.0009) [2023-12-26 09:40:58,231][123091] Updated weights for policy 0, policy_version 1263846 (0.0011) [2023-12-26 09:40:58,292][123091] Updated weights for policy 0, policy_version 1263856 (0.0009) [2023-12-26 09:40:58,659][123090] Updated weights for policy 1, policy_version 1255014 (0.0009) [2023-12-26 09:40:58,728][123090] Updated weights for policy 1, policy_version 1255024 (0.0009) [2023-12-26 09:40:58,786][121949] Fps is (10 sec: 18018.2, 60 sec: 17612.1, 300 sec: 17772.3). Total num frames: 644833280. Throughput: 0: 8805.9, 1: 8919.2. Samples: 644831480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:40:58,787][121949] Avg episode reward: [(0, '6267.905'), (1, '5079.555')] [2023-12-26 09:40:58,796][123090] Updated weights for policy 1, policy_version 1255034 (0.0009) [2023-12-26 09:40:59,156][123091] Updated weights for policy 0, policy_version 1263866 (0.0005) [2023-12-26 09:40:59,209][123091] Updated weights for policy 0, policy_version 1263876 (0.0006) [2023-12-26 09:40:59,272][123091] Updated weights for policy 0, policy_version 1263886 (0.0010) [2023-12-26 09:40:59,621][123090] Updated weights for policy 1, policy_version 1255044 (0.0009) [2023-12-26 09:40:59,690][123090] Updated weights for policy 1, policy_version 1255054 (0.0010) [2023-12-26 09:40:59,747][123090] Updated weights for policy 1, policy_version 1255064 (0.0009) [2023-12-26 09:41:00,063][123091] Updated weights for policy 0, policy_version 1263896 (0.0009) [2023-12-26 09:41:00,125][123091] Updated weights for policy 0, policy_version 1263906 (0.0008) [2023-12-26 09:41:00,182][123091] Updated weights for policy 0, policy_version 1263916 (0.0009) [2023-12-26 09:41:00,613][123090] Updated weights for policy 1, policy_version 1255074 (0.0008) [2023-12-26 09:41:00,677][123090] Updated weights for policy 1, policy_version 1255084 (0.0010) [2023-12-26 09:41:00,724][123090] Updated weights for policy 1, policy_version 1255094 (0.0010) [2023-12-26 09:41:00,772][123090] Updated weights for policy 1, policy_version 1255104 (0.0010) [2023-12-26 09:41:00,941][123091] Updated weights for policy 0, policy_version 1263926 (0.0005) [2023-12-26 09:41:01,000][123091] Updated weights for policy 0, policy_version 1263936 (0.0005) [2023-12-26 09:41:01,068][123091] Updated weights for policy 0, policy_version 1263946 (0.0009) [2023-12-26 09:41:01,638][123090] Updated weights for policy 1, policy_version 1255114 (0.0007) [2023-12-26 09:41:01,693][123090] Updated weights for policy 1, policy_version 1255124 (0.0009) [2023-12-26 09:41:01,763][123090] Updated weights for policy 1, policy_version 1255134 (0.0009) [2023-12-26 09:41:01,867][123091] Updated weights for policy 0, policy_version 1263956 (0.0009) [2023-12-26 09:41:01,923][123091] Updated weights for policy 0, policy_version 1263966 (0.0010) [2023-12-26 09:41:01,977][123091] Updated weights for policy 0, policy_version 1263976 (0.0009) [2023-12-26 09:41:02,599][123090] Updated weights for policy 1, policy_version 1255144 (0.0010) [2023-12-26 09:41:02,652][123090] Updated weights for policy 1, policy_version 1255154 (0.0010) [2023-12-26 09:41:02,710][123090] Updated weights for policy 1, policy_version 1255164 (0.0010) [2023-12-26 09:41:02,795][123091] Updated weights for policy 0, policy_version 1263986 (0.0010) [2023-12-26 09:41:02,852][123091] Updated weights for policy 0, policy_version 1263996 (0.0007) [2023-12-26 09:41:02,922][123091] Updated weights for policy 0, policy_version 1264006 (0.0005) [2023-12-26 09:41:02,980][123091] Updated weights for policy 0, policy_version 1264016 (0.0005) [2023-12-26 09:41:03,475][123090] Updated weights for policy 1, policy_version 1255174 (0.0007) [2023-12-26 09:41:03,525][123090] Updated weights for policy 1, policy_version 1255184 (0.0005) [2023-12-26 09:41:03,574][123091] Updated weights for policy 0, policy_version 1264026 (0.0006) [2023-12-26 09:41:03,585][123090] Updated weights for policy 1, policy_version 1255194 (0.0005) [2023-12-26 09:41:03,629][123091] Updated weights for policy 0, policy_version 1264036 (0.0006) [2023-12-26 09:41:03,692][123091] Updated weights for policy 0, policy_version 1264046 (0.0006) [2023-12-26 09:41:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 644931584. Throughput: 0: 8847.5, 1: 8845.4. Samples: 644937684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:03,784][121949] Avg episode reward: [(0, '6282.805'), (1, '4977.295')] [2023-12-26 09:41:04,374][123090] Updated weights for policy 1, policy_version 1255204 (0.0007) [2023-12-26 09:41:04,437][123090] Updated weights for policy 1, policy_version 1255214 (0.0008) [2023-12-26 09:41:04,468][123091] Updated weights for policy 0, policy_version 1264056 (0.0009) [2023-12-26 09:41:04,505][123090] Updated weights for policy 1, policy_version 1255224 (0.0006) [2023-12-26 09:41:04,530][123091] Updated weights for policy 0, policy_version 1264066 (0.0010) [2023-12-26 09:41:04,591][123091] Updated weights for policy 0, policy_version 1264076 (0.0010) [2023-12-26 09:41:05,233][123090] Updated weights for policy 1, policy_version 1255234 (0.0008) [2023-12-26 09:41:05,294][123091] Updated weights for policy 0, policy_version 1264086 (0.0007) [2023-12-26 09:41:05,295][123090] Updated weights for policy 1, policy_version 1255244 (0.0005) [2023-12-26 09:41:05,350][123090] Updated weights for policy 1, policy_version 1255254 (0.0008) [2023-12-26 09:41:05,368][123091] Updated weights for policy 0, policy_version 1264096 (0.0005) [2023-12-26 09:41:05,406][123090] Updated weights for policy 1, policy_version 1255264 (0.0007) [2023-12-26 09:41:05,435][123091] Updated weights for policy 0, policy_version 1264106 (0.0005) [2023-12-26 09:41:06,117][123091] Updated weights for policy 0, policy_version 1264116 (0.0006) [2023-12-26 09:41:06,184][123091] Updated weights for policy 0, policy_version 1264126 (0.0009) [2023-12-26 09:41:06,252][123091] Updated weights for policy 0, policy_version 1264136 (0.0009) [2023-12-26 09:41:06,257][123090] Updated weights for policy 1, policy_version 1255274 (0.0008) [2023-12-26 09:41:06,312][123090] Updated weights for policy 1, policy_version 1255284 (0.0008) [2023-12-26 09:41:06,384][123090] Updated weights for policy 1, policy_version 1255294 (0.0009) [2023-12-26 09:41:06,931][123091] Updated weights for policy 0, policy_version 1264146 (0.0010) [2023-12-26 09:41:06,991][123091] Updated weights for policy 0, policy_version 1264156 (0.0010) [2023-12-26 09:41:07,054][123091] Updated weights for policy 0, policy_version 1264166 (0.0010) [2023-12-26 09:41:07,118][123091] Updated weights for policy 0, policy_version 1264176 (0.0009) [2023-12-26 09:41:07,229][123090] Updated weights for policy 1, policy_version 1255304 (0.0010) [2023-12-26 09:41:07,286][123090] Updated weights for policy 1, policy_version 1255316 (0.0011) [2023-12-26 09:41:07,334][123090] Updated weights for policy 1, policy_version 1255326 (0.0010) [2023-12-26 09:41:07,840][123091] Updated weights for policy 0, policy_version 1264186 (0.0005) [2023-12-26 09:41:07,898][123091] Updated weights for policy 0, policy_version 1264196 (0.0006) [2023-12-26 09:41:07,957][123091] Updated weights for policy 0, policy_version 1264206 (0.0006) [2023-12-26 09:41:08,070][123090] Updated weights for policy 1, policy_version 1255336 (0.0007) [2023-12-26 09:41:08,130][123090] Updated weights for policy 1, policy_version 1255346 (0.0010) [2023-12-26 09:41:08,185][123090] Updated weights for policy 1, policy_version 1255356 (0.0010) [2023-12-26 09:41:08,660][123091] Updated weights for policy 0, policy_version 1264216 (0.0006) [2023-12-26 09:41:08,721][123091] Updated weights for policy 0, policy_version 1264226 (0.0006) [2023-12-26 09:41:08,772][123091] Updated weights for policy 0, policy_version 1264236 (0.0005) [2023-12-26 09:41:08,784][121949] Fps is (10 sec: 18026.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 645013504. Throughput: 0: 8927.1, 1: 8859.9. Samples: 644992204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:08,785][121949] Avg episode reward: [(0, '6387.061'), (1, '4777.161')] [2023-12-26 09:41:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001255360_321372160.pth... [2023-12-26 09:41:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001264240_323649536.pth... [2023-12-26 09:41:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001254336_321110016.pth [2023-12-26 09:41:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001263184_323379200.pth [2023-12-26 09:41:09,004][123090] Updated weights for policy 1, policy_version 1255366 (0.0010) [2023-12-26 09:41:09,063][123090] Updated weights for policy 1, policy_version 1255376 (0.0010) [2023-12-26 09:41:09,133][123090] Updated weights for policy 1, policy_version 1255386 (0.0010) [2023-12-26 09:41:09,488][123091] Updated weights for policy 0, policy_version 1264246 (0.0008) [2023-12-26 09:41:09,547][123091] Updated weights for policy 0, policy_version 1264256 (0.0010) [2023-12-26 09:41:09,606][123091] Updated weights for policy 0, policy_version 1264266 (0.0010) [2023-12-26 09:41:09,913][123090] Updated weights for policy 1, policy_version 1255396 (0.0010) [2023-12-26 09:41:09,978][123090] Updated weights for policy 1, policy_version 1255406 (0.0011) [2023-12-26 09:41:10,047][123090] Updated weights for policy 1, policy_version 1255416 (0.0011) [2023-12-26 09:41:10,478][123091] Updated weights for policy 0, policy_version 1264276 (0.0009) [2023-12-26 09:41:10,528][123091] Updated weights for policy 0, policy_version 1264286 (0.0009) [2023-12-26 09:41:10,573][123091] Updated weights for policy 0, policy_version 1264296 (0.0007) [2023-12-26 09:41:10,884][123090] Updated weights for policy 1, policy_version 1255426 (0.0010) [2023-12-26 09:41:10,939][123090] Updated weights for policy 1, policy_version 1255436 (0.0006) [2023-12-26 09:41:11,000][123090] Updated weights for policy 1, policy_version 1255446 (0.0007) [2023-12-26 09:41:11,068][123090] Updated weights for policy 1, policy_version 1255456 (0.0008) [2023-12-26 09:41:11,396][123091] Updated weights for policy 0, policy_version 1264306 (0.0008) [2023-12-26 09:41:11,469][123091] Updated weights for policy 0, policy_version 1264316 (0.0009) [2023-12-26 09:41:11,540][123091] Updated weights for policy 0, policy_version 1264326 (0.0009) [2023-12-26 09:41:11,596][123091] Updated weights for policy 0, policy_version 1264336 (0.0009) [2023-12-26 09:41:11,894][123090] Updated weights for policy 1, policy_version 1255466 (0.0009) [2023-12-26 09:41:11,950][123090] Updated weights for policy 1, policy_version 1255476 (0.0009) [2023-12-26 09:41:11,999][123090] Updated weights for policy 1, policy_version 1255486 (0.0009) [2023-12-26 09:41:12,443][123091] Updated weights for policy 0, policy_version 1264346 (0.0009) [2023-12-26 09:41:12,509][123091] Updated weights for policy 0, policy_version 1264356 (0.0008) [2023-12-26 09:41:12,566][123091] Updated weights for policy 0, policy_version 1264366 (0.0006) [2023-12-26 09:41:12,908][123090] Updated weights for policy 1, policy_version 1255496 (0.0006) [2023-12-26 09:41:12,970][123090] Updated weights for policy 1, policy_version 1255506 (0.0005) [2023-12-26 09:41:13,021][123090] Updated weights for policy 1, policy_version 1255516 (0.0006) [2023-12-26 09:41:13,259][123091] Updated weights for policy 0, policy_version 1264376 (0.0005) [2023-12-26 09:41:13,306][123091] Updated weights for policy 0, policy_version 1264386 (0.0005) [2023-12-26 09:41:13,354][123091] Updated weights for policy 0, policy_version 1264396 (0.0007) [2023-12-26 09:41:13,686][123090] Updated weights for policy 1, policy_version 1255526 (0.0007) [2023-12-26 09:41:13,741][123090] Updated weights for policy 1, policy_version 1255536 (0.0010) [2023-12-26 09:41:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 645103616. Throughput: 0: 8971.6, 1: 8795.6. Samples: 645098896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:13,785][121949] Avg episode reward: [(0, '6260.022'), (1, '4982.789')] [2023-12-26 09:41:13,797][123090] Updated weights for policy 1, policy_version 1255546 (0.0009) [2023-12-26 09:41:14,027][123091] Updated weights for policy 0, policy_version 1264406 (0.0008) [2023-12-26 09:41:14,093][123091] Updated weights for policy 0, policy_version 1264416 (0.0010) [2023-12-26 09:41:14,148][123091] Updated weights for policy 0, policy_version 1264426 (0.0010) [2023-12-26 09:41:14,637][123090] Updated weights for policy 1, policy_version 1255556 (0.0010) [2023-12-26 09:41:14,701][123090] Updated weights for policy 1, policy_version 1255566 (0.0009) [2023-12-26 09:41:14,751][123090] Updated weights for policy 1, policy_version 1255576 (0.0009) [2023-12-26 09:41:14,946][123091] Updated weights for policy 0, policy_version 1264436 (0.0009) [2023-12-26 09:41:15,014][123091] Updated weights for policy 0, policy_version 1264446 (0.0008) [2023-12-26 09:41:15,091][123091] Updated weights for policy 0, policy_version 1264456 (0.0008) [2023-12-26 09:41:15,617][123090] Updated weights for policy 1, policy_version 1255586 (0.0010) [2023-12-26 09:41:15,669][123090] Updated weights for policy 1, policy_version 1255596 (0.0009) [2023-12-26 09:41:15,722][123090] Updated weights for policy 1, policy_version 1255606 (0.0009) [2023-12-26 09:41:15,778][123090] Updated weights for policy 1, policy_version 1255616 (0.0009) [2023-12-26 09:41:15,902][123091] Updated weights for policy 0, policy_version 1264466 (0.0010) [2023-12-26 09:41:15,970][123091] Updated weights for policy 0, policy_version 1264476 (0.0010) [2023-12-26 09:41:16,039][123091] Updated weights for policy 0, policy_version 1264486 (0.0010) [2023-12-26 09:41:16,100][123091] Updated weights for policy 0, policy_version 1264496 (0.0010) [2023-12-26 09:41:16,643][123090] Updated weights for policy 1, policy_version 1255626 (0.0010) [2023-12-26 09:41:16,697][123090] Updated weights for policy 1, policy_version 1255637 (0.0010) [2023-12-26 09:41:16,755][123090] Updated weights for policy 1, policy_version 1255647 (0.0005) [2023-12-26 09:41:16,870][123091] Updated weights for policy 0, policy_version 1264506 (0.0005) [2023-12-26 09:41:16,917][123091] Updated weights for policy 0, policy_version 1264516 (0.0005) [2023-12-26 09:41:16,977][123091] Updated weights for policy 0, policy_version 1264526 (0.0005) [2023-12-26 09:41:17,432][123090] Updated weights for policy 1, policy_version 1255657 (0.0006) [2023-12-26 09:41:17,483][123090] Updated weights for policy 1, policy_version 1255667 (0.0008) [2023-12-26 09:41:17,549][123090] Updated weights for policy 1, policy_version 1255678 (0.0007) [2023-12-26 09:41:17,738][123091] Updated weights for policy 0, policy_version 1264536 (0.0009) [2023-12-26 09:41:17,785][123091] Updated weights for policy 0, policy_version 1264546 (0.0010) [2023-12-26 09:41:17,832][123091] Updated weights for policy 0, policy_version 1264556 (0.0010) [2023-12-26 09:41:18,248][123090] Updated weights for policy 1, policy_version 1255688 (0.0005) [2023-12-26 09:41:18,309][123090] Updated weights for policy 1, policy_version 1255698 (0.0006) [2023-12-26 09:41:18,379][123090] Updated weights for policy 1, policy_version 1255708 (0.0007) [2023-12-26 09:41:18,665][123091] Updated weights for policy 0, policy_version 1264566 (0.0010) [2023-12-26 09:41:18,723][123091] Updated weights for policy 0, policy_version 1264576 (0.0010) [2023-12-26 09:41:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 645193728. Throughput: 0: 9047.2, 1: 8806.3. Samples: 645208780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:18,785][121949] Avg episode reward: [(0, '6280.348'), (1, '5049.354')] [2023-12-26 09:41:18,785][123091] Updated weights for policy 0, policy_version 1264586 (0.0010) [2023-12-26 09:41:19,076][123090] Updated weights for policy 1, policy_version 1255718 (0.0006) [2023-12-26 09:41:19,128][123090] Updated weights for policy 1, policy_version 1255728 (0.0005) [2023-12-26 09:41:19,184][123090] Updated weights for policy 1, policy_version 1255738 (0.0008) [2023-12-26 09:41:19,663][123091] Updated weights for policy 0, policy_version 1264596 (0.0008) [2023-12-26 09:41:19,732][123091] Updated weights for policy 0, policy_version 1264606 (0.0006) [2023-12-26 09:41:19,800][123091] Updated weights for policy 0, policy_version 1264616 (0.0006) [2023-12-26 09:41:20,071][123090] Updated weights for policy 1, policy_version 1255748 (0.0009) [2023-12-26 09:41:20,138][123090] Updated weights for policy 1, policy_version 1255758 (0.0009) [2023-12-26 09:41:20,201][123090] Updated weights for policy 1, policy_version 1255768 (0.0009) [2023-12-26 09:41:20,475][123091] Updated weights for policy 0, policy_version 1264626 (0.0007) [2023-12-26 09:41:20,551][123091] Updated weights for policy 0, policy_version 1264636 (0.0006) [2023-12-26 09:41:20,628][123091] Updated weights for policy 0, policy_version 1264646 (0.0008) [2023-12-26 09:41:20,693][123091] Updated weights for policy 0, policy_version 1264656 (0.0011) [2023-12-26 09:41:21,080][123090] Updated weights for policy 1, policy_version 1255778 (0.0009) [2023-12-26 09:41:21,153][123090] Updated weights for policy 1, policy_version 1255788 (0.0008) [2023-12-26 09:41:21,229][123090] Updated weights for policy 1, policy_version 1255798 (0.0011) [2023-12-26 09:41:21,294][123090] Updated weights for policy 1, policy_version 1255808 (0.0011) [2023-12-26 09:41:21,554][123091] Updated weights for policy 0, policy_version 1264666 (0.0010) [2023-12-26 09:41:21,621][123091] Updated weights for policy 0, policy_version 1264676 (0.0011) [2023-12-26 09:41:21,694][123091] Updated weights for policy 0, policy_version 1264686 (0.0011) [2023-12-26 09:41:22,129][123090] Updated weights for policy 1, policy_version 1255818 (0.0011) [2023-12-26 09:41:22,200][123090] Updated weights for policy 1, policy_version 1255828 (0.0011) [2023-12-26 09:41:22,267][123090] Updated weights for policy 1, policy_version 1255838 (0.0011) [2023-12-26 09:41:22,503][123091] Updated weights for policy 0, policy_version 1264696 (0.0008) [2023-12-26 09:41:22,570][123091] Updated weights for policy 0, policy_version 1264706 (0.0011) [2023-12-26 09:41:22,638][123091] Updated weights for policy 0, policy_version 1264716 (0.0009) [2023-12-26 09:41:23,061][123090] Updated weights for policy 1, policy_version 1255848 (0.0006) [2023-12-26 09:41:23,126][123090] Updated weights for policy 1, policy_version 1255858 (0.0008) [2023-12-26 09:41:23,193][123090] Updated weights for policy 1, policy_version 1255868 (0.0011) [2023-12-26 09:41:23,422][123091] Updated weights for policy 0, policy_version 1264726 (0.0010) [2023-12-26 09:41:23,473][123091] Updated weights for policy 0, policy_version 1264736 (0.0010) [2023-12-26 09:41:23,536][123091] Updated weights for policy 0, policy_version 1264746 (0.0011) [2023-12-26 09:41:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 645283840. Throughput: 0: 9021.5, 1: 8798.7. Samples: 645259760. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:23,784][121949] Avg episode reward: [(0, '6325.384'), (1, '4923.145')] [2023-12-26 09:41:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001264752_323780608.pth... [2023-12-26 09:41:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001255872_321503232.pth... [2023-12-26 09:41:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001254848_321241088.pth [2023-12-26 09:41:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001263664_323502080.pth [2023-12-26 09:41:23,959][123090] Updated weights for policy 1, policy_version 1255878 (0.0009) [2023-12-26 09:41:24,029][123090] Updated weights for policy 1, policy_version 1255888 (0.0010) [2023-12-26 09:41:24,105][123090] Updated weights for policy 1, policy_version 1255898 (0.0006) [2023-12-26 09:41:24,269][123091] Updated weights for policy 0, policy_version 1264756 (0.0010) [2023-12-26 09:41:24,321][123091] Updated weights for policy 0, policy_version 1264766 (0.0009) [2023-12-26 09:41:24,370][123091] Updated weights for policy 0, policy_version 1264776 (0.0009) [2023-12-26 09:41:24,892][123090] Updated weights for policy 1, policy_version 1255908 (0.0009) [2023-12-26 09:41:24,950][123090] Updated weights for policy 1, policy_version 1255918 (0.0010) [2023-12-26 09:41:25,019][123090] Updated weights for policy 1, policy_version 1255928 (0.0009) [2023-12-26 09:41:25,155][123091] Updated weights for policy 0, policy_version 1264786 (0.0009) [2023-12-26 09:41:25,204][123091] Updated weights for policy 0, policy_version 1264796 (0.0006) [2023-12-26 09:41:25,251][123091] Updated weights for policy 0, policy_version 1264806 (0.0006) [2023-12-26 09:41:25,302][123091] Updated weights for policy 0, policy_version 1264816 (0.0008) [2023-12-26 09:41:25,736][123090] Updated weights for policy 1, policy_version 1255938 (0.0008) [2023-12-26 09:41:25,798][123090] Updated weights for policy 1, policy_version 1255948 (0.0008) [2023-12-26 09:41:25,866][123090] Updated weights for policy 1, policy_version 1255958 (0.0005) [2023-12-26 09:41:25,933][123090] Updated weights for policy 1, policy_version 1255968 (0.0008) [2023-12-26 09:41:26,007][123091] Updated weights for policy 0, policy_version 1264826 (0.0005) [2023-12-26 09:41:26,087][123091] Updated weights for policy 0, policy_version 1264836 (0.0005) [2023-12-26 09:41:26,170][123091] Updated weights for policy 0, policy_version 1264846 (0.0006) [2023-12-26 09:41:26,588][123090] Updated weights for policy 1, policy_version 1255978 (0.0008) [2023-12-26 09:41:26,648][123090] Updated weights for policy 1, policy_version 1255988 (0.0011) [2023-12-26 09:41:26,699][123090] Updated weights for policy 1, policy_version 1255998 (0.0010) [2023-12-26 09:41:26,774][123091] Updated weights for policy 0, policy_version 1264856 (0.0005) [2023-12-26 09:41:26,840][123091] Updated weights for policy 0, policy_version 1264866 (0.0008) [2023-12-26 09:41:26,906][123091] Updated weights for policy 0, policy_version 1264876 (0.0006) [2023-12-26 09:41:27,486][123090] Updated weights for policy 1, policy_version 1256008 (0.0010) [2023-12-26 09:41:27,544][123090] Updated weights for policy 1, policy_version 1256018 (0.0010) [2023-12-26 09:41:27,596][123090] Updated weights for policy 1, policy_version 1256028 (0.0010) [2023-12-26 09:41:27,631][123091] Updated weights for policy 0, policy_version 1264886 (0.0009) [2023-12-26 09:41:27,674][123091] Updated weights for policy 0, policy_version 1264896 (0.0010) [2023-12-26 09:41:27,721][123091] Updated weights for policy 0, policy_version 1264906 (0.0010) [2023-12-26 09:41:28,400][123090] Updated weights for policy 1, policy_version 1256038 (0.0008) [2023-12-26 09:41:28,475][123090] Updated weights for policy 1, policy_version 1256048 (0.0005) [2023-12-26 09:41:28,490][123091] Updated weights for policy 0, policy_version 1264916 (0.0008) [2023-12-26 09:41:28,551][123090] Updated weights for policy 1, policy_version 1256058 (0.0005) [2023-12-26 09:41:28,555][123091] Updated weights for policy 0, policy_version 1264926 (0.0005) [2023-12-26 09:41:28,615][123091] Updated weights for policy 0, policy_version 1264936 (0.0010) [2023-12-26 09:41:28,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 645382144. Throughput: 0: 9070.1, 1: 8872.2. Samples: 645370932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:28,785][121949] Avg episode reward: [(0, '6148.061'), (1, '5146.663')] [2023-12-26 09:41:29,237][123090] Updated weights for policy 1, policy_version 1256068 (0.0007) [2023-12-26 09:41:29,291][123090] Updated weights for policy 1, policy_version 1256078 (0.0007) [2023-12-26 09:41:29,329][123091] Updated weights for policy 0, policy_version 1264946 (0.0009) [2023-12-26 09:41:29,355][123090] Updated weights for policy 1, policy_version 1256088 (0.0007) [2023-12-26 09:41:29,396][123091] Updated weights for policy 0, policy_version 1264956 (0.0007) [2023-12-26 09:41:29,453][123091] Updated weights for policy 0, policy_version 1264966 (0.0006) [2023-12-26 09:41:29,506][123091] Updated weights for policy 0, policy_version 1264976 (0.0005) [2023-12-26 09:41:30,125][123090] Updated weights for policy 1, policy_version 1256098 (0.0007) [2023-12-26 09:41:30,177][123090] Updated weights for policy 1, policy_version 1256108 (0.0010) [2023-12-26 09:41:30,210][123091] Updated weights for policy 0, policy_version 1264986 (0.0006) [2023-12-26 09:41:30,236][123090] Updated weights for policy 1, policy_version 1256118 (0.0010) [2023-12-26 09:41:30,264][123091] Updated weights for policy 0, policy_version 1264996 (0.0005) [2023-12-26 09:41:30,280][123090] Updated weights for policy 1, policy_version 1256128 (0.0010) [2023-12-26 09:41:30,312][123091] Updated weights for policy 0, policy_version 1265006 (0.0010) [2023-12-26 09:41:31,062][123091] Updated weights for policy 0, policy_version 1265016 (0.0011) [2023-12-26 09:41:31,117][123091] Updated weights for policy 0, policy_version 1265026 (0.0010) [2023-12-26 09:41:31,137][123090] Updated weights for policy 1, policy_version 1256138 (0.0010) [2023-12-26 09:41:31,184][123091] Updated weights for policy 0, policy_version 1265036 (0.0011) [2023-12-26 09:41:31,202][123090] Updated weights for policy 1, policy_version 1256148 (0.0010) [2023-12-26 09:41:31,265][123090] Updated weights for policy 1, policy_version 1256158 (0.0010) [2023-12-26 09:41:32,008][123090] Updated weights for policy 1, policy_version 1256168 (0.0007) [2023-12-26 09:41:32,029][123091] Updated weights for policy 0, policy_version 1265046 (0.0010) [2023-12-26 09:41:32,067][123090] Updated weights for policy 1, policy_version 1256178 (0.0008) [2023-12-26 09:41:32,077][123091] Updated weights for policy 0, policy_version 1265056 (0.0010) [2023-12-26 09:41:32,120][123090] Updated weights for policy 1, policy_version 1256188 (0.0006) [2023-12-26 09:41:32,132][123091] Updated weights for policy 0, policy_version 1265066 (0.0010) [2023-12-26 09:41:32,938][123090] Updated weights for policy 1, policy_version 1256198 (0.0009) [2023-12-26 09:41:32,974][123091] Updated weights for policy 0, policy_version 1265076 (0.0009) [2023-12-26 09:41:33,000][123090] Updated weights for policy 1, policy_version 1256208 (0.0009) [2023-12-26 09:41:33,029][123091] Updated weights for policy 0, policy_version 1265086 (0.0005) [2023-12-26 09:41:33,062][123090] Updated weights for policy 1, policy_version 1256218 (0.0010) [2023-12-26 09:41:33,083][123091] Updated weights for policy 0, policy_version 1265096 (0.0005) [2023-12-26 09:41:33,734][123091] Updated weights for policy 0, policy_version 1265106 (0.0005) [2023-12-26 09:41:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 645464064. Throughput: 0: 9134.4, 1: 8853.4. Samples: 645481132. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:33,785][121949] Avg episode reward: [(0, '6149.911'), (1, '5188.040')] [2023-12-26 09:41:33,788][123091] Updated weights for policy 0, policy_version 1265116 (0.0005) [2023-12-26 09:41:33,845][123091] Updated weights for policy 0, policy_version 1265126 (0.0005) [2023-12-26 09:41:33,897][123091] Updated weights for policy 0, policy_version 1265136 (0.0005) [2023-12-26 09:41:33,966][123090] Updated weights for policy 1, policy_version 1256228 (0.0008) [2023-12-26 09:41:34,037][123090] Updated weights for policy 1, policy_version 1256238 (0.0009) [2023-12-26 09:41:34,103][123090] Updated weights for policy 1, policy_version 1256248 (0.0009) [2023-12-26 09:41:34,674][123091] Updated weights for policy 0, policy_version 1265146 (0.0010) [2023-12-26 09:41:34,740][123091] Updated weights for policy 0, policy_version 1265156 (0.0009) [2023-12-26 09:41:34,793][123091] Updated weights for policy 0, policy_version 1265166 (0.0010) [2023-12-26 09:41:34,848][123090] Updated weights for policy 1, policy_version 1256258 (0.0008) [2023-12-26 09:41:34,898][123090] Updated weights for policy 1, policy_version 1256268 (0.0005) [2023-12-26 09:41:34,947][123090] Updated weights for policy 1, policy_version 1256278 (0.0009) [2023-12-26 09:41:34,995][123090] Updated weights for policy 1, policy_version 1256288 (0.0007) [2023-12-26 09:41:35,521][123091] Updated weights for policy 0, policy_version 1265176 (0.0006) [2023-12-26 09:41:35,568][123091] Updated weights for policy 0, policy_version 1265186 (0.0005) [2023-12-26 09:41:35,618][123091] Updated weights for policy 0, policy_version 1265196 (0.0006) [2023-12-26 09:41:35,814][123090] Updated weights for policy 1, policy_version 1256298 (0.0010) [2023-12-26 09:41:35,885][123090] Updated weights for policy 1, policy_version 1256308 (0.0009) [2023-12-26 09:41:35,948][123090] Updated weights for policy 1, policy_version 1256318 (0.0010) [2023-12-26 09:41:36,412][123091] Updated weights for policy 0, policy_version 1265206 (0.0010) [2023-12-26 09:41:36,474][123091] Updated weights for policy 0, policy_version 1265216 (0.0009) [2023-12-26 09:41:36,542][123091] Updated weights for policy 0, policy_version 1265226 (0.0009) [2023-12-26 09:41:36,751][123090] Updated weights for policy 1, policy_version 1256328 (0.0010) [2023-12-26 09:41:36,801][123090] Updated weights for policy 1, policy_version 1256338 (0.0009) [2023-12-26 09:41:36,867][123090] Updated weights for policy 1, policy_version 1256348 (0.0009) [2023-12-26 09:41:37,375][123091] Updated weights for policy 0, policy_version 1265236 (0.0010) [2023-12-26 09:41:37,440][123091] Updated weights for policy 0, policy_version 1265246 (0.0009) [2023-12-26 09:41:37,505][123091] Updated weights for policy 0, policy_version 1265256 (0.0009) [2023-12-26 09:41:37,694][123090] Updated weights for policy 1, policy_version 1256358 (0.0009) [2023-12-26 09:41:37,756][123090] Updated weights for policy 1, policy_version 1256368 (0.0008) [2023-12-26 09:41:37,816][123090] Updated weights for policy 1, policy_version 1256378 (0.0010) [2023-12-26 09:41:38,329][123091] Updated weights for policy 0, policy_version 1265266 (0.0010) [2023-12-26 09:41:38,403][123091] Updated weights for policy 0, policy_version 1265276 (0.0006) [2023-12-26 09:41:38,470][123091] Updated weights for policy 0, policy_version 1265286 (0.0005) [2023-12-26 09:41:38,530][123091] Updated weights for policy 0, policy_version 1265296 (0.0008) [2023-12-26 09:41:38,679][123090] Updated weights for policy 1, policy_version 1256388 (0.0010) [2023-12-26 09:41:38,749][123090] Updated weights for policy 1, policy_version 1256398 (0.0009) [2023-12-26 09:41:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 645554176. Throughput: 0: 9196.4, 1: 8883.2. Samples: 645534660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:38,785][121949] Avg episode reward: [(0, '6319.573'), (1, '5146.000')] [2023-12-26 09:41:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001265296_323919872.pth... [2023-12-26 09:41:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001264240_323649536.pth [2023-12-26 09:41:38,807][123090] Updated weights for policy 1, policy_version 1256408 (0.0010) [2023-12-26 09:41:38,852][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001256416_321642496.pth... [2023-12-26 09:41:38,856][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001255360_321372160.pth [2023-12-26 09:41:39,175][123091] Updated weights for policy 0, policy_version 1265306 (0.0009) [2023-12-26 09:41:39,229][123091] Updated weights for policy 0, policy_version 1265316 (0.0010) [2023-12-26 09:41:39,295][123091] Updated weights for policy 0, policy_version 1265326 (0.0007) [2023-12-26 09:41:39,674][123090] Updated weights for policy 1, policy_version 1256418 (0.0009) [2023-12-26 09:41:39,726][123090] Updated weights for policy 1, policy_version 1256428 (0.0006) [2023-12-26 09:41:39,776][123090] Updated weights for policy 1, policy_version 1256438 (0.0007) [2023-12-26 09:41:39,851][123090] Updated weights for policy 1, policy_version 1256448 (0.0013) [2023-12-26 09:41:40,128][123091] Updated weights for policy 0, policy_version 1265336 (0.0009) [2023-12-26 09:41:40,178][123091] Updated weights for policy 0, policy_version 1265346 (0.0009) [2023-12-26 09:41:40,228][123091] Updated weights for policy 0, policy_version 1265356 (0.0009) [2023-12-26 09:41:40,703][123090] Updated weights for policy 1, policy_version 1256458 (0.0010) [2023-12-26 09:41:40,762][123090] Updated weights for policy 1, policy_version 1256468 (0.0010) [2023-12-26 09:41:40,824][123090] Updated weights for policy 1, policy_version 1256478 (0.0009) [2023-12-26 09:41:40,964][123091] Updated weights for policy 0, policy_version 1265366 (0.0010) [2023-12-26 09:41:41,041][123091] Updated weights for policy 0, policy_version 1265376 (0.0012) [2023-12-26 09:41:41,103][123091] Updated weights for policy 0, policy_version 1265386 (0.0010) [2023-12-26 09:41:41,753][123090] Updated weights for policy 1, policy_version 1256488 (0.0010) [2023-12-26 09:41:41,818][123090] Updated weights for policy 1, policy_version 1256498 (0.0010) [2023-12-26 09:41:41,879][123091] Updated weights for policy 0, policy_version 1265396 (0.0008) [2023-12-26 09:41:41,889][123090] Updated weights for policy 1, policy_version 1256508 (0.0009) [2023-12-26 09:41:41,943][123091] Updated weights for policy 0, policy_version 1265406 (0.0008) [2023-12-26 09:41:42,008][123091] Updated weights for policy 0, policy_version 1265416 (0.0010) [2023-12-26 09:41:42,676][123090] Updated weights for policy 1, policy_version 1256518 (0.0006) [2023-12-26 09:41:42,738][123090] Updated weights for policy 1, policy_version 1256528 (0.0005) [2023-12-26 09:41:42,803][123090] Updated weights for policy 1, policy_version 1256538 (0.0006) [2023-12-26 09:41:42,870][123091] Updated weights for policy 0, policy_version 1265426 (0.0010) [2023-12-26 09:41:42,933][123091] Updated weights for policy 0, policy_version 1265436 (0.0005) [2023-12-26 09:41:43,010][123091] Updated weights for policy 0, policy_version 1265446 (0.0006) [2023-12-26 09:41:43,078][123091] Updated weights for policy 0, policy_version 1265456 (0.0007) [2023-12-26 09:41:43,566][123090] Updated weights for policy 1, policy_version 1256548 (0.0009) [2023-12-26 09:41:43,619][123090] Updated weights for policy 1, policy_version 1256558 (0.0009) [2023-12-26 09:41:43,675][123090] Updated weights for policy 1, policy_version 1256568 (0.0009) [2023-12-26 09:41:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 645644288. Throughput: 0: 9169.3, 1: 8733.5. Samples: 645637064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:43,785][121949] Avg episode reward: [(0, '6226.946'), (1, '5044.507')] [2023-12-26 09:41:43,791][123091] Updated weights for policy 0, policy_version 1265466 (0.0005) [2023-12-26 09:41:43,851][123091] Updated weights for policy 0, policy_version 1265476 (0.0007) [2023-12-26 09:41:43,905][123091] Updated weights for policy 0, policy_version 1265486 (0.0005) [2023-12-26 09:41:44,355][123090] Updated weights for policy 1, policy_version 1256578 (0.0009) [2023-12-26 09:41:44,409][123090] Updated weights for policy 1, policy_version 1256588 (0.0007) [2023-12-26 09:41:44,464][123090] Updated weights for policy 1, policy_version 1256598 (0.0010) [2023-12-26 09:41:44,515][123090] Updated weights for policy 1, policy_version 1256608 (0.0010) [2023-12-26 09:41:44,664][123091] Updated weights for policy 0, policy_version 1265496 (0.0008) [2023-12-26 09:41:44,730][123091] Updated weights for policy 0, policy_version 1265506 (0.0009) [2023-12-26 09:41:44,800][123091] Updated weights for policy 0, policy_version 1265516 (0.0008) [2023-12-26 09:41:45,302][123090] Updated weights for policy 1, policy_version 1256618 (0.0011) [2023-12-26 09:41:45,369][123090] Updated weights for policy 1, policy_version 1256628 (0.0011) [2023-12-26 09:41:45,436][123090] Updated weights for policy 1, policy_version 1256638 (0.0011) [2023-12-26 09:41:45,566][123091] Updated weights for policy 0, policy_version 1265526 (0.0009) [2023-12-26 09:41:45,630][123091] Updated weights for policy 0, policy_version 1265536 (0.0009) [2023-12-26 09:41:45,694][123091] Updated weights for policy 0, policy_version 1265546 (0.0009) [2023-12-26 09:41:46,197][123090] Updated weights for policy 1, policy_version 1256648 (0.0010) [2023-12-26 09:41:46,244][123090] Updated weights for policy 1, policy_version 1256658 (0.0010) [2023-12-26 09:41:46,299][123090] Updated weights for policy 1, policy_version 1256668 (0.0010) [2023-12-26 09:41:46,441][123091] Updated weights for policy 0, policy_version 1265556 (0.0008) [2023-12-26 09:41:46,497][123091] Updated weights for policy 0, policy_version 1265566 (0.0005) [2023-12-26 09:41:46,545][123091] Updated weights for policy 0, policy_version 1265576 (0.0005) [2023-12-26 09:41:47,005][123090] Updated weights for policy 1, policy_version 1256678 (0.0009) [2023-12-26 09:41:47,068][123090] Updated weights for policy 1, policy_version 1256688 (0.0010) [2023-12-26 09:41:47,122][123090] Updated weights for policy 1, policy_version 1256698 (0.0010) [2023-12-26 09:41:47,314][123091] Updated weights for policy 0, policy_version 1265586 (0.0006) [2023-12-26 09:41:47,372][123091] Updated weights for policy 0, policy_version 1265596 (0.0009) [2023-12-26 09:41:47,424][123091] Updated weights for policy 0, policy_version 1265606 (0.0009) [2023-12-26 09:41:47,491][123091] Updated weights for policy 0, policy_version 1265616 (0.0009) [2023-12-26 09:41:47,851][123090] Updated weights for policy 1, policy_version 1256708 (0.0008) [2023-12-26 09:41:47,905][123090] Updated weights for policy 1, policy_version 1256718 (0.0006) [2023-12-26 09:41:47,953][123090] Updated weights for policy 1, policy_version 1256728 (0.0006) [2023-12-26 09:41:48,346][123091] Updated weights for policy 0, policy_version 1265626 (0.0006) [2023-12-26 09:41:48,409][123091] Updated weights for policy 0, policy_version 1265636 (0.0009) [2023-12-26 09:41:48,482][123091] Updated weights for policy 0, policy_version 1265646 (0.0005) [2023-12-26 09:41:48,632][123090] Updated weights for policy 1, policy_version 1256738 (0.0006) [2023-12-26 09:41:48,684][123090] Updated weights for policy 1, policy_version 1256748 (0.0008) [2023-12-26 09:41:48,741][123090] Updated weights for policy 1, policy_version 1256758 (0.0008) [2023-12-26 09:41:48,784][121949] Fps is (10 sec: 18021.8, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 645734400. Throughput: 0: 9155.7, 1: 8866.4. Samples: 645748684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:48,786][121949] Avg episode reward: [(0, '6189.837'), (1, '5039.629')] [2023-12-26 09:41:48,808][123090] Updated weights for policy 1, policy_version 1256768 (0.0008) [2023-12-26 09:41:49,264][123091] Updated weights for policy 0, policy_version 1265656 (0.0008) [2023-12-26 09:41:49,333][123091] Updated weights for policy 0, policy_version 1265666 (0.0010) [2023-12-26 09:41:49,404][123091] Updated weights for policy 0, policy_version 1265676 (0.0009) [2023-12-26 09:41:49,618][123090] Updated weights for policy 1, policy_version 1256778 (0.0010) [2023-12-26 09:41:49,685][123090] Updated weights for policy 1, policy_version 1256788 (0.0010) [2023-12-26 09:41:49,743][123090] Updated weights for policy 1, policy_version 1256798 (0.0009) [2023-12-26 09:41:50,270][123091] Updated weights for policy 0, policy_version 1265686 (0.0010) [2023-12-26 09:41:50,328][123091] Updated weights for policy 0, policy_version 1265696 (0.0009) [2023-12-26 09:41:50,391][123091] Updated weights for policy 0, policy_version 1265706 (0.0009) [2023-12-26 09:41:50,545][123090] Updated weights for policy 1, policy_version 1256808 (0.0009) [2023-12-26 09:41:50,606][123090] Updated weights for policy 1, policy_version 1256818 (0.0008) [2023-12-26 09:41:50,680][123090] Updated weights for policy 1, policy_version 1256828 (0.0006) [2023-12-26 09:41:51,277][123091] Updated weights for policy 0, policy_version 1265716 (0.0010) [2023-12-26 09:41:51,343][123091] Updated weights for policy 0, policy_version 1265726 (0.0010) [2023-12-26 09:41:51,412][123091] Updated weights for policy 0, policy_version 1265736 (0.0010) [2023-12-26 09:41:51,452][123090] Updated weights for policy 1, policy_version 1256838 (0.0007) [2023-12-26 09:41:51,518][123090] Updated weights for policy 1, policy_version 1256848 (0.0009) [2023-12-26 09:41:51,586][123090] Updated weights for policy 1, policy_version 1256858 (0.0010) [2023-12-26 09:41:52,310][123090] Updated weights for policy 1, policy_version 1256868 (0.0007) [2023-12-26 09:41:52,324][123091] Updated weights for policy 0, policy_version 1265746 (0.0010) [2023-12-26 09:41:52,378][123091] Updated weights for policy 0, policy_version 1265756 (0.0007) [2023-12-26 09:41:52,384][123090] Updated weights for policy 1, policy_version 1256878 (0.0008) [2023-12-26 09:41:52,444][123090] Updated weights for policy 1, policy_version 1256888 (0.0006) [2023-12-26 09:41:52,451][123091] Updated weights for policy 0, policy_version 1265766 (0.0009) [2023-12-26 09:41:52,512][123091] Updated weights for policy 0, policy_version 1265776 (0.0009) [2023-12-26 09:41:53,212][123090] Updated weights for policy 1, policy_version 1256898 (0.0007) [2023-12-26 09:41:53,272][123090] Updated weights for policy 1, policy_version 1256908 (0.0005) [2023-12-26 09:41:53,320][123090] Updated weights for policy 1, policy_version 1256918 (0.0005) [2023-12-26 09:41:53,367][123090] Updated weights for policy 1, policy_version 1256928 (0.0005) [2023-12-26 09:41:53,369][123091] Updated weights for policy 0, policy_version 1265786 (0.0006) [2023-12-26 09:41:53,440][123091] Updated weights for policy 0, policy_version 1265796 (0.0009) [2023-12-26 09:41:53,492][123091] Updated weights for policy 0, policy_version 1265806 (0.0007) [2023-12-26 09:41:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 645824512. Throughput: 0: 9056.4, 1: 8873.7. Samples: 645799056. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:53,785][121949] Avg episode reward: [(0, '6344.772'), (1, '4944.322')] [2023-12-26 09:41:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001256928_321773568.pth... [2023-12-26 09:41:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001265808_324050944.pth... [2023-12-26 09:41:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001264752_323780608.pth [2023-12-26 09:41:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001255872_321503232.pth [2023-12-26 09:41:54,035][123090] Updated weights for policy 1, policy_version 1256938 (0.0005) [2023-12-26 09:41:54,096][123090] Updated weights for policy 1, policy_version 1256948 (0.0010) [2023-12-26 09:41:54,097][123091] Updated weights for policy 0, policy_version 1265816 (0.0006) [2023-12-26 09:41:54,163][123091] Updated weights for policy 0, policy_version 1265826 (0.0005) [2023-12-26 09:41:54,164][123090] Updated weights for policy 1, policy_version 1256958 (0.0010) [2023-12-26 09:41:54,234][123091] Updated weights for policy 0, policy_version 1265836 (0.0007) [2023-12-26 09:41:54,901][123091] Updated weights for policy 0, policy_version 1265846 (0.0005) [2023-12-26 09:41:54,969][123091] Updated weights for policy 0, policy_version 1265856 (0.0006) [2023-12-26 09:41:54,985][123090] Updated weights for policy 1, policy_version 1256968 (0.0011) [2023-12-26 09:41:55,030][123091] Updated weights for policy 0, policy_version 1265866 (0.0008) [2023-12-26 09:41:55,038][123090] Updated weights for policy 1, policy_version 1256978 (0.0011) [2023-12-26 09:41:55,093][123090] Updated weights for policy 1, policy_version 1256988 (0.0010) [2023-12-26 09:41:55,704][123091] Updated weights for policy 0, policy_version 1265876 (0.0006) [2023-12-26 09:41:55,761][123091] Updated weights for policy 0, policy_version 1265886 (0.0005) [2023-12-26 09:41:55,811][123091] Updated weights for policy 0, policy_version 1265896 (0.0005) [2023-12-26 09:41:55,893][123090] Updated weights for policy 1, policy_version 1256998 (0.0010) [2023-12-26 09:41:55,959][123090] Updated weights for policy 1, policy_version 1257008 (0.0010) [2023-12-26 09:41:56,010][123090] Updated weights for policy 1, policy_version 1257018 (0.0010) [2023-12-26 09:41:56,481][123091] Updated weights for policy 0, policy_version 1265906 (0.0005) [2023-12-26 09:41:56,534][123091] Updated weights for policy 0, policy_version 1265916 (0.0005) [2023-12-26 09:41:56,589][123091] Updated weights for policy 0, policy_version 1265926 (0.0005) [2023-12-26 09:41:56,639][123091] Updated weights for policy 0, policy_version 1265936 (0.0005) [2023-12-26 09:41:56,766][123090] Updated weights for policy 1, policy_version 1257028 (0.0008) [2023-12-26 09:41:56,817][123090] Updated weights for policy 1, policy_version 1257038 (0.0005) [2023-12-26 09:41:56,873][123090] Updated weights for policy 1, policy_version 1257048 (0.0005) [2023-12-26 09:41:57,325][123091] Updated weights for policy 0, policy_version 1265946 (0.0009) [2023-12-26 09:41:57,386][123091] Updated weights for policy 0, policy_version 1265956 (0.0010) [2023-12-26 09:41:57,452][123091] Updated weights for policy 0, policy_version 1265966 (0.0010) [2023-12-26 09:41:57,632][123090] Updated weights for policy 1, policy_version 1257058 (0.0006) [2023-12-26 09:41:57,689][123090] Updated weights for policy 1, policy_version 1257068 (0.0008) [2023-12-26 09:41:57,741][123090] Updated weights for policy 1, policy_version 1257078 (0.0005) [2023-12-26 09:41:57,792][123090] Updated weights for policy 1, policy_version 1257088 (0.0005) [2023-12-26 09:41:58,140][123091] Updated weights for policy 0, policy_version 1265976 (0.0009) [2023-12-26 09:41:58,207][123091] Updated weights for policy 0, policy_version 1265986 (0.0011) [2023-12-26 09:41:58,266][123091] Updated weights for policy 0, policy_version 1265996 (0.0011) [2023-12-26 09:41:58,610][123090] Updated weights for policy 1, policy_version 1257098 (0.0006) [2023-12-26 09:41:58,685][123090] Updated weights for policy 1, policy_version 1257108 (0.0006) [2023-12-26 09:41:58,753][123090] Updated weights for policy 1, policy_version 1257118 (0.0007) [2023-12-26 09:41:58,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18159.7, 300 sec: 17800.3). Total num frames: 645922816. Throughput: 0: 9142.8, 1: 8961.2. Samples: 645913576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:41:58,785][121949] Avg episode reward: [(0, '6397.929'), (1, '4865.681')] [2023-12-26 09:41:59,120][123091] Updated weights for policy 0, policy_version 1266006 (0.0010) [2023-12-26 09:41:59,186][123091] Updated weights for policy 0, policy_version 1266016 (0.0010) [2023-12-26 09:41:59,260][123091] Updated weights for policy 0, policy_version 1266026 (0.0010) [2023-12-26 09:41:59,592][123090] Updated weights for policy 1, policy_version 1257128 (0.0008) [2023-12-26 09:41:59,662][123090] Updated weights for policy 1, policy_version 1257138 (0.0006) [2023-12-26 09:41:59,718][123090] Updated weights for policy 1, policy_version 1257148 (0.0005) [2023-12-26 09:42:00,152][123091] Updated weights for policy 0, policy_version 1266036 (0.0011) [2023-12-26 09:42:00,214][123091] Updated weights for policy 0, policy_version 1266046 (0.0010) [2023-12-26 09:42:00,265][123091] Updated weights for policy 0, policy_version 1266056 (0.0010) [2023-12-26 09:42:00,457][123090] Updated weights for policy 1, policy_version 1257158 (0.0007) [2023-12-26 09:42:00,504][123090] Updated weights for policy 1, policy_version 1257168 (0.0008) [2023-12-26 09:42:00,556][123090] Updated weights for policy 1, policy_version 1257178 (0.0008) [2023-12-26 09:42:01,079][123091] Updated weights for policy 0, policy_version 1266066 (0.0010) [2023-12-26 09:42:01,147][123091] Updated weights for policy 0, policy_version 1266076 (0.0011) [2023-12-26 09:42:01,202][123091] Updated weights for policy 0, policy_version 1266086 (0.0010) [2023-12-26 09:42:01,257][123091] Updated weights for policy 0, policy_version 1266096 (0.0010) [2023-12-26 09:42:01,415][123090] Updated weights for policy 1, policy_version 1257188 (0.0009) [2023-12-26 09:42:01,472][123090] Updated weights for policy 1, policy_version 1257198 (0.0009) [2023-12-26 09:42:01,525][123090] Updated weights for policy 1, policy_version 1257208 (0.0009) [2023-12-26 09:42:02,041][123091] Updated weights for policy 0, policy_version 1266106 (0.0008) [2023-12-26 09:42:02,093][123091] Updated weights for policy 0, policy_version 1266116 (0.0008) [2023-12-26 09:42:02,153][123091] Updated weights for policy 0, policy_version 1266126 (0.0006) [2023-12-26 09:42:02,441][123090] Updated weights for policy 1, policy_version 1257218 (0.0008) [2023-12-26 09:42:02,504][123090] Updated weights for policy 1, policy_version 1257228 (0.0009) [2023-12-26 09:42:02,569][123090] Updated weights for policy 1, policy_version 1257238 (0.0010) [2023-12-26 09:42:02,636][123090] Updated weights for policy 1, policy_version 1257248 (0.0009) [2023-12-26 09:42:02,924][123091] Updated weights for policy 0, policy_version 1266136 (0.0009) [2023-12-26 09:42:02,984][123091] Updated weights for policy 0, policy_version 1266146 (0.0008) [2023-12-26 09:42:03,045][123091] Updated weights for policy 0, policy_version 1266157 (0.0009) [2023-12-26 09:42:03,448][123090] Updated weights for policy 1, policy_version 1257258 (0.0009) [2023-12-26 09:42:03,501][123090] Updated weights for policy 1, policy_version 1257268 (0.0010) [2023-12-26 09:42:03,555][123090] Updated weights for policy 1, policy_version 1257278 (0.0013) [2023-12-26 09:42:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 646004736. Throughput: 0: 9069.1, 1: 8886.6. Samples: 646016784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:03,785][121949] Avg episode reward: [(0, '6401.785'), (1, '5004.089')] [2023-12-26 09:42:03,890][123091] Updated weights for policy 0, policy_version 1266167 (0.0010) [2023-12-26 09:42:03,944][123091] Updated weights for policy 0, policy_version 1266177 (0.0009) [2023-12-26 09:42:03,997][123091] Updated weights for policy 0, policy_version 1266187 (0.0009) [2023-12-26 09:42:04,394][123090] Updated weights for policy 1, policy_version 1257288 (0.0009) [2023-12-26 09:42:04,447][123090] Updated weights for policy 1, policy_version 1257298 (0.0009) [2023-12-26 09:42:04,510][123090] Updated weights for policy 1, policy_version 1257308 (0.0009) [2023-12-26 09:42:04,860][123091] Updated weights for policy 0, policy_version 1266197 (0.0010) [2023-12-26 09:42:04,928][123091] Updated weights for policy 0, policy_version 1266207 (0.0009) [2023-12-26 09:42:04,994][123091] Updated weights for policy 0, policy_version 1266217 (0.0009) [2023-12-26 09:42:05,362][123090] Updated weights for policy 1, policy_version 1257318 (0.0010) [2023-12-26 09:42:05,428][123090] Updated weights for policy 1, policy_version 1257328 (0.0009) [2023-12-26 09:42:05,493][123090] Updated weights for policy 1, policy_version 1257338 (0.0010) [2023-12-26 09:42:05,814][123091] Updated weights for policy 0, policy_version 1266227 (0.0010) [2023-12-26 09:42:05,869][123091] Updated weights for policy 0, policy_version 1266237 (0.0010) [2023-12-26 09:42:05,923][123091] Updated weights for policy 0, policy_version 1266247 (0.0009) [2023-12-26 09:42:06,328][123090] Updated weights for policy 1, policy_version 1257348 (0.0010) [2023-12-26 09:42:06,380][123090] Updated weights for policy 1, policy_version 1257358 (0.0009) [2023-12-26 09:42:06,444][123090] Updated weights for policy 1, policy_version 1257368 (0.0009) [2023-12-26 09:42:06,749][123091] Updated weights for policy 0, policy_version 1266257 (0.0009) [2023-12-26 09:42:06,803][123091] Updated weights for policy 0, policy_version 1266267 (0.0009) [2023-12-26 09:42:06,850][123091] Updated weights for policy 0, policy_version 1266277 (0.0009) [2023-12-26 09:42:06,902][123091] Updated weights for policy 0, policy_version 1266287 (0.0009) [2023-12-26 09:42:07,300][123090] Updated weights for policy 1, policy_version 1257378 (0.0010) [2023-12-26 09:42:07,356][123090] Updated weights for policy 1, policy_version 1257388 (0.0006) [2023-12-26 09:42:07,412][123090] Updated weights for policy 1, policy_version 1257398 (0.0005) [2023-12-26 09:42:07,475][123090] Updated weights for policy 1, policy_version 1257408 (0.0005) [2023-12-26 09:42:07,751][123091] Updated weights for policy 0, policy_version 1266297 (0.0006) [2023-12-26 09:42:07,814][123091] Updated weights for policy 0, policy_version 1266307 (0.0005) [2023-12-26 09:42:07,881][123091] Updated weights for policy 0, policy_version 1266317 (0.0005) [2023-12-26 09:42:08,112][123090] Updated weights for policy 1, policy_version 1257418 (0.0005) [2023-12-26 09:42:08,173][123090] Updated weights for policy 1, policy_version 1257428 (0.0005) [2023-12-26 09:42:08,236][123090] Updated weights for policy 1, policy_version 1257438 (0.0008) [2023-12-26 09:42:08,598][123091] Updated weights for policy 0, policy_version 1266327 (0.0009) [2023-12-26 09:42:08,656][123091] Updated weights for policy 0, policy_version 1266337 (0.0011) [2023-12-26 09:42:08,720][123091] Updated weights for policy 0, policy_version 1266347 (0.0011) [2023-12-26 09:42:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 646094848. Throughput: 0: 9070.3, 1: 8886.2. Samples: 646067804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:08,785][121949] Avg episode reward: [(0, '6199.250'), (1, '5011.633')] [2023-12-26 09:42:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001266352_324190208.pth... [2023-12-26 09:42:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001257440_321904640.pth... [2023-12-26 09:42:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001256416_321642496.pth [2023-12-26 09:42:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001265296_323919872.pth [2023-12-26 09:42:08,959][123090] Updated weights for policy 1, policy_version 1257448 (0.0007) [2023-12-26 09:42:09,026][123090] Updated weights for policy 1, policy_version 1257458 (0.0010) [2023-12-26 09:42:09,096][123090] Updated weights for policy 1, policy_version 1257468 (0.0010) [2023-12-26 09:42:09,550][123091] Updated weights for policy 0, policy_version 1266357 (0.0010) [2023-12-26 09:42:09,600][123091] Updated weights for policy 0, policy_version 1266367 (0.0009) [2023-12-26 09:42:09,664][123091] Updated weights for policy 0, policy_version 1266377 (0.0011) [2023-12-26 09:42:09,882][123090] Updated weights for policy 1, policy_version 1257478 (0.0008) [2023-12-26 09:42:09,954][123090] Updated weights for policy 1, policy_version 1257488 (0.0008) [2023-12-26 09:42:10,023][123090] Updated weights for policy 1, policy_version 1257498 (0.0011) [2023-12-26 09:42:10,454][123091] Updated weights for policy 0, policy_version 1266387 (0.0011) [2023-12-26 09:42:10,523][123091] Updated weights for policy 0, policy_version 1266397 (0.0011) [2023-12-26 09:42:10,591][123091] Updated weights for policy 0, policy_version 1266407 (0.0011) [2023-12-26 09:42:10,822][123090] Updated weights for policy 1, policy_version 1257508 (0.0011) [2023-12-26 09:42:10,885][123090] Updated weights for policy 1, policy_version 1257518 (0.0011) [2023-12-26 09:42:10,937][123090] Updated weights for policy 1, policy_version 1257528 (0.0010) [2023-12-26 09:42:11,357][123091] Updated weights for policy 0, policy_version 1266417 (0.0010) [2023-12-26 09:42:11,433][123091] Updated weights for policy 0, policy_version 1266427 (0.0007) [2023-12-26 09:42:11,492][123091] Updated weights for policy 0, policy_version 1266437 (0.0009) [2023-12-26 09:42:11,565][123091] Updated weights for policy 0, policy_version 1266447 (0.0010) [2023-12-26 09:42:11,814][123090] Updated weights for policy 1, policy_version 1257538 (0.0010) [2023-12-26 09:42:11,886][123090] Updated weights for policy 1, policy_version 1257548 (0.0010) [2023-12-26 09:42:11,960][123090] Updated weights for policy 1, policy_version 1257558 (0.0010) [2023-12-26 09:42:12,031][123090] Updated weights for policy 1, policy_version 1257568 (0.0008) [2023-12-26 09:42:12,345][123091] Updated weights for policy 0, policy_version 1266457 (0.0008) [2023-12-26 09:42:12,409][123091] Updated weights for policy 0, policy_version 1266467 (0.0006) [2023-12-26 09:42:12,474][123091] Updated weights for policy 0, policy_version 1266477 (0.0008) [2023-12-26 09:42:12,844][123090] Updated weights for policy 1, policy_version 1257578 (0.0010) [2023-12-26 09:42:12,900][123090] Updated weights for policy 1, policy_version 1257588 (0.0009) [2023-12-26 09:42:12,958][123090] Updated weights for policy 1, policy_version 1257598 (0.0009) [2023-12-26 09:42:13,235][123091] Updated weights for policy 0, policy_version 1266487 (0.0007) [2023-12-26 09:42:13,307][123091] Updated weights for policy 0, policy_version 1266497 (0.0005) [2023-12-26 09:42:13,363][123091] Updated weights for policy 0, policy_version 1266507 (0.0010) [2023-12-26 09:42:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 646176768. Throughput: 0: 8992.6, 1: 8852.0. Samples: 646173936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:13,784][121949] Avg episode reward: [(0, '6211.570'), (1, '4957.630')] [2023-12-26 09:42:13,822][123090] Updated weights for policy 1, policy_version 1257608 (0.0008) [2023-12-26 09:42:13,885][123090] Updated weights for policy 1, policy_version 1257618 (0.0009) [2023-12-26 09:42:13,941][123090] Updated weights for policy 1, policy_version 1257628 (0.0008) [2023-12-26 09:42:14,091][123091] Updated weights for policy 0, policy_version 1266517 (0.0010) [2023-12-26 09:42:14,150][123091] Updated weights for policy 0, policy_version 1266527 (0.0011) [2023-12-26 09:42:14,208][123091] Updated weights for policy 0, policy_version 1266537 (0.0010) [2023-12-26 09:42:14,809][123090] Updated weights for policy 1, policy_version 1257638 (0.0008) [2023-12-26 09:42:14,877][123090] Updated weights for policy 1, policy_version 1257648 (0.0009) [2023-12-26 09:42:14,941][123090] Updated weights for policy 1, policy_version 1257658 (0.0008) [2023-12-26 09:42:14,966][123091] Updated weights for policy 0, policy_version 1266547 (0.0010) [2023-12-26 09:42:15,023][123091] Updated weights for policy 0, policy_version 1266557 (0.0011) [2023-12-26 09:42:15,076][123091] Updated weights for policy 0, policy_version 1266567 (0.0011) [2023-12-26 09:42:15,799][123090] Updated weights for policy 1, policy_version 1257668 (0.0008) [2023-12-26 09:42:15,858][123090] Updated weights for policy 1, policy_version 1257678 (0.0008) [2023-12-26 09:42:15,906][123090] Updated weights for policy 1, policy_version 1257688 (0.0009) [2023-12-26 09:42:15,925][123091] Updated weights for policy 0, policy_version 1266577 (0.0011) [2023-12-26 09:42:15,984][123091] Updated weights for policy 0, policy_version 1266587 (0.0011) [2023-12-26 09:42:16,036][123091] Updated weights for policy 0, policy_version 1266597 (0.0011) [2023-12-26 09:42:16,095][123091] Updated weights for policy 0, policy_version 1266607 (0.0011) [2023-12-26 09:42:16,589][123090] Updated weights for policy 1, policy_version 1257698 (0.0009) [2023-12-26 09:42:16,653][123090] Updated weights for policy 1, policy_version 1257708 (0.0006) [2023-12-26 09:42:16,729][123090] Updated weights for policy 1, policy_version 1257718 (0.0005) [2023-12-26 09:42:16,799][123090] Updated weights for policy 1, policy_version 1257728 (0.0005) [2023-12-26 09:42:16,939][123091] Updated weights for policy 0, policy_version 1266617 (0.0011) [2023-12-26 09:42:17,001][123091] Updated weights for policy 0, policy_version 1266627 (0.0010) [2023-12-26 09:42:17,060][123091] Updated weights for policy 0, policy_version 1266637 (0.0011) [2023-12-26 09:42:17,532][123090] Updated weights for policy 1, policy_version 1257738 (0.0005) [2023-12-26 09:42:17,597][123090] Updated weights for policy 1, policy_version 1257748 (0.0006) [2023-12-26 09:42:17,660][123090] Updated weights for policy 1, policy_version 1257758 (0.0007) [2023-12-26 09:42:17,867][123091] Updated weights for policy 0, policy_version 1266647 (0.0009) [2023-12-26 09:42:17,916][123091] Updated weights for policy 0, policy_version 1266657 (0.0009) [2023-12-26 09:42:17,965][123091] Updated weights for policy 0, policy_version 1266668 (0.0009) [2023-12-26 09:42:18,406][123090] Updated weights for policy 1, policy_version 1257768 (0.0007) [2023-12-26 09:42:18,468][123090] Updated weights for policy 1, policy_version 1257778 (0.0009) [2023-12-26 09:42:18,522][123090] Updated weights for policy 1, policy_version 1257788 (0.0009) [2023-12-26 09:42:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 646266880. Throughput: 0: 8890.5, 1: 8837.1. Samples: 646278872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:18,785][121949] Avg episode reward: [(0, '6316.346'), (1, '4801.584')] [2023-12-26 09:42:18,858][123091] Updated weights for policy 0, policy_version 1266678 (0.0010) [2023-12-26 09:42:18,929][123091] Updated weights for policy 0, policy_version 1266688 (0.0011) [2023-12-26 09:42:18,989][123091] Updated weights for policy 0, policy_version 1266698 (0.0011) [2023-12-26 09:42:19,385][123090] Updated weights for policy 1, policy_version 1257799 (0.0008) [2023-12-26 09:42:19,458][123090] Updated weights for policy 1, policy_version 1257809 (0.0010) [2023-12-26 09:42:19,526][123090] Updated weights for policy 1, policy_version 1257819 (0.0008) [2023-12-26 09:42:19,781][123091] Updated weights for policy 0, policy_version 1266708 (0.0009) [2023-12-26 09:42:19,846][123091] Updated weights for policy 0, policy_version 1266718 (0.0007) [2023-12-26 09:42:19,913][123091] Updated weights for policy 0, policy_version 1266728 (0.0005) [2023-12-26 09:42:20,360][123090] Updated weights for policy 1, policy_version 1257829 (0.0009) [2023-12-26 09:42:20,418][123090] Updated weights for policy 1, policy_version 1257839 (0.0009) [2023-12-26 09:42:20,475][123090] Updated weights for policy 1, policy_version 1257849 (0.0010) [2023-12-26 09:42:20,585][123091] Updated weights for policy 0, policy_version 1266738 (0.0010) [2023-12-26 09:42:20,646][123091] Updated weights for policy 0, policy_version 1266748 (0.0007) [2023-12-26 09:42:20,708][123091] Updated weights for policy 0, policy_version 1266758 (0.0008) [2023-12-26 09:42:20,766][123091] Updated weights for policy 0, policy_version 1266768 (0.0006) [2023-12-26 09:42:21,373][123090] Updated weights for policy 1, policy_version 1257859 (0.0010) [2023-12-26 09:42:21,452][123090] Updated weights for policy 1, policy_version 1257869 (0.0009) [2023-12-26 09:42:21,521][123090] Updated weights for policy 1, policy_version 1257879 (0.0009) [2023-12-26 09:42:21,565][123091] Updated weights for policy 0, policy_version 1266778 (0.0011) [2023-12-26 09:42:21,627][123091] Updated weights for policy 0, policy_version 1266788 (0.0011) [2023-12-26 09:42:21,696][123091] Updated weights for policy 0, policy_version 1266798 (0.0008) [2023-12-26 09:42:22,390][123090] Updated weights for policy 1, policy_version 1257889 (0.0008) [2023-12-26 09:42:22,461][123090] Updated weights for policy 1, policy_version 1257899 (0.0009) [2023-12-26 09:42:22,513][123091] Updated weights for policy 0, policy_version 1266808 (0.0007) [2023-12-26 09:42:22,535][123090] Updated weights for policy 1, policy_version 1257909 (0.0009) [2023-12-26 09:42:22,579][123091] Updated weights for policy 0, policy_version 1266818 (0.0009) [2023-12-26 09:42:22,595][123090] Updated weights for policy 1, policy_version 1257919 (0.0007) [2023-12-26 09:42:22,648][123091] Updated weights for policy 0, policy_version 1266828 (0.0011) [2023-12-26 09:42:23,440][123090] Updated weights for policy 1, policy_version 1257929 (0.0005) [2023-12-26 09:42:23,506][123091] Updated weights for policy 0, policy_version 1266838 (0.0011) [2023-12-26 09:42:23,507][123090] Updated weights for policy 1, policy_version 1257939 (0.0010) [2023-12-26 09:42:23,571][123091] Updated weights for policy 0, policy_version 1266848 (0.0011) [2023-12-26 09:42:23,572][123090] Updated weights for policy 1, policy_version 1257949 (0.0011) [2023-12-26 09:42:23,635][123091] Updated weights for policy 0, policy_version 1266858 (0.0011) [2023-12-26 09:42:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 646356992. Throughput: 0: 8881.3, 1: 8787.3. Samples: 646329752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:23,785][121949] Avg episode reward: [(0, '6313.899'), (1, '4990.159')] [2023-12-26 09:42:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001266864_324321280.pth... [2023-12-26 09:42:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001257952_322035712.pth... [2023-12-26 09:42:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001265808_324050944.pth [2023-12-26 09:42:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001256928_321773568.pth [2023-12-26 09:42:24,358][123091] Updated weights for policy 0, policy_version 1266868 (0.0010) [2023-12-26 09:42:24,365][123090] Updated weights for policy 1, policy_version 1257959 (0.0009) [2023-12-26 09:42:24,420][123091] Updated weights for policy 0, policy_version 1266878 (0.0009) [2023-12-26 09:42:24,421][123090] Updated weights for policy 1, policy_version 1257969 (0.0007) [2023-12-26 09:42:24,468][123091] Updated weights for policy 0, policy_version 1266888 (0.0008) [2023-12-26 09:42:24,477][123090] Updated weights for policy 1, policy_version 1257979 (0.0010) [2023-12-26 09:42:25,237][123091] Updated weights for policy 0, policy_version 1266898 (0.0007) [2023-12-26 09:42:25,294][123090] Updated weights for policy 1, policy_version 1257989 (0.0007) [2023-12-26 09:42:25,301][123091] Updated weights for policy 0, policy_version 1266908 (0.0007) [2023-12-26 09:42:25,347][123090] Updated weights for policy 1, policy_version 1257999 (0.0008) [2023-12-26 09:42:25,349][123091] Updated weights for policy 0, policy_version 1266918 (0.0010) [2023-12-26 09:42:25,395][123091] Updated weights for policy 0, policy_version 1266928 (0.0008) [2023-12-26 09:42:25,401][123090] Updated weights for policy 1, policy_version 1258009 (0.0007) [2023-12-26 09:42:26,162][123091] Updated weights for policy 0, policy_version 1266938 (0.0010) [2023-12-26 09:42:26,221][123091] Updated weights for policy 0, policy_version 1266948 (0.0009) [2023-12-26 09:42:26,243][123090] Updated weights for policy 1, policy_version 1258019 (0.0007) [2023-12-26 09:42:26,297][123091] Updated weights for policy 0, policy_version 1266958 (0.0006) [2023-12-26 09:42:26,310][123090] Updated weights for policy 1, policy_version 1258029 (0.0005) [2023-12-26 09:42:26,374][123090] Updated weights for policy 1, policy_version 1258039 (0.0005) [2023-12-26 09:42:26,984][123091] Updated weights for policy 0, policy_version 1266968 (0.0005) [2023-12-26 09:42:27,013][123090] Updated weights for policy 1, policy_version 1258049 (0.0005) [2023-12-26 09:42:27,032][123091] Updated weights for policy 0, policy_version 1266978 (0.0005) [2023-12-26 09:42:27,069][123090] Updated weights for policy 1, policy_version 1258059 (0.0005) [2023-12-26 09:42:27,078][123091] Updated weights for policy 0, policy_version 1266988 (0.0005) [2023-12-26 09:42:27,123][123090] Updated weights for policy 1, policy_version 1258069 (0.0006) [2023-12-26 09:42:27,179][123090] Updated weights for policy 1, policy_version 1258079 (0.0005) [2023-12-26 09:42:27,761][123091] Updated weights for policy 0, policy_version 1266998 (0.0006) [2023-12-26 09:42:27,831][123091] Updated weights for policy 0, policy_version 1267008 (0.0006) [2023-12-26 09:42:27,884][123090] Updated weights for policy 1, policy_version 1258089 (0.0007) [2023-12-26 09:42:27,890][123091] Updated weights for policy 0, policy_version 1267018 (0.0011) [2023-12-26 09:42:27,943][123090] Updated weights for policy 1, policy_version 1258099 (0.0006) [2023-12-26 09:42:27,993][123090] Updated weights for policy 1, policy_version 1258109 (0.0005) [2023-12-26 09:42:28,549][123091] Updated weights for policy 0, policy_version 1267028 (0.0009) [2023-12-26 09:42:28,614][123091] Updated weights for policy 0, policy_version 1267038 (0.0005) [2023-12-26 09:42:28,673][123091] Updated weights for policy 0, policy_version 1267048 (0.0005) [2023-12-26 09:42:28,744][123090] Updated weights for policy 1, policy_version 1258119 (0.0009) [2023-12-26 09:42:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 646447104. Throughput: 0: 8956.1, 1: 8882.7. Samples: 646439808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:28,784][121949] Avg episode reward: [(0, '6266.026'), (1, '5300.276')] [2023-12-26 09:42:28,819][123090] Updated weights for policy 1, policy_version 1258129 (0.0011) [2023-12-26 09:42:28,887][123090] Updated weights for policy 1, policy_version 1258139 (0.0011) [2023-12-26 09:42:29,450][123091] Updated weights for policy 0, policy_version 1267058 (0.0007) [2023-12-26 09:42:29,516][123091] Updated weights for policy 0, policy_version 1267068 (0.0010) [2023-12-26 09:42:29,576][123091] Updated weights for policy 0, policy_version 1267078 (0.0011) [2023-12-26 09:42:29,646][123091] Updated weights for policy 0, policy_version 1267088 (0.0011) [2023-12-26 09:42:29,714][123090] Updated weights for policy 1, policy_version 1258149 (0.0011) [2023-12-26 09:42:29,770][123090] Updated weights for policy 1, policy_version 1258160 (0.0010) [2023-12-26 09:42:29,829][123090] Updated weights for policy 1, policy_version 1258170 (0.0006) [2023-12-26 09:42:30,454][123091] Updated weights for policy 0, policy_version 1267098 (0.0010) [2023-12-26 09:42:30,512][123091] Updated weights for policy 0, policy_version 1267108 (0.0010) [2023-12-26 09:42:30,563][123091] Updated weights for policy 0, policy_version 1267118 (0.0010) [2023-12-26 09:42:30,642][123090] Updated weights for policy 1, policy_version 1258180 (0.0008) [2023-12-26 09:42:30,700][123090] Updated weights for policy 1, policy_version 1258190 (0.0008) [2023-12-26 09:42:30,750][123090] Updated weights for policy 1, policy_version 1258200 (0.0005) [2023-12-26 09:42:31,397][123091] Updated weights for policy 0, policy_version 1267128 (0.0010) [2023-12-26 09:42:31,455][123091] Updated weights for policy 0, policy_version 1267139 (0.0010) [2023-12-26 09:42:31,502][123090] Updated weights for policy 1, policy_version 1258210 (0.0005) [2023-12-26 09:42:31,508][123091] Updated weights for policy 0, policy_version 1267149 (0.0009) [2023-12-26 09:42:31,565][123090] Updated weights for policy 1, policy_version 1258220 (0.0009) [2023-12-26 09:42:31,630][123090] Updated weights for policy 1, policy_version 1258230 (0.0009) [2023-12-26 09:42:31,704][123090] Updated weights for policy 1, policy_version 1258240 (0.0007) [2023-12-26 09:42:32,293][123091] Updated weights for policy 0, policy_version 1267159 (0.0008) [2023-12-26 09:42:32,366][123091] Updated weights for policy 0, policy_version 1267169 (0.0006) [2023-12-26 09:42:32,429][123090] Updated weights for policy 1, policy_version 1258250 (0.0007) [2023-12-26 09:42:32,431][123091] Updated weights for policy 0, policy_version 1267179 (0.0007) [2023-12-26 09:42:32,479][123090] Updated weights for policy 1, policy_version 1258260 (0.0009) [2023-12-26 09:42:32,536][123090] Updated weights for policy 1, policy_version 1258270 (0.0009) [2023-12-26 09:42:33,142][123091] Updated weights for policy 0, policy_version 1267189 (0.0009) [2023-12-26 09:42:33,185][123091] Updated weights for policy 0, policy_version 1267199 (0.0010) [2023-12-26 09:42:33,236][123091] Updated weights for policy 0, policy_version 1267209 (0.0010) [2023-12-26 09:42:33,355][123090] Updated weights for policy 1, policy_version 1258280 (0.0006) [2023-12-26 09:42:33,426][123090] Updated weights for policy 1, policy_version 1258290 (0.0005) [2023-12-26 09:42:33,493][123090] Updated weights for policy 1, policy_version 1258300 (0.0005) [2023-12-26 09:42:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 646537216. Throughput: 0: 8966.9, 1: 8814.9. Samples: 646548860. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:33,785][121949] Avg episode reward: [(0, '6332.237'), (1, '5315.812')] [2023-12-26 09:42:33,902][123091] Updated weights for policy 0, policy_version 1267219 (0.0009) [2023-12-26 09:42:33,954][123091] Updated weights for policy 0, policy_version 1267229 (0.0008) [2023-12-26 09:42:34,013][123091] Updated weights for policy 0, policy_version 1267239 (0.0011) [2023-12-26 09:42:34,084][123090] Updated weights for policy 1, policy_version 1258310 (0.0006) [2023-12-26 09:42:34,153][123090] Updated weights for policy 1, policy_version 1258320 (0.0006) [2023-12-26 09:42:34,222][123090] Updated weights for policy 1, policy_version 1258330 (0.0007) [2023-12-26 09:42:34,852][123091] Updated weights for policy 0, policy_version 1267249 (0.0011) [2023-12-26 09:42:34,905][123091] Updated weights for policy 0, policy_version 1267259 (0.0009) [2023-12-26 09:42:34,953][123091] Updated weights for policy 0, policy_version 1267269 (0.0009) [2023-12-26 09:42:35,014][123091] Updated weights for policy 0, policy_version 1267279 (0.0009) [2023-12-26 09:42:35,046][123090] Updated weights for policy 1, policy_version 1258340 (0.0009) [2023-12-26 09:42:35,097][123090] Updated weights for policy 1, policy_version 1258350 (0.0008) [2023-12-26 09:42:35,150][123090] Updated weights for policy 1, policy_version 1258360 (0.0010) [2023-12-26 09:42:35,871][123091] Updated weights for policy 0, policy_version 1267289 (0.0010) [2023-12-26 09:42:35,926][123091] Updated weights for policy 0, policy_version 1267300 (0.0010) [2023-12-26 09:42:35,963][123090] Updated weights for policy 1, policy_version 1258370 (0.0006) [2023-12-26 09:42:35,977][123091] Updated weights for policy 0, policy_version 1267311 (0.0010) [2023-12-26 09:42:36,055][123090] Updated weights for policy 1, policy_version 1258380 (0.0005) [2023-12-26 09:42:36,120][123090] Updated weights for policy 1, policy_version 1258390 (0.0006) [2023-12-26 09:42:36,184][123090] Updated weights for policy 1, policy_version 1258400 (0.0011) [2023-12-26 09:42:36,903][123091] Updated weights for policy 0, policy_version 1267321 (0.0009) [2023-12-26 09:42:36,969][123091] Updated weights for policy 0, policy_version 1267331 (0.0008) [2023-12-26 09:42:36,975][123090] Updated weights for policy 1, policy_version 1258410 (0.0009) [2023-12-26 09:42:37,023][123091] Updated weights for policy 0, policy_version 1267341 (0.0008) [2023-12-26 09:42:37,040][123090] Updated weights for policy 1, policy_version 1258420 (0.0008) [2023-12-26 09:42:37,109][123090] Updated weights for policy 1, policy_version 1258430 (0.0010) [2023-12-26 09:42:37,860][123091] Updated weights for policy 0, policy_version 1267351 (0.0009) [2023-12-26 09:42:37,914][123091] Updated weights for policy 0, policy_version 1267361 (0.0008) [2023-12-26 09:42:37,942][123090] Updated weights for policy 1, policy_version 1258440 (0.0006) [2023-12-26 09:42:37,974][123091] Updated weights for policy 0, policy_version 1267371 (0.0006) [2023-12-26 09:42:37,999][123090] Updated weights for policy 1, policy_version 1258450 (0.0010) [2023-12-26 09:42:38,056][123090] Updated weights for policy 1, policy_version 1258460 (0.0011) [2023-12-26 09:42:38,760][123091] Updated weights for policy 0, policy_version 1267381 (0.0009) [2023-12-26 09:42:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 646619136. Throughput: 0: 9001.7, 1: 8825.1. Samples: 646601260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:38,785][121949] Avg episode reward: [(0, '6328.222'), (1, '5208.786')] [2023-12-26 09:42:38,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001258464_322166784.pth... [2023-12-26 09:42:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001257440_321904640.pth [2023-12-26 09:42:38,831][123091] Updated weights for policy 0, policy_version 1267391 (0.0007) [2023-12-26 09:42:38,883][123091] Updated weights for policy 0, policy_version 1267401 (0.0006) [2023-12-26 09:42:38,894][123090] Updated weights for policy 1, policy_version 1258470 (0.0011) [2023-12-26 09:42:38,917][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001267408_324460544.pth... [2023-12-26 09:42:38,920][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001266352_324190208.pth [2023-12-26 09:42:38,938][123090] Updated weights for policy 1, policy_version 1258480 (0.0010) [2023-12-26 09:42:38,986][123090] Updated weights for policy 1, policy_version 1258490 (0.0010) [2023-12-26 09:42:39,626][123091] Updated weights for policy 0, policy_version 1267411 (0.0006) [2023-12-26 09:42:39,695][123091] Updated weights for policy 0, policy_version 1267421 (0.0007) [2023-12-26 09:42:39,762][123091] Updated weights for policy 0, policy_version 1267431 (0.0007) [2023-12-26 09:42:39,912][123090] Updated weights for policy 1, policy_version 1258500 (0.0010) [2023-12-26 09:42:39,978][123090] Updated weights for policy 1, policy_version 1258510 (0.0009) [2023-12-26 09:42:40,043][123090] Updated weights for policy 1, policy_version 1258520 (0.0009) [2023-12-26 09:42:40,538][123091] Updated weights for policy 0, policy_version 1267441 (0.0007) [2023-12-26 09:42:40,602][123091] Updated weights for policy 0, policy_version 1267451 (0.0010) [2023-12-26 09:42:40,657][123091] Updated weights for policy 0, policy_version 1267461 (0.0010) [2023-12-26 09:42:40,705][123091] Updated weights for policy 0, policy_version 1267471 (0.0010) [2023-12-26 09:42:40,870][123090] Updated weights for policy 1, policy_version 1258530 (0.0008) [2023-12-26 09:42:40,937][123090] Updated weights for policy 1, policy_version 1258540 (0.0010) [2023-12-26 09:42:40,989][123090] Updated weights for policy 1, policy_version 1258550 (0.0010) [2023-12-26 09:42:41,053][123090] Updated weights for policy 1, policy_version 1258560 (0.0010) [2023-12-26 09:42:41,523][123091] Updated weights for policy 0, policy_version 1267481 (0.0008) [2023-12-26 09:42:41,583][123091] Updated weights for policy 0, policy_version 1267491 (0.0006) [2023-12-26 09:42:41,659][123091] Updated weights for policy 0, policy_version 1267501 (0.0010) [2023-12-26 09:42:41,948][123090] Updated weights for policy 1, policy_version 1258570 (0.0006) [2023-12-26 09:42:42,012][123090] Updated weights for policy 1, policy_version 1258580 (0.0011) [2023-12-26 09:42:42,077][123090] Updated weights for policy 1, policy_version 1258590 (0.0011) [2023-12-26 09:42:42,443][123091] Updated weights for policy 0, policy_version 1267511 (0.0009) [2023-12-26 09:42:42,509][123091] Updated weights for policy 0, policy_version 1267521 (0.0009) [2023-12-26 09:42:42,561][123091] Updated weights for policy 0, policy_version 1267531 (0.0009) [2023-12-26 09:42:42,898][123090] Updated weights for policy 1, policy_version 1258600 (0.0011) [2023-12-26 09:42:42,958][123090] Updated weights for policy 1, policy_version 1258610 (0.0010) [2023-12-26 09:42:43,024][123090] Updated weights for policy 1, policy_version 1258620 (0.0010) [2023-12-26 09:42:43,293][123091] Updated weights for policy 0, policy_version 1267541 (0.0007) [2023-12-26 09:42:43,341][123091] Updated weights for policy 0, policy_version 1267551 (0.0005) [2023-12-26 09:42:43,387][123091] Updated weights for policy 0, policy_version 1267561 (0.0005) [2023-12-26 09:42:43,750][123090] Updated weights for policy 1, policy_version 1258630 (0.0007) [2023-12-26 09:42:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 646709248. Throughput: 0: 8872.0, 1: 8694.8. Samples: 646704084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:43,785][121949] Avg episode reward: [(0, '6303.569'), (1, '5210.402')] [2023-12-26 09:42:43,823][123090] Updated weights for policy 1, policy_version 1258640 (0.0005) [2023-12-26 09:42:43,875][123090] Updated weights for policy 1, policy_version 1258650 (0.0005) [2023-12-26 09:42:44,060][123091] Updated weights for policy 0, policy_version 1267571 (0.0007) [2023-12-26 09:42:44,114][123091] Updated weights for policy 0, policy_version 1267582 (0.0010) [2023-12-26 09:42:44,173][123091] Updated weights for policy 0, policy_version 1267592 (0.0010) [2023-12-26 09:42:44,546][123090] Updated weights for policy 1, policy_version 1258660 (0.0005) [2023-12-26 09:42:44,601][123090] Updated weights for policy 1, policy_version 1258670 (0.0010) [2023-12-26 09:42:44,670][123090] Updated weights for policy 1, policy_version 1258680 (0.0010) [2023-12-26 09:42:45,101][123091] Updated weights for policy 0, policy_version 1267602 (0.0009) [2023-12-26 09:42:45,155][123091] Updated weights for policy 0, policy_version 1267612 (0.0009) [2023-12-26 09:42:45,219][123091] Updated weights for policy 0, policy_version 1267622 (0.0009) [2023-12-26 09:42:45,281][123091] Updated weights for policy 0, policy_version 1267632 (0.0009) [2023-12-26 09:42:45,476][123090] Updated weights for policy 1, policy_version 1258690 (0.0011) [2023-12-26 09:42:45,530][123090] Updated weights for policy 1, policy_version 1258700 (0.0010) [2023-12-26 09:42:45,579][123090] Updated weights for policy 1, policy_version 1258710 (0.0010) [2023-12-26 09:42:45,627][123090] Updated weights for policy 1, policy_version 1258720 (0.0010) [2023-12-26 09:42:46,026][123091] Updated weights for policy 0, policy_version 1267642 (0.0010) [2023-12-26 09:42:46,070][123091] Updated weights for policy 0, policy_version 1267652 (0.0010) [2023-12-26 09:42:46,121][123091] Updated weights for policy 0, policy_version 1267662 (0.0010) [2023-12-26 09:42:46,464][123090] Updated weights for policy 1, policy_version 1258730 (0.0010) [2023-12-26 09:42:46,511][123090] Updated weights for policy 1, policy_version 1258740 (0.0010) [2023-12-26 09:42:46,565][123090] Updated weights for policy 1, policy_version 1258750 (0.0010) [2023-12-26 09:42:46,976][123091] Updated weights for policy 0, policy_version 1267672 (0.0010) [2023-12-26 09:42:47,035][123091] Updated weights for policy 0, policy_version 1267682 (0.0010) [2023-12-26 09:42:47,091][123091] Updated weights for policy 0, policy_version 1267692 (0.0011) [2023-12-26 09:42:47,359][123090] Updated weights for policy 1, policy_version 1258760 (0.0007) [2023-12-26 09:42:47,409][123090] Updated weights for policy 1, policy_version 1258770 (0.0005) [2023-12-26 09:42:47,464][123090] Updated weights for policy 1, policy_version 1258780 (0.0005) [2023-12-26 09:42:47,928][123091] Updated weights for policy 0, policy_version 1267702 (0.0010) [2023-12-26 09:42:47,980][123091] Updated weights for policy 0, policy_version 1267712 (0.0010) [2023-12-26 09:42:48,029][123091] Updated weights for policy 0, policy_version 1267722 (0.0007) [2023-12-26 09:42:48,054][123090] Updated weights for policy 1, policy_version 1258790 (0.0005) [2023-12-26 09:42:48,112][123090] Updated weights for policy 1, policy_version 1258800 (0.0005) [2023-12-26 09:42:48,167][123090] Updated weights for policy 1, policy_version 1258810 (0.0007) [2023-12-26 09:42:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.5, 300 sec: 17828.0). Total num frames: 646799360. Throughput: 0: 8903.5, 1: 8834.7. Samples: 646815000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:48,785][121949] Avg episode reward: [(0, '6332.218'), (1, '5384.756')] [2023-12-26 09:42:48,859][123091] Updated weights for policy 0, policy_version 1267732 (0.0011) [2023-12-26 09:42:48,861][123090] Updated weights for policy 1, policy_version 1258820 (0.0007) [2023-12-26 09:42:48,913][123090] Updated weights for policy 1, policy_version 1258830 (0.0010) [2023-12-26 09:42:48,919][123091] Updated weights for policy 0, policy_version 1267742 (0.0011) [2023-12-26 09:42:48,968][123090] Updated weights for policy 1, policy_version 1258840 (0.0005) [2023-12-26 09:42:48,983][123091] Updated weights for policy 0, policy_version 1267752 (0.0011) [2023-12-26 09:42:49,761][123091] Updated weights for policy 0, policy_version 1267762 (0.0011) [2023-12-26 09:42:49,798][123090] Updated weights for policy 1, policy_version 1258850 (0.0006) [2023-12-26 09:42:49,809][123091] Updated weights for policy 0, policy_version 1267772 (0.0010) [2023-12-26 09:42:49,860][123090] Updated weights for policy 1, policy_version 1258860 (0.0009) [2023-12-26 09:42:49,879][123091] Updated weights for policy 0, policy_version 1267782 (0.0007) [2023-12-26 09:42:49,925][123090] Updated weights for policy 1, policy_version 1258870 (0.0011) [2023-12-26 09:42:49,949][123091] Updated weights for policy 0, policy_version 1267792 (0.0007) [2023-12-26 09:42:49,989][123090] Updated weights for policy 1, policy_version 1258880 (0.0010) [2023-12-26 09:42:50,768][123091] Updated weights for policy 0, policy_version 1267802 (0.0010) [2023-12-26 09:42:50,807][123090] Updated weights for policy 1, policy_version 1258890 (0.0006) [2023-12-26 09:42:50,839][123091] Updated weights for policy 0, policy_version 1267812 (0.0008) [2023-12-26 09:42:50,869][123090] Updated weights for policy 1, policy_version 1258900 (0.0006) [2023-12-26 09:42:50,906][123091] Updated weights for policy 0, policy_version 1267822 (0.0007) [2023-12-26 09:42:50,925][123090] Updated weights for policy 1, policy_version 1258910 (0.0009) [2023-12-26 09:42:51,643][123090] Updated weights for policy 1, policy_version 1258920 (0.0008) [2023-12-26 09:42:51,714][123090] Updated weights for policy 1, policy_version 1258930 (0.0009) [2023-12-26 09:42:51,736][123091] Updated weights for policy 0, policy_version 1267832 (0.0007) [2023-12-26 09:42:51,781][123090] Updated weights for policy 1, policy_version 1258940 (0.0009) [2023-12-26 09:42:51,802][123091] Updated weights for policy 0, policy_version 1267842 (0.0010) [2023-12-26 09:42:51,867][123091] Updated weights for policy 0, policy_version 1267852 (0.0011) [2023-12-26 09:42:52,606][123091] Updated weights for policy 0, policy_version 1267862 (0.0009) [2023-12-26 09:42:52,653][123090] Updated weights for policy 1, policy_version 1258950 (0.0009) [2023-12-26 09:42:52,668][123091] Updated weights for policy 0, policy_version 1267872 (0.0007) [2023-12-26 09:42:52,716][123091] Updated weights for policy 0, policy_version 1267882 (0.0006) [2023-12-26 09:42:52,722][123090] Updated weights for policy 1, policy_version 1258960 (0.0010) [2023-12-26 09:42:52,785][123090] Updated weights for policy 1, policy_version 1258970 (0.0011) [2023-12-26 09:42:53,535][123091] Updated weights for policy 0, policy_version 1267892 (0.0010) [2023-12-26 09:42:53,588][123091] Updated weights for policy 0, policy_version 1267902 (0.0009) [2023-12-26 09:42:53,604][123090] Updated weights for policy 1, policy_version 1258980 (0.0011) [2023-12-26 09:42:53,646][123091] Updated weights for policy 0, policy_version 1267912 (0.0006) [2023-12-26 09:42:53,656][123090] Updated weights for policy 1, policy_version 1258990 (0.0010) [2023-12-26 09:42:53,705][123090] Updated weights for policy 1, policy_version 1259000 (0.0010) [2023-12-26 09:42:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 646897664. Throughput: 0: 8919.7, 1: 8876.3. Samples: 646868628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:53,785][121949] Avg episode reward: [(0, '6332.313'), (1, '5294.339')] [2023-12-26 09:42:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001267920_324591616.pth... [2023-12-26 09:42:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001259008_322306048.pth... [2023-12-26 09:42:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001266864_324321280.pth [2023-12-26 09:42:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001257952_322035712.pth [2023-12-26 09:42:54,493][123091] Updated weights for policy 0, policy_version 1267922 (0.0008) [2023-12-26 09:42:54,553][123091] Updated weights for policy 0, policy_version 1267932 (0.0009) [2023-12-26 09:42:54,560][123090] Updated weights for policy 1, policy_version 1259010 (0.0010) [2023-12-26 09:42:54,610][123091] Updated weights for policy 0, policy_version 1267942 (0.0007) [2023-12-26 09:42:54,618][123090] Updated weights for policy 1, policy_version 1259020 (0.0008) [2023-12-26 09:42:54,679][123091] Updated weights for policy 0, policy_version 1267952 (0.0008) [2023-12-26 09:42:54,680][123090] Updated weights for policy 1, policy_version 1259030 (0.0010) [2023-12-26 09:42:54,729][123090] Updated weights for policy 1, policy_version 1259040 (0.0009) [2023-12-26 09:42:55,490][123091] Updated weights for policy 0, policy_version 1267962 (0.0009) [2023-12-26 09:42:55,540][123091] Updated weights for policy 0, policy_version 1267972 (0.0008) [2023-12-26 09:42:55,585][123090] Updated weights for policy 1, policy_version 1259050 (0.0009) [2023-12-26 09:42:55,596][123091] Updated weights for policy 0, policy_version 1267982 (0.0005) [2023-12-26 09:42:55,640][123090] Updated weights for policy 1, policy_version 1259061 (0.0010) [2023-12-26 09:42:55,693][123090] Updated weights for policy 1, policy_version 1259071 (0.0010) [2023-12-26 09:42:56,354][123091] Updated weights for policy 0, policy_version 1267992 (0.0005) [2023-12-26 09:42:56,404][123091] Updated weights for policy 0, policy_version 1268002 (0.0005) [2023-12-26 09:42:56,463][123091] Updated weights for policy 0, policy_version 1268012 (0.0006) [2023-12-26 09:42:56,481][123090] Updated weights for policy 1, policy_version 1259081 (0.0010) [2023-12-26 09:42:56,543][123090] Updated weights for policy 1, policy_version 1259091 (0.0010) [2023-12-26 09:42:56,606][123090] Updated weights for policy 1, policy_version 1259101 (0.0010) [2023-12-26 09:42:57,207][123091] Updated weights for policy 0, policy_version 1268022 (0.0007) [2023-12-26 09:42:57,253][123091] Updated weights for policy 0, policy_version 1268032 (0.0008) [2023-12-26 09:42:57,309][123091] Updated weights for policy 0, policy_version 1268042 (0.0008) [2023-12-26 09:42:57,382][123090] Updated weights for policy 1, policy_version 1259111 (0.0010) [2023-12-26 09:42:57,429][123090] Updated weights for policy 1, policy_version 1259121 (0.0010) [2023-12-26 09:42:57,484][123090] Updated weights for policy 1, policy_version 1259131 (0.0010) [2023-12-26 09:42:58,159][123091] Updated weights for policy 0, policy_version 1268052 (0.0009) [2023-12-26 09:42:58,226][123091] Updated weights for policy 0, policy_version 1268062 (0.0011) [2023-12-26 09:42:58,289][123091] Updated weights for policy 0, policy_version 1268072 (0.0010) [2023-12-26 09:42:58,361][123090] Updated weights for policy 1, policy_version 1259141 (0.0010) [2023-12-26 09:42:58,429][123090] Updated weights for policy 1, policy_version 1259151 (0.0009) [2023-12-26 09:42:58,498][123090] Updated weights for policy 1, policy_version 1259161 (0.0007) [2023-12-26 09:42:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 646979584. Throughput: 0: 8918.4, 1: 8820.8. Samples: 646972200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:42:58,785][121949] Avg episode reward: [(0, '6336.070'), (1, '4962.460')] [2023-12-26 09:42:59,218][123091] Updated weights for policy 0, policy_version 1268082 (0.0010) [2023-12-26 09:42:59,287][123091] Updated weights for policy 0, policy_version 1268092 (0.0009) [2023-12-26 09:42:59,357][123091] Updated weights for policy 0, policy_version 1268102 (0.0010) [2023-12-26 09:42:59,405][123090] Updated weights for policy 1, policy_version 1259171 (0.0008) [2023-12-26 09:42:59,422][123091] Updated weights for policy 0, policy_version 1268112 (0.0009) [2023-12-26 09:42:59,469][123090] Updated weights for policy 1, policy_version 1259181 (0.0010) [2023-12-26 09:42:59,529][123090] Updated weights for policy 1, policy_version 1259191 (0.0009) [2023-12-26 09:43:00,236][123090] Updated weights for policy 1, policy_version 1259201 (0.0006) [2023-12-26 09:43:00,298][123090] Updated weights for policy 1, policy_version 1259211 (0.0005) [2023-12-26 09:43:00,326][123091] Updated weights for policy 0, policy_version 1268122 (0.0009) [2023-12-26 09:43:00,360][123090] Updated weights for policy 1, policy_version 1259221 (0.0005) [2023-12-26 09:43:00,386][123091] Updated weights for policy 0, policy_version 1268132 (0.0008) [2023-12-26 09:43:00,427][123090] Updated weights for policy 1, policy_version 1259231 (0.0005) [2023-12-26 09:43:00,446][123091] Updated weights for policy 0, policy_version 1268142 (0.0009) [2023-12-26 09:43:01,148][123090] Updated weights for policy 1, policy_version 1259241 (0.0009) [2023-12-26 09:43:01,214][123090] Updated weights for policy 1, policy_version 1259251 (0.0007) [2023-12-26 09:43:01,279][123090] Updated weights for policy 1, policy_version 1259261 (0.0009) [2023-12-26 09:43:01,353][123091] Updated weights for policy 0, policy_version 1268152 (0.0011) [2023-12-26 09:43:01,423][123091] Updated weights for policy 0, policy_version 1268162 (0.0010) [2023-12-26 09:43:01,476][123091] Updated weights for policy 0, policy_version 1268172 (0.0009) [2023-12-26 09:43:02,004][123090] Updated weights for policy 1, policy_version 1259271 (0.0010) [2023-12-26 09:43:02,052][123090] Updated weights for policy 1, policy_version 1259281 (0.0006) [2023-12-26 09:43:02,117][123090] Updated weights for policy 1, policy_version 1259291 (0.0008) [2023-12-26 09:43:02,277][123091] Updated weights for policy 0, policy_version 1268182 (0.0012) [2023-12-26 09:43:02,334][123091] Updated weights for policy 0, policy_version 1268192 (0.0008) [2023-12-26 09:43:02,392][123091] Updated weights for policy 0, policy_version 1268202 (0.0006) [2023-12-26 09:43:02,776][123090] Updated weights for policy 1, policy_version 1259301 (0.0007) [2023-12-26 09:43:02,841][123090] Updated weights for policy 1, policy_version 1259311 (0.0005) [2023-12-26 09:43:02,897][123090] Updated weights for policy 1, policy_version 1259321 (0.0005) [2023-12-26 09:43:03,169][123091] Updated weights for policy 0, policy_version 1268212 (0.0007) [2023-12-26 09:43:03,233][123091] Updated weights for policy 0, policy_version 1268222 (0.0006) [2023-12-26 09:43:03,292][123091] Updated weights for policy 0, policy_version 1268232 (0.0006) [2023-12-26 09:43:03,522][123090] Updated weights for policy 1, policy_version 1259331 (0.0005) [2023-12-26 09:43:03,569][123090] Updated weights for policy 1, policy_version 1259341 (0.0005) [2023-12-26 09:43:03,642][123090] Updated weights for policy 1, policy_version 1259351 (0.0005) [2023-12-26 09:43:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 647069696. Throughput: 0: 8874.9, 1: 8904.3. Samples: 647078940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:43:03,786][121949] Avg episode reward: [(0, '6379.147'), (1, '4871.593')] [2023-12-26 09:43:04,016][123091] Updated weights for policy 0, policy_version 1268242 (0.0007) [2023-12-26 09:43:04,075][123091] Updated weights for policy 0, policy_version 1268252 (0.0010) [2023-12-26 09:43:04,142][123091] Updated weights for policy 0, policy_version 1268262 (0.0011) [2023-12-26 09:43:04,202][123091] Updated weights for policy 0, policy_version 1268272 (0.0011) [2023-12-26 09:43:04,411][123090] Updated weights for policy 1, policy_version 1259361 (0.0007) [2023-12-26 09:43:04,466][123090] Updated weights for policy 1, policy_version 1259371 (0.0005) [2023-12-26 09:43:04,538][123090] Updated weights for policy 1, policy_version 1259381 (0.0009) [2023-12-26 09:43:04,611][123090] Updated weights for policy 1, policy_version 1259391 (0.0010) [2023-12-26 09:43:04,934][123091] Updated weights for policy 0, policy_version 1268282 (0.0006) [2023-12-26 09:43:04,989][123091] Updated weights for policy 0, policy_version 1268292 (0.0005) [2023-12-26 09:43:05,036][123091] Updated weights for policy 0, policy_version 1268302 (0.0006) [2023-12-26 09:43:05,499][123090] Updated weights for policy 1, policy_version 1259401 (0.0009) [2023-12-26 09:43:05,560][123090] Updated weights for policy 1, policy_version 1259411 (0.0010) [2023-12-26 09:43:05,620][123090] Updated weights for policy 1, policy_version 1259421 (0.0009) [2023-12-26 09:43:05,654][123091] Updated weights for policy 0, policy_version 1268312 (0.0006) [2023-12-26 09:43:05,705][123091] Updated weights for policy 0, policy_version 1268322 (0.0005) [2023-12-26 09:43:05,758][123091] Updated weights for policy 0, policy_version 1268332 (0.0005) [2023-12-26 09:43:06,486][123091] Updated weights for policy 0, policy_version 1268342 (0.0005) [2023-12-26 09:43:06,551][123090] Updated weights for policy 1, policy_version 1259431 (0.0010) [2023-12-26 09:43:06,558][123091] Updated weights for policy 0, policy_version 1268352 (0.0006) [2023-12-26 09:43:06,614][123090] Updated weights for policy 1, policy_version 1259441 (0.0009) [2023-12-26 09:43:06,623][123091] Updated weights for policy 0, policy_version 1268362 (0.0007) [2023-12-26 09:43:06,679][123090] Updated weights for policy 1, policy_version 1259451 (0.0008) [2023-12-26 09:43:07,371][123091] Updated weights for policy 0, policy_version 1268372 (0.0010) [2023-12-26 09:43:07,431][123091] Updated weights for policy 0, policy_version 1268382 (0.0005) [2023-12-26 09:43:07,504][123091] Updated weights for policy 0, policy_version 1268392 (0.0006) [2023-12-26 09:43:07,540][123090] Updated weights for policy 1, policy_version 1259461 (0.0009) [2023-12-26 09:43:07,599][123090] Updated weights for policy 1, policy_version 1259471 (0.0009) [2023-12-26 09:43:07,657][123090] Updated weights for policy 1, policy_version 1259481 (0.0009) [2023-12-26 09:43:08,248][123091] Updated weights for policy 0, policy_version 1268402 (0.0005) [2023-12-26 09:43:08,297][123091] Updated weights for policy 0, policy_version 1268412 (0.0005) [2023-12-26 09:43:08,361][123091] Updated weights for policy 0, policy_version 1268422 (0.0007) [2023-12-26 09:43:08,434][123091] Updated weights for policy 0, policy_version 1268432 (0.0007) [2023-12-26 09:43:08,558][123090] Updated weights for policy 1, policy_version 1259491 (0.0009) [2023-12-26 09:43:08,633][123090] Updated weights for policy 1, policy_version 1259501 (0.0005) [2023-12-26 09:43:08,704][123090] Updated weights for policy 1, policy_version 1259511 (0.0007) [2023-12-26 09:43:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 647159808. Throughput: 0: 8946.3, 1: 8911.5. Samples: 647133348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:43:08,785][121949] Avg episode reward: [(0, '6408.117'), (1, '4893.012')] [2023-12-26 09:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001268432_324722688.pth... [2023-12-26 09:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001259520_322437120.pth... [2023-12-26 09:43:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001258464_322166784.pth [2023-12-26 09:43:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001267408_324460544.pth [2023-12-26 09:43:09,202][123091] Updated weights for policy 0, policy_version 1268442 (0.0008) [2023-12-26 09:43:09,265][123091] Updated weights for policy 0, policy_version 1268452 (0.0010) [2023-12-26 09:43:09,324][123091] Updated weights for policy 0, policy_version 1268462 (0.0011) [2023-12-26 09:43:09,493][123090] Updated weights for policy 1, policy_version 1259521 (0.0010) [2023-12-26 09:43:09,560][123090] Updated weights for policy 1, policy_version 1259531 (0.0011) [2023-12-26 09:43:09,625][123090] Updated weights for policy 1, policy_version 1259541 (0.0011) [2023-12-26 09:43:09,689][123090] Updated weights for policy 1, policy_version 1259551 (0.0011) [2023-12-26 09:43:10,095][123091] Updated weights for policy 0, policy_version 1268472 (0.0009) [2023-12-26 09:43:10,161][123091] Updated weights for policy 0, policy_version 1268482 (0.0009) [2023-12-26 09:43:10,225][123091] Updated weights for policy 0, policy_version 1268492 (0.0008) [2023-12-26 09:43:10,542][123090] Updated weights for policy 1, policy_version 1259561 (0.0011) [2023-12-26 09:43:10,607][123090] Updated weights for policy 1, policy_version 1259571 (0.0011) [2023-12-26 09:43:10,660][123090] Updated weights for policy 1, policy_version 1259581 (0.0010) [2023-12-26 09:43:10,958][123091] Updated weights for policy 0, policy_version 1268502 (0.0008) [2023-12-26 09:43:11,019][123091] Updated weights for policy 0, policy_version 1268512 (0.0009) [2023-12-26 09:43:11,083][123091] Updated weights for policy 0, policy_version 1268522 (0.0010) [2023-12-26 09:43:11,522][123090] Updated weights for policy 1, policy_version 1259591 (0.0009) [2023-12-26 09:43:11,582][123090] Updated weights for policy 1, policy_version 1259601 (0.0009) [2023-12-26 09:43:11,645][123090] Updated weights for policy 1, policy_version 1259611 (0.0011) [2023-12-26 09:43:11,935][123091] Updated weights for policy 0, policy_version 1268532 (0.0010) [2023-12-26 09:43:11,984][123091] Updated weights for policy 0, policy_version 1268542 (0.0008) [2023-12-26 09:43:12,039][123091] Updated weights for policy 0, policy_version 1268552 (0.0008) [2023-12-26 09:43:12,527][123090] Updated weights for policy 1, policy_version 1259621 (0.0011) [2023-12-26 09:43:12,583][123090] Updated weights for policy 1, policy_version 1259631 (0.0010) [2023-12-26 09:43:12,636][123090] Updated weights for policy 1, policy_version 1259641 (0.0010) [2023-12-26 09:43:12,797][123091] Updated weights for policy 0, policy_version 1268562 (0.0007) [2023-12-26 09:43:12,858][123091] Updated weights for policy 0, policy_version 1268572 (0.0010) [2023-12-26 09:43:12,926][123091] Updated weights for policy 0, policy_version 1268582 (0.0005) [2023-12-26 09:43:12,992][123091] Updated weights for policy 0, policy_version 1268592 (0.0006) [2023-12-26 09:43:13,488][123090] Updated weights for policy 1, policy_version 1259651 (0.0009) [2023-12-26 09:43:13,560][123090] Updated weights for policy 1, policy_version 1259661 (0.0005) [2023-12-26 09:43:13,612][123090] Updated weights for policy 1, policy_version 1259671 (0.0005) [2023-12-26 09:43:13,662][123091] Updated weights for policy 0, policy_version 1268602 (0.0005) [2023-12-26 09:43:13,717][123091] Updated weights for policy 0, policy_version 1268612 (0.0005) [2023-12-26 09:43:13,771][123091] Updated weights for policy 0, policy_version 1268622 (0.0006) [2023-12-26 09:43:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 647241728. Throughput: 0: 8913.5, 1: 8808.5. Samples: 647237300. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:13,785][121949] Avg episode reward: [(0, '6447.349'), (1, '4975.866')] [2023-12-26 09:43:14,296][123090] Updated weights for policy 1, policy_version 1259681 (0.0005) [2023-12-26 09:43:14,359][123090] Updated weights for policy 1, policy_version 1259691 (0.0005) [2023-12-26 09:43:14,426][123090] Updated weights for policy 1, policy_version 1259701 (0.0007) [2023-12-26 09:43:14,435][123091] Updated weights for policy 0, policy_version 1268632 (0.0005) [2023-12-26 09:43:14,482][123090] Updated weights for policy 1, policy_version 1259711 (0.0009) [2023-12-26 09:43:14,485][123091] Updated weights for policy 0, policy_version 1268642 (0.0005) [2023-12-26 09:43:14,545][123091] Updated weights for policy 0, policy_version 1268652 (0.0005) [2023-12-26 09:43:15,195][123091] Updated weights for policy 0, policy_version 1268662 (0.0008) [2023-12-26 09:43:15,257][123091] Updated weights for policy 0, policy_version 1268672 (0.0006) [2023-12-26 09:43:15,296][123090] Updated weights for policy 1, policy_version 1259721 (0.0007) [2023-12-26 09:43:15,325][123091] Updated weights for policy 0, policy_version 1268682 (0.0007) [2023-12-26 09:43:15,363][123090] Updated weights for policy 1, policy_version 1259731 (0.0007) [2023-12-26 09:43:15,430][123090] Updated weights for policy 1, policy_version 1259741 (0.0011) [2023-12-26 09:43:16,072][123091] Updated weights for policy 0, policy_version 1268692 (0.0007) [2023-12-26 09:43:16,125][123091] Updated weights for policy 0, policy_version 1268702 (0.0007) [2023-12-26 09:43:16,177][123091] Updated weights for policy 0, policy_version 1268712 (0.0005) [2023-12-26 09:43:16,218][123090] Updated weights for policy 1, policy_version 1259751 (0.0009) [2023-12-26 09:43:16,275][123090] Updated weights for policy 1, policy_version 1259761 (0.0009) [2023-12-26 09:43:16,332][123090] Updated weights for policy 1, policy_version 1259772 (0.0011) [2023-12-26 09:43:16,944][123091] Updated weights for policy 0, policy_version 1268722 (0.0006) [2023-12-26 09:43:17,004][123091] Updated weights for policy 0, policy_version 1268732 (0.0009) [2023-12-26 09:43:17,056][123091] Updated weights for policy 0, policy_version 1268742 (0.0009) [2023-12-26 09:43:17,201][123090] Updated weights for policy 1, policy_version 1259782 (0.0010) [2023-12-26 09:43:17,257][123090] Updated weights for policy 1, policy_version 1259792 (0.0010) [2023-12-26 09:43:17,316][123090] Updated weights for policy 1, policy_version 1259802 (0.0010) [2023-12-26 09:43:17,888][123091] Updated weights for policy 0, policy_version 1268753 (0.0009) [2023-12-26 09:43:17,938][123091] Updated weights for policy 0, policy_version 1268763 (0.0008) [2023-12-26 09:43:17,989][123091] Updated weights for policy 0, policy_version 1268773 (0.0005) [2023-12-26 09:43:18,051][123091] Updated weights for policy 0, policy_version 1268783 (0.0007) [2023-12-26 09:43:18,120][123090] Updated weights for policy 1, policy_version 1259812 (0.0008) [2023-12-26 09:43:18,189][123090] Updated weights for policy 1, policy_version 1259822 (0.0005) [2023-12-26 09:43:18,242][123090] Updated weights for policy 1, policy_version 1259832 (0.0005) [2023-12-26 09:43:18,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 647331840. Throughput: 0: 8964.8, 1: 8783.6. Samples: 647347540. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:18,786][121949] Avg episode reward: [(0, '6397.257'), (1, '5077.892')] [2023-12-26 09:43:18,848][123091] Updated weights for policy 0, policy_version 1268793 (0.0009) [2023-12-26 09:43:18,903][123091] Updated weights for policy 0, policy_version 1268803 (0.0010) [2023-12-26 09:43:18,955][123091] Updated weights for policy 0, policy_version 1268813 (0.0009) [2023-12-26 09:43:18,974][123090] Updated weights for policy 1, policy_version 1259842 (0.0006) [2023-12-26 09:43:19,028][123090] Updated weights for policy 1, policy_version 1259852 (0.0005) [2023-12-26 09:43:19,092][123090] Updated weights for policy 1, policy_version 1259862 (0.0005) [2023-12-26 09:43:19,161][123090] Updated weights for policy 1, policy_version 1259872 (0.0010) [2023-12-26 09:43:19,817][123091] Updated weights for policy 0, policy_version 1268823 (0.0008) [2023-12-26 09:43:19,894][123091] Updated weights for policy 0, policy_version 1268833 (0.0011) [2023-12-26 09:43:19,963][123091] Updated weights for policy 0, policy_version 1268843 (0.0011) [2023-12-26 09:43:19,988][123090] Updated weights for policy 1, policy_version 1259882 (0.0007) [2023-12-26 09:43:20,058][123090] Updated weights for policy 1, policy_version 1259892 (0.0009) [2023-12-26 09:43:20,123][123090] Updated weights for policy 1, policy_version 1259902 (0.0007) [2023-12-26 09:43:20,710][123091] Updated weights for policy 0, policy_version 1268853 (0.0008) [2023-12-26 09:43:20,781][123091] Updated weights for policy 0, policy_version 1268863 (0.0006) [2023-12-26 09:43:20,857][123091] Updated weights for policy 0, policy_version 1268873 (0.0010) [2023-12-26 09:43:20,916][123090] Updated weights for policy 1, policy_version 1259912 (0.0009) [2023-12-26 09:43:20,980][123090] Updated weights for policy 1, policy_version 1259922 (0.0010) [2023-12-26 09:43:21,053][123090] Updated weights for policy 1, policy_version 1259932 (0.0008) [2023-12-26 09:43:21,590][123091] Updated weights for policy 0, policy_version 1268883 (0.0010) [2023-12-26 09:43:21,669][123091] Updated weights for policy 0, policy_version 1268893 (0.0013) [2023-12-26 09:43:21,765][123091] Updated weights for policy 0, policy_version 1268903 (0.0009) [2023-12-26 09:43:21,869][123090] Updated weights for policy 1, policy_version 1259942 (0.0009) [2023-12-26 09:43:21,937][123090] Updated weights for policy 1, policy_version 1259952 (0.0009) [2023-12-26 09:43:22,005][123090] Updated weights for policy 1, policy_version 1259962 (0.0009) [2023-12-26 09:43:22,528][123091] Updated weights for policy 0, policy_version 1268913 (0.0008) [2023-12-26 09:43:22,595][123091] Updated weights for policy 0, policy_version 1268923 (0.0009) [2023-12-26 09:43:22,655][123091] Updated weights for policy 0, policy_version 1268933 (0.0010) [2023-12-26 09:43:22,717][123091] Updated weights for policy 0, policy_version 1268943 (0.0009) [2023-12-26 09:43:22,919][123090] Updated weights for policy 1, policy_version 1259972 (0.0010) [2023-12-26 09:43:22,990][123090] Updated weights for policy 1, policy_version 1259982 (0.0010) [2023-12-26 09:43:23,048][123090] Updated weights for policy 1, policy_version 1259992 (0.0010) [2023-12-26 09:43:23,468][123091] Updated weights for policy 0, policy_version 1268953 (0.0007) [2023-12-26 09:43:23,537][123091] Updated weights for policy 0, policy_version 1268963 (0.0006) [2023-12-26 09:43:23,601][123091] Updated weights for policy 0, policy_version 1268973 (0.0006) [2023-12-26 09:43:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 647421952. Throughput: 0: 8977.5, 1: 8779.9. Samples: 647400344. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:23,786][121949] Avg episode reward: [(0, '6278.310'), (1, '4971.330')] [2023-12-26 09:43:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001268976_324861952.pth... [2023-12-26 09:43:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001260000_322560000.pth... [2023-12-26 09:43:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001267920_324591616.pth [2023-12-26 09:43:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001259008_322306048.pth [2023-12-26 09:43:23,957][123090] Updated weights for policy 1, policy_version 1260002 (0.0010) [2023-12-26 09:43:24,019][123090] Updated weights for policy 1, policy_version 1260012 (0.0009) [2023-12-26 09:43:24,078][123090] Updated weights for policy 1, policy_version 1260022 (0.0009) [2023-12-26 09:43:24,130][123090] Updated weights for policy 1, policy_version 1260032 (0.0009) [2023-12-26 09:43:24,238][123091] Updated weights for policy 0, policy_version 1268983 (0.0008) [2023-12-26 09:43:24,300][123091] Updated weights for policy 0, policy_version 1268993 (0.0009) [2023-12-26 09:43:24,355][123091] Updated weights for policy 0, policy_version 1269003 (0.0006) [2023-12-26 09:43:25,012][123090] Updated weights for policy 1, policy_version 1260042 (0.0006) [2023-12-26 09:43:25,078][123090] Updated weights for policy 1, policy_version 1260052 (0.0006) [2023-12-26 09:43:25,150][123090] Updated weights for policy 1, policy_version 1260062 (0.0006) [2023-12-26 09:43:25,176][123091] Updated weights for policy 0, policy_version 1269013 (0.0008) [2023-12-26 09:43:25,223][123091] Updated weights for policy 0, policy_version 1269023 (0.0010) [2023-12-26 09:43:25,285][123091] Updated weights for policy 0, policy_version 1269033 (0.0010) [2023-12-26 09:43:25,770][123090] Updated weights for policy 1, policy_version 1260073 (0.0010) [2023-12-26 09:43:25,823][123090] Updated weights for policy 1, policy_version 1260083 (0.0010) [2023-12-26 09:43:25,878][123090] Updated weights for policy 1, policy_version 1260093 (0.0010) [2023-12-26 09:43:26,013][123091] Updated weights for policy 0, policy_version 1269043 (0.0009) [2023-12-26 09:43:26,075][123091] Updated weights for policy 0, policy_version 1269053 (0.0008) [2023-12-26 09:43:26,123][123091] Updated weights for policy 0, policy_version 1269063 (0.0010) [2023-12-26 09:43:26,714][123090] Updated weights for policy 1, policy_version 1260103 (0.0009) [2023-12-26 09:43:26,768][123090] Updated weights for policy 1, policy_version 1260113 (0.0009) [2023-12-26 09:43:26,827][123090] Updated weights for policy 1, policy_version 1260123 (0.0007) [2023-12-26 09:43:26,932][123091] Updated weights for policy 0, policy_version 1269073 (0.0010) [2023-12-26 09:43:26,979][123091] Updated weights for policy 0, policy_version 1269083 (0.0005) [2023-12-26 09:43:27,023][123091] Updated weights for policy 0, policy_version 1269093 (0.0005) [2023-12-26 09:43:27,078][123091] Updated weights for policy 0, policy_version 1269103 (0.0005) [2023-12-26 09:43:27,589][123090] Updated weights for policy 1, policy_version 1260133 (0.0005) [2023-12-26 09:43:27,648][123090] Updated weights for policy 1, policy_version 1260143 (0.0005) [2023-12-26 09:43:27,703][123091] Updated weights for policy 0, policy_version 1269113 (0.0007) [2023-12-26 09:43:27,708][123090] Updated weights for policy 1, policy_version 1260153 (0.0005) [2023-12-26 09:43:27,764][123091] Updated weights for policy 0, policy_version 1269123 (0.0008) [2023-12-26 09:43:27,830][123091] Updated weights for policy 0, policy_version 1269133 (0.0008) [2023-12-26 09:43:28,451][123090] Updated weights for policy 1, policy_version 1260163 (0.0006) [2023-12-26 09:43:28,469][123091] Updated weights for policy 0, policy_version 1269143 (0.0007) [2023-12-26 09:43:28,503][123090] Updated weights for policy 1, policy_version 1260173 (0.0009) [2023-12-26 09:43:28,531][123091] Updated weights for policy 0, policy_version 1269153 (0.0007) [2023-12-26 09:43:28,570][123090] Updated weights for policy 1, policy_version 1260183 (0.0007) [2023-12-26 09:43:28,599][123091] Updated weights for policy 0, policy_version 1269163 (0.0008) [2023-12-26 09:43:28,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 647520256. Throughput: 0: 9070.1, 1: 8801.8. Samples: 647508316. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:28,784][121949] Avg episode reward: [(0, '6282.598'), (1, '4933.083')] [2023-12-26 09:43:29,298][123091] Updated weights for policy 0, policy_version 1269173 (0.0007) [2023-12-26 09:43:29,347][123090] Updated weights for policy 1, policy_version 1260193 (0.0007) [2023-12-26 09:43:29,368][123091] Updated weights for policy 0, policy_version 1269183 (0.0007) [2023-12-26 09:43:29,416][123090] Updated weights for policy 1, policy_version 1260203 (0.0009) [2023-12-26 09:43:29,431][123091] Updated weights for policy 0, policy_version 1269193 (0.0007) [2023-12-26 09:43:29,485][123090] Updated weights for policy 1, policy_version 1260213 (0.0008) [2023-12-26 09:43:29,553][123090] Updated weights for policy 1, policy_version 1260223 (0.0006) [2023-12-26 09:43:30,214][123091] Updated weights for policy 0, policy_version 1269203 (0.0007) [2023-12-26 09:43:30,233][123090] Updated weights for policy 1, policy_version 1260233 (0.0006) [2023-12-26 09:43:30,269][123091] Updated weights for policy 0, policy_version 1269213 (0.0010) [2023-12-26 09:43:30,282][123090] Updated weights for policy 1, policy_version 1260243 (0.0009) [2023-12-26 09:43:30,317][123091] Updated weights for policy 0, policy_version 1269223 (0.0010) [2023-12-26 09:43:30,328][123090] Updated weights for policy 1, policy_version 1260253 (0.0009) [2023-12-26 09:43:31,114][123091] Updated weights for policy 0, policy_version 1269233 (0.0011) [2023-12-26 09:43:31,178][123091] Updated weights for policy 0, policy_version 1269243 (0.0009) [2023-12-26 09:43:31,185][123090] Updated weights for policy 1, policy_version 1260263 (0.0010) [2023-12-26 09:43:31,234][123091] Updated weights for policy 0, policy_version 1269253 (0.0010) [2023-12-26 09:43:31,237][123090] Updated weights for policy 1, policy_version 1260273 (0.0010) [2023-12-26 09:43:31,293][123091] Updated weights for policy 0, policy_version 1269263 (0.0011) [2023-12-26 09:43:31,305][123090] Updated weights for policy 1, policy_version 1260283 (0.0008) [2023-12-26 09:43:32,091][123091] Updated weights for policy 0, policy_version 1269273 (0.0010) [2023-12-26 09:43:32,139][123091] Updated weights for policy 0, policy_version 1269283 (0.0009) [2023-12-26 09:43:32,189][123091] Updated weights for policy 0, policy_version 1269293 (0.0010) [2023-12-26 09:43:32,201][123090] Updated weights for policy 1, policy_version 1260293 (0.0008) [2023-12-26 09:43:32,288][123090] Updated weights for policy 1, policy_version 1260303 (0.0009) [2023-12-26 09:43:32,361][123090] Updated weights for policy 1, policy_version 1260313 (0.0009) [2023-12-26 09:43:33,044][123091] Updated weights for policy 0, policy_version 1269303 (0.0009) [2023-12-26 09:43:33,086][123091] Updated weights for policy 0, policy_version 1269313 (0.0006) [2023-12-26 09:43:33,142][123090] Updated weights for policy 1, policy_version 1260323 (0.0009) [2023-12-26 09:43:33,152][123091] Updated weights for policy 0, policy_version 1269323 (0.0006) [2023-12-26 09:43:33,204][123090] Updated weights for policy 1, policy_version 1260333 (0.0008) [2023-12-26 09:43:33,278][123090] Updated weights for policy 1, policy_version 1260343 (0.0010) [2023-12-26 09:43:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 647602176. Throughput: 0: 9108.4, 1: 8682.3. Samples: 647615584. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:33,784][121949] Avg episode reward: [(0, '6352.799'), (1, '5134.580')] [2023-12-26 09:43:33,809][123091] Updated weights for policy 0, policy_version 1269333 (0.0008) [2023-12-26 09:43:33,861][123091] Updated weights for policy 0, policy_version 1269344 (0.0010) [2023-12-26 09:43:33,918][123091] Updated weights for policy 0, policy_version 1269354 (0.0009) [2023-12-26 09:43:34,106][123090] Updated weights for policy 1, policy_version 1260353 (0.0010) [2023-12-26 09:43:34,175][123090] Updated weights for policy 1, policy_version 1260363 (0.0010) [2023-12-26 09:43:34,240][123090] Updated weights for policy 1, policy_version 1260373 (0.0010) [2023-12-26 09:43:34,300][123090] Updated weights for policy 1, policy_version 1260383 (0.0010) [2023-12-26 09:43:34,720][123091] Updated weights for policy 0, policy_version 1269364 (0.0007) [2023-12-26 09:43:34,787][123091] Updated weights for policy 0, policy_version 1269374 (0.0006) [2023-12-26 09:43:34,854][123091] Updated weights for policy 0, policy_version 1269384 (0.0006) [2023-12-26 09:43:35,207][123090] Updated weights for policy 1, policy_version 1260393 (0.0009) [2023-12-26 09:43:35,267][123090] Updated weights for policy 1, policy_version 1260403 (0.0009) [2023-12-26 09:43:35,327][123090] Updated weights for policy 1, policy_version 1260413 (0.0009) [2023-12-26 09:43:35,575][123091] Updated weights for policy 0, policy_version 1269394 (0.0006) [2023-12-26 09:43:35,634][123091] Updated weights for policy 0, policy_version 1269404 (0.0005) [2023-12-26 09:43:35,700][123091] Updated weights for policy 0, policy_version 1269414 (0.0009) [2023-12-26 09:43:35,756][123091] Updated weights for policy 0, policy_version 1269424 (0.0009) [2023-12-26 09:43:36,157][123090] Updated weights for policy 1, policy_version 1260423 (0.0008) [2023-12-26 09:43:36,224][123090] Updated weights for policy 1, policy_version 1260433 (0.0008) [2023-12-26 09:43:36,289][123090] Updated weights for policy 1, policy_version 1260443 (0.0010) [2023-12-26 09:43:36,534][123091] Updated weights for policy 0, policy_version 1269434 (0.0005) [2023-12-26 09:43:36,610][123091] Updated weights for policy 0, policy_version 1269444 (0.0007) [2023-12-26 09:43:36,680][123091] Updated weights for policy 0, policy_version 1269454 (0.0009) [2023-12-26 09:43:37,121][123090] Updated weights for policy 1, policy_version 1260453 (0.0008) [2023-12-26 09:43:37,185][123090] Updated weights for policy 1, policy_version 1260463 (0.0005) [2023-12-26 09:43:37,256][123090] Updated weights for policy 1, policy_version 1260473 (0.0005) [2023-12-26 09:43:37,462][123091] Updated weights for policy 0, policy_version 1269464 (0.0009) [2023-12-26 09:43:37,523][123091] Updated weights for policy 0, policy_version 1269474 (0.0009) [2023-12-26 09:43:37,588][123091] Updated weights for policy 0, policy_version 1269484 (0.0009) [2023-12-26 09:43:38,003][123090] Updated weights for policy 1, policy_version 1260483 (0.0007) [2023-12-26 09:43:38,062][123090] Updated weights for policy 1, policy_version 1260493 (0.0009) [2023-12-26 09:43:38,115][123090] Updated weights for policy 1, policy_version 1260503 (0.0009) [2023-12-26 09:43:38,413][123091] Updated weights for policy 0, policy_version 1269494 (0.0009) [2023-12-26 09:43:38,474][123091] Updated weights for policy 0, policy_version 1269504 (0.0008) [2023-12-26 09:43:38,537][123091] Updated weights for policy 0, policy_version 1269514 (0.0010) [2023-12-26 09:43:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 647692288. Throughput: 0: 9149.7, 1: 8634.9. Samples: 647668932. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:38,785][121949] Avg episode reward: [(0, '6305.658'), (1, '5261.514')] [2023-12-26 09:43:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001269520_325001216.pth... [2023-12-26 09:43:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001260512_322691072.pth... [2023-12-26 09:43:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001259520_322437120.pth [2023-12-26 09:43:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001268432_324722688.pth [2023-12-26 09:43:38,931][123090] Updated weights for policy 1, policy_version 1260513 (0.0009) [2023-12-26 09:43:38,995][123090] Updated weights for policy 1, policy_version 1260523 (0.0008) [2023-12-26 09:43:39,051][123090] Updated weights for policy 1, policy_version 1260533 (0.0010) [2023-12-26 09:43:39,115][123090] Updated weights for policy 1, policy_version 1260543 (0.0007) [2023-12-26 09:43:39,435][123091] Updated weights for policy 0, policy_version 1269524 (0.0009) [2023-12-26 09:43:39,496][123091] Updated weights for policy 0, policy_version 1269534 (0.0009) [2023-12-26 09:43:39,556][123091] Updated weights for policy 0, policy_version 1269544 (0.0009) [2023-12-26 09:43:39,905][123090] Updated weights for policy 1, policy_version 1260553 (0.0009) [2023-12-26 09:43:39,979][123090] Updated weights for policy 1, policy_version 1260563 (0.0008) [2023-12-26 09:43:40,044][123090] Updated weights for policy 1, policy_version 1260573 (0.0006) [2023-12-26 09:43:40,439][123091] Updated weights for policy 0, policy_version 1269554 (0.0009) [2023-12-26 09:43:40,496][123091] Updated weights for policy 0, policy_version 1269564 (0.0009) [2023-12-26 09:43:40,555][123091] Updated weights for policy 0, policy_version 1269574 (0.0010) [2023-12-26 09:43:40,617][123091] Updated weights for policy 0, policy_version 1269584 (0.0010) [2023-12-26 09:43:40,761][123090] Updated weights for policy 1, policy_version 1260583 (0.0009) [2023-12-26 09:43:40,822][123090] Updated weights for policy 1, policy_version 1260593 (0.0010) [2023-12-26 09:43:40,887][123090] Updated weights for policy 1, policy_version 1260603 (0.0009) [2023-12-26 09:43:41,509][123091] Updated weights for policy 0, policy_version 1269594 (0.0008) [2023-12-26 09:43:41,571][123091] Updated weights for policy 0, policy_version 1269604 (0.0009) [2023-12-26 09:43:41,635][123091] Updated weights for policy 0, policy_version 1269614 (0.0008) [2023-12-26 09:43:41,750][123090] Updated weights for policy 1, policy_version 1260613 (0.0010) [2023-12-26 09:43:41,819][123090] Updated weights for policy 1, policy_version 1260623 (0.0010) [2023-12-26 09:43:41,892][123090] Updated weights for policy 1, policy_version 1260633 (0.0010) [2023-12-26 09:43:42,456][123091] Updated weights for policy 0, policy_version 1269624 (0.0010) [2023-12-26 09:43:42,522][123091] Updated weights for policy 0, policy_version 1269634 (0.0005) [2023-12-26 09:43:42,591][123091] Updated weights for policy 0, policy_version 1269644 (0.0009) [2023-12-26 09:43:42,770][123090] Updated weights for policy 1, policy_version 1260643 (0.0009) [2023-12-26 09:43:42,833][123090] Updated weights for policy 1, policy_version 1260653 (0.0009) [2023-12-26 09:43:42,889][123090] Updated weights for policy 1, policy_version 1260664 (0.0010) [2023-12-26 09:43:43,351][123091] Updated weights for policy 0, policy_version 1269654 (0.0009) [2023-12-26 09:43:43,409][123091] Updated weights for policy 0, policy_version 1269664 (0.0009) [2023-12-26 09:43:43,478][123091] Updated weights for policy 0, policy_version 1269674 (0.0010) [2023-12-26 09:43:43,756][123090] Updated weights for policy 1, policy_version 1260674 (0.0010) [2023-12-26 09:43:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 647774208. Throughput: 0: 9077.9, 1: 8669.4. Samples: 647770824. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:43,784][121949] Avg episode reward: [(0, '6225.646'), (1, '5336.938')] [2023-12-26 09:43:43,812][123090] Updated weights for policy 1, policy_version 1260684 (0.0008) [2023-12-26 09:43:43,870][123090] Updated weights for policy 1, policy_version 1260694 (0.0009) [2023-12-26 09:43:43,929][123090] Updated weights for policy 1, policy_version 1260704 (0.0009) [2023-12-26 09:43:44,204][123091] Updated weights for policy 0, policy_version 1269684 (0.0008) [2023-12-26 09:43:44,265][123091] Updated weights for policy 0, policy_version 1269695 (0.0007) [2023-12-26 09:43:44,317][123091] Updated weights for policy 0, policy_version 1269705 (0.0009) [2023-12-26 09:43:44,792][123090] Updated weights for policy 1, policy_version 1260714 (0.0010) [2023-12-26 09:43:44,844][123090] Updated weights for policy 1, policy_version 1260724 (0.0009) [2023-12-26 09:43:44,905][123090] Updated weights for policy 1, policy_version 1260734 (0.0010) [2023-12-26 09:43:45,132][123091] Updated weights for policy 0, policy_version 1269715 (0.0010) [2023-12-26 09:43:45,196][123091] Updated weights for policy 0, policy_version 1269725 (0.0009) [2023-12-26 09:43:45,253][123091] Updated weights for policy 0, policy_version 1269735 (0.0010) [2023-12-26 09:43:45,786][123090] Updated weights for policy 1, policy_version 1260744 (0.0009) [2023-12-26 09:43:45,846][123090] Updated weights for policy 1, policy_version 1260754 (0.0009) [2023-12-26 09:43:45,904][123090] Updated weights for policy 1, policy_version 1260764 (0.0009) [2023-12-26 09:43:45,921][123091] Updated weights for policy 0, policy_version 1269745 (0.0006) [2023-12-26 09:43:45,979][123091] Updated weights for policy 0, policy_version 1269755 (0.0005) [2023-12-26 09:43:46,040][123091] Updated weights for policy 0, policy_version 1269765 (0.0008) [2023-12-26 09:43:46,084][123091] Updated weights for policy 0, policy_version 1269775 (0.0010) [2023-12-26 09:43:46,744][123090] Updated weights for policy 1, policy_version 1260774 (0.0009) [2023-12-26 09:43:46,796][123090] Updated weights for policy 1, policy_version 1260784 (0.0009) [2023-12-26 09:43:46,856][123090] Updated weights for policy 1, policy_version 1260794 (0.0009) [2023-12-26 09:43:46,890][123091] Updated weights for policy 0, policy_version 1269785 (0.0010) [2023-12-26 09:43:46,945][123091] Updated weights for policy 0, policy_version 1269795 (0.0010) [2023-12-26 09:43:46,996][123091] Updated weights for policy 0, policy_version 1269805 (0.0010) [2023-12-26 09:43:47,672][123090] Updated weights for policy 1, policy_version 1260804 (0.0009) [2023-12-26 09:43:47,742][123090] Updated weights for policy 1, policy_version 1260814 (0.0010) [2023-12-26 09:43:47,779][123091] Updated weights for policy 0, policy_version 1269815 (0.0007) [2023-12-26 09:43:47,804][123090] Updated weights for policy 1, policy_version 1260824 (0.0009) [2023-12-26 09:43:47,845][123091] Updated weights for policy 0, policy_version 1269825 (0.0005) [2023-12-26 09:43:47,902][123091] Updated weights for policy 0, policy_version 1269835 (0.0005) [2023-12-26 09:43:48,588][123091] Updated weights for policy 0, policy_version 1269845 (0.0007) [2023-12-26 09:43:48,648][123091] Updated weights for policy 0, policy_version 1269855 (0.0007) [2023-12-26 09:43:48,684][123090] Updated weights for policy 1, policy_version 1260834 (0.0009) [2023-12-26 09:43:48,707][123091] Updated weights for policy 0, policy_version 1269865 (0.0007) [2023-12-26 09:43:48,752][123090] Updated weights for policy 1, policy_version 1260844 (0.0008) [2023-12-26 09:43:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 647864320. Throughput: 0: 9199.5, 1: 8521.0. Samples: 647876360. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:48,785][121949] Avg episode reward: [(0, '6196.996'), (1, '5097.093')] [2023-12-26 09:43:48,818][123090] Updated weights for policy 1, policy_version 1260854 (0.0010) [2023-12-26 09:43:48,877][123090] Updated weights for policy 1, policy_version 1260864 (0.0010) [2023-12-26 09:43:49,452][123091] Updated weights for policy 0, policy_version 1269875 (0.0007) [2023-12-26 09:43:49,500][123091] Updated weights for policy 0, policy_version 1269885 (0.0009) [2023-12-26 09:43:49,553][123091] Updated weights for policy 0, policy_version 1269896 (0.0009) [2023-12-26 09:43:49,759][123090] Updated weights for policy 1, policy_version 1260874 (0.0005) [2023-12-26 09:43:49,837][123090] Updated weights for policy 1, policy_version 1260884 (0.0007) [2023-12-26 09:43:49,906][123090] Updated weights for policy 1, policy_version 1260894 (0.0008) [2023-12-26 09:43:50,367][123091] Updated weights for policy 0, policy_version 1269906 (0.0008) [2023-12-26 09:43:50,435][123091] Updated weights for policy 0, policy_version 1269916 (0.0006) [2023-12-26 09:43:50,494][123091] Updated weights for policy 0, policy_version 1269926 (0.0006) [2023-12-26 09:43:50,545][123091] Updated weights for policy 0, policy_version 1269936 (0.0005) [2023-12-26 09:43:50,614][123090] Updated weights for policy 1, policy_version 1260904 (0.0008) [2023-12-26 09:43:50,680][123090] Updated weights for policy 1, policy_version 1260914 (0.0005) [2023-12-26 09:43:50,748][123090] Updated weights for policy 1, policy_version 1260924 (0.0007) [2023-12-26 09:43:51,259][123091] Updated weights for policy 0, policy_version 1269946 (0.0009) [2023-12-26 09:43:51,315][123091] Updated weights for policy 0, policy_version 1269956 (0.0010) [2023-12-26 09:43:51,386][123091] Updated weights for policy 0, policy_version 1269966 (0.0010) [2023-12-26 09:43:51,493][123090] Updated weights for policy 1, policy_version 1260934 (0.0009) [2023-12-26 09:43:51,558][123090] Updated weights for policy 1, policy_version 1260944 (0.0007) [2023-12-26 09:43:51,632][123090] Updated weights for policy 1, policy_version 1260954 (0.0008) [2023-12-26 09:43:52,265][123091] Updated weights for policy 0, policy_version 1269976 (0.0008) [2023-12-26 09:43:52,328][123091] Updated weights for policy 0, policy_version 1269986 (0.0010) [2023-12-26 09:43:52,397][123091] Updated weights for policy 0, policy_version 1269996 (0.0009) [2023-12-26 09:43:52,429][123090] Updated weights for policy 1, policy_version 1260964 (0.0009) [2023-12-26 09:43:52,495][123090] Updated weights for policy 1, policy_version 1260974 (0.0008) [2023-12-26 09:43:52,555][123090] Updated weights for policy 1, policy_version 1260984 (0.0008) [2023-12-26 09:43:53,260][123091] Updated weights for policy 0, policy_version 1270006 (0.0006) [2023-12-26 09:43:53,294][123090] Updated weights for policy 1, policy_version 1260994 (0.0007) [2023-12-26 09:43:53,308][123091] Updated weights for policy 0, policy_version 1270016 (0.0005) [2023-12-26 09:43:53,354][123090] Updated weights for policy 1, policy_version 1261004 (0.0005) [2023-12-26 09:43:53,362][123091] Updated weights for policy 0, policy_version 1270026 (0.0006) [2023-12-26 09:43:53,405][123090] Updated weights for policy 1, policy_version 1261014 (0.0009) [2023-12-26 09:43:53,456][123090] Updated weights for policy 1, policy_version 1261024 (0.0009) [2023-12-26 09:43:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 647954432. Throughput: 0: 9139.2, 1: 8568.9. Samples: 647930212. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:53,785][121949] Avg episode reward: [(0, '6251.416'), (1, '5183.419')] [2023-12-26 09:43:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001261024_322822144.pth... [2023-12-26 09:43:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001270032_325132288.pth... [2023-12-26 09:43:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001260000_322560000.pth [2023-12-26 09:43:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001268976_324861952.pth [2023-12-26 09:43:54,148][123091] Updated weights for policy 0, policy_version 1270036 (0.0007) [2023-12-26 09:43:54,201][123091] Updated weights for policy 0, policy_version 1270046 (0.0010) [2023-12-26 09:43:54,251][123091] Updated weights for policy 0, policy_version 1270056 (0.0009) [2023-12-26 09:43:54,286][123090] Updated weights for policy 1, policy_version 1261034 (0.0010) [2023-12-26 09:43:54,346][123090] Updated weights for policy 1, policy_version 1261044 (0.0011) [2023-12-26 09:43:54,417][123090] Updated weights for policy 1, policy_version 1261054 (0.0009) [2023-12-26 09:43:55,133][123091] Updated weights for policy 0, policy_version 1270066 (0.0008) [2023-12-26 09:43:55,156][123090] Updated weights for policy 1, policy_version 1261064 (0.0008) [2023-12-26 09:43:55,198][123091] Updated weights for policy 0, policy_version 1270076 (0.0009) [2023-12-26 09:43:55,218][123090] Updated weights for policy 1, policy_version 1261074 (0.0006) [2023-12-26 09:43:55,264][123091] Updated weights for policy 0, policy_version 1270086 (0.0009) [2023-12-26 09:43:55,271][123090] Updated weights for policy 1, policy_version 1261084 (0.0008) [2023-12-26 09:43:55,323][123091] Updated weights for policy 0, policy_version 1270096 (0.0008) [2023-12-26 09:43:56,006][123090] Updated weights for policy 1, policy_version 1261094 (0.0007) [2023-12-26 09:43:56,056][123090] Updated weights for policy 1, policy_version 1261104 (0.0005) [2023-12-26 09:43:56,106][123090] Updated weights for policy 1, policy_version 1261114 (0.0005) [2023-12-26 09:43:56,198][123091] Updated weights for policy 0, policy_version 1270106 (0.0010) [2023-12-26 09:43:56,264][123091] Updated weights for policy 0, policy_version 1270116 (0.0010) [2023-12-26 09:43:56,332][123091] Updated weights for policy 0, policy_version 1270126 (0.0010) [2023-12-26 09:43:56,754][123090] Updated weights for policy 1, policy_version 1261124 (0.0005) [2023-12-26 09:43:56,803][123090] Updated weights for policy 1, policy_version 1261134 (0.0005) [2023-12-26 09:43:56,867][123090] Updated weights for policy 1, policy_version 1261144 (0.0005) [2023-12-26 09:43:57,265][123091] Updated weights for policy 0, policy_version 1270136 (0.0010) [2023-12-26 09:43:57,336][123091] Updated weights for policy 0, policy_version 1270146 (0.0009) [2023-12-26 09:43:57,403][123091] Updated weights for policy 0, policy_version 1270156 (0.0008) [2023-12-26 09:43:57,554][123090] Updated weights for policy 1, policy_version 1261154 (0.0006) [2023-12-26 09:43:57,622][123090] Updated weights for policy 1, policy_version 1261164 (0.0010) [2023-12-26 09:43:57,680][123090] Updated weights for policy 1, policy_version 1261174 (0.0010) [2023-12-26 09:43:57,737][123090] Updated weights for policy 1, policy_version 1261184 (0.0010) [2023-12-26 09:43:58,234][123091] Updated weights for policy 0, policy_version 1270166 (0.0009) [2023-12-26 09:43:58,305][123091] Updated weights for policy 0, policy_version 1270176 (0.0010) [2023-12-26 09:43:58,381][123091] Updated weights for policy 0, policy_version 1270186 (0.0009) [2023-12-26 09:43:58,524][123090] Updated weights for policy 1, policy_version 1261194 (0.0010) [2023-12-26 09:43:58,591][123090] Updated weights for policy 1, policy_version 1261204 (0.0010) [2023-12-26 09:43:58,655][123090] Updated weights for policy 1, policy_version 1261214 (0.0010) [2023-12-26 09:43:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 648044544. Throughput: 0: 9021.8, 1: 8735.7. Samples: 648036384. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:43:58,785][121949] Avg episode reward: [(0, '6204.506'), (1, '5041.622')] [2023-12-26 09:43:59,247][123091] Updated weights for policy 0, policy_version 1270196 (0.0009) [2023-12-26 09:43:59,308][123091] Updated weights for policy 0, policy_version 1270206 (0.0008) [2023-12-26 09:43:59,382][123091] Updated weights for policy 0, policy_version 1270216 (0.0008) [2023-12-26 09:43:59,517][123090] Updated weights for policy 1, policy_version 1261224 (0.0009) [2023-12-26 09:43:59,572][123090] Updated weights for policy 1, policy_version 1261234 (0.0010) [2023-12-26 09:43:59,635][123090] Updated weights for policy 1, policy_version 1261244 (0.0010) [2023-12-26 09:44:00,194][123091] Updated weights for policy 0, policy_version 1270226 (0.0006) [2023-12-26 09:44:00,258][123091] Updated weights for policy 0, policy_version 1270236 (0.0008) [2023-12-26 09:44:00,321][123091] Updated weights for policy 0, policy_version 1270246 (0.0007) [2023-12-26 09:44:00,372][123091] Updated weights for policy 0, policy_version 1270256 (0.0006) [2023-12-26 09:44:00,468][123090] Updated weights for policy 1, policy_version 1261254 (0.0007) [2023-12-26 09:44:00,530][123090] Updated weights for policy 1, policy_version 1261264 (0.0006) [2023-12-26 09:44:00,589][123090] Updated weights for policy 1, policy_version 1261274 (0.0005) [2023-12-26 09:44:01,019][123091] Updated weights for policy 0, policy_version 1270266 (0.0005) [2023-12-26 09:44:01,082][123091] Updated weights for policy 0, policy_version 1270276 (0.0008) [2023-12-26 09:44:01,143][123091] Updated weights for policy 0, policy_version 1270286 (0.0009) [2023-12-26 09:44:01,276][123090] Updated weights for policy 1, policy_version 1261284 (0.0007) [2023-12-26 09:44:01,329][123090] Updated weights for policy 1, policy_version 1261294 (0.0009) [2023-12-26 09:44:01,398][123090] Updated weights for policy 1, policy_version 1261304 (0.0009) [2023-12-26 09:44:02,002][123091] Updated weights for policy 0, policy_version 1270296 (0.0007) [2023-12-26 09:44:02,067][123091] Updated weights for policy 0, policy_version 1270306 (0.0008) [2023-12-26 09:44:02,130][123091] Updated weights for policy 0, policy_version 1270316 (0.0011) [2023-12-26 09:44:02,182][123090] Updated weights for policy 1, policy_version 1261314 (0.0009) [2023-12-26 09:44:02,244][123090] Updated weights for policy 1, policy_version 1261324 (0.0008) [2023-12-26 09:44:02,305][123090] Updated weights for policy 1, policy_version 1261334 (0.0006) [2023-12-26 09:44:02,374][123090] Updated weights for policy 1, policy_version 1261344 (0.0007) [2023-12-26 09:44:02,939][123091] Updated weights for policy 0, policy_version 1270326 (0.0010) [2023-12-26 09:44:03,003][123091] Updated weights for policy 0, policy_version 1270336 (0.0010) [2023-12-26 09:44:03,072][123091] Updated weights for policy 0, policy_version 1270346 (0.0010) [2023-12-26 09:44:03,174][123090] Updated weights for policy 1, policy_version 1261354 (0.0008) [2023-12-26 09:44:03,233][123090] Updated weights for policy 1, policy_version 1261364 (0.0008) [2023-12-26 09:44:03,287][123090] Updated weights for policy 1, policy_version 1261374 (0.0005) [2023-12-26 09:44:03,714][123091] Updated weights for policy 0, policy_version 1270356 (0.0008) [2023-12-26 09:44:03,772][123091] Updated weights for policy 0, policy_version 1270366 (0.0005) [2023-12-26 09:44:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 648126464. Throughput: 0: 8918.7, 1: 8748.3. Samples: 648142552. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:03,785][121949] Avg episode reward: [(0, '6272.823'), (1, '4865.396')] [2023-12-26 09:44:03,837][123090] Updated weights for policy 1, policy_version 1261384 (0.0006) [2023-12-26 09:44:03,846][123091] Updated weights for policy 0, policy_version 1270376 (0.0006) [2023-12-26 09:44:03,902][123090] Updated weights for policy 1, policy_version 1261394 (0.0007) [2023-12-26 09:44:03,960][123090] Updated weights for policy 1, policy_version 1261404 (0.0006) [2023-12-26 09:44:04,593][123091] Updated weights for policy 0, policy_version 1270386 (0.0009) [2023-12-26 09:44:04,654][123091] Updated weights for policy 0, policy_version 1270396 (0.0009) [2023-12-26 09:44:04,702][123090] Updated weights for policy 1, policy_version 1261414 (0.0008) [2023-12-26 09:44:04,717][123091] Updated weights for policy 0, policy_version 1270406 (0.0007) [2023-12-26 09:44:04,764][123090] Updated weights for policy 1, policy_version 1261424 (0.0008) [2023-12-26 09:44:04,776][123091] Updated weights for policy 0, policy_version 1270416 (0.0008) [2023-12-26 09:44:04,829][123090] Updated weights for policy 1, policy_version 1261434 (0.0010) [2023-12-26 09:44:05,515][123091] Updated weights for policy 0, policy_version 1270426 (0.0005) [2023-12-26 09:44:05,562][123091] Updated weights for policy 0, policy_version 1270436 (0.0005) [2023-12-26 09:44:05,614][123091] Updated weights for policy 0, policy_version 1270446 (0.0007) [2023-12-26 09:44:05,659][123090] Updated weights for policy 1, policy_version 1261444 (0.0010) [2023-12-26 09:44:05,708][123090] Updated weights for policy 1, policy_version 1261454 (0.0009) [2023-12-26 09:44:05,764][123090] Updated weights for policy 1, policy_version 1261464 (0.0008) [2023-12-26 09:44:06,413][123091] Updated weights for policy 0, policy_version 1270456 (0.0011) [2023-12-26 09:44:06,484][123091] Updated weights for policy 0, policy_version 1270466 (0.0011) [2023-12-26 09:44:06,555][123091] Updated weights for policy 0, policy_version 1270476 (0.0011) [2023-12-26 09:44:06,633][123090] Updated weights for policy 1, policy_version 1261474 (0.0009) [2023-12-26 09:44:06,698][123090] Updated weights for policy 1, policy_version 1261484 (0.0009) [2023-12-26 09:44:06,759][123090] Updated weights for policy 1, policy_version 1261494 (0.0008) [2023-12-26 09:44:06,820][123090] Updated weights for policy 1, policy_version 1261504 (0.0009) [2023-12-26 09:44:07,367][123091] Updated weights for policy 0, policy_version 1270486 (0.0010) [2023-12-26 09:44:07,420][123091] Updated weights for policy 0, policy_version 1270496 (0.0009) [2023-12-26 09:44:07,469][123091] Updated weights for policy 0, policy_version 1270506 (0.0009) [2023-12-26 09:44:07,637][123090] Updated weights for policy 1, policy_version 1261514 (0.0009) [2023-12-26 09:44:07,690][123090] Updated weights for policy 1, policy_version 1261524 (0.0009) [2023-12-26 09:44:07,740][123090] Updated weights for policy 1, policy_version 1261534 (0.0010) [2023-12-26 09:44:08,306][123091] Updated weights for policy 0, policy_version 1270516 (0.0010) [2023-12-26 09:44:08,374][123091] Updated weights for policy 0, policy_version 1270526 (0.0009) [2023-12-26 09:44:08,443][123091] Updated weights for policy 0, policy_version 1270536 (0.0009) [2023-12-26 09:44:08,599][123090] Updated weights for policy 1, policy_version 1261544 (0.0009) [2023-12-26 09:44:08,660][123090] Updated weights for policy 1, policy_version 1261554 (0.0009) [2023-12-26 09:44:08,710][123090] Updated weights for policy 1, policy_version 1261564 (0.0009) [2023-12-26 09:44:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 648224768. Throughput: 0: 8939.6, 1: 8761.7. Samples: 648196900. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:08,785][121949] Avg episode reward: [(0, '6315.270'), (1, '5182.012')] [2023-12-26 09:44:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001270544_325263360.pth... [2023-12-26 09:44:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001261568_322961408.pth... [2023-12-26 09:44:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001269520_325001216.pth [2023-12-26 09:44:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001260512_322691072.pth [2023-12-26 09:44:09,207][123091] Updated weights for policy 0, policy_version 1270546 (0.0009) [2023-12-26 09:44:09,275][123091] Updated weights for policy 0, policy_version 1270556 (0.0009) [2023-12-26 09:44:09,344][123091] Updated weights for policy 0, policy_version 1270566 (0.0009) [2023-12-26 09:44:09,406][123091] Updated weights for policy 0, policy_version 1270576 (0.0009) [2023-12-26 09:44:09,618][123090] Updated weights for policy 1, policy_version 1261574 (0.0010) [2023-12-26 09:44:09,677][123090] Updated weights for policy 1, policy_version 1261584 (0.0009) [2023-12-26 09:44:09,732][123090] Updated weights for policy 1, policy_version 1261594 (0.0009) [2023-12-26 09:44:10,289][123091] Updated weights for policy 0, policy_version 1270586 (0.0010) [2023-12-26 09:44:10,351][123091] Updated weights for policy 0, policy_version 1270596 (0.0010) [2023-12-26 09:44:10,423][123091] Updated weights for policy 0, policy_version 1270606 (0.0007) [2023-12-26 09:44:10,579][123090] Updated weights for policy 1, policy_version 1261604 (0.0010) [2023-12-26 09:44:10,641][123090] Updated weights for policy 1, policy_version 1261614 (0.0010) [2023-12-26 09:44:10,699][123090] Updated weights for policy 1, policy_version 1261624 (0.0009) [2023-12-26 09:44:11,283][123091] Updated weights for policy 0, policy_version 1270616 (0.0008) [2023-12-26 09:44:11,356][123091] Updated weights for policy 0, policy_version 1270626 (0.0008) [2023-12-26 09:44:11,423][123091] Updated weights for policy 0, policy_version 1270636 (0.0006) [2023-12-26 09:44:11,618][123090] Updated weights for policy 1, policy_version 1261634 (0.0008) [2023-12-26 09:44:11,694][123090] Updated weights for policy 1, policy_version 1261644 (0.0007) [2023-12-26 09:44:11,765][123090] Updated weights for policy 1, policy_version 1261654 (0.0008) [2023-12-26 09:44:11,832][123090] Updated weights for policy 1, policy_version 1261664 (0.0006) [2023-12-26 09:44:12,186][123091] Updated weights for policy 0, policy_version 1270646 (0.0009) [2023-12-26 09:44:12,249][123091] Updated weights for policy 0, policy_version 1270656 (0.0010) [2023-12-26 09:44:12,310][123091] Updated weights for policy 0, policy_version 1270666 (0.0008) [2023-12-26 09:44:12,548][123090] Updated weights for policy 1, policy_version 1261674 (0.0010) [2023-12-26 09:44:12,607][123090] Updated weights for policy 1, policy_version 1261684 (0.0010) [2023-12-26 09:44:12,670][123090] Updated weights for policy 1, policy_version 1261694 (0.0010) [2023-12-26 09:44:13,155][123091] Updated weights for policy 0, policy_version 1270676 (0.0010) [2023-12-26 09:44:13,206][123091] Updated weights for policy 0, policy_version 1270686 (0.0010) [2023-12-26 09:44:13,261][123091] Updated weights for policy 0, policy_version 1270696 (0.0010) [2023-12-26 09:44:13,482][123090] Updated weights for policy 1, policy_version 1261704 (0.0010) [2023-12-26 09:44:13,549][123090] Updated weights for policy 1, policy_version 1261714 (0.0009) [2023-12-26 09:44:13,621][123090] Updated weights for policy 1, policy_version 1261724 (0.0009) [2023-12-26 09:44:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 648306688. Throughput: 0: 8823.9, 1: 8728.0. Samples: 648298152. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:13,785][121949] Avg episode reward: [(0, '6265.815'), (1, '5076.907')] [2023-12-26 09:44:14,108][123091] Updated weights for policy 0, policy_version 1270706 (0.0009) [2023-12-26 09:44:14,178][123091] Updated weights for policy 0, policy_version 1270716 (0.0011) [2023-12-26 09:44:14,237][123091] Updated weights for policy 0, policy_version 1270726 (0.0010) [2023-12-26 09:44:14,296][123091] Updated weights for policy 0, policy_version 1270736 (0.0011) [2023-12-26 09:44:14,432][123090] Updated weights for policy 1, policy_version 1261734 (0.0009) [2023-12-26 09:44:14,481][123090] Updated weights for policy 1, policy_version 1261744 (0.0009) [2023-12-26 09:44:14,529][123090] Updated weights for policy 1, policy_version 1261754 (0.0008) [2023-12-26 09:44:15,084][123091] Updated weights for policy 0, policy_version 1270746 (0.0010) [2023-12-26 09:44:15,150][123091] Updated weights for policy 0, policy_version 1270756 (0.0010) [2023-12-26 09:44:15,207][123091] Updated weights for policy 0, policy_version 1270766 (0.0009) [2023-12-26 09:44:15,440][123090] Updated weights for policy 1, policy_version 1261764 (0.0010) [2023-12-26 09:44:15,504][123090] Updated weights for policy 1, policy_version 1261774 (0.0009) [2023-12-26 09:44:15,564][123090] Updated weights for policy 1, policy_version 1261784 (0.0009) [2023-12-26 09:44:15,985][123091] Updated weights for policy 0, policy_version 1270776 (0.0006) [2023-12-26 09:44:16,038][123091] Updated weights for policy 0, policy_version 1270786 (0.0005) [2023-12-26 09:44:16,097][123091] Updated weights for policy 0, policy_version 1270796 (0.0006) [2023-12-26 09:44:16,389][123090] Updated weights for policy 1, policy_version 1261794 (0.0010) [2023-12-26 09:44:16,443][123090] Updated weights for policy 1, policy_version 1261805 (0.0011) [2023-12-26 09:44:16,498][123090] Updated weights for policy 1, policy_version 1261816 (0.0010) [2023-12-26 09:44:16,742][123091] Updated weights for policy 0, policy_version 1270806 (0.0007) [2023-12-26 09:44:16,802][123091] Updated weights for policy 0, policy_version 1270816 (0.0005) [2023-12-26 09:44:16,868][123091] Updated weights for policy 0, policy_version 1270826 (0.0009) [2023-12-26 09:44:17,407][123090] Updated weights for policy 1, policy_version 1261826 (0.0010) [2023-12-26 09:44:17,469][123090] Updated weights for policy 1, policy_version 1261836 (0.0010) [2023-12-26 09:44:17,520][123090] Updated weights for policy 1, policy_version 1261846 (0.0009) [2023-12-26 09:44:17,615][123091] Updated weights for policy 0, policy_version 1270836 (0.0009) [2023-12-26 09:44:17,672][123091] Updated weights for policy 0, policy_version 1270846 (0.0009) [2023-12-26 09:44:17,734][123091] Updated weights for policy 0, policy_version 1270856 (0.0009) [2023-12-26 09:44:18,404][123090] Updated weights for policy 1, policy_version 1261857 (0.0010) [2023-12-26 09:44:18,461][123090] Updated weights for policy 1, policy_version 1261867 (0.0009) [2023-12-26 09:44:18,504][123091] Updated weights for policy 0, policy_version 1270866 (0.0007) [2023-12-26 09:44:18,513][123090] Updated weights for policy 1, policy_version 1261877 (0.0009) [2023-12-26 09:44:18,570][123091] Updated weights for policy 0, policy_version 1270876 (0.0008) [2023-12-26 09:44:18,571][123090] Updated weights for policy 1, policy_version 1261887 (0.0009) [2023-12-26 09:44:18,629][123091] Updated weights for policy 0, policy_version 1270886 (0.0009) [2023-12-26 09:44:18,682][123091] Updated weights for policy 0, policy_version 1270896 (0.0009) [2023-12-26 09:44:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 648396800. Throughput: 0: 8799.9, 1: 8682.6. Samples: 648402300. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:18,785][121949] Avg episode reward: [(0, '6260.792'), (1, '4999.651')] [2023-12-26 09:44:19,427][123090] Updated weights for policy 1, policy_version 1261897 (0.0008) [2023-12-26 09:44:19,480][123090] Updated weights for policy 1, policy_version 1261907 (0.0009) [2023-12-26 09:44:19,510][123091] Updated weights for policy 0, policy_version 1270906 (0.0008) [2023-12-26 09:44:19,546][123090] Updated weights for policy 1, policy_version 1261917 (0.0009) [2023-12-26 09:44:19,577][123091] Updated weights for policy 0, policy_version 1270916 (0.0008) [2023-12-26 09:44:19,649][123091] Updated weights for policy 0, policy_version 1270926 (0.0008) [2023-12-26 09:44:20,387][123091] Updated weights for policy 0, policy_version 1270936 (0.0010) [2023-12-26 09:44:20,394][123090] Updated weights for policy 1, policy_version 1261927 (0.0006) [2023-12-26 09:44:20,433][123091] Updated weights for policy 0, policy_version 1270946 (0.0007) [2023-12-26 09:44:20,456][123090] Updated weights for policy 1, policy_version 1261937 (0.0008) [2023-12-26 09:44:20,487][123091] Updated weights for policy 0, policy_version 1270956 (0.0005) [2023-12-26 09:44:20,522][123090] Updated weights for policy 1, policy_version 1261947 (0.0009) [2023-12-26 09:44:21,214][123091] Updated weights for policy 0, policy_version 1270966 (0.0009) [2023-12-26 09:44:21,290][123091] Updated weights for policy 0, policy_version 1270976 (0.0011) [2023-12-26 09:44:21,351][123091] Updated weights for policy 0, policy_version 1270986 (0.0009) [2023-12-26 09:44:21,415][123090] Updated weights for policy 1, policy_version 1261957 (0.0008) [2023-12-26 09:44:21,477][123090] Updated weights for policy 1, policy_version 1261967 (0.0007) [2023-12-26 09:44:21,545][123090] Updated weights for policy 1, policy_version 1261977 (0.0005) [2023-12-26 09:44:22,152][123091] Updated weights for policy 0, policy_version 1270996 (0.0008) [2023-12-26 09:44:22,203][123091] Updated weights for policy 0, policy_version 1271006 (0.0006) [2023-12-26 09:44:22,254][123091] Updated weights for policy 0, policy_version 1271016 (0.0009) [2023-12-26 09:44:22,387][123090] Updated weights for policy 1, policy_version 1261987 (0.0006) [2023-12-26 09:44:22,448][123090] Updated weights for policy 1, policy_version 1261997 (0.0005) [2023-12-26 09:44:22,518][123090] Updated weights for policy 1, policy_version 1262007 (0.0007) [2023-12-26 09:44:23,119][123091] Updated weights for policy 0, policy_version 1271026 (0.0010) [2023-12-26 09:44:23,189][123091] Updated weights for policy 0, policy_version 1271036 (0.0009) [2023-12-26 09:44:23,256][123091] Updated weights for policy 0, policy_version 1271046 (0.0010) [2023-12-26 09:44:23,324][123091] Updated weights for policy 0, policy_version 1271056 (0.0010) [2023-12-26 09:44:23,326][123090] Updated weights for policy 1, policy_version 1262017 (0.0009) [2023-12-26 09:44:23,392][123090] Updated weights for policy 1, policy_version 1262027 (0.0005) [2023-12-26 09:44:23,460][123090] Updated weights for policy 1, policy_version 1262037 (0.0005) [2023-12-26 09:44:23,519][123090] Updated weights for policy 1, policy_version 1262047 (0.0005) [2023-12-26 09:44:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 648478720. Throughput: 0: 8764.7, 1: 8679.6. Samples: 648453928. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:23,785][121949] Avg episode reward: [(0, '6287.295'), (1, '5277.127')] [2023-12-26 09:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001271056_325394432.pth... [2023-12-26 09:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001262048_323084288.pth... [2023-12-26 09:44:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001270032_325132288.pth [2023-12-26 09:44:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001261024_322822144.pth [2023-12-26 09:44:24,127][123091] Updated weights for policy 0, policy_version 1271066 (0.0009) [2023-12-26 09:44:24,183][123091] Updated weights for policy 0, policy_version 1271077 (0.0010) [2023-12-26 09:44:24,224][123090] Updated weights for policy 1, policy_version 1262057 (0.0006) [2023-12-26 09:44:24,238][123091] Updated weights for policy 0, policy_version 1271088 (0.0009) [2023-12-26 09:44:24,275][123090] Updated weights for policy 1, policy_version 1262067 (0.0005) [2023-12-26 09:44:24,336][123090] Updated weights for policy 1, policy_version 1262078 (0.0007) [2023-12-26 09:44:25,086][123090] Updated weights for policy 1, policy_version 1262088 (0.0009) [2023-12-26 09:44:25,126][123091] Updated weights for policy 0, policy_version 1271098 (0.0010) [2023-12-26 09:44:25,150][123090] Updated weights for policy 1, policy_version 1262098 (0.0008) [2023-12-26 09:44:25,185][123091] Updated weights for policy 0, policy_version 1271108 (0.0008) [2023-12-26 09:44:25,213][123090] Updated weights for policy 1, policy_version 1262108 (0.0006) [2023-12-26 09:44:25,250][123091] Updated weights for policy 0, policy_version 1271118 (0.0007) [2023-12-26 09:44:26,034][123091] Updated weights for policy 0, policy_version 1271128 (0.0009) [2023-12-26 09:44:26,073][123090] Updated weights for policy 1, policy_version 1262118 (0.0009) [2023-12-26 09:44:26,094][123091] Updated weights for policy 0, policy_version 1271138 (0.0007) [2023-12-26 09:44:26,131][123090] Updated weights for policy 1, policy_version 1262128 (0.0007) [2023-12-26 09:44:26,160][123091] Updated weights for policy 0, policy_version 1271148 (0.0010) [2023-12-26 09:44:26,185][123090] Updated weights for policy 1, policy_version 1262138 (0.0009) [2023-12-26 09:44:26,944][123091] Updated weights for policy 0, policy_version 1271158 (0.0006) [2023-12-26 09:44:26,967][123090] Updated weights for policy 1, policy_version 1262148 (0.0008) [2023-12-26 09:44:26,993][123091] Updated weights for policy 0, policy_version 1271168 (0.0006) [2023-12-26 09:44:27,018][123090] Updated weights for policy 1, policy_version 1262158 (0.0007) [2023-12-26 09:44:27,042][123091] Updated weights for policy 0, policy_version 1271178 (0.0007) [2023-12-26 09:44:27,070][123090] Updated weights for policy 1, policy_version 1262168 (0.0008) [2023-12-26 09:44:27,696][123091] Updated weights for policy 0, policy_version 1271188 (0.0005) [2023-12-26 09:44:27,743][123091] Updated weights for policy 0, policy_version 1271198 (0.0005) [2023-12-26 09:44:27,771][123090] Updated weights for policy 1, policy_version 1262178 (0.0008) [2023-12-26 09:44:27,788][123091] Updated weights for policy 0, policy_version 1271208 (0.0005) [2023-12-26 09:44:27,819][123090] Updated weights for policy 1, policy_version 1262188 (0.0005) [2023-12-26 09:44:27,875][123090] Updated weights for policy 1, policy_version 1262198 (0.0005) [2023-12-26 09:44:27,922][123090] Updated weights for policy 1, policy_version 1262208 (0.0005) [2023-12-26 09:44:28,500][123091] Updated weights for policy 0, policy_version 1271218 (0.0006) [2023-12-26 09:44:28,572][123091] Updated weights for policy 0, policy_version 1271228 (0.0010) [2023-12-26 09:44:28,628][123090] Updated weights for policy 1, policy_version 1262218 (0.0005) [2023-12-26 09:44:28,630][123091] Updated weights for policy 0, policy_version 1271238 (0.0009) [2023-12-26 09:44:28,686][123090] Updated weights for policy 1, policy_version 1262228 (0.0005) [2023-12-26 09:44:28,686][123091] Updated weights for policy 0, policy_version 1271248 (0.0009) [2023-12-26 09:44:28,747][123090] Updated weights for policy 1, policy_version 1262238 (0.0005) [2023-12-26 09:44:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 648577024. Throughput: 0: 8854.1, 1: 8711.9. Samples: 648561296. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:28,784][121949] Avg episode reward: [(0, '6281.723'), (1, '5362.820')] [2023-12-26 09:44:29,523][123090] Updated weights for policy 1, policy_version 1262248 (0.0009) [2023-12-26 09:44:29,566][123091] Updated weights for policy 0, policy_version 1271258 (0.0010) [2023-12-26 09:44:29,570][123090] Updated weights for policy 1, policy_version 1262258 (0.0010) [2023-12-26 09:44:29,614][123091] Updated weights for policy 0, policy_version 1271268 (0.0010) [2023-12-26 09:44:29,615][123090] Updated weights for policy 1, policy_version 1262268 (0.0010) [2023-12-26 09:44:29,666][123091] Updated weights for policy 0, policy_version 1271278 (0.0009) [2023-12-26 09:44:30,399][123091] Updated weights for policy 0, policy_version 1271288 (0.0006) [2023-12-26 09:44:30,468][123091] Updated weights for policy 0, policy_version 1271298 (0.0006) [2023-12-26 09:44:30,505][123090] Updated weights for policy 1, policy_version 1262278 (0.0010) [2023-12-26 09:44:30,530][123091] Updated weights for policy 0, policy_version 1271308 (0.0007) [2023-12-26 09:44:30,569][123090] Updated weights for policy 1, policy_version 1262288 (0.0008) [2023-12-26 09:44:30,628][123090] Updated weights for policy 1, policy_version 1262298 (0.0005) [2023-12-26 09:44:31,169][123091] Updated weights for policy 0, policy_version 1271318 (0.0009) [2023-12-26 09:44:31,238][123091] Updated weights for policy 0, policy_version 1271328 (0.0009) [2023-12-26 09:44:31,301][123091] Updated weights for policy 0, policy_version 1271338 (0.0010) [2023-12-26 09:44:31,438][123090] Updated weights for policy 1, policy_version 1262308 (0.0008) [2023-12-26 09:44:31,502][123090] Updated weights for policy 1, policy_version 1262318 (0.0008) [2023-12-26 09:44:31,559][123090] Updated weights for policy 1, policy_version 1262328 (0.0010) [2023-12-26 09:44:32,030][123091] Updated weights for policy 0, policy_version 1271348 (0.0008) [2023-12-26 09:44:32,093][123091] Updated weights for policy 0, policy_version 1271358 (0.0008) [2023-12-26 09:44:32,158][123091] Updated weights for policy 0, policy_version 1271368 (0.0010) [2023-12-26 09:44:32,307][123090] Updated weights for policy 1, policy_version 1262338 (0.0009) [2023-12-26 09:44:32,375][123090] Updated weights for policy 1, policy_version 1262348 (0.0008) [2023-12-26 09:44:32,422][123090] Updated weights for policy 1, policy_version 1262358 (0.0005) [2023-12-26 09:44:32,484][123090] Updated weights for policy 1, policy_version 1262368 (0.0005) [2023-12-26 09:44:32,901][123091] Updated weights for policy 0, policy_version 1271378 (0.0009) [2023-12-26 09:44:32,964][123091] Updated weights for policy 0, policy_version 1271388 (0.0008) [2023-12-26 09:44:33,040][123091] Updated weights for policy 0, policy_version 1271398 (0.0008) [2023-12-26 09:44:33,111][123091] Updated weights for policy 0, policy_version 1271408 (0.0008) [2023-12-26 09:44:33,201][123090] Updated weights for policy 1, policy_version 1262378 (0.0010) [2023-12-26 09:44:33,254][123090] Updated weights for policy 1, policy_version 1262389 (0.0010) [2023-12-26 09:44:33,305][123090] Updated weights for policy 1, policy_version 1262399 (0.0005) [2023-12-26 09:44:33,747][123091] Updated weights for policy 0, policy_version 1271418 (0.0005) [2023-12-26 09:44:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 648658944. Throughput: 0: 8891.8, 1: 8848.7. Samples: 648674684. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:33,785][121949] Avg episode reward: [(0, '6256.670'), (1, '5311.062')] [2023-12-26 09:44:33,818][123091] Updated weights for policy 0, policy_version 1271428 (0.0005) [2023-12-26 09:44:33,892][123091] Updated weights for policy 0, policy_version 1271438 (0.0005) [2023-12-26 09:44:34,019][123090] Updated weights for policy 1, policy_version 1262409 (0.0005) [2023-12-26 09:44:34,079][123090] Updated weights for policy 1, policy_version 1262419 (0.0005) [2023-12-26 09:44:34,131][123090] Updated weights for policy 1, policy_version 1262429 (0.0005) [2023-12-26 09:44:34,551][123091] Updated weights for policy 0, policy_version 1271448 (0.0006) [2023-12-26 09:44:34,622][123091] Updated weights for policy 0, policy_version 1271458 (0.0007) [2023-12-26 09:44:34,687][123091] Updated weights for policy 0, policy_version 1271468 (0.0005) [2023-12-26 09:44:34,831][123090] Updated weights for policy 1, policy_version 1262439 (0.0009) [2023-12-26 09:44:34,905][123090] Updated weights for policy 1, policy_version 1262449 (0.0010) [2023-12-26 09:44:34,973][123090] Updated weights for policy 1, policy_version 1262459 (0.0009) [2023-12-26 09:44:35,285][123091] Updated weights for policy 0, policy_version 1271478 (0.0008) [2023-12-26 09:44:35,328][123091] Updated weights for policy 0, policy_version 1271488 (0.0010) [2023-12-26 09:44:35,394][123091] Updated weights for policy 0, policy_version 1271498 (0.0010) [2023-12-26 09:44:35,857][123090] Updated weights for policy 1, policy_version 1262469 (0.0010) [2023-12-26 09:44:35,917][123090] Updated weights for policy 1, policy_version 1262479 (0.0010) [2023-12-26 09:44:35,971][123090] Updated weights for policy 1, policy_version 1262489 (0.0010) [2023-12-26 09:44:35,991][123091] Updated weights for policy 0, policy_version 1271508 (0.0008) [2023-12-26 09:44:36,053][123091] Updated weights for policy 0, policy_version 1271518 (0.0007) [2023-12-26 09:44:36,107][123091] Updated weights for policy 0, policy_version 1271528 (0.0006) [2023-12-26 09:44:36,891][123091] Updated weights for policy 0, policy_version 1271538 (0.0008) [2023-12-26 09:44:36,901][123090] Updated weights for policy 1, policy_version 1262499 (0.0008) [2023-12-26 09:44:36,954][123091] Updated weights for policy 0, policy_version 1271548 (0.0009) [2023-12-26 09:44:36,964][123090] Updated weights for policy 1, policy_version 1262509 (0.0007) [2023-12-26 09:44:37,017][123091] Updated weights for policy 0, policy_version 1271558 (0.0008) [2023-12-26 09:44:37,029][123090] Updated weights for policy 1, policy_version 1262519 (0.0008) [2023-12-26 09:44:37,081][123091] Updated weights for policy 0, policy_version 1271568 (0.0011) [2023-12-26 09:44:37,798][123090] Updated weights for policy 1, policy_version 1262529 (0.0007) [2023-12-26 09:44:37,810][123091] Updated weights for policy 0, policy_version 1271578 (0.0005) [2023-12-26 09:44:37,865][123090] Updated weights for policy 1, policy_version 1262539 (0.0008) [2023-12-26 09:44:37,874][123091] Updated weights for policy 0, policy_version 1271588 (0.0005) [2023-12-26 09:44:37,924][123090] Updated weights for policy 1, policy_version 1262549 (0.0010) [2023-12-26 09:44:37,932][123091] Updated weights for policy 0, policy_version 1271598 (0.0010) [2023-12-26 09:44:37,984][123090] Updated weights for policy 1, policy_version 1262559 (0.0010) [2023-12-26 09:44:38,757][123091] Updated weights for policy 0, policy_version 1271608 (0.0010) [2023-12-26 09:44:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 648749056. Throughput: 0: 8975.9, 1: 8830.3. Samples: 648731492. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:38,785][121949] Avg episode reward: [(0, '6130.730'), (1, '5585.987')] [2023-12-26 09:44:38,801][123090] Updated weights for policy 1, policy_version 1262569 (0.0011) [2023-12-26 09:44:38,821][123091] Updated weights for policy 0, policy_version 1271618 (0.0011) [2023-12-26 09:44:38,857][123090] Updated weights for policy 1, policy_version 1262579 (0.0011) [2023-12-26 09:44:38,885][123091] Updated weights for policy 0, policy_version 1271628 (0.0011) [2023-12-26 09:44:38,908][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001271632_325541888.pth... [2023-12-26 09:44:38,913][123090] Updated weights for policy 1, policy_version 1262589 (0.0010) [2023-12-26 09:44:38,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001270544_325263360.pth [2023-12-26 09:44:38,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001262592_323223552.pth... [2023-12-26 09:44:38,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001261568_322961408.pth [2023-12-26 09:44:39,676][123091] Updated weights for policy 0, policy_version 1271638 (0.0010) [2023-12-26 09:44:39,718][123090] Updated weights for policy 1, policy_version 1262599 (0.0011) [2023-12-26 09:44:39,735][123091] Updated weights for policy 0, policy_version 1271648 (0.0011) [2023-12-26 09:44:39,778][123090] Updated weights for policy 1, policy_version 1262609 (0.0011) [2023-12-26 09:44:39,795][123091] Updated weights for policy 0, policy_version 1271658 (0.0011) [2023-12-26 09:44:39,841][123090] Updated weights for policy 1, policy_version 1262619 (0.0011) [2023-12-26 09:44:40,627][123091] Updated weights for policy 0, policy_version 1271668 (0.0010) [2023-12-26 09:44:40,635][123090] Updated weights for policy 1, policy_version 1262629 (0.0011) [2023-12-26 09:44:40,677][123091] Updated weights for policy 0, policy_version 1271678 (0.0007) [2023-12-26 09:44:40,691][123090] Updated weights for policy 1, policy_version 1262639 (0.0010) [2023-12-26 09:44:40,730][123091] Updated weights for policy 0, policy_version 1271688 (0.0009) [2023-12-26 09:44:40,750][123090] Updated weights for policy 1, policy_version 1262649 (0.0011) [2023-12-26 09:44:41,614][123090] Updated weights for policy 1, policy_version 1262659 (0.0011) [2023-12-26 09:44:41,621][123091] Updated weights for policy 0, policy_version 1271698 (0.0008) [2023-12-26 09:44:41,672][123090] Updated weights for policy 1, policy_version 1262669 (0.0008) [2023-12-26 09:44:41,688][123091] Updated weights for policy 0, policy_version 1271708 (0.0009) [2023-12-26 09:44:41,744][123090] Updated weights for policy 1, policy_version 1262679 (0.0008) [2023-12-26 09:44:41,756][123091] Updated weights for policy 0, policy_version 1271718 (0.0007) [2023-12-26 09:44:41,812][123091] Updated weights for policy 0, policy_version 1271728 (0.0008) [2023-12-26 09:44:42,578][123090] Updated weights for policy 1, policy_version 1262689 (0.0008) [2023-12-26 09:44:42,639][123090] Updated weights for policy 1, policy_version 1262699 (0.0011) [2023-12-26 09:44:42,651][123091] Updated weights for policy 0, policy_version 1271738 (0.0007) [2023-12-26 09:44:42,708][123090] Updated weights for policy 1, policy_version 1262709 (0.0011) [2023-12-26 09:44:42,712][123091] Updated weights for policy 0, policy_version 1271748 (0.0006) [2023-12-26 09:44:42,773][123090] Updated weights for policy 1, policy_version 1262719 (0.0011) [2023-12-26 09:44:42,780][123091] Updated weights for policy 0, policy_version 1271758 (0.0005) [2023-12-26 09:44:43,536][123090] Updated weights for policy 1, policy_version 1262729 (0.0010) [2023-12-26 09:44:43,597][123090] Updated weights for policy 1, policy_version 1262739 (0.0011) [2023-12-26 09:44:43,631][123091] Updated weights for policy 0, policy_version 1271768 (0.0007) [2023-12-26 09:44:43,662][123090] Updated weights for policy 1, policy_version 1262749 (0.0011) [2023-12-26 09:44:43,695][123091] Updated weights for policy 0, policy_version 1271778 (0.0008) [2023-12-26 09:44:43,756][123091] Updated weights for policy 0, policy_version 1271788 (0.0009) [2023-12-26 09:44:43,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 648847360. Throughput: 0: 9045.1, 1: 8724.1. Samples: 648836004. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:43,785][121949] Avg episode reward: [(0, '6184.331'), (1, '5706.014')] [2023-12-26 09:44:44,487][123090] Updated weights for policy 1, policy_version 1262759 (0.0011) [2023-12-26 09:44:44,542][123090] Updated weights for policy 1, policy_version 1262769 (0.0010) [2023-12-26 09:44:44,584][123091] Updated weights for policy 0, policy_version 1271798 (0.0007) [2023-12-26 09:44:44,589][123090] Updated weights for policy 1, policy_version 1262779 (0.0010) [2023-12-26 09:44:44,640][123091] Updated weights for policy 0, policy_version 1271808 (0.0007) [2023-12-26 09:44:44,688][123091] Updated weights for policy 0, policy_version 1271818 (0.0008) [2023-12-26 09:44:45,471][123090] Updated weights for policy 1, policy_version 1262789 (0.0011) [2023-12-26 09:44:45,543][123090] Updated weights for policy 1, policy_version 1262799 (0.0011) [2023-12-26 09:44:45,556][123091] Updated weights for policy 0, policy_version 1271828 (0.0008) [2023-12-26 09:44:45,603][123090] Updated weights for policy 1, policy_version 1262809 (0.0010) [2023-12-26 09:44:45,613][123091] Updated weights for policy 0, policy_version 1271838 (0.0007) [2023-12-26 09:44:45,671][123091] Updated weights for policy 0, policy_version 1271848 (0.0006) [2023-12-26 09:44:46,360][123091] Updated weights for policy 0, policy_version 1271858 (0.0005) [2023-12-26 09:44:46,425][123091] Updated weights for policy 0, policy_version 1271868 (0.0009) [2023-12-26 09:44:46,429][123090] Updated weights for policy 1, policy_version 1262819 (0.0011) [2023-12-26 09:44:46,487][123091] Updated weights for policy 0, policy_version 1271878 (0.0008) [2023-12-26 09:44:46,500][123090] Updated weights for policy 1, policy_version 1262829 (0.0011) [2023-12-26 09:44:46,545][123091] Updated weights for policy 0, policy_version 1271888 (0.0008) [2023-12-26 09:44:46,568][123090] Updated weights for policy 1, policy_version 1262839 (0.0011) [2023-12-26 09:44:47,262][123091] Updated weights for policy 0, policy_version 1271899 (0.0010) [2023-12-26 09:44:47,315][123091] Updated weights for policy 0, policy_version 1271910 (0.0010) [2023-12-26 09:44:47,365][123090] Updated weights for policy 1, policy_version 1262849 (0.0011) [2023-12-26 09:44:47,373][123091] Updated weights for policy 0, policy_version 1271920 (0.0009) [2023-12-26 09:44:47,435][123090] Updated weights for policy 1, policy_version 1262859 (0.0010) [2023-12-26 09:44:47,500][123090] Updated weights for policy 1, policy_version 1262869 (0.0008) [2023-12-26 09:44:47,564][123090] Updated weights for policy 1, policy_version 1262879 (0.0005) [2023-12-26 09:44:48,144][123090] Updated weights for policy 1, policy_version 1262889 (0.0009) [2023-12-26 09:44:48,176][123091] Updated weights for policy 0, policy_version 1271930 (0.0008) [2023-12-26 09:44:48,191][123090] Updated weights for policy 1, policy_version 1262899 (0.0010) [2023-12-26 09:44:48,229][123091] Updated weights for policy 0, policy_version 1271940 (0.0007) [2023-12-26 09:44:48,247][123090] Updated weights for policy 1, policy_version 1262909 (0.0010) [2023-12-26 09:44:48,284][123091] Updated weights for policy 0, policy_version 1271950 (0.0007) [2023-12-26 09:44:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 648929280. Throughput: 0: 9052.7, 1: 8722.8. Samples: 648942448. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:48,785][121949] Avg episode reward: [(0, '6157.764'), (1, '5696.979')] [2023-12-26 09:44:49,033][123091] Updated weights for policy 0, policy_version 1271960 (0.0010) [2023-12-26 09:44:49,064][123090] Updated weights for policy 1, policy_version 1262919 (0.0010) [2023-12-26 09:44:49,100][123091] Updated weights for policy 0, policy_version 1271970 (0.0011) [2023-12-26 09:44:49,119][123090] Updated weights for policy 1, policy_version 1262929 (0.0010) [2023-12-26 09:44:49,147][123091] Updated weights for policy 0, policy_version 1271980 (0.0010) [2023-12-26 09:44:49,177][123090] Updated weights for policy 1, policy_version 1262939 (0.0010) [2023-12-26 09:44:49,914][123091] Updated weights for policy 0, policy_version 1271990 (0.0009) [2023-12-26 09:44:49,984][123091] Updated weights for policy 0, policy_version 1272000 (0.0008) [2023-12-26 09:44:50,018][123090] Updated weights for policy 1, policy_version 1262949 (0.0011) [2023-12-26 09:44:50,047][123091] Updated weights for policy 0, policy_version 1272010 (0.0008) [2023-12-26 09:44:50,073][123090] Updated weights for policy 1, policy_version 1262959 (0.0010) [2023-12-26 09:44:50,132][123090] Updated weights for policy 1, policy_version 1262969 (0.0010) [2023-12-26 09:44:50,784][123091] Updated weights for policy 0, policy_version 1272020 (0.0008) [2023-12-26 09:44:50,841][123091] Updated weights for policy 0, policy_version 1272030 (0.0009) [2023-12-26 09:44:50,894][123091] Updated weights for policy 0, policy_version 1272040 (0.0009) [2023-12-26 09:44:50,945][123090] Updated weights for policy 1, policy_version 1262979 (0.0011) [2023-12-26 09:44:51,009][123090] Updated weights for policy 1, policy_version 1262989 (0.0011) [2023-12-26 09:44:51,078][123090] Updated weights for policy 1, policy_version 1262999 (0.0011) [2023-12-26 09:44:51,777][123091] Updated weights for policy 0, policy_version 1272050 (0.0008) [2023-12-26 09:44:51,846][123091] Updated weights for policy 0, policy_version 1272060 (0.0009) [2023-12-26 09:44:51,909][123091] Updated weights for policy 0, policy_version 1272070 (0.0009) [2023-12-26 09:44:51,920][123090] Updated weights for policy 1, policy_version 1263009 (0.0011) [2023-12-26 09:44:51,973][123091] Updated weights for policy 0, policy_version 1272080 (0.0006) [2023-12-26 09:44:51,976][123090] Updated weights for policy 1, policy_version 1263019 (0.0010) [2023-12-26 09:44:52,032][123090] Updated weights for policy 1, policy_version 1263029 (0.0010) [2023-12-26 09:44:52,083][123090] Updated weights for policy 1, policy_version 1263039 (0.0010) [2023-12-26 09:44:52,710][123091] Updated weights for policy 0, policy_version 1272090 (0.0006) [2023-12-26 09:44:52,781][123091] Updated weights for policy 0, policy_version 1272100 (0.0006) [2023-12-26 09:44:52,853][123091] Updated weights for policy 0, policy_version 1272110 (0.0006) [2023-12-26 09:44:52,893][123090] Updated weights for policy 1, policy_version 1263049 (0.0010) [2023-12-26 09:44:52,956][123090] Updated weights for policy 1, policy_version 1263059 (0.0011) [2023-12-26 09:44:53,019][123090] Updated weights for policy 1, policy_version 1263069 (0.0010) [2023-12-26 09:44:53,644][123091] Updated weights for policy 0, policy_version 1272120 (0.0009) [2023-12-26 09:44:53,708][123091] Updated weights for policy 0, policy_version 1272130 (0.0010) [2023-12-26 09:44:53,725][123090] Updated weights for policy 1, policy_version 1263079 (0.0007) [2023-12-26 09:44:53,773][123091] Updated weights for policy 0, policy_version 1272140 (0.0009) [2023-12-26 09:44:53,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 649011200. Throughput: 0: 9051.8, 1: 8693.5. Samples: 648995440. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:53,785][121949] Avg episode reward: [(0, '6196.312'), (1, '5533.914')] [2023-12-26 09:44:53,788][123090] Updated weights for policy 1, policy_version 1263089 (0.0005) [2023-12-26 09:44:53,799][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001272144_325672960.pth... [2023-12-26 09:44:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001271056_325394432.pth [2023-12-26 09:44:53,839][123090] Updated weights for policy 1, policy_version 1263099 (0.0005) [2023-12-26 09:44:53,862][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001263104_323354624.pth... [2023-12-26 09:44:53,865][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001262048_323084288.pth [2023-12-26 09:44:54,368][123090] Updated weights for policy 1, policy_version 1263109 (0.0005) [2023-12-26 09:44:54,419][123090] Updated weights for policy 1, policy_version 1263119 (0.0005) [2023-12-26 09:44:54,470][123090] Updated weights for policy 1, policy_version 1263129 (0.0005) [2023-12-26 09:44:54,685][123091] Updated weights for policy 0, policy_version 1272150 (0.0010) [2023-12-26 09:44:54,733][123091] Updated weights for policy 0, policy_version 1272160 (0.0009) [2023-12-26 09:44:54,781][123091] Updated weights for policy 0, policy_version 1272170 (0.0008) [2023-12-26 09:44:55,208][123090] Updated weights for policy 1, policy_version 1263139 (0.0006) [2023-12-26 09:44:55,273][123090] Updated weights for policy 1, policy_version 1263149 (0.0010) [2023-12-26 09:44:55,336][123090] Updated weights for policy 1, policy_version 1263159 (0.0009) [2023-12-26 09:44:55,555][123091] Updated weights for policy 0, policy_version 1272180 (0.0009) [2023-12-26 09:44:55,609][123091] Updated weights for policy 0, policy_version 1272190 (0.0010) [2023-12-26 09:44:55,671][123091] Updated weights for policy 0, policy_version 1272200 (0.0007) [2023-12-26 09:44:56,175][123090] Updated weights for policy 1, policy_version 1263169 (0.0008) [2023-12-26 09:44:56,234][123090] Updated weights for policy 1, policy_version 1263179 (0.0010) [2023-12-26 09:44:56,287][123090] Updated weights for policy 1, policy_version 1263189 (0.0008) [2023-12-26 09:44:56,315][123091] Updated weights for policy 0, policy_version 1272210 (0.0008) [2023-12-26 09:44:56,343][123090] Updated weights for policy 1, policy_version 1263199 (0.0005) [2023-12-26 09:44:56,370][123091] Updated weights for policy 0, policy_version 1272220 (0.0006) [2023-12-26 09:44:56,421][123091] Updated weights for policy 0, policy_version 1272230 (0.0005) [2023-12-26 09:44:56,474][123091] Updated weights for policy 0, policy_version 1272240 (0.0006) [2023-12-26 09:44:57,110][123090] Updated weights for policy 1, policy_version 1263209 (0.0005) [2023-12-26 09:44:57,169][123090] Updated weights for policy 1, policy_version 1263219 (0.0005) [2023-12-26 09:44:57,227][123090] Updated weights for policy 1, policy_version 1263229 (0.0006) [2023-12-26 09:44:57,242][123091] Updated weights for policy 0, policy_version 1272250 (0.0011) [2023-12-26 09:44:57,298][123091] Updated weights for policy 0, policy_version 1272260 (0.0010) [2023-12-26 09:44:57,363][123091] Updated weights for policy 0, policy_version 1272270 (0.0009) [2023-12-26 09:44:57,926][123090] Updated weights for policy 1, policy_version 1263239 (0.0006) [2023-12-26 09:44:57,982][123090] Updated weights for policy 1, policy_version 1263249 (0.0005) [2023-12-26 09:44:58,038][123090] Updated weights for policy 1, policy_version 1263259 (0.0006) [2023-12-26 09:44:58,185][123091] Updated weights for policy 0, policy_version 1272280 (0.0007) [2023-12-26 09:44:58,248][123091] Updated weights for policy 0, policy_version 1272290 (0.0010) [2023-12-26 09:44:58,304][123091] Updated weights for policy 0, policy_version 1272300 (0.0011) [2023-12-26 09:44:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 649109504. Throughput: 0: 9095.0, 1: 8847.6. Samples: 649105572. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:44:58,785][121949] Avg episode reward: [(0, '6175.576'), (1, '5493.718')] [2023-12-26 09:44:58,979][123090] Updated weights for policy 1, policy_version 1263269 (0.0009) [2023-12-26 09:44:59,043][123090] Updated weights for policy 1, policy_version 1263279 (0.0010) [2023-12-26 09:44:59,115][123090] Updated weights for policy 1, policy_version 1263289 (0.0010) [2023-12-26 09:44:59,184][123091] Updated weights for policy 0, policy_version 1272310 (0.0009) [2023-12-26 09:44:59,257][123091] Updated weights for policy 0, policy_version 1272320 (0.0008) [2023-12-26 09:44:59,311][123091] Updated weights for policy 0, policy_version 1272330 (0.0006) [2023-12-26 09:44:59,968][123090] Updated weights for policy 1, policy_version 1263299 (0.0010) [2023-12-26 09:45:00,026][123090] Updated weights for policy 1, policy_version 1263309 (0.0009) [2023-12-26 09:45:00,076][123091] Updated weights for policy 0, policy_version 1272340 (0.0009) [2023-12-26 09:45:00,080][123090] Updated weights for policy 1, policy_version 1263319 (0.0009) [2023-12-26 09:45:00,131][123091] Updated weights for policy 0, policy_version 1272350 (0.0007) [2023-12-26 09:45:00,186][123091] Updated weights for policy 0, policy_version 1272360 (0.0010) [2023-12-26 09:45:00,867][123090] Updated weights for policy 1, policy_version 1263329 (0.0009) [2023-12-26 09:45:00,926][123090] Updated weights for policy 1, policy_version 1263339 (0.0006) [2023-12-26 09:45:00,982][123091] Updated weights for policy 0, policy_version 1272370 (0.0009) [2023-12-26 09:45:00,983][123090] Updated weights for policy 1, policy_version 1263349 (0.0006) [2023-12-26 09:45:01,043][123090] Updated weights for policy 1, policy_version 1263359 (0.0007) [2023-12-26 09:45:01,055][123091] Updated weights for policy 0, policy_version 1272380 (0.0008) [2023-12-26 09:45:01,120][123091] Updated weights for policy 0, policy_version 1272390 (0.0008) [2023-12-26 09:45:01,186][123091] Updated weights for policy 0, policy_version 1272400 (0.0007) [2023-12-26 09:45:01,827][123090] Updated weights for policy 1, policy_version 1263369 (0.0006) [2023-12-26 09:45:01,885][123090] Updated weights for policy 1, policy_version 1263379 (0.0006) [2023-12-26 09:45:01,940][123090] Updated weights for policy 1, policy_version 1263389 (0.0007) [2023-12-26 09:45:01,968][123091] Updated weights for policy 0, policy_version 1272410 (0.0006) [2023-12-26 09:45:02,027][123091] Updated weights for policy 0, policy_version 1272420 (0.0007) [2023-12-26 09:45:02,084][123091] Updated weights for policy 0, policy_version 1272430 (0.0007) [2023-12-26 09:45:02,715][123090] Updated weights for policy 1, policy_version 1263399 (0.0008) [2023-12-26 09:45:02,765][123090] Updated weights for policy 1, policy_version 1263409 (0.0008) [2023-12-26 09:45:02,812][123090] Updated weights for policy 1, policy_version 1263419 (0.0008) [2023-12-26 09:45:02,881][123091] Updated weights for policy 0, policy_version 1272440 (0.0009) [2023-12-26 09:45:02,924][123091] Updated weights for policy 0, policy_version 1272450 (0.0010) [2023-12-26 09:45:02,985][123091] Updated weights for policy 0, policy_version 1272460 (0.0005) [2023-12-26 09:45:03,608][123090] Updated weights for policy 1, policy_version 1263429 (0.0007) [2023-12-26 09:45:03,656][123090] Updated weights for policy 1, policy_version 1263439 (0.0005) [2023-12-26 09:45:03,709][123090] Updated weights for policy 1, policy_version 1263449 (0.0005) [2023-12-26 09:45:03,768][123091] Updated weights for policy 0, policy_version 1272470 (0.0008) [2023-12-26 09:45:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 649199616. Throughput: 0: 9061.7, 1: 8914.4. Samples: 649211224. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:45:03,785][121949] Avg episode reward: [(0, '6173.348'), (1, '5428.634')] [2023-12-26 09:45:03,823][123091] Updated weights for policy 0, policy_version 1272482 (0.0010) [2023-12-26 09:45:03,884][123091] Updated weights for policy 0, policy_version 1272492 (0.0010) [2023-12-26 09:45:04,486][123090] Updated weights for policy 1, policy_version 1263459 (0.0006) [2023-12-26 09:45:04,545][123090] Updated weights for policy 1, policy_version 1263469 (0.0009) [2023-12-26 09:45:04,609][123090] Updated weights for policy 1, policy_version 1263479 (0.0010) [2023-12-26 09:45:04,731][123091] Updated weights for policy 0, policy_version 1272502 (0.0009) [2023-12-26 09:45:04,806][123091] Updated weights for policy 0, policy_version 1272512 (0.0010) [2023-12-26 09:45:04,876][123091] Updated weights for policy 0, policy_version 1272522 (0.0010) [2023-12-26 09:45:05,372][123090] Updated weights for policy 1, policy_version 1263489 (0.0009) [2023-12-26 09:45:05,418][123090] Updated weights for policy 1, policy_version 1263499 (0.0006) [2023-12-26 09:45:05,470][123090] Updated weights for policy 1, policy_version 1263509 (0.0005) [2023-12-26 09:45:05,525][123090] Updated weights for policy 1, policy_version 1263519 (0.0005) [2023-12-26 09:45:05,619][123091] Updated weights for policy 0, policy_version 1272532 (0.0010) [2023-12-26 09:45:05,681][123091] Updated weights for policy 0, policy_version 1272542 (0.0010) [2023-12-26 09:45:05,737][123091] Updated weights for policy 0, policy_version 1272552 (0.0008) [2023-12-26 09:45:06,245][123090] Updated weights for policy 1, policy_version 1263529 (0.0008) [2023-12-26 09:45:06,308][123090] Updated weights for policy 1, policy_version 1263539 (0.0008) [2023-12-26 09:45:06,374][123090] Updated weights for policy 1, policy_version 1263549 (0.0009) [2023-12-26 09:45:06,555][123091] Updated weights for policy 0, policy_version 1272562 (0.0008) [2023-12-26 09:45:06,633][123091] Updated weights for policy 0, policy_version 1272572 (0.0006) [2023-12-26 09:45:06,694][123091] Updated weights for policy 0, policy_version 1272582 (0.0009) [2023-12-26 09:45:06,747][123091] Updated weights for policy 0, policy_version 1272592 (0.0008) [2023-12-26 09:45:07,241][123090] Updated weights for policy 1, policy_version 1263559 (0.0010) [2023-12-26 09:45:07,311][123090] Updated weights for policy 1, policy_version 1263569 (0.0009) [2023-12-26 09:45:07,364][123090] Updated weights for policy 1, policy_version 1263579 (0.0010) [2023-12-26 09:45:07,525][123091] Updated weights for policy 0, policy_version 1272602 (0.0009) [2023-12-26 09:45:07,586][123091] Updated weights for policy 0, policy_version 1272612 (0.0010) [2023-12-26 09:45:07,646][123091] Updated weights for policy 0, policy_version 1272622 (0.0009) [2023-12-26 09:45:08,124][123090] Updated weights for policy 1, policy_version 1263589 (0.0007) [2023-12-26 09:45:08,174][123090] Updated weights for policy 1, policy_version 1263599 (0.0005) [2023-12-26 09:45:08,220][123090] Updated weights for policy 1, policy_version 1263609 (0.0005) [2023-12-26 09:45:08,537][123091] Updated weights for policy 0, policy_version 1272632 (0.0009) [2023-12-26 09:45:08,603][123091] Updated weights for policy 0, policy_version 1272642 (0.0010) [2023-12-26 09:45:08,661][123091] Updated weights for policy 0, policy_version 1272652 (0.0009) [2023-12-26 09:45:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 649289728. Throughput: 0: 9051.7, 1: 8959.7. Samples: 649264440. Policy #0 lag: (min: 31.0, avg: 40.3, max: 63.0) [2023-12-26 09:45:08,785][121949] Avg episode reward: [(0, '6055.189'), (1, '5634.666')] [2023-12-26 09:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001272656_325804032.pth... [2023-12-26 09:45:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001263616_323485696.pth... [2023-12-26 09:45:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001262592_323223552.pth [2023-12-26 09:45:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001271632_325541888.pth [2023-12-26 09:45:09,037][123090] Updated weights for policy 1, policy_version 1263620 (0.0008) [2023-12-26 09:45:09,098][123090] Updated weights for policy 1, policy_version 1263630 (0.0006) [2023-12-26 09:45:09,159][123090] Updated weights for policy 1, policy_version 1263640 (0.0009) [2023-12-26 09:45:09,499][123091] Updated weights for policy 0, policy_version 1272662 (0.0010) [2023-12-26 09:45:09,563][123091] Updated weights for policy 0, policy_version 1272672 (0.0010) [2023-12-26 09:45:09,623][123091] Updated weights for policy 0, policy_version 1272682 (0.0008) [2023-12-26 09:45:09,985][123090] Updated weights for policy 1, policy_version 1263650 (0.0010) [2023-12-26 09:45:10,048][123090] Updated weights for policy 1, policy_version 1263660 (0.0010) [2023-12-26 09:45:10,114][123090] Updated weights for policy 1, policy_version 1263670 (0.0009) [2023-12-26 09:45:10,186][123090] Updated weights for policy 1, policy_version 1263680 (0.0010) [2023-12-26 09:45:10,486][123091] Updated weights for policy 0, policy_version 1272692 (0.0010) [2023-12-26 09:45:10,540][123091] Updated weights for policy 0, policy_version 1272702 (0.0009) [2023-12-26 09:45:10,595][123091] Updated weights for policy 0, policy_version 1272712 (0.0008) [2023-12-26 09:45:10,930][123090] Updated weights for policy 1, policy_version 1263690 (0.0006) [2023-12-26 09:45:10,985][123090] Updated weights for policy 1, policy_version 1263700 (0.0005) [2023-12-26 09:45:11,042][123090] Updated weights for policy 1, policy_version 1263710 (0.0007) [2023-12-26 09:45:11,452][123091] Updated weights for policy 0, policy_version 1272722 (0.0009) [2023-12-26 09:45:11,519][123091] Updated weights for policy 0, policy_version 1272732 (0.0010) [2023-12-26 09:45:11,583][123091] Updated weights for policy 0, policy_version 1272742 (0.0009) [2023-12-26 09:45:11,652][123091] Updated weights for policy 0, policy_version 1272752 (0.0009) [2023-12-26 09:45:11,837][123090] Updated weights for policy 1, policy_version 1263720 (0.0009) [2023-12-26 09:45:11,907][123090] Updated weights for policy 1, policy_version 1263730 (0.0007) [2023-12-26 09:45:11,969][123090] Updated weights for policy 1, policy_version 1263740 (0.0007) [2023-12-26 09:45:12,491][123091] Updated weights for policy 0, policy_version 1272762 (0.0008) [2023-12-26 09:45:12,548][123091] Updated weights for policy 0, policy_version 1272772 (0.0005) [2023-12-26 09:45:12,619][123091] Updated weights for policy 0, policy_version 1272782 (0.0006) [2023-12-26 09:45:12,740][123090] Updated weights for policy 1, policy_version 1263750 (0.0007) [2023-12-26 09:45:12,810][123090] Updated weights for policy 1, policy_version 1263760 (0.0006) [2023-12-26 09:45:12,882][123090] Updated weights for policy 1, policy_version 1263770 (0.0006) [2023-12-26 09:45:13,343][123091] Updated weights for policy 0, policy_version 1272792 (0.0009) [2023-12-26 09:45:13,407][123091] Updated weights for policy 0, policy_version 1272802 (0.0009) [2023-12-26 09:45:13,479][123091] Updated weights for policy 0, policy_version 1272812 (0.0009) [2023-12-26 09:45:13,534][123090] Updated weights for policy 1, policy_version 1263780 (0.0008) [2023-12-26 09:45:13,602][123090] Updated weights for policy 1, policy_version 1263790 (0.0010) [2023-12-26 09:45:13,662][123090] Updated weights for policy 1, policy_version 1263800 (0.0010) [2023-12-26 09:45:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 649379840. Throughput: 0: 8964.3, 1: 8936.3. Samples: 649366828. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:13,785][121949] Avg episode reward: [(0, '6162.416'), (1, '5484.546')] [2023-12-26 09:45:14,305][123091] Updated weights for policy 0, policy_version 1272822 (0.0011) [2023-12-26 09:45:14,370][123091] Updated weights for policy 0, policy_version 1272832 (0.0011) [2023-12-26 09:45:14,430][123091] Updated weights for policy 0, policy_version 1272842 (0.0011) [2023-12-26 09:45:14,438][123090] Updated weights for policy 1, policy_version 1263810 (0.0009) [2023-12-26 09:45:14,503][123090] Updated weights for policy 1, policy_version 1263820 (0.0009) [2023-12-26 09:45:14,567][123090] Updated weights for policy 1, policy_version 1263830 (0.0011) [2023-12-26 09:45:14,635][123090] Updated weights for policy 1, policy_version 1263840 (0.0011) [2023-12-26 09:45:15,222][123091] Updated weights for policy 0, policy_version 1272852 (0.0011) [2023-12-26 09:45:15,291][123091] Updated weights for policy 0, policy_version 1272862 (0.0011) [2023-12-26 09:45:15,362][123091] Updated weights for policy 0, policy_version 1272872 (0.0011) [2023-12-26 09:45:15,435][123090] Updated weights for policy 1, policy_version 1263850 (0.0006) [2023-12-26 09:45:15,503][123090] Updated weights for policy 1, policy_version 1263860 (0.0007) [2023-12-26 09:45:15,572][123090] Updated weights for policy 1, policy_version 1263870 (0.0007) [2023-12-26 09:45:16,196][123091] Updated weights for policy 0, policy_version 1272882 (0.0010) [2023-12-26 09:45:16,248][123091] Updated weights for policy 0, policy_version 1272892 (0.0008) [2023-12-26 09:45:16,321][123091] Updated weights for policy 0, policy_version 1272902 (0.0009) [2023-12-26 09:45:16,373][123090] Updated weights for policy 1, policy_version 1263880 (0.0010) [2023-12-26 09:45:16,377][123091] Updated weights for policy 0, policy_version 1272912 (0.0006) [2023-12-26 09:45:16,445][123090] Updated weights for policy 1, policy_version 1263890 (0.0011) [2023-12-26 09:45:16,516][123090] Updated weights for policy 1, policy_version 1263900 (0.0011) [2023-12-26 09:45:17,132][123091] Updated weights for policy 0, policy_version 1272922 (0.0006) [2023-12-26 09:45:17,185][123091] Updated weights for policy 0, policy_version 1272932 (0.0009) [2023-12-26 09:45:17,248][123091] Updated weights for policy 0, policy_version 1272942 (0.0009) [2023-12-26 09:45:17,339][123090] Updated weights for policy 1, policy_version 1263910 (0.0011) [2023-12-26 09:45:17,410][123090] Updated weights for policy 1, policy_version 1263920 (0.0010) [2023-12-26 09:45:17,482][123090] Updated weights for policy 1, policy_version 1263930 (0.0011) [2023-12-26 09:45:18,029][123091] Updated weights for policy 0, policy_version 1272952 (0.0009) [2023-12-26 09:45:18,083][123091] Updated weights for policy 0, policy_version 1272962 (0.0009) [2023-12-26 09:45:18,145][123091] Updated weights for policy 0, policy_version 1272972 (0.0009) [2023-12-26 09:45:18,262][123090] Updated weights for policy 1, policy_version 1263940 (0.0009) [2023-12-26 09:45:18,327][123090] Updated weights for policy 1, policy_version 1263950 (0.0011) [2023-12-26 09:45:18,391][123090] Updated weights for policy 1, policy_version 1263960 (0.0008) [2023-12-26 09:45:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 649461760. Throughput: 0: 8860.8, 1: 8881.6. Samples: 649473092. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:18,785][121949] Avg episode reward: [(0, '6174.093'), (1, '5266.831')] [2023-12-26 09:45:19,059][123091] Updated weights for policy 0, policy_version 1272982 (0.0009) [2023-12-26 09:45:19,122][123091] Updated weights for policy 0, policy_version 1272992 (0.0009) [2023-12-26 09:45:19,140][123090] Updated weights for policy 1, policy_version 1263970 (0.0009) [2023-12-26 09:45:19,187][123091] Updated weights for policy 0, policy_version 1273002 (0.0007) [2023-12-26 09:45:19,197][123090] Updated weights for policy 1, policy_version 1263980 (0.0010) [2023-12-26 09:45:19,267][123090] Updated weights for policy 1, policy_version 1263990 (0.0010) [2023-12-26 09:45:19,339][123090] Updated weights for policy 1, policy_version 1264000 (0.0011) [2023-12-26 09:45:19,948][123091] Updated weights for policy 0, policy_version 1273012 (0.0008) [2023-12-26 09:45:20,014][123091] Updated weights for policy 0, policy_version 1273022 (0.0009) [2023-12-26 09:45:20,080][123091] Updated weights for policy 0, policy_version 1273032 (0.0010) [2023-12-26 09:45:20,218][123090] Updated weights for policy 1, policy_version 1264010 (0.0011) [2023-12-26 09:45:20,285][123090] Updated weights for policy 1, policy_version 1264020 (0.0011) [2023-12-26 09:45:20,355][123090] Updated weights for policy 1, policy_version 1264030 (0.0011) [2023-12-26 09:45:20,924][123091] Updated weights for policy 0, policy_version 1273042 (0.0009) [2023-12-26 09:45:20,998][123091] Updated weights for policy 0, policy_version 1273052 (0.0007) [2023-12-26 09:45:21,067][123091] Updated weights for policy 0, policy_version 1273062 (0.0007) [2023-12-26 09:45:21,139][123091] Updated weights for policy 0, policy_version 1273072 (0.0007) [2023-12-26 09:45:21,235][123090] Updated weights for policy 1, policy_version 1264040 (0.0010) [2023-12-26 09:45:21,308][123090] Updated weights for policy 1, policy_version 1264050 (0.0010) [2023-12-26 09:45:21,380][123090] Updated weights for policy 1, policy_version 1264060 (0.0013) [2023-12-26 09:45:21,947][123091] Updated weights for policy 0, policy_version 1273082 (0.0008) [2023-12-26 09:45:22,011][123091] Updated weights for policy 0, policy_version 1273092 (0.0008) [2023-12-26 09:45:22,073][123091] Updated weights for policy 0, policy_version 1273102 (0.0008) [2023-12-26 09:45:22,280][123090] Updated weights for policy 1, policy_version 1264070 (0.0010) [2023-12-26 09:45:22,345][123090] Updated weights for policy 1, policy_version 1264080 (0.0009) [2023-12-26 09:45:22,426][123090] Updated weights for policy 1, policy_version 1264090 (0.0009) [2023-12-26 09:45:22,923][123091] Updated weights for policy 0, policy_version 1273112 (0.0006) [2023-12-26 09:45:22,989][123091] Updated weights for policy 0, policy_version 1273122 (0.0007) [2023-12-26 09:45:23,052][123091] Updated weights for policy 0, policy_version 1273132 (0.0008) [2023-12-26 09:45:23,179][123090] Updated weights for policy 1, policy_version 1264100 (0.0008) [2023-12-26 09:45:23,235][123090] Updated weights for policy 1, policy_version 1264110 (0.0010) [2023-12-26 09:45:23,292][123090] Updated weights for policy 1, policy_version 1264120 (0.0009) [2023-12-26 09:45:23,775][123091] Updated weights for policy 0, policy_version 1273142 (0.0007) [2023-12-26 09:45:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 649543680. Throughput: 0: 8747.1, 1: 8859.0. Samples: 649523764. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:23,784][121949] Avg episode reward: [(0, '6301.139'), (1, '5176.363')] [2023-12-26 09:45:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001264128_323616768.pth... [2023-12-26 09:45:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001263104_323354624.pth [2023-12-26 09:45:23,839][123091] Updated weights for policy 0, policy_version 1273152 (0.0005) [2023-12-26 09:45:23,895][123091] Updated weights for policy 0, policy_version 1273162 (0.0005) [2023-12-26 09:45:23,921][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001273168_325935104.pth... [2023-12-26 09:45:23,925][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001272144_325672960.pth [2023-12-26 09:45:24,076][123090] Updated weights for policy 1, policy_version 1264130 (0.0010) [2023-12-26 09:45:24,132][123090] Updated weights for policy 1, policy_version 1264140 (0.0010) [2023-12-26 09:45:24,193][123090] Updated weights for policy 1, policy_version 1264150 (0.0011) [2023-12-26 09:45:24,260][123090] Updated weights for policy 1, policy_version 1264160 (0.0011) [2023-12-26 09:45:24,578][123091] Updated weights for policy 0, policy_version 1273172 (0.0008) [2023-12-26 09:45:24,637][123091] Updated weights for policy 0, policy_version 1273182 (0.0009) [2023-12-26 09:45:24,688][123091] Updated weights for policy 0, policy_version 1273192 (0.0009) [2023-12-26 09:45:25,077][123090] Updated weights for policy 1, policy_version 1264170 (0.0005) [2023-12-26 09:45:25,149][123090] Updated weights for policy 1, policy_version 1264180 (0.0006) [2023-12-26 09:45:25,201][123090] Updated weights for policy 1, policy_version 1264190 (0.0005) [2023-12-26 09:45:25,526][123091] Updated weights for policy 0, policy_version 1273202 (0.0009) [2023-12-26 09:45:25,583][123091] Updated weights for policy 0, policy_version 1273212 (0.0005) [2023-12-26 09:45:25,648][123091] Updated weights for policy 0, policy_version 1273222 (0.0005) [2023-12-26 09:45:25,725][123091] Updated weights for policy 0, policy_version 1273232 (0.0005) [2023-12-26 09:45:25,861][123090] Updated weights for policy 1, policy_version 1264200 (0.0005) [2023-12-26 09:45:25,921][123090] Updated weights for policy 1, policy_version 1264210 (0.0005) [2023-12-26 09:45:25,973][123090] Updated weights for policy 1, policy_version 1264220 (0.0005) [2023-12-26 09:45:26,361][123091] Updated weights for policy 0, policy_version 1273242 (0.0005) [2023-12-26 09:45:26,429][123091] Updated weights for policy 0, policy_version 1273252 (0.0005) [2023-12-26 09:45:26,484][123091] Updated weights for policy 0, policy_version 1273262 (0.0010) [2023-12-26 09:45:26,621][123090] Updated weights for policy 1, policy_version 1264230 (0.0008) [2023-12-26 09:45:26,684][123090] Updated weights for policy 1, policy_version 1264240 (0.0009) [2023-12-26 09:45:26,738][123090] Updated weights for policy 1, policy_version 1264250 (0.0009) [2023-12-26 09:45:27,269][123091] Updated weights for policy 0, policy_version 1273272 (0.0010) [2023-12-26 09:45:27,331][123091] Updated weights for policy 0, policy_version 1273282 (0.0010) [2023-12-26 09:45:27,393][123091] Updated weights for policy 0, policy_version 1273292 (0.0011) [2023-12-26 09:45:27,565][123090] Updated weights for policy 1, policy_version 1264260 (0.0009) [2023-12-26 09:45:27,617][123090] Updated weights for policy 1, policy_version 1264270 (0.0008) [2023-12-26 09:45:27,665][123090] Updated weights for policy 1, policy_version 1264280 (0.0009) [2023-12-26 09:45:28,185][123091] Updated weights for policy 0, policy_version 1273302 (0.0010) [2023-12-26 09:45:28,241][123091] Updated weights for policy 0, policy_version 1273312 (0.0010) [2023-12-26 09:45:28,297][123091] Updated weights for policy 0, policy_version 1273322 (0.0010) [2023-12-26 09:45:28,359][123090] Updated weights for policy 1, policy_version 1264290 (0.0008) [2023-12-26 09:45:28,432][123090] Updated weights for policy 1, policy_version 1264300 (0.0009) [2023-12-26 09:45:28,503][123090] Updated weights for policy 1, policy_version 1264310 (0.0011) [2023-12-26 09:45:28,573][123090] Updated weights for policy 1, policy_version 1264320 (0.0010) [2023-12-26 09:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 649641984. Throughput: 0: 8791.6, 1: 8927.6. Samples: 649633364. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:28,785][121949] Avg episode reward: [(0, '6326.355'), (1, '5203.885')] [2023-12-26 09:45:29,118][123091] Updated weights for policy 0, policy_version 1273332 (0.0011) [2023-12-26 09:45:29,180][123091] Updated weights for policy 0, policy_version 1273342 (0.0010) [2023-12-26 09:45:29,249][123091] Updated weights for policy 0, policy_version 1273352 (0.0010) [2023-12-26 09:45:29,300][123090] Updated weights for policy 1, policy_version 1264330 (0.0006) [2023-12-26 09:45:29,359][123090] Updated weights for policy 1, policy_version 1264340 (0.0008) [2023-12-26 09:45:29,418][123090] Updated weights for policy 1, policy_version 1264350 (0.0008) [2023-12-26 09:45:30,071][123091] Updated weights for policy 0, policy_version 1273362 (0.0011) [2023-12-26 09:45:30,132][123091] Updated weights for policy 0, policy_version 1273372 (0.0011) [2023-12-26 09:45:30,132][123090] Updated weights for policy 1, policy_version 1264360 (0.0010) [2023-12-26 09:45:30,191][123091] Updated weights for policy 0, policy_version 1273382 (0.0011) [2023-12-26 09:45:30,195][123090] Updated weights for policy 1, policy_version 1264370 (0.0011) [2023-12-26 09:45:30,248][123091] Updated weights for policy 0, policy_version 1273392 (0.0011) [2023-12-26 09:45:30,263][123090] Updated weights for policy 1, policy_version 1264380 (0.0011) [2023-12-26 09:45:31,051][123090] Updated weights for policy 1, policy_version 1264390 (0.0008) [2023-12-26 09:45:31,084][123091] Updated weights for policy 0, policy_version 1273402 (0.0011) [2023-12-26 09:45:31,113][123090] Updated weights for policy 1, policy_version 1264400 (0.0008) [2023-12-26 09:45:31,144][123091] Updated weights for policy 0, policy_version 1273412 (0.0011) [2023-12-26 09:45:31,173][123090] Updated weights for policy 1, policy_version 1264410 (0.0008) [2023-12-26 09:45:31,207][123091] Updated weights for policy 0, policy_version 1273422 (0.0011) [2023-12-26 09:45:31,938][123091] Updated weights for policy 0, policy_version 1273432 (0.0010) [2023-12-26 09:45:31,961][123090] Updated weights for policy 1, policy_version 1264420 (0.0009) [2023-12-26 09:45:31,996][123091] Updated weights for policy 0, policy_version 1273442 (0.0011) [2023-12-26 09:45:32,024][123090] Updated weights for policy 1, policy_version 1264430 (0.0010) [2023-12-26 09:45:32,059][123091] Updated weights for policy 0, policy_version 1273452 (0.0011) [2023-12-26 09:45:32,090][123090] Updated weights for policy 1, policy_version 1264440 (0.0010) [2023-12-26 09:45:32,845][123090] Updated weights for policy 1, policy_version 1264450 (0.0006) [2023-12-26 09:45:32,899][123091] Updated weights for policy 0, policy_version 1273462 (0.0009) [2023-12-26 09:45:32,911][123090] Updated weights for policy 1, policy_version 1264460 (0.0010) [2023-12-26 09:45:32,962][123090] Updated weights for policy 1, policy_version 1264470 (0.0009) [2023-12-26 09:45:32,963][123091] Updated weights for policy 0, policy_version 1273472 (0.0008) [2023-12-26 09:45:33,013][123090] Updated weights for policy 1, policy_version 1264480 (0.0007) [2023-12-26 09:45:33,023][123091] Updated weights for policy 0, policy_version 1273482 (0.0009) [2023-12-26 09:45:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 649723904. Throughput: 0: 8773.2, 1: 8965.6. Samples: 649740696. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:33,785][121949] Avg episode reward: [(0, '6332.870'), (1, '5289.223')] [2023-12-26 09:45:33,837][123090] Updated weights for policy 1, policy_version 1264490 (0.0009) [2023-12-26 09:45:33,843][123091] Updated weights for policy 0, policy_version 1273492 (0.0009) [2023-12-26 09:45:33,899][123090] Updated weights for policy 1, policy_version 1264500 (0.0009) [2023-12-26 09:45:33,909][123091] Updated weights for policy 0, policy_version 1273502 (0.0007) [2023-12-26 09:45:33,961][123090] Updated weights for policy 1, policy_version 1264510 (0.0008) [2023-12-26 09:45:33,968][123091] Updated weights for policy 0, policy_version 1273512 (0.0008) [2023-12-26 09:45:34,716][123091] Updated weights for policy 0, policy_version 1273522 (0.0008) [2023-12-26 09:45:34,781][123091] Updated weights for policy 0, policy_version 1273532 (0.0005) [2023-12-26 09:45:34,843][123091] Updated weights for policy 0, policy_version 1273542 (0.0007) [2023-12-26 09:45:34,850][123090] Updated weights for policy 1, policy_version 1264520 (0.0009) [2023-12-26 09:45:34,893][123091] Updated weights for policy 0, policy_version 1273552 (0.0008) [2023-12-26 09:45:34,895][123090] Updated weights for policy 1, policy_version 1264530 (0.0009) [2023-12-26 09:45:34,944][123090] Updated weights for policy 1, policy_version 1264540 (0.0009) [2023-12-26 09:45:35,592][123091] Updated weights for policy 0, policy_version 1273562 (0.0009) [2023-12-26 09:45:35,652][123091] Updated weights for policy 0, policy_version 1273572 (0.0010) [2023-12-26 09:45:35,686][123090] Updated weights for policy 1, policy_version 1264550 (0.0007) [2023-12-26 09:45:35,698][123091] Updated weights for policy 0, policy_version 1273582 (0.0008) [2023-12-26 09:45:35,755][123090] Updated weights for policy 1, policy_version 1264560 (0.0006) [2023-12-26 09:45:35,804][123090] Updated weights for policy 1, policy_version 1264570 (0.0009) [2023-12-26 09:45:36,553][123091] Updated weights for policy 0, policy_version 1273592 (0.0010) [2023-12-26 09:45:36,614][123091] Updated weights for policy 0, policy_version 1273602 (0.0009) [2023-12-26 09:45:36,621][123090] Updated weights for policy 1, policy_version 1264580 (0.0008) [2023-12-26 09:45:36,673][123091] Updated weights for policy 0, policy_version 1273612 (0.0009) [2023-12-26 09:45:36,690][123090] Updated weights for policy 1, policy_version 1264590 (0.0006) [2023-12-26 09:45:36,755][123090] Updated weights for policy 1, policy_version 1264600 (0.0008) [2023-12-26 09:45:37,448][123090] Updated weights for policy 1, policy_version 1264610 (0.0009) [2023-12-26 09:45:37,500][123090] Updated weights for policy 1, policy_version 1264620 (0.0009) [2023-12-26 09:45:37,550][123091] Updated weights for policy 0, policy_version 1273622 (0.0009) [2023-12-26 09:45:37,562][123090] Updated weights for policy 1, policy_version 1264630 (0.0007) [2023-12-26 09:45:37,614][123091] Updated weights for policy 0, policy_version 1273632 (0.0009) [2023-12-26 09:45:37,629][123090] Updated weights for policy 1, policy_version 1264640 (0.0008) [2023-12-26 09:45:37,674][123091] Updated weights for policy 0, policy_version 1273642 (0.0009) [2023-12-26 09:45:38,366][123090] Updated weights for policy 1, policy_version 1264650 (0.0007) [2023-12-26 09:45:38,434][123090] Updated weights for policy 1, policy_version 1264660 (0.0007) [2023-12-26 09:45:38,505][123090] Updated weights for policy 1, policy_version 1264670 (0.0005) [2023-12-26 09:45:38,539][123091] Updated weights for policy 0, policy_version 1273652 (0.0009) [2023-12-26 09:45:38,606][123091] Updated weights for policy 0, policy_version 1273662 (0.0009) [2023-12-26 09:45:38,668][123091] Updated weights for policy 0, policy_version 1273672 (0.0009) [2023-12-26 09:45:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 649822208. Throughput: 0: 8770.0, 1: 8975.3. Samples: 649793980. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:38,785][121949] Avg episode reward: [(0, '6358.476'), (1, '5358.312')] [2023-12-26 09:45:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001264672_323756032.pth... [2023-12-26 09:45:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001273680_326066176.pth... [2023-12-26 09:45:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001272656_325804032.pth [2023-12-26 09:45:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001263616_323485696.pth [2023-12-26 09:45:39,332][123090] Updated weights for policy 1, policy_version 1264680 (0.0009) [2023-12-26 09:45:39,391][123091] Updated weights for policy 0, policy_version 1273682 (0.0008) [2023-12-26 09:45:39,408][123090] Updated weights for policy 1, policy_version 1264690 (0.0008) [2023-12-26 09:45:39,464][123091] Updated weights for policy 0, policy_version 1273692 (0.0009) [2023-12-26 09:45:39,475][123090] Updated weights for policy 1, policy_version 1264700 (0.0007) [2023-12-26 09:45:39,524][123091] Updated weights for policy 0, policy_version 1273702 (0.0008) [2023-12-26 09:45:39,589][123091] Updated weights for policy 0, policy_version 1273712 (0.0010) [2023-12-26 09:45:40,382][123091] Updated weights for policy 0, policy_version 1273722 (0.0006) [2023-12-26 09:45:40,392][123090] Updated weights for policy 1, policy_version 1264710 (0.0008) [2023-12-26 09:45:40,444][123091] Updated weights for policy 0, policy_version 1273732 (0.0006) [2023-12-26 09:45:40,455][123090] Updated weights for policy 1, policy_version 1264720 (0.0008) [2023-12-26 09:45:40,515][123091] Updated weights for policy 0, policy_version 1273742 (0.0006) [2023-12-26 09:45:40,519][123090] Updated weights for policy 1, policy_version 1264730 (0.0008) [2023-12-26 09:45:41,250][123091] Updated weights for policy 0, policy_version 1273752 (0.0009) [2023-12-26 09:45:41,313][123091] Updated weights for policy 0, policy_version 1273762 (0.0009) [2023-12-26 09:45:41,351][123090] Updated weights for policy 1, policy_version 1264740 (0.0009) [2023-12-26 09:45:41,376][123091] Updated weights for policy 0, policy_version 1273772 (0.0009) [2023-12-26 09:45:41,430][123090] Updated weights for policy 1, policy_version 1264750 (0.0008) [2023-12-26 09:45:41,494][123090] Updated weights for policy 1, policy_version 1264760 (0.0009) [2023-12-26 09:45:42,220][123091] Updated weights for policy 0, policy_version 1273782 (0.0010) [2023-12-26 09:45:42,261][123090] Updated weights for policy 1, policy_version 1264770 (0.0009) [2023-12-26 09:45:42,291][123091] Updated weights for policy 0, policy_version 1273792 (0.0008) [2023-12-26 09:45:42,326][123090] Updated weights for policy 1, policy_version 1264780 (0.0008) [2023-12-26 09:45:42,355][123091] Updated weights for policy 0, policy_version 1273802 (0.0008) [2023-12-26 09:45:42,391][123090] Updated weights for policy 1, policy_version 1264790 (0.0009) [2023-12-26 09:45:42,447][123090] Updated weights for policy 1, policy_version 1264800 (0.0010) [2023-12-26 09:45:43,197][123091] Updated weights for policy 0, policy_version 1273812 (0.0008) [2023-12-26 09:45:43,257][123091] Updated weights for policy 0, policy_version 1273822 (0.0010) [2023-12-26 09:45:43,298][123090] Updated weights for policy 1, policy_version 1264810 (0.0009) [2023-12-26 09:45:43,322][123091] Updated weights for policy 0, policy_version 1273832 (0.0008) [2023-12-26 09:45:43,362][123090] Updated weights for policy 1, policy_version 1264820 (0.0009) [2023-12-26 09:45:43,420][123090] Updated weights for policy 1, policy_version 1264830 (0.0009) [2023-12-26 09:45:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17800.3). Total num frames: 649904128. Throughput: 0: 8740.9, 1: 8880.2. Samples: 649898520. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:43,784][121949] Avg episode reward: [(0, '6468.428'), (1, '5380.741')] [2023-12-26 09:45:44,085][123090] Updated weights for policy 1, policy_version 1264840 (0.0006) [2023-12-26 09:45:44,090][123091] Updated weights for policy 0, policy_version 1273842 (0.0007) [2023-12-26 09:45:44,151][123090] Updated weights for policy 1, policy_version 1264850 (0.0006) [2023-12-26 09:45:44,160][123091] Updated weights for policy 0, policy_version 1273852 (0.0007) [2023-12-26 09:45:44,221][123090] Updated weights for policy 1, policy_version 1264860 (0.0006) [2023-12-26 09:45:44,224][123091] Updated weights for policy 0, policy_version 1273862 (0.0009) [2023-12-26 09:45:44,288][123091] Updated weights for policy 0, policy_version 1273872 (0.0006) [2023-12-26 09:45:44,927][123091] Updated weights for policy 0, policy_version 1273882 (0.0008) [2023-12-26 09:45:44,952][123090] Updated weights for policy 1, policy_version 1264870 (0.0006) [2023-12-26 09:45:44,989][123091] Updated weights for policy 0, policy_version 1273892 (0.0008) [2023-12-26 09:45:45,001][123090] Updated weights for policy 1, policy_version 1264880 (0.0008) [2023-12-26 09:45:45,051][123091] Updated weights for policy 0, policy_version 1273902 (0.0008) [2023-12-26 09:45:45,063][123090] Updated weights for policy 1, policy_version 1264890 (0.0008) [2023-12-26 09:45:45,802][123091] Updated weights for policy 0, policy_version 1273912 (0.0010) [2023-12-26 09:45:45,865][123091] Updated weights for policy 0, policy_version 1273922 (0.0011) [2023-12-26 09:45:45,931][123091] Updated weights for policy 0, policy_version 1273932 (0.0007) [2023-12-26 09:45:45,951][123090] Updated weights for policy 1, policy_version 1264900 (0.0009) [2023-12-26 09:45:46,003][123090] Updated weights for policy 1, policy_version 1264910 (0.0010) [2023-12-26 09:45:46,063][123090] Updated weights for policy 1, policy_version 1264920 (0.0010) [2023-12-26 09:45:46,745][123091] Updated weights for policy 0, policy_version 1273942 (0.0008) [2023-12-26 09:45:46,797][123091] Updated weights for policy 0, policy_version 1273952 (0.0009) [2023-12-26 09:45:46,860][123091] Updated weights for policy 0, policy_version 1273962 (0.0009) [2023-12-26 09:45:46,897][123090] Updated weights for policy 1, policy_version 1264930 (0.0010) [2023-12-26 09:45:46,944][123090] Updated weights for policy 1, policy_version 1264940 (0.0010) [2023-12-26 09:45:46,996][123090] Updated weights for policy 1, policy_version 1264950 (0.0010) [2023-12-26 09:45:47,055][123090] Updated weights for policy 1, policy_version 1264960 (0.0010) [2023-12-26 09:45:47,672][123091] Updated weights for policy 0, policy_version 1273972 (0.0007) [2023-12-26 09:45:47,724][123091] Updated weights for policy 0, policy_version 1273982 (0.0006) [2023-12-26 09:45:47,777][123091] Updated weights for policy 0, policy_version 1273992 (0.0007) [2023-12-26 09:45:47,783][123090] Updated weights for policy 1, policy_version 1264970 (0.0010) [2023-12-26 09:45:47,833][123090] Updated weights for policy 1, policy_version 1264980 (0.0008) [2023-12-26 09:45:47,894][123090] Updated weights for policy 1, policy_version 1264990 (0.0010) [2023-12-26 09:45:48,568][123091] Updated weights for policy 0, policy_version 1274002 (0.0007) [2023-12-26 09:45:48,633][123091] Updated weights for policy 0, policy_version 1274012 (0.0006) [2023-12-26 09:45:48,647][123090] Updated weights for policy 1, policy_version 1265000 (0.0007) [2023-12-26 09:45:48,701][123090] Updated weights for policy 1, policy_version 1265010 (0.0009) [2023-12-26 09:45:48,705][123091] Updated weights for policy 0, policy_version 1274022 (0.0005) [2023-12-26 09:45:48,762][123090] Updated weights for policy 1, policy_version 1265020 (0.0011) [2023-12-26 09:45:48,778][123091] Updated weights for policy 0, policy_version 1274032 (0.0008) [2023-12-26 09:45:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 650002432. Throughput: 0: 8785.2, 1: 8907.8. Samples: 650007408. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:48,784][121949] Avg episode reward: [(0, '6459.942'), (1, '5533.542')] [2023-12-26 09:45:49,444][123091] Updated weights for policy 0, policy_version 1274042 (0.0008) [2023-12-26 09:45:49,507][123090] Updated weights for policy 1, policy_version 1265030 (0.0009) [2023-12-26 09:45:49,513][123091] Updated weights for policy 0, policy_version 1274052 (0.0008) [2023-12-26 09:45:49,564][123091] Updated weights for policy 0, policy_version 1274062 (0.0008) [2023-12-26 09:45:49,569][123090] Updated weights for policy 1, policy_version 1265040 (0.0008) [2023-12-26 09:45:49,644][123090] Updated weights for policy 1, policy_version 1265050 (0.0008) [2023-12-26 09:45:50,380][123091] Updated weights for policy 0, policy_version 1274072 (0.0009) [2023-12-26 09:45:50,414][123090] Updated weights for policy 1, policy_version 1265060 (0.0008) [2023-12-26 09:45:50,446][123091] Updated weights for policy 0, policy_version 1274082 (0.0007) [2023-12-26 09:45:50,465][123090] Updated weights for policy 1, policy_version 1265070 (0.0010) [2023-12-26 09:45:50,494][123091] Updated weights for policy 0, policy_version 1274092 (0.0005) [2023-12-26 09:45:50,517][123090] Updated weights for policy 1, policy_version 1265080 (0.0010) [2023-12-26 09:45:51,321][123090] Updated weights for policy 1, policy_version 1265090 (0.0010) [2023-12-26 09:45:51,366][123091] Updated weights for policy 0, policy_version 1274102 (0.0007) [2023-12-26 09:45:51,391][123090] Updated weights for policy 1, policy_version 1265100 (0.0008) [2023-12-26 09:45:51,441][123091] Updated weights for policy 0, policy_version 1274113 (0.0009) [2023-12-26 09:45:51,448][123090] Updated weights for policy 1, policy_version 1265110 (0.0007) [2023-12-26 09:45:51,500][123091] Updated weights for policy 0, policy_version 1274123 (0.0009) [2023-12-26 09:45:51,501][123090] Updated weights for policy 1, policy_version 1265120 (0.0009) [2023-12-26 09:45:52,308][123091] Updated weights for policy 0, policy_version 1274133 (0.0010) [2023-12-26 09:45:52,319][123090] Updated weights for policy 1, policy_version 1265130 (0.0009) [2023-12-26 09:45:52,380][123091] Updated weights for policy 0, policy_version 1274143 (0.0011) [2023-12-26 09:45:52,385][123090] Updated weights for policy 1, policy_version 1265140 (0.0010) [2023-12-26 09:45:52,439][123091] Updated weights for policy 0, policy_version 1274153 (0.0011) [2023-12-26 09:45:52,442][123090] Updated weights for policy 1, policy_version 1265150 (0.0010) [2023-12-26 09:45:53,103][123091] Updated weights for policy 0, policy_version 1274163 (0.0009) [2023-12-26 09:45:53,171][123091] Updated weights for policy 0, policy_version 1274173 (0.0005) [2023-12-26 09:45:53,238][123091] Updated weights for policy 0, policy_version 1274183 (0.0005) [2023-12-26 09:45:53,259][123090] Updated weights for policy 1, policy_version 1265160 (0.0010) [2023-12-26 09:45:53,333][123090] Updated weights for policy 1, policy_version 1265170 (0.0011) [2023-12-26 09:45:53,395][123090] Updated weights for policy 1, policy_version 1265180 (0.0010) [2023-12-26 09:45:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.4). Total num frames: 650084352. Throughput: 0: 8786.9, 1: 8904.0. Samples: 650060528. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:53,785][121949] Avg episode reward: [(0, '6319.458'), (1, '5652.594')] [2023-12-26 09:45:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001274192_326197248.pth... [2023-12-26 09:45:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001265184_323887104.pth... [2023-12-26 09:45:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001273168_325935104.pth [2023-12-26 09:45:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001264128_323616768.pth [2023-12-26 09:45:53,972][123091] Updated weights for policy 0, policy_version 1274193 (0.0006) [2023-12-26 09:45:54,023][123091] Updated weights for policy 0, policy_version 1274203 (0.0010) [2023-12-26 09:45:54,066][123091] Updated weights for policy 0, policy_version 1274213 (0.0010) [2023-12-26 09:45:54,117][123091] Updated weights for policy 0, policy_version 1274223 (0.0010) [2023-12-26 09:45:54,201][123090] Updated weights for policy 1, policy_version 1265190 (0.0010) [2023-12-26 09:45:54,265][123090] Updated weights for policy 1, policy_version 1265200 (0.0010) [2023-12-26 09:45:54,331][123090] Updated weights for policy 1, policy_version 1265210 (0.0011) [2023-12-26 09:45:54,903][123091] Updated weights for policy 0, policy_version 1274233 (0.0009) [2023-12-26 09:45:54,971][123091] Updated weights for policy 0, policy_version 1274243 (0.0008) [2023-12-26 09:45:55,044][123091] Updated weights for policy 0, policy_version 1274253 (0.0006) [2023-12-26 09:45:55,086][123090] Updated weights for policy 1, policy_version 1265220 (0.0010) [2023-12-26 09:45:55,147][123090] Updated weights for policy 1, policy_version 1265230 (0.0006) [2023-12-26 09:45:55,211][123090] Updated weights for policy 1, policy_version 1265240 (0.0006) [2023-12-26 09:45:55,776][123091] Updated weights for policy 0, policy_version 1274263 (0.0010) [2023-12-26 09:45:55,843][123091] Updated weights for policy 0, policy_version 1274273 (0.0010) [2023-12-26 09:45:55,910][123091] Updated weights for policy 0, policy_version 1274283 (0.0010) [2023-12-26 09:45:56,024][123090] Updated weights for policy 1, policy_version 1265250 (0.0008) [2023-12-26 09:45:56,090][123090] Updated weights for policy 1, policy_version 1265260 (0.0010) [2023-12-26 09:45:56,161][123090] Updated weights for policy 1, policy_version 1265270 (0.0010) [2023-12-26 09:45:56,227][123090] Updated weights for policy 1, policy_version 1265280 (0.0010) [2023-12-26 09:45:56,584][123091] Updated weights for policy 0, policy_version 1274293 (0.0007) [2023-12-26 09:45:56,653][123091] Updated weights for policy 0, policy_version 1274303 (0.0005) [2023-12-26 09:45:56,720][123091] Updated weights for policy 0, policy_version 1274313 (0.0005) [2023-12-26 09:45:57,124][123090] Updated weights for policy 1, policy_version 1265290 (0.0010) [2023-12-26 09:45:57,190][123090] Updated weights for policy 1, policy_version 1265300 (0.0010) [2023-12-26 09:45:57,252][123090] Updated weights for policy 1, policy_version 1265310 (0.0010) [2023-12-26 09:45:57,346][123091] Updated weights for policy 0, policy_version 1274323 (0.0005) [2023-12-26 09:45:57,403][123091] Updated weights for policy 0, policy_version 1274333 (0.0006) [2023-12-26 09:45:57,451][123091] Updated weights for policy 0, policy_version 1274343 (0.0005) [2023-12-26 09:45:57,963][123090] Updated weights for policy 1, policy_version 1265320 (0.0008) [2023-12-26 09:45:58,029][123090] Updated weights for policy 1, policy_version 1265330 (0.0008) [2023-12-26 09:45:58,064][123091] Updated weights for policy 0, policy_version 1274353 (0.0006) [2023-12-26 09:45:58,098][123090] Updated weights for policy 1, policy_version 1265340 (0.0007) [2023-12-26 09:45:58,129][123091] Updated weights for policy 0, policy_version 1274363 (0.0009) [2023-12-26 09:45:58,191][123091] Updated weights for policy 0, policy_version 1274373 (0.0011) [2023-12-26 09:45:58,253][123091] Updated weights for policy 0, policy_version 1274383 (0.0010) [2023-12-26 09:45:58,786][121949] Fps is (10 sec: 17199.6, 60 sec: 17748.8, 300 sec: 17772.4). Total num frames: 650174464. Throughput: 0: 8968.7, 1: 8885.0. Samples: 650170280. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:45:58,787][121949] Avg episode reward: [(0, '6283.800'), (1, '5677.794')] [2023-12-26 09:45:58,933][123090] Updated weights for policy 1, policy_version 1265350 (0.0009) [2023-12-26 09:45:59,000][123090] Updated weights for policy 1, policy_version 1265360 (0.0009) [2023-12-26 09:45:59,067][123090] Updated weights for policy 1, policy_version 1265370 (0.0010) [2023-12-26 09:45:59,204][123091] Updated weights for policy 0, policy_version 1274393 (0.0010) [2023-12-26 09:45:59,282][123091] Updated weights for policy 0, policy_version 1274403 (0.0008) [2023-12-26 09:45:59,346][123091] Updated weights for policy 0, policy_version 1274413 (0.0010) [2023-12-26 09:45:59,916][123090] Updated weights for policy 1, policy_version 1265380 (0.0009) [2023-12-26 09:45:59,979][123090] Updated weights for policy 1, policy_version 1265390 (0.0006) [2023-12-26 09:46:00,035][123090] Updated weights for policy 1, policy_version 1265400 (0.0008) [2023-12-26 09:46:00,157][123091] Updated weights for policy 0, policy_version 1274423 (0.0010) [2023-12-26 09:46:00,206][123091] Updated weights for policy 0, policy_version 1274433 (0.0009) [2023-12-26 09:46:00,259][123091] Updated weights for policy 0, policy_version 1274443 (0.0009) [2023-12-26 09:46:00,858][123090] Updated weights for policy 1, policy_version 1265410 (0.0008) [2023-12-26 09:46:00,910][123090] Updated weights for policy 1, policy_version 1265420 (0.0005) [2023-12-26 09:46:00,972][123090] Updated weights for policy 1, policy_version 1265430 (0.0005) [2023-12-26 09:46:01,029][123090] Updated weights for policy 1, policy_version 1265440 (0.0005) [2023-12-26 09:46:01,049][123091] Updated weights for policy 0, policy_version 1274453 (0.0008) [2023-12-26 09:46:01,120][123091] Updated weights for policy 0, policy_version 1274463 (0.0008) [2023-12-26 09:46:01,187][123091] Updated weights for policy 0, policy_version 1274473 (0.0010) [2023-12-26 09:46:01,773][123090] Updated weights for policy 1, policy_version 1265450 (0.0009) [2023-12-26 09:46:01,828][123090] Updated weights for policy 1, policy_version 1265460 (0.0009) [2023-12-26 09:46:01,895][123090] Updated weights for policy 1, policy_version 1265470 (0.0008) [2023-12-26 09:46:02,003][123091] Updated weights for policy 0, policy_version 1274483 (0.0010) [2023-12-26 09:46:02,059][123091] Updated weights for policy 0, policy_version 1274493 (0.0011) [2023-12-26 09:46:02,122][123091] Updated weights for policy 0, policy_version 1274503 (0.0011) [2023-12-26 09:46:02,657][123090] Updated weights for policy 1, policy_version 1265480 (0.0006) [2023-12-26 09:46:02,725][123090] Updated weights for policy 1, policy_version 1265490 (0.0005) [2023-12-26 09:46:02,789][123090] Updated weights for policy 1, policy_version 1265500 (0.0005) [2023-12-26 09:46:02,901][123091] Updated weights for policy 0, policy_version 1274513 (0.0011) [2023-12-26 09:46:02,965][123091] Updated weights for policy 0, policy_version 1274523 (0.0011) [2023-12-26 09:46:03,032][123091] Updated weights for policy 0, policy_version 1274533 (0.0011) [2023-12-26 09:46:03,102][123091] Updated weights for policy 0, policy_version 1274543 (0.0011) [2023-12-26 09:46:03,546][123090] Updated weights for policy 1, policy_version 1265510 (0.0008) [2023-12-26 09:46:03,605][123090] Updated weights for policy 1, policy_version 1265520 (0.0010) [2023-12-26 09:46:03,656][123090] Updated weights for policy 1, policy_version 1265530 (0.0010) [2023-12-26 09:46:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 650264576. Throughput: 0: 8958.8, 1: 8877.9. Samples: 650275744. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:03,785][121949] Avg episode reward: [(0, '6369.981'), (1, '5688.032')] [2023-12-26 09:46:03,818][123091] Updated weights for policy 0, policy_version 1274553 (0.0007) [2023-12-26 09:46:03,879][123091] Updated weights for policy 0, policy_version 1274563 (0.0010) [2023-12-26 09:46:03,933][123091] Updated weights for policy 0, policy_version 1274573 (0.0010) [2023-12-26 09:46:04,405][123090] Updated weights for policy 1, policy_version 1265540 (0.0008) [2023-12-26 09:46:04,470][123090] Updated weights for policy 1, policy_version 1265550 (0.0006) [2023-12-26 09:46:04,544][123090] Updated weights for policy 1, policy_version 1265560 (0.0008) [2023-12-26 09:46:04,816][123091] Updated weights for policy 0, policy_version 1274584 (0.0011) [2023-12-26 09:46:04,870][123091] Updated weights for policy 0, policy_version 1274594 (0.0010) [2023-12-26 09:46:04,925][123091] Updated weights for policy 0, policy_version 1274605 (0.0010) [2023-12-26 09:46:05,154][123090] Updated weights for policy 1, policy_version 1265570 (0.0005) [2023-12-26 09:46:05,225][123090] Updated weights for policy 1, policy_version 1265580 (0.0005) [2023-12-26 09:46:05,284][123090] Updated weights for policy 1, policy_version 1265590 (0.0005) [2023-12-26 09:46:05,341][123090] Updated weights for policy 1, policy_version 1265600 (0.0005) [2023-12-26 09:46:05,913][123091] Updated weights for policy 0, policy_version 1274616 (0.0010) [2023-12-26 09:46:05,964][123091] Updated weights for policy 0, policy_version 1274627 (0.0010) [2023-12-26 09:46:05,972][123090] Updated weights for policy 1, policy_version 1265610 (0.0005) [2023-12-26 09:46:06,014][123091] Updated weights for policy 0, policy_version 1274637 (0.0009) [2023-12-26 09:46:06,045][123090] Updated weights for policy 1, policy_version 1265620 (0.0005) [2023-12-26 09:46:06,117][123090] Updated weights for policy 1, policy_version 1265630 (0.0006) [2023-12-26 09:46:06,778][123090] Updated weights for policy 1, policy_version 1265640 (0.0008) [2023-12-26 09:46:06,844][123090] Updated weights for policy 1, policy_version 1265650 (0.0010) [2023-12-26 09:46:06,908][123090] Updated weights for policy 1, policy_version 1265660 (0.0010) [2023-12-26 09:46:06,944][123091] Updated weights for policy 0, policy_version 1274647 (0.0010) [2023-12-26 09:46:07,004][123091] Updated weights for policy 0, policy_version 1274657 (0.0009) [2023-12-26 09:46:07,069][123091] Updated weights for policy 0, policy_version 1274667 (0.0010) [2023-12-26 09:46:07,645][123090] Updated weights for policy 1, policy_version 1265670 (0.0010) [2023-12-26 09:46:07,700][123090] Updated weights for policy 1, policy_version 1265680 (0.0007) [2023-12-26 09:46:07,762][123090] Updated weights for policy 1, policy_version 1265690 (0.0006) [2023-12-26 09:46:07,984][123091] Updated weights for policy 0, policy_version 1274677 (0.0009) [2023-12-26 09:46:08,038][123091] Updated weights for policy 0, policy_version 1274687 (0.0010) [2023-12-26 09:46:08,096][123091] Updated weights for policy 0, policy_version 1274697 (0.0010) [2023-12-26 09:46:08,434][123090] Updated weights for policy 1, policy_version 1265700 (0.0007) [2023-12-26 09:46:08,498][123090] Updated weights for policy 1, policy_version 1265710 (0.0010) [2023-12-26 09:46:08,557][123090] Updated weights for policy 1, policy_version 1265720 (0.0010) [2023-12-26 09:46:08,784][121949] Fps is (10 sec: 18025.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 650354688. Throughput: 0: 8917.9, 1: 8995.6. Samples: 650329876. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:08,785][121949] Avg episode reward: [(0, '6358.616'), (1, '5740.911')] [2023-12-26 09:46:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001274704_326328320.pth... [2023-12-26 09:46:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001265728_324026368.pth... [2023-12-26 09:46:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001273680_326066176.pth [2023-12-26 09:46:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001264672_323756032.pth [2023-12-26 09:46:08,993][123091] Updated weights for policy 0, policy_version 1274707 (0.0010) [2023-12-26 09:46:09,046][123091] Updated weights for policy 0, policy_version 1274717 (0.0009) [2023-12-26 09:46:09,100][123091] Updated weights for policy 0, policy_version 1274727 (0.0009) [2023-12-26 09:46:09,376][123090] Updated weights for policy 1, policy_version 1265730 (0.0010) [2023-12-26 09:46:09,473][123090] Updated weights for policy 1, policy_version 1265740 (0.0007) [2023-12-26 09:46:09,539][123090] Updated weights for policy 1, policy_version 1265750 (0.0005) [2023-12-26 09:46:09,602][123090] Updated weights for policy 1, policy_version 1265760 (0.0007) [2023-12-26 09:46:10,111][123091] Updated weights for policy 0, policy_version 1274737 (0.0009) [2023-12-26 09:46:10,164][123091] Updated weights for policy 0, policy_version 1274747 (0.0009) [2023-12-26 09:46:10,225][123091] Updated weights for policy 0, policy_version 1274757 (0.0009) [2023-12-26 09:46:10,277][123091] Updated weights for policy 0, policy_version 1274767 (0.0008) [2023-12-26 09:46:10,292][123090] Updated weights for policy 1, policy_version 1265770 (0.0008) [2023-12-26 09:46:10,354][123090] Updated weights for policy 1, policy_version 1265780 (0.0010) [2023-12-26 09:46:10,410][123090] Updated weights for policy 1, policy_version 1265790 (0.0010) [2023-12-26 09:46:11,137][123091] Updated weights for policy 0, policy_version 1274777 (0.0009) [2023-12-26 09:46:11,205][123091] Updated weights for policy 0, policy_version 1274787 (0.0008) [2023-12-26 09:46:11,249][123090] Updated weights for policy 1, policy_version 1265800 (0.0011) [2023-12-26 09:46:11,270][123091] Updated weights for policy 0, policy_version 1274797 (0.0008) [2023-12-26 09:46:11,309][123090] Updated weights for policy 1, policy_version 1265810 (0.0010) [2023-12-26 09:46:11,380][123090] Updated weights for policy 1, policy_version 1265820 (0.0009) [2023-12-26 09:46:12,171][123091] Updated weights for policy 0, policy_version 1274807 (0.0009) [2023-12-26 09:46:12,181][123090] Updated weights for policy 1, policy_version 1265830 (0.0008) [2023-12-26 09:46:12,240][123091] Updated weights for policy 0, policy_version 1274817 (0.0008) [2023-12-26 09:46:12,245][123090] Updated weights for policy 1, policy_version 1265840 (0.0010) [2023-12-26 09:46:12,304][123091] Updated weights for policy 0, policy_version 1274827 (0.0007) [2023-12-26 09:46:12,311][123090] Updated weights for policy 1, policy_version 1265850 (0.0009) [2023-12-26 09:46:13,091][123090] Updated weights for policy 1, policy_version 1265860 (0.0008) [2023-12-26 09:46:13,153][123090] Updated weights for policy 1, policy_version 1265870 (0.0010) [2023-12-26 09:46:13,173][123091] Updated weights for policy 0, policy_version 1274837 (0.0009) [2023-12-26 09:46:13,220][123090] Updated weights for policy 1, policy_version 1265880 (0.0009) [2023-12-26 09:46:13,230][123091] Updated weights for policy 0, policy_version 1274847 (0.0008) [2023-12-26 09:46:13,289][123091] Updated weights for policy 0, policy_version 1274857 (0.0009) [2023-12-26 09:46:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 650436608. Throughput: 0: 8766.6, 1: 8974.9. Samples: 650431732. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:13,785][121949] Avg episode reward: [(0, '6306.298'), (1, '5587.557')] [2023-12-26 09:46:13,975][123090] Updated weights for policy 1, policy_version 1265890 (0.0008) [2023-12-26 09:46:14,030][123091] Updated weights for policy 0, policy_version 1274867 (0.0008) [2023-12-26 09:46:14,031][123090] Updated weights for policy 1, policy_version 1265900 (0.0005) [2023-12-26 09:46:14,085][123090] Updated weights for policy 1, policy_version 1265910 (0.0005) [2023-12-26 09:46:14,099][123091] Updated weights for policy 0, policy_version 1274877 (0.0006) [2023-12-26 09:46:14,140][123090] Updated weights for policy 1, policy_version 1265920 (0.0005) [2023-12-26 09:46:14,162][123091] Updated weights for policy 0, policy_version 1274887 (0.0006) [2023-12-26 09:46:14,851][123090] Updated weights for policy 1, policy_version 1265930 (0.0009) [2023-12-26 09:46:14,902][123090] Updated weights for policy 1, policy_version 1265940 (0.0010) [2023-12-26 09:46:14,904][123091] Updated weights for policy 0, policy_version 1274897 (0.0006) [2023-12-26 09:46:14,961][123090] Updated weights for policy 1, policy_version 1265950 (0.0008) [2023-12-26 09:46:14,964][123091] Updated weights for policy 0, policy_version 1274907 (0.0008) [2023-12-26 09:46:15,029][123091] Updated weights for policy 0, policy_version 1274917 (0.0010) [2023-12-26 09:46:15,089][123091] Updated weights for policy 0, policy_version 1274927 (0.0011) [2023-12-26 09:46:15,720][123090] Updated weights for policy 1, policy_version 1265960 (0.0006) [2023-12-26 09:46:15,773][123090] Updated weights for policy 1, policy_version 1265970 (0.0007) [2023-12-26 09:46:15,829][123090] Updated weights for policy 1, policy_version 1265980 (0.0009) [2023-12-26 09:46:15,927][123091] Updated weights for policy 0, policy_version 1274937 (0.0011) [2023-12-26 09:46:15,999][123091] Updated weights for policy 0, policy_version 1274947 (0.0010) [2023-12-26 09:46:16,065][123091] Updated weights for policy 0, policy_version 1274957 (0.0011) [2023-12-26 09:46:16,641][123090] Updated weights for policy 1, policy_version 1265990 (0.0007) [2023-12-26 09:46:16,697][123090] Updated weights for policy 1, policy_version 1266000 (0.0009) [2023-12-26 09:46:16,751][123090] Updated weights for policy 1, policy_version 1266010 (0.0009) [2023-12-26 09:46:16,860][123091] Updated weights for policy 0, policy_version 1274967 (0.0007) [2023-12-26 09:46:16,931][123091] Updated weights for policy 0, policy_version 1274977 (0.0007) [2023-12-26 09:46:16,987][123091] Updated weights for policy 0, policy_version 1274987 (0.0008) [2023-12-26 09:46:17,611][123090] Updated weights for policy 1, policy_version 1266020 (0.0008) [2023-12-26 09:46:17,643][123091] Updated weights for policy 0, policy_version 1274997 (0.0008) [2023-12-26 09:46:17,668][123090] Updated weights for policy 1, policy_version 1266030 (0.0005) [2023-12-26 09:46:17,702][123091] Updated weights for policy 0, policy_version 1275007 (0.0005) [2023-12-26 09:46:17,717][123090] Updated weights for policy 1, policy_version 1266040 (0.0005) [2023-12-26 09:46:17,760][123091] Updated weights for policy 0, policy_version 1275017 (0.0010) [2023-12-26 09:46:18,419][123091] Updated weights for policy 0, policy_version 1275027 (0.0006) [2023-12-26 09:46:18,478][123091] Updated weights for policy 0, policy_version 1275037 (0.0006) [2023-12-26 09:46:18,529][123090] Updated weights for policy 1, policy_version 1266050 (0.0006) [2023-12-26 09:46:18,547][123091] Updated weights for policy 0, policy_version 1275047 (0.0006) [2023-12-26 09:46:18,590][123090] Updated weights for policy 1, policy_version 1266060 (0.0009) [2023-12-26 09:46:18,649][123090] Updated weights for policy 1, policy_version 1266070 (0.0009) [2023-12-26 09:46:18,723][123090] Updated weights for policy 1, policy_version 1266080 (0.0009) [2023-12-26 09:46:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 650534912. Throughput: 0: 8818.1, 1: 8955.7. Samples: 650540520. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:18,785][121949] Avg episode reward: [(0, '6322.051'), (1, '5625.913')] [2023-12-26 09:46:19,215][123091] Updated weights for policy 0, policy_version 1275057 (0.0006) [2023-12-26 09:46:19,281][123091] Updated weights for policy 0, policy_version 1275067 (0.0010) [2023-12-26 09:46:19,336][123091] Updated weights for policy 0, policy_version 1275077 (0.0011) [2023-12-26 09:46:19,410][123091] Updated weights for policy 0, policy_version 1275087 (0.0010) [2023-12-26 09:46:19,577][123090] Updated weights for policy 1, policy_version 1266090 (0.0010) [2023-12-26 09:46:19,636][123090] Updated weights for policy 1, policy_version 1266100 (0.0010) [2023-12-26 09:46:19,699][123090] Updated weights for policy 1, policy_version 1266110 (0.0009) [2023-12-26 09:46:20,112][123091] Updated weights for policy 0, policy_version 1275097 (0.0008) [2023-12-26 09:46:20,181][123091] Updated weights for policy 0, policy_version 1275107 (0.0008) [2023-12-26 09:46:20,244][123091] Updated weights for policy 0, policy_version 1275117 (0.0008) [2023-12-26 09:46:20,600][123090] Updated weights for policy 1, policy_version 1266120 (0.0009) [2023-12-26 09:46:20,666][123090] Updated weights for policy 1, policy_version 1266130 (0.0010) [2023-12-26 09:46:20,732][123090] Updated weights for policy 1, policy_version 1266140 (0.0010) [2023-12-26 09:46:20,979][123091] Updated weights for policy 0, policy_version 1275127 (0.0010) [2023-12-26 09:46:21,045][123091] Updated weights for policy 0, policy_version 1275137 (0.0009) [2023-12-26 09:46:21,114][123091] Updated weights for policy 0, policy_version 1275147 (0.0009) [2023-12-26 09:46:21,657][123090] Updated weights for policy 1, policy_version 1266150 (0.0008) [2023-12-26 09:46:21,731][123090] Updated weights for policy 1, policy_version 1266160 (0.0008) [2023-12-26 09:46:21,799][123090] Updated weights for policy 1, policy_version 1266170 (0.0008) [2023-12-26 09:46:21,953][123091] Updated weights for policy 0, policy_version 1275157 (0.0011) [2023-12-26 09:46:22,013][123091] Updated weights for policy 0, policy_version 1275167 (0.0011) [2023-12-26 09:46:22,083][123091] Updated weights for policy 0, policy_version 1275177 (0.0011) [2023-12-26 09:46:22,610][123090] Updated weights for policy 1, policy_version 1266180 (0.0008) [2023-12-26 09:46:22,675][123090] Updated weights for policy 1, policy_version 1266190 (0.0009) [2023-12-26 09:46:22,740][123090] Updated weights for policy 1, policy_version 1266200 (0.0009) [2023-12-26 09:46:22,912][123091] Updated weights for policy 0, policy_version 1275187 (0.0011) [2023-12-26 09:46:22,966][123091] Updated weights for policy 0, policy_version 1275197 (0.0010) [2023-12-26 09:46:23,018][123091] Updated weights for policy 0, policy_version 1275207 (0.0010) [2023-12-26 09:46:23,563][123090] Updated weights for policy 1, policy_version 1266210 (0.0008) [2023-12-26 09:46:23,621][123090] Updated weights for policy 1, policy_version 1266220 (0.0005) [2023-12-26 09:46:23,676][123090] Updated weights for policy 1, policy_version 1266230 (0.0005) [2023-12-26 09:46:23,730][123090] Updated weights for policy 1, policy_version 1266240 (0.0005) [2023-12-26 09:46:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 650616832. Throughput: 0: 8831.3, 1: 8912.9. Samples: 650592468. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:23,784][121949] Avg episode reward: [(0, '6339.348'), (1, '5753.510')] [2023-12-26 09:46:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001266240_324157440.pth... [2023-12-26 09:46:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001275216_326459392.pth... [2023-12-26 09:46:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001274192_326197248.pth [2023-12-26 09:46:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001265184_323887104.pth [2023-12-26 09:46:23,868][123091] Updated weights for policy 0, policy_version 1275217 (0.0010) [2023-12-26 09:46:23,918][123091] Updated weights for policy 0, policy_version 1275227 (0.0010) [2023-12-26 09:46:23,970][123091] Updated weights for policy 0, policy_version 1275237 (0.0010) [2023-12-26 09:46:24,021][123091] Updated weights for policy 0, policy_version 1275247 (0.0010) [2023-12-26 09:46:24,411][123090] Updated weights for policy 1, policy_version 1266250 (0.0005) [2023-12-26 09:46:24,481][123090] Updated weights for policy 1, policy_version 1266260 (0.0005) [2023-12-26 09:46:24,542][123090] Updated weights for policy 1, policy_version 1266270 (0.0005) [2023-12-26 09:46:24,827][123091] Updated weights for policy 0, policy_version 1275257 (0.0009) [2023-12-26 09:46:24,887][123091] Updated weights for policy 0, policy_version 1275267 (0.0009) [2023-12-26 09:46:24,943][123091] Updated weights for policy 0, policy_version 1275277 (0.0009) [2023-12-26 09:46:25,251][123090] Updated weights for policy 1, policy_version 1266280 (0.0009) [2023-12-26 09:46:25,302][123090] Updated weights for policy 1, policy_version 1266290 (0.0010) [2023-12-26 09:46:25,358][123090] Updated weights for policy 1, policy_version 1266300 (0.0010) [2023-12-26 09:46:25,784][123091] Updated weights for policy 0, policy_version 1275287 (0.0009) [2023-12-26 09:46:25,836][123091] Updated weights for policy 0, policy_version 1275297 (0.0009) [2023-12-26 09:46:25,893][123091] Updated weights for policy 0, policy_version 1275307 (0.0009) [2023-12-26 09:46:26,212][123090] Updated weights for policy 1, policy_version 1266310 (0.0010) [2023-12-26 09:46:26,260][123090] Updated weights for policy 1, policy_version 1266320 (0.0010) [2023-12-26 09:46:26,308][123090] Updated weights for policy 1, policy_version 1266330 (0.0010) [2023-12-26 09:46:26,736][123091] Updated weights for policy 0, policy_version 1275317 (0.0009) [2023-12-26 09:46:26,805][123091] Updated weights for policy 0, policy_version 1275327 (0.0009) [2023-12-26 09:46:26,861][123091] Updated weights for policy 0, policy_version 1275337 (0.0009) [2023-12-26 09:46:27,149][123090] Updated weights for policy 1, policy_version 1266340 (0.0010) [2023-12-26 09:46:27,206][123090] Updated weights for policy 1, policy_version 1266350 (0.0010) [2023-12-26 09:46:27,259][123090] Updated weights for policy 1, policy_version 1266360 (0.0009) [2023-12-26 09:46:27,688][123091] Updated weights for policy 0, policy_version 1275347 (0.0009) [2023-12-26 09:46:27,748][123091] Updated weights for policy 0, policy_version 1275357 (0.0010) [2023-12-26 09:46:27,811][123091] Updated weights for policy 0, policy_version 1275367 (0.0009) [2023-12-26 09:46:27,988][123090] Updated weights for policy 1, policy_version 1266370 (0.0009) [2023-12-26 09:46:28,035][123090] Updated weights for policy 1, policy_version 1266380 (0.0009) [2023-12-26 09:46:28,091][123090] Updated weights for policy 1, policy_version 1266391 (0.0009) [2023-12-26 09:46:28,655][123091] Updated weights for policy 0, policy_version 1275377 (0.0009) [2023-12-26 09:46:28,722][123091] Updated weights for policy 0, policy_version 1275387 (0.0010) [2023-12-26 09:46:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 650698752. Throughput: 0: 8818.2, 1: 8928.9. Samples: 650697140. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:28,785][121949] Avg episode reward: [(0, '6404.479'), (1, '5337.536')] [2023-12-26 09:46:28,790][123091] Updated weights for policy 0, policy_version 1275397 (0.0010) [2023-12-26 09:46:28,851][123091] Updated weights for policy 0, policy_version 1275407 (0.0009) [2023-12-26 09:46:28,954][123090] Updated weights for policy 1, policy_version 1266401 (0.0008) [2023-12-26 09:46:29,003][123090] Updated weights for policy 1, policy_version 1266411 (0.0008) [2023-12-26 09:46:29,060][123090] Updated weights for policy 1, policy_version 1266421 (0.0009) [2023-12-26 09:46:29,115][123090] Updated weights for policy 1, policy_version 1266431 (0.0010) [2023-12-26 09:46:29,668][123091] Updated weights for policy 0, policy_version 1275417 (0.0010) [2023-12-26 09:46:29,727][123091] Updated weights for policy 0, policy_version 1275427 (0.0009) [2023-12-26 09:46:29,788][123091] Updated weights for policy 0, policy_version 1275437 (0.0009) [2023-12-26 09:46:29,994][123090] Updated weights for policy 1, policy_version 1266441 (0.0010) [2023-12-26 09:46:30,053][123090] Updated weights for policy 1, policy_version 1266451 (0.0009) [2023-12-26 09:46:30,112][123090] Updated weights for policy 1, policy_version 1266461 (0.0010) [2023-12-26 09:46:30,665][123091] Updated weights for policy 0, policy_version 1275447 (0.0009) [2023-12-26 09:46:30,711][123091] Updated weights for policy 0, policy_version 1275457 (0.0008) [2023-12-26 09:46:30,770][123091] Updated weights for policy 0, policy_version 1275467 (0.0008) [2023-12-26 09:46:30,880][123090] Updated weights for policy 1, policy_version 1266471 (0.0008) [2023-12-26 09:46:30,938][123090] Updated weights for policy 1, policy_version 1266481 (0.0009) [2023-12-26 09:46:30,996][123090] Updated weights for policy 1, policy_version 1266491 (0.0009) [2023-12-26 09:46:31,612][123091] Updated weights for policy 0, policy_version 1275477 (0.0009) [2023-12-26 09:46:31,682][123091] Updated weights for policy 0, policy_version 1275487 (0.0009) [2023-12-26 09:46:31,747][123091] Updated weights for policy 0, policy_version 1275497 (0.0009) [2023-12-26 09:46:31,852][123090] Updated weights for policy 1, policy_version 1266501 (0.0007) [2023-12-26 09:46:31,914][123090] Updated weights for policy 1, policy_version 1266511 (0.0008) [2023-12-26 09:46:31,982][123090] Updated weights for policy 1, policy_version 1266521 (0.0005) [2023-12-26 09:46:32,542][123091] Updated weights for policy 0, policy_version 1275507 (0.0007) [2023-12-26 09:46:32,598][123091] Updated weights for policy 0, policy_version 1275517 (0.0011) [2023-12-26 09:46:32,649][123091] Updated weights for policy 0, policy_version 1275527 (0.0010) [2023-12-26 09:46:32,728][123090] Updated weights for policy 1, policy_version 1266531 (0.0007) [2023-12-26 09:46:32,780][123090] Updated weights for policy 1, policy_version 1266541 (0.0008) [2023-12-26 09:46:32,835][123090] Updated weights for policy 1, policy_version 1266551 (0.0009) [2023-12-26 09:46:33,368][123091] Updated weights for policy 0, policy_version 1275537 (0.0010) [2023-12-26 09:46:33,424][123091] Updated weights for policy 0, policy_version 1275547 (0.0005) [2023-12-26 09:46:33,477][123091] Updated weights for policy 0, policy_version 1275557 (0.0006) [2023-12-26 09:46:33,540][123091] Updated weights for policy 0, policy_version 1275567 (0.0005) [2023-12-26 09:46:33,696][123090] Updated weights for policy 1, policy_version 1266561 (0.0006) [2023-12-26 09:46:33,755][123090] Updated weights for policy 1, policy_version 1266571 (0.0010) [2023-12-26 09:46:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 650788864. Throughput: 0: 8776.0, 1: 8893.7. Samples: 650802544. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:33,785][121949] Avg episode reward: [(0, '6389.138'), (1, '5198.338')] [2023-12-26 09:46:33,812][123090] Updated weights for policy 1, policy_version 1266581 (0.0010) [2023-12-26 09:46:33,875][123090] Updated weights for policy 1, policy_version 1266591 (0.0010) [2023-12-26 09:46:34,153][123091] Updated weights for policy 0, policy_version 1275577 (0.0007) [2023-12-26 09:46:34,216][123091] Updated weights for policy 0, policy_version 1275587 (0.0011) [2023-12-26 09:46:34,276][123091] Updated weights for policy 0, policy_version 1275597 (0.0011) [2023-12-26 09:46:34,759][123090] Updated weights for policy 1, policy_version 1266601 (0.0006) [2023-12-26 09:46:34,828][123090] Updated weights for policy 1, policy_version 1266611 (0.0008) [2023-12-26 09:46:34,893][123090] Updated weights for policy 1, policy_version 1266621 (0.0009) [2023-12-26 09:46:35,057][123091] Updated weights for policy 0, policy_version 1275607 (0.0009) [2023-12-26 09:46:35,116][123091] Updated weights for policy 0, policy_version 1275617 (0.0006) [2023-12-26 09:46:35,174][123091] Updated weights for policy 0, policy_version 1275627 (0.0006) [2023-12-26 09:46:35,588][123090] Updated weights for policy 1, policy_version 1266631 (0.0006) [2023-12-26 09:46:35,645][123090] Updated weights for policy 1, policy_version 1266641 (0.0007) [2023-12-26 09:46:35,700][123090] Updated weights for policy 1, policy_version 1266651 (0.0008) [2023-12-26 09:46:35,894][123091] Updated weights for policy 0, policy_version 1275637 (0.0005) [2023-12-26 09:46:35,963][123091] Updated weights for policy 0, policy_version 1275647 (0.0005) [2023-12-26 09:46:36,024][123091] Updated weights for policy 0, policy_version 1275657 (0.0005) [2023-12-26 09:46:36,474][123090] Updated weights for policy 1, policy_version 1266661 (0.0007) [2023-12-26 09:46:36,530][123090] Updated weights for policy 1, policy_version 1266671 (0.0007) [2023-12-26 09:46:36,580][123090] Updated weights for policy 1, policy_version 1266681 (0.0005) [2023-12-26 09:46:36,792][123091] Updated weights for policy 0, policy_version 1275667 (0.0007) [2023-12-26 09:46:36,861][123091] Updated weights for policy 0, policy_version 1275677 (0.0011) [2023-12-26 09:46:36,932][123091] Updated weights for policy 0, policy_version 1275687 (0.0010) [2023-12-26 09:46:37,389][123090] Updated weights for policy 1, policy_version 1266691 (0.0007) [2023-12-26 09:46:37,456][123090] Updated weights for policy 1, policy_version 1266701 (0.0008) [2023-12-26 09:46:37,527][123090] Updated weights for policy 1, policy_version 1266711 (0.0008) [2023-12-26 09:46:37,635][123091] Updated weights for policy 0, policy_version 1275697 (0.0005) [2023-12-26 09:46:37,686][123091] Updated weights for policy 0, policy_version 1275707 (0.0005) [2023-12-26 09:46:37,742][123091] Updated weights for policy 0, policy_version 1275717 (0.0006) [2023-12-26 09:46:37,806][123091] Updated weights for policy 0, policy_version 1275727 (0.0010) [2023-12-26 09:46:38,297][123090] Updated weights for policy 1, policy_version 1266721 (0.0009) [2023-12-26 09:46:38,367][123090] Updated weights for policy 1, policy_version 1266731 (0.0009) [2023-12-26 09:46:38,428][123090] Updated weights for policy 1, policy_version 1266741 (0.0009) [2023-12-26 09:46:38,497][123090] Updated weights for policy 1, policy_version 1266751 (0.0009) [2023-12-26 09:46:38,607][123091] Updated weights for policy 0, policy_version 1275737 (0.0011) [2023-12-26 09:46:38,670][123091] Updated weights for policy 0, policy_version 1275747 (0.0011) [2023-12-26 09:46:38,733][123091] Updated weights for policy 0, policy_version 1275757 (0.0011) [2023-12-26 09:46:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 650887168. Throughput: 0: 8830.4, 1: 8887.8. Samples: 650857848. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:38,785][121949] Avg episode reward: [(0, '6302.837'), (1, '5257.981')] [2023-12-26 09:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001275760_326598656.pth... [2023-12-26 09:46:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001266752_324288512.pth... [2023-12-26 09:46:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001265728_324026368.pth [2023-12-26 09:46:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001274704_326328320.pth [2023-12-26 09:46:39,375][123090] Updated weights for policy 1, policy_version 1266761 (0.0009) [2023-12-26 09:46:39,444][123090] Updated weights for policy 1, policy_version 1266771 (0.0008) [2023-12-26 09:46:39,512][123090] Updated weights for policy 1, policy_version 1266781 (0.0005) [2023-12-26 09:46:39,561][123091] Updated weights for policy 0, policy_version 1275767 (0.0007) [2023-12-26 09:46:39,632][123091] Updated weights for policy 0, policy_version 1275777 (0.0006) [2023-12-26 09:46:39,695][123091] Updated weights for policy 0, policy_version 1275787 (0.0007) [2023-12-26 09:46:40,274][123090] Updated weights for policy 1, policy_version 1266791 (0.0005) [2023-12-26 09:46:40,348][123090] Updated weights for policy 1, policy_version 1266801 (0.0009) [2023-12-26 09:46:40,413][123090] Updated weights for policy 1, policy_version 1266811 (0.0008) [2023-12-26 09:46:40,473][123091] Updated weights for policy 0, policy_version 1275797 (0.0007) [2023-12-26 09:46:40,538][123091] Updated weights for policy 0, policy_version 1275807 (0.0006) [2023-12-26 09:46:40,608][123091] Updated weights for policy 0, policy_version 1275817 (0.0006) [2023-12-26 09:46:41,157][123090] Updated weights for policy 1, policy_version 1266821 (0.0009) [2023-12-26 09:46:41,218][123090] Updated weights for policy 1, policy_version 1266831 (0.0009) [2023-12-26 09:46:41,284][123090] Updated weights for policy 1, policy_version 1266841 (0.0008) [2023-12-26 09:46:41,380][123091] Updated weights for policy 0, policy_version 1275827 (0.0007) [2023-12-26 09:46:41,456][123091] Updated weights for policy 0, policy_version 1275837 (0.0011) [2023-12-26 09:46:41,515][123091] Updated weights for policy 0, policy_version 1275847 (0.0011) [2023-12-26 09:46:42,178][123090] Updated weights for policy 1, policy_version 1266851 (0.0008) [2023-12-26 09:46:42,231][123090] Updated weights for policy 1, policy_version 1266861 (0.0009) [2023-12-26 09:46:42,299][123090] Updated weights for policy 1, policy_version 1266871 (0.0008) [2023-12-26 09:46:42,339][123091] Updated weights for policy 0, policy_version 1275857 (0.0011) [2023-12-26 09:46:42,411][123091] Updated weights for policy 0, policy_version 1275867 (0.0010) [2023-12-26 09:46:42,480][123091] Updated weights for policy 0, policy_version 1275877 (0.0010) [2023-12-26 09:46:42,544][123091] Updated weights for policy 0, policy_version 1275887 (0.0011) [2023-12-26 09:46:43,084][123090] Updated weights for policy 1, policy_version 1266881 (0.0009) [2023-12-26 09:46:43,135][123090] Updated weights for policy 1, policy_version 1266891 (0.0005) [2023-12-26 09:46:43,183][123090] Updated weights for policy 1, policy_version 1266901 (0.0005) [2023-12-26 09:46:43,237][123090] Updated weights for policy 1, policy_version 1266911 (0.0007) [2023-12-26 09:46:43,256][123091] Updated weights for policy 0, policy_version 1275897 (0.0006) [2023-12-26 09:46:43,308][123091] Updated weights for policy 0, policy_version 1275907 (0.0005) [2023-12-26 09:46:43,361][123091] Updated weights for policy 0, policy_version 1275917 (0.0005) [2023-12-26 09:46:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 650969088. Throughput: 0: 8737.9, 1: 8887.1. Samples: 650963372. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:43,785][121949] Avg episode reward: [(0, '6132.589'), (1, '5354.112')] [2023-12-26 09:46:43,869][123090] Updated weights for policy 1, policy_version 1266921 (0.0007) [2023-12-26 09:46:43,925][123090] Updated weights for policy 1, policy_version 1266931 (0.0005) [2023-12-26 09:46:43,976][123090] Updated weights for policy 1, policy_version 1266941 (0.0005) [2023-12-26 09:46:44,052][123091] Updated weights for policy 0, policy_version 1275927 (0.0009) [2023-12-26 09:46:44,104][123091] Updated weights for policy 0, policy_version 1275937 (0.0010) [2023-12-26 09:46:44,169][123091] Updated weights for policy 0, policy_version 1275947 (0.0010) [2023-12-26 09:46:44,683][123090] Updated weights for policy 1, policy_version 1266951 (0.0007) [2023-12-26 09:46:44,747][123090] Updated weights for policy 1, policy_version 1266961 (0.0007) [2023-12-26 09:46:44,813][123090] Updated weights for policy 1, policy_version 1266971 (0.0008) [2023-12-26 09:46:44,994][123091] Updated weights for policy 0, policy_version 1275957 (0.0008) [2023-12-26 09:46:45,055][123091] Updated weights for policy 0, policy_version 1275967 (0.0006) [2023-12-26 09:46:45,120][123091] Updated weights for policy 0, policy_version 1275977 (0.0006) [2023-12-26 09:46:45,615][123090] Updated weights for policy 1, policy_version 1266981 (0.0009) [2023-12-26 09:46:45,672][123090] Updated weights for policy 1, policy_version 1266991 (0.0011) [2023-12-26 09:46:45,724][123090] Updated weights for policy 1, policy_version 1267001 (0.0010) [2023-12-26 09:46:45,835][123091] Updated weights for policy 0, policy_version 1275987 (0.0007) [2023-12-26 09:46:45,910][123091] Updated weights for policy 0, policy_version 1275997 (0.0009) [2023-12-26 09:46:45,971][123091] Updated weights for policy 0, policy_version 1276007 (0.0009) [2023-12-26 09:46:46,543][123090] Updated weights for policy 1, policy_version 1267011 (0.0010) [2023-12-26 09:46:46,590][123090] Updated weights for policy 1, policy_version 1267021 (0.0010) [2023-12-26 09:46:46,634][123090] Updated weights for policy 1, policy_version 1267031 (0.0010) [2023-12-26 09:46:46,755][123091] Updated weights for policy 0, policy_version 1276017 (0.0008) [2023-12-26 09:46:46,806][123091] Updated weights for policy 0, policy_version 1276027 (0.0010) [2023-12-26 09:46:46,860][123091] Updated weights for policy 0, policy_version 1276037 (0.0010) [2023-12-26 09:46:46,907][123091] Updated weights for policy 0, policy_version 1276047 (0.0010) [2023-12-26 09:46:47,454][123090] Updated weights for policy 1, policy_version 1267041 (0.0010) [2023-12-26 09:46:47,515][123090] Updated weights for policy 1, policy_version 1267051 (0.0010) [2023-12-26 09:46:47,563][123090] Updated weights for policy 1, policy_version 1267061 (0.0010) [2023-12-26 09:46:47,610][123090] Updated weights for policy 1, policy_version 1267071 (0.0010) [2023-12-26 09:46:47,764][123091] Updated weights for policy 0, policy_version 1276057 (0.0008) [2023-12-26 09:46:47,820][123091] Updated weights for policy 0, policy_version 1276067 (0.0006) [2023-12-26 09:46:47,886][123091] Updated weights for policy 0, policy_version 1276077 (0.0009) [2023-12-26 09:46:48,441][123090] Updated weights for policy 1, policy_version 1267081 (0.0006) [2023-12-26 09:46:48,512][123090] Updated weights for policy 1, policy_version 1267091 (0.0006) [2023-12-26 09:46:48,582][123090] Updated weights for policy 1, policy_version 1267101 (0.0007) [2023-12-26 09:46:48,740][123091] Updated weights for policy 0, policy_version 1276087 (0.0009) [2023-12-26 09:46:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 651059200. Throughput: 0: 8777.9, 1: 8946.1. Samples: 651073324. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:48,785][121949] Avg episode reward: [(0, '6174.013'), (1, '5519.371')] [2023-12-26 09:46:48,809][123091] Updated weights for policy 0, policy_version 1276097 (0.0010) [2023-12-26 09:46:48,870][123091] Updated weights for policy 0, policy_version 1276107 (0.0009) [2023-12-26 09:46:49,346][123090] Updated weights for policy 1, policy_version 1267111 (0.0008) [2023-12-26 09:46:49,420][123090] Updated weights for policy 1, policy_version 1267121 (0.0006) [2023-12-26 09:46:49,471][123090] Updated weights for policy 1, policy_version 1267131 (0.0007) [2023-12-26 09:46:49,669][123091] Updated weights for policy 0, policy_version 1276117 (0.0010) [2023-12-26 09:46:49,730][123091] Updated weights for policy 0, policy_version 1276127 (0.0009) [2023-12-26 09:46:49,790][123091] Updated weights for policy 0, policy_version 1276137 (0.0009) [2023-12-26 09:46:50,327][123090] Updated weights for policy 1, policy_version 1267141 (0.0010) [2023-12-26 09:46:50,382][123090] Updated weights for policy 1, policy_version 1267151 (0.0010) [2023-12-26 09:46:50,433][123090] Updated weights for policy 1, policy_version 1267161 (0.0010) [2023-12-26 09:46:50,614][123091] Updated weights for policy 0, policy_version 1276147 (0.0010) [2023-12-26 09:46:50,684][123091] Updated weights for policy 0, policy_version 1276157 (0.0010) [2023-12-26 09:46:50,747][123091] Updated weights for policy 0, policy_version 1276167 (0.0011) [2023-12-26 09:46:51,318][123090] Updated weights for policy 1, policy_version 1267171 (0.0009) [2023-12-26 09:46:51,394][123090] Updated weights for policy 1, policy_version 1267181 (0.0007) [2023-12-26 09:46:51,466][123090] Updated weights for policy 1, policy_version 1267191 (0.0008) [2023-12-26 09:46:51,513][123091] Updated weights for policy 0, policy_version 1276177 (0.0009) [2023-12-26 09:46:51,583][123091] Updated weights for policy 0, policy_version 1276187 (0.0011) [2023-12-26 09:46:51,653][123091] Updated weights for policy 0, policy_version 1276197 (0.0009) [2023-12-26 09:46:51,707][123091] Updated weights for policy 0, policy_version 1276207 (0.0010) [2023-12-26 09:46:52,234][123090] Updated weights for policy 1, policy_version 1267201 (0.0008) [2023-12-26 09:46:52,309][123090] Updated weights for policy 1, policy_version 1267211 (0.0007) [2023-12-26 09:46:52,379][123090] Updated weights for policy 1, policy_version 1267221 (0.0008) [2023-12-26 09:46:52,448][123090] Updated weights for policy 1, policy_version 1267231 (0.0008) [2023-12-26 09:46:52,498][123091] Updated weights for policy 0, policy_version 1276217 (0.0006) [2023-12-26 09:46:52,564][123091] Updated weights for policy 0, policy_version 1276227 (0.0006) [2023-12-26 09:46:52,628][123091] Updated weights for policy 0, policy_version 1276237 (0.0009) [2023-12-26 09:46:53,220][123090] Updated weights for policy 1, policy_version 1267241 (0.0009) [2023-12-26 09:46:53,284][123090] Updated weights for policy 1, policy_version 1267251 (0.0009) [2023-12-26 09:46:53,341][123091] Updated weights for policy 0, policy_version 1276247 (0.0009) [2023-12-26 09:46:53,344][123090] Updated weights for policy 1, policy_version 1267261 (0.0009) [2023-12-26 09:46:53,400][123091] Updated weights for policy 0, policy_version 1276257 (0.0010) [2023-12-26 09:46:53,471][123091] Updated weights for policy 0, policy_version 1276267 (0.0010) [2023-12-26 09:46:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 651149312. Throughput: 0: 8812.3, 1: 8836.4. Samples: 651124068. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:53,785][121949] Avg episode reward: [(0, '6313.327'), (1, '5621.922')] [2023-12-26 09:46:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001276272_326729728.pth... [2023-12-26 09:46:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001267264_324419584.pth... [2023-12-26 09:46:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001275216_326459392.pth [2023-12-26 09:46:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001266240_324157440.pth [2023-12-26 09:46:54,140][123090] Updated weights for policy 1, policy_version 1267271 (0.0009) [2023-12-26 09:46:54,201][123090] Updated weights for policy 1, policy_version 1267281 (0.0009) [2023-12-26 09:46:54,263][123090] Updated weights for policy 1, policy_version 1267291 (0.0010) [2023-12-26 09:46:54,298][123091] Updated weights for policy 0, policy_version 1276277 (0.0009) [2023-12-26 09:46:54,363][123091] Updated weights for policy 0, policy_version 1276287 (0.0008) [2023-12-26 09:46:54,436][123091] Updated weights for policy 0, policy_version 1276297 (0.0005) [2023-12-26 09:46:54,996][123091] Updated weights for policy 0, policy_version 1276307 (0.0007) [2023-12-26 09:46:55,058][123091] Updated weights for policy 0, policy_version 1276317 (0.0009) [2023-12-26 09:46:55,120][123091] Updated weights for policy 0, policy_version 1276327 (0.0009) [2023-12-26 09:46:55,154][123090] Updated weights for policy 1, policy_version 1267301 (0.0008) [2023-12-26 09:46:55,214][123090] Updated weights for policy 1, policy_version 1267311 (0.0009) [2023-12-26 09:46:55,265][123090] Updated weights for policy 1, policy_version 1267321 (0.0009) [2023-12-26 09:46:55,890][123091] Updated weights for policy 0, policy_version 1276337 (0.0008) [2023-12-26 09:46:55,946][123091] Updated weights for policy 0, policy_version 1276348 (0.0010) [2023-12-26 09:46:56,003][123091] Updated weights for policy 0, policy_version 1276358 (0.0010) [2023-12-26 09:46:56,043][123090] Updated weights for policy 1, policy_version 1267331 (0.0009) [2023-12-26 09:46:56,058][123091] Updated weights for policy 0, policy_version 1276368 (0.0008) [2023-12-26 09:46:56,104][123090] Updated weights for policy 1, policy_version 1267341 (0.0008) [2023-12-26 09:46:56,171][123090] Updated weights for policy 1, policy_version 1267351 (0.0007) [2023-12-26 09:46:56,916][123091] Updated weights for policy 0, policy_version 1276378 (0.0007) [2023-12-26 09:46:56,937][123090] Updated weights for policy 1, policy_version 1267361 (0.0009) [2023-12-26 09:46:56,962][123091] Updated weights for policy 0, policy_version 1276388 (0.0008) [2023-12-26 09:46:56,988][123090] Updated weights for policy 1, policy_version 1267371 (0.0006) [2023-12-26 09:46:57,013][123091] Updated weights for policy 0, policy_version 1276398 (0.0008) [2023-12-26 09:46:57,043][123090] Updated weights for policy 1, policy_version 1267381 (0.0009) [2023-12-26 09:46:57,089][123090] Updated weights for policy 1, policy_version 1267391 (0.0008) [2023-12-26 09:46:57,800][123090] Updated weights for policy 1, policy_version 1267401 (0.0006) [2023-12-26 09:46:57,855][123090] Updated weights for policy 1, policy_version 1267411 (0.0006) [2023-12-26 09:46:57,900][123091] Updated weights for policy 0, policy_version 1276408 (0.0008) [2023-12-26 09:46:57,920][123090] Updated weights for policy 1, policy_version 1267421 (0.0008) [2023-12-26 09:46:57,964][123091] Updated weights for policy 0, policy_version 1276418 (0.0008) [2023-12-26 09:46:58,033][123091] Updated weights for policy 0, policy_version 1276428 (0.0009) [2023-12-26 09:46:58,776][123090] Updated weights for policy 1, policy_version 1267431 (0.0007) [2023-12-26 09:46:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17613.4, 300 sec: 17716.9). Total num frames: 651231232. Throughput: 0: 8953.4, 1: 8808.2. Samples: 651231004. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:46:58,785][121949] Avg episode reward: [(0, '6329.241'), (1, '5454.679')] [2023-12-26 09:46:58,865][123090] Updated weights for policy 1, policy_version 1267442 (0.0010) [2023-12-26 09:46:58,933][123090] Updated weights for policy 1, policy_version 1267452 (0.0011) [2023-12-26 09:46:59,001][123091] Updated weights for policy 0, policy_version 1276438 (0.0009) [2023-12-26 09:46:59,062][123091] Updated weights for policy 0, policy_version 1276448 (0.0009) [2023-12-26 09:46:59,135][123091] Updated weights for policy 0, policy_version 1276458 (0.0008) [2023-12-26 09:46:59,799][123090] Updated weights for policy 1, policy_version 1267462 (0.0009) [2023-12-26 09:46:59,867][123090] Updated weights for policy 1, policy_version 1267472 (0.0010) [2023-12-26 09:46:59,936][123090] Updated weights for policy 1, policy_version 1267482 (0.0010) [2023-12-26 09:47:00,041][123091] Updated weights for policy 0, policy_version 1276468 (0.0008) [2023-12-26 09:47:00,105][123091] Updated weights for policy 0, policy_version 1276478 (0.0008) [2023-12-26 09:47:00,160][123091] Updated weights for policy 0, policy_version 1276488 (0.0010) [2023-12-26 09:47:00,811][123091] Updated weights for policy 0, policy_version 1276498 (0.0009) [2023-12-26 09:47:00,822][123090] Updated weights for policy 1, policy_version 1267492 (0.0007) [2023-12-26 09:47:00,859][123091] Updated weights for policy 0, policy_version 1276508 (0.0007) [2023-12-26 09:47:00,870][123090] Updated weights for policy 1, policy_version 1267502 (0.0008) [2023-12-26 09:47:00,907][123091] Updated weights for policy 0, policy_version 1276518 (0.0008) [2023-12-26 09:47:00,919][123090] Updated weights for policy 1, policy_version 1267512 (0.0006) [2023-12-26 09:47:00,956][123091] Updated weights for policy 0, policy_version 1276528 (0.0010) [2023-12-26 09:47:01,706][123090] Updated weights for policy 1, policy_version 1267522 (0.0006) [2023-12-26 09:47:01,782][123090] Updated weights for policy 1, policy_version 1267532 (0.0007) [2023-12-26 09:47:01,845][123090] Updated weights for policy 1, policy_version 1267542 (0.0008) [2023-12-26 09:47:01,866][123091] Updated weights for policy 0, policy_version 1276538 (0.0009) [2023-12-26 09:47:01,900][123090] Updated weights for policy 1, policy_version 1267552 (0.0006) [2023-12-26 09:47:01,926][123091] Updated weights for policy 0, policy_version 1276548 (0.0009) [2023-12-26 09:47:01,981][123091] Updated weights for policy 0, policy_version 1276560 (0.0011) [2023-12-26 09:47:02,591][123090] Updated weights for policy 1, policy_version 1267562 (0.0005) [2023-12-26 09:47:02,654][123090] Updated weights for policy 1, policy_version 1267572 (0.0005) [2023-12-26 09:47:02,719][123090] Updated weights for policy 1, policy_version 1267582 (0.0005) [2023-12-26 09:47:02,870][123091] Updated weights for policy 0, policy_version 1276570 (0.0005) [2023-12-26 09:47:02,927][123091] Updated weights for policy 0, policy_version 1276580 (0.0006) [2023-12-26 09:47:02,992][123091] Updated weights for policy 0, policy_version 1276590 (0.0006) [2023-12-26 09:47:03,392][123090] Updated weights for policy 1, policy_version 1267592 (0.0005) [2023-12-26 09:47:03,445][123090] Updated weights for policy 1, policy_version 1267602 (0.0005) [2023-12-26 09:47:03,491][123090] Updated weights for policy 1, policy_version 1267612 (0.0005) [2023-12-26 09:47:03,662][123091] Updated weights for policy 0, policy_version 1276600 (0.0010) [2023-12-26 09:47:03,710][123091] Updated weights for policy 0, policy_version 1276610 (0.0010) [2023-12-26 09:47:03,759][123091] Updated weights for policy 0, policy_version 1276620 (0.0010) [2023-12-26 09:47:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 651329536. Throughput: 0: 8868.5, 1: 8797.1. Samples: 651335468. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:47:03,785][121949] Avg episode reward: [(0, '6297.271'), (1, '5427.714')] [2023-12-26 09:47:04,269][123090] Updated weights for policy 1, policy_version 1267622 (0.0010) [2023-12-26 09:47:04,337][123090] Updated weights for policy 1, policy_version 1267632 (0.0010) [2023-12-26 09:47:04,405][123090] Updated weights for policy 1, policy_version 1267642 (0.0011) [2023-12-26 09:47:04,622][123091] Updated weights for policy 0, policy_version 1276630 (0.0009) [2023-12-26 09:47:04,683][123091] Updated weights for policy 0, policy_version 1276640 (0.0009) [2023-12-26 09:47:04,739][123091] Updated weights for policy 0, policy_version 1276650 (0.0009) [2023-12-26 09:47:05,220][123090] Updated weights for policy 1, policy_version 1267652 (0.0010) [2023-12-26 09:47:05,282][123090] Updated weights for policy 1, policy_version 1267662 (0.0010) [2023-12-26 09:47:05,347][123090] Updated weights for policy 1, policy_version 1267672 (0.0010) [2023-12-26 09:47:05,560][123091] Updated weights for policy 0, policy_version 1276660 (0.0009) [2023-12-26 09:47:05,610][123091] Updated weights for policy 0, policy_version 1276671 (0.0009) [2023-12-26 09:47:05,662][123091] Updated weights for policy 0, policy_version 1276681 (0.0009) [2023-12-26 09:47:06,149][123090] Updated weights for policy 1, policy_version 1267682 (0.0010) [2023-12-26 09:47:06,214][123090] Updated weights for policy 1, policy_version 1267692 (0.0011) [2023-12-26 09:47:06,285][123090] Updated weights for policy 1, policy_version 1267702 (0.0011) [2023-12-26 09:47:06,353][123090] Updated weights for policy 1, policy_version 1267712 (0.0011) [2023-12-26 09:47:06,499][123091] Updated weights for policy 0, policy_version 1276691 (0.0008) [2023-12-26 09:47:06,563][123091] Updated weights for policy 0, policy_version 1276701 (0.0009) [2023-12-26 09:47:06,632][123091] Updated weights for policy 0, policy_version 1276711 (0.0006) [2023-12-26 09:47:07,178][123090] Updated weights for policy 1, policy_version 1267722 (0.0008) [2023-12-26 09:47:07,240][123090] Updated weights for policy 1, policy_version 1267732 (0.0005) [2023-12-26 09:47:07,308][123090] Updated weights for policy 1, policy_version 1267742 (0.0005) [2023-12-26 09:47:07,429][123091] Updated weights for policy 0, policy_version 1276721 (0.0005) [2023-12-26 09:47:07,478][123091] Updated weights for policy 0, policy_version 1276731 (0.0005) [2023-12-26 09:47:07,541][123091] Updated weights for policy 0, policy_version 1276741 (0.0005) [2023-12-26 09:47:07,594][123091] Updated weights for policy 0, policy_version 1276751 (0.0005) [2023-12-26 09:47:08,051][123090] Updated weights for policy 1, policy_version 1267752 (0.0008) [2023-12-26 09:47:08,105][123090] Updated weights for policy 1, policy_version 1267762 (0.0008) [2023-12-26 09:47:08,164][123090] Updated weights for policy 1, policy_version 1267772 (0.0009) [2023-12-26 09:47:08,290][123091] Updated weights for policy 0, policy_version 1276761 (0.0005) [2023-12-26 09:47:08,360][123091] Updated weights for policy 0, policy_version 1276771 (0.0009) [2023-12-26 09:47:08,425][123091] Updated weights for policy 0, policy_version 1276781 (0.0009) [2023-12-26 09:47:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 651411456. Throughput: 0: 8819.6, 1: 8835.3. Samples: 651386944. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 09:47:08,786][121949] Avg episode reward: [(0, '6219.095'), (1, '5533.487')] [2023-12-26 09:47:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001276784_326860800.pth... [2023-12-26 09:47:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001267776_324550656.pth... [2023-12-26 09:47:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001275760_326598656.pth [2023-12-26 09:47:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001266752_324288512.pth [2023-12-26 09:47:09,008][123090] Updated weights for policy 1, policy_version 1267782 (0.0009) [2023-12-26 09:47:09,081][123090] Updated weights for policy 1, policy_version 1267792 (0.0010) [2023-12-26 09:47:09,148][123090] Updated weights for policy 1, policy_version 1267802 (0.0007) [2023-12-26 09:47:09,205][123091] Updated weights for policy 0, policy_version 1276791 (0.0008) [2023-12-26 09:47:09,280][123091] Updated weights for policy 0, policy_version 1276801 (0.0009) [2023-12-26 09:47:09,340][123091] Updated weights for policy 0, policy_version 1276811 (0.0009) [2023-12-26 09:47:09,957][123090] Updated weights for policy 1, policy_version 1267812 (0.0009) [2023-12-26 09:47:10,012][123090] Updated weights for policy 1, policy_version 1267822 (0.0008) [2023-12-26 09:47:10,071][123090] Updated weights for policy 1, policy_version 1267832 (0.0009) [2023-12-26 09:47:10,179][123091] Updated weights for policy 0, policy_version 1276821 (0.0010) [2023-12-26 09:47:10,242][123091] Updated weights for policy 0, policy_version 1276831 (0.0011) [2023-12-26 09:47:10,302][123091] Updated weights for policy 0, policy_version 1276841 (0.0011) [2023-12-26 09:47:10,984][123090] Updated weights for policy 1, policy_version 1267842 (0.0009) [2023-12-26 09:47:11,033][123091] Updated weights for policy 0, policy_version 1276851 (0.0010) [2023-12-26 09:47:11,063][123090] Updated weights for policy 1, policy_version 1267852 (0.0009) [2023-12-26 09:47:11,097][123091] Updated weights for policy 0, policy_version 1276861 (0.0010) [2023-12-26 09:47:11,129][123090] Updated weights for policy 1, policy_version 1267862 (0.0008) [2023-12-26 09:47:11,169][123091] Updated weights for policy 0, policy_version 1276871 (0.0010) [2023-12-26 09:47:11,197][123090] Updated weights for policy 1, policy_version 1267872 (0.0007) [2023-12-26 09:47:11,987][123090] Updated weights for policy 1, policy_version 1267882 (0.0008) [2023-12-26 09:47:12,023][123091] Updated weights for policy 0, policy_version 1276881 (0.0010) [2023-12-26 09:47:12,055][123090] Updated weights for policy 1, policy_version 1267892 (0.0010) [2023-12-26 09:47:12,089][123091] Updated weights for policy 0, policy_version 1276891 (0.0006) [2023-12-26 09:47:12,115][123090] Updated weights for policy 1, policy_version 1267902 (0.0009) [2023-12-26 09:47:12,152][123091] Updated weights for policy 0, policy_version 1276901 (0.0006) [2023-12-26 09:47:12,219][123091] Updated weights for policy 0, policy_version 1276911 (0.0009) [2023-12-26 09:47:12,892][123090] Updated weights for policy 1, policy_version 1267912 (0.0006) [2023-12-26 09:47:12,941][123090] Updated weights for policy 1, policy_version 1267922 (0.0007) [2023-12-26 09:47:12,989][123090] Updated weights for policy 1, policy_version 1267932 (0.0010) [2023-12-26 09:47:13,013][123091] Updated weights for policy 0, policy_version 1276921 (0.0007) [2023-12-26 09:47:13,066][123091] Updated weights for policy 0, policy_version 1276931 (0.0009) [2023-12-26 09:47:13,122][123091] Updated weights for policy 0, policy_version 1276941 (0.0009) [2023-12-26 09:47:13,759][123090] Updated weights for policy 1, policy_version 1267942 (0.0007) [2023-12-26 09:47:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 651493376. Throughput: 0: 8882.0, 1: 8780.1. Samples: 651491936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:13,785][121949] Avg episode reward: [(0, '6226.777'), (1, '5595.055')] [2023-12-26 09:47:13,815][123090] Updated weights for policy 1, policy_version 1267952 (0.0006) [2023-12-26 09:47:13,868][123090] Updated weights for policy 1, policy_version 1267962 (0.0005) [2023-12-26 09:47:13,932][123091] Updated weights for policy 0, policy_version 1276951 (0.0006) [2023-12-26 09:47:13,979][123091] Updated weights for policy 0, policy_version 1276961 (0.0005) [2023-12-26 09:47:14,027][123091] Updated weights for policy 0, policy_version 1276971 (0.0005) [2023-12-26 09:47:14,656][123090] Updated weights for policy 1, policy_version 1267972 (0.0006) [2023-12-26 09:47:14,712][123090] Updated weights for policy 1, policy_version 1267982 (0.0009) [2023-12-26 09:47:14,737][123091] Updated weights for policy 0, policy_version 1276981 (0.0006) [2023-12-26 09:47:14,785][123090] Updated weights for policy 1, policy_version 1267992 (0.0008) [2023-12-26 09:47:14,801][123091] Updated weights for policy 0, policy_version 1276991 (0.0007) [2023-12-26 09:47:14,866][123091] Updated weights for policy 0, policy_version 1277001 (0.0007) [2023-12-26 09:47:15,661][123090] Updated weights for policy 1, policy_version 1268002 (0.0009) [2023-12-26 09:47:15,721][123090] Updated weights for policy 1, policy_version 1268012 (0.0009) [2023-12-26 09:47:15,732][123091] Updated weights for policy 0, policy_version 1277011 (0.0008) [2023-12-26 09:47:15,779][123090] Updated weights for policy 1, policy_version 1268022 (0.0008) [2023-12-26 09:47:15,791][123091] Updated weights for policy 0, policy_version 1277021 (0.0007) [2023-12-26 09:47:15,836][123090] Updated weights for policy 1, policy_version 1268032 (0.0009) [2023-12-26 09:47:15,855][123091] Updated weights for policy 0, policy_version 1277031 (0.0005) [2023-12-26 09:47:16,482][123091] Updated weights for policy 0, policy_version 1277041 (0.0006) [2023-12-26 09:47:16,540][123091] Updated weights for policy 0, policy_version 1277051 (0.0010) [2023-12-26 09:47:16,602][123091] Updated weights for policy 0, policy_version 1277061 (0.0010) [2023-12-26 09:47:16,662][123091] Updated weights for policy 0, policy_version 1277071 (0.0009) [2023-12-26 09:47:16,713][123090] Updated weights for policy 1, policy_version 1268042 (0.0008) [2023-12-26 09:47:16,785][123090] Updated weights for policy 1, policy_version 1268052 (0.0007) [2023-12-26 09:47:16,848][123090] Updated weights for policy 1, policy_version 1268062 (0.0008) [2023-12-26 09:47:17,373][123091] Updated weights for policy 0, policy_version 1277081 (0.0005) [2023-12-26 09:47:17,432][123091] Updated weights for policy 0, policy_version 1277091 (0.0006) [2023-12-26 09:47:17,475][123091] Updated weights for policy 0, policy_version 1277101 (0.0010) [2023-12-26 09:47:17,692][123090] Updated weights for policy 1, policy_version 1268072 (0.0009) [2023-12-26 09:47:17,746][123090] Updated weights for policy 1, policy_version 1268082 (0.0008) [2023-12-26 09:47:17,795][123090] Updated weights for policy 1, policy_version 1268092 (0.0009) [2023-12-26 09:47:18,230][123091] Updated weights for policy 0, policy_version 1277111 (0.0010) [2023-12-26 09:47:18,284][123091] Updated weights for policy 0, policy_version 1277121 (0.0010) [2023-12-26 09:47:18,347][123091] Updated weights for policy 0, policy_version 1277131 (0.0010) [2023-12-26 09:47:18,562][123090] Updated weights for policy 1, policy_version 1268102 (0.0006) [2023-12-26 09:47:18,608][123090] Updated weights for policy 1, policy_version 1268112 (0.0005) [2023-12-26 09:47:18,658][123090] Updated weights for policy 1, policy_version 1268122 (0.0007) [2023-12-26 09:47:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 651591680. Throughput: 0: 8956.8, 1: 8772.4. Samples: 651600360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:18,785][121949] Avg episode reward: [(0, '6238.444'), (1, '5326.766')] [2023-12-26 09:47:19,038][123091] Updated weights for policy 0, policy_version 1277141 (0.0008) [2023-12-26 09:47:19,097][123091] Updated weights for policy 0, policy_version 1277151 (0.0006) [2023-12-26 09:47:19,164][123091] Updated weights for policy 0, policy_version 1277161 (0.0007) [2023-12-26 09:47:19,512][123090] Updated weights for policy 1, policy_version 1268132 (0.0009) [2023-12-26 09:47:19,579][123090] Updated weights for policy 1, policy_version 1268142 (0.0009) [2023-12-26 09:47:19,641][123090] Updated weights for policy 1, policy_version 1268152 (0.0009) [2023-12-26 09:47:19,954][123091] Updated weights for policy 0, policy_version 1277171 (0.0010) [2023-12-26 09:47:20,014][123091] Updated weights for policy 0, policy_version 1277181 (0.0009) [2023-12-26 09:47:20,083][123091] Updated weights for policy 0, policy_version 1277191 (0.0010) [2023-12-26 09:47:20,497][123090] Updated weights for policy 1, policy_version 1268162 (0.0009) [2023-12-26 09:47:20,573][123090] Updated weights for policy 1, policy_version 1268172 (0.0009) [2023-12-26 09:47:20,642][123090] Updated weights for policy 1, policy_version 1268182 (0.0008) [2023-12-26 09:47:20,704][123090] Updated weights for policy 1, policy_version 1268192 (0.0007) [2023-12-26 09:47:20,911][123091] Updated weights for policy 0, policy_version 1277201 (0.0010) [2023-12-26 09:47:20,969][123091] Updated weights for policy 0, policy_version 1277211 (0.0007) [2023-12-26 09:47:21,037][123091] Updated weights for policy 0, policy_version 1277221 (0.0007) [2023-12-26 09:47:21,109][123091] Updated weights for policy 0, policy_version 1277231 (0.0010) [2023-12-26 09:47:21,541][123090] Updated weights for policy 1, policy_version 1268202 (0.0010) [2023-12-26 09:47:21,607][123090] Updated weights for policy 1, policy_version 1268212 (0.0009) [2023-12-26 09:47:21,678][123090] Updated weights for policy 1, policy_version 1268222 (0.0010) [2023-12-26 09:47:21,872][123091] Updated weights for policy 0, policy_version 1277241 (0.0009) [2023-12-26 09:47:21,922][123091] Updated weights for policy 0, policy_version 1277251 (0.0007) [2023-12-26 09:47:21,973][123091] Updated weights for policy 0, policy_version 1277261 (0.0009) [2023-12-26 09:47:22,521][123090] Updated weights for policy 1, policy_version 1268232 (0.0008) [2023-12-26 09:47:22,600][123090] Updated weights for policy 1, policy_version 1268242 (0.0005) [2023-12-26 09:47:22,665][123090] Updated weights for policy 1, policy_version 1268252 (0.0006) [2023-12-26 09:47:22,792][123091] Updated weights for policy 0, policy_version 1277271 (0.0010) [2023-12-26 09:47:22,857][123091] Updated weights for policy 0, policy_version 1277281 (0.0010) [2023-12-26 09:47:22,909][123091] Updated weights for policy 0, policy_version 1277291 (0.0010) [2023-12-26 09:47:23,311][123090] Updated weights for policy 1, policy_version 1268262 (0.0009) [2023-12-26 09:47:23,366][123090] Updated weights for policy 1, policy_version 1268272 (0.0008) [2023-12-26 09:47:23,436][123090] Updated weights for policy 1, policy_version 1268282 (0.0006) [2023-12-26 09:47:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 651673600. Throughput: 0: 8899.3, 1: 8732.2. Samples: 651651268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:23,785][121949] Avg episode reward: [(0, '6259.420'), (1, '5032.694')] [2023-12-26 09:47:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001268288_324681728.pth... [2023-12-26 09:47:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001267264_324419584.pth [2023-12-26 09:47:23,817][123091] Updated weights for policy 0, policy_version 1277302 (0.0010) [2023-12-26 09:47:23,886][123091] Updated weights for policy 0, policy_version 1277312 (0.0010) [2023-12-26 09:47:23,953][123091] Updated weights for policy 0, policy_version 1277322 (0.0007) [2023-12-26 09:47:23,995][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001277328_327000064.pth... [2023-12-26 09:47:24,001][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001276272_326729728.pth [2023-12-26 09:47:24,146][123090] Updated weights for policy 1, policy_version 1268292 (0.0005) [2023-12-26 09:47:24,212][123090] Updated weights for policy 1, policy_version 1268302 (0.0005) [2023-12-26 09:47:24,287][123090] Updated weights for policy 1, policy_version 1268312 (0.0005) [2023-12-26 09:47:24,840][123091] Updated weights for policy 0, policy_version 1277332 (0.0009) [2023-12-26 09:47:24,896][123091] Updated weights for policy 0, policy_version 1277342 (0.0009) [2023-12-26 09:47:24,911][123090] Updated weights for policy 1, policy_version 1268322 (0.0006) [2023-12-26 09:47:24,963][123091] Updated weights for policy 0, policy_version 1277352 (0.0008) [2023-12-26 09:47:24,970][123090] Updated weights for policy 1, policy_version 1268332 (0.0007) [2023-12-26 09:47:25,032][123090] Updated weights for policy 1, policy_version 1268342 (0.0006) [2023-12-26 09:47:25,098][123090] Updated weights for policy 1, policy_version 1268352 (0.0006) [2023-12-26 09:47:25,844][123091] Updated weights for policy 0, policy_version 1277362 (0.0009) [2023-12-26 09:47:25,845][123090] Updated weights for policy 1, policy_version 1268362 (0.0006) [2023-12-26 09:47:25,903][123091] Updated weights for policy 0, policy_version 1277372 (0.0007) [2023-12-26 09:47:25,904][123090] Updated weights for policy 1, policy_version 1268372 (0.0010) [2023-12-26 09:47:25,964][123091] Updated weights for policy 0, policy_version 1277382 (0.0009) [2023-12-26 09:47:25,965][123090] Updated weights for policy 1, policy_version 1268382 (0.0009) [2023-12-26 09:47:26,034][123091] Updated weights for policy 0, policy_version 1277392 (0.0009) [2023-12-26 09:47:26,756][123090] Updated weights for policy 1, policy_version 1268392 (0.0010) [2023-12-26 09:47:26,805][123090] Updated weights for policy 1, policy_version 1268402 (0.0008) [2023-12-26 09:47:26,820][123091] Updated weights for policy 0, policy_version 1277402 (0.0007) [2023-12-26 09:47:26,872][123091] Updated weights for policy 0, policy_version 1277412 (0.0009) [2023-12-26 09:47:26,875][123090] Updated weights for policy 1, policy_version 1268412 (0.0008) [2023-12-26 09:47:26,938][123091] Updated weights for policy 0, policy_version 1277422 (0.0008) [2023-12-26 09:47:27,572][123090] Updated weights for policy 1, policy_version 1268422 (0.0010) [2023-12-26 09:47:27,634][123090] Updated weights for policy 1, policy_version 1268432 (0.0010) [2023-12-26 09:47:27,704][123090] Updated weights for policy 1, policy_version 1268442 (0.0010) [2023-12-26 09:47:27,723][123091] Updated weights for policy 0, policy_version 1277432 (0.0006) [2023-12-26 09:47:27,777][123091] Updated weights for policy 0, policy_version 1277442 (0.0006) [2023-12-26 09:47:27,826][123091] Updated weights for policy 0, policy_version 1277452 (0.0005) [2023-12-26 09:47:28,487][123091] Updated weights for policy 0, policy_version 1277462 (0.0005) [2023-12-26 09:47:28,498][123090] Updated weights for policy 1, policy_version 1268452 (0.0009) [2023-12-26 09:47:28,543][123091] Updated weights for policy 0, policy_version 1277472 (0.0005) [2023-12-26 09:47:28,557][123090] Updated weights for policy 1, policy_version 1268462 (0.0010) [2023-12-26 09:47:28,604][123091] Updated weights for policy 0, policy_version 1277482 (0.0005) [2023-12-26 09:47:28,606][123090] Updated weights for policy 1, policy_version 1268472 (0.0010) [2023-12-26 09:47:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 651771904. Throughput: 0: 8820.7, 1: 8858.1. Samples: 651758920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:28,785][121949] Avg episode reward: [(0, '6285.605'), (1, '5097.125')] [2023-12-26 09:47:29,317][123091] Updated weights for policy 0, policy_version 1277492 (0.0006) [2023-12-26 09:47:29,385][123091] Updated weights for policy 0, policy_version 1277502 (0.0009) [2023-12-26 09:47:29,398][123090] Updated weights for policy 1, policy_version 1268482 (0.0010) [2023-12-26 09:47:29,450][123091] Updated weights for policy 0, policy_version 1277512 (0.0006) [2023-12-26 09:47:29,467][123090] Updated weights for policy 1, policy_version 1268492 (0.0010) [2023-12-26 09:47:29,534][123090] Updated weights for policy 1, policy_version 1268502 (0.0010) [2023-12-26 09:47:29,601][123090] Updated weights for policy 1, policy_version 1268512 (0.0010) [2023-12-26 09:47:30,275][123091] Updated weights for policy 0, policy_version 1277522 (0.0006) [2023-12-26 09:47:30,307][123090] Updated weights for policy 1, policy_version 1268522 (0.0006) [2023-12-26 09:47:30,341][123091] Updated weights for policy 0, policy_version 1277532 (0.0010) [2023-12-26 09:47:30,377][123090] Updated weights for policy 1, policy_version 1268532 (0.0007) [2023-12-26 09:47:30,405][123091] Updated weights for policy 0, policy_version 1277542 (0.0009) [2023-12-26 09:47:30,441][123090] Updated weights for policy 1, policy_version 1268542 (0.0005) [2023-12-26 09:47:30,471][123091] Updated weights for policy 0, policy_version 1277552 (0.0009) [2023-12-26 09:47:31,181][123090] Updated weights for policy 1, policy_version 1268552 (0.0008) [2023-12-26 09:47:31,247][123090] Updated weights for policy 1, policy_version 1268562 (0.0009) [2023-12-26 09:47:31,305][123090] Updated weights for policy 1, policy_version 1268572 (0.0009) [2023-12-26 09:47:31,342][123091] Updated weights for policy 0, policy_version 1277562 (0.0007) [2023-12-26 09:47:31,404][123091] Updated weights for policy 0, policy_version 1277572 (0.0009) [2023-12-26 09:47:31,460][123091] Updated weights for policy 0, policy_version 1277582 (0.0009) [2023-12-26 09:47:32,166][123090] Updated weights for policy 1, policy_version 1268582 (0.0010) [2023-12-26 09:47:32,232][123090] Updated weights for policy 1, policy_version 1268592 (0.0008) [2023-12-26 09:47:32,294][123091] Updated weights for policy 0, policy_version 1277592 (0.0007) [2023-12-26 09:47:32,296][123090] Updated weights for policy 1, policy_version 1268602 (0.0009) [2023-12-26 09:47:32,357][123091] Updated weights for policy 0, policy_version 1277602 (0.0007) [2023-12-26 09:47:32,422][123091] Updated weights for policy 0, policy_version 1277612 (0.0010) [2023-12-26 09:47:32,957][123090] Updated weights for policy 1, policy_version 1268612 (0.0008) [2023-12-26 09:47:33,013][123090] Updated weights for policy 1, policy_version 1268622 (0.0005) [2023-12-26 09:47:33,065][123090] Updated weights for policy 1, policy_version 1268632 (0.0005) [2023-12-26 09:47:33,284][123091] Updated weights for policy 0, policy_version 1277622 (0.0007) [2023-12-26 09:47:33,329][123091] Updated weights for policy 0, policy_version 1277632 (0.0005) [2023-12-26 09:47:33,373][123091] Updated weights for policy 0, policy_version 1277642 (0.0008) [2023-12-26 09:47:33,700][123090] Updated weights for policy 1, policy_version 1268642 (0.0005) [2023-12-26 09:47:33,754][123090] Updated weights for policy 1, policy_version 1268652 (0.0005) [2023-12-26 09:47:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 651853824. Throughput: 0: 8815.6, 1: 8850.2. Samples: 651868284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:33,785][121949] Avg episode reward: [(0, '6302.206'), (1, '5220.609')] [2023-12-26 09:47:33,809][123090] Updated weights for policy 1, policy_version 1268662 (0.0005) [2023-12-26 09:47:33,860][123090] Updated weights for policy 1, policy_version 1268672 (0.0005) [2023-12-26 09:47:34,193][123091] Updated weights for policy 0, policy_version 1277652 (0.0011) [2023-12-26 09:47:34,260][123091] Updated weights for policy 0, policy_version 1277662 (0.0011) [2023-12-26 09:47:34,328][123091] Updated weights for policy 0, policy_version 1277672 (0.0011) [2023-12-26 09:47:34,589][123090] Updated weights for policy 1, policy_version 1268682 (0.0011) [2023-12-26 09:47:34,657][123090] Updated weights for policy 1, policy_version 1268692 (0.0011) [2023-12-26 09:47:34,726][123090] Updated weights for policy 1, policy_version 1268702 (0.0011) [2023-12-26 09:47:35,147][123091] Updated weights for policy 0, policy_version 1277682 (0.0011) [2023-12-26 09:47:35,202][123091] Updated weights for policy 0, policy_version 1277692 (0.0011) [2023-12-26 09:47:35,257][123091] Updated weights for policy 0, policy_version 1277702 (0.0010) [2023-12-26 09:47:35,315][123091] Updated weights for policy 0, policy_version 1277712 (0.0010) [2023-12-26 09:47:35,543][123090] Updated weights for policy 1, policy_version 1268712 (0.0011) [2023-12-26 09:47:35,610][123090] Updated weights for policy 1, policy_version 1268722 (0.0010) [2023-12-26 09:47:35,674][123090] Updated weights for policy 1, policy_version 1268732 (0.0011) [2023-12-26 09:47:36,074][123091] Updated weights for policy 0, policy_version 1277722 (0.0011) [2023-12-26 09:47:36,142][123091] Updated weights for policy 0, policy_version 1277732 (0.0011) [2023-12-26 09:47:36,189][123091] Updated weights for policy 0, policy_version 1277742 (0.0006) [2023-12-26 09:47:36,492][123090] Updated weights for policy 1, policy_version 1268742 (0.0011) [2023-12-26 09:47:36,545][123090] Updated weights for policy 1, policy_version 1268752 (0.0011) [2023-12-26 09:47:36,614][123090] Updated weights for policy 1, policy_version 1268762 (0.0011) [2023-12-26 09:47:36,814][123091] Updated weights for policy 0, policy_version 1277752 (0.0005) [2023-12-26 09:47:36,876][123091] Updated weights for policy 0, policy_version 1277762 (0.0005) [2023-12-26 09:47:36,949][123091] Updated weights for policy 0, policy_version 1277772 (0.0006) [2023-12-26 09:47:37,392][123090] Updated weights for policy 1, policy_version 1268772 (0.0009) [2023-12-26 09:47:37,461][123090] Updated weights for policy 1, policy_version 1268782 (0.0006) [2023-12-26 09:47:37,524][123090] Updated weights for policy 1, policy_version 1268792 (0.0005) [2023-12-26 09:47:37,723][123091] Updated weights for policy 0, policy_version 1277782 (0.0011) [2023-12-26 09:47:37,777][123091] Updated weights for policy 0, policy_version 1277792 (0.0010) [2023-12-26 09:47:37,855][123091] Updated weights for policy 0, policy_version 1277802 (0.0011) [2023-12-26 09:47:38,193][123090] Updated weights for policy 1, policy_version 1268802 (0.0006) [2023-12-26 09:47:38,253][123090] Updated weights for policy 1, policy_version 1268812 (0.0011) [2023-12-26 09:47:38,346][123090] Updated weights for policy 1, policy_version 1268822 (0.0011) [2023-12-26 09:47:38,413][123090] Updated weights for policy 1, policy_version 1268832 (0.0011) [2023-12-26 09:47:38,602][123091] Updated weights for policy 0, policy_version 1277812 (0.0011) [2023-12-26 09:47:38,653][123091] Updated weights for policy 0, policy_version 1277822 (0.0010) [2023-12-26 09:47:38,712][123091] Updated weights for policy 0, policy_version 1277832 (0.0011) [2023-12-26 09:47:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 651952128. Throughput: 0: 8848.0, 1: 8882.1. Samples: 651921920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:38,785][121949] Avg episode reward: [(0, '6346.783'), (1, '5163.078')] [2023-12-26 09:47:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001277840_327131136.pth... [2023-12-26 09:47:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001268832_324820992.pth... [2023-12-26 09:47:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001276784_326860800.pth [2023-12-26 09:47:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001267776_324550656.pth [2023-12-26 09:47:39,197][123090] Updated weights for policy 1, policy_version 1268842 (0.0009) [2023-12-26 09:47:39,260][123090] Updated weights for policy 1, policy_version 1268852 (0.0010) [2023-12-26 09:47:39,322][123090] Updated weights for policy 1, policy_version 1268862 (0.0010) [2023-12-26 09:47:39,552][123091] Updated weights for policy 0, policy_version 1277842 (0.0010) [2023-12-26 09:47:39,612][123091] Updated weights for policy 0, policy_version 1277852 (0.0010) [2023-12-26 09:47:39,664][123091] Updated weights for policy 0, policy_version 1277862 (0.0009) [2023-12-26 09:47:39,722][123091] Updated weights for policy 0, policy_version 1277872 (0.0010) [2023-12-26 09:47:40,107][123090] Updated weights for policy 1, policy_version 1268872 (0.0009) [2023-12-26 09:47:40,167][123090] Updated weights for policy 1, policy_version 1268882 (0.0008) [2023-12-26 09:47:40,223][123090] Updated weights for policy 1, policy_version 1268892 (0.0008) [2023-12-26 09:47:40,649][123091] Updated weights for policy 0, policy_version 1277882 (0.0006) [2023-12-26 09:47:40,715][123091] Updated weights for policy 0, policy_version 1277892 (0.0010) [2023-12-26 09:47:40,772][123091] Updated weights for policy 0, policy_version 1277902 (0.0010) [2023-12-26 09:47:40,988][123090] Updated weights for policy 1, policy_version 1268902 (0.0009) [2023-12-26 09:47:41,049][123090] Updated weights for policy 1, policy_version 1268912 (0.0011) [2023-12-26 09:47:41,118][123090] Updated weights for policy 1, policy_version 1268922 (0.0010) [2023-12-26 09:47:41,575][123091] Updated weights for policy 0, policy_version 1277912 (0.0009) [2023-12-26 09:47:41,637][123091] Updated weights for policy 0, policy_version 1277922 (0.0007) [2023-12-26 09:47:41,701][123091] Updated weights for policy 0, policy_version 1277932 (0.0010) [2023-12-26 09:47:41,962][123090] Updated weights for policy 1, policy_version 1268932 (0.0010) [2023-12-26 09:47:42,028][123090] Updated weights for policy 1, policy_version 1268942 (0.0009) [2023-12-26 09:47:42,077][123090] Updated weights for policy 1, policy_version 1268952 (0.0009) [2023-12-26 09:47:42,568][123091] Updated weights for policy 0, policy_version 1277942 (0.0009) [2023-12-26 09:47:42,633][123091] Updated weights for policy 0, policy_version 1277952 (0.0010) [2023-12-26 09:47:42,694][123091] Updated weights for policy 0, policy_version 1277962 (0.0010) [2023-12-26 09:47:42,816][123090] Updated weights for policy 1, policy_version 1268962 (0.0009) [2023-12-26 09:47:42,870][123090] Updated weights for policy 1, policy_version 1268972 (0.0006) [2023-12-26 09:47:42,940][123090] Updated weights for policy 1, policy_version 1268982 (0.0006) [2023-12-26 09:47:43,001][123090] Updated weights for policy 1, policy_version 1268992 (0.0009) [2023-12-26 09:47:43,546][123091] Updated weights for policy 0, policy_version 1277972 (0.0008) [2023-12-26 09:47:43,607][123091] Updated weights for policy 0, policy_version 1277982 (0.0010) [2023-12-26 09:47:43,673][123091] Updated weights for policy 0, policy_version 1277992 (0.0010) [2023-12-26 09:47:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 652034048. Throughput: 0: 8791.3, 1: 8906.9. Samples: 652027424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:43,785][121949] Avg episode reward: [(0, '6261.142'), (1, '5060.891')] [2023-12-26 09:47:43,805][123090] Updated weights for policy 1, policy_version 1269002 (0.0005) [2023-12-26 09:47:43,877][123090] Updated weights for policy 1, policy_version 1269012 (0.0005) [2023-12-26 09:47:43,951][123090] Updated weights for policy 1, policy_version 1269022 (0.0005) [2023-12-26 09:47:44,484][123091] Updated weights for policy 0, policy_version 1278002 (0.0010) [2023-12-26 09:47:44,545][123091] Updated weights for policy 0, policy_version 1278013 (0.0010) [2023-12-26 09:47:44,589][123090] Updated weights for policy 1, policy_version 1269032 (0.0006) [2023-12-26 09:47:44,603][123091] Updated weights for policy 0, policy_version 1278023 (0.0009) [2023-12-26 09:47:44,656][123090] Updated weights for policy 1, policy_version 1269042 (0.0005) [2023-12-26 09:47:44,706][123090] Updated weights for policy 1, policy_version 1269052 (0.0009) [2023-12-26 09:47:45,434][123091] Updated weights for policy 0, policy_version 1278033 (0.0008) [2023-12-26 09:47:45,501][123091] Updated weights for policy 0, policy_version 1278043 (0.0010) [2023-12-26 09:47:45,534][123090] Updated weights for policy 1, policy_version 1269062 (0.0008) [2023-12-26 09:47:45,562][123091] Updated weights for policy 0, policy_version 1278053 (0.0008) [2023-12-26 09:47:45,596][123090] Updated weights for policy 1, policy_version 1269072 (0.0009) [2023-12-26 09:47:45,628][123091] Updated weights for policy 0, policy_version 1278063 (0.0008) [2023-12-26 09:47:45,665][123090] Updated weights for policy 1, policy_version 1269082 (0.0006) [2023-12-26 09:47:46,292][123090] Updated weights for policy 1, policy_version 1269092 (0.0005) [2023-12-26 09:47:46,350][123090] Updated weights for policy 1, policy_version 1269102 (0.0010) [2023-12-26 09:47:46,411][123090] Updated weights for policy 1, policy_version 1269112 (0.0009) [2023-12-26 09:47:46,502][123091] Updated weights for policy 0, policy_version 1278073 (0.0009) [2023-12-26 09:47:46,569][123091] Updated weights for policy 0, policy_version 1278083 (0.0009) [2023-12-26 09:47:46,627][123091] Updated weights for policy 0, policy_version 1278093 (0.0010) [2023-12-26 09:47:47,135][123090] Updated weights for policy 1, policy_version 1269122 (0.0009) [2023-12-26 09:47:47,190][123090] Updated weights for policy 1, policy_version 1269132 (0.0009) [2023-12-26 09:47:47,245][123090] Updated weights for policy 1, policy_version 1269142 (0.0009) [2023-12-26 09:47:47,288][123091] Updated weights for policy 0, policy_version 1278103 (0.0008) [2023-12-26 09:47:47,294][123090] Updated weights for policy 1, policy_version 1269152 (0.0008) [2023-12-26 09:47:47,342][123091] Updated weights for policy 0, policy_version 1278113 (0.0008) [2023-12-26 09:47:47,400][123091] Updated weights for policy 0, policy_version 1278123 (0.0009) [2023-12-26 09:47:48,102][123090] Updated weights for policy 1, policy_version 1269162 (0.0005) [2023-12-26 09:47:48,159][123090] Updated weights for policy 1, policy_version 1269172 (0.0006) [2023-12-26 09:47:48,206][123090] Updated weights for policy 1, policy_version 1269182 (0.0005) [2023-12-26 09:47:48,284][123091] Updated weights for policy 0, policy_version 1278133 (0.0008) [2023-12-26 09:47:48,354][123091] Updated weights for policy 0, policy_version 1278143 (0.0010) [2023-12-26 09:47:48,419][123091] Updated weights for policy 0, policy_version 1278153 (0.0009) [2023-12-26 09:47:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 652124160. Throughput: 0: 8803.1, 1: 8982.6. Samples: 652135824. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:48,785][121949] Avg episode reward: [(0, '6238.595'), (1, '5109.343')] [2023-12-26 09:47:49,000][123090] Updated weights for policy 1, policy_version 1269192 (0.0005) [2023-12-26 09:47:49,071][123090] Updated weights for policy 1, policy_version 1269202 (0.0005) [2023-12-26 09:47:49,142][123090] Updated weights for policy 1, policy_version 1269212 (0.0005) [2023-12-26 09:47:49,283][123091] Updated weights for policy 0, policy_version 1278163 (0.0010) [2023-12-26 09:47:49,345][123091] Updated weights for policy 0, policy_version 1278173 (0.0010) [2023-12-26 09:47:49,414][123091] Updated weights for policy 0, policy_version 1278183 (0.0009) [2023-12-26 09:47:49,818][123090] Updated weights for policy 1, policy_version 1269222 (0.0008) [2023-12-26 09:47:49,893][123090] Updated weights for policy 1, policy_version 1269232 (0.0010) [2023-12-26 09:47:49,964][123090] Updated weights for policy 1, policy_version 1269242 (0.0010) [2023-12-26 09:47:50,241][123091] Updated weights for policy 0, policy_version 1278193 (0.0009) [2023-12-26 09:47:50,297][123091] Updated weights for policy 0, policy_version 1278203 (0.0008) [2023-12-26 09:47:50,360][123091] Updated weights for policy 0, policy_version 1278213 (0.0007) [2023-12-26 09:47:50,420][123091] Updated weights for policy 0, policy_version 1278223 (0.0009) [2023-12-26 09:47:50,820][123090] Updated weights for policy 1, policy_version 1269252 (0.0008) [2023-12-26 09:47:50,895][123090] Updated weights for policy 1, policy_version 1269262 (0.0006) [2023-12-26 09:47:50,957][123090] Updated weights for policy 1, policy_version 1269272 (0.0008) [2023-12-26 09:47:51,228][123091] Updated weights for policy 0, policy_version 1278233 (0.0009) [2023-12-26 09:47:51,296][123091] Updated weights for policy 0, policy_version 1278243 (0.0011) [2023-12-26 09:47:51,367][123091] Updated weights for policy 0, policy_version 1278253 (0.0010) [2023-12-26 09:47:51,775][123090] Updated weights for policy 1, policy_version 1269282 (0.0010) [2023-12-26 09:47:51,842][123090] Updated weights for policy 1, policy_version 1269292 (0.0010) [2023-12-26 09:47:51,907][123090] Updated weights for policy 1, policy_version 1269302 (0.0009) [2023-12-26 09:47:51,980][123090] Updated weights for policy 1, policy_version 1269312 (0.0010) [2023-12-26 09:47:52,215][123091] Updated weights for policy 0, policy_version 1278263 (0.0010) [2023-12-26 09:47:52,272][123091] Updated weights for policy 0, policy_version 1278273 (0.0007) [2023-12-26 09:47:52,337][123091] Updated weights for policy 0, policy_version 1278283 (0.0008) [2023-12-26 09:47:52,857][123090] Updated weights for policy 1, policy_version 1269322 (0.0010) [2023-12-26 09:47:52,916][123090] Updated weights for policy 1, policy_version 1269332 (0.0010) [2023-12-26 09:47:52,974][123090] Updated weights for policy 1, policy_version 1269342 (0.0010) [2023-12-26 09:47:53,134][123091] Updated weights for policy 0, policy_version 1278293 (0.0008) [2023-12-26 09:47:53,200][123091] Updated weights for policy 0, policy_version 1278303 (0.0006) [2023-12-26 09:47:53,259][123091] Updated weights for policy 0, policy_version 1278313 (0.0005) [2023-12-26 09:47:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 652206080. Throughput: 0: 8793.0, 1: 8982.7. Samples: 652186848. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:53,785][121949] Avg episode reward: [(0, '6254.576'), (1, '5012.989')] [2023-12-26 09:47:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001278320_327254016.pth... [2023-12-26 09:47:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001277328_327000064.pth [2023-12-26 09:47:53,839][123090] Updated weights for policy 1, policy_version 1269352 (0.0006) [2023-12-26 09:47:53,878][123091] Updated weights for policy 0, policy_version 1278323 (0.0005) [2023-12-26 09:47:53,893][123090] Updated weights for policy 1, policy_version 1269362 (0.0005) [2023-12-26 09:47:53,933][123091] Updated weights for policy 0, policy_version 1278333 (0.0005) [2023-12-26 09:47:53,951][123090] Updated weights for policy 1, policy_version 1269372 (0.0005) [2023-12-26 09:47:53,970][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001269376_324960256.pth... [2023-12-26 09:47:53,973][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001268288_324681728.pth [2023-12-26 09:47:53,989][123091] Updated weights for policy 0, policy_version 1278343 (0.0005) [2023-12-26 09:47:54,582][123091] Updated weights for policy 0, policy_version 1278353 (0.0006) [2023-12-26 09:47:54,642][123091] Updated weights for policy 0, policy_version 1278363 (0.0010) [2023-12-26 09:47:54,704][123091] Updated weights for policy 0, policy_version 1278373 (0.0007) [2023-12-26 09:47:54,720][123090] Updated weights for policy 1, policy_version 1269382 (0.0008) [2023-12-26 09:47:54,756][123091] Updated weights for policy 0, policy_version 1278383 (0.0010) [2023-12-26 09:47:54,781][123090] Updated weights for policy 1, policy_version 1269392 (0.0007) [2023-12-26 09:47:54,840][123090] Updated weights for policy 1, policy_version 1269402 (0.0009) [2023-12-26 09:47:55,541][123090] Updated weights for policy 1, policy_version 1269412 (0.0007) [2023-12-26 09:47:55,609][123090] Updated weights for policy 1, policy_version 1269422 (0.0009) [2023-12-26 09:47:55,621][123091] Updated weights for policy 0, policy_version 1278393 (0.0007) [2023-12-26 09:47:55,666][123090] Updated weights for policy 1, policy_version 1269432 (0.0008) [2023-12-26 09:47:55,678][123091] Updated weights for policy 0, policy_version 1278403 (0.0008) [2023-12-26 09:47:55,740][123091] Updated weights for policy 0, policy_version 1278413 (0.0009) [2023-12-26 09:47:56,443][123091] Updated weights for policy 0, policy_version 1278423 (0.0007) [2023-12-26 09:47:56,492][123091] Updated weights for policy 0, policy_version 1278433 (0.0005) [2023-12-26 09:47:56,543][123091] Updated weights for policy 0, policy_version 1278443 (0.0006) [2023-12-26 09:47:56,547][123090] Updated weights for policy 1, policy_version 1269442 (0.0008) [2023-12-26 09:47:56,613][123090] Updated weights for policy 1, policy_version 1269452 (0.0009) [2023-12-26 09:47:56,671][123090] Updated weights for policy 1, policy_version 1269462 (0.0006) [2023-12-26 09:47:56,723][123090] Updated weights for policy 1, policy_version 1269472 (0.0005) [2023-12-26 09:47:57,237][123091] Updated weights for policy 0, policy_version 1278453 (0.0005) [2023-12-26 09:47:57,285][123091] Updated weights for policy 0, policy_version 1278463 (0.0005) [2023-12-26 09:47:57,333][123091] Updated weights for policy 0, policy_version 1278473 (0.0007) [2023-12-26 09:47:57,490][123090] Updated weights for policy 1, policy_version 1269482 (0.0008) [2023-12-26 09:47:57,541][123090] Updated weights for policy 1, policy_version 1269492 (0.0008) [2023-12-26 09:47:57,588][123090] Updated weights for policy 1, policy_version 1269502 (0.0009) [2023-12-26 09:47:58,146][123091] Updated weights for policy 0, policy_version 1278483 (0.0011) [2023-12-26 09:47:58,242][123091] Updated weights for policy 0, policy_version 1278493 (0.0010) [2023-12-26 09:47:58,293][123091] Updated weights for policy 0, policy_version 1278503 (0.0010) [2023-12-26 09:47:58,457][123090] Updated weights for policy 1, policy_version 1269512 (0.0007) [2023-12-26 09:47:58,520][123090] Updated weights for policy 1, policy_version 1269522 (0.0007) [2023-12-26 09:47:58,587][123090] Updated weights for policy 1, policy_version 1269532 (0.0008) [2023-12-26 09:47:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 652304384. Throughput: 0: 8876.7, 1: 9000.9. Samples: 652296428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:47:58,785][121949] Avg episode reward: [(0, '6213.297'), (1, '4928.980')] [2023-12-26 09:47:59,095][123091] Updated weights for policy 0, policy_version 1278513 (0.0011) [2023-12-26 09:47:59,163][123091] Updated weights for policy 0, policy_version 1278523 (0.0010) [2023-12-26 09:47:59,214][123091] Updated weights for policy 0, policy_version 1278533 (0.0010) [2023-12-26 09:47:59,276][123091] Updated weights for policy 0, policy_version 1278543 (0.0011) [2023-12-26 09:47:59,336][123090] Updated weights for policy 1, policy_version 1269542 (0.0009) [2023-12-26 09:47:59,409][123090] Updated weights for policy 1, policy_version 1269552 (0.0009) [2023-12-26 09:47:59,467][123090] Updated weights for policy 1, policy_version 1269562 (0.0009) [2023-12-26 09:48:00,140][123091] Updated weights for policy 0, policy_version 1278553 (0.0010) [2023-12-26 09:48:00,208][123091] Updated weights for policy 0, policy_version 1278563 (0.0008) [2023-12-26 09:48:00,275][123090] Updated weights for policy 1, policy_version 1269572 (0.0008) [2023-12-26 09:48:00,279][123091] Updated weights for policy 0, policy_version 1278573 (0.0009) [2023-12-26 09:48:00,339][123090] Updated weights for policy 1, policy_version 1269582 (0.0009) [2023-12-26 09:48:00,411][123090] Updated weights for policy 1, policy_version 1269592 (0.0008) [2023-12-26 09:48:01,106][123091] Updated weights for policy 0, policy_version 1278583 (0.0009) [2023-12-26 09:48:01,170][123091] Updated weights for policy 0, policy_version 1278593 (0.0010) [2023-12-26 09:48:01,207][123090] Updated weights for policy 1, policy_version 1269602 (0.0009) [2023-12-26 09:48:01,236][123091] Updated weights for policy 0, policy_version 1278603 (0.0008) [2023-12-26 09:48:01,269][123090] Updated weights for policy 1, policy_version 1269612 (0.0009) [2023-12-26 09:48:01,329][123090] Updated weights for policy 1, policy_version 1269622 (0.0009) [2023-12-26 09:48:01,399][123090] Updated weights for policy 1, policy_version 1269632 (0.0009) [2023-12-26 09:48:02,063][123091] Updated weights for policy 0, policy_version 1278613 (0.0009) [2023-12-26 09:48:02,099][123090] Updated weights for policy 1, policy_version 1269642 (0.0006) [2023-12-26 09:48:02,125][123091] Updated weights for policy 0, policy_version 1278623 (0.0007) [2023-12-26 09:48:02,167][123090] Updated weights for policy 1, policy_version 1269652 (0.0007) [2023-12-26 09:48:02,183][123091] Updated weights for policy 0, policy_version 1278633 (0.0008) [2023-12-26 09:48:02,232][123090] Updated weights for policy 1, policy_version 1269662 (0.0007) [2023-12-26 09:48:02,957][123090] Updated weights for policy 1, policy_version 1269672 (0.0005) [2023-12-26 09:48:03,006][123090] Updated weights for policy 1, policy_version 1269682 (0.0006) [2023-12-26 09:48:03,034][123091] Updated weights for policy 0, policy_version 1278643 (0.0009) [2023-12-26 09:48:03,062][123090] Updated weights for policy 1, policy_version 1269692 (0.0010) [2023-12-26 09:48:03,082][123091] Updated weights for policy 0, policy_version 1278653 (0.0005) [2023-12-26 09:48:03,132][123091] Updated weights for policy 0, policy_version 1278663 (0.0009) [2023-12-26 09:48:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 652386304. Throughput: 0: 8752.3, 1: 9031.9. Samples: 652400648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:03,784][121949] Avg episode reward: [(0, '6197.871'), (1, '5027.771')] [2023-12-26 09:48:03,895][123090] Updated weights for policy 1, policy_version 1269702 (0.0010) [2023-12-26 09:48:03,951][123090] Updated weights for policy 1, policy_version 1269712 (0.0010) [2023-12-26 09:48:03,978][123091] Updated weights for policy 0, policy_version 1278673 (0.0009) [2023-12-26 09:48:04,007][123090] Updated weights for policy 1, policy_version 1269722 (0.0009) [2023-12-26 09:48:04,043][123091] Updated weights for policy 0, policy_version 1278683 (0.0007) [2023-12-26 09:48:04,112][123091] Updated weights for policy 0, policy_version 1278693 (0.0006) [2023-12-26 09:48:04,171][123091] Updated weights for policy 0, policy_version 1278703 (0.0006) [2023-12-26 09:48:04,835][123090] Updated weights for policy 1, policy_version 1269732 (0.0007) [2023-12-26 09:48:04,887][123090] Updated weights for policy 1, policy_version 1269742 (0.0006) [2023-12-26 09:48:04,936][123090] Updated weights for policy 1, policy_version 1269752 (0.0005) [2023-12-26 09:48:04,941][123091] Updated weights for policy 0, policy_version 1278713 (0.0008) [2023-12-26 09:48:04,991][123091] Updated weights for policy 0, policy_version 1278723 (0.0009) [2023-12-26 09:48:05,048][123091] Updated weights for policy 0, policy_version 1278734 (0.0010) [2023-12-26 09:48:05,629][123090] Updated weights for policy 1, policy_version 1269762 (0.0005) [2023-12-26 09:48:05,695][123090] Updated weights for policy 1, policy_version 1269772 (0.0006) [2023-12-26 09:48:05,754][123090] Updated weights for policy 1, policy_version 1269782 (0.0005) [2023-12-26 09:48:05,815][123090] Updated weights for policy 1, policy_version 1269792 (0.0005) [2023-12-26 09:48:06,003][123091] Updated weights for policy 0, policy_version 1278744 (0.0009) [2023-12-26 09:48:06,058][123091] Updated weights for policy 0, policy_version 1278755 (0.0010) [2023-12-26 09:48:06,126][123091] Updated weights for policy 0, policy_version 1278765 (0.0007) [2023-12-26 09:48:06,488][123090] Updated weights for policy 1, policy_version 1269802 (0.0006) [2023-12-26 09:48:06,561][123090] Updated weights for policy 1, policy_version 1269812 (0.0005) [2023-12-26 09:48:06,632][123090] Updated weights for policy 1, policy_version 1269822 (0.0006) [2023-12-26 09:48:06,914][123091] Updated weights for policy 0, policy_version 1278775 (0.0008) [2023-12-26 09:48:06,976][123091] Updated weights for policy 0, policy_version 1278785 (0.0010) [2023-12-26 09:48:07,042][123091] Updated weights for policy 0, policy_version 1278795 (0.0009) [2023-12-26 09:48:07,393][123090] Updated weights for policy 1, policy_version 1269832 (0.0011) [2023-12-26 09:48:07,441][123090] Updated weights for policy 1, policy_version 1269842 (0.0010) [2023-12-26 09:48:07,496][123090] Updated weights for policy 1, policy_version 1269852 (0.0010) [2023-12-26 09:48:07,841][123091] Updated weights for policy 0, policy_version 1278805 (0.0009) [2023-12-26 09:48:07,889][123091] Updated weights for policy 0, policy_version 1278815 (0.0009) [2023-12-26 09:48:07,954][123091] Updated weights for policy 0, policy_version 1278825 (0.0010) [2023-12-26 09:48:08,332][123090] Updated weights for policy 1, policy_version 1269862 (0.0010) [2023-12-26 09:48:08,392][123090] Updated weights for policy 1, policy_version 1269872 (0.0009) [2023-12-26 09:48:08,451][123090] Updated weights for policy 1, policy_version 1269882 (0.0009) [2023-12-26 09:48:08,784][123091] Updated weights for policy 0, policy_version 1278835 (0.0010) [2023-12-26 09:48:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 652476416. Throughput: 0: 8732.6, 1: 9127.3. Samples: 652454964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:08,785][121949] Avg episode reward: [(0, '6238.398'), (1, '5371.567')] [2023-12-26 09:48:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001269888_325091328.pth... [2023-12-26 09:48:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001268832_324820992.pth [2023-12-26 09:48:08,842][123091] Updated weights for policy 0, policy_version 1278845 (0.0010) [2023-12-26 09:48:08,912][123091] Updated weights for policy 0, policy_version 1278855 (0.0010) [2023-12-26 09:48:08,965][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001278864_327393280.pth... [2023-12-26 09:48:08,968][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001277840_327131136.pth [2023-12-26 09:48:09,173][123090] Updated weights for policy 1, policy_version 1269892 (0.0007) [2023-12-26 09:48:09,245][123090] Updated weights for policy 1, policy_version 1269902 (0.0007) [2023-12-26 09:48:09,301][123090] Updated weights for policy 1, policy_version 1269912 (0.0009) [2023-12-26 09:48:09,783][123091] Updated weights for policy 0, policy_version 1278865 (0.0010) [2023-12-26 09:48:09,851][123091] Updated weights for policy 0, policy_version 1278875 (0.0014) [2023-12-26 09:48:09,920][123091] Updated weights for policy 0, policy_version 1278885 (0.0008) [2023-12-26 09:48:09,988][123091] Updated weights for policy 0, policy_version 1278895 (0.0008) [2023-12-26 09:48:10,095][123090] Updated weights for policy 1, policy_version 1269922 (0.0009) [2023-12-26 09:48:10,158][123090] Updated weights for policy 1, policy_version 1269932 (0.0008) [2023-12-26 09:48:10,225][123090] Updated weights for policy 1, policy_version 1269942 (0.0008) [2023-12-26 09:48:10,287][123090] Updated weights for policy 1, policy_version 1269952 (0.0008) [2023-12-26 09:48:10,724][123091] Updated weights for policy 0, policy_version 1278905 (0.0010) [2023-12-26 09:48:10,788][123091] Updated weights for policy 0, policy_version 1278915 (0.0011) [2023-12-26 09:48:10,852][123091] Updated weights for policy 0, policy_version 1278925 (0.0011) [2023-12-26 09:48:10,955][123090] Updated weights for policy 1, policy_version 1269962 (0.0009) [2023-12-26 09:48:11,010][123090] Updated weights for policy 1, policy_version 1269972 (0.0010) [2023-12-26 09:48:11,079][123090] Updated weights for policy 1, policy_version 1269982 (0.0008) [2023-12-26 09:48:11,676][123091] Updated weights for policy 0, policy_version 1278935 (0.0009) [2023-12-26 09:48:11,742][123091] Updated weights for policy 0, policy_version 1278945 (0.0008) [2023-12-26 09:48:11,816][123091] Updated weights for policy 0, policy_version 1278955 (0.0007) [2023-12-26 09:48:11,955][123090] Updated weights for policy 1, policy_version 1269992 (0.0009) [2023-12-26 09:48:12,022][123090] Updated weights for policy 1, policy_version 1270002 (0.0010) [2023-12-26 09:48:12,089][123090] Updated weights for policy 1, policy_version 1270012 (0.0010) [2023-12-26 09:48:12,627][123091] Updated weights for policy 0, policy_version 1278965 (0.0009) [2023-12-26 09:48:12,678][123091] Updated weights for policy 0, policy_version 1278975 (0.0010) [2023-12-26 09:48:12,735][123091] Updated weights for policy 0, policy_version 1278985 (0.0009) [2023-12-26 09:48:12,917][123090] Updated weights for policy 1, policy_version 1270022 (0.0010) [2023-12-26 09:48:12,980][123090] Updated weights for policy 1, policy_version 1270032 (0.0009) [2023-12-26 09:48:13,032][123090] Updated weights for policy 1, policy_version 1270042 (0.0010) [2023-12-26 09:48:13,557][123091] Updated weights for policy 0, policy_version 1278995 (0.0008) [2023-12-26 09:48:13,603][123091] Updated weights for policy 0, policy_version 1279005 (0.0005) [2023-12-26 09:48:13,650][123091] Updated weights for policy 0, policy_version 1279015 (0.0005) [2023-12-26 09:48:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 652566528. Throughput: 0: 8765.3, 1: 9014.6. Samples: 652559020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:13,785][121949] Avg episode reward: [(0, '6182.388'), (1, '5434.018')] [2023-12-26 09:48:13,827][123090] Updated weights for policy 1, policy_version 1270052 (0.0008) [2023-12-26 09:48:13,877][123090] Updated weights for policy 1, policy_version 1270062 (0.0005) [2023-12-26 09:48:13,940][123090] Updated weights for policy 1, policy_version 1270072 (0.0005) [2023-12-26 09:48:14,454][123091] Updated weights for policy 0, policy_version 1279025 (0.0006) [2023-12-26 09:48:14,509][123091] Updated weights for policy 0, policy_version 1279035 (0.0009) [2023-12-26 09:48:14,570][123091] Updated weights for policy 0, policy_version 1279046 (0.0009) [2023-12-26 09:48:14,625][123091] Updated weights for policy 0, policy_version 1279056 (0.0009) [2023-12-26 09:48:14,659][123090] Updated weights for policy 1, policy_version 1270082 (0.0006) [2023-12-26 09:48:14,706][123090] Updated weights for policy 1, policy_version 1270092 (0.0009) [2023-12-26 09:48:14,773][123090] Updated weights for policy 1, policy_version 1270103 (0.0009) [2023-12-26 09:48:15,506][123091] Updated weights for policy 0, policy_version 1279066 (0.0011) [2023-12-26 09:48:15,577][123091] Updated weights for policy 0, policy_version 1279076 (0.0008) [2023-12-26 09:48:15,596][123090] Updated weights for policy 1, policy_version 1270113 (0.0009) [2023-12-26 09:48:15,642][123091] Updated weights for policy 0, policy_version 1279086 (0.0009) [2023-12-26 09:48:15,657][123090] Updated weights for policy 1, policy_version 1270123 (0.0008) [2023-12-26 09:48:15,713][123090] Updated weights for policy 1, policy_version 1270133 (0.0010) [2023-12-26 09:48:15,774][123090] Updated weights for policy 1, policy_version 1270143 (0.0009) [2023-12-26 09:48:16,435][123091] Updated weights for policy 0, policy_version 1279096 (0.0009) [2023-12-26 09:48:16,500][123091] Updated weights for policy 0, policy_version 1279106 (0.0010) [2023-12-26 09:48:16,563][123091] Updated weights for policy 0, policy_version 1279116 (0.0007) [2023-12-26 09:48:16,603][123090] Updated weights for policy 1, policy_version 1270153 (0.0009) [2023-12-26 09:48:16,657][123090] Updated weights for policy 1, policy_version 1270164 (0.0010) [2023-12-26 09:48:16,722][123090] Updated weights for policy 1, policy_version 1270174 (0.0009) [2023-12-26 09:48:17,307][123091] Updated weights for policy 0, policy_version 1279126 (0.0009) [2023-12-26 09:48:17,361][123091] Updated weights for policy 0, policy_version 1279136 (0.0010) [2023-12-26 09:48:17,412][123091] Updated weights for policy 0, policy_version 1279146 (0.0010) [2023-12-26 09:48:17,601][123090] Updated weights for policy 1, policy_version 1270184 (0.0008) [2023-12-26 09:48:17,666][123090] Updated weights for policy 1, policy_version 1270194 (0.0010) [2023-12-26 09:48:17,728][123090] Updated weights for policy 1, policy_version 1270204 (0.0010) [2023-12-26 09:48:18,150][123091] Updated weights for policy 0, policy_version 1279156 (0.0010) [2023-12-26 09:48:18,205][123091] Updated weights for policy 0, policy_version 1279166 (0.0010) [2023-12-26 09:48:18,275][123091] Updated weights for policy 0, policy_version 1279176 (0.0011) [2023-12-26 09:48:18,534][123090] Updated weights for policy 1, policy_version 1270214 (0.0007) [2023-12-26 09:48:18,602][123090] Updated weights for policy 1, policy_version 1270224 (0.0006) [2023-12-26 09:48:18,664][123090] Updated weights for policy 1, policy_version 1270234 (0.0010) [2023-12-26 09:48:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 652656640. Throughput: 0: 8752.3, 1: 8963.8. Samples: 652665508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:18,785][121949] Avg episode reward: [(0, '6241.112'), (1, '5134.939')] [2023-12-26 09:48:19,067][123091] Updated weights for policy 0, policy_version 1279186 (0.0010) [2023-12-26 09:48:19,131][123091] Updated weights for policy 0, policy_version 1279196 (0.0009) [2023-12-26 09:48:19,200][123091] Updated weights for policy 0, policy_version 1279206 (0.0009) [2023-12-26 09:48:19,270][123091] Updated weights for policy 0, policy_version 1279216 (0.0010) [2023-12-26 09:48:19,442][123090] Updated weights for policy 1, policy_version 1270244 (0.0010) [2023-12-26 09:48:19,511][123090] Updated weights for policy 1, policy_version 1270254 (0.0011) [2023-12-26 09:48:19,570][123090] Updated weights for policy 1, policy_version 1270264 (0.0010) [2023-12-26 09:48:20,094][123091] Updated weights for policy 0, policy_version 1279226 (0.0009) [2023-12-26 09:48:20,149][123091] Updated weights for policy 0, policy_version 1279236 (0.0009) [2023-12-26 09:48:20,202][123091] Updated weights for policy 0, policy_version 1279246 (0.0009) [2023-12-26 09:48:20,425][123090] Updated weights for policy 1, policy_version 1270274 (0.0011) [2023-12-26 09:48:20,492][123090] Updated weights for policy 1, policy_version 1270284 (0.0011) [2023-12-26 09:48:20,563][123090] Updated weights for policy 1, policy_version 1270294 (0.0010) [2023-12-26 09:48:20,634][123090] Updated weights for policy 1, policy_version 1270304 (0.0009) [2023-12-26 09:48:21,104][123091] Updated weights for policy 0, policy_version 1279256 (0.0010) [2023-12-26 09:48:21,176][123091] Updated weights for policy 0, policy_version 1279266 (0.0009) [2023-12-26 09:48:21,242][123091] Updated weights for policy 0, policy_version 1279276 (0.0010) [2023-12-26 09:48:21,421][123090] Updated weights for policy 1, policy_version 1270314 (0.0008) [2023-12-26 09:48:21,480][123090] Updated weights for policy 1, policy_version 1270324 (0.0010) [2023-12-26 09:48:21,533][123090] Updated weights for policy 1, policy_version 1270334 (0.0009) [2023-12-26 09:48:22,067][123091] Updated weights for policy 0, policy_version 1279286 (0.0010) [2023-12-26 09:48:22,122][123091] Updated weights for policy 0, policy_version 1279296 (0.0010) [2023-12-26 09:48:22,181][123091] Updated weights for policy 0, policy_version 1279306 (0.0010) [2023-12-26 09:48:22,423][123090] Updated weights for policy 1, policy_version 1270344 (0.0010) [2023-12-26 09:48:22,476][123090] Updated weights for policy 1, policy_version 1270354 (0.0009) [2023-12-26 09:48:22,530][123090] Updated weights for policy 1, policy_version 1270364 (0.0010) [2023-12-26 09:48:23,058][123091] Updated weights for policy 0, policy_version 1279316 (0.0010) [2023-12-26 09:48:23,144][123091] Updated weights for policy 0, policy_version 1279326 (0.0009) [2023-12-26 09:48:23,210][123091] Updated weights for policy 0, policy_version 1279336 (0.0010) [2023-12-26 09:48:23,361][123090] Updated weights for policy 1, policy_version 1270374 (0.0006) [2023-12-26 09:48:23,437][123090] Updated weights for policy 1, policy_version 1270384 (0.0005) [2023-12-26 09:48:23,513][123090] Updated weights for policy 1, policy_version 1270394 (0.0006) [2023-12-26 09:48:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 652738560. Throughput: 0: 8705.8, 1: 8932.3. Samples: 652715640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:23,786][121949] Avg episode reward: [(0, '6375.470'), (1, '4925.181')] [2023-12-26 09:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001270400_325222400.pth... [2023-12-26 09:48:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001279344_327516160.pth... [2023-12-26 09:48:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001269376_324960256.pth [2023-12-26 09:48:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001278320_327254016.pth [2023-12-26 09:48:24,053][123091] Updated weights for policy 0, policy_version 1279346 (0.0009) [2023-12-26 09:48:24,110][123091] Updated weights for policy 0, policy_version 1279356 (0.0010) [2023-12-26 09:48:24,173][123091] Updated weights for policy 0, policy_version 1279366 (0.0009) [2023-12-26 09:48:24,238][123091] Updated weights for policy 0, policy_version 1279376 (0.0009) [2023-12-26 09:48:24,263][123090] Updated weights for policy 1, policy_version 1270404 (0.0008) [2023-12-26 09:48:24,332][123090] Updated weights for policy 1, policy_version 1270414 (0.0009) [2023-12-26 09:48:24,386][123090] Updated weights for policy 1, policy_version 1270424 (0.0009) [2023-12-26 09:48:25,077][123091] Updated weights for policy 0, policy_version 1279386 (0.0009) [2023-12-26 09:48:25,141][123091] Updated weights for policy 0, policy_version 1279396 (0.0010) [2023-12-26 09:48:25,199][123090] Updated weights for policy 1, policy_version 1270434 (0.0009) [2023-12-26 09:48:25,206][123091] Updated weights for policy 0, policy_version 1279406 (0.0008) [2023-12-26 09:48:25,257][123090] Updated weights for policy 1, policy_version 1270444 (0.0010) [2023-12-26 09:48:25,327][123090] Updated weights for policy 1, policy_version 1270454 (0.0009) [2023-12-26 09:48:25,382][123090] Updated weights for policy 1, policy_version 1270464 (0.0008) [2023-12-26 09:48:26,064][123091] Updated weights for policy 0, policy_version 1279416 (0.0009) [2023-12-26 09:48:26,102][123090] Updated weights for policy 1, policy_version 1270474 (0.0005) [2023-12-26 09:48:26,114][123091] Updated weights for policy 0, policy_version 1279426 (0.0009) [2023-12-26 09:48:26,162][123090] Updated weights for policy 1, policy_version 1270484 (0.0005) [2023-12-26 09:48:26,164][123091] Updated weights for policy 0, policy_version 1279437 (0.0009) [2023-12-26 09:48:26,235][123090] Updated weights for policy 1, policy_version 1270494 (0.0005) [2023-12-26 09:48:26,913][123091] Updated weights for policy 0, policy_version 1279447 (0.0007) [2023-12-26 09:48:26,948][123090] Updated weights for policy 1, policy_version 1270504 (0.0008) [2023-12-26 09:48:26,967][123091] Updated weights for policy 0, policy_version 1279457 (0.0010) [2023-12-26 09:48:26,996][123090] Updated weights for policy 1, policy_version 1270514 (0.0006) [2023-12-26 09:48:27,025][123091] Updated weights for policy 0, policy_version 1279467 (0.0010) [2023-12-26 09:48:27,053][123090] Updated weights for policy 1, policy_version 1270524 (0.0008) [2023-12-26 09:48:27,749][123090] Updated weights for policy 1, policy_version 1270534 (0.0007) [2023-12-26 09:48:27,806][123091] Updated weights for policy 0, policy_version 1279477 (0.0010) [2023-12-26 09:48:27,816][123090] Updated weights for policy 1, policy_version 1270544 (0.0005) [2023-12-26 09:48:27,852][123091] Updated weights for policy 0, policy_version 1279487 (0.0010) [2023-12-26 09:48:27,877][123090] Updated weights for policy 1, policy_version 1270554 (0.0005) [2023-12-26 09:48:27,903][123091] Updated weights for policy 0, policy_version 1279497 (0.0010) [2023-12-26 09:48:28,475][123090] Updated weights for policy 1, policy_version 1270564 (0.0005) [2023-12-26 09:48:28,532][123090] Updated weights for policy 1, policy_version 1270574 (0.0005) [2023-12-26 09:48:28,589][123090] Updated weights for policy 1, policy_version 1270584 (0.0006) [2023-12-26 09:48:28,723][123091] Updated weights for policy 0, policy_version 1279507 (0.0010) [2023-12-26 09:48:28,775][123091] Updated weights for policy 0, policy_version 1279517 (0.0010) [2023-12-26 09:48:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 652828672. Throughput: 0: 8706.1, 1: 8960.8. Samples: 652822436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:28,785][121949] Avg episode reward: [(0, '6392.396'), (1, '4959.431')] [2023-12-26 09:48:28,830][123091] Updated weights for policy 0, policy_version 1279527 (0.0010) [2023-12-26 09:48:29,378][123090] Updated weights for policy 1, policy_version 1270594 (0.0006) [2023-12-26 09:48:29,448][123090] Updated weights for policy 1, policy_version 1270604 (0.0010) [2023-12-26 09:48:29,508][123090] Updated weights for policy 1, policy_version 1270614 (0.0010) [2023-12-26 09:48:29,581][123090] Updated weights for policy 1, policy_version 1270624 (0.0010) [2023-12-26 09:48:29,633][123091] Updated weights for policy 0, policy_version 1279537 (0.0010) [2023-12-26 09:48:29,691][123091] Updated weights for policy 0, policy_version 1279547 (0.0009) [2023-12-26 09:48:29,744][123091] Updated weights for policy 0, policy_version 1279557 (0.0010) [2023-12-26 09:48:29,798][123091] Updated weights for policy 0, policy_version 1279568 (0.0010) [2023-12-26 09:48:30,303][123090] Updated weights for policy 1, policy_version 1270634 (0.0009) [2023-12-26 09:48:30,365][123090] Updated weights for policy 1, policy_version 1270644 (0.0007) [2023-12-26 09:48:30,431][123090] Updated weights for policy 1, policy_version 1270654 (0.0005) [2023-12-26 09:48:30,559][123091] Updated weights for policy 0, policy_version 1279578 (0.0006) [2023-12-26 09:48:30,627][123091] Updated weights for policy 0, policy_version 1279588 (0.0007) [2023-12-26 09:48:30,695][123091] Updated weights for policy 0, policy_version 1279598 (0.0009) [2023-12-26 09:48:31,213][123090] Updated weights for policy 1, policy_version 1270664 (0.0009) [2023-12-26 09:48:31,275][123090] Updated weights for policy 1, policy_version 1270674 (0.0006) [2023-12-26 09:48:31,360][123090] Updated weights for policy 1, policy_version 1270684 (0.0009) [2023-12-26 09:48:31,500][123091] Updated weights for policy 0, policy_version 1279608 (0.0007) [2023-12-26 09:48:31,569][123091] Updated weights for policy 0, policy_version 1279618 (0.0009) [2023-12-26 09:48:31,639][123091] Updated weights for policy 0, policy_version 1279629 (0.0009) [2023-12-26 09:48:32,139][123090] Updated weights for policy 1, policy_version 1270694 (0.0007) [2023-12-26 09:48:32,192][123090] Updated weights for policy 1, policy_version 1270704 (0.0008) [2023-12-26 09:48:32,254][123090] Updated weights for policy 1, policy_version 1270714 (0.0009) [2023-12-26 09:48:32,473][123091] Updated weights for policy 0, policy_version 1279639 (0.0009) [2023-12-26 09:48:32,531][123091] Updated weights for policy 0, policy_version 1279649 (0.0009) [2023-12-26 09:48:32,593][123091] Updated weights for policy 0, policy_version 1279659 (0.0006) [2023-12-26 09:48:33,126][123090] Updated weights for policy 1, policy_version 1270724 (0.0009) [2023-12-26 09:48:33,182][123090] Updated weights for policy 1, policy_version 1270734 (0.0009) [2023-12-26 09:48:33,237][123090] Updated weights for policy 1, policy_version 1270744 (0.0009) [2023-12-26 09:48:33,293][123091] Updated weights for policy 0, policy_version 1279669 (0.0007) [2023-12-26 09:48:33,354][123091] Updated weights for policy 0, policy_version 1279679 (0.0009) [2023-12-26 09:48:33,418][123091] Updated weights for policy 0, policy_version 1279689 (0.0009) [2023-12-26 09:48:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 652918784. Throughput: 0: 8743.8, 1: 8897.9. Samples: 652929700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:33,785][121949] Avg episode reward: [(0, '6375.525'), (1, '4698.746')] [2023-12-26 09:48:34,118][123090] Updated weights for policy 1, policy_version 1270754 (0.0009) [2023-12-26 09:48:34,136][123091] Updated weights for policy 0, policy_version 1279699 (0.0008) [2023-12-26 09:48:34,178][123090] Updated weights for policy 1, policy_version 1270764 (0.0008) [2023-12-26 09:48:34,201][123091] Updated weights for policy 0, policy_version 1279709 (0.0010) [2023-12-26 09:48:34,239][123090] Updated weights for policy 1, policy_version 1270774 (0.0007) [2023-12-26 09:48:34,261][123091] Updated weights for policy 0, policy_version 1279719 (0.0011) [2023-12-26 09:48:34,297][123090] Updated weights for policy 1, policy_version 1270784 (0.0009) [2023-12-26 09:48:35,104][123091] Updated weights for policy 0, policy_version 1279729 (0.0011) [2023-12-26 09:48:35,146][123090] Updated weights for policy 1, policy_version 1270794 (0.0009) [2023-12-26 09:48:35,163][123091] Updated weights for policy 0, policy_version 1279739 (0.0011) [2023-12-26 09:48:35,212][123090] Updated weights for policy 1, policy_version 1270804 (0.0006) [2023-12-26 09:48:35,217][123091] Updated weights for policy 0, policy_version 1279749 (0.0010) [2023-12-26 09:48:35,264][123091] Updated weights for policy 0, policy_version 1279759 (0.0010) [2023-12-26 09:48:35,275][123090] Updated weights for policy 1, policy_version 1270814 (0.0006) [2023-12-26 09:48:36,096][123090] Updated weights for policy 1, policy_version 1270824 (0.0007) [2023-12-26 09:48:36,110][123091] Updated weights for policy 0, policy_version 1279769 (0.0011) [2023-12-26 09:48:36,171][123090] Updated weights for policy 1, policy_version 1270834 (0.0008) [2023-12-26 09:48:36,178][123091] Updated weights for policy 0, policy_version 1279779 (0.0011) [2023-12-26 09:48:36,229][123090] Updated weights for policy 1, policy_version 1270844 (0.0008) [2023-12-26 09:48:36,242][123091] Updated weights for policy 0, policy_version 1279789 (0.0011) [2023-12-26 09:48:37,063][123090] Updated weights for policy 1, policy_version 1270854 (0.0009) [2023-12-26 09:48:37,080][123091] Updated weights for policy 0, policy_version 1279799 (0.0011) [2023-12-26 09:48:37,116][123090] Updated weights for policy 1, policy_version 1270864 (0.0008) [2023-12-26 09:48:37,138][123091] Updated weights for policy 0, policy_version 1279809 (0.0011) [2023-12-26 09:48:37,168][123090] Updated weights for policy 1, policy_version 1270874 (0.0009) [2023-12-26 09:48:37,201][123091] Updated weights for policy 0, policy_version 1279819 (0.0010) [2023-12-26 09:48:38,011][123090] Updated weights for policy 1, policy_version 1270884 (0.0007) [2023-12-26 09:48:38,019][123091] Updated weights for policy 0, policy_version 1279829 (0.0011) [2023-12-26 09:48:38,080][123090] Updated weights for policy 1, policy_version 1270894 (0.0006) [2023-12-26 09:48:38,086][123091] Updated weights for policy 0, policy_version 1279839 (0.0011) [2023-12-26 09:48:38,138][123091] Updated weights for policy 0, policy_version 1279849 (0.0011) [2023-12-26 09:48:38,140][123090] Updated weights for policy 1, policy_version 1270904 (0.0006) [2023-12-26 09:48:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 653000704. Throughput: 0: 8773.3, 1: 8875.6. Samples: 652981052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:38,785][121949] Avg episode reward: [(0, '6256.420'), (1, '4759.047')] [2023-12-26 09:48:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001270912_325353472.pth... [2023-12-26 09:48:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001279856_327647232.pth... [2023-12-26 09:48:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001269888_325091328.pth [2023-12-26 09:48:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001278864_327393280.pth [2023-12-26 09:48:38,857][123091] Updated weights for policy 0, policy_version 1279859 (0.0011) [2023-12-26 09:48:38,921][123091] Updated weights for policy 0, policy_version 1279869 (0.0011) [2023-12-26 09:48:38,940][123090] Updated weights for policy 1, policy_version 1270914 (0.0006) [2023-12-26 09:48:38,985][123091] Updated weights for policy 0, policy_version 1279879 (0.0011) [2023-12-26 09:48:38,994][123090] Updated weights for policy 1, policy_version 1270924 (0.0007) [2023-12-26 09:48:39,056][123090] Updated weights for policy 1, policy_version 1270934 (0.0006) [2023-12-26 09:48:39,128][123090] Updated weights for policy 1, policy_version 1270944 (0.0008) [2023-12-26 09:48:39,815][123091] Updated weights for policy 0, policy_version 1279889 (0.0011) [2023-12-26 09:48:39,882][123091] Updated weights for policy 0, policy_version 1279899 (0.0009) [2023-12-26 09:48:39,925][123090] Updated weights for policy 1, policy_version 1270954 (0.0008) [2023-12-26 09:48:39,948][123091] Updated weights for policy 0, policy_version 1279909 (0.0009) [2023-12-26 09:48:39,994][123090] Updated weights for policy 1, policy_version 1270964 (0.0010) [2023-12-26 09:48:40,006][123091] Updated weights for policy 0, policy_version 1279919 (0.0007) [2023-12-26 09:48:40,062][123090] Updated weights for policy 1, policy_version 1270974 (0.0010) [2023-12-26 09:48:40,684][123091] Updated weights for policy 0, policy_version 1279929 (0.0006) [2023-12-26 09:48:40,757][123091] Updated weights for policy 0, policy_version 1279939 (0.0006) [2023-12-26 09:48:40,830][123091] Updated weights for policy 0, policy_version 1279949 (0.0006) [2023-12-26 09:48:40,897][123090] Updated weights for policy 1, policy_version 1270984 (0.0011) [2023-12-26 09:48:40,961][123090] Updated weights for policy 1, policy_version 1270994 (0.0011) [2023-12-26 09:48:41,013][123090] Updated weights for policy 1, policy_version 1271004 (0.0010) [2023-12-26 09:48:41,609][123091] Updated weights for policy 0, policy_version 1279959 (0.0009) [2023-12-26 09:48:41,680][123091] Updated weights for policy 0, policy_version 1279969 (0.0010) [2023-12-26 09:48:41,755][123091] Updated weights for policy 0, policy_version 1279979 (0.0009) [2023-12-26 09:48:41,889][123090] Updated weights for policy 1, policy_version 1271014 (0.0007) [2023-12-26 09:48:41,944][123090] Updated weights for policy 1, policy_version 1271024 (0.0008) [2023-12-26 09:48:42,016][123090] Updated weights for policy 1, policy_version 1271034 (0.0006) [2023-12-26 09:48:42,555][123091] Updated weights for policy 0, policy_version 1279989 (0.0006) [2023-12-26 09:48:42,622][123091] Updated weights for policy 0, policy_version 1279999 (0.0006) [2023-12-26 09:48:42,691][123091] Updated weights for policy 0, policy_version 1280009 (0.0006) [2023-12-26 09:48:42,789][123090] Updated weights for policy 1, policy_version 1271044 (0.0006) [2023-12-26 09:48:42,860][123090] Updated weights for policy 1, policy_version 1271054 (0.0006) [2023-12-26 09:48:42,930][123090] Updated weights for policy 1, policy_version 1271064 (0.0005) [2023-12-26 09:48:43,345][123091] Updated weights for policy 0, policy_version 1280019 (0.0006) [2023-12-26 09:48:43,393][123091] Updated weights for policy 0, policy_version 1280029 (0.0005) [2023-12-26 09:48:43,438][123091] Updated weights for policy 0, policy_version 1280039 (0.0005) [2023-12-26 09:48:43,556][123090] Updated weights for policy 1, policy_version 1271074 (0.0005) [2023-12-26 09:48:43,624][123090] Updated weights for policy 1, policy_version 1271084 (0.0006) [2023-12-26 09:48:43,686][123090] Updated weights for policy 1, policy_version 1271094 (0.0009) [2023-12-26 09:48:43,753][123090] Updated weights for policy 1, policy_version 1271104 (0.0009) [2023-12-26 09:48:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 653099008. Throughput: 0: 8668.9, 1: 8877.8. Samples: 653086028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:43,785][121949] Avg episode reward: [(0, '6148.520'), (1, '5134.373')] [2023-12-26 09:48:44,249][123091] Updated weights for policy 0, policy_version 1280049 (0.0006) [2023-12-26 09:48:44,303][123091] Updated weights for policy 0, policy_version 1280059 (0.0006) [2023-12-26 09:48:44,356][123091] Updated weights for policy 0, policy_version 1280069 (0.0005) [2023-12-26 09:48:44,415][123091] Updated weights for policy 0, policy_version 1280079 (0.0006) [2023-12-26 09:48:44,501][123090] Updated weights for policy 1, policy_version 1271114 (0.0010) [2023-12-26 09:48:44,572][123090] Updated weights for policy 1, policy_version 1271125 (0.0011) [2023-12-26 09:48:44,623][123090] Updated weights for policy 1, policy_version 1271135 (0.0005) [2023-12-26 09:48:45,233][123091] Updated weights for policy 0, policy_version 1280089 (0.0010) [2023-12-26 09:48:45,283][123090] Updated weights for policy 1, policy_version 1271145 (0.0010) [2023-12-26 09:48:45,296][123091] Updated weights for policy 0, policy_version 1280099 (0.0011) [2023-12-26 09:48:45,336][123090] Updated weights for policy 1, policy_version 1271155 (0.0010) [2023-12-26 09:48:45,360][123091] Updated weights for policy 0, policy_version 1280109 (0.0011) [2023-12-26 09:48:45,400][123090] Updated weights for policy 1, policy_version 1271165 (0.0006) [2023-12-26 09:48:46,193][123091] Updated weights for policy 0, policy_version 1280119 (0.0011) [2023-12-26 09:48:46,193][123090] Updated weights for policy 1, policy_version 1271175 (0.0009) [2023-12-26 09:48:46,249][123091] Updated weights for policy 0, policy_version 1280129 (0.0010) [2023-12-26 09:48:46,264][123090] Updated weights for policy 1, policy_version 1271185 (0.0011) [2023-12-26 09:48:46,308][123091] Updated weights for policy 0, policy_version 1280139 (0.0011) [2023-12-26 09:48:46,319][123090] Updated weights for policy 1, policy_version 1271195 (0.0010) [2023-12-26 09:48:47,086][123090] Updated weights for policy 1, policy_version 1271205 (0.0008) [2023-12-26 09:48:47,118][123091] Updated weights for policy 0, policy_version 1280149 (0.0008) [2023-12-26 09:48:47,154][123090] Updated weights for policy 1, policy_version 1271215 (0.0005) [2023-12-26 09:48:47,172][123091] Updated weights for policy 0, policy_version 1280159 (0.0005) [2023-12-26 09:48:47,216][123090] Updated weights for policy 1, policy_version 1271225 (0.0005) [2023-12-26 09:48:47,221][123091] Updated weights for policy 0, policy_version 1280169 (0.0005) [2023-12-26 09:48:47,869][123090] Updated weights for policy 1, policy_version 1271235 (0.0006) [2023-12-26 09:48:47,902][123091] Updated weights for policy 0, policy_version 1280179 (0.0005) [2023-12-26 09:48:47,918][123090] Updated weights for policy 1, policy_version 1271245 (0.0006) [2023-12-26 09:48:47,964][123091] Updated weights for policy 0, policy_version 1280189 (0.0006) [2023-12-26 09:48:47,974][123090] Updated weights for policy 1, policy_version 1271255 (0.0005) [2023-12-26 09:48:48,034][123091] Updated weights for policy 0, policy_version 1280199 (0.0006) [2023-12-26 09:48:48,748][123091] Updated weights for policy 0, policy_version 1280209 (0.0006) [2023-12-26 09:48:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 653180928. Throughput: 0: 8788.5, 1: 8944.3. Samples: 653198628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:48,785][121949] Avg episode reward: [(0, '6260.498'), (1, '5053.109')] [2023-12-26 09:48:48,807][123091] Updated weights for policy 0, policy_version 1280219 (0.0006) [2023-12-26 09:48:48,817][123090] Updated weights for policy 1, policy_version 1271265 (0.0010) [2023-12-26 09:48:48,863][123091] Updated weights for policy 0, policy_version 1280229 (0.0011) [2023-12-26 09:48:48,884][123090] Updated weights for policy 1, policy_version 1271275 (0.0011) [2023-12-26 09:48:48,919][123091] Updated weights for policy 0, policy_version 1280239 (0.0011) [2023-12-26 09:48:48,948][123090] Updated weights for policy 1, policy_version 1271285 (0.0011) [2023-12-26 09:48:49,011][123090] Updated weights for policy 1, policy_version 1271295 (0.0010) [2023-12-26 09:48:49,722][123091] Updated weights for policy 0, policy_version 1280249 (0.0007) [2023-12-26 09:48:49,792][123091] Updated weights for policy 0, policy_version 1280259 (0.0005) [2023-12-26 09:48:49,854][123090] Updated weights for policy 1, policy_version 1271305 (0.0008) [2023-12-26 09:48:49,866][123091] Updated weights for policy 0, policy_version 1280269 (0.0008) [2023-12-26 09:48:49,915][123090] Updated weights for policy 1, policy_version 1271315 (0.0009) [2023-12-26 09:48:49,978][123090] Updated weights for policy 1, policy_version 1271325 (0.0009) [2023-12-26 09:48:50,673][123091] Updated weights for policy 0, policy_version 1280279 (0.0007) [2023-12-26 09:48:50,745][123091] Updated weights for policy 0, policy_version 1280289 (0.0005) [2023-12-26 09:48:50,808][123090] Updated weights for policy 1, policy_version 1271335 (0.0009) [2023-12-26 09:48:50,815][123091] Updated weights for policy 0, policy_version 1280299 (0.0005) [2023-12-26 09:48:50,874][123090] Updated weights for policy 1, policy_version 1271345 (0.0008) [2023-12-26 09:48:50,939][123090] Updated weights for policy 1, policy_version 1271355 (0.0008) [2023-12-26 09:48:51,554][123091] Updated weights for policy 0, policy_version 1280309 (0.0009) [2023-12-26 09:48:51,618][123091] Updated weights for policy 0, policy_version 1280319 (0.0009) [2023-12-26 09:48:51,684][123091] Updated weights for policy 0, policy_version 1280329 (0.0010) [2023-12-26 09:48:51,783][123090] Updated weights for policy 1, policy_version 1271365 (0.0008) [2023-12-26 09:48:51,844][123090] Updated weights for policy 1, policy_version 1271375 (0.0008) [2023-12-26 09:48:51,898][123090] Updated weights for policy 1, policy_version 1271385 (0.0010) [2023-12-26 09:48:52,476][123091] Updated weights for policy 0, policy_version 1280339 (0.0011) [2023-12-26 09:48:52,542][123091] Updated weights for policy 0, policy_version 1280349 (0.0006) [2023-12-26 09:48:52,611][123091] Updated weights for policy 0, policy_version 1280359 (0.0008) [2023-12-26 09:48:52,752][123090] Updated weights for policy 1, policy_version 1271395 (0.0009) [2023-12-26 09:48:52,817][123090] Updated weights for policy 1, policy_version 1271405 (0.0008) [2023-12-26 09:48:52,882][123090] Updated weights for policy 1, policy_version 1271415 (0.0008) [2023-12-26 09:48:53,282][123091] Updated weights for policy 0, policy_version 1280369 (0.0006) [2023-12-26 09:48:53,345][123091] Updated weights for policy 0, policy_version 1280379 (0.0005) [2023-12-26 09:48:53,399][123091] Updated weights for policy 0, policy_version 1280389 (0.0005) [2023-12-26 09:48:53,458][123091] Updated weights for policy 0, policy_version 1280399 (0.0005) [2023-12-26 09:48:53,525][123090] Updated weights for policy 1, policy_version 1271425 (0.0008) [2023-12-26 09:48:53,592][123090] Updated weights for policy 1, policy_version 1271435 (0.0007) [2023-12-26 09:48:53,663][123090] Updated weights for policy 1, policy_version 1271445 (0.0006) [2023-12-26 09:48:53,732][123090] Updated weights for policy 1, policy_version 1271455 (0.0005) [2023-12-26 09:48:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 653279232. Throughput: 0: 8808.2, 1: 8863.8. Samples: 653250204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:53,785][121949] Avg episode reward: [(0, '6296.877'), (1, '5052.034')] [2023-12-26 09:48:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001280400_327786496.pth... [2023-12-26 09:48:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001271456_325492736.pth... [2023-12-26 09:48:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001279344_327516160.pth [2023-12-26 09:48:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001270400_325222400.pth [2023-12-26 09:48:54,063][123091] Updated weights for policy 0, policy_version 1280409 (0.0006) [2023-12-26 09:48:54,125][123091] Updated weights for policy 0, policy_version 1280419 (0.0008) [2023-12-26 09:48:54,189][123091] Updated weights for policy 0, policy_version 1280429 (0.0008) [2023-12-26 09:48:54,432][123090] Updated weights for policy 1, policy_version 1271465 (0.0009) [2023-12-26 09:48:54,485][123090] Updated weights for policy 1, policy_version 1271475 (0.0009) [2023-12-26 09:48:54,534][123090] Updated weights for policy 1, policy_version 1271485 (0.0009) [2023-12-26 09:48:54,926][123091] Updated weights for policy 0, policy_version 1280439 (0.0008) [2023-12-26 09:48:54,995][123091] Updated weights for policy 0, policy_version 1280449 (0.0009) [2023-12-26 09:48:55,053][123091] Updated weights for policy 0, policy_version 1280459 (0.0009) [2023-12-26 09:48:55,429][123090] Updated weights for policy 1, policy_version 1271495 (0.0009) [2023-12-26 09:48:55,482][123090] Updated weights for policy 1, policy_version 1271505 (0.0007) [2023-12-26 09:48:55,541][123090] Updated weights for policy 1, policy_version 1271515 (0.0009) [2023-12-26 09:48:55,814][123091] Updated weights for policy 0, policy_version 1280469 (0.0007) [2023-12-26 09:48:55,862][123091] Updated weights for policy 0, policy_version 1280479 (0.0005) [2023-12-26 09:48:55,925][123091] Updated weights for policy 0, policy_version 1280489 (0.0005) [2023-12-26 09:48:56,247][123090] Updated weights for policy 1, policy_version 1271525 (0.0007) [2023-12-26 09:48:56,318][123090] Updated weights for policy 1, policy_version 1271535 (0.0006) [2023-12-26 09:48:56,374][123090] Updated weights for policy 1, policy_version 1271545 (0.0005) [2023-12-26 09:48:56,588][123091] Updated weights for policy 0, policy_version 1280499 (0.0005) [2023-12-26 09:48:56,646][123091] Updated weights for policy 0, policy_version 1280509 (0.0005) [2023-12-26 09:48:56,702][123091] Updated weights for policy 0, policy_version 1280519 (0.0010) [2023-12-26 09:48:56,933][123090] Updated weights for policy 1, policy_version 1271555 (0.0006) [2023-12-26 09:48:56,996][123090] Updated weights for policy 1, policy_version 1271565 (0.0009) [2023-12-26 09:48:57,053][123090] Updated weights for policy 1, policy_version 1271575 (0.0009) [2023-12-26 09:48:57,389][123091] Updated weights for policy 0, policy_version 1280529 (0.0010) [2023-12-26 09:48:57,455][123091] Updated weights for policy 0, policy_version 1280539 (0.0005) [2023-12-26 09:48:57,523][123091] Updated weights for policy 0, policy_version 1280549 (0.0006) [2023-12-26 09:48:57,585][123091] Updated weights for policy 0, policy_version 1280559 (0.0008) [2023-12-26 09:48:57,920][123090] Updated weights for policy 1, policy_version 1271585 (0.0009) [2023-12-26 09:48:57,983][123090] Updated weights for policy 1, policy_version 1271595 (0.0008) [2023-12-26 09:48:58,048][123090] Updated weights for policy 1, policy_version 1271605 (0.0009) [2023-12-26 09:48:58,106][123090] Updated weights for policy 1, policy_version 1271615 (0.0009) [2023-12-26 09:48:58,336][123091] Updated weights for policy 0, policy_version 1280569 (0.0008) [2023-12-26 09:48:58,406][123091] Updated weights for policy 0, policy_version 1280579 (0.0009) [2023-12-26 09:48:58,468][123091] Updated weights for policy 0, policy_version 1280589 (0.0009) [2023-12-26 09:48:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 653369344. Throughput: 0: 8976.0, 1: 8922.3. Samples: 653364440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:48:58,785][121949] Avg episode reward: [(0, '6193.047'), (1, '5055.487')] [2023-12-26 09:48:59,046][123090] Updated weights for policy 1, policy_version 1271625 (0.0010) [2023-12-26 09:48:59,107][123090] Updated weights for policy 1, policy_version 1271635 (0.0009) [2023-12-26 09:48:59,170][123090] Updated weights for policy 1, policy_version 1271645 (0.0010) [2023-12-26 09:48:59,318][123091] Updated weights for policy 0, policy_version 1280599 (0.0010) [2023-12-26 09:48:59,382][123091] Updated weights for policy 0, policy_version 1280609 (0.0010) [2023-12-26 09:48:59,445][123091] Updated weights for policy 0, policy_version 1280619 (0.0009) [2023-12-26 09:48:59,970][123090] Updated weights for policy 1, policy_version 1271655 (0.0007) [2023-12-26 09:49:00,037][123090] Updated weights for policy 1, policy_version 1271665 (0.0007) [2023-12-26 09:49:00,104][123090] Updated weights for policy 1, policy_version 1271675 (0.0009) [2023-12-26 09:49:00,290][123091] Updated weights for policy 0, policy_version 1280629 (0.0009) [2023-12-26 09:49:00,348][123091] Updated weights for policy 0, policy_version 1280639 (0.0010) [2023-12-26 09:49:00,404][123091] Updated weights for policy 0, policy_version 1280649 (0.0009) [2023-12-26 09:49:00,912][123090] Updated weights for policy 1, policy_version 1271685 (0.0009) [2023-12-26 09:49:00,985][123090] Updated weights for policy 1, policy_version 1271695 (0.0009) [2023-12-26 09:49:01,060][123090] Updated weights for policy 1, policy_version 1271705 (0.0010) [2023-12-26 09:49:01,240][123091] Updated weights for policy 0, policy_version 1280659 (0.0009) [2023-12-26 09:49:01,296][123091] Updated weights for policy 0, policy_version 1280669 (0.0009) [2023-12-26 09:49:01,360][123091] Updated weights for policy 0, policy_version 1280679 (0.0010) [2023-12-26 09:49:01,917][123090] Updated weights for policy 1, policy_version 1271715 (0.0010) [2023-12-26 09:49:01,994][123090] Updated weights for policy 1, policy_version 1271725 (0.0009) [2023-12-26 09:49:02,060][123090] Updated weights for policy 1, policy_version 1271735 (0.0009) [2023-12-26 09:49:02,187][123091] Updated weights for policy 0, policy_version 1280689 (0.0010) [2023-12-26 09:49:02,259][123091] Updated weights for policy 0, policy_version 1280699 (0.0009) [2023-12-26 09:49:02,322][123091] Updated weights for policy 0, policy_version 1280709 (0.0010) [2023-12-26 09:49:02,390][123091] Updated weights for policy 0, policy_version 1280719 (0.0010) [2023-12-26 09:49:02,864][123090] Updated weights for policy 1, policy_version 1271745 (0.0010) [2023-12-26 09:49:02,916][123090] Updated weights for policy 1, policy_version 1271755 (0.0009) [2023-12-26 09:49:02,969][123090] Updated weights for policy 1, policy_version 1271765 (0.0009) [2023-12-26 09:49:03,029][123090] Updated weights for policy 1, policy_version 1271775 (0.0009) [2023-12-26 09:49:03,209][123091] Updated weights for policy 0, policy_version 1280729 (0.0009) [2023-12-26 09:49:03,256][123091] Updated weights for policy 0, policy_version 1280739 (0.0009) [2023-12-26 09:49:03,313][123091] Updated weights for policy 0, policy_version 1280750 (0.0009) [2023-12-26 09:49:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 653451264. Throughput: 0: 8917.6, 1: 8853.8. Samples: 653465224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:49:03,785][121949] Avg episode reward: [(0, '6192.260'), (1, '5001.439')] [2023-12-26 09:49:03,893][123090] Updated weights for policy 1, policy_version 1271785 (0.0010) [2023-12-26 09:49:03,959][123090] Updated weights for policy 1, policy_version 1271795 (0.0008) [2023-12-26 09:49:04,014][123090] Updated weights for policy 1, policy_version 1271805 (0.0010) [2023-12-26 09:49:04,189][123091] Updated weights for policy 0, policy_version 1280760 (0.0009) [2023-12-26 09:49:04,245][123091] Updated weights for policy 0, policy_version 1280770 (0.0009) [2023-12-26 09:49:04,298][123091] Updated weights for policy 0, policy_version 1280780 (0.0009) [2023-12-26 09:49:04,851][123090] Updated weights for policy 1, policy_version 1271815 (0.0010) [2023-12-26 09:49:04,911][123090] Updated weights for policy 1, policy_version 1271825 (0.0009) [2023-12-26 09:49:04,964][123090] Updated weights for policy 1, policy_version 1271836 (0.0009) [2023-12-26 09:49:05,138][123091] Updated weights for policy 0, policy_version 1280790 (0.0010) [2023-12-26 09:49:05,199][123091] Updated weights for policy 0, policy_version 1280800 (0.0009) [2023-12-26 09:49:05,258][123091] Updated weights for policy 0, policy_version 1280810 (0.0010) [2023-12-26 09:49:05,807][123090] Updated weights for policy 1, policy_version 1271846 (0.0010) [2023-12-26 09:49:05,861][123090] Updated weights for policy 1, policy_version 1271857 (0.0009) [2023-12-26 09:49:05,912][123090] Updated weights for policy 1, policy_version 1271867 (0.0009) [2023-12-26 09:49:06,095][123091] Updated weights for policy 0, policy_version 1280820 (0.0009) [2023-12-26 09:49:06,159][123091] Updated weights for policy 0, policy_version 1280830 (0.0009) [2023-12-26 09:49:06,227][123091] Updated weights for policy 0, policy_version 1280840 (0.0009) [2023-12-26 09:49:06,730][123090] Updated weights for policy 1, policy_version 1271877 (0.0010) [2023-12-26 09:49:06,792][123090] Updated weights for policy 1, policy_version 1271887 (0.0009) [2023-12-26 09:49:06,856][123090] Updated weights for policy 1, policy_version 1271897 (0.0010) [2023-12-26 09:49:07,080][123091] Updated weights for policy 0, policy_version 1280850 (0.0010) [2023-12-26 09:49:07,138][123091] Updated weights for policy 0, policy_version 1280860 (0.0009) [2023-12-26 09:49:07,187][123091] Updated weights for policy 0, policy_version 1280870 (0.0009) [2023-12-26 09:49:07,244][123091] Updated weights for policy 0, policy_version 1280880 (0.0010) [2023-12-26 09:49:07,633][123090] Updated weights for policy 1, policy_version 1271907 (0.0008) [2023-12-26 09:49:07,696][123090] Updated weights for policy 1, policy_version 1271917 (0.0005) [2023-12-26 09:49:07,758][123090] Updated weights for policy 1, policy_version 1271927 (0.0005) [2023-12-26 09:49:08,145][123091] Updated weights for policy 0, policy_version 1280890 (0.0009) [2023-12-26 09:49:08,199][123091] Updated weights for policy 0, policy_version 1280900 (0.0010) [2023-12-26 09:49:08,257][123091] Updated weights for policy 0, policy_version 1280910 (0.0010) [2023-12-26 09:49:08,435][123090] Updated weights for policy 1, policy_version 1271937 (0.0005) [2023-12-26 09:49:08,504][123090] Updated weights for policy 1, policy_version 1271947 (0.0006) [2023-12-26 09:49:08,564][123090] Updated weights for policy 1, policy_version 1271957 (0.0007) [2023-12-26 09:49:08,622][123090] Updated weights for policy 1, policy_version 1271967 (0.0005) [2023-12-26 09:49:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 653541376. Throughput: 0: 8923.9, 1: 8858.5. Samples: 653515848. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:49:08,785][121949] Avg episode reward: [(0, '6072.549'), (1, '5068.625')] [2023-12-26 09:49:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001280912_327917568.pth... [2023-12-26 09:49:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001271968_325623808.pth... [2023-12-26 09:49:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001279856_327647232.pth [2023-12-26 09:49:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001270912_325353472.pth [2023-12-26 09:49:09,121][123091] Updated weights for policy 0, policy_version 1280920 (0.0007) [2023-12-26 09:49:09,190][123091] Updated weights for policy 0, policy_version 1280930 (0.0007) [2023-12-26 09:49:09,260][123091] Updated weights for policy 0, policy_version 1280940 (0.0008) [2023-12-26 09:49:09,318][123090] Updated weights for policy 1, policy_version 1271977 (0.0008) [2023-12-26 09:49:09,383][123090] Updated weights for policy 1, policy_version 1271987 (0.0009) [2023-12-26 09:49:09,451][123090] Updated weights for policy 1, policy_version 1271997 (0.0010) [2023-12-26 09:49:09,990][123091] Updated weights for policy 0, policy_version 1280950 (0.0009) [2023-12-26 09:49:10,046][123091] Updated weights for policy 0, policy_version 1280960 (0.0008) [2023-12-26 09:49:10,105][123091] Updated weights for policy 0, policy_version 1280970 (0.0009) [2023-12-26 09:49:10,388][123090] Updated weights for policy 1, policy_version 1272007 (0.0009) [2023-12-26 09:49:10,450][123090] Updated weights for policy 1, policy_version 1272017 (0.0009) [2023-12-26 09:49:10,502][123090] Updated weights for policy 1, policy_version 1272027 (0.0010) [2023-12-26 09:49:10,957][123091] Updated weights for policy 0, policy_version 1280980 (0.0007) [2023-12-26 09:49:11,011][123091] Updated weights for policy 0, policy_version 1280990 (0.0010) [2023-12-26 09:49:11,086][123091] Updated weights for policy 0, policy_version 1281001 (0.0009) [2023-12-26 09:49:11,369][123090] Updated weights for policy 1, policy_version 1272037 (0.0009) [2023-12-26 09:49:11,438][123090] Updated weights for policy 1, policy_version 1272047 (0.0009) [2023-12-26 09:49:11,506][123090] Updated weights for policy 1, policy_version 1272057 (0.0009) [2023-12-26 09:49:11,914][123091] Updated weights for policy 0, policy_version 1281011 (0.0009) [2023-12-26 09:49:11,971][123091] Updated weights for policy 0, policy_version 1281021 (0.0006) [2023-12-26 09:49:12,023][123091] Updated weights for policy 0, policy_version 1281031 (0.0008) [2023-12-26 09:49:12,338][123090] Updated weights for policy 1, policy_version 1272067 (0.0009) [2023-12-26 09:49:12,412][123090] Updated weights for policy 1, policy_version 1272077 (0.0009) [2023-12-26 09:49:12,471][123090] Updated weights for policy 1, policy_version 1272087 (0.0007) [2023-12-26 09:49:12,745][123091] Updated weights for policy 0, policy_version 1281041 (0.0006) [2023-12-26 09:49:12,816][123091] Updated weights for policy 0, policy_version 1281051 (0.0006) [2023-12-26 09:49:12,876][123091] Updated weights for policy 0, policy_version 1281061 (0.0007) [2023-12-26 09:49:12,934][123091] Updated weights for policy 0, policy_version 1281071 (0.0009) [2023-12-26 09:49:13,244][123090] Updated weights for policy 1, policy_version 1272097 (0.0008) [2023-12-26 09:49:13,308][123090] Updated weights for policy 1, policy_version 1272107 (0.0005) [2023-12-26 09:49:13,359][123090] Updated weights for policy 1, policy_version 1272117 (0.0005) [2023-12-26 09:49:13,414][123090] Updated weights for policy 1, policy_version 1272127 (0.0005) [2023-12-26 09:49:13,645][123091] Updated weights for policy 0, policy_version 1281081 (0.0006) [2023-12-26 09:49:13,696][123091] Updated weights for policy 0, policy_version 1281091 (0.0005) [2023-12-26 09:49:13,751][123091] Updated weights for policy 0, policy_version 1281101 (0.0006) [2023-12-26 09:49:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 653631488. Throughput: 0: 8927.1, 1: 8784.7. Samples: 653619460. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:13,785][121949] Avg episode reward: [(0, '6199.834'), (1, '5186.145')] [2023-12-26 09:49:14,176][123090] Updated weights for policy 1, policy_version 1272137 (0.0009) [2023-12-26 09:49:14,226][123090] Updated weights for policy 1, policy_version 1272147 (0.0009) [2023-12-26 09:49:14,274][123090] Updated weights for policy 1, policy_version 1272157 (0.0009) [2023-12-26 09:49:14,535][123091] Updated weights for policy 0, policy_version 1281111 (0.0006) [2023-12-26 09:49:14,587][123091] Updated weights for policy 0, policy_version 1281121 (0.0005) [2023-12-26 09:49:14,639][123091] Updated weights for policy 0, policy_version 1281131 (0.0006) [2023-12-26 09:49:15,199][123090] Updated weights for policy 1, policy_version 1272167 (0.0008) [2023-12-26 09:49:15,271][123090] Updated weights for policy 1, policy_version 1272177 (0.0008) [2023-12-26 09:49:15,340][123090] Updated weights for policy 1, policy_version 1272187 (0.0009) [2023-12-26 09:49:15,388][123091] Updated weights for policy 0, policy_version 1281141 (0.0008) [2023-12-26 09:49:15,451][123091] Updated weights for policy 0, policy_version 1281151 (0.0011) [2023-12-26 09:49:15,506][123091] Updated weights for policy 0, policy_version 1281161 (0.0010) [2023-12-26 09:49:16,155][123090] Updated weights for policy 1, policy_version 1272197 (0.0008) [2023-12-26 09:49:16,223][123090] Updated weights for policy 1, policy_version 1272207 (0.0009) [2023-12-26 09:49:16,291][123090] Updated weights for policy 1, policy_version 1272217 (0.0009) [2023-12-26 09:49:16,335][123091] Updated weights for policy 0, policy_version 1281171 (0.0010) [2023-12-26 09:49:16,387][123091] Updated weights for policy 0, policy_version 1281181 (0.0011) [2023-12-26 09:49:16,434][123091] Updated weights for policy 0, policy_version 1281191 (0.0010) [2023-12-26 09:49:17,142][123090] Updated weights for policy 1, policy_version 1272227 (0.0009) [2023-12-26 09:49:17,196][123090] Updated weights for policy 1, policy_version 1272237 (0.0010) [2023-12-26 09:49:17,227][123091] Updated weights for policy 0, policy_version 1281201 (0.0010) [2023-12-26 09:49:17,250][123090] Updated weights for policy 1, policy_version 1272247 (0.0009) [2023-12-26 09:49:17,291][123091] Updated weights for policy 0, policy_version 1281211 (0.0005) [2023-12-26 09:49:17,344][123091] Updated weights for policy 0, policy_version 1281221 (0.0005) [2023-12-26 09:49:17,399][123091] Updated weights for policy 0, policy_version 1281231 (0.0008) [2023-12-26 09:49:18,104][123091] Updated weights for policy 0, policy_version 1281241 (0.0008) [2023-12-26 09:49:18,148][123090] Updated weights for policy 1, policy_version 1272257 (0.0008) [2023-12-26 09:49:18,163][123091] Updated weights for policy 0, policy_version 1281251 (0.0009) [2023-12-26 09:49:18,202][123090] Updated weights for policy 1, policy_version 1272267 (0.0008) [2023-12-26 09:49:18,213][123091] Updated weights for policy 0, policy_version 1281261 (0.0007) [2023-12-26 09:49:18,261][123090] Updated weights for policy 1, policy_version 1272277 (0.0009) [2023-12-26 09:49:18,315][123090] Updated weights for policy 1, policy_version 1272288 (0.0009) [2023-12-26 09:49:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 653713408. Throughput: 0: 8980.9, 1: 8704.5. Samples: 653725544. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:18,785][121949] Avg episode reward: [(0, '6207.674'), (1, '5431.575')] [2023-12-26 09:49:18,933][123091] Updated weights for policy 0, policy_version 1281271 (0.0005) [2023-12-26 09:49:18,979][123091] Updated weights for policy 0, policy_version 1281281 (0.0005) [2023-12-26 09:49:19,039][123091] Updated weights for policy 0, policy_version 1281291 (0.0005) [2023-12-26 09:49:19,227][123090] Updated weights for policy 1, policy_version 1272298 (0.0009) [2023-12-26 09:49:19,296][123090] Updated weights for policy 1, policy_version 1272308 (0.0009) [2023-12-26 09:49:19,369][123090] Updated weights for policy 1, policy_version 1272318 (0.0010) [2023-12-26 09:49:19,859][123091] Updated weights for policy 0, policy_version 1281301 (0.0010) [2023-12-26 09:49:19,938][123091] Updated weights for policy 0, policy_version 1281311 (0.0006) [2023-12-26 09:49:20,020][123091] Updated weights for policy 0, policy_version 1281321 (0.0007) [2023-12-26 09:49:20,219][123090] Updated weights for policy 1, policy_version 1272328 (0.0009) [2023-12-26 09:49:20,288][123090] Updated weights for policy 1, policy_version 1272338 (0.0010) [2023-12-26 09:49:20,351][123090] Updated weights for policy 1, policy_version 1272348 (0.0010) [2023-12-26 09:49:20,775][123091] Updated weights for policy 0, policy_version 1281331 (0.0007) [2023-12-26 09:49:20,849][123091] Updated weights for policy 0, policy_version 1281341 (0.0006) [2023-12-26 09:49:20,915][123091] Updated weights for policy 0, policy_version 1281351 (0.0009) [2023-12-26 09:49:21,191][123090] Updated weights for policy 1, policy_version 1272358 (0.0007) [2023-12-26 09:49:21,265][123090] Updated weights for policy 1, policy_version 1272368 (0.0008) [2023-12-26 09:49:21,348][123090] Updated weights for policy 1, policy_version 1272378 (0.0006) [2023-12-26 09:49:21,739][123091] Updated weights for policy 0, policy_version 1281361 (0.0010) [2023-12-26 09:49:21,798][123091] Updated weights for policy 0, policy_version 1281371 (0.0009) [2023-12-26 09:49:21,859][123091] Updated weights for policy 0, policy_version 1281381 (0.0008) [2023-12-26 09:49:21,913][123091] Updated weights for policy 0, policy_version 1281391 (0.0005) [2023-12-26 09:49:22,173][123090] Updated weights for policy 1, policy_version 1272388 (0.0010) [2023-12-26 09:49:22,227][123090] Updated weights for policy 1, policy_version 1272398 (0.0009) [2023-12-26 09:49:22,286][123090] Updated weights for policy 1, policy_version 1272408 (0.0009) [2023-12-26 09:49:22,713][123091] Updated weights for policy 0, policy_version 1281401 (0.0006) [2023-12-26 09:49:22,774][123091] Updated weights for policy 0, policy_version 1281411 (0.0005) [2023-12-26 09:49:22,842][123091] Updated weights for policy 0, policy_version 1281421 (0.0005) [2023-12-26 09:49:23,199][123090] Updated weights for policy 1, policy_version 1272418 (0.0009) [2023-12-26 09:49:23,268][123090] Updated weights for policy 1, policy_version 1272428 (0.0010) [2023-12-26 09:49:23,336][123090] Updated weights for policy 1, policy_version 1272438 (0.0010) [2023-12-26 09:49:23,414][123090] Updated weights for policy 1, policy_version 1272448 (0.0010) [2023-12-26 09:49:23,532][123091] Updated weights for policy 0, policy_version 1281431 (0.0007) [2023-12-26 09:49:23,594][123091] Updated weights for policy 0, policy_version 1281441 (0.0007) [2023-12-26 09:49:23,658][123091] Updated weights for policy 0, policy_version 1281451 (0.0005) [2023-12-26 09:49:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 653803520. Throughput: 0: 8995.2, 1: 8699.1. Samples: 653777304. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:23,785][121949] Avg episode reward: [(0, '6215.344'), (1, '5340.333')] [2023-12-26 09:49:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001272448_325746688.pth... [2023-12-26 09:49:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001281456_328056832.pth... [2023-12-26 09:49:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001271456_325492736.pth [2023-12-26 09:49:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001280400_327786496.pth [2023-12-26 09:49:24,159][123090] Updated weights for policy 1, policy_version 1272458 (0.0005) [2023-12-26 09:49:24,221][123090] Updated weights for policy 1, policy_version 1272468 (0.0005) [2023-12-26 09:49:24,296][123090] Updated weights for policy 1, policy_version 1272478 (0.0005) [2023-12-26 09:49:24,328][123091] Updated weights for policy 0, policy_version 1281461 (0.0007) [2023-12-26 09:49:24,388][123091] Updated weights for policy 0, policy_version 1281471 (0.0010) [2023-12-26 09:49:24,436][123091] Updated weights for policy 0, policy_version 1281481 (0.0010) [2023-12-26 09:49:24,962][123090] Updated weights for policy 1, policy_version 1272488 (0.0007) [2023-12-26 09:49:25,011][123090] Updated weights for policy 1, policy_version 1272498 (0.0009) [2023-12-26 09:49:25,063][123090] Updated weights for policy 1, policy_version 1272508 (0.0009) [2023-12-26 09:49:25,227][123091] Updated weights for policy 0, policy_version 1281491 (0.0009) [2023-12-26 09:49:25,288][123091] Updated weights for policy 0, policy_version 1281501 (0.0005) [2023-12-26 09:49:25,347][123091] Updated weights for policy 0, policy_version 1281511 (0.0005) [2023-12-26 09:49:25,900][123090] Updated weights for policy 1, policy_version 1272518 (0.0009) [2023-12-26 09:49:25,951][123090] Updated weights for policy 1, policy_version 1272528 (0.0010) [2023-12-26 09:49:25,972][123091] Updated weights for policy 0, policy_version 1281521 (0.0005) [2023-12-26 09:49:25,999][123090] Updated weights for policy 1, policy_version 1272538 (0.0010) [2023-12-26 09:49:26,017][123091] Updated weights for policy 0, policy_version 1281531 (0.0005) [2023-12-26 09:49:26,067][123091] Updated weights for policy 0, policy_version 1281541 (0.0005) [2023-12-26 09:49:26,117][123091] Updated weights for policy 0, policy_version 1281551 (0.0005) [2023-12-26 09:49:26,706][123091] Updated weights for policy 0, policy_version 1281561 (0.0006) [2023-12-26 09:49:26,772][123091] Updated weights for policy 0, policy_version 1281571 (0.0006) [2023-12-26 09:49:26,831][123091] Updated weights for policy 0, policy_version 1281581 (0.0006) [2023-12-26 09:49:26,841][123090] Updated weights for policy 1, policy_version 1272548 (0.0010) [2023-12-26 09:49:26,902][123090] Updated weights for policy 1, policy_version 1272558 (0.0009) [2023-12-26 09:49:26,971][123090] Updated weights for policy 1, policy_version 1272568 (0.0008) [2023-12-26 09:49:27,514][123091] Updated weights for policy 0, policy_version 1281591 (0.0005) [2023-12-26 09:49:27,569][123091] Updated weights for policy 0, policy_version 1281601 (0.0005) [2023-12-26 09:49:27,619][123091] Updated weights for policy 0, policy_version 1281611 (0.0005) [2023-12-26 09:49:27,773][123090] Updated weights for policy 1, policy_version 1272578 (0.0008) [2023-12-26 09:49:27,831][123090] Updated weights for policy 1, policy_version 1272588 (0.0010) [2023-12-26 09:49:27,889][123090] Updated weights for policy 1, policy_version 1272599 (0.0009) [2023-12-26 09:49:28,264][123091] Updated weights for policy 0, policy_version 1281621 (0.0005) [2023-12-26 09:49:28,332][123091] Updated weights for policy 0, policy_version 1281631 (0.0008) [2023-12-26 09:49:28,394][123091] Updated weights for policy 0, policy_version 1281641 (0.0011) [2023-12-26 09:49:28,710][123090] Updated weights for policy 1, policy_version 1272609 (0.0009) [2023-12-26 09:49:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 653893632. Throughput: 0: 9112.5, 1: 8729.1. Samples: 653888896. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:28,785][121949] Avg episode reward: [(0, '6193.169'), (1, '5169.708')] [2023-12-26 09:49:28,785][123090] Updated weights for policy 1, policy_version 1272619 (0.0005) [2023-12-26 09:49:28,858][123090] Updated weights for policy 1, policy_version 1272629 (0.0005) [2023-12-26 09:49:28,925][123090] Updated weights for policy 1, policy_version 1272639 (0.0005) [2023-12-26 09:49:29,114][123091] Updated weights for policy 0, policy_version 1281651 (0.0009) [2023-12-26 09:49:29,183][123091] Updated weights for policy 0, policy_version 1281661 (0.0005) [2023-12-26 09:49:29,251][123091] Updated weights for policy 0, policy_version 1281671 (0.0007) [2023-12-26 09:49:29,572][123090] Updated weights for policy 1, policy_version 1272649 (0.0009) [2023-12-26 09:49:29,630][123090] Updated weights for policy 1, policy_version 1272659 (0.0009) [2023-12-26 09:49:29,687][123090] Updated weights for policy 1, policy_version 1272669 (0.0009) [2023-12-26 09:49:30,019][123091] Updated weights for policy 0, policy_version 1281682 (0.0009) [2023-12-26 09:49:30,083][123091] Updated weights for policy 0, policy_version 1281692 (0.0009) [2023-12-26 09:49:30,144][123091] Updated weights for policy 0, policy_version 1281702 (0.0007) [2023-12-26 09:49:30,196][123091] Updated weights for policy 0, policy_version 1281712 (0.0005) [2023-12-26 09:49:30,537][123090] Updated weights for policy 1, policy_version 1272679 (0.0010) [2023-12-26 09:49:30,585][123090] Updated weights for policy 1, policy_version 1272689 (0.0009) [2023-12-26 09:49:30,633][123090] Updated weights for policy 1, policy_version 1272699 (0.0009) [2023-12-26 09:49:30,981][123091] Updated weights for policy 0, policy_version 1281722 (0.0009) [2023-12-26 09:49:31,028][123091] Updated weights for policy 0, policy_version 1281732 (0.0009) [2023-12-26 09:49:31,088][123091] Updated weights for policy 0, policy_version 1281742 (0.0010) [2023-12-26 09:49:31,469][123090] Updated weights for policy 1, policy_version 1272709 (0.0009) [2023-12-26 09:49:31,535][123090] Updated weights for policy 1, policy_version 1272719 (0.0009) [2023-12-26 09:49:31,592][123090] Updated weights for policy 1, policy_version 1272729 (0.0010) [2023-12-26 09:49:31,909][123091] Updated weights for policy 0, policy_version 1281752 (0.0006) [2023-12-26 09:49:31,963][123091] Updated weights for policy 0, policy_version 1281762 (0.0005) [2023-12-26 09:49:32,020][123091] Updated weights for policy 0, policy_version 1281772 (0.0006) [2023-12-26 09:49:32,522][123090] Updated weights for policy 1, policy_version 1272739 (0.0010) [2023-12-26 09:49:32,585][123090] Updated weights for policy 1, policy_version 1272749 (0.0009) [2023-12-26 09:49:32,640][123090] Updated weights for policy 1, policy_version 1272759 (0.0009) [2023-12-26 09:49:32,818][123091] Updated weights for policy 0, policy_version 1281782 (0.0008) [2023-12-26 09:49:32,874][123091] Updated weights for policy 0, policy_version 1281792 (0.0009) [2023-12-26 09:49:32,931][123091] Updated weights for policy 0, policy_version 1281802 (0.0010) [2023-12-26 09:49:33,439][123090] Updated weights for policy 1, policy_version 1272769 (0.0006) [2023-12-26 09:49:33,499][123090] Updated weights for policy 1, policy_version 1272779 (0.0010) [2023-12-26 09:49:33,553][123090] Updated weights for policy 1, policy_version 1272790 (0.0009) [2023-12-26 09:49:33,612][123090] Updated weights for policy 1, policy_version 1272800 (0.0010) [2023-12-26 09:49:33,675][123091] Updated weights for policy 0, policy_version 1281812 (0.0008) [2023-12-26 09:49:33,732][123091] Updated weights for policy 0, policy_version 1281822 (0.0009) [2023-12-26 09:49:33,782][123091] Updated weights for policy 0, policy_version 1281832 (0.0010) [2023-12-26 09:49:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 653983744. Throughput: 0: 9101.9, 1: 8608.1. Samples: 653995576. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:33,785][121949] Avg episode reward: [(0, '6236.179'), (1, '5326.756')] [2023-12-26 09:49:34,449][123090] Updated weights for policy 1, policy_version 1272810 (0.0010) [2023-12-26 09:49:34,501][123090] Updated weights for policy 1, policy_version 1272820 (0.0010) [2023-12-26 09:49:34,557][123090] Updated weights for policy 1, policy_version 1272830 (0.0010) [2023-12-26 09:49:34,590][123091] Updated weights for policy 0, policy_version 1281842 (0.0010) [2023-12-26 09:49:34,643][123091] Updated weights for policy 0, policy_version 1281852 (0.0010) [2023-12-26 09:49:34,698][123091] Updated weights for policy 0, policy_version 1281862 (0.0011) [2023-12-26 09:49:34,758][123091] Updated weights for policy 0, policy_version 1281872 (0.0011) [2023-12-26 09:49:35,469][123090] Updated weights for policy 1, policy_version 1272840 (0.0009) [2023-12-26 09:49:35,498][123091] Updated weights for policy 0, policy_version 1281882 (0.0005) [2023-12-26 09:49:35,534][123090] Updated weights for policy 1, policy_version 1272850 (0.0007) [2023-12-26 09:49:35,567][123091] Updated weights for policy 0, policy_version 1281892 (0.0005) [2023-12-26 09:49:35,605][123090] Updated weights for policy 1, policy_version 1272860 (0.0007) [2023-12-26 09:49:35,635][123091] Updated weights for policy 0, policy_version 1281902 (0.0005) [2023-12-26 09:49:36,357][123090] Updated weights for policy 1, policy_version 1272870 (0.0010) [2023-12-26 09:49:36,360][123091] Updated weights for policy 0, policy_version 1281912 (0.0010) [2023-12-26 09:49:36,420][123091] Updated weights for policy 0, policy_version 1281922 (0.0011) [2023-12-26 09:49:36,421][123090] Updated weights for policy 1, policy_version 1272880 (0.0010) [2023-12-26 09:49:36,477][123090] Updated weights for policy 1, policy_version 1272890 (0.0009) [2023-12-26 09:49:36,485][123091] Updated weights for policy 0, policy_version 1281932 (0.0011) [2023-12-26 09:49:37,317][123090] Updated weights for policy 1, policy_version 1272900 (0.0011) [2023-12-26 09:49:37,322][123091] Updated weights for policy 0, policy_version 1281942 (0.0011) [2023-12-26 09:49:37,374][123090] Updated weights for policy 1, policy_version 1272910 (0.0010) [2023-12-26 09:49:37,382][123091] Updated weights for policy 0, policy_version 1281952 (0.0011) [2023-12-26 09:49:37,430][123090] Updated weights for policy 1, policy_version 1272920 (0.0010) [2023-12-26 09:49:37,443][123091] Updated weights for policy 0, policy_version 1281962 (0.0011) [2023-12-26 09:49:38,229][123090] Updated weights for policy 1, policy_version 1272930 (0.0009) [2023-12-26 09:49:38,272][123091] Updated weights for policy 0, policy_version 1281972 (0.0011) [2023-12-26 09:49:38,284][123090] Updated weights for policy 1, policy_version 1272940 (0.0006) [2023-12-26 09:49:38,340][123091] Updated weights for policy 0, policy_version 1281982 (0.0011) [2023-12-26 09:49:38,347][123090] Updated weights for policy 1, policy_version 1272950 (0.0008) [2023-12-26 09:49:38,395][123091] Updated weights for policy 0, policy_version 1281992 (0.0011) [2023-12-26 09:49:38,411][123090] Updated weights for policy 1, policy_version 1272960 (0.0007) [2023-12-26 09:49:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 654073856. Throughput: 0: 9125.6, 1: 8612.6. Samples: 654048424. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:38,785][121949] Avg episode reward: [(0, '6405.146'), (1, '5399.666')] [2023-12-26 09:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001282000_328196096.pth... [2023-12-26 09:49:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001272960_325877760.pth... [2023-12-26 09:49:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001280912_327917568.pth [2023-12-26 09:49:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001271968_325623808.pth [2023-12-26 09:49:39,120][123090] Updated weights for policy 1, policy_version 1272970 (0.0011) [2023-12-26 09:49:39,183][123090] Updated weights for policy 1, policy_version 1272980 (0.0010) [2023-12-26 09:49:39,219][123091] Updated weights for policy 0, policy_version 1282002 (0.0010) [2023-12-26 09:49:39,253][123090] Updated weights for policy 1, policy_version 1272990 (0.0008) [2023-12-26 09:49:39,289][123091] Updated weights for policy 0, policy_version 1282012 (0.0010) [2023-12-26 09:49:39,358][123091] Updated weights for policy 0, policy_version 1282022 (0.0011) [2023-12-26 09:49:39,420][123091] Updated weights for policy 0, policy_version 1282032 (0.0013) [2023-12-26 09:49:40,085][123090] Updated weights for policy 1, policy_version 1273000 (0.0007) [2023-12-26 09:49:40,152][123090] Updated weights for policy 1, policy_version 1273010 (0.0006) [2023-12-26 09:49:40,208][123090] Updated weights for policy 1, policy_version 1273020 (0.0011) [2023-12-26 09:49:40,230][123091] Updated weights for policy 0, policy_version 1282042 (0.0006) [2023-12-26 09:49:40,297][123091] Updated weights for policy 0, policy_version 1282052 (0.0006) [2023-12-26 09:49:40,358][123091] Updated weights for policy 0, policy_version 1282062 (0.0010) [2023-12-26 09:49:40,980][123090] Updated weights for policy 1, policy_version 1273030 (0.0009) [2023-12-26 09:49:41,044][123090] Updated weights for policy 1, policy_version 1273040 (0.0009) [2023-12-26 09:49:41,094][123091] Updated weights for policy 0, policy_version 1282072 (0.0011) [2023-12-26 09:49:41,109][123090] Updated weights for policy 1, policy_version 1273050 (0.0007) [2023-12-26 09:49:41,167][123091] Updated weights for policy 0, policy_version 1282082 (0.0009) [2023-12-26 09:49:41,234][123091] Updated weights for policy 0, policy_version 1282092 (0.0011) [2023-12-26 09:49:41,958][123090] Updated weights for policy 1, policy_version 1273060 (0.0009) [2023-12-26 09:49:42,021][123090] Updated weights for policy 1, policy_version 1273070 (0.0009) [2023-12-26 09:49:42,061][123091] Updated weights for policy 0, policy_version 1282102 (0.0009) [2023-12-26 09:49:42,084][123090] Updated weights for policy 1, policy_version 1273080 (0.0010) [2023-12-26 09:49:42,130][123091] Updated weights for policy 0, policy_version 1282112 (0.0007) [2023-12-26 09:49:42,188][123091] Updated weights for policy 0, policy_version 1282122 (0.0009) [2023-12-26 09:49:42,889][123090] Updated weights for policy 1, policy_version 1273090 (0.0010) [2023-12-26 09:49:42,944][123090] Updated weights for policy 1, policy_version 1273100 (0.0008) [2023-12-26 09:49:42,998][123090] Updated weights for policy 1, policy_version 1273110 (0.0009) [2023-12-26 09:49:43,053][123090] Updated weights for policy 1, policy_version 1273120 (0.0007) [2023-12-26 09:49:43,076][123091] Updated weights for policy 0, policy_version 1282132 (0.0009) [2023-12-26 09:49:43,142][123091] Updated weights for policy 0, policy_version 1282142 (0.0009) [2023-12-26 09:49:43,200][123091] Updated weights for policy 0, policy_version 1282152 (0.0010) [2023-12-26 09:49:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 654155776. Throughput: 0: 8951.2, 1: 8566.6. Samples: 654152740. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:43,785][121949] Avg episode reward: [(0, '6337.354'), (1, '5290.592')] [2023-12-26 09:49:43,854][123090] Updated weights for policy 1, policy_version 1273130 (0.0009) [2023-12-26 09:49:43,918][123090] Updated weights for policy 1, policy_version 1273140 (0.0008) [2023-12-26 09:49:43,977][123090] Updated weights for policy 1, policy_version 1273150 (0.0009) [2023-12-26 09:49:44,032][123091] Updated weights for policy 0, policy_version 1282162 (0.0010) [2023-12-26 09:49:44,090][123091] Updated weights for policy 0, policy_version 1282172 (0.0010) [2023-12-26 09:49:44,138][123091] Updated weights for policy 0, policy_version 1282182 (0.0010) [2023-12-26 09:49:44,192][123091] Updated weights for policy 0, policy_version 1282192 (0.0010) [2023-12-26 09:49:44,745][123090] Updated weights for policy 1, policy_version 1273160 (0.0006) [2023-12-26 09:49:44,814][123090] Updated weights for policy 1, policy_version 1273170 (0.0007) [2023-12-26 09:49:44,890][123090] Updated weights for policy 1, policy_version 1273180 (0.0007) [2023-12-26 09:49:44,948][123091] Updated weights for policy 0, policy_version 1282202 (0.0006) [2023-12-26 09:49:44,994][123091] Updated weights for policy 0, policy_version 1282212 (0.0006) [2023-12-26 09:49:45,061][123091] Updated weights for policy 0, policy_version 1282222 (0.0007) [2023-12-26 09:49:45,682][123090] Updated weights for policy 1, policy_version 1273190 (0.0009) [2023-12-26 09:49:45,752][123090] Updated weights for policy 1, policy_version 1273200 (0.0010) [2023-12-26 09:49:45,806][123091] Updated weights for policy 0, policy_version 1282232 (0.0007) [2023-12-26 09:49:45,807][123090] Updated weights for policy 1, policy_version 1273210 (0.0010) [2023-12-26 09:49:45,871][123091] Updated weights for policy 0, policy_version 1282242 (0.0006) [2023-12-26 09:49:45,937][123091] Updated weights for policy 0, policy_version 1282252 (0.0008) [2023-12-26 09:49:46,587][123090] Updated weights for policy 1, policy_version 1273220 (0.0009) [2023-12-26 09:49:46,652][123090] Updated weights for policy 1, policy_version 1273230 (0.0008) [2023-12-26 09:49:46,680][123091] Updated weights for policy 0, policy_version 1282262 (0.0010) [2023-12-26 09:49:46,722][123090] Updated weights for policy 1, policy_version 1273240 (0.0005) [2023-12-26 09:49:46,748][123091] Updated weights for policy 0, policy_version 1282272 (0.0006) [2023-12-26 09:49:46,808][123091] Updated weights for policy 0, policy_version 1282282 (0.0006) [2023-12-26 09:49:47,470][123090] Updated weights for policy 1, policy_version 1273250 (0.0007) [2023-12-26 09:49:47,540][123090] Updated weights for policy 1, policy_version 1273260 (0.0010) [2023-12-26 09:49:47,594][123091] Updated weights for policy 0, policy_version 1282292 (0.0009) [2023-12-26 09:49:47,606][123090] Updated weights for policy 1, policy_version 1273270 (0.0010) [2023-12-26 09:49:47,654][123091] Updated weights for policy 0, policy_version 1282302 (0.0011) [2023-12-26 09:49:47,667][123090] Updated weights for policy 1, policy_version 1273280 (0.0010) [2023-12-26 09:49:47,724][123091] Updated weights for policy 0, policy_version 1282312 (0.0007) [2023-12-26 09:49:48,468][123090] Updated weights for policy 1, policy_version 1273290 (0.0008) [2023-12-26 09:49:48,517][123091] Updated weights for policy 0, policy_version 1282322 (0.0010) [2023-12-26 09:49:48,537][123090] Updated weights for policy 1, policy_version 1273300 (0.0007) [2023-12-26 09:49:48,583][123091] Updated weights for policy 0, policy_version 1282332 (0.0009) [2023-12-26 09:49:48,607][123090] Updated weights for policy 1, policy_version 1273310 (0.0005) [2023-12-26 09:49:48,647][123091] Updated weights for policy 0, policy_version 1282342 (0.0009) [2023-12-26 09:49:48,701][123091] Updated weights for policy 0, policy_version 1282352 (0.0010) [2023-12-26 09:49:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 654254080. Throughput: 0: 9030.2, 1: 8645.4. Samples: 654260628. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:48,785][121949] Avg episode reward: [(0, '6290.683'), (1, '5265.185')] [2023-12-26 09:49:49,348][123090] Updated weights for policy 1, policy_version 1273320 (0.0009) [2023-12-26 09:49:49,417][123090] Updated weights for policy 1, policy_version 1273330 (0.0009) [2023-12-26 09:49:49,494][123090] Updated weights for policy 1, policy_version 1273340 (0.0009) [2023-12-26 09:49:49,529][123091] Updated weights for policy 0, policy_version 1282362 (0.0006) [2023-12-26 09:49:49,597][123091] Updated weights for policy 0, policy_version 1282372 (0.0007) [2023-12-26 09:49:49,672][123091] Updated weights for policy 0, policy_version 1282382 (0.0005) [2023-12-26 09:49:50,209][123090] Updated weights for policy 1, policy_version 1273350 (0.0010) [2023-12-26 09:49:50,263][123090] Updated weights for policy 1, policy_version 1273360 (0.0009) [2023-12-26 09:49:50,323][123090] Updated weights for policy 1, policy_version 1273370 (0.0009) [2023-12-26 09:49:50,363][123091] Updated weights for policy 0, policy_version 1282392 (0.0007) [2023-12-26 09:49:50,423][123091] Updated weights for policy 0, policy_version 1282402 (0.0005) [2023-12-26 09:49:50,490][123091] Updated weights for policy 0, policy_version 1282412 (0.0005) [2023-12-26 09:49:51,218][123090] Updated weights for policy 1, policy_version 1273380 (0.0010) [2023-12-26 09:49:51,256][123091] Updated weights for policy 0, policy_version 1282422 (0.0007) [2023-12-26 09:49:51,289][123090] Updated weights for policy 1, policy_version 1273390 (0.0008) [2023-12-26 09:49:51,318][123091] Updated weights for policy 0, policy_version 1282432 (0.0008) [2023-12-26 09:49:51,357][123090] Updated weights for policy 1, policy_version 1273400 (0.0009) [2023-12-26 09:49:51,383][123091] Updated weights for policy 0, policy_version 1282442 (0.0008) [2023-12-26 09:49:52,170][123090] Updated weights for policy 1, policy_version 1273410 (0.0008) [2023-12-26 09:49:52,194][123091] Updated weights for policy 0, policy_version 1282452 (0.0009) [2023-12-26 09:49:52,232][123090] Updated weights for policy 1, policy_version 1273420 (0.0005) [2023-12-26 09:49:52,264][123091] Updated weights for policy 0, policy_version 1282462 (0.0009) [2023-12-26 09:49:52,301][123090] Updated weights for policy 1, policy_version 1273430 (0.0007) [2023-12-26 09:49:52,327][123091] Updated weights for policy 0, policy_version 1282472 (0.0009) [2023-12-26 09:49:52,357][123090] Updated weights for policy 1, policy_version 1273440 (0.0008) [2023-12-26 09:49:53,132][123091] Updated weights for policy 0, policy_version 1282482 (0.0009) [2023-12-26 09:49:53,188][123090] Updated weights for policy 1, policy_version 1273450 (0.0009) [2023-12-26 09:49:53,193][123091] Updated weights for policy 0, policy_version 1282492 (0.0005) [2023-12-26 09:49:53,255][123090] Updated weights for policy 1, policy_version 1273460 (0.0009) [2023-12-26 09:49:53,260][123091] Updated weights for policy 0, policy_version 1282502 (0.0005) [2023-12-26 09:49:53,316][123090] Updated weights for policy 1, policy_version 1273470 (0.0009) [2023-12-26 09:49:53,332][123091] Updated weights for policy 0, policy_version 1282512 (0.0005) [2023-12-26 09:49:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 654336000. Throughput: 0: 9062.7, 1: 8654.1. Samples: 654313108. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:53,785][121949] Avg episode reward: [(0, '6304.034'), (1, '5255.159')] [2023-12-26 09:49:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001282512_328327168.pth... [2023-12-26 09:49:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001273472_326008832.pth... [2023-12-26 09:49:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001281456_328056832.pth [2023-12-26 09:49:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001272448_325746688.pth [2023-12-26 09:49:53,942][123091] Updated weights for policy 0, policy_version 1282522 (0.0005) [2023-12-26 09:49:53,990][123091] Updated weights for policy 0, policy_version 1282532 (0.0009) [2023-12-26 09:49:54,053][123091] Updated weights for policy 0, policy_version 1282544 (0.0010) [2023-12-26 09:49:54,201][123090] Updated weights for policy 1, policy_version 1273480 (0.0010) [2023-12-26 09:49:54,250][123090] Updated weights for policy 1, policy_version 1273490 (0.0009) [2023-12-26 09:49:54,308][123090] Updated weights for policy 1, policy_version 1273500 (0.0008) [2023-12-26 09:49:54,887][123091] Updated weights for policy 0, policy_version 1282554 (0.0011) [2023-12-26 09:49:54,948][123091] Updated weights for policy 0, policy_version 1282564 (0.0010) [2023-12-26 09:49:55,008][123091] Updated weights for policy 0, policy_version 1282574 (0.0011) [2023-12-26 09:49:55,187][123090] Updated weights for policy 1, policy_version 1273510 (0.0009) [2023-12-26 09:49:55,244][123090] Updated weights for policy 1, policy_version 1273520 (0.0010) [2023-12-26 09:49:55,297][123090] Updated weights for policy 1, policy_version 1273530 (0.0010) [2023-12-26 09:49:55,779][123091] Updated weights for policy 0, policy_version 1282584 (0.0011) [2023-12-26 09:49:55,848][123091] Updated weights for policy 0, policy_version 1282594 (0.0010) [2023-12-26 09:49:55,911][123091] Updated weights for policy 0, policy_version 1282604 (0.0011) [2023-12-26 09:49:56,127][123090] Updated weights for policy 1, policy_version 1273540 (0.0009) [2023-12-26 09:49:56,186][123090] Updated weights for policy 1, policy_version 1273550 (0.0008) [2023-12-26 09:49:56,241][123090] Updated weights for policy 1, policy_version 1273560 (0.0008) [2023-12-26 09:49:56,703][123091] Updated weights for policy 0, policy_version 1282614 (0.0010) [2023-12-26 09:49:56,750][123091] Updated weights for policy 0, policy_version 1282624 (0.0010) [2023-12-26 09:49:56,806][123091] Updated weights for policy 0, policy_version 1282634 (0.0011) [2023-12-26 09:49:57,088][123090] Updated weights for policy 1, policy_version 1273570 (0.0008) [2023-12-26 09:49:57,146][123090] Updated weights for policy 1, policy_version 1273580 (0.0009) [2023-12-26 09:49:57,205][123090] Updated weights for policy 1, policy_version 1273590 (0.0008) [2023-12-26 09:49:57,260][123090] Updated weights for policy 1, policy_version 1273600 (0.0009) [2023-12-26 09:49:57,658][123091] Updated weights for policy 0, policy_version 1282644 (0.0011) [2023-12-26 09:49:57,716][123091] Updated weights for policy 0, policy_version 1282654 (0.0011) [2023-12-26 09:49:57,789][123091] Updated weights for policy 0, policy_version 1282664 (0.0011) [2023-12-26 09:49:58,083][123090] Updated weights for policy 1, policy_version 1273610 (0.0009) [2023-12-26 09:49:58,149][123090] Updated weights for policy 1, policy_version 1273620 (0.0008) [2023-12-26 09:49:58,221][123090] Updated weights for policy 1, policy_version 1273630 (0.0007) [2023-12-26 09:49:58,640][123091] Updated weights for policy 0, policy_version 1282674 (0.0011) [2023-12-26 09:49:58,705][123091] Updated weights for policy 0, policy_version 1282684 (0.0009) [2023-12-26 09:49:58,775][123091] Updated weights for policy 0, policy_version 1282694 (0.0008) [2023-12-26 09:49:58,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 654417920. Throughput: 0: 9131.6, 1: 8626.2. Samples: 654418560. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:49:58,784][121949] Avg episode reward: [(0, '6270.234'), (1, '5172.462')] [2023-12-26 09:49:58,846][123091] Updated weights for policy 0, policy_version 1282704 (0.0008) [2023-12-26 09:49:59,098][123090] Updated weights for policy 1, policy_version 1273640 (0.0009) [2023-12-26 09:49:59,158][123090] Updated weights for policy 1, policy_version 1273650 (0.0009) [2023-12-26 09:49:59,214][123090] Updated weights for policy 1, policy_version 1273660 (0.0009) [2023-12-26 09:49:59,642][123091] Updated weights for policy 0, policy_version 1282714 (0.0006) [2023-12-26 09:49:59,709][123091] Updated weights for policy 0, policy_version 1282724 (0.0006) [2023-12-26 09:49:59,787][123091] Updated weights for policy 0, policy_version 1282734 (0.0006) [2023-12-26 09:50:00,085][123090] Updated weights for policy 1, policy_version 1273670 (0.0009) [2023-12-26 09:50:00,152][123090] Updated weights for policy 1, policy_version 1273680 (0.0006) [2023-12-26 09:50:00,222][123090] Updated weights for policy 1, policy_version 1273690 (0.0009) [2023-12-26 09:50:00,441][123091] Updated weights for policy 0, policy_version 1282744 (0.0009) [2023-12-26 09:50:00,491][123091] Updated weights for policy 0, policy_version 1282754 (0.0009) [2023-12-26 09:50:00,538][123091] Updated weights for policy 0, policy_version 1282764 (0.0009) [2023-12-26 09:50:01,013][123090] Updated weights for policy 1, policy_version 1273700 (0.0009) [2023-12-26 09:50:01,078][123090] Updated weights for policy 1, policy_version 1273710 (0.0009) [2023-12-26 09:50:01,139][123090] Updated weights for policy 1, policy_version 1273720 (0.0009) [2023-12-26 09:50:01,373][123091] Updated weights for policy 0, policy_version 1282774 (0.0008) [2023-12-26 09:50:01,435][123091] Updated weights for policy 0, policy_version 1282784 (0.0007) [2023-12-26 09:50:01,498][123091] Updated weights for policy 0, policy_version 1282794 (0.0011) [2023-12-26 09:50:02,011][123090] Updated weights for policy 1, policy_version 1273730 (0.0009) [2023-12-26 09:50:02,073][123090] Updated weights for policy 1, policy_version 1273741 (0.0009) [2023-12-26 09:50:02,122][123090] Updated weights for policy 1, policy_version 1273751 (0.0009) [2023-12-26 09:50:02,321][123091] Updated weights for policy 0, policy_version 1282804 (0.0010) [2023-12-26 09:50:02,381][123091] Updated weights for policy 0, policy_version 1282814 (0.0006) [2023-12-26 09:50:02,428][123091] Updated weights for policy 0, policy_version 1282824 (0.0005) [2023-12-26 09:50:02,953][123090] Updated weights for policy 1, policy_version 1273761 (0.0009) [2023-12-26 09:50:03,025][123090] Updated weights for policy 1, policy_version 1273771 (0.0008) [2023-12-26 09:50:03,087][123090] Updated weights for policy 1, policy_version 1273781 (0.0010) [2023-12-26 09:50:03,112][123091] Updated weights for policy 0, policy_version 1282834 (0.0006) [2023-12-26 09:50:03,151][123090] Updated weights for policy 1, policy_version 1273791 (0.0008) [2023-12-26 09:50:03,163][123091] Updated weights for policy 0, policy_version 1282844 (0.0005) [2023-12-26 09:50:03,208][123091] Updated weights for policy 0, policy_version 1282854 (0.0005) [2023-12-26 09:50:03,257][123091] Updated weights for policy 0, policy_version 1282864 (0.0005) [2023-12-26 09:50:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 654508032. Throughput: 0: 9107.6, 1: 8624.6. Samples: 654523488. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:03,784][121949] Avg episode reward: [(0, '6376.144'), (1, '5060.709')] [2023-12-26 09:50:03,903][123090] Updated weights for policy 1, policy_version 1273801 (0.0007) [2023-12-26 09:50:03,956][123091] Updated weights for policy 0, policy_version 1282874 (0.0006) [2023-12-26 09:50:03,971][123090] Updated weights for policy 1, policy_version 1273811 (0.0006) [2023-12-26 09:50:04,025][123091] Updated weights for policy 0, policy_version 1282884 (0.0008) [2023-12-26 09:50:04,035][123090] Updated weights for policy 1, policy_version 1273821 (0.0006) [2023-12-26 09:50:04,091][123091] Updated weights for policy 0, policy_version 1282894 (0.0006) [2023-12-26 09:50:04,712][123090] Updated weights for policy 1, policy_version 1273831 (0.0005) [2023-12-26 09:50:04,779][123090] Updated weights for policy 1, policy_version 1273841 (0.0006) [2023-12-26 09:50:04,840][123090] Updated weights for policy 1, policy_version 1273851 (0.0007) [2023-12-26 09:50:04,873][123091] Updated weights for policy 0, policy_version 1282904 (0.0011) [2023-12-26 09:50:04,938][123091] Updated weights for policy 0, policy_version 1282914 (0.0011) [2023-12-26 09:50:05,003][123091] Updated weights for policy 0, policy_version 1282924 (0.0011) [2023-12-26 09:50:05,510][123090] Updated weights for policy 1, policy_version 1273861 (0.0008) [2023-12-26 09:50:05,574][123090] Updated weights for policy 1, policy_version 1273871 (0.0005) [2023-12-26 09:50:05,626][123090] Updated weights for policy 1, policy_version 1273881 (0.0005) [2023-12-26 09:50:05,744][123091] Updated weights for policy 0, policy_version 1282934 (0.0010) [2023-12-26 09:50:05,797][123091] Updated weights for policy 0, policy_version 1282944 (0.0010) [2023-12-26 09:50:05,845][123091] Updated weights for policy 0, policy_version 1282954 (0.0010) [2023-12-26 09:50:06,227][123090] Updated weights for policy 1, policy_version 1273891 (0.0007) [2023-12-26 09:50:06,297][123090] Updated weights for policy 1, policy_version 1273901 (0.0010) [2023-12-26 09:50:06,369][123090] Updated weights for policy 1, policy_version 1273911 (0.0011) [2023-12-26 09:50:06,715][123091] Updated weights for policy 0, policy_version 1282964 (0.0010) [2023-12-26 09:50:06,786][123091] Updated weights for policy 0, policy_version 1282974 (0.0011) [2023-12-26 09:50:06,852][123091] Updated weights for policy 0, policy_version 1282984 (0.0011) [2023-12-26 09:50:07,161][123090] Updated weights for policy 1, policy_version 1273921 (0.0010) [2023-12-26 09:50:07,231][123090] Updated weights for policy 1, policy_version 1273931 (0.0008) [2023-12-26 09:50:07,285][123090] Updated weights for policy 1, policy_version 1273941 (0.0006) [2023-12-26 09:50:07,341][123090] Updated weights for policy 1, policy_version 1273951 (0.0007) [2023-12-26 09:50:07,603][123091] Updated weights for policy 0, policy_version 1282994 (0.0010) [2023-12-26 09:50:07,656][123091] Updated weights for policy 0, policy_version 1283004 (0.0005) [2023-12-26 09:50:07,731][123091] Updated weights for policy 0, policy_version 1283014 (0.0006) [2023-12-26 09:50:07,806][123091] Updated weights for policy 0, policy_version 1283024 (0.0005) [2023-12-26 09:50:07,971][123090] Updated weights for policy 1, policy_version 1273961 (0.0006) [2023-12-26 09:50:08,042][123090] Updated weights for policy 1, policy_version 1273971 (0.0006) [2023-12-26 09:50:08,123][123090] Updated weights for policy 1, policy_version 1273981 (0.0006) [2023-12-26 09:50:08,391][123091] Updated weights for policy 0, policy_version 1283034 (0.0007) [2023-12-26 09:50:08,447][123091] Updated weights for policy 0, policy_version 1283044 (0.0009) [2023-12-26 09:50:08,510][123091] Updated weights for policy 0, policy_version 1283054 (0.0007) [2023-12-26 09:50:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 654606336. Throughput: 0: 9110.8, 1: 8730.9. Samples: 654580176. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:08,785][121949] Avg episode reward: [(0, '6311.765'), (1, '5231.982')] [2023-12-26 09:50:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001283056_328466432.pth... [2023-12-26 09:50:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001273984_326139904.pth... [2023-12-26 09:50:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001282000_328196096.pth [2023-12-26 09:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001272960_325877760.pth [2023-12-26 09:50:08,875][123090] Updated weights for policy 1, policy_version 1273991 (0.0009) [2023-12-26 09:50:08,947][123090] Updated weights for policy 1, policy_version 1274001 (0.0009) [2023-12-26 09:50:09,012][123090] Updated weights for policy 1, policy_version 1274011 (0.0009) [2023-12-26 09:50:09,295][123091] Updated weights for policy 0, policy_version 1283064 (0.0007) [2023-12-26 09:50:09,371][123091] Updated weights for policy 0, policy_version 1283074 (0.0008) [2023-12-26 09:50:09,441][123091] Updated weights for policy 0, policy_version 1283084 (0.0010) [2023-12-26 09:50:09,899][123090] Updated weights for policy 1, policy_version 1274021 (0.0010) [2023-12-26 09:50:09,960][123090] Updated weights for policy 1, policy_version 1274031 (0.0008) [2023-12-26 09:50:10,018][123090] Updated weights for policy 1, policy_version 1274041 (0.0009) [2023-12-26 09:50:10,264][123091] Updated weights for policy 0, policy_version 1283094 (0.0010) [2023-12-26 09:50:10,321][123091] Updated weights for policy 0, policy_version 1283104 (0.0010) [2023-12-26 09:50:10,383][123091] Updated weights for policy 0, policy_version 1283114 (0.0010) [2023-12-26 09:50:10,890][123090] Updated weights for policy 1, policy_version 1274051 (0.0009) [2023-12-26 09:50:10,962][123090] Updated weights for policy 1, policy_version 1274061 (0.0008) [2023-12-26 09:50:11,041][123090] Updated weights for policy 1, policy_version 1274071 (0.0008) [2023-12-26 09:50:11,087][123091] Updated weights for policy 0, policy_version 1283124 (0.0008) [2023-12-26 09:50:11,152][123091] Updated weights for policy 0, policy_version 1283134 (0.0007) [2023-12-26 09:50:11,224][123091] Updated weights for policy 0, policy_version 1283144 (0.0006) [2023-12-26 09:50:11,823][123090] Updated weights for policy 1, policy_version 1274081 (0.0008) [2023-12-26 09:50:11,880][123090] Updated weights for policy 1, policy_version 1274091 (0.0009) [2023-12-26 09:50:11,940][123090] Updated weights for policy 1, policy_version 1274101 (0.0010) [2023-12-26 09:50:12,004][123091] Updated weights for policy 0, policy_version 1283154 (0.0006) [2023-12-26 09:50:12,004][123090] Updated weights for policy 1, policy_version 1274111 (0.0009) [2023-12-26 09:50:12,068][123091] Updated weights for policy 0, policy_version 1283164 (0.0009) [2023-12-26 09:50:12,134][123091] Updated weights for policy 0, policy_version 1283174 (0.0008) [2023-12-26 09:50:12,183][123091] Updated weights for policy 0, policy_version 1283184 (0.0009) [2023-12-26 09:50:12,852][123090] Updated weights for policy 1, policy_version 1274121 (0.0010) [2023-12-26 09:50:12,915][123090] Updated weights for policy 1, policy_version 1274131 (0.0010) [2023-12-26 09:50:12,977][123090] Updated weights for policy 1, policy_version 1274141 (0.0005) [2023-12-26 09:50:13,040][123091] Updated weights for policy 0, policy_version 1283194 (0.0010) [2023-12-26 09:50:13,098][123091] Updated weights for policy 0, policy_version 1283204 (0.0010) [2023-12-26 09:50:13,167][123091] Updated weights for policy 0, policy_version 1283214 (0.0010) [2023-12-26 09:50:13,665][123090] Updated weights for policy 1, policy_version 1274151 (0.0006) [2023-12-26 09:50:13,723][123090] Updated weights for policy 1, policy_version 1274161 (0.0010) [2023-12-26 09:50:13,774][123090] Updated weights for policy 1, policy_version 1274171 (0.0010) [2023-12-26 09:50:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 654688256. Throughput: 0: 9002.1, 1: 8716.6. Samples: 654686236. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:13,784][121949] Avg episode reward: [(0, '6234.404'), (1, '5220.856')] [2023-12-26 09:50:14,058][123091] Updated weights for policy 0, policy_version 1283224 (0.0010) [2023-12-26 09:50:14,115][123091] Updated weights for policy 0, policy_version 1283234 (0.0010) [2023-12-26 09:50:14,178][123091] Updated weights for policy 0, policy_version 1283244 (0.0006) [2023-12-26 09:50:14,550][123090] Updated weights for policy 1, policy_version 1274181 (0.0008) [2023-12-26 09:50:14,607][123090] Updated weights for policy 1, policy_version 1274191 (0.0008) [2023-12-26 09:50:14,665][123090] Updated weights for policy 1, policy_version 1274201 (0.0009) [2023-12-26 09:50:14,943][123091] Updated weights for policy 0, policy_version 1283254 (0.0010) [2023-12-26 09:50:15,002][123091] Updated weights for policy 0, policy_version 1283264 (0.0010) [2023-12-26 09:50:15,061][123091] Updated weights for policy 0, policy_version 1283274 (0.0010) [2023-12-26 09:50:15,536][123090] Updated weights for policy 1, policy_version 1274211 (0.0010) [2023-12-26 09:50:15,597][123090] Updated weights for policy 1, policy_version 1274221 (0.0008) [2023-12-26 09:50:15,666][123090] Updated weights for policy 1, policy_version 1274231 (0.0009) [2023-12-26 09:50:15,870][123091] Updated weights for policy 0, policy_version 1283284 (0.0007) [2023-12-26 09:50:15,943][123091] Updated weights for policy 0, policy_version 1283294 (0.0010) [2023-12-26 09:50:16,002][123091] Updated weights for policy 0, policy_version 1283304 (0.0010) [2023-12-26 09:50:16,398][123090] Updated weights for policy 1, policy_version 1274241 (0.0008) [2023-12-26 09:50:16,451][123090] Updated weights for policy 1, policy_version 1274251 (0.0006) [2023-12-26 09:50:16,506][123090] Updated weights for policy 1, policy_version 1274261 (0.0005) [2023-12-26 09:50:16,574][123090] Updated weights for policy 1, policy_version 1274271 (0.0005) [2023-12-26 09:50:16,880][123091] Updated weights for policy 0, policy_version 1283314 (0.0009) [2023-12-26 09:50:16,944][123091] Updated weights for policy 0, policy_version 1283324 (0.0009) [2023-12-26 09:50:17,018][123091] Updated weights for policy 0, policy_version 1283334 (0.0009) [2023-12-26 09:50:17,087][123091] Updated weights for policy 0, policy_version 1283344 (0.0009) [2023-12-26 09:50:17,313][123090] Updated weights for policy 1, policy_version 1274281 (0.0005) [2023-12-26 09:50:17,366][123090] Updated weights for policy 1, policy_version 1274291 (0.0005) [2023-12-26 09:50:17,433][123090] Updated weights for policy 1, policy_version 1274301 (0.0005) [2023-12-26 09:50:17,833][123091] Updated weights for policy 0, policy_version 1283354 (0.0008) [2023-12-26 09:50:17,888][123091] Updated weights for policy 0, policy_version 1283364 (0.0008) [2023-12-26 09:50:17,940][123091] Updated weights for policy 0, policy_version 1283374 (0.0009) [2023-12-26 09:50:18,193][123090] Updated weights for policy 1, policy_version 1274311 (0.0005) [2023-12-26 09:50:18,239][123090] Updated weights for policy 1, policy_version 1274321 (0.0005) [2023-12-26 09:50:18,287][123090] Updated weights for policy 1, policy_version 1274331 (0.0005) [2023-12-26 09:50:18,779][123091] Updated weights for policy 0, policy_version 1283384 (0.0009) [2023-12-26 09:50:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 654778368. Throughput: 0: 8893.8, 1: 8825.4. Samples: 654792940. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:18,785][121949] Avg episode reward: [(0, '6265.990'), (1, '5243.364')] [2023-12-26 09:50:18,842][123091] Updated weights for policy 0, policy_version 1283394 (0.0010) [2023-12-26 09:50:18,895][123091] Updated weights for policy 0, policy_version 1283404 (0.0009) [2023-12-26 09:50:19,082][123090] Updated weights for policy 1, policy_version 1274341 (0.0008) [2023-12-26 09:50:19,146][123090] Updated weights for policy 1, policy_version 1274351 (0.0010) [2023-12-26 09:50:19,208][123090] Updated weights for policy 1, policy_version 1274361 (0.0010) [2023-12-26 09:50:19,721][123091] Updated weights for policy 0, policy_version 1283414 (0.0010) [2023-12-26 09:50:19,784][123091] Updated weights for policy 0, policy_version 1283424 (0.0011) [2023-12-26 09:50:19,847][123091] Updated weights for policy 0, policy_version 1283434 (0.0009) [2023-12-26 09:50:20,036][123090] Updated weights for policy 1, policy_version 1274371 (0.0011) [2023-12-26 09:50:20,093][123090] Updated weights for policy 1, policy_version 1274381 (0.0011) [2023-12-26 09:50:20,146][123090] Updated weights for policy 1, policy_version 1274391 (0.0011) [2023-12-26 09:50:20,639][123091] Updated weights for policy 0, policy_version 1283444 (0.0006) [2023-12-26 09:50:20,715][123091] Updated weights for policy 0, policy_version 1283454 (0.0006) [2023-12-26 09:50:20,784][123091] Updated weights for policy 0, policy_version 1283464 (0.0006) [2023-12-26 09:50:21,005][123090] Updated weights for policy 1, policy_version 1274401 (0.0010) [2023-12-26 09:50:21,087][123090] Updated weights for policy 1, policy_version 1274411 (0.0010) [2023-12-26 09:50:21,162][123090] Updated weights for policy 1, policy_version 1274421 (0.0009) [2023-12-26 09:50:21,232][123090] Updated weights for policy 1, policy_version 1274431 (0.0008) [2023-12-26 09:50:21,558][123091] Updated weights for policy 0, policy_version 1283474 (0.0006) [2023-12-26 09:50:21,629][123091] Updated weights for policy 0, policy_version 1283484 (0.0008) [2023-12-26 09:50:21,697][123091] Updated weights for policy 0, policy_version 1283494 (0.0010) [2023-12-26 09:50:21,764][123091] Updated weights for policy 0, policy_version 1283504 (0.0010) [2023-12-26 09:50:22,088][123090] Updated weights for policy 1, policy_version 1274441 (0.0007) [2023-12-26 09:50:22,144][123090] Updated weights for policy 1, policy_version 1274451 (0.0008) [2023-12-26 09:50:22,197][123090] Updated weights for policy 1, policy_version 1274461 (0.0009) [2023-12-26 09:50:22,594][123091] Updated weights for policy 0, policy_version 1283514 (0.0010) [2023-12-26 09:50:22,664][123091] Updated weights for policy 0, policy_version 1283524 (0.0010) [2023-12-26 09:50:22,733][123091] Updated weights for policy 0, policy_version 1283534 (0.0009) [2023-12-26 09:50:23,054][123090] Updated weights for policy 1, policy_version 1274471 (0.0008) [2023-12-26 09:50:23,125][123090] Updated weights for policy 1, policy_version 1274481 (0.0005) [2023-12-26 09:50:23,194][123090] Updated weights for policy 1, policy_version 1274491 (0.0005) [2023-12-26 09:50:23,557][123091] Updated weights for policy 0, policy_version 1283544 (0.0011) [2023-12-26 09:50:23,620][123091] Updated weights for policy 0, policy_version 1283554 (0.0011) [2023-12-26 09:50:23,683][123091] Updated weights for policy 0, policy_version 1283564 (0.0011) [2023-12-26 09:50:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 654868480. Throughput: 0: 8879.7, 1: 8814.2. Samples: 654844652. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:23,785][121949] Avg episode reward: [(0, '6358.158'), (1, '5087.019')] [2023-12-26 09:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001283568_328597504.pth... [2023-12-26 09:50:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001274496_326270976.pth... [2023-12-26 09:50:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001282512_328327168.pth [2023-12-26 09:50:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001273472_326008832.pth [2023-12-26 09:50:23,972][123090] Updated weights for policy 1, policy_version 1274501 (0.0007) [2023-12-26 09:50:24,038][123090] Updated weights for policy 1, policy_version 1274511 (0.0006) [2023-12-26 09:50:24,097][123090] Updated weights for policy 1, policy_version 1274521 (0.0010) [2023-12-26 09:50:24,403][123091] Updated weights for policy 0, policy_version 1283574 (0.0009) [2023-12-26 09:50:24,463][123091] Updated weights for policy 0, policy_version 1283584 (0.0009) [2023-12-26 09:50:24,521][123091] Updated weights for policy 0, policy_version 1283594 (0.0010) [2023-12-26 09:50:24,807][123090] Updated weights for policy 1, policy_version 1274531 (0.0009) [2023-12-26 09:50:24,867][123090] Updated weights for policy 1, policy_version 1274541 (0.0010) [2023-12-26 09:50:24,933][123090] Updated weights for policy 1, policy_version 1274551 (0.0010) [2023-12-26 09:50:25,280][123091] Updated weights for policy 0, policy_version 1283604 (0.0008) [2023-12-26 09:50:25,349][123091] Updated weights for policy 0, policy_version 1283614 (0.0005) [2023-12-26 09:50:25,396][123091] Updated weights for policy 0, policy_version 1283624 (0.0005) [2023-12-26 09:50:25,741][123090] Updated weights for policy 1, policy_version 1274561 (0.0010) [2023-12-26 09:50:25,807][123090] Updated weights for policy 1, policy_version 1274571 (0.0005) [2023-12-26 09:50:25,867][123090] Updated weights for policy 1, policy_version 1274581 (0.0005) [2023-12-26 09:50:25,932][123090] Updated weights for policy 1, policy_version 1274591 (0.0005) [2023-12-26 09:50:26,125][123091] Updated weights for policy 0, policy_version 1283634 (0.0006) [2023-12-26 09:50:26,193][123091] Updated weights for policy 0, policy_version 1283644 (0.0008) [2023-12-26 09:50:26,266][123091] Updated weights for policy 0, policy_version 1283654 (0.0005) [2023-12-26 09:50:26,337][123091] Updated weights for policy 0, policy_version 1283664 (0.0005) [2023-12-26 09:50:26,697][123090] Updated weights for policy 1, policy_version 1274601 (0.0005) [2023-12-26 09:50:26,748][123090] Updated weights for policy 1, policy_version 1274611 (0.0005) [2023-12-26 09:50:26,796][123090] Updated weights for policy 1, policy_version 1274621 (0.0005) [2023-12-26 09:50:27,054][123091] Updated weights for policy 0, policy_version 1283674 (0.0010) [2023-12-26 09:50:27,098][123091] Updated weights for policy 0, policy_version 1283684 (0.0010) [2023-12-26 09:50:27,153][123091] Updated weights for policy 0, policy_version 1283694 (0.0010) [2023-12-26 09:50:27,439][123090] Updated weights for policy 1, policy_version 1274631 (0.0005) [2023-12-26 09:50:27,497][123090] Updated weights for policy 1, policy_version 1274641 (0.0005) [2023-12-26 09:50:27,561][123090] Updated weights for policy 1, policy_version 1274651 (0.0010) [2023-12-26 09:50:27,906][123091] Updated weights for policy 0, policy_version 1283704 (0.0008) [2023-12-26 09:50:27,958][123091] Updated weights for policy 0, policy_version 1283714 (0.0010) [2023-12-26 09:50:28,015][123091] Updated weights for policy 0, policy_version 1283724 (0.0005) [2023-12-26 09:50:28,247][123090] Updated weights for policy 1, policy_version 1274661 (0.0008) [2023-12-26 09:50:28,296][123090] Updated weights for policy 1, policy_version 1274671 (0.0005) [2023-12-26 09:50:28,366][123090] Updated weights for policy 1, policy_version 1274681 (0.0007) [2023-12-26 09:50:28,707][123091] Updated weights for policy 0, policy_version 1283734 (0.0005) [2023-12-26 09:50:28,759][123091] Updated weights for policy 0, policy_version 1283744 (0.0005) [2023-12-26 09:50:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 654958592. Throughput: 0: 8953.5, 1: 8841.7. Samples: 654953524. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:28,785][121949] Avg episode reward: [(0, '6372.121'), (1, '4862.231')] [2023-12-26 09:50:28,820][123091] Updated weights for policy 0, policy_version 1283754 (0.0009) [2023-12-26 09:50:29,131][123090] Updated weights for policy 1, policy_version 1274691 (0.0007) [2023-12-26 09:50:29,193][123090] Updated weights for policy 1, policy_version 1274701 (0.0010) [2023-12-26 09:50:29,261][123090] Updated weights for policy 1, policy_version 1274711 (0.0010) [2023-12-26 09:50:29,605][123091] Updated weights for policy 0, policy_version 1283764 (0.0008) [2023-12-26 09:50:29,662][123091] Updated weights for policy 0, policy_version 1283774 (0.0005) [2023-12-26 09:50:29,725][123091] Updated weights for policy 0, policy_version 1283784 (0.0005) [2023-12-26 09:50:30,071][123090] Updated weights for policy 1, policy_version 1274721 (0.0011) [2023-12-26 09:50:30,140][123090] Updated weights for policy 1, policy_version 1274731 (0.0011) [2023-12-26 09:50:30,201][123090] Updated weights for policy 1, policy_version 1274741 (0.0011) [2023-12-26 09:50:30,253][123090] Updated weights for policy 1, policy_version 1274751 (0.0010) [2023-12-26 09:50:30,480][123091] Updated weights for policy 0, policy_version 1283794 (0.0006) [2023-12-26 09:50:30,542][123091] Updated weights for policy 0, policy_version 1283804 (0.0011) [2023-12-26 09:50:30,609][123091] Updated weights for policy 0, policy_version 1283814 (0.0011) [2023-12-26 09:50:30,682][123091] Updated weights for policy 0, policy_version 1283824 (0.0011) [2023-12-26 09:50:30,928][123090] Updated weights for policy 1, policy_version 1274761 (0.0006) [2023-12-26 09:50:30,979][123090] Updated weights for policy 1, policy_version 1274771 (0.0005) [2023-12-26 09:50:31,045][123090] Updated weights for policy 1, policy_version 1274781 (0.0007) [2023-12-26 09:50:31,418][123091] Updated weights for policy 0, policy_version 1283834 (0.0009) [2023-12-26 09:50:31,479][123091] Updated weights for policy 0, policy_version 1283844 (0.0009) [2023-12-26 09:50:31,538][123091] Updated weights for policy 0, policy_version 1283854 (0.0009) [2023-12-26 09:50:31,880][123090] Updated weights for policy 1, policy_version 1274791 (0.0010) [2023-12-26 09:50:31,954][123090] Updated weights for policy 1, policy_version 1274801 (0.0010) [2023-12-26 09:50:32,015][123090] Updated weights for policy 1, policy_version 1274811 (0.0008) [2023-12-26 09:50:32,385][123091] Updated weights for policy 0, policy_version 1283864 (0.0009) [2023-12-26 09:50:32,454][123091] Updated weights for policy 0, policy_version 1283874 (0.0010) [2023-12-26 09:50:32,524][123091] Updated weights for policy 0, policy_version 1283884 (0.0009) [2023-12-26 09:50:32,838][123090] Updated weights for policy 1, policy_version 1274821 (0.0010) [2023-12-26 09:50:32,893][123090] Updated weights for policy 1, policy_version 1274831 (0.0009) [2023-12-26 09:50:32,948][123090] Updated weights for policy 1, policy_version 1274841 (0.0006) [2023-12-26 09:50:33,328][123091] Updated weights for policy 0, policy_version 1283894 (0.0010) [2023-12-26 09:50:33,375][123091] Updated weights for policy 0, policy_version 1283905 (0.0008) [2023-12-26 09:50:33,430][123091] Updated weights for policy 0, policy_version 1283915 (0.0008) [2023-12-26 09:50:33,702][123090] Updated weights for policy 1, policy_version 1274851 (0.0005) [2023-12-26 09:50:33,749][123090] Updated weights for policy 1, policy_version 1274861 (0.0005) [2023-12-26 09:50:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 655048704. Throughput: 0: 8968.0, 1: 8862.4. Samples: 655062988. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:33,784][121949] Avg episode reward: [(0, '6382.373'), (1, '4940.912')] [2023-12-26 09:50:33,798][123090] Updated weights for policy 1, policy_version 1274871 (0.0005) [2023-12-26 09:50:34,340][123091] Updated weights for policy 0, policy_version 1283925 (0.0009) [2023-12-26 09:50:34,410][123091] Updated weights for policy 0, policy_version 1283935 (0.0007) [2023-12-26 09:50:34,475][123091] Updated weights for policy 0, policy_version 1283945 (0.0010) [2023-12-26 09:50:34,572][123090] Updated weights for policy 1, policy_version 1274881 (0.0006) [2023-12-26 09:50:34,640][123090] Updated weights for policy 1, policy_version 1274891 (0.0010) [2023-12-26 09:50:34,713][123090] Updated weights for policy 1, policy_version 1274901 (0.0009) [2023-12-26 09:50:34,776][123090] Updated weights for policy 1, policy_version 1274911 (0.0009) [2023-12-26 09:50:35,260][123091] Updated weights for policy 0, policy_version 1283955 (0.0010) [2023-12-26 09:50:35,314][123091] Updated weights for policy 0, policy_version 1283965 (0.0009) [2023-12-26 09:50:35,368][123091] Updated weights for policy 0, policy_version 1283975 (0.0009) [2023-12-26 09:50:35,601][123090] Updated weights for policy 1, policy_version 1274921 (0.0010) [2023-12-26 09:50:35,668][123090] Updated weights for policy 1, policy_version 1274931 (0.0009) [2023-12-26 09:50:35,737][123090] Updated weights for policy 1, policy_version 1274941 (0.0009) [2023-12-26 09:50:36,222][123091] Updated weights for policy 0, policy_version 1283985 (0.0009) [2023-12-26 09:50:36,287][123091] Updated weights for policy 0, policy_version 1283995 (0.0009) [2023-12-26 09:50:36,346][123091] Updated weights for policy 0, policy_version 1284005 (0.0009) [2023-12-26 09:50:36,409][123091] Updated weights for policy 0, policy_version 1284015 (0.0009) [2023-12-26 09:50:36,535][123090] Updated weights for policy 1, policy_version 1274951 (0.0008) [2023-12-26 09:50:36,596][123090] Updated weights for policy 1, policy_version 1274961 (0.0008) [2023-12-26 09:50:36,657][123090] Updated weights for policy 1, policy_version 1274971 (0.0009) [2023-12-26 09:50:37,268][123091] Updated weights for policy 0, policy_version 1284025 (0.0009) [2023-12-26 09:50:37,323][123091] Updated weights for policy 0, policy_version 1284035 (0.0009) [2023-12-26 09:50:37,372][123091] Updated weights for policy 0, policy_version 1284046 (0.0009) [2023-12-26 09:50:37,488][123090] Updated weights for policy 1, policy_version 1274981 (0.0009) [2023-12-26 09:50:37,557][123090] Updated weights for policy 1, policy_version 1274991 (0.0009) [2023-12-26 09:50:37,627][123090] Updated weights for policy 1, policy_version 1275001 (0.0010) [2023-12-26 09:50:38,204][123091] Updated weights for policy 0, policy_version 1284056 (0.0010) [2023-12-26 09:50:38,258][123091] Updated weights for policy 0, policy_version 1284066 (0.0010) [2023-12-26 09:50:38,313][123091] Updated weights for policy 0, policy_version 1284076 (0.0010) [2023-12-26 09:50:38,380][123090] Updated weights for policy 1, policy_version 1275011 (0.0009) [2023-12-26 09:50:38,440][123090] Updated weights for policy 1, policy_version 1275021 (0.0009) [2023-12-26 09:50:38,499][123090] Updated weights for policy 1, policy_version 1275031 (0.0010) [2023-12-26 09:50:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 655138816. Throughput: 0: 8930.8, 1: 8876.7. Samples: 655114440. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:38,785][121949] Avg episode reward: [(0, '6290.505'), (1, '5167.170')] [2023-12-26 09:50:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001275040_326410240.pth... [2023-12-26 09:50:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001284080_328728576.pth... [2023-12-26 09:50:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001283056_328466432.pth [2023-12-26 09:50:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001273984_326139904.pth [2023-12-26 09:50:39,197][123091] Updated weights for policy 0, policy_version 1284086 (0.0010) [2023-12-26 09:50:39,264][123091] Updated weights for policy 0, policy_version 1284096 (0.0010) [2023-12-26 09:50:39,316][123090] Updated weights for policy 1, policy_version 1275041 (0.0010) [2023-12-26 09:50:39,333][123091] Updated weights for policy 0, policy_version 1284106 (0.0009) [2023-12-26 09:50:39,386][123090] Updated weights for policy 1, policy_version 1275051 (0.0009) [2023-12-26 09:50:39,451][123090] Updated weights for policy 1, policy_version 1275061 (0.0009) [2023-12-26 09:50:39,501][123090] Updated weights for policy 1, policy_version 1275071 (0.0009) [2023-12-26 09:50:40,181][123091] Updated weights for policy 0, policy_version 1284116 (0.0009) [2023-12-26 09:50:40,256][123091] Updated weights for policy 0, policy_version 1284126 (0.0009) [2023-12-26 09:50:40,296][123090] Updated weights for policy 1, policy_version 1275081 (0.0009) [2023-12-26 09:50:40,325][123091] Updated weights for policy 0, policy_version 1284136 (0.0009) [2023-12-26 09:50:40,362][123090] Updated weights for policy 1, policy_version 1275091 (0.0010) [2023-12-26 09:50:40,434][123090] Updated weights for policy 1, policy_version 1275101 (0.0009) [2023-12-26 09:50:41,192][123091] Updated weights for policy 0, policy_version 1284146 (0.0008) [2023-12-26 09:50:41,263][123091] Updated weights for policy 0, policy_version 1284156 (0.0009) [2023-12-26 09:50:41,282][123090] Updated weights for policy 1, policy_version 1275111 (0.0011) [2023-12-26 09:50:41,320][123091] Updated weights for policy 0, policy_version 1284166 (0.0007) [2023-12-26 09:50:41,356][123090] Updated weights for policy 1, policy_version 1275121 (0.0010) [2023-12-26 09:50:41,395][123091] Updated weights for policy 0, policy_version 1284176 (0.0009) [2023-12-26 09:50:41,433][123090] Updated weights for policy 1, policy_version 1275131 (0.0010) [2023-12-26 09:50:42,244][123090] Updated weights for policy 1, policy_version 1275141 (0.0008) [2023-12-26 09:50:42,266][123091] Updated weights for policy 0, policy_version 1284186 (0.0009) [2023-12-26 09:50:42,312][123090] Updated weights for policy 1, policy_version 1275151 (0.0008) [2023-12-26 09:50:42,336][123091] Updated weights for policy 0, policy_version 1284196 (0.0008) [2023-12-26 09:50:42,388][123090] Updated weights for policy 1, policy_version 1275161 (0.0009) [2023-12-26 09:50:42,409][123091] Updated weights for policy 0, policy_version 1284206 (0.0009) [2023-12-26 09:50:43,031][123090] Updated weights for policy 1, policy_version 1275171 (0.0005) [2023-12-26 09:50:43,095][123090] Updated weights for policy 1, policy_version 1275181 (0.0005) [2023-12-26 09:50:43,144][123090] Updated weights for policy 1, policy_version 1275191 (0.0009) [2023-12-26 09:50:43,233][123091] Updated weights for policy 0, policy_version 1284216 (0.0008) [2023-12-26 09:50:43,292][123091] Updated weights for policy 0, policy_version 1284226 (0.0009) [2023-12-26 09:50:43,358][123091] Updated weights for policy 0, policy_version 1284236 (0.0009) [2023-12-26 09:50:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 655220736. Throughput: 0: 8816.8, 1: 8911.0. Samples: 655216312. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:43,785][121949] Avg episode reward: [(0, '6120.590'), (1, '5344.216')] [2023-12-26 09:50:43,884][123090] Updated weights for policy 1, policy_version 1275201 (0.0009) [2023-12-26 09:50:43,953][123090] Updated weights for policy 1, policy_version 1275212 (0.0009) [2023-12-26 09:50:44,013][123090] Updated weights for policy 1, policy_version 1275222 (0.0010) [2023-12-26 09:50:44,066][123090] Updated weights for policy 1, policy_version 1275232 (0.0010) [2023-12-26 09:50:44,197][123091] Updated weights for policy 0, policy_version 1284246 (0.0009) [2023-12-26 09:50:44,254][123091] Updated weights for policy 0, policy_version 1284257 (0.0010) [2023-12-26 09:50:44,309][123091] Updated weights for policy 0, policy_version 1284267 (0.0009) [2023-12-26 09:50:44,930][123090] Updated weights for policy 1, policy_version 1275242 (0.0009) [2023-12-26 09:50:45,002][123090] Updated weights for policy 1, policy_version 1275252 (0.0006) [2023-12-26 09:50:45,068][123090] Updated weights for policy 1, policy_version 1275262 (0.0010) [2023-12-26 09:50:45,143][123091] Updated weights for policy 0, policy_version 1284277 (0.0009) [2023-12-26 09:50:45,202][123091] Updated weights for policy 0, policy_version 1284287 (0.0009) [2023-12-26 09:50:45,261][123091] Updated weights for policy 0, policy_version 1284297 (0.0010) [2023-12-26 09:50:45,837][123090] Updated weights for policy 1, policy_version 1275272 (0.0010) [2023-12-26 09:50:45,894][123090] Updated weights for policy 1, policy_version 1275282 (0.0008) [2023-12-26 09:50:45,957][123090] Updated weights for policy 1, policy_version 1275292 (0.0006) [2023-12-26 09:50:46,109][123091] Updated weights for policy 0, policy_version 1284307 (0.0009) [2023-12-26 09:50:46,168][123091] Updated weights for policy 0, policy_version 1284317 (0.0005) [2023-12-26 09:50:46,234][123091] Updated weights for policy 0, policy_version 1284327 (0.0005) [2023-12-26 09:50:46,628][123090] Updated weights for policy 1, policy_version 1275302 (0.0008) [2023-12-26 09:50:46,683][123090] Updated weights for policy 1, policy_version 1275312 (0.0009) [2023-12-26 09:50:46,744][123090] Updated weights for policy 1, policy_version 1275322 (0.0009) [2023-12-26 09:50:46,973][123091] Updated weights for policy 0, policy_version 1284337 (0.0006) [2023-12-26 09:50:47,028][123091] Updated weights for policy 0, policy_version 1284347 (0.0011) [2023-12-26 09:50:47,103][123091] Updated weights for policy 0, policy_version 1284357 (0.0011) [2023-12-26 09:50:47,162][123091] Updated weights for policy 0, policy_version 1284367 (0.0011) [2023-12-26 09:50:47,558][123090] Updated weights for policy 1, policy_version 1275332 (0.0009) [2023-12-26 09:50:47,606][123090] Updated weights for policy 1, policy_version 1275342 (0.0008) [2023-12-26 09:50:47,662][123090] Updated weights for policy 1, policy_version 1275352 (0.0009) [2023-12-26 09:50:47,963][123091] Updated weights for policy 0, policy_version 1284377 (0.0011) [2023-12-26 09:50:48,014][123091] Updated weights for policy 0, policy_version 1284387 (0.0010) [2023-12-26 09:50:48,062][123091] Updated weights for policy 0, policy_version 1284397 (0.0010) [2023-12-26 09:50:48,552][123090] Updated weights for policy 1, policy_version 1275362 (0.0008) [2023-12-26 09:50:48,621][123090] Updated weights for policy 1, policy_version 1275372 (0.0009) [2023-12-26 09:50:48,686][123090] Updated weights for policy 1, policy_version 1275382 (0.0009) [2023-12-26 09:50:48,744][123090] Updated weights for policy 1, policy_version 1275392 (0.0009) [2023-12-26 09:50:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 655310848. Throughput: 0: 8748.5, 1: 8969.3. Samples: 655320792. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:48,784][121949] Avg episode reward: [(0, '6164.642'), (1, '5367.071')] [2023-12-26 09:50:48,915][123091] Updated weights for policy 0, policy_version 1284407 (0.0011) [2023-12-26 09:50:48,972][123091] Updated weights for policy 0, policy_version 1284417 (0.0011) [2023-12-26 09:50:49,027][123091] Updated weights for policy 0, policy_version 1284427 (0.0010) [2023-12-26 09:50:49,603][123090] Updated weights for policy 1, policy_version 1275402 (0.0009) [2023-12-26 09:50:49,666][123090] Updated weights for policy 1, policy_version 1275412 (0.0008) [2023-12-26 09:50:49,733][123090] Updated weights for policy 1, policy_version 1275422 (0.0009) [2023-12-26 09:50:49,889][123091] Updated weights for policy 0, policy_version 1284437 (0.0008) [2023-12-26 09:50:49,959][123091] Updated weights for policy 0, policy_version 1284447 (0.0010) [2023-12-26 09:50:50,015][123091] Updated weights for policy 0, policy_version 1284457 (0.0011) [2023-12-26 09:50:50,487][123090] Updated weights for policy 1, policy_version 1275432 (0.0006) [2023-12-26 09:50:50,543][123090] Updated weights for policy 1, policy_version 1275442 (0.0005) [2023-12-26 09:50:50,607][123090] Updated weights for policy 1, policy_version 1275452 (0.0006) [2023-12-26 09:50:50,729][123091] Updated weights for policy 0, policy_version 1284467 (0.0008) [2023-12-26 09:50:50,821][123091] Updated weights for policy 0, policy_version 1284477 (0.0008) [2023-12-26 09:50:50,889][123091] Updated weights for policy 0, policy_version 1284487 (0.0008) [2023-12-26 09:50:51,406][123090] Updated weights for policy 1, policy_version 1275462 (0.0008) [2023-12-26 09:50:51,461][123090] Updated weights for policy 1, policy_version 1275472 (0.0010) [2023-12-26 09:50:51,525][123090] Updated weights for policy 1, policy_version 1275482 (0.0010) [2023-12-26 09:50:51,634][123091] Updated weights for policy 0, policy_version 1284497 (0.0010) [2023-12-26 09:50:51,700][123091] Updated weights for policy 0, policy_version 1284507 (0.0008) [2023-12-26 09:50:51,766][123091] Updated weights for policy 0, policy_version 1284517 (0.0008) [2023-12-26 09:50:51,835][123091] Updated weights for policy 0, policy_version 1284527 (0.0008) [2023-12-26 09:50:52,479][123090] Updated weights for policy 1, policy_version 1275492 (0.0010) [2023-12-26 09:50:52,517][123091] Updated weights for policy 0, policy_version 1284537 (0.0006) [2023-12-26 09:50:52,543][123090] Updated weights for policy 1, policy_version 1275502 (0.0011) [2023-12-26 09:50:52,582][123091] Updated weights for policy 0, policy_version 1284547 (0.0011) [2023-12-26 09:50:52,610][123090] Updated weights for policy 1, policy_version 1275512 (0.0011) [2023-12-26 09:50:52,645][123091] Updated weights for policy 0, policy_version 1284557 (0.0008) [2023-12-26 09:50:53,284][123090] Updated weights for policy 1, policy_version 1275522 (0.0010) [2023-12-26 09:50:53,350][123090] Updated weights for policy 1, policy_version 1275532 (0.0010) [2023-12-26 09:50:53,366][123091] Updated weights for policy 0, policy_version 1284567 (0.0009) [2023-12-26 09:50:53,412][123090] Updated weights for policy 1, policy_version 1275542 (0.0010) [2023-12-26 09:50:53,425][123091] Updated weights for policy 0, policy_version 1284577 (0.0010) [2023-12-26 09:50:53,474][123090] Updated weights for policy 1, policy_version 1275552 (0.0010) [2023-12-26 09:50:53,490][123091] Updated weights for policy 0, policy_version 1284587 (0.0010) [2023-12-26 09:50:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 655400960. Throughput: 0: 8741.7, 1: 8888.3. Samples: 655373524. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:53,785][121949] Avg episode reward: [(0, '6297.215'), (1, '5110.341')] [2023-12-26 09:50:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001284592_328859648.pth... [2023-12-26 09:50:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001275552_326541312.pth... [2023-12-26 09:50:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001283568_328597504.pth [2023-12-26 09:50:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001274496_326270976.pth [2023-12-26 09:50:54,230][123091] Updated weights for policy 0, policy_version 1284597 (0.0007) [2023-12-26 09:50:54,271][123090] Updated weights for policy 1, policy_version 1275562 (0.0007) [2023-12-26 09:50:54,295][123091] Updated weights for policy 0, policy_version 1284607 (0.0008) [2023-12-26 09:50:54,329][123090] Updated weights for policy 1, policy_version 1275572 (0.0007) [2023-12-26 09:50:54,356][123091] Updated weights for policy 0, policy_version 1284617 (0.0007) [2023-12-26 09:50:54,398][123090] Updated weights for policy 1, policy_version 1275582 (0.0007) [2023-12-26 09:50:55,104][123090] Updated weights for policy 1, policy_version 1275592 (0.0009) [2023-12-26 09:50:55,166][123090] Updated weights for policy 1, policy_version 1275602 (0.0009) [2023-12-26 09:50:55,230][123091] Updated weights for policy 0, policy_version 1284627 (0.0008) [2023-12-26 09:50:55,232][123090] Updated weights for policy 1, policy_version 1275612 (0.0009) [2023-12-26 09:50:55,279][123091] Updated weights for policy 0, policy_version 1284637 (0.0008) [2023-12-26 09:50:55,328][123091] Updated weights for policy 0, policy_version 1284647 (0.0009) [2023-12-26 09:50:55,955][123090] Updated weights for policy 1, policy_version 1275622 (0.0008) [2023-12-26 09:50:56,004][123091] Updated weights for policy 0, policy_version 1284657 (0.0005) [2023-12-26 09:50:56,018][123090] Updated weights for policy 1, policy_version 1275632 (0.0005) [2023-12-26 09:50:56,063][123091] Updated weights for policy 0, policy_version 1284667 (0.0006) [2023-12-26 09:50:56,072][123090] Updated weights for policy 1, policy_version 1275642 (0.0005) [2023-12-26 09:50:56,118][123091] Updated weights for policy 0, policy_version 1284677 (0.0006) [2023-12-26 09:50:56,169][123091] Updated weights for policy 0, policy_version 1284687 (0.0005) [2023-12-26 09:50:56,732][123090] Updated weights for policy 1, policy_version 1275652 (0.0006) [2023-12-26 09:50:56,789][123090] Updated weights for policy 1, policy_version 1275662 (0.0009) [2023-12-26 09:50:56,854][123090] Updated weights for policy 1, policy_version 1275672 (0.0009) [2023-12-26 09:50:56,858][123091] Updated weights for policy 0, policy_version 1284697 (0.0006) [2023-12-26 09:50:56,924][123091] Updated weights for policy 0, policy_version 1284707 (0.0009) [2023-12-26 09:50:56,986][123091] Updated weights for policy 0, policy_version 1284717 (0.0010) [2023-12-26 09:50:57,579][123090] Updated weights for policy 1, policy_version 1275682 (0.0007) [2023-12-26 09:50:57,640][123090] Updated weights for policy 1, policy_version 1275692 (0.0006) [2023-12-26 09:50:57,677][123091] Updated weights for policy 0, policy_version 1284727 (0.0009) [2023-12-26 09:50:57,686][123090] Updated weights for policy 1, policy_version 1275702 (0.0008) [2023-12-26 09:50:57,732][123091] Updated weights for policy 0, policy_version 1284737 (0.0007) [2023-12-26 09:50:57,735][123090] Updated weights for policy 1, policy_version 1275712 (0.0005) [2023-12-26 09:50:57,792][123091] Updated weights for policy 0, policy_version 1284747 (0.0005) [2023-12-26 09:50:58,543][123090] Updated weights for policy 1, policy_version 1275722 (0.0008) [2023-12-26 09:50:58,591][123091] Updated weights for policy 0, policy_version 1284757 (0.0007) [2023-12-26 09:50:58,603][123090] Updated weights for policy 1, policy_version 1275732 (0.0008) [2023-12-26 09:50:58,657][123091] Updated weights for policy 0, policy_version 1284767 (0.0009) [2023-12-26 09:50:58,668][123090] Updated weights for policy 1, policy_version 1275742 (0.0008) [2023-12-26 09:50:58,724][123091] Updated weights for policy 0, policy_version 1284777 (0.0009) [2023-12-26 09:50:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 655499264. Throughput: 0: 8826.0, 1: 8980.6. Samples: 655487532. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:50:58,785][121949] Avg episode reward: [(0, '6295.379'), (1, '5019.780')] [2023-12-26 09:50:59,565][123090] Updated weights for policy 1, policy_version 1275752 (0.0007) [2023-12-26 09:50:59,632][123090] Updated weights for policy 1, policy_version 1275762 (0.0009) [2023-12-26 09:50:59,635][123091] Updated weights for policy 0, policy_version 1284787 (0.0009) [2023-12-26 09:50:59,688][123090] Updated weights for policy 1, policy_version 1275772 (0.0009) [2023-12-26 09:50:59,698][123091] Updated weights for policy 0, policy_version 1284797 (0.0008) [2023-12-26 09:50:59,755][123091] Updated weights for policy 0, policy_version 1284807 (0.0010) [2023-12-26 09:51:00,518][123090] Updated weights for policy 1, policy_version 1275782 (0.0008) [2023-12-26 09:51:00,563][123091] Updated weights for policy 0, policy_version 1284817 (0.0009) [2023-12-26 09:51:00,569][123090] Updated weights for policy 1, policy_version 1275792 (0.0010) [2023-12-26 09:51:00,614][123090] Updated weights for policy 1, policy_version 1275802 (0.0006) [2023-12-26 09:51:00,616][123091] Updated weights for policy 0, policy_version 1284827 (0.0010) [2023-12-26 09:51:00,668][123091] Updated weights for policy 0, policy_version 1284837 (0.0009) [2023-12-26 09:51:00,739][123091] Updated weights for policy 0, policy_version 1284847 (0.0010) [2023-12-26 09:51:01,450][123090] Updated weights for policy 1, policy_version 1275812 (0.0007) [2023-12-26 09:51:01,502][123090] Updated weights for policy 1, policy_version 1275822 (0.0008) [2023-12-26 09:51:01,504][123091] Updated weights for policy 0, policy_version 1284857 (0.0008) [2023-12-26 09:51:01,563][123091] Updated weights for policy 0, policy_version 1284867 (0.0005) [2023-12-26 09:51:01,566][123090] Updated weights for policy 1, policy_version 1275832 (0.0009) [2023-12-26 09:51:01,612][123091] Updated weights for policy 0, policy_version 1284877 (0.0006) [2023-12-26 09:51:02,345][123091] Updated weights for policy 0, policy_version 1284887 (0.0008) [2023-12-26 09:51:02,408][123091] Updated weights for policy 0, policy_version 1284897 (0.0011) [2023-12-26 09:51:02,459][123091] Updated weights for policy 0, policy_version 1284907 (0.0011) [2023-12-26 09:51:02,479][123090] Updated weights for policy 1, policy_version 1275842 (0.0009) [2023-12-26 09:51:02,535][123090] Updated weights for policy 1, policy_version 1275852 (0.0008) [2023-12-26 09:51:02,594][123090] Updated weights for policy 1, policy_version 1275862 (0.0009) [2023-12-26 09:51:02,648][123090] Updated weights for policy 1, policy_version 1275872 (0.0009) [2023-12-26 09:51:03,250][123091] Updated weights for policy 0, policy_version 1284917 (0.0008) [2023-12-26 09:51:03,312][123091] Updated weights for policy 0, policy_version 1284927 (0.0006) [2023-12-26 09:51:03,381][123091] Updated weights for policy 0, policy_version 1284937 (0.0006) [2023-12-26 09:51:03,445][123090] Updated weights for policy 1, policy_version 1275882 (0.0007) [2023-12-26 09:51:03,501][123090] Updated weights for policy 1, policy_version 1275892 (0.0006) [2023-12-26 09:51:03,556][123090] Updated weights for policy 1, policy_version 1275902 (0.0005) [2023-12-26 09:51:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 655581184. Throughput: 0: 8873.2, 1: 8865.8. Samples: 655591200. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:51:03,785][121949] Avg episode reward: [(0, '6308.261'), (1, '5054.168')] [2023-12-26 09:51:04,107][123091] Updated weights for policy 0, policy_version 1284947 (0.0007) [2023-12-26 09:51:04,182][123091] Updated weights for policy 0, policy_version 1284957 (0.0007) [2023-12-26 09:51:04,255][123091] Updated weights for policy 0, policy_version 1284967 (0.0007) [2023-12-26 09:51:04,312][123090] Updated weights for policy 1, policy_version 1275912 (0.0009) [2023-12-26 09:51:04,372][123090] Updated weights for policy 1, policy_version 1275922 (0.0009) [2023-12-26 09:51:04,424][123090] Updated weights for policy 1, policy_version 1275932 (0.0006) [2023-12-26 09:51:04,894][123091] Updated weights for policy 0, policy_version 1284977 (0.0006) [2023-12-26 09:51:04,952][123091] Updated weights for policy 0, policy_version 1284987 (0.0008) [2023-12-26 09:51:05,015][123091] Updated weights for policy 0, policy_version 1284997 (0.0007) [2023-12-26 09:51:05,075][123091] Updated weights for policy 0, policy_version 1285007 (0.0009) [2023-12-26 09:51:05,251][123090] Updated weights for policy 1, policy_version 1275942 (0.0010) [2023-12-26 09:51:05,310][123090] Updated weights for policy 1, policy_version 1275952 (0.0010) [2023-12-26 09:51:05,374][123090] Updated weights for policy 1, policy_version 1275962 (0.0010) [2023-12-26 09:51:05,848][123091] Updated weights for policy 0, policy_version 1285017 (0.0009) [2023-12-26 09:51:05,904][123091] Updated weights for policy 0, policy_version 1285027 (0.0009) [2023-12-26 09:51:05,961][123091] Updated weights for policy 0, policy_version 1285037 (0.0009) [2023-12-26 09:51:06,184][123090] Updated weights for policy 1, policy_version 1275972 (0.0009) [2023-12-26 09:51:06,259][123090] Updated weights for policy 1, policy_version 1275982 (0.0006) [2023-12-26 09:51:06,323][123090] Updated weights for policy 1, policy_version 1275992 (0.0006) [2023-12-26 09:51:06,873][123091] Updated weights for policy 0, policy_version 1285047 (0.0009) [2023-12-26 09:51:06,924][123091] Updated weights for policy 0, policy_version 1285057 (0.0009) [2023-12-26 09:51:06,973][123091] Updated weights for policy 0, policy_version 1285067 (0.0009) [2023-12-26 09:51:07,068][123090] Updated weights for policy 1, policy_version 1276002 (0.0007) [2023-12-26 09:51:07,125][123090] Updated weights for policy 1, policy_version 1276012 (0.0010) [2023-12-26 09:51:07,182][123090] Updated weights for policy 1, policy_version 1276022 (0.0011) [2023-12-26 09:51:07,242][123090] Updated weights for policy 1, policy_version 1276032 (0.0010) [2023-12-26 09:51:07,796][123091] Updated weights for policy 0, policy_version 1285077 (0.0009) [2023-12-26 09:51:07,843][123091] Updated weights for policy 0, policy_version 1285087 (0.0005) [2023-12-26 09:51:07,908][123091] Updated weights for policy 0, policy_version 1285097 (0.0005) [2023-12-26 09:51:08,068][123090] Updated weights for policy 1, policy_version 1276042 (0.0010) [2023-12-26 09:51:08,128][123090] Updated weights for policy 1, policy_version 1276052 (0.0010) [2023-12-26 09:51:08,183][123090] Updated weights for policy 1, policy_version 1276062 (0.0010) [2023-12-26 09:51:08,683][123091] Updated weights for policy 0, policy_version 1285107 (0.0006) [2023-12-26 09:51:08,743][123091] Updated weights for policy 0, policy_version 1285117 (0.0009) [2023-12-26 09:51:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 655663104. Throughput: 0: 8872.4, 1: 8907.3. Samples: 655644736. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:51:08,785][121949] Avg episode reward: [(0, '6379.407'), (1, '5248.189')] [2023-12-26 09:51:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001276064_326672384.pth... [2023-12-26 09:51:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001275040_326410240.pth [2023-12-26 09:51:08,807][123091] Updated weights for policy 0, policy_version 1285127 (0.0007) [2023-12-26 09:51:08,867][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001285136_328998912.pth... [2023-12-26 09:51:08,871][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001284080_328728576.pth [2023-12-26 09:51:08,982][123090] Updated weights for policy 1, policy_version 1276072 (0.0010) [2023-12-26 09:51:09,045][123090] Updated weights for policy 1, policy_version 1276082 (0.0007) [2023-12-26 09:51:09,114][123090] Updated weights for policy 1, policy_version 1276092 (0.0010) [2023-12-26 09:51:09,667][123091] Updated weights for policy 0, policy_version 1285137 (0.0008) [2023-12-26 09:51:09,739][123091] Updated weights for policy 0, policy_version 1285147 (0.0007) [2023-12-26 09:51:09,810][123091] Updated weights for policy 0, policy_version 1285157 (0.0010) [2023-12-26 09:51:09,879][123091] Updated weights for policy 0, policy_version 1285167 (0.0010) [2023-12-26 09:51:09,938][123090] Updated weights for policy 1, policy_version 1276102 (0.0009) [2023-12-26 09:51:10,007][123090] Updated weights for policy 1, policy_version 1276112 (0.0009) [2023-12-26 09:51:10,076][123090] Updated weights for policy 1, policy_version 1276122 (0.0010) [2023-12-26 09:51:10,716][123091] Updated weights for policy 0, policy_version 1285177 (0.0010) [2023-12-26 09:51:10,748][123090] Updated weights for policy 1, policy_version 1276132 (0.0010) [2023-12-26 09:51:10,782][123091] Updated weights for policy 0, policy_version 1285187 (0.0006) [2023-12-26 09:51:10,822][123090] Updated weights for policy 1, policy_version 1276142 (0.0009) [2023-12-26 09:51:10,852][123091] Updated weights for policy 0, policy_version 1285197 (0.0006) [2023-12-26 09:51:10,895][123090] Updated weights for policy 1, policy_version 1276152 (0.0009) [2023-12-26 09:51:11,616][123091] Updated weights for policy 0, policy_version 1285207 (0.0009) [2023-12-26 09:51:11,683][123091] Updated weights for policy 0, policy_version 1285217 (0.0007) [2023-12-26 09:51:11,750][123091] Updated weights for policy 0, policy_version 1285227 (0.0009) [2023-12-26 09:51:11,751][123090] Updated weights for policy 1, policy_version 1276162 (0.0009) [2023-12-26 09:51:11,814][123090] Updated weights for policy 1, policy_version 1276172 (0.0009) [2023-12-26 09:51:11,871][123090] Updated weights for policy 1, policy_version 1276182 (0.0009) [2023-12-26 09:51:11,934][123090] Updated weights for policy 1, policy_version 1276192 (0.0008) [2023-12-26 09:51:12,667][123091] Updated weights for policy 0, policy_version 1285237 (0.0009) [2023-12-26 09:51:12,717][123091] Updated weights for policy 0, policy_version 1285247 (0.0010) [2023-12-26 09:51:12,736][123090] Updated weights for policy 1, policy_version 1276202 (0.0006) [2023-12-26 09:51:12,767][123091] Updated weights for policy 0, policy_version 1285257 (0.0009) [2023-12-26 09:51:12,811][123090] Updated weights for policy 1, policy_version 1276212 (0.0006) [2023-12-26 09:51:12,874][123090] Updated weights for policy 1, policy_version 1276222 (0.0009) [2023-12-26 09:51:13,594][123090] Updated weights for policy 1, policy_version 1276232 (0.0007) [2023-12-26 09:51:13,609][123091] Updated weights for policy 0, policy_version 1285267 (0.0007) [2023-12-26 09:51:13,643][123090] Updated weights for policy 1, policy_version 1276242 (0.0005) [2023-12-26 09:51:13,675][123091] Updated weights for policy 0, policy_version 1285277 (0.0006) [2023-12-26 09:51:13,708][123090] Updated weights for policy 1, policy_version 1276252 (0.0006) [2023-12-26 09:51:13,741][123091] Updated weights for policy 0, policy_version 1285287 (0.0007) [2023-12-26 09:51:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 655753216. Throughput: 0: 8788.1, 1: 8861.8. Samples: 655747768. Policy #0 lag: (min: 31.0, avg: 35.9, max: 63.0) [2023-12-26 09:51:13,785][121949] Avg episode reward: [(0, '6368.536'), (1, '5437.065')] [2023-12-26 09:51:14,377][123091] Updated weights for policy 0, policy_version 1285297 (0.0005) [2023-12-26 09:51:14,408][123090] Updated weights for policy 1, policy_version 1276262 (0.0007) [2023-12-26 09:51:14,444][123091] Updated weights for policy 0, policy_version 1285307 (0.0005) [2023-12-26 09:51:14,453][123090] Updated weights for policy 1, policy_version 1276272 (0.0005) [2023-12-26 09:51:14,501][123090] Updated weights for policy 1, policy_version 1276282 (0.0005) [2023-12-26 09:51:14,505][123091] Updated weights for policy 0, policy_version 1285317 (0.0005) [2023-12-26 09:51:14,557][123091] Updated weights for policy 0, policy_version 1285327 (0.0005) [2023-12-26 09:51:15,257][123090] Updated weights for policy 1, policy_version 1276292 (0.0008) [2023-12-26 09:51:15,289][123091] Updated weights for policy 0, policy_version 1285337 (0.0010) [2023-12-26 09:51:15,318][123090] Updated weights for policy 1, policy_version 1276302 (0.0011) [2023-12-26 09:51:15,352][123091] Updated weights for policy 0, policy_version 1285347 (0.0011) [2023-12-26 09:51:15,387][123090] Updated weights for policy 1, policy_version 1276312 (0.0008) [2023-12-26 09:51:15,423][123091] Updated weights for policy 0, policy_version 1285357 (0.0011) [2023-12-26 09:51:15,993][123090] Updated weights for policy 1, policy_version 1276322 (0.0005) [2023-12-26 09:51:16,053][123090] Updated weights for policy 1, policy_version 1276332 (0.0005) [2023-12-26 09:51:16,103][123090] Updated weights for policy 1, policy_version 1276342 (0.0005) [2023-12-26 09:51:16,151][123090] Updated weights for policy 1, policy_version 1276352 (0.0005) [2023-12-26 09:51:16,184][123091] Updated weights for policy 0, policy_version 1285367 (0.0007) [2023-12-26 09:51:16,243][123091] Updated weights for policy 0, policy_version 1285377 (0.0007) [2023-12-26 09:51:16,298][123091] Updated weights for policy 0, policy_version 1285387 (0.0010) [2023-12-26 09:51:16,843][123090] Updated weights for policy 1, policy_version 1276362 (0.0005) [2023-12-26 09:51:16,909][123090] Updated weights for policy 1, policy_version 1276372 (0.0005) [2023-12-26 09:51:16,948][123091] Updated weights for policy 0, policy_version 1285397 (0.0008) [2023-12-26 09:51:16,966][123090] Updated weights for policy 1, policy_version 1276382 (0.0005) [2023-12-26 09:51:17,008][123091] Updated weights for policy 0, policy_version 1285407 (0.0008) [2023-12-26 09:51:17,073][123091] Updated weights for policy 0, policy_version 1285417 (0.0010) [2023-12-26 09:51:17,581][123090] Updated weights for policy 1, policy_version 1276392 (0.0009) [2023-12-26 09:51:17,638][123090] Updated weights for policy 1, policy_version 1276402 (0.0011) [2023-12-26 09:51:17,700][123090] Updated weights for policy 1, policy_version 1276412 (0.0009) [2023-12-26 09:51:17,838][123091] Updated weights for policy 0, policy_version 1285427 (0.0008) [2023-12-26 09:51:17,895][123091] Updated weights for policy 0, policy_version 1285437 (0.0009) [2023-12-26 09:51:17,947][123091] Updated weights for policy 0, policy_version 1285447 (0.0008) [2023-12-26 09:51:18,519][123090] Updated weights for policy 1, policy_version 1276422 (0.0011) [2023-12-26 09:51:18,575][123090] Updated weights for policy 1, policy_version 1276432 (0.0010) [2023-12-26 09:51:18,631][123090] Updated weights for policy 1, policy_version 1276442 (0.0010) [2023-12-26 09:51:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 655851520. Throughput: 0: 8809.9, 1: 8964.9. Samples: 655862856. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:18,785][121949] Avg episode reward: [(0, '6366.897'), (1, '5298.066')] [2023-12-26 09:51:18,811][123091] Updated weights for policy 0, policy_version 1285457 (0.0008) [2023-12-26 09:51:18,875][123091] Updated weights for policy 0, policy_version 1285467 (0.0009) [2023-12-26 09:51:18,939][123091] Updated weights for policy 0, policy_version 1285477 (0.0008) [2023-12-26 09:51:19,008][123091] Updated weights for policy 0, policy_version 1285487 (0.0009) [2023-12-26 09:51:19,469][123090] Updated weights for policy 1, policy_version 1276452 (0.0010) [2023-12-26 09:51:19,533][123090] Updated weights for policy 1, policy_version 1276462 (0.0010) [2023-12-26 09:51:19,595][123090] Updated weights for policy 1, policy_version 1276472 (0.0010) [2023-12-26 09:51:19,833][123091] Updated weights for policy 0, policy_version 1285497 (0.0009) [2023-12-26 09:51:19,904][123091] Updated weights for policy 0, policy_version 1285507 (0.0009) [2023-12-26 09:51:19,961][123091] Updated weights for policy 0, policy_version 1285517 (0.0009) [2023-12-26 09:51:20,380][123090] Updated weights for policy 1, policy_version 1276482 (0.0009) [2023-12-26 09:51:20,450][123090] Updated weights for policy 1, policy_version 1276492 (0.0006) [2023-12-26 09:51:20,524][123090] Updated weights for policy 1, policy_version 1276502 (0.0005) [2023-12-26 09:51:20,601][123090] Updated weights for policy 1, policy_version 1276512 (0.0009) [2023-12-26 09:51:20,877][123091] Updated weights for policy 0, policy_version 1285527 (0.0010) [2023-12-26 09:51:20,942][123091] Updated weights for policy 0, policy_version 1285537 (0.0011) [2023-12-26 09:51:21,004][123091] Updated weights for policy 0, policy_version 1285547 (0.0009) [2023-12-26 09:51:21,301][123090] Updated weights for policy 1, policy_version 1276522 (0.0008) [2023-12-26 09:51:21,364][123090] Updated weights for policy 1, policy_version 1276532 (0.0009) [2023-12-26 09:51:21,429][123090] Updated weights for policy 1, policy_version 1276542 (0.0011) [2023-12-26 09:51:21,921][123091] Updated weights for policy 0, policy_version 1285557 (0.0008) [2023-12-26 09:51:21,986][123091] Updated weights for policy 0, policy_version 1285567 (0.0006) [2023-12-26 09:51:22,052][123091] Updated weights for policy 0, policy_version 1285577 (0.0005) [2023-12-26 09:51:22,251][123090] Updated weights for policy 1, policy_version 1276552 (0.0010) [2023-12-26 09:51:22,316][123090] Updated weights for policy 1, policy_version 1276562 (0.0009) [2023-12-26 09:51:22,390][123090] Updated weights for policy 1, policy_version 1276572 (0.0009) [2023-12-26 09:51:22,801][123091] Updated weights for policy 0, policy_version 1285587 (0.0007) [2023-12-26 09:51:22,865][123091] Updated weights for policy 0, policy_version 1285597 (0.0009) [2023-12-26 09:51:22,921][123091] Updated weights for policy 0, policy_version 1285607 (0.0012) [2023-12-26 09:51:23,181][123090] Updated weights for policy 1, policy_version 1276582 (0.0009) [2023-12-26 09:51:23,245][123090] Updated weights for policy 1, policy_version 1276592 (0.0008) [2023-12-26 09:51:23,298][123090] Updated weights for policy 1, policy_version 1276602 (0.0009) [2023-12-26 09:51:23,591][123091] Updated weights for policy 0, policy_version 1285617 (0.0010) [2023-12-26 09:51:23,657][123091] Updated weights for policy 0, policy_version 1285627 (0.0005) [2023-12-26 09:51:23,706][123091] Updated weights for policy 0, policy_version 1285637 (0.0005) [2023-12-26 09:51:23,754][123091] Updated weights for policy 0, policy_version 1285647 (0.0006) [2023-12-26 09:51:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 655941632. Throughput: 0: 8787.3, 1: 8973.4. Samples: 655913672. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:23,785][121949] Avg episode reward: [(0, '6363.922'), (1, '5270.576')] [2023-12-26 09:51:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001276608_326811648.pth... [2023-12-26 09:51:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001285648_329129984.pth... [2023-12-26 09:51:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001275552_326541312.pth [2023-12-26 09:51:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001284592_328859648.pth [2023-12-26 09:51:24,202][123090] Updated weights for policy 1, policy_version 1276612 (0.0009) [2023-12-26 09:51:24,249][123090] Updated weights for policy 1, policy_version 1276622 (0.0008) [2023-12-26 09:51:24,304][123090] Updated weights for policy 1, policy_version 1276632 (0.0008) [2023-12-26 09:51:24,491][123091] Updated weights for policy 0, policy_version 1285657 (0.0007) [2023-12-26 09:51:24,546][123091] Updated weights for policy 0, policy_version 1285667 (0.0010) [2023-12-26 09:51:24,594][123091] Updated weights for policy 0, policy_version 1285677 (0.0009) [2023-12-26 09:51:25,166][123090] Updated weights for policy 1, policy_version 1276642 (0.0010) [2023-12-26 09:51:25,221][123090] Updated weights for policy 1, policy_version 1276652 (0.0008) [2023-12-26 09:51:25,284][123090] Updated weights for policy 1, policy_version 1276662 (0.0009) [2023-12-26 09:51:25,344][123090] Updated weights for policy 1, policy_version 1276672 (0.0009) [2023-12-26 09:51:25,426][123091] Updated weights for policy 0, policy_version 1285687 (0.0010) [2023-12-26 09:51:25,471][123091] Updated weights for policy 0, policy_version 1285697 (0.0009) [2023-12-26 09:51:25,522][123091] Updated weights for policy 0, policy_version 1285707 (0.0009) [2023-12-26 09:51:26,139][123090] Updated weights for policy 1, policy_version 1276682 (0.0005) [2023-12-26 09:51:26,199][123090] Updated weights for policy 1, policy_version 1276692 (0.0008) [2023-12-26 09:51:26,251][123090] Updated weights for policy 1, policy_version 1276702 (0.0009) [2023-12-26 09:51:26,323][123091] Updated weights for policy 0, policy_version 1285717 (0.0008) [2023-12-26 09:51:26,378][123091] Updated weights for policy 0, policy_version 1285727 (0.0005) [2023-12-26 09:51:26,423][123091] Updated weights for policy 0, policy_version 1285737 (0.0005) [2023-12-26 09:51:27,057][123091] Updated weights for policy 0, policy_version 1285747 (0.0005) [2023-12-26 09:51:27,113][123091] Updated weights for policy 0, policy_version 1285757 (0.0005) [2023-12-26 09:51:27,159][123090] Updated weights for policy 1, policy_version 1276712 (0.0008) [2023-12-26 09:51:27,165][123091] Updated weights for policy 0, policy_version 1285767 (0.0006) [2023-12-26 09:51:27,207][123090] Updated weights for policy 1, policy_version 1276722 (0.0009) [2023-12-26 09:51:27,263][123090] Updated weights for policy 1, policy_version 1276732 (0.0010) [2023-12-26 09:51:27,886][123091] Updated weights for policy 0, policy_version 1285777 (0.0005) [2023-12-26 09:51:27,933][123091] Updated weights for policy 0, policy_version 1285787 (0.0005) [2023-12-26 09:51:27,985][123091] Updated weights for policy 0, policy_version 1285797 (0.0005) [2023-12-26 09:51:28,058][123091] Updated weights for policy 0, policy_version 1285807 (0.0006) [2023-12-26 09:51:28,142][123090] Updated weights for policy 1, policy_version 1276742 (0.0009) [2023-12-26 09:51:28,195][123090] Updated weights for policy 1, policy_version 1276752 (0.0009) [2023-12-26 09:51:28,255][123090] Updated weights for policy 1, policy_version 1276762 (0.0009) [2023-12-26 09:51:28,775][123091] Updated weights for policy 0, policy_version 1285817 (0.0009) [2023-12-26 09:51:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 656023552. Throughput: 0: 8966.0, 1: 8924.8. Samples: 656021396. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:28,785][121949] Avg episode reward: [(0, '6370.799'), (1, '5183.834')] [2023-12-26 09:51:28,840][123091] Updated weights for policy 0, policy_version 1285827 (0.0006) [2023-12-26 09:51:28,899][123091] Updated weights for policy 0, policy_version 1285837 (0.0006) [2023-12-26 09:51:29,140][123090] Updated weights for policy 1, policy_version 1276772 (0.0010) [2023-12-26 09:51:29,205][123090] Updated weights for policy 1, policy_version 1276782 (0.0009) [2023-12-26 09:51:29,272][123090] Updated weights for policy 1, policy_version 1276792 (0.0009) [2023-12-26 09:51:29,619][123091] Updated weights for policy 0, policy_version 1285847 (0.0009) [2023-12-26 09:51:29,682][123091] Updated weights for policy 0, policy_version 1285857 (0.0011) [2023-12-26 09:51:29,745][123091] Updated weights for policy 0, policy_version 1285867 (0.0010) [2023-12-26 09:51:30,112][123090] Updated weights for policy 1, policy_version 1276802 (0.0010) [2023-12-26 09:51:30,180][123090] Updated weights for policy 1, policy_version 1276812 (0.0009) [2023-12-26 09:51:30,241][123090] Updated weights for policy 1, policy_version 1276822 (0.0009) [2023-12-26 09:51:30,307][123090] Updated weights for policy 1, policy_version 1276832 (0.0009) [2023-12-26 09:51:30,575][123091] Updated weights for policy 0, policy_version 1285877 (0.0010) [2023-12-26 09:51:30,628][123091] Updated weights for policy 0, policy_version 1285887 (0.0009) [2023-12-26 09:51:30,685][123091] Updated weights for policy 0, policy_version 1285897 (0.0010) [2023-12-26 09:51:31,172][123090] Updated weights for policy 1, policy_version 1276842 (0.0009) [2023-12-26 09:51:31,224][123090] Updated weights for policy 1, policy_version 1276852 (0.0009) [2023-12-26 09:51:31,280][123090] Updated weights for policy 1, policy_version 1276862 (0.0008) [2023-12-26 09:51:31,452][123091] Updated weights for policy 0, policy_version 1285907 (0.0011) [2023-12-26 09:51:31,511][123091] Updated weights for policy 0, policy_version 1285917 (0.0011) [2023-12-26 09:51:31,570][123091] Updated weights for policy 0, policy_version 1285927 (0.0011) [2023-12-26 09:51:32,103][123090] Updated weights for policy 1, policy_version 1276872 (0.0005) [2023-12-26 09:51:32,166][123090] Updated weights for policy 1, policy_version 1276882 (0.0006) [2023-12-26 09:51:32,230][123090] Updated weights for policy 1, policy_version 1276892 (0.0010) [2023-12-26 09:51:32,299][123091] Updated weights for policy 0, policy_version 1285937 (0.0010) [2023-12-26 09:51:32,350][123091] Updated weights for policy 0, policy_version 1285947 (0.0006) [2023-12-26 09:51:32,407][123091] Updated weights for policy 0, policy_version 1285957 (0.0005) [2023-12-26 09:51:32,460][123091] Updated weights for policy 0, policy_version 1285967 (0.0005) [2023-12-26 09:51:33,097][123091] Updated weights for policy 0, policy_version 1285977 (0.0005) [2023-12-26 09:51:33,100][123090] Updated weights for policy 1, policy_version 1276902 (0.0007) [2023-12-26 09:51:33,158][123091] Updated weights for policy 0, policy_version 1285987 (0.0005) [2023-12-26 09:51:33,162][123090] Updated weights for policy 1, policy_version 1276912 (0.0006) [2023-12-26 09:51:33,217][123091] Updated weights for policy 0, policy_version 1285997 (0.0006) [2023-12-26 09:51:33,229][123090] Updated weights for policy 1, policy_version 1276922 (0.0006) [2023-12-26 09:51:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 656113664. Throughput: 0: 9082.9, 1: 8875.6. Samples: 656128928. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:33,785][121949] Avg episode reward: [(0, '6359.845'), (1, '5203.960')] [2023-12-26 09:51:33,920][123090] Updated weights for policy 1, policy_version 1276932 (0.0006) [2023-12-26 09:51:33,980][123090] Updated weights for policy 1, policy_version 1276942 (0.0005) [2023-12-26 09:51:34,036][123091] Updated weights for policy 0, policy_version 1286007 (0.0009) [2023-12-26 09:51:34,036][123090] Updated weights for policy 1, policy_version 1276952 (0.0006) [2023-12-26 09:51:34,086][123091] Updated weights for policy 0, policy_version 1286017 (0.0008) [2023-12-26 09:51:34,136][123091] Updated weights for policy 0, policy_version 1286027 (0.0008) [2023-12-26 09:51:34,816][123090] Updated weights for policy 1, policy_version 1276962 (0.0007) [2023-12-26 09:51:34,870][123090] Updated weights for policy 1, policy_version 1276972 (0.0008) [2023-12-26 09:51:34,924][123090] Updated weights for policy 1, policy_version 1276982 (0.0009) [2023-12-26 09:51:34,971][123091] Updated weights for policy 0, policy_version 1286037 (0.0008) [2023-12-26 09:51:34,991][123090] Updated weights for policy 1, policy_version 1276992 (0.0008) [2023-12-26 09:51:35,028][123091] Updated weights for policy 0, policy_version 1286047 (0.0009) [2023-12-26 09:51:35,083][123091] Updated weights for policy 0, policy_version 1286057 (0.0010) [2023-12-26 09:51:35,799][123090] Updated weights for policy 1, policy_version 1277002 (0.0005) [2023-12-26 09:51:35,856][123090] Updated weights for policy 1, policy_version 1277012 (0.0006) [2023-12-26 09:51:35,907][123091] Updated weights for policy 0, policy_version 1286068 (0.0008) [2023-12-26 09:51:35,909][123090] Updated weights for policy 1, policy_version 1277022 (0.0006) [2023-12-26 09:51:35,967][123091] Updated weights for policy 0, policy_version 1286078 (0.0006) [2023-12-26 09:51:36,029][123091] Updated weights for policy 0, policy_version 1286088 (0.0006) [2023-12-26 09:51:36,623][123090] Updated weights for policy 1, policy_version 1277032 (0.0007) [2023-12-26 09:51:36,686][123090] Updated weights for policy 1, policy_version 1277042 (0.0010) [2023-12-26 09:51:36,742][123091] Updated weights for policy 0, policy_version 1286098 (0.0006) [2023-12-26 09:51:36,751][123090] Updated weights for policy 1, policy_version 1277052 (0.0009) [2023-12-26 09:51:36,808][123091] Updated weights for policy 0, policy_version 1286108 (0.0007) [2023-12-26 09:51:36,873][123091] Updated weights for policy 0, policy_version 1286118 (0.0009) [2023-12-26 09:51:36,932][123091] Updated weights for policy 0, policy_version 1286128 (0.0009) [2023-12-26 09:51:37,474][123090] Updated weights for policy 1, policy_version 1277062 (0.0006) [2023-12-26 09:51:37,533][123090] Updated weights for policy 1, policy_version 1277072 (0.0005) [2023-12-26 09:51:37,596][123090] Updated weights for policy 1, policy_version 1277082 (0.0005) [2023-12-26 09:51:37,668][123091] Updated weights for policy 0, policy_version 1286138 (0.0007) [2023-12-26 09:51:37,724][123091] Updated weights for policy 0, policy_version 1286149 (0.0010) [2023-12-26 09:51:37,779][123091] Updated weights for policy 0, policy_version 1286160 (0.0011) [2023-12-26 09:51:38,248][123090] Updated weights for policy 1, policy_version 1277092 (0.0005) [2023-12-26 09:51:38,316][123090] Updated weights for policy 1, policy_version 1277102 (0.0005) [2023-12-26 09:51:38,388][123090] Updated weights for policy 1, policy_version 1277112 (0.0006) [2023-12-26 09:51:38,539][123091] Updated weights for policy 0, policy_version 1286170 (0.0005) [2023-12-26 09:51:38,612][123091] Updated weights for policy 0, policy_version 1286180 (0.0005) [2023-12-26 09:51:38,687][123091] Updated weights for policy 0, policy_version 1286190 (0.0005) [2023-12-26 09:51:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 656211968. Throughput: 0: 9079.1, 1: 8910.5. Samples: 656183056. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:38,785][121949] Avg episode reward: [(0, '6327.769'), (1, '5380.856')] [2023-12-26 09:51:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001286192_329269248.pth... [2023-12-26 09:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001277120_326942720.pth... [2023-12-26 09:51:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001276064_326672384.pth [2023-12-26 09:51:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001285136_328998912.pth [2023-12-26 09:51:39,201][123090] Updated weights for policy 1, policy_version 1277122 (0.0007) [2023-12-26 09:51:39,273][123090] Updated weights for policy 1, policy_version 1277132 (0.0009) [2023-12-26 09:51:39,336][123090] Updated weights for policy 1, policy_version 1277142 (0.0010) [2023-12-26 09:51:39,378][123091] Updated weights for policy 0, policy_version 1286200 (0.0007) [2023-12-26 09:51:39,406][123090] Updated weights for policy 1, policy_version 1277152 (0.0009) [2023-12-26 09:51:39,448][123091] Updated weights for policy 0, policy_version 1286210 (0.0009) [2023-12-26 09:51:39,502][123091] Updated weights for policy 0, policy_version 1286220 (0.0009) [2023-12-26 09:51:40,267][123090] Updated weights for policy 1, policy_version 1277162 (0.0010) [2023-12-26 09:51:40,327][123090] Updated weights for policy 1, policy_version 1277172 (0.0010) [2023-12-26 09:51:40,354][123091] Updated weights for policy 0, policy_version 1286230 (0.0009) [2023-12-26 09:51:40,388][123090] Updated weights for policy 1, policy_version 1277182 (0.0007) [2023-12-26 09:51:40,412][123091] Updated weights for policy 0, policy_version 1286240 (0.0010) [2023-12-26 09:51:40,465][123091] Updated weights for policy 0, policy_version 1286250 (0.0009) [2023-12-26 09:51:41,274][123090] Updated weights for policy 1, policy_version 1277192 (0.0009) [2023-12-26 09:51:41,285][123091] Updated weights for policy 0, policy_version 1286260 (0.0008) [2023-12-26 09:51:41,353][123090] Updated weights for policy 1, policy_version 1277202 (0.0009) [2023-12-26 09:51:41,361][123091] Updated weights for policy 0, policy_version 1286270 (0.0008) [2023-12-26 09:51:41,428][123090] Updated weights for policy 1, policy_version 1277212 (0.0009) [2023-12-26 09:51:41,435][123091] Updated weights for policy 0, policy_version 1286280 (0.0006) [2023-12-26 09:51:42,182][123091] Updated weights for policy 0, policy_version 1286290 (0.0007) [2023-12-26 09:51:42,234][123090] Updated weights for policy 1, policy_version 1277222 (0.0009) [2023-12-26 09:51:42,245][123091] Updated weights for policy 0, policy_version 1286300 (0.0008) [2023-12-26 09:51:42,307][123090] Updated weights for policy 1, policy_version 1277232 (0.0008) [2023-12-26 09:51:42,314][123091] Updated weights for policy 0, policy_version 1286310 (0.0009) [2023-12-26 09:51:42,388][123091] Updated weights for policy 0, policy_version 1286320 (0.0009) [2023-12-26 09:51:42,388][123090] Updated weights for policy 1, policy_version 1277242 (0.0010) [2023-12-26 09:51:43,163][123090] Updated weights for policy 1, policy_version 1277252 (0.0008) [2023-12-26 09:51:43,221][123090] Updated weights for policy 1, policy_version 1277262 (0.0005) [2023-12-26 09:51:43,250][123091] Updated weights for policy 0, policy_version 1286330 (0.0009) [2023-12-26 09:51:43,278][123090] Updated weights for policy 1, policy_version 1277272 (0.0006) [2023-12-26 09:51:43,307][123091] Updated weights for policy 0, policy_version 1286340 (0.0008) [2023-12-26 09:51:43,360][123091] Updated weights for policy 0, policy_version 1286350 (0.0008) [2023-12-26 09:51:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 656293888. Throughput: 0: 8977.5, 1: 8808.8. Samples: 656287920. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:43,785][121949] Avg episode reward: [(0, '6359.217'), (1, '5398.561')] [2023-12-26 09:51:43,999][123090] Updated weights for policy 1, policy_version 1277282 (0.0006) [2023-12-26 09:51:44,060][123090] Updated weights for policy 1, policy_version 1277292 (0.0005) [2023-12-26 09:51:44,128][123090] Updated weights for policy 1, policy_version 1277302 (0.0006) [2023-12-26 09:51:44,190][123090] Updated weights for policy 1, policy_version 1277312 (0.0008) [2023-12-26 09:51:44,205][123091] Updated weights for policy 0, policy_version 1286360 (0.0007) [2023-12-26 09:51:44,259][123091] Updated weights for policy 0, policy_version 1286370 (0.0009) [2023-12-26 09:51:44,330][123091] Updated weights for policy 0, policy_version 1286380 (0.0009) [2023-12-26 09:51:44,932][123090] Updated weights for policy 1, policy_version 1277322 (0.0007) [2023-12-26 09:51:44,992][123090] Updated weights for policy 1, policy_version 1277332 (0.0010) [2023-12-26 09:51:45,064][123090] Updated weights for policy 1, policy_version 1277342 (0.0011) [2023-12-26 09:51:45,177][123091] Updated weights for policy 0, policy_version 1286390 (0.0010) [2023-12-26 09:51:45,233][123091] Updated weights for policy 0, policy_version 1286400 (0.0010) [2023-12-26 09:51:45,288][123091] Updated weights for policy 0, policy_version 1286410 (0.0008) [2023-12-26 09:51:45,906][123090] Updated weights for policy 1, policy_version 1277352 (0.0011) [2023-12-26 09:51:45,962][123091] Updated weights for policy 0, policy_version 1286420 (0.0006) [2023-12-26 09:51:45,980][123090] Updated weights for policy 1, policy_version 1277362 (0.0011) [2023-12-26 09:51:46,029][123091] Updated weights for policy 0, policy_version 1286430 (0.0006) [2023-12-26 09:51:46,046][123090] Updated weights for policy 1, policy_version 1277372 (0.0009) [2023-12-26 09:51:46,079][123091] Updated weights for policy 0, policy_version 1286440 (0.0008) [2023-12-26 09:51:46,758][123091] Updated weights for policy 0, policy_version 1286450 (0.0009) [2023-12-26 09:51:46,780][123090] Updated weights for policy 1, policy_version 1277382 (0.0008) [2023-12-26 09:51:46,809][123091] Updated weights for policy 0, policy_version 1286460 (0.0007) [2023-12-26 09:51:46,835][123090] Updated weights for policy 1, policy_version 1277392 (0.0006) [2023-12-26 09:51:46,868][123091] Updated weights for policy 0, policy_version 1286470 (0.0009) [2023-12-26 09:51:46,898][123090] Updated weights for policy 1, policy_version 1277402 (0.0011) [2023-12-26 09:51:46,918][123091] Updated weights for policy 0, policy_version 1286480 (0.0006) [2023-12-26 09:51:47,676][123090] Updated weights for policy 1, policy_version 1277412 (0.0008) [2023-12-26 09:51:47,687][123091] Updated weights for policy 0, policy_version 1286490 (0.0010) [2023-12-26 09:51:47,742][123090] Updated weights for policy 1, policy_version 1277422 (0.0009) [2023-12-26 09:51:47,749][123091] Updated weights for policy 0, policy_version 1286500 (0.0007) [2023-12-26 09:51:47,810][123090] Updated weights for policy 1, policy_version 1277432 (0.0007) [2023-12-26 09:51:47,816][123091] Updated weights for policy 0, policy_version 1286510 (0.0009) [2023-12-26 09:51:48,560][123090] Updated weights for policy 1, policy_version 1277442 (0.0009) [2023-12-26 09:51:48,590][123091] Updated weights for policy 0, policy_version 1286520 (0.0008) [2023-12-26 09:51:48,627][123090] Updated weights for policy 1, policy_version 1277452 (0.0008) [2023-12-26 09:51:48,657][123091] Updated weights for policy 0, policy_version 1286530 (0.0008) [2023-12-26 09:51:48,681][123090] Updated weights for policy 1, policy_version 1277462 (0.0008) [2023-12-26 09:51:48,723][123091] Updated weights for policy 0, policy_version 1286540 (0.0008) [2023-12-26 09:51:48,734][123090] Updated weights for policy 1, policy_version 1277472 (0.0007) [2023-12-26 09:51:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 656392192. Throughput: 0: 9032.7, 1: 8882.0. Samples: 656397356. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:48,785][121949] Avg episode reward: [(0, '6284.361'), (1, '5408.217')] [2023-12-26 09:51:49,534][123091] Updated weights for policy 0, policy_version 1286550 (0.0010) [2023-12-26 09:51:49,590][123091] Updated weights for policy 0, policy_version 1286560 (0.0010) [2023-12-26 09:51:49,614][123090] Updated weights for policy 1, policy_version 1277482 (0.0007) [2023-12-26 09:51:49,652][123091] Updated weights for policy 0, policy_version 1286570 (0.0011) [2023-12-26 09:51:49,663][123090] Updated weights for policy 1, policy_version 1277492 (0.0009) [2023-12-26 09:51:49,712][123090] Updated weights for policy 1, policy_version 1277502 (0.0008) [2023-12-26 09:51:50,407][123091] Updated weights for policy 0, policy_version 1286580 (0.0009) [2023-12-26 09:51:50,463][123091] Updated weights for policy 0, policy_version 1286590 (0.0005) [2023-12-26 09:51:50,516][123091] Updated weights for policy 0, policy_version 1286600 (0.0005) [2023-12-26 09:51:50,621][123090] Updated weights for policy 1, policy_version 1277512 (0.0009) [2023-12-26 09:51:50,682][123090] Updated weights for policy 1, policy_version 1277522 (0.0008) [2023-12-26 09:51:50,752][123090] Updated weights for policy 1, policy_version 1277532 (0.0007) [2023-12-26 09:51:51,221][123091] Updated weights for policy 0, policy_version 1286610 (0.0005) [2023-12-26 09:51:51,272][123091] Updated weights for policy 0, policy_version 1286620 (0.0006) [2023-12-26 09:51:51,334][123091] Updated weights for policy 0, policy_version 1286630 (0.0006) [2023-12-26 09:51:51,406][123091] Updated weights for policy 0, policy_version 1286640 (0.0010) [2023-12-26 09:51:51,560][123090] Updated weights for policy 1, policy_version 1277542 (0.0009) [2023-12-26 09:51:51,631][123090] Updated weights for policy 1, policy_version 1277552 (0.0006) [2023-12-26 09:51:51,703][123090] Updated weights for policy 1, policy_version 1277562 (0.0006) [2023-12-26 09:51:52,233][123091] Updated weights for policy 0, policy_version 1286650 (0.0010) [2023-12-26 09:51:52,307][123091] Updated weights for policy 0, policy_version 1286660 (0.0008) [2023-12-26 09:51:52,380][123091] Updated weights for policy 0, policy_version 1286670 (0.0010) [2023-12-26 09:51:52,487][123090] Updated weights for policy 1, policy_version 1277572 (0.0007) [2023-12-26 09:51:52,544][123090] Updated weights for policy 1, policy_version 1277582 (0.0005) [2023-12-26 09:51:52,600][123090] Updated weights for policy 1, policy_version 1277592 (0.0006) [2023-12-26 09:51:53,251][123091] Updated weights for policy 0, policy_version 1286680 (0.0008) [2023-12-26 09:51:53,252][123090] Updated weights for policy 1, policy_version 1277602 (0.0007) [2023-12-26 09:51:53,294][123091] Updated weights for policy 0, policy_version 1286690 (0.0008) [2023-12-26 09:51:53,307][123090] Updated weights for policy 1, policy_version 1277612 (0.0010) [2023-12-26 09:51:53,341][123091] Updated weights for policy 0, policy_version 1286700 (0.0006) [2023-12-26 09:51:53,351][123090] Updated weights for policy 1, policy_version 1277622 (0.0010) [2023-12-26 09:51:53,414][123090] Updated weights for policy 1, policy_version 1277632 (0.0010) [2023-12-26 09:51:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 656474112. Throughput: 0: 9047.0, 1: 8832.5. Samples: 656449316. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:53,785][121949] Avg episode reward: [(0, '6232.569'), (1, '5484.906')] [2023-12-26 09:51:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001286704_329400320.pth... [2023-12-26 09:51:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001277632_327073792.pth... [2023-12-26 09:51:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001285648_329129984.pth [2023-12-26 09:51:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001276608_326811648.pth [2023-12-26 09:51:54,122][123091] Updated weights for policy 0, policy_version 1286710 (0.0005) [2023-12-26 09:51:54,182][123091] Updated weights for policy 0, policy_version 1286720 (0.0005) [2023-12-26 09:51:54,239][123090] Updated weights for policy 1, policy_version 1277642 (0.0009) [2023-12-26 09:51:54,246][123091] Updated weights for policy 0, policy_version 1286730 (0.0010) [2023-12-26 09:51:54,293][123090] Updated weights for policy 1, policy_version 1277652 (0.0007) [2023-12-26 09:51:54,350][123090] Updated weights for policy 1, policy_version 1277662 (0.0006) [2023-12-26 09:51:54,916][123091] Updated weights for policy 0, policy_version 1286740 (0.0008) [2023-12-26 09:51:54,982][123091] Updated weights for policy 0, policy_version 1286750 (0.0006) [2023-12-26 09:51:55,039][123091] Updated weights for policy 0, policy_version 1286760 (0.0005) [2023-12-26 09:51:55,252][123090] Updated weights for policy 1, policy_version 1277672 (0.0009) [2023-12-26 09:51:55,305][123090] Updated weights for policy 1, policy_version 1277682 (0.0009) [2023-12-26 09:51:55,370][123090] Updated weights for policy 1, policy_version 1277692 (0.0009) [2023-12-26 09:51:55,723][123091] Updated weights for policy 0, policy_version 1286770 (0.0007) [2023-12-26 09:51:55,771][123091] Updated weights for policy 0, policy_version 1286780 (0.0005) [2023-12-26 09:51:55,838][123091] Updated weights for policy 0, policy_version 1286790 (0.0005) [2023-12-26 09:51:55,904][123091] Updated weights for policy 0, policy_version 1286800 (0.0005) [2023-12-26 09:51:56,139][123090] Updated weights for policy 1, policy_version 1277702 (0.0007) [2023-12-26 09:51:56,188][123090] Updated weights for policy 1, policy_version 1277712 (0.0005) [2023-12-26 09:51:56,234][123090] Updated weights for policy 1, policy_version 1277722 (0.0005) [2023-12-26 09:51:56,525][123091] Updated weights for policy 0, policy_version 1286810 (0.0005) [2023-12-26 09:51:56,601][123091] Updated weights for policy 0, policy_version 1286820 (0.0005) [2023-12-26 09:51:56,679][123091] Updated weights for policy 0, policy_version 1286830 (0.0005) [2023-12-26 09:51:56,919][123090] Updated weights for policy 1, policy_version 1277732 (0.0005) [2023-12-26 09:51:56,977][123090] Updated weights for policy 1, policy_version 1277742 (0.0005) [2023-12-26 09:51:57,029][123090] Updated weights for policy 1, policy_version 1277752 (0.0005) [2023-12-26 09:51:57,259][123091] Updated weights for policy 0, policy_version 1286840 (0.0005) [2023-12-26 09:51:57,304][123091] Updated weights for policy 0, policy_version 1286850 (0.0005) [2023-12-26 09:51:57,358][123091] Updated weights for policy 0, policy_version 1286860 (0.0005) [2023-12-26 09:51:57,677][123090] Updated weights for policy 1, policy_version 1277762 (0.0005) [2023-12-26 09:51:57,725][123090] Updated weights for policy 1, policy_version 1277772 (0.0005) [2023-12-26 09:51:57,775][123090] Updated weights for policy 1, policy_version 1277782 (0.0005) [2023-12-26 09:51:57,846][123090] Updated weights for policy 1, policy_version 1277792 (0.0006) [2023-12-26 09:51:58,070][123091] Updated weights for policy 0, policy_version 1286870 (0.0008) [2023-12-26 09:51:58,133][123091] Updated weights for policy 0, policy_version 1286880 (0.0011) [2023-12-26 09:51:58,192][123091] Updated weights for policy 0, policy_version 1286890 (0.0011) [2023-12-26 09:51:58,538][123090] Updated weights for policy 1, policy_version 1277802 (0.0008) [2023-12-26 09:51:58,601][123090] Updated weights for policy 1, policy_version 1277812 (0.0008) [2023-12-26 09:51:58,678][123090] Updated weights for policy 1, policy_version 1277822 (0.0009) [2023-12-26 09:51:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 656572416. Throughput: 0: 9205.0, 1: 8910.6. Samples: 656562968. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:51:58,785][121949] Avg episode reward: [(0, '6254.814'), (1, '5573.659')] [2023-12-26 09:51:59,109][123091] Updated weights for policy 0, policy_version 1286900 (0.0010) [2023-12-26 09:51:59,181][123091] Updated weights for policy 0, policy_version 1286910 (0.0007) [2023-12-26 09:51:59,250][123091] Updated weights for policy 0, policy_version 1286920 (0.0009) [2023-12-26 09:51:59,490][123090] Updated weights for policy 1, policy_version 1277832 (0.0006) [2023-12-26 09:51:59,556][123090] Updated weights for policy 1, policy_version 1277842 (0.0010) [2023-12-26 09:51:59,615][123090] Updated weights for policy 1, policy_version 1277852 (0.0008) [2023-12-26 09:51:59,958][123091] Updated weights for policy 0, policy_version 1286930 (0.0008) [2023-12-26 09:52:00,026][123091] Updated weights for policy 0, policy_version 1286940 (0.0008) [2023-12-26 09:52:00,084][123091] Updated weights for policy 0, policy_version 1286950 (0.0008) [2023-12-26 09:52:00,131][123091] Updated weights for policy 0, policy_version 1286960 (0.0008) [2023-12-26 09:52:00,452][123090] Updated weights for policy 1, policy_version 1277862 (0.0010) [2023-12-26 09:52:00,505][123090] Updated weights for policy 1, policy_version 1277872 (0.0009) [2023-12-26 09:52:00,561][123090] Updated weights for policy 1, policy_version 1277882 (0.0010) [2023-12-26 09:52:00,944][123091] Updated weights for policy 0, policy_version 1286970 (0.0005) [2023-12-26 09:52:01,006][123091] Updated weights for policy 0, policy_version 1286980 (0.0006) [2023-12-26 09:52:01,076][123091] Updated weights for policy 0, policy_version 1286990 (0.0010) [2023-12-26 09:52:01,368][123090] Updated weights for policy 1, policy_version 1277892 (0.0009) [2023-12-26 09:52:01,433][123090] Updated weights for policy 1, policy_version 1277902 (0.0010) [2023-12-26 09:52:01,501][123090] Updated weights for policy 1, policy_version 1277912 (0.0009) [2023-12-26 09:52:01,788][123091] Updated weights for policy 0, policy_version 1287000 (0.0010) [2023-12-26 09:52:01,842][123091] Updated weights for policy 0, policy_version 1287010 (0.0006) [2023-12-26 09:52:01,903][123091] Updated weights for policy 0, policy_version 1287020 (0.0005) [2023-12-26 09:52:02,355][123090] Updated weights for policy 1, policy_version 1277922 (0.0006) [2023-12-26 09:52:02,416][123090] Updated weights for policy 1, policy_version 1277933 (0.0010) [2023-12-26 09:52:02,484][123090] Updated weights for policy 1, policy_version 1277943 (0.0007) [2023-12-26 09:52:02,599][123091] Updated weights for policy 0, policy_version 1287030 (0.0007) [2023-12-26 09:52:02,646][123091] Updated weights for policy 0, policy_version 1287040 (0.0009) [2023-12-26 09:52:02,702][123091] Updated weights for policy 0, policy_version 1287050 (0.0009) [2023-12-26 09:52:03,198][123090] Updated weights for policy 1, policy_version 1277953 (0.0006) [2023-12-26 09:52:03,249][123090] Updated weights for policy 1, policy_version 1277963 (0.0005) [2023-12-26 09:52:03,306][123090] Updated weights for policy 1, policy_version 1277973 (0.0010) [2023-12-26 09:52:03,448][123091] Updated weights for policy 0, policy_version 1287060 (0.0008) [2023-12-26 09:52:03,498][123091] Updated weights for policy 0, policy_version 1287070 (0.0005) [2023-12-26 09:52:03,549][123091] Updated weights for policy 0, policy_version 1287080 (0.0005) [2023-12-26 09:52:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17800.3). Total num frames: 656662528. Throughput: 0: 9180.6, 1: 8785.6. Samples: 656671336. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:03,785][121949] Avg episode reward: [(0, '6390.604'), (1, '5476.377')] [2023-12-26 09:52:04,153][123090] Updated weights for policy 1, policy_version 1277985 (0.0010) [2023-12-26 09:52:04,226][123090] Updated weights for policy 1, policy_version 1277995 (0.0009) [2023-12-26 09:52:04,297][123090] Updated weights for policy 1, policy_version 1278005 (0.0005) [2023-12-26 09:52:04,356][123091] Updated weights for policy 0, policy_version 1287090 (0.0006) [2023-12-26 09:52:04,366][123090] Updated weights for policy 1, policy_version 1278015 (0.0008) [2023-12-26 09:52:04,424][123091] Updated weights for policy 0, policy_version 1287100 (0.0010) [2023-12-26 09:52:04,499][123091] Updated weights for policy 0, policy_version 1287110 (0.0007) [2023-12-26 09:52:04,563][123091] Updated weights for policy 0, policy_version 1287120 (0.0008) [2023-12-26 09:52:05,173][123090] Updated weights for policy 1, policy_version 1278025 (0.0007) [2023-12-26 09:52:05,243][123090] Updated weights for policy 1, policy_version 1278035 (0.0007) [2023-12-26 09:52:05,305][123090] Updated weights for policy 1, policy_version 1278045 (0.0007) [2023-12-26 09:52:05,306][123091] Updated weights for policy 0, policy_version 1287130 (0.0011) [2023-12-26 09:52:05,366][123091] Updated weights for policy 0, policy_version 1287140 (0.0011) [2023-12-26 09:52:05,436][123091] Updated weights for policy 0, policy_version 1287150 (0.0011) [2023-12-26 09:52:06,041][123090] Updated weights for policy 1, policy_version 1278055 (0.0006) [2023-12-26 09:52:06,104][123091] Updated weights for policy 0, policy_version 1287160 (0.0008) [2023-12-26 09:52:06,134][123090] Updated weights for policy 1, policy_version 1278065 (0.0006) [2023-12-26 09:52:06,170][123091] Updated weights for policy 0, policy_version 1287170 (0.0007) [2023-12-26 09:52:06,198][123090] Updated weights for policy 1, policy_version 1278075 (0.0010) [2023-12-26 09:52:06,234][123091] Updated weights for policy 0, policy_version 1287180 (0.0009) [2023-12-26 09:52:06,998][123090] Updated weights for policy 1, policy_version 1278085 (0.0009) [2023-12-26 09:52:07,070][123090] Updated weights for policy 1, policy_version 1278095 (0.0010) [2023-12-26 09:52:07,076][123091] Updated weights for policy 0, policy_version 1287190 (0.0010) [2023-12-26 09:52:07,129][123090] Updated weights for policy 1, policy_version 1278105 (0.0010) [2023-12-26 09:52:07,141][123091] Updated weights for policy 0, policy_version 1287200 (0.0006) [2023-12-26 09:52:07,212][123091] Updated weights for policy 0, policy_version 1287210 (0.0005) [2023-12-26 09:52:07,948][123090] Updated weights for policy 1, policy_version 1278115 (0.0010) [2023-12-26 09:52:07,985][123091] Updated weights for policy 0, policy_version 1287220 (0.0007) [2023-12-26 09:52:08,007][123090] Updated weights for policy 1, policy_version 1278125 (0.0010) [2023-12-26 09:52:08,031][123091] Updated weights for policy 0, policy_version 1287230 (0.0009) [2023-12-26 09:52:08,062][123090] Updated weights for policy 1, policy_version 1278135 (0.0005) [2023-12-26 09:52:08,073][123091] Updated weights for policy 0, policy_version 1287240 (0.0005) [2023-12-26 09:52:08,771][123090] Updated weights for policy 1, policy_version 1278145 (0.0006) [2023-12-26 09:52:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 656744448. Throughput: 0: 9251.8, 1: 8777.4. Samples: 656724988. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:08,785][121949] Avg episode reward: [(0, '6335.716'), (1, '5286.573')] [2023-12-26 09:52:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001287248_329539584.pth... [2023-12-26 09:52:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001286192_329269248.pth [2023-12-26 09:52:08,841][123091] Updated weights for policy 0, policy_version 1287250 (0.0006) [2023-12-26 09:52:08,841][123090] Updated weights for policy 1, policy_version 1278155 (0.0010) [2023-12-26 09:52:08,903][123091] Updated weights for policy 0, policy_version 1287260 (0.0007) [2023-12-26 09:52:08,910][123090] Updated weights for policy 1, policy_version 1278165 (0.0011) [2023-12-26 09:52:08,967][123090] Updated weights for policy 1, policy_version 1278175 (0.0007) [2023-12-26 09:52:08,968][123091] Updated weights for policy 0, policy_version 1287270 (0.0006) [2023-12-26 09:52:08,974][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001278176_327213056.pth... [2023-12-26 09:52:08,979][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001277120_326942720.pth [2023-12-26 09:52:09,040][123091] Updated weights for policy 0, policy_version 1287280 (0.0006) [2023-12-26 09:52:09,763][123090] Updated weights for policy 1, policy_version 1278185 (0.0008) [2023-12-26 09:52:09,800][123091] Updated weights for policy 0, policy_version 1287290 (0.0006) [2023-12-26 09:52:09,828][123090] Updated weights for policy 1, policy_version 1278195 (0.0011) [2023-12-26 09:52:09,865][123091] Updated weights for policy 0, policy_version 1287300 (0.0007) [2023-12-26 09:52:09,895][123090] Updated weights for policy 1, policy_version 1278205 (0.0010) [2023-12-26 09:52:09,921][123091] Updated weights for policy 0, policy_version 1287310 (0.0008) [2023-12-26 09:52:10,720][123090] Updated weights for policy 1, policy_version 1278215 (0.0011) [2023-12-26 09:52:10,767][123091] Updated weights for policy 0, policy_version 1287320 (0.0009) [2023-12-26 09:52:10,781][123090] Updated weights for policy 1, policy_version 1278225 (0.0007) [2023-12-26 09:52:10,819][123091] Updated weights for policy 0, policy_version 1287330 (0.0009) [2023-12-26 09:52:10,837][123090] Updated weights for policy 1, policy_version 1278235 (0.0006) [2023-12-26 09:52:10,873][123091] Updated weights for policy 0, policy_version 1287340 (0.0009) [2023-12-26 09:52:11,640][123090] Updated weights for policy 1, policy_version 1278245 (0.0007) [2023-12-26 09:52:11,705][123090] Updated weights for policy 1, policy_version 1278255 (0.0007) [2023-12-26 09:52:11,780][123091] Updated weights for policy 0, policy_version 1287350 (0.0010) [2023-12-26 09:52:11,793][123090] Updated weights for policy 1, policy_version 1278265 (0.0007) [2023-12-26 09:52:11,837][123091] Updated weights for policy 0, policy_version 1287360 (0.0008) [2023-12-26 09:52:11,889][123091] Updated weights for policy 0, policy_version 1287370 (0.0005) [2023-12-26 09:52:12,578][123090] Updated weights for policy 1, policy_version 1278275 (0.0007) [2023-12-26 09:52:12,620][123091] Updated weights for policy 0, policy_version 1287380 (0.0007) [2023-12-26 09:52:12,638][123090] Updated weights for policy 1, policy_version 1278285 (0.0007) [2023-12-26 09:52:12,686][123091] Updated weights for policy 0, policy_version 1287390 (0.0008) [2023-12-26 09:52:12,703][123090] Updated weights for policy 1, policy_version 1278295 (0.0006) [2023-12-26 09:52:12,759][123091] Updated weights for policy 0, policy_version 1287400 (0.0008) [2023-12-26 09:52:13,399][123090] Updated weights for policy 1, policy_version 1278305 (0.0007) [2023-12-26 09:52:13,469][123090] Updated weights for policy 1, policy_version 1278315 (0.0009) [2023-12-26 09:52:13,535][123090] Updated weights for policy 1, policy_version 1278325 (0.0010) [2023-12-26 09:52:13,551][123091] Updated weights for policy 0, policy_version 1287410 (0.0008) [2023-12-26 09:52:13,602][123090] Updated weights for policy 1, policy_version 1278335 (0.0010) [2023-12-26 09:52:13,606][123091] Updated weights for policy 0, policy_version 1287420 (0.0007) [2023-12-26 09:52:13,658][123091] Updated weights for policy 0, policy_version 1287430 (0.0009) [2023-12-26 09:52:13,723][123091] Updated weights for policy 0, policy_version 1287440 (0.0006) [2023-12-26 09:52:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 656842752. Throughput: 0: 9149.1, 1: 8837.8. Samples: 656830808. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:13,785][121949] Avg episode reward: [(0, '6302.236'), (1, '5273.729')] [2023-12-26 09:52:14,302][123090] Updated weights for policy 1, policy_version 1278345 (0.0008) [2023-12-26 09:52:14,367][123090] Updated weights for policy 1, policy_version 1278355 (0.0008) [2023-12-26 09:52:14,395][123091] Updated weights for policy 0, policy_version 1287450 (0.0007) [2023-12-26 09:52:14,436][123090] Updated weights for policy 1, policy_version 1278365 (0.0005) [2023-12-26 09:52:14,473][123091] Updated weights for policy 0, policy_version 1287460 (0.0006) [2023-12-26 09:52:14,548][123091] Updated weights for policy 0, policy_version 1287470 (0.0006) [2023-12-26 09:52:15,142][123090] Updated weights for policy 1, policy_version 1278375 (0.0007) [2023-12-26 09:52:15,215][123090] Updated weights for policy 1, policy_version 1278385 (0.0006) [2023-12-26 09:52:15,237][123091] Updated weights for policy 0, policy_version 1287480 (0.0009) [2023-12-26 09:52:15,279][123090] Updated weights for policy 1, policy_version 1278395 (0.0007) [2023-12-26 09:52:15,295][123091] Updated weights for policy 0, policy_version 1287490 (0.0010) [2023-12-26 09:52:15,352][123091] Updated weights for policy 0, policy_version 1287500 (0.0009) [2023-12-26 09:52:16,017][123090] Updated weights for policy 1, policy_version 1278405 (0.0008) [2023-12-26 09:52:16,072][123090] Updated weights for policy 1, policy_version 1278415 (0.0009) [2023-12-26 09:52:16,134][123090] Updated weights for policy 1, policy_version 1278425 (0.0010) [2023-12-26 09:52:16,199][123091] Updated weights for policy 0, policy_version 1287510 (0.0010) [2023-12-26 09:52:16,248][123091] Updated weights for policy 0, policy_version 1287520 (0.0009) [2023-12-26 09:52:16,309][123091] Updated weights for policy 0, policy_version 1287530 (0.0009) [2023-12-26 09:52:16,956][123090] Updated weights for policy 1, policy_version 1278435 (0.0008) [2023-12-26 09:52:17,021][123090] Updated weights for policy 1, policy_version 1278445 (0.0010) [2023-12-26 09:52:17,083][123090] Updated weights for policy 1, policy_version 1278455 (0.0008) [2023-12-26 09:52:17,142][123091] Updated weights for policy 0, policy_version 1287540 (0.0009) [2023-12-26 09:52:17,202][123091] Updated weights for policy 0, policy_version 1287550 (0.0010) [2023-12-26 09:52:17,264][123091] Updated weights for policy 0, policy_version 1287560 (0.0010) [2023-12-26 09:52:17,894][123090] Updated weights for policy 1, policy_version 1278465 (0.0008) [2023-12-26 09:52:17,965][123090] Updated weights for policy 1, policy_version 1278475 (0.0006) [2023-12-26 09:52:18,034][123090] Updated weights for policy 1, policy_version 1278485 (0.0006) [2023-12-26 09:52:18,090][123090] Updated weights for policy 1, policy_version 1278495 (0.0005) [2023-12-26 09:52:18,099][123091] Updated weights for policy 0, policy_version 1287570 (0.0009) [2023-12-26 09:52:18,159][123091] Updated weights for policy 0, policy_version 1287581 (0.0010) [2023-12-26 09:52:18,210][123091] Updated weights for policy 0, policy_version 1287591 (0.0009) [2023-12-26 09:52:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 656924672. Throughput: 0: 9075.7, 1: 8925.7. Samples: 656938992. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:18,785][121949] Avg episode reward: [(0, '6178.564'), (1, '5006.549')] [2023-12-26 09:52:18,851][123090] Updated weights for policy 1, policy_version 1278505 (0.0008) [2023-12-26 09:52:18,919][123090] Updated weights for policy 1, policy_version 1278515 (0.0007) [2023-12-26 09:52:18,985][123090] Updated weights for policy 1, policy_version 1278525 (0.0009) [2023-12-26 09:52:19,084][123091] Updated weights for policy 0, policy_version 1287601 (0.0009) [2023-12-26 09:52:19,147][123091] Updated weights for policy 0, policy_version 1287611 (0.0009) [2023-12-26 09:52:19,222][123091] Updated weights for policy 0, policy_version 1287621 (0.0009) [2023-12-26 09:52:19,302][123091] Updated weights for policy 0, policy_version 1287631 (0.0010) [2023-12-26 09:52:19,757][123090] Updated weights for policy 1, policy_version 1278535 (0.0008) [2023-12-26 09:52:19,812][123090] Updated weights for policy 1, policy_version 1278545 (0.0009) [2023-12-26 09:52:19,875][123090] Updated weights for policy 1, policy_version 1278555 (0.0010) [2023-12-26 09:52:20,187][123091] Updated weights for policy 0, policy_version 1287641 (0.0009) [2023-12-26 09:52:20,250][123091] Updated weights for policy 0, policy_version 1287651 (0.0010) [2023-12-26 09:52:20,318][123091] Updated weights for policy 0, policy_version 1287661 (0.0010) [2023-12-26 09:52:20,742][123090] Updated weights for policy 1, policy_version 1278565 (0.0009) [2023-12-26 09:52:20,812][123090] Updated weights for policy 1, policy_version 1278575 (0.0007) [2023-12-26 09:52:20,887][123090] Updated weights for policy 1, policy_version 1278585 (0.0009) [2023-12-26 09:52:21,164][123091] Updated weights for policy 0, policy_version 1287671 (0.0010) [2023-12-26 09:52:21,232][123091] Updated weights for policy 0, policy_version 1287681 (0.0010) [2023-12-26 09:52:21,301][123091] Updated weights for policy 0, policy_version 1287691 (0.0010) [2023-12-26 09:52:21,737][123090] Updated weights for policy 1, policy_version 1278595 (0.0009) [2023-12-26 09:52:21,801][123090] Updated weights for policy 1, policy_version 1278605 (0.0009) [2023-12-26 09:52:21,866][123090] Updated weights for policy 1, policy_version 1278615 (0.0008) [2023-12-26 09:52:22,164][123091] Updated weights for policy 0, policy_version 1287701 (0.0011) [2023-12-26 09:52:22,228][123091] Updated weights for policy 0, policy_version 1287711 (0.0011) [2023-12-26 09:52:22,291][123091] Updated weights for policy 0, policy_version 1287721 (0.0011) [2023-12-26 09:52:22,726][123090] Updated weights for policy 1, policy_version 1278625 (0.0009) [2023-12-26 09:52:22,791][123090] Updated weights for policy 1, policy_version 1278635 (0.0009) [2023-12-26 09:52:22,849][123090] Updated weights for policy 1, policy_version 1278645 (0.0010) [2023-12-26 09:52:22,908][123090] Updated weights for policy 1, policy_version 1278655 (0.0009) [2023-12-26 09:52:23,052][123091] Updated weights for policy 0, policy_version 1287731 (0.0008) [2023-12-26 09:52:23,124][123091] Updated weights for policy 0, policy_version 1287741 (0.0006) [2023-12-26 09:52:23,192][123091] Updated weights for policy 0, policy_version 1287751 (0.0008) [2023-12-26 09:52:23,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 657006592. Throughput: 0: 9027.3, 1: 8886.8. Samples: 656989192. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:23,785][121949] Avg episode reward: [(0, '6129.098'), (1, '5134.261')] [2023-12-26 09:52:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001287760_329670656.pth... [2023-12-26 09:52:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001286704_329400320.pth [2023-12-26 09:52:23,802][123090] Updated weights for policy 1, policy_version 1278665 (0.0009) [2023-12-26 09:52:23,849][123091] Updated weights for policy 0, policy_version 1287761 (0.0007) [2023-12-26 09:52:23,855][123090] Updated weights for policy 1, policy_version 1278675 (0.0010) [2023-12-26 09:52:23,906][123091] Updated weights for policy 0, policy_version 1287771 (0.0006) [2023-12-26 09:52:23,916][123090] Updated weights for policy 1, policy_version 1278685 (0.0009) [2023-12-26 09:52:23,931][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001278688_327344128.pth... [2023-12-26 09:52:23,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001277632_327073792.pth [2023-12-26 09:52:23,978][123091] Updated weights for policy 0, policy_version 1287781 (0.0009) [2023-12-26 09:52:24,049][123091] Updated weights for policy 0, policy_version 1287791 (0.0009) [2023-12-26 09:52:24,602][123090] Updated weights for policy 1, policy_version 1278695 (0.0006) [2023-12-26 09:52:24,657][123090] Updated weights for policy 1, policy_version 1278705 (0.0005) [2023-12-26 09:52:24,729][123090] Updated weights for policy 1, policy_version 1278715 (0.0005) [2023-12-26 09:52:24,769][123091] Updated weights for policy 0, policy_version 1287801 (0.0006) [2023-12-26 09:52:24,815][123091] Updated weights for policy 0, policy_version 1287811 (0.0005) [2023-12-26 09:52:24,859][123091] Updated weights for policy 0, policy_version 1287821 (0.0005) [2023-12-26 09:52:25,500][123090] Updated weights for policy 1, policy_version 1278725 (0.0007) [2023-12-26 09:52:25,555][123090] Updated weights for policy 1, policy_version 1278735 (0.0010) [2023-12-26 09:52:25,623][123090] Updated weights for policy 1, policy_version 1278745 (0.0009) [2023-12-26 09:52:25,648][123091] Updated weights for policy 0, policy_version 1287831 (0.0007) [2023-12-26 09:52:25,710][123091] Updated weights for policy 0, policy_version 1287841 (0.0008) [2023-12-26 09:52:25,769][123091] Updated weights for policy 0, policy_version 1287851 (0.0010) [2023-12-26 09:52:26,410][123090] Updated weights for policy 1, policy_version 1278755 (0.0008) [2023-12-26 09:52:26,466][123090] Updated weights for policy 1, policy_version 1278765 (0.0008) [2023-12-26 09:52:26,519][123090] Updated weights for policy 1, policy_version 1278775 (0.0009) [2023-12-26 09:52:26,573][123091] Updated weights for policy 0, policy_version 1287861 (0.0011) [2023-12-26 09:52:26,628][123091] Updated weights for policy 0, policy_version 1287871 (0.0010) [2023-12-26 09:52:26,689][123091] Updated weights for policy 0, policy_version 1287881 (0.0010) [2023-12-26 09:52:27,372][123090] Updated weights for policy 1, policy_version 1278785 (0.0009) [2023-12-26 09:52:27,439][123090] Updated weights for policy 1, policy_version 1278795 (0.0009) [2023-12-26 09:52:27,466][123091] Updated weights for policy 0, policy_version 1287891 (0.0009) [2023-12-26 09:52:27,494][123090] Updated weights for policy 1, policy_version 1278805 (0.0009) [2023-12-26 09:52:27,526][123091] Updated weights for policy 0, policy_version 1287901 (0.0005) [2023-12-26 09:52:27,556][123090] Updated weights for policy 1, policy_version 1278815 (0.0009) [2023-12-26 09:52:27,603][123091] Updated weights for policy 0, policy_version 1287911 (0.0006) [2023-12-26 09:52:28,193][123091] Updated weights for policy 0, policy_version 1287921 (0.0010) [2023-12-26 09:52:28,236][123091] Updated weights for policy 0, policy_version 1287931 (0.0005) [2023-12-26 09:52:28,288][123091] Updated weights for policy 0, policy_version 1287942 (0.0008) [2023-12-26 09:52:28,342][123091] Updated weights for policy 0, policy_version 1287952 (0.0010) [2023-12-26 09:52:28,445][123090] Updated weights for policy 1, policy_version 1278825 (0.0008) [2023-12-26 09:52:28,510][123090] Updated weights for policy 1, policy_version 1278835 (0.0011) [2023-12-26 09:52:28,570][123090] Updated weights for policy 1, policy_version 1278845 (0.0011) [2023-12-26 09:52:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 657104896. Throughput: 0: 9084.4, 1: 8870.9. Samples: 657095904. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:28,785][121949] Avg episode reward: [(0, '6241.103'), (1, '5247.753')] [2023-12-26 09:52:29,066][123091] Updated weights for policy 0, policy_version 1287962 (0.0009) [2023-12-26 09:52:29,134][123091] Updated weights for policy 0, policy_version 1287972 (0.0007) [2023-12-26 09:52:29,201][123091] Updated weights for policy 0, policy_version 1287982 (0.0005) [2023-12-26 09:52:29,389][123090] Updated weights for policy 1, policy_version 1278855 (0.0010) [2023-12-26 09:52:29,455][123090] Updated weights for policy 1, policy_version 1278865 (0.0009) [2023-12-26 09:52:29,504][123090] Updated weights for policy 1, policy_version 1278875 (0.0009) [2023-12-26 09:52:29,983][123091] Updated weights for policy 0, policy_version 1287992 (0.0010) [2023-12-26 09:52:30,037][123091] Updated weights for policy 0, policy_version 1288002 (0.0008) [2023-12-26 09:52:30,093][123091] Updated weights for policy 0, policy_version 1288012 (0.0007) [2023-12-26 09:52:30,294][123090] Updated weights for policy 1, policy_version 1278885 (0.0007) [2023-12-26 09:52:30,352][123090] Updated weights for policy 1, policy_version 1278895 (0.0007) [2023-12-26 09:52:30,429][123090] Updated weights for policy 1, policy_version 1278905 (0.0010) [2023-12-26 09:52:30,829][123091] Updated weights for policy 0, policy_version 1288022 (0.0006) [2023-12-26 09:52:30,888][123091] Updated weights for policy 0, policy_version 1288032 (0.0005) [2023-12-26 09:52:30,934][123091] Updated weights for policy 0, policy_version 1288042 (0.0005) [2023-12-26 09:52:31,260][123090] Updated weights for policy 1, policy_version 1278915 (0.0009) [2023-12-26 09:52:31,331][123090] Updated weights for policy 1, policy_version 1278925 (0.0007) [2023-12-26 09:52:31,407][123090] Updated weights for policy 1, policy_version 1278935 (0.0009) [2023-12-26 09:52:31,667][123091] Updated weights for policy 0, policy_version 1288052 (0.0007) [2023-12-26 09:52:31,742][123091] Updated weights for policy 0, policy_version 1288062 (0.0009) [2023-12-26 09:52:31,801][123091] Updated weights for policy 0, policy_version 1288072 (0.0008) [2023-12-26 09:52:32,197][123090] Updated weights for policy 1, policy_version 1278945 (0.0009) [2023-12-26 09:52:32,261][123090] Updated weights for policy 1, policy_version 1278955 (0.0006) [2023-12-26 09:52:32,322][123090] Updated weights for policy 1, policy_version 1278965 (0.0007) [2023-12-26 09:52:32,391][123090] Updated weights for policy 1, policy_version 1278975 (0.0008) [2023-12-26 09:52:32,560][123091] Updated weights for policy 0, policy_version 1288082 (0.0007) [2023-12-26 09:52:32,616][123091] Updated weights for policy 0, policy_version 1288092 (0.0005) [2023-12-26 09:52:32,667][123091] Updated weights for policy 0, policy_version 1288102 (0.0007) [2023-12-26 09:52:32,715][123091] Updated weights for policy 0, policy_version 1288112 (0.0005) [2023-12-26 09:52:33,086][123090] Updated weights for policy 1, policy_version 1278985 (0.0006) [2023-12-26 09:52:33,133][123090] Updated weights for policy 1, policy_version 1278995 (0.0006) [2023-12-26 09:52:33,183][123090] Updated weights for policy 1, policy_version 1279005 (0.0005) [2023-12-26 09:52:33,485][123091] Updated weights for policy 0, policy_version 1288122 (0.0010) [2023-12-26 09:52:33,560][123091] Updated weights for policy 0, policy_version 1288132 (0.0005) [2023-12-26 09:52:33,617][123091] Updated weights for policy 0, policy_version 1288142 (0.0005) [2023-12-26 09:52:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 657195008. Throughput: 0: 9148.6, 1: 8857.3. Samples: 657207616. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:33,784][121949] Avg episode reward: [(0, '6198.596'), (1, '5217.174')] [2023-12-26 09:52:33,903][123090] Updated weights for policy 1, policy_version 1279015 (0.0006) [2023-12-26 09:52:33,960][123090] Updated weights for policy 1, policy_version 1279025 (0.0005) [2023-12-26 09:52:34,010][123090] Updated weights for policy 1, policy_version 1279035 (0.0005) [2023-12-26 09:52:34,260][123091] Updated weights for policy 0, policy_version 1288152 (0.0008) [2023-12-26 09:52:34,314][123091] Updated weights for policy 0, policy_version 1288162 (0.0009) [2023-12-26 09:52:34,367][123091] Updated weights for policy 0, policy_version 1288172 (0.0009) [2023-12-26 09:52:34,824][123090] Updated weights for policy 1, policy_version 1279045 (0.0007) [2023-12-26 09:52:34,893][123090] Updated weights for policy 1, policy_version 1279055 (0.0010) [2023-12-26 09:52:34,950][123090] Updated weights for policy 1, policy_version 1279065 (0.0008) [2023-12-26 09:52:35,009][123091] Updated weights for policy 0, policy_version 1288182 (0.0007) [2023-12-26 09:52:35,058][123091] Updated weights for policy 0, policy_version 1288192 (0.0010) [2023-12-26 09:52:35,111][123091] Updated weights for policy 0, policy_version 1288202 (0.0006) [2023-12-26 09:52:35,623][123090] Updated weights for policy 1, policy_version 1279075 (0.0005) [2023-12-26 09:52:35,682][123090] Updated weights for policy 1, policy_version 1279085 (0.0006) [2023-12-26 09:52:35,736][123090] Updated weights for policy 1, policy_version 1279095 (0.0006) [2023-12-26 09:52:35,781][123091] Updated weights for policy 0, policy_version 1288212 (0.0006) [2023-12-26 09:52:35,833][123091] Updated weights for policy 0, policy_version 1288222 (0.0005) [2023-12-26 09:52:35,887][123091] Updated weights for policy 0, policy_version 1288232 (0.0005) [2023-12-26 09:52:36,468][123090] Updated weights for policy 1, policy_version 1279105 (0.0006) [2023-12-26 09:52:36,533][123090] Updated weights for policy 1, policy_version 1279115 (0.0011) [2023-12-26 09:52:36,598][123091] Updated weights for policy 0, policy_version 1288242 (0.0006) [2023-12-26 09:52:36,606][123090] Updated weights for policy 1, policy_version 1279125 (0.0011) [2023-12-26 09:52:36,666][123091] Updated weights for policy 0, policy_version 1288252 (0.0009) [2023-12-26 09:52:36,672][123090] Updated weights for policy 1, policy_version 1279135 (0.0009) [2023-12-26 09:52:36,736][123091] Updated weights for policy 0, policy_version 1288262 (0.0008) [2023-12-26 09:52:36,806][123091] Updated weights for policy 0, policy_version 1288272 (0.0007) [2023-12-26 09:52:37,480][123091] Updated weights for policy 0, policy_version 1288282 (0.0005) [2023-12-26 09:52:37,534][123090] Updated weights for policy 1, policy_version 1279145 (0.0010) [2023-12-26 09:52:37,535][123091] Updated weights for policy 0, policy_version 1288292 (0.0005) [2023-12-26 09:52:37,582][123091] Updated weights for policy 0, policy_version 1288302 (0.0005) [2023-12-26 09:52:37,601][123090] Updated weights for policy 1, policy_version 1279155 (0.0009) [2023-12-26 09:52:37,672][123090] Updated weights for policy 1, policy_version 1279165 (0.0010) [2023-12-26 09:52:38,216][123091] Updated weights for policy 0, policy_version 1288312 (0.0008) [2023-12-26 09:52:38,263][123091] Updated weights for policy 0, policy_version 1288322 (0.0010) [2023-12-26 09:52:38,311][123091] Updated weights for policy 0, policy_version 1288332 (0.0010) [2023-12-26 09:52:38,611][123090] Updated weights for policy 1, policy_version 1279175 (0.0007) [2023-12-26 09:52:38,663][123090] Updated weights for policy 1, policy_version 1279185 (0.0005) [2023-12-26 09:52:38,718][123090] Updated weights for policy 1, policy_version 1279195 (0.0005) [2023-12-26 09:52:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 657293312. Throughput: 0: 9223.0, 1: 8926.4. Samples: 657266040. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:38,785][121949] Avg episode reward: [(0, '6277.506'), (1, '5332.625')] [2023-12-26 09:52:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001288336_329818112.pth... [2023-12-26 09:52:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001279200_327475200.pth... [2023-12-26 09:52:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001287248_329539584.pth [2023-12-26 09:52:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001278176_327213056.pth [2023-12-26 09:52:39,056][123091] Updated weights for policy 0, policy_version 1288342 (0.0007) [2023-12-26 09:52:39,119][123091] Updated weights for policy 0, policy_version 1288352 (0.0010) [2023-12-26 09:52:39,187][123091] Updated weights for policy 0, policy_version 1288362 (0.0011) [2023-12-26 09:52:39,464][123090] Updated weights for policy 1, policy_version 1279205 (0.0008) [2023-12-26 09:52:39,520][123090] Updated weights for policy 1, policy_version 1279216 (0.0011) [2023-12-26 09:52:39,584][123090] Updated weights for policy 1, policy_version 1279226 (0.0008) [2023-12-26 09:52:39,905][123091] Updated weights for policy 0, policy_version 1288372 (0.0009) [2023-12-26 09:52:39,968][123091] Updated weights for policy 0, policy_version 1288382 (0.0008) [2023-12-26 09:52:40,028][123091] Updated weights for policy 0, policy_version 1288392 (0.0008) [2023-12-26 09:52:40,513][123090] Updated weights for policy 1, policy_version 1279236 (0.0010) [2023-12-26 09:52:40,564][123090] Updated weights for policy 1, policy_version 1279246 (0.0009) [2023-12-26 09:52:40,621][123090] Updated weights for policy 1, policy_version 1279256 (0.0009) [2023-12-26 09:52:40,749][123091] Updated weights for policy 0, policy_version 1288402 (0.0008) [2023-12-26 09:52:40,821][123091] Updated weights for policy 0, policy_version 1288412 (0.0005) [2023-12-26 09:52:40,896][123091] Updated weights for policy 0, policy_version 1288422 (0.0006) [2023-12-26 09:52:40,962][123091] Updated weights for policy 0, policy_version 1288432 (0.0006) [2023-12-26 09:52:41,491][123090] Updated weights for policy 1, policy_version 1279266 (0.0008) [2023-12-26 09:52:41,568][123090] Updated weights for policy 1, policy_version 1279276 (0.0006) [2023-12-26 09:52:41,642][123090] Updated weights for policy 1, policy_version 1279286 (0.0007) [2023-12-26 09:52:41,674][123091] Updated weights for policy 0, policy_version 1288442 (0.0011) [2023-12-26 09:52:41,711][123090] Updated weights for policy 1, policy_version 1279296 (0.0006) [2023-12-26 09:52:41,739][123091] Updated weights for policy 0, policy_version 1288452 (0.0011) [2023-12-26 09:52:41,796][123091] Updated weights for policy 0, policy_version 1288462 (0.0009) [2023-12-26 09:52:42,458][123090] Updated weights for policy 1, policy_version 1279306 (0.0010) [2023-12-26 09:52:42,527][123090] Updated weights for policy 1, policy_version 1279316 (0.0009) [2023-12-26 09:52:42,590][123090] Updated weights for policy 1, policy_version 1279326 (0.0008) [2023-12-26 09:52:42,625][123091] Updated weights for policy 0, policy_version 1288472 (0.0008) [2023-12-26 09:52:42,679][123091] Updated weights for policy 0, policy_version 1288482 (0.0009) [2023-12-26 09:52:42,725][123091] Updated weights for policy 0, policy_version 1288492 (0.0009) [2023-12-26 09:52:43,440][123090] Updated weights for policy 1, policy_version 1279336 (0.0009) [2023-12-26 09:52:43,468][123091] Updated weights for policy 0, policy_version 1288502 (0.0009) [2023-12-26 09:52:43,509][123090] Updated weights for policy 1, policy_version 1279346 (0.0007) [2023-12-26 09:52:43,516][123091] Updated weights for policy 0, policy_version 1288512 (0.0009) [2023-12-26 09:52:43,562][123091] Updated weights for policy 0, policy_version 1288522 (0.0008) [2023-12-26 09:52:43,575][123090] Updated weights for policy 1, policy_version 1279356 (0.0009) [2023-12-26 09:52:43,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 657383424. Throughput: 0: 9201.1, 1: 8788.0. Samples: 657372480. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:43,785][121949] Avg episode reward: [(0, '6322.105'), (1, '5142.293')] [2023-12-26 09:52:44,247][123090] Updated weights for policy 1, policy_version 1279366 (0.0008) [2023-12-26 09:52:44,294][123090] Updated weights for policy 1, policy_version 1279376 (0.0010) [2023-12-26 09:52:44,345][123090] Updated weights for policy 1, policy_version 1279386 (0.0010) [2023-12-26 09:52:44,407][123091] Updated weights for policy 0, policy_version 1288532 (0.0008) [2023-12-26 09:52:44,461][123091] Updated weights for policy 0, policy_version 1288542 (0.0005) [2023-12-26 09:52:44,514][123091] Updated weights for policy 0, policy_version 1288552 (0.0005) [2023-12-26 09:52:45,115][123090] Updated weights for policy 1, policy_version 1279396 (0.0007) [2023-12-26 09:52:45,191][123090] Updated weights for policy 1, policy_version 1279406 (0.0008) [2023-12-26 09:52:45,267][123090] Updated weights for policy 1, policy_version 1279416 (0.0011) [2023-12-26 09:52:45,267][123091] Updated weights for policy 0, policy_version 1288562 (0.0007) [2023-12-26 09:52:45,330][123091] Updated weights for policy 0, policy_version 1288572 (0.0006) [2023-12-26 09:52:45,389][123091] Updated weights for policy 0, policy_version 1288582 (0.0009) [2023-12-26 09:52:45,459][123091] Updated weights for policy 0, policy_version 1288592 (0.0010) [2023-12-26 09:52:46,023][123090] Updated weights for policy 1, policy_version 1279426 (0.0010) [2023-12-26 09:52:46,083][123090] Updated weights for policy 1, policy_version 1279436 (0.0005) [2023-12-26 09:52:46,149][123090] Updated weights for policy 1, policy_version 1279446 (0.0006) [2023-12-26 09:52:46,209][123090] Updated weights for policy 1, policy_version 1279456 (0.0011) [2023-12-26 09:52:46,220][123091] Updated weights for policy 0, policy_version 1288602 (0.0005) [2023-12-26 09:52:46,275][123091] Updated weights for policy 0, policy_version 1288612 (0.0008) [2023-12-26 09:52:46,330][123091] Updated weights for policy 0, policy_version 1288622 (0.0009) [2023-12-26 09:52:46,912][123090] Updated weights for policy 1, policy_version 1279466 (0.0005) [2023-12-26 09:52:46,974][123090] Updated weights for policy 1, policy_version 1279476 (0.0009) [2023-12-26 09:52:47,013][123091] Updated weights for policy 0, policy_version 1288632 (0.0006) [2023-12-26 09:52:47,035][123090] Updated weights for policy 1, policy_version 1279486 (0.0009) [2023-12-26 09:52:47,063][123091] Updated weights for policy 0, policy_version 1288642 (0.0005) [2023-12-26 09:52:47,123][123091] Updated weights for policy 0, policy_version 1288652 (0.0005) [2023-12-26 09:52:47,808][123090] Updated weights for policy 1, policy_version 1279496 (0.0005) [2023-12-26 09:52:47,866][123090] Updated weights for policy 1, policy_version 1279506 (0.0006) [2023-12-26 09:52:47,926][123091] Updated weights for policy 0, policy_version 1288662 (0.0008) [2023-12-26 09:52:47,934][123090] Updated weights for policy 1, policy_version 1279516 (0.0009) [2023-12-26 09:52:47,998][123091] Updated weights for policy 0, policy_version 1288672 (0.0006) [2023-12-26 09:52:48,062][123091] Updated weights for policy 0, policy_version 1288682 (0.0005) [2023-12-26 09:52:48,701][123090] Updated weights for policy 1, policy_version 1279526 (0.0007) [2023-12-26 09:52:48,765][123090] Updated weights for policy 1, policy_version 1279536 (0.0005) [2023-12-26 09:52:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 657465344. Throughput: 0: 9218.5, 1: 8832.6. Samples: 657483636. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:48,785][121949] Avg episode reward: [(0, '6209.718'), (1, '5237.452')] [2023-12-26 09:52:48,788][123091] Updated weights for policy 0, policy_version 1288692 (0.0008) [2023-12-26 09:52:48,829][123090] Updated weights for policy 1, policy_version 1279546 (0.0006) [2023-12-26 09:52:48,847][123091] Updated weights for policy 0, policy_version 1288702 (0.0010) [2023-12-26 09:52:48,898][123091] Updated weights for policy 0, policy_version 1288712 (0.0010) [2023-12-26 09:52:49,619][123090] Updated weights for policy 1, policy_version 1279556 (0.0008) [2023-12-26 09:52:49,663][123091] Updated weights for policy 0, policy_version 1288722 (0.0010) [2023-12-26 09:52:49,672][123090] Updated weights for policy 1, policy_version 1279566 (0.0009) [2023-12-26 09:52:49,726][123091] Updated weights for policy 0, policy_version 1288732 (0.0011) [2023-12-26 09:52:49,733][123090] Updated weights for policy 1, policy_version 1279576 (0.0008) [2023-12-26 09:52:49,789][123091] Updated weights for policy 0, policy_version 1288742 (0.0011) [2023-12-26 09:52:49,857][123091] Updated weights for policy 0, policy_version 1288752 (0.0013) [2023-12-26 09:52:50,444][123090] Updated weights for policy 1, policy_version 1279586 (0.0007) [2023-12-26 09:52:50,512][123090] Updated weights for policy 1, policy_version 1279596 (0.0005) [2023-12-26 09:52:50,571][123090] Updated weights for policy 1, policy_version 1279606 (0.0006) [2023-12-26 09:52:50,604][123091] Updated weights for policy 0, policy_version 1288762 (0.0011) [2023-12-26 09:52:50,633][123090] Updated weights for policy 1, policy_version 1279616 (0.0008) [2023-12-26 09:52:50,665][123091] Updated weights for policy 0, policy_version 1288772 (0.0009) [2023-12-26 09:52:50,730][123091] Updated weights for policy 0, policy_version 1288782 (0.0008) [2023-12-26 09:52:51,402][123090] Updated weights for policy 1, policy_version 1279626 (0.0010) [2023-12-26 09:52:51,467][123090] Updated weights for policy 1, policy_version 1279636 (0.0009) [2023-12-26 09:52:51,535][123090] Updated weights for policy 1, policy_version 1279646 (0.0009) [2023-12-26 09:52:51,570][123091] Updated weights for policy 0, policy_version 1288792 (0.0008) [2023-12-26 09:52:51,628][123091] Updated weights for policy 0, policy_version 1288802 (0.0008) [2023-12-26 09:52:51,686][123091] Updated weights for policy 0, policy_version 1288812 (0.0010) [2023-12-26 09:52:52,379][123090] Updated weights for policy 1, policy_version 1279656 (0.0009) [2023-12-26 09:52:52,451][123090] Updated weights for policy 1, policy_version 1279666 (0.0010) [2023-12-26 09:52:52,513][123090] Updated weights for policy 1, policy_version 1279676 (0.0009) [2023-12-26 09:52:52,574][123091] Updated weights for policy 0, policy_version 1288822 (0.0009) [2023-12-26 09:52:52,637][123091] Updated weights for policy 0, policy_version 1288832 (0.0009) [2023-12-26 09:52:52,695][123091] Updated weights for policy 0, policy_version 1288842 (0.0009) [2023-12-26 09:52:53,356][123090] Updated weights for policy 1, policy_version 1279686 (0.0010) [2023-12-26 09:52:53,424][123090] Updated weights for policy 1, policy_version 1279696 (0.0008) [2023-12-26 09:52:53,490][123090] Updated weights for policy 1, policy_version 1279706 (0.0006) [2023-12-26 09:52:53,528][123091] Updated weights for policy 0, policy_version 1288852 (0.0009) [2023-12-26 09:52:53,585][123091] Updated weights for policy 0, policy_version 1288862 (0.0010) [2023-12-26 09:52:53,643][123091] Updated weights for policy 0, policy_version 1288872 (0.0010) [2023-12-26 09:52:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 657563648. Throughput: 0: 9204.1, 1: 8833.5. Samples: 657536688. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:53,786][121949] Avg episode reward: [(0, '6243.225'), (1, '5084.629')] [2023-12-26 09:52:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001288880_329957376.pth... [2023-12-26 09:52:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001279712_327606272.pth... [2023-12-26 09:52:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001278688_327344128.pth [2023-12-26 09:52:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001287760_329670656.pth [2023-12-26 09:52:54,205][123090] Updated weights for policy 1, policy_version 1279716 (0.0007) [2023-12-26 09:52:54,261][123090] Updated weights for policy 1, policy_version 1279726 (0.0009) [2023-12-26 09:52:54,326][123090] Updated weights for policy 1, policy_version 1279736 (0.0009) [2023-12-26 09:52:54,359][123091] Updated weights for policy 0, policy_version 1288882 (0.0009) [2023-12-26 09:52:54,431][123091] Updated weights for policy 0, policy_version 1288892 (0.0006) [2023-12-26 09:52:54,495][123091] Updated weights for policy 0, policy_version 1288902 (0.0008) [2023-12-26 09:52:54,545][123091] Updated weights for policy 0, policy_version 1288912 (0.0005) [2023-12-26 09:52:55,178][123090] Updated weights for policy 1, policy_version 1279746 (0.0008) [2023-12-26 09:52:55,219][123091] Updated weights for policy 0, policy_version 1288922 (0.0005) [2023-12-26 09:52:55,230][123090] Updated weights for policy 1, policy_version 1279757 (0.0007) [2023-12-26 09:52:55,269][123091] Updated weights for policy 0, policy_version 1288932 (0.0005) [2023-12-26 09:52:55,298][123090] Updated weights for policy 1, policy_version 1279767 (0.0007) [2023-12-26 09:52:55,325][123091] Updated weights for policy 0, policy_version 1288942 (0.0005) [2023-12-26 09:52:55,950][123091] Updated weights for policy 0, policy_version 1288952 (0.0005) [2023-12-26 09:52:55,971][123090] Updated weights for policy 1, policy_version 1279777 (0.0008) [2023-12-26 09:52:56,006][123091] Updated weights for policy 0, policy_version 1288962 (0.0005) [2023-12-26 09:52:56,050][123090] Updated weights for policy 1, policy_version 1279787 (0.0005) [2023-12-26 09:52:56,070][123091] Updated weights for policy 0, policy_version 1288972 (0.0010) [2023-12-26 09:52:56,106][123090] Updated weights for policy 1, policy_version 1279797 (0.0005) [2023-12-26 09:52:56,170][123090] Updated weights for policy 1, policy_version 1279807 (0.0005) [2023-12-26 09:52:56,749][123091] Updated weights for policy 0, policy_version 1288982 (0.0007) [2023-12-26 09:52:56,759][123090] Updated weights for policy 1, policy_version 1279817 (0.0005) [2023-12-26 09:52:56,794][123091] Updated weights for policy 0, policy_version 1288992 (0.0006) [2023-12-26 09:52:56,807][123090] Updated weights for policy 1, policy_version 1279827 (0.0005) [2023-12-26 09:52:56,845][123091] Updated weights for policy 0, policy_version 1289002 (0.0010) [2023-12-26 09:52:56,870][123090] Updated weights for policy 1, policy_version 1279837 (0.0006) [2023-12-26 09:52:57,561][123091] Updated weights for policy 0, policy_version 1289012 (0.0008) [2023-12-26 09:52:57,610][123090] Updated weights for policy 1, policy_version 1279847 (0.0007) [2023-12-26 09:52:57,629][123091] Updated weights for policy 0, policy_version 1289022 (0.0010) [2023-12-26 09:52:57,677][123090] Updated weights for policy 1, policy_version 1279857 (0.0006) [2023-12-26 09:52:57,684][123091] Updated weights for policy 0, policy_version 1289032 (0.0010) [2023-12-26 09:52:57,739][123090] Updated weights for policy 1, policy_version 1279867 (0.0008) [2023-12-26 09:52:58,546][123091] Updated weights for policy 0, policy_version 1289042 (0.0010) [2023-12-26 09:52:58,574][123090] Updated weights for policy 1, policy_version 1279877 (0.0007) [2023-12-26 09:52:58,610][123091] Updated weights for policy 0, policy_version 1289052 (0.0011) [2023-12-26 09:52:58,642][123090] Updated weights for policy 1, policy_version 1279887 (0.0007) [2023-12-26 09:52:58,680][123091] Updated weights for policy 0, policy_version 1289062 (0.0010) [2023-12-26 09:52:58,713][123090] Updated weights for policy 1, policy_version 1279897 (0.0009) [2023-12-26 09:52:58,748][123091] Updated weights for policy 0, policy_version 1289072 (0.0010) [2023-12-26 09:52:58,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 657661952. Throughput: 0: 9297.0, 1: 8909.4. Samples: 657650096. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:52:58,785][121949] Avg episode reward: [(0, '6398.917'), (1, '5062.590')] [2023-12-26 09:52:59,580][123090] Updated weights for policy 1, policy_version 1279907 (0.0009) [2023-12-26 09:52:59,623][123091] Updated weights for policy 0, policy_version 1289082 (0.0009) [2023-12-26 09:52:59,639][123090] Updated weights for policy 1, policy_version 1279917 (0.0010) [2023-12-26 09:52:59,669][123091] Updated weights for policy 0, policy_version 1289092 (0.0006) [2023-12-26 09:52:59,706][123090] Updated weights for policy 1, policy_version 1279927 (0.0010) [2023-12-26 09:52:59,720][123091] Updated weights for policy 0, policy_version 1289102 (0.0005) [2023-12-26 09:53:00,385][123090] Updated weights for policy 1, policy_version 1279937 (0.0010) [2023-12-26 09:53:00,448][123090] Updated weights for policy 1, policy_version 1279947 (0.0006) [2023-12-26 09:53:00,495][123091] Updated weights for policy 0, policy_version 1289112 (0.0007) [2023-12-26 09:53:00,513][123090] Updated weights for policy 1, policy_version 1279957 (0.0006) [2023-12-26 09:53:00,547][123091] Updated weights for policy 0, policy_version 1289122 (0.0007) [2023-12-26 09:53:00,578][123090] Updated weights for policy 1, policy_version 1279967 (0.0006) [2023-12-26 09:53:00,609][123091] Updated weights for policy 0, policy_version 1289132 (0.0005) [2023-12-26 09:53:01,270][123090] Updated weights for policy 1, policy_version 1279977 (0.0009) [2023-12-26 09:53:01,328][123090] Updated weights for policy 1, policy_version 1279987 (0.0009) [2023-12-26 09:53:01,356][123091] Updated weights for policy 0, policy_version 1289142 (0.0007) [2023-12-26 09:53:01,396][123090] Updated weights for policy 1, policy_version 1279997 (0.0009) [2023-12-26 09:53:01,419][123091] Updated weights for policy 0, policy_version 1289152 (0.0008) [2023-12-26 09:53:01,477][123091] Updated weights for policy 0, policy_version 1289162 (0.0008) [2023-12-26 09:53:02,146][123090] Updated weights for policy 1, policy_version 1280007 (0.0006) [2023-12-26 09:53:02,200][123090] Updated weights for policy 1, policy_version 1280017 (0.0005) [2023-12-26 09:53:02,229][123091] Updated weights for policy 0, policy_version 1289172 (0.0009) [2023-12-26 09:53:02,263][123090] Updated weights for policy 1, policy_version 1280027 (0.0007) [2023-12-26 09:53:02,293][123091] Updated weights for policy 0, policy_version 1289182 (0.0011) [2023-12-26 09:53:02,363][123091] Updated weights for policy 0, policy_version 1289192 (0.0011) [2023-12-26 09:53:03,017][123090] Updated weights for policy 1, policy_version 1280037 (0.0010) [2023-12-26 09:53:03,082][123090] Updated weights for policy 1, policy_version 1280047 (0.0007) [2023-12-26 09:53:03,149][123090] Updated weights for policy 1, policy_version 1280057 (0.0006) [2023-12-26 09:53:03,167][123091] Updated weights for policy 0, policy_version 1289202 (0.0010) [2023-12-26 09:53:03,234][123091] Updated weights for policy 0, policy_version 1289212 (0.0006) [2023-12-26 09:53:03,285][123091] Updated weights for policy 0, policy_version 1289222 (0.0005) [2023-12-26 09:53:03,344][123091] Updated weights for policy 0, policy_version 1289232 (0.0007) [2023-12-26 09:53:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 657743872. Throughput: 0: 9289.5, 1: 8907.6. Samples: 657757860. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:53:03,784][121949] Avg episode reward: [(0, '6214.712'), (1, '5326.469')] [2023-12-26 09:53:03,835][123090] Updated weights for policy 1, policy_version 1280067 (0.0006) [2023-12-26 09:53:03,897][123090] Updated weights for policy 1, policy_version 1280077 (0.0007) [2023-12-26 09:53:03,954][123090] Updated weights for policy 1, policy_version 1280087 (0.0006) [2023-12-26 09:53:04,080][123091] Updated weights for policy 0, policy_version 1289242 (0.0007) [2023-12-26 09:53:04,138][123091] Updated weights for policy 0, policy_version 1289252 (0.0005) [2023-12-26 09:53:04,200][123091] Updated weights for policy 0, policy_version 1289262 (0.0008) [2023-12-26 09:53:04,780][123090] Updated weights for policy 1, policy_version 1280097 (0.0006) [2023-12-26 09:53:04,816][123091] Updated weights for policy 0, policy_version 1289272 (0.0006) [2023-12-26 09:53:04,851][123090] Updated weights for policy 1, policy_version 1280107 (0.0009) [2023-12-26 09:53:04,872][123091] Updated weights for policy 0, policy_version 1289282 (0.0005) [2023-12-26 09:53:04,921][123090] Updated weights for policy 1, policy_version 1280117 (0.0006) [2023-12-26 09:53:04,925][123091] Updated weights for policy 0, policy_version 1289292 (0.0005) [2023-12-26 09:53:04,991][123090] Updated weights for policy 1, policy_version 1280127 (0.0005) [2023-12-26 09:53:05,549][123091] Updated weights for policy 0, policy_version 1289302 (0.0005) [2023-12-26 09:53:05,603][123091] Updated weights for policy 0, policy_version 1289312 (0.0005) [2023-12-26 09:53:05,658][123091] Updated weights for policy 0, policy_version 1289322 (0.0005) [2023-12-26 09:53:05,738][123090] Updated weights for policy 1, policy_version 1280137 (0.0008) [2023-12-26 09:53:05,811][123090] Updated weights for policy 1, policy_version 1280147 (0.0009) [2023-12-26 09:53:05,878][123090] Updated weights for policy 1, policy_version 1280157 (0.0008) [2023-12-26 09:53:06,391][123091] Updated weights for policy 0, policy_version 1289332 (0.0006) [2023-12-26 09:53:06,449][123091] Updated weights for policy 0, policy_version 1289342 (0.0006) [2023-12-26 09:53:06,510][123091] Updated weights for policy 0, policy_version 1289352 (0.0006) [2023-12-26 09:53:06,662][123090] Updated weights for policy 1, policy_version 1280167 (0.0007) [2023-12-26 09:53:06,719][123090] Updated weights for policy 1, policy_version 1280177 (0.0006) [2023-12-26 09:53:06,784][123090] Updated weights for policy 1, policy_version 1280187 (0.0006) [2023-12-26 09:53:07,257][123091] Updated weights for policy 0, policy_version 1289362 (0.0009) [2023-12-26 09:53:07,325][123091] Updated weights for policy 0, policy_version 1289372 (0.0010) [2023-12-26 09:53:07,395][123091] Updated weights for policy 0, policy_version 1289382 (0.0005) [2023-12-26 09:53:07,463][123091] Updated weights for policy 0, policy_version 1289392 (0.0006) [2023-12-26 09:53:07,538][123090] Updated weights for policy 1, policy_version 1280197 (0.0008) [2023-12-26 09:53:07,595][123090] Updated weights for policy 1, policy_version 1280207 (0.0011) [2023-12-26 09:53:07,653][123090] Updated weights for policy 1, policy_version 1280217 (0.0011) [2023-12-26 09:53:08,192][123091] Updated weights for policy 0, policy_version 1289402 (0.0011) [2023-12-26 09:53:08,244][123091] Updated weights for policy 0, policy_version 1289412 (0.0010) [2023-12-26 09:53:08,295][123091] Updated weights for policy 0, policy_version 1289422 (0.0010) [2023-12-26 09:53:08,335][123090] Updated weights for policy 1, policy_version 1280227 (0.0011) [2023-12-26 09:53:08,407][123090] Updated weights for policy 1, policy_version 1280237 (0.0009) [2023-12-26 09:53:08,470][123090] Updated weights for policy 1, policy_version 1280247 (0.0011) [2023-12-26 09:53:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18295.5, 300 sec: 17883.6). Total num frames: 657842176. Throughput: 0: 9416.8, 1: 8928.3. Samples: 657814720. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:53:08,785][121949] Avg episode reward: [(0, '6181.155'), (1, '5172.811')] [2023-12-26 09:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001289424_330096640.pth... [2023-12-26 09:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001280256_327745536.pth... [2023-12-26 09:53:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001288336_329818112.pth [2023-12-26 09:53:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001279200_327475200.pth [2023-12-26 09:53:09,209][123091] Updated weights for policy 0, policy_version 1289432 (0.0007) [2023-12-26 09:53:09,276][123091] Updated weights for policy 0, policy_version 1289442 (0.0009) [2023-12-26 09:53:09,296][123090] Updated weights for policy 1, policy_version 1280257 (0.0010) [2023-12-26 09:53:09,347][123091] Updated weights for policy 0, policy_version 1289452 (0.0010) [2023-12-26 09:53:09,370][123090] Updated weights for policy 1, policy_version 1280267 (0.0008) [2023-12-26 09:53:09,443][123090] Updated weights for policy 1, policy_version 1280277 (0.0008) [2023-12-26 09:53:09,529][123090] Updated weights for policy 1, policy_version 1280287 (0.0009) [2023-12-26 09:53:10,159][123091] Updated weights for policy 0, policy_version 1289462 (0.0008) [2023-12-26 09:53:10,206][123091] Updated weights for policy 0, policy_version 1289472 (0.0007) [2023-12-26 09:53:10,265][123091] Updated weights for policy 0, policy_version 1289482 (0.0007) [2023-12-26 09:53:10,336][123090] Updated weights for policy 1, policy_version 1280297 (0.0009) [2023-12-26 09:53:10,392][123090] Updated weights for policy 1, policy_version 1280307 (0.0009) [2023-12-26 09:53:10,454][123090] Updated weights for policy 1, policy_version 1280317 (0.0009) [2023-12-26 09:53:11,154][123091] Updated weights for policy 0, policy_version 1289492 (0.0009) [2023-12-26 09:53:11,225][123091] Updated weights for policy 0, policy_version 1289502 (0.0010) [2023-12-26 09:53:11,229][123090] Updated weights for policy 1, policy_version 1280327 (0.0006) [2023-12-26 09:53:11,293][123091] Updated weights for policy 0, policy_version 1289512 (0.0009) [2023-12-26 09:53:11,303][123090] Updated weights for policy 1, policy_version 1280337 (0.0007) [2023-12-26 09:53:11,380][123090] Updated weights for policy 1, policy_version 1280347 (0.0008) [2023-12-26 09:53:12,148][123091] Updated weights for policy 0, policy_version 1289522 (0.0008) [2023-12-26 09:53:12,150][123090] Updated weights for policy 1, policy_version 1280357 (0.0007) [2023-12-26 09:53:12,208][123091] Updated weights for policy 0, policy_version 1289532 (0.0006) [2023-12-26 09:53:12,225][123090] Updated weights for policy 1, policy_version 1280367 (0.0008) [2023-12-26 09:53:12,271][123091] Updated weights for policy 0, policy_version 1289542 (0.0007) [2023-12-26 09:53:12,295][123090] Updated weights for policy 1, policy_version 1280377 (0.0008) [2023-12-26 09:53:12,341][123091] Updated weights for policy 0, policy_version 1289552 (0.0008) [2023-12-26 09:53:13,029][123091] Updated weights for policy 0, policy_version 1289562 (0.0005) [2023-12-26 09:53:13,085][123091] Updated weights for policy 0, policy_version 1289572 (0.0005) [2023-12-26 09:53:13,139][123091] Updated weights for policy 0, policy_version 1289582 (0.0005) [2023-12-26 09:53:13,152][123090] Updated weights for policy 1, policy_version 1280387 (0.0008) [2023-12-26 09:53:13,207][123090] Updated weights for policy 1, policy_version 1280398 (0.0011) [2023-12-26 09:53:13,261][123090] Updated weights for policy 1, policy_version 1280408 (0.0010) [2023-12-26 09:53:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 657924096. Throughput: 0: 9332.1, 1: 8984.0. Samples: 657920128. Policy #0 lag: (min: 29.0, avg: 29.0, max: 33.0) [2023-12-26 09:53:13,785][121949] Avg episode reward: [(0, '6325.218'), (1, '4853.627')] [2023-12-26 09:53:13,898][123091] Updated weights for policy 0, policy_version 1289592 (0.0008) [2023-12-26 09:53:13,955][123091] Updated weights for policy 0, policy_version 1289602 (0.0010) [2023-12-26 09:53:14,018][123091] Updated weights for policy 0, policy_version 1289612 (0.0010) [2023-12-26 09:53:14,138][123090] Updated weights for policy 1, policy_version 1280418 (0.0009) [2023-12-26 09:53:14,200][123090] Updated weights for policy 1, policy_version 1280428 (0.0009) [2023-12-26 09:53:14,264][123090] Updated weights for policy 1, policy_version 1280438 (0.0009) [2023-12-26 09:53:14,328][123090] Updated weights for policy 1, policy_version 1280448 (0.0009) [2023-12-26 09:53:14,773][123091] Updated weights for policy 0, policy_version 1289622 (0.0010) [2023-12-26 09:53:14,838][123091] Updated weights for policy 0, policy_version 1289632 (0.0008) [2023-12-26 09:53:14,912][123091] Updated weights for policy 0, policy_version 1289642 (0.0007) [2023-12-26 09:53:15,254][123090] Updated weights for policy 1, policy_version 1280458 (0.0010) [2023-12-26 09:53:15,309][123090] Updated weights for policy 1, policy_version 1280468 (0.0010) [2023-12-26 09:53:15,364][123090] Updated weights for policy 1, policy_version 1280478 (0.0010) [2023-12-26 09:53:15,519][123091] Updated weights for policy 0, policy_version 1289652 (0.0008) [2023-12-26 09:53:15,570][123091] Updated weights for policy 0, policy_version 1289662 (0.0010) [2023-12-26 09:53:15,633][123091] Updated weights for policy 0, policy_version 1289672 (0.0010) [2023-12-26 09:53:16,251][123090] Updated weights for policy 1, policy_version 1280488 (0.0008) [2023-12-26 09:53:16,304][123090] Updated weights for policy 1, policy_version 1280498 (0.0009) [2023-12-26 09:53:16,352][123090] Updated weights for policy 1, policy_version 1280508 (0.0009) [2023-12-26 09:53:16,464][123091] Updated weights for policy 0, policy_version 1289682 (0.0010) [2023-12-26 09:53:16,533][123091] Updated weights for policy 0, policy_version 1289692 (0.0010) [2023-12-26 09:53:16,598][123091] Updated weights for policy 0, policy_version 1289702 (0.0011) [2023-12-26 09:53:16,665][123091] Updated weights for policy 0, policy_version 1289712 (0.0011) [2023-12-26 09:53:17,198][123090] Updated weights for policy 1, policy_version 1280518 (0.0008) [2023-12-26 09:53:17,256][123090] Updated weights for policy 1, policy_version 1280528 (0.0010) [2023-12-26 09:53:17,307][123090] Updated weights for policy 1, policy_version 1280538 (0.0008) [2023-12-26 09:53:17,324][123091] Updated weights for policy 0, policy_version 1289722 (0.0010) [2023-12-26 09:53:17,378][123091] Updated weights for policy 0, policy_version 1289732 (0.0010) [2023-12-26 09:53:17,446][123091] Updated weights for policy 0, policy_version 1289742 (0.0010) [2023-12-26 09:53:18,164][123090] Updated weights for policy 1, policy_version 1280548 (0.0009) [2023-12-26 09:53:18,200][123091] Updated weights for policy 0, policy_version 1289752 (0.0011) [2023-12-26 09:53:18,232][123090] Updated weights for policy 1, policy_version 1280558 (0.0008) [2023-12-26 09:53:18,258][123091] Updated weights for policy 0, policy_version 1289762 (0.0011) [2023-12-26 09:53:18,295][123090] Updated weights for policy 1, policy_version 1280568 (0.0007) [2023-12-26 09:53:18,310][123091] Updated weights for policy 0, policy_version 1289772 (0.0010) [2023-12-26 09:53:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18159.0, 300 sec: 17883.6). Total num frames: 658014208. Throughput: 0: 9308.0, 1: 8874.3. Samples: 658025820. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:18,785][121949] Avg episode reward: [(0, '6188.240'), (1, '4884.097')] [2023-12-26 09:53:19,057][123090] Updated weights for policy 1, policy_version 1280578 (0.0008) [2023-12-26 09:53:19,109][123090] Updated weights for policy 1, policy_version 1280588 (0.0005) [2023-12-26 09:53:19,166][123090] Updated weights for policy 1, policy_version 1280598 (0.0007) [2023-12-26 09:53:19,170][123091] Updated weights for policy 0, policy_version 1289782 (0.0010) [2023-12-26 09:53:19,230][123090] Updated weights for policy 1, policy_version 1280608 (0.0010) [2023-12-26 09:53:19,232][123091] Updated weights for policy 0, policy_version 1289792 (0.0011) [2023-12-26 09:53:19,301][123091] Updated weights for policy 0, policy_version 1289802 (0.0007) [2023-12-26 09:53:19,967][123091] Updated weights for policy 0, policy_version 1289812 (0.0008) [2023-12-26 09:53:20,036][123091] Updated weights for policy 0, policy_version 1289822 (0.0008) [2023-12-26 09:53:20,087][123090] Updated weights for policy 1, policy_version 1280618 (0.0008) [2023-12-26 09:53:20,106][123091] Updated weights for policy 0, policy_version 1289832 (0.0007) [2023-12-26 09:53:20,154][123090] Updated weights for policy 1, policy_version 1280628 (0.0009) [2023-12-26 09:53:20,231][123090] Updated weights for policy 1, policy_version 1280638 (0.0010) [2023-12-26 09:53:20,805][123091] Updated weights for policy 0, policy_version 1289842 (0.0007) [2023-12-26 09:53:20,870][123091] Updated weights for policy 0, policy_version 1289852 (0.0011) [2023-12-26 09:53:20,931][123091] Updated weights for policy 0, policy_version 1289862 (0.0011) [2023-12-26 09:53:20,989][123090] Updated weights for policy 1, policy_version 1280648 (0.0007) [2023-12-26 09:53:20,995][123091] Updated weights for policy 0, policy_version 1289872 (0.0011) [2023-12-26 09:53:21,066][123090] Updated weights for policy 1, policy_version 1280658 (0.0009) [2023-12-26 09:53:21,128][123090] Updated weights for policy 1, policy_version 1280668 (0.0008) [2023-12-26 09:53:21,798][123091] Updated weights for policy 0, policy_version 1289882 (0.0010) [2023-12-26 09:53:21,870][123091] Updated weights for policy 0, policy_version 1289892 (0.0006) [2023-12-26 09:53:21,939][123091] Updated weights for policy 0, policy_version 1289902 (0.0006) [2023-12-26 09:53:22,003][123090] Updated weights for policy 1, policy_version 1280678 (0.0009) [2023-12-26 09:53:22,065][123090] Updated weights for policy 1, policy_version 1280688 (0.0010) [2023-12-26 09:53:22,136][123090] Updated weights for policy 1, policy_version 1280698 (0.0009) [2023-12-26 09:53:22,717][123091] Updated weights for policy 0, policy_version 1289912 (0.0009) [2023-12-26 09:53:22,779][123091] Updated weights for policy 0, policy_version 1289922 (0.0010) [2023-12-26 09:53:22,845][123091] Updated weights for policy 0, policy_version 1289932 (0.0010) [2023-12-26 09:53:23,001][123090] Updated weights for policy 1, policy_version 1280708 (0.0008) [2023-12-26 09:53:23,061][123090] Updated weights for policy 1, policy_version 1280718 (0.0005) [2023-12-26 09:53:23,129][123090] Updated weights for policy 1, policy_version 1280728 (0.0006) [2023-12-26 09:53:23,633][123091] Updated weights for policy 0, policy_version 1289942 (0.0007) [2023-12-26 09:53:23,691][123091] Updated weights for policy 0, policy_version 1289952 (0.0005) [2023-12-26 09:53:23,747][123091] Updated weights for policy 0, policy_version 1289962 (0.0005) [2023-12-26 09:53:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18295.5, 300 sec: 17883.6). Total num frames: 658104320. Throughput: 0: 9238.7, 1: 8826.9. Samples: 658078988. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:23,785][121949] Avg episode reward: [(0, '6252.594'), (1, '5245.490')] [2023-12-26 09:53:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001280736_327868416.pth... [2023-12-26 09:53:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001289968_330235904.pth... [2023-12-26 09:53:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001279712_327606272.pth [2023-12-26 09:53:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001288880_329957376.pth [2023-12-26 09:53:23,870][123090] Updated weights for policy 1, policy_version 1280738 (0.0009) [2023-12-26 09:53:23,932][123090] Updated weights for policy 1, policy_version 1280748 (0.0010) [2023-12-26 09:53:23,986][123090] Updated weights for policy 1, policy_version 1280758 (0.0010) [2023-12-26 09:53:24,039][123090] Updated weights for policy 1, policy_version 1280768 (0.0009) [2023-12-26 09:53:24,387][123091] Updated weights for policy 0, policy_version 1289972 (0.0006) [2023-12-26 09:53:24,447][123091] Updated weights for policy 0, policy_version 1289982 (0.0007) [2023-12-26 09:53:24,521][123091] Updated weights for policy 0, policy_version 1289992 (0.0006) [2023-12-26 09:53:24,901][123090] Updated weights for policy 1, policy_version 1280778 (0.0010) [2023-12-26 09:53:24,966][123090] Updated weights for policy 1, policy_version 1280788 (0.0008) [2023-12-26 09:53:25,038][123090] Updated weights for policy 1, policy_version 1280798 (0.0008) [2023-12-26 09:53:25,246][123091] Updated weights for policy 0, policy_version 1290002 (0.0006) [2023-12-26 09:53:25,305][123091] Updated weights for policy 0, policy_version 1290012 (0.0010) [2023-12-26 09:53:25,347][123091] Updated weights for policy 0, policy_version 1290022 (0.0005) [2023-12-26 09:53:25,402][123091] Updated weights for policy 0, policy_version 1290032 (0.0005) [2023-12-26 09:53:25,709][123090] Updated weights for policy 1, policy_version 1280808 (0.0007) [2023-12-26 09:53:25,770][123090] Updated weights for policy 1, policy_version 1280818 (0.0005) [2023-12-26 09:53:25,825][123090] Updated weights for policy 1, policy_version 1280828 (0.0005) [2023-12-26 09:53:26,082][123091] Updated weights for policy 0, policy_version 1290042 (0.0008) [2023-12-26 09:53:26,131][123091] Updated weights for policy 0, policy_version 1290052 (0.0006) [2023-12-26 09:53:26,182][123091] Updated weights for policy 0, policy_version 1290062 (0.0005) [2023-12-26 09:53:26,457][123090] Updated weights for policy 1, policy_version 1280838 (0.0005) [2023-12-26 09:53:26,504][123090] Updated weights for policy 1, policy_version 1280848 (0.0005) [2023-12-26 09:53:26,566][123090] Updated weights for policy 1, policy_version 1280858 (0.0005) [2023-12-26 09:53:26,831][123091] Updated weights for policy 0, policy_version 1290072 (0.0005) [2023-12-26 09:53:26,884][123091] Updated weights for policy 0, policy_version 1290082 (0.0005) [2023-12-26 09:53:26,938][123091] Updated weights for policy 0, policy_version 1290092 (0.0005) [2023-12-26 09:53:27,207][123090] Updated weights for policy 1, policy_version 1280868 (0.0005) [2023-12-26 09:53:27,255][123090] Updated weights for policy 1, policy_version 1280878 (0.0005) [2023-12-26 09:53:27,311][123090] Updated weights for policy 1, policy_version 1280888 (0.0005) [2023-12-26 09:53:27,696][123091] Updated weights for policy 0, policy_version 1290102 (0.0009) [2023-12-26 09:53:27,751][123091] Updated weights for policy 0, policy_version 1290112 (0.0010) [2023-12-26 09:53:27,793][123091] Updated weights for policy 0, policy_version 1290122 (0.0010) [2023-12-26 09:53:28,038][123090] Updated weights for policy 1, policy_version 1280898 (0.0010) [2023-12-26 09:53:28,099][123090] Updated weights for policy 1, policy_version 1280908 (0.0009) [2023-12-26 09:53:28,151][123090] Updated weights for policy 1, policy_version 1280918 (0.0008) [2023-12-26 09:53:28,207][123090] Updated weights for policy 1, policy_version 1280928 (0.0009) [2023-12-26 09:53:28,620][123091] Updated weights for policy 0, policy_version 1290132 (0.0010) [2023-12-26 09:53:28,667][123091] Updated weights for policy 0, policy_version 1290142 (0.0010) [2023-12-26 09:53:28,722][123091] Updated weights for policy 0, policy_version 1290152 (0.0010) [2023-12-26 09:53:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18295.5, 300 sec: 17911.3). Total num frames: 658202624. Throughput: 0: 9262.5, 1: 8979.0. Samples: 658193344. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:28,784][121949] Avg episode reward: [(0, '6293.628'), (1, '5405.114')] [2023-12-26 09:53:29,052][123090] Updated weights for policy 1, policy_version 1280938 (0.0009) [2023-12-26 09:53:29,106][123090] Updated weights for policy 1, policy_version 1280948 (0.0009) [2023-12-26 09:53:29,160][123090] Updated weights for policy 1, policy_version 1280958 (0.0010) [2023-12-26 09:53:29,504][123091] Updated weights for policy 0, policy_version 1290162 (0.0009) [2023-12-26 09:53:29,552][123091] Updated weights for policy 0, policy_version 1290172 (0.0007) [2023-12-26 09:53:29,599][123091] Updated weights for policy 0, policy_version 1290182 (0.0010) [2023-12-26 09:53:29,662][123091] Updated weights for policy 0, policy_version 1290192 (0.0011) [2023-12-26 09:53:30,059][123090] Updated weights for policy 1, policy_version 1280968 (0.0009) [2023-12-26 09:53:30,127][123090] Updated weights for policy 1, policy_version 1280978 (0.0009) [2023-12-26 09:53:30,186][123090] Updated weights for policy 1, policy_version 1280988 (0.0009) [2023-12-26 09:53:30,443][123091] Updated weights for policy 0, policy_version 1290202 (0.0005) [2023-12-26 09:53:30,496][123091] Updated weights for policy 0, policy_version 1290212 (0.0005) [2023-12-26 09:53:30,555][123091] Updated weights for policy 0, policy_version 1290222 (0.0005) [2023-12-26 09:53:30,946][123090] Updated weights for policy 1, policy_version 1280998 (0.0007) [2023-12-26 09:53:31,015][123090] Updated weights for policy 1, policy_version 1281008 (0.0006) [2023-12-26 09:53:31,084][123090] Updated weights for policy 1, policy_version 1281018 (0.0008) [2023-12-26 09:53:31,325][123091] Updated weights for policy 0, policy_version 1290232 (0.0006) [2023-12-26 09:53:31,394][123091] Updated weights for policy 0, policy_version 1290242 (0.0008) [2023-12-26 09:53:31,457][123091] Updated weights for policy 0, policy_version 1290252 (0.0006) [2023-12-26 09:53:31,862][123090] Updated weights for policy 1, policy_version 1281028 (0.0008) [2023-12-26 09:53:31,909][123090] Updated weights for policy 1, policy_version 1281038 (0.0008) [2023-12-26 09:53:31,957][123090] Updated weights for policy 1, policy_version 1281048 (0.0008) [2023-12-26 09:53:32,272][123091] Updated weights for policy 0, policy_version 1290262 (0.0009) [2023-12-26 09:53:32,332][123091] Updated weights for policy 0, policy_version 1290272 (0.0011) [2023-12-26 09:53:32,399][123091] Updated weights for policy 0, policy_version 1290282 (0.0008) [2023-12-26 09:53:32,722][123090] Updated weights for policy 1, policy_version 1281058 (0.0007) [2023-12-26 09:53:32,787][123090] Updated weights for policy 1, policy_version 1281068 (0.0009) [2023-12-26 09:53:32,845][123090] Updated weights for policy 1, policy_version 1281078 (0.0010) [2023-12-26 09:53:32,911][123090] Updated weights for policy 1, policy_version 1281088 (0.0010) [2023-12-26 09:53:33,095][123091] Updated weights for policy 0, policy_version 1290292 (0.0009) [2023-12-26 09:53:33,158][123091] Updated weights for policy 0, policy_version 1290302 (0.0010) [2023-12-26 09:53:33,222][123091] Updated weights for policy 0, policy_version 1290312 (0.0010) [2023-12-26 09:53:33,669][123090] Updated weights for policy 1, policy_version 1281098 (0.0007) [2023-12-26 09:53:33,735][123090] Updated weights for policy 1, policy_version 1281108 (0.0009) [2023-12-26 09:53:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17911.3). Total num frames: 658284544. Throughput: 0: 9242.5, 1: 8926.2. Samples: 658301228. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:33,785][121949] Avg episode reward: [(0, '6312.464'), (1, '5229.761')] [2023-12-26 09:53:33,801][123090] Updated weights for policy 1, policy_version 1281118 (0.0010) [2023-12-26 09:53:33,985][123091] Updated weights for policy 0, policy_version 1290322 (0.0010) [2023-12-26 09:53:34,047][123091] Updated weights for policy 0, policy_version 1290332 (0.0008) [2023-12-26 09:53:34,116][123091] Updated weights for policy 0, policy_version 1290342 (0.0009) [2023-12-26 09:53:34,181][123091] Updated weights for policy 0, policy_version 1290352 (0.0009) [2023-12-26 09:53:34,607][123090] Updated weights for policy 1, policy_version 1281128 (0.0007) [2023-12-26 09:53:34,659][123090] Updated weights for policy 1, policy_version 1281138 (0.0005) [2023-12-26 09:53:34,724][123090] Updated weights for policy 1, policy_version 1281148 (0.0005) [2023-12-26 09:53:34,982][123091] Updated weights for policy 0, policy_version 1290362 (0.0009) [2023-12-26 09:53:35,039][123091] Updated weights for policy 0, policy_version 1290372 (0.0011) [2023-12-26 09:53:35,099][123091] Updated weights for policy 0, policy_version 1290382 (0.0009) [2023-12-26 09:53:35,441][123090] Updated weights for policy 1, policy_version 1281158 (0.0006) [2023-12-26 09:53:35,490][123090] Updated weights for policy 1, policy_version 1281168 (0.0005) [2023-12-26 09:53:35,557][123090] Updated weights for policy 1, policy_version 1281178 (0.0005) [2023-12-26 09:53:35,910][123091] Updated weights for policy 0, policy_version 1290392 (0.0006) [2023-12-26 09:53:35,965][123091] Updated weights for policy 0, policy_version 1290402 (0.0005) [2023-12-26 09:53:36,009][123091] Updated weights for policy 0, policy_version 1290412 (0.0005) [2023-12-26 09:53:36,223][123090] Updated weights for policy 1, policy_version 1281188 (0.0006) [2023-12-26 09:53:36,290][123090] Updated weights for policy 1, policy_version 1281198 (0.0007) [2023-12-26 09:53:36,363][123090] Updated weights for policy 1, policy_version 1281208 (0.0006) [2023-12-26 09:53:36,847][123091] Updated weights for policy 0, policy_version 1290422 (0.0009) [2023-12-26 09:53:36,914][123091] Updated weights for policy 0, policy_version 1290432 (0.0009) [2023-12-26 09:53:36,976][123091] Updated weights for policy 0, policy_version 1290442 (0.0008) [2023-12-26 09:53:37,128][123090] Updated weights for policy 1, policy_version 1281218 (0.0006) [2023-12-26 09:53:37,181][123090] Updated weights for policy 1, policy_version 1281228 (0.0009) [2023-12-26 09:53:37,243][123090] Updated weights for policy 1, policy_version 1281238 (0.0009) [2023-12-26 09:53:37,322][123090] Updated weights for policy 1, policy_version 1281248 (0.0009) [2023-12-26 09:53:37,687][123091] Updated weights for policy 0, policy_version 1290452 (0.0010) [2023-12-26 09:53:37,758][123091] Updated weights for policy 0, policy_version 1290462 (0.0006) [2023-12-26 09:53:37,838][123091] Updated weights for policy 0, policy_version 1290472 (0.0006) [2023-12-26 09:53:38,038][123090] Updated weights for policy 1, policy_version 1281258 (0.0010) [2023-12-26 09:53:38,107][123090] Updated weights for policy 1, policy_version 1281268 (0.0009) [2023-12-26 09:53:38,180][123090] Updated weights for policy 1, policy_version 1281278 (0.0010) [2023-12-26 09:53:38,486][123091] Updated weights for policy 0, policy_version 1290482 (0.0006) [2023-12-26 09:53:38,538][123091] Updated weights for policy 0, policy_version 1290492 (0.0006) [2023-12-26 09:53:38,599][123091] Updated weights for policy 0, policy_version 1290502 (0.0009) [2023-12-26 09:53:38,667][123091] Updated weights for policy 0, policy_version 1290512 (0.0009) [2023-12-26 09:53:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18159.0, 300 sec: 17911.3). Total num frames: 658382848. Throughput: 0: 9244.2, 1: 8970.6. Samples: 658356344. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:38,785][121949] Avg episode reward: [(0, '6437.852'), (1, '5176.181')] [2023-12-26 09:53:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001290512_330375168.pth... [2023-12-26 09:53:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001281280_328007680.pth... [2023-12-26 09:53:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001289424_330096640.pth [2023-12-26 09:53:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001280256_327745536.pth [2023-12-26 09:53:39,010][123090] Updated weights for policy 1, policy_version 1281288 (0.0010) [2023-12-26 09:53:39,074][123090] Updated weights for policy 1, policy_version 1281298 (0.0009) [2023-12-26 09:53:39,142][123090] Updated weights for policy 1, policy_version 1281308 (0.0010) [2023-12-26 09:53:39,441][123091] Updated weights for policy 0, policy_version 1290522 (0.0008) [2023-12-26 09:53:39,514][123091] Updated weights for policy 0, policy_version 1290532 (0.0006) [2023-12-26 09:53:39,588][123091] Updated weights for policy 0, policy_version 1290542 (0.0007) [2023-12-26 09:53:39,989][123090] Updated weights for policy 1, policy_version 1281318 (0.0009) [2023-12-26 09:53:40,061][123090] Updated weights for policy 1, policy_version 1281328 (0.0008) [2023-12-26 09:53:40,127][123090] Updated weights for policy 1, policy_version 1281338 (0.0009) [2023-12-26 09:53:40,335][123091] Updated weights for policy 0, policy_version 1290552 (0.0009) [2023-12-26 09:53:40,398][123091] Updated weights for policy 0, policy_version 1290562 (0.0010) [2023-12-26 09:53:40,471][123091] Updated weights for policy 0, policy_version 1290572 (0.0010) [2023-12-26 09:53:40,860][123090] Updated weights for policy 1, policy_version 1281348 (0.0008) [2023-12-26 09:53:40,912][123090] Updated weights for policy 1, policy_version 1281358 (0.0005) [2023-12-26 09:53:40,963][123090] Updated weights for policy 1, policy_version 1281368 (0.0005) [2023-12-26 09:53:41,394][123091] Updated weights for policy 0, policy_version 1290584 (0.0009) [2023-12-26 09:53:41,455][123091] Updated weights for policy 0, policy_version 1290594 (0.0008) [2023-12-26 09:53:41,522][123091] Updated weights for policy 0, policy_version 1290604 (0.0006) [2023-12-26 09:53:41,827][123090] Updated weights for policy 1, policy_version 1281378 (0.0009) [2023-12-26 09:53:41,893][123090] Updated weights for policy 1, policy_version 1281388 (0.0010) [2023-12-26 09:53:41,966][123090] Updated weights for policy 1, policy_version 1281398 (0.0009) [2023-12-26 09:53:42,029][123090] Updated weights for policy 1, policy_version 1281408 (0.0010) [2023-12-26 09:53:42,324][123091] Updated weights for policy 0, policy_version 1290614 (0.0007) [2023-12-26 09:53:42,392][123091] Updated weights for policy 0, policy_version 1290624 (0.0010) [2023-12-26 09:53:42,446][123091] Updated weights for policy 0, policy_version 1290634 (0.0009) [2023-12-26 09:53:42,955][123090] Updated weights for policy 1, policy_version 1281418 (0.0009) [2023-12-26 09:53:43,008][123090] Updated weights for policy 1, policy_version 1281428 (0.0009) [2023-12-26 09:53:43,062][123090] Updated weights for policy 1, policy_version 1281438 (0.0010) [2023-12-26 09:53:43,224][123091] Updated weights for policy 0, policy_version 1290644 (0.0010) [2023-12-26 09:53:43,285][123091] Updated weights for policy 0, policy_version 1290654 (0.0009) [2023-12-26 09:53:43,341][123091] Updated weights for policy 0, policy_version 1290664 (0.0008) [2023-12-26 09:53:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 658464768. Throughput: 0: 9137.8, 1: 8869.1. Samples: 658460404. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:43,784][121949] Avg episode reward: [(0, '6334.859'), (1, '5343.210')] [2023-12-26 09:53:43,980][123090] Updated weights for policy 1, policy_version 1281448 (0.0010) [2023-12-26 09:53:44,048][123090] Updated weights for policy 1, policy_version 1281458 (0.0009) [2023-12-26 09:53:44,071][123091] Updated weights for policy 0, policy_version 1290674 (0.0008) [2023-12-26 09:53:44,120][123090] Updated weights for policy 1, policy_version 1281468 (0.0008) [2023-12-26 09:53:44,138][123091] Updated weights for policy 0, policy_version 1290684 (0.0010) [2023-12-26 09:53:44,198][123091] Updated weights for policy 0, policy_version 1290694 (0.0009) [2023-12-26 09:53:44,258][123091] Updated weights for policy 0, policy_version 1290704 (0.0005) [2023-12-26 09:53:44,867][123090] Updated weights for policy 1, policy_version 1281478 (0.0008) [2023-12-26 09:53:44,936][123090] Updated weights for policy 1, policy_version 1281488 (0.0007) [2023-12-26 09:53:44,940][123091] Updated weights for policy 0, policy_version 1290714 (0.0008) [2023-12-26 09:53:45,004][123090] Updated weights for policy 1, policy_version 1281498 (0.0006) [2023-12-26 09:53:45,007][123091] Updated weights for policy 0, policy_version 1290724 (0.0010) [2023-12-26 09:53:45,075][123091] Updated weights for policy 0, policy_version 1290734 (0.0011) [2023-12-26 09:53:45,720][123090] Updated weights for policy 1, policy_version 1281508 (0.0008) [2023-12-26 09:53:45,794][123090] Updated weights for policy 1, policy_version 1281518 (0.0007) [2023-12-26 09:53:45,821][123091] Updated weights for policy 0, policy_version 1290744 (0.0011) [2023-12-26 09:53:45,859][123090] Updated weights for policy 1, policy_version 1281528 (0.0011) [2023-12-26 09:53:45,874][123091] Updated weights for policy 0, policy_version 1290754 (0.0011) [2023-12-26 09:53:45,925][123091] Updated weights for policy 0, policy_version 1290764 (0.0010) [2023-12-26 09:53:46,622][123090] Updated weights for policy 1, policy_version 1281538 (0.0010) [2023-12-26 09:53:46,676][123090] Updated weights for policy 1, policy_version 1281548 (0.0005) [2023-12-26 09:53:46,729][123091] Updated weights for policy 0, policy_version 1290774 (0.0010) [2023-12-26 09:53:46,730][123090] Updated weights for policy 1, policy_version 1281558 (0.0007) [2023-12-26 09:53:46,781][123091] Updated weights for policy 0, policy_version 1290784 (0.0010) [2023-12-26 09:53:46,791][123090] Updated weights for policy 1, policy_version 1281568 (0.0009) [2023-12-26 09:53:46,830][123091] Updated weights for policy 0, policy_version 1290794 (0.0007) [2023-12-26 09:53:47,457][123090] Updated weights for policy 1, policy_version 1281578 (0.0009) [2023-12-26 09:53:47,510][123090] Updated weights for policy 1, policy_version 1281588 (0.0010) [2023-12-26 09:53:47,559][123090] Updated weights for policy 1, policy_version 1281598 (0.0007) [2023-12-26 09:53:47,662][123091] Updated weights for policy 0, policy_version 1290804 (0.0008) [2023-12-26 09:53:47,733][123091] Updated weights for policy 0, policy_version 1290814 (0.0005) [2023-12-26 09:53:47,803][123091] Updated weights for policy 0, policy_version 1290824 (0.0005) [2023-12-26 09:53:48,416][123090] Updated weights for policy 1, policy_version 1281608 (0.0009) [2023-12-26 09:53:48,437][123091] Updated weights for policy 0, policy_version 1290834 (0.0006) [2023-12-26 09:53:48,480][123090] Updated weights for policy 1, policy_version 1281618 (0.0008) [2023-12-26 09:53:48,501][123091] Updated weights for policy 0, policy_version 1290844 (0.0008) [2023-12-26 09:53:48,543][123090] Updated weights for policy 1, policy_version 1281628 (0.0006) [2023-12-26 09:53:48,566][123091] Updated weights for policy 0, policy_version 1290854 (0.0009) [2023-12-26 09:53:48,630][123091] Updated weights for policy 0, policy_version 1290864 (0.0011) [2023-12-26 09:53:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18295.4, 300 sec: 17911.3). Total num frames: 658563072. Throughput: 0: 9219.9, 1: 8825.8. Samples: 658569924. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:48,785][121949] Avg episode reward: [(0, '6130.416'), (1, '5169.166')] [2023-12-26 09:53:49,335][123090] Updated weights for policy 1, policy_version 1281638 (0.0008) [2023-12-26 09:53:49,407][123090] Updated weights for policy 1, policy_version 1281648 (0.0008) [2023-12-26 09:53:49,422][123091] Updated weights for policy 0, policy_version 1290874 (0.0009) [2023-12-26 09:53:49,472][123090] Updated weights for policy 1, policy_version 1281658 (0.0005) [2023-12-26 09:53:49,486][123091] Updated weights for policy 0, policy_version 1290884 (0.0009) [2023-12-26 09:53:49,556][123091] Updated weights for policy 0, policy_version 1290894 (0.0009) [2023-12-26 09:53:50,253][123090] Updated weights for policy 1, policy_version 1281668 (0.0006) [2023-12-26 09:53:50,266][123091] Updated weights for policy 0, policy_version 1290904 (0.0005) [2023-12-26 09:53:50,307][123090] Updated weights for policy 1, policy_version 1281678 (0.0009) [2023-12-26 09:53:50,323][123091] Updated weights for policy 0, policy_version 1290914 (0.0006) [2023-12-26 09:53:50,362][123090] Updated weights for policy 1, policy_version 1281688 (0.0009) [2023-12-26 09:53:50,383][123091] Updated weights for policy 0, policy_version 1290924 (0.0010) [2023-12-26 09:53:51,162][123091] Updated weights for policy 0, policy_version 1290934 (0.0010) [2023-12-26 09:53:51,225][123091] Updated weights for policy 0, policy_version 1290944 (0.0010) [2023-12-26 09:53:51,263][123090] Updated weights for policy 1, policy_version 1281698 (0.0007) [2023-12-26 09:53:51,298][123091] Updated weights for policy 0, policy_version 1290954 (0.0010) [2023-12-26 09:53:51,333][123090] Updated weights for policy 1, policy_version 1281708 (0.0008) [2023-12-26 09:53:51,390][123090] Updated weights for policy 1, policy_version 1281718 (0.0006) [2023-12-26 09:53:51,443][123090] Updated weights for policy 1, policy_version 1281728 (0.0005) [2023-12-26 09:53:52,127][123091] Updated weights for policy 0, policy_version 1290964 (0.0009) [2023-12-26 09:53:52,196][123091] Updated weights for policy 0, policy_version 1290974 (0.0009) [2023-12-26 09:53:52,200][123090] Updated weights for policy 1, policy_version 1281738 (0.0008) [2023-12-26 09:53:52,260][123091] Updated weights for policy 0, policy_version 1290984 (0.0009) [2023-12-26 09:53:52,271][123090] Updated weights for policy 1, policy_version 1281748 (0.0007) [2023-12-26 09:53:52,337][123090] Updated weights for policy 1, policy_version 1281758 (0.0006) [2023-12-26 09:53:52,970][123091] Updated weights for policy 0, policy_version 1290994 (0.0010) [2023-12-26 09:53:53,035][123091] Updated weights for policy 0, policy_version 1291004 (0.0007) [2023-12-26 09:53:53,047][123090] Updated weights for policy 1, policy_version 1281768 (0.0009) [2023-12-26 09:53:53,094][123091] Updated weights for policy 0, policy_version 1291014 (0.0005) [2023-12-26 09:53:53,106][123090] Updated weights for policy 1, policy_version 1281778 (0.0010) [2023-12-26 09:53:53,150][123091] Updated weights for policy 0, policy_version 1291024 (0.0008) [2023-12-26 09:53:53,158][123090] Updated weights for policy 1, policy_version 1281788 (0.0007) [2023-12-26 09:53:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.5, 300 sec: 17883.5). Total num frames: 658644992. Throughput: 0: 9149.8, 1: 8816.8. Samples: 658623216. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:53,785][121949] Avg episode reward: [(0, '6127.577'), (1, '4985.249')] [2023-12-26 09:53:53,820][123090] Updated weights for policy 1, policy_version 1281798 (0.0007) [2023-12-26 09:53:53,832][123091] Updated weights for policy 0, policy_version 1291034 (0.0005) [2023-12-26 09:53:53,868][123090] Updated weights for policy 1, policy_version 1281808 (0.0008) [2023-12-26 09:53:53,900][123091] Updated weights for policy 0, policy_version 1291044 (0.0005) [2023-12-26 09:53:53,917][123090] Updated weights for policy 1, policy_version 1281818 (0.0005) [2023-12-26 09:53:53,949][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001281824_328146944.pth... [2023-12-26 09:53:53,952][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001280736_327868416.pth [2023-12-26 09:53:53,953][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001281824_328146944.pth [2023-12-26 09:53:53,960][123091] Updated weights for policy 0, policy_version 1291054 (0.0009) [2023-12-26 09:53:53,967][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001291056_330514432.pth... [2023-12-26 09:53:53,970][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001289968_330235904.pth [2023-12-26 09:53:53,971][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001291056_330514432.pth [2023-12-26 09:53:54,633][123091] Updated weights for policy 0, policy_version 1291064 (0.0009) [2023-12-26 09:53:54,650][123090] Updated weights for policy 1, policy_version 1281828 (0.0006) [2023-12-26 09:53:54,695][123091] Updated weights for policy 0, policy_version 1291074 (0.0010) [2023-12-26 09:53:54,700][123090] Updated weights for policy 1, policy_version 1281838 (0.0007) [2023-12-26 09:53:54,756][123090] Updated weights for policy 1, policy_version 1281848 (0.0006) [2023-12-26 09:53:54,768][123091] Updated weights for policy 0, policy_version 1291084 (0.0010) [2023-12-26 09:53:55,445][123090] Updated weights for policy 1, policy_version 1281858 (0.0007) [2023-12-26 09:53:55,463][123091] Updated weights for policy 0, policy_version 1291094 (0.0009) [2023-12-26 09:53:55,501][123090] Updated weights for policy 1, policy_version 1281868 (0.0010) [2023-12-26 09:53:55,515][123091] Updated weights for policy 0, policy_version 1291104 (0.0005) [2023-12-26 09:53:55,555][123090] Updated weights for policy 1, policy_version 1281878 (0.0010) [2023-12-26 09:53:55,560][123091] Updated weights for policy 0, policy_version 1291114 (0.0005) [2023-12-26 09:53:55,615][123090] Updated weights for policy 1, policy_version 1281888 (0.0010) [2023-12-26 09:53:56,173][123091] Updated weights for policy 0, policy_version 1291124 (0.0007) [2023-12-26 09:53:56,229][123091] Updated weights for policy 0, policy_version 1291134 (0.0010) [2023-12-26 09:53:56,287][123091] Updated weights for policy 0, policy_version 1291144 (0.0010) [2023-12-26 09:53:56,460][123090] Updated weights for policy 1, policy_version 1281898 (0.0011) [2023-12-26 09:53:56,523][123090] Updated weights for policy 1, policy_version 1281908 (0.0010) [2023-12-26 09:53:56,581][123090] Updated weights for policy 1, policy_version 1281918 (0.0010) [2023-12-26 09:53:57,038][123091] Updated weights for policy 0, policy_version 1291154 (0.0010) [2023-12-26 09:53:57,085][123091] Updated weights for policy 0, policy_version 1291164 (0.0010) [2023-12-26 09:53:57,147][123091] Updated weights for policy 0, policy_version 1291174 (0.0009) [2023-12-26 09:53:57,206][123091] Updated weights for policy 0, policy_version 1291184 (0.0008) [2023-12-26 09:53:57,396][123090] Updated weights for policy 1, policy_version 1281928 (0.0010) [2023-12-26 09:53:57,461][123090] Updated weights for policy 1, policy_version 1281938 (0.0010) [2023-12-26 09:53:57,523][123090] Updated weights for policy 1, policy_version 1281948 (0.0010) [2023-12-26 09:53:57,983][123091] Updated weights for policy 0, policy_version 1291194 (0.0005) [2023-12-26 09:53:58,038][123091] Updated weights for policy 0, policy_version 1291204 (0.0006) [2023-12-26 09:53:58,108][123091] Updated weights for policy 0, policy_version 1291214 (0.0007) [2023-12-26 09:53:58,269][123090] Updated weights for policy 1, policy_version 1281958 (0.0009) [2023-12-26 09:53:58,344][123090] Updated weights for policy 1, policy_version 1281968 (0.0008) [2023-12-26 09:53:58,419][123090] Updated weights for policy 1, policy_version 1281978 (0.0009) [2023-12-26 09:53:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 658743296. Throughput: 0: 9306.7, 1: 8876.2. Samples: 658738356. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:53:58,785][121949] Avg episode reward: [(0, '6232.161'), (1, '4928.958')] [2023-12-26 09:53:58,893][123091] Updated weights for policy 0, policy_version 1291224 (0.0006) [2023-12-26 09:53:58,963][123091] Updated weights for policy 0, policy_version 1291234 (0.0009) [2023-12-26 09:53:59,029][123091] Updated weights for policy 0, policy_version 1291244 (0.0010) [2023-12-26 09:53:59,300][123090] Updated weights for policy 1, policy_version 1281988 (0.0009) [2023-12-26 09:53:59,365][123090] Updated weights for policy 1, policy_version 1281998 (0.0009) [2023-12-26 09:53:59,427][123090] Updated weights for policy 1, policy_version 1282008 (0.0009) [2023-12-26 09:53:59,773][123091] Updated weights for policy 0, policy_version 1291254 (0.0010) [2023-12-26 09:53:59,842][123091] Updated weights for policy 0, policy_version 1291264 (0.0010) [2023-12-26 09:53:59,900][123091] Updated weights for policy 0, policy_version 1291274 (0.0008) [2023-12-26 09:54:00,264][123090] Updated weights for policy 1, policy_version 1282018 (0.0009) [2023-12-26 09:54:00,320][123090] Updated weights for policy 1, policy_version 1282028 (0.0006) [2023-12-26 09:54:00,371][123090] Updated weights for policy 1, policy_version 1282038 (0.0010) [2023-12-26 09:54:00,425][123090] Updated weights for policy 1, policy_version 1282048 (0.0009) [2023-12-26 09:54:00,665][123091] Updated weights for policy 0, policy_version 1291284 (0.0009) [2023-12-26 09:54:00,712][123091] Updated weights for policy 0, policy_version 1291294 (0.0010) [2023-12-26 09:54:00,769][123091] Updated weights for policy 0, policy_version 1291304 (0.0010) [2023-12-26 09:54:01,239][123090] Updated weights for policy 1, policy_version 1282058 (0.0010) [2023-12-26 09:54:01,311][123090] Updated weights for policy 1, policy_version 1282068 (0.0007) [2023-12-26 09:54:01,392][123090] Updated weights for policy 1, policy_version 1282078 (0.0009) [2023-12-26 09:54:01,571][123091] Updated weights for policy 0, policy_version 1291314 (0.0011) [2023-12-26 09:54:01,640][123091] Updated weights for policy 0, policy_version 1291324 (0.0012) [2023-12-26 09:54:01,704][123091] Updated weights for policy 0, policy_version 1291334 (0.0010) [2023-12-26 09:54:01,778][123091] Updated weights for policy 0, policy_version 1291344 (0.0010) [2023-12-26 09:54:02,205][123090] Updated weights for policy 1, policy_version 1282088 (0.0010) [2023-12-26 09:54:02,266][123090] Updated weights for policy 1, policy_version 1282098 (0.0010) [2023-12-26 09:54:02,337][123090] Updated weights for policy 1, policy_version 1282108 (0.0009) [2023-12-26 09:54:02,548][123091] Updated weights for policy 0, policy_version 1291354 (0.0010) [2023-12-26 09:54:02,610][123091] Updated weights for policy 0, policy_version 1291364 (0.0006) [2023-12-26 09:54:02,684][123091] Updated weights for policy 0, policy_version 1291374 (0.0005) [2023-12-26 09:54:03,007][123090] Updated weights for policy 1, policy_version 1282118 (0.0006) [2023-12-26 09:54:03,065][123090] Updated weights for policy 1, policy_version 1282128 (0.0005) [2023-12-26 09:54:03,117][123090] Updated weights for policy 1, policy_version 1282138 (0.0005) [2023-12-26 09:54:03,382][123091] Updated weights for policy 0, policy_version 1291384 (0.0005) [2023-12-26 09:54:03,439][123091] Updated weights for policy 0, policy_version 1291394 (0.0005) [2023-12-26 09:54:03,487][123091] Updated weights for policy 0, policy_version 1291404 (0.0005) [2023-12-26 09:54:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17939.1). Total num frames: 658833408. Throughput: 0: 9269.9, 1: 8971.1. Samples: 658846664. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:03,785][121949] Avg episode reward: [(0, '6270.607'), (1, '4880.929')] [2023-12-26 09:54:03,869][123090] Updated weights for policy 1, policy_version 1282148 (0.0006) [2023-12-26 09:54:03,923][123090] Updated weights for policy 1, policy_version 1282158 (0.0008) [2023-12-26 09:54:03,978][123090] Updated weights for policy 1, policy_version 1282168 (0.0010) [2023-12-26 09:54:04,245][123091] Updated weights for policy 0, policy_version 1291414 (0.0009) [2023-12-26 09:54:04,315][123091] Updated weights for policy 0, policy_version 1291424 (0.0008) [2023-12-26 09:54:04,376][123091] Updated weights for policy 0, policy_version 1291434 (0.0009) [2023-12-26 09:54:04,747][123090] Updated weights for policy 1, policy_version 1282178 (0.0007) [2023-12-26 09:54:04,799][123090] Updated weights for policy 1, policy_version 1282188 (0.0009) [2023-12-26 09:54:04,851][123090] Updated weights for policy 1, policy_version 1282199 (0.0010) [2023-12-26 09:54:05,124][123091] Updated weights for policy 0, policy_version 1291444 (0.0008) [2023-12-26 09:54:05,198][123091] Updated weights for policy 0, policy_version 1291454 (0.0006) [2023-12-26 09:54:05,276][123091] Updated weights for policy 0, policy_version 1291464 (0.0009) [2023-12-26 09:54:05,596][123090] Updated weights for policy 1, policy_version 1282209 (0.0009) [2023-12-26 09:54:05,646][123090] Updated weights for policy 1, policy_version 1282219 (0.0010) [2023-12-26 09:54:05,697][123090] Updated weights for policy 1, policy_version 1282229 (0.0010) [2023-12-26 09:54:05,745][123090] Updated weights for policy 1, policy_version 1282239 (0.0010) [2023-12-26 09:54:05,937][123091] Updated weights for policy 0, policy_version 1291474 (0.0009) [2023-12-26 09:54:05,989][123091] Updated weights for policy 0, policy_version 1291484 (0.0008) [2023-12-26 09:54:06,047][123091] Updated weights for policy 0, policy_version 1291494 (0.0009) [2023-12-26 09:54:06,110][123091] Updated weights for policy 0, policy_version 1291504 (0.0009) [2023-12-26 09:54:06,624][123090] Updated weights for policy 1, policy_version 1282249 (0.0010) [2023-12-26 09:54:06,684][123090] Updated weights for policy 1, policy_version 1282259 (0.0008) [2023-12-26 09:54:06,736][123090] Updated weights for policy 1, policy_version 1282269 (0.0009) [2023-12-26 09:54:06,866][123091] Updated weights for policy 0, policy_version 1291514 (0.0010) [2023-12-26 09:54:06,931][123091] Updated weights for policy 0, policy_version 1291524 (0.0011) [2023-12-26 09:54:06,983][123091] Updated weights for policy 0, policy_version 1291534 (0.0011) [2023-12-26 09:54:07,606][123090] Updated weights for policy 1, policy_version 1282279 (0.0009) [2023-12-26 09:54:07,660][123090] Updated weights for policy 1, policy_version 1282289 (0.0009) [2023-12-26 09:54:07,710][123090] Updated weights for policy 1, policy_version 1282299 (0.0009) [2023-12-26 09:54:07,800][123091] Updated weights for policy 0, policy_version 1291544 (0.0010) [2023-12-26 09:54:07,848][123091] Updated weights for policy 0, policy_version 1291554 (0.0010) [2023-12-26 09:54:07,896][123091] Updated weights for policy 0, policy_version 1291564 (0.0010) [2023-12-26 09:54:08,642][123090] Updated weights for policy 1, policy_version 1282309 (0.0009) [2023-12-26 09:54:08,651][123091] Updated weights for policy 0, policy_version 1291574 (0.0008) [2023-12-26 09:54:08,708][123090] Updated weights for policy 1, policy_version 1282319 (0.0009) [2023-12-26 09:54:08,714][123091] Updated weights for policy 0, policy_version 1291584 (0.0006) [2023-12-26 09:54:08,773][123090] Updated weights for policy 1, policy_version 1282329 (0.0008) [2023-12-26 09:54:08,783][123091] Updated weights for policy 0, policy_version 1291594 (0.0007) [2023-12-26 09:54:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 658915328. Throughput: 0: 9279.1, 1: 9006.9. Samples: 658901860. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:08,785][121949] Avg episode reward: [(0, '6303.844'), (1, '5103.613')] [2023-12-26 09:54:08,818][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001282336_328278016.pth... [2023-12-26 09:54:08,819][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001291600_330653696.pth... [2023-12-26 09:54:08,823][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001281280_328007680.pth [2023-12-26 09:54:08,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001290512_330375168.pth [2023-12-26 09:54:09,546][123091] Updated weights for policy 0, policy_version 1291604 (0.0008) [2023-12-26 09:54:09,609][123091] Updated weights for policy 0, policy_version 1291614 (0.0008) [2023-12-26 09:54:09,611][123090] Updated weights for policy 1, policy_version 1282339 (0.0008) [2023-12-26 09:54:09,673][123091] Updated weights for policy 0, policy_version 1291624 (0.0008) [2023-12-26 09:54:09,675][123090] Updated weights for policy 1, policy_version 1282349 (0.0008) [2023-12-26 09:54:09,747][123090] Updated weights for policy 1, policy_version 1282359 (0.0008) [2023-12-26 09:54:10,505][123091] Updated weights for policy 0, policy_version 1291634 (0.0009) [2023-12-26 09:54:10,561][123091] Updated weights for policy 0, policy_version 1291644 (0.0009) [2023-12-26 09:54:10,612][123091] Updated weights for policy 0, policy_version 1291654 (0.0010) [2023-12-26 09:54:10,639][123090] Updated weights for policy 1, policy_version 1282369 (0.0009) [2023-12-26 09:54:10,661][123091] Updated weights for policy 0, policy_version 1291664 (0.0009) [2023-12-26 09:54:10,700][123090] Updated weights for policy 1, policy_version 1282379 (0.0008) [2023-12-26 09:54:10,753][123090] Updated weights for policy 1, policy_version 1282389 (0.0010) [2023-12-26 09:54:10,811][123090] Updated weights for policy 1, policy_version 1282399 (0.0009) [2023-12-26 09:54:11,552][123091] Updated weights for policy 0, policy_version 1291674 (0.0009) [2023-12-26 09:54:11,603][123091] Updated weights for policy 0, policy_version 1291684 (0.0009) [2023-12-26 09:54:11,678][123090] Updated weights for policy 1, policy_version 1282409 (0.0008) [2023-12-26 09:54:11,682][123091] Updated weights for policy 0, policy_version 1291694 (0.0008) [2023-12-26 09:54:11,757][123090] Updated weights for policy 1, policy_version 1282419 (0.0008) [2023-12-26 09:54:11,823][123090] Updated weights for policy 1, policy_version 1282429 (0.0010) [2023-12-26 09:54:12,549][123091] Updated weights for policy 0, policy_version 1291704 (0.0008) [2023-12-26 09:54:12,607][123091] Updated weights for policy 0, policy_version 1291714 (0.0007) [2023-12-26 09:54:12,632][123090] Updated weights for policy 1, policy_version 1282439 (0.0008) [2023-12-26 09:54:12,666][123091] Updated weights for policy 0, policy_version 1291724 (0.0008) [2023-12-26 09:54:12,693][123090] Updated weights for policy 1, policy_version 1282449 (0.0007) [2023-12-26 09:54:12,765][123090] Updated weights for policy 1, policy_version 1282459 (0.0005) [2023-12-26 09:54:13,392][123090] Updated weights for policy 1, policy_version 1282469 (0.0008) [2023-12-26 09:54:13,455][123090] Updated weights for policy 1, policy_version 1282479 (0.0009) [2023-12-26 09:54:13,505][123090] Updated weights for policy 1, policy_version 1282489 (0.0008) [2023-12-26 09:54:13,532][123091] Updated weights for policy 0, policy_version 1291734 (0.0007) [2023-12-26 09:54:13,578][123091] Updated weights for policy 0, policy_version 1291744 (0.0005) [2023-12-26 09:54:13,625][123091] Updated weights for policy 0, policy_version 1291754 (0.0005) [2023-12-26 09:54:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 17966.9). Total num frames: 659013632. Throughput: 0: 9144.0, 1: 8841.1. Samples: 659002676. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:13,785][121949] Avg episode reward: [(0, '6257.633'), (1, '5019.193')] [2023-12-26 09:54:14,234][123090] Updated weights for policy 1, policy_version 1282499 (0.0008) [2023-12-26 09:54:14,306][123090] Updated weights for policy 1, policy_version 1282509 (0.0005) [2023-12-26 09:54:14,332][123091] Updated weights for policy 0, policy_version 1291764 (0.0009) [2023-12-26 09:54:14,370][123090] Updated weights for policy 1, policy_version 1282519 (0.0005) [2023-12-26 09:54:14,379][123091] Updated weights for policy 0, policy_version 1291774 (0.0007) [2023-12-26 09:54:14,427][123091] Updated weights for policy 0, policy_version 1291784 (0.0007) [2023-12-26 09:54:15,140][123090] Updated weights for policy 1, policy_version 1282529 (0.0007) [2023-12-26 09:54:15,204][123090] Updated weights for policy 1, policy_version 1282539 (0.0006) [2023-12-26 09:54:15,259][123091] Updated weights for policy 0, policy_version 1291794 (0.0009) [2023-12-26 09:54:15,273][123090] Updated weights for policy 1, policy_version 1282549 (0.0008) [2023-12-26 09:54:15,313][123091] Updated weights for policy 0, policy_version 1291804 (0.0011) [2023-12-26 09:54:15,325][123090] Updated weights for policy 1, policy_version 1282559 (0.0006) [2023-12-26 09:54:15,377][123091] Updated weights for policy 0, policy_version 1291814 (0.0011) [2023-12-26 09:54:15,444][123091] Updated weights for policy 0, policy_version 1291824 (0.0011) [2023-12-26 09:54:16,154][123090] Updated weights for policy 1, policy_version 1282569 (0.0009) [2023-12-26 09:54:16,196][123091] Updated weights for policy 0, policy_version 1291834 (0.0009) [2023-12-26 09:54:16,214][123090] Updated weights for policy 1, policy_version 1282579 (0.0007) [2023-12-26 09:54:16,261][123091] Updated weights for policy 0, policy_version 1291844 (0.0009) [2023-12-26 09:54:16,279][123090] Updated weights for policy 1, policy_version 1282589 (0.0007) [2023-12-26 09:54:16,321][123091] Updated weights for policy 0, policy_version 1291854 (0.0009) [2023-12-26 09:54:17,042][123091] Updated weights for policy 0, policy_version 1291864 (0.0006) [2023-12-26 09:54:17,109][123091] Updated weights for policy 0, policy_version 1291874 (0.0007) [2023-12-26 09:54:17,164][123091] Updated weights for policy 0, policy_version 1291884 (0.0011) [2023-12-26 09:54:17,167][123090] Updated weights for policy 1, policy_version 1282599 (0.0007) [2023-12-26 09:54:17,232][123090] Updated weights for policy 1, policy_version 1282609 (0.0008) [2023-12-26 09:54:17,300][123090] Updated weights for policy 1, policy_version 1282619 (0.0010) [2023-12-26 09:54:17,849][123091] Updated weights for policy 0, policy_version 1291894 (0.0008) [2023-12-26 09:54:17,901][123091] Updated weights for policy 0, policy_version 1291904 (0.0005) [2023-12-26 09:54:17,954][123091] Updated weights for policy 0, policy_version 1291914 (0.0005) [2023-12-26 09:54:18,181][123090] Updated weights for policy 1, policy_version 1282629 (0.0009) [2023-12-26 09:54:18,229][123090] Updated weights for policy 1, policy_version 1282639 (0.0009) [2023-12-26 09:54:18,282][123090] Updated weights for policy 1, policy_version 1282649 (0.0009) [2023-12-26 09:54:18,741][123091] Updated weights for policy 0, policy_version 1291924 (0.0007) [2023-12-26 09:54:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 659095552. Throughput: 0: 9166.7, 1: 8823.0. Samples: 659110764. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:18,785][121949] Avg episode reward: [(0, '6229.960'), (1, '4932.058')] [2023-12-26 09:54:18,808][123091] Updated weights for policy 0, policy_version 1291934 (0.0011) [2023-12-26 09:54:18,875][123091] Updated weights for policy 0, policy_version 1291944 (0.0011) [2023-12-26 09:54:19,149][123090] Updated weights for policy 1, policy_version 1282659 (0.0009) [2023-12-26 09:54:19,203][123090] Updated weights for policy 1, policy_version 1282669 (0.0009) [2023-12-26 09:54:19,268][123090] Updated weights for policy 1, policy_version 1282679 (0.0009) [2023-12-26 09:54:19,652][123091] Updated weights for policy 0, policy_version 1291954 (0.0010) [2023-12-26 09:54:19,710][123091] Updated weights for policy 0, policy_version 1291964 (0.0005) [2023-12-26 09:54:19,767][123091] Updated weights for policy 0, policy_version 1291974 (0.0006) [2023-12-26 09:54:19,828][123091] Updated weights for policy 0, policy_version 1291984 (0.0006) [2023-12-26 09:54:20,211][123090] Updated weights for policy 1, policy_version 1282689 (0.0008) [2023-12-26 09:54:20,272][123090] Updated weights for policy 1, policy_version 1282699 (0.0009) [2023-12-26 09:54:20,332][123090] Updated weights for policy 1, policy_version 1282709 (0.0008) [2023-12-26 09:54:20,394][123090] Updated weights for policy 1, policy_version 1282719 (0.0008) [2023-12-26 09:54:20,555][123091] Updated weights for policy 0, policy_version 1291994 (0.0010) [2023-12-26 09:54:20,623][123091] Updated weights for policy 0, policy_version 1292004 (0.0011) [2023-12-26 09:54:20,687][123091] Updated weights for policy 0, policy_version 1292014 (0.0011) [2023-12-26 09:54:21,260][123090] Updated weights for policy 1, policy_version 1282729 (0.0010) [2023-12-26 09:54:21,330][123090] Updated weights for policy 1, policy_version 1282739 (0.0009) [2023-12-26 09:54:21,406][123090] Updated weights for policy 1, policy_version 1282749 (0.0007) [2023-12-26 09:54:21,514][123091] Updated weights for policy 0, policy_version 1292024 (0.0009) [2023-12-26 09:54:21,565][123091] Updated weights for policy 0, policy_version 1292034 (0.0009) [2023-12-26 09:54:21,625][123091] Updated weights for policy 0, policy_version 1292044 (0.0009) [2023-12-26 09:54:22,171][123090] Updated weights for policy 1, policy_version 1282759 (0.0005) [2023-12-26 09:54:22,242][123090] Updated weights for policy 1, policy_version 1282769 (0.0006) [2023-12-26 09:54:22,314][123090] Updated weights for policy 1, policy_version 1282779 (0.0006) [2023-12-26 09:54:22,456][123091] Updated weights for policy 0, policy_version 1292054 (0.0010) [2023-12-26 09:54:22,522][123091] Updated weights for policy 0, policy_version 1292064 (0.0010) [2023-12-26 09:54:22,589][123091] Updated weights for policy 0, policy_version 1292074 (0.0010) [2023-12-26 09:54:23,009][123090] Updated weights for policy 1, policy_version 1282789 (0.0006) [2023-12-26 09:54:23,083][123090] Updated weights for policy 1, policy_version 1282799 (0.0008) [2023-12-26 09:54:23,156][123090] Updated weights for policy 1, policy_version 1282809 (0.0006) [2023-12-26 09:54:23,389][123091] Updated weights for policy 0, policy_version 1292084 (0.0010) [2023-12-26 09:54:23,456][123091] Updated weights for policy 0, policy_version 1292094 (0.0009) [2023-12-26 09:54:23,521][123091] Updated weights for policy 0, policy_version 1292104 (0.0010) [2023-12-26 09:54:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 659185664. Throughput: 0: 9160.1, 1: 8725.4. Samples: 659161192. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:23,785][121949] Avg episode reward: [(0, '6171.971'), (1, '5167.362')] [2023-12-26 09:54:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001282816_328400896.pth... [2023-12-26 09:54:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001292112_330784768.pth... [2023-12-26 09:54:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001281824_328146944.pth [2023-12-26 09:54:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001291056_330514432.pth [2023-12-26 09:54:23,923][123090] Updated weights for policy 1, policy_version 1282819 (0.0008) [2023-12-26 09:54:23,973][123090] Updated weights for policy 1, policy_version 1282829 (0.0005) [2023-12-26 09:54:24,017][123090] Updated weights for policy 1, policy_version 1282839 (0.0005) [2023-12-26 09:54:24,345][123091] Updated weights for policy 0, policy_version 1292114 (0.0009) [2023-12-26 09:54:24,397][123091] Updated weights for policy 0, policy_version 1292124 (0.0010) [2023-12-26 09:54:24,453][123091] Updated weights for policy 0, policy_version 1292134 (0.0009) [2023-12-26 09:54:24,509][123091] Updated weights for policy 0, policy_version 1292144 (0.0009) [2023-12-26 09:54:24,840][123090] Updated weights for policy 1, policy_version 1282849 (0.0009) [2023-12-26 09:54:24,889][123090] Updated weights for policy 1, policy_version 1282859 (0.0008) [2023-12-26 09:54:24,938][123090] Updated weights for policy 1, policy_version 1282869 (0.0009) [2023-12-26 09:54:24,985][123090] Updated weights for policy 1, policy_version 1282879 (0.0008) [2023-12-26 09:54:25,381][123091] Updated weights for policy 0, policy_version 1292154 (0.0005) [2023-12-26 09:54:25,452][123091] Updated weights for policy 0, policy_version 1292164 (0.0005) [2023-12-26 09:54:25,513][123091] Updated weights for policy 0, policy_version 1292174 (0.0005) [2023-12-26 09:54:25,678][123090] Updated weights for policy 1, policy_version 1282889 (0.0006) [2023-12-26 09:54:25,724][123090] Updated weights for policy 1, policy_version 1282899 (0.0005) [2023-12-26 09:54:25,785][123090] Updated weights for policy 1, policy_version 1282909 (0.0005) [2023-12-26 09:54:26,150][123091] Updated weights for policy 0, policy_version 1292184 (0.0005) [2023-12-26 09:54:26,210][123091] Updated weights for policy 0, policy_version 1292194 (0.0006) [2023-12-26 09:54:26,280][123091] Updated weights for policy 0, policy_version 1292204 (0.0006) [2023-12-26 09:54:26,447][123090] Updated weights for policy 1, policy_version 1282919 (0.0007) [2023-12-26 09:54:26,507][123090] Updated weights for policy 1, policy_version 1282929 (0.0009) [2023-12-26 09:54:26,567][123090] Updated weights for policy 1, policy_version 1282939 (0.0008) [2023-12-26 09:54:26,986][123091] Updated weights for policy 0, policy_version 1292214 (0.0007) [2023-12-26 09:54:27,031][123091] Updated weights for policy 0, policy_version 1292224 (0.0005) [2023-12-26 09:54:27,086][123091] Updated weights for policy 0, policy_version 1292234 (0.0005) [2023-12-26 09:54:27,381][123090] Updated weights for policy 1, policy_version 1282949 (0.0008) [2023-12-26 09:54:27,435][123090] Updated weights for policy 1, policy_version 1282959 (0.0005) [2023-12-26 09:54:27,498][123090] Updated weights for policy 1, policy_version 1282969 (0.0005) [2023-12-26 09:54:27,764][123091] Updated weights for policy 0, policy_version 1292244 (0.0007) [2023-12-26 09:54:27,817][123091] Updated weights for policy 0, policy_version 1292254 (0.0009) [2023-12-26 09:54:27,873][123091] Updated weights for policy 0, policy_version 1292264 (0.0009) [2023-12-26 09:54:28,199][123090] Updated weights for policy 1, policy_version 1282979 (0.0007) [2023-12-26 09:54:28,250][123090] Updated weights for policy 1, policy_version 1282989 (0.0007) [2023-12-26 09:54:28,303][123090] Updated weights for policy 1, policy_version 1282999 (0.0005) [2023-12-26 09:54:28,650][123091] Updated weights for policy 0, policy_version 1292274 (0.0009) [2023-12-26 09:54:28,716][123091] Updated weights for policy 0, policy_version 1292284 (0.0006) [2023-12-26 09:54:28,769][123091] Updated weights for policy 0, policy_version 1292294 (0.0005) [2023-12-26 09:54:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17939.1). Total num frames: 659275776. Throughput: 0: 9225.7, 1: 8848.4. Samples: 659273740. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:28,785][121949] Avg episode reward: [(0, '6168.676'), (1, '5298.096')] [2023-12-26 09:54:28,821][123091] Updated weights for policy 0, policy_version 1292304 (0.0005) [2023-12-26 09:54:29,097][123090] Updated weights for policy 1, policy_version 1283009 (0.0008) [2023-12-26 09:54:29,152][123090] Updated weights for policy 1, policy_version 1283019 (0.0009) [2023-12-26 09:54:29,200][123090] Updated weights for policy 1, policy_version 1283029 (0.0009) [2023-12-26 09:54:29,270][123090] Updated weights for policy 1, policy_version 1283039 (0.0009) [2023-12-26 09:54:29,571][123091] Updated weights for policy 0, policy_version 1292314 (0.0009) [2023-12-26 09:54:29,632][123091] Updated weights for policy 0, policy_version 1292324 (0.0008) [2023-12-26 09:54:29,697][123091] Updated weights for policy 0, policy_version 1292334 (0.0010) [2023-12-26 09:54:30,165][123090] Updated weights for policy 1, policy_version 1283049 (0.0009) [2023-12-26 09:54:30,221][123090] Updated weights for policy 1, policy_version 1283059 (0.0009) [2023-12-26 09:54:30,279][123090] Updated weights for policy 1, policy_version 1283070 (0.0010) [2023-12-26 09:54:30,469][123091] Updated weights for policy 0, policy_version 1292344 (0.0010) [2023-12-26 09:54:30,532][123091] Updated weights for policy 0, policy_version 1292354 (0.0010) [2023-12-26 09:54:30,598][123091] Updated weights for policy 0, policy_version 1292364 (0.0009) [2023-12-26 09:54:31,150][123090] Updated weights for policy 1, policy_version 1283080 (0.0008) [2023-12-26 09:54:31,219][123090] Updated weights for policy 1, policy_version 1283090 (0.0009) [2023-12-26 09:54:31,281][123090] Updated weights for policy 1, policy_version 1283100 (0.0009) [2023-12-26 09:54:31,415][123091] Updated weights for policy 0, policy_version 1292374 (0.0010) [2023-12-26 09:54:31,477][123091] Updated weights for policy 0, policy_version 1292384 (0.0010) [2023-12-26 09:54:31,532][123091] Updated weights for policy 0, policy_version 1292394 (0.0010) [2023-12-26 09:54:32,126][123090] Updated weights for policy 1, policy_version 1283110 (0.0009) [2023-12-26 09:54:32,193][123090] Updated weights for policy 1, policy_version 1283120 (0.0009) [2023-12-26 09:54:32,262][123090] Updated weights for policy 1, policy_version 1283130 (0.0009) [2023-12-26 09:54:32,376][123091] Updated weights for policy 0, policy_version 1292404 (0.0008) [2023-12-26 09:54:32,446][123091] Updated weights for policy 0, policy_version 1292414 (0.0006) [2023-12-26 09:54:32,506][123091] Updated weights for policy 0, policy_version 1292424 (0.0006) [2023-12-26 09:54:33,166][123090] Updated weights for policy 1, policy_version 1283140 (0.0009) [2023-12-26 09:54:33,215][123091] Updated weights for policy 0, policy_version 1292434 (0.0007) [2023-12-26 09:54:33,220][123090] Updated weights for policy 1, policy_version 1283150 (0.0010) [2023-12-26 09:54:33,276][123090] Updated weights for policy 1, policy_version 1283160 (0.0008) [2023-12-26 09:54:33,278][123091] Updated weights for policy 0, policy_version 1292444 (0.0006) [2023-12-26 09:54:33,344][123091] Updated weights for policy 0, policy_version 1292454 (0.0005) [2023-12-26 09:54:33,410][123091] Updated weights for policy 0, policy_version 1292464 (0.0009) [2023-12-26 09:54:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 659365888. Throughput: 0: 9165.2, 1: 8803.3. Samples: 659378504. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:33,785][121949] Avg episode reward: [(0, '6228.958'), (1, '5308.235')] [2023-12-26 09:54:34,051][123090] Updated weights for policy 1, policy_version 1283170 (0.0010) [2023-12-26 09:54:34,113][123090] Updated weights for policy 1, policy_version 1283180 (0.0008) [2023-12-26 09:54:34,116][123091] Updated weights for policy 0, policy_version 1292474 (0.0008) [2023-12-26 09:54:34,178][123091] Updated weights for policy 0, policy_version 1292484 (0.0008) [2023-12-26 09:54:34,179][123090] Updated weights for policy 1, policy_version 1283190 (0.0009) [2023-12-26 09:54:34,232][123090] Updated weights for policy 1, policy_version 1283200 (0.0009) [2023-12-26 09:54:34,252][123091] Updated weights for policy 0, policy_version 1292494 (0.0007) [2023-12-26 09:54:34,997][123091] Updated weights for policy 0, policy_version 1292504 (0.0009) [2023-12-26 09:54:35,050][123091] Updated weights for policy 0, policy_version 1292514 (0.0009) [2023-12-26 09:54:35,112][123091] Updated weights for policy 0, policy_version 1292524 (0.0009) [2023-12-26 09:54:35,116][123090] Updated weights for policy 1, policy_version 1283210 (0.0008) [2023-12-26 09:54:35,165][123090] Updated weights for policy 1, policy_version 1283220 (0.0009) [2023-12-26 09:54:35,219][123090] Updated weights for policy 1, policy_version 1283230 (0.0009) [2023-12-26 09:54:35,770][123091] Updated weights for policy 0, policy_version 1292534 (0.0006) [2023-12-26 09:54:35,829][123091] Updated weights for policy 0, policy_version 1292544 (0.0005) [2023-12-26 09:54:35,902][123091] Updated weights for policy 0, policy_version 1292554 (0.0006) [2023-12-26 09:54:36,177][123090] Updated weights for policy 1, policy_version 1283240 (0.0010) [2023-12-26 09:54:36,241][123090] Updated weights for policy 1, policy_version 1283250 (0.0010) [2023-12-26 09:54:36,301][123090] Updated weights for policy 1, policy_version 1283260 (0.0010) [2023-12-26 09:54:36,568][123091] Updated weights for policy 0, policy_version 1292564 (0.0006) [2023-12-26 09:54:36,629][123091] Updated weights for policy 0, policy_version 1292574 (0.0005) [2023-12-26 09:54:36,687][123091] Updated weights for policy 0, policy_version 1292584 (0.0005) [2023-12-26 09:54:37,244][123090] Updated weights for policy 1, policy_version 1283270 (0.0010) [2023-12-26 09:54:37,298][123090] Updated weights for policy 1, policy_version 1283280 (0.0010) [2023-12-26 09:54:37,303][123091] Updated weights for policy 0, policy_version 1292594 (0.0005) [2023-12-26 09:54:37,354][123091] Updated weights for policy 0, policy_version 1292604 (0.0005) [2023-12-26 09:54:37,362][123090] Updated weights for policy 1, policy_version 1283290 (0.0009) [2023-12-26 09:54:37,401][123091] Updated weights for policy 0, policy_version 1292614 (0.0005) [2023-12-26 09:54:37,463][123091] Updated weights for policy 0, policy_version 1292624 (0.0007) [2023-12-26 09:54:38,229][123091] Updated weights for policy 0, policy_version 1292634 (0.0006) [2023-12-26 09:54:38,274][123090] Updated weights for policy 1, policy_version 1283300 (0.0009) [2023-12-26 09:54:38,289][123091] Updated weights for policy 0, policy_version 1292644 (0.0005) [2023-12-26 09:54:38,331][123090] Updated weights for policy 1, policy_version 1283310 (0.0009) [2023-12-26 09:54:38,357][123091] Updated weights for policy 0, policy_version 1292654 (0.0009) [2023-12-26 09:54:38,401][123090] Updated weights for policy 1, policy_version 1283320 (0.0010) [2023-12-26 09:54:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17966.9). Total num frames: 659456000. Throughput: 0: 9219.1, 1: 8746.3. Samples: 659431660. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:38,785][121949] Avg episode reward: [(0, '6329.065'), (1, '5298.800')] [2023-12-26 09:54:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001283328_328531968.pth... [2023-12-26 09:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001292656_330924032.pth... [2023-12-26 09:54:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001282336_328278016.pth [2023-12-26 09:54:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001291600_330653696.pth [2023-12-26 09:54:39,082][123091] Updated weights for policy 0, policy_version 1292664 (0.0007) [2023-12-26 09:54:39,143][123091] Updated weights for policy 0, policy_version 1292674 (0.0006) [2023-12-26 09:54:39,205][123091] Updated weights for policy 0, policy_version 1292684 (0.0006) [2023-12-26 09:54:39,282][123090] Updated weights for policy 1, policy_version 1283330 (0.0009) [2023-12-26 09:54:39,354][123090] Updated weights for policy 1, policy_version 1283340 (0.0007) [2023-12-26 09:54:39,430][123090] Updated weights for policy 1, policy_version 1283350 (0.0009) [2023-12-26 09:54:39,481][123090] Updated weights for policy 1, policy_version 1283360 (0.0009) [2023-12-26 09:54:40,032][123091] Updated weights for policy 0, policy_version 1292694 (0.0009) [2023-12-26 09:54:40,090][123091] Updated weights for policy 0, policy_version 1292704 (0.0006) [2023-12-26 09:54:40,145][123091] Updated weights for policy 0, policy_version 1292714 (0.0009) [2023-12-26 09:54:40,359][123090] Updated weights for policy 1, policy_version 1283370 (0.0009) [2023-12-26 09:54:40,416][123090] Updated weights for policy 1, policy_version 1283381 (0.0010) [2023-12-26 09:54:40,474][123090] Updated weights for policy 1, policy_version 1283391 (0.0010) [2023-12-26 09:54:40,865][123091] Updated weights for policy 0, policy_version 1292724 (0.0007) [2023-12-26 09:54:40,935][123091] Updated weights for policy 0, policy_version 1292734 (0.0006) [2023-12-26 09:54:41,012][123091] Updated weights for policy 0, policy_version 1292744 (0.0005) [2023-12-26 09:54:41,393][123090] Updated weights for policy 1, policy_version 1283401 (0.0009) [2023-12-26 09:54:41,467][123090] Updated weights for policy 1, policy_version 1283411 (0.0009) [2023-12-26 09:54:41,543][123090] Updated weights for policy 1, policy_version 1283421 (0.0009) [2023-12-26 09:54:41,717][123091] Updated weights for policy 0, policy_version 1292754 (0.0008) [2023-12-26 09:54:41,792][123091] Updated weights for policy 0, policy_version 1292764 (0.0010) [2023-12-26 09:54:41,865][123091] Updated weights for policy 0, policy_version 1292774 (0.0009) [2023-12-26 09:54:41,920][123091] Updated weights for policy 0, policy_version 1292784 (0.0009) [2023-12-26 09:54:42,377][123090] Updated weights for policy 1, policy_version 1283431 (0.0009) [2023-12-26 09:54:42,433][123090] Updated weights for policy 1, policy_version 1283441 (0.0006) [2023-12-26 09:54:42,494][123090] Updated weights for policy 1, policy_version 1283451 (0.0006) [2023-12-26 09:54:42,744][123091] Updated weights for policy 0, policy_version 1292794 (0.0011) [2023-12-26 09:54:42,807][123091] Updated weights for policy 0, policy_version 1292804 (0.0011) [2023-12-26 09:54:42,860][123091] Updated weights for policy 0, policy_version 1292814 (0.0009) [2023-12-26 09:54:43,171][123090] Updated weights for policy 1, policy_version 1283461 (0.0006) [2023-12-26 09:54:43,235][123090] Updated weights for policy 1, policy_version 1283471 (0.0008) [2023-12-26 09:54:43,302][123090] Updated weights for policy 1, policy_version 1283481 (0.0010) [2023-12-26 09:54:43,594][123091] Updated weights for policy 0, policy_version 1292824 (0.0006) [2023-12-26 09:54:43,666][123091] Updated weights for policy 0, policy_version 1292834 (0.0005) [2023-12-26 09:54:43,727][123091] Updated weights for policy 0, policy_version 1292844 (0.0006) [2023-12-26 09:54:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.3, 300 sec: 17939.1). Total num frames: 659546112. Throughput: 0: 9166.4, 1: 8566.5. Samples: 659536336. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:43,785][121949] Avg episode reward: [(0, '6349.363'), (1, '5262.367')] [2023-12-26 09:54:44,046][123090] Updated weights for policy 1, policy_version 1283491 (0.0010) [2023-12-26 09:54:44,098][123090] Updated weights for policy 1, policy_version 1283501 (0.0009) [2023-12-26 09:54:44,159][123090] Updated weights for policy 1, policy_version 1283511 (0.0007) [2023-12-26 09:54:44,355][123091] Updated weights for policy 0, policy_version 1292854 (0.0006) [2023-12-26 09:54:44,415][123091] Updated weights for policy 0, policy_version 1292864 (0.0005) [2023-12-26 09:54:44,477][123091] Updated weights for policy 0, policy_version 1292874 (0.0010) [2023-12-26 09:54:44,923][123090] Updated weights for policy 1, policy_version 1283521 (0.0006) [2023-12-26 09:54:44,984][123090] Updated weights for policy 1, policy_version 1283531 (0.0010) [2023-12-26 09:54:45,040][123090] Updated weights for policy 1, policy_version 1283541 (0.0009) [2023-12-26 09:54:45,100][123090] Updated weights for policy 1, policy_version 1283551 (0.0008) [2023-12-26 09:54:45,265][123091] Updated weights for policy 0, policy_version 1292884 (0.0009) [2023-12-26 09:54:45,313][123091] Updated weights for policy 0, policy_version 1292894 (0.0006) [2023-12-26 09:54:45,369][123091] Updated weights for policy 0, policy_version 1292904 (0.0005) [2023-12-26 09:54:46,010][123090] Updated weights for policy 1, policy_version 1283561 (0.0006) [2023-12-26 09:54:46,063][123090] Updated weights for policy 1, policy_version 1283571 (0.0005) [2023-12-26 09:54:46,109][123091] Updated weights for policy 0, policy_version 1292914 (0.0005) [2023-12-26 09:54:46,132][123090] Updated weights for policy 1, policy_version 1283581 (0.0005) [2023-12-26 09:54:46,179][123091] Updated weights for policy 0, policy_version 1292924 (0.0008) [2023-12-26 09:54:46,243][123091] Updated weights for policy 0, policy_version 1292934 (0.0011) [2023-12-26 09:54:46,295][123091] Updated weights for policy 0, policy_version 1292944 (0.0011) [2023-12-26 09:54:46,739][123090] Updated weights for policy 1, policy_version 1283591 (0.0005) [2023-12-26 09:54:46,802][123090] Updated weights for policy 1, policy_version 1283601 (0.0005) [2023-12-26 09:54:46,872][123090] Updated weights for policy 1, policy_version 1283611 (0.0005) [2023-12-26 09:54:47,082][123091] Updated weights for policy 0, policy_version 1292954 (0.0010) [2023-12-26 09:54:47,133][123091] Updated weights for policy 0, policy_version 1292964 (0.0010) [2023-12-26 09:54:47,192][123091] Updated weights for policy 0, policy_version 1292974 (0.0010) [2023-12-26 09:54:47,494][123090] Updated weights for policy 1, policy_version 1283621 (0.0006) [2023-12-26 09:54:47,553][123090] Updated weights for policy 1, policy_version 1283631 (0.0006) [2023-12-26 09:54:47,620][123090] Updated weights for policy 1, policy_version 1283641 (0.0005) [2023-12-26 09:54:48,039][123091] Updated weights for policy 0, policy_version 1292984 (0.0007) [2023-12-26 09:54:48,099][123091] Updated weights for policy 0, policy_version 1292994 (0.0005) [2023-12-26 09:54:48,164][123091] Updated weights for policy 0, policy_version 1293004 (0.0005) [2023-12-26 09:54:48,433][123090] Updated weights for policy 1, policy_version 1283651 (0.0009) [2023-12-26 09:54:48,501][123090] Updated weights for policy 1, policy_version 1283661 (0.0009) [2023-12-26 09:54:48,561][123090] Updated weights for policy 1, policy_version 1283671 (0.0009) [2023-12-26 09:54:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17966.9). Total num frames: 659636224. Throughput: 0: 9166.8, 1: 8628.9. Samples: 659647472. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:48,785][121949] Avg episode reward: [(0, '6331.348'), (1, '5244.757')] [2023-12-26 09:54:48,905][123091] Updated weights for policy 0, policy_version 1293014 (0.0009) [2023-12-26 09:54:48,964][123091] Updated weights for policy 0, policy_version 1293024 (0.0006) [2023-12-26 09:54:49,025][123091] Updated weights for policy 0, policy_version 1293034 (0.0007) [2023-12-26 09:54:49,323][123090] Updated weights for policy 1, policy_version 1283681 (0.0009) [2023-12-26 09:54:49,421][123090] Updated weights for policy 1, policy_version 1283691 (0.0009) [2023-12-26 09:54:49,489][123090] Updated weights for policy 1, policy_version 1283701 (0.0005) [2023-12-26 09:54:49,556][123090] Updated weights for policy 1, policy_version 1283711 (0.0009) [2023-12-26 09:54:49,817][123091] Updated weights for policy 0, policy_version 1293044 (0.0006) [2023-12-26 09:54:49,885][123091] Updated weights for policy 0, policy_version 1293054 (0.0007) [2023-12-26 09:54:49,955][123091] Updated weights for policy 0, policy_version 1293064 (0.0008) [2023-12-26 09:54:50,376][123090] Updated weights for policy 1, policy_version 1283721 (0.0007) [2023-12-26 09:54:50,432][123090] Updated weights for policy 1, policy_version 1283731 (0.0005) [2023-12-26 09:54:50,492][123090] Updated weights for policy 1, policy_version 1283741 (0.0006) [2023-12-26 09:54:50,750][123091] Updated weights for policy 0, policy_version 1293074 (0.0008) [2023-12-26 09:54:50,827][123091] Updated weights for policy 0, policy_version 1293084 (0.0006) [2023-12-26 09:54:50,895][123091] Updated weights for policy 0, policy_version 1293094 (0.0006) [2023-12-26 09:54:50,960][123091] Updated weights for policy 0, policy_version 1293104 (0.0005) [2023-12-26 09:54:51,245][123090] Updated weights for policy 1, policy_version 1283751 (0.0009) [2023-12-26 09:54:51,310][123090] Updated weights for policy 1, policy_version 1283761 (0.0010) [2023-12-26 09:54:51,370][123090] Updated weights for policy 1, policy_version 1283772 (0.0009) [2023-12-26 09:54:51,705][123091] Updated weights for policy 0, policy_version 1293114 (0.0010) [2023-12-26 09:54:51,779][123091] Updated weights for policy 0, policy_version 1293124 (0.0007) [2023-12-26 09:54:51,850][123091] Updated weights for policy 0, policy_version 1293134 (0.0006) [2023-12-26 09:54:52,223][123090] Updated weights for policy 1, policy_version 1283782 (0.0009) [2023-12-26 09:54:52,274][123090] Updated weights for policy 1, policy_version 1283792 (0.0008) [2023-12-26 09:54:52,340][123090] Updated weights for policy 1, policy_version 1283802 (0.0010) [2023-12-26 09:54:52,587][123091] Updated weights for policy 0, policy_version 1293144 (0.0009) [2023-12-26 09:54:52,649][123091] Updated weights for policy 0, policy_version 1293154 (0.0009) [2023-12-26 09:54:52,714][123091] Updated weights for policy 0, policy_version 1293164 (0.0005) [2023-12-26 09:54:53,220][123090] Updated weights for policy 1, policy_version 1283812 (0.0008) [2023-12-26 09:54:53,271][123090] Updated weights for policy 1, policy_version 1283822 (0.0005) [2023-12-26 09:54:53,327][123090] Updated weights for policy 1, policy_version 1283832 (0.0005) [2023-12-26 09:54:53,386][123091] Updated weights for policy 0, policy_version 1293174 (0.0005) [2023-12-26 09:54:53,447][123091] Updated weights for policy 0, policy_version 1293184 (0.0005) [2023-12-26 09:54:53,506][123091] Updated weights for policy 0, policy_version 1293194 (0.0005) [2023-12-26 09:54:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17994.6). Total num frames: 659726336. Throughput: 0: 9136.1, 1: 8601.2. Samples: 659700040. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:53,785][121949] Avg episode reward: [(0, '6336.189'), (1, '5377.306')] [2023-12-26 09:54:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001293200_331063296.pth... [2023-12-26 09:54:53,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001283840_328663040.pth... [2023-12-26 09:54:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001292112_330784768.pth [2023-12-26 09:54:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001282816_328400896.pth [2023-12-26 09:54:53,963][123090] Updated weights for policy 1, policy_version 1283842 (0.0005) [2023-12-26 09:54:54,023][123090] Updated weights for policy 1, policy_version 1283852 (0.0005) [2023-12-26 09:54:54,076][123090] Updated weights for policy 1, policy_version 1283862 (0.0005) [2023-12-26 09:54:54,100][123091] Updated weights for policy 0, policy_version 1293204 (0.0005) [2023-12-26 09:54:54,144][123090] Updated weights for policy 1, policy_version 1283872 (0.0005) [2023-12-26 09:54:54,158][123091] Updated weights for policy 0, policy_version 1293214 (0.0005) [2023-12-26 09:54:54,208][123091] Updated weights for policy 0, policy_version 1293224 (0.0005) [2023-12-26 09:54:54,836][123090] Updated weights for policy 1, policy_version 1283882 (0.0010) [2023-12-26 09:54:54,896][123090] Updated weights for policy 1, policy_version 1283892 (0.0010) [2023-12-26 09:54:54,962][123090] Updated weights for policy 1, policy_version 1283902 (0.0010) [2023-12-26 09:54:54,962][123091] Updated weights for policy 0, policy_version 1293234 (0.0009) [2023-12-26 09:54:55,019][123091] Updated weights for policy 0, policy_version 1293244 (0.0007) [2023-12-26 09:54:55,073][123091] Updated weights for policy 0, policy_version 1293254 (0.0009) [2023-12-26 09:54:55,146][123091] Updated weights for policy 0, policy_version 1293264 (0.0009) [2023-12-26 09:54:55,724][123090] Updated weights for policy 1, policy_version 1283912 (0.0006) [2023-12-26 09:54:55,779][123090] Updated weights for policy 1, policy_version 1283922 (0.0005) [2023-12-26 09:54:55,833][123091] Updated weights for policy 0, policy_version 1293274 (0.0008) [2023-12-26 09:54:55,835][123090] Updated weights for policy 1, policy_version 1283932 (0.0007) [2023-12-26 09:54:55,896][123091] Updated weights for policy 0, policy_version 1293284 (0.0008) [2023-12-26 09:54:55,952][123091] Updated weights for policy 0, policy_version 1293294 (0.0010) [2023-12-26 09:54:56,492][123090] Updated weights for policy 1, policy_version 1283942 (0.0009) [2023-12-26 09:54:56,555][123090] Updated weights for policy 1, policy_version 1283952 (0.0010) [2023-12-26 09:54:56,602][123090] Updated weights for policy 1, policy_version 1283962 (0.0010) [2023-12-26 09:54:56,832][123091] Updated weights for policy 0, policy_version 1293304 (0.0009) [2023-12-26 09:54:56,882][123091] Updated weights for policy 0, policy_version 1293314 (0.0009) [2023-12-26 09:54:56,940][123091] Updated weights for policy 0, policy_version 1293325 (0.0010) [2023-12-26 09:54:57,294][123090] Updated weights for policy 1, policy_version 1283972 (0.0008) [2023-12-26 09:54:57,352][123090] Updated weights for policy 1, policy_version 1283982 (0.0006) [2023-12-26 09:54:57,403][123090] Updated weights for policy 1, policy_version 1283992 (0.0009) [2023-12-26 09:54:57,696][123091] Updated weights for policy 0, policy_version 1293335 (0.0009) [2023-12-26 09:54:57,754][123091] Updated weights for policy 0, policy_version 1293345 (0.0009) [2023-12-26 09:54:57,805][123091] Updated weights for policy 0, policy_version 1293355 (0.0008) [2023-12-26 09:54:58,176][123090] Updated weights for policy 1, policy_version 1284002 (0.0010) [2023-12-26 09:54:58,241][123090] Updated weights for policy 1, policy_version 1284012 (0.0010) [2023-12-26 09:54:58,300][123090] Updated weights for policy 1, policy_version 1284022 (0.0010) [2023-12-26 09:54:58,365][123090] Updated weights for policy 1, policy_version 1284032 (0.0010) [2023-12-26 09:54:58,630][123091] Updated weights for policy 0, policy_version 1293365 (0.0010) [2023-12-26 09:54:58,703][123091] Updated weights for policy 0, policy_version 1293375 (0.0008) [2023-12-26 09:54:58,775][123091] Updated weights for policy 0, policy_version 1293385 (0.0009) [2023-12-26 09:54:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17994.6). Total num frames: 659816448. Throughput: 0: 9237.6, 1: 8793.5. Samples: 659814076. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:54:58,785][121949] Avg episode reward: [(0, '6300.690'), (1, '5350.406')] [2023-12-26 09:54:59,305][123090] Updated weights for policy 1, policy_version 1284042 (0.0011) [2023-12-26 09:54:59,369][123090] Updated weights for policy 1, policy_version 1284052 (0.0010) [2023-12-26 09:54:59,425][123090] Updated weights for policy 1, policy_version 1284062 (0.0010) [2023-12-26 09:54:59,603][123091] Updated weights for policy 0, policy_version 1293395 (0.0007) [2023-12-26 09:54:59,667][123091] Updated weights for policy 0, policy_version 1293405 (0.0006) [2023-12-26 09:54:59,732][123091] Updated weights for policy 0, policy_version 1293415 (0.0006) [2023-12-26 09:55:00,212][123090] Updated weights for policy 1, policy_version 1284072 (0.0010) [2023-12-26 09:55:00,265][123090] Updated weights for policy 1, policy_version 1284083 (0.0010) [2023-12-26 09:55:00,317][123090] Updated weights for policy 1, policy_version 1284093 (0.0009) [2023-12-26 09:55:00,465][123091] Updated weights for policy 0, policy_version 1293425 (0.0005) [2023-12-26 09:55:00,512][123091] Updated weights for policy 0, policy_version 1293435 (0.0006) [2023-12-26 09:55:00,564][123091] Updated weights for policy 0, policy_version 1293445 (0.0005) [2023-12-26 09:55:00,615][123091] Updated weights for policy 0, policy_version 1293455 (0.0007) [2023-12-26 09:55:01,082][123090] Updated weights for policy 1, policy_version 1284103 (0.0008) [2023-12-26 09:55:01,147][123090] Updated weights for policy 1, policy_version 1284113 (0.0007) [2023-12-26 09:55:01,208][123090] Updated weights for policy 1, policy_version 1284123 (0.0005) [2023-12-26 09:55:01,358][123091] Updated weights for policy 0, policy_version 1293465 (0.0010) [2023-12-26 09:55:01,431][123091] Updated weights for policy 0, policy_version 1293475 (0.0011) [2023-12-26 09:55:01,486][123091] Updated weights for policy 0, policy_version 1293485 (0.0010) [2023-12-26 09:55:01,935][123090] Updated weights for policy 1, policy_version 1284133 (0.0005) [2023-12-26 09:55:02,006][123090] Updated weights for policy 1, policy_version 1284143 (0.0008) [2023-12-26 09:55:02,079][123090] Updated weights for policy 1, policy_version 1284153 (0.0005) [2023-12-26 09:55:02,279][123091] Updated weights for policy 0, policy_version 1293495 (0.0007) [2023-12-26 09:55:02,333][123091] Updated weights for policy 0, policy_version 1293505 (0.0006) [2023-12-26 09:55:02,397][123091] Updated weights for policy 0, policy_version 1293515 (0.0008) [2023-12-26 09:55:02,710][123090] Updated weights for policy 1, policy_version 1284163 (0.0007) [2023-12-26 09:55:02,759][123090] Updated weights for policy 1, policy_version 1284173 (0.0005) [2023-12-26 09:55:02,811][123090] Updated weights for policy 1, policy_version 1284183 (0.0005) [2023-12-26 09:55:03,053][123091] Updated weights for policy 0, policy_version 1293525 (0.0008) [2023-12-26 09:55:03,100][123091] Updated weights for policy 0, policy_version 1293535 (0.0005) [2023-12-26 09:55:03,155][123091] Updated weights for policy 0, policy_version 1293545 (0.0010) [2023-12-26 09:55:03,458][123090] Updated weights for policy 1, policy_version 1284193 (0.0005) [2023-12-26 09:55:03,512][123090] Updated weights for policy 1, policy_version 1284203 (0.0005) [2023-12-26 09:55:03,566][123090] Updated weights for policy 1, policy_version 1284213 (0.0007) [2023-12-26 09:55:03,618][123090] Updated weights for policy 1, policy_version 1284223 (0.0010) [2023-12-26 09:55:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.3, 300 sec: 17994.6). Total num frames: 659914752. Throughput: 0: 9235.0, 1: 8872.4. Samples: 659925600. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:55:03,785][121949] Avg episode reward: [(0, '6282.788'), (1, '5129.217')] [2023-12-26 09:55:03,855][123091] Updated weights for policy 0, policy_version 1293555 (0.0010) [2023-12-26 09:55:03,919][123091] Updated weights for policy 0, policy_version 1293565 (0.0007) [2023-12-26 09:55:03,984][123091] Updated weights for policy 0, policy_version 1293575 (0.0008) [2023-12-26 09:55:04,453][123090] Updated weights for policy 1, policy_version 1284233 (0.0010) [2023-12-26 09:55:04,524][123090] Updated weights for policy 1, policy_version 1284243 (0.0011) [2023-12-26 09:55:04,580][123090] Updated weights for policy 1, policy_version 1284253 (0.0010) [2023-12-26 09:55:04,815][123091] Updated weights for policy 0, policy_version 1293585 (0.0009) [2023-12-26 09:55:04,864][123091] Updated weights for policy 0, policy_version 1293595 (0.0009) [2023-12-26 09:55:04,913][123091] Updated weights for policy 0, policy_version 1293605 (0.0008) [2023-12-26 09:55:04,967][123091] Updated weights for policy 0, policy_version 1293615 (0.0010) [2023-12-26 09:55:05,410][123090] Updated weights for policy 1, policy_version 1284263 (0.0010) [2023-12-26 09:55:05,485][123090] Updated weights for policy 1, policy_version 1284273 (0.0007) [2023-12-26 09:55:05,549][123090] Updated weights for policy 1, policy_version 1284283 (0.0009) [2023-12-26 09:55:05,814][123091] Updated weights for policy 0, policy_version 1293625 (0.0005) [2023-12-26 09:55:05,862][123091] Updated weights for policy 0, policy_version 1293635 (0.0005) [2023-12-26 09:55:05,915][123091] Updated weights for policy 0, policy_version 1293645 (0.0005) [2023-12-26 09:55:06,377][123090] Updated weights for policy 1, policy_version 1284293 (0.0009) [2023-12-26 09:55:06,438][123090] Updated weights for policy 1, policy_version 1284303 (0.0010) [2023-12-26 09:55:06,489][123090] Updated weights for policy 1, policy_version 1284313 (0.0010) [2023-12-26 09:55:06,633][123091] Updated weights for policy 0, policy_version 1293655 (0.0008) [2023-12-26 09:55:06,692][123091] Updated weights for policy 0, policy_version 1293665 (0.0009) [2023-12-26 09:55:06,752][123091] Updated weights for policy 0, policy_version 1293676 (0.0008) [2023-12-26 09:55:07,277][123090] Updated weights for policy 1, policy_version 1284323 (0.0008) [2023-12-26 09:55:07,332][123090] Updated weights for policy 1, policy_version 1284333 (0.0005) [2023-12-26 09:55:07,390][123090] Updated weights for policy 1, policy_version 1284343 (0.0005) [2023-12-26 09:55:07,617][123091] Updated weights for policy 0, policy_version 1293686 (0.0008) [2023-12-26 09:55:07,687][123091] Updated weights for policy 0, policy_version 1293696 (0.0009) [2023-12-26 09:55:07,746][123091] Updated weights for policy 0, policy_version 1293706 (0.0008) [2023-12-26 09:55:08,092][123090] Updated weights for policy 1, policy_version 1284353 (0.0006) [2023-12-26 09:55:08,155][123090] Updated weights for policy 1, policy_version 1284363 (0.0007) [2023-12-26 09:55:08,230][123090] Updated weights for policy 1, policy_version 1284373 (0.0005) [2023-12-26 09:55:08,294][123090] Updated weights for policy 1, policy_version 1284383 (0.0005) [2023-12-26 09:55:08,416][123091] Updated weights for policy 0, policy_version 1293716 (0.0008) [2023-12-26 09:55:08,483][123091] Updated weights for policy 0, policy_version 1293726 (0.0008) [2023-12-26 09:55:08,546][123091] Updated weights for policy 0, policy_version 1293736 (0.0008) [2023-12-26 09:55:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18159.0, 300 sec: 18022.4). Total num frames: 660004864. Throughput: 0: 9257.0, 1: 8891.5. Samples: 659977872. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:55:08,785][121949] Avg episode reward: [(0, '6332.134'), (1, '4945.711')] [2023-12-26 09:55:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001293744_331202560.pth... [2023-12-26 09:55:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001284384_328802304.pth... [2023-12-26 09:55:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001292656_330924032.pth [2023-12-26 09:55:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001283328_328531968.pth [2023-12-26 09:55:09,074][123090] Updated weights for policy 1, policy_version 1284393 (0.0009) [2023-12-26 09:55:09,122][123090] Updated weights for policy 1, policy_version 1284403 (0.0008) [2023-12-26 09:55:09,176][123090] Updated weights for policy 1, policy_version 1284413 (0.0006) [2023-12-26 09:55:09,338][123091] Updated weights for policy 0, policy_version 1293746 (0.0008) [2023-12-26 09:55:09,416][123091] Updated weights for policy 0, policy_version 1293756 (0.0009) [2023-12-26 09:55:09,474][123091] Updated weights for policy 0, policy_version 1293766 (0.0011) [2023-12-26 09:55:09,530][123091] Updated weights for policy 0, policy_version 1293776 (0.0011) [2023-12-26 09:55:09,981][123090] Updated weights for policy 1, policy_version 1284423 (0.0007) [2023-12-26 09:55:10,050][123090] Updated weights for policy 1, policy_version 1284433 (0.0011) [2023-12-26 09:55:10,120][123090] Updated weights for policy 1, policy_version 1284443 (0.0008) [2023-12-26 09:55:10,392][123091] Updated weights for policy 0, policy_version 1293786 (0.0006) [2023-12-26 09:55:10,460][123091] Updated weights for policy 0, policy_version 1293796 (0.0008) [2023-12-26 09:55:10,536][123091] Updated weights for policy 0, policy_version 1293806 (0.0008) [2023-12-26 09:55:10,871][123090] Updated weights for policy 1, policy_version 1284453 (0.0008) [2023-12-26 09:55:10,935][123090] Updated weights for policy 1, policy_version 1284463 (0.0006) [2023-12-26 09:55:11,011][123090] Updated weights for policy 1, policy_version 1284473 (0.0006) [2023-12-26 09:55:11,268][123091] Updated weights for policy 0, policy_version 1293816 (0.0009) [2023-12-26 09:55:11,337][123091] Updated weights for policy 0, policy_version 1293826 (0.0006) [2023-12-26 09:55:11,408][123091] Updated weights for policy 0, policy_version 1293836 (0.0009) [2023-12-26 09:55:11,820][123090] Updated weights for policy 1, policy_version 1284483 (0.0008) [2023-12-26 09:55:11,876][123090] Updated weights for policy 1, policy_version 1284493 (0.0006) [2023-12-26 09:55:11,930][123090] Updated weights for policy 1, policy_version 1284503 (0.0005) [2023-12-26 09:55:12,210][123091] Updated weights for policy 0, policy_version 1293846 (0.0011) [2023-12-26 09:55:12,275][123091] Updated weights for policy 0, policy_version 1293856 (0.0011) [2023-12-26 09:55:12,340][123091] Updated weights for policy 0, policy_version 1293866 (0.0011) [2023-12-26 09:55:12,720][123090] Updated weights for policy 1, policy_version 1284513 (0.0009) [2023-12-26 09:55:12,783][123090] Updated weights for policy 1, policy_version 1284523 (0.0010) [2023-12-26 09:55:12,854][123090] Updated weights for policy 1, policy_version 1284533 (0.0007) [2023-12-26 09:55:12,920][123090] Updated weights for policy 1, policy_version 1284543 (0.0011) [2023-12-26 09:55:13,175][123091] Updated weights for policy 0, policy_version 1293876 (0.0011) [2023-12-26 09:55:13,232][123091] Updated weights for policy 0, policy_version 1293886 (0.0006) [2023-12-26 09:55:13,294][123091] Updated weights for policy 0, policy_version 1293896 (0.0005) [2023-12-26 09:55:13,651][123090] Updated weights for policy 1, policy_version 1284553 (0.0009) [2023-12-26 09:55:13,702][123090] Updated weights for policy 1, policy_version 1284563 (0.0010) [2023-12-26 09:55:13,764][123090] Updated weights for policy 1, policy_version 1284573 (0.0010) [2023-12-26 09:55:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 18022.4). Total num frames: 660094976. Throughput: 0: 9192.3, 1: 8840.1. Samples: 660085196. Policy #0 lag: (min: 31.0, avg: 32.0, max: 59.0) [2023-12-26 09:55:13,785][121949] Avg episode reward: [(0, '6352.226'), (1, '4897.962')] [2023-12-26 09:55:14,071][123091] Updated weights for policy 0, policy_version 1293906 (0.0006) [2023-12-26 09:55:14,122][123091] Updated weights for policy 0, policy_version 1293916 (0.0010) [2023-12-26 09:55:14,173][123091] Updated weights for policy 0, policy_version 1293926 (0.0010) [2023-12-26 09:55:14,236][123091] Updated weights for policy 0, policy_version 1293936 (0.0011) [2023-12-26 09:55:14,609][123090] Updated weights for policy 1, policy_version 1284583 (0.0008) [2023-12-26 09:55:14,663][123090] Updated weights for policy 1, policy_version 1284593 (0.0009) [2023-12-26 09:55:14,711][123090] Updated weights for policy 1, policy_version 1284603 (0.0006) [2023-12-26 09:55:15,066][123091] Updated weights for policy 0, policy_version 1293946 (0.0008) [2023-12-26 09:55:15,131][123091] Updated weights for policy 0, policy_version 1293956 (0.0009) [2023-12-26 09:55:15,201][123091] Updated weights for policy 0, policy_version 1293966 (0.0010) [2023-12-26 09:55:15,393][123090] Updated weights for policy 1, policy_version 1284613 (0.0007) [2023-12-26 09:55:15,453][123090] Updated weights for policy 1, policy_version 1284623 (0.0008) [2023-12-26 09:55:15,520][123090] Updated weights for policy 1, policy_version 1284633 (0.0008) [2023-12-26 09:55:15,961][123091] Updated weights for policy 0, policy_version 1293976 (0.0009) [2023-12-26 09:55:16,012][123091] Updated weights for policy 0, policy_version 1293986 (0.0010) [2023-12-26 09:55:16,058][123091] Updated weights for policy 0, policy_version 1293996 (0.0007) [2023-12-26 09:55:16,309][123090] Updated weights for policy 1, policy_version 1284643 (0.0009) [2023-12-26 09:55:16,370][123090] Updated weights for policy 1, policy_version 1284653 (0.0009) [2023-12-26 09:55:16,430][123090] Updated weights for policy 1, policy_version 1284663 (0.0006) [2023-12-26 09:55:16,858][123091] Updated weights for policy 0, policy_version 1294006 (0.0009) [2023-12-26 09:55:16,914][123091] Updated weights for policy 0, policy_version 1294016 (0.0009) [2023-12-26 09:55:16,973][123091] Updated weights for policy 0, policy_version 1294026 (0.0010) [2023-12-26 09:55:17,108][123090] Updated weights for policy 1, policy_version 1284673 (0.0005) [2023-12-26 09:55:17,176][123090] Updated weights for policy 1, policy_version 1284683 (0.0006) [2023-12-26 09:55:17,229][123090] Updated weights for policy 1, policy_version 1284693 (0.0008) [2023-12-26 09:55:17,277][123090] Updated weights for policy 1, policy_version 1284703 (0.0009) [2023-12-26 09:55:17,789][123091] Updated weights for policy 0, policy_version 1294036 (0.0009) [2023-12-26 09:55:17,844][123091] Updated weights for policy 0, policy_version 1294046 (0.0005) [2023-12-26 09:55:17,891][123091] Updated weights for policy 0, policy_version 1294056 (0.0005) [2023-12-26 09:55:17,951][123090] Updated weights for policy 1, policy_version 1284713 (0.0005) [2023-12-26 09:55:17,998][123090] Updated weights for policy 1, policy_version 1284723 (0.0005) [2023-12-26 09:55:18,050][123090] Updated weights for policy 1, policy_version 1284733 (0.0005) [2023-12-26 09:55:18,676][123091] Updated weights for policy 0, policy_version 1294066 (0.0006) [2023-12-26 09:55:18,747][123091] Updated weights for policy 0, policy_version 1294076 (0.0008) [2023-12-26 09:55:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 18022.4, 300 sec: 17994.6). Total num frames: 660176896. Throughput: 0: 9182.8, 1: 8962.4. Samples: 660195040. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:18,785][121949] Avg episode reward: [(0, '6256.449'), (1, '5059.422')] [2023-12-26 09:55:18,790][123090] Updated weights for policy 1, policy_version 1284743 (0.0006) [2023-12-26 09:55:18,811][123091] Updated weights for policy 0, policy_version 1294086 (0.0008) [2023-12-26 09:55:18,859][123090] Updated weights for policy 1, policy_version 1284753 (0.0008) [2023-12-26 09:55:18,877][123091] Updated weights for policy 0, policy_version 1294096 (0.0007) [2023-12-26 09:55:18,928][123090] Updated weights for policy 1, policy_version 1284763 (0.0010) [2023-12-26 09:55:19,620][123091] Updated weights for policy 0, policy_version 1294106 (0.0006) [2023-12-26 09:55:19,688][123091] Updated weights for policy 0, policy_version 1294116 (0.0006) [2023-12-26 09:55:19,724][123090] Updated weights for policy 1, policy_version 1284773 (0.0010) [2023-12-26 09:55:19,744][123091] Updated weights for policy 0, policy_version 1294126 (0.0011) [2023-12-26 09:55:19,780][123090] Updated weights for policy 1, policy_version 1284783 (0.0010) [2023-12-26 09:55:19,849][123090] Updated weights for policy 1, policy_version 1284793 (0.0010) [2023-12-26 09:55:20,502][123091] Updated weights for policy 0, policy_version 1294136 (0.0008) [2023-12-26 09:55:20,578][123091] Updated weights for policy 0, policy_version 1294146 (0.0006) [2023-12-26 09:55:20,637][123091] Updated weights for policy 0, policy_version 1294156 (0.0008) [2023-12-26 09:55:20,699][123090] Updated weights for policy 1, policy_version 1284803 (0.0011) [2023-12-26 09:55:20,772][123090] Updated weights for policy 1, policy_version 1284813 (0.0011) [2023-12-26 09:55:20,844][123090] Updated weights for policy 1, policy_version 1284823 (0.0010) [2023-12-26 09:55:21,414][123091] Updated weights for policy 0, policy_version 1294166 (0.0007) [2023-12-26 09:55:21,463][123091] Updated weights for policy 0, policy_version 1294176 (0.0006) [2023-12-26 09:55:21,519][123091] Updated weights for policy 0, policy_version 1294186 (0.0006) [2023-12-26 09:55:21,680][123090] Updated weights for policy 1, policy_version 1284833 (0.0010) [2023-12-26 09:55:21,757][123090] Updated weights for policy 1, policy_version 1284843 (0.0010) [2023-12-26 09:55:21,829][123090] Updated weights for policy 1, policy_version 1284853 (0.0010) [2023-12-26 09:55:21,897][123090] Updated weights for policy 1, policy_version 1284863 (0.0010) [2023-12-26 09:55:22,254][123091] Updated weights for policy 0, policy_version 1294196 (0.0007) [2023-12-26 09:55:22,324][123091] Updated weights for policy 0, policy_version 1294206 (0.0009) [2023-12-26 09:55:22,393][123091] Updated weights for policy 0, policy_version 1294216 (0.0009) [2023-12-26 09:55:22,746][123090] Updated weights for policy 1, policy_version 1284873 (0.0010) [2023-12-26 09:55:22,810][123090] Updated weights for policy 1, policy_version 1284883 (0.0011) [2023-12-26 09:55:22,878][123090] Updated weights for policy 1, policy_version 1284893 (0.0011) [2023-12-26 09:55:23,060][123091] Updated weights for policy 0, policy_version 1294226 (0.0009) [2023-12-26 09:55:23,131][123091] Updated weights for policy 0, policy_version 1294236 (0.0006) [2023-12-26 09:55:23,193][123091] Updated weights for policy 0, policy_version 1294246 (0.0005) [2023-12-26 09:55:23,247][123091] Updated weights for policy 0, policy_version 1294256 (0.0005) [2023-12-26 09:55:23,710][123090] Updated weights for policy 1, policy_version 1284903 (0.0011) [2023-12-26 09:55:23,769][123090] Updated weights for policy 1, policy_version 1284913 (0.0010) [2023-12-26 09:55:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17994.6). Total num frames: 660267008. Throughput: 0: 9135.3, 1: 8996.8. Samples: 660247604. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:23,784][121949] Avg episode reward: [(0, '6312.527'), (1, '5048.002')] [2023-12-26 09:55:23,823][123091] Updated weights for policy 0, policy_version 1294266 (0.0005) [2023-12-26 09:55:23,833][123090] Updated weights for policy 1, policy_version 1284923 (0.0011) [2023-12-26 09:55:23,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001284928_328941568.pth... [2023-12-26 09:55:23,866][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001283840_328663040.pth [2023-12-26 09:55:23,889][123091] Updated weights for policy 0, policy_version 1294276 (0.0005) [2023-12-26 09:55:23,938][123091] Updated weights for policy 0, policy_version 1294286 (0.0005) [2023-12-26 09:55:23,947][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001294288_331341824.pth... [2023-12-26 09:55:23,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001293200_331063296.pth [2023-12-26 09:55:24,643][123090] Updated weights for policy 1, policy_version 1284933 (0.0011) [2023-12-26 09:55:24,675][123091] Updated weights for policy 0, policy_version 1294296 (0.0008) [2023-12-26 09:55:24,691][123090] Updated weights for policy 1, policy_version 1284943 (0.0010) [2023-12-26 09:55:24,741][123091] Updated weights for policy 0, policy_version 1294306 (0.0007) [2023-12-26 09:55:24,750][123090] Updated weights for policy 1, policy_version 1284953 (0.0011) [2023-12-26 09:55:24,801][123091] Updated weights for policy 0, policy_version 1294316 (0.0007) [2023-12-26 09:55:25,517][123090] Updated weights for policy 1, policy_version 1284963 (0.0010) [2023-12-26 09:55:25,591][123090] Updated weights for policy 1, policy_version 1284973 (0.0010) [2023-12-26 09:55:25,636][123091] Updated weights for policy 0, policy_version 1294326 (0.0008) [2023-12-26 09:55:25,644][123090] Updated weights for policy 1, policy_version 1284983 (0.0007) [2023-12-26 09:55:25,686][123091] Updated weights for policy 0, policy_version 1294336 (0.0009) [2023-12-26 09:55:25,741][123091] Updated weights for policy 0, policy_version 1294346 (0.0010) [2023-12-26 09:55:26,277][123090] Updated weights for policy 1, policy_version 1284993 (0.0005) [2023-12-26 09:55:26,337][123090] Updated weights for policy 1, policy_version 1285003 (0.0005) [2023-12-26 09:55:26,390][123090] Updated weights for policy 1, policy_version 1285013 (0.0005) [2023-12-26 09:55:26,446][123090] Updated weights for policy 1, policy_version 1285023 (0.0006) [2023-12-26 09:55:26,646][123091] Updated weights for policy 0, policy_version 1294356 (0.0010) [2023-12-26 09:55:26,699][123091] Updated weights for policy 0, policy_version 1294367 (0.0010) [2023-12-26 09:55:26,755][123091] Updated weights for policy 0, policy_version 1294378 (0.0010) [2023-12-26 09:55:27,112][123090] Updated weights for policy 1, policy_version 1285033 (0.0005) [2023-12-26 09:55:27,169][123090] Updated weights for policy 1, policy_version 1285043 (0.0006) [2023-12-26 09:55:27,236][123090] Updated weights for policy 1, policy_version 1285053 (0.0005) [2023-12-26 09:55:27,661][123091] Updated weights for policy 0, policy_version 1294388 (0.0010) [2023-12-26 09:55:27,715][123091] Updated weights for policy 0, policy_version 1294398 (0.0008) [2023-12-26 09:55:27,766][123091] Updated weights for policy 0, policy_version 1294408 (0.0009) [2023-12-26 09:55:27,907][123090] Updated weights for policy 1, policy_version 1285063 (0.0005) [2023-12-26 09:55:27,963][123090] Updated weights for policy 1, policy_version 1285073 (0.0008) [2023-12-26 09:55:28,020][123090] Updated weights for policy 1, policy_version 1285083 (0.0006) [2023-12-26 09:55:28,549][123091] Updated weights for policy 0, policy_version 1294418 (0.0008) [2023-12-26 09:55:28,624][123091] Updated weights for policy 0, policy_version 1294428 (0.0005) [2023-12-26 09:55:28,684][123091] Updated weights for policy 0, policy_version 1294438 (0.0005) [2023-12-26 09:55:28,745][123091] Updated weights for policy 0, policy_version 1294448 (0.0007) [2023-12-26 09:55:28,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18158.9, 300 sec: 18022.4). Total num frames: 660365312. Throughput: 0: 9099.4, 1: 9159.7. Samples: 660357996. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:28,785][121949] Avg episode reward: [(0, '6218.099'), (1, '5205.986')] [2023-12-26 09:55:28,849][123090] Updated weights for policy 1, policy_version 1285093 (0.0008) [2023-12-26 09:55:28,896][123090] Updated weights for policy 1, policy_version 1285103 (0.0010) [2023-12-26 09:55:28,949][123090] Updated weights for policy 1, policy_version 1285113 (0.0010) [2023-12-26 09:55:29,512][123091] Updated weights for policy 0, policy_version 1294458 (0.0009) [2023-12-26 09:55:29,566][123091] Updated weights for policy 0, policy_version 1294468 (0.0008) [2023-12-26 09:55:29,622][123091] Updated weights for policy 0, policy_version 1294478 (0.0005) [2023-12-26 09:55:29,766][123090] Updated weights for policy 1, policy_version 1285123 (0.0009) [2023-12-26 09:55:29,837][123090] Updated weights for policy 1, policy_version 1285133 (0.0006) [2023-12-26 09:55:29,909][123090] Updated weights for policy 1, policy_version 1285143 (0.0007) [2023-12-26 09:55:30,483][123091] Updated weights for policy 0, policy_version 1294488 (0.0008) [2023-12-26 09:55:30,545][123091] Updated weights for policy 0, policy_version 1294498 (0.0008) [2023-12-26 09:55:30,599][123090] Updated weights for policy 1, policy_version 1285153 (0.0008) [2023-12-26 09:55:30,605][123091] Updated weights for policy 0, policy_version 1294508 (0.0009) [2023-12-26 09:55:30,666][123090] Updated weights for policy 1, policy_version 1285163 (0.0005) [2023-12-26 09:55:30,717][123090] Updated weights for policy 1, policy_version 1285173 (0.0009) [2023-12-26 09:55:30,768][123090] Updated weights for policy 1, policy_version 1285183 (0.0010) [2023-12-26 09:55:31,489][123091] Updated weights for policy 0, policy_version 1294519 (0.0009) [2023-12-26 09:55:31,534][123090] Updated weights for policy 1, policy_version 1285193 (0.0010) [2023-12-26 09:55:31,553][123091] Updated weights for policy 0, policy_version 1294529 (0.0009) [2023-12-26 09:55:31,595][123090] Updated weights for policy 1, policy_version 1285203 (0.0010) [2023-12-26 09:55:31,619][123091] Updated weights for policy 0, policy_version 1294539 (0.0008) [2023-12-26 09:55:31,659][123090] Updated weights for policy 1, policy_version 1285213 (0.0009) [2023-12-26 09:55:32,448][123090] Updated weights for policy 1, policy_version 1285223 (0.0008) [2023-12-26 09:55:32,508][123091] Updated weights for policy 0, policy_version 1294549 (0.0008) [2023-12-26 09:55:32,523][123090] Updated weights for policy 1, policy_version 1285233 (0.0008) [2023-12-26 09:55:32,575][123091] Updated weights for policy 0, policy_version 1294559 (0.0008) [2023-12-26 09:55:32,581][123090] Updated weights for policy 1, policy_version 1285243 (0.0008) [2023-12-26 09:55:32,636][123091] Updated weights for policy 0, policy_version 1294569 (0.0009) [2023-12-26 09:55:33,377][123090] Updated weights for policy 1, policy_version 1285253 (0.0007) [2023-12-26 09:55:33,422][123090] Updated weights for policy 1, policy_version 1285263 (0.0005) [2023-12-26 09:55:33,450][123091] Updated weights for policy 0, policy_version 1294579 (0.0009) [2023-12-26 09:55:33,469][123090] Updated weights for policy 1, policy_version 1285273 (0.0005) [2023-12-26 09:55:33,502][123091] Updated weights for policy 0, policy_version 1294589 (0.0008) [2023-12-26 09:55:33,552][123091] Updated weights for policy 0, policy_version 1294599 (0.0009) [2023-12-26 09:55:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 18022.4). Total num frames: 660455424. Throughput: 0: 9004.7, 1: 9142.7. Samples: 660464108. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:33,785][121949] Avg episode reward: [(0, '6119.801'), (1, '5396.007')] [2023-12-26 09:55:34,242][123090] Updated weights for policy 1, policy_version 1285283 (0.0007) [2023-12-26 09:55:34,295][123090] Updated weights for policy 1, policy_version 1285293 (0.0009) [2023-12-26 09:55:34,364][123090] Updated weights for policy 1, policy_version 1285303 (0.0009) [2023-12-26 09:55:34,409][123091] Updated weights for policy 0, policy_version 1294609 (0.0009) [2023-12-26 09:55:34,476][123091] Updated weights for policy 0, policy_version 1294619 (0.0005) [2023-12-26 09:55:34,540][123091] Updated weights for policy 0, policy_version 1294629 (0.0009) [2023-12-26 09:55:34,594][123091] Updated weights for policy 0, policy_version 1294639 (0.0009) [2023-12-26 09:55:35,200][123090] Updated weights for policy 1, policy_version 1285313 (0.0008) [2023-12-26 09:55:35,267][123090] Updated weights for policy 1, policy_version 1285323 (0.0006) [2023-12-26 09:55:35,334][123090] Updated weights for policy 1, policy_version 1285333 (0.0008) [2023-12-26 09:55:35,380][123091] Updated weights for policy 0, policy_version 1294649 (0.0007) [2023-12-26 09:55:35,397][123090] Updated weights for policy 1, policy_version 1285343 (0.0007) [2023-12-26 09:55:35,442][123091] Updated weights for policy 0, policy_version 1294659 (0.0008) [2023-12-26 09:55:35,502][123091] Updated weights for policy 0, policy_version 1294669 (0.0008) [2023-12-26 09:55:36,154][123090] Updated weights for policy 1, policy_version 1285353 (0.0008) [2023-12-26 09:55:36,201][123091] Updated weights for policy 0, policy_version 1294679 (0.0007) [2023-12-26 09:55:36,220][123090] Updated weights for policy 1, policy_version 1285363 (0.0005) [2023-12-26 09:55:36,272][123091] Updated weights for policy 0, policy_version 1294689 (0.0006) [2023-12-26 09:55:36,288][123090] Updated weights for policy 1, policy_version 1285373 (0.0006) [2023-12-26 09:55:36,347][123091] Updated weights for policy 0, policy_version 1294699 (0.0009) [2023-12-26 09:55:36,949][123090] Updated weights for policy 1, policy_version 1285383 (0.0009) [2023-12-26 09:55:37,005][123090] Updated weights for policy 1, policy_version 1285393 (0.0010) [2023-12-26 09:55:37,064][123090] Updated weights for policy 1, policy_version 1285403 (0.0010) [2023-12-26 09:55:37,090][123091] Updated weights for policy 0, policy_version 1294709 (0.0008) [2023-12-26 09:55:37,141][123091] Updated weights for policy 0, policy_version 1294719 (0.0006) [2023-12-26 09:55:37,201][123091] Updated weights for policy 0, policy_version 1294729 (0.0005) [2023-12-26 09:55:37,827][123090] Updated weights for policy 1, policy_version 1285413 (0.0008) [2023-12-26 09:55:37,887][123090] Updated weights for policy 1, policy_version 1285423 (0.0006) [2023-12-26 09:55:37,902][123091] Updated weights for policy 0, policy_version 1294739 (0.0007) [2023-12-26 09:55:37,954][123090] Updated weights for policy 1, policy_version 1285433 (0.0007) [2023-12-26 09:55:37,964][123091] Updated weights for policy 0, policy_version 1294749 (0.0010) [2023-12-26 09:55:38,016][123091] Updated weights for policy 0, policy_version 1294759 (0.0010) [2023-12-26 09:55:38,640][123090] Updated weights for policy 1, policy_version 1285443 (0.0007) [2023-12-26 09:55:38,707][123090] Updated weights for policy 1, policy_version 1285453 (0.0009) [2023-12-26 09:55:38,767][123090] Updated weights for policy 1, policy_version 1285463 (0.0008) [2023-12-26 09:55:38,782][123091] Updated weights for policy 0, policy_version 1294769 (0.0010) [2023-12-26 09:55:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 18022.4). Total num frames: 660537344. Throughput: 0: 9014.3, 1: 9156.1. Samples: 660517700. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:38,784][121949] Avg episode reward: [(0, '6201.990'), (1, '5389.210')] [2023-12-26 09:55:38,826][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001285472_329080832.pth... [2023-12-26 09:55:38,831][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001284384_328802304.pth [2023-12-26 09:55:38,848][123091] Updated weights for policy 0, policy_version 1294779 (0.0009) [2023-12-26 09:55:38,903][123091] Updated weights for policy 0, policy_version 1294789 (0.0010) [2023-12-26 09:55:38,953][123091] Updated weights for policy 0, policy_version 1294799 (0.0009) [2023-12-26 09:55:38,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001294800_331472896.pth... [2023-12-26 09:55:38,962][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001293744_331202560.pth [2023-12-26 09:55:39,617][123090] Updated weights for policy 1, policy_version 1285473 (0.0009) [2023-12-26 09:55:39,666][123090] Updated weights for policy 1, policy_version 1285483 (0.0009) [2023-12-26 09:55:39,716][123090] Updated weights for policy 1, policy_version 1285493 (0.0008) [2023-12-26 09:55:39,771][123090] Updated weights for policy 1, policy_version 1285503 (0.0009) [2023-12-26 09:55:39,889][123091] Updated weights for policy 0, policy_version 1294809 (0.0011) [2023-12-26 09:55:39,954][123091] Updated weights for policy 0, policy_version 1294819 (0.0011) [2023-12-26 09:55:40,007][123091] Updated weights for policy 0, policy_version 1294829 (0.0011) [2023-12-26 09:55:40,625][123090] Updated weights for policy 1, policy_version 1285513 (0.0008) [2023-12-26 09:55:40,674][123090] Updated weights for policy 1, policy_version 1285523 (0.0009) [2023-12-26 09:55:40,728][123090] Updated weights for policy 1, policy_version 1285533 (0.0009) [2023-12-26 09:55:40,846][123091] Updated weights for policy 0, policy_version 1294839 (0.0011) [2023-12-26 09:55:40,918][123091] Updated weights for policy 0, policy_version 1294849 (0.0009) [2023-12-26 09:55:40,981][123091] Updated weights for policy 0, policy_version 1294859 (0.0010) [2023-12-26 09:55:41,554][123090] Updated weights for policy 1, policy_version 1285543 (0.0009) [2023-12-26 09:55:41,619][123090] Updated weights for policy 1, policy_version 1285553 (0.0009) [2023-12-26 09:55:41,687][123090] Updated weights for policy 1, policy_version 1285563 (0.0008) [2023-12-26 09:55:41,839][123091] Updated weights for policy 0, policy_version 1294869 (0.0010) [2023-12-26 09:55:41,887][123091] Updated weights for policy 0, policy_version 1294879 (0.0010) [2023-12-26 09:55:41,944][123091] Updated weights for policy 0, policy_version 1294889 (0.0009) [2023-12-26 09:55:42,557][123090] Updated weights for policy 1, policy_version 1285573 (0.0007) [2023-12-26 09:55:42,608][123090] Updated weights for policy 1, policy_version 1285583 (0.0005) [2023-12-26 09:55:42,676][123090] Updated weights for policy 1, policy_version 1285593 (0.0005) [2023-12-26 09:55:42,784][123091] Updated weights for policy 0, policy_version 1294899 (0.0009) [2023-12-26 09:55:42,840][123091] Updated weights for policy 0, policy_version 1294909 (0.0005) [2023-12-26 09:55:42,902][123091] Updated weights for policy 0, policy_version 1294919 (0.0005) [2023-12-26 09:55:43,428][123090] Updated weights for policy 1, policy_version 1285603 (0.0007) [2023-12-26 09:55:43,477][123090] Updated weights for policy 1, policy_version 1285613 (0.0005) [2023-12-26 09:55:43,508][123091] Updated weights for policy 0, policy_version 1294929 (0.0010) [2023-12-26 09:55:43,526][123090] Updated weights for policy 1, policy_version 1285623 (0.0005) [2023-12-26 09:55:43,556][123091] Updated weights for policy 0, policy_version 1294939 (0.0006) [2023-12-26 09:55:43,601][123091] Updated weights for policy 0, policy_version 1294949 (0.0005) [2023-12-26 09:55:43,646][123091] Updated weights for policy 0, policy_version 1294959 (0.0005) [2023-12-26 09:55:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18159.0, 300 sec: 18050.2). Total num frames: 660635648. Throughput: 0: 8919.3, 1: 9059.4. Samples: 660623116. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:43,785][121949] Avg episode reward: [(0, '6140.305'), (1, '5337.525')] [2023-12-26 09:55:44,313][123090] Updated weights for policy 1, policy_version 1285633 (0.0006) [2023-12-26 09:55:44,356][123091] Updated weights for policy 0, policy_version 1294969 (0.0006) [2023-12-26 09:55:44,361][123090] Updated weights for policy 1, policy_version 1285643 (0.0010) [2023-12-26 09:55:44,420][123090] Updated weights for policy 1, policy_version 1285653 (0.0010) [2023-12-26 09:55:44,422][123091] Updated weights for policy 0, policy_version 1294979 (0.0005) [2023-12-26 09:55:44,481][123090] Updated weights for policy 1, policy_version 1285663 (0.0009) [2023-12-26 09:55:44,496][123091] Updated weights for policy 0, policy_version 1294989 (0.0005) [2023-12-26 09:55:45,149][123091] Updated weights for policy 0, policy_version 1294999 (0.0008) [2023-12-26 09:55:45,218][123091] Updated weights for policy 0, policy_version 1295009 (0.0010) [2023-12-26 09:55:45,276][123091] Updated weights for policy 0, policy_version 1295019 (0.0010) [2023-12-26 09:55:45,347][123090] Updated weights for policy 1, policy_version 1285673 (0.0006) [2023-12-26 09:55:45,416][123090] Updated weights for policy 1, policy_version 1285683 (0.0007) [2023-12-26 09:55:45,486][123090] Updated weights for policy 1, policy_version 1285693 (0.0005) [2023-12-26 09:55:46,138][123090] Updated weights for policy 1, policy_version 1285703 (0.0005) [2023-12-26 09:55:46,171][123091] Updated weights for policy 0, policy_version 1295029 (0.0007) [2023-12-26 09:55:46,202][123090] Updated weights for policy 1, policy_version 1285713 (0.0006) [2023-12-26 09:55:46,236][123091] Updated weights for policy 0, policy_version 1295039 (0.0007) [2023-12-26 09:55:46,259][123090] Updated weights for policy 1, policy_version 1285723 (0.0005) [2023-12-26 09:55:46,293][123091] Updated weights for policy 0, policy_version 1295049 (0.0009) [2023-12-26 09:55:46,910][123090] Updated weights for policy 1, policy_version 1285733 (0.0006) [2023-12-26 09:55:46,960][123090] Updated weights for policy 1, policy_version 1285743 (0.0005) [2023-12-26 09:55:47,022][123090] Updated weights for policy 1, policy_version 1285753 (0.0005) [2023-12-26 09:55:47,092][123091] Updated weights for policy 0, policy_version 1295059 (0.0010) [2023-12-26 09:55:47,151][123091] Updated weights for policy 0, policy_version 1295069 (0.0010) [2023-12-26 09:55:47,206][123091] Updated weights for policy 0, policy_version 1295079 (0.0010) [2023-12-26 09:55:47,623][123090] Updated weights for policy 1, policy_version 1285763 (0.0006) [2023-12-26 09:55:47,672][123090] Updated weights for policy 1, policy_version 1285773 (0.0005) [2023-12-26 09:55:47,720][123090] Updated weights for policy 1, policy_version 1285783 (0.0005) [2023-12-26 09:55:48,026][123091] Updated weights for policy 0, policy_version 1295089 (0.0010) [2023-12-26 09:55:48,077][123091] Updated weights for policy 0, policy_version 1295099 (0.0005) [2023-12-26 09:55:48,130][123091] Updated weights for policy 0, policy_version 1295109 (0.0005) [2023-12-26 09:55:48,182][123091] Updated weights for policy 0, policy_version 1295119 (0.0005) [2023-12-26 09:55:48,437][123090] Updated weights for policy 1, policy_version 1285793 (0.0006) [2023-12-26 09:55:48,486][123090] Updated weights for policy 1, policy_version 1285803 (0.0005) [2023-12-26 09:55:48,547][123090] Updated weights for policy 1, policy_version 1285813 (0.0005) [2023-12-26 09:55:48,614][123090] Updated weights for policy 1, policy_version 1285823 (0.0006) [2023-12-26 09:55:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 18050.2). Total num frames: 660725760. Throughput: 0: 8921.1, 1: 9090.2. Samples: 660736104. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:48,785][121949] Avg episode reward: [(0, '6192.527'), (1, '5414.023')] [2023-12-26 09:55:48,919][123091] Updated weights for policy 0, policy_version 1295129 (0.0006) [2023-12-26 09:55:48,979][123091] Updated weights for policy 0, policy_version 1295139 (0.0006) [2023-12-26 09:55:49,030][123091] Updated weights for policy 0, policy_version 1295149 (0.0007) [2023-12-26 09:55:49,401][123090] Updated weights for policy 1, policy_version 1285833 (0.0010) [2023-12-26 09:55:49,473][123090] Updated weights for policy 1, policy_version 1285843 (0.0009) [2023-12-26 09:55:49,531][123090] Updated weights for policy 1, policy_version 1285853 (0.0008) [2023-12-26 09:55:49,795][123091] Updated weights for policy 0, policy_version 1295159 (0.0009) [2023-12-26 09:55:49,868][123091] Updated weights for policy 0, policy_version 1295169 (0.0009) [2023-12-26 09:55:49,933][123091] Updated weights for policy 0, policy_version 1295179 (0.0008) [2023-12-26 09:55:50,359][123090] Updated weights for policy 1, policy_version 1285863 (0.0010) [2023-12-26 09:55:50,411][123090] Updated weights for policy 1, policy_version 1285873 (0.0010) [2023-12-26 09:55:50,479][123090] Updated weights for policy 1, policy_version 1285883 (0.0011) [2023-12-26 09:55:50,694][123091] Updated weights for policy 0, policy_version 1295189 (0.0006) [2023-12-26 09:55:50,757][123091] Updated weights for policy 0, policy_version 1295199 (0.0007) [2023-12-26 09:55:50,818][123091] Updated weights for policy 0, policy_version 1295209 (0.0005) [2023-12-26 09:55:51,323][123090] Updated weights for policy 1, policy_version 1285893 (0.0011) [2023-12-26 09:55:51,391][123090] Updated weights for policy 1, policy_version 1285903 (0.0010) [2023-12-26 09:55:51,463][123090] Updated weights for policy 1, policy_version 1285913 (0.0010) [2023-12-26 09:55:51,525][123091] Updated weights for policy 0, policy_version 1295219 (0.0006) [2023-12-26 09:55:51,580][123091] Updated weights for policy 0, policy_version 1295229 (0.0005) [2023-12-26 09:55:51,644][123091] Updated weights for policy 0, policy_version 1295239 (0.0007) [2023-12-26 09:55:52,270][123090] Updated weights for policy 1, policy_version 1285923 (0.0010) [2023-12-26 09:55:52,335][123090] Updated weights for policy 1, policy_version 1285933 (0.0007) [2023-12-26 09:55:52,412][123090] Updated weights for policy 1, policy_version 1285943 (0.0009) [2023-12-26 09:55:52,480][123091] Updated weights for policy 0, policy_version 1295249 (0.0010) [2023-12-26 09:55:52,549][123091] Updated weights for policy 0, policy_version 1295259 (0.0009) [2023-12-26 09:55:52,613][123091] Updated weights for policy 0, policy_version 1295269 (0.0010) [2023-12-26 09:55:52,675][123091] Updated weights for policy 0, policy_version 1295279 (0.0010) [2023-12-26 09:55:53,208][123090] Updated weights for policy 1, policy_version 1285953 (0.0009) [2023-12-26 09:55:53,270][123090] Updated weights for policy 1, policy_version 1285963 (0.0010) [2023-12-26 09:55:53,317][123090] Updated weights for policy 1, policy_version 1285973 (0.0010) [2023-12-26 09:55:53,363][123090] Updated weights for policy 1, policy_version 1285983 (0.0005) [2023-12-26 09:55:53,533][123091] Updated weights for policy 0, policy_version 1295289 (0.0010) [2023-12-26 09:55:53,586][123091] Updated weights for policy 0, policy_version 1295299 (0.0009) [2023-12-26 09:55:53,647][123091] Updated weights for policy 0, policy_version 1295309 (0.0009) [2023-12-26 09:55:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 18022.4). Total num frames: 660815872. Throughput: 0: 8943.3, 1: 9104.1. Samples: 660790004. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:53,785][121949] Avg episode reward: [(0, '6246.469'), (1, '5447.383')] [2023-12-26 09:55:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001295312_331603968.pth... [2023-12-26 09:55:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001285984_329211904.pth... [2023-12-26 09:55:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001294288_331341824.pth [2023-12-26 09:55:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001284928_328941568.pth [2023-12-26 09:55:54,088][123090] Updated weights for policy 1, policy_version 1285993 (0.0009) [2023-12-26 09:55:54,140][123090] Updated weights for policy 1, policy_version 1286003 (0.0009) [2023-12-26 09:55:54,199][123090] Updated weights for policy 1, policy_version 1286013 (0.0006) [2023-12-26 09:55:54,418][123091] Updated weights for policy 0, policy_version 1295319 (0.0010) [2023-12-26 09:55:54,483][123091] Updated weights for policy 0, policy_version 1295329 (0.0008) [2023-12-26 09:55:54,556][123091] Updated weights for policy 0, policy_version 1295339 (0.0007) [2023-12-26 09:55:55,084][123090] Updated weights for policy 1, policy_version 1286023 (0.0006) [2023-12-26 09:55:55,162][123090] Updated weights for policy 1, policy_version 1286033 (0.0005) [2023-12-26 09:55:55,226][123090] Updated weights for policy 1, policy_version 1286043 (0.0005) [2023-12-26 09:55:55,263][123091] Updated weights for policy 0, policy_version 1295349 (0.0007) [2023-12-26 09:55:55,332][123091] Updated weights for policy 0, policy_version 1295359 (0.0006) [2023-12-26 09:55:55,391][123091] Updated weights for policy 0, policy_version 1295369 (0.0005) [2023-12-26 09:55:56,001][123090] Updated weights for policy 1, policy_version 1286053 (0.0008) [2023-12-26 09:55:56,053][123091] Updated weights for policy 0, policy_version 1295379 (0.0006) [2023-12-26 09:55:56,054][123090] Updated weights for policy 1, policy_version 1286063 (0.0009) [2023-12-26 09:55:56,104][123090] Updated weights for policy 1, policy_version 1286073 (0.0010) [2023-12-26 09:55:56,107][123091] Updated weights for policy 0, policy_version 1295389 (0.0007) [2023-12-26 09:55:56,161][123091] Updated weights for policy 0, policy_version 1295399 (0.0009) [2023-12-26 09:55:56,873][123091] Updated weights for policy 0, policy_version 1295409 (0.0008) [2023-12-26 09:55:56,919][123091] Updated weights for policy 0, policy_version 1295419 (0.0005) [2023-12-26 09:55:56,976][123091] Updated weights for policy 0, policy_version 1295429 (0.0008) [2023-12-26 09:55:57,008][123090] Updated weights for policy 1, policy_version 1286083 (0.0007) [2023-12-26 09:55:57,035][123091] Updated weights for policy 0, policy_version 1295439 (0.0009) [2023-12-26 09:55:57,065][123090] Updated weights for policy 1, policy_version 1286093 (0.0008) [2023-12-26 09:55:57,132][123090] Updated weights for policy 1, policy_version 1286104 (0.0010) [2023-12-26 09:55:57,762][123091] Updated weights for policy 0, policy_version 1295449 (0.0008) [2023-12-26 09:55:57,818][123091] Updated weights for policy 0, policy_version 1295459 (0.0005) [2023-12-26 09:55:57,875][123091] Updated weights for policy 0, policy_version 1295469 (0.0005) [2023-12-26 09:55:57,977][123090] Updated weights for policy 1, policy_version 1286114 (0.0009) [2023-12-26 09:55:58,043][123090] Updated weights for policy 1, policy_version 1286124 (0.0010) [2023-12-26 09:55:58,120][123090] Updated weights for policy 1, policy_version 1286134 (0.0007) [2023-12-26 09:55:58,198][123090] Updated weights for policy 1, policy_version 1286144 (0.0009) [2023-12-26 09:55:58,652][123091] Updated weights for policy 0, policy_version 1295479 (0.0007) [2023-12-26 09:55:58,722][123091] Updated weights for policy 0, policy_version 1295489 (0.0008) [2023-12-26 09:55:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 18022.4). Total num frames: 660897792. Throughput: 0: 9007.8, 1: 9049.4. Samples: 660897772. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:55:58,785][121949] Avg episode reward: [(0, '6314.763'), (1, '5546.728')] [2023-12-26 09:55:58,795][123091] Updated weights for policy 0, policy_version 1295499 (0.0008) [2023-12-26 09:55:59,040][123090] Updated weights for policy 1, policy_version 1286154 (0.0007) [2023-12-26 09:55:59,107][123090] Updated weights for policy 1, policy_version 1286164 (0.0008) [2023-12-26 09:55:59,171][123090] Updated weights for policy 1, policy_version 1286174 (0.0009) [2023-12-26 09:55:59,622][123091] Updated weights for policy 0, policy_version 1295509 (0.0008) [2023-12-26 09:55:59,668][123091] Updated weights for policy 0, policy_version 1295519 (0.0008) [2023-12-26 09:55:59,713][123091] Updated weights for policy 0, policy_version 1295529 (0.0007) [2023-12-26 09:55:59,954][123090] Updated weights for policy 1, policy_version 1286184 (0.0008) [2023-12-26 09:56:00,014][123090] Updated weights for policy 1, policy_version 1286194 (0.0010) [2023-12-26 09:56:00,082][123090] Updated weights for policy 1, policy_version 1286204 (0.0011) [2023-12-26 09:56:00,470][123091] Updated weights for policy 0, policy_version 1295539 (0.0006) [2023-12-26 09:56:00,515][123091] Updated weights for policy 0, policy_version 1295549 (0.0005) [2023-12-26 09:56:00,565][123091] Updated weights for policy 0, policy_version 1295559 (0.0005) [2023-12-26 09:56:00,912][123090] Updated weights for policy 1, policy_version 1286214 (0.0010) [2023-12-26 09:56:00,963][123090] Updated weights for policy 1, policy_version 1286224 (0.0010) [2023-12-26 09:56:01,010][123090] Updated weights for policy 1, policy_version 1286234 (0.0010) [2023-12-26 09:56:01,288][123091] Updated weights for policy 0, policy_version 1295569 (0.0006) [2023-12-26 09:56:01,352][123091] Updated weights for policy 0, policy_version 1295579 (0.0011) [2023-12-26 09:56:01,419][123091] Updated weights for policy 0, policy_version 1295589 (0.0010) [2023-12-26 09:56:01,485][123091] Updated weights for policy 0, policy_version 1295599 (0.0010) [2023-12-26 09:56:01,804][123090] Updated weights for policy 1, policy_version 1286244 (0.0008) [2023-12-26 09:56:01,858][123090] Updated weights for policy 1, policy_version 1286254 (0.0005) [2023-12-26 09:56:01,911][123090] Updated weights for policy 1, policy_version 1286264 (0.0005) [2023-12-26 09:56:02,297][123091] Updated weights for policy 0, policy_version 1295609 (0.0011) [2023-12-26 09:56:02,360][123091] Updated weights for policy 0, policy_version 1295619 (0.0010) [2023-12-26 09:56:02,433][123091] Updated weights for policy 0, policy_version 1295629 (0.0008) [2023-12-26 09:56:02,622][123090] Updated weights for policy 1, policy_version 1286274 (0.0005) [2023-12-26 09:56:02,676][123090] Updated weights for policy 1, policy_version 1286284 (0.0006) [2023-12-26 09:56:02,733][123090] Updated weights for policy 1, policy_version 1286294 (0.0005) [2023-12-26 09:56:02,795][123090] Updated weights for policy 1, policy_version 1286304 (0.0010) [2023-12-26 09:56:03,111][123091] Updated weights for policy 0, policy_version 1295639 (0.0007) [2023-12-26 09:56:03,167][123091] Updated weights for policy 0, policy_version 1295649 (0.0006) [2023-12-26 09:56:03,219][123091] Updated weights for policy 0, policy_version 1295659 (0.0006) [2023-12-26 09:56:03,549][123090] Updated weights for policy 1, policy_version 1286314 (0.0010) [2023-12-26 09:56:03,601][123090] Updated weights for policy 1, policy_version 1286324 (0.0010) [2023-12-26 09:56:03,662][123090] Updated weights for policy 1, policy_version 1286334 (0.0008) [2023-12-26 09:56:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.5, 300 sec: 18077.9). Total num frames: 660996096. Throughput: 0: 9055.6, 1: 8979.8. Samples: 661006628. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:03,784][121949] Avg episode reward: [(0, '6220.428'), (1, '5532.683')] [2023-12-26 09:56:03,923][123091] Updated weights for policy 0, policy_version 1295669 (0.0008) [2023-12-26 09:56:03,990][123091] Updated weights for policy 0, policy_version 1295679 (0.0011) [2023-12-26 09:56:04,057][123091] Updated weights for policy 0, policy_version 1295689 (0.0011) [2023-12-26 09:56:04,436][123090] Updated weights for policy 1, policy_version 1286344 (0.0009) [2023-12-26 09:56:04,500][123090] Updated weights for policy 1, policy_version 1286354 (0.0010) [2023-12-26 09:56:04,559][123090] Updated weights for policy 1, policy_version 1286364 (0.0011) [2023-12-26 09:56:04,829][123091] Updated weights for policy 0, policy_version 1295699 (0.0008) [2023-12-26 09:56:04,897][123091] Updated weights for policy 0, policy_version 1295709 (0.0006) [2023-12-26 09:56:04,966][123091] Updated weights for policy 0, policy_version 1295719 (0.0009) [2023-12-26 09:56:05,401][123090] Updated weights for policy 1, policy_version 1286374 (0.0010) [2023-12-26 09:56:05,459][123090] Updated weights for policy 1, policy_version 1286384 (0.0010) [2023-12-26 09:56:05,529][123090] Updated weights for policy 1, policy_version 1286394 (0.0010) [2023-12-26 09:56:05,573][123091] Updated weights for policy 0, policy_version 1295729 (0.0011) [2023-12-26 09:56:05,642][123091] Updated weights for policy 0, policy_version 1295739 (0.0011) [2023-12-26 09:56:05,702][123091] Updated weights for policy 0, policy_version 1295749 (0.0009) [2023-12-26 09:56:05,765][123091] Updated weights for policy 0, policy_version 1295759 (0.0005) [2023-12-26 09:56:06,379][123090] Updated weights for policy 1, policy_version 1286404 (0.0011) [2023-12-26 09:56:06,444][123090] Updated weights for policy 1, policy_version 1286414 (0.0011) [2023-12-26 09:56:06,483][123091] Updated weights for policy 0, policy_version 1295769 (0.0010) [2023-12-26 09:56:06,508][123090] Updated weights for policy 1, policy_version 1286424 (0.0011) [2023-12-26 09:56:06,548][123091] Updated weights for policy 0, policy_version 1295779 (0.0009) [2023-12-26 09:56:06,620][123091] Updated weights for policy 0, policy_version 1295789 (0.0011) [2023-12-26 09:56:07,335][123090] Updated weights for policy 1, policy_version 1286434 (0.0011) [2023-12-26 09:56:07,354][123091] Updated weights for policy 0, policy_version 1295799 (0.0007) [2023-12-26 09:56:07,386][123090] Updated weights for policy 1, policy_version 1286444 (0.0010) [2023-12-26 09:56:07,417][123091] Updated weights for policy 0, policy_version 1295809 (0.0005) [2023-12-26 09:56:07,446][123090] Updated weights for policy 1, policy_version 1286454 (0.0011) [2023-12-26 09:56:07,475][123091] Updated weights for policy 0, policy_version 1295819 (0.0005) [2023-12-26 09:56:07,494][123090] Updated weights for policy 1, policy_version 1286464 (0.0010) [2023-12-26 09:56:08,101][123091] Updated weights for policy 0, policy_version 1295829 (0.0005) [2023-12-26 09:56:08,173][123091] Updated weights for policy 0, policy_version 1295839 (0.0006) [2023-12-26 09:56:08,238][123091] Updated weights for policy 0, policy_version 1295849 (0.0006) [2023-12-26 09:56:08,344][123090] Updated weights for policy 1, policy_version 1286474 (0.0007) [2023-12-26 09:56:08,420][123090] Updated weights for policy 1, policy_version 1286484 (0.0009) [2023-12-26 09:56:08,491][123090] Updated weights for policy 1, policy_version 1286494 (0.0010) [2023-12-26 09:56:08,784][121949] Fps is (10 sec: 18841.1, 60 sec: 18022.3, 300 sec: 18077.9). Total num frames: 661086208. Throughput: 0: 9084.4, 1: 8986.7. Samples: 661060808. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:08,785][121949] Avg episode reward: [(0, '6117.775'), (1, '5528.212')] [2023-12-26 09:56:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001295856_331743232.pth... [2023-12-26 09:56:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001286496_329342976.pth... [2023-12-26 09:56:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001285472_329080832.pth [2023-12-26 09:56:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001294800_331472896.pth [2023-12-26 09:56:08,923][123091] Updated weights for policy 0, policy_version 1295859 (0.0007) [2023-12-26 09:56:08,989][123091] Updated weights for policy 0, policy_version 1295869 (0.0009) [2023-12-26 09:56:09,040][123091] Updated weights for policy 0, policy_version 1295879 (0.0009) [2023-12-26 09:56:09,352][123090] Updated weights for policy 1, policy_version 1286504 (0.0009) [2023-12-26 09:56:09,430][123090] Updated weights for policy 1, policy_version 1286514 (0.0009) [2023-12-26 09:56:09,510][123090] Updated weights for policy 1, policy_version 1286524 (0.0010) [2023-12-26 09:56:09,848][123091] Updated weights for policy 0, policy_version 1295889 (0.0009) [2023-12-26 09:56:09,925][123091] Updated weights for policy 0, policy_version 1295899 (0.0009) [2023-12-26 09:56:09,986][123091] Updated weights for policy 0, policy_version 1295909 (0.0009) [2023-12-26 09:56:10,051][123091] Updated weights for policy 0, policy_version 1295919 (0.0009) [2023-12-26 09:56:10,359][123090] Updated weights for policy 1, policy_version 1286534 (0.0007) [2023-12-26 09:56:10,430][123090] Updated weights for policy 1, policy_version 1286544 (0.0005) [2023-12-26 09:56:10,491][123090] Updated weights for policy 1, policy_version 1286554 (0.0008) [2023-12-26 09:56:10,894][123091] Updated weights for policy 0, policy_version 1295929 (0.0010) [2023-12-26 09:56:10,946][123091] Updated weights for policy 0, policy_version 1295939 (0.0009) [2023-12-26 09:56:11,003][123091] Updated weights for policy 0, policy_version 1295949 (0.0008) [2023-12-26 09:56:11,304][123090] Updated weights for policy 1, policy_version 1286564 (0.0010) [2023-12-26 09:56:11,368][123090] Updated weights for policy 1, policy_version 1286574 (0.0009) [2023-12-26 09:56:11,447][123090] Updated weights for policy 1, policy_version 1286584 (0.0009) [2023-12-26 09:56:11,922][123091] Updated weights for policy 0, policy_version 1295959 (0.0010) [2023-12-26 09:56:11,982][123091] Updated weights for policy 0, policy_version 1295969 (0.0010) [2023-12-26 09:56:12,035][123091] Updated weights for policy 0, policy_version 1295979 (0.0009) [2023-12-26 09:56:12,254][123090] Updated weights for policy 1, policy_version 1286594 (0.0009) [2023-12-26 09:56:12,321][123090] Updated weights for policy 1, policy_version 1286604 (0.0006) [2023-12-26 09:56:12,391][123090] Updated weights for policy 1, policy_version 1286614 (0.0010) [2023-12-26 09:56:12,459][123090] Updated weights for policy 1, policy_version 1286624 (0.0009) [2023-12-26 09:56:12,928][123091] Updated weights for policy 0, policy_version 1295989 (0.0009) [2023-12-26 09:56:13,014][123091] Updated weights for policy 0, policy_version 1295999 (0.0009) [2023-12-26 09:56:13,087][123091] Updated weights for policy 0, policy_version 1296009 (0.0010) [2023-12-26 09:56:13,159][123090] Updated weights for policy 1, policy_version 1286634 (0.0007) [2023-12-26 09:56:13,230][123090] Updated weights for policy 1, policy_version 1286644 (0.0008) [2023-12-26 09:56:13,296][123090] Updated weights for policy 1, policy_version 1286654 (0.0005) [2023-12-26 09:56:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 18022.4). Total num frames: 661168128. Throughput: 0: 9060.7, 1: 8865.2. Samples: 661164664. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:13,785][121949] Avg episode reward: [(0, '6072.522'), (1, '5407.905')] [2023-12-26 09:56:13,910][123091] Updated weights for policy 0, policy_version 1296019 (0.0008) [2023-12-26 09:56:13,975][123091] Updated weights for policy 0, policy_version 1296029 (0.0005) [2023-12-26 09:56:14,044][123091] Updated weights for policy 0, policy_version 1296039 (0.0005) [2023-12-26 09:56:14,053][123090] Updated weights for policy 1, policy_version 1286664 (0.0008) [2023-12-26 09:56:14,109][123090] Updated weights for policy 1, policy_version 1286674 (0.0009) [2023-12-26 09:56:14,166][123090] Updated weights for policy 1, policy_version 1286684 (0.0009) [2023-12-26 09:56:14,806][123091] Updated weights for policy 0, policy_version 1296049 (0.0007) [2023-12-26 09:56:14,859][123091] Updated weights for policy 0, policy_version 1296059 (0.0010) [2023-12-26 09:56:14,914][123091] Updated weights for policy 0, policy_version 1296069 (0.0009) [2023-12-26 09:56:14,917][123090] Updated weights for policy 1, policy_version 1286694 (0.0007) [2023-12-26 09:56:14,965][123091] Updated weights for policy 0, policy_version 1296079 (0.0009) [2023-12-26 09:56:14,977][123090] Updated weights for policy 1, policy_version 1286704 (0.0006) [2023-12-26 09:56:15,045][123090] Updated weights for policy 1, policy_version 1286714 (0.0010) [2023-12-26 09:56:15,748][123090] Updated weights for policy 1, policy_version 1286724 (0.0008) [2023-12-26 09:56:15,816][123090] Updated weights for policy 1, policy_version 1286734 (0.0009) [2023-12-26 09:56:15,879][123090] Updated weights for policy 1, policy_version 1286744 (0.0007) [2023-12-26 09:56:15,908][123091] Updated weights for policy 0, policy_version 1296089 (0.0009) [2023-12-26 09:56:15,964][123091] Updated weights for policy 0, policy_version 1296099 (0.0010) [2023-12-26 09:56:16,019][123091] Updated weights for policy 0, policy_version 1296110 (0.0010) [2023-12-26 09:56:16,524][123090] Updated weights for policy 1, policy_version 1286754 (0.0007) [2023-12-26 09:56:16,582][123090] Updated weights for policy 1, policy_version 1286764 (0.0010) [2023-12-26 09:56:16,636][123090] Updated weights for policy 1, policy_version 1286774 (0.0010) [2023-12-26 09:56:16,708][123090] Updated weights for policy 1, policy_version 1286784 (0.0006) [2023-12-26 09:56:16,933][123091] Updated weights for policy 0, policy_version 1296120 (0.0010) [2023-12-26 09:56:16,996][123091] Updated weights for policy 0, policy_version 1296130 (0.0009) [2023-12-26 09:56:17,051][123091] Updated weights for policy 0, policy_version 1296141 (0.0010) [2023-12-26 09:56:17,366][123090] Updated weights for policy 1, policy_version 1286794 (0.0005) [2023-12-26 09:56:17,413][123090] Updated weights for policy 1, policy_version 1286804 (0.0005) [2023-12-26 09:56:17,460][123090] Updated weights for policy 1, policy_version 1286814 (0.0006) [2023-12-26 09:56:17,994][123091] Updated weights for policy 0, policy_version 1296151 (0.0010) [2023-12-26 09:56:18,070][123091] Updated weights for policy 0, policy_version 1296161 (0.0010) [2023-12-26 09:56:18,101][123090] Updated weights for policy 1, policy_version 1286824 (0.0006) [2023-12-26 09:56:18,127][123091] Updated weights for policy 0, policy_version 1296171 (0.0008) [2023-12-26 09:56:18,162][123090] Updated weights for policy 1, policy_version 1286834 (0.0009) [2023-12-26 09:56:18,217][123090] Updated weights for policy 1, policy_version 1286844 (0.0006) [2023-12-26 09:56:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 18022.4). Total num frames: 661258240. Throughput: 0: 8994.0, 1: 8968.9. Samples: 661272444. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:18,785][121949] Avg episode reward: [(0, '6223.498'), (1, '5327.817')] [2023-12-26 09:56:18,917][123090] Updated weights for policy 1, policy_version 1286854 (0.0006) [2023-12-26 09:56:18,987][123090] Updated weights for policy 1, policy_version 1286864 (0.0005) [2023-12-26 09:56:19,046][123091] Updated weights for policy 0, policy_version 1296181 (0.0007) [2023-12-26 09:56:19,057][123090] Updated weights for policy 1, policy_version 1286874 (0.0005) [2023-12-26 09:56:19,103][123091] Updated weights for policy 0, policy_version 1296191 (0.0009) [2023-12-26 09:56:19,155][123091] Updated weights for policy 0, policy_version 1296201 (0.0009) [2023-12-26 09:56:19,762][123090] Updated weights for policy 1, policy_version 1286884 (0.0007) [2023-12-26 09:56:19,834][123090] Updated weights for policy 1, policy_version 1286894 (0.0009) [2023-12-26 09:56:19,892][123090] Updated weights for policy 1, policy_version 1286904 (0.0010) [2023-12-26 09:56:19,977][123091] Updated weights for policy 0, policy_version 1296211 (0.0008) [2023-12-26 09:56:20,037][123091] Updated weights for policy 0, policy_version 1296221 (0.0008) [2023-12-26 09:56:20,095][123091] Updated weights for policy 0, policy_version 1296231 (0.0009) [2023-12-26 09:56:20,760][123090] Updated weights for policy 1, policy_version 1286914 (0.0010) [2023-12-26 09:56:20,815][123090] Updated weights for policy 1, policy_version 1286924 (0.0009) [2023-12-26 09:56:20,869][123090] Updated weights for policy 1, policy_version 1286934 (0.0009) [2023-12-26 09:56:20,909][123091] Updated weights for policy 0, policy_version 1296241 (0.0011) [2023-12-26 09:56:20,929][123090] Updated weights for policy 1, policy_version 1286944 (0.0008) [2023-12-26 09:56:20,977][123091] Updated weights for policy 0, policy_version 1296251 (0.0011) [2023-12-26 09:56:21,049][123091] Updated weights for policy 0, policy_version 1296261 (0.0010) [2023-12-26 09:56:21,123][123091] Updated weights for policy 0, policy_version 1296271 (0.0010) [2023-12-26 09:56:21,824][123090] Updated weights for policy 1, policy_version 1286954 (0.0009) [2023-12-26 09:56:21,886][123090] Updated weights for policy 1, policy_version 1286964 (0.0008) [2023-12-26 09:56:21,899][123091] Updated weights for policy 0, policy_version 1296281 (0.0009) [2023-12-26 09:56:21,942][123090] Updated weights for policy 1, policy_version 1286974 (0.0007) [2023-12-26 09:56:21,960][123091] Updated weights for policy 0, policy_version 1296291 (0.0009) [2023-12-26 09:56:22,026][123091] Updated weights for policy 0, policy_version 1296301 (0.0009) [2023-12-26 09:56:22,800][123090] Updated weights for policy 1, policy_version 1286984 (0.0010) [2023-12-26 09:56:22,842][123091] Updated weights for policy 0, policy_version 1296311 (0.0008) [2023-12-26 09:56:22,866][123090] Updated weights for policy 1, policy_version 1286994 (0.0008) [2023-12-26 09:56:22,903][123091] Updated weights for policy 0, policy_version 1296321 (0.0009) [2023-12-26 09:56:22,927][123090] Updated weights for policy 1, policy_version 1287004 (0.0007) [2023-12-26 09:56:22,966][123091] Updated weights for policy 0, policy_version 1296331 (0.0009) [2023-12-26 09:56:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 18022.4). Total num frames: 661340160. Throughput: 0: 8967.2, 1: 8960.6. Samples: 661324452. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:23,785][121949] Avg episode reward: [(0, '6314.684'), (1, '5370.899')] [2023-12-26 09:56:23,786][123091] Updated weights for policy 0, policy_version 1296341 (0.0007) [2023-12-26 09:56:23,788][123090] Updated weights for policy 1, policy_version 1287014 (0.0009) [2023-12-26 09:56:23,848][123091] Updated weights for policy 0, policy_version 1296351 (0.0009) [2023-12-26 09:56:23,849][123090] Updated weights for policy 1, policy_version 1287024 (0.0007) [2023-12-26 09:56:23,906][123090] Updated weights for policy 1, policy_version 1287034 (0.0009) [2023-12-26 09:56:23,906][123091] Updated weights for policy 0, policy_version 1296361 (0.0009) [2023-12-26 09:56:23,938][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001287040_329482240.pth... [2023-12-26 09:56:23,942][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001285984_329211904.pth [2023-12-26 09:56:23,948][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001296368_331874304.pth... [2023-12-26 09:56:23,953][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001295312_331603968.pth [2023-12-26 09:56:24,708][123091] Updated weights for policy 0, policy_version 1296371 (0.0007) [2023-12-26 09:56:24,756][123090] Updated weights for policy 1, policy_version 1287044 (0.0010) [2023-12-26 09:56:24,764][123091] Updated weights for policy 0, policy_version 1296381 (0.0006) [2023-12-26 09:56:24,818][123091] Updated weights for policy 0, policy_version 1296391 (0.0007) [2023-12-26 09:56:24,820][123090] Updated weights for policy 1, policy_version 1287054 (0.0009) [2023-12-26 09:56:24,888][123090] Updated weights for policy 1, policy_version 1287064 (0.0010) [2023-12-26 09:56:25,609][123091] Updated weights for policy 0, policy_version 1296401 (0.0006) [2023-12-26 09:56:25,668][123091] Updated weights for policy 0, policy_version 1296411 (0.0005) [2023-12-26 09:56:25,682][123090] Updated weights for policy 1, policy_version 1287074 (0.0010) [2023-12-26 09:56:25,717][123091] Updated weights for policy 0, policy_version 1296421 (0.0005) [2023-12-26 09:56:25,740][123090] Updated weights for policy 1, policy_version 1287084 (0.0008) [2023-12-26 09:56:25,762][123091] Updated weights for policy 0, policy_version 1296431 (0.0005) [2023-12-26 09:56:25,799][123090] Updated weights for policy 1, policy_version 1287094 (0.0010) [2023-12-26 09:56:25,858][123090] Updated weights for policy 1, policy_version 1287104 (0.0010) [2023-12-26 09:56:26,417][123091] Updated weights for policy 0, policy_version 1296441 (0.0005) [2023-12-26 09:56:26,484][123091] Updated weights for policy 0, policy_version 1296451 (0.0009) [2023-12-26 09:56:26,539][123091] Updated weights for policy 0, policy_version 1296461 (0.0009) [2023-12-26 09:56:26,787][123090] Updated weights for policy 1, policy_version 1287114 (0.0009) [2023-12-26 09:56:26,850][123090] Updated weights for policy 1, policy_version 1287124 (0.0009) [2023-12-26 09:56:26,906][123090] Updated weights for policy 1, policy_version 1287134 (0.0009) [2023-12-26 09:56:27,283][123091] Updated weights for policy 0, policy_version 1296471 (0.0009) [2023-12-26 09:56:27,331][123091] Updated weights for policy 0, policy_version 1296481 (0.0009) [2023-12-26 09:56:27,379][123091] Updated weights for policy 0, policy_version 1296491 (0.0009) [2023-12-26 09:56:27,750][123090] Updated weights for policy 1, policy_version 1287144 (0.0010) [2023-12-26 09:56:27,799][123090] Updated weights for policy 1, policy_version 1287154 (0.0009) [2023-12-26 09:56:27,847][123090] Updated weights for policy 1, policy_version 1287164 (0.0009) [2023-12-26 09:56:28,188][123091] Updated weights for policy 0, policy_version 1296501 (0.0010) [2023-12-26 09:56:28,235][123091] Updated weights for policy 0, policy_version 1296511 (0.0009) [2023-12-26 09:56:28,297][123091] Updated weights for policy 0, policy_version 1296521 (0.0010) [2023-12-26 09:56:28,704][123090] Updated weights for policy 1, policy_version 1287174 (0.0008) [2023-12-26 09:56:28,765][123090] Updated weights for policy 1, policy_version 1287184 (0.0010) [2023-12-26 09:56:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 18022.4). Total num frames: 661430272. Throughput: 0: 9017.2, 1: 8884.3. Samples: 661428688. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:28,785][121949] Avg episode reward: [(0, '6258.741'), (1, '5464.899')] [2023-12-26 09:56:28,828][123090] Updated weights for policy 1, policy_version 1287194 (0.0008) [2023-12-26 09:56:29,060][123091] Updated weights for policy 0, policy_version 1296531 (0.0008) [2023-12-26 09:56:29,110][123091] Updated weights for policy 0, policy_version 1296541 (0.0005) [2023-12-26 09:56:29,166][123091] Updated weights for policy 0, policy_version 1296551 (0.0005) [2023-12-26 09:56:29,647][123090] Updated weights for policy 1, policy_version 1287204 (0.0007) [2023-12-26 09:56:29,706][123090] Updated weights for policy 1, policy_version 1287214 (0.0007) [2023-12-26 09:56:29,754][123090] Updated weights for policy 1, policy_version 1287224 (0.0005) [2023-12-26 09:56:29,992][123091] Updated weights for policy 0, policy_version 1296561 (0.0006) [2023-12-26 09:56:30,045][123091] Updated weights for policy 0, policy_version 1296571 (0.0009) [2023-12-26 09:56:30,094][123091] Updated weights for policy 0, policy_version 1296581 (0.0009) [2023-12-26 09:56:30,150][123091] Updated weights for policy 0, policy_version 1296591 (0.0009) [2023-12-26 09:56:30,519][123090] Updated weights for policy 1, policy_version 1287234 (0.0006) [2023-12-26 09:56:30,581][123090] Updated weights for policy 1, policy_version 1287244 (0.0010) [2023-12-26 09:56:30,640][123090] Updated weights for policy 1, policy_version 1287254 (0.0010) [2023-12-26 09:56:30,701][123090] Updated weights for policy 1, policy_version 1287264 (0.0010) [2023-12-26 09:56:31,009][123091] Updated weights for policy 0, policy_version 1296601 (0.0009) [2023-12-26 09:56:31,068][123091] Updated weights for policy 0, policy_version 1296611 (0.0009) [2023-12-26 09:56:31,122][123091] Updated weights for policy 0, policy_version 1296621 (0.0010) [2023-12-26 09:56:31,498][123090] Updated weights for policy 1, policy_version 1287274 (0.0010) [2023-12-26 09:56:31,563][123090] Updated weights for policy 1, policy_version 1287284 (0.0006) [2023-12-26 09:56:31,635][123090] Updated weights for policy 1, policy_version 1287294 (0.0007) [2023-12-26 09:56:32,005][123091] Updated weights for policy 0, policy_version 1296631 (0.0009) [2023-12-26 09:56:32,060][123091] Updated weights for policy 0, policy_version 1296641 (0.0010) [2023-12-26 09:56:32,118][123091] Updated weights for policy 0, policy_version 1296651 (0.0010) [2023-12-26 09:56:32,425][123090] Updated weights for policy 1, policy_version 1287304 (0.0009) [2023-12-26 09:56:32,485][123090] Updated weights for policy 1, policy_version 1287314 (0.0010) [2023-12-26 09:56:32,541][123090] Updated weights for policy 1, policy_version 1287324 (0.0009) [2023-12-26 09:56:32,960][123091] Updated weights for policy 0, policy_version 1296661 (0.0010) [2023-12-26 09:56:33,010][123091] Updated weights for policy 0, policy_version 1296671 (0.0009) [2023-12-26 09:56:33,060][123091] Updated weights for policy 0, policy_version 1296681 (0.0009) [2023-12-26 09:56:33,378][123090] Updated weights for policy 1, policy_version 1287334 (0.0009) [2023-12-26 09:56:33,430][123090] Updated weights for policy 1, policy_version 1287344 (0.0009) [2023-12-26 09:56:33,489][123090] Updated weights for policy 1, policy_version 1287354 (0.0008) [2023-12-26 09:56:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17994.6). Total num frames: 661520384. Throughput: 0: 8930.4, 1: 8768.5. Samples: 661532556. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:33,785][121949] Avg episode reward: [(0, '6241.197'), (1, '5700.031')] [2023-12-26 09:56:33,834][123091] Updated weights for policy 0, policy_version 1296691 (0.0009) [2023-12-26 09:56:33,888][123091] Updated weights for policy 0, policy_version 1296701 (0.0005) [2023-12-26 09:56:33,947][123091] Updated weights for policy 0, policy_version 1296711 (0.0006) [2023-12-26 09:56:34,323][123090] Updated weights for policy 1, policy_version 1287364 (0.0010) [2023-12-26 09:56:34,394][123090] Updated weights for policy 1, policy_version 1287374 (0.0009) [2023-12-26 09:56:34,464][123090] Updated weights for policy 1, policy_version 1287384 (0.0009) [2023-12-26 09:56:34,573][123091] Updated weights for policy 0, policy_version 1296721 (0.0006) [2023-12-26 09:56:34,638][123091] Updated weights for policy 0, policy_version 1296731 (0.0010) [2023-12-26 09:56:34,700][123091] Updated weights for policy 0, policy_version 1296741 (0.0010) [2023-12-26 09:56:34,758][123091] Updated weights for policy 0, policy_version 1296751 (0.0010) [2023-12-26 09:56:35,310][123090] Updated weights for policy 1, policy_version 1287394 (0.0009) [2023-12-26 09:56:35,363][123090] Updated weights for policy 1, policy_version 1287404 (0.0010) [2023-12-26 09:56:35,414][123090] Updated weights for policy 1, policy_version 1287414 (0.0009) [2023-12-26 09:56:35,450][123091] Updated weights for policy 0, policy_version 1296761 (0.0007) [2023-12-26 09:56:35,471][123090] Updated weights for policy 1, policy_version 1287424 (0.0009) [2023-12-26 09:56:35,510][123091] Updated weights for policy 0, policy_version 1296771 (0.0009) [2023-12-26 09:56:35,572][123091] Updated weights for policy 0, policy_version 1296781 (0.0009) [2023-12-26 09:56:36,328][123090] Updated weights for policy 1, policy_version 1287434 (0.0009) [2023-12-26 09:56:36,397][123090] Updated weights for policy 1, policy_version 1287444 (0.0010) [2023-12-26 09:56:36,413][123091] Updated weights for policy 0, policy_version 1296791 (0.0006) [2023-12-26 09:56:36,472][123090] Updated weights for policy 1, policy_version 1287454 (0.0009) [2023-12-26 09:56:36,485][123091] Updated weights for policy 0, policy_version 1296801 (0.0007) [2023-12-26 09:56:36,542][123091] Updated weights for policy 0, policy_version 1296811 (0.0010) [2023-12-26 09:56:37,299][123090] Updated weights for policy 1, policy_version 1287464 (0.0009) [2023-12-26 09:56:37,346][123091] Updated weights for policy 0, policy_version 1296821 (0.0009) [2023-12-26 09:56:37,366][123090] Updated weights for policy 1, policy_version 1287474 (0.0009) [2023-12-26 09:56:37,402][123091] Updated weights for policy 0, policy_version 1296831 (0.0008) [2023-12-26 09:56:37,422][123090] Updated weights for policy 1, policy_version 1287484 (0.0007) [2023-12-26 09:56:37,456][123091] Updated weights for policy 0, policy_version 1296841 (0.0009) [2023-12-26 09:56:38,248][123090] Updated weights for policy 1, policy_version 1287494 (0.0008) [2023-12-26 09:56:38,299][123090] Updated weights for policy 1, policy_version 1287505 (0.0010) [2023-12-26 09:56:38,311][123091] Updated weights for policy 0, policy_version 1296851 (0.0008) [2023-12-26 09:56:38,364][123090] Updated weights for policy 1, policy_version 1287515 (0.0007) [2023-12-26 09:56:38,378][123091] Updated weights for policy 0, policy_version 1296861 (0.0010) [2023-12-26 09:56:38,431][123091] Updated weights for policy 0, policy_version 1296871 (0.0009) [2023-12-26 09:56:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 18022.4). Total num frames: 661610496. Throughput: 0: 8915.9, 1: 8757.6. Samples: 661585312. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:38,785][121949] Avg episode reward: [(0, '6260.044'), (1, '5719.295')] [2023-12-26 09:56:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001296880_332005376.pth... [2023-12-26 09:56:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001287520_329605120.pth... [2023-12-26 09:56:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001295856_331743232.pth [2023-12-26 09:56:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001286496_329342976.pth [2023-12-26 09:56:39,153][123090] Updated weights for policy 1, policy_version 1287525 (0.0006) [2023-12-26 09:56:39,199][123090] Updated weights for policy 1, policy_version 1287535 (0.0005) [2023-12-26 09:56:39,263][123090] Updated weights for policy 1, policy_version 1287545 (0.0009) [2023-12-26 09:56:39,352][123091] Updated weights for policy 0, policy_version 1296881 (0.0010) [2023-12-26 09:56:39,419][123091] Updated weights for policy 0, policy_version 1296891 (0.0009) [2023-12-26 09:56:39,472][123091] Updated weights for policy 0, policy_version 1296901 (0.0008) [2023-12-26 09:56:39,541][123091] Updated weights for policy 0, policy_version 1296911 (0.0009) [2023-12-26 09:56:40,082][123090] Updated weights for policy 1, policy_version 1287555 (0.0010) [2023-12-26 09:56:40,154][123090] Updated weights for policy 1, policy_version 1287565 (0.0008) [2023-12-26 09:56:40,220][123090] Updated weights for policy 1, policy_version 1287575 (0.0009) [2023-12-26 09:56:40,470][123091] Updated weights for policy 0, policy_version 1296921 (0.0010) [2023-12-26 09:56:40,532][123091] Updated weights for policy 0, policy_version 1296931 (0.0009) [2023-12-26 09:56:40,589][123091] Updated weights for policy 0, policy_version 1296941 (0.0009) [2023-12-26 09:56:41,033][123090] Updated weights for policy 1, policy_version 1287585 (0.0010) [2023-12-26 09:56:41,104][123090] Updated weights for policy 1, policy_version 1287595 (0.0007) [2023-12-26 09:56:41,179][123090] Updated weights for policy 1, policy_version 1287605 (0.0008) [2023-12-26 09:56:41,245][123090] Updated weights for policy 1, policy_version 1287615 (0.0006) [2023-12-26 09:56:41,493][123091] Updated weights for policy 0, policy_version 1296951 (0.0009) [2023-12-26 09:56:41,545][123091] Updated weights for policy 0, policy_version 1296962 (0.0010) [2023-12-26 09:56:41,616][123091] Updated weights for policy 0, policy_version 1296972 (0.0009) [2023-12-26 09:56:42,050][123090] Updated weights for policy 1, policy_version 1287625 (0.0009) [2023-12-26 09:56:42,123][123090] Updated weights for policy 1, policy_version 1287635 (0.0008) [2023-12-26 09:56:42,188][123090] Updated weights for policy 1, policy_version 1287645 (0.0009) [2023-12-26 09:56:42,528][123091] Updated weights for policy 0, policy_version 1296982 (0.0009) [2023-12-26 09:56:42,581][123091] Updated weights for policy 0, policy_version 1296992 (0.0009) [2023-12-26 09:56:42,635][123091] Updated weights for policy 0, policy_version 1297002 (0.0009) [2023-12-26 09:56:43,011][123090] Updated weights for policy 1, policy_version 1287655 (0.0006) [2023-12-26 09:56:43,066][123090] Updated weights for policy 1, policy_version 1287665 (0.0006) [2023-12-26 09:56:43,114][123090] Updated weights for policy 1, policy_version 1287675 (0.0005) [2023-12-26 09:56:43,481][123091] Updated weights for policy 0, policy_version 1297012 (0.0008) [2023-12-26 09:56:43,547][123091] Updated weights for policy 0, policy_version 1297022 (0.0005) [2023-12-26 09:56:43,622][123091] Updated weights for policy 0, policy_version 1297032 (0.0005) [2023-12-26 09:56:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17966.9). Total num frames: 661692416. Throughput: 0: 8767.3, 1: 8744.7. Samples: 661685812. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:43,785][121949] Avg episode reward: [(0, '6233.697'), (1, '5761.394')] [2023-12-26 09:56:43,875][123090] Updated weights for policy 1, policy_version 1287685 (0.0005) [2023-12-26 09:56:43,946][123090] Updated weights for policy 1, policy_version 1287695 (0.0005) [2023-12-26 09:56:44,014][123090] Updated weights for policy 1, policy_version 1287705 (0.0006) [2023-12-26 09:56:44,274][123091] Updated weights for policy 0, policy_version 1297042 (0.0005) [2023-12-26 09:56:44,326][123091] Updated weights for policy 0, policy_version 1297052 (0.0005) [2023-12-26 09:56:44,389][123091] Updated weights for policy 0, policy_version 1297062 (0.0006) [2023-12-26 09:56:44,439][123091] Updated weights for policy 0, policy_version 1297072 (0.0007) [2023-12-26 09:56:44,609][123090] Updated weights for policy 1, policy_version 1287715 (0.0007) [2023-12-26 09:56:44,669][123090] Updated weights for policy 1, policy_version 1287725 (0.0010) [2023-12-26 09:56:44,724][123090] Updated weights for policy 1, policy_version 1287735 (0.0009) [2023-12-26 09:56:45,013][123091] Updated weights for policy 0, policy_version 1297082 (0.0007) [2023-12-26 09:56:45,076][123091] Updated weights for policy 0, policy_version 1297092 (0.0010) [2023-12-26 09:56:45,150][123091] Updated weights for policy 0, policy_version 1297102 (0.0006) [2023-12-26 09:56:45,642][123090] Updated weights for policy 1, policy_version 1287745 (0.0008) [2023-12-26 09:56:45,700][123090] Updated weights for policy 1, policy_version 1287755 (0.0009) [2023-12-26 09:56:45,759][123090] Updated weights for policy 1, policy_version 1287765 (0.0010) [2023-12-26 09:56:45,828][123090] Updated weights for policy 1, policy_version 1287775 (0.0009) [2023-12-26 09:56:45,869][123091] Updated weights for policy 0, policy_version 1297112 (0.0006) [2023-12-26 09:56:45,933][123091] Updated weights for policy 0, policy_version 1297122 (0.0008) [2023-12-26 09:56:45,983][123091] Updated weights for policy 0, policy_version 1297132 (0.0005) [2023-12-26 09:56:46,537][123090] Updated weights for policy 1, policy_version 1287785 (0.0006) [2023-12-26 09:56:46,604][123090] Updated weights for policy 1, policy_version 1287795 (0.0005) [2023-12-26 09:56:46,641][123091] Updated weights for policy 0, policy_version 1297142 (0.0006) [2023-12-26 09:56:46,677][123090] Updated weights for policy 1, policy_version 1287805 (0.0005) [2023-12-26 09:56:46,697][123091] Updated weights for policy 0, policy_version 1297152 (0.0005) [2023-12-26 09:56:46,743][123091] Updated weights for policy 0, policy_version 1297162 (0.0005) [2023-12-26 09:56:47,260][123090] Updated weights for policy 1, policy_version 1287815 (0.0008) [2023-12-26 09:56:47,308][123090] Updated weights for policy 1, policy_version 1287825 (0.0009) [2023-12-26 09:56:47,357][123090] Updated weights for policy 1, policy_version 1287835 (0.0008) [2023-12-26 09:56:47,413][123091] Updated weights for policy 0, policy_version 1297172 (0.0005) [2023-12-26 09:56:47,475][123091] Updated weights for policy 0, policy_version 1297182 (0.0006) [2023-12-26 09:56:47,525][123091] Updated weights for policy 0, policy_version 1297192 (0.0009) [2023-12-26 09:56:48,187][123090] Updated weights for policy 1, policy_version 1287845 (0.0007) [2023-12-26 09:56:48,243][123090] Updated weights for policy 1, policy_version 1287855 (0.0005) [2023-12-26 09:56:48,296][123090] Updated weights for policy 1, policy_version 1287865 (0.0005) [2023-12-26 09:56:48,389][123091] Updated weights for policy 0, policy_version 1297202 (0.0010) [2023-12-26 09:56:48,461][123091] Updated weights for policy 0, policy_version 1297212 (0.0009) [2023-12-26 09:56:48,532][123091] Updated weights for policy 0, policy_version 1297222 (0.0009) [2023-12-26 09:56:48,589][123091] Updated weights for policy 0, policy_version 1297232 (0.0009) [2023-12-26 09:56:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 18022.4). Total num frames: 661790720. Throughput: 0: 8824.9, 1: 8805.8. Samples: 661800008. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:48,784][121949] Avg episode reward: [(0, '6211.377'), (1, '5735.567')] [2023-12-26 09:56:49,041][123090] Updated weights for policy 1, policy_version 1287875 (0.0007) [2023-12-26 09:56:49,115][123090] Updated weights for policy 1, policy_version 1287885 (0.0008) [2023-12-26 09:56:49,191][123090] Updated weights for policy 1, policy_version 1287895 (0.0007) [2023-12-26 09:56:49,509][123091] Updated weights for policy 0, policy_version 1297242 (0.0009) [2023-12-26 09:56:49,569][123091] Updated weights for policy 0, policy_version 1297252 (0.0010) [2023-12-26 09:56:49,624][123091] Updated weights for policy 0, policy_version 1297262 (0.0010) [2023-12-26 09:56:49,979][123090] Updated weights for policy 1, policy_version 1287905 (0.0009) [2023-12-26 09:56:50,036][123090] Updated weights for policy 1, policy_version 1287915 (0.0010) [2023-12-26 09:56:50,105][123090] Updated weights for policy 1, policy_version 1287925 (0.0010) [2023-12-26 09:56:50,170][123090] Updated weights for policy 1, policy_version 1287935 (0.0010) [2023-12-26 09:56:50,469][123091] Updated weights for policy 0, policy_version 1297272 (0.0009) [2023-12-26 09:56:50,531][123091] Updated weights for policy 0, policy_version 1297282 (0.0009) [2023-12-26 09:56:50,597][123091] Updated weights for policy 0, policy_version 1297292 (0.0010) [2023-12-26 09:56:50,995][123090] Updated weights for policy 1, policy_version 1287945 (0.0010) [2023-12-26 09:56:51,069][123090] Updated weights for policy 1, policy_version 1287955 (0.0010) [2023-12-26 09:56:51,129][123090] Updated weights for policy 1, policy_version 1287965 (0.0009) [2023-12-26 09:56:51,495][123091] Updated weights for policy 0, policy_version 1297302 (0.0009) [2023-12-26 09:56:51,552][123091] Updated weights for policy 0, policy_version 1297312 (0.0009) [2023-12-26 09:56:51,602][123091] Updated weights for policy 0, policy_version 1297322 (0.0009) [2023-12-26 09:56:51,935][123090] Updated weights for policy 1, policy_version 1287975 (0.0007) [2023-12-26 09:56:51,997][123090] Updated weights for policy 1, policy_version 1287985 (0.0009) [2023-12-26 09:56:52,059][123090] Updated weights for policy 1, policy_version 1287995 (0.0009) [2023-12-26 09:56:52,493][123091] Updated weights for policy 0, policy_version 1297332 (0.0010) [2023-12-26 09:56:52,546][123091] Updated weights for policy 0, policy_version 1297342 (0.0010) [2023-12-26 09:56:52,605][123091] Updated weights for policy 0, policy_version 1297352 (0.0010) [2023-12-26 09:56:52,823][123090] Updated weights for policy 1, policy_version 1288005 (0.0008) [2023-12-26 09:56:52,888][123090] Updated weights for policy 1, policy_version 1288015 (0.0007) [2023-12-26 09:56:52,960][123090] Updated weights for policy 1, policy_version 1288025 (0.0008) [2023-12-26 09:56:53,490][123091] Updated weights for policy 0, policy_version 1297362 (0.0010) [2023-12-26 09:56:53,546][123091] Updated weights for policy 0, policy_version 1297372 (0.0009) [2023-12-26 09:56:53,592][123090] Updated weights for policy 1, policy_version 1288035 (0.0009) [2023-12-26 09:56:53,611][123091] Updated weights for policy 0, policy_version 1297383 (0.0008) [2023-12-26 09:56:53,656][123090] Updated weights for policy 1, policy_version 1288045 (0.0008) [2023-12-26 09:56:53,706][123090] Updated weights for policy 1, policy_version 1288055 (0.0010) [2023-12-26 09:56:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.2, 300 sec: 17994.6). Total num frames: 661880832. Throughput: 0: 8721.9, 1: 8820.3. Samples: 661850204. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:53,785][121949] Avg episode reward: [(0, '6269.048'), (1, '5688.971')] [2023-12-26 09:56:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001297392_332136448.pth... [2023-12-26 09:56:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001288064_329744384.pth... [2023-12-26 09:56:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001287040_329482240.pth [2023-12-26 09:56:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001296368_331874304.pth [2023-12-26 09:56:54,454][123091] Updated weights for policy 0, policy_version 1297393 (0.0009) [2023-12-26 09:56:54,516][123090] Updated weights for policy 1, policy_version 1288065 (0.0010) [2023-12-26 09:56:54,518][123091] Updated weights for policy 0, policy_version 1297403 (0.0009) [2023-12-26 09:56:54,568][123090] Updated weights for policy 1, policy_version 1288075 (0.0007) [2023-12-26 09:56:54,577][123091] Updated weights for policy 0, policy_version 1297413 (0.0009) [2023-12-26 09:56:54,620][123090] Updated weights for policy 1, policy_version 1288085 (0.0005) [2023-12-26 09:56:54,643][123091] Updated weights for policy 0, policy_version 1297423 (0.0009) [2023-12-26 09:56:54,670][123090] Updated weights for policy 1, policy_version 1288095 (0.0008) [2023-12-26 09:56:55,449][123090] Updated weights for policy 1, policy_version 1288105 (0.0007) [2023-12-26 09:56:55,515][123090] Updated weights for policy 1, policy_version 1288115 (0.0009) [2023-12-26 09:56:55,517][123091] Updated weights for policy 0, policy_version 1297433 (0.0007) [2023-12-26 09:56:55,571][123090] Updated weights for policy 1, policy_version 1288125 (0.0008) [2023-12-26 09:56:55,573][123091] Updated weights for policy 0, policy_version 1297443 (0.0009) [2023-12-26 09:56:55,629][123091] Updated weights for policy 0, policy_version 1297453 (0.0010) [2023-12-26 09:56:56,376][123090] Updated weights for policy 1, policy_version 1288135 (0.0008) [2023-12-26 09:56:56,435][123090] Updated weights for policy 1, policy_version 1288145 (0.0009) [2023-12-26 09:56:56,473][123091] Updated weights for policy 0, policy_version 1297463 (0.0008) [2023-12-26 09:56:56,493][123090] Updated weights for policy 1, policy_version 1288155 (0.0009) [2023-12-26 09:56:56,524][123091] Updated weights for policy 0, policy_version 1297473 (0.0008) [2023-12-26 09:56:56,584][123091] Updated weights for policy 0, policy_version 1297483 (0.0009) [2023-12-26 09:56:57,208][123090] Updated weights for policy 1, policy_version 1288165 (0.0007) [2023-12-26 09:56:57,268][123090] Updated weights for policy 1, policy_version 1288175 (0.0005) [2023-12-26 09:56:57,332][123090] Updated weights for policy 1, policy_version 1288185 (0.0005) [2023-12-26 09:56:57,432][123091] Updated weights for policy 0, policy_version 1297494 (0.0010) [2023-12-26 09:56:57,484][123091] Updated weights for policy 0, policy_version 1297504 (0.0009) [2023-12-26 09:56:57,540][123091] Updated weights for policy 0, policy_version 1297514 (0.0009) [2023-12-26 09:56:58,019][123090] Updated weights for policy 1, policy_version 1288195 (0.0005) [2023-12-26 09:56:58,086][123090] Updated weights for policy 1, policy_version 1288205 (0.0007) [2023-12-26 09:56:58,149][123090] Updated weights for policy 1, policy_version 1288215 (0.0008) [2023-12-26 09:56:58,444][123091] Updated weights for policy 0, policy_version 1297524 (0.0009) [2023-12-26 09:56:58,513][123091] Updated weights for policy 0, policy_version 1297534 (0.0008) [2023-12-26 09:56:58,584][123091] Updated weights for policy 0, policy_version 1297544 (0.0008) [2023-12-26 09:56:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17966.9). Total num frames: 661962752. Throughput: 0: 8625.9, 1: 8951.5. Samples: 661955644. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:56:58,785][121949] Avg episode reward: [(0, '6255.163'), (1, '5634.043')] [2023-12-26 09:56:58,951][123090] Updated weights for policy 1, policy_version 1288225 (0.0008) [2023-12-26 09:56:58,998][123090] Updated weights for policy 1, policy_version 1288235 (0.0010) [2023-12-26 09:56:59,059][123090] Updated weights for policy 1, policy_version 1288245 (0.0007) [2023-12-26 09:56:59,120][123090] Updated weights for policy 1, policy_version 1288255 (0.0010) [2023-12-26 09:56:59,413][123091] Updated weights for policy 0, policy_version 1297554 (0.0008) [2023-12-26 09:56:59,478][123091] Updated weights for policy 0, policy_version 1297564 (0.0009) [2023-12-26 09:56:59,531][123091] Updated weights for policy 0, policy_version 1297574 (0.0009) [2023-12-26 09:56:59,585][123091] Updated weights for policy 0, policy_version 1297584 (0.0009) [2023-12-26 09:56:59,880][123090] Updated weights for policy 1, policy_version 1288265 (0.0010) [2023-12-26 09:56:59,947][123090] Updated weights for policy 1, policy_version 1288275 (0.0011) [2023-12-26 09:57:00,002][123090] Updated weights for policy 1, policy_version 1288285 (0.0010) [2023-12-26 09:57:00,401][123091] Updated weights for policy 0, policy_version 1297594 (0.0006) [2023-12-26 09:57:00,457][123091] Updated weights for policy 0, policy_version 1297604 (0.0007) [2023-12-26 09:57:00,503][123091] Updated weights for policy 0, policy_version 1297614 (0.0005) [2023-12-26 09:57:00,713][123090] Updated weights for policy 1, policy_version 1288295 (0.0007) [2023-12-26 09:57:00,757][123090] Updated weights for policy 1, policy_version 1288305 (0.0005) [2023-12-26 09:57:00,815][123090] Updated weights for policy 1, policy_version 1288315 (0.0007) [2023-12-26 09:57:01,176][123091] Updated weights for policy 0, policy_version 1297624 (0.0006) [2023-12-26 09:57:01,239][123091] Updated weights for policy 0, policy_version 1297634 (0.0007) [2023-12-26 09:57:01,308][123091] Updated weights for policy 0, policy_version 1297644 (0.0008) [2023-12-26 09:57:01,647][123090] Updated weights for policy 1, policy_version 1288325 (0.0009) [2023-12-26 09:57:01,699][123090] Updated weights for policy 1, policy_version 1288335 (0.0010) [2023-12-26 09:57:01,766][123090] Updated weights for policy 1, policy_version 1288345 (0.0008) [2023-12-26 09:57:02,141][123091] Updated weights for policy 0, policy_version 1297654 (0.0010) [2023-12-26 09:57:02,189][123091] Updated weights for policy 0, policy_version 1297664 (0.0009) [2023-12-26 09:57:02,240][123091] Updated weights for policy 0, policy_version 1297674 (0.0009) [2023-12-26 09:57:02,536][123090] Updated weights for policy 1, policy_version 1288355 (0.0006) [2023-12-26 09:57:02,585][123090] Updated weights for policy 1, policy_version 1288365 (0.0005) [2023-12-26 09:57:02,641][123090] Updated weights for policy 1, policy_version 1288375 (0.0006) [2023-12-26 09:57:03,117][123091] Updated weights for policy 0, policy_version 1297684 (0.0010) [2023-12-26 09:57:03,168][123091] Updated weights for policy 0, policy_version 1297695 (0.0009) [2023-12-26 09:57:03,224][123091] Updated weights for policy 0, policy_version 1297705 (0.0010) [2023-12-26 09:57:03,444][123090] Updated weights for policy 1, policy_version 1288385 (0.0009) [2023-12-26 09:57:03,505][123090] Updated weights for policy 1, policy_version 1288395 (0.0008) [2023-12-26 09:57:03,575][123090] Updated weights for policy 1, policy_version 1288405 (0.0009) [2023-12-26 09:57:03,631][123090] Updated weights for policy 1, policy_version 1288415 (0.0008) [2023-12-26 09:57:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17994.6). Total num frames: 662052864. Throughput: 0: 8711.2, 1: 8847.7. Samples: 662062592. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:57:03,785][121949] Avg episode reward: [(0, '6233.091'), (1, '5608.105')] [2023-12-26 09:57:04,069][123091] Updated weights for policy 0, policy_version 1297716 (0.0009) [2023-12-26 09:57:04,137][123091] Updated weights for policy 0, policy_version 1297726 (0.0009) [2023-12-26 09:57:04,205][123091] Updated weights for policy 0, policy_version 1297736 (0.0009) [2023-12-26 09:57:04,405][123090] Updated weights for policy 1, policy_version 1288425 (0.0006) [2023-12-26 09:57:04,457][123090] Updated weights for policy 1, policy_version 1288435 (0.0005) [2023-12-26 09:57:04,520][123090] Updated weights for policy 1, policy_version 1288445 (0.0009) [2023-12-26 09:57:05,052][123091] Updated weights for policy 0, policy_version 1297746 (0.0010) [2023-12-26 09:57:05,107][123091] Updated weights for policy 0, policy_version 1297756 (0.0010) [2023-12-26 09:57:05,166][123091] Updated weights for policy 0, policy_version 1297766 (0.0010) [2023-12-26 09:57:05,240][123091] Updated weights for policy 0, policy_version 1297776 (0.0010) [2023-12-26 09:57:05,333][123090] Updated weights for policy 1, policy_version 1288455 (0.0009) [2023-12-26 09:57:05,394][123090] Updated weights for policy 1, policy_version 1288465 (0.0009) [2023-12-26 09:57:05,442][123090] Updated weights for policy 1, policy_version 1288475 (0.0009) [2023-12-26 09:57:06,055][123091] Updated weights for policy 0, policy_version 1297786 (0.0006) [2023-12-26 09:57:06,121][123091] Updated weights for policy 0, policy_version 1297796 (0.0010) [2023-12-26 09:57:06,184][123091] Updated weights for policy 0, policy_version 1297806 (0.0010) [2023-12-26 09:57:06,257][123090] Updated weights for policy 1, policy_version 1288485 (0.0007) [2023-12-26 09:57:06,323][123090] Updated weights for policy 1, policy_version 1288495 (0.0006) [2023-12-26 09:57:06,390][123090] Updated weights for policy 1, policy_version 1288505 (0.0009) [2023-12-26 09:57:06,998][123091] Updated weights for policy 0, policy_version 1297816 (0.0009) [2023-12-26 09:57:07,057][123091] Updated weights for policy 0, policy_version 1297826 (0.0008) [2023-12-26 09:57:07,128][123091] Updated weights for policy 0, policy_version 1297836 (0.0007) [2023-12-26 09:57:07,183][123090] Updated weights for policy 1, policy_version 1288515 (0.0010) [2023-12-26 09:57:07,250][123090] Updated weights for policy 1, policy_version 1288525 (0.0010) [2023-12-26 09:57:07,312][123090] Updated weights for policy 1, policy_version 1288535 (0.0010) [2023-12-26 09:57:07,944][123091] Updated weights for policy 0, policy_version 1297846 (0.0009) [2023-12-26 09:57:07,998][123091] Updated weights for policy 0, policy_version 1297856 (0.0010) [2023-12-26 09:57:08,050][123090] Updated weights for policy 1, policy_version 1288545 (0.0010) [2023-12-26 09:57:08,059][123091] Updated weights for policy 0, policy_version 1297866 (0.0009) [2023-12-26 09:57:08,112][123090] Updated weights for policy 1, policy_version 1288555 (0.0009) [2023-12-26 09:57:08,176][123090] Updated weights for policy 1, policy_version 1288565 (0.0010) [2023-12-26 09:57:08,241][123090] Updated weights for policy 1, policy_version 1288575 (0.0009) [2023-12-26 09:57:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17939.1). Total num frames: 662134784. Throughput: 0: 8706.3, 1: 8843.8. Samples: 662114208. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:57:08,785][121949] Avg episode reward: [(0, '6243.408'), (1, '5601.991')] [2023-12-26 09:57:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001288576_329875456.pth... [2023-12-26 09:57:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001297872_332259328.pth... [2023-12-26 09:57:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001287520_329605120.pth [2023-12-26 09:57:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001296880_332005376.pth [2023-12-26 09:57:08,849][123091] Updated weights for policy 0, policy_version 1297876 (0.0008) [2023-12-26 09:57:08,908][123091] Updated weights for policy 0, policy_version 1297886 (0.0006) [2023-12-26 09:57:08,953][123090] Updated weights for policy 1, policy_version 1288585 (0.0005) [2023-12-26 09:57:08,961][123091] Updated weights for policy 0, policy_version 1297896 (0.0006) [2023-12-26 09:57:09,018][123090] Updated weights for policy 1, policy_version 1288595 (0.0009) [2023-12-26 09:57:09,101][123090] Updated weights for policy 1, policy_version 1288605 (0.0010) [2023-12-26 09:57:09,743][123091] Updated weights for policy 0, policy_version 1297906 (0.0006) [2023-12-26 09:57:09,809][123091] Updated weights for policy 0, policy_version 1297916 (0.0009) [2023-12-26 09:57:09,879][123091] Updated weights for policy 0, policy_version 1297926 (0.0009) [2023-12-26 09:57:09,891][123090] Updated weights for policy 1, policy_version 1288615 (0.0011) [2023-12-26 09:57:09,947][123091] Updated weights for policy 0, policy_version 1297936 (0.0008) [2023-12-26 09:57:09,963][123090] Updated weights for policy 1, policy_version 1288625 (0.0009) [2023-12-26 09:57:10,032][123090] Updated weights for policy 1, policy_version 1288635 (0.0011) [2023-12-26 09:57:10,777][123091] Updated weights for policy 0, policy_version 1297946 (0.0009) [2023-12-26 09:57:10,841][123091] Updated weights for policy 0, policy_version 1297956 (0.0009) [2023-12-26 09:57:10,853][123090] Updated weights for policy 1, policy_version 1288645 (0.0011) [2023-12-26 09:57:10,908][123091] Updated weights for policy 0, policy_version 1297966 (0.0010) [2023-12-26 09:57:10,921][123090] Updated weights for policy 1, policy_version 1288655 (0.0011) [2023-12-26 09:57:10,981][123090] Updated weights for policy 1, policy_version 1288665 (0.0010) [2023-12-26 09:57:11,739][123091] Updated weights for policy 0, policy_version 1297976 (0.0009) [2023-12-26 09:57:11,808][123091] Updated weights for policy 0, policy_version 1297986 (0.0010) [2023-12-26 09:57:11,873][123091] Updated weights for policy 0, policy_version 1297996 (0.0011) [2023-12-26 09:57:11,881][123090] Updated weights for policy 1, policy_version 1288675 (0.0009) [2023-12-26 09:57:11,950][123090] Updated weights for policy 1, policy_version 1288685 (0.0006) [2023-12-26 09:57:12,024][123090] Updated weights for policy 1, policy_version 1288695 (0.0007) [2023-12-26 09:57:12,676][123091] Updated weights for policy 0, policy_version 1298006 (0.0009) [2023-12-26 09:57:12,737][123090] Updated weights for policy 1, policy_version 1288705 (0.0009) [2023-12-26 09:57:12,740][123091] Updated weights for policy 0, policy_version 1298016 (0.0009) [2023-12-26 09:57:12,796][123091] Updated weights for policy 0, policy_version 1298026 (0.0009) [2023-12-26 09:57:12,800][123090] Updated weights for policy 1, policy_version 1288715 (0.0009) [2023-12-26 09:57:12,864][123090] Updated weights for policy 1, policy_version 1288725 (0.0008) [2023-12-26 09:57:12,931][123090] Updated weights for policy 1, policy_version 1288735 (0.0010) [2023-12-26 09:57:13,471][123091] Updated weights for policy 0, policy_version 1298036 (0.0009) [2023-12-26 09:57:13,526][123091] Updated weights for policy 0, policy_version 1298046 (0.0010) [2023-12-26 09:57:13,580][123091] Updated weights for policy 0, policy_version 1298058 (0.0011) [2023-12-26 09:57:13,652][123090] Updated weights for policy 1, policy_version 1288745 (0.0007) [2023-12-26 09:57:13,711][123090] Updated weights for policy 1, policy_version 1288755 (0.0006) [2023-12-26 09:57:13,773][123090] Updated weights for policy 1, policy_version 1288765 (0.0006) [2023-12-26 09:57:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17966.9). Total num frames: 662224896. Throughput: 0: 8658.4, 1: 8920.1. Samples: 662219720. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 09:57:13,785][121949] Avg episode reward: [(0, '6255.266'), (1, '5573.226')] [2023-12-26 09:57:14,356][123090] Updated weights for policy 1, policy_version 1288775 (0.0006) [2023-12-26 09:57:14,414][123090] Updated weights for policy 1, policy_version 1288785 (0.0009) [2023-12-26 09:57:14,476][123090] Updated weights for policy 1, policy_version 1288795 (0.0009) [2023-12-26 09:57:14,504][123091] Updated weights for policy 0, policy_version 1298068 (0.0009) [2023-12-26 09:57:14,569][123091] Updated weights for policy 0, policy_version 1298078 (0.0007) [2023-12-26 09:57:14,630][123091] Updated weights for policy 0, policy_version 1298088 (0.0006) [2023-12-26 09:57:15,302][123090] Updated weights for policy 1, policy_version 1288805 (0.0009) [2023-12-26 09:57:15,361][123090] Updated weights for policy 1, policy_version 1288815 (0.0008) [2023-12-26 09:57:15,406][123091] Updated weights for policy 0, policy_version 1298098 (0.0007) [2023-12-26 09:57:15,429][123090] Updated weights for policy 1, policy_version 1288825 (0.0005) [2023-12-26 09:57:15,455][123091] Updated weights for policy 0, policy_version 1298108 (0.0009) [2023-12-26 09:57:15,512][123091] Updated weights for policy 0, policy_version 1298118 (0.0009) [2023-12-26 09:57:15,576][123091] Updated weights for policy 0, policy_version 1298128 (0.0009) [2023-12-26 09:57:16,200][123090] Updated weights for policy 1, policy_version 1288835 (0.0007) [2023-12-26 09:57:16,248][123090] Updated weights for policy 1, policy_version 1288845 (0.0008) [2023-12-26 09:57:16,305][123090] Updated weights for policy 1, policy_version 1288855 (0.0009) [2023-12-26 09:57:16,441][123091] Updated weights for policy 0, policy_version 1298138 (0.0006) [2023-12-26 09:57:16,504][123091] Updated weights for policy 0, policy_version 1298148 (0.0005) [2023-12-26 09:57:16,572][123091] Updated weights for policy 0, policy_version 1298158 (0.0008) [2023-12-26 09:57:17,088][123090] Updated weights for policy 1, policy_version 1288865 (0.0010) [2023-12-26 09:57:17,152][123090] Updated weights for policy 1, policy_version 1288875 (0.0011) [2023-12-26 09:57:17,227][123090] Updated weights for policy 1, policy_version 1288885 (0.0011) [2023-12-26 09:57:17,258][123091] Updated weights for policy 0, policy_version 1298168 (0.0005) [2023-12-26 09:57:17,282][123090] Updated weights for policy 1, policy_version 1288895 (0.0010) [2023-12-26 09:57:17,326][123091] Updated weights for policy 0, policy_version 1298178 (0.0006) [2023-12-26 09:57:17,396][123091] Updated weights for policy 0, policy_version 1298188 (0.0005) [2023-12-26 09:57:17,995][123091] Updated weights for policy 0, policy_version 1298198 (0.0005) [2023-12-26 09:57:18,059][123091] Updated weights for policy 0, policy_version 1298208 (0.0005) [2023-12-26 09:57:18,093][123090] Updated weights for policy 1, policy_version 1288905 (0.0010) [2023-12-26 09:57:18,127][123091] Updated weights for policy 0, policy_version 1298218 (0.0006) [2023-12-26 09:57:18,144][123090] Updated weights for policy 1, policy_version 1288915 (0.0006) [2023-12-26 09:57:18,194][123090] Updated weights for policy 1, policy_version 1288925 (0.0005) [2023-12-26 09:57:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17994.6). Total num frames: 662315008. Throughput: 0: 8733.9, 1: 8991.1. Samples: 662330180. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:18,785][121949] Avg episode reward: [(0, '6221.129'), (1, '5656.616')] [2023-12-26 09:57:18,906][123091] Updated weights for policy 0, policy_version 1298228 (0.0010) [2023-12-26 09:57:18,916][123090] Updated weights for policy 1, policy_version 1288935 (0.0009) [2023-12-26 09:57:18,970][123091] Updated weights for policy 0, policy_version 1298238 (0.0006) [2023-12-26 09:57:18,972][123090] Updated weights for policy 1, policy_version 1288945 (0.0010) [2023-12-26 09:57:19,034][123091] Updated weights for policy 0, policy_version 1298248 (0.0006) [2023-12-26 09:57:19,035][123090] Updated weights for policy 1, policy_version 1288955 (0.0011) [2023-12-26 09:57:19,783][123090] Updated weights for policy 1, policy_version 1288965 (0.0011) [2023-12-26 09:57:19,853][123090] Updated weights for policy 1, policy_version 1288975 (0.0011) [2023-12-26 09:57:19,920][123091] Updated weights for policy 0, policy_version 1298258 (0.0008) [2023-12-26 09:57:19,928][123090] Updated weights for policy 1, policy_version 1288985 (0.0011) [2023-12-26 09:57:19,991][123091] Updated weights for policy 0, policy_version 1298268 (0.0008) [2023-12-26 09:57:20,062][123091] Updated weights for policy 0, policy_version 1298278 (0.0006) [2023-12-26 09:57:20,134][123091] Updated weights for policy 0, policy_version 1298288 (0.0006) [2023-12-26 09:57:20,806][123090] Updated weights for policy 1, policy_version 1288995 (0.0009) [2023-12-26 09:57:20,859][123091] Updated weights for policy 0, policy_version 1298298 (0.0008) [2023-12-26 09:57:20,879][123090] Updated weights for policy 1, policy_version 1289005 (0.0007) [2023-12-26 09:57:20,927][123091] Updated weights for policy 0, policy_version 1298308 (0.0008) [2023-12-26 09:57:20,946][123090] Updated weights for policy 1, policy_version 1289015 (0.0010) [2023-12-26 09:57:20,990][123091] Updated weights for policy 0, policy_version 1298318 (0.0008) [2023-12-26 09:57:21,787][123090] Updated weights for policy 1, policy_version 1289025 (0.0008) [2023-12-26 09:57:21,803][123091] Updated weights for policy 0, policy_version 1298328 (0.0008) [2023-12-26 09:57:21,853][123090] Updated weights for policy 1, policy_version 1289035 (0.0009) [2023-12-26 09:57:21,855][123091] Updated weights for policy 0, policy_version 1298338 (0.0008) [2023-12-26 09:57:21,914][123091] Updated weights for policy 0, policy_version 1298348 (0.0008) [2023-12-26 09:57:21,918][123090] Updated weights for policy 1, policy_version 1289045 (0.0006) [2023-12-26 09:57:21,988][123090] Updated weights for policy 1, policy_version 1289055 (0.0010) [2023-12-26 09:57:22,758][123091] Updated weights for policy 0, policy_version 1298358 (0.0010) [2023-12-26 09:57:22,818][123091] Updated weights for policy 0, policy_version 1298368 (0.0011) [2023-12-26 09:57:22,837][123090] Updated weights for policy 1, policy_version 1289065 (0.0006) [2023-12-26 09:57:22,881][123091] Updated weights for policy 0, policy_version 1298378 (0.0011) [2023-12-26 09:57:22,897][123090] Updated weights for policy 1, policy_version 1289075 (0.0008) [2023-12-26 09:57:22,954][123090] Updated weights for policy 1, policy_version 1289085 (0.0009) [2023-12-26 09:57:23,651][123091] Updated weights for policy 0, policy_version 1298388 (0.0010) [2023-12-26 09:57:23,712][123091] Updated weights for policy 0, policy_version 1298398 (0.0009) [2023-12-26 09:57:23,773][123090] Updated weights for policy 1, policy_version 1289095 (0.0008) [2023-12-26 09:57:23,778][123091] Updated weights for policy 0, policy_version 1298408 (0.0009) [2023-12-26 09:57:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17939.1). Total num frames: 662396928. Throughput: 0: 8693.8, 1: 9009.8. Samples: 662381980. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:23,785][121949] Avg episode reward: [(0, '6264.806'), (1, '5819.319')] [2023-12-26 09:57:23,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001298416_332398592.pth... [2023-12-26 09:57:23,830][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001297392_332136448.pth [2023-12-26 09:57:23,835][123090] Updated weights for policy 1, policy_version 1289105 (0.0008) [2023-12-26 09:57:23,894][123090] Updated weights for policy 1, policy_version 1289115 (0.0009) [2023-12-26 09:57:23,925][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001289120_330014720.pth... [2023-12-26 09:57:23,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001288064_329744384.pth [2023-12-26 09:57:24,498][123091] Updated weights for policy 0, policy_version 1298418 (0.0010) [2023-12-26 09:57:24,564][123091] Updated weights for policy 0, policy_version 1298428 (0.0006) [2023-12-26 09:57:24,628][123091] Updated weights for policy 0, policy_version 1298438 (0.0008) [2023-12-26 09:57:24,677][123091] Updated weights for policy 0, policy_version 1298448 (0.0008) [2023-12-26 09:57:24,776][123090] Updated weights for policy 1, policy_version 1289125 (0.0009) [2023-12-26 09:57:24,830][123090] Updated weights for policy 1, policy_version 1289135 (0.0010) [2023-12-26 09:57:24,889][123090] Updated weights for policy 1, policy_version 1289145 (0.0010) [2023-12-26 09:57:25,381][123091] Updated weights for policy 0, policy_version 1298458 (0.0010) [2023-12-26 09:57:25,433][123091] Updated weights for policy 0, policy_version 1298468 (0.0010) [2023-12-26 09:57:25,484][123091] Updated weights for policy 0, policy_version 1298478 (0.0010) [2023-12-26 09:57:25,804][123090] Updated weights for policy 1, policy_version 1289156 (0.0010) [2023-12-26 09:57:25,856][123090] Updated weights for policy 1, policy_version 1289166 (0.0009) [2023-12-26 09:57:25,913][123090] Updated weights for policy 1, policy_version 1289176 (0.0009) [2023-12-26 09:57:26,330][123091] Updated weights for policy 0, policy_version 1298488 (0.0011) [2023-12-26 09:57:26,399][123091] Updated weights for policy 0, policy_version 1298498 (0.0010) [2023-12-26 09:57:26,465][123091] Updated weights for policy 0, policy_version 1298508 (0.0007) [2023-12-26 09:57:26,786][123090] Updated weights for policy 1, policy_version 1289186 (0.0009) [2023-12-26 09:57:26,835][123090] Updated weights for policy 1, policy_version 1289196 (0.0009) [2023-12-26 09:57:26,884][123090] Updated weights for policy 1, policy_version 1289206 (0.0009) [2023-12-26 09:57:26,938][123090] Updated weights for policy 1, policy_version 1289216 (0.0009) [2023-12-26 09:57:27,206][123091] Updated weights for policy 0, policy_version 1298518 (0.0008) [2023-12-26 09:57:27,260][123091] Updated weights for policy 0, policy_version 1298528 (0.0010) [2023-12-26 09:57:27,311][123091] Updated weights for policy 0, policy_version 1298538 (0.0010) [2023-12-26 09:57:27,848][123090] Updated weights for policy 1, policy_version 1289227 (0.0011) [2023-12-26 09:57:27,895][123091] Updated weights for policy 0, policy_version 1298548 (0.0008) [2023-12-26 09:57:27,905][123090] Updated weights for policy 1, policy_version 1289237 (0.0008) [2023-12-26 09:57:27,947][123091] Updated weights for policy 0, policy_version 1298558 (0.0005) [2023-12-26 09:57:27,960][123090] Updated weights for policy 1, policy_version 1289247 (0.0008) [2023-12-26 09:57:28,007][123091] Updated weights for policy 0, policy_version 1298568 (0.0005) [2023-12-26 09:57:28,612][123091] Updated weights for policy 0, policy_version 1298578 (0.0005) [2023-12-26 09:57:28,666][123091] Updated weights for policy 0, policy_version 1298588 (0.0009) [2023-12-26 09:57:28,717][123091] Updated weights for policy 0, policy_version 1298598 (0.0010) [2023-12-26 09:57:28,764][123091] Updated weights for policy 0, policy_version 1298608 (0.0010) [2023-12-26 09:57:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17966.9). Total num frames: 662495232. Throughput: 0: 8837.5, 1: 8947.3. Samples: 662486124. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:28,784][121949] Avg episode reward: [(0, '6212.016'), (1, '5780.396')] [2023-12-26 09:57:28,882][123090] Updated weights for policy 1, policy_version 1289257 (0.0009) [2023-12-26 09:57:28,930][123090] Updated weights for policy 1, policy_version 1289267 (0.0008) [2023-12-26 09:57:28,984][123090] Updated weights for policy 1, policy_version 1289277 (0.0009) [2023-12-26 09:57:29,602][123091] Updated weights for policy 0, policy_version 1298618 (0.0011) [2023-12-26 09:57:29,664][123091] Updated weights for policy 0, policy_version 1298628 (0.0010) [2023-12-26 09:57:29,726][123091] Updated weights for policy 0, policy_version 1298638 (0.0011) [2023-12-26 09:57:29,835][123090] Updated weights for policy 1, policy_version 1289287 (0.0009) [2023-12-26 09:57:29,899][123090] Updated weights for policy 1, policy_version 1289297 (0.0009) [2023-12-26 09:57:29,960][123090] Updated weights for policy 1, policy_version 1289307 (0.0009) [2023-12-26 09:57:30,451][123091] Updated weights for policy 0, policy_version 1298648 (0.0007) [2023-12-26 09:57:30,500][123091] Updated weights for policy 0, policy_version 1298658 (0.0005) [2023-12-26 09:57:30,557][123091] Updated weights for policy 0, policy_version 1298668 (0.0005) [2023-12-26 09:57:30,912][123090] Updated weights for policy 1, policy_version 1289317 (0.0010) [2023-12-26 09:57:30,965][123090] Updated weights for policy 1, policy_version 1289327 (0.0009) [2023-12-26 09:57:31,016][123090] Updated weights for policy 1, policy_version 1289337 (0.0010) [2023-12-26 09:57:31,239][123091] Updated weights for policy 0, policy_version 1298678 (0.0006) [2023-12-26 09:57:31,312][123091] Updated weights for policy 0, policy_version 1298688 (0.0006) [2023-12-26 09:57:31,385][123091] Updated weights for policy 0, policy_version 1298698 (0.0009) [2023-12-26 09:57:31,920][123090] Updated weights for policy 1, policy_version 1289347 (0.0010) [2023-12-26 09:57:31,973][123090] Updated weights for policy 1, policy_version 1289357 (0.0009) [2023-12-26 09:57:32,030][123090] Updated weights for policy 1, policy_version 1289367 (0.0009) [2023-12-26 09:57:32,111][123091] Updated weights for policy 0, policy_version 1298708 (0.0009) [2023-12-26 09:57:32,179][123091] Updated weights for policy 0, policy_version 1298718 (0.0010) [2023-12-26 09:57:32,245][123091] Updated weights for policy 0, policy_version 1298728 (0.0008) [2023-12-26 09:57:32,833][123090] Updated weights for policy 1, policy_version 1289377 (0.0009) [2023-12-26 09:57:32,907][123090] Updated weights for policy 1, policy_version 1289387 (0.0009) [2023-12-26 09:57:32,952][123091] Updated weights for policy 0, policy_version 1298738 (0.0010) [2023-12-26 09:57:32,973][123090] Updated weights for policy 1, policy_version 1289397 (0.0009) [2023-12-26 09:57:33,001][123091] Updated weights for policy 0, policy_version 1298748 (0.0007) [2023-12-26 09:57:33,039][123090] Updated weights for policy 1, policy_version 1289407 (0.0007) [2023-12-26 09:57:33,050][123091] Updated weights for policy 0, policy_version 1298758 (0.0008) [2023-12-26 09:57:33,106][123091] Updated weights for policy 0, policy_version 1298768 (0.0005) [2023-12-26 09:57:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 662577152. Throughput: 0: 8857.3, 1: 8789.2. Samples: 662594104. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:33,785][121949] Avg episode reward: [(0, '6228.996'), (1, '5724.486')] [2023-12-26 09:57:33,817][123091] Updated weights for policy 0, policy_version 1298778 (0.0005) [2023-12-26 09:57:33,862][123091] Updated weights for policy 0, policy_version 1298788 (0.0005) [2023-12-26 09:57:33,906][123091] Updated weights for policy 0, policy_version 1298798 (0.0005) [2023-12-26 09:57:33,936][123090] Updated weights for policy 1, policy_version 1289417 (0.0008) [2023-12-26 09:57:33,993][123090] Updated weights for policy 1, policy_version 1289427 (0.0010) [2023-12-26 09:57:34,050][123090] Updated weights for policy 1, policy_version 1289437 (0.0010) [2023-12-26 09:57:34,649][123091] Updated weights for policy 0, policy_version 1298808 (0.0010) [2023-12-26 09:57:34,705][123091] Updated weights for policy 0, policy_version 1298818 (0.0011) [2023-12-26 09:57:34,753][123091] Updated weights for policy 0, policy_version 1298828 (0.0010) [2023-12-26 09:57:34,949][123090] Updated weights for policy 1, policy_version 1289447 (0.0009) [2023-12-26 09:57:34,998][123090] Updated weights for policy 1, policy_version 1289457 (0.0006) [2023-12-26 09:57:35,055][123090] Updated weights for policy 1, policy_version 1289467 (0.0009) [2023-12-26 09:57:35,520][123091] Updated weights for policy 0, policy_version 1298838 (0.0010) [2023-12-26 09:57:35,581][123091] Updated weights for policy 0, policy_version 1298848 (0.0009) [2023-12-26 09:57:35,646][123091] Updated weights for policy 0, policy_version 1298858 (0.0009) [2023-12-26 09:57:35,928][123090] Updated weights for policy 1, policy_version 1289477 (0.0010) [2023-12-26 09:57:35,995][123090] Updated weights for policy 1, policy_version 1289487 (0.0009) [2023-12-26 09:57:36,048][123090] Updated weights for policy 1, policy_version 1289497 (0.0009) [2023-12-26 09:57:36,442][123091] Updated weights for policy 0, policy_version 1298868 (0.0010) [2023-12-26 09:57:36,503][123091] Updated weights for policy 0, policy_version 1298878 (0.0009) [2023-12-26 09:57:36,568][123091] Updated weights for policy 0, policy_version 1298888 (0.0009) [2023-12-26 09:57:36,953][123090] Updated weights for policy 1, policy_version 1289507 (0.0009) [2023-12-26 09:57:37,017][123090] Updated weights for policy 1, policy_version 1289517 (0.0009) [2023-12-26 09:57:37,081][123090] Updated weights for policy 1, policy_version 1289527 (0.0009) [2023-12-26 09:57:37,330][123091] Updated weights for policy 0, policy_version 1298898 (0.0009) [2023-12-26 09:57:37,385][123091] Updated weights for policy 0, policy_version 1298908 (0.0008) [2023-12-26 09:57:37,438][123091] Updated weights for policy 0, policy_version 1298918 (0.0009) [2023-12-26 09:57:37,833][123090] Updated weights for policy 1, policy_version 1289537 (0.0009) [2023-12-26 09:57:37,888][123090] Updated weights for policy 1, policy_version 1289547 (0.0005) [2023-12-26 09:57:37,944][123090] Updated weights for policy 1, policy_version 1289557 (0.0005) [2023-12-26 09:57:38,001][123090] Updated weights for policy 1, policy_version 1289567 (0.0005) [2023-12-26 09:57:38,284][123091] Updated weights for policy 0, policy_version 1298929 (0.0010) [2023-12-26 09:57:38,342][123091] Updated weights for policy 0, policy_version 1298939 (0.0006) [2023-12-26 09:57:38,403][123091] Updated weights for policy 0, policy_version 1298949 (0.0006) [2023-12-26 09:57:38,471][123091] Updated weights for policy 0, policy_version 1298959 (0.0005) [2023-12-26 09:57:38,707][123090] Updated weights for policy 1, policy_version 1289577 (0.0005) [2023-12-26 09:57:38,762][123090] Updated weights for policy 1, policy_version 1289587 (0.0008) [2023-12-26 09:57:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 662667264. Throughput: 0: 8948.9, 1: 8746.3. Samples: 662646484. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:38,785][121949] Avg episode reward: [(0, '6300.214'), (1, '5723.512')] [2023-12-26 09:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001298960_332537856.pth... [2023-12-26 09:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001297872_332259328.pth [2023-12-26 09:57:38,816][123090] Updated weights for policy 1, policy_version 1289597 (0.0009) [2023-12-26 09:57:38,832][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001289600_330137600.pth... [2023-12-26 09:57:38,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001288576_329875456.pth [2023-12-26 09:57:39,253][123091] Updated weights for policy 0, policy_version 1298969 (0.0009) [2023-12-26 09:57:39,317][123091] Updated weights for policy 0, policy_version 1298979 (0.0010) [2023-12-26 09:57:39,385][123091] Updated weights for policy 0, policy_version 1298989 (0.0010) [2023-12-26 09:57:39,581][123090] Updated weights for policy 1, policy_version 1289607 (0.0009) [2023-12-26 09:57:39,655][123090] Updated weights for policy 1, policy_version 1289617 (0.0009) [2023-12-26 09:57:39,722][123090] Updated weights for policy 1, policy_version 1289627 (0.0009) [2023-12-26 09:57:40,233][123091] Updated weights for policy 0, policy_version 1298999 (0.0009) [2023-12-26 09:57:40,289][123091] Updated weights for policy 0, policy_version 1299009 (0.0009) [2023-12-26 09:57:40,352][123091] Updated weights for policy 0, policy_version 1299019 (0.0009) [2023-12-26 09:57:40,468][123090] Updated weights for policy 1, policy_version 1289637 (0.0010) [2023-12-26 09:57:40,538][123090] Updated weights for policy 1, policy_version 1289647 (0.0010) [2023-12-26 09:57:40,597][123090] Updated weights for policy 1, policy_version 1289657 (0.0008) [2023-12-26 09:57:41,189][123091] Updated weights for policy 0, policy_version 1299029 (0.0008) [2023-12-26 09:57:41,259][123091] Updated weights for policy 0, policy_version 1299039 (0.0007) [2023-12-26 09:57:41,325][123091] Updated weights for policy 0, policy_version 1299049 (0.0010) [2023-12-26 09:57:41,469][123090] Updated weights for policy 1, policy_version 1289667 (0.0007) [2023-12-26 09:57:41,556][123090] Updated weights for policy 1, policy_version 1289677 (0.0009) [2023-12-26 09:57:41,621][123090] Updated weights for policy 1, policy_version 1289687 (0.0010) [2023-12-26 09:57:42,176][123091] Updated weights for policy 0, policy_version 1299059 (0.0010) [2023-12-26 09:57:42,251][123091] Updated weights for policy 0, policy_version 1299069 (0.0009) [2023-12-26 09:57:42,315][123091] Updated weights for policy 0, policy_version 1299079 (0.0010) [2023-12-26 09:57:42,456][123090] Updated weights for policy 1, policy_version 1289697 (0.0008) [2023-12-26 09:57:42,509][123090] Updated weights for policy 1, policy_version 1289707 (0.0009) [2023-12-26 09:57:42,569][123090] Updated weights for policy 1, policy_version 1289717 (0.0010) [2023-12-26 09:57:42,627][123090] Updated weights for policy 1, policy_version 1289727 (0.0009) [2023-12-26 09:57:43,136][123091] Updated weights for policy 0, policy_version 1299089 (0.0010) [2023-12-26 09:57:43,197][123091] Updated weights for policy 0, policy_version 1299099 (0.0008) [2023-12-26 09:57:43,266][123091] Updated weights for policy 0, policy_version 1299109 (0.0011) [2023-12-26 09:57:43,333][123091] Updated weights for policy 0, policy_version 1299119 (0.0011) [2023-12-26 09:57:43,485][123090] Updated weights for policy 1, policy_version 1289737 (0.0009) [2023-12-26 09:57:43,533][123090] Updated weights for policy 1, policy_version 1289747 (0.0008) [2023-12-26 09:57:43,596][123090] Updated weights for policy 1, policy_version 1289757 (0.0009) [2023-12-26 09:57:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17939.1). Total num frames: 662757376. Throughput: 0: 8984.6, 1: 8668.5. Samples: 662750036. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:43,785][121949] Avg episode reward: [(0, '6319.562'), (1, '5649.142')] [2023-12-26 09:57:44,151][123091] Updated weights for policy 0, policy_version 1299129 (0.0011) [2023-12-26 09:57:44,217][123091] Updated weights for policy 0, policy_version 1299139 (0.0010) [2023-12-26 09:57:44,276][123091] Updated weights for policy 0, policy_version 1299149 (0.0010) [2023-12-26 09:57:44,444][123090] Updated weights for policy 1, policy_version 1289767 (0.0010) [2023-12-26 09:57:44,495][123090] Updated weights for policy 1, policy_version 1289777 (0.0010) [2023-12-26 09:57:44,559][123090] Updated weights for policy 1, policy_version 1289787 (0.0010) [2023-12-26 09:57:45,098][123091] Updated weights for policy 0, policy_version 1299159 (0.0011) [2023-12-26 09:57:45,150][123091] Updated weights for policy 0, policy_version 1299169 (0.0011) [2023-12-26 09:57:45,214][123091] Updated weights for policy 0, policy_version 1299179 (0.0011) [2023-12-26 09:57:45,373][123090] Updated weights for policy 1, policy_version 1289797 (0.0010) [2023-12-26 09:57:45,435][123090] Updated weights for policy 1, policy_version 1289807 (0.0009) [2023-12-26 09:57:45,500][123090] Updated weights for policy 1, policy_version 1289817 (0.0009) [2023-12-26 09:57:46,058][123091] Updated weights for policy 0, policy_version 1299189 (0.0011) [2023-12-26 09:57:46,110][123091] Updated weights for policy 0, policy_version 1299199 (0.0010) [2023-12-26 09:57:46,174][123091] Updated weights for policy 0, policy_version 1299209 (0.0008) [2023-12-26 09:57:46,344][123090] Updated weights for policy 1, policy_version 1289827 (0.0009) [2023-12-26 09:57:46,411][123090] Updated weights for policy 1, policy_version 1289837 (0.0010) [2023-12-26 09:57:46,466][123090] Updated weights for policy 1, policy_version 1289847 (0.0010) [2023-12-26 09:57:46,815][123091] Updated weights for policy 0, policy_version 1299219 (0.0007) [2023-12-26 09:57:46,874][123091] Updated weights for policy 0, policy_version 1299229 (0.0009) [2023-12-26 09:57:46,929][123091] Updated weights for policy 0, policy_version 1299239 (0.0009) [2023-12-26 09:57:47,262][123090] Updated weights for policy 1, policy_version 1289857 (0.0010) [2023-12-26 09:57:47,310][123090] Updated weights for policy 1, policy_version 1289867 (0.0005) [2023-12-26 09:57:47,358][123090] Updated weights for policy 1, policy_version 1289877 (0.0005) [2023-12-26 09:57:47,415][123090] Updated weights for policy 1, policy_version 1289887 (0.0005) [2023-12-26 09:57:47,747][123091] Updated weights for policy 0, policy_version 1299249 (0.0009) [2023-12-26 09:57:47,805][123091] Updated weights for policy 0, policy_version 1299259 (0.0010) [2023-12-26 09:57:47,871][123091] Updated weights for policy 0, policy_version 1299269 (0.0007) [2023-12-26 09:57:47,932][123091] Updated weights for policy 0, policy_version 1299279 (0.0010) [2023-12-26 09:57:48,153][123090] Updated weights for policy 1, policy_version 1289897 (0.0008) [2023-12-26 09:57:48,204][123090] Updated weights for policy 1, policy_version 1289907 (0.0009) [2023-12-26 09:57:48,253][123090] Updated weights for policy 1, policy_version 1289917 (0.0008) [2023-12-26 09:57:48,745][123091] Updated weights for policy 0, policy_version 1299289 (0.0011) [2023-12-26 09:57:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17883.6). Total num frames: 662839296. Throughput: 0: 9004.0, 1: 8608.0. Samples: 662855132. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:48,785][121949] Avg episode reward: [(0, '6254.882'), (1, '5630.479')] [2023-12-26 09:57:48,801][123091] Updated weights for policy 0, policy_version 1299299 (0.0011) [2023-12-26 09:57:48,854][123091] Updated weights for policy 0, policy_version 1299309 (0.0011) [2023-12-26 09:57:49,173][123090] Updated weights for policy 1, policy_version 1289927 (0.0009) [2023-12-26 09:57:49,234][123090] Updated weights for policy 1, policy_version 1289937 (0.0009) [2023-12-26 09:57:49,302][123090] Updated weights for policy 1, policy_version 1289947 (0.0010) [2023-12-26 09:57:49,589][123091] Updated weights for policy 0, policy_version 1299319 (0.0010) [2023-12-26 09:57:49,646][123091] Updated weights for policy 0, policy_version 1299329 (0.0010) [2023-12-26 09:57:49,709][123091] Updated weights for policy 0, policy_version 1299339 (0.0010) [2023-12-26 09:57:50,060][123090] Updated weights for policy 1, policy_version 1289957 (0.0008) [2023-12-26 09:57:50,124][123090] Updated weights for policy 1, policy_version 1289967 (0.0010) [2023-12-26 09:57:50,187][123090] Updated weights for policy 1, policy_version 1289977 (0.0008) [2023-12-26 09:57:50,633][123091] Updated weights for policy 0, policy_version 1299349 (0.0010) [2023-12-26 09:57:50,693][123091] Updated weights for policy 0, policy_version 1299359 (0.0010) [2023-12-26 09:57:50,761][123091] Updated weights for policy 0, policy_version 1299369 (0.0010) [2023-12-26 09:57:50,912][123090] Updated weights for policy 1, policy_version 1289987 (0.0008) [2023-12-26 09:57:50,971][123090] Updated weights for policy 1, policy_version 1289997 (0.0005) [2023-12-26 09:57:51,036][123090] Updated weights for policy 1, policy_version 1290007 (0.0006) [2023-12-26 09:57:51,667][123091] Updated weights for policy 0, policy_version 1299379 (0.0011) [2023-12-26 09:57:51,738][123091] Updated weights for policy 0, policy_version 1299389 (0.0009) [2023-12-26 09:57:51,792][123090] Updated weights for policy 1, policy_version 1290017 (0.0006) [2023-12-26 09:57:51,799][123091] Updated weights for policy 0, policy_version 1299399 (0.0009) [2023-12-26 09:57:51,853][123090] Updated weights for policy 1, policy_version 1290027 (0.0007) [2023-12-26 09:57:51,919][123090] Updated weights for policy 1, policy_version 1290037 (0.0009) [2023-12-26 09:57:51,981][123090] Updated weights for policy 1, policy_version 1290047 (0.0010) [2023-12-26 09:57:52,665][123091] Updated weights for policy 0, policy_version 1299409 (0.0009) [2023-12-26 09:57:52,733][123091] Updated weights for policy 0, policy_version 1299419 (0.0011) [2023-12-26 09:57:52,795][123091] Updated weights for policy 0, policy_version 1299429 (0.0006) [2023-12-26 09:57:52,841][123090] Updated weights for policy 1, policy_version 1290057 (0.0010) [2023-12-26 09:57:52,862][123091] Updated weights for policy 0, policy_version 1299439 (0.0008) [2023-12-26 09:57:52,909][123090] Updated weights for policy 1, policy_version 1290067 (0.0008) [2023-12-26 09:57:52,962][123090] Updated weights for policy 1, policy_version 1290077 (0.0009) [2023-12-26 09:57:53,609][123091] Updated weights for policy 0, policy_version 1299449 (0.0010) [2023-12-26 09:57:53,661][123091] Updated weights for policy 0, policy_version 1299459 (0.0010) [2023-12-26 09:57:53,716][123091] Updated weights for policy 0, policy_version 1299469 (0.0010) [2023-12-26 09:57:53,768][123090] Updated weights for policy 1, policy_version 1290087 (0.0006) [2023-12-26 09:57:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 662929408. Throughput: 0: 8984.9, 1: 8624.9. Samples: 662906652. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:53,785][121949] Avg episode reward: [(0, '6334.744'), (1, '5633.508')] [2023-12-26 09:57:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001299472_332668928.pth... [2023-12-26 09:57:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001298416_332398592.pth [2023-12-26 09:57:53,823][123090] Updated weights for policy 1, policy_version 1290097 (0.0006) [2023-12-26 09:57:53,883][123090] Updated weights for policy 1, policy_version 1290107 (0.0007) [2023-12-26 09:57:53,915][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001290112_330268672.pth... [2023-12-26 09:57:53,920][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001289120_330014720.pth [2023-12-26 09:57:54,555][123091] Updated weights for policy 0, policy_version 1299479 (0.0011) [2023-12-26 09:57:54,631][123091] Updated weights for policy 0, policy_version 1299489 (0.0011) [2023-12-26 09:57:54,687][123090] Updated weights for policy 1, policy_version 1290117 (0.0008) [2023-12-26 09:57:54,693][123091] Updated weights for policy 0, policy_version 1299499 (0.0010) [2023-12-26 09:57:54,757][123090] Updated weights for policy 1, policy_version 1290127 (0.0008) [2023-12-26 09:57:54,827][123090] Updated weights for policy 1, policy_version 1290137 (0.0007) [2023-12-26 09:57:55,468][123091] Updated weights for policy 0, policy_version 1299509 (0.0010) [2023-12-26 09:57:55,521][123090] Updated weights for policy 1, policy_version 1290147 (0.0006) [2023-12-26 09:57:55,531][123091] Updated weights for policy 0, policy_version 1299519 (0.0010) [2023-12-26 09:57:55,590][123091] Updated weights for policy 0, policy_version 1299529 (0.0010) [2023-12-26 09:57:55,592][123090] Updated weights for policy 1, policy_version 1290157 (0.0007) [2023-12-26 09:57:55,648][123090] Updated weights for policy 1, policy_version 1290167 (0.0006) [2023-12-26 09:57:56,293][123091] Updated weights for policy 0, policy_version 1299539 (0.0009) [2023-12-26 09:57:56,348][123091] Updated weights for policy 0, policy_version 1299549 (0.0005) [2023-12-26 09:57:56,398][123090] Updated weights for policy 1, policy_version 1290177 (0.0008) [2023-12-26 09:57:56,405][123091] Updated weights for policy 0, policy_version 1299559 (0.0005) [2023-12-26 09:57:56,463][123090] Updated weights for policy 1, policy_version 1290187 (0.0008) [2023-12-26 09:57:56,536][123090] Updated weights for policy 1, policy_version 1290197 (0.0010) [2023-12-26 09:57:56,615][123090] Updated weights for policy 1, policy_version 1290207 (0.0009) [2023-12-26 09:57:57,015][123091] Updated weights for policy 0, policy_version 1299569 (0.0005) [2023-12-26 09:57:57,070][123091] Updated weights for policy 0, policy_version 1299579 (0.0005) [2023-12-26 09:57:57,125][123091] Updated weights for policy 0, policy_version 1299589 (0.0005) [2023-12-26 09:57:57,179][123091] Updated weights for policy 0, policy_version 1299599 (0.0005) [2023-12-26 09:57:57,370][123090] Updated weights for policy 1, policy_version 1290217 (0.0006) [2023-12-26 09:57:57,433][123090] Updated weights for policy 1, policy_version 1290227 (0.0005) [2023-12-26 09:57:57,497][123090] Updated weights for policy 1, policy_version 1290237 (0.0005) [2023-12-26 09:57:57,894][123091] Updated weights for policy 0, policy_version 1299609 (0.0007) [2023-12-26 09:57:57,953][123091] Updated weights for policy 0, policy_version 1299619 (0.0009) [2023-12-26 09:57:58,024][123091] Updated weights for policy 0, policy_version 1299629 (0.0006) [2023-12-26 09:57:58,317][123090] Updated weights for policy 1, policy_version 1290247 (0.0007) [2023-12-26 09:57:58,392][123090] Updated weights for policy 1, policy_version 1290257 (0.0009) [2023-12-26 09:57:58,461][123090] Updated weights for policy 1, policy_version 1290267 (0.0010) [2023-12-26 09:57:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 663019520. Throughput: 0: 9055.4, 1: 8642.1. Samples: 663016104. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:57:58,785][121949] Avg episode reward: [(0, '6388.296'), (1, '5711.433')] [2023-12-26 09:57:58,870][123091] Updated weights for policy 0, policy_version 1299639 (0.0008) [2023-12-26 09:57:58,918][123091] Updated weights for policy 0, policy_version 1299649 (0.0009) [2023-12-26 09:57:58,972][123091] Updated weights for policy 0, policy_version 1299659 (0.0009) [2023-12-26 09:57:59,225][123090] Updated weights for policy 1, policy_version 1290277 (0.0008) [2023-12-26 09:57:59,296][123090] Updated weights for policy 1, policy_version 1290287 (0.0006) [2023-12-26 09:57:59,369][123090] Updated weights for policy 1, policy_version 1290297 (0.0009) [2023-12-26 09:57:59,787][123091] Updated weights for policy 0, policy_version 1299669 (0.0008) [2023-12-26 09:57:59,855][123091] Updated weights for policy 0, policy_version 1299679 (0.0007) [2023-12-26 09:57:59,930][123091] Updated weights for policy 0, policy_version 1299689 (0.0006) [2023-12-26 09:58:00,119][123090] Updated weights for policy 1, policy_version 1290307 (0.0006) [2023-12-26 09:58:00,189][123090] Updated weights for policy 1, policy_version 1290317 (0.0007) [2023-12-26 09:58:00,253][123090] Updated weights for policy 1, policy_version 1290327 (0.0009) [2023-12-26 09:58:00,726][123091] Updated weights for policy 0, policy_version 1299699 (0.0009) [2023-12-26 09:58:00,780][123091] Updated weights for policy 0, policy_version 1299709 (0.0010) [2023-12-26 09:58:00,837][123091] Updated weights for policy 0, policy_version 1299720 (0.0010) [2023-12-26 09:58:00,894][123090] Updated weights for policy 1, policy_version 1290337 (0.0006) [2023-12-26 09:58:00,954][123090] Updated weights for policy 1, policy_version 1290347 (0.0005) [2023-12-26 09:58:01,004][123090] Updated weights for policy 1, policy_version 1290357 (0.0005) [2023-12-26 09:58:01,073][123090] Updated weights for policy 1, policy_version 1290367 (0.0008) [2023-12-26 09:58:01,742][123091] Updated weights for policy 0, policy_version 1299730 (0.0009) [2023-12-26 09:58:01,805][123091] Updated weights for policy 0, policy_version 1299740 (0.0009) [2023-12-26 09:58:01,866][123091] Updated weights for policy 0, policy_version 1299750 (0.0008) [2023-12-26 09:58:01,890][123090] Updated weights for policy 1, policy_version 1290377 (0.0009) [2023-12-26 09:58:01,924][123091] Updated weights for policy 0, policy_version 1299760 (0.0008) [2023-12-26 09:58:01,954][123090] Updated weights for policy 1, policy_version 1290387 (0.0009) [2023-12-26 09:58:02,030][123090] Updated weights for policy 1, policy_version 1290397 (0.0009) [2023-12-26 09:58:02,793][123091] Updated weights for policy 0, policy_version 1299770 (0.0010) [2023-12-26 09:58:02,809][123090] Updated weights for policy 1, policy_version 1290407 (0.0007) [2023-12-26 09:58:02,852][123091] Updated weights for policy 0, policy_version 1299780 (0.0006) [2023-12-26 09:58:02,866][123090] Updated weights for policy 1, policy_version 1290417 (0.0010) [2023-12-26 09:58:02,912][123091] Updated weights for policy 0, policy_version 1299790 (0.0008) [2023-12-26 09:58:02,922][123090] Updated weights for policy 1, policy_version 1290427 (0.0007) [2023-12-26 09:58:03,708][123091] Updated weights for policy 0, policy_version 1299800 (0.0006) [2023-12-26 09:58:03,763][123091] Updated weights for policy 0, policy_version 1299810 (0.0005) [2023-12-26 09:58:03,775][123090] Updated weights for policy 1, policy_version 1290437 (0.0009) [2023-12-26 09:58:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 663101440. Throughput: 0: 8973.4, 1: 8597.2. Samples: 663120860. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:03,785][121949] Avg episode reward: [(0, '6327.843'), (1, '5736.879')] [2023-12-26 09:58:03,832][123091] Updated weights for policy 0, policy_version 1299820 (0.0006) [2023-12-26 09:58:03,843][123090] Updated weights for policy 1, policy_version 1290447 (0.0008) [2023-12-26 09:58:03,913][123090] Updated weights for policy 1, policy_version 1290457 (0.0008) [2023-12-26 09:58:04,593][123091] Updated weights for policy 0, policy_version 1299830 (0.0011) [2023-12-26 09:58:04,657][123091] Updated weights for policy 0, policy_version 1299840 (0.0010) [2023-12-26 09:58:04,720][123091] Updated weights for policy 0, policy_version 1299850 (0.0011) [2023-12-26 09:58:04,745][123090] Updated weights for policy 1, policy_version 1290467 (0.0009) [2023-12-26 09:58:04,815][123090] Updated weights for policy 1, policy_version 1290477 (0.0009) [2023-12-26 09:58:04,869][123090] Updated weights for policy 1, policy_version 1290487 (0.0009) [2023-12-26 09:58:05,407][123091] Updated weights for policy 0, policy_version 1299860 (0.0011) [2023-12-26 09:58:05,458][123091] Updated weights for policy 0, policy_version 1299870 (0.0008) [2023-12-26 09:58:05,502][123091] Updated weights for policy 0, policy_version 1299880 (0.0005) [2023-12-26 09:58:05,756][123090] Updated weights for policy 1, policy_version 1290497 (0.0010) [2023-12-26 09:58:05,812][123090] Updated weights for policy 1, policy_version 1290507 (0.0009) [2023-12-26 09:58:05,876][123090] Updated weights for policy 1, policy_version 1290517 (0.0009) [2023-12-26 09:58:05,936][123090] Updated weights for policy 1, policy_version 1290527 (0.0009) [2023-12-26 09:58:06,278][123091] Updated weights for policy 0, policy_version 1299890 (0.0006) [2023-12-26 09:58:06,333][123091] Updated weights for policy 0, policy_version 1299900 (0.0011) [2023-12-26 09:58:06,389][123091] Updated weights for policy 0, policy_version 1299910 (0.0011) [2023-12-26 09:58:06,445][123091] Updated weights for policy 0, policy_version 1299920 (0.0011) [2023-12-26 09:58:06,770][123090] Updated weights for policy 1, policy_version 1290537 (0.0009) [2023-12-26 09:58:06,829][123090] Updated weights for policy 1, policy_version 1290547 (0.0008) [2023-12-26 09:58:06,889][123090] Updated weights for policy 1, policy_version 1290557 (0.0009) [2023-12-26 09:58:07,199][123091] Updated weights for policy 0, policy_version 1299930 (0.0008) [2023-12-26 09:58:07,250][123091] Updated weights for policy 0, policy_version 1299941 (0.0010) [2023-12-26 09:58:07,307][123091] Updated weights for policy 0, policy_version 1299952 (0.0010) [2023-12-26 09:58:07,765][123090] Updated weights for policy 1, policy_version 1290567 (0.0009) [2023-12-26 09:58:07,828][123090] Updated weights for policy 1, policy_version 1290577 (0.0010) [2023-12-26 09:58:07,880][123090] Updated weights for policy 1, policy_version 1290587 (0.0009) [2023-12-26 09:58:08,133][123091] Updated weights for policy 0, policy_version 1299962 (0.0010) [2023-12-26 09:58:08,192][123091] Updated weights for policy 0, policy_version 1299974 (0.0011) [2023-12-26 09:58:08,245][123091] Updated weights for policy 0, policy_version 1299984 (0.0010) [2023-12-26 09:58:08,703][123090] Updated weights for policy 1, policy_version 1290597 (0.0009) [2023-12-26 09:58:08,762][123090] Updated weights for policy 1, policy_version 1290607 (0.0010) [2023-12-26 09:58:08,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 663191552. Throughput: 0: 9006.2, 1: 8564.6. Samples: 663172668. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:08,785][121949] Avg episode reward: [(0, '6246.252'), (1, '5653.101')] [2023-12-26 09:58:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001299984_332800000.pth... [2023-12-26 09:58:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001298960_332537856.pth [2023-12-26 09:58:08,817][123090] Updated weights for policy 1, policy_version 1290617 (0.0010) [2023-12-26 09:58:08,863][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001290624_330399744.pth... [2023-12-26 09:58:08,868][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001289600_330137600.pth [2023-12-26 09:58:09,123][123091] Updated weights for policy 0, policy_version 1299994 (0.0009) [2023-12-26 09:58:09,186][123091] Updated weights for policy 0, policy_version 1300004 (0.0009) [2023-12-26 09:58:09,251][123091] Updated weights for policy 0, policy_version 1300014 (0.0009) [2023-12-26 09:58:09,704][123090] Updated weights for policy 1, policy_version 1290627 (0.0009) [2023-12-26 09:58:09,778][123090] Updated weights for policy 1, policy_version 1290637 (0.0008) [2023-12-26 09:58:09,847][123090] Updated weights for policy 1, policy_version 1290647 (0.0010) [2023-12-26 09:58:10,137][123091] Updated weights for policy 0, policy_version 1300024 (0.0009) [2023-12-26 09:58:10,202][123091] Updated weights for policy 0, policy_version 1300034 (0.0008) [2023-12-26 09:58:10,272][123091] Updated weights for policy 0, policy_version 1300044 (0.0005) [2023-12-26 09:58:10,631][123090] Updated weights for policy 1, policy_version 1290657 (0.0008) [2023-12-26 09:58:10,690][123090] Updated weights for policy 1, policy_version 1290667 (0.0010) [2023-12-26 09:58:10,753][123090] Updated weights for policy 1, policy_version 1290677 (0.0010) [2023-12-26 09:58:10,828][123090] Updated weights for policy 1, policy_version 1290687 (0.0011) [2023-12-26 09:58:10,975][123091] Updated weights for policy 0, policy_version 1300054 (0.0005) [2023-12-26 09:58:11,035][123091] Updated weights for policy 0, policy_version 1300064 (0.0007) [2023-12-26 09:58:11,108][123091] Updated weights for policy 0, policy_version 1300074 (0.0011) [2023-12-26 09:58:11,678][123090] Updated weights for policy 1, policy_version 1290697 (0.0011) [2023-12-26 09:58:11,755][123090] Updated weights for policy 1, policy_version 1290707 (0.0010) [2023-12-26 09:58:11,822][123090] Updated weights for policy 1, policy_version 1290717 (0.0010) [2023-12-26 09:58:11,928][123091] Updated weights for policy 0, policy_version 1300084 (0.0009) [2023-12-26 09:58:11,996][123091] Updated weights for policy 0, policy_version 1300094 (0.0008) [2023-12-26 09:58:12,069][123091] Updated weights for policy 0, policy_version 1300104 (0.0006) [2023-12-26 09:58:12,640][123090] Updated weights for policy 1, policy_version 1290727 (0.0010) [2023-12-26 09:58:12,708][123090] Updated weights for policy 1, policy_version 1290737 (0.0010) [2023-12-26 09:58:12,763][123090] Updated weights for policy 1, policy_version 1290747 (0.0010) [2023-12-26 09:58:12,853][123091] Updated weights for policy 0, policy_version 1300114 (0.0009) [2023-12-26 09:58:12,904][123091] Updated weights for policy 0, policy_version 1300124 (0.0010) [2023-12-26 09:58:12,953][123091] Updated weights for policy 0, policy_version 1300134 (0.0009) [2023-12-26 09:58:13,004][123091] Updated weights for policy 0, policy_version 1300144 (0.0009) [2023-12-26 09:58:13,585][123090] Updated weights for policy 1, policy_version 1290757 (0.0009) [2023-12-26 09:58:13,638][123090] Updated weights for policy 1, policy_version 1290767 (0.0010) [2023-12-26 09:58:13,691][123090] Updated weights for policy 1, policy_version 1290777 (0.0010) [2023-12-26 09:58:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 663281664. Throughput: 0: 8946.8, 1: 8591.0. Samples: 663275328. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:13,785][121949] Avg episode reward: [(0, '6189.093'), (1, '5398.859')] [2023-12-26 09:58:13,833][123091] Updated weights for policy 0, policy_version 1300154 (0.0009) [2023-12-26 09:58:13,893][123091] Updated weights for policy 0, policy_version 1300164 (0.0009) [2023-12-26 09:58:13,955][123091] Updated weights for policy 0, policy_version 1300174 (0.0009) [2023-12-26 09:58:14,429][123090] Updated weights for policy 1, policy_version 1290787 (0.0010) [2023-12-26 09:58:14,484][123090] Updated weights for policy 1, policy_version 1290797 (0.0010) [2023-12-26 09:58:14,542][123090] Updated weights for policy 1, policy_version 1290807 (0.0010) [2023-12-26 09:58:14,789][123091] Updated weights for policy 0, policy_version 1300184 (0.0010) [2023-12-26 09:58:14,853][123091] Updated weights for policy 0, policy_version 1300194 (0.0009) [2023-12-26 09:58:14,917][123091] Updated weights for policy 0, policy_version 1300204 (0.0008) [2023-12-26 09:58:15,402][123090] Updated weights for policy 1, policy_version 1290817 (0.0006) [2023-12-26 09:58:15,465][123090] Updated weights for policy 1, policy_version 1290827 (0.0010) [2023-12-26 09:58:15,536][123090] Updated weights for policy 1, policy_version 1290837 (0.0011) [2023-12-26 09:58:15,605][123090] Updated weights for policy 1, policy_version 1290847 (0.0011) [2023-12-26 09:58:15,706][123091] Updated weights for policy 0, policy_version 1300214 (0.0009) [2023-12-26 09:58:15,758][123091] Updated weights for policy 0, policy_version 1300224 (0.0008) [2023-12-26 09:58:15,814][123091] Updated weights for policy 0, policy_version 1300234 (0.0008) [2023-12-26 09:58:16,427][123090] Updated weights for policy 1, policy_version 1290857 (0.0010) [2023-12-26 09:58:16,454][123091] Updated weights for policy 0, policy_version 1300244 (0.0005) [2023-12-26 09:58:16,473][123090] Updated weights for policy 1, policy_version 1290867 (0.0009) [2023-12-26 09:58:16,509][123091] Updated weights for policy 0, policy_version 1300254 (0.0006) [2023-12-26 09:58:16,523][123090] Updated weights for policy 1, policy_version 1290877 (0.0009) [2023-12-26 09:58:16,568][123091] Updated weights for policy 0, policy_version 1300264 (0.0005) [2023-12-26 09:58:17,218][123091] Updated weights for policy 0, policy_version 1300274 (0.0005) [2023-12-26 09:58:17,280][123091] Updated weights for policy 0, policy_version 1300284 (0.0005) [2023-12-26 09:58:17,291][123090] Updated weights for policy 1, policy_version 1290887 (0.0007) [2023-12-26 09:58:17,335][123091] Updated weights for policy 0, policy_version 1300294 (0.0007) [2023-12-26 09:58:17,349][123090] Updated weights for policy 1, policy_version 1290897 (0.0005) [2023-12-26 09:58:17,398][123091] Updated weights for policy 0, policy_version 1300304 (0.0006) [2023-12-26 09:58:17,405][123090] Updated weights for policy 1, policy_version 1290907 (0.0006) [2023-12-26 09:58:18,058][123091] Updated weights for policy 0, policy_version 1300314 (0.0005) [2023-12-26 09:58:18,118][123091] Updated weights for policy 0, policy_version 1300324 (0.0005) [2023-12-26 09:58:18,177][123091] Updated weights for policy 0, policy_version 1300334 (0.0005) [2023-12-26 09:58:18,179][123090] Updated weights for policy 1, policy_version 1290917 (0.0010) [2023-12-26 09:58:18,241][123090] Updated weights for policy 1, policy_version 1290927 (0.0009) [2023-12-26 09:58:18,307][123090] Updated weights for policy 1, policy_version 1290937 (0.0009) [2023-12-26 09:58:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 663371776. Throughput: 0: 8882.3, 1: 8679.2. Samples: 663384372. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:18,784][121949] Avg episode reward: [(0, '6240.179'), (1, '5386.939')] [2023-12-26 09:58:18,957][123091] Updated weights for policy 0, policy_version 1300344 (0.0010) [2023-12-26 09:58:19,012][123091] Updated weights for policy 0, policy_version 1300354 (0.0010) [2023-12-26 09:58:19,070][123091] Updated weights for policy 0, policy_version 1300364 (0.0010) [2023-12-26 09:58:19,119][123090] Updated weights for policy 1, policy_version 1290947 (0.0008) [2023-12-26 09:58:19,165][123090] Updated weights for policy 1, policy_version 1290957 (0.0005) [2023-12-26 09:58:19,228][123090] Updated weights for policy 1, policy_version 1290967 (0.0006) [2023-12-26 09:58:19,991][123091] Updated weights for policy 0, policy_version 1300374 (0.0009) [2023-12-26 09:58:19,998][123090] Updated weights for policy 1, policy_version 1290977 (0.0007) [2023-12-26 09:58:20,054][123091] Updated weights for policy 0, policy_version 1300384 (0.0010) [2023-12-26 09:58:20,061][123090] Updated weights for policy 1, policy_version 1290987 (0.0007) [2023-12-26 09:58:20,114][123091] Updated weights for policy 0, policy_version 1300394 (0.0008) [2023-12-26 09:58:20,125][123090] Updated weights for policy 1, policy_version 1290997 (0.0007) [2023-12-26 09:58:20,183][123090] Updated weights for policy 1, policy_version 1291007 (0.0010) [2023-12-26 09:58:20,999][123090] Updated weights for policy 1, policy_version 1291017 (0.0008) [2023-12-26 09:58:21,026][123091] Updated weights for policy 0, policy_version 1300404 (0.0008) [2023-12-26 09:58:21,065][123090] Updated weights for policy 1, policy_version 1291027 (0.0009) [2023-12-26 09:58:21,096][123091] Updated weights for policy 0, policy_version 1300414 (0.0009) [2023-12-26 09:58:21,130][123090] Updated weights for policy 1, policy_version 1291037 (0.0009) [2023-12-26 09:58:21,164][123091] Updated weights for policy 0, policy_version 1300424 (0.0009) [2023-12-26 09:58:21,971][123090] Updated weights for policy 1, policy_version 1291047 (0.0009) [2023-12-26 09:58:22,005][123091] Updated weights for policy 0, policy_version 1300434 (0.0009) [2023-12-26 09:58:22,035][123090] Updated weights for policy 1, policy_version 1291057 (0.0009) [2023-12-26 09:58:22,067][123091] Updated weights for policy 0, policy_version 1300444 (0.0008) [2023-12-26 09:58:22,102][123090] Updated weights for policy 1, policy_version 1291067 (0.0007) [2023-12-26 09:58:22,129][123091] Updated weights for policy 0, policy_version 1300454 (0.0009) [2023-12-26 09:58:22,191][123091] Updated weights for policy 0, policy_version 1300464 (0.0009) [2023-12-26 09:58:22,866][123090] Updated weights for policy 1, policy_version 1291077 (0.0007) [2023-12-26 09:58:22,924][123090] Updated weights for policy 1, policy_version 1291087 (0.0005) [2023-12-26 09:58:22,986][123090] Updated weights for policy 1, policy_version 1291097 (0.0005) [2023-12-26 09:58:23,107][123091] Updated weights for policy 0, policy_version 1300474 (0.0010) [2023-12-26 09:58:23,171][123091] Updated weights for policy 0, policy_version 1300484 (0.0009) [2023-12-26 09:58:23,224][123091] Updated weights for policy 0, policy_version 1300494 (0.0009) [2023-12-26 09:58:23,777][123090] Updated weights for policy 1, policy_version 1291107 (0.0007) [2023-12-26 09:58:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 663453696. Throughput: 0: 8785.6, 1: 8723.5. Samples: 663434392. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:23,784][121949] Avg episode reward: [(0, '6293.333'), (1, '5379.432')] [2023-12-26 09:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001300496_332931072.pth... [2023-12-26 09:58:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001299472_332668928.pth [2023-12-26 09:58:23,840][123090] Updated weights for policy 1, policy_version 1291117 (0.0010) [2023-12-26 09:58:23,887][123090] Updated weights for policy 1, policy_version 1291127 (0.0010) [2023-12-26 09:58:23,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001291136_330530816.pth... [2023-12-26 09:58:23,932][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001290112_330268672.pth [2023-12-26 09:58:24,067][123091] Updated weights for policy 0, policy_version 1300504 (0.0009) [2023-12-26 09:58:24,116][123091] Updated weights for policy 0, policy_version 1300514 (0.0009) [2023-12-26 09:58:24,165][123091] Updated weights for policy 0, policy_version 1300524 (0.0009) [2023-12-26 09:58:24,723][123090] Updated weights for policy 1, policy_version 1291137 (0.0010) [2023-12-26 09:58:24,786][123090] Updated weights for policy 1, policy_version 1291147 (0.0010) [2023-12-26 09:58:24,847][123090] Updated weights for policy 1, policy_version 1291157 (0.0010) [2023-12-26 09:58:24,909][123090] Updated weights for policy 1, policy_version 1291167 (0.0010) [2023-12-26 09:58:25,034][123091] Updated weights for policy 0, policy_version 1300534 (0.0008) [2023-12-26 09:58:25,087][123091] Updated weights for policy 0, policy_version 1300544 (0.0009) [2023-12-26 09:58:25,134][123091] Updated weights for policy 0, policy_version 1300554 (0.0008) [2023-12-26 09:58:25,679][123090] Updated weights for policy 1, policy_version 1291177 (0.0011) [2023-12-26 09:58:25,731][123090] Updated weights for policy 1, policy_version 1291187 (0.0010) [2023-12-26 09:58:25,788][123090] Updated weights for policy 1, policy_version 1291197 (0.0011) [2023-12-26 09:58:26,033][123091] Updated weights for policy 0, policy_version 1300564 (0.0009) [2023-12-26 09:58:26,082][123091] Updated weights for policy 0, policy_version 1300574 (0.0009) [2023-12-26 09:58:26,149][123091] Updated weights for policy 0, policy_version 1300584 (0.0009) [2023-12-26 09:58:26,508][123090] Updated weights for policy 1, policy_version 1291207 (0.0007) [2023-12-26 09:58:26,568][123090] Updated weights for policy 1, policy_version 1291217 (0.0005) [2023-12-26 09:58:26,632][123090] Updated weights for policy 1, policy_version 1291227 (0.0006) [2023-12-26 09:58:26,984][123091] Updated weights for policy 0, policy_version 1300594 (0.0009) [2023-12-26 09:58:27,039][123091] Updated weights for policy 0, policy_version 1300604 (0.0008) [2023-12-26 09:58:27,090][123091] Updated weights for policy 0, policy_version 1300614 (0.0009) [2023-12-26 09:58:27,139][123091] Updated weights for policy 0, policy_version 1300624 (0.0009) [2023-12-26 09:58:27,352][123090] Updated weights for policy 1, policy_version 1291237 (0.0007) [2023-12-26 09:58:27,419][123090] Updated weights for policy 1, policy_version 1291247 (0.0010) [2023-12-26 09:58:27,478][123090] Updated weights for policy 1, policy_version 1291257 (0.0009) [2023-12-26 09:58:27,992][123091] Updated weights for policy 0, policy_version 1300634 (0.0009) [2023-12-26 09:58:28,043][123091] Updated weights for policy 0, policy_version 1300644 (0.0009) [2023-12-26 09:58:28,092][123091] Updated weights for policy 0, policy_version 1300654 (0.0008) [2023-12-26 09:58:28,276][123090] Updated weights for policy 1, policy_version 1291267 (0.0010) [2023-12-26 09:58:28,327][123090] Updated weights for policy 1, policy_version 1291277 (0.0010) [2023-12-26 09:58:28,386][123090] Updated weights for policy 1, policy_version 1291287 (0.0010) [2023-12-26 09:58:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 663543808. Throughput: 0: 8763.4, 1: 8762.2. Samples: 663538688. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:28,785][121949] Avg episode reward: [(0, '6309.390'), (1, '5400.226')] [2023-12-26 09:58:28,938][123091] Updated weights for policy 0, policy_version 1300664 (0.0009) [2023-12-26 09:58:28,990][123091] Updated weights for policy 0, policy_version 1300674 (0.0009) [2023-12-26 09:58:29,045][123091] Updated weights for policy 0, policy_version 1300684 (0.0009) [2023-12-26 09:58:29,212][123090] Updated weights for policy 1, policy_version 1291297 (0.0010) [2023-12-26 09:58:29,275][123090] Updated weights for policy 1, policy_version 1291307 (0.0010) [2023-12-26 09:58:29,331][123090] Updated weights for policy 1, policy_version 1291317 (0.0010) [2023-12-26 09:58:29,397][123090] Updated weights for policy 1, policy_version 1291327 (0.0011) [2023-12-26 09:58:29,908][123091] Updated weights for policy 0, policy_version 1300694 (0.0009) [2023-12-26 09:58:29,971][123091] Updated weights for policy 0, policy_version 1300704 (0.0009) [2023-12-26 09:58:30,031][123091] Updated weights for policy 0, policy_version 1300714 (0.0008) [2023-12-26 09:58:30,214][123090] Updated weights for policy 1, policy_version 1291337 (0.0010) [2023-12-26 09:58:30,265][123090] Updated weights for policy 1, policy_version 1291347 (0.0010) [2023-12-26 09:58:30,316][123090] Updated weights for policy 1, policy_version 1291357 (0.0010) [2023-12-26 09:58:30,853][123091] Updated weights for policy 0, policy_version 1300724 (0.0007) [2023-12-26 09:58:30,902][123091] Updated weights for policy 0, policy_version 1300734 (0.0009) [2023-12-26 09:58:30,954][123091] Updated weights for policy 0, policy_version 1300744 (0.0009) [2023-12-26 09:58:31,147][123090] Updated weights for policy 1, policy_version 1291367 (0.0010) [2023-12-26 09:58:31,207][123090] Updated weights for policy 1, policy_version 1291377 (0.0011) [2023-12-26 09:58:31,263][123090] Updated weights for policy 1, policy_version 1291387 (0.0008) [2023-12-26 09:58:31,779][123091] Updated weights for policy 0, policy_version 1300754 (0.0008) [2023-12-26 09:58:31,838][123091] Updated weights for policy 0, policy_version 1300764 (0.0005) [2023-12-26 09:58:31,900][123091] Updated weights for policy 0, policy_version 1300774 (0.0005) [2023-12-26 09:58:31,962][123091] Updated weights for policy 0, policy_version 1300784 (0.0009) [2023-12-26 09:58:32,124][123090] Updated weights for policy 1, policy_version 1291397 (0.0009) [2023-12-26 09:58:32,176][123090] Updated weights for policy 1, policy_version 1291407 (0.0010) [2023-12-26 09:58:32,247][123090] Updated weights for policy 1, policy_version 1291417 (0.0009) [2023-12-26 09:58:32,711][123091] Updated weights for policy 0, policy_version 1300794 (0.0010) [2023-12-26 09:58:32,771][123091] Updated weights for policy 0, policy_version 1300804 (0.0009) [2023-12-26 09:58:32,833][123091] Updated weights for policy 0, policy_version 1300814 (0.0010) [2023-12-26 09:58:33,121][123090] Updated weights for policy 1, policy_version 1291427 (0.0010) [2023-12-26 09:58:33,169][123090] Updated weights for policy 1, policy_version 1291437 (0.0006) [2023-12-26 09:58:33,229][123090] Updated weights for policy 1, policy_version 1291447 (0.0010) [2023-12-26 09:58:33,632][123091] Updated weights for policy 0, policy_version 1300824 (0.0008) [2023-12-26 09:58:33,684][123091] Updated weights for policy 0, policy_version 1300834 (0.0009) [2023-12-26 09:58:33,738][123091] Updated weights for policy 0, policy_version 1300844 (0.0009) [2023-12-26 09:58:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 663633920. Throughput: 0: 8772.5, 1: 8729.2. Samples: 663642712. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:33,785][121949] Avg episode reward: [(0, '6278.279'), (1, '5408.986')] [2023-12-26 09:58:34,071][123090] Updated weights for policy 1, policy_version 1291457 (0.0009) [2023-12-26 09:58:34,136][123090] Updated weights for policy 1, policy_version 1291467 (0.0008) [2023-12-26 09:58:34,192][123090] Updated weights for policy 1, policy_version 1291477 (0.0009) [2023-12-26 09:58:34,250][123090] Updated weights for policy 1, policy_version 1291487 (0.0010) [2023-12-26 09:58:34,615][123091] Updated weights for policy 0, policy_version 1300854 (0.0010) [2023-12-26 09:58:34,684][123091] Updated weights for policy 0, policy_version 1300864 (0.0009) [2023-12-26 09:58:34,749][123091] Updated weights for policy 0, policy_version 1300874 (0.0009) [2023-12-26 09:58:35,082][123090] Updated weights for policy 1, policy_version 1291497 (0.0007) [2023-12-26 09:58:35,133][123090] Updated weights for policy 1, policy_version 1291507 (0.0010) [2023-12-26 09:58:35,189][123090] Updated weights for policy 1, policy_version 1291517 (0.0008) [2023-12-26 09:58:35,648][123091] Updated weights for policy 0, policy_version 1300884 (0.0009) [2023-12-26 09:58:35,716][123091] Updated weights for policy 0, policy_version 1300894 (0.0010) [2023-12-26 09:58:35,789][123091] Updated weights for policy 0, policy_version 1300904 (0.0010) [2023-12-26 09:58:35,866][123090] Updated weights for policy 1, policy_version 1291527 (0.0006) [2023-12-26 09:58:35,925][123090] Updated weights for policy 1, policy_version 1291537 (0.0008) [2023-12-26 09:58:35,992][123090] Updated weights for policy 1, policy_version 1291547 (0.0009) [2023-12-26 09:58:36,476][123091] Updated weights for policy 0, policy_version 1300914 (0.0008) [2023-12-26 09:58:36,533][123091] Updated weights for policy 0, policy_version 1300924 (0.0007) [2023-12-26 09:58:36,603][123091] Updated weights for policy 0, policy_version 1300934 (0.0009) [2023-12-26 09:58:36,670][123091] Updated weights for policy 0, policy_version 1300944 (0.0010) [2023-12-26 09:58:36,768][123090] Updated weights for policy 1, policy_version 1291557 (0.0008) [2023-12-26 09:58:36,837][123090] Updated weights for policy 1, policy_version 1291567 (0.0006) [2023-12-26 09:58:36,900][123090] Updated weights for policy 1, policy_version 1291577 (0.0005) [2023-12-26 09:58:37,442][123091] Updated weights for policy 0, policy_version 1300954 (0.0010) [2023-12-26 09:58:37,479][123090] Updated weights for policy 1, policy_version 1291587 (0.0006) [2023-12-26 09:58:37,490][123091] Updated weights for policy 0, policy_version 1300964 (0.0009) [2023-12-26 09:58:37,540][123090] Updated weights for policy 1, policy_version 1291597 (0.0010) [2023-12-26 09:58:37,547][123091] Updated weights for policy 0, policy_version 1300974 (0.0007) [2023-12-26 09:58:37,603][123090] Updated weights for policy 1, policy_version 1291607 (0.0010) [2023-12-26 09:58:38,357][123091] Updated weights for policy 0, policy_version 1300984 (0.0007) [2023-12-26 09:58:38,409][123091] Updated weights for policy 0, policy_version 1300994 (0.0008) [2023-12-26 09:58:38,444][123090] Updated weights for policy 1, policy_version 1291617 (0.0008) [2023-12-26 09:58:38,474][123091] Updated weights for policy 0, policy_version 1301004 (0.0009) [2023-12-26 09:58:38,513][123090] Updated weights for policy 1, policy_version 1291627 (0.0009) [2023-12-26 09:58:38,574][123090] Updated weights for policy 1, policy_version 1291637 (0.0009) [2023-12-26 09:58:38,640][123090] Updated weights for policy 1, policy_version 1291647 (0.0009) [2023-12-26 09:58:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 663724032. Throughput: 0: 8780.9, 1: 8758.1. Samples: 663695904. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:38,785][121949] Avg episode reward: [(0, '6260.889'), (1, '5532.831')] [2023-12-26 09:58:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001301008_333062144.pth... [2023-12-26 09:58:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001291648_330661888.pth... [2023-12-26 09:58:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001290624_330399744.pth [2023-12-26 09:58:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001299984_332800000.pth [2023-12-26 09:58:39,240][123091] Updated weights for policy 0, policy_version 1301014 (0.0008) [2023-12-26 09:58:39,301][123091] Updated weights for policy 0, policy_version 1301024 (0.0009) [2023-12-26 09:58:39,375][123091] Updated weights for policy 0, policy_version 1301034 (0.0009) [2023-12-26 09:58:39,603][123090] Updated weights for policy 1, policy_version 1291657 (0.0009) [2023-12-26 09:58:39,667][123090] Updated weights for policy 1, policy_version 1291667 (0.0010) [2023-12-26 09:58:39,728][123090] Updated weights for policy 1, policy_version 1291677 (0.0008) [2023-12-26 09:58:40,232][123091] Updated weights for policy 0, policy_version 1301044 (0.0010) [2023-12-26 09:58:40,291][123091] Updated weights for policy 0, policy_version 1301054 (0.0009) [2023-12-26 09:58:40,358][123091] Updated weights for policy 0, policy_version 1301064 (0.0010) [2023-12-26 09:58:40,555][123090] Updated weights for policy 1, policy_version 1291687 (0.0010) [2023-12-26 09:58:40,612][123090] Updated weights for policy 1, policy_version 1291697 (0.0009) [2023-12-26 09:58:40,668][123090] Updated weights for policy 1, policy_version 1291707 (0.0009) [2023-12-26 09:58:41,185][123091] Updated weights for policy 0, policy_version 1301074 (0.0009) [2023-12-26 09:58:41,249][123091] Updated weights for policy 0, policy_version 1301084 (0.0009) [2023-12-26 09:58:41,324][123091] Updated weights for policy 0, policy_version 1301094 (0.0006) [2023-12-26 09:58:41,397][123091] Updated weights for policy 0, policy_version 1301104 (0.0008) [2023-12-26 09:58:41,594][123090] Updated weights for policy 1, policy_version 1291717 (0.0009) [2023-12-26 09:58:41,669][123090] Updated weights for policy 1, policy_version 1291727 (0.0009) [2023-12-26 09:58:41,741][123090] Updated weights for policy 1, policy_version 1291737 (0.0009) [2023-12-26 09:58:42,184][123091] Updated weights for policy 0, policy_version 1301114 (0.0009) [2023-12-26 09:58:42,233][123091] Updated weights for policy 0, policy_version 1301124 (0.0009) [2023-12-26 09:58:42,300][123091] Updated weights for policy 0, policy_version 1301134 (0.0009) [2023-12-26 09:58:42,548][123090] Updated weights for policy 1, policy_version 1291747 (0.0010) [2023-12-26 09:58:42,616][123090] Updated weights for policy 1, policy_version 1291757 (0.0011) [2023-12-26 09:58:42,682][123090] Updated weights for policy 1, policy_version 1291767 (0.0011) [2023-12-26 09:58:43,173][123091] Updated weights for policy 0, policy_version 1301144 (0.0009) [2023-12-26 09:58:43,241][123091] Updated weights for policy 0, policy_version 1301154 (0.0009) [2023-12-26 09:58:43,290][123091] Updated weights for policy 0, policy_version 1301164 (0.0009) [2023-12-26 09:58:43,528][123090] Updated weights for policy 1, policy_version 1291777 (0.0011) [2023-12-26 09:58:43,595][123090] Updated weights for policy 1, policy_version 1291787 (0.0010) [2023-12-26 09:58:43,654][123090] Updated weights for policy 1, policy_version 1291797 (0.0010) [2023-12-26 09:58:43,719][123090] Updated weights for policy 1, policy_version 1291807 (0.0010) [2023-12-26 09:58:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 663805952. Throughput: 0: 8699.2, 1: 8677.8. Samples: 663798068. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:43,785][121949] Avg episode reward: [(0, '6240.585'), (1, '5630.666')] [2023-12-26 09:58:44,117][123091] Updated weights for policy 0, policy_version 1301174 (0.0009) [2023-12-26 09:58:44,164][123091] Updated weights for policy 0, policy_version 1301184 (0.0008) [2023-12-26 09:58:44,224][123091] Updated weights for policy 0, policy_version 1301194 (0.0009) [2023-12-26 09:58:44,539][123090] Updated weights for policy 1, policy_version 1291817 (0.0010) [2023-12-26 09:58:44,603][123090] Updated weights for policy 1, policy_version 1291827 (0.0010) [2023-12-26 09:58:44,666][123090] Updated weights for policy 1, policy_version 1291837 (0.0010) [2023-12-26 09:58:45,053][123091] Updated weights for policy 0, policy_version 1301204 (0.0007) [2023-12-26 09:58:45,131][123091] Updated weights for policy 0, policy_version 1301214 (0.0006) [2023-12-26 09:58:45,205][123091] Updated weights for policy 0, policy_version 1301224 (0.0006) [2023-12-26 09:58:45,494][123090] Updated weights for policy 1, policy_version 1291847 (0.0010) [2023-12-26 09:58:45,549][123090] Updated weights for policy 1, policy_version 1291857 (0.0010) [2023-12-26 09:58:45,608][123090] Updated weights for policy 1, policy_version 1291867 (0.0008) [2023-12-26 09:58:45,834][123091] Updated weights for policy 0, policy_version 1301234 (0.0006) [2023-12-26 09:58:45,902][123091] Updated weights for policy 0, policy_version 1301244 (0.0005) [2023-12-26 09:58:45,960][123091] Updated weights for policy 0, policy_version 1301254 (0.0005) [2023-12-26 09:58:46,021][123091] Updated weights for policy 0, policy_version 1301264 (0.0005) [2023-12-26 09:58:46,374][123090] Updated weights for policy 1, policy_version 1291877 (0.0008) [2023-12-26 09:58:46,432][123090] Updated weights for policy 1, policy_version 1291887 (0.0010) [2023-12-26 09:58:46,490][123090] Updated weights for policy 1, policy_version 1291897 (0.0010) [2023-12-26 09:58:46,691][123091] Updated weights for policy 0, policy_version 1301274 (0.0005) [2023-12-26 09:58:46,767][123091] Updated weights for policy 0, policy_version 1301284 (0.0005) [2023-12-26 09:58:46,831][123091] Updated weights for policy 0, policy_version 1301294 (0.0006) [2023-12-26 09:58:47,326][123090] Updated weights for policy 1, policy_version 1291907 (0.0010) [2023-12-26 09:58:47,381][123090] Updated weights for policy 1, policy_version 1291917 (0.0010) [2023-12-26 09:58:47,426][123091] Updated weights for policy 0, policy_version 1301304 (0.0009) [2023-12-26 09:58:47,440][123090] Updated weights for policy 1, policy_version 1291927 (0.0010) [2023-12-26 09:58:47,475][123091] Updated weights for policy 0, policy_version 1301314 (0.0006) [2023-12-26 09:58:47,518][123091] Updated weights for policy 0, policy_version 1301324 (0.0005) [2023-12-26 09:58:48,190][123091] Updated weights for policy 0, policy_version 1301334 (0.0006) [2023-12-26 09:58:48,244][123091] Updated weights for policy 0, policy_version 1301344 (0.0007) [2023-12-26 09:58:48,280][123090] Updated weights for policy 1, policy_version 1291937 (0.0010) [2023-12-26 09:58:48,294][123091] Updated weights for policy 0, policy_version 1301354 (0.0009) [2023-12-26 09:58:48,340][123090] Updated weights for policy 1, policy_version 1291947 (0.0010) [2023-12-26 09:58:48,407][123090] Updated weights for policy 1, policy_version 1291957 (0.0010) [2023-12-26 09:58:48,470][123090] Updated weights for policy 1, policy_version 1291967 (0.0010) [2023-12-26 09:58:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 663896064. Throughput: 0: 8830.7, 1: 8628.0. Samples: 663906500. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:48,785][121949] Avg episode reward: [(0, '6259.507'), (1, '5525.004')] [2023-12-26 09:58:49,065][123091] Updated weights for policy 0, policy_version 1301364 (0.0010) [2023-12-26 09:58:49,122][123091] Updated weights for policy 0, policy_version 1301374 (0.0006) [2023-12-26 09:58:49,172][123091] Updated weights for policy 0, policy_version 1301384 (0.0005) [2023-12-26 09:58:49,283][123090] Updated weights for policy 1, policy_version 1291977 (0.0007) [2023-12-26 09:58:49,351][123090] Updated weights for policy 1, policy_version 1291987 (0.0008) [2023-12-26 09:58:49,417][123090] Updated weights for policy 1, policy_version 1291997 (0.0009) [2023-12-26 09:58:49,919][123091] Updated weights for policy 0, policy_version 1301394 (0.0006) [2023-12-26 09:58:49,990][123091] Updated weights for policy 0, policy_version 1301404 (0.0008) [2023-12-26 09:58:50,049][123091] Updated weights for policy 0, policy_version 1301414 (0.0008) [2023-12-26 09:58:50,111][123091] Updated weights for policy 0, policy_version 1301424 (0.0008) [2023-12-26 09:58:50,220][123090] Updated weights for policy 1, policy_version 1292007 (0.0010) [2023-12-26 09:58:50,283][123090] Updated weights for policy 1, policy_version 1292017 (0.0011) [2023-12-26 09:58:50,338][123090] Updated weights for policy 1, policy_version 1292027 (0.0010) [2023-12-26 09:58:50,897][123091] Updated weights for policy 0, policy_version 1301434 (0.0011) [2023-12-26 09:58:50,968][123091] Updated weights for policy 0, policy_version 1301444 (0.0011) [2023-12-26 09:58:51,041][123091] Updated weights for policy 0, policy_version 1301454 (0.0009) [2023-12-26 09:58:51,197][123090] Updated weights for policy 1, policy_version 1292037 (0.0010) [2023-12-26 09:58:51,259][123090] Updated weights for policy 1, policy_version 1292047 (0.0011) [2023-12-26 09:58:51,322][123090] Updated weights for policy 1, policy_version 1292057 (0.0009) [2023-12-26 09:58:51,864][123091] Updated weights for policy 0, policy_version 1301464 (0.0009) [2023-12-26 09:58:51,919][123091] Updated weights for policy 0, policy_version 1301474 (0.0009) [2023-12-26 09:58:51,987][123091] Updated weights for policy 0, policy_version 1301484 (0.0010) [2023-12-26 09:58:52,123][123090] Updated weights for policy 1, policy_version 1292067 (0.0009) [2023-12-26 09:58:52,187][123090] Updated weights for policy 1, policy_version 1292077 (0.0010) [2023-12-26 09:58:52,260][123090] Updated weights for policy 1, policy_version 1292087 (0.0009) [2023-12-26 09:58:52,812][123091] Updated weights for policy 0, policy_version 1301494 (0.0007) [2023-12-26 09:58:52,888][123091] Updated weights for policy 0, policy_version 1301504 (0.0006) [2023-12-26 09:58:52,957][123091] Updated weights for policy 0, policy_version 1301514 (0.0006) [2023-12-26 09:58:53,086][123090] Updated weights for policy 1, policy_version 1292097 (0.0009) [2023-12-26 09:58:53,149][123090] Updated weights for policy 1, policy_version 1292107 (0.0008) [2023-12-26 09:58:53,204][123090] Updated weights for policy 1, policy_version 1292117 (0.0006) [2023-12-26 09:58:53,252][123090] Updated weights for policy 1, policy_version 1292127 (0.0005) [2023-12-26 09:58:53,624][123091] Updated weights for policy 0, policy_version 1301524 (0.0007) [2023-12-26 09:58:53,672][123091] Updated weights for policy 0, policy_version 1301534 (0.0009) [2023-12-26 09:58:53,740][123091] Updated weights for policy 0, policy_version 1301544 (0.0010) [2023-12-26 09:58:53,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 663977984. Throughput: 0: 8823.2, 1: 8655.8. Samples: 663959224. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:53,786][121949] Avg episode reward: [(0, '6243.386'), (1, '5322.435')] [2023-12-26 09:58:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001292128_330784768.pth... [2023-12-26 09:58:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001301552_333201408.pth... [2023-12-26 09:58:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001291136_330530816.pth [2023-12-26 09:58:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001300496_332931072.pth [2023-12-26 09:58:54,031][123090] Updated weights for policy 1, policy_version 1292137 (0.0010) [2023-12-26 09:58:54,084][123090] Updated weights for policy 1, policy_version 1292147 (0.0009) [2023-12-26 09:58:54,136][123090] Updated weights for policy 1, policy_version 1292157 (0.0009) [2023-12-26 09:58:54,422][123091] Updated weights for policy 0, policy_version 1301554 (0.0008) [2023-12-26 09:58:54,476][123091] Updated weights for policy 0, policy_version 1301564 (0.0005) [2023-12-26 09:58:54,534][123091] Updated weights for policy 0, policy_version 1301574 (0.0005) [2023-12-26 09:58:54,606][123091] Updated weights for policy 0, policy_version 1301584 (0.0006) [2023-12-26 09:58:55,055][123090] Updated weights for policy 1, policy_version 1292167 (0.0009) [2023-12-26 09:58:55,110][123090] Updated weights for policy 1, policy_version 1292177 (0.0009) [2023-12-26 09:58:55,164][123090] Updated weights for policy 1, policy_version 1292187 (0.0010) [2023-12-26 09:58:55,256][123091] Updated weights for policy 0, policy_version 1301594 (0.0006) [2023-12-26 09:58:55,321][123091] Updated weights for policy 0, policy_version 1301604 (0.0006) [2023-12-26 09:58:55,388][123091] Updated weights for policy 0, policy_version 1301614 (0.0005) [2023-12-26 09:58:56,052][123090] Updated weights for policy 1, policy_version 1292197 (0.0009) [2023-12-26 09:58:56,082][123091] Updated weights for policy 0, policy_version 1301624 (0.0010) [2023-12-26 09:58:56,110][123090] Updated weights for policy 1, policy_version 1292207 (0.0010) [2023-12-26 09:58:56,134][123091] Updated weights for policy 0, policy_version 1301634 (0.0011) [2023-12-26 09:58:56,171][123090] Updated weights for policy 1, policy_version 1292217 (0.0007) [2023-12-26 09:58:56,190][123091] Updated weights for policy 0, policy_version 1301644 (0.0009) [2023-12-26 09:58:56,965][123090] Updated weights for policy 1, policy_version 1292227 (0.0007) [2023-12-26 09:58:57,031][123090] Updated weights for policy 1, policy_version 1292237 (0.0008) [2023-12-26 09:58:57,059][123091] Updated weights for policy 0, policy_version 1301654 (0.0009) [2023-12-26 09:58:57,097][123090] Updated weights for policy 1, policy_version 1292247 (0.0008) [2023-12-26 09:58:57,106][123091] Updated weights for policy 0, policy_version 1301664 (0.0008) [2023-12-26 09:58:57,153][123091] Updated weights for policy 0, policy_version 1301674 (0.0009) [2023-12-26 09:58:57,864][123090] Updated weights for policy 1, policy_version 1292257 (0.0007) [2023-12-26 09:58:57,892][123091] Updated weights for policy 0, policy_version 1301684 (0.0007) [2023-12-26 09:58:57,934][123090] Updated weights for policy 1, policy_version 1292267 (0.0005) [2023-12-26 09:58:57,951][123091] Updated weights for policy 0, policy_version 1301694 (0.0005) [2023-12-26 09:58:58,010][123090] Updated weights for policy 1, policy_version 1292277 (0.0006) [2023-12-26 09:58:58,022][123091] Updated weights for policy 0, policy_version 1301704 (0.0006) [2023-12-26 09:58:58,079][123090] Updated weights for policy 1, policy_version 1292287 (0.0007) [2023-12-26 09:58:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 664068096. Throughput: 0: 8894.6, 1: 8692.9. Samples: 664066764. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:58:58,784][121949] Avg episode reward: [(0, '6226.703'), (1, '5391.601')] [2023-12-26 09:58:58,800][123090] Updated weights for policy 1, policy_version 1292297 (0.0009) [2023-12-26 09:58:58,873][123090] Updated weights for policy 1, policy_version 1292307 (0.0009) [2023-12-26 09:58:58,903][123091] Updated weights for policy 0, policy_version 1301714 (0.0009) [2023-12-26 09:58:58,938][123090] Updated weights for policy 1, policy_version 1292317 (0.0008) [2023-12-26 09:58:58,954][123091] Updated weights for policy 0, policy_version 1301724 (0.0008) [2023-12-26 09:58:59,028][123091] Updated weights for policy 0, policy_version 1301734 (0.0008) [2023-12-26 09:58:59,094][123091] Updated weights for policy 0, policy_version 1301744 (0.0007) [2023-12-26 09:58:59,882][123090] Updated weights for policy 1, policy_version 1292327 (0.0008) [2023-12-26 09:58:59,899][123091] Updated weights for policy 0, policy_version 1301754 (0.0007) [2023-12-26 09:58:59,947][123090] Updated weights for policy 1, policy_version 1292337 (0.0008) [2023-12-26 09:58:59,968][123091] Updated weights for policy 0, policy_version 1301764 (0.0009) [2023-12-26 09:59:00,011][123090] Updated weights for policy 1, policy_version 1292347 (0.0008) [2023-12-26 09:59:00,032][123091] Updated weights for policy 0, policy_version 1301774 (0.0009) [2023-12-26 09:59:00,778][123091] Updated weights for policy 0, policy_version 1301784 (0.0008) [2023-12-26 09:59:00,780][123090] Updated weights for policy 1, policy_version 1292357 (0.0008) [2023-12-26 09:59:00,823][123091] Updated weights for policy 0, policy_version 1301794 (0.0007) [2023-12-26 09:59:00,841][123090] Updated weights for policy 1, policy_version 1292367 (0.0010) [2023-12-26 09:59:00,867][123091] Updated weights for policy 0, policy_version 1301804 (0.0008) [2023-12-26 09:59:00,903][123090] Updated weights for policy 1, policy_version 1292377 (0.0009) [2023-12-26 09:59:01,738][123091] Updated weights for policy 0, policy_version 1301814 (0.0008) [2023-12-26 09:59:01,764][123090] Updated weights for policy 1, policy_version 1292387 (0.0009) [2023-12-26 09:59:01,801][123091] Updated weights for policy 0, policy_version 1301824 (0.0008) [2023-12-26 09:59:01,817][123090] Updated weights for policy 1, policy_version 1292397 (0.0005) [2023-12-26 09:59:01,855][123091] Updated weights for policy 0, policy_version 1301834 (0.0008) [2023-12-26 09:59:01,874][123090] Updated weights for policy 1, policy_version 1292407 (0.0005) [2023-12-26 09:59:02,572][123091] Updated weights for policy 0, policy_version 1301844 (0.0007) [2023-12-26 09:59:02,605][123090] Updated weights for policy 1, policy_version 1292417 (0.0006) [2023-12-26 09:59:02,631][123091] Updated weights for policy 0, policy_version 1301854 (0.0005) [2023-12-26 09:59:02,670][123090] Updated weights for policy 1, policy_version 1292427 (0.0008) [2023-12-26 09:59:02,686][123091] Updated weights for policy 0, policy_version 1301864 (0.0007) [2023-12-26 09:59:02,736][123090] Updated weights for policy 1, policy_version 1292437 (0.0008) [2023-12-26 09:59:02,793][123090] Updated weights for policy 1, policy_version 1292447 (0.0006) [2023-12-26 09:59:03,407][123090] Updated weights for policy 1, policy_version 1292457 (0.0005) [2023-12-26 09:59:03,465][123090] Updated weights for policy 1, policy_version 1292467 (0.0005) [2023-12-26 09:59:03,472][123091] Updated weights for policy 0, policy_version 1301874 (0.0010) [2023-12-26 09:59:03,512][123090] Updated weights for policy 1, policy_version 1292477 (0.0005) [2023-12-26 09:59:03,529][123091] Updated weights for policy 0, policy_version 1301884 (0.0007) [2023-12-26 09:59:03,575][123091] Updated weights for policy 0, policy_version 1301894 (0.0005) [2023-12-26 09:59:03,621][123091] Updated weights for policy 0, policy_version 1301904 (0.0005) [2023-12-26 09:59:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 664166400. Throughput: 0: 8842.2, 1: 8712.8. Samples: 664174348. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:59:03,785][121949] Avg episode reward: [(0, '6242.366'), (1, '5633.305')] [2023-12-26 09:59:04,202][123090] Updated weights for policy 1, policy_version 1292487 (0.0005) [2023-12-26 09:59:04,283][123090] Updated weights for policy 1, policy_version 1292497 (0.0008) [2023-12-26 09:59:04,320][123091] Updated weights for policy 0, policy_version 1301914 (0.0006) [2023-12-26 09:59:04,348][123090] Updated weights for policy 1, policy_version 1292507 (0.0009) [2023-12-26 09:59:04,383][123091] Updated weights for policy 0, policy_version 1301924 (0.0006) [2023-12-26 09:59:04,454][123091] Updated weights for policy 0, policy_version 1301934 (0.0006) [2023-12-26 09:59:05,084][123091] Updated weights for policy 0, policy_version 1301944 (0.0009) [2023-12-26 09:59:05,137][123091] Updated weights for policy 0, policy_version 1301954 (0.0005) [2023-12-26 09:59:05,169][123090] Updated weights for policy 1, policy_version 1292517 (0.0007) [2023-12-26 09:59:05,201][123091] Updated weights for policy 0, policy_version 1301964 (0.0007) [2023-12-26 09:59:05,226][123090] Updated weights for policy 1, policy_version 1292527 (0.0006) [2023-12-26 09:59:05,286][123090] Updated weights for policy 1, policy_version 1292537 (0.0006) [2023-12-26 09:59:05,919][123090] Updated weights for policy 1, policy_version 1292547 (0.0006) [2023-12-26 09:59:05,936][123091] Updated weights for policy 0, policy_version 1301974 (0.0007) [2023-12-26 09:59:05,982][123090] Updated weights for policy 1, policy_version 1292557 (0.0005) [2023-12-26 09:59:05,982][123091] Updated weights for policy 0, policy_version 1301984 (0.0005) [2023-12-26 09:59:06,031][123091] Updated weights for policy 0, policy_version 1301994 (0.0005) [2023-12-26 09:59:06,044][123090] Updated weights for policy 1, policy_version 1292567 (0.0006) [2023-12-26 09:59:06,847][123091] Updated weights for policy 0, policy_version 1302004 (0.0007) [2023-12-26 09:59:06,869][123090] Updated weights for policy 1, policy_version 1292577 (0.0006) [2023-12-26 09:59:06,907][123091] Updated weights for policy 0, policy_version 1302014 (0.0011) [2023-12-26 09:59:06,933][123090] Updated weights for policy 1, policy_version 1292587 (0.0011) [2023-12-26 09:59:06,963][123091] Updated weights for policy 0, policy_version 1302024 (0.0008) [2023-12-26 09:59:06,998][123090] Updated weights for policy 1, policy_version 1292597 (0.0011) [2023-12-26 09:59:07,061][123090] Updated weights for policy 1, policy_version 1292607 (0.0011) [2023-12-26 09:59:07,669][123091] Updated weights for policy 0, policy_version 1302034 (0.0007) [2023-12-26 09:59:07,717][123091] Updated weights for policy 0, policy_version 1302044 (0.0006) [2023-12-26 09:59:07,757][123090] Updated weights for policy 1, policy_version 1292617 (0.0010) [2023-12-26 09:59:07,764][123091] Updated weights for policy 0, policy_version 1302054 (0.0010) [2023-12-26 09:59:07,811][123091] Updated weights for policy 0, policy_version 1302064 (0.0010) [2023-12-26 09:59:07,820][123090] Updated weights for policy 1, policy_version 1292627 (0.0010) [2023-12-26 09:59:07,879][123090] Updated weights for policy 1, policy_version 1292637 (0.0010) [2023-12-26 09:59:08,550][123091] Updated weights for policy 0, policy_version 1302074 (0.0006) [2023-12-26 09:59:08,625][123091] Updated weights for policy 0, policy_version 1302084 (0.0006) [2023-12-26 09:59:08,693][123091] Updated weights for policy 0, policy_version 1302094 (0.0005) [2023-12-26 09:59:08,701][123090] Updated weights for policy 1, policy_version 1292647 (0.0011) [2023-12-26 09:59:08,772][123090] Updated weights for policy 1, policy_version 1292657 (0.0011) [2023-12-26 09:59:08,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 664256512. Throughput: 0: 8962.9, 1: 8754.6. Samples: 664231684. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:59:08,786][121949] Avg episode reward: [(0, '6223.670'), (1, '5588.925')] [2023-12-26 09:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001302096_333340672.pth... [2023-12-26 09:59:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001301008_333062144.pth [2023-12-26 09:59:08,831][123090] Updated weights for policy 1, policy_version 1292667 (0.0010) [2023-12-26 09:59:08,862][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001292672_330924032.pth... [2023-12-26 09:59:08,867][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001291648_330661888.pth [2023-12-26 09:59:09,371][123091] Updated weights for policy 0, policy_version 1302104 (0.0008) [2023-12-26 09:59:09,439][123091] Updated weights for policy 0, policy_version 1302114 (0.0009) [2023-12-26 09:59:09,514][123091] Updated weights for policy 0, policy_version 1302124 (0.0006) [2023-12-26 09:59:09,598][123090] Updated weights for policy 1, policy_version 1292677 (0.0010) [2023-12-26 09:59:09,668][123090] Updated weights for policy 1, policy_version 1292687 (0.0006) [2023-12-26 09:59:09,747][123090] Updated weights for policy 1, policy_version 1292697 (0.0005) [2023-12-26 09:59:10,239][123091] Updated weights for policy 0, policy_version 1302134 (0.0005) [2023-12-26 09:59:10,300][123091] Updated weights for policy 0, policy_version 1302144 (0.0006) [2023-12-26 09:59:10,369][123091] Updated weights for policy 0, policy_version 1302154 (0.0007) [2023-12-26 09:59:10,466][123090] Updated weights for policy 1, policy_version 1292707 (0.0007) [2023-12-26 09:59:10,538][123090] Updated weights for policy 1, policy_version 1292717 (0.0009) [2023-12-26 09:59:10,599][123090] Updated weights for policy 1, policy_version 1292727 (0.0008) [2023-12-26 09:59:11,203][123091] Updated weights for policy 0, policy_version 1302164 (0.0009) [2023-12-26 09:59:11,269][123091] Updated weights for policy 0, policy_version 1302174 (0.0010) [2023-12-26 09:59:11,339][123090] Updated weights for policy 1, policy_version 1292737 (0.0009) [2023-12-26 09:59:11,339][123091] Updated weights for policy 0, policy_version 1302184 (0.0009) [2023-12-26 09:59:11,410][123090] Updated weights for policy 1, policy_version 1292747 (0.0010) [2023-12-26 09:59:11,467][123090] Updated weights for policy 1, policy_version 1292757 (0.0010) [2023-12-26 09:59:11,523][123090] Updated weights for policy 1, policy_version 1292767 (0.0011) [2023-12-26 09:59:12,227][123091] Updated weights for policy 0, policy_version 1302194 (0.0010) [2023-12-26 09:59:12,292][123091] Updated weights for policy 0, policy_version 1302204 (0.0010) [2023-12-26 09:59:12,359][123091] Updated weights for policy 0, policy_version 1302214 (0.0009) [2023-12-26 09:59:12,387][123090] Updated weights for policy 1, policy_version 1292777 (0.0009) [2023-12-26 09:59:12,428][123091] Updated weights for policy 0, policy_version 1302224 (0.0009) [2023-12-26 09:59:12,450][123090] Updated weights for policy 1, policy_version 1292787 (0.0009) [2023-12-26 09:59:12,504][123090] Updated weights for policy 1, policy_version 1292797 (0.0010) [2023-12-26 09:59:13,272][123091] Updated weights for policy 0, policy_version 1302234 (0.0009) [2023-12-26 09:59:13,330][123091] Updated weights for policy 0, policy_version 1302244 (0.0010) [2023-12-26 09:59:13,337][123090] Updated weights for policy 1, policy_version 1292807 (0.0007) [2023-12-26 09:59:13,387][123091] Updated weights for policy 0, policy_version 1302254 (0.0008) [2023-12-26 09:59:13,399][123090] Updated weights for policy 1, policy_version 1292817 (0.0008) [2023-12-26 09:59:13,454][123090] Updated weights for policy 1, policy_version 1292827 (0.0006) [2023-12-26 09:59:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 664346624. Throughput: 0: 9059.3, 1: 8725.7. Samples: 664339012. Policy #0 lag: (min: 22.0, avg: 22.0, max: 22.0) [2023-12-26 09:59:13,785][121949] Avg episode reward: [(0, '6334.260'), (1, '5589.034')] [2023-12-26 09:59:14,171][123090] Updated weights for policy 1, policy_version 1292837 (0.0008) [2023-12-26 09:59:14,239][123090] Updated weights for policy 1, policy_version 1292847 (0.0010) [2023-12-26 09:59:14,274][123091] Updated weights for policy 0, policy_version 1302264 (0.0008) [2023-12-26 09:59:14,301][123090] Updated weights for policy 1, policy_version 1292857 (0.0009) [2023-12-26 09:59:14,344][123091] Updated weights for policy 0, policy_version 1302274 (0.0008) [2023-12-26 09:59:14,410][123091] Updated weights for policy 0, policy_version 1302284 (0.0010) [2023-12-26 09:59:15,079][123090] Updated weights for policy 1, policy_version 1292867 (0.0007) [2023-12-26 09:59:15,132][123090] Updated weights for policy 1, policy_version 1292877 (0.0006) [2023-12-26 09:59:15,187][123090] Updated weights for policy 1, policy_version 1292887 (0.0008) [2023-12-26 09:59:15,265][123091] Updated weights for policy 0, policy_version 1302294 (0.0009) [2023-12-26 09:59:15,321][123091] Updated weights for policy 0, policy_version 1302304 (0.0010) [2023-12-26 09:59:15,377][123091] Updated weights for policy 0, policy_version 1302314 (0.0010) [2023-12-26 09:59:16,024][123090] Updated weights for policy 1, policy_version 1292897 (0.0009) [2023-12-26 09:59:16,072][123090] Updated weights for policy 1, policy_version 1292907 (0.0009) [2023-12-26 09:59:16,131][123090] Updated weights for policy 1, policy_version 1292917 (0.0009) [2023-12-26 09:59:16,198][123090] Updated weights for policy 1, policy_version 1292927 (0.0009) [2023-12-26 09:59:16,215][123091] Updated weights for policy 0, policy_version 1302324 (0.0009) [2023-12-26 09:59:16,265][123091] Updated weights for policy 0, policy_version 1302334 (0.0009) [2023-12-26 09:59:16,318][123091] Updated weights for policy 0, policy_version 1302344 (0.0009) [2023-12-26 09:59:17,027][123090] Updated weights for policy 1, policy_version 1292937 (0.0009) [2023-12-26 09:59:17,084][123090] Updated weights for policy 1, policy_version 1292947 (0.0009) [2023-12-26 09:59:17,146][123091] Updated weights for policy 0, policy_version 1302354 (0.0009) [2023-12-26 09:59:17,153][123090] Updated weights for policy 1, policy_version 1292957 (0.0008) [2023-12-26 09:59:17,208][123091] Updated weights for policy 0, policy_version 1302364 (0.0009) [2023-12-26 09:59:17,263][123091] Updated weights for policy 0, policy_version 1302374 (0.0005) [2023-12-26 09:59:17,318][123091] Updated weights for policy 0, policy_version 1302384 (0.0006) [2023-12-26 09:59:17,987][123090] Updated weights for policy 1, policy_version 1292967 (0.0005) [2023-12-26 09:59:18,057][123090] Updated weights for policy 1, policy_version 1292977 (0.0009) [2023-12-26 09:59:18,093][123091] Updated weights for policy 0, policy_version 1302394 (0.0009) [2023-12-26 09:59:18,123][123090] Updated weights for policy 1, policy_version 1292987 (0.0007) [2023-12-26 09:59:18,147][123091] Updated weights for policy 0, policy_version 1302404 (0.0009) [2023-12-26 09:59:18,196][123091] Updated weights for policy 0, policy_version 1302414 (0.0009) [2023-12-26 09:59:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 664428544. Throughput: 0: 8996.5, 1: 8778.1. Samples: 664442572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:18,785][121949] Avg episode reward: [(0, '6332.750'), (1, '5529.062')] [2023-12-26 09:59:18,913][123090] Updated weights for policy 1, policy_version 1292997 (0.0008) [2023-12-26 09:59:18,977][123090] Updated weights for policy 1, policy_version 1293007 (0.0009) [2023-12-26 09:59:19,042][123090] Updated weights for policy 1, policy_version 1293017 (0.0009) [2023-12-26 09:59:19,064][123091] Updated weights for policy 0, policy_version 1302424 (0.0010) [2023-12-26 09:59:19,114][123091] Updated weights for policy 0, policy_version 1302434 (0.0008) [2023-12-26 09:59:19,197][123091] Updated weights for policy 0, policy_version 1302444 (0.0010) [2023-12-26 09:59:19,885][123090] Updated weights for policy 1, policy_version 1293027 (0.0009) [2023-12-26 09:59:19,960][123090] Updated weights for policy 1, policy_version 1293037 (0.0009) [2023-12-26 09:59:20,027][123090] Updated weights for policy 1, policy_version 1293047 (0.0009) [2023-12-26 09:59:20,048][123091] Updated weights for policy 0, policy_version 1302454 (0.0008) [2023-12-26 09:59:20,112][123091] Updated weights for policy 0, policy_version 1302464 (0.0008) [2023-12-26 09:59:20,167][123091] Updated weights for policy 0, policy_version 1302474 (0.0010) [2023-12-26 09:59:20,861][123090] Updated weights for policy 1, policy_version 1293057 (0.0008) [2023-12-26 09:59:20,913][123090] Updated weights for policy 1, policy_version 1293067 (0.0009) [2023-12-26 09:59:20,974][123090] Updated weights for policy 1, policy_version 1293077 (0.0010) [2023-12-26 09:59:21,005][123091] Updated weights for policy 0, policy_version 1302484 (0.0009) [2023-12-26 09:59:21,043][123090] Updated weights for policy 1, policy_version 1293087 (0.0009) [2023-12-26 09:59:21,075][123091] Updated weights for policy 0, policy_version 1302494 (0.0009) [2023-12-26 09:59:21,142][123091] Updated weights for policy 0, policy_version 1302504 (0.0009) [2023-12-26 09:59:21,954][123091] Updated weights for policy 0, policy_version 1302514 (0.0010) [2023-12-26 09:59:21,976][123090] Updated weights for policy 1, policy_version 1293097 (0.0010) [2023-12-26 09:59:22,020][123091] Updated weights for policy 0, policy_version 1302524 (0.0009) [2023-12-26 09:59:22,035][123090] Updated weights for policy 1, policy_version 1293107 (0.0009) [2023-12-26 09:59:22,086][123091] Updated weights for policy 0, policy_version 1302534 (0.0009) [2023-12-26 09:59:22,102][123090] Updated weights for policy 1, policy_version 1293117 (0.0009) [2023-12-26 09:59:22,154][123091] Updated weights for policy 0, policy_version 1302544 (0.0009) [2023-12-26 09:59:22,920][123091] Updated weights for policy 0, policy_version 1302554 (0.0010) [2023-12-26 09:59:22,987][123091] Updated weights for policy 0, policy_version 1302564 (0.0010) [2023-12-26 09:59:22,991][123090] Updated weights for policy 1, policy_version 1293127 (0.0008) [2023-12-26 09:59:23,049][123091] Updated weights for policy 0, policy_version 1302574 (0.0009) [2023-12-26 09:59:23,057][123090] Updated weights for policy 1, policy_version 1293137 (0.0009) [2023-12-26 09:59:23,123][123090] Updated weights for policy 1, policy_version 1293147 (0.0010) [2023-12-26 09:59:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 664510464. Throughput: 0: 8993.0, 1: 8699.2. Samples: 664492052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:23,785][121949] Avg episode reward: [(0, '6287.290'), (1, '5611.243')] [2023-12-26 09:59:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001302576_333463552.pth... [2023-12-26 09:59:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001293152_331046912.pth... [2023-12-26 09:59:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001301552_333201408.pth [2023-12-26 09:59:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001292128_330784768.pth [2023-12-26 09:59:23,879][123091] Updated weights for policy 0, policy_version 1302584 (0.0010) [2023-12-26 09:59:23,880][123090] Updated weights for policy 1, policy_version 1293157 (0.0008) [2023-12-26 09:59:23,939][123091] Updated weights for policy 0, policy_version 1302594 (0.0011) [2023-12-26 09:59:23,947][123090] Updated weights for policy 1, policy_version 1293167 (0.0005) [2023-12-26 09:59:23,998][123091] Updated weights for policy 0, policy_version 1302604 (0.0011) [2023-12-26 09:59:24,009][123090] Updated weights for policy 1, policy_version 1293177 (0.0006) [2023-12-26 09:59:24,688][123090] Updated weights for policy 1, policy_version 1293187 (0.0005) [2023-12-26 09:59:24,746][123090] Updated weights for policy 1, policy_version 1293197 (0.0005) [2023-12-26 09:59:24,805][123090] Updated weights for policy 1, policy_version 1293207 (0.0007) [2023-12-26 09:59:24,827][123091] Updated weights for policy 0, policy_version 1302614 (0.0010) [2023-12-26 09:59:24,871][123091] Updated weights for policy 0, policy_version 1302624 (0.0010) [2023-12-26 09:59:24,922][123091] Updated weights for policy 0, policy_version 1302634 (0.0010) [2023-12-26 09:59:25,452][123090] Updated weights for policy 1, policy_version 1293217 (0.0005) [2023-12-26 09:59:25,517][123090] Updated weights for policy 1, policy_version 1293227 (0.0005) [2023-12-26 09:59:25,583][123090] Updated weights for policy 1, policy_version 1293237 (0.0005) [2023-12-26 09:59:25,644][123090] Updated weights for policy 1, policy_version 1293247 (0.0007) [2023-12-26 09:59:25,730][123091] Updated weights for policy 0, policy_version 1302644 (0.0009) [2023-12-26 09:59:25,777][123091] Updated weights for policy 0, policy_version 1302654 (0.0006) [2023-12-26 09:59:25,823][123091] Updated weights for policy 0, policy_version 1302664 (0.0005) [2023-12-26 09:59:26,498][123090] Updated weights for policy 1, policy_version 1293257 (0.0010) [2023-12-26 09:59:26,501][123091] Updated weights for policy 0, policy_version 1302674 (0.0006) [2023-12-26 09:59:26,553][123091] Updated weights for policy 0, policy_version 1302684 (0.0007) [2023-12-26 09:59:26,555][123090] Updated weights for policy 1, policy_version 1293267 (0.0009) [2023-12-26 09:59:26,599][123091] Updated weights for policy 0, policy_version 1302694 (0.0009) [2023-12-26 09:59:26,624][123090] Updated weights for policy 1, policy_version 1293277 (0.0007) [2023-12-26 09:59:26,653][123091] Updated weights for policy 0, policy_version 1302704 (0.0009) [2023-12-26 09:59:27,413][123090] Updated weights for policy 1, policy_version 1293287 (0.0008) [2023-12-26 09:59:27,469][123090] Updated weights for policy 1, policy_version 1293297 (0.0006) [2023-12-26 09:59:27,504][123091] Updated weights for policy 0, policy_version 1302714 (0.0009) [2023-12-26 09:59:27,529][123090] Updated weights for policy 1, policy_version 1293307 (0.0006) [2023-12-26 09:59:27,553][123091] Updated weights for policy 0, policy_version 1302724 (0.0010) [2023-12-26 09:59:27,601][123091] Updated weights for policy 0, policy_version 1302734 (0.0009) [2023-12-26 09:59:28,337][123090] Updated weights for policy 1, policy_version 1293317 (0.0008) [2023-12-26 09:59:28,404][123090] Updated weights for policy 1, policy_version 1293327 (0.0010) [2023-12-26 09:59:28,430][123091] Updated weights for policy 0, policy_version 1302744 (0.0007) [2023-12-26 09:59:28,453][123090] Updated weights for policy 1, policy_version 1293337 (0.0009) [2023-12-26 09:59:28,499][123091] Updated weights for policy 0, policy_version 1302754 (0.0008) [2023-12-26 09:59:28,556][123091] Updated weights for policy 0, policy_version 1302764 (0.0009) [2023-12-26 09:59:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 664608768. Throughput: 0: 9030.7, 1: 8782.2. Samples: 664599656. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:28,786][121949] Avg episode reward: [(0, '6224.946'), (1, '5748.122')] [2023-12-26 09:59:29,280][123090] Updated weights for policy 1, policy_version 1293347 (0.0008) [2023-12-26 09:59:29,351][123090] Updated weights for policy 1, policy_version 1293357 (0.0009) [2023-12-26 09:59:29,387][123091] Updated weights for policy 0, policy_version 1302774 (0.0009) [2023-12-26 09:59:29,421][123090] Updated weights for policy 1, policy_version 1293367 (0.0008) [2023-12-26 09:59:29,448][123091] Updated weights for policy 0, policy_version 1302784 (0.0008) [2023-12-26 09:59:29,509][123091] Updated weights for policy 0, policy_version 1302794 (0.0010) [2023-12-26 09:59:30,107][123090] Updated weights for policy 1, policy_version 1293377 (0.0005) [2023-12-26 09:59:30,172][123090] Updated weights for policy 1, policy_version 1293387 (0.0009) [2023-12-26 09:59:30,239][123090] Updated weights for policy 1, policy_version 1293397 (0.0010) [2023-12-26 09:59:30,306][123090] Updated weights for policy 1, policy_version 1293407 (0.0010) [2023-12-26 09:59:30,334][123091] Updated weights for policy 0, policy_version 1302804 (0.0009) [2023-12-26 09:59:30,392][123091] Updated weights for policy 0, policy_version 1302814 (0.0005) [2023-12-26 09:59:30,457][123091] Updated weights for policy 0, policy_version 1302824 (0.0008) [2023-12-26 09:59:31,008][123090] Updated weights for policy 1, policy_version 1293417 (0.0007) [2023-12-26 09:59:31,074][123090] Updated weights for policy 1, policy_version 1293427 (0.0009) [2023-12-26 09:59:31,133][123090] Updated weights for policy 1, policy_version 1293437 (0.0009) [2023-12-26 09:59:31,262][123091] Updated weights for policy 0, policy_version 1302834 (0.0010) [2023-12-26 09:59:31,316][123091] Updated weights for policy 0, policy_version 1302844 (0.0009) [2023-12-26 09:59:31,388][123091] Updated weights for policy 0, policy_version 1302854 (0.0009) [2023-12-26 09:59:31,449][123091] Updated weights for policy 0, policy_version 1302864 (0.0009) [2023-12-26 09:59:31,987][123090] Updated weights for policy 1, policy_version 1293447 (0.0009) [2023-12-26 09:59:32,043][123090] Updated weights for policy 1, policy_version 1293457 (0.0009) [2023-12-26 09:59:32,104][123090] Updated weights for policy 1, policy_version 1293467 (0.0010) [2023-12-26 09:59:32,288][123091] Updated weights for policy 0, policy_version 1302874 (0.0010) [2023-12-26 09:59:32,356][123091] Updated weights for policy 0, policy_version 1302884 (0.0009) [2023-12-26 09:59:32,428][123091] Updated weights for policy 0, policy_version 1302894 (0.0010) [2023-12-26 09:59:32,921][123090] Updated weights for policy 1, policy_version 1293477 (0.0009) [2023-12-26 09:59:32,970][123090] Updated weights for policy 1, policy_version 1293487 (0.0009) [2023-12-26 09:59:33,018][123090] Updated weights for policy 1, policy_version 1293497 (0.0009) [2023-12-26 09:59:33,243][123091] Updated weights for policy 0, policy_version 1302904 (0.0009) [2023-12-26 09:59:33,308][123091] Updated weights for policy 0, policy_version 1302914 (0.0010) [2023-12-26 09:59:33,374][123091] Updated weights for policy 0, policy_version 1302924 (0.0010) [2023-12-26 09:59:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 664690688. Throughput: 0: 8903.8, 1: 8817.0. Samples: 664703936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:33,785][121949] Avg episode reward: [(0, '6203.464'), (1, '5610.640')] [2023-12-26 09:59:33,802][123090] Updated weights for policy 1, policy_version 1293507 (0.0008) [2023-12-26 09:59:33,850][123090] Updated weights for policy 1, policy_version 1293517 (0.0005) [2023-12-26 09:59:33,896][123090] Updated weights for policy 1, policy_version 1293527 (0.0005) [2023-12-26 09:59:34,116][123091] Updated weights for policy 0, policy_version 1302934 (0.0007) [2023-12-26 09:59:34,190][123091] Updated weights for policy 0, policy_version 1302944 (0.0010) [2023-12-26 09:59:34,249][123091] Updated weights for policy 0, policy_version 1302954 (0.0011) [2023-12-26 09:59:34,637][123090] Updated weights for policy 1, policy_version 1293537 (0.0005) [2023-12-26 09:59:34,707][123090] Updated weights for policy 1, policy_version 1293547 (0.0007) [2023-12-26 09:59:34,775][123090] Updated weights for policy 1, policy_version 1293557 (0.0008) [2023-12-26 09:59:34,835][123090] Updated weights for policy 1, policy_version 1293567 (0.0009) [2023-12-26 09:59:35,038][123091] Updated weights for policy 0, policy_version 1302964 (0.0011) [2023-12-26 09:59:35,088][123091] Updated weights for policy 0, policy_version 1302974 (0.0010) [2023-12-26 09:59:35,139][123091] Updated weights for policy 0, policy_version 1302984 (0.0010) [2023-12-26 09:59:35,564][123090] Updated weights for policy 1, policy_version 1293577 (0.0009) [2023-12-26 09:59:35,628][123090] Updated weights for policy 1, policy_version 1293587 (0.0009) [2023-12-26 09:59:35,680][123090] Updated weights for policy 1, policy_version 1293597 (0.0006) [2023-12-26 09:59:35,974][123091] Updated weights for policy 0, policy_version 1302994 (0.0011) [2023-12-26 09:59:36,035][123091] Updated weights for policy 0, policy_version 1303004 (0.0011) [2023-12-26 09:59:36,101][123091] Updated weights for policy 0, policy_version 1303014 (0.0010) [2023-12-26 09:59:36,163][123091] Updated weights for policy 0, policy_version 1303024 (0.0010) [2023-12-26 09:59:36,401][123090] Updated weights for policy 1, policy_version 1293607 (0.0008) [2023-12-26 09:59:36,465][123090] Updated weights for policy 1, policy_version 1293617 (0.0011) [2023-12-26 09:59:36,535][123090] Updated weights for policy 1, policy_version 1293627 (0.0011) [2023-12-26 09:59:36,959][123091] Updated weights for policy 0, policy_version 1303034 (0.0006) [2023-12-26 09:59:37,018][123091] Updated weights for policy 0, policy_version 1303044 (0.0005) [2023-12-26 09:59:37,082][123091] Updated weights for policy 0, policy_version 1303054 (0.0006) [2023-12-26 09:59:37,359][123090] Updated weights for policy 1, policy_version 1293637 (0.0008) [2023-12-26 09:59:37,426][123090] Updated weights for policy 1, policy_version 1293647 (0.0007) [2023-12-26 09:59:37,493][123090] Updated weights for policy 1, policy_version 1293657 (0.0010) [2023-12-26 09:59:37,799][123091] Updated weights for policy 0, policy_version 1303064 (0.0010) [2023-12-26 09:59:37,872][123091] Updated weights for policy 0, policy_version 1303074 (0.0010) [2023-12-26 09:59:37,944][123091] Updated weights for policy 0, policy_version 1303084 (0.0010) [2023-12-26 09:59:38,161][123090] Updated weights for policy 1, policy_version 1293667 (0.0011) [2023-12-26 09:59:38,209][123090] Updated weights for policy 1, policy_version 1293677 (0.0010) [2023-12-26 09:59:38,265][123090] Updated weights for policy 1, policy_version 1293687 (0.0010) [2023-12-26 09:59:38,737][123091] Updated weights for policy 0, policy_version 1303094 (0.0009) [2023-12-26 09:59:38,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 664780800. Throughput: 0: 8892.7, 1: 8877.7. Samples: 664758884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:38,785][121949] Avg episode reward: [(0, '6260.377'), (1, '5572.333')] [2023-12-26 09:59:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001293696_331186176.pth... [2023-12-26 09:59:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001292672_330924032.pth [2023-12-26 09:59:38,808][123091] Updated weights for policy 0, policy_version 1303104 (0.0009) [2023-12-26 09:59:38,874][123091] Updated weights for policy 0, policy_version 1303114 (0.0010) [2023-12-26 09:59:38,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001303120_333602816.pth... [2023-12-26 09:59:38,907][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001302096_333340672.pth [2023-12-26 09:59:39,043][123090] Updated weights for policy 1, policy_version 1293697 (0.0010) [2023-12-26 09:59:39,095][123090] Updated weights for policy 1, policy_version 1293707 (0.0010) [2023-12-26 09:59:39,154][123090] Updated weights for policy 1, policy_version 1293717 (0.0010) [2023-12-26 09:59:39,217][123090] Updated weights for policy 1, policy_version 1293727 (0.0010) [2023-12-26 09:59:39,722][123091] Updated weights for policy 0, policy_version 1303124 (0.0009) [2023-12-26 09:59:39,789][123091] Updated weights for policy 0, policy_version 1303134 (0.0010) [2023-12-26 09:59:39,855][123091] Updated weights for policy 0, policy_version 1303144 (0.0009) [2023-12-26 09:59:40,021][123090] Updated weights for policy 1, policy_version 1293737 (0.0008) [2023-12-26 09:59:40,095][123090] Updated weights for policy 1, policy_version 1293747 (0.0008) [2023-12-26 09:59:40,162][123090] Updated weights for policy 1, policy_version 1293757 (0.0008) [2023-12-26 09:59:40,729][123091] Updated weights for policy 0, policy_version 1303154 (0.0010) [2023-12-26 09:59:40,784][123091] Updated weights for policy 0, policy_version 1303164 (0.0009) [2023-12-26 09:59:40,854][123091] Updated weights for policy 0, policy_version 1303174 (0.0006) [2023-12-26 09:59:40,921][123091] Updated weights for policy 0, policy_version 1303184 (0.0005) [2023-12-26 09:59:40,971][123090] Updated weights for policy 1, policy_version 1293767 (0.0009) [2023-12-26 09:59:41,021][123090] Updated weights for policy 1, policy_version 1293777 (0.0009) [2023-12-26 09:59:41,092][123090] Updated weights for policy 1, policy_version 1293787 (0.0009) [2023-12-26 09:59:41,741][123091] Updated weights for policy 0, policy_version 1303194 (0.0010) [2023-12-26 09:59:41,811][123091] Updated weights for policy 0, policy_version 1303204 (0.0010) [2023-12-26 09:59:41,882][123091] Updated weights for policy 0, policy_version 1303214 (0.0009) [2023-12-26 09:59:41,945][123090] Updated weights for policy 1, policy_version 1293797 (0.0010) [2023-12-26 09:59:42,014][123090] Updated weights for policy 1, policy_version 1293807 (0.0009) [2023-12-26 09:59:42,076][123090] Updated weights for policy 1, policy_version 1293817 (0.0010) [2023-12-26 09:59:42,684][123091] Updated weights for policy 0, policy_version 1303224 (0.0010) [2023-12-26 09:59:42,754][123091] Updated weights for policy 0, policy_version 1303234 (0.0010) [2023-12-26 09:59:42,808][123091] Updated weights for policy 0, policy_version 1303244 (0.0008) [2023-12-26 09:59:42,808][123090] Updated weights for policy 1, policy_version 1293827 (0.0009) [2023-12-26 09:59:42,871][123090] Updated weights for policy 1, policy_version 1293837 (0.0010) [2023-12-26 09:59:42,933][123090] Updated weights for policy 1, policy_version 1293847 (0.0010) [2023-12-26 09:59:43,499][123091] Updated weights for policy 0, policy_version 1303254 (0.0007) [2023-12-26 09:59:43,569][123091] Updated weights for policy 0, policy_version 1303264 (0.0005) [2023-12-26 09:59:43,642][123091] Updated weights for policy 0, policy_version 1303274 (0.0006) [2023-12-26 09:59:43,726][123090] Updated weights for policy 1, policy_version 1293857 (0.0010) [2023-12-26 09:59:43,774][123090] Updated weights for policy 1, policy_version 1293867 (0.0008) [2023-12-26 09:59:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 664870912. Throughput: 0: 8813.3, 1: 8905.6. Samples: 664864116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:43,785][121949] Avg episode reward: [(0, '6287.400'), (1, '5664.809')] [2023-12-26 09:59:43,822][123090] Updated weights for policy 1, policy_version 1293877 (0.0010) [2023-12-26 09:59:43,873][123090] Updated weights for policy 1, policy_version 1293887 (0.0010) [2023-12-26 09:59:44,393][123091] Updated weights for policy 0, policy_version 1303284 (0.0009) [2023-12-26 09:59:44,450][123091] Updated weights for policy 0, policy_version 1303294 (0.0009) [2023-12-26 09:59:44,498][123091] Updated weights for policy 0, policy_version 1303304 (0.0009) [2023-12-26 09:59:44,695][123090] Updated weights for policy 1, policy_version 1293897 (0.0010) [2023-12-26 09:59:44,743][123090] Updated weights for policy 1, policy_version 1293907 (0.0010) [2023-12-26 09:59:44,810][123090] Updated weights for policy 1, policy_version 1293917 (0.0011) [2023-12-26 09:59:45,340][123091] Updated weights for policy 0, policy_version 1303314 (0.0009) [2023-12-26 09:59:45,403][123091] Updated weights for policy 0, policy_version 1303324 (0.0009) [2023-12-26 09:59:45,464][123091] Updated weights for policy 0, policy_version 1303334 (0.0009) [2023-12-26 09:59:45,535][123091] Updated weights for policy 0, policy_version 1303344 (0.0010) [2023-12-26 09:59:45,643][123090] Updated weights for policy 1, policy_version 1293927 (0.0007) [2023-12-26 09:59:45,696][123090] Updated weights for policy 1, policy_version 1293937 (0.0005) [2023-12-26 09:59:45,744][123090] Updated weights for policy 1, policy_version 1293947 (0.0005) [2023-12-26 09:59:46,300][123091] Updated weights for policy 0, policy_version 1303354 (0.0005) [2023-12-26 09:59:46,371][123091] Updated weights for policy 0, policy_version 1303364 (0.0009) [2023-12-26 09:59:46,441][123091] Updated weights for policy 0, policy_version 1303374 (0.0009) [2023-12-26 09:59:46,452][123090] Updated weights for policy 1, policy_version 1293957 (0.0007) [2023-12-26 09:59:46,507][123090] Updated weights for policy 1, policy_version 1293967 (0.0010) [2023-12-26 09:59:46,569][123090] Updated weights for policy 1, policy_version 1293977 (0.0010) [2023-12-26 09:59:47,189][123091] Updated weights for policy 0, policy_version 1303384 (0.0009) [2023-12-26 09:59:47,261][123091] Updated weights for policy 0, policy_version 1303394 (0.0010) [2023-12-26 09:59:47,299][123090] Updated weights for policy 1, policy_version 1293987 (0.0010) [2023-12-26 09:59:47,326][123091] Updated weights for policy 0, policy_version 1303404 (0.0009) [2023-12-26 09:59:47,362][123090] Updated weights for policy 1, policy_version 1293997 (0.0008) [2023-12-26 09:59:47,416][123090] Updated weights for policy 1, policy_version 1294007 (0.0009) [2023-12-26 09:59:48,113][123091] Updated weights for policy 0, policy_version 1303414 (0.0009) [2023-12-26 09:59:48,186][123091] Updated weights for policy 0, policy_version 1303424 (0.0006) [2023-12-26 09:59:48,210][123090] Updated weights for policy 1, policy_version 1294017 (0.0008) [2023-12-26 09:59:48,260][123090] Updated weights for policy 1, policy_version 1294027 (0.0005) [2023-12-26 09:59:48,261][123091] Updated weights for policy 0, policy_version 1303434 (0.0006) [2023-12-26 09:59:48,322][123090] Updated weights for policy 1, policy_version 1294037 (0.0006) [2023-12-26 09:59:48,396][123090] Updated weights for policy 1, policy_version 1294047 (0.0006) [2023-12-26 09:59:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 664961024. Throughput: 0: 8811.3, 1: 8957.9. Samples: 664973960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:48,785][121949] Avg episode reward: [(0, '6316.859'), (1, '5537.969')] [2023-12-26 09:59:49,010][123091] Updated weights for policy 0, policy_version 1303444 (0.0008) [2023-12-26 09:59:49,072][123090] Updated weights for policy 1, policy_version 1294057 (0.0005) [2023-12-26 09:59:49,076][123091] Updated weights for policy 0, policy_version 1303454 (0.0011) [2023-12-26 09:59:49,118][123090] Updated weights for policy 1, policy_version 1294067 (0.0005) [2023-12-26 09:59:49,136][123091] Updated weights for policy 0, policy_version 1303464 (0.0010) [2023-12-26 09:59:49,179][123090] Updated weights for policy 1, policy_version 1294077 (0.0006) [2023-12-26 09:59:49,943][123091] Updated weights for policy 0, policy_version 1303474 (0.0010) [2023-12-26 09:59:49,983][123090] Updated weights for policy 1, policy_version 1294087 (0.0007) [2023-12-26 09:59:50,012][123091] Updated weights for policy 0, policy_version 1303484 (0.0007) [2023-12-26 09:59:50,046][123090] Updated weights for policy 1, policy_version 1294097 (0.0008) [2023-12-26 09:59:50,076][123091] Updated weights for policy 0, policy_version 1303494 (0.0006) [2023-12-26 09:59:50,109][123090] Updated weights for policy 1, policy_version 1294107 (0.0008) [2023-12-26 09:59:50,144][123091] Updated weights for policy 0, policy_version 1303504 (0.0010) [2023-12-26 09:59:50,920][123090] Updated weights for policy 1, policy_version 1294117 (0.0009) [2023-12-26 09:59:50,966][123091] Updated weights for policy 0, policy_version 1303514 (0.0006) [2023-12-26 09:59:50,976][123090] Updated weights for policy 1, policy_version 1294127 (0.0010) [2023-12-26 09:59:51,029][123091] Updated weights for policy 0, policy_version 1303524 (0.0007) [2023-12-26 09:59:51,051][123090] Updated weights for policy 1, policy_version 1294137 (0.0010) [2023-12-26 09:59:51,098][123091] Updated weights for policy 0, policy_version 1303534 (0.0008) [2023-12-26 09:59:51,910][123090] Updated weights for policy 1, policy_version 1294147 (0.0009) [2023-12-26 09:59:51,926][123091] Updated weights for policy 0, policy_version 1303544 (0.0008) [2023-12-26 09:59:51,966][123090] Updated weights for policy 1, policy_version 1294157 (0.0008) [2023-12-26 09:59:51,990][123091] Updated weights for policy 0, policy_version 1303554 (0.0005) [2023-12-26 09:59:52,028][123090] Updated weights for policy 1, policy_version 1294167 (0.0009) [2023-12-26 09:59:52,045][123091] Updated weights for policy 0, policy_version 1303564 (0.0005) [2023-12-26 09:59:52,742][123091] Updated weights for policy 0, policy_version 1303574 (0.0008) [2023-12-26 09:59:52,793][123091] Updated weights for policy 0, policy_version 1303584 (0.0007) [2023-12-26 09:59:52,850][123091] Updated weights for policy 0, policy_version 1303594 (0.0006) [2023-12-26 09:59:52,891][123090] Updated weights for policy 1, policy_version 1294177 (0.0009) [2023-12-26 09:59:52,946][123090] Updated weights for policy 1, policy_version 1294187 (0.0010) [2023-12-26 09:59:52,999][123090] Updated weights for policy 1, policy_version 1294197 (0.0010) [2023-12-26 09:59:53,055][123090] Updated weights for policy 1, policy_version 1294207 (0.0010) [2023-12-26 09:59:53,591][123091] Updated weights for policy 0, policy_version 1303604 (0.0008) [2023-12-26 09:59:53,651][123091] Updated weights for policy 0, policy_version 1303614 (0.0010) [2023-12-26 09:59:53,716][123091] Updated weights for policy 0, policy_version 1303624 (0.0010) [2023-12-26 09:59:53,765][123090] Updated weights for policy 1, policy_version 1294217 (0.0009) [2023-12-26 09:59:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 665051136. Throughput: 0: 8724.0, 1: 8927.9. Samples: 665026016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:53,785][121949] Avg episode reward: [(0, '6218.541'), (1, '5430.187')] [2023-12-26 09:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001303632_333733888.pth... [2023-12-26 09:59:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001302576_333463552.pth [2023-12-26 09:59:53,829][123090] Updated weights for policy 1, policy_version 1294227 (0.0008) [2023-12-26 09:59:53,898][123090] Updated weights for policy 1, policy_version 1294237 (0.0009) [2023-12-26 09:59:53,915][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001294240_331325440.pth... [2023-12-26 09:59:53,918][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001293152_331046912.pth [2023-12-26 09:59:54,551][123091] Updated weights for policy 0, policy_version 1303634 (0.0009) [2023-12-26 09:59:54,603][123091] Updated weights for policy 0, policy_version 1303644 (0.0005) [2023-12-26 09:59:54,654][123091] Updated weights for policy 0, policy_version 1303654 (0.0005) [2023-12-26 09:59:54,712][123091] Updated weights for policy 0, policy_version 1303664 (0.0007) [2023-12-26 09:59:54,737][123090] Updated weights for policy 1, policy_version 1294247 (0.0009) [2023-12-26 09:59:54,811][123090] Updated weights for policy 1, policy_version 1294257 (0.0009) [2023-12-26 09:59:54,871][123090] Updated weights for policy 1, policy_version 1294267 (0.0009) [2023-12-26 09:59:55,441][123091] Updated weights for policy 0, policy_version 1303674 (0.0005) [2023-12-26 09:59:55,501][123091] Updated weights for policy 0, policy_version 1303684 (0.0009) [2023-12-26 09:59:55,561][123091] Updated weights for policy 0, policy_version 1303694 (0.0011) [2023-12-26 09:59:55,745][123090] Updated weights for policy 1, policy_version 1294277 (0.0009) [2023-12-26 09:59:55,793][123090] Updated weights for policy 1, policy_version 1294287 (0.0009) [2023-12-26 09:59:55,841][123090] Updated weights for policy 1, policy_version 1294297 (0.0009) [2023-12-26 09:59:56,289][123091] Updated weights for policy 0, policy_version 1303704 (0.0010) [2023-12-26 09:59:56,336][123091] Updated weights for policy 0, policy_version 1303714 (0.0010) [2023-12-26 09:59:56,383][123091] Updated weights for policy 0, policy_version 1303724 (0.0010) [2023-12-26 09:59:56,762][123090] Updated weights for policy 1, policy_version 1294307 (0.0009) [2023-12-26 09:59:56,825][123090] Updated weights for policy 1, policy_version 1294317 (0.0010) [2023-12-26 09:59:56,879][123090] Updated weights for policy 1, policy_version 1294327 (0.0010) [2023-12-26 09:59:57,092][123091] Updated weights for policy 0, policy_version 1303734 (0.0007) [2023-12-26 09:59:57,137][123091] Updated weights for policy 0, policy_version 1303744 (0.0005) [2023-12-26 09:59:57,181][123091] Updated weights for policy 0, policy_version 1303754 (0.0005) [2023-12-26 09:59:57,770][123090] Updated weights for policy 1, policy_version 1294337 (0.0009) [2023-12-26 09:59:57,833][123091] Updated weights for policy 0, policy_version 1303764 (0.0006) [2023-12-26 09:59:57,836][123090] Updated weights for policy 1, policy_version 1294347 (0.0005) [2023-12-26 09:59:57,892][123090] Updated weights for policy 1, policy_version 1294357 (0.0005) [2023-12-26 09:59:57,906][123091] Updated weights for policy 0, policy_version 1303774 (0.0005) [2023-12-26 09:59:57,948][123090] Updated weights for policy 1, policy_version 1294367 (0.0005) [2023-12-26 09:59:57,979][123091] Updated weights for policy 0, policy_version 1303784 (0.0006) [2023-12-26 09:59:58,649][123090] Updated weights for policy 1, policy_version 1294377 (0.0007) [2023-12-26 09:59:58,741][123090] Updated weights for policy 1, policy_version 1294387 (0.0008) [2023-12-26 09:59:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 665133056. Throughput: 0: 8814.0, 1: 8859.9. Samples: 665134340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 09:59:58,785][121949] Avg episode reward: [(0, '6210.460'), (1, '5491.178')] [2023-12-26 09:59:58,796][123091] Updated weights for policy 0, policy_version 1303794 (0.0006) [2023-12-26 09:59:58,825][123090] Updated weights for policy 1, policy_version 1294397 (0.0008) [2023-12-26 09:59:58,863][123091] Updated weights for policy 0, policy_version 1303804 (0.0009) [2023-12-26 09:59:58,926][123091] Updated weights for policy 0, policy_version 1303814 (0.0007) [2023-12-26 09:59:58,996][123091] Updated weights for policy 0, policy_version 1303824 (0.0008) [2023-12-26 09:59:59,678][123090] Updated weights for policy 1, policy_version 1294407 (0.0011) [2023-12-26 09:59:59,726][123090] Updated weights for policy 1, policy_version 1294417 (0.0010) [2023-12-26 09:59:59,788][123090] Updated weights for policy 1, policy_version 1294427 (0.0005) [2023-12-26 09:59:59,902][123091] Updated weights for policy 0, policy_version 1303834 (0.0006) [2023-12-26 09:59:59,968][123091] Updated weights for policy 0, policy_version 1303844 (0.0008) [2023-12-26 10:00:00,032][123091] Updated weights for policy 0, policy_version 1303854 (0.0008) [2023-12-26 10:00:00,555][123090] Updated weights for policy 1, policy_version 1294437 (0.0006) [2023-12-26 10:00:00,621][123090] Updated weights for policy 1, policy_version 1294447 (0.0006) [2023-12-26 10:00:00,666][123091] Updated weights for policy 0, policy_version 1303864 (0.0006) [2023-12-26 10:00:00,680][123090] Updated weights for policy 1, policy_version 1294457 (0.0006) [2023-12-26 10:00:00,736][123091] Updated weights for policy 0, policy_version 1303874 (0.0006) [2023-12-26 10:00:00,812][123091] Updated weights for policy 0, policy_version 1303884 (0.0008) [2023-12-26 10:00:01,465][123091] Updated weights for policy 0, policy_version 1303894 (0.0011) [2023-12-26 10:00:01,492][123090] Updated weights for policy 1, policy_version 1294467 (0.0006) [2023-12-26 10:00:01,527][123091] Updated weights for policy 0, policy_version 1303904 (0.0011) [2023-12-26 10:00:01,552][123090] Updated weights for policy 1, policy_version 1294477 (0.0006) [2023-12-26 10:00:01,578][123091] Updated weights for policy 0, policy_version 1303914 (0.0010) [2023-12-26 10:00:01,604][123090] Updated weights for policy 1, policy_version 1294487 (0.0005) [2023-12-26 10:00:02,382][123090] Updated weights for policy 1, policy_version 1294497 (0.0008) [2023-12-26 10:00:02,423][123091] Updated weights for policy 0, policy_version 1303924 (0.0009) [2023-12-26 10:00:02,450][123090] Updated weights for policy 1, policy_version 1294507 (0.0009) [2023-12-26 10:00:02,490][123091] Updated weights for policy 0, policy_version 1303934 (0.0008) [2023-12-26 10:00:02,515][123090] Updated weights for policy 1, policy_version 1294517 (0.0007) [2023-12-26 10:00:02,543][123091] Updated weights for policy 0, policy_version 1303944 (0.0009) [2023-12-26 10:00:02,585][123090] Updated weights for policy 1, policy_version 1294527 (0.0006) [2023-12-26 10:00:03,281][123091] Updated weights for policy 0, policy_version 1303954 (0.0008) [2023-12-26 10:00:03,341][123091] Updated weights for policy 0, policy_version 1303964 (0.0005) [2023-12-26 10:00:03,401][123091] Updated weights for policy 0, policy_version 1303974 (0.0006) [2023-12-26 10:00:03,409][123090] Updated weights for policy 1, policy_version 1294538 (0.0009) [2023-12-26 10:00:03,446][123091] Updated weights for policy 0, policy_version 1303984 (0.0005) [2023-12-26 10:00:03,461][123090] Updated weights for policy 1, policy_version 1294548 (0.0008) [2023-12-26 10:00:03,517][123090] Updated weights for policy 1, policy_version 1294558 (0.0010) [2023-12-26 10:00:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 665231360. Throughput: 0: 8896.7, 1: 8833.7. Samples: 665240440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:03,785][121949] Avg episode reward: [(0, '6234.830'), (1, '5433.400')] [2023-12-26 10:00:04,064][123091] Updated weights for policy 0, policy_version 1303994 (0.0006) [2023-12-26 10:00:04,130][123091] Updated weights for policy 0, policy_version 1304004 (0.0009) [2023-12-26 10:00:04,194][123091] Updated weights for policy 0, policy_version 1304014 (0.0007) [2023-12-26 10:00:04,466][123090] Updated weights for policy 1, policy_version 1294569 (0.0010) [2023-12-26 10:00:04,530][123090] Updated weights for policy 1, policy_version 1294579 (0.0010) [2023-12-26 10:00:04,593][123090] Updated weights for policy 1, policy_version 1294589 (0.0010) [2023-12-26 10:00:04,959][123091] Updated weights for policy 0, policy_version 1304024 (0.0009) [2023-12-26 10:00:05,006][123091] Updated weights for policy 0, policy_version 1304034 (0.0010) [2023-12-26 10:00:05,062][123091] Updated weights for policy 0, policy_version 1304044 (0.0010) [2023-12-26 10:00:05,272][123090] Updated weights for policy 1, policy_version 1294599 (0.0007) [2023-12-26 10:00:05,345][123090] Updated weights for policy 1, policy_version 1294609 (0.0005) [2023-12-26 10:00:05,414][123090] Updated weights for policy 1, policy_version 1294619 (0.0005) [2023-12-26 10:00:05,821][123091] Updated weights for policy 0, policy_version 1304054 (0.0007) [2023-12-26 10:00:05,881][123091] Updated weights for policy 0, policy_version 1304064 (0.0005) [2023-12-26 10:00:05,926][123091] Updated weights for policy 0, policy_version 1304074 (0.0005) [2023-12-26 10:00:06,040][123090] Updated weights for policy 1, policy_version 1294629 (0.0008) [2023-12-26 10:00:06,096][123090] Updated weights for policy 1, policy_version 1294639 (0.0008) [2023-12-26 10:00:06,165][123090] Updated weights for policy 1, policy_version 1294649 (0.0008) [2023-12-26 10:00:06,726][123091] Updated weights for policy 0, policy_version 1304084 (0.0006) [2023-12-26 10:00:06,793][123091] Updated weights for policy 0, policy_version 1304094 (0.0009) [2023-12-26 10:00:06,848][123091] Updated weights for policy 0, policy_version 1304104 (0.0009) [2023-12-26 10:00:06,934][123090] Updated weights for policy 1, policy_version 1294659 (0.0008) [2023-12-26 10:00:06,993][123090] Updated weights for policy 1, policy_version 1294669 (0.0006) [2023-12-26 10:00:07,057][123090] Updated weights for policy 1, policy_version 1294679 (0.0006) [2023-12-26 10:00:07,737][123091] Updated weights for policy 0, policy_version 1304114 (0.0009) [2023-12-26 10:00:07,800][123091] Updated weights for policy 0, policy_version 1304124 (0.0009) [2023-12-26 10:00:07,816][123090] Updated weights for policy 1, policy_version 1294689 (0.0007) [2023-12-26 10:00:07,857][123091] Updated weights for policy 0, policy_version 1304134 (0.0008) [2023-12-26 10:00:07,864][123090] Updated weights for policy 1, policy_version 1294699 (0.0008) [2023-12-26 10:00:07,913][123091] Updated weights for policy 0, policy_version 1304144 (0.0009) [2023-12-26 10:00:07,913][123090] Updated weights for policy 1, policy_version 1294709 (0.0007) [2023-12-26 10:00:07,969][123090] Updated weights for policy 1, policy_version 1294719 (0.0009) [2023-12-26 10:00:08,751][123090] Updated weights for policy 1, policy_version 1294729 (0.0010) [2023-12-26 10:00:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 665313280. Throughput: 0: 8984.5, 1: 8902.2. Samples: 665296956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:08,785][121949] Avg episode reward: [(0, '6178.134'), (1, '5553.868')] [2023-12-26 10:00:08,814][123090] Updated weights for policy 1, policy_version 1294739 (0.0010) [2023-12-26 10:00:08,835][123091] Updated weights for policy 0, policy_version 1304154 (0.0006) [2023-12-26 10:00:08,878][123090] Updated weights for policy 1, policy_version 1294749 (0.0006) [2023-12-26 10:00:08,894][123091] Updated weights for policy 0, policy_version 1304164 (0.0009) [2023-12-26 10:00:08,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001294752_331456512.pth... [2023-12-26 10:00:08,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001293696_331186176.pth [2023-12-26 10:00:08,951][123091] Updated weights for policy 0, policy_version 1304174 (0.0010) [2023-12-26 10:00:08,959][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001304176_333873152.pth... [2023-12-26 10:00:08,964][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001303120_333602816.pth [2023-12-26 10:00:09,655][123090] Updated weights for policy 1, policy_version 1294759 (0.0009) [2023-12-26 10:00:09,725][123090] Updated weights for policy 1, policy_version 1294769 (0.0011) [2023-12-26 10:00:09,789][123090] Updated weights for policy 1, policy_version 1294779 (0.0011) [2023-12-26 10:00:09,870][123091] Updated weights for policy 0, policy_version 1304184 (0.0009) [2023-12-26 10:00:09,931][123091] Updated weights for policy 0, policy_version 1304194 (0.0010) [2023-12-26 10:00:10,002][123091] Updated weights for policy 0, policy_version 1304204 (0.0007) [2023-12-26 10:00:10,628][123090] Updated weights for policy 1, policy_version 1294789 (0.0009) [2023-12-26 10:00:10,677][123090] Updated weights for policy 1, policy_version 1294799 (0.0009) [2023-12-26 10:00:10,728][123090] Updated weights for policy 1, policy_version 1294809 (0.0005) [2023-12-26 10:00:10,833][123091] Updated weights for policy 0, policy_version 1304214 (0.0007) [2023-12-26 10:00:10,889][123091] Updated weights for policy 0, policy_version 1304224 (0.0005) [2023-12-26 10:00:10,945][123091] Updated weights for policy 0, policy_version 1304234 (0.0007) [2023-12-26 10:00:11,572][123090] Updated weights for policy 1, policy_version 1294819 (0.0007) [2023-12-26 10:00:11,644][123090] Updated weights for policy 1, policy_version 1294829 (0.0010) [2023-12-26 10:00:11,715][123090] Updated weights for policy 1, policy_version 1294839 (0.0008) [2023-12-26 10:00:11,784][123091] Updated weights for policy 0, policy_version 1304244 (0.0009) [2023-12-26 10:00:11,855][123091] Updated weights for policy 0, policy_version 1304254 (0.0010) [2023-12-26 10:00:11,923][123091] Updated weights for policy 0, policy_version 1304264 (0.0009) [2023-12-26 10:00:12,544][123090] Updated weights for policy 1, policy_version 1294849 (0.0008) [2023-12-26 10:00:12,605][123090] Updated weights for policy 1, policy_version 1294859 (0.0009) [2023-12-26 10:00:12,664][123090] Updated weights for policy 1, policy_version 1294869 (0.0010) [2023-12-26 10:00:12,717][123090] Updated weights for policy 1, policy_version 1294879 (0.0006) [2023-12-26 10:00:12,749][123091] Updated weights for policy 0, policy_version 1304274 (0.0009) [2023-12-26 10:00:12,801][123091] Updated weights for policy 0, policy_version 1304284 (0.0005) [2023-12-26 10:00:12,867][123091] Updated weights for policy 0, policy_version 1304294 (0.0006) [2023-12-26 10:00:12,934][123091] Updated weights for policy 0, policy_version 1304304 (0.0009) [2023-12-26 10:00:13,487][123090] Updated weights for policy 1, policy_version 1294889 (0.0008) [2023-12-26 10:00:13,553][123090] Updated weights for policy 1, policy_version 1294899 (0.0008) [2023-12-26 10:00:13,613][123090] Updated weights for policy 1, policy_version 1294909 (0.0009) [2023-12-26 10:00:13,707][123091] Updated weights for policy 0, policy_version 1304314 (0.0010) [2023-12-26 10:00:13,768][123091] Updated weights for policy 0, policy_version 1304324 (0.0009) [2023-12-26 10:00:13,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 665403392. Throughput: 0: 8877.8, 1: 8896.5. Samples: 665399504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:13,786][121949] Avg episode reward: [(0, '6259.149'), (1, '5494.951')] [2023-12-26 10:00:13,822][123091] Updated weights for policy 0, policy_version 1304334 (0.0009) [2023-12-26 10:00:14,400][123090] Updated weights for policy 1, policy_version 1294919 (0.0009) [2023-12-26 10:00:14,449][123090] Updated weights for policy 1, policy_version 1294929 (0.0009) [2023-12-26 10:00:14,503][123090] Updated weights for policy 1, policy_version 1294939 (0.0009) [2023-12-26 10:00:14,660][123091] Updated weights for policy 0, policy_version 1304344 (0.0009) [2023-12-26 10:00:14,722][123091] Updated weights for policy 0, policy_version 1304354 (0.0009) [2023-12-26 10:00:14,797][123091] Updated weights for policy 0, policy_version 1304364 (0.0009) [2023-12-26 10:00:15,332][123090] Updated weights for policy 1, policy_version 1294949 (0.0010) [2023-12-26 10:00:15,399][123090] Updated weights for policy 1, policy_version 1294959 (0.0010) [2023-12-26 10:00:15,469][123090] Updated weights for policy 1, policy_version 1294969 (0.0009) [2023-12-26 10:00:15,623][123091] Updated weights for policy 0, policy_version 1304374 (0.0010) [2023-12-26 10:00:15,685][123091] Updated weights for policy 0, policy_version 1304384 (0.0010) [2023-12-26 10:00:15,752][123091] Updated weights for policy 0, policy_version 1304394 (0.0010) [2023-12-26 10:00:16,232][123090] Updated weights for policy 1, policy_version 1294979 (0.0008) [2023-12-26 10:00:16,300][123090] Updated weights for policy 1, policy_version 1294989 (0.0010) [2023-12-26 10:00:16,363][123090] Updated weights for policy 1, policy_version 1294999 (0.0009) [2023-12-26 10:00:16,576][123091] Updated weights for policy 0, policy_version 1304404 (0.0010) [2023-12-26 10:00:16,645][123091] Updated weights for policy 0, policy_version 1304414 (0.0010) [2023-12-26 10:00:16,707][123091] Updated weights for policy 0, policy_version 1304424 (0.0010) [2023-12-26 10:00:17,119][123090] Updated weights for policy 1, policy_version 1295009 (0.0008) [2023-12-26 10:00:17,182][123090] Updated weights for policy 1, policy_version 1295019 (0.0009) [2023-12-26 10:00:17,245][123090] Updated weights for policy 1, policy_version 1295029 (0.0009) [2023-12-26 10:00:17,309][123090] Updated weights for policy 1, policy_version 1295039 (0.0008) [2023-12-26 10:00:17,552][123091] Updated weights for policy 0, policy_version 1304434 (0.0009) [2023-12-26 10:00:17,615][123091] Updated weights for policy 0, policy_version 1304444 (0.0009) [2023-12-26 10:00:17,673][123091] Updated weights for policy 0, policy_version 1304454 (0.0009) [2023-12-26 10:00:17,736][123091] Updated weights for policy 0, policy_version 1304464 (0.0009) [2023-12-26 10:00:18,095][123090] Updated weights for policy 1, policy_version 1295049 (0.0010) [2023-12-26 10:00:18,162][123090] Updated weights for policy 1, policy_version 1295059 (0.0009) [2023-12-26 10:00:18,220][123090] Updated weights for policy 1, policy_version 1295069 (0.0010) [2023-12-26 10:00:18,541][123091] Updated weights for policy 0, policy_version 1304474 (0.0009) [2023-12-26 10:00:18,610][123091] Updated weights for policy 0, policy_version 1304484 (0.0009) [2023-12-26 10:00:18,669][123091] Updated weights for policy 0, policy_version 1304494 (0.0009) [2023-12-26 10:00:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 665493504. Throughput: 0: 8854.6, 1: 8885.1. Samples: 665502228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:18,785][121949] Avg episode reward: [(0, '6316.462'), (1, '5385.701')] [2023-12-26 10:00:19,002][123090] Updated weights for policy 1, policy_version 1295079 (0.0009) [2023-12-26 10:00:19,071][123090] Updated weights for policy 1, policy_version 1295089 (0.0009) [2023-12-26 10:00:19,135][123090] Updated weights for policy 1, policy_version 1295099 (0.0009) [2023-12-26 10:00:19,567][123091] Updated weights for policy 0, policy_version 1304504 (0.0009) [2023-12-26 10:00:19,632][123091] Updated weights for policy 0, policy_version 1304514 (0.0010) [2023-12-26 10:00:19,700][123091] Updated weights for policy 0, policy_version 1304524 (0.0009) [2023-12-26 10:00:19,957][123090] Updated weights for policy 1, policy_version 1295109 (0.0009) [2023-12-26 10:00:20,021][123090] Updated weights for policy 1, policy_version 1295119 (0.0006) [2023-12-26 10:00:20,091][123090] Updated weights for policy 1, policy_version 1295129 (0.0006) [2023-12-26 10:00:20,583][123091] Updated weights for policy 0, policy_version 1304534 (0.0009) [2023-12-26 10:00:20,656][123091] Updated weights for policy 0, policy_version 1304544 (0.0009) [2023-12-26 10:00:20,726][123091] Updated weights for policy 0, policy_version 1304554 (0.0008) [2023-12-26 10:00:20,872][123090] Updated weights for policy 1, policy_version 1295139 (0.0007) [2023-12-26 10:00:20,941][123090] Updated weights for policy 1, policy_version 1295149 (0.0010) [2023-12-26 10:00:21,009][123090] Updated weights for policy 1, policy_version 1295159 (0.0009) [2023-12-26 10:00:21,600][123091] Updated weights for policy 0, policy_version 1304564 (0.0007) [2023-12-26 10:00:21,680][123091] Updated weights for policy 0, policy_version 1304574 (0.0008) [2023-12-26 10:00:21,755][123091] Updated weights for policy 0, policy_version 1304584 (0.0008) [2023-12-26 10:00:21,906][123090] Updated weights for policy 1, policy_version 1295169 (0.0009) [2023-12-26 10:00:21,977][123090] Updated weights for policy 1, policy_version 1295179 (0.0008) [2023-12-26 10:00:22,047][123090] Updated weights for policy 1, policy_version 1295189 (0.0008) [2023-12-26 10:00:22,119][123090] Updated weights for policy 1, policy_version 1295199 (0.0008) [2023-12-26 10:00:22,588][123091] Updated weights for policy 0, policy_version 1304594 (0.0008) [2023-12-26 10:00:22,649][123091] Updated weights for policy 0, policy_version 1304604 (0.0010) [2023-12-26 10:00:22,714][123091] Updated weights for policy 0, policy_version 1304614 (0.0010) [2023-12-26 10:00:22,772][123091] Updated weights for policy 0, policy_version 1304624 (0.0009) [2023-12-26 10:00:22,903][123090] Updated weights for policy 1, policy_version 1295209 (0.0009) [2023-12-26 10:00:22,958][123090] Updated weights for policy 1, policy_version 1295219 (0.0009) [2023-12-26 10:00:23,016][123090] Updated weights for policy 1, policy_version 1295230 (0.0009) [2023-12-26 10:00:23,616][123091] Updated weights for policy 0, policy_version 1304634 (0.0006) [2023-12-26 10:00:23,672][123091] Updated weights for policy 0, policy_version 1304644 (0.0006) [2023-12-26 10:00:23,738][123091] Updated weights for policy 0, policy_version 1304654 (0.0010) [2023-12-26 10:00:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 665575424. Throughput: 0: 8801.4, 1: 8828.9. Samples: 665552248. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:23,785][121949] Avg episode reward: [(0, '6312.536'), (1, '5501.102')] [2023-12-26 10:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001304656_333996032.pth... [2023-12-26 10:00:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001295232_331579392.pth... [2023-12-26 10:00:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001303632_333733888.pth [2023-12-26 10:00:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001294240_331325440.pth [2023-12-26 10:00:23,933][123090] Updated weights for policy 1, policy_version 1295240 (0.0010) [2023-12-26 10:00:23,999][123090] Updated weights for policy 1, policy_version 1295250 (0.0009) [2023-12-26 10:00:24,072][123090] Updated weights for policy 1, policy_version 1295260 (0.0010) [2023-12-26 10:00:24,465][123091] Updated weights for policy 0, policy_version 1304664 (0.0006) [2023-12-26 10:00:24,533][123091] Updated weights for policy 0, policy_version 1304674 (0.0006) [2023-12-26 10:00:24,604][123091] Updated weights for policy 0, policy_version 1304684 (0.0006) [2023-12-26 10:00:24,828][123090] Updated weights for policy 1, policy_version 1295271 (0.0010) [2023-12-26 10:00:24,885][123090] Updated weights for policy 1, policy_version 1295281 (0.0009) [2023-12-26 10:00:24,951][123090] Updated weights for policy 1, policy_version 1295291 (0.0010) [2023-12-26 10:00:25,281][123091] Updated weights for policy 0, policy_version 1304694 (0.0007) [2023-12-26 10:00:25,345][123091] Updated weights for policy 0, policy_version 1304704 (0.0008) [2023-12-26 10:00:25,410][123091] Updated weights for policy 0, policy_version 1304714 (0.0008) [2023-12-26 10:00:25,865][123090] Updated weights for policy 1, policy_version 1295301 (0.0008) [2023-12-26 10:00:25,923][123090] Updated weights for policy 1, policy_version 1295311 (0.0005) [2023-12-26 10:00:25,972][123090] Updated weights for policy 1, policy_version 1295321 (0.0005) [2023-12-26 10:00:26,115][123091] Updated weights for policy 0, policy_version 1304724 (0.0006) [2023-12-26 10:00:26,182][123091] Updated weights for policy 0, policy_version 1304734 (0.0005) [2023-12-26 10:00:26,233][123091] Updated weights for policy 0, policy_version 1304744 (0.0006) [2023-12-26 10:00:26,755][123090] Updated weights for policy 1, policy_version 1295331 (0.0007) [2023-12-26 10:00:26,813][123091] Updated weights for policy 0, policy_version 1304754 (0.0005) [2023-12-26 10:00:26,821][123090] Updated weights for policy 1, policy_version 1295342 (0.0010) [2023-12-26 10:00:26,867][123091] Updated weights for policy 0, policy_version 1304764 (0.0005) [2023-12-26 10:00:26,885][123090] Updated weights for policy 1, policy_version 1295352 (0.0009) [2023-12-26 10:00:26,915][123091] Updated weights for policy 0, policy_version 1304774 (0.0006) [2023-12-26 10:00:26,967][123091] Updated weights for policy 0, policy_version 1304784 (0.0006) [2023-12-26 10:00:27,668][123090] Updated weights for policy 1, policy_version 1295362 (0.0009) [2023-12-26 10:00:27,723][123090] Updated weights for policy 1, policy_version 1295372 (0.0010) [2023-12-26 10:00:27,769][123091] Updated weights for policy 0, policy_version 1304794 (0.0010) [2023-12-26 10:00:27,774][123090] Updated weights for policy 1, policy_version 1295382 (0.0010) [2023-12-26 10:00:27,824][123091] Updated weights for policy 0, policy_version 1304804 (0.0010) [2023-12-26 10:00:27,826][123090] Updated weights for policy 1, policy_version 1295392 (0.0010) [2023-12-26 10:00:27,878][123091] Updated weights for policy 0, policy_version 1304814 (0.0010) [2023-12-26 10:00:28,533][123090] Updated weights for policy 1, policy_version 1295402 (0.0006) [2023-12-26 10:00:28,595][123090] Updated weights for policy 1, policy_version 1295412 (0.0006) [2023-12-26 10:00:28,617][123091] Updated weights for policy 0, policy_version 1304824 (0.0007) [2023-12-26 10:00:28,660][123090] Updated weights for policy 1, policy_version 1295422 (0.0005) [2023-12-26 10:00:28,680][123091] Updated weights for policy 0, policy_version 1304834 (0.0006) [2023-12-26 10:00:28,740][123091] Updated weights for policy 0, policy_version 1304844 (0.0006) [2023-12-26 10:00:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 665673728. Throughput: 0: 8892.9, 1: 8781.7. Samples: 665659472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:28,785][121949] Avg episode reward: [(0, '6291.942'), (1, '5516.212')] [2023-12-26 10:00:29,373][123091] Updated weights for policy 0, policy_version 1304854 (0.0008) [2023-12-26 10:00:29,401][123090] Updated weights for policy 1, policy_version 1295432 (0.0009) [2023-12-26 10:00:29,433][123091] Updated weights for policy 0, policy_version 1304864 (0.0008) [2023-12-26 10:00:29,464][123090] Updated weights for policy 1, policy_version 1295442 (0.0010) [2023-12-26 10:00:29,491][123091] Updated weights for policy 0, policy_version 1304874 (0.0008) [2023-12-26 10:00:29,524][123090] Updated weights for policy 1, policy_version 1295452 (0.0010) [2023-12-26 10:00:30,193][123091] Updated weights for policy 0, policy_version 1304884 (0.0007) [2023-12-26 10:00:30,264][123091] Updated weights for policy 0, policy_version 1304894 (0.0006) [2023-12-26 10:00:30,275][123090] Updated weights for policy 1, policy_version 1295462 (0.0010) [2023-12-26 10:00:30,319][123091] Updated weights for policy 0, policy_version 1304904 (0.0005) [2023-12-26 10:00:30,343][123090] Updated weights for policy 1, policy_version 1295472 (0.0010) [2023-12-26 10:00:30,406][123090] Updated weights for policy 1, policy_version 1295482 (0.0011) [2023-12-26 10:00:31,086][123091] Updated weights for policy 0, policy_version 1304914 (0.0007) [2023-12-26 10:00:31,153][123091] Updated weights for policy 0, policy_version 1304924 (0.0009) [2023-12-26 10:00:31,215][123090] Updated weights for policy 1, policy_version 1295492 (0.0011) [2023-12-26 10:00:31,220][123091] Updated weights for policy 0, policy_version 1304934 (0.0010) [2023-12-26 10:00:31,277][123090] Updated weights for policy 1, policy_version 1295502 (0.0011) [2023-12-26 10:00:31,279][123091] Updated weights for policy 0, policy_version 1304944 (0.0008) [2023-12-26 10:00:31,348][123090] Updated weights for policy 1, policy_version 1295512 (0.0010) [2023-12-26 10:00:32,069][123091] Updated weights for policy 0, policy_version 1304954 (0.0006) [2023-12-26 10:00:32,130][123091] Updated weights for policy 0, policy_version 1304964 (0.0009) [2023-12-26 10:00:32,185][123091] Updated weights for policy 0, policy_version 1304974 (0.0010) [2023-12-26 10:00:32,224][123090] Updated weights for policy 1, policy_version 1295522 (0.0009) [2023-12-26 10:00:32,286][123090] Updated weights for policy 1, policy_version 1295532 (0.0009) [2023-12-26 10:00:32,350][123090] Updated weights for policy 1, policy_version 1295542 (0.0010) [2023-12-26 10:00:32,424][123090] Updated weights for policy 1, policy_version 1295552 (0.0009) [2023-12-26 10:00:32,993][123091] Updated weights for policy 0, policy_version 1304984 (0.0010) [2023-12-26 10:00:33,047][123091] Updated weights for policy 0, policy_version 1304994 (0.0010) [2023-12-26 10:00:33,099][123091] Updated weights for policy 0, policy_version 1305004 (0.0010) [2023-12-26 10:00:33,266][123090] Updated weights for policy 1, policy_version 1295562 (0.0009) [2023-12-26 10:00:33,313][123090] Updated weights for policy 1, policy_version 1295572 (0.0008) [2023-12-26 10:00:33,365][123090] Updated weights for policy 1, policy_version 1295582 (0.0005) [2023-12-26 10:00:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 665755648. Throughput: 0: 8925.6, 1: 8726.0. Samples: 665768284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:33,785][121949] Avg episode reward: [(0, '6308.383'), (1, '5556.381')] [2023-12-26 10:00:34,001][123091] Updated weights for policy 0, policy_version 1305014 (0.0009) [2023-12-26 10:00:34,055][123091] Updated weights for policy 0, policy_version 1305024 (0.0008) [2023-12-26 10:00:34,070][123090] Updated weights for policy 1, policy_version 1295592 (0.0009) [2023-12-26 10:00:34,113][123091] Updated weights for policy 0, policy_version 1305034 (0.0007) [2023-12-26 10:00:34,122][123090] Updated weights for policy 1, policy_version 1295602 (0.0010) [2023-12-26 10:00:34,186][123090] Updated weights for policy 1, policy_version 1295612 (0.0011) [2023-12-26 10:00:34,857][123090] Updated weights for policy 1, policy_version 1295622 (0.0007) [2023-12-26 10:00:34,918][123090] Updated weights for policy 1, policy_version 1295632 (0.0005) [2023-12-26 10:00:34,981][123090] Updated weights for policy 1, policy_version 1295642 (0.0008) [2023-12-26 10:00:35,010][123091] Updated weights for policy 0, policy_version 1305044 (0.0008) [2023-12-26 10:00:35,070][123091] Updated weights for policy 0, policy_version 1305054 (0.0008) [2023-12-26 10:00:35,129][123091] Updated weights for policy 0, policy_version 1305064 (0.0009) [2023-12-26 10:00:35,676][123090] Updated weights for policy 1, policy_version 1295652 (0.0008) [2023-12-26 10:00:35,762][123090] Updated weights for policy 1, policy_version 1295662 (0.0005) [2023-12-26 10:00:35,819][123090] Updated weights for policy 1, policy_version 1295672 (0.0005) [2023-12-26 10:00:36,035][123091] Updated weights for policy 0, policy_version 1305074 (0.0009) [2023-12-26 10:00:36,112][123091] Updated weights for policy 0, policy_version 1305084 (0.0009) [2023-12-26 10:00:36,178][123091] Updated weights for policy 0, policy_version 1305094 (0.0010) [2023-12-26 10:00:36,243][123091] Updated weights for policy 0, policy_version 1305104 (0.0009) [2023-12-26 10:00:36,496][123090] Updated weights for policy 1, policy_version 1295682 (0.0005) [2023-12-26 10:00:36,569][123090] Updated weights for policy 1, policy_version 1295692 (0.0006) [2023-12-26 10:00:36,643][123090] Updated weights for policy 1, policy_version 1295702 (0.0010) [2023-12-26 10:00:36,711][123090] Updated weights for policy 1, policy_version 1295712 (0.0011) [2023-12-26 10:00:37,118][123091] Updated weights for policy 0, policy_version 1305114 (0.0006) [2023-12-26 10:00:37,178][123091] Updated weights for policy 0, policy_version 1305124 (0.0009) [2023-12-26 10:00:37,240][123091] Updated weights for policy 0, policy_version 1305134 (0.0008) [2023-12-26 10:00:37,507][123090] Updated weights for policy 1, policy_version 1295722 (0.0011) [2023-12-26 10:00:37,571][123090] Updated weights for policy 1, policy_version 1295732 (0.0010) [2023-12-26 10:00:37,635][123090] Updated weights for policy 1, policy_version 1295742 (0.0011) [2023-12-26 10:00:38,004][123091] Updated weights for policy 0, policy_version 1305144 (0.0009) [2023-12-26 10:00:38,064][123091] Updated weights for policy 0, policy_version 1305154 (0.0010) [2023-12-26 10:00:38,123][123091] Updated weights for policy 0, policy_version 1305164 (0.0008) [2023-12-26 10:00:38,405][123090] Updated weights for policy 1, policy_version 1295752 (0.0009) [2023-12-26 10:00:38,462][123090] Updated weights for policy 1, policy_version 1295762 (0.0009) [2023-12-26 10:00:38,515][123090] Updated weights for policy 1, policy_version 1295772 (0.0009) [2023-12-26 10:00:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 665845760. Throughput: 0: 8886.7, 1: 8808.5. Samples: 665822296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:38,785][121949] Avg episode reward: [(0, '6313.116'), (1, '5526.717')] [2023-12-26 10:00:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001305168_334127104.pth... [2023-12-26 10:00:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001295776_331718656.pth... [2023-12-26 10:00:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001304176_333873152.pth [2023-12-26 10:00:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001294752_331456512.pth [2023-12-26 10:00:38,955][123091] Updated weights for policy 0, policy_version 1305174 (0.0008) [2023-12-26 10:00:39,009][123091] Updated weights for policy 0, policy_version 1305184 (0.0009) [2023-12-26 10:00:39,065][123091] Updated weights for policy 0, policy_version 1305194 (0.0010) [2023-12-26 10:00:39,367][123090] Updated weights for policy 1, policy_version 1295782 (0.0010) [2023-12-26 10:00:39,434][123090] Updated weights for policy 1, policy_version 1295792 (0.0010) [2023-12-26 10:00:39,496][123090] Updated weights for policy 1, policy_version 1295802 (0.0009) [2023-12-26 10:00:39,864][123091] Updated weights for policy 0, policy_version 1305204 (0.0009) [2023-12-26 10:00:39,930][123091] Updated weights for policy 0, policy_version 1305214 (0.0009) [2023-12-26 10:00:39,991][123091] Updated weights for policy 0, policy_version 1305224 (0.0010) [2023-12-26 10:00:40,377][123090] Updated weights for policy 1, policy_version 1295812 (0.0009) [2023-12-26 10:00:40,434][123090] Updated weights for policy 1, policy_version 1295822 (0.0009) [2023-12-26 10:00:40,492][123090] Updated weights for policy 1, policy_version 1295832 (0.0008) [2023-12-26 10:00:40,790][123091] Updated weights for policy 0, policy_version 1305234 (0.0010) [2023-12-26 10:00:40,844][123091] Updated weights for policy 0, policy_version 1305244 (0.0009) [2023-12-26 10:00:40,890][123091] Updated weights for policy 0, policy_version 1305254 (0.0009) [2023-12-26 10:00:40,941][123091] Updated weights for policy 0, policy_version 1305264 (0.0010) [2023-12-26 10:00:41,356][123090] Updated weights for policy 1, policy_version 1295842 (0.0009) [2023-12-26 10:00:41,425][123090] Updated weights for policy 1, policy_version 1295852 (0.0009) [2023-12-26 10:00:41,489][123090] Updated weights for policy 1, policy_version 1295862 (0.0006) [2023-12-26 10:00:41,554][123090] Updated weights for policy 1, policy_version 1295872 (0.0006) [2023-12-26 10:00:41,836][123091] Updated weights for policy 0, policy_version 1305274 (0.0010) [2023-12-26 10:00:41,889][123091] Updated weights for policy 0, policy_version 1305284 (0.0009) [2023-12-26 10:00:41,951][123091] Updated weights for policy 0, policy_version 1305294 (0.0008) [2023-12-26 10:00:42,344][123090] Updated weights for policy 1, policy_version 1295882 (0.0009) [2023-12-26 10:00:42,410][123090] Updated weights for policy 1, policy_version 1295892 (0.0008) [2023-12-26 10:00:42,476][123090] Updated weights for policy 1, policy_version 1295902 (0.0008) [2023-12-26 10:00:42,725][123091] Updated weights for policy 0, policy_version 1305304 (0.0008) [2023-12-26 10:00:42,790][123091] Updated weights for policy 0, policy_version 1305314 (0.0009) [2023-12-26 10:00:42,851][123091] Updated weights for policy 0, policy_version 1305324 (0.0010) [2023-12-26 10:00:43,272][123090] Updated weights for policy 1, policy_version 1295912 (0.0009) [2023-12-26 10:00:43,327][123090] Updated weights for policy 1, policy_version 1295922 (0.0009) [2023-12-26 10:00:43,376][123090] Updated weights for policy 1, policy_version 1295932 (0.0009) [2023-12-26 10:00:43,682][123091] Updated weights for policy 0, policy_version 1305334 (0.0008) [2023-12-26 10:00:43,747][123091] Updated weights for policy 0, policy_version 1305344 (0.0010) [2023-12-26 10:00:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 665927680. Throughput: 0: 8742.7, 1: 8816.4. Samples: 665924496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:43,785][121949] Avg episode reward: [(0, '6404.319'), (1, '5596.670')] [2023-12-26 10:00:43,797][123091] Updated weights for policy 0, policy_version 1305354 (0.0009) [2023-12-26 10:00:44,235][123090] Updated weights for policy 1, policy_version 1295942 (0.0009) [2023-12-26 10:00:44,293][123090] Updated weights for policy 1, policy_version 1295952 (0.0009) [2023-12-26 10:00:44,351][123090] Updated weights for policy 1, policy_version 1295962 (0.0009) [2023-12-26 10:00:44,587][123091] Updated weights for policy 0, policy_version 1305364 (0.0009) [2023-12-26 10:00:44,649][123091] Updated weights for policy 0, policy_version 1305374 (0.0009) [2023-12-26 10:00:44,714][123091] Updated weights for policy 0, policy_version 1305384 (0.0010) [2023-12-26 10:00:45,190][123090] Updated weights for policy 1, policy_version 1295972 (0.0008) [2023-12-26 10:00:45,257][123090] Updated weights for policy 1, policy_version 1295982 (0.0005) [2023-12-26 10:00:45,325][123090] Updated weights for policy 1, policy_version 1295992 (0.0009) [2023-12-26 10:00:45,519][123091] Updated weights for policy 0, policy_version 1305394 (0.0010) [2023-12-26 10:00:45,573][123091] Updated weights for policy 0, policy_version 1305404 (0.0009) [2023-12-26 10:00:45,628][123091] Updated weights for policy 0, policy_version 1305414 (0.0010) [2023-12-26 10:00:45,688][123091] Updated weights for policy 0, policy_version 1305424 (0.0009) [2023-12-26 10:00:46,068][123090] Updated weights for policy 1, policy_version 1296002 (0.0010) [2023-12-26 10:00:46,138][123090] Updated weights for policy 1, policy_version 1296012 (0.0009) [2023-12-26 10:00:46,196][123090] Updated weights for policy 1, policy_version 1296022 (0.0009) [2023-12-26 10:00:46,252][123090] Updated weights for policy 1, policy_version 1296032 (0.0009) [2023-12-26 10:00:46,581][123091] Updated weights for policy 0, policy_version 1305434 (0.0009) [2023-12-26 10:00:46,636][123091] Updated weights for policy 0, policy_version 1305444 (0.0009) [2023-12-26 10:00:46,685][123091] Updated weights for policy 0, policy_version 1305455 (0.0010) [2023-12-26 10:00:47,090][123090] Updated weights for policy 1, policy_version 1296042 (0.0009) [2023-12-26 10:00:47,155][123090] Updated weights for policy 1, policy_version 1296052 (0.0009) [2023-12-26 10:00:47,220][123090] Updated weights for policy 1, policy_version 1296062 (0.0006) [2023-12-26 10:00:47,540][123091] Updated weights for policy 0, policy_version 1305465 (0.0010) [2023-12-26 10:00:47,612][123091] Updated weights for policy 0, policy_version 1305475 (0.0010) [2023-12-26 10:00:47,673][123091] Updated weights for policy 0, policy_version 1305485 (0.0010) [2023-12-26 10:00:47,987][123090] Updated weights for policy 1, policy_version 1296072 (0.0006) [2023-12-26 10:00:48,045][123090] Updated weights for policy 1, policy_version 1296082 (0.0005) [2023-12-26 10:00:48,097][123090] Updated weights for policy 1, policy_version 1296092 (0.0005) [2023-12-26 10:00:48,553][123091] Updated weights for policy 0, policy_version 1305495 (0.0009) [2023-12-26 10:00:48,611][123091] Updated weights for policy 0, policy_version 1305505 (0.0010) [2023-12-26 10:00:48,671][123091] Updated weights for policy 0, policy_version 1305515 (0.0010) [2023-12-26 10:00:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 666017792. Throughput: 0: 8662.3, 1: 8851.8. Samples: 666028576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:48,785][121949] Avg episode reward: [(0, '6339.761'), (1, '5468.918')] [2023-12-26 10:00:48,806][123090] Updated weights for policy 1, policy_version 1296102 (0.0005) [2023-12-26 10:00:48,864][123090] Updated weights for policy 1, policy_version 1296112 (0.0006) [2023-12-26 10:00:48,925][123090] Updated weights for policy 1, policy_version 1296122 (0.0005) [2023-12-26 10:00:49,563][123091] Updated weights for policy 0, policy_version 1305525 (0.0009) [2023-12-26 10:00:49,600][123090] Updated weights for policy 1, policy_version 1296132 (0.0006) [2023-12-26 10:00:49,619][123091] Updated weights for policy 0, policy_version 1305535 (0.0010) [2023-12-26 10:00:49,657][123090] Updated weights for policy 1, policy_version 1296142 (0.0008) [2023-12-26 10:00:49,669][123091] Updated weights for policy 0, policy_version 1305545 (0.0008) [2023-12-26 10:00:49,726][123090] Updated weights for policy 1, policy_version 1296152 (0.0010) [2023-12-26 10:00:50,502][123091] Updated weights for policy 0, policy_version 1305555 (0.0007) [2023-12-26 10:00:50,559][123091] Updated weights for policy 0, policy_version 1305565 (0.0009) [2023-12-26 10:00:50,566][123090] Updated weights for policy 1, policy_version 1296162 (0.0009) [2023-12-26 10:00:50,631][123091] Updated weights for policy 0, policy_version 1305575 (0.0009) [2023-12-26 10:00:50,633][123090] Updated weights for policy 1, policy_version 1296172 (0.0007) [2023-12-26 10:00:50,698][123090] Updated weights for policy 1, policy_version 1296182 (0.0007) [2023-12-26 10:00:50,757][123090] Updated weights for policy 1, policy_version 1296192 (0.0008) [2023-12-26 10:00:51,519][123091] Updated weights for policy 0, policy_version 1305585 (0.0008) [2023-12-26 10:00:51,577][123091] Updated weights for policy 0, policy_version 1305595 (0.0009) [2023-12-26 10:00:51,578][123090] Updated weights for policy 1, policy_version 1296202 (0.0010) [2023-12-26 10:00:51,648][123091] Updated weights for policy 0, policy_version 1305605 (0.0008) [2023-12-26 10:00:51,648][123090] Updated weights for policy 1, policy_version 1296212 (0.0009) [2023-12-26 10:00:51,709][123091] Updated weights for policy 0, policy_version 1305615 (0.0010) [2023-12-26 10:00:51,714][123090] Updated weights for policy 1, policy_version 1296222 (0.0008) [2023-12-26 10:00:52,527][123090] Updated weights for policy 1, policy_version 1296232 (0.0009) [2023-12-26 10:00:52,534][123091] Updated weights for policy 0, policy_version 1305625 (0.0008) [2023-12-26 10:00:52,580][123090] Updated weights for policy 1, policy_version 1296242 (0.0008) [2023-12-26 10:00:52,583][123091] Updated weights for policy 0, policy_version 1305635 (0.0008) [2023-12-26 10:00:52,641][123091] Updated weights for policy 0, policy_version 1305645 (0.0008) [2023-12-26 10:00:52,647][123090] Updated weights for policy 1, policy_version 1296252 (0.0009) [2023-12-26 10:00:53,440][123090] Updated weights for policy 1, policy_version 1296262 (0.0010) [2023-12-26 10:00:53,490][123090] Updated weights for policy 1, policy_version 1296272 (0.0009) [2023-12-26 10:00:53,499][123091] Updated weights for policy 0, policy_version 1305655 (0.0006) [2023-12-26 10:00:53,540][123090] Updated weights for policy 1, policy_version 1296282 (0.0008) [2023-12-26 10:00:53,550][123091] Updated weights for policy 0, policy_version 1305665 (0.0008) [2023-12-26 10:00:53,605][123091] Updated weights for policy 0, policy_version 1305675 (0.0008) [2023-12-26 10:00:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 666107904. Throughput: 0: 8575.6, 1: 8821.6. Samples: 666079828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:53,785][121949] Avg episode reward: [(0, '6302.761'), (1, '5390.388')] [2023-12-26 10:00:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001305680_334258176.pth... [2023-12-26 10:00:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001296288_331849728.pth... [2023-12-26 10:00:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001304656_333996032.pth [2023-12-26 10:00:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001295232_331579392.pth [2023-12-26 10:00:54,395][123090] Updated weights for policy 1, policy_version 1296292 (0.0009) [2023-12-26 10:00:54,415][123091] Updated weights for policy 0, policy_version 1305685 (0.0008) [2023-12-26 10:00:54,440][123090] Updated weights for policy 1, policy_version 1296302 (0.0008) [2023-12-26 10:00:54,475][123091] Updated weights for policy 0, policy_version 1305695 (0.0010) [2023-12-26 10:00:54,508][123090] Updated weights for policy 1, policy_version 1296312 (0.0006) [2023-12-26 10:00:54,533][123091] Updated weights for policy 0, policy_version 1305705 (0.0008) [2023-12-26 10:00:55,316][123090] Updated weights for policy 1, policy_version 1296322 (0.0008) [2023-12-26 10:00:55,382][123090] Updated weights for policy 1, policy_version 1296332 (0.0005) [2023-12-26 10:00:55,416][123091] Updated weights for policy 0, policy_version 1305715 (0.0009) [2023-12-26 10:00:55,432][123090] Updated weights for policy 1, policy_version 1296342 (0.0005) [2023-12-26 10:00:55,470][123091] Updated weights for policy 0, policy_version 1305725 (0.0010) [2023-12-26 10:00:55,479][123090] Updated weights for policy 1, policy_version 1296352 (0.0005) [2023-12-26 10:00:55,523][123091] Updated weights for policy 0, policy_version 1305738 (0.0010) [2023-12-26 10:00:56,149][123090] Updated weights for policy 1, policy_version 1296362 (0.0005) [2023-12-26 10:00:56,215][123090] Updated weights for policy 1, policy_version 1296372 (0.0005) [2023-12-26 10:00:56,283][123090] Updated weights for policy 1, policy_version 1296382 (0.0006) [2023-12-26 10:00:56,480][123091] Updated weights for policy 0, policy_version 1305749 (0.0010) [2023-12-26 10:00:56,530][123091] Updated weights for policy 0, policy_version 1305759 (0.0009) [2023-12-26 10:00:56,578][123091] Updated weights for policy 0, policy_version 1305769 (0.0008) [2023-12-26 10:00:57,004][123090] Updated weights for policy 1, policy_version 1296392 (0.0010) [2023-12-26 10:00:57,051][123090] Updated weights for policy 1, policy_version 1296402 (0.0010) [2023-12-26 10:00:57,106][123090] Updated weights for policy 1, policy_version 1296412 (0.0010) [2023-12-26 10:00:57,370][123091] Updated weights for policy 0, policy_version 1305779 (0.0008) [2023-12-26 10:00:57,430][123091] Updated weights for policy 0, policy_version 1305789 (0.0009) [2023-12-26 10:00:57,488][123091] Updated weights for policy 0, policy_version 1305800 (0.0010) [2023-12-26 10:00:57,782][123090] Updated weights for policy 1, policy_version 1296422 (0.0007) [2023-12-26 10:00:57,842][123090] Updated weights for policy 1, policy_version 1296432 (0.0005) [2023-12-26 10:00:57,899][123090] Updated weights for policy 1, policy_version 1296442 (0.0005) [2023-12-26 10:00:58,244][123091] Updated weights for policy 0, policy_version 1305811 (0.0010) [2023-12-26 10:00:58,299][123091] Updated weights for policy 0, policy_version 1305821 (0.0007) [2023-12-26 10:00:58,369][123091] Updated weights for policy 0, policy_version 1305831 (0.0008) [2023-12-26 10:00:58,743][123090] Updated weights for policy 1, policy_version 1296452 (0.0008) [2023-12-26 10:00:58,785][121949] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 666189824. Throughput: 0: 8613.6, 1: 8863.0. Samples: 666185952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:00:58,785][121949] Avg episode reward: [(0, '6322.825'), (1, '5443.417')] [2023-12-26 10:00:58,818][123090] Updated weights for policy 1, policy_version 1296462 (0.0010) [2023-12-26 10:00:58,888][123090] Updated weights for policy 1, policy_version 1296472 (0.0009) [2023-12-26 10:00:59,195][123091] Updated weights for policy 0, policy_version 1305841 (0.0008) [2023-12-26 10:00:59,272][123091] Updated weights for policy 0, policy_version 1305851 (0.0009) [2023-12-26 10:00:59,337][123091] Updated weights for policy 0, policy_version 1305861 (0.0010) [2023-12-26 10:00:59,399][123091] Updated weights for policy 0, policy_version 1305871 (0.0008) [2023-12-26 10:00:59,720][123090] Updated weights for policy 1, policy_version 1296482 (0.0009) [2023-12-26 10:00:59,783][123090] Updated weights for policy 1, policy_version 1296492 (0.0009) [2023-12-26 10:00:59,850][123090] Updated weights for policy 1, policy_version 1296502 (0.0010) [2023-12-26 10:00:59,919][123090] Updated weights for policy 1, policy_version 1296512 (0.0009) [2023-12-26 10:01:00,237][123091] Updated weights for policy 0, policy_version 1305881 (0.0009) [2023-12-26 10:01:00,291][123091] Updated weights for policy 0, policy_version 1305891 (0.0009) [2023-12-26 10:01:00,346][123091] Updated weights for policy 0, policy_version 1305901 (0.0009) [2023-12-26 10:01:00,740][123090] Updated weights for policy 1, policy_version 1296522 (0.0010) [2023-12-26 10:01:00,803][123090] Updated weights for policy 1, policy_version 1296532 (0.0010) [2023-12-26 10:01:00,877][123090] Updated weights for policy 1, policy_version 1296542 (0.0005) [2023-12-26 10:01:01,176][123091] Updated weights for policy 0, policy_version 1305911 (0.0008) [2023-12-26 10:01:01,241][123091] Updated weights for policy 0, policy_version 1305921 (0.0007) [2023-12-26 10:01:01,310][123091] Updated weights for policy 0, policy_version 1305931 (0.0009) [2023-12-26 10:01:01,652][123090] Updated weights for policy 1, policy_version 1296552 (0.0008) [2023-12-26 10:01:01,717][123090] Updated weights for policy 1, policy_version 1296562 (0.0009) [2023-12-26 10:01:01,784][123090] Updated weights for policy 1, policy_version 1296572 (0.0010) [2023-12-26 10:01:02,179][123091] Updated weights for policy 0, policy_version 1305941 (0.0010) [2023-12-26 10:01:02,233][123091] Updated weights for policy 0, policy_version 1305951 (0.0010) [2023-12-26 10:01:02,293][123091] Updated weights for policy 0, policy_version 1305961 (0.0010) [2023-12-26 10:01:02,597][123090] Updated weights for policy 1, policy_version 1296582 (0.0009) [2023-12-26 10:01:02,653][123090] Updated weights for policy 1, policy_version 1296592 (0.0009) [2023-12-26 10:01:02,708][123090] Updated weights for policy 1, policy_version 1296602 (0.0009) [2023-12-26 10:01:03,124][123091] Updated weights for policy 0, policy_version 1305971 (0.0010) [2023-12-26 10:01:03,188][123091] Updated weights for policy 0, policy_version 1305981 (0.0010) [2023-12-26 10:01:03,251][123091] Updated weights for policy 0, policy_version 1305991 (0.0010) [2023-12-26 10:01:03,549][123090] Updated weights for policy 1, policy_version 1296612 (0.0009) [2023-12-26 10:01:03,611][123090] Updated weights for policy 1, policy_version 1296622 (0.0008) [2023-12-26 10:01:03,659][123090] Updated weights for policy 1, policy_version 1296632 (0.0010) [2023-12-26 10:01:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 666279936. Throughput: 0: 8639.5, 1: 8834.4. Samples: 666288552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:01:03,785][121949] Avg episode reward: [(0, '6401.886'), (1, '5331.080')] [2023-12-26 10:01:04,118][123091] Updated weights for policy 0, policy_version 1306001 (0.0010) [2023-12-26 10:01:04,178][123091] Updated weights for policy 0, policy_version 1306011 (0.0010) [2023-12-26 10:01:04,241][123091] Updated weights for policy 0, policy_version 1306021 (0.0011) [2023-12-26 10:01:04,299][123091] Updated weights for policy 0, policy_version 1306031 (0.0011) [2023-12-26 10:01:04,460][123090] Updated weights for policy 1, policy_version 1296642 (0.0010) [2023-12-26 10:01:04,536][123090] Updated weights for policy 1, policy_version 1296652 (0.0007) [2023-12-26 10:01:04,601][123090] Updated weights for policy 1, policy_version 1296662 (0.0010) [2023-12-26 10:01:04,668][123090] Updated weights for policy 1, policy_version 1296672 (0.0010) [2023-12-26 10:01:05,095][123091] Updated weights for policy 0, policy_version 1306041 (0.0011) [2023-12-26 10:01:05,154][123091] Updated weights for policy 0, policy_version 1306051 (0.0011) [2023-12-26 10:01:05,217][123091] Updated weights for policy 0, policy_version 1306061 (0.0010) [2023-12-26 10:01:05,417][123090] Updated weights for policy 1, policy_version 1296682 (0.0006) [2023-12-26 10:01:05,479][123090] Updated weights for policy 1, policy_version 1296692 (0.0010) [2023-12-26 10:01:05,540][123090] Updated weights for policy 1, policy_version 1296702 (0.0010) [2023-12-26 10:01:06,041][123091] Updated weights for policy 0, policy_version 1306071 (0.0011) [2023-12-26 10:01:06,119][123091] Updated weights for policy 0, policy_version 1306081 (0.0011) [2023-12-26 10:01:06,170][123091] Updated weights for policy 0, policy_version 1306091 (0.0011) [2023-12-26 10:01:06,245][123090] Updated weights for policy 1, policy_version 1296712 (0.0006) [2023-12-26 10:01:06,308][123090] Updated weights for policy 1, policy_version 1296722 (0.0005) [2023-12-26 10:01:06,368][123090] Updated weights for policy 1, policy_version 1296732 (0.0006) [2023-12-26 10:01:06,958][123091] Updated weights for policy 0, policy_version 1306101 (0.0011) [2023-12-26 10:01:07,009][123091] Updated weights for policy 0, policy_version 1306111 (0.0010) [2023-12-26 10:01:07,066][123091] Updated weights for policy 0, policy_version 1306121 (0.0008) [2023-12-26 10:01:07,089][123090] Updated weights for policy 1, policy_version 1296742 (0.0008) [2023-12-26 10:01:07,141][123090] Updated weights for policy 1, policy_version 1296752 (0.0010) [2023-12-26 10:01:07,193][123090] Updated weights for policy 1, policy_version 1296762 (0.0010) [2023-12-26 10:01:07,735][123091] Updated weights for policy 0, policy_version 1306131 (0.0007) [2023-12-26 10:01:07,799][123091] Updated weights for policy 0, policy_version 1306141 (0.0006) [2023-12-26 10:01:07,855][123091] Updated weights for policy 0, policy_version 1306151 (0.0005) [2023-12-26 10:01:08,023][123090] Updated weights for policy 1, policy_version 1296772 (0.0008) [2023-12-26 10:01:08,071][123090] Updated weights for policy 1, policy_version 1296782 (0.0005) [2023-12-26 10:01:08,124][123090] Updated weights for policy 1, policy_version 1296792 (0.0006) [2023-12-26 10:01:08,460][123091] Updated weights for policy 0, policy_version 1306161 (0.0006) [2023-12-26 10:01:08,517][123091] Updated weights for policy 0, policy_version 1306171 (0.0005) [2023-12-26 10:01:08,573][123091] Updated weights for policy 0, policy_version 1306181 (0.0005) [2023-12-26 10:01:08,637][123091] Updated weights for policy 0, policy_version 1306191 (0.0005) [2023-12-26 10:01:08,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 666370048. Throughput: 0: 8684.5, 1: 8883.0. Samples: 666342788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:01:08,786][121949] Avg episode reward: [(0, '6275.896'), (1, '5507.119')] [2023-12-26 10:01:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001306192_334389248.pth... [2023-12-26 10:01:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001296800_331980800.pth... [2023-12-26 10:01:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001305168_334127104.pth [2023-12-26 10:01:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001295776_331718656.pth [2023-12-26 10:01:08,871][123090] Updated weights for policy 1, policy_version 1296802 (0.0006) [2023-12-26 10:01:08,946][123090] Updated weights for policy 1, policy_version 1296812 (0.0006) [2023-12-26 10:01:09,005][123090] Updated weights for policy 1, policy_version 1296822 (0.0005) [2023-12-26 10:01:09,336][123091] Updated weights for policy 0, policy_version 1306201 (0.0010) [2023-12-26 10:01:09,412][123091] Updated weights for policy 0, policy_version 1306211 (0.0010) [2023-12-26 10:01:09,471][123091] Updated weights for policy 0, policy_version 1306221 (0.0008) [2023-12-26 10:01:09,790][123090] Updated weights for policy 1, policy_version 1296833 (0.0007) [2023-12-26 10:01:09,860][123090] Updated weights for policy 1, policy_version 1296843 (0.0007) [2023-12-26 10:01:09,926][123090] Updated weights for policy 1, policy_version 1296853 (0.0008) [2023-12-26 10:01:09,993][123090] Updated weights for policy 1, policy_version 1296863 (0.0008) [2023-12-26 10:01:10,303][123091] Updated weights for policy 0, policy_version 1306231 (0.0010) [2023-12-26 10:01:10,362][123091] Updated weights for policy 0, policy_version 1306241 (0.0010) [2023-12-26 10:01:10,421][123091] Updated weights for policy 0, policy_version 1306251 (0.0010) [2023-12-26 10:01:10,749][123090] Updated weights for policy 1, policy_version 1296873 (0.0009) [2023-12-26 10:01:10,797][123090] Updated weights for policy 1, policy_version 1296883 (0.0009) [2023-12-26 10:01:10,853][123090] Updated weights for policy 1, policy_version 1296893 (0.0008) [2023-12-26 10:01:11,235][123091] Updated weights for policy 0, policy_version 1306261 (0.0010) [2023-12-26 10:01:11,305][123091] Updated weights for policy 0, policy_version 1306271 (0.0009) [2023-12-26 10:01:11,378][123091] Updated weights for policy 0, policy_version 1306281 (0.0010) [2023-12-26 10:01:11,752][123090] Updated weights for policy 1, policy_version 1296903 (0.0010) [2023-12-26 10:01:11,817][123090] Updated weights for policy 1, policy_version 1296913 (0.0010) [2023-12-26 10:01:11,876][123090] Updated weights for policy 1, policy_version 1296923 (0.0010) [2023-12-26 10:01:12,175][123091] Updated weights for policy 0, policy_version 1306291 (0.0009) [2023-12-26 10:01:12,242][123091] Updated weights for policy 0, policy_version 1306301 (0.0009) [2023-12-26 10:01:12,300][123091] Updated weights for policy 0, policy_version 1306311 (0.0010) [2023-12-26 10:01:12,725][123090] Updated weights for policy 1, policy_version 1296933 (0.0009) [2023-12-26 10:01:12,777][123090] Updated weights for policy 1, policy_version 1296943 (0.0009) [2023-12-26 10:01:12,851][123090] Updated weights for policy 1, policy_version 1296953 (0.0005) [2023-12-26 10:01:13,136][123091] Updated weights for policy 0, policy_version 1306321 (0.0008) [2023-12-26 10:01:13,192][123091] Updated weights for policy 0, policy_version 1306331 (0.0009) [2023-12-26 10:01:13,247][123091] Updated weights for policy 0, policy_version 1306341 (0.0009) [2023-12-26 10:01:13,302][123091] Updated weights for policy 0, policy_version 1306351 (0.0009) [2023-12-26 10:01:13,488][123090] Updated weights for policy 1, policy_version 1296963 (0.0007) [2023-12-26 10:01:13,545][123090] Updated weights for policy 1, policy_version 1296973 (0.0009) [2023-12-26 10:01:13,601][123090] Updated weights for policy 1, policy_version 1296983 (0.0010) [2023-12-26 10:01:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 666460160. Throughput: 0: 8664.5, 1: 8918.7. Samples: 666450720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:01:13,785][121949] Avg episode reward: [(0, '6233.647'), (1, '5541.415')] [2023-12-26 10:01:14,104][123091] Updated weights for policy 0, policy_version 1306361 (0.0009) [2023-12-26 10:01:14,167][123091] Updated weights for policy 0, policy_version 1306371 (0.0009) [2023-12-26 10:01:14,224][123091] Updated weights for policy 0, policy_version 1306381 (0.0010) [2023-12-26 10:01:14,482][123090] Updated weights for policy 1, policy_version 1296993 (0.0009) [2023-12-26 10:01:14,541][123090] Updated weights for policy 1, policy_version 1297003 (0.0010) [2023-12-26 10:01:14,602][123090] Updated weights for policy 1, policy_version 1297013 (0.0009) [2023-12-26 10:01:14,664][123090] Updated weights for policy 1, policy_version 1297023 (0.0010) [2023-12-26 10:01:15,010][123091] Updated weights for policy 0, policy_version 1306391 (0.0010) [2023-12-26 10:01:15,080][123091] Updated weights for policy 0, policy_version 1306401 (0.0005) [2023-12-26 10:01:15,152][123091] Updated weights for policy 0, policy_version 1306411 (0.0006) [2023-12-26 10:01:15,543][123090] Updated weights for policy 1, policy_version 1297033 (0.0008) [2023-12-26 10:01:15,617][123090] Updated weights for policy 1, policy_version 1297043 (0.0008) [2023-12-26 10:01:15,691][123090] Updated weights for policy 1, policy_version 1297053 (0.0008) [2023-12-26 10:01:15,848][123091] Updated weights for policy 0, policy_version 1306421 (0.0006) [2023-12-26 10:01:15,919][123091] Updated weights for policy 0, policy_version 1306431 (0.0005) [2023-12-26 10:01:15,976][123091] Updated weights for policy 0, policy_version 1306441 (0.0005) [2023-12-26 10:01:16,552][123090] Updated weights for policy 1, policy_version 1297063 (0.0009) [2023-12-26 10:01:16,617][123091] Updated weights for policy 0, policy_version 1306451 (0.0006) [2023-12-26 10:01:16,623][123090] Updated weights for policy 1, policy_version 1297073 (0.0007) [2023-12-26 10:01:16,675][123091] Updated weights for policy 0, policy_version 1306461 (0.0008) [2023-12-26 10:01:16,691][123090] Updated weights for policy 1, policy_version 1297083 (0.0008) [2023-12-26 10:01:16,740][123091] Updated weights for policy 0, policy_version 1306471 (0.0009) [2023-12-26 10:01:17,409][123090] Updated weights for policy 1, policy_version 1297093 (0.0008) [2023-12-26 10:01:17,469][123090] Updated weights for policy 1, policy_version 1297103 (0.0009) [2023-12-26 10:01:17,518][123090] Updated weights for policy 1, policy_version 1297113 (0.0009) [2023-12-26 10:01:17,616][123091] Updated weights for policy 0, policy_version 1306481 (0.0009) [2023-12-26 10:01:17,671][123091] Updated weights for policy 0, policy_version 1306491 (0.0008) [2023-12-26 10:01:17,724][123091] Updated weights for policy 0, policy_version 1306502 (0.0009) [2023-12-26 10:01:17,782][123091] Updated weights for policy 0, policy_version 1306512 (0.0009) [2023-12-26 10:01:18,327][123090] Updated weights for policy 1, policy_version 1297123 (0.0009) [2023-12-26 10:01:18,403][123090] Updated weights for policy 1, policy_version 1297133 (0.0009) [2023-12-26 10:01:18,466][123090] Updated weights for policy 1, policy_version 1297143 (0.0008) [2023-12-26 10:01:18,695][123091] Updated weights for policy 0, policy_version 1306522 (0.0005) [2023-12-26 10:01:18,764][123091] Updated weights for policy 0, policy_version 1306532 (0.0008) [2023-12-26 10:01:18,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 666542080. Throughput: 0: 8621.4, 1: 8888.2. Samples: 666556212. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:18,784][121949] Avg episode reward: [(0, '6345.205'), (1, '5135.667')] [2023-12-26 10:01:18,822][123091] Updated weights for policy 0, policy_version 1306542 (0.0011) [2023-12-26 10:01:19,302][123090] Updated weights for policy 1, policy_version 1297153 (0.0006) [2023-12-26 10:01:19,376][123090] Updated weights for policy 1, policy_version 1297163 (0.0008) [2023-12-26 10:01:19,435][123090] Updated weights for policy 1, policy_version 1297173 (0.0008) [2023-12-26 10:01:19,501][123090] Updated weights for policy 1, policy_version 1297183 (0.0008) [2023-12-26 10:01:19,556][123091] Updated weights for policy 0, policy_version 1306552 (0.0011) [2023-12-26 10:01:19,613][123091] Updated weights for policy 0, policy_version 1306562 (0.0011) [2023-12-26 10:01:19,670][123091] Updated weights for policy 0, policy_version 1306572 (0.0010) [2023-12-26 10:01:20,303][123090] Updated weights for policy 1, policy_version 1297193 (0.0009) [2023-12-26 10:01:20,358][123090] Updated weights for policy 1, policy_version 1297203 (0.0009) [2023-12-26 10:01:20,411][123090] Updated weights for policy 1, policy_version 1297213 (0.0009) [2023-12-26 10:01:20,533][123091] Updated weights for policy 0, policy_version 1306582 (0.0010) [2023-12-26 10:01:20,613][123091] Updated weights for policy 0, policy_version 1306592 (0.0012) [2023-12-26 10:01:20,683][123091] Updated weights for policy 0, policy_version 1306602 (0.0010) [2023-12-26 10:01:21,216][123090] Updated weights for policy 1, policy_version 1297223 (0.0007) [2023-12-26 10:01:21,292][123090] Updated weights for policy 1, policy_version 1297233 (0.0008) [2023-12-26 10:01:21,367][123090] Updated weights for policy 1, policy_version 1297243 (0.0010) [2023-12-26 10:01:21,553][123091] Updated weights for policy 0, policy_version 1306612 (0.0010) [2023-12-26 10:01:21,610][123091] Updated weights for policy 0, policy_version 1306622 (0.0008) [2023-12-26 10:01:21,687][123091] Updated weights for policy 0, policy_version 1306632 (0.0007) [2023-12-26 10:01:22,093][123090] Updated weights for policy 1, policy_version 1297253 (0.0007) [2023-12-26 10:01:22,150][123090] Updated weights for policy 1, policy_version 1297263 (0.0005) [2023-12-26 10:01:22,224][123090] Updated weights for policy 1, policy_version 1297273 (0.0006) [2023-12-26 10:01:22,590][123091] Updated weights for policy 0, policy_version 1306642 (0.0009) [2023-12-26 10:01:22,653][123091] Updated weights for policy 0, policy_version 1306652 (0.0010) [2023-12-26 10:01:22,707][123091] Updated weights for policy 0, policy_version 1306662 (0.0009) [2023-12-26 10:01:22,761][123091] Updated weights for policy 0, policy_version 1306672 (0.0009) [2023-12-26 10:01:23,003][123090] Updated weights for policy 1, policy_version 1297283 (0.0008) [2023-12-26 10:01:23,064][123090] Updated weights for policy 1, policy_version 1297293 (0.0009) [2023-12-26 10:01:23,123][123090] Updated weights for policy 1, policy_version 1297303 (0.0008) [2023-12-26 10:01:23,615][123091] Updated weights for policy 0, policy_version 1306682 (0.0005) [2023-12-26 10:01:23,664][123091] Updated weights for policy 0, policy_version 1306692 (0.0005) [2023-12-26 10:01:23,708][123091] Updated weights for policy 0, policy_version 1306702 (0.0005) [2023-12-26 10:01:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 666632192. Throughput: 0: 8662.7, 1: 8778.9. Samples: 666607172. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:23,785][121949] Avg episode reward: [(0, '6321.116'), (1, '5045.637')] [2023-12-26 10:01:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001306704_334520320.pth... [2023-12-26 10:01:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001297312_332111872.pth... [2023-12-26 10:01:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001305680_334258176.pth [2023-12-26 10:01:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001296288_331849728.pth [2023-12-26 10:01:23,898][123090] Updated weights for policy 1, policy_version 1297313 (0.0008) [2023-12-26 10:01:23,966][123090] Updated weights for policy 1, policy_version 1297323 (0.0005) [2023-12-26 10:01:24,031][123090] Updated weights for policy 1, policy_version 1297333 (0.0005) [2023-12-26 10:01:24,086][123090] Updated weights for policy 1, policy_version 1297343 (0.0005) [2023-12-26 10:01:24,456][123091] Updated weights for policy 0, policy_version 1306712 (0.0005) [2023-12-26 10:01:24,520][123091] Updated weights for policy 0, policy_version 1306722 (0.0008) [2023-12-26 10:01:24,582][123091] Updated weights for policy 0, policy_version 1306732 (0.0010) [2023-12-26 10:01:24,774][123090] Updated weights for policy 1, policy_version 1297353 (0.0010) [2023-12-26 10:01:24,825][123090] Updated weights for policy 1, policy_version 1297363 (0.0010) [2023-12-26 10:01:24,872][123090] Updated weights for policy 1, policy_version 1297373 (0.0010) [2023-12-26 10:01:25,376][123091] Updated weights for policy 0, policy_version 1306742 (0.0010) [2023-12-26 10:01:25,437][123091] Updated weights for policy 0, policy_version 1306752 (0.0009) [2023-12-26 10:01:25,502][123091] Updated weights for policy 0, policy_version 1306762 (0.0009) [2023-12-26 10:01:25,607][123090] Updated weights for policy 1, policy_version 1297383 (0.0010) [2023-12-26 10:01:25,658][123090] Updated weights for policy 1, policy_version 1297393 (0.0010) [2023-12-26 10:01:25,710][123090] Updated weights for policy 1, policy_version 1297403 (0.0010) [2023-12-26 10:01:26,336][123091] Updated weights for policy 0, policy_version 1306772 (0.0009) [2023-12-26 10:01:26,403][123091] Updated weights for policy 0, policy_version 1306782 (0.0009) [2023-12-26 10:01:26,472][123091] Updated weights for policy 0, policy_version 1306792 (0.0009) [2023-12-26 10:01:26,554][123090] Updated weights for policy 1, policy_version 1297413 (0.0009) [2023-12-26 10:01:26,617][123090] Updated weights for policy 1, policy_version 1297423 (0.0010) [2023-12-26 10:01:26,686][123090] Updated weights for policy 1, policy_version 1297433 (0.0010) [2023-12-26 10:01:27,290][123091] Updated weights for policy 0, policy_version 1306802 (0.0010) [2023-12-26 10:01:27,316][123090] Updated weights for policy 1, policy_version 1297443 (0.0009) [2023-12-26 10:01:27,351][123091] Updated weights for policy 0, policy_version 1306812 (0.0010) [2023-12-26 10:01:27,374][123090] Updated weights for policy 1, policy_version 1297453 (0.0010) [2023-12-26 10:01:27,403][123091] Updated weights for policy 0, policy_version 1306822 (0.0006) [2023-12-26 10:01:27,426][123090] Updated weights for policy 1, policy_version 1297463 (0.0010) [2023-12-26 10:01:27,465][123091] Updated weights for policy 0, policy_version 1306832 (0.0010) [2023-12-26 10:01:28,151][123090] Updated weights for policy 1, policy_version 1297473 (0.0010) [2023-12-26 10:01:28,208][123090] Updated weights for policy 1, policy_version 1297483 (0.0005) [2023-12-26 10:01:28,258][123090] Updated weights for policy 1, policy_version 1297493 (0.0005) [2023-12-26 10:01:28,282][123091] Updated weights for policy 0, policy_version 1306842 (0.0007) [2023-12-26 10:01:28,325][123090] Updated weights for policy 1, policy_version 1297503 (0.0006) [2023-12-26 10:01:28,335][123091] Updated weights for policy 0, policy_version 1306852 (0.0006) [2023-12-26 10:01:28,407][123091] Updated weights for policy 0, policy_version 1306862 (0.0007) [2023-12-26 10:01:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 666722304. Throughput: 0: 8654.4, 1: 8901.4. Samples: 666714504. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:28,785][121949] Avg episode reward: [(0, '6276.837'), (1, '5245.089')] [2023-12-26 10:01:29,001][123090] Updated weights for policy 1, policy_version 1297513 (0.0007) [2023-12-26 10:01:29,062][123090] Updated weights for policy 1, policy_version 1297523 (0.0010) [2023-12-26 10:01:29,078][123091] Updated weights for policy 0, policy_version 1306872 (0.0006) [2023-12-26 10:01:29,117][123090] Updated weights for policy 1, policy_version 1297533 (0.0010) [2023-12-26 10:01:29,136][123091] Updated weights for policy 0, policy_version 1306882 (0.0005) [2023-12-26 10:01:29,192][123091] Updated weights for policy 0, policy_version 1306892 (0.0009) [2023-12-26 10:01:29,967][123090] Updated weights for policy 1, policy_version 1297543 (0.0010) [2023-12-26 10:01:30,033][123090] Updated weights for policy 1, policy_version 1297553 (0.0008) [2023-12-26 10:01:30,047][123091] Updated weights for policy 0, policy_version 1306902 (0.0008) [2023-12-26 10:01:30,093][123090] Updated weights for policy 1, policy_version 1297563 (0.0005) [2023-12-26 10:01:30,101][123091] Updated weights for policy 0, policy_version 1306912 (0.0008) [2023-12-26 10:01:30,152][123091] Updated weights for policy 0, policy_version 1306922 (0.0008) [2023-12-26 10:01:30,878][123091] Updated weights for policy 0, policy_version 1306932 (0.0006) [2023-12-26 10:01:30,928][123090] Updated weights for policy 1, policy_version 1297573 (0.0005) [2023-12-26 10:01:30,929][123091] Updated weights for policy 0, policy_version 1306942 (0.0007) [2023-12-26 10:01:30,984][123091] Updated weights for policy 0, policy_version 1306952 (0.0007) [2023-12-26 10:01:30,993][123090] Updated weights for policy 1, policy_version 1297583 (0.0005) [2023-12-26 10:01:31,068][123090] Updated weights for policy 1, policy_version 1297593 (0.0007) [2023-12-26 10:01:31,736][123091] Updated weights for policy 0, policy_version 1306962 (0.0008) [2023-12-26 10:01:31,748][123090] Updated weights for policy 1, policy_version 1297603 (0.0006) [2023-12-26 10:01:31,808][123091] Updated weights for policy 0, policy_version 1306972 (0.0007) [2023-12-26 10:01:31,820][123090] Updated weights for policy 1, policy_version 1297613 (0.0008) [2023-12-26 10:01:31,862][123091] Updated weights for policy 0, policy_version 1306982 (0.0006) [2023-12-26 10:01:31,877][123090] Updated weights for policy 1, policy_version 1297623 (0.0009) [2023-12-26 10:01:31,921][123091] Updated weights for policy 0, policy_version 1306992 (0.0006) [2023-12-26 10:01:32,655][123090] Updated weights for policy 1, policy_version 1297633 (0.0009) [2023-12-26 10:01:32,685][123091] Updated weights for policy 0, policy_version 1307002 (0.0009) [2023-12-26 10:01:32,707][123090] Updated weights for policy 1, policy_version 1297643 (0.0006) [2023-12-26 10:01:32,738][123091] Updated weights for policy 0, policy_version 1307012 (0.0009) [2023-12-26 10:01:32,756][123090] Updated weights for policy 1, policy_version 1297653 (0.0006) [2023-12-26 10:01:32,791][123091] Updated weights for policy 0, policy_version 1307022 (0.0009) [2023-12-26 10:01:32,812][123090] Updated weights for policy 1, policy_version 1297663 (0.0006) [2023-12-26 10:01:33,501][123090] Updated weights for policy 1, policy_version 1297673 (0.0005) [2023-12-26 10:01:33,579][123090] Updated weights for policy 1, policy_version 1297683 (0.0005) [2023-12-26 10:01:33,606][123091] Updated weights for policy 0, policy_version 1307032 (0.0006) [2023-12-26 10:01:33,649][123090] Updated weights for policy 1, policy_version 1297693 (0.0006) [2023-12-26 10:01:33,679][123091] Updated weights for policy 0, policy_version 1307042 (0.0008) [2023-12-26 10:01:33,749][123091] Updated weights for policy 0, policy_version 1307052 (0.0010) [2023-12-26 10:01:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 666820608. Throughput: 0: 8759.7, 1: 8981.4. Samples: 666826928. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:33,785][121949] Avg episode reward: [(0, '6332.875'), (1, '5462.496')] [2023-12-26 10:01:34,266][123090] Updated weights for policy 1, policy_version 1297703 (0.0006) [2023-12-26 10:01:34,345][123090] Updated weights for policy 1, policy_version 1297713 (0.0006) [2023-12-26 10:01:34,419][123091] Updated weights for policy 0, policy_version 1307062 (0.0009) [2023-12-26 10:01:34,420][123090] Updated weights for policy 1, policy_version 1297723 (0.0006) [2023-12-26 10:01:34,490][123091] Updated weights for policy 0, policy_version 1307072 (0.0010) [2023-12-26 10:01:34,564][123091] Updated weights for policy 0, policy_version 1307082 (0.0010) [2023-12-26 10:01:35,185][123090] Updated weights for policy 1, policy_version 1297733 (0.0007) [2023-12-26 10:01:35,250][123090] Updated weights for policy 1, policy_version 1297743 (0.0007) [2023-12-26 10:01:35,277][123091] Updated weights for policy 0, policy_version 1307092 (0.0009) [2023-12-26 10:01:35,301][123090] Updated weights for policy 1, policy_version 1297753 (0.0006) [2023-12-26 10:01:35,326][123091] Updated weights for policy 0, policy_version 1307102 (0.0005) [2023-12-26 10:01:35,377][123091] Updated weights for policy 0, policy_version 1307112 (0.0005) [2023-12-26 10:01:35,956][123090] Updated weights for policy 1, policy_version 1297763 (0.0005) [2023-12-26 10:01:36,015][123090] Updated weights for policy 1, policy_version 1297773 (0.0005) [2023-12-26 10:01:36,062][123090] Updated weights for policy 1, policy_version 1297783 (0.0005) [2023-12-26 10:01:36,101][123091] Updated weights for policy 0, policy_version 1307122 (0.0006) [2023-12-26 10:01:36,167][123091] Updated weights for policy 0, policy_version 1307132 (0.0007) [2023-12-26 10:01:36,236][123091] Updated weights for policy 0, policy_version 1307142 (0.0011) [2023-12-26 10:01:36,307][123091] Updated weights for policy 0, policy_version 1307152 (0.0011) [2023-12-26 10:01:36,867][123090] Updated weights for policy 1, policy_version 1297793 (0.0007) [2023-12-26 10:01:36,919][123090] Updated weights for policy 1, policy_version 1297803 (0.0010) [2023-12-26 10:01:36,978][123090] Updated weights for policy 1, policy_version 1297813 (0.0010) [2023-12-26 10:01:37,024][123090] Updated weights for policy 1, policy_version 1297823 (0.0009) [2023-12-26 10:01:37,100][123091] Updated weights for policy 0, policy_version 1307162 (0.0011) [2023-12-26 10:01:37,152][123091] Updated weights for policy 0, policy_version 1307172 (0.0011) [2023-12-26 10:01:37,204][123091] Updated weights for policy 0, policy_version 1307182 (0.0011) [2023-12-26 10:01:37,889][123090] Updated weights for policy 1, policy_version 1297833 (0.0010) [2023-12-26 10:01:37,953][123090] Updated weights for policy 1, policy_version 1297843 (0.0010) [2023-12-26 10:01:38,018][123090] Updated weights for policy 1, policy_version 1297853 (0.0011) [2023-12-26 10:01:38,065][123091] Updated weights for policy 0, policy_version 1307192 (0.0010) [2023-12-26 10:01:38,115][123091] Updated weights for policy 0, policy_version 1307202 (0.0009) [2023-12-26 10:01:38,170][123091] Updated weights for policy 0, policy_version 1307212 (0.0009) [2023-12-26 10:01:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 666902528. Throughput: 0: 8831.7, 1: 9034.4. Samples: 666883804. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:38,785][121949] Avg episode reward: [(0, '6329.334'), (1, '5453.981')] [2023-12-26 10:01:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001297856_332251136.pth... [2023-12-26 10:01:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001307216_334651392.pth... [2023-12-26 10:01:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001296800_331980800.pth [2023-12-26 10:01:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001306192_334389248.pth [2023-12-26 10:01:38,859][123090] Updated weights for policy 1, policy_version 1297863 (0.0011) [2023-12-26 10:01:38,934][123090] Updated weights for policy 1, policy_version 1297873 (0.0011) [2023-12-26 10:01:38,954][123091] Updated weights for policy 0, policy_version 1307222 (0.0009) [2023-12-26 10:01:38,986][123090] Updated weights for policy 1, policy_version 1297883 (0.0010) [2023-12-26 10:01:39,013][123091] Updated weights for policy 0, policy_version 1307232 (0.0005) [2023-12-26 10:01:39,072][123091] Updated weights for policy 0, policy_version 1307242 (0.0008) [2023-12-26 10:01:39,840][123090] Updated weights for policy 1, policy_version 1297893 (0.0011) [2023-12-26 10:01:39,906][123090] Updated weights for policy 1, policy_version 1297903 (0.0010) [2023-12-26 10:01:39,938][123091] Updated weights for policy 0, policy_version 1307252 (0.0007) [2023-12-26 10:01:39,980][123090] Updated weights for policy 1, policy_version 1297913 (0.0009) [2023-12-26 10:01:39,987][123091] Updated weights for policy 0, policy_version 1307262 (0.0009) [2023-12-26 10:01:40,044][123091] Updated weights for policy 0, policy_version 1307272 (0.0006) [2023-12-26 10:01:40,721][123090] Updated weights for policy 1, policy_version 1297923 (0.0008) [2023-12-26 10:01:40,776][123090] Updated weights for policy 1, policy_version 1297933 (0.0007) [2023-12-26 10:01:40,807][123091] Updated weights for policy 0, policy_version 1307282 (0.0008) [2023-12-26 10:01:40,832][123090] Updated weights for policy 1, policy_version 1297943 (0.0009) [2023-12-26 10:01:40,871][123091] Updated weights for policy 0, policy_version 1307292 (0.0005) [2023-12-26 10:01:40,920][123091] Updated weights for policy 0, policy_version 1307302 (0.0005) [2023-12-26 10:01:40,972][123091] Updated weights for policy 0, policy_version 1307312 (0.0005) [2023-12-26 10:01:41,671][123090] Updated weights for policy 1, policy_version 1297953 (0.0009) [2023-12-26 10:01:41,737][123090] Updated weights for policy 1, policy_version 1297963 (0.0009) [2023-12-26 10:01:41,757][123091] Updated weights for policy 0, policy_version 1307322 (0.0008) [2023-12-26 10:01:41,803][123090] Updated weights for policy 1, policy_version 1297973 (0.0008) [2023-12-26 10:01:41,819][123091] Updated weights for policy 0, policy_version 1307332 (0.0008) [2023-12-26 10:01:41,857][123090] Updated weights for policy 1, policy_version 1297983 (0.0008) [2023-12-26 10:01:41,884][123091] Updated weights for policy 0, policy_version 1307342 (0.0008) [2023-12-26 10:01:42,698][123091] Updated weights for policy 0, policy_version 1307352 (0.0010) [2023-12-26 10:01:42,736][123090] Updated weights for policy 1, policy_version 1297993 (0.0006) [2023-12-26 10:01:42,748][123091] Updated weights for policy 0, policy_version 1307362 (0.0009) [2023-12-26 10:01:42,797][123090] Updated weights for policy 1, policy_version 1298003 (0.0006) [2023-12-26 10:01:42,802][123091] Updated weights for policy 0, policy_version 1307372 (0.0005) [2023-12-26 10:01:42,863][123090] Updated weights for policy 1, policy_version 1298013 (0.0005) [2023-12-26 10:01:43,510][123091] Updated weights for policy 0, policy_version 1307382 (0.0006) [2023-12-26 10:01:43,529][123090] Updated weights for policy 1, policy_version 1298023 (0.0005) [2023-12-26 10:01:43,558][123091] Updated weights for policy 0, policy_version 1307392 (0.0007) [2023-12-26 10:01:43,597][123090] Updated weights for policy 1, policy_version 1298033 (0.0005) [2023-12-26 10:01:43,610][123091] Updated weights for policy 0, policy_version 1307402 (0.0007) [2023-12-26 10:01:43,663][123090] Updated weights for policy 1, policy_version 1298043 (0.0010) [2023-12-26 10:01:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 667000832. Throughput: 0: 8877.6, 1: 8929.8. Samples: 666987276. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:43,785][121949] Avg episode reward: [(0, '6305.389'), (1, '5278.518')] [2023-12-26 10:01:44,341][123090] Updated weights for policy 1, policy_version 1298053 (0.0010) [2023-12-26 10:01:44,393][123090] Updated weights for policy 1, policy_version 1298063 (0.0009) [2023-12-26 10:01:44,402][123091] Updated weights for policy 0, policy_version 1307412 (0.0008) [2023-12-26 10:01:44,455][123091] Updated weights for policy 0, policy_version 1307422 (0.0008) [2023-12-26 10:01:44,461][123090] Updated weights for policy 1, policy_version 1298073 (0.0008) [2023-12-26 10:01:44,513][123091] Updated weights for policy 0, policy_version 1307432 (0.0007) [2023-12-26 10:01:45,304][123090] Updated weights for policy 1, policy_version 1298083 (0.0008) [2023-12-26 10:01:45,305][123091] Updated weights for policy 0, policy_version 1307442 (0.0007) [2023-12-26 10:01:45,362][123090] Updated weights for policy 1, policy_version 1298093 (0.0008) [2023-12-26 10:01:45,370][123091] Updated weights for policy 0, policy_version 1307452 (0.0008) [2023-12-26 10:01:45,416][123090] Updated weights for policy 1, policy_version 1298103 (0.0008) [2023-12-26 10:01:45,434][123091] Updated weights for policy 0, policy_version 1307462 (0.0009) [2023-12-26 10:01:45,497][123091] Updated weights for policy 0, policy_version 1307472 (0.0008) [2023-12-26 10:01:46,234][123091] Updated weights for policy 0, policy_version 1307482 (0.0005) [2023-12-26 10:01:46,286][123090] Updated weights for policy 1, policy_version 1298113 (0.0009) [2023-12-26 10:01:46,302][123091] Updated weights for policy 0, policy_version 1307492 (0.0006) [2023-12-26 10:01:46,334][123090] Updated weights for policy 1, policy_version 1298123 (0.0008) [2023-12-26 10:01:46,369][123091] Updated weights for policy 0, policy_version 1307502 (0.0008) [2023-12-26 10:01:46,396][123090] Updated weights for policy 1, policy_version 1298133 (0.0009) [2023-12-26 10:01:46,456][123090] Updated weights for policy 1, policy_version 1298143 (0.0012) [2023-12-26 10:01:47,052][123091] Updated weights for policy 0, policy_version 1307512 (0.0006) [2023-12-26 10:01:47,098][123091] Updated weights for policy 0, policy_version 1307522 (0.0005) [2023-12-26 10:01:47,154][123091] Updated weights for policy 0, policy_version 1307532 (0.0008) [2023-12-26 10:01:47,389][123090] Updated weights for policy 1, policy_version 1298153 (0.0009) [2023-12-26 10:01:47,452][123090] Updated weights for policy 1, policy_version 1298163 (0.0010) [2023-12-26 10:01:47,516][123090] Updated weights for policy 1, policy_version 1298173 (0.0010) [2023-12-26 10:01:47,987][123091] Updated weights for policy 0, policy_version 1307542 (0.0009) [2023-12-26 10:01:48,042][123091] Updated weights for policy 0, policy_version 1307552 (0.0008) [2023-12-26 10:01:48,112][123091] Updated weights for policy 0, policy_version 1307562 (0.0005) [2023-12-26 10:01:48,381][123090] Updated weights for policy 1, policy_version 1298183 (0.0008) [2023-12-26 10:01:48,458][123090] Updated weights for policy 1, policy_version 1298193 (0.0006) [2023-12-26 10:01:48,530][123090] Updated weights for policy 1, policy_version 1298203 (0.0009) [2023-12-26 10:01:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 667082752. Throughput: 0: 8982.0, 1: 8965.1. Samples: 667096176. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:48,785][121949] Avg episode reward: [(0, '6284.978'), (1, '5098.026')] [2023-12-26 10:01:48,815][123091] Updated weights for policy 0, policy_version 1307572 (0.0007) [2023-12-26 10:01:48,866][123091] Updated weights for policy 0, policy_version 1307582 (0.0005) [2023-12-26 10:01:48,922][123091] Updated weights for policy 0, policy_version 1307592 (0.0006) [2023-12-26 10:01:49,263][123090] Updated weights for policy 1, policy_version 1298213 (0.0009) [2023-12-26 10:01:49,327][123090] Updated weights for policy 1, policy_version 1298223 (0.0008) [2023-12-26 10:01:49,396][123090] Updated weights for policy 1, policy_version 1298233 (0.0009) [2023-12-26 10:01:49,672][123091] Updated weights for policy 0, policy_version 1307602 (0.0007) [2023-12-26 10:01:49,741][123091] Updated weights for policy 0, policy_version 1307612 (0.0009) [2023-12-26 10:01:49,810][123091] Updated weights for policy 0, policy_version 1307622 (0.0009) [2023-12-26 10:01:49,881][123091] Updated weights for policy 0, policy_version 1307632 (0.0009) [2023-12-26 10:01:50,223][123090] Updated weights for policy 1, policy_version 1298243 (0.0010) [2023-12-26 10:01:50,292][123090] Updated weights for policy 1, policy_version 1298253 (0.0010) [2023-12-26 10:01:50,347][123090] Updated weights for policy 1, policy_version 1298263 (0.0010) [2023-12-26 10:01:50,755][123091] Updated weights for policy 0, policy_version 1307642 (0.0011) [2023-12-26 10:01:50,818][123091] Updated weights for policy 0, policy_version 1307652 (0.0011) [2023-12-26 10:01:50,866][123091] Updated weights for policy 0, policy_version 1307662 (0.0007) [2023-12-26 10:01:51,166][123090] Updated weights for policy 1, policy_version 1298273 (0.0010) [2023-12-26 10:01:51,214][123090] Updated weights for policy 1, policy_version 1298283 (0.0010) [2023-12-26 10:01:51,277][123090] Updated weights for policy 1, policy_version 1298293 (0.0010) [2023-12-26 10:01:51,329][123090] Updated weights for policy 1, policy_version 1298303 (0.0010) [2023-12-26 10:01:51,607][123091] Updated weights for policy 0, policy_version 1307672 (0.0006) [2023-12-26 10:01:51,673][123091] Updated weights for policy 0, policy_version 1307682 (0.0011) [2023-12-26 10:01:51,745][123091] Updated weights for policy 0, policy_version 1307692 (0.0010) [2023-12-26 10:01:52,193][123090] Updated weights for policy 1, policy_version 1298313 (0.0010) [2023-12-26 10:01:52,256][123090] Updated weights for policy 1, policy_version 1298323 (0.0010) [2023-12-26 10:01:52,331][123090] Updated weights for policy 1, policy_version 1298333 (0.0011) [2023-12-26 10:01:52,427][123091] Updated weights for policy 0, policy_version 1307702 (0.0011) [2023-12-26 10:01:52,490][123091] Updated weights for policy 0, policy_version 1307712 (0.0011) [2023-12-26 10:01:52,543][123091] Updated weights for policy 0, policy_version 1307722 (0.0005) [2023-12-26 10:01:53,112][123090] Updated weights for policy 1, policy_version 1298343 (0.0009) [2023-12-26 10:01:53,183][123090] Updated weights for policy 1, policy_version 1298353 (0.0008) [2023-12-26 10:01:53,253][123090] Updated weights for policy 1, policy_version 1298363 (0.0010) [2023-12-26 10:01:53,302][123091] Updated weights for policy 0, policy_version 1307732 (0.0006) [2023-12-26 10:01:53,353][123091] Updated weights for policy 0, policy_version 1307742 (0.0005) [2023-12-26 10:01:53,405][123091] Updated weights for policy 0, policy_version 1307752 (0.0005) [2023-12-26 10:01:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 667172864. Throughput: 0: 8992.7, 1: 8909.8. Samples: 667148396. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:53,785][121949] Avg episode reward: [(0, '6194.542'), (1, '5162.753')] [2023-12-26 10:01:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001307760_334790656.pth... [2023-12-26 10:01:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001298368_332382208.pth... [2023-12-26 10:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001297312_332111872.pth [2023-12-26 10:01:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001306704_334520320.pth [2023-12-26 10:01:53,963][123090] Updated weights for policy 1, policy_version 1298373 (0.0006) [2023-12-26 10:01:54,018][123090] Updated weights for policy 1, policy_version 1298383 (0.0005) [2023-12-26 10:01:54,067][123091] Updated weights for policy 0, policy_version 1307762 (0.0006) [2023-12-26 10:01:54,092][123090] Updated weights for policy 1, policy_version 1298393 (0.0006) [2023-12-26 10:01:54,139][123091] Updated weights for policy 0, policy_version 1307772 (0.0009) [2023-12-26 10:01:54,197][123091] Updated weights for policy 0, policy_version 1307782 (0.0010) [2023-12-26 10:01:54,250][123091] Updated weights for policy 0, policy_version 1307792 (0.0011) [2023-12-26 10:01:54,768][123090] Updated weights for policy 1, policy_version 1298403 (0.0006) [2023-12-26 10:01:54,826][123090] Updated weights for policy 1, policy_version 1298413 (0.0005) [2023-12-26 10:01:54,876][123090] Updated weights for policy 1, policy_version 1298423 (0.0005) [2023-12-26 10:01:54,993][123091] Updated weights for policy 0, policy_version 1307802 (0.0006) [2023-12-26 10:01:55,048][123091] Updated weights for policy 0, policy_version 1307812 (0.0008) [2023-12-26 10:01:55,115][123091] Updated weights for policy 0, policy_version 1307822 (0.0009) [2023-12-26 10:01:55,523][123090] Updated weights for policy 1, policy_version 1298433 (0.0005) [2023-12-26 10:01:55,574][123090] Updated weights for policy 1, policy_version 1298443 (0.0005) [2023-12-26 10:01:55,622][123090] Updated weights for policy 1, policy_version 1298453 (0.0005) [2023-12-26 10:01:55,672][123090] Updated weights for policy 1, policy_version 1298463 (0.0005) [2023-12-26 10:01:55,915][123091] Updated weights for policy 0, policy_version 1307832 (0.0006) [2023-12-26 10:01:55,974][123091] Updated weights for policy 0, policy_version 1307842 (0.0005) [2023-12-26 10:01:56,024][123091] Updated weights for policy 0, policy_version 1307852 (0.0005) [2023-12-26 10:01:56,381][123090] Updated weights for policy 1, policy_version 1298473 (0.0005) [2023-12-26 10:01:56,443][123090] Updated weights for policy 1, policy_version 1298483 (0.0005) [2023-12-26 10:01:56,505][123090] Updated weights for policy 1, policy_version 1298493 (0.0005) [2023-12-26 10:01:56,839][123091] Updated weights for policy 0, policy_version 1307862 (0.0009) [2023-12-26 10:01:56,902][123091] Updated weights for policy 0, policy_version 1307872 (0.0009) [2023-12-26 10:01:56,967][123091] Updated weights for policy 0, policy_version 1307882 (0.0007) [2023-12-26 10:01:57,114][123090] Updated weights for policy 1, policy_version 1298503 (0.0009) [2023-12-26 10:01:57,173][123090] Updated weights for policy 1, policy_version 1298513 (0.0010) [2023-12-26 10:01:57,231][123090] Updated weights for policy 1, policy_version 1298523 (0.0010) [2023-12-26 10:01:57,629][123091] Updated weights for policy 0, policy_version 1307892 (0.0007) [2023-12-26 10:01:57,675][123091] Updated weights for policy 0, policy_version 1307902 (0.0005) [2023-12-26 10:01:57,743][123091] Updated weights for policy 0, policy_version 1307912 (0.0005) [2023-12-26 10:01:57,948][123090] Updated weights for policy 1, policy_version 1298533 (0.0008) [2023-12-26 10:01:57,995][123090] Updated weights for policy 1, policy_version 1298543 (0.0005) [2023-12-26 10:01:58,070][123090] Updated weights for policy 1, policy_version 1298553 (0.0007) [2023-12-26 10:01:58,516][123091] Updated weights for policy 0, policy_version 1307922 (0.0006) [2023-12-26 10:01:58,581][123091] Updated weights for policy 0, policy_version 1307932 (0.0009) [2023-12-26 10:01:58,651][123091] Updated weights for policy 0, policy_version 1307942 (0.0010) [2023-12-26 10:01:58,728][123091] Updated weights for policy 0, policy_version 1307952 (0.0010) [2023-12-26 10:01:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17689.2). Total num frames: 667271168. Throughput: 0: 9027.8, 1: 9025.4. Samples: 667263108. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:01:58,785][121949] Avg episode reward: [(0, '6188.500'), (1, '5122.759')] [2023-12-26 10:01:58,804][123090] Updated weights for policy 1, policy_version 1298563 (0.0007) [2023-12-26 10:01:58,876][123090] Updated weights for policy 1, policy_version 1298573 (0.0010) [2023-12-26 10:01:58,933][123090] Updated weights for policy 1, policy_version 1298583 (0.0011) [2023-12-26 10:01:59,596][123091] Updated weights for policy 0, policy_version 1307962 (0.0006) [2023-12-26 10:01:59,665][123091] Updated weights for policy 0, policy_version 1307972 (0.0006) [2023-12-26 10:01:59,725][123091] Updated weights for policy 0, policy_version 1307982 (0.0006) [2023-12-26 10:01:59,743][123090] Updated weights for policy 1, policy_version 1298593 (0.0010) [2023-12-26 10:01:59,806][123090] Updated weights for policy 1, policy_version 1298603 (0.0006) [2023-12-26 10:01:59,883][123090] Updated weights for policy 1, policy_version 1298613 (0.0009) [2023-12-26 10:01:59,955][123090] Updated weights for policy 1, policy_version 1298623 (0.0011) [2023-12-26 10:02:00,354][123091] Updated weights for policy 0, policy_version 1307992 (0.0006) [2023-12-26 10:02:00,417][123091] Updated weights for policy 0, policy_version 1308002 (0.0007) [2023-12-26 10:02:00,476][123091] Updated weights for policy 0, policy_version 1308012 (0.0009) [2023-12-26 10:02:00,757][123090] Updated weights for policy 1, policy_version 1298633 (0.0010) [2023-12-26 10:02:00,804][123090] Updated weights for policy 1, policy_version 1298643 (0.0010) [2023-12-26 10:02:00,869][123090] Updated weights for policy 1, policy_version 1298653 (0.0010) [2023-12-26 10:02:01,212][123091] Updated weights for policy 0, policy_version 1308022 (0.0009) [2023-12-26 10:02:01,268][123091] Updated weights for policy 0, policy_version 1308032 (0.0009) [2023-12-26 10:02:01,321][123091] Updated weights for policy 0, policy_version 1308042 (0.0009) [2023-12-26 10:02:01,726][123090] Updated weights for policy 1, policy_version 1298663 (0.0009) [2023-12-26 10:02:01,796][123090] Updated weights for policy 1, policy_version 1298673 (0.0006) [2023-12-26 10:02:01,855][123090] Updated weights for policy 1, policy_version 1298683 (0.0005) [2023-12-26 10:02:02,124][123091] Updated weights for policy 0, policy_version 1308052 (0.0008) [2023-12-26 10:02:02,187][123091] Updated weights for policy 0, policy_version 1308062 (0.0005) [2023-12-26 10:02:02,255][123091] Updated weights for policy 0, policy_version 1308072 (0.0006) [2023-12-26 10:02:02,607][123090] Updated weights for policy 1, policy_version 1298693 (0.0008) [2023-12-26 10:02:02,656][123090] Updated weights for policy 1, policy_version 1298703 (0.0009) [2023-12-26 10:02:02,718][123090] Updated weights for policy 1, policy_version 1298713 (0.0009) [2023-12-26 10:02:02,939][123091] Updated weights for policy 0, policy_version 1308082 (0.0009) [2023-12-26 10:02:03,000][123091] Updated weights for policy 0, policy_version 1308092 (0.0005) [2023-12-26 10:02:03,057][123091] Updated weights for policy 0, policy_version 1308102 (0.0009) [2023-12-26 10:02:03,109][123091] Updated weights for policy 0, policy_version 1308112 (0.0009) [2023-12-26 10:02:03,479][123090] Updated weights for policy 1, policy_version 1298723 (0.0007) [2023-12-26 10:02:03,543][123090] Updated weights for policy 1, policy_version 1298733 (0.0005) [2023-12-26 10:02:03,591][123090] Updated weights for policy 1, policy_version 1298743 (0.0005) [2023-12-26 10:02:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 667361280. Throughput: 0: 9061.1, 1: 9065.9. Samples: 667371924. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:03,784][121949] Avg episode reward: [(0, '6197.277'), (1, '5025.690')] [2023-12-26 10:02:03,857][123091] Updated weights for policy 0, policy_version 1308122 (0.0008) [2023-12-26 10:02:03,911][123091] Updated weights for policy 0, policy_version 1308132 (0.0009) [2023-12-26 10:02:03,962][123091] Updated weights for policy 0, policy_version 1308142 (0.0010) [2023-12-26 10:02:04,382][123090] Updated weights for policy 1, policy_version 1298753 (0.0008) [2023-12-26 10:02:04,442][123090] Updated weights for policy 1, policy_version 1298763 (0.0011) [2023-12-26 10:02:04,506][123090] Updated weights for policy 1, policy_version 1298773 (0.0007) [2023-12-26 10:02:04,568][123090] Updated weights for policy 1, policy_version 1298783 (0.0010) [2023-12-26 10:02:04,752][123091] Updated weights for policy 0, policy_version 1308152 (0.0007) [2023-12-26 10:02:04,820][123091] Updated weights for policy 0, policy_version 1308162 (0.0006) [2023-12-26 10:02:04,888][123091] Updated weights for policy 0, policy_version 1308172 (0.0005) [2023-12-26 10:02:05,381][123090] Updated weights for policy 1, policy_version 1298793 (0.0007) [2023-12-26 10:02:05,443][123090] Updated weights for policy 1, policy_version 1298803 (0.0006) [2023-12-26 10:02:05,498][123090] Updated weights for policy 1, policy_version 1298814 (0.0009) [2023-12-26 10:02:05,531][123091] Updated weights for policy 0, policy_version 1308182 (0.0006) [2023-12-26 10:02:05,582][123091] Updated weights for policy 0, policy_version 1308192 (0.0006) [2023-12-26 10:02:05,649][123091] Updated weights for policy 0, policy_version 1308202 (0.0006) [2023-12-26 10:02:06,209][123090] Updated weights for policy 1, policy_version 1298824 (0.0008) [2023-12-26 10:02:06,272][123090] Updated weights for policy 1, policy_version 1298834 (0.0009) [2023-12-26 10:02:06,341][123090] Updated weights for policy 1, policy_version 1298844 (0.0009) [2023-12-26 10:02:06,381][123091] Updated weights for policy 0, policy_version 1308212 (0.0006) [2023-12-26 10:02:06,446][123091] Updated weights for policy 0, policy_version 1308222 (0.0010) [2023-12-26 10:02:06,517][123091] Updated weights for policy 0, policy_version 1308232 (0.0006) [2023-12-26 10:02:07,199][123090] Updated weights for policy 1, policy_version 1298854 (0.0010) [2023-12-26 10:02:07,263][123090] Updated weights for policy 1, policy_version 1298864 (0.0010) [2023-12-26 10:02:07,296][123091] Updated weights for policy 0, policy_version 1308242 (0.0006) [2023-12-26 10:02:07,314][123090] Updated weights for policy 1, policy_version 1298874 (0.0009) [2023-12-26 10:02:07,365][123091] Updated weights for policy 0, policy_version 1308252 (0.0005) [2023-12-26 10:02:07,438][123091] Updated weights for policy 0, policy_version 1308262 (0.0006) [2023-12-26 10:02:07,510][123091] Updated weights for policy 0, policy_version 1308272 (0.0010) [2023-12-26 10:02:08,219][123090] Updated weights for policy 1, policy_version 1298884 (0.0009) [2023-12-26 10:02:08,222][123091] Updated weights for policy 0, policy_version 1308282 (0.0009) [2023-12-26 10:02:08,266][123090] Updated weights for policy 1, policy_version 1298894 (0.0008) [2023-12-26 10:02:08,283][123091] Updated weights for policy 0, policy_version 1308292 (0.0008) [2023-12-26 10:02:08,331][123090] Updated weights for policy 1, policy_version 1298904 (0.0006) [2023-12-26 10:02:08,348][123091] Updated weights for policy 0, policy_version 1308302 (0.0010) [2023-12-26 10:02:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 667451392. Throughput: 0: 9129.5, 1: 9106.8. Samples: 667427804. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:08,785][121949] Avg episode reward: [(0, '6305.729'), (1, '5116.444')] [2023-12-26 10:02:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001308304_334929920.pth... [2023-12-26 10:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001298912_332521472.pth... [2023-12-26 10:02:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001307216_334651392.pth [2023-12-26 10:02:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001297856_332251136.pth [2023-12-26 10:02:09,113][123091] Updated weights for policy 0, policy_version 1308312 (0.0010) [2023-12-26 10:02:09,164][123091] Updated weights for policy 0, policy_version 1308322 (0.0010) [2023-12-26 10:02:09,169][123090] Updated weights for policy 1, policy_version 1298914 (0.0009) [2023-12-26 10:02:09,222][123091] Updated weights for policy 0, policy_version 1308332 (0.0010) [2023-12-26 10:02:09,238][123090] Updated weights for policy 1, policy_version 1298924 (0.0008) [2023-12-26 10:02:09,299][123090] Updated weights for policy 1, policy_version 1298934 (0.0009) [2023-12-26 10:02:09,365][123090] Updated weights for policy 1, policy_version 1298944 (0.0008) [2023-12-26 10:02:10,105][123091] Updated weights for policy 0, policy_version 1308342 (0.0010) [2023-12-26 10:02:10,173][123091] Updated weights for policy 0, policy_version 1308352 (0.0009) [2023-12-26 10:02:10,203][123090] Updated weights for policy 1, policy_version 1298954 (0.0008) [2023-12-26 10:02:10,241][123091] Updated weights for policy 0, policy_version 1308362 (0.0009) [2023-12-26 10:02:10,258][123090] Updated weights for policy 1, policy_version 1298964 (0.0007) [2023-12-26 10:02:10,319][123090] Updated weights for policy 1, policy_version 1298974 (0.0008) [2023-12-26 10:02:11,039][123091] Updated weights for policy 0, policy_version 1308372 (0.0010) [2023-12-26 10:02:11,111][123091] Updated weights for policy 0, policy_version 1308382 (0.0010) [2023-12-26 10:02:11,177][123091] Updated weights for policy 0, policy_version 1308392 (0.0008) [2023-12-26 10:02:11,190][123090] Updated weights for policy 1, policy_version 1298984 (0.0008) [2023-12-26 10:02:11,259][123090] Updated weights for policy 1, policy_version 1298994 (0.0007) [2023-12-26 10:02:11,326][123090] Updated weights for policy 1, policy_version 1299004 (0.0007) [2023-12-26 10:02:11,999][123091] Updated weights for policy 0, policy_version 1308402 (0.0008) [2023-12-26 10:02:12,062][123091] Updated weights for policy 0, policy_version 1308412 (0.0011) [2023-12-26 10:02:12,106][123090] Updated weights for policy 1, policy_version 1299014 (0.0008) [2023-12-26 10:02:12,123][123091] Updated weights for policy 0, policy_version 1308422 (0.0011) [2023-12-26 10:02:12,174][123090] Updated weights for policy 1, policy_version 1299024 (0.0008) [2023-12-26 10:02:12,209][123091] Updated weights for policy 0, policy_version 1308432 (0.0011) [2023-12-26 10:02:12,243][123090] Updated weights for policy 1, policy_version 1299034 (0.0008) [2023-12-26 10:02:13,011][123091] Updated weights for policy 0, policy_version 1308442 (0.0011) [2023-12-26 10:02:13,063][123091] Updated weights for policy 0, policy_version 1308452 (0.0011) [2023-12-26 10:02:13,065][123090] Updated weights for policy 1, policy_version 1299044 (0.0008) [2023-12-26 10:02:13,115][123090] Updated weights for policy 1, policy_version 1299054 (0.0006) [2023-12-26 10:02:13,115][123091] Updated weights for policy 0, policy_version 1308462 (0.0011) [2023-12-26 10:02:13,190][123090] Updated weights for policy 1, policy_version 1299064 (0.0010) [2023-12-26 10:02:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 667533312. Throughput: 0: 9138.5, 1: 8974.8. Samples: 667529604. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:13,785][121949] Avg episode reward: [(0, '6320.277'), (1, '5257.394')] [2023-12-26 10:02:13,913][123091] Updated weights for policy 0, policy_version 1308472 (0.0011) [2023-12-26 10:02:13,914][123090] Updated weights for policy 1, policy_version 1299074 (0.0008) [2023-12-26 10:02:13,966][123090] Updated weights for policy 1, policy_version 1299084 (0.0005) [2023-12-26 10:02:13,980][123091] Updated weights for policy 0, policy_version 1308482 (0.0010) [2023-12-26 10:02:14,012][123090] Updated weights for policy 1, policy_version 1299094 (0.0005) [2023-12-26 10:02:14,050][123091] Updated weights for policy 0, policy_version 1308492 (0.0011) [2023-12-26 10:02:14,065][123090] Updated weights for policy 1, policy_version 1299104 (0.0005) [2023-12-26 10:02:14,831][123091] Updated weights for policy 0, policy_version 1308502 (0.0010) [2023-12-26 10:02:14,834][123090] Updated weights for policy 1, policy_version 1299114 (0.0008) [2023-12-26 10:02:14,892][123091] Updated weights for policy 0, policy_version 1308512 (0.0011) [2023-12-26 10:02:14,899][123090] Updated weights for policy 1, policy_version 1299124 (0.0006) [2023-12-26 10:02:14,956][123091] Updated weights for policy 0, policy_version 1308522 (0.0011) [2023-12-26 10:02:14,965][123090] Updated weights for policy 1, policy_version 1299134 (0.0006) [2023-12-26 10:02:15,622][123090] Updated weights for policy 1, policy_version 1299144 (0.0005) [2023-12-26 10:02:15,675][123090] Updated weights for policy 1, policy_version 1299154 (0.0006) [2023-12-26 10:02:15,730][123090] Updated weights for policy 1, policy_version 1299164 (0.0005) [2023-12-26 10:02:15,805][123091] Updated weights for policy 0, policy_version 1308532 (0.0011) [2023-12-26 10:02:15,860][123091] Updated weights for policy 0, policy_version 1308542 (0.0010) [2023-12-26 10:02:15,916][123091] Updated weights for policy 0, policy_version 1308552 (0.0011) [2023-12-26 10:02:16,386][123090] Updated weights for policy 1, policy_version 1299174 (0.0007) [2023-12-26 10:02:16,435][123090] Updated weights for policy 1, policy_version 1299184 (0.0009) [2023-12-26 10:02:16,483][123090] Updated weights for policy 1, policy_version 1299194 (0.0009) [2023-12-26 10:02:16,746][123091] Updated weights for policy 0, policy_version 1308562 (0.0011) [2023-12-26 10:02:16,800][123091] Updated weights for policy 0, policy_version 1308572 (0.0010) [2023-12-26 10:02:16,851][123091] Updated weights for policy 0, policy_version 1308582 (0.0010) [2023-12-26 10:02:16,910][123091] Updated weights for policy 0, policy_version 1308592 (0.0010) [2023-12-26 10:02:17,351][123090] Updated weights for policy 1, policy_version 1299204 (0.0008) [2023-12-26 10:02:17,402][123090] Updated weights for policy 1, policy_version 1299214 (0.0009) [2023-12-26 10:02:17,449][123090] Updated weights for policy 1, policy_version 1299224 (0.0009) [2023-12-26 10:02:17,742][123091] Updated weights for policy 0, policy_version 1308602 (0.0011) [2023-12-26 10:02:17,799][123091] Updated weights for policy 0, policy_version 1308612 (0.0011) [2023-12-26 10:02:17,851][123091] Updated weights for policy 0, policy_version 1308622 (0.0011) [2023-12-26 10:02:18,312][123090] Updated weights for policy 1, policy_version 1299234 (0.0008) [2023-12-26 10:02:18,384][123090] Updated weights for policy 1, policy_version 1299244 (0.0009) [2023-12-26 10:02:18,443][123090] Updated weights for policy 1, policy_version 1299254 (0.0009) [2023-12-26 10:02:18,510][123090] Updated weights for policy 1, policy_version 1299264 (0.0009) [2023-12-26 10:02:18,648][123091] Updated weights for policy 0, policy_version 1308632 (0.0010) [2023-12-26 10:02:18,707][123091] Updated weights for policy 0, policy_version 1308642 (0.0011) [2023-12-26 10:02:18,754][123091] Updated weights for policy 0, policy_version 1308652 (0.0010) [2023-12-26 10:02:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 667631616. Throughput: 0: 9084.1, 1: 8925.2. Samples: 667637344. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:18,785][121949] Avg episode reward: [(0, '6310.166'), (1, '5235.498')] [2023-12-26 10:02:19,319][123090] Updated weights for policy 1, policy_version 1299274 (0.0011) [2023-12-26 10:02:19,389][123090] Updated weights for policy 1, policy_version 1299284 (0.0011) [2023-12-26 10:02:19,446][123090] Updated weights for policy 1, policy_version 1299294 (0.0011) [2023-12-26 10:02:19,594][123091] Updated weights for policy 0, policy_version 1308662 (0.0010) [2023-12-26 10:02:19,657][123091] Updated weights for policy 0, policy_version 1308672 (0.0009) [2023-12-26 10:02:19,716][123091] Updated weights for policy 0, policy_version 1308682 (0.0009) [2023-12-26 10:02:20,277][123090] Updated weights for policy 1, policy_version 1299304 (0.0007) [2023-12-26 10:02:20,336][123090] Updated weights for policy 1, policy_version 1299314 (0.0006) [2023-12-26 10:02:20,398][123090] Updated weights for policy 1, policy_version 1299324 (0.0006) [2023-12-26 10:02:20,645][123091] Updated weights for policy 0, policy_version 1308692 (0.0009) [2023-12-26 10:02:20,713][123091] Updated weights for policy 0, policy_version 1308702 (0.0010) [2023-12-26 10:02:20,780][123091] Updated weights for policy 0, policy_version 1308712 (0.0009) [2023-12-26 10:02:21,204][123090] Updated weights for policy 1, policy_version 1299334 (0.0006) [2023-12-26 10:02:21,270][123090] Updated weights for policy 1, policy_version 1299344 (0.0006) [2023-12-26 10:02:21,336][123090] Updated weights for policy 1, policy_version 1299354 (0.0006) [2023-12-26 10:02:21,632][123091] Updated weights for policy 0, policy_version 1308722 (0.0009) [2023-12-26 10:02:21,699][123091] Updated weights for policy 0, policy_version 1308732 (0.0010) [2023-12-26 10:02:21,772][123091] Updated weights for policy 0, policy_version 1308742 (0.0010) [2023-12-26 10:02:21,833][123091] Updated weights for policy 0, policy_version 1308752 (0.0009) [2023-12-26 10:02:22,064][123090] Updated weights for policy 1, policy_version 1299364 (0.0007) [2023-12-26 10:02:22,137][123090] Updated weights for policy 1, policy_version 1299374 (0.0006) [2023-12-26 10:02:22,193][123090] Updated weights for policy 1, policy_version 1299384 (0.0009) [2023-12-26 10:02:22,699][123091] Updated weights for policy 0, policy_version 1308762 (0.0005) [2023-12-26 10:02:22,764][123091] Updated weights for policy 0, policy_version 1308772 (0.0005) [2023-12-26 10:02:22,834][123091] Updated weights for policy 0, policy_version 1308782 (0.0005) [2023-12-26 10:02:23,060][123090] Updated weights for policy 1, policy_version 1299394 (0.0009) [2023-12-26 10:02:23,125][123090] Updated weights for policy 1, policy_version 1299404 (0.0006) [2023-12-26 10:02:23,190][123090] Updated weights for policy 1, policy_version 1299414 (0.0006) [2023-12-26 10:02:23,250][123090] Updated weights for policy 1, policy_version 1299424 (0.0005) [2023-12-26 10:02:23,626][123091] Updated weights for policy 0, policy_version 1308792 (0.0009) [2023-12-26 10:02:23,686][123091] Updated weights for policy 0, policy_version 1308802 (0.0009) [2023-12-26 10:02:23,735][123091] Updated weights for policy 0, policy_version 1308812 (0.0009) [2023-12-26 10:02:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17689.1). Total num frames: 667713536. Throughput: 0: 8999.7, 1: 8866.8. Samples: 667687796. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:23,785][121949] Avg episode reward: [(0, '6313.649'), (1, '5322.131')] [2023-12-26 10:02:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001308816_335060992.pth... [2023-12-26 10:02:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001299424_332652544.pth... [2023-12-26 10:02:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001298368_332382208.pth [2023-12-26 10:02:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001307760_334790656.pth [2023-12-26 10:02:23,949][123090] Updated weights for policy 1, policy_version 1299434 (0.0009) [2023-12-26 10:02:24,002][123090] Updated weights for policy 1, policy_version 1299444 (0.0007) [2023-12-26 10:02:24,054][123090] Updated weights for policy 1, policy_version 1299454 (0.0005) [2023-12-26 10:02:24,613][123091] Updated weights for policy 0, policy_version 1308822 (0.0007) [2023-12-26 10:02:24,663][123091] Updated weights for policy 0, policy_version 1308832 (0.0008) [2023-12-26 10:02:24,724][123091] Updated weights for policy 0, policy_version 1308842 (0.0009) [2023-12-26 10:02:24,827][123090] Updated weights for policy 1, policy_version 1299464 (0.0009) [2023-12-26 10:02:24,885][123090] Updated weights for policy 1, policy_version 1299475 (0.0010) [2023-12-26 10:02:24,950][123090] Updated weights for policy 1, policy_version 1299485 (0.0008) [2023-12-26 10:02:25,539][123091] Updated weights for policy 0, policy_version 1308852 (0.0006) [2023-12-26 10:02:25,591][123091] Updated weights for policy 0, policy_version 1308862 (0.0005) [2023-12-26 10:02:25,656][123091] Updated weights for policy 0, policy_version 1308872 (0.0009) [2023-12-26 10:02:25,734][123090] Updated weights for policy 1, policy_version 1299495 (0.0009) [2023-12-26 10:02:25,787][123090] Updated weights for policy 1, policy_version 1299505 (0.0010) [2023-12-26 10:02:25,848][123090] Updated weights for policy 1, policy_version 1299515 (0.0009) [2023-12-26 10:02:26,277][123091] Updated weights for policy 0, policy_version 1308882 (0.0009) [2023-12-26 10:02:26,351][123091] Updated weights for policy 0, policy_version 1308892 (0.0011) [2023-12-26 10:02:26,417][123091] Updated weights for policy 0, policy_version 1308902 (0.0010) [2023-12-26 10:02:26,468][123091] Updated weights for policy 0, policy_version 1308912 (0.0010) [2023-12-26 10:02:26,649][123090] Updated weights for policy 1, policy_version 1299525 (0.0008) [2023-12-26 10:02:26,706][123090] Updated weights for policy 1, policy_version 1299535 (0.0005) [2023-12-26 10:02:26,765][123090] Updated weights for policy 1, policy_version 1299545 (0.0010) [2023-12-26 10:02:27,203][123091] Updated weights for policy 0, policy_version 1308922 (0.0005) [2023-12-26 10:02:27,248][123091] Updated weights for policy 0, policy_version 1308932 (0.0005) [2023-12-26 10:02:27,299][123091] Updated weights for policy 0, policy_version 1308942 (0.0005) [2023-12-26 10:02:27,491][123090] Updated weights for policy 1, policy_version 1299555 (0.0009) [2023-12-26 10:02:27,549][123090] Updated weights for policy 1, policy_version 1299565 (0.0010) [2023-12-26 10:02:27,597][123090] Updated weights for policy 1, policy_version 1299575 (0.0010) [2023-12-26 10:02:28,075][123091] Updated weights for policy 0, policy_version 1308952 (0.0010) [2023-12-26 10:02:28,122][123091] Updated weights for policy 0, policy_version 1308962 (0.0008) [2023-12-26 10:02:28,170][123091] Updated weights for policy 0, policy_version 1308972 (0.0007) [2023-12-26 10:02:28,359][123090] Updated weights for policy 1, policy_version 1299585 (0.0009) [2023-12-26 10:02:28,426][123090] Updated weights for policy 1, policy_version 1299595 (0.0007) [2023-12-26 10:02:28,488][123090] Updated weights for policy 1, policy_version 1299605 (0.0010) [2023-12-26 10:02:28,558][123090] Updated weights for policy 1, policy_version 1299615 (0.0010) [2023-12-26 10:02:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 667803648. Throughput: 0: 9028.5, 1: 8944.6. Samples: 667796060. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:28,785][121949] Avg episode reward: [(0, '6305.084'), (1, '5375.569')] [2023-12-26 10:02:28,933][123091] Updated weights for policy 0, policy_version 1308982 (0.0009) [2023-12-26 10:02:28,985][123091] Updated weights for policy 0, policy_version 1308992 (0.0011) [2023-12-26 10:02:29,029][123091] Updated weights for policy 0, policy_version 1309002 (0.0010) [2023-12-26 10:02:29,356][123090] Updated weights for policy 1, policy_version 1299625 (0.0011) [2023-12-26 10:02:29,417][123090] Updated weights for policy 1, policy_version 1299635 (0.0011) [2023-12-26 10:02:29,476][123090] Updated weights for policy 1, policy_version 1299645 (0.0010) [2023-12-26 10:02:29,875][123091] Updated weights for policy 0, policy_version 1309012 (0.0010) [2023-12-26 10:02:29,933][123091] Updated weights for policy 0, policy_version 1309022 (0.0009) [2023-12-26 10:02:29,990][123091] Updated weights for policy 0, policy_version 1309032 (0.0009) [2023-12-26 10:02:30,302][123090] Updated weights for policy 1, policy_version 1299655 (0.0010) [2023-12-26 10:02:30,364][123090] Updated weights for policy 1, policy_version 1299665 (0.0010) [2023-12-26 10:02:30,420][123090] Updated weights for policy 1, policy_version 1299675 (0.0010) [2023-12-26 10:02:30,799][123091] Updated weights for policy 0, policy_version 1309042 (0.0010) [2023-12-26 10:02:30,856][123091] Updated weights for policy 0, policy_version 1309052 (0.0010) [2023-12-26 10:02:30,911][123091] Updated weights for policy 0, policy_version 1309062 (0.0010) [2023-12-26 10:02:30,954][123091] Updated weights for policy 0, policy_version 1309072 (0.0010) [2023-12-26 10:02:31,191][123090] Updated weights for policy 1, policy_version 1299685 (0.0009) [2023-12-26 10:02:31,259][123090] Updated weights for policy 1, policy_version 1299695 (0.0006) [2023-12-26 10:02:31,333][123090] Updated weights for policy 1, policy_version 1299705 (0.0007) [2023-12-26 10:02:31,801][123091] Updated weights for policy 0, policy_version 1309082 (0.0006) [2023-12-26 10:02:31,866][123091] Updated weights for policy 0, policy_version 1309092 (0.0005) [2023-12-26 10:02:31,924][123091] Updated weights for policy 0, policy_version 1309102 (0.0006) [2023-12-26 10:02:32,083][123090] Updated weights for policy 1, policy_version 1299715 (0.0009) [2023-12-26 10:02:32,132][123090] Updated weights for policy 1, policy_version 1299725 (0.0009) [2023-12-26 10:02:32,179][123090] Updated weights for policy 1, policy_version 1299735 (0.0008) [2023-12-26 10:02:32,670][123091] Updated weights for policy 0, policy_version 1309112 (0.0009) [2023-12-26 10:02:32,727][123091] Updated weights for policy 0, policy_version 1309122 (0.0005) [2023-12-26 10:02:32,777][123091] Updated weights for policy 0, policy_version 1309132 (0.0005) [2023-12-26 10:02:33,083][123090] Updated weights for policy 1, policy_version 1299745 (0.0009) [2023-12-26 10:02:33,130][123090] Updated weights for policy 1, policy_version 1299755 (0.0008) [2023-12-26 10:02:33,178][123090] Updated weights for policy 1, policy_version 1299765 (0.0009) [2023-12-26 10:02:33,226][123090] Updated weights for policy 1, policy_version 1299775 (0.0008) [2023-12-26 10:02:33,536][123091] Updated weights for policy 0, policy_version 1309142 (0.0005) [2023-12-26 10:02:33,580][123091] Updated weights for policy 0, policy_version 1309152 (0.0005) [2023-12-26 10:02:33,633][123091] Updated weights for policy 0, policy_version 1309162 (0.0005) [2023-12-26 10:02:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 667893760. Throughput: 0: 8975.5, 1: 8955.9. Samples: 667903088. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:33,785][121949] Avg episode reward: [(0, '6302.953'), (1, '5508.264')] [2023-12-26 10:02:33,947][123090] Updated weights for policy 1, policy_version 1299785 (0.0006) [2023-12-26 10:02:34,001][123090] Updated weights for policy 1, policy_version 1299795 (0.0005) [2023-12-26 10:02:34,053][123090] Updated weights for policy 1, policy_version 1299805 (0.0005) [2023-12-26 10:02:34,343][123091] Updated weights for policy 0, policy_version 1309172 (0.0007) [2023-12-26 10:02:34,407][123091] Updated weights for policy 0, policy_version 1309182 (0.0011) [2023-12-26 10:02:34,483][123091] Updated weights for policy 0, policy_version 1309192 (0.0011) [2023-12-26 10:02:34,767][123090] Updated weights for policy 1, policy_version 1299815 (0.0006) [2023-12-26 10:02:34,830][123090] Updated weights for policy 1, policy_version 1299825 (0.0006) [2023-12-26 10:02:34,894][123090] Updated weights for policy 1, policy_version 1299835 (0.0007) [2023-12-26 10:02:35,249][123091] Updated weights for policy 0, policy_version 1309202 (0.0010) [2023-12-26 10:02:35,311][123091] Updated weights for policy 0, policy_version 1309212 (0.0005) [2023-12-26 10:02:35,364][123091] Updated weights for policy 0, policy_version 1309222 (0.0005) [2023-12-26 10:02:35,423][123091] Updated weights for policy 0, policy_version 1309232 (0.0005) [2023-12-26 10:02:35,612][123090] Updated weights for policy 1, policy_version 1299845 (0.0007) [2023-12-26 10:02:35,663][123090] Updated weights for policy 1, policy_version 1299855 (0.0005) [2023-12-26 10:02:35,710][123090] Updated weights for policy 1, policy_version 1299865 (0.0005) [2023-12-26 10:02:36,084][123091] Updated weights for policy 0, policy_version 1309242 (0.0005) [2023-12-26 10:02:36,159][123091] Updated weights for policy 0, policy_version 1309252 (0.0011) [2023-12-26 10:02:36,220][123091] Updated weights for policy 0, policy_version 1309262 (0.0011) [2023-12-26 10:02:36,403][123090] Updated weights for policy 1, policy_version 1299875 (0.0007) [2023-12-26 10:02:36,477][123090] Updated weights for policy 1, policy_version 1299885 (0.0009) [2023-12-26 10:02:36,551][123090] Updated weights for policy 1, policy_version 1299895 (0.0010) [2023-12-26 10:02:37,040][123091] Updated weights for policy 0, policy_version 1309272 (0.0011) [2023-12-26 10:02:37,100][123091] Updated weights for policy 0, policy_version 1309282 (0.0011) [2023-12-26 10:02:37,156][123091] Updated weights for policy 0, policy_version 1309292 (0.0011) [2023-12-26 10:02:37,336][123090] Updated weights for policy 1, policy_version 1299905 (0.0009) [2023-12-26 10:02:37,396][123090] Updated weights for policy 1, policy_version 1299915 (0.0008) [2023-12-26 10:02:37,464][123090] Updated weights for policy 1, policy_version 1299925 (0.0008) [2023-12-26 10:02:37,539][123090] Updated weights for policy 1, policy_version 1299935 (0.0009) [2023-12-26 10:02:37,927][123091] Updated weights for policy 0, policy_version 1309302 (0.0008) [2023-12-26 10:02:37,983][123091] Updated weights for policy 0, policy_version 1309312 (0.0005) [2023-12-26 10:02:38,048][123091] Updated weights for policy 0, policy_version 1309322 (0.0009) [2023-12-26 10:02:38,291][123090] Updated weights for policy 1, policy_version 1299945 (0.0009) [2023-12-26 10:02:38,351][123090] Updated weights for policy 1, policy_version 1299955 (0.0008) [2023-12-26 10:02:38,408][123090] Updated weights for policy 1, policy_version 1299965 (0.0006) [2023-12-26 10:02:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 667983872. Throughput: 0: 9016.0, 1: 9043.4. Samples: 667961068. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:38,785][121949] Avg episode reward: [(0, '6340.185'), (1, '5538.368')] [2023-12-26 10:02:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001299968_332791808.pth... [2023-12-26 10:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001309328_335192064.pth... [2023-12-26 10:02:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001298912_332521472.pth [2023-12-26 10:02:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001308304_334929920.pth [2023-12-26 10:02:38,871][123091] Updated weights for policy 0, policy_version 1309332 (0.0010) [2023-12-26 10:02:38,929][123091] Updated weights for policy 0, policy_version 1309342 (0.0010) [2023-12-26 10:02:38,989][123091] Updated weights for policy 0, policy_version 1309352 (0.0010) [2023-12-26 10:02:39,160][123090] Updated weights for policy 1, policy_version 1299975 (0.0007) [2023-12-26 10:02:39,221][123090] Updated weights for policy 1, policy_version 1299985 (0.0006) [2023-12-26 10:02:39,292][123090] Updated weights for policy 1, policy_version 1299995 (0.0007) [2023-12-26 10:02:39,888][123091] Updated weights for policy 0, policy_version 1309363 (0.0010) [2023-12-26 10:02:39,950][123091] Updated weights for policy 0, policy_version 1309373 (0.0010) [2023-12-26 10:02:40,013][123091] Updated weights for policy 0, policy_version 1309383 (0.0010) [2023-12-26 10:02:40,091][123090] Updated weights for policy 1, policy_version 1300005 (0.0010) [2023-12-26 10:02:40,156][123090] Updated weights for policy 1, policy_version 1300015 (0.0011) [2023-12-26 10:02:40,220][123090] Updated weights for policy 1, policy_version 1300025 (0.0011) [2023-12-26 10:02:40,704][123091] Updated weights for policy 0, policy_version 1309393 (0.0005) [2023-12-26 10:02:40,763][123091] Updated weights for policy 0, policy_version 1309403 (0.0005) [2023-12-26 10:02:40,818][123091] Updated weights for policy 0, policy_version 1309413 (0.0005) [2023-12-26 10:02:40,867][123091] Updated weights for policy 0, policy_version 1309423 (0.0005) [2023-12-26 10:02:40,879][123090] Updated weights for policy 1, policy_version 1300035 (0.0009) [2023-12-26 10:02:40,939][123090] Updated weights for policy 1, policy_version 1300045 (0.0005) [2023-12-26 10:02:40,994][123090] Updated weights for policy 1, policy_version 1300055 (0.0006) [2023-12-26 10:02:41,724][123091] Updated weights for policy 0, policy_version 1309433 (0.0012) [2023-12-26 10:02:41,781][123090] Updated weights for policy 1, policy_version 1300065 (0.0007) [2023-12-26 10:02:41,783][123091] Updated weights for policy 0, policy_version 1309443 (0.0011) [2023-12-26 10:02:41,842][123091] Updated weights for policy 0, policy_version 1309453 (0.0009) [2023-12-26 10:02:41,846][123090] Updated weights for policy 1, policy_version 1300075 (0.0006) [2023-12-26 10:02:41,918][123090] Updated weights for policy 1, policy_version 1300085 (0.0010) [2023-12-26 10:02:41,972][123090] Updated weights for policy 1, policy_version 1300095 (0.0009) [2023-12-26 10:02:42,627][123091] Updated weights for policy 0, policy_version 1309463 (0.0008) [2023-12-26 10:02:42,675][123091] Updated weights for policy 0, policy_version 1309473 (0.0010) [2023-12-26 10:02:42,727][123091] Updated weights for policy 0, policy_version 1309483 (0.0011) [2023-12-26 10:02:42,907][123090] Updated weights for policy 1, policy_version 1300105 (0.0009) [2023-12-26 10:02:42,969][123090] Updated weights for policy 1, policy_version 1300115 (0.0009) [2023-12-26 10:02:43,034][123090] Updated weights for policy 1, policy_version 1300125 (0.0008) [2023-12-26 10:02:43,569][123091] Updated weights for policy 0, policy_version 1309493 (0.0011) [2023-12-26 10:02:43,628][123091] Updated weights for policy 0, policy_version 1309503 (0.0010) [2023-12-26 10:02:43,671][123091] Updated weights for policy 0, policy_version 1309513 (0.0010) [2023-12-26 10:02:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 668073984. Throughput: 0: 8925.7, 1: 8955.7. Samples: 668067772. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:43,785][121949] Avg episode reward: [(0, '6396.195'), (1, '5520.590')] [2023-12-26 10:02:43,867][123090] Updated weights for policy 1, policy_version 1300135 (0.0009) [2023-12-26 10:02:43,941][123090] Updated weights for policy 1, policy_version 1300145 (0.0010) [2023-12-26 10:02:44,015][123090] Updated weights for policy 1, policy_version 1300155 (0.0009) [2023-12-26 10:02:44,337][123091] Updated weights for policy 0, policy_version 1309523 (0.0009) [2023-12-26 10:02:44,407][123091] Updated weights for policy 0, policy_version 1309533 (0.0006) [2023-12-26 10:02:44,482][123091] Updated weights for policy 0, policy_version 1309543 (0.0006) [2023-12-26 10:02:44,883][123090] Updated weights for policy 1, policy_version 1300165 (0.0008) [2023-12-26 10:02:44,945][123090] Updated weights for policy 1, policy_version 1300175 (0.0006) [2023-12-26 10:02:45,004][123090] Updated weights for policy 1, policy_version 1300185 (0.0006) [2023-12-26 10:02:45,204][123091] Updated weights for policy 0, policy_version 1309553 (0.0008) [2023-12-26 10:02:45,263][123091] Updated weights for policy 0, policy_version 1309563 (0.0011) [2023-12-26 10:02:45,315][123091] Updated weights for policy 0, policy_version 1309573 (0.0010) [2023-12-26 10:02:45,379][123091] Updated weights for policy 0, policy_version 1309583 (0.0006) [2023-12-26 10:02:45,707][123090] Updated weights for policy 1, policy_version 1300195 (0.0005) [2023-12-26 10:02:45,769][123090] Updated weights for policy 1, policy_version 1300205 (0.0005) [2023-12-26 10:02:45,822][123090] Updated weights for policy 1, policy_version 1300215 (0.0005) [2023-12-26 10:02:46,036][123091] Updated weights for policy 0, policy_version 1309593 (0.0005) [2023-12-26 10:02:46,084][123091] Updated weights for policy 0, policy_version 1309603 (0.0005) [2023-12-26 10:02:46,132][123091] Updated weights for policy 0, policy_version 1309613 (0.0006) [2023-12-26 10:02:46,492][123090] Updated weights for policy 1, policy_version 1300225 (0.0005) [2023-12-26 10:02:46,548][123090] Updated weights for policy 1, policy_version 1300235 (0.0006) [2023-12-26 10:02:46,611][123090] Updated weights for policy 1, policy_version 1300245 (0.0010) [2023-12-26 10:02:46,669][123090] Updated weights for policy 1, policy_version 1300255 (0.0010) [2023-12-26 10:02:46,797][123091] Updated weights for policy 0, policy_version 1309623 (0.0005) [2023-12-26 10:02:46,864][123091] Updated weights for policy 0, policy_version 1309633 (0.0009) [2023-12-26 10:02:46,927][123091] Updated weights for policy 0, policy_version 1309643 (0.0011) [2023-12-26 10:02:47,394][123090] Updated weights for policy 1, policy_version 1300265 (0.0008) [2023-12-26 10:02:47,457][123090] Updated weights for policy 1, policy_version 1300275 (0.0009) [2023-12-26 10:02:47,516][123090] Updated weights for policy 1, policy_version 1300285 (0.0008) [2023-12-26 10:02:47,715][123091] Updated weights for policy 0, policy_version 1309653 (0.0010) [2023-12-26 10:02:47,768][123091] Updated weights for policy 0, policy_version 1309663 (0.0010) [2023-12-26 10:02:47,824][123091] Updated weights for policy 0, policy_version 1309673 (0.0009) [2023-12-26 10:02:48,337][123090] Updated weights for policy 1, policy_version 1300295 (0.0007) [2023-12-26 10:02:48,411][123090] Updated weights for policy 1, policy_version 1300305 (0.0007) [2023-12-26 10:02:48,479][123090] Updated weights for policy 1, policy_version 1300315 (0.0008) [2023-12-26 10:02:48,675][123091] Updated weights for policy 0, policy_version 1309683 (0.0009) [2023-12-26 10:02:48,729][123091] Updated weights for policy 0, policy_version 1309693 (0.0010) [2023-12-26 10:02:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 668164096. Throughput: 0: 8951.6, 1: 8951.7. Samples: 668177572. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:48,785][121949] Avg episode reward: [(0, '6336.251'), (1, '5449.025')] [2023-12-26 10:02:48,785][123091] Updated weights for policy 0, policy_version 1309703 (0.0010) [2023-12-26 10:02:49,315][123090] Updated weights for policy 1, policy_version 1300325 (0.0010) [2023-12-26 10:02:49,382][123090] Updated weights for policy 1, policy_version 1300335 (0.0007) [2023-12-26 10:02:49,440][123090] Updated weights for policy 1, policy_version 1300345 (0.0007) [2023-12-26 10:02:49,600][123091] Updated weights for policy 0, policy_version 1309713 (0.0010) [2023-12-26 10:02:49,663][123091] Updated weights for policy 0, policy_version 1309723 (0.0010) [2023-12-26 10:02:49,732][123091] Updated weights for policy 0, policy_version 1309733 (0.0009) [2023-12-26 10:02:49,790][123091] Updated weights for policy 0, policy_version 1309744 (0.0009) [2023-12-26 10:02:50,280][123090] Updated weights for policy 1, policy_version 1300355 (0.0009) [2023-12-26 10:02:50,347][123090] Updated weights for policy 1, policy_version 1300365 (0.0008) [2023-12-26 10:02:50,413][123090] Updated weights for policy 1, policy_version 1300375 (0.0007) [2023-12-26 10:02:50,653][123091] Updated weights for policy 0, policy_version 1309754 (0.0010) [2023-12-26 10:02:50,720][123091] Updated weights for policy 0, policy_version 1309764 (0.0010) [2023-12-26 10:02:50,787][123091] Updated weights for policy 0, policy_version 1309774 (0.0009) [2023-12-26 10:02:51,205][123090] Updated weights for policy 1, policy_version 1300385 (0.0009) [2023-12-26 10:02:51,261][123090] Updated weights for policy 1, policy_version 1300395 (0.0010) [2023-12-26 10:02:51,326][123090] Updated weights for policy 1, policy_version 1300405 (0.0010) [2023-12-26 10:02:51,390][123090] Updated weights for policy 1, policy_version 1300415 (0.0008) [2023-12-26 10:02:51,642][123091] Updated weights for policy 0, policy_version 1309784 (0.0010) [2023-12-26 10:02:51,701][123091] Updated weights for policy 0, policy_version 1309794 (0.0010) [2023-12-26 10:02:51,774][123091] Updated weights for policy 0, policy_version 1309804 (0.0009) [2023-12-26 10:02:52,290][123090] Updated weights for policy 1, policy_version 1300425 (0.0010) [2023-12-26 10:02:52,360][123090] Updated weights for policy 1, policy_version 1300435 (0.0009) [2023-12-26 10:02:52,436][123090] Updated weights for policy 1, policy_version 1300445 (0.0009) [2023-12-26 10:02:52,525][123091] Updated weights for policy 0, policy_version 1309814 (0.0009) [2023-12-26 10:02:52,589][123091] Updated weights for policy 0, policy_version 1309824 (0.0010) [2023-12-26 10:02:52,652][123091] Updated weights for policy 0, policy_version 1309834 (0.0010) [2023-12-26 10:02:53,312][123090] Updated weights for policy 1, policy_version 1300455 (0.0008) [2023-12-26 10:02:53,351][123091] Updated weights for policy 0, policy_version 1309844 (0.0008) [2023-12-26 10:02:53,374][123090] Updated weights for policy 1, policy_version 1300465 (0.0010) [2023-12-26 10:02:53,418][123091] Updated weights for policy 0, policy_version 1309854 (0.0006) [2023-12-26 10:02:53,445][123090] Updated weights for policy 1, policy_version 1300475 (0.0010) [2023-12-26 10:02:53,491][123091] Updated weights for policy 0, policy_version 1309864 (0.0008) [2023-12-26 10:02:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 668254208. Throughput: 0: 8885.6, 1: 8896.4. Samples: 668227992. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:53,785][121949] Avg episode reward: [(0, '6375.933'), (1, '5438.536')] [2023-12-26 10:02:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001309872_335331328.pth... [2023-12-26 10:02:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001300480_332922880.pth... [2023-12-26 10:02:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001308816_335060992.pth [2023-12-26 10:02:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001299424_332652544.pth [2023-12-26 10:02:54,239][123090] Updated weights for policy 1, policy_version 1300485 (0.0008) [2023-12-26 10:02:54,262][123091] Updated weights for policy 0, policy_version 1309874 (0.0008) [2023-12-26 10:02:54,298][123090] Updated weights for policy 1, policy_version 1300495 (0.0005) [2023-12-26 10:02:54,322][123091] Updated weights for policy 0, policy_version 1309884 (0.0008) [2023-12-26 10:02:54,345][123090] Updated weights for policy 1, policy_version 1300505 (0.0005) [2023-12-26 10:02:54,381][123091] Updated weights for policy 0, policy_version 1309894 (0.0009) [2023-12-26 10:02:54,444][123091] Updated weights for policy 0, policy_version 1309904 (0.0010) [2023-12-26 10:02:55,117][123091] Updated weights for policy 0, policy_version 1309914 (0.0005) [2023-12-26 10:02:55,138][123090] Updated weights for policy 1, policy_version 1300515 (0.0007) [2023-12-26 10:02:55,186][123090] Updated weights for policy 1, policy_version 1300525 (0.0010) [2023-12-26 10:02:55,192][123091] Updated weights for policy 0, policy_version 1309924 (0.0006) [2023-12-26 10:02:55,234][123090] Updated weights for policy 1, policy_version 1300535 (0.0010) [2023-12-26 10:02:55,255][123091] Updated weights for policy 0, policy_version 1309934 (0.0006) [2023-12-26 10:02:55,959][123091] Updated weights for policy 0, policy_version 1309944 (0.0010) [2023-12-26 10:02:56,014][123091] Updated weights for policy 0, policy_version 1309954 (0.0010) [2023-12-26 10:02:56,064][123091] Updated weights for policy 0, policy_version 1309964 (0.0010) [2023-12-26 10:02:56,088][123090] Updated weights for policy 1, policy_version 1300545 (0.0010) [2023-12-26 10:02:56,136][123090] Updated weights for policy 1, policy_version 1300555 (0.0010) [2023-12-26 10:02:56,198][123090] Updated weights for policy 1, policy_version 1300565 (0.0010) [2023-12-26 10:02:56,259][123090] Updated weights for policy 1, policy_version 1300575 (0.0010) [2023-12-26 10:02:56,757][123091] Updated weights for policy 0, policy_version 1309974 (0.0005) [2023-12-26 10:02:56,820][123091] Updated weights for policy 0, policy_version 1309984 (0.0005) [2023-12-26 10:02:56,878][123091] Updated weights for policy 0, policy_version 1309994 (0.0006) [2023-12-26 10:02:57,074][123090] Updated weights for policy 1, policy_version 1300585 (0.0010) [2023-12-26 10:02:57,140][123090] Updated weights for policy 1, policy_version 1300595 (0.0010) [2023-12-26 10:02:57,205][123090] Updated weights for policy 1, policy_version 1300605 (0.0010) [2023-12-26 10:02:57,584][123091] Updated weights for policy 0, policy_version 1310004 (0.0005) [2023-12-26 10:02:57,643][123091] Updated weights for policy 0, policy_version 1310014 (0.0005) [2023-12-26 10:02:57,691][123091] Updated weights for policy 0, policy_version 1310024 (0.0009) [2023-12-26 10:02:57,995][123090] Updated weights for policy 1, policy_version 1300615 (0.0010) [2023-12-26 10:02:58,053][123090] Updated weights for policy 1, policy_version 1300625 (0.0011) [2023-12-26 10:02:58,109][123090] Updated weights for policy 1, policy_version 1300635 (0.0010) [2023-12-26 10:02:58,517][123091] Updated weights for policy 0, policy_version 1310034 (0.0009) [2023-12-26 10:02:58,577][123091] Updated weights for policy 0, policy_version 1310044 (0.0011) [2023-12-26 10:02:58,652][123091] Updated weights for policy 0, policy_version 1310054 (0.0009) [2023-12-26 10:02:58,725][123091] Updated weights for policy 0, policy_version 1310064 (0.0008) [2023-12-26 10:02:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 668344320. Throughput: 0: 8995.4, 1: 8936.7. Samples: 668336548. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:02:58,785][121949] Avg episode reward: [(0, '6385.901'), (1, '5409.750')] [2023-12-26 10:02:58,977][123090] Updated weights for policy 1, policy_version 1300645 (0.0010) [2023-12-26 10:02:59,042][123090] Updated weights for policy 1, policy_version 1300655 (0.0009) [2023-12-26 10:02:59,118][123090] Updated weights for policy 1, policy_version 1300665 (0.0009) [2023-12-26 10:02:59,558][123091] Updated weights for policy 0, policy_version 1310074 (0.0006) [2023-12-26 10:02:59,617][123091] Updated weights for policy 0, policy_version 1310084 (0.0007) [2023-12-26 10:02:59,682][123091] Updated weights for policy 0, policy_version 1310094 (0.0011) [2023-12-26 10:03:00,012][123090] Updated weights for policy 1, policy_version 1300675 (0.0008) [2023-12-26 10:03:00,087][123090] Updated weights for policy 1, policy_version 1300685 (0.0005) [2023-12-26 10:03:00,148][123090] Updated weights for policy 1, policy_version 1300695 (0.0005) [2023-12-26 10:03:00,421][123091] Updated weights for policy 0, policy_version 1310104 (0.0010) [2023-12-26 10:03:00,479][123091] Updated weights for policy 0, policy_version 1310114 (0.0010) [2023-12-26 10:03:00,542][123091] Updated weights for policy 0, policy_version 1310124 (0.0011) [2023-12-26 10:03:00,869][123090] Updated weights for policy 1, policy_version 1300705 (0.0005) [2023-12-26 10:03:00,926][123090] Updated weights for policy 1, policy_version 1300715 (0.0007) [2023-12-26 10:03:00,995][123090] Updated weights for policy 1, policy_version 1300725 (0.0005) [2023-12-26 10:03:01,067][123090] Updated weights for policy 1, policy_version 1300735 (0.0007) [2023-12-26 10:03:01,384][123091] Updated weights for policy 0, policy_version 1310134 (0.0010) [2023-12-26 10:03:01,441][123091] Updated weights for policy 0, policy_version 1310144 (0.0009) [2023-12-26 10:03:01,497][123091] Updated weights for policy 0, policy_version 1310154 (0.0009) [2023-12-26 10:03:01,901][123090] Updated weights for policy 1, policy_version 1300745 (0.0009) [2023-12-26 10:03:01,963][123090] Updated weights for policy 1, policy_version 1300755 (0.0009) [2023-12-26 10:03:02,025][123090] Updated weights for policy 1, policy_version 1300765 (0.0010) [2023-12-26 10:03:02,280][123091] Updated weights for policy 0, policy_version 1310164 (0.0009) [2023-12-26 10:03:02,348][123091] Updated weights for policy 0, policy_version 1310174 (0.0011) [2023-12-26 10:03:02,413][123091] Updated weights for policy 0, policy_version 1310184 (0.0009) [2023-12-26 10:03:02,876][123090] Updated weights for policy 1, policy_version 1300775 (0.0007) [2023-12-26 10:03:02,945][123090] Updated weights for policy 1, policy_version 1300785 (0.0006) [2023-12-26 10:03:03,009][123090] Updated weights for policy 1, policy_version 1300795 (0.0005) [2023-12-26 10:03:03,211][123091] Updated weights for policy 0, policy_version 1310194 (0.0010) [2023-12-26 10:03:03,267][123091] Updated weights for policy 0, policy_version 1310204 (0.0007) [2023-12-26 10:03:03,330][123091] Updated weights for policy 0, policy_version 1310214 (0.0008) [2023-12-26 10:03:03,396][123091] Updated weights for policy 0, policy_version 1310224 (0.0010) [2023-12-26 10:03:03,693][123090] Updated weights for policy 1, policy_version 1300805 (0.0007) [2023-12-26 10:03:03,740][123090] Updated weights for policy 1, policy_version 1300815 (0.0008) [2023-12-26 10:03:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 668426240. Throughput: 0: 8995.9, 1: 8870.6. Samples: 668441336. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:03:03,785][121949] Avg episode reward: [(0, '6305.947'), (1, '5465.349')] [2023-12-26 10:03:03,792][123090] Updated weights for policy 1, policy_version 1300825 (0.0008) [2023-12-26 10:03:04,204][123091] Updated weights for policy 0, policy_version 1310234 (0.0010) [2023-12-26 10:03:04,272][123091] Updated weights for policy 0, policy_version 1310244 (0.0011) [2023-12-26 10:03:04,339][123091] Updated weights for policy 0, policy_version 1310254 (0.0011) [2023-12-26 10:03:04,651][123090] Updated weights for policy 1, policy_version 1300835 (0.0009) [2023-12-26 10:03:04,717][123090] Updated weights for policy 1, policy_version 1300845 (0.0009) [2023-12-26 10:03:04,780][123090] Updated weights for policy 1, policy_version 1300855 (0.0008) [2023-12-26 10:03:05,152][123091] Updated weights for policy 0, policy_version 1310264 (0.0010) [2023-12-26 10:03:05,216][123091] Updated weights for policy 0, policy_version 1310274 (0.0010) [2023-12-26 10:03:05,292][123091] Updated weights for policy 0, policy_version 1310284 (0.0010) [2023-12-26 10:03:05,543][123090] Updated weights for policy 1, policy_version 1300865 (0.0009) [2023-12-26 10:03:05,615][123090] Updated weights for policy 1, policy_version 1300875 (0.0010) [2023-12-26 10:03:05,664][123090] Updated weights for policy 1, policy_version 1300885 (0.0009) [2023-12-26 10:03:05,712][123090] Updated weights for policy 1, policy_version 1300895 (0.0009) [2023-12-26 10:03:06,114][123091] Updated weights for policy 0, policy_version 1310294 (0.0010) [2023-12-26 10:03:06,179][123091] Updated weights for policy 0, policy_version 1310304 (0.0010) [2023-12-26 10:03:06,237][123091] Updated weights for policy 0, policy_version 1310314 (0.0009) [2023-12-26 10:03:06,525][123090] Updated weights for policy 1, policy_version 1300905 (0.0009) [2023-12-26 10:03:06,577][123090] Updated weights for policy 1, policy_version 1300915 (0.0010) [2023-12-26 10:03:06,638][123090] Updated weights for policy 1, policy_version 1300925 (0.0009) [2023-12-26 10:03:07,087][123091] Updated weights for policy 0, policy_version 1310324 (0.0010) [2023-12-26 10:03:07,145][123091] Updated weights for policy 0, policy_version 1310334 (0.0010) [2023-12-26 10:03:07,199][123091] Updated weights for policy 0, policy_version 1310344 (0.0009) [2023-12-26 10:03:07,438][123090] Updated weights for policy 1, policy_version 1300935 (0.0010) [2023-12-26 10:03:07,505][123090] Updated weights for policy 1, policy_version 1300945 (0.0007) [2023-12-26 10:03:07,573][123090] Updated weights for policy 1, policy_version 1300955 (0.0005) [2023-12-26 10:03:08,076][123091] Updated weights for policy 0, policy_version 1310354 (0.0009) [2023-12-26 10:03:08,128][123091] Updated weights for policy 0, policy_version 1310364 (0.0009) [2023-12-26 10:03:08,178][123091] Updated weights for policy 0, policy_version 1310374 (0.0009) [2023-12-26 10:03:08,212][123090] Updated weights for policy 1, policy_version 1300965 (0.0006) [2023-12-26 10:03:08,224][123091] Updated weights for policy 0, policy_version 1310384 (0.0008) [2023-12-26 10:03:08,282][123090] Updated weights for policy 1, policy_version 1300975 (0.0010) [2023-12-26 10:03:08,356][123090] Updated weights for policy 1, policy_version 1300985 (0.0010) [2023-12-26 10:03:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 668516352. Throughput: 0: 9012.1, 1: 8875.3. Samples: 668492724. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:03:08,785][121949] Avg episode reward: [(0, '6319.055'), (1, '5356.380')] [2023-12-26 10:03:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001310384_335462400.pth... [2023-12-26 10:03:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001300992_333053952.pth... [2023-12-26 10:03:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001309328_335192064.pth [2023-12-26 10:03:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001299968_332791808.pth [2023-12-26 10:03:09,099][123091] Updated weights for policy 0, policy_version 1310394 (0.0009) [2023-12-26 10:03:09,159][123091] Updated weights for policy 0, policy_version 1310404 (0.0010) [2023-12-26 10:03:09,215][123091] Updated weights for policy 0, policy_version 1310414 (0.0010) [2023-12-26 10:03:09,239][123090] Updated weights for policy 1, policy_version 1300995 (0.0010) [2023-12-26 10:03:09,301][123090] Updated weights for policy 1, policy_version 1301005 (0.0010) [2023-12-26 10:03:09,370][123090] Updated weights for policy 1, policy_version 1301015 (0.0008) [2023-12-26 10:03:10,114][123091] Updated weights for policy 0, policy_version 1310424 (0.0010) [2023-12-26 10:03:10,168][123091] Updated weights for policy 0, policy_version 1310434 (0.0010) [2023-12-26 10:03:10,192][123090] Updated weights for policy 1, policy_version 1301025 (0.0010) [2023-12-26 10:03:10,227][123091] Updated weights for policy 0, policy_version 1310444 (0.0009) [2023-12-26 10:03:10,250][123090] Updated weights for policy 1, policy_version 1301035 (0.0006) [2023-12-26 10:03:10,315][123090] Updated weights for policy 1, policy_version 1301045 (0.0009) [2023-12-26 10:03:10,381][123090] Updated weights for policy 1, policy_version 1301055 (0.0009) [2023-12-26 10:03:11,007][123091] Updated weights for policy 0, policy_version 1310454 (0.0007) [2023-12-26 10:03:11,083][123091] Updated weights for policy 0, policy_version 1310464 (0.0008) [2023-12-26 10:03:11,159][123091] Updated weights for policy 0, policy_version 1310474 (0.0008) [2023-12-26 10:03:11,207][123090] Updated weights for policy 1, policy_version 1301065 (0.0009) [2023-12-26 10:03:11,271][123090] Updated weights for policy 1, policy_version 1301075 (0.0008) [2023-12-26 10:03:11,337][123090] Updated weights for policy 1, policy_version 1301085 (0.0009) [2023-12-26 10:03:11,923][123091] Updated weights for policy 0, policy_version 1310484 (0.0009) [2023-12-26 10:03:11,979][123091] Updated weights for policy 0, policy_version 1310494 (0.0009) [2023-12-26 10:03:12,040][123091] Updated weights for policy 0, policy_version 1310504 (0.0009) [2023-12-26 10:03:12,210][123090] Updated weights for policy 1, policy_version 1301095 (0.0010) [2023-12-26 10:03:12,275][123090] Updated weights for policy 1, policy_version 1301105 (0.0010) [2023-12-26 10:03:12,338][123090] Updated weights for policy 1, policy_version 1301115 (0.0010) [2023-12-26 10:03:12,909][123091] Updated weights for policy 0, policy_version 1310514 (0.0007) [2023-12-26 10:03:12,963][123091] Updated weights for policy 0, policy_version 1310524 (0.0009) [2023-12-26 10:03:13,024][123091] Updated weights for policy 0, policy_version 1310534 (0.0009) [2023-12-26 10:03:13,078][123091] Updated weights for policy 0, policy_version 1310544 (0.0009) [2023-12-26 10:03:13,122][123090] Updated weights for policy 1, policy_version 1301125 (0.0010) [2023-12-26 10:03:13,184][123090] Updated weights for policy 1, policy_version 1301135 (0.0009) [2023-12-26 10:03:13,246][123090] Updated weights for policy 1, policy_version 1301145 (0.0010) [2023-12-26 10:03:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 668598272. Throughput: 0: 8960.4, 1: 8810.4. Samples: 668595748. Policy #0 lag: (min: 10.0, avg: 30.3, max: 42.0) [2023-12-26 10:03:13,785][121949] Avg episode reward: [(0, '6344.796'), (1, '5283.888')] [2023-12-26 10:03:13,894][123091] Updated weights for policy 0, policy_version 1310554 (0.0005) [2023-12-26 10:03:13,961][123091] Updated weights for policy 0, policy_version 1310564 (0.0008) [2023-12-26 10:03:14,028][123091] Updated weights for policy 0, policy_version 1310574 (0.0007) [2023-12-26 10:03:14,102][123090] Updated weights for policy 1, policy_version 1301155 (0.0010) [2023-12-26 10:03:14,165][123090] Updated weights for policy 1, policy_version 1301165 (0.0010) [2023-12-26 10:03:14,227][123090] Updated weights for policy 1, policy_version 1301175 (0.0010) [2023-12-26 10:03:14,612][123091] Updated weights for policy 0, policy_version 1310584 (0.0007) [2023-12-26 10:03:14,684][123091] Updated weights for policy 0, policy_version 1310594 (0.0005) [2023-12-26 10:03:14,758][123091] Updated weights for policy 0, policy_version 1310604 (0.0006) [2023-12-26 10:03:15,079][123090] Updated weights for policy 1, policy_version 1301185 (0.0010) [2023-12-26 10:03:15,138][123090] Updated weights for policy 1, policy_version 1301195 (0.0009) [2023-12-26 10:03:15,201][123090] Updated weights for policy 1, policy_version 1301205 (0.0008) [2023-12-26 10:03:15,262][123090] Updated weights for policy 1, policy_version 1301215 (0.0009) [2023-12-26 10:03:15,522][123091] Updated weights for policy 0, policy_version 1310614 (0.0010) [2023-12-26 10:03:15,574][123091] Updated weights for policy 0, policy_version 1310624 (0.0009) [2023-12-26 10:03:15,637][123091] Updated weights for policy 0, policy_version 1310634 (0.0010) [2023-12-26 10:03:16,062][123090] Updated weights for policy 1, policy_version 1301225 (0.0006) [2023-12-26 10:03:16,117][123090] Updated weights for policy 1, policy_version 1301235 (0.0005) [2023-12-26 10:03:16,166][123090] Updated weights for policy 1, policy_version 1301245 (0.0005) [2023-12-26 10:03:16,375][123091] Updated weights for policy 0, policy_version 1310644 (0.0010) [2023-12-26 10:03:16,422][123091] Updated weights for policy 0, policy_version 1310654 (0.0010) [2023-12-26 10:03:16,475][123091] Updated weights for policy 0, policy_version 1310664 (0.0011) [2023-12-26 10:03:16,820][123090] Updated weights for policy 1, policy_version 1301255 (0.0009) [2023-12-26 10:03:16,875][123090] Updated weights for policy 1, policy_version 1301265 (0.0010) [2023-12-26 10:03:16,923][123090] Updated weights for policy 1, policy_version 1301275 (0.0010) [2023-12-26 10:03:17,262][123091] Updated weights for policy 0, policy_version 1310674 (0.0010) [2023-12-26 10:03:17,320][123091] Updated weights for policy 0, policy_version 1310684 (0.0009) [2023-12-26 10:03:17,382][123091] Updated weights for policy 0, policy_version 1310694 (0.0010) [2023-12-26 10:03:17,447][123091] Updated weights for policy 0, policy_version 1310704 (0.0010) [2023-12-26 10:03:17,697][123090] Updated weights for policy 1, policy_version 1301285 (0.0010) [2023-12-26 10:03:17,764][123090] Updated weights for policy 1, policy_version 1301295 (0.0006) [2023-12-26 10:03:17,828][123090] Updated weights for policy 1, policy_version 1301305 (0.0005) [2023-12-26 10:03:18,169][123091] Updated weights for policy 0, policy_version 1310714 (0.0005) [2023-12-26 10:03:18,217][123091] Updated weights for policy 0, policy_version 1310724 (0.0005) [2023-12-26 10:03:18,263][123091] Updated weights for policy 0, policy_version 1310734 (0.0005) [2023-12-26 10:03:18,416][123090] Updated weights for policy 1, policy_version 1301315 (0.0005) [2023-12-26 10:03:18,474][123090] Updated weights for policy 1, policy_version 1301325 (0.0006) [2023-12-26 10:03:18,542][123090] Updated weights for policy 1, policy_version 1301335 (0.0006) [2023-12-26 10:03:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 668696576. Throughput: 0: 8994.5, 1: 8868.9. Samples: 668706940. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:18,785][121949] Avg episode reward: [(0, '6314.426'), (1, '5276.736')] [2023-12-26 10:03:18,969][123091] Updated weights for policy 0, policy_version 1310744 (0.0010) [2023-12-26 10:03:19,036][123091] Updated weights for policy 0, policy_version 1310754 (0.0011) [2023-12-26 10:03:19,107][123091] Updated weights for policy 0, policy_version 1310764 (0.0011) [2023-12-26 10:03:19,258][123090] Updated weights for policy 1, policy_version 1301345 (0.0006) [2023-12-26 10:03:19,325][123090] Updated weights for policy 1, policy_version 1301355 (0.0008) [2023-12-26 10:03:19,396][123090] Updated weights for policy 1, policy_version 1301365 (0.0008) [2023-12-26 10:03:19,459][123090] Updated weights for policy 1, policy_version 1301375 (0.0008) [2023-12-26 10:03:19,858][123091] Updated weights for policy 0, policy_version 1310774 (0.0008) [2023-12-26 10:03:19,929][123091] Updated weights for policy 0, policy_version 1310784 (0.0011) [2023-12-26 10:03:19,999][123091] Updated weights for policy 0, policy_version 1310794 (0.0010) [2023-12-26 10:03:20,319][123090] Updated weights for policy 1, policy_version 1301385 (0.0009) [2023-12-26 10:03:20,384][123090] Updated weights for policy 1, policy_version 1301395 (0.0009) [2023-12-26 10:03:20,450][123090] Updated weights for policy 1, policy_version 1301405 (0.0009) [2023-12-26 10:03:20,807][123091] Updated weights for policy 0, policy_version 1310804 (0.0011) [2023-12-26 10:03:20,871][123091] Updated weights for policy 0, policy_version 1310814 (0.0011) [2023-12-26 10:03:20,932][123091] Updated weights for policy 0, policy_version 1310824 (0.0011) [2023-12-26 10:03:21,398][123090] Updated weights for policy 1, policy_version 1301415 (0.0010) [2023-12-26 10:03:21,461][123090] Updated weights for policy 1, policy_version 1301425 (0.0009) [2023-12-26 10:03:21,527][123090] Updated weights for policy 1, policy_version 1301435 (0.0009) [2023-12-26 10:03:21,783][123091] Updated weights for policy 0, policy_version 1310834 (0.0010) [2023-12-26 10:03:21,846][123091] Updated weights for policy 0, policy_version 1310844 (0.0008) [2023-12-26 10:03:21,915][123091] Updated weights for policy 0, policy_version 1310854 (0.0008) [2023-12-26 10:03:21,982][123091] Updated weights for policy 0, policy_version 1310864 (0.0008) [2023-12-26 10:03:22,455][123090] Updated weights for policy 1, policy_version 1301445 (0.0009) [2023-12-26 10:03:22,507][123090] Updated weights for policy 1, policy_version 1301455 (0.0009) [2023-12-26 10:03:22,565][123090] Updated weights for policy 1, policy_version 1301465 (0.0010) [2023-12-26 10:03:22,774][123091] Updated weights for policy 0, policy_version 1310874 (0.0010) [2023-12-26 10:03:22,846][123091] Updated weights for policy 0, policy_version 1310884 (0.0010) [2023-12-26 10:03:22,903][123091] Updated weights for policy 0, policy_version 1310894 (0.0009) [2023-12-26 10:03:23,410][123090] Updated weights for policy 1, policy_version 1301475 (0.0010) [2023-12-26 10:03:23,482][123090] Updated weights for policy 1, policy_version 1301485 (0.0008) [2023-12-26 10:03:23,556][123090] Updated weights for policy 1, policy_version 1301495 (0.0007) [2023-12-26 10:03:23,741][123091] Updated weights for policy 0, policy_version 1310904 (0.0009) [2023-12-26 10:03:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 668778496. Throughput: 0: 8941.2, 1: 8751.2. Samples: 668757228. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:23,785][121949] Avg episode reward: [(0, '6258.386'), (1, '5273.749')] [2023-12-26 10:03:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001301504_333185024.pth... [2023-12-26 10:03:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001300480_332922880.pth [2023-12-26 10:03:23,804][123091] Updated weights for policy 0, policy_version 1310915 (0.0009) [2023-12-26 10:03:23,864][123091] Updated weights for policy 0, policy_version 1310925 (0.0009) [2023-12-26 10:03:23,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001310928_335601664.pth... [2023-12-26 10:03:23,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001309872_335331328.pth [2023-12-26 10:03:24,265][123090] Updated weights for policy 1, policy_version 1301505 (0.0010) [2023-12-26 10:03:24,315][123090] Updated weights for policy 1, policy_version 1301515 (0.0005) [2023-12-26 10:03:24,363][123090] Updated weights for policy 1, policy_version 1301525 (0.0005) [2023-12-26 10:03:24,416][123090] Updated weights for policy 1, policy_version 1301535 (0.0005) [2023-12-26 10:03:24,770][123091] Updated weights for policy 0, policy_version 1310935 (0.0009) [2023-12-26 10:03:24,817][123091] Updated weights for policy 0, policy_version 1310945 (0.0009) [2023-12-26 10:03:24,866][123091] Updated weights for policy 0, policy_version 1310955 (0.0008) [2023-12-26 10:03:25,134][123090] Updated weights for policy 1, policy_version 1301545 (0.0010) [2023-12-26 10:03:25,202][123090] Updated weights for policy 1, policy_version 1301555 (0.0010) [2023-12-26 10:03:25,255][123090] Updated weights for policy 1, policy_version 1301565 (0.0008) [2023-12-26 10:03:25,734][123091] Updated weights for policy 0, policy_version 1310965 (0.0009) [2023-12-26 10:03:25,793][123091] Updated weights for policy 0, policy_version 1310975 (0.0009) [2023-12-26 10:03:25,840][123091] Updated weights for policy 0, policy_version 1310985 (0.0008) [2023-12-26 10:03:26,077][123090] Updated weights for policy 1, policy_version 1301575 (0.0010) [2023-12-26 10:03:26,134][123090] Updated weights for policy 1, policy_version 1301585 (0.0010) [2023-12-26 10:03:26,200][123090] Updated weights for policy 1, policy_version 1301595 (0.0005) [2023-12-26 10:03:26,530][123091] Updated weights for policy 0, policy_version 1310995 (0.0005) [2023-12-26 10:03:26,588][123091] Updated weights for policy 0, policy_version 1311005 (0.0005) [2023-12-26 10:03:26,642][123091] Updated weights for policy 0, policy_version 1311015 (0.0005) [2023-12-26 10:03:26,996][123090] Updated weights for policy 1, policy_version 1301605 (0.0008) [2023-12-26 10:03:27,052][123090] Updated weights for policy 1, policy_version 1301615 (0.0010) [2023-12-26 10:03:27,111][123090] Updated weights for policy 1, policy_version 1301625 (0.0010) [2023-12-26 10:03:27,286][123091] Updated weights for policy 0, policy_version 1311025 (0.0005) [2023-12-26 10:03:27,344][123091] Updated weights for policy 0, policy_version 1311035 (0.0011) [2023-12-26 10:03:27,407][123091] Updated weights for policy 0, policy_version 1311045 (0.0011) [2023-12-26 10:03:27,469][123091] Updated weights for policy 0, policy_version 1311055 (0.0011) [2023-12-26 10:03:27,945][123090] Updated weights for policy 1, policy_version 1301635 (0.0010) [2023-12-26 10:03:28,025][123090] Updated weights for policy 1, policy_version 1301645 (0.0010) [2023-12-26 10:03:28,083][123090] Updated weights for policy 1, policy_version 1301655 (0.0010) [2023-12-26 10:03:28,149][123091] Updated weights for policy 0, policy_version 1311065 (0.0007) [2023-12-26 10:03:28,199][123091] Updated weights for policy 0, policy_version 1311075 (0.0007) [2023-12-26 10:03:28,268][123091] Updated weights for policy 0, policy_version 1311085 (0.0010) [2023-12-26 10:03:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 668868608. Throughput: 0: 8947.9, 1: 8713.8. Samples: 668862548. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:28,785][121949] Avg episode reward: [(0, '6328.899'), (1, '5386.390')] [2023-12-26 10:03:28,794][123090] Updated weights for policy 1, policy_version 1301665 (0.0010) [2023-12-26 10:03:28,853][123090] Updated weights for policy 1, policy_version 1301675 (0.0010) [2023-12-26 10:03:28,918][123090] Updated weights for policy 1, policy_version 1301685 (0.0010) [2023-12-26 10:03:28,981][123090] Updated weights for policy 1, policy_version 1301695 (0.0010) [2023-12-26 10:03:29,079][123091] Updated weights for policy 0, policy_version 1311095 (0.0007) [2023-12-26 10:03:29,144][123091] Updated weights for policy 0, policy_version 1311105 (0.0007) [2023-12-26 10:03:29,204][123091] Updated weights for policy 0, policy_version 1311115 (0.0011) [2023-12-26 10:03:29,731][123090] Updated weights for policy 1, policy_version 1301705 (0.0006) [2023-12-26 10:03:29,786][123090] Updated weights for policy 1, policy_version 1301715 (0.0005) [2023-12-26 10:03:29,846][123090] Updated weights for policy 1, policy_version 1301725 (0.0006) [2023-12-26 10:03:29,952][123091] Updated weights for policy 0, policy_version 1311125 (0.0010) [2023-12-26 10:03:30,001][123091] Updated weights for policy 0, policy_version 1311135 (0.0009) [2023-12-26 10:03:30,051][123091] Updated weights for policy 0, policy_version 1311145 (0.0009) [2023-12-26 10:03:30,604][123090] Updated weights for policy 1, policy_version 1301735 (0.0006) [2023-12-26 10:03:30,659][123090] Updated weights for policy 1, policy_version 1301745 (0.0005) [2023-12-26 10:03:30,722][123090] Updated weights for policy 1, policy_version 1301755 (0.0005) [2023-12-26 10:03:30,817][123091] Updated weights for policy 0, policy_version 1311156 (0.0008) [2023-12-26 10:03:30,893][123091] Updated weights for policy 0, policy_version 1311166 (0.0006) [2023-12-26 10:03:30,957][123091] Updated weights for policy 0, policy_version 1311176 (0.0008) [2023-12-26 10:03:31,458][123090] Updated weights for policy 1, policy_version 1301765 (0.0006) [2023-12-26 10:03:31,506][123090] Updated weights for policy 1, policy_version 1301775 (0.0005) [2023-12-26 10:03:31,553][123090] Updated weights for policy 1, policy_version 1301785 (0.0005) [2023-12-26 10:03:31,765][123091] Updated weights for policy 0, policy_version 1311186 (0.0007) [2023-12-26 10:03:31,822][123091] Updated weights for policy 0, policy_version 1311196 (0.0006) [2023-12-26 10:03:31,887][123091] Updated weights for policy 0, policy_version 1311206 (0.0005) [2023-12-26 10:03:31,957][123091] Updated weights for policy 0, policy_version 1311216 (0.0005) [2023-12-26 10:03:32,397][123090] Updated weights for policy 1, policy_version 1301795 (0.0007) [2023-12-26 10:03:32,456][123090] Updated weights for policy 1, policy_version 1301805 (0.0010) [2023-12-26 10:03:32,522][123090] Updated weights for policy 1, policy_version 1301815 (0.0009) [2023-12-26 10:03:32,659][123091] Updated weights for policy 0, policy_version 1311226 (0.0008) [2023-12-26 10:03:32,730][123091] Updated weights for policy 0, policy_version 1311236 (0.0010) [2023-12-26 10:03:32,800][123091] Updated weights for policy 0, policy_version 1311246 (0.0010) [2023-12-26 10:03:33,277][123090] Updated weights for policy 1, policy_version 1301825 (0.0009) [2023-12-26 10:03:33,332][123090] Updated weights for policy 1, policy_version 1301835 (0.0005) [2023-12-26 10:03:33,391][123090] Updated weights for policy 1, policy_version 1301845 (0.0005) [2023-12-26 10:03:33,445][123090] Updated weights for policy 1, policy_version 1301855 (0.0005) [2023-12-26 10:03:33,603][123091] Updated weights for policy 0, policy_version 1311256 (0.0007) [2023-12-26 10:03:33,667][123091] Updated weights for policy 0, policy_version 1311266 (0.0005) [2023-12-26 10:03:33,730][123091] Updated weights for policy 0, policy_version 1311276 (0.0005) [2023-12-26 10:03:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 668966912. Throughput: 0: 8924.3, 1: 8751.4. Samples: 668972984. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:33,785][121949] Avg episode reward: [(0, '6363.752'), (1, '5505.121')] [2023-12-26 10:03:34,122][123090] Updated weights for policy 1, policy_version 1301865 (0.0005) [2023-12-26 10:03:34,193][123090] Updated weights for policy 1, policy_version 1301875 (0.0007) [2023-12-26 10:03:34,271][123090] Updated weights for policy 1, policy_version 1301885 (0.0009) [2023-12-26 10:03:34,408][123091] Updated weights for policy 0, policy_version 1311286 (0.0006) [2023-12-26 10:03:34,464][123091] Updated weights for policy 0, policy_version 1311296 (0.0006) [2023-12-26 10:03:34,535][123091] Updated weights for policy 0, policy_version 1311306 (0.0006) [2023-12-26 10:03:35,034][123090] Updated weights for policy 1, policy_version 1301895 (0.0008) [2023-12-26 10:03:35,098][123090] Updated weights for policy 1, policy_version 1301905 (0.0009) [2023-12-26 10:03:35,163][123090] Updated weights for policy 1, policy_version 1301915 (0.0010) [2023-12-26 10:03:35,347][123091] Updated weights for policy 0, policy_version 1311316 (0.0008) [2023-12-26 10:03:35,415][123091] Updated weights for policy 0, policy_version 1311326 (0.0007) [2023-12-26 10:03:35,484][123091] Updated weights for policy 0, policy_version 1311336 (0.0009) [2023-12-26 10:03:36,006][123090] Updated weights for policy 1, policy_version 1301926 (0.0010) [2023-12-26 10:03:36,061][123090] Updated weights for policy 1, policy_version 1301936 (0.0009) [2023-12-26 10:03:36,123][123090] Updated weights for policy 1, policy_version 1301946 (0.0009) [2023-12-26 10:03:36,240][123091] Updated weights for policy 0, policy_version 1311346 (0.0009) [2023-12-26 10:03:36,301][123091] Updated weights for policy 0, policy_version 1311356 (0.0009) [2023-12-26 10:03:36,361][123091] Updated weights for policy 0, policy_version 1311366 (0.0009) [2023-12-26 10:03:36,428][123091] Updated weights for policy 0, policy_version 1311376 (0.0009) [2023-12-26 10:03:36,986][123090] Updated weights for policy 1, policy_version 1301956 (0.0008) [2023-12-26 10:03:37,051][123090] Updated weights for policy 1, policy_version 1301966 (0.0009) [2023-12-26 10:03:37,114][123090] Updated weights for policy 1, policy_version 1301976 (0.0009) [2023-12-26 10:03:37,161][123091] Updated weights for policy 0, policy_version 1311386 (0.0009) [2023-12-26 10:03:37,223][123091] Updated weights for policy 0, policy_version 1311396 (0.0010) [2023-12-26 10:03:37,297][123091] Updated weights for policy 0, policy_version 1311406 (0.0010) [2023-12-26 10:03:37,949][123090] Updated weights for policy 1, policy_version 1301986 (0.0008) [2023-12-26 10:03:38,000][123090] Updated weights for policy 1, policy_version 1301996 (0.0010) [2023-12-26 10:03:38,047][123090] Updated weights for policy 1, policy_version 1302006 (0.0008) [2023-12-26 10:03:38,068][123091] Updated weights for policy 0, policy_version 1311416 (0.0010) [2023-12-26 10:03:38,109][123090] Updated weights for policy 1, policy_version 1302016 (0.0007) [2023-12-26 10:03:38,127][123091] Updated weights for policy 0, policy_version 1311426 (0.0010) [2023-12-26 10:03:38,193][123091] Updated weights for policy 0, policy_version 1311436 (0.0010) [2023-12-26 10:03:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 669048832. Throughput: 0: 8981.8, 1: 8804.3. Samples: 669028372. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:38,785][121949] Avg episode reward: [(0, '6313.609'), (1, '5039.811')] [2023-12-26 10:03:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001302016_333316096.pth... [2023-12-26 10:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001311440_335732736.pth... [2023-12-26 10:03:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001310384_335462400.pth [2023-12-26 10:03:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001300992_333053952.pth [2023-12-26 10:03:38,959][123091] Updated weights for policy 0, policy_version 1311446 (0.0006) [2023-12-26 10:03:38,979][123090] Updated weights for policy 1, policy_version 1302026 (0.0007) [2023-12-26 10:03:39,008][123091] Updated weights for policy 0, policy_version 1311456 (0.0005) [2023-12-26 10:03:39,042][123090] Updated weights for policy 1, policy_version 1302036 (0.0009) [2023-12-26 10:03:39,073][123091] Updated weights for policy 0, policy_version 1311466 (0.0006) [2023-12-26 10:03:39,103][123090] Updated weights for policy 1, policy_version 1302046 (0.0009) [2023-12-26 10:03:39,860][123091] Updated weights for policy 0, policy_version 1311476 (0.0007) [2023-12-26 10:03:39,927][123091] Updated weights for policy 0, policy_version 1311486 (0.0009) [2023-12-26 10:03:39,974][123090] Updated weights for policy 1, policy_version 1302056 (0.0009) [2023-12-26 10:03:39,990][123091] Updated weights for policy 0, policy_version 1311496 (0.0008) [2023-12-26 10:03:40,036][123090] Updated weights for policy 1, policy_version 1302066 (0.0009) [2023-12-26 10:03:40,100][123090] Updated weights for policy 1, policy_version 1302076 (0.0010) [2023-12-26 10:03:40,844][123091] Updated weights for policy 0, policy_version 1311506 (0.0008) [2023-12-26 10:03:40,908][123091] Updated weights for policy 0, policy_version 1311516 (0.0010) [2023-12-26 10:03:40,928][123090] Updated weights for policy 1, policy_version 1302086 (0.0008) [2023-12-26 10:03:40,968][123091] Updated weights for policy 0, policy_version 1311526 (0.0007) [2023-12-26 10:03:40,983][123090] Updated weights for policy 1, policy_version 1302096 (0.0008) [2023-12-26 10:03:41,021][123091] Updated weights for policy 0, policy_version 1311536 (0.0009) [2023-12-26 10:03:41,044][123090] Updated weights for policy 1, policy_version 1302106 (0.0008) [2023-12-26 10:03:41,849][123091] Updated weights for policy 0, policy_version 1311546 (0.0010) [2023-12-26 10:03:41,909][123091] Updated weights for policy 0, policy_version 1311556 (0.0008) [2023-12-26 10:03:41,928][123090] Updated weights for policy 1, policy_version 1302116 (0.0009) [2023-12-26 10:03:41,980][123091] Updated weights for policy 0, policy_version 1311566 (0.0007) [2023-12-26 10:03:41,996][123090] Updated weights for policy 1, policy_version 1302126 (0.0009) [2023-12-26 10:03:42,066][123090] Updated weights for policy 1, policy_version 1302136 (0.0009) [2023-12-26 10:03:42,745][123091] Updated weights for policy 0, policy_version 1311576 (0.0010) [2023-12-26 10:03:42,795][123091] Updated weights for policy 0, policy_version 1311586 (0.0009) [2023-12-26 10:03:42,849][123091] Updated weights for policy 0, policy_version 1311596 (0.0010) [2023-12-26 10:03:42,934][123090] Updated weights for policy 1, policy_version 1302146 (0.0009) [2023-12-26 10:03:42,986][123090] Updated weights for policy 1, policy_version 1302156 (0.0010) [2023-12-26 10:03:43,047][123090] Updated weights for policy 1, policy_version 1302166 (0.0009) [2023-12-26 10:03:43,106][123090] Updated weights for policy 1, policy_version 1302176 (0.0007) [2023-12-26 10:03:43,668][123091] Updated weights for policy 0, policy_version 1311606 (0.0010) [2023-12-26 10:03:43,716][123091] Updated weights for policy 0, policy_version 1311616 (0.0009) [2023-12-26 10:03:43,767][123091] Updated weights for policy 0, policy_version 1311626 (0.0009) [2023-12-26 10:03:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 669130752. Throughput: 0: 8897.3, 1: 8751.7. Samples: 669130752. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:43,785][121949] Avg episode reward: [(0, '6221.578'), (1, '4942.758')] [2023-12-26 10:03:43,875][123090] Updated weights for policy 1, policy_version 1302187 (0.0010) [2023-12-26 10:03:43,923][123090] Updated weights for policy 1, policy_version 1302198 (0.0009) [2023-12-26 10:03:44,555][123091] Updated weights for policy 0, policy_version 1311636 (0.0008) [2023-12-26 10:03:44,611][123091] Updated weights for policy 0, policy_version 1311646 (0.0006) [2023-12-26 10:03:44,663][123091] Updated weights for policy 0, policy_version 1311656 (0.0009) [2023-12-26 10:03:44,764][123090] Updated weights for policy 1, policy_version 1302209 (0.0007) [2023-12-26 10:03:44,831][123090] Updated weights for policy 1, policy_version 1302219 (0.0009) [2023-12-26 10:03:44,892][123090] Updated weights for policy 1, policy_version 1302229 (0.0010) [2023-12-26 10:03:44,955][123090] Updated weights for policy 1, policy_version 1302239 (0.0009) [2023-12-26 10:03:45,505][123091] Updated weights for policy 0, policy_version 1311666 (0.0009) [2023-12-26 10:03:45,571][123091] Updated weights for policy 0, policy_version 1311676 (0.0010) [2023-12-26 10:03:45,633][123091] Updated weights for policy 0, policy_version 1311686 (0.0008) [2023-12-26 10:03:45,694][123091] Updated weights for policy 0, policy_version 1311696 (0.0009) [2023-12-26 10:03:45,815][123090] Updated weights for policy 1, policy_version 1302249 (0.0009) [2023-12-26 10:03:45,887][123090] Updated weights for policy 1, policy_version 1302259 (0.0010) [2023-12-26 10:03:45,952][123090] Updated weights for policy 1, policy_version 1302269 (0.0009) [2023-12-26 10:03:46,522][123091] Updated weights for policy 0, policy_version 1311706 (0.0005) [2023-12-26 10:03:46,574][123091] Updated weights for policy 0, policy_version 1311716 (0.0005) [2023-12-26 10:03:46,624][123091] Updated weights for policy 0, policy_version 1311726 (0.0005) [2023-12-26 10:03:46,705][123090] Updated weights for policy 1, policy_version 1302279 (0.0006) [2023-12-26 10:03:46,757][123090] Updated weights for policy 1, policy_version 1302289 (0.0005) [2023-12-26 10:03:46,810][123090] Updated weights for policy 1, policy_version 1302299 (0.0006) [2023-12-26 10:03:47,486][123091] Updated weights for policy 0, policy_version 1311737 (0.0009) [2023-12-26 10:03:47,510][123090] Updated weights for policy 1, policy_version 1302309 (0.0006) [2023-12-26 10:03:47,543][123091] Updated weights for policy 0, policy_version 1311747 (0.0009) [2023-12-26 10:03:47,573][123090] Updated weights for policy 1, policy_version 1302319 (0.0006) [2023-12-26 10:03:47,603][123091] Updated weights for policy 0, policy_version 1311757 (0.0009) [2023-12-26 10:03:47,636][123090] Updated weights for policy 1, policy_version 1302329 (0.0005) [2023-12-26 10:03:48,284][123090] Updated weights for policy 1, policy_version 1302339 (0.0006) [2023-12-26 10:03:48,366][123090] Updated weights for policy 1, policy_version 1302349 (0.0013) [2023-12-26 10:03:48,424][123090] Updated weights for policy 1, policy_version 1302359 (0.0006) [2023-12-26 10:03:48,463][123091] Updated weights for policy 0, policy_version 1311767 (0.0008) [2023-12-26 10:03:48,526][123091] Updated weights for policy 0, policy_version 1311777 (0.0008) [2023-12-26 10:03:48,589][123091] Updated weights for policy 0, policy_version 1311787 (0.0008) [2023-12-26 10:03:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 669229056. Throughput: 0: 8875.5, 1: 8823.4. Samples: 669237784. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:48,785][121949] Avg episode reward: [(0, '6207.902'), (1, '5334.147')] [2023-12-26 10:03:49,171][123090] Updated weights for policy 1, policy_version 1302369 (0.0005) [2023-12-26 10:03:49,243][123090] Updated weights for policy 1, policy_version 1302379 (0.0008) [2023-12-26 10:03:49,310][123090] Updated weights for policy 1, policy_version 1302389 (0.0009) [2023-12-26 10:03:49,381][123090] Updated weights for policy 1, policy_version 1302399 (0.0010) [2023-12-26 10:03:49,407][123091] Updated weights for policy 0, policy_version 1311797 (0.0007) [2023-12-26 10:03:49,475][123091] Updated weights for policy 0, policy_version 1311807 (0.0008) [2023-12-26 10:03:49,539][123091] Updated weights for policy 0, policy_version 1311817 (0.0009) [2023-12-26 10:03:50,138][123090] Updated weights for policy 1, policy_version 1302409 (0.0009) [2023-12-26 10:03:50,192][123090] Updated weights for policy 1, policy_version 1302419 (0.0009) [2023-12-26 10:03:50,246][123090] Updated weights for policy 1, policy_version 1302429 (0.0008) [2023-12-26 10:03:50,357][123091] Updated weights for policy 0, policy_version 1311827 (0.0008) [2023-12-26 10:03:50,419][123091] Updated weights for policy 0, policy_version 1311837 (0.0007) [2023-12-26 10:03:50,478][123091] Updated weights for policy 0, policy_version 1311847 (0.0009) [2023-12-26 10:03:51,143][123090] Updated weights for policy 1, policy_version 1302439 (0.0010) [2023-12-26 10:03:51,207][123090] Updated weights for policy 1, policy_version 1302449 (0.0010) [2023-12-26 10:03:51,243][123091] Updated weights for policy 0, policy_version 1311857 (0.0009) [2023-12-26 10:03:51,280][123090] Updated weights for policy 1, policy_version 1302459 (0.0008) [2023-12-26 10:03:51,300][123091] Updated weights for policy 0, policy_version 1311867 (0.0009) [2023-12-26 10:03:51,368][123091] Updated weights for policy 0, policy_version 1311877 (0.0010) [2023-12-26 10:03:51,424][123091] Updated weights for policy 0, policy_version 1311887 (0.0009) [2023-12-26 10:03:52,107][123090] Updated weights for policy 1, policy_version 1302469 (0.0008) [2023-12-26 10:03:52,168][123090] Updated weights for policy 1, policy_version 1302479 (0.0008) [2023-12-26 10:03:52,199][123091] Updated weights for policy 0, policy_version 1311897 (0.0006) [2023-12-26 10:03:52,222][123090] Updated weights for policy 1, policy_version 1302489 (0.0009) [2023-12-26 10:03:52,268][123091] Updated weights for policy 0, policy_version 1311907 (0.0008) [2023-12-26 10:03:52,338][123091] Updated weights for policy 0, policy_version 1311917 (0.0009) [2023-12-26 10:03:52,931][123090] Updated weights for policy 1, policy_version 1302499 (0.0009) [2023-12-26 10:03:52,999][123090] Updated weights for policy 1, policy_version 1302509 (0.0009) [2023-12-26 10:03:53,059][123090] Updated weights for policy 1, policy_version 1302519 (0.0009) [2023-12-26 10:03:53,128][123091] Updated weights for policy 0, policy_version 1311927 (0.0007) [2023-12-26 10:03:53,182][123091] Updated weights for policy 0, policy_version 1311937 (0.0010) [2023-12-26 10:03:53,246][123091] Updated weights for policy 0, policy_version 1311947 (0.0009) [2023-12-26 10:03:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 669310976. Throughput: 0: 8900.0, 1: 8805.4. Samples: 669289472. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:53,785][121949] Avg episode reward: [(0, '6256.171'), (1, '5347.418')] [2023-12-26 10:03:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001311952_335863808.pth... [2023-12-26 10:03:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001302528_333447168.pth... [2023-12-26 10:03:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001310928_335601664.pth [2023-12-26 10:03:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001301504_333185024.pth [2023-12-26 10:03:53,833][123090] Updated weights for policy 1, policy_version 1302529 (0.0009) [2023-12-26 10:03:53,904][123090] Updated weights for policy 1, policy_version 1302539 (0.0008) [2023-12-26 10:03:53,966][123090] Updated weights for policy 1, policy_version 1302549 (0.0009) [2023-12-26 10:03:54,015][123090] Updated weights for policy 1, policy_version 1302559 (0.0009) [2023-12-26 10:03:54,140][123091] Updated weights for policy 0, policy_version 1311957 (0.0009) [2023-12-26 10:03:54,204][123091] Updated weights for policy 0, policy_version 1311967 (0.0009) [2023-12-26 10:03:54,267][123091] Updated weights for policy 0, policy_version 1311977 (0.0009) [2023-12-26 10:03:54,818][123090] Updated weights for policy 1, policy_version 1302569 (0.0006) [2023-12-26 10:03:54,876][123090] Updated weights for policy 1, policy_version 1302579 (0.0005) [2023-12-26 10:03:54,937][123090] Updated weights for policy 1, policy_version 1302589 (0.0006) [2023-12-26 10:03:55,032][123091] Updated weights for policy 0, policy_version 1311987 (0.0007) [2023-12-26 10:03:55,082][123091] Updated weights for policy 0, policy_version 1311997 (0.0007) [2023-12-26 10:03:55,135][123091] Updated weights for policy 0, policy_version 1312007 (0.0009) [2023-12-26 10:03:55,694][123090] Updated weights for policy 1, policy_version 1302599 (0.0008) [2023-12-26 10:03:55,753][123090] Updated weights for policy 1, policy_version 1302609 (0.0009) [2023-12-26 10:03:55,806][123090] Updated weights for policy 1, policy_version 1302619 (0.0009) [2023-12-26 10:03:55,961][123091] Updated weights for policy 0, policy_version 1312017 (0.0010) [2023-12-26 10:03:56,024][123091] Updated weights for policy 0, policy_version 1312027 (0.0006) [2023-12-26 10:03:56,088][123091] Updated weights for policy 0, policy_version 1312037 (0.0008) [2023-12-26 10:03:56,152][123091] Updated weights for policy 0, policy_version 1312047 (0.0010) [2023-12-26 10:03:56,672][123090] Updated weights for policy 1, policy_version 1302630 (0.0009) [2023-12-26 10:03:56,727][123090] Updated weights for policy 1, policy_version 1302641 (0.0010) [2023-12-26 10:03:56,788][123090] Updated weights for policy 1, policy_version 1302651 (0.0009) [2023-12-26 10:03:56,835][123091] Updated weights for policy 0, policy_version 1312057 (0.0010) [2023-12-26 10:03:56,886][123091] Updated weights for policy 0, policy_version 1312067 (0.0010) [2023-12-26 10:03:56,935][123091] Updated weights for policy 0, policy_version 1312077 (0.0009) [2023-12-26 10:03:57,532][123090] Updated weights for policy 1, policy_version 1302661 (0.0006) [2023-12-26 10:03:57,601][123090] Updated weights for policy 1, policy_version 1302671 (0.0005) [2023-12-26 10:03:57,637][123091] Updated weights for policy 0, policy_version 1312087 (0.0005) [2023-12-26 10:03:57,669][123090] Updated weights for policy 1, policy_version 1302681 (0.0005) [2023-12-26 10:03:57,694][123091] Updated weights for policy 0, policy_version 1312097 (0.0005) [2023-12-26 10:03:57,763][123091] Updated weights for policy 0, policy_version 1312107 (0.0007) [2023-12-26 10:03:58,237][123090] Updated weights for policy 1, policy_version 1302691 (0.0007) [2023-12-26 10:03:58,302][123090] Updated weights for policy 1, policy_version 1302701 (0.0008) [2023-12-26 10:03:58,389][123090] Updated weights for policy 1, policy_version 1302714 (0.0008) [2023-12-26 10:03:58,571][123091] Updated weights for policy 0, policy_version 1312117 (0.0010) [2023-12-26 10:03:58,644][123091] Updated weights for policy 0, policy_version 1312127 (0.0010) [2023-12-26 10:03:58,722][123091] Updated weights for policy 0, policy_version 1312137 (0.0008) [2023-12-26 10:03:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 669409280. Throughput: 0: 8963.0, 1: 8867.8. Samples: 669398136. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:03:58,785][121949] Avg episode reward: [(0, '6297.314'), (1, '5283.826')] [2023-12-26 10:03:59,200][123090] Updated weights for policy 1, policy_version 1302724 (0.0007) [2023-12-26 10:03:59,271][123090] Updated weights for policy 1, policy_version 1302734 (0.0008) [2023-12-26 10:03:59,334][123090] Updated weights for policy 1, policy_version 1302744 (0.0008) [2023-12-26 10:03:59,543][123091] Updated weights for policy 0, policy_version 1312147 (0.0008) [2023-12-26 10:03:59,608][123091] Updated weights for policy 0, policy_version 1312157 (0.0010) [2023-12-26 10:03:59,677][123091] Updated weights for policy 0, policy_version 1312167 (0.0010) [2023-12-26 10:04:00,032][123090] Updated weights for policy 1, policy_version 1302754 (0.0008) [2023-12-26 10:04:00,086][123090] Updated weights for policy 1, policy_version 1302765 (0.0009) [2023-12-26 10:04:00,145][123090] Updated weights for policy 1, policy_version 1302776 (0.0010) [2023-12-26 10:04:00,532][123091] Updated weights for policy 0, policy_version 1312177 (0.0010) [2023-12-26 10:04:00,606][123091] Updated weights for policy 0, policy_version 1312187 (0.0009) [2023-12-26 10:04:00,668][123091] Updated weights for policy 0, policy_version 1312197 (0.0009) [2023-12-26 10:04:00,727][123091] Updated weights for policy 0, policy_version 1312208 (0.0011) [2023-12-26 10:04:00,864][123090] Updated weights for policy 1, policy_version 1302786 (0.0006) [2023-12-26 10:04:00,924][123090] Updated weights for policy 1, policy_version 1302796 (0.0008) [2023-12-26 10:04:00,985][123090] Updated weights for policy 1, policy_version 1302806 (0.0007) [2023-12-26 10:04:01,047][123090] Updated weights for policy 1, policy_version 1302816 (0.0008) [2023-12-26 10:04:01,575][123091] Updated weights for policy 0, policy_version 1312218 (0.0006) [2023-12-26 10:04:01,645][123091] Updated weights for policy 0, policy_version 1312228 (0.0010) [2023-12-26 10:04:01,706][123091] Updated weights for policy 0, policy_version 1312238 (0.0011) [2023-12-26 10:04:01,851][123090] Updated weights for policy 1, policy_version 1302826 (0.0008) [2023-12-26 10:04:01,898][123090] Updated weights for policy 1, policy_version 1302836 (0.0008) [2023-12-26 10:04:01,950][123090] Updated weights for policy 1, policy_version 1302846 (0.0008) [2023-12-26 10:04:02,498][123091] Updated weights for policy 0, policy_version 1312248 (0.0010) [2023-12-26 10:04:02,558][123091] Updated weights for policy 0, policy_version 1312258 (0.0011) [2023-12-26 10:04:02,628][123091] Updated weights for policy 0, policy_version 1312268 (0.0011) [2023-12-26 10:04:02,791][123090] Updated weights for policy 1, policy_version 1302856 (0.0008) [2023-12-26 10:04:02,851][123090] Updated weights for policy 1, policy_version 1302866 (0.0010) [2023-12-26 10:04:02,910][123090] Updated weights for policy 1, policy_version 1302876 (0.0010) [2023-12-26 10:04:03,341][123091] Updated weights for policy 0, policy_version 1312278 (0.0007) [2023-12-26 10:04:03,386][123091] Updated weights for policy 0, policy_version 1312288 (0.0005) [2023-12-26 10:04:03,433][123091] Updated weights for policy 0, policy_version 1312298 (0.0008) [2023-12-26 10:04:03,627][123090] Updated weights for policy 1, policy_version 1302886 (0.0008) [2023-12-26 10:04:03,685][123090] Updated weights for policy 1, policy_version 1302896 (0.0006) [2023-12-26 10:04:03,736][123090] Updated weights for policy 1, policy_version 1302906 (0.0005) [2023-12-26 10:04:03,790][121949] Fps is (10 sec: 18831.0, 60 sec: 17884.1, 300 sec: 17772.1). Total num frames: 669499392. Throughput: 0: 8871.5, 1: 8873.0. Samples: 669505544. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:03,791][121949] Avg episode reward: [(0, '6311.285'), (1, '5241.446')] [2023-12-26 10:04:04,270][123091] Updated weights for policy 0, policy_version 1312308 (0.0008) [2023-12-26 10:04:04,339][123091] Updated weights for policy 0, policy_version 1312318 (0.0006) [2023-12-26 10:04:04,407][123091] Updated weights for policy 0, policy_version 1312328 (0.0006) [2023-12-26 10:04:04,533][123090] Updated weights for policy 1, policy_version 1302916 (0.0007) [2023-12-26 10:04:04,592][123090] Updated weights for policy 1, policy_version 1302926 (0.0010) [2023-12-26 10:04:04,644][123090] Updated weights for policy 1, policy_version 1302936 (0.0010) [2023-12-26 10:04:05,194][123091] Updated weights for policy 0, policy_version 1312338 (0.0009) [2023-12-26 10:04:05,244][123091] Updated weights for policy 0, policy_version 1312348 (0.0008) [2023-12-26 10:04:05,292][123091] Updated weights for policy 0, policy_version 1312358 (0.0009) [2023-12-26 10:04:05,342][123091] Updated weights for policy 0, policy_version 1312368 (0.0009) [2023-12-26 10:04:05,430][123090] Updated weights for policy 1, policy_version 1302946 (0.0010) [2023-12-26 10:04:05,502][123090] Updated weights for policy 1, policy_version 1302956 (0.0010) [2023-12-26 10:04:05,572][123090] Updated weights for policy 1, policy_version 1302966 (0.0010) [2023-12-26 10:04:05,632][123090] Updated weights for policy 1, policy_version 1302976 (0.0010) [2023-12-26 10:04:06,069][123091] Updated weights for policy 0, policy_version 1312378 (0.0007) [2023-12-26 10:04:06,138][123091] Updated weights for policy 0, policy_version 1312388 (0.0008) [2023-12-26 10:04:06,206][123091] Updated weights for policy 0, policy_version 1312398 (0.0007) [2023-12-26 10:04:06,440][123090] Updated weights for policy 1, policy_version 1302986 (0.0010) [2023-12-26 10:04:06,495][123090] Updated weights for policy 1, policy_version 1302996 (0.0010) [2023-12-26 10:04:06,566][123090] Updated weights for policy 1, policy_version 1303006 (0.0010) [2023-12-26 10:04:06,840][123091] Updated weights for policy 0, policy_version 1312408 (0.0006) [2023-12-26 10:04:06,902][123091] Updated weights for policy 0, policy_version 1312418 (0.0008) [2023-12-26 10:04:06,955][123091] Updated weights for policy 0, policy_version 1312428 (0.0009) [2023-12-26 10:04:07,440][123090] Updated weights for policy 1, policy_version 1303016 (0.0010) [2023-12-26 10:04:07,503][123090] Updated weights for policy 1, policy_version 1303026 (0.0009) [2023-12-26 10:04:07,574][123090] Updated weights for policy 1, policy_version 1303036 (0.0007) [2023-12-26 10:04:07,785][123091] Updated weights for policy 0, policy_version 1312438 (0.0010) [2023-12-26 10:04:07,851][123091] Updated weights for policy 0, policy_version 1312448 (0.0011) [2023-12-26 10:04:07,906][123091] Updated weights for policy 0, policy_version 1312458 (0.0011) [2023-12-26 10:04:08,302][123090] Updated weights for policy 1, policy_version 1303046 (0.0010) [2023-12-26 10:04:08,374][123090] Updated weights for policy 1, policy_version 1303056 (0.0011) [2023-12-26 10:04:08,441][123090] Updated weights for policy 1, policy_version 1303066 (0.0010) [2023-12-26 10:04:08,698][123091] Updated weights for policy 0, policy_version 1312468 (0.0008) [2023-12-26 10:04:08,763][123091] Updated weights for policy 0, policy_version 1312478 (0.0005) [2023-12-26 10:04:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 669581312. Throughput: 0: 8913.1, 1: 8906.4. Samples: 669559104. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:08,785][121949] Avg episode reward: [(0, '6244.020'), (1, '5398.430')] [2023-12-26 10:04:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001303072_333586432.pth... [2023-12-26 10:04:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001302016_333316096.pth [2023-12-26 10:04:08,826][123091] Updated weights for policy 0, policy_version 1312488 (0.0007) [2023-12-26 10:04:08,870][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001312496_336003072.pth... [2023-12-26 10:04:08,875][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001311440_335732736.pth [2023-12-26 10:04:09,268][123090] Updated weights for policy 1, policy_version 1303076 (0.0011) [2023-12-26 10:04:09,341][123090] Updated weights for policy 1, policy_version 1303086 (0.0011) [2023-12-26 10:04:09,419][123090] Updated weights for policy 1, policy_version 1303096 (0.0010) [2023-12-26 10:04:09,640][123091] Updated weights for policy 0, policy_version 1312498 (0.0009) [2023-12-26 10:04:09,710][123091] Updated weights for policy 0, policy_version 1312508 (0.0009) [2023-12-26 10:04:09,766][123091] Updated weights for policy 0, policy_version 1312518 (0.0009) [2023-12-26 10:04:09,816][123091] Updated weights for policy 0, policy_version 1312528 (0.0010) [2023-12-26 10:04:10,268][123090] Updated weights for policy 1, policy_version 1303106 (0.0011) [2023-12-26 10:04:10,336][123090] Updated weights for policy 1, policy_version 1303116 (0.0011) [2023-12-26 10:04:10,407][123090] Updated weights for policy 1, policy_version 1303126 (0.0011) [2023-12-26 10:04:10,471][123090] Updated weights for policy 1, policy_version 1303136 (0.0010) [2023-12-26 10:04:10,583][123091] Updated weights for policy 0, policy_version 1312538 (0.0006) [2023-12-26 10:04:10,647][123091] Updated weights for policy 0, policy_version 1312548 (0.0006) [2023-12-26 10:04:10,710][123091] Updated weights for policy 0, policy_version 1312558 (0.0006) [2023-12-26 10:04:11,297][123090] Updated weights for policy 1, policy_version 1303146 (0.0008) [2023-12-26 10:04:11,385][123090] Updated weights for policy 1, policy_version 1303156 (0.0008) [2023-12-26 10:04:11,452][123090] Updated weights for policy 1, policy_version 1303166 (0.0011) [2023-12-26 10:04:11,525][123091] Updated weights for policy 0, policy_version 1312568 (0.0010) [2023-12-26 10:04:11,598][123091] Updated weights for policy 0, policy_version 1312578 (0.0006) [2023-12-26 10:04:11,683][123091] Updated weights for policy 0, policy_version 1312588 (0.0009) [2023-12-26 10:04:12,322][123090] Updated weights for policy 1, policy_version 1303176 (0.0011) [2023-12-26 10:04:12,391][123090] Updated weights for policy 1, policy_version 1303186 (0.0010) [2023-12-26 10:04:12,441][123090] Updated weights for policy 1, policy_version 1303196 (0.0010) [2023-12-26 10:04:12,462][123091] Updated weights for policy 0, policy_version 1312598 (0.0006) [2023-12-26 10:04:12,532][123091] Updated weights for policy 0, policy_version 1312608 (0.0005) [2023-12-26 10:04:12,600][123091] Updated weights for policy 0, policy_version 1312618 (0.0006) [2023-12-26 10:04:13,216][123091] Updated weights for policy 0, policy_version 1312628 (0.0006) [2023-12-26 10:04:13,265][123091] Updated weights for policy 0, policy_version 1312638 (0.0005) [2023-12-26 10:04:13,268][123090] Updated weights for policy 1, policy_version 1303206 (0.0010) [2023-12-26 10:04:13,319][123090] Updated weights for policy 1, policy_version 1303216 (0.0010) [2023-12-26 10:04:13,322][123091] Updated weights for policy 0, policy_version 1312648 (0.0005) [2023-12-26 10:04:13,371][123090] Updated weights for policy 1, policy_version 1303226 (0.0010) [2023-12-26 10:04:13,784][121949] Fps is (10 sec: 17213.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 669671424. Throughput: 0: 8902.6, 1: 8861.4. Samples: 669661924. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:13,785][121949] Avg episode reward: [(0, '6297.663'), (1, '5588.334')] [2023-12-26 10:04:13,993][123091] Updated weights for policy 0, policy_version 1312658 (0.0005) [2023-12-26 10:04:14,059][123091] Updated weights for policy 0, policy_version 1312668 (0.0005) [2023-12-26 10:04:14,116][123091] Updated weights for policy 0, policy_version 1312678 (0.0006) [2023-12-26 10:04:14,177][123091] Updated weights for policy 0, policy_version 1312688 (0.0005) [2023-12-26 10:04:14,222][123090] Updated weights for policy 1, policy_version 1303236 (0.0011) [2023-12-26 10:04:14,281][123090] Updated weights for policy 1, policy_version 1303246 (0.0010) [2023-12-26 10:04:14,340][123090] Updated weights for policy 1, policy_version 1303256 (0.0010) [2023-12-26 10:04:14,785][123091] Updated weights for policy 0, policy_version 1312698 (0.0007) [2023-12-26 10:04:14,852][123091] Updated weights for policy 0, policy_version 1312708 (0.0006) [2023-12-26 10:04:14,917][123091] Updated weights for policy 0, policy_version 1312718 (0.0006) [2023-12-26 10:04:15,185][123090] Updated weights for policy 1, policy_version 1303266 (0.0010) [2023-12-26 10:04:15,245][123090] Updated weights for policy 1, policy_version 1303276 (0.0011) [2023-12-26 10:04:15,305][123090] Updated weights for policy 1, policy_version 1303286 (0.0011) [2023-12-26 10:04:15,365][123090] Updated weights for policy 1, policy_version 1303296 (0.0010) [2023-12-26 10:04:15,661][123091] Updated weights for policy 0, policy_version 1312728 (0.0005) [2023-12-26 10:04:15,715][123091] Updated weights for policy 0, policy_version 1312738 (0.0005) [2023-12-26 10:04:15,770][123091] Updated weights for policy 0, policy_version 1312748 (0.0005) [2023-12-26 10:04:16,193][123090] Updated weights for policy 1, policy_version 1303306 (0.0005) [2023-12-26 10:04:16,240][123090] Updated weights for policy 1, policy_version 1303316 (0.0005) [2023-12-26 10:04:16,290][123090] Updated weights for policy 1, policy_version 1303326 (0.0005) [2023-12-26 10:04:16,451][123091] Updated weights for policy 0, policy_version 1312758 (0.0008) [2023-12-26 10:04:16,504][123091] Updated weights for policy 0, policy_version 1312768 (0.0010) [2023-12-26 10:04:16,561][123091] Updated weights for policy 0, policy_version 1312779 (0.0009) [2023-12-26 10:04:17,008][123090] Updated weights for policy 1, policy_version 1303336 (0.0006) [2023-12-26 10:04:17,080][123090] Updated weights for policy 1, policy_version 1303346 (0.0006) [2023-12-26 10:04:17,150][123090] Updated weights for policy 1, policy_version 1303356 (0.0007) [2023-12-26 10:04:17,446][123091] Updated weights for policy 0, policy_version 1312790 (0.0010) [2023-12-26 10:04:17,496][123091] Updated weights for policy 0, policy_version 1312800 (0.0009) [2023-12-26 10:04:17,553][123091] Updated weights for policy 0, policy_version 1312810 (0.0010) [2023-12-26 10:04:17,864][123090] Updated weights for policy 1, policy_version 1303366 (0.0008) [2023-12-26 10:04:17,923][123090] Updated weights for policy 1, policy_version 1303376 (0.0009) [2023-12-26 10:04:17,977][123090] Updated weights for policy 1, policy_version 1303386 (0.0008) [2023-12-26 10:04:18,400][123091] Updated weights for policy 0, policy_version 1312820 (0.0009) [2023-12-26 10:04:18,464][123091] Updated weights for policy 0, policy_version 1312830 (0.0010) [2023-12-26 10:04:18,527][123091] Updated weights for policy 0, policy_version 1312840 (0.0009) [2023-12-26 10:04:18,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 669761536. Throughput: 0: 8946.2, 1: 8823.6. Samples: 669772628. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:18,785][121949] Avg episode reward: [(0, '6369.961'), (1, '5552.389')] [2023-12-26 10:04:18,808][123090] Updated weights for policy 1, policy_version 1303396 (0.0010) [2023-12-26 10:04:18,863][123090] Updated weights for policy 1, policy_version 1303406 (0.0009) [2023-12-26 10:04:18,917][123090] Updated weights for policy 1, policy_version 1303416 (0.0009) [2023-12-26 10:04:19,366][123091] Updated weights for policy 0, policy_version 1312850 (0.0009) [2023-12-26 10:04:19,423][123091] Updated weights for policy 0, policy_version 1312860 (0.0008) [2023-12-26 10:04:19,499][123091] Updated weights for policy 0, policy_version 1312870 (0.0007) [2023-12-26 10:04:19,562][123091] Updated weights for policy 0, policy_version 1312880 (0.0008) [2023-12-26 10:04:19,793][123090] Updated weights for policy 1, policy_version 1303426 (0.0008) [2023-12-26 10:04:19,862][123090] Updated weights for policy 1, policy_version 1303436 (0.0009) [2023-12-26 10:04:19,938][123090] Updated weights for policy 1, policy_version 1303446 (0.0011) [2023-12-26 10:04:20,008][123090] Updated weights for policy 1, policy_version 1303456 (0.0011) [2023-12-26 10:04:20,337][123091] Updated weights for policy 0, policy_version 1312890 (0.0009) [2023-12-26 10:04:20,393][123091] Updated weights for policy 0, policy_version 1312900 (0.0008) [2023-12-26 10:04:20,454][123091] Updated weights for policy 0, policy_version 1312910 (0.0009) [2023-12-26 10:04:20,812][123090] Updated weights for policy 1, policy_version 1303466 (0.0011) [2023-12-26 10:04:20,876][123090] Updated weights for policy 1, policy_version 1303476 (0.0011) [2023-12-26 10:04:20,944][123090] Updated weights for policy 1, policy_version 1303486 (0.0011) [2023-12-26 10:04:21,322][123091] Updated weights for policy 0, policy_version 1312920 (0.0009) [2023-12-26 10:04:21,399][123091] Updated weights for policy 0, policy_version 1312930 (0.0009) [2023-12-26 10:04:21,463][123091] Updated weights for policy 0, policy_version 1312940 (0.0009) [2023-12-26 10:04:21,760][123090] Updated weights for policy 1, policy_version 1303496 (0.0008) [2023-12-26 10:04:21,835][123090] Updated weights for policy 1, policy_version 1303506 (0.0006) [2023-12-26 10:04:21,906][123090] Updated weights for policy 1, policy_version 1303516 (0.0005) [2023-12-26 10:04:22,351][123091] Updated weights for policy 0, policy_version 1312950 (0.0010) [2023-12-26 10:04:22,422][123091] Updated weights for policy 0, policy_version 1312960 (0.0010) [2023-12-26 10:04:22,487][123091] Updated weights for policy 0, policy_version 1312970 (0.0009) [2023-12-26 10:04:22,700][123090] Updated weights for policy 1, policy_version 1303526 (0.0008) [2023-12-26 10:04:22,756][123090] Updated weights for policy 1, policy_version 1303536 (0.0010) [2023-12-26 10:04:22,820][123090] Updated weights for policy 1, policy_version 1303546 (0.0010) [2023-12-26 10:04:23,326][123091] Updated weights for policy 0, policy_version 1312980 (0.0009) [2023-12-26 10:04:23,390][123091] Updated weights for policy 0, policy_version 1312990 (0.0009) [2023-12-26 10:04:23,451][123091] Updated weights for policy 0, policy_version 1313000 (0.0009) [2023-12-26 10:04:23,649][123090] Updated weights for policy 1, policy_version 1303556 (0.0008) [2023-12-26 10:04:23,722][123090] Updated weights for policy 1, policy_version 1303566 (0.0006) [2023-12-26 10:04:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 669843456. Throughput: 0: 8877.1, 1: 8776.9. Samples: 669822800. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:23,785][121949] Avg episode reward: [(0, '6346.675'), (1, '5556.225')] [2023-12-26 10:04:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313008_336134144.pth... [2023-12-26 10:04:23,790][123090] Updated weights for policy 1, policy_version 1303576 (0.0006) [2023-12-26 10:04:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001311952_335863808.pth [2023-12-26 10:04:23,847][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001303584_333717504.pth... [2023-12-26 10:04:23,852][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001302528_333447168.pth [2023-12-26 10:04:24,298][123091] Updated weights for policy 0, policy_version 1313010 (0.0010) [2023-12-26 10:04:24,362][123091] Updated weights for policy 0, policy_version 1313020 (0.0010) [2023-12-26 10:04:24,429][123091] Updated weights for policy 0, policy_version 1313030 (0.0009) [2023-12-26 10:04:24,467][123090] Updated weights for policy 1, policy_version 1303586 (0.0005) [2023-12-26 10:04:24,495][123091] Updated weights for policy 0, policy_version 1313040 (0.0010) [2023-12-26 10:04:24,529][123090] Updated weights for policy 1, policy_version 1303596 (0.0008) [2023-12-26 10:04:24,598][123090] Updated weights for policy 1, policy_version 1303606 (0.0010) [2023-12-26 10:04:24,666][123090] Updated weights for policy 1, policy_version 1303616 (0.0009) [2023-12-26 10:04:25,345][123090] Updated weights for policy 1, policy_version 1303626 (0.0010) [2023-12-26 10:04:25,383][123091] Updated weights for policy 0, policy_version 1313050 (0.0008) [2023-12-26 10:04:25,395][123090] Updated weights for policy 1, policy_version 1303637 (0.0009) [2023-12-26 10:04:25,438][123091] Updated weights for policy 0, policy_version 1313060 (0.0008) [2023-12-26 10:04:25,445][123090] Updated weights for policy 1, policy_version 1303647 (0.0008) [2023-12-26 10:04:25,493][123091] Updated weights for policy 0, policy_version 1313070 (0.0009) [2023-12-26 10:04:26,228][123090] Updated weights for policy 1, policy_version 1303657 (0.0009) [2023-12-26 10:04:26,280][123090] Updated weights for policy 1, policy_version 1303667 (0.0009) [2023-12-26 10:04:26,329][123090] Updated weights for policy 1, policy_version 1303677 (0.0009) [2023-12-26 10:04:26,371][123091] Updated weights for policy 0, policy_version 1313080 (0.0009) [2023-12-26 10:04:26,425][123091] Updated weights for policy 0, policy_version 1313090 (0.0009) [2023-12-26 10:04:26,495][123091] Updated weights for policy 0, policy_version 1313100 (0.0010) [2023-12-26 10:04:27,105][123090] Updated weights for policy 1, policy_version 1303687 (0.0008) [2023-12-26 10:04:27,159][123090] Updated weights for policy 1, policy_version 1303697 (0.0010) [2023-12-26 10:04:27,222][123090] Updated weights for policy 1, policy_version 1303708 (0.0009) [2023-12-26 10:04:27,316][123091] Updated weights for policy 0, policy_version 1313110 (0.0009) [2023-12-26 10:04:27,368][123091] Updated weights for policy 0, policy_version 1313120 (0.0009) [2023-12-26 10:04:27,418][123091] Updated weights for policy 0, policy_version 1313130 (0.0009) [2023-12-26 10:04:27,858][123090] Updated weights for policy 1, policy_version 1303718 (0.0006) [2023-12-26 10:04:27,917][123090] Updated weights for policy 1, policy_version 1303728 (0.0005) [2023-12-26 10:04:27,963][123090] Updated weights for policy 1, policy_version 1303738 (0.0005) [2023-12-26 10:04:28,325][123091] Updated weights for policy 0, policy_version 1313141 (0.0009) [2023-12-26 10:04:28,379][123091] Updated weights for policy 0, policy_version 1313151 (0.0009) [2023-12-26 10:04:28,439][123091] Updated weights for policy 0, policy_version 1313161 (0.0010) [2023-12-26 10:04:28,732][123090] Updated weights for policy 1, policy_version 1303748 (0.0007) [2023-12-26 10:04:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 669933568. Throughput: 0: 8795.4, 1: 8903.2. Samples: 669927188. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:28,784][121949] Avg episode reward: [(0, '6362.888'), (1, '5525.962')] [2023-12-26 10:04:28,797][123090] Updated weights for policy 1, policy_version 1303758 (0.0010) [2023-12-26 10:04:28,868][123090] Updated weights for policy 1, policy_version 1303768 (0.0009) [2023-12-26 10:04:29,312][123091] Updated weights for policy 0, policy_version 1313171 (0.0008) [2023-12-26 10:04:29,381][123091] Updated weights for policy 0, policy_version 1313181 (0.0009) [2023-12-26 10:04:29,455][123091] Updated weights for policy 0, policy_version 1313191 (0.0009) [2023-12-26 10:04:29,612][123090] Updated weights for policy 1, policy_version 1303778 (0.0006) [2023-12-26 10:04:29,691][123090] Updated weights for policy 1, policy_version 1303788 (0.0010) [2023-12-26 10:04:29,755][123090] Updated weights for policy 1, policy_version 1303798 (0.0010) [2023-12-26 10:04:29,818][123090] Updated weights for policy 1, policy_version 1303808 (0.0009) [2023-12-26 10:04:30,314][123091] Updated weights for policy 0, policy_version 1313201 (0.0010) [2023-12-26 10:04:30,378][123091] Updated weights for policy 0, policy_version 1313211 (0.0009) [2023-12-26 10:04:30,438][123091] Updated weights for policy 0, policy_version 1313221 (0.0009) [2023-12-26 10:04:30,496][123091] Updated weights for policy 0, policy_version 1313231 (0.0009) [2023-12-26 10:04:30,596][123090] Updated weights for policy 1, policy_version 1303818 (0.0006) [2023-12-26 10:04:30,663][123090] Updated weights for policy 1, policy_version 1303828 (0.0005) [2023-12-26 10:04:30,730][123090] Updated weights for policy 1, policy_version 1303838 (0.0005) [2023-12-26 10:04:31,423][123091] Updated weights for policy 0, policy_version 1313241 (0.0009) [2023-12-26 10:04:31,458][123090] Updated weights for policy 1, policy_version 1303848 (0.0009) [2023-12-26 10:04:31,486][123091] Updated weights for policy 0, policy_version 1313251 (0.0008) [2023-12-26 10:04:31,519][123090] Updated weights for policy 1, policy_version 1303858 (0.0011) [2023-12-26 10:04:31,549][123091] Updated weights for policy 0, policy_version 1313261 (0.0005) [2023-12-26 10:04:31,579][123090] Updated weights for policy 1, policy_version 1303868 (0.0010) [2023-12-26 10:04:32,232][123091] Updated weights for policy 0, policy_version 1313271 (0.0007) [2023-12-26 10:04:32,296][123091] Updated weights for policy 0, policy_version 1313281 (0.0009) [2023-12-26 10:04:32,362][123091] Updated weights for policy 0, policy_version 1313291 (0.0009) [2023-12-26 10:04:32,414][123090] Updated weights for policy 1, policy_version 1303878 (0.0009) [2023-12-26 10:04:32,478][123090] Updated weights for policy 1, policy_version 1303888 (0.0008) [2023-12-26 10:04:32,533][123090] Updated weights for policy 1, policy_version 1303898 (0.0006) [2023-12-26 10:04:33,216][123090] Updated weights for policy 1, policy_version 1303908 (0.0005) [2023-12-26 10:04:33,257][123091] Updated weights for policy 0, policy_version 1313301 (0.0008) [2023-12-26 10:04:33,268][123090] Updated weights for policy 1, policy_version 1303918 (0.0006) [2023-12-26 10:04:33,317][123091] Updated weights for policy 0, policy_version 1313311 (0.0008) [2023-12-26 10:04:33,332][123090] Updated weights for policy 1, policy_version 1303928 (0.0005) [2023-12-26 10:04:33,378][123091] Updated weights for policy 0, policy_version 1313321 (0.0007) [2023-12-26 10:04:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 670023680. Throughput: 0: 8750.1, 1: 8941.6. Samples: 670033912. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:33,785][121949] Avg episode reward: [(0, '6392.169'), (1, '5421.085')] [2023-12-26 10:04:34,044][123090] Updated weights for policy 1, policy_version 1303938 (0.0009) [2023-12-26 10:04:34,107][123090] Updated weights for policy 1, policy_version 1303948 (0.0010) [2023-12-26 10:04:34,162][123090] Updated weights for policy 1, policy_version 1303958 (0.0010) [2023-12-26 10:04:34,219][123090] Updated weights for policy 1, policy_version 1303968 (0.0010) [2023-12-26 10:04:34,222][123091] Updated weights for policy 0, policy_version 1313331 (0.0008) [2023-12-26 10:04:34,286][123091] Updated weights for policy 0, policy_version 1313341 (0.0009) [2023-12-26 10:04:34,346][123091] Updated weights for policy 0, policy_version 1313351 (0.0010) [2023-12-26 10:04:35,005][123090] Updated weights for policy 1, policy_version 1303978 (0.0011) [2023-12-26 10:04:35,068][123090] Updated weights for policy 1, policy_version 1303988 (0.0010) [2023-12-26 10:04:35,135][123090] Updated weights for policy 1, policy_version 1303998 (0.0010) [2023-12-26 10:04:35,214][123091] Updated weights for policy 0, policy_version 1313361 (0.0010) [2023-12-26 10:04:35,270][123091] Updated weights for policy 0, policy_version 1313371 (0.0009) [2023-12-26 10:04:35,318][123091] Updated weights for policy 0, policy_version 1313381 (0.0009) [2023-12-26 10:04:35,369][123091] Updated weights for policy 0, policy_version 1313391 (0.0008) [2023-12-26 10:04:35,954][123090] Updated weights for policy 1, policy_version 1304008 (0.0009) [2023-12-26 10:04:36,010][123090] Updated weights for policy 1, policy_version 1304018 (0.0010) [2023-12-26 10:04:36,068][123090] Updated weights for policy 1, policy_version 1304028 (0.0010) [2023-12-26 10:04:36,232][123091] Updated weights for policy 0, policy_version 1313401 (0.0009) [2023-12-26 10:04:36,288][123091] Updated weights for policy 0, policy_version 1313411 (0.0009) [2023-12-26 10:04:36,345][123091] Updated weights for policy 0, policy_version 1313421 (0.0009) [2023-12-26 10:04:36,941][123090] Updated weights for policy 1, policy_version 1304038 (0.0011) [2023-12-26 10:04:37,000][123090] Updated weights for policy 1, policy_version 1304048 (0.0010) [2023-12-26 10:04:37,060][123090] Updated weights for policy 1, policy_version 1304058 (0.0010) [2023-12-26 10:04:37,196][123091] Updated weights for policy 0, policy_version 1313431 (0.0009) [2023-12-26 10:04:37,248][123091] Updated weights for policy 0, policy_version 1313441 (0.0009) [2023-12-26 10:04:37,297][123091] Updated weights for policy 0, policy_version 1313451 (0.0009) [2023-12-26 10:04:37,873][123090] Updated weights for policy 1, policy_version 1304068 (0.0008) [2023-12-26 10:04:37,921][123090] Updated weights for policy 1, policy_version 1304078 (0.0005) [2023-12-26 10:04:37,974][123090] Updated weights for policy 1, policy_version 1304088 (0.0005) [2023-12-26 10:04:38,202][123091] Updated weights for policy 0, policy_version 1313461 (0.0009) [2023-12-26 10:04:38,263][123091] Updated weights for policy 0, policy_version 1313471 (0.0010) [2023-12-26 10:04:38,320][123091] Updated weights for policy 0, policy_version 1313481 (0.0010) [2023-12-26 10:04:38,579][123090] Updated weights for policy 1, policy_version 1304098 (0.0005) [2023-12-26 10:04:38,649][123090] Updated weights for policy 1, policy_version 1304108 (0.0009) [2023-12-26 10:04:38,718][123090] Updated weights for policy 1, policy_version 1304118 (0.0011) [2023-12-26 10:04:38,782][123090] Updated weights for policy 1, policy_version 1304128 (0.0011) [2023-12-26 10:04:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 670113792. Throughput: 0: 8721.5, 1: 8960.0. Samples: 670085136. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:38,784][121949] Avg episode reward: [(0, '6343.020'), (1, '5257.767')] [2023-12-26 10:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313488_336257024.pth... [2023-12-26 10:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001304128_333856768.pth... [2023-12-26 10:04:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001312496_336003072.pth [2023-12-26 10:04:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001303072_333586432.pth [2023-12-26 10:04:39,221][123091] Updated weights for policy 0, policy_version 1313491 (0.0009) [2023-12-26 10:04:39,273][123091] Updated weights for policy 0, policy_version 1313501 (0.0008) [2023-12-26 10:04:39,336][123091] Updated weights for policy 0, policy_version 1313511 (0.0008) [2023-12-26 10:04:39,593][123090] Updated weights for policy 1, policy_version 1304138 (0.0006) [2023-12-26 10:04:39,661][123090] Updated weights for policy 1, policy_version 1304148 (0.0006) [2023-12-26 10:04:39,728][123090] Updated weights for policy 1, policy_version 1304158 (0.0011) [2023-12-26 10:04:40,213][123091] Updated weights for policy 0, policy_version 1313521 (0.0009) [2023-12-26 10:04:40,270][123091] Updated weights for policy 0, policy_version 1313531 (0.0005) [2023-12-26 10:04:40,324][123091] Updated weights for policy 0, policy_version 1313541 (0.0005) [2023-12-26 10:04:40,376][123091] Updated weights for policy 0, policy_version 1313551 (0.0007) [2023-12-26 10:04:40,546][123090] Updated weights for policy 1, policy_version 1304168 (0.0007) [2023-12-26 10:04:40,615][123090] Updated weights for policy 1, policy_version 1304178 (0.0007) [2023-12-26 10:04:40,689][123090] Updated weights for policy 1, policy_version 1304188 (0.0010) [2023-12-26 10:04:41,222][123091] Updated weights for policy 0, policy_version 1313561 (0.0009) [2023-12-26 10:04:41,284][123091] Updated weights for policy 0, policy_version 1313571 (0.0010) [2023-12-26 10:04:41,337][123091] Updated weights for policy 0, policy_version 1313581 (0.0009) [2023-12-26 10:04:41,480][123090] Updated weights for policy 1, policy_version 1304198 (0.0009) [2023-12-26 10:04:41,541][123090] Updated weights for policy 1, policy_version 1304208 (0.0008) [2023-12-26 10:04:41,601][123090] Updated weights for policy 1, policy_version 1304218 (0.0009) [2023-12-26 10:04:42,257][123091] Updated weights for policy 0, policy_version 1313591 (0.0009) [2023-12-26 10:04:42,326][123091] Updated weights for policy 0, policy_version 1313601 (0.0009) [2023-12-26 10:04:42,393][123091] Updated weights for policy 0, policy_version 1313611 (0.0009) [2023-12-26 10:04:42,471][123090] Updated weights for policy 1, policy_version 1304228 (0.0009) [2023-12-26 10:04:42,529][123090] Updated weights for policy 1, policy_version 1304238 (0.0010) [2023-12-26 10:04:42,588][123090] Updated weights for policy 1, policy_version 1304248 (0.0010) [2023-12-26 10:04:43,239][123091] Updated weights for policy 0, policy_version 1313621 (0.0009) [2023-12-26 10:04:43,286][123091] Updated weights for policy 0, policy_version 1313631 (0.0005) [2023-12-26 10:04:43,333][123091] Updated weights for policy 0, policy_version 1313641 (0.0009) [2023-12-26 10:04:43,469][123090] Updated weights for policy 1, policy_version 1304258 (0.0009) [2023-12-26 10:04:43,527][123090] Updated weights for policy 1, policy_version 1304268 (0.0011) [2023-12-26 10:04:43,589][123090] Updated weights for policy 1, policy_version 1304278 (0.0010) [2023-12-26 10:04:43,643][123090] Updated weights for policy 1, policy_version 1304288 (0.0009) [2023-12-26 10:04:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 670195712. Throughput: 0: 8606.0, 1: 8917.6. Samples: 670186700. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:43,785][121949] Avg episode reward: [(0, '6355.214'), (1, '5345.009')] [2023-12-26 10:04:44,216][123091] Updated weights for policy 0, policy_version 1313651 (0.0010) [2023-12-26 10:04:44,263][123091] Updated weights for policy 0, policy_version 1313661 (0.0008) [2023-12-26 10:04:44,312][123091] Updated weights for policy 0, policy_version 1313671 (0.0009) [2023-12-26 10:04:44,500][123090] Updated weights for policy 1, policy_version 1304298 (0.0010) [2023-12-26 10:04:44,555][123090] Updated weights for policy 1, policy_version 1304308 (0.0010) [2023-12-26 10:04:44,603][123090] Updated weights for policy 1, policy_version 1304318 (0.0010) [2023-12-26 10:04:45,198][123091] Updated weights for policy 0, policy_version 1313681 (0.0009) [2023-12-26 10:04:45,263][123091] Updated weights for policy 0, policy_version 1313691 (0.0009) [2023-12-26 10:04:45,331][123091] Updated weights for policy 0, policy_version 1313701 (0.0009) [2023-12-26 10:04:45,366][123090] Updated weights for policy 1, policy_version 1304328 (0.0009) [2023-12-26 10:04:45,378][123091] Updated weights for policy 0, policy_version 1313711 (0.0008) [2023-12-26 10:04:45,421][123090] Updated weights for policy 1, policy_version 1304338 (0.0007) [2023-12-26 10:04:45,484][123090] Updated weights for policy 1, policy_version 1304348 (0.0008) [2023-12-26 10:04:46,254][123091] Updated weights for policy 0, policy_version 1313721 (0.0009) [2023-12-26 10:04:46,265][123090] Updated weights for policy 1, policy_version 1304358 (0.0007) [2023-12-26 10:04:46,305][123091] Updated weights for policy 0, policy_version 1313731 (0.0008) [2023-12-26 10:04:46,318][123090] Updated weights for policy 1, policy_version 1304368 (0.0006) [2023-12-26 10:04:46,363][123091] Updated weights for policy 0, policy_version 1313741 (0.0010) [2023-12-26 10:04:46,368][123090] Updated weights for policy 1, policy_version 1304378 (0.0005) [2023-12-26 10:04:47,034][123090] Updated weights for policy 1, policy_version 1304388 (0.0008) [2023-12-26 10:04:47,085][123090] Updated weights for policy 1, policy_version 1304398 (0.0009) [2023-12-26 10:04:47,137][123090] Updated weights for policy 1, policy_version 1304409 (0.0009) [2023-12-26 10:04:47,278][123091] Updated weights for policy 0, policy_version 1313751 (0.0009) [2023-12-26 10:04:47,338][123091] Updated weights for policy 0, policy_version 1313761 (0.0009) [2023-12-26 10:04:47,402][123091] Updated weights for policy 0, policy_version 1313771 (0.0009) [2023-12-26 10:04:47,858][123090] Updated weights for policy 1, policy_version 1304419 (0.0008) [2023-12-26 10:04:47,912][123090] Updated weights for policy 1, policy_version 1304429 (0.0005) [2023-12-26 10:04:47,976][123090] Updated weights for policy 1, policy_version 1304439 (0.0005) [2023-12-26 10:04:48,307][123091] Updated weights for policy 0, policy_version 1313781 (0.0009) [2023-12-26 10:04:48,371][123091] Updated weights for policy 0, policy_version 1313791 (0.0009) [2023-12-26 10:04:48,429][123091] Updated weights for policy 0, policy_version 1313801 (0.0010) [2023-12-26 10:04:48,661][123090] Updated weights for policy 1, policy_version 1304449 (0.0005) [2023-12-26 10:04:48,739][123090] Updated weights for policy 1, policy_version 1304459 (0.0007) [2023-12-26 10:04:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 670277632. Throughput: 0: 8544.0, 1: 8916.2. Samples: 670291152. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:48,785][121949] Avg episode reward: [(0, '6227.716'), (1, '5445.870')] [2023-12-26 10:04:48,813][123090] Updated weights for policy 1, policy_version 1304469 (0.0007) [2023-12-26 10:04:48,881][123090] Updated weights for policy 1, policy_version 1304479 (0.0007) [2023-12-26 10:04:49,361][123091] Updated weights for policy 0, policy_version 1313811 (0.0010) [2023-12-26 10:04:49,426][123091] Updated weights for policy 0, policy_version 1313821 (0.0010) [2023-12-26 10:04:49,492][123091] Updated weights for policy 0, policy_version 1313831 (0.0009) [2023-12-26 10:04:49,508][123090] Updated weights for policy 1, policy_version 1304489 (0.0006) [2023-12-26 10:04:49,567][123090] Updated weights for policy 1, policy_version 1304499 (0.0008) [2023-12-26 10:04:49,623][123090] Updated weights for policy 1, policy_version 1304509 (0.0009) [2023-12-26 10:04:50,345][123091] Updated weights for policy 0, policy_version 1313841 (0.0010) [2023-12-26 10:04:50,408][123091] Updated weights for policy 0, policy_version 1313851 (0.0006) [2023-12-26 10:04:50,458][123091] Updated weights for policy 0, policy_version 1313861 (0.0006) [2023-12-26 10:04:50,480][123090] Updated weights for policy 1, policy_version 1304519 (0.0009) [2023-12-26 10:04:50,518][123091] Updated weights for policy 0, policy_version 1313871 (0.0006) [2023-12-26 10:04:50,553][123090] Updated weights for policy 1, policy_version 1304529 (0.0008) [2023-12-26 10:04:50,620][123090] Updated weights for policy 1, policy_version 1304539 (0.0008) [2023-12-26 10:04:51,325][123091] Updated weights for policy 0, policy_version 1313881 (0.0011) [2023-12-26 10:04:51,395][123091] Updated weights for policy 0, policy_version 1313891 (0.0010) [2023-12-26 10:04:51,465][123091] Updated weights for policy 0, policy_version 1313901 (0.0007) [2023-12-26 10:04:51,508][123090] Updated weights for policy 1, policy_version 1304549 (0.0009) [2023-12-26 10:04:51,581][123090] Updated weights for policy 1, policy_version 1304559 (0.0008) [2023-12-26 10:04:51,656][123090] Updated weights for policy 1, policy_version 1304569 (0.0010) [2023-12-26 10:04:52,291][123091] Updated weights for policy 0, policy_version 1313911 (0.0009) [2023-12-26 10:04:52,351][123091] Updated weights for policy 0, policy_version 1313921 (0.0011) [2023-12-26 10:04:52,419][123091] Updated weights for policy 0, policy_version 1313931 (0.0011) [2023-12-26 10:04:52,442][123090] Updated weights for policy 1, policy_version 1304579 (0.0008) [2023-12-26 10:04:52,514][123090] Updated weights for policy 1, policy_version 1304589 (0.0005) [2023-12-26 10:04:52,579][123090] Updated weights for policy 1, policy_version 1304599 (0.0005) [2023-12-26 10:04:53,224][123090] Updated weights for policy 1, policy_version 1304609 (0.0005) [2023-12-26 10:04:53,232][123091] Updated weights for policy 0, policy_version 1313941 (0.0010) [2023-12-26 10:04:53,294][123090] Updated weights for policy 1, policy_version 1304619 (0.0006) [2023-12-26 10:04:53,301][123091] Updated weights for policy 0, policy_version 1313951 (0.0009) [2023-12-26 10:04:53,351][123090] Updated weights for policy 1, policy_version 1304629 (0.0006) [2023-12-26 10:04:53,367][123091] Updated weights for policy 0, policy_version 1313961 (0.0010) [2023-12-26 10:04:53,406][123090] Updated weights for policy 1, policy_version 1304639 (0.0006) [2023-12-26 10:04:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 670367744. Throughput: 0: 8488.0, 1: 8921.0. Samples: 670342512. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:53,785][121949] Avg episode reward: [(0, '6264.438'), (1, '5513.865')] [2023-12-26 10:04:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001304640_333987840.pth... [2023-12-26 10:04:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313968_336379904.pth... [2023-12-26 10:04:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001303584_333717504.pth [2023-12-26 10:04:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313008_336134144.pth [2023-12-26 10:04:54,133][123090] Updated weights for policy 1, policy_version 1304649 (0.0007) [2023-12-26 10:04:54,192][123090] Updated weights for policy 1, policy_version 1304659 (0.0010) [2023-12-26 10:04:54,216][123091] Updated weights for policy 0, policy_version 1313971 (0.0009) [2023-12-26 10:04:54,258][123090] Updated weights for policy 1, policy_version 1304669 (0.0009) [2023-12-26 10:04:54,276][123091] Updated weights for policy 0, policy_version 1313981 (0.0008) [2023-12-26 10:04:54,335][123091] Updated weights for policy 0, policy_version 1313991 (0.0010) [2023-12-26 10:04:55,098][123090] Updated weights for policy 1, policy_version 1304679 (0.0007) [2023-12-26 10:04:55,149][123090] Updated weights for policy 1, policy_version 1304689 (0.0006) [2023-12-26 10:04:55,202][123091] Updated weights for policy 0, policy_version 1314001 (0.0009) [2023-12-26 10:04:55,204][123090] Updated weights for policy 1, policy_version 1304699 (0.0009) [2023-12-26 10:04:55,257][123091] Updated weights for policy 0, policy_version 1314011 (0.0009) [2023-12-26 10:04:55,312][123091] Updated weights for policy 0, policy_version 1314021 (0.0010) [2023-12-26 10:04:55,368][123091] Updated weights for policy 0, policy_version 1314031 (0.0010) [2023-12-26 10:04:55,997][123090] Updated weights for policy 1, policy_version 1304709 (0.0008) [2023-12-26 10:04:56,058][123090] Updated weights for policy 1, policy_version 1304719 (0.0006) [2023-12-26 10:04:56,124][123090] Updated weights for policy 1, policy_version 1304729 (0.0007) [2023-12-26 10:04:56,226][123091] Updated weights for policy 0, policy_version 1314041 (0.0008) [2023-12-26 10:04:56,290][123091] Updated weights for policy 0, policy_version 1314051 (0.0010) [2023-12-26 10:04:56,361][123091] Updated weights for policy 0, policy_version 1314061 (0.0009) [2023-12-26 10:04:56,917][123090] Updated weights for policy 1, policy_version 1304739 (0.0010) [2023-12-26 10:04:56,975][123090] Updated weights for policy 1, policy_version 1304749 (0.0009) [2023-12-26 10:04:57,035][123090] Updated weights for policy 1, policy_version 1304759 (0.0010) [2023-12-26 10:04:57,176][123091] Updated weights for policy 0, policy_version 1314071 (0.0009) [2023-12-26 10:04:57,241][123091] Updated weights for policy 0, policy_version 1314081 (0.0009) [2023-12-26 10:04:57,304][123091] Updated weights for policy 0, policy_version 1314091 (0.0009) [2023-12-26 10:04:57,800][123090] Updated weights for policy 1, policy_version 1304769 (0.0009) [2023-12-26 10:04:57,849][123090] Updated weights for policy 1, policy_version 1304779 (0.0009) [2023-12-26 10:04:57,896][123090] Updated weights for policy 1, policy_version 1304789 (0.0010) [2023-12-26 10:04:57,946][123090] Updated weights for policy 1, policy_version 1304799 (0.0010) [2023-12-26 10:04:58,159][123091] Updated weights for policy 0, policy_version 1314101 (0.0010) [2023-12-26 10:04:58,217][123091] Updated weights for policy 0, policy_version 1314111 (0.0009) [2023-12-26 10:04:58,278][123091] Updated weights for policy 0, policy_version 1314121 (0.0009) [2023-12-26 10:04:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 670449664. Throughput: 0: 8428.3, 1: 9022.9. Samples: 670447232. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:04:58,785][121949] Avg episode reward: [(0, '6334.199'), (1, '5389.471')] [2023-12-26 10:04:58,827][123090] Updated weights for policy 1, policy_version 1304809 (0.0006) [2023-12-26 10:04:58,902][123090] Updated weights for policy 1, policy_version 1304819 (0.0008) [2023-12-26 10:04:58,972][123090] Updated weights for policy 1, policy_version 1304829 (0.0005) [2023-12-26 10:04:59,109][123091] Updated weights for policy 0, policy_version 1314131 (0.0010) [2023-12-26 10:04:59,163][123091] Updated weights for policy 0, policy_version 1314143 (0.0010) [2023-12-26 10:04:59,225][123091] Updated weights for policy 0, policy_version 1314154 (0.0010) [2023-12-26 10:04:59,636][123090] Updated weights for policy 1, policy_version 1304839 (0.0006) [2023-12-26 10:04:59,698][123090] Updated weights for policy 1, policy_version 1304849 (0.0006) [2023-12-26 10:04:59,757][123090] Updated weights for policy 1, policy_version 1304859 (0.0010) [2023-12-26 10:05:00,069][123091] Updated weights for policy 0, policy_version 1314164 (0.0008) [2023-12-26 10:05:00,131][123091] Updated weights for policy 0, policy_version 1314174 (0.0005) [2023-12-26 10:05:00,180][123091] Updated weights for policy 0, policy_version 1314184 (0.0005) [2023-12-26 10:05:00,516][123090] Updated weights for policy 1, policy_version 1304869 (0.0010) [2023-12-26 10:05:00,579][123090] Updated weights for policy 1, policy_version 1304879 (0.0010) [2023-12-26 10:05:00,656][123090] Updated weights for policy 1, policy_version 1304889 (0.0005) [2023-12-26 10:05:01,008][123091] Updated weights for policy 0, policy_version 1314194 (0.0008) [2023-12-26 10:05:01,071][123091] Updated weights for policy 0, policy_version 1314204 (0.0009) [2023-12-26 10:05:01,135][123091] Updated weights for policy 0, policy_version 1314214 (0.0009) [2023-12-26 10:05:01,202][123091] Updated weights for policy 0, policy_version 1314224 (0.0009) [2023-12-26 10:05:01,392][123090] Updated weights for policy 1, policy_version 1304899 (0.0007) [2023-12-26 10:05:01,456][123090] Updated weights for policy 1, policy_version 1304909 (0.0010) [2023-12-26 10:05:01,514][123090] Updated weights for policy 1, policy_version 1304919 (0.0010) [2023-12-26 10:05:01,985][123091] Updated weights for policy 0, policy_version 1314234 (0.0005) [2023-12-26 10:05:02,034][123091] Updated weights for policy 0, policy_version 1314244 (0.0005) [2023-12-26 10:05:02,087][123091] Updated weights for policy 0, policy_version 1314254 (0.0008) [2023-12-26 10:05:02,322][123090] Updated weights for policy 1, policy_version 1304929 (0.0010) [2023-12-26 10:05:02,391][123090] Updated weights for policy 1, policy_version 1304939 (0.0010) [2023-12-26 10:05:02,462][123090] Updated weights for policy 1, policy_version 1304949 (0.0010) [2023-12-26 10:05:02,534][123090] Updated weights for policy 1, policy_version 1304959 (0.0010) [2023-12-26 10:05:02,940][123091] Updated weights for policy 0, policy_version 1314264 (0.0009) [2023-12-26 10:05:02,996][123091] Updated weights for policy 0, policy_version 1314274 (0.0010) [2023-12-26 10:05:03,050][123091] Updated weights for policy 0, policy_version 1314285 (0.0010) [2023-12-26 10:05:03,232][123090] Updated weights for policy 1, policy_version 1304969 (0.0006) [2023-12-26 10:05:03,298][123090] Updated weights for policy 1, policy_version 1304979 (0.0005) [2023-12-26 10:05:03,357][123090] Updated weights for policy 1, policy_version 1304989 (0.0005) [2023-12-26 10:05:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17341.4, 300 sec: 17716.9). Total num frames: 670539776. Throughput: 0: 8318.0, 1: 9058.3. Samples: 670554560. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:05:03,785][121949] Avg episode reward: [(0, '6376.656'), (1, '5268.483')] [2023-12-26 10:05:03,809][123091] Updated weights for policy 0, policy_version 1314295 (0.0007) [2023-12-26 10:05:03,869][123091] Updated weights for policy 0, policy_version 1314305 (0.0007) [2023-12-26 10:05:03,921][123091] Updated weights for policy 0, policy_version 1314315 (0.0010) [2023-12-26 10:05:04,030][123090] Updated weights for policy 1, policy_version 1304999 (0.0005) [2023-12-26 10:05:04,103][123090] Updated weights for policy 1, policy_version 1305009 (0.0005) [2023-12-26 10:05:04,176][123090] Updated weights for policy 1, policy_version 1305019 (0.0008) [2023-12-26 10:05:04,771][123091] Updated weights for policy 0, policy_version 1314325 (0.0010) [2023-12-26 10:05:04,835][123091] Updated weights for policy 0, policy_version 1314335 (0.0009) [2023-12-26 10:05:04,895][123091] Updated weights for policy 0, policy_version 1314345 (0.0009) [2023-12-26 10:05:04,911][123090] Updated weights for policy 1, policy_version 1305029 (0.0007) [2023-12-26 10:05:04,965][123090] Updated weights for policy 1, policy_version 1305039 (0.0008) [2023-12-26 10:05:05,034][123090] Updated weights for policy 1, policy_version 1305049 (0.0009) [2023-12-26 10:05:05,587][123091] Updated weights for policy 0, policy_version 1314355 (0.0006) [2023-12-26 10:05:05,663][123091] Updated weights for policy 0, policy_version 1314365 (0.0006) [2023-12-26 10:05:05,676][123090] Updated weights for policy 1, policy_version 1305059 (0.0007) [2023-12-26 10:05:05,728][123091] Updated weights for policy 0, policy_version 1314375 (0.0006) [2023-12-26 10:05:05,739][123090] Updated weights for policy 1, policy_version 1305069 (0.0005) [2023-12-26 10:05:05,794][123090] Updated weights for policy 1, policy_version 1305079 (0.0008) [2023-12-26 10:05:06,478][123091] Updated weights for policy 0, policy_version 1314385 (0.0011) [2023-12-26 10:05:06,516][123090] Updated weights for policy 1, policy_version 1305089 (0.0010) [2023-12-26 10:05:06,530][123091] Updated weights for policy 0, policy_version 1314395 (0.0011) [2023-12-26 10:05:06,584][123090] Updated weights for policy 1, policy_version 1305099 (0.0011) [2023-12-26 10:05:06,586][123091] Updated weights for policy 0, policy_version 1314405 (0.0010) [2023-12-26 10:05:06,649][123090] Updated weights for policy 1, policy_version 1305109 (0.0010) [2023-12-26 10:05:06,671][123091] Updated weights for policy 0, policy_version 1314415 (0.0010) [2023-12-26 10:05:06,705][123090] Updated weights for policy 1, policy_version 1305119 (0.0010) [2023-12-26 10:05:07,347][123091] Updated weights for policy 0, policy_version 1314425 (0.0005) [2023-12-26 10:05:07,419][123091] Updated weights for policy 0, policy_version 1314435 (0.0005) [2023-12-26 10:05:07,450][123090] Updated weights for policy 1, policy_version 1305129 (0.0006) [2023-12-26 10:05:07,481][123091] Updated weights for policy 0, policy_version 1314445 (0.0006) [2023-12-26 10:05:07,513][123090] Updated weights for policy 1, policy_version 1305139 (0.0005) [2023-12-26 10:05:07,573][123090] Updated weights for policy 1, policy_version 1305149 (0.0009) [2023-12-26 10:05:08,121][123091] Updated weights for policy 0, policy_version 1314455 (0.0009) [2023-12-26 10:05:08,177][123091] Updated weights for policy 0, policy_version 1314465 (0.0010) [2023-12-26 10:05:08,228][123091] Updated weights for policy 0, policy_version 1314475 (0.0010) [2023-12-26 10:05:08,245][123090] Updated weights for policy 1, policy_version 1305159 (0.0006) [2023-12-26 10:05:08,298][123090] Updated weights for policy 1, policy_version 1305169 (0.0008) [2023-12-26 10:05:08,365][123090] Updated weights for policy 1, policy_version 1305179 (0.0007) [2023-12-26 10:05:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 670638080. Throughput: 0: 8371.3, 1: 9149.2. Samples: 670611220. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:05:08,785][121949] Avg episode reward: [(0, '6384.704'), (1, '5362.802')] [2023-12-26 10:05:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001305184_334127104.pth... [2023-12-26 10:05:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001314480_336510976.pth... [2023-12-26 10:05:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001304128_333856768.pth [2023-12-26 10:05:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313488_336257024.pth [2023-12-26 10:05:09,049][123091] Updated weights for policy 0, policy_version 1314485 (0.0010) [2023-12-26 10:05:09,080][123090] Updated weights for policy 1, policy_version 1305189 (0.0007) [2023-12-26 10:05:09,105][123091] Updated weights for policy 0, policy_version 1314495 (0.0008) [2023-12-26 10:05:09,129][123090] Updated weights for policy 1, policy_version 1305199 (0.0008) [2023-12-26 10:05:09,162][123091] Updated weights for policy 0, policy_version 1314505 (0.0007) [2023-12-26 10:05:09,186][123090] Updated weights for policy 1, policy_version 1305209 (0.0008) [2023-12-26 10:05:09,998][123091] Updated weights for policy 0, policy_version 1314515 (0.0010) [2023-12-26 10:05:10,063][123091] Updated weights for policy 0, policy_version 1314525 (0.0010) [2023-12-26 10:05:10,126][123090] Updated weights for policy 1, policy_version 1305219 (0.0008) [2023-12-26 10:05:10,128][123091] Updated weights for policy 0, policy_version 1314535 (0.0010) [2023-12-26 10:05:10,189][123090] Updated weights for policy 1, policy_version 1305229 (0.0010) [2023-12-26 10:05:10,252][123090] Updated weights for policy 1, policy_version 1305239 (0.0008) [2023-12-26 10:05:10,998][123091] Updated weights for policy 0, policy_version 1314545 (0.0007) [2023-12-26 10:05:11,012][123090] Updated weights for policy 1, policy_version 1305249 (0.0006) [2023-12-26 10:05:11,065][123091] Updated weights for policy 0, policy_version 1314555 (0.0008) [2023-12-26 10:05:11,083][123090] Updated weights for policy 1, policy_version 1305259 (0.0010) [2023-12-26 10:05:11,126][123091] Updated weights for policy 0, policy_version 1314565 (0.0009) [2023-12-26 10:05:11,142][123090] Updated weights for policy 1, policy_version 1305269 (0.0007) [2023-12-26 10:05:11,197][123091] Updated weights for policy 0, policy_version 1314575 (0.0009) [2023-12-26 10:05:11,211][123090] Updated weights for policy 1, policy_version 1305279 (0.0010) [2023-12-26 10:05:12,068][123091] Updated weights for policy 0, policy_version 1314585 (0.0010) [2023-12-26 10:05:12,071][123090] Updated weights for policy 1, policy_version 1305289 (0.0007) [2023-12-26 10:05:12,130][123091] Updated weights for policy 0, policy_version 1314595 (0.0009) [2023-12-26 10:05:12,136][123090] Updated weights for policy 1, policy_version 1305299 (0.0008) [2023-12-26 10:05:12,188][123091] Updated weights for policy 0, policy_version 1314605 (0.0009) [2023-12-26 10:05:12,194][123090] Updated weights for policy 1, policy_version 1305309 (0.0008) [2023-12-26 10:05:13,008][123090] Updated weights for policy 1, policy_version 1305319 (0.0008) [2023-12-26 10:05:13,042][123091] Updated weights for policy 0, policy_version 1314615 (0.0008) [2023-12-26 10:05:13,068][123090] Updated weights for policy 1, policy_version 1305329 (0.0008) [2023-12-26 10:05:13,092][123091] Updated weights for policy 0, policy_version 1314625 (0.0009) [2023-12-26 10:05:13,127][123090] Updated weights for policy 1, policy_version 1305339 (0.0006) [2023-12-26 10:05:13,141][123091] Updated weights for policy 0, policy_version 1314635 (0.0009) [2023-12-26 10:05:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 670720000. Throughput: 0: 8439.0, 1: 9106.4. Samples: 670716732. Policy #0 lag: (min: 31.0, avg: 39.0, max: 63.0) [2023-12-26 10:05:13,785][121949] Avg episode reward: [(0, '6371.631'), (1, '5570.122')] [2023-12-26 10:05:13,905][123091] Updated weights for policy 0, policy_version 1314645 (0.0008) [2023-12-26 10:05:13,954][123090] Updated weights for policy 1, policy_version 1305349 (0.0007) [2023-12-26 10:05:13,965][123091] Updated weights for policy 0, policy_version 1314655 (0.0008) [2023-12-26 10:05:14,017][123090] Updated weights for policy 1, policy_version 1305359 (0.0008) [2023-12-26 10:05:14,017][123091] Updated weights for policy 0, policy_version 1314665 (0.0007) [2023-12-26 10:05:14,074][123090] Updated weights for policy 1, policy_version 1305369 (0.0009) [2023-12-26 10:05:14,844][123091] Updated weights for policy 0, policy_version 1314675 (0.0007) [2023-12-26 10:05:14,903][123091] Updated weights for policy 0, policy_version 1314685 (0.0009) [2023-12-26 10:05:14,920][123090] Updated weights for policy 1, policy_version 1305379 (0.0008) [2023-12-26 10:05:14,962][123091] Updated weights for policy 0, policy_version 1314695 (0.0008) [2023-12-26 10:05:14,987][123090] Updated weights for policy 1, policy_version 1305389 (0.0009) [2023-12-26 10:05:15,055][123090] Updated weights for policy 1, policy_version 1305399 (0.0009) [2023-12-26 10:05:15,815][123091] Updated weights for policy 0, policy_version 1314705 (0.0007) [2023-12-26 10:05:15,836][123090] Updated weights for policy 1, policy_version 1305409 (0.0010) [2023-12-26 10:05:15,879][123091] Updated weights for policy 0, policy_version 1314715 (0.0006) [2023-12-26 10:05:15,909][123090] Updated weights for policy 1, policy_version 1305419 (0.0006) [2023-12-26 10:05:15,942][123091] Updated weights for policy 0, policy_version 1314725 (0.0009) [2023-12-26 10:05:15,966][123090] Updated weights for policy 1, policy_version 1305429 (0.0006) [2023-12-26 10:05:16,001][123091] Updated weights for policy 0, policy_version 1314735 (0.0010) [2023-12-26 10:05:16,018][123090] Updated weights for policy 1, policy_version 1305439 (0.0009) [2023-12-26 10:05:16,724][123090] Updated weights for policy 1, policy_version 1305449 (0.0009) [2023-12-26 10:05:16,785][123090] Updated weights for policy 1, policy_version 1305459 (0.0009) [2023-12-26 10:05:16,793][123091] Updated weights for policy 0, policy_version 1314745 (0.0006) [2023-12-26 10:05:16,839][123090] Updated weights for policy 1, policy_version 1305469 (0.0009) [2023-12-26 10:05:16,851][123091] Updated weights for policy 0, policy_version 1314755 (0.0005) [2023-12-26 10:05:16,900][123091] Updated weights for policy 0, policy_version 1314765 (0.0005) [2023-12-26 10:05:17,552][123091] Updated weights for policy 0, policy_version 1314775 (0.0005) [2023-12-26 10:05:17,598][123090] Updated weights for policy 1, policy_version 1305479 (0.0006) [2023-12-26 10:05:17,628][123091] Updated weights for policy 0, policy_version 1314785 (0.0005) [2023-12-26 10:05:17,651][123090] Updated weights for policy 1, policy_version 1305489 (0.0005) [2023-12-26 10:05:17,692][123091] Updated weights for policy 0, policy_version 1314795 (0.0005) [2023-12-26 10:05:17,729][123090] Updated weights for policy 1, policy_version 1305499 (0.0006) [2023-12-26 10:05:18,368][123091] Updated weights for policy 0, policy_version 1314805 (0.0007) [2023-12-26 10:05:18,380][123090] Updated weights for policy 1, policy_version 1305509 (0.0007) [2023-12-26 10:05:18,423][123091] Updated weights for policy 0, policy_version 1314815 (0.0005) [2023-12-26 10:05:18,446][123090] Updated weights for policy 1, policy_version 1305519 (0.0008) [2023-12-26 10:05:18,480][123091] Updated weights for policy 0, policy_version 1314825 (0.0007) [2023-12-26 10:05:18,510][123090] Updated weights for policy 1, policy_version 1305529 (0.0008) [2023-12-26 10:05:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 670818304. Throughput: 0: 8567.8, 1: 9046.0. Samples: 670826536. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:18,785][121949] Avg episode reward: [(0, '6364.776'), (1, '5601.346')] [2023-12-26 10:05:19,228][123091] Updated weights for policy 0, policy_version 1314835 (0.0010) [2023-12-26 10:05:19,232][123090] Updated weights for policy 1, policy_version 1305539 (0.0007) [2023-12-26 10:05:19,299][123091] Updated weights for policy 0, policy_version 1314845 (0.0010) [2023-12-26 10:05:19,302][123090] Updated weights for policy 1, policy_version 1305549 (0.0007) [2023-12-26 10:05:19,362][123091] Updated weights for policy 0, policy_version 1314855 (0.0008) [2023-12-26 10:05:19,373][123090] Updated weights for policy 1, policy_version 1305559 (0.0008) [2023-12-26 10:05:20,174][123090] Updated weights for policy 1, policy_version 1305569 (0.0009) [2023-12-26 10:05:20,236][123090] Updated weights for policy 1, policy_version 1305579 (0.0011) [2023-12-26 10:05:20,247][123091] Updated weights for policy 0, policy_version 1314865 (0.0006) [2023-12-26 10:05:20,300][123090] Updated weights for policy 1, policy_version 1305589 (0.0010) [2023-12-26 10:05:20,300][123091] Updated weights for policy 0, policy_version 1314875 (0.0008) [2023-12-26 10:05:20,359][123091] Updated weights for policy 0, policy_version 1314885 (0.0008) [2023-12-26 10:05:20,364][123090] Updated weights for policy 1, policy_version 1305599 (0.0011) [2023-12-26 10:05:20,413][123091] Updated weights for policy 0, policy_version 1314895 (0.0008) [2023-12-26 10:05:21,214][123090] Updated weights for policy 1, policy_version 1305609 (0.0011) [2023-12-26 10:05:21,288][123091] Updated weights for policy 0, policy_version 1314905 (0.0007) [2023-12-26 10:05:21,288][123090] Updated weights for policy 1, policy_version 1305619 (0.0009) [2023-12-26 10:05:21,352][123091] Updated weights for policy 0, policy_version 1314915 (0.0007) [2023-12-26 10:05:21,363][123090] Updated weights for policy 1, policy_version 1305629 (0.0010) [2023-12-26 10:05:21,427][123091] Updated weights for policy 0, policy_version 1314925 (0.0010) [2023-12-26 10:05:22,206][123090] Updated weights for policy 1, policy_version 1305639 (0.0009) [2023-12-26 10:05:22,272][123090] Updated weights for policy 1, policy_version 1305649 (0.0009) [2023-12-26 10:05:22,286][123091] Updated weights for policy 0, policy_version 1314935 (0.0009) [2023-12-26 10:05:22,337][123090] Updated weights for policy 1, policy_version 1305659 (0.0007) [2023-12-26 10:05:22,348][123091] Updated weights for policy 0, policy_version 1314945 (0.0009) [2023-12-26 10:05:22,413][123091] Updated weights for policy 0, policy_version 1314955 (0.0010) [2023-12-26 10:05:23,188][123090] Updated weights for policy 1, policy_version 1305669 (0.0009) [2023-12-26 10:05:23,248][123090] Updated weights for policy 1, policy_version 1305679 (0.0011) [2023-12-26 10:05:23,251][123091] Updated weights for policy 0, policy_version 1314965 (0.0008) [2023-12-26 10:05:23,308][123090] Updated weights for policy 1, policy_version 1305689 (0.0011) [2023-12-26 10:05:23,319][123091] Updated weights for policy 0, policy_version 1314975 (0.0007) [2023-12-26 10:05:23,393][123091] Updated weights for policy 0, policy_version 1314985 (0.0009) [2023-12-26 10:05:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 670900224. Throughput: 0: 8581.0, 1: 9035.7. Samples: 670877888. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:23,785][121949] Avg episode reward: [(0, '6348.076'), (1, '5362.540')] [2023-12-26 10:05:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001305696_334258176.pth... [2023-12-26 10:05:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001314992_336642048.pth... [2023-12-26 10:05:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001313968_336379904.pth [2023-12-26 10:05:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001304640_333987840.pth [2023-12-26 10:05:24,094][123090] Updated weights for policy 1, policy_version 1305699 (0.0010) [2023-12-26 10:05:24,157][123090] Updated weights for policy 1, policy_version 1305709 (0.0010) [2023-12-26 10:05:24,217][123090] Updated weights for policy 1, policy_version 1305719 (0.0010) [2023-12-26 10:05:24,233][123091] Updated weights for policy 0, policy_version 1314995 (0.0009) [2023-12-26 10:05:24,290][123091] Updated weights for policy 0, policy_version 1315005 (0.0009) [2023-12-26 10:05:24,346][123091] Updated weights for policy 0, policy_version 1315015 (0.0009) [2023-12-26 10:05:24,939][123090] Updated weights for policy 1, policy_version 1305729 (0.0005) [2023-12-26 10:05:24,998][123090] Updated weights for policy 1, policy_version 1305739 (0.0005) [2023-12-26 10:05:25,062][123090] Updated weights for policy 1, policy_version 1305749 (0.0006) [2023-12-26 10:05:25,121][123090] Updated weights for policy 1, policy_version 1305759 (0.0006) [2023-12-26 10:05:25,260][123091] Updated weights for policy 0, policy_version 1315025 (0.0010) [2023-12-26 10:05:25,323][123091] Updated weights for policy 0, policy_version 1315035 (0.0009) [2023-12-26 10:05:25,383][123091] Updated weights for policy 0, policy_version 1315045 (0.0009) [2023-12-26 10:05:25,434][123091] Updated weights for policy 0, policy_version 1315055 (0.0009) [2023-12-26 10:05:25,864][123090] Updated weights for policy 1, policy_version 1305769 (0.0008) [2023-12-26 10:05:25,918][123090] Updated weights for policy 1, policy_version 1305779 (0.0008) [2023-12-26 10:05:25,985][123090] Updated weights for policy 1, policy_version 1305789 (0.0009) [2023-12-26 10:05:26,295][123091] Updated weights for policy 0, policy_version 1315065 (0.0009) [2023-12-26 10:05:26,350][123091] Updated weights for policy 0, policy_version 1315075 (0.0009) [2023-12-26 10:05:26,405][123091] Updated weights for policy 0, policy_version 1315085 (0.0009) [2023-12-26 10:05:26,821][123090] Updated weights for policy 1, policy_version 1305799 (0.0010) [2023-12-26 10:05:26,875][123090] Updated weights for policy 1, policy_version 1305809 (0.0010) [2023-12-26 10:05:26,930][123090] Updated weights for policy 1, policy_version 1305819 (0.0009) [2023-12-26 10:05:27,177][123091] Updated weights for policy 0, policy_version 1315095 (0.0006) [2023-12-26 10:05:27,250][123091] Updated weights for policy 0, policy_version 1315105 (0.0005) [2023-12-26 10:05:27,316][123091] Updated weights for policy 0, policy_version 1315115 (0.0007) [2023-12-26 10:05:27,811][123090] Updated weights for policy 1, policy_version 1305829 (0.0009) [2023-12-26 10:05:27,872][123090] Updated weights for policy 1, policy_version 1305839 (0.0010) [2023-12-26 10:05:27,922][123090] Updated weights for policy 1, policy_version 1305849 (0.0009) [2023-12-26 10:05:28,071][123091] Updated weights for policy 0, policy_version 1315125 (0.0008) [2023-12-26 10:05:28,128][123091] Updated weights for policy 0, policy_version 1315136 (0.0009) [2023-12-26 10:05:28,180][123091] Updated weights for policy 0, policy_version 1315147 (0.0009) [2023-12-26 10:05:28,712][123090] Updated weights for policy 1, policy_version 1305859 (0.0010) [2023-12-26 10:05:28,773][123090] Updated weights for policy 1, policy_version 1305869 (0.0009) [2023-12-26 10:05:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 670982144. Throughput: 0: 8611.3, 1: 9056.4. Samples: 670981744. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:28,784][121949] Avg episode reward: [(0, '6308.206'), (1, '5269.551')] [2023-12-26 10:05:28,830][123090] Updated weights for policy 1, policy_version 1305879 (0.0009) [2023-12-26 10:05:29,049][123091] Updated weights for policy 0, policy_version 1315157 (0.0010) [2023-12-26 10:05:29,100][123091] Updated weights for policy 0, policy_version 1315167 (0.0009) [2023-12-26 10:05:29,153][123091] Updated weights for policy 0, policy_version 1315177 (0.0009) [2023-12-26 10:05:29,701][123090] Updated weights for policy 1, policy_version 1305889 (0.0009) [2023-12-26 10:05:29,764][123090] Updated weights for policy 1, policy_version 1305899 (0.0008) [2023-12-26 10:05:29,815][123090] Updated weights for policy 1, policy_version 1305909 (0.0006) [2023-12-26 10:05:29,884][123090] Updated weights for policy 1, policy_version 1305919 (0.0008) [2023-12-26 10:05:30,001][123091] Updated weights for policy 0, policy_version 1315187 (0.0009) [2023-12-26 10:05:30,071][123091] Updated weights for policy 0, policy_version 1315197 (0.0008) [2023-12-26 10:05:30,137][123091] Updated weights for policy 0, policy_version 1315207 (0.0008) [2023-12-26 10:05:30,672][123090] Updated weights for policy 1, policy_version 1305929 (0.0008) [2023-12-26 10:05:30,721][123090] Updated weights for policy 1, policy_version 1305939 (0.0006) [2023-12-26 10:05:30,769][123090] Updated weights for policy 1, policy_version 1305949 (0.0005) [2023-12-26 10:05:30,860][123091] Updated weights for policy 0, policy_version 1315217 (0.0008) [2023-12-26 10:05:30,933][123091] Updated weights for policy 0, policy_version 1315227 (0.0005) [2023-12-26 10:05:30,990][123091] Updated weights for policy 0, policy_version 1315237 (0.0005) [2023-12-26 10:05:31,053][123091] Updated weights for policy 0, policy_version 1315247 (0.0006) [2023-12-26 10:05:31,511][123090] Updated weights for policy 1, policy_version 1305959 (0.0008) [2023-12-26 10:05:31,573][123090] Updated weights for policy 1, policy_version 1305969 (0.0009) [2023-12-26 10:05:31,637][123090] Updated weights for policy 1, policy_version 1305979 (0.0009) [2023-12-26 10:05:31,773][123091] Updated weights for policy 0, policy_version 1315257 (0.0009) [2023-12-26 10:05:31,843][123091] Updated weights for policy 0, policy_version 1315267 (0.0009) [2023-12-26 10:05:31,902][123091] Updated weights for policy 0, policy_version 1315277 (0.0009) [2023-12-26 10:05:32,462][123090] Updated weights for policy 1, policy_version 1305989 (0.0009) [2023-12-26 10:05:32,536][123090] Updated weights for policy 1, policy_version 1305999 (0.0006) [2023-12-26 10:05:32,610][123090] Updated weights for policy 1, policy_version 1306009 (0.0010) [2023-12-26 10:05:32,705][123091] Updated weights for policy 0, policy_version 1315287 (0.0007) [2023-12-26 10:05:32,759][123091] Updated weights for policy 0, policy_version 1315297 (0.0005) [2023-12-26 10:05:32,825][123091] Updated weights for policy 0, policy_version 1315307 (0.0005) [2023-12-26 10:05:33,251][123090] Updated weights for policy 1, policy_version 1306019 (0.0008) [2023-12-26 10:05:33,305][123090] Updated weights for policy 1, policy_version 1306029 (0.0005) [2023-12-26 10:05:33,353][123090] Updated weights for policy 1, policy_version 1306039 (0.0005) [2023-12-26 10:05:33,410][123091] Updated weights for policy 0, policy_version 1315317 (0.0005) [2023-12-26 10:05:33,473][123091] Updated weights for policy 0, policy_version 1315327 (0.0005) [2023-12-26 10:05:33,529][123091] Updated weights for policy 0, policy_version 1315337 (0.0007) [2023-12-26 10:05:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 671080448. Throughput: 0: 8753.0, 1: 9016.1. Samples: 671090760. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:33,785][121949] Avg episode reward: [(0, '6304.422'), (1, '5355.031')] [2023-12-26 10:05:33,976][123090] Updated weights for policy 1, policy_version 1306049 (0.0006) [2023-12-26 10:05:34,032][123090] Updated weights for policy 1, policy_version 1306059 (0.0009) [2023-12-26 10:05:34,091][123090] Updated weights for policy 1, policy_version 1306069 (0.0009) [2023-12-26 10:05:34,148][123090] Updated weights for policy 1, policy_version 1306079 (0.0009) [2023-12-26 10:05:34,378][123091] Updated weights for policy 0, policy_version 1315347 (0.0010) [2023-12-26 10:05:34,441][123091] Updated weights for policy 0, policy_version 1315357 (0.0010) [2023-12-26 10:05:34,500][123091] Updated weights for policy 0, policy_version 1315367 (0.0010) [2023-12-26 10:05:35,030][123090] Updated weights for policy 1, policy_version 1306089 (0.0010) [2023-12-26 10:05:35,091][123090] Updated weights for policy 1, policy_version 1306099 (0.0009) [2023-12-26 10:05:35,153][123090] Updated weights for policy 1, policy_version 1306109 (0.0009) [2023-12-26 10:05:35,210][123091] Updated weights for policy 0, policy_version 1315377 (0.0009) [2023-12-26 10:05:35,263][123091] Updated weights for policy 0, policy_version 1315387 (0.0009) [2023-12-26 10:05:35,314][123091] Updated weights for policy 0, policy_version 1315397 (0.0009) [2023-12-26 10:05:35,364][123091] Updated weights for policy 0, policy_version 1315408 (0.0010) [2023-12-26 10:05:36,053][123090] Updated weights for policy 1, policy_version 1306119 (0.0009) [2023-12-26 10:05:36,123][123090] Updated weights for policy 1, policy_version 1306129 (0.0009) [2023-12-26 10:05:36,174][123091] Updated weights for policy 0, policy_version 1315418 (0.0006) [2023-12-26 10:05:36,191][123090] Updated weights for policy 1, policy_version 1306139 (0.0007) [2023-12-26 10:05:36,236][123091] Updated weights for policy 0, policy_version 1315428 (0.0006) [2023-12-26 10:05:36,297][123091] Updated weights for policy 0, policy_version 1315438 (0.0006) [2023-12-26 10:05:36,888][123090] Updated weights for policy 1, policy_version 1306149 (0.0006) [2023-12-26 10:05:36,963][123090] Updated weights for policy 1, policy_version 1306159 (0.0005) [2023-12-26 10:05:37,016][123090] Updated weights for policy 1, policy_version 1306169 (0.0005) [2023-12-26 10:05:37,074][123091] Updated weights for policy 0, policy_version 1315448 (0.0006) [2023-12-26 10:05:37,128][123091] Updated weights for policy 0, policy_version 1315458 (0.0007) [2023-12-26 10:05:37,173][123091] Updated weights for policy 0, policy_version 1315468 (0.0005) [2023-12-26 10:05:37,697][123090] Updated weights for policy 1, policy_version 1306179 (0.0006) [2023-12-26 10:05:37,759][123090] Updated weights for policy 1, policy_version 1306189 (0.0006) [2023-12-26 10:05:37,762][123091] Updated weights for policy 0, policy_version 1315478 (0.0006) [2023-12-26 10:05:37,814][123090] Updated weights for policy 1, policy_version 1306199 (0.0005) [2023-12-26 10:05:37,819][123091] Updated weights for policy 0, policy_version 1315488 (0.0005) [2023-12-26 10:05:37,869][123091] Updated weights for policy 0, policy_version 1315498 (0.0005) [2023-12-26 10:05:38,525][123090] Updated weights for policy 1, policy_version 1306209 (0.0005) [2023-12-26 10:05:38,595][123090] Updated weights for policy 1, policy_version 1306219 (0.0006) [2023-12-26 10:05:38,663][123090] Updated weights for policy 1, policy_version 1306229 (0.0010) [2023-12-26 10:05:38,680][123091] Updated weights for policy 0, policy_version 1315508 (0.0006) [2023-12-26 10:05:38,728][123090] Updated weights for policy 1, policy_version 1306239 (0.0009) [2023-12-26 10:05:38,744][123091] Updated weights for policy 0, policy_version 1315518 (0.0008) [2023-12-26 10:05:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 671170560. Throughput: 0: 8789.8, 1: 9014.6. Samples: 671143708. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:38,785][121949] Avg episode reward: [(0, '6389.384'), (1, '5438.874')] [2023-12-26 10:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001306240_334397440.pth... [2023-12-26 10:05:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001305184_334127104.pth [2023-12-26 10:05:38,797][123091] Updated weights for policy 0, policy_version 1315529 (0.0010) [2023-12-26 10:05:38,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001315536_336781312.pth... [2023-12-26 10:05:38,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001314480_336510976.pth [2023-12-26 10:05:39,518][123090] Updated weights for policy 1, policy_version 1306249 (0.0009) [2023-12-26 10:05:39,583][123090] Updated weights for policy 1, policy_version 1306259 (0.0009) [2023-12-26 10:05:39,642][123090] Updated weights for policy 1, policy_version 1306269 (0.0010) [2023-12-26 10:05:39,710][123091] Updated weights for policy 0, policy_version 1315539 (0.0010) [2023-12-26 10:05:39,776][123091] Updated weights for policy 0, policy_version 1315549 (0.0009) [2023-12-26 10:05:39,852][123091] Updated weights for policy 0, policy_version 1315559 (0.0009) [2023-12-26 10:05:40,403][123090] Updated weights for policy 1, policy_version 1306279 (0.0008) [2023-12-26 10:05:40,477][123090] Updated weights for policy 1, policy_version 1306289 (0.0008) [2023-12-26 10:05:40,544][123090] Updated weights for policy 1, policy_version 1306299 (0.0010) [2023-12-26 10:05:40,706][123091] Updated weights for policy 0, policy_version 1315569 (0.0009) [2023-12-26 10:05:40,772][123091] Updated weights for policy 0, policy_version 1315579 (0.0007) [2023-12-26 10:05:40,835][123091] Updated weights for policy 0, policy_version 1315589 (0.0009) [2023-12-26 10:05:40,884][123091] Updated weights for policy 0, policy_version 1315599 (0.0009) [2023-12-26 10:05:41,323][123090] Updated weights for policy 1, policy_version 1306309 (0.0007) [2023-12-26 10:05:41,401][123090] Updated weights for policy 1, policy_version 1306319 (0.0009) [2023-12-26 10:05:41,471][123090] Updated weights for policy 1, policy_version 1306329 (0.0009) [2023-12-26 10:05:41,804][123091] Updated weights for policy 0, policy_version 1315609 (0.0010) [2023-12-26 10:05:41,867][123091] Updated weights for policy 0, policy_version 1315619 (0.0010) [2023-12-26 10:05:41,927][123091] Updated weights for policy 0, policy_version 1315629 (0.0010) [2023-12-26 10:05:42,220][123090] Updated weights for policy 1, policy_version 1306339 (0.0008) [2023-12-26 10:05:42,292][123090] Updated weights for policy 1, policy_version 1306349 (0.0008) [2023-12-26 10:05:42,360][123090] Updated weights for policy 1, policy_version 1306359 (0.0009) [2023-12-26 10:05:42,844][123091] Updated weights for policy 0, policy_version 1315639 (0.0009) [2023-12-26 10:05:42,903][123091] Updated weights for policy 0, policy_version 1315649 (0.0010) [2023-12-26 10:05:42,963][123091] Updated weights for policy 0, policy_version 1315659 (0.0009) [2023-12-26 10:05:43,130][123090] Updated weights for policy 1, policy_version 1306369 (0.0006) [2023-12-26 10:05:43,185][123090] Updated weights for policy 1, policy_version 1306379 (0.0005) [2023-12-26 10:05:43,237][123090] Updated weights for policy 1, policy_version 1306389 (0.0006) [2023-12-26 10:05:43,282][123090] Updated weights for policy 1, policy_version 1306399 (0.0005) [2023-12-26 10:05:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 671252480. Throughput: 0: 8816.1, 1: 9021.6. Samples: 671249928. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:43,785][121949] Avg episode reward: [(0, '6454.893'), (1, '5544.749')] [2023-12-26 10:05:43,852][123091] Updated weights for policy 0, policy_version 1315669 (0.0009) [2023-12-26 10:05:43,914][123091] Updated weights for policy 0, policy_version 1315679 (0.0007) [2023-12-26 10:05:43,931][123090] Updated weights for policy 1, policy_version 1306409 (0.0006) [2023-12-26 10:05:43,984][123091] Updated weights for policy 0, policy_version 1315689 (0.0006) [2023-12-26 10:05:43,994][123090] Updated weights for policy 1, policy_version 1306419 (0.0006) [2023-12-26 10:05:44,055][123090] Updated weights for policy 1, policy_version 1306429 (0.0006) [2023-12-26 10:05:44,665][123091] Updated weights for policy 0, policy_version 1315699 (0.0005) [2023-12-26 10:05:44,685][123090] Updated weights for policy 1, policy_version 1306439 (0.0005) [2023-12-26 10:05:44,718][123091] Updated weights for policy 0, policy_version 1315709 (0.0005) [2023-12-26 10:05:44,742][123090] Updated weights for policy 1, policy_version 1306449 (0.0006) [2023-12-26 10:05:44,806][123091] Updated weights for policy 0, policy_version 1315719 (0.0006) [2023-12-26 10:05:44,822][123090] Updated weights for policy 1, policy_version 1306459 (0.0008) [2023-12-26 10:05:45,462][123091] Updated weights for policy 0, policy_version 1315729 (0.0006) [2023-12-26 10:05:45,520][123091] Updated weights for policy 0, policy_version 1315739 (0.0011) [2023-12-26 10:05:45,553][123090] Updated weights for policy 1, policy_version 1306469 (0.0007) [2023-12-26 10:05:45,572][123091] Updated weights for policy 0, policy_version 1315749 (0.0011) [2023-12-26 10:05:45,611][123090] Updated weights for policy 1, policy_version 1306479 (0.0007) [2023-12-26 10:05:45,632][123091] Updated weights for policy 0, policy_version 1315759 (0.0010) [2023-12-26 10:05:45,671][123090] Updated weights for policy 1, policy_version 1306489 (0.0008) [2023-12-26 10:05:46,422][123091] Updated weights for policy 0, policy_version 1315769 (0.0010) [2023-12-26 10:05:46,467][123091] Updated weights for policy 0, policy_version 1315779 (0.0011) [2023-12-26 10:05:46,484][123090] Updated weights for policy 1, policy_version 1306499 (0.0007) [2023-12-26 10:05:46,532][123091] Updated weights for policy 0, policy_version 1315789 (0.0006) [2023-12-26 10:05:46,549][123090] Updated weights for policy 1, policy_version 1306509 (0.0007) [2023-12-26 10:05:46,612][123090] Updated weights for policy 1, policy_version 1306519 (0.0008) [2023-12-26 10:05:47,324][123091] Updated weights for policy 0, policy_version 1315799 (0.0007) [2023-12-26 10:05:47,386][123091] Updated weights for policy 0, policy_version 1315809 (0.0010) [2023-12-26 10:05:47,409][123090] Updated weights for policy 1, policy_version 1306529 (0.0009) [2023-12-26 10:05:47,454][123091] Updated weights for policy 0, policy_version 1315819 (0.0006) [2023-12-26 10:05:47,465][123090] Updated weights for policy 1, policy_version 1306539 (0.0009) [2023-12-26 10:05:47,525][123090] Updated weights for policy 1, policy_version 1306549 (0.0009) [2023-12-26 10:05:47,585][123090] Updated weights for policy 1, policy_version 1306559 (0.0009) [2023-12-26 10:05:48,064][123091] Updated weights for policy 0, policy_version 1315829 (0.0005) [2023-12-26 10:05:48,130][123091] Updated weights for policy 0, policy_version 1315839 (0.0009) [2023-12-26 10:05:48,185][123091] Updated weights for policy 0, policy_version 1315849 (0.0010) [2023-12-26 10:05:48,328][123090] Updated weights for policy 1, policy_version 1306569 (0.0008) [2023-12-26 10:05:48,392][123090] Updated weights for policy 1, policy_version 1306579 (0.0008) [2023-12-26 10:05:48,460][123090] Updated weights for policy 1, policy_version 1306589 (0.0009) [2023-12-26 10:05:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 671350784. Throughput: 0: 8887.9, 1: 9040.8. Samples: 671361352. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:48,785][121949] Avg episode reward: [(0, '6384.386'), (1, '5593.674')] [2023-12-26 10:05:49,017][123091] Updated weights for policy 0, policy_version 1315859 (0.0010) [2023-12-26 10:05:49,065][123091] Updated weights for policy 0, policy_version 1315869 (0.0010) [2023-12-26 10:05:49,127][123091] Updated weights for policy 0, policy_version 1315879 (0.0010) [2023-12-26 10:05:49,153][123090] Updated weights for policy 1, policy_version 1306599 (0.0008) [2023-12-26 10:05:49,228][123090] Updated weights for policy 1, policy_version 1306609 (0.0008) [2023-12-26 10:05:49,301][123090] Updated weights for policy 1, policy_version 1306619 (0.0006) [2023-12-26 10:05:49,987][123091] Updated weights for policy 0, policy_version 1315889 (0.0010) [2023-12-26 10:05:50,036][123090] Updated weights for policy 1, policy_version 1306629 (0.0007) [2023-12-26 10:05:50,050][123091] Updated weights for policy 0, policy_version 1315899 (0.0010) [2023-12-26 10:05:50,091][123090] Updated weights for policy 1, policy_version 1306639 (0.0009) [2023-12-26 10:05:50,113][123091] Updated weights for policy 0, policy_version 1315909 (0.0007) [2023-12-26 10:05:50,157][123090] Updated weights for policy 1, policy_version 1306649 (0.0009) [2023-12-26 10:05:50,175][123091] Updated weights for policy 0, policy_version 1315919 (0.0009) [2023-12-26 10:05:50,978][123090] Updated weights for policy 1, policy_version 1306659 (0.0009) [2023-12-26 10:05:50,980][123091] Updated weights for policy 0, policy_version 1315929 (0.0006) [2023-12-26 10:05:51,048][123091] Updated weights for policy 0, policy_version 1315939 (0.0007) [2023-12-26 10:05:51,049][123090] Updated weights for policy 1, policy_version 1306669 (0.0009) [2023-12-26 10:05:51,118][123090] Updated weights for policy 1, policy_version 1306679 (0.0007) [2023-12-26 10:05:51,121][123091] Updated weights for policy 0, policy_version 1315949 (0.0009) [2023-12-26 10:05:51,902][123090] Updated weights for policy 1, policy_version 1306689 (0.0007) [2023-12-26 10:05:51,974][123090] Updated weights for policy 1, policy_version 1306699 (0.0010) [2023-12-26 10:05:51,986][123091] Updated weights for policy 0, policy_version 1315959 (0.0008) [2023-12-26 10:05:52,041][123090] Updated weights for policy 1, policy_version 1306709 (0.0011) [2023-12-26 10:05:52,045][123091] Updated weights for policy 0, policy_version 1315969 (0.0008) [2023-12-26 10:05:52,108][123091] Updated weights for policy 0, policy_version 1315979 (0.0008) [2023-12-26 10:05:52,108][123090] Updated weights for policy 1, policy_version 1306719 (0.0011) [2023-12-26 10:05:52,932][123091] Updated weights for policy 0, policy_version 1315989 (0.0008) [2023-12-26 10:05:52,933][123090] Updated weights for policy 1, policy_version 1306729 (0.0010) [2023-12-26 10:05:52,983][123090] Updated weights for policy 1, policy_version 1306739 (0.0008) [2023-12-26 10:05:52,998][123091] Updated weights for policy 0, policy_version 1315999 (0.0008) [2023-12-26 10:05:53,041][123090] Updated weights for policy 1, policy_version 1306749 (0.0008) [2023-12-26 10:05:53,062][123091] Updated weights for policy 0, policy_version 1316009 (0.0010) [2023-12-26 10:05:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 671432704. Throughput: 0: 8839.1, 1: 9007.3. Samples: 671414308. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:53,785][121949] Avg episode reward: [(0, '6408.915'), (1, '5538.375')] [2023-12-26 10:05:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001316016_336904192.pth... [2023-12-26 10:05:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001306752_334528512.pth... [2023-12-26 10:05:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001314992_336642048.pth [2023-12-26 10:05:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001305696_334258176.pth [2023-12-26 10:05:53,871][123090] Updated weights for policy 1, policy_version 1306759 (0.0009) [2023-12-26 10:05:53,876][123091] Updated weights for policy 0, policy_version 1316019 (0.0010) [2023-12-26 10:05:53,938][123091] Updated weights for policy 0, policy_version 1316029 (0.0011) [2023-12-26 10:05:53,941][123090] Updated weights for policy 1, policy_version 1306769 (0.0006) [2023-12-26 10:05:53,995][123090] Updated weights for policy 1, policy_version 1306779 (0.0006) [2023-12-26 10:05:53,996][123091] Updated weights for policy 0, policy_version 1316039 (0.0010) [2023-12-26 10:05:54,818][123091] Updated weights for policy 0, policy_version 1316049 (0.0011) [2023-12-26 10:05:54,824][123090] Updated weights for policy 1, policy_version 1306789 (0.0008) [2023-12-26 10:05:54,872][123091] Updated weights for policy 0, policy_version 1316059 (0.0010) [2023-12-26 10:05:54,875][123090] Updated weights for policy 1, policy_version 1306799 (0.0008) [2023-12-26 10:05:54,941][123090] Updated weights for policy 1, policy_version 1306809 (0.0007) [2023-12-26 10:05:54,943][123091] Updated weights for policy 0, policy_version 1316069 (0.0011) [2023-12-26 10:05:55,002][123091] Updated weights for policy 0, policy_version 1316079 (0.0011) [2023-12-26 10:05:55,779][123090] Updated weights for policy 1, policy_version 1306819 (0.0006) [2023-12-26 10:05:55,823][123091] Updated weights for policy 0, policy_version 1316089 (0.0011) [2023-12-26 10:05:55,831][123090] Updated weights for policy 1, policy_version 1306829 (0.0008) [2023-12-26 10:05:55,871][123091] Updated weights for policy 0, policy_version 1316099 (0.0010) [2023-12-26 10:05:55,882][123090] Updated weights for policy 1, policy_version 1306839 (0.0005) [2023-12-26 10:05:55,918][123091] Updated weights for policy 0, policy_version 1316109 (0.0010) [2023-12-26 10:05:56,719][123090] Updated weights for policy 1, policy_version 1306849 (0.0007) [2023-12-26 10:05:56,760][123091] Updated weights for policy 0, policy_version 1316119 (0.0010) [2023-12-26 10:05:56,768][123090] Updated weights for policy 1, policy_version 1306859 (0.0006) [2023-12-26 10:05:56,804][123091] Updated weights for policy 0, policy_version 1316129 (0.0010) [2023-12-26 10:05:56,815][123090] Updated weights for policy 1, policy_version 1306869 (0.0005) [2023-12-26 10:05:56,852][123091] Updated weights for policy 0, policy_version 1316139 (0.0010) [2023-12-26 10:05:56,871][123090] Updated weights for policy 1, policy_version 1306879 (0.0006) [2023-12-26 10:05:57,696][123091] Updated weights for policy 0, policy_version 1316149 (0.0010) [2023-12-26 10:05:57,727][123090] Updated weights for policy 1, policy_version 1306889 (0.0009) [2023-12-26 10:05:57,746][123091] Updated weights for policy 0, policy_version 1316159 (0.0010) [2023-12-26 10:05:57,786][123090] Updated weights for policy 1, policy_version 1306899 (0.0006) [2023-12-26 10:05:57,803][123091] Updated weights for policy 0, policy_version 1316169 (0.0010) [2023-12-26 10:05:57,847][123090] Updated weights for policy 1, policy_version 1306909 (0.0006) [2023-12-26 10:05:58,662][123091] Updated weights for policy 0, policy_version 1316179 (0.0010) [2023-12-26 10:05:58,733][123091] Updated weights for policy 0, policy_version 1316189 (0.0010) [2023-12-26 10:05:58,738][123090] Updated weights for policy 1, policy_version 1306919 (0.0007) [2023-12-26 10:05:58,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 671514624. Throughput: 0: 8814.2, 1: 8967.5. Samples: 671516912. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:05:58,785][121949] Avg episode reward: [(0, '6402.702'), (1, '5551.368')] [2023-12-26 10:05:58,799][123091] Updated weights for policy 0, policy_version 1316199 (0.0009) [2023-12-26 10:05:58,804][123090] Updated weights for policy 1, policy_version 1306929 (0.0009) [2023-12-26 10:05:58,867][123090] Updated weights for policy 1, policy_version 1306939 (0.0008) [2023-12-26 10:05:59,615][123091] Updated weights for policy 0, policy_version 1316209 (0.0011) [2023-12-26 10:05:59,682][123091] Updated weights for policy 0, policy_version 1316219 (0.0009) [2023-12-26 10:05:59,702][123090] Updated weights for policy 1, policy_version 1306949 (0.0009) [2023-12-26 10:05:59,743][123091] Updated weights for policy 0, policy_version 1316229 (0.0009) [2023-12-26 10:05:59,763][123090] Updated weights for policy 1, policy_version 1306959 (0.0006) [2023-12-26 10:05:59,804][123091] Updated weights for policy 0, policy_version 1316239 (0.0008) [2023-12-26 10:05:59,824][123090] Updated weights for policy 1, policy_version 1306969 (0.0009) [2023-12-26 10:06:00,570][123091] Updated weights for policy 0, policy_version 1316249 (0.0006) [2023-12-26 10:06:00,627][123090] Updated weights for policy 1, policy_version 1306979 (0.0009) [2023-12-26 10:06:00,634][123091] Updated weights for policy 0, policy_version 1316259 (0.0009) [2023-12-26 10:06:00,688][123090] Updated weights for policy 1, policy_version 1306989 (0.0007) [2023-12-26 10:06:00,695][123091] Updated weights for policy 0, policy_version 1316269 (0.0010) [2023-12-26 10:06:00,743][123090] Updated weights for policy 1, policy_version 1306999 (0.0007) [2023-12-26 10:06:01,510][123091] Updated weights for policy 0, policy_version 1316279 (0.0010) [2023-12-26 10:06:01,572][123091] Updated weights for policy 0, policy_version 1316289 (0.0010) [2023-12-26 10:06:01,612][123090] Updated weights for policy 1, policy_version 1307009 (0.0008) [2023-12-26 10:06:01,643][123091] Updated weights for policy 0, policy_version 1316299 (0.0011) [2023-12-26 10:06:01,684][123090] Updated weights for policy 1, policy_version 1307019 (0.0006) [2023-12-26 10:06:01,753][123090] Updated weights for policy 1, policy_version 1307029 (0.0008) [2023-12-26 10:06:01,805][123090] Updated weights for policy 1, policy_version 1307039 (0.0009) [2023-12-26 10:06:02,465][123091] Updated weights for policy 0, policy_version 1316309 (0.0010) [2023-12-26 10:06:02,517][123091] Updated weights for policy 0, policy_version 1316319 (0.0009) [2023-12-26 10:06:02,579][123091] Updated weights for policy 0, policy_version 1316329 (0.0009) [2023-12-26 10:06:02,648][123090] Updated weights for policy 1, policy_version 1307049 (0.0010) [2023-12-26 10:06:02,707][123090] Updated weights for policy 1, policy_version 1307059 (0.0010) [2023-12-26 10:06:02,770][123090] Updated weights for policy 1, policy_version 1307069 (0.0011) [2023-12-26 10:06:03,349][123091] Updated weights for policy 0, policy_version 1316339 (0.0007) [2023-12-26 10:06:03,409][123091] Updated weights for policy 0, policy_version 1316349 (0.0005) [2023-12-26 10:06:03,459][123091] Updated weights for policy 0, policy_version 1316359 (0.0006) [2023-12-26 10:06:03,505][123090] Updated weights for policy 1, policy_version 1307079 (0.0007) [2023-12-26 10:06:03,553][123090] Updated weights for policy 1, policy_version 1307089 (0.0005) [2023-12-26 10:06:03,623][123090] Updated weights for policy 1, policy_version 1307099 (0.0006) [2023-12-26 10:06:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 671612928. Throughput: 0: 8748.8, 1: 8899.1. Samples: 671620692. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:03,785][121949] Avg episode reward: [(0, '6379.248'), (1, '5481.058')] [2023-12-26 10:06:04,297][123091] Updated weights for policy 0, policy_version 1316369 (0.0008) [2023-12-26 10:06:04,300][123090] Updated weights for policy 1, policy_version 1307109 (0.0009) [2023-12-26 10:06:04,362][123091] Updated weights for policy 0, policy_version 1316379 (0.0007) [2023-12-26 10:06:04,368][123090] Updated weights for policy 1, policy_version 1307119 (0.0010) [2023-12-26 10:06:04,434][123091] Updated weights for policy 0, policy_version 1316389 (0.0007) [2023-12-26 10:06:04,436][123090] Updated weights for policy 1, policy_version 1307129 (0.0011) [2023-12-26 10:06:04,497][123091] Updated weights for policy 0, policy_version 1316399 (0.0007) [2023-12-26 10:06:05,261][123090] Updated weights for policy 1, policy_version 1307139 (0.0010) [2023-12-26 10:06:05,286][123091] Updated weights for policy 0, policy_version 1316409 (0.0008) [2023-12-26 10:06:05,317][123090] Updated weights for policy 1, policy_version 1307149 (0.0009) [2023-12-26 10:06:05,336][123091] Updated weights for policy 0, policy_version 1316419 (0.0009) [2023-12-26 10:06:05,373][123090] Updated weights for policy 1, policy_version 1307159 (0.0005) [2023-12-26 10:06:05,385][123091] Updated weights for policy 0, policy_version 1316430 (0.0008) [2023-12-26 10:06:06,171][123090] Updated weights for policy 1, policy_version 1307169 (0.0009) [2023-12-26 10:06:06,235][123090] Updated weights for policy 1, policy_version 1307179 (0.0010) [2023-12-26 10:06:06,255][123091] Updated weights for policy 0, policy_version 1316440 (0.0007) [2023-12-26 10:06:06,298][123090] Updated weights for policy 1, policy_version 1307189 (0.0010) [2023-12-26 10:06:06,323][123091] Updated weights for policy 0, policy_version 1316450 (0.0006) [2023-12-26 10:06:06,366][123090] Updated weights for policy 1, policy_version 1307199 (0.0010) [2023-12-26 10:06:06,391][123091] Updated weights for policy 0, policy_version 1316460 (0.0008) [2023-12-26 10:06:07,162][123090] Updated weights for policy 1, policy_version 1307209 (0.0007) [2023-12-26 10:06:07,212][123091] Updated weights for policy 0, policy_version 1316470 (0.0009) [2023-12-26 10:06:07,221][123090] Updated weights for policy 1, policy_version 1307219 (0.0008) [2023-12-26 10:06:07,265][123091] Updated weights for policy 0, policy_version 1316480 (0.0007) [2023-12-26 10:06:07,280][123090] Updated weights for policy 1, policy_version 1307229 (0.0010) [2023-12-26 10:06:07,319][123091] Updated weights for policy 0, policy_version 1316490 (0.0011) [2023-12-26 10:06:08,002][123090] Updated weights for policy 1, policy_version 1307239 (0.0007) [2023-12-26 10:06:08,053][123090] Updated weights for policy 1, policy_version 1307249 (0.0005) [2023-12-26 10:06:08,099][123090] Updated weights for policy 1, policy_version 1307259 (0.0005) [2023-12-26 10:06:08,168][123091] Updated weights for policy 0, policy_version 1316500 (0.0009) [2023-12-26 10:06:08,224][123091] Updated weights for policy 0, policy_version 1316510 (0.0005) [2023-12-26 10:06:08,271][123091] Updated weights for policy 0, policy_version 1316520 (0.0005) [2023-12-26 10:06:08,775][123090] Updated weights for policy 1, policy_version 1307269 (0.0005) [2023-12-26 10:06:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 671694848. Throughput: 0: 8748.7, 1: 8910.0. Samples: 671672528. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:08,785][121949] Avg episode reward: [(0, '6357.509'), (1, '5441.112')] [2023-12-26 10:06:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001316528_337035264.pth... [2023-12-26 10:06:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001315536_336781312.pth [2023-12-26 10:06:08,822][123090] Updated weights for policy 1, policy_version 1307279 (0.0005) [2023-12-26 10:06:08,870][123090] Updated weights for policy 1, policy_version 1307289 (0.0005) [2023-12-26 10:06:08,903][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001307296_334667776.pth... [2023-12-26 10:06:08,906][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001306240_334397440.pth [2023-12-26 10:06:09,086][123091] Updated weights for policy 0, policy_version 1316530 (0.0006) [2023-12-26 10:06:09,133][123091] Updated weights for policy 0, policy_version 1316540 (0.0010) [2023-12-26 10:06:09,184][123091] Updated weights for policy 0, policy_version 1316550 (0.0010) [2023-12-26 10:06:09,243][123091] Updated weights for policy 0, policy_version 1316560 (0.0010) [2023-12-26 10:06:09,697][123090] Updated weights for policy 1, policy_version 1307299 (0.0009) [2023-12-26 10:06:09,766][123090] Updated weights for policy 1, policy_version 1307309 (0.0009) [2023-12-26 10:06:09,838][123090] Updated weights for policy 1, policy_version 1307319 (0.0010) [2023-12-26 10:06:10,014][123091] Updated weights for policy 0, policy_version 1316570 (0.0011) [2023-12-26 10:06:10,086][123091] Updated weights for policy 0, policy_version 1316580 (0.0006) [2023-12-26 10:06:10,155][123091] Updated weights for policy 0, policy_version 1316590 (0.0007) [2023-12-26 10:06:10,730][123090] Updated weights for policy 1, policy_version 1307329 (0.0008) [2023-12-26 10:06:10,785][123090] Updated weights for policy 1, policy_version 1307339 (0.0007) [2023-12-26 10:06:10,831][123091] Updated weights for policy 0, policy_version 1316600 (0.0006) [2023-12-26 10:06:10,837][123090] Updated weights for policy 1, policy_version 1307349 (0.0009) [2023-12-26 10:06:10,890][123091] Updated weights for policy 0, policy_version 1316610 (0.0006) [2023-12-26 10:06:10,900][123090] Updated weights for policy 1, policy_version 1307359 (0.0009) [2023-12-26 10:06:10,958][123091] Updated weights for policy 0, policy_version 1316620 (0.0011) [2023-12-26 10:06:11,754][123090] Updated weights for policy 1, policy_version 1307369 (0.0008) [2023-12-26 10:06:11,780][123091] Updated weights for policy 0, policy_version 1316630 (0.0008) [2023-12-26 10:06:11,825][123090] Updated weights for policy 1, policy_version 1307379 (0.0011) [2023-12-26 10:06:11,829][123091] Updated weights for policy 0, policy_version 1316640 (0.0006) [2023-12-26 10:06:11,881][123091] Updated weights for policy 0, policy_version 1316650 (0.0006) [2023-12-26 10:06:11,892][123090] Updated weights for policy 1, policy_version 1307389 (0.0008) [2023-12-26 10:06:12,625][123090] Updated weights for policy 1, policy_version 1307399 (0.0010) [2023-12-26 10:06:12,677][123090] Updated weights for policy 1, policy_version 1307409 (0.0010) [2023-12-26 10:06:12,680][123091] Updated weights for policy 0, policy_version 1316660 (0.0006) [2023-12-26 10:06:12,723][123090] Updated weights for policy 1, policy_version 1307419 (0.0010) [2023-12-26 10:06:12,725][123091] Updated weights for policy 0, policy_version 1316670 (0.0005) [2023-12-26 10:06:12,780][123091] Updated weights for policy 0, policy_version 1316680 (0.0007) [2023-12-26 10:06:13,581][123090] Updated weights for policy 1, policy_version 1307429 (0.0010) [2023-12-26 10:06:13,644][123091] Updated weights for policy 0, policy_version 1316690 (0.0008) [2023-12-26 10:06:13,648][123090] Updated weights for policy 1, policy_version 1307439 (0.0011) [2023-12-26 10:06:13,696][123091] Updated weights for policy 0, policy_version 1316700 (0.0006) [2023-12-26 10:06:13,715][123090] Updated weights for policy 1, policy_version 1307449 (0.0010) [2023-12-26 10:06:13,747][123091] Updated weights for policy 0, policy_version 1316710 (0.0005) [2023-12-26 10:06:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 671784960. Throughput: 0: 8808.2, 1: 8928.7. Samples: 671779908. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:13,785][121949] Avg episode reward: [(0, '6402.489'), (1, '5545.974')] [2023-12-26 10:06:13,805][123091] Updated weights for policy 0, policy_version 1316720 (0.0006) [2023-12-26 10:06:14,483][123091] Updated weights for policy 0, policy_version 1316730 (0.0005) [2023-12-26 10:06:14,521][123090] Updated weights for policy 1, policy_version 1307459 (0.0010) [2023-12-26 10:06:14,540][123091] Updated weights for policy 0, policy_version 1316740 (0.0006) [2023-12-26 10:06:14,584][123090] Updated weights for policy 1, policy_version 1307469 (0.0010) [2023-12-26 10:06:14,589][123091] Updated weights for policy 0, policy_version 1316750 (0.0007) [2023-12-26 10:06:14,639][123090] Updated weights for policy 1, policy_version 1307479 (0.0010) [2023-12-26 10:06:15,344][123091] Updated weights for policy 0, policy_version 1316760 (0.0009) [2023-12-26 10:06:15,411][123091] Updated weights for policy 0, policy_version 1316770 (0.0009) [2023-12-26 10:06:15,470][123090] Updated weights for policy 1, policy_version 1307489 (0.0010) [2023-12-26 10:06:15,483][123091] Updated weights for policy 0, policy_version 1316780 (0.0008) [2023-12-26 10:06:15,527][123090] Updated weights for policy 1, policy_version 1307499 (0.0011) [2023-12-26 10:06:15,599][123090] Updated weights for policy 1, policy_version 1307509 (0.0011) [2023-12-26 10:06:15,663][123090] Updated weights for policy 1, policy_version 1307519 (0.0010) [2023-12-26 10:06:16,129][123091] Updated weights for policy 0, policy_version 1316790 (0.0010) [2023-12-26 10:06:16,180][123091] Updated weights for policy 0, policy_version 1316800 (0.0010) [2023-12-26 10:06:16,228][123091] Updated weights for policy 0, policy_version 1316810 (0.0011) [2023-12-26 10:06:16,482][123090] Updated weights for policy 1, policy_version 1307529 (0.0009) [2023-12-26 10:06:16,532][123090] Updated weights for policy 1, policy_version 1307539 (0.0008) [2023-12-26 10:06:16,591][123090] Updated weights for policy 1, policy_version 1307549 (0.0010) [2023-12-26 10:06:17,044][123091] Updated weights for policy 0, policy_version 1316820 (0.0009) [2023-12-26 10:06:17,116][123091] Updated weights for policy 0, policy_version 1316830 (0.0008) [2023-12-26 10:06:17,179][123091] Updated weights for policy 0, policy_version 1316840 (0.0011) [2023-12-26 10:06:17,411][123090] Updated weights for policy 1, policy_version 1307559 (0.0007) [2023-12-26 10:06:17,467][123090] Updated weights for policy 1, policy_version 1307569 (0.0005) [2023-12-26 10:06:17,526][123090] Updated weights for policy 1, policy_version 1307579 (0.0005) [2023-12-26 10:06:17,971][123091] Updated weights for policy 0, policy_version 1316850 (0.0011) [2023-12-26 10:06:18,026][123091] Updated weights for policy 0, policy_version 1316860 (0.0007) [2023-12-26 10:06:18,089][123091] Updated weights for policy 0, policy_version 1316870 (0.0005) [2023-12-26 10:06:18,164][123091] Updated weights for policy 0, policy_version 1316880 (0.0006) [2023-12-26 10:06:18,322][123090] Updated weights for policy 1, policy_version 1307589 (0.0008) [2023-12-26 10:06:18,400][123090] Updated weights for policy 1, policy_version 1307599 (0.0011) [2023-12-26 10:06:18,461][123090] Updated weights for policy 1, policy_version 1307609 (0.0010) [2023-12-26 10:06:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 671875072. Throughput: 0: 8818.3, 1: 8874.9. Samples: 671886948. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:18,785][121949] Avg episode reward: [(0, '6335.826'), (1, '5368.860')] [2023-12-26 10:06:18,901][123091] Updated weights for policy 0, policy_version 1316890 (0.0011) [2023-12-26 10:06:18,964][123091] Updated weights for policy 0, policy_version 1316900 (0.0010) [2023-12-26 10:06:19,031][123091] Updated weights for policy 0, policy_version 1316910 (0.0011) [2023-12-26 10:06:19,256][123090] Updated weights for policy 1, policy_version 1307619 (0.0010) [2023-12-26 10:06:19,322][123090] Updated weights for policy 1, policy_version 1307629 (0.0008) [2023-12-26 10:06:19,388][123090] Updated weights for policy 1, policy_version 1307639 (0.0008) [2023-12-26 10:06:19,806][123091] Updated weights for policy 0, policy_version 1316920 (0.0006) [2023-12-26 10:06:19,879][123091] Updated weights for policy 0, policy_version 1316931 (0.0007) [2023-12-26 10:06:19,949][123091] Updated weights for policy 0, policy_version 1316941 (0.0011) [2023-12-26 10:06:20,174][123090] Updated weights for policy 1, policy_version 1307649 (0.0008) [2023-12-26 10:06:20,244][123090] Updated weights for policy 1, policy_version 1307659 (0.0008) [2023-12-26 10:06:20,306][123090] Updated weights for policy 1, policy_version 1307669 (0.0009) [2023-12-26 10:06:20,372][123090] Updated weights for policy 1, policy_version 1307679 (0.0009) [2023-12-26 10:06:20,709][123091] Updated weights for policy 0, policy_version 1316951 (0.0006) [2023-12-26 10:06:20,786][123091] Updated weights for policy 0, policy_version 1316961 (0.0007) [2023-12-26 10:06:20,860][123091] Updated weights for policy 0, policy_version 1316971 (0.0008) [2023-12-26 10:06:21,111][123090] Updated weights for policy 1, policy_version 1307689 (0.0007) [2023-12-26 10:06:21,180][123090] Updated weights for policy 1, policy_version 1307699 (0.0007) [2023-12-26 10:06:21,254][123090] Updated weights for policy 1, policy_version 1307709 (0.0006) [2023-12-26 10:06:21,593][123091] Updated weights for policy 0, policy_version 1316981 (0.0007) [2023-12-26 10:06:21,665][123091] Updated weights for policy 0, policy_version 1316991 (0.0008) [2023-12-26 10:06:21,732][123091] Updated weights for policy 0, policy_version 1317001 (0.0008) [2023-12-26 10:06:22,079][123090] Updated weights for policy 1, policy_version 1307719 (0.0006) [2023-12-26 10:06:22,134][123090] Updated weights for policy 1, policy_version 1307729 (0.0006) [2023-12-26 10:06:22,186][123090] Updated weights for policy 1, policy_version 1307739 (0.0006) [2023-12-26 10:06:22,591][123091] Updated weights for policy 0, policy_version 1317011 (0.0009) [2023-12-26 10:06:22,658][123091] Updated weights for policy 0, policy_version 1317021 (0.0009) [2023-12-26 10:06:22,715][123091] Updated weights for policy 0, policy_version 1317031 (0.0010) [2023-12-26 10:06:22,876][123090] Updated weights for policy 1, policy_version 1307749 (0.0006) [2023-12-26 10:06:22,937][123090] Updated weights for policy 1, policy_version 1307759 (0.0007) [2023-12-26 10:06:23,000][123090] Updated weights for policy 1, policy_version 1307770 (0.0008) [2023-12-26 10:06:23,614][123091] Updated weights for policy 0, policy_version 1317041 (0.0009) [2023-12-26 10:06:23,665][123091] Updated weights for policy 0, policy_version 1317051 (0.0005) [2023-12-26 10:06:23,728][123091] Updated weights for policy 0, policy_version 1317061 (0.0005) [2023-12-26 10:06:23,778][123090] Updated weights for policy 1, policy_version 1307780 (0.0005) [2023-12-26 10:06:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 671956992. Throughput: 0: 8818.1, 1: 8893.3. Samples: 671940724. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:23,785][121949] Avg episode reward: [(0, '6347.659'), (1, '5190.810')] [2023-12-26 10:06:23,792][123091] Updated weights for policy 0, policy_version 1317071 (0.0006) [2023-12-26 10:06:23,797][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001317072_337174528.pth... [2023-12-26 10:06:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001316016_336904192.pth [2023-12-26 10:06:23,841][123090] Updated weights for policy 1, policy_version 1307790 (0.0005) [2023-12-26 10:06:23,904][123090] Updated weights for policy 1, policy_version 1307800 (0.0006) [2023-12-26 10:06:23,958][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001307808_334798848.pth... [2023-12-26 10:06:23,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001306752_334528512.pth [2023-12-26 10:06:24,597][123091] Updated weights for policy 0, policy_version 1317081 (0.0009) [2023-12-26 10:06:24,635][123090] Updated weights for policy 1, policy_version 1307810 (0.0007) [2023-12-26 10:06:24,664][123091] Updated weights for policy 0, policy_version 1317091 (0.0009) [2023-12-26 10:06:24,688][123090] Updated weights for policy 1, policy_version 1307820 (0.0008) [2023-12-26 10:06:24,722][123091] Updated weights for policy 0, policy_version 1317101 (0.0007) [2023-12-26 10:06:24,738][123090] Updated weights for policy 1, policy_version 1307830 (0.0009) [2023-12-26 10:06:24,788][123090] Updated weights for policy 1, policy_version 1307840 (0.0009) [2023-12-26 10:06:25,334][123091] Updated weights for policy 0, policy_version 1317111 (0.0006) [2023-12-26 10:06:25,404][123091] Updated weights for policy 0, policy_version 1317121 (0.0005) [2023-12-26 10:06:25,459][123091] Updated weights for policy 0, policy_version 1317131 (0.0006) [2023-12-26 10:06:25,682][123090] Updated weights for policy 1, policy_version 1307850 (0.0005) [2023-12-26 10:06:25,739][123090] Updated weights for policy 1, policy_version 1307860 (0.0008) [2023-12-26 10:06:25,820][123090] Updated weights for policy 1, policy_version 1307870 (0.0008) [2023-12-26 10:06:26,152][123091] Updated weights for policy 0, policy_version 1317141 (0.0007) [2023-12-26 10:06:26,207][123091] Updated weights for policy 0, policy_version 1317151 (0.0006) [2023-12-26 10:06:26,264][123091] Updated weights for policy 0, policy_version 1317161 (0.0006) [2023-12-26 10:06:26,621][123090] Updated weights for policy 1, policy_version 1307880 (0.0009) [2023-12-26 10:06:26,674][123090] Updated weights for policy 1, policy_version 1307890 (0.0010) [2023-12-26 10:06:26,725][123090] Updated weights for policy 1, policy_version 1307900 (0.0010) [2023-12-26 10:06:26,958][123091] Updated weights for policy 0, policy_version 1317171 (0.0007) [2023-12-26 10:06:27,019][123091] Updated weights for policy 0, policy_version 1317181 (0.0009) [2023-12-26 10:06:27,074][123091] Updated weights for policy 0, policy_version 1317191 (0.0009) [2023-12-26 10:06:27,574][123090] Updated weights for policy 1, policy_version 1307910 (0.0010) [2023-12-26 10:06:27,629][123090] Updated weights for policy 1, policy_version 1307920 (0.0010) [2023-12-26 10:06:27,687][123090] Updated weights for policy 1, policy_version 1307930 (0.0010) [2023-12-26 10:06:27,902][123091] Updated weights for policy 0, policy_version 1317201 (0.0009) [2023-12-26 10:06:27,972][123091] Updated weights for policy 0, policy_version 1317211 (0.0009) [2023-12-26 10:06:28,039][123091] Updated weights for policy 0, policy_version 1317221 (0.0009) [2023-12-26 10:06:28,109][123091] Updated weights for policy 0, policy_version 1317231 (0.0009) [2023-12-26 10:06:28,522][123090] Updated weights for policy 1, policy_version 1307940 (0.0010) [2023-12-26 10:06:28,596][123090] Updated weights for policy 1, policy_version 1307950 (0.0010) [2023-12-26 10:06:28,658][123090] Updated weights for policy 1, policy_version 1307960 (0.0010) [2023-12-26 10:06:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 672055296. Throughput: 0: 8889.2, 1: 8852.6. Samples: 672048308. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:28,784][121949] Avg episode reward: [(0, '6431.494'), (1, '5270.425')] [2023-12-26 10:06:28,912][123091] Updated weights for policy 0, policy_version 1317241 (0.0009) [2023-12-26 10:06:28,970][123091] Updated weights for policy 0, policy_version 1317251 (0.0009) [2023-12-26 10:06:29,033][123091] Updated weights for policy 0, policy_version 1317261 (0.0009) [2023-12-26 10:06:29,491][123090] Updated weights for policy 1, policy_version 1307970 (0.0010) [2023-12-26 10:06:29,542][123090] Updated weights for policy 1, policy_version 1307980 (0.0009) [2023-12-26 10:06:29,599][123090] Updated weights for policy 1, policy_version 1307990 (0.0009) [2023-12-26 10:06:29,656][123090] Updated weights for policy 1, policy_version 1308000 (0.0008) [2023-12-26 10:06:29,884][123091] Updated weights for policy 0, policy_version 1317271 (0.0009) [2023-12-26 10:06:29,952][123091] Updated weights for policy 0, policy_version 1317281 (0.0007) [2023-12-26 10:06:30,015][123091] Updated weights for policy 0, policy_version 1317291 (0.0008) [2023-12-26 10:06:30,476][123090] Updated weights for policy 1, policy_version 1308010 (0.0009) [2023-12-26 10:06:30,545][123090] Updated weights for policy 1, policy_version 1308020 (0.0009) [2023-12-26 10:06:30,612][123090] Updated weights for policy 1, policy_version 1308030 (0.0009) [2023-12-26 10:06:30,789][123091] Updated weights for policy 0, policy_version 1317301 (0.0009) [2023-12-26 10:06:30,842][123091] Updated weights for policy 0, policy_version 1317311 (0.0009) [2023-12-26 10:06:30,898][123091] Updated weights for policy 0, policy_version 1317321 (0.0009) [2023-12-26 10:06:31,458][123090] Updated weights for policy 1, policy_version 1308040 (0.0009) [2023-12-26 10:06:31,521][123090] Updated weights for policy 1, policy_version 1308050 (0.0010) [2023-12-26 10:06:31,580][123090] Updated weights for policy 1, policy_version 1308060 (0.0010) [2023-12-26 10:06:31,733][123091] Updated weights for policy 0, policy_version 1317331 (0.0009) [2023-12-26 10:06:31,786][123091] Updated weights for policy 0, policy_version 1317341 (0.0006) [2023-12-26 10:06:31,843][123091] Updated weights for policy 0, policy_version 1317351 (0.0007) [2023-12-26 10:06:32,446][123090] Updated weights for policy 1, policy_version 1308070 (0.0011) [2023-12-26 10:06:32,508][123090] Updated weights for policy 1, policy_version 1308080 (0.0010) [2023-12-26 10:06:32,574][123090] Updated weights for policy 1, policy_version 1308090 (0.0010) [2023-12-26 10:06:32,599][123091] Updated weights for policy 0, policy_version 1317361 (0.0006) [2023-12-26 10:06:32,669][123091] Updated weights for policy 0, policy_version 1317371 (0.0008) [2023-12-26 10:06:32,743][123091] Updated weights for policy 0, policy_version 1317381 (0.0009) [2023-12-26 10:06:32,809][123091] Updated weights for policy 0, policy_version 1317391 (0.0009) [2023-12-26 10:06:33,382][123090] Updated weights for policy 1, policy_version 1308100 (0.0011) [2023-12-26 10:06:33,450][123090] Updated weights for policy 1, policy_version 1308110 (0.0010) [2023-12-26 10:06:33,501][123090] Updated weights for policy 1, policy_version 1308120 (0.0010) [2023-12-26 10:06:33,513][123091] Updated weights for policy 0, policy_version 1317401 (0.0010) [2023-12-26 10:06:33,564][123091] Updated weights for policy 0, policy_version 1317411 (0.0010) [2023-12-26 10:06:33,616][123091] Updated weights for policy 0, policy_version 1317421 (0.0010) [2023-12-26 10:06:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 672145408. Throughput: 0: 8836.4, 1: 8734.0. Samples: 672152020. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:33,785][121949] Avg episode reward: [(0, '6373.634'), (1, '5291.733')] [2023-12-26 10:06:34,287][123090] Updated weights for policy 1, policy_version 1308130 (0.0010) [2023-12-26 10:06:34,339][123090] Updated weights for policy 1, policy_version 1308140 (0.0010) [2023-12-26 10:06:34,405][123090] Updated weights for policy 1, policy_version 1308150 (0.0010) [2023-12-26 10:06:34,452][123091] Updated weights for policy 0, policy_version 1317431 (0.0011) [2023-12-26 10:06:34,469][123090] Updated weights for policy 1, policy_version 1308160 (0.0011) [2023-12-26 10:06:34,511][123091] Updated weights for policy 0, policy_version 1317441 (0.0011) [2023-12-26 10:06:34,570][123091] Updated weights for policy 0, policy_version 1317451 (0.0011) [2023-12-26 10:06:35,180][123090] Updated weights for policy 1, policy_version 1308170 (0.0010) [2023-12-26 10:06:35,239][123090] Updated weights for policy 1, policy_version 1308180 (0.0010) [2023-12-26 10:06:35,305][123090] Updated weights for policy 1, policy_version 1308190 (0.0010) [2023-12-26 10:06:35,378][123091] Updated weights for policy 0, policy_version 1317461 (0.0011) [2023-12-26 10:06:35,433][123091] Updated weights for policy 0, policy_version 1317471 (0.0010) [2023-12-26 10:06:35,481][123091] Updated weights for policy 0, policy_version 1317481 (0.0010) [2023-12-26 10:06:36,128][123090] Updated weights for policy 1, policy_version 1308200 (0.0008) [2023-12-26 10:06:36,191][123090] Updated weights for policy 1, policy_version 1308210 (0.0008) [2023-12-26 10:06:36,251][123091] Updated weights for policy 0, policy_version 1317491 (0.0009) [2023-12-26 10:06:36,261][123090] Updated weights for policy 1, policy_version 1308220 (0.0008) [2023-12-26 10:06:36,317][123091] Updated weights for policy 0, policy_version 1317501 (0.0006) [2023-12-26 10:06:36,383][123091] Updated weights for policy 0, policy_version 1317511 (0.0007) [2023-12-26 10:06:37,037][123090] Updated weights for policy 1, policy_version 1308230 (0.0007) [2023-12-26 10:06:37,099][123090] Updated weights for policy 1, policy_version 1308240 (0.0006) [2023-12-26 10:06:37,120][123091] Updated weights for policy 0, policy_version 1317521 (0.0006) [2023-12-26 10:06:37,160][123090] Updated weights for policy 1, policy_version 1308250 (0.0005) [2023-12-26 10:06:37,191][123091] Updated weights for policy 0, policy_version 1317531 (0.0006) [2023-12-26 10:06:37,248][123091] Updated weights for policy 0, policy_version 1317541 (0.0006) [2023-12-26 10:06:37,320][123091] Updated weights for policy 0, policy_version 1317551 (0.0008) [2023-12-26 10:06:37,918][123090] Updated weights for policy 1, policy_version 1308260 (0.0007) [2023-12-26 10:06:37,970][123090] Updated weights for policy 1, policy_version 1308270 (0.0009) [2023-12-26 10:06:37,999][123091] Updated weights for policy 0, policy_version 1317561 (0.0006) [2023-12-26 10:06:38,027][123090] Updated weights for policy 1, policy_version 1308280 (0.0008) [2023-12-26 10:06:38,053][123091] Updated weights for policy 0, policy_version 1317571 (0.0005) [2023-12-26 10:06:38,104][123091] Updated weights for policy 0, policy_version 1317581 (0.0005) [2023-12-26 10:06:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 672227328. Throughput: 0: 8873.9, 1: 8722.5. Samples: 672206144. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:38,785][121949] Avg episode reward: [(0, '6242.084'), (1, '5243.358')] [2023-12-26 10:06:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001308288_334921728.pth... [2023-12-26 10:06:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001307296_334667776.pth [2023-12-26 10:06:38,831][123091] Updated weights for policy 0, policy_version 1317591 (0.0008) [2023-12-26 10:06:38,897][123091] Updated weights for policy 0, policy_version 1317601 (0.0006) [2023-12-26 10:06:38,921][123090] Updated weights for policy 1, policy_version 1308290 (0.0008) [2023-12-26 10:06:38,951][123091] Updated weights for policy 0, policy_version 1317611 (0.0005) [2023-12-26 10:06:38,981][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001317616_337313792.pth... [2023-12-26 10:06:38,986][123090] Updated weights for policy 1, policy_version 1308300 (0.0006) [2023-12-26 10:06:38,987][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001316528_337035264.pth [2023-12-26 10:06:39,053][123090] Updated weights for policy 1, policy_version 1308310 (0.0006) [2023-12-26 10:06:39,114][123090] Updated weights for policy 1, policy_version 1308320 (0.0006) [2023-12-26 10:06:39,701][123091] Updated weights for policy 0, policy_version 1317621 (0.0008) [2023-12-26 10:06:39,761][123091] Updated weights for policy 0, policy_version 1317631 (0.0011) [2023-12-26 10:06:39,825][123091] Updated weights for policy 0, policy_version 1317641 (0.0011) [2023-12-26 10:06:39,841][123090] Updated weights for policy 1, policy_version 1308330 (0.0010) [2023-12-26 10:06:39,903][123090] Updated weights for policy 1, policy_version 1308340 (0.0010) [2023-12-26 10:06:39,970][123090] Updated weights for policy 1, policy_version 1308350 (0.0011) [2023-12-26 10:06:40,650][123091] Updated weights for policy 0, policy_version 1317651 (0.0011) [2023-12-26 10:06:40,703][123091] Updated weights for policy 0, policy_version 1317661 (0.0011) [2023-12-26 10:06:40,756][123091] Updated weights for policy 0, policy_version 1317671 (0.0011) [2023-12-26 10:06:40,811][123090] Updated weights for policy 1, policy_version 1308360 (0.0010) [2023-12-26 10:06:40,884][123090] Updated weights for policy 1, policy_version 1308370 (0.0005) [2023-12-26 10:06:40,957][123090] Updated weights for policy 1, policy_version 1308380 (0.0005) [2023-12-26 10:06:41,551][123091] Updated weights for policy 0, policy_version 1317681 (0.0010) [2023-12-26 10:06:41,624][123091] Updated weights for policy 0, policy_version 1317691 (0.0006) [2023-12-26 10:06:41,691][123090] Updated weights for policy 1, policy_version 1308390 (0.0007) [2023-12-26 10:06:41,693][123091] Updated weights for policy 0, policy_version 1317701 (0.0008) [2023-12-26 10:06:41,764][123091] Updated weights for policy 0, policy_version 1317711 (0.0009) [2023-12-26 10:06:41,765][123090] Updated weights for policy 1, policy_version 1308400 (0.0007) [2023-12-26 10:06:41,829][123090] Updated weights for policy 1, policy_version 1308410 (0.0009) [2023-12-26 10:06:42,476][123091] Updated weights for policy 0, policy_version 1317721 (0.0010) [2023-12-26 10:06:42,536][123091] Updated weights for policy 0, policy_version 1317731 (0.0011) [2023-12-26 10:06:42,592][123091] Updated weights for policy 0, policy_version 1317741 (0.0011) [2023-12-26 10:06:42,616][123090] Updated weights for policy 1, policy_version 1308420 (0.0008) [2023-12-26 10:06:42,681][123090] Updated weights for policy 1, policy_version 1308430 (0.0009) [2023-12-26 10:06:42,746][123090] Updated weights for policy 1, policy_version 1308440 (0.0009) [2023-12-26 10:06:43,384][123091] Updated weights for policy 0, policy_version 1317751 (0.0011) [2023-12-26 10:06:43,432][123091] Updated weights for policy 0, policy_version 1317761 (0.0010) [2023-12-26 10:06:43,487][123091] Updated weights for policy 0, policy_version 1317771 (0.0011) [2023-12-26 10:06:43,592][123090] Updated weights for policy 1, policy_version 1308450 (0.0009) [2023-12-26 10:06:43,661][123090] Updated weights for policy 1, policy_version 1308460 (0.0008) [2023-12-26 10:06:43,733][123090] Updated weights for policy 1, policy_version 1308470 (0.0007) [2023-12-26 10:06:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 672317440. Throughput: 0: 8947.9, 1: 8746.3. Samples: 672313152. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:43,785][121949] Avg episode reward: [(0, '6251.974'), (1, '5113.885')] [2023-12-26 10:06:43,807][123090] Updated weights for policy 1, policy_version 1308480 (0.0008) [2023-12-26 10:06:44,204][123091] Updated weights for policy 0, policy_version 1317781 (0.0010) [2023-12-26 10:06:44,269][123091] Updated weights for policy 0, policy_version 1317791 (0.0010) [2023-12-26 10:06:44,333][123091] Updated weights for policy 0, policy_version 1317801 (0.0009) [2023-12-26 10:06:44,471][123090] Updated weights for policy 1, policy_version 1308490 (0.0005) [2023-12-26 10:06:44,528][123090] Updated weights for policy 1, policy_version 1308500 (0.0005) [2023-12-26 10:06:44,591][123090] Updated weights for policy 1, policy_version 1308510 (0.0007) [2023-12-26 10:06:45,195][123091] Updated weights for policy 0, policy_version 1317811 (0.0009) [2023-12-26 10:06:45,248][123091] Updated weights for policy 0, policy_version 1317821 (0.0009) [2023-12-26 10:06:45,307][123091] Updated weights for policy 0, policy_version 1317831 (0.0010) [2023-12-26 10:06:45,397][123090] Updated weights for policy 1, policy_version 1308520 (0.0009) [2023-12-26 10:06:45,459][123090] Updated weights for policy 1, policy_version 1308530 (0.0007) [2023-12-26 10:06:45,528][123090] Updated weights for policy 1, policy_version 1308540 (0.0006) [2023-12-26 10:06:46,125][123091] Updated weights for policy 0, policy_version 1317841 (0.0009) [2023-12-26 10:06:46,195][123091] Updated weights for policy 0, policy_version 1317851 (0.0008) [2023-12-26 10:06:46,258][123091] Updated weights for policy 0, policy_version 1317861 (0.0010) [2023-12-26 10:06:46,320][123091] Updated weights for policy 0, policy_version 1317871 (0.0011) [2023-12-26 10:06:46,360][123090] Updated weights for policy 1, policy_version 1308550 (0.0010) [2023-12-26 10:06:46,426][123090] Updated weights for policy 1, policy_version 1308560 (0.0010) [2023-12-26 10:06:46,503][123090] Updated weights for policy 1, policy_version 1308570 (0.0010) [2023-12-26 10:06:46,978][123091] Updated weights for policy 0, policy_version 1317881 (0.0007) [2023-12-26 10:06:47,034][123091] Updated weights for policy 0, policy_version 1317891 (0.0007) [2023-12-26 10:06:47,099][123091] Updated weights for policy 0, policy_version 1317901 (0.0006) [2023-12-26 10:06:47,184][123090] Updated weights for policy 1, policy_version 1308580 (0.0008) [2023-12-26 10:06:47,240][123090] Updated weights for policy 1, policy_version 1308590 (0.0005) [2023-12-26 10:06:47,311][123090] Updated weights for policy 1, policy_version 1308600 (0.0005) [2023-12-26 10:06:47,804][123091] Updated weights for policy 0, policy_version 1317911 (0.0007) [2023-12-26 10:06:47,851][123091] Updated weights for policy 0, policy_version 1317921 (0.0010) [2023-12-26 10:06:47,902][123091] Updated weights for policy 0, policy_version 1317931 (0.0010) [2023-12-26 10:06:47,955][123090] Updated weights for policy 1, policy_version 1308610 (0.0006) [2023-12-26 10:06:48,022][123090] Updated weights for policy 1, policy_version 1308620 (0.0006) [2023-12-26 10:06:48,093][123090] Updated weights for policy 1, policy_version 1308630 (0.0005) [2023-12-26 10:06:48,155][123090] Updated weights for policy 1, policy_version 1308640 (0.0005) [2023-12-26 10:06:48,767][123091] Updated weights for policy 0, policy_version 1317941 (0.0010) [2023-12-26 10:06:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 672407552. Throughput: 0: 9000.9, 1: 8847.9. Samples: 672423892. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:48,785][121949] Avg episode reward: [(0, '6313.659'), (1, '5290.593')] [2023-12-26 10:06:48,822][123091] Updated weights for policy 0, policy_version 1317951 (0.0010) [2023-12-26 10:06:48,877][123091] Updated weights for policy 0, policy_version 1317961 (0.0010) [2023-12-26 10:06:48,913][123090] Updated weights for policy 1, policy_version 1308650 (0.0010) [2023-12-26 10:06:48,957][123090] Updated weights for policy 1, policy_version 1308660 (0.0010) [2023-12-26 10:06:49,005][123090] Updated weights for policy 1, policy_version 1308670 (0.0010) [2023-12-26 10:06:49,719][123091] Updated weights for policy 0, policy_version 1317971 (0.0011) [2023-12-26 10:06:49,779][123091] Updated weights for policy 0, policy_version 1317981 (0.0011) [2023-12-26 10:06:49,845][123091] Updated weights for policy 0, policy_version 1317991 (0.0010) [2023-12-26 10:06:49,886][123090] Updated weights for policy 1, policy_version 1308680 (0.0010) [2023-12-26 10:06:49,952][123090] Updated weights for policy 1, policy_version 1308690 (0.0010) [2023-12-26 10:06:50,012][123090] Updated weights for policy 1, policy_version 1308700 (0.0006) [2023-12-26 10:06:50,673][123091] Updated weights for policy 0, policy_version 1318001 (0.0007) [2023-12-26 10:06:50,733][123091] Updated weights for policy 0, policy_version 1318011 (0.0010) [2023-12-26 10:06:50,793][123091] Updated weights for policy 0, policy_version 1318021 (0.0009) [2023-12-26 10:06:50,802][123090] Updated weights for policy 1, policy_version 1308710 (0.0006) [2023-12-26 10:06:50,848][123091] Updated weights for policy 0, policy_version 1318031 (0.0008) [2023-12-26 10:06:50,869][123090] Updated weights for policy 1, policy_version 1308720 (0.0008) [2023-12-26 10:06:50,926][123090] Updated weights for policy 1, policy_version 1308730 (0.0009) [2023-12-26 10:06:51,627][123091] Updated weights for policy 0, policy_version 1318041 (0.0008) [2023-12-26 10:06:51,691][123091] Updated weights for policy 0, policy_version 1318051 (0.0010) [2023-12-26 10:06:51,763][123091] Updated weights for policy 0, policy_version 1318061 (0.0010) [2023-12-26 10:06:51,794][123090] Updated weights for policy 1, policy_version 1308740 (0.0009) [2023-12-26 10:06:51,861][123090] Updated weights for policy 1, policy_version 1308750 (0.0010) [2023-12-26 10:06:51,922][123090] Updated weights for policy 1, policy_version 1308760 (0.0009) [2023-12-26 10:06:52,591][123091] Updated weights for policy 0, policy_version 1318071 (0.0009) [2023-12-26 10:06:52,648][123091] Updated weights for policy 0, policy_version 1318081 (0.0009) [2023-12-26 10:06:52,707][123091] Updated weights for policy 0, policy_version 1318091 (0.0009) [2023-12-26 10:06:52,770][123090] Updated weights for policy 1, policy_version 1308770 (0.0009) [2023-12-26 10:06:52,825][123090] Updated weights for policy 1, policy_version 1308780 (0.0009) [2023-12-26 10:06:52,890][123090] Updated weights for policy 1, policy_version 1308790 (0.0010) [2023-12-26 10:06:52,961][123090] Updated weights for policy 1, policy_version 1308800 (0.0007) [2023-12-26 10:06:53,583][123091] Updated weights for policy 0, policy_version 1318101 (0.0009) [2023-12-26 10:06:53,634][123091] Updated weights for policy 0, policy_version 1318111 (0.0008) [2023-12-26 10:06:53,653][123090] Updated weights for policy 1, policy_version 1308810 (0.0009) [2023-12-26 10:06:53,687][123091] Updated weights for policy 0, policy_version 1318121 (0.0007) [2023-12-26 10:06:53,717][123090] Updated weights for policy 1, policy_version 1308820 (0.0010) [2023-12-26 10:06:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 672497664. Throughput: 0: 9016.6, 1: 8829.5. Samples: 672475604. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:53,786][121949] Avg episode reward: [(0, '6349.308'), (1, '5599.592')] [2023-12-26 10:06:53,786][123090] Updated weights for policy 1, policy_version 1308830 (0.0010) [2023-12-26 10:06:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001318128_337444864.pth... [2023-12-26 10:06:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001317072_337174528.pth [2023-12-26 10:06:53,800][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001308832_335060992.pth... [2023-12-26 10:06:53,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001307808_334798848.pth [2023-12-26 10:06:54,484][123090] Updated weights for policy 1, policy_version 1308840 (0.0007) [2023-12-26 10:06:54,519][123091] Updated weights for policy 0, policy_version 1318131 (0.0008) [2023-12-26 10:06:54,542][123090] Updated weights for policy 1, policy_version 1308850 (0.0006) [2023-12-26 10:06:54,588][123091] Updated weights for policy 0, policy_version 1318141 (0.0009) [2023-12-26 10:06:54,611][123090] Updated weights for policy 1, policy_version 1308860 (0.0006) [2023-12-26 10:06:54,660][123091] Updated weights for policy 0, policy_version 1318151 (0.0009) [2023-12-26 10:06:55,316][123090] Updated weights for policy 1, policy_version 1308870 (0.0008) [2023-12-26 10:06:55,367][123090] Updated weights for policy 1, policy_version 1308880 (0.0009) [2023-12-26 10:06:55,431][123090] Updated weights for policy 1, policy_version 1308890 (0.0009) [2023-12-26 10:06:55,534][123091] Updated weights for policy 0, policy_version 1318161 (0.0010) [2023-12-26 10:06:55,601][123091] Updated weights for policy 0, policy_version 1318171 (0.0010) [2023-12-26 10:06:55,666][123091] Updated weights for policy 0, policy_version 1318181 (0.0009) [2023-12-26 10:06:55,724][123091] Updated weights for policy 0, policy_version 1318191 (0.0009) [2023-12-26 10:06:56,254][123090] Updated weights for policy 1, policy_version 1308900 (0.0009) [2023-12-26 10:06:56,307][123090] Updated weights for policy 1, policy_version 1308910 (0.0009) [2023-12-26 10:06:56,373][123090] Updated weights for policy 1, policy_version 1308920 (0.0009) [2023-12-26 10:06:56,578][123091] Updated weights for policy 0, policy_version 1318201 (0.0010) [2023-12-26 10:06:56,634][123091] Updated weights for policy 0, policy_version 1318211 (0.0010) [2023-12-26 10:06:56,688][123091] Updated weights for policy 0, policy_version 1318221 (0.0009) [2023-12-26 10:06:57,131][123090] Updated weights for policy 1, policy_version 1308930 (0.0009) [2023-12-26 10:06:57,190][123090] Updated weights for policy 1, policy_version 1308940 (0.0010) [2023-12-26 10:06:57,244][123090] Updated weights for policy 1, policy_version 1308950 (0.0010) [2023-12-26 10:06:57,299][123090] Updated weights for policy 1, policy_version 1308960 (0.0010) [2023-12-26 10:06:57,553][123091] Updated weights for policy 0, policy_version 1318231 (0.0009) [2023-12-26 10:06:57,604][123091] Updated weights for policy 0, policy_version 1318242 (0.0009) [2023-12-26 10:06:57,653][123091] Updated weights for policy 0, policy_version 1318252 (0.0009) [2023-12-26 10:06:58,071][123090] Updated weights for policy 1, policy_version 1308970 (0.0010) [2023-12-26 10:06:58,142][123090] Updated weights for policy 1, policy_version 1308980 (0.0010) [2023-12-26 10:06:58,219][123090] Updated weights for policy 1, policy_version 1308990 (0.0011) [2023-12-26 10:06:58,521][123091] Updated weights for policy 0, policy_version 1318262 (0.0009) [2023-12-26 10:06:58,587][123091] Updated weights for policy 0, policy_version 1318272 (0.0010) [2023-12-26 10:06:58,656][123091] Updated weights for policy 0, policy_version 1318282 (0.0009) [2023-12-26 10:06:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 672587776. Throughput: 0: 8932.6, 1: 8861.8. Samples: 672580656. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:06:58,785][121949] Avg episode reward: [(0, '6346.703'), (1, '5606.962')] [2023-12-26 10:06:59,071][123090] Updated weights for policy 1, policy_version 1309000 (0.0010) [2023-12-26 10:06:59,137][123090] Updated weights for policy 1, policy_version 1309010 (0.0009) [2023-12-26 10:06:59,207][123090] Updated weights for policy 1, policy_version 1309020 (0.0009) [2023-12-26 10:06:59,599][123091] Updated weights for policy 0, policy_version 1318292 (0.0009) [2023-12-26 10:06:59,660][123091] Updated weights for policy 0, policy_version 1318302 (0.0009) [2023-12-26 10:06:59,715][123091] Updated weights for policy 0, policy_version 1318312 (0.0010) [2023-12-26 10:07:00,045][123090] Updated weights for policy 1, policy_version 1309030 (0.0007) [2023-12-26 10:07:00,103][123090] Updated weights for policy 1, policy_version 1309040 (0.0005) [2023-12-26 10:07:00,176][123090] Updated weights for policy 1, policy_version 1309050 (0.0009) [2023-12-26 10:07:00,498][123091] Updated weights for policy 0, policy_version 1318322 (0.0009) [2023-12-26 10:07:00,570][123091] Updated weights for policy 0, policy_version 1318332 (0.0009) [2023-12-26 10:07:00,642][123091] Updated weights for policy 0, policy_version 1318342 (0.0011) [2023-12-26 10:07:00,719][123091] Updated weights for policy 0, policy_version 1318352 (0.0005) [2023-12-26 10:07:00,905][123090] Updated weights for policy 1, policy_version 1309060 (0.0008) [2023-12-26 10:07:00,955][123090] Updated weights for policy 1, policy_version 1309070 (0.0005) [2023-12-26 10:07:01,023][123090] Updated weights for policy 1, policy_version 1309080 (0.0006) [2023-12-26 10:07:01,367][123091] Updated weights for policy 0, policy_version 1318362 (0.0011) [2023-12-26 10:07:01,430][123091] Updated weights for policy 0, policy_version 1318372 (0.0010) [2023-12-26 10:07:01,475][123091] Updated weights for policy 0, policy_version 1318382 (0.0007) [2023-12-26 10:07:01,796][123090] Updated weights for policy 1, policy_version 1309090 (0.0006) [2023-12-26 10:07:01,857][123090] Updated weights for policy 1, policy_version 1309100 (0.0009) [2023-12-26 10:07:01,908][123090] Updated weights for policy 1, policy_version 1309110 (0.0006) [2023-12-26 10:07:01,955][123090] Updated weights for policy 1, policy_version 1309120 (0.0010) [2023-12-26 10:07:02,264][123091] Updated weights for policy 0, policy_version 1318392 (0.0009) [2023-12-26 10:07:02,333][123091] Updated weights for policy 0, policy_version 1318402 (0.0009) [2023-12-26 10:07:02,393][123091] Updated weights for policy 0, policy_version 1318412 (0.0010) [2023-12-26 10:07:02,777][123090] Updated weights for policy 1, policy_version 1309130 (0.0005) [2023-12-26 10:07:02,864][123090] Updated weights for policy 1, policy_version 1309140 (0.0007) [2023-12-26 10:07:02,919][123090] Updated weights for policy 1, policy_version 1309150 (0.0009) [2023-12-26 10:07:03,189][123091] Updated weights for policy 0, policy_version 1318422 (0.0007) [2023-12-26 10:07:03,248][123091] Updated weights for policy 0, policy_version 1318432 (0.0008) [2023-12-26 10:07:03,308][123091] Updated weights for policy 0, policy_version 1318442 (0.0010) [2023-12-26 10:07:03,653][123090] Updated weights for policy 1, policy_version 1309160 (0.0007) [2023-12-26 10:07:03,713][123090] Updated weights for policy 1, policy_version 1309170 (0.0007) [2023-12-26 10:07:03,777][123090] Updated weights for policy 1, policy_version 1309180 (0.0008) [2023-12-26 10:07:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 672669696. Throughput: 0: 8865.2, 1: 8889.6. Samples: 672685912. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:07:03,784][121949] Avg episode reward: [(0, '6373.632'), (1, '5447.193')] [2023-12-26 10:07:04,121][123091] Updated weights for policy 0, policy_version 1318452 (0.0010) [2023-12-26 10:07:04,190][123091] Updated weights for policy 0, policy_version 1318462 (0.0009) [2023-12-26 10:07:04,253][123091] Updated weights for policy 0, policy_version 1318472 (0.0010) [2023-12-26 10:07:04,563][123090] Updated weights for policy 1, policy_version 1309190 (0.0010) [2023-12-26 10:07:04,622][123090] Updated weights for policy 1, policy_version 1309201 (0.0010) [2023-12-26 10:07:04,680][123090] Updated weights for policy 1, policy_version 1309211 (0.0009) [2023-12-26 10:07:05,095][123091] Updated weights for policy 0, policy_version 1318482 (0.0009) [2023-12-26 10:07:05,145][123091] Updated weights for policy 0, policy_version 1318493 (0.0010) [2023-12-26 10:07:05,199][123091] Updated weights for policy 0, policy_version 1318503 (0.0009) [2023-12-26 10:07:05,472][123090] Updated weights for policy 1, policy_version 1309221 (0.0009) [2023-12-26 10:07:05,520][123090] Updated weights for policy 1, policy_version 1309231 (0.0009) [2023-12-26 10:07:05,577][123090] Updated weights for policy 1, policy_version 1309241 (0.0010) [2023-12-26 10:07:06,071][123091] Updated weights for policy 0, policy_version 1318513 (0.0009) [2023-12-26 10:07:06,131][123091] Updated weights for policy 0, policy_version 1318523 (0.0010) [2023-12-26 10:07:06,183][123091] Updated weights for policy 0, policy_version 1318533 (0.0010) [2023-12-26 10:07:06,234][123091] Updated weights for policy 0, policy_version 1318543 (0.0009) [2023-12-26 10:07:06,346][123090] Updated weights for policy 1, policy_version 1309251 (0.0008) [2023-12-26 10:07:06,409][123090] Updated weights for policy 1, policy_version 1309261 (0.0005) [2023-12-26 10:07:06,468][123090] Updated weights for policy 1, policy_version 1309271 (0.0006) [2023-12-26 10:07:07,131][123091] Updated weights for policy 0, policy_version 1318553 (0.0009) [2023-12-26 10:07:07,192][123091] Updated weights for policy 0, policy_version 1318563 (0.0009) [2023-12-26 10:07:07,256][123091] Updated weights for policy 0, policy_version 1318573 (0.0009) [2023-12-26 10:07:07,266][123090] Updated weights for policy 1, policy_version 1309281 (0.0006) [2023-12-26 10:07:07,336][123090] Updated weights for policy 1, policy_version 1309291 (0.0010) [2023-12-26 10:07:07,403][123090] Updated weights for policy 1, policy_version 1309301 (0.0010) [2023-12-26 10:07:07,466][123090] Updated weights for policy 1, policy_version 1309311 (0.0010) [2023-12-26 10:07:08,079][123091] Updated weights for policy 0, policy_version 1318583 (0.0006) [2023-12-26 10:07:08,140][123091] Updated weights for policy 0, policy_version 1318593 (0.0009) [2023-12-26 10:07:08,205][123091] Updated weights for policy 0, policy_version 1318603 (0.0009) [2023-12-26 10:07:08,277][123090] Updated weights for policy 1, policy_version 1309321 (0.0009) [2023-12-26 10:07:08,342][123090] Updated weights for policy 1, policy_version 1309331 (0.0009) [2023-12-26 10:07:08,401][123090] Updated weights for policy 1, policy_version 1309341 (0.0009) [2023-12-26 10:07:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 672759808. Throughput: 0: 8816.7, 1: 8877.4. Samples: 672736960. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:07:08,785][121949] Avg episode reward: [(0, '6377.203'), (1, '5538.406')] [2023-12-26 10:07:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001318608_337567744.pth... [2023-12-26 10:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001309344_335192064.pth... [2023-12-26 10:07:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001317616_337313792.pth [2023-12-26 10:07:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001308288_334921728.pth [2023-12-26 10:07:09,035][123091] Updated weights for policy 0, policy_version 1318613 (0.0009) [2023-12-26 10:07:09,100][123091] Updated weights for policy 0, policy_version 1318623 (0.0009) [2023-12-26 10:07:09,158][123091] Updated weights for policy 0, policy_version 1318633 (0.0008) [2023-12-26 10:07:09,224][123090] Updated weights for policy 1, policy_version 1309351 (0.0009) [2023-12-26 10:07:09,300][123090] Updated weights for policy 1, policy_version 1309361 (0.0009) [2023-12-26 10:07:09,372][123090] Updated weights for policy 1, policy_version 1309371 (0.0009) [2023-12-26 10:07:10,029][123091] Updated weights for policy 0, policy_version 1318643 (0.0009) [2023-12-26 10:07:10,086][123091] Updated weights for policy 0, policy_version 1318653 (0.0010) [2023-12-26 10:07:10,149][123091] Updated weights for policy 0, policy_version 1318663 (0.0008) [2023-12-26 10:07:10,216][123090] Updated weights for policy 1, policy_version 1309381 (0.0007) [2023-12-26 10:07:10,295][123090] Updated weights for policy 1, policy_version 1309391 (0.0006) [2023-12-26 10:07:10,362][123090] Updated weights for policy 1, policy_version 1309401 (0.0008) [2023-12-26 10:07:10,957][123091] Updated weights for policy 0, policy_version 1318673 (0.0007) [2023-12-26 10:07:11,032][123091] Updated weights for policy 0, policy_version 1318683 (0.0006) [2023-12-26 10:07:11,088][123090] Updated weights for policy 1, policy_version 1309411 (0.0008) [2023-12-26 10:07:11,099][123091] Updated weights for policy 0, policy_version 1318693 (0.0009) [2023-12-26 10:07:11,158][123090] Updated weights for policy 1, policy_version 1309421 (0.0007) [2023-12-26 10:07:11,169][123091] Updated weights for policy 0, policy_version 1318703 (0.0010) [2023-12-26 10:07:11,218][123090] Updated weights for policy 1, policy_version 1309431 (0.0006) [2023-12-26 10:07:11,992][123090] Updated weights for policy 1, policy_version 1309441 (0.0007) [2023-12-26 10:07:12,041][123091] Updated weights for policy 0, policy_version 1318713 (0.0010) [2023-12-26 10:07:12,062][123090] Updated weights for policy 1, policy_version 1309451 (0.0007) [2023-12-26 10:07:12,103][123091] Updated weights for policy 0, policy_version 1318723 (0.0009) [2023-12-26 10:07:12,128][123090] Updated weights for policy 1, policy_version 1309461 (0.0007) [2023-12-26 10:07:12,159][123091] Updated weights for policy 0, policy_version 1318733 (0.0009) [2023-12-26 10:07:12,195][123090] Updated weights for policy 1, policy_version 1309471 (0.0008) [2023-12-26 10:07:12,972][123090] Updated weights for policy 1, policy_version 1309481 (0.0009) [2023-12-26 10:07:13,041][123090] Updated weights for policy 1, policy_version 1309491 (0.0009) [2023-12-26 10:07:13,052][123091] Updated weights for policy 0, policy_version 1318743 (0.0007) [2023-12-26 10:07:13,103][123091] Updated weights for policy 0, policy_version 1318753 (0.0009) [2023-12-26 10:07:13,106][123090] Updated weights for policy 1, policy_version 1309501 (0.0009) [2023-12-26 10:07:13,151][123091] Updated weights for policy 0, policy_version 1318763 (0.0009) [2023-12-26 10:07:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 672841728. Throughput: 0: 8718.0, 1: 8844.4. Samples: 672838620. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 10:07:13,785][121949] Avg episode reward: [(0, '6386.408'), (1, '5723.473')] [2023-12-26 10:07:13,860][123090] Updated weights for policy 1, policy_version 1309511 (0.0008) [2023-12-26 10:07:13,910][123090] Updated weights for policy 1, policy_version 1309521 (0.0010) [2023-12-26 10:07:13,961][123090] Updated weights for policy 1, policy_version 1309532 (0.0009) [2023-12-26 10:07:14,008][123091] Updated weights for policy 0, policy_version 1318774 (0.0009) [2023-12-26 10:07:14,064][123091] Updated weights for policy 0, policy_version 1318784 (0.0009) [2023-12-26 10:07:14,112][123091] Updated weights for policy 0, policy_version 1318794 (0.0009) [2023-12-26 10:07:14,843][123090] Updated weights for policy 1, policy_version 1309542 (0.0009) [2023-12-26 10:07:14,906][123090] Updated weights for policy 1, policy_version 1309552 (0.0009) [2023-12-26 10:07:14,954][123091] Updated weights for policy 0, policy_version 1318804 (0.0009) [2023-12-26 10:07:14,964][123090] Updated weights for policy 1, policy_version 1309562 (0.0010) [2023-12-26 10:07:15,021][123091] Updated weights for policy 0, policy_version 1318814 (0.0008) [2023-12-26 10:07:15,091][123091] Updated weights for policy 0, policy_version 1318824 (0.0009) [2023-12-26 10:07:15,811][123090] Updated weights for policy 1, policy_version 1309572 (0.0008) [2023-12-26 10:07:15,864][123090] Updated weights for policy 1, policy_version 1309582 (0.0009) [2023-12-26 10:07:15,919][123090] Updated weights for policy 1, policy_version 1309593 (0.0010) [2023-12-26 10:07:15,926][123091] Updated weights for policy 0, policy_version 1318834 (0.0009) [2023-12-26 10:07:15,984][123091] Updated weights for policy 0, policy_version 1318844 (0.0010) [2023-12-26 10:07:16,038][123091] Updated weights for policy 0, policy_version 1318855 (0.0010) [2023-12-26 10:07:16,744][123090] Updated weights for policy 1, policy_version 1309603 (0.0008) [2023-12-26 10:07:16,793][123090] Updated weights for policy 1, policy_version 1309613 (0.0009) [2023-12-26 10:07:16,845][123090] Updated weights for policy 1, policy_version 1309624 (0.0009) [2023-12-26 10:07:16,893][123091] Updated weights for policy 0, policy_version 1318865 (0.0008) [2023-12-26 10:07:16,944][123091] Updated weights for policy 0, policy_version 1318875 (0.0009) [2023-12-26 10:07:16,997][123091] Updated weights for policy 0, policy_version 1318885 (0.0005) [2023-12-26 10:07:17,064][123091] Updated weights for policy 0, policy_version 1318895 (0.0006) [2023-12-26 10:07:17,746][123090] Updated weights for policy 1, policy_version 1309634 (0.0009) [2023-12-26 10:07:17,810][123090] Updated weights for policy 1, policy_version 1309644 (0.0009) [2023-12-26 10:07:17,833][123091] Updated weights for policy 0, policy_version 1318905 (0.0007) [2023-12-26 10:07:17,873][123090] Updated weights for policy 1, policy_version 1309654 (0.0008) [2023-12-26 10:07:17,884][123091] Updated weights for policy 0, policy_version 1318915 (0.0007) [2023-12-26 10:07:17,930][123091] Updated weights for policy 0, policy_version 1318925 (0.0009) [2023-12-26 10:07:17,932][123090] Updated weights for policy 1, policy_version 1309664 (0.0009) [2023-12-26 10:07:18,742][123091] Updated weights for policy 0, policy_version 1318935 (0.0009) [2023-12-26 10:07:18,770][123090] Updated weights for policy 1, policy_version 1309674 (0.0011) [2023-12-26 10:07:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 672923648. Throughput: 0: 8711.8, 1: 8855.6. Samples: 672942548. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:18,785][121949] Avg episode reward: [(0, '6339.366'), (1, '5560.554')] [2023-12-26 10:07:18,811][123091] Updated weights for policy 0, policy_version 1318945 (0.0006) [2023-12-26 10:07:18,834][123090] Updated weights for policy 1, policy_version 1309684 (0.0010) [2023-12-26 10:07:18,874][123091] Updated weights for policy 0, policy_version 1318955 (0.0006) [2023-12-26 10:07:18,894][123090] Updated weights for policy 1, policy_version 1309694 (0.0011) [2023-12-26 10:07:19,705][123090] Updated weights for policy 1, policy_version 1309704 (0.0010) [2023-12-26 10:07:19,732][123091] Updated weights for policy 0, policy_version 1318965 (0.0009) [2023-12-26 10:07:19,771][123090] Updated weights for policy 1, policy_version 1309714 (0.0011) [2023-12-26 10:07:19,800][123091] Updated weights for policy 0, policy_version 1318975 (0.0008) [2023-12-26 10:07:19,843][123090] Updated weights for policy 1, policy_version 1309724 (0.0011) [2023-12-26 10:07:19,865][123091] Updated weights for policy 0, policy_version 1318985 (0.0008) [2023-12-26 10:07:20,702][123090] Updated weights for policy 1, policy_version 1309734 (0.0009) [2023-12-26 10:07:20,709][123091] Updated weights for policy 0, policy_version 1318995 (0.0009) [2023-12-26 10:07:20,774][123090] Updated weights for policy 1, policy_version 1309744 (0.0007) [2023-12-26 10:07:20,775][123091] Updated weights for policy 0, policy_version 1319005 (0.0009) [2023-12-26 10:07:20,839][123091] Updated weights for policy 0, policy_version 1319015 (0.0009) [2023-12-26 10:07:20,841][123090] Updated weights for policy 1, policy_version 1309754 (0.0007) [2023-12-26 10:07:21,653][123090] Updated weights for policy 1, policy_version 1309764 (0.0008) [2023-12-26 10:07:21,697][123091] Updated weights for policy 0, policy_version 1319025 (0.0008) [2023-12-26 10:07:21,730][123090] Updated weights for policy 1, policy_version 1309774 (0.0008) [2023-12-26 10:07:21,771][123091] Updated weights for policy 0, policy_version 1319035 (0.0009) [2023-12-26 10:07:21,799][123090] Updated weights for policy 1, policy_version 1309784 (0.0008) [2023-12-26 10:07:21,832][123091] Updated weights for policy 0, policy_version 1319045 (0.0008) [2023-12-26 10:07:21,895][123091] Updated weights for policy 0, policy_version 1319055 (0.0009) [2023-12-26 10:07:22,594][123090] Updated weights for policy 1, policy_version 1309794 (0.0008) [2023-12-26 10:07:22,664][123090] Updated weights for policy 1, policy_version 1309804 (0.0010) [2023-12-26 10:07:22,721][123090] Updated weights for policy 1, policy_version 1309814 (0.0009) [2023-12-26 10:07:22,763][123091] Updated weights for policy 0, policy_version 1319065 (0.0007) [2023-12-26 10:07:22,777][123090] Updated weights for policy 1, policy_version 1309824 (0.0008) [2023-12-26 10:07:22,823][123091] Updated weights for policy 0, policy_version 1319075 (0.0009) [2023-12-26 10:07:22,888][123091] Updated weights for policy 0, policy_version 1319085 (0.0010) [2023-12-26 10:07:23,626][123090] Updated weights for policy 1, policy_version 1309834 (0.0009) [2023-12-26 10:07:23,675][123091] Updated weights for policy 0, policy_version 1319095 (0.0007) [2023-12-26 10:07:23,688][123090] Updated weights for policy 1, policy_version 1309844 (0.0009) [2023-12-26 10:07:23,724][123091] Updated weights for policy 0, policy_version 1319105 (0.0005) [2023-12-26 10:07:23,746][123090] Updated weights for policy 1, policy_version 1309854 (0.0008) [2023-12-26 10:07:23,770][123091] Updated weights for policy 0, policy_version 1319115 (0.0005) [2023-12-26 10:07:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 673013760. Throughput: 0: 8663.9, 1: 8820.6. Samples: 672992948. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:23,785][121949] Avg episode reward: [(0, '6323.328'), (1, '5341.187')] [2023-12-26 10:07:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001309856_335323136.pth... [2023-12-26 10:07:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001308832_335060992.pth [2023-12-26 10:07:23,799][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001319120_337698816.pth... [2023-12-26 10:07:23,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001318128_337444864.pth [2023-12-26 10:07:24,454][123091] Updated weights for policy 0, policy_version 1319125 (0.0007) [2023-12-26 10:07:24,472][123090] Updated weights for policy 1, policy_version 1309864 (0.0006) [2023-12-26 10:07:24,526][123091] Updated weights for policy 0, policy_version 1319135 (0.0006) [2023-12-26 10:07:24,542][123090] Updated weights for policy 1, policy_version 1309874 (0.0006) [2023-12-26 10:07:24,594][123091] Updated weights for policy 0, policy_version 1319145 (0.0006) [2023-12-26 10:07:24,611][123090] Updated weights for policy 1, policy_version 1309884 (0.0008) [2023-12-26 10:07:25,343][123091] Updated weights for policy 0, policy_version 1319155 (0.0007) [2023-12-26 10:07:25,389][123090] Updated weights for policy 1, policy_version 1309894 (0.0008) [2023-12-26 10:07:25,395][123091] Updated weights for policy 0, policy_version 1319165 (0.0007) [2023-12-26 10:07:25,441][123090] Updated weights for policy 1, policy_version 1309904 (0.0008) [2023-12-26 10:07:25,450][123091] Updated weights for policy 0, policy_version 1319175 (0.0008) [2023-12-26 10:07:25,496][123090] Updated weights for policy 1, policy_version 1309914 (0.0006) [2023-12-26 10:07:26,318][123090] Updated weights for policy 1, policy_version 1309924 (0.0008) [2023-12-26 10:07:26,332][123091] Updated weights for policy 0, policy_version 1319185 (0.0010) [2023-12-26 10:07:26,369][123090] Updated weights for policy 1, policy_version 1309934 (0.0009) [2023-12-26 10:07:26,376][123091] Updated weights for policy 0, policy_version 1319195 (0.0006) [2023-12-26 10:07:26,425][123090] Updated weights for policy 1, policy_version 1309944 (0.0009) [2023-12-26 10:07:26,428][123091] Updated weights for policy 0, policy_version 1319205 (0.0007) [2023-12-26 10:07:26,484][123091] Updated weights for policy 0, policy_version 1319215 (0.0007) [2023-12-26 10:07:27,151][123090] Updated weights for policy 1, policy_version 1309954 (0.0009) [2023-12-26 10:07:27,207][123090] Updated weights for policy 1, policy_version 1309964 (0.0009) [2023-12-26 10:07:27,263][123090] Updated weights for policy 1, policy_version 1309975 (0.0009) [2023-12-26 10:07:27,351][123091] Updated weights for policy 0, policy_version 1319225 (0.0007) [2023-12-26 10:07:27,415][123091] Updated weights for policy 0, policy_version 1319236 (0.0009) [2023-12-26 10:07:27,479][123091] Updated weights for policy 0, policy_version 1319246 (0.0009) [2023-12-26 10:07:27,975][123090] Updated weights for policy 1, policy_version 1309985 (0.0009) [2023-12-26 10:07:28,038][123090] Updated weights for policy 1, policy_version 1309995 (0.0009) [2023-12-26 10:07:28,091][123090] Updated weights for policy 1, policy_version 1310005 (0.0011) [2023-12-26 10:07:28,148][123090] Updated weights for policy 1, policy_version 1310015 (0.0010) [2023-12-26 10:07:28,305][123091] Updated weights for policy 0, policy_version 1319256 (0.0009) [2023-12-26 10:07:28,368][123091] Updated weights for policy 0, policy_version 1319266 (0.0010) [2023-12-26 10:07:28,429][123091] Updated weights for policy 0, policy_version 1319276 (0.0008) [2023-12-26 10:07:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 673103872. Throughput: 0: 8598.0, 1: 8824.1. Samples: 673097152. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:28,785][121949] Avg episode reward: [(0, '6292.573'), (1, '5420.146')] [2023-12-26 10:07:28,918][123090] Updated weights for policy 1, policy_version 1310025 (0.0010) [2023-12-26 10:07:28,977][123090] Updated weights for policy 1, policy_version 1310035 (0.0010) [2023-12-26 10:07:29,036][123090] Updated weights for policy 1, policy_version 1310045 (0.0010) [2023-12-26 10:07:29,264][123091] Updated weights for policy 0, policy_version 1319286 (0.0009) [2023-12-26 10:07:29,320][123091] Updated weights for policy 0, policy_version 1319296 (0.0008) [2023-12-26 10:07:29,385][123091] Updated weights for policy 0, policy_version 1319306 (0.0008) [2023-12-26 10:07:29,906][123090] Updated weights for policy 1, policy_version 1310055 (0.0009) [2023-12-26 10:07:29,976][123090] Updated weights for policy 1, policy_version 1310065 (0.0010) [2023-12-26 10:07:30,041][123090] Updated weights for policy 1, policy_version 1310075 (0.0009) [2023-12-26 10:07:30,213][123091] Updated weights for policy 0, policy_version 1319316 (0.0009) [2023-12-26 10:07:30,279][123091] Updated weights for policy 0, policy_version 1319326 (0.0009) [2023-12-26 10:07:30,348][123091] Updated weights for policy 0, policy_version 1319336 (0.0009) [2023-12-26 10:07:30,755][123090] Updated weights for policy 1, policy_version 1310085 (0.0009) [2023-12-26 10:07:30,814][123090] Updated weights for policy 1, policy_version 1310095 (0.0006) [2023-12-26 10:07:30,861][123090] Updated weights for policy 1, policy_version 1310105 (0.0005) [2023-12-26 10:07:31,228][123091] Updated weights for policy 0, policy_version 1319346 (0.0008) [2023-12-26 10:07:31,293][123091] Updated weights for policy 0, policy_version 1319356 (0.0009) [2023-12-26 10:07:31,358][123091] Updated weights for policy 0, policy_version 1319366 (0.0010) [2023-12-26 10:07:31,430][123091] Updated weights for policy 0, policy_version 1319376 (0.0009) [2023-12-26 10:07:31,658][123090] Updated weights for policy 1, policy_version 1310115 (0.0007) [2023-12-26 10:07:31,725][123090] Updated weights for policy 1, policy_version 1310125 (0.0008) [2023-12-26 10:07:31,795][123090] Updated weights for policy 1, policy_version 1310135 (0.0011) [2023-12-26 10:07:32,262][123091] Updated weights for policy 0, policy_version 1319387 (0.0010) [2023-12-26 10:07:32,323][123091] Updated weights for policy 0, policy_version 1319397 (0.0009) [2023-12-26 10:07:32,386][123091] Updated weights for policy 0, policy_version 1319407 (0.0009) [2023-12-26 10:07:32,537][123090] Updated weights for policy 1, policy_version 1310145 (0.0010) [2023-12-26 10:07:32,589][123090] Updated weights for policy 1, policy_version 1310155 (0.0010) [2023-12-26 10:07:32,641][123090] Updated weights for policy 1, policy_version 1310165 (0.0010) [2023-12-26 10:07:32,690][123090] Updated weights for policy 1, policy_version 1310175 (0.0010) [2023-12-26 10:07:33,243][123091] Updated weights for policy 0, policy_version 1319417 (0.0009) [2023-12-26 10:07:33,296][123091] Updated weights for policy 0, policy_version 1319427 (0.0009) [2023-12-26 10:07:33,356][123091] Updated weights for policy 0, policy_version 1319438 (0.0009) [2023-12-26 10:07:33,422][123090] Updated weights for policy 1, policy_version 1310185 (0.0008) [2023-12-26 10:07:33,477][123090] Updated weights for policy 1, policy_version 1310195 (0.0005) [2023-12-26 10:07:33,530][123090] Updated weights for policy 1, policy_version 1310205 (0.0008) [2023-12-26 10:07:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 673193984. Throughput: 0: 8486.1, 1: 8828.5. Samples: 673203052. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:33,785][121949] Avg episode reward: [(0, '6343.335'), (1, '5561.374')] [2023-12-26 10:07:34,225][123091] Updated weights for policy 0, policy_version 1319448 (0.0010) [2023-12-26 10:07:34,283][123091] Updated weights for policy 0, policy_version 1319458 (0.0008) [2023-12-26 10:07:34,290][123090] Updated weights for policy 1, policy_version 1310215 (0.0008) [2023-12-26 10:07:34,344][123091] Updated weights for policy 0, policy_version 1319468 (0.0008) [2023-12-26 10:07:34,346][123090] Updated weights for policy 1, policy_version 1310225 (0.0008) [2023-12-26 10:07:34,409][123090] Updated weights for policy 1, policy_version 1310235 (0.0009) [2023-12-26 10:07:35,150][123090] Updated weights for policy 1, policy_version 1310245 (0.0009) [2023-12-26 10:07:35,209][123090] Updated weights for policy 1, policy_version 1310255 (0.0010) [2023-12-26 10:07:35,251][123091] Updated weights for policy 0, policy_version 1319478 (0.0007) [2023-12-26 10:07:35,261][123090] Updated weights for policy 1, policy_version 1310265 (0.0010) [2023-12-26 10:07:35,311][123091] Updated weights for policy 0, policy_version 1319488 (0.0006) [2023-12-26 10:07:35,364][123091] Updated weights for policy 0, policy_version 1319498 (0.0009) [2023-12-26 10:07:35,983][123090] Updated weights for policy 1, policy_version 1310275 (0.0009) [2023-12-26 10:07:36,053][123090] Updated weights for policy 1, policy_version 1310285 (0.0005) [2023-12-26 10:07:36,128][123090] Updated weights for policy 1, policy_version 1310295 (0.0007) [2023-12-26 10:07:36,274][123091] Updated weights for policy 0, policy_version 1319508 (0.0009) [2023-12-26 10:07:36,328][123091] Updated weights for policy 0, policy_version 1319518 (0.0009) [2023-12-26 10:07:36,377][123091] Updated weights for policy 0, policy_version 1319528 (0.0009) [2023-12-26 10:07:36,855][123090] Updated weights for policy 1, policy_version 1310305 (0.0008) [2023-12-26 10:07:36,907][123090] Updated weights for policy 1, policy_version 1310315 (0.0010) [2023-12-26 10:07:36,977][123090] Updated weights for policy 1, policy_version 1310325 (0.0007) [2023-12-26 10:07:37,056][123090] Updated weights for policy 1, policy_version 1310335 (0.0005) [2023-12-26 10:07:37,267][123091] Updated weights for policy 0, policy_version 1319538 (0.0009) [2023-12-26 10:07:37,330][123091] Updated weights for policy 0, policy_version 1319548 (0.0010) [2023-12-26 10:07:37,386][123091] Updated weights for policy 0, policy_version 1319559 (0.0011) [2023-12-26 10:07:37,702][123090] Updated weights for policy 1, policy_version 1310345 (0.0007) [2023-12-26 10:07:37,766][123090] Updated weights for policy 1, policy_version 1310355 (0.0011) [2023-12-26 10:07:37,818][123090] Updated weights for policy 1, policy_version 1310365 (0.0010) [2023-12-26 10:07:38,233][123091] Updated weights for policy 0, policy_version 1319569 (0.0010) [2023-12-26 10:07:38,281][123091] Updated weights for policy 0, policy_version 1319579 (0.0005) [2023-12-26 10:07:38,342][123091] Updated weights for policy 0, policy_version 1319589 (0.0007) [2023-12-26 10:07:38,403][123091] Updated weights for policy 0, policy_version 1319599 (0.0007) [2023-12-26 10:07:38,572][123090] Updated weights for policy 1, policy_version 1310375 (0.0008) [2023-12-26 10:07:38,635][123090] Updated weights for policy 1, policy_version 1310385 (0.0010) [2023-12-26 10:07:38,697][123090] Updated weights for policy 1, policy_version 1310395 (0.0009) [2023-12-26 10:07:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 673284096. Throughput: 0: 8436.2, 1: 8899.7. Samples: 673255716. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:38,785][121949] Avg episode reward: [(0, '6270.283'), (1, '5387.217')] [2023-12-26 10:07:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001319600_337821696.pth... [2023-12-26 10:07:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001310400_335462400.pth... [2023-12-26 10:07:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001309344_335192064.pth [2023-12-26 10:07:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001318608_337567744.pth [2023-12-26 10:07:39,062][123091] Updated weights for policy 0, policy_version 1319609 (0.0006) [2023-12-26 10:07:39,125][123091] Updated weights for policy 0, policy_version 1319619 (0.0011) [2023-12-26 10:07:39,187][123091] Updated weights for policy 0, policy_version 1319629 (0.0011) [2023-12-26 10:07:39,492][123090] Updated weights for policy 1, policy_version 1310405 (0.0009) [2023-12-26 10:07:39,566][123090] Updated weights for policy 1, policy_version 1310415 (0.0006) [2023-12-26 10:07:39,639][123090] Updated weights for policy 1, policy_version 1310425 (0.0006) [2023-12-26 10:07:40,008][123091] Updated weights for policy 0, policy_version 1319639 (0.0011) [2023-12-26 10:07:40,079][123091] Updated weights for policy 0, policy_version 1319649 (0.0011) [2023-12-26 10:07:40,147][123091] Updated weights for policy 0, policy_version 1319659 (0.0011) [2023-12-26 10:07:40,457][123090] Updated weights for policy 1, policy_version 1310435 (0.0007) [2023-12-26 10:07:40,514][123090] Updated weights for policy 1, policy_version 1310445 (0.0009) [2023-12-26 10:07:40,583][123090] Updated weights for policy 1, policy_version 1310455 (0.0009) [2023-12-26 10:07:40,970][123091] Updated weights for policy 0, policy_version 1319669 (0.0011) [2023-12-26 10:07:41,038][123091] Updated weights for policy 0, policy_version 1319679 (0.0011) [2023-12-26 10:07:41,098][123091] Updated weights for policy 0, policy_version 1319689 (0.0011) [2023-12-26 10:07:41,437][123090] Updated weights for policy 1, policy_version 1310465 (0.0008) [2023-12-26 10:07:41,490][123090] Updated weights for policy 1, policy_version 1310475 (0.0009) [2023-12-26 10:07:41,551][123090] Updated weights for policy 1, policy_version 1310485 (0.0009) [2023-12-26 10:07:41,613][123090] Updated weights for policy 1, policy_version 1310495 (0.0009) [2023-12-26 10:07:41,961][123091] Updated weights for policy 0, policy_version 1319699 (0.0011) [2023-12-26 10:07:42,024][123091] Updated weights for policy 0, policy_version 1319709 (0.0011) [2023-12-26 10:07:42,092][123091] Updated weights for policy 0, policy_version 1319719 (0.0011) [2023-12-26 10:07:42,459][123090] Updated weights for policy 1, policy_version 1310505 (0.0006) [2023-12-26 10:07:42,529][123090] Updated weights for policy 1, policy_version 1310515 (0.0010) [2023-12-26 10:07:42,600][123090] Updated weights for policy 1, policy_version 1310525 (0.0010) [2023-12-26 10:07:42,808][123091] Updated weights for policy 0, policy_version 1319729 (0.0010) [2023-12-26 10:07:42,879][123091] Updated weights for policy 0, policy_version 1319739 (0.0006) [2023-12-26 10:07:42,950][123091] Updated weights for policy 0, policy_version 1319749 (0.0006) [2023-12-26 10:07:43,002][123091] Updated weights for policy 0, policy_version 1319759 (0.0005) [2023-12-26 10:07:43,443][123090] Updated weights for policy 1, policy_version 1310535 (0.0010) [2023-12-26 10:07:43,496][123090] Updated weights for policy 1, policy_version 1310545 (0.0009) [2023-12-26 10:07:43,549][123090] Updated weights for policy 1, policy_version 1310555 (0.0010) [2023-12-26 10:07:43,690][123091] Updated weights for policy 0, policy_version 1319769 (0.0005) [2023-12-26 10:07:43,755][123091] Updated weights for policy 0, policy_version 1319779 (0.0005) [2023-12-26 10:07:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 673366016. Throughput: 0: 8499.0, 1: 8842.4. Samples: 673361024. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:43,785][121949] Avg episode reward: [(0, '6299.425'), (1, '5331.964')] [2023-12-26 10:07:43,825][123091] Updated weights for policy 0, policy_version 1319789 (0.0005) [2023-12-26 10:07:44,421][123090] Updated weights for policy 1, policy_version 1310565 (0.0007) [2023-12-26 10:07:44,461][123091] Updated weights for policy 0, policy_version 1319799 (0.0005) [2023-12-26 10:07:44,479][123090] Updated weights for policy 1, policy_version 1310575 (0.0008) [2023-12-26 10:07:44,525][123091] Updated weights for policy 0, policy_version 1319809 (0.0005) [2023-12-26 10:07:44,535][123090] Updated weights for policy 1, policy_version 1310585 (0.0007) [2023-12-26 10:07:44,583][123091] Updated weights for policy 0, policy_version 1319819 (0.0007) [2023-12-26 10:07:45,261][123091] Updated weights for policy 0, policy_version 1319829 (0.0010) [2023-12-26 10:07:45,314][123090] Updated weights for policy 1, policy_version 1310595 (0.0010) [2023-12-26 10:07:45,330][123091] Updated weights for policy 0, policy_version 1319839 (0.0008) [2023-12-26 10:07:45,372][123090] Updated weights for policy 1, policy_version 1310605 (0.0010) [2023-12-26 10:07:45,389][123091] Updated weights for policy 0, policy_version 1319849 (0.0007) [2023-12-26 10:07:45,436][123090] Updated weights for policy 1, policy_version 1310615 (0.0010) [2023-12-26 10:07:46,206][123091] Updated weights for policy 0, policy_version 1319859 (0.0010) [2023-12-26 10:07:46,263][123091] Updated weights for policy 0, policy_version 1319869 (0.0011) [2023-12-26 10:07:46,279][123090] Updated weights for policy 1, policy_version 1310625 (0.0010) [2023-12-26 10:07:46,318][123091] Updated weights for policy 0, policy_version 1319879 (0.0011) [2023-12-26 10:07:46,348][123090] Updated weights for policy 1, policy_version 1310635 (0.0008) [2023-12-26 10:07:46,406][123090] Updated weights for policy 1, policy_version 1310645 (0.0010) [2023-12-26 10:07:46,457][123090] Updated weights for policy 1, policy_version 1310655 (0.0010) [2023-12-26 10:07:47,155][123091] Updated weights for policy 0, policy_version 1319889 (0.0011) [2023-12-26 10:07:47,196][123090] Updated weights for policy 1, policy_version 1310665 (0.0006) [2023-12-26 10:07:47,210][123091] Updated weights for policy 0, policy_version 1319899 (0.0009) [2023-12-26 10:07:47,250][123090] Updated weights for policy 1, policy_version 1310675 (0.0005) [2023-12-26 10:07:47,274][123091] Updated weights for policy 0, policy_version 1319909 (0.0009) [2023-12-26 10:07:47,315][123090] Updated weights for policy 1, policy_version 1310685 (0.0006) [2023-12-26 10:07:47,326][123091] Updated weights for policy 0, policy_version 1319919 (0.0010) [2023-12-26 10:07:48,046][123090] Updated weights for policy 1, policy_version 1310695 (0.0008) [2023-12-26 10:07:48,097][123090] Updated weights for policy 1, policy_version 1310705 (0.0008) [2023-12-26 10:07:48,128][123091] Updated weights for policy 0, policy_version 1319929 (0.0011) [2023-12-26 10:07:48,145][123090] Updated weights for policy 1, policy_version 1310715 (0.0006) [2023-12-26 10:07:48,177][123091] Updated weights for policy 0, policy_version 1319939 (0.0010) [2023-12-26 10:07:48,228][123091] Updated weights for policy 0, policy_version 1319949 (0.0010) [2023-12-26 10:07:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 673456128. Throughput: 0: 8571.3, 1: 8848.9. Samples: 673469824. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:48,785][121949] Avg episode reward: [(0, '6380.041'), (1, '5381.378')] [2023-12-26 10:07:49,033][123090] Updated weights for policy 1, policy_version 1310725 (0.0007) [2023-12-26 10:07:49,087][123091] Updated weights for policy 0, policy_version 1319959 (0.0011) [2023-12-26 10:07:49,090][123090] Updated weights for policy 1, policy_version 1310735 (0.0007) [2023-12-26 10:07:49,142][123090] Updated weights for policy 1, policy_version 1310745 (0.0009) [2023-12-26 10:07:49,149][123091] Updated weights for policy 0, policy_version 1319969 (0.0010) [2023-12-26 10:07:49,215][123091] Updated weights for policy 0, policy_version 1319979 (0.0011) [2023-12-26 10:07:49,970][123090] Updated weights for policy 1, policy_version 1310755 (0.0007) [2023-12-26 10:07:50,040][123090] Updated weights for policy 1, policy_version 1310765 (0.0008) [2023-12-26 10:07:50,076][123091] Updated weights for policy 0, policy_version 1319989 (0.0009) [2023-12-26 10:07:50,103][123090] Updated weights for policy 1, policy_version 1310775 (0.0007) [2023-12-26 10:07:50,141][123091] Updated weights for policy 0, policy_version 1319999 (0.0009) [2023-12-26 10:07:50,212][123091] Updated weights for policy 0, policy_version 1320009 (0.0009) [2023-12-26 10:07:50,908][123090] Updated weights for policy 1, policy_version 1310785 (0.0008) [2023-12-26 10:07:50,965][123090] Updated weights for policy 1, policy_version 1310795 (0.0010) [2023-12-26 10:07:51,012][123091] Updated weights for policy 0, policy_version 1320019 (0.0009) [2023-12-26 10:07:51,022][123090] Updated weights for policy 1, policy_version 1310805 (0.0010) [2023-12-26 10:07:51,082][123091] Updated weights for policy 0, policy_version 1320029 (0.0007) [2023-12-26 10:07:51,088][123090] Updated weights for policy 1, policy_version 1310815 (0.0010) [2023-12-26 10:07:51,152][123091] Updated weights for policy 0, policy_version 1320039 (0.0007) [2023-12-26 10:07:51,893][123090] Updated weights for policy 1, policy_version 1310825 (0.0010) [2023-12-26 10:07:51,954][123090] Updated weights for policy 1, policy_version 1310835 (0.0010) [2023-12-26 10:07:52,005][123091] Updated weights for policy 0, policy_version 1320049 (0.0008) [2023-12-26 10:07:52,017][123090] Updated weights for policy 1, policy_version 1310845 (0.0009) [2023-12-26 10:07:52,066][123091] Updated weights for policy 0, policy_version 1320059 (0.0009) [2023-12-26 10:07:52,138][123091] Updated weights for policy 0, policy_version 1320069 (0.0009) [2023-12-26 10:07:52,205][123091] Updated weights for policy 0, policy_version 1320079 (0.0009) [2023-12-26 10:07:52,894][123090] Updated weights for policy 1, policy_version 1310855 (0.0009) [2023-12-26 10:07:52,949][123090] Updated weights for policy 1, policy_version 1310865 (0.0008) [2023-12-26 10:07:52,977][123091] Updated weights for policy 0, policy_version 1320089 (0.0009) [2023-12-26 10:07:53,006][123090] Updated weights for policy 1, policy_version 1310875 (0.0008) [2023-12-26 10:07:53,041][123091] Updated weights for policy 0, policy_version 1320099 (0.0007) [2023-12-26 10:07:53,107][123091] Updated weights for policy 0, policy_version 1320109 (0.0005) [2023-12-26 10:07:53,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 673538048. Throughput: 0: 8574.9, 1: 8841.3. Samples: 673520692. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:53,785][121949] Avg episode reward: [(0, '6325.493'), (1, '5377.090')] [2023-12-26 10:07:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001310880_335585280.pth... [2023-12-26 10:07:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001309856_335323136.pth [2023-12-26 10:07:53,812][123091] Updated weights for policy 0, policy_version 1320119 (0.0008) [2023-12-26 10:07:53,866][123091] Updated weights for policy 0, policy_version 1320129 (0.0007) [2023-12-26 10:07:53,900][123090] Updated weights for policy 1, policy_version 1310885 (0.0009) [2023-12-26 10:07:53,931][123091] Updated weights for policy 0, policy_version 1320139 (0.0010) [2023-12-26 10:07:53,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001320144_337960960.pth... [2023-12-26 10:07:53,965][123090] Updated weights for policy 1, policy_version 1310895 (0.0007) [2023-12-26 10:07:53,966][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001319120_337698816.pth [2023-12-26 10:07:54,018][123090] Updated weights for policy 1, policy_version 1310905 (0.0009) [2023-12-26 10:07:54,662][123091] Updated weights for policy 0, policy_version 1320149 (0.0009) [2023-12-26 10:07:54,712][123091] Updated weights for policy 0, policy_version 1320159 (0.0010) [2023-12-26 10:07:54,768][123091] Updated weights for policy 0, policy_version 1320169 (0.0009) [2023-12-26 10:07:54,905][123090] Updated weights for policy 1, policy_version 1310915 (0.0009) [2023-12-26 10:07:54,963][123090] Updated weights for policy 1, policy_version 1310925 (0.0010) [2023-12-26 10:07:55,032][123090] Updated weights for policy 1, policy_version 1310935 (0.0009) [2023-12-26 10:07:55,619][123091] Updated weights for policy 0, policy_version 1320179 (0.0007) [2023-12-26 10:07:55,680][123091] Updated weights for policy 0, policy_version 1320189 (0.0005) [2023-12-26 10:07:55,731][123091] Updated weights for policy 0, policy_version 1320199 (0.0005) [2023-12-26 10:07:55,909][123090] Updated weights for policy 1, policy_version 1310945 (0.0009) [2023-12-26 10:07:55,973][123090] Updated weights for policy 1, policy_version 1310955 (0.0009) [2023-12-26 10:07:56,032][123090] Updated weights for policy 1, policy_version 1310965 (0.0009) [2023-12-26 10:07:56,111][123090] Updated weights for policy 1, policy_version 1310975 (0.0008) [2023-12-26 10:07:56,412][123091] Updated weights for policy 0, policy_version 1320209 (0.0005) [2023-12-26 10:07:56,467][123091] Updated weights for policy 0, policy_version 1320219 (0.0010) [2023-12-26 10:07:56,520][123091] Updated weights for policy 0, policy_version 1320229 (0.0011) [2023-12-26 10:07:56,587][123091] Updated weights for policy 0, policy_version 1320239 (0.0011) [2023-12-26 10:07:56,993][123090] Updated weights for policy 1, policy_version 1310985 (0.0009) [2023-12-26 10:07:57,050][123090] Updated weights for policy 1, policy_version 1310995 (0.0009) [2023-12-26 10:07:57,099][123090] Updated weights for policy 1, policy_version 1311005 (0.0009) [2023-12-26 10:07:57,408][123091] Updated weights for policy 0, policy_version 1320249 (0.0006) [2023-12-26 10:07:57,460][123091] Updated weights for policy 0, policy_version 1320259 (0.0006) [2023-12-26 10:07:57,503][123091] Updated weights for policy 0, policy_version 1320269 (0.0010) [2023-12-26 10:07:57,918][123090] Updated weights for policy 1, policy_version 1311015 (0.0007) [2023-12-26 10:07:57,962][123090] Updated weights for policy 1, policy_version 1311025 (0.0005) [2023-12-26 10:07:58,010][123090] Updated weights for policy 1, policy_version 1311035 (0.0006) [2023-12-26 10:07:58,322][123091] Updated weights for policy 0, policy_version 1320279 (0.0010) [2023-12-26 10:07:58,394][123091] Updated weights for policy 0, policy_version 1320289 (0.0009) [2023-12-26 10:07:58,472][123091] Updated weights for policy 0, policy_version 1320299 (0.0008) [2023-12-26 10:07:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 673628160. Throughput: 0: 8684.5, 1: 8767.0. Samples: 673623936. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:07:58,785][121949] Avg episode reward: [(0, '6342.488'), (1, '5415.168')] [2023-12-26 10:07:58,816][123090] Updated weights for policy 1, policy_version 1311045 (0.0008) [2023-12-26 10:07:58,890][123090] Updated weights for policy 1, policy_version 1311055 (0.0007) [2023-12-26 10:07:58,955][123090] Updated weights for policy 1, policy_version 1311065 (0.0008) [2023-12-26 10:07:59,255][123091] Updated weights for policy 0, policy_version 1320309 (0.0008) [2023-12-26 10:07:59,315][123091] Updated weights for policy 0, policy_version 1320319 (0.0010) [2023-12-26 10:07:59,393][123091] Updated weights for policy 0, policy_version 1320330 (0.0010) [2023-12-26 10:07:59,753][123090] Updated weights for policy 1, policy_version 1311075 (0.0009) [2023-12-26 10:07:59,805][123090] Updated weights for policy 1, policy_version 1311085 (0.0009) [2023-12-26 10:07:59,869][123090] Updated weights for policy 1, policy_version 1311095 (0.0009) [2023-12-26 10:08:00,205][123091] Updated weights for policy 0, policy_version 1320340 (0.0009) [2023-12-26 10:08:00,259][123091] Updated weights for policy 0, policy_version 1320350 (0.0009) [2023-12-26 10:08:00,310][123091] Updated weights for policy 0, policy_version 1320360 (0.0009) [2023-12-26 10:08:00,768][123090] Updated weights for policy 1, policy_version 1311105 (0.0010) [2023-12-26 10:08:00,820][123090] Updated weights for policy 1, policy_version 1311115 (0.0009) [2023-12-26 10:08:00,866][123090] Updated weights for policy 1, policy_version 1311125 (0.0009) [2023-12-26 10:08:00,917][123090] Updated weights for policy 1, policy_version 1311135 (0.0009) [2023-12-26 10:08:01,174][123091] Updated weights for policy 0, policy_version 1320371 (0.0009) [2023-12-26 10:08:01,240][123091] Updated weights for policy 0, policy_version 1320381 (0.0011) [2023-12-26 10:08:01,310][123091] Updated weights for policy 0, policy_version 1320391 (0.0011) [2023-12-26 10:08:01,695][123090] Updated weights for policy 1, policy_version 1311145 (0.0009) [2023-12-26 10:08:01,764][123090] Updated weights for policy 1, policy_version 1311155 (0.0007) [2023-12-26 10:08:01,818][123090] Updated weights for policy 1, policy_version 1311165 (0.0009) [2023-12-26 10:08:02,106][123091] Updated weights for policy 0, policy_version 1320401 (0.0010) [2023-12-26 10:08:02,175][123091] Updated weights for policy 0, policy_version 1320411 (0.0006) [2023-12-26 10:08:02,239][123091] Updated weights for policy 0, policy_version 1320421 (0.0010) [2023-12-26 10:08:02,301][123091] Updated weights for policy 0, policy_version 1320431 (0.0010) [2023-12-26 10:08:02,689][123090] Updated weights for policy 1, policy_version 1311175 (0.0010) [2023-12-26 10:08:02,746][123090] Updated weights for policy 1, policy_version 1311185 (0.0009) [2023-12-26 10:08:02,795][123090] Updated weights for policy 1, policy_version 1311195 (0.0009) [2023-12-26 10:08:03,073][123091] Updated weights for policy 0, policy_version 1320441 (0.0008) [2023-12-26 10:08:03,132][123091] Updated weights for policy 0, policy_version 1320451 (0.0006) [2023-12-26 10:08:03,204][123091] Updated weights for policy 0, policy_version 1320461 (0.0007) [2023-12-26 10:08:03,629][123090] Updated weights for policy 1, policy_version 1311205 (0.0010) [2023-12-26 10:08:03,696][123090] Updated weights for policy 1, policy_version 1311215 (0.0009) [2023-12-26 10:08:03,742][123090] Updated weights for policy 1, policy_version 1311225 (0.0010) [2023-12-26 10:08:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 673718272. Throughput: 0: 8658.1, 1: 8777.8. Samples: 673727160. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:03,785][121949] Avg episode reward: [(0, '6228.678'), (1, '5450.319')] [2023-12-26 10:08:04,021][123091] Updated weights for policy 0, policy_version 1320471 (0.0010) [2023-12-26 10:08:04,075][123091] Updated weights for policy 0, policy_version 1320481 (0.0010) [2023-12-26 10:08:04,134][123091] Updated weights for policy 0, policy_version 1320491 (0.0006) [2023-12-26 10:08:04,503][123090] Updated weights for policy 1, policy_version 1311235 (0.0007) [2023-12-26 10:08:04,571][123090] Updated weights for policy 1, policy_version 1311245 (0.0011) [2023-12-26 10:08:04,637][123090] Updated weights for policy 1, policy_version 1311255 (0.0006) [2023-12-26 10:08:04,858][123091] Updated weights for policy 0, policy_version 1320501 (0.0006) [2023-12-26 10:08:04,918][123091] Updated weights for policy 0, policy_version 1320511 (0.0005) [2023-12-26 10:08:04,968][123091] Updated weights for policy 0, policy_version 1320521 (0.0005) [2023-12-26 10:08:05,259][123090] Updated weights for policy 1, policy_version 1311265 (0.0006) [2023-12-26 10:08:05,327][123090] Updated weights for policy 1, policy_version 1311275 (0.0006) [2023-12-26 10:08:05,390][123090] Updated weights for policy 1, policy_version 1311285 (0.0006) [2023-12-26 10:08:05,454][123090] Updated weights for policy 1, policy_version 1311295 (0.0007) [2023-12-26 10:08:05,677][123091] Updated weights for policy 0, policy_version 1320531 (0.0007) [2023-12-26 10:08:05,743][123091] Updated weights for policy 0, policy_version 1320541 (0.0009) [2023-12-26 10:08:05,795][123091] Updated weights for policy 0, policy_version 1320551 (0.0009) [2023-12-26 10:08:06,115][123090] Updated weights for policy 1, policy_version 1311305 (0.0010) [2023-12-26 10:08:06,188][123090] Updated weights for policy 1, policy_version 1311315 (0.0007) [2023-12-26 10:08:06,248][123090] Updated weights for policy 1, policy_version 1311325 (0.0005) [2023-12-26 10:08:06,670][123091] Updated weights for policy 0, policy_version 1320561 (0.0009) [2023-12-26 10:08:06,735][123091] Updated weights for policy 0, policy_version 1320571 (0.0009) [2023-12-26 10:08:06,792][123091] Updated weights for policy 0, policy_version 1320581 (0.0010) [2023-12-26 10:08:06,854][123091] Updated weights for policy 0, policy_version 1320591 (0.0010) [2023-12-26 10:08:06,954][123090] Updated weights for policy 1, policy_version 1311335 (0.0005) [2023-12-26 10:08:07,005][123090] Updated weights for policy 1, policy_version 1311345 (0.0006) [2023-12-26 10:08:07,065][123090] Updated weights for policy 1, policy_version 1311355 (0.0006) [2023-12-26 10:08:07,688][123091] Updated weights for policy 0, policy_version 1320601 (0.0010) [2023-12-26 10:08:07,750][123091] Updated weights for policy 0, policy_version 1320611 (0.0011) [2023-12-26 10:08:07,802][123091] Updated weights for policy 0, policy_version 1320621 (0.0010) [2023-12-26 10:08:07,813][123090] Updated weights for policy 1, policy_version 1311365 (0.0008) [2023-12-26 10:08:07,872][123090] Updated weights for policy 1, policy_version 1311375 (0.0010) [2023-12-26 10:08:07,923][123090] Updated weights for policy 1, policy_version 1311385 (0.0010) [2023-12-26 10:08:08,437][123091] Updated weights for policy 0, policy_version 1320631 (0.0005) [2023-12-26 10:08:08,511][123091] Updated weights for policy 0, policy_version 1320641 (0.0005) [2023-12-26 10:08:08,587][123091] Updated weights for policy 0, policy_version 1320651 (0.0006) [2023-12-26 10:08:08,784][123090] Updated weights for policy 1, policy_version 1311395 (0.0010) [2023-12-26 10:08:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 673808384. Throughput: 0: 8722.9, 1: 8858.8. Samples: 673784128. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:08,785][121949] Avg episode reward: [(0, '6199.786'), (1, '5474.335')] [2023-12-26 10:08:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001320656_338092032.pth... [2023-12-26 10:08:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001319600_337821696.pth [2023-12-26 10:08:08,851][123090] Updated weights for policy 1, policy_version 1311405 (0.0011) [2023-12-26 10:08:08,915][123090] Updated weights for policy 1, policy_version 1311415 (0.0011) [2023-12-26 10:08:08,980][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001311424_335724544.pth... [2023-12-26 10:08:08,985][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001310400_335462400.pth [2023-12-26 10:08:09,266][123091] Updated weights for policy 0, policy_version 1320661 (0.0007) [2023-12-26 10:08:09,339][123091] Updated weights for policy 0, policy_version 1320671 (0.0007) [2023-12-26 10:08:09,407][123091] Updated weights for policy 0, policy_version 1320681 (0.0010) [2023-12-26 10:08:09,710][123090] Updated weights for policy 1, policy_version 1311425 (0.0010) [2023-12-26 10:08:09,784][123090] Updated weights for policy 1, policy_version 1311435 (0.0008) [2023-12-26 10:08:09,857][123090] Updated weights for policy 1, policy_version 1311445 (0.0009) [2023-12-26 10:08:09,931][123090] Updated weights for policy 1, policy_version 1311455 (0.0008) [2023-12-26 10:08:10,222][123091] Updated weights for policy 0, policy_version 1320691 (0.0009) [2023-12-26 10:08:10,273][123091] Updated weights for policy 0, policy_version 1320701 (0.0009) [2023-12-26 10:08:10,329][123091] Updated weights for policy 0, policy_version 1320711 (0.0007) [2023-12-26 10:08:10,681][123090] Updated weights for policy 1, policy_version 1311465 (0.0007) [2023-12-26 10:08:10,738][123090] Updated weights for policy 1, policy_version 1311475 (0.0006) [2023-12-26 10:08:10,799][123090] Updated weights for policy 1, policy_version 1311485 (0.0006) [2023-12-26 10:08:11,154][123091] Updated weights for policy 0, policy_version 1320721 (0.0006) [2023-12-26 10:08:11,223][123091] Updated weights for policy 0, policy_version 1320731 (0.0008) [2023-12-26 10:08:11,288][123091] Updated weights for policy 0, policy_version 1320741 (0.0011) [2023-12-26 10:08:11,352][123091] Updated weights for policy 0, policy_version 1320751 (0.0011) [2023-12-26 10:08:11,557][123090] Updated weights for policy 1, policy_version 1311495 (0.0005) [2023-12-26 10:08:11,622][123090] Updated weights for policy 1, policy_version 1311505 (0.0009) [2023-12-26 10:08:11,699][123090] Updated weights for policy 1, policy_version 1311515 (0.0010) [2023-12-26 10:08:12,075][123091] Updated weights for policy 0, policy_version 1320761 (0.0009) [2023-12-26 10:08:12,134][123091] Updated weights for policy 0, policy_version 1320771 (0.0009) [2023-12-26 10:08:12,195][123091] Updated weights for policy 0, policy_version 1320781 (0.0009) [2023-12-26 10:08:12,559][123090] Updated weights for policy 1, policy_version 1311525 (0.0009) [2023-12-26 10:08:12,631][123090] Updated weights for policy 1, policy_version 1311535 (0.0007) [2023-12-26 10:08:12,694][123090] Updated weights for policy 1, policy_version 1311545 (0.0010) [2023-12-26 10:08:12,978][123091] Updated weights for policy 0, policy_version 1320791 (0.0009) [2023-12-26 10:08:13,042][123091] Updated weights for policy 0, policy_version 1320801 (0.0009) [2023-12-26 10:08:13,101][123091] Updated weights for policy 0, policy_version 1320811 (0.0010) [2023-12-26 10:08:13,527][123090] Updated weights for policy 1, policy_version 1311555 (0.0010) [2023-12-26 10:08:13,580][123090] Updated weights for policy 1, policy_version 1311565 (0.0009) [2023-12-26 10:08:13,651][123090] Updated weights for policy 1, policy_version 1311575 (0.0010) [2023-12-26 10:08:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 673898496. Throughput: 0: 8785.1, 1: 8875.7. Samples: 673891884. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:13,785][121949] Avg episode reward: [(0, '6210.698'), (1, '5386.355')] [2023-12-26 10:08:13,823][123091] Updated weights for policy 0, policy_version 1320821 (0.0007) [2023-12-26 10:08:13,882][123091] Updated weights for policy 0, policy_version 1320831 (0.0005) [2023-12-26 10:08:13,945][123091] Updated weights for policy 0, policy_version 1320841 (0.0005) [2023-12-26 10:08:14,538][123090] Updated weights for policy 1, policy_version 1311585 (0.0010) [2023-12-26 10:08:14,617][123090] Updated weights for policy 1, policy_version 1311595 (0.0006) [2023-12-26 10:08:14,678][123090] Updated weights for policy 1, policy_version 1311605 (0.0009) [2023-12-26 10:08:14,716][123091] Updated weights for policy 0, policy_version 1320851 (0.0006) [2023-12-26 10:08:14,742][123090] Updated weights for policy 1, policy_version 1311615 (0.0009) [2023-12-26 10:08:14,771][123091] Updated weights for policy 0, policy_version 1320861 (0.0009) [2023-12-26 10:08:14,841][123091] Updated weights for policy 0, policy_version 1320871 (0.0009) [2023-12-26 10:08:15,569][123091] Updated weights for policy 0, policy_version 1320881 (0.0009) [2023-12-26 10:08:15,586][123090] Updated weights for policy 1, policy_version 1311625 (0.0009) [2023-12-26 10:08:15,619][123091] Updated weights for policy 0, policy_version 1320891 (0.0005) [2023-12-26 10:08:15,648][123090] Updated weights for policy 1, policy_version 1311635 (0.0008) [2023-12-26 10:08:15,671][123091] Updated weights for policy 0, policy_version 1320901 (0.0005) [2023-12-26 10:08:15,707][123090] Updated weights for policy 1, policy_version 1311645 (0.0009) [2023-12-26 10:08:15,734][123091] Updated weights for policy 0, policy_version 1320911 (0.0008) [2023-12-26 10:08:16,511][123091] Updated weights for policy 0, policy_version 1320921 (0.0010) [2023-12-26 10:08:16,531][123090] Updated weights for policy 1, policy_version 1311655 (0.0007) [2023-12-26 10:08:16,572][123091] Updated weights for policy 0, policy_version 1320931 (0.0007) [2023-12-26 10:08:16,598][123090] Updated weights for policy 1, policy_version 1311665 (0.0009) [2023-12-26 10:08:16,637][123091] Updated weights for policy 0, policy_version 1320941 (0.0011) [2023-12-26 10:08:16,661][123090] Updated weights for policy 1, policy_version 1311675 (0.0009) [2023-12-26 10:08:17,473][123091] Updated weights for policy 0, policy_version 1320951 (0.0010) [2023-12-26 10:08:17,476][123090] Updated weights for policy 1, policy_version 1311685 (0.0008) [2023-12-26 10:08:17,516][123091] Updated weights for policy 0, policy_version 1320961 (0.0010) [2023-12-26 10:08:17,527][123090] Updated weights for policy 1, policy_version 1311695 (0.0005) [2023-12-26 10:08:17,572][123091] Updated weights for policy 0, policy_version 1320971 (0.0010) [2023-12-26 10:08:17,575][123090] Updated weights for policy 1, policy_version 1311705 (0.0006) [2023-12-26 10:08:18,243][123091] Updated weights for policy 0, policy_version 1320981 (0.0010) [2023-12-26 10:08:18,301][123091] Updated weights for policy 0, policy_version 1320991 (0.0009) [2023-12-26 10:08:18,361][123091] Updated weights for policy 0, policy_version 1321001 (0.0009) [2023-12-26 10:08:18,498][123090] Updated weights for policy 1, policy_version 1311715 (0.0008) [2023-12-26 10:08:18,555][123090] Updated weights for policy 1, policy_version 1311725 (0.0009) [2023-12-26 10:08:18,616][123090] Updated weights for policy 1, policy_version 1311735 (0.0009) [2023-12-26 10:08:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 673988608. Throughput: 0: 8904.1, 1: 8731.8. Samples: 673996668. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:18,785][121949] Avg episode reward: [(0, '6233.429'), (1, '5424.347')] [2023-12-26 10:08:19,243][123091] Updated weights for policy 0, policy_version 1321011 (0.0009) [2023-12-26 10:08:19,297][123091] Updated weights for policy 0, policy_version 1321021 (0.0009) [2023-12-26 10:08:19,359][123091] Updated weights for policy 0, policy_version 1321031 (0.0010) [2023-12-26 10:08:19,419][123090] Updated weights for policy 1, policy_version 1311745 (0.0009) [2023-12-26 10:08:19,469][123090] Updated weights for policy 1, policy_version 1311755 (0.0009) [2023-12-26 10:08:19,533][123090] Updated weights for policy 1, policy_version 1311765 (0.0008) [2023-12-26 10:08:19,597][123090] Updated weights for policy 1, policy_version 1311775 (0.0010) [2023-12-26 10:08:20,199][123091] Updated weights for policy 0, policy_version 1321041 (0.0009) [2023-12-26 10:08:20,266][123091] Updated weights for policy 0, policy_version 1321051 (0.0011) [2023-12-26 10:08:20,322][123091] Updated weights for policy 0, policy_version 1321061 (0.0011) [2023-12-26 10:08:20,387][123091] Updated weights for policy 0, policy_version 1321071 (0.0011) [2023-12-26 10:08:20,486][123090] Updated weights for policy 1, policy_version 1311785 (0.0009) [2023-12-26 10:08:20,538][123090] Updated weights for policy 1, policy_version 1311795 (0.0008) [2023-12-26 10:08:20,616][123090] Updated weights for policy 1, policy_version 1311805 (0.0009) [2023-12-26 10:08:21,251][123091] Updated weights for policy 0, policy_version 1321081 (0.0011) [2023-12-26 10:08:21,312][123091] Updated weights for policy 0, policy_version 1321091 (0.0011) [2023-12-26 10:08:21,380][123091] Updated weights for policy 0, policy_version 1321101 (0.0010) [2023-12-26 10:08:21,493][123090] Updated weights for policy 1, policy_version 1311815 (0.0008) [2023-12-26 10:08:21,561][123090] Updated weights for policy 1, policy_version 1311825 (0.0009) [2023-12-26 10:08:21,618][123090] Updated weights for policy 1, policy_version 1311835 (0.0008) [2023-12-26 10:08:22,245][123091] Updated weights for policy 0, policy_version 1321111 (0.0010) [2023-12-26 10:08:22,309][123091] Updated weights for policy 0, policy_version 1321121 (0.0010) [2023-12-26 10:08:22,377][123091] Updated weights for policy 0, policy_version 1321131 (0.0009) [2023-12-26 10:08:22,471][123090] Updated weights for policy 1, policy_version 1311845 (0.0009) [2023-12-26 10:08:22,540][123090] Updated weights for policy 1, policy_version 1311855 (0.0009) [2023-12-26 10:08:22,610][123090] Updated weights for policy 1, policy_version 1311865 (0.0009) [2023-12-26 10:08:23,095][123091] Updated weights for policy 0, policy_version 1321141 (0.0007) [2023-12-26 10:08:23,160][123091] Updated weights for policy 0, policy_version 1321151 (0.0006) [2023-12-26 10:08:23,231][123091] Updated weights for policy 0, policy_version 1321161 (0.0006) [2023-12-26 10:08:23,438][123090] Updated weights for policy 1, policy_version 1311875 (0.0009) [2023-12-26 10:08:23,508][123090] Updated weights for policy 1, policy_version 1311885 (0.0009) [2023-12-26 10:08:23,583][123090] Updated weights for policy 1, policy_version 1311895 (0.0009) [2023-12-26 10:08:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 674070528. Throughput: 0: 8929.2, 1: 8645.1. Samples: 674046560. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:23,784][121949] Avg episode reward: [(0, '6307.036'), (1, '5571.440')] [2023-12-26 10:08:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001321168_338223104.pth... [2023-12-26 10:08:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001311904_335847424.pth... [2023-12-26 10:08:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001320144_337960960.pth [2023-12-26 10:08:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001310880_335585280.pth [2023-12-26 10:08:24,011][123091] Updated weights for policy 0, policy_version 1321171 (0.0006) [2023-12-26 10:08:24,074][123091] Updated weights for policy 0, policy_version 1321181 (0.0009) [2023-12-26 10:08:24,130][123091] Updated weights for policy 0, policy_version 1321191 (0.0009) [2023-12-26 10:08:24,401][123090] Updated weights for policy 1, policy_version 1311905 (0.0009) [2023-12-26 10:08:24,469][123090] Updated weights for policy 1, policy_version 1311915 (0.0009) [2023-12-26 10:08:24,537][123090] Updated weights for policy 1, policy_version 1311925 (0.0009) [2023-12-26 10:08:24,603][123090] Updated weights for policy 1, policy_version 1311935 (0.0009) [2023-12-26 10:08:24,898][123091] Updated weights for policy 0, policy_version 1321201 (0.0008) [2023-12-26 10:08:24,960][123091] Updated weights for policy 0, policy_version 1321211 (0.0008) [2023-12-26 10:08:25,023][123091] Updated weights for policy 0, policy_version 1321221 (0.0006) [2023-12-26 10:08:25,088][123091] Updated weights for policy 0, policy_version 1321231 (0.0009) [2023-12-26 10:08:25,441][123090] Updated weights for policy 1, policy_version 1311945 (0.0009) [2023-12-26 10:08:25,497][123090] Updated weights for policy 1, policy_version 1311955 (0.0008) [2023-12-26 10:08:25,557][123090] Updated weights for policy 1, policy_version 1311965 (0.0009) [2023-12-26 10:08:25,882][123091] Updated weights for policy 0, policy_version 1321241 (0.0011) [2023-12-26 10:08:25,944][123091] Updated weights for policy 0, policy_version 1321251 (0.0010) [2023-12-26 10:08:26,006][123091] Updated weights for policy 0, policy_version 1321261 (0.0011) [2023-12-26 10:08:26,415][123090] Updated weights for policy 1, policy_version 1311975 (0.0009) [2023-12-26 10:08:26,477][123090] Updated weights for policy 1, policy_version 1311985 (0.0006) [2023-12-26 10:08:26,535][123090] Updated weights for policy 1, policy_version 1311995 (0.0006) [2023-12-26 10:08:26,822][123091] Updated weights for policy 0, policy_version 1321271 (0.0011) [2023-12-26 10:08:26,886][123091] Updated weights for policy 0, policy_version 1321281 (0.0011) [2023-12-26 10:08:26,953][123091] Updated weights for policy 0, policy_version 1321291 (0.0011) [2023-12-26 10:08:27,360][123090] Updated weights for policy 1, policy_version 1312005 (0.0008) [2023-12-26 10:08:27,418][123090] Updated weights for policy 1, policy_version 1312015 (0.0009) [2023-12-26 10:08:27,485][123090] Updated weights for policy 1, policy_version 1312025 (0.0009) [2023-12-26 10:08:27,747][123091] Updated weights for policy 0, policy_version 1321301 (0.0011) [2023-12-26 10:08:27,801][123091] Updated weights for policy 0, policy_version 1321311 (0.0010) [2023-12-26 10:08:27,848][123091] Updated weights for policy 0, policy_version 1321321 (0.0010) [2023-12-26 10:08:28,299][123090] Updated weights for policy 1, policy_version 1312035 (0.0009) [2023-12-26 10:08:28,366][123090] Updated weights for policy 1, policy_version 1312045 (0.0009) [2023-12-26 10:08:28,434][123090] Updated weights for policy 1, policy_version 1312055 (0.0009) [2023-12-26 10:08:28,675][123091] Updated weights for policy 0, policy_version 1321331 (0.0010) [2023-12-26 10:08:28,738][123091] Updated weights for policy 0, policy_version 1321341 (0.0011) [2023-12-26 10:08:28,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 674152448. Throughput: 0: 8955.9, 1: 8578.1. Samples: 674150048. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:28,785][121949] Avg episode reward: [(0, '6185.837'), (1, '5625.799')] [2023-12-26 10:08:28,788][123091] Updated weights for policy 0, policy_version 1321351 (0.0010) [2023-12-26 10:08:29,265][123090] Updated weights for policy 1, policy_version 1312065 (0.0009) [2023-12-26 10:08:29,334][123090] Updated weights for policy 1, policy_version 1312075 (0.0009) [2023-12-26 10:08:29,402][123090] Updated weights for policy 1, policy_version 1312085 (0.0009) [2023-12-26 10:08:29,460][123090] Updated weights for policy 1, policy_version 1312095 (0.0009) [2023-12-26 10:08:29,588][123091] Updated weights for policy 0, policy_version 1321361 (0.0010) [2023-12-26 10:08:29,646][123091] Updated weights for policy 0, policy_version 1321371 (0.0010) [2023-12-26 10:08:29,705][123091] Updated weights for policy 0, policy_version 1321381 (0.0010) [2023-12-26 10:08:29,769][123091] Updated weights for policy 0, policy_version 1321391 (0.0011) [2023-12-26 10:08:30,146][123090] Updated weights for policy 1, policy_version 1312105 (0.0009) [2023-12-26 10:08:30,202][123090] Updated weights for policy 1, policy_version 1312115 (0.0010) [2023-12-26 10:08:30,270][123090] Updated weights for policy 1, policy_version 1312125 (0.0007) [2023-12-26 10:08:30,616][123091] Updated weights for policy 0, policy_version 1321401 (0.0010) [2023-12-26 10:08:30,676][123091] Updated weights for policy 0, policy_version 1321412 (0.0011) [2023-12-26 10:08:30,734][123091] Updated weights for policy 0, policy_version 1321422 (0.0010) [2023-12-26 10:08:30,933][123090] Updated weights for policy 1, policy_version 1312135 (0.0005) [2023-12-26 10:08:31,002][123090] Updated weights for policy 1, policy_version 1312145 (0.0005) [2023-12-26 10:08:31,069][123090] Updated weights for policy 1, policy_version 1312155 (0.0008) [2023-12-26 10:08:31,624][123091] Updated weights for policy 0, policy_version 1321432 (0.0007) [2023-12-26 10:08:31,690][123091] Updated weights for policy 0, policy_version 1321442 (0.0008) [2023-12-26 10:08:31,755][123091] Updated weights for policy 0, policy_version 1321452 (0.0008) [2023-12-26 10:08:31,832][123090] Updated weights for policy 1, policy_version 1312165 (0.0008) [2023-12-26 10:08:31,893][123090] Updated weights for policy 1, policy_version 1312175 (0.0010) [2023-12-26 10:08:31,947][123090] Updated weights for policy 1, policy_version 1312185 (0.0009) [2023-12-26 10:08:32,447][123091] Updated weights for policy 0, policy_version 1321462 (0.0006) [2023-12-26 10:08:32,520][123091] Updated weights for policy 0, policy_version 1321472 (0.0005) [2023-12-26 10:08:32,586][123091] Updated weights for policy 0, policy_version 1321482 (0.0011) [2023-12-26 10:08:32,758][123090] Updated weights for policy 1, policy_version 1312195 (0.0009) [2023-12-26 10:08:32,816][123090] Updated weights for policy 1, policy_version 1312205 (0.0005) [2023-12-26 10:08:32,861][123090] Updated weights for policy 1, policy_version 1312215 (0.0005) [2023-12-26 10:08:33,358][123091] Updated weights for policy 0, policy_version 1321492 (0.0008) [2023-12-26 10:08:33,416][123091] Updated weights for policy 0, policy_version 1321502 (0.0005) [2023-12-26 10:08:33,470][123091] Updated weights for policy 0, policy_version 1321512 (0.0005) [2023-12-26 10:08:33,635][123090] Updated weights for policy 1, policy_version 1312225 (0.0006) [2023-12-26 10:08:33,703][123090] Updated weights for policy 1, policy_version 1312235 (0.0008) [2023-12-26 10:08:33,764][123090] Updated weights for policy 1, policy_version 1312245 (0.0009) [2023-12-26 10:08:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 674242560. Throughput: 0: 8881.7, 1: 8605.9. Samples: 674256764. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:33,785][121949] Avg episode reward: [(0, '6235.253'), (1, '5640.666')] [2023-12-26 10:08:33,816][123090] Updated weights for policy 1, policy_version 1312255 (0.0009) [2023-12-26 10:08:34,155][123091] Updated weights for policy 0, policy_version 1321522 (0.0006) [2023-12-26 10:08:34,217][123091] Updated weights for policy 0, policy_version 1321532 (0.0009) [2023-12-26 10:08:34,276][123091] Updated weights for policy 0, policy_version 1321542 (0.0010) [2023-12-26 10:08:34,333][123091] Updated weights for policy 0, policy_version 1321552 (0.0010) [2023-12-26 10:08:34,652][123090] Updated weights for policy 1, policy_version 1312265 (0.0007) [2023-12-26 10:08:34,721][123090] Updated weights for policy 1, policy_version 1312275 (0.0008) [2023-12-26 10:08:34,786][123090] Updated weights for policy 1, policy_version 1312285 (0.0010) [2023-12-26 10:08:35,185][123091] Updated weights for policy 0, policy_version 1321562 (0.0010) [2023-12-26 10:08:35,245][123091] Updated weights for policy 0, policy_version 1321572 (0.0009) [2023-12-26 10:08:35,305][123091] Updated weights for policy 0, policy_version 1321582 (0.0009) [2023-12-26 10:08:35,435][123090] Updated weights for policy 1, policy_version 1312295 (0.0010) [2023-12-26 10:08:35,494][123090] Updated weights for policy 1, policy_version 1312305 (0.0009) [2023-12-26 10:08:35,554][123090] Updated weights for policy 1, policy_version 1312315 (0.0008) [2023-12-26 10:08:36,103][123091] Updated weights for policy 0, policy_version 1321592 (0.0010) [2023-12-26 10:08:36,170][123091] Updated weights for policy 0, policy_version 1321602 (0.0010) [2023-12-26 10:08:36,238][123091] Updated weights for policy 0, policy_version 1321612 (0.0011) [2023-12-26 10:08:36,468][123090] Updated weights for policy 1, policy_version 1312325 (0.0009) [2023-12-26 10:08:36,534][123090] Updated weights for policy 1, policy_version 1312335 (0.0009) [2023-12-26 10:08:36,602][123090] Updated weights for policy 1, policy_version 1312345 (0.0008) [2023-12-26 10:08:36,970][123091] Updated weights for policy 0, policy_version 1321622 (0.0007) [2023-12-26 10:08:37,028][123091] Updated weights for policy 0, policy_version 1321632 (0.0006) [2023-12-26 10:08:37,077][123091] Updated weights for policy 0, policy_version 1321642 (0.0005) [2023-12-26 10:08:37,514][123090] Updated weights for policy 1, policy_version 1312355 (0.0010) [2023-12-26 10:08:37,568][123090] Updated weights for policy 1, policy_version 1312365 (0.0010) [2023-12-26 10:08:37,619][123090] Updated weights for policy 1, policy_version 1312375 (0.0009) [2023-12-26 10:08:37,786][123091] Updated weights for policy 0, policy_version 1321652 (0.0008) [2023-12-26 10:08:37,846][123091] Updated weights for policy 0, policy_version 1321662 (0.0010) [2023-12-26 10:08:37,920][123091] Updated weights for policy 0, policy_version 1321672 (0.0011) [2023-12-26 10:08:38,542][123090] Updated weights for policy 1, policy_version 1312385 (0.0009) [2023-12-26 10:08:38,595][123090] Updated weights for policy 1, policy_version 1312395 (0.0010) [2023-12-26 10:08:38,636][123091] Updated weights for policy 0, policy_version 1321682 (0.0010) [2023-12-26 10:08:38,650][123090] Updated weights for policy 1, policy_version 1312405 (0.0009) [2023-12-26 10:08:38,695][123091] Updated weights for policy 0, policy_version 1321692 (0.0008) [2023-12-26 10:08:38,713][123090] Updated weights for policy 1, policy_version 1312415 (0.0008) [2023-12-26 10:08:38,746][123091] Updated weights for policy 0, policy_version 1321702 (0.0009) [2023-12-26 10:08:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 674332672. Throughput: 0: 8914.8, 1: 8606.6. Samples: 674309156. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:38,785][121949] Avg episode reward: [(0, '6410.783'), (1, '5544.739')] [2023-12-26 10:08:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001312416_335978496.pth... [2023-12-26 10:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001311424_335724544.pth [2023-12-26 10:08:38,808][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001321712_338362368.pth... [2023-12-26 10:08:38,809][123091] Updated weights for policy 0, policy_version 1321712 (0.0010) [2023-12-26 10:08:38,811][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001320656_338092032.pth [2023-12-26 10:08:39,599][123090] Updated weights for policy 1, policy_version 1312425 (0.0009) [2023-12-26 10:08:39,667][123090] Updated weights for policy 1, policy_version 1312435 (0.0009) [2023-12-26 10:08:39,678][123091] Updated weights for policy 0, policy_version 1321722 (0.0008) [2023-12-26 10:08:39,733][123090] Updated weights for policy 1, policy_version 1312445 (0.0007) [2023-12-26 10:08:39,739][123091] Updated weights for policy 0, policy_version 1321732 (0.0009) [2023-12-26 10:08:39,796][123091] Updated weights for policy 0, policy_version 1321742 (0.0010) [2023-12-26 10:08:40,559][123090] Updated weights for policy 1, policy_version 1312455 (0.0008) [2023-12-26 10:08:40,615][123090] Updated weights for policy 1, policy_version 1312465 (0.0009) [2023-12-26 10:08:40,626][123091] Updated weights for policy 0, policy_version 1321752 (0.0009) [2023-12-26 10:08:40,686][123091] Updated weights for policy 0, policy_version 1321762 (0.0009) [2023-12-26 10:08:40,689][123090] Updated weights for policy 1, policy_version 1312475 (0.0006) [2023-12-26 10:08:40,745][123091] Updated weights for policy 0, policy_version 1321772 (0.0008) [2023-12-26 10:08:41,489][123090] Updated weights for policy 1, policy_version 1312485 (0.0008) [2023-12-26 10:08:41,498][123091] Updated weights for policy 0, policy_version 1321782 (0.0008) [2023-12-26 10:08:41,555][123090] Updated weights for policy 1, policy_version 1312495 (0.0009) [2023-12-26 10:08:41,564][123091] Updated weights for policy 0, policy_version 1321792 (0.0007) [2023-12-26 10:08:41,617][123090] Updated weights for policy 1, policy_version 1312505 (0.0008) [2023-12-26 10:08:41,620][123091] Updated weights for policy 0, policy_version 1321802 (0.0008) [2023-12-26 10:08:42,508][123091] Updated weights for policy 0, policy_version 1321812 (0.0009) [2023-12-26 10:08:42,512][123090] Updated weights for policy 1, policy_version 1312515 (0.0008) [2023-12-26 10:08:42,566][123091] Updated weights for policy 0, policy_version 1321822 (0.0009) [2023-12-26 10:08:42,568][123090] Updated weights for policy 1, policy_version 1312525 (0.0006) [2023-12-26 10:08:42,621][123091] Updated weights for policy 0, policy_version 1321832 (0.0008) [2023-12-26 10:08:42,623][123090] Updated weights for policy 1, policy_version 1312535 (0.0007) [2023-12-26 10:08:43,456][123091] Updated weights for policy 0, policy_version 1321842 (0.0009) [2023-12-26 10:08:43,463][123090] Updated weights for policy 1, policy_version 1312545 (0.0008) [2023-12-26 10:08:43,515][123091] Updated weights for policy 0, policy_version 1321852 (0.0009) [2023-12-26 10:08:43,530][123090] Updated weights for policy 1, policy_version 1312555 (0.0007) [2023-12-26 10:08:43,575][123091] Updated weights for policy 0, policy_version 1321862 (0.0008) [2023-12-26 10:08:43,600][123090] Updated weights for policy 1, policy_version 1312565 (0.0007) [2023-12-26 10:08:43,641][123091] Updated weights for policy 0, policy_version 1321872 (0.0010) [2023-12-26 10:08:43,662][123090] Updated weights for policy 1, policy_version 1312575 (0.0006) [2023-12-26 10:08:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 674422784. Throughput: 0: 8900.2, 1: 8614.5. Samples: 674412096. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:43,785][121949] Avg episode reward: [(0, '6234.824'), (1, '5328.314')] [2023-12-26 10:08:44,392][123090] Updated weights for policy 1, policy_version 1312585 (0.0009) [2023-12-26 10:08:44,451][123090] Updated weights for policy 1, policy_version 1312595 (0.0009) [2023-12-26 10:08:44,502][123090] Updated weights for policy 1, policy_version 1312605 (0.0009) [2023-12-26 10:08:44,502][123091] Updated weights for policy 0, policy_version 1321882 (0.0007) [2023-12-26 10:08:44,551][123091] Updated weights for policy 0, policy_version 1321892 (0.0010) [2023-12-26 10:08:44,612][123091] Updated weights for policy 0, policy_version 1321902 (0.0010) [2023-12-26 10:08:45,307][123090] Updated weights for policy 1, policy_version 1312615 (0.0009) [2023-12-26 10:08:45,373][123090] Updated weights for policy 1, policy_version 1312625 (0.0009) [2023-12-26 10:08:45,448][123090] Updated weights for policy 1, policy_version 1312635 (0.0010) [2023-12-26 10:08:45,481][123091] Updated weights for policy 0, policy_version 1321912 (0.0007) [2023-12-26 10:08:45,548][123091] Updated weights for policy 0, policy_version 1321922 (0.0008) [2023-12-26 10:08:45,605][123091] Updated weights for policy 0, policy_version 1321932 (0.0005) [2023-12-26 10:08:46,289][123090] Updated weights for policy 1, policy_version 1312645 (0.0009) [2023-12-26 10:08:46,338][123090] Updated weights for policy 1, policy_version 1312655 (0.0008) [2023-12-26 10:08:46,351][123091] Updated weights for policy 0, policy_version 1321942 (0.0006) [2023-12-26 10:08:46,392][123090] Updated weights for policy 1, policy_version 1312665 (0.0009) [2023-12-26 10:08:46,401][123091] Updated weights for policy 0, policy_version 1321952 (0.0005) [2023-12-26 10:08:46,451][123091] Updated weights for policy 0, policy_version 1321962 (0.0005) [2023-12-26 10:08:47,167][123091] Updated weights for policy 0, policy_version 1321972 (0.0006) [2023-12-26 10:08:47,217][123091] Updated weights for policy 0, policy_version 1321982 (0.0005) [2023-12-26 10:08:47,267][123091] Updated weights for policy 0, policy_version 1321992 (0.0006) [2023-12-26 10:08:47,298][123090] Updated weights for policy 1, policy_version 1312676 (0.0010) [2023-12-26 10:08:47,351][123090] Updated weights for policy 1, policy_version 1312686 (0.0009) [2023-12-26 10:08:47,401][123090] Updated weights for policy 1, policy_version 1312696 (0.0009) [2023-12-26 10:08:48,052][123091] Updated weights for policy 0, policy_version 1322002 (0.0008) [2023-12-26 10:08:48,110][123091] Updated weights for policy 0, policy_version 1322012 (0.0010) [2023-12-26 10:08:48,160][123091] Updated weights for policy 0, policy_version 1322022 (0.0010) [2023-12-26 10:08:48,217][123091] Updated weights for policy 0, policy_version 1322032 (0.0010) [2023-12-26 10:08:48,262][123090] Updated weights for policy 1, policy_version 1312706 (0.0009) [2023-12-26 10:08:48,319][123090] Updated weights for policy 1, policy_version 1312716 (0.0010) [2023-12-26 10:08:48,381][123090] Updated weights for policy 1, policy_version 1312726 (0.0009) [2023-12-26 10:08:48,431][123090] Updated weights for policy 1, policy_version 1312736 (0.0009) [2023-12-26 10:08:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 674504704. Throughput: 0: 8927.5, 1: 8600.0. Samples: 674515896. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:48,785][121949] Avg episode reward: [(0, '6157.546'), (1, '5285.417')] [2023-12-26 10:08:49,074][123091] Updated weights for policy 0, policy_version 1322042 (0.0010) [2023-12-26 10:08:49,144][123091] Updated weights for policy 0, policy_version 1322052 (0.0009) [2023-12-26 10:08:49,218][123091] Updated weights for policy 0, policy_version 1322062 (0.0009) [2023-12-26 10:08:49,302][123090] Updated weights for policy 1, policy_version 1312746 (0.0008) [2023-12-26 10:08:49,373][123090] Updated weights for policy 1, policy_version 1312756 (0.0008) [2023-12-26 10:08:49,446][123090] Updated weights for policy 1, policy_version 1312766 (0.0009) [2023-12-26 10:08:50,056][123091] Updated weights for policy 0, policy_version 1322072 (0.0010) [2023-12-26 10:08:50,111][123091] Updated weights for policy 0, policy_version 1322082 (0.0006) [2023-12-26 10:08:50,168][123091] Updated weights for policy 0, policy_version 1322092 (0.0008) [2023-12-26 10:08:50,322][123090] Updated weights for policy 1, policy_version 1312776 (0.0008) [2023-12-26 10:08:50,390][123090] Updated weights for policy 1, policy_version 1312786 (0.0009) [2023-12-26 10:08:50,450][123090] Updated weights for policy 1, policy_version 1312796 (0.0008) [2023-12-26 10:08:51,013][123091] Updated weights for policy 0, policy_version 1322102 (0.0010) [2023-12-26 10:08:51,074][123091] Updated weights for policy 0, policy_version 1322112 (0.0011) [2023-12-26 10:08:51,140][123091] Updated weights for policy 0, policy_version 1322122 (0.0012) [2023-12-26 10:08:51,297][123090] Updated weights for policy 1, policy_version 1312806 (0.0009) [2023-12-26 10:08:51,355][123090] Updated weights for policy 1, policy_version 1312816 (0.0009) [2023-12-26 10:08:51,425][123090] Updated weights for policy 1, policy_version 1312826 (0.0007) [2023-12-26 10:08:51,983][123091] Updated weights for policy 0, policy_version 1322132 (0.0010) [2023-12-26 10:08:52,038][123091] Updated weights for policy 0, policy_version 1322142 (0.0005) [2023-12-26 10:08:52,110][123091] Updated weights for policy 0, policy_version 1322152 (0.0009) [2023-12-26 10:08:52,217][123090] Updated weights for policy 1, policy_version 1312836 (0.0007) [2023-12-26 10:08:52,288][123090] Updated weights for policy 1, policy_version 1312846 (0.0009) [2023-12-26 10:08:52,355][123090] Updated weights for policy 1, policy_version 1312856 (0.0009) [2023-12-26 10:08:52,785][123091] Updated weights for policy 0, policy_version 1322162 (0.0010) [2023-12-26 10:08:52,833][123091] Updated weights for policy 0, policy_version 1322172 (0.0005) [2023-12-26 10:08:52,887][123091] Updated weights for policy 0, policy_version 1322182 (0.0005) [2023-12-26 10:08:52,934][123091] Updated weights for policy 0, policy_version 1322192 (0.0005) [2023-12-26 10:08:53,149][123090] Updated weights for policy 1, policy_version 1312866 (0.0008) [2023-12-26 10:08:53,196][123090] Updated weights for policy 1, policy_version 1312876 (0.0010) [2023-12-26 10:08:53,248][123090] Updated weights for policy 1, policy_version 1312886 (0.0010) [2023-12-26 10:08:53,307][123090] Updated weights for policy 1, policy_version 1312896 (0.0010) [2023-12-26 10:08:53,626][123091] Updated weights for policy 0, policy_version 1322202 (0.0005) [2023-12-26 10:08:53,690][123091] Updated weights for policy 0, policy_version 1322212 (0.0005) [2023-12-26 10:08:53,747][123091] Updated weights for policy 0, policy_version 1322222 (0.0005) [2023-12-26 10:08:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 674594816. Throughput: 0: 8870.2, 1: 8508.0. Samples: 674566148. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:53,785][121949] Avg episode reward: [(0, '6298.301'), (1, '5349.959')] [2023-12-26 10:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001322224_338493440.pth... [2023-12-26 10:08:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001312896_336101376.pth... [2023-12-26 10:08:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001321168_338223104.pth [2023-12-26 10:08:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001311904_335847424.pth [2023-12-26 10:08:54,035][123090] Updated weights for policy 1, policy_version 1312906 (0.0005) [2023-12-26 10:08:54,105][123090] Updated weights for policy 1, policy_version 1312916 (0.0006) [2023-12-26 10:08:54,168][123090] Updated weights for policy 1, policy_version 1312926 (0.0010) [2023-12-26 10:08:54,405][123091] Updated weights for policy 0, policy_version 1322232 (0.0009) [2023-12-26 10:08:54,456][123091] Updated weights for policy 0, policy_version 1322242 (0.0011) [2023-12-26 10:08:54,511][123091] Updated weights for policy 0, policy_version 1322252 (0.0011) [2023-12-26 10:08:54,947][123090] Updated weights for policy 1, policy_version 1312936 (0.0011) [2023-12-26 10:08:55,009][123090] Updated weights for policy 1, policy_version 1312946 (0.0010) [2023-12-26 10:08:55,081][123090] Updated weights for policy 1, policy_version 1312956 (0.0005) [2023-12-26 10:08:55,328][123091] Updated weights for policy 0, policy_version 1322262 (0.0008) [2023-12-26 10:08:55,375][123091] Updated weights for policy 0, policy_version 1322272 (0.0005) [2023-12-26 10:08:55,422][123091] Updated weights for policy 0, policy_version 1322282 (0.0005) [2023-12-26 10:08:55,802][123090] Updated weights for policy 1, policy_version 1312966 (0.0008) [2023-12-26 10:08:55,860][123090] Updated weights for policy 1, policy_version 1312976 (0.0010) [2023-12-26 10:08:55,920][123090] Updated weights for policy 1, policy_version 1312986 (0.0010) [2023-12-26 10:08:56,149][123091] Updated weights for policy 0, policy_version 1322292 (0.0007) [2023-12-26 10:08:56,204][123091] Updated weights for policy 0, policy_version 1322302 (0.0011) [2023-12-26 10:08:56,264][123091] Updated weights for policy 0, policy_version 1322312 (0.0011) [2023-12-26 10:08:56,777][123090] Updated weights for policy 1, policy_version 1312996 (0.0011) [2023-12-26 10:08:56,837][123090] Updated weights for policy 1, policy_version 1313006 (0.0010) [2023-12-26 10:08:56,899][123090] Updated weights for policy 1, policy_version 1313016 (0.0010) [2023-12-26 10:08:57,091][123091] Updated weights for policy 0, policy_version 1322322 (0.0011) [2023-12-26 10:08:57,138][123091] Updated weights for policy 0, policy_version 1322332 (0.0010) [2023-12-26 10:08:57,186][123091] Updated weights for policy 0, policy_version 1322342 (0.0010) [2023-12-26 10:08:57,233][123091] Updated weights for policy 0, policy_version 1322352 (0.0010) [2023-12-26 10:08:57,637][123090] Updated weights for policy 1, policy_version 1313026 (0.0011) [2023-12-26 10:08:57,695][123090] Updated weights for policy 1, policy_version 1313036 (0.0009) [2023-12-26 10:08:57,764][123090] Updated weights for policy 1, policy_version 1313046 (0.0006) [2023-12-26 10:08:57,828][123090] Updated weights for policy 1, policy_version 1313056 (0.0005) [2023-12-26 10:08:58,055][123091] Updated weights for policy 0, policy_version 1322362 (0.0009) [2023-12-26 10:08:58,122][123091] Updated weights for policy 0, policy_version 1322372 (0.0008) [2023-12-26 10:08:58,188][123091] Updated weights for policy 0, policy_version 1322382 (0.0006) [2023-12-26 10:08:58,512][123090] Updated weights for policy 1, policy_version 1313066 (0.0009) [2023-12-26 10:08:58,585][123090] Updated weights for policy 1, policy_version 1313076 (0.0010) [2023-12-26 10:08:58,658][123090] Updated weights for policy 1, policy_version 1313086 (0.0008) [2023-12-26 10:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.4). Total num frames: 674684928. Throughput: 0: 8908.5, 1: 8523.5. Samples: 674676324. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:08:58,784][121949] Avg episode reward: [(0, '6345.912'), (1, '5460.428')] [2023-12-26 10:08:59,042][123091] Updated weights for policy 0, policy_version 1322392 (0.0007) [2023-12-26 10:08:59,110][123091] Updated weights for policy 0, policy_version 1322402 (0.0005) [2023-12-26 10:08:59,178][123091] Updated weights for policy 0, policy_version 1322412 (0.0007) [2023-12-26 10:08:59,603][123090] Updated weights for policy 1, policy_version 1313096 (0.0009) [2023-12-26 10:08:59,669][123090] Updated weights for policy 1, policy_version 1313106 (0.0006) [2023-12-26 10:08:59,728][123090] Updated weights for policy 1, policy_version 1313116 (0.0005) [2023-12-26 10:08:59,904][123091] Updated weights for policy 0, policy_version 1322422 (0.0008) [2023-12-26 10:08:59,977][123091] Updated weights for policy 0, policy_version 1322432 (0.0009) [2023-12-26 10:09:00,044][123091] Updated weights for policy 0, policy_version 1322442 (0.0008) [2023-12-26 10:09:00,472][123090] Updated weights for policy 1, policy_version 1313126 (0.0008) [2023-12-26 10:09:00,533][123090] Updated weights for policy 1, policy_version 1313136 (0.0008) [2023-12-26 10:09:00,613][123090] Updated weights for policy 1, policy_version 1313146 (0.0010) [2023-12-26 10:09:00,786][123091] Updated weights for policy 0, policy_version 1322452 (0.0005) [2023-12-26 10:09:00,841][123091] Updated weights for policy 0, policy_version 1322462 (0.0005) [2023-12-26 10:09:00,904][123091] Updated weights for policy 0, policy_version 1322472 (0.0005) [2023-12-26 10:09:01,396][123090] Updated weights for policy 1, policy_version 1313156 (0.0010) [2023-12-26 10:09:01,457][123090] Updated weights for policy 1, policy_version 1313166 (0.0009) [2023-12-26 10:09:01,507][123090] Updated weights for policy 1, policy_version 1313176 (0.0005) [2023-12-26 10:09:01,601][123091] Updated weights for policy 0, policy_version 1322482 (0.0006) [2023-12-26 10:09:01,667][123091] Updated weights for policy 0, policy_version 1322492 (0.0008) [2023-12-26 10:09:01,741][123091] Updated weights for policy 0, policy_version 1322502 (0.0007) [2023-12-26 10:09:01,789][123091] Updated weights for policy 0, policy_version 1322512 (0.0009) [2023-12-26 10:09:02,323][123090] Updated weights for policy 1, policy_version 1313186 (0.0008) [2023-12-26 10:09:02,389][123090] Updated weights for policy 1, policy_version 1313196 (0.0011) [2023-12-26 10:09:02,456][123090] Updated weights for policy 1, policy_version 1313206 (0.0010) [2023-12-26 10:09:02,516][123090] Updated weights for policy 1, policy_version 1313216 (0.0010) [2023-12-26 10:09:02,539][123091] Updated weights for policy 0, policy_version 1322522 (0.0007) [2023-12-26 10:09:02,587][123091] Updated weights for policy 0, policy_version 1322532 (0.0009) [2023-12-26 10:09:02,639][123091] Updated weights for policy 0, policy_version 1322542 (0.0009) [2023-12-26 10:09:03,282][123090] Updated weights for policy 1, policy_version 1313226 (0.0005) [2023-12-26 10:09:03,349][123090] Updated weights for policy 1, policy_version 1313236 (0.0005) [2023-12-26 10:09:03,389][123091] Updated weights for policy 0, policy_version 1322552 (0.0005) [2023-12-26 10:09:03,410][123090] Updated weights for policy 1, policy_version 1313246 (0.0005) [2023-12-26 10:09:03,442][123091] Updated weights for policy 0, policy_version 1322562 (0.0006) [2023-12-26 10:09:03,489][123091] Updated weights for policy 0, policy_version 1322572 (0.0005) [2023-12-26 10:09:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 674775040. Throughput: 0: 8907.7, 1: 8610.2. Samples: 674784968. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:09:03,785][121949] Avg episode reward: [(0, '6292.297'), (1, '5248.803')] [2023-12-26 10:09:04,131][123090] Updated weights for policy 1, policy_version 1313256 (0.0010) [2023-12-26 10:09:04,201][123090] Updated weights for policy 1, policy_version 1313266 (0.0011) [2023-12-26 10:09:04,206][123091] Updated weights for policy 0, policy_version 1322582 (0.0008) [2023-12-26 10:09:04,258][123090] Updated weights for policy 1, policy_version 1313276 (0.0007) [2023-12-26 10:09:04,268][123091] Updated weights for policy 0, policy_version 1322592 (0.0008) [2023-12-26 10:09:04,336][123091] Updated weights for policy 0, policy_version 1322602 (0.0008) [2023-12-26 10:09:05,048][123090] Updated weights for policy 1, policy_version 1313286 (0.0008) [2023-12-26 10:09:05,099][123090] Updated weights for policy 1, policy_version 1313296 (0.0009) [2023-12-26 10:09:05,112][123091] Updated weights for policy 0, policy_version 1322612 (0.0007) [2023-12-26 10:09:05,149][123090] Updated weights for policy 1, policy_version 1313306 (0.0009) [2023-12-26 10:09:05,176][123091] Updated weights for policy 0, policy_version 1322622 (0.0009) [2023-12-26 10:09:05,237][123091] Updated weights for policy 0, policy_version 1322632 (0.0009) [2023-12-26 10:09:05,997][123090] Updated weights for policy 1, policy_version 1313316 (0.0008) [2023-12-26 10:09:06,054][123090] Updated weights for policy 1, policy_version 1313326 (0.0009) [2023-12-26 10:09:06,064][123091] Updated weights for policy 0, policy_version 1322642 (0.0010) [2023-12-26 10:09:06,104][123090] Updated weights for policy 1, policy_version 1313336 (0.0008) [2023-12-26 10:09:06,131][123091] Updated weights for policy 0, policy_version 1322652 (0.0008) [2023-12-26 10:09:06,192][123091] Updated weights for policy 0, policy_version 1322662 (0.0007) [2023-12-26 10:09:06,248][123091] Updated weights for policy 0, policy_version 1322672 (0.0009) [2023-12-26 10:09:06,927][123090] Updated weights for policy 1, policy_version 1313346 (0.0007) [2023-12-26 10:09:06,984][123090] Updated weights for policy 1, policy_version 1313356 (0.0006) [2023-12-26 10:09:07,049][123090] Updated weights for policy 1, policy_version 1313366 (0.0006) [2023-12-26 10:09:07,056][123091] Updated weights for policy 0, policy_version 1322682 (0.0006) [2023-12-26 10:09:07,120][123090] Updated weights for policy 1, policy_version 1313376 (0.0005) [2023-12-26 10:09:07,121][123091] Updated weights for policy 0, policy_version 1322692 (0.0006) [2023-12-26 10:09:07,172][123091] Updated weights for policy 0, policy_version 1322702 (0.0005) [2023-12-26 10:09:07,771][123090] Updated weights for policy 1, policy_version 1313386 (0.0006) [2023-12-26 10:09:07,778][123091] Updated weights for policy 0, policy_version 1322712 (0.0006) [2023-12-26 10:09:07,826][123090] Updated weights for policy 1, policy_version 1313396 (0.0005) [2023-12-26 10:09:07,826][123091] Updated weights for policy 0, policy_version 1322722 (0.0005) [2023-12-26 10:09:07,885][123091] Updated weights for policy 0, policy_version 1322732 (0.0005) [2023-12-26 10:09:07,895][123090] Updated weights for policy 1, policy_version 1313406 (0.0005) [2023-12-26 10:09:08,517][123091] Updated weights for policy 0, policy_version 1322742 (0.0008) [2023-12-26 10:09:08,580][123091] Updated weights for policy 0, policy_version 1322752 (0.0009) [2023-12-26 10:09:08,634][123091] Updated weights for policy 0, policy_version 1322762 (0.0008) [2023-12-26 10:09:08,644][123090] Updated weights for policy 1, policy_version 1313416 (0.0009) [2023-12-26 10:09:08,703][123090] Updated weights for policy 1, policy_version 1313426 (0.0008) [2023-12-26 10:09:08,757][123090] Updated weights for policy 1, policy_version 1313436 (0.0007) [2023-12-26 10:09:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 674873344. Throughput: 0: 8945.3, 1: 8637.7. Samples: 674837796. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:09:08,785][121949] Avg episode reward: [(0, '6285.785'), (1, '5245.616')] [2023-12-26 10:09:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001313440_336240640.pth... [2023-12-26 10:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001322768_338632704.pth... [2023-12-26 10:09:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001312416_335978496.pth [2023-12-26 10:09:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001321712_338362368.pth [2023-12-26 10:09:09,463][123091] Updated weights for policy 0, policy_version 1322772 (0.0008) [2023-12-26 10:09:09,516][123091] Updated weights for policy 0, policy_version 1322782 (0.0009) [2023-12-26 10:09:09,569][123091] Updated weights for policy 0, policy_version 1322792 (0.0008) [2023-12-26 10:09:09,599][123090] Updated weights for policy 1, policy_version 1313446 (0.0009) [2023-12-26 10:09:09,651][123090] Updated weights for policy 1, policy_version 1313456 (0.0008) [2023-12-26 10:09:09,702][123090] Updated weights for policy 1, policy_version 1313466 (0.0010) [2023-12-26 10:09:10,414][123091] Updated weights for policy 0, policy_version 1322802 (0.0009) [2023-12-26 10:09:10,485][123091] Updated weights for policy 0, policy_version 1322812 (0.0011) [2023-12-26 10:09:10,550][123091] Updated weights for policy 0, policy_version 1322822 (0.0011) [2023-12-26 10:09:10,578][123090] Updated weights for policy 1, policy_version 1313476 (0.0008) [2023-12-26 10:09:10,610][123091] Updated weights for policy 0, policy_version 1322832 (0.0011) [2023-12-26 10:09:10,638][123090] Updated weights for policy 1, policy_version 1313486 (0.0009) [2023-12-26 10:09:10,688][123090] Updated weights for policy 1, policy_version 1313496 (0.0009) [2023-12-26 10:09:11,456][123091] Updated weights for policy 0, policy_version 1322842 (0.0011) [2023-12-26 10:09:11,517][123091] Updated weights for policy 0, policy_version 1322852 (0.0012) [2023-12-26 10:09:11,581][123091] Updated weights for policy 0, policy_version 1322862 (0.0009) [2023-12-26 10:09:11,593][123090] Updated weights for policy 1, policy_version 1313506 (0.0009) [2023-12-26 10:09:11,661][123090] Updated weights for policy 1, policy_version 1313516 (0.0009) [2023-12-26 10:09:11,729][123090] Updated weights for policy 1, policy_version 1313526 (0.0009) [2023-12-26 10:09:11,801][123090] Updated weights for policy 1, policy_version 1313536 (0.0008) [2023-12-26 10:09:12,333][123091] Updated weights for policy 0, policy_version 1322872 (0.0008) [2023-12-26 10:09:12,403][123091] Updated weights for policy 0, policy_version 1322882 (0.0007) [2023-12-26 10:09:12,464][123091] Updated weights for policy 0, policy_version 1322892 (0.0005) [2023-12-26 10:09:12,628][123090] Updated weights for policy 1, policy_version 1313546 (0.0008) [2023-12-26 10:09:12,688][123090] Updated weights for policy 1, policy_version 1313556 (0.0007) [2023-12-26 10:09:12,757][123090] Updated weights for policy 1, policy_version 1313566 (0.0007) [2023-12-26 10:09:13,187][123091] Updated weights for policy 0, policy_version 1322902 (0.0006) [2023-12-26 10:09:13,244][123091] Updated weights for policy 0, policy_version 1322912 (0.0005) [2023-12-26 10:09:13,310][123091] Updated weights for policy 0, policy_version 1322922 (0.0009) [2023-12-26 10:09:13,472][123090] Updated weights for policy 1, policy_version 1313577 (0.0009) [2023-12-26 10:09:13,526][123090] Updated weights for policy 1, policy_version 1313587 (0.0010) [2023-12-26 10:09:13,576][123090] Updated weights for policy 1, policy_version 1313597 (0.0009) [2023-12-26 10:09:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 674955264. Throughput: 0: 9002.0, 1: 8691.3. Samples: 674946244. Policy #0 lag: (min: 31.0, avg: 40.2, max: 63.0) [2023-12-26 10:09:13,785][121949] Avg episode reward: [(0, '6287.031'), (1, '5479.170')] [2023-12-26 10:09:14,020][123091] Updated weights for policy 0, policy_version 1322932 (0.0009) [2023-12-26 10:09:14,067][123091] Updated weights for policy 0, policy_version 1322942 (0.0009) [2023-12-26 10:09:14,127][123091] Updated weights for policy 0, policy_version 1322953 (0.0010) [2023-12-26 10:09:14,426][123090] Updated weights for policy 1, policy_version 1313607 (0.0009) [2023-12-26 10:09:14,479][123090] Updated weights for policy 1, policy_version 1313617 (0.0009) [2023-12-26 10:09:14,543][123090] Updated weights for policy 1, policy_version 1313627 (0.0009) [2023-12-26 10:09:14,969][123091] Updated weights for policy 0, policy_version 1322963 (0.0010) [2023-12-26 10:09:15,041][123091] Updated weights for policy 0, policy_version 1322973 (0.0011) [2023-12-26 10:09:15,096][123091] Updated weights for policy 0, policy_version 1322983 (0.0010) [2023-12-26 10:09:15,323][123090] Updated weights for policy 1, policy_version 1313637 (0.0008) [2023-12-26 10:09:15,399][123090] Updated weights for policy 1, policy_version 1313647 (0.0006) [2023-12-26 10:09:15,471][123090] Updated weights for policy 1, policy_version 1313657 (0.0005) [2023-12-26 10:09:15,881][123091] Updated weights for policy 0, policy_version 1322993 (0.0010) [2023-12-26 10:09:15,939][123091] Updated weights for policy 0, policy_version 1323003 (0.0006) [2023-12-26 10:09:16,007][123091] Updated weights for policy 0, policy_version 1323013 (0.0005) [2023-12-26 10:09:16,080][123091] Updated weights for policy 0, policy_version 1323023 (0.0005) [2023-12-26 10:09:16,257][123090] Updated weights for policy 1, policy_version 1313667 (0.0008) [2023-12-26 10:09:16,307][123090] Updated weights for policy 1, policy_version 1313677 (0.0009) [2023-12-26 10:09:16,356][123090] Updated weights for policy 1, policy_version 1313687 (0.0008) [2023-12-26 10:09:16,777][123091] Updated weights for policy 0, policy_version 1323033 (0.0005) [2023-12-26 10:09:16,848][123091] Updated weights for policy 0, policy_version 1323043 (0.0008) [2023-12-26 10:09:16,907][123091] Updated weights for policy 0, policy_version 1323053 (0.0011) [2023-12-26 10:09:17,229][123090] Updated weights for policy 1, policy_version 1313697 (0.0008) [2023-12-26 10:09:17,281][123090] Updated weights for policy 1, policy_version 1313707 (0.0008) [2023-12-26 10:09:17,343][123090] Updated weights for policy 1, policy_version 1313717 (0.0008) [2023-12-26 10:09:17,407][123090] Updated weights for policy 1, policy_version 1313727 (0.0009) [2023-12-26 10:09:17,638][123091] Updated weights for policy 0, policy_version 1323063 (0.0007) [2023-12-26 10:09:17,697][123091] Updated weights for policy 0, policy_version 1323073 (0.0006) [2023-12-26 10:09:17,753][123091] Updated weights for policy 0, policy_version 1323083 (0.0005) [2023-12-26 10:09:18,144][123090] Updated weights for policy 1, policy_version 1313737 (0.0008) [2023-12-26 10:09:18,198][123090] Updated weights for policy 1, policy_version 1313747 (0.0007) [2023-12-26 10:09:18,253][123090] Updated weights for policy 1, policy_version 1313757 (0.0006) [2023-12-26 10:09:18,512][123091] Updated weights for policy 0, policy_version 1323093 (0.0008) [2023-12-26 10:09:18,565][123091] Updated weights for policy 0, policy_version 1323103 (0.0009) [2023-12-26 10:09:18,636][123091] Updated weights for policy 0, policy_version 1323113 (0.0009) [2023-12-26 10:09:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 675045376. Throughput: 0: 9072.5, 1: 8672.1. Samples: 675055268. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:18,784][121949] Avg episode reward: [(0, '6326.179'), (1, '5449.958')] [2023-12-26 10:09:19,031][123090] Updated weights for policy 1, policy_version 1313767 (0.0010) [2023-12-26 10:09:19,090][123090] Updated weights for policy 1, policy_version 1313777 (0.0010) [2023-12-26 10:09:19,163][123090] Updated weights for policy 1, policy_version 1313787 (0.0010) [2023-12-26 10:09:19,472][123091] Updated weights for policy 0, policy_version 1323123 (0.0010) [2023-12-26 10:09:19,534][123091] Updated weights for policy 0, policy_version 1323133 (0.0008) [2023-12-26 10:09:19,594][123091] Updated weights for policy 0, policy_version 1323143 (0.0008) [2023-12-26 10:09:19,941][123090] Updated weights for policy 1, policy_version 1313797 (0.0011) [2023-12-26 10:09:20,017][123090] Updated weights for policy 1, policy_version 1313807 (0.0011) [2023-12-26 10:09:20,086][123090] Updated weights for policy 1, policy_version 1313817 (0.0011) [2023-12-26 10:09:20,404][123091] Updated weights for policy 0, policy_version 1323153 (0.0008) [2023-12-26 10:09:20,464][123091] Updated weights for policy 0, policy_version 1323163 (0.0006) [2023-12-26 10:09:20,531][123091] Updated weights for policy 0, policy_version 1323173 (0.0006) [2023-12-26 10:09:20,606][123091] Updated weights for policy 0, policy_version 1323183 (0.0008) [2023-12-26 10:09:20,885][123090] Updated weights for policy 1, policy_version 1313827 (0.0009) [2023-12-26 10:09:20,955][123090] Updated weights for policy 1, policy_version 1313837 (0.0010) [2023-12-26 10:09:21,015][123090] Updated weights for policy 1, policy_version 1313847 (0.0011) [2023-12-26 10:09:21,276][123091] Updated weights for policy 0, policy_version 1323193 (0.0010) [2023-12-26 10:09:21,337][123091] Updated weights for policy 0, policy_version 1323203 (0.0009) [2023-12-26 10:09:21,412][123091] Updated weights for policy 0, policy_version 1323213 (0.0010) [2023-12-26 10:09:21,806][123090] Updated weights for policy 1, policy_version 1313857 (0.0010) [2023-12-26 10:09:21,877][123090] Updated weights for policy 1, policy_version 1313867 (0.0009) [2023-12-26 10:09:21,948][123090] Updated weights for policy 1, policy_version 1313877 (0.0011) [2023-12-26 10:09:22,015][123090] Updated weights for policy 1, policy_version 1313887 (0.0010) [2023-12-26 10:09:22,268][123091] Updated weights for policy 0, policy_version 1323223 (0.0007) [2023-12-26 10:09:22,342][123091] Updated weights for policy 0, policy_version 1323233 (0.0006) [2023-12-26 10:09:22,415][123091] Updated weights for policy 0, policy_version 1323243 (0.0009) [2023-12-26 10:09:22,809][123090] Updated weights for policy 1, policy_version 1313897 (0.0010) [2023-12-26 10:09:22,871][123090] Updated weights for policy 1, policy_version 1313907 (0.0009) [2023-12-26 10:09:22,935][123090] Updated weights for policy 1, policy_version 1313917 (0.0006) [2023-12-26 10:09:23,169][123091] Updated weights for policy 0, policy_version 1323253 (0.0010) [2023-12-26 10:09:23,221][123091] Updated weights for policy 0, policy_version 1323263 (0.0010) [2023-12-26 10:09:23,274][123091] Updated weights for policy 0, policy_version 1323273 (0.0009) [2023-12-26 10:09:23,629][123090] Updated weights for policy 1, policy_version 1313927 (0.0006) [2023-12-26 10:09:23,680][123090] Updated weights for policy 1, policy_version 1313937 (0.0005) [2023-12-26 10:09:23,750][123090] Updated weights for policy 1, policy_version 1313947 (0.0005) [2023-12-26 10:09:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 675135488. Throughput: 0: 9055.7, 1: 8678.0. Samples: 675107176. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:23,785][121949] Avg episode reward: [(0, '6306.833'), (1, '5313.699')] [2023-12-26 10:09:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001323280_338763776.pth... [2023-12-26 10:09:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001313952_336371712.pth... [2023-12-26 10:09:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001322224_338493440.pth [2023-12-26 10:09:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001312896_336101376.pth [2023-12-26 10:09:24,136][123091] Updated weights for policy 0, policy_version 1323283 (0.0008) [2023-12-26 10:09:24,186][123091] Updated weights for policy 0, policy_version 1323293 (0.0005) [2023-12-26 10:09:24,231][123091] Updated weights for policy 0, policy_version 1323303 (0.0008) [2023-12-26 10:09:24,403][123090] Updated weights for policy 1, policy_version 1313957 (0.0005) [2023-12-26 10:09:24,478][123090] Updated weights for policy 1, policy_version 1313967 (0.0005) [2023-12-26 10:09:24,556][123090] Updated weights for policy 1, policy_version 1313977 (0.0006) [2023-12-26 10:09:24,882][123091] Updated weights for policy 0, policy_version 1323313 (0.0006) [2023-12-26 10:09:24,932][123091] Updated weights for policy 0, policy_version 1323323 (0.0006) [2023-12-26 10:09:24,987][123091] Updated weights for policy 0, policy_version 1323333 (0.0006) [2023-12-26 10:09:25,057][123091] Updated weights for policy 0, policy_version 1323343 (0.0006) [2023-12-26 10:09:25,176][123090] Updated weights for policy 1, policy_version 1313987 (0.0006) [2023-12-26 10:09:25,225][123090] Updated weights for policy 1, policy_version 1313997 (0.0009) [2023-12-26 10:09:25,275][123090] Updated weights for policy 1, policy_version 1314007 (0.0009) [2023-12-26 10:09:25,832][123091] Updated weights for policy 0, policy_version 1323353 (0.0007) [2023-12-26 10:09:25,883][123091] Updated weights for policy 0, policy_version 1323363 (0.0009) [2023-12-26 10:09:25,936][123091] Updated weights for policy 0, policy_version 1323373 (0.0008) [2023-12-26 10:09:26,068][123090] Updated weights for policy 1, policy_version 1314017 (0.0009) [2023-12-26 10:09:26,130][123090] Updated weights for policy 1, policy_version 1314027 (0.0006) [2023-12-26 10:09:26,199][123090] Updated weights for policy 1, policy_version 1314037 (0.0008) [2023-12-26 10:09:26,264][123090] Updated weights for policy 1, policy_version 1314047 (0.0009) [2023-12-26 10:09:26,716][123091] Updated weights for policy 0, policy_version 1323383 (0.0008) [2023-12-26 10:09:26,766][123091] Updated weights for policy 0, policy_version 1323393 (0.0009) [2023-12-26 10:09:26,822][123091] Updated weights for policy 0, policy_version 1323403 (0.0008) [2023-12-26 10:09:27,068][123090] Updated weights for policy 1, policy_version 1314057 (0.0006) [2023-12-26 10:09:27,136][123090] Updated weights for policy 1, policy_version 1314067 (0.0005) [2023-12-26 10:09:27,201][123090] Updated weights for policy 1, policy_version 1314077 (0.0005) [2023-12-26 10:09:27,676][123091] Updated weights for policy 0, policy_version 1323413 (0.0009) [2023-12-26 10:09:27,739][123091] Updated weights for policy 0, policy_version 1323423 (0.0009) [2023-12-26 10:09:27,798][123091] Updated weights for policy 0, policy_version 1323433 (0.0010) [2023-12-26 10:09:27,950][123090] Updated weights for policy 1, policy_version 1314087 (0.0005) [2023-12-26 10:09:28,017][123090] Updated weights for policy 1, policy_version 1314097 (0.0006) [2023-12-26 10:09:28,088][123090] Updated weights for policy 1, policy_version 1314107 (0.0005) [2023-12-26 10:09:28,707][123091] Updated weights for policy 0, policy_version 1323443 (0.0010) [2023-12-26 10:09:28,715][123090] Updated weights for policy 1, policy_version 1314117 (0.0005) [2023-12-26 10:09:28,769][123091] Updated weights for policy 0, policy_version 1323453 (0.0009) [2023-12-26 10:09:28,773][123090] Updated weights for policy 1, policy_version 1314127 (0.0005) [2023-12-26 10:09:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 675217408. Throughput: 0: 9066.2, 1: 8857.6. Samples: 675218668. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:28,785][121949] Avg episode reward: [(0, '6334.289'), (1, '5145.615')] [2023-12-26 10:09:28,827][123091] Updated weights for policy 0, policy_version 1323463 (0.0010) [2023-12-26 10:09:28,833][123090] Updated weights for policy 1, policy_version 1314137 (0.0007) [2023-12-26 10:09:29,564][123090] Updated weights for policy 1, policy_version 1314147 (0.0008) [2023-12-26 10:09:29,624][123090] Updated weights for policy 1, policy_version 1314157 (0.0005) [2023-12-26 10:09:29,673][123090] Updated weights for policy 1, policy_version 1314167 (0.0005) [2023-12-26 10:09:29,732][123091] Updated weights for policy 0, policy_version 1323473 (0.0008) [2023-12-26 10:09:29,808][123091] Updated weights for policy 0, policy_version 1323483 (0.0009) [2023-12-26 10:09:29,879][123091] Updated weights for policy 0, policy_version 1323493 (0.0009) [2023-12-26 10:09:29,955][123091] Updated weights for policy 0, policy_version 1323503 (0.0006) [2023-12-26 10:09:30,429][123090] Updated weights for policy 1, policy_version 1314177 (0.0006) [2023-12-26 10:09:30,480][123090] Updated weights for policy 1, policy_version 1314187 (0.0005) [2023-12-26 10:09:30,539][123090] Updated weights for policy 1, policy_version 1314197 (0.0005) [2023-12-26 10:09:30,587][123090] Updated weights for policy 1, policy_version 1314207 (0.0005) [2023-12-26 10:09:30,704][123091] Updated weights for policy 0, policy_version 1323513 (0.0009) [2023-12-26 10:09:30,772][123091] Updated weights for policy 0, policy_version 1323523 (0.0009) [2023-12-26 10:09:30,832][123091] Updated weights for policy 0, policy_version 1323533 (0.0009) [2023-12-26 10:09:31,132][123090] Updated weights for policy 1, policy_version 1314217 (0.0008) [2023-12-26 10:09:31,195][123090] Updated weights for policy 1, policy_version 1314227 (0.0006) [2023-12-26 10:09:31,252][123090] Updated weights for policy 1, policy_version 1314237 (0.0009) [2023-12-26 10:09:31,580][123091] Updated weights for policy 0, policy_version 1323543 (0.0007) [2023-12-26 10:09:31,653][123091] Updated weights for policy 0, policy_version 1323553 (0.0009) [2023-12-26 10:09:31,718][123091] Updated weights for policy 0, policy_version 1323563 (0.0009) [2023-12-26 10:09:32,058][123090] Updated weights for policy 1, policy_version 1314247 (0.0009) [2023-12-26 10:09:32,110][123090] Updated weights for policy 1, policy_version 1314257 (0.0009) [2023-12-26 10:09:32,167][123090] Updated weights for policy 1, policy_version 1314267 (0.0008) [2023-12-26 10:09:32,495][123091] Updated weights for policy 0, policy_version 1323573 (0.0009) [2023-12-26 10:09:32,553][123091] Updated weights for policy 0, policy_version 1323583 (0.0009) [2023-12-26 10:09:32,608][123091] Updated weights for policy 0, policy_version 1323593 (0.0009) [2023-12-26 10:09:33,010][123090] Updated weights for policy 1, policy_version 1314277 (0.0010) [2023-12-26 10:09:33,066][123090] Updated weights for policy 1, policy_version 1314287 (0.0008) [2023-12-26 10:09:33,115][123090] Updated weights for policy 1, policy_version 1314297 (0.0005) [2023-12-26 10:09:33,481][123091] Updated weights for policy 0, policy_version 1323603 (0.0010) [2023-12-26 10:09:33,532][123091] Updated weights for policy 0, policy_version 1323613 (0.0010) [2023-12-26 10:09:33,598][123091] Updated weights for policy 0, policy_version 1323623 (0.0010) [2023-12-26 10:09:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 675315712. Throughput: 0: 9011.4, 1: 8986.9. Samples: 675325820. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:33,784][121949] Avg episode reward: [(0, '6219.757'), (1, '5250.886')] [2023-12-26 10:09:33,871][123090] Updated weights for policy 1, policy_version 1314307 (0.0007) [2023-12-26 10:09:33,924][123090] Updated weights for policy 1, policy_version 1314317 (0.0009) [2023-12-26 10:09:33,978][123090] Updated weights for policy 1, policy_version 1314328 (0.0010) [2023-12-26 10:09:34,322][123091] Updated weights for policy 0, policy_version 1323633 (0.0007) [2023-12-26 10:09:34,386][123091] Updated weights for policy 0, policy_version 1323643 (0.0010) [2023-12-26 10:09:34,452][123091] Updated weights for policy 0, policy_version 1323653 (0.0009) [2023-12-26 10:09:34,515][123091] Updated weights for policy 0, policy_version 1323663 (0.0010) [2023-12-26 10:09:34,903][123090] Updated weights for policy 1, policy_version 1314339 (0.0011) [2023-12-26 10:09:34,960][123090] Updated weights for policy 1, policy_version 1314349 (0.0008) [2023-12-26 10:09:35,027][123090] Updated weights for policy 1, policy_version 1314359 (0.0007) [2023-12-26 10:09:35,366][123091] Updated weights for policy 0, policy_version 1323673 (0.0009) [2023-12-26 10:09:35,418][123091] Updated weights for policy 0, policy_version 1323683 (0.0008) [2023-12-26 10:09:35,468][123091] Updated weights for policy 0, policy_version 1323693 (0.0009) [2023-12-26 10:09:35,842][123090] Updated weights for policy 1, policy_version 1314369 (0.0010) [2023-12-26 10:09:35,901][123090] Updated weights for policy 1, policy_version 1314379 (0.0010) [2023-12-26 10:09:35,964][123090] Updated weights for policy 1, policy_version 1314389 (0.0010) [2023-12-26 10:09:36,030][123090] Updated weights for policy 1, policy_version 1314399 (0.0010) [2023-12-26 10:09:36,256][123091] Updated weights for policy 0, policy_version 1323703 (0.0008) [2023-12-26 10:09:36,316][123091] Updated weights for policy 0, policy_version 1323713 (0.0008) [2023-12-26 10:09:36,378][123091] Updated weights for policy 0, policy_version 1323723 (0.0009) [2023-12-26 10:09:36,856][123090] Updated weights for policy 1, policy_version 1314409 (0.0009) [2023-12-26 10:09:36,909][123090] Updated weights for policy 1, policy_version 1314419 (0.0009) [2023-12-26 10:09:36,966][123090] Updated weights for policy 1, policy_version 1314429 (0.0009) [2023-12-26 10:09:37,161][123091] Updated weights for policy 0, policy_version 1323733 (0.0010) [2023-12-26 10:09:37,226][123091] Updated weights for policy 0, policy_version 1323743 (0.0010) [2023-12-26 10:09:37,287][123091] Updated weights for policy 0, policy_version 1323753 (0.0006) [2023-12-26 10:09:37,875][123090] Updated weights for policy 1, policy_version 1314439 (0.0010) [2023-12-26 10:09:37,941][123090] Updated weights for policy 1, policy_version 1314449 (0.0007) [2023-12-26 10:09:37,985][123091] Updated weights for policy 0, policy_version 1323763 (0.0006) [2023-12-26 10:09:38,006][123090] Updated weights for policy 1, policy_version 1314459 (0.0006) [2023-12-26 10:09:38,050][123091] Updated weights for policy 0, policy_version 1323773 (0.0007) [2023-12-26 10:09:38,107][123091] Updated weights for policy 0, policy_version 1323783 (0.0009) [2023-12-26 10:09:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 675397632. Throughput: 0: 9052.3, 1: 8984.1. Samples: 675377788. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:38,785][121949] Avg episode reward: [(0, '6319.546'), (1, '5401.834')] [2023-12-26 10:09:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001323792_338894848.pth... [2023-12-26 10:09:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001322768_338632704.pth [2023-12-26 10:09:38,813][123090] Updated weights for policy 1, policy_version 1314469 (0.0009) [2023-12-26 10:09:38,871][123090] Updated weights for policy 1, policy_version 1314479 (0.0010) [2023-12-26 10:09:38,931][123090] Updated weights for policy 1, policy_version 1314489 (0.0010) [2023-12-26 10:09:38,942][123091] Updated weights for policy 0, policy_version 1323793 (0.0008) [2023-12-26 10:09:38,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001314496_336510976.pth... [2023-12-26 10:09:38,969][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001313440_336240640.pth [2023-12-26 10:09:39,005][123091] Updated weights for policy 0, policy_version 1323803 (0.0007) [2023-12-26 10:09:39,063][123091] Updated weights for policy 0, policy_version 1323813 (0.0007) [2023-12-26 10:09:39,130][123091] Updated weights for policy 0, policy_version 1323823 (0.0005) [2023-12-26 10:09:39,749][123090] Updated weights for policy 1, policy_version 1314499 (0.0009) [2023-12-26 10:09:39,819][123090] Updated weights for policy 1, policy_version 1314509 (0.0007) [2023-12-26 10:09:39,880][123091] Updated weights for policy 0, policy_version 1323833 (0.0007) [2023-12-26 10:09:39,890][123090] Updated weights for policy 1, policy_version 1314519 (0.0008) [2023-12-26 10:09:39,950][123091] Updated weights for policy 0, policy_version 1323843 (0.0009) [2023-12-26 10:09:40,014][123091] Updated weights for policy 0, policy_version 1323853 (0.0008) [2023-12-26 10:09:40,737][123090] Updated weights for policy 1, policy_version 1314529 (0.0009) [2023-12-26 10:09:40,784][123091] Updated weights for policy 0, policy_version 1323863 (0.0009) [2023-12-26 10:09:40,791][123090] Updated weights for policy 1, policy_version 1314539 (0.0008) [2023-12-26 10:09:40,839][123091] Updated weights for policy 0, policy_version 1323873 (0.0010) [2023-12-26 10:09:40,846][123090] Updated weights for policy 1, policy_version 1314549 (0.0006) [2023-12-26 10:09:40,898][123091] Updated weights for policy 0, policy_version 1323883 (0.0010) [2023-12-26 10:09:40,899][123090] Updated weights for policy 1, policy_version 1314559 (0.0009) [2023-12-26 10:09:41,716][123091] Updated weights for policy 0, policy_version 1323893 (0.0008) [2023-12-26 10:09:41,785][123090] Updated weights for policy 1, policy_version 1314569 (0.0008) [2023-12-26 10:09:41,790][123091] Updated weights for policy 0, policy_version 1323903 (0.0007) [2023-12-26 10:09:41,850][123090] Updated weights for policy 1, policy_version 1314579 (0.0006) [2023-12-26 10:09:41,852][123091] Updated weights for policy 0, policy_version 1323913 (0.0010) [2023-12-26 10:09:41,912][123090] Updated weights for policy 1, policy_version 1314589 (0.0007) [2023-12-26 10:09:42,647][123091] Updated weights for policy 0, policy_version 1323923 (0.0008) [2023-12-26 10:09:42,714][123091] Updated weights for policy 0, policy_version 1323933 (0.0006) [2023-12-26 10:09:42,736][123090] Updated weights for policy 1, policy_version 1314599 (0.0011) [2023-12-26 10:09:42,774][123091] Updated weights for policy 0, policy_version 1323943 (0.0007) [2023-12-26 10:09:42,792][123090] Updated weights for policy 1, policy_version 1314609 (0.0011) [2023-12-26 10:09:42,848][123090] Updated weights for policy 1, policy_version 1314619 (0.0011) [2023-12-26 10:09:43,488][123091] Updated weights for policy 0, policy_version 1323953 (0.0008) [2023-12-26 10:09:43,546][123091] Updated weights for policy 0, policy_version 1323963 (0.0008) [2023-12-26 10:09:43,610][123091] Updated weights for policy 0, policy_version 1323973 (0.0006) [2023-12-26 10:09:43,665][123091] Updated weights for policy 0, policy_version 1323983 (0.0009) [2023-12-26 10:09:43,688][123090] Updated weights for policy 1, policy_version 1314629 (0.0010) [2023-12-26 10:09:43,750][123090] Updated weights for policy 1, policy_version 1314639 (0.0010) [2023-12-26 10:09:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 675487744. Throughput: 0: 8989.9, 1: 8899.2. Samples: 675481340. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:43,785][121949] Avg episode reward: [(0, '6334.456'), (1, '5491.801')] [2023-12-26 10:09:43,816][123090] Updated weights for policy 1, policy_version 1314649 (0.0010) [2023-12-26 10:09:44,489][123091] Updated weights for policy 0, policy_version 1323993 (0.0009) [2023-12-26 10:09:44,546][123091] Updated weights for policy 0, policy_version 1324003 (0.0010) [2023-12-26 10:09:44,555][123090] Updated weights for policy 1, policy_version 1314659 (0.0009) [2023-12-26 10:09:44,601][123091] Updated weights for policy 0, policy_version 1324013 (0.0008) [2023-12-26 10:09:44,603][123090] Updated weights for policy 1, policy_version 1314669 (0.0006) [2023-12-26 10:09:44,658][123090] Updated weights for policy 1, policy_version 1314679 (0.0007) [2023-12-26 10:09:45,493][123090] Updated weights for policy 1, policy_version 1314689 (0.0006) [2023-12-26 10:09:45,494][123091] Updated weights for policy 0, policy_version 1324023 (0.0009) [2023-12-26 10:09:45,541][123090] Updated weights for policy 1, policy_version 1314699 (0.0010) [2023-12-26 10:09:45,557][123091] Updated weights for policy 0, policy_version 1324033 (0.0008) [2023-12-26 10:09:45,606][123090] Updated weights for policy 1, policy_version 1314709 (0.0011) [2023-12-26 10:09:45,610][123091] Updated weights for policy 0, policy_version 1324043 (0.0007) [2023-12-26 10:09:45,674][123090] Updated weights for policy 1, policy_version 1314719 (0.0011) [2023-12-26 10:09:46,394][123091] Updated weights for policy 0, policy_version 1324053 (0.0009) [2023-12-26 10:09:46,449][123091] Updated weights for policy 0, policy_version 1324063 (0.0009) [2023-12-26 10:09:46,498][123091] Updated weights for policy 0, policy_version 1324073 (0.0007) [2023-12-26 10:09:46,504][123090] Updated weights for policy 1, policy_version 1314729 (0.0010) [2023-12-26 10:09:46,555][123090] Updated weights for policy 1, policy_version 1314739 (0.0010) [2023-12-26 10:09:46,607][123090] Updated weights for policy 1, policy_version 1314749 (0.0010) [2023-12-26 10:09:47,331][123091] Updated weights for policy 0, policy_version 1324083 (0.0007) [2023-12-26 10:09:47,395][123091] Updated weights for policy 0, policy_version 1324093 (0.0005) [2023-12-26 10:09:47,436][123090] Updated weights for policy 1, policy_version 1314759 (0.0010) [2023-12-26 10:09:47,450][123091] Updated weights for policy 0, policy_version 1324103 (0.0007) [2023-12-26 10:09:47,487][123090] Updated weights for policy 1, policy_version 1314769 (0.0010) [2023-12-26 10:09:47,553][123090] Updated weights for policy 1, policy_version 1314779 (0.0010) [2023-12-26 10:09:48,228][123091] Updated weights for policy 0, policy_version 1324113 (0.0010) [2023-12-26 10:09:48,283][123091] Updated weights for policy 0, policy_version 1324123 (0.0008) [2023-12-26 10:09:48,310][123090] Updated weights for policy 1, policy_version 1314789 (0.0010) [2023-12-26 10:09:48,350][123091] Updated weights for policy 0, policy_version 1324133 (0.0008) [2023-12-26 10:09:48,377][123090] Updated weights for policy 1, policy_version 1314799 (0.0012) [2023-12-26 10:09:48,414][123091] Updated weights for policy 0, policy_version 1324143 (0.0007) [2023-12-26 10:09:48,439][123090] Updated weights for policy 1, policy_version 1314809 (0.0008) [2023-12-26 10:09:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 675577856. Throughput: 0: 8940.4, 1: 8887.7. Samples: 675587228. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:48,785][121949] Avg episode reward: [(0, '6334.969'), (1, '5308.772')] [2023-12-26 10:09:49,198][123090] Updated weights for policy 1, policy_version 1314819 (0.0008) [2023-12-26 10:09:49,243][123091] Updated weights for policy 0, policy_version 1324153 (0.0008) [2023-12-26 10:09:49,268][123090] Updated weights for policy 1, policy_version 1314829 (0.0009) [2023-12-26 10:09:49,310][123091] Updated weights for policy 0, policy_version 1324163 (0.0007) [2023-12-26 10:09:49,336][123090] Updated weights for policy 1, policy_version 1314839 (0.0008) [2023-12-26 10:09:49,383][123091] Updated weights for policy 0, policy_version 1324173 (0.0008) [2023-12-26 10:09:50,129][123090] Updated weights for policy 1, policy_version 1314849 (0.0008) [2023-12-26 10:09:50,175][123091] Updated weights for policy 0, policy_version 1324183 (0.0008) [2023-12-26 10:09:50,188][123090] Updated weights for policy 1, policy_version 1314859 (0.0009) [2023-12-26 10:09:50,241][123091] Updated weights for policy 0, policy_version 1324193 (0.0008) [2023-12-26 10:09:50,244][123090] Updated weights for policy 1, policy_version 1314869 (0.0009) [2023-12-26 10:09:50,303][123091] Updated weights for policy 0, policy_version 1324203 (0.0008) [2023-12-26 10:09:50,308][123090] Updated weights for policy 1, policy_version 1314879 (0.0008) [2023-12-26 10:09:51,081][123091] Updated weights for policy 0, policy_version 1324213 (0.0008) [2023-12-26 10:09:51,144][123091] Updated weights for policy 0, policy_version 1324223 (0.0009) [2023-12-26 10:09:51,150][123090] Updated weights for policy 1, policy_version 1314889 (0.0008) [2023-12-26 10:09:51,204][123091] Updated weights for policy 0, policy_version 1324233 (0.0010) [2023-12-26 10:09:51,216][123090] Updated weights for policy 1, policy_version 1314899 (0.0006) [2023-12-26 10:09:51,281][123090] Updated weights for policy 1, policy_version 1314909 (0.0009) [2023-12-26 10:09:52,034][123091] Updated weights for policy 0, policy_version 1324243 (0.0007) [2023-12-26 10:09:52,094][123091] Updated weights for policy 0, policy_version 1324253 (0.0006) [2023-12-26 10:09:52,107][123090] Updated weights for policy 1, policy_version 1314919 (0.0010) [2023-12-26 10:09:52,159][123091] Updated weights for policy 0, policy_version 1324263 (0.0006) [2023-12-26 10:09:52,171][123090] Updated weights for policy 1, policy_version 1314929 (0.0010) [2023-12-26 10:09:52,235][123090] Updated weights for policy 1, policy_version 1314939 (0.0010) [2023-12-26 10:09:52,850][123091] Updated weights for policy 0, policy_version 1324273 (0.0006) [2023-12-26 10:09:52,911][123091] Updated weights for policy 0, policy_version 1324283 (0.0006) [2023-12-26 10:09:52,972][123091] Updated weights for policy 0, policy_version 1324293 (0.0009) [2023-12-26 10:09:52,991][123090] Updated weights for policy 1, policy_version 1314949 (0.0011) [2023-12-26 10:09:53,029][123091] Updated weights for policy 0, policy_version 1324303 (0.0006) [2023-12-26 10:09:53,050][123090] Updated weights for policy 1, policy_version 1314959 (0.0011) [2023-12-26 10:09:53,114][123090] Updated weights for policy 1, policy_version 1314969 (0.0010) [2023-12-26 10:09:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 675659776. Throughput: 0: 8915.9, 1: 8893.0. Samples: 675639200. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:53,785][121949] Avg episode reward: [(0, '6291.342'), (1, '5218.993')] [2023-12-26 10:09:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001314976_336633856.pth... [2023-12-26 10:09:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001313952_336371712.pth [2023-12-26 10:09:53,810][123091] Updated weights for policy 0, policy_version 1324313 (0.0009) [2023-12-26 10:09:53,849][123090] Updated weights for policy 1, policy_version 1314979 (0.0009) [2023-12-26 10:09:53,868][123091] Updated weights for policy 0, policy_version 1324323 (0.0010) [2023-12-26 10:09:53,913][123090] Updated weights for policy 1, policy_version 1314989 (0.0005) [2023-12-26 10:09:53,932][123091] Updated weights for policy 0, policy_version 1324333 (0.0009) [2023-12-26 10:09:53,950][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001324336_339034112.pth... [2023-12-26 10:09:53,955][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001323280_338763776.pth [2023-12-26 10:09:53,968][123090] Updated weights for policy 1, policy_version 1314999 (0.0005) [2023-12-26 10:09:54,696][123090] Updated weights for policy 1, policy_version 1315009 (0.0008) [2023-12-26 10:09:54,743][123090] Updated weights for policy 1, policy_version 1315019 (0.0005) [2023-12-26 10:09:54,800][123090] Updated weights for policy 1, policy_version 1315029 (0.0005) [2023-12-26 10:09:54,822][123091] Updated weights for policy 0, policy_version 1324343 (0.0009) [2023-12-26 10:09:54,854][123090] Updated weights for policy 1, policy_version 1315039 (0.0005) [2023-12-26 10:09:54,883][123091] Updated weights for policy 0, policy_version 1324353 (0.0010) [2023-12-26 10:09:54,940][123091] Updated weights for policy 0, policy_version 1324363 (0.0010) [2023-12-26 10:09:55,483][123090] Updated weights for policy 1, policy_version 1315049 (0.0005) [2023-12-26 10:09:55,538][123090] Updated weights for policy 1, policy_version 1315059 (0.0005) [2023-12-26 10:09:55,600][123090] Updated weights for policy 1, policy_version 1315069 (0.0005) [2023-12-26 10:09:55,884][123091] Updated weights for policy 0, policy_version 1324373 (0.0010) [2023-12-26 10:09:55,938][123091] Updated weights for policy 0, policy_version 1324383 (0.0009) [2023-12-26 10:09:55,991][123091] Updated weights for policy 0, policy_version 1324393 (0.0010) [2023-12-26 10:09:56,287][123090] Updated weights for policy 1, policy_version 1315079 (0.0007) [2023-12-26 10:09:56,345][123090] Updated weights for policy 1, policy_version 1315089 (0.0010) [2023-12-26 10:09:56,415][123090] Updated weights for policy 1, policy_version 1315099 (0.0011) [2023-12-26 10:09:56,741][123091] Updated weights for policy 0, policy_version 1324403 (0.0010) [2023-12-26 10:09:56,797][123091] Updated weights for policy 0, policy_version 1324413 (0.0010) [2023-12-26 10:09:56,855][123091] Updated weights for policy 0, policy_version 1324423 (0.0010) [2023-12-26 10:09:57,100][123090] Updated weights for policy 1, policy_version 1315109 (0.0009) [2023-12-26 10:09:57,172][123090] Updated weights for policy 1, policy_version 1315119 (0.0006) [2023-12-26 10:09:57,273][123090] Updated weights for policy 1, policy_version 1315129 (0.0005) [2023-12-26 10:09:57,730][123091] Updated weights for policy 0, policy_version 1324433 (0.0010) [2023-12-26 10:09:57,787][123091] Updated weights for policy 0, policy_version 1324443 (0.0010) [2023-12-26 10:09:57,842][123091] Updated weights for policy 0, policy_version 1324453 (0.0009) [2023-12-26 10:09:57,891][123091] Updated weights for policy 0, policy_version 1324463 (0.0009) [2023-12-26 10:09:57,930][123090] Updated weights for policy 1, policy_version 1315139 (0.0008) [2023-12-26 10:09:57,989][123090] Updated weights for policy 1, policy_version 1315149 (0.0008) [2023-12-26 10:09:58,059][123090] Updated weights for policy 1, policy_version 1315159 (0.0010) [2023-12-26 10:09:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 675749888. Throughput: 0: 8824.1, 1: 9023.4. Samples: 675749380. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:09:58,785][121949] Avg episode reward: [(0, '6298.440'), (1, '5155.255')] [2023-12-26 10:09:58,824][123091] Updated weights for policy 0, policy_version 1324473 (0.0010) [2023-12-26 10:09:58,900][123091] Updated weights for policy 0, policy_version 1324483 (0.0007) [2023-12-26 10:09:58,961][123090] Updated weights for policy 1, policy_version 1315169 (0.0009) [2023-12-26 10:09:58,978][123091] Updated weights for policy 0, policy_version 1324493 (0.0007) [2023-12-26 10:09:59,029][123090] Updated weights for policy 1, policy_version 1315179 (0.0010) [2023-12-26 10:09:59,087][123090] Updated weights for policy 1, policy_version 1315189 (0.0010) [2023-12-26 10:09:59,147][123090] Updated weights for policy 1, policy_version 1315199 (0.0010) [2023-12-26 10:09:59,862][123091] Updated weights for policy 0, policy_version 1324503 (0.0009) [2023-12-26 10:09:59,931][123091] Updated weights for policy 0, policy_version 1324513 (0.0009) [2023-12-26 10:09:59,989][123091] Updated weights for policy 0, policy_version 1324523 (0.0009) [2023-12-26 10:10:00,085][123090] Updated weights for policy 1, policy_version 1315209 (0.0010) [2023-12-26 10:10:00,140][123090] Updated weights for policy 1, policy_version 1315219 (0.0010) [2023-12-26 10:10:00,196][123090] Updated weights for policy 1, policy_version 1315229 (0.0010) [2023-12-26 10:10:00,692][123091] Updated weights for policy 0, policy_version 1324533 (0.0007) [2023-12-26 10:10:00,751][123091] Updated weights for policy 0, policy_version 1324543 (0.0009) [2023-12-26 10:10:00,804][123091] Updated weights for policy 0, policy_version 1324554 (0.0010) [2023-12-26 10:10:00,958][123090] Updated weights for policy 1, policy_version 1315239 (0.0007) [2023-12-26 10:10:01,034][123090] Updated weights for policy 1, policy_version 1315249 (0.0006) [2023-12-26 10:10:01,110][123090] Updated weights for policy 1, policy_version 1315259 (0.0006) [2023-12-26 10:10:01,716][123091] Updated weights for policy 0, policy_version 1324565 (0.0009) [2023-12-26 10:10:01,780][123091] Updated weights for policy 0, policy_version 1324575 (0.0009) [2023-12-26 10:10:01,796][123090] Updated weights for policy 1, policy_version 1315269 (0.0008) [2023-12-26 10:10:01,835][123091] Updated weights for policy 0, policy_version 1324585 (0.0010) [2023-12-26 10:10:01,859][123090] Updated weights for policy 1, policy_version 1315279 (0.0009) [2023-12-26 10:10:01,928][123090] Updated weights for policy 1, policy_version 1315289 (0.0009) [2023-12-26 10:10:02,625][123091] Updated weights for policy 0, policy_version 1324595 (0.0008) [2023-12-26 10:10:02,680][123090] Updated weights for policy 1, policy_version 1315299 (0.0007) [2023-12-26 10:10:02,689][123091] Updated weights for policy 0, policy_version 1324605 (0.0010) [2023-12-26 10:10:02,731][123090] Updated weights for policy 1, policy_version 1315309 (0.0005) [2023-12-26 10:10:02,753][123091] Updated weights for policy 0, policy_version 1324615 (0.0011) [2023-12-26 10:10:02,789][123090] Updated weights for policy 1, policy_version 1315319 (0.0005) [2023-12-26 10:10:03,541][123091] Updated weights for policy 0, policy_version 1324625 (0.0010) [2023-12-26 10:10:03,562][123090] Updated weights for policy 1, policy_version 1315329 (0.0009) [2023-12-26 10:10:03,600][123091] Updated weights for policy 0, policy_version 1324635 (0.0006) [2023-12-26 10:10:03,607][123090] Updated weights for policy 1, policy_version 1315339 (0.0005) [2023-12-26 10:10:03,648][123091] Updated weights for policy 0, policy_version 1324645 (0.0009) [2023-12-26 10:10:03,656][123090] Updated weights for policy 1, policy_version 1315349 (0.0005) [2023-12-26 10:10:03,703][123091] Updated weights for policy 0, policy_version 1324655 (0.0005) [2023-12-26 10:10:03,708][123090] Updated weights for policy 1, policy_version 1315359 (0.0006) [2023-12-26 10:10:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 675848192. Throughput: 0: 8713.1, 1: 8994.0. Samples: 675852092. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:03,785][121949] Avg episode reward: [(0, '6400.350'), (1, '5125.523')] [2023-12-26 10:10:04,438][123091] Updated weights for policy 0, policy_version 1324665 (0.0010) [2023-12-26 10:10:04,491][123091] Updated weights for policy 0, policy_version 1324675 (0.0009) [2023-12-26 10:10:04,557][123091] Updated weights for policy 0, policy_version 1324685 (0.0008) [2023-12-26 10:10:04,624][123090] Updated weights for policy 1, policy_version 1315369 (0.0009) [2023-12-26 10:10:04,676][123090] Updated weights for policy 1, policy_version 1315379 (0.0008) [2023-12-26 10:10:04,724][123090] Updated weights for policy 1, policy_version 1315389 (0.0009) [2023-12-26 10:10:05,410][123091] Updated weights for policy 0, policy_version 1324695 (0.0011) [2023-12-26 10:10:05,458][123091] Updated weights for policy 0, policy_version 1324705 (0.0010) [2023-12-26 10:10:05,506][123091] Updated weights for policy 0, policy_version 1324715 (0.0010) [2023-12-26 10:10:05,567][123090] Updated weights for policy 1, policy_version 1315399 (0.0007) [2023-12-26 10:10:05,631][123090] Updated weights for policy 1, policy_version 1315409 (0.0005) [2023-12-26 10:10:05,687][123090] Updated weights for policy 1, policy_version 1315419 (0.0005) [2023-12-26 10:10:06,333][123091] Updated weights for policy 0, policy_version 1324725 (0.0010) [2023-12-26 10:10:06,389][123091] Updated weights for policy 0, policy_version 1324735 (0.0009) [2023-12-26 10:10:06,441][123090] Updated weights for policy 1, policy_version 1315429 (0.0005) [2023-12-26 10:10:06,456][123091] Updated weights for policy 0, policy_version 1324745 (0.0010) [2023-12-26 10:10:06,507][123090] Updated weights for policy 1, policy_version 1315439 (0.0008) [2023-12-26 10:10:06,569][123090] Updated weights for policy 1, policy_version 1315449 (0.0009) [2023-12-26 10:10:07,315][123091] Updated weights for policy 0, policy_version 1324755 (0.0010) [2023-12-26 10:10:07,380][123091] Updated weights for policy 0, policy_version 1324765 (0.0009) [2023-12-26 10:10:07,406][123090] Updated weights for policy 1, policy_version 1315459 (0.0008) [2023-12-26 10:10:07,444][123091] Updated weights for policy 0, policy_version 1324775 (0.0010) [2023-12-26 10:10:07,466][123090] Updated weights for policy 1, policy_version 1315469 (0.0008) [2023-12-26 10:10:07,526][123090] Updated weights for policy 1, policy_version 1315479 (0.0009) [2023-12-26 10:10:08,269][123090] Updated weights for policy 1, policy_version 1315489 (0.0007) [2023-12-26 10:10:08,299][123091] Updated weights for policy 0, policy_version 1324785 (0.0009) [2023-12-26 10:10:08,325][123090] Updated weights for policy 1, policy_version 1315499 (0.0008) [2023-12-26 10:10:08,366][123091] Updated weights for policy 0, policy_version 1324795 (0.0008) [2023-12-26 10:10:08,386][123090] Updated weights for policy 1, policy_version 1315509 (0.0009) [2023-12-26 10:10:08,428][123091] Updated weights for policy 0, policy_version 1324805 (0.0009) [2023-12-26 10:10:08,456][123090] Updated weights for policy 1, policy_version 1315519 (0.0007) [2023-12-26 10:10:08,491][123091] Updated weights for policy 0, policy_version 1324815 (0.0007) [2023-12-26 10:10:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 675930112. Throughput: 0: 8734.8, 1: 8984.6. Samples: 675904548. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:08,785][121949] Avg episode reward: [(0, '6413.879'), (1, '4976.167')] [2023-12-26 10:10:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001324816_339156992.pth... [2023-12-26 10:10:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001315520_336773120.pth... [2023-12-26 10:10:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001323792_338894848.pth [2023-12-26 10:10:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001314496_336510976.pth [2023-12-26 10:10:09,265][123090] Updated weights for policy 1, policy_version 1315529 (0.0009) [2023-12-26 10:10:09,323][123090] Updated weights for policy 1, policy_version 1315539 (0.0008) [2023-12-26 10:10:09,340][123091] Updated weights for policy 0, policy_version 1324825 (0.0010) [2023-12-26 10:10:09,392][123090] Updated weights for policy 1, policy_version 1315549 (0.0009) [2023-12-26 10:10:09,412][123091] Updated weights for policy 0, policy_version 1324835 (0.0008) [2023-12-26 10:10:09,479][123091] Updated weights for policy 0, policy_version 1324845 (0.0009) [2023-12-26 10:10:10,258][123090] Updated weights for policy 1, policy_version 1315559 (0.0009) [2023-12-26 10:10:10,319][123090] Updated weights for policy 1, policy_version 1315569 (0.0010) [2023-12-26 10:10:10,327][123091] Updated weights for policy 0, policy_version 1324855 (0.0008) [2023-12-26 10:10:10,372][123090] Updated weights for policy 1, policy_version 1315579 (0.0009) [2023-12-26 10:10:10,393][123091] Updated weights for policy 0, policy_version 1324865 (0.0008) [2023-12-26 10:10:10,461][123091] Updated weights for policy 0, policy_version 1324875 (0.0009) [2023-12-26 10:10:11,215][123091] Updated weights for policy 0, policy_version 1324885 (0.0009) [2023-12-26 10:10:11,273][123090] Updated weights for policy 1, policy_version 1315589 (0.0008) [2023-12-26 10:10:11,275][123091] Updated weights for policy 0, policy_version 1324895 (0.0008) [2023-12-26 10:10:11,329][123091] Updated weights for policy 0, policy_version 1324905 (0.0007) [2023-12-26 10:10:11,336][123090] Updated weights for policy 1, policy_version 1315599 (0.0008) [2023-12-26 10:10:11,410][123090] Updated weights for policy 1, policy_version 1315609 (0.0009) [2023-12-26 10:10:12,156][123091] Updated weights for policy 0, policy_version 1324915 (0.0010) [2023-12-26 10:10:12,217][123091] Updated weights for policy 0, policy_version 1324925 (0.0009) [2023-12-26 10:10:12,273][123090] Updated weights for policy 1, policy_version 1315619 (0.0007) [2023-12-26 10:10:12,285][123091] Updated weights for policy 0, policy_version 1324935 (0.0010) [2023-12-26 10:10:12,338][123090] Updated weights for policy 1, policy_version 1315629 (0.0009) [2023-12-26 10:10:12,405][123090] Updated weights for policy 1, policy_version 1315639 (0.0007) [2023-12-26 10:10:13,134][123091] Updated weights for policy 0, policy_version 1324945 (0.0008) [2023-12-26 10:10:13,196][123091] Updated weights for policy 0, policy_version 1324955 (0.0011) [2023-12-26 10:10:13,201][123090] Updated weights for policy 1, policy_version 1315649 (0.0007) [2023-12-26 10:10:13,251][123091] Updated weights for policy 0, policy_version 1324965 (0.0010) [2023-12-26 10:10:13,254][123090] Updated weights for policy 1, policy_version 1315659 (0.0006) [2023-12-26 10:10:13,299][123091] Updated weights for policy 0, policy_version 1324975 (0.0010) [2023-12-26 10:10:13,307][123090] Updated weights for policy 1, policy_version 1315669 (0.0006) [2023-12-26 10:10:13,353][123090] Updated weights for policy 1, policy_version 1315679 (0.0007) [2023-12-26 10:10:13,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 676012032. Throughput: 0: 8646.5, 1: 8854.4. Samples: 676006216. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:13,786][121949] Avg episode reward: [(0, '6352.779'), (1, '4826.213')] [2023-12-26 10:10:14,054][123090] Updated weights for policy 1, policy_version 1315689 (0.0006) [2023-12-26 10:10:14,100][123091] Updated weights for policy 0, policy_version 1324985 (0.0006) [2023-12-26 10:10:14,108][123090] Updated weights for policy 1, policy_version 1315699 (0.0005) [2023-12-26 10:10:14,152][123091] Updated weights for policy 0, policy_version 1324995 (0.0006) [2023-12-26 10:10:14,170][123090] Updated weights for policy 1, policy_version 1315709 (0.0006) [2023-12-26 10:10:14,218][123091] Updated weights for policy 0, policy_version 1325005 (0.0007) [2023-12-26 10:10:14,857][123090] Updated weights for policy 1, policy_version 1315719 (0.0008) [2023-12-26 10:10:14,913][123090] Updated weights for policy 1, policy_version 1315729 (0.0008) [2023-12-26 10:10:14,960][123091] Updated weights for policy 0, policy_version 1325015 (0.0009) [2023-12-26 10:10:14,976][123090] Updated weights for policy 1, policy_version 1315739 (0.0008) [2023-12-26 10:10:15,024][123091] Updated weights for policy 0, policy_version 1325025 (0.0011) [2023-12-26 10:10:15,095][123091] Updated weights for policy 0, policy_version 1325035 (0.0011) [2023-12-26 10:10:15,841][123090] Updated weights for policy 1, policy_version 1315749 (0.0009) [2023-12-26 10:10:15,904][123090] Updated weights for policy 1, policy_version 1315759 (0.0008) [2023-12-26 10:10:15,910][123091] Updated weights for policy 0, policy_version 1325045 (0.0011) [2023-12-26 10:10:15,967][123090] Updated weights for policy 1, policy_version 1315769 (0.0006) [2023-12-26 10:10:15,972][123091] Updated weights for policy 0, policy_version 1325055 (0.0010) [2023-12-26 10:10:16,037][123091] Updated weights for policy 0, policy_version 1325065 (0.0010) [2023-12-26 10:10:16,801][123090] Updated weights for policy 1, policy_version 1315779 (0.0007) [2023-12-26 10:10:16,840][123091] Updated weights for policy 0, policy_version 1325075 (0.0010) [2023-12-26 10:10:16,864][123090] Updated weights for policy 1, policy_version 1315789 (0.0009) [2023-12-26 10:10:16,905][123091] Updated weights for policy 0, policy_version 1325085 (0.0009) [2023-12-26 10:10:16,925][123090] Updated weights for policy 1, policy_version 1315799 (0.0006) [2023-12-26 10:10:16,959][123091] Updated weights for policy 0, policy_version 1325095 (0.0009) [2023-12-26 10:10:17,714][123090] Updated weights for policy 1, policy_version 1315809 (0.0006) [2023-12-26 10:10:17,767][123090] Updated weights for policy 1, policy_version 1315819 (0.0010) [2023-12-26 10:10:17,799][123091] Updated weights for policy 0, policy_version 1325105 (0.0009) [2023-12-26 10:10:17,824][123090] Updated weights for policy 1, policy_version 1315829 (0.0010) [2023-12-26 10:10:17,861][123091] Updated weights for policy 0, policy_version 1325115 (0.0009) [2023-12-26 10:10:17,888][123090] Updated weights for policy 1, policy_version 1315839 (0.0008) [2023-12-26 10:10:17,918][123091] Updated weights for policy 0, policy_version 1325125 (0.0007) [2023-12-26 10:10:17,970][123091] Updated weights for policy 0, policy_version 1325135 (0.0009) [2023-12-26 10:10:18,741][123090] Updated weights for policy 1, policy_version 1315849 (0.0009) [2023-12-26 10:10:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 676093952. Throughput: 0: 8701.5, 1: 8790.3. Samples: 676112952. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:18,785][121949] Avg episode reward: [(0, '6227.011'), (1, '4968.025')] [2023-12-26 10:10:18,793][123091] Updated weights for policy 0, policy_version 1325145 (0.0007) [2023-12-26 10:10:18,804][123090] Updated weights for policy 1, policy_version 1315859 (0.0009) [2023-12-26 10:10:18,850][123091] Updated weights for policy 0, policy_version 1325155 (0.0008) [2023-12-26 10:10:18,866][123090] Updated weights for policy 1, policy_version 1315869 (0.0008) [2023-12-26 10:10:18,902][123091] Updated weights for policy 0, policy_version 1325165 (0.0008) [2023-12-26 10:10:19,708][123090] Updated weights for policy 1, policy_version 1315879 (0.0008) [2023-12-26 10:10:19,730][123091] Updated weights for policy 0, policy_version 1325175 (0.0009) [2023-12-26 10:10:19,772][123090] Updated weights for policy 1, policy_version 1315889 (0.0009) [2023-12-26 10:10:19,787][123091] Updated weights for policy 0, policy_version 1325185 (0.0009) [2023-12-26 10:10:19,833][123090] Updated weights for policy 1, policy_version 1315899 (0.0007) [2023-12-26 10:10:19,852][123091] Updated weights for policy 0, policy_version 1325195 (0.0008) [2023-12-26 10:10:20,632][123090] Updated weights for policy 1, policy_version 1315909 (0.0008) [2023-12-26 10:10:20,679][123091] Updated weights for policy 0, policy_version 1325205 (0.0008) [2023-12-26 10:10:20,700][123090] Updated weights for policy 1, policy_version 1315919 (0.0009) [2023-12-26 10:10:20,749][123091] Updated weights for policy 0, policy_version 1325215 (0.0008) [2023-12-26 10:10:20,769][123090] Updated weights for policy 1, policy_version 1315929 (0.0008) [2023-12-26 10:10:20,816][123091] Updated weights for policy 0, policy_version 1325225 (0.0008) [2023-12-26 10:10:21,553][123090] Updated weights for policy 1, policy_version 1315939 (0.0006) [2023-12-26 10:10:21,607][123090] Updated weights for policy 1, policy_version 1315949 (0.0006) [2023-12-26 10:10:21,672][123091] Updated weights for policy 0, policy_version 1325235 (0.0009) [2023-12-26 10:10:21,695][123090] Updated weights for policy 1, policy_version 1315959 (0.0007) [2023-12-26 10:10:21,740][123091] Updated weights for policy 0, policy_version 1325245 (0.0007) [2023-12-26 10:10:21,816][123091] Updated weights for policy 0, policy_version 1325255 (0.0009) [2023-12-26 10:10:22,475][123090] Updated weights for policy 1, policy_version 1315969 (0.0008) [2023-12-26 10:10:22,532][123090] Updated weights for policy 1, policy_version 1315979 (0.0008) [2023-12-26 10:10:22,592][123090] Updated weights for policy 1, policy_version 1315989 (0.0005) [2023-12-26 10:10:22,626][123091] Updated weights for policy 0, policy_version 1325265 (0.0009) [2023-12-26 10:10:22,666][123090] Updated weights for policy 1, policy_version 1315999 (0.0008) [2023-12-26 10:10:22,687][123091] Updated weights for policy 0, policy_version 1325275 (0.0006) [2023-12-26 10:10:22,743][123091] Updated weights for policy 0, policy_version 1325285 (0.0005) [2023-12-26 10:10:22,813][123091] Updated weights for policy 0, policy_version 1325295 (0.0005) [2023-12-26 10:10:23,432][123091] Updated weights for policy 0, policy_version 1325305 (0.0009) [2023-12-26 10:10:23,498][123091] Updated weights for policy 0, policy_version 1325315 (0.0007) [2023-12-26 10:10:23,501][123090] Updated weights for policy 1, policy_version 1316009 (0.0008) [2023-12-26 10:10:23,558][123091] Updated weights for policy 0, policy_version 1325325 (0.0005) [2023-12-26 10:10:23,566][123090] Updated weights for policy 1, policy_version 1316019 (0.0008) [2023-12-26 10:10:23,619][123090] Updated weights for policy 1, policy_version 1316029 (0.0008) [2023-12-26 10:10:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 676192256. Throughput: 0: 8665.9, 1: 8806.1. Samples: 676164032. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:23,786][121949] Avg episode reward: [(0, '6251.590'), (1, '5053.645')] [2023-12-26 10:10:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001325328_339288064.pth... [2023-12-26 10:10:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001316032_336904192.pth... [2023-12-26 10:10:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001324336_339034112.pth [2023-12-26 10:10:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001314976_336633856.pth [2023-12-26 10:10:24,377][123091] Updated weights for policy 0, policy_version 1325335 (0.0009) [2023-12-26 10:10:24,439][123091] Updated weights for policy 0, policy_version 1325345 (0.0009) [2023-12-26 10:10:24,457][123090] Updated weights for policy 1, policy_version 1316039 (0.0010) [2023-12-26 10:10:24,497][123091] Updated weights for policy 0, policy_version 1325355 (0.0008) [2023-12-26 10:10:24,504][123090] Updated weights for policy 1, policy_version 1316049 (0.0010) [2023-12-26 10:10:24,559][123090] Updated weights for policy 1, policy_version 1316059 (0.0010) [2023-12-26 10:10:25,202][123091] Updated weights for policy 0, policy_version 1325365 (0.0007) [2023-12-26 10:10:25,260][123091] Updated weights for policy 0, policy_version 1325375 (0.0006) [2023-12-26 10:10:25,262][123090] Updated weights for policy 1, policy_version 1316069 (0.0008) [2023-12-26 10:10:25,312][123090] Updated weights for policy 1, policy_version 1316079 (0.0005) [2023-12-26 10:10:25,320][123091] Updated weights for policy 0, policy_version 1325385 (0.0005) [2023-12-26 10:10:25,370][123090] Updated weights for policy 1, policy_version 1316089 (0.0005) [2023-12-26 10:10:26,038][123090] Updated weights for policy 1, policy_version 1316099 (0.0005) [2023-12-26 10:10:26,102][123090] Updated weights for policy 1, policy_version 1316109 (0.0005) [2023-12-26 10:10:26,112][123091] Updated weights for policy 0, policy_version 1325395 (0.0007) [2023-12-26 10:10:26,163][123091] Updated weights for policy 0, policy_version 1325405 (0.0010) [2023-12-26 10:10:26,164][123090] Updated weights for policy 1, policy_version 1316119 (0.0005) [2023-12-26 10:10:26,207][123091] Updated weights for policy 0, policy_version 1325415 (0.0010) [2023-12-26 10:10:26,839][123090] Updated weights for policy 1, policy_version 1316129 (0.0006) [2023-12-26 10:10:26,894][123090] Updated weights for policy 1, policy_version 1316139 (0.0006) [2023-12-26 10:10:26,950][123090] Updated weights for policy 1, policy_version 1316149 (0.0008) [2023-12-26 10:10:26,995][123090] Updated weights for policy 1, policy_version 1316159 (0.0009) [2023-12-26 10:10:27,014][123091] Updated weights for policy 0, policy_version 1325425 (0.0010) [2023-12-26 10:10:27,063][123091] Updated weights for policy 0, policy_version 1325435 (0.0009) [2023-12-26 10:10:27,115][123091] Updated weights for policy 0, policy_version 1325445 (0.0010) [2023-12-26 10:10:27,166][123091] Updated weights for policy 0, policy_version 1325455 (0.0009) [2023-12-26 10:10:27,723][123090] Updated weights for policy 1, policy_version 1316169 (0.0008) [2023-12-26 10:10:27,771][123090] Updated weights for policy 1, policy_version 1316179 (0.0008) [2023-12-26 10:10:27,819][123090] Updated weights for policy 1, policy_version 1316189 (0.0006) [2023-12-26 10:10:27,992][123091] Updated weights for policy 0, policy_version 1325465 (0.0009) [2023-12-26 10:10:28,062][123091] Updated weights for policy 0, policy_version 1325475 (0.0009) [2023-12-26 10:10:28,134][123091] Updated weights for policy 0, policy_version 1325485 (0.0009) [2023-12-26 10:10:28,568][123090] Updated weights for policy 1, policy_version 1316199 (0.0005) [2023-12-26 10:10:28,637][123090] Updated weights for policy 1, policy_version 1316209 (0.0005) [2023-12-26 10:10:28,701][123090] Updated weights for policy 1, policy_version 1316219 (0.0006) [2023-12-26 10:10:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 676282368. Throughput: 0: 8689.6, 1: 8942.0. Samples: 676274760. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:28,785][121949] Avg episode reward: [(0, '6321.246'), (1, '5328.952')] [2023-12-26 10:10:28,928][123091] Updated weights for policy 0, policy_version 1325495 (0.0010) [2023-12-26 10:10:28,978][123091] Updated weights for policy 0, policy_version 1325505 (0.0010) [2023-12-26 10:10:29,036][123091] Updated weights for policy 0, policy_version 1325515 (0.0010) [2023-12-26 10:10:29,376][123090] Updated weights for policy 1, policy_version 1316229 (0.0008) [2023-12-26 10:10:29,434][123090] Updated weights for policy 1, policy_version 1316239 (0.0011) [2023-12-26 10:10:29,509][123090] Updated weights for policy 1, policy_version 1316249 (0.0009) [2023-12-26 10:10:29,777][123091] Updated weights for policy 0, policy_version 1325525 (0.0008) [2023-12-26 10:10:29,832][123091] Updated weights for policy 0, policy_version 1325535 (0.0006) [2023-12-26 10:10:29,899][123091] Updated weights for policy 0, policy_version 1325545 (0.0008) [2023-12-26 10:10:30,387][123090] Updated weights for policy 1, policy_version 1316259 (0.0009) [2023-12-26 10:10:30,460][123090] Updated weights for policy 1, policy_version 1316269 (0.0008) [2023-12-26 10:10:30,528][123090] Updated weights for policy 1, policy_version 1316279 (0.0009) [2023-12-26 10:10:30,652][123091] Updated weights for policy 0, policy_version 1325555 (0.0010) [2023-12-26 10:10:30,704][123091] Updated weights for policy 0, policy_version 1325565 (0.0009) [2023-12-26 10:10:30,776][123091] Updated weights for policy 0, policy_version 1325575 (0.0009) [2023-12-26 10:10:31,346][123090] Updated weights for policy 1, policy_version 1316289 (0.0009) [2023-12-26 10:10:31,419][123090] Updated weights for policy 1, policy_version 1316299 (0.0009) [2023-12-26 10:10:31,480][123090] Updated weights for policy 1, policy_version 1316309 (0.0009) [2023-12-26 10:10:31,540][123090] Updated weights for policy 1, policy_version 1316319 (0.0009) [2023-12-26 10:10:31,636][123091] Updated weights for policy 0, policy_version 1325585 (0.0009) [2023-12-26 10:10:31,688][123091] Updated weights for policy 0, policy_version 1325595 (0.0010) [2023-12-26 10:10:31,755][123091] Updated weights for policy 0, policy_version 1325605 (0.0009) [2023-12-26 10:10:31,820][123091] Updated weights for policy 0, policy_version 1325615 (0.0009) [2023-12-26 10:10:32,302][123090] Updated weights for policy 1, policy_version 1316329 (0.0010) [2023-12-26 10:10:32,369][123090] Updated weights for policy 1, policy_version 1316339 (0.0009) [2023-12-26 10:10:32,439][123090] Updated weights for policy 1, policy_version 1316349 (0.0010) [2023-12-26 10:10:32,669][123091] Updated weights for policy 0, policy_version 1325625 (0.0010) [2023-12-26 10:10:32,736][123091] Updated weights for policy 0, policy_version 1325635 (0.0010) [2023-12-26 10:10:32,799][123091] Updated weights for policy 0, policy_version 1325645 (0.0009) [2023-12-26 10:10:33,196][123090] Updated weights for policy 1, policy_version 1316359 (0.0007) [2023-12-26 10:10:33,250][123090] Updated weights for policy 1, policy_version 1316369 (0.0005) [2023-12-26 10:10:33,306][123090] Updated weights for policy 1, policy_version 1316380 (0.0009) [2023-12-26 10:10:33,666][123091] Updated weights for policy 0, policy_version 1325655 (0.0010) [2023-12-26 10:10:33,723][123091] Updated weights for policy 0, policy_version 1325665 (0.0010) [2023-12-26 10:10:33,775][123091] Updated weights for policy 0, policy_version 1325676 (0.0009) [2023-12-26 10:10:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 676364288. Throughput: 0: 8672.0, 1: 8961.2. Samples: 676380724. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:33,785][121949] Avg episode reward: [(0, '6290.813'), (1, '5363.451')] [2023-12-26 10:10:33,975][123090] Updated weights for policy 1, policy_version 1316390 (0.0009) [2023-12-26 10:10:34,039][123090] Updated weights for policy 1, policy_version 1316400 (0.0008) [2023-12-26 10:10:34,105][123090] Updated weights for policy 1, policy_version 1316410 (0.0009) [2023-12-26 10:10:34,644][123091] Updated weights for policy 0, policy_version 1325687 (0.0011) [2023-12-26 10:10:34,697][123091] Updated weights for policy 0, policy_version 1325697 (0.0011) [2023-12-26 10:10:34,761][123091] Updated weights for policy 0, policy_version 1325707 (0.0011) [2023-12-26 10:10:34,946][123090] Updated weights for policy 1, policy_version 1316420 (0.0009) [2023-12-26 10:10:35,001][123090] Updated weights for policy 1, policy_version 1316430 (0.0010) [2023-12-26 10:10:35,057][123090] Updated weights for policy 1, policy_version 1316441 (0.0011) [2023-12-26 10:10:35,468][123091] Updated weights for policy 0, policy_version 1325717 (0.0011) [2023-12-26 10:10:35,524][123091] Updated weights for policy 0, policy_version 1325727 (0.0011) [2023-12-26 10:10:35,572][123091] Updated weights for policy 0, policy_version 1325737 (0.0010) [2023-12-26 10:10:35,923][123090] Updated weights for policy 1, policy_version 1316451 (0.0008) [2023-12-26 10:10:35,974][123090] Updated weights for policy 1, policy_version 1316461 (0.0005) [2023-12-26 10:10:36,027][123090] Updated weights for policy 1, policy_version 1316471 (0.0008) [2023-12-26 10:10:36,395][123091] Updated weights for policy 0, policy_version 1325747 (0.0009) [2023-12-26 10:10:36,462][123091] Updated weights for policy 0, policy_version 1325757 (0.0009) [2023-12-26 10:10:36,524][123091] Updated weights for policy 0, policy_version 1325767 (0.0011) [2023-12-26 10:10:36,909][123090] Updated weights for policy 1, policy_version 1316482 (0.0010) [2023-12-26 10:10:36,962][123090] Updated weights for policy 1, policy_version 1316492 (0.0009) [2023-12-26 10:10:37,012][123090] Updated weights for policy 1, policy_version 1316502 (0.0010) [2023-12-26 10:10:37,075][123090] Updated weights for policy 1, policy_version 1316512 (0.0010) [2023-12-26 10:10:37,324][123091] Updated weights for policy 0, policy_version 1325777 (0.0011) [2023-12-26 10:10:37,390][123091] Updated weights for policy 0, policy_version 1325787 (0.0008) [2023-12-26 10:10:37,462][123091] Updated weights for policy 0, policy_version 1325797 (0.0009) [2023-12-26 10:10:37,531][123091] Updated weights for policy 0, policy_version 1325807 (0.0009) [2023-12-26 10:10:37,938][123090] Updated weights for policy 1, policy_version 1316522 (0.0009) [2023-12-26 10:10:37,990][123090] Updated weights for policy 1, policy_version 1316532 (0.0009) [2023-12-26 10:10:38,040][123090] Updated weights for policy 1, policy_version 1316542 (0.0009) [2023-12-26 10:10:38,322][123091] Updated weights for policy 0, policy_version 1325817 (0.0007) [2023-12-26 10:10:38,385][123091] Updated weights for policy 0, policy_version 1325827 (0.0009) [2023-12-26 10:10:38,447][123091] Updated weights for policy 0, policy_version 1325837 (0.0009) [2023-12-26 10:10:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 676454400. Throughput: 0: 8690.7, 1: 8950.7. Samples: 676433068. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:38,785][121949] Avg episode reward: [(0, '6303.316'), (1, '5059.969')] [2023-12-26 10:10:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001325840_339419136.pth... [2023-12-26 10:10:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001316544_337035264.pth... [2023-12-26 10:10:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001324816_339156992.pth [2023-12-26 10:10:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001315520_336773120.pth [2023-12-26 10:10:38,897][123090] Updated weights for policy 1, policy_version 1316552 (0.0007) [2023-12-26 10:10:38,971][123090] Updated weights for policy 1, policy_version 1316562 (0.0006) [2023-12-26 10:10:39,024][123090] Updated weights for policy 1, policy_version 1316572 (0.0005) [2023-12-26 10:10:39,212][123091] Updated weights for policy 0, policy_version 1325847 (0.0006) [2023-12-26 10:10:39,279][123091] Updated weights for policy 0, policy_version 1325857 (0.0008) [2023-12-26 10:10:39,348][123091] Updated weights for policy 0, policy_version 1325867 (0.0006) [2023-12-26 10:10:39,785][123090] Updated weights for policy 1, policy_version 1316582 (0.0009) [2023-12-26 10:10:39,852][123090] Updated weights for policy 1, policy_version 1316592 (0.0011) [2023-12-26 10:10:39,920][123090] Updated weights for policy 1, policy_version 1316602 (0.0013) [2023-12-26 10:10:40,190][123091] Updated weights for policy 0, policy_version 1325877 (0.0008) [2023-12-26 10:10:40,259][123091] Updated weights for policy 0, policy_version 1325887 (0.0006) [2023-12-26 10:10:40,326][123091] Updated weights for policy 0, policy_version 1325897 (0.0007) [2023-12-26 10:10:40,663][123090] Updated weights for policy 1, policy_version 1316612 (0.0008) [2023-12-26 10:10:40,722][123090] Updated weights for policy 1, policy_version 1316622 (0.0010) [2023-12-26 10:10:40,784][123090] Updated weights for policy 1, policy_version 1316632 (0.0010) [2023-12-26 10:10:41,134][123091] Updated weights for policy 0, policy_version 1325907 (0.0009) [2023-12-26 10:10:41,204][123091] Updated weights for policy 0, policy_version 1325917 (0.0008) [2023-12-26 10:10:41,267][123091] Updated weights for policy 0, policy_version 1325927 (0.0008) [2023-12-26 10:10:41,657][123090] Updated weights for policy 1, policy_version 1316642 (0.0010) [2023-12-26 10:10:41,728][123090] Updated weights for policy 1, policy_version 1316652 (0.0011) [2023-12-26 10:10:41,799][123090] Updated weights for policy 1, policy_version 1316662 (0.0009) [2023-12-26 10:10:41,862][123090] Updated weights for policy 1, policy_version 1316672 (0.0008) [2023-12-26 10:10:42,074][123091] Updated weights for policy 0, policy_version 1325937 (0.0009) [2023-12-26 10:10:42,131][123091] Updated weights for policy 0, policy_version 1325947 (0.0009) [2023-12-26 10:10:42,193][123091] Updated weights for policy 0, policy_version 1325957 (0.0009) [2023-12-26 10:10:42,247][123091] Updated weights for policy 0, policy_version 1325967 (0.0006) [2023-12-26 10:10:42,655][123090] Updated weights for policy 1, policy_version 1316682 (0.0007) [2023-12-26 10:10:42,724][123090] Updated weights for policy 1, policy_version 1316692 (0.0005) [2023-12-26 10:10:42,786][123090] Updated weights for policy 1, policy_version 1316702 (0.0005) [2023-12-26 10:10:43,113][123091] Updated weights for policy 0, policy_version 1325977 (0.0009) [2023-12-26 10:10:43,174][123091] Updated weights for policy 0, policy_version 1325987 (0.0009) [2023-12-26 10:10:43,235][123091] Updated weights for policy 0, policy_version 1325997 (0.0009) [2023-12-26 10:10:43,565][123090] Updated weights for policy 1, policy_version 1316712 (0.0009) [2023-12-26 10:10:43,628][123090] Updated weights for policy 1, policy_version 1316722 (0.0010) [2023-12-26 10:10:43,693][123090] Updated weights for policy 1, policy_version 1316732 (0.0010) [2023-12-26 10:10:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 676544512. Throughput: 0: 8691.6, 1: 8809.7. Samples: 676536940. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:43,785][121949] Avg episode reward: [(0, '6274.583'), (1, '5095.274')] [2023-12-26 10:10:44,040][123091] Updated weights for policy 0, policy_version 1326007 (0.0009) [2023-12-26 10:10:44,111][123091] Updated weights for policy 0, policy_version 1326017 (0.0009) [2023-12-26 10:10:44,181][123091] Updated weights for policy 0, policy_version 1326027 (0.0009) [2023-12-26 10:10:44,412][123090] Updated weights for policy 1, policy_version 1316742 (0.0007) [2023-12-26 10:10:44,464][123090] Updated weights for policy 1, policy_version 1316752 (0.0006) [2023-12-26 10:10:44,533][123090] Updated weights for policy 1, policy_version 1316762 (0.0008) [2023-12-26 10:10:44,919][123091] Updated weights for policy 0, policy_version 1326037 (0.0010) [2023-12-26 10:10:44,979][123091] Updated weights for policy 0, policy_version 1326047 (0.0010) [2023-12-26 10:10:45,045][123091] Updated weights for policy 0, policy_version 1326057 (0.0010) [2023-12-26 10:10:45,256][123090] Updated weights for policy 1, policy_version 1316772 (0.0005) [2023-12-26 10:10:45,315][123090] Updated weights for policy 1, policy_version 1316782 (0.0008) [2023-12-26 10:10:45,386][123090] Updated weights for policy 1, policy_version 1316792 (0.0005) [2023-12-26 10:10:45,901][123091] Updated weights for policy 0, policy_version 1326067 (0.0009) [2023-12-26 10:10:45,962][123091] Updated weights for policy 0, policy_version 1326077 (0.0009) [2023-12-26 10:10:46,027][123091] Updated weights for policy 0, policy_version 1326087 (0.0008) [2023-12-26 10:10:46,098][123090] Updated weights for policy 1, policy_version 1316802 (0.0008) [2023-12-26 10:10:46,166][123090] Updated weights for policy 1, policy_version 1316812 (0.0005) [2023-12-26 10:10:46,244][123090] Updated weights for policy 1, policy_version 1316822 (0.0005) [2023-12-26 10:10:46,317][123090] Updated weights for policy 1, policy_version 1316832 (0.0005) [2023-12-26 10:10:46,921][123091] Updated weights for policy 0, policy_version 1326097 (0.0009) [2023-12-26 10:10:46,957][123090] Updated weights for policy 1, policy_version 1316842 (0.0006) [2023-12-26 10:10:46,989][123091] Updated weights for policy 0, policy_version 1326107 (0.0008) [2023-12-26 10:10:47,029][123090] Updated weights for policy 1, policy_version 1316852 (0.0006) [2023-12-26 10:10:47,050][123091] Updated weights for policy 0, policy_version 1326117 (0.0010) [2023-12-26 10:10:47,098][123090] Updated weights for policy 1, policy_version 1316862 (0.0006) [2023-12-26 10:10:47,100][123091] Updated weights for policy 0, policy_version 1326127 (0.0009) [2023-12-26 10:10:47,715][123090] Updated weights for policy 1, policy_version 1316872 (0.0007) [2023-12-26 10:10:47,781][123090] Updated weights for policy 1, policy_version 1316882 (0.0008) [2023-12-26 10:10:47,848][123090] Updated weights for policy 1, policy_version 1316892 (0.0009) [2023-12-26 10:10:48,013][123091] Updated weights for policy 0, policy_version 1326137 (0.0010) [2023-12-26 10:10:48,067][123091] Updated weights for policy 0, policy_version 1326147 (0.0009) [2023-12-26 10:10:48,133][123091] Updated weights for policy 0, policy_version 1326157 (0.0009) [2023-12-26 10:10:48,659][123090] Updated weights for policy 1, policy_version 1316902 (0.0009) [2023-12-26 10:10:48,715][123090] Updated weights for policy 1, policy_version 1316912 (0.0010) [2023-12-26 10:10:48,775][123090] Updated weights for policy 1, policy_version 1316922 (0.0009) [2023-12-26 10:10:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 676626432. Throughput: 0: 8680.5, 1: 8934.4. Samples: 676644756. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:48,785][121949] Avg episode reward: [(0, '6387.326'), (1, '5197.331')] [2023-12-26 10:10:48,983][123091] Updated weights for policy 0, policy_version 1326168 (0.0010) [2023-12-26 10:10:49,043][123091] Updated weights for policy 0, policy_version 1326178 (0.0009) [2023-12-26 10:10:49,097][123091] Updated weights for policy 0, policy_version 1326188 (0.0009) [2023-12-26 10:10:49,610][123090] Updated weights for policy 1, policy_version 1316932 (0.0010) [2023-12-26 10:10:49,666][123090] Updated weights for policy 1, policy_version 1316942 (0.0010) [2023-12-26 10:10:49,716][123090] Updated weights for policy 1, policy_version 1316952 (0.0009) [2023-12-26 10:10:49,970][123091] Updated weights for policy 0, policy_version 1326198 (0.0009) [2023-12-26 10:10:50,034][123091] Updated weights for policy 0, policy_version 1326208 (0.0010) [2023-12-26 10:10:50,100][123091] Updated weights for policy 0, policy_version 1326218 (0.0009) [2023-12-26 10:10:50,469][123090] Updated weights for policy 1, policy_version 1316962 (0.0005) [2023-12-26 10:10:50,524][123090] Updated weights for policy 1, policy_version 1316972 (0.0008) [2023-12-26 10:10:50,590][123090] Updated weights for policy 1, policy_version 1316982 (0.0007) [2023-12-26 10:10:50,645][123090] Updated weights for policy 1, policy_version 1316992 (0.0008) [2023-12-26 10:10:50,979][123091] Updated weights for policy 0, policy_version 1326228 (0.0009) [2023-12-26 10:10:51,045][123091] Updated weights for policy 0, policy_version 1326238 (0.0009) [2023-12-26 10:10:51,115][123091] Updated weights for policy 0, policy_version 1326248 (0.0010) [2023-12-26 10:10:51,461][123090] Updated weights for policy 1, policy_version 1317002 (0.0006) [2023-12-26 10:10:51,522][123090] Updated weights for policy 1, policy_version 1317012 (0.0005) [2023-12-26 10:10:51,587][123090] Updated weights for policy 1, policy_version 1317022 (0.0009) [2023-12-26 10:10:51,898][123091] Updated weights for policy 0, policy_version 1326258 (0.0007) [2023-12-26 10:10:51,967][123091] Updated weights for policy 0, policy_version 1326268 (0.0009) [2023-12-26 10:10:52,028][123091] Updated weights for policy 0, policy_version 1326278 (0.0010) [2023-12-26 10:10:52,083][123091] Updated weights for policy 0, policy_version 1326288 (0.0010) [2023-12-26 10:10:52,315][123090] Updated weights for policy 1, policy_version 1317032 (0.0009) [2023-12-26 10:10:52,386][123090] Updated weights for policy 1, policy_version 1317042 (0.0008) [2023-12-26 10:10:52,448][123090] Updated weights for policy 1, policy_version 1317052 (0.0008) [2023-12-26 10:10:52,881][123091] Updated weights for policy 0, policy_version 1326298 (0.0009) [2023-12-26 10:10:52,937][123091] Updated weights for policy 0, policy_version 1326308 (0.0010) [2023-12-26 10:10:53,004][123091] Updated weights for policy 0, policy_version 1326318 (0.0009) [2023-12-26 10:10:53,278][123090] Updated weights for policy 1, policy_version 1317062 (0.0010) [2023-12-26 10:10:53,337][123090] Updated weights for policy 1, policy_version 1317072 (0.0010) [2023-12-26 10:10:53,388][123090] Updated weights for policy 1, policy_version 1317082 (0.0009) [2023-12-26 10:10:53,743][123091] Updated weights for policy 0, policy_version 1326328 (0.0010) [2023-12-26 10:10:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 676716544. Throughput: 0: 8638.8, 1: 8939.3. Samples: 676695564. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:53,785][121949] Avg episode reward: [(0, '6381.435'), (1, '5014.390')] [2023-12-26 10:10:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001317088_337174528.pth... [2023-12-26 10:10:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001316032_336904192.pth [2023-12-26 10:10:53,798][123091] Updated weights for policy 0, policy_version 1326338 (0.0010) [2023-12-26 10:10:53,858][123091] Updated weights for policy 0, policy_version 1326348 (0.0009) [2023-12-26 10:10:53,882][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001326352_339550208.pth... [2023-12-26 10:10:53,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001325328_339288064.pth [2023-12-26 10:10:54,186][123090] Updated weights for policy 1, policy_version 1317092 (0.0009) [2023-12-26 10:10:54,250][123090] Updated weights for policy 1, policy_version 1317102 (0.0009) [2023-12-26 10:10:54,314][123090] Updated weights for policy 1, policy_version 1317112 (0.0009) [2023-12-26 10:10:54,675][123091] Updated weights for policy 0, policy_version 1326358 (0.0009) [2023-12-26 10:10:54,727][123091] Updated weights for policy 0, policy_version 1326368 (0.0009) [2023-12-26 10:10:54,780][123091] Updated weights for policy 0, policy_version 1326379 (0.0010) [2023-12-26 10:10:55,067][123090] Updated weights for policy 1, policy_version 1317122 (0.0009) [2023-12-26 10:10:55,117][123090] Updated weights for policy 1, policy_version 1317132 (0.0009) [2023-12-26 10:10:55,170][123090] Updated weights for policy 1, policy_version 1317142 (0.0010) [2023-12-26 10:10:55,219][123090] Updated weights for policy 1, policy_version 1317152 (0.0008) [2023-12-26 10:10:55,602][123091] Updated weights for policy 0, policy_version 1326389 (0.0010) [2023-12-26 10:10:55,650][123091] Updated weights for policy 0, policy_version 1326399 (0.0005) [2023-12-26 10:10:55,704][123091] Updated weights for policy 0, policy_version 1326409 (0.0005) [2023-12-26 10:10:56,090][123090] Updated weights for policy 1, policy_version 1317162 (0.0009) [2023-12-26 10:10:56,140][123090] Updated weights for policy 1, policy_version 1317172 (0.0010) [2023-12-26 10:10:56,195][123090] Updated weights for policy 1, policy_version 1317182 (0.0009) [2023-12-26 10:10:56,510][123091] Updated weights for policy 0, policy_version 1326419 (0.0007) [2023-12-26 10:10:56,568][123091] Updated weights for policy 0, policy_version 1326429 (0.0008) [2023-12-26 10:10:56,621][123091] Updated weights for policy 0, policy_version 1326439 (0.0009) [2023-12-26 10:10:57,052][123090] Updated weights for policy 1, policy_version 1317192 (0.0009) [2023-12-26 10:10:57,111][123090] Updated weights for policy 1, policy_version 1317202 (0.0009) [2023-12-26 10:10:57,185][123090] Updated weights for policy 1, policy_version 1317212 (0.0009) [2023-12-26 10:10:57,442][123091] Updated weights for policy 0, policy_version 1326449 (0.0009) [2023-12-26 10:10:57,494][123091] Updated weights for policy 0, policy_version 1326459 (0.0010) [2023-12-26 10:10:57,557][123091] Updated weights for policy 0, policy_version 1326469 (0.0009) [2023-12-26 10:10:57,610][123091] Updated weights for policy 0, policy_version 1326479 (0.0009) [2023-12-26 10:10:58,025][123090] Updated weights for policy 1, policy_version 1317222 (0.0009) [2023-12-26 10:10:58,087][123090] Updated weights for policy 1, policy_version 1317232 (0.0010) [2023-12-26 10:10:58,156][123090] Updated weights for policy 1, policy_version 1317242 (0.0009) [2023-12-26 10:10:58,388][123091] Updated weights for policy 0, policy_version 1326489 (0.0009) [2023-12-26 10:10:58,452][123091] Updated weights for policy 0, policy_version 1326499 (0.0010) [2023-12-26 10:10:58,521][123091] Updated weights for policy 0, policy_version 1326509 (0.0009) [2023-12-26 10:10:58,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 676806656. Throughput: 0: 8694.6, 1: 8982.4. Samples: 676801680. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:10:58,785][121949] Avg episode reward: [(0, '6364.862'), (1, '5311.043')] [2023-12-26 10:10:59,021][123090] Updated weights for policy 1, policy_version 1317252 (0.0008) [2023-12-26 10:10:59,083][123090] Updated weights for policy 1, policy_version 1317262 (0.0007) [2023-12-26 10:10:59,150][123090] Updated weights for policy 1, policy_version 1317272 (0.0009) [2023-12-26 10:10:59,412][123091] Updated weights for policy 0, policy_version 1326519 (0.0007) [2023-12-26 10:10:59,469][123091] Updated weights for policy 0, policy_version 1326529 (0.0006) [2023-12-26 10:10:59,538][123091] Updated weights for policy 0, policy_version 1326539 (0.0006) [2023-12-26 10:11:00,011][123090] Updated weights for policy 1, policy_version 1317282 (0.0010) [2023-12-26 10:11:00,063][123090] Updated weights for policy 1, policy_version 1317292 (0.0009) [2023-12-26 10:11:00,128][123090] Updated weights for policy 1, policy_version 1317302 (0.0009) [2023-12-26 10:11:00,187][123090] Updated weights for policy 1, policy_version 1317312 (0.0009) [2023-12-26 10:11:00,202][123091] Updated weights for policy 0, policy_version 1326549 (0.0007) [2023-12-26 10:11:00,263][123091] Updated weights for policy 0, policy_version 1326559 (0.0010) [2023-12-26 10:11:00,324][123091] Updated weights for policy 0, policy_version 1326569 (0.0009) [2023-12-26 10:11:00,901][123090] Updated weights for policy 1, policy_version 1317322 (0.0009) [2023-12-26 10:11:00,953][123090] Updated weights for policy 1, policy_version 1317332 (0.0009) [2023-12-26 10:11:01,012][123090] Updated weights for policy 1, policy_version 1317342 (0.0009) [2023-12-26 10:11:01,067][123091] Updated weights for policy 0, policy_version 1326579 (0.0010) [2023-12-26 10:11:01,130][123091] Updated weights for policy 0, policy_version 1326589 (0.0011) [2023-12-26 10:11:01,197][123091] Updated weights for policy 0, policy_version 1326599 (0.0011) [2023-12-26 10:11:01,832][123090] Updated weights for policy 1, policy_version 1317352 (0.0007) [2023-12-26 10:11:01,900][123090] Updated weights for policy 1, policy_version 1317362 (0.0007) [2023-12-26 10:11:01,968][123090] Updated weights for policy 1, policy_version 1317372 (0.0007) [2023-12-26 10:11:01,982][123091] Updated weights for policy 0, policy_version 1326609 (0.0009) [2023-12-26 10:11:02,041][123091] Updated weights for policy 0, policy_version 1326619 (0.0006) [2023-12-26 10:11:02,097][123091] Updated weights for policy 0, policy_version 1326629 (0.0006) [2023-12-26 10:11:02,157][123091] Updated weights for policy 0, policy_version 1326639 (0.0006) [2023-12-26 10:11:02,789][123090] Updated weights for policy 1, policy_version 1317382 (0.0010) [2023-12-26 10:11:02,848][123090] Updated weights for policy 1, policy_version 1317392 (0.0011) [2023-12-26 10:11:02,912][123090] Updated weights for policy 1, policy_version 1317402 (0.0011) [2023-12-26 10:11:02,929][123091] Updated weights for policy 0, policy_version 1326649 (0.0007) [2023-12-26 10:11:02,980][123091] Updated weights for policy 0, policy_version 1326659 (0.0006) [2023-12-26 10:11:03,035][123091] Updated weights for policy 0, policy_version 1326669 (0.0005) [2023-12-26 10:11:03,729][123090] Updated weights for policy 1, policy_version 1317412 (0.0010) [2023-12-26 10:11:03,753][123091] Updated weights for policy 0, policy_version 1326679 (0.0005) [2023-12-26 10:11:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 676888576. Throughput: 0: 8744.3, 1: 8903.2. Samples: 676907088. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:11:03,784][121949] Avg episode reward: [(0, '6260.798'), (1, '5496.436')] [2023-12-26 10:11:03,792][123090] Updated weights for policy 1, policy_version 1317422 (0.0010) [2023-12-26 10:11:03,802][123091] Updated weights for policy 0, policy_version 1326689 (0.0005) [2023-12-26 10:11:03,859][123090] Updated weights for policy 1, policy_version 1317432 (0.0008) [2023-12-26 10:11:03,868][123091] Updated weights for policy 0, policy_version 1326699 (0.0007) [2023-12-26 10:11:04,570][123090] Updated weights for policy 1, policy_version 1317442 (0.0006) [2023-12-26 10:11:04,630][123091] Updated weights for policy 0, policy_version 1326709 (0.0009) [2023-12-26 10:11:04,650][123090] Updated weights for policy 1, policy_version 1317452 (0.0006) [2023-12-26 10:11:04,686][123091] Updated weights for policy 0, policy_version 1326719 (0.0011) [2023-12-26 10:11:04,704][123090] Updated weights for policy 1, policy_version 1317462 (0.0006) [2023-12-26 10:11:04,754][123091] Updated weights for policy 0, policy_version 1326729 (0.0011) [2023-12-26 10:11:04,757][123090] Updated weights for policy 1, policy_version 1317472 (0.0005) [2023-12-26 10:11:05,440][123090] Updated weights for policy 1, policy_version 1317482 (0.0010) [2023-12-26 10:11:05,448][123091] Updated weights for policy 0, policy_version 1326739 (0.0009) [2023-12-26 10:11:05,492][123090] Updated weights for policy 1, policy_version 1317492 (0.0010) [2023-12-26 10:11:05,513][123091] Updated weights for policy 0, policy_version 1326749 (0.0006) [2023-12-26 10:11:05,543][123090] Updated weights for policy 1, policy_version 1317502 (0.0010) [2023-12-26 10:11:05,577][123091] Updated weights for policy 0, policy_version 1326759 (0.0006) [2023-12-26 10:11:06,348][123091] Updated weights for policy 0, policy_version 1326769 (0.0007) [2023-12-26 10:11:06,409][123091] Updated weights for policy 0, policy_version 1326779 (0.0006) [2023-12-26 10:11:06,421][123090] Updated weights for policy 1, policy_version 1317512 (0.0009) [2023-12-26 10:11:06,473][123090] Updated weights for policy 1, policy_version 1317522 (0.0009) [2023-12-26 10:11:06,478][123091] Updated weights for policy 0, policy_version 1326789 (0.0008) [2023-12-26 10:11:06,538][123090] Updated weights for policy 1, policy_version 1317532 (0.0008) [2023-12-26 10:11:06,539][123091] Updated weights for policy 0, policy_version 1326799 (0.0008) [2023-12-26 10:11:07,265][123091] Updated weights for policy 0, policy_version 1326809 (0.0005) [2023-12-26 10:11:07,323][123091] Updated weights for policy 0, policy_version 1326819 (0.0005) [2023-12-26 10:11:07,348][123090] Updated weights for policy 1, policy_version 1317542 (0.0009) [2023-12-26 10:11:07,378][123091] Updated weights for policy 0, policy_version 1326829 (0.0005) [2023-12-26 10:11:07,398][123090] Updated weights for policy 1, policy_version 1317552 (0.0008) [2023-12-26 10:11:07,464][123090] Updated weights for policy 1, policy_version 1317562 (0.0005) [2023-12-26 10:11:08,092][123091] Updated weights for policy 0, policy_version 1326839 (0.0005) [2023-12-26 10:11:08,148][123091] Updated weights for policy 0, policy_version 1326849 (0.0006) [2023-12-26 10:11:08,218][123091] Updated weights for policy 0, policy_version 1326859 (0.0005) [2023-12-26 10:11:08,278][123090] Updated weights for policy 1, policy_version 1317572 (0.0005) [2023-12-26 10:11:08,349][123090] Updated weights for policy 1, policy_version 1317582 (0.0007) [2023-12-26 10:11:08,413][123090] Updated weights for policy 1, policy_version 1317592 (0.0011) [2023-12-26 10:11:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 676986880. Throughput: 0: 8798.5, 1: 8936.6. Samples: 676962112. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:11:08,786][121949] Avg episode reward: [(0, '6303.189'), (1, '5305.874')] [2023-12-26 10:11:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001317600_337305600.pth... [2023-12-26 10:11:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001326864_339681280.pth... [2023-12-26 10:11:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001316544_337035264.pth [2023-12-26 10:11:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001325840_339419136.pth [2023-12-26 10:11:08,874][123091] Updated weights for policy 0, policy_version 1326869 (0.0006) [2023-12-26 10:11:08,940][123091] Updated weights for policy 0, policy_version 1326879 (0.0008) [2023-12-26 10:11:09,011][123091] Updated weights for policy 0, policy_version 1326889 (0.0009) [2023-12-26 10:11:09,221][123090] Updated weights for policy 1, policy_version 1317602 (0.0010) [2023-12-26 10:11:09,294][123090] Updated weights for policy 1, policy_version 1317612 (0.0008) [2023-12-26 10:11:09,367][123090] Updated weights for policy 1, policy_version 1317622 (0.0008) [2023-12-26 10:11:09,434][123090] Updated weights for policy 1, policy_version 1317632 (0.0008) [2023-12-26 10:11:09,765][123091] Updated weights for policy 0, policy_version 1326899 (0.0006) [2023-12-26 10:11:09,834][123091] Updated weights for policy 0, policy_version 1326909 (0.0007) [2023-12-26 10:11:09,909][123091] Updated weights for policy 0, policy_version 1326919 (0.0010) [2023-12-26 10:11:10,209][123090] Updated weights for policy 1, policy_version 1317642 (0.0009) [2023-12-26 10:11:10,267][123090] Updated weights for policy 1, policy_version 1317652 (0.0009) [2023-12-26 10:11:10,332][123090] Updated weights for policy 1, policy_version 1317662 (0.0009) [2023-12-26 10:11:10,752][123091] Updated weights for policy 0, policy_version 1326929 (0.0011) [2023-12-26 10:11:10,810][123091] Updated weights for policy 0, policy_version 1326939 (0.0010) [2023-12-26 10:11:10,861][123091] Updated weights for policy 0, policy_version 1326949 (0.0010) [2023-12-26 10:11:10,920][123091] Updated weights for policy 0, policy_version 1326959 (0.0011) [2023-12-26 10:11:11,185][123090] Updated weights for policy 1, policy_version 1317672 (0.0010) [2023-12-26 10:11:11,251][123090] Updated weights for policy 1, policy_version 1317682 (0.0009) [2023-12-26 10:11:11,312][123090] Updated weights for policy 1, policy_version 1317692 (0.0009) [2023-12-26 10:11:11,765][123091] Updated weights for policy 0, policy_version 1326969 (0.0011) [2023-12-26 10:11:11,829][123091] Updated weights for policy 0, policy_version 1326979 (0.0011) [2023-12-26 10:11:11,898][123091] Updated weights for policy 0, policy_version 1326989 (0.0009) [2023-12-26 10:11:12,139][123090] Updated weights for policy 1, policy_version 1317702 (0.0008) [2023-12-26 10:11:12,203][123090] Updated weights for policy 1, policy_version 1317712 (0.0008) [2023-12-26 10:11:12,273][123090] Updated weights for policy 1, policy_version 1317722 (0.0008) [2023-12-26 10:11:12,725][123091] Updated weights for policy 0, policy_version 1326999 (0.0009) [2023-12-26 10:11:12,788][123091] Updated weights for policy 0, policy_version 1327009 (0.0009) [2023-12-26 10:11:12,850][123091] Updated weights for policy 0, policy_version 1327019 (0.0007) [2023-12-26 10:11:13,097][123090] Updated weights for policy 1, policy_version 1317732 (0.0009) [2023-12-26 10:11:13,156][123090] Updated weights for policy 1, policy_version 1317742 (0.0010) [2023-12-26 10:11:13,213][123090] Updated weights for policy 1, policy_version 1317752 (0.0009) [2023-12-26 10:11:13,650][123091] Updated weights for policy 0, policy_version 1327029 (0.0008) [2023-12-26 10:11:13,703][123091] Updated weights for policy 0, policy_version 1327039 (0.0005) [2023-12-26 10:11:13,749][123091] Updated weights for policy 0, policy_version 1327049 (0.0005) [2023-12-26 10:11:13,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 677076992. Throughput: 0: 8802.2, 1: 8825.8. Samples: 677068016. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:11:13,784][121949] Avg episode reward: [(0, '6323.727'), (1, '5201.352')] [2023-12-26 10:11:14,116][123090] Updated weights for policy 1, policy_version 1317764 (0.0010) [2023-12-26 10:11:14,175][123090] Updated weights for policy 1, policy_version 1317774 (0.0010) [2023-12-26 10:11:14,228][123090] Updated weights for policy 1, policy_version 1317784 (0.0009) [2023-12-26 10:11:14,449][123091] Updated weights for policy 0, policy_version 1327059 (0.0007) [2023-12-26 10:11:14,508][123091] Updated weights for policy 0, policy_version 1327069 (0.0006) [2023-12-26 10:11:14,574][123091] Updated weights for policy 0, policy_version 1327079 (0.0005) [2023-12-26 10:11:15,144][123090] Updated weights for policy 1, policy_version 1317794 (0.0009) [2023-12-26 10:11:15,147][123091] Updated weights for policy 0, policy_version 1327089 (0.0007) [2023-12-26 10:11:15,212][123091] Updated weights for policy 0, policy_version 1327099 (0.0006) [2023-12-26 10:11:15,212][123090] Updated weights for policy 1, policy_version 1317804 (0.0009) [2023-12-26 10:11:15,276][123090] Updated weights for policy 1, policy_version 1317814 (0.0008) [2023-12-26 10:11:15,277][123091] Updated weights for policy 0, policy_version 1327109 (0.0006) [2023-12-26 10:11:15,342][123091] Updated weights for policy 0, policy_version 1327119 (0.0006) [2023-12-26 10:11:15,347][123090] Updated weights for policy 1, policy_version 1317824 (0.0009) [2023-12-26 10:11:15,984][123091] Updated weights for policy 0, policy_version 1327129 (0.0005) [2023-12-26 10:11:16,039][123091] Updated weights for policy 0, policy_version 1327139 (0.0005) [2023-12-26 10:11:16,098][123091] Updated weights for policy 0, policy_version 1327149 (0.0005) [2023-12-26 10:11:16,248][123090] Updated weights for policy 1, policy_version 1317834 (0.0009) [2023-12-26 10:11:16,299][123090] Updated weights for policy 1, policy_version 1317844 (0.0008) [2023-12-26 10:11:16,353][123090] Updated weights for policy 1, policy_version 1317854 (0.0010) [2023-12-26 10:11:16,762][123091] Updated weights for policy 0, policy_version 1327159 (0.0005) [2023-12-26 10:11:16,814][123091] Updated weights for policy 0, policy_version 1327169 (0.0005) [2023-12-26 10:11:16,863][123091] Updated weights for policy 0, policy_version 1327179 (0.0005) [2023-12-26 10:11:17,238][123090] Updated weights for policy 1, policy_version 1317864 (0.0009) [2023-12-26 10:11:17,306][123090] Updated weights for policy 1, policy_version 1317874 (0.0010) [2023-12-26 10:11:17,369][123090] Updated weights for policy 1, policy_version 1317884 (0.0010) [2023-12-26 10:11:17,535][123091] Updated weights for policy 0, policy_version 1327189 (0.0005) [2023-12-26 10:11:17,587][123091] Updated weights for policy 0, policy_version 1327199 (0.0005) [2023-12-26 10:11:17,643][123091] Updated weights for policy 0, policy_version 1327209 (0.0006) [2023-12-26 10:11:18,223][123090] Updated weights for policy 1, policy_version 1317894 (0.0009) [2023-12-26 10:11:18,271][123090] Updated weights for policy 1, policy_version 1317904 (0.0009) [2023-12-26 10:11:18,335][123090] Updated weights for policy 1, policy_version 1317914 (0.0008) [2023-12-26 10:11:18,382][123091] Updated weights for policy 0, policy_version 1327219 (0.0007) [2023-12-26 10:11:18,445][123091] Updated weights for policy 0, policy_version 1327229 (0.0011) [2023-12-26 10:11:18,505][123091] Updated weights for policy 0, policy_version 1327239 (0.0011) [2023-12-26 10:11:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 677167104. Throughput: 0: 8952.3, 1: 8705.8. Samples: 677175344. Policy #0 lag: (min: 0.0, avg: 29.4, max: 32.0) [2023-12-26 10:11:18,786][121949] Avg episode reward: [(0, '6184.250'), (1, '5355.692')] [2023-12-26 10:11:19,249][123090] Updated weights for policy 1, policy_version 1317924 (0.0009) [2023-12-26 10:11:19,278][123091] Updated weights for policy 0, policy_version 1327249 (0.0011) [2023-12-26 10:11:19,315][123090] Updated weights for policy 1, policy_version 1317934 (0.0009) [2023-12-26 10:11:19,365][123091] Updated weights for policy 0, policy_version 1327259 (0.0011) [2023-12-26 10:11:19,385][123090] Updated weights for policy 1, policy_version 1317944 (0.0007) [2023-12-26 10:11:19,428][123091] Updated weights for policy 0, policy_version 1327269 (0.0011) [2023-12-26 10:11:19,497][123091] Updated weights for policy 0, policy_version 1327279 (0.0010) [2023-12-26 10:11:20,197][123090] Updated weights for policy 1, policy_version 1317954 (0.0008) [2023-12-26 10:11:20,263][123090] Updated weights for policy 1, policy_version 1317964 (0.0005) [2023-12-26 10:11:20,279][123091] Updated weights for policy 0, policy_version 1327289 (0.0008) [2023-12-26 10:11:20,328][123090] Updated weights for policy 1, policy_version 1317974 (0.0008) [2023-12-26 10:11:20,340][123091] Updated weights for policy 0, policy_version 1327299 (0.0009) [2023-12-26 10:11:20,390][123090] Updated weights for policy 1, policy_version 1317984 (0.0009) [2023-12-26 10:11:20,408][123091] Updated weights for policy 0, policy_version 1327309 (0.0008) [2023-12-26 10:11:21,193][123090] Updated weights for policy 1, policy_version 1317994 (0.0011) [2023-12-26 10:11:21,243][123091] Updated weights for policy 0, policy_version 1327319 (0.0007) [2023-12-26 10:11:21,258][123090] Updated weights for policy 1, policy_version 1318004 (0.0011) [2023-12-26 10:11:21,313][123091] Updated weights for policy 0, policy_version 1327329 (0.0006) [2023-12-26 10:11:21,319][123090] Updated weights for policy 1, policy_version 1318014 (0.0011) [2023-12-26 10:11:21,388][123091] Updated weights for policy 0, policy_version 1327339 (0.0009) [2023-12-26 10:11:22,095][123090] Updated weights for policy 1, policy_version 1318024 (0.0006) [2023-12-26 10:11:22,169][123090] Updated weights for policy 1, policy_version 1318034 (0.0007) [2023-12-26 10:11:22,233][123090] Updated weights for policy 1, policy_version 1318044 (0.0010) [2023-12-26 10:11:22,267][123091] Updated weights for policy 0, policy_version 1327349 (0.0009) [2023-12-26 10:11:22,331][123091] Updated weights for policy 0, policy_version 1327359 (0.0009) [2023-12-26 10:11:22,399][123091] Updated weights for policy 0, policy_version 1327369 (0.0010) [2023-12-26 10:11:23,009][123090] Updated weights for policy 1, policy_version 1318054 (0.0010) [2023-12-26 10:11:23,064][123090] Updated weights for policy 1, policy_version 1318064 (0.0010) [2023-12-26 10:11:23,121][123090] Updated weights for policy 1, policy_version 1318074 (0.0010) [2023-12-26 10:11:23,211][123091] Updated weights for policy 0, policy_version 1327379 (0.0009) [2023-12-26 10:11:23,267][123091] Updated weights for policy 0, policy_version 1327389 (0.0010) [2023-12-26 10:11:23,321][123091] Updated weights for policy 0, policy_version 1327399 (0.0008) [2023-12-26 10:11:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 677249024. Throughput: 0: 8935.5, 1: 8696.7. Samples: 677226512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:23,785][121949] Avg episode reward: [(0, '6186.034'), (1, '5367.304')] [2023-12-26 10:11:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001327408_339820544.pth... [2023-12-26 10:11:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001318080_337428480.pth... [2023-12-26 10:11:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001326352_339550208.pth [2023-12-26 10:11:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001317088_337174528.pth [2023-12-26 10:11:23,958][123090] Updated weights for policy 1, policy_version 1318084 (0.0010) [2023-12-26 10:11:24,013][123090] Updated weights for policy 1, policy_version 1318094 (0.0010) [2023-12-26 10:11:24,054][123091] Updated weights for policy 0, policy_version 1327409 (0.0006) [2023-12-26 10:11:24,064][123090] Updated weights for policy 1, policy_version 1318104 (0.0010) [2023-12-26 10:11:24,113][123091] Updated weights for policy 0, policy_version 1327419 (0.0010) [2023-12-26 10:11:24,176][123091] Updated weights for policy 0, policy_version 1327429 (0.0010) [2023-12-26 10:11:24,235][123091] Updated weights for policy 0, policy_version 1327439 (0.0009) [2023-12-26 10:11:24,880][123090] Updated weights for policy 1, policy_version 1318114 (0.0010) [2023-12-26 10:11:24,938][123090] Updated weights for policy 1, policy_version 1318124 (0.0010) [2023-12-26 10:11:24,990][123090] Updated weights for policy 1, policy_version 1318134 (0.0010) [2023-12-26 10:11:25,035][123091] Updated weights for policy 0, policy_version 1327449 (0.0006) [2023-12-26 10:11:25,049][123090] Updated weights for policy 1, policy_version 1318144 (0.0010) [2023-12-26 10:11:25,089][123091] Updated weights for policy 0, policy_version 1327459 (0.0008) [2023-12-26 10:11:25,136][123091] Updated weights for policy 0, policy_version 1327469 (0.0008) [2023-12-26 10:11:25,809][123090] Updated weights for policy 1, policy_version 1318154 (0.0010) [2023-12-26 10:11:25,864][123090] Updated weights for policy 1, policy_version 1318164 (0.0010) [2023-12-26 10:11:25,916][123091] Updated weights for policy 0, policy_version 1327479 (0.0007) [2023-12-26 10:11:25,924][123090] Updated weights for policy 1, policy_version 1318174 (0.0010) [2023-12-26 10:11:25,966][123091] Updated weights for policy 0, policy_version 1327489 (0.0005) [2023-12-26 10:11:26,016][123091] Updated weights for policy 0, policy_version 1327499 (0.0005) [2023-12-26 10:11:26,679][123091] Updated weights for policy 0, policy_version 1327509 (0.0005) [2023-12-26 10:11:26,729][123091] Updated weights for policy 0, policy_version 1327519 (0.0005) [2023-12-26 10:11:26,748][123090] Updated weights for policy 1, policy_version 1318184 (0.0010) [2023-12-26 10:11:26,776][123091] Updated weights for policy 0, policy_version 1327529 (0.0006) [2023-12-26 10:11:26,804][123090] Updated weights for policy 1, policy_version 1318194 (0.0010) [2023-12-26 10:11:26,872][123090] Updated weights for policy 1, policy_version 1318204 (0.0011) [2023-12-26 10:11:27,520][123091] Updated weights for policy 0, policy_version 1327539 (0.0006) [2023-12-26 10:11:27,569][123091] Updated weights for policy 0, policy_version 1327549 (0.0005) [2023-12-26 10:11:27,630][123091] Updated weights for policy 0, policy_version 1327559 (0.0008) [2023-12-26 10:11:27,709][123090] Updated weights for policy 1, policy_version 1318214 (0.0010) [2023-12-26 10:11:27,771][123090] Updated weights for policy 1, policy_version 1318224 (0.0010) [2023-12-26 10:11:27,833][123090] Updated weights for policy 1, policy_version 1318234 (0.0010) [2023-12-26 10:11:28,358][123091] Updated weights for policy 0, policy_version 1327569 (0.0007) [2023-12-26 10:11:28,416][123091] Updated weights for policy 0, policy_version 1327579 (0.0009) [2023-12-26 10:11:28,472][123091] Updated weights for policy 0, policy_version 1327589 (0.0009) [2023-12-26 10:11:28,526][123091] Updated weights for policy 0, policy_version 1327599 (0.0009) [2023-12-26 10:11:28,630][123090] Updated weights for policy 1, policy_version 1318244 (0.0007) [2023-12-26 10:11:28,681][123090] Updated weights for policy 1, policy_version 1318254 (0.0006) [2023-12-26 10:11:28,736][123090] Updated weights for policy 1, policy_version 1318264 (0.0005) [2023-12-26 10:11:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 677347328. Throughput: 0: 9016.0, 1: 8721.3. Samples: 677335120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:28,785][121949] Avg episode reward: [(0, '6233.156'), (1, '5054.644')] [2023-12-26 10:11:29,399][123091] Updated weights for policy 0, policy_version 1327609 (0.0014) [2023-12-26 10:11:29,473][123091] Updated weights for policy 0, policy_version 1327619 (0.0010) [2023-12-26 10:11:29,540][123091] Updated weights for policy 0, policy_version 1327629 (0.0011) [2023-12-26 10:11:29,546][123090] Updated weights for policy 1, policy_version 1318274 (0.0008) [2023-12-26 10:11:29,605][123090] Updated weights for policy 1, policy_version 1318284 (0.0008) [2023-12-26 10:11:29,663][123090] Updated weights for policy 1, policy_version 1318294 (0.0009) [2023-12-26 10:11:29,719][123090] Updated weights for policy 1, policy_version 1318304 (0.0008) [2023-12-26 10:11:30,398][123091] Updated weights for policy 0, policy_version 1327639 (0.0010) [2023-12-26 10:11:30,442][123091] Updated weights for policy 0, policy_version 1327649 (0.0010) [2023-12-26 10:11:30,488][123091] Updated weights for policy 0, policy_version 1327659 (0.0010) [2023-12-26 10:11:30,566][123090] Updated weights for policy 1, policy_version 1318314 (0.0008) [2023-12-26 10:11:30,622][123090] Updated weights for policy 1, policy_version 1318324 (0.0008) [2023-12-26 10:11:30,670][123090] Updated weights for policy 1, policy_version 1318334 (0.0008) [2023-12-26 10:11:31,314][123091] Updated weights for policy 0, policy_version 1327669 (0.0008) [2023-12-26 10:11:31,388][123091] Updated weights for policy 0, policy_version 1327679 (0.0008) [2023-12-26 10:11:31,451][123091] Updated weights for policy 0, policy_version 1327689 (0.0011) [2023-12-26 10:11:31,528][123090] Updated weights for policy 1, policy_version 1318344 (0.0008) [2023-12-26 10:11:31,582][123090] Updated weights for policy 1, policy_version 1318354 (0.0009) [2023-12-26 10:11:31,651][123090] Updated weights for policy 1, policy_version 1318364 (0.0009) [2023-12-26 10:11:32,180][123091] Updated weights for policy 0, policy_version 1327699 (0.0008) [2023-12-26 10:11:32,231][123091] Updated weights for policy 0, policy_version 1327709 (0.0008) [2023-12-26 10:11:32,304][123091] Updated weights for policy 0, policy_version 1327719 (0.0011) [2023-12-26 10:11:32,522][123090] Updated weights for policy 1, policy_version 1318374 (0.0009) [2023-12-26 10:11:32,590][123090] Updated weights for policy 1, policy_version 1318384 (0.0009) [2023-12-26 10:11:32,661][123090] Updated weights for policy 1, policy_version 1318394 (0.0009) [2023-12-26 10:11:33,068][123091] Updated weights for policy 0, policy_version 1327729 (0.0009) [2023-12-26 10:11:33,126][123091] Updated weights for policy 0, policy_version 1327739 (0.0009) [2023-12-26 10:11:33,188][123091] Updated weights for policy 0, policy_version 1327750 (0.0009) [2023-12-26 10:11:33,235][123091] Updated weights for policy 0, policy_version 1327760 (0.0009) [2023-12-26 10:11:33,433][123090] Updated weights for policy 1, policy_version 1318404 (0.0010) [2023-12-26 10:11:33,484][123090] Updated weights for policy 1, policy_version 1318414 (0.0009) [2023-12-26 10:11:33,536][123090] Updated weights for policy 1, policy_version 1318424 (0.0010) [2023-12-26 10:11:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 677429248. Throughput: 0: 9079.5, 1: 8572.7. Samples: 677439108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:33,785][121949] Avg episode reward: [(0, '6377.929'), (1, '4988.464')] [2023-12-26 10:11:34,065][123091] Updated weights for policy 0, policy_version 1327770 (0.0008) [2023-12-26 10:11:34,123][123091] Updated weights for policy 0, policy_version 1327780 (0.0006) [2023-12-26 10:11:34,186][123091] Updated weights for policy 0, policy_version 1327790 (0.0009) [2023-12-26 10:11:34,388][123090] Updated weights for policy 1, policy_version 1318434 (0.0009) [2023-12-26 10:11:34,453][123090] Updated weights for policy 1, policy_version 1318444 (0.0009) [2023-12-26 10:11:34,514][123090] Updated weights for policy 1, policy_version 1318454 (0.0009) [2023-12-26 10:11:34,575][123090] Updated weights for policy 1, policy_version 1318464 (0.0009) [2023-12-26 10:11:35,011][123091] Updated weights for policy 0, policy_version 1327800 (0.0010) [2023-12-26 10:11:35,072][123091] Updated weights for policy 0, policy_version 1327810 (0.0010) [2023-12-26 10:11:35,128][123091] Updated weights for policy 0, policy_version 1327820 (0.0009) [2023-12-26 10:11:35,387][123090] Updated weights for policy 1, policy_version 1318474 (0.0010) [2023-12-26 10:11:35,456][123090] Updated weights for policy 1, policy_version 1318484 (0.0009) [2023-12-26 10:11:35,511][123090] Updated weights for policy 1, policy_version 1318494 (0.0008) [2023-12-26 10:11:35,954][123091] Updated weights for policy 0, policy_version 1327830 (0.0009) [2023-12-26 10:11:36,007][123091] Updated weights for policy 0, policy_version 1327840 (0.0009) [2023-12-26 10:11:36,063][123091] Updated weights for policy 0, policy_version 1327850 (0.0009) [2023-12-26 10:11:36,341][123090] Updated weights for policy 1, policy_version 1318504 (0.0010) [2023-12-26 10:11:36,410][123090] Updated weights for policy 1, policy_version 1318514 (0.0009) [2023-12-26 10:11:36,471][123090] Updated weights for policy 1, policy_version 1318524 (0.0008) [2023-12-26 10:11:36,895][123091] Updated weights for policy 0, policy_version 1327860 (0.0009) [2023-12-26 10:11:36,961][123091] Updated weights for policy 0, policy_version 1327870 (0.0010) [2023-12-26 10:11:37,014][123091] Updated weights for policy 0, policy_version 1327880 (0.0009) [2023-12-26 10:11:37,276][123090] Updated weights for policy 1, policy_version 1318534 (0.0008) [2023-12-26 10:11:37,342][123090] Updated weights for policy 1, policy_version 1318544 (0.0005) [2023-12-26 10:11:37,408][123090] Updated weights for policy 1, policy_version 1318554 (0.0005) [2023-12-26 10:11:37,769][123091] Updated weights for policy 0, policy_version 1327890 (0.0009) [2023-12-26 10:11:37,824][123091] Updated weights for policy 0, policy_version 1327900 (0.0010) [2023-12-26 10:11:37,879][123091] Updated weights for policy 0, policy_version 1327910 (0.0009) [2023-12-26 10:11:37,948][123091] Updated weights for policy 0, policy_version 1327920 (0.0007) [2023-12-26 10:11:38,153][123090] Updated weights for policy 1, policy_version 1318564 (0.0007) [2023-12-26 10:11:38,214][123090] Updated weights for policy 1, policy_version 1318575 (0.0010) [2023-12-26 10:11:38,266][123090] Updated weights for policy 1, policy_version 1318585 (0.0010) [2023-12-26 10:11:38,669][123091] Updated weights for policy 0, policy_version 1327930 (0.0010) [2023-12-26 10:11:38,737][123091] Updated weights for policy 0, policy_version 1327940 (0.0009) [2023-12-26 10:11:38,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 677511168. Throughput: 0: 9095.1, 1: 8561.5. Samples: 677490112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:38,785][121949] Avg episode reward: [(0, '6242.522'), (1, '5258.438')] [2023-12-26 10:11:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001318592_337559552.pth... [2023-12-26 10:11:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001317600_337305600.pth [2023-12-26 10:11:38,805][123091] Updated weights for policy 0, policy_version 1327950 (0.0011) [2023-12-26 10:11:38,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001327952_339959808.pth... [2023-12-26 10:11:38,821][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001326864_339681280.pth [2023-12-26 10:11:39,154][123090] Updated weights for policy 1, policy_version 1318595 (0.0010) [2023-12-26 10:11:39,201][123090] Updated weights for policy 1, policy_version 1318605 (0.0009) [2023-12-26 10:11:39,262][123090] Updated weights for policy 1, policy_version 1318615 (0.0010) [2023-12-26 10:11:39,680][123091] Updated weights for policy 0, policy_version 1327960 (0.0010) [2023-12-26 10:11:39,744][123091] Updated weights for policy 0, policy_version 1327970 (0.0011) [2023-12-26 10:11:39,799][123091] Updated weights for policy 0, policy_version 1327980 (0.0010) [2023-12-26 10:11:40,188][123090] Updated weights for policy 1, policy_version 1318625 (0.0009) [2023-12-26 10:11:40,256][123090] Updated weights for policy 1, policy_version 1318635 (0.0010) [2023-12-26 10:11:40,320][123090] Updated weights for policy 1, policy_version 1318645 (0.0009) [2023-12-26 10:11:40,384][123090] Updated weights for policy 1, policy_version 1318655 (0.0009) [2023-12-26 10:11:40,548][123091] Updated weights for policy 0, policy_version 1327990 (0.0011) [2023-12-26 10:11:40,600][123091] Updated weights for policy 0, policy_version 1328000 (0.0011) [2023-12-26 10:11:40,665][123091] Updated weights for policy 0, policy_version 1328010 (0.0010) [2023-12-26 10:11:41,283][123090] Updated weights for policy 1, policy_version 1318665 (0.0010) [2023-12-26 10:11:41,346][123090] Updated weights for policy 1, policy_version 1318675 (0.0010) [2023-12-26 10:11:41,420][123090] Updated weights for policy 1, policy_version 1318685 (0.0010) [2023-12-26 10:11:41,442][123091] Updated weights for policy 0, policy_version 1328020 (0.0010) [2023-12-26 10:11:41,490][123091] Updated weights for policy 0, policy_version 1328030 (0.0008) [2023-12-26 10:11:41,542][123091] Updated weights for policy 0, policy_version 1328040 (0.0008) [2023-12-26 10:11:42,253][123090] Updated weights for policy 1, policy_version 1318695 (0.0007) [2023-12-26 10:11:42,328][123090] Updated weights for policy 1, policy_version 1318705 (0.0008) [2023-12-26 10:11:42,395][123091] Updated weights for policy 0, policy_version 1328050 (0.0007) [2023-12-26 10:11:42,402][123090] Updated weights for policy 1, policy_version 1318715 (0.0009) [2023-12-26 10:11:42,446][123091] Updated weights for policy 0, policy_version 1328060 (0.0007) [2023-12-26 10:11:42,507][123091] Updated weights for policy 0, policy_version 1328070 (0.0008) [2023-12-26 10:11:42,578][123091] Updated weights for policy 0, policy_version 1328080 (0.0006) [2023-12-26 10:11:43,183][123091] Updated weights for policy 0, policy_version 1328090 (0.0008) [2023-12-26 10:11:43,183][123090] Updated weights for policy 1, policy_version 1318725 (0.0008) [2023-12-26 10:11:43,235][123091] Updated weights for policy 0, policy_version 1328100 (0.0006) [2023-12-26 10:11:43,250][123090] Updated weights for policy 1, policy_version 1318735 (0.0010) [2023-12-26 10:11:43,298][123091] Updated weights for policy 0, policy_version 1328110 (0.0006) [2023-12-26 10:11:43,317][123090] Updated weights for policy 1, policy_version 1318745 (0.0008) [2023-12-26 10:11:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 677601280. Throughput: 0: 9106.2, 1: 8502.4. Samples: 677594060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:43,785][121949] Avg episode reward: [(0, '6126.163'), (1, '5199.111')] [2023-12-26 10:11:43,979][123091] Updated weights for policy 0, policy_version 1328120 (0.0009) [2023-12-26 10:11:44,034][123091] Updated weights for policy 0, policy_version 1328131 (0.0010) [2023-12-26 10:11:44,092][123091] Updated weights for policy 0, policy_version 1328141 (0.0010) [2023-12-26 10:11:44,196][123090] Updated weights for policy 1, policy_version 1318755 (0.0010) [2023-12-26 10:11:44,256][123090] Updated weights for policy 1, policy_version 1318765 (0.0009) [2023-12-26 10:11:44,320][123090] Updated weights for policy 1, policy_version 1318775 (0.0009) [2023-12-26 10:11:44,954][123091] Updated weights for policy 0, policy_version 1328151 (0.0008) [2023-12-26 10:11:45,004][123091] Updated weights for policy 0, policy_version 1328161 (0.0007) [2023-12-26 10:11:45,061][123091] Updated weights for policy 0, policy_version 1328171 (0.0009) [2023-12-26 10:11:45,144][123090] Updated weights for policy 1, policy_version 1318785 (0.0010) [2023-12-26 10:11:45,215][123090] Updated weights for policy 1, policy_version 1318795 (0.0009) [2023-12-26 10:11:45,265][123090] Updated weights for policy 1, policy_version 1318805 (0.0009) [2023-12-26 10:11:45,332][123090] Updated weights for policy 1, policy_version 1318815 (0.0010) [2023-12-26 10:11:45,817][123091] Updated weights for policy 0, policy_version 1328181 (0.0010) [2023-12-26 10:11:45,876][123091] Updated weights for policy 0, policy_version 1328191 (0.0010) [2023-12-26 10:11:45,939][123091] Updated weights for policy 0, policy_version 1328201 (0.0009) [2023-12-26 10:11:46,181][123090] Updated weights for policy 1, policy_version 1318825 (0.0006) [2023-12-26 10:11:46,256][123090] Updated weights for policy 1, policy_version 1318835 (0.0007) [2023-12-26 10:11:46,318][123090] Updated weights for policy 1, policy_version 1318845 (0.0009) [2023-12-26 10:11:46,739][123091] Updated weights for policy 0, policy_version 1328211 (0.0008) [2023-12-26 10:11:46,798][123091] Updated weights for policy 0, policy_version 1328221 (0.0005) [2023-12-26 10:11:46,856][123091] Updated weights for policy 0, policy_version 1328231 (0.0005) [2023-12-26 10:11:47,000][123090] Updated weights for policy 1, policy_version 1318855 (0.0007) [2023-12-26 10:11:47,048][123090] Updated weights for policy 1, policy_version 1318865 (0.0005) [2023-12-26 10:11:47,096][123090] Updated weights for policy 1, policy_version 1318875 (0.0005) [2023-12-26 10:11:47,567][123091] Updated weights for policy 0, policy_version 1328241 (0.0006) [2023-12-26 10:11:47,631][123091] Updated weights for policy 0, policy_version 1328251 (0.0008) [2023-12-26 10:11:47,699][123091] Updated weights for policy 0, policy_version 1328261 (0.0005) [2023-12-26 10:11:47,766][123091] Updated weights for policy 0, policy_version 1328271 (0.0009) [2023-12-26 10:11:47,872][123090] Updated weights for policy 1, policy_version 1318885 (0.0006) [2023-12-26 10:11:47,939][123090] Updated weights for policy 1, policy_version 1318895 (0.0006) [2023-12-26 10:11:48,007][123090] Updated weights for policy 1, policy_version 1318905 (0.0005) [2023-12-26 10:11:48,577][123091] Updated weights for policy 0, policy_version 1328281 (0.0010) [2023-12-26 10:11:48,640][123091] Updated weights for policy 0, policy_version 1328291 (0.0009) [2023-12-26 10:11:48,688][123091] Updated weights for policy 0, policy_version 1328301 (0.0009) [2023-12-26 10:11:48,736][123090] Updated weights for policy 1, policy_version 1318915 (0.0007) [2023-12-26 10:11:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 677691392. Throughput: 0: 9128.4, 1: 8552.9. Samples: 677702748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:48,785][121949] Avg episode reward: [(0, '6203.238'), (1, '5018.738')] [2023-12-26 10:11:48,797][123090] Updated weights for policy 1, policy_version 1318925 (0.0009) [2023-12-26 10:11:48,860][123090] Updated weights for policy 1, policy_version 1318935 (0.0010) [2023-12-26 10:11:49,480][123091] Updated weights for policy 0, policy_version 1328311 (0.0006) [2023-12-26 10:11:49,534][123091] Updated weights for policy 0, policy_version 1328321 (0.0005) [2023-12-26 10:11:49,584][123091] Updated weights for policy 0, policy_version 1328331 (0.0005) [2023-12-26 10:11:49,689][123090] Updated weights for policy 1, policy_version 1318945 (0.0009) [2023-12-26 10:11:49,747][123090] Updated weights for policy 1, policy_version 1318955 (0.0005) [2023-12-26 10:11:49,807][123090] Updated weights for policy 1, policy_version 1318965 (0.0005) [2023-12-26 10:11:49,880][123090] Updated weights for policy 1, policy_version 1318975 (0.0007) [2023-12-26 10:11:50,313][123091] Updated weights for policy 0, policy_version 1328341 (0.0007) [2023-12-26 10:11:50,378][123091] Updated weights for policy 0, policy_version 1328351 (0.0010) [2023-12-26 10:11:50,445][123091] Updated weights for policy 0, policy_version 1328361 (0.0009) [2023-12-26 10:11:50,652][123090] Updated weights for policy 1, policy_version 1318985 (0.0005) [2023-12-26 10:11:50,710][123090] Updated weights for policy 1, policy_version 1318995 (0.0005) [2023-12-26 10:11:50,767][123090] Updated weights for policy 1, policy_version 1319005 (0.0007) [2023-12-26 10:11:51,261][123091] Updated weights for policy 0, policy_version 1328371 (0.0009) [2023-12-26 10:11:51,320][123091] Updated weights for policy 0, policy_version 1328381 (0.0010) [2023-12-26 10:11:51,383][123091] Updated weights for policy 0, policy_version 1328391 (0.0009) [2023-12-26 10:11:51,585][123090] Updated weights for policy 1, policy_version 1319015 (0.0010) [2023-12-26 10:11:51,652][123090] Updated weights for policy 1, policy_version 1319025 (0.0009) [2023-12-26 10:11:51,706][123090] Updated weights for policy 1, policy_version 1319035 (0.0008) [2023-12-26 10:11:52,236][123091] Updated weights for policy 0, policy_version 1328401 (0.0010) [2023-12-26 10:11:52,292][123091] Updated weights for policy 0, policy_version 1328411 (0.0009) [2023-12-26 10:11:52,356][123091] Updated weights for policy 0, policy_version 1328421 (0.0010) [2023-12-26 10:11:52,406][123091] Updated weights for policy 0, policy_version 1328431 (0.0009) [2023-12-26 10:11:52,580][123090] Updated weights for policy 1, policy_version 1319045 (0.0010) [2023-12-26 10:11:52,639][123090] Updated weights for policy 1, policy_version 1319055 (0.0007) [2023-12-26 10:11:52,694][123090] Updated weights for policy 1, policy_version 1319065 (0.0006) [2023-12-26 10:11:53,313][123091] Updated weights for policy 0, policy_version 1328441 (0.0010) [2023-12-26 10:11:53,354][123090] Updated weights for policy 1, policy_version 1319075 (0.0006) [2023-12-26 10:11:53,366][123091] Updated weights for policy 0, policy_version 1328451 (0.0009) [2023-12-26 10:11:53,419][123090] Updated weights for policy 1, policy_version 1319085 (0.0008) [2023-12-26 10:11:53,432][123091] Updated weights for policy 0, policy_version 1328461 (0.0010) [2023-12-26 10:11:53,483][123090] Updated weights for policy 1, policy_version 1319095 (0.0008) [2023-12-26 10:11:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 677781504. Throughput: 0: 9108.5, 1: 8533.4. Samples: 677755992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:53,785][121949] Avg episode reward: [(0, '6282.473'), (1, '5130.713')] [2023-12-26 10:11:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001328464_340090880.pth... [2023-12-26 10:11:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001319104_337690624.pth... [2023-12-26 10:11:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001327408_339820544.pth [2023-12-26 10:11:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001318080_337428480.pth [2023-12-26 10:11:54,198][123091] Updated weights for policy 0, policy_version 1328471 (0.0006) [2023-12-26 10:11:54,258][123090] Updated weights for policy 1, policy_version 1319105 (0.0005) [2023-12-26 10:11:54,264][123091] Updated weights for policy 0, policy_version 1328481 (0.0005) [2023-12-26 10:11:54,312][123090] Updated weights for policy 1, policy_version 1319115 (0.0006) [2023-12-26 10:11:54,327][123091] Updated weights for policy 0, policy_version 1328491 (0.0009) [2023-12-26 10:11:54,374][123090] Updated weights for policy 1, policy_version 1319125 (0.0007) [2023-12-26 10:11:54,442][123090] Updated weights for policy 1, policy_version 1319135 (0.0009) [2023-12-26 10:11:55,050][123091] Updated weights for policy 0, policy_version 1328501 (0.0010) [2023-12-26 10:11:55,114][123091] Updated weights for policy 0, policy_version 1328511 (0.0009) [2023-12-26 10:11:55,172][123091] Updated weights for policy 0, policy_version 1328521 (0.0010) [2023-12-26 10:11:55,262][123090] Updated weights for policy 1, policy_version 1319145 (0.0010) [2023-12-26 10:11:55,328][123090] Updated weights for policy 1, policy_version 1319155 (0.0009) [2023-12-26 10:11:55,386][123090] Updated weights for policy 1, policy_version 1319165 (0.0005) [2023-12-26 10:11:55,911][123091] Updated weights for policy 0, policy_version 1328531 (0.0008) [2023-12-26 10:11:55,965][123091] Updated weights for policy 0, policy_version 1328541 (0.0006) [2023-12-26 10:11:56,013][123091] Updated weights for policy 0, policy_version 1328551 (0.0005) [2023-12-26 10:11:56,223][123090] Updated weights for policy 1, policy_version 1319175 (0.0006) [2023-12-26 10:11:56,285][123090] Updated weights for policy 1, policy_version 1319185 (0.0005) [2023-12-26 10:11:56,350][123090] Updated weights for policy 1, policy_version 1319195 (0.0005) [2023-12-26 10:11:56,660][123091] Updated weights for policy 0, policy_version 1328561 (0.0005) [2023-12-26 10:11:56,711][123091] Updated weights for policy 0, policy_version 1328571 (0.0005) [2023-12-26 10:11:56,758][123091] Updated weights for policy 0, policy_version 1328581 (0.0005) [2023-12-26 10:11:56,811][123091] Updated weights for policy 0, policy_version 1328591 (0.0005) [2023-12-26 10:11:56,998][123090] Updated weights for policy 1, policy_version 1319205 (0.0007) [2023-12-26 10:11:57,050][123090] Updated weights for policy 1, policy_version 1319215 (0.0009) [2023-12-26 10:11:57,098][123090] Updated weights for policy 1, policy_version 1319225 (0.0009) [2023-12-26 10:11:57,548][123091] Updated weights for policy 0, policy_version 1328601 (0.0009) [2023-12-26 10:11:57,604][123091] Updated weights for policy 0, policy_version 1328611 (0.0009) [2023-12-26 10:11:57,650][123091] Updated weights for policy 0, policy_version 1328621 (0.0009) [2023-12-26 10:11:57,942][123090] Updated weights for policy 1, policy_version 1319235 (0.0008) [2023-12-26 10:11:57,988][123090] Updated weights for policy 1, policy_version 1319245 (0.0008) [2023-12-26 10:11:58,060][123090] Updated weights for policy 1, policy_version 1319255 (0.0009) [2023-12-26 10:11:58,540][123091] Updated weights for policy 0, policy_version 1328631 (0.0010) [2023-12-26 10:11:58,609][123091] Updated weights for policy 0, policy_version 1328641 (0.0009) [2023-12-26 10:11:58,682][123091] Updated weights for policy 0, policy_version 1328651 (0.0006) [2023-12-26 10:11:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 677871616. Throughput: 0: 9125.9, 1: 8600.2. Samples: 677865688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:11:58,785][121949] Avg episode reward: [(0, '6309.318'), (1, '5274.606')] [2023-12-26 10:11:59,004][123090] Updated weights for policy 1, policy_version 1319265 (0.0008) [2023-12-26 10:11:59,070][123090] Updated weights for policy 1, policy_version 1319275 (0.0010) [2023-12-26 10:11:59,133][123090] Updated weights for policy 1, policy_version 1319285 (0.0010) [2023-12-26 10:11:59,194][123090] Updated weights for policy 1, policy_version 1319295 (0.0009) [2023-12-26 10:11:59,382][123091] Updated weights for policy 0, policy_version 1328661 (0.0007) [2023-12-26 10:11:59,428][123091] Updated weights for policy 0, policy_version 1328671 (0.0005) [2023-12-26 10:11:59,492][123091] Updated weights for policy 0, policy_version 1328681 (0.0007) [2023-12-26 10:12:00,028][123090] Updated weights for policy 1, policy_version 1319305 (0.0008) [2023-12-26 10:12:00,090][123090] Updated weights for policy 1, policy_version 1319315 (0.0010) [2023-12-26 10:12:00,152][123090] Updated weights for policy 1, policy_version 1319325 (0.0009) [2023-12-26 10:12:00,313][123091] Updated weights for policy 0, policy_version 1328691 (0.0008) [2023-12-26 10:12:00,374][123091] Updated weights for policy 0, policy_version 1328701 (0.0009) [2023-12-26 10:12:00,439][123091] Updated weights for policy 0, policy_version 1328711 (0.0006) [2023-12-26 10:12:00,876][123090] Updated weights for policy 1, policy_version 1319335 (0.0008) [2023-12-26 10:12:00,939][123090] Updated weights for policy 1, policy_version 1319345 (0.0005) [2023-12-26 10:12:00,997][123091] Updated weights for policy 0, policy_version 1328721 (0.0006) [2023-12-26 10:12:00,998][123090] Updated weights for policy 1, policy_version 1319355 (0.0005) [2023-12-26 10:12:01,057][123091] Updated weights for policy 0, policy_version 1328731 (0.0007) [2023-12-26 10:12:01,112][123091] Updated weights for policy 0, policy_version 1328741 (0.0006) [2023-12-26 10:12:01,176][123091] Updated weights for policy 0, policy_version 1328751 (0.0008) [2023-12-26 10:12:01,821][123090] Updated weights for policy 1, policy_version 1319365 (0.0007) [2023-12-26 10:12:01,879][123090] Updated weights for policy 1, policy_version 1319375 (0.0009) [2023-12-26 10:12:01,936][123090] Updated weights for policy 1, policy_version 1319385 (0.0009) [2023-12-26 10:12:02,003][123091] Updated weights for policy 0, policy_version 1328761 (0.0009) [2023-12-26 10:12:02,060][123091] Updated weights for policy 0, policy_version 1328771 (0.0009) [2023-12-26 10:12:02,113][123091] Updated weights for policy 0, policy_version 1328781 (0.0009) [2023-12-26 10:12:02,778][123090] Updated weights for policy 1, policy_version 1319395 (0.0010) [2023-12-26 10:12:02,833][123090] Updated weights for policy 1, policy_version 1319405 (0.0009) [2023-12-26 10:12:02,905][123090] Updated weights for policy 1, policy_version 1319415 (0.0006) [2023-12-26 10:12:02,969][123091] Updated weights for policy 0, policy_version 1328791 (0.0009) [2023-12-26 10:12:03,045][123091] Updated weights for policy 0, policy_version 1328801 (0.0010) [2023-12-26 10:12:03,104][123091] Updated weights for policy 0, policy_version 1328811 (0.0011) [2023-12-26 10:12:03,609][123090] Updated weights for policy 1, policy_version 1319425 (0.0006) [2023-12-26 10:12:03,660][123090] Updated weights for policy 1, policy_version 1319435 (0.0009) [2023-12-26 10:12:03,713][123090] Updated weights for policy 1, policy_version 1319446 (0.0010) [2023-12-26 10:12:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 677961728. Throughput: 0: 9004.8, 1: 8687.8. Samples: 677971504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:03,785][121949] Avg episode reward: [(0, '6213.808'), (1, '5283.027')] [2023-12-26 10:12:03,805][123091] Updated weights for policy 0, policy_version 1328821 (0.0009) [2023-12-26 10:12:03,867][123091] Updated weights for policy 0, policy_version 1328831 (0.0007) [2023-12-26 10:12:03,935][123091] Updated weights for policy 0, policy_version 1328841 (0.0008) [2023-12-26 10:12:04,508][123090] Updated weights for policy 1, policy_version 1319458 (0.0009) [2023-12-26 10:12:04,574][123090] Updated weights for policy 1, policy_version 1319468 (0.0005) [2023-12-26 10:12:04,634][123090] Updated weights for policy 1, policy_version 1319478 (0.0005) [2023-12-26 10:12:04,707][123090] Updated weights for policy 1, policy_version 1319488 (0.0005) [2023-12-26 10:12:04,743][123091] Updated weights for policy 0, policy_version 1328851 (0.0011) [2023-12-26 10:12:04,801][123091] Updated weights for policy 0, policy_version 1328861 (0.0010) [2023-12-26 10:12:04,868][123091] Updated weights for policy 0, policy_version 1328871 (0.0011) [2023-12-26 10:12:05,277][123090] Updated weights for policy 1, policy_version 1319498 (0.0005) [2023-12-26 10:12:05,334][123090] Updated weights for policy 1, policy_version 1319508 (0.0005) [2023-12-26 10:12:05,388][123090] Updated weights for policy 1, policy_version 1319518 (0.0005) [2023-12-26 10:12:05,674][123091] Updated weights for policy 0, policy_version 1328881 (0.0010) [2023-12-26 10:12:05,733][123091] Updated weights for policy 0, policy_version 1328891 (0.0005) [2023-12-26 10:12:05,791][123091] Updated weights for policy 0, policy_version 1328901 (0.0005) [2023-12-26 10:12:05,838][123091] Updated weights for policy 0, policy_version 1328911 (0.0005) [2023-12-26 10:12:06,196][123090] Updated weights for policy 1, policy_version 1319528 (0.0009) [2023-12-26 10:12:06,260][123090] Updated weights for policy 1, policy_version 1319538 (0.0011) [2023-12-26 10:12:06,324][123090] Updated weights for policy 1, policy_version 1319548 (0.0010) [2023-12-26 10:12:06,582][123091] Updated weights for policy 0, policy_version 1328921 (0.0010) [2023-12-26 10:12:06,634][123091] Updated weights for policy 0, policy_version 1328931 (0.0011) [2023-12-26 10:12:06,699][123091] Updated weights for policy 0, policy_version 1328941 (0.0005) [2023-12-26 10:12:07,167][123090] Updated weights for policy 1, policy_version 1319558 (0.0011) [2023-12-26 10:12:07,228][123090] Updated weights for policy 1, policy_version 1319568 (0.0011) [2023-12-26 10:12:07,299][123090] Updated weights for policy 1, policy_version 1319578 (0.0011) [2023-12-26 10:12:07,369][123091] Updated weights for policy 0, policy_version 1328951 (0.0009) [2023-12-26 10:12:07,426][123091] Updated weights for policy 0, policy_version 1328961 (0.0010) [2023-12-26 10:12:07,482][123091] Updated weights for policy 0, policy_version 1328971 (0.0011) [2023-12-26 10:12:08,091][123090] Updated weights for policy 1, policy_version 1319588 (0.0008) [2023-12-26 10:12:08,147][123090] Updated weights for policy 1, policy_version 1319598 (0.0005) [2023-12-26 10:12:08,204][123091] Updated weights for policy 0, policy_version 1328981 (0.0008) [2023-12-26 10:12:08,209][123090] Updated weights for policy 1, policy_version 1319608 (0.0009) [2023-12-26 10:12:08,270][123091] Updated weights for policy 0, policy_version 1328991 (0.0006) [2023-12-26 10:12:08,337][123091] Updated weights for policy 0, policy_version 1329001 (0.0011) [2023-12-26 10:12:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 678051840. Throughput: 0: 9042.3, 1: 8743.6. Samples: 678026876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:08,784][121949] Avg episode reward: [(0, '6205.320'), (1, '5422.374')] [2023-12-26 10:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001329008_340230144.pth... [2023-12-26 10:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001319616_337821696.pth... [2023-12-26 10:12:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001327952_339959808.pth [2023-12-26 10:12:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001318592_337559552.pth [2023-12-26 10:12:08,999][123090] Updated weights for policy 1, policy_version 1319618 (0.0009) [2023-12-26 10:12:09,053][123090] Updated weights for policy 1, policy_version 1319628 (0.0007) [2023-12-26 10:12:09,105][123090] Updated weights for policy 1, policy_version 1319638 (0.0006) [2023-12-26 10:12:09,137][123091] Updated weights for policy 0, policy_version 1329011 (0.0011) [2023-12-26 10:12:09,162][123090] Updated weights for policy 1, policy_version 1319648 (0.0005) [2023-12-26 10:12:09,188][123091] Updated weights for policy 0, policy_version 1329021 (0.0010) [2023-12-26 10:12:09,247][123091] Updated weights for policy 0, policy_version 1329031 (0.0011) [2023-12-26 10:12:09,997][123090] Updated weights for policy 1, policy_version 1319658 (0.0006) [2023-12-26 10:12:10,064][123090] Updated weights for policy 1, policy_version 1319668 (0.0006) [2023-12-26 10:12:10,096][123091] Updated weights for policy 0, policy_version 1329041 (0.0011) [2023-12-26 10:12:10,123][123090] Updated weights for policy 1, policy_version 1319678 (0.0006) [2023-12-26 10:12:10,161][123091] Updated weights for policy 0, policy_version 1329051 (0.0010) [2023-12-26 10:12:10,230][123091] Updated weights for policy 0, policy_version 1329061 (0.0009) [2023-12-26 10:12:10,297][123091] Updated weights for policy 0, policy_version 1329071 (0.0010) [2023-12-26 10:12:10,883][123090] Updated weights for policy 1, policy_version 1319688 (0.0009) [2023-12-26 10:12:10,937][123090] Updated weights for policy 1, policy_version 1319698 (0.0009) [2023-12-26 10:12:10,993][123090] Updated weights for policy 1, policy_version 1319708 (0.0010) [2023-12-26 10:12:11,193][123091] Updated weights for policy 0, policy_version 1329081 (0.0010) [2023-12-26 10:12:11,257][123091] Updated weights for policy 0, policy_version 1329091 (0.0009) [2023-12-26 10:12:11,323][123091] Updated weights for policy 0, policy_version 1329101 (0.0010) [2023-12-26 10:12:11,887][123090] Updated weights for policy 1, policy_version 1319718 (0.0009) [2023-12-26 10:12:11,959][123090] Updated weights for policy 1, policy_version 1319728 (0.0006) [2023-12-26 10:12:12,017][123090] Updated weights for policy 1, policy_version 1319738 (0.0006) [2023-12-26 10:12:12,237][123091] Updated weights for policy 0, policy_version 1329111 (0.0010) [2023-12-26 10:12:12,306][123091] Updated weights for policy 0, policy_version 1329121 (0.0009) [2023-12-26 10:12:12,379][123091] Updated weights for policy 0, policy_version 1329131 (0.0008) [2023-12-26 10:12:12,745][123090] Updated weights for policy 1, policy_version 1319748 (0.0006) [2023-12-26 10:12:12,808][123090] Updated weights for policy 1, policy_version 1319758 (0.0005) [2023-12-26 10:12:12,876][123090] Updated weights for policy 1, policy_version 1319768 (0.0006) [2023-12-26 10:12:13,145][123091] Updated weights for policy 0, policy_version 1329141 (0.0007) [2023-12-26 10:12:13,198][123091] Updated weights for policy 0, policy_version 1329151 (0.0009) [2023-12-26 10:12:13,263][123091] Updated weights for policy 0, policy_version 1329161 (0.0009) [2023-12-26 10:12:13,549][123090] Updated weights for policy 1, policy_version 1319778 (0.0006) [2023-12-26 10:12:13,602][123090] Updated weights for policy 1, policy_version 1319788 (0.0007) [2023-12-26 10:12:13,658][123090] Updated weights for policy 1, policy_version 1319799 (0.0006) [2023-12-26 10:12:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 678141952. Throughput: 0: 8960.2, 1: 8732.8. Samples: 678131300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:13,785][121949] Avg episode reward: [(0, '6234.170'), (1, '5511.110')] [2023-12-26 10:12:14,182][123091] Updated weights for policy 0, policy_version 1329171 (0.0010) [2023-12-26 10:12:14,237][123091] Updated weights for policy 0, policy_version 1329181 (0.0010) [2023-12-26 10:12:14,293][123091] Updated weights for policy 0, policy_version 1329192 (0.0009) [2023-12-26 10:12:14,323][123090] Updated weights for policy 1, policy_version 1319809 (0.0007) [2023-12-26 10:12:14,382][123090] Updated weights for policy 1, policy_version 1319819 (0.0010) [2023-12-26 10:12:14,429][123090] Updated weights for policy 1, policy_version 1319829 (0.0010) [2023-12-26 10:12:14,485][123090] Updated weights for policy 1, policy_version 1319839 (0.0010) [2023-12-26 10:12:15,113][123091] Updated weights for policy 0, policy_version 1329202 (0.0006) [2023-12-26 10:12:15,184][123091] Updated weights for policy 0, policy_version 1329212 (0.0006) [2023-12-26 10:12:15,245][123091] Updated weights for policy 0, policy_version 1329222 (0.0007) [2023-12-26 10:12:15,248][123090] Updated weights for policy 1, policy_version 1319849 (0.0006) [2023-12-26 10:12:15,316][123091] Updated weights for policy 0, policy_version 1329232 (0.0006) [2023-12-26 10:12:15,322][123090] Updated weights for policy 1, policy_version 1319859 (0.0006) [2023-12-26 10:12:15,396][123090] Updated weights for policy 1, policy_version 1319869 (0.0011) [2023-12-26 10:12:16,038][123091] Updated weights for policy 0, policy_version 1329242 (0.0006) [2023-12-26 10:12:16,115][123091] Updated weights for policy 0, policy_version 1329252 (0.0006) [2023-12-26 10:12:16,144][123090] Updated weights for policy 1, policy_version 1319879 (0.0010) [2023-12-26 10:12:16,181][123091] Updated weights for policy 0, policy_version 1329262 (0.0007) [2023-12-26 10:12:16,203][123090] Updated weights for policy 1, policy_version 1319889 (0.0010) [2023-12-26 10:12:16,247][123090] Updated weights for policy 1, policy_version 1319899 (0.0010) [2023-12-26 10:12:16,890][123091] Updated weights for policy 0, policy_version 1329272 (0.0006) [2023-12-26 10:12:16,957][123091] Updated weights for policy 0, policy_version 1329282 (0.0005) [2023-12-26 10:12:17,019][123091] Updated weights for policy 0, policy_version 1329292 (0.0007) [2023-12-26 10:12:17,030][123090] Updated weights for policy 1, policy_version 1319909 (0.0009) [2023-12-26 10:12:17,090][123090] Updated weights for policy 1, policy_version 1319919 (0.0005) [2023-12-26 10:12:17,149][123090] Updated weights for policy 1, policy_version 1319929 (0.0005) [2023-12-26 10:12:17,790][123091] Updated weights for policy 0, policy_version 1329302 (0.0008) [2023-12-26 10:12:17,796][123090] Updated weights for policy 1, policy_version 1319939 (0.0007) [2023-12-26 10:12:17,847][123091] Updated weights for policy 0, policy_version 1329312 (0.0006) [2023-12-26 10:12:17,847][123090] Updated weights for policy 1, policy_version 1319949 (0.0010) [2023-12-26 10:12:17,895][123091] Updated weights for policy 0, policy_version 1329322 (0.0005) [2023-12-26 10:12:17,899][123090] Updated weights for policy 1, policy_version 1319959 (0.0010) [2023-12-26 10:12:18,602][123091] Updated weights for policy 0, policy_version 1329332 (0.0007) [2023-12-26 10:12:18,662][123091] Updated weights for policy 0, policy_version 1329342 (0.0008) [2023-12-26 10:12:18,690][123090] Updated weights for policy 1, policy_version 1319969 (0.0010) [2023-12-26 10:12:18,726][123091] Updated weights for policy 0, policy_version 1329352 (0.0009) [2023-12-26 10:12:18,749][123090] Updated weights for policy 1, policy_version 1319979 (0.0010) [2023-12-26 10:12:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.5, 300 sec: 17689.2). Total num frames: 678232064. Throughput: 0: 9005.6, 1: 8889.7. Samples: 678244396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:18,785][121949] Avg episode reward: [(0, '6249.461'), (1, '5498.884')] [2023-12-26 10:12:18,820][123090] Updated weights for policy 1, policy_version 1319989 (0.0011) [2023-12-26 10:12:18,890][123090] Updated weights for policy 1, policy_version 1319999 (0.0011) [2023-12-26 10:12:19,595][123091] Updated weights for policy 0, policy_version 1329362 (0.0007) [2023-12-26 10:12:19,654][123091] Updated weights for policy 0, policy_version 1329372 (0.0010) [2023-12-26 10:12:19,698][123090] Updated weights for policy 1, policy_version 1320009 (0.0006) [2023-12-26 10:12:19,712][123091] Updated weights for policy 0, policy_version 1329382 (0.0008) [2023-12-26 10:12:19,753][123090] Updated weights for policy 1, policy_version 1320019 (0.0008) [2023-12-26 10:12:19,775][123091] Updated weights for policy 0, policy_version 1329392 (0.0008) [2023-12-26 10:12:19,810][123090] Updated weights for policy 1, policy_version 1320029 (0.0007) [2023-12-26 10:12:20,630][123090] Updated weights for policy 1, policy_version 1320039 (0.0010) [2023-12-26 10:12:20,648][123091] Updated weights for policy 0, policy_version 1329402 (0.0011) [2023-12-26 10:12:20,694][123090] Updated weights for policy 1, policy_version 1320049 (0.0011) [2023-12-26 10:12:20,709][123091] Updated weights for policy 0, policy_version 1329412 (0.0011) [2023-12-26 10:12:20,754][123090] Updated weights for policy 1, policy_version 1320059 (0.0011) [2023-12-26 10:12:20,768][123091] Updated weights for policy 0, policy_version 1329422 (0.0010) [2023-12-26 10:12:21,578][123090] Updated weights for policy 1, policy_version 1320069 (0.0011) [2023-12-26 10:12:21,616][123091] Updated weights for policy 0, policy_version 1329432 (0.0010) [2023-12-26 10:12:21,647][123090] Updated weights for policy 1, policy_version 1320079 (0.0011) [2023-12-26 10:12:21,687][123091] Updated weights for policy 0, policy_version 1329442 (0.0011) [2023-12-26 10:12:21,716][123090] Updated weights for policy 1, policy_version 1320089 (0.0010) [2023-12-26 10:12:21,747][123091] Updated weights for policy 0, policy_version 1329452 (0.0009) [2023-12-26 10:12:22,544][123091] Updated weights for policy 0, policy_version 1329462 (0.0007) [2023-12-26 10:12:22,551][123090] Updated weights for policy 1, policy_version 1320099 (0.0011) [2023-12-26 10:12:22,608][123091] Updated weights for policy 0, policy_version 1329472 (0.0008) [2023-12-26 10:12:22,614][123090] Updated weights for policy 1, policy_version 1320109 (0.0011) [2023-12-26 10:12:22,665][123091] Updated weights for policy 0, policy_version 1329482 (0.0008) [2023-12-26 10:12:22,678][123090] Updated weights for policy 1, policy_version 1320119 (0.0010) [2023-12-26 10:12:23,379][123091] Updated weights for policy 0, policy_version 1329492 (0.0009) [2023-12-26 10:12:23,446][123091] Updated weights for policy 0, policy_version 1329502 (0.0011) [2023-12-26 10:12:23,501][123091] Updated weights for policy 0, policy_version 1329512 (0.0010) [2023-12-26 10:12:23,506][123090] Updated weights for policy 1, policy_version 1320129 (0.0010) [2023-12-26 10:12:23,557][123090] Updated weights for policy 1, policy_version 1320139 (0.0010) [2023-12-26 10:12:23,623][123090] Updated weights for policy 1, policy_version 1320149 (0.0010) [2023-12-26 10:12:23,681][123090] Updated weights for policy 1, policy_version 1320159 (0.0010) [2023-12-26 10:12:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 678322176. Throughput: 0: 8986.7, 1: 8902.1. Samples: 678295112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:23,785][121949] Avg episode reward: [(0, '6345.020'), (1, '5496.668')] [2023-12-26 10:12:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001329520_340361216.pth... [2023-12-26 10:12:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001320160_337960960.pth... [2023-12-26 10:12:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001319104_337690624.pth [2023-12-26 10:12:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001328464_340090880.pth [2023-12-26 10:12:24,323][123091] Updated weights for policy 0, policy_version 1329522 (0.0011) [2023-12-26 10:12:24,381][123091] Updated weights for policy 0, policy_version 1329532 (0.0010) [2023-12-26 10:12:24,439][123091] Updated weights for policy 0, policy_version 1329542 (0.0010) [2023-12-26 10:12:24,481][123090] Updated weights for policy 1, policy_version 1320169 (0.0007) [2023-12-26 10:12:24,494][123091] Updated weights for policy 0, policy_version 1329552 (0.0010) [2023-12-26 10:12:24,537][123090] Updated weights for policy 1, policy_version 1320179 (0.0009) [2023-12-26 10:12:24,602][123090] Updated weights for policy 1, policy_version 1320189 (0.0008) [2023-12-26 10:12:25,304][123091] Updated weights for policy 0, policy_version 1329562 (0.0010) [2023-12-26 10:12:25,363][123091] Updated weights for policy 0, policy_version 1329572 (0.0007) [2023-12-26 10:12:25,431][123091] Updated weights for policy 0, policy_version 1329582 (0.0008) [2023-12-26 10:12:25,457][123090] Updated weights for policy 1, policy_version 1320199 (0.0008) [2023-12-26 10:12:25,513][123090] Updated weights for policy 1, policy_version 1320209 (0.0005) [2023-12-26 10:12:25,570][123090] Updated weights for policy 1, policy_version 1320219 (0.0005) [2023-12-26 10:12:26,240][123090] Updated weights for policy 1, policy_version 1320229 (0.0007) [2023-12-26 10:12:26,252][123091] Updated weights for policy 0, policy_version 1329592 (0.0008) [2023-12-26 10:12:26,294][123090] Updated weights for policy 1, policy_version 1320239 (0.0007) [2023-12-26 10:12:26,313][123091] Updated weights for policy 0, policy_version 1329602 (0.0010) [2023-12-26 10:12:26,356][123090] Updated weights for policy 1, policy_version 1320249 (0.0007) [2023-12-26 10:12:26,375][123091] Updated weights for policy 0, policy_version 1329612 (0.0009) [2023-12-26 10:12:27,200][123090] Updated weights for policy 1, policy_version 1320259 (0.0007) [2023-12-26 10:12:27,224][123091] Updated weights for policy 0, policy_version 1329622 (0.0009) [2023-12-26 10:12:27,246][123090] Updated weights for policy 1, policy_version 1320269 (0.0005) [2023-12-26 10:12:27,282][123091] Updated weights for policy 0, policy_version 1329632 (0.0009) [2023-12-26 10:12:27,295][123090] Updated weights for policy 1, policy_version 1320279 (0.0005) [2023-12-26 10:12:27,340][123091] Updated weights for policy 0, policy_version 1329642 (0.0009) [2023-12-26 10:12:27,836][123090] Updated weights for policy 1, policy_version 1320289 (0.0006) [2023-12-26 10:12:27,901][123090] Updated weights for policy 1, policy_version 1320299 (0.0005) [2023-12-26 10:12:27,967][123090] Updated weights for policy 1, policy_version 1320309 (0.0005) [2023-12-26 10:12:28,017][123090] Updated weights for policy 1, policy_version 1320319 (0.0005) [2023-12-26 10:12:28,241][123091] Updated weights for policy 0, policy_version 1329652 (0.0010) [2023-12-26 10:12:28,295][123091] Updated weights for policy 0, policy_version 1329662 (0.0009) [2023-12-26 10:12:28,350][123091] Updated weights for policy 0, policy_version 1329672 (0.0009) [2023-12-26 10:12:28,709][123090] Updated weights for policy 1, policy_version 1320329 (0.0005) [2023-12-26 10:12:28,773][123090] Updated weights for policy 1, policy_version 1320339 (0.0006) [2023-12-26 10:12:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 678404096. Throughput: 0: 8948.7, 1: 8967.9. Samples: 678400308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:28,784][121949] Avg episode reward: [(0, '6342.864'), (1, '5392.090')] [2023-12-26 10:12:28,825][123090] Updated weights for policy 1, policy_version 1320349 (0.0009) [2023-12-26 10:12:29,208][123091] Updated weights for policy 0, policy_version 1329682 (0.0009) [2023-12-26 10:12:29,282][123091] Updated weights for policy 0, policy_version 1329692 (0.0011) [2023-12-26 10:12:29,355][123091] Updated weights for policy 0, policy_version 1329702 (0.0010) [2023-12-26 10:12:29,413][123091] Updated weights for policy 0, policy_version 1329712 (0.0010) [2023-12-26 10:12:29,554][123090] Updated weights for policy 1, policy_version 1320359 (0.0008) [2023-12-26 10:12:29,607][123090] Updated weights for policy 1, policy_version 1320369 (0.0009) [2023-12-26 10:12:29,658][123090] Updated weights for policy 1, policy_version 1320379 (0.0009) [2023-12-26 10:12:30,240][123091] Updated weights for policy 0, policy_version 1329722 (0.0009) [2023-12-26 10:12:30,300][123091] Updated weights for policy 0, policy_version 1329732 (0.0008) [2023-12-26 10:12:30,359][123091] Updated weights for policy 0, policy_version 1329742 (0.0009) [2023-12-26 10:12:30,500][123090] Updated weights for policy 1, policy_version 1320389 (0.0010) [2023-12-26 10:12:30,562][123090] Updated weights for policy 1, policy_version 1320399 (0.0010) [2023-12-26 10:12:30,622][123090] Updated weights for policy 1, policy_version 1320409 (0.0010) [2023-12-26 10:12:31,150][123091] Updated weights for policy 0, policy_version 1329752 (0.0009) [2023-12-26 10:12:31,208][123091] Updated weights for policy 0, policy_version 1329762 (0.0008) [2023-12-26 10:12:31,270][123091] Updated weights for policy 0, policy_version 1329772 (0.0008) [2023-12-26 10:12:31,497][123090] Updated weights for policy 1, policy_version 1320419 (0.0009) [2023-12-26 10:12:31,556][123090] Updated weights for policy 1, policy_version 1320429 (0.0010) [2023-12-26 10:12:31,601][123090] Updated weights for policy 1, policy_version 1320439 (0.0010) [2023-12-26 10:12:32,060][123091] Updated weights for policy 0, policy_version 1329782 (0.0008) [2023-12-26 10:12:32,114][123091] Updated weights for policy 0, policy_version 1329792 (0.0009) [2023-12-26 10:12:32,175][123091] Updated weights for policy 0, policy_version 1329803 (0.0010) [2023-12-26 10:12:32,457][123090] Updated weights for policy 1, policy_version 1320449 (0.0009) [2023-12-26 10:12:32,526][123090] Updated weights for policy 1, policy_version 1320459 (0.0010) [2023-12-26 10:12:32,592][123090] Updated weights for policy 1, policy_version 1320469 (0.0010) [2023-12-26 10:12:32,658][123090] Updated weights for policy 1, policy_version 1320479 (0.0010) [2023-12-26 10:12:33,048][123091] Updated weights for policy 0, policy_version 1329813 (0.0010) [2023-12-26 10:12:33,102][123091] Updated weights for policy 0, policy_version 1329823 (0.0010) [2023-12-26 10:12:33,160][123091] Updated weights for policy 0, policy_version 1329833 (0.0010) [2023-12-26 10:12:33,390][123090] Updated weights for policy 1, policy_version 1320489 (0.0006) [2023-12-26 10:12:33,455][123090] Updated weights for policy 1, policy_version 1320499 (0.0005) [2023-12-26 10:12:33,504][123090] Updated weights for policy 1, policy_version 1320509 (0.0005) [2023-12-26 10:12:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 678494208. Throughput: 0: 8840.7, 1: 9000.6. Samples: 678505608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:33,785][121949] Avg episode reward: [(0, '6331.882'), (1, '5265.705')] [2023-12-26 10:12:33,909][123091] Updated weights for policy 0, policy_version 1329843 (0.0009) [2023-12-26 10:12:33,971][123091] Updated weights for policy 0, policy_version 1329853 (0.0005) [2023-12-26 10:12:34,026][123091] Updated weights for policy 0, policy_version 1329863 (0.0005) [2023-12-26 10:12:34,166][123090] Updated weights for policy 1, policy_version 1320519 (0.0006) [2023-12-26 10:12:34,229][123090] Updated weights for policy 1, policy_version 1320529 (0.0007) [2023-12-26 10:12:34,287][123090] Updated weights for policy 1, policy_version 1320539 (0.0008) [2023-12-26 10:12:34,763][123091] Updated weights for policy 0, policy_version 1329873 (0.0006) [2023-12-26 10:12:34,810][123091] Updated weights for policy 0, policy_version 1329883 (0.0011) [2023-12-26 10:12:34,873][123091] Updated weights for policy 0, policy_version 1329893 (0.0010) [2023-12-26 10:12:34,939][123091] Updated weights for policy 0, policy_version 1329903 (0.0011) [2023-12-26 10:12:35,095][123090] Updated weights for policy 1, policy_version 1320549 (0.0009) [2023-12-26 10:12:35,172][123090] Updated weights for policy 1, policy_version 1320559 (0.0010) [2023-12-26 10:12:35,242][123090] Updated weights for policy 1, policy_version 1320569 (0.0010) [2023-12-26 10:12:35,613][123091] Updated weights for policy 0, policy_version 1329913 (0.0006) [2023-12-26 10:12:35,661][123091] Updated weights for policy 0, policy_version 1329923 (0.0005) [2023-12-26 10:12:35,708][123091] Updated weights for policy 0, policy_version 1329933 (0.0005) [2023-12-26 10:12:35,981][123090] Updated weights for policy 1, policy_version 1320579 (0.0009) [2023-12-26 10:12:36,029][123090] Updated weights for policy 1, policy_version 1320589 (0.0005) [2023-12-26 10:12:36,077][123090] Updated weights for policy 1, policy_version 1320599 (0.0005) [2023-12-26 10:12:36,439][123091] Updated weights for policy 0, policy_version 1329943 (0.0006) [2023-12-26 10:12:36,500][123091] Updated weights for policy 0, policy_version 1329953 (0.0011) [2023-12-26 10:12:36,575][123091] Updated weights for policy 0, policy_version 1329963 (0.0008) [2023-12-26 10:12:36,865][123090] Updated weights for policy 1, policy_version 1320609 (0.0007) [2023-12-26 10:12:36,928][123090] Updated weights for policy 1, policy_version 1320619 (0.0011) [2023-12-26 10:12:36,991][123090] Updated weights for policy 1, policy_version 1320629 (0.0011) [2023-12-26 10:12:37,056][123090] Updated weights for policy 1, policy_version 1320639 (0.0011) [2023-12-26 10:12:37,334][123091] Updated weights for policy 0, policy_version 1329973 (0.0010) [2023-12-26 10:12:37,384][123091] Updated weights for policy 0, policy_version 1329983 (0.0009) [2023-12-26 10:12:37,443][123091] Updated weights for policy 0, policy_version 1329993 (0.0009) [2023-12-26 10:12:37,818][123090] Updated weights for policy 1, policy_version 1320649 (0.0011) [2023-12-26 10:12:37,874][123090] Updated weights for policy 1, policy_version 1320659 (0.0011) [2023-12-26 10:12:37,938][123090] Updated weights for policy 1, policy_version 1320669 (0.0011) [2023-12-26 10:12:38,316][123091] Updated weights for policy 0, policy_version 1330003 (0.0009) [2023-12-26 10:12:38,368][123091] Updated weights for policy 0, policy_version 1330013 (0.0009) [2023-12-26 10:12:38,418][123091] Updated weights for policy 0, policy_version 1330023 (0.0009) [2023-12-26 10:12:38,757][123090] Updated weights for policy 1, policy_version 1320679 (0.0011) [2023-12-26 10:12:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 678584320. Throughput: 0: 8889.9, 1: 9033.5. Samples: 678562540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:38,785][121949] Avg episode reward: [(0, '6183.214'), (1, '5485.808')] [2023-12-26 10:12:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001330032_340492288.pth... [2023-12-26 10:12:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001329008_340230144.pth [2023-12-26 10:12:38,817][123090] Updated weights for policy 1, policy_version 1320689 (0.0011) [2023-12-26 10:12:38,885][123090] Updated weights for policy 1, policy_version 1320699 (0.0011) [2023-12-26 10:12:38,917][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001320704_338100224.pth... [2023-12-26 10:12:38,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001319616_337821696.pth [2023-12-26 10:12:39,274][123091] Updated weights for policy 0, policy_version 1330033 (0.0009) [2023-12-26 10:12:39,339][123091] Updated weights for policy 0, policy_version 1330043 (0.0009) [2023-12-26 10:12:39,399][123091] Updated weights for policy 0, policy_version 1330053 (0.0008) [2023-12-26 10:12:39,469][123091] Updated weights for policy 0, policy_version 1330063 (0.0009) [2023-12-26 10:12:39,719][123090] Updated weights for policy 1, policy_version 1320709 (0.0011) [2023-12-26 10:12:39,784][123090] Updated weights for policy 1, policy_version 1320719 (0.0010) [2023-12-26 10:12:39,857][123090] Updated weights for policy 1, policy_version 1320729 (0.0011) [2023-12-26 10:12:40,253][123091] Updated weights for policy 0, policy_version 1330073 (0.0010) [2023-12-26 10:12:40,320][123091] Updated weights for policy 0, policy_version 1330083 (0.0011) [2023-12-26 10:12:40,387][123091] Updated weights for policy 0, policy_version 1330093 (0.0011) [2023-12-26 10:12:40,668][123090] Updated weights for policy 1, policy_version 1320739 (0.0010) [2023-12-26 10:12:40,722][123090] Updated weights for policy 1, policy_version 1320749 (0.0010) [2023-12-26 10:12:40,781][123090] Updated weights for policy 1, policy_version 1320759 (0.0005) [2023-12-26 10:12:41,184][123091] Updated weights for policy 0, policy_version 1330103 (0.0010) [2023-12-26 10:12:41,240][123091] Updated weights for policy 0, policy_version 1330113 (0.0011) [2023-12-26 10:12:41,303][123091] Updated weights for policy 0, policy_version 1330123 (0.0008) [2023-12-26 10:12:41,550][123090] Updated weights for policy 1, policy_version 1320769 (0.0005) [2023-12-26 10:12:41,622][123090] Updated weights for policy 1, policy_version 1320779 (0.0006) [2023-12-26 10:12:41,688][123090] Updated weights for policy 1, policy_version 1320789 (0.0007) [2023-12-26 10:12:41,760][123090] Updated weights for policy 1, policy_version 1320799 (0.0008) [2023-12-26 10:12:42,184][123091] Updated weights for policy 0, policy_version 1330133 (0.0009) [2023-12-26 10:12:42,256][123091] Updated weights for policy 0, policy_version 1330143 (0.0009) [2023-12-26 10:12:42,322][123091] Updated weights for policy 0, policy_version 1330153 (0.0008) [2023-12-26 10:12:42,485][123090] Updated weights for policy 1, policy_version 1320809 (0.0008) [2023-12-26 10:12:42,561][123090] Updated weights for policy 1, policy_version 1320819 (0.0010) [2023-12-26 10:12:42,625][123090] Updated weights for policy 1, policy_version 1320829 (0.0009) [2023-12-26 10:12:43,095][123091] Updated weights for policy 0, policy_version 1330163 (0.0008) [2023-12-26 10:12:43,149][123091] Updated weights for policy 0, policy_version 1330173 (0.0005) [2023-12-26 10:12:43,197][123091] Updated weights for policy 0, policy_version 1330183 (0.0005) [2023-12-26 10:12:43,365][123090] Updated weights for policy 1, policy_version 1320839 (0.0007) [2023-12-26 10:12:43,439][123090] Updated weights for policy 1, policy_version 1320849 (0.0005) [2023-12-26 10:12:43,488][123090] Updated weights for policy 1, policy_version 1320859 (0.0005) [2023-12-26 10:12:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 678674432. Throughput: 0: 8793.4, 1: 8987.2. Samples: 678665816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:43,785][121949] Avg episode reward: [(0, '6197.748'), (1, '5574.003')] [2023-12-26 10:12:43,927][123091] Updated weights for policy 0, policy_version 1330193 (0.0005) [2023-12-26 10:12:43,999][123091] Updated weights for policy 0, policy_version 1330203 (0.0005) [2023-12-26 10:12:44,062][123091] Updated weights for policy 0, policy_version 1330213 (0.0005) [2023-12-26 10:12:44,135][123091] Updated weights for policy 0, policy_version 1330223 (0.0005) [2023-12-26 10:12:44,209][123090] Updated weights for policy 1, policy_version 1320869 (0.0006) [2023-12-26 10:12:44,279][123090] Updated weights for policy 1, policy_version 1320879 (0.0006) [2023-12-26 10:12:44,338][123090] Updated weights for policy 1, policy_version 1320889 (0.0005) [2023-12-26 10:12:44,861][123091] Updated weights for policy 0, policy_version 1330233 (0.0006) [2023-12-26 10:12:44,928][123091] Updated weights for policy 0, policy_version 1330243 (0.0006) [2023-12-26 10:12:44,986][123091] Updated weights for policy 0, policy_version 1330253 (0.0005) [2023-12-26 10:12:45,052][123090] Updated weights for policy 1, policy_version 1320899 (0.0007) [2023-12-26 10:12:45,115][123090] Updated weights for policy 1, policy_version 1320909 (0.0011) [2023-12-26 10:12:45,175][123090] Updated weights for policy 1, policy_version 1320919 (0.0010) [2023-12-26 10:12:45,809][123091] Updated weights for policy 0, policy_version 1330263 (0.0009) [2023-12-26 10:12:45,872][123091] Updated weights for policy 0, policy_version 1330273 (0.0010) [2023-12-26 10:12:45,918][123090] Updated weights for policy 1, policy_version 1320929 (0.0011) [2023-12-26 10:12:45,931][123091] Updated weights for policy 0, policy_version 1330283 (0.0009) [2023-12-26 10:12:45,984][123090] Updated weights for policy 1, policy_version 1320939 (0.0010) [2023-12-26 10:12:46,046][123090] Updated weights for policy 1, policy_version 1320949 (0.0010) [2023-12-26 10:12:46,113][123090] Updated weights for policy 1, policy_version 1320959 (0.0010) [2023-12-26 10:12:46,773][123091] Updated weights for policy 0, policy_version 1330293 (0.0009) [2023-12-26 10:12:46,828][123091] Updated weights for policy 0, policy_version 1330303 (0.0009) [2023-12-26 10:12:46,888][123091] Updated weights for policy 0, policy_version 1330313 (0.0009) [2023-12-26 10:12:46,916][123090] Updated weights for policy 1, policy_version 1320969 (0.0006) [2023-12-26 10:12:46,972][123090] Updated weights for policy 1, policy_version 1320979 (0.0005) [2023-12-26 10:12:47,026][123090] Updated weights for policy 1, policy_version 1320989 (0.0005) [2023-12-26 10:12:47,757][123091] Updated weights for policy 0, policy_version 1330323 (0.0009) [2023-12-26 10:12:47,767][123090] Updated weights for policy 1, policy_version 1320999 (0.0005) [2023-12-26 10:12:47,806][123091] Updated weights for policy 0, policy_version 1330333 (0.0008) [2023-12-26 10:12:47,825][123090] Updated weights for policy 1, policy_version 1321009 (0.0005) [2023-12-26 10:12:47,863][123091] Updated weights for policy 0, policy_version 1330343 (0.0009) [2023-12-26 10:12:47,894][123090] Updated weights for policy 1, policy_version 1321019 (0.0008) [2023-12-26 10:12:48,590][123091] Updated weights for policy 0, policy_version 1330353 (0.0006) [2023-12-26 10:12:48,658][123091] Updated weights for policy 0, policy_version 1330363 (0.0006) [2023-12-26 10:12:48,684][123090] Updated weights for policy 1, policy_version 1321029 (0.0011) [2023-12-26 10:12:48,726][123091] Updated weights for policy 0, policy_version 1330373 (0.0006) [2023-12-26 10:12:48,740][123090] Updated weights for policy 1, policy_version 1321039 (0.0010) [2023-12-26 10:12:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 678756352. Throughput: 0: 8802.1, 1: 9094.2. Samples: 678776840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:48,784][121949] Avg episode reward: [(0, '6276.446'), (1, '5425.426')] [2023-12-26 10:12:48,786][123091] Updated weights for policy 0, policy_version 1330383 (0.0007) [2023-12-26 10:12:48,799][123090] Updated weights for policy 1, policy_version 1321049 (0.0010) [2023-12-26 10:12:49,474][123091] Updated weights for policy 0, policy_version 1330393 (0.0010) [2023-12-26 10:12:49,541][123091] Updated weights for policy 0, policy_version 1330403 (0.0010) [2023-12-26 10:12:49,575][123090] Updated weights for policy 1, policy_version 1321059 (0.0009) [2023-12-26 10:12:49,597][123091] Updated weights for policy 0, policy_version 1330413 (0.0009) [2023-12-26 10:12:49,634][123090] Updated weights for policy 1, policy_version 1321069 (0.0008) [2023-12-26 10:12:49,704][123090] Updated weights for policy 1, policy_version 1321079 (0.0010) [2023-12-26 10:12:50,400][123091] Updated weights for policy 0, policy_version 1330423 (0.0008) [2023-12-26 10:12:50,463][123091] Updated weights for policy 0, policy_version 1330433 (0.0008) [2023-12-26 10:12:50,517][123091] Updated weights for policy 0, policy_version 1330443 (0.0010) [2023-12-26 10:12:50,533][123090] Updated weights for policy 1, policy_version 1321089 (0.0010) [2023-12-26 10:12:50,603][123090] Updated weights for policy 1, policy_version 1321100 (0.0007) [2023-12-26 10:12:50,683][123090] Updated weights for policy 1, policy_version 1321110 (0.0005) [2023-12-26 10:12:50,744][123090] Updated weights for policy 1, policy_version 1321120 (0.0006) [2023-12-26 10:12:51,393][123091] Updated weights for policy 0, policy_version 1330453 (0.0009) [2023-12-26 10:12:51,421][123090] Updated weights for policy 1, policy_version 1321130 (0.0007) [2023-12-26 10:12:51,459][123091] Updated weights for policy 0, policy_version 1330463 (0.0009) [2023-12-26 10:12:51,481][123090] Updated weights for policy 1, policy_version 1321140 (0.0005) [2023-12-26 10:12:51,521][123091] Updated weights for policy 0, policy_version 1330473 (0.0009) [2023-12-26 10:12:51,550][123090] Updated weights for policy 1, policy_version 1321150 (0.0008) [2023-12-26 10:12:52,326][123090] Updated weights for policy 1, policy_version 1321160 (0.0009) [2023-12-26 10:12:52,371][123091] Updated weights for policy 0, policy_version 1330483 (0.0008) [2023-12-26 10:12:52,392][123090] Updated weights for policy 1, policy_version 1321170 (0.0010) [2023-12-26 10:12:52,436][123091] Updated weights for policy 0, policy_version 1330493 (0.0008) [2023-12-26 10:12:52,453][123090] Updated weights for policy 1, policy_version 1321180 (0.0009) [2023-12-26 10:12:52,501][123091] Updated weights for policy 0, policy_version 1330503 (0.0008) [2023-12-26 10:12:53,259][123091] Updated weights for policy 0, policy_version 1330513 (0.0009) [2023-12-26 10:12:53,309][123091] Updated weights for policy 0, policy_version 1330523 (0.0008) [2023-12-26 10:12:53,309][123090] Updated weights for policy 1, policy_version 1321190 (0.0009) [2023-12-26 10:12:53,359][123091] Updated weights for policy 0, policy_version 1330533 (0.0007) [2023-12-26 10:12:53,369][123090] Updated weights for policy 1, policy_version 1321200 (0.0010) [2023-12-26 10:12:53,413][123091] Updated weights for policy 0, policy_version 1330543 (0.0009) [2023-12-26 10:12:53,421][123090] Updated weights for policy 1, policy_version 1321210 (0.0008) [2023-12-26 10:12:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 678854656. Throughput: 0: 8777.1, 1: 9069.1. Samples: 678829956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:53,785][121949] Avg episode reward: [(0, '6380.861'), (1, '5433.525')] [2023-12-26 10:12:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001330544_340623360.pth... [2023-12-26 10:12:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001321216_338231296.pth... [2023-12-26 10:12:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001320160_337960960.pth [2023-12-26 10:12:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001329520_340361216.pth [2023-12-26 10:12:54,186][123091] Updated weights for policy 0, policy_version 1330553 (0.0006) [2023-12-26 10:12:54,240][123091] Updated weights for policy 0, policy_version 1330563 (0.0005) [2023-12-26 10:12:54,280][123090] Updated weights for policy 1, policy_version 1321220 (0.0008) [2023-12-26 10:12:54,303][123091] Updated weights for policy 0, policy_version 1330573 (0.0007) [2023-12-26 10:12:54,331][123090] Updated weights for policy 1, policy_version 1321230 (0.0007) [2023-12-26 10:12:54,393][123090] Updated weights for policy 1, policy_version 1321240 (0.0009) [2023-12-26 10:12:54,975][123091] Updated weights for policy 0, policy_version 1330583 (0.0006) [2023-12-26 10:12:55,034][123091] Updated weights for policy 0, policy_version 1330593 (0.0006) [2023-12-26 10:12:55,101][123091] Updated weights for policy 0, policy_version 1330603 (0.0005) [2023-12-26 10:12:55,293][123090] Updated weights for policy 1, policy_version 1321250 (0.0010) [2023-12-26 10:12:55,352][123090] Updated weights for policy 1, policy_version 1321260 (0.0009) [2023-12-26 10:12:55,416][123090] Updated weights for policy 1, policy_version 1321270 (0.0009) [2023-12-26 10:12:55,472][123090] Updated weights for policy 1, policy_version 1321280 (0.0009) [2023-12-26 10:12:55,771][123091] Updated weights for policy 0, policy_version 1330613 (0.0005) [2023-12-26 10:12:55,826][123091] Updated weights for policy 0, policy_version 1330623 (0.0005) [2023-12-26 10:12:55,881][123091] Updated weights for policy 0, policy_version 1330633 (0.0007) [2023-12-26 10:12:56,331][123090] Updated weights for policy 1, policy_version 1321290 (0.0009) [2023-12-26 10:12:56,379][123090] Updated weights for policy 1, policy_version 1321300 (0.0008) [2023-12-26 10:12:56,427][123090] Updated weights for policy 1, policy_version 1321310 (0.0008) [2023-12-26 10:12:56,665][123091] Updated weights for policy 0, policy_version 1330643 (0.0009) [2023-12-26 10:12:56,731][123091] Updated weights for policy 0, policy_version 1330653 (0.0010) [2023-12-26 10:12:56,788][123091] Updated weights for policy 0, policy_version 1330663 (0.0010) [2023-12-26 10:12:57,238][123090] Updated weights for policy 1, policy_version 1321320 (0.0011) [2023-12-26 10:12:57,288][123090] Updated weights for policy 1, policy_version 1321330 (0.0010) [2023-12-26 10:12:57,350][123090] Updated weights for policy 1, policy_version 1321340 (0.0006) [2023-12-26 10:12:57,615][123091] Updated weights for policy 0, policy_version 1330673 (0.0011) [2023-12-26 10:12:57,673][123091] Updated weights for policy 0, policy_version 1330684 (0.0010) [2023-12-26 10:12:57,740][123091] Updated weights for policy 0, policy_version 1330694 (0.0010) [2023-12-26 10:12:57,808][123091] Updated weights for policy 0, policy_version 1330704 (0.0010) [2023-12-26 10:12:58,050][123090] Updated weights for policy 1, policy_version 1321350 (0.0007) [2023-12-26 10:12:58,114][123090] Updated weights for policy 1, policy_version 1321360 (0.0007) [2023-12-26 10:12:58,184][123090] Updated weights for policy 1, policy_version 1321370 (0.0010) [2023-12-26 10:12:58,766][123091] Updated weights for policy 0, policy_version 1330714 (0.0012) [2023-12-26 10:12:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 678936576. Throughput: 0: 8857.1, 1: 9026.9. Samples: 678936084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:12:58,785][121949] Avg episode reward: [(0, '6244.449'), (1, '5348.188')] [2023-12-26 10:12:58,836][123091] Updated weights for policy 0, policy_version 1330724 (0.0008) [2023-12-26 10:12:58,907][123091] Updated weights for policy 0, policy_version 1330734 (0.0008) [2023-12-26 10:12:59,127][123090] Updated weights for policy 1, policy_version 1321380 (0.0010) [2023-12-26 10:12:59,198][123090] Updated weights for policy 1, policy_version 1321390 (0.0008) [2023-12-26 10:12:59,269][123090] Updated weights for policy 1, policy_version 1321400 (0.0009) [2023-12-26 10:12:59,764][123091] Updated weights for policy 0, policy_version 1330744 (0.0009) [2023-12-26 10:12:59,816][123091] Updated weights for policy 0, policy_version 1330754 (0.0009) [2023-12-26 10:12:59,879][123091] Updated weights for policy 0, policy_version 1330764 (0.0009) [2023-12-26 10:13:00,025][123090] Updated weights for policy 1, policy_version 1321410 (0.0009) [2023-12-26 10:13:00,091][123090] Updated weights for policy 1, policy_version 1321420 (0.0010) [2023-12-26 10:13:00,155][123090] Updated weights for policy 1, policy_version 1321430 (0.0009) [2023-12-26 10:13:00,221][123090] Updated weights for policy 1, policy_version 1321440 (0.0010) [2023-12-26 10:13:00,733][123091] Updated weights for policy 0, policy_version 1330774 (0.0009) [2023-12-26 10:13:00,786][123091] Updated weights for policy 0, policy_version 1330785 (0.0010) [2023-12-26 10:13:00,843][123091] Updated weights for policy 0, policy_version 1330795 (0.0010) [2023-12-26 10:13:00,916][123090] Updated weights for policy 1, policy_version 1321450 (0.0009) [2023-12-26 10:13:00,964][123090] Updated weights for policy 1, policy_version 1321461 (0.0009) [2023-12-26 10:13:01,018][123090] Updated weights for policy 1, policy_version 1321472 (0.0009) [2023-12-26 10:13:01,675][123091] Updated weights for policy 0, policy_version 1330805 (0.0010) [2023-12-26 10:13:01,725][123091] Updated weights for policy 0, policy_version 1330815 (0.0010) [2023-12-26 10:13:01,785][123091] Updated weights for policy 0, policy_version 1330825 (0.0010) [2023-12-26 10:13:01,950][123090] Updated weights for policy 1, policy_version 1321482 (0.0010) [2023-12-26 10:13:02,010][123090] Updated weights for policy 1, policy_version 1321492 (0.0010) [2023-12-26 10:13:02,068][123090] Updated weights for policy 1, policy_version 1321502 (0.0010) [2023-12-26 10:13:02,479][123091] Updated weights for policy 0, policy_version 1330835 (0.0010) [2023-12-26 10:13:02,554][123091] Updated weights for policy 0, policy_version 1330845 (0.0010) [2023-12-26 10:13:02,619][123091] Updated weights for policy 0, policy_version 1330855 (0.0009) [2023-12-26 10:13:02,926][123090] Updated weights for policy 1, policy_version 1321512 (0.0006) [2023-12-26 10:13:02,994][123090] Updated weights for policy 1, policy_version 1321523 (0.0010) [2023-12-26 10:13:03,053][123090] Updated weights for policy 1, policy_version 1321533 (0.0009) [2023-12-26 10:13:03,353][123091] Updated weights for policy 0, policy_version 1330865 (0.0006) [2023-12-26 10:13:03,414][123091] Updated weights for policy 0, policy_version 1330875 (0.0005) [2023-12-26 10:13:03,464][123091] Updated weights for policy 0, policy_version 1330885 (0.0009) [2023-12-26 10:13:03,514][123091] Updated weights for policy 0, policy_version 1330895 (0.0008) [2023-12-26 10:13:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 679026688. Throughput: 0: 8780.0, 1: 8884.0. Samples: 679039280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:13:03,785][121949] Avg episode reward: [(0, '6258.770'), (1, '5521.663')] [2023-12-26 10:13:03,917][123090] Updated weights for policy 1, policy_version 1321543 (0.0010) [2023-12-26 10:13:03,976][123090] Updated weights for policy 1, policy_version 1321553 (0.0010) [2023-12-26 10:13:04,031][123090] Updated weights for policy 1, policy_version 1321563 (0.0010) [2023-12-26 10:13:04,181][123091] Updated weights for policy 0, policy_version 1330905 (0.0009) [2023-12-26 10:13:04,243][123091] Updated weights for policy 0, policy_version 1330915 (0.0008) [2023-12-26 10:13:04,299][123091] Updated weights for policy 0, policy_version 1330925 (0.0005) [2023-12-26 10:13:04,920][123090] Updated weights for policy 1, policy_version 1321573 (0.0008) [2023-12-26 10:13:04,968][123090] Updated weights for policy 1, policy_version 1321583 (0.0009) [2023-12-26 10:13:05,018][123090] Updated weights for policy 1, policy_version 1321593 (0.0009) [2023-12-26 10:13:05,025][123091] Updated weights for policy 0, policy_version 1330935 (0.0008) [2023-12-26 10:13:05,074][123091] Updated weights for policy 0, policy_version 1330945 (0.0008) [2023-12-26 10:13:05,124][123091] Updated weights for policy 0, policy_version 1330955 (0.0009) [2023-12-26 10:13:05,720][123090] Updated weights for policy 1, policy_version 1321603 (0.0007) [2023-12-26 10:13:05,773][123090] Updated weights for policy 1, policy_version 1321613 (0.0005) [2023-12-26 10:13:05,827][123090] Updated weights for policy 1, policy_version 1321623 (0.0009) [2023-12-26 10:13:05,907][123091] Updated weights for policy 0, policy_version 1330965 (0.0009) [2023-12-26 10:13:05,966][123091] Updated weights for policy 0, policy_version 1330975 (0.0009) [2023-12-26 10:13:06,013][123091] Updated weights for policy 0, policy_version 1330985 (0.0009) [2023-12-26 10:13:06,595][123090] Updated weights for policy 1, policy_version 1321633 (0.0010) [2023-12-26 10:13:06,662][123090] Updated weights for policy 1, policy_version 1321643 (0.0011) [2023-12-26 10:13:06,722][123090] Updated weights for policy 1, policy_version 1321653 (0.0010) [2023-12-26 10:13:06,788][123090] Updated weights for policy 1, policy_version 1321663 (0.0010) [2023-12-26 10:13:06,898][123091] Updated weights for policy 0, policy_version 1330995 (0.0009) [2023-12-26 10:13:06,946][123091] Updated weights for policy 0, policy_version 1331005 (0.0009) [2023-12-26 10:13:06,998][123091] Updated weights for policy 0, policy_version 1331015 (0.0009) [2023-12-26 10:13:07,603][123090] Updated weights for policy 1, policy_version 1321673 (0.0011) [2023-12-26 10:13:07,669][123090] Updated weights for policy 1, policy_version 1321683 (0.0010) [2023-12-26 10:13:07,724][123090] Updated weights for policy 1, policy_version 1321693 (0.0010) [2023-12-26 10:13:07,836][123091] Updated weights for policy 0, policy_version 1331025 (0.0009) [2023-12-26 10:13:07,902][123091] Updated weights for policy 0, policy_version 1331035 (0.0009) [2023-12-26 10:13:07,966][123091] Updated weights for policy 0, policy_version 1331045 (0.0008) [2023-12-26 10:13:08,030][123091] Updated weights for policy 0, policy_version 1331055 (0.0008) [2023-12-26 10:13:08,573][123090] Updated weights for policy 1, policy_version 1321703 (0.0009) [2023-12-26 10:13:08,646][123090] Updated weights for policy 1, policy_version 1321713 (0.0010) [2023-12-26 10:13:08,710][123090] Updated weights for policy 1, policy_version 1321723 (0.0009) [2023-12-26 10:13:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 679116800. Throughput: 0: 8856.9, 1: 8900.4. Samples: 679094192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:13:08,785][121949] Avg episode reward: [(0, '6312.839'), (1, '5606.288')] [2023-12-26 10:13:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001321728_338362368.pth... [2023-12-26 10:13:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001331056_340754432.pth... [2023-12-26 10:13:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001330032_340492288.pth [2023-12-26 10:13:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001320704_338100224.pth [2023-12-26 10:13:08,873][123091] Updated weights for policy 0, policy_version 1331065 (0.0010) [2023-12-26 10:13:08,932][123091] Updated weights for policy 0, policy_version 1331075 (0.0010) [2023-12-26 10:13:08,992][123091] Updated weights for policy 0, policy_version 1331085 (0.0009) [2023-12-26 10:13:09,574][123090] Updated weights for policy 1, policy_version 1321733 (0.0010) [2023-12-26 10:13:09,641][123090] Updated weights for policy 1, policy_version 1321743 (0.0009) [2023-12-26 10:13:09,709][123090] Updated weights for policy 1, policy_version 1321753 (0.0010) [2023-12-26 10:13:09,844][123091] Updated weights for policy 0, policy_version 1331096 (0.0011) [2023-12-26 10:13:09,914][123091] Updated weights for policy 0, policy_version 1331106 (0.0010) [2023-12-26 10:13:09,981][123091] Updated weights for policy 0, policy_version 1331116 (0.0009) [2023-12-26 10:13:10,496][123090] Updated weights for policy 1, policy_version 1321763 (0.0010) [2023-12-26 10:13:10,546][123090] Updated weights for policy 1, policy_version 1321773 (0.0008) [2023-12-26 10:13:10,605][123090] Updated weights for policy 1, policy_version 1321783 (0.0009) [2023-12-26 10:13:10,812][123091] Updated weights for policy 0, policy_version 1331126 (0.0010) [2023-12-26 10:13:10,867][123091] Updated weights for policy 0, policy_version 1331136 (0.0006) [2023-12-26 10:13:10,930][123091] Updated weights for policy 0, policy_version 1331146 (0.0005) [2023-12-26 10:13:11,490][123090] Updated weights for policy 1, policy_version 1321793 (0.0008) [2023-12-26 10:13:11,560][123090] Updated weights for policy 1, policy_version 1321803 (0.0005) [2023-12-26 10:13:11,636][123090] Updated weights for policy 1, policy_version 1321813 (0.0009) [2023-12-26 10:13:11,706][123090] Updated weights for policy 1, policy_version 1321823 (0.0009) [2023-12-26 10:13:11,706][123091] Updated weights for policy 0, policy_version 1331156 (0.0006) [2023-12-26 10:13:11,772][123091] Updated weights for policy 0, policy_version 1331166 (0.0010) [2023-12-26 10:13:11,839][123091] Updated weights for policy 0, policy_version 1331176 (0.0011) [2023-12-26 10:13:12,508][123090] Updated weights for policy 1, policy_version 1321833 (0.0009) [2023-12-26 10:13:12,579][123090] Updated weights for policy 1, policy_version 1321843 (0.0006) [2023-12-26 10:13:12,636][123091] Updated weights for policy 0, policy_version 1331186 (0.0009) [2023-12-26 10:13:12,643][123090] Updated weights for policy 1, policy_version 1321853 (0.0007) [2023-12-26 10:13:12,684][123091] Updated weights for policy 0, policy_version 1331196 (0.0005) [2023-12-26 10:13:12,735][123091] Updated weights for policy 0, policy_version 1331206 (0.0005) [2023-12-26 10:13:12,784][123091] Updated weights for policy 0, policy_version 1331216 (0.0006) [2023-12-26 10:13:13,405][123090] Updated weights for policy 1, policy_version 1321863 (0.0007) [2023-12-26 10:13:13,467][123090] Updated weights for policy 1, policy_version 1321873 (0.0007) [2023-12-26 10:13:13,497][123091] Updated weights for policy 0, policy_version 1331226 (0.0006) [2023-12-26 10:13:13,534][123090] Updated weights for policy 1, policy_version 1321883 (0.0010) [2023-12-26 10:13:13,554][123091] Updated weights for policy 0, policy_version 1331236 (0.0005) [2023-12-26 10:13:13,618][123091] Updated weights for policy 0, policy_version 1331246 (0.0005) [2023-12-26 10:13:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 679206912. Throughput: 0: 8847.4, 1: 8834.7. Samples: 679196000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:13:13,785][121949] Avg episode reward: [(0, '6320.878'), (1, '5574.960')] [2023-12-26 10:13:14,372][123090] Updated weights for policy 1, policy_version 1321893 (0.0008) [2023-12-26 10:13:14,379][123091] Updated weights for policy 0, policy_version 1331256 (0.0009) [2023-12-26 10:13:14,427][123090] Updated weights for policy 1, policy_version 1321903 (0.0008) [2023-12-26 10:13:14,431][123091] Updated weights for policy 0, policy_version 1331266 (0.0006) [2023-12-26 10:13:14,489][123091] Updated weights for policy 0, policy_version 1331276 (0.0005) [2023-12-26 10:13:14,493][123090] Updated weights for policy 1, policy_version 1321913 (0.0010) [2023-12-26 10:13:15,284][123091] Updated weights for policy 0, policy_version 1331286 (0.0009) [2023-12-26 10:13:15,347][123090] Updated weights for policy 1, policy_version 1321923 (0.0010) [2023-12-26 10:13:15,354][123091] Updated weights for policy 0, policy_version 1331296 (0.0009) [2023-12-26 10:13:15,405][123090] Updated weights for policy 1, policy_version 1321933 (0.0008) [2023-12-26 10:13:15,419][123091] Updated weights for policy 0, policy_version 1331306 (0.0008) [2023-12-26 10:13:15,466][123090] Updated weights for policy 1, policy_version 1321943 (0.0008) [2023-12-26 10:13:16,228][123091] Updated weights for policy 0, policy_version 1331316 (0.0008) [2023-12-26 10:13:16,235][123090] Updated weights for policy 1, policy_version 1321953 (0.0009) [2023-12-26 10:13:16,275][123091] Updated weights for policy 0, policy_version 1331326 (0.0009) [2023-12-26 10:13:16,291][123090] Updated weights for policy 1, policy_version 1321963 (0.0008) [2023-12-26 10:13:16,320][123091] Updated weights for policy 0, policy_version 1331336 (0.0006) [2023-12-26 10:13:16,341][123090] Updated weights for policy 1, policy_version 1321973 (0.0006) [2023-12-26 10:13:16,396][123090] Updated weights for policy 1, policy_version 1321983 (0.0005) [2023-12-26 10:13:17,003][123090] Updated weights for policy 1, policy_version 1321993 (0.0005) [2023-12-26 10:13:17,027][123091] Updated weights for policy 0, policy_version 1331346 (0.0005) [2023-12-26 10:13:17,057][123090] Updated weights for policy 1, policy_version 1322003 (0.0005) [2023-12-26 10:13:17,086][123091] Updated weights for policy 0, policy_version 1331356 (0.0005) [2023-12-26 10:13:17,108][123090] Updated weights for policy 1, policy_version 1322013 (0.0006) [2023-12-26 10:13:17,153][123091] Updated weights for policy 0, policy_version 1331366 (0.0006) [2023-12-26 10:13:17,215][123091] Updated weights for policy 0, policy_version 1331376 (0.0005) [2023-12-26 10:13:17,799][123090] Updated weights for policy 1, policy_version 1322023 (0.0006) [2023-12-26 10:13:17,839][123091] Updated weights for policy 0, policy_version 1331386 (0.0005) [2023-12-26 10:13:17,855][123090] Updated weights for policy 1, policy_version 1322033 (0.0008) [2023-12-26 10:13:17,893][123091] Updated weights for policy 0, policy_version 1331396 (0.0005) [2023-12-26 10:13:17,908][123090] Updated weights for policy 1, policy_version 1322043 (0.0009) [2023-12-26 10:13:17,948][123091] Updated weights for policy 0, policy_version 1331406 (0.0005) [2023-12-26 10:13:18,622][123091] Updated weights for policy 0, policy_version 1331416 (0.0007) [2023-12-26 10:13:18,694][123091] Updated weights for policy 0, policy_version 1331426 (0.0005) [2023-12-26 10:13:18,757][123091] Updated weights for policy 0, policy_version 1331436 (0.0010) [2023-12-26 10:13:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 679297024. Throughput: 0: 8989.6, 1: 8843.1. Samples: 679308076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 10:13:18,784][121949] Avg episode reward: [(0, '6185.850'), (1, '5418.143')] [2023-12-26 10:13:18,786][123090] Updated weights for policy 1, policy_version 1322053 (0.0008) [2023-12-26 10:13:18,860][123090] Updated weights for policy 1, policy_version 1322063 (0.0009) [2023-12-26 10:13:18,922][123090] Updated weights for policy 1, policy_version 1322073 (0.0009) [2023-12-26 10:13:19,624][123091] Updated weights for policy 0, policy_version 1331446 (0.0010) [2023-12-26 10:13:19,680][123091] Updated weights for policy 0, policy_version 1331457 (0.0010) [2023-12-26 10:13:19,729][123091] Updated weights for policy 0, policy_version 1331467 (0.0009) [2023-12-26 10:13:19,755][123090] Updated weights for policy 1, policy_version 1322083 (0.0010) [2023-12-26 10:13:19,808][123090] Updated weights for policy 1, policy_version 1322093 (0.0009) [2023-12-26 10:13:19,869][123090] Updated weights for policy 1, policy_version 1322103 (0.0010) [2023-12-26 10:13:20,569][123091] Updated weights for policy 0, policy_version 1331477 (0.0007) [2023-12-26 10:13:20,638][123091] Updated weights for policy 0, policy_version 1331487 (0.0009) [2023-12-26 10:13:20,711][123091] Updated weights for policy 0, policy_version 1331497 (0.0009) [2023-12-26 10:13:20,746][123090] Updated weights for policy 1, policy_version 1322113 (0.0010) [2023-12-26 10:13:20,811][123090] Updated weights for policy 1, policy_version 1322123 (0.0008) [2023-12-26 10:13:20,880][123090] Updated weights for policy 1, policy_version 1322133 (0.0008) [2023-12-26 10:13:20,937][123090] Updated weights for policy 1, policy_version 1322143 (0.0010) [2023-12-26 10:13:21,590][123091] Updated weights for policy 0, policy_version 1331507 (0.0010) [2023-12-26 10:13:21,655][123091] Updated weights for policy 0, policy_version 1331517 (0.0009) [2023-12-26 10:13:21,714][123091] Updated weights for policy 0, policy_version 1331527 (0.0007) [2023-12-26 10:13:21,769][123090] Updated weights for policy 1, policy_version 1322153 (0.0009) [2023-12-26 10:13:21,833][123090] Updated weights for policy 1, policy_version 1322163 (0.0010) [2023-12-26 10:13:21,897][123090] Updated weights for policy 1, policy_version 1322173 (0.0009) [2023-12-26 10:13:22,551][123091] Updated weights for policy 0, policy_version 1331537 (0.0008) [2023-12-26 10:13:22,608][123091] Updated weights for policy 0, policy_version 1331547 (0.0009) [2023-12-26 10:13:22,668][123091] Updated weights for policy 0, policy_version 1331557 (0.0008) [2023-12-26 10:13:22,683][123090] Updated weights for policy 1, policy_version 1322183 (0.0010) [2023-12-26 10:13:22,729][123091] Updated weights for policy 0, policy_version 1331567 (0.0006) [2023-12-26 10:13:22,749][123090] Updated weights for policy 1, policy_version 1322193 (0.0010) [2023-12-26 10:13:22,815][123090] Updated weights for policy 1, policy_version 1322203 (0.0010) [2023-12-26 10:13:23,371][123091] Updated weights for policy 0, policy_version 1331577 (0.0009) [2023-12-26 10:13:23,433][123091] Updated weights for policy 0, policy_version 1331588 (0.0009) [2023-12-26 10:13:23,497][123091] Updated weights for policy 0, policy_version 1331598 (0.0009) [2023-12-26 10:13:23,700][123090] Updated weights for policy 1, policy_version 1322213 (0.0009) [2023-12-26 10:13:23,754][123090] Updated weights for policy 1, policy_version 1322223 (0.0010) [2023-12-26 10:13:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 679378944. Throughput: 0: 8897.1, 1: 8780.4. Samples: 679358032. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:23,785][121949] Avg episode reward: [(0, '6146.894'), (1, '5500.926')] [2023-12-26 10:13:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001331600_340893696.pth... [2023-12-26 10:13:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001330544_340623360.pth [2023-12-26 10:13:23,808][123090] Updated weights for policy 1, policy_version 1322233 (0.0010) [2023-12-26 10:13:23,838][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001322240_338493440.pth... [2023-12-26 10:13:23,843][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001321216_338231296.pth [2023-12-26 10:13:24,237][123091] Updated weights for policy 0, policy_version 1331608 (0.0009) [2023-12-26 10:13:24,286][123091] Updated weights for policy 0, policy_version 1331618 (0.0009) [2023-12-26 10:13:24,350][123091] Updated weights for policy 0, policy_version 1331628 (0.0008) [2023-12-26 10:13:24,649][123090] Updated weights for policy 1, policy_version 1322244 (0.0008) [2023-12-26 10:13:24,711][123090] Updated weights for policy 1, policy_version 1322254 (0.0005) [2023-12-26 10:13:24,774][123090] Updated weights for policy 1, policy_version 1322264 (0.0008) [2023-12-26 10:13:25,134][123091] Updated weights for policy 0, policy_version 1331638 (0.0007) [2023-12-26 10:13:25,194][123091] Updated weights for policy 0, policy_version 1331648 (0.0005) [2023-12-26 10:13:25,253][123091] Updated weights for policy 0, policy_version 1331658 (0.0009) [2023-12-26 10:13:25,418][123090] Updated weights for policy 1, policy_version 1322274 (0.0009) [2023-12-26 10:13:25,489][123090] Updated weights for policy 1, policy_version 1322284 (0.0005) [2023-12-26 10:13:25,561][123090] Updated weights for policy 1, policy_version 1322294 (0.0005) [2023-12-26 10:13:25,636][123090] Updated weights for policy 1, policy_version 1322304 (0.0005) [2023-12-26 10:13:26,061][123091] Updated weights for policy 0, policy_version 1331668 (0.0008) [2023-12-26 10:13:26,118][123091] Updated weights for policy 0, policy_version 1331678 (0.0006) [2023-12-26 10:13:26,177][123091] Updated weights for policy 0, policy_version 1331688 (0.0009) [2023-12-26 10:13:26,350][123090] Updated weights for policy 1, policy_version 1322314 (0.0010) [2023-12-26 10:13:26,416][123090] Updated weights for policy 1, policy_version 1322324 (0.0010) [2023-12-26 10:13:26,479][123090] Updated weights for policy 1, policy_version 1322334 (0.0010) [2023-12-26 10:13:27,037][123091] Updated weights for policy 0, policy_version 1331698 (0.0009) [2023-12-26 10:13:27,096][123091] Updated weights for policy 0, policy_version 1331710 (0.0011) [2023-12-26 10:13:27,148][123091] Updated weights for policy 0, policy_version 1331720 (0.0009) [2023-12-26 10:13:27,178][123090] Updated weights for policy 1, policy_version 1322344 (0.0006) [2023-12-26 10:13:27,245][123090] Updated weights for policy 1, policy_version 1322354 (0.0010) [2023-12-26 10:13:27,300][123090] Updated weights for policy 1, policy_version 1322364 (0.0010) [2023-12-26 10:13:27,966][123091] Updated weights for policy 0, policy_version 1331731 (0.0008) [2023-12-26 10:13:28,016][123091] Updated weights for policy 0, policy_version 1331741 (0.0007) [2023-12-26 10:13:28,049][123090] Updated weights for policy 1, policy_version 1322374 (0.0009) [2023-12-26 10:13:28,071][123091] Updated weights for policy 0, policy_version 1331751 (0.0006) [2023-12-26 10:13:28,110][123090] Updated weights for policy 1, policy_version 1322384 (0.0009) [2023-12-26 10:13:28,173][123090] Updated weights for policy 1, policy_version 1322394 (0.0010) [2023-12-26 10:13:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 679469056. Throughput: 0: 8948.6, 1: 8825.9. Samples: 679465664. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:28,784][121949] Avg episode reward: [(0, '6247.770'), (1, '5478.265')] [2023-12-26 10:13:28,917][123091] Updated weights for policy 0, policy_version 1331761 (0.0005) [2023-12-26 10:13:28,969][123091] Updated weights for policy 0, policy_version 1331771 (0.0008) [2023-12-26 10:13:29,004][123090] Updated weights for policy 1, policy_version 1322404 (0.0010) [2023-12-26 10:13:29,024][123091] Updated weights for policy 0, policy_version 1331781 (0.0007) [2023-12-26 10:13:29,078][123090] Updated weights for policy 1, policy_version 1322414 (0.0010) [2023-12-26 10:13:29,090][123091] Updated weights for policy 0, policy_version 1331791 (0.0008) [2023-12-26 10:13:29,144][123090] Updated weights for policy 1, policy_version 1322424 (0.0011) [2023-12-26 10:13:29,845][123091] Updated weights for policy 0, policy_version 1331801 (0.0007) [2023-12-26 10:13:29,914][123091] Updated weights for policy 0, policy_version 1331811 (0.0008) [2023-12-26 10:13:29,944][123090] Updated weights for policy 1, policy_version 1322434 (0.0009) [2023-12-26 10:13:29,980][123091] Updated weights for policy 0, policy_version 1331821 (0.0009) [2023-12-26 10:13:30,016][123090] Updated weights for policy 1, policy_version 1322444 (0.0006) [2023-12-26 10:13:30,093][123090] Updated weights for policy 1, policy_version 1322454 (0.0010) [2023-12-26 10:13:30,163][123090] Updated weights for policy 1, policy_version 1322464 (0.0010) [2023-12-26 10:13:30,701][123091] Updated weights for policy 0, policy_version 1331831 (0.0009) [2023-12-26 10:13:30,755][123091] Updated weights for policy 0, policy_version 1331842 (0.0010) [2023-12-26 10:13:30,808][123091] Updated weights for policy 0, policy_version 1331853 (0.0007) [2023-12-26 10:13:30,941][123090] Updated weights for policy 1, policy_version 1322474 (0.0009) [2023-12-26 10:13:31,004][123090] Updated weights for policy 1, policy_version 1322484 (0.0008) [2023-12-26 10:13:31,068][123090] Updated weights for policy 1, policy_version 1322494 (0.0009) [2023-12-26 10:13:31,607][123091] Updated weights for policy 0, policy_version 1331863 (0.0006) [2023-12-26 10:13:31,667][123091] Updated weights for policy 0, policy_version 1331873 (0.0007) [2023-12-26 10:13:31,730][123091] Updated weights for policy 0, policy_version 1331883 (0.0007) [2023-12-26 10:13:31,941][123090] Updated weights for policy 1, policy_version 1322504 (0.0008) [2023-12-26 10:13:31,994][123090] Updated weights for policy 1, policy_version 1322514 (0.0009) [2023-12-26 10:13:32,044][123090] Updated weights for policy 1, policy_version 1322524 (0.0009) [2023-12-26 10:13:32,549][123091] Updated weights for policy 0, policy_version 1331893 (0.0008) [2023-12-26 10:13:32,612][123091] Updated weights for policy 0, policy_version 1331903 (0.0011) [2023-12-26 10:13:32,671][123091] Updated weights for policy 0, policy_version 1331913 (0.0010) [2023-12-26 10:13:32,927][123090] Updated weights for policy 1, policy_version 1322534 (0.0009) [2023-12-26 10:13:32,979][123090] Updated weights for policy 1, policy_version 1322544 (0.0009) [2023-12-26 10:13:33,035][123090] Updated weights for policy 1, policy_version 1322555 (0.0009) [2023-12-26 10:13:33,358][123091] Updated weights for policy 0, policy_version 1331923 (0.0007) [2023-12-26 10:13:33,405][123091] Updated weights for policy 0, policy_version 1331933 (0.0005) [2023-12-26 10:13:33,452][123091] Updated weights for policy 0, policy_version 1331943 (0.0005) [2023-12-26 10:13:33,767][123090] Updated weights for policy 1, policy_version 1322565 (0.0005) [2023-12-26 10:13:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 679559168. Throughput: 0: 8976.1, 1: 8710.4. Samples: 679572732. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:33,785][121949] Avg episode reward: [(0, '6351.030'), (1, '5537.976')] [2023-12-26 10:13:33,821][123090] Updated weights for policy 1, policy_version 1322575 (0.0005) [2023-12-26 10:13:33,877][123090] Updated weights for policy 1, policy_version 1322585 (0.0009) [2023-12-26 10:13:34,223][123091] Updated weights for policy 0, policy_version 1331953 (0.0008) [2023-12-26 10:13:34,293][123091] Updated weights for policy 0, policy_version 1331963 (0.0009) [2023-12-26 10:13:34,360][123091] Updated weights for policy 0, policy_version 1331973 (0.0008) [2023-12-26 10:13:34,435][123091] Updated weights for policy 0, policy_version 1331983 (0.0008) [2023-12-26 10:13:34,750][123090] Updated weights for policy 1, policy_version 1322596 (0.0010) [2023-12-26 10:13:34,806][123090] Updated weights for policy 1, policy_version 1322606 (0.0009) [2023-12-26 10:13:34,865][123090] Updated weights for policy 1, policy_version 1322616 (0.0009) [2023-12-26 10:13:35,098][123091] Updated weights for policy 0, policy_version 1331993 (0.0008) [2023-12-26 10:13:35,159][123091] Updated weights for policy 0, policy_version 1332003 (0.0008) [2023-12-26 10:13:35,228][123091] Updated weights for policy 0, policy_version 1332013 (0.0009) [2023-12-26 10:13:35,761][123090] Updated weights for policy 1, policy_version 1322626 (0.0009) [2023-12-26 10:13:35,810][123090] Updated weights for policy 1, policy_version 1322636 (0.0009) [2023-12-26 10:13:35,869][123090] Updated weights for policy 1, policy_version 1322646 (0.0008) [2023-12-26 10:13:35,927][123090] Updated weights for policy 1, policy_version 1322656 (0.0008) [2023-12-26 10:13:35,954][123091] Updated weights for policy 0, policy_version 1332023 (0.0010) [2023-12-26 10:13:36,005][123091] Updated weights for policy 0, policy_version 1332033 (0.0010) [2023-12-26 10:13:36,056][123091] Updated weights for policy 0, policy_version 1332043 (0.0010) [2023-12-26 10:13:36,789][123090] Updated weights for policy 1, policy_version 1322666 (0.0009) [2023-12-26 10:13:36,862][123090] Updated weights for policy 1, policy_version 1322676 (0.0009) [2023-12-26 10:13:36,920][123091] Updated weights for policy 0, policy_version 1332053 (0.0010) [2023-12-26 10:13:36,931][123090] Updated weights for policy 1, policy_version 1322686 (0.0006) [2023-12-26 10:13:36,983][123091] Updated weights for policy 0, policy_version 1332063 (0.0011) [2023-12-26 10:13:37,050][123091] Updated weights for policy 0, policy_version 1332073 (0.0011) [2023-12-26 10:13:37,703][123090] Updated weights for policy 1, policy_version 1322696 (0.0010) [2023-12-26 10:13:37,767][123090] Updated weights for policy 1, policy_version 1322706 (0.0010) [2023-12-26 10:13:37,820][123090] Updated weights for policy 1, policy_version 1322716 (0.0010) [2023-12-26 10:13:37,832][123091] Updated weights for policy 0, policy_version 1332083 (0.0009) [2023-12-26 10:13:37,896][123091] Updated weights for policy 0, policy_version 1332093 (0.0006) [2023-12-26 10:13:37,956][123091] Updated weights for policy 0, policy_version 1332103 (0.0010) [2023-12-26 10:13:38,660][123090] Updated weights for policy 1, policy_version 1322726 (0.0010) [2023-12-26 10:13:38,731][123090] Updated weights for policy 1, policy_version 1322736 (0.0010) [2023-12-26 10:13:38,754][123091] Updated weights for policy 0, policy_version 1332113 (0.0010) [2023-12-26 10:13:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 679641088. Throughput: 0: 9006.9, 1: 8671.0. Samples: 679625464. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:38,785][121949] Avg episode reward: [(0, '6375.189'), (1, '5428.549')] [2023-12-26 10:13:38,798][123090] Updated weights for policy 1, policy_version 1322746 (0.0009) [2023-12-26 10:13:38,811][123091] Updated weights for policy 0, policy_version 1332123 (0.0008) [2023-12-26 10:13:38,832][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001322752_338624512.pth... [2023-12-26 10:13:38,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001321728_338362368.pth [2023-12-26 10:13:38,866][123091] Updated weights for policy 0, policy_version 1332133 (0.0006) [2023-12-26 10:13:38,926][123091] Updated weights for policy 0, policy_version 1332143 (0.0005) [2023-12-26 10:13:38,932][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001332144_341032960.pth... [2023-12-26 10:13:38,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001331056_340754432.pth [2023-12-26 10:13:39,610][123090] Updated weights for policy 1, policy_version 1322756 (0.0010) [2023-12-26 10:13:39,673][123090] Updated weights for policy 1, policy_version 1322766 (0.0010) [2023-12-26 10:13:39,714][123091] Updated weights for policy 0, policy_version 1332153 (0.0006) [2023-12-26 10:13:39,740][123090] Updated weights for policy 1, policy_version 1322776 (0.0009) [2023-12-26 10:13:39,781][123091] Updated weights for policy 0, policy_version 1332163 (0.0008) [2023-12-26 10:13:39,855][123091] Updated weights for policy 0, policy_version 1332173 (0.0010) [2023-12-26 10:13:40,618][123090] Updated weights for policy 1, policy_version 1322786 (0.0007) [2023-12-26 10:13:40,691][123090] Updated weights for policy 1, policy_version 1322796 (0.0005) [2023-12-26 10:13:40,694][123091] Updated weights for policy 0, policy_version 1332183 (0.0009) [2023-12-26 10:13:40,752][123091] Updated weights for policy 0, policy_version 1332193 (0.0009) [2023-12-26 10:13:40,761][123090] Updated weights for policy 1, policy_version 1322806 (0.0005) [2023-12-26 10:13:40,812][123090] Updated weights for policy 1, policy_version 1322816 (0.0007) [2023-12-26 10:13:40,821][123091] Updated weights for policy 0, policy_version 1332203 (0.0009) [2023-12-26 10:13:41,572][123090] Updated weights for policy 1, policy_version 1322826 (0.0009) [2023-12-26 10:13:41,641][123090] Updated weights for policy 1, policy_version 1322836 (0.0009) [2023-12-26 10:13:41,715][123091] Updated weights for policy 0, policy_version 1332213 (0.0008) [2023-12-26 10:13:41,715][123090] Updated weights for policy 1, policy_version 1322846 (0.0010) [2023-12-26 10:13:41,788][123091] Updated weights for policy 0, policy_version 1332223 (0.0009) [2023-12-26 10:13:41,847][123091] Updated weights for policy 0, policy_version 1332233 (0.0010) [2023-12-26 10:13:42,413][123090] Updated weights for policy 1, policy_version 1322856 (0.0008) [2023-12-26 10:13:42,476][123090] Updated weights for policy 1, policy_version 1322866 (0.0009) [2023-12-26 10:13:42,544][123090] Updated weights for policy 1, policy_version 1322876 (0.0009) [2023-12-26 10:13:42,712][123091] Updated weights for policy 0, policy_version 1332243 (0.0010) [2023-12-26 10:13:42,763][123091] Updated weights for policy 0, policy_version 1332253 (0.0009) [2023-12-26 10:13:42,820][123091] Updated weights for policy 0, policy_version 1332263 (0.0006) [2023-12-26 10:13:43,422][123090] Updated weights for policy 1, policy_version 1322886 (0.0010) [2023-12-26 10:13:43,472][123090] Updated weights for policy 1, policy_version 1322896 (0.0009) [2023-12-26 10:13:43,500][123091] Updated weights for policy 0, policy_version 1332273 (0.0005) [2023-12-26 10:13:43,525][123090] Updated weights for policy 1, policy_version 1322907 (0.0011) [2023-12-26 10:13:43,561][123091] Updated weights for policy 0, policy_version 1332283 (0.0005) [2023-12-26 10:13:43,623][123091] Updated weights for policy 0, policy_version 1332293 (0.0005) [2023-12-26 10:13:43,695][123091] Updated weights for policy 0, policy_version 1332303 (0.0007) [2023-12-26 10:13:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 679739392. Throughput: 0: 8911.1, 1: 8683.5. Samples: 679727840. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:43,785][121949] Avg episode reward: [(0, '6359.044'), (1, '5320.611')] [2023-12-26 10:13:44,426][123090] Updated weights for policy 1, policy_version 1322917 (0.0007) [2023-12-26 10:13:44,449][123091] Updated weights for policy 0, policy_version 1332313 (0.0006) [2023-12-26 10:13:44,488][123090] Updated weights for policy 1, policy_version 1322927 (0.0006) [2023-12-26 10:13:44,515][123091] Updated weights for policy 0, policy_version 1332323 (0.0006) [2023-12-26 10:13:44,552][123090] Updated weights for policy 1, policy_version 1322937 (0.0005) [2023-12-26 10:13:44,577][123091] Updated weights for policy 0, policy_version 1332333 (0.0007) [2023-12-26 10:13:45,344][123091] Updated weights for policy 0, policy_version 1332343 (0.0009) [2023-12-26 10:13:45,362][123090] Updated weights for policy 1, policy_version 1322947 (0.0008) [2023-12-26 10:13:45,397][123091] Updated weights for policy 0, policy_version 1332353 (0.0009) [2023-12-26 10:13:45,416][123090] Updated weights for policy 1, policy_version 1322957 (0.0009) [2023-12-26 10:13:45,447][123091] Updated weights for policy 0, policy_version 1332363 (0.0009) [2023-12-26 10:13:45,479][123090] Updated weights for policy 1, policy_version 1322967 (0.0006) [2023-12-26 10:13:46,211][123090] Updated weights for policy 1, policy_version 1322977 (0.0005) [2023-12-26 10:13:46,286][123090] Updated weights for policy 1, policy_version 1322987 (0.0005) [2023-12-26 10:13:46,359][123091] Updated weights for policy 0, policy_version 1332373 (0.0008) [2023-12-26 10:13:46,363][123090] Updated weights for policy 1, policy_version 1322997 (0.0005) [2023-12-26 10:13:46,406][123091] Updated weights for policy 0, policy_version 1332383 (0.0008) [2023-12-26 10:13:46,439][123090] Updated weights for policy 1, policy_version 1323007 (0.0005) [2023-12-26 10:13:46,455][123091] Updated weights for policy 0, policy_version 1332393 (0.0009) [2023-12-26 10:13:46,954][123090] Updated weights for policy 1, policy_version 1323017 (0.0005) [2023-12-26 10:13:47,014][123090] Updated weights for policy 1, policy_version 1323027 (0.0005) [2023-12-26 10:13:47,073][123090] Updated weights for policy 1, policy_version 1323037 (0.0006) [2023-12-26 10:13:47,230][123091] Updated weights for policy 0, policy_version 1332403 (0.0008) [2023-12-26 10:13:47,302][123091] Updated weights for policy 0, policy_version 1332413 (0.0005) [2023-12-26 10:13:47,359][123091] Updated weights for policy 0, policy_version 1332423 (0.0008) [2023-12-26 10:13:47,857][123090] Updated weights for policy 1, policy_version 1323047 (0.0007) [2023-12-26 10:13:47,924][123090] Updated weights for policy 1, policy_version 1323057 (0.0009) [2023-12-26 10:13:47,983][123091] Updated weights for policy 0, policy_version 1332433 (0.0008) [2023-12-26 10:13:47,990][123090] Updated weights for policy 1, policy_version 1323067 (0.0009) [2023-12-26 10:13:48,044][123091] Updated weights for policy 0, policy_version 1332443 (0.0009) [2023-12-26 10:13:48,102][123091] Updated weights for policy 0, policy_version 1332453 (0.0009) [2023-12-26 10:13:48,161][123091] Updated weights for policy 0, policy_version 1332463 (0.0008) [2023-12-26 10:13:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 679821312. Throughput: 0: 8983.2, 1: 8728.2. Samples: 679836288. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:48,785][121949] Avg episode reward: [(0, '6271.732'), (1, '5353.355')] [2023-12-26 10:13:48,841][123090] Updated weights for policy 1, policy_version 1323077 (0.0010) [2023-12-26 10:13:48,905][123090] Updated weights for policy 1, policy_version 1323087 (0.0010) [2023-12-26 10:13:48,960][123090] Updated weights for policy 1, policy_version 1323097 (0.0008) [2023-12-26 10:13:48,966][123091] Updated weights for policy 0, policy_version 1332473 (0.0009) [2023-12-26 10:13:49,025][123091] Updated weights for policy 0, policy_version 1332483 (0.0009) [2023-12-26 10:13:49,089][123091] Updated weights for policy 0, policy_version 1332493 (0.0009) [2023-12-26 10:13:49,840][123091] Updated weights for policy 0, policy_version 1332503 (0.0008) [2023-12-26 10:13:49,855][123090] Updated weights for policy 1, policy_version 1323107 (0.0008) [2023-12-26 10:13:49,910][123091] Updated weights for policy 0, policy_version 1332513 (0.0010) [2023-12-26 10:13:49,921][123090] Updated weights for policy 1, policy_version 1323117 (0.0006) [2023-12-26 10:13:49,979][123091] Updated weights for policy 0, policy_version 1332523 (0.0010) [2023-12-26 10:13:49,991][123090] Updated weights for policy 1, policy_version 1323127 (0.0008) [2023-12-26 10:13:50,673][123090] Updated weights for policy 1, policy_version 1323137 (0.0006) [2023-12-26 10:13:50,736][123090] Updated weights for policy 1, policy_version 1323147 (0.0010) [2023-12-26 10:13:50,786][123091] Updated weights for policy 0, policy_version 1332533 (0.0010) [2023-12-26 10:13:50,797][123090] Updated weights for policy 1, policy_version 1323157 (0.0008) [2023-12-26 10:13:50,850][123091] Updated weights for policy 0, policy_version 1332543 (0.0010) [2023-12-26 10:13:50,858][123090] Updated weights for policy 1, policy_version 1323167 (0.0008) [2023-12-26 10:13:50,914][123091] Updated weights for policy 0, policy_version 1332553 (0.0010) [2023-12-26 10:13:51,631][123090] Updated weights for policy 1, policy_version 1323177 (0.0008) [2023-12-26 10:13:51,694][123090] Updated weights for policy 1, policy_version 1323187 (0.0008) [2023-12-26 10:13:51,760][123090] Updated weights for policy 1, policy_version 1323197 (0.0009) [2023-12-26 10:13:51,782][123091] Updated weights for policy 0, policy_version 1332563 (0.0009) [2023-12-26 10:13:51,848][123091] Updated weights for policy 0, policy_version 1332573 (0.0010) [2023-12-26 10:13:51,922][123091] Updated weights for policy 0, policy_version 1332583 (0.0009) [2023-12-26 10:13:52,548][123090] Updated weights for policy 1, policy_version 1323207 (0.0009) [2023-12-26 10:13:52,615][123090] Updated weights for policy 1, policy_version 1323217 (0.0009) [2023-12-26 10:13:52,680][123090] Updated weights for policy 1, policy_version 1323227 (0.0010) [2023-12-26 10:13:52,731][123091] Updated weights for policy 0, policy_version 1332593 (0.0010) [2023-12-26 10:13:52,791][123091] Updated weights for policy 0, policy_version 1332603 (0.0010) [2023-12-26 10:13:52,847][123091] Updated weights for policy 0, policy_version 1332613 (0.0009) [2023-12-26 10:13:52,896][123091] Updated weights for policy 0, policy_version 1332623 (0.0009) [2023-12-26 10:13:53,532][123090] Updated weights for policy 1, policy_version 1323237 (0.0010) [2023-12-26 10:13:53,595][123090] Updated weights for policy 1, policy_version 1323247 (0.0010) [2023-12-26 10:13:53,663][123090] Updated weights for policy 1, policy_version 1323257 (0.0008) [2023-12-26 10:13:53,664][123091] Updated weights for policy 0, policy_version 1332633 (0.0008) [2023-12-26 10:13:53,717][123091] Updated weights for policy 0, policy_version 1332643 (0.0008) [2023-12-26 10:13:53,777][123091] Updated weights for policy 0, policy_version 1332653 (0.0005) [2023-12-26 10:13:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 679911424. Throughput: 0: 8932.9, 1: 8707.5. Samples: 679888008. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:53,785][121949] Avg episode reward: [(0, '6309.587'), (1, '5466.815')] [2023-12-26 10:13:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001323264_338755584.pth... [2023-12-26 10:13:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001322240_338493440.pth [2023-12-26 10:13:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001332656_341164032.pth... [2023-12-26 10:13:53,795][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001323264_338755584.pth [2023-12-26 10:13:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001331600_340893696.pth [2023-12-26 10:13:53,798][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001332656_341164032.pth [2023-12-26 10:13:54,465][123091] Updated weights for policy 0, policy_version 1332663 (0.0007) [2023-12-26 10:13:54,528][123091] Updated weights for policy 0, policy_version 1332673 (0.0005) [2023-12-26 10:13:54,554][123090] Updated weights for policy 1, policy_version 1323267 (0.0008) [2023-12-26 10:13:54,587][123091] Updated weights for policy 0, policy_version 1332683 (0.0009) [2023-12-26 10:13:54,616][123090] Updated weights for policy 1, policy_version 1323277 (0.0007) [2023-12-26 10:13:54,691][123090] Updated weights for policy 1, policy_version 1323287 (0.0009) [2023-12-26 10:13:55,365][123091] Updated weights for policy 0, policy_version 1332693 (0.0008) [2023-12-26 10:13:55,415][123091] Updated weights for policy 0, policy_version 1332703 (0.0009) [2023-12-26 10:13:55,462][123091] Updated weights for policy 0, policy_version 1332713 (0.0008) [2023-12-26 10:13:55,491][123090] Updated weights for policy 1, policy_version 1323297 (0.0010) [2023-12-26 10:13:55,546][123090] Updated weights for policy 1, policy_version 1323307 (0.0008) [2023-12-26 10:13:55,599][123090] Updated weights for policy 1, policy_version 1323317 (0.0008) [2023-12-26 10:13:55,655][123090] Updated weights for policy 1, policy_version 1323327 (0.0009) [2023-12-26 10:13:56,268][123091] Updated weights for policy 0, policy_version 1332723 (0.0009) [2023-12-26 10:13:56,344][123091] Updated weights for policy 0, policy_version 1332733 (0.0005) [2023-12-26 10:13:56,413][123091] Updated weights for policy 0, policy_version 1332743 (0.0006) [2023-12-26 10:13:56,554][123090] Updated weights for policy 1, policy_version 1323338 (0.0010) [2023-12-26 10:13:56,606][123090] Updated weights for policy 1, policy_version 1323349 (0.0009) [2023-12-26 10:13:56,657][123090] Updated weights for policy 1, policy_version 1323359 (0.0009) [2023-12-26 10:13:57,061][123091] Updated weights for policy 0, policy_version 1332753 (0.0005) [2023-12-26 10:13:57,113][123091] Updated weights for policy 0, policy_version 1332763 (0.0009) [2023-12-26 10:13:57,163][123091] Updated weights for policy 0, policy_version 1332773 (0.0009) [2023-12-26 10:13:57,220][123091] Updated weights for policy 0, policy_version 1332784 (0.0009) [2023-12-26 10:13:57,540][123090] Updated weights for policy 1, policy_version 1323369 (0.0009) [2023-12-26 10:13:57,598][123090] Updated weights for policy 1, policy_version 1323379 (0.0010) [2023-12-26 10:13:57,657][123090] Updated weights for policy 1, policy_version 1323389 (0.0009) [2023-12-26 10:13:57,885][123091] Updated weights for policy 0, policy_version 1332794 (0.0005) [2023-12-26 10:13:57,944][123091] Updated weights for policy 0, policy_version 1332804 (0.0005) [2023-12-26 10:13:58,011][123091] Updated weights for policy 0, policy_version 1332814 (0.0006) [2023-12-26 10:13:58,532][123090] Updated weights for policy 1, policy_version 1323399 (0.0009) [2023-12-26 10:13:58,602][123090] Updated weights for policy 1, policy_version 1323409 (0.0008) [2023-12-26 10:13:58,689][123090] Updated weights for policy 1, policy_version 1323419 (0.0009) [2023-12-26 10:13:58,745][123091] Updated weights for policy 0, policy_version 1332824 (0.0008) [2023-12-26 10:13:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 680001536. Throughput: 0: 9053.9, 1: 8687.0. Samples: 679994344. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:13:58,785][121949] Avg episode reward: [(0, '6243.196'), (1, '5560.481')] [2023-12-26 10:13:58,818][123091] Updated weights for policy 0, policy_version 1332834 (0.0008) [2023-12-26 10:13:58,887][123091] Updated weights for policy 0, policy_version 1332844 (0.0008) [2023-12-26 10:13:59,535][123090] Updated weights for policy 1, policy_version 1323429 (0.0010) [2023-12-26 10:13:59,595][123090] Updated weights for policy 1, policy_version 1323439 (0.0008) [2023-12-26 10:13:59,647][123090] Updated weights for policy 1, policy_version 1323449 (0.0009) [2023-12-26 10:13:59,670][123091] Updated weights for policy 0, policy_version 1332854 (0.0008) [2023-12-26 10:13:59,735][123091] Updated weights for policy 0, policy_version 1332864 (0.0010) [2023-12-26 10:13:59,794][123091] Updated weights for policy 0, policy_version 1332875 (0.0010) [2023-12-26 10:14:00,454][123090] Updated weights for policy 1, policy_version 1323459 (0.0009) [2023-12-26 10:14:00,516][123090] Updated weights for policy 1, policy_version 1323469 (0.0008) [2023-12-26 10:14:00,576][123090] Updated weights for policy 1, policy_version 1323479 (0.0010) [2023-12-26 10:14:00,642][123091] Updated weights for policy 0, policy_version 1332885 (0.0008) [2023-12-26 10:14:00,686][123091] Updated weights for policy 0, policy_version 1332895 (0.0005) [2023-12-26 10:14:00,742][123091] Updated weights for policy 0, policy_version 1332905 (0.0005) [2023-12-26 10:14:01,425][123090] Updated weights for policy 1, policy_version 1323490 (0.0010) [2023-12-26 10:14:01,476][123090] Updated weights for policy 1, policy_version 1323500 (0.0010) [2023-12-26 10:14:01,486][123091] Updated weights for policy 0, policy_version 1332915 (0.0006) [2023-12-26 10:14:01,537][123090] Updated weights for policy 1, policy_version 1323510 (0.0009) [2023-12-26 10:14:01,549][123091] Updated weights for policy 0, policy_version 1332925 (0.0010) [2023-12-26 10:14:01,588][123090] Updated weights for policy 1, policy_version 1323520 (0.0008) [2023-12-26 10:14:01,612][123091] Updated weights for policy 0, policy_version 1332935 (0.0009) [2023-12-26 10:14:02,417][123091] Updated weights for policy 0, policy_version 1332945 (0.0010) [2023-12-26 10:14:02,471][123090] Updated weights for policy 1, policy_version 1323530 (0.0010) [2023-12-26 10:14:02,473][123091] Updated weights for policy 0, policy_version 1332955 (0.0006) [2023-12-26 10:14:02,531][123090] Updated weights for policy 1, policy_version 1323540 (0.0008) [2023-12-26 10:14:02,533][123091] Updated weights for policy 0, policy_version 1332965 (0.0008) [2023-12-26 10:14:02,592][123090] Updated weights for policy 1, policy_version 1323550 (0.0007) [2023-12-26 10:14:02,594][123091] Updated weights for policy 0, policy_version 1332975 (0.0009) [2023-12-26 10:14:03,400][123090] Updated weights for policy 1, policy_version 1323560 (0.0007) [2023-12-26 10:14:03,408][123091] Updated weights for policy 0, policy_version 1332985 (0.0009) [2023-12-26 10:14:03,450][123090] Updated weights for policy 1, policy_version 1323570 (0.0008) [2023-12-26 10:14:03,461][123091] Updated weights for policy 0, policy_version 1332995 (0.0007) [2023-12-26 10:14:03,502][123090] Updated weights for policy 1, policy_version 1323580 (0.0008) [2023-12-26 10:14:03,509][123091] Updated weights for policy 0, policy_version 1333005 (0.0007) [2023-12-26 10:14:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 680091648. Throughput: 0: 8973.0, 1: 8602.6. Samples: 680098980. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:03,785][121949] Avg episode reward: [(0, '6207.892'), (1, '5301.841')] [2023-12-26 10:14:04,360][123091] Updated weights for policy 0, policy_version 1333015 (0.0007) [2023-12-26 10:14:04,376][123090] Updated weights for policy 1, policy_version 1323590 (0.0007) [2023-12-26 10:14:04,425][123091] Updated weights for policy 0, policy_version 1333025 (0.0008) [2023-12-26 10:14:04,437][123090] Updated weights for policy 1, policy_version 1323600 (0.0010) [2023-12-26 10:14:04,486][123091] Updated weights for policy 0, policy_version 1333035 (0.0009) [2023-12-26 10:14:04,492][123090] Updated weights for policy 1, policy_version 1323610 (0.0007) [2023-12-26 10:14:05,268][123091] Updated weights for policy 0, policy_version 1333045 (0.0007) [2023-12-26 10:14:05,325][123091] Updated weights for policy 0, policy_version 1333055 (0.0006) [2023-12-26 10:14:05,364][123090] Updated weights for policy 1, policy_version 1323620 (0.0010) [2023-12-26 10:14:05,382][123091] Updated weights for policy 0, policy_version 1333065 (0.0005) [2023-12-26 10:14:05,419][123090] Updated weights for policy 1, policy_version 1323630 (0.0009) [2023-12-26 10:14:05,474][123090] Updated weights for policy 1, policy_version 1323640 (0.0009) [2023-12-26 10:14:06,180][123091] Updated weights for policy 0, policy_version 1333075 (0.0008) [2023-12-26 10:14:06,248][123091] Updated weights for policy 0, policy_version 1333085 (0.0009) [2023-12-26 10:14:06,278][123090] Updated weights for policy 1, policy_version 1323650 (0.0009) [2023-12-26 10:14:06,303][123091] Updated weights for policy 0, policy_version 1333095 (0.0008) [2023-12-26 10:14:06,338][123090] Updated weights for policy 1, policy_version 1323660 (0.0008) [2023-12-26 10:14:06,394][123090] Updated weights for policy 1, policy_version 1323670 (0.0008) [2023-12-26 10:14:06,450][123090] Updated weights for policy 1, policy_version 1323680 (0.0009) [2023-12-26 10:14:07,143][123091] Updated weights for policy 0, policy_version 1333105 (0.0006) [2023-12-26 10:14:07,196][123091] Updated weights for policy 0, policy_version 1333115 (0.0009) [2023-12-26 10:14:07,247][123091] Updated weights for policy 0, policy_version 1333125 (0.0008) [2023-12-26 10:14:07,286][123090] Updated weights for policy 1, policy_version 1323690 (0.0009) [2023-12-26 10:14:07,311][123091] Updated weights for policy 0, policy_version 1333135 (0.0010) [2023-12-26 10:14:07,338][123090] Updated weights for policy 1, policy_version 1323700 (0.0010) [2023-12-26 10:14:07,395][123090] Updated weights for policy 1, policy_version 1323710 (0.0008) [2023-12-26 10:14:08,063][123091] Updated weights for policy 0, policy_version 1333145 (0.0006) [2023-12-26 10:14:08,128][123091] Updated weights for policy 0, policy_version 1333155 (0.0006) [2023-12-26 10:14:08,204][123091] Updated weights for policy 0, policy_version 1333165 (0.0005) [2023-12-26 10:14:08,232][123090] Updated weights for policy 1, policy_version 1323720 (0.0009) [2023-12-26 10:14:08,290][123090] Updated weights for policy 1, policy_version 1323730 (0.0010) [2023-12-26 10:14:08,352][123090] Updated weights for policy 1, policy_version 1323740 (0.0009) [2023-12-26 10:14:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 680173568. Throughput: 0: 9003.2, 1: 8605.4. Samples: 680150420. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:08,785][121949] Avg episode reward: [(0, '6361.002'), (1, '5346.128')] [2023-12-26 10:14:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001323744_338878464.pth... [2023-12-26 10:14:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001322752_338624512.pth [2023-12-26 10:14:08,833][123091] Updated weights for policy 0, policy_version 1333175 (0.0009) [2023-12-26 10:14:08,893][123091] Updated weights for policy 0, policy_version 1333185 (0.0009) [2023-12-26 10:14:08,949][123091] Updated weights for policy 0, policy_version 1333195 (0.0009) [2023-12-26 10:14:08,973][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001333200_341303296.pth... [2023-12-26 10:14:08,976][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001332144_341032960.pth [2023-12-26 10:14:09,237][123090] Updated weights for policy 1, policy_version 1323750 (0.0009) [2023-12-26 10:14:09,295][123090] Updated weights for policy 1, policy_version 1323760 (0.0009) [2023-12-26 10:14:09,366][123090] Updated weights for policy 1, policy_version 1323770 (0.0009) [2023-12-26 10:14:09,798][123091] Updated weights for policy 0, policy_version 1333205 (0.0010) [2023-12-26 10:14:09,869][123091] Updated weights for policy 0, policy_version 1333215 (0.0009) [2023-12-26 10:14:09,937][123091] Updated weights for policy 0, policy_version 1333225 (0.0010) [2023-12-26 10:14:10,169][123090] Updated weights for policy 1, policy_version 1323780 (0.0010) [2023-12-26 10:14:10,244][123090] Updated weights for policy 1, policy_version 1323790 (0.0009) [2023-12-26 10:14:10,316][123090] Updated weights for policy 1, policy_version 1323800 (0.0010) [2023-12-26 10:14:10,732][123091] Updated weights for policy 0, policy_version 1333235 (0.0010) [2023-12-26 10:14:10,799][123091] Updated weights for policy 0, policy_version 1333245 (0.0010) [2023-12-26 10:14:10,898][123091] Updated weights for policy 0, policy_version 1333255 (0.0009) [2023-12-26 10:14:11,155][123090] Updated weights for policy 1, policy_version 1323810 (0.0010) [2023-12-26 10:14:11,225][123090] Updated weights for policy 1, policy_version 1323820 (0.0009) [2023-12-26 10:14:11,306][123090] Updated weights for policy 1, policy_version 1323830 (0.0009) [2023-12-26 10:14:11,372][123090] Updated weights for policy 1, policy_version 1323840 (0.0009) [2023-12-26 10:14:11,660][123091] Updated weights for policy 0, policy_version 1333265 (0.0006) [2023-12-26 10:14:11,721][123091] Updated weights for policy 0, policy_version 1333275 (0.0009) [2023-12-26 10:14:11,793][123091] Updated weights for policy 0, policy_version 1333285 (0.0009) [2023-12-26 10:14:11,867][123091] Updated weights for policy 0, policy_version 1333295 (0.0009) [2023-12-26 10:14:12,209][123090] Updated weights for policy 1, policy_version 1323850 (0.0009) [2023-12-26 10:14:12,279][123090] Updated weights for policy 1, policy_version 1323860 (0.0009) [2023-12-26 10:14:12,349][123090] Updated weights for policy 1, policy_version 1323870 (0.0015) [2023-12-26 10:14:12,695][123091] Updated weights for policy 0, policy_version 1333305 (0.0006) [2023-12-26 10:14:12,758][123091] Updated weights for policy 0, policy_version 1333315 (0.0006) [2023-12-26 10:14:12,827][123091] Updated weights for policy 0, policy_version 1333325 (0.0006) [2023-12-26 10:14:13,201][123090] Updated weights for policy 1, policy_version 1323880 (0.0007) [2023-12-26 10:14:13,261][123090] Updated weights for policy 1, policy_version 1323890 (0.0007) [2023-12-26 10:14:13,314][123090] Updated weights for policy 1, policy_version 1323900 (0.0006) [2023-12-26 10:14:13,614][123091] Updated weights for policy 0, policy_version 1333335 (0.0009) [2023-12-26 10:14:13,667][123091] Updated weights for policy 0, policy_version 1333345 (0.0010) [2023-12-26 10:14:13,718][123091] Updated weights for policy 0, policy_version 1333355 (0.0009) [2023-12-26 10:14:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 680263680. Throughput: 0: 8992.3, 1: 8515.9. Samples: 680253536. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:13,785][121949] Avg episode reward: [(0, '6245.553'), (1, '5408.596')] [2023-12-26 10:14:14,026][123090] Updated weights for policy 1, policy_version 1323911 (0.0007) [2023-12-26 10:14:14,077][123090] Updated weights for policy 1, policy_version 1323921 (0.0005) [2023-12-26 10:14:14,140][123090] Updated weights for policy 1, policy_version 1323931 (0.0009) [2023-12-26 10:14:14,631][123091] Updated weights for policy 0, policy_version 1333365 (0.0010) [2023-12-26 10:14:14,694][123091] Updated weights for policy 0, policy_version 1333375 (0.0009) [2023-12-26 10:14:14,744][123091] Updated weights for policy 0, policy_version 1333385 (0.0010) [2023-12-26 10:14:14,907][123090] Updated weights for policy 1, policy_version 1323941 (0.0008) [2023-12-26 10:14:14,978][123090] Updated weights for policy 1, policy_version 1323951 (0.0006) [2023-12-26 10:14:15,045][123090] Updated weights for policy 1, policy_version 1323961 (0.0006) [2023-12-26 10:14:15,655][123091] Updated weights for policy 0, policy_version 1333395 (0.0009) [2023-12-26 10:14:15,710][123091] Updated weights for policy 0, policy_version 1333405 (0.0005) [2023-12-26 10:14:15,740][123090] Updated weights for policy 1, policy_version 1323971 (0.0006) [2023-12-26 10:14:15,766][123091] Updated weights for policy 0, policy_version 1333415 (0.0009) [2023-12-26 10:14:15,793][123090] Updated weights for policy 1, policy_version 1323981 (0.0006) [2023-12-26 10:14:15,840][123090] Updated weights for policy 1, policy_version 1323991 (0.0005) [2023-12-26 10:14:16,490][123091] Updated weights for policy 0, policy_version 1333425 (0.0009) [2023-12-26 10:14:16,541][123090] Updated weights for policy 1, policy_version 1324001 (0.0006) [2023-12-26 10:14:16,548][123091] Updated weights for policy 0, policy_version 1333435 (0.0007) [2023-12-26 10:14:16,593][123090] Updated weights for policy 1, policy_version 1324011 (0.0010) [2023-12-26 10:14:16,596][123091] Updated weights for policy 0, policy_version 1333445 (0.0006) [2023-12-26 10:14:16,647][123091] Updated weights for policy 0, policy_version 1333455 (0.0007) [2023-12-26 10:14:16,652][123090] Updated weights for policy 1, policy_version 1324021 (0.0010) [2023-12-26 10:14:16,710][123090] Updated weights for policy 1, policy_version 1324031 (0.0009) [2023-12-26 10:14:17,462][123090] Updated weights for policy 1, policy_version 1324041 (0.0005) [2023-12-26 10:14:17,512][123090] Updated weights for policy 1, policy_version 1324051 (0.0005) [2023-12-26 10:14:17,532][123091] Updated weights for policy 0, policy_version 1333465 (0.0008) [2023-12-26 10:14:17,568][123090] Updated weights for policy 1, policy_version 1324061 (0.0010) [2023-12-26 10:14:17,591][123091] Updated weights for policy 0, policy_version 1333475 (0.0006) [2023-12-26 10:14:17,637][123091] Updated weights for policy 0, policy_version 1333485 (0.0006) [2023-12-26 10:14:18,363][123090] Updated weights for policy 1, policy_version 1324071 (0.0010) [2023-12-26 10:14:18,415][123090] Updated weights for policy 1, policy_version 1324081 (0.0010) [2023-12-26 10:14:18,475][123090] Updated weights for policy 1, policy_version 1324091 (0.0011) [2023-12-26 10:14:18,480][123091] Updated weights for policy 0, policy_version 1333495 (0.0006) [2023-12-26 10:14:18,544][123091] Updated weights for policy 0, policy_version 1333505 (0.0006) [2023-12-26 10:14:18,599][123091] Updated weights for policy 0, policy_version 1333515 (0.0005) [2023-12-26 10:14:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 680353792. Throughput: 0: 8920.5, 1: 8644.2. Samples: 680363140. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:18,784][121949] Avg episode reward: [(0, '6080.761'), (1, '5477.936')] [2023-12-26 10:14:19,174][123090] Updated weights for policy 1, policy_version 1324101 (0.0011) [2023-12-26 10:14:19,238][123090] Updated weights for policy 1, policy_version 1324111 (0.0011) [2023-12-26 10:14:19,302][123090] Updated weights for policy 1, policy_version 1324121 (0.0011) [2023-12-26 10:14:19,308][123091] Updated weights for policy 0, policy_version 1333525 (0.0006) [2023-12-26 10:14:19,376][123091] Updated weights for policy 0, policy_version 1333535 (0.0008) [2023-12-26 10:14:19,434][123091] Updated weights for policy 0, policy_version 1333545 (0.0008) [2023-12-26 10:14:20,046][123090] Updated weights for policy 1, policy_version 1324131 (0.0011) [2023-12-26 10:14:20,117][123090] Updated weights for policy 1, policy_version 1324141 (0.0011) [2023-12-26 10:14:20,145][123091] Updated weights for policy 0, policy_version 1333555 (0.0007) [2023-12-26 10:14:20,185][123090] Updated weights for policy 1, policy_version 1324151 (0.0011) [2023-12-26 10:14:20,206][123091] Updated weights for policy 0, policy_version 1333565 (0.0006) [2023-12-26 10:14:20,264][123091] Updated weights for policy 0, policy_version 1333575 (0.0007) [2023-12-26 10:14:21,008][123091] Updated weights for policy 0, policy_version 1333585 (0.0009) [2023-12-26 10:14:21,013][123090] Updated weights for policy 1, policy_version 1324161 (0.0011) [2023-12-26 10:14:21,071][123091] Updated weights for policy 0, policy_version 1333595 (0.0009) [2023-12-26 10:14:21,081][123090] Updated weights for policy 1, policy_version 1324171 (0.0010) [2023-12-26 10:14:21,139][123091] Updated weights for policy 0, policy_version 1333605 (0.0007) [2023-12-26 10:14:21,144][123090] Updated weights for policy 1, policy_version 1324181 (0.0011) [2023-12-26 10:14:21,200][123091] Updated weights for policy 0, policy_version 1333615 (0.0008) [2023-12-26 10:14:21,209][123090] Updated weights for policy 1, policy_version 1324191 (0.0011) [2023-12-26 10:14:22,048][123090] Updated weights for policy 1, policy_version 1324201 (0.0009) [2023-12-26 10:14:22,068][123091] Updated weights for policy 0, policy_version 1333625 (0.0008) [2023-12-26 10:14:22,096][123090] Updated weights for policy 1, policy_version 1324211 (0.0009) [2023-12-26 10:14:22,137][123091] Updated weights for policy 0, policy_version 1333635 (0.0009) [2023-12-26 10:14:22,147][123090] Updated weights for policy 1, policy_version 1324221 (0.0008) [2023-12-26 10:14:22,208][123091] Updated weights for policy 0, policy_version 1333645 (0.0009) [2023-12-26 10:14:23,009][123090] Updated weights for policy 1, policy_version 1324231 (0.0009) [2023-12-26 10:14:23,048][123091] Updated weights for policy 0, policy_version 1333655 (0.0009) [2023-12-26 10:14:23,069][123090] Updated weights for policy 1, policy_version 1324241 (0.0007) [2023-12-26 10:14:23,102][123091] Updated weights for policy 0, policy_version 1333665 (0.0008) [2023-12-26 10:14:23,118][123090] Updated weights for policy 1, policy_version 1324251 (0.0007) [2023-12-26 10:14:23,164][123091] Updated weights for policy 0, policy_version 1333675 (0.0010) [2023-12-26 10:14:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 680435712. Throughput: 0: 8904.4, 1: 8670.3. Samples: 680416324. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:23,784][121949] Avg episode reward: [(0, '6186.047'), (1, '5453.679')] [2023-12-26 10:14:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001333680_341426176.pth... [2023-12-26 10:14:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001324256_339009536.pth... [2023-12-26 10:14:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001332656_341164032.pth [2023-12-26 10:14:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001323264_338755584.pth [2023-12-26 10:14:23,855][123091] Updated weights for policy 0, policy_version 1333685 (0.0007) [2023-12-26 10:14:23,899][123091] Updated weights for policy 0, policy_version 1333695 (0.0005) [2023-12-26 10:14:23,962][123091] Updated weights for policy 0, policy_version 1333705 (0.0005) [2023-12-26 10:14:24,021][123090] Updated weights for policy 1, policy_version 1324261 (0.0008) [2023-12-26 10:14:24,075][123090] Updated weights for policy 1, policy_version 1324271 (0.0010) [2023-12-26 10:14:24,144][123090] Updated weights for policy 1, policy_version 1324281 (0.0009) [2023-12-26 10:14:24,712][123091] Updated weights for policy 0, policy_version 1333715 (0.0005) [2023-12-26 10:14:24,779][123091] Updated weights for policy 0, policy_version 1333725 (0.0009) [2023-12-26 10:14:24,847][123091] Updated weights for policy 0, policy_version 1333735 (0.0010) [2023-12-26 10:14:24,978][123090] Updated weights for policy 1, policy_version 1324291 (0.0009) [2023-12-26 10:14:25,030][123090] Updated weights for policy 1, policy_version 1324301 (0.0010) [2023-12-26 10:14:25,078][123090] Updated weights for policy 1, policy_version 1324311 (0.0009) [2023-12-26 10:14:25,697][123091] Updated weights for policy 0, policy_version 1333745 (0.0009) [2023-12-26 10:14:25,747][123091] Updated weights for policy 0, policy_version 1333755 (0.0009) [2023-12-26 10:14:25,759][123090] Updated weights for policy 1, policy_version 1324321 (0.0009) [2023-12-26 10:14:25,805][123091] Updated weights for policy 0, policy_version 1333765 (0.0007) [2023-12-26 10:14:25,818][123090] Updated weights for policy 1, policy_version 1324331 (0.0009) [2023-12-26 10:14:25,852][123091] Updated weights for policy 0, policy_version 1333775 (0.0010) [2023-12-26 10:14:25,885][123090] Updated weights for policy 1, policy_version 1324341 (0.0009) [2023-12-26 10:14:25,937][123090] Updated weights for policy 1, policy_version 1324351 (0.0009) [2023-12-26 10:14:26,689][123091] Updated weights for policy 0, policy_version 1333785 (0.0006) [2023-12-26 10:14:26,724][123090] Updated weights for policy 1, policy_version 1324361 (0.0008) [2023-12-26 10:14:26,744][123091] Updated weights for policy 0, policy_version 1333795 (0.0005) [2023-12-26 10:14:26,777][123090] Updated weights for policy 1, policy_version 1324371 (0.0009) [2023-12-26 10:14:26,803][123091] Updated weights for policy 0, policy_version 1333805 (0.0006) [2023-12-26 10:14:26,834][123090] Updated weights for policy 1, policy_version 1324381 (0.0009) [2023-12-26 10:14:27,591][123090] Updated weights for policy 1, policy_version 1324391 (0.0006) [2023-12-26 10:14:27,638][123090] Updated weights for policy 1, policy_version 1324401 (0.0006) [2023-12-26 10:14:27,643][123091] Updated weights for policy 0, policy_version 1333815 (0.0008) [2023-12-26 10:14:27,694][123090] Updated weights for policy 1, policy_version 1324411 (0.0007) [2023-12-26 10:14:27,707][123091] Updated weights for policy 0, policy_version 1333825 (0.0008) [2023-12-26 10:14:27,765][123091] Updated weights for policy 0, policy_version 1333835 (0.0008) [2023-12-26 10:14:28,305][123090] Updated weights for policy 1, policy_version 1324421 (0.0007) [2023-12-26 10:14:28,378][123090] Updated weights for policy 1, policy_version 1324431 (0.0009) [2023-12-26 10:14:28,434][123090] Updated weights for policy 1, policy_version 1324441 (0.0005) [2023-12-26 10:14:28,602][123091] Updated weights for policy 0, policy_version 1333845 (0.0008) [2023-12-26 10:14:28,652][123091] Updated weights for policy 0, policy_version 1333855 (0.0008) [2023-12-26 10:14:28,703][123091] Updated weights for policy 0, policy_version 1333865 (0.0008) [2023-12-26 10:14:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 680534016. Throughput: 0: 8932.6, 1: 8738.0. Samples: 680523020. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:28,785][121949] Avg episode reward: [(0, '6305.283'), (1, '5353.159')] [2023-12-26 10:14:29,179][123090] Updated weights for policy 1, policy_version 1324451 (0.0005) [2023-12-26 10:14:29,242][123090] Updated weights for policy 1, policy_version 1324461 (0.0007) [2023-12-26 10:14:29,311][123090] Updated weights for policy 1, policy_version 1324471 (0.0007) [2023-12-26 10:14:29,492][123091] Updated weights for policy 0, policy_version 1333875 (0.0007) [2023-12-26 10:14:29,558][123091] Updated weights for policy 0, policy_version 1333885 (0.0007) [2023-12-26 10:14:29,621][123091] Updated weights for policy 0, policy_version 1333895 (0.0010) [2023-12-26 10:14:30,156][123090] Updated weights for policy 1, policy_version 1324481 (0.0009) [2023-12-26 10:14:30,224][123090] Updated weights for policy 1, policy_version 1324491 (0.0010) [2023-12-26 10:14:30,282][123090] Updated weights for policy 1, policy_version 1324501 (0.0010) [2023-12-26 10:14:30,295][123091] Updated weights for policy 0, policy_version 1333905 (0.0008) [2023-12-26 10:14:30,340][123090] Updated weights for policy 1, policy_version 1324511 (0.0008) [2023-12-26 10:14:30,354][123091] Updated weights for policy 0, policy_version 1333915 (0.0007) [2023-12-26 10:14:30,425][123091] Updated weights for policy 0, policy_version 1333925 (0.0009) [2023-12-26 10:14:30,488][123091] Updated weights for policy 0, policy_version 1333935 (0.0011) [2023-12-26 10:14:31,108][123090] Updated weights for policy 1, policy_version 1324521 (0.0009) [2023-12-26 10:14:31,180][123090] Updated weights for policy 1, policy_version 1324531 (0.0009) [2023-12-26 10:14:31,210][123091] Updated weights for policy 0, policy_version 1333945 (0.0006) [2023-12-26 10:14:31,242][123090] Updated weights for policy 1, policy_version 1324541 (0.0009) [2023-12-26 10:14:31,271][123091] Updated weights for policy 0, policy_version 1333955 (0.0008) [2023-12-26 10:14:31,336][123091] Updated weights for policy 0, policy_version 1333965 (0.0010) [2023-12-26 10:14:31,984][123090] Updated weights for policy 1, policy_version 1324551 (0.0006) [2023-12-26 10:14:32,037][123090] Updated weights for policy 1, policy_version 1324561 (0.0005) [2023-12-26 10:14:32,094][123091] Updated weights for policy 0, policy_version 1333975 (0.0007) [2023-12-26 10:14:32,097][123090] Updated weights for policy 1, policy_version 1324571 (0.0005) [2023-12-26 10:14:32,146][123091] Updated weights for policy 0, policy_version 1333985 (0.0005) [2023-12-26 10:14:32,209][123091] Updated weights for policy 0, policy_version 1333995 (0.0005) [2023-12-26 10:14:32,766][123090] Updated weights for policy 1, policy_version 1324581 (0.0005) [2023-12-26 10:14:32,814][123090] Updated weights for policy 1, policy_version 1324591 (0.0008) [2023-12-26 10:14:32,876][123090] Updated weights for policy 1, policy_version 1324601 (0.0010) [2023-12-26 10:14:32,970][123091] Updated weights for policy 0, policy_version 1334005 (0.0008) [2023-12-26 10:14:33,021][123091] Updated weights for policy 0, policy_version 1334015 (0.0010) [2023-12-26 10:14:33,069][123091] Updated weights for policy 0, policy_version 1334025 (0.0010) [2023-12-26 10:14:33,548][123090] Updated weights for policy 1, policy_version 1324611 (0.0011) [2023-12-26 10:14:33,611][123090] Updated weights for policy 1, policy_version 1324621 (0.0006) [2023-12-26 10:14:33,671][123090] Updated weights for policy 1, policy_version 1324631 (0.0007) [2023-12-26 10:14:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 680624128. Throughput: 0: 8935.1, 1: 8805.3. Samples: 680634608. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:33,785][121949] Avg episode reward: [(0, '6192.443'), (1, '5435.138')] [2023-12-26 10:14:33,890][123091] Updated weights for policy 0, policy_version 1334035 (0.0009) [2023-12-26 10:14:33,954][123091] Updated weights for policy 0, policy_version 1334045 (0.0006) [2023-12-26 10:14:34,011][123091] Updated weights for policy 0, policy_version 1334055 (0.0006) [2023-12-26 10:14:34,330][123090] Updated weights for policy 1, policy_version 1324641 (0.0008) [2023-12-26 10:14:34,386][123090] Updated weights for policy 1, policy_version 1324651 (0.0005) [2023-12-26 10:14:34,445][123090] Updated weights for policy 1, policy_version 1324661 (0.0006) [2023-12-26 10:14:34,498][123090] Updated weights for policy 1, policy_version 1324671 (0.0009) [2023-12-26 10:14:34,765][123091] Updated weights for policy 0, policy_version 1334065 (0.0006) [2023-12-26 10:14:34,814][123091] Updated weights for policy 0, policy_version 1334075 (0.0008) [2023-12-26 10:14:34,868][123091] Updated weights for policy 0, policy_version 1334085 (0.0009) [2023-12-26 10:14:34,930][123091] Updated weights for policy 0, policy_version 1334095 (0.0009) [2023-12-26 10:14:35,237][123090] Updated weights for policy 1, policy_version 1324681 (0.0008) [2023-12-26 10:14:35,309][123090] Updated weights for policy 1, policy_version 1324691 (0.0008) [2023-12-26 10:14:35,375][123090] Updated weights for policy 1, policy_version 1324701 (0.0008) [2023-12-26 10:14:35,777][123091] Updated weights for policy 0, policy_version 1334105 (0.0010) [2023-12-26 10:14:35,821][123091] Updated weights for policy 0, policy_version 1334115 (0.0010) [2023-12-26 10:14:35,887][123091] Updated weights for policy 0, policy_version 1334125 (0.0011) [2023-12-26 10:14:36,115][123090] Updated weights for policy 1, policy_version 1324711 (0.0009) [2023-12-26 10:14:36,181][123090] Updated weights for policy 1, policy_version 1324721 (0.0008) [2023-12-26 10:14:36,244][123090] Updated weights for policy 1, policy_version 1324731 (0.0006) [2023-12-26 10:14:36,691][123091] Updated weights for policy 0, policy_version 1334135 (0.0010) [2023-12-26 10:14:36,756][123091] Updated weights for policy 0, policy_version 1334145 (0.0009) [2023-12-26 10:14:36,828][123091] Updated weights for policy 0, policy_version 1334155 (0.0007) [2023-12-26 10:14:37,047][123090] Updated weights for policy 1, policy_version 1324741 (0.0005) [2023-12-26 10:14:37,104][123090] Updated weights for policy 1, policy_version 1324751 (0.0007) [2023-12-26 10:14:37,183][123090] Updated weights for policy 1, policy_version 1324761 (0.0005) [2023-12-26 10:14:37,457][123091] Updated weights for policy 0, policy_version 1334165 (0.0006) [2023-12-26 10:14:37,513][123091] Updated weights for policy 0, policy_version 1334175 (0.0005) [2023-12-26 10:14:37,568][123091] Updated weights for policy 0, policy_version 1334185 (0.0005) [2023-12-26 10:14:37,813][123090] Updated weights for policy 1, policy_version 1324771 (0.0005) [2023-12-26 10:14:37,865][123090] Updated weights for policy 1, policy_version 1324781 (0.0005) [2023-12-26 10:14:37,930][123090] Updated weights for policy 1, policy_version 1324791 (0.0005) [2023-12-26 10:14:38,193][123091] Updated weights for policy 0, policy_version 1334195 (0.0006) [2023-12-26 10:14:38,260][123091] Updated weights for policy 0, policy_version 1334205 (0.0010) [2023-12-26 10:14:38,332][123091] Updated weights for policy 0, policy_version 1334215 (0.0010) [2023-12-26 10:14:38,671][123090] Updated weights for policy 1, policy_version 1324801 (0.0005) [2023-12-26 10:14:38,747][123090] Updated weights for policy 1, policy_version 1324811 (0.0005) [2023-12-26 10:14:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 680714240. Throughput: 0: 8956.7, 1: 8860.9. Samples: 680689800. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:38,785][121949] Avg episode reward: [(0, '6134.431'), (1, '5570.422')] [2023-12-26 10:14:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001334224_341565440.pth... [2023-12-26 10:14:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001333200_341303296.pth [2023-12-26 10:14:38,821][123090] Updated weights for policy 1, policy_version 1324821 (0.0006) [2023-12-26 10:14:38,879][123090] Updated weights for policy 1, policy_version 1324831 (0.0009) [2023-12-26 10:14:38,885][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001324832_339156992.pth... [2023-12-26 10:14:38,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001323744_338878464.pth [2023-12-26 10:14:39,154][123091] Updated weights for policy 0, policy_version 1334225 (0.0009) [2023-12-26 10:14:39,222][123091] Updated weights for policy 0, policy_version 1334235 (0.0008) [2023-12-26 10:14:39,290][123091] Updated weights for policy 0, policy_version 1334245 (0.0009) [2023-12-26 10:14:39,364][123091] Updated weights for policy 0, policy_version 1334255 (0.0007) [2023-12-26 10:14:39,702][123090] Updated weights for policy 1, policy_version 1324841 (0.0006) [2023-12-26 10:14:39,758][123090] Updated weights for policy 1, policy_version 1324851 (0.0005) [2023-12-26 10:14:39,818][123090] Updated weights for policy 1, policy_version 1324861 (0.0006) [2023-12-26 10:14:40,108][123091] Updated weights for policy 0, policy_version 1334265 (0.0006) [2023-12-26 10:14:40,177][123091] Updated weights for policy 0, policy_version 1334275 (0.0007) [2023-12-26 10:14:40,250][123091] Updated weights for policy 0, policy_version 1334285 (0.0007) [2023-12-26 10:14:40,622][123090] Updated weights for policy 1, policy_version 1324871 (0.0010) [2023-12-26 10:14:40,683][123090] Updated weights for policy 1, policy_version 1324881 (0.0009) [2023-12-26 10:14:40,751][123090] Updated weights for policy 1, policy_version 1324891 (0.0009) [2023-12-26 10:14:41,011][123091] Updated weights for policy 0, policy_version 1334295 (0.0008) [2023-12-26 10:14:41,074][123091] Updated weights for policy 0, policy_version 1334305 (0.0010) [2023-12-26 10:14:41,135][123091] Updated weights for policy 0, policy_version 1334315 (0.0010) [2023-12-26 10:14:41,592][123090] Updated weights for policy 1, policy_version 1324903 (0.0009) [2023-12-26 10:14:41,659][123090] Updated weights for policy 1, policy_version 1324913 (0.0009) [2023-12-26 10:14:41,717][123090] Updated weights for policy 1, policy_version 1324923 (0.0009) [2023-12-26 10:14:42,013][123091] Updated weights for policy 0, policy_version 1334325 (0.0009) [2023-12-26 10:14:42,083][123091] Updated weights for policy 0, policy_version 1334335 (0.0008) [2023-12-26 10:14:42,155][123091] Updated weights for policy 0, policy_version 1334345 (0.0007) [2023-12-26 10:14:42,543][123090] Updated weights for policy 1, policy_version 1324933 (0.0010) [2023-12-26 10:14:42,600][123090] Updated weights for policy 1, policy_version 1324943 (0.0007) [2023-12-26 10:14:42,659][123090] Updated weights for policy 1, policy_version 1324953 (0.0005) [2023-12-26 10:14:42,971][123091] Updated weights for policy 0, policy_version 1334355 (0.0009) [2023-12-26 10:14:43,029][123091] Updated weights for policy 0, policy_version 1334365 (0.0009) [2023-12-26 10:14:43,092][123091] Updated weights for policy 0, policy_version 1334375 (0.0009) [2023-12-26 10:14:43,399][123090] Updated weights for policy 1, policy_version 1324963 (0.0007) [2023-12-26 10:14:43,460][123090] Updated weights for policy 1, policy_version 1324973 (0.0010) [2023-12-26 10:14:43,518][123090] Updated weights for policy 1, policy_version 1324983 (0.0010) [2023-12-26 10:14:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 680804352. Throughput: 0: 8894.7, 1: 8963.1. Samples: 680797944. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:43,785][121949] Avg episode reward: [(0, '6148.962'), (1, '5553.116')] [2023-12-26 10:14:43,942][123091] Updated weights for policy 0, policy_version 1334385 (0.0010) [2023-12-26 10:14:44,000][123091] Updated weights for policy 0, policy_version 1334395 (0.0009) [2023-12-26 10:14:44,055][123091] Updated weights for policy 0, policy_version 1334405 (0.0010) [2023-12-26 10:14:44,115][123091] Updated weights for policy 0, policy_version 1334415 (0.0009) [2023-12-26 10:14:44,284][123090] Updated weights for policy 1, policy_version 1324993 (0.0010) [2023-12-26 10:14:44,335][123090] Updated weights for policy 1, policy_version 1325003 (0.0009) [2023-12-26 10:14:44,385][123090] Updated weights for policy 1, policy_version 1325013 (0.0009) [2023-12-26 10:14:44,444][123090] Updated weights for policy 1, policy_version 1325023 (0.0009) [2023-12-26 10:14:44,977][123091] Updated weights for policy 0, policy_version 1334425 (0.0010) [2023-12-26 10:14:45,037][123091] Updated weights for policy 0, policy_version 1334435 (0.0010) [2023-12-26 10:14:45,114][123091] Updated weights for policy 0, policy_version 1334445 (0.0009) [2023-12-26 10:14:45,269][123090] Updated weights for policy 1, policy_version 1325033 (0.0009) [2023-12-26 10:14:45,340][123090] Updated weights for policy 1, policy_version 1325043 (0.0009) [2023-12-26 10:14:45,411][123090] Updated weights for policy 1, policy_version 1325053 (0.0009) [2023-12-26 10:14:45,931][123091] Updated weights for policy 0, policy_version 1334455 (0.0010) [2023-12-26 10:14:45,985][123091] Updated weights for policy 0, policy_version 1334465 (0.0010) [2023-12-26 10:14:46,046][123091] Updated weights for policy 0, policy_version 1334475 (0.0009) [2023-12-26 10:14:46,228][123090] Updated weights for policy 1, policy_version 1325063 (0.0010) [2023-12-26 10:14:46,290][123090] Updated weights for policy 1, policy_version 1325073 (0.0009) [2023-12-26 10:14:46,354][123090] Updated weights for policy 1, policy_version 1325083 (0.0009) [2023-12-26 10:14:46,892][123091] Updated weights for policy 0, policy_version 1334485 (0.0009) [2023-12-26 10:14:46,957][123091] Updated weights for policy 0, policy_version 1334495 (0.0009) [2023-12-26 10:14:47,023][123091] Updated weights for policy 0, policy_version 1334505 (0.0009) [2023-12-26 10:14:47,159][123090] Updated weights for policy 1, policy_version 1325093 (0.0010) [2023-12-26 10:14:47,218][123090] Updated weights for policy 1, policy_version 1325103 (0.0010) [2023-12-26 10:14:47,276][123090] Updated weights for policy 1, policy_version 1325113 (0.0010) [2023-12-26 10:14:47,866][123091] Updated weights for policy 0, policy_version 1334515 (0.0009) [2023-12-26 10:14:47,923][123091] Updated weights for policy 0, policy_version 1334525 (0.0009) [2023-12-26 10:14:47,973][123091] Updated weights for policy 0, policy_version 1334535 (0.0005) [2023-12-26 10:14:48,053][123090] Updated weights for policy 1, policy_version 1325123 (0.0009) [2023-12-26 10:14:48,117][123090] Updated weights for policy 1, policy_version 1325133 (0.0009) [2023-12-26 10:14:48,180][123090] Updated weights for policy 1, policy_version 1325143 (0.0010) [2023-12-26 10:14:48,784][123091] Updated weights for policy 0, policy_version 1334545 (0.0006) [2023-12-26 10:14:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 680886272. Throughput: 0: 8818.4, 1: 9003.2. Samples: 680900952. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:48,785][121949] Avg episode reward: [(0, '6261.399'), (1, '5286.188')] [2023-12-26 10:14:48,850][123091] Updated weights for policy 0, policy_version 1334555 (0.0010) [2023-12-26 10:14:48,910][123091] Updated weights for policy 0, policy_version 1334565 (0.0010) [2023-12-26 10:14:48,951][123090] Updated weights for policy 1, policy_version 1325153 (0.0008) [2023-12-26 10:14:48,963][123091] Updated weights for policy 0, policy_version 1334575 (0.0010) [2023-12-26 10:14:49,009][123090] Updated weights for policy 1, policy_version 1325163 (0.0005) [2023-12-26 10:14:49,073][123090] Updated weights for policy 1, policy_version 1325173 (0.0005) [2023-12-26 10:14:49,123][123090] Updated weights for policy 1, policy_version 1325183 (0.0005) [2023-12-26 10:14:49,847][123090] Updated weights for policy 1, policy_version 1325193 (0.0007) [2023-12-26 10:14:49,871][123091] Updated weights for policy 0, policy_version 1334585 (0.0009) [2023-12-26 10:14:49,913][123090] Updated weights for policy 1, policy_version 1325203 (0.0005) [2023-12-26 10:14:49,936][123091] Updated weights for policy 0, policy_version 1334595 (0.0009) [2023-12-26 10:14:49,983][123090] Updated weights for policy 1, policy_version 1325213 (0.0007) [2023-12-26 10:14:50,000][123091] Updated weights for policy 0, policy_version 1334605 (0.0008) [2023-12-26 10:14:50,771][123090] Updated weights for policy 1, policy_version 1325223 (0.0009) [2023-12-26 10:14:50,837][123091] Updated weights for policy 0, policy_version 1334615 (0.0009) [2023-12-26 10:14:50,837][123090] Updated weights for policy 1, policy_version 1325233 (0.0010) [2023-12-26 10:14:50,900][123091] Updated weights for policy 0, policy_version 1334625 (0.0010) [2023-12-26 10:14:50,907][123090] Updated weights for policy 1, policy_version 1325243 (0.0007) [2023-12-26 10:14:50,966][123091] Updated weights for policy 0, policy_version 1334635 (0.0009) [2023-12-26 10:14:51,722][123090] Updated weights for policy 1, policy_version 1325253 (0.0009) [2023-12-26 10:14:51,796][123090] Updated weights for policy 1, policy_version 1325263 (0.0010) [2023-12-26 10:14:51,856][123091] Updated weights for policy 0, policy_version 1334645 (0.0009) [2023-12-26 10:14:51,862][123090] Updated weights for policy 1, policy_version 1325273 (0.0008) [2023-12-26 10:14:51,917][123091] Updated weights for policy 0, policy_version 1334655 (0.0009) [2023-12-26 10:14:51,976][123091] Updated weights for policy 0, policy_version 1334665 (0.0009) [2023-12-26 10:14:52,594][123090] Updated weights for policy 1, policy_version 1325283 (0.0007) [2023-12-26 10:14:52,655][123090] Updated weights for policy 1, policy_version 1325293 (0.0006) [2023-12-26 10:14:52,713][123090] Updated weights for policy 1, policy_version 1325303 (0.0005) [2023-12-26 10:14:52,889][123091] Updated weights for policy 0, policy_version 1334675 (0.0010) [2023-12-26 10:14:52,943][123091] Updated weights for policy 0, policy_version 1334685 (0.0009) [2023-12-26 10:14:52,994][123091] Updated weights for policy 0, policy_version 1334695 (0.0008) [2023-12-26 10:14:53,510][123090] Updated weights for policy 1, policy_version 1325313 (0.0009) [2023-12-26 10:14:53,585][123090] Updated weights for policy 1, policy_version 1325323 (0.0010) [2023-12-26 10:14:53,666][123090] Updated weights for policy 1, policy_version 1325333 (0.0010) [2023-12-26 10:14:53,730][123090] Updated weights for policy 1, policy_version 1325343 (0.0010) [2023-12-26 10:14:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 680976384. Throughput: 0: 8775.7, 1: 9048.0. Samples: 680952484. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:53,785][121949] Avg episode reward: [(0, '6245.761'), (1, '5111.993')] [2023-12-26 10:14:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001325344_339288064.pth... [2023-12-26 10:14:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001334704_341688320.pth... [2023-12-26 10:14:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001324256_339009536.pth [2023-12-26 10:14:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001333680_341426176.pth [2023-12-26 10:14:53,833][123091] Updated weights for policy 0, policy_version 1334705 (0.0009) [2023-12-26 10:14:53,891][123091] Updated weights for policy 0, policy_version 1334715 (0.0010) [2023-12-26 10:14:53,946][123091] Updated weights for policy 0, policy_version 1334725 (0.0010) [2023-12-26 10:14:53,999][123091] Updated weights for policy 0, policy_version 1334735 (0.0010) [2023-12-26 10:14:54,451][123090] Updated weights for policy 1, policy_version 1325353 (0.0006) [2023-12-26 10:14:54,518][123090] Updated weights for policy 1, policy_version 1325363 (0.0006) [2023-12-26 10:14:54,578][123090] Updated weights for policy 1, policy_version 1325373 (0.0010) [2023-12-26 10:14:54,795][123091] Updated weights for policy 0, policy_version 1334745 (0.0005) [2023-12-26 10:14:54,861][123091] Updated weights for policy 0, policy_version 1334755 (0.0006) [2023-12-26 10:14:54,914][123091] Updated weights for policy 0, policy_version 1334765 (0.0007) [2023-12-26 10:14:55,378][123090] Updated weights for policy 1, policy_version 1325383 (0.0007) [2023-12-26 10:14:55,443][123090] Updated weights for policy 1, policy_version 1325393 (0.0005) [2023-12-26 10:14:55,505][123090] Updated weights for policy 1, policy_version 1325403 (0.0005) [2023-12-26 10:14:55,694][123091] Updated weights for policy 0, policy_version 1334775 (0.0006) [2023-12-26 10:14:55,744][123091] Updated weights for policy 0, policy_version 1334785 (0.0005) [2023-12-26 10:14:55,800][123091] Updated weights for policy 0, policy_version 1334795 (0.0008) [2023-12-26 10:14:56,145][123090] Updated weights for policy 1, policy_version 1325413 (0.0008) [2023-12-26 10:14:56,201][123090] Updated weights for policy 1, policy_version 1325423 (0.0010) [2023-12-26 10:14:56,254][123090] Updated weights for policy 1, policy_version 1325433 (0.0009) [2023-12-26 10:14:56,586][123091] Updated weights for policy 0, policy_version 1334805 (0.0010) [2023-12-26 10:14:56,646][123091] Updated weights for policy 0, policy_version 1334815 (0.0010) [2023-12-26 10:14:56,702][123091] Updated weights for policy 0, policy_version 1334825 (0.0009) [2023-12-26 10:14:57,053][123090] Updated weights for policy 1, policy_version 1325443 (0.0009) [2023-12-26 10:14:57,107][123090] Updated weights for policy 1, policy_version 1325454 (0.0010) [2023-12-26 10:14:57,160][123090] Updated weights for policy 1, policy_version 1325464 (0.0009) [2023-12-26 10:14:57,381][123091] Updated weights for policy 0, policy_version 1334835 (0.0007) [2023-12-26 10:14:57,428][123091] Updated weights for policy 0, policy_version 1334845 (0.0005) [2023-12-26 10:14:57,473][123091] Updated weights for policy 0, policy_version 1334855 (0.0005) [2023-12-26 10:14:57,977][123090] Updated weights for policy 1, policy_version 1325474 (0.0009) [2023-12-26 10:14:58,026][123090] Updated weights for policy 1, policy_version 1325484 (0.0006) [2023-12-26 10:14:58,099][123090] Updated weights for policy 1, policy_version 1325494 (0.0010) [2023-12-26 10:14:58,153][123090] Updated weights for policy 1, policy_version 1325504 (0.0010) [2023-12-26 10:14:58,166][123091] Updated weights for policy 0, policy_version 1334865 (0.0005) [2023-12-26 10:14:58,219][123091] Updated weights for policy 0, policy_version 1334875 (0.0006) [2023-12-26 10:14:58,282][123091] Updated weights for policy 0, policy_version 1334885 (0.0007) [2023-12-26 10:14:58,350][123091] Updated weights for policy 0, policy_version 1334895 (0.0008) [2023-12-26 10:14:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 681066496. Throughput: 0: 8788.7, 1: 9140.4. Samples: 681060344. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:14:58,785][121949] Avg episode reward: [(0, '6263.099'), (1, '5241.548')] [2023-12-26 10:14:59,064][123090] Updated weights for policy 1, policy_version 1325514 (0.0007) [2023-12-26 10:14:59,120][123090] Updated weights for policy 1, policy_version 1325524 (0.0007) [2023-12-26 10:14:59,152][123091] Updated weights for policy 0, policy_version 1334905 (0.0008) [2023-12-26 10:14:59,174][123090] Updated weights for policy 1, policy_version 1325534 (0.0007) [2023-12-26 10:14:59,220][123091] Updated weights for policy 0, policy_version 1334915 (0.0009) [2023-12-26 10:14:59,289][123091] Updated weights for policy 0, policy_version 1334925 (0.0009) [2023-12-26 10:15:00,021][123090] Updated weights for policy 1, policy_version 1325544 (0.0009) [2023-12-26 10:15:00,082][123091] Updated weights for policy 0, policy_version 1334935 (0.0008) [2023-12-26 10:15:00,086][123090] Updated weights for policy 1, policy_version 1325554 (0.0010) [2023-12-26 10:15:00,127][123091] Updated weights for policy 0, policy_version 1334945 (0.0005) [2023-12-26 10:15:00,140][123090] Updated weights for policy 1, policy_version 1325564 (0.0009) [2023-12-26 10:15:00,175][123091] Updated weights for policy 0, policy_version 1334955 (0.0007) [2023-12-26 10:15:00,951][123091] Updated weights for policy 0, policy_version 1334965 (0.0009) [2023-12-26 10:15:01,013][123091] Updated weights for policy 0, policy_version 1334975 (0.0008) [2023-12-26 10:15:01,039][123090] Updated weights for policy 1, policy_version 1325574 (0.0009) [2023-12-26 10:15:01,082][123091] Updated weights for policy 0, policy_version 1334985 (0.0008) [2023-12-26 10:15:01,108][123090] Updated weights for policy 1, policy_version 1325584 (0.0008) [2023-12-26 10:15:01,176][123090] Updated weights for policy 1, policy_version 1325594 (0.0010) [2023-12-26 10:15:01,799][123091] Updated weights for policy 0, policy_version 1334995 (0.0006) [2023-12-26 10:15:01,869][123091] Updated weights for policy 0, policy_version 1335005 (0.0007) [2023-12-26 10:15:01,931][123091] Updated weights for policy 0, policy_version 1335015 (0.0009) [2023-12-26 10:15:01,971][123090] Updated weights for policy 1, policy_version 1325604 (0.0009) [2023-12-26 10:15:02,033][123090] Updated weights for policy 1, policy_version 1325614 (0.0010) [2023-12-26 10:15:02,100][123090] Updated weights for policy 1, policy_version 1325624 (0.0009) [2023-12-26 10:15:02,669][123091] Updated weights for policy 0, policy_version 1335025 (0.0010) [2023-12-26 10:15:02,728][123091] Updated weights for policy 0, policy_version 1335035 (0.0010) [2023-12-26 10:15:02,788][123091] Updated weights for policy 0, policy_version 1335045 (0.0009) [2023-12-26 10:15:02,848][123091] Updated weights for policy 0, policy_version 1335055 (0.0009) [2023-12-26 10:15:02,854][123090] Updated weights for policy 1, policy_version 1325634 (0.0010) [2023-12-26 10:15:02,920][123090] Updated weights for policy 1, policy_version 1325644 (0.0006) [2023-12-26 10:15:02,993][123090] Updated weights for policy 1, policy_version 1325654 (0.0006) [2023-12-26 10:15:03,055][123090] Updated weights for policy 1, policy_version 1325664 (0.0007) [2023-12-26 10:15:03,718][123090] Updated weights for policy 1, policy_version 1325674 (0.0008) [2023-12-26 10:15:03,737][123091] Updated weights for policy 0, policy_version 1335065 (0.0006) [2023-12-26 10:15:03,766][123090] Updated weights for policy 1, policy_version 1325684 (0.0008) [2023-12-26 10:15:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 681148416. Throughput: 0: 8859.0, 1: 9022.5. Samples: 681167808. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:15:03,785][121949] Avg episode reward: [(0, '6298.831'), (1, '5286.451')] [2023-12-26 10:15:03,788][123091] Updated weights for policy 0, policy_version 1335075 (0.0006) [2023-12-26 10:15:03,815][123090] Updated weights for policy 1, policy_version 1325694 (0.0009) [2023-12-26 10:15:03,853][123091] Updated weights for policy 0, policy_version 1335085 (0.0007) [2023-12-26 10:15:04,540][123091] Updated weights for policy 0, policy_version 1335095 (0.0010) [2023-12-26 10:15:04,601][123091] Updated weights for policy 0, policy_version 1335105 (0.0011) [2023-12-26 10:15:04,667][123091] Updated weights for policy 0, policy_version 1335115 (0.0009) [2023-12-26 10:15:04,699][123090] Updated weights for policy 1, policy_version 1325704 (0.0009) [2023-12-26 10:15:04,748][123090] Updated weights for policy 1, policy_version 1325714 (0.0009) [2023-12-26 10:15:04,808][123090] Updated weights for policy 1, policy_version 1325724 (0.0009) [2023-12-26 10:15:05,487][123091] Updated weights for policy 0, policy_version 1335125 (0.0011) [2023-12-26 10:15:05,546][123091] Updated weights for policy 0, policy_version 1335135 (0.0011) [2023-12-26 10:15:05,590][123091] Updated weights for policy 0, policy_version 1335145 (0.0010) [2023-12-26 10:15:05,651][123090] Updated weights for policy 1, policy_version 1325734 (0.0009) [2023-12-26 10:15:05,698][123090] Updated weights for policy 1, policy_version 1325744 (0.0008) [2023-12-26 10:15:05,752][123090] Updated weights for policy 1, policy_version 1325754 (0.0009) [2023-12-26 10:15:06,440][123091] Updated weights for policy 0, policy_version 1335155 (0.0011) [2023-12-26 10:15:06,503][123091] Updated weights for policy 0, policy_version 1335165 (0.0011) [2023-12-26 10:15:06,516][123090] Updated weights for policy 1, policy_version 1325764 (0.0010) [2023-12-26 10:15:06,567][123091] Updated weights for policy 0, policy_version 1335175 (0.0011) [2023-12-26 10:15:06,586][123090] Updated weights for policy 1, policy_version 1325774 (0.0008) [2023-12-26 10:15:06,653][123090] Updated weights for policy 1, policy_version 1325784 (0.0008) [2023-12-26 10:15:07,384][123090] Updated weights for policy 1, policy_version 1325794 (0.0008) [2023-12-26 10:15:07,396][123091] Updated weights for policy 0, policy_version 1335185 (0.0011) [2023-12-26 10:15:07,442][123090] Updated weights for policy 1, policy_version 1325804 (0.0006) [2023-12-26 10:15:07,444][123091] Updated weights for policy 0, policy_version 1335195 (0.0011) [2023-12-26 10:15:07,498][123090] Updated weights for policy 1, policy_version 1325814 (0.0005) [2023-12-26 10:15:07,500][123091] Updated weights for policy 0, policy_version 1335205 (0.0011) [2023-12-26 10:15:07,553][123090] Updated weights for policy 1, policy_version 1325824 (0.0005) [2023-12-26 10:15:07,557][123091] Updated weights for policy 0, policy_version 1335215 (0.0011) [2023-12-26 10:15:08,210][123090] Updated weights for policy 1, policy_version 1325834 (0.0009) [2023-12-26 10:15:08,277][123090] Updated weights for policy 1, policy_version 1325844 (0.0008) [2023-12-26 10:15:08,339][123090] Updated weights for policy 1, policy_version 1325854 (0.0010) [2023-12-26 10:15:08,390][123091] Updated weights for policy 0, policy_version 1335225 (0.0008) [2023-12-26 10:15:08,457][123091] Updated weights for policy 0, policy_version 1335235 (0.0009) [2023-12-26 10:15:08,516][123091] Updated weights for policy 0, policy_version 1335245 (0.0011) [2023-12-26 10:15:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 681246720. Throughput: 0: 8843.4, 1: 9026.2. Samples: 681220464. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:15:08,786][121949] Avg episode reward: [(0, '6141.192'), (1, '5030.799')] [2023-12-26 10:15:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001325856_339419136.pth... [2023-12-26 10:15:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001335248_341827584.pth... [2023-12-26 10:15:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001334224_341565440.pth [2023-12-26 10:15:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001324832_339156992.pth [2023-12-26 10:15:09,123][123090] Updated weights for policy 1, policy_version 1325864 (0.0007) [2023-12-26 10:15:09,195][123090] Updated weights for policy 1, policy_version 1325874 (0.0006) [2023-12-26 10:15:09,263][123090] Updated weights for policy 1, policy_version 1325884 (0.0009) [2023-12-26 10:15:09,340][123091] Updated weights for policy 0, policy_version 1335255 (0.0009) [2023-12-26 10:15:09,410][123091] Updated weights for policy 0, policy_version 1335265 (0.0010) [2023-12-26 10:15:09,476][123091] Updated weights for policy 0, policy_version 1335275 (0.0011) [2023-12-26 10:15:10,065][123090] Updated weights for policy 1, policy_version 1325894 (0.0011) [2023-12-26 10:15:10,139][123090] Updated weights for policy 1, policy_version 1325904 (0.0011) [2023-12-26 10:15:10,217][123090] Updated weights for policy 1, policy_version 1325914 (0.0011) [2023-12-26 10:15:10,251][123091] Updated weights for policy 0, policy_version 1335285 (0.0008) [2023-12-26 10:15:10,318][123091] Updated weights for policy 0, policy_version 1335295 (0.0006) [2023-12-26 10:15:10,381][123091] Updated weights for policy 0, policy_version 1335305 (0.0006) [2023-12-26 10:15:11,028][123090] Updated weights for policy 1, policy_version 1325924 (0.0010) [2023-12-26 10:15:11,101][123090] Updated weights for policy 1, policy_version 1325934 (0.0007) [2023-12-26 10:15:11,114][123091] Updated weights for policy 0, policy_version 1335315 (0.0007) [2023-12-26 10:15:11,173][123090] Updated weights for policy 1, policy_version 1325944 (0.0008) [2023-12-26 10:15:11,186][123091] Updated weights for policy 0, policy_version 1335325 (0.0008) [2023-12-26 10:15:11,258][123091] Updated weights for policy 0, policy_version 1335335 (0.0009) [2023-12-26 10:15:11,979][123091] Updated weights for policy 0, policy_version 1335345 (0.0010) [2023-12-26 10:15:12,042][123091] Updated weights for policy 0, policy_version 1335355 (0.0009) [2023-12-26 10:15:12,070][123090] Updated weights for policy 1, policy_version 1325954 (0.0007) [2023-12-26 10:15:12,104][123091] Updated weights for policy 0, policy_version 1335365 (0.0010) [2023-12-26 10:15:12,129][123090] Updated weights for policy 1, policy_version 1325964 (0.0008) [2023-12-26 10:15:12,163][123091] Updated weights for policy 0, policy_version 1335375 (0.0009) [2023-12-26 10:15:12,192][123090] Updated weights for policy 1, policy_version 1325974 (0.0009) [2023-12-26 10:15:12,251][123090] Updated weights for policy 1, policy_version 1325984 (0.0009) [2023-12-26 10:15:12,910][123091] Updated weights for policy 0, policy_version 1335385 (0.0006) [2023-12-26 10:15:12,955][123091] Updated weights for policy 0, policy_version 1335395 (0.0005) [2023-12-26 10:15:13,002][123091] Updated weights for policy 0, policy_version 1335405 (0.0007) [2023-12-26 10:15:13,152][123090] Updated weights for policy 1, policy_version 1325994 (0.0008) [2023-12-26 10:15:13,215][123090] Updated weights for policy 1, policy_version 1326004 (0.0010) [2023-12-26 10:15:13,280][123090] Updated weights for policy 1, policy_version 1326014 (0.0009) [2023-12-26 10:15:13,753][123091] Updated weights for policy 0, policy_version 1335416 (0.0009) [2023-12-26 10:15:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 681328640. Throughput: 0: 8858.8, 1: 8991.2. Samples: 681326272. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:15:13,785][121949] Avg episode reward: [(0, '6189.557'), (1, '5263.580')] [2023-12-26 10:15:13,811][123091] Updated weights for policy 0, policy_version 1335427 (0.0010) [2023-12-26 10:15:13,866][123091] Updated weights for policy 0, policy_version 1335437 (0.0010) [2023-12-26 10:15:13,883][123090] Updated weights for policy 1, policy_version 1326024 (0.0006) [2023-12-26 10:15:13,934][123090] Updated weights for policy 1, policy_version 1326034 (0.0005) [2023-12-26 10:15:13,989][123090] Updated weights for policy 1, policy_version 1326044 (0.0005) [2023-12-26 10:15:14,709][123091] Updated weights for policy 0, policy_version 1335447 (0.0007) [2023-12-26 10:15:14,768][123091] Updated weights for policy 0, policy_version 1335457 (0.0011) [2023-12-26 10:15:14,817][123090] Updated weights for policy 1, policy_version 1326054 (0.0007) [2023-12-26 10:15:14,831][123091] Updated weights for policy 0, policy_version 1335467 (0.0011) [2023-12-26 10:15:14,878][123090] Updated weights for policy 1, policy_version 1326064 (0.0006) [2023-12-26 10:15:14,956][123090] Updated weights for policy 1, policy_version 1326074 (0.0006) [2023-12-26 10:15:15,653][123091] Updated weights for policy 0, policy_version 1335477 (0.0011) [2023-12-26 10:15:15,678][123090] Updated weights for policy 1, policy_version 1326084 (0.0007) [2023-12-26 10:15:15,713][123091] Updated weights for policy 0, policy_version 1335487 (0.0011) [2023-12-26 10:15:15,747][123090] Updated weights for policy 1, policy_version 1326094 (0.0006) [2023-12-26 10:15:15,779][123091] Updated weights for policy 0, policy_version 1335497 (0.0011) [2023-12-26 10:15:15,809][123090] Updated weights for policy 1, policy_version 1326104 (0.0006) [2023-12-26 10:15:16,469][123090] Updated weights for policy 1, policy_version 1326114 (0.0006) [2023-12-26 10:15:16,510][123091] Updated weights for policy 0, policy_version 1335507 (0.0011) [2023-12-26 10:15:16,535][123090] Updated weights for policy 1, policy_version 1326124 (0.0006) [2023-12-26 10:15:16,566][123091] Updated weights for policy 0, policy_version 1335517 (0.0011) [2023-12-26 10:15:16,590][123090] Updated weights for policy 1, policy_version 1326134 (0.0006) [2023-12-26 10:15:16,626][123091] Updated weights for policy 0, policy_version 1335527 (0.0010) [2023-12-26 10:15:16,649][123090] Updated weights for policy 1, policy_version 1326144 (0.0006) [2023-12-26 10:15:17,348][123090] Updated weights for policy 1, policy_version 1326154 (0.0011) [2023-12-26 10:15:17,366][123091] Updated weights for policy 0, policy_version 1335537 (0.0010) [2023-12-26 10:15:17,408][123090] Updated weights for policy 1, policy_version 1326164 (0.0011) [2023-12-26 10:15:17,430][123091] Updated weights for policy 0, policy_version 1335547 (0.0009) [2023-12-26 10:15:17,470][123090] Updated weights for policy 1, policy_version 1326174 (0.0006) [2023-12-26 10:15:17,488][123091] Updated weights for policy 0, policy_version 1335557 (0.0010) [2023-12-26 10:15:17,551][123091] Updated weights for policy 0, policy_version 1335567 (0.0010) [2023-12-26 10:15:18,197][123090] Updated weights for policy 1, policy_version 1326184 (0.0009) [2023-12-26 10:15:18,265][123090] Updated weights for policy 1, policy_version 1326194 (0.0008) [2023-12-26 10:15:18,294][123091] Updated weights for policy 0, policy_version 1335577 (0.0010) [2023-12-26 10:15:18,326][123090] Updated weights for policy 1, policy_version 1326204 (0.0010) [2023-12-26 10:15:18,361][123091] Updated weights for policy 0, policy_version 1335587 (0.0011) [2023-12-26 10:15:18,428][123091] Updated weights for policy 0, policy_version 1335597 (0.0011) [2023-12-26 10:15:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.7, 300 sec: 17744.7). Total num frames: 681426944. Throughput: 0: 8850.3, 1: 8984.2. Samples: 681437168. Policy #0 lag: (min: 17.0, avg: 43.2, max: 49.0) [2023-12-26 10:15:18,786][121949] Avg episode reward: [(0, '6339.201'), (1, '5423.016')] [2023-12-26 10:15:19,157][123090] Updated weights for policy 1, policy_version 1326214 (0.0009) [2023-12-26 10:15:19,211][123090] Updated weights for policy 1, policy_version 1326224 (0.0009) [2023-12-26 10:15:19,281][123091] Updated weights for policy 0, policy_version 1335607 (0.0010) [2023-12-26 10:15:19,285][123090] Updated weights for policy 1, policy_version 1326234 (0.0008) [2023-12-26 10:15:19,348][123091] Updated weights for policy 0, policy_version 1335617 (0.0010) [2023-12-26 10:15:19,417][123091] Updated weights for policy 0, policy_version 1335627 (0.0007) [2023-12-26 10:15:20,213][123090] Updated weights for policy 1, policy_version 1326244 (0.0008) [2023-12-26 10:15:20,280][123090] Updated weights for policy 1, policy_version 1326254 (0.0010) [2023-12-26 10:15:20,284][123091] Updated weights for policy 0, policy_version 1335637 (0.0007) [2023-12-26 10:15:20,338][123090] Updated weights for policy 1, policy_version 1326264 (0.0009) [2023-12-26 10:15:20,353][123091] Updated weights for policy 0, policy_version 1335647 (0.0008) [2023-12-26 10:15:20,422][123091] Updated weights for policy 0, policy_version 1335657 (0.0007) [2023-12-26 10:15:21,207][123091] Updated weights for policy 0, policy_version 1335667 (0.0008) [2023-12-26 10:15:21,276][123091] Updated weights for policy 0, policy_version 1335677 (0.0008) [2023-12-26 10:15:21,316][123090] Updated weights for policy 1, policy_version 1326274 (0.0009) [2023-12-26 10:15:21,342][123091] Updated weights for policy 0, policy_version 1335687 (0.0008) [2023-12-26 10:15:21,389][123090] Updated weights for policy 1, policy_version 1326284 (0.0012) [2023-12-26 10:15:21,462][123090] Updated weights for policy 1, policy_version 1326294 (0.0009) [2023-12-26 10:15:21,526][123090] Updated weights for policy 1, policy_version 1326304 (0.0009) [2023-12-26 10:15:22,227][123091] Updated weights for policy 0, policy_version 1335697 (0.0008) [2023-12-26 10:15:22,299][123091] Updated weights for policy 0, policy_version 1335707 (0.0008) [2023-12-26 10:15:22,374][123091] Updated weights for policy 0, policy_version 1335717 (0.0008) [2023-12-26 10:15:22,413][123090] Updated weights for policy 1, policy_version 1326314 (0.0010) [2023-12-26 10:15:22,441][123091] Updated weights for policy 0, policy_version 1335727 (0.0006) [2023-12-26 10:15:22,476][123090] Updated weights for policy 1, policy_version 1326324 (0.0010) [2023-12-26 10:15:22,539][123090] Updated weights for policy 1, policy_version 1326334 (0.0010) [2023-12-26 10:15:23,256][123091] Updated weights for policy 0, policy_version 1335737 (0.0010) [2023-12-26 10:15:23,324][123091] Updated weights for policy 0, policy_version 1335747 (0.0009) [2023-12-26 10:15:23,388][123091] Updated weights for policy 0, policy_version 1335757 (0.0010) [2023-12-26 10:15:23,400][123090] Updated weights for policy 1, policy_version 1326344 (0.0008) [2023-12-26 10:15:23,464][123090] Updated weights for policy 1, policy_version 1326354 (0.0008) [2023-12-26 10:15:23,533][123090] Updated weights for policy 1, policy_version 1326364 (0.0010) [2023-12-26 10:15:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 681508864. Throughput: 0: 8811.1, 1: 8873.5. Samples: 681485608. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:23,785][121949] Avg episode reward: [(0, '6276.145'), (1, '5426.860')] [2023-12-26 10:15:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001326368_339550208.pth... [2023-12-26 10:15:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001335760_341958656.pth... [2023-12-26 10:15:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001325344_339288064.pth [2023-12-26 10:15:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001334704_341688320.pth [2023-12-26 10:15:24,244][123091] Updated weights for policy 0, policy_version 1335767 (0.0011) [2023-12-26 10:15:24,311][123091] Updated weights for policy 0, policy_version 1335777 (0.0011) [2023-12-26 10:15:24,356][123090] Updated weights for policy 1, policy_version 1326374 (0.0007) [2023-12-26 10:15:24,371][123091] Updated weights for policy 0, policy_version 1335787 (0.0011) [2023-12-26 10:15:24,422][123090] Updated weights for policy 1, policy_version 1326384 (0.0007) [2023-12-26 10:15:24,487][123090] Updated weights for policy 1, policy_version 1326394 (0.0009) [2023-12-26 10:15:25,062][123091] Updated weights for policy 0, policy_version 1335797 (0.0008) [2023-12-26 10:15:25,119][123091] Updated weights for policy 0, policy_version 1335807 (0.0005) [2023-12-26 10:15:25,175][123091] Updated weights for policy 0, policy_version 1335817 (0.0010) [2023-12-26 10:15:25,407][123090] Updated weights for policy 1, policy_version 1326404 (0.0010) [2023-12-26 10:15:25,460][123090] Updated weights for policy 1, policy_version 1326414 (0.0009) [2023-12-26 10:15:25,514][123090] Updated weights for policy 1, policy_version 1326424 (0.0010) [2023-12-26 10:15:25,851][123091] Updated weights for policy 0, policy_version 1335827 (0.0011) [2023-12-26 10:15:25,903][123091] Updated weights for policy 0, policy_version 1335837 (0.0011) [2023-12-26 10:15:25,956][123091] Updated weights for policy 0, policy_version 1335847 (0.0011) [2023-12-26 10:15:26,435][123090] Updated weights for policy 1, policy_version 1326434 (0.0010) [2023-12-26 10:15:26,495][123090] Updated weights for policy 1, policy_version 1326444 (0.0010) [2023-12-26 10:15:26,559][123090] Updated weights for policy 1, policy_version 1326454 (0.0009) [2023-12-26 10:15:26,616][123090] Updated weights for policy 1, policy_version 1326464 (0.0009) [2023-12-26 10:15:26,694][123091] Updated weights for policy 0, policy_version 1335857 (0.0006) [2023-12-26 10:15:26,751][123091] Updated weights for policy 0, policy_version 1335867 (0.0005) [2023-12-26 10:15:26,803][123091] Updated weights for policy 0, policy_version 1335877 (0.0006) [2023-12-26 10:15:26,856][123091] Updated weights for policy 0, policy_version 1335887 (0.0005) [2023-12-26 10:15:27,495][123090] Updated weights for policy 1, policy_version 1326474 (0.0005) [2023-12-26 10:15:27,558][123090] Updated weights for policy 1, policy_version 1326484 (0.0007) [2023-12-26 10:15:27,562][123091] Updated weights for policy 0, policy_version 1335897 (0.0005) [2023-12-26 10:15:27,612][123091] Updated weights for policy 0, policy_version 1335907 (0.0005) [2023-12-26 10:15:27,616][123090] Updated weights for policy 1, policy_version 1326494 (0.0008) [2023-12-26 10:15:27,662][123091] Updated weights for policy 0, policy_version 1335917 (0.0007) [2023-12-26 10:15:28,316][123091] Updated weights for policy 0, policy_version 1335928 (0.0007) [2023-12-26 10:15:28,393][123091] Updated weights for policy 0, policy_version 1335938 (0.0007) [2023-12-26 10:15:28,464][123091] Updated weights for policy 0, policy_version 1335948 (0.0007) [2023-12-26 10:15:28,479][123090] Updated weights for policy 1, policy_version 1326504 (0.0008) [2023-12-26 10:15:28,547][123090] Updated weights for policy 1, policy_version 1326514 (0.0009) [2023-12-26 10:15:28,615][123090] Updated weights for policy 1, policy_version 1326524 (0.0010) [2023-12-26 10:15:28,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 681598976. Throughput: 0: 8835.1, 1: 8757.4. Samples: 681589608. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:28,785][121949] Avg episode reward: [(0, '6318.604'), (1, '5313.333')] [2023-12-26 10:15:29,148][123091] Updated weights for policy 0, policy_version 1335958 (0.0006) [2023-12-26 10:15:29,200][123091] Updated weights for policy 0, policy_version 1335968 (0.0005) [2023-12-26 10:15:29,271][123091] Updated weights for policy 0, policy_version 1335978 (0.0008) [2023-12-26 10:15:29,417][123090] Updated weights for policy 1, policy_version 1326534 (0.0007) [2023-12-26 10:15:29,484][123090] Updated weights for policy 1, policy_version 1326544 (0.0005) [2023-12-26 10:15:29,550][123090] Updated weights for policy 1, policy_version 1326554 (0.0005) [2023-12-26 10:15:29,925][123091] Updated weights for policy 0, policy_version 1335988 (0.0007) [2023-12-26 10:15:29,991][123091] Updated weights for policy 0, policy_version 1335998 (0.0008) [2023-12-26 10:15:30,058][123091] Updated weights for policy 0, policy_version 1336008 (0.0010) [2023-12-26 10:15:30,250][123090] Updated weights for policy 1, policy_version 1326564 (0.0006) [2023-12-26 10:15:30,308][123090] Updated weights for policy 1, policy_version 1326574 (0.0006) [2023-12-26 10:15:30,367][123090] Updated weights for policy 1, policy_version 1326584 (0.0006) [2023-12-26 10:15:30,885][123091] Updated weights for policy 0, policy_version 1336018 (0.0010) [2023-12-26 10:15:30,943][123091] Updated weights for policy 0, policy_version 1336028 (0.0009) [2023-12-26 10:15:31,004][123091] Updated weights for policy 0, policy_version 1336038 (0.0008) [2023-12-26 10:15:31,060][123090] Updated weights for policy 1, policy_version 1326594 (0.0007) [2023-12-26 10:15:31,067][123091] Updated weights for policy 0, policy_version 1336048 (0.0008) [2023-12-26 10:15:31,120][123090] Updated weights for policy 1, policy_version 1326604 (0.0010) [2023-12-26 10:15:31,190][123090] Updated weights for policy 1, policy_version 1326614 (0.0010) [2023-12-26 10:15:31,258][123090] Updated weights for policy 1, policy_version 1326624 (0.0008) [2023-12-26 10:15:31,947][123091] Updated weights for policy 0, policy_version 1336058 (0.0009) [2023-12-26 10:15:32,015][123091] Updated weights for policy 0, policy_version 1336068 (0.0009) [2023-12-26 10:15:32,057][123090] Updated weights for policy 1, policy_version 1326634 (0.0010) [2023-12-26 10:15:32,076][123091] Updated weights for policy 0, policy_version 1336078 (0.0008) [2023-12-26 10:15:32,116][123090] Updated weights for policy 1, policy_version 1326644 (0.0010) [2023-12-26 10:15:32,172][123090] Updated weights for policy 1, policy_version 1326654 (0.0010) [2023-12-26 10:15:32,903][123091] Updated weights for policy 0, policy_version 1336088 (0.0008) [2023-12-26 10:15:32,959][123091] Updated weights for policy 0, policy_version 1336098 (0.0009) [2023-12-26 10:15:33,003][123090] Updated weights for policy 1, policy_version 1326664 (0.0009) [2023-12-26 10:15:33,022][123091] Updated weights for policy 0, policy_version 1336108 (0.0008) [2023-12-26 10:15:33,064][123090] Updated weights for policy 1, policy_version 1326674 (0.0007) [2023-12-26 10:15:33,116][123090] Updated weights for policy 1, policy_version 1326684 (0.0008) [2023-12-26 10:15:33,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 681680896. Throughput: 0: 8934.8, 1: 8766.5. Samples: 681697508. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:33,784][123091] Updated weights for policy 0, policy_version 1336118 (0.0009) [2023-12-26 10:15:33,784][121949] Avg episode reward: [(0, '6163.359'), (1, '5323.896')] [2023-12-26 10:15:33,843][123091] Updated weights for policy 0, policy_version 1336128 (0.0010) [2023-12-26 10:15:33,901][123090] Updated weights for policy 1, policy_version 1326694 (0.0008) [2023-12-26 10:15:33,906][123091] Updated weights for policy 0, policy_version 1336138 (0.0011) [2023-12-26 10:15:33,951][123090] Updated weights for policy 1, policy_version 1326704 (0.0008) [2023-12-26 10:15:34,001][123090] Updated weights for policy 1, policy_version 1326714 (0.0008) [2023-12-26 10:15:34,710][123091] Updated weights for policy 0, policy_version 1336148 (0.0010) [2023-12-26 10:15:34,770][123091] Updated weights for policy 0, policy_version 1336158 (0.0009) [2023-12-26 10:15:34,843][123091] Updated weights for policy 0, policy_version 1336168 (0.0009) [2023-12-26 10:15:34,886][123090] Updated weights for policy 1, policy_version 1326724 (0.0009) [2023-12-26 10:15:34,950][123090] Updated weights for policy 1, policy_version 1326734 (0.0010) [2023-12-26 10:15:35,012][123090] Updated weights for policy 1, policy_version 1326744 (0.0010) [2023-12-26 10:15:35,680][123091] Updated weights for policy 0, policy_version 1336179 (0.0010) [2023-12-26 10:15:35,739][123091] Updated weights for policy 0, policy_version 1336190 (0.0010) [2023-12-26 10:15:35,775][123090] Updated weights for policy 1, policy_version 1326754 (0.0009) [2023-12-26 10:15:35,793][123091] Updated weights for policy 0, policy_version 1336200 (0.0009) [2023-12-26 10:15:35,827][123090] Updated weights for policy 1, policy_version 1326764 (0.0005) [2023-12-26 10:15:35,874][123090] Updated weights for policy 1, policy_version 1326774 (0.0005) [2023-12-26 10:15:35,923][123090] Updated weights for policy 1, policy_version 1326784 (0.0005) [2023-12-26 10:15:36,702][123091] Updated weights for policy 0, policy_version 1336210 (0.0008) [2023-12-26 10:15:36,755][123090] Updated weights for policy 1, policy_version 1326794 (0.0010) [2023-12-26 10:15:36,762][123091] Updated weights for policy 0, policy_version 1336220 (0.0007) [2023-12-26 10:15:36,803][123090] Updated weights for policy 1, policy_version 1326804 (0.0010) [2023-12-26 10:15:36,823][123091] Updated weights for policy 0, policy_version 1336230 (0.0007) [2023-12-26 10:15:36,856][123090] Updated weights for policy 1, policy_version 1326814 (0.0010) [2023-12-26 10:15:36,885][123091] Updated weights for policy 0, policy_version 1336240 (0.0007) [2023-12-26 10:15:37,679][123091] Updated weights for policy 0, policy_version 1336250 (0.0009) [2023-12-26 10:15:37,692][123090] Updated weights for policy 1, policy_version 1326824 (0.0006) [2023-12-26 10:15:37,733][123091] Updated weights for policy 0, policy_version 1336260 (0.0009) [2023-12-26 10:15:37,755][123090] Updated weights for policy 1, policy_version 1326834 (0.0006) [2023-12-26 10:15:37,786][123091] Updated weights for policy 0, policy_version 1336270 (0.0008) [2023-12-26 10:15:37,803][123090] Updated weights for policy 1, policy_version 1326844 (0.0005) [2023-12-26 10:15:38,529][123090] Updated weights for policy 1, policy_version 1326854 (0.0007) [2023-12-26 10:15:38,569][123091] Updated weights for policy 0, policy_version 1336280 (0.0011) [2023-12-26 10:15:38,583][123090] Updated weights for policy 1, policy_version 1326864 (0.0009) [2023-12-26 10:15:38,632][123091] Updated weights for policy 0, policy_version 1336290 (0.0011) [2023-12-26 10:15:38,640][123090] Updated weights for policy 1, policy_version 1326874 (0.0005) [2023-12-26 10:15:38,693][123091] Updated weights for policy 0, policy_version 1336300 (0.0011) [2023-12-26 10:15:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 681779200. Throughput: 0: 8952.1, 1: 8751.2. Samples: 681749132. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:38,785][121949] Avg episode reward: [(0, '6055.727'), (1, '5381.121')] [2023-12-26 10:15:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001336304_342097920.pth... [2023-12-26 10:15:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001326880_339681280.pth... [2023-12-26 10:15:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001335248_341827584.pth [2023-12-26 10:15:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001325856_339419136.pth [2023-12-26 10:15:39,333][123090] Updated weights for policy 1, policy_version 1326884 (0.0007) [2023-12-26 10:15:39,402][123090] Updated weights for policy 1, policy_version 1326894 (0.0008) [2023-12-26 10:15:39,471][123090] Updated weights for policy 1, policy_version 1326904 (0.0009) [2023-12-26 10:15:39,551][123091] Updated weights for policy 0, policy_version 1336310 (0.0008) [2023-12-26 10:15:39,603][123091] Updated weights for policy 0, policy_version 1336320 (0.0006) [2023-12-26 10:15:39,653][123091] Updated weights for policy 0, policy_version 1336330 (0.0006) [2023-12-26 10:15:40,348][123090] Updated weights for policy 1, policy_version 1326914 (0.0008) [2023-12-26 10:15:40,405][123090] Updated weights for policy 1, policy_version 1326924 (0.0008) [2023-12-26 10:15:40,457][123090] Updated weights for policy 1, policy_version 1326934 (0.0009) [2023-12-26 10:15:40,475][123091] Updated weights for policy 0, policy_version 1336340 (0.0010) [2023-12-26 10:15:40,526][123090] Updated weights for policy 1, policy_version 1326944 (0.0007) [2023-12-26 10:15:40,532][123091] Updated weights for policy 0, policy_version 1336350 (0.0011) [2023-12-26 10:15:40,593][123091] Updated weights for policy 0, policy_version 1336360 (0.0011) [2023-12-26 10:15:41,397][123090] Updated weights for policy 1, policy_version 1326954 (0.0009) [2023-12-26 10:15:41,439][123091] Updated weights for policy 0, policy_version 1336370 (0.0010) [2023-12-26 10:15:41,461][123090] Updated weights for policy 1, policy_version 1326964 (0.0009) [2023-12-26 10:15:41,489][123091] Updated weights for policy 0, policy_version 1336380 (0.0007) [2023-12-26 10:15:41,526][123090] Updated weights for policy 1, policy_version 1326974 (0.0008) [2023-12-26 10:15:41,555][123091] Updated weights for policy 0, policy_version 1336390 (0.0008) [2023-12-26 10:15:41,634][123091] Updated weights for policy 0, policy_version 1336400 (0.0009) [2023-12-26 10:15:42,422][123090] Updated weights for policy 1, policy_version 1326984 (0.0009) [2023-12-26 10:15:42,447][123091] Updated weights for policy 0, policy_version 1336410 (0.0006) [2023-12-26 10:15:42,485][123090] Updated weights for policy 1, policy_version 1326994 (0.0007) [2023-12-26 10:15:42,501][123091] Updated weights for policy 0, policy_version 1336420 (0.0009) [2023-12-26 10:15:42,552][123090] Updated weights for policy 1, policy_version 1327004 (0.0008) [2023-12-26 10:15:42,565][123091] Updated weights for policy 0, policy_version 1336430 (0.0009) [2023-12-26 10:15:43,362][123091] Updated weights for policy 0, policy_version 1336440 (0.0009) [2023-12-26 10:15:43,410][123090] Updated weights for policy 1, policy_version 1327014 (0.0008) [2023-12-26 10:15:43,412][123091] Updated weights for policy 0, policy_version 1336450 (0.0009) [2023-12-26 10:15:43,474][123090] Updated weights for policy 1, policy_version 1327024 (0.0008) [2023-12-26 10:15:43,479][123091] Updated weights for policy 0, policy_version 1336460 (0.0008) [2023-12-26 10:15:43,540][123090] Updated weights for policy 1, policy_version 1327034 (0.0008) [2023-12-26 10:15:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 681861120. Throughput: 0: 8895.8, 1: 8687.6. Samples: 681851600. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:43,785][121949] Avg episode reward: [(0, '6168.148'), (1, '5408.064')] [2023-12-26 10:15:44,296][123091] Updated weights for policy 0, policy_version 1336470 (0.0010) [2023-12-26 10:15:44,347][123090] Updated weights for policy 1, policy_version 1327044 (0.0008) [2023-12-26 10:15:44,357][123091] Updated weights for policy 0, policy_version 1336480 (0.0008) [2023-12-26 10:15:44,395][123090] Updated weights for policy 1, policy_version 1327054 (0.0006) [2023-12-26 10:15:44,416][123091] Updated weights for policy 0, policy_version 1336490 (0.0008) [2023-12-26 10:15:44,450][123090] Updated weights for policy 1, policy_version 1327064 (0.0009) [2023-12-26 10:15:45,286][123091] Updated weights for policy 0, policy_version 1336500 (0.0007) [2023-12-26 10:15:45,323][123090] Updated weights for policy 1, policy_version 1327074 (0.0010) [2023-12-26 10:15:45,360][123091] Updated weights for policy 0, policy_version 1336510 (0.0006) [2023-12-26 10:15:45,384][123090] Updated weights for policy 1, policy_version 1327084 (0.0011) [2023-12-26 10:15:45,430][123091] Updated weights for policy 0, policy_version 1336520 (0.0006) [2023-12-26 10:15:45,440][123090] Updated weights for policy 1, policy_version 1327094 (0.0010) [2023-12-26 10:15:45,504][123090] Updated weights for policy 1, policy_version 1327104 (0.0010) [2023-12-26 10:15:46,075][123091] Updated weights for policy 0, policy_version 1336530 (0.0006) [2023-12-26 10:15:46,143][123091] Updated weights for policy 0, policy_version 1336540 (0.0005) [2023-12-26 10:15:46,199][123091] Updated weights for policy 0, policy_version 1336550 (0.0005) [2023-12-26 10:15:46,247][123090] Updated weights for policy 1, policy_version 1327114 (0.0009) [2023-12-26 10:15:46,262][123091] Updated weights for policy 0, policy_version 1336560 (0.0005) [2023-12-26 10:15:46,298][123090] Updated weights for policy 1, policy_version 1327124 (0.0009) [2023-12-26 10:15:46,351][123090] Updated weights for policy 1, policy_version 1327135 (0.0010) [2023-12-26 10:15:46,917][123091] Updated weights for policy 0, policy_version 1336570 (0.0009) [2023-12-26 10:15:46,985][123091] Updated weights for policy 0, policy_version 1336580 (0.0009) [2023-12-26 10:15:47,042][123091] Updated weights for policy 0, policy_version 1336590 (0.0009) [2023-12-26 10:15:47,235][123090] Updated weights for policy 1, policy_version 1327145 (0.0010) [2023-12-26 10:15:47,293][123090] Updated weights for policy 1, policy_version 1327155 (0.0006) [2023-12-26 10:15:47,351][123090] Updated weights for policy 1, policy_version 1327165 (0.0007) [2023-12-26 10:15:47,864][123091] Updated weights for policy 0, policy_version 1336600 (0.0009) [2023-12-26 10:15:47,916][123091] Updated weights for policy 0, policy_version 1336610 (0.0009) [2023-12-26 10:15:47,973][123091] Updated weights for policy 0, policy_version 1336620 (0.0009) [2023-12-26 10:15:48,213][123090] Updated weights for policy 1, policy_version 1327175 (0.0009) [2023-12-26 10:15:48,265][123090] Updated weights for policy 1, policy_version 1327185 (0.0010) [2023-12-26 10:15:48,320][123090] Updated weights for policy 1, policy_version 1327197 (0.0010) [2023-12-26 10:15:48,755][123091] Updated weights for policy 0, policy_version 1336630 (0.0009) [2023-12-26 10:15:48,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 681943040. Throughput: 0: 8899.1, 1: 8657.2. Samples: 681957840. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:48,784][121949] Avg episode reward: [(0, '6206.685'), (1, '5430.286')] [2023-12-26 10:15:48,820][123091] Updated weights for policy 0, policy_version 1336640 (0.0009) [2023-12-26 10:15:48,891][123091] Updated weights for policy 0, policy_version 1336650 (0.0010) [2023-12-26 10:15:49,135][123090] Updated weights for policy 1, policy_version 1327207 (0.0007) [2023-12-26 10:15:49,189][123090] Updated weights for policy 1, policy_version 1327217 (0.0005) [2023-12-26 10:15:49,249][123090] Updated weights for policy 1, policy_version 1327227 (0.0009) [2023-12-26 10:15:49,732][123091] Updated weights for policy 0, policy_version 1336660 (0.0008) [2023-12-26 10:15:49,799][123091] Updated weights for policy 0, policy_version 1336670 (0.0006) [2023-12-26 10:15:49,870][123091] Updated weights for policy 0, policy_version 1336680 (0.0009) [2023-12-26 10:15:50,105][123090] Updated weights for policy 1, policy_version 1327237 (0.0008) [2023-12-26 10:15:50,168][123090] Updated weights for policy 1, policy_version 1327247 (0.0006) [2023-12-26 10:15:50,223][123090] Updated weights for policy 1, policy_version 1327257 (0.0005) [2023-12-26 10:15:50,595][123091] Updated weights for policy 0, policy_version 1336690 (0.0008) [2023-12-26 10:15:50,666][123091] Updated weights for policy 0, policy_version 1336700 (0.0009) [2023-12-26 10:15:50,730][123091] Updated weights for policy 0, policy_version 1336710 (0.0010) [2023-12-26 10:15:50,802][123091] Updated weights for policy 0, policy_version 1336720 (0.0010) [2023-12-26 10:15:50,928][123090] Updated weights for policy 1, policy_version 1327267 (0.0007) [2023-12-26 10:15:50,997][123090] Updated weights for policy 1, policy_version 1327277 (0.0009) [2023-12-26 10:15:51,066][123090] Updated weights for policy 1, policy_version 1327287 (0.0010) [2023-12-26 10:15:51,621][123091] Updated weights for policy 0, policy_version 1336730 (0.0009) [2023-12-26 10:15:51,686][123091] Updated weights for policy 0, policy_version 1336740 (0.0009) [2023-12-26 10:15:51,762][123091] Updated weights for policy 0, policy_version 1336750 (0.0009) [2023-12-26 10:15:51,905][123090] Updated weights for policy 1, policy_version 1327297 (0.0010) [2023-12-26 10:15:51,973][123090] Updated weights for policy 1, policy_version 1327307 (0.0008) [2023-12-26 10:15:52,031][123090] Updated weights for policy 1, policy_version 1327317 (0.0008) [2023-12-26 10:15:52,085][123090] Updated weights for policy 1, policy_version 1327327 (0.0009) [2023-12-26 10:15:52,567][123091] Updated weights for policy 0, policy_version 1336760 (0.0008) [2023-12-26 10:15:52,623][123091] Updated weights for policy 0, policy_version 1336770 (0.0009) [2023-12-26 10:15:52,686][123091] Updated weights for policy 0, policy_version 1336780 (0.0009) [2023-12-26 10:15:52,907][123090] Updated weights for policy 1, policy_version 1327337 (0.0009) [2023-12-26 10:15:52,954][123090] Updated weights for policy 1, policy_version 1327347 (0.0009) [2023-12-26 10:15:53,007][123090] Updated weights for policy 1, policy_version 1327358 (0.0010) [2023-12-26 10:15:53,486][123091] Updated weights for policy 0, policy_version 1336790 (0.0007) [2023-12-26 10:15:53,535][123091] Updated weights for policy 0, policy_version 1336800 (0.0005) [2023-12-26 10:15:53,582][123091] Updated weights for policy 0, policy_version 1336810 (0.0005) [2023-12-26 10:15:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 682033152. Throughput: 0: 8899.3, 1: 8662.9. Samples: 682010760. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:53,785][121949] Avg episode reward: [(0, '6274.777'), (1, '5335.382')] [2023-12-26 10:15:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001336816_342228992.pth... [2023-12-26 10:15:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001335760_341958656.pth [2023-12-26 10:15:53,799][123090] Updated weights for policy 1, policy_version 1327368 (0.0010) [2023-12-26 10:15:53,848][123090] Updated weights for policy 1, policy_version 1327378 (0.0009) [2023-12-26 10:15:53,904][123090] Updated weights for policy 1, policy_version 1327388 (0.0010) [2023-12-26 10:15:53,922][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001327392_339812352.pth... [2023-12-26 10:15:53,925][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001326368_339550208.pth [2023-12-26 10:15:54,364][123091] Updated weights for policy 0, policy_version 1336820 (0.0007) [2023-12-26 10:15:54,414][123091] Updated weights for policy 0, policy_version 1336830 (0.0009) [2023-12-26 10:15:54,464][123091] Updated weights for policy 0, policy_version 1336840 (0.0009) [2023-12-26 10:15:54,731][123090] Updated weights for policy 1, policy_version 1327398 (0.0007) [2023-12-26 10:15:54,798][123090] Updated weights for policy 1, policy_version 1327408 (0.0005) [2023-12-26 10:15:54,861][123090] Updated weights for policy 1, policy_version 1327418 (0.0005) [2023-12-26 10:15:55,341][123091] Updated weights for policy 0, policy_version 1336850 (0.0009) [2023-12-26 10:15:55,397][123091] Updated weights for policy 0, policy_version 1336860 (0.0009) [2023-12-26 10:15:55,449][123091] Updated weights for policy 0, policy_version 1336870 (0.0009) [2023-12-26 10:15:55,499][123091] Updated weights for policy 0, policy_version 1336880 (0.0008) [2023-12-26 10:15:55,586][123090] Updated weights for policy 1, policy_version 1327428 (0.0007) [2023-12-26 10:15:55,640][123090] Updated weights for policy 1, policy_version 1327438 (0.0010) [2023-12-26 10:15:55,688][123090] Updated weights for policy 1, policy_version 1327448 (0.0005) [2023-12-26 10:15:56,349][123091] Updated weights for policy 0, policy_version 1336890 (0.0009) [2023-12-26 10:15:56,411][123091] Updated weights for policy 0, policy_version 1336900 (0.0008) [2023-12-26 10:15:56,442][123090] Updated weights for policy 1, policy_version 1327458 (0.0006) [2023-12-26 10:15:56,474][123091] Updated weights for policy 0, policy_version 1336910 (0.0007) [2023-12-26 10:15:56,497][123090] Updated weights for policy 1, policy_version 1327469 (0.0009) [2023-12-26 10:15:56,563][123090] Updated weights for policy 1, policy_version 1327479 (0.0005) [2023-12-26 10:15:57,206][123090] Updated weights for policy 1, policy_version 1327489 (0.0005) [2023-12-26 10:15:57,266][123090] Updated weights for policy 1, policy_version 1327499 (0.0008) [2023-12-26 10:15:57,328][123090] Updated weights for policy 1, policy_version 1327509 (0.0007) [2023-12-26 10:15:57,346][123091] Updated weights for policy 0, policy_version 1336921 (0.0008) [2023-12-26 10:15:57,381][123090] Updated weights for policy 1, policy_version 1327519 (0.0006) [2023-12-26 10:15:57,399][123091] Updated weights for policy 0, policy_version 1336931 (0.0009) [2023-12-26 10:15:57,455][123091] Updated weights for policy 0, policy_version 1336941 (0.0009) [2023-12-26 10:15:58,106][123090] Updated weights for policy 1, policy_version 1327529 (0.0009) [2023-12-26 10:15:58,175][123090] Updated weights for policy 1, policy_version 1327539 (0.0010) [2023-12-26 10:15:58,240][123090] Updated weights for policy 1, policy_version 1327549 (0.0010) [2023-12-26 10:15:58,343][123091] Updated weights for policy 0, policy_version 1336951 (0.0010) [2023-12-26 10:15:58,414][123091] Updated weights for policy 0, policy_version 1336961 (0.0008) [2023-12-26 10:15:58,479][123091] Updated weights for policy 0, policy_version 1336971 (0.0010) [2023-12-26 10:15:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 682123264. Throughput: 0: 8849.3, 1: 8734.7. Samples: 682117556. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:15:58,785][121949] Avg episode reward: [(0, '6374.482'), (1, '5490.223')] [2023-12-26 10:15:59,131][123090] Updated weights for policy 1, policy_version 1327559 (0.0009) [2023-12-26 10:15:59,198][123090] Updated weights for policy 1, policy_version 1327569 (0.0006) [2023-12-26 10:15:59,270][123090] Updated weights for policy 1, policy_version 1327579 (0.0007) [2023-12-26 10:15:59,332][123091] Updated weights for policy 0, policy_version 1336981 (0.0009) [2023-12-26 10:15:59,398][123091] Updated weights for policy 0, policy_version 1336991 (0.0008) [2023-12-26 10:15:59,467][123091] Updated weights for policy 0, policy_version 1337001 (0.0005) [2023-12-26 10:16:00,043][123090] Updated weights for policy 1, policy_version 1327589 (0.0011) [2023-12-26 10:16:00,106][123090] Updated weights for policy 1, policy_version 1327599 (0.0010) [2023-12-26 10:16:00,157][123091] Updated weights for policy 0, policy_version 1337011 (0.0006) [2023-12-26 10:16:00,169][123090] Updated weights for policy 1, policy_version 1327609 (0.0008) [2023-12-26 10:16:00,219][123091] Updated weights for policy 0, policy_version 1337021 (0.0008) [2023-12-26 10:16:00,276][123091] Updated weights for policy 0, policy_version 1337031 (0.0008) [2023-12-26 10:16:00,889][123090] Updated weights for policy 1, policy_version 1327619 (0.0007) [2023-12-26 10:16:00,946][123090] Updated weights for policy 1, policy_version 1327629 (0.0005) [2023-12-26 10:16:01,000][123090] Updated weights for policy 1, policy_version 1327639 (0.0010) [2023-12-26 10:16:01,074][123091] Updated weights for policy 0, policy_version 1337041 (0.0008) [2023-12-26 10:16:01,132][123091] Updated weights for policy 0, policy_version 1337051 (0.0011) [2023-12-26 10:16:01,202][123091] Updated weights for policy 0, policy_version 1337061 (0.0011) [2023-12-26 10:16:01,268][123091] Updated weights for policy 0, policy_version 1337071 (0.0010) [2023-12-26 10:16:01,814][123090] Updated weights for policy 1, policy_version 1327649 (0.0008) [2023-12-26 10:16:01,878][123090] Updated weights for policy 1, policy_version 1327659 (0.0010) [2023-12-26 10:16:01,944][123090] Updated weights for policy 1, policy_version 1327669 (0.0009) [2023-12-26 10:16:02,016][123090] Updated weights for policy 1, policy_version 1327679 (0.0009) [2023-12-26 10:16:02,056][123091] Updated weights for policy 0, policy_version 1337081 (0.0007) [2023-12-26 10:16:02,125][123091] Updated weights for policy 0, policy_version 1337091 (0.0007) [2023-12-26 10:16:02,191][123091] Updated weights for policy 0, policy_version 1337101 (0.0008) [2023-12-26 10:16:02,882][123091] Updated weights for policy 0, policy_version 1337111 (0.0007) [2023-12-26 10:16:02,919][123090] Updated weights for policy 1, policy_version 1327689 (0.0009) [2023-12-26 10:16:02,944][123091] Updated weights for policy 0, policy_version 1337121 (0.0008) [2023-12-26 10:16:02,980][123090] Updated weights for policy 1, policy_version 1327699 (0.0009) [2023-12-26 10:16:03,003][123091] Updated weights for policy 0, policy_version 1337131 (0.0005) [2023-12-26 10:16:03,030][123090] Updated weights for policy 1, policy_version 1327709 (0.0009) [2023-12-26 10:16:03,703][123091] Updated weights for policy 0, policy_version 1337141 (0.0006) [2023-12-26 10:16:03,752][123090] Updated weights for policy 1, policy_version 1327719 (0.0006) [2023-12-26 10:16:03,762][123091] Updated weights for policy 0, policy_version 1337151 (0.0008) [2023-12-26 10:16:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 682205184. Throughput: 0: 8857.1, 1: 8638.6. Samples: 682224464. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:03,784][121949] Avg episode reward: [(0, '6216.833'), (1, '5413.822')] [2023-12-26 10:16:03,802][123090] Updated weights for policy 1, policy_version 1327729 (0.0005) [2023-12-26 10:16:03,822][123091] Updated weights for policy 0, policy_version 1337161 (0.0009) [2023-12-26 10:16:03,864][123090] Updated weights for policy 1, policy_version 1327739 (0.0007) [2023-12-26 10:16:04,657][123091] Updated weights for policy 0, policy_version 1337171 (0.0011) [2023-12-26 10:16:04,698][123090] Updated weights for policy 1, policy_version 1327749 (0.0007) [2023-12-26 10:16:04,713][123091] Updated weights for policy 0, policy_version 1337181 (0.0010) [2023-12-26 10:16:04,746][123090] Updated weights for policy 1, policy_version 1327759 (0.0006) [2023-12-26 10:16:04,768][123091] Updated weights for policy 0, policy_version 1337191 (0.0008) [2023-12-26 10:16:04,803][123090] Updated weights for policy 1, policy_version 1327769 (0.0009) [2023-12-26 10:16:05,452][123091] Updated weights for policy 0, policy_version 1337201 (0.0006) [2023-12-26 10:16:05,522][123091] Updated weights for policy 0, policy_version 1337211 (0.0006) [2023-12-26 10:16:05,594][123091] Updated weights for policy 0, policy_version 1337221 (0.0007) [2023-12-26 10:16:05,647][123091] Updated weights for policy 0, policy_version 1337231 (0.0009) [2023-12-26 10:16:05,698][123090] Updated weights for policy 1, policy_version 1327779 (0.0009) [2023-12-26 10:16:05,771][123090] Updated weights for policy 1, policy_version 1327789 (0.0010) [2023-12-26 10:16:05,826][123090] Updated weights for policy 1, policy_version 1327799 (0.0010) [2023-12-26 10:16:06,429][123091] Updated weights for policy 0, policy_version 1337241 (0.0009) [2023-12-26 10:16:06,499][123091] Updated weights for policy 0, policy_version 1337251 (0.0009) [2023-12-26 10:16:06,554][123090] Updated weights for policy 1, policy_version 1327809 (0.0010) [2023-12-26 10:16:06,560][123091] Updated weights for policy 0, policy_version 1337261 (0.0009) [2023-12-26 10:16:06,619][123090] Updated weights for policy 1, policy_version 1327819 (0.0010) [2023-12-26 10:16:06,674][123090] Updated weights for policy 1, policy_version 1327829 (0.0009) [2023-12-26 10:16:06,731][123090] Updated weights for policy 1, policy_version 1327839 (0.0009) [2023-12-26 10:16:07,304][123091] Updated weights for policy 0, policy_version 1337271 (0.0009) [2023-12-26 10:16:07,365][123091] Updated weights for policy 0, policy_version 1337281 (0.0009) [2023-12-26 10:16:07,428][123091] Updated weights for policy 0, policy_version 1337291 (0.0009) [2023-12-26 10:16:07,596][123090] Updated weights for policy 1, policy_version 1327849 (0.0006) [2023-12-26 10:16:07,647][123090] Updated weights for policy 1, policy_version 1327859 (0.0006) [2023-12-26 10:16:07,697][123090] Updated weights for policy 1, policy_version 1327869 (0.0005) [2023-12-26 10:16:08,270][123091] Updated weights for policy 0, policy_version 1337301 (0.0010) [2023-12-26 10:16:08,290][123090] Updated weights for policy 1, policy_version 1327879 (0.0005) [2023-12-26 10:16:08,334][123091] Updated weights for policy 0, policy_version 1337311 (0.0008) [2023-12-26 10:16:08,359][123090] Updated weights for policy 1, policy_version 1327889 (0.0007) [2023-12-26 10:16:08,405][123091] Updated weights for policy 0, policy_version 1337321 (0.0009) [2023-12-26 10:16:08,415][123090] Updated weights for policy 1, policy_version 1327899 (0.0008) [2023-12-26 10:16:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 682303488. Throughput: 0: 8877.0, 1: 8696.7. Samples: 682276416. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:08,785][121949] Avg episode reward: [(0, '6162.170'), (1, '5161.510')] [2023-12-26 10:16:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001337328_342360064.pth... [2023-12-26 10:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001327904_339943424.pth... [2023-12-26 10:16:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001326880_339681280.pth [2023-12-26 10:16:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001336304_342097920.pth [2023-12-26 10:16:09,174][123090] Updated weights for policy 1, policy_version 1327909 (0.0007) [2023-12-26 10:16:09,234][123090] Updated weights for policy 1, policy_version 1327919 (0.0007) [2023-12-26 10:16:09,299][123091] Updated weights for policy 0, policy_version 1337331 (0.0007) [2023-12-26 10:16:09,302][123090] Updated weights for policy 1, policy_version 1327929 (0.0009) [2023-12-26 10:16:09,363][123091] Updated weights for policy 0, policy_version 1337341 (0.0010) [2023-12-26 10:16:09,434][123091] Updated weights for policy 0, policy_version 1337351 (0.0009) [2023-12-26 10:16:10,158][123090] Updated weights for policy 1, policy_version 1327939 (0.0007) [2023-12-26 10:16:10,229][123090] Updated weights for policy 1, policy_version 1327949 (0.0009) [2023-12-26 10:16:10,273][123091] Updated weights for policy 0, policy_version 1337361 (0.0009) [2023-12-26 10:16:10,297][123090] Updated weights for policy 1, policy_version 1327959 (0.0011) [2023-12-26 10:16:10,326][123091] Updated weights for policy 0, policy_version 1337371 (0.0006) [2023-12-26 10:16:10,382][123091] Updated weights for policy 0, policy_version 1337381 (0.0009) [2023-12-26 10:16:10,436][123091] Updated weights for policy 0, policy_version 1337391 (0.0009) [2023-12-26 10:16:11,109][123090] Updated weights for policy 1, policy_version 1327969 (0.0010) [2023-12-26 10:16:11,186][123090] Updated weights for policy 1, policy_version 1327979 (0.0011) [2023-12-26 10:16:11,254][123090] Updated weights for policy 1, policy_version 1327989 (0.0011) [2023-12-26 10:16:11,259][123091] Updated weights for policy 0, policy_version 1337401 (0.0009) [2023-12-26 10:16:11,320][123090] Updated weights for policy 1, policy_version 1327999 (0.0011) [2023-12-26 10:16:11,323][123091] Updated weights for policy 0, policy_version 1337411 (0.0007) [2023-12-26 10:16:11,396][123091] Updated weights for policy 0, policy_version 1337421 (0.0009) [2023-12-26 10:16:12,160][123090] Updated weights for policy 1, policy_version 1328009 (0.0010) [2023-12-26 10:16:12,213][123091] Updated weights for policy 0, policy_version 1337431 (0.0009) [2023-12-26 10:16:12,225][123090] Updated weights for policy 1, policy_version 1328019 (0.0009) [2023-12-26 10:16:12,270][123091] Updated weights for policy 0, policy_version 1337441 (0.0009) [2023-12-26 10:16:12,297][123090] Updated weights for policy 1, policy_version 1328029 (0.0008) [2023-12-26 10:16:12,353][123091] Updated weights for policy 0, policy_version 1337451 (0.0009) [2023-12-26 10:16:13,070][123090] Updated weights for policy 1, policy_version 1328039 (0.0007) [2023-12-26 10:16:13,129][123090] Updated weights for policy 1, policy_version 1328049 (0.0009) [2023-12-26 10:16:13,189][123090] Updated weights for policy 1, policy_version 1328059 (0.0009) [2023-12-26 10:16:13,189][123091] Updated weights for policy 0, policy_version 1337461 (0.0010) [2023-12-26 10:16:13,257][123091] Updated weights for policy 0, policy_version 1337471 (0.0011) [2023-12-26 10:16:13,323][123091] Updated weights for policy 0, policy_version 1337481 (0.0011) [2023-12-26 10:16:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 682385408. Throughput: 0: 8773.5, 1: 8783.3. Samples: 682379664. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:13,785][121949] Avg episode reward: [(0, '6160.572'), (1, '5300.953')] [2023-12-26 10:16:14,030][123090] Updated weights for policy 1, policy_version 1328069 (0.0009) [2023-12-26 10:16:14,080][123090] Updated weights for policy 1, policy_version 1328079 (0.0009) [2023-12-26 10:16:14,120][123091] Updated weights for policy 0, policy_version 1337491 (0.0011) [2023-12-26 10:16:14,140][123090] Updated weights for policy 1, policy_version 1328089 (0.0008) [2023-12-26 10:16:14,167][123091] Updated weights for policy 0, policy_version 1337501 (0.0010) [2023-12-26 10:16:14,214][123091] Updated weights for policy 0, policy_version 1337511 (0.0010) [2023-12-26 10:16:14,975][123091] Updated weights for policy 0, policy_version 1337521 (0.0010) [2023-12-26 10:16:14,987][123090] Updated weights for policy 1, policy_version 1328099 (0.0006) [2023-12-26 10:16:15,034][123091] Updated weights for policy 0, policy_version 1337531 (0.0010) [2023-12-26 10:16:15,057][123090] Updated weights for policy 1, policy_version 1328109 (0.0011) [2023-12-26 10:16:15,087][123091] Updated weights for policy 0, policy_version 1337541 (0.0011) [2023-12-26 10:16:15,125][123090] Updated weights for policy 1, policy_version 1328119 (0.0011) [2023-12-26 10:16:15,151][123091] Updated weights for policy 0, policy_version 1337551 (0.0011) [2023-12-26 10:16:15,916][123090] Updated weights for policy 1, policy_version 1328129 (0.0011) [2023-12-26 10:16:15,938][123091] Updated weights for policy 0, policy_version 1337561 (0.0011) [2023-12-26 10:16:15,972][123090] Updated weights for policy 1, policy_version 1328139 (0.0010) [2023-12-26 10:16:16,005][123091] Updated weights for policy 0, policy_version 1337571 (0.0011) [2023-12-26 10:16:16,025][123090] Updated weights for policy 1, policy_version 1328149 (0.0010) [2023-12-26 10:16:16,065][123091] Updated weights for policy 0, policy_version 1337581 (0.0009) [2023-12-26 10:16:16,073][123090] Updated weights for policy 1, policy_version 1328159 (0.0010) [2023-12-26 10:16:16,752][123091] Updated weights for policy 0, policy_version 1337591 (0.0005) [2023-12-26 10:16:16,825][123091] Updated weights for policy 0, policy_version 1337601 (0.0008) [2023-12-26 10:16:16,869][123091] Updated weights for policy 0, policy_version 1337611 (0.0010) [2023-12-26 10:16:16,924][123090] Updated weights for policy 1, policy_version 1328169 (0.0010) [2023-12-26 10:16:16,982][123090] Updated weights for policy 1, policy_version 1328179 (0.0010) [2023-12-26 10:16:17,055][123090] Updated weights for policy 1, policy_version 1328189 (0.0010) [2023-12-26 10:16:17,548][123091] Updated weights for policy 0, policy_version 1337621 (0.0010) [2023-12-26 10:16:17,600][123091] Updated weights for policy 0, policy_version 1337631 (0.0009) [2023-12-26 10:16:17,651][123091] Updated weights for policy 0, policy_version 1337641 (0.0009) [2023-12-26 10:16:17,863][123090] Updated weights for policy 1, policy_version 1328199 (0.0010) [2023-12-26 10:16:17,911][123090] Updated weights for policy 1, policy_version 1328209 (0.0010) [2023-12-26 10:16:17,958][123090] Updated weights for policy 1, policy_version 1328219 (0.0010) [2023-12-26 10:16:18,516][123091] Updated weights for policy 0, policy_version 1337651 (0.0008) [2023-12-26 10:16:18,569][123091] Updated weights for policy 0, policy_version 1337661 (0.0009) [2023-12-26 10:16:18,622][123091] Updated weights for policy 0, policy_version 1337671 (0.0008) [2023-12-26 10:16:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 682475520. Throughput: 0: 8775.3, 1: 8754.3. Samples: 682486340. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:18,785][121949] Avg episode reward: [(0, '6206.399'), (1, '5472.262')] [2023-12-26 10:16:18,824][123090] Updated weights for policy 1, policy_version 1328229 (0.0010) [2023-12-26 10:16:18,885][123090] Updated weights for policy 1, policy_version 1328239 (0.0011) [2023-12-26 10:16:18,944][123090] Updated weights for policy 1, policy_version 1328249 (0.0010) [2023-12-26 10:16:19,504][123091] Updated weights for policy 0, policy_version 1337681 (0.0009) [2023-12-26 10:16:19,563][123091] Updated weights for policy 0, policy_version 1337691 (0.0010) [2023-12-26 10:16:19,622][123091] Updated weights for policy 0, policy_version 1337701 (0.0009) [2023-12-26 10:16:19,675][123091] Updated weights for policy 0, policy_version 1337711 (0.0011) [2023-12-26 10:16:19,806][123090] Updated weights for policy 1, policy_version 1328259 (0.0009) [2023-12-26 10:16:19,880][123090] Updated weights for policy 1, policy_version 1328269 (0.0008) [2023-12-26 10:16:19,946][123090] Updated weights for policy 1, policy_version 1328279 (0.0009) [2023-12-26 10:16:20,539][123091] Updated weights for policy 0, policy_version 1337721 (0.0011) [2023-12-26 10:16:20,603][123091] Updated weights for policy 0, policy_version 1337731 (0.0010) [2023-12-26 10:16:20,671][123091] Updated weights for policy 0, policy_version 1337741 (0.0010) [2023-12-26 10:16:20,688][123090] Updated weights for policy 1, policy_version 1328289 (0.0006) [2023-12-26 10:16:20,752][123090] Updated weights for policy 1, policy_version 1328299 (0.0009) [2023-12-26 10:16:20,813][123090] Updated weights for policy 1, policy_version 1328309 (0.0009) [2023-12-26 10:16:20,862][123090] Updated weights for policy 1, policy_version 1328319 (0.0009) [2023-12-26 10:16:21,460][123091] Updated weights for policy 0, policy_version 1337751 (0.0008) [2023-12-26 10:16:21,528][123091] Updated weights for policy 0, policy_version 1337761 (0.0008) [2023-12-26 10:16:21,594][123091] Updated weights for policy 0, policy_version 1337771 (0.0008) [2023-12-26 10:16:21,707][123090] Updated weights for policy 1, policy_version 1328329 (0.0006) [2023-12-26 10:16:21,782][123090] Updated weights for policy 1, policy_version 1328339 (0.0009) [2023-12-26 10:16:21,844][123090] Updated weights for policy 1, policy_version 1328349 (0.0009) [2023-12-26 10:16:22,328][123091] Updated weights for policy 0, policy_version 1337781 (0.0009) [2023-12-26 10:16:22,397][123091] Updated weights for policy 0, policy_version 1337791 (0.0009) [2023-12-26 10:16:22,453][123091] Updated weights for policy 0, policy_version 1337801 (0.0011) [2023-12-26 10:16:22,661][123090] Updated weights for policy 1, policy_version 1328359 (0.0009) [2023-12-26 10:16:22,723][123090] Updated weights for policy 1, policy_version 1328369 (0.0008) [2023-12-26 10:16:22,772][123090] Updated weights for policy 1, policy_version 1328379 (0.0009) [2023-12-26 10:16:23,260][123091] Updated weights for policy 0, policy_version 1337811 (0.0011) [2023-12-26 10:16:23,318][123091] Updated weights for policy 0, policy_version 1337821 (0.0010) [2023-12-26 10:16:23,373][123091] Updated weights for policy 0, policy_version 1337831 (0.0011) [2023-12-26 10:16:23,632][123090] Updated weights for policy 1, policy_version 1328389 (0.0009) [2023-12-26 10:16:23,695][123090] Updated weights for policy 1, policy_version 1328399 (0.0009) [2023-12-26 10:16:23,749][123090] Updated weights for policy 1, policy_version 1328409 (0.0009) [2023-12-26 10:16:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 682557440. Throughput: 0: 8776.2, 1: 8726.3. Samples: 682536744. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:23,785][121949] Avg episode reward: [(0, '6272.649'), (1, '5266.989')] [2023-12-26 10:16:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001337840_342491136.pth... [2023-12-26 10:16:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001328416_340074496.pth... [2023-12-26 10:16:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001336816_342228992.pth [2023-12-26 10:16:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001327392_339812352.pth [2023-12-26 10:16:24,124][123091] Updated weights for policy 0, policy_version 1337841 (0.0010) [2023-12-26 10:16:24,178][123091] Updated weights for policy 0, policy_version 1337851 (0.0009) [2023-12-26 10:16:24,235][123091] Updated weights for policy 0, policy_version 1337861 (0.0008) [2023-12-26 10:16:24,296][123091] Updated weights for policy 0, policy_version 1337871 (0.0006) [2023-12-26 10:16:24,648][123090] Updated weights for policy 1, policy_version 1328419 (0.0010) [2023-12-26 10:16:24,718][123090] Updated weights for policy 1, policy_version 1328429 (0.0010) [2023-12-26 10:16:24,787][123090] Updated weights for policy 1, policy_version 1328439 (0.0009) [2023-12-26 10:16:24,935][123091] Updated weights for policy 0, policy_version 1337881 (0.0005) [2023-12-26 10:16:24,979][123091] Updated weights for policy 0, policy_version 1337891 (0.0005) [2023-12-26 10:16:25,041][123091] Updated weights for policy 0, policy_version 1337901 (0.0005) [2023-12-26 10:16:25,641][123090] Updated weights for policy 1, policy_version 1328449 (0.0008) [2023-12-26 10:16:25,707][123090] Updated weights for policy 1, policy_version 1328459 (0.0005) [2023-12-26 10:16:25,767][123090] Updated weights for policy 1, policy_version 1328469 (0.0006) [2023-12-26 10:16:25,814][123091] Updated weights for policy 0, policy_version 1337911 (0.0009) [2023-12-26 10:16:25,826][123090] Updated weights for policy 1, policy_version 1328479 (0.0010) [2023-12-26 10:16:25,880][123091] Updated weights for policy 0, policy_version 1337921 (0.0010) [2023-12-26 10:16:25,937][123091] Updated weights for policy 0, policy_version 1337931 (0.0010) [2023-12-26 10:16:26,568][123090] Updated weights for policy 1, policy_version 1328489 (0.0006) [2023-12-26 10:16:26,623][123090] Updated weights for policy 1, policy_version 1328499 (0.0006) [2023-12-26 10:16:26,676][123090] Updated weights for policy 1, policy_version 1328509 (0.0005) [2023-12-26 10:16:26,756][123091] Updated weights for policy 0, policy_version 1337941 (0.0010) [2023-12-26 10:16:26,814][123091] Updated weights for policy 0, policy_version 1337951 (0.0010) [2023-12-26 10:16:26,875][123091] Updated weights for policy 0, policy_version 1337961 (0.0010) [2023-12-26 10:16:27,348][123090] Updated weights for policy 1, policy_version 1328519 (0.0006) [2023-12-26 10:16:27,403][123090] Updated weights for policy 1, policy_version 1328529 (0.0005) [2023-12-26 10:16:27,462][123090] Updated weights for policy 1, policy_version 1328539 (0.0007) [2023-12-26 10:16:27,685][123091] Updated weights for policy 0, policy_version 1337971 (0.0010) [2023-12-26 10:16:27,732][123091] Updated weights for policy 0, policy_version 1337981 (0.0010) [2023-12-26 10:16:27,779][123091] Updated weights for policy 0, policy_version 1337991 (0.0010) [2023-12-26 10:16:28,140][123090] Updated weights for policy 1, policy_version 1328549 (0.0005) [2023-12-26 10:16:28,207][123090] Updated weights for policy 1, policy_version 1328559 (0.0009) [2023-12-26 10:16:28,257][123090] Updated weights for policy 1, policy_version 1328569 (0.0010) [2023-12-26 10:16:28,600][123091] Updated weights for policy 0, policy_version 1338001 (0.0010) [2023-12-26 10:16:28,666][123091] Updated weights for policy 0, policy_version 1338011 (0.0011) [2023-12-26 10:16:28,724][123091] Updated weights for policy 0, policy_version 1338021 (0.0010) [2023-12-26 10:16:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 682647552. Throughput: 0: 8869.8, 1: 8754.2. Samples: 682644680. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:28,784][121949] Avg episode reward: [(0, '6238.436'), (1, '5120.983')] [2023-12-26 10:16:28,786][123091] Updated weights for policy 0, policy_version 1338031 (0.0011) [2023-12-26 10:16:29,066][123090] Updated weights for policy 1, policy_version 1328579 (0.0008) [2023-12-26 10:16:29,128][123090] Updated weights for policy 1, policy_version 1328589 (0.0006) [2023-12-26 10:16:29,173][123090] Updated weights for policy 1, policy_version 1328599 (0.0005) [2023-12-26 10:16:29,631][123091] Updated weights for policy 0, policy_version 1338041 (0.0009) [2023-12-26 10:16:29,683][123091] Updated weights for policy 0, policy_version 1338051 (0.0009) [2023-12-26 10:16:29,732][123091] Updated weights for policy 0, policy_version 1338061 (0.0008) [2023-12-26 10:16:30,017][123090] Updated weights for policy 1, policy_version 1328609 (0.0006) [2023-12-26 10:16:30,079][123090] Updated weights for policy 1, policy_version 1328619 (0.0010) [2023-12-26 10:16:30,133][123090] Updated weights for policy 1, policy_version 1328629 (0.0009) [2023-12-26 10:16:30,186][123090] Updated weights for policy 1, policy_version 1328639 (0.0009) [2023-12-26 10:16:30,502][123091] Updated weights for policy 0, policy_version 1338071 (0.0008) [2023-12-26 10:16:30,547][123091] Updated weights for policy 0, policy_version 1338081 (0.0009) [2023-12-26 10:16:30,596][123091] Updated weights for policy 0, policy_version 1338091 (0.0009) [2023-12-26 10:16:31,074][123090] Updated weights for policy 1, policy_version 1328649 (0.0008) [2023-12-26 10:16:31,140][123090] Updated weights for policy 1, policy_version 1328659 (0.0010) [2023-12-26 10:16:31,197][123090] Updated weights for policy 1, policy_version 1328669 (0.0009) [2023-12-26 10:16:31,516][123091] Updated weights for policy 0, policy_version 1338101 (0.0009) [2023-12-26 10:16:31,564][123091] Updated weights for policy 0, policy_version 1338111 (0.0009) [2023-12-26 10:16:31,622][123091] Updated weights for policy 0, policy_version 1338121 (0.0009) [2023-12-26 10:16:32,047][123090] Updated weights for policy 1, policy_version 1328679 (0.0008) [2023-12-26 10:16:32,116][123090] Updated weights for policy 1, policy_version 1328689 (0.0008) [2023-12-26 10:16:32,179][123090] Updated weights for policy 1, policy_version 1328699 (0.0010) [2023-12-26 10:16:32,479][123091] Updated weights for policy 0, policy_version 1338131 (0.0010) [2023-12-26 10:16:32,532][123091] Updated weights for policy 0, policy_version 1338141 (0.0009) [2023-12-26 10:16:32,584][123091] Updated weights for policy 0, policy_version 1338151 (0.0009) [2023-12-26 10:16:32,975][123090] Updated weights for policy 1, policy_version 1328709 (0.0010) [2023-12-26 10:16:33,025][123090] Updated weights for policy 1, policy_version 1328719 (0.0008) [2023-12-26 10:16:33,084][123090] Updated weights for policy 1, policy_version 1328729 (0.0005) [2023-12-26 10:16:33,451][123091] Updated weights for policy 0, policy_version 1338161 (0.0009) [2023-12-26 10:16:33,498][123091] Updated weights for policy 0, policy_version 1338171 (0.0010) [2023-12-26 10:16:33,545][123091] Updated weights for policy 0, policy_version 1338181 (0.0010) [2023-12-26 10:16:33,592][123091] Updated weights for policy 0, policy_version 1338191 (0.0010) [2023-12-26 10:16:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 682737664. Throughput: 0: 8783.8, 1: 8807.5. Samples: 682749452. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:33,785][121949] Avg episode reward: [(0, '6258.212'), (1, '5022.592')] [2023-12-26 10:16:33,798][123090] Updated weights for policy 1, policy_version 1328739 (0.0007) [2023-12-26 10:16:33,856][123090] Updated weights for policy 1, policy_version 1328749 (0.0010) [2023-12-26 10:16:33,917][123090] Updated weights for policy 1, policy_version 1328759 (0.0009) [2023-12-26 10:16:34,351][123091] Updated weights for policy 0, policy_version 1338201 (0.0008) [2023-12-26 10:16:34,414][123091] Updated weights for policy 0, policy_version 1338211 (0.0008) [2023-12-26 10:16:34,483][123091] Updated weights for policy 0, policy_version 1338221 (0.0008) [2023-12-26 10:16:34,714][123090] Updated weights for policy 1, policy_version 1328769 (0.0006) [2023-12-26 10:16:34,782][123090] Updated weights for policy 1, policy_version 1328779 (0.0011) [2023-12-26 10:16:34,849][123090] Updated weights for policy 1, policy_version 1328789 (0.0007) [2023-12-26 10:16:34,916][123090] Updated weights for policy 1, policy_version 1328799 (0.0011) [2023-12-26 10:16:35,253][123091] Updated weights for policy 0, policy_version 1338231 (0.0008) [2023-12-26 10:16:35,307][123091] Updated weights for policy 0, policy_version 1338241 (0.0006) [2023-12-26 10:16:35,379][123091] Updated weights for policy 0, policy_version 1338251 (0.0007) [2023-12-26 10:16:35,737][123090] Updated weights for policy 1, policy_version 1328809 (0.0010) [2023-12-26 10:16:35,789][123090] Updated weights for policy 1, policy_version 1328819 (0.0010) [2023-12-26 10:16:35,845][123090] Updated weights for policy 1, policy_version 1328829 (0.0010) [2023-12-26 10:16:36,086][123091] Updated weights for policy 0, policy_version 1338261 (0.0008) [2023-12-26 10:16:36,157][123091] Updated weights for policy 0, policy_version 1338271 (0.0010) [2023-12-26 10:16:36,218][123091] Updated weights for policy 0, policy_version 1338281 (0.0010) [2023-12-26 10:16:36,714][123090] Updated weights for policy 1, policy_version 1328839 (0.0010) [2023-12-26 10:16:36,781][123090] Updated weights for policy 1, policy_version 1328849 (0.0010) [2023-12-26 10:16:36,844][123090] Updated weights for policy 1, policy_version 1328859 (0.0010) [2023-12-26 10:16:37,041][123091] Updated weights for policy 0, policy_version 1338291 (0.0009) [2023-12-26 10:16:37,105][123091] Updated weights for policy 0, policy_version 1338301 (0.0007) [2023-12-26 10:16:37,160][123091] Updated weights for policy 0, policy_version 1338311 (0.0006) [2023-12-26 10:16:37,595][123090] Updated weights for policy 1, policy_version 1328869 (0.0008) [2023-12-26 10:16:37,668][123090] Updated weights for policy 1, policy_version 1328879 (0.0005) [2023-12-26 10:16:37,735][123090] Updated weights for policy 1, policy_version 1328889 (0.0006) [2023-12-26 10:16:37,865][123091] Updated weights for policy 0, policy_version 1338321 (0.0006) [2023-12-26 10:16:37,919][123091] Updated weights for policy 0, policy_version 1338332 (0.0010) [2023-12-26 10:16:37,972][123091] Updated weights for policy 0, policy_version 1338342 (0.0006) [2023-12-26 10:16:38,047][123091] Updated weights for policy 0, policy_version 1338352 (0.0006) [2023-12-26 10:16:38,531][123090] Updated weights for policy 1, policy_version 1328899 (0.0010) [2023-12-26 10:16:38,579][123090] Updated weights for policy 1, policy_version 1328909 (0.0010) [2023-12-26 10:16:38,628][123090] Updated weights for policy 1, policy_version 1328919 (0.0010) [2023-12-26 10:16:38,735][123091] Updated weights for policy 0, policy_version 1338362 (0.0008) [2023-12-26 10:16:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 682827776. Throughput: 0: 8820.9, 1: 8790.7. Samples: 682803280. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:38,785][121949] Avg episode reward: [(0, '6350.598'), (1, '5063.529')] [2023-12-26 10:16:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001328928_340205568.pth... [2023-12-26 10:16:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001327904_339943424.pth [2023-12-26 10:16:38,795][123091] Updated weights for policy 0, policy_version 1338372 (0.0008) [2023-12-26 10:16:38,858][123091] Updated weights for policy 0, policy_version 1338382 (0.0008) [2023-12-26 10:16:38,868][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001338384_342630400.pth... [2023-12-26 10:16:38,873][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001337328_342360064.pth [2023-12-26 10:16:39,468][123090] Updated weights for policy 1, policy_version 1328929 (0.0010) [2023-12-26 10:16:39,542][123090] Updated weights for policy 1, policy_version 1328939 (0.0010) [2023-12-26 10:16:39,605][123090] Updated weights for policy 1, policy_version 1328949 (0.0009) [2023-12-26 10:16:39,671][123090] Updated weights for policy 1, policy_version 1328959 (0.0009) [2023-12-26 10:16:39,708][123091] Updated weights for policy 0, policy_version 1338392 (0.0009) [2023-12-26 10:16:39,771][123091] Updated weights for policy 0, policy_version 1338402 (0.0010) [2023-12-26 10:16:39,841][123091] Updated weights for policy 0, policy_version 1338412 (0.0010) [2023-12-26 10:16:40,524][123090] Updated weights for policy 1, policy_version 1328969 (0.0008) [2023-12-26 10:16:40,586][123090] Updated weights for policy 1, policy_version 1328979 (0.0008) [2023-12-26 10:16:40,640][123090] Updated weights for policy 1, policy_version 1328989 (0.0009) [2023-12-26 10:16:40,679][123091] Updated weights for policy 0, policy_version 1338422 (0.0009) [2023-12-26 10:16:40,741][123091] Updated weights for policy 0, policy_version 1338432 (0.0009) [2023-12-26 10:16:40,809][123091] Updated weights for policy 0, policy_version 1338442 (0.0011) [2023-12-26 10:16:41,483][123090] Updated weights for policy 1, policy_version 1328999 (0.0009) [2023-12-26 10:16:41,552][123090] Updated weights for policy 1, policy_version 1329009 (0.0009) [2023-12-26 10:16:41,621][123090] Updated weights for policy 1, policy_version 1329019 (0.0010) [2023-12-26 10:16:41,676][123091] Updated weights for policy 0, policy_version 1338452 (0.0009) [2023-12-26 10:16:41,751][123091] Updated weights for policy 0, policy_version 1338462 (0.0008) [2023-12-26 10:16:41,821][123091] Updated weights for policy 0, policy_version 1338472 (0.0008) [2023-12-26 10:16:42,458][123090] Updated weights for policy 1, policy_version 1329029 (0.0009) [2023-12-26 10:16:42,520][123090] Updated weights for policy 1, policy_version 1329039 (0.0008) [2023-12-26 10:16:42,586][123090] Updated weights for policy 1, policy_version 1329049 (0.0008) [2023-12-26 10:16:42,622][123091] Updated weights for policy 0, policy_version 1338482 (0.0008) [2023-12-26 10:16:42,685][123091] Updated weights for policy 0, policy_version 1338492 (0.0009) [2023-12-26 10:16:42,752][123091] Updated weights for policy 0, policy_version 1338502 (0.0009) [2023-12-26 10:16:42,824][123091] Updated weights for policy 0, policy_version 1338512 (0.0009) [2023-12-26 10:16:43,340][123090] Updated weights for policy 1, policy_version 1329059 (0.0008) [2023-12-26 10:16:43,395][123090] Updated weights for policy 1, policy_version 1329069 (0.0010) [2023-12-26 10:16:43,446][123090] Updated weights for policy 1, policy_version 1329079 (0.0010) [2023-12-26 10:16:43,690][123091] Updated weights for policy 0, policy_version 1338522 (0.0010) [2023-12-26 10:16:43,757][123091] Updated weights for policy 0, policy_version 1338532 (0.0010) [2023-12-26 10:16:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 682909696. Throughput: 0: 8858.9, 1: 8673.9. Samples: 682906532. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:43,785][121949] Avg episode reward: [(0, '6370.909'), (1, '4939.283')] [2023-12-26 10:16:43,813][123091] Updated weights for policy 0, policy_version 1338542 (0.0010) [2023-12-26 10:16:44,218][123090] Updated weights for policy 1, policy_version 1329089 (0.0010) [2023-12-26 10:16:44,273][123090] Updated weights for policy 1, policy_version 1329099 (0.0009) [2023-12-26 10:16:44,333][123090] Updated weights for policy 1, policy_version 1329109 (0.0009) [2023-12-26 10:16:44,390][123090] Updated weights for policy 1, policy_version 1329120 (0.0014) [2023-12-26 10:16:44,640][123091] Updated weights for policy 0, policy_version 1338552 (0.0010) [2023-12-26 10:16:44,702][123091] Updated weights for policy 0, policy_version 1338562 (0.0010) [2023-12-26 10:16:44,781][123091] Updated weights for policy 0, policy_version 1338573 (0.0009) [2023-12-26 10:16:45,212][123090] Updated weights for policy 1, policy_version 1329130 (0.0009) [2023-12-26 10:16:45,280][123090] Updated weights for policy 1, policy_version 1329140 (0.0009) [2023-12-26 10:16:45,349][123090] Updated weights for policy 1, policy_version 1329150 (0.0009) [2023-12-26 10:16:45,630][123091] Updated weights for policy 0, policy_version 1338583 (0.0010) [2023-12-26 10:16:45,689][123091] Updated weights for policy 0, policy_version 1338593 (0.0010) [2023-12-26 10:16:45,748][123091] Updated weights for policy 0, policy_version 1338603 (0.0009) [2023-12-26 10:16:46,208][123090] Updated weights for policy 1, policy_version 1329160 (0.0010) [2023-12-26 10:16:46,268][123090] Updated weights for policy 1, policy_version 1329170 (0.0010) [2023-12-26 10:16:46,323][123090] Updated weights for policy 1, policy_version 1329180 (0.0010) [2023-12-26 10:16:46,514][123091] Updated weights for policy 0, policy_version 1338613 (0.0007) [2023-12-26 10:16:46,578][123091] Updated weights for policy 0, policy_version 1338623 (0.0006) [2023-12-26 10:16:46,642][123091] Updated weights for policy 0, policy_version 1338633 (0.0009) [2023-12-26 10:16:47,218][123090] Updated weights for policy 1, policy_version 1329191 (0.0010) [2023-12-26 10:16:47,278][123090] Updated weights for policy 1, policy_version 1329201 (0.0009) [2023-12-26 10:16:47,336][123090] Updated weights for policy 1, policy_version 1329211 (0.0009) [2023-12-26 10:16:47,443][123091] Updated weights for policy 0, policy_version 1338643 (0.0010) [2023-12-26 10:16:47,492][123091] Updated weights for policy 0, policy_version 1338653 (0.0009) [2023-12-26 10:16:47,542][123091] Updated weights for policy 0, policy_version 1338664 (0.0010) [2023-12-26 10:16:48,188][123090] Updated weights for policy 1, policy_version 1329221 (0.0009) [2023-12-26 10:16:48,253][123090] Updated weights for policy 1, policy_version 1329231 (0.0009) [2023-12-26 10:16:48,309][123090] Updated weights for policy 1, policy_version 1329241 (0.0009) [2023-12-26 10:16:48,370][123091] Updated weights for policy 0, policy_version 1338674 (0.0009) [2023-12-26 10:16:48,429][123091] Updated weights for policy 0, policy_version 1338684 (0.0009) [2023-12-26 10:16:48,494][123091] Updated weights for policy 0, policy_version 1338694 (0.0010) [2023-12-26 10:16:48,556][123091] Updated weights for policy 0, policy_version 1338704 (0.0008) [2023-12-26 10:16:48,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 682999808. Throughput: 0: 8780.8, 1: 8668.6. Samples: 683009696. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:48,785][121949] Avg episode reward: [(0, '6367.137'), (1, '5117.988')] [2023-12-26 10:16:49,196][123090] Updated weights for policy 1, policy_version 1329251 (0.0010) [2023-12-26 10:16:49,265][123090] Updated weights for policy 1, policy_version 1329261 (0.0010) [2023-12-26 10:16:49,336][123090] Updated weights for policy 1, policy_version 1329271 (0.0010) [2023-12-26 10:16:49,355][123091] Updated weights for policy 0, policy_version 1338714 (0.0006) [2023-12-26 10:16:49,436][123091] Updated weights for policy 0, policy_version 1338724 (0.0007) [2023-12-26 10:16:49,502][123091] Updated weights for policy 0, policy_version 1338734 (0.0006) [2023-12-26 10:16:50,194][123090] Updated weights for policy 1, policy_version 1329281 (0.0009) [2023-12-26 10:16:50,262][123090] Updated weights for policy 1, policy_version 1329291 (0.0006) [2023-12-26 10:16:50,292][123091] Updated weights for policy 0, policy_version 1338744 (0.0009) [2023-12-26 10:16:50,323][123090] Updated weights for policy 1, policy_version 1329301 (0.0006) [2023-12-26 10:16:50,353][123091] Updated weights for policy 0, policy_version 1338754 (0.0009) [2023-12-26 10:16:50,394][123090] Updated weights for policy 1, policy_version 1329311 (0.0008) [2023-12-26 10:16:50,417][123091] Updated weights for policy 0, policy_version 1338764 (0.0008) [2023-12-26 10:16:51,228][123091] Updated weights for policy 0, policy_version 1338774 (0.0007) [2023-12-26 10:16:51,246][123090] Updated weights for policy 1, policy_version 1329321 (0.0010) [2023-12-26 10:16:51,304][123091] Updated weights for policy 0, policy_version 1338784 (0.0006) [2023-12-26 10:16:51,318][123090] Updated weights for policy 1, policy_version 1329331 (0.0011) [2023-12-26 10:16:51,375][123091] Updated weights for policy 0, policy_version 1338794 (0.0007) [2023-12-26 10:16:51,402][123090] Updated weights for policy 1, policy_version 1329341 (0.0011) [2023-12-26 10:16:52,165][123090] Updated weights for policy 1, policy_version 1329351 (0.0009) [2023-12-26 10:16:52,226][123090] Updated weights for policy 1, policy_version 1329361 (0.0010) [2023-12-26 10:16:52,246][123091] Updated weights for policy 0, policy_version 1338804 (0.0008) [2023-12-26 10:16:52,290][123090] Updated weights for policy 1, policy_version 1329371 (0.0007) [2023-12-26 10:16:52,311][123091] Updated weights for policy 0, policy_version 1338814 (0.0007) [2023-12-26 10:16:52,382][123091] Updated weights for policy 0, policy_version 1338824 (0.0010) [2023-12-26 10:16:53,075][123090] Updated weights for policy 1, policy_version 1329381 (0.0008) [2023-12-26 10:16:53,137][123090] Updated weights for policy 1, policy_version 1329391 (0.0009) [2023-12-26 10:16:53,201][123090] Updated weights for policy 1, policy_version 1329401 (0.0009) [2023-12-26 10:16:53,240][123091] Updated weights for policy 0, policy_version 1338834 (0.0009) [2023-12-26 10:16:53,304][123091] Updated weights for policy 0, policy_version 1338844 (0.0010) [2023-12-26 10:16:53,366][123091] Updated weights for policy 0, policy_version 1338854 (0.0009) [2023-12-26 10:16:53,435][123091] Updated weights for policy 0, policy_version 1338864 (0.0009) [2023-12-26 10:16:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 683081728. Throughput: 0: 8782.5, 1: 8635.4. Samples: 683060220. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:53,785][121949] Avg episode reward: [(0, '6372.656'), (1, '5007.593')] [2023-12-26 10:16:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001338864_342753280.pth... [2023-12-26 10:16:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001329408_340328448.pth... [2023-12-26 10:16:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001328416_340074496.pth [2023-12-26 10:16:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001337840_342491136.pth [2023-12-26 10:16:53,994][123090] Updated weights for policy 1, policy_version 1329411 (0.0008) [2023-12-26 10:16:54,058][123090] Updated weights for policy 1, policy_version 1329421 (0.0010) [2023-12-26 10:16:54,120][123090] Updated weights for policy 1, policy_version 1329431 (0.0010) [2023-12-26 10:16:54,204][123091] Updated weights for policy 0, policy_version 1338874 (0.0006) [2023-12-26 10:16:54,262][123091] Updated weights for policy 0, policy_version 1338884 (0.0010) [2023-12-26 10:16:54,311][123091] Updated weights for policy 0, policy_version 1338894 (0.0009) [2023-12-26 10:16:54,981][123090] Updated weights for policy 1, policy_version 1329441 (0.0008) [2023-12-26 10:16:55,049][123090] Updated weights for policy 1, policy_version 1329451 (0.0006) [2023-12-26 10:16:55,105][123090] Updated weights for policy 1, policy_version 1329461 (0.0005) [2023-12-26 10:16:55,156][123091] Updated weights for policy 0, policy_version 1338904 (0.0009) [2023-12-26 10:16:55,166][123090] Updated weights for policy 1, policy_version 1329471 (0.0006) [2023-12-26 10:16:55,231][123091] Updated weights for policy 0, policy_version 1338914 (0.0009) [2023-12-26 10:16:55,294][123091] Updated weights for policy 0, policy_version 1338924 (0.0009) [2023-12-26 10:16:55,895][123090] Updated weights for policy 1, policy_version 1329481 (0.0007) [2023-12-26 10:16:55,947][123090] Updated weights for policy 1, policy_version 1329491 (0.0007) [2023-12-26 10:16:56,005][123090] Updated weights for policy 1, policy_version 1329501 (0.0009) [2023-12-26 10:16:56,121][123091] Updated weights for policy 0, policy_version 1338934 (0.0009) [2023-12-26 10:16:56,178][123091] Updated weights for policy 0, policy_version 1338944 (0.0009) [2023-12-26 10:16:56,241][123091] Updated weights for policy 0, policy_version 1338954 (0.0009) [2023-12-26 10:16:56,819][123090] Updated weights for policy 1, policy_version 1329511 (0.0009) [2023-12-26 10:16:56,874][123090] Updated weights for policy 1, policy_version 1329522 (0.0010) [2023-12-26 10:16:56,921][123090] Updated weights for policy 1, policy_version 1329532 (0.0009) [2023-12-26 10:16:57,056][123091] Updated weights for policy 0, policy_version 1338964 (0.0009) [2023-12-26 10:16:57,103][123091] Updated weights for policy 0, policy_version 1338974 (0.0008) [2023-12-26 10:16:57,157][123091] Updated weights for policy 0, policy_version 1338984 (0.0009) [2023-12-26 10:16:57,693][123090] Updated weights for policy 1, policy_version 1329542 (0.0006) [2023-12-26 10:16:57,772][123090] Updated weights for policy 1, policy_version 1329552 (0.0008) [2023-12-26 10:16:57,819][123090] Updated weights for policy 1, policy_version 1329562 (0.0006) [2023-12-26 10:16:57,853][123091] Updated weights for policy 0, policy_version 1338994 (0.0008) [2023-12-26 10:16:57,909][123091] Updated weights for policy 0, policy_version 1339004 (0.0005) [2023-12-26 10:16:57,956][123091] Updated weights for policy 0, policy_version 1339014 (0.0005) [2023-12-26 10:16:58,024][123091] Updated weights for policy 0, policy_version 1339024 (0.0006) [2023-12-26 10:16:58,560][123090] Updated weights for policy 1, policy_version 1329572 (0.0007) [2023-12-26 10:16:58,634][123090] Updated weights for policy 1, policy_version 1329582 (0.0009) [2023-12-26 10:16:58,707][123090] Updated weights for policy 1, policy_version 1329592 (0.0009) [2023-12-26 10:16:58,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 683171840. Throughput: 0: 8795.9, 1: 8652.8. Samples: 683164856. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:16:58,785][121949] Avg episode reward: [(0, '6335.324'), (1, '5213.780')] [2023-12-26 10:16:58,864][123091] Updated weights for policy 0, policy_version 1339034 (0.0005) [2023-12-26 10:16:58,936][123091] Updated weights for policy 0, policy_version 1339044 (0.0008) [2023-12-26 10:16:58,998][123091] Updated weights for policy 0, policy_version 1339054 (0.0010) [2023-12-26 10:16:59,642][123090] Updated weights for policy 1, policy_version 1329602 (0.0008) [2023-12-26 10:16:59,694][123090] Updated weights for policy 1, policy_version 1329612 (0.0009) [2023-12-26 10:16:59,746][123090] Updated weights for policy 1, policy_version 1329622 (0.0008) [2023-12-26 10:16:59,798][123091] Updated weights for policy 0, policy_version 1339064 (0.0011) [2023-12-26 10:16:59,810][123090] Updated weights for policy 1, policy_version 1329632 (0.0006) [2023-12-26 10:16:59,860][123091] Updated weights for policy 0, policy_version 1339074 (0.0009) [2023-12-26 10:16:59,925][123091] Updated weights for policy 0, policy_version 1339084 (0.0007) [2023-12-26 10:17:00,606][123090] Updated weights for policy 1, policy_version 1329642 (0.0005) [2023-12-26 10:17:00,660][123091] Updated weights for policy 0, policy_version 1339094 (0.0008) [2023-12-26 10:17:00,669][123090] Updated weights for policy 1, policy_version 1329652 (0.0005) [2023-12-26 10:17:00,709][123091] Updated weights for policy 0, policy_version 1339104 (0.0009) [2023-12-26 10:17:00,722][123090] Updated weights for policy 1, policy_version 1329662 (0.0005) [2023-12-26 10:17:00,762][123091] Updated weights for policy 0, policy_version 1339114 (0.0009) [2023-12-26 10:17:01,402][123090] Updated weights for policy 1, policy_version 1329672 (0.0008) [2023-12-26 10:17:01,458][123090] Updated weights for policy 1, policy_version 1329682 (0.0006) [2023-12-26 10:17:01,512][123090] Updated weights for policy 1, policy_version 1329692 (0.0005) [2023-12-26 10:17:01,709][123091] Updated weights for policy 0, policy_version 1339124 (0.0010) [2023-12-26 10:17:01,774][123091] Updated weights for policy 0, policy_version 1339134 (0.0009) [2023-12-26 10:17:01,832][123091] Updated weights for policy 0, policy_version 1339144 (0.0009) [2023-12-26 10:17:02,325][123090] Updated weights for policy 1, policy_version 1329702 (0.0008) [2023-12-26 10:17:02,398][123090] Updated weights for policy 1, policy_version 1329712 (0.0009) [2023-12-26 10:17:02,470][123090] Updated weights for policy 1, policy_version 1329722 (0.0009) [2023-12-26 10:17:02,604][123091] Updated weights for policy 0, policy_version 1339154 (0.0009) [2023-12-26 10:17:02,662][123091] Updated weights for policy 0, policy_version 1339164 (0.0005) [2023-12-26 10:17:02,707][123091] Updated weights for policy 0, policy_version 1339174 (0.0005) [2023-12-26 10:17:02,772][123091] Updated weights for policy 0, policy_version 1339184 (0.0010) [2023-12-26 10:17:03,203][123090] Updated weights for policy 1, policy_version 1329732 (0.0008) [2023-12-26 10:17:03,248][123090] Updated weights for policy 1, policy_version 1329742 (0.0005) [2023-12-26 10:17:03,298][123090] Updated weights for policy 1, policy_version 1329752 (0.0005) [2023-12-26 10:17:03,554][123091] Updated weights for policy 0, policy_version 1339194 (0.0005) [2023-12-26 10:17:03,599][123091] Updated weights for policy 0, policy_version 1339204 (0.0005) [2023-12-26 10:17:03,646][123091] Updated weights for policy 0, policy_version 1339214 (0.0005) [2023-12-26 10:17:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 683261952. Throughput: 0: 8752.2, 1: 8700.0. Samples: 683271696. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:17:03,785][121949] Avg episode reward: [(0, '6296.195'), (1, '5218.859')] [2023-12-26 10:17:03,997][123090] Updated weights for policy 1, policy_version 1329762 (0.0006) [2023-12-26 10:17:04,058][123090] Updated weights for policy 1, policy_version 1329772 (0.0010) [2023-12-26 10:17:04,117][123090] Updated weights for policy 1, policy_version 1329782 (0.0010) [2023-12-26 10:17:04,171][123090] Updated weights for policy 1, policy_version 1329792 (0.0010) [2023-12-26 10:17:04,379][123091] Updated weights for policy 0, policy_version 1339224 (0.0009) [2023-12-26 10:17:04,447][123091] Updated weights for policy 0, policy_version 1339234 (0.0009) [2023-12-26 10:17:04,539][123091] Updated weights for policy 0, policy_version 1339244 (0.0009) [2023-12-26 10:17:05,043][123090] Updated weights for policy 1, policy_version 1329802 (0.0006) [2023-12-26 10:17:05,093][123090] Updated weights for policy 1, policy_version 1329812 (0.0005) [2023-12-26 10:17:05,146][123090] Updated weights for policy 1, policy_version 1329822 (0.0006) [2023-12-26 10:17:05,191][123091] Updated weights for policy 0, policy_version 1339254 (0.0007) [2023-12-26 10:17:05,257][123091] Updated weights for policy 0, policy_version 1339264 (0.0005) [2023-12-26 10:17:05,329][123091] Updated weights for policy 0, policy_version 1339274 (0.0009) [2023-12-26 10:17:05,918][123090] Updated weights for policy 1, policy_version 1329832 (0.0006) [2023-12-26 10:17:05,965][123090] Updated weights for policy 1, policy_version 1329842 (0.0005) [2023-12-26 10:17:06,023][123090] Updated weights for policy 1, policy_version 1329852 (0.0007) [2023-12-26 10:17:06,067][123091] Updated weights for policy 0, policy_version 1339284 (0.0007) [2023-12-26 10:17:06,131][123091] Updated weights for policy 0, policy_version 1339294 (0.0007) [2023-12-26 10:17:06,194][123091] Updated weights for policy 0, policy_version 1339304 (0.0007) [2023-12-26 10:17:06,861][123090] Updated weights for policy 1, policy_version 1329862 (0.0009) [2023-12-26 10:17:06,928][123090] Updated weights for policy 1, policy_version 1329872 (0.0008) [2023-12-26 10:17:06,983][123091] Updated weights for policy 0, policy_version 1339314 (0.0007) [2023-12-26 10:17:06,991][123090] Updated weights for policy 1, policy_version 1329882 (0.0009) [2023-12-26 10:17:07,051][123091] Updated weights for policy 0, policy_version 1339324 (0.0009) [2023-12-26 10:17:07,120][123091] Updated weights for policy 0, policy_version 1339334 (0.0010) [2023-12-26 10:17:07,191][123091] Updated weights for policy 0, policy_version 1339344 (0.0009) [2023-12-26 10:17:07,697][123090] Updated weights for policy 1, policy_version 1329892 (0.0008) [2023-12-26 10:17:07,751][123090] Updated weights for policy 1, policy_version 1329902 (0.0009) [2023-12-26 10:17:07,799][123090] Updated weights for policy 1, policy_version 1329912 (0.0009) [2023-12-26 10:17:08,020][123091] Updated weights for policy 0, policy_version 1339354 (0.0009) [2023-12-26 10:17:08,093][123091] Updated weights for policy 0, policy_version 1339364 (0.0008) [2023-12-26 10:17:08,159][123091] Updated weights for policy 0, policy_version 1339374 (0.0010) [2023-12-26 10:17:08,603][123090] Updated weights for policy 1, policy_version 1329922 (0.0010) [2023-12-26 10:17:08,655][123090] Updated weights for policy 1, policy_version 1329932 (0.0010) [2023-12-26 10:17:08,711][123090] Updated weights for policy 1, policy_version 1329942 (0.0010) [2023-12-26 10:17:08,771][123090] Updated weights for policy 1, policy_version 1329952 (0.0011) [2023-12-26 10:17:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 683352064. Throughput: 0: 8837.7, 1: 8734.2. Samples: 683327480. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:17:08,785][121949] Avg episode reward: [(0, '6311.757'), (1, '5105.215')] [2023-12-26 10:17:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001339376_342884352.pth... [2023-12-26 10:17:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001329952_340467712.pth... [2023-12-26 10:17:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001328928_340205568.pth [2023-12-26 10:17:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001338384_342630400.pth [2023-12-26 10:17:08,985][123091] Updated weights for policy 0, policy_version 1339384 (0.0011) [2023-12-26 10:17:09,033][123091] Updated weights for policy 0, policy_version 1339394 (0.0010) [2023-12-26 10:17:09,091][123091] Updated weights for policy 0, policy_version 1339404 (0.0010) [2023-12-26 10:17:09,642][123090] Updated weights for policy 1, policy_version 1329962 (0.0011) [2023-12-26 10:17:09,717][123090] Updated weights for policy 1, policy_version 1329972 (0.0011) [2023-12-26 10:17:09,780][123090] Updated weights for policy 1, policy_version 1329982 (0.0011) [2023-12-26 10:17:09,851][123091] Updated weights for policy 0, policy_version 1339414 (0.0007) [2023-12-26 10:17:09,928][123091] Updated weights for policy 0, policy_version 1339424 (0.0006) [2023-12-26 10:17:10,004][123091] Updated weights for policy 0, policy_version 1339434 (0.0007) [2023-12-26 10:17:10,554][123090] Updated weights for policy 1, policy_version 1329992 (0.0008) [2023-12-26 10:17:10,613][123091] Updated weights for policy 0, policy_version 1339444 (0.0006) [2023-12-26 10:17:10,617][123090] Updated weights for policy 1, policy_version 1330002 (0.0008) [2023-12-26 10:17:10,681][123091] Updated weights for policy 0, policy_version 1339454 (0.0008) [2023-12-26 10:17:10,687][123090] Updated weights for policy 1, policy_version 1330012 (0.0008) [2023-12-26 10:17:10,737][123091] Updated weights for policy 0, policy_version 1339464 (0.0010) [2023-12-26 10:17:11,506][123091] Updated weights for policy 0, policy_version 1339474 (0.0010) [2023-12-26 10:17:11,563][123090] Updated weights for policy 1, policy_version 1330022 (0.0008) [2023-12-26 10:17:11,571][123091] Updated weights for policy 0, policy_version 1339484 (0.0006) [2023-12-26 10:17:11,636][123090] Updated weights for policy 1, policy_version 1330032 (0.0009) [2023-12-26 10:17:11,637][123091] Updated weights for policy 0, policy_version 1339494 (0.0009) [2023-12-26 10:17:11,704][123090] Updated weights for policy 1, policy_version 1330042 (0.0007) [2023-12-26 10:17:11,705][123091] Updated weights for policy 0, policy_version 1339504 (0.0011) [2023-12-26 10:17:12,427][123091] Updated weights for policy 0, policy_version 1339514 (0.0010) [2023-12-26 10:17:12,475][123091] Updated weights for policy 0, policy_version 1339524 (0.0010) [2023-12-26 10:17:12,534][123091] Updated weights for policy 0, policy_version 1339534 (0.0011) [2023-12-26 10:17:12,577][123090] Updated weights for policy 1, policy_version 1330052 (0.0010) [2023-12-26 10:17:12,634][123090] Updated weights for policy 1, policy_version 1330062 (0.0008) [2023-12-26 10:17:12,700][123090] Updated weights for policy 1, policy_version 1330072 (0.0009) [2023-12-26 10:17:13,369][123091] Updated weights for policy 0, policy_version 1339544 (0.0010) [2023-12-26 10:17:13,435][123091] Updated weights for policy 0, policy_version 1339554 (0.0010) [2023-12-26 10:17:13,497][123091] Updated weights for policy 0, policy_version 1339564 (0.0009) [2023-12-26 10:17:13,515][123090] Updated weights for policy 1, policy_version 1330082 (0.0009) [2023-12-26 10:17:13,567][123090] Updated weights for policy 1, policy_version 1330092 (0.0009) [2023-12-26 10:17:13,618][123090] Updated weights for policy 1, policy_version 1330102 (0.0009) [2023-12-26 10:17:13,673][123090] Updated weights for policy 1, policy_version 1330112 (0.0008) [2023-12-26 10:17:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 683442176. Throughput: 0: 8799.1, 1: 8708.5. Samples: 683432524. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:17:13,785][121949] Avg episode reward: [(0, '6273.563'), (1, '5165.262')] [2023-12-26 10:17:14,312][123091] Updated weights for policy 0, policy_version 1339574 (0.0010) [2023-12-26 10:17:14,366][123091] Updated weights for policy 0, policy_version 1339584 (0.0009) [2023-12-26 10:17:14,422][123091] Updated weights for policy 0, policy_version 1339594 (0.0009) [2023-12-26 10:17:14,514][123090] Updated weights for policy 1, policy_version 1330122 (0.0009) [2023-12-26 10:17:14,566][123090] Updated weights for policy 1, policy_version 1330132 (0.0009) [2023-12-26 10:17:14,625][123090] Updated weights for policy 1, policy_version 1330142 (0.0010) [2023-12-26 10:17:15,254][123091] Updated weights for policy 0, policy_version 1339604 (0.0009) [2023-12-26 10:17:15,315][123091] Updated weights for policy 0, policy_version 1339614 (0.0009) [2023-12-26 10:17:15,382][123091] Updated weights for policy 0, policy_version 1339624 (0.0011) [2023-12-26 10:17:15,507][123090] Updated weights for policy 1, policy_version 1330152 (0.0009) [2023-12-26 10:17:15,566][123090] Updated weights for policy 1, policy_version 1330162 (0.0009) [2023-12-26 10:17:15,618][123090] Updated weights for policy 1, policy_version 1330173 (0.0010) [2023-12-26 10:17:16,164][123091] Updated weights for policy 0, policy_version 1339634 (0.0010) [2023-12-26 10:17:16,230][123091] Updated weights for policy 0, policy_version 1339644 (0.0011) [2023-12-26 10:17:16,297][123091] Updated weights for policy 0, policy_version 1339654 (0.0010) [2023-12-26 10:17:16,360][123091] Updated weights for policy 0, policy_version 1339664 (0.0011) [2023-12-26 10:17:16,489][123090] Updated weights for policy 1, policy_version 1330183 (0.0010) [2023-12-26 10:17:16,552][123090] Updated weights for policy 1, policy_version 1330193 (0.0008) [2023-12-26 10:17:16,616][123090] Updated weights for policy 1, policy_version 1330203 (0.0009) [2023-12-26 10:17:17,072][123091] Updated weights for policy 0, policy_version 1339674 (0.0011) [2023-12-26 10:17:17,117][123091] Updated weights for policy 0, policy_version 1339684 (0.0010) [2023-12-26 10:17:17,164][123091] Updated weights for policy 0, policy_version 1339694 (0.0010) [2023-12-26 10:17:17,506][123090] Updated weights for policy 1, policy_version 1330213 (0.0008) [2023-12-26 10:17:17,568][123090] Updated weights for policy 1, policy_version 1330223 (0.0009) [2023-12-26 10:17:17,632][123090] Updated weights for policy 1, policy_version 1330233 (0.0009) [2023-12-26 10:17:18,030][123091] Updated weights for policy 0, policy_version 1339704 (0.0011) [2023-12-26 10:17:18,090][123091] Updated weights for policy 0, policy_version 1339714 (0.0010) [2023-12-26 10:17:18,148][123091] Updated weights for policy 0, policy_version 1339724 (0.0011) [2023-12-26 10:17:18,461][123090] Updated weights for policy 1, policy_version 1330243 (0.0009) [2023-12-26 10:17:18,515][123090] Updated weights for policy 1, policy_version 1330253 (0.0010) [2023-12-26 10:17:18,573][123090] Updated weights for policy 1, policy_version 1330263 (0.0009) [2023-12-26 10:17:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 683524096. Throughput: 0: 8841.2, 1: 8622.2. Samples: 683535304. Policy #0 lag: (min: 23.0, avg: 23.0, max: 23.0) [2023-12-26 10:17:18,785][121949] Avg episode reward: [(0, '6269.183'), (1, '5136.455')] [2023-12-26 10:17:18,934][123091] Updated weights for policy 0, policy_version 1339734 (0.0010) [2023-12-26 10:17:18,992][123091] Updated weights for policy 0, policy_version 1339744 (0.0008) [2023-12-26 10:17:19,045][123091] Updated weights for policy 0, policy_version 1339754 (0.0011) [2023-12-26 10:17:19,441][123090] Updated weights for policy 1, policy_version 1330273 (0.0009) [2023-12-26 10:17:19,508][123090] Updated weights for policy 1, policy_version 1330283 (0.0009) [2023-12-26 10:17:19,569][123090] Updated weights for policy 1, policy_version 1330293 (0.0008) [2023-12-26 10:17:19,638][123090] Updated weights for policy 1, policy_version 1330303 (0.0005) [2023-12-26 10:17:19,881][123091] Updated weights for policy 0, policy_version 1339764 (0.0011) [2023-12-26 10:17:19,949][123091] Updated weights for policy 0, policy_version 1339774 (0.0011) [2023-12-26 10:17:20,013][123091] Updated weights for policy 0, policy_version 1339784 (0.0011) [2023-12-26 10:17:20,443][123090] Updated weights for policy 1, policy_version 1330313 (0.0008) [2023-12-26 10:17:20,500][123090] Updated weights for policy 1, policy_version 1330323 (0.0009) [2023-12-26 10:17:20,556][123090] Updated weights for policy 1, policy_version 1330333 (0.0009) [2023-12-26 10:17:20,842][123091] Updated weights for policy 0, policy_version 1339794 (0.0011) [2023-12-26 10:17:20,915][123091] Updated weights for policy 0, policy_version 1339804 (0.0011) [2023-12-26 10:17:20,988][123091] Updated weights for policy 0, policy_version 1339814 (0.0011) [2023-12-26 10:17:21,061][123091] Updated weights for policy 0, policy_version 1339824 (0.0011) [2023-12-26 10:17:21,473][123090] Updated weights for policy 1, policy_version 1330343 (0.0009) [2023-12-26 10:17:21,547][123090] Updated weights for policy 1, policy_version 1330353 (0.0010) [2023-12-26 10:17:21,621][123090] Updated weights for policy 1, policy_version 1330363 (0.0010) [2023-12-26 10:17:21,873][123091] Updated weights for policy 0, policy_version 1339834 (0.0006) [2023-12-26 10:17:21,936][123091] Updated weights for policy 0, policy_version 1339844 (0.0009) [2023-12-26 10:17:21,994][123091] Updated weights for policy 0, policy_version 1339854 (0.0010) [2023-12-26 10:17:22,458][123090] Updated weights for policy 1, policy_version 1330373 (0.0010) [2023-12-26 10:17:22,511][123090] Updated weights for policy 1, policy_version 1330383 (0.0008) [2023-12-26 10:17:22,568][123090] Updated weights for policy 1, policy_version 1330393 (0.0009) [2023-12-26 10:17:22,811][123091] Updated weights for policy 0, policy_version 1339864 (0.0010) [2023-12-26 10:17:22,866][123091] Updated weights for policy 0, policy_version 1339874 (0.0010) [2023-12-26 10:17:22,930][123091] Updated weights for policy 0, policy_version 1339884 (0.0006) [2023-12-26 10:17:23,441][123090] Updated weights for policy 1, policy_version 1330404 (0.0011) [2023-12-26 10:17:23,507][123090] Updated weights for policy 1, policy_version 1330414 (0.0009) [2023-12-26 10:17:23,573][123090] Updated weights for policy 1, policy_version 1330424 (0.0009) [2023-12-26 10:17:23,748][123091] Updated weights for policy 0, policy_version 1339894 (0.0008) [2023-12-26 10:17:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 683606016. Throughput: 0: 8794.8, 1: 8594.4. Samples: 683585796. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:23,786][121949] Avg episode reward: [(0, '6233.468'), (1, '5115.584')] [2023-12-26 10:17:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001330432_340590592.pth... [2023-12-26 10:17:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001329408_340328448.pth [2023-12-26 10:17:23,809][123091] Updated weights for policy 0, policy_version 1339904 (0.0010) [2023-12-26 10:17:23,880][123091] Updated weights for policy 0, policy_version 1339914 (0.0007) [2023-12-26 10:17:23,927][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001339920_343023616.pth... [2023-12-26 10:17:23,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001338864_342753280.pth [2023-12-26 10:17:24,318][123090] Updated weights for policy 1, policy_version 1330434 (0.0010) [2023-12-26 10:17:24,374][123090] Updated weights for policy 1, policy_version 1330444 (0.0006) [2023-12-26 10:17:24,429][123090] Updated weights for policy 1, policy_version 1330454 (0.0010) [2023-12-26 10:17:24,493][123090] Updated weights for policy 1, policy_version 1330464 (0.0008) [2023-12-26 10:17:24,521][123091] Updated weights for policy 0, policy_version 1339924 (0.0007) [2023-12-26 10:17:24,579][123091] Updated weights for policy 0, policy_version 1339934 (0.0010) [2023-12-26 10:17:24,638][123091] Updated weights for policy 0, policy_version 1339945 (0.0010) [2023-12-26 10:17:25,182][123090] Updated weights for policy 1, policy_version 1330474 (0.0006) [2023-12-26 10:17:25,229][123090] Updated weights for policy 1, policy_version 1330484 (0.0005) [2023-12-26 10:17:25,273][123090] Updated weights for policy 1, policy_version 1330494 (0.0005) [2023-12-26 10:17:25,514][123091] Updated weights for policy 0, policy_version 1339955 (0.0009) [2023-12-26 10:17:25,580][123091] Updated weights for policy 0, policy_version 1339965 (0.0010) [2023-12-26 10:17:25,642][123091] Updated weights for policy 0, policy_version 1339975 (0.0009) [2023-12-26 10:17:25,895][123090] Updated weights for policy 1, policy_version 1330504 (0.0005) [2023-12-26 10:17:25,954][123090] Updated weights for policy 1, policy_version 1330514 (0.0006) [2023-12-26 10:17:26,016][123090] Updated weights for policy 1, policy_version 1330524 (0.0010) [2023-12-26 10:17:26,504][123091] Updated weights for policy 0, policy_version 1339985 (0.0009) [2023-12-26 10:17:26,569][123091] Updated weights for policy 0, policy_version 1339995 (0.0009) [2023-12-26 10:17:26,631][123091] Updated weights for policy 0, policy_version 1340005 (0.0010) [2023-12-26 10:17:26,684][123091] Updated weights for policy 0, policy_version 1340016 (0.0009) [2023-12-26 10:17:26,693][123090] Updated weights for policy 1, policy_version 1330534 (0.0008) [2023-12-26 10:17:26,757][123090] Updated weights for policy 1, policy_version 1330544 (0.0006) [2023-12-26 10:17:26,821][123090] Updated weights for policy 1, policy_version 1330554 (0.0005) [2023-12-26 10:17:27,498][123090] Updated weights for policy 1, policy_version 1330564 (0.0005) [2023-12-26 10:17:27,549][123090] Updated weights for policy 1, policy_version 1330574 (0.0005) [2023-12-26 10:17:27,604][123091] Updated weights for policy 0, policy_version 1340026 (0.0009) [2023-12-26 10:17:27,613][123090] Updated weights for policy 1, policy_version 1330584 (0.0006) [2023-12-26 10:17:27,664][123091] Updated weights for policy 0, policy_version 1340036 (0.0007) [2023-12-26 10:17:27,725][123091] Updated weights for policy 0, policy_version 1340046 (0.0008) [2023-12-26 10:17:28,307][123090] Updated weights for policy 1, policy_version 1330594 (0.0005) [2023-12-26 10:17:28,380][123090] Updated weights for policy 1, policy_version 1330604 (0.0007) [2023-12-26 10:17:28,442][123090] Updated weights for policy 1, policy_version 1330614 (0.0005) [2023-12-26 10:17:28,508][123090] Updated weights for policy 1, policy_version 1330624 (0.0005) [2023-12-26 10:17:28,638][123091] Updated weights for policy 0, policy_version 1340056 (0.0009) [2023-12-26 10:17:28,709][123091] Updated weights for policy 0, policy_version 1340066 (0.0010) [2023-12-26 10:17:28,768][123091] Updated weights for policy 0, policy_version 1340076 (0.0010) [2023-12-26 10:17:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 683696128. Throughput: 0: 8757.8, 1: 8726.0. Samples: 683693304. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:28,785][121949] Avg episode reward: [(0, '6172.614'), (1, '4991.942')] [2023-12-26 10:17:29,187][123090] Updated weights for policy 1, policy_version 1330634 (0.0005) [2023-12-26 10:17:29,254][123090] Updated weights for policy 1, policy_version 1330644 (0.0008) [2023-12-26 10:17:29,311][123090] Updated weights for policy 1, policy_version 1330654 (0.0008) [2023-12-26 10:17:29,602][123091] Updated weights for policy 0, policy_version 1340086 (0.0010) [2023-12-26 10:17:29,653][123091] Updated weights for policy 0, policy_version 1340096 (0.0009) [2023-12-26 10:17:29,712][123091] Updated weights for policy 0, policy_version 1340106 (0.0007) [2023-12-26 10:17:30,104][123090] Updated weights for policy 1, policy_version 1330665 (0.0009) [2023-12-26 10:17:30,159][123090] Updated weights for policy 1, policy_version 1330675 (0.0009) [2023-12-26 10:17:30,216][123090] Updated weights for policy 1, policy_version 1330685 (0.0009) [2023-12-26 10:17:30,536][123091] Updated weights for policy 0, policy_version 1340116 (0.0007) [2023-12-26 10:17:30,598][123091] Updated weights for policy 0, policy_version 1340126 (0.0010) [2023-12-26 10:17:30,651][123091] Updated weights for policy 0, policy_version 1340137 (0.0009) [2023-12-26 10:17:31,086][123090] Updated weights for policy 1, policy_version 1330695 (0.0010) [2023-12-26 10:17:31,153][123090] Updated weights for policy 1, policy_version 1330705 (0.0010) [2023-12-26 10:17:31,216][123090] Updated weights for policy 1, policy_version 1330715 (0.0010) [2023-12-26 10:17:31,526][123091] Updated weights for policy 0, policy_version 1340147 (0.0008) [2023-12-26 10:17:31,577][123091] Updated weights for policy 0, policy_version 1340157 (0.0008) [2023-12-26 10:17:31,639][123091] Updated weights for policy 0, policy_version 1340167 (0.0008) [2023-12-26 10:17:32,059][123090] Updated weights for policy 1, policy_version 1330725 (0.0010) [2023-12-26 10:17:32,125][123090] Updated weights for policy 1, policy_version 1330735 (0.0010) [2023-12-26 10:17:32,188][123090] Updated weights for policy 1, policy_version 1330745 (0.0010) [2023-12-26 10:17:32,482][123091] Updated weights for policy 0, policy_version 1340177 (0.0009) [2023-12-26 10:17:32,534][123091] Updated weights for policy 0, policy_version 1340187 (0.0008) [2023-12-26 10:17:32,590][123091] Updated weights for policy 0, policy_version 1340197 (0.0009) [2023-12-26 10:17:32,642][123091] Updated weights for policy 0, policy_version 1340207 (0.0009) [2023-12-26 10:17:33,012][123090] Updated weights for policy 1, policy_version 1330755 (0.0010) [2023-12-26 10:17:33,060][123090] Updated weights for policy 1, policy_version 1330765 (0.0010) [2023-12-26 10:17:33,119][123090] Updated weights for policy 1, policy_version 1330775 (0.0010) [2023-12-26 10:17:33,507][123091] Updated weights for policy 0, policy_version 1340217 (0.0010) [2023-12-26 10:17:33,561][123091] Updated weights for policy 0, policy_version 1340227 (0.0010) [2023-12-26 10:17:33,606][123091] Updated weights for policy 0, policy_version 1340237 (0.0010) [2023-12-26 10:17:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 683786240. Throughput: 0: 8738.7, 1: 8762.6. Samples: 683797252. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:33,785][121949] Avg episode reward: [(0, '6211.158'), (1, '5119.377')] [2023-12-26 10:17:33,837][123090] Updated weights for policy 1, policy_version 1330785 (0.0010) [2023-12-26 10:17:33,887][123090] Updated weights for policy 1, policy_version 1330795 (0.0005) [2023-12-26 10:17:33,933][123090] Updated weights for policy 1, policy_version 1330805 (0.0005) [2023-12-26 10:17:33,979][123090] Updated weights for policy 1, policy_version 1330815 (0.0005) [2023-12-26 10:17:34,437][123091] Updated weights for policy 0, policy_version 1340247 (0.0010) [2023-12-26 10:17:34,498][123091] Updated weights for policy 0, policy_version 1340257 (0.0009) [2023-12-26 10:17:34,554][123091] Updated weights for policy 0, policy_version 1340267 (0.0006) [2023-12-26 10:17:34,633][123090] Updated weights for policy 1, policy_version 1330825 (0.0010) [2023-12-26 10:17:34,688][123090] Updated weights for policy 1, policy_version 1330835 (0.0010) [2023-12-26 10:17:34,739][123090] Updated weights for policy 1, policy_version 1330845 (0.0010) [2023-12-26 10:17:35,339][123091] Updated weights for policy 0, policy_version 1340277 (0.0009) [2023-12-26 10:17:35,393][123091] Updated weights for policy 0, policy_version 1340287 (0.0010) [2023-12-26 10:17:35,441][123090] Updated weights for policy 1, policy_version 1330855 (0.0009) [2023-12-26 10:17:35,446][123091] Updated weights for policy 0, policy_version 1340297 (0.0010) [2023-12-26 10:17:35,488][123090] Updated weights for policy 1, policy_version 1330865 (0.0007) [2023-12-26 10:17:35,541][123090] Updated weights for policy 1, policy_version 1330875 (0.0009) [2023-12-26 10:17:36,158][123091] Updated weights for policy 0, policy_version 1340307 (0.0009) [2023-12-26 10:17:36,217][123091] Updated weights for policy 0, policy_version 1340317 (0.0008) [2023-12-26 10:17:36,277][123091] Updated weights for policy 0, policy_version 1340327 (0.0008) [2023-12-26 10:17:36,436][123090] Updated weights for policy 1, policy_version 1330885 (0.0010) [2023-12-26 10:17:36,502][123090] Updated weights for policy 1, policy_version 1330895 (0.0010) [2023-12-26 10:17:36,563][123090] Updated weights for policy 1, policy_version 1330905 (0.0011) [2023-12-26 10:17:37,059][123091] Updated weights for policy 0, policy_version 1340337 (0.0008) [2023-12-26 10:17:37,107][123091] Updated weights for policy 0, policy_version 1340347 (0.0009) [2023-12-26 10:17:37,159][123091] Updated weights for policy 0, policy_version 1340357 (0.0009) [2023-12-26 10:17:37,206][123091] Updated weights for policy 0, policy_version 1340367 (0.0008) [2023-12-26 10:17:37,391][123090] Updated weights for policy 1, policy_version 1330915 (0.0011) [2023-12-26 10:17:37,459][123090] Updated weights for policy 1, policy_version 1330925 (0.0011) [2023-12-26 10:17:37,526][123090] Updated weights for policy 1, policy_version 1330935 (0.0010) [2023-12-26 10:17:38,059][123091] Updated weights for policy 0, policy_version 1340377 (0.0009) [2023-12-26 10:17:38,111][123091] Updated weights for policy 0, policy_version 1340387 (0.0008) [2023-12-26 10:17:38,169][123091] Updated weights for policy 0, policy_version 1340397 (0.0009) [2023-12-26 10:17:38,371][123090] Updated weights for policy 1, policy_version 1330945 (0.0010) [2023-12-26 10:17:38,440][123090] Updated weights for policy 1, policy_version 1330955 (0.0011) [2023-12-26 10:17:38,500][123090] Updated weights for policy 1, policy_version 1330965 (0.0010) [2023-12-26 10:17:38,568][123090] Updated weights for policy 1, policy_version 1330975 (0.0011) [2023-12-26 10:17:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 683876352. Throughput: 0: 8755.4, 1: 8851.6. Samples: 683852540. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:38,785][121949] Avg episode reward: [(0, '6217.995'), (1, '5267.640')] [2023-12-26 10:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001330976_340729856.pth... [2023-12-26 10:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001340400_343146496.pth... [2023-12-26 10:17:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001329952_340467712.pth [2023-12-26 10:17:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001339376_342884352.pth [2023-12-26 10:17:39,053][123091] Updated weights for policy 0, policy_version 1340407 (0.0009) [2023-12-26 10:17:39,116][123091] Updated weights for policy 0, policy_version 1340417 (0.0009) [2023-12-26 10:17:39,175][123091] Updated weights for policy 0, policy_version 1340427 (0.0009) [2023-12-26 10:17:39,373][123090] Updated weights for policy 1, policy_version 1330985 (0.0011) [2023-12-26 10:17:39,442][123090] Updated weights for policy 1, policy_version 1330995 (0.0011) [2023-12-26 10:17:39,510][123090] Updated weights for policy 1, policy_version 1331005 (0.0009) [2023-12-26 10:17:39,969][123091] Updated weights for policy 0, policy_version 1340437 (0.0007) [2023-12-26 10:17:40,042][123091] Updated weights for policy 0, policy_version 1340447 (0.0006) [2023-12-26 10:17:40,113][123091] Updated weights for policy 0, policy_version 1340457 (0.0006) [2023-12-26 10:17:40,340][123090] Updated weights for policy 1, policy_version 1331015 (0.0010) [2023-12-26 10:17:40,402][123090] Updated weights for policy 1, policy_version 1331025 (0.0005) [2023-12-26 10:17:40,469][123090] Updated weights for policy 1, policy_version 1331035 (0.0006) [2023-12-26 10:17:40,832][123091] Updated weights for policy 0, policy_version 1340467 (0.0007) [2023-12-26 10:17:40,895][123091] Updated weights for policy 0, policy_version 1340477 (0.0011) [2023-12-26 10:17:40,961][123091] Updated weights for policy 0, policy_version 1340487 (0.0011) [2023-12-26 10:17:41,253][123090] Updated weights for policy 1, policy_version 1331045 (0.0008) [2023-12-26 10:17:41,310][123090] Updated weights for policy 1, policy_version 1331055 (0.0009) [2023-12-26 10:17:41,384][123090] Updated weights for policy 1, policy_version 1331065 (0.0009) [2023-12-26 10:17:41,736][123091] Updated weights for policy 0, policy_version 1340497 (0.0009) [2023-12-26 10:17:41,807][123091] Updated weights for policy 0, policy_version 1340507 (0.0011) [2023-12-26 10:17:41,879][123091] Updated weights for policy 0, policy_version 1340517 (0.0011) [2023-12-26 10:17:41,951][123091] Updated weights for policy 0, policy_version 1340527 (0.0011) [2023-12-26 10:17:42,243][123090] Updated weights for policy 1, policy_version 1331075 (0.0009) [2023-12-26 10:17:42,311][123090] Updated weights for policy 1, policy_version 1331085 (0.0009) [2023-12-26 10:17:42,381][123090] Updated weights for policy 1, policy_version 1331095 (0.0010) [2023-12-26 10:17:42,656][123091] Updated weights for policy 0, policy_version 1340537 (0.0009) [2023-12-26 10:17:42,710][123091] Updated weights for policy 0, policy_version 1340547 (0.0007) [2023-12-26 10:17:42,773][123091] Updated weights for policy 0, policy_version 1340557 (0.0007) [2023-12-26 10:17:43,198][123090] Updated weights for policy 1, policy_version 1331105 (0.0010) [2023-12-26 10:17:43,260][123090] Updated weights for policy 1, policy_version 1331115 (0.0010) [2023-12-26 10:17:43,318][123090] Updated weights for policy 1, policy_version 1331125 (0.0010) [2023-12-26 10:17:43,383][123090] Updated weights for policy 1, policy_version 1331135 (0.0010) [2023-12-26 10:17:43,547][123091] Updated weights for policy 0, policy_version 1340567 (0.0009) [2023-12-26 10:17:43,612][123091] Updated weights for policy 0, policy_version 1340577 (0.0009) [2023-12-26 10:17:43,674][123091] Updated weights for policy 0, policy_version 1340587 (0.0008) [2023-12-26 10:17:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 683966464. Throughput: 0: 8797.7, 1: 8788.6. Samples: 683956240. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:43,785][121949] Avg episode reward: [(0, '6310.136'), (1, '5166.002')] [2023-12-26 10:17:44,204][123090] Updated weights for policy 1, policy_version 1331145 (0.0010) [2023-12-26 10:17:44,280][123090] Updated weights for policy 1, policy_version 1331155 (0.0010) [2023-12-26 10:17:44,350][123090] Updated weights for policy 1, policy_version 1331165 (0.0011) [2023-12-26 10:17:44,426][123091] Updated weights for policy 0, policy_version 1340597 (0.0008) [2023-12-26 10:17:44,488][123091] Updated weights for policy 0, policy_version 1340607 (0.0010) [2023-12-26 10:17:44,547][123091] Updated weights for policy 0, policy_version 1340617 (0.0011) [2023-12-26 10:17:45,096][123090] Updated weights for policy 1, policy_version 1331175 (0.0011) [2023-12-26 10:17:45,162][123090] Updated weights for policy 1, policy_version 1331185 (0.0011) [2023-12-26 10:17:45,230][123090] Updated weights for policy 1, policy_version 1331195 (0.0011) [2023-12-26 10:17:45,351][123091] Updated weights for policy 0, policy_version 1340627 (0.0011) [2023-12-26 10:17:45,414][123091] Updated weights for policy 0, policy_version 1340637 (0.0011) [2023-12-26 10:17:45,484][123091] Updated weights for policy 0, policy_version 1340647 (0.0011) [2023-12-26 10:17:46,038][123090] Updated weights for policy 1, policy_version 1331205 (0.0007) [2023-12-26 10:17:46,106][123090] Updated weights for policy 1, policy_version 1331215 (0.0006) [2023-12-26 10:17:46,168][123090] Updated weights for policy 1, policy_version 1331225 (0.0009) [2023-12-26 10:17:46,298][123091] Updated weights for policy 0, policy_version 1340657 (0.0011) [2023-12-26 10:17:46,363][123091] Updated weights for policy 0, policy_version 1340667 (0.0010) [2023-12-26 10:17:46,432][123091] Updated weights for policy 0, policy_version 1340677 (0.0009) [2023-12-26 10:17:46,498][123091] Updated weights for policy 0, policy_version 1340687 (0.0005) [2023-12-26 10:17:46,908][123090] Updated weights for policy 1, policy_version 1331235 (0.0008) [2023-12-26 10:17:46,976][123090] Updated weights for policy 1, policy_version 1331245 (0.0009) [2023-12-26 10:17:47,040][123090] Updated weights for policy 1, policy_version 1331255 (0.0009) [2023-12-26 10:17:47,249][123091] Updated weights for policy 0, policy_version 1340697 (0.0010) [2023-12-26 10:17:47,311][123091] Updated weights for policy 0, policy_version 1340707 (0.0011) [2023-12-26 10:17:47,365][123091] Updated weights for policy 0, policy_version 1340717 (0.0010) [2023-12-26 10:17:47,761][123090] Updated weights for policy 1, policy_version 1331265 (0.0006) [2023-12-26 10:17:47,829][123090] Updated weights for policy 1, policy_version 1331275 (0.0008) [2023-12-26 10:17:47,888][123090] Updated weights for policy 1, policy_version 1331285 (0.0008) [2023-12-26 10:17:47,952][123090] Updated weights for policy 1, policy_version 1331295 (0.0009) [2023-12-26 10:17:48,175][123091] Updated weights for policy 0, policy_version 1340727 (0.0011) [2023-12-26 10:17:48,237][123091] Updated weights for policy 0, policy_version 1340737 (0.0010) [2023-12-26 10:17:48,299][123091] Updated weights for policy 0, policy_version 1340747 (0.0011) [2023-12-26 10:17:48,722][123090] Updated weights for policy 1, policy_version 1331305 (0.0006) [2023-12-26 10:17:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17605.9). Total num frames: 684048384. Throughput: 0: 8795.9, 1: 8793.2. Samples: 684063204. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:48,785][121949] Avg episode reward: [(0, '6310.203'), (1, '5308.451')] [2023-12-26 10:17:48,787][123090] Updated weights for policy 1, policy_version 1331315 (0.0009) [2023-12-26 10:17:48,856][123090] Updated weights for policy 1, policy_version 1331325 (0.0009) [2023-12-26 10:17:49,146][123091] Updated weights for policy 0, policy_version 1340757 (0.0010) [2023-12-26 10:17:49,194][123091] Updated weights for policy 0, policy_version 1340767 (0.0010) [2023-12-26 10:17:49,254][123091] Updated weights for policy 0, policy_version 1340777 (0.0011) [2023-12-26 10:17:49,653][123090] Updated weights for policy 1, policy_version 1331335 (0.0009) [2023-12-26 10:17:49,708][123090] Updated weights for policy 1, policy_version 1331345 (0.0008) [2023-12-26 10:17:49,779][123090] Updated weights for policy 1, policy_version 1331355 (0.0009) [2023-12-26 10:17:50,122][123091] Updated weights for policy 0, policy_version 1340787 (0.0011) [2023-12-26 10:17:50,180][123091] Updated weights for policy 0, policy_version 1340797 (0.0010) [2023-12-26 10:17:50,232][123091] Updated weights for policy 0, policy_version 1340807 (0.0010) [2023-12-26 10:17:50,624][123090] Updated weights for policy 1, policy_version 1331365 (0.0009) [2023-12-26 10:17:50,677][123090] Updated weights for policy 1, policy_version 1331375 (0.0009) [2023-12-26 10:17:50,726][123090] Updated weights for policy 1, policy_version 1331385 (0.0009) [2023-12-26 10:17:51,094][123091] Updated weights for policy 0, policy_version 1340817 (0.0010) [2023-12-26 10:17:51,164][123091] Updated weights for policy 0, policy_version 1340827 (0.0010) [2023-12-26 10:17:51,225][123091] Updated weights for policy 0, policy_version 1340837 (0.0011) [2023-12-26 10:17:51,284][123091] Updated weights for policy 0, policy_version 1340847 (0.0011) [2023-12-26 10:17:51,614][123090] Updated weights for policy 1, policy_version 1331395 (0.0008) [2023-12-26 10:17:51,680][123090] Updated weights for policy 1, policy_version 1331405 (0.0009) [2023-12-26 10:17:51,757][123090] Updated weights for policy 1, policy_version 1331415 (0.0009) [2023-12-26 10:17:52,016][123091] Updated weights for policy 0, policy_version 1340857 (0.0009) [2023-12-26 10:17:52,074][123091] Updated weights for policy 0, policy_version 1340867 (0.0009) [2023-12-26 10:17:52,140][123091] Updated weights for policy 0, policy_version 1340877 (0.0009) [2023-12-26 10:17:52,618][123090] Updated weights for policy 1, policy_version 1331425 (0.0010) [2023-12-26 10:17:52,689][123090] Updated weights for policy 1, policy_version 1331435 (0.0010) [2023-12-26 10:17:52,749][123090] Updated weights for policy 1, policy_version 1331445 (0.0009) [2023-12-26 10:17:52,810][123090] Updated weights for policy 1, policy_version 1331455 (0.0009) [2023-12-26 10:17:52,982][123091] Updated weights for policy 0, policy_version 1340887 (0.0010) [2023-12-26 10:17:53,052][123091] Updated weights for policy 0, policy_version 1340897 (0.0010) [2023-12-26 10:17:53,117][123091] Updated weights for policy 0, policy_version 1340907 (0.0010) [2023-12-26 10:17:53,550][123090] Updated weights for policy 1, policy_version 1331465 (0.0009) [2023-12-26 10:17:53,609][123090] Updated weights for policy 1, policy_version 1331475 (0.0009) [2023-12-26 10:17:53,674][123090] Updated weights for policy 1, policy_version 1331485 (0.0008) [2023-12-26 10:17:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 684138496. Throughput: 0: 8718.5, 1: 8751.8. Samples: 684113644. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:53,785][121949] Avg episode reward: [(0, '6212.769'), (1, '5200.471')] [2023-12-26 10:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001340912_343277568.pth... [2023-12-26 10:17:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001331488_340860928.pth... [2023-12-26 10:17:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001330432_340590592.pth [2023-12-26 10:17:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001339920_343023616.pth [2023-12-26 10:17:53,969][123091] Updated weights for policy 0, policy_version 1340917 (0.0010) [2023-12-26 10:17:54,026][123091] Updated weights for policy 0, policy_version 1340927 (0.0011) [2023-12-26 10:17:54,086][123091] Updated weights for policy 0, policy_version 1340937 (0.0009) [2023-12-26 10:17:54,552][123090] Updated weights for policy 1, policy_version 1331495 (0.0009) [2023-12-26 10:17:54,621][123090] Updated weights for policy 1, policy_version 1331505 (0.0009) [2023-12-26 10:17:54,687][123090] Updated weights for policy 1, policy_version 1331515 (0.0007) [2023-12-26 10:17:54,839][123091] Updated weights for policy 0, policy_version 1340947 (0.0011) [2023-12-26 10:17:54,894][123091] Updated weights for policy 0, policy_version 1340957 (0.0011) [2023-12-26 10:17:54,959][123091] Updated weights for policy 0, policy_version 1340967 (0.0010) [2023-12-26 10:17:55,501][123090] Updated weights for policy 1, policy_version 1331525 (0.0007) [2023-12-26 10:17:55,566][123090] Updated weights for policy 1, policy_version 1331535 (0.0009) [2023-12-26 10:17:55,635][123090] Updated weights for policy 1, policy_version 1331545 (0.0010) [2023-12-26 10:17:55,677][123091] Updated weights for policy 0, policy_version 1340977 (0.0011) [2023-12-26 10:17:55,741][123091] Updated weights for policy 0, policy_version 1340987 (0.0008) [2023-12-26 10:17:55,797][123091] Updated weights for policy 0, policy_version 1340997 (0.0009) [2023-12-26 10:17:55,857][123091] Updated weights for policy 0, policy_version 1341007 (0.0009) [2023-12-26 10:17:56,445][123090] Updated weights for policy 1, policy_version 1331555 (0.0008) [2023-12-26 10:17:56,507][123090] Updated weights for policy 1, policy_version 1331565 (0.0005) [2023-12-26 10:17:56,576][123090] Updated weights for policy 1, policy_version 1331575 (0.0010) [2023-12-26 10:17:56,698][123091] Updated weights for policy 0, policy_version 1341017 (0.0010) [2023-12-26 10:17:56,755][123091] Updated weights for policy 0, policy_version 1341027 (0.0009) [2023-12-26 10:17:56,807][123091] Updated weights for policy 0, policy_version 1341037 (0.0009) [2023-12-26 10:17:57,230][123090] Updated weights for policy 1, policy_version 1331585 (0.0007) [2023-12-26 10:17:57,294][123090] Updated weights for policy 1, policy_version 1331595 (0.0008) [2023-12-26 10:17:57,353][123090] Updated weights for policy 1, policy_version 1331605 (0.0009) [2023-12-26 10:17:57,415][123090] Updated weights for policy 1, policy_version 1331616 (0.0010) [2023-12-26 10:17:57,612][123091] Updated weights for policy 0, policy_version 1341048 (0.0009) [2023-12-26 10:17:57,667][123091] Updated weights for policy 0, policy_version 1341058 (0.0009) [2023-12-26 10:17:57,727][123091] Updated weights for policy 0, policy_version 1341068 (0.0007) [2023-12-26 10:17:58,232][123090] Updated weights for policy 1, policy_version 1331626 (0.0009) [2023-12-26 10:17:58,285][123090] Updated weights for policy 1, policy_version 1331636 (0.0010) [2023-12-26 10:17:58,348][123090] Updated weights for policy 1, policy_version 1331646 (0.0009) [2023-12-26 10:17:58,581][123091] Updated weights for policy 0, policy_version 1341079 (0.0010) [2023-12-26 10:17:58,654][123091] Updated weights for policy 0, policy_version 1341089 (0.0007) [2023-12-26 10:17:58,736][123091] Updated weights for policy 0, policy_version 1341099 (0.0007) [2023-12-26 10:17:58,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 684228608. Throughput: 0: 8710.5, 1: 8753.8. Samples: 684218420. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:17:58,785][121949] Avg episode reward: [(0, '6127.173'), (1, '5347.358')] [2023-12-26 10:17:59,304][123090] Updated weights for policy 1, policy_version 1331656 (0.0010) [2023-12-26 10:17:59,376][123090] Updated weights for policy 1, policy_version 1331666 (0.0008) [2023-12-26 10:17:59,441][123090] Updated weights for policy 1, policy_version 1331676 (0.0009) [2023-12-26 10:17:59,608][123091] Updated weights for policy 0, policy_version 1341109 (0.0007) [2023-12-26 10:17:59,680][123091] Updated weights for policy 0, policy_version 1341119 (0.0005) [2023-12-26 10:17:59,753][123091] Updated weights for policy 0, policy_version 1341129 (0.0005) [2023-12-26 10:18:00,310][123090] Updated weights for policy 1, policy_version 1331686 (0.0010) [2023-12-26 10:18:00,373][123090] Updated weights for policy 1, policy_version 1331696 (0.0009) [2023-12-26 10:18:00,435][123090] Updated weights for policy 1, policy_version 1331706 (0.0010) [2023-12-26 10:18:00,496][123091] Updated weights for policy 0, policy_version 1341139 (0.0005) [2023-12-26 10:18:00,542][123091] Updated weights for policy 0, policy_version 1341149 (0.0005) [2023-12-26 10:18:00,593][123091] Updated weights for policy 0, policy_version 1341159 (0.0005) [2023-12-26 10:18:01,294][123090] Updated weights for policy 1, policy_version 1331716 (0.0010) [2023-12-26 10:18:01,299][123091] Updated weights for policy 0, policy_version 1341169 (0.0007) [2023-12-26 10:18:01,354][123090] Updated weights for policy 1, policy_version 1331726 (0.0010) [2023-12-26 10:18:01,357][123091] Updated weights for policy 0, policy_version 1341179 (0.0008) [2023-12-26 10:18:01,420][123090] Updated weights for policy 1, policy_version 1331736 (0.0011) [2023-12-26 10:18:01,423][123091] Updated weights for policy 0, policy_version 1341189 (0.0006) [2023-12-26 10:18:01,484][123091] Updated weights for policy 0, policy_version 1341199 (0.0007) [2023-12-26 10:18:02,218][123090] Updated weights for policy 1, policy_version 1331746 (0.0009) [2023-12-26 10:18:02,284][123090] Updated weights for policy 1, policy_version 1331756 (0.0007) [2023-12-26 10:18:02,346][123090] Updated weights for policy 1, policy_version 1331766 (0.0008) [2023-12-26 10:18:02,355][123091] Updated weights for policy 0, policy_version 1341209 (0.0008) [2023-12-26 10:18:02,404][123090] Updated weights for policy 1, policy_version 1331776 (0.0008) [2023-12-26 10:18:02,418][123091] Updated weights for policy 0, policy_version 1341219 (0.0009) [2023-12-26 10:18:02,472][123091] Updated weights for policy 0, policy_version 1341229 (0.0009) [2023-12-26 10:18:03,185][123090] Updated weights for policy 1, policy_version 1331786 (0.0009) [2023-12-26 10:18:03,237][123090] Updated weights for policy 1, policy_version 1331796 (0.0008) [2023-12-26 10:18:03,288][123090] Updated weights for policy 1, policy_version 1331807 (0.0008) [2023-12-26 10:18:03,304][123091] Updated weights for policy 0, policy_version 1341239 (0.0009) [2023-12-26 10:18:03,353][123091] Updated weights for policy 0, policy_version 1341249 (0.0009) [2023-12-26 10:18:03,402][123091] Updated weights for policy 0, policy_version 1341259 (0.0008) [2023-12-26 10:18:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 684310528. Throughput: 0: 8686.8, 1: 8775.6. Samples: 684321112. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:03,785][121949] Avg episode reward: [(0, '6166.786'), (1, '5476.250')] [2023-12-26 10:18:04,118][123090] Updated weights for policy 1, policy_version 1331817 (0.0005) [2023-12-26 10:18:04,140][123091] Updated weights for policy 0, policy_version 1341269 (0.0007) [2023-12-26 10:18:04,173][123090] Updated weights for policy 1, policy_version 1331827 (0.0005) [2023-12-26 10:18:04,203][123091] Updated weights for policy 0, policy_version 1341279 (0.0010) [2023-12-26 10:18:04,230][123090] Updated weights for policy 1, policy_version 1331837 (0.0006) [2023-12-26 10:18:04,260][123091] Updated weights for policy 0, policy_version 1341289 (0.0008) [2023-12-26 10:18:05,050][123090] Updated weights for policy 1, policy_version 1331847 (0.0007) [2023-12-26 10:18:05,103][123091] Updated weights for policy 0, policy_version 1341299 (0.0008) [2023-12-26 10:18:05,129][123090] Updated weights for policy 1, policy_version 1331857 (0.0007) [2023-12-26 10:18:05,159][123091] Updated weights for policy 0, policy_version 1341309 (0.0006) [2023-12-26 10:18:05,185][123090] Updated weights for policy 1, policy_version 1331867 (0.0009) [2023-12-26 10:18:05,215][123091] Updated weights for policy 0, policy_version 1341319 (0.0007) [2023-12-26 10:18:05,926][123090] Updated weights for policy 1, policy_version 1331877 (0.0010) [2023-12-26 10:18:05,980][123090] Updated weights for policy 1, policy_version 1331887 (0.0008) [2023-12-26 10:18:06,038][123090] Updated weights for policy 1, policy_version 1331897 (0.0010) [2023-12-26 10:18:06,040][123091] Updated weights for policy 0, policy_version 1341329 (0.0010) [2023-12-26 10:18:06,104][123091] Updated weights for policy 0, policy_version 1341339 (0.0008) [2023-12-26 10:18:06,164][123091] Updated weights for policy 0, policy_version 1341349 (0.0010) [2023-12-26 10:18:06,224][123091] Updated weights for policy 0, policy_version 1341359 (0.0009) [2023-12-26 10:18:06,901][123090] Updated weights for policy 1, policy_version 1331907 (0.0008) [2023-12-26 10:18:06,959][123090] Updated weights for policy 1, policy_version 1331918 (0.0009) [2023-12-26 10:18:06,981][123091] Updated weights for policy 0, policy_version 1341369 (0.0009) [2023-12-26 10:18:07,015][123090] Updated weights for policy 1, policy_version 1331928 (0.0007) [2023-12-26 10:18:07,043][123091] Updated weights for policy 0, policy_version 1341379 (0.0008) [2023-12-26 10:18:07,103][123091] Updated weights for policy 0, policy_version 1341389 (0.0009) [2023-12-26 10:18:07,767][123090] Updated weights for policy 1, policy_version 1331938 (0.0007) [2023-12-26 10:18:07,824][123090] Updated weights for policy 1, policy_version 1331948 (0.0005) [2023-12-26 10:18:07,891][123090] Updated weights for policy 1, policy_version 1331958 (0.0006) [2023-12-26 10:18:07,963][123090] Updated weights for policy 1, policy_version 1331968 (0.0011) [2023-12-26 10:18:07,988][123091] Updated weights for policy 0, policy_version 1341399 (0.0008) [2023-12-26 10:18:08,041][123091] Updated weights for policy 0, policy_version 1341409 (0.0009) [2023-12-26 10:18:08,090][123091] Updated weights for policy 0, policy_version 1341419 (0.0009) [2023-12-26 10:18:08,762][123090] Updated weights for policy 1, policy_version 1331978 (0.0011) [2023-12-26 10:18:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 684392448. Throughput: 0: 8705.1, 1: 8814.9. Samples: 684374196. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:08,786][121949] Avg episode reward: [(0, '6146.040'), (1, '5602.710')] [2023-12-26 10:18:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001341424_343408640.pth... [2023-12-26 10:18:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001340400_343146496.pth [2023-12-26 10:18:08,825][123090] Updated weights for policy 1, policy_version 1331988 (0.0010) [2023-12-26 10:18:08,886][123090] Updated weights for policy 1, policy_version 1331998 (0.0011) [2023-12-26 10:18:08,898][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001332000_340992000.pth... [2023-12-26 10:18:08,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001330976_340729856.pth [2023-12-26 10:18:08,953][123091] Updated weights for policy 0, policy_version 1341429 (0.0007) [2023-12-26 10:18:09,010][123091] Updated weights for policy 0, policy_version 1341439 (0.0008) [2023-12-26 10:18:09,067][123091] Updated weights for policy 0, policy_version 1341449 (0.0009) [2023-12-26 10:18:09,703][123090] Updated weights for policy 1, policy_version 1332008 (0.0008) [2023-12-26 10:18:09,770][123090] Updated weights for policy 1, policy_version 1332018 (0.0008) [2023-12-26 10:18:09,843][123090] Updated weights for policy 1, policy_version 1332028 (0.0008) [2023-12-26 10:18:09,958][123091] Updated weights for policy 0, policy_version 1341459 (0.0009) [2023-12-26 10:18:10,024][123091] Updated weights for policy 0, policy_version 1341469 (0.0007) [2023-12-26 10:18:10,096][123091] Updated weights for policy 0, policy_version 1341479 (0.0009) [2023-12-26 10:18:10,668][123090] Updated weights for policy 1, policy_version 1332038 (0.0009) [2023-12-26 10:18:10,728][123090] Updated weights for policy 1, policy_version 1332048 (0.0010) [2023-12-26 10:18:10,792][123090] Updated weights for policy 1, policy_version 1332058 (0.0009) [2023-12-26 10:18:10,834][123091] Updated weights for policy 0, policy_version 1341489 (0.0010) [2023-12-26 10:18:10,904][123091] Updated weights for policy 0, policy_version 1341499 (0.0009) [2023-12-26 10:18:10,960][123091] Updated weights for policy 0, policy_version 1341509 (0.0010) [2023-12-26 10:18:11,016][123091] Updated weights for policy 0, policy_version 1341519 (0.0009) [2023-12-26 10:18:11,622][123090] Updated weights for policy 1, policy_version 1332068 (0.0010) [2023-12-26 10:18:11,689][123090] Updated weights for policy 1, policy_version 1332078 (0.0009) [2023-12-26 10:18:11,755][123090] Updated weights for policy 1, policy_version 1332088 (0.0009) [2023-12-26 10:18:11,857][123091] Updated weights for policy 0, policy_version 1341529 (0.0011) [2023-12-26 10:18:11,927][123091] Updated weights for policy 0, policy_version 1341539 (0.0009) [2023-12-26 10:18:11,983][123091] Updated weights for policy 0, policy_version 1341549 (0.0010) [2023-12-26 10:18:12,581][123090] Updated weights for policy 1, policy_version 1332098 (0.0008) [2023-12-26 10:18:12,637][123090] Updated weights for policy 1, policy_version 1332108 (0.0009) [2023-12-26 10:18:12,686][123090] Updated weights for policy 1, policy_version 1332118 (0.0009) [2023-12-26 10:18:12,735][123090] Updated weights for policy 1, policy_version 1332128 (0.0009) [2023-12-26 10:18:12,801][123091] Updated weights for policy 0, policy_version 1341559 (0.0010) [2023-12-26 10:18:12,864][123091] Updated weights for policy 0, policy_version 1341569 (0.0011) [2023-12-26 10:18:12,938][123091] Updated weights for policy 0, policy_version 1341579 (0.0011) [2023-12-26 10:18:13,490][123090] Updated weights for policy 1, policy_version 1332138 (0.0005) [2023-12-26 10:18:13,539][123090] Updated weights for policy 1, policy_version 1332148 (0.0005) [2023-12-26 10:18:13,602][123090] Updated weights for policy 1, policy_version 1332158 (0.0007) [2023-12-26 10:18:13,689][123091] Updated weights for policy 0, policy_version 1341589 (0.0010) [2023-12-26 10:18:13,746][123091] Updated weights for policy 0, policy_version 1341599 (0.0010) [2023-12-26 10:18:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 684482560. Throughput: 0: 8699.0, 1: 8709.6. Samples: 684476692. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:13,785][121949] Avg episode reward: [(0, '6183.203'), (1, '5220.879')] [2023-12-26 10:18:13,816][123091] Updated weights for policy 0, policy_version 1341609 (0.0011) [2023-12-26 10:18:14,330][123090] Updated weights for policy 1, policy_version 1332168 (0.0007) [2023-12-26 10:18:14,401][123090] Updated weights for policy 1, policy_version 1332178 (0.0008) [2023-12-26 10:18:14,463][123090] Updated weights for policy 1, policy_version 1332188 (0.0006) [2023-12-26 10:18:14,627][123091] Updated weights for policy 0, policy_version 1341619 (0.0011) [2023-12-26 10:18:14,685][123091] Updated weights for policy 0, policy_version 1341629 (0.0010) [2023-12-26 10:18:14,732][123091] Updated weights for policy 0, policy_version 1341639 (0.0010) [2023-12-26 10:18:15,220][123090] Updated weights for policy 1, policy_version 1332198 (0.0005) [2023-12-26 10:18:15,291][123090] Updated weights for policy 1, policy_version 1332208 (0.0009) [2023-12-26 10:18:15,363][123090] Updated weights for policy 1, policy_version 1332218 (0.0009) [2023-12-26 10:18:15,544][123091] Updated weights for policy 0, policy_version 1341649 (0.0010) [2023-12-26 10:18:15,606][123091] Updated weights for policy 0, policy_version 1341659 (0.0010) [2023-12-26 10:18:15,676][123091] Updated weights for policy 0, policy_version 1341669 (0.0011) [2023-12-26 10:18:15,743][123091] Updated weights for policy 0, policy_version 1341679 (0.0011) [2023-12-26 10:18:16,165][123090] Updated weights for policy 1, policy_version 1332228 (0.0008) [2023-12-26 10:18:16,229][123090] Updated weights for policy 1, policy_version 1332238 (0.0009) [2023-12-26 10:18:16,299][123090] Updated weights for policy 1, policy_version 1332248 (0.0007) [2023-12-26 10:18:16,456][123091] Updated weights for policy 0, policy_version 1341689 (0.0006) [2023-12-26 10:18:16,504][123091] Updated weights for policy 0, policy_version 1341699 (0.0005) [2023-12-26 10:18:16,556][123091] Updated weights for policy 0, policy_version 1341709 (0.0005) [2023-12-26 10:18:17,107][123090] Updated weights for policy 1, policy_version 1332258 (0.0007) [2023-12-26 10:18:17,163][123090] Updated weights for policy 1, policy_version 1332268 (0.0009) [2023-12-26 10:18:17,214][123090] Updated weights for policy 1, policy_version 1332278 (0.0008) [2023-12-26 10:18:17,227][123091] Updated weights for policy 0, policy_version 1341719 (0.0009) [2023-12-26 10:18:17,273][123090] Updated weights for policy 1, policy_version 1332288 (0.0006) [2023-12-26 10:18:17,283][123091] Updated weights for policy 0, policy_version 1341729 (0.0010) [2023-12-26 10:18:17,345][123091] Updated weights for policy 0, policy_version 1341739 (0.0010) [2023-12-26 10:18:17,991][123090] Updated weights for policy 1, policy_version 1332298 (0.0005) [2023-12-26 10:18:18,053][123090] Updated weights for policy 1, policy_version 1332308 (0.0008) [2023-12-26 10:18:18,107][123090] Updated weights for policy 1, policy_version 1332318 (0.0008) [2023-12-26 10:18:18,169][123091] Updated weights for policy 0, policy_version 1341749 (0.0009) [2023-12-26 10:18:18,223][123091] Updated weights for policy 0, policy_version 1341759 (0.0007) [2023-12-26 10:18:18,277][123091] Updated weights for policy 0, policy_version 1341769 (0.0005) [2023-12-26 10:18:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 684572672. Throughput: 0: 8784.0, 1: 8741.9. Samples: 684585916. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:18,785][121949] Avg episode reward: [(0, '6232.674'), (1, '5074.488')] [2023-12-26 10:18:18,897][123090] Updated weights for policy 1, policy_version 1332328 (0.0009) [2023-12-26 10:18:18,948][123090] Updated weights for policy 1, policy_version 1332339 (0.0010) [2023-12-26 10:18:19,008][123090] Updated weights for policy 1, policy_version 1332349 (0.0008) [2023-12-26 10:18:19,097][123091] Updated weights for policy 0, policy_version 1341779 (0.0007) [2023-12-26 10:18:19,155][123091] Updated weights for policy 0, policy_version 1341789 (0.0010) [2023-12-26 10:18:19,220][123091] Updated weights for policy 0, policy_version 1341799 (0.0010) [2023-12-26 10:18:19,879][123090] Updated weights for policy 1, policy_version 1332359 (0.0009) [2023-12-26 10:18:19,946][123090] Updated weights for policy 1, policy_version 1332369 (0.0009) [2023-12-26 10:18:20,002][123090] Updated weights for policy 1, policy_version 1332379 (0.0010) [2023-12-26 10:18:20,081][123091] Updated weights for policy 0, policy_version 1341809 (0.0009) [2023-12-26 10:18:20,149][123091] Updated weights for policy 0, policy_version 1341819 (0.0007) [2023-12-26 10:18:20,219][123091] Updated weights for policy 0, policy_version 1341829 (0.0006) [2023-12-26 10:18:20,291][123091] Updated weights for policy 0, policy_version 1341839 (0.0006) [2023-12-26 10:18:20,890][123091] Updated weights for policy 0, policy_version 1341849 (0.0006) [2023-12-26 10:18:20,901][123090] Updated weights for policy 1, policy_version 1332389 (0.0010) [2023-12-26 10:18:20,958][123090] Updated weights for policy 1, policy_version 1332399 (0.0011) [2023-12-26 10:18:20,964][123091] Updated weights for policy 0, policy_version 1341859 (0.0006) [2023-12-26 10:18:21,025][123090] Updated weights for policy 1, policy_version 1332409 (0.0008) [2023-12-26 10:18:21,028][123091] Updated weights for policy 0, policy_version 1341869 (0.0007) [2023-12-26 10:18:21,778][123091] Updated weights for policy 0, policy_version 1341879 (0.0010) [2023-12-26 10:18:21,842][123090] Updated weights for policy 1, policy_version 1332419 (0.0009) [2023-12-26 10:18:21,842][123091] Updated weights for policy 0, policy_version 1341889 (0.0011) [2023-12-26 10:18:21,901][123091] Updated weights for policy 0, policy_version 1341899 (0.0011) [2023-12-26 10:18:21,905][123090] Updated weights for policy 1, policy_version 1332429 (0.0011) [2023-12-26 10:18:21,969][123090] Updated weights for policy 1, policy_version 1332439 (0.0010) [2023-12-26 10:18:22,731][123091] Updated weights for policy 0, policy_version 1341909 (0.0011) [2023-12-26 10:18:22,755][123090] Updated weights for policy 1, policy_version 1332449 (0.0007) [2023-12-26 10:18:22,788][123091] Updated weights for policy 0, policy_version 1341919 (0.0009) [2023-12-26 10:18:22,827][123090] Updated weights for policy 1, policy_version 1332459 (0.0007) [2023-12-26 10:18:22,843][123091] Updated weights for policy 0, policy_version 1341929 (0.0008) [2023-12-26 10:18:22,894][123090] Updated weights for policy 1, policy_version 1332469 (0.0011) [2023-12-26 10:18:22,959][123090] Updated weights for policy 1, policy_version 1332479 (0.0011) [2023-12-26 10:18:23,714][123091] Updated weights for policy 0, policy_version 1341939 (0.0008) [2023-12-26 10:18:23,752][123090] Updated weights for policy 1, policy_version 1332489 (0.0006) [2023-12-26 10:18:23,767][123091] Updated weights for policy 0, policy_version 1341949 (0.0009) [2023-12-26 10:18:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 684654592. Throughput: 0: 8791.4, 1: 8660.1. Samples: 684637856. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:23,784][121949] Avg episode reward: [(0, '6241.475'), (1, '5370.166')] [2023-12-26 10:18:23,813][123090] Updated weights for policy 1, policy_version 1332499 (0.0008) [2023-12-26 10:18:23,826][123091] Updated weights for policy 0, policy_version 1341959 (0.0006) [2023-12-26 10:18:23,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001341968_343547904.pth... [2023-12-26 10:18:23,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001340912_343277568.pth [2023-12-26 10:18:23,880][123090] Updated weights for policy 1, policy_version 1332509 (0.0010) [2023-12-26 10:18:23,898][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001332512_341123072.pth... [2023-12-26 10:18:23,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001331488_340860928.pth [2023-12-26 10:18:24,554][123091] Updated weights for policy 0, policy_version 1341969 (0.0006) [2023-12-26 10:18:24,611][123091] Updated weights for policy 0, policy_version 1341979 (0.0011) [2023-12-26 10:18:24,670][123091] Updated weights for policy 0, policy_version 1341989 (0.0011) [2023-12-26 10:18:24,718][123090] Updated weights for policy 1, policy_version 1332519 (0.0008) [2023-12-26 10:18:24,729][123091] Updated weights for policy 0, policy_version 1341999 (0.0009) [2023-12-26 10:18:24,777][123090] Updated weights for policy 1, policy_version 1332529 (0.0005) [2023-12-26 10:18:24,848][123090] Updated weights for policy 1, policy_version 1332539 (0.0005) [2023-12-26 10:18:25,562][123091] Updated weights for policy 0, policy_version 1342009 (0.0006) [2023-12-26 10:18:25,593][123090] Updated weights for policy 1, policy_version 1332549 (0.0007) [2023-12-26 10:18:25,638][123091] Updated weights for policy 0, policy_version 1342019 (0.0006) [2023-12-26 10:18:25,653][123090] Updated weights for policy 1, policy_version 1332559 (0.0007) [2023-12-26 10:18:25,698][123091] Updated weights for policy 0, policy_version 1342029 (0.0006) [2023-12-26 10:18:25,713][123090] Updated weights for policy 1, policy_version 1332569 (0.0005) [2023-12-26 10:18:26,386][123091] Updated weights for policy 0, policy_version 1342039 (0.0006) [2023-12-26 10:18:26,408][123090] Updated weights for policy 1, policy_version 1332579 (0.0009) [2023-12-26 10:18:26,457][123091] Updated weights for policy 0, policy_version 1342049 (0.0008) [2023-12-26 10:18:26,468][123090] Updated weights for policy 1, policy_version 1332589 (0.0007) [2023-12-26 10:18:26,520][123091] Updated weights for policy 0, policy_version 1342059 (0.0011) [2023-12-26 10:18:26,527][123090] Updated weights for policy 1, policy_version 1332599 (0.0006) [2023-12-26 10:18:27,188][123091] Updated weights for policy 0, policy_version 1342069 (0.0008) [2023-12-26 10:18:27,240][123091] Updated weights for policy 0, policy_version 1342079 (0.0005) [2023-12-26 10:18:27,285][123091] Updated weights for policy 0, policy_version 1342089 (0.0005) [2023-12-26 10:18:27,396][123090] Updated weights for policy 1, policy_version 1332609 (0.0009) [2023-12-26 10:18:27,456][123090] Updated weights for policy 1, policy_version 1332619 (0.0009) [2023-12-26 10:18:27,519][123090] Updated weights for policy 1, policy_version 1332629 (0.0009) [2023-12-26 10:18:27,571][123090] Updated weights for policy 1, policy_version 1332639 (0.0009) [2023-12-26 10:18:28,063][123091] Updated weights for policy 0, policy_version 1342099 (0.0007) [2023-12-26 10:18:28,124][123091] Updated weights for policy 0, policy_version 1342109 (0.0010) [2023-12-26 10:18:28,193][123091] Updated weights for policy 0, policy_version 1342119 (0.0010) [2023-12-26 10:18:28,385][123090] Updated weights for policy 1, policy_version 1332649 (0.0007) [2023-12-26 10:18:28,451][123090] Updated weights for policy 1, policy_version 1332659 (0.0010) [2023-12-26 10:18:28,525][123090] Updated weights for policy 1, policy_version 1332669 (0.0008) [2023-12-26 10:18:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 684752896. Throughput: 0: 8819.3, 1: 8710.6. Samples: 684745084. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:28,785][121949] Avg episode reward: [(0, '6285.237'), (1, '5599.710')] [2023-12-26 10:18:28,802][123091] Updated weights for policy 0, policy_version 1342129 (0.0005) [2023-12-26 10:18:28,863][123091] Updated weights for policy 0, policy_version 1342139 (0.0005) [2023-12-26 10:18:28,922][123091] Updated weights for policy 0, policy_version 1342149 (0.0010) [2023-12-26 10:18:28,976][123091] Updated weights for policy 0, policy_version 1342159 (0.0008) [2023-12-26 10:18:29,212][123090] Updated weights for policy 1, policy_version 1332679 (0.0009) [2023-12-26 10:18:29,274][123090] Updated weights for policy 1, policy_version 1332689 (0.0010) [2023-12-26 10:18:29,330][123090] Updated weights for policy 1, policy_version 1332699 (0.0010) [2023-12-26 10:18:29,701][123091] Updated weights for policy 0, policy_version 1342169 (0.0010) [2023-12-26 10:18:29,756][123091] Updated weights for policy 0, policy_version 1342179 (0.0010) [2023-12-26 10:18:29,804][123091] Updated weights for policy 0, policy_version 1342189 (0.0008) [2023-12-26 10:18:30,163][123090] Updated weights for policy 1, policy_version 1332709 (0.0008) [2023-12-26 10:18:30,225][123090] Updated weights for policy 1, policy_version 1332719 (0.0006) [2023-12-26 10:18:30,281][123090] Updated weights for policy 1, policy_version 1332729 (0.0008) [2023-12-26 10:18:30,600][123091] Updated weights for policy 0, policy_version 1342199 (0.0007) [2023-12-26 10:18:30,663][123091] Updated weights for policy 0, policy_version 1342209 (0.0005) [2023-12-26 10:18:30,741][123091] Updated weights for policy 0, policy_version 1342219 (0.0005) [2023-12-26 10:18:31,065][123090] Updated weights for policy 1, policy_version 1332739 (0.0009) [2023-12-26 10:18:31,132][123090] Updated weights for policy 1, policy_version 1332749 (0.0010) [2023-12-26 10:18:31,199][123090] Updated weights for policy 1, policy_version 1332759 (0.0010) [2023-12-26 10:18:31,429][123091] Updated weights for policy 0, policy_version 1342229 (0.0006) [2023-12-26 10:18:31,496][123091] Updated weights for policy 0, policy_version 1342239 (0.0006) [2023-12-26 10:18:31,570][123091] Updated weights for policy 0, policy_version 1342249 (0.0008) [2023-12-26 10:18:32,043][123090] Updated weights for policy 1, policy_version 1332769 (0.0011) [2023-12-26 10:18:32,111][123090] Updated weights for policy 1, policy_version 1332779 (0.0009) [2023-12-26 10:18:32,180][123090] Updated weights for policy 1, policy_version 1332789 (0.0010) [2023-12-26 10:18:32,251][123090] Updated weights for policy 1, policy_version 1332799 (0.0010) [2023-12-26 10:18:32,394][123091] Updated weights for policy 0, policy_version 1342259 (0.0008) [2023-12-26 10:18:32,448][123091] Updated weights for policy 0, policy_version 1342269 (0.0008) [2023-12-26 10:18:32,508][123091] Updated weights for policy 0, policy_version 1342279 (0.0008) [2023-12-26 10:18:32,984][123090] Updated weights for policy 1, policy_version 1332809 (0.0006) [2023-12-26 10:18:33,042][123090] Updated weights for policy 1, policy_version 1332819 (0.0008) [2023-12-26 10:18:33,096][123090] Updated weights for policy 1, policy_version 1332829 (0.0008) [2023-12-26 10:18:33,296][123091] Updated weights for policy 0, policy_version 1342289 (0.0008) [2023-12-26 10:18:33,343][123091] Updated weights for policy 0, policy_version 1342299 (0.0010) [2023-12-26 10:18:33,390][123091] Updated weights for policy 0, policy_version 1342309 (0.0010) [2023-12-26 10:18:33,452][123091] Updated weights for policy 0, policy_version 1342319 (0.0010) [2023-12-26 10:18:33,754][123090] Updated weights for policy 1, policy_version 1332839 (0.0007) [2023-12-26 10:18:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 684843008. Throughput: 0: 8893.9, 1: 8733.1. Samples: 684856416. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:33,785][121949] Avg episode reward: [(0, '6328.402'), (1, '5613.514')] [2023-12-26 10:18:33,817][123090] Updated weights for policy 1, policy_version 1332849 (0.0008) [2023-12-26 10:18:33,889][123090] Updated weights for policy 1, policy_version 1332859 (0.0005) [2023-12-26 10:18:34,208][123091] Updated weights for policy 0, policy_version 1342329 (0.0007) [2023-12-26 10:18:34,276][123091] Updated weights for policy 0, policy_version 1342339 (0.0009) [2023-12-26 10:18:34,351][123091] Updated weights for policy 0, policy_version 1342349 (0.0008) [2023-12-26 10:18:34,592][123090] Updated weights for policy 1, policy_version 1332869 (0.0006) [2023-12-26 10:18:34,664][123090] Updated weights for policy 1, policy_version 1332879 (0.0007) [2023-12-26 10:18:34,733][123090] Updated weights for policy 1, policy_version 1332889 (0.0009) [2023-12-26 10:18:34,975][123091] Updated weights for policy 0, policy_version 1342359 (0.0005) [2023-12-26 10:18:35,035][123091] Updated weights for policy 0, policy_version 1342369 (0.0005) [2023-12-26 10:18:35,095][123091] Updated weights for policy 0, policy_version 1342379 (0.0005) [2023-12-26 10:18:35,513][123090] Updated weights for policy 1, policy_version 1332899 (0.0007) [2023-12-26 10:18:35,587][123090] Updated weights for policy 1, policy_version 1332909 (0.0005) [2023-12-26 10:18:35,651][123090] Updated weights for policy 1, policy_version 1332919 (0.0005) [2023-12-26 10:18:35,834][123091] Updated weights for policy 0, policy_version 1342389 (0.0009) [2023-12-26 10:18:35,899][123091] Updated weights for policy 0, policy_version 1342399 (0.0010) [2023-12-26 10:18:35,954][123091] Updated weights for policy 0, policy_version 1342409 (0.0010) [2023-12-26 10:18:36,343][123090] Updated weights for policy 1, policy_version 1332929 (0.0005) [2023-12-26 10:18:36,422][123090] Updated weights for policy 1, policy_version 1332939 (0.0005) [2023-12-26 10:18:36,491][123090] Updated weights for policy 1, policy_version 1332949 (0.0009) [2023-12-26 10:18:36,569][123090] Updated weights for policy 1, policy_version 1332959 (0.0010) [2023-12-26 10:18:36,749][123091] Updated weights for policy 0, policy_version 1342419 (0.0010) [2023-12-26 10:18:36,806][123091] Updated weights for policy 0, policy_version 1342429 (0.0006) [2023-12-26 10:18:36,872][123091] Updated weights for policy 0, policy_version 1342439 (0.0007) [2023-12-26 10:18:37,372][123090] Updated weights for policy 1, policy_version 1332969 (0.0010) [2023-12-26 10:18:37,444][123090] Updated weights for policy 1, policy_version 1332979 (0.0009) [2023-12-26 10:18:37,517][123091] Updated weights for policy 0, policy_version 1342449 (0.0006) [2023-12-26 10:18:37,525][123090] Updated weights for policy 1, policy_version 1332989 (0.0010) [2023-12-26 10:18:37,573][123091] Updated weights for policy 0, policy_version 1342459 (0.0006) [2023-12-26 10:18:37,627][123091] Updated weights for policy 0, policy_version 1342469 (0.0007) [2023-12-26 10:18:37,678][123091] Updated weights for policy 0, policy_version 1342479 (0.0008) [2023-12-26 10:18:38,373][123090] Updated weights for policy 1, policy_version 1332999 (0.0010) [2023-12-26 10:18:38,438][123090] Updated weights for policy 1, policy_version 1333009 (0.0011) [2023-12-26 10:18:38,462][123091] Updated weights for policy 0, policy_version 1342489 (0.0007) [2023-12-26 10:18:38,508][123090] Updated weights for policy 1, policy_version 1333019 (0.0011) [2023-12-26 10:18:38,529][123091] Updated weights for policy 0, policy_version 1342499 (0.0007) [2023-12-26 10:18:38,597][123091] Updated weights for policy 0, policy_version 1342509 (0.0009) [2023-12-26 10:18:38,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 684941312. Throughput: 0: 8961.3, 1: 8793.0. Samples: 684912588. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:38,785][121949] Avg episode reward: [(0, '6308.775'), (1, '5440.632')] [2023-12-26 10:18:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001342512_343687168.pth... [2023-12-26 10:18:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001333024_341254144.pth... [2023-12-26 10:18:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001341424_343408640.pth [2023-12-26 10:18:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001332000_340992000.pth [2023-12-26 10:18:39,318][123090] Updated weights for policy 1, policy_version 1333029 (0.0008) [2023-12-26 10:18:39,389][123090] Updated weights for policy 1, policy_version 1333039 (0.0009) [2023-12-26 10:18:39,445][123091] Updated weights for policy 0, policy_version 1342519 (0.0009) [2023-12-26 10:18:39,458][123090] Updated weights for policy 1, policy_version 1333049 (0.0009) [2023-12-26 10:18:39,506][123091] Updated weights for policy 0, policy_version 1342529 (0.0009) [2023-12-26 10:18:39,561][123091] Updated weights for policy 0, policy_version 1342539 (0.0009) [2023-12-26 10:18:40,326][123090] Updated weights for policy 1, policy_version 1333059 (0.0009) [2023-12-26 10:18:40,394][123090] Updated weights for policy 1, policy_version 1333069 (0.0010) [2023-12-26 10:18:40,418][123091] Updated weights for policy 0, policy_version 1342549 (0.0008) [2023-12-26 10:18:40,462][123090] Updated weights for policy 1, policy_version 1333079 (0.0011) [2023-12-26 10:18:40,474][123091] Updated weights for policy 0, policy_version 1342559 (0.0009) [2023-12-26 10:18:40,536][123091] Updated weights for policy 0, policy_version 1342569 (0.0010) [2023-12-26 10:18:41,241][123090] Updated weights for policy 1, policy_version 1333089 (0.0010) [2023-12-26 10:18:41,302][123090] Updated weights for policy 1, policy_version 1333099 (0.0008) [2023-12-26 10:18:41,381][123090] Updated weights for policy 1, policy_version 1333109 (0.0007) [2023-12-26 10:18:41,439][123091] Updated weights for policy 0, policy_version 1342579 (0.0009) [2023-12-26 10:18:41,452][123090] Updated weights for policy 1, policy_version 1333119 (0.0008) [2023-12-26 10:18:41,493][123091] Updated weights for policy 0, policy_version 1342589 (0.0009) [2023-12-26 10:18:41,563][123091] Updated weights for policy 0, policy_version 1342599 (0.0008) [2023-12-26 10:18:42,297][123090] Updated weights for policy 1, policy_version 1333129 (0.0010) [2023-12-26 10:18:42,366][123090] Updated weights for policy 1, policy_version 1333139 (0.0010) [2023-12-26 10:18:42,436][123090] Updated weights for policy 1, policy_version 1333149 (0.0009) [2023-12-26 10:18:42,456][123091] Updated weights for policy 0, policy_version 1342609 (0.0009) [2023-12-26 10:18:42,506][123091] Updated weights for policy 0, policy_version 1342619 (0.0010) [2023-12-26 10:18:42,558][123091] Updated weights for policy 0, policy_version 1342629 (0.0010) [2023-12-26 10:18:42,620][123091] Updated weights for policy 0, policy_version 1342639 (0.0010) [2023-12-26 10:18:43,113][123090] Updated weights for policy 1, policy_version 1333159 (0.0010) [2023-12-26 10:18:43,164][123090] Updated weights for policy 1, policy_version 1333169 (0.0010) [2023-12-26 10:18:43,211][123090] Updated weights for policy 1, policy_version 1333179 (0.0010) [2023-12-26 10:18:43,527][123091] Updated weights for policy 0, policy_version 1342649 (0.0006) [2023-12-26 10:18:43,590][123091] Updated weights for policy 0, policy_version 1342659 (0.0005) [2023-12-26 10:18:43,638][123091] Updated weights for policy 0, policy_version 1342669 (0.0006) [2023-12-26 10:18:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 685023232. Throughput: 0: 8928.8, 1: 8763.5. Samples: 685014568. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:43,785][121949] Avg episode reward: [(0, '6280.409'), (1, '5467.533')] [2023-12-26 10:18:44,058][123090] Updated weights for policy 1, policy_version 1333189 (0.0010) [2023-12-26 10:18:44,112][123090] Updated weights for policy 1, policy_version 1333199 (0.0009) [2023-12-26 10:18:44,173][123090] Updated weights for policy 1, policy_version 1333209 (0.0009) [2023-12-26 10:18:44,400][123091] Updated weights for policy 0, policy_version 1342679 (0.0009) [2023-12-26 10:18:44,463][123091] Updated weights for policy 0, policy_version 1342689 (0.0011) [2023-12-26 10:18:44,514][123091] Updated weights for policy 0, policy_version 1342699 (0.0010) [2023-12-26 10:18:44,924][123090] Updated weights for policy 1, policy_version 1333219 (0.0009) [2023-12-26 10:18:44,978][123090] Updated weights for policy 1, policy_version 1333229 (0.0009) [2023-12-26 10:18:45,031][123090] Updated weights for policy 1, policy_version 1333239 (0.0009) [2023-12-26 10:18:45,322][123091] Updated weights for policy 0, policy_version 1342709 (0.0010) [2023-12-26 10:18:45,386][123091] Updated weights for policy 0, policy_version 1342719 (0.0010) [2023-12-26 10:18:45,447][123091] Updated weights for policy 0, policy_version 1342729 (0.0010) [2023-12-26 10:18:45,762][123090] Updated weights for policy 1, policy_version 1333249 (0.0009) [2023-12-26 10:18:45,816][123090] Updated weights for policy 1, policy_version 1333259 (0.0005) [2023-12-26 10:18:45,871][123090] Updated weights for policy 1, policy_version 1333269 (0.0005) [2023-12-26 10:18:45,931][123090] Updated weights for policy 1, policy_version 1333279 (0.0006) [2023-12-26 10:18:46,318][123091] Updated weights for policy 0, policy_version 1342739 (0.0006) [2023-12-26 10:18:46,391][123091] Updated weights for policy 0, policy_version 1342749 (0.0007) [2023-12-26 10:18:46,453][123091] Updated weights for policy 0, policy_version 1342759 (0.0009) [2023-12-26 10:18:46,658][123090] Updated weights for policy 1, policy_version 1333289 (0.0009) [2023-12-26 10:18:46,720][123090] Updated weights for policy 1, policy_version 1333299 (0.0009) [2023-12-26 10:18:46,787][123090] Updated weights for policy 1, policy_version 1333309 (0.0010) [2023-12-26 10:18:47,109][123091] Updated weights for policy 0, policy_version 1342769 (0.0007) [2023-12-26 10:18:47,161][123091] Updated weights for policy 0, policy_version 1342779 (0.0010) [2023-12-26 10:18:47,212][123091] Updated weights for policy 0, policy_version 1342789 (0.0009) [2023-12-26 10:18:47,267][123091] Updated weights for policy 0, policy_version 1342799 (0.0010) [2023-12-26 10:18:47,616][123090] Updated weights for policy 1, policy_version 1333319 (0.0010) [2023-12-26 10:18:47,672][123090] Updated weights for policy 1, policy_version 1333329 (0.0009) [2023-12-26 10:18:47,737][123090] Updated weights for policy 1, policy_version 1333339 (0.0009) [2023-12-26 10:18:48,119][123091] Updated weights for policy 0, policy_version 1342809 (0.0009) [2023-12-26 10:18:48,185][123091] Updated weights for policy 0, policy_version 1342819 (0.0009) [2023-12-26 10:18:48,239][123091] Updated weights for policy 0, policy_version 1342829 (0.0009) [2023-12-26 10:18:48,526][123090] Updated weights for policy 1, policy_version 1333349 (0.0008) [2023-12-26 10:18:48,578][123090] Updated weights for policy 1, policy_version 1333359 (0.0005) [2023-12-26 10:18:48,631][123090] Updated weights for policy 1, policy_version 1333369 (0.0005) [2023-12-26 10:18:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 685113344. Throughput: 0: 8936.5, 1: 8853.1. Samples: 685121644. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:48,785][121949] Avg episode reward: [(0, '6290.625'), (1, '5558.814')] [2023-12-26 10:18:49,074][123091] Updated weights for policy 0, policy_version 1342839 (0.0010) [2023-12-26 10:18:49,127][123091] Updated weights for policy 0, policy_version 1342849 (0.0009) [2023-12-26 10:18:49,173][123091] Updated weights for policy 0, policy_version 1342859 (0.0008) [2023-12-26 10:18:49,484][123090] Updated weights for policy 1, policy_version 1333379 (0.0008) [2023-12-26 10:18:49,550][123090] Updated weights for policy 1, policy_version 1333389 (0.0009) [2023-12-26 10:18:49,616][123090] Updated weights for policy 1, policy_version 1333399 (0.0009) [2023-12-26 10:18:49,980][123091] Updated weights for policy 0, policy_version 1342869 (0.0007) [2023-12-26 10:18:50,044][123091] Updated weights for policy 0, policy_version 1342879 (0.0010) [2023-12-26 10:18:50,098][123091] Updated weights for policy 0, policy_version 1342889 (0.0010) [2023-12-26 10:18:50,394][123090] Updated weights for policy 1, policy_version 1333409 (0.0009) [2023-12-26 10:18:50,445][123090] Updated weights for policy 1, policy_version 1333419 (0.0009) [2023-12-26 10:18:50,500][123090] Updated weights for policy 1, policy_version 1333429 (0.0009) [2023-12-26 10:18:50,564][123090] Updated weights for policy 1, policy_version 1333439 (0.0010) [2023-12-26 10:18:50,947][123091] Updated weights for policy 0, policy_version 1342899 (0.0010) [2023-12-26 10:18:51,004][123091] Updated weights for policy 0, policy_version 1342909 (0.0009) [2023-12-26 10:18:51,075][123091] Updated weights for policy 0, policy_version 1342919 (0.0009) [2023-12-26 10:18:51,396][123090] Updated weights for policy 1, policy_version 1333449 (0.0010) [2023-12-26 10:18:51,463][123090] Updated weights for policy 1, policy_version 1333459 (0.0008) [2023-12-26 10:18:51,533][123090] Updated weights for policy 1, policy_version 1333469 (0.0010) [2023-12-26 10:18:51,977][123091] Updated weights for policy 0, policy_version 1342929 (0.0009) [2023-12-26 10:18:52,032][123091] Updated weights for policy 0, policy_version 1342939 (0.0011) [2023-12-26 10:18:52,092][123091] Updated weights for policy 0, policy_version 1342949 (0.0007) [2023-12-26 10:18:52,150][123091] Updated weights for policy 0, policy_version 1342959 (0.0005) [2023-12-26 10:18:52,362][123090] Updated weights for policy 1, policy_version 1333479 (0.0011) [2023-12-26 10:18:52,426][123090] Updated weights for policy 1, policy_version 1333489 (0.0011) [2023-12-26 10:18:52,486][123090] Updated weights for policy 1, policy_version 1333499 (0.0011) [2023-12-26 10:18:52,929][123091] Updated weights for policy 0, policy_version 1342969 (0.0009) [2023-12-26 10:18:52,978][123091] Updated weights for policy 0, policy_version 1342979 (0.0009) [2023-12-26 10:18:53,031][123091] Updated weights for policy 0, policy_version 1342989 (0.0009) [2023-12-26 10:18:53,323][123090] Updated weights for policy 1, policy_version 1333509 (0.0011) [2023-12-26 10:18:53,378][123090] Updated weights for policy 1, policy_version 1333519 (0.0010) [2023-12-26 10:18:53,430][123090] Updated weights for policy 1, policy_version 1333529 (0.0010) [2023-12-26 10:18:53,722][123091] Updated weights for policy 0, policy_version 1342999 (0.0006) [2023-12-26 10:18:53,776][123091] Updated weights for policy 0, policy_version 1343009 (0.0005) [2023-12-26 10:18:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 685195264. Throughput: 0: 8909.6, 1: 8830.1. Samples: 685172476. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:53,785][121949] Avg episode reward: [(0, '6335.982'), (1, '5609.754')] [2023-12-26 10:18:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001333536_341385216.pth... [2023-12-26 10:18:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001332512_341123072.pth [2023-12-26 10:18:53,832][123091] Updated weights for policy 0, policy_version 1343019 (0.0005) [2023-12-26 10:18:53,855][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001343024_343818240.pth... [2023-12-26 10:18:53,859][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001341968_343547904.pth [2023-12-26 10:18:54,215][123090] Updated weights for policy 1, policy_version 1333539 (0.0007) [2023-12-26 10:18:54,272][123090] Updated weights for policy 1, policy_version 1333549 (0.0005) [2023-12-26 10:18:54,335][123090] Updated weights for policy 1, policy_version 1333559 (0.0006) [2023-12-26 10:18:54,515][123091] Updated weights for policy 0, policy_version 1343029 (0.0005) [2023-12-26 10:18:54,568][123091] Updated weights for policy 0, policy_version 1343039 (0.0006) [2023-12-26 10:18:54,622][123091] Updated weights for policy 0, policy_version 1343049 (0.0006) [2023-12-26 10:18:55,040][123090] Updated weights for policy 1, policy_version 1333569 (0.0006) [2023-12-26 10:18:55,103][123090] Updated weights for policy 1, policy_version 1333579 (0.0010) [2023-12-26 10:18:55,162][123090] Updated weights for policy 1, policy_version 1333589 (0.0010) [2023-12-26 10:18:55,225][123090] Updated weights for policy 1, policy_version 1333599 (0.0010) [2023-12-26 10:18:55,356][123091] Updated weights for policy 0, policy_version 1343059 (0.0006) [2023-12-26 10:18:55,403][123091] Updated weights for policy 0, policy_version 1343069 (0.0005) [2023-12-26 10:18:55,452][123091] Updated weights for policy 0, policy_version 1343079 (0.0007) [2023-12-26 10:18:55,927][123090] Updated weights for policy 1, policy_version 1333609 (0.0010) [2023-12-26 10:18:55,988][123090] Updated weights for policy 1, policy_version 1333620 (0.0009) [2023-12-26 10:18:56,039][123090] Updated weights for policy 1, policy_version 1333630 (0.0008) [2023-12-26 10:18:56,301][123091] Updated weights for policy 0, policy_version 1343089 (0.0010) [2023-12-26 10:18:56,351][123091] Updated weights for policy 0, policy_version 1343099 (0.0010) [2023-12-26 10:18:56,399][123091] Updated weights for policy 0, policy_version 1343109 (0.0009) [2023-12-26 10:18:56,447][123091] Updated weights for policy 0, policy_version 1343119 (0.0009) [2023-12-26 10:18:56,877][123090] Updated weights for policy 1, policy_version 1333640 (0.0009) [2023-12-26 10:18:56,939][123090] Updated weights for policy 1, policy_version 1333650 (0.0009) [2023-12-26 10:18:57,002][123090] Updated weights for policy 1, policy_version 1333660 (0.0009) [2023-12-26 10:18:57,327][123091] Updated weights for policy 0, policy_version 1343129 (0.0010) [2023-12-26 10:18:57,380][123091] Updated weights for policy 0, policy_version 1343139 (0.0009) [2023-12-26 10:18:57,434][123091] Updated weights for policy 0, policy_version 1343149 (0.0010) [2023-12-26 10:18:57,845][123090] Updated weights for policy 1, policy_version 1333670 (0.0009) [2023-12-26 10:18:57,900][123090] Updated weights for policy 1, policy_version 1333680 (0.0010) [2023-12-26 10:18:57,951][123090] Updated weights for policy 1, policy_version 1333690 (0.0010) [2023-12-26 10:18:58,306][123091] Updated weights for policy 0, policy_version 1343159 (0.0008) [2023-12-26 10:18:58,378][123091] Updated weights for policy 0, policy_version 1343169 (0.0009) [2023-12-26 10:18:58,446][123091] Updated weights for policy 0, policy_version 1343179 (0.0010) [2023-12-26 10:18:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 685285376. Throughput: 0: 8996.5, 1: 8876.5. Samples: 685280972. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:18:58,785][121949] Avg episode reward: [(0, '6361.669'), (1, '5661.291')] [2023-12-26 10:18:58,828][123090] Updated weights for policy 1, policy_version 1333700 (0.0010) [2023-12-26 10:18:58,897][123090] Updated weights for policy 1, policy_version 1333710 (0.0009) [2023-12-26 10:18:58,961][123090] Updated weights for policy 1, policy_version 1333720 (0.0009) [2023-12-26 10:18:59,281][123091] Updated weights for policy 0, policy_version 1343189 (0.0010) [2023-12-26 10:18:59,334][123091] Updated weights for policy 0, policy_version 1343199 (0.0010) [2023-12-26 10:18:59,402][123091] Updated weights for policy 0, policy_version 1343209 (0.0009) [2023-12-26 10:18:59,731][123090] Updated weights for policy 1, policy_version 1333730 (0.0008) [2023-12-26 10:18:59,790][123090] Updated weights for policy 1, policy_version 1333740 (0.0006) [2023-12-26 10:18:59,849][123090] Updated weights for policy 1, policy_version 1333750 (0.0007) [2023-12-26 10:18:59,919][123090] Updated weights for policy 1, policy_version 1333760 (0.0008) [2023-12-26 10:19:00,283][123091] Updated weights for policy 0, policy_version 1343219 (0.0010) [2023-12-26 10:19:00,341][123091] Updated weights for policy 0, policy_version 1343229 (0.0010) [2023-12-26 10:19:00,402][123091] Updated weights for policy 0, policy_version 1343239 (0.0011) [2023-12-26 10:19:00,697][123090] Updated weights for policy 1, policy_version 1333770 (0.0006) [2023-12-26 10:19:00,743][123090] Updated weights for policy 1, policy_version 1333780 (0.0005) [2023-12-26 10:19:00,794][123090] Updated weights for policy 1, policy_version 1333790 (0.0006) [2023-12-26 10:19:01,086][123091] Updated weights for policy 0, policy_version 1343249 (0.0010) [2023-12-26 10:19:01,149][123091] Updated weights for policy 0, policy_version 1343259 (0.0008) [2023-12-26 10:19:01,200][123091] Updated weights for policy 0, policy_version 1343269 (0.0006) [2023-12-26 10:19:01,251][123091] Updated weights for policy 0, policy_version 1343279 (0.0008) [2023-12-26 10:19:01,538][123090] Updated weights for policy 1, policy_version 1333800 (0.0009) [2023-12-26 10:19:01,604][123090] Updated weights for policy 1, policy_version 1333810 (0.0010) [2023-12-26 10:19:01,666][123090] Updated weights for policy 1, policy_version 1333820 (0.0009) [2023-12-26 10:19:02,002][123091] Updated weights for policy 0, policy_version 1343289 (0.0009) [2023-12-26 10:19:02,063][123091] Updated weights for policy 0, policy_version 1343299 (0.0010) [2023-12-26 10:19:02,115][123091] Updated weights for policy 0, policy_version 1343309 (0.0009) [2023-12-26 10:19:02,451][123090] Updated weights for policy 1, policy_version 1333830 (0.0009) [2023-12-26 10:19:02,513][123090] Updated weights for policy 1, policy_version 1333840 (0.0009) [2023-12-26 10:19:02,576][123090] Updated weights for policy 1, policy_version 1333850 (0.0010) [2023-12-26 10:19:02,940][123091] Updated weights for policy 0, policy_version 1343319 (0.0009) [2023-12-26 10:19:02,991][123091] Updated weights for policy 0, policy_version 1343329 (0.0010) [2023-12-26 10:19:03,043][123091] Updated weights for policy 0, policy_version 1343339 (0.0009) [2023-12-26 10:19:03,357][123090] Updated weights for policy 1, policy_version 1333860 (0.0009) [2023-12-26 10:19:03,421][123090] Updated weights for policy 1, policy_version 1333871 (0.0009) [2023-12-26 10:19:03,474][123090] Updated weights for policy 1, policy_version 1333881 (0.0005) [2023-12-26 10:19:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 685375488. Throughput: 0: 8953.9, 1: 8839.8. Samples: 685386632. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:19:03,784][121949] Avg episode reward: [(0, '6234.951'), (1, '5528.035')] [2023-12-26 10:19:03,866][123091] Updated weights for policy 0, policy_version 1343349 (0.0010) [2023-12-26 10:19:03,918][123091] Updated weights for policy 0, policy_version 1343359 (0.0009) [2023-12-26 10:19:03,973][123091] Updated weights for policy 0, policy_version 1343370 (0.0011) [2023-12-26 10:19:04,178][123090] Updated weights for policy 1, policy_version 1333891 (0.0005) [2023-12-26 10:19:04,236][123090] Updated weights for policy 1, policy_version 1333901 (0.0009) [2023-12-26 10:19:04,303][123090] Updated weights for policy 1, policy_version 1333911 (0.0010) [2023-12-26 10:19:04,837][123091] Updated weights for policy 0, policy_version 1343380 (0.0009) [2023-12-26 10:19:04,895][123091] Updated weights for policy 0, policy_version 1343390 (0.0010) [2023-12-26 10:19:04,946][123091] Updated weights for policy 0, policy_version 1343400 (0.0009) [2023-12-26 10:19:05,079][123090] Updated weights for policy 1, policy_version 1333921 (0.0009) [2023-12-26 10:19:05,134][123090] Updated weights for policy 1, policy_version 1333931 (0.0009) [2023-12-26 10:19:05,189][123090] Updated weights for policy 1, policy_version 1333941 (0.0007) [2023-12-26 10:19:05,241][123090] Updated weights for policy 1, policy_version 1333951 (0.0005) [2023-12-26 10:19:05,862][123091] Updated weights for policy 0, policy_version 1343411 (0.0010) [2023-12-26 10:19:05,913][123091] Updated weights for policy 0, policy_version 1343422 (0.0009) [2023-12-26 10:19:05,942][123090] Updated weights for policy 1, policy_version 1333961 (0.0005) [2023-12-26 10:19:05,961][123091] Updated weights for policy 0, policy_version 1343432 (0.0009) [2023-12-26 10:19:05,996][123090] Updated weights for policy 1, policy_version 1333971 (0.0005) [2023-12-26 10:19:06,071][123090] Updated weights for policy 1, policy_version 1333981 (0.0005) [2023-12-26 10:19:06,735][123090] Updated weights for policy 1, policy_version 1333991 (0.0008) [2023-12-26 10:19:06,788][123090] Updated weights for policy 1, policy_version 1334001 (0.0009) [2023-12-26 10:19:06,842][123090] Updated weights for policy 1, policy_version 1334011 (0.0009) [2023-12-26 10:19:06,881][123091] Updated weights for policy 0, policy_version 1343443 (0.0008) [2023-12-26 10:19:06,935][123091] Updated weights for policy 0, policy_version 1343453 (0.0009) [2023-12-26 10:19:06,985][123091] Updated weights for policy 0, policy_version 1343463 (0.0009) [2023-12-26 10:19:07,668][123090] Updated weights for policy 1, policy_version 1334021 (0.0007) [2023-12-26 10:19:07,717][123090] Updated weights for policy 1, policy_version 1334031 (0.0005) [2023-12-26 10:19:07,767][123090] Updated weights for policy 1, policy_version 1334041 (0.0006) [2023-12-26 10:19:07,863][123091] Updated weights for policy 0, policy_version 1343473 (0.0009) [2023-12-26 10:19:07,913][123091] Updated weights for policy 0, policy_version 1343483 (0.0009) [2023-12-26 10:19:07,974][123091] Updated weights for policy 0, policy_version 1343493 (0.0010) [2023-12-26 10:19:08,028][123091] Updated weights for policy 0, policy_version 1343503 (0.0007) [2023-12-26 10:19:08,610][123090] Updated weights for policy 1, policy_version 1334052 (0.0010) [2023-12-26 10:19:08,684][123090] Updated weights for policy 1, policy_version 1334062 (0.0010) [2023-12-26 10:19:08,748][123090] Updated weights for policy 1, policy_version 1334072 (0.0010) [2023-12-26 10:19:08,760][123091] Updated weights for policy 0, policy_version 1343513 (0.0006) [2023-12-26 10:19:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 685457408. Throughput: 0: 8891.6, 1: 8946.8. Samples: 685440588. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:19:08,784][121949] Avg episode reward: [(0, '6358.203'), (1, '5312.152')] [2023-12-26 10:19:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001334080_341524480.pth... [2023-12-26 10:19:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001333024_341254144.pth [2023-12-26 10:19:08,823][123091] Updated weights for policy 0, policy_version 1343523 (0.0008) [2023-12-26 10:19:08,893][123091] Updated weights for policy 0, policy_version 1343533 (0.0009) [2023-12-26 10:19:08,910][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001343536_343949312.pth... [2023-12-26 10:19:08,915][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001342512_343687168.pth [2023-12-26 10:19:09,582][123090] Updated weights for policy 1, policy_version 1334082 (0.0008) [2023-12-26 10:19:09,648][123090] Updated weights for policy 1, policy_version 1334092 (0.0008) [2023-12-26 10:19:09,719][123090] Updated weights for policy 1, policy_version 1334102 (0.0009) [2023-12-26 10:19:09,738][123091] Updated weights for policy 0, policy_version 1343543 (0.0007) [2023-12-26 10:19:09,788][123090] Updated weights for policy 1, policy_version 1334112 (0.0008) [2023-12-26 10:19:09,811][123091] Updated weights for policy 0, policy_version 1343553 (0.0009) [2023-12-26 10:19:09,879][123091] Updated weights for policy 0, policy_version 1343563 (0.0010) [2023-12-26 10:19:10,527][123090] Updated weights for policy 1, policy_version 1334122 (0.0007) [2023-12-26 10:19:10,588][123090] Updated weights for policy 1, policy_version 1334132 (0.0009) [2023-12-26 10:19:10,642][123090] Updated weights for policy 1, policy_version 1334142 (0.0008) [2023-12-26 10:19:10,691][123091] Updated weights for policy 0, policy_version 1343573 (0.0011) [2023-12-26 10:19:10,763][123091] Updated weights for policy 0, policy_version 1343583 (0.0011) [2023-12-26 10:19:10,823][123091] Updated weights for policy 0, policy_version 1343593 (0.0011) [2023-12-26 10:19:11,381][123090] Updated weights for policy 1, policy_version 1334152 (0.0007) [2023-12-26 10:19:11,431][123090] Updated weights for policy 1, policy_version 1334162 (0.0005) [2023-12-26 10:19:11,495][123090] Updated weights for policy 1, policy_version 1334172 (0.0007) [2023-12-26 10:19:11,635][123091] Updated weights for policy 0, policy_version 1343603 (0.0009) [2023-12-26 10:19:11,704][123091] Updated weights for policy 0, policy_version 1343613 (0.0010) [2023-12-26 10:19:11,773][123091] Updated weights for policy 0, policy_version 1343623 (0.0010) [2023-12-26 10:19:12,279][123090] Updated weights for policy 1, policy_version 1334182 (0.0008) [2023-12-26 10:19:12,346][123090] Updated weights for policy 1, policy_version 1334192 (0.0009) [2023-12-26 10:19:12,409][123090] Updated weights for policy 1, policy_version 1334202 (0.0010) [2023-12-26 10:19:12,632][123091] Updated weights for policy 0, policy_version 1343633 (0.0010) [2023-12-26 10:19:12,697][123091] Updated weights for policy 0, policy_version 1343643 (0.0009) [2023-12-26 10:19:12,765][123091] Updated weights for policy 0, policy_version 1343653 (0.0009) [2023-12-26 10:19:12,813][123091] Updated weights for policy 0, policy_version 1343663 (0.0009) [2023-12-26 10:19:13,225][123090] Updated weights for policy 1, policy_version 1334212 (0.0008) [2023-12-26 10:19:13,286][123090] Updated weights for policy 1, policy_version 1334222 (0.0005) [2023-12-26 10:19:13,354][123090] Updated weights for policy 1, policy_version 1334232 (0.0007) [2023-12-26 10:19:13,671][123091] Updated weights for policy 0, policy_version 1343673 (0.0006) [2023-12-26 10:19:13,726][123091] Updated weights for policy 0, policy_version 1343683 (0.0005) [2023-12-26 10:19:13,773][123091] Updated weights for policy 0, policy_version 1343693 (0.0005) [2023-12-26 10:19:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 685547520. Throughput: 0: 8831.3, 1: 8953.6. Samples: 685545404. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:19:13,785][121949] Avg episode reward: [(0, '6371.431'), (1, '5382.741')] [2023-12-26 10:19:14,018][123090] Updated weights for policy 1, policy_version 1334242 (0.0009) [2023-12-26 10:19:14,092][123090] Updated weights for policy 1, policy_version 1334252 (0.0010) [2023-12-26 10:19:14,159][123090] Updated weights for policy 1, policy_version 1334262 (0.0010) [2023-12-26 10:19:14,206][123090] Updated weights for policy 1, policy_version 1334272 (0.0010) [2023-12-26 10:19:14,415][123091] Updated weights for policy 0, policy_version 1343703 (0.0008) [2023-12-26 10:19:14,468][123091] Updated weights for policy 0, policy_version 1343713 (0.0009) [2023-12-26 10:19:14,516][123091] Updated weights for policy 0, policy_version 1343723 (0.0009) [2023-12-26 10:19:15,026][123090] Updated weights for policy 1, policy_version 1334282 (0.0010) [2023-12-26 10:19:15,080][123090] Updated weights for policy 1, policy_version 1334292 (0.0011) [2023-12-26 10:19:15,133][123090] Updated weights for policy 1, policy_version 1334302 (0.0010) [2023-12-26 10:19:15,400][123091] Updated weights for policy 0, policy_version 1343733 (0.0009) [2023-12-26 10:19:15,461][123091] Updated weights for policy 0, policy_version 1343743 (0.0009) [2023-12-26 10:19:15,510][123091] Updated weights for policy 0, policy_version 1343753 (0.0009) [2023-12-26 10:19:15,985][123090] Updated weights for policy 1, policy_version 1334312 (0.0010) [2023-12-26 10:19:16,041][123090] Updated weights for policy 1, policy_version 1334322 (0.0010) [2023-12-26 10:19:16,104][123090] Updated weights for policy 1, policy_version 1334332 (0.0010) [2023-12-26 10:19:16,366][123091] Updated weights for policy 0, policy_version 1343763 (0.0010) [2023-12-26 10:19:16,419][123091] Updated weights for policy 0, policy_version 1343773 (0.0009) [2023-12-26 10:19:16,478][123091] Updated weights for policy 0, policy_version 1343783 (0.0008) [2023-12-26 10:19:16,930][123090] Updated weights for policy 1, policy_version 1334342 (0.0009) [2023-12-26 10:19:17,003][123090] Updated weights for policy 1, policy_version 1334352 (0.0010) [2023-12-26 10:19:17,077][123090] Updated weights for policy 1, policy_version 1334362 (0.0010) [2023-12-26 10:19:17,277][123091] Updated weights for policy 0, policy_version 1343793 (0.0009) [2023-12-26 10:19:17,333][123091] Updated weights for policy 0, policy_version 1343803 (0.0009) [2023-12-26 10:19:17,393][123091] Updated weights for policy 0, policy_version 1343813 (0.0010) [2023-12-26 10:19:17,447][123091] Updated weights for policy 0, policy_version 1343823 (0.0010) [2023-12-26 10:19:17,803][123090] Updated weights for policy 1, policy_version 1334372 (0.0009) [2023-12-26 10:19:17,855][123090] Updated weights for policy 1, policy_version 1334382 (0.0008) [2023-12-26 10:19:17,906][123090] Updated weights for policy 1, policy_version 1334392 (0.0009) [2023-12-26 10:19:18,322][123091] Updated weights for policy 0, policy_version 1343833 (0.0009) [2023-12-26 10:19:18,389][123091] Updated weights for policy 0, policy_version 1343843 (0.0009) [2023-12-26 10:19:18,444][123091] Updated weights for policy 0, policy_version 1343853 (0.0009) [2023-12-26 10:19:18,747][123090] Updated weights for policy 1, policy_version 1334402 (0.0010) [2023-12-26 10:19:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 685637632. Throughput: 0: 8738.8, 1: 8913.4. Samples: 685650764. Policy #0 lag: (min: 18.0, avg: 32.5, max: 50.0) [2023-12-26 10:19:18,785][121949] Avg episode reward: [(0, '6341.640'), (1, '5508.109')] [2023-12-26 10:19:18,801][123090] Updated weights for policy 1, policy_version 1334412 (0.0009) [2023-12-26 10:19:18,868][123090] Updated weights for policy 1, policy_version 1334422 (0.0013) [2023-12-26 10:19:18,928][123090] Updated weights for policy 1, policy_version 1334432 (0.0010) [2023-12-26 10:19:19,316][123091] Updated weights for policy 0, policy_version 1343863 (0.0007) [2023-12-26 10:19:19,381][123091] Updated weights for policy 0, policy_version 1343873 (0.0010) [2023-12-26 10:19:19,433][123091] Updated weights for policy 0, policy_version 1343883 (0.0009) [2023-12-26 10:19:19,776][123090] Updated weights for policy 1, policy_version 1334442 (0.0010) [2023-12-26 10:19:19,845][123090] Updated weights for policy 1, policy_version 1334452 (0.0010) [2023-12-26 10:19:19,907][123090] Updated weights for policy 1, policy_version 1334462 (0.0010) [2023-12-26 10:19:20,282][123091] Updated weights for policy 0, policy_version 1343893 (0.0009) [2023-12-26 10:19:20,336][123091] Updated weights for policy 0, policy_version 1343903 (0.0009) [2023-12-26 10:19:20,385][123091] Updated weights for policy 0, policy_version 1343913 (0.0008) [2023-12-26 10:19:20,757][123090] Updated weights for policy 1, policy_version 1334472 (0.0010) [2023-12-26 10:19:20,820][123090] Updated weights for policy 1, policy_version 1334482 (0.0010) [2023-12-26 10:19:20,886][123090] Updated weights for policy 1, policy_version 1334492 (0.0010) [2023-12-26 10:19:21,239][123091] Updated weights for policy 0, policy_version 1343924 (0.0010) [2023-12-26 10:19:21,314][123091] Updated weights for policy 0, policy_version 1343934 (0.0009) [2023-12-26 10:19:21,385][123091] Updated weights for policy 0, policy_version 1343944 (0.0009) [2023-12-26 10:19:21,706][123090] Updated weights for policy 1, policy_version 1334502 (0.0010) [2023-12-26 10:19:21,781][123090] Updated weights for policy 1, policy_version 1334512 (0.0011) [2023-12-26 10:19:21,842][123090] Updated weights for policy 1, policy_version 1334522 (0.0010) [2023-12-26 10:19:22,193][123091] Updated weights for policy 0, policy_version 1343954 (0.0009) [2023-12-26 10:19:22,266][123091] Updated weights for policy 0, policy_version 1343964 (0.0011) [2023-12-26 10:19:22,333][123091] Updated weights for policy 0, policy_version 1343974 (0.0010) [2023-12-26 10:19:22,392][123091] Updated weights for policy 0, policy_version 1343984 (0.0010) [2023-12-26 10:19:22,679][123090] Updated weights for policy 1, policy_version 1334532 (0.0011) [2023-12-26 10:19:22,751][123090] Updated weights for policy 1, policy_version 1334542 (0.0011) [2023-12-26 10:19:22,819][123090] Updated weights for policy 1, policy_version 1334552 (0.0010) [2023-12-26 10:19:23,141][123091] Updated weights for policy 0, policy_version 1343994 (0.0010) [2023-12-26 10:19:23,211][123091] Updated weights for policy 0, policy_version 1344004 (0.0011) [2023-12-26 10:19:23,277][123091] Updated weights for policy 0, policy_version 1344014 (0.0010) [2023-12-26 10:19:23,630][123090] Updated weights for policy 1, policy_version 1334562 (0.0011) [2023-12-26 10:19:23,692][123090] Updated weights for policy 1, policy_version 1334572 (0.0006) [2023-12-26 10:19:23,766][123090] Updated weights for policy 1, policy_version 1334582 (0.0005) [2023-12-26 10:19:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 685719552. Throughput: 0: 8663.9, 1: 8855.5. Samples: 685700960. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:23,785][121949] Avg episode reward: [(0, '6361.622'), (1, '5601.545')] [2023-12-26 10:19:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001344016_344072192.pth... [2023-12-26 10:19:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001343024_343818240.pth [2023-12-26 10:19:23,823][123090] Updated weights for policy 1, policy_version 1334592 (0.0005) [2023-12-26 10:19:23,823][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001334592_341655552.pth... [2023-12-26 10:19:23,827][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001333536_341385216.pth [2023-12-26 10:19:24,033][123091] Updated weights for policy 0, policy_version 1344024 (0.0006) [2023-12-26 10:19:24,107][123091] Updated weights for policy 0, policy_version 1344034 (0.0009) [2023-12-26 10:19:24,170][123091] Updated weights for policy 0, policy_version 1344044 (0.0011) [2023-12-26 10:19:24,479][123090] Updated weights for policy 1, policy_version 1334602 (0.0008) [2023-12-26 10:19:24,544][123090] Updated weights for policy 1, policy_version 1334612 (0.0009) [2023-12-26 10:19:24,617][123090] Updated weights for policy 1, policy_version 1334622 (0.0006) [2023-12-26 10:19:24,890][123091] Updated weights for policy 0, policy_version 1344054 (0.0007) [2023-12-26 10:19:24,948][123091] Updated weights for policy 0, policy_version 1344064 (0.0006) [2023-12-26 10:19:25,007][123091] Updated weights for policy 0, policy_version 1344074 (0.0005) [2023-12-26 10:19:25,345][123090] Updated weights for policy 1, policy_version 1334632 (0.0008) [2023-12-26 10:19:25,408][123090] Updated weights for policy 1, policy_version 1334642 (0.0009) [2023-12-26 10:19:25,476][123090] Updated weights for policy 1, policy_version 1334652 (0.0010) [2023-12-26 10:19:25,799][123091] Updated weights for policy 0, policy_version 1344084 (0.0008) [2023-12-26 10:19:25,846][123091] Updated weights for policy 0, policy_version 1344094 (0.0008) [2023-12-26 10:19:25,896][123091] Updated weights for policy 0, policy_version 1344104 (0.0010) [2023-12-26 10:19:26,271][123090] Updated weights for policy 1, policy_version 1334662 (0.0009) [2023-12-26 10:19:26,336][123090] Updated weights for policy 1, policy_version 1334672 (0.0009) [2023-12-26 10:19:26,396][123090] Updated weights for policy 1, policy_version 1334682 (0.0009) [2023-12-26 10:19:26,713][123091] Updated weights for policy 0, policy_version 1344114 (0.0010) [2023-12-26 10:19:26,784][123091] Updated weights for policy 0, policy_version 1344124 (0.0009) [2023-12-26 10:19:26,846][123091] Updated weights for policy 0, policy_version 1344134 (0.0010) [2023-12-26 10:19:26,903][123091] Updated weights for policy 0, policy_version 1344144 (0.0010) [2023-12-26 10:19:27,174][123090] Updated weights for policy 1, policy_version 1334692 (0.0009) [2023-12-26 10:19:27,225][123090] Updated weights for policy 1, policy_version 1334702 (0.0009) [2023-12-26 10:19:27,287][123090] Updated weights for policy 1, policy_version 1334712 (0.0010) [2023-12-26 10:19:27,630][123091] Updated weights for policy 0, policy_version 1344154 (0.0005) [2023-12-26 10:19:27,682][123091] Updated weights for policy 0, policy_version 1344164 (0.0005) [2023-12-26 10:19:27,736][123091] Updated weights for policy 0, policy_version 1344174 (0.0006) [2023-12-26 10:19:27,993][123090] Updated weights for policy 1, policy_version 1334722 (0.0009) [2023-12-26 10:19:28,051][123090] Updated weights for policy 1, policy_version 1334732 (0.0010) [2023-12-26 10:19:28,106][123090] Updated weights for policy 1, policy_version 1334742 (0.0009) [2023-12-26 10:19:28,163][123090] Updated weights for policy 1, policy_version 1334752 (0.0005) [2023-12-26 10:19:28,435][123091] Updated weights for policy 0, policy_version 1344184 (0.0008) [2023-12-26 10:19:28,504][123091] Updated weights for policy 0, policy_version 1344194 (0.0008) [2023-12-26 10:19:28,571][123091] Updated weights for policy 0, policy_version 1344204 (0.0008) [2023-12-26 10:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 685817856. Throughput: 0: 8735.7, 1: 8940.2. Samples: 685809980. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:28,785][121949] Avg episode reward: [(0, '6280.741'), (1, '5813.442')] [2023-12-26 10:19:28,898][123090] Updated weights for policy 1, policy_version 1334762 (0.0007) [2023-12-26 10:19:28,950][123090] Updated weights for policy 1, policy_version 1334772 (0.0009) [2023-12-26 10:19:29,006][123090] Updated weights for policy 1, policy_version 1334782 (0.0005) [2023-12-26 10:19:29,326][123091] Updated weights for policy 0, policy_version 1344214 (0.0007) [2023-12-26 10:19:29,391][123091] Updated weights for policy 0, policy_version 1344224 (0.0008) [2023-12-26 10:19:29,455][123091] Updated weights for policy 0, policy_version 1344234 (0.0009) [2023-12-26 10:19:29,774][123090] Updated weights for policy 1, policy_version 1334792 (0.0006) [2023-12-26 10:19:29,854][123090] Updated weights for policy 1, policy_version 1334802 (0.0006) [2023-12-26 10:19:29,925][123090] Updated weights for policy 1, policy_version 1334812 (0.0006) [2023-12-26 10:19:30,125][123091] Updated weights for policy 0, policy_version 1344244 (0.0008) [2023-12-26 10:19:30,191][123091] Updated weights for policy 0, policy_version 1344254 (0.0009) [2023-12-26 10:19:30,251][123091] Updated weights for policy 0, policy_version 1344264 (0.0009) [2023-12-26 10:19:30,600][123090] Updated weights for policy 1, policy_version 1334822 (0.0007) [2023-12-26 10:19:30,654][123090] Updated weights for policy 1, policy_version 1334832 (0.0005) [2023-12-26 10:19:30,700][123090] Updated weights for policy 1, policy_version 1334842 (0.0005) [2023-12-26 10:19:30,981][123091] Updated weights for policy 0, policy_version 1344274 (0.0009) [2023-12-26 10:19:31,043][123091] Updated weights for policy 0, policy_version 1344284 (0.0009) [2023-12-26 10:19:31,101][123091] Updated weights for policy 0, policy_version 1344294 (0.0010) [2023-12-26 10:19:31,170][123091] Updated weights for policy 0, policy_version 1344304 (0.0008) [2023-12-26 10:19:31,520][123090] Updated weights for policy 1, policy_version 1334852 (0.0005) [2023-12-26 10:19:31,580][123090] Updated weights for policy 1, policy_version 1334862 (0.0006) [2023-12-26 10:19:31,655][123090] Updated weights for policy 1, policy_version 1334872 (0.0008) [2023-12-26 10:19:31,888][123091] Updated weights for policy 0, policy_version 1344314 (0.0006) [2023-12-26 10:19:31,943][123091] Updated weights for policy 0, policy_version 1344324 (0.0006) [2023-12-26 10:19:32,007][123091] Updated weights for policy 0, policy_version 1344334 (0.0006) [2023-12-26 10:19:32,384][123090] Updated weights for policy 1, policy_version 1334882 (0.0007) [2023-12-26 10:19:32,450][123090] Updated weights for policy 1, policy_version 1334892 (0.0005) [2023-12-26 10:19:32,518][123090] Updated weights for policy 1, policy_version 1334902 (0.0009) [2023-12-26 10:19:32,591][123090] Updated weights for policy 1, policy_version 1334912 (0.0007) [2023-12-26 10:19:32,703][123091] Updated weights for policy 0, policy_version 1344344 (0.0006) [2023-12-26 10:19:32,761][123091] Updated weights for policy 0, policy_version 1344354 (0.0005) [2023-12-26 10:19:32,811][123091] Updated weights for policy 0, policy_version 1344364 (0.0006) [2023-12-26 10:19:33,342][123090] Updated weights for policy 1, policy_version 1334922 (0.0005) [2023-12-26 10:19:33,387][123090] Updated weights for policy 1, policy_version 1334932 (0.0005) [2023-12-26 10:19:33,440][123090] Updated weights for policy 1, policy_version 1334942 (0.0005) [2023-12-26 10:19:33,545][123091] Updated weights for policy 0, policy_version 1344374 (0.0005) [2023-12-26 10:19:33,591][123091] Updated weights for policy 0, policy_version 1344384 (0.0005) [2023-12-26 10:19:33,659][123091] Updated weights for policy 0, policy_version 1344394 (0.0005) [2023-12-26 10:19:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 685916160. Throughput: 0: 8844.6, 1: 8984.9. Samples: 685923972. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:33,785][121949] Avg episode reward: [(0, '6279.123'), (1, '5884.218')] [2023-12-26 10:19:34,189][123090] Updated weights for policy 1, policy_version 1334952 (0.0007) [2023-12-26 10:19:34,248][123090] Updated weights for policy 1, policy_version 1334962 (0.0008) [2023-12-26 10:19:34,309][123091] Updated weights for policy 0, policy_version 1344404 (0.0006) [2023-12-26 10:19:34,314][123090] Updated weights for policy 1, policy_version 1334972 (0.0008) [2023-12-26 10:19:34,376][123091] Updated weights for policy 0, policy_version 1344414 (0.0008) [2023-12-26 10:19:34,434][123091] Updated weights for policy 0, policy_version 1344424 (0.0009) [2023-12-26 10:19:35,074][123090] Updated weights for policy 1, policy_version 1334982 (0.0006) [2023-12-26 10:19:35,127][123090] Updated weights for policy 1, policy_version 1334992 (0.0005) [2023-12-26 10:19:35,197][123090] Updated weights for policy 1, policy_version 1335002 (0.0007) [2023-12-26 10:19:35,225][123091] Updated weights for policy 0, policy_version 1344434 (0.0008) [2023-12-26 10:19:35,292][123091] Updated weights for policy 0, policy_version 1344444 (0.0007) [2023-12-26 10:19:35,361][123091] Updated weights for policy 0, policy_version 1344454 (0.0005) [2023-12-26 10:19:35,425][123091] Updated weights for policy 0, policy_version 1344464 (0.0005) [2023-12-26 10:19:35,948][123090] Updated weights for policy 1, policy_version 1335013 (0.0007) [2023-12-26 10:19:35,997][123090] Updated weights for policy 1, policy_version 1335023 (0.0005) [2023-12-26 10:19:36,053][123090] Updated weights for policy 1, policy_version 1335033 (0.0005) [2023-12-26 10:19:36,086][123091] Updated weights for policy 0, policy_version 1344474 (0.0006) [2023-12-26 10:19:36,155][123091] Updated weights for policy 0, policy_version 1344484 (0.0009) [2023-12-26 10:19:36,220][123091] Updated weights for policy 0, policy_version 1344494 (0.0009) [2023-12-26 10:19:36,842][123090] Updated weights for policy 1, policy_version 1335043 (0.0006) [2023-12-26 10:19:36,910][123090] Updated weights for policy 1, policy_version 1335053 (0.0005) [2023-12-26 10:19:36,979][123090] Updated weights for policy 1, policy_version 1335063 (0.0005) [2023-12-26 10:19:37,025][123091] Updated weights for policy 0, policy_version 1344504 (0.0008) [2023-12-26 10:19:37,091][123091] Updated weights for policy 0, policy_version 1344514 (0.0010) [2023-12-26 10:19:37,156][123091] Updated weights for policy 0, policy_version 1344524 (0.0005) [2023-12-26 10:19:37,561][123090] Updated weights for policy 1, policy_version 1335073 (0.0005) [2023-12-26 10:19:37,635][123090] Updated weights for policy 1, policy_version 1335083 (0.0005) [2023-12-26 10:19:37,714][123090] Updated weights for policy 1, policy_version 1335093 (0.0005) [2023-12-26 10:19:37,770][123091] Updated weights for policy 0, policy_version 1344534 (0.0006) [2023-12-26 10:19:37,789][123090] Updated weights for policy 1, policy_version 1335103 (0.0006) [2023-12-26 10:19:37,821][123091] Updated weights for policy 0, policy_version 1344544 (0.0009) [2023-12-26 10:19:37,886][123091] Updated weights for policy 0, policy_version 1344554 (0.0006) [2023-12-26 10:19:38,446][123090] Updated weights for policy 1, policy_version 1335113 (0.0009) [2023-12-26 10:19:38,505][123090] Updated weights for policy 1, policy_version 1335123 (0.0007) [2023-12-26 10:19:38,564][123090] Updated weights for policy 1, policy_version 1335133 (0.0009) [2023-12-26 10:19:38,642][123091] Updated weights for policy 0, policy_version 1344564 (0.0007) [2023-12-26 10:19:38,701][123091] Updated weights for policy 0, policy_version 1344574 (0.0009) [2023-12-26 10:19:38,762][123091] Updated weights for policy 0, policy_version 1344584 (0.0009) [2023-12-26 10:19:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 686006272. Throughput: 0: 8913.5, 1: 9045.3. Samples: 685980624. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:38,785][121949] Avg episode reward: [(0, '6399.762'), (1, '5768.158')] [2023-12-26 10:19:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001335136_341794816.pth... [2023-12-26 10:19:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001334080_341524480.pth [2023-12-26 10:19:38,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001344592_344219648.pth... [2023-12-26 10:19:38,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001343536_343949312.pth [2023-12-26 10:19:39,403][123090] Updated weights for policy 1, policy_version 1335143 (0.0010) [2023-12-26 10:19:39,470][123090] Updated weights for policy 1, policy_version 1335153 (0.0011) [2023-12-26 10:19:39,526][123090] Updated weights for policy 1, policy_version 1335163 (0.0011) [2023-12-26 10:19:39,655][123091] Updated weights for policy 0, policy_version 1344594 (0.0010) [2023-12-26 10:19:39,727][123091] Updated weights for policy 0, policy_version 1344604 (0.0010) [2023-12-26 10:19:39,787][123091] Updated weights for policy 0, policy_version 1344614 (0.0009) [2023-12-26 10:19:39,850][123091] Updated weights for policy 0, policy_version 1344624 (0.0009) [2023-12-26 10:19:40,352][123090] Updated weights for policy 1, policy_version 1335173 (0.0010) [2023-12-26 10:19:40,426][123090] Updated weights for policy 1, policy_version 1335183 (0.0007) [2023-12-26 10:19:40,492][123090] Updated weights for policy 1, policy_version 1335193 (0.0009) [2023-12-26 10:19:40,720][123091] Updated weights for policy 0, policy_version 1344634 (0.0010) [2023-12-26 10:19:40,770][123091] Updated weights for policy 0, policy_version 1344645 (0.0009) [2023-12-26 10:19:40,820][123091] Updated weights for policy 0, policy_version 1344655 (0.0010) [2023-12-26 10:19:41,285][123090] Updated weights for policy 1, policy_version 1335203 (0.0008) [2023-12-26 10:19:41,358][123090] Updated weights for policy 1, policy_version 1335213 (0.0009) [2023-12-26 10:19:41,432][123090] Updated weights for policy 1, policy_version 1335223 (0.0009) [2023-12-26 10:19:41,738][123091] Updated weights for policy 0, policy_version 1344665 (0.0008) [2023-12-26 10:19:41,798][123091] Updated weights for policy 0, policy_version 1344675 (0.0010) [2023-12-26 10:19:41,864][123091] Updated weights for policy 0, policy_version 1344685 (0.0010) [2023-12-26 10:19:42,274][123090] Updated weights for policy 1, policy_version 1335233 (0.0009) [2023-12-26 10:19:42,343][123090] Updated weights for policy 1, policy_version 1335243 (0.0010) [2023-12-26 10:19:42,416][123090] Updated weights for policy 1, policy_version 1335253 (0.0009) [2023-12-26 10:19:42,478][123090] Updated weights for policy 1, policy_version 1335263 (0.0009) [2023-12-26 10:19:42,645][123091] Updated weights for policy 0, policy_version 1344695 (0.0010) [2023-12-26 10:19:42,703][123091] Updated weights for policy 0, policy_version 1344705 (0.0009) [2023-12-26 10:19:42,761][123091] Updated weights for policy 0, policy_version 1344715 (0.0009) [2023-12-26 10:19:43,233][123090] Updated weights for policy 1, policy_version 1335273 (0.0006) [2023-12-26 10:19:43,282][123090] Updated weights for policy 1, policy_version 1335283 (0.0005) [2023-12-26 10:19:43,329][123090] Updated weights for policy 1, policy_version 1335293 (0.0005) [2023-12-26 10:19:43,600][123091] Updated weights for policy 0, policy_version 1344725 (0.0010) [2023-12-26 10:19:43,658][123091] Updated weights for policy 0, policy_version 1344735 (0.0010) [2023-12-26 10:19:43,714][123091] Updated weights for policy 0, policy_version 1344745 (0.0009) [2023-12-26 10:19:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 686096384. Throughput: 0: 8862.0, 1: 9020.7. Samples: 686085696. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:43,785][121949] Avg episode reward: [(0, '6407.486'), (1, '5630.898')] [2023-12-26 10:19:44,061][123090] Updated weights for policy 1, policy_version 1335303 (0.0009) [2023-12-26 10:19:44,114][123090] Updated weights for policy 1, policy_version 1335313 (0.0010) [2023-12-26 10:19:44,166][123090] Updated weights for policy 1, policy_version 1335323 (0.0010) [2023-12-26 10:19:44,512][123091] Updated weights for policy 0, policy_version 1344755 (0.0009) [2023-12-26 10:19:44,562][123091] Updated weights for policy 0, policy_version 1344765 (0.0005) [2023-12-26 10:19:44,610][123091] Updated weights for policy 0, policy_version 1344775 (0.0005) [2023-12-26 10:19:44,951][123090] Updated weights for policy 1, policy_version 1335333 (0.0010) [2023-12-26 10:19:45,005][123090] Updated weights for policy 1, policy_version 1335343 (0.0008) [2023-12-26 10:19:45,054][123090] Updated weights for policy 1, policy_version 1335353 (0.0009) [2023-12-26 10:19:45,405][123091] Updated weights for policy 0, policy_version 1344785 (0.0006) [2023-12-26 10:19:45,468][123091] Updated weights for policy 0, policy_version 1344795 (0.0011) [2023-12-26 10:19:45,536][123091] Updated weights for policy 0, policy_version 1344805 (0.0011) [2023-12-26 10:19:45,585][123091] Updated weights for policy 0, policy_version 1344815 (0.0010) [2023-12-26 10:19:45,842][123090] Updated weights for policy 1, policy_version 1335363 (0.0009) [2023-12-26 10:19:45,909][123090] Updated weights for policy 1, policy_version 1335373 (0.0008) [2023-12-26 10:19:45,978][123090] Updated weights for policy 1, policy_version 1335383 (0.0008) [2023-12-26 10:19:46,324][123091] Updated weights for policy 0, policy_version 1344825 (0.0006) [2023-12-26 10:19:46,392][123091] Updated weights for policy 0, policy_version 1344835 (0.0005) [2023-12-26 10:19:46,459][123091] Updated weights for policy 0, policy_version 1344845 (0.0006) [2023-12-26 10:19:46,787][123090] Updated weights for policy 1, policy_version 1335393 (0.0009) [2023-12-26 10:19:46,857][123090] Updated weights for policy 1, policy_version 1335403 (0.0009) [2023-12-26 10:19:46,928][123090] Updated weights for policy 1, policy_version 1335413 (0.0009) [2023-12-26 10:19:47,008][123090] Updated weights for policy 1, policy_version 1335423 (0.0010) [2023-12-26 10:19:47,093][123091] Updated weights for policy 0, policy_version 1344855 (0.0005) [2023-12-26 10:19:47,147][123091] Updated weights for policy 0, policy_version 1344865 (0.0005) [2023-12-26 10:19:47,203][123091] Updated weights for policy 0, policy_version 1344875 (0.0006) [2023-12-26 10:19:47,818][123090] Updated weights for policy 1, policy_version 1335433 (0.0009) [2023-12-26 10:19:47,887][123090] Updated weights for policy 1, policy_version 1335443 (0.0009) [2023-12-26 10:19:47,952][123090] Updated weights for policy 1, policy_version 1335453 (0.0009) [2023-12-26 10:19:48,009][123091] Updated weights for policy 0, policy_version 1344885 (0.0010) [2023-12-26 10:19:48,071][123091] Updated weights for policy 0, policy_version 1344895 (0.0011) [2023-12-26 10:19:48,136][123091] Updated weights for policy 0, policy_version 1344905 (0.0010) [2023-12-26 10:19:48,736][123090] Updated weights for policy 1, policy_version 1335463 (0.0006) [2023-12-26 10:19:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 686178304. Throughput: 0: 8910.4, 1: 9047.8. Samples: 686194752. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:48,784][121949] Avg episode reward: [(0, '6327.659'), (1, '5585.453')] [2023-12-26 10:19:48,786][123090] Updated weights for policy 1, policy_version 1335473 (0.0005) [2023-12-26 10:19:48,844][123090] Updated weights for policy 1, policy_version 1335483 (0.0005) [2023-12-26 10:19:48,921][123091] Updated weights for policy 0, policy_version 1344915 (0.0011) [2023-12-26 10:19:48,975][123091] Updated weights for policy 0, policy_version 1344925 (0.0009) [2023-12-26 10:19:49,024][123091] Updated weights for policy 0, policy_version 1344935 (0.0008) [2023-12-26 10:19:49,598][123090] Updated weights for policy 1, policy_version 1335493 (0.0008) [2023-12-26 10:19:49,656][123090] Updated weights for policy 1, policy_version 1335503 (0.0010) [2023-12-26 10:19:49,706][123090] Updated weights for policy 1, policy_version 1335514 (0.0009) [2023-12-26 10:19:49,840][123091] Updated weights for policy 0, policy_version 1344945 (0.0006) [2023-12-26 10:19:49,907][123091] Updated weights for policy 0, policy_version 1344955 (0.0010) [2023-12-26 10:19:49,971][123091] Updated weights for policy 0, policy_version 1344965 (0.0010) [2023-12-26 10:19:50,028][123091] Updated weights for policy 0, policy_version 1344975 (0.0010) [2023-12-26 10:19:50,551][123090] Updated weights for policy 1, policy_version 1335524 (0.0010) [2023-12-26 10:19:50,628][123090] Updated weights for policy 1, policy_version 1335534 (0.0008) [2023-12-26 10:19:50,686][123090] Updated weights for policy 1, policy_version 1335544 (0.0009) [2023-12-26 10:19:50,895][123091] Updated weights for policy 0, policy_version 1344985 (0.0010) [2023-12-26 10:19:50,954][123091] Updated weights for policy 0, policy_version 1344995 (0.0010) [2023-12-26 10:19:51,011][123091] Updated weights for policy 0, policy_version 1345005 (0.0009) [2023-12-26 10:19:51,545][123090] Updated weights for policy 1, policy_version 1335554 (0.0010) [2023-12-26 10:19:51,614][123090] Updated weights for policy 1, policy_version 1335564 (0.0006) [2023-12-26 10:19:51,683][123090] Updated weights for policy 1, policy_version 1335574 (0.0006) [2023-12-26 10:19:51,751][123090] Updated weights for policy 1, policy_version 1335584 (0.0008) [2023-12-26 10:19:51,895][123091] Updated weights for policy 0, policy_version 1345015 (0.0008) [2023-12-26 10:19:51,957][123091] Updated weights for policy 0, policy_version 1345025 (0.0008) [2023-12-26 10:19:52,022][123091] Updated weights for policy 0, policy_version 1345035 (0.0008) [2023-12-26 10:19:52,542][123090] Updated weights for policy 1, policy_version 1335594 (0.0009) [2023-12-26 10:19:52,605][123090] Updated weights for policy 1, policy_version 1335604 (0.0009) [2023-12-26 10:19:52,670][123090] Updated weights for policy 1, policy_version 1335614 (0.0007) [2023-12-26 10:19:52,816][123091] Updated weights for policy 0, policy_version 1345045 (0.0008) [2023-12-26 10:19:52,871][123091] Updated weights for policy 0, policy_version 1345055 (0.0009) [2023-12-26 10:19:52,924][123091] Updated weights for policy 0, policy_version 1345065 (0.0010) [2023-12-26 10:19:53,337][123090] Updated weights for policy 1, policy_version 1335624 (0.0005) [2023-12-26 10:19:53,410][123090] Updated weights for policy 1, policy_version 1335634 (0.0005) [2023-12-26 10:19:53,475][123090] Updated weights for policy 1, policy_version 1335644 (0.0005) [2023-12-26 10:19:53,641][123091] Updated weights for policy 0, policy_version 1345075 (0.0009) [2023-12-26 10:19:53,706][123091] Updated weights for policy 0, policy_version 1345085 (0.0005) [2023-12-26 10:19:53,755][123091] Updated weights for policy 0, policy_version 1345095 (0.0005) [2023-12-26 10:19:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 686268416. Throughput: 0: 8935.5, 1: 8968.3. Samples: 686246264. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:53,785][121949] Avg episode reward: [(0, '6348.284'), (1, '5595.149')] [2023-12-26 10:19:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001335648_341925888.pth... [2023-12-26 10:19:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001334592_341655552.pth [2023-12-26 10:19:53,810][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001345104_344350720.pth... [2023-12-26 10:19:53,813][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001344016_344072192.pth [2023-12-26 10:19:54,126][123090] Updated weights for policy 1, policy_version 1335654 (0.0006) [2023-12-26 10:19:54,181][123090] Updated weights for policy 1, policy_version 1335664 (0.0005) [2023-12-26 10:19:54,248][123090] Updated weights for policy 1, policy_version 1335674 (0.0005) [2023-12-26 10:19:54,343][123091] Updated weights for policy 0, policy_version 1345105 (0.0005) [2023-12-26 10:19:54,394][123091] Updated weights for policy 0, policy_version 1345115 (0.0005) [2023-12-26 10:19:54,450][123091] Updated weights for policy 0, policy_version 1345125 (0.0006) [2023-12-26 10:19:54,509][123091] Updated weights for policy 0, policy_version 1345135 (0.0006) [2023-12-26 10:19:54,928][123090] Updated weights for policy 1, policy_version 1335684 (0.0005) [2023-12-26 10:19:54,992][123090] Updated weights for policy 1, policy_version 1335694 (0.0006) [2023-12-26 10:19:55,049][123090] Updated weights for policy 1, policy_version 1335704 (0.0005) [2023-12-26 10:19:55,227][123091] Updated weights for policy 0, policy_version 1345146 (0.0011) [2023-12-26 10:19:55,287][123091] Updated weights for policy 0, policy_version 1345157 (0.0009) [2023-12-26 10:19:55,335][123091] Updated weights for policy 0, policy_version 1345167 (0.0005) [2023-12-26 10:19:55,693][123090] Updated weights for policy 1, policy_version 1335714 (0.0005) [2023-12-26 10:19:55,757][123090] Updated weights for policy 1, policy_version 1335724 (0.0005) [2023-12-26 10:19:55,809][123090] Updated weights for policy 1, policy_version 1335734 (0.0007) [2023-12-26 10:19:55,869][123090] Updated weights for policy 1, policy_version 1335744 (0.0007) [2023-12-26 10:19:56,191][123091] Updated weights for policy 0, policy_version 1345177 (0.0010) [2023-12-26 10:19:56,254][123091] Updated weights for policy 0, policy_version 1345187 (0.0010) [2023-12-26 10:19:56,327][123091] Updated weights for policy 0, policy_version 1345197 (0.0010) [2023-12-26 10:19:56,427][123090] Updated weights for policy 1, policy_version 1335754 (0.0005) [2023-12-26 10:19:56,487][123090] Updated weights for policy 1, policy_version 1335764 (0.0009) [2023-12-26 10:19:56,552][123090] Updated weights for policy 1, policy_version 1335774 (0.0010) [2023-12-26 10:19:57,125][123091] Updated weights for policy 0, policy_version 1345207 (0.0010) [2023-12-26 10:19:57,181][123091] Updated weights for policy 0, policy_version 1345219 (0.0011) [2023-12-26 10:19:57,257][123091] Updated weights for policy 0, policy_version 1345230 (0.0010) [2023-12-26 10:19:57,299][123090] Updated weights for policy 1, policy_version 1335784 (0.0006) [2023-12-26 10:19:57,353][123090] Updated weights for policy 1, policy_version 1335794 (0.0008) [2023-12-26 10:19:57,405][123090] Updated weights for policy 1, policy_version 1335804 (0.0009) [2023-12-26 10:19:58,071][123091] Updated weights for policy 0, policy_version 1345240 (0.0007) [2023-12-26 10:19:58,134][123091] Updated weights for policy 0, policy_version 1345250 (0.0008) [2023-12-26 10:19:58,196][123091] Updated weights for policy 0, policy_version 1345260 (0.0008) [2023-12-26 10:19:58,214][123090] Updated weights for policy 1, policy_version 1335814 (0.0007) [2023-12-26 10:19:58,278][123090] Updated weights for policy 1, policy_version 1335824 (0.0007) [2023-12-26 10:19:58,343][123090] Updated weights for policy 1, policy_version 1335834 (0.0008) [2023-12-26 10:19:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 686366720. Throughput: 0: 9026.9, 1: 9094.5. Samples: 686360868. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:19:58,785][121949] Avg episode reward: [(0, '6326.760'), (1, '5639.636')] [2023-12-26 10:19:58,928][123091] Updated weights for policy 0, policy_version 1345270 (0.0006) [2023-12-26 10:19:58,997][123091] Updated weights for policy 0, policy_version 1345280 (0.0010) [2023-12-26 10:19:59,059][123091] Updated weights for policy 0, policy_version 1345290 (0.0007) [2023-12-26 10:19:59,139][123090] Updated weights for policy 1, policy_version 1335844 (0.0006) [2023-12-26 10:19:59,200][123090] Updated weights for policy 1, policy_version 1335854 (0.0005) [2023-12-26 10:19:59,281][123090] Updated weights for policy 1, policy_version 1335864 (0.0010) [2023-12-26 10:19:59,774][123091] Updated weights for policy 0, policy_version 1345300 (0.0007) [2023-12-26 10:19:59,840][123091] Updated weights for policy 0, policy_version 1345310 (0.0008) [2023-12-26 10:19:59,915][123091] Updated weights for policy 0, policy_version 1345320 (0.0008) [2023-12-26 10:20:00,117][123090] Updated weights for policy 1, policy_version 1335874 (0.0011) [2023-12-26 10:20:00,182][123090] Updated weights for policy 1, policy_version 1335884 (0.0011) [2023-12-26 10:20:00,241][123090] Updated weights for policy 1, policy_version 1335894 (0.0010) [2023-12-26 10:20:00,308][123090] Updated weights for policy 1, policy_version 1335904 (0.0010) [2023-12-26 10:20:00,691][123091] Updated weights for policy 0, policy_version 1345330 (0.0009) [2023-12-26 10:20:00,743][123091] Updated weights for policy 0, policy_version 1345340 (0.0010) [2023-12-26 10:20:00,794][123091] Updated weights for policy 0, policy_version 1345350 (0.0010) [2023-12-26 10:20:00,842][123091] Updated weights for policy 0, policy_version 1345360 (0.0010) [2023-12-26 10:20:01,012][123090] Updated weights for policy 1, policy_version 1335914 (0.0005) [2023-12-26 10:20:01,086][123090] Updated weights for policy 1, policy_version 1335925 (0.0007) [2023-12-26 10:20:01,156][123090] Updated weights for policy 1, policy_version 1335935 (0.0007) [2023-12-26 10:20:01,666][123091] Updated weights for policy 0, policy_version 1345370 (0.0007) [2023-12-26 10:20:01,734][123091] Updated weights for policy 0, policy_version 1345380 (0.0007) [2023-12-26 10:20:01,792][123091] Updated weights for policy 0, policy_version 1345390 (0.0005) [2023-12-26 10:20:01,883][123090] Updated weights for policy 1, policy_version 1335945 (0.0010) [2023-12-26 10:20:01,947][123090] Updated weights for policy 1, policy_version 1335955 (0.0011) [2023-12-26 10:20:02,007][123090] Updated weights for policy 1, policy_version 1335965 (0.0010) [2023-12-26 10:20:02,575][123091] Updated weights for policy 0, policy_version 1345400 (0.0008) [2023-12-26 10:20:02,632][123091] Updated weights for policy 0, policy_version 1345410 (0.0010) [2023-12-26 10:20:02,684][123091] Updated weights for policy 0, policy_version 1345420 (0.0010) [2023-12-26 10:20:02,789][123090] Updated weights for policy 1, policy_version 1335975 (0.0010) [2023-12-26 10:20:02,845][123090] Updated weights for policy 1, policy_version 1335985 (0.0010) [2023-12-26 10:20:02,896][123090] Updated weights for policy 1, policy_version 1335995 (0.0010) [2023-12-26 10:20:03,522][123091] Updated weights for policy 0, policy_version 1345430 (0.0006) [2023-12-26 10:20:03,573][123091] Updated weights for policy 0, policy_version 1345440 (0.0005) [2023-12-26 10:20:03,590][123090] Updated weights for policy 1, policy_version 1336005 (0.0008) [2023-12-26 10:20:03,622][123091] Updated weights for policy 0, policy_version 1345450 (0.0006) [2023-12-26 10:20:03,646][123090] Updated weights for policy 1, policy_version 1336015 (0.0005) [2023-12-26 10:20:03,710][123090] Updated weights for policy 1, policy_version 1336025 (0.0006) [2023-12-26 10:20:03,784][121949] Fps is (10 sec: 19661.4, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 686465024. Throughput: 0: 9088.7, 1: 9136.4. Samples: 686470896. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:03,784][121949] Avg episode reward: [(0, '6298.215'), (1, '5627.209')] [2023-12-26 10:20:04,413][123091] Updated weights for policy 0, policy_version 1345460 (0.0008) [2023-12-26 10:20:04,472][123091] Updated weights for policy 0, policy_version 1345470 (0.0009) [2023-12-26 10:20:04,509][123090] Updated weights for policy 1, policy_version 1336035 (0.0007) [2023-12-26 10:20:04,536][123091] Updated weights for policy 0, policy_version 1345480 (0.0008) [2023-12-26 10:20:04,593][123090] Updated weights for policy 1, policy_version 1336045 (0.0010) [2023-12-26 10:20:04,664][123090] Updated weights for policy 1, policy_version 1336055 (0.0010) [2023-12-26 10:20:05,367][123091] Updated weights for policy 0, policy_version 1345490 (0.0008) [2023-12-26 10:20:05,431][123091] Updated weights for policy 0, policy_version 1345500 (0.0009) [2023-12-26 10:20:05,437][123090] Updated weights for policy 1, policy_version 1336065 (0.0010) [2023-12-26 10:20:05,487][123091] Updated weights for policy 0, policy_version 1345510 (0.0008) [2023-12-26 10:20:05,503][123090] Updated weights for policy 1, policy_version 1336075 (0.0010) [2023-12-26 10:20:05,535][123091] Updated weights for policy 0, policy_version 1345520 (0.0007) [2023-12-26 10:20:05,558][123090] Updated weights for policy 1, policy_version 1336085 (0.0010) [2023-12-26 10:20:05,613][123090] Updated weights for policy 1, policy_version 1336095 (0.0010) [2023-12-26 10:20:06,394][123091] Updated weights for policy 0, policy_version 1345530 (0.0009) [2023-12-26 10:20:06,442][123090] Updated weights for policy 1, policy_version 1336105 (0.0009) [2023-12-26 10:20:06,457][123091] Updated weights for policy 0, policy_version 1345540 (0.0010) [2023-12-26 10:20:06,511][123090] Updated weights for policy 1, policy_version 1336115 (0.0009) [2023-12-26 10:20:06,523][123091] Updated weights for policy 0, policy_version 1345550 (0.0009) [2023-12-26 10:20:06,573][123090] Updated weights for policy 1, policy_version 1336125 (0.0010) [2023-12-26 10:20:07,388][123091] Updated weights for policy 0, policy_version 1345560 (0.0009) [2023-12-26 10:20:07,405][123090] Updated weights for policy 1, policy_version 1336135 (0.0009) [2023-12-26 10:20:07,449][123091] Updated weights for policy 0, policy_version 1345570 (0.0010) [2023-12-26 10:20:07,456][123090] Updated weights for policy 1, policy_version 1336145 (0.0006) [2023-12-26 10:20:07,507][123090] Updated weights for policy 1, policy_version 1336155 (0.0009) [2023-12-26 10:20:07,513][123091] Updated weights for policy 0, policy_version 1345580 (0.0009) [2023-12-26 10:20:08,185][123091] Updated weights for policy 0, policy_version 1345590 (0.0007) [2023-12-26 10:20:08,239][123091] Updated weights for policy 0, policy_version 1345600 (0.0005) [2023-12-26 10:20:08,299][123090] Updated weights for policy 1, policy_version 1336165 (0.0006) [2023-12-26 10:20:08,312][123091] Updated weights for policy 0, policy_version 1345610 (0.0005) [2023-12-26 10:20:08,373][123090] Updated weights for policy 1, policy_version 1336175 (0.0009) [2023-12-26 10:20:08,441][123090] Updated weights for policy 1, policy_version 1336185 (0.0011) [2023-12-26 10:20:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17689.1). Total num frames: 686546944. Throughput: 0: 9092.7, 1: 9155.6. Samples: 686522136. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:08,785][121949] Avg episode reward: [(0, '6288.087'), (1, '5685.420')] [2023-12-26 10:20:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001345616_344481792.pth... [2023-12-26 10:20:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001336192_342065152.pth... [2023-12-26 10:20:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001344592_344219648.pth [2023-12-26 10:20:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001335136_341794816.pth [2023-12-26 10:20:09,044][123091] Updated weights for policy 0, policy_version 1345620 (0.0010) [2023-12-26 10:20:09,107][123091] Updated weights for policy 0, policy_version 1345630 (0.0010) [2023-12-26 10:20:09,109][123090] Updated weights for policy 1, policy_version 1336195 (0.0010) [2023-12-26 10:20:09,174][123091] Updated weights for policy 0, policy_version 1345640 (0.0011) [2023-12-26 10:20:09,176][123090] Updated weights for policy 1, policy_version 1336205 (0.0008) [2023-12-26 10:20:09,242][123090] Updated weights for policy 1, policy_version 1336215 (0.0009) [2023-12-26 10:20:09,988][123091] Updated weights for policy 0, policy_version 1345650 (0.0009) [2023-12-26 10:20:10,056][123090] Updated weights for policy 1, policy_version 1336226 (0.0010) [2023-12-26 10:20:10,065][123091] Updated weights for policy 0, policy_version 1345660 (0.0006) [2023-12-26 10:20:10,115][123090] Updated weights for policy 1, policy_version 1336236 (0.0009) [2023-12-26 10:20:10,128][123091] Updated weights for policy 0, policy_version 1345670 (0.0006) [2023-12-26 10:20:10,177][123090] Updated weights for policy 1, policy_version 1336246 (0.0008) [2023-12-26 10:20:10,185][123091] Updated weights for policy 0, policy_version 1345680 (0.0006) [2023-12-26 10:20:10,239][123090] Updated weights for policy 1, policy_version 1336256 (0.0010) [2023-12-26 10:20:10,874][123091] Updated weights for policy 0, policy_version 1345690 (0.0009) [2023-12-26 10:20:10,922][123091] Updated weights for policy 0, policy_version 1345700 (0.0009) [2023-12-26 10:20:10,972][123091] Updated weights for policy 0, policy_version 1345710 (0.0009) [2023-12-26 10:20:11,127][123090] Updated weights for policy 1, policy_version 1336266 (0.0009) [2023-12-26 10:20:11,196][123090] Updated weights for policy 1, policy_version 1336276 (0.0009) [2023-12-26 10:20:11,254][123090] Updated weights for policy 1, policy_version 1336286 (0.0009) [2023-12-26 10:20:11,901][123091] Updated weights for policy 0, policy_version 1345720 (0.0009) [2023-12-26 10:20:11,967][123091] Updated weights for policy 0, policy_version 1345730 (0.0010) [2023-12-26 10:20:12,032][123091] Updated weights for policy 0, policy_version 1345740 (0.0010) [2023-12-26 10:20:12,142][123090] Updated weights for policy 1, policy_version 1336296 (0.0007) [2023-12-26 10:20:12,218][123090] Updated weights for policy 1, policy_version 1336306 (0.0010) [2023-12-26 10:20:12,287][123090] Updated weights for policy 1, policy_version 1336316 (0.0008) [2023-12-26 10:20:12,828][123091] Updated weights for policy 0, policy_version 1345750 (0.0007) [2023-12-26 10:20:12,883][123091] Updated weights for policy 0, policy_version 1345760 (0.0005) [2023-12-26 10:20:12,952][123091] Updated weights for policy 0, policy_version 1345770 (0.0009) [2023-12-26 10:20:13,139][123090] Updated weights for policy 1, policy_version 1336326 (0.0006) [2023-12-26 10:20:13,213][123090] Updated weights for policy 1, policy_version 1336336 (0.0007) [2023-12-26 10:20:13,275][123090] Updated weights for policy 1, policy_version 1336346 (0.0010) [2023-12-26 10:20:13,720][123091] Updated weights for policy 0, policy_version 1345780 (0.0010) [2023-12-26 10:20:13,764][123091] Updated weights for policy 0, policy_version 1345790 (0.0007) [2023-12-26 10:20:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 18022.4, 300 sec: 17633.7). Total num frames: 686628864. Throughput: 0: 9031.6, 1: 9094.6. Samples: 686625660. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:13,785][121949] Avg episode reward: [(0, '6217.512'), (1, '5752.847')] [2023-12-26 10:20:13,812][123091] Updated weights for policy 0, policy_version 1345800 (0.0006) [2023-12-26 10:20:13,972][123090] Updated weights for policy 1, policy_version 1336356 (0.0010) [2023-12-26 10:20:14,027][123090] Updated weights for policy 1, policy_version 1336366 (0.0010) [2023-12-26 10:20:14,074][123090] Updated weights for policy 1, policy_version 1336376 (0.0010) [2023-12-26 10:20:14,523][123091] Updated weights for policy 0, policy_version 1345810 (0.0007) [2023-12-26 10:20:14,580][123091] Updated weights for policy 0, policy_version 1345820 (0.0005) [2023-12-26 10:20:14,630][123091] Updated weights for policy 0, policy_version 1345830 (0.0005) [2023-12-26 10:20:14,690][123091] Updated weights for policy 0, policy_version 1345840 (0.0009) [2023-12-26 10:20:14,897][123090] Updated weights for policy 1, policy_version 1336386 (0.0010) [2023-12-26 10:20:14,961][123090] Updated weights for policy 1, policy_version 1336396 (0.0011) [2023-12-26 10:20:15,028][123090] Updated weights for policy 1, policy_version 1336406 (0.0011) [2023-12-26 10:20:15,093][123090] Updated weights for policy 1, policy_version 1336416 (0.0010) [2023-12-26 10:20:15,493][123091] Updated weights for policy 0, policy_version 1345850 (0.0006) [2023-12-26 10:20:15,560][123091] Updated weights for policy 0, policy_version 1345860 (0.0007) [2023-12-26 10:20:15,625][123091] Updated weights for policy 0, policy_version 1345870 (0.0011) [2023-12-26 10:20:15,899][123090] Updated weights for policy 1, policy_version 1336426 (0.0010) [2023-12-26 10:20:15,958][123090] Updated weights for policy 1, policy_version 1336436 (0.0010) [2023-12-26 10:20:16,006][123090] Updated weights for policy 1, policy_version 1336446 (0.0010) [2023-12-26 10:20:16,270][123091] Updated weights for policy 0, policy_version 1345880 (0.0007) [2023-12-26 10:20:16,343][123091] Updated weights for policy 0, policy_version 1345890 (0.0009) [2023-12-26 10:20:16,417][123091] Updated weights for policy 0, policy_version 1345900 (0.0011) [2023-12-26 10:20:16,768][123090] Updated weights for policy 1, policy_version 1336456 (0.0010) [2023-12-26 10:20:16,833][123090] Updated weights for policy 1, policy_version 1336466 (0.0010) [2023-12-26 10:20:16,908][123090] Updated weights for policy 1, policy_version 1336476 (0.0010) [2023-12-26 10:20:17,123][123091] Updated weights for policy 0, policy_version 1345910 (0.0009) [2023-12-26 10:20:17,183][123091] Updated weights for policy 0, policy_version 1345920 (0.0011) [2023-12-26 10:20:17,243][123091] Updated weights for policy 0, policy_version 1345930 (0.0011) [2023-12-26 10:20:17,742][123090] Updated weights for policy 1, policy_version 1336486 (0.0009) [2023-12-26 10:20:17,810][123090] Updated weights for policy 1, policy_version 1336496 (0.0010) [2023-12-26 10:20:17,858][123090] Updated weights for policy 1, policy_version 1336506 (0.0010) [2023-12-26 10:20:18,032][123091] Updated weights for policy 0, policy_version 1345940 (0.0008) [2023-12-26 10:20:18,098][123091] Updated weights for policy 0, policy_version 1345950 (0.0008) [2023-12-26 10:20:18,171][123091] Updated weights for policy 0, policy_version 1345960 (0.0009) [2023-12-26 10:20:18,648][123090] Updated weights for policy 1, policy_version 1336516 (0.0010) [2023-12-26 10:20:18,715][123090] Updated weights for policy 1, policy_version 1336526 (0.0008) [2023-12-26 10:20:18,777][123090] Updated weights for policy 1, policy_version 1336536 (0.0010) [2023-12-26 10:20:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 686718976. Throughput: 0: 9023.0, 1: 9008.0. Samples: 686735364. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:18,785][121949] Avg episode reward: [(0, '6332.338'), (1, '5665.350')] [2023-12-26 10:20:18,954][123091] Updated weights for policy 0, policy_version 1345970 (0.0007) [2023-12-26 10:20:19,011][123091] Updated weights for policy 0, policy_version 1345980 (0.0009) [2023-12-26 10:20:19,068][123091] Updated weights for policy 0, policy_version 1345990 (0.0010) [2023-12-26 10:20:19,129][123091] Updated weights for policy 0, policy_version 1346000 (0.0009) [2023-12-26 10:20:19,528][123090] Updated weights for policy 1, policy_version 1336546 (0.0009) [2023-12-26 10:20:19,585][123090] Updated weights for policy 1, policy_version 1336556 (0.0005) [2023-12-26 10:20:19,645][123090] Updated weights for policy 1, policy_version 1336566 (0.0005) [2023-12-26 10:20:19,704][123090] Updated weights for policy 1, policy_version 1336576 (0.0005) [2023-12-26 10:20:19,991][123091] Updated weights for policy 0, policy_version 1346010 (0.0009) [2023-12-26 10:20:20,061][123091] Updated weights for policy 0, policy_version 1346020 (0.0007) [2023-12-26 10:20:20,131][123091] Updated weights for policy 0, policy_version 1346030 (0.0009) [2023-12-26 10:20:20,534][123090] Updated weights for policy 1, policy_version 1336586 (0.0009) [2023-12-26 10:20:20,607][123090] Updated weights for policy 1, policy_version 1336596 (0.0006) [2023-12-26 10:20:20,676][123090] Updated weights for policy 1, policy_version 1336606 (0.0006) [2023-12-26 10:20:20,969][123091] Updated weights for policy 0, policy_version 1346040 (0.0009) [2023-12-26 10:20:21,035][123091] Updated weights for policy 0, policy_version 1346050 (0.0008) [2023-12-26 10:20:21,105][123091] Updated weights for policy 0, policy_version 1346060 (0.0009) [2023-12-26 10:20:21,432][123090] Updated weights for policy 1, policy_version 1336616 (0.0009) [2023-12-26 10:20:21,498][123090] Updated weights for policy 1, policy_version 1336626 (0.0010) [2023-12-26 10:20:21,559][123090] Updated weights for policy 1, policy_version 1336636 (0.0009) [2023-12-26 10:20:21,964][123091] Updated weights for policy 0, policy_version 1346070 (0.0009) [2023-12-26 10:20:22,021][123091] Updated weights for policy 0, policy_version 1346081 (0.0010) [2023-12-26 10:20:22,089][123091] Updated weights for policy 0, policy_version 1346091 (0.0010) [2023-12-26 10:20:22,326][123090] Updated weights for policy 1, policy_version 1336646 (0.0010) [2023-12-26 10:20:22,394][123090] Updated weights for policy 1, policy_version 1336656 (0.0010) [2023-12-26 10:20:22,472][123090] Updated weights for policy 1, policy_version 1336666 (0.0010) [2023-12-26 10:20:22,946][123091] Updated weights for policy 0, policy_version 1346101 (0.0008) [2023-12-26 10:20:23,015][123091] Updated weights for policy 0, policy_version 1346111 (0.0008) [2023-12-26 10:20:23,078][123091] Updated weights for policy 0, policy_version 1346121 (0.0009) [2023-12-26 10:20:23,283][123090] Updated weights for policy 1, policy_version 1336676 (0.0007) [2023-12-26 10:20:23,339][123090] Updated weights for policy 1, policy_version 1336686 (0.0005) [2023-12-26 10:20:23,395][123090] Updated weights for policy 1, policy_version 1336696 (0.0005) [2023-12-26 10:20:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17661.4). Total num frames: 686809088. Throughput: 0: 8943.3, 1: 8967.0. Samples: 686786588. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:23,785][121949] Avg episode reward: [(0, '6374.242'), (1, '5592.736')] [2023-12-26 10:20:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001346128_344612864.pth... [2023-12-26 10:20:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001336704_342196224.pth... [2023-12-26 10:20:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001345104_344350720.pth [2023-12-26 10:20:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001335648_341925888.pth [2023-12-26 10:20:23,931][123091] Updated weights for policy 0, policy_version 1346131 (0.0009) [2023-12-26 10:20:23,989][123091] Updated weights for policy 0, policy_version 1346141 (0.0009) [2023-12-26 10:20:24,050][123091] Updated weights for policy 0, policy_version 1346151 (0.0010) [2023-12-26 10:20:24,112][123090] Updated weights for policy 1, policy_version 1336706 (0.0006) [2023-12-26 10:20:24,165][123090] Updated weights for policy 1, policy_version 1336717 (0.0009) [2023-12-26 10:20:24,222][123090] Updated weights for policy 1, policy_version 1336727 (0.0009) [2023-12-26 10:20:24,900][123091] Updated weights for policy 0, policy_version 1346161 (0.0009) [2023-12-26 10:20:24,963][123091] Updated weights for policy 0, policy_version 1346171 (0.0010) [2023-12-26 10:20:25,017][123090] Updated weights for policy 1, policy_version 1336737 (0.0010) [2023-12-26 10:20:25,025][123091] Updated weights for policy 0, policy_version 1346181 (0.0009) [2023-12-26 10:20:25,079][123090] Updated weights for policy 1, policy_version 1336747 (0.0010) [2023-12-26 10:20:25,083][123091] Updated weights for policy 0, policy_version 1346191 (0.0008) [2023-12-26 10:20:25,141][123090] Updated weights for policy 1, policy_version 1336757 (0.0010) [2023-12-26 10:20:25,196][123090] Updated weights for policy 1, policy_version 1336767 (0.0010) [2023-12-26 10:20:25,927][123091] Updated weights for policy 0, policy_version 1346201 (0.0008) [2023-12-26 10:20:25,986][123091] Updated weights for policy 0, policy_version 1346211 (0.0010) [2023-12-26 10:20:26,006][123090] Updated weights for policy 1, policy_version 1336777 (0.0007) [2023-12-26 10:20:26,044][123091] Updated weights for policy 0, policy_version 1346221 (0.0007) [2023-12-26 10:20:26,065][123090] Updated weights for policy 1, policy_version 1336787 (0.0010) [2023-12-26 10:20:26,116][123090] Updated weights for policy 1, policy_version 1336797 (0.0010) [2023-12-26 10:20:26,855][123091] Updated weights for policy 0, policy_version 1346231 (0.0007) [2023-12-26 10:20:26,916][123091] Updated weights for policy 0, policy_version 1346241 (0.0010) [2023-12-26 10:20:26,948][123090] Updated weights for policy 1, policy_version 1336807 (0.0007) [2023-12-26 10:20:26,976][123091] Updated weights for policy 0, policy_version 1346251 (0.0010) [2023-12-26 10:20:27,004][123090] Updated weights for policy 1, policy_version 1336817 (0.0007) [2023-12-26 10:20:27,068][123090] Updated weights for policy 1, policy_version 1336827 (0.0009) [2023-12-26 10:20:27,764][123091] Updated weights for policy 0, policy_version 1346261 (0.0007) [2023-12-26 10:20:27,832][123091] Updated weights for policy 0, policy_version 1346271 (0.0006) [2023-12-26 10:20:27,883][123090] Updated weights for policy 1, policy_version 1336837 (0.0009) [2023-12-26 10:20:27,895][123091] Updated weights for policy 0, policy_version 1346281 (0.0006) [2023-12-26 10:20:27,944][123090] Updated weights for policy 1, policy_version 1336847 (0.0008) [2023-12-26 10:20:28,001][123090] Updated weights for policy 1, policy_version 1336857 (0.0010) [2023-12-26 10:20:28,644][123091] Updated weights for policy 0, policy_version 1346291 (0.0008) [2023-12-26 10:20:28,710][123091] Updated weights for policy 0, policy_version 1346301 (0.0009) [2023-12-26 10:20:28,771][123091] Updated weights for policy 0, policy_version 1346311 (0.0009) [2023-12-26 10:20:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 686891008. Throughput: 0: 8913.4, 1: 8987.7. Samples: 686891248. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:28,785][121949] Avg episode reward: [(0, '6370.413'), (1, '5756.478')] [2023-12-26 10:20:28,824][123090] Updated weights for policy 1, policy_version 1336867 (0.0009) [2023-12-26 10:20:28,886][123090] Updated weights for policy 1, policy_version 1336877 (0.0010) [2023-12-26 10:20:28,941][123090] Updated weights for policy 1, policy_version 1336887 (0.0010) [2023-12-26 10:20:29,637][123091] Updated weights for policy 0, policy_version 1346321 (0.0009) [2023-12-26 10:20:29,692][123090] Updated weights for policy 1, policy_version 1336897 (0.0010) [2023-12-26 10:20:29,704][123091] Updated weights for policy 0, policy_version 1346331 (0.0007) [2023-12-26 10:20:29,753][123090] Updated weights for policy 1, policy_version 1336907 (0.0009) [2023-12-26 10:20:29,761][123091] Updated weights for policy 0, policy_version 1346341 (0.0005) [2023-12-26 10:20:29,819][123091] Updated weights for policy 0, policy_version 1346351 (0.0006) [2023-12-26 10:20:29,822][123090] Updated weights for policy 1, policy_version 1336917 (0.0009) [2023-12-26 10:20:29,887][123090] Updated weights for policy 1, policy_version 1336927 (0.0008) [2023-12-26 10:20:30,608][123091] Updated weights for policy 0, policy_version 1346361 (0.0008) [2023-12-26 10:20:30,673][123091] Updated weights for policy 0, policy_version 1346371 (0.0005) [2023-12-26 10:20:30,677][123090] Updated weights for policy 1, policy_version 1336937 (0.0007) [2023-12-26 10:20:30,722][123091] Updated weights for policy 0, policy_version 1346381 (0.0005) [2023-12-26 10:20:30,732][123090] Updated weights for policy 1, policy_version 1336947 (0.0008) [2023-12-26 10:20:30,779][123090] Updated weights for policy 1, policy_version 1336957 (0.0010) [2023-12-26 10:20:31,425][123091] Updated weights for policy 0, policy_version 1346391 (0.0006) [2023-12-26 10:20:31,486][123091] Updated weights for policy 0, policy_version 1346401 (0.0006) [2023-12-26 10:20:31,539][123091] Updated weights for policy 0, policy_version 1346411 (0.0005) [2023-12-26 10:20:31,587][123090] Updated weights for policy 1, policy_version 1336967 (0.0009) [2023-12-26 10:20:31,653][123090] Updated weights for policy 1, policy_version 1336977 (0.0009) [2023-12-26 10:20:31,722][123090] Updated weights for policy 1, policy_version 1336987 (0.0010) [2023-12-26 10:20:32,356][123091] Updated weights for policy 0, policy_version 1346421 (0.0007) [2023-12-26 10:20:32,432][123091] Updated weights for policy 0, policy_version 1346431 (0.0007) [2023-12-26 10:20:32,484][123090] Updated weights for policy 1, policy_version 1336997 (0.0008) [2023-12-26 10:20:32,498][123091] Updated weights for policy 0, policy_version 1346441 (0.0009) [2023-12-26 10:20:32,543][123090] Updated weights for policy 1, policy_version 1337007 (0.0007) [2023-12-26 10:20:32,607][123090] Updated weights for policy 1, policy_version 1337017 (0.0010) [2023-12-26 10:20:33,314][123091] Updated weights for policy 0, policy_version 1346451 (0.0009) [2023-12-26 10:20:33,374][123091] Updated weights for policy 0, policy_version 1346461 (0.0009) [2023-12-26 10:20:33,404][123090] Updated weights for policy 1, policy_version 1337027 (0.0009) [2023-12-26 10:20:33,430][123091] Updated weights for policy 0, policy_version 1346471 (0.0009) [2023-12-26 10:20:33,458][123090] Updated weights for policy 1, policy_version 1337037 (0.0009) [2023-12-26 10:20:33,513][123090] Updated weights for policy 1, policy_version 1337047 (0.0005) [2023-12-26 10:20:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 686989312. Throughput: 0: 8874.1, 1: 8967.3. Samples: 686997616. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:33,785][121949] Avg episode reward: [(0, '6240.964'), (1, '5873.689')] [2023-12-26 10:20:34,207][123090] Updated weights for policy 1, policy_version 1337057 (0.0006) [2023-12-26 10:20:34,247][123091] Updated weights for policy 0, policy_version 1346481 (0.0009) [2023-12-26 10:20:34,262][123090] Updated weights for policy 1, policy_version 1337067 (0.0010) [2023-12-26 10:20:34,316][123091] Updated weights for policy 0, policy_version 1346491 (0.0009) [2023-12-26 10:20:34,326][123090] Updated weights for policy 1, policy_version 1337077 (0.0010) [2023-12-26 10:20:34,376][123091] Updated weights for policy 0, policy_version 1346501 (0.0008) [2023-12-26 10:20:34,393][123090] Updated weights for policy 1, policy_version 1337087 (0.0006) [2023-12-26 10:20:34,442][123091] Updated weights for policy 0, policy_version 1346511 (0.0009) [2023-12-26 10:20:35,149][123090] Updated weights for policy 1, policy_version 1337097 (0.0009) [2023-12-26 10:20:35,210][123090] Updated weights for policy 1, policy_version 1337107 (0.0011) [2023-12-26 10:20:35,272][123090] Updated weights for policy 1, policy_version 1337117 (0.0010) [2023-12-26 10:20:35,295][123091] Updated weights for policy 0, policy_version 1346521 (0.0008) [2023-12-26 10:20:35,360][123091] Updated weights for policy 0, policy_version 1346531 (0.0008) [2023-12-26 10:20:35,412][123091] Updated weights for policy 0, policy_version 1346541 (0.0009) [2023-12-26 10:20:36,074][123090] Updated weights for policy 1, policy_version 1337127 (0.0009) [2023-12-26 10:20:36,143][123090] Updated weights for policy 1, policy_version 1337137 (0.0010) [2023-12-26 10:20:36,205][123090] Updated weights for policy 1, policy_version 1337147 (0.0010) [2023-12-26 10:20:36,253][123091] Updated weights for policy 0, policy_version 1346551 (0.0007) [2023-12-26 10:20:36,327][123091] Updated weights for policy 0, policy_version 1346561 (0.0009) [2023-12-26 10:20:36,388][123091] Updated weights for policy 0, policy_version 1346571 (0.0009) [2023-12-26 10:20:37,012][123090] Updated weights for policy 1, policy_version 1337157 (0.0008) [2023-12-26 10:20:37,074][123090] Updated weights for policy 1, policy_version 1337167 (0.0005) [2023-12-26 10:20:37,100][123091] Updated weights for policy 0, policy_version 1346581 (0.0008) [2023-12-26 10:20:37,134][123090] Updated weights for policy 1, policy_version 1337177 (0.0005) [2023-12-26 10:20:37,149][123091] Updated weights for policy 0, policy_version 1346591 (0.0010) [2023-12-26 10:20:37,202][123091] Updated weights for policy 0, policy_version 1346601 (0.0009) [2023-12-26 10:20:37,896][123090] Updated weights for policy 1, policy_version 1337187 (0.0007) [2023-12-26 10:20:37,970][123090] Updated weights for policy 1, policy_version 1337197 (0.0005) [2023-12-26 10:20:38,035][123090] Updated weights for policy 1, policy_version 1337207 (0.0005) [2023-12-26 10:20:38,059][123091] Updated weights for policy 0, policy_version 1346611 (0.0009) [2023-12-26 10:20:38,119][123091] Updated weights for policy 0, policy_version 1346621 (0.0009) [2023-12-26 10:20:38,178][123091] Updated weights for policy 0, policy_version 1346631 (0.0009) [2023-12-26 10:20:38,749][123090] Updated weights for policy 1, policy_version 1337217 (0.0006) [2023-12-26 10:20:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 687071232. Throughput: 0: 8874.7, 1: 9006.4. Samples: 687050912. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:38,785][121949] Avg episode reward: [(0, '6192.424'), (1, '5884.284')] [2023-12-26 10:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001346640_344743936.pth... [2023-12-26 10:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001345616_344481792.pth [2023-12-26 10:20:38,812][123090] Updated weights for policy 1, policy_version 1337227 (0.0009) [2023-12-26 10:20:38,874][123090] Updated weights for policy 1, policy_version 1337237 (0.0009) [2023-12-26 10:20:38,934][123090] Updated weights for policy 1, policy_version 1337247 (0.0009) [2023-12-26 10:20:38,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001337248_342335488.pth... [2023-12-26 10:20:38,945][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001336192_342065152.pth [2023-12-26 10:20:39,027][123091] Updated weights for policy 0, policy_version 1346641 (0.0009) [2023-12-26 10:20:39,089][123091] Updated weights for policy 0, policy_version 1346651 (0.0010) [2023-12-26 10:20:39,154][123091] Updated weights for policy 0, policy_version 1346661 (0.0009) [2023-12-26 10:20:39,211][123091] Updated weights for policy 0, policy_version 1346671 (0.0007) [2023-12-26 10:20:39,831][123090] Updated weights for policy 1, policy_version 1337257 (0.0009) [2023-12-26 10:20:39,905][123090] Updated weights for policy 1, policy_version 1337267 (0.0008) [2023-12-26 10:20:39,970][123090] Updated weights for policy 1, policy_version 1337277 (0.0010) [2023-12-26 10:20:40,057][123091] Updated weights for policy 0, policy_version 1346681 (0.0009) [2023-12-26 10:20:40,108][123091] Updated weights for policy 0, policy_version 1346691 (0.0010) [2023-12-26 10:20:40,175][123091] Updated weights for policy 0, policy_version 1346701 (0.0010) [2023-12-26 10:20:40,720][123090] Updated weights for policy 1, policy_version 1337287 (0.0010) [2023-12-26 10:20:40,793][123090] Updated weights for policy 1, policy_version 1337297 (0.0008) [2023-12-26 10:20:40,857][123090] Updated weights for policy 1, policy_version 1337307 (0.0010) [2023-12-26 10:20:41,066][123091] Updated weights for policy 0, policy_version 1346711 (0.0009) [2023-12-26 10:20:41,137][123091] Updated weights for policy 0, policy_version 1346721 (0.0010) [2023-12-26 10:20:41,212][123091] Updated weights for policy 0, policy_version 1346731 (0.0010) [2023-12-26 10:20:41,697][123090] Updated weights for policy 1, policy_version 1337317 (0.0008) [2023-12-26 10:20:41,768][123090] Updated weights for policy 1, policy_version 1337327 (0.0011) [2023-12-26 10:20:41,835][123090] Updated weights for policy 1, policy_version 1337337 (0.0011) [2023-12-26 10:20:42,063][123091] Updated weights for policy 0, policy_version 1346741 (0.0010) [2023-12-26 10:20:42,142][123091] Updated weights for policy 0, policy_version 1346751 (0.0010) [2023-12-26 10:20:42,204][123091] Updated weights for policy 0, policy_version 1346761 (0.0010) [2023-12-26 10:20:42,602][123090] Updated weights for policy 1, policy_version 1337347 (0.0010) [2023-12-26 10:20:42,669][123090] Updated weights for policy 1, policy_version 1337357 (0.0008) [2023-12-26 10:20:42,732][123090] Updated weights for policy 1, policy_version 1337367 (0.0008) [2023-12-26 10:20:43,061][123091] Updated weights for policy 0, policy_version 1346771 (0.0009) [2023-12-26 10:20:43,110][123091] Updated weights for policy 0, policy_version 1346781 (0.0008) [2023-12-26 10:20:43,163][123091] Updated weights for policy 0, policy_version 1346791 (0.0009) [2023-12-26 10:20:43,474][123090] Updated weights for policy 1, policy_version 1337377 (0.0008) [2023-12-26 10:20:43,545][123090] Updated weights for policy 1, policy_version 1337387 (0.0011) [2023-12-26 10:20:43,612][123090] Updated weights for policy 1, policy_version 1337397 (0.0011) [2023-12-26 10:20:43,678][123090] Updated weights for policy 1, policy_version 1337407 (0.0010) [2023-12-26 10:20:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 687161344. Throughput: 0: 8746.3, 1: 8865.9. Samples: 687153416. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:43,784][121949] Avg episode reward: [(0, '6219.999'), (1, '5883.764')] [2023-12-26 10:20:43,965][123091] Updated weights for policy 0, policy_version 1346801 (0.0009) [2023-12-26 10:20:44,031][123091] Updated weights for policy 0, policy_version 1346811 (0.0009) [2023-12-26 10:20:44,086][123091] Updated weights for policy 0, policy_version 1346821 (0.0010) [2023-12-26 10:20:44,137][123091] Updated weights for policy 0, policy_version 1346831 (0.0010) [2023-12-26 10:20:44,472][123090] Updated weights for policy 1, policy_version 1337417 (0.0006) [2023-12-26 10:20:44,520][123090] Updated weights for policy 1, policy_version 1337427 (0.0005) [2023-12-26 10:20:44,566][123090] Updated weights for policy 1, policy_version 1337437 (0.0006) [2023-12-26 10:20:44,853][123091] Updated weights for policy 0, policy_version 1346841 (0.0008) [2023-12-26 10:20:44,919][123091] Updated weights for policy 0, policy_version 1346851 (0.0008) [2023-12-26 10:20:44,985][123091] Updated weights for policy 0, policy_version 1346861 (0.0009) [2023-12-26 10:20:45,393][123090] Updated weights for policy 1, policy_version 1337447 (0.0009) [2023-12-26 10:20:45,467][123090] Updated weights for policy 1, policy_version 1337457 (0.0006) [2023-12-26 10:20:45,535][123090] Updated weights for policy 1, policy_version 1337467 (0.0005) [2023-12-26 10:20:45,783][123091] Updated weights for policy 0, policy_version 1346871 (0.0010) [2023-12-26 10:20:45,837][123091] Updated weights for policy 0, policy_version 1346881 (0.0010) [2023-12-26 10:20:45,884][123091] Updated weights for policy 0, policy_version 1346891 (0.0010) [2023-12-26 10:20:46,300][123090] Updated weights for policy 1, policy_version 1337477 (0.0008) [2023-12-26 10:20:46,348][123090] Updated weights for policy 1, policy_version 1337487 (0.0010) [2023-12-26 10:20:46,396][123090] Updated weights for policy 1, policy_version 1337497 (0.0010) [2023-12-26 10:20:46,677][123091] Updated weights for policy 0, policy_version 1346901 (0.0009) [2023-12-26 10:20:46,748][123091] Updated weights for policy 0, policy_version 1346911 (0.0009) [2023-12-26 10:20:46,800][123091] Updated weights for policy 0, policy_version 1346921 (0.0009) [2023-12-26 10:20:47,254][123090] Updated weights for policy 1, policy_version 1337507 (0.0010) [2023-12-26 10:20:47,323][123090] Updated weights for policy 1, policy_version 1337517 (0.0010) [2023-12-26 10:20:47,387][123090] Updated weights for policy 1, policy_version 1337527 (0.0006) [2023-12-26 10:20:47,600][123091] Updated weights for policy 0, policy_version 1346931 (0.0008) [2023-12-26 10:20:47,656][123091] Updated weights for policy 0, policy_version 1346941 (0.0005) [2023-12-26 10:20:47,714][123091] Updated weights for policy 0, policy_version 1346951 (0.0006) [2023-12-26 10:20:48,156][123090] Updated weights for policy 1, policy_version 1337537 (0.0006) [2023-12-26 10:20:48,215][123090] Updated weights for policy 1, policy_version 1337547 (0.0010) [2023-12-26 10:20:48,282][123090] Updated weights for policy 1, policy_version 1337557 (0.0011) [2023-12-26 10:20:48,349][123090] Updated weights for policy 1, policy_version 1337567 (0.0011) [2023-12-26 10:20:48,535][123091] Updated weights for policy 0, policy_version 1346961 (0.0006) [2023-12-26 10:20:48,597][123091] Updated weights for policy 0, policy_version 1346971 (0.0009) [2023-12-26 10:20:48,662][123091] Updated weights for policy 0, policy_version 1346981 (0.0010) [2023-12-26 10:20:48,715][123091] Updated weights for policy 0, policy_version 1346991 (0.0009) [2023-12-26 10:20:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 687251456. Throughput: 0: 8714.7, 1: 8807.8. Samples: 687259412. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:48,785][121949] Avg episode reward: [(0, '6209.544'), (1, '5806.264')] [2023-12-26 10:20:49,141][123090] Updated weights for policy 1, policy_version 1337577 (0.0010) [2023-12-26 10:20:49,197][123090] Updated weights for policy 1, policy_version 1337587 (0.0010) [2023-12-26 10:20:49,256][123090] Updated weights for policy 1, policy_version 1337597 (0.0010) [2023-12-26 10:20:49,595][123091] Updated weights for policy 0, policy_version 1347001 (0.0010) [2023-12-26 10:20:49,649][123091] Updated weights for policy 0, policy_version 1347011 (0.0009) [2023-12-26 10:20:49,700][123091] Updated weights for policy 0, policy_version 1347021 (0.0008) [2023-12-26 10:20:50,095][123090] Updated weights for policy 1, policy_version 1337607 (0.0011) [2023-12-26 10:20:50,158][123090] Updated weights for policy 1, policy_version 1337617 (0.0010) [2023-12-26 10:20:50,229][123090] Updated weights for policy 1, policy_version 1337627 (0.0010) [2023-12-26 10:20:50,522][123091] Updated weights for policy 0, policy_version 1347031 (0.0009) [2023-12-26 10:20:50,575][123091] Updated weights for policy 0, policy_version 1347041 (0.0009) [2023-12-26 10:20:50,640][123091] Updated weights for policy 0, policy_version 1347051 (0.0009) [2023-12-26 10:20:51,060][123090] Updated weights for policy 1, policy_version 1337637 (0.0011) [2023-12-26 10:20:51,128][123090] Updated weights for policy 1, policy_version 1337647 (0.0010) [2023-12-26 10:20:51,196][123090] Updated weights for policy 1, policy_version 1337657 (0.0010) [2023-12-26 10:20:51,492][123091] Updated weights for policy 0, policy_version 1347061 (0.0009) [2023-12-26 10:20:51,555][123091] Updated weights for policy 0, policy_version 1347071 (0.0010) [2023-12-26 10:20:51,624][123091] Updated weights for policy 0, policy_version 1347081 (0.0009) [2023-12-26 10:20:52,017][123090] Updated weights for policy 1, policy_version 1337667 (0.0010) [2023-12-26 10:20:52,093][123090] Updated weights for policy 1, policy_version 1337677 (0.0006) [2023-12-26 10:20:52,166][123090] Updated weights for policy 1, policy_version 1337687 (0.0006) [2023-12-26 10:20:52,510][123091] Updated weights for policy 0, policy_version 1347091 (0.0010) [2023-12-26 10:20:52,569][123091] Updated weights for policy 0, policy_version 1347101 (0.0009) [2023-12-26 10:20:52,630][123091] Updated weights for policy 0, policy_version 1347111 (0.0009) [2023-12-26 10:20:52,870][123090] Updated weights for policy 1, policy_version 1337697 (0.0006) [2023-12-26 10:20:52,939][123090] Updated weights for policy 1, policy_version 1337707 (0.0008) [2023-12-26 10:20:52,995][123090] Updated weights for policy 1, policy_version 1337717 (0.0009) [2023-12-26 10:20:53,052][123090] Updated weights for policy 1, policy_version 1337727 (0.0005) [2023-12-26 10:20:53,476][123091] Updated weights for policy 0, policy_version 1347121 (0.0010) [2023-12-26 10:20:53,531][123091] Updated weights for policy 0, policy_version 1347131 (0.0009) [2023-12-26 10:20:53,589][123091] Updated weights for policy 0, policy_version 1347141 (0.0008) [2023-12-26 10:20:53,648][123091] Updated weights for policy 0, policy_version 1347151 (0.0005) [2023-12-26 10:20:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 687333376. Throughput: 0: 8710.7, 1: 8798.1. Samples: 687310036. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:53,785][121949] Avg episode reward: [(0, '6294.989'), (1, '5779.498')] [2023-12-26 10:20:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001347152_344875008.pth... [2023-12-26 10:20:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001346128_344612864.pth [2023-12-26 10:20:53,838][123090] Updated weights for policy 1, policy_version 1337737 (0.0008) [2023-12-26 10:20:53,906][123090] Updated weights for policy 1, policy_version 1337747 (0.0006) [2023-12-26 10:20:53,961][123090] Updated weights for policy 1, policy_version 1337757 (0.0005) [2023-12-26 10:20:53,979][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001337760_342466560.pth... [2023-12-26 10:20:53,982][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001336704_342196224.pth [2023-12-26 10:20:54,262][123091] Updated weights for policy 0, policy_version 1347161 (0.0008) [2023-12-26 10:20:54,324][123091] Updated weights for policy 0, policy_version 1347171 (0.0010) [2023-12-26 10:20:54,377][123091] Updated weights for policy 0, policy_version 1347181 (0.0010) [2023-12-26 10:20:54,649][123090] Updated weights for policy 1, policy_version 1337767 (0.0009) [2023-12-26 10:20:54,697][123090] Updated weights for policy 1, policy_version 1337777 (0.0009) [2023-12-26 10:20:54,746][123090] Updated weights for policy 1, policy_version 1337787 (0.0009) [2023-12-26 10:20:55,191][123091] Updated weights for policy 0, policy_version 1347191 (0.0007) [2023-12-26 10:20:55,236][123091] Updated weights for policy 0, policy_version 1347201 (0.0005) [2023-12-26 10:20:55,301][123091] Updated weights for policy 0, policy_version 1347211 (0.0005) [2023-12-26 10:20:55,636][123090] Updated weights for policy 1, policy_version 1337798 (0.0010) [2023-12-26 10:20:55,690][123090] Updated weights for policy 1, policy_version 1337808 (0.0009) [2023-12-26 10:20:55,743][123090] Updated weights for policy 1, policy_version 1337818 (0.0009) [2023-12-26 10:20:56,060][123091] Updated weights for policy 0, policy_version 1347221 (0.0007) [2023-12-26 10:20:56,119][123091] Updated weights for policy 0, policy_version 1347231 (0.0009) [2023-12-26 10:20:56,176][123091] Updated weights for policy 0, policy_version 1347242 (0.0010) [2023-12-26 10:20:56,613][123090] Updated weights for policy 1, policy_version 1337828 (0.0009) [2023-12-26 10:20:56,671][123090] Updated weights for policy 1, policy_version 1337838 (0.0010) [2023-12-26 10:20:56,724][123090] Updated weights for policy 1, policy_version 1337848 (0.0010) [2023-12-26 10:20:56,886][123091] Updated weights for policy 0, policy_version 1347252 (0.0010) [2023-12-26 10:20:56,941][123091] Updated weights for policy 0, policy_version 1347263 (0.0010) [2023-12-26 10:20:57,001][123091] Updated weights for policy 0, policy_version 1347275 (0.0010) [2023-12-26 10:20:57,574][123090] Updated weights for policy 1, policy_version 1337858 (0.0010) [2023-12-26 10:20:57,630][123090] Updated weights for policy 1, policy_version 1337868 (0.0010) [2023-12-26 10:20:57,688][123090] Updated weights for policy 1, policy_version 1337878 (0.0010) [2023-12-26 10:20:57,710][123091] Updated weights for policy 0, policy_version 1347285 (0.0007) [2023-12-26 10:20:57,742][123090] Updated weights for policy 1, policy_version 1337888 (0.0005) [2023-12-26 10:20:57,765][123091] Updated weights for policy 0, policy_version 1347295 (0.0006) [2023-12-26 10:20:57,818][123091] Updated weights for policy 0, policy_version 1347305 (0.0010) [2023-12-26 10:20:58,488][123090] Updated weights for policy 1, policy_version 1337898 (0.0010) [2023-12-26 10:20:58,561][123090] Updated weights for policy 1, policy_version 1337908 (0.0009) [2023-12-26 10:20:58,620][123091] Updated weights for policy 0, policy_version 1347315 (0.0009) [2023-12-26 10:20:58,634][123090] Updated weights for policy 1, policy_version 1337918 (0.0010) [2023-12-26 10:20:58,689][123091] Updated weights for policy 0, policy_version 1347325 (0.0010) [2023-12-26 10:20:58,761][123091] Updated weights for policy 0, policy_version 1347335 (0.0008) [2023-12-26 10:20:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 687423488. Throughput: 0: 8787.0, 1: 8834.9. Samples: 687418648. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:20:58,785][121949] Avg episode reward: [(0, '6152.875'), (1, '5866.605')] [2023-12-26 10:20:59,381][123090] Updated weights for policy 1, policy_version 1337928 (0.0010) [2023-12-26 10:20:59,448][123090] Updated weights for policy 1, policy_version 1337938 (0.0009) [2023-12-26 10:20:59,516][123090] Updated weights for policy 1, policy_version 1337948 (0.0007) [2023-12-26 10:20:59,566][123091] Updated weights for policy 0, policy_version 1347345 (0.0008) [2023-12-26 10:20:59,628][123091] Updated weights for policy 0, policy_version 1347355 (0.0006) [2023-12-26 10:20:59,696][123091] Updated weights for policy 0, policy_version 1347365 (0.0006) [2023-12-26 10:20:59,769][123091] Updated weights for policy 0, policy_version 1347375 (0.0006) [2023-12-26 10:21:00,296][123090] Updated weights for policy 1, policy_version 1337958 (0.0008) [2023-12-26 10:21:00,356][123090] Updated weights for policy 1, policy_version 1337968 (0.0009) [2023-12-26 10:21:00,421][123090] Updated weights for policy 1, policy_version 1337978 (0.0009) [2023-12-26 10:21:00,445][123091] Updated weights for policy 0, policy_version 1347385 (0.0008) [2023-12-26 10:21:00,509][123091] Updated weights for policy 0, policy_version 1347395 (0.0005) [2023-12-26 10:21:00,580][123091] Updated weights for policy 0, policy_version 1347405 (0.0009) [2023-12-26 10:21:01,235][123090] Updated weights for policy 1, policy_version 1337988 (0.0009) [2023-12-26 10:21:01,304][123090] Updated weights for policy 1, policy_version 1337998 (0.0009) [2023-12-26 10:21:01,305][123091] Updated weights for policy 0, policy_version 1347415 (0.0008) [2023-12-26 10:21:01,369][123091] Updated weights for policy 0, policy_version 1347425 (0.0009) [2023-12-26 10:21:01,378][123090] Updated weights for policy 1, policy_version 1338008 (0.0008) [2023-12-26 10:21:01,431][123091] Updated weights for policy 0, policy_version 1347435 (0.0007) [2023-12-26 10:21:02,094][123090] Updated weights for policy 1, policy_version 1338018 (0.0007) [2023-12-26 10:21:02,151][123090] Updated weights for policy 1, policy_version 1338028 (0.0010) [2023-12-26 10:21:02,207][123090] Updated weights for policy 1, policy_version 1338038 (0.0009) [2023-12-26 10:21:02,257][123091] Updated weights for policy 0, policy_version 1347445 (0.0009) [2023-12-26 10:21:02,265][123090] Updated weights for policy 1, policy_version 1338048 (0.0008) [2023-12-26 10:21:02,314][123091] Updated weights for policy 0, policy_version 1347455 (0.0010) [2023-12-26 10:21:02,380][123091] Updated weights for policy 0, policy_version 1347465 (0.0009) [2023-12-26 10:21:03,072][123090] Updated weights for policy 1, policy_version 1338058 (0.0009) [2023-12-26 10:21:03,135][123090] Updated weights for policy 1, policy_version 1338068 (0.0006) [2023-12-26 10:21:03,200][123090] Updated weights for policy 1, policy_version 1338078 (0.0009) [2023-12-26 10:21:03,237][123091] Updated weights for policy 0, policy_version 1347475 (0.0009) [2023-12-26 10:21:03,286][123091] Updated weights for policy 0, policy_version 1347485 (0.0009) [2023-12-26 10:21:03,344][123091] Updated weights for policy 0, policy_version 1347495 (0.0010) [2023-12-26 10:21:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 687513600. Throughput: 0: 8696.1, 1: 8875.8. Samples: 687526100. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:21:03,785][121949] Avg episode reward: [(0, '6161.979'), (1, '5859.772')] [2023-12-26 10:21:03,974][123090] Updated weights for policy 1, policy_version 1338088 (0.0011) [2023-12-26 10:21:04,047][123090] Updated weights for policy 1, policy_version 1338098 (0.0009) [2023-12-26 10:21:04,103][123090] Updated weights for policy 1, policy_version 1338108 (0.0007) [2023-12-26 10:21:04,248][123091] Updated weights for policy 0, policy_version 1347505 (0.0010) [2023-12-26 10:21:04,321][123091] Updated weights for policy 0, policy_version 1347515 (0.0009) [2023-12-26 10:21:04,386][123091] Updated weights for policy 0, policy_version 1347525 (0.0010) [2023-12-26 10:21:04,456][123091] Updated weights for policy 0, policy_version 1347535 (0.0009) [2023-12-26 10:21:04,801][123090] Updated weights for policy 1, policy_version 1338118 (0.0006) [2023-12-26 10:21:04,851][123090] Updated weights for policy 1, policy_version 1338128 (0.0006) [2023-12-26 10:21:04,901][123090] Updated weights for policy 1, policy_version 1338138 (0.0005) [2023-12-26 10:21:05,323][123091] Updated weights for policy 0, policy_version 1347545 (0.0008) [2023-12-26 10:21:05,382][123091] Updated weights for policy 0, policy_version 1347555 (0.0008) [2023-12-26 10:21:05,435][123091] Updated weights for policy 0, policy_version 1347565 (0.0009) [2023-12-26 10:21:05,646][123090] Updated weights for policy 1, policy_version 1338148 (0.0008) [2023-12-26 10:21:05,692][123090] Updated weights for policy 1, policy_version 1338158 (0.0005) [2023-12-26 10:21:05,741][123090] Updated weights for policy 1, policy_version 1338168 (0.0005) [2023-12-26 10:21:06,045][123091] Updated weights for policy 0, policy_version 1347575 (0.0005) [2023-12-26 10:21:06,096][123091] Updated weights for policy 0, policy_version 1347585 (0.0006) [2023-12-26 10:21:06,160][123091] Updated weights for policy 0, policy_version 1347595 (0.0010) [2023-12-26 10:21:06,500][123090] Updated weights for policy 1, policy_version 1338178 (0.0006) [2023-12-26 10:21:06,569][123090] Updated weights for policy 1, policy_version 1338188 (0.0008) [2023-12-26 10:21:06,632][123090] Updated weights for policy 1, policy_version 1338198 (0.0007) [2023-12-26 10:21:06,701][123090] Updated weights for policy 1, policy_version 1338208 (0.0006) [2023-12-26 10:21:06,884][123091] Updated weights for policy 0, policy_version 1347605 (0.0009) [2023-12-26 10:21:06,941][123091] Updated weights for policy 0, policy_version 1347615 (0.0010) [2023-12-26 10:21:06,998][123091] Updated weights for policy 0, policy_version 1347625 (0.0009) [2023-12-26 10:21:07,452][123090] Updated weights for policy 1, policy_version 1338218 (0.0010) [2023-12-26 10:21:07,519][123090] Updated weights for policy 1, policy_version 1338228 (0.0010) [2023-12-26 10:21:07,563][123090] Updated weights for policy 1, policy_version 1338238 (0.0010) [2023-12-26 10:21:07,880][123091] Updated weights for policy 0, policy_version 1347635 (0.0009) [2023-12-26 10:21:07,934][123091] Updated weights for policy 0, policy_version 1347645 (0.0009) [2023-12-26 10:21:07,986][123091] Updated weights for policy 0, policy_version 1347655 (0.0010) [2023-12-26 10:21:08,171][123090] Updated weights for policy 1, policy_version 1338248 (0.0006) [2023-12-26 10:21:08,227][123090] Updated weights for policy 1, policy_version 1338258 (0.0005) [2023-12-26 10:21:08,281][123090] Updated weights for policy 1, policy_version 1338268 (0.0005) [2023-12-26 10:21:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 687603712. Throughput: 0: 8738.4, 1: 8922.5. Samples: 687581328. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:21:08,785][121949] Avg episode reward: [(0, '6210.818'), (1, '5856.538')] [2023-12-26 10:21:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001347664_345006080.pth... [2023-12-26 10:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001338272_342597632.pth... [2023-12-26 10:21:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001346640_344743936.pth [2023-12-26 10:21:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001337248_342335488.pth [2023-12-26 10:21:08,899][123091] Updated weights for policy 0, policy_version 1347665 (0.0009) [2023-12-26 10:21:08,968][123091] Updated weights for policy 0, policy_version 1347675 (0.0009) [2023-12-26 10:21:09,015][123090] Updated weights for policy 1, policy_version 1338278 (0.0009) [2023-12-26 10:21:09,035][123091] Updated weights for policy 0, policy_version 1347685 (0.0009) [2023-12-26 10:21:09,083][123090] Updated weights for policy 1, policy_version 1338288 (0.0009) [2023-12-26 10:21:09,095][123091] Updated weights for policy 0, policy_version 1347695 (0.0007) [2023-12-26 10:21:09,147][123090] Updated weights for policy 1, policy_version 1338298 (0.0011) [2023-12-26 10:21:10,007][123091] Updated weights for policy 0, policy_version 1347705 (0.0010) [2023-12-26 10:21:10,079][123091] Updated weights for policy 0, policy_version 1347715 (0.0010) [2023-12-26 10:21:10,113][123090] Updated weights for policy 1, policy_version 1338308 (0.0011) [2023-12-26 10:21:10,147][123091] Updated weights for policy 0, policy_version 1347725 (0.0009) [2023-12-26 10:21:10,172][123090] Updated weights for policy 1, policy_version 1338318 (0.0007) [2023-12-26 10:21:10,229][123090] Updated weights for policy 1, policy_version 1338328 (0.0009) [2023-12-26 10:21:10,989][123091] Updated weights for policy 0, policy_version 1347735 (0.0009) [2023-12-26 10:21:11,055][123091] Updated weights for policy 0, policy_version 1347745 (0.0007) [2023-12-26 10:21:11,109][123090] Updated weights for policy 1, policy_version 1338338 (0.0007) [2023-12-26 10:21:11,126][123091] Updated weights for policy 0, policy_version 1347755 (0.0008) [2023-12-26 10:21:11,184][123090] Updated weights for policy 1, policy_version 1338348 (0.0008) [2023-12-26 10:21:11,260][123090] Updated weights for policy 1, policy_version 1338358 (0.0010) [2023-12-26 10:21:11,339][123090] Updated weights for policy 1, policy_version 1338368 (0.0008) [2023-12-26 10:21:12,096][123091] Updated weights for policy 0, policy_version 1347765 (0.0009) [2023-12-26 10:21:12,157][123091] Updated weights for policy 0, policy_version 1347775 (0.0010) [2023-12-26 10:21:12,229][123091] Updated weights for policy 0, policy_version 1347785 (0.0010) [2023-12-26 10:21:12,303][123090] Updated weights for policy 1, policy_version 1338378 (0.0009) [2023-12-26 10:21:12,389][123090] Updated weights for policy 1, policy_version 1338388 (0.0009) [2023-12-26 10:21:12,468][123090] Updated weights for policy 1, policy_version 1338398 (0.0009) [2023-12-26 10:21:13,137][123091] Updated weights for policy 0, policy_version 1347795 (0.0008) [2023-12-26 10:21:13,209][123091] Updated weights for policy 0, policy_version 1347805 (0.0010) [2023-12-26 10:21:13,278][123091] Updated weights for policy 0, policy_version 1347815 (0.0010) [2023-12-26 10:21:13,330][123090] Updated weights for policy 1, policy_version 1338408 (0.0008) [2023-12-26 10:21:13,405][123090] Updated weights for policy 1, policy_version 1338418 (0.0008) [2023-12-26 10:21:13,477][123090] Updated weights for policy 1, policy_version 1338428 (0.0007) [2023-12-26 10:21:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 687685632. Throughput: 0: 8658.0, 1: 8845.8. Samples: 687678920. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:21:13,785][121949] Avg episode reward: [(0, '6155.807'), (1, '5903.973')] [2023-12-26 10:21:14,225][123091] Updated weights for policy 0, policy_version 1347825 (0.0009) [2023-12-26 10:21:14,283][123091] Updated weights for policy 0, policy_version 1347835 (0.0006) [2023-12-26 10:21:14,311][123090] Updated weights for policy 1, policy_version 1338438 (0.0008) [2023-12-26 10:21:14,345][123091] Updated weights for policy 0, policy_version 1347845 (0.0007) [2023-12-26 10:21:14,381][123090] Updated weights for policy 1, policy_version 1338448 (0.0009) [2023-12-26 10:21:14,414][123091] Updated weights for policy 0, policy_version 1347855 (0.0008) [2023-12-26 10:21:14,453][123090] Updated weights for policy 1, policy_version 1338458 (0.0010) [2023-12-26 10:21:15,270][123091] Updated weights for policy 0, policy_version 1347865 (0.0010) [2023-12-26 10:21:15,316][123090] Updated weights for policy 1, policy_version 1338468 (0.0008) [2023-12-26 10:21:15,339][123091] Updated weights for policy 0, policy_version 1347875 (0.0011) [2023-12-26 10:21:15,384][123090] Updated weights for policy 1, policy_version 1338478 (0.0008) [2023-12-26 10:21:15,403][123091] Updated weights for policy 0, policy_version 1347885 (0.0011) [2023-12-26 10:21:15,451][123090] Updated weights for policy 1, policy_version 1338488 (0.0008) [2023-12-26 10:21:16,224][123091] Updated weights for policy 0, policy_version 1347895 (0.0007) [2023-12-26 10:21:16,281][123091] Updated weights for policy 0, policy_version 1347905 (0.0005) [2023-12-26 10:21:16,328][123090] Updated weights for policy 1, policy_version 1338498 (0.0009) [2023-12-26 10:21:16,344][123091] Updated weights for policy 0, policy_version 1347915 (0.0007) [2023-12-26 10:21:16,391][123090] Updated weights for policy 1, policy_version 1338508 (0.0008) [2023-12-26 10:21:16,457][123090] Updated weights for policy 1, policy_version 1338518 (0.0010) [2023-12-26 10:21:16,521][123090] Updated weights for policy 1, policy_version 1338528 (0.0011) [2023-12-26 10:21:17,154][123091] Updated weights for policy 0, policy_version 1347925 (0.0011) [2023-12-26 10:21:17,217][123091] Updated weights for policy 0, policy_version 1347935 (0.0011) [2023-12-26 10:21:17,285][123091] Updated weights for policy 0, policy_version 1347945 (0.0011) [2023-12-26 10:21:17,353][123090] Updated weights for policy 1, policy_version 1338538 (0.0008) [2023-12-26 10:21:17,415][123090] Updated weights for policy 1, policy_version 1338548 (0.0007) [2023-12-26 10:21:17,485][123090] Updated weights for policy 1, policy_version 1338558 (0.0006) [2023-12-26 10:21:18,106][123091] Updated weights for policy 0, policy_version 1347955 (0.0011) [2023-12-26 10:21:18,177][123091] Updated weights for policy 0, policy_version 1347965 (0.0011) [2023-12-26 10:21:18,244][123091] Updated weights for policy 0, policy_version 1347975 (0.0011) [2023-12-26 10:21:18,293][123090] Updated weights for policy 1, policy_version 1338568 (0.0008) [2023-12-26 10:21:18,361][123090] Updated weights for policy 1, policy_version 1338578 (0.0012) [2023-12-26 10:21:18,427][123090] Updated weights for policy 1, policy_version 1338588 (0.0009) [2023-12-26 10:21:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 687767552. Throughput: 0: 8586.7, 1: 8751.4. Samples: 687777836. Policy #0 lag: (min: 31.0, avg: 34.9, max: 63.0) [2023-12-26 10:21:18,786][121949] Avg episode reward: [(0, '6215.694'), (1, '5803.871')] [2023-12-26 10:21:19,077][123091] Updated weights for policy 0, policy_version 1347985 (0.0009) [2023-12-26 10:21:19,135][123091] Updated weights for policy 0, policy_version 1347995 (0.0009) [2023-12-26 10:21:19,196][123091] Updated weights for policy 0, policy_version 1348005 (0.0006) [2023-12-26 10:21:19,272][123091] Updated weights for policy 0, policy_version 1348015 (0.0010) [2023-12-26 10:21:19,289][123090] Updated weights for policy 1, policy_version 1338598 (0.0010) [2023-12-26 10:21:19,361][123090] Updated weights for policy 1, policy_version 1338608 (0.0011) [2023-12-26 10:21:19,422][123090] Updated weights for policy 1, policy_version 1338618 (0.0010) [2023-12-26 10:21:20,160][123091] Updated weights for policy 0, policy_version 1348025 (0.0009) [2023-12-26 10:21:20,240][123091] Updated weights for policy 0, policy_version 1348035 (0.0008) [2023-12-26 10:21:20,310][123091] Updated weights for policy 0, policy_version 1348045 (0.0008) [2023-12-26 10:21:20,361][123090] Updated weights for policy 1, policy_version 1338628 (0.0010) [2023-12-26 10:21:20,425][123090] Updated weights for policy 1, policy_version 1338638 (0.0009) [2023-12-26 10:21:20,490][123090] Updated weights for policy 1, policy_version 1338648 (0.0009) [2023-12-26 10:21:21,152][123091] Updated weights for policy 0, policy_version 1348055 (0.0009) [2023-12-26 10:21:21,224][123091] Updated weights for policy 0, policy_version 1348065 (0.0008) [2023-12-26 10:21:21,308][123091] Updated weights for policy 0, policy_version 1348075 (0.0009) [2023-12-26 10:21:21,459][123090] Updated weights for policy 1, policy_version 1338658 (0.0008) [2023-12-26 10:21:21,537][123090] Updated weights for policy 1, policy_version 1338668 (0.0008) [2023-12-26 10:21:21,615][123090] Updated weights for policy 1, policy_version 1338678 (0.0008) [2023-12-26 10:21:21,693][123090] Updated weights for policy 1, policy_version 1338688 (0.0008) [2023-12-26 10:21:22,232][123091] Updated weights for policy 0, policy_version 1348085 (0.0009) [2023-12-26 10:21:22,321][123091] Updated weights for policy 0, policy_version 1348095 (0.0009) [2023-12-26 10:21:22,395][123091] Updated weights for policy 0, policy_version 1348105 (0.0009) [2023-12-26 10:21:22,549][123090] Updated weights for policy 1, policy_version 1338698 (0.0011) [2023-12-26 10:21:22,623][123090] Updated weights for policy 1, policy_version 1338708 (0.0011) [2023-12-26 10:21:22,692][123090] Updated weights for policy 1, policy_version 1338718 (0.0011) [2023-12-26 10:21:23,260][123091] Updated weights for policy 0, policy_version 1348115 (0.0009) [2023-12-26 10:21:23,323][123091] Updated weights for policy 0, policy_version 1348125 (0.0009) [2023-12-26 10:21:23,397][123091] Updated weights for policy 0, policy_version 1348135 (0.0009) [2023-12-26 10:21:23,531][123090] Updated weights for policy 1, policy_version 1338728 (0.0011) [2023-12-26 10:21:23,602][123090] Updated weights for policy 1, policy_version 1338738 (0.0011) [2023-12-26 10:21:23,670][123090] Updated weights for policy 1, policy_version 1338748 (0.0007) [2023-12-26 10:21:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 687849472. Throughput: 0: 8552.1, 1: 8651.2. Samples: 687825060. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:23,785][121949] Avg episode reward: [(0, '6268.045'), (1, '5798.936')] [2023-12-26 10:21:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001348144_345128960.pth... [2023-12-26 10:21:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001338752_342720512.pth... [2023-12-26 10:21:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001347152_344875008.pth [2023-12-26 10:21:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001337760_342466560.pth [2023-12-26 10:21:24,298][123091] Updated weights for policy 0, policy_version 1348145 (0.0009) [2023-12-26 10:21:24,369][123091] Updated weights for policy 0, policy_version 1348155 (0.0010) [2023-12-26 10:21:24,393][123090] Updated weights for policy 1, policy_version 1338758 (0.0007) [2023-12-26 10:21:24,445][123091] Updated weights for policy 0, policy_version 1348165 (0.0008) [2023-12-26 10:21:24,457][123090] Updated weights for policy 1, policy_version 1338768 (0.0009) [2023-12-26 10:21:24,516][123091] Updated weights for policy 0, policy_version 1348175 (0.0009) [2023-12-26 10:21:24,530][123090] Updated weights for policy 1, policy_version 1338778 (0.0009) [2023-12-26 10:21:25,389][123091] Updated weights for policy 0, policy_version 1348185 (0.0009) [2023-12-26 10:21:25,400][123090] Updated weights for policy 1, policy_version 1338788 (0.0009) [2023-12-26 10:21:25,459][123091] Updated weights for policy 0, policy_version 1348195 (0.0009) [2023-12-26 10:21:25,470][123090] Updated weights for policy 1, policy_version 1338798 (0.0008) [2023-12-26 10:21:25,522][123091] Updated weights for policy 0, policy_version 1348205 (0.0008) [2023-12-26 10:21:25,534][123090] Updated weights for policy 1, policy_version 1338808 (0.0010) [2023-12-26 10:21:26,365][123090] Updated weights for policy 1, policy_version 1338818 (0.0009) [2023-12-26 10:21:26,366][123091] Updated weights for policy 0, policy_version 1348215 (0.0008) [2023-12-26 10:21:26,435][123091] Updated weights for policy 0, policy_version 1348225 (0.0008) [2023-12-26 10:21:26,435][123090] Updated weights for policy 1, policy_version 1338828 (0.0008) [2023-12-26 10:21:26,503][123091] Updated weights for policy 0, policy_version 1348235 (0.0007) [2023-12-26 10:21:26,513][123090] Updated weights for policy 1, policy_version 1338838 (0.0008) [2023-12-26 10:21:26,592][123090] Updated weights for policy 1, policy_version 1338848 (0.0006) [2023-12-26 10:21:27,334][123090] Updated weights for policy 1, policy_version 1338858 (0.0009) [2023-12-26 10:21:27,360][123091] Updated weights for policy 0, policy_version 1348245 (0.0007) [2023-12-26 10:21:27,398][123090] Updated weights for policy 1, policy_version 1338868 (0.0008) [2023-12-26 10:21:27,425][123091] Updated weights for policy 0, policy_version 1348255 (0.0006) [2023-12-26 10:21:27,465][123090] Updated weights for policy 1, policy_version 1338878 (0.0008) [2023-12-26 10:21:27,483][123091] Updated weights for policy 0, policy_version 1348265 (0.0006) [2023-12-26 10:21:28,308][123091] Updated weights for policy 0, policy_version 1348275 (0.0007) [2023-12-26 10:21:28,333][123090] Updated weights for policy 1, policy_version 1338888 (0.0009) [2023-12-26 10:21:28,379][123091] Updated weights for policy 0, policy_version 1348285 (0.0009) [2023-12-26 10:21:28,404][123090] Updated weights for policy 1, policy_version 1338898 (0.0009) [2023-12-26 10:21:28,449][123091] Updated weights for policy 0, policy_version 1348295 (0.0009) [2023-12-26 10:21:28,461][123090] Updated weights for policy 1, policy_version 1338908 (0.0008) [2023-12-26 10:21:28,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 687931392. Throughput: 0: 8510.7, 1: 8615.0. Samples: 687924072. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:28,785][121949] Avg episode reward: [(0, '6232.581'), (1, '5849.411')] [2023-12-26 10:21:29,328][123091] Updated weights for policy 0, policy_version 1348305 (0.0010) [2023-12-26 10:21:29,375][123090] Updated weights for policy 1, policy_version 1338918 (0.0009) [2023-12-26 10:21:29,405][123091] Updated weights for policy 0, policy_version 1348315 (0.0009) [2023-12-26 10:21:29,444][123090] Updated weights for policy 1, policy_version 1338928 (0.0011) [2023-12-26 10:21:29,478][123091] Updated weights for policy 0, policy_version 1348325 (0.0008) [2023-12-26 10:21:29,514][123090] Updated weights for policy 1, policy_version 1338938 (0.0011) [2023-12-26 10:21:29,548][123091] Updated weights for policy 0, policy_version 1348335 (0.0010) [2023-12-26 10:21:30,451][123091] Updated weights for policy 0, policy_version 1348345 (0.0008) [2023-12-26 10:21:30,457][123090] Updated weights for policy 1, policy_version 1338948 (0.0011) [2023-12-26 10:21:30,515][123090] Updated weights for policy 1, policy_version 1338958 (0.0011) [2023-12-26 10:21:30,518][123091] Updated weights for policy 0, policy_version 1348355 (0.0007) [2023-12-26 10:21:30,585][123091] Updated weights for policy 0, policy_version 1348365 (0.0007) [2023-12-26 10:21:30,588][123090] Updated weights for policy 1, policy_version 1338968 (0.0011) [2023-12-26 10:21:31,489][123090] Updated weights for policy 1, policy_version 1338978 (0.0010) [2023-12-26 10:21:31,556][123091] Updated weights for policy 0, policy_version 1348375 (0.0010) [2023-12-26 10:21:31,558][123090] Updated weights for policy 1, policy_version 1338988 (0.0008) [2023-12-26 10:21:31,629][123091] Updated weights for policy 0, policy_version 1348385 (0.0009) [2023-12-26 10:21:31,634][123090] Updated weights for policy 1, policy_version 1338998 (0.0009) [2023-12-26 10:21:31,697][123091] Updated weights for policy 0, policy_version 1348395 (0.0007) [2023-12-26 10:21:31,703][123090] Updated weights for policy 1, policy_version 1339008 (0.0010) [2023-12-26 10:21:32,558][123090] Updated weights for policy 1, policy_version 1339018 (0.0009) [2023-12-26 10:21:32,584][123091] Updated weights for policy 0, policy_version 1348405 (0.0008) [2023-12-26 10:21:32,618][123090] Updated weights for policy 1, policy_version 1339028 (0.0005) [2023-12-26 10:21:32,647][123091] Updated weights for policy 0, policy_version 1348415 (0.0010) [2023-12-26 10:21:32,688][123090] Updated weights for policy 1, policy_version 1339038 (0.0006) [2023-12-26 10:21:32,714][123091] Updated weights for policy 0, policy_version 1348425 (0.0007) [2023-12-26 10:21:33,451][123090] Updated weights for policy 1, policy_version 1339048 (0.0008) [2023-12-26 10:21:33,518][123090] Updated weights for policy 1, policy_version 1339058 (0.0009) [2023-12-26 10:21:33,529][123091] Updated weights for policy 0, policy_version 1348435 (0.0006) [2023-12-26 10:21:33,590][123090] Updated weights for policy 1, policy_version 1339068 (0.0009) [2023-12-26 10:21:33,601][123091] Updated weights for policy 0, policy_version 1348445 (0.0007) [2023-12-26 10:21:33,672][123091] Updated weights for policy 0, policy_version 1348455 (0.0009) [2023-12-26 10:21:33,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17066.7, 300 sec: 17578.1). Total num frames: 688013312. Throughput: 0: 8383.5, 1: 8508.9. Samples: 688019572. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:33,785][121949] Avg episode reward: [(0, '6311.339'), (1, '5757.502')] [2023-12-26 10:21:34,423][123090] Updated weights for policy 1, policy_version 1339078 (0.0008) [2023-12-26 10:21:34,496][123090] Updated weights for policy 1, policy_version 1339088 (0.0010) [2023-12-26 10:21:34,509][123091] Updated weights for policy 0, policy_version 1348465 (0.0010) [2023-12-26 10:21:34,567][123090] Updated weights for policy 1, policy_version 1339098 (0.0007) [2023-12-26 10:21:34,573][123091] Updated weights for policy 0, policy_version 1348475 (0.0008) [2023-12-26 10:21:34,640][123091] Updated weights for policy 0, policy_version 1348485 (0.0008) [2023-12-26 10:21:34,715][123091] Updated weights for policy 0, policy_version 1348495 (0.0008) [2023-12-26 10:21:35,459][123090] Updated weights for policy 1, policy_version 1339108 (0.0009) [2023-12-26 10:21:35,487][123091] Updated weights for policy 0, policy_version 1348505 (0.0010) [2023-12-26 10:21:35,528][123090] Updated weights for policy 1, policy_version 1339118 (0.0008) [2023-12-26 10:21:35,551][123091] Updated weights for policy 0, policy_version 1348515 (0.0008) [2023-12-26 10:21:35,600][123090] Updated weights for policy 1, policy_version 1339128 (0.0007) [2023-12-26 10:21:35,617][123091] Updated weights for policy 0, policy_version 1348525 (0.0011) [2023-12-26 10:21:36,461][123090] Updated weights for policy 1, policy_version 1339138 (0.0008) [2023-12-26 10:21:36,522][123091] Updated weights for policy 0, policy_version 1348535 (0.0009) [2023-12-26 10:21:36,533][123090] Updated weights for policy 1, policy_version 1339148 (0.0008) [2023-12-26 10:21:36,595][123091] Updated weights for policy 0, policy_version 1348545 (0.0009) [2023-12-26 10:21:36,606][123090] Updated weights for policy 1, policy_version 1339158 (0.0009) [2023-12-26 10:21:36,667][123091] Updated weights for policy 0, policy_version 1348555 (0.0008) [2023-12-26 10:21:36,674][123090] Updated weights for policy 1, policy_version 1339168 (0.0007) [2023-12-26 10:21:37,466][123090] Updated weights for policy 1, policy_version 1339178 (0.0010) [2023-12-26 10:21:37,519][123091] Updated weights for policy 0, policy_version 1348565 (0.0009) [2023-12-26 10:21:37,527][123090] Updated weights for policy 1, policy_version 1339188 (0.0008) [2023-12-26 10:21:37,583][123091] Updated weights for policy 0, policy_version 1348575 (0.0007) [2023-12-26 10:21:37,602][123090] Updated weights for policy 1, policy_version 1339198 (0.0008) [2023-12-26 10:21:37,640][123091] Updated weights for policy 0, policy_version 1348585 (0.0008) [2023-12-26 10:21:38,471][123091] Updated weights for policy 0, policy_version 1348595 (0.0009) [2023-12-26 10:21:38,509][123090] Updated weights for policy 1, policy_version 1339208 (0.0009) [2023-12-26 10:21:38,542][123091] Updated weights for policy 0, policy_version 1348605 (0.0008) [2023-12-26 10:21:38,577][123090] Updated weights for policy 1, policy_version 1339218 (0.0007) [2023-12-26 10:21:38,610][123091] Updated weights for policy 0, policy_version 1348615 (0.0010) [2023-12-26 10:21:38,640][123090] Updated weights for policy 1, policy_version 1339228 (0.0008) [2023-12-26 10:21:38,784][121949] Fps is (10 sec: 16383.5, 60 sec: 17066.6, 300 sec: 17578.1). Total num frames: 688095232. Throughput: 0: 8378.3, 1: 8497.2. Samples: 688069432. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:38,785][121949] Avg episode reward: [(0, '6349.777'), (1, '5583.297')] [2023-12-26 10:21:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001348624_345251840.pth... [2023-12-26 10:21:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001339232_342843392.pth... [2023-12-26 10:21:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001347664_345006080.pth [2023-12-26 10:21:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001338272_342597632.pth [2023-12-26 10:21:39,385][123091] Updated weights for policy 0, policy_version 1348625 (0.0008) [2023-12-26 10:21:39,465][123091] Updated weights for policy 0, policy_version 1348635 (0.0009) [2023-12-26 10:21:39,532][123091] Updated weights for policy 0, policy_version 1348645 (0.0008) [2023-12-26 10:21:39,551][123090] Updated weights for policy 1, policy_version 1339238 (0.0010) [2023-12-26 10:21:39,601][123091] Updated weights for policy 0, policy_version 1348655 (0.0006) [2023-12-26 10:21:39,615][123090] Updated weights for policy 1, policy_version 1339248 (0.0009) [2023-12-26 10:21:39,671][123090] Updated weights for policy 1, policy_version 1339258 (0.0009) [2023-12-26 10:21:40,464][123091] Updated weights for policy 0, policy_version 1348665 (0.0010) [2023-12-26 10:21:40,526][123091] Updated weights for policy 0, policy_version 1348675 (0.0009) [2023-12-26 10:21:40,555][123090] Updated weights for policy 1, policy_version 1339268 (0.0009) [2023-12-26 10:21:40,594][123091] Updated weights for policy 0, policy_version 1348685 (0.0007) [2023-12-26 10:21:40,622][123090] Updated weights for policy 1, policy_version 1339278 (0.0008) [2023-12-26 10:21:40,688][123090] Updated weights for policy 1, policy_version 1339288 (0.0010) [2023-12-26 10:21:41,488][123091] Updated weights for policy 0, policy_version 1348695 (0.0009) [2023-12-26 10:21:41,558][123091] Updated weights for policy 0, policy_version 1348705 (0.0010) [2023-12-26 10:21:41,613][123090] Updated weights for policy 1, policy_version 1339298 (0.0008) [2023-12-26 10:21:41,630][123091] Updated weights for policy 0, policy_version 1348715 (0.0010) [2023-12-26 10:21:41,691][123090] Updated weights for policy 1, policy_version 1339308 (0.0008) [2023-12-26 10:21:41,769][123090] Updated weights for policy 1, policy_version 1339318 (0.0007) [2023-12-26 10:21:41,851][123090] Updated weights for policy 1, policy_version 1339328 (0.0008) [2023-12-26 10:21:42,559][123091] Updated weights for policy 0, policy_version 1348725 (0.0010) [2023-12-26 10:21:42,632][123091] Updated weights for policy 0, policy_version 1348735 (0.0010) [2023-12-26 10:21:42,699][123090] Updated weights for policy 1, policy_version 1339338 (0.0008) [2023-12-26 10:21:42,713][123091] Updated weights for policy 0, policy_version 1348745 (0.0011) [2023-12-26 10:21:42,760][123090] Updated weights for policy 1, policy_version 1339348 (0.0008) [2023-12-26 10:21:42,828][123090] Updated weights for policy 1, policy_version 1339358 (0.0008) [2023-12-26 10:21:43,531][123091] Updated weights for policy 0, policy_version 1348755 (0.0011) [2023-12-26 10:21:43,580][123090] Updated weights for policy 1, policy_version 1339368 (0.0009) [2023-12-26 10:21:43,596][123091] Updated weights for policy 0, policy_version 1348765 (0.0011) [2023-12-26 10:21:43,638][123090] Updated weights for policy 1, policy_version 1339378 (0.0006) [2023-12-26 10:21:43,652][123091] Updated weights for policy 0, policy_version 1348775 (0.0011) [2023-12-26 10:21:43,690][123090] Updated weights for policy 1, policy_version 1339388 (0.0006) [2023-12-26 10:21:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 17550.3). Total num frames: 688177152. Throughput: 0: 8233.9, 1: 8374.8. Samples: 688166040. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:43,785][121949] Avg episode reward: [(0, '6312.167'), (1, '5556.778')] [2023-12-26 10:21:44,498][123091] Updated weights for policy 0, policy_version 1348785 (0.0011) [2023-12-26 10:21:44,502][123090] Updated weights for policy 1, policy_version 1339398 (0.0008) [2023-12-26 10:21:44,566][123091] Updated weights for policy 0, policy_version 1348795 (0.0011) [2023-12-26 10:21:44,566][123090] Updated weights for policy 1, policy_version 1339408 (0.0008) [2023-12-26 10:21:44,618][123091] Updated weights for policy 0, policy_version 1348805 (0.0010) [2023-12-26 10:21:44,633][123090] Updated weights for policy 1, policy_version 1339418 (0.0006) [2023-12-26 10:21:44,677][123091] Updated weights for policy 0, policy_version 1348815 (0.0011) [2023-12-26 10:21:45,457][123091] Updated weights for policy 0, policy_version 1348825 (0.0011) [2023-12-26 10:21:45,511][123090] Updated weights for policy 1, policy_version 1339428 (0.0008) [2023-12-26 10:21:45,530][123091] Updated weights for policy 0, policy_version 1348835 (0.0011) [2023-12-26 10:21:45,573][123090] Updated weights for policy 1, policy_version 1339438 (0.0008) [2023-12-26 10:21:45,599][123091] Updated weights for policy 0, policy_version 1348845 (0.0011) [2023-12-26 10:21:45,643][123090] Updated weights for policy 1, policy_version 1339448 (0.0009) [2023-12-26 10:21:46,417][123090] Updated weights for policy 1, policy_version 1339458 (0.0008) [2023-12-26 10:21:46,447][123091] Updated weights for policy 0, policy_version 1348855 (0.0007) [2023-12-26 10:21:46,487][123090] Updated weights for policy 1, policy_version 1339468 (0.0005) [2023-12-26 10:21:46,505][123091] Updated weights for policy 0, policy_version 1348865 (0.0005) [2023-12-26 10:21:46,556][123090] Updated weights for policy 1, policy_version 1339478 (0.0007) [2023-12-26 10:21:46,573][123091] Updated weights for policy 0, policy_version 1348875 (0.0005) [2023-12-26 10:21:46,618][123090] Updated weights for policy 1, policy_version 1339488 (0.0008) [2023-12-26 10:21:47,191][123091] Updated weights for policy 0, policy_version 1348885 (0.0006) [2023-12-26 10:21:47,250][123091] Updated weights for policy 0, policy_version 1348895 (0.0006) [2023-12-26 10:21:47,307][123091] Updated weights for policy 0, policy_version 1348905 (0.0007) [2023-12-26 10:21:47,355][123090] Updated weights for policy 1, policy_version 1339498 (0.0008) [2023-12-26 10:21:47,419][123090] Updated weights for policy 1, policy_version 1339508 (0.0010) [2023-12-26 10:21:47,480][123090] Updated weights for policy 1, policy_version 1339518 (0.0007) [2023-12-26 10:21:48,137][123091] Updated weights for policy 0, policy_version 1348915 (0.0010) [2023-12-26 10:21:48,190][123091] Updated weights for policy 0, policy_version 1348925 (0.0010) [2023-12-26 10:21:48,255][123091] Updated weights for policy 0, policy_version 1348935 (0.0010) [2023-12-26 10:21:48,306][123090] Updated weights for policy 1, policy_version 1339528 (0.0008) [2023-12-26 10:21:48,385][123090] Updated weights for policy 1, policy_version 1339538 (0.0009) [2023-12-26 10:21:48,456][123090] Updated weights for policy 1, policy_version 1339548 (0.0009) [2023-12-26 10:21:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 17550.3). Total num frames: 688259072. Throughput: 0: 8200.8, 1: 8307.4. Samples: 688268968. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:48,785][121949] Avg episode reward: [(0, '6233.714'), (1, '5646.632')] [2023-12-26 10:21:49,258][123091] Updated weights for policy 0, policy_version 1348945 (0.0010) [2023-12-26 10:21:49,352][123091] Updated weights for policy 0, policy_version 1348955 (0.0008) [2023-12-26 10:21:49,421][123090] Updated weights for policy 1, policy_version 1339558 (0.0009) [2023-12-26 10:21:49,442][123091] Updated weights for policy 0, policy_version 1348965 (0.0008) [2023-12-26 10:21:49,487][123090] Updated weights for policy 1, policy_version 1339568 (0.0008) [2023-12-26 10:21:49,508][123091] Updated weights for policy 0, policy_version 1348975 (0.0008) [2023-12-26 10:21:49,551][123090] Updated weights for policy 1, policy_version 1339578 (0.0009) [2023-12-26 10:21:50,317][123091] Updated weights for policy 0, policy_version 1348985 (0.0009) [2023-12-26 10:21:50,390][123091] Updated weights for policy 0, policy_version 1348995 (0.0010) [2023-12-26 10:21:50,455][123090] Updated weights for policy 1, policy_version 1339588 (0.0009) [2023-12-26 10:21:50,463][123091] Updated weights for policy 0, policy_version 1349005 (0.0010) [2023-12-26 10:21:50,526][123090] Updated weights for policy 1, policy_version 1339598 (0.0010) [2023-12-26 10:21:50,599][123090] Updated weights for policy 1, policy_version 1339608 (0.0010) [2023-12-26 10:21:51,384][123091] Updated weights for policy 0, policy_version 1349015 (0.0009) [2023-12-26 10:21:51,458][123091] Updated weights for policy 0, policy_version 1349025 (0.0009) [2023-12-26 10:21:51,525][123091] Updated weights for policy 0, policy_version 1349035 (0.0009) [2023-12-26 10:21:51,554][123090] Updated weights for policy 1, policy_version 1339618 (0.0011) [2023-12-26 10:21:51,632][123090] Updated weights for policy 1, policy_version 1339628 (0.0010) [2023-12-26 10:21:51,698][123090] Updated weights for policy 1, policy_version 1339638 (0.0010) [2023-12-26 10:21:51,775][123090] Updated weights for policy 1, policy_version 1339648 (0.0010) [2023-12-26 10:21:52,408][123091] Updated weights for policy 0, policy_version 1349045 (0.0009) [2023-12-26 10:21:52,475][123091] Updated weights for policy 0, policy_version 1349055 (0.0010) [2023-12-26 10:21:52,532][123091] Updated weights for policy 0, policy_version 1349065 (0.0010) [2023-12-26 10:21:52,626][123090] Updated weights for policy 1, policy_version 1339658 (0.0009) [2023-12-26 10:21:52,681][123090] Updated weights for policy 1, policy_version 1339668 (0.0009) [2023-12-26 10:21:52,743][123090] Updated weights for policy 1, policy_version 1339678 (0.0008) [2023-12-26 10:21:53,429][123091] Updated weights for policy 0, policy_version 1349075 (0.0010) [2023-12-26 10:21:53,490][123091] Updated weights for policy 0, policy_version 1349085 (0.0010) [2023-12-26 10:21:53,508][123090] Updated weights for policy 1, policy_version 1339688 (0.0006) [2023-12-26 10:21:53,545][123091] Updated weights for policy 0, policy_version 1349095 (0.0009) [2023-12-26 10:21:53,572][123090] Updated weights for policy 1, policy_version 1339698 (0.0006) [2023-12-26 10:21:53,635][123090] Updated weights for policy 1, policy_version 1339708 (0.0006) [2023-12-26 10:21:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 17522.5). Total num frames: 688340992. Throughput: 0: 8102.0, 1: 8192.5. Samples: 688314576. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:53,785][121949] Avg episode reward: [(0, '6224.429'), (1, '5501.833')] [2023-12-26 10:21:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001339712_342966272.pth... [2023-12-26 10:21:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001349104_345374720.pth... [2023-12-26 10:21:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001338752_342720512.pth [2023-12-26 10:21:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001348144_345128960.pth [2023-12-26 10:21:54,347][123090] Updated weights for policy 1, policy_version 1339718 (0.0007) [2023-12-26 10:21:54,386][123091] Updated weights for policy 0, policy_version 1349105 (0.0008) [2023-12-26 10:21:54,410][123090] Updated weights for policy 1, policy_version 1339728 (0.0010) [2023-12-26 10:21:54,435][123091] Updated weights for policy 0, policy_version 1349115 (0.0007) [2023-12-26 10:21:54,466][123090] Updated weights for policy 1, policy_version 1339738 (0.0010) [2023-12-26 10:21:54,490][123091] Updated weights for policy 0, policy_version 1349125 (0.0008) [2023-12-26 10:21:54,545][123091] Updated weights for policy 0, policy_version 1349135 (0.0010) [2023-12-26 10:21:55,070][123090] Updated weights for policy 1, policy_version 1339748 (0.0010) [2023-12-26 10:21:55,135][123090] Updated weights for policy 1, policy_version 1339758 (0.0006) [2023-12-26 10:21:55,200][123090] Updated weights for policy 1, policy_version 1339768 (0.0005) [2023-12-26 10:21:55,460][123091] Updated weights for policy 0, policy_version 1349145 (0.0010) [2023-12-26 10:21:55,518][123091] Updated weights for policy 0, policy_version 1349155 (0.0010) [2023-12-26 10:21:55,576][123091] Updated weights for policy 0, policy_version 1349165 (0.0009) [2023-12-26 10:21:55,836][123090] Updated weights for policy 1, policy_version 1339778 (0.0005) [2023-12-26 10:21:55,892][123090] Updated weights for policy 1, policy_version 1339788 (0.0005) [2023-12-26 10:21:55,952][123090] Updated weights for policy 1, policy_version 1339798 (0.0005) [2023-12-26 10:21:56,004][123090] Updated weights for policy 1, policy_version 1339808 (0.0005) [2023-12-26 10:21:56,515][123091] Updated weights for policy 0, policy_version 1349175 (0.0010) [2023-12-26 10:21:56,576][123091] Updated weights for policy 0, policy_version 1349185 (0.0010) [2023-12-26 10:21:56,616][123090] Updated weights for policy 1, policy_version 1339818 (0.0005) [2023-12-26 10:21:56,636][123091] Updated weights for policy 0, policy_version 1349195 (0.0009) [2023-12-26 10:21:56,676][123090] Updated weights for policy 1, policy_version 1339828 (0.0005) [2023-12-26 10:21:56,742][123090] Updated weights for policy 1, policy_version 1339838 (0.0005) [2023-12-26 10:21:57,476][123090] Updated weights for policy 1, policy_version 1339848 (0.0009) [2023-12-26 10:21:57,479][123091] Updated weights for policy 0, policy_version 1349205 (0.0008) [2023-12-26 10:21:57,539][123090] Updated weights for policy 1, policy_version 1339858 (0.0010) [2023-12-26 10:21:57,541][123091] Updated weights for policy 0, policy_version 1349215 (0.0005) [2023-12-26 10:21:57,596][123091] Updated weights for policy 0, policy_version 1349225 (0.0005) [2023-12-26 10:21:57,602][123090] Updated weights for policy 1, policy_version 1339868 (0.0010) [2023-12-26 10:21:58,405][123090] Updated weights for policy 1, policy_version 1339878 (0.0009) [2023-12-26 10:21:58,415][123091] Updated weights for policy 0, policy_version 1349235 (0.0007) [2023-12-26 10:21:58,467][123090] Updated weights for policy 1, policy_version 1339888 (0.0007) [2023-12-26 10:21:58,482][123091] Updated weights for policy 0, policy_version 1349245 (0.0008) [2023-12-26 10:21:58,535][123090] Updated weights for policy 1, policy_version 1339898 (0.0008) [2023-12-26 10:21:58,548][123091] Updated weights for policy 0, policy_version 1349255 (0.0009) [2023-12-26 10:21:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 17522.6). Total num frames: 688431104. Throughput: 0: 8137.6, 1: 8357.6. Samples: 688421204. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:21:58,785][121949] Avg episode reward: [(0, '6197.911'), (1, '5515.924')] [2023-12-26 10:21:59,348][123091] Updated weights for policy 0, policy_version 1349265 (0.0010) [2023-12-26 10:21:59,373][123090] Updated weights for policy 1, policy_version 1339908 (0.0008) [2023-12-26 10:21:59,407][123091] Updated weights for policy 0, policy_version 1349275 (0.0008) [2023-12-26 10:21:59,439][123090] Updated weights for policy 1, policy_version 1339918 (0.0006) [2023-12-26 10:21:59,465][123091] Updated weights for policy 0, policy_version 1349285 (0.0008) [2023-12-26 10:21:59,491][123090] Updated weights for policy 1, policy_version 1339928 (0.0008) [2023-12-26 10:21:59,524][123091] Updated weights for policy 0, policy_version 1349295 (0.0008) [2023-12-26 10:22:00,281][123091] Updated weights for policy 0, policy_version 1349305 (0.0008) [2023-12-26 10:22:00,323][123090] Updated weights for policy 1, policy_version 1339938 (0.0007) [2023-12-26 10:22:00,331][123091] Updated weights for policy 0, policy_version 1349315 (0.0008) [2023-12-26 10:22:00,385][123090] Updated weights for policy 1, policy_version 1339948 (0.0008) [2023-12-26 10:22:00,389][123091] Updated weights for policy 0, policy_version 1349325 (0.0008) [2023-12-26 10:22:00,448][123090] Updated weights for policy 1, policy_version 1339958 (0.0008) [2023-12-26 10:22:00,510][123090] Updated weights for policy 1, policy_version 1339968 (0.0006) [2023-12-26 10:22:01,181][123091] Updated weights for policy 0, policy_version 1349335 (0.0008) [2023-12-26 10:22:01,249][123091] Updated weights for policy 0, policy_version 1349345 (0.0006) [2023-12-26 10:22:01,297][123090] Updated weights for policy 1, policy_version 1339978 (0.0011) [2023-12-26 10:22:01,312][123091] Updated weights for policy 0, policy_version 1349355 (0.0008) [2023-12-26 10:22:01,368][123090] Updated weights for policy 1, policy_version 1339988 (0.0010) [2023-12-26 10:22:01,427][123090] Updated weights for policy 1, policy_version 1339998 (0.0010) [2023-12-26 10:22:02,133][123091] Updated weights for policy 0, policy_version 1349365 (0.0006) [2023-12-26 10:22:02,204][123091] Updated weights for policy 0, policy_version 1349375 (0.0006) [2023-12-26 10:22:02,237][123090] Updated weights for policy 1, policy_version 1340008 (0.0006) [2023-12-26 10:22:02,276][123091] Updated weights for policy 0, policy_version 1349385 (0.0006) [2023-12-26 10:22:02,309][123090] Updated weights for policy 1, policy_version 1340018 (0.0006) [2023-12-26 10:22:02,371][123090] Updated weights for policy 1, policy_version 1340028 (0.0006) [2023-12-26 10:22:03,015][123090] Updated weights for policy 1, policy_version 1340038 (0.0009) [2023-12-26 10:22:03,068][123090] Updated weights for policy 1, policy_version 1340048 (0.0009) [2023-12-26 10:22:03,071][123091] Updated weights for policy 0, policy_version 1349395 (0.0007) [2023-12-26 10:22:03,116][123090] Updated weights for policy 1, policy_version 1340058 (0.0006) [2023-12-26 10:22:03,123][123091] Updated weights for policy 0, policy_version 1349405 (0.0008) [2023-12-26 10:22:03,179][123091] Updated weights for policy 0, policy_version 1349415 (0.0007) [2023-12-26 10:22:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 16657.1, 300 sec: 17494.8). Total num frames: 688513024. Throughput: 0: 8214.6, 1: 8438.2. Samples: 688527208. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:03,784][121949] Avg episode reward: [(0, '6154.805'), (1, '5653.986')] [2023-12-26 10:22:03,874][123091] Updated weights for policy 0, policy_version 1349425 (0.0009) [2023-12-26 10:22:03,929][123091] Updated weights for policy 0, policy_version 1349435 (0.0008) [2023-12-26 10:22:03,981][123091] Updated weights for policy 0, policy_version 1349445 (0.0008) [2023-12-26 10:22:04,006][123090] Updated weights for policy 1, policy_version 1340068 (0.0008) [2023-12-26 10:22:04,031][123091] Updated weights for policy 0, policy_version 1349455 (0.0009) [2023-12-26 10:22:04,064][123090] Updated weights for policy 1, policy_version 1340078 (0.0008) [2023-12-26 10:22:04,119][123090] Updated weights for policy 1, policy_version 1340088 (0.0008) [2023-12-26 10:22:04,886][123091] Updated weights for policy 0, policy_version 1349465 (0.0010) [2023-12-26 10:22:04,940][123091] Updated weights for policy 0, policy_version 1349475 (0.0010) [2023-12-26 10:22:04,960][123090] Updated weights for policy 1, policy_version 1340098 (0.0009) [2023-12-26 10:22:05,000][123091] Updated weights for policy 0, policy_version 1349485 (0.0008) [2023-12-26 10:22:05,010][123090] Updated weights for policy 1, policy_version 1340108 (0.0010) [2023-12-26 10:22:05,059][123090] Updated weights for policy 1, policy_version 1340118 (0.0009) [2023-12-26 10:22:05,107][123090] Updated weights for policy 1, policy_version 1340128 (0.0009) [2023-12-26 10:22:05,859][123091] Updated weights for policy 0, policy_version 1349495 (0.0009) [2023-12-26 10:22:05,922][123090] Updated weights for policy 1, policy_version 1340138 (0.0006) [2023-12-26 10:22:05,926][123091] Updated weights for policy 0, policy_version 1349505 (0.0007) [2023-12-26 10:22:05,978][123090] Updated weights for policy 1, policy_version 1340148 (0.0007) [2023-12-26 10:22:05,984][123091] Updated weights for policy 0, policy_version 1349515 (0.0009) [2023-12-26 10:22:06,038][123090] Updated weights for policy 1, policy_version 1340158 (0.0008) [2023-12-26 10:22:06,816][123091] Updated weights for policy 0, policy_version 1349525 (0.0010) [2023-12-26 10:22:06,874][123090] Updated weights for policy 1, policy_version 1340168 (0.0008) [2023-12-26 10:22:06,882][123091] Updated weights for policy 0, policy_version 1349535 (0.0009) [2023-12-26 10:22:06,947][123091] Updated weights for policy 0, policy_version 1349545 (0.0008) [2023-12-26 10:22:06,948][123090] Updated weights for policy 1, policy_version 1340178 (0.0006) [2023-12-26 10:22:07,011][123090] Updated weights for policy 1, policy_version 1340188 (0.0010) [2023-12-26 10:22:07,823][123091] Updated weights for policy 0, policy_version 1349555 (0.0008) [2023-12-26 10:22:07,858][123090] Updated weights for policy 1, policy_version 1340198 (0.0009) [2023-12-26 10:22:07,882][123091] Updated weights for policy 0, policy_version 1349565 (0.0009) [2023-12-26 10:22:07,919][123090] Updated weights for policy 1, policy_version 1340208 (0.0009) [2023-12-26 10:22:07,938][123091] Updated weights for policy 0, policy_version 1349575 (0.0009) [2023-12-26 10:22:07,983][123090] Updated weights for policy 1, policy_version 1340218 (0.0006) [2023-12-26 10:22:08,757][123091] Updated weights for policy 0, policy_version 1349585 (0.0009) [2023-12-26 10:22:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 16520.5, 300 sec: 17467.0). Total num frames: 688594944. Throughput: 0: 8257.0, 1: 8494.8. Samples: 688578888. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:08,785][121949] Avg episode reward: [(0, '6258.929'), (1, '5684.833')] [2023-12-26 10:22:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001340224_343097344.pth... [2023-12-26 10:22:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001339232_342843392.pth [2023-12-26 10:22:08,818][123091] Updated weights for policy 0, policy_version 1349595 (0.0008) [2023-12-26 10:22:08,852][123090] Updated weights for policy 1, policy_version 1340228 (0.0006) [2023-12-26 10:22:08,875][123091] Updated weights for policy 0, policy_version 1349605 (0.0011) [2023-12-26 10:22:08,917][123090] Updated weights for policy 1, policy_version 1340238 (0.0006) [2023-12-26 10:22:08,932][123091] Updated weights for policy 0, policy_version 1349615 (0.0011) [2023-12-26 10:22:08,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001349616_345505792.pth... [2023-12-26 10:22:08,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001348624_345251840.pth [2023-12-26 10:22:08,982][123090] Updated weights for policy 1, policy_version 1340248 (0.0008) [2023-12-26 10:22:09,747][123091] Updated weights for policy 0, policy_version 1349625 (0.0010) [2023-12-26 10:22:09,800][123091] Updated weights for policy 0, policy_version 1349635 (0.0009) [2023-12-26 10:22:09,865][123091] Updated weights for policy 0, policy_version 1349645 (0.0008) [2023-12-26 10:22:09,873][123090] Updated weights for policy 1, policy_version 1340258 (0.0009) [2023-12-26 10:22:09,950][123090] Updated weights for policy 1, policy_version 1340268 (0.0009) [2023-12-26 10:22:10,017][123090] Updated weights for policy 1, policy_version 1340278 (0.0009) [2023-12-26 10:22:10,082][123090] Updated weights for policy 1, policy_version 1340288 (0.0009) [2023-12-26 10:22:10,677][123091] Updated weights for policy 0, policy_version 1349655 (0.0009) [2023-12-26 10:22:10,737][123091] Updated weights for policy 0, policy_version 1349665 (0.0010) [2023-12-26 10:22:10,792][123091] Updated weights for policy 0, policy_version 1349675 (0.0009) [2023-12-26 10:22:10,799][123090] Updated weights for policy 1, policy_version 1340298 (0.0006) [2023-12-26 10:22:10,853][123090] Updated weights for policy 1, policy_version 1340308 (0.0006) [2023-12-26 10:22:10,917][123090] Updated weights for policy 1, policy_version 1340318 (0.0008) [2023-12-26 10:22:11,657][123091] Updated weights for policy 0, policy_version 1349685 (0.0008) [2023-12-26 10:22:11,691][123090] Updated weights for policy 1, policy_version 1340328 (0.0009) [2023-12-26 10:22:11,708][123091] Updated weights for policy 0, policy_version 1349695 (0.0008) [2023-12-26 10:22:11,753][123090] Updated weights for policy 1, policy_version 1340338 (0.0008) [2023-12-26 10:22:11,778][123091] Updated weights for policy 0, policy_version 1349705 (0.0008) [2023-12-26 10:22:11,819][123090] Updated weights for policy 1, policy_version 1340348 (0.0008) [2023-12-26 10:22:12,634][123091] Updated weights for policy 0, policy_version 1349715 (0.0010) [2023-12-26 10:22:12,694][123091] Updated weights for policy 0, policy_version 1349725 (0.0008) [2023-12-26 10:22:12,720][123090] Updated weights for policy 1, policy_version 1340358 (0.0008) [2023-12-26 10:22:12,745][123091] Updated weights for policy 0, policy_version 1349735 (0.0009) [2023-12-26 10:22:12,784][123090] Updated weights for policy 1, policy_version 1340368 (0.0008) [2023-12-26 10:22:12,847][123090] Updated weights for policy 1, policy_version 1340378 (0.0010) [2023-12-26 10:22:13,558][123091] Updated weights for policy 0, policy_version 1349745 (0.0008) [2023-12-26 10:22:13,612][123091] Updated weights for policy 0, policy_version 1349755 (0.0005) [2023-12-26 10:22:13,657][123090] Updated weights for policy 1, policy_version 1340388 (0.0009) [2023-12-26 10:22:13,667][123091] Updated weights for policy 0, policy_version 1349765 (0.0006) [2023-12-26 10:22:13,713][123090] Updated weights for policy 1, policy_version 1340398 (0.0006) [2023-12-26 10:22:13,723][123091] Updated weights for policy 0, policy_version 1349775 (0.0007) [2023-12-26 10:22:13,774][123090] Updated weights for policy 1, policy_version 1340408 (0.0005) [2023-12-26 10:22:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16657.1, 300 sec: 17494.8). Total num frames: 688685056. Throughput: 0: 8314.7, 1: 8469.3. Samples: 688679356. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:13,785][121949] Avg episode reward: [(0, '6384.064'), (1, '5752.776')] [2023-12-26 10:22:14,463][123090] Updated weights for policy 1, policy_version 1340418 (0.0006) [2023-12-26 10:22:14,525][123090] Updated weights for policy 1, policy_version 1340428 (0.0009) [2023-12-26 10:22:14,584][123090] Updated weights for policy 1, policy_version 1340438 (0.0009) [2023-12-26 10:22:14,602][123091] Updated weights for policy 0, policy_version 1349785 (0.0010) [2023-12-26 10:22:14,644][123090] Updated weights for policy 1, policy_version 1340448 (0.0007) [2023-12-26 10:22:14,654][123091] Updated weights for policy 0, policy_version 1349795 (0.0010) [2023-12-26 10:22:14,714][123091] Updated weights for policy 0, policy_version 1349805 (0.0010) [2023-12-26 10:22:15,483][123090] Updated weights for policy 1, policy_version 1340458 (0.0009) [2023-12-26 10:22:15,540][123090] Updated weights for policy 1, policy_version 1340468 (0.0009) [2023-12-26 10:22:15,560][123091] Updated weights for policy 0, policy_version 1349815 (0.0009) [2023-12-26 10:22:15,602][123090] Updated weights for policy 1, policy_version 1340478 (0.0007) [2023-12-26 10:22:15,625][123091] Updated weights for policy 0, policy_version 1349825 (0.0006) [2023-12-26 10:22:15,693][123091] Updated weights for policy 0, policy_version 1349835 (0.0006) [2023-12-26 10:22:16,300][123090] Updated weights for policy 1, policy_version 1340488 (0.0006) [2023-12-26 10:22:16,353][123090] Updated weights for policy 1, policy_version 1340498 (0.0006) [2023-12-26 10:22:16,359][123091] Updated weights for policy 0, policy_version 1349845 (0.0005) [2023-12-26 10:22:16,408][123090] Updated weights for policy 1, policy_version 1340508 (0.0006) [2023-12-26 10:22:16,422][123091] Updated weights for policy 0, policy_version 1349855 (0.0005) [2023-12-26 10:22:16,489][123091] Updated weights for policy 0, policy_version 1349865 (0.0009) [2023-12-26 10:22:17,055][123090] Updated weights for policy 1, policy_version 1340518 (0.0006) [2023-12-26 10:22:17,114][123090] Updated weights for policy 1, policy_version 1340528 (0.0005) [2023-12-26 10:22:17,177][123090] Updated weights for policy 1, policy_version 1340538 (0.0005) [2023-12-26 10:22:17,231][123091] Updated weights for policy 0, policy_version 1349875 (0.0009) [2023-12-26 10:22:17,304][123091] Updated weights for policy 0, policy_version 1349885 (0.0007) [2023-12-26 10:22:17,374][123091] Updated weights for policy 0, policy_version 1349895 (0.0005) [2023-12-26 10:22:17,960][123090] Updated weights for policy 1, policy_version 1340548 (0.0007) [2023-12-26 10:22:17,991][123091] Updated weights for policy 0, policy_version 1349905 (0.0006) [2023-12-26 10:22:18,010][123090] Updated weights for policy 1, policy_version 1340558 (0.0009) [2023-12-26 10:22:18,059][123091] Updated weights for policy 0, policy_version 1349915 (0.0007) [2023-12-26 10:22:18,081][123090] Updated weights for policy 1, policy_version 1340568 (0.0007) [2023-12-26 10:22:18,106][123091] Updated weights for policy 0, policy_version 1349925 (0.0009) [2023-12-26 10:22:18,153][123091] Updated weights for policy 0, policy_version 1349935 (0.0009) [2023-12-26 10:22:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 16793.6, 300 sec: 17522.6). Total num frames: 688775168. Throughput: 0: 8454.9, 1: 8643.8. Samples: 688789012. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:18,785][121949] Avg episode reward: [(0, '6361.600'), (1, '5725.426')] [2023-12-26 10:22:18,852][123090] Updated weights for policy 1, policy_version 1340578 (0.0008) [2023-12-26 10:22:18,919][123090] Updated weights for policy 1, policy_version 1340588 (0.0009) [2023-12-26 10:22:18,989][123090] Updated weights for policy 1, policy_version 1340598 (0.0009) [2023-12-26 10:22:19,044][123091] Updated weights for policy 0, policy_version 1349945 (0.0007) [2023-12-26 10:22:19,055][123090] Updated weights for policy 1, policy_version 1340608 (0.0009) [2023-12-26 10:22:19,110][123091] Updated weights for policy 0, policy_version 1349955 (0.0009) [2023-12-26 10:22:19,183][123091] Updated weights for policy 0, policy_version 1349965 (0.0009) [2023-12-26 10:22:19,861][123090] Updated weights for policy 1, policy_version 1340618 (0.0007) [2023-12-26 10:22:19,926][123090] Updated weights for policy 1, policy_version 1340628 (0.0007) [2023-12-26 10:22:19,968][123091] Updated weights for policy 0, policy_version 1349975 (0.0009) [2023-12-26 10:22:19,995][123090] Updated weights for policy 1, policy_version 1340638 (0.0009) [2023-12-26 10:22:20,027][123091] Updated weights for policy 0, policy_version 1349985 (0.0009) [2023-12-26 10:22:20,095][123091] Updated weights for policy 0, policy_version 1349995 (0.0009) [2023-12-26 10:22:20,817][123090] Updated weights for policy 1, policy_version 1340648 (0.0009) [2023-12-26 10:22:20,885][123090] Updated weights for policy 1, policy_version 1340658 (0.0010) [2023-12-26 10:22:20,891][123091] Updated weights for policy 0, policy_version 1350005 (0.0008) [2023-12-26 10:22:20,956][123090] Updated weights for policy 1, policy_version 1340668 (0.0007) [2023-12-26 10:22:20,958][123091] Updated weights for policy 0, policy_version 1350015 (0.0008) [2023-12-26 10:22:21,028][123091] Updated weights for policy 0, policy_version 1350025 (0.0009) [2023-12-26 10:22:21,736][123090] Updated weights for policy 1, policy_version 1340678 (0.0007) [2023-12-26 10:22:21,801][123090] Updated weights for policy 1, policy_version 1340688 (0.0005) [2023-12-26 10:22:21,836][123091] Updated weights for policy 0, policy_version 1350035 (0.0009) [2023-12-26 10:22:21,860][123090] Updated weights for policy 1, policy_version 1340698 (0.0009) [2023-12-26 10:22:21,897][123091] Updated weights for policy 0, policy_version 1350045 (0.0010) [2023-12-26 10:22:21,965][123091] Updated weights for policy 0, policy_version 1350055 (0.0009) [2023-12-26 10:22:22,625][123090] Updated weights for policy 1, policy_version 1340708 (0.0008) [2023-12-26 10:22:22,674][123090] Updated weights for policy 1, policy_version 1340718 (0.0009) [2023-12-26 10:22:22,728][123090] Updated weights for policy 1, policy_version 1340728 (0.0009) [2023-12-26 10:22:22,769][123091] Updated weights for policy 0, policy_version 1350065 (0.0010) [2023-12-26 10:22:22,837][123091] Updated weights for policy 0, policy_version 1350075 (0.0010) [2023-12-26 10:22:22,907][123091] Updated weights for policy 0, policy_version 1350085 (0.0009) [2023-12-26 10:22:22,959][123091] Updated weights for policy 0, policy_version 1350095 (0.0010) [2023-12-26 10:22:23,617][123090] Updated weights for policy 1, policy_version 1340738 (0.0008) [2023-12-26 10:22:23,683][123090] Updated weights for policy 1, policy_version 1340748 (0.0009) [2023-12-26 10:22:23,740][123090] Updated weights for policy 1, policy_version 1340758 (0.0008) [2023-12-26 10:22:23,760][123091] Updated weights for policy 0, policy_version 1350105 (0.0008) [2023-12-26 10:22:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 17494.8). Total num frames: 688857088. Throughput: 0: 8481.6, 1: 8666.5. Samples: 688841096. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:23,785][121949] Avg episode reward: [(0, '6269.394'), (1, '5558.769')] [2023-12-26 10:22:23,804][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001340768_343236608.pth... [2023-12-26 10:22:23,804][123090] Updated weights for policy 1, policy_version 1340768 (0.0008) [2023-12-26 10:22:23,809][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001339712_342966272.pth [2023-12-26 10:22:23,820][123091] Updated weights for policy 0, policy_version 1350115 (0.0009) [2023-12-26 10:22:23,892][123091] Updated weights for policy 0, policy_version 1350125 (0.0010) [2023-12-26 10:22:23,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001350128_345636864.pth... [2023-12-26 10:22:23,911][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001349104_345374720.pth [2023-12-26 10:22:24,576][123090] Updated weights for policy 1, policy_version 1340778 (0.0010) [2023-12-26 10:22:24,636][123090] Updated weights for policy 1, policy_version 1340788 (0.0010) [2023-12-26 10:22:24,699][123090] Updated weights for policy 1, policy_version 1340798 (0.0010) [2023-12-26 10:22:24,741][123091] Updated weights for policy 0, policy_version 1350135 (0.0009) [2023-12-26 10:22:24,804][123091] Updated weights for policy 0, policy_version 1350145 (0.0009) [2023-12-26 10:22:24,872][123091] Updated weights for policy 0, policy_version 1350155 (0.0010) [2023-12-26 10:22:25,404][123090] Updated weights for policy 1, policy_version 1340808 (0.0010) [2023-12-26 10:22:25,473][123090] Updated weights for policy 1, policy_version 1340818 (0.0010) [2023-12-26 10:22:25,543][123090] Updated weights for policy 1, policy_version 1340828 (0.0010) [2023-12-26 10:22:25,755][123091] Updated weights for policy 0, policy_version 1350165 (0.0007) [2023-12-26 10:22:25,818][123091] Updated weights for policy 0, policy_version 1350175 (0.0005) [2023-12-26 10:22:25,885][123091] Updated weights for policy 0, policy_version 1350185 (0.0005) [2023-12-26 10:22:26,207][123090] Updated weights for policy 1, policy_version 1340838 (0.0005) [2023-12-26 10:22:26,280][123090] Updated weights for policy 1, policy_version 1340848 (0.0005) [2023-12-26 10:22:26,340][123090] Updated weights for policy 1, policy_version 1340858 (0.0010) [2023-12-26 10:22:26,665][123091] Updated weights for policy 0, policy_version 1350195 (0.0007) [2023-12-26 10:22:26,713][123091] Updated weights for policy 0, policy_version 1350205 (0.0009) [2023-12-26 10:22:26,769][123091] Updated weights for policy 0, policy_version 1350215 (0.0009) [2023-12-26 10:22:27,100][123090] Updated weights for policy 1, policy_version 1340868 (0.0008) [2023-12-26 10:22:27,175][123090] Updated weights for policy 1, policy_version 1340878 (0.0005) [2023-12-26 10:22:27,238][123090] Updated weights for policy 1, policy_version 1340888 (0.0005) [2023-12-26 10:22:27,479][123091] Updated weights for policy 0, policy_version 1350225 (0.0008) [2023-12-26 10:22:27,549][123091] Updated weights for policy 0, policy_version 1350235 (0.0005) [2023-12-26 10:22:27,603][123091] Updated weights for policy 0, policy_version 1350245 (0.0005) [2023-12-26 10:22:27,658][123091] Updated weights for policy 0, policy_version 1350255 (0.0005) [2023-12-26 10:22:27,860][123090] Updated weights for policy 1, policy_version 1340898 (0.0005) [2023-12-26 10:22:27,906][123090] Updated weights for policy 1, policy_version 1340908 (0.0005) [2023-12-26 10:22:27,973][123090] Updated weights for policy 1, policy_version 1340918 (0.0006) [2023-12-26 10:22:28,024][123090] Updated weights for policy 1, policy_version 1340928 (0.0005) [2023-12-26 10:22:28,274][123091] Updated weights for policy 0, policy_version 1350265 (0.0005) [2023-12-26 10:22:28,328][123091] Updated weights for policy 0, policy_version 1350275 (0.0006) [2023-12-26 10:22:28,391][123091] Updated weights for policy 0, policy_version 1350285 (0.0009) [2023-12-26 10:22:28,759][123090] Updated weights for policy 1, policy_version 1340938 (0.0009) [2023-12-26 10:22:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17066.6, 300 sec: 17522.5). Total num frames: 688955392. Throughput: 0: 8559.7, 1: 8848.0. Samples: 688949388. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:28,785][121949] Avg episode reward: [(0, '6222.249'), (1, '5270.988')] [2023-12-26 10:22:28,829][123090] Updated weights for policy 1, policy_version 1340948 (0.0006) [2023-12-26 10:22:28,895][123090] Updated weights for policy 1, policy_version 1340958 (0.0010) [2023-12-26 10:22:29,199][123091] Updated weights for policy 0, policy_version 1350295 (0.0010) [2023-12-26 10:22:29,258][123091] Updated weights for policy 0, policy_version 1350305 (0.0011) [2023-12-26 10:22:29,309][123091] Updated weights for policy 0, policy_version 1350315 (0.0010) [2023-12-26 10:22:29,678][123090] Updated weights for policy 1, policy_version 1340968 (0.0007) [2023-12-26 10:22:29,730][123090] Updated weights for policy 1, policy_version 1340978 (0.0005) [2023-12-26 10:22:29,794][123090] Updated weights for policy 1, policy_version 1340988 (0.0008) [2023-12-26 10:22:30,102][123091] Updated weights for policy 0, policy_version 1350325 (0.0008) [2023-12-26 10:22:30,163][123091] Updated weights for policy 0, policy_version 1350335 (0.0009) [2023-12-26 10:22:30,222][123091] Updated weights for policy 0, policy_version 1350345 (0.0009) [2023-12-26 10:22:30,553][123090] Updated weights for policy 1, policy_version 1340998 (0.0009) [2023-12-26 10:22:30,601][123090] Updated weights for policy 1, policy_version 1341008 (0.0008) [2023-12-26 10:22:30,661][123090] Updated weights for policy 1, policy_version 1341018 (0.0009) [2023-12-26 10:22:31,030][123091] Updated weights for policy 0, policy_version 1350355 (0.0009) [2023-12-26 10:22:31,092][123091] Updated weights for policy 0, policy_version 1350365 (0.0006) [2023-12-26 10:22:31,149][123091] Updated weights for policy 0, policy_version 1350375 (0.0007) [2023-12-26 10:22:31,514][123090] Updated weights for policy 1, policy_version 1341028 (0.0009) [2023-12-26 10:22:31,573][123090] Updated weights for policy 1, policy_version 1341038 (0.0008) [2023-12-26 10:22:31,628][123090] Updated weights for policy 1, policy_version 1341048 (0.0009) [2023-12-26 10:22:31,995][123091] Updated weights for policy 0, policy_version 1350385 (0.0008) [2023-12-26 10:22:32,043][123091] Updated weights for policy 0, policy_version 1350395 (0.0009) [2023-12-26 10:22:32,107][123091] Updated weights for policy 0, policy_version 1350405 (0.0009) [2023-12-26 10:22:32,164][123091] Updated weights for policy 0, policy_version 1350415 (0.0009) [2023-12-26 10:22:32,418][123090] Updated weights for policy 1, policy_version 1341058 (0.0009) [2023-12-26 10:22:32,491][123090] Updated weights for policy 1, policy_version 1341068 (0.0007) [2023-12-26 10:22:32,557][123090] Updated weights for policy 1, policy_version 1341078 (0.0005) [2023-12-26 10:22:32,619][123090] Updated weights for policy 1, policy_version 1341088 (0.0008) [2023-12-26 10:22:33,052][123091] Updated weights for policy 0, policy_version 1350425 (0.0009) [2023-12-26 10:22:33,101][123091] Updated weights for policy 0, policy_version 1350435 (0.0009) [2023-12-26 10:22:33,160][123091] Updated weights for policy 0, policy_version 1350445 (0.0009) [2023-12-26 10:22:33,398][123090] Updated weights for policy 1, policy_version 1341098 (0.0010) [2023-12-26 10:22:33,449][123090] Updated weights for policy 1, policy_version 1341108 (0.0010) [2023-12-26 10:22:33,499][123090] Updated weights for policy 1, policy_version 1341118 (0.0010) [2023-12-26 10:22:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17203.2, 300 sec: 17522.6). Total num frames: 689045504. Throughput: 0: 8595.2, 1: 8903.5. Samples: 689056408. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:33,784][121949] Avg episode reward: [(0, '6208.496'), (1, '5341.326')] [2023-12-26 10:22:33,988][123091] Updated weights for policy 0, policy_version 1350455 (0.0008) [2023-12-26 10:22:34,044][123091] Updated weights for policy 0, policy_version 1350465 (0.0006) [2023-12-26 10:22:34,106][123091] Updated weights for policy 0, policy_version 1350475 (0.0005) [2023-12-26 10:22:34,329][123090] Updated weights for policy 1, policy_version 1341128 (0.0009) [2023-12-26 10:22:34,397][123090] Updated weights for policy 1, policy_version 1341138 (0.0009) [2023-12-26 10:22:34,465][123090] Updated weights for policy 1, policy_version 1341148 (0.0009) [2023-12-26 10:22:34,868][123091] Updated weights for policy 0, policy_version 1350485 (0.0006) [2023-12-26 10:22:34,925][123091] Updated weights for policy 0, policy_version 1350495 (0.0006) [2023-12-26 10:22:35,001][123091] Updated weights for policy 0, policy_version 1350505 (0.0005) [2023-12-26 10:22:35,232][123090] Updated weights for policy 1, policy_version 1341158 (0.0007) [2023-12-26 10:22:35,294][123090] Updated weights for policy 1, policy_version 1341168 (0.0005) [2023-12-26 10:22:35,342][123090] Updated weights for policy 1, policy_version 1341178 (0.0006) [2023-12-26 10:22:35,646][123091] Updated weights for policy 0, policy_version 1350515 (0.0007) [2023-12-26 10:22:35,704][123091] Updated weights for policy 0, policy_version 1350525 (0.0010) [2023-12-26 10:22:35,766][123091] Updated weights for policy 0, policy_version 1350535 (0.0010) [2023-12-26 10:22:36,075][123090] Updated weights for policy 1, policy_version 1341188 (0.0008) [2023-12-26 10:22:36,144][123090] Updated weights for policy 1, policy_version 1341198 (0.0006) [2023-12-26 10:22:36,197][123090] Updated weights for policy 1, policy_version 1341208 (0.0006) [2023-12-26 10:22:36,601][123091] Updated weights for policy 0, policy_version 1350545 (0.0010) [2023-12-26 10:22:36,659][123091] Updated weights for policy 0, policy_version 1350555 (0.0010) [2023-12-26 10:22:36,709][123091] Updated weights for policy 0, policy_version 1350565 (0.0009) [2023-12-26 10:22:36,767][123091] Updated weights for policy 0, policy_version 1350575 (0.0009) [2023-12-26 10:22:36,993][123090] Updated weights for policy 1, policy_version 1341218 (0.0010) [2023-12-26 10:22:37,050][123090] Updated weights for policy 1, policy_version 1341228 (0.0009) [2023-12-26 10:22:37,107][123090] Updated weights for policy 1, policy_version 1341238 (0.0009) [2023-12-26 10:22:37,173][123090] Updated weights for policy 1, policy_version 1341248 (0.0010) [2023-12-26 10:22:37,607][123091] Updated weights for policy 0, policy_version 1350585 (0.0006) [2023-12-26 10:22:37,664][123091] Updated weights for policy 0, policy_version 1350595 (0.0005) [2023-12-26 10:22:37,716][123091] Updated weights for policy 0, policy_version 1350605 (0.0005) [2023-12-26 10:22:38,016][123090] Updated weights for policy 1, policy_version 1341258 (0.0008) [2023-12-26 10:22:38,069][123090] Updated weights for policy 1, policy_version 1341268 (0.0009) [2023-12-26 10:22:38,123][123090] Updated weights for policy 1, policy_version 1341278 (0.0008) [2023-12-26 10:22:38,541][123091] Updated weights for policy 0, policy_version 1350615 (0.0009) [2023-12-26 10:22:38,606][123091] Updated weights for policy 0, policy_version 1350625 (0.0009) [2023-12-26 10:22:38,671][123091] Updated weights for policy 0, policy_version 1350635 (0.0010) [2023-12-26 10:22:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 689135616. Throughput: 0: 8703.8, 1: 8982.3. Samples: 689110452. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:38,785][121949] Avg episode reward: [(0, '6209.279'), (1, '5470.029')] [2023-12-26 10:22:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001350640_345767936.pth... [2023-12-26 10:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001341280_343367680.pth... [2023-12-26 10:22:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001349616_345505792.pth [2023-12-26 10:22:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001340224_343097344.pth [2023-12-26 10:22:38,946][123090] Updated weights for policy 1, policy_version 1341288 (0.0010) [2023-12-26 10:22:39,007][123090] Updated weights for policy 1, policy_version 1341298 (0.0009) [2023-12-26 10:22:39,061][123090] Updated weights for policy 1, policy_version 1341308 (0.0010) [2023-12-26 10:22:39,510][123091] Updated weights for policy 0, policy_version 1350645 (0.0010) [2023-12-26 10:22:39,578][123091] Updated weights for policy 0, policy_version 1350655 (0.0009) [2023-12-26 10:22:39,642][123091] Updated weights for policy 0, policy_version 1350665 (0.0011) [2023-12-26 10:22:39,928][123090] Updated weights for policy 1, policy_version 1341318 (0.0010) [2023-12-26 10:22:39,995][123090] Updated weights for policy 1, policy_version 1341328 (0.0009) [2023-12-26 10:22:40,062][123090] Updated weights for policy 1, policy_version 1341338 (0.0009) [2023-12-26 10:22:40,494][123091] Updated weights for policy 0, policy_version 1350675 (0.0010) [2023-12-26 10:22:40,556][123091] Updated weights for policy 0, policy_version 1350685 (0.0009) [2023-12-26 10:22:40,617][123091] Updated weights for policy 0, policy_version 1350695 (0.0009) [2023-12-26 10:22:40,974][123090] Updated weights for policy 1, policy_version 1341348 (0.0010) [2023-12-26 10:22:41,039][123090] Updated weights for policy 1, policy_version 1341358 (0.0009) [2023-12-26 10:22:41,100][123090] Updated weights for policy 1, policy_version 1341368 (0.0008) [2023-12-26 10:22:41,316][123091] Updated weights for policy 0, policy_version 1350705 (0.0006) [2023-12-26 10:22:41,384][123091] Updated weights for policy 0, policy_version 1350715 (0.0007) [2023-12-26 10:22:41,451][123091] Updated weights for policy 0, policy_version 1350725 (0.0009) [2023-12-26 10:22:41,526][123091] Updated weights for policy 0, policy_version 1350735 (0.0010) [2023-12-26 10:22:41,990][123090] Updated weights for policy 1, policy_version 1341378 (0.0009) [2023-12-26 10:22:42,056][123090] Updated weights for policy 1, policy_version 1341388 (0.0009) [2023-12-26 10:22:42,118][123090] Updated weights for policy 1, policy_version 1341398 (0.0009) [2023-12-26 10:22:42,321][123091] Updated weights for policy 0, policy_version 1350745 (0.0010) [2023-12-26 10:22:42,393][123091] Updated weights for policy 0, policy_version 1350755 (0.0009) [2023-12-26 10:22:42,458][123091] Updated weights for policy 0, policy_version 1350765 (0.0009) [2023-12-26 10:22:42,928][123090] Updated weights for policy 1, policy_version 1341409 (0.0010) [2023-12-26 10:22:42,981][123090] Updated weights for policy 1, policy_version 1341419 (0.0009) [2023-12-26 10:22:43,034][123090] Updated weights for policy 1, policy_version 1341429 (0.0009) [2023-12-26 10:22:43,083][123090] Updated weights for policy 1, policy_version 1341439 (0.0011) [2023-12-26 10:22:43,167][123091] Updated weights for policy 0, policy_version 1350775 (0.0008) [2023-12-26 10:22:43,238][123091] Updated weights for policy 0, policy_version 1350785 (0.0006) [2023-12-26 10:22:43,311][123091] Updated weights for policy 0, policy_version 1350795 (0.0008) [2023-12-26 10:22:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 689217536. Throughput: 0: 8765.3, 1: 8811.9. Samples: 689212180. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:43,785][121949] Avg episode reward: [(0, '6261.320'), (1, '5526.671')] [2023-12-26 10:22:43,961][123090] Updated weights for policy 1, policy_version 1341449 (0.0010) [2023-12-26 10:22:44,024][123090] Updated weights for policy 1, policy_version 1341459 (0.0010) [2023-12-26 10:22:44,074][123091] Updated weights for policy 0, policy_version 1350805 (0.0008) [2023-12-26 10:22:44,076][123090] Updated weights for policy 1, policy_version 1341469 (0.0010) [2023-12-26 10:22:44,121][123091] Updated weights for policy 0, policy_version 1350815 (0.0007) [2023-12-26 10:22:44,191][123091] Updated weights for policy 0, policy_version 1350825 (0.0009) [2023-12-26 10:22:44,965][123090] Updated weights for policy 1, policy_version 1341479 (0.0011) [2023-12-26 10:22:44,979][123091] Updated weights for policy 0, policy_version 1350835 (0.0009) [2023-12-26 10:22:45,034][123090] Updated weights for policy 1, policy_version 1341489 (0.0011) [2023-12-26 10:22:45,044][123091] Updated weights for policy 0, policy_version 1350845 (0.0008) [2023-12-26 10:22:45,104][123090] Updated weights for policy 1, policy_version 1341499 (0.0010) [2023-12-26 10:22:45,108][123091] Updated weights for policy 0, policy_version 1350855 (0.0007) [2023-12-26 10:22:45,869][123090] Updated weights for policy 1, policy_version 1341509 (0.0008) [2023-12-26 10:22:45,924][123090] Updated weights for policy 1, policy_version 1341519 (0.0006) [2023-12-26 10:22:45,927][123091] Updated weights for policy 0, policy_version 1350865 (0.0008) [2023-12-26 10:22:45,985][123090] Updated weights for policy 1, policy_version 1341529 (0.0006) [2023-12-26 10:22:45,987][123091] Updated weights for policy 0, policy_version 1350875 (0.0011) [2023-12-26 10:22:46,045][123091] Updated weights for policy 0, policy_version 1350885 (0.0010) [2023-12-26 10:22:46,111][123091] Updated weights for policy 0, policy_version 1350895 (0.0010) [2023-12-26 10:22:46,766][123090] Updated weights for policy 1, policy_version 1341539 (0.0006) [2023-12-26 10:22:46,829][123090] Updated weights for policy 1, policy_version 1341549 (0.0008) [2023-12-26 10:22:46,837][123091] Updated weights for policy 0, policy_version 1350905 (0.0007) [2023-12-26 10:22:46,897][123090] Updated weights for policy 1, policy_version 1341559 (0.0009) [2023-12-26 10:22:46,900][123091] Updated weights for policy 0, policy_version 1350915 (0.0008) [2023-12-26 10:22:46,961][123091] Updated weights for policy 0, policy_version 1350925 (0.0009) [2023-12-26 10:22:47,568][123090] Updated weights for policy 1, policy_version 1341569 (0.0008) [2023-12-26 10:22:47,633][123090] Updated weights for policy 1, policy_version 1341579 (0.0005) [2023-12-26 10:22:47,709][123090] Updated weights for policy 1, policy_version 1341589 (0.0005) [2023-12-26 10:22:47,765][123090] Updated weights for policy 1, policy_version 1341599 (0.0005) [2023-12-26 10:22:47,778][123091] Updated weights for policy 0, policy_version 1350935 (0.0010) [2023-12-26 10:22:47,841][123091] Updated weights for policy 0, policy_version 1350945 (0.0010) [2023-12-26 10:22:47,891][123091] Updated weights for policy 0, policy_version 1350955 (0.0010) [2023-12-26 10:22:48,397][123090] Updated weights for policy 1, policy_version 1341609 (0.0010) [2023-12-26 10:22:48,456][123090] Updated weights for policy 1, policy_version 1341619 (0.0008) [2023-12-26 10:22:48,513][123090] Updated weights for policy 1, policy_version 1341629 (0.0007) [2023-12-26 10:22:48,704][123091] Updated weights for policy 0, policy_version 1350965 (0.0010) [2023-12-26 10:22:48,759][123091] Updated weights for policy 0, policy_version 1350975 (0.0011) [2023-12-26 10:22:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 689307648. Throughput: 0: 8790.1, 1: 8844.2. Samples: 689320752. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:48,785][121949] Avg episode reward: [(0, '6282.778'), (1, '5313.820')] [2023-12-26 10:22:48,825][123091] Updated weights for policy 0, policy_version 1350985 (0.0011) [2023-12-26 10:22:49,336][123090] Updated weights for policy 1, policy_version 1341639 (0.0008) [2023-12-26 10:22:49,411][123090] Updated weights for policy 1, policy_version 1341649 (0.0009) [2023-12-26 10:22:49,476][123090] Updated weights for policy 1, policy_version 1341659 (0.0009) [2023-12-26 10:22:49,620][123091] Updated weights for policy 0, policy_version 1350995 (0.0010) [2023-12-26 10:22:49,670][123091] Updated weights for policy 0, policy_version 1351005 (0.0009) [2023-12-26 10:22:49,721][123091] Updated weights for policy 0, policy_version 1351015 (0.0009) [2023-12-26 10:22:50,271][123090] Updated weights for policy 1, policy_version 1341669 (0.0009) [2023-12-26 10:22:50,334][123090] Updated weights for policy 1, policy_version 1341679 (0.0009) [2023-12-26 10:22:50,399][123090] Updated weights for policy 1, policy_version 1341689 (0.0010) [2023-12-26 10:22:50,557][123091] Updated weights for policy 0, policy_version 1351025 (0.0009) [2023-12-26 10:22:50,629][123091] Updated weights for policy 0, policy_version 1351035 (0.0008) [2023-12-26 10:22:50,691][123091] Updated weights for policy 0, policy_version 1351045 (0.0009) [2023-12-26 10:22:50,755][123091] Updated weights for policy 0, policy_version 1351055 (0.0009) [2023-12-26 10:22:51,287][123090] Updated weights for policy 1, policy_version 1341699 (0.0009) [2023-12-26 10:22:51,355][123090] Updated weights for policy 1, policy_version 1341709 (0.0009) [2023-12-26 10:22:51,425][123090] Updated weights for policy 1, policy_version 1341719 (0.0010) [2023-12-26 10:22:51,600][123091] Updated weights for policy 0, policy_version 1351065 (0.0008) [2023-12-26 10:22:51,671][123091] Updated weights for policy 0, policy_version 1351075 (0.0008) [2023-12-26 10:22:51,737][123091] Updated weights for policy 0, policy_version 1351085 (0.0008) [2023-12-26 10:22:52,321][123090] Updated weights for policy 1, policy_version 1341729 (0.0010) [2023-12-26 10:22:52,389][123090] Updated weights for policy 1, policy_version 1341739 (0.0009) [2023-12-26 10:22:52,405][123091] Updated weights for policy 0, policy_version 1351095 (0.0009) [2023-12-26 10:22:52,439][123090] Updated weights for policy 1, policy_version 1341749 (0.0009) [2023-12-26 10:22:52,463][123091] Updated weights for policy 0, policy_version 1351105 (0.0009) [2023-12-26 10:22:52,488][123090] Updated weights for policy 1, policy_version 1341759 (0.0008) [2023-12-26 10:22:52,524][123091] Updated weights for policy 0, policy_version 1351115 (0.0009) [2023-12-26 10:22:53,258][123090] Updated weights for policy 1, policy_version 1341769 (0.0006) [2023-12-26 10:22:53,267][123091] Updated weights for policy 0, policy_version 1351125 (0.0008) [2023-12-26 10:22:53,313][123091] Updated weights for policy 0, policy_version 1351135 (0.0005) [2023-12-26 10:22:53,328][123090] Updated weights for policy 1, policy_version 1341779 (0.0005) [2023-12-26 10:22:53,362][123091] Updated weights for policy 0, policy_version 1351145 (0.0005) [2023-12-26 10:22:53,392][123090] Updated weights for policy 1, policy_version 1341789 (0.0005) [2023-12-26 10:22:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17522.6). Total num frames: 689397760. Throughput: 0: 8785.1, 1: 8826.0. Samples: 689371392. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:53,785][121949] Avg episode reward: [(0, '6259.846'), (1, '5323.294')] [2023-12-26 10:22:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001351152_345899008.pth... [2023-12-26 10:22:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001341792_343498752.pth... [2023-12-26 10:22:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001340768_343236608.pth [2023-12-26 10:22:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001350128_345636864.pth [2023-12-26 10:22:54,072][123090] Updated weights for policy 1, policy_version 1341799 (0.0009) [2023-12-26 10:22:54,119][123090] Updated weights for policy 1, policy_version 1341809 (0.0010) [2023-12-26 10:22:54,173][123091] Updated weights for policy 0, policy_version 1351155 (0.0005) [2023-12-26 10:22:54,175][123090] Updated weights for policy 1, policy_version 1341819 (0.0010) [2023-12-26 10:22:54,238][123091] Updated weights for policy 0, policy_version 1351165 (0.0007) [2023-12-26 10:22:54,302][123091] Updated weights for policy 0, policy_version 1351175 (0.0009) [2023-12-26 10:22:55,017][123090] Updated weights for policy 1, policy_version 1341829 (0.0010) [2023-12-26 10:22:55,065][123090] Updated weights for policy 1, policy_version 1341839 (0.0010) [2023-12-26 10:22:55,109][123091] Updated weights for policy 0, policy_version 1351185 (0.0009) [2023-12-26 10:22:55,124][123090] Updated weights for policy 1, policy_version 1341849 (0.0010) [2023-12-26 10:22:55,171][123091] Updated weights for policy 0, policy_version 1351195 (0.0008) [2023-12-26 10:22:55,236][123091] Updated weights for policy 0, policy_version 1351205 (0.0005) [2023-12-26 10:22:55,334][123091] Updated weights for policy 0, policy_version 1351215 (0.0005) [2023-12-26 10:22:55,827][123090] Updated weights for policy 1, policy_version 1341859 (0.0009) [2023-12-26 10:22:55,900][123090] Updated weights for policy 1, policy_version 1341869 (0.0010) [2023-12-26 10:22:55,941][123091] Updated weights for policy 0, policy_version 1351225 (0.0005) [2023-12-26 10:22:55,964][123090] Updated weights for policy 1, policy_version 1341879 (0.0010) [2023-12-26 10:22:55,995][123091] Updated weights for policy 0, policy_version 1351235 (0.0005) [2023-12-26 10:22:56,041][123091] Updated weights for policy 0, policy_version 1351245 (0.0005) [2023-12-26 10:22:56,741][123091] Updated weights for policy 0, policy_version 1351255 (0.0005) [2023-12-26 10:22:56,759][123090] Updated weights for policy 1, policy_version 1341889 (0.0010) [2023-12-26 10:22:56,797][123091] Updated weights for policy 0, policy_version 1351265 (0.0005) [2023-12-26 10:22:56,814][123090] Updated weights for policy 1, policy_version 1341899 (0.0010) [2023-12-26 10:22:56,851][123091] Updated weights for policy 0, policy_version 1351275 (0.0005) [2023-12-26 10:22:56,872][123090] Updated weights for policy 1, policy_version 1341909 (0.0010) [2023-12-26 10:22:56,926][123090] Updated weights for policy 1, policy_version 1341919 (0.0010) [2023-12-26 10:22:57,598][123091] Updated weights for policy 0, policy_version 1351285 (0.0008) [2023-12-26 10:22:57,642][123091] Updated weights for policy 0, policy_version 1351295 (0.0011) [2023-12-26 10:22:57,679][123090] Updated weights for policy 1, policy_version 1341929 (0.0006) [2023-12-26 10:22:57,686][123091] Updated weights for policy 0, policy_version 1351305 (0.0010) [2023-12-26 10:22:57,737][123090] Updated weights for policy 1, policy_version 1341939 (0.0005) [2023-12-26 10:22:57,795][123090] Updated weights for policy 1, policy_version 1341949 (0.0005) [2023-12-26 10:22:58,519][123090] Updated weights for policy 1, policy_version 1341959 (0.0009) [2023-12-26 10:22:58,522][123091] Updated weights for policy 0, policy_version 1351315 (0.0007) [2023-12-26 10:22:58,587][123090] Updated weights for policy 1, policy_version 1341969 (0.0011) [2023-12-26 10:22:58,589][123091] Updated weights for policy 0, policy_version 1351325 (0.0008) [2023-12-26 10:22:58,658][123090] Updated weights for policy 1, policy_version 1341979 (0.0009) [2023-12-26 10:22:58,670][123091] Updated weights for policy 0, policy_version 1351335 (0.0008) [2023-12-26 10:22:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 689496064. Throughput: 0: 8928.7, 1: 8927.3. Samples: 689482876. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:22:58,785][121949] Avg episode reward: [(0, '6296.092'), (1, '5400.621')] [2023-12-26 10:22:59,461][123091] Updated weights for policy 0, policy_version 1351345 (0.0009) [2023-12-26 10:22:59,524][123091] Updated weights for policy 0, policy_version 1351355 (0.0006) [2023-12-26 10:22:59,591][123091] Updated weights for policy 0, policy_version 1351365 (0.0009) [2023-12-26 10:22:59,611][123090] Updated weights for policy 1, policy_version 1341989 (0.0008) [2023-12-26 10:22:59,646][123091] Updated weights for policy 0, policy_version 1351375 (0.0008) [2023-12-26 10:22:59,672][123090] Updated weights for policy 1, policy_version 1341999 (0.0009) [2023-12-26 10:22:59,733][123090] Updated weights for policy 1, policy_version 1342009 (0.0009) [2023-12-26 10:23:00,389][123091] Updated weights for policy 0, policy_version 1351385 (0.0009) [2023-12-26 10:23:00,455][123091] Updated weights for policy 0, policy_version 1351395 (0.0008) [2023-12-26 10:23:00,519][123091] Updated weights for policy 0, policy_version 1351405 (0.0006) [2023-12-26 10:23:00,624][123090] Updated weights for policy 1, policy_version 1342019 (0.0009) [2023-12-26 10:23:00,698][123090] Updated weights for policy 1, policy_version 1342029 (0.0010) [2023-12-26 10:23:00,750][123090] Updated weights for policy 1, policy_version 1342040 (0.0010) [2023-12-26 10:23:01,239][123091] Updated weights for policy 0, policy_version 1351415 (0.0006) [2023-12-26 10:23:01,304][123091] Updated weights for policy 0, policy_version 1351425 (0.0006) [2023-12-26 10:23:01,380][123091] Updated weights for policy 0, policy_version 1351435 (0.0009) [2023-12-26 10:23:01,628][123090] Updated weights for policy 1, policy_version 1342050 (0.0009) [2023-12-26 10:23:01,698][123090] Updated weights for policy 1, policy_version 1342060 (0.0009) [2023-12-26 10:23:01,765][123090] Updated weights for policy 1, policy_version 1342070 (0.0009) [2023-12-26 10:23:01,822][123090] Updated weights for policy 1, policy_version 1342080 (0.0010) [2023-12-26 10:23:02,095][123091] Updated weights for policy 0, policy_version 1351445 (0.0009) [2023-12-26 10:23:02,148][123091] Updated weights for policy 0, policy_version 1351455 (0.0005) [2023-12-26 10:23:02,212][123091] Updated weights for policy 0, policy_version 1351465 (0.0005) [2023-12-26 10:23:02,712][123090] Updated weights for policy 1, policy_version 1342090 (0.0009) [2023-12-26 10:23:02,760][123090] Updated weights for policy 1, policy_version 1342100 (0.0008) [2023-12-26 10:23:02,811][123090] Updated weights for policy 1, policy_version 1342110 (0.0009) [2023-12-26 10:23:02,901][123091] Updated weights for policy 0, policy_version 1351475 (0.0007) [2023-12-26 10:23:02,952][123091] Updated weights for policy 0, policy_version 1351485 (0.0010) [2023-12-26 10:23:03,004][123091] Updated weights for policy 0, policy_version 1351495 (0.0010) [2023-12-26 10:23:03,673][123090] Updated weights for policy 1, policy_version 1342120 (0.0009) [2023-12-26 10:23:03,736][123090] Updated weights for policy 1, policy_version 1342130 (0.0009) [2023-12-26 10:23:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 689569792. Throughput: 0: 8954.8, 1: 8796.7. Samples: 689587828. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:23:03,785][121949] Avg episode reward: [(0, '6297.478'), (1, '5576.226')] [2023-12-26 10:23:03,798][123090] Updated weights for policy 1, policy_version 1342140 (0.0009) [2023-12-26 10:23:03,831][123091] Updated weights for policy 0, policy_version 1351505 (0.0011) [2023-12-26 10:23:03,902][123091] Updated weights for policy 0, policy_version 1351515 (0.0009) [2023-12-26 10:23:03,964][123091] Updated weights for policy 0, policy_version 1351525 (0.0007) [2023-12-26 10:23:04,022][123091] Updated weights for policy 0, policy_version 1351535 (0.0006) [2023-12-26 10:23:04,624][123090] Updated weights for policy 1, policy_version 1342150 (0.0009) [2023-12-26 10:23:04,688][123090] Updated weights for policy 1, policy_version 1342160 (0.0009) [2023-12-26 10:23:04,753][123090] Updated weights for policy 1, policy_version 1342170 (0.0007) [2023-12-26 10:23:04,775][123091] Updated weights for policy 0, policy_version 1351545 (0.0010) [2023-12-26 10:23:04,838][123091] Updated weights for policy 0, policy_version 1351555 (0.0011) [2023-12-26 10:23:04,896][123091] Updated weights for policy 0, policy_version 1351565 (0.0010) [2023-12-26 10:23:05,579][123091] Updated weights for policy 0, policy_version 1351575 (0.0007) [2023-12-26 10:23:05,635][123090] Updated weights for policy 1, policy_version 1342180 (0.0008) [2023-12-26 10:23:05,637][123091] Updated weights for policy 0, policy_version 1351585 (0.0005) [2023-12-26 10:23:05,690][123090] Updated weights for policy 1, policy_version 1342190 (0.0007) [2023-12-26 10:23:05,695][123091] Updated weights for policy 0, policy_version 1351595 (0.0006) [2023-12-26 10:23:05,760][123090] Updated weights for policy 1, policy_version 1342200 (0.0009) [2023-12-26 10:23:06,354][123091] Updated weights for policy 0, policy_version 1351605 (0.0008) [2023-12-26 10:23:06,414][123091] Updated weights for policy 0, policy_version 1351615 (0.0009) [2023-12-26 10:23:06,484][123091] Updated weights for policy 0, policy_version 1351625 (0.0010) [2023-12-26 10:23:06,648][123090] Updated weights for policy 1, policy_version 1342210 (0.0009) [2023-12-26 10:23:06,719][123090] Updated weights for policy 1, policy_version 1342220 (0.0010) [2023-12-26 10:23:06,788][123090] Updated weights for policy 1, policy_version 1342230 (0.0009) [2023-12-26 10:23:06,853][123090] Updated weights for policy 1, policy_version 1342240 (0.0009) [2023-12-26 10:23:07,277][123091] Updated weights for policy 0, policy_version 1351635 (0.0008) [2023-12-26 10:23:07,333][123091] Updated weights for policy 0, policy_version 1351645 (0.0009) [2023-12-26 10:23:07,383][123091] Updated weights for policy 0, policy_version 1351655 (0.0008) [2023-12-26 10:23:07,687][123090] Updated weights for policy 1, policy_version 1342250 (0.0010) [2023-12-26 10:23:07,745][123090] Updated weights for policy 1, policy_version 1342260 (0.0009) [2023-12-26 10:23:07,808][123090] Updated weights for policy 1, policy_version 1342270 (0.0009) [2023-12-26 10:23:08,139][123091] Updated weights for policy 0, policy_version 1351665 (0.0006) [2023-12-26 10:23:08,191][123091] Updated weights for policy 0, policy_version 1351675 (0.0009) [2023-12-26 10:23:08,243][123091] Updated weights for policy 0, policy_version 1351685 (0.0009) [2023-12-26 10:23:08,300][123091] Updated weights for policy 0, policy_version 1351695 (0.0009) [2023-12-26 10:23:08,654][123090] Updated weights for policy 1, policy_version 1342280 (0.0010) [2023-12-26 10:23:08,726][123090] Updated weights for policy 1, policy_version 1342290 (0.0010) [2023-12-26 10:23:08,783][123090] Updated weights for policy 1, policy_version 1342300 (0.0010) [2023-12-26 10:23:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 689659904. Throughput: 0: 9009.0, 1: 8764.4. Samples: 689640896. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:23:08,785][121949] Avg episode reward: [(0, '6258.206'), (1, '5524.324')] [2023-12-26 10:23:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001351696_346038272.pth... [2023-12-26 10:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001350640_345767936.pth [2023-12-26 10:23:08,806][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001342304_343629824.pth... [2023-12-26 10:23:08,811][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001341280_343367680.pth [2023-12-26 10:23:09,068][123091] Updated weights for policy 0, policy_version 1351705 (0.0010) [2023-12-26 10:23:09,134][123091] Updated weights for policy 0, policy_version 1351715 (0.0009) [2023-12-26 10:23:09,195][123091] Updated weights for policy 0, policy_version 1351725 (0.0009) [2023-12-26 10:23:09,635][123090] Updated weights for policy 1, policy_version 1342310 (0.0009) [2023-12-26 10:23:09,699][123090] Updated weights for policy 1, policy_version 1342320 (0.0008) [2023-12-26 10:23:09,756][123090] Updated weights for policy 1, policy_version 1342330 (0.0009) [2023-12-26 10:23:10,044][123091] Updated weights for policy 0, policy_version 1351735 (0.0010) [2023-12-26 10:23:10,118][123091] Updated weights for policy 0, policy_version 1351745 (0.0009) [2023-12-26 10:23:10,186][123091] Updated weights for policy 0, policy_version 1351755 (0.0010) [2023-12-26 10:23:10,596][123090] Updated weights for policy 1, policy_version 1342340 (0.0009) [2023-12-26 10:23:10,660][123090] Updated weights for policy 1, policy_version 1342350 (0.0010) [2023-12-26 10:23:10,720][123090] Updated weights for policy 1, policy_version 1342360 (0.0009) [2023-12-26 10:23:11,036][123091] Updated weights for policy 0, policy_version 1351765 (0.0010) [2023-12-26 10:23:11,109][123091] Updated weights for policy 0, policy_version 1351775 (0.0010) [2023-12-26 10:23:11,186][123091] Updated weights for policy 0, policy_version 1351785 (0.0010) [2023-12-26 10:23:11,617][123090] Updated weights for policy 1, policy_version 1342370 (0.0009) [2023-12-26 10:23:11,696][123090] Updated weights for policy 1, policy_version 1342380 (0.0011) [2023-12-26 10:23:11,777][123090] Updated weights for policy 1, policy_version 1342390 (0.0009) [2023-12-26 10:23:11,848][123090] Updated weights for policy 1, policy_version 1342400 (0.0009) [2023-12-26 10:23:12,082][123091] Updated weights for policy 0, policy_version 1351795 (0.0009) [2023-12-26 10:23:12,154][123091] Updated weights for policy 0, policy_version 1351805 (0.0010) [2023-12-26 10:23:12,221][123091] Updated weights for policy 0, policy_version 1351815 (0.0010) [2023-12-26 10:23:12,618][123090] Updated weights for policy 1, policy_version 1342410 (0.0008) [2023-12-26 10:23:12,692][123090] Updated weights for policy 1, policy_version 1342420 (0.0009) [2023-12-26 10:23:12,754][123090] Updated weights for policy 1, policy_version 1342430 (0.0009) [2023-12-26 10:23:13,094][123091] Updated weights for policy 0, policy_version 1351825 (0.0010) [2023-12-26 10:23:13,161][123091] Updated weights for policy 0, policy_version 1351835 (0.0009) [2023-12-26 10:23:13,216][123091] Updated weights for policy 0, policy_version 1351845 (0.0010) [2023-12-26 10:23:13,265][123091] Updated weights for policy 0, policy_version 1351855 (0.0009) [2023-12-26 10:23:13,530][123090] Updated weights for policy 1, policy_version 1342441 (0.0010) [2023-12-26 10:23:13,582][123090] Updated weights for policy 1, policy_version 1342451 (0.0008) [2023-12-26 10:23:13,650][123090] Updated weights for policy 1, policy_version 1342461 (0.0007) [2023-12-26 10:23:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 689750016. Throughput: 0: 8976.7, 1: 8636.3. Samples: 689741972. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:23:13,785][121949] Avg episode reward: [(0, '6203.378'), (1, '5638.689')] [2023-12-26 10:23:14,138][123091] Updated weights for policy 0, policy_version 1351865 (0.0010) [2023-12-26 10:23:14,203][123091] Updated weights for policy 0, policy_version 1351875 (0.0009) [2023-12-26 10:23:14,272][123091] Updated weights for policy 0, policy_version 1351885 (0.0009) [2023-12-26 10:23:14,400][123090] Updated weights for policy 1, policy_version 1342471 (0.0007) [2023-12-26 10:23:14,453][123090] Updated weights for policy 1, policy_version 1342481 (0.0005) [2023-12-26 10:23:14,510][123090] Updated weights for policy 1, policy_version 1342491 (0.0009) [2023-12-26 10:23:15,124][123091] Updated weights for policy 0, policy_version 1351895 (0.0008) [2023-12-26 10:23:15,186][123091] Updated weights for policy 0, policy_version 1351905 (0.0010) [2023-12-26 10:23:15,249][123091] Updated weights for policy 0, policy_version 1351915 (0.0010) [2023-12-26 10:23:15,344][123090] Updated weights for policy 1, policy_version 1342501 (0.0009) [2023-12-26 10:23:15,404][123090] Updated weights for policy 1, policy_version 1342511 (0.0009) [2023-12-26 10:23:15,459][123090] Updated weights for policy 1, policy_version 1342521 (0.0009) [2023-12-26 10:23:15,992][123091] Updated weights for policy 0, policy_version 1351925 (0.0009) [2023-12-26 10:23:16,058][123091] Updated weights for policy 0, policy_version 1351935 (0.0009) [2023-12-26 10:23:16,120][123091] Updated weights for policy 0, policy_version 1351945 (0.0010) [2023-12-26 10:23:16,291][123090] Updated weights for policy 1, policy_version 1342531 (0.0009) [2023-12-26 10:23:16,346][123090] Updated weights for policy 1, policy_version 1342541 (0.0010) [2023-12-26 10:23:16,408][123090] Updated weights for policy 1, policy_version 1342551 (0.0010) [2023-12-26 10:23:16,868][123091] Updated weights for policy 0, policy_version 1351955 (0.0009) [2023-12-26 10:23:16,933][123091] Updated weights for policy 0, policy_version 1351965 (0.0006) [2023-12-26 10:23:17,002][123091] Updated weights for policy 0, policy_version 1351975 (0.0006) [2023-12-26 10:23:17,334][123090] Updated weights for policy 1, policy_version 1342561 (0.0010) [2023-12-26 10:23:17,403][123090] Updated weights for policy 1, policy_version 1342571 (0.0008) [2023-12-26 10:23:17,471][123090] Updated weights for policy 1, policy_version 1342581 (0.0005) [2023-12-26 10:23:17,544][123090] Updated weights for policy 1, policy_version 1342591 (0.0005) [2023-12-26 10:23:17,651][123091] Updated weights for policy 0, policy_version 1351985 (0.0006) [2023-12-26 10:23:17,706][123091] Updated weights for policy 0, policy_version 1351995 (0.0010) [2023-12-26 10:23:17,772][123091] Updated weights for policy 0, policy_version 1352005 (0.0010) [2023-12-26 10:23:17,833][123091] Updated weights for policy 0, policy_version 1352015 (0.0010) [2023-12-26 10:23:18,191][123090] Updated weights for policy 1, policy_version 1342601 (0.0008) [2023-12-26 10:23:18,240][123090] Updated weights for policy 1, policy_version 1342611 (0.0007) [2023-12-26 10:23:18,286][123090] Updated weights for policy 1, policy_version 1342621 (0.0005) [2023-12-26 10:23:18,762][123091] Updated weights for policy 0, policy_version 1352025 (0.0010) [2023-12-26 10:23:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 689831936. Throughput: 0: 8967.5, 1: 8620.9. Samples: 689847884. Policy #0 lag: (min: 22.0, avg: 27.0, max: 54.0) [2023-12-26 10:23:18,784][121949] Avg episode reward: [(0, '6241.265'), (1, '5518.321')] [2023-12-26 10:23:18,826][123091] Updated weights for policy 0, policy_version 1352035 (0.0009) [2023-12-26 10:23:18,893][123091] Updated weights for policy 0, policy_version 1352045 (0.0009) [2023-12-26 10:23:18,987][123090] Updated weights for policy 1, policy_version 1342631 (0.0005) [2023-12-26 10:23:19,039][123090] Updated weights for policy 1, policy_version 1342641 (0.0009) [2023-12-26 10:23:19,104][123090] Updated weights for policy 1, policy_version 1342651 (0.0011) [2023-12-26 10:23:19,753][123091] Updated weights for policy 0, policy_version 1352055 (0.0010) [2023-12-26 10:23:19,826][123091] Updated weights for policy 0, policy_version 1352065 (0.0009) [2023-12-26 10:23:19,887][123091] Updated weights for policy 0, policy_version 1352075 (0.0010) [2023-12-26 10:23:19,975][123090] Updated weights for policy 1, policy_version 1342661 (0.0008) [2023-12-26 10:23:20,044][123090] Updated weights for policy 1, policy_version 1342671 (0.0006) [2023-12-26 10:23:20,112][123090] Updated weights for policy 1, policy_version 1342681 (0.0006) [2023-12-26 10:23:20,764][123091] Updated weights for policy 0, policy_version 1352085 (0.0008) [2023-12-26 10:23:20,833][123091] Updated weights for policy 0, policy_version 1352095 (0.0007) [2023-12-26 10:23:20,851][123090] Updated weights for policy 1, policy_version 1342691 (0.0009) [2023-12-26 10:23:20,908][123091] Updated weights for policy 0, policy_version 1352105 (0.0008) [2023-12-26 10:23:20,920][123090] Updated weights for policy 1, policy_version 1342701 (0.0008) [2023-12-26 10:23:20,990][123090] Updated weights for policy 1, policy_version 1342711 (0.0007) [2023-12-26 10:23:21,735][123091] Updated weights for policy 0, policy_version 1352115 (0.0007) [2023-12-26 10:23:21,801][123091] Updated weights for policy 0, policy_version 1352125 (0.0009) [2023-12-26 10:23:21,854][123090] Updated weights for policy 1, policy_version 1342721 (0.0009) [2023-12-26 10:23:21,873][123091] Updated weights for policy 0, policy_version 1352135 (0.0008) [2023-12-26 10:23:21,920][123090] Updated weights for policy 1, policy_version 1342731 (0.0009) [2023-12-26 10:23:21,978][123090] Updated weights for policy 1, policy_version 1342741 (0.0006) [2023-12-26 10:23:22,025][123090] Updated weights for policy 1, policy_version 1342751 (0.0005) [2023-12-26 10:23:22,648][123091] Updated weights for policy 0, policy_version 1352145 (0.0007) [2023-12-26 10:23:22,711][123091] Updated weights for policy 0, policy_version 1352155 (0.0010) [2023-12-26 10:23:22,783][123091] Updated weights for policy 0, policy_version 1352165 (0.0010) [2023-12-26 10:23:22,790][123090] Updated weights for policy 1, policy_version 1342761 (0.0006) [2023-12-26 10:23:22,848][123091] Updated weights for policy 0, policy_version 1352175 (0.0010) [2023-12-26 10:23:22,851][123090] Updated weights for policy 1, policy_version 1342771 (0.0007) [2023-12-26 10:23:22,904][123090] Updated weights for policy 1, policy_version 1342781 (0.0010) [2023-12-26 10:23:23,662][123091] Updated weights for policy 0, policy_version 1352185 (0.0009) [2023-12-26 10:23:23,678][123090] Updated weights for policy 1, policy_version 1342791 (0.0009) [2023-12-26 10:23:23,708][123091] Updated weights for policy 0, policy_version 1352195 (0.0007) [2023-12-26 10:23:23,740][123090] Updated weights for policy 1, policy_version 1342801 (0.0008) [2023-12-26 10:23:23,765][123091] Updated weights for policy 0, policy_version 1352205 (0.0007) [2023-12-26 10:23:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17522.6). Total num frames: 689922048. Throughput: 0: 8908.0, 1: 8613.9. Samples: 689898936. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:23,785][121949] Avg episode reward: [(0, '6218.498'), (1, '5485.941')] [2023-12-26 10:23:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001352208_346169344.pth... [2023-12-26 10:23:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001351152_345899008.pth [2023-12-26 10:23:23,803][123090] Updated weights for policy 1, policy_version 1342811 (0.0008) [2023-12-26 10:23:23,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001342816_343760896.pth... [2023-12-26 10:23:23,827][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001341792_343498752.pth [2023-12-26 10:23:24,613][123091] Updated weights for policy 0, policy_version 1352215 (0.0009) [2023-12-26 10:23:24,624][123090] Updated weights for policy 1, policy_version 1342821 (0.0009) [2023-12-26 10:23:24,670][123091] Updated weights for policy 0, policy_version 1352225 (0.0007) [2023-12-26 10:23:24,685][123090] Updated weights for policy 1, policy_version 1342831 (0.0010) [2023-12-26 10:23:24,718][123091] Updated weights for policy 0, policy_version 1352235 (0.0007) [2023-12-26 10:23:24,738][123090] Updated weights for policy 1, policy_version 1342841 (0.0010) [2023-12-26 10:23:25,438][123090] Updated weights for policy 1, policy_version 1342851 (0.0008) [2023-12-26 10:23:25,510][123090] Updated weights for policy 1, policy_version 1342861 (0.0007) [2023-12-26 10:23:25,529][123091] Updated weights for policy 0, policy_version 1352245 (0.0008) [2023-12-26 10:23:25,577][123090] Updated weights for policy 1, policy_version 1342871 (0.0010) [2023-12-26 10:23:25,597][123091] Updated weights for policy 0, policy_version 1352255 (0.0007) [2023-12-26 10:23:25,652][123091] Updated weights for policy 0, policy_version 1352265 (0.0009) [2023-12-26 10:23:26,241][123090] Updated weights for policy 1, policy_version 1342881 (0.0006) [2023-12-26 10:23:26,296][123090] Updated weights for policy 1, policy_version 1342891 (0.0009) [2023-12-26 10:23:26,348][123090] Updated weights for policy 1, policy_version 1342901 (0.0008) [2023-12-26 10:23:26,402][123090] Updated weights for policy 1, policy_version 1342911 (0.0010) [2023-12-26 10:23:26,529][123091] Updated weights for policy 0, policy_version 1352276 (0.0011) [2023-12-26 10:23:26,586][123091] Updated weights for policy 0, policy_version 1352286 (0.0009) [2023-12-26 10:23:26,646][123091] Updated weights for policy 0, policy_version 1352296 (0.0009) [2023-12-26 10:23:27,209][123090] Updated weights for policy 1, policy_version 1342921 (0.0006) [2023-12-26 10:23:27,259][123090] Updated weights for policy 1, policy_version 1342931 (0.0005) [2023-12-26 10:23:27,330][123090] Updated weights for policy 1, policy_version 1342941 (0.0009) [2023-12-26 10:23:27,480][123091] Updated weights for policy 0, policy_version 1352306 (0.0009) [2023-12-26 10:23:27,535][123091] Updated weights for policy 0, policy_version 1352316 (0.0008) [2023-12-26 10:23:27,594][123091] Updated weights for policy 0, policy_version 1352326 (0.0009) [2023-12-26 10:23:27,651][123091] Updated weights for policy 0, policy_version 1352336 (0.0009) [2023-12-26 10:23:28,163][123090] Updated weights for policy 1, policy_version 1342951 (0.0009) [2023-12-26 10:23:28,216][123090] Updated weights for policy 1, policy_version 1342962 (0.0010) [2023-12-26 10:23:28,267][123090] Updated weights for policy 1, policy_version 1342973 (0.0009) [2023-12-26 10:23:28,353][123091] Updated weights for policy 0, policy_version 1352346 (0.0006) [2023-12-26 10:23:28,423][123091] Updated weights for policy 0, policy_version 1352356 (0.0006) [2023-12-26 10:23:28,490][123091] Updated weights for policy 0, policy_version 1352366 (0.0007) [2023-12-26 10:23:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 690012160. Throughput: 0: 8888.3, 1: 8714.3. Samples: 690004296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:28,784][121949] Avg episode reward: [(0, '6223.567'), (1, '5599.034')] [2023-12-26 10:23:29,143][123090] Updated weights for policy 1, policy_version 1342983 (0.0006) [2023-12-26 10:23:29,193][123090] Updated weights for policy 1, policy_version 1342993 (0.0005) [2023-12-26 10:23:29,225][123091] Updated weights for policy 0, policy_version 1352376 (0.0007) [2023-12-26 10:23:29,255][123090] Updated weights for policy 1, policy_version 1343003 (0.0007) [2023-12-26 10:23:29,286][123091] Updated weights for policy 0, policy_version 1352386 (0.0008) [2023-12-26 10:23:29,349][123091] Updated weights for policy 0, policy_version 1352396 (0.0009) [2023-12-26 10:23:30,064][123090] Updated weights for policy 1, policy_version 1343013 (0.0009) [2023-12-26 10:23:30,124][123090] Updated weights for policy 1, policy_version 1343023 (0.0009) [2023-12-26 10:23:30,177][123090] Updated weights for policy 1, policy_version 1343033 (0.0008) [2023-12-26 10:23:30,191][123091] Updated weights for policy 0, policy_version 1352406 (0.0009) [2023-12-26 10:23:30,261][123091] Updated weights for policy 0, policy_version 1352416 (0.0009) [2023-12-26 10:23:30,324][123091] Updated weights for policy 0, policy_version 1352426 (0.0009) [2023-12-26 10:23:30,985][123090] Updated weights for policy 1, policy_version 1343043 (0.0006) [2023-12-26 10:23:31,053][123090] Updated weights for policy 1, policy_version 1343053 (0.0010) [2023-12-26 10:23:31,125][123090] Updated weights for policy 1, policy_version 1343063 (0.0009) [2023-12-26 10:23:31,128][123091] Updated weights for policy 0, policy_version 1352436 (0.0008) [2023-12-26 10:23:31,197][123091] Updated weights for policy 0, policy_version 1352446 (0.0008) [2023-12-26 10:23:31,265][123091] Updated weights for policy 0, policy_version 1352456 (0.0009) [2023-12-26 10:23:31,921][123090] Updated weights for policy 1, policy_version 1343073 (0.0008) [2023-12-26 10:23:31,980][123090] Updated weights for policy 1, policy_version 1343083 (0.0007) [2023-12-26 10:23:32,045][123090] Updated weights for policy 1, policy_version 1343093 (0.0009) [2023-12-26 10:23:32,099][123090] Updated weights for policy 1, policy_version 1343103 (0.0010) [2023-12-26 10:23:32,110][123091] Updated weights for policy 0, policy_version 1352466 (0.0009) [2023-12-26 10:23:32,178][123091] Updated weights for policy 0, policy_version 1352476 (0.0010) [2023-12-26 10:23:32,231][123091] Updated weights for policy 0, policy_version 1352487 (0.0009) [2023-12-26 10:23:32,931][123090] Updated weights for policy 1, policy_version 1343113 (0.0010) [2023-12-26 10:23:32,987][123090] Updated weights for policy 1, policy_version 1343123 (0.0008) [2023-12-26 10:23:33,039][123090] Updated weights for policy 1, policy_version 1343133 (0.0009) [2023-12-26 10:23:33,070][123091] Updated weights for policy 0, policy_version 1352497 (0.0009) [2023-12-26 10:23:33,123][123091] Updated weights for policy 0, policy_version 1352507 (0.0009) [2023-12-26 10:23:33,177][123091] Updated weights for policy 0, policy_version 1352518 (0.0010) [2023-12-26 10:23:33,232][123091] Updated weights for policy 0, policy_version 1352528 (0.0009) [2023-12-26 10:23:33,702][123090] Updated weights for policy 1, policy_version 1343143 (0.0007) [2023-12-26 10:23:33,768][123090] Updated weights for policy 1, policy_version 1343153 (0.0005) [2023-12-26 10:23:33,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 690094080. Throughput: 0: 8835.4, 1: 8677.6. Samples: 690108844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:33,785][121949] Avg episode reward: [(0, '6250.809'), (1, '5707.429')] [2023-12-26 10:23:33,827][123090] Updated weights for policy 1, policy_version 1343163 (0.0005) [2023-12-26 10:23:34,100][123091] Updated weights for policy 0, policy_version 1352538 (0.0005) [2023-12-26 10:23:34,151][123091] Updated weights for policy 0, policy_version 1352548 (0.0006) [2023-12-26 10:23:34,205][123091] Updated weights for policy 0, policy_version 1352558 (0.0007) [2023-12-26 10:23:34,557][123090] Updated weights for policy 1, policy_version 1343173 (0.0007) [2023-12-26 10:23:34,623][123090] Updated weights for policy 1, policy_version 1343183 (0.0009) [2023-12-26 10:23:34,672][123090] Updated weights for policy 1, policy_version 1343193 (0.0009) [2023-12-26 10:23:34,993][123091] Updated weights for policy 0, policy_version 1352568 (0.0007) [2023-12-26 10:23:35,057][123091] Updated weights for policy 0, policy_version 1352578 (0.0009) [2023-12-26 10:23:35,117][123091] Updated weights for policy 0, policy_version 1352588 (0.0009) [2023-12-26 10:23:35,508][123090] Updated weights for policy 1, policy_version 1343203 (0.0008) [2023-12-26 10:23:35,559][123090] Updated weights for policy 1, policy_version 1343213 (0.0005) [2023-12-26 10:23:35,607][123090] Updated weights for policy 1, policy_version 1343223 (0.0005) [2023-12-26 10:23:35,896][123091] Updated weights for policy 0, policy_version 1352598 (0.0010) [2023-12-26 10:23:35,944][123091] Updated weights for policy 0, policy_version 1352608 (0.0010) [2023-12-26 10:23:35,992][123091] Updated weights for policy 0, policy_version 1352618 (0.0009) [2023-12-26 10:23:36,351][123090] Updated weights for policy 1, policy_version 1343233 (0.0006) [2023-12-26 10:23:36,415][123090] Updated weights for policy 1, policy_version 1343243 (0.0009) [2023-12-26 10:23:36,483][123090] Updated weights for policy 1, policy_version 1343253 (0.0010) [2023-12-26 10:23:36,544][123090] Updated weights for policy 1, policy_version 1343263 (0.0010) [2023-12-26 10:23:36,838][123091] Updated weights for policy 0, policy_version 1352628 (0.0008) [2023-12-26 10:23:36,907][123091] Updated weights for policy 0, policy_version 1352638 (0.0005) [2023-12-26 10:23:36,975][123091] Updated weights for policy 0, policy_version 1352648 (0.0005) [2023-12-26 10:23:37,436][123090] Updated weights for policy 1, policy_version 1343273 (0.0010) [2023-12-26 10:23:37,499][123090] Updated weights for policy 1, policy_version 1343283 (0.0009) [2023-12-26 10:23:37,556][123090] Updated weights for policy 1, policy_version 1343293 (0.0009) [2023-12-26 10:23:37,681][123091] Updated weights for policy 0, policy_version 1352658 (0.0006) [2023-12-26 10:23:37,743][123091] Updated weights for policy 0, policy_version 1352668 (0.0006) [2023-12-26 10:23:37,804][123091] Updated weights for policy 0, policy_version 1352678 (0.0005) [2023-12-26 10:23:37,852][123091] Updated weights for policy 0, policy_version 1352688 (0.0005) [2023-12-26 10:23:38,379][123090] Updated weights for policy 1, policy_version 1343303 (0.0009) [2023-12-26 10:23:38,430][123090] Updated weights for policy 1, policy_version 1343313 (0.0010) [2023-12-26 10:23:38,497][123090] Updated weights for policy 1, policy_version 1343323 (0.0010) [2023-12-26 10:23:38,568][123091] Updated weights for policy 0, policy_version 1352698 (0.0009) [2023-12-26 10:23:38,635][123091] Updated weights for policy 0, policy_version 1352708 (0.0010) [2023-12-26 10:23:38,704][123091] Updated weights for policy 0, policy_version 1352718 (0.0010) [2023-12-26 10:23:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 690192384. Throughput: 0: 8868.6, 1: 8721.6. Samples: 690162944. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:38,785][121949] Avg episode reward: [(0, '6221.829'), (1, '5717.107')] [2023-12-26 10:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001352720_346300416.pth... [2023-12-26 10:23:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001343328_343891968.pth... [2023-12-26 10:23:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001351696_346038272.pth [2023-12-26 10:23:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001342304_343629824.pth [2023-12-26 10:23:39,321][123090] Updated weights for policy 1, policy_version 1343333 (0.0009) [2023-12-26 10:23:39,389][123090] Updated weights for policy 1, policy_version 1343343 (0.0010) [2023-12-26 10:23:39,453][123090] Updated weights for policy 1, policy_version 1343353 (0.0009) [2023-12-26 10:23:39,558][123091] Updated weights for policy 0, policy_version 1352728 (0.0010) [2023-12-26 10:23:39,621][123091] Updated weights for policy 0, policy_version 1352738 (0.0008) [2023-12-26 10:23:39,684][123091] Updated weights for policy 0, policy_version 1352748 (0.0010) [2023-12-26 10:23:40,330][123090] Updated weights for policy 1, policy_version 1343363 (0.0009) [2023-12-26 10:23:40,391][123090] Updated weights for policy 1, policy_version 1343373 (0.0009) [2023-12-26 10:23:40,415][123091] Updated weights for policy 0, policy_version 1352758 (0.0009) [2023-12-26 10:23:40,448][123090] Updated weights for policy 1, policy_version 1343383 (0.0008) [2023-12-26 10:23:40,477][123091] Updated weights for policy 0, policy_version 1352768 (0.0007) [2023-12-26 10:23:40,541][123091] Updated weights for policy 0, policy_version 1352778 (0.0008) [2023-12-26 10:23:41,280][123090] Updated weights for policy 1, policy_version 1343393 (0.0009) [2023-12-26 10:23:41,352][123090] Updated weights for policy 1, policy_version 1343403 (0.0009) [2023-12-26 10:23:41,399][123091] Updated weights for policy 0, policy_version 1352788 (0.0008) [2023-12-26 10:23:41,418][123090] Updated weights for policy 1, policy_version 1343413 (0.0008) [2023-12-26 10:23:41,461][123091] Updated weights for policy 0, policy_version 1352798 (0.0009) [2023-12-26 10:23:41,469][123090] Updated weights for policy 1, policy_version 1343423 (0.0008) [2023-12-26 10:23:41,521][123091] Updated weights for policy 0, policy_version 1352808 (0.0009) [2023-12-26 10:23:42,356][123090] Updated weights for policy 1, policy_version 1343433 (0.0009) [2023-12-26 10:23:42,404][123091] Updated weights for policy 0, policy_version 1352818 (0.0009) [2023-12-26 10:23:42,425][123090] Updated weights for policy 1, policy_version 1343443 (0.0008) [2023-12-26 10:23:42,468][123091] Updated weights for policy 0, policy_version 1352828 (0.0010) [2023-12-26 10:23:42,495][123090] Updated weights for policy 1, policy_version 1343453 (0.0007) [2023-12-26 10:23:42,535][123091] Updated weights for policy 0, policy_version 1352838 (0.0011) [2023-12-26 10:23:42,607][123091] Updated weights for policy 0, policy_version 1352848 (0.0006) [2023-12-26 10:23:43,307][123090] Updated weights for policy 1, policy_version 1343463 (0.0008) [2023-12-26 10:23:43,332][123091] Updated weights for policy 0, policy_version 1352858 (0.0010) [2023-12-26 10:23:43,359][123090] Updated weights for policy 1, policy_version 1343473 (0.0008) [2023-12-26 10:23:43,387][123091] Updated weights for policy 0, policy_version 1352868 (0.0008) [2023-12-26 10:23:43,424][123090] Updated weights for policy 1, policy_version 1343483 (0.0007) [2023-12-26 10:23:43,445][123091] Updated weights for policy 0, policy_version 1352878 (0.0009) [2023-12-26 10:23:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 690274304. Throughput: 0: 8761.6, 1: 8618.2. Samples: 690264968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:43,785][121949] Avg episode reward: [(0, '6201.730'), (1, '5745.949')] [2023-12-26 10:23:44,215][123091] Updated weights for policy 0, policy_version 1352888 (0.0010) [2023-12-26 10:23:44,267][123091] Updated weights for policy 0, policy_version 1352898 (0.0006) [2023-12-26 10:23:44,327][123091] Updated weights for policy 0, policy_version 1352908 (0.0005) [2023-12-26 10:23:44,342][123090] Updated weights for policy 1, policy_version 1343493 (0.0009) [2023-12-26 10:23:44,404][123090] Updated weights for policy 1, policy_version 1343503 (0.0008) [2023-12-26 10:23:44,471][123090] Updated weights for policy 1, policy_version 1343513 (0.0009) [2023-12-26 10:23:45,089][123091] Updated weights for policy 0, policy_version 1352918 (0.0009) [2023-12-26 10:23:45,156][123091] Updated weights for policy 0, policy_version 1352928 (0.0011) [2023-12-26 10:23:45,221][123091] Updated weights for policy 0, policy_version 1352938 (0.0010) [2023-12-26 10:23:45,333][123090] Updated weights for policy 1, policy_version 1343523 (0.0009) [2023-12-26 10:23:45,399][123090] Updated weights for policy 1, policy_version 1343533 (0.0009) [2023-12-26 10:23:45,466][123090] Updated weights for policy 1, policy_version 1343543 (0.0010) [2023-12-26 10:23:46,014][123091] Updated weights for policy 0, policy_version 1352948 (0.0009) [2023-12-26 10:23:46,072][123091] Updated weights for policy 0, policy_version 1352958 (0.0009) [2023-12-26 10:23:46,122][123091] Updated weights for policy 0, policy_version 1352968 (0.0009) [2023-12-26 10:23:46,273][123090] Updated weights for policy 1, policy_version 1343553 (0.0009) [2023-12-26 10:23:46,337][123090] Updated weights for policy 1, policy_version 1343563 (0.0009) [2023-12-26 10:23:46,390][123090] Updated weights for policy 1, policy_version 1343573 (0.0007) [2023-12-26 10:23:46,437][123090] Updated weights for policy 1, policy_version 1343583 (0.0005) [2023-12-26 10:23:47,009][123091] Updated weights for policy 0, policy_version 1352978 (0.0009) [2023-12-26 10:23:47,074][123091] Updated weights for policy 0, policy_version 1352988 (0.0008) [2023-12-26 10:23:47,139][123091] Updated weights for policy 0, policy_version 1352998 (0.0010) [2023-12-26 10:23:47,191][123090] Updated weights for policy 1, policy_version 1343593 (0.0009) [2023-12-26 10:23:47,208][123091] Updated weights for policy 0, policy_version 1353008 (0.0008) [2023-12-26 10:23:47,243][123090] Updated weights for policy 1, policy_version 1343603 (0.0009) [2023-12-26 10:23:47,309][123090] Updated weights for policy 1, policy_version 1343613 (0.0009) [2023-12-26 10:23:47,996][123091] Updated weights for policy 0, policy_version 1353018 (0.0010) [2023-12-26 10:23:48,050][123091] Updated weights for policy 0, policy_version 1353028 (0.0009) [2023-12-26 10:23:48,099][123091] Updated weights for policy 0, policy_version 1353038 (0.0010) [2023-12-26 10:23:48,126][123090] Updated weights for policy 1, policy_version 1343623 (0.0007) [2023-12-26 10:23:48,178][123090] Updated weights for policy 1, policy_version 1343633 (0.0005) [2023-12-26 10:23:48,231][123090] Updated weights for policy 1, policy_version 1343643 (0.0005) [2023-12-26 10:23:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 690356224. Throughput: 0: 8738.7, 1: 8655.7. Samples: 690370572. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:48,785][121949] Avg episode reward: [(0, '6339.595'), (1, '5906.150')] [2023-12-26 10:23:48,830][123091] Updated weights for policy 0, policy_version 1353048 (0.0011) [2023-12-26 10:23:48,890][123091] Updated weights for policy 0, policy_version 1353058 (0.0011) [2023-12-26 10:23:48,938][123091] Updated weights for policy 0, policy_version 1353068 (0.0010) [2023-12-26 10:23:49,022][123090] Updated weights for policy 1, policy_version 1343653 (0.0005) [2023-12-26 10:23:49,074][123090] Updated weights for policy 1, policy_version 1343663 (0.0008) [2023-12-26 10:23:49,134][123090] Updated weights for policy 1, policy_version 1343673 (0.0010) [2023-12-26 10:23:49,709][123091] Updated weights for policy 0, policy_version 1353078 (0.0009) [2023-12-26 10:23:49,768][123091] Updated weights for policy 0, policy_version 1353088 (0.0008) [2023-12-26 10:23:49,823][123091] Updated weights for policy 0, policy_version 1353098 (0.0008) [2023-12-26 10:23:49,965][123090] Updated weights for policy 1, policy_version 1343683 (0.0010) [2023-12-26 10:23:50,036][123090] Updated weights for policy 1, policy_version 1343693 (0.0010) [2023-12-26 10:23:50,103][123090] Updated weights for policy 1, policy_version 1343703 (0.0010) [2023-12-26 10:23:50,660][123091] Updated weights for policy 0, policy_version 1353108 (0.0009) [2023-12-26 10:23:50,717][123091] Updated weights for policy 0, policy_version 1353118 (0.0010) [2023-12-26 10:23:50,777][123091] Updated weights for policy 0, policy_version 1353128 (0.0010) [2023-12-26 10:23:50,939][123090] Updated weights for policy 1, policy_version 1343713 (0.0011) [2023-12-26 10:23:51,007][123090] Updated weights for policy 1, policy_version 1343723 (0.0009) [2023-12-26 10:23:51,079][123090] Updated weights for policy 1, policy_version 1343733 (0.0010) [2023-12-26 10:23:51,152][123090] Updated weights for policy 1, policy_version 1343743 (0.0007) [2023-12-26 10:23:51,544][123091] Updated weights for policy 0, policy_version 1353138 (0.0009) [2023-12-26 10:23:51,609][123091] Updated weights for policy 0, policy_version 1353148 (0.0009) [2023-12-26 10:23:51,673][123091] Updated weights for policy 0, policy_version 1353158 (0.0008) [2023-12-26 10:23:51,738][123091] Updated weights for policy 0, policy_version 1353168 (0.0010) [2023-12-26 10:23:52,011][123090] Updated weights for policy 1, policy_version 1343753 (0.0005) [2023-12-26 10:23:52,082][123090] Updated weights for policy 1, policy_version 1343763 (0.0006) [2023-12-26 10:23:52,153][123090] Updated weights for policy 1, policy_version 1343773 (0.0006) [2023-12-26 10:23:52,527][123091] Updated weights for policy 0, policy_version 1353178 (0.0006) [2023-12-26 10:23:52,594][123091] Updated weights for policy 0, policy_version 1353188 (0.0005) [2023-12-26 10:23:52,660][123091] Updated weights for policy 0, policy_version 1353198 (0.0006) [2023-12-26 10:23:52,919][123090] Updated weights for policy 1, policy_version 1343783 (0.0007) [2023-12-26 10:23:52,984][123090] Updated weights for policy 1, policy_version 1343793 (0.0007) [2023-12-26 10:23:53,044][123090] Updated weights for policy 1, policy_version 1343803 (0.0006) [2023-12-26 10:23:53,449][123091] Updated weights for policy 0, policy_version 1353208 (0.0006) [2023-12-26 10:23:53,508][123091] Updated weights for policy 0, policy_version 1353218 (0.0005) [2023-12-26 10:23:53,581][123091] Updated weights for policy 0, policy_version 1353228 (0.0005) [2023-12-26 10:23:53,725][123090] Updated weights for policy 1, policy_version 1343813 (0.0009) [2023-12-26 10:23:53,777][123090] Updated weights for policy 1, policy_version 1343823 (0.0009) [2023-12-26 10:23:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 690446336. Throughput: 0: 8689.2, 1: 8666.5. Samples: 690421900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:53,785][121949] Avg episode reward: [(0, '6363.665'), (1, '5883.619')] [2023-12-26 10:23:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001353232_346431488.pth... [2023-12-26 10:23:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001352208_346169344.pth [2023-12-26 10:23:53,827][123090] Updated weights for policy 1, policy_version 1343833 (0.0009) [2023-12-26 10:23:53,867][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001343840_344023040.pth... [2023-12-26 10:23:53,871][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001342816_343760896.pth [2023-12-26 10:23:54,281][123091] Updated weights for policy 0, policy_version 1353238 (0.0007) [2023-12-26 10:23:54,337][123091] Updated weights for policy 0, policy_version 1353248 (0.0009) [2023-12-26 10:23:54,391][123091] Updated weights for policy 0, policy_version 1353258 (0.0009) [2023-12-26 10:23:54,689][123090] Updated weights for policy 1, policy_version 1343843 (0.0009) [2023-12-26 10:23:54,750][123090] Updated weights for policy 1, policy_version 1343853 (0.0009) [2023-12-26 10:23:54,817][123090] Updated weights for policy 1, policy_version 1343863 (0.0009) [2023-12-26 10:23:55,220][123091] Updated weights for policy 0, policy_version 1353268 (0.0010) [2023-12-26 10:23:55,273][123091] Updated weights for policy 0, policy_version 1353278 (0.0009) [2023-12-26 10:23:55,320][123091] Updated weights for policy 0, policy_version 1353288 (0.0009) [2023-12-26 10:23:55,619][123090] Updated weights for policy 1, policy_version 1343873 (0.0009) [2023-12-26 10:23:55,675][123090] Updated weights for policy 1, policy_version 1343883 (0.0008) [2023-12-26 10:23:55,735][123090] Updated weights for policy 1, policy_version 1343893 (0.0009) [2023-12-26 10:23:55,784][123090] Updated weights for policy 1, policy_version 1343903 (0.0009) [2023-12-26 10:23:56,155][123091] Updated weights for policy 0, policy_version 1353299 (0.0008) [2023-12-26 10:23:56,209][123091] Updated weights for policy 0, policy_version 1353309 (0.0005) [2023-12-26 10:23:56,256][123091] Updated weights for policy 0, policy_version 1353319 (0.0005) [2023-12-26 10:23:56,600][123090] Updated weights for policy 1, policy_version 1343913 (0.0006) [2023-12-26 10:23:56,655][123090] Updated weights for policy 1, policy_version 1343923 (0.0005) [2023-12-26 10:23:56,722][123090] Updated weights for policy 1, policy_version 1343933 (0.0005) [2023-12-26 10:23:57,116][123091] Updated weights for policy 0, policy_version 1353329 (0.0006) [2023-12-26 10:23:57,173][123091] Updated weights for policy 0, policy_version 1353339 (0.0010) [2023-12-26 10:23:57,238][123091] Updated weights for policy 0, policy_version 1353349 (0.0009) [2023-12-26 10:23:57,296][123091] Updated weights for policy 0, policy_version 1353359 (0.0010) [2023-12-26 10:23:57,372][123090] Updated weights for policy 1, policy_version 1343943 (0.0006) [2023-12-26 10:23:57,426][123090] Updated weights for policy 1, policy_version 1343953 (0.0008) [2023-12-26 10:23:57,491][123090] Updated weights for policy 1, policy_version 1343963 (0.0010) [2023-12-26 10:23:58,173][123090] Updated weights for policy 1, policy_version 1343973 (0.0009) [2023-12-26 10:23:58,188][123091] Updated weights for policy 0, policy_version 1353369 (0.0010) [2023-12-26 10:23:58,238][123090] Updated weights for policy 1, policy_version 1343983 (0.0008) [2023-12-26 10:23:58,251][123091] Updated weights for policy 0, policy_version 1353379 (0.0008) [2023-12-26 10:23:58,303][123090] Updated weights for policy 1, policy_version 1343993 (0.0009) [2023-12-26 10:23:58,319][123091] Updated weights for policy 0, policy_version 1353389 (0.0008) [2023-12-26 10:23:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 690536448. Throughput: 0: 8718.2, 1: 8770.7. Samples: 690528968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:23:58,785][121949] Avg episode reward: [(0, '6333.837'), (1, '5792.697')] [2023-12-26 10:23:59,186][123090] Updated weights for policy 1, policy_version 1344003 (0.0011) [2023-12-26 10:23:59,263][123090] Updated weights for policy 1, policy_version 1344013 (0.0008) [2023-12-26 10:23:59,287][123091] Updated weights for policy 0, policy_version 1353399 (0.0008) [2023-12-26 10:23:59,326][123090] Updated weights for policy 1, policy_version 1344023 (0.0006) [2023-12-26 10:23:59,365][123091] Updated weights for policy 0, policy_version 1353409 (0.0008) [2023-12-26 10:23:59,428][123091] Updated weights for policy 0, policy_version 1353419 (0.0009) [2023-12-26 10:24:00,064][123090] Updated weights for policy 1, policy_version 1344033 (0.0009) [2023-12-26 10:24:00,111][123090] Updated weights for policy 1, policy_version 1344043 (0.0008) [2023-12-26 10:24:00,166][123090] Updated weights for policy 1, policy_version 1344053 (0.0009) [2023-12-26 10:24:00,215][123090] Updated weights for policy 1, policy_version 1344063 (0.0009) [2023-12-26 10:24:00,271][123091] Updated weights for policy 0, policy_version 1353429 (0.0007) [2023-12-26 10:24:00,318][123091] Updated weights for policy 0, policy_version 1353439 (0.0005) [2023-12-26 10:24:00,383][123091] Updated weights for policy 0, policy_version 1353449 (0.0007) [2023-12-26 10:24:01,102][123090] Updated weights for policy 1, policy_version 1344073 (0.0007) [2023-12-26 10:24:01,171][123091] Updated weights for policy 0, policy_version 1353459 (0.0008) [2023-12-26 10:24:01,176][123090] Updated weights for policy 1, policy_version 1344083 (0.0007) [2023-12-26 10:24:01,219][123091] Updated weights for policy 0, policy_version 1353469 (0.0008) [2023-12-26 10:24:01,242][123090] Updated weights for policy 1, policy_version 1344093 (0.0006) [2023-12-26 10:24:01,284][123091] Updated weights for policy 0, policy_version 1353479 (0.0009) [2023-12-26 10:24:01,939][123090] Updated weights for policy 1, policy_version 1344103 (0.0006) [2023-12-26 10:24:02,002][123090] Updated weights for policy 1, policy_version 1344113 (0.0006) [2023-12-26 10:24:02,066][123090] Updated weights for policy 1, policy_version 1344123 (0.0008) [2023-12-26 10:24:02,126][123091] Updated weights for policy 0, policy_version 1353489 (0.0011) [2023-12-26 10:24:02,180][123091] Updated weights for policy 0, policy_version 1353499 (0.0010) [2023-12-26 10:24:02,231][123091] Updated weights for policy 0, policy_version 1353509 (0.0010) [2023-12-26 10:24:02,287][123091] Updated weights for policy 0, policy_version 1353519 (0.0011) [2023-12-26 10:24:02,800][123090] Updated weights for policy 1, policy_version 1344133 (0.0007) [2023-12-26 10:24:02,863][123090] Updated weights for policy 1, policy_version 1344143 (0.0010) [2023-12-26 10:24:02,925][123090] Updated weights for policy 1, policy_version 1344153 (0.0010) [2023-12-26 10:24:03,019][123091] Updated weights for policy 0, policy_version 1353529 (0.0009) [2023-12-26 10:24:03,083][123091] Updated weights for policy 0, policy_version 1353539 (0.0010) [2023-12-26 10:24:03,134][123091] Updated weights for policy 0, policy_version 1353549 (0.0008) [2023-12-26 10:24:03,701][123090] Updated weights for policy 1, policy_version 1344163 (0.0007) [2023-12-26 10:24:03,753][123090] Updated weights for policy 1, policy_version 1344173 (0.0005) [2023-12-26 10:24:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 690618368. Throughput: 0: 8677.6, 1: 8796.9. Samples: 690634236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:03,784][121949] Avg episode reward: [(0, '6337.500'), (1, '5665.995')] [2023-12-26 10:24:03,807][123090] Updated weights for policy 1, policy_version 1344183 (0.0005) [2023-12-26 10:24:03,957][123091] Updated weights for policy 0, policy_version 1353559 (0.0006) [2023-12-26 10:24:04,005][123091] Updated weights for policy 0, policy_version 1353569 (0.0006) [2023-12-26 10:24:04,054][123091] Updated weights for policy 0, policy_version 1353579 (0.0007) [2023-12-26 10:24:04,626][123090] Updated weights for policy 1, policy_version 1344193 (0.0008) [2023-12-26 10:24:04,692][123090] Updated weights for policy 1, policy_version 1344203 (0.0010) [2023-12-26 10:24:04,761][123090] Updated weights for policy 1, policy_version 1344213 (0.0010) [2023-12-26 10:24:04,832][123090] Updated weights for policy 1, policy_version 1344223 (0.0009) [2023-12-26 10:24:04,849][123091] Updated weights for policy 0, policy_version 1353589 (0.0006) [2023-12-26 10:24:04,895][123091] Updated weights for policy 0, policy_version 1353599 (0.0005) [2023-12-26 10:24:04,945][123091] Updated weights for policy 0, policy_version 1353609 (0.0006) [2023-12-26 10:24:05,591][123090] Updated weights for policy 1, policy_version 1344233 (0.0006) [2023-12-26 10:24:05,649][123090] Updated weights for policy 1, policy_version 1344243 (0.0005) [2023-12-26 10:24:05,716][123090] Updated weights for policy 1, policy_version 1344253 (0.0005) [2023-12-26 10:24:05,748][123091] Updated weights for policy 0, policy_version 1353619 (0.0007) [2023-12-26 10:24:05,815][123091] Updated weights for policy 0, policy_version 1353629 (0.0005) [2023-12-26 10:24:05,890][123091] Updated weights for policy 0, policy_version 1353639 (0.0007) [2023-12-26 10:24:06,462][123090] Updated weights for policy 1, policy_version 1344263 (0.0009) [2023-12-26 10:24:06,530][123090] Updated weights for policy 1, policy_version 1344274 (0.0010) [2023-12-26 10:24:06,589][123090] Updated weights for policy 1, policy_version 1344284 (0.0009) [2023-12-26 10:24:06,646][123091] Updated weights for policy 0, policy_version 1353649 (0.0009) [2023-12-26 10:24:06,702][123091] Updated weights for policy 0, policy_version 1353659 (0.0010) [2023-12-26 10:24:06,751][123091] Updated weights for policy 0, policy_version 1353669 (0.0009) [2023-12-26 10:24:06,801][123091] Updated weights for policy 0, policy_version 1353679 (0.0010) [2023-12-26 10:24:07,489][123090] Updated weights for policy 1, policy_version 1344294 (0.0010) [2023-12-26 10:24:07,546][123090] Updated weights for policy 1, policy_version 1344304 (0.0009) [2023-12-26 10:24:07,574][123091] Updated weights for policy 0, policy_version 1353689 (0.0009) [2023-12-26 10:24:07,598][123090] Updated weights for policy 1, policy_version 1344314 (0.0007) [2023-12-26 10:24:07,623][123091] Updated weights for policy 0, policy_version 1353699 (0.0007) [2023-12-26 10:24:07,675][123091] Updated weights for policy 0, policy_version 1353709 (0.0010) [2023-12-26 10:24:08,351][123090] Updated weights for policy 1, policy_version 1344324 (0.0006) [2023-12-26 10:24:08,421][123090] Updated weights for policy 1, policy_version 1344334 (0.0006) [2023-12-26 10:24:08,485][123090] Updated weights for policy 1, policy_version 1344344 (0.0008) [2023-12-26 10:24:08,493][123091] Updated weights for policy 0, policy_version 1353719 (0.0008) [2023-12-26 10:24:08,553][123091] Updated weights for policy 0, policy_version 1353729 (0.0009) [2023-12-26 10:24:08,610][123091] Updated weights for policy 0, policy_version 1353739 (0.0009) [2023-12-26 10:24:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 690716672. Throughput: 0: 8728.7, 1: 8810.7. Samples: 690688212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:08,785][121949] Avg episode reward: [(0, '6349.808'), (1, '5705.620')] [2023-12-26 10:24:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001353744_346562560.pth... [2023-12-26 10:24:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001344352_344154112.pth... [2023-12-26 10:24:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001352720_346300416.pth [2023-12-26 10:24:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001343328_343891968.pth [2023-12-26 10:24:09,229][123090] Updated weights for policy 1, policy_version 1344354 (0.0006) [2023-12-26 10:24:09,294][123090] Updated weights for policy 1, policy_version 1344364 (0.0006) [2023-12-26 10:24:09,372][123090] Updated weights for policy 1, policy_version 1344374 (0.0008) [2023-12-26 10:24:09,440][123090] Updated weights for policy 1, policy_version 1344384 (0.0009) [2023-12-26 10:24:09,467][123091] Updated weights for policy 0, policy_version 1353749 (0.0007) [2023-12-26 10:24:09,530][123091] Updated weights for policy 0, policy_version 1353759 (0.0006) [2023-12-26 10:24:09,600][123091] Updated weights for policy 0, policy_version 1353769 (0.0006) [2023-12-26 10:24:10,287][123091] Updated weights for policy 0, policy_version 1353779 (0.0006) [2023-12-26 10:24:10,305][123090] Updated weights for policy 1, policy_version 1344394 (0.0005) [2023-12-26 10:24:10,351][123091] Updated weights for policy 0, policy_version 1353789 (0.0008) [2023-12-26 10:24:10,365][123090] Updated weights for policy 1, policy_version 1344404 (0.0009) [2023-12-26 10:24:10,416][123090] Updated weights for policy 1, policy_version 1344414 (0.0009) [2023-12-26 10:24:10,416][123091] Updated weights for policy 0, policy_version 1353799 (0.0008) [2023-12-26 10:24:11,165][123091] Updated weights for policy 0, policy_version 1353809 (0.0009) [2023-12-26 10:24:11,208][123090] Updated weights for policy 1, policy_version 1344424 (0.0010) [2023-12-26 10:24:11,233][123091] Updated weights for policy 0, policy_version 1353819 (0.0005) [2023-12-26 10:24:11,277][123090] Updated weights for policy 1, policy_version 1344434 (0.0009) [2023-12-26 10:24:11,301][123091] Updated weights for policy 0, policy_version 1353829 (0.0009) [2023-12-26 10:24:11,341][123090] Updated weights for policy 1, policy_version 1344444 (0.0008) [2023-12-26 10:24:11,368][123091] Updated weights for policy 0, policy_version 1353839 (0.0009) [2023-12-26 10:24:12,149][123090] Updated weights for policy 1, policy_version 1344454 (0.0008) [2023-12-26 10:24:12,177][123091] Updated weights for policy 0, policy_version 1353849 (0.0007) [2023-12-26 10:24:12,216][123090] Updated weights for policy 1, policy_version 1344464 (0.0011) [2023-12-26 10:24:12,238][123091] Updated weights for policy 0, policy_version 1353859 (0.0010) [2023-12-26 10:24:12,280][123090] Updated weights for policy 1, policy_version 1344474 (0.0011) [2023-12-26 10:24:12,309][123091] Updated weights for policy 0, policy_version 1353869 (0.0007) [2023-12-26 10:24:13,031][123090] Updated weights for policy 1, policy_version 1344484 (0.0009) [2023-12-26 10:24:13,096][123090] Updated weights for policy 1, policy_version 1344494 (0.0010) [2023-12-26 10:24:13,157][123090] Updated weights for policy 1, policy_version 1344504 (0.0010) [2023-12-26 10:24:13,161][123091] Updated weights for policy 0, policy_version 1353879 (0.0009) [2023-12-26 10:24:13,225][123091] Updated weights for policy 0, policy_version 1353889 (0.0010) [2023-12-26 10:24:13,285][123091] Updated weights for policy 0, policy_version 1353899 (0.0009) [2023-12-26 10:24:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 690798592. Throughput: 0: 8789.5, 1: 8759.1. Samples: 690793984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:13,784][121949] Avg episode reward: [(0, '6404.567'), (1, '5791.411')] [2023-12-26 10:24:13,934][123090] Updated weights for policy 1, policy_version 1344514 (0.0010) [2023-12-26 10:24:13,986][123090] Updated weights for policy 1, policy_version 1344524 (0.0010) [2023-12-26 10:24:14,034][123090] Updated weights for policy 1, policy_version 1344534 (0.0010) [2023-12-26 10:24:14,095][123090] Updated weights for policy 1, policy_version 1344544 (0.0011) [2023-12-26 10:24:14,125][123091] Updated weights for policy 0, policy_version 1353909 (0.0009) [2023-12-26 10:24:14,176][123091] Updated weights for policy 0, policy_version 1353919 (0.0008) [2023-12-26 10:24:14,243][123091] Updated weights for policy 0, policy_version 1353929 (0.0009) [2023-12-26 10:24:14,877][123090] Updated weights for policy 1, policy_version 1344554 (0.0010) [2023-12-26 10:24:14,937][123090] Updated weights for policy 1, policy_version 1344564 (0.0011) [2023-12-26 10:24:14,994][123090] Updated weights for policy 1, policy_version 1344574 (0.0011) [2023-12-26 10:24:15,119][123091] Updated weights for policy 0, policy_version 1353939 (0.0009) [2023-12-26 10:24:15,190][123091] Updated weights for policy 0, policy_version 1353949 (0.0009) [2023-12-26 10:24:15,248][123091] Updated weights for policy 0, policy_version 1353959 (0.0009) [2023-12-26 10:24:15,836][123090] Updated weights for policy 1, policy_version 1344584 (0.0011) [2023-12-26 10:24:15,899][123090] Updated weights for policy 1, policy_version 1344594 (0.0011) [2023-12-26 10:24:15,966][123090] Updated weights for policy 1, policy_version 1344604 (0.0010) [2023-12-26 10:24:16,101][123091] Updated weights for policy 0, policy_version 1353969 (0.0009) [2023-12-26 10:24:16,164][123091] Updated weights for policy 0, policy_version 1353979 (0.0009) [2023-12-26 10:24:16,223][123091] Updated weights for policy 0, policy_version 1353989 (0.0008) [2023-12-26 10:24:16,289][123091] Updated weights for policy 0, policy_version 1353999 (0.0008) [2023-12-26 10:24:16,713][123090] Updated weights for policy 1, policy_version 1344614 (0.0008) [2023-12-26 10:24:16,779][123090] Updated weights for policy 1, policy_version 1344624 (0.0005) [2023-12-26 10:24:16,844][123090] Updated weights for policy 1, policy_version 1344634 (0.0005) [2023-12-26 10:24:17,061][123091] Updated weights for policy 0, policy_version 1354009 (0.0006) [2023-12-26 10:24:17,120][123091] Updated weights for policy 0, policy_version 1354019 (0.0005) [2023-12-26 10:24:17,182][123091] Updated weights for policy 0, policy_version 1354029 (0.0006) [2023-12-26 10:24:17,552][123090] Updated weights for policy 1, policy_version 1344644 (0.0008) [2023-12-26 10:24:17,600][123090] Updated weights for policy 1, policy_version 1344654 (0.0009) [2023-12-26 10:24:17,661][123090] Updated weights for policy 1, policy_version 1344664 (0.0005) [2023-12-26 10:24:17,916][123091] Updated weights for policy 0, policy_version 1354039 (0.0007) [2023-12-26 10:24:17,982][123091] Updated weights for policy 0, policy_version 1354049 (0.0008) [2023-12-26 10:24:18,032][123091] Updated weights for policy 0, policy_version 1354059 (0.0008) [2023-12-26 10:24:18,455][123090] Updated weights for policy 1, policy_version 1344674 (0.0006) [2023-12-26 10:24:18,512][123090] Updated weights for policy 1, policy_version 1344684 (0.0009) [2023-12-26 10:24:18,567][123090] Updated weights for policy 1, policy_version 1344694 (0.0009) [2023-12-26 10:24:18,629][123090] Updated weights for policy 1, policy_version 1344704 (0.0009) [2023-12-26 10:24:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 690888704. Throughput: 0: 8787.6, 1: 8778.9. Samples: 690899332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:18,785][121949] Avg episode reward: [(0, '6371.748'), (1, '5775.494')] [2023-12-26 10:24:18,856][123091] Updated weights for policy 0, policy_version 1354069 (0.0009) [2023-12-26 10:24:18,905][123091] Updated weights for policy 0, policy_version 1354079 (0.0009) [2023-12-26 10:24:18,957][123091] Updated weights for policy 0, policy_version 1354089 (0.0010) [2023-12-26 10:24:19,455][123090] Updated weights for policy 1, policy_version 1344714 (0.0009) [2023-12-26 10:24:19,515][123090] Updated weights for policy 1, policy_version 1344724 (0.0010) [2023-12-26 10:24:19,579][123090] Updated weights for policy 1, policy_version 1344734 (0.0008) [2023-12-26 10:24:19,885][123091] Updated weights for policy 0, policy_version 1354100 (0.0010) [2023-12-26 10:24:19,960][123091] Updated weights for policy 0, policy_version 1354110 (0.0010) [2023-12-26 10:24:20,025][123091] Updated weights for policy 0, policy_version 1354120 (0.0010) [2023-12-26 10:24:20,467][123090] Updated weights for policy 1, policy_version 1344744 (0.0007) [2023-12-26 10:24:20,541][123090] Updated weights for policy 1, policy_version 1344754 (0.0006) [2023-12-26 10:24:20,614][123090] Updated weights for policy 1, policy_version 1344764 (0.0008) [2023-12-26 10:24:20,740][123091] Updated weights for policy 0, policy_version 1354130 (0.0011) [2023-12-26 10:24:20,812][123091] Updated weights for policy 0, policy_version 1354140 (0.0011) [2023-12-26 10:24:20,880][123091] Updated weights for policy 0, policy_version 1354150 (0.0011) [2023-12-26 10:24:20,944][123091] Updated weights for policy 0, policy_version 1354160 (0.0011) [2023-12-26 10:24:21,400][123090] Updated weights for policy 1, policy_version 1344774 (0.0007) [2023-12-26 10:24:21,472][123090] Updated weights for policy 1, policy_version 1344784 (0.0009) [2023-12-26 10:24:21,538][123090] Updated weights for policy 1, policy_version 1344794 (0.0009) [2023-12-26 10:24:21,751][123091] Updated weights for policy 0, policy_version 1354170 (0.0008) [2023-12-26 10:24:21,815][123091] Updated weights for policy 0, policy_version 1354180 (0.0008) [2023-12-26 10:24:21,880][123091] Updated weights for policy 0, policy_version 1354190 (0.0010) [2023-12-26 10:24:22,409][123090] Updated weights for policy 1, policy_version 1344804 (0.0009) [2023-12-26 10:24:22,468][123090] Updated weights for policy 1, policy_version 1344814 (0.0009) [2023-12-26 10:24:22,534][123090] Updated weights for policy 1, policy_version 1344824 (0.0006) [2023-12-26 10:24:22,721][123091] Updated weights for policy 0, policy_version 1354200 (0.0010) [2023-12-26 10:24:22,795][123091] Updated weights for policy 0, policy_version 1354210 (0.0010) [2023-12-26 10:24:22,866][123091] Updated weights for policy 0, policy_version 1354220 (0.0010) [2023-12-26 10:24:23,277][123090] Updated weights for policy 1, policy_version 1344834 (0.0006) [2023-12-26 10:24:23,328][123090] Updated weights for policy 1, policy_version 1344844 (0.0006) [2023-12-26 10:24:23,388][123090] Updated weights for policy 1, policy_version 1344854 (0.0006) [2023-12-26 10:24:23,450][123090] Updated weights for policy 1, policy_version 1344864 (0.0005) [2023-12-26 10:24:23,684][123091] Updated weights for policy 0, policy_version 1354230 (0.0009) [2023-12-26 10:24:23,739][123091] Updated weights for policy 0, policy_version 1354240 (0.0009) [2023-12-26 10:24:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 690970624. Throughput: 0: 8760.4, 1: 8739.3. Samples: 690950428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:23,785][121949] Avg episode reward: [(0, '6379.370'), (1, '5879.901')] [2023-12-26 10:24:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001344864_344285184.pth... [2023-12-26 10:24:23,793][123091] Updated weights for policy 0, policy_version 1354250 (0.0009) [2023-12-26 10:24:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001343840_344023040.pth [2023-12-26 10:24:23,817][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001354256_346693632.pth... [2023-12-26 10:24:23,820][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001353232_346431488.pth [2023-12-26 10:24:24,124][123090] Updated weights for policy 1, policy_version 1344874 (0.0005) [2023-12-26 10:24:24,186][123090] Updated weights for policy 1, policy_version 1344884 (0.0009) [2023-12-26 10:24:24,246][123090] Updated weights for policy 1, policy_version 1344894 (0.0010) [2023-12-26 10:24:24,663][123091] Updated weights for policy 0, policy_version 1354261 (0.0010) [2023-12-26 10:24:24,722][123091] Updated weights for policy 0, policy_version 1354271 (0.0010) [2023-12-26 10:24:24,790][123091] Updated weights for policy 0, policy_version 1354281 (0.0011) [2023-12-26 10:24:24,990][123090] Updated weights for policy 1, policy_version 1344904 (0.0006) [2023-12-26 10:24:25,047][123090] Updated weights for policy 1, policy_version 1344914 (0.0005) [2023-12-26 10:24:25,100][123090] Updated weights for policy 1, policy_version 1344924 (0.0005) [2023-12-26 10:24:25,599][123091] Updated weights for policy 0, policy_version 1354291 (0.0009) [2023-12-26 10:24:25,654][123091] Updated weights for policy 0, policy_version 1354301 (0.0005) [2023-12-26 10:24:25,712][123091] Updated weights for policy 0, policy_version 1354311 (0.0006) [2023-12-26 10:24:25,869][123090] Updated weights for policy 1, policy_version 1344934 (0.0008) [2023-12-26 10:24:25,931][123090] Updated weights for policy 1, policy_version 1344944 (0.0010) [2023-12-26 10:24:25,987][123090] Updated weights for policy 1, policy_version 1344954 (0.0010) [2023-12-26 10:24:26,435][123091] Updated weights for policy 0, policy_version 1354321 (0.0007) [2023-12-26 10:24:26,486][123091] Updated weights for policy 0, policy_version 1354331 (0.0010) [2023-12-26 10:24:26,544][123091] Updated weights for policy 0, policy_version 1354341 (0.0010) [2023-12-26 10:24:26,618][123091] Updated weights for policy 0, policy_version 1354351 (0.0011) [2023-12-26 10:24:26,643][123090] Updated weights for policy 1, policy_version 1344964 (0.0008) [2023-12-26 10:24:26,698][123090] Updated weights for policy 1, policy_version 1344974 (0.0005) [2023-12-26 10:24:26,756][123090] Updated weights for policy 1, policy_version 1344984 (0.0005) [2023-12-26 10:24:27,338][123091] Updated weights for policy 0, policy_version 1354361 (0.0007) [2023-12-26 10:24:27,401][123091] Updated weights for policy 0, policy_version 1354371 (0.0005) [2023-12-26 10:24:27,446][123091] Updated weights for policy 0, policy_version 1354381 (0.0005) [2023-12-26 10:24:27,509][123090] Updated weights for policy 1, policy_version 1344994 (0.0005) [2023-12-26 10:24:27,558][123090] Updated weights for policy 1, policy_version 1345004 (0.0005) [2023-12-26 10:24:27,612][123090] Updated weights for policy 1, policy_version 1345014 (0.0005) [2023-12-26 10:24:27,666][123090] Updated weights for policy 1, policy_version 1345024 (0.0005) [2023-12-26 10:24:28,171][123091] Updated weights for policy 0, policy_version 1354391 (0.0008) [2023-12-26 10:24:28,235][123091] Updated weights for policy 0, policy_version 1354401 (0.0008) [2023-12-26 10:24:28,293][123091] Updated weights for policy 0, policy_version 1354411 (0.0006) [2023-12-26 10:24:28,484][123090] Updated weights for policy 1, policy_version 1345034 (0.0011) [2023-12-26 10:24:28,554][123090] Updated weights for policy 1, policy_version 1345044 (0.0011) [2023-12-26 10:24:28,621][123090] Updated weights for policy 1, policy_version 1345054 (0.0010) [2023-12-26 10:24:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 691068928. Throughput: 0: 8775.2, 1: 8891.6. Samples: 691059976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:28,785][121949] Avg episode reward: [(0, '6340.500'), (1, '5846.105')] [2023-12-26 10:24:29,038][123091] Updated weights for policy 0, policy_version 1354421 (0.0009) [2023-12-26 10:24:29,094][123091] Updated weights for policy 0, policy_version 1354431 (0.0009) [2023-12-26 10:24:29,151][123091] Updated weights for policy 0, policy_version 1354441 (0.0008) [2023-12-26 10:24:29,438][123090] Updated weights for policy 1, policy_version 1345064 (0.0007) [2023-12-26 10:24:29,503][123090] Updated weights for policy 1, policy_version 1345074 (0.0005) [2023-12-26 10:24:29,574][123090] Updated weights for policy 1, policy_version 1345084 (0.0006) [2023-12-26 10:24:30,008][123091] Updated weights for policy 0, policy_version 1354451 (0.0009) [2023-12-26 10:24:30,082][123091] Updated weights for policy 0, policy_version 1354461 (0.0009) [2023-12-26 10:24:30,143][123091] Updated weights for policy 0, policy_version 1354471 (0.0008) [2023-12-26 10:24:30,293][123090] Updated weights for policy 1, policy_version 1345094 (0.0009) [2023-12-26 10:24:30,363][123090] Updated weights for policy 1, policy_version 1345104 (0.0011) [2023-12-26 10:24:30,426][123090] Updated weights for policy 1, policy_version 1345114 (0.0010) [2023-12-26 10:24:30,944][123091] Updated weights for policy 0, policy_version 1354481 (0.0009) [2023-12-26 10:24:31,003][123091] Updated weights for policy 0, policy_version 1354491 (0.0007) [2023-12-26 10:24:31,063][123091] Updated weights for policy 0, policy_version 1354501 (0.0010) [2023-12-26 10:24:31,110][123090] Updated weights for policy 1, policy_version 1345124 (0.0009) [2023-12-26 10:24:31,123][123091] Updated weights for policy 0, policy_version 1354511 (0.0009) [2023-12-26 10:24:31,185][123090] Updated weights for policy 1, policy_version 1345134 (0.0009) [2023-12-26 10:24:31,247][123090] Updated weights for policy 1, policy_version 1345144 (0.0009) [2023-12-26 10:24:32,002][123090] Updated weights for policy 1, policy_version 1345154 (0.0009) [2023-12-26 10:24:32,032][123091] Updated weights for policy 0, policy_version 1354521 (0.0009) [2023-12-26 10:24:32,060][123090] Updated weights for policy 1, policy_version 1345164 (0.0005) [2023-12-26 10:24:32,087][123091] Updated weights for policy 0, policy_version 1354531 (0.0009) [2023-12-26 10:24:32,113][123090] Updated weights for policy 1, policy_version 1345174 (0.0006) [2023-12-26 10:24:32,146][123091] Updated weights for policy 0, policy_version 1354541 (0.0009) [2023-12-26 10:24:32,174][123090] Updated weights for policy 1, policy_version 1345184 (0.0008) [2023-12-26 10:24:32,938][123091] Updated weights for policy 0, policy_version 1354551 (0.0006) [2023-12-26 10:24:32,997][123091] Updated weights for policy 0, policy_version 1354561 (0.0006) [2023-12-26 10:24:33,031][123090] Updated weights for policy 1, policy_version 1345194 (0.0009) [2023-12-26 10:24:33,055][123091] Updated weights for policy 0, policy_version 1354571 (0.0005) [2023-12-26 10:24:33,082][123090] Updated weights for policy 1, policy_version 1345204 (0.0010) [2023-12-26 10:24:33,135][123090] Updated weights for policy 1, policy_version 1345214 (0.0010) [2023-12-26 10:24:33,729][123091] Updated weights for policy 0, policy_version 1354581 (0.0005) [2023-12-26 10:24:33,774][123091] Updated weights for policy 0, policy_version 1354591 (0.0005) [2023-12-26 10:24:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 691150848. Throughput: 0: 8763.1, 1: 8934.5. Samples: 691166964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:33,785][121949] Avg episode reward: [(0, '6305.399'), (1, '5651.046')] [2023-12-26 10:24:33,819][123091] Updated weights for policy 0, policy_version 1354601 (0.0005) [2023-12-26 10:24:33,926][123090] Updated weights for policy 1, policy_version 1345224 (0.0006) [2023-12-26 10:24:33,992][123090] Updated weights for policy 1, policy_version 1345234 (0.0005) [2023-12-26 10:24:34,036][123090] Updated weights for policy 1, policy_version 1345244 (0.0005) [2023-12-26 10:24:34,587][123091] Updated weights for policy 0, policy_version 1354611 (0.0007) [2023-12-26 10:24:34,652][123091] Updated weights for policy 0, policy_version 1354621 (0.0009) [2023-12-26 10:24:34,716][123091] Updated weights for policy 0, policy_version 1354631 (0.0011) [2023-12-26 10:24:34,750][123090] Updated weights for policy 1, policy_version 1345254 (0.0010) [2023-12-26 10:24:34,798][123090] Updated weights for policy 1, policy_version 1345264 (0.0010) [2023-12-26 10:24:34,842][123090] Updated weights for policy 1, policy_version 1345274 (0.0010) [2023-12-26 10:24:35,504][123091] Updated weights for policy 0, policy_version 1354641 (0.0006) [2023-12-26 10:24:35,552][123091] Updated weights for policy 0, policy_version 1354651 (0.0010) [2023-12-26 10:24:35,603][123091] Updated weights for policy 0, policy_version 1354661 (0.0010) [2023-12-26 10:24:35,655][123091] Updated weights for policy 0, policy_version 1354671 (0.0009) [2023-12-26 10:24:35,725][123090] Updated weights for policy 1, policy_version 1345284 (0.0010) [2023-12-26 10:24:35,772][123090] Updated weights for policy 1, policy_version 1345294 (0.0010) [2023-12-26 10:24:35,823][123090] Updated weights for policy 1, policy_version 1345304 (0.0010) [2023-12-26 10:24:36,457][123091] Updated weights for policy 0, policy_version 1354681 (0.0009) [2023-12-26 10:24:36,531][123091] Updated weights for policy 0, policy_version 1354691 (0.0009) [2023-12-26 10:24:36,605][123091] Updated weights for policy 0, policy_version 1354701 (0.0009) [2023-12-26 10:24:36,683][123090] Updated weights for policy 1, policy_version 1345314 (0.0010) [2023-12-26 10:24:36,740][123090] Updated weights for policy 1, policy_version 1345324 (0.0011) [2023-12-26 10:24:36,792][123090] Updated weights for policy 1, policy_version 1345334 (0.0011) [2023-12-26 10:24:36,853][123090] Updated weights for policy 1, policy_version 1345344 (0.0011) [2023-12-26 10:24:37,427][123091] Updated weights for policy 0, policy_version 1354711 (0.0009) [2023-12-26 10:24:37,475][123091] Updated weights for policy 0, policy_version 1354721 (0.0009) [2023-12-26 10:24:37,523][123091] Updated weights for policy 0, policy_version 1354731 (0.0009) [2023-12-26 10:24:37,695][123090] Updated weights for policy 1, policy_version 1345354 (0.0010) [2023-12-26 10:24:37,758][123090] Updated weights for policy 1, policy_version 1345364 (0.0010) [2023-12-26 10:24:37,806][123090] Updated weights for policy 1, policy_version 1345374 (0.0010) [2023-12-26 10:24:38,387][123091] Updated weights for policy 0, policy_version 1354741 (0.0009) [2023-12-26 10:24:38,451][123091] Updated weights for policy 0, policy_version 1354751 (0.0009) [2023-12-26 10:24:38,511][123091] Updated weights for policy 0, policy_version 1354761 (0.0008) [2023-12-26 10:24:38,650][123090] Updated weights for policy 1, policy_version 1345384 (0.0010) [2023-12-26 10:24:38,702][123090] Updated weights for policy 1, policy_version 1345394 (0.0010) [2023-12-26 10:24:38,754][123090] Updated weights for policy 1, policy_version 1345404 (0.0010) [2023-12-26 10:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 691249152. Throughput: 0: 8781.9, 1: 8980.4. Samples: 691221208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:38,785][121949] Avg episode reward: [(0, '6362.518'), (1, '5616.163')] [2023-12-26 10:24:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001345408_344424448.pth... [2023-12-26 10:24:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001354768_346824704.pth... [2023-12-26 10:24:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001344352_344154112.pth [2023-12-26 10:24:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001353744_346562560.pth [2023-12-26 10:24:39,360][123091] Updated weights for policy 0, policy_version 1354771 (0.0009) [2023-12-26 10:24:39,430][123091] Updated weights for policy 0, policy_version 1354781 (0.0009) [2023-12-26 10:24:39,489][123091] Updated weights for policy 0, policy_version 1354791 (0.0010) [2023-12-26 10:24:39,587][123090] Updated weights for policy 1, policy_version 1345414 (0.0009) [2023-12-26 10:24:39,651][123090] Updated weights for policy 1, policy_version 1345424 (0.0009) [2023-12-26 10:24:39,713][123090] Updated weights for policy 1, policy_version 1345434 (0.0008) [2023-12-26 10:24:40,314][123091] Updated weights for policy 0, policy_version 1354801 (0.0009) [2023-12-26 10:24:40,387][123091] Updated weights for policy 0, policy_version 1354811 (0.0011) [2023-12-26 10:24:40,454][123091] Updated weights for policy 0, policy_version 1354821 (0.0011) [2023-12-26 10:24:40,521][123091] Updated weights for policy 0, policy_version 1354831 (0.0011) [2023-12-26 10:24:40,611][123090] Updated weights for policy 1, policy_version 1345444 (0.0009) [2023-12-26 10:24:40,668][123090] Updated weights for policy 1, policy_version 1345454 (0.0009) [2023-12-26 10:24:40,721][123090] Updated weights for policy 1, policy_version 1345464 (0.0009) [2023-12-26 10:24:41,241][123091] Updated weights for policy 0, policy_version 1354841 (0.0011) [2023-12-26 10:24:41,311][123091] Updated weights for policy 0, policy_version 1354851 (0.0011) [2023-12-26 10:24:41,392][123091] Updated weights for policy 0, policy_version 1354861 (0.0010) [2023-12-26 10:24:41,588][123090] Updated weights for policy 1, policy_version 1345474 (0.0009) [2023-12-26 10:24:41,668][123090] Updated weights for policy 1, policy_version 1345484 (0.0008) [2023-12-26 10:24:41,738][123090] Updated weights for policy 1, policy_version 1345494 (0.0010) [2023-12-26 10:24:41,807][123090] Updated weights for policy 1, policy_version 1345504 (0.0010) [2023-12-26 10:24:42,246][123091] Updated weights for policy 0, policy_version 1354871 (0.0010) [2023-12-26 10:24:42,310][123091] Updated weights for policy 0, policy_version 1354881 (0.0010) [2023-12-26 10:24:42,386][123091] Updated weights for policy 0, policy_version 1354891 (0.0009) [2023-12-26 10:24:42,651][123090] Updated weights for policy 1, policy_version 1345514 (0.0009) [2023-12-26 10:24:42,701][123090] Updated weights for policy 1, policy_version 1345524 (0.0009) [2023-12-26 10:24:42,757][123090] Updated weights for policy 1, policy_version 1345534 (0.0009) [2023-12-26 10:24:43,237][123091] Updated weights for policy 0, policy_version 1354901 (0.0007) [2023-12-26 10:24:43,309][123091] Updated weights for policy 0, policy_version 1354911 (0.0006) [2023-12-26 10:24:43,382][123091] Updated weights for policy 0, policy_version 1354921 (0.0009) [2023-12-26 10:24:43,466][123090] Updated weights for policy 1, policy_version 1345544 (0.0006) [2023-12-26 10:24:43,535][123090] Updated weights for policy 1, policy_version 1345554 (0.0006) [2023-12-26 10:24:43,603][123090] Updated weights for policy 1, policy_version 1345564 (0.0005) [2023-12-26 10:24:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 691331072. Throughput: 0: 8741.1, 1: 8874.3. Samples: 691321664. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:43,785][121949] Avg episode reward: [(0, '6408.878'), (1, '5597.788')] [2023-12-26 10:24:44,003][123091] Updated weights for policy 0, policy_version 1354931 (0.0007) [2023-12-26 10:24:44,059][123091] Updated weights for policy 0, policy_version 1354941 (0.0005) [2023-12-26 10:24:44,113][123091] Updated weights for policy 0, policy_version 1354951 (0.0008) [2023-12-26 10:24:44,272][123090] Updated weights for policy 1, policy_version 1345574 (0.0008) [2023-12-26 10:24:44,336][123090] Updated weights for policy 1, policy_version 1345584 (0.0009) [2023-12-26 10:24:44,383][123090] Updated weights for policy 1, policy_version 1345594 (0.0010) [2023-12-26 10:24:44,776][123091] Updated weights for policy 0, policy_version 1354961 (0.0009) [2023-12-26 10:24:44,842][123091] Updated weights for policy 0, policy_version 1354971 (0.0006) [2023-12-26 10:24:44,909][123091] Updated weights for policy 0, policy_version 1354981 (0.0006) [2023-12-26 10:24:44,975][123091] Updated weights for policy 0, policy_version 1354991 (0.0009) [2023-12-26 10:24:45,248][123090] Updated weights for policy 1, policy_version 1345604 (0.0010) [2023-12-26 10:24:45,316][123090] Updated weights for policy 1, policy_version 1345614 (0.0011) [2023-12-26 10:24:45,382][123090] Updated weights for policy 1, policy_version 1345624 (0.0011) [2023-12-26 10:24:45,747][123091] Updated weights for policy 0, policy_version 1355001 (0.0009) [2023-12-26 10:24:45,812][123091] Updated weights for policy 0, policy_version 1355011 (0.0009) [2023-12-26 10:24:45,871][123091] Updated weights for policy 0, policy_version 1355021 (0.0008) [2023-12-26 10:24:46,159][123090] Updated weights for policy 1, policy_version 1345634 (0.0007) [2023-12-26 10:24:46,223][123090] Updated weights for policy 1, policy_version 1345644 (0.0011) [2023-12-26 10:24:46,286][123090] Updated weights for policy 1, policy_version 1345654 (0.0010) [2023-12-26 10:24:46,349][123090] Updated weights for policy 1, policy_version 1345664 (0.0011) [2023-12-26 10:24:46,713][123091] Updated weights for policy 0, policy_version 1355031 (0.0010) [2023-12-26 10:24:46,787][123091] Updated weights for policy 0, policy_version 1355041 (0.0010) [2023-12-26 10:24:46,850][123091] Updated weights for policy 0, policy_version 1355051 (0.0010) [2023-12-26 10:24:47,120][123090] Updated weights for policy 1, policy_version 1345674 (0.0006) [2023-12-26 10:24:47,185][123090] Updated weights for policy 1, policy_version 1345684 (0.0005) [2023-12-26 10:24:47,256][123090] Updated weights for policy 1, policy_version 1345694 (0.0009) [2023-12-26 10:24:47,608][123091] Updated weights for policy 0, policy_version 1355061 (0.0007) [2023-12-26 10:24:47,667][123091] Updated weights for policy 0, policy_version 1355071 (0.0005) [2023-12-26 10:24:47,720][123091] Updated weights for policy 0, policy_version 1355081 (0.0010) [2023-12-26 10:24:47,945][123090] Updated weights for policy 1, policy_version 1345704 (0.0009) [2023-12-26 10:24:47,994][123090] Updated weights for policy 1, policy_version 1345714 (0.0009) [2023-12-26 10:24:48,055][123090] Updated weights for policy 1, policy_version 1345724 (0.0009) [2023-12-26 10:24:48,496][123091] Updated weights for policy 0, policy_version 1355091 (0.0010) [2023-12-26 10:24:48,560][123091] Updated weights for policy 0, policy_version 1355101 (0.0011) [2023-12-26 10:24:48,610][123091] Updated weights for policy 0, policy_version 1355111 (0.0010) [2023-12-26 10:24:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 691421184. Throughput: 0: 8840.2, 1: 8877.3. Samples: 691431528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:48,785][121949] Avg episode reward: [(0, '6335.517'), (1, '5364.056')] [2023-12-26 10:24:48,920][123090] Updated weights for policy 1, policy_version 1345734 (0.0010) [2023-12-26 10:24:48,983][123090] Updated weights for policy 1, policy_version 1345744 (0.0010) [2023-12-26 10:24:49,038][123090] Updated weights for policy 1, policy_version 1345754 (0.0007) [2023-12-26 10:24:49,449][123091] Updated weights for policy 0, policy_version 1355121 (0.0010) [2023-12-26 10:24:49,511][123091] Updated weights for policy 0, policy_version 1355131 (0.0010) [2023-12-26 10:24:49,573][123091] Updated weights for policy 0, policy_version 1355141 (0.0010) [2023-12-26 10:24:49,643][123091] Updated weights for policy 0, policy_version 1355151 (0.0010) [2023-12-26 10:24:49,816][123090] Updated weights for policy 1, policy_version 1345764 (0.0005) [2023-12-26 10:24:49,884][123090] Updated weights for policy 1, policy_version 1345774 (0.0007) [2023-12-26 10:24:49,955][123090] Updated weights for policy 1, policy_version 1345784 (0.0010) [2023-12-26 10:24:50,426][123091] Updated weights for policy 0, policy_version 1355161 (0.0011) [2023-12-26 10:24:50,489][123091] Updated weights for policy 0, policy_version 1355171 (0.0010) [2023-12-26 10:24:50,555][123091] Updated weights for policy 0, policy_version 1355181 (0.0011) [2023-12-26 10:24:50,663][123090] Updated weights for policy 1, policy_version 1345794 (0.0007) [2023-12-26 10:24:50,727][123090] Updated weights for policy 1, policy_version 1345804 (0.0011) [2023-12-26 10:24:50,787][123090] Updated weights for policy 1, policy_version 1345814 (0.0011) [2023-12-26 10:24:50,859][123090] Updated weights for policy 1, policy_version 1345824 (0.0011) [2023-12-26 10:24:51,367][123091] Updated weights for policy 0, policy_version 1355191 (0.0009) [2023-12-26 10:24:51,444][123091] Updated weights for policy 0, policy_version 1355201 (0.0011) [2023-12-26 10:24:51,519][123091] Updated weights for policy 0, policy_version 1355211 (0.0006) [2023-12-26 10:24:51,645][123090] Updated weights for policy 1, policy_version 1345834 (0.0007) [2023-12-26 10:24:51,713][123090] Updated weights for policy 1, policy_version 1345844 (0.0006) [2023-12-26 10:24:51,784][123090] Updated weights for policy 1, policy_version 1345854 (0.0010) [2023-12-26 10:24:52,279][123091] Updated weights for policy 0, policy_version 1355221 (0.0010) [2023-12-26 10:24:52,356][123091] Updated weights for policy 0, policy_version 1355231 (0.0011) [2023-12-26 10:24:52,423][123091] Updated weights for policy 0, policy_version 1355241 (0.0009) [2023-12-26 10:24:52,530][123090] Updated weights for policy 1, policy_version 1345864 (0.0008) [2023-12-26 10:24:52,595][123090] Updated weights for policy 1, policy_version 1345874 (0.0009) [2023-12-26 10:24:52,649][123090] Updated weights for policy 1, policy_version 1345884 (0.0009) [2023-12-26 10:24:53,205][123091] Updated weights for policy 0, policy_version 1355251 (0.0009) [2023-12-26 10:24:53,262][123091] Updated weights for policy 0, policy_version 1355261 (0.0010) [2023-12-26 10:24:53,318][123091] Updated weights for policy 0, policy_version 1355271 (0.0010) [2023-12-26 10:24:53,467][123090] Updated weights for policy 1, policy_version 1345894 (0.0007) [2023-12-26 10:24:53,516][123090] Updated weights for policy 1, policy_version 1345904 (0.0008) [2023-12-26 10:24:53,569][123090] Updated weights for policy 1, policy_version 1345914 (0.0009) [2023-12-26 10:24:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17439.2). Total num frames: 691511296. Throughput: 0: 8819.9, 1: 8902.6. Samples: 691485724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:53,785][121949] Avg episode reward: [(0, '6341.080'), (1, '5475.978')] [2023-12-26 10:24:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001345920_344555520.pth... [2023-12-26 10:24:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001355280_346955776.pth... [2023-12-26 10:24:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001344864_344285184.pth [2023-12-26 10:24:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001354256_346693632.pth [2023-12-26 10:24:54,136][123091] Updated weights for policy 0, policy_version 1355281 (0.0011) [2023-12-26 10:24:54,199][123091] Updated weights for policy 0, policy_version 1355291 (0.0011) [2023-12-26 10:24:54,273][123091] Updated weights for policy 0, policy_version 1355301 (0.0011) [2023-12-26 10:24:54,333][123091] Updated weights for policy 0, policy_version 1355311 (0.0011) [2023-12-26 10:24:54,350][123090] Updated weights for policy 1, policy_version 1345924 (0.0009) [2023-12-26 10:24:54,403][123090] Updated weights for policy 1, policy_version 1345934 (0.0008) [2023-12-26 10:24:54,451][123090] Updated weights for policy 1, policy_version 1345944 (0.0005) [2023-12-26 10:24:55,135][123091] Updated weights for policy 0, policy_version 1355321 (0.0010) [2023-12-26 10:24:55,191][123091] Updated weights for policy 0, policy_version 1355331 (0.0010) [2023-12-26 10:24:55,234][123090] Updated weights for policy 1, policy_version 1345954 (0.0006) [2023-12-26 10:24:55,253][123091] Updated weights for policy 0, policy_version 1355341 (0.0010) [2023-12-26 10:24:55,302][123090] Updated weights for policy 1, policy_version 1345964 (0.0007) [2023-12-26 10:24:55,371][123090] Updated weights for policy 1, policy_version 1345974 (0.0006) [2023-12-26 10:24:55,441][123090] Updated weights for policy 1, policy_version 1345984 (0.0007) [2023-12-26 10:24:56,016][123091] Updated weights for policy 0, policy_version 1355351 (0.0010) [2023-12-26 10:24:56,064][123091] Updated weights for policy 0, policy_version 1355361 (0.0009) [2023-12-26 10:24:56,111][123091] Updated weights for policy 0, policy_version 1355371 (0.0009) [2023-12-26 10:24:56,129][123090] Updated weights for policy 1, policy_version 1345994 (0.0008) [2023-12-26 10:24:56,191][123090] Updated weights for policy 1, policy_version 1346004 (0.0010) [2023-12-26 10:24:56,244][123090] Updated weights for policy 1, policy_version 1346014 (0.0009) [2023-12-26 10:24:56,907][123091] Updated weights for policy 0, policy_version 1355381 (0.0006) [2023-12-26 10:24:56,953][123091] Updated weights for policy 0, policy_version 1355391 (0.0005) [2023-12-26 10:24:57,005][123091] Updated weights for policy 0, policy_version 1355401 (0.0005) [2023-12-26 10:24:57,137][123090] Updated weights for policy 1, policy_version 1346024 (0.0009) [2023-12-26 10:24:57,200][123090] Updated weights for policy 1, policy_version 1346034 (0.0009) [2023-12-26 10:24:57,253][123090] Updated weights for policy 1, policy_version 1346044 (0.0008) [2023-12-26 10:24:57,757][123091] Updated weights for policy 0, policy_version 1355411 (0.0006) [2023-12-26 10:24:57,813][123091] Updated weights for policy 0, policy_version 1355421 (0.0009) [2023-12-26 10:24:57,868][123091] Updated weights for policy 0, policy_version 1355431 (0.0009) [2023-12-26 10:24:58,042][123090] Updated weights for policy 1, policy_version 1346054 (0.0006) [2023-12-26 10:24:58,108][123090] Updated weights for policy 1, policy_version 1346064 (0.0008) [2023-12-26 10:24:58,178][123090] Updated weights for policy 1, policy_version 1346074 (0.0008) [2023-12-26 10:24:58,626][123091] Updated weights for policy 0, policy_version 1355442 (0.0008) [2023-12-26 10:24:58,698][123091] Updated weights for policy 0, policy_version 1355452 (0.0009) [2023-12-26 10:24:58,767][123091] Updated weights for policy 0, policy_version 1355462 (0.0009) [2023-12-26 10:24:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17383.7). Total num frames: 691593216. Throughput: 0: 8832.7, 1: 8914.9. Samples: 691592628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:24:58,785][121949] Avg episode reward: [(0, '6370.211'), (1, '5600.762')] [2023-12-26 10:24:58,836][123091] Updated weights for policy 0, policy_version 1355472 (0.0009) [2023-12-26 10:24:59,042][123090] Updated weights for policy 1, policy_version 1346084 (0.0008) [2023-12-26 10:24:59,103][123090] Updated weights for policy 1, policy_version 1346094 (0.0009) [2023-12-26 10:24:59,156][123090] Updated weights for policy 1, policy_version 1346104 (0.0009) [2023-12-26 10:24:59,727][123091] Updated weights for policy 0, policy_version 1355482 (0.0011) [2023-12-26 10:24:59,790][123091] Updated weights for policy 0, policy_version 1355492 (0.0008) [2023-12-26 10:24:59,855][123091] Updated weights for policy 0, policy_version 1355502 (0.0007) [2023-12-26 10:24:59,988][123090] Updated weights for policy 1, policy_version 1346114 (0.0009) [2023-12-26 10:25:00,056][123090] Updated weights for policy 1, policy_version 1346124 (0.0010) [2023-12-26 10:25:00,112][123090] Updated weights for policy 1, policy_version 1346134 (0.0010) [2023-12-26 10:25:00,172][123090] Updated weights for policy 1, policy_version 1346144 (0.0010) [2023-12-26 10:25:00,660][123091] Updated weights for policy 0, policy_version 1355512 (0.0006) [2023-12-26 10:25:00,708][123091] Updated weights for policy 0, policy_version 1355522 (0.0006) [2023-12-26 10:25:00,767][123091] Updated weights for policy 0, policy_version 1355532 (0.0005) [2023-12-26 10:25:00,987][123090] Updated weights for policy 1, policy_version 1346154 (0.0010) [2023-12-26 10:25:01,057][123090] Updated weights for policy 1, policy_version 1346164 (0.0010) [2023-12-26 10:25:01,114][123090] Updated weights for policy 1, policy_version 1346174 (0.0010) [2023-12-26 10:25:01,476][123091] Updated weights for policy 0, policy_version 1355542 (0.0007) [2023-12-26 10:25:01,531][123091] Updated weights for policy 0, policy_version 1355552 (0.0008) [2023-12-26 10:25:01,590][123091] Updated weights for policy 0, policy_version 1355562 (0.0010) [2023-12-26 10:25:01,965][123090] Updated weights for policy 1, policy_version 1346184 (0.0010) [2023-12-26 10:25:02,021][123090] Updated weights for policy 1, policy_version 1346194 (0.0010) [2023-12-26 10:25:02,077][123090] Updated weights for policy 1, policy_version 1346204 (0.0008) [2023-12-26 10:25:02,446][123091] Updated weights for policy 0, policy_version 1355572 (0.0009) [2023-12-26 10:25:02,518][123091] Updated weights for policy 0, policy_version 1355582 (0.0009) [2023-12-26 10:25:02,583][123091] Updated weights for policy 0, policy_version 1355592 (0.0010) [2023-12-26 10:25:02,827][123090] Updated weights for policy 1, policy_version 1346214 (0.0005) [2023-12-26 10:25:02,888][123090] Updated weights for policy 1, policy_version 1346224 (0.0006) [2023-12-26 10:25:02,949][123090] Updated weights for policy 1, policy_version 1346234 (0.0011) [2023-12-26 10:25:03,418][123091] Updated weights for policy 0, policy_version 1355602 (0.0009) [2023-12-26 10:25:03,482][123091] Updated weights for policy 0, policy_version 1355612 (0.0006) [2023-12-26 10:25:03,556][123091] Updated weights for policy 0, policy_version 1355622 (0.0005) [2023-12-26 10:25:03,603][123091] Updated weights for policy 0, policy_version 1355632 (0.0005) [2023-12-26 10:25:03,624][123090] Updated weights for policy 1, policy_version 1346244 (0.0009) [2023-12-26 10:25:03,677][123090] Updated weights for policy 1, policy_version 1346254 (0.0006) [2023-12-26 10:25:03,735][123090] Updated weights for policy 1, policy_version 1346264 (0.0005) [2023-12-26 10:25:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17439.3). Total num frames: 691691520. Throughput: 0: 8840.9, 1: 8900.4. Samples: 691697688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:25:03,785][121949] Avg episode reward: [(0, '6342.080'), (1, '5809.784')] [2023-12-26 10:25:04,283][123091] Updated weights for policy 0, policy_version 1355642 (0.0010) [2023-12-26 10:25:04,339][123091] Updated weights for policy 0, policy_version 1355652 (0.0010) [2023-12-26 10:25:04,401][123091] Updated weights for policy 0, policy_version 1355662 (0.0010) [2023-12-26 10:25:04,469][123090] Updated weights for policy 1, policy_version 1346274 (0.0006) [2023-12-26 10:25:04,533][123090] Updated weights for policy 1, policy_version 1346284 (0.0010) [2023-12-26 10:25:04,594][123090] Updated weights for policy 1, policy_version 1346294 (0.0009) [2023-12-26 10:25:04,658][123090] Updated weights for policy 1, policy_version 1346304 (0.0009) [2023-12-26 10:25:05,107][123091] Updated weights for policy 0, policy_version 1355672 (0.0006) [2023-12-26 10:25:05,154][123091] Updated weights for policy 0, policy_version 1355682 (0.0006) [2023-12-26 10:25:05,219][123091] Updated weights for policy 0, policy_version 1355693 (0.0009) [2023-12-26 10:25:05,416][123090] Updated weights for policy 1, policy_version 1346314 (0.0005) [2023-12-26 10:25:05,477][123090] Updated weights for policy 1, policy_version 1346324 (0.0006) [2023-12-26 10:25:05,543][123090] Updated weights for policy 1, policy_version 1346334 (0.0005) [2023-12-26 10:25:06,056][123091] Updated weights for policy 0, policy_version 1355703 (0.0007) [2023-12-26 10:25:06,123][123091] Updated weights for policy 0, policy_version 1355713 (0.0007) [2023-12-26 10:25:06,185][123091] Updated weights for policy 0, policy_version 1355723 (0.0008) [2023-12-26 10:25:06,321][123090] Updated weights for policy 1, policy_version 1346344 (0.0008) [2023-12-26 10:25:06,381][123090] Updated weights for policy 1, policy_version 1346354 (0.0010) [2023-12-26 10:25:06,456][123090] Updated weights for policy 1, policy_version 1346364 (0.0006) [2023-12-26 10:25:06,820][123091] Updated weights for policy 0, policy_version 1355733 (0.0007) [2023-12-26 10:25:06,870][123091] Updated weights for policy 0, policy_version 1355743 (0.0007) [2023-12-26 10:25:06,926][123091] Updated weights for policy 0, policy_version 1355753 (0.0007) [2023-12-26 10:25:07,219][123090] Updated weights for policy 1, policy_version 1346374 (0.0006) [2023-12-26 10:25:07,281][123090] Updated weights for policy 1, policy_version 1346384 (0.0005) [2023-12-26 10:25:07,333][123090] Updated weights for policy 1, policy_version 1346394 (0.0005) [2023-12-26 10:25:07,612][123091] Updated weights for policy 0, policy_version 1355763 (0.0006) [2023-12-26 10:25:07,677][123091] Updated weights for policy 0, policy_version 1355773 (0.0010) [2023-12-26 10:25:07,739][123091] Updated weights for policy 0, policy_version 1355783 (0.0010) [2023-12-26 10:25:08,031][123090] Updated weights for policy 1, policy_version 1346404 (0.0008) [2023-12-26 10:25:08,098][123090] Updated weights for policy 1, policy_version 1346414 (0.0010) [2023-12-26 10:25:08,158][123090] Updated weights for policy 1, policy_version 1346424 (0.0011) [2023-12-26 10:25:08,600][123091] Updated weights for policy 0, policy_version 1355793 (0.0010) [2023-12-26 10:25:08,665][123091] Updated weights for policy 0, policy_version 1355803 (0.0009) [2023-12-26 10:25:08,734][123091] Updated weights for policy 0, policy_version 1355813 (0.0009) [2023-12-26 10:25:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 691773440. Throughput: 0: 8890.7, 1: 8953.9. Samples: 691753440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:25:08,785][121949] Avg episode reward: [(0, '6334.778'), (1, '5733.708')] [2023-12-26 10:25:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001346432_344686592.pth... [2023-12-26 10:25:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001345408_344424448.pth [2023-12-26 10:25:08,809][123091] Updated weights for policy 0, policy_version 1355823 (0.0009) [2023-12-26 10:25:08,813][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001355824_347095040.pth... [2023-12-26 10:25:08,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001354768_346824704.pth [2023-12-26 10:25:08,994][123090] Updated weights for policy 1, policy_version 1346434 (0.0009) [2023-12-26 10:25:09,042][123090] Updated weights for policy 1, policy_version 1346444 (0.0010) [2023-12-26 10:25:09,094][123090] Updated weights for policy 1, policy_version 1346454 (0.0010) [2023-12-26 10:25:09,164][123090] Updated weights for policy 1, policy_version 1346464 (0.0011) [2023-12-26 10:25:09,653][123091] Updated weights for policy 0, policy_version 1355833 (0.0006) [2023-12-26 10:25:09,725][123091] Updated weights for policy 0, policy_version 1355843 (0.0006) [2023-12-26 10:25:09,803][123091] Updated weights for policy 0, policy_version 1355853 (0.0006) [2023-12-26 10:25:09,988][123090] Updated weights for policy 1, policy_version 1346474 (0.0010) [2023-12-26 10:25:10,060][123090] Updated weights for policy 1, policy_version 1346484 (0.0010) [2023-12-26 10:25:10,120][123090] Updated weights for policy 1, policy_version 1346494 (0.0006) [2023-12-26 10:25:10,557][123091] Updated weights for policy 0, policy_version 1355863 (0.0009) [2023-12-26 10:25:10,631][123091] Updated weights for policy 0, policy_version 1355873 (0.0009) [2023-12-26 10:25:10,703][123091] Updated weights for policy 0, policy_version 1355883 (0.0010) [2023-12-26 10:25:10,758][123090] Updated weights for policy 1, policy_version 1346504 (0.0007) [2023-12-26 10:25:10,835][123090] Updated weights for policy 1, policy_version 1346514 (0.0006) [2023-12-26 10:25:10,906][123090] Updated weights for policy 1, policy_version 1346524 (0.0010) [2023-12-26 10:25:11,558][123091] Updated weights for policy 0, policy_version 1355893 (0.0009) [2023-12-26 10:25:11,629][123091] Updated weights for policy 0, policy_version 1355903 (0.0010) [2023-12-26 10:25:11,693][123091] Updated weights for policy 0, policy_version 1355913 (0.0009) [2023-12-26 10:25:11,718][123090] Updated weights for policy 1, policy_version 1346534 (0.0009) [2023-12-26 10:25:11,793][123090] Updated weights for policy 1, policy_version 1346544 (0.0006) [2023-12-26 10:25:11,853][123090] Updated weights for policy 1, policy_version 1346554 (0.0009) [2023-12-26 10:25:12,540][123091] Updated weights for policy 0, policy_version 1355923 (0.0010) [2023-12-26 10:25:12,598][123091] Updated weights for policy 0, policy_version 1355933 (0.0009) [2023-12-26 10:25:12,635][123090] Updated weights for policy 1, policy_version 1346564 (0.0006) [2023-12-26 10:25:12,657][123091] Updated weights for policy 0, policy_version 1355943 (0.0009) [2023-12-26 10:25:12,708][123090] Updated weights for policy 1, policy_version 1346574 (0.0005) [2023-12-26 10:25:12,770][123090] Updated weights for policy 1, policy_version 1346584 (0.0005) [2023-12-26 10:25:13,399][123091] Updated weights for policy 0, policy_version 1355953 (0.0009) [2023-12-26 10:25:13,469][123091] Updated weights for policy 0, policy_version 1355963 (0.0006) [2023-12-26 10:25:13,514][123090] Updated weights for policy 1, policy_version 1346594 (0.0006) [2023-12-26 10:25:13,536][123091] Updated weights for policy 0, policy_version 1355973 (0.0007) [2023-12-26 10:25:13,586][123091] Updated weights for policy 0, policy_version 1355983 (0.0006) [2023-12-26 10:25:13,590][123090] Updated weights for policy 1, policy_version 1346604 (0.0005) [2023-12-26 10:25:13,649][123090] Updated weights for policy 1, policy_version 1346614 (0.0007) [2023-12-26 10:25:13,708][123090] Updated weights for policy 1, policy_version 1346624 (0.0009) [2023-12-26 10:25:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17467.0). Total num frames: 691871744. Throughput: 0: 8861.8, 1: 8902.7. Samples: 691859380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:25:13,785][121949] Avg episode reward: [(0, '6331.533'), (1, '5657.478')] [2023-12-26 10:25:14,258][123091] Updated weights for policy 0, policy_version 1355993 (0.0010) [2023-12-26 10:25:14,312][123091] Updated weights for policy 0, policy_version 1356003 (0.0010) [2023-12-26 10:25:14,363][123091] Updated weights for policy 0, policy_version 1356013 (0.0010) [2023-12-26 10:25:14,539][123090] Updated weights for policy 1, policy_version 1346634 (0.0009) [2023-12-26 10:25:14,594][123090] Updated weights for policy 1, policy_version 1346644 (0.0008) [2023-12-26 10:25:14,650][123090] Updated weights for policy 1, policy_version 1346654 (0.0009) [2023-12-26 10:25:15,197][123091] Updated weights for policy 0, policy_version 1356023 (0.0010) [2023-12-26 10:25:15,261][123091] Updated weights for policy 0, policy_version 1356033 (0.0009) [2023-12-26 10:25:15,326][123091] Updated weights for policy 0, policy_version 1356043 (0.0010) [2023-12-26 10:25:15,494][123090] Updated weights for policy 1, policy_version 1346664 (0.0006) [2023-12-26 10:25:15,560][123090] Updated weights for policy 1, policy_version 1346674 (0.0005) [2023-12-26 10:25:15,624][123090] Updated weights for policy 1, policy_version 1346684 (0.0008) [2023-12-26 10:25:15,967][123091] Updated weights for policy 0, policy_version 1356053 (0.0007) [2023-12-26 10:25:16,032][123091] Updated weights for policy 0, policy_version 1356063 (0.0006) [2023-12-26 10:25:16,102][123091] Updated weights for policy 0, policy_version 1356073 (0.0006) [2023-12-26 10:25:16,444][123090] Updated weights for policy 1, policy_version 1346694 (0.0007) [2023-12-26 10:25:16,501][123090] Updated weights for policy 1, policy_version 1346704 (0.0005) [2023-12-26 10:25:16,565][123090] Updated weights for policy 1, policy_version 1346714 (0.0005) [2023-12-26 10:25:16,893][123091] Updated weights for policy 0, policy_version 1356083 (0.0009) [2023-12-26 10:25:16,946][123091] Updated weights for policy 0, policy_version 1356094 (0.0010) [2023-12-26 10:25:17,000][123091] Updated weights for policy 0, policy_version 1356104 (0.0010) [2023-12-26 10:25:17,218][123090] Updated weights for policy 1, policy_version 1346724 (0.0006) [2023-12-26 10:25:17,280][123090] Updated weights for policy 1, policy_version 1346734 (0.0009) [2023-12-26 10:25:17,341][123090] Updated weights for policy 1, policy_version 1346744 (0.0010) [2023-12-26 10:25:17,933][123091] Updated weights for policy 0, policy_version 1356114 (0.0010) [2023-12-26 10:25:17,985][123091] Updated weights for policy 0, policy_version 1356124 (0.0009) [2023-12-26 10:25:18,045][123091] Updated weights for policy 0, policy_version 1356134 (0.0010) [2023-12-26 10:25:18,078][123090] Updated weights for policy 1, policy_version 1346754 (0.0009) [2023-12-26 10:25:18,109][123091] Updated weights for policy 0, policy_version 1356144 (0.0007) [2023-12-26 10:25:18,130][123090] Updated weights for policy 1, policy_version 1346764 (0.0006) [2023-12-26 10:25:18,186][123090] Updated weights for policy 1, policy_version 1346774 (0.0008) [2023-12-26 10:25:18,238][123090] Updated weights for policy 1, policy_version 1346784 (0.0010) [2023-12-26 10:25:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17439.2). Total num frames: 691953664. Throughput: 0: 8890.5, 1: 8920.4. Samples: 691968456. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:25:18,785][121949] Avg episode reward: [(0, '6306.866'), (1, '5597.964')] [2023-12-26 10:25:18,903][123091] Updated weights for policy 0, policy_version 1356154 (0.0008) [2023-12-26 10:25:18,963][123091] Updated weights for policy 0, policy_version 1356164 (0.0009) [2023-12-26 10:25:19,026][123091] Updated weights for policy 0, policy_version 1356174 (0.0009) [2023-12-26 10:25:19,105][123090] Updated weights for policy 1, policy_version 1346794 (0.0008) [2023-12-26 10:25:19,153][123090] Updated weights for policy 1, policy_version 1346804 (0.0005) [2023-12-26 10:25:19,212][123090] Updated weights for policy 1, policy_version 1346814 (0.0006) [2023-12-26 10:25:19,815][123091] Updated weights for policy 0, policy_version 1356184 (0.0007) [2023-12-26 10:25:19,878][123091] Updated weights for policy 0, policy_version 1356194 (0.0009) [2023-12-26 10:25:19,949][123091] Updated weights for policy 0, policy_version 1356204 (0.0010) [2023-12-26 10:25:19,968][123090] Updated weights for policy 1, policy_version 1346824 (0.0010) [2023-12-26 10:25:20,029][123090] Updated weights for policy 1, policy_version 1346834 (0.0011) [2023-12-26 10:25:20,090][123090] Updated weights for policy 1, policy_version 1346844 (0.0011) [2023-12-26 10:25:20,745][123091] Updated weights for policy 0, policy_version 1356214 (0.0010) [2023-12-26 10:25:20,815][123091] Updated weights for policy 0, policy_version 1356224 (0.0006) [2023-12-26 10:25:20,889][123091] Updated weights for policy 0, policy_version 1356234 (0.0009) [2023-12-26 10:25:20,943][123090] Updated weights for policy 1, policy_version 1346854 (0.0011) [2023-12-26 10:25:21,011][123090] Updated weights for policy 1, policy_version 1346864 (0.0010) [2023-12-26 10:25:21,079][123090] Updated weights for policy 1, policy_version 1346874 (0.0011) [2023-12-26 10:25:21,756][123091] Updated weights for policy 0, policy_version 1356244 (0.0011) [2023-12-26 10:25:21,829][123091] Updated weights for policy 0, policy_version 1356254 (0.0009) [2023-12-26 10:25:21,885][123091] Updated weights for policy 0, policy_version 1356264 (0.0009) [2023-12-26 10:25:21,890][123090] Updated weights for policy 1, policy_version 1346884 (0.0009) [2023-12-26 10:25:21,959][123090] Updated weights for policy 1, policy_version 1346894 (0.0005) [2023-12-26 10:25:22,035][123090] Updated weights for policy 1, policy_version 1346904 (0.0008) [2023-12-26 10:25:22,678][123091] Updated weights for policy 0, policy_version 1356274 (0.0006) [2023-12-26 10:25:22,733][123091] Updated weights for policy 0, policy_version 1356284 (0.0008) [2023-12-26 10:25:22,774][123090] Updated weights for policy 1, policy_version 1346914 (0.0011) [2023-12-26 10:25:22,793][123091] Updated weights for policy 0, policy_version 1356294 (0.0007) [2023-12-26 10:25:22,835][123090] Updated weights for policy 1, policy_version 1346924 (0.0011) [2023-12-26 10:25:22,863][123091] Updated weights for policy 0, policy_version 1356304 (0.0006) [2023-12-26 10:25:22,899][123090] Updated weights for policy 1, policy_version 1346934 (0.0011) [2023-12-26 10:25:22,959][123090] Updated weights for policy 1, policy_version 1346944 (0.0010) [2023-12-26 10:25:23,662][123091] Updated weights for policy 0, policy_version 1356314 (0.0005) [2023-12-26 10:25:23,734][123091] Updated weights for policy 0, policy_version 1356324 (0.0006) [2023-12-26 10:25:23,782][123090] Updated weights for policy 1, policy_version 1346954 (0.0009) [2023-12-26 10:25:23,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17749.4, 300 sec: 17439.2). Total num frames: 692035584. Throughput: 0: 8852.1, 1: 8897.7. Samples: 692019948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:25:23,784][121949] Avg episode reward: [(0, '6302.325'), (1, '5758.579')] [2023-12-26 10:25:23,788][123091] Updated weights for policy 0, policy_version 1356334 (0.0008) [2023-12-26 10:25:23,804][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001356336_347226112.pth... [2023-12-26 10:25:23,808][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001355280_346955776.pth [2023-12-26 10:25:23,851][123090] Updated weights for policy 1, policy_version 1346964 (0.0009) [2023-12-26 10:25:23,903][123090] Updated weights for policy 1, policy_version 1346974 (0.0010) [2023-12-26 10:25:23,913][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001346976_344825856.pth... [2023-12-26 10:25:23,916][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001345920_344555520.pth [2023-12-26 10:25:24,528][123091] Updated weights for policy 0, policy_version 1356344 (0.0010) [2023-12-26 10:25:24,590][123091] Updated weights for policy 0, policy_version 1356354 (0.0009) [2023-12-26 10:25:24,648][123091] Updated weights for policy 0, policy_version 1356364 (0.0009) [2023-12-26 10:25:24,702][123090] Updated weights for policy 1, policy_version 1346984 (0.0006) [2023-12-26 10:25:24,765][123090] Updated weights for policy 1, policy_version 1346994 (0.0005) [2023-12-26 10:25:24,826][123090] Updated weights for policy 1, policy_version 1347004 (0.0005) [2023-12-26 10:25:25,403][123091] Updated weights for policy 0, policy_version 1356374 (0.0007) [2023-12-26 10:25:25,465][123091] Updated weights for policy 0, policy_version 1356384 (0.0008) [2023-12-26 10:25:25,484][123090] Updated weights for policy 1, policy_version 1347014 (0.0005) [2023-12-26 10:25:25,544][123091] Updated weights for policy 0, policy_version 1356394 (0.0005) [2023-12-26 10:25:25,557][123090] Updated weights for policy 1, policy_version 1347024 (0.0007) [2023-12-26 10:25:25,635][123090] Updated weights for policy 1, policy_version 1347034 (0.0006) [2023-12-26 10:25:26,274][123091] Updated weights for policy 0, policy_version 1356404 (0.0007) [2023-12-26 10:25:26,287][123090] Updated weights for policy 1, policy_version 1347044 (0.0008) [2023-12-26 10:25:26,331][123091] Updated weights for policy 0, policy_version 1356414 (0.0009) [2023-12-26 10:25:26,346][123090] Updated weights for policy 1, policy_version 1347054 (0.0010) [2023-12-26 10:25:26,395][123091] Updated weights for policy 0, policy_version 1356424 (0.0006) [2023-12-26 10:25:26,413][123090] Updated weights for policy 1, policy_version 1347064 (0.0011) [2023-12-26 10:25:27,136][123090] Updated weights for policy 1, policy_version 1347074 (0.0009) [2023-12-26 10:25:27,156][123091] Updated weights for policy 0, policy_version 1356434 (0.0009) [2023-12-26 10:25:27,189][123090] Updated weights for policy 1, policy_version 1347084 (0.0005) [2023-12-26 10:25:27,201][123091] Updated weights for policy 0, policy_version 1356444 (0.0005) [2023-12-26 10:25:27,247][123090] Updated weights for policy 1, policy_version 1347094 (0.0005) [2023-12-26 10:25:27,253][123091] Updated weights for policy 0, policy_version 1356454 (0.0005) [2023-12-26 10:25:27,301][123090] Updated weights for policy 1, policy_version 1347104 (0.0006) [2023-12-26 10:25:27,308][123091] Updated weights for policy 0, policy_version 1356464 (0.0005) [2023-12-26 10:25:27,947][123091] Updated weights for policy 0, policy_version 1356474 (0.0010) [2023-12-26 10:25:27,950][123090] Updated weights for policy 1, policy_version 1347114 (0.0008) [2023-12-26 10:25:27,994][123091] Updated weights for policy 0, policy_version 1356484 (0.0010) [2023-12-26 10:25:28,013][123090] Updated weights for policy 1, policy_version 1347124 (0.0008) [2023-12-26 10:25:28,048][123091] Updated weights for policy 0, policy_version 1356494 (0.0010) [2023-12-26 10:25:28,073][123090] Updated weights for policy 1, policy_version 1347134 (0.0008) [2023-12-26 10:25:28,750][123090] Updated weights for policy 1, policy_version 1347144 (0.0008) [2023-12-26 10:25:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17439.2). Total num frames: 692133888. Throughput: 0: 8957.3, 1: 9038.0. Samples: 692131448. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:28,785][121949] Avg episode reward: [(0, '6271.524'), (1, '5824.116')] [2023-12-26 10:25:28,814][123090] Updated weights for policy 1, policy_version 1347154 (0.0008) [2023-12-26 10:25:28,834][123091] Updated weights for policy 0, policy_version 1356504 (0.0010) [2023-12-26 10:25:28,882][123090] Updated weights for policy 1, policy_version 1347164 (0.0010) [2023-12-26 10:25:28,894][123091] Updated weights for policy 0, policy_version 1356514 (0.0011) [2023-12-26 10:25:28,946][123091] Updated weights for policy 0, policy_version 1356524 (0.0010) [2023-12-26 10:25:29,593][123090] Updated weights for policy 1, policy_version 1347174 (0.0009) [2023-12-26 10:25:29,645][123090] Updated weights for policy 1, policy_version 1347184 (0.0010) [2023-12-26 10:25:29,701][123090] Updated weights for policy 1, policy_version 1347194 (0.0010) [2023-12-26 10:25:29,732][123091] Updated weights for policy 0, policy_version 1356534 (0.0010) [2023-12-26 10:25:29,784][123091] Updated weights for policy 0, policy_version 1356544 (0.0010) [2023-12-26 10:25:29,854][123091] Updated weights for policy 0, policy_version 1356555 (0.0008) [2023-12-26 10:25:30,536][123090] Updated weights for policy 1, policy_version 1347204 (0.0010) [2023-12-26 10:25:30,582][123090] Updated weights for policy 1, policy_version 1347214 (0.0008) [2023-12-26 10:25:30,632][123090] Updated weights for policy 1, policy_version 1347224 (0.0007) [2023-12-26 10:25:30,701][123091] Updated weights for policy 0, policy_version 1356565 (0.0010) [2023-12-26 10:25:30,754][123091] Updated weights for policy 0, policy_version 1356575 (0.0009) [2023-12-26 10:25:30,807][123091] Updated weights for policy 0, policy_version 1356585 (0.0010) [2023-12-26 10:25:31,391][123090] Updated weights for policy 1, policy_version 1347234 (0.0006) [2023-12-26 10:25:31,462][123090] Updated weights for policy 1, policy_version 1347244 (0.0010) [2023-12-26 10:25:31,528][123090] Updated weights for policy 1, policy_version 1347254 (0.0009) [2023-12-26 10:25:31,589][123090] Updated weights for policy 1, policy_version 1347264 (0.0009) [2023-12-26 10:25:31,719][123091] Updated weights for policy 0, policy_version 1356595 (0.0010) [2023-12-26 10:25:31,777][123091] Updated weights for policy 0, policy_version 1356605 (0.0009) [2023-12-26 10:25:31,827][123091] Updated weights for policy 0, policy_version 1356615 (0.0009) [2023-12-26 10:25:32,418][123090] Updated weights for policy 1, policy_version 1347274 (0.0010) [2023-12-26 10:25:32,478][123090] Updated weights for policy 1, policy_version 1347284 (0.0009) [2023-12-26 10:25:32,542][123090] Updated weights for policy 1, policy_version 1347294 (0.0009) [2023-12-26 10:25:32,656][123091] Updated weights for policy 0, policy_version 1356625 (0.0010) [2023-12-26 10:25:32,707][123091] Updated weights for policy 0, policy_version 1356635 (0.0010) [2023-12-26 10:25:32,766][123091] Updated weights for policy 0, policy_version 1356645 (0.0010) [2023-12-26 10:25:32,825][123091] Updated weights for policy 0, policy_version 1356655 (0.0009) [2023-12-26 10:25:33,356][123090] Updated weights for policy 1, policy_version 1347304 (0.0009) [2023-12-26 10:25:33,412][123090] Updated weights for policy 1, policy_version 1347314 (0.0009) [2023-12-26 10:25:33,471][123090] Updated weights for policy 1, policy_version 1347324 (0.0009) [2023-12-26 10:25:33,664][123091] Updated weights for policy 0, policy_version 1356665 (0.0009) [2023-12-26 10:25:33,713][123091] Updated weights for policy 0, policy_version 1356675 (0.0010) [2023-12-26 10:25:33,760][123091] Updated weights for policy 0, policy_version 1356685 (0.0009) [2023-12-26 10:25:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 17494.8). Total num frames: 692232192. Throughput: 0: 8898.5, 1: 9033.4. Samples: 692238460. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:33,784][121949] Avg episode reward: [(0, '6348.080'), (1, '5768.262')] [2023-12-26 10:25:34,308][123090] Updated weights for policy 1, policy_version 1347334 (0.0010) [2023-12-26 10:25:34,369][123090] Updated weights for policy 1, policy_version 1347344 (0.0009) [2023-12-26 10:25:34,431][123090] Updated weights for policy 1, policy_version 1347354 (0.0009) [2023-12-26 10:25:34,642][123091] Updated weights for policy 0, policy_version 1356695 (0.0009) [2023-12-26 10:25:34,711][123091] Updated weights for policy 0, policy_version 1356705 (0.0008) [2023-12-26 10:25:34,781][123091] Updated weights for policy 0, policy_version 1356715 (0.0008) [2023-12-26 10:25:35,229][123090] Updated weights for policy 1, policy_version 1347364 (0.0010) [2023-12-26 10:25:35,284][123090] Updated weights for policy 1, policy_version 1347374 (0.0008) [2023-12-26 10:25:35,341][123090] Updated weights for policy 1, policy_version 1347384 (0.0009) [2023-12-26 10:25:35,445][123091] Updated weights for policy 0, policy_version 1356725 (0.0008) [2023-12-26 10:25:35,508][123091] Updated weights for policy 0, policy_version 1356735 (0.0010) [2023-12-26 10:25:35,580][123091] Updated weights for policy 0, policy_version 1356745 (0.0010) [2023-12-26 10:25:36,147][123090] Updated weights for policy 1, policy_version 1347394 (0.0009) [2023-12-26 10:25:36,218][123090] Updated weights for policy 1, policy_version 1347404 (0.0010) [2023-12-26 10:25:36,292][123090] Updated weights for policy 1, policy_version 1347414 (0.0009) [2023-12-26 10:25:36,353][123090] Updated weights for policy 1, policy_version 1347424 (0.0010) [2023-12-26 10:25:36,417][123091] Updated weights for policy 0, policy_version 1356755 (0.0009) [2023-12-26 10:25:36,488][123091] Updated weights for policy 0, policy_version 1356765 (0.0008) [2023-12-26 10:25:36,541][123091] Updated weights for policy 0, policy_version 1356775 (0.0006) [2023-12-26 10:25:37,218][123091] Updated weights for policy 0, policy_version 1356785 (0.0007) [2023-12-26 10:25:37,266][123090] Updated weights for policy 1, policy_version 1347434 (0.0007) [2023-12-26 10:25:37,276][123091] Updated weights for policy 0, policy_version 1356795 (0.0011) [2023-12-26 10:25:37,329][123090] Updated weights for policy 1, policy_version 1347444 (0.0006) [2023-12-26 10:25:37,332][123091] Updated weights for policy 0, policy_version 1356805 (0.0010) [2023-12-26 10:25:37,388][123090] Updated weights for policy 1, policy_version 1347454 (0.0006) [2023-12-26 10:25:37,395][123091] Updated weights for policy 0, policy_version 1356815 (0.0010) [2023-12-26 10:25:38,157][123090] Updated weights for policy 1, policy_version 1347464 (0.0008) [2023-12-26 10:25:38,206][123090] Updated weights for policy 1, policy_version 1347474 (0.0008) [2023-12-26 10:25:38,208][123091] Updated weights for policy 0, policy_version 1356825 (0.0010) [2023-12-26 10:25:38,262][123090] Updated weights for policy 1, policy_version 1347484 (0.0006) [2023-12-26 10:25:38,266][123091] Updated weights for policy 0, policy_version 1356835 (0.0011) [2023-12-26 10:25:38,333][123091] Updated weights for policy 0, policy_version 1356845 (0.0010) [2023-12-26 10:25:38,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 692314112. Throughput: 0: 8909.5, 1: 8982.7. Samples: 692290880. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:38,786][121949] Avg episode reward: [(0, '6358.453'), (1, '5664.622')] [2023-12-26 10:25:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001356848_347357184.pth... [2023-12-26 10:25:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001347488_344956928.pth... [2023-12-26 10:25:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001346432_344686592.pth [2023-12-26 10:25:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001355824_347095040.pth [2023-12-26 10:25:39,027][123090] Updated weights for policy 1, policy_version 1347494 (0.0009) [2023-12-26 10:25:39,098][123090] Updated weights for policy 1, policy_version 1347504 (0.0008) [2023-12-26 10:25:39,105][123091] Updated weights for policy 0, policy_version 1356855 (0.0009) [2023-12-26 10:25:39,164][123090] Updated weights for policy 1, policy_version 1347514 (0.0007) [2023-12-26 10:25:39,170][123091] Updated weights for policy 0, policy_version 1356865 (0.0011) [2023-12-26 10:25:39,239][123091] Updated weights for policy 0, policy_version 1356875 (0.0010) [2023-12-26 10:25:40,011][123090] Updated weights for policy 1, policy_version 1347524 (0.0008) [2023-12-26 10:25:40,081][123090] Updated weights for policy 1, policy_version 1347534 (0.0007) [2023-12-26 10:25:40,088][123091] Updated weights for policy 0, policy_version 1356885 (0.0009) [2023-12-26 10:25:40,144][123090] Updated weights for policy 1, policy_version 1347544 (0.0008) [2023-12-26 10:25:40,156][123091] Updated weights for policy 0, policy_version 1356895 (0.0008) [2023-12-26 10:25:40,209][123091] Updated weights for policy 0, policy_version 1356905 (0.0011) [2023-12-26 10:25:40,984][123090] Updated weights for policy 1, policy_version 1347554 (0.0009) [2023-12-26 10:25:40,999][123091] Updated weights for policy 0, policy_version 1356915 (0.0011) [2023-12-26 10:25:41,067][123090] Updated weights for policy 1, policy_version 1347564 (0.0007) [2023-12-26 10:25:41,068][123091] Updated weights for policy 0, policy_version 1356925 (0.0011) [2023-12-26 10:25:41,135][123090] Updated weights for policy 1, policy_version 1347574 (0.0006) [2023-12-26 10:25:41,135][123091] Updated weights for policy 0, policy_version 1356935 (0.0010) [2023-12-26 10:25:41,203][123090] Updated weights for policy 1, policy_version 1347584 (0.0008) [2023-12-26 10:25:41,968][123091] Updated weights for policy 0, policy_version 1356945 (0.0009) [2023-12-26 10:25:42,024][123091] Updated weights for policy 0, policy_version 1356955 (0.0008) [2023-12-26 10:25:42,031][123090] Updated weights for policy 1, policy_version 1347594 (0.0007) [2023-12-26 10:25:42,076][123091] Updated weights for policy 0, policy_version 1356965 (0.0009) [2023-12-26 10:25:42,097][123090] Updated weights for policy 1, policy_version 1347604 (0.0006) [2023-12-26 10:25:42,138][123091] Updated weights for policy 0, policy_version 1356975 (0.0011) [2023-12-26 10:25:42,162][123090] Updated weights for policy 1, policy_version 1347614 (0.0007) [2023-12-26 10:25:42,909][123091] Updated weights for policy 0, policy_version 1356985 (0.0006) [2023-12-26 10:25:42,980][123091] Updated weights for policy 0, policy_version 1356995 (0.0005) [2023-12-26 10:25:43,031][123090] Updated weights for policy 1, policy_version 1347624 (0.0006) [2023-12-26 10:25:43,048][123091] Updated weights for policy 0, policy_version 1357005 (0.0006) [2023-12-26 10:25:43,111][123090] Updated weights for policy 1, policy_version 1347634 (0.0006) [2023-12-26 10:25:43,187][123090] Updated weights for policy 1, policy_version 1347644 (0.0005) [2023-12-26 10:25:43,742][123091] Updated weights for policy 0, policy_version 1357015 (0.0006) [2023-12-26 10:25:43,766][123090] Updated weights for policy 1, policy_version 1347654 (0.0005) [2023-12-26 10:25:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.4, 300 sec: 17439.2). Total num frames: 692396032. Throughput: 0: 8883.3, 1: 8931.0. Samples: 692394268. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:43,785][121949] Avg episode reward: [(0, '6256.984'), (1, '5726.817')] [2023-12-26 10:25:43,806][123091] Updated weights for policy 0, policy_version 1357025 (0.0005) [2023-12-26 10:25:43,830][123090] Updated weights for policy 1, policy_version 1347664 (0.0005) [2023-12-26 10:25:43,866][123091] Updated weights for policy 0, policy_version 1357035 (0.0006) [2023-12-26 10:25:43,876][123090] Updated weights for policy 1, policy_version 1347674 (0.0006) [2023-12-26 10:25:44,594][123091] Updated weights for policy 0, policy_version 1357045 (0.0007) [2023-12-26 10:25:44,658][123091] Updated weights for policy 0, policy_version 1357055 (0.0005) [2023-12-26 10:25:44,701][123090] Updated weights for policy 1, policy_version 1347684 (0.0007) [2023-12-26 10:25:44,728][123091] Updated weights for policy 0, policy_version 1357065 (0.0005) [2023-12-26 10:25:44,763][123090] Updated weights for policy 1, policy_version 1347694 (0.0010) [2023-12-26 10:25:44,831][123090] Updated weights for policy 1, policy_version 1347704 (0.0006) [2023-12-26 10:25:45,475][123091] Updated weights for policy 0, policy_version 1357075 (0.0009) [2023-12-26 10:25:45,531][123091] Updated weights for policy 0, policy_version 1357085 (0.0009) [2023-12-26 10:25:45,588][123091] Updated weights for policy 0, policy_version 1357095 (0.0010) [2023-12-26 10:25:45,611][123090] Updated weights for policy 1, policy_version 1347714 (0.0006) [2023-12-26 10:25:45,679][123090] Updated weights for policy 1, policy_version 1347724 (0.0006) [2023-12-26 10:25:45,747][123090] Updated weights for policy 1, policy_version 1347734 (0.0006) [2023-12-26 10:25:45,810][123090] Updated weights for policy 1, policy_version 1347744 (0.0006) [2023-12-26 10:25:46,448][123090] Updated weights for policy 1, policy_version 1347754 (0.0007) [2023-12-26 10:25:46,496][123090] Updated weights for policy 1, policy_version 1347764 (0.0008) [2023-12-26 10:25:46,518][123091] Updated weights for policy 0, policy_version 1357105 (0.0008) [2023-12-26 10:25:46,552][123090] Updated weights for policy 1, policy_version 1347774 (0.0007) [2023-12-26 10:25:46,568][123091] Updated weights for policy 0, policy_version 1357115 (0.0009) [2023-12-26 10:25:46,624][123091] Updated weights for policy 0, policy_version 1357125 (0.0009) [2023-12-26 10:25:46,684][123091] Updated weights for policy 0, policy_version 1357135 (0.0010) [2023-12-26 10:25:47,212][123090] Updated weights for policy 1, policy_version 1347784 (0.0006) [2023-12-26 10:25:47,274][123090] Updated weights for policy 1, policy_version 1347794 (0.0005) [2023-12-26 10:25:47,324][123090] Updated weights for policy 1, policy_version 1347804 (0.0008) [2023-12-26 10:25:47,402][123091] Updated weights for policy 0, policy_version 1357145 (0.0006) [2023-12-26 10:25:47,449][123091] Updated weights for policy 0, policy_version 1357155 (0.0009) [2023-12-26 10:25:47,499][123091] Updated weights for policy 0, policy_version 1357165 (0.0010) [2023-12-26 10:25:48,037][123090] Updated weights for policy 1, policy_version 1347814 (0.0009) [2023-12-26 10:25:48,094][123090] Updated weights for policy 1, policy_version 1347824 (0.0006) [2023-12-26 10:25:48,160][123090] Updated weights for policy 1, policy_version 1347834 (0.0009) [2023-12-26 10:25:48,328][123091] Updated weights for policy 0, policy_version 1357175 (0.0009) [2023-12-26 10:25:48,397][123091] Updated weights for policy 0, policy_version 1357185 (0.0010) [2023-12-26 10:25:48,494][123091] Updated weights for policy 0, policy_version 1357195 (0.0011) [2023-12-26 10:25:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17494.8). Total num frames: 692494336. Throughput: 0: 8922.6, 1: 9027.9. Samples: 692505468. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:48,785][121949] Avg episode reward: [(0, '6190.291'), (1, '5670.665')] [2023-12-26 10:25:48,948][123090] Updated weights for policy 1, policy_version 1347844 (0.0007) [2023-12-26 10:25:48,998][123090] Updated weights for policy 1, policy_version 1347854 (0.0005) [2023-12-26 10:25:49,046][123090] Updated weights for policy 1, policy_version 1347864 (0.0007) [2023-12-26 10:25:49,335][123091] Updated weights for policy 0, policy_version 1357205 (0.0011) [2023-12-26 10:25:49,405][123091] Updated weights for policy 0, policy_version 1357215 (0.0009) [2023-12-26 10:25:49,473][123091] Updated weights for policy 0, policy_version 1357225 (0.0009) [2023-12-26 10:25:49,938][123090] Updated weights for policy 1, policy_version 1347874 (0.0007) [2023-12-26 10:25:50,004][123090] Updated weights for policy 1, policy_version 1347884 (0.0009) [2023-12-26 10:25:50,068][123090] Updated weights for policy 1, policy_version 1347894 (0.0009) [2023-12-26 10:25:50,125][123090] Updated weights for policy 1, policy_version 1347904 (0.0008) [2023-12-26 10:25:50,269][123091] Updated weights for policy 0, policy_version 1357235 (0.0009) [2023-12-26 10:25:50,321][123091] Updated weights for policy 0, policy_version 1357245 (0.0005) [2023-12-26 10:25:50,390][123091] Updated weights for policy 0, policy_version 1357255 (0.0007) [2023-12-26 10:25:50,983][123090] Updated weights for policy 1, policy_version 1347914 (0.0008) [2023-12-26 10:25:51,038][123090] Updated weights for policy 1, policy_version 1347924 (0.0009) [2023-12-26 10:25:51,098][123090] Updated weights for policy 1, policy_version 1347934 (0.0010) [2023-12-26 10:25:51,133][123091] Updated weights for policy 0, policy_version 1357265 (0.0006) [2023-12-26 10:25:51,191][123091] Updated weights for policy 0, policy_version 1357275 (0.0010) [2023-12-26 10:25:51,253][123091] Updated weights for policy 0, policy_version 1357285 (0.0009) [2023-12-26 10:25:51,307][123091] Updated weights for policy 0, policy_version 1357295 (0.0009) [2023-12-26 10:25:51,982][123090] Updated weights for policy 1, policy_version 1347944 (0.0009) [2023-12-26 10:25:52,040][123090] Updated weights for policy 1, policy_version 1347954 (0.0009) [2023-12-26 10:25:52,089][123090] Updated weights for policy 1, policy_version 1347964 (0.0009) [2023-12-26 10:25:52,180][123091] Updated weights for policy 0, policy_version 1357305 (0.0009) [2023-12-26 10:25:52,234][123091] Updated weights for policy 0, policy_version 1357315 (0.0009) [2023-12-26 10:25:52,292][123091] Updated weights for policy 0, policy_version 1357325 (0.0010) [2023-12-26 10:25:52,934][123090] Updated weights for policy 1, policy_version 1347974 (0.0009) [2023-12-26 10:25:52,994][123090] Updated weights for policy 1, policy_version 1347984 (0.0009) [2023-12-26 10:25:53,029][123091] Updated weights for policy 0, policy_version 1357335 (0.0007) [2023-12-26 10:25:53,049][123090] Updated weights for policy 1, policy_version 1347994 (0.0010) [2023-12-26 10:25:53,086][123091] Updated weights for policy 0, policy_version 1357345 (0.0005) [2023-12-26 10:25:53,145][123091] Updated weights for policy 0, policy_version 1357355 (0.0005) [2023-12-26 10:25:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 692576256. Throughput: 0: 8868.6, 1: 8962.5. Samples: 692555836. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:53,785][121949] Avg episode reward: [(0, '6228.284'), (1, '5563.504')] [2023-12-26 10:25:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001348000_345088000.pth... [2023-12-26 10:25:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001346976_344825856.pth [2023-12-26 10:25:53,822][123091] Updated weights for policy 0, policy_version 1357365 (0.0007) [2023-12-26 10:25:53,890][123091] Updated weights for policy 0, policy_version 1357375 (0.0007) [2023-12-26 10:25:53,949][123090] Updated weights for policy 1, policy_version 1348004 (0.0008) [2023-12-26 10:25:53,951][123091] Updated weights for policy 0, policy_version 1357385 (0.0009) [2023-12-26 10:25:53,987][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001357392_347496448.pth... [2023-12-26 10:25:53,991][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001356336_347226112.pth [2023-12-26 10:25:54,035][123090] Updated weights for policy 1, policy_version 1348014 (0.0009) [2023-12-26 10:25:54,092][123090] Updated weights for policy 1, policy_version 1348024 (0.0009) [2023-12-26 10:25:54,744][123091] Updated weights for policy 0, policy_version 1357395 (0.0008) [2023-12-26 10:25:54,804][123091] Updated weights for policy 0, policy_version 1357405 (0.0009) [2023-12-26 10:25:54,866][123091] Updated weights for policy 0, policy_version 1357415 (0.0009) [2023-12-26 10:25:54,920][123090] Updated weights for policy 1, policy_version 1348034 (0.0009) [2023-12-26 10:25:54,989][123090] Updated weights for policy 1, policy_version 1348044 (0.0009) [2023-12-26 10:25:55,065][123090] Updated weights for policy 1, policy_version 1348054 (0.0010) [2023-12-26 10:25:55,121][123090] Updated weights for policy 1, policy_version 1348064 (0.0009) [2023-12-26 10:25:55,678][123091] Updated weights for policy 0, policy_version 1357425 (0.0009) [2023-12-26 10:25:55,751][123091] Updated weights for policy 0, policy_version 1357435 (0.0007) [2023-12-26 10:25:55,815][123091] Updated weights for policy 0, policy_version 1357445 (0.0010) [2023-12-26 10:25:55,865][123091] Updated weights for policy 0, policy_version 1357455 (0.0009) [2023-12-26 10:25:55,896][123090] Updated weights for policy 1, policy_version 1348074 (0.0009) [2023-12-26 10:25:55,957][123090] Updated weights for policy 1, policy_version 1348084 (0.0008) [2023-12-26 10:25:56,022][123090] Updated weights for policy 1, policy_version 1348094 (0.0009) [2023-12-26 10:25:56,630][123091] Updated weights for policy 0, policy_version 1357465 (0.0006) [2023-12-26 10:25:56,702][123091] Updated weights for policy 0, policy_version 1357475 (0.0005) [2023-12-26 10:25:56,770][123091] Updated weights for policy 0, policy_version 1357485 (0.0007) [2023-12-26 10:25:56,881][123090] Updated weights for policy 1, policy_version 1348104 (0.0010) [2023-12-26 10:25:56,945][123090] Updated weights for policy 1, policy_version 1348114 (0.0009) [2023-12-26 10:25:57,013][123090] Updated weights for policy 1, policy_version 1348124 (0.0009) [2023-12-26 10:25:57,459][123091] Updated weights for policy 0, policy_version 1357495 (0.0010) [2023-12-26 10:25:57,514][123091] Updated weights for policy 0, policy_version 1357505 (0.0009) [2023-12-26 10:25:57,565][123091] Updated weights for policy 0, policy_version 1357515 (0.0009) [2023-12-26 10:25:57,759][123090] Updated weights for policy 1, policy_version 1348134 (0.0007) [2023-12-26 10:25:57,820][123090] Updated weights for policy 1, policy_version 1348144 (0.0005) [2023-12-26 10:25:57,883][123090] Updated weights for policy 1, policy_version 1348154 (0.0005) [2023-12-26 10:25:58,420][123091] Updated weights for policy 0, policy_version 1357525 (0.0009) [2023-12-26 10:25:58,483][123091] Updated weights for policy 0, policy_version 1357535 (0.0010) [2023-12-26 10:25:58,550][123091] Updated weights for policy 0, policy_version 1357545 (0.0007) [2023-12-26 10:25:58,558][123090] Updated weights for policy 1, policy_version 1348164 (0.0006) [2023-12-26 10:25:58,621][123090] Updated weights for policy 1, policy_version 1348174 (0.0008) [2023-12-26 10:25:58,702][123090] Updated weights for policy 1, policy_version 1348184 (0.0007) [2023-12-26 10:25:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17494.8). Total num frames: 692674560. Throughput: 0: 8957.6, 1: 8880.9. Samples: 692662112. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:25:58,785][121949] Avg episode reward: [(0, '6306.733'), (1, '5508.718')] [2023-12-26 10:25:59,335][123091] Updated weights for policy 0, policy_version 1357555 (0.0008) [2023-12-26 10:25:59,409][123091] Updated weights for policy 0, policy_version 1357565 (0.0008) [2023-12-26 10:25:59,475][123090] Updated weights for policy 1, policy_version 1348194 (0.0007) [2023-12-26 10:25:59,483][123091] Updated weights for policy 0, policy_version 1357575 (0.0010) [2023-12-26 10:25:59,538][123090] Updated weights for policy 1, policy_version 1348204 (0.0010) [2023-12-26 10:25:59,597][123090] Updated weights for policy 1, policy_version 1348214 (0.0010) [2023-12-26 10:25:59,652][123090] Updated weights for policy 1, policy_version 1348224 (0.0010) [2023-12-26 10:26:00,236][123091] Updated weights for policy 0, policy_version 1357585 (0.0009) [2023-12-26 10:26:00,298][123091] Updated weights for policy 0, policy_version 1357595 (0.0005) [2023-12-26 10:26:00,345][123091] Updated weights for policy 0, policy_version 1357605 (0.0006) [2023-12-26 10:26:00,394][123091] Updated weights for policy 0, policy_version 1357615 (0.0006) [2023-12-26 10:26:00,422][123090] Updated weights for policy 1, policy_version 1348234 (0.0005) [2023-12-26 10:26:00,486][123090] Updated weights for policy 1, policy_version 1348244 (0.0005) [2023-12-26 10:26:00,538][123090] Updated weights for policy 1, policy_version 1348254 (0.0005) [2023-12-26 10:26:01,121][123091] Updated weights for policy 0, policy_version 1357625 (0.0008) [2023-12-26 10:26:01,186][123091] Updated weights for policy 0, policy_version 1357635 (0.0008) [2023-12-26 10:26:01,245][123091] Updated weights for policy 0, policy_version 1357645 (0.0008) [2023-12-26 10:26:01,252][123090] Updated weights for policy 1, policy_version 1348264 (0.0010) [2023-12-26 10:26:01,316][123090] Updated weights for policy 1, policy_version 1348274 (0.0008) [2023-12-26 10:26:01,390][123090] Updated weights for policy 1, policy_version 1348284 (0.0010) [2023-12-26 10:26:02,127][123091] Updated weights for policy 0, policy_version 1357655 (0.0006) [2023-12-26 10:26:02,166][123090] Updated weights for policy 1, policy_version 1348294 (0.0007) [2023-12-26 10:26:02,189][123091] Updated weights for policy 0, policy_version 1357665 (0.0008) [2023-12-26 10:26:02,235][123090] Updated weights for policy 1, policy_version 1348304 (0.0007) [2023-12-26 10:26:02,255][123091] Updated weights for policy 0, policy_version 1357675 (0.0010) [2023-12-26 10:26:02,300][123090] Updated weights for policy 1, policy_version 1348314 (0.0010) [2023-12-26 10:26:03,050][123090] Updated weights for policy 1, policy_version 1348324 (0.0009) [2023-12-26 10:26:03,061][123091] Updated weights for policy 0, policy_version 1357685 (0.0009) [2023-12-26 10:26:03,110][123090] Updated weights for policy 1, policy_version 1348334 (0.0009) [2023-12-26 10:26:03,112][123091] Updated weights for policy 0, policy_version 1357695 (0.0010) [2023-12-26 10:26:03,163][123091] Updated weights for policy 0, policy_version 1357705 (0.0010) [2023-12-26 10:26:03,169][123090] Updated weights for policy 1, policy_version 1348344 (0.0010) [2023-12-26 10:26:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 692756480. Throughput: 0: 8904.5, 1: 8930.6. Samples: 692771032. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:03,784][121949] Avg episode reward: [(0, '6257.891'), (1, '5664.608')] [2023-12-26 10:26:03,900][123090] Updated weights for policy 1, policy_version 1348354 (0.0009) [2023-12-26 10:26:03,968][123090] Updated weights for policy 1, policy_version 1348364 (0.0005) [2023-12-26 10:26:03,978][123091] Updated weights for policy 0, policy_version 1357715 (0.0011) [2023-12-26 10:26:04,038][123090] Updated weights for policy 1, policy_version 1348374 (0.0006) [2023-12-26 10:26:04,042][123091] Updated weights for policy 0, policy_version 1357725 (0.0011) [2023-12-26 10:26:04,107][123091] Updated weights for policy 0, policy_version 1357735 (0.0011) [2023-12-26 10:26:04,107][123090] Updated weights for policy 1, policy_version 1348384 (0.0009) [2023-12-26 10:26:04,765][123091] Updated weights for policy 0, policy_version 1357745 (0.0010) [2023-12-26 10:26:04,823][123091] Updated weights for policy 0, policy_version 1357755 (0.0010) [2023-12-26 10:26:04,878][123091] Updated weights for policy 0, policy_version 1357765 (0.0010) [2023-12-26 10:26:04,906][123090] Updated weights for policy 1, policy_version 1348394 (0.0010) [2023-12-26 10:26:04,925][123091] Updated weights for policy 0, policy_version 1357775 (0.0010) [2023-12-26 10:26:04,971][123090] Updated weights for policy 1, policy_version 1348404 (0.0007) [2023-12-26 10:26:05,028][123090] Updated weights for policy 1, policy_version 1348414 (0.0005) [2023-12-26 10:26:05,706][123090] Updated weights for policy 1, policy_version 1348424 (0.0005) [2023-12-26 10:26:05,755][123091] Updated weights for policy 0, policy_version 1357785 (0.0010) [2023-12-26 10:26:05,779][123090] Updated weights for policy 1, policy_version 1348434 (0.0008) [2023-12-26 10:26:05,818][123091] Updated weights for policy 0, policy_version 1357795 (0.0009) [2023-12-26 10:26:05,847][123090] Updated weights for policy 1, policy_version 1348444 (0.0011) [2023-12-26 10:26:05,874][123091] Updated weights for policy 0, policy_version 1357805 (0.0011) [2023-12-26 10:26:06,651][123090] Updated weights for policy 1, policy_version 1348454 (0.0010) [2023-12-26 10:26:06,692][123091] Updated weights for policy 0, policy_version 1357815 (0.0007) [2023-12-26 10:26:06,700][123090] Updated weights for policy 1, policy_version 1348464 (0.0010) [2023-12-26 10:26:06,752][123090] Updated weights for policy 1, policy_version 1348474 (0.0010) [2023-12-26 10:26:06,758][123091] Updated weights for policy 0, policy_version 1357825 (0.0006) [2023-12-26 10:26:06,821][123091] Updated weights for policy 0, policy_version 1357835 (0.0005) [2023-12-26 10:26:07,465][123091] Updated weights for policy 0, policy_version 1357845 (0.0007) [2023-12-26 10:26:07,482][123090] Updated weights for policy 1, policy_version 1348484 (0.0009) [2023-12-26 10:26:07,527][123091] Updated weights for policy 0, policy_version 1357855 (0.0008) [2023-12-26 10:26:07,539][123090] Updated weights for policy 1, policy_version 1348494 (0.0005) [2023-12-26 10:26:07,581][123091] Updated weights for policy 0, policy_version 1357865 (0.0009) [2023-12-26 10:26:07,591][123090] Updated weights for policy 1, policy_version 1348504 (0.0005) [2023-12-26 10:26:08,346][123090] Updated weights for policy 1, policy_version 1348514 (0.0006) [2023-12-26 10:26:08,349][123091] Updated weights for policy 0, policy_version 1357875 (0.0008) [2023-12-26 10:26:08,411][123090] Updated weights for policy 1, policy_version 1348524 (0.0010) [2023-12-26 10:26:08,418][123091] Updated weights for policy 0, policy_version 1357885 (0.0007) [2023-12-26 10:26:08,475][123090] Updated weights for policy 1, policy_version 1348534 (0.0011) [2023-12-26 10:26:08,485][123091] Updated weights for policy 0, policy_version 1357895 (0.0006) [2023-12-26 10:26:08,546][123090] Updated weights for policy 1, policy_version 1348544 (0.0011) [2023-12-26 10:26:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17522.5). Total num frames: 692854784. Throughput: 0: 8930.4, 1: 8972.4. Samples: 692825580. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:08,785][121949] Avg episode reward: [(0, '6232.331'), (1, '5596.140')] [2023-12-26 10:26:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001357904_347627520.pth... [2023-12-26 10:26:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001348544_345227264.pth... [2023-12-26 10:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001356848_347357184.pth [2023-12-26 10:26:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001347488_344956928.pth [2023-12-26 10:26:09,118][123091] Updated weights for policy 0, policy_version 1357905 (0.0008) [2023-12-26 10:26:09,183][123091] Updated weights for policy 0, policy_version 1357915 (0.0005) [2023-12-26 10:26:09,250][123091] Updated weights for policy 0, policy_version 1357925 (0.0007) [2023-12-26 10:26:09,306][123091] Updated weights for policy 0, policy_version 1357935 (0.0006) [2023-12-26 10:26:09,379][123090] Updated weights for policy 1, policy_version 1348554 (0.0008) [2023-12-26 10:26:09,452][123090] Updated weights for policy 1, policy_version 1348564 (0.0008) [2023-12-26 10:26:09,519][123090] Updated weights for policy 1, policy_version 1348574 (0.0008) [2023-12-26 10:26:10,190][123091] Updated weights for policy 0, policy_version 1357945 (0.0007) [2023-12-26 10:26:10,260][123091] Updated weights for policy 0, policy_version 1357955 (0.0006) [2023-12-26 10:26:10,290][123090] Updated weights for policy 1, policy_version 1348584 (0.0010) [2023-12-26 10:26:10,326][123091] Updated weights for policy 0, policy_version 1357965 (0.0006) [2023-12-26 10:26:10,366][123090] Updated weights for policy 1, policy_version 1348594 (0.0011) [2023-12-26 10:26:10,434][123090] Updated weights for policy 1, policy_version 1348604 (0.0007) [2023-12-26 10:26:11,089][123091] Updated weights for policy 0, policy_version 1357975 (0.0009) [2023-12-26 10:26:11,150][123091] Updated weights for policy 0, policy_version 1357985 (0.0011) [2023-12-26 10:26:11,151][123090] Updated weights for policy 1, policy_version 1348614 (0.0007) [2023-12-26 10:26:11,212][123091] Updated weights for policy 0, policy_version 1357995 (0.0013) [2023-12-26 10:26:11,219][123090] Updated weights for policy 1, policy_version 1348624 (0.0007) [2023-12-26 10:26:11,291][123090] Updated weights for policy 1, policy_version 1348634 (0.0008) [2023-12-26 10:26:11,955][123091] Updated weights for policy 0, policy_version 1358005 (0.0009) [2023-12-26 10:26:12,008][123091] Updated weights for policy 0, policy_version 1358015 (0.0011) [2023-12-26 10:26:12,052][123091] Updated weights for policy 0, policy_version 1358025 (0.0010) [2023-12-26 10:26:12,101][123090] Updated weights for policy 1, policy_version 1348644 (0.0011) [2023-12-26 10:26:12,154][123090] Updated weights for policy 1, policy_version 1348654 (0.0010) [2023-12-26 10:26:12,221][123090] Updated weights for policy 1, policy_version 1348664 (0.0011) [2023-12-26 10:26:12,919][123091] Updated weights for policy 0, policy_version 1358035 (0.0011) [2023-12-26 10:26:12,967][123091] Updated weights for policy 0, policy_version 1358045 (0.0011) [2023-12-26 10:26:13,016][123090] Updated weights for policy 1, policy_version 1348674 (0.0010) [2023-12-26 10:26:13,023][123091] Updated weights for policy 0, policy_version 1358055 (0.0010) [2023-12-26 10:26:13,083][123090] Updated weights for policy 1, policy_version 1348684 (0.0005) [2023-12-26 10:26:13,152][123090] Updated weights for policy 1, policy_version 1348694 (0.0006) [2023-12-26 10:26:13,218][123090] Updated weights for policy 1, policy_version 1348704 (0.0005) [2023-12-26 10:26:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17522.6). Total num frames: 692936704. Throughput: 0: 8910.9, 1: 8913.4. Samples: 692933544. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:13,785][121949] Avg episode reward: [(0, '6290.226'), (1, '5675.638')] [2023-12-26 10:26:13,835][123091] Updated weights for policy 0, policy_version 1358065 (0.0009) [2023-12-26 10:26:13,880][123090] Updated weights for policy 1, policy_version 1348714 (0.0006) [2023-12-26 10:26:13,900][123091] Updated weights for policy 0, policy_version 1358075 (0.0005) [2023-12-26 10:26:13,934][123090] Updated weights for policy 1, policy_version 1348724 (0.0005) [2023-12-26 10:26:13,961][123091] Updated weights for policy 0, policy_version 1358085 (0.0006) [2023-12-26 10:26:13,986][123090] Updated weights for policy 1, policy_version 1348734 (0.0005) [2023-12-26 10:26:14,025][123091] Updated weights for policy 0, policy_version 1358095 (0.0005) [2023-12-26 10:26:14,684][123090] Updated weights for policy 1, policy_version 1348744 (0.0005) [2023-12-26 10:26:14,713][123091] Updated weights for policy 0, policy_version 1358105 (0.0005) [2023-12-26 10:26:14,745][123090] Updated weights for policy 1, policy_version 1348754 (0.0005) [2023-12-26 10:26:14,781][123091] Updated weights for policy 0, policy_version 1358115 (0.0007) [2023-12-26 10:26:14,829][123090] Updated weights for policy 1, policy_version 1348764 (0.0006) [2023-12-26 10:26:14,854][123091] Updated weights for policy 0, policy_version 1358125 (0.0007) [2023-12-26 10:26:15,569][123090] Updated weights for policy 1, policy_version 1348774 (0.0006) [2023-12-26 10:26:15,634][123090] Updated weights for policy 1, policy_version 1348784 (0.0007) [2023-12-26 10:26:15,638][123091] Updated weights for policy 0, policy_version 1358135 (0.0009) [2023-12-26 10:26:15,700][123090] Updated weights for policy 1, policy_version 1348794 (0.0008) [2023-12-26 10:26:15,702][123091] Updated weights for policy 0, policy_version 1358145 (0.0008) [2023-12-26 10:26:15,771][123091] Updated weights for policy 0, policy_version 1358155 (0.0006) [2023-12-26 10:26:16,493][123091] Updated weights for policy 0, policy_version 1358165 (0.0010) [2023-12-26 10:26:16,537][123090] Updated weights for policy 1, policy_version 1348804 (0.0008) [2023-12-26 10:26:16,552][123091] Updated weights for policy 0, policy_version 1358175 (0.0011) [2023-12-26 10:26:16,597][123090] Updated weights for policy 1, policy_version 1348814 (0.0005) [2023-12-26 10:26:16,615][123091] Updated weights for policy 0, policy_version 1358185 (0.0011) [2023-12-26 10:26:16,661][123090] Updated weights for policy 1, policy_version 1348824 (0.0006) [2023-12-26 10:26:17,384][123091] Updated weights for policy 0, policy_version 1358195 (0.0011) [2023-12-26 10:26:17,414][123090] Updated weights for policy 1, policy_version 1348834 (0.0007) [2023-12-26 10:26:17,446][123091] Updated weights for policy 0, policy_version 1358205 (0.0011) [2023-12-26 10:26:17,486][123090] Updated weights for policy 1, policy_version 1348844 (0.0006) [2023-12-26 10:26:17,513][123091] Updated weights for policy 0, policy_version 1358215 (0.0011) [2023-12-26 10:26:17,551][123090] Updated weights for policy 1, policy_version 1348854 (0.0006) [2023-12-26 10:26:17,622][123090] Updated weights for policy 1, policy_version 1348864 (0.0006) [2023-12-26 10:26:18,310][123091] Updated weights for policy 0, policy_version 1358225 (0.0011) [2023-12-26 10:26:18,335][123090] Updated weights for policy 1, policy_version 1348874 (0.0009) [2023-12-26 10:26:18,375][123091] Updated weights for policy 0, policy_version 1358235 (0.0011) [2023-12-26 10:26:18,399][123090] Updated weights for policy 1, policy_version 1348884 (0.0009) [2023-12-26 10:26:18,437][123091] Updated weights for policy 0, policy_version 1358245 (0.0008) [2023-12-26 10:26:18,470][123090] Updated weights for policy 1, policy_version 1348894 (0.0007) [2023-12-26 10:26:18,507][123091] Updated weights for policy 0, policy_version 1358255 (0.0006) [2023-12-26 10:26:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17578.1). Total num frames: 693035008. Throughput: 0: 8955.5, 1: 8939.9. Samples: 693043756. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:18,785][121949] Avg episode reward: [(0, '6375.252'), (1, '5745.330')] [2023-12-26 10:26:19,206][123091] Updated weights for policy 0, policy_version 1358265 (0.0006) [2023-12-26 10:26:19,214][123090] Updated weights for policy 1, policy_version 1348904 (0.0006) [2023-12-26 10:26:19,281][123091] Updated weights for policy 0, policy_version 1358275 (0.0009) [2023-12-26 10:26:19,282][123090] Updated weights for policy 1, policy_version 1348914 (0.0008) [2023-12-26 10:26:19,347][123091] Updated weights for policy 0, policy_version 1358285 (0.0007) [2023-12-26 10:26:19,349][123090] Updated weights for policy 1, policy_version 1348924 (0.0008) [2023-12-26 10:26:20,160][123091] Updated weights for policy 0, policy_version 1358295 (0.0010) [2023-12-26 10:26:20,209][123090] Updated weights for policy 1, policy_version 1348934 (0.0008) [2023-12-26 10:26:20,223][123091] Updated weights for policy 0, policy_version 1358305 (0.0010) [2023-12-26 10:26:20,277][123090] Updated weights for policy 1, policy_version 1348944 (0.0007) [2023-12-26 10:26:20,290][123091] Updated weights for policy 0, policy_version 1358315 (0.0011) [2023-12-26 10:26:20,340][123090] Updated weights for policy 1, policy_version 1348954 (0.0009) [2023-12-26 10:26:21,036][123091] Updated weights for policy 0, policy_version 1358325 (0.0006) [2023-12-26 10:26:21,112][123091] Updated weights for policy 0, policy_version 1358335 (0.0007) [2023-12-26 10:26:21,182][123091] Updated weights for policy 0, policy_version 1358345 (0.0010) [2023-12-26 10:26:21,262][123090] Updated weights for policy 1, policy_version 1348964 (0.0008) [2023-12-26 10:26:21,338][123090] Updated weights for policy 1, policy_version 1348974 (0.0006) [2023-12-26 10:26:21,417][123090] Updated weights for policy 1, policy_version 1348984 (0.0009) [2023-12-26 10:26:21,919][123091] Updated weights for policy 0, policy_version 1358355 (0.0006) [2023-12-26 10:26:21,982][123091] Updated weights for policy 0, policy_version 1358365 (0.0006) [2023-12-26 10:26:22,045][123091] Updated weights for policy 0, policy_version 1358375 (0.0007) [2023-12-26 10:26:22,264][123090] Updated weights for policy 1, policy_version 1348994 (0.0008) [2023-12-26 10:26:22,334][123090] Updated weights for policy 1, policy_version 1349004 (0.0008) [2023-12-26 10:26:22,403][123090] Updated weights for policy 1, policy_version 1349014 (0.0009) [2023-12-26 10:26:22,469][123090] Updated weights for policy 1, policy_version 1349024 (0.0009) [2023-12-26 10:26:22,817][123091] Updated weights for policy 0, policy_version 1358385 (0.0010) [2023-12-26 10:26:22,872][123091] Updated weights for policy 0, policy_version 1358395 (0.0009) [2023-12-26 10:26:22,936][123091] Updated weights for policy 0, policy_version 1358405 (0.0009) [2023-12-26 10:26:23,002][123091] Updated weights for policy 0, policy_version 1358415 (0.0005) [2023-12-26 10:26:23,275][123090] Updated weights for policy 1, policy_version 1349034 (0.0010) [2023-12-26 10:26:23,332][123090] Updated weights for policy 1, policy_version 1349044 (0.0009) [2023-12-26 10:26:23,396][123090] Updated weights for policy 1, policy_version 1349054 (0.0009) [2023-12-26 10:26:23,707][123091] Updated weights for policy 0, policy_version 1358425 (0.0005) [2023-12-26 10:26:23,766][123091] Updated weights for policy 0, policy_version 1358435 (0.0006) [2023-12-26 10:26:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17578.1). Total num frames: 693116928. Throughput: 0: 8976.7, 1: 8918.6. Samples: 693096164. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:23,785][121949] Avg episode reward: [(0, '6309.618'), (1, '5747.835')] [2023-12-26 10:26:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001349056_345358336.pth... [2023-12-26 10:26:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001348000_345088000.pth [2023-12-26 10:26:23,821][123091] Updated weights for policy 0, policy_version 1358445 (0.0006) [2023-12-26 10:26:23,837][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001358448_347766784.pth... [2023-12-26 10:26:23,843][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001357392_347496448.pth [2023-12-26 10:26:24,251][123090] Updated weights for policy 1, policy_version 1349064 (0.0009) [2023-12-26 10:26:24,299][123090] Updated weights for policy 1, policy_version 1349074 (0.0009) [2023-12-26 10:26:24,347][123090] Updated weights for policy 1, policy_version 1349084 (0.0009) [2023-12-26 10:26:24,591][123091] Updated weights for policy 0, policy_version 1358455 (0.0006) [2023-12-26 10:26:24,653][123091] Updated weights for policy 0, policy_version 1358465 (0.0005) [2023-12-26 10:26:24,707][123091] Updated weights for policy 0, policy_version 1358475 (0.0005) [2023-12-26 10:26:25,308][123091] Updated weights for policy 0, policy_version 1358485 (0.0005) [2023-12-26 10:26:25,319][123090] Updated weights for policy 1, policy_version 1349094 (0.0009) [2023-12-26 10:26:25,370][123091] Updated weights for policy 0, policy_version 1358495 (0.0006) [2023-12-26 10:26:25,381][123090] Updated weights for policy 1, policy_version 1349104 (0.0009) [2023-12-26 10:26:25,433][123091] Updated weights for policy 0, policy_version 1358505 (0.0006) [2023-12-26 10:26:25,447][123090] Updated weights for policy 1, policy_version 1349114 (0.0009) [2023-12-26 10:26:26,106][123091] Updated weights for policy 0, policy_version 1358515 (0.0007) [2023-12-26 10:26:26,157][123091] Updated weights for policy 0, policy_version 1358525 (0.0010) [2023-12-26 10:26:26,212][123091] Updated weights for policy 0, policy_version 1358535 (0.0010) [2023-12-26 10:26:26,370][123090] Updated weights for policy 1, policy_version 1349124 (0.0009) [2023-12-26 10:26:26,429][123090] Updated weights for policy 1, policy_version 1349134 (0.0009) [2023-12-26 10:26:26,481][123090] Updated weights for policy 1, policy_version 1349144 (0.0009) [2023-12-26 10:26:27,040][123091] Updated weights for policy 0, policy_version 1358545 (0.0010) [2023-12-26 10:26:27,095][123091] Updated weights for policy 0, policy_version 1358555 (0.0010) [2023-12-26 10:26:27,143][123091] Updated weights for policy 0, policy_version 1358566 (0.0008) [2023-12-26 10:26:27,298][123090] Updated weights for policy 1, policy_version 1349154 (0.0010) [2023-12-26 10:26:27,356][123090] Updated weights for policy 1, policy_version 1349164 (0.0008) [2023-12-26 10:26:27,417][123090] Updated weights for policy 1, policy_version 1349174 (0.0005) [2023-12-26 10:26:27,482][123090] Updated weights for policy 1, policy_version 1349184 (0.0005) [2023-12-26 10:26:27,988][123091] Updated weights for policy 0, policy_version 1358577 (0.0010) [2023-12-26 10:26:28,043][123091] Updated weights for policy 0, policy_version 1358587 (0.0009) [2023-12-26 10:26:28,092][123091] Updated weights for policy 0, policy_version 1358597 (0.0009) [2023-12-26 10:26:28,157][123091] Updated weights for policy 0, policy_version 1358607 (0.0006) [2023-12-26 10:26:28,236][123090] Updated weights for policy 1, policy_version 1349194 (0.0009) [2023-12-26 10:26:28,317][123090] Updated weights for policy 1, policy_version 1349204 (0.0009) [2023-12-26 10:26:28,391][123090] Updated weights for policy 1, policy_version 1349214 (0.0007) [2023-12-26 10:26:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 693207040. Throughput: 0: 9069.5, 1: 8899.5. Samples: 693202872. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:28,785][121949] Avg episode reward: [(0, '6251.122'), (1, '5793.179')] [2023-12-26 10:26:28,866][123091] Updated weights for policy 0, policy_version 1358617 (0.0010) [2023-12-26 10:26:28,924][123091] Updated weights for policy 0, policy_version 1358627 (0.0007) [2023-12-26 10:26:28,963][123090] Updated weights for policy 1, policy_version 1349224 (0.0005) [2023-12-26 10:26:28,985][123091] Updated weights for policy 0, policy_version 1358637 (0.0006) [2023-12-26 10:26:29,034][123090] Updated weights for policy 1, policy_version 1349234 (0.0007) [2023-12-26 10:26:29,103][123090] Updated weights for policy 1, policy_version 1349244 (0.0009) [2023-12-26 10:26:29,703][123091] Updated weights for policy 0, policy_version 1358647 (0.0007) [2023-12-26 10:26:29,757][123091] Updated weights for policy 0, policy_version 1358657 (0.0005) [2023-12-26 10:26:29,814][123091] Updated weights for policy 0, policy_version 1358667 (0.0006) [2023-12-26 10:26:29,851][123090] Updated weights for policy 1, policy_version 1349254 (0.0008) [2023-12-26 10:26:29,917][123090] Updated weights for policy 1, policy_version 1349264 (0.0008) [2023-12-26 10:26:29,981][123090] Updated weights for policy 1, policy_version 1349274 (0.0007) [2023-12-26 10:26:30,580][123091] Updated weights for policy 0, policy_version 1358677 (0.0006) [2023-12-26 10:26:30,643][123091] Updated weights for policy 0, policy_version 1358687 (0.0005) [2023-12-26 10:26:30,693][123091] Updated weights for policy 0, policy_version 1358697 (0.0005) [2023-12-26 10:26:30,733][123090] Updated weights for policy 1, policy_version 1349284 (0.0007) [2023-12-26 10:26:30,794][123090] Updated weights for policy 1, policy_version 1349294 (0.0010) [2023-12-26 10:26:30,845][123090] Updated weights for policy 1, policy_version 1349304 (0.0009) [2023-12-26 10:26:31,467][123091] Updated weights for policy 0, policy_version 1358707 (0.0007) [2023-12-26 10:26:31,520][123091] Updated weights for policy 0, policy_version 1358717 (0.0009) [2023-12-26 10:26:31,569][123091] Updated weights for policy 0, policy_version 1358727 (0.0009) [2023-12-26 10:26:31,718][123090] Updated weights for policy 1, policy_version 1349315 (0.0009) [2023-12-26 10:26:31,782][123090] Updated weights for policy 1, policy_version 1349325 (0.0009) [2023-12-26 10:26:31,840][123090] Updated weights for policy 1, policy_version 1349335 (0.0009) [2023-12-26 10:26:32,452][123091] Updated weights for policy 0, policy_version 1358737 (0.0009) [2023-12-26 10:26:32,519][123091] Updated weights for policy 0, policy_version 1358747 (0.0010) [2023-12-26 10:26:32,580][123091] Updated weights for policy 0, policy_version 1358757 (0.0009) [2023-12-26 10:26:32,639][123090] Updated weights for policy 1, policy_version 1349345 (0.0009) [2023-12-26 10:26:32,650][123091] Updated weights for policy 0, policy_version 1358767 (0.0010) [2023-12-26 10:26:32,693][123090] Updated weights for policy 1, policy_version 1349355 (0.0007) [2023-12-26 10:26:32,748][123090] Updated weights for policy 1, policy_version 1349365 (0.0009) [2023-12-26 10:26:32,795][123090] Updated weights for policy 1, policy_version 1349375 (0.0008) [2023-12-26 10:26:33,401][123091] Updated weights for policy 0, policy_version 1358777 (0.0009) [2023-12-26 10:26:33,474][123091] Updated weights for policy 0, policy_version 1358787 (0.0007) [2023-12-26 10:26:33,484][123090] Updated weights for policy 1, policy_version 1349385 (0.0009) [2023-12-26 10:26:33,539][123091] Updated weights for policy 0, policy_version 1358797 (0.0008) [2023-12-26 10:26:33,549][123090] Updated weights for policy 1, policy_version 1349395 (0.0010) [2023-12-26 10:26:33,611][123090] Updated weights for policy 1, policy_version 1349405 (0.0010) [2023-12-26 10:26:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 693305344. Throughput: 0: 9105.2, 1: 8841.3. Samples: 693313056. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:33,785][121949] Avg episode reward: [(0, '6264.396'), (1, '5793.404')] [2023-12-26 10:26:34,121][123091] Updated weights for policy 0, policy_version 1358807 (0.0006) [2023-12-26 10:26:34,189][123091] Updated weights for policy 0, policy_version 1358817 (0.0007) [2023-12-26 10:26:34,243][123091] Updated weights for policy 0, policy_version 1358827 (0.0005) [2023-12-26 10:26:34,354][123090] Updated weights for policy 1, policy_version 1349415 (0.0007) [2023-12-26 10:26:34,417][123090] Updated weights for policy 1, policy_version 1349425 (0.0006) [2023-12-26 10:26:34,487][123090] Updated weights for policy 1, policy_version 1349435 (0.0006) [2023-12-26 10:26:35,047][123091] Updated weights for policy 0, policy_version 1358837 (0.0005) [2023-12-26 10:26:35,116][123091] Updated weights for policy 0, policy_version 1358847 (0.0005) [2023-12-26 10:26:35,141][123090] Updated weights for policy 1, policy_version 1349445 (0.0006) [2023-12-26 10:26:35,178][123091] Updated weights for policy 0, policy_version 1358857 (0.0008) [2023-12-26 10:26:35,189][123090] Updated weights for policy 1, policy_version 1349455 (0.0005) [2023-12-26 10:26:35,252][123090] Updated weights for policy 1, policy_version 1349465 (0.0005) [2023-12-26 10:26:35,906][123090] Updated weights for policy 1, policy_version 1349475 (0.0005) [2023-12-26 10:26:35,928][123091] Updated weights for policy 0, policy_version 1358867 (0.0010) [2023-12-26 10:26:35,973][123090] Updated weights for policy 1, policy_version 1349485 (0.0008) [2023-12-26 10:26:35,997][123091] Updated weights for policy 0, policy_version 1358877 (0.0005) [2023-12-26 10:26:36,034][123090] Updated weights for policy 1, policy_version 1349495 (0.0009) [2023-12-26 10:26:36,067][123091] Updated weights for policy 0, policy_version 1358887 (0.0008) [2023-12-26 10:26:36,783][123091] Updated weights for policy 0, policy_version 1358897 (0.0008) [2023-12-26 10:26:36,838][123091] Updated weights for policy 0, policy_version 1358907 (0.0008) [2023-12-26 10:26:36,904][123091] Updated weights for policy 0, policy_version 1358917 (0.0005) [2023-12-26 10:26:36,908][123090] Updated weights for policy 1, policy_version 1349505 (0.0006) [2023-12-26 10:26:36,968][123091] Updated weights for policy 0, policy_version 1358927 (0.0006) [2023-12-26 10:26:36,977][123090] Updated weights for policy 1, policy_version 1349515 (0.0008) [2023-12-26 10:26:37,051][123090] Updated weights for policy 1, policy_version 1349525 (0.0010) [2023-12-26 10:26:37,110][123090] Updated weights for policy 1, policy_version 1349535 (0.0010) [2023-12-26 10:26:37,712][123091] Updated weights for policy 0, policy_version 1358937 (0.0009) [2023-12-26 10:26:37,770][123091] Updated weights for policy 0, policy_version 1358947 (0.0009) [2023-12-26 10:26:37,826][123091] Updated weights for policy 0, policy_version 1358957 (0.0009) [2023-12-26 10:26:37,903][123090] Updated weights for policy 1, policy_version 1349545 (0.0009) [2023-12-26 10:26:37,970][123090] Updated weights for policy 1, policy_version 1349555 (0.0009) [2023-12-26 10:26:38,029][123090] Updated weights for policy 1, policy_version 1349565 (0.0008) [2023-12-26 10:26:38,651][123091] Updated weights for policy 0, policy_version 1358967 (0.0007) [2023-12-26 10:26:38,713][123091] Updated weights for policy 0, policy_version 1358977 (0.0005) [2023-12-26 10:26:38,778][123090] Updated weights for policy 1, policy_version 1349575 (0.0008) [2023-12-26 10:26:38,779][123091] Updated weights for policy 0, policy_version 1358987 (0.0009) [2023-12-26 10:26:38,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 693387264. Throughput: 0: 9171.4, 1: 8931.7. Samples: 693370480. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:38,786][121949] Avg episode reward: [(0, '6270.264'), (1, '5824.001')] [2023-12-26 10:26:38,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001358992_347906048.pth... [2023-12-26 10:26:38,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001357904_347627520.pth [2023-12-26 10:26:38,837][123090] Updated weights for policy 1, policy_version 1349585 (0.0005) [2023-12-26 10:26:38,893][123090] Updated weights for policy 1, policy_version 1349595 (0.0005) [2023-12-26 10:26:38,920][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001349600_345497600.pth... [2023-12-26 10:26:38,923][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001348544_345227264.pth [2023-12-26 10:26:39,526][123090] Updated weights for policy 1, policy_version 1349605 (0.0007) [2023-12-26 10:26:39,588][123091] Updated weights for policy 0, policy_version 1358997 (0.0010) [2023-12-26 10:26:39,596][123090] Updated weights for policy 1, policy_version 1349615 (0.0008) [2023-12-26 10:26:39,649][123091] Updated weights for policy 0, policy_version 1359007 (0.0009) [2023-12-26 10:26:39,661][123090] Updated weights for policy 1, policy_version 1349625 (0.0009) [2023-12-26 10:26:39,710][123091] Updated weights for policy 0, policy_version 1359017 (0.0009) [2023-12-26 10:26:40,507][123090] Updated weights for policy 1, policy_version 1349635 (0.0010) [2023-12-26 10:26:40,523][123091] Updated weights for policy 0, policy_version 1359027 (0.0009) [2023-12-26 10:26:40,561][123090] Updated weights for policy 1, policy_version 1349645 (0.0007) [2023-12-26 10:26:40,589][123091] Updated weights for policy 0, policy_version 1359037 (0.0010) [2023-12-26 10:26:40,615][123090] Updated weights for policy 1, policy_version 1349655 (0.0006) [2023-12-26 10:26:40,653][123091] Updated weights for policy 0, policy_version 1359047 (0.0009) [2023-12-26 10:26:41,446][123090] Updated weights for policy 1, policy_version 1349665 (0.0009) [2023-12-26 10:26:41,510][123090] Updated weights for policy 1, policy_version 1349675 (0.0010) [2023-12-26 10:26:41,526][123091] Updated weights for policy 0, policy_version 1359057 (0.0009) [2023-12-26 10:26:41,580][123090] Updated weights for policy 1, policy_version 1349685 (0.0008) [2023-12-26 10:26:41,585][123091] Updated weights for policy 0, policy_version 1359067 (0.0008) [2023-12-26 10:26:41,647][123090] Updated weights for policy 1, policy_version 1349695 (0.0009) [2023-12-26 10:26:41,655][123091] Updated weights for policy 0, policy_version 1359077 (0.0009) [2023-12-26 10:26:41,724][123091] Updated weights for policy 0, policy_version 1359087 (0.0007) [2023-12-26 10:26:42,490][123090] Updated weights for policy 1, policy_version 1349705 (0.0009) [2023-12-26 10:26:42,544][123091] Updated weights for policy 0, policy_version 1359097 (0.0008) [2023-12-26 10:26:42,556][123090] Updated weights for policy 1, policy_version 1349715 (0.0008) [2023-12-26 10:26:42,603][123091] Updated weights for policy 0, policy_version 1359107 (0.0008) [2023-12-26 10:26:42,609][123090] Updated weights for policy 1, policy_version 1349725 (0.0007) [2023-12-26 10:26:42,662][123091] Updated weights for policy 0, policy_version 1359117 (0.0008) [2023-12-26 10:26:43,433][123090] Updated weights for policy 1, policy_version 1349735 (0.0010) [2023-12-26 10:26:43,448][123091] Updated weights for policy 0, policy_version 1359127 (0.0007) [2023-12-26 10:26:43,496][123090] Updated weights for policy 1, policy_version 1349745 (0.0011) [2023-12-26 10:26:43,499][123091] Updated weights for policy 0, policy_version 1359137 (0.0008) [2023-12-26 10:26:43,560][123090] Updated weights for policy 1, policy_version 1349755 (0.0011) [2023-12-26 10:26:43,563][123091] Updated weights for policy 0, policy_version 1359147 (0.0007) [2023-12-26 10:26:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 693485568. Throughput: 0: 9070.2, 1: 8987.4. Samples: 693474704. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:43,784][121949] Avg episode reward: [(0, '6271.176'), (1, '5844.902')] [2023-12-26 10:26:44,336][123090] Updated weights for policy 1, policy_version 1349765 (0.0011) [2023-12-26 10:26:44,403][123090] Updated weights for policy 1, policy_version 1349775 (0.0008) [2023-12-26 10:26:44,428][123091] Updated weights for policy 0, policy_version 1359157 (0.0008) [2023-12-26 10:26:44,471][123090] Updated weights for policy 1, policy_version 1349785 (0.0005) [2023-12-26 10:26:44,477][123091] Updated weights for policy 0, policy_version 1359167 (0.0009) [2023-12-26 10:26:44,528][123091] Updated weights for policy 0, policy_version 1359177 (0.0008) [2023-12-26 10:26:45,207][123090] Updated weights for policy 1, policy_version 1349795 (0.0005) [2023-12-26 10:26:45,283][123090] Updated weights for policy 1, policy_version 1349805 (0.0007) [2023-12-26 10:26:45,351][123090] Updated weights for policy 1, policy_version 1349815 (0.0008) [2023-12-26 10:26:45,413][123091] Updated weights for policy 0, policy_version 1359187 (0.0009) [2023-12-26 10:26:45,468][123091] Updated weights for policy 0, policy_version 1359197 (0.0005) [2023-12-26 10:26:45,535][123091] Updated weights for policy 0, policy_version 1359207 (0.0005) [2023-12-26 10:26:46,030][123090] Updated weights for policy 1, policy_version 1349825 (0.0010) [2023-12-26 10:26:46,102][123090] Updated weights for policy 1, policy_version 1349835 (0.0008) [2023-12-26 10:26:46,167][123090] Updated weights for policy 1, policy_version 1349845 (0.0007) [2023-12-26 10:26:46,233][123090] Updated weights for policy 1, policy_version 1349855 (0.0006) [2023-12-26 10:26:46,248][123091] Updated weights for policy 0, policy_version 1359217 (0.0005) [2023-12-26 10:26:46,302][123091] Updated weights for policy 0, policy_version 1359227 (0.0005) [2023-12-26 10:26:46,363][123091] Updated weights for policy 0, policy_version 1359237 (0.0005) [2023-12-26 10:26:46,414][123091] Updated weights for policy 0, policy_version 1359247 (0.0008) [2023-12-26 10:26:46,880][123090] Updated weights for policy 1, policy_version 1349865 (0.0010) [2023-12-26 10:26:46,942][123090] Updated weights for policy 1, policy_version 1349875 (0.0010) [2023-12-26 10:26:47,001][123090] Updated weights for policy 1, policy_version 1349885 (0.0010) [2023-12-26 10:26:47,044][123091] Updated weights for policy 0, policy_version 1359257 (0.0006) [2023-12-26 10:26:47,106][123091] Updated weights for policy 0, policy_version 1359267 (0.0006) [2023-12-26 10:26:47,175][123091] Updated weights for policy 0, policy_version 1359277 (0.0006) [2023-12-26 10:26:47,818][123090] Updated weights for policy 1, policy_version 1349895 (0.0007) [2023-12-26 10:26:47,887][123090] Updated weights for policy 1, policy_version 1349905 (0.0008) [2023-12-26 10:26:47,894][123091] Updated weights for policy 0, policy_version 1359287 (0.0009) [2023-12-26 10:26:47,943][123090] Updated weights for policy 1, policy_version 1349915 (0.0006) [2023-12-26 10:26:47,949][123091] Updated weights for policy 0, policy_version 1359297 (0.0010) [2023-12-26 10:26:48,012][123091] Updated weights for policy 0, policy_version 1359307 (0.0011) [2023-12-26 10:26:48,706][123090] Updated weights for policy 1, policy_version 1349925 (0.0005) [2023-12-26 10:26:48,781][123090] Updated weights for policy 1, policy_version 1349935 (0.0006) [2023-12-26 10:26:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 693567488. Throughput: 0: 9122.2, 1: 8974.0. Samples: 693585364. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:48,785][121949] Avg episode reward: [(0, '6299.723'), (1, '5778.802')] [2023-12-26 10:26:48,848][123091] Updated weights for policy 0, policy_version 1359317 (0.0011) [2023-12-26 10:26:48,856][123090] Updated weights for policy 1, policy_version 1349945 (0.0010) [2023-12-26 10:26:48,905][123091] Updated weights for policy 0, policy_version 1359327 (0.0011) [2023-12-26 10:26:48,961][123091] Updated weights for policy 0, policy_version 1359337 (0.0011) [2023-12-26 10:26:49,614][123090] Updated weights for policy 1, policy_version 1349955 (0.0008) [2023-12-26 10:26:49,674][123090] Updated weights for policy 1, policy_version 1349965 (0.0009) [2023-12-26 10:26:49,712][123091] Updated weights for policy 0, policy_version 1359347 (0.0010) [2023-12-26 10:26:49,740][123090] Updated weights for policy 1, policy_version 1349975 (0.0008) [2023-12-26 10:26:49,775][123091] Updated weights for policy 0, policy_version 1359357 (0.0008) [2023-12-26 10:26:49,836][123091] Updated weights for policy 0, policy_version 1359367 (0.0007) [2023-12-26 10:26:50,614][123091] Updated weights for policy 0, policy_version 1359377 (0.0008) [2023-12-26 10:26:50,629][123090] Updated weights for policy 1, policy_version 1349985 (0.0007) [2023-12-26 10:26:50,683][123091] Updated weights for policy 0, policy_version 1359387 (0.0011) [2023-12-26 10:26:50,690][123090] Updated weights for policy 1, policy_version 1349995 (0.0006) [2023-12-26 10:26:50,739][123091] Updated weights for policy 0, policy_version 1359397 (0.0011) [2023-12-26 10:26:50,747][123090] Updated weights for policy 1, policy_version 1350005 (0.0007) [2023-12-26 10:26:50,799][123091] Updated weights for policy 0, policy_version 1359407 (0.0011) [2023-12-26 10:26:50,806][123090] Updated weights for policy 1, policy_version 1350015 (0.0008) [2023-12-26 10:26:51,591][123091] Updated weights for policy 0, policy_version 1359417 (0.0006) [2023-12-26 10:26:51,659][123091] Updated weights for policy 0, policy_version 1359427 (0.0009) [2023-12-26 10:26:51,685][123090] Updated weights for policy 1, policy_version 1350025 (0.0009) [2023-12-26 10:26:51,711][123091] Updated weights for policy 0, policy_version 1359437 (0.0008) [2023-12-26 10:26:51,758][123090] Updated weights for policy 1, policy_version 1350035 (0.0009) [2023-12-26 10:26:51,827][123090] Updated weights for policy 1, policy_version 1350045 (0.0009) [2023-12-26 10:26:52,571][123091] Updated weights for policy 0, policy_version 1359447 (0.0009) [2023-12-26 10:26:52,614][123090] Updated weights for policy 1, policy_version 1350055 (0.0008) [2023-12-26 10:26:52,638][123091] Updated weights for policy 0, policy_version 1359457 (0.0009) [2023-12-26 10:26:52,675][123090] Updated weights for policy 1, policy_version 1350065 (0.0007) [2023-12-26 10:26:52,707][123091] Updated weights for policy 0, policy_version 1359467 (0.0011) [2023-12-26 10:26:52,737][123090] Updated weights for policy 1, policy_version 1350075 (0.0007) [2023-12-26 10:26:53,524][123091] Updated weights for policy 0, policy_version 1359477 (0.0008) [2023-12-26 10:26:53,576][123090] Updated weights for policy 1, policy_version 1350085 (0.0008) [2023-12-26 10:26:53,585][123091] Updated weights for policy 0, policy_version 1359487 (0.0010) [2023-12-26 10:26:53,635][123090] Updated weights for policy 1, policy_version 1350095 (0.0007) [2023-12-26 10:26:53,648][123091] Updated weights for policy 0, policy_version 1359497 (0.0011) [2023-12-26 10:26:53,689][123090] Updated weights for policy 1, policy_version 1350105 (0.0007) [2023-12-26 10:26:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 693665792. Throughput: 0: 9133.3, 1: 8906.6. Samples: 693637376. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:53,785][121949] Avg episode reward: [(0, '6231.600'), (1, '5682.900')] [2023-12-26 10:26:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001359504_348037120.pth... [2023-12-26 10:26:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001350112_345628672.pth... [2023-12-26 10:26:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001358448_347766784.pth [2023-12-26 10:26:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001349056_345358336.pth [2023-12-26 10:26:54,321][123091] Updated weights for policy 0, policy_version 1359507 (0.0009) [2023-12-26 10:26:54,393][123091] Updated weights for policy 0, policy_version 1359517 (0.0005) [2023-12-26 10:26:54,467][123091] Updated weights for policy 0, policy_version 1359527 (0.0005) [2023-12-26 10:26:54,569][123090] Updated weights for policy 1, policy_version 1350115 (0.0009) [2023-12-26 10:26:54,637][123090] Updated weights for policy 1, policy_version 1350125 (0.0009) [2023-12-26 10:26:54,705][123090] Updated weights for policy 1, policy_version 1350135 (0.0008) [2023-12-26 10:26:55,097][123091] Updated weights for policy 0, policy_version 1359537 (0.0006) [2023-12-26 10:26:55,155][123091] Updated weights for policy 0, policy_version 1359547 (0.0011) [2023-12-26 10:26:55,207][123091] Updated weights for policy 0, policy_version 1359557 (0.0011) [2023-12-26 10:26:55,255][123091] Updated weights for policy 0, policy_version 1359567 (0.0010) [2023-12-26 10:26:55,542][123090] Updated weights for policy 1, policy_version 1350145 (0.0009) [2023-12-26 10:26:55,586][123090] Updated weights for policy 1, policy_version 1350155 (0.0010) [2023-12-26 10:26:55,631][123090] Updated weights for policy 1, policy_version 1350165 (0.0010) [2023-12-26 10:26:55,683][123090] Updated weights for policy 1, policy_version 1350175 (0.0009) [2023-12-26 10:26:55,946][123091] Updated weights for policy 0, policy_version 1359577 (0.0011) [2023-12-26 10:26:56,002][123091] Updated weights for policy 0, policy_version 1359587 (0.0010) [2023-12-26 10:26:56,061][123091] Updated weights for policy 0, policy_version 1359597 (0.0011) [2023-12-26 10:26:56,431][123090] Updated weights for policy 1, policy_version 1350185 (0.0005) [2023-12-26 10:26:56,500][123090] Updated weights for policy 1, policy_version 1350195 (0.0010) [2023-12-26 10:26:56,578][123090] Updated weights for policy 1, policy_version 1350205 (0.0011) [2023-12-26 10:26:56,802][123091] Updated weights for policy 0, policy_version 1359607 (0.0007) [2023-12-26 10:26:56,865][123091] Updated weights for policy 0, policy_version 1359617 (0.0006) [2023-12-26 10:26:56,924][123091] Updated weights for policy 0, policy_version 1359627 (0.0006) [2023-12-26 10:26:57,292][123090] Updated weights for policy 1, policy_version 1350215 (0.0007) [2023-12-26 10:26:57,347][123090] Updated weights for policy 1, policy_version 1350225 (0.0006) [2023-12-26 10:26:57,394][123090] Updated weights for policy 1, policy_version 1350235 (0.0010) [2023-12-26 10:26:57,728][123091] Updated weights for policy 0, policy_version 1359637 (0.0005) [2023-12-26 10:26:57,799][123091] Updated weights for policy 0, policy_version 1359647 (0.0005) [2023-12-26 10:26:57,851][123091] Updated weights for policy 0, policy_version 1359657 (0.0005) [2023-12-26 10:26:58,130][123090] Updated weights for policy 1, policy_version 1350245 (0.0008) [2023-12-26 10:26:58,199][123090] Updated weights for policy 1, policy_version 1350255 (0.0010) [2023-12-26 10:26:58,271][123090] Updated weights for policy 1, policy_version 1350265 (0.0010) [2023-12-26 10:26:58,529][123091] Updated weights for policy 0, policy_version 1359667 (0.0006) [2023-12-26 10:26:58,597][123091] Updated weights for policy 0, policy_version 1359677 (0.0009) [2023-12-26 10:26:58,662][123091] Updated weights for policy 0, policy_version 1359687 (0.0007) [2023-12-26 10:26:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 693755904. Throughput: 0: 9156.9, 1: 8888.0. Samples: 693745564. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:26:58,785][121949] Avg episode reward: [(0, '6231.386'), (1, '5559.036')] [2023-12-26 10:26:59,133][123090] Updated weights for policy 1, policy_version 1350275 (0.0006) [2023-12-26 10:26:59,204][123090] Updated weights for policy 1, policy_version 1350285 (0.0006) [2023-12-26 10:26:59,288][123090] Updated weights for policy 1, policy_version 1350295 (0.0008) [2023-12-26 10:26:59,561][123091] Updated weights for policy 0, policy_version 1359697 (0.0010) [2023-12-26 10:26:59,618][123091] Updated weights for policy 0, policy_version 1359707 (0.0009) [2023-12-26 10:26:59,684][123091] Updated weights for policy 0, policy_version 1359717 (0.0010) [2023-12-26 10:26:59,742][123091] Updated weights for policy 0, policy_version 1359727 (0.0009) [2023-12-26 10:27:00,031][123090] Updated weights for policy 1, policy_version 1350305 (0.0009) [2023-12-26 10:27:00,099][123090] Updated weights for policy 1, policy_version 1350315 (0.0009) [2023-12-26 10:27:00,162][123090] Updated weights for policy 1, policy_version 1350325 (0.0006) [2023-12-26 10:27:00,230][123090] Updated weights for policy 1, policy_version 1350335 (0.0005) [2023-12-26 10:27:00,665][123091] Updated weights for policy 0, policy_version 1359737 (0.0009) [2023-12-26 10:27:00,729][123091] Updated weights for policy 0, policy_version 1359747 (0.0009) [2023-12-26 10:27:00,792][123091] Updated weights for policy 0, policy_version 1359757 (0.0009) [2023-12-26 10:27:00,925][123090] Updated weights for policy 1, policy_version 1350345 (0.0008) [2023-12-26 10:27:00,978][123090] Updated weights for policy 1, policy_version 1350355 (0.0006) [2023-12-26 10:27:01,029][123090] Updated weights for policy 1, policy_version 1350365 (0.0006) [2023-12-26 10:27:01,594][123091] Updated weights for policy 0, policy_version 1359767 (0.0008) [2023-12-26 10:27:01,672][123091] Updated weights for policy 0, policy_version 1359777 (0.0007) [2023-12-26 10:27:01,743][123091] Updated weights for policy 0, policy_version 1359787 (0.0008) [2023-12-26 10:27:01,838][123090] Updated weights for policy 1, policy_version 1350375 (0.0009) [2023-12-26 10:27:01,898][123090] Updated weights for policy 1, policy_version 1350385 (0.0009) [2023-12-26 10:27:01,949][123090] Updated weights for policy 1, policy_version 1350395 (0.0010) [2023-12-26 10:27:02,484][123091] Updated weights for policy 0, policy_version 1359797 (0.0008) [2023-12-26 10:27:02,549][123091] Updated weights for policy 0, policy_version 1359807 (0.0009) [2023-12-26 10:27:02,615][123091] Updated weights for policy 0, policy_version 1359817 (0.0011) [2023-12-26 10:27:02,811][123090] Updated weights for policy 1, policy_version 1350405 (0.0010) [2023-12-26 10:27:02,880][123090] Updated weights for policy 1, policy_version 1350415 (0.0009) [2023-12-26 10:27:02,936][123090] Updated weights for policy 1, policy_version 1350425 (0.0009) [2023-12-26 10:27:03,410][123091] Updated weights for policy 0, policy_version 1359827 (0.0010) [2023-12-26 10:27:03,467][123091] Updated weights for policy 0, policy_version 1359837 (0.0010) [2023-12-26 10:27:03,525][123091] Updated weights for policy 0, policy_version 1359847 (0.0010) [2023-12-26 10:27:03,663][123090] Updated weights for policy 1, policy_version 1350435 (0.0009) [2023-12-26 10:27:03,710][123090] Updated weights for policy 1, policy_version 1350445 (0.0010) [2023-12-26 10:27:03,757][123090] Updated weights for policy 1, policy_version 1350455 (0.0010) [2023-12-26 10:27:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 693837824. Throughput: 0: 9084.4, 1: 8848.7. Samples: 693850744. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:27:03,785][121949] Avg episode reward: [(0, '6308.100'), (1, '5602.444')] [2023-12-26 10:27:04,347][123091] Updated weights for policy 0, policy_version 1359857 (0.0010) [2023-12-26 10:27:04,418][123091] Updated weights for policy 0, policy_version 1359867 (0.0006) [2023-12-26 10:27:04,490][123091] Updated weights for policy 0, policy_version 1359877 (0.0005) [2023-12-26 10:27:04,535][123091] Updated weights for policy 0, policy_version 1359887 (0.0005) [2023-12-26 10:27:04,629][123090] Updated weights for policy 1, policy_version 1350465 (0.0010) [2023-12-26 10:27:04,689][123090] Updated weights for policy 1, policy_version 1350475 (0.0010) [2023-12-26 10:27:04,751][123090] Updated weights for policy 1, policy_version 1350485 (0.0010) [2023-12-26 10:27:04,808][123090] Updated weights for policy 1, policy_version 1350495 (0.0007) [2023-12-26 10:27:05,301][123091] Updated weights for policy 0, policy_version 1359897 (0.0009) [2023-12-26 10:27:05,360][123091] Updated weights for policy 0, policy_version 1359907 (0.0010) [2023-12-26 10:27:05,423][123091] Updated weights for policy 0, policy_version 1359917 (0.0011) [2023-12-26 10:27:05,605][123090] Updated weights for policy 1, policy_version 1350505 (0.0010) [2023-12-26 10:27:05,652][123090] Updated weights for policy 1, policy_version 1350515 (0.0010) [2023-12-26 10:27:05,699][123090] Updated weights for policy 1, policy_version 1350525 (0.0010) [2023-12-26 10:27:06,252][123091] Updated weights for policy 0, policy_version 1359927 (0.0010) [2023-12-26 10:27:06,318][123091] Updated weights for policy 0, policy_version 1359937 (0.0008) [2023-12-26 10:27:06,371][123091] Updated weights for policy 0, policy_version 1359947 (0.0011) [2023-12-26 10:27:06,474][123090] Updated weights for policy 1, policy_version 1350535 (0.0007) [2023-12-26 10:27:06,547][123090] Updated weights for policy 1, policy_version 1350545 (0.0007) [2023-12-26 10:27:06,605][123090] Updated weights for policy 1, policy_version 1350555 (0.0009) [2023-12-26 10:27:07,081][123091] Updated weights for policy 0, policy_version 1359957 (0.0008) [2023-12-26 10:27:07,141][123091] Updated weights for policy 0, policy_version 1359967 (0.0005) [2023-12-26 10:27:07,206][123091] Updated weights for policy 0, policy_version 1359977 (0.0007) [2023-12-26 10:27:07,470][123090] Updated weights for policy 1, policy_version 1350565 (0.0009) [2023-12-26 10:27:07,523][123090] Updated weights for policy 1, policy_version 1350575 (0.0010) [2023-12-26 10:27:07,580][123090] Updated weights for policy 1, policy_version 1350585 (0.0010) [2023-12-26 10:27:07,886][123091] Updated weights for policy 0, policy_version 1359987 (0.0009) [2023-12-26 10:27:07,948][123091] Updated weights for policy 0, policy_version 1359997 (0.0005) [2023-12-26 10:27:08,015][123091] Updated weights for policy 0, policy_version 1360007 (0.0007) [2023-12-26 10:27:08,487][123090] Updated weights for policy 1, policy_version 1350595 (0.0009) [2023-12-26 10:27:08,556][123090] Updated weights for policy 1, policy_version 1350605 (0.0009) [2023-12-26 10:27:08,619][123090] Updated weights for policy 1, policy_version 1350615 (0.0008) [2023-12-26 10:27:08,783][123091] Updated weights for policy 0, policy_version 1360017 (0.0009) [2023-12-26 10:27:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 693927936. Throughput: 0: 9057.4, 1: 8882.3. Samples: 693903452. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:27:08,785][121949] Avg episode reward: [(0, '6315.134'), (1, '5510.685')] [2023-12-26 10:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001350624_345759744.pth... [2023-12-26 10:27:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001349600_345497600.pth [2023-12-26 10:27:08,843][123091] Updated weights for policy 0, policy_version 1360027 (0.0009) [2023-12-26 10:27:08,900][123091] Updated weights for policy 0, policy_version 1360037 (0.0010) [2023-12-26 10:27:08,953][123091] Updated weights for policy 0, policy_version 1360047 (0.0010) [2023-12-26 10:27:08,960][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001360048_348176384.pth... [2023-12-26 10:27:08,964][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001358992_347906048.pth [2023-12-26 10:27:09,290][123090] Updated weights for policy 1, policy_version 1350625 (0.0007) [2023-12-26 10:27:09,359][123090] Updated weights for policy 1, policy_version 1350635 (0.0008) [2023-12-26 10:27:09,427][123090] Updated weights for policy 1, policy_version 1350645 (0.0008) [2023-12-26 10:27:09,498][123090] Updated weights for policy 1, policy_version 1350655 (0.0010) [2023-12-26 10:27:09,770][123091] Updated weights for policy 0, policy_version 1360057 (0.0009) [2023-12-26 10:27:09,837][123091] Updated weights for policy 0, policy_version 1360067 (0.0009) [2023-12-26 10:27:09,912][123091] Updated weights for policy 0, policy_version 1360077 (0.0010) [2023-12-26 10:27:10,321][123090] Updated weights for policy 1, policy_version 1350665 (0.0011) [2023-12-26 10:27:10,399][123090] Updated weights for policy 1, policy_version 1350675 (0.0011) [2023-12-26 10:27:10,468][123090] Updated weights for policy 1, policy_version 1350685 (0.0010) [2023-12-26 10:27:10,759][123091] Updated weights for policy 0, policy_version 1360087 (0.0008) [2023-12-26 10:27:10,829][123091] Updated weights for policy 0, policy_version 1360097 (0.0005) [2023-12-26 10:27:10,901][123091] Updated weights for policy 0, policy_version 1360107 (0.0005) [2023-12-26 10:27:11,197][123090] Updated weights for policy 1, policy_version 1350695 (0.0007) [2023-12-26 10:27:11,265][123090] Updated weights for policy 1, policy_version 1350705 (0.0007) [2023-12-26 10:27:11,332][123090] Updated weights for policy 1, policy_version 1350715 (0.0006) [2023-12-26 10:27:11,659][123091] Updated weights for policy 0, policy_version 1360117 (0.0008) [2023-12-26 10:27:11,723][123091] Updated weights for policy 0, policy_version 1360127 (0.0011) [2023-12-26 10:27:11,795][123091] Updated weights for policy 0, policy_version 1360137 (0.0009) [2023-12-26 10:27:12,184][123090] Updated weights for policy 1, policy_version 1350725 (0.0010) [2023-12-26 10:27:12,259][123090] Updated weights for policy 1, policy_version 1350735 (0.0010) [2023-12-26 10:27:12,332][123090] Updated weights for policy 1, policy_version 1350745 (0.0009) [2023-12-26 10:27:12,559][123091] Updated weights for policy 0, policy_version 1360147 (0.0007) [2023-12-26 10:27:12,626][123091] Updated weights for policy 0, policy_version 1360157 (0.0009) [2023-12-26 10:27:12,682][123091] Updated weights for policy 0, policy_version 1360167 (0.0011) [2023-12-26 10:27:13,151][123090] Updated weights for policy 1, policy_version 1350755 (0.0008) [2023-12-26 10:27:13,208][123090] Updated weights for policy 1, policy_version 1350765 (0.0009) [2023-12-26 10:27:13,273][123090] Updated weights for policy 1, policy_version 1350775 (0.0009) [2023-12-26 10:27:13,489][123091] Updated weights for policy 0, policy_version 1360177 (0.0010) [2023-12-26 10:27:13,555][123091] Updated weights for policy 0, policy_version 1360187 (0.0009) [2023-12-26 10:27:13,622][123091] Updated weights for policy 0, policy_version 1360197 (0.0009) [2023-12-26 10:27:13,691][123091] Updated weights for policy 0, policy_version 1360207 (0.0010) [2023-12-26 10:27:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 694018048. Throughput: 0: 9001.8, 1: 8912.3. Samples: 694009008. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:27:13,785][121949] Avg episode reward: [(0, '6321.316'), (1, '5513.409')] [2023-12-26 10:27:14,125][123090] Updated weights for policy 1, policy_version 1350785 (0.0009) [2023-12-26 10:27:14,173][123090] Updated weights for policy 1, policy_version 1350795 (0.0009) [2023-12-26 10:27:14,222][123090] Updated weights for policy 1, policy_version 1350805 (0.0009) [2023-12-26 10:27:14,270][123090] Updated weights for policy 1, policy_version 1350815 (0.0009) [2023-12-26 10:27:14,466][123091] Updated weights for policy 0, policy_version 1360217 (0.0009) [2023-12-26 10:27:14,533][123091] Updated weights for policy 0, policy_version 1360227 (0.0010) [2023-12-26 10:27:14,599][123091] Updated weights for policy 0, policy_version 1360237 (0.0009) [2023-12-26 10:27:15,060][123090] Updated weights for policy 1, policy_version 1350825 (0.0010) [2023-12-26 10:27:15,107][123090] Updated weights for policy 1, policy_version 1350835 (0.0009) [2023-12-26 10:27:15,178][123090] Updated weights for policy 1, policy_version 1350845 (0.0008) [2023-12-26 10:27:15,428][123091] Updated weights for policy 0, policy_version 1360247 (0.0009) [2023-12-26 10:27:15,489][123091] Updated weights for policy 0, policy_version 1360257 (0.0010) [2023-12-26 10:27:15,556][123091] Updated weights for policy 0, policy_version 1360268 (0.0010) [2023-12-26 10:27:15,936][123090] Updated weights for policy 1, policy_version 1350855 (0.0010) [2023-12-26 10:27:16,003][123090] Updated weights for policy 1, policy_version 1350865 (0.0009) [2023-12-26 10:27:16,067][123090] Updated weights for policy 1, policy_version 1350875 (0.0008) [2023-12-26 10:27:16,391][123091] Updated weights for policy 0, policy_version 1360278 (0.0010) [2023-12-26 10:27:16,438][123091] Updated weights for policy 0, policy_version 1360288 (0.0010) [2023-12-26 10:27:16,493][123091] Updated weights for policy 0, policy_version 1360298 (0.0010) [2023-12-26 10:27:16,865][123090] Updated weights for policy 1, policy_version 1350885 (0.0007) [2023-12-26 10:27:16,927][123090] Updated weights for policy 1, policy_version 1350895 (0.0006) [2023-12-26 10:27:16,988][123090] Updated weights for policy 1, policy_version 1350905 (0.0005) [2023-12-26 10:27:17,329][123091] Updated weights for policy 0, policy_version 1360308 (0.0010) [2023-12-26 10:27:17,380][123091] Updated weights for policy 0, policy_version 1360318 (0.0010) [2023-12-26 10:27:17,428][123091] Updated weights for policy 0, policy_version 1360328 (0.0010) [2023-12-26 10:27:17,679][123090] Updated weights for policy 1, policy_version 1350915 (0.0006) [2023-12-26 10:27:17,732][123090] Updated weights for policy 1, policy_version 1350925 (0.0009) [2023-12-26 10:27:17,780][123090] Updated weights for policy 1, policy_version 1350935 (0.0009) [2023-12-26 10:27:18,275][123091] Updated weights for policy 0, policy_version 1360338 (0.0011) [2023-12-26 10:27:18,348][123091] Updated weights for policy 0, policy_version 1360348 (0.0011) [2023-12-26 10:27:18,423][123091] Updated weights for policy 0, policy_version 1360358 (0.0011) [2023-12-26 10:27:18,482][123091] Updated weights for policy 0, policy_version 1360368 (0.0011) [2023-12-26 10:27:18,613][123090] Updated weights for policy 1, policy_version 1350945 (0.0008) [2023-12-26 10:27:18,678][123090] Updated weights for policy 1, policy_version 1350955 (0.0009) [2023-12-26 10:27:18,737][123090] Updated weights for policy 1, policy_version 1350965 (0.0009) [2023-12-26 10:27:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 694099968. Throughput: 0: 8904.2, 1: 8888.8. Samples: 694113740. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:27:18,784][121949] Avg episode reward: [(0, '6245.907'), (1, '5698.747')] [2023-12-26 10:27:18,797][123090] Updated weights for policy 1, policy_version 1350975 (0.0009) [2023-12-26 10:27:19,311][123091] Updated weights for policy 0, policy_version 1360378 (0.0011) [2023-12-26 10:27:19,381][123091] Updated weights for policy 0, policy_version 1360388 (0.0011) [2023-12-26 10:27:19,444][123091] Updated weights for policy 0, policy_version 1360398 (0.0007) [2023-12-26 10:27:19,679][123090] Updated weights for policy 1, policy_version 1350985 (0.0009) [2023-12-26 10:27:19,745][123090] Updated weights for policy 1, policy_version 1350995 (0.0009) [2023-12-26 10:27:19,809][123090] Updated weights for policy 1, policy_version 1351005 (0.0009) [2023-12-26 10:27:20,229][123091] Updated weights for policy 0, policy_version 1360408 (0.0006) [2023-12-26 10:27:20,283][123091] Updated weights for policy 0, policy_version 1360418 (0.0006) [2023-12-26 10:27:20,337][123091] Updated weights for policy 0, policy_version 1360428 (0.0005) [2023-12-26 10:27:20,715][123090] Updated weights for policy 1, policy_version 1351015 (0.0010) [2023-12-26 10:27:20,777][123090] Updated weights for policy 1, policy_version 1351025 (0.0009) [2023-12-26 10:27:20,846][123090] Updated weights for policy 1, policy_version 1351035 (0.0010) [2023-12-26 10:27:21,136][123091] Updated weights for policy 0, policy_version 1360438 (0.0009) [2023-12-26 10:27:21,204][123091] Updated weights for policy 0, policy_version 1360448 (0.0010) [2023-12-26 10:27:21,276][123091] Updated weights for policy 0, policy_version 1360458 (0.0010) [2023-12-26 10:27:21,746][123090] Updated weights for policy 1, policy_version 1351045 (0.0010) [2023-12-26 10:27:21,806][123090] Updated weights for policy 1, policy_version 1351055 (0.0010) [2023-12-26 10:27:21,862][123090] Updated weights for policy 1, policy_version 1351065 (0.0009) [2023-12-26 10:27:22,108][123091] Updated weights for policy 0, policy_version 1360468 (0.0008) [2023-12-26 10:27:22,163][123091] Updated weights for policy 0, policy_version 1360478 (0.0005) [2023-12-26 10:27:22,211][123091] Updated weights for policy 0, policy_version 1360488 (0.0006) [2023-12-26 10:27:22,745][123090] Updated weights for policy 1, policy_version 1351075 (0.0009) [2023-12-26 10:27:22,808][123090] Updated weights for policy 1, policy_version 1351085 (0.0010) [2023-12-26 10:27:22,867][123090] Updated weights for policy 1, policy_version 1351095 (0.0010) [2023-12-26 10:27:22,986][123091] Updated weights for policy 0, policy_version 1360498 (0.0007) [2023-12-26 10:27:23,046][123091] Updated weights for policy 0, policy_version 1360508 (0.0009) [2023-12-26 10:27:23,108][123091] Updated weights for policy 0, policy_version 1360518 (0.0009) [2023-12-26 10:27:23,178][123091] Updated weights for policy 0, policy_version 1360528 (0.0008) [2023-12-26 10:27:23,640][123090] Updated weights for policy 1, policy_version 1351105 (0.0010) [2023-12-26 10:27:23,697][123090] Updated weights for policy 1, policy_version 1351115 (0.0005) [2023-12-26 10:27:23,748][123090] Updated weights for policy 1, policy_version 1351125 (0.0005) [2023-12-26 10:27:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 694181888. Throughput: 0: 8837.9, 1: 8775.0. Samples: 694163056. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 10:27:23,785][121949] Avg episode reward: [(0, '6251.024'), (1, '5619.436')] [2023-12-26 10:27:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001360528_348299264.pth... [2023-12-26 10:27:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001359504_348037120.pth [2023-12-26 10:27:23,797][123090] Updated weights for policy 1, policy_version 1351135 (0.0005) [2023-12-26 10:27:23,802][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001351136_345890816.pth... [2023-12-26 10:27:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001350112_345628672.pth [2023-12-26 10:27:23,890][123091] Updated weights for policy 0, policy_version 1360538 (0.0005) [2023-12-26 10:27:23,952][123091] Updated weights for policy 0, policy_version 1360548 (0.0007) [2023-12-26 10:27:24,033][123091] Updated weights for policy 0, policy_version 1360558 (0.0005) [2023-12-26 10:27:24,437][123090] Updated weights for policy 1, policy_version 1351145 (0.0005) [2023-12-26 10:27:24,506][123090] Updated weights for policy 1, policy_version 1351155 (0.0007) [2023-12-26 10:27:24,563][123090] Updated weights for policy 1, policy_version 1351165 (0.0009) [2023-12-26 10:27:24,765][123091] Updated weights for policy 0, policy_version 1360568 (0.0010) [2023-12-26 10:27:24,823][123091] Updated weights for policy 0, policy_version 1360578 (0.0010) [2023-12-26 10:27:24,882][123091] Updated weights for policy 0, policy_version 1360588 (0.0010) [2023-12-26 10:27:25,400][123090] Updated weights for policy 1, policy_version 1351175 (0.0009) [2023-12-26 10:27:25,459][123090] Updated weights for policy 1, policy_version 1351185 (0.0008) [2023-12-26 10:27:25,523][123090] Updated weights for policy 1, policy_version 1351195 (0.0009) [2023-12-26 10:27:25,695][123091] Updated weights for policy 0, policy_version 1360598 (0.0011) [2023-12-26 10:27:25,758][123091] Updated weights for policy 0, policy_version 1360608 (0.0011) [2023-12-26 10:27:25,814][123091] Updated weights for policy 0, policy_version 1360618 (0.0010) [2023-12-26 10:27:26,238][123090] Updated weights for policy 1, policy_version 1351205 (0.0008) [2023-12-26 10:27:26,304][123090] Updated weights for policy 1, policy_version 1351215 (0.0009) [2023-12-26 10:27:26,369][123090] Updated weights for policy 1, policy_version 1351225 (0.0009) [2023-12-26 10:27:26,629][123091] Updated weights for policy 0, policy_version 1360628 (0.0010) [2023-12-26 10:27:26,689][123091] Updated weights for policy 0, policy_version 1360638 (0.0009) [2023-12-26 10:27:26,757][123091] Updated weights for policy 0, policy_version 1360648 (0.0009) [2023-12-26 10:27:27,209][123090] Updated weights for policy 1, policy_version 1351235 (0.0008) [2023-12-26 10:27:27,276][123090] Updated weights for policy 1, policy_version 1351245 (0.0005) [2023-12-26 10:27:27,330][123090] Updated weights for policy 1, policy_version 1351255 (0.0005) [2023-12-26 10:27:27,537][123091] Updated weights for policy 0, policy_version 1360658 (0.0008) [2023-12-26 10:27:27,610][123091] Updated weights for policy 0, policy_version 1360668 (0.0006) [2023-12-26 10:27:27,676][123091] Updated weights for policy 0, policy_version 1360678 (0.0010) [2023-12-26 10:27:27,726][123091] Updated weights for policy 0, policy_version 1360688 (0.0010) [2023-12-26 10:27:27,951][123090] Updated weights for policy 1, policy_version 1351265 (0.0006) [2023-12-26 10:27:28,001][123090] Updated weights for policy 1, policy_version 1351275 (0.0005) [2023-12-26 10:27:28,053][123090] Updated weights for policy 1, policy_version 1351285 (0.0005) [2023-12-26 10:27:28,101][123090] Updated weights for policy 1, policy_version 1351295 (0.0005) [2023-12-26 10:27:28,433][123091] Updated weights for policy 0, policy_version 1360698 (0.0010) [2023-12-26 10:27:28,492][123091] Updated weights for policy 0, policy_version 1360708 (0.0010) [2023-12-26 10:27:28,548][123091] Updated weights for policy 0, policy_version 1360718 (0.0005) [2023-12-26 10:27:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 694280192. Throughput: 0: 8906.4, 1: 8802.0. Samples: 694271580. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:28,785][121949] Avg episode reward: [(0, '6332.031'), (1, '5459.074')] [2023-12-26 10:27:28,820][123090] Updated weights for policy 1, policy_version 1351305 (0.0006) [2023-12-26 10:27:28,886][123090] Updated weights for policy 1, policy_version 1351315 (0.0008) [2023-12-26 10:27:28,943][123090] Updated weights for policy 1, policy_version 1351325 (0.0010) [2023-12-26 10:27:29,350][123091] Updated weights for policy 0, policy_version 1360728 (0.0009) [2023-12-26 10:27:29,420][123091] Updated weights for policy 0, policy_version 1360738 (0.0009) [2023-12-26 10:27:29,481][123091] Updated weights for policy 0, policy_version 1360748 (0.0010) [2023-12-26 10:27:29,799][123090] Updated weights for policy 1, policy_version 1351335 (0.0010) [2023-12-26 10:27:29,864][123090] Updated weights for policy 1, policy_version 1351345 (0.0009) [2023-12-26 10:27:29,920][123090] Updated weights for policy 1, policy_version 1351355 (0.0010) [2023-12-26 10:27:30,219][123091] Updated weights for policy 0, policy_version 1360758 (0.0007) [2023-12-26 10:27:30,272][123091] Updated weights for policy 0, policy_version 1360768 (0.0008) [2023-12-26 10:27:30,333][123091] Updated weights for policy 0, policy_version 1360778 (0.0009) [2023-12-26 10:27:30,688][123090] Updated weights for policy 1, policy_version 1351365 (0.0007) [2023-12-26 10:27:30,753][123090] Updated weights for policy 1, policy_version 1351375 (0.0006) [2023-12-26 10:27:30,815][123090] Updated weights for policy 1, policy_version 1351385 (0.0009) [2023-12-26 10:27:31,168][123091] Updated weights for policy 0, policy_version 1360788 (0.0008) [2023-12-26 10:27:31,220][123091] Updated weights for policy 0, policy_version 1360798 (0.0009) [2023-12-26 10:27:31,279][123091] Updated weights for policy 0, policy_version 1360808 (0.0009) [2023-12-26 10:27:31,588][123090] Updated weights for policy 1, policy_version 1351395 (0.0009) [2023-12-26 10:27:31,659][123090] Updated weights for policy 1, policy_version 1351405 (0.0006) [2023-12-26 10:27:31,727][123090] Updated weights for policy 1, policy_version 1351415 (0.0007) [2023-12-26 10:27:31,998][123091] Updated weights for policy 0, policy_version 1360818 (0.0007) [2023-12-26 10:27:32,051][123091] Updated weights for policy 0, policy_version 1360828 (0.0010) [2023-12-26 10:27:32,109][123091] Updated weights for policy 0, policy_version 1360838 (0.0010) [2023-12-26 10:27:32,157][123091] Updated weights for policy 0, policy_version 1360848 (0.0008) [2023-12-26 10:27:32,476][123090] Updated weights for policy 1, policy_version 1351425 (0.0008) [2023-12-26 10:27:32,543][123090] Updated weights for policy 1, policy_version 1351435 (0.0006) [2023-12-26 10:27:32,607][123090] Updated weights for policy 1, policy_version 1351445 (0.0005) [2023-12-26 10:27:32,673][123090] Updated weights for policy 1, policy_version 1351455 (0.0005) [2023-12-26 10:27:32,941][123091] Updated weights for policy 0, policy_version 1360858 (0.0009) [2023-12-26 10:27:32,994][123091] Updated weights for policy 0, policy_version 1360868 (0.0009) [2023-12-26 10:27:33,045][123091] Updated weights for policy 0, policy_version 1360878 (0.0009) [2023-12-26 10:27:33,359][123090] Updated weights for policy 1, policy_version 1351465 (0.0005) [2023-12-26 10:27:33,425][123090] Updated weights for policy 1, policy_version 1351475 (0.0005) [2023-12-26 10:27:33,487][123090] Updated weights for policy 1, policy_version 1351485 (0.0007) [2023-12-26 10:27:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 694370304. Throughput: 0: 8895.4, 1: 8801.6. Samples: 694381728. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:33,785][121949] Avg episode reward: [(0, '6394.065'), (1, '5593.552')] [2023-12-26 10:27:33,884][123091] Updated weights for policy 0, policy_version 1360888 (0.0007) [2023-12-26 10:27:33,957][123091] Updated weights for policy 0, policy_version 1360898 (0.0007) [2023-12-26 10:27:34,018][123091] Updated weights for policy 0, policy_version 1360908 (0.0007) [2023-12-26 10:27:34,261][123090] Updated weights for policy 1, policy_version 1351495 (0.0007) [2023-12-26 10:27:34,329][123090] Updated weights for policy 1, policy_version 1351505 (0.0006) [2023-12-26 10:27:34,409][123090] Updated weights for policy 1, policy_version 1351515 (0.0005) [2023-12-26 10:27:34,755][123091] Updated weights for policy 0, policy_version 1360918 (0.0005) [2023-12-26 10:27:34,818][123091] Updated weights for policy 0, policy_version 1360928 (0.0005) [2023-12-26 10:27:34,892][123091] Updated weights for policy 0, policy_version 1360938 (0.0009) [2023-12-26 10:27:35,091][123090] Updated weights for policy 1, policy_version 1351525 (0.0005) [2023-12-26 10:27:35,162][123090] Updated weights for policy 1, policy_version 1351535 (0.0006) [2023-12-26 10:27:35,225][123090] Updated weights for policy 1, policy_version 1351545 (0.0006) [2023-12-26 10:27:35,574][123091] Updated weights for policy 0, policy_version 1360948 (0.0009) [2023-12-26 10:27:35,641][123091] Updated weights for policy 0, policy_version 1360958 (0.0007) [2023-12-26 10:27:35,707][123091] Updated weights for policy 0, policy_version 1360968 (0.0011) [2023-12-26 10:27:35,831][123090] Updated weights for policy 1, policy_version 1351555 (0.0005) [2023-12-26 10:27:35,892][123090] Updated weights for policy 1, policy_version 1351565 (0.0006) [2023-12-26 10:27:35,954][123090] Updated weights for policy 1, policy_version 1351575 (0.0005) [2023-12-26 10:27:36,448][123091] Updated weights for policy 0, policy_version 1360978 (0.0010) [2023-12-26 10:27:36,523][123091] Updated weights for policy 0, policy_version 1360988 (0.0007) [2023-12-26 10:27:36,595][123091] Updated weights for policy 0, policy_version 1360998 (0.0006) [2023-12-26 10:27:36,652][123090] Updated weights for policy 1, policy_version 1351585 (0.0005) [2023-12-26 10:27:36,666][123091] Updated weights for policy 0, policy_version 1361008 (0.0007) [2023-12-26 10:27:36,728][123090] Updated weights for policy 1, policy_version 1351595 (0.0006) [2023-12-26 10:27:36,799][123090] Updated weights for policy 1, policy_version 1351605 (0.0006) [2023-12-26 10:27:36,874][123090] Updated weights for policy 1, policy_version 1351615 (0.0005) [2023-12-26 10:27:37,413][123091] Updated weights for policy 0, policy_version 1361018 (0.0010) [2023-12-26 10:27:37,469][123091] Updated weights for policy 0, policy_version 1361028 (0.0011) [2023-12-26 10:27:37,532][123091] Updated weights for policy 0, policy_version 1361038 (0.0011) [2023-12-26 10:27:37,608][123090] Updated weights for policy 1, policy_version 1351625 (0.0009) [2023-12-26 10:27:37,681][123090] Updated weights for policy 1, policy_version 1351635 (0.0007) [2023-12-26 10:27:37,748][123090] Updated weights for policy 1, policy_version 1351645 (0.0009) [2023-12-26 10:27:38,341][123091] Updated weights for policy 0, policy_version 1361048 (0.0009) [2023-12-26 10:27:38,416][123091] Updated weights for policy 0, policy_version 1361058 (0.0011) [2023-12-26 10:27:38,468][123091] Updated weights for policy 0, policy_version 1361068 (0.0011) [2023-12-26 10:27:38,483][123090] Updated weights for policy 1, policy_version 1351655 (0.0007) [2023-12-26 10:27:38,543][123090] Updated weights for policy 1, policy_version 1351665 (0.0008) [2023-12-26 10:27:38,612][123090] Updated weights for policy 1, policy_version 1351675 (0.0009) [2023-12-26 10:27:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 694468608. Throughput: 0: 8940.8, 1: 8918.2. Samples: 694441028. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:38,784][121949] Avg episode reward: [(0, '6281.059'), (1, '5565.349')] [2023-12-26 10:27:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001361072_348438528.pth... [2023-12-26 10:27:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001351680_346030080.pth... [2023-12-26 10:27:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001360048_348176384.pth [2023-12-26 10:27:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001350624_345759744.pth [2023-12-26 10:27:39,287][123091] Updated weights for policy 0, policy_version 1361078 (0.0011) [2023-12-26 10:27:39,355][123091] Updated weights for policy 0, policy_version 1361088 (0.0011) [2023-12-26 10:27:39,422][123091] Updated weights for policy 0, policy_version 1361098 (0.0010) [2023-12-26 10:27:39,458][123090] Updated weights for policy 1, policy_version 1351685 (0.0008) [2023-12-26 10:27:39,520][123090] Updated weights for policy 1, policy_version 1351695 (0.0009) [2023-12-26 10:27:39,584][123090] Updated weights for policy 1, policy_version 1351705 (0.0009) [2023-12-26 10:27:40,159][123091] Updated weights for policy 0, policy_version 1361108 (0.0008) [2023-12-26 10:27:40,220][123091] Updated weights for policy 0, policy_version 1361118 (0.0007) [2023-12-26 10:27:40,288][123091] Updated weights for policy 0, policy_version 1361128 (0.0008) [2023-12-26 10:27:40,496][123090] Updated weights for policy 1, policy_version 1351715 (0.0010) [2023-12-26 10:27:40,542][123090] Updated weights for policy 1, policy_version 1351725 (0.0008) [2023-12-26 10:27:40,604][123090] Updated weights for policy 1, policy_version 1351735 (0.0009) [2023-12-26 10:27:41,085][123091] Updated weights for policy 0, policy_version 1361138 (0.0007) [2023-12-26 10:27:41,155][123091] Updated weights for policy 0, policy_version 1361148 (0.0009) [2023-12-26 10:27:41,224][123091] Updated weights for policy 0, policy_version 1361158 (0.0008) [2023-12-26 10:27:41,283][123091] Updated weights for policy 0, policy_version 1361168 (0.0009) [2023-12-26 10:27:41,460][123090] Updated weights for policy 1, policy_version 1351745 (0.0009) [2023-12-26 10:27:41,521][123090] Updated weights for policy 1, policy_version 1351755 (0.0009) [2023-12-26 10:27:41,587][123090] Updated weights for policy 1, policy_version 1351765 (0.0009) [2023-12-26 10:27:41,656][123090] Updated weights for policy 1, policy_version 1351775 (0.0007) [2023-12-26 10:27:42,075][123091] Updated weights for policy 0, policy_version 1361178 (0.0009) [2023-12-26 10:27:42,138][123091] Updated weights for policy 0, policy_version 1361188 (0.0009) [2023-12-26 10:27:42,203][123091] Updated weights for policy 0, policy_version 1361198 (0.0010) [2023-12-26 10:27:42,553][123090] Updated weights for policy 1, policy_version 1351785 (0.0008) [2023-12-26 10:27:42,621][123090] Updated weights for policy 1, policy_version 1351795 (0.0010) [2023-12-26 10:27:42,682][123090] Updated weights for policy 1, policy_version 1351805 (0.0010) [2023-12-26 10:27:42,974][123091] Updated weights for policy 0, policy_version 1361208 (0.0006) [2023-12-26 10:27:43,030][123091] Updated weights for policy 0, policy_version 1361218 (0.0005) [2023-12-26 10:27:43,089][123091] Updated weights for policy 0, policy_version 1361228 (0.0005) [2023-12-26 10:27:43,587][123090] Updated weights for policy 1, policy_version 1351815 (0.0010) [2023-12-26 10:27:43,634][123090] Updated weights for policy 1, policy_version 1351825 (0.0009) [2023-12-26 10:27:43,691][123090] Updated weights for policy 1, policy_version 1351835 (0.0009) [2023-12-26 10:27:43,708][123091] Updated weights for policy 0, policy_version 1361238 (0.0007) [2023-12-26 10:27:43,754][123091] Updated weights for policy 0, policy_version 1361248 (0.0006) [2023-12-26 10:27:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 694550528. Throughput: 0: 8870.0, 1: 8868.4. Samples: 694543792. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:43,785][121949] Avg episode reward: [(0, '6216.565'), (1, '5568.310')] [2023-12-26 10:27:43,808][123091] Updated weights for policy 0, policy_version 1361258 (0.0005) [2023-12-26 10:27:44,562][123090] Updated weights for policy 1, policy_version 1351845 (0.0010) [2023-12-26 10:27:44,605][123091] Updated weights for policy 0, policy_version 1361268 (0.0005) [2023-12-26 10:27:44,625][123090] Updated weights for policy 1, policy_version 1351855 (0.0009) [2023-12-26 10:27:44,657][123091] Updated weights for policy 0, policy_version 1361278 (0.0005) [2023-12-26 10:27:44,678][123090] Updated weights for policy 1, policy_version 1351865 (0.0008) [2023-12-26 10:27:44,719][123091] Updated weights for policy 0, policy_version 1361288 (0.0005) [2023-12-26 10:27:45,469][123091] Updated weights for policy 0, policy_version 1361298 (0.0005) [2023-12-26 10:27:45,528][123091] Updated weights for policy 0, policy_version 1361308 (0.0006) [2023-12-26 10:27:45,575][123090] Updated weights for policy 1, policy_version 1351875 (0.0009) [2023-12-26 10:27:45,590][123091] Updated weights for policy 0, policy_version 1361318 (0.0006) [2023-12-26 10:27:45,639][123090] Updated weights for policy 1, policy_version 1351885 (0.0009) [2023-12-26 10:27:45,658][123091] Updated weights for policy 0, policy_version 1361328 (0.0005) [2023-12-26 10:27:45,710][123090] Updated weights for policy 1, policy_version 1351895 (0.0010) [2023-12-26 10:27:46,324][123091] Updated weights for policy 0, policy_version 1361338 (0.0005) [2023-12-26 10:27:46,393][123091] Updated weights for policy 0, policy_version 1361348 (0.0005) [2023-12-26 10:27:46,464][123091] Updated weights for policy 0, policy_version 1361358 (0.0005) [2023-12-26 10:27:46,615][123090] Updated weights for policy 1, policy_version 1351905 (0.0010) [2023-12-26 10:27:46,664][123090] Updated weights for policy 1, policy_version 1351915 (0.0009) [2023-12-26 10:27:46,720][123090] Updated weights for policy 1, policy_version 1351925 (0.0006) [2023-12-26 10:27:46,776][123090] Updated weights for policy 1, policy_version 1351935 (0.0005) [2023-12-26 10:27:47,081][123091] Updated weights for policy 0, policy_version 1361368 (0.0009) [2023-12-26 10:27:47,134][123091] Updated weights for policy 0, policy_version 1361378 (0.0011) [2023-12-26 10:27:47,194][123091] Updated weights for policy 0, policy_version 1361388 (0.0011) [2023-12-26 10:27:47,476][123090] Updated weights for policy 1, policy_version 1351945 (0.0008) [2023-12-26 10:27:47,539][123090] Updated weights for policy 1, policy_version 1351955 (0.0009) [2023-12-26 10:27:47,598][123090] Updated weights for policy 1, policy_version 1351965 (0.0009) [2023-12-26 10:27:48,021][123091] Updated weights for policy 0, policy_version 1361398 (0.0011) [2023-12-26 10:27:48,080][123091] Updated weights for policy 0, policy_version 1361408 (0.0011) [2023-12-26 10:27:48,132][123091] Updated weights for policy 0, policy_version 1361418 (0.0011) [2023-12-26 10:27:48,394][123090] Updated weights for policy 1, policy_version 1351975 (0.0009) [2023-12-26 10:27:48,452][123090] Updated weights for policy 1, policy_version 1351985 (0.0010) [2023-12-26 10:27:48,519][123090] Updated weights for policy 1, policy_version 1351995 (0.0009) [2023-12-26 10:27:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 694640640. Throughput: 0: 9024.0, 1: 8787.8. Samples: 694652276. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:48,785][121949] Avg episode reward: [(0, '6264.186'), (1, '5778.534')] [2023-12-26 10:27:48,882][123091] Updated weights for policy 0, policy_version 1361428 (0.0008) [2023-12-26 10:27:48,943][123091] Updated weights for policy 0, policy_version 1361438 (0.0008) [2023-12-26 10:27:48,997][123091] Updated weights for policy 0, policy_version 1361448 (0.0009) [2023-12-26 10:27:49,418][123090] Updated weights for policy 1, policy_version 1352005 (0.0009) [2023-12-26 10:27:49,471][123090] Updated weights for policy 1, policy_version 1352015 (0.0009) [2023-12-26 10:27:49,531][123090] Updated weights for policy 1, policy_version 1352025 (0.0010) [2023-12-26 10:27:49,828][123091] Updated weights for policy 0, policy_version 1361458 (0.0009) [2023-12-26 10:27:49,899][123091] Updated weights for policy 0, policy_version 1361468 (0.0007) [2023-12-26 10:27:49,972][123091] Updated weights for policy 0, policy_version 1361478 (0.0008) [2023-12-26 10:27:50,030][123091] Updated weights for policy 0, policy_version 1361488 (0.0006) [2023-12-26 10:27:50,382][123090] Updated weights for policy 1, policy_version 1352035 (0.0009) [2023-12-26 10:27:50,455][123090] Updated weights for policy 1, policy_version 1352045 (0.0009) [2023-12-26 10:27:50,530][123090] Updated weights for policy 1, policy_version 1352055 (0.0011) [2023-12-26 10:27:50,743][123091] Updated weights for policy 0, policy_version 1361498 (0.0011) [2023-12-26 10:27:50,807][123091] Updated weights for policy 0, policy_version 1361508 (0.0011) [2023-12-26 10:27:50,870][123091] Updated weights for policy 0, policy_version 1361518 (0.0007) [2023-12-26 10:27:51,302][123090] Updated weights for policy 1, policy_version 1352065 (0.0011) [2023-12-26 10:27:51,371][123090] Updated weights for policy 1, policy_version 1352075 (0.0010) [2023-12-26 10:27:51,442][123090] Updated weights for policy 1, policy_version 1352085 (0.0010) [2023-12-26 10:27:51,493][123090] Updated weights for policy 1, policy_version 1352095 (0.0008) [2023-12-26 10:27:51,645][123091] Updated weights for policy 0, policy_version 1361528 (0.0008) [2023-12-26 10:27:51,713][123091] Updated weights for policy 0, policy_version 1361538 (0.0008) [2023-12-26 10:27:51,784][123091] Updated weights for policy 0, policy_version 1361548 (0.0006) [2023-12-26 10:27:52,298][123090] Updated weights for policy 1, policy_version 1352105 (0.0008) [2023-12-26 10:27:52,369][123090] Updated weights for policy 1, policy_version 1352115 (0.0007) [2023-12-26 10:27:52,435][123090] Updated weights for policy 1, policy_version 1352125 (0.0009) [2023-12-26 10:27:52,585][123091] Updated weights for policy 0, policy_version 1361558 (0.0006) [2023-12-26 10:27:52,653][123091] Updated weights for policy 0, policy_version 1361568 (0.0006) [2023-12-26 10:27:52,714][123091] Updated weights for policy 0, policy_version 1361578 (0.0006) [2023-12-26 10:27:53,291][123091] Updated weights for policy 0, policy_version 1361588 (0.0005) [2023-12-26 10:27:53,323][123090] Updated weights for policy 1, policy_version 1352135 (0.0009) [2023-12-26 10:27:53,348][123091] Updated weights for policy 0, policy_version 1361598 (0.0005) [2023-12-26 10:27:53,378][123090] Updated weights for policy 1, policy_version 1352145 (0.0009) [2023-12-26 10:27:53,400][123091] Updated weights for policy 0, policy_version 1361608 (0.0005) [2023-12-26 10:27:53,432][123090] Updated weights for policy 1, policy_version 1352155 (0.0009) [2023-12-26 10:27:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 694730752. Throughput: 0: 9039.5, 1: 8757.1. Samples: 694704304. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:53,785][121949] Avg episode reward: [(0, '6247.512'), (1, '5798.705')] [2023-12-26 10:27:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001352160_346152960.pth... [2023-12-26 10:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001361616_348577792.pth... [2023-12-26 10:27:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001351136_345890816.pth [2023-12-26 10:27:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001360528_348299264.pth [2023-12-26 10:27:54,043][123091] Updated weights for policy 0, policy_version 1361618 (0.0005) [2023-12-26 10:27:54,111][123091] Updated weights for policy 0, policy_version 1361628 (0.0006) [2023-12-26 10:27:54,169][123091] Updated weights for policy 0, policy_version 1361638 (0.0007) [2023-12-26 10:27:54,227][123091] Updated weights for policy 0, policy_version 1361648 (0.0010) [2023-12-26 10:27:54,353][123090] Updated weights for policy 1, policy_version 1352165 (0.0010) [2023-12-26 10:27:54,423][123090] Updated weights for policy 1, policy_version 1352175 (0.0006) [2023-12-26 10:27:54,489][123090] Updated weights for policy 1, policy_version 1352185 (0.0008) [2023-12-26 10:27:54,950][123091] Updated weights for policy 0, policy_version 1361658 (0.0007) [2023-12-26 10:27:55,001][123091] Updated weights for policy 0, policy_version 1361668 (0.0007) [2023-12-26 10:27:55,065][123091] Updated weights for policy 0, policy_version 1361678 (0.0006) [2023-12-26 10:27:55,213][123090] Updated weights for policy 1, policy_version 1352195 (0.0008) [2023-12-26 10:27:55,261][123090] Updated weights for policy 1, policy_version 1352205 (0.0005) [2023-12-26 10:27:55,319][123090] Updated weights for policy 1, policy_version 1352215 (0.0005) [2023-12-26 10:27:55,742][123091] Updated weights for policy 0, policy_version 1361688 (0.0005) [2023-12-26 10:27:55,788][123091] Updated weights for policy 0, policy_version 1361698 (0.0005) [2023-12-26 10:27:55,846][123091] Updated weights for policy 0, policy_version 1361708 (0.0005) [2023-12-26 10:27:55,901][123090] Updated weights for policy 1, policy_version 1352225 (0.0005) [2023-12-26 10:27:55,952][123090] Updated weights for policy 1, policy_version 1352235 (0.0005) [2023-12-26 10:27:56,003][123090] Updated weights for policy 1, policy_version 1352245 (0.0005) [2023-12-26 10:27:56,053][123090] Updated weights for policy 1, policy_version 1352255 (0.0006) [2023-12-26 10:27:56,502][123091] Updated weights for policy 0, policy_version 1361718 (0.0005) [2023-12-26 10:27:56,548][123091] Updated weights for policy 0, policy_version 1361728 (0.0005) [2023-12-26 10:27:56,595][123091] Updated weights for policy 0, policy_version 1361738 (0.0005) [2023-12-26 10:27:56,890][123090] Updated weights for policy 1, policy_version 1352265 (0.0009) [2023-12-26 10:27:56,942][123090] Updated weights for policy 1, policy_version 1352275 (0.0008) [2023-12-26 10:27:57,001][123090] Updated weights for policy 1, policy_version 1352285 (0.0008) [2023-12-26 10:27:57,320][123091] Updated weights for policy 0, policy_version 1361748 (0.0005) [2023-12-26 10:27:57,380][123091] Updated weights for policy 0, policy_version 1361758 (0.0006) [2023-12-26 10:27:57,436][123091] Updated weights for policy 0, policy_version 1361768 (0.0005) [2023-12-26 10:27:57,915][123090] Updated weights for policy 1, policy_version 1352295 (0.0009) [2023-12-26 10:27:57,972][123090] Updated weights for policy 1, policy_version 1352306 (0.0010) [2023-12-26 10:27:58,026][123090] Updated weights for policy 1, policy_version 1352316 (0.0009) [2023-12-26 10:27:58,143][123091] Updated weights for policy 0, policy_version 1361778 (0.0006) [2023-12-26 10:27:58,207][123091] Updated weights for policy 0, policy_version 1361788 (0.0011) [2023-12-26 10:27:58,280][123091] Updated weights for policy 0, policy_version 1361798 (0.0008) [2023-12-26 10:27:58,356][123091] Updated weights for policy 0, policy_version 1361808 (0.0007) [2023-12-26 10:27:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 694820864. Throughput: 0: 9152.7, 1: 8789.6. Samples: 694816412. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:27:58,785][121949] Avg episode reward: [(0, '6263.074'), (1, '5798.756')] [2023-12-26 10:27:59,040][123090] Updated weights for policy 1, policy_version 1352326 (0.0009) [2023-12-26 10:27:59,102][123090] Updated weights for policy 1, policy_version 1352336 (0.0010) [2023-12-26 10:27:59,160][123090] Updated weights for policy 1, policy_version 1352346 (0.0009) [2023-12-26 10:27:59,180][123091] Updated weights for policy 0, policy_version 1361818 (0.0006) [2023-12-26 10:27:59,251][123091] Updated weights for policy 0, policy_version 1361828 (0.0008) [2023-12-26 10:27:59,310][123091] Updated weights for policy 0, policy_version 1361838 (0.0011) [2023-12-26 10:27:59,980][123090] Updated weights for policy 1, policy_version 1352356 (0.0009) [2023-12-26 10:28:00,032][123090] Updated weights for policy 1, policy_version 1352366 (0.0007) [2023-12-26 10:28:00,085][123090] Updated weights for policy 1, policy_version 1352376 (0.0006) [2023-12-26 10:28:00,093][123091] Updated weights for policy 0, policy_version 1361848 (0.0009) [2023-12-26 10:28:00,151][123091] Updated weights for policy 0, policy_version 1361858 (0.0009) [2023-12-26 10:28:00,202][123091] Updated weights for policy 0, policy_version 1361868 (0.0006) [2023-12-26 10:28:00,904][123090] Updated weights for policy 1, policy_version 1352386 (0.0005) [2023-12-26 10:28:00,957][123090] Updated weights for policy 1, policy_version 1352396 (0.0005) [2023-12-26 10:28:00,997][123091] Updated weights for policy 0, policy_version 1361878 (0.0007) [2023-12-26 10:28:01,011][123090] Updated weights for policy 1, policy_version 1352406 (0.0005) [2023-12-26 10:28:01,054][123091] Updated weights for policy 0, policy_version 1361888 (0.0008) [2023-12-26 10:28:01,080][123090] Updated weights for policy 1, policy_version 1352416 (0.0007) [2023-12-26 10:28:01,117][123091] Updated weights for policy 0, policy_version 1361898 (0.0009) [2023-12-26 10:28:01,805][123090] Updated weights for policy 1, policy_version 1352426 (0.0010) [2023-12-26 10:28:01,867][123090] Updated weights for policy 1, policy_version 1352436 (0.0009) [2023-12-26 10:28:01,919][123090] Updated weights for policy 1, policy_version 1352446 (0.0010) [2023-12-26 10:28:02,003][123091] Updated weights for policy 0, policy_version 1361908 (0.0009) [2023-12-26 10:28:02,063][123091] Updated weights for policy 0, policy_version 1361918 (0.0008) [2023-12-26 10:28:02,115][123091] Updated weights for policy 0, policy_version 1361928 (0.0009) [2023-12-26 10:28:02,636][123090] Updated weights for policy 1, policy_version 1352456 (0.0006) [2023-12-26 10:28:02,687][123090] Updated weights for policy 1, policy_version 1352466 (0.0009) [2023-12-26 10:28:02,738][123090] Updated weights for policy 1, policy_version 1352476 (0.0010) [2023-12-26 10:28:02,980][123091] Updated weights for policy 0, policy_version 1361938 (0.0009) [2023-12-26 10:28:03,032][123091] Updated weights for policy 0, policy_version 1361948 (0.0010) [2023-12-26 10:28:03,085][123091] Updated weights for policy 0, policy_version 1361958 (0.0010) [2023-12-26 10:28:03,425][123090] Updated weights for policy 1, policy_version 1352486 (0.0010) [2023-12-26 10:28:03,485][123090] Updated weights for policy 1, policy_version 1352496 (0.0007) [2023-12-26 10:28:03,540][123090] Updated weights for policy 1, policy_version 1352506 (0.0005) [2023-12-26 10:28:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 694910976. Throughput: 0: 9164.5, 1: 8770.2. Samples: 694920804. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:03,785][121949] Avg episode reward: [(0, '6115.163'), (1, '5777.500')] [2023-12-26 10:28:03,915][123091] Updated weights for policy 0, policy_version 1361969 (0.0009) [2023-12-26 10:28:03,979][123091] Updated weights for policy 0, policy_version 1361979 (0.0006) [2023-12-26 10:28:04,050][123091] Updated weights for policy 0, policy_version 1361989 (0.0006) [2023-12-26 10:28:04,123][123091] Updated weights for policy 0, policy_version 1361999 (0.0006) [2023-12-26 10:28:04,328][123090] Updated weights for policy 1, policy_version 1352516 (0.0006) [2023-12-26 10:28:04,398][123090] Updated weights for policy 1, policy_version 1352526 (0.0008) [2023-12-26 10:28:04,469][123090] Updated weights for policy 1, policy_version 1352536 (0.0011) [2023-12-26 10:28:04,873][123091] Updated weights for policy 0, policy_version 1362009 (0.0009) [2023-12-26 10:28:04,925][123091] Updated weights for policy 0, policy_version 1362019 (0.0009) [2023-12-26 10:28:04,981][123091] Updated weights for policy 0, policy_version 1362029 (0.0010) [2023-12-26 10:28:05,265][123090] Updated weights for policy 1, policy_version 1352546 (0.0010) [2023-12-26 10:28:05,322][123090] Updated weights for policy 1, policy_version 1352556 (0.0009) [2023-12-26 10:28:05,378][123090] Updated weights for policy 1, policy_version 1352566 (0.0005) [2023-12-26 10:28:05,433][123090] Updated weights for policy 1, policy_version 1352576 (0.0005) [2023-12-26 10:28:05,787][123091] Updated weights for policy 0, policy_version 1362039 (0.0011) [2023-12-26 10:28:05,854][123091] Updated weights for policy 0, policy_version 1362049 (0.0010) [2023-12-26 10:28:05,924][123091] Updated weights for policy 0, policy_version 1362059 (0.0006) [2023-12-26 10:28:06,156][123090] Updated weights for policy 1, policy_version 1352586 (0.0006) [2023-12-26 10:28:06,205][123090] Updated weights for policy 1, policy_version 1352596 (0.0008) [2023-12-26 10:28:06,266][123090] Updated weights for policy 1, policy_version 1352606 (0.0006) [2023-12-26 10:28:06,669][123091] Updated weights for policy 0, policy_version 1362069 (0.0008) [2023-12-26 10:28:06,736][123091] Updated weights for policy 0, policy_version 1362079 (0.0010) [2023-12-26 10:28:06,798][123091] Updated weights for policy 0, policy_version 1362089 (0.0009) [2023-12-26 10:28:07,025][123090] Updated weights for policy 1, policy_version 1352616 (0.0005) [2023-12-26 10:28:07,082][123090] Updated weights for policy 1, policy_version 1352626 (0.0006) [2023-12-26 10:28:07,130][123090] Updated weights for policy 1, policy_version 1352636 (0.0006) [2023-12-26 10:28:07,559][123091] Updated weights for policy 0, policy_version 1362099 (0.0009) [2023-12-26 10:28:07,628][123091] Updated weights for policy 0, policy_version 1362109 (0.0005) [2023-12-26 10:28:07,693][123091] Updated weights for policy 0, policy_version 1362119 (0.0006) [2023-12-26 10:28:07,897][123090] Updated weights for policy 1, policy_version 1352646 (0.0008) [2023-12-26 10:28:07,947][123090] Updated weights for policy 1, policy_version 1352656 (0.0009) [2023-12-26 10:28:08,000][123090] Updated weights for policy 1, policy_version 1352666 (0.0009) [2023-12-26 10:28:08,421][123091] Updated weights for policy 0, policy_version 1362129 (0.0006) [2023-12-26 10:28:08,491][123091] Updated weights for policy 0, policy_version 1362139 (0.0010) [2023-12-26 10:28:08,559][123091] Updated weights for policy 0, policy_version 1362149 (0.0010) [2023-12-26 10:28:08,625][123091] Updated weights for policy 0, policy_version 1362159 (0.0009) [2023-12-26 10:28:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 695001088. Throughput: 0: 9200.8, 1: 8870.6. Samples: 694976268. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:08,785][121949] Avg episode reward: [(0, '6167.286'), (1, '5811.197')] [2023-12-26 10:28:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001362160_348717056.pth... [2023-12-26 10:28:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001361072_348438528.pth [2023-12-26 10:28:08,819][123090] Updated weights for policy 1, policy_version 1352676 (0.0008) [2023-12-26 10:28:08,882][123090] Updated weights for policy 1, policy_version 1352686 (0.0007) [2023-12-26 10:28:08,944][123090] Updated weights for policy 1, policy_version 1352696 (0.0009) [2023-12-26 10:28:08,994][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001352704_346292224.pth... [2023-12-26 10:28:09,000][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001351680_346030080.pth [2023-12-26 10:28:09,499][123091] Updated weights for policy 0, policy_version 1362169 (0.0010) [2023-12-26 10:28:09,568][123091] Updated weights for policy 0, policy_version 1362179 (0.0010) [2023-12-26 10:28:09,634][123091] Updated weights for policy 0, policy_version 1362189 (0.0009) [2023-12-26 10:28:09,703][123090] Updated weights for policy 1, policy_version 1352706 (0.0010) [2023-12-26 10:28:09,765][123090] Updated weights for policy 1, policy_version 1352716 (0.0010) [2023-12-26 10:28:09,829][123090] Updated weights for policy 1, policy_version 1352726 (0.0009) [2023-12-26 10:28:09,897][123090] Updated weights for policy 1, policy_version 1352736 (0.0006) [2023-12-26 10:28:10,490][123091] Updated weights for policy 0, policy_version 1362199 (0.0007) [2023-12-26 10:28:10,553][123091] Updated weights for policy 0, policy_version 1362209 (0.0005) [2023-12-26 10:28:10,613][123091] Updated weights for policy 0, policy_version 1362219 (0.0008) [2023-12-26 10:28:10,700][123090] Updated weights for policy 1, policy_version 1352746 (0.0008) [2023-12-26 10:28:10,762][123090] Updated weights for policy 1, policy_version 1352756 (0.0010) [2023-12-26 10:28:10,828][123090] Updated weights for policy 1, policy_version 1352766 (0.0009) [2023-12-26 10:28:11,394][123091] Updated weights for policy 0, policy_version 1362229 (0.0010) [2023-12-26 10:28:11,467][123091] Updated weights for policy 0, policy_version 1362239 (0.0009) [2023-12-26 10:28:11,533][123091] Updated weights for policy 0, policy_version 1362249 (0.0010) [2023-12-26 10:28:11,691][123090] Updated weights for policy 1, policy_version 1352776 (0.0009) [2023-12-26 10:28:11,765][123090] Updated weights for policy 1, policy_version 1352786 (0.0010) [2023-12-26 10:28:11,827][123090] Updated weights for policy 1, policy_version 1352796 (0.0009) [2023-12-26 10:28:12,368][123091] Updated weights for policy 0, policy_version 1362259 (0.0008) [2023-12-26 10:28:12,421][123091] Updated weights for policy 0, policy_version 1362269 (0.0009) [2023-12-26 10:28:12,474][123091] Updated weights for policy 0, policy_version 1362279 (0.0008) [2023-12-26 10:28:12,679][123090] Updated weights for policy 1, policy_version 1352806 (0.0010) [2023-12-26 10:28:12,735][123090] Updated weights for policy 1, policy_version 1352816 (0.0008) [2023-12-26 10:28:12,791][123090] Updated weights for policy 1, policy_version 1352826 (0.0005) [2023-12-26 10:28:13,280][123091] Updated weights for policy 0, policy_version 1362289 (0.0008) [2023-12-26 10:28:13,344][123091] Updated weights for policy 0, policy_version 1362299 (0.0010) [2023-12-26 10:28:13,395][123091] Updated weights for policy 0, policy_version 1362309 (0.0010) [2023-12-26 10:28:13,456][123091] Updated weights for policy 0, policy_version 1362319 (0.0009) [2023-12-26 10:28:13,506][123090] Updated weights for policy 1, policy_version 1352836 (0.0006) [2023-12-26 10:28:13,563][123090] Updated weights for policy 1, policy_version 1352846 (0.0006) [2023-12-26 10:28:13,620][123090] Updated weights for policy 1, policy_version 1352856 (0.0006) [2023-12-26 10:28:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 695091200. Throughput: 0: 9124.7, 1: 8826.4. Samples: 695079384. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:13,785][121949] Avg episode reward: [(0, '6243.376'), (1, '5813.364')] [2023-12-26 10:28:14,194][123091] Updated weights for policy 0, policy_version 1362329 (0.0006) [2023-12-26 10:28:14,267][123091] Updated weights for policy 0, policy_version 1362339 (0.0006) [2023-12-26 10:28:14,333][123091] Updated weights for policy 0, policy_version 1362349 (0.0008) [2023-12-26 10:28:14,436][123090] Updated weights for policy 1, policy_version 1352866 (0.0008) [2023-12-26 10:28:14,494][123090] Updated weights for policy 1, policy_version 1352876 (0.0010) [2023-12-26 10:28:14,548][123090] Updated weights for policy 1, policy_version 1352886 (0.0010) [2023-12-26 10:28:14,602][123090] Updated weights for policy 1, policy_version 1352896 (0.0010) [2023-12-26 10:28:15,012][123091] Updated weights for policy 0, policy_version 1362359 (0.0008) [2023-12-26 10:28:15,080][123091] Updated weights for policy 0, policy_version 1362369 (0.0008) [2023-12-26 10:28:15,154][123091] Updated weights for policy 0, policy_version 1362379 (0.0007) [2023-12-26 10:28:15,538][123090] Updated weights for policy 1, policy_version 1352906 (0.0009) [2023-12-26 10:28:15,610][123090] Updated weights for policy 1, policy_version 1352916 (0.0009) [2023-12-26 10:28:15,674][123090] Updated weights for policy 1, policy_version 1352926 (0.0008) [2023-12-26 10:28:15,940][123091] Updated weights for policy 0, policy_version 1362389 (0.0010) [2023-12-26 10:28:15,998][123091] Updated weights for policy 0, policy_version 1362399 (0.0010) [2023-12-26 10:28:16,052][123091] Updated weights for policy 0, policy_version 1362409 (0.0010) [2023-12-26 10:28:16,495][123090] Updated weights for policy 1, policy_version 1352936 (0.0010) [2023-12-26 10:28:16,560][123090] Updated weights for policy 1, policy_version 1352946 (0.0008) [2023-12-26 10:28:16,623][123090] Updated weights for policy 1, policy_version 1352956 (0.0008) [2023-12-26 10:28:16,826][123091] Updated weights for policy 0, policy_version 1362419 (0.0009) [2023-12-26 10:28:16,887][123091] Updated weights for policy 0, policy_version 1362429 (0.0005) [2023-12-26 10:28:16,941][123091] Updated weights for policy 0, policy_version 1362439 (0.0005) [2023-12-26 10:28:17,520][123090] Updated weights for policy 1, policy_version 1352966 (0.0009) [2023-12-26 10:28:17,578][123090] Updated weights for policy 1, policy_version 1352976 (0.0008) [2023-12-26 10:28:17,587][123091] Updated weights for policy 0, policy_version 1362449 (0.0005) [2023-12-26 10:28:17,633][123090] Updated weights for policy 1, policy_version 1352986 (0.0009) [2023-12-26 10:28:17,639][123091] Updated weights for policy 0, policy_version 1362459 (0.0007) [2023-12-26 10:28:17,693][123091] Updated weights for policy 0, policy_version 1362469 (0.0006) [2023-12-26 10:28:17,745][123091] Updated weights for policy 0, policy_version 1362479 (0.0005) [2023-12-26 10:28:18,494][123090] Updated weights for policy 1, policy_version 1352996 (0.0009) [2023-12-26 10:28:18,515][123091] Updated weights for policy 0, policy_version 1362489 (0.0008) [2023-12-26 10:28:18,548][123090] Updated weights for policy 1, policy_version 1353006 (0.0009) [2023-12-26 10:28:18,582][123091] Updated weights for policy 0, policy_version 1362499 (0.0009) [2023-12-26 10:28:18,603][123090] Updated weights for policy 1, policy_version 1353016 (0.0007) [2023-12-26 10:28:18,640][123091] Updated weights for policy 0, policy_version 1362509 (0.0009) [2023-12-26 10:28:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 695181312. Throughput: 0: 9189.7, 1: 8705.3. Samples: 695187000. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:18,784][121949] Avg episode reward: [(0, '6321.689'), (1, '5665.595')] [2023-12-26 10:28:19,382][123090] Updated weights for policy 1, policy_version 1353026 (0.0008) [2023-12-26 10:28:19,429][123091] Updated weights for policy 0, policy_version 1362519 (0.0007) [2023-12-26 10:28:19,441][123090] Updated weights for policy 1, policy_version 1353036 (0.0008) [2023-12-26 10:28:19,483][123091] Updated weights for policy 0, policy_version 1362529 (0.0009) [2023-12-26 10:28:19,510][123090] Updated weights for policy 1, policy_version 1353046 (0.0008) [2023-12-26 10:28:19,548][123091] Updated weights for policy 0, policy_version 1362539 (0.0008) [2023-12-26 10:28:19,578][123090] Updated weights for policy 1, policy_version 1353056 (0.0008) [2023-12-26 10:28:20,373][123090] Updated weights for policy 1, policy_version 1353066 (0.0010) [2023-12-26 10:28:20,422][123091] Updated weights for policy 0, policy_version 1362549 (0.0007) [2023-12-26 10:28:20,431][123090] Updated weights for policy 1, policy_version 1353076 (0.0008) [2023-12-26 10:28:20,473][123091] Updated weights for policy 0, policy_version 1362559 (0.0006) [2023-12-26 10:28:20,487][123090] Updated weights for policy 1, policy_version 1353086 (0.0008) [2023-12-26 10:28:20,521][123091] Updated weights for policy 0, policy_version 1362569 (0.0005) [2023-12-26 10:28:21,320][123091] Updated weights for policy 0, policy_version 1362579 (0.0008) [2023-12-26 10:28:21,388][123091] Updated weights for policy 0, policy_version 1362589 (0.0009) [2023-12-26 10:28:21,432][123090] Updated weights for policy 1, policy_version 1353096 (0.0008) [2023-12-26 10:28:21,452][123091] Updated weights for policy 0, policy_version 1362599 (0.0008) [2023-12-26 10:28:21,500][123090] Updated weights for policy 1, policy_version 1353106 (0.0007) [2023-12-26 10:28:21,571][123090] Updated weights for policy 1, policy_version 1353116 (0.0009) [2023-12-26 10:28:22,296][123091] Updated weights for policy 0, policy_version 1362609 (0.0010) [2023-12-26 10:28:22,356][123091] Updated weights for policy 0, policy_version 1362619 (0.0009) [2023-12-26 10:28:22,415][123090] Updated weights for policy 1, policy_version 1353126 (0.0008) [2023-12-26 10:28:22,427][123091] Updated weights for policy 0, policy_version 1362629 (0.0008) [2023-12-26 10:28:22,481][123090] Updated weights for policy 1, policy_version 1353136 (0.0009) [2023-12-26 10:28:22,491][123091] Updated weights for policy 0, policy_version 1362639 (0.0009) [2023-12-26 10:28:22,544][123090] Updated weights for policy 1, policy_version 1353146 (0.0009) [2023-12-26 10:28:23,299][123091] Updated weights for policy 0, policy_version 1362649 (0.0005) [2023-12-26 10:28:23,341][123090] Updated weights for policy 1, policy_version 1353156 (0.0009) [2023-12-26 10:28:23,367][123091] Updated weights for policy 0, policy_version 1362659 (0.0005) [2023-12-26 10:28:23,398][123090] Updated weights for policy 1, policy_version 1353166 (0.0009) [2023-12-26 10:28:23,435][123091] Updated weights for policy 0, policy_version 1362669 (0.0005) [2023-12-26 10:28:23,446][123090] Updated weights for policy 1, policy_version 1353176 (0.0009) [2023-12-26 10:28:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 695263232. Throughput: 0: 9110.0, 1: 8601.8. Samples: 695238064. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:23,785][121949] Avg episode reward: [(0, '6268.361'), (1, '5625.998')] [2023-12-26 10:28:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001362672_348848128.pth... [2023-12-26 10:28:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001353184_346415104.pth... [2023-12-26 10:28:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001352160_346152960.pth [2023-12-26 10:28:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001361616_348577792.pth [2023-12-26 10:28:24,075][123091] Updated weights for policy 0, policy_version 1362679 (0.0008) [2023-12-26 10:28:24,132][123091] Updated weights for policy 0, policy_version 1362689 (0.0010) [2023-12-26 10:28:24,191][123091] Updated weights for policy 0, policy_version 1362699 (0.0009) [2023-12-26 10:28:24,352][123090] Updated weights for policy 1, policy_version 1353186 (0.0009) [2023-12-26 10:28:24,409][123090] Updated weights for policy 1, policy_version 1353196 (0.0009) [2023-12-26 10:28:24,464][123090] Updated weights for policy 1, policy_version 1353206 (0.0008) [2023-12-26 10:28:24,522][123090] Updated weights for policy 1, policy_version 1353216 (0.0009) [2023-12-26 10:28:25,027][123091] Updated weights for policy 0, policy_version 1362709 (0.0010) [2023-12-26 10:28:25,078][123091] Updated weights for policy 0, policy_version 1362720 (0.0010) [2023-12-26 10:28:25,125][123091] Updated weights for policy 0, policy_version 1362730 (0.0008) [2023-12-26 10:28:25,337][123090] Updated weights for policy 1, policy_version 1353226 (0.0009) [2023-12-26 10:28:25,389][123090] Updated weights for policy 1, policy_version 1353236 (0.0009) [2023-12-26 10:28:25,442][123090] Updated weights for policy 1, policy_version 1353246 (0.0009) [2023-12-26 10:28:25,966][123091] Updated weights for policy 0, policy_version 1362740 (0.0010) [2023-12-26 10:28:26,023][123091] Updated weights for policy 0, policy_version 1362750 (0.0010) [2023-12-26 10:28:26,079][123091] Updated weights for policy 0, policy_version 1362760 (0.0010) [2023-12-26 10:28:26,294][123090] Updated weights for policy 1, policy_version 1353256 (0.0010) [2023-12-26 10:28:26,345][123090] Updated weights for policy 1, policy_version 1353266 (0.0008) [2023-12-26 10:28:26,397][123090] Updated weights for policy 1, policy_version 1353276 (0.0008) [2023-12-26 10:28:26,909][123091] Updated weights for policy 0, policy_version 1362770 (0.0009) [2023-12-26 10:28:26,973][123091] Updated weights for policy 0, policy_version 1362780 (0.0010) [2023-12-26 10:28:27,042][123091] Updated weights for policy 0, policy_version 1362790 (0.0009) [2023-12-26 10:28:27,110][123091] Updated weights for policy 0, policy_version 1362800 (0.0010) [2023-12-26 10:28:27,233][123090] Updated weights for policy 1, policy_version 1353286 (0.0009) [2023-12-26 10:28:27,290][123090] Updated weights for policy 1, policy_version 1353296 (0.0009) [2023-12-26 10:28:27,358][123090] Updated weights for policy 1, policy_version 1353306 (0.0008) [2023-12-26 10:28:27,940][123091] Updated weights for policy 0, policy_version 1362810 (0.0010) [2023-12-26 10:28:27,988][123090] Updated weights for policy 1, policy_version 1353316 (0.0005) [2023-12-26 10:28:27,995][123091] Updated weights for policy 0, policy_version 1362820 (0.0009) [2023-12-26 10:28:28,047][123090] Updated weights for policy 1, policy_version 1353326 (0.0006) [2023-12-26 10:28:28,051][123091] Updated weights for policy 0, policy_version 1362830 (0.0008) [2023-12-26 10:28:28,113][123090] Updated weights for policy 1, policy_version 1353336 (0.0005) [2023-12-26 10:28:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 695345152. Throughput: 0: 9126.9, 1: 8625.1. Samples: 695342628. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:28,784][121949] Avg episode reward: [(0, '6301.564'), (1, '5652.543')] [2023-12-26 10:28:28,860][123091] Updated weights for policy 0, policy_version 1362840 (0.0009) [2023-12-26 10:28:28,913][123090] Updated weights for policy 1, policy_version 1353346 (0.0005) [2023-12-26 10:28:28,915][123091] Updated weights for policy 0, policy_version 1362851 (0.0010) [2023-12-26 10:28:28,965][123091] Updated weights for policy 0, policy_version 1362861 (0.0009) [2023-12-26 10:28:28,979][123090] Updated weights for policy 1, policy_version 1353356 (0.0008) [2023-12-26 10:28:29,041][123090] Updated weights for policy 1, policy_version 1353366 (0.0005) [2023-12-26 10:28:29,100][123090] Updated weights for policy 1, policy_version 1353376 (0.0008) [2023-12-26 10:28:29,775][123091] Updated weights for policy 0, policy_version 1362871 (0.0009) [2023-12-26 10:28:29,801][123090] Updated weights for policy 1, policy_version 1353386 (0.0006) [2023-12-26 10:28:29,840][123091] Updated weights for policy 0, policy_version 1362881 (0.0009) [2023-12-26 10:28:29,881][123090] Updated weights for policy 1, policy_version 1353396 (0.0010) [2023-12-26 10:28:29,906][123091] Updated weights for policy 0, policy_version 1362891 (0.0009) [2023-12-26 10:28:29,948][123090] Updated weights for policy 1, policy_version 1353406 (0.0010) [2023-12-26 10:28:30,687][123090] Updated weights for policy 1, policy_version 1353416 (0.0006) [2023-12-26 10:28:30,744][123090] Updated weights for policy 1, policy_version 1353426 (0.0006) [2023-12-26 10:28:30,769][123091] Updated weights for policy 0, policy_version 1362901 (0.0009) [2023-12-26 10:28:30,807][123090] Updated weights for policy 1, policy_version 1353436 (0.0009) [2023-12-26 10:28:30,830][123091] Updated weights for policy 0, policy_version 1362911 (0.0010) [2023-12-26 10:28:30,889][123091] Updated weights for policy 0, policy_version 1362921 (0.0006) [2023-12-26 10:28:31,629][123090] Updated weights for policy 1, policy_version 1353446 (0.0007) [2023-12-26 10:28:31,686][123090] Updated weights for policy 1, policy_version 1353456 (0.0007) [2023-12-26 10:28:31,689][123091] Updated weights for policy 0, policy_version 1362931 (0.0009) [2023-12-26 10:28:31,757][123090] Updated weights for policy 1, policy_version 1353466 (0.0007) [2023-12-26 10:28:31,758][123091] Updated weights for policy 0, policy_version 1362941 (0.0009) [2023-12-26 10:28:31,810][123091] Updated weights for policy 0, policy_version 1362951 (0.0010) [2023-12-26 10:28:32,407][123090] Updated weights for policy 1, policy_version 1353476 (0.0008) [2023-12-26 10:28:32,452][123090] Updated weights for policy 1, policy_version 1353486 (0.0010) [2023-12-26 10:28:32,500][123090] Updated weights for policy 1, policy_version 1353496 (0.0009) [2023-12-26 10:28:32,604][123091] Updated weights for policy 0, policy_version 1362961 (0.0010) [2023-12-26 10:28:32,663][123091] Updated weights for policy 0, policy_version 1362971 (0.0011) [2023-12-26 10:28:32,721][123091] Updated weights for policy 0, policy_version 1362981 (0.0010) [2023-12-26 10:28:32,795][123091] Updated weights for policy 0, policy_version 1362991 (0.0011) [2023-12-26 10:28:33,195][123090] Updated weights for policy 1, policy_version 1353506 (0.0006) [2023-12-26 10:28:33,267][123090] Updated weights for policy 1, policy_version 1353516 (0.0005) [2023-12-26 10:28:33,325][123090] Updated weights for policy 1, policy_version 1353526 (0.0005) [2023-12-26 10:28:33,389][123090] Updated weights for policy 1, policy_version 1353536 (0.0005) [2023-12-26 10:28:33,605][123091] Updated weights for policy 0, policy_version 1363001 (0.0011) [2023-12-26 10:28:33,670][123091] Updated weights for policy 0, policy_version 1363011 (0.0010) [2023-12-26 10:28:33,724][123091] Updated weights for policy 0, policy_version 1363021 (0.0010) [2023-12-26 10:28:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 695443456. Throughput: 0: 8985.2, 1: 8779.9. Samples: 695451704. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:33,784][121949] Avg episode reward: [(0, '6306.558'), (1, '5800.924')] [2023-12-26 10:28:34,053][123090] Updated weights for policy 1, policy_version 1353546 (0.0005) [2023-12-26 10:28:34,119][123090] Updated weights for policy 1, policy_version 1353556 (0.0005) [2023-12-26 10:28:34,194][123090] Updated weights for policy 1, policy_version 1353566 (0.0007) [2023-12-26 10:28:34,483][123091] Updated weights for policy 0, policy_version 1363031 (0.0011) [2023-12-26 10:28:34,542][123091] Updated weights for policy 0, policy_version 1363041 (0.0011) [2023-12-26 10:28:34,595][123091] Updated weights for policy 0, policy_version 1363051 (0.0011) [2023-12-26 10:28:35,002][123090] Updated weights for policy 1, policy_version 1353576 (0.0009) [2023-12-26 10:28:35,059][123090] Updated weights for policy 1, policy_version 1353586 (0.0009) [2023-12-26 10:28:35,115][123090] Updated weights for policy 1, policy_version 1353596 (0.0009) [2023-12-26 10:28:35,239][123091] Updated weights for policy 0, policy_version 1363061 (0.0006) [2023-12-26 10:28:35,298][123091] Updated weights for policy 0, policy_version 1363071 (0.0005) [2023-12-26 10:28:35,345][123091] Updated weights for policy 0, policy_version 1363081 (0.0005) [2023-12-26 10:28:35,995][123090] Updated weights for policy 1, policy_version 1353607 (0.0010) [2023-12-26 10:28:36,054][123090] Updated weights for policy 1, policy_version 1353617 (0.0010) [2023-12-26 10:28:36,077][123091] Updated weights for policy 0, policy_version 1363091 (0.0005) [2023-12-26 10:28:36,106][123090] Updated weights for policy 1, policy_version 1353627 (0.0009) [2023-12-26 10:28:36,141][123091] Updated weights for policy 0, policy_version 1363101 (0.0008) [2023-12-26 10:28:36,197][123091] Updated weights for policy 0, policy_version 1363111 (0.0011) [2023-12-26 10:28:36,995][123090] Updated weights for policy 1, policy_version 1353637 (0.0008) [2023-12-26 10:28:37,017][123091] Updated weights for policy 0, policy_version 1363121 (0.0011) [2023-12-26 10:28:37,060][123090] Updated weights for policy 1, policy_version 1353647 (0.0009) [2023-12-26 10:28:37,080][123091] Updated weights for policy 0, policy_version 1363131 (0.0009) [2023-12-26 10:28:37,113][123090] Updated weights for policy 1, policy_version 1353657 (0.0006) [2023-12-26 10:28:37,143][123091] Updated weights for policy 0, policy_version 1363141 (0.0009) [2023-12-26 10:28:37,212][123091] Updated weights for policy 0, policy_version 1363151 (0.0009) [2023-12-26 10:28:37,950][123090] Updated weights for policy 1, policy_version 1353667 (0.0010) [2023-12-26 10:28:38,012][123090] Updated weights for policy 1, policy_version 1353677 (0.0008) [2023-12-26 10:28:38,023][123091] Updated weights for policy 0, policy_version 1363161 (0.0009) [2023-12-26 10:28:38,077][123090] Updated weights for policy 1, policy_version 1353687 (0.0009) [2023-12-26 10:28:38,079][123091] Updated weights for policy 0, policy_version 1363171 (0.0006) [2023-12-26 10:28:38,127][123091] Updated weights for policy 0, policy_version 1363181 (0.0006) [2023-12-26 10:28:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 695525376. Throughput: 0: 9021.7, 1: 8783.0. Samples: 695505512. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:38,784][121949] Avg episode reward: [(0, '6258.462'), (1, '5806.649')] [2023-12-26 10:28:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001363184_348979200.pth... [2023-12-26 10:28:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001353696_346546176.pth... [2023-12-26 10:28:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001352704_346292224.pth [2023-12-26 10:28:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001362160_348717056.pth [2023-12-26 10:28:38,925][123090] Updated weights for policy 1, policy_version 1353697 (0.0010) [2023-12-26 10:28:38,979][123091] Updated weights for policy 0, policy_version 1363191 (0.0009) [2023-12-26 10:28:38,981][123090] Updated weights for policy 1, policy_version 1353707 (0.0009) [2023-12-26 10:28:39,034][123090] Updated weights for policy 1, policy_version 1353717 (0.0008) [2023-12-26 10:28:39,042][123091] Updated weights for policy 0, policy_version 1363201 (0.0008) [2023-12-26 10:28:39,087][123090] Updated weights for policy 1, policy_version 1353727 (0.0007) [2023-12-26 10:28:39,095][123091] Updated weights for policy 0, policy_version 1363211 (0.0008) [2023-12-26 10:28:39,903][123090] Updated weights for policy 1, policy_version 1353737 (0.0009) [2023-12-26 10:28:39,906][123091] Updated weights for policy 0, policy_version 1363221 (0.0008) [2023-12-26 10:28:39,974][123091] Updated weights for policy 0, policy_version 1363231 (0.0009) [2023-12-26 10:28:39,977][123090] Updated weights for policy 1, policy_version 1353747 (0.0008) [2023-12-26 10:28:40,036][123090] Updated weights for policy 1, policy_version 1353757 (0.0007) [2023-12-26 10:28:40,040][123091] Updated weights for policy 0, policy_version 1363241 (0.0009) [2023-12-26 10:28:40,847][123090] Updated weights for policy 1, policy_version 1353767 (0.0008) [2023-12-26 10:28:40,858][123091] Updated weights for policy 0, policy_version 1363251 (0.0010) [2023-12-26 10:28:40,906][123090] Updated weights for policy 1, policy_version 1353777 (0.0007) [2023-12-26 10:28:40,915][123091] Updated weights for policy 0, policy_version 1363261 (0.0006) [2023-12-26 10:28:40,967][123090] Updated weights for policy 1, policy_version 1353787 (0.0007) [2023-12-26 10:28:40,973][123091] Updated weights for policy 0, policy_version 1363271 (0.0009) [2023-12-26 10:28:41,827][123090] Updated weights for policy 1, policy_version 1353797 (0.0008) [2023-12-26 10:28:41,836][123091] Updated weights for policy 0, policy_version 1363281 (0.0008) [2023-12-26 10:28:41,896][123090] Updated weights for policy 1, policy_version 1353807 (0.0010) [2023-12-26 10:28:41,898][123091] Updated weights for policy 0, policy_version 1363291 (0.0006) [2023-12-26 10:28:41,950][123091] Updated weights for policy 0, policy_version 1363301 (0.0007) [2023-12-26 10:28:41,960][123090] Updated weights for policy 1, policy_version 1353817 (0.0009) [2023-12-26 10:28:42,010][123091] Updated weights for policy 0, policy_version 1363311 (0.0008) [2023-12-26 10:28:42,827][123091] Updated weights for policy 0, policy_version 1363321 (0.0006) [2023-12-26 10:28:42,867][123090] Updated weights for policy 1, policy_version 1353827 (0.0009) [2023-12-26 10:28:42,883][123091] Updated weights for policy 0, policy_version 1363331 (0.0005) [2023-12-26 10:28:42,926][123090] Updated weights for policy 1, policy_version 1353837 (0.0007) [2023-12-26 10:28:42,948][123091] Updated weights for policy 0, policy_version 1363341 (0.0005) [2023-12-26 10:28:42,991][123090] Updated weights for policy 1, policy_version 1353847 (0.0005) [2023-12-26 10:28:43,616][123091] Updated weights for policy 0, policy_version 1363351 (0.0009) [2023-12-26 10:28:43,667][123091] Updated weights for policy 0, policy_version 1363361 (0.0010) [2023-12-26 10:28:43,707][123090] Updated weights for policy 1, policy_version 1353857 (0.0005) [2023-12-26 10:28:43,730][123091] Updated weights for policy 0, policy_version 1363371 (0.0011) [2023-12-26 10:28:43,771][123090] Updated weights for policy 1, policy_version 1353867 (0.0006) [2023-12-26 10:28:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 695615488. Throughput: 0: 8832.4, 1: 8735.1. Samples: 695606948. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:43,785][121949] Avg episode reward: [(0, '6279.190'), (1, '5831.301')] [2023-12-26 10:28:43,838][123090] Updated weights for policy 1, policy_version 1353877 (0.0008) [2023-12-26 10:28:43,900][123090] Updated weights for policy 1, policy_version 1353887 (0.0008) [2023-12-26 10:28:44,557][123091] Updated weights for policy 0, policy_version 1363381 (0.0010) [2023-12-26 10:28:44,620][123091] Updated weights for policy 0, policy_version 1363391 (0.0011) [2023-12-26 10:28:44,646][123090] Updated weights for policy 1, policy_version 1353897 (0.0006) [2023-12-26 10:28:44,675][123091] Updated weights for policy 0, policy_version 1363401 (0.0010) [2023-12-26 10:28:44,713][123090] Updated weights for policy 1, policy_version 1353907 (0.0005) [2023-12-26 10:28:44,778][123090] Updated weights for policy 1, policy_version 1353917 (0.0006) [2023-12-26 10:28:45,439][123090] Updated weights for policy 1, policy_version 1353927 (0.0008) [2023-12-26 10:28:45,509][123090] Updated weights for policy 1, policy_version 1353937 (0.0007) [2023-12-26 10:28:45,565][123091] Updated weights for policy 0, policy_version 1363411 (0.0010) [2023-12-26 10:28:45,575][123090] Updated weights for policy 1, policy_version 1353947 (0.0006) [2023-12-26 10:28:45,635][123091] Updated weights for policy 0, policy_version 1363421 (0.0009) [2023-12-26 10:28:45,697][123091] Updated weights for policy 0, policy_version 1363431 (0.0009) [2023-12-26 10:28:46,294][123090] Updated weights for policy 1, policy_version 1353957 (0.0009) [2023-12-26 10:28:46,340][123090] Updated weights for policy 1, policy_version 1353967 (0.0007) [2023-12-26 10:28:46,390][123090] Updated weights for policy 1, policy_version 1353977 (0.0005) [2023-12-26 10:28:46,525][123091] Updated weights for policy 0, policy_version 1363441 (0.0009) [2023-12-26 10:28:46,576][123091] Updated weights for policy 0, policy_version 1363451 (0.0005) [2023-12-26 10:28:46,624][123091] Updated weights for policy 0, policy_version 1363461 (0.0005) [2023-12-26 10:28:46,671][123091] Updated weights for policy 0, policy_version 1363471 (0.0005) [2023-12-26 10:28:47,165][123090] Updated weights for policy 1, policy_version 1353987 (0.0006) [2023-12-26 10:28:47,241][123090] Updated weights for policy 1, policy_version 1353997 (0.0005) [2023-12-26 10:28:47,297][123090] Updated weights for policy 1, policy_version 1354007 (0.0005) [2023-12-26 10:28:47,408][123091] Updated weights for policy 0, policy_version 1363481 (0.0005) [2023-12-26 10:28:47,453][123091] Updated weights for policy 0, policy_version 1363491 (0.0005) [2023-12-26 10:28:47,502][123091] Updated weights for policy 0, policy_version 1363501 (0.0009) [2023-12-26 10:28:47,998][123090] Updated weights for policy 1, policy_version 1354017 (0.0005) [2023-12-26 10:28:48,055][123090] Updated weights for policy 1, policy_version 1354027 (0.0005) [2023-12-26 10:28:48,116][123090] Updated weights for policy 1, policy_version 1354037 (0.0005) [2023-12-26 10:28:48,147][123091] Updated weights for policy 0, policy_version 1363511 (0.0009) [2023-12-26 10:28:48,179][123090] Updated weights for policy 1, policy_version 1354047 (0.0009) [2023-12-26 10:28:48,212][123091] Updated weights for policy 0, policy_version 1363521 (0.0010) [2023-12-26 10:28:48,281][123091] Updated weights for policy 0, policy_version 1363531 (0.0010) [2023-12-26 10:28:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 695705600. Throughput: 0: 8915.2, 1: 8822.5. Samples: 695719000. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:48,785][121949] Avg episode reward: [(0, '6203.172'), (1, '5821.796')] [2023-12-26 10:28:48,958][123090] Updated weights for policy 1, policy_version 1354057 (0.0010) [2023-12-26 10:28:49,007][123090] Updated weights for policy 1, policy_version 1354067 (0.0010) [2023-12-26 10:28:49,051][123091] Updated weights for policy 0, policy_version 1363541 (0.0010) [2023-12-26 10:28:49,056][123090] Updated weights for policy 1, policy_version 1354077 (0.0007) [2023-12-26 10:28:49,122][123091] Updated weights for policy 0, policy_version 1363551 (0.0009) [2023-12-26 10:28:49,189][123091] Updated weights for policy 0, policy_version 1363561 (0.0010) [2023-12-26 10:28:49,836][123090] Updated weights for policy 1, policy_version 1354087 (0.0007) [2023-12-26 10:28:49,897][123090] Updated weights for policy 1, policy_version 1354097 (0.0008) [2023-12-26 10:28:49,961][123090] Updated weights for policy 1, policy_version 1354107 (0.0008) [2023-12-26 10:28:49,971][123091] Updated weights for policy 0, policy_version 1363571 (0.0010) [2023-12-26 10:28:50,034][123091] Updated weights for policy 0, policy_version 1363581 (0.0008) [2023-12-26 10:28:50,093][123091] Updated weights for policy 0, policy_version 1363591 (0.0009) [2023-12-26 10:28:50,747][123090] Updated weights for policy 1, policy_version 1354117 (0.0008) [2023-12-26 10:28:50,811][123090] Updated weights for policy 1, policy_version 1354127 (0.0009) [2023-12-26 10:28:50,868][123090] Updated weights for policy 1, policy_version 1354137 (0.0010) [2023-12-26 10:28:50,919][123091] Updated weights for policy 0, policy_version 1363601 (0.0010) [2023-12-26 10:28:50,970][123091] Updated weights for policy 0, policy_version 1363611 (0.0010) [2023-12-26 10:28:51,041][123091] Updated weights for policy 0, policy_version 1363621 (0.0011) [2023-12-26 10:28:51,102][123091] Updated weights for policy 0, policy_version 1363631 (0.0011) [2023-12-26 10:28:51,729][123090] Updated weights for policy 1, policy_version 1354147 (0.0011) [2023-12-26 10:28:51,798][123090] Updated weights for policy 1, policy_version 1354157 (0.0011) [2023-12-26 10:28:51,867][123090] Updated weights for policy 1, policy_version 1354167 (0.0011) [2023-12-26 10:28:51,944][123091] Updated weights for policy 0, policy_version 1363641 (0.0008) [2023-12-26 10:28:52,013][123091] Updated weights for policy 0, policy_version 1363651 (0.0010) [2023-12-26 10:28:52,077][123091] Updated weights for policy 0, policy_version 1363661 (0.0010) [2023-12-26 10:28:52,626][123090] Updated weights for policy 1, policy_version 1354177 (0.0010) [2023-12-26 10:28:52,683][123090] Updated weights for policy 1, policy_version 1354187 (0.0005) [2023-12-26 10:28:52,738][123090] Updated weights for policy 1, policy_version 1354197 (0.0005) [2023-12-26 10:28:52,793][123090] Updated weights for policy 1, policy_version 1354207 (0.0005) [2023-12-26 10:28:52,960][123091] Updated weights for policy 0, policy_version 1363671 (0.0010) [2023-12-26 10:28:53,023][123091] Updated weights for policy 0, policy_version 1363681 (0.0010) [2023-12-26 10:28:53,088][123091] Updated weights for policy 0, policy_version 1363691 (0.0009) [2023-12-26 10:28:53,538][123090] Updated weights for policy 1, policy_version 1354217 (0.0008) [2023-12-26 10:28:53,592][123090] Updated weights for policy 1, policy_version 1354227 (0.0006) [2023-12-26 10:28:53,646][123090] Updated weights for policy 1, policy_version 1354237 (0.0005) [2023-12-26 10:28:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 695795712. Throughput: 0: 8896.0, 1: 8778.1. Samples: 695771600. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:53,785][121949] Avg episode reward: [(0, '6165.348'), (1, '5801.523')] [2023-12-26 10:28:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001363696_349110272.pth... [2023-12-26 10:28:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001354240_346685440.pth... [2023-12-26 10:28:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001362672_348848128.pth [2023-12-26 10:28:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001353184_346415104.pth [2023-12-26 10:28:53,955][123091] Updated weights for policy 0, policy_version 1363701 (0.0009) [2023-12-26 10:28:54,008][123091] Updated weights for policy 0, policy_version 1363711 (0.0009) [2023-12-26 10:28:54,067][123091] Updated weights for policy 0, policy_version 1363721 (0.0009) [2023-12-26 10:28:54,458][123090] Updated weights for policy 1, policy_version 1354247 (0.0008) [2023-12-26 10:28:54,509][123090] Updated weights for policy 1, policy_version 1354257 (0.0009) [2023-12-26 10:28:54,557][123090] Updated weights for policy 1, policy_version 1354267 (0.0009) [2023-12-26 10:28:54,872][123091] Updated weights for policy 0, policy_version 1363731 (0.0008) [2023-12-26 10:28:54,929][123091] Updated weights for policy 0, policy_version 1363741 (0.0006) [2023-12-26 10:28:54,985][123091] Updated weights for policy 0, policy_version 1363751 (0.0006) [2023-12-26 10:28:55,487][123090] Updated weights for policy 1, policy_version 1354277 (0.0009) [2023-12-26 10:28:55,564][123090] Updated weights for policy 1, policy_version 1354287 (0.0005) [2023-12-26 10:28:55,578][123091] Updated weights for policy 0, policy_version 1363761 (0.0006) [2023-12-26 10:28:55,634][123090] Updated weights for policy 1, policy_version 1354297 (0.0007) [2023-12-26 10:28:55,647][123091] Updated weights for policy 0, policy_version 1363771 (0.0010) [2023-12-26 10:28:55,713][123091] Updated weights for policy 0, policy_version 1363781 (0.0010) [2023-12-26 10:28:55,780][123091] Updated weights for policy 0, policy_version 1363791 (0.0011) [2023-12-26 10:28:56,270][123090] Updated weights for policy 1, policy_version 1354307 (0.0008) [2023-12-26 10:28:56,336][123090] Updated weights for policy 1, policy_version 1354317 (0.0008) [2023-12-26 10:28:56,388][123090] Updated weights for policy 1, policy_version 1354327 (0.0009) [2023-12-26 10:28:56,570][123091] Updated weights for policy 0, policy_version 1363801 (0.0010) [2023-12-26 10:28:56,624][123091] Updated weights for policy 0, policy_version 1363811 (0.0010) [2023-12-26 10:28:56,677][123091] Updated weights for policy 0, policy_version 1363822 (0.0010) [2023-12-26 10:28:57,178][123090] Updated weights for policy 1, policy_version 1354337 (0.0009) [2023-12-26 10:28:57,234][123090] Updated weights for policy 1, policy_version 1354347 (0.0009) [2023-12-26 10:28:57,284][123090] Updated weights for policy 1, policy_version 1354357 (0.0009) [2023-12-26 10:28:57,342][123090] Updated weights for policy 1, policy_version 1354367 (0.0010) [2023-12-26 10:28:57,461][123091] Updated weights for policy 0, policy_version 1363832 (0.0006) [2023-12-26 10:28:57,512][123091] Updated weights for policy 0, policy_version 1363842 (0.0008) [2023-12-26 10:28:57,566][123091] Updated weights for policy 0, policy_version 1363854 (0.0009) [2023-12-26 10:28:58,210][123090] Updated weights for policy 1, policy_version 1354377 (0.0009) [2023-12-26 10:28:58,274][123090] Updated weights for policy 1, policy_version 1354387 (0.0007) [2023-12-26 10:28:58,346][123090] Updated weights for policy 1, policy_version 1354397 (0.0007) [2023-12-26 10:28:58,391][123091] Updated weights for policy 0, policy_version 1363864 (0.0009) [2023-12-26 10:28:58,445][123091] Updated weights for policy 0, policy_version 1363874 (0.0010) [2023-12-26 10:28:58,506][123091] Updated weights for policy 0, policy_version 1363884 (0.0009) [2023-12-26 10:28:58,784][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.2, 300 sec: 17855.8). Total num frames: 695885824. Throughput: 0: 8933.8, 1: 8808.4. Samples: 695877788. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:28:58,785][121949] Avg episode reward: [(0, '6216.084'), (1, '5799.604')] [2023-12-26 10:28:59,293][123090] Updated weights for policy 1, policy_version 1354407 (0.0009) [2023-12-26 10:28:59,367][123090] Updated weights for policy 1, policy_version 1354417 (0.0009) [2023-12-26 10:28:59,427][123090] Updated weights for policy 1, policy_version 1354427 (0.0009) [2023-12-26 10:28:59,503][123091] Updated weights for policy 0, policy_version 1363894 (0.0010) [2023-12-26 10:28:59,575][123091] Updated weights for policy 0, policy_version 1363904 (0.0011) [2023-12-26 10:28:59,630][123091] Updated weights for policy 0, policy_version 1363914 (0.0011) [2023-12-26 10:29:00,296][123090] Updated weights for policy 1, policy_version 1354437 (0.0009) [2023-12-26 10:29:00,356][123090] Updated weights for policy 1, policy_version 1354447 (0.0009) [2023-12-26 10:29:00,423][123090] Updated weights for policy 1, policy_version 1354457 (0.0009) [2023-12-26 10:29:00,450][123091] Updated weights for policy 0, policy_version 1363924 (0.0011) [2023-12-26 10:29:00,506][123091] Updated weights for policy 0, policy_version 1363934 (0.0010) [2023-12-26 10:29:00,565][123091] Updated weights for policy 0, policy_version 1363944 (0.0010) [2023-12-26 10:29:01,317][123090] Updated weights for policy 1, policy_version 1354467 (0.0007) [2023-12-26 10:29:01,362][123091] Updated weights for policy 0, policy_version 1363954 (0.0010) [2023-12-26 10:29:01,384][123090] Updated weights for policy 1, policy_version 1354477 (0.0009) [2023-12-26 10:29:01,422][123091] Updated weights for policy 0, policy_version 1363964 (0.0008) [2023-12-26 10:29:01,447][123090] Updated weights for policy 1, policy_version 1354487 (0.0010) [2023-12-26 10:29:01,488][123091] Updated weights for policy 0, policy_version 1363974 (0.0009) [2023-12-26 10:29:01,551][123091] Updated weights for policy 0, policy_version 1363984 (0.0008) [2023-12-26 10:29:02,310][123090] Updated weights for policy 1, policy_version 1354497 (0.0009) [2023-12-26 10:29:02,376][123090] Updated weights for policy 1, policy_version 1354507 (0.0008) [2023-12-26 10:29:02,381][123091] Updated weights for policy 0, policy_version 1363994 (0.0009) [2023-12-26 10:29:02,430][123090] Updated weights for policy 1, policy_version 1354517 (0.0009) [2023-12-26 10:29:02,436][123091] Updated weights for policy 0, policy_version 1364004 (0.0011) [2023-12-26 10:29:02,489][123090] Updated weights for policy 1, policy_version 1354527 (0.0006) [2023-12-26 10:29:02,495][123091] Updated weights for policy 0, policy_version 1364014 (0.0011) [2023-12-26 10:29:03,316][123091] Updated weights for policy 0, policy_version 1364024 (0.0007) [2023-12-26 10:29:03,329][123090] Updated weights for policy 1, policy_version 1354537 (0.0008) [2023-12-26 10:29:03,368][123091] Updated weights for policy 0, policy_version 1364034 (0.0005) [2023-12-26 10:29:03,380][123090] Updated weights for policy 1, policy_version 1354547 (0.0009) [2023-12-26 10:29:03,419][123091] Updated weights for policy 0, policy_version 1364044 (0.0005) [2023-12-26 10:29:03,435][123090] Updated weights for policy 1, policy_version 1354557 (0.0010) [2023-12-26 10:29:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 695967744. Throughput: 0: 8807.4, 1: 8770.6. Samples: 695978016. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:29:03,785][121949] Avg episode reward: [(0, '6202.752'), (1, '5809.125')] [2023-12-26 10:29:04,067][123091] Updated weights for policy 0, policy_version 1364054 (0.0006) [2023-12-26 10:29:04,135][123091] Updated weights for policy 0, policy_version 1364064 (0.0011) [2023-12-26 10:29:04,206][123091] Updated weights for policy 0, policy_version 1364074 (0.0010) [2023-12-26 10:29:04,357][123090] Updated weights for policy 1, policy_version 1354567 (0.0009) [2023-12-26 10:29:04,421][123090] Updated weights for policy 1, policy_version 1354577 (0.0010) [2023-12-26 10:29:04,478][123090] Updated weights for policy 1, policy_version 1354587 (0.0009) [2023-12-26 10:29:04,892][123091] Updated weights for policy 0, policy_version 1364084 (0.0006) [2023-12-26 10:29:04,943][123091] Updated weights for policy 0, policy_version 1364094 (0.0008) [2023-12-26 10:29:05,012][123091] Updated weights for policy 0, policy_version 1364104 (0.0010) [2023-12-26 10:29:05,291][123090] Updated weights for policy 1, policy_version 1354597 (0.0009) [2023-12-26 10:29:05,349][123090] Updated weights for policy 1, policy_version 1354607 (0.0010) [2023-12-26 10:29:05,404][123090] Updated weights for policy 1, policy_version 1354617 (0.0010) [2023-12-26 10:29:05,625][123091] Updated weights for policy 0, policy_version 1364114 (0.0009) [2023-12-26 10:29:05,682][123091] Updated weights for policy 0, policy_version 1364124 (0.0005) [2023-12-26 10:29:05,738][123091] Updated weights for policy 0, policy_version 1364134 (0.0005) [2023-12-26 10:29:05,797][123091] Updated weights for policy 0, policy_version 1364144 (0.0006) [2023-12-26 10:29:06,251][123090] Updated weights for policy 1, policy_version 1354627 (0.0011) [2023-12-26 10:29:06,315][123090] Updated weights for policy 1, policy_version 1354637 (0.0011) [2023-12-26 10:29:06,384][123090] Updated weights for policy 1, policy_version 1354647 (0.0011) [2023-12-26 10:29:06,477][123091] Updated weights for policy 0, policy_version 1364154 (0.0009) [2023-12-26 10:29:06,546][123091] Updated weights for policy 0, policy_version 1364164 (0.0009) [2023-12-26 10:29:06,607][123091] Updated weights for policy 0, policy_version 1364174 (0.0010) [2023-12-26 10:29:07,227][123090] Updated weights for policy 1, policy_version 1354657 (0.0011) [2023-12-26 10:29:07,297][123090] Updated weights for policy 1, policy_version 1354667 (0.0008) [2023-12-26 10:29:07,368][123090] Updated weights for policy 1, policy_version 1354677 (0.0010) [2023-12-26 10:29:07,416][123091] Updated weights for policy 0, policy_version 1364184 (0.0011) [2023-12-26 10:29:07,433][123090] Updated weights for policy 1, policy_version 1354687 (0.0006) [2023-12-26 10:29:07,488][123091] Updated weights for policy 0, policy_version 1364194 (0.0011) [2023-12-26 10:29:07,552][123091] Updated weights for policy 0, policy_version 1364204 (0.0011) [2023-12-26 10:29:08,167][123090] Updated weights for policy 1, policy_version 1354697 (0.0010) [2023-12-26 10:29:08,225][123090] Updated weights for policy 1, policy_version 1354707 (0.0006) [2023-12-26 10:29:08,260][123091] Updated weights for policy 0, policy_version 1364214 (0.0008) [2023-12-26 10:29:08,278][123090] Updated weights for policy 1, policy_version 1354717 (0.0008) [2023-12-26 10:29:08,331][123091] Updated weights for policy 0, policy_version 1364224 (0.0006) [2023-12-26 10:29:08,397][123091] Updated weights for policy 0, policy_version 1364234 (0.0008) [2023-12-26 10:29:08,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 696057856. Throughput: 0: 8906.0, 1: 8766.3. Samples: 696033324. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:29:08,786][121949] Avg episode reward: [(0, '6177.381'), (1, '5816.226')] [2023-12-26 10:29:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001364240_349249536.pth... [2023-12-26 10:29:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001354720_346808320.pth... [2023-12-26 10:29:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001363184_348979200.pth [2023-12-26 10:29:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001353696_346546176.pth [2023-12-26 10:29:09,116][123090] Updated weights for policy 1, policy_version 1354727 (0.0009) [2023-12-26 10:29:09,176][123090] Updated weights for policy 1, policy_version 1354737 (0.0010) [2023-12-26 10:29:09,193][123091] Updated weights for policy 0, policy_version 1364244 (0.0010) [2023-12-26 10:29:09,248][123090] Updated weights for policy 1, policy_version 1354747 (0.0011) [2023-12-26 10:29:09,258][123091] Updated weights for policy 0, policy_version 1364254 (0.0007) [2023-12-26 10:29:09,317][123091] Updated weights for policy 0, policy_version 1364264 (0.0009) [2023-12-26 10:29:10,092][123090] Updated weights for policy 1, policy_version 1354757 (0.0010) [2023-12-26 10:29:10,139][123091] Updated weights for policy 0, policy_version 1364274 (0.0008) [2023-12-26 10:29:10,161][123090] Updated weights for policy 1, policy_version 1354767 (0.0009) [2023-12-26 10:29:10,207][123091] Updated weights for policy 0, policy_version 1364284 (0.0008) [2023-12-26 10:29:10,222][123090] Updated weights for policy 1, policy_version 1354777 (0.0006) [2023-12-26 10:29:10,274][123091] Updated weights for policy 0, policy_version 1364294 (0.0010) [2023-12-26 10:29:10,342][123091] Updated weights for policy 0, policy_version 1364304 (0.0009) [2023-12-26 10:29:11,081][123090] Updated weights for policy 1, policy_version 1354787 (0.0008) [2023-12-26 10:29:11,132][123091] Updated weights for policy 0, policy_version 1364314 (0.0008) [2023-12-26 10:29:11,147][123090] Updated weights for policy 1, policy_version 1354797 (0.0008) [2023-12-26 10:29:11,198][123091] Updated weights for policy 0, policy_version 1364324 (0.0008) [2023-12-26 10:29:11,207][123090] Updated weights for policy 1, policy_version 1354807 (0.0008) [2023-12-26 10:29:11,259][123091] Updated weights for policy 0, policy_version 1364334 (0.0007) [2023-12-26 10:29:12,008][123090] Updated weights for policy 1, policy_version 1354817 (0.0009) [2023-12-26 10:29:12,072][123090] Updated weights for policy 1, policy_version 1354827 (0.0010) [2023-12-26 10:29:12,119][123091] Updated weights for policy 0, policy_version 1364344 (0.0007) [2023-12-26 10:29:12,129][123090] Updated weights for policy 1, policy_version 1354837 (0.0010) [2023-12-26 10:29:12,179][123091] Updated weights for policy 0, policy_version 1364354 (0.0007) [2023-12-26 10:29:12,188][123090] Updated weights for policy 1, policy_version 1354847 (0.0008) [2023-12-26 10:29:12,245][123091] Updated weights for policy 0, policy_version 1364364 (0.0010) [2023-12-26 10:29:12,959][123090] Updated weights for policy 1, policy_version 1354857 (0.0010) [2023-12-26 10:29:13,029][123090] Updated weights for policy 1, policy_version 1354867 (0.0010) [2023-12-26 10:29:13,098][123090] Updated weights for policy 1, policy_version 1354877 (0.0010) [2023-12-26 10:29:13,131][123091] Updated weights for policy 0, policy_version 1364374 (0.0010) [2023-12-26 10:29:13,198][123091] Updated weights for policy 0, policy_version 1364384 (0.0009) [2023-12-26 10:29:13,266][123091] Updated weights for policy 0, policy_version 1364394 (0.0009) [2023-12-26 10:29:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 696139776. Throughput: 0: 8886.1, 1: 8759.4. Samples: 696136680. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:29:13,785][121949] Avg episode reward: [(0, '6248.819'), (1, '5798.257')] [2023-12-26 10:29:13,877][123090] Updated weights for policy 1, policy_version 1354887 (0.0007) [2023-12-26 10:29:13,947][123090] Updated weights for policy 1, policy_version 1354897 (0.0005) [2023-12-26 10:29:14,014][123090] Updated weights for policy 1, policy_version 1354907 (0.0005) [2023-12-26 10:29:14,091][123091] Updated weights for policy 0, policy_version 1364404 (0.0009) [2023-12-26 10:29:14,145][123091] Updated weights for policy 0, policy_version 1364415 (0.0010) [2023-12-26 10:29:14,198][123091] Updated weights for policy 0, policy_version 1364425 (0.0010) [2023-12-26 10:29:14,680][123090] Updated weights for policy 1, policy_version 1354917 (0.0005) [2023-12-26 10:29:14,756][123090] Updated weights for policy 1, policy_version 1354927 (0.0005) [2023-12-26 10:29:14,813][123090] Updated weights for policy 1, policy_version 1354937 (0.0007) [2023-12-26 10:29:15,156][123091] Updated weights for policy 0, policy_version 1364436 (0.0010) [2023-12-26 10:29:15,213][123091] Updated weights for policy 0, policy_version 1364446 (0.0009) [2023-12-26 10:29:15,275][123091] Updated weights for policy 0, policy_version 1364456 (0.0010) [2023-12-26 10:29:15,496][123090] Updated weights for policy 1, policy_version 1354947 (0.0005) [2023-12-26 10:29:15,572][123090] Updated weights for policy 1, policy_version 1354957 (0.0005) [2023-12-26 10:29:15,637][123090] Updated weights for policy 1, policy_version 1354967 (0.0005) [2023-12-26 10:29:16,219][123091] Updated weights for policy 0, policy_version 1364466 (0.0009) [2023-12-26 10:29:16,281][123091] Updated weights for policy 0, policy_version 1364476 (0.0010) [2023-12-26 10:29:16,316][123090] Updated weights for policy 1, policy_version 1354977 (0.0005) [2023-12-26 10:29:16,336][123091] Updated weights for policy 0, policy_version 1364486 (0.0009) [2023-12-26 10:29:16,376][123090] Updated weights for policy 1, policy_version 1354987 (0.0005) [2023-12-26 10:29:16,395][123091] Updated weights for policy 0, policy_version 1364496 (0.0009) [2023-12-26 10:29:16,426][123090] Updated weights for policy 1, policy_version 1354997 (0.0008) [2023-12-26 10:29:16,481][123090] Updated weights for policy 1, policy_version 1355007 (0.0010) [2023-12-26 10:29:17,220][123091] Updated weights for policy 0, policy_version 1364506 (0.0005) [2023-12-26 10:29:17,267][123091] Updated weights for policy 0, policy_version 1364516 (0.0005) [2023-12-26 10:29:17,286][123090] Updated weights for policy 1, policy_version 1355017 (0.0010) [2023-12-26 10:29:17,324][123091] Updated weights for policy 0, policy_version 1364526 (0.0005) [2023-12-26 10:29:17,353][123090] Updated weights for policy 1, policy_version 1355027 (0.0010) [2023-12-26 10:29:17,412][123090] Updated weights for policy 1, policy_version 1355037 (0.0010) [2023-12-26 10:29:17,931][123091] Updated weights for policy 0, policy_version 1364536 (0.0005) [2023-12-26 10:29:17,976][123091] Updated weights for policy 0, policy_version 1364546 (0.0005) [2023-12-26 10:29:18,024][123091] Updated weights for policy 0, policy_version 1364556 (0.0005) [2023-12-26 10:29:18,245][123090] Updated weights for policy 1, policy_version 1355047 (0.0010) [2023-12-26 10:29:18,306][123090] Updated weights for policy 1, policy_version 1355057 (0.0009) [2023-12-26 10:29:18,371][123090] Updated weights for policy 1, policy_version 1355067 (0.0008) [2023-12-26 10:29:18,771][123091] Updated weights for policy 0, policy_version 1364566 (0.0009) [2023-12-26 10:29:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 696229888. Throughput: 0: 8885.2, 1: 8728.6. Samples: 696244328. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:29:18,785][121949] Avg episode reward: [(0, '6327.587'), (1, '5794.414')] [2023-12-26 10:29:18,830][123091] Updated weights for policy 0, policy_version 1364576 (0.0011) [2023-12-26 10:29:18,885][123091] Updated weights for policy 0, policy_version 1364586 (0.0011) [2023-12-26 10:29:19,204][123090] Updated weights for policy 1, policy_version 1355077 (0.0010) [2023-12-26 10:29:19,269][123090] Updated weights for policy 1, policy_version 1355087 (0.0009) [2023-12-26 10:29:19,327][123090] Updated weights for policy 1, policy_version 1355097 (0.0009) [2023-12-26 10:29:19,753][123091] Updated weights for policy 0, policy_version 1364596 (0.0010) [2023-12-26 10:29:19,820][123091] Updated weights for policy 0, policy_version 1364606 (0.0010) [2023-12-26 10:29:19,888][123091] Updated weights for policy 0, policy_version 1364616 (0.0009) [2023-12-26 10:29:19,984][123090] Updated weights for policy 1, policy_version 1355107 (0.0008) [2023-12-26 10:29:20,041][123090] Updated weights for policy 1, policy_version 1355117 (0.0009) [2023-12-26 10:29:20,101][123090] Updated weights for policy 1, policy_version 1355127 (0.0007) [2023-12-26 10:29:20,818][123090] Updated weights for policy 1, policy_version 1355137 (0.0007) [2023-12-26 10:29:20,825][123091] Updated weights for policy 0, policy_version 1364626 (0.0009) [2023-12-26 10:29:20,884][123090] Updated weights for policy 1, policy_version 1355147 (0.0009) [2023-12-26 10:29:20,891][123091] Updated weights for policy 0, policy_version 1364636 (0.0007) [2023-12-26 10:29:20,948][123090] Updated weights for policy 1, policy_version 1355157 (0.0011) [2023-12-26 10:29:20,955][123091] Updated weights for policy 0, policy_version 1364646 (0.0007) [2023-12-26 10:29:21,012][123090] Updated weights for policy 1, policy_version 1355167 (0.0011) [2023-12-26 10:29:21,029][123091] Updated weights for policy 0, policy_version 1364656 (0.0009) [2023-12-26 10:29:21,847][123090] Updated weights for policy 1, policy_version 1355177 (0.0011) [2023-12-26 10:29:21,872][123091] Updated weights for policy 0, policy_version 1364666 (0.0007) [2023-12-26 10:29:21,911][123090] Updated weights for policy 1, policy_version 1355187 (0.0011) [2023-12-26 10:29:21,928][123091] Updated weights for policy 0, policy_version 1364676 (0.0008) [2023-12-26 10:29:21,975][123090] Updated weights for policy 1, policy_version 1355197 (0.0011) [2023-12-26 10:29:21,993][123091] Updated weights for policy 0, policy_version 1364686 (0.0010) [2023-12-26 10:29:22,802][123090] Updated weights for policy 1, policy_version 1355207 (0.0007) [2023-12-26 10:29:22,871][123090] Updated weights for policy 1, policy_version 1355217 (0.0006) [2023-12-26 10:29:22,880][123091] Updated weights for policy 0, policy_version 1364696 (0.0009) [2023-12-26 10:29:22,932][123090] Updated weights for policy 1, policy_version 1355227 (0.0006) [2023-12-26 10:29:22,946][123091] Updated weights for policy 0, policy_version 1364706 (0.0009) [2023-12-26 10:29:23,010][123091] Updated weights for policy 0, policy_version 1364716 (0.0009) [2023-12-26 10:29:23,616][123090] Updated weights for policy 1, policy_version 1355237 (0.0006) [2023-12-26 10:29:23,673][123090] Updated weights for policy 1, policy_version 1355247 (0.0006) [2023-12-26 10:29:23,677][123091] Updated weights for policy 0, policy_version 1364726 (0.0007) [2023-12-26 10:29:23,723][123090] Updated weights for policy 1, policy_version 1355257 (0.0006) [2023-12-26 10:29:23,729][123091] Updated weights for policy 0, policy_version 1364736 (0.0005) [2023-12-26 10:29:23,781][123091] Updated weights for policy 0, policy_version 1364746 (0.0005) [2023-12-26 10:29:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 696320000. Throughput: 0: 8783.6, 1: 8766.8. Samples: 696295284. Policy #0 lag: (min: 31.0, avg: 34.0, max: 63.0) [2023-12-26 10:29:23,785][121949] Avg episode reward: [(0, '6272.556'), (1, '5806.907')] [2023-12-26 10:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001355264_346947584.pth... [2023-12-26 10:29:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001354240_346685440.pth [2023-12-26 10:29:23,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001364752_349380608.pth... [2023-12-26 10:29:23,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001363696_349110272.pth [2023-12-26 10:29:24,485][123091] Updated weights for policy 0, policy_version 1364756 (0.0007) [2023-12-26 10:29:24,524][123090] Updated weights for policy 1, policy_version 1355267 (0.0007) [2023-12-26 10:29:24,537][123091] Updated weights for policy 0, policy_version 1364766 (0.0009) [2023-12-26 10:29:24,589][123090] Updated weights for policy 1, policy_version 1355277 (0.0008) [2023-12-26 10:29:24,590][123091] Updated weights for policy 0, policy_version 1364776 (0.0007) [2023-12-26 10:29:24,656][123090] Updated weights for policy 1, policy_version 1355287 (0.0010) [2023-12-26 10:29:25,328][123091] Updated weights for policy 0, policy_version 1364786 (0.0005) [2023-12-26 10:29:25,384][123090] Updated weights for policy 1, policy_version 1355297 (0.0008) [2023-12-26 10:29:25,385][123091] Updated weights for policy 0, policy_version 1364796 (0.0006) [2023-12-26 10:29:25,431][123090] Updated weights for policy 1, policy_version 1355307 (0.0005) [2023-12-26 10:29:25,443][123091] Updated weights for policy 0, policy_version 1364806 (0.0006) [2023-12-26 10:29:25,477][123090] Updated weights for policy 1, policy_version 1355317 (0.0005) [2023-12-26 10:29:25,496][123091] Updated weights for policy 0, policy_version 1364816 (0.0006) [2023-12-26 10:29:25,525][123090] Updated weights for policy 1, policy_version 1355327 (0.0005) [2023-12-26 10:29:26,150][123091] Updated weights for policy 0, policy_version 1364826 (0.0006) [2023-12-26 10:29:26,222][123091] Updated weights for policy 0, policy_version 1364836 (0.0006) [2023-12-26 10:29:26,282][123091] Updated weights for policy 0, policy_version 1364846 (0.0008) [2023-12-26 10:29:26,285][123090] Updated weights for policy 1, policy_version 1355337 (0.0005) [2023-12-26 10:29:26,356][123090] Updated weights for policy 1, policy_version 1355347 (0.0007) [2023-12-26 10:29:26,422][123090] Updated weights for policy 1, policy_version 1355357 (0.0011) [2023-12-26 10:29:26,921][123091] Updated weights for policy 0, policy_version 1364856 (0.0008) [2023-12-26 10:29:26,976][123091] Updated weights for policy 0, policy_version 1364866 (0.0008) [2023-12-26 10:29:27,039][123091] Updated weights for policy 0, policy_version 1364876 (0.0008) [2023-12-26 10:29:27,211][123090] Updated weights for policy 1, policy_version 1355367 (0.0011) [2023-12-26 10:29:27,264][123090] Updated weights for policy 1, policy_version 1355377 (0.0010) [2023-12-26 10:29:27,336][123090] Updated weights for policy 1, policy_version 1355387 (0.0010) [2023-12-26 10:29:27,714][123091] Updated weights for policy 0, policy_version 1364886 (0.0007) [2023-12-26 10:29:27,778][123091] Updated weights for policy 0, policy_version 1364896 (0.0006) [2023-12-26 10:29:27,848][123091] Updated weights for policy 0, policy_version 1364906 (0.0007) [2023-12-26 10:29:28,101][123090] Updated weights for policy 1, policy_version 1355397 (0.0008) [2023-12-26 10:29:28,159][123090] Updated weights for policy 1, policy_version 1355407 (0.0010) [2023-12-26 10:29:28,213][123090] Updated weights for policy 1, policy_version 1355417 (0.0010) [2023-12-26 10:29:28,555][123091] Updated weights for policy 0, policy_version 1364916 (0.0008) [2023-12-26 10:29:28,624][123091] Updated weights for policy 0, policy_version 1364926 (0.0005) [2023-12-26 10:29:28,689][123091] Updated weights for policy 0, policy_version 1364936 (0.0005) [2023-12-26 10:29:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 696418304. Throughput: 0: 8939.2, 1: 8886.2. Samples: 696409092. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:28,785][121949] Avg episode reward: [(0, '6328.009'), (1, '5761.859')] [2023-12-26 10:29:29,050][123090] Updated weights for policy 1, policy_version 1355427 (0.0010) [2023-12-26 10:29:29,111][123090] Updated weights for policy 1, policy_version 1355437 (0.0009) [2023-12-26 10:29:29,170][123090] Updated weights for policy 1, policy_version 1355447 (0.0005) [2023-12-26 10:29:29,387][123091] Updated weights for policy 0, policy_version 1364946 (0.0006) [2023-12-26 10:29:29,433][123091] Updated weights for policy 0, policy_version 1364956 (0.0005) [2023-12-26 10:29:29,489][123091] Updated weights for policy 0, policy_version 1364966 (0.0005) [2023-12-26 10:29:29,558][123091] Updated weights for policy 0, policy_version 1364976 (0.0006) [2023-12-26 10:29:29,907][123090] Updated weights for policy 1, policy_version 1355457 (0.0005) [2023-12-26 10:29:29,976][123090] Updated weights for policy 1, policy_version 1355467 (0.0008) [2023-12-26 10:29:30,038][123090] Updated weights for policy 1, policy_version 1355477 (0.0008) [2023-12-26 10:29:30,085][123090] Updated weights for policy 1, policy_version 1355487 (0.0008) [2023-12-26 10:29:30,350][123091] Updated weights for policy 0, policy_version 1364986 (0.0009) [2023-12-26 10:29:30,411][123091] Updated weights for policy 0, policy_version 1364996 (0.0010) [2023-12-26 10:29:30,463][123091] Updated weights for policy 0, policy_version 1365006 (0.0010) [2023-12-26 10:29:30,807][123090] Updated weights for policy 1, policy_version 1355497 (0.0009) [2023-12-26 10:29:30,867][123090] Updated weights for policy 1, policy_version 1355507 (0.0011) [2023-12-26 10:29:30,927][123090] Updated weights for policy 1, policy_version 1355517 (0.0011) [2023-12-26 10:29:31,306][123091] Updated weights for policy 0, policy_version 1365016 (0.0010) [2023-12-26 10:29:31,363][123091] Updated weights for policy 0, policy_version 1365026 (0.0011) [2023-12-26 10:29:31,424][123091] Updated weights for policy 0, policy_version 1365036 (0.0009) [2023-12-26 10:29:31,746][123090] Updated weights for policy 1, policy_version 1355527 (0.0010) [2023-12-26 10:29:31,807][123090] Updated weights for policy 1, policy_version 1355537 (0.0007) [2023-12-26 10:29:31,870][123090] Updated weights for policy 1, policy_version 1355547 (0.0006) [2023-12-26 10:29:32,210][123091] Updated weights for policy 0, policy_version 1365046 (0.0009) [2023-12-26 10:29:32,263][123091] Updated weights for policy 0, policy_version 1365056 (0.0011) [2023-12-26 10:29:32,315][123091] Updated weights for policy 0, policy_version 1365066 (0.0011) [2023-12-26 10:29:32,614][123090] Updated weights for policy 1, policy_version 1355557 (0.0006) [2023-12-26 10:29:32,682][123090] Updated weights for policy 1, policy_version 1355567 (0.0007) [2023-12-26 10:29:32,743][123090] Updated weights for policy 1, policy_version 1355577 (0.0010) [2023-12-26 10:29:33,110][123091] Updated weights for policy 0, policy_version 1365076 (0.0008) [2023-12-26 10:29:33,155][123091] Updated weights for policy 0, policy_version 1365086 (0.0005) [2023-12-26 10:29:33,203][123091] Updated weights for policy 0, policy_version 1365096 (0.0005) [2023-12-26 10:29:33,475][123090] Updated weights for policy 1, policy_version 1355587 (0.0009) [2023-12-26 10:29:33,521][123090] Updated weights for policy 1, policy_version 1355597 (0.0005) [2023-12-26 10:29:33,567][123090] Updated weights for policy 1, policy_version 1355607 (0.0005) [2023-12-26 10:29:33,769][123091] Updated weights for policy 0, policy_version 1365106 (0.0006) [2023-12-26 10:29:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 696508416. Throughput: 0: 8952.5, 1: 8838.9. Samples: 696519608. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:33,785][121949] Avg episode reward: [(0, '6346.473'), (1, '5552.090')] [2023-12-26 10:29:33,815][123091] Updated weights for policy 0, policy_version 1365116 (0.0005) [2023-12-26 10:29:33,868][123091] Updated weights for policy 0, policy_version 1365126 (0.0005) [2023-12-26 10:29:33,913][123091] Updated weights for policy 0, policy_version 1365136 (0.0005) [2023-12-26 10:29:34,338][123090] Updated weights for policy 1, policy_version 1355617 (0.0006) [2023-12-26 10:29:34,405][123090] Updated weights for policy 1, policy_version 1355627 (0.0009) [2023-12-26 10:29:34,461][123090] Updated weights for policy 1, policy_version 1355637 (0.0009) [2023-12-26 10:29:34,512][123090] Updated weights for policy 1, policy_version 1355647 (0.0009) [2023-12-26 10:29:34,668][123091] Updated weights for policy 0, policy_version 1365146 (0.0009) [2023-12-26 10:29:34,727][123091] Updated weights for policy 0, policy_version 1365156 (0.0010) [2023-12-26 10:29:34,784][123091] Updated weights for policy 0, policy_version 1365166 (0.0009) [2023-12-26 10:29:35,303][123090] Updated weights for policy 1, policy_version 1355657 (0.0009) [2023-12-26 10:29:35,356][123090] Updated weights for policy 1, policy_version 1355667 (0.0009) [2023-12-26 10:29:35,404][123090] Updated weights for policy 1, policy_version 1355677 (0.0009) [2023-12-26 10:29:35,619][123091] Updated weights for policy 0, policy_version 1365176 (0.0010) [2023-12-26 10:29:35,680][123091] Updated weights for policy 0, policy_version 1365186 (0.0009) [2023-12-26 10:29:35,751][123091] Updated weights for policy 0, policy_version 1365196 (0.0009) [2023-12-26 10:29:36,231][123090] Updated weights for policy 1, policy_version 1355687 (0.0010) [2023-12-26 10:29:36,284][123090] Updated weights for policy 1, policy_version 1355697 (0.0010) [2023-12-26 10:29:36,344][123090] Updated weights for policy 1, policy_version 1355707 (0.0010) [2023-12-26 10:29:36,572][123091] Updated weights for policy 0, policy_version 1365206 (0.0009) [2023-12-26 10:29:36,642][123091] Updated weights for policy 0, policy_version 1365216 (0.0008) [2023-12-26 10:29:36,707][123091] Updated weights for policy 0, policy_version 1365226 (0.0008) [2023-12-26 10:29:37,228][123090] Updated weights for policy 1, policy_version 1355717 (0.0010) [2023-12-26 10:29:37,286][123090] Updated weights for policy 1, policy_version 1355727 (0.0006) [2023-12-26 10:29:37,340][123090] Updated weights for policy 1, policy_version 1355737 (0.0006) [2023-12-26 10:29:37,539][123091] Updated weights for policy 0, policy_version 1365237 (0.0011) [2023-12-26 10:29:37,592][123091] Updated weights for policy 0, policy_version 1365247 (0.0010) [2023-12-26 10:29:37,648][123091] Updated weights for policy 0, policy_version 1365257 (0.0010) [2023-12-26 10:29:38,143][123090] Updated weights for policy 1, policy_version 1355747 (0.0007) [2023-12-26 10:29:38,219][123090] Updated weights for policy 1, policy_version 1355757 (0.0006) [2023-12-26 10:29:38,280][123090] Updated weights for policy 1, policy_version 1355767 (0.0009) [2023-12-26 10:29:38,512][123091] Updated weights for policy 0, policy_version 1365267 (0.0011) [2023-12-26 10:29:38,579][123091] Updated weights for policy 0, policy_version 1365277 (0.0011) [2023-12-26 10:29:38,641][123091] Updated weights for policy 0, policy_version 1365287 (0.0011) [2023-12-26 10:29:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 696598528. Throughput: 0: 8970.9, 1: 8842.9. Samples: 696573224. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:38,785][121949] Avg episode reward: [(0, '6304.514'), (1, '5661.879')] [2023-12-26 10:29:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001365296_349519872.pth... [2023-12-26 10:29:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001355776_347078656.pth... [2023-12-26 10:29:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001364240_349249536.pth [2023-12-26 10:29:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001354720_346808320.pth [2023-12-26 10:29:39,095][123090] Updated weights for policy 1, policy_version 1355777 (0.0009) [2023-12-26 10:29:39,152][123090] Updated weights for policy 1, policy_version 1355787 (0.0007) [2023-12-26 10:29:39,219][123090] Updated weights for policy 1, policy_version 1355797 (0.0006) [2023-12-26 10:29:39,284][123090] Updated weights for policy 1, policy_version 1355807 (0.0008) [2023-12-26 10:29:39,372][123091] Updated weights for policy 0, policy_version 1365297 (0.0011) [2023-12-26 10:29:39,444][123091] Updated weights for policy 0, policy_version 1365307 (0.0010) [2023-12-26 10:29:39,495][123091] Updated weights for policy 0, policy_version 1365317 (0.0009) [2023-12-26 10:29:39,563][123091] Updated weights for policy 0, policy_version 1365327 (0.0009) [2023-12-26 10:29:40,078][123090] Updated weights for policy 1, policy_version 1355817 (0.0008) [2023-12-26 10:29:40,150][123090] Updated weights for policy 1, policy_version 1355827 (0.0009) [2023-12-26 10:29:40,207][123090] Updated weights for policy 1, policy_version 1355837 (0.0009) [2023-12-26 10:29:40,319][123091] Updated weights for policy 0, policy_version 1365337 (0.0006) [2023-12-26 10:29:40,373][123091] Updated weights for policy 0, policy_version 1365347 (0.0006) [2023-12-26 10:29:40,431][123091] Updated weights for policy 0, policy_version 1365357 (0.0006) [2023-12-26 10:29:40,941][123090] Updated weights for policy 1, policy_version 1355847 (0.0010) [2023-12-26 10:29:41,015][123090] Updated weights for policy 1, policy_version 1355857 (0.0008) [2023-12-26 10:29:41,076][123090] Updated weights for policy 1, policy_version 1355867 (0.0008) [2023-12-26 10:29:41,159][123091] Updated weights for policy 0, policy_version 1365367 (0.0008) [2023-12-26 10:29:41,229][123091] Updated weights for policy 0, policy_version 1365377 (0.0010) [2023-12-26 10:29:41,304][123091] Updated weights for policy 0, policy_version 1365387 (0.0010) [2023-12-26 10:29:41,922][123090] Updated weights for policy 1, policy_version 1355877 (0.0008) [2023-12-26 10:29:41,985][123090] Updated weights for policy 1, policy_version 1355887 (0.0008) [2023-12-26 10:29:42,053][123090] Updated weights for policy 1, policy_version 1355897 (0.0006) [2023-12-26 10:29:42,137][123091] Updated weights for policy 0, policy_version 1365397 (0.0008) [2023-12-26 10:29:42,187][123091] Updated weights for policy 0, policy_version 1365407 (0.0007) [2023-12-26 10:29:42,246][123091] Updated weights for policy 0, policy_version 1365417 (0.0009) [2023-12-26 10:29:42,880][123090] Updated weights for policy 1, policy_version 1355907 (0.0007) [2023-12-26 10:29:42,941][123090] Updated weights for policy 1, policy_version 1355917 (0.0009) [2023-12-26 10:29:42,995][123090] Updated weights for policy 1, policy_version 1355927 (0.0009) [2023-12-26 10:29:43,014][123091] Updated weights for policy 0, policy_version 1365427 (0.0008) [2023-12-26 10:29:43,077][123091] Updated weights for policy 0, policy_version 1365437 (0.0005) [2023-12-26 10:29:43,134][123091] Updated weights for policy 0, policy_version 1365447 (0.0005) [2023-12-26 10:29:43,780][123091] Updated weights for policy 0, policy_version 1365457 (0.0006) [2023-12-26 10:29:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 696680448. Throughput: 0: 8986.0, 1: 8815.8. Samples: 696678856. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:43,785][121949] Avg episode reward: [(0, '6318.346'), (1, '5867.954')] [2023-12-26 10:29:43,840][123091] Updated weights for policy 0, policy_version 1365467 (0.0009) [2023-12-26 10:29:43,874][123090] Updated weights for policy 1, policy_version 1355937 (0.0009) [2023-12-26 10:29:43,902][123091] Updated weights for policy 0, policy_version 1365477 (0.0010) [2023-12-26 10:29:43,926][123090] Updated weights for policy 1, policy_version 1355947 (0.0008) [2023-12-26 10:29:43,955][123091] Updated weights for policy 0, policy_version 1365487 (0.0007) [2023-12-26 10:29:43,976][123090] Updated weights for policy 1, policy_version 1355957 (0.0008) [2023-12-26 10:29:44,033][123090] Updated weights for policy 1, policy_version 1355967 (0.0009) [2023-12-26 10:29:44,795][123091] Updated weights for policy 0, policy_version 1365497 (0.0010) [2023-12-26 10:29:44,867][123091] Updated weights for policy 0, policy_version 1365507 (0.0009) [2023-12-26 10:29:44,891][123090] Updated weights for policy 1, policy_version 1355977 (0.0008) [2023-12-26 10:29:44,925][123091] Updated weights for policy 0, policy_version 1365517 (0.0006) [2023-12-26 10:29:44,962][123090] Updated weights for policy 1, policy_version 1355987 (0.0009) [2023-12-26 10:29:45,023][123090] Updated weights for policy 1, policy_version 1355997 (0.0009) [2023-12-26 10:29:45,654][123091] Updated weights for policy 0, policy_version 1365527 (0.0009) [2023-12-26 10:29:45,710][123091] Updated weights for policy 0, policy_version 1365537 (0.0009) [2023-12-26 10:29:45,761][123091] Updated weights for policy 0, policy_version 1365547 (0.0010) [2023-12-26 10:29:45,892][123090] Updated weights for policy 1, policy_version 1356007 (0.0007) [2023-12-26 10:29:45,954][123090] Updated weights for policy 1, policy_version 1356017 (0.0005) [2023-12-26 10:29:46,006][123090] Updated weights for policy 1, policy_version 1356027 (0.0005) [2023-12-26 10:29:46,635][123091] Updated weights for policy 0, policy_version 1365557 (0.0009) [2023-12-26 10:29:46,692][123091] Updated weights for policy 0, policy_version 1365567 (0.0009) [2023-12-26 10:29:46,742][123091] Updated weights for policy 0, policy_version 1365577 (0.0009) [2023-12-26 10:29:46,751][123090] Updated weights for policy 1, policy_version 1356037 (0.0008) [2023-12-26 10:29:46,798][123090] Updated weights for policy 1, policy_version 1356047 (0.0008) [2023-12-26 10:29:46,858][123090] Updated weights for policy 1, policy_version 1356057 (0.0006) [2023-12-26 10:29:47,573][123091] Updated weights for policy 0, policy_version 1365587 (0.0008) [2023-12-26 10:29:47,627][123091] Updated weights for policy 0, policy_version 1365597 (0.0010) [2023-12-26 10:29:47,678][123091] Updated weights for policy 0, policy_version 1365607 (0.0008) [2023-12-26 10:29:47,693][123090] Updated weights for policy 1, policy_version 1356067 (0.0007) [2023-12-26 10:29:47,751][123090] Updated weights for policy 1, policy_version 1356077 (0.0005) [2023-12-26 10:29:47,822][123090] Updated weights for policy 1, policy_version 1356087 (0.0005) [2023-12-26 10:29:48,537][123091] Updated weights for policy 0, policy_version 1365617 (0.0007) [2023-12-26 10:29:48,595][123090] Updated weights for policy 1, policy_version 1356097 (0.0007) [2023-12-26 10:29:48,601][123091] Updated weights for policy 0, policy_version 1365627 (0.0011) [2023-12-26 10:29:48,660][123090] Updated weights for policy 1, policy_version 1356107 (0.0009) [2023-12-26 10:29:48,666][123091] Updated weights for policy 0, policy_version 1365637 (0.0011) [2023-12-26 10:29:48,727][123090] Updated weights for policy 1, policy_version 1356117 (0.0007) [2023-12-26 10:29:48,730][123091] Updated weights for policy 0, policy_version 1365647 (0.0011) [2023-12-26 10:29:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 696770560. Throughput: 0: 9019.7, 1: 8881.0. Samples: 696783544. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:48,784][121949] Avg episode reward: [(0, '6343.763'), (1, '5861.130')] [2023-12-26 10:29:48,796][123090] Updated weights for policy 1, policy_version 1356127 (0.0009) [2023-12-26 10:29:49,537][123090] Updated weights for policy 1, policy_version 1356137 (0.0009) [2023-12-26 10:29:49,567][123091] Updated weights for policy 0, policy_version 1365657 (0.0011) [2023-12-26 10:29:49,592][123090] Updated weights for policy 1, policy_version 1356147 (0.0010) [2023-12-26 10:29:49,628][123091] Updated weights for policy 0, policy_version 1365667 (0.0005) [2023-12-26 10:29:49,647][123090] Updated weights for policy 1, policy_version 1356157 (0.0009) [2023-12-26 10:29:49,691][123091] Updated weights for policy 0, policy_version 1365677 (0.0005) [2023-12-26 10:29:50,477][123090] Updated weights for policy 1, policy_version 1356167 (0.0010) [2023-12-26 10:29:50,493][123091] Updated weights for policy 0, policy_version 1365687 (0.0009) [2023-12-26 10:29:50,533][123090] Updated weights for policy 1, policy_version 1356177 (0.0010) [2023-12-26 10:29:50,545][123091] Updated weights for policy 0, policy_version 1365697 (0.0010) [2023-12-26 10:29:50,597][123090] Updated weights for policy 1, policy_version 1356187 (0.0010) [2023-12-26 10:29:50,609][123091] Updated weights for policy 0, policy_version 1365707 (0.0011) [2023-12-26 10:29:51,423][123091] Updated weights for policy 0, policy_version 1365717 (0.0009) [2023-12-26 10:29:51,452][123090] Updated weights for policy 1, policy_version 1356197 (0.0010) [2023-12-26 10:29:51,491][123091] Updated weights for policy 0, policy_version 1365727 (0.0008) [2023-12-26 10:29:51,512][123090] Updated weights for policy 1, policy_version 1356207 (0.0010) [2023-12-26 10:29:51,557][123091] Updated weights for policy 0, policy_version 1365737 (0.0007) [2023-12-26 10:29:51,572][123090] Updated weights for policy 1, policy_version 1356217 (0.0010) [2023-12-26 10:29:52,386][123090] Updated weights for policy 1, policy_version 1356227 (0.0009) [2023-12-26 10:29:52,426][123091] Updated weights for policy 0, policy_version 1365747 (0.0007) [2023-12-26 10:29:52,453][123090] Updated weights for policy 1, policy_version 1356237 (0.0011) [2023-12-26 10:29:52,491][123091] Updated weights for policy 0, policy_version 1365757 (0.0008) [2023-12-26 10:29:52,517][123090] Updated weights for policy 1, policy_version 1356247 (0.0010) [2023-12-26 10:29:52,558][123091] Updated weights for policy 0, policy_version 1365767 (0.0008) [2023-12-26 10:29:53,249][123090] Updated weights for policy 1, policy_version 1356257 (0.0011) [2023-12-26 10:29:53,305][123090] Updated weights for policy 1, policy_version 1356267 (0.0009) [2023-12-26 10:29:53,364][123090] Updated weights for policy 1, policy_version 1356277 (0.0009) [2023-12-26 10:29:53,384][123091] Updated weights for policy 0, policy_version 1365777 (0.0007) [2023-12-26 10:29:53,422][123090] Updated weights for policy 1, policy_version 1356287 (0.0008) [2023-12-26 10:29:53,442][123091] Updated weights for policy 0, policy_version 1365787 (0.0008) [2023-12-26 10:29:53,494][123091] Updated weights for policy 0, policy_version 1365797 (0.0009) [2023-12-26 10:29:53,545][123091] Updated weights for policy 0, policy_version 1365807 (0.0010) [2023-12-26 10:29:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 696860672. Throughput: 0: 8924.1, 1: 8888.7. Samples: 696834892. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:53,785][121949] Avg episode reward: [(0, '6329.293'), (1, '5811.731')] [2023-12-26 10:29:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001365808_349650944.pth... [2023-12-26 10:29:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001356288_347209728.pth... [2023-12-26 10:29:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001364752_349380608.pth [2023-12-26 10:29:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001355264_346947584.pth [2023-12-26 10:29:54,268][123090] Updated weights for policy 1, policy_version 1356297 (0.0009) [2023-12-26 10:29:54,322][123090] Updated weights for policy 1, policy_version 1356307 (0.0009) [2023-12-26 10:29:54,371][123090] Updated weights for policy 1, policy_version 1356317 (0.0006) [2023-12-26 10:29:54,379][123091] Updated weights for policy 0, policy_version 1365817 (0.0009) [2023-12-26 10:29:54,444][123091] Updated weights for policy 0, policy_version 1365827 (0.0009) [2023-12-26 10:29:54,502][123091] Updated weights for policy 0, policy_version 1365838 (0.0011) [2023-12-26 10:29:55,155][123090] Updated weights for policy 1, policy_version 1356327 (0.0006) [2023-12-26 10:29:55,217][123090] Updated weights for policy 1, policy_version 1356337 (0.0005) [2023-12-26 10:29:55,271][123090] Updated weights for policy 1, policy_version 1356347 (0.0005) [2023-12-26 10:29:55,333][123091] Updated weights for policy 0, policy_version 1365848 (0.0006) [2023-12-26 10:29:55,393][123091] Updated weights for policy 0, policy_version 1365858 (0.0005) [2023-12-26 10:29:55,446][123091] Updated weights for policy 0, policy_version 1365868 (0.0005) [2023-12-26 10:29:55,871][123090] Updated weights for policy 1, policy_version 1356357 (0.0005) [2023-12-26 10:29:55,920][123090] Updated weights for policy 1, policy_version 1356367 (0.0005) [2023-12-26 10:29:55,970][123090] Updated weights for policy 1, policy_version 1356377 (0.0005) [2023-12-26 10:29:56,050][123091] Updated weights for policy 0, policy_version 1365878 (0.0006) [2023-12-26 10:29:56,097][123091] Updated weights for policy 0, policy_version 1365888 (0.0006) [2023-12-26 10:29:56,147][123091] Updated weights for policy 0, policy_version 1365898 (0.0005) [2023-12-26 10:29:56,668][123090] Updated weights for policy 1, policy_version 1356387 (0.0005) [2023-12-26 10:29:56,718][123090] Updated weights for policy 1, policy_version 1356397 (0.0005) [2023-12-26 10:29:56,796][123090] Updated weights for policy 1, policy_version 1356407 (0.0006) [2023-12-26 10:29:56,830][123091] Updated weights for policy 0, policy_version 1365908 (0.0007) [2023-12-26 10:29:56,895][123091] Updated weights for policy 0, policy_version 1365918 (0.0006) [2023-12-26 10:29:56,963][123091] Updated weights for policy 0, policy_version 1365928 (0.0005) [2023-12-26 10:29:57,469][123090] Updated weights for policy 1, policy_version 1356417 (0.0007) [2023-12-26 10:29:57,516][123090] Updated weights for policy 1, policy_version 1356427 (0.0007) [2023-12-26 10:29:57,571][123090] Updated weights for policy 1, policy_version 1356437 (0.0005) [2023-12-26 10:29:57,607][123091] Updated weights for policy 0, policy_version 1365938 (0.0005) [2023-12-26 10:29:57,624][123090] Updated weights for policy 1, policy_version 1356447 (0.0005) [2023-12-26 10:29:57,663][123091] Updated weights for policy 0, policy_version 1365948 (0.0005) [2023-12-26 10:29:57,708][123091] Updated weights for policy 0, policy_version 1365958 (0.0005) [2023-12-26 10:29:57,754][123091] Updated weights for policy 0, policy_version 1365968 (0.0005) [2023-12-26 10:29:58,344][123090] Updated weights for policy 1, policy_version 1356457 (0.0009) [2023-12-26 10:29:58,420][123090] Updated weights for policy 1, policy_version 1356467 (0.0011) [2023-12-26 10:29:58,466][123091] Updated weights for policy 0, policy_version 1365978 (0.0008) [2023-12-26 10:29:58,491][123090] Updated weights for policy 1, policy_version 1356477 (0.0011) [2023-12-26 10:29:58,529][123091] Updated weights for policy 0, policy_version 1365988 (0.0008) [2023-12-26 10:29:58,605][123091] Updated weights for policy 0, policy_version 1365998 (0.0009) [2023-12-26 10:29:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17886.0, 300 sec: 17855.8). Total num frames: 696958976. Throughput: 0: 9015.4, 1: 9013.0. Samples: 696947956. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:29:58,784][121949] Avg episode reward: [(0, '6336.020'), (1, '5853.553')] [2023-12-26 10:29:59,350][123090] Updated weights for policy 1, policy_version 1356487 (0.0009) [2023-12-26 10:29:59,417][123090] Updated weights for policy 1, policy_version 1356497 (0.0007) [2023-12-26 10:29:59,470][123091] Updated weights for policy 0, policy_version 1366008 (0.0010) [2023-12-26 10:29:59,488][123090] Updated weights for policy 1, policy_version 1356507 (0.0005) [2023-12-26 10:29:59,529][123091] Updated weights for policy 0, policy_version 1366018 (0.0008) [2023-12-26 10:29:59,595][123091] Updated weights for policy 0, policy_version 1366028 (0.0010) [2023-12-26 10:30:00,258][123091] Updated weights for policy 0, policy_version 1366038 (0.0009) [2023-12-26 10:30:00,307][123090] Updated weights for policy 1, policy_version 1356517 (0.0008) [2023-12-26 10:30:00,322][123091] Updated weights for policy 0, policy_version 1366048 (0.0010) [2023-12-26 10:30:00,371][123090] Updated weights for policy 1, policy_version 1356527 (0.0011) [2023-12-26 10:30:00,385][123091] Updated weights for policy 0, policy_version 1366058 (0.0010) [2023-12-26 10:30:00,436][123090] Updated weights for policy 1, policy_version 1356537 (0.0011) [2023-12-26 10:30:01,206][123091] Updated weights for policy 0, policy_version 1366068 (0.0010) [2023-12-26 10:30:01,254][123090] Updated weights for policy 1, policy_version 1356547 (0.0010) [2023-12-26 10:30:01,279][123091] Updated weights for policy 0, policy_version 1366078 (0.0008) [2023-12-26 10:30:01,320][123090] Updated weights for policy 1, policy_version 1356557 (0.0007) [2023-12-26 10:30:01,344][123091] Updated weights for policy 0, policy_version 1366088 (0.0010) [2023-12-26 10:30:01,389][123090] Updated weights for policy 1, policy_version 1356567 (0.0008) [2023-12-26 10:30:02,093][123090] Updated weights for policy 1, policy_version 1356577 (0.0007) [2023-12-26 10:30:02,142][123090] Updated weights for policy 1, policy_version 1356587 (0.0009) [2023-12-26 10:30:02,190][123091] Updated weights for policy 0, policy_version 1366098 (0.0007) [2023-12-26 10:30:02,194][123090] Updated weights for policy 1, policy_version 1356597 (0.0007) [2023-12-26 10:30:02,239][123091] Updated weights for policy 0, policy_version 1366108 (0.0009) [2023-12-26 10:30:02,253][123090] Updated weights for policy 1, policy_version 1356607 (0.0007) [2023-12-26 10:30:02,309][123091] Updated weights for policy 0, policy_version 1366118 (0.0009) [2023-12-26 10:30:02,372][123091] Updated weights for policy 0, policy_version 1366128 (0.0010) [2023-12-26 10:30:03,087][123090] Updated weights for policy 1, policy_version 1356617 (0.0010) [2023-12-26 10:30:03,151][123090] Updated weights for policy 1, policy_version 1356627 (0.0009) [2023-12-26 10:30:03,217][123090] Updated weights for policy 1, policy_version 1356637 (0.0009) [2023-12-26 10:30:03,235][123091] Updated weights for policy 0, policy_version 1366138 (0.0007) [2023-12-26 10:30:03,282][123091] Updated weights for policy 0, policy_version 1366148 (0.0005) [2023-12-26 10:30:03,330][123091] Updated weights for policy 0, policy_version 1366158 (0.0009) [2023-12-26 10:30:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 697040896. Throughput: 0: 9037.2, 1: 8943.7. Samples: 697053472. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:03,785][121949] Avg episode reward: [(0, '6307.913'), (1, '5768.743')] [2023-12-26 10:30:03,893][123090] Updated weights for policy 1, policy_version 1356647 (0.0008) [2023-12-26 10:30:03,951][123090] Updated weights for policy 1, policy_version 1356657 (0.0005) [2023-12-26 10:30:04,010][123090] Updated weights for policy 1, policy_version 1356667 (0.0005) [2023-12-26 10:30:04,216][123091] Updated weights for policy 0, policy_version 1366168 (0.0010) [2023-12-26 10:30:04,277][123091] Updated weights for policy 0, policy_version 1366178 (0.0010) [2023-12-26 10:30:04,334][123091] Updated weights for policy 0, policy_version 1366188 (0.0009) [2023-12-26 10:30:04,833][123090] Updated weights for policy 1, policy_version 1356677 (0.0007) [2023-12-26 10:30:04,904][123090] Updated weights for policy 1, policy_version 1356687 (0.0005) [2023-12-26 10:30:04,980][123090] Updated weights for policy 1, policy_version 1356697 (0.0006) [2023-12-26 10:30:05,131][123091] Updated weights for policy 0, policy_version 1366198 (0.0006) [2023-12-26 10:30:05,188][123091] Updated weights for policy 0, policy_version 1366208 (0.0005) [2023-12-26 10:30:05,251][123091] Updated weights for policy 0, policy_version 1366218 (0.0005) [2023-12-26 10:30:05,619][123090] Updated weights for policy 1, policy_version 1356707 (0.0006) [2023-12-26 10:30:05,678][123090] Updated weights for policy 1, policy_version 1356717 (0.0005) [2023-12-26 10:30:05,727][123090] Updated weights for policy 1, policy_version 1356727 (0.0005) [2023-12-26 10:30:05,895][123091] Updated weights for policy 0, policy_version 1366228 (0.0005) [2023-12-26 10:30:05,951][123091] Updated weights for policy 0, policy_version 1366238 (0.0005) [2023-12-26 10:30:06,009][123091] Updated weights for policy 0, policy_version 1366248 (0.0006) [2023-12-26 10:30:06,459][123090] Updated weights for policy 1, policy_version 1356737 (0.0006) [2023-12-26 10:30:06,516][123090] Updated weights for policy 1, policy_version 1356747 (0.0011) [2023-12-26 10:30:06,572][123090] Updated weights for policy 1, policy_version 1356757 (0.0011) [2023-12-26 10:30:06,637][123090] Updated weights for policy 1, policy_version 1356767 (0.0011) [2023-12-26 10:30:06,743][123091] Updated weights for policy 0, policy_version 1366258 (0.0007) [2023-12-26 10:30:06,799][123091] Updated weights for policy 0, policy_version 1366268 (0.0009) [2023-12-26 10:30:06,856][123091] Updated weights for policy 0, policy_version 1366278 (0.0009) [2023-12-26 10:30:06,905][123091] Updated weights for policy 0, policy_version 1366288 (0.0009) [2023-12-26 10:30:07,377][123090] Updated weights for policy 1, policy_version 1356777 (0.0010) [2023-12-26 10:30:07,436][123090] Updated weights for policy 1, policy_version 1356787 (0.0010) [2023-12-26 10:30:07,484][123090] Updated weights for policy 1, policy_version 1356797 (0.0010) [2023-12-26 10:30:07,624][123091] Updated weights for policy 0, policy_version 1366298 (0.0009) [2023-12-26 10:30:07,683][123091] Updated weights for policy 0, policy_version 1366308 (0.0008) [2023-12-26 10:30:07,747][123091] Updated weights for policy 0, policy_version 1366318 (0.0009) [2023-12-26 10:30:08,365][123090] Updated weights for policy 1, policy_version 1356807 (0.0010) [2023-12-26 10:30:08,432][123090] Updated weights for policy 1, policy_version 1356817 (0.0011) [2023-12-26 10:30:08,498][123090] Updated weights for policy 1, policy_version 1356827 (0.0011) [2023-12-26 10:30:08,586][123091] Updated weights for policy 0, policy_version 1366328 (0.0009) [2023-12-26 10:30:08,651][123091] Updated weights for policy 0, policy_version 1366338 (0.0010) [2023-12-26 10:30:08,719][123091] Updated weights for policy 0, policy_version 1366348 (0.0008) [2023-12-26 10:30:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 697139200. Throughput: 0: 9121.6, 1: 9006.6. Samples: 697111048. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:08,785][121949] Avg episode reward: [(0, '6323.976'), (1, '5701.547')] [2023-12-26 10:30:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001366352_349790208.pth... [2023-12-26 10:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001356832_347348992.pth... [2023-12-26 10:30:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001365296_349519872.pth [2023-12-26 10:30:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001355776_347078656.pth [2023-12-26 10:30:09,298][123090] Updated weights for policy 1, policy_version 1356837 (0.0011) [2023-12-26 10:30:09,359][123090] Updated weights for policy 1, policy_version 1356847 (0.0010) [2023-12-26 10:30:09,433][123090] Updated weights for policy 1, policy_version 1356857 (0.0008) [2023-12-26 10:30:09,553][123091] Updated weights for policy 0, policy_version 1366358 (0.0007) [2023-12-26 10:30:09,609][123091] Updated weights for policy 0, policy_version 1366368 (0.0005) [2023-12-26 10:30:09,665][123091] Updated weights for policy 0, policy_version 1366378 (0.0006) [2023-12-26 10:30:10,364][123090] Updated weights for policy 1, policy_version 1356867 (0.0009) [2023-12-26 10:30:10,420][123090] Updated weights for policy 1, policy_version 1356877 (0.0009) [2023-12-26 10:30:10,433][123091] Updated weights for policy 0, policy_version 1366388 (0.0010) [2023-12-26 10:30:10,481][123090] Updated weights for policy 1, policy_version 1356887 (0.0010) [2023-12-26 10:30:10,492][123091] Updated weights for policy 0, policy_version 1366398 (0.0011) [2023-12-26 10:30:10,559][123091] Updated weights for policy 0, policy_version 1366408 (0.0008) [2023-12-26 10:30:11,277][123091] Updated weights for policy 0, policy_version 1366418 (0.0007) [2023-12-26 10:30:11,343][123091] Updated weights for policy 0, policy_version 1366428 (0.0009) [2023-12-26 10:30:11,365][123090] Updated weights for policy 1, policy_version 1356897 (0.0008) [2023-12-26 10:30:11,405][123091] Updated weights for policy 0, policy_version 1366438 (0.0009) [2023-12-26 10:30:11,435][123090] Updated weights for policy 1, policy_version 1356907 (0.0009) [2023-12-26 10:30:11,453][123091] Updated weights for policy 0, policy_version 1366448 (0.0009) [2023-12-26 10:30:11,499][123090] Updated weights for policy 1, policy_version 1356918 (0.0009) [2023-12-26 10:30:11,561][123090] Updated weights for policy 1, policy_version 1356928 (0.0009) [2023-12-26 10:30:12,411][123091] Updated weights for policy 0, policy_version 1366458 (0.0009) [2023-12-26 10:30:12,463][123090] Updated weights for policy 1, policy_version 1356938 (0.0009) [2023-12-26 10:30:12,472][123091] Updated weights for policy 0, policy_version 1366468 (0.0009) [2023-12-26 10:30:12,511][123090] Updated weights for policy 1, policy_version 1356948 (0.0009) [2023-12-26 10:30:12,531][123091] Updated weights for policy 0, policy_version 1366478 (0.0008) [2023-12-26 10:30:12,584][123090] Updated weights for policy 1, policy_version 1356958 (0.0010) [2023-12-26 10:30:13,209][123091] Updated weights for policy 0, policy_version 1366488 (0.0005) [2023-12-26 10:30:13,265][123091] Updated weights for policy 0, policy_version 1366498 (0.0009) [2023-12-26 10:30:13,313][123091] Updated weights for policy 0, policy_version 1366508 (0.0010) [2023-12-26 10:30:13,499][123090] Updated weights for policy 1, policy_version 1356968 (0.0010) [2023-12-26 10:30:13,554][123090] Updated weights for policy 1, policy_version 1356978 (0.0010) [2023-12-26 10:30:13,614][123090] Updated weights for policy 1, policy_version 1356988 (0.0006) [2023-12-26 10:30:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 697221120. Throughput: 0: 8983.9, 1: 8867.0. Samples: 697212384. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:13,784][121949] Avg episode reward: [(0, '6282.553'), (1, '5782.623')] [2023-12-26 10:30:14,041][123091] Updated weights for policy 0, policy_version 1366518 (0.0007) [2023-12-26 10:30:14,113][123091] Updated weights for policy 0, policy_version 1366528 (0.0009) [2023-12-26 10:30:14,173][123091] Updated weights for policy 0, policy_version 1366538 (0.0011) [2023-12-26 10:30:14,372][123090] Updated weights for policy 1, policy_version 1356998 (0.0009) [2023-12-26 10:30:14,436][123090] Updated weights for policy 1, policy_version 1357008 (0.0011) [2023-12-26 10:30:14,496][123090] Updated weights for policy 1, policy_version 1357018 (0.0011) [2023-12-26 10:30:14,941][123091] Updated weights for policy 0, policy_version 1366548 (0.0008) [2023-12-26 10:30:15,013][123091] Updated weights for policy 0, policy_version 1366558 (0.0011) [2023-12-26 10:30:15,082][123091] Updated weights for policy 0, policy_version 1366568 (0.0011) [2023-12-26 10:30:15,382][123090] Updated weights for policy 1, policy_version 1357028 (0.0009) [2023-12-26 10:30:15,462][123090] Updated weights for policy 1, policy_version 1357038 (0.0006) [2023-12-26 10:30:15,541][123090] Updated weights for policy 1, policy_version 1357048 (0.0005) [2023-12-26 10:30:15,801][123091] Updated weights for policy 0, policy_version 1366578 (0.0010) [2023-12-26 10:30:15,848][123091] Updated weights for policy 0, policy_version 1366588 (0.0008) [2023-12-26 10:30:15,902][123091] Updated weights for policy 0, policy_version 1366598 (0.0008) [2023-12-26 10:30:15,955][123091] Updated weights for policy 0, policy_version 1366608 (0.0008) [2023-12-26 10:30:16,203][123090] Updated weights for policy 1, policy_version 1357058 (0.0007) [2023-12-26 10:30:16,265][123090] Updated weights for policy 1, policy_version 1357068 (0.0006) [2023-12-26 10:30:16,325][123090] Updated weights for policy 1, policy_version 1357080 (0.0010) [2023-12-26 10:30:16,636][123091] Updated weights for policy 0, policy_version 1366618 (0.0011) [2023-12-26 10:30:16,704][123091] Updated weights for policy 0, policy_version 1366628 (0.0006) [2023-12-26 10:30:16,763][123091] Updated weights for policy 0, policy_version 1366638 (0.0006) [2023-12-26 10:30:17,182][123090] Updated weights for policy 1, policy_version 1357090 (0.0009) [2023-12-26 10:30:17,237][123090] Updated weights for policy 1, policy_version 1357100 (0.0008) [2023-12-26 10:30:17,294][123090] Updated weights for policy 1, policy_version 1357110 (0.0008) [2023-12-26 10:30:17,359][123090] Updated weights for policy 1, policy_version 1357120 (0.0009) [2023-12-26 10:30:17,537][123091] Updated weights for policy 0, policy_version 1366648 (0.0008) [2023-12-26 10:30:17,597][123091] Updated weights for policy 0, policy_version 1366658 (0.0010) [2023-12-26 10:30:17,662][123091] Updated weights for policy 0, policy_version 1366668 (0.0011) [2023-12-26 10:30:18,196][123090] Updated weights for policy 1, policy_version 1357130 (0.0010) [2023-12-26 10:30:18,269][123090] Updated weights for policy 1, policy_version 1357140 (0.0011) [2023-12-26 10:30:18,343][123090] Updated weights for policy 1, policy_version 1357150 (0.0009) [2023-12-26 10:30:18,366][123091] Updated weights for policy 0, policy_version 1366678 (0.0009) [2023-12-26 10:30:18,437][123091] Updated weights for policy 0, policy_version 1366688 (0.0008) [2023-12-26 10:30:18,499][123091] Updated weights for policy 0, policy_version 1366698 (0.0006) [2023-12-26 10:30:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 697311232. Throughput: 0: 9023.8, 1: 8794.7. Samples: 697321440. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:18,784][121949] Avg episode reward: [(0, '6288.056'), (1, '5857.144')] [2023-12-26 10:30:19,217][123091] Updated weights for policy 0, policy_version 1366708 (0.0007) [2023-12-26 10:30:19,280][123090] Updated weights for policy 1, policy_version 1357160 (0.0009) [2023-12-26 10:30:19,290][123091] Updated weights for policy 0, policy_version 1366718 (0.0008) [2023-12-26 10:30:19,342][123090] Updated weights for policy 1, policy_version 1357170 (0.0009) [2023-12-26 10:30:19,355][123091] Updated weights for policy 0, policy_version 1366728 (0.0009) [2023-12-26 10:30:19,416][123090] Updated weights for policy 1, policy_version 1357180 (0.0009) [2023-12-26 10:30:20,138][123091] Updated weights for policy 0, policy_version 1366738 (0.0010) [2023-12-26 10:30:20,192][123091] Updated weights for policy 0, policy_version 1366748 (0.0009) [2023-12-26 10:30:20,254][123091] Updated weights for policy 0, policy_version 1366758 (0.0009) [2023-12-26 10:30:20,259][123090] Updated weights for policy 1, policy_version 1357190 (0.0009) [2023-12-26 10:30:20,325][123091] Updated weights for policy 0, policy_version 1366768 (0.0009) [2023-12-26 10:30:20,329][123090] Updated weights for policy 1, policy_version 1357200 (0.0008) [2023-12-26 10:30:20,396][123090] Updated weights for policy 1, policy_version 1357210 (0.0009) [2023-12-26 10:30:21,190][123091] Updated weights for policy 0, policy_version 1366778 (0.0010) [2023-12-26 10:30:21,250][123091] Updated weights for policy 0, policy_version 1366788 (0.0010) [2023-12-26 10:30:21,302][123090] Updated weights for policy 1, policy_version 1357220 (0.0009) [2023-12-26 10:30:21,313][123091] Updated weights for policy 0, policy_version 1366798 (0.0008) [2023-12-26 10:30:21,371][123090] Updated weights for policy 1, policy_version 1357230 (0.0009) [2023-12-26 10:30:21,443][123090] Updated weights for policy 1, policy_version 1357240 (0.0010) [2023-12-26 10:30:22,223][123091] Updated weights for policy 0, policy_version 1366808 (0.0008) [2023-12-26 10:30:22,296][123091] Updated weights for policy 0, policy_version 1366818 (0.0008) [2023-12-26 10:30:22,332][123090] Updated weights for policy 1, policy_version 1357250 (0.0009) [2023-12-26 10:30:22,368][123091] Updated weights for policy 0, policy_version 1366828 (0.0008) [2023-12-26 10:30:22,408][123090] Updated weights for policy 1, policy_version 1357260 (0.0008) [2023-12-26 10:30:22,480][123090] Updated weights for policy 1, policy_version 1357270 (0.0008) [2023-12-26 10:30:22,548][123090] Updated weights for policy 1, policy_version 1357280 (0.0009) [2023-12-26 10:30:23,191][123091] Updated weights for policy 0, policy_version 1366838 (0.0009) [2023-12-26 10:30:23,259][123091] Updated weights for policy 0, policy_version 1366848 (0.0009) [2023-12-26 10:30:23,329][123091] Updated weights for policy 0, policy_version 1366858 (0.0009) [2023-12-26 10:30:23,376][123090] Updated weights for policy 1, policy_version 1357290 (0.0009) [2023-12-26 10:30:23,437][123090] Updated weights for policy 1, policy_version 1357300 (0.0009) [2023-12-26 10:30:23,502][123090] Updated weights for policy 1, policy_version 1357310 (0.0010) [2023-12-26 10:30:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 697393152. Throughput: 0: 8972.4, 1: 8734.5. Samples: 697370036. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:23,785][121949] Avg episode reward: [(0, '6369.309'), (1, '5931.150')] [2023-12-26 10:30:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001366864_349921280.pth... [2023-12-26 10:30:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001357312_347471872.pth... [2023-12-26 10:30:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001365808_349650944.pth [2023-12-26 10:30:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001356288_347209728.pth [2023-12-26 10:30:24,148][123091] Updated weights for policy 0, policy_version 1366868 (0.0008) [2023-12-26 10:30:24,216][123091] Updated weights for policy 0, policy_version 1366878 (0.0008) [2023-12-26 10:30:24,276][123091] Updated weights for policy 0, policy_version 1366889 (0.0009) [2023-12-26 10:30:24,322][123090] Updated weights for policy 1, policy_version 1357320 (0.0008) [2023-12-26 10:30:24,378][123090] Updated weights for policy 1, policy_version 1357330 (0.0008) [2023-12-26 10:30:24,432][123090] Updated weights for policy 1, policy_version 1357340 (0.0006) [2023-12-26 10:30:25,123][123091] Updated weights for policy 0, policy_version 1366899 (0.0009) [2023-12-26 10:30:25,182][123091] Updated weights for policy 0, policy_version 1366909 (0.0009) [2023-12-26 10:30:25,246][123091] Updated weights for policy 0, policy_version 1366919 (0.0009) [2023-12-26 10:30:25,265][123090] Updated weights for policy 1, policy_version 1357350 (0.0010) [2023-12-26 10:30:25,329][123090] Updated weights for policy 1, policy_version 1357360 (0.0011) [2023-12-26 10:30:25,395][123090] Updated weights for policy 1, policy_version 1357370 (0.0010) [2023-12-26 10:30:26,029][123091] Updated weights for policy 0, policy_version 1366929 (0.0007) [2023-12-26 10:30:26,090][123091] Updated weights for policy 0, policy_version 1366939 (0.0011) [2023-12-26 10:30:26,154][123091] Updated weights for policy 0, policy_version 1366949 (0.0011) [2023-12-26 10:30:26,216][123091] Updated weights for policy 0, policy_version 1366959 (0.0011) [2023-12-26 10:30:26,234][123090] Updated weights for policy 1, policy_version 1357380 (0.0011) [2023-12-26 10:30:26,285][123090] Updated weights for policy 1, policy_version 1357390 (0.0010) [2023-12-26 10:30:26,332][123090] Updated weights for policy 1, policy_version 1357400 (0.0010) [2023-12-26 10:30:26,966][123091] Updated weights for policy 0, policy_version 1366969 (0.0006) [2023-12-26 10:30:27,033][123091] Updated weights for policy 0, policy_version 1366979 (0.0008) [2023-12-26 10:30:27,080][123091] Updated weights for policy 0, policy_version 1366989 (0.0010) [2023-12-26 10:30:27,104][123090] Updated weights for policy 1, policy_version 1357410 (0.0009) [2023-12-26 10:30:27,162][123090] Updated weights for policy 1, policy_version 1357420 (0.0010) [2023-12-26 10:30:27,209][123090] Updated weights for policy 1, policy_version 1357430 (0.0010) [2023-12-26 10:30:27,259][123090] Updated weights for policy 1, policy_version 1357440 (0.0010) [2023-12-26 10:30:27,880][123091] Updated weights for policy 0, policy_version 1366999 (0.0009) [2023-12-26 10:30:27,955][123091] Updated weights for policy 0, policy_version 1367009 (0.0008) [2023-12-26 10:30:28,014][123091] Updated weights for policy 0, policy_version 1367019 (0.0006) [2023-12-26 10:30:28,023][123090] Updated weights for policy 1, policy_version 1357450 (0.0005) [2023-12-26 10:30:28,070][123090] Updated weights for policy 1, policy_version 1357460 (0.0005) [2023-12-26 10:30:28,115][123090] Updated weights for policy 1, policy_version 1357470 (0.0005) [2023-12-26 10:30:28,689][123091] Updated weights for policy 0, policy_version 1367030 (0.0007) [2023-12-26 10:30:28,753][123091] Updated weights for policy 0, policy_version 1367040 (0.0006) [2023-12-26 10:30:28,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 697475072. Throughput: 0: 8948.9, 1: 8703.1. Samples: 697473196. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:28,785][121949] Avg episode reward: [(0, '6350.999'), (1, '5872.337')] [2023-12-26 10:30:28,807][123090] Updated weights for policy 1, policy_version 1357480 (0.0008) [2023-12-26 10:30:28,815][123091] Updated weights for policy 0, policy_version 1367050 (0.0006) [2023-12-26 10:30:28,867][123090] Updated weights for policy 1, policy_version 1357490 (0.0008) [2023-12-26 10:30:28,931][123090] Updated weights for policy 1, policy_version 1357500 (0.0009) [2023-12-26 10:30:29,645][123091] Updated weights for policy 0, policy_version 1367060 (0.0010) [2023-12-26 10:30:29,694][123091] Updated weights for policy 0, policy_version 1367070 (0.0009) [2023-12-26 10:30:29,744][123091] Updated weights for policy 0, policy_version 1367080 (0.0009) [2023-12-26 10:30:29,761][123090] Updated weights for policy 1, policy_version 1357510 (0.0007) [2023-12-26 10:30:29,810][123090] Updated weights for policy 1, policy_version 1357520 (0.0009) [2023-12-26 10:30:29,881][123090] Updated weights for policy 1, policy_version 1357530 (0.0010) [2023-12-26 10:30:30,562][123091] Updated weights for policy 0, policy_version 1367090 (0.0008) [2023-12-26 10:30:30,616][123091] Updated weights for policy 0, policy_version 1367100 (0.0007) [2023-12-26 10:30:30,669][123091] Updated weights for policy 0, policy_version 1367111 (0.0009) [2023-12-26 10:30:30,737][123090] Updated weights for policy 1, policy_version 1357540 (0.0008) [2023-12-26 10:30:30,796][123090] Updated weights for policy 1, policy_version 1357551 (0.0008) [2023-12-26 10:30:30,865][123090] Updated weights for policy 1, policy_version 1357561 (0.0007) [2023-12-26 10:30:31,524][123091] Updated weights for policy 0, policy_version 1367121 (0.0009) [2023-12-26 10:30:31,601][123091] Updated weights for policy 0, policy_version 1367131 (0.0006) [2023-12-26 10:30:31,655][123090] Updated weights for policy 1, policy_version 1357571 (0.0010) [2023-12-26 10:30:31,670][123091] Updated weights for policy 0, policy_version 1367141 (0.0008) [2023-12-26 10:30:31,723][123090] Updated weights for policy 1, policy_version 1357581 (0.0011) [2023-12-26 10:30:31,735][123091] Updated weights for policy 0, policy_version 1367151 (0.0008) [2023-12-26 10:30:31,790][123090] Updated weights for policy 1, policy_version 1357591 (0.0010) [2023-12-26 10:30:32,477][123091] Updated weights for policy 0, policy_version 1367161 (0.0007) [2023-12-26 10:30:32,541][123091] Updated weights for policy 0, policy_version 1367171 (0.0009) [2023-12-26 10:30:32,611][123090] Updated weights for policy 1, policy_version 1357601 (0.0006) [2023-12-26 10:30:32,613][123091] Updated weights for policy 0, policy_version 1367181 (0.0009) [2023-12-26 10:30:32,681][123090] Updated weights for policy 1, policy_version 1357611 (0.0011) [2023-12-26 10:30:32,747][123090] Updated weights for policy 1, policy_version 1357621 (0.0010) [2023-12-26 10:30:32,813][123090] Updated weights for policy 1, policy_version 1357631 (0.0006) [2023-12-26 10:30:33,355][123091] Updated weights for policy 0, policy_version 1367191 (0.0008) [2023-12-26 10:30:33,426][123091] Updated weights for policy 0, policy_version 1367201 (0.0009) [2023-12-26 10:30:33,497][123091] Updated weights for policy 0, policy_version 1367211 (0.0009) [2023-12-26 10:30:33,618][123090] Updated weights for policy 1, policy_version 1357641 (0.0006) [2023-12-26 10:30:33,681][123090] Updated weights for policy 1, policy_version 1357651 (0.0006) [2023-12-26 10:30:33,733][123090] Updated weights for policy 1, policy_version 1357661 (0.0005) [2023-12-26 10:30:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 697573376. Throughput: 0: 8964.8, 1: 8739.9. Samples: 697580256. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:33,785][121949] Avg episode reward: [(0, '6329.455'), (1, '5794.354')] [2023-12-26 10:30:34,195][123091] Updated weights for policy 0, policy_version 1367221 (0.0009) [2023-12-26 10:30:34,249][123091] Updated weights for policy 0, policy_version 1367231 (0.0010) [2023-12-26 10:30:34,308][123091] Updated weights for policy 0, policy_version 1367241 (0.0009) [2023-12-26 10:30:34,394][123090] Updated weights for policy 1, policy_version 1357671 (0.0006) [2023-12-26 10:30:34,447][123090] Updated weights for policy 1, policy_version 1357681 (0.0010) [2023-12-26 10:30:34,503][123090] Updated weights for policy 1, policy_version 1357691 (0.0011) [2023-12-26 10:30:35,141][123091] Updated weights for policy 0, policy_version 1367251 (0.0009) [2023-12-26 10:30:35,189][123091] Updated weights for policy 0, policy_version 1367261 (0.0009) [2023-12-26 10:30:35,240][123091] Updated weights for policy 0, policy_version 1367271 (0.0009) [2023-12-26 10:30:35,321][123090] Updated weights for policy 1, policy_version 1357701 (0.0008) [2023-12-26 10:30:35,369][123090] Updated weights for policy 1, policy_version 1357711 (0.0005) [2023-12-26 10:30:35,424][123090] Updated weights for policy 1, policy_version 1357721 (0.0005) [2023-12-26 10:30:36,132][123091] Updated weights for policy 0, policy_version 1367281 (0.0010) [2023-12-26 10:30:36,199][123091] Updated weights for policy 0, policy_version 1367291 (0.0009) [2023-12-26 10:30:36,226][123090] Updated weights for policy 1, policy_version 1357731 (0.0006) [2023-12-26 10:30:36,258][123091] Updated weights for policy 0, policy_version 1367301 (0.0009) [2023-12-26 10:30:36,286][123090] Updated weights for policy 1, policy_version 1357741 (0.0008) [2023-12-26 10:30:36,315][123091] Updated weights for policy 0, policy_version 1367311 (0.0006) [2023-12-26 10:30:36,349][123090] Updated weights for policy 1, policy_version 1357751 (0.0008) [2023-12-26 10:30:36,971][123091] Updated weights for policy 0, policy_version 1367321 (0.0007) [2023-12-26 10:30:37,032][123091] Updated weights for policy 0, policy_version 1367331 (0.0010) [2023-12-26 10:30:37,094][123091] Updated weights for policy 0, policy_version 1367341 (0.0010) [2023-12-26 10:30:37,220][123090] Updated weights for policy 1, policy_version 1357761 (0.0008) [2023-12-26 10:30:37,277][123090] Updated weights for policy 1, policy_version 1357771 (0.0009) [2023-12-26 10:30:37,335][123090] Updated weights for policy 1, policy_version 1357781 (0.0010) [2023-12-26 10:30:37,389][123090] Updated weights for policy 1, policy_version 1357791 (0.0010) [2023-12-26 10:30:37,883][123091] Updated weights for policy 0, policy_version 1367351 (0.0009) [2023-12-26 10:30:37,936][123091] Updated weights for policy 0, policy_version 1367361 (0.0008) [2023-12-26 10:30:38,000][123091] Updated weights for policy 0, policy_version 1367371 (0.0009) [2023-12-26 10:30:38,271][123090] Updated weights for policy 1, policy_version 1357801 (0.0010) [2023-12-26 10:30:38,335][123090] Updated weights for policy 1, policy_version 1357811 (0.0010) [2023-12-26 10:30:38,387][123090] Updated weights for policy 1, policy_version 1357821 (0.0009) [2023-12-26 10:30:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 697655296. Throughput: 0: 8971.7, 1: 8784.6. Samples: 697633924. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:38,785][121949] Avg episode reward: [(0, '6359.001'), (1, '5840.490')] [2023-12-26 10:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001367376_350052352.pth... [2023-12-26 10:30:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001357824_347602944.pth... [2023-12-26 10:30:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001366352_349790208.pth [2023-12-26 10:30:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001356832_347348992.pth [2023-12-26 10:30:38,855][123091] Updated weights for policy 0, policy_version 1367381 (0.0010) [2023-12-26 10:30:38,920][123091] Updated weights for policy 0, policy_version 1367391 (0.0010) [2023-12-26 10:30:38,989][123091] Updated weights for policy 0, policy_version 1367401 (0.0010) [2023-12-26 10:30:39,238][123090] Updated weights for policy 1, policy_version 1357831 (0.0009) [2023-12-26 10:30:39,303][123090] Updated weights for policy 1, policy_version 1357841 (0.0009) [2023-12-26 10:30:39,372][123090] Updated weights for policy 1, policy_version 1357851 (0.0009) [2023-12-26 10:30:39,843][123091] Updated weights for policy 0, policy_version 1367411 (0.0011) [2023-12-26 10:30:39,907][123091] Updated weights for policy 0, policy_version 1367421 (0.0011) [2023-12-26 10:30:39,970][123091] Updated weights for policy 0, policy_version 1367431 (0.0011) [2023-12-26 10:30:40,237][123090] Updated weights for policy 1, policy_version 1357861 (0.0009) [2023-12-26 10:30:40,286][123090] Updated weights for policy 1, policy_version 1357871 (0.0009) [2023-12-26 10:30:40,343][123090] Updated weights for policy 1, policy_version 1357881 (0.0009) [2023-12-26 10:30:40,826][123091] Updated weights for policy 0, policy_version 1367441 (0.0011) [2023-12-26 10:30:40,877][123091] Updated weights for policy 0, policy_version 1367451 (0.0010) [2023-12-26 10:30:40,939][123091] Updated weights for policy 0, policy_version 1367461 (0.0010) [2023-12-26 10:30:41,001][123091] Updated weights for policy 0, policy_version 1367471 (0.0010) [2023-12-26 10:30:41,199][123090] Updated weights for policy 1, policy_version 1357891 (0.0008) [2023-12-26 10:30:41,264][123090] Updated weights for policy 1, policy_version 1357901 (0.0008) [2023-12-26 10:30:41,325][123090] Updated weights for policy 1, policy_version 1357911 (0.0009) [2023-12-26 10:30:41,907][123091] Updated weights for policy 0, policy_version 1367481 (0.0010) [2023-12-26 10:30:41,977][123091] Updated weights for policy 0, policy_version 1367491 (0.0006) [2023-12-26 10:30:42,047][123091] Updated weights for policy 0, policy_version 1367501 (0.0008) [2023-12-26 10:30:42,119][123090] Updated weights for policy 1, policy_version 1357921 (0.0009) [2023-12-26 10:30:42,176][123090] Updated weights for policy 1, policy_version 1357931 (0.0009) [2023-12-26 10:30:42,246][123090] Updated weights for policy 1, policy_version 1357941 (0.0009) [2023-12-26 10:30:42,323][123090] Updated weights for policy 1, policy_version 1357951 (0.0008) [2023-12-26 10:30:42,824][123091] Updated weights for policy 0, policy_version 1367511 (0.0009) [2023-12-26 10:30:42,885][123091] Updated weights for policy 0, policy_version 1367521 (0.0010) [2023-12-26 10:30:42,943][123091] Updated weights for policy 0, policy_version 1367531 (0.0010) [2023-12-26 10:30:43,098][123090] Updated weights for policy 1, policy_version 1357961 (0.0006) [2023-12-26 10:30:43,151][123090] Updated weights for policy 1, policy_version 1357971 (0.0005) [2023-12-26 10:30:43,197][123090] Updated weights for policy 1, policy_version 1357981 (0.0005) [2023-12-26 10:30:43,718][123091] Updated weights for policy 0, policy_version 1367542 (0.0008) [2023-12-26 10:30:43,782][123091] Updated weights for policy 0, policy_version 1367552 (0.0006) [2023-12-26 10:30:43,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 697737216. Throughput: 0: 8868.8, 1: 8622.1. Samples: 697735048. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:43,785][121949] Avg episode reward: [(0, '6232.343'), (1, '5813.816')] [2023-12-26 10:30:43,845][123091] Updated weights for policy 0, policy_version 1367562 (0.0006) [2023-12-26 10:30:43,880][123090] Updated weights for policy 1, policy_version 1357991 (0.0006) [2023-12-26 10:30:43,952][123090] Updated weights for policy 1, policy_version 1358001 (0.0009) [2023-12-26 10:30:44,020][123090] Updated weights for policy 1, policy_version 1358011 (0.0009) [2023-12-26 10:30:44,527][123091] Updated weights for policy 0, policy_version 1367572 (0.0008) [2023-12-26 10:30:44,577][123091] Updated weights for policy 0, policy_version 1367582 (0.0008) [2023-12-26 10:30:44,625][123091] Updated weights for policy 0, policy_version 1367592 (0.0009) [2023-12-26 10:30:44,780][123090] Updated weights for policy 1, policy_version 1358021 (0.0009) [2023-12-26 10:30:44,842][123090] Updated weights for policy 1, policy_version 1358031 (0.0009) [2023-12-26 10:30:44,909][123090] Updated weights for policy 1, policy_version 1358041 (0.0010) [2023-12-26 10:30:45,426][123091] Updated weights for policy 0, policy_version 1367603 (0.0010) [2023-12-26 10:30:45,485][123091] Updated weights for policy 0, policy_version 1367613 (0.0010) [2023-12-26 10:30:45,542][123091] Updated weights for policy 0, policy_version 1367623 (0.0009) [2023-12-26 10:30:45,780][123090] Updated weights for policy 1, policy_version 1358051 (0.0010) [2023-12-26 10:30:45,842][123090] Updated weights for policy 1, policy_version 1358061 (0.0010) [2023-12-26 10:30:45,911][123090] Updated weights for policy 1, policy_version 1358071 (0.0010) [2023-12-26 10:30:46,352][123091] Updated weights for policy 0, policy_version 1367633 (0.0010) [2023-12-26 10:30:46,416][123091] Updated weights for policy 0, policy_version 1367643 (0.0009) [2023-12-26 10:30:46,473][123091] Updated weights for policy 0, policy_version 1367653 (0.0009) [2023-12-26 10:30:46,538][123091] Updated weights for policy 0, policy_version 1367663 (0.0009) [2023-12-26 10:30:46,782][123090] Updated weights for policy 1, policy_version 1358081 (0.0010) [2023-12-26 10:30:46,857][123090] Updated weights for policy 1, policy_version 1358091 (0.0009) [2023-12-26 10:30:46,917][123090] Updated weights for policy 1, policy_version 1358101 (0.0009) [2023-12-26 10:30:46,974][123090] Updated weights for policy 1, policy_version 1358111 (0.0009) [2023-12-26 10:30:47,262][123091] Updated weights for policy 0, policy_version 1367673 (0.0006) [2023-12-26 10:30:47,315][123091] Updated weights for policy 0, policy_version 1367683 (0.0006) [2023-12-26 10:30:47,391][123091] Updated weights for policy 0, policy_version 1367693 (0.0006) [2023-12-26 10:30:47,866][123090] Updated weights for policy 1, policy_version 1358122 (0.0010) [2023-12-26 10:30:47,918][123090] Updated weights for policy 1, policy_version 1358132 (0.0009) [2023-12-26 10:30:47,982][123090] Updated weights for policy 1, policy_version 1358142 (0.0010) [2023-12-26 10:30:48,062][123091] Updated weights for policy 0, policy_version 1367703 (0.0009) [2023-12-26 10:30:48,125][123091] Updated weights for policy 0, policy_version 1367713 (0.0010) [2023-12-26 10:30:48,187][123091] Updated weights for policy 0, policy_version 1367723 (0.0009) [2023-12-26 10:30:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 697827328. Throughput: 0: 8935.5, 1: 8611.7. Samples: 697843092. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:48,785][121949] Avg episode reward: [(0, '6270.549'), (1, '5882.205')] [2023-12-26 10:30:48,873][123090] Updated weights for policy 1, policy_version 1358152 (0.0009) [2023-12-26 10:30:48,930][123090] Updated weights for policy 1, policy_version 1358162 (0.0009) [2023-12-26 10:30:48,954][123091] Updated weights for policy 0, policy_version 1367733 (0.0005) [2023-12-26 10:30:48,989][123090] Updated weights for policy 1, policy_version 1358173 (0.0011) [2023-12-26 10:30:49,012][123091] Updated weights for policy 0, policy_version 1367743 (0.0005) [2023-12-26 10:30:49,065][123091] Updated weights for policy 0, policy_version 1367753 (0.0006) [2023-12-26 10:30:49,840][123091] Updated weights for policy 0, policy_version 1367763 (0.0010) [2023-12-26 10:30:49,877][123090] Updated weights for policy 1, policy_version 1358183 (0.0009) [2023-12-26 10:30:49,899][123091] Updated weights for policy 0, policy_version 1367773 (0.0010) [2023-12-26 10:30:49,950][123090] Updated weights for policy 1, policy_version 1358193 (0.0009) [2023-12-26 10:30:49,965][123091] Updated weights for policy 0, policy_version 1367783 (0.0010) [2023-12-26 10:30:50,004][123090] Updated weights for policy 1, policy_version 1358203 (0.0008) [2023-12-26 10:30:50,822][123091] Updated weights for policy 0, policy_version 1367793 (0.0007) [2023-12-26 10:30:50,867][123090] Updated weights for policy 1, policy_version 1358213 (0.0010) [2023-12-26 10:30:50,870][123091] Updated weights for policy 0, policy_version 1367803 (0.0008) [2023-12-26 10:30:50,917][123091] Updated weights for policy 0, policy_version 1367813 (0.0008) [2023-12-26 10:30:50,928][123090] Updated weights for policy 1, policy_version 1358223 (0.0008) [2023-12-26 10:30:50,980][123091] Updated weights for policy 0, policy_version 1367823 (0.0008) [2023-12-26 10:30:50,993][123090] Updated weights for policy 1, policy_version 1358233 (0.0007) [2023-12-26 10:30:51,791][123091] Updated weights for policy 0, policy_version 1367833 (0.0008) [2023-12-26 10:30:51,867][123091] Updated weights for policy 0, policy_version 1367843 (0.0008) [2023-12-26 10:30:51,893][123090] Updated weights for policy 1, policy_version 1358243 (0.0009) [2023-12-26 10:30:51,931][123091] Updated weights for policy 0, policy_version 1367853 (0.0008) [2023-12-26 10:30:51,962][123090] Updated weights for policy 1, policy_version 1358253 (0.0009) [2023-12-26 10:30:52,017][123090] Updated weights for policy 1, policy_version 1358263 (0.0010) [2023-12-26 10:30:52,760][123091] Updated weights for policy 0, policy_version 1367863 (0.0009) [2023-12-26 10:30:52,808][123091] Updated weights for policy 0, policy_version 1367873 (0.0009) [2023-12-26 10:30:52,843][123090] Updated weights for policy 1, policy_version 1358273 (0.0009) [2023-12-26 10:30:52,860][123091] Updated weights for policy 0, policy_version 1367883 (0.0008) [2023-12-26 10:30:52,895][123090] Updated weights for policy 1, policy_version 1358283 (0.0010) [2023-12-26 10:30:52,950][123090] Updated weights for policy 1, policy_version 1358293 (0.0010) [2023-12-26 10:30:53,002][123090] Updated weights for policy 1, policy_version 1358303 (0.0009) [2023-12-26 10:30:53,744][123090] Updated weights for policy 1, policy_version 1358313 (0.0005) [2023-12-26 10:30:53,783][123091] Updated weights for policy 0, policy_version 1367893 (0.0010) [2023-12-26 10:30:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 697909248. Throughput: 0: 8900.4, 1: 8488.1. Samples: 697893528. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:53,785][121949] Avg episode reward: [(0, '6348.998'), (1, '5880.729')] [2023-12-26 10:30:53,798][123090] Updated weights for policy 1, policy_version 1358323 (0.0005) [2023-12-26 10:30:53,839][123091] Updated weights for policy 0, policy_version 1367903 (0.0009) [2023-12-26 10:30:53,860][123090] Updated weights for policy 1, policy_version 1358333 (0.0005) [2023-12-26 10:30:53,876][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001358336_347734016.pth... [2023-12-26 10:30:53,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001357312_347471872.pth [2023-12-26 10:30:53,894][123091] Updated weights for policy 0, policy_version 1367913 (0.0010) [2023-12-26 10:30:53,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001367920_350191616.pth... [2023-12-26 10:30:53,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001366864_349921280.pth [2023-12-26 10:30:54,456][123090] Updated weights for policy 1, policy_version 1358343 (0.0005) [2023-12-26 10:30:54,532][123090] Updated weights for policy 1, policy_version 1358353 (0.0009) [2023-12-26 10:30:54,597][123090] Updated weights for policy 1, policy_version 1358363 (0.0010) [2023-12-26 10:30:54,817][123091] Updated weights for policy 0, policy_version 1367923 (0.0010) [2023-12-26 10:30:54,878][123091] Updated weights for policy 0, policy_version 1367933 (0.0009) [2023-12-26 10:30:54,946][123091] Updated weights for policy 0, policy_version 1367943 (0.0008) [2023-12-26 10:30:55,393][123090] Updated weights for policy 1, policy_version 1358373 (0.0008) [2023-12-26 10:30:55,455][123090] Updated weights for policy 1, policy_version 1358383 (0.0010) [2023-12-26 10:30:55,521][123090] Updated weights for policy 1, policy_version 1358393 (0.0008) [2023-12-26 10:30:55,767][123091] Updated weights for policy 0, policy_version 1367953 (0.0009) [2023-12-26 10:30:55,825][123091] Updated weights for policy 0, policy_version 1367963 (0.0008) [2023-12-26 10:30:55,888][123091] Updated weights for policy 0, policy_version 1367973 (0.0006) [2023-12-26 10:30:55,944][123091] Updated weights for policy 0, policy_version 1367983 (0.0009) [2023-12-26 10:30:56,292][123090] Updated weights for policy 1, policy_version 1358403 (0.0008) [2023-12-26 10:30:56,339][123090] Updated weights for policy 1, policy_version 1358413 (0.0005) [2023-12-26 10:30:56,389][123090] Updated weights for policy 1, policy_version 1358423 (0.0005) [2023-12-26 10:30:56,723][123091] Updated weights for policy 0, policy_version 1367993 (0.0006) [2023-12-26 10:30:56,783][123091] Updated weights for policy 0, policy_version 1368003 (0.0006) [2023-12-26 10:30:56,847][123091] Updated weights for policy 0, policy_version 1368013 (0.0006) [2023-12-26 10:30:57,135][123090] Updated weights for policy 1, policy_version 1358433 (0.0007) [2023-12-26 10:30:57,185][123090] Updated weights for policy 1, policy_version 1358443 (0.0005) [2023-12-26 10:30:57,243][123090] Updated weights for policy 1, policy_version 1358453 (0.0008) [2023-12-26 10:30:57,307][123090] Updated weights for policy 1, policy_version 1358463 (0.0010) [2023-12-26 10:30:57,514][123091] Updated weights for policy 0, policy_version 1368023 (0.0009) [2023-12-26 10:30:57,558][123091] Updated weights for policy 0, policy_version 1368033 (0.0010) [2023-12-26 10:30:57,606][123091] Updated weights for policy 0, policy_version 1368043 (0.0010) [2023-12-26 10:30:57,948][123090] Updated weights for policy 1, policy_version 1358473 (0.0006) [2023-12-26 10:30:58,007][123090] Updated weights for policy 1, policy_version 1358483 (0.0005) [2023-12-26 10:30:58,071][123090] Updated weights for policy 1, policy_version 1358493 (0.0007) [2023-12-26 10:30:58,484][123091] Updated weights for policy 0, policy_version 1368053 (0.0008) [2023-12-26 10:30:58,556][123091] Updated weights for policy 0, policy_version 1368063 (0.0006) [2023-12-26 10:30:58,631][123091] Updated weights for policy 0, policy_version 1368073 (0.0007) [2023-12-26 10:30:58,786][121949] Fps is (10 sec: 18019.4, 60 sec: 17475.7, 300 sec: 17800.1). Total num frames: 698007552. Throughput: 0: 8883.9, 1: 8623.0. Samples: 698000228. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:30:58,786][121949] Avg episode reward: [(0, '6380.493'), (1, '5797.088')] [2023-12-26 10:30:58,983][123090] Updated weights for policy 1, policy_version 1358503 (0.0010) [2023-12-26 10:30:59,049][123090] Updated weights for policy 1, policy_version 1358513 (0.0009) [2023-12-26 10:30:59,115][123090] Updated weights for policy 1, policy_version 1358523 (0.0011) [2023-12-26 10:30:59,422][123091] Updated weights for policy 0, policy_version 1368083 (0.0008) [2023-12-26 10:30:59,469][123091] Updated weights for policy 0, policy_version 1368093 (0.0006) [2023-12-26 10:30:59,514][123091] Updated weights for policy 0, policy_version 1368103 (0.0005) [2023-12-26 10:30:59,866][123090] Updated weights for policy 1, policy_version 1358533 (0.0009) [2023-12-26 10:30:59,941][123090] Updated weights for policy 1, policy_version 1358543 (0.0006) [2023-12-26 10:31:00,009][123090] Updated weights for policy 1, policy_version 1358553 (0.0006) [2023-12-26 10:31:00,331][123091] Updated weights for policy 0, policy_version 1368113 (0.0006) [2023-12-26 10:31:00,387][123091] Updated weights for policy 0, policy_version 1368123 (0.0006) [2023-12-26 10:31:00,449][123091] Updated weights for policy 0, policy_version 1368133 (0.0007) [2023-12-26 10:31:00,505][123091] Updated weights for policy 0, policy_version 1368143 (0.0009) [2023-12-26 10:31:00,774][123090] Updated weights for policy 1, policy_version 1358563 (0.0007) [2023-12-26 10:31:00,835][123090] Updated weights for policy 1, policy_version 1358573 (0.0009) [2023-12-26 10:31:00,887][123090] Updated weights for policy 1, policy_version 1358583 (0.0008) [2023-12-26 10:31:01,266][123091] Updated weights for policy 0, policy_version 1368153 (0.0007) [2023-12-26 10:31:01,331][123091] Updated weights for policy 0, policy_version 1368163 (0.0009) [2023-12-26 10:31:01,396][123091] Updated weights for policy 0, policy_version 1368173 (0.0009) [2023-12-26 10:31:01,768][123090] Updated weights for policy 1, policy_version 1358594 (0.0009) [2023-12-26 10:31:01,837][123090] Updated weights for policy 1, policy_version 1358604 (0.0010) [2023-12-26 10:31:01,900][123090] Updated weights for policy 1, policy_version 1358614 (0.0010) [2023-12-26 10:31:01,964][123090] Updated weights for policy 1, policy_version 1358624 (0.0009) [2023-12-26 10:31:02,219][123091] Updated weights for policy 0, policy_version 1368183 (0.0010) [2023-12-26 10:31:02,284][123091] Updated weights for policy 0, policy_version 1368193 (0.0010) [2023-12-26 10:31:02,355][123091] Updated weights for policy 0, policy_version 1368203 (0.0010) [2023-12-26 10:31:02,740][123090] Updated weights for policy 1, policy_version 1358634 (0.0011) [2023-12-26 10:31:02,796][123090] Updated weights for policy 1, policy_version 1358644 (0.0010) [2023-12-26 10:31:02,851][123090] Updated weights for policy 1, policy_version 1358654 (0.0010) [2023-12-26 10:31:03,145][123091] Updated weights for policy 0, policy_version 1368213 (0.0008) [2023-12-26 10:31:03,209][123091] Updated weights for policy 0, policy_version 1368223 (0.0005) [2023-12-26 10:31:03,272][123091] Updated weights for policy 0, policy_version 1368233 (0.0005) [2023-12-26 10:31:03,592][123090] Updated weights for policy 1, policy_version 1358664 (0.0006) [2023-12-26 10:31:03,651][123090] Updated weights for policy 1, policy_version 1358674 (0.0005) [2023-12-26 10:31:03,719][123090] Updated weights for policy 1, policy_version 1358684 (0.0005) [2023-12-26 10:31:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 698097664. Throughput: 0: 8798.5, 1: 8654.8. Samples: 698106840. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:31:03,785][121949] Avg episode reward: [(0, '6352.520'), (1, '5813.689')] [2023-12-26 10:31:03,968][123091] Updated weights for policy 0, policy_version 1368243 (0.0007) [2023-12-26 10:31:04,020][123091] Updated weights for policy 0, policy_version 1368253 (0.0010) [2023-12-26 10:31:04,069][123091] Updated weights for policy 0, policy_version 1368263 (0.0010) [2023-12-26 10:31:04,410][123090] Updated weights for policy 1, policy_version 1358694 (0.0008) [2023-12-26 10:31:04,478][123090] Updated weights for policy 1, policy_version 1358704 (0.0011) [2023-12-26 10:31:04,549][123090] Updated weights for policy 1, policy_version 1358714 (0.0010) [2023-12-26 10:31:04,862][123091] Updated weights for policy 0, policy_version 1368273 (0.0010) [2023-12-26 10:31:04,928][123091] Updated weights for policy 0, policy_version 1368283 (0.0007) [2023-12-26 10:31:04,991][123091] Updated weights for policy 0, policy_version 1368293 (0.0011) [2023-12-26 10:31:05,058][123091] Updated weights for policy 0, policy_version 1368303 (0.0011) [2023-12-26 10:31:05,318][123090] Updated weights for policy 1, policy_version 1358724 (0.0006) [2023-12-26 10:31:05,376][123090] Updated weights for policy 1, policy_version 1358734 (0.0005) [2023-12-26 10:31:05,431][123090] Updated weights for policy 1, policy_version 1358744 (0.0005) [2023-12-26 10:31:05,864][123091] Updated weights for policy 0, policy_version 1368313 (0.0009) [2023-12-26 10:31:05,912][123091] Updated weights for policy 0, policy_version 1368323 (0.0009) [2023-12-26 10:31:05,963][123091] Updated weights for policy 0, policy_version 1368333 (0.0009) [2023-12-26 10:31:06,227][123090] Updated weights for policy 1, policy_version 1358754 (0.0011) [2023-12-26 10:31:06,290][123090] Updated weights for policy 1, policy_version 1358764 (0.0011) [2023-12-26 10:31:06,357][123090] Updated weights for policy 1, policy_version 1358774 (0.0010) [2023-12-26 10:31:06,421][123090] Updated weights for policy 1, policy_version 1358784 (0.0011) [2023-12-26 10:31:06,745][123091] Updated weights for policy 0, policy_version 1368343 (0.0007) [2023-12-26 10:31:06,792][123091] Updated weights for policy 0, policy_version 1368353 (0.0006) [2023-12-26 10:31:06,838][123091] Updated weights for policy 0, policy_version 1368363 (0.0005) [2023-12-26 10:31:07,241][123090] Updated weights for policy 1, policy_version 1358794 (0.0010) [2023-12-26 10:31:07,296][123090] Updated weights for policy 1, policy_version 1358804 (0.0010) [2023-12-26 10:31:07,356][123090] Updated weights for policy 1, policy_version 1358814 (0.0010) [2023-12-26 10:31:07,531][123091] Updated weights for policy 0, policy_version 1368373 (0.0005) [2023-12-26 10:31:07,582][123091] Updated weights for policy 0, policy_version 1368383 (0.0005) [2023-12-26 10:31:07,640][123091] Updated weights for policy 0, policy_version 1368393 (0.0005) [2023-12-26 10:31:08,194][123090] Updated weights for policy 1, policy_version 1358824 (0.0010) [2023-12-26 10:31:08,266][123090] Updated weights for policy 1, policy_version 1358834 (0.0011) [2023-12-26 10:31:08,332][123091] Updated weights for policy 0, policy_version 1368403 (0.0009) [2023-12-26 10:31:08,337][123090] Updated weights for policy 1, policy_version 1358844 (0.0011) [2023-12-26 10:31:08,394][123091] Updated weights for policy 0, policy_version 1368413 (0.0008) [2023-12-26 10:31:08,460][123091] Updated weights for policy 0, policy_version 1368423 (0.0008) [2023-12-26 10:31:08,784][121949] Fps is (10 sec: 18025.6, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 698187776. Throughput: 0: 8836.3, 1: 8737.1. Samples: 698160836. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:31:08,784][121949] Avg episode reward: [(0, '6316.907'), (1, '5816.210')] [2023-12-26 10:31:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001358848_347865088.pth... [2023-12-26 10:31:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001368432_350322688.pth... [2023-12-26 10:31:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001357824_347602944.pth [2023-12-26 10:31:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001367376_350052352.pth [2023-12-26 10:31:09,068][123090] Updated weights for policy 1, policy_version 1358854 (0.0012) [2023-12-26 10:31:09,130][123090] Updated weights for policy 1, policy_version 1358864 (0.0008) [2023-12-26 10:31:09,195][123090] Updated weights for policy 1, policy_version 1358874 (0.0005) [2023-12-26 10:31:09,245][123091] Updated weights for policy 0, policy_version 1368433 (0.0009) [2023-12-26 10:31:09,310][123091] Updated weights for policy 0, policy_version 1368443 (0.0008) [2023-12-26 10:31:09,382][123091] Updated weights for policy 0, policy_version 1368453 (0.0009) [2023-12-26 10:31:09,449][123091] Updated weights for policy 0, policy_version 1368463 (0.0008) [2023-12-26 10:31:10,051][123090] Updated weights for policy 1, policy_version 1358884 (0.0009) [2023-12-26 10:31:10,115][123090] Updated weights for policy 1, policy_version 1358894 (0.0011) [2023-12-26 10:31:10,188][123090] Updated weights for policy 1, policy_version 1358904 (0.0011) [2023-12-26 10:31:10,282][123091] Updated weights for policy 0, policy_version 1368473 (0.0009) [2023-12-26 10:31:10,334][123091] Updated weights for policy 0, policy_version 1368483 (0.0011) [2023-12-26 10:31:10,390][123091] Updated weights for policy 0, policy_version 1368493 (0.0010) [2023-12-26 10:31:11,001][123090] Updated weights for policy 1, policy_version 1358914 (0.0011) [2023-12-26 10:31:11,065][123090] Updated weights for policy 1, policy_version 1358924 (0.0011) [2023-12-26 10:31:11,131][123090] Updated weights for policy 1, policy_version 1358934 (0.0010) [2023-12-26 10:31:11,185][123091] Updated weights for policy 0, policy_version 1368503 (0.0011) [2023-12-26 10:31:11,201][123090] Updated weights for policy 1, policy_version 1358944 (0.0010) [2023-12-26 10:31:11,246][123091] Updated weights for policy 0, policy_version 1368513 (0.0010) [2023-12-26 10:31:11,315][123091] Updated weights for policy 0, policy_version 1368523 (0.0010) [2023-12-26 10:31:12,102][123090] Updated weights for policy 1, policy_version 1358954 (0.0011) [2023-12-26 10:31:12,157][123090] Updated weights for policy 1, policy_version 1358964 (0.0010) [2023-12-26 10:31:12,166][123091] Updated weights for policy 0, policy_version 1368533 (0.0007) [2023-12-26 10:31:12,217][123090] Updated weights for policy 1, policy_version 1358974 (0.0010) [2023-12-26 10:31:12,224][123091] Updated weights for policy 0, policy_version 1368543 (0.0006) [2023-12-26 10:31:12,291][123091] Updated weights for policy 0, policy_version 1368553 (0.0007) [2023-12-26 10:31:12,938][123091] Updated weights for policy 0, policy_version 1368563 (0.0006) [2023-12-26 10:31:13,008][123091] Updated weights for policy 0, policy_version 1368573 (0.0006) [2023-12-26 10:31:13,059][123090] Updated weights for policy 1, policy_version 1358984 (0.0011) [2023-12-26 10:31:13,070][123091] Updated weights for policy 0, policy_version 1368583 (0.0007) [2023-12-26 10:31:13,123][123090] Updated weights for policy 1, policy_version 1358994 (0.0010) [2023-12-26 10:31:13,183][123090] Updated weights for policy 1, policy_version 1359004 (0.0010) [2023-12-26 10:31:13,756][123091] Updated weights for policy 0, policy_version 1368593 (0.0009) [2023-12-26 10:31:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 698269696. Throughput: 0: 8904.6, 1: 8742.5. Samples: 698267316. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:31:13,785][121949] Avg episode reward: [(0, '6285.301'), (1, '5781.402')] [2023-12-26 10:31:13,819][123091] Updated weights for policy 0, policy_version 1368603 (0.0011) [2023-12-26 10:31:13,881][123091] Updated weights for policy 0, policy_version 1368613 (0.0010) [2023-12-26 10:31:13,890][123090] Updated weights for policy 1, policy_version 1359014 (0.0008) [2023-12-26 10:31:13,933][123090] Updated weights for policy 1, policy_version 1359024 (0.0010) [2023-12-26 10:31:13,943][123091] Updated weights for policy 0, policy_version 1368623 (0.0011) [2023-12-26 10:31:13,989][123090] Updated weights for policy 1, policy_version 1359034 (0.0010) [2023-12-26 10:31:14,771][123090] Updated weights for policy 1, policy_version 1359044 (0.0009) [2023-12-26 10:31:14,795][123091] Updated weights for policy 0, policy_version 1368633 (0.0008) [2023-12-26 10:31:14,836][123090] Updated weights for policy 1, policy_version 1359054 (0.0008) [2023-12-26 10:31:14,857][123091] Updated weights for policy 0, policy_version 1368643 (0.0009) [2023-12-26 10:31:14,898][123090] Updated weights for policy 1, policy_version 1359064 (0.0007) [2023-12-26 10:31:14,924][123091] Updated weights for policy 0, policy_version 1368653 (0.0008) [2023-12-26 10:31:15,581][123091] Updated weights for policy 0, policy_version 1368663 (0.0007) [2023-12-26 10:31:15,636][123091] Updated weights for policy 0, policy_version 1368673 (0.0005) [2023-12-26 10:31:15,687][123091] Updated weights for policy 0, policy_version 1368683 (0.0007) [2023-12-26 10:31:15,765][123090] Updated weights for policy 1, policy_version 1359074 (0.0011) [2023-12-26 10:31:15,818][123090] Updated weights for policy 1, policy_version 1359084 (0.0009) [2023-12-26 10:31:15,880][123090] Updated weights for policy 1, policy_version 1359094 (0.0010) [2023-12-26 10:31:15,939][123090] Updated weights for policy 1, policy_version 1359104 (0.0009) [2023-12-26 10:31:16,411][123091] Updated weights for policy 0, policy_version 1368693 (0.0007) [2023-12-26 10:31:16,476][123091] Updated weights for policy 0, policy_version 1368703 (0.0005) [2023-12-26 10:31:16,545][123091] Updated weights for policy 0, policy_version 1368713 (0.0005) [2023-12-26 10:31:16,752][123090] Updated weights for policy 1, policy_version 1359114 (0.0008) [2023-12-26 10:31:16,812][123090] Updated weights for policy 1, policy_version 1359124 (0.0007) [2023-12-26 10:31:16,871][123090] Updated weights for policy 1, policy_version 1359134 (0.0007) [2023-12-26 10:31:17,227][123091] Updated weights for policy 0, policy_version 1368723 (0.0005) [2023-12-26 10:31:17,284][123091] Updated weights for policy 0, policy_version 1368733 (0.0006) [2023-12-26 10:31:17,343][123091] Updated weights for policy 0, policy_version 1368743 (0.0007) [2023-12-26 10:31:17,559][123090] Updated weights for policy 1, policy_version 1359144 (0.0005) [2023-12-26 10:31:17,613][123090] Updated weights for policy 1, policy_version 1359154 (0.0005) [2023-12-26 10:31:17,660][123090] Updated weights for policy 1, policy_version 1359164 (0.0005) [2023-12-26 10:31:18,146][123091] Updated weights for policy 0, policy_version 1368753 (0.0009) [2023-12-26 10:31:18,194][123091] Updated weights for policy 0, policy_version 1368763 (0.0010) [2023-12-26 10:31:18,241][123091] Updated weights for policy 0, policy_version 1368773 (0.0010) [2023-12-26 10:31:18,293][123091] Updated weights for policy 0, policy_version 1368783 (0.0011) [2023-12-26 10:31:18,385][123090] Updated weights for policy 1, policy_version 1359174 (0.0008) [2023-12-26 10:31:18,445][123090] Updated weights for policy 1, policy_version 1359184 (0.0009) [2023-12-26 10:31:18,519][123090] Updated weights for policy 1, policy_version 1359194 (0.0009) [2023-12-26 10:31:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 698368000. Throughput: 0: 8950.5, 1: 8770.7. Samples: 698377708. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:31:18,785][121949] Avg episode reward: [(0, '6174.237'), (1, '5826.871')] [2023-12-26 10:31:19,161][123091] Updated weights for policy 0, policy_version 1368793 (0.0011) [2023-12-26 10:31:19,220][123091] Updated weights for policy 0, policy_version 1368803 (0.0011) [2023-12-26 10:31:19,284][123091] Updated weights for policy 0, policy_version 1368813 (0.0011) [2023-12-26 10:31:19,358][123090] Updated weights for policy 1, policy_version 1359204 (0.0009) [2023-12-26 10:31:19,417][123090] Updated weights for policy 1, policy_version 1359214 (0.0008) [2023-12-26 10:31:19,465][123090] Updated weights for policy 1, policy_version 1359224 (0.0008) [2023-12-26 10:31:20,127][123091] Updated weights for policy 0, policy_version 1368823 (0.0011) [2023-12-26 10:31:20,191][123091] Updated weights for policy 0, policy_version 1368833 (0.0011) [2023-12-26 10:31:20,263][123091] Updated weights for policy 0, policy_version 1368843 (0.0011) [2023-12-26 10:31:20,289][123090] Updated weights for policy 1, policy_version 1359234 (0.0008) [2023-12-26 10:31:20,363][123090] Updated weights for policy 1, policy_version 1359244 (0.0009) [2023-12-26 10:31:20,432][123090] Updated weights for policy 1, policy_version 1359254 (0.0007) [2023-12-26 10:31:20,488][123090] Updated weights for policy 1, policy_version 1359264 (0.0006) [2023-12-26 10:31:21,109][123091] Updated weights for policy 0, policy_version 1368853 (0.0009) [2023-12-26 10:31:21,181][123091] Updated weights for policy 0, policy_version 1368863 (0.0009) [2023-12-26 10:31:21,240][123091] Updated weights for policy 0, policy_version 1368873 (0.0010) [2023-12-26 10:31:21,309][123090] Updated weights for policy 1, policy_version 1359274 (0.0007) [2023-12-26 10:31:21,381][123090] Updated weights for policy 1, policy_version 1359284 (0.0012) [2023-12-26 10:31:21,448][123090] Updated weights for policy 1, policy_version 1359294 (0.0008) [2023-12-26 10:31:22,120][123091] Updated weights for policy 0, policy_version 1368883 (0.0010) [2023-12-26 10:31:22,182][123091] Updated weights for policy 0, policy_version 1368893 (0.0009) [2023-12-26 10:31:22,249][123091] Updated weights for policy 0, policy_version 1368903 (0.0009) [2023-12-26 10:31:22,255][123090] Updated weights for policy 1, policy_version 1359304 (0.0010) [2023-12-26 10:31:22,317][123090] Updated weights for policy 1, policy_version 1359314 (0.0011) [2023-12-26 10:31:22,392][123090] Updated weights for policy 1, policy_version 1359324 (0.0010) [2023-12-26 10:31:23,104][123091] Updated weights for policy 0, policy_version 1368913 (0.0006) [2023-12-26 10:31:23,167][123091] Updated weights for policy 0, policy_version 1368923 (0.0011) [2023-12-26 10:31:23,226][123091] Updated weights for policy 0, policy_version 1368933 (0.0011) [2023-12-26 10:31:23,229][123090] Updated weights for policy 1, policy_version 1359334 (0.0007) [2023-12-26 10:31:23,276][123090] Updated weights for policy 1, policy_version 1359344 (0.0008) [2023-12-26 10:31:23,284][123091] Updated weights for policy 0, policy_version 1368943 (0.0011) [2023-12-26 10:31:23,327][123090] Updated weights for policy 1, policy_version 1359354 (0.0009) [2023-12-26 10:31:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 698449920. Throughput: 0: 8925.0, 1: 8732.7. Samples: 698428520. Policy #0 lag: (min: 31.0, avg: 35.7, max: 63.0) [2023-12-26 10:31:23,785][121949] Avg episode reward: [(0, '6212.589'), (1, '5836.087')] [2023-12-26 10:31:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001368944_350453760.pth... [2023-12-26 10:31:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001359360_347996160.pth... [2023-12-26 10:31:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001358336_347734016.pth [2023-12-26 10:31:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001367920_350191616.pth [2023-12-26 10:31:24,057][123090] Updated weights for policy 1, policy_version 1359364 (0.0007) [2023-12-26 10:31:24,073][123091] Updated weights for policy 0, policy_version 1368953 (0.0010) [2023-12-26 10:31:24,118][123090] Updated weights for policy 1, policy_version 1359374 (0.0005) [2023-12-26 10:31:24,128][123091] Updated weights for policy 0, policy_version 1368963 (0.0010) [2023-12-26 10:31:24,184][123090] Updated weights for policy 1, policy_version 1359384 (0.0006) [2023-12-26 10:31:24,193][123091] Updated weights for policy 0, policy_version 1368973 (0.0011) [2023-12-26 10:31:24,832][123090] Updated weights for policy 1, policy_version 1359394 (0.0007) [2023-12-26 10:31:24,908][123090] Updated weights for policy 1, policy_version 1359404 (0.0005) [2023-12-26 10:31:24,975][123090] Updated weights for policy 1, policy_version 1359414 (0.0009) [2023-12-26 10:31:24,986][123091] Updated weights for policy 0, policy_version 1368983 (0.0009) [2023-12-26 10:31:25,036][123090] Updated weights for policy 1, policy_version 1359424 (0.0009) [2023-12-26 10:31:25,039][123091] Updated weights for policy 0, policy_version 1368993 (0.0007) [2023-12-26 10:31:25,096][123091] Updated weights for policy 0, policy_version 1369003 (0.0009) [2023-12-26 10:31:25,793][123091] Updated weights for policy 0, policy_version 1369013 (0.0008) [2023-12-26 10:31:25,826][123090] Updated weights for policy 1, policy_version 1359434 (0.0007) [2023-12-26 10:31:25,871][123091] Updated weights for policy 0, policy_version 1369023 (0.0006) [2023-12-26 10:31:25,884][123090] Updated weights for policy 1, policy_version 1359444 (0.0006) [2023-12-26 10:31:25,935][123091] Updated weights for policy 0, policy_version 1369033 (0.0006) [2023-12-26 10:31:25,937][123090] Updated weights for policy 1, policy_version 1359454 (0.0005) [2023-12-26 10:31:26,589][123091] Updated weights for policy 0, policy_version 1369043 (0.0007) [2023-12-26 10:31:26,648][123091] Updated weights for policy 0, policy_version 1369053 (0.0010) [2023-12-26 10:31:26,706][123091] Updated weights for policy 0, policy_version 1369063 (0.0010) [2023-12-26 10:31:26,735][123090] Updated weights for policy 1, policy_version 1359464 (0.0005) [2023-12-26 10:31:26,784][123090] Updated weights for policy 1, policy_version 1359474 (0.0005) [2023-12-26 10:31:26,834][123090] Updated weights for policy 1, policy_version 1359484 (0.0005) [2023-12-26 10:31:27,515][123091] Updated weights for policy 0, policy_version 1369073 (0.0009) [2023-12-26 10:31:27,539][123090] Updated weights for policy 1, policy_version 1359494 (0.0007) [2023-12-26 10:31:27,577][123091] Updated weights for policy 0, policy_version 1369083 (0.0010) [2023-12-26 10:31:27,589][123090] Updated weights for policy 1, policy_version 1359504 (0.0007) [2023-12-26 10:31:27,625][123091] Updated weights for policy 0, policy_version 1369093 (0.0010) [2023-12-26 10:31:27,640][123090] Updated weights for policy 1, policy_version 1359514 (0.0005) [2023-12-26 10:31:27,686][123091] Updated weights for policy 0, policy_version 1369103 (0.0011) [2023-12-26 10:31:28,463][123091] Updated weights for policy 0, policy_version 1369113 (0.0010) [2023-12-26 10:31:28,487][123090] Updated weights for policy 1, policy_version 1359524 (0.0006) [2023-12-26 10:31:28,510][123091] Updated weights for policy 0, policy_version 1369123 (0.0010) [2023-12-26 10:31:28,549][123090] Updated weights for policy 1, policy_version 1359534 (0.0007) [2023-12-26 10:31:28,569][123091] Updated weights for policy 0, policy_version 1369133 (0.0009) [2023-12-26 10:31:28,615][123090] Updated weights for policy 1, policy_version 1359544 (0.0009) [2023-12-26 10:31:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 698548224. Throughput: 0: 8973.5, 1: 8841.5. Samples: 698536724. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:28,784][121949] Avg episode reward: [(0, '6250.874'), (1, '5869.791')] [2023-12-26 10:31:29,422][123091] Updated weights for policy 0, policy_version 1369143 (0.0009) [2023-12-26 10:31:29,446][123090] Updated weights for policy 1, policy_version 1359554 (0.0009) [2023-12-26 10:31:29,487][123091] Updated weights for policy 0, policy_version 1369153 (0.0008) [2023-12-26 10:31:29,499][123090] Updated weights for policy 1, policy_version 1359564 (0.0007) [2023-12-26 10:31:29,549][123090] Updated weights for policy 1, policy_version 1359574 (0.0008) [2023-12-26 10:31:29,550][123091] Updated weights for policy 0, policy_version 1369163 (0.0009) [2023-12-26 10:31:29,606][123090] Updated weights for policy 1, policy_version 1359584 (0.0009) [2023-12-26 10:31:30,320][123091] Updated weights for policy 0, policy_version 1369173 (0.0010) [2023-12-26 10:31:30,384][123091] Updated weights for policy 0, policy_version 1369183 (0.0009) [2023-12-26 10:31:30,443][123091] Updated weights for policy 0, policy_version 1369193 (0.0008) [2023-12-26 10:31:30,474][123090] Updated weights for policy 1, policy_version 1359594 (0.0010) [2023-12-26 10:31:30,537][123090] Updated weights for policy 1, policy_version 1359604 (0.0008) [2023-12-26 10:31:30,597][123090] Updated weights for policy 1, policy_version 1359614 (0.0006) [2023-12-26 10:31:31,297][123091] Updated weights for policy 0, policy_version 1369203 (0.0006) [2023-12-26 10:31:31,354][123091] Updated weights for policy 0, policy_version 1369213 (0.0006) [2023-12-26 10:31:31,382][123090] Updated weights for policy 1, policy_version 1359624 (0.0010) [2023-12-26 10:31:31,422][123091] Updated weights for policy 0, policy_version 1369223 (0.0009) [2023-12-26 10:31:31,451][123090] Updated weights for policy 1, policy_version 1359634 (0.0008) [2023-12-26 10:31:31,509][123090] Updated weights for policy 1, policy_version 1359644 (0.0008) [2023-12-26 10:31:32,266][123090] Updated weights for policy 1, policy_version 1359654 (0.0008) [2023-12-26 10:31:32,275][123091] Updated weights for policy 0, policy_version 1369233 (0.0009) [2023-12-26 10:31:32,323][123090] Updated weights for policy 1, policy_version 1359664 (0.0007) [2023-12-26 10:31:32,341][123091] Updated weights for policy 0, policy_version 1369243 (0.0009) [2023-12-26 10:31:32,387][123090] Updated weights for policy 1, policy_version 1359674 (0.0008) [2023-12-26 10:31:32,396][123091] Updated weights for policy 0, policy_version 1369253 (0.0006) [2023-12-26 10:31:32,448][123091] Updated weights for policy 0, policy_version 1369263 (0.0005) [2023-12-26 10:31:33,111][123090] Updated weights for policy 1, policy_version 1359684 (0.0005) [2023-12-26 10:31:33,177][123090] Updated weights for policy 1, policy_version 1359694 (0.0005) [2023-12-26 10:31:33,237][123091] Updated weights for policy 0, policy_version 1369273 (0.0009) [2023-12-26 10:31:33,240][123090] Updated weights for policy 1, policy_version 1359704 (0.0005) [2023-12-26 10:31:33,287][123091] Updated weights for policy 0, policy_version 1369283 (0.0008) [2023-12-26 10:31:33,342][123091] Updated weights for policy 0, policy_version 1369293 (0.0009) [2023-12-26 10:31:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 698630144. Throughput: 0: 8890.9, 1: 8869.4. Samples: 698642308. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:33,785][121949] Avg episode reward: [(0, '6264.131'), (1, '5898.729')] [2023-12-26 10:31:33,984][123090] Updated weights for policy 1, policy_version 1359714 (0.0009) [2023-12-26 10:31:34,042][123090] Updated weights for policy 1, policy_version 1359724 (0.0009) [2023-12-26 10:31:34,069][123091] Updated weights for policy 0, policy_version 1369303 (0.0010) [2023-12-26 10:31:34,102][123090] Updated weights for policy 1, policy_version 1359734 (0.0007) [2023-12-26 10:31:34,128][123091] Updated weights for policy 0, policy_version 1369313 (0.0010) [2023-12-26 10:31:34,170][123090] Updated weights for policy 1, policy_version 1359744 (0.0009) [2023-12-26 10:31:34,191][123091] Updated weights for policy 0, policy_version 1369323 (0.0008) [2023-12-26 10:31:34,982][123090] Updated weights for policy 1, policy_version 1359754 (0.0006) [2023-12-26 10:31:35,008][123091] Updated weights for policy 0, policy_version 1369333 (0.0009) [2023-12-26 10:31:35,045][123090] Updated weights for policy 1, policy_version 1359764 (0.0010) [2023-12-26 10:31:35,071][123091] Updated weights for policy 0, policy_version 1369343 (0.0010) [2023-12-26 10:31:35,107][123090] Updated weights for policy 1, policy_version 1359774 (0.0010) [2023-12-26 10:31:35,128][123091] Updated weights for policy 0, policy_version 1369353 (0.0010) [2023-12-26 10:31:35,894][123090] Updated weights for policy 1, policy_version 1359784 (0.0010) [2023-12-26 10:31:35,925][123091] Updated weights for policy 0, policy_version 1369363 (0.0010) [2023-12-26 10:31:35,961][123090] Updated weights for policy 1, policy_version 1359794 (0.0010) [2023-12-26 10:31:35,977][123091] Updated weights for policy 0, policy_version 1369373 (0.0005) [2023-12-26 10:31:36,028][123090] Updated weights for policy 1, policy_version 1359804 (0.0010) [2023-12-26 10:31:36,037][123091] Updated weights for policy 0, policy_version 1369383 (0.0009) [2023-12-26 10:31:36,799][123091] Updated weights for policy 0, policy_version 1369393 (0.0007) [2023-12-26 10:31:36,824][123090] Updated weights for policy 1, policy_version 1359814 (0.0007) [2023-12-26 10:31:36,868][123091] Updated weights for policy 0, policy_version 1369403 (0.0007) [2023-12-26 10:31:36,894][123090] Updated weights for policy 1, policy_version 1359824 (0.0007) [2023-12-26 10:31:36,939][123091] Updated weights for policy 0, policy_version 1369413 (0.0011) [2023-12-26 10:31:36,956][123090] Updated weights for policy 1, policy_version 1359834 (0.0010) [2023-12-26 10:31:37,003][123091] Updated weights for policy 0, policy_version 1369423 (0.0011) [2023-12-26 10:31:37,735][123090] Updated weights for policy 1, policy_version 1359844 (0.0009) [2023-12-26 10:31:37,789][123090] Updated weights for policy 1, policy_version 1359854 (0.0008) [2023-12-26 10:31:37,804][123091] Updated weights for policy 0, policy_version 1369433 (0.0011) [2023-12-26 10:31:37,846][123090] Updated weights for policy 1, policy_version 1359864 (0.0008) [2023-12-26 10:31:37,855][123091] Updated weights for policy 0, policy_version 1369443 (0.0010) [2023-12-26 10:31:37,910][123091] Updated weights for policy 0, policy_version 1369453 (0.0010) [2023-12-26 10:31:38,670][123090] Updated weights for policy 1, policy_version 1359874 (0.0008) [2023-12-26 10:31:38,726][123090] Updated weights for policy 1, policy_version 1359884 (0.0010) [2023-12-26 10:31:38,748][123091] Updated weights for policy 0, policy_version 1369463 (0.0010) [2023-12-26 10:31:38,781][123090] Updated weights for policy 1, policy_version 1359894 (0.0010) [2023-12-26 10:31:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 698712064. Throughput: 0: 8912.3, 1: 8914.8. Samples: 698695744. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:38,785][121949] Avg episode reward: [(0, '6212.332'), (1, '5801.291')] [2023-12-26 10:31:38,811][123091] Updated weights for policy 0, policy_version 1369473 (0.0010) [2023-12-26 10:31:38,832][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001359904_348135424.pth... [2023-12-26 10:31:38,833][123090] Updated weights for policy 1, policy_version 1359904 (0.0010) [2023-12-26 10:31:38,836][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001358848_347865088.pth [2023-12-26 10:31:38,866][123091] Updated weights for policy 0, policy_version 1369483 (0.0010) [2023-12-26 10:31:38,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001369488_350593024.pth... [2023-12-26 10:31:38,894][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001368432_350322688.pth [2023-12-26 10:31:39,611][123090] Updated weights for policy 1, policy_version 1359914 (0.0006) [2023-12-26 10:31:39,678][123090] Updated weights for policy 1, policy_version 1359924 (0.0011) [2023-12-26 10:31:39,694][123091] Updated weights for policy 0, policy_version 1369493 (0.0011) [2023-12-26 10:31:39,739][123090] Updated weights for policy 1, policy_version 1359934 (0.0010) [2023-12-26 10:31:39,750][123091] Updated weights for policy 0, policy_version 1369503 (0.0011) [2023-12-26 10:31:39,806][123091] Updated weights for policy 0, policy_version 1369513 (0.0011) [2023-12-26 10:31:40,499][123090] Updated weights for policy 1, policy_version 1359944 (0.0007) [2023-12-26 10:31:40,561][123091] Updated weights for policy 0, policy_version 1369523 (0.0008) [2023-12-26 10:31:40,577][123090] Updated weights for policy 1, policy_version 1359954 (0.0005) [2023-12-26 10:31:40,615][123091] Updated weights for policy 0, policy_version 1369533 (0.0008) [2023-12-26 10:31:40,645][123090] Updated weights for policy 1, policy_version 1359964 (0.0005) [2023-12-26 10:31:40,670][123091] Updated weights for policy 0, policy_version 1369543 (0.0005) [2023-12-26 10:31:41,308][123090] Updated weights for policy 1, policy_version 1359974 (0.0010) [2023-12-26 10:31:41,383][123090] Updated weights for policy 1, policy_version 1359984 (0.0008) [2023-12-26 10:31:41,443][123090] Updated weights for policy 1, policy_version 1359994 (0.0008) [2023-12-26 10:31:41,541][123091] Updated weights for policy 0, policy_version 1369553 (0.0006) [2023-12-26 10:31:41,618][123091] Updated weights for policy 0, policy_version 1369563 (0.0006) [2023-12-26 10:31:41,698][123091] Updated weights for policy 0, policy_version 1369573 (0.0008) [2023-12-26 10:31:41,780][123091] Updated weights for policy 0, policy_version 1369583 (0.0007) [2023-12-26 10:31:42,233][123090] Updated weights for policy 1, policy_version 1360004 (0.0009) [2023-12-26 10:31:42,299][123090] Updated weights for policy 1, policy_version 1360014 (0.0010) [2023-12-26 10:31:42,375][123090] Updated weights for policy 1, policy_version 1360024 (0.0008) [2023-12-26 10:31:42,535][123091] Updated weights for policy 0, policy_version 1369593 (0.0009) [2023-12-26 10:31:42,602][123091] Updated weights for policy 0, policy_version 1369603 (0.0011) [2023-12-26 10:31:42,665][123091] Updated weights for policy 0, policy_version 1369613 (0.0010) [2023-12-26 10:31:43,193][123090] Updated weights for policy 1, policy_version 1360034 (0.0008) [2023-12-26 10:31:43,247][123090] Updated weights for policy 1, policy_version 1360044 (0.0008) [2023-12-26 10:31:43,316][123090] Updated weights for policy 1, policy_version 1360054 (0.0009) [2023-12-26 10:31:43,378][123090] Updated weights for policy 1, policy_version 1360064 (0.0006) [2023-12-26 10:31:43,484][123091] Updated weights for policy 0, policy_version 1369623 (0.0011) [2023-12-26 10:31:43,546][123091] Updated weights for policy 0, policy_version 1369633 (0.0010) [2023-12-26 10:31:43,597][123091] Updated weights for policy 0, policy_version 1369643 (0.0010) [2023-12-26 10:31:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 698810368. Throughput: 0: 8925.8, 1: 8881.3. Samples: 698801520. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:43,785][121949] Avg episode reward: [(0, '6334.291'), (1, '5757.246')] [2023-12-26 10:31:44,043][123090] Updated weights for policy 1, policy_version 1360074 (0.0005) [2023-12-26 10:31:44,103][123090] Updated weights for policy 1, policy_version 1360084 (0.0006) [2023-12-26 10:31:44,152][123090] Updated weights for policy 1, policy_version 1360094 (0.0005) [2023-12-26 10:31:44,354][123091] Updated weights for policy 0, policy_version 1369653 (0.0010) [2023-12-26 10:31:44,416][123091] Updated weights for policy 0, policy_version 1369663 (0.0010) [2023-12-26 10:31:44,470][123091] Updated weights for policy 0, policy_version 1369673 (0.0010) [2023-12-26 10:31:44,878][123090] Updated weights for policy 1, policy_version 1360104 (0.0008) [2023-12-26 10:31:44,944][123090] Updated weights for policy 1, policy_version 1360114 (0.0009) [2023-12-26 10:31:45,014][123090] Updated weights for policy 1, policy_version 1360124 (0.0009) [2023-12-26 10:31:45,278][123091] Updated weights for policy 0, policy_version 1369683 (0.0009) [2023-12-26 10:31:45,331][123091] Updated weights for policy 0, policy_version 1369693 (0.0009) [2023-12-26 10:31:45,387][123091] Updated weights for policy 0, policy_version 1369703 (0.0010) [2023-12-26 10:31:45,846][123090] Updated weights for policy 1, policy_version 1360134 (0.0009) [2023-12-26 10:31:45,907][123090] Updated weights for policy 1, policy_version 1360144 (0.0009) [2023-12-26 10:31:45,973][123090] Updated weights for policy 1, policy_version 1360154 (0.0010) [2023-12-26 10:31:46,100][123091] Updated weights for policy 0, policy_version 1369713 (0.0010) [2023-12-26 10:31:46,147][123091] Updated weights for policy 0, policy_version 1369723 (0.0005) [2023-12-26 10:31:46,194][123091] Updated weights for policy 0, policy_version 1369733 (0.0005) [2023-12-26 10:31:46,246][123091] Updated weights for policy 0, policy_version 1369743 (0.0009) [2023-12-26 10:31:46,761][123090] Updated weights for policy 1, policy_version 1360164 (0.0008) [2023-12-26 10:31:46,821][123090] Updated weights for policy 1, policy_version 1360174 (0.0005) [2023-12-26 10:31:46,896][123090] Updated weights for policy 1, policy_version 1360184 (0.0005) [2023-12-26 10:31:46,967][123091] Updated weights for policy 0, policy_version 1369753 (0.0006) [2023-12-26 10:31:47,017][123091] Updated weights for policy 0, policy_version 1369763 (0.0005) [2023-12-26 10:31:47,066][123091] Updated weights for policy 0, policy_version 1369773 (0.0005) [2023-12-26 10:31:47,595][123090] Updated weights for policy 1, policy_version 1360194 (0.0006) [2023-12-26 10:31:47,644][123090] Updated weights for policy 1, policy_version 1360204 (0.0005) [2023-12-26 10:31:47,691][123090] Updated weights for policy 1, policy_version 1360214 (0.0005) [2023-12-26 10:31:47,752][123090] Updated weights for policy 1, policy_version 1360224 (0.0005) [2023-12-26 10:31:47,789][123091] Updated weights for policy 0, policy_version 1369783 (0.0009) [2023-12-26 10:31:47,849][123091] Updated weights for policy 0, policy_version 1369793 (0.0011) [2023-12-26 10:31:47,893][123091] Updated weights for policy 0, policy_version 1369803 (0.0010) [2023-12-26 10:31:48,397][123090] Updated weights for policy 1, policy_version 1360234 (0.0009) [2023-12-26 10:31:48,452][123090] Updated weights for policy 1, policy_version 1360244 (0.0008) [2023-12-26 10:31:48,502][123090] Updated weights for policy 1, policy_version 1360254 (0.0005) [2023-12-26 10:31:48,634][123091] Updated weights for policy 0, policy_version 1369813 (0.0010) [2023-12-26 10:31:48,698][123091] Updated weights for policy 0, policy_version 1369823 (0.0011) [2023-12-26 10:31:48,762][123091] Updated weights for policy 0, policy_version 1369833 (0.0011) [2023-12-26 10:31:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 698900480. Throughput: 0: 8996.1, 1: 8969.5. Samples: 698915292. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:48,785][121949] Avg episode reward: [(0, '6445.400'), (1, '5875.676')] [2023-12-26 10:31:49,229][123090] Updated weights for policy 1, policy_version 1360264 (0.0006) [2023-12-26 10:31:49,295][123090] Updated weights for policy 1, policy_version 1360274 (0.0007) [2023-12-26 10:31:49,359][123090] Updated weights for policy 1, policy_version 1360284 (0.0011) [2023-12-26 10:31:49,575][123091] Updated weights for policy 0, policy_version 1369843 (0.0011) [2023-12-26 10:31:49,664][123091] Updated weights for policy 0, policy_version 1369853 (0.0007) [2023-12-26 10:31:49,716][123091] Updated weights for policy 0, policy_version 1369863 (0.0008) [2023-12-26 10:31:50,144][123090] Updated weights for policy 1, policy_version 1360294 (0.0009) [2023-12-26 10:31:50,214][123090] Updated weights for policy 1, policy_version 1360304 (0.0008) [2023-12-26 10:31:50,277][123090] Updated weights for policy 1, policy_version 1360314 (0.0008) [2023-12-26 10:31:50,388][123091] Updated weights for policy 0, policy_version 1369873 (0.0010) [2023-12-26 10:31:50,447][123091] Updated weights for policy 0, policy_version 1369883 (0.0005) [2023-12-26 10:31:50,505][123091] Updated weights for policy 0, policy_version 1369893 (0.0006) [2023-12-26 10:31:50,565][123091] Updated weights for policy 0, policy_version 1369903 (0.0006) [2023-12-26 10:31:51,176][123090] Updated weights for policy 1, policy_version 1360324 (0.0009) [2023-12-26 10:31:51,240][123091] Updated weights for policy 0, policy_version 1369913 (0.0010) [2023-12-26 10:31:51,242][123090] Updated weights for policy 1, policy_version 1360334 (0.0011) [2023-12-26 10:31:51,306][123090] Updated weights for policy 1, policy_version 1360344 (0.0011) [2023-12-26 10:31:51,308][123091] Updated weights for policy 0, policy_version 1369923 (0.0010) [2023-12-26 10:31:51,368][123091] Updated weights for policy 0, policy_version 1369933 (0.0010) [2023-12-26 10:31:52,155][123090] Updated weights for policy 1, policy_version 1360354 (0.0010) [2023-12-26 10:31:52,206][123090] Updated weights for policy 1, policy_version 1360364 (0.0005) [2023-12-26 10:31:52,228][123091] Updated weights for policy 0, policy_version 1369943 (0.0010) [2023-12-26 10:31:52,265][123090] Updated weights for policy 1, policy_version 1360374 (0.0006) [2023-12-26 10:31:52,292][123091] Updated weights for policy 0, policy_version 1369953 (0.0009) [2023-12-26 10:31:52,329][123090] Updated weights for policy 1, policy_version 1360384 (0.0007) [2023-12-26 10:31:52,365][123091] Updated weights for policy 0, policy_version 1369963 (0.0008) [2023-12-26 10:31:53,083][123090] Updated weights for policy 1, policy_version 1360394 (0.0008) [2023-12-26 10:31:53,134][123090] Updated weights for policy 1, policy_version 1360404 (0.0009) [2023-12-26 10:31:53,157][123091] Updated weights for policy 0, policy_version 1369973 (0.0011) [2023-12-26 10:31:53,189][123090] Updated weights for policy 1, policy_version 1360414 (0.0006) [2023-12-26 10:31:53,204][123091] Updated weights for policy 0, policy_version 1369983 (0.0010) [2023-12-26 10:31:53,252][123091] Updated weights for policy 0, policy_version 1369993 (0.0010) [2023-12-26 10:31:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 698990592. Throughput: 0: 9021.5, 1: 8947.1. Samples: 698969424. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:53,785][121949] Avg episode reward: [(0, '6425.243'), (1, '5922.589')] [2023-12-26 10:31:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001370000_350724096.pth... [2023-12-26 10:31:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001360416_348266496.pth... [2023-12-26 10:31:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001359360_347996160.pth [2023-12-26 10:31:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001368944_350453760.pth [2023-12-26 10:31:53,967][123090] Updated weights for policy 1, policy_version 1360424 (0.0008) [2023-12-26 10:31:54,031][123090] Updated weights for policy 1, policy_version 1360434 (0.0009) [2023-12-26 10:31:54,104][123090] Updated weights for policy 1, policy_version 1360444 (0.0007) [2023-12-26 10:31:54,114][123091] Updated weights for policy 0, policy_version 1370003 (0.0010) [2023-12-26 10:31:54,178][123091] Updated weights for policy 0, policy_version 1370013 (0.0011) [2023-12-26 10:31:54,230][123091] Updated weights for policy 0, policy_version 1370023 (0.0010) [2023-12-26 10:31:54,869][123090] Updated weights for policy 1, policy_version 1360454 (0.0010) [2023-12-26 10:31:54,919][123090] Updated weights for policy 1, policy_version 1360464 (0.0007) [2023-12-26 10:31:54,980][123090] Updated weights for policy 1, policy_version 1360474 (0.0011) [2023-12-26 10:31:55,066][123091] Updated weights for policy 0, policy_version 1370033 (0.0010) [2023-12-26 10:31:55,125][123091] Updated weights for policy 0, policy_version 1370043 (0.0011) [2023-12-26 10:31:55,188][123091] Updated weights for policy 0, policy_version 1370053 (0.0011) [2023-12-26 10:31:55,257][123091] Updated weights for policy 0, policy_version 1370063 (0.0011) [2023-12-26 10:31:55,711][123090] Updated weights for policy 1, policy_version 1360484 (0.0007) [2023-12-26 10:31:55,774][123090] Updated weights for policy 1, policy_version 1360494 (0.0005) [2023-12-26 10:31:55,832][123090] Updated weights for policy 1, policy_version 1360504 (0.0005) [2023-12-26 10:31:56,049][123091] Updated weights for policy 0, policy_version 1370073 (0.0011) [2023-12-26 10:31:56,128][123091] Updated weights for policy 0, policy_version 1370083 (0.0011) [2023-12-26 10:31:56,198][123091] Updated weights for policy 0, policy_version 1370093 (0.0011) [2023-12-26 10:31:56,449][123090] Updated weights for policy 1, policy_version 1360514 (0.0006) [2023-12-26 10:31:56,496][123090] Updated weights for policy 1, policy_version 1360524 (0.0010) [2023-12-26 10:31:56,540][123090] Updated weights for policy 1, policy_version 1360534 (0.0010) [2023-12-26 10:31:56,591][123090] Updated weights for policy 1, policy_version 1360544 (0.0010) [2023-12-26 10:31:57,010][123091] Updated weights for policy 0, policy_version 1370103 (0.0011) [2023-12-26 10:31:57,061][123091] Updated weights for policy 0, policy_version 1370113 (0.0010) [2023-12-26 10:31:57,112][123091] Updated weights for policy 0, policy_version 1370123 (0.0010) [2023-12-26 10:31:57,391][123090] Updated weights for policy 1, policy_version 1360554 (0.0005) [2023-12-26 10:31:57,440][123090] Updated weights for policy 1, policy_version 1360564 (0.0005) [2023-12-26 10:31:57,506][123090] Updated weights for policy 1, policy_version 1360574 (0.0005) [2023-12-26 10:31:57,948][123091] Updated weights for policy 0, policy_version 1370133 (0.0011) [2023-12-26 10:31:58,010][123091] Updated weights for policy 0, policy_version 1370143 (0.0011) [2023-12-26 10:31:58,078][123091] Updated weights for policy 0, policy_version 1370153 (0.0011) [2023-12-26 10:31:58,264][123090] Updated weights for policy 1, policy_version 1360584 (0.0007) [2023-12-26 10:31:58,337][123090] Updated weights for policy 1, policy_version 1360594 (0.0008) [2023-12-26 10:31:58,404][123090] Updated weights for policy 1, policy_version 1360604 (0.0009) [2023-12-26 10:31:58,787][121949] Fps is (10 sec: 18017.9, 60 sec: 17885.6, 300 sec: 17772.3). Total num frames: 699080704. Throughput: 0: 8933.7, 1: 9056.9. Samples: 699076936. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:31:58,787][121949] Avg episode reward: [(0, '6300.703'), (1, '5924.777')] [2023-12-26 10:31:58,917][123091] Updated weights for policy 0, policy_version 1370163 (0.0010) [2023-12-26 10:31:58,981][123091] Updated weights for policy 0, policy_version 1370173 (0.0011) [2023-12-26 10:31:59,046][123091] Updated weights for policy 0, policy_version 1370183 (0.0010) [2023-12-26 10:31:59,253][123090] Updated weights for policy 1, policy_version 1360614 (0.0011) [2023-12-26 10:31:59,323][123090] Updated weights for policy 1, policy_version 1360624 (0.0010) [2023-12-26 10:31:59,394][123090] Updated weights for policy 1, policy_version 1360634 (0.0013) [2023-12-26 10:31:59,917][123091] Updated weights for policy 0, policy_version 1370193 (0.0010) [2023-12-26 10:31:59,989][123091] Updated weights for policy 0, policy_version 1370203 (0.0007) [2023-12-26 10:32:00,063][123091] Updated weights for policy 0, policy_version 1370213 (0.0007) [2023-12-26 10:32:00,133][123091] Updated weights for policy 0, policy_version 1370223 (0.0006) [2023-12-26 10:32:00,135][123090] Updated weights for policy 1, policy_version 1360644 (0.0008) [2023-12-26 10:32:00,201][123090] Updated weights for policy 1, policy_version 1360654 (0.0010) [2023-12-26 10:32:00,268][123090] Updated weights for policy 1, policy_version 1360664 (0.0009) [2023-12-26 10:32:00,795][123091] Updated weights for policy 0, policy_version 1370233 (0.0006) [2023-12-26 10:32:00,848][123091] Updated weights for policy 0, policy_version 1370243 (0.0006) [2023-12-26 10:32:00,899][123091] Updated weights for policy 0, policy_version 1370253 (0.0009) [2023-12-26 10:32:01,150][123090] Updated weights for policy 1, policy_version 1360674 (0.0009) [2023-12-26 10:32:01,208][123090] Updated weights for policy 1, policy_version 1360684 (0.0009) [2023-12-26 10:32:01,266][123090] Updated weights for policy 1, policy_version 1360694 (0.0010) [2023-12-26 10:32:01,317][123090] Updated weights for policy 1, policy_version 1360704 (0.0010) [2023-12-26 10:32:01,739][123091] Updated weights for policy 0, policy_version 1370263 (0.0010) [2023-12-26 10:32:01,805][123091] Updated weights for policy 0, policy_version 1370273 (0.0009) [2023-12-26 10:32:01,865][123091] Updated weights for policy 0, policy_version 1370283 (0.0009) [2023-12-26 10:32:02,105][123090] Updated weights for policy 1, policy_version 1360714 (0.0009) [2023-12-26 10:32:02,165][123090] Updated weights for policy 1, policy_version 1360724 (0.0009) [2023-12-26 10:32:02,230][123090] Updated weights for policy 1, policy_version 1360734 (0.0009) [2023-12-26 10:32:02,706][123091] Updated weights for policy 0, policy_version 1370293 (0.0010) [2023-12-26 10:32:02,774][123091] Updated weights for policy 0, policy_version 1370303 (0.0009) [2023-12-26 10:32:02,843][123091] Updated weights for policy 0, policy_version 1370313 (0.0009) [2023-12-26 10:32:03,051][123090] Updated weights for policy 1, policy_version 1360744 (0.0009) [2023-12-26 10:32:03,113][123090] Updated weights for policy 1, policy_version 1360754 (0.0008) [2023-12-26 10:32:03,174][123090] Updated weights for policy 1, policy_version 1360764 (0.0009) [2023-12-26 10:32:03,670][123091] Updated weights for policy 0, policy_version 1370323 (0.0009) [2023-12-26 10:32:03,743][123091] Updated weights for policy 0, policy_version 1370333 (0.0006) [2023-12-26 10:32:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 699162624. Throughput: 0: 8832.2, 1: 8992.4. Samples: 699179816. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:03,784][121949] Avg episode reward: [(0, '6228.748'), (1, '5951.179')] [2023-12-26 10:32:03,801][123091] Updated weights for policy 0, policy_version 1370343 (0.0009) [2023-12-26 10:32:03,961][123090] Updated weights for policy 1, policy_version 1360774 (0.0007) [2023-12-26 10:32:04,032][123090] Updated weights for policy 1, policy_version 1360784 (0.0008) [2023-12-26 10:32:04,098][123090] Updated weights for policy 1, policy_version 1360794 (0.0008) [2023-12-26 10:32:04,598][123091] Updated weights for policy 0, policy_version 1370353 (0.0009) [2023-12-26 10:32:04,659][123091] Updated weights for policy 0, policy_version 1370363 (0.0008) [2023-12-26 10:32:04,717][123091] Updated weights for policy 0, policy_version 1370373 (0.0008) [2023-12-26 10:32:04,776][123091] Updated weights for policy 0, policy_version 1370383 (0.0008) [2023-12-26 10:32:04,800][123090] Updated weights for policy 1, policy_version 1360804 (0.0009) [2023-12-26 10:32:04,857][123090] Updated weights for policy 1, policy_version 1360814 (0.0010) [2023-12-26 10:32:04,914][123090] Updated weights for policy 1, policy_version 1360824 (0.0009) [2023-12-26 10:32:05,526][123091] Updated weights for policy 0, policy_version 1370393 (0.0010) [2023-12-26 10:32:05,592][123091] Updated weights for policy 0, policy_version 1370403 (0.0009) [2023-12-26 10:32:05,654][123091] Updated weights for policy 0, policy_version 1370413 (0.0010) [2023-12-26 10:32:05,763][123090] Updated weights for policy 1, policy_version 1360834 (0.0009) [2023-12-26 10:32:05,821][123090] Updated weights for policy 1, policy_version 1360844 (0.0009) [2023-12-26 10:32:05,882][123090] Updated weights for policy 1, policy_version 1360854 (0.0006) [2023-12-26 10:32:05,953][123090] Updated weights for policy 1, policy_version 1360864 (0.0011) [2023-12-26 10:32:06,468][123091] Updated weights for policy 0, policy_version 1370423 (0.0011) [2023-12-26 10:32:06,534][123091] Updated weights for policy 0, policy_version 1370433 (0.0010) [2023-12-26 10:32:06,604][123091] Updated weights for policy 0, policy_version 1370443 (0.0010) [2023-12-26 10:32:06,704][123090] Updated weights for policy 1, policy_version 1360874 (0.0009) [2023-12-26 10:32:06,764][123090] Updated weights for policy 1, policy_version 1360884 (0.0010) [2023-12-26 10:32:06,828][123090] Updated weights for policy 1, policy_version 1360894 (0.0011) [2023-12-26 10:32:07,355][123091] Updated weights for policy 0, policy_version 1370453 (0.0008) [2023-12-26 10:32:07,406][123091] Updated weights for policy 0, policy_version 1370463 (0.0005) [2023-12-26 10:32:07,463][123091] Updated weights for policy 0, policy_version 1370473 (0.0005) [2023-12-26 10:32:07,614][123090] Updated weights for policy 1, policy_version 1360904 (0.0007) [2023-12-26 10:32:07,675][123090] Updated weights for policy 1, policy_version 1360914 (0.0009) [2023-12-26 10:32:07,729][123090] Updated weights for policy 1, policy_version 1360924 (0.0010) [2023-12-26 10:32:08,147][123091] Updated weights for policy 0, policy_version 1370483 (0.0006) [2023-12-26 10:32:08,220][123091] Updated weights for policy 0, policy_version 1370493 (0.0005) [2023-12-26 10:32:08,293][123091] Updated weights for policy 0, policy_version 1370503 (0.0005) [2023-12-26 10:32:08,616][123090] Updated weights for policy 1, policy_version 1360934 (0.0010) [2023-12-26 10:32:08,668][123090] Updated weights for policy 1, policy_version 1360944 (0.0009) [2023-12-26 10:32:08,728][123090] Updated weights for policy 1, policy_version 1360954 (0.0010) [2023-12-26 10:32:08,784][121949] Fps is (10 sec: 18026.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 699260928. Throughput: 0: 8862.6, 1: 9005.4. Samples: 699232580. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:08,785][121949] Avg episode reward: [(0, '6339.996'), (1, '5935.557')] [2023-12-26 10:32:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001370512_350855168.pth... [2023-12-26 10:32:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001369488_350593024.pth [2023-12-26 10:32:08,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001360960_348405760.pth... [2023-12-26 10:32:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001359904_348135424.pth [2023-12-26 10:32:08,990][123091] Updated weights for policy 0, policy_version 1370513 (0.0010) [2023-12-26 10:32:09,051][123091] Updated weights for policy 0, policy_version 1370523 (0.0009) [2023-12-26 10:32:09,114][123091] Updated weights for policy 0, policy_version 1370533 (0.0011) [2023-12-26 10:32:09,181][123091] Updated weights for policy 0, policy_version 1370543 (0.0010) [2023-12-26 10:32:09,660][123090] Updated weights for policy 1, policy_version 1360964 (0.0010) [2023-12-26 10:32:09,721][123090] Updated weights for policy 1, policy_version 1360974 (0.0009) [2023-12-26 10:32:09,787][123090] Updated weights for policy 1, policy_version 1360984 (0.0007) [2023-12-26 10:32:10,012][123091] Updated weights for policy 0, policy_version 1370553 (0.0011) [2023-12-26 10:32:10,082][123091] Updated weights for policy 0, policy_version 1370563 (0.0011) [2023-12-26 10:32:10,144][123091] Updated weights for policy 0, policy_version 1370573 (0.0010) [2023-12-26 10:32:10,618][123090] Updated weights for policy 1, policy_version 1360994 (0.0009) [2023-12-26 10:32:10,675][123090] Updated weights for policy 1, policy_version 1361004 (0.0009) [2023-12-26 10:32:10,740][123090] Updated weights for policy 1, policy_version 1361014 (0.0009) [2023-12-26 10:32:10,809][123090] Updated weights for policy 1, policy_version 1361024 (0.0008) [2023-12-26 10:32:10,956][123091] Updated weights for policy 0, policy_version 1370583 (0.0010) [2023-12-26 10:32:11,007][123091] Updated weights for policy 0, policy_version 1370593 (0.0010) [2023-12-26 10:32:11,075][123091] Updated weights for policy 0, policy_version 1370603 (0.0011) [2023-12-26 10:32:11,666][123090] Updated weights for policy 1, policy_version 1361034 (0.0009) [2023-12-26 10:32:11,724][123090] Updated weights for policy 1, policy_version 1361044 (0.0009) [2023-12-26 10:32:11,794][123090] Updated weights for policy 1, policy_version 1361054 (0.0009) [2023-12-26 10:32:11,982][123091] Updated weights for policy 0, policy_version 1370613 (0.0008) [2023-12-26 10:32:12,049][123091] Updated weights for policy 0, policy_version 1370623 (0.0011) [2023-12-26 10:32:12,120][123091] Updated weights for policy 0, policy_version 1370633 (0.0011) [2023-12-26 10:32:12,654][123090] Updated weights for policy 1, policy_version 1361064 (0.0010) [2023-12-26 10:32:12,711][123090] Updated weights for policy 1, policy_version 1361074 (0.0010) [2023-12-26 10:32:12,766][123090] Updated weights for policy 1, policy_version 1361084 (0.0010) [2023-12-26 10:32:12,935][123091] Updated weights for policy 0, policy_version 1370643 (0.0011) [2023-12-26 10:32:13,002][123091] Updated weights for policy 0, policy_version 1370653 (0.0011) [2023-12-26 10:32:13,072][123091] Updated weights for policy 0, policy_version 1370663 (0.0011) [2023-12-26 10:32:13,452][123090] Updated weights for policy 1, policy_version 1361094 (0.0005) [2023-12-26 10:32:13,505][123090] Updated weights for policy 1, policy_version 1361104 (0.0005) [2023-12-26 10:32:13,560][123090] Updated weights for policy 1, policy_version 1361114 (0.0005) [2023-12-26 10:32:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 699342848. Throughput: 0: 8833.5, 1: 8910.8. Samples: 699335220. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:13,784][121949] Avg episode reward: [(0, '6358.014'), (1, '5910.275')] [2023-12-26 10:32:13,836][123091] Updated weights for policy 0, policy_version 1370673 (0.0010) [2023-12-26 10:32:13,885][123091] Updated weights for policy 0, policy_version 1370683 (0.0005) [2023-12-26 10:32:13,946][123091] Updated weights for policy 0, policy_version 1370693 (0.0005) [2023-12-26 10:32:14,009][123091] Updated weights for policy 0, policy_version 1370703 (0.0006) [2023-12-26 10:32:14,264][123090] Updated weights for policy 1, policy_version 1361124 (0.0009) [2023-12-26 10:32:14,326][123090] Updated weights for policy 1, policy_version 1361134 (0.0009) [2023-12-26 10:32:14,386][123090] Updated weights for policy 1, policy_version 1361144 (0.0009) [2023-12-26 10:32:14,761][123091] Updated weights for policy 0, policy_version 1370713 (0.0006) [2023-12-26 10:32:14,829][123091] Updated weights for policy 0, policy_version 1370723 (0.0008) [2023-12-26 10:32:14,899][123091] Updated weights for policy 0, policy_version 1370733 (0.0008) [2023-12-26 10:32:15,259][123090] Updated weights for policy 1, policy_version 1361154 (0.0009) [2023-12-26 10:32:15,313][123090] Updated weights for policy 1, policy_version 1361164 (0.0010) [2023-12-26 10:32:15,368][123090] Updated weights for policy 1, policy_version 1361174 (0.0009) [2023-12-26 10:32:15,428][123090] Updated weights for policy 1, policy_version 1361184 (0.0009) [2023-12-26 10:32:15,608][123091] Updated weights for policy 0, policy_version 1370743 (0.0007) [2023-12-26 10:32:15,665][123091] Updated weights for policy 0, policy_version 1370753 (0.0010) [2023-12-26 10:32:15,717][123091] Updated weights for policy 0, policy_version 1370763 (0.0010) [2023-12-26 10:32:16,210][123090] Updated weights for policy 1, policy_version 1361194 (0.0005) [2023-12-26 10:32:16,259][123090] Updated weights for policy 1, policy_version 1361204 (0.0005) [2023-12-26 10:32:16,325][123090] Updated weights for policy 1, policy_version 1361214 (0.0006) [2023-12-26 10:32:16,551][123091] Updated weights for policy 0, policy_version 1370774 (0.0010) [2023-12-26 10:32:16,607][123091] Updated weights for policy 0, policy_version 1370784 (0.0009) [2023-12-26 10:32:16,662][123091] Updated weights for policy 0, policy_version 1370794 (0.0010) [2023-12-26 10:32:17,011][123090] Updated weights for policy 1, policy_version 1361224 (0.0009) [2023-12-26 10:32:17,074][123090] Updated weights for policy 1, policy_version 1361234 (0.0010) [2023-12-26 10:32:17,138][123090] Updated weights for policy 1, policy_version 1361244 (0.0010) [2023-12-26 10:32:17,455][123091] Updated weights for policy 0, policy_version 1370804 (0.0008) [2023-12-26 10:32:17,509][123091] Updated weights for policy 0, policy_version 1370814 (0.0005) [2023-12-26 10:32:17,570][123091] Updated weights for policy 0, policy_version 1370824 (0.0005) [2023-12-26 10:32:17,956][123090] Updated weights for policy 1, policy_version 1361254 (0.0010) [2023-12-26 10:32:18,031][123090] Updated weights for policy 1, policy_version 1361264 (0.0010) [2023-12-26 10:32:18,088][123090] Updated weights for policy 1, policy_version 1361274 (0.0009) [2023-12-26 10:32:18,231][123091] Updated weights for policy 0, policy_version 1370834 (0.0006) [2023-12-26 10:32:18,283][123091] Updated weights for policy 0, policy_version 1370844 (0.0006) [2023-12-26 10:32:18,351][123091] Updated weights for policy 0, policy_version 1370854 (0.0007) [2023-12-26 10:32:18,419][123091] Updated weights for policy 0, policy_version 1370864 (0.0006) [2023-12-26 10:32:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 699432960. Throughput: 0: 8929.2, 1: 8908.4. Samples: 699445004. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:18,785][121949] Avg episode reward: [(0, '6314.877'), (1, '5860.183')] [2023-12-26 10:32:19,033][123090] Updated weights for policy 1, policy_version 1361284 (0.0010) [2023-12-26 10:32:19,091][123091] Updated weights for policy 0, policy_version 1370874 (0.0007) [2023-12-26 10:32:19,093][123090] Updated weights for policy 1, policy_version 1361294 (0.0011) [2023-12-26 10:32:19,136][123091] Updated weights for policy 0, policy_version 1370884 (0.0007) [2023-12-26 10:32:19,151][123090] Updated weights for policy 1, policy_version 1361304 (0.0010) [2023-12-26 10:32:19,194][123091] Updated weights for policy 0, policy_version 1370894 (0.0006) [2023-12-26 10:32:19,982][123090] Updated weights for policy 1, policy_version 1361314 (0.0010) [2023-12-26 10:32:20,006][123091] Updated weights for policy 0, policy_version 1370904 (0.0007) [2023-12-26 10:32:20,046][123090] Updated weights for policy 1, policy_version 1361324 (0.0008) [2023-12-26 10:32:20,062][123091] Updated weights for policy 0, policy_version 1370914 (0.0007) [2023-12-26 10:32:20,098][123090] Updated weights for policy 1, policy_version 1361334 (0.0008) [2023-12-26 10:32:20,119][123091] Updated weights for policy 0, policy_version 1370924 (0.0007) [2023-12-26 10:32:20,163][123090] Updated weights for policy 1, policy_version 1361344 (0.0008) [2023-12-26 10:32:20,971][123091] Updated weights for policy 0, policy_version 1370934 (0.0010) [2023-12-26 10:32:21,037][123091] Updated weights for policy 0, policy_version 1370944 (0.0008) [2023-12-26 10:32:21,046][123090] Updated weights for policy 1, policy_version 1361354 (0.0008) [2023-12-26 10:32:21,104][123091] Updated weights for policy 0, policy_version 1370954 (0.0010) [2023-12-26 10:32:21,116][123090] Updated weights for policy 1, policy_version 1361364 (0.0006) [2023-12-26 10:32:21,182][123090] Updated weights for policy 1, policy_version 1361374 (0.0008) [2023-12-26 10:32:21,888][123091] Updated weights for policy 0, policy_version 1370964 (0.0009) [2023-12-26 10:32:21,944][123091] Updated weights for policy 0, policy_version 1370974 (0.0009) [2023-12-26 10:32:22,003][123091] Updated weights for policy 0, policy_version 1370984 (0.0008) [2023-12-26 10:32:22,068][123090] Updated weights for policy 1, policy_version 1361384 (0.0010) [2023-12-26 10:32:22,127][123090] Updated weights for policy 1, policy_version 1361394 (0.0009) [2023-12-26 10:32:22,192][123090] Updated weights for policy 1, policy_version 1361404 (0.0010) [2023-12-26 10:32:22,824][123091] Updated weights for policy 0, policy_version 1370994 (0.0007) [2023-12-26 10:32:22,880][123091] Updated weights for policy 0, policy_version 1371004 (0.0008) [2023-12-26 10:32:22,939][123091] Updated weights for policy 0, policy_version 1371014 (0.0008) [2023-12-26 10:32:23,004][123091] Updated weights for policy 0, policy_version 1371024 (0.0009) [2023-12-26 10:32:23,100][123090] Updated weights for policy 1, policy_version 1361414 (0.0008) [2023-12-26 10:32:23,160][123090] Updated weights for policy 1, policy_version 1361424 (0.0008) [2023-12-26 10:32:23,222][123090] Updated weights for policy 1, policy_version 1361434 (0.0010) [2023-12-26 10:32:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 699514880. Throughput: 0: 8921.0, 1: 8872.0. Samples: 699496432. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:23,785][121949] Avg episode reward: [(0, '6369.058'), (1, '5864.016')] [2023-12-26 10:32:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001361440_348528640.pth... [2023-12-26 10:32:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001360416_348266496.pth [2023-12-26 10:32:23,813][123091] Updated weights for policy 0, policy_version 1371034 (0.0009) [2023-12-26 10:32:23,860][123091] Updated weights for policy 0, policy_version 1371044 (0.0009) [2023-12-26 10:32:23,926][123091] Updated weights for policy 0, policy_version 1371054 (0.0010) [2023-12-26 10:32:23,937][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001371056_350994432.pth... [2023-12-26 10:32:23,943][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001370000_350724096.pth [2023-12-26 10:32:24,028][123090] Updated weights for policy 1, policy_version 1361445 (0.0010) [2023-12-26 10:32:24,080][123090] Updated weights for policy 1, policy_version 1361455 (0.0008) [2023-12-26 10:32:24,129][123090] Updated weights for policy 1, policy_version 1361465 (0.0008) [2023-12-26 10:32:24,829][123091] Updated weights for policy 0, policy_version 1371064 (0.0009) [2023-12-26 10:32:24,879][123091] Updated weights for policy 0, policy_version 1371074 (0.0009) [2023-12-26 10:32:24,896][123090] Updated weights for policy 1, policy_version 1361475 (0.0008) [2023-12-26 10:32:24,929][123091] Updated weights for policy 0, policy_version 1371084 (0.0009) [2023-12-26 10:32:24,953][123090] Updated weights for policy 1, policy_version 1361485 (0.0007) [2023-12-26 10:32:25,018][123090] Updated weights for policy 1, policy_version 1361495 (0.0009) [2023-12-26 10:32:25,709][123091] Updated weights for policy 0, policy_version 1371094 (0.0007) [2023-12-26 10:32:25,758][123091] Updated weights for policy 0, policy_version 1371104 (0.0005) [2023-12-26 10:32:25,803][123091] Updated weights for policy 0, policy_version 1371114 (0.0005) [2023-12-26 10:32:25,848][123090] Updated weights for policy 1, policy_version 1361505 (0.0009) [2023-12-26 10:32:25,906][123090] Updated weights for policy 1, policy_version 1361515 (0.0005) [2023-12-26 10:32:25,958][123090] Updated weights for policy 1, policy_version 1361525 (0.0005) [2023-12-26 10:32:26,006][123090] Updated weights for policy 1, policy_version 1361535 (0.0005) [2023-12-26 10:32:26,558][123091] Updated weights for policy 0, policy_version 1371124 (0.0007) [2023-12-26 10:32:26,614][123091] Updated weights for policy 0, policy_version 1371134 (0.0009) [2023-12-26 10:32:26,640][123090] Updated weights for policy 1, policy_version 1361545 (0.0009) [2023-12-26 10:32:26,680][123091] Updated weights for policy 0, policy_version 1371144 (0.0007) [2023-12-26 10:32:26,687][123090] Updated weights for policy 1, policy_version 1361555 (0.0008) [2023-12-26 10:32:26,737][123090] Updated weights for policy 1, policy_version 1361565 (0.0008) [2023-12-26 10:32:27,457][123091] Updated weights for policy 0, policy_version 1371154 (0.0009) [2023-12-26 10:32:27,520][123091] Updated weights for policy 0, policy_version 1371164 (0.0008) [2023-12-26 10:32:27,593][123091] Updated weights for policy 0, policy_version 1371174 (0.0006) [2023-12-26 10:32:27,627][123090] Updated weights for policy 1, policy_version 1361575 (0.0008) [2023-12-26 10:32:27,656][123091] Updated weights for policy 0, policy_version 1371184 (0.0006) [2023-12-26 10:32:27,694][123090] Updated weights for policy 1, policy_version 1361585 (0.0009) [2023-12-26 10:32:27,762][123090] Updated weights for policy 1, policy_version 1361595 (0.0010) [2023-12-26 10:32:28,286][123091] Updated weights for policy 0, policy_version 1371194 (0.0005) [2023-12-26 10:32:28,355][123091] Updated weights for policy 0, policy_version 1371204 (0.0007) [2023-12-26 10:32:28,407][123091] Updated weights for policy 0, policy_version 1371214 (0.0009) [2023-12-26 10:32:28,658][123090] Updated weights for policy 1, policy_version 1361605 (0.0009) [2023-12-26 10:32:28,719][123090] Updated weights for policy 1, policy_version 1361615 (0.0009) [2023-12-26 10:32:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 699604992. Throughput: 0: 8942.3, 1: 8843.4. Samples: 699601876. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:28,785][121949] Avg episode reward: [(0, '6348.417'), (1, '5908.601')] [2023-12-26 10:32:28,789][123090] Updated weights for policy 1, policy_version 1361625 (0.0010) [2023-12-26 10:32:29,057][123091] Updated weights for policy 0, policy_version 1371224 (0.0009) [2023-12-26 10:32:29,107][123091] Updated weights for policy 0, policy_version 1371234 (0.0008) [2023-12-26 10:32:29,155][123091] Updated weights for policy 0, policy_version 1371244 (0.0009) [2023-12-26 10:32:29,661][123090] Updated weights for policy 1, policy_version 1361635 (0.0010) [2023-12-26 10:32:29,715][123090] Updated weights for policy 1, policy_version 1361645 (0.0009) [2023-12-26 10:32:29,776][123090] Updated weights for policy 1, policy_version 1361655 (0.0009) [2023-12-26 10:32:29,985][123091] Updated weights for policy 0, policy_version 1371254 (0.0010) [2023-12-26 10:32:30,050][123091] Updated weights for policy 0, policy_version 1371264 (0.0009) [2023-12-26 10:32:30,113][123091] Updated weights for policy 0, policy_version 1371274 (0.0009) [2023-12-26 10:32:30,602][123090] Updated weights for policy 1, policy_version 1361665 (0.0009) [2023-12-26 10:32:30,664][123090] Updated weights for policy 1, policy_version 1361675 (0.0010) [2023-12-26 10:32:30,715][123090] Updated weights for policy 1, policy_version 1361685 (0.0009) [2023-12-26 10:32:30,770][123090] Updated weights for policy 1, policy_version 1361695 (0.0009) [2023-12-26 10:32:30,903][123091] Updated weights for policy 0, policy_version 1371284 (0.0009) [2023-12-26 10:32:30,962][123091] Updated weights for policy 0, policy_version 1371294 (0.0009) [2023-12-26 10:32:31,010][123091] Updated weights for policy 0, policy_version 1371304 (0.0009) [2023-12-26 10:32:31,589][123090] Updated weights for policy 1, policy_version 1361705 (0.0009) [2023-12-26 10:32:31,657][123090] Updated weights for policy 1, policy_version 1361715 (0.0009) [2023-12-26 10:32:31,717][123090] Updated weights for policy 1, policy_version 1361725 (0.0009) [2023-12-26 10:32:31,865][123091] Updated weights for policy 0, policy_version 1371314 (0.0009) [2023-12-26 10:32:31,916][123091] Updated weights for policy 0, policy_version 1371324 (0.0009) [2023-12-26 10:32:31,969][123091] Updated weights for policy 0, policy_version 1371334 (0.0010) [2023-12-26 10:32:32,030][123091] Updated weights for policy 0, policy_version 1371344 (0.0010) [2023-12-26 10:32:32,462][123090] Updated weights for policy 1, policy_version 1361735 (0.0009) [2023-12-26 10:32:32,518][123090] Updated weights for policy 1, policy_version 1361745 (0.0009) [2023-12-26 10:32:32,578][123090] Updated weights for policy 1, policy_version 1361755 (0.0010) [2023-12-26 10:32:32,879][123091] Updated weights for policy 0, policy_version 1371354 (0.0009) [2023-12-26 10:32:32,935][123091] Updated weights for policy 0, policy_version 1371364 (0.0010) [2023-12-26 10:32:32,985][123091] Updated weights for policy 0, policy_version 1371374 (0.0010) [2023-12-26 10:32:33,373][123090] Updated weights for policy 1, policy_version 1361765 (0.0008) [2023-12-26 10:32:33,437][123090] Updated weights for policy 1, policy_version 1361775 (0.0008) [2023-12-26 10:32:33,506][123090] Updated weights for policy 1, policy_version 1361785 (0.0008) [2023-12-26 10:32:33,763][123091] Updated weights for policy 0, policy_version 1371384 (0.0007) [2023-12-26 10:32:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 699695104. Throughput: 0: 8890.6, 1: 8731.3. Samples: 699708276. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:33,784][121949] Avg episode reward: [(0, '6316.834'), (1, '5938.902')] [2023-12-26 10:32:33,808][123091] Updated weights for policy 0, policy_version 1371394 (0.0005) [2023-12-26 10:32:33,857][123091] Updated weights for policy 0, policy_version 1371404 (0.0005) [2023-12-26 10:32:34,299][123090] Updated weights for policy 1, policy_version 1361795 (0.0009) [2023-12-26 10:32:34,362][123090] Updated weights for policy 1, policy_version 1361805 (0.0010) [2023-12-26 10:32:34,424][123090] Updated weights for policy 1, policy_version 1361815 (0.0009) [2023-12-26 10:32:34,565][123091] Updated weights for policy 0, policy_version 1371414 (0.0007) [2023-12-26 10:32:34,635][123091] Updated weights for policy 0, policy_version 1371424 (0.0009) [2023-12-26 10:32:34,705][123091] Updated weights for policy 0, policy_version 1371434 (0.0010) [2023-12-26 10:32:35,264][123090] Updated weights for policy 1, policy_version 1361825 (0.0009) [2023-12-26 10:32:35,324][123090] Updated weights for policy 1, policy_version 1361835 (0.0009) [2023-12-26 10:32:35,373][123090] Updated weights for policy 1, policy_version 1361845 (0.0009) [2023-12-26 10:32:35,427][123090] Updated weights for policy 1, policy_version 1361855 (0.0009) [2023-12-26 10:32:35,478][123091] Updated weights for policy 0, policy_version 1371444 (0.0009) [2023-12-26 10:32:35,539][123091] Updated weights for policy 0, policy_version 1371454 (0.0010) [2023-12-26 10:32:35,596][123091] Updated weights for policy 0, policy_version 1371464 (0.0009) [2023-12-26 10:32:36,288][123090] Updated weights for policy 1, policy_version 1361865 (0.0010) [2023-12-26 10:32:36,349][123090] Updated weights for policy 1, policy_version 1361875 (0.0010) [2023-12-26 10:32:36,418][123090] Updated weights for policy 1, policy_version 1361885 (0.0010) [2023-12-26 10:32:36,445][123091] Updated weights for policy 0, policy_version 1371474 (0.0009) [2023-12-26 10:32:36,498][123091] Updated weights for policy 0, policy_version 1371484 (0.0010) [2023-12-26 10:32:36,554][123091] Updated weights for policy 0, policy_version 1371494 (0.0009) [2023-12-26 10:32:36,610][123091] Updated weights for policy 0, policy_version 1371504 (0.0009) [2023-12-26 10:32:37,220][123090] Updated weights for policy 1, policy_version 1361895 (0.0009) [2023-12-26 10:32:37,280][123090] Updated weights for policy 1, policy_version 1361905 (0.0009) [2023-12-26 10:32:37,337][123090] Updated weights for policy 1, policy_version 1361915 (0.0009) [2023-12-26 10:32:37,459][123091] Updated weights for policy 0, policy_version 1371514 (0.0005) [2023-12-26 10:32:37,508][123091] Updated weights for policy 0, policy_version 1371524 (0.0005) [2023-12-26 10:32:37,561][123091] Updated weights for policy 0, policy_version 1371534 (0.0005) [2023-12-26 10:32:38,207][123090] Updated weights for policy 1, policy_version 1361925 (0.0010) [2023-12-26 10:32:38,263][123090] Updated weights for policy 1, policy_version 1361935 (0.0010) [2023-12-26 10:32:38,317][123090] Updated weights for policy 1, policy_version 1361945 (0.0009) [2023-12-26 10:32:38,354][123091] Updated weights for policy 0, policy_version 1371544 (0.0006) [2023-12-26 10:32:38,422][123091] Updated weights for policy 0, policy_version 1371554 (0.0008) [2023-12-26 10:32:38,484][123091] Updated weights for policy 0, policy_version 1371564 (0.0008) [2023-12-26 10:32:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 699785216. Throughput: 0: 8869.3, 1: 8711.6. Samples: 699760568. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:38,785][121949] Avg episode reward: [(0, '6339.883'), (1, '5915.450')] [2023-12-26 10:32:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001361952_348659712.pth... [2023-12-26 10:32:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001371568_351125504.pth... [2023-12-26 10:32:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001360960_348405760.pth [2023-12-26 10:32:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001370512_350855168.pth [2023-12-26 10:32:39,234][123090] Updated weights for policy 1, policy_version 1361955 (0.0008) [2023-12-26 10:32:39,237][123091] Updated weights for policy 0, policy_version 1371574 (0.0009) [2023-12-26 10:32:39,302][123091] Updated weights for policy 0, policy_version 1371584 (0.0009) [2023-12-26 10:32:39,305][123090] Updated weights for policy 1, policy_version 1361965 (0.0006) [2023-12-26 10:32:39,374][123091] Updated weights for policy 0, policy_version 1371594 (0.0009) [2023-12-26 10:32:39,375][123090] Updated weights for policy 1, policy_version 1361975 (0.0010) [2023-12-26 10:32:40,187][123091] Updated weights for policy 0, policy_version 1371604 (0.0008) [2023-12-26 10:32:40,224][123090] Updated weights for policy 1, policy_version 1361985 (0.0009) [2023-12-26 10:32:40,250][123091] Updated weights for policy 0, policy_version 1371614 (0.0009) [2023-12-26 10:32:40,278][123090] Updated weights for policy 1, policy_version 1361995 (0.0007) [2023-12-26 10:32:40,298][123091] Updated weights for policy 0, policy_version 1371624 (0.0009) [2023-12-26 10:32:40,340][123090] Updated weights for policy 1, policy_version 1362005 (0.0009) [2023-12-26 10:32:40,396][123090] Updated weights for policy 1, policy_version 1362015 (0.0007) [2023-12-26 10:32:41,167][123090] Updated weights for policy 1, policy_version 1362025 (0.0008) [2023-12-26 10:32:41,211][123091] Updated weights for policy 0, policy_version 1371634 (0.0008) [2023-12-26 10:32:41,241][123090] Updated weights for policy 1, policy_version 1362035 (0.0008) [2023-12-26 10:32:41,270][123091] Updated weights for policy 0, policy_version 1371644 (0.0008) [2023-12-26 10:32:41,305][123090] Updated weights for policy 1, policy_version 1362045 (0.0008) [2023-12-26 10:32:41,339][123091] Updated weights for policy 0, policy_version 1371654 (0.0009) [2023-12-26 10:32:41,406][123091] Updated weights for policy 0, policy_version 1371664 (0.0009) [2023-12-26 10:32:42,163][123090] Updated weights for policy 1, policy_version 1362055 (0.0009) [2023-12-26 10:32:42,215][123090] Updated weights for policy 1, policy_version 1362065 (0.0009) [2023-12-26 10:32:42,228][123091] Updated weights for policy 0, policy_version 1371674 (0.0009) [2023-12-26 10:32:42,283][123090] Updated weights for policy 1, policy_version 1362075 (0.0010) [2023-12-26 10:32:42,294][123091] Updated weights for policy 0, policy_version 1371684 (0.0007) [2023-12-26 10:32:42,364][123091] Updated weights for policy 0, policy_version 1371694 (0.0008) [2023-12-26 10:32:43,152][123091] Updated weights for policy 0, policy_version 1371704 (0.0008) [2023-12-26 10:32:43,152][123090] Updated weights for policy 1, policy_version 1362085 (0.0009) [2023-12-26 10:32:43,206][123090] Updated weights for policy 1, policy_version 1362095 (0.0007) [2023-12-26 10:32:43,208][123091] Updated weights for policy 0, policy_version 1371714 (0.0009) [2023-12-26 10:32:43,257][123091] Updated weights for policy 0, policy_version 1371724 (0.0008) [2023-12-26 10:32:43,268][123090] Updated weights for policy 1, policy_version 1362105 (0.0007) [2023-12-26 10:32:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 699867136. Throughput: 0: 8878.7, 1: 8572.9. Samples: 699862216. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:43,785][121949] Avg episode reward: [(0, '6306.303'), (1, '5905.375')] [2023-12-26 10:32:43,986][123090] Updated weights for policy 1, policy_version 1362115 (0.0008) [2023-12-26 10:32:44,048][123090] Updated weights for policy 1, policy_version 1362125 (0.0005) [2023-12-26 10:32:44,112][123090] Updated weights for policy 1, policy_version 1362135 (0.0005) [2023-12-26 10:32:44,139][123091] Updated weights for policy 0, policy_version 1371734 (0.0009) [2023-12-26 10:32:44,204][123091] Updated weights for policy 0, policy_version 1371744 (0.0009) [2023-12-26 10:32:44,275][123091] Updated weights for policy 0, policy_version 1371754 (0.0010) [2023-12-26 10:32:44,738][123090] Updated weights for policy 1, policy_version 1362145 (0.0005) [2023-12-26 10:32:44,810][123090] Updated weights for policy 1, policy_version 1362155 (0.0008) [2023-12-26 10:32:44,878][123090] Updated weights for policy 1, policy_version 1362165 (0.0006) [2023-12-26 10:32:44,947][123090] Updated weights for policy 1, policy_version 1362175 (0.0005) [2023-12-26 10:32:45,079][123091] Updated weights for policy 0, policy_version 1371764 (0.0010) [2023-12-26 10:32:45,138][123091] Updated weights for policy 0, policy_version 1371774 (0.0010) [2023-12-26 10:32:45,194][123091] Updated weights for policy 0, policy_version 1371784 (0.0010) [2023-12-26 10:32:45,690][123090] Updated weights for policy 1, policy_version 1362185 (0.0009) [2023-12-26 10:32:45,746][123090] Updated weights for policy 1, policy_version 1362195 (0.0009) [2023-12-26 10:32:45,810][123090] Updated weights for policy 1, policy_version 1362205 (0.0010) [2023-12-26 10:32:45,960][123091] Updated weights for policy 0, policy_version 1371794 (0.0008) [2023-12-26 10:32:46,016][123091] Updated weights for policy 0, policy_version 1371804 (0.0005) [2023-12-26 10:32:46,071][123091] Updated weights for policy 0, policy_version 1371814 (0.0005) [2023-12-26 10:32:46,129][123091] Updated weights for policy 0, policy_version 1371824 (0.0008) [2023-12-26 10:32:46,660][123090] Updated weights for policy 1, policy_version 1362215 (0.0010) [2023-12-26 10:32:46,709][123090] Updated weights for policy 1, policy_version 1362225 (0.0009) [2023-12-26 10:32:46,758][123090] Updated weights for policy 1, policy_version 1362235 (0.0009) [2023-12-26 10:32:46,951][123091] Updated weights for policy 0, policy_version 1371834 (0.0009) [2023-12-26 10:32:47,012][123091] Updated weights for policy 0, policy_version 1371844 (0.0010) [2023-12-26 10:32:47,067][123091] Updated weights for policy 0, policy_version 1371854 (0.0009) [2023-12-26 10:32:47,611][123090] Updated weights for policy 1, policy_version 1362245 (0.0009) [2023-12-26 10:32:47,665][123090] Updated weights for policy 1, policy_version 1362255 (0.0006) [2023-12-26 10:32:47,725][123090] Updated weights for policy 1, policy_version 1362265 (0.0006) [2023-12-26 10:32:47,888][123091] Updated weights for policy 0, policy_version 1371864 (0.0009) [2023-12-26 10:32:47,949][123091] Updated weights for policy 0, policy_version 1371874 (0.0008) [2023-12-26 10:32:48,001][123091] Updated weights for policy 0, policy_version 1371884 (0.0008) [2023-12-26 10:32:48,538][123090] Updated weights for policy 1, policy_version 1362275 (0.0007) [2023-12-26 10:32:48,603][123090] Updated weights for policy 1, policy_version 1362285 (0.0006) [2023-12-26 10:32:48,671][123090] Updated weights for policy 1, policy_version 1362295 (0.0008) [2023-12-26 10:32:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 699957248. Throughput: 0: 8888.8, 1: 8635.9. Samples: 699968428. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:48,785][121949] Avg episode reward: [(0, '6214.854'), (1, '5879.246')] [2023-12-26 10:32:48,839][123091] Updated weights for policy 0, policy_version 1371894 (0.0007) [2023-12-26 10:32:48,911][123091] Updated weights for policy 0, policy_version 1371904 (0.0005) [2023-12-26 10:32:48,984][123091] Updated weights for policy 0, policy_version 1371914 (0.0006) [2023-12-26 10:32:49,549][123090] Updated weights for policy 1, policy_version 1362305 (0.0010) [2023-12-26 10:32:49,618][123090] Updated weights for policy 1, policy_version 1362315 (0.0009) [2023-12-26 10:32:49,674][123090] Updated weights for policy 1, policy_version 1362325 (0.0009) [2023-12-26 10:32:49,707][123091] Updated weights for policy 0, policy_version 1371924 (0.0007) [2023-12-26 10:32:49,731][123090] Updated weights for policy 1, policy_version 1362335 (0.0008) [2023-12-26 10:32:49,772][123091] Updated weights for policy 0, policy_version 1371934 (0.0009) [2023-12-26 10:32:49,840][123091] Updated weights for policy 0, policy_version 1371944 (0.0010) [2023-12-26 10:32:50,580][123090] Updated weights for policy 1, policy_version 1362345 (0.0009) [2023-12-26 10:32:50,648][123090] Updated weights for policy 1, policy_version 1362355 (0.0006) [2023-12-26 10:32:50,676][123091] Updated weights for policy 0, policy_version 1371954 (0.0008) [2023-12-26 10:32:50,714][123090] Updated weights for policy 1, policy_version 1362365 (0.0007) [2023-12-26 10:32:50,742][123091] Updated weights for policy 0, policy_version 1371964 (0.0010) [2023-12-26 10:32:50,803][123091] Updated weights for policy 0, policy_version 1371974 (0.0009) [2023-12-26 10:32:50,870][123091] Updated weights for policy 0, policy_version 1371984 (0.0009) [2023-12-26 10:32:51,507][123090] Updated weights for policy 1, policy_version 1362375 (0.0006) [2023-12-26 10:32:51,563][123090] Updated weights for policy 1, policy_version 1362385 (0.0009) [2023-12-26 10:32:51,624][123090] Updated weights for policy 1, policy_version 1362395 (0.0009) [2023-12-26 10:32:51,677][123091] Updated weights for policy 0, policy_version 1371994 (0.0010) [2023-12-26 10:32:51,743][123091] Updated weights for policy 0, policy_version 1372004 (0.0010) [2023-12-26 10:32:51,808][123091] Updated weights for policy 0, policy_version 1372014 (0.0010) [2023-12-26 10:32:52,453][123090] Updated weights for policy 1, policy_version 1362405 (0.0006) [2023-12-26 10:32:52,525][123090] Updated weights for policy 1, policy_version 1362415 (0.0006) [2023-12-26 10:32:52,586][123090] Updated weights for policy 1, policy_version 1362425 (0.0005) [2023-12-26 10:32:52,653][123091] Updated weights for policy 0, policy_version 1372024 (0.0009) [2023-12-26 10:32:52,706][123091] Updated weights for policy 0, policy_version 1372034 (0.0008) [2023-12-26 10:32:52,754][123091] Updated weights for policy 0, policy_version 1372044 (0.0009) [2023-12-26 10:32:53,373][123090] Updated weights for policy 1, policy_version 1362435 (0.0009) [2023-12-26 10:32:53,425][123090] Updated weights for policy 1, policy_version 1362445 (0.0010) [2023-12-26 10:32:53,477][123090] Updated weights for policy 1, policy_version 1362455 (0.0010) [2023-12-26 10:32:53,495][123091] Updated weights for policy 0, policy_version 1372054 (0.0010) [2023-12-26 10:32:53,558][123091] Updated weights for policy 0, policy_version 1372064 (0.0011) [2023-12-26 10:32:53,621][123091] Updated weights for policy 0, policy_version 1372074 (0.0011) [2023-12-26 10:32:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 700047360. Throughput: 0: 8887.8, 1: 8610.7. Samples: 700020016. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:53,785][121949] Avg episode reward: [(0, '6290.267'), (1, '5816.562')] [2023-12-26 10:32:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001362464_348790784.pth... [2023-12-26 10:32:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001372080_351256576.pth... [2023-12-26 10:32:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001361440_348528640.pth [2023-12-26 10:32:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001371056_350994432.pth [2023-12-26 10:32:54,215][123090] Updated weights for policy 1, policy_version 1362465 (0.0010) [2023-12-26 10:32:54,285][123090] Updated weights for policy 1, policy_version 1362475 (0.0006) [2023-12-26 10:32:54,361][123090] Updated weights for policy 1, policy_version 1362485 (0.0010) [2023-12-26 10:32:54,401][123091] Updated weights for policy 0, policy_version 1372084 (0.0009) [2023-12-26 10:32:54,429][123090] Updated weights for policy 1, policy_version 1362495 (0.0011) [2023-12-26 10:32:54,468][123091] Updated weights for policy 0, policy_version 1372094 (0.0008) [2023-12-26 10:32:54,540][123091] Updated weights for policy 0, policy_version 1372104 (0.0009) [2023-12-26 10:32:55,168][123090] Updated weights for policy 1, policy_version 1362505 (0.0008) [2023-12-26 10:32:55,223][123090] Updated weights for policy 1, policy_version 1362515 (0.0010) [2023-12-26 10:32:55,226][123091] Updated weights for policy 0, policy_version 1372114 (0.0008) [2023-12-26 10:32:55,281][123090] Updated weights for policy 1, policy_version 1362525 (0.0005) [2023-12-26 10:32:55,287][123091] Updated weights for policy 0, policy_version 1372124 (0.0009) [2023-12-26 10:32:55,350][123091] Updated weights for policy 0, policy_version 1372134 (0.0006) [2023-12-26 10:32:55,415][123091] Updated weights for policy 0, policy_version 1372144 (0.0005) [2023-12-26 10:32:55,854][123090] Updated weights for policy 1, policy_version 1362535 (0.0005) [2023-12-26 10:32:55,922][123090] Updated weights for policy 1, policy_version 1362545 (0.0005) [2023-12-26 10:32:55,996][123090] Updated weights for policy 1, policy_version 1362555 (0.0006) [2023-12-26 10:32:56,047][123091] Updated weights for policy 0, policy_version 1372154 (0.0011) [2023-12-26 10:32:56,098][123091] Updated weights for policy 0, policy_version 1372164 (0.0010) [2023-12-26 10:32:56,145][123091] Updated weights for policy 0, policy_version 1372174 (0.0010) [2023-12-26 10:32:56,635][123090] Updated weights for policy 1, policy_version 1362565 (0.0008) [2023-12-26 10:32:56,700][123090] Updated weights for policy 1, policy_version 1362575 (0.0011) [2023-12-26 10:32:56,753][123090] Updated weights for policy 1, policy_version 1362585 (0.0007) [2023-12-26 10:32:56,892][123091] Updated weights for policy 0, policy_version 1372184 (0.0007) [2023-12-26 10:32:56,949][123091] Updated weights for policy 0, policy_version 1372194 (0.0006) [2023-12-26 10:32:57,010][123091] Updated weights for policy 0, policy_version 1372204 (0.0010) [2023-12-26 10:32:57,426][123090] Updated weights for policy 1, policy_version 1362595 (0.0009) [2023-12-26 10:32:57,485][123090] Updated weights for policy 1, policy_version 1362605 (0.0005) [2023-12-26 10:32:57,544][123090] Updated weights for policy 1, policy_version 1362615 (0.0005) [2023-12-26 10:32:57,806][123091] Updated weights for policy 0, policy_version 1372214 (0.0011) [2023-12-26 10:32:57,857][123091] Updated weights for policy 0, policy_version 1372224 (0.0010) [2023-12-26 10:32:57,912][123091] Updated weights for policy 0, policy_version 1372234 (0.0011) [2023-12-26 10:32:58,220][123090] Updated weights for policy 1, policy_version 1362625 (0.0005) [2023-12-26 10:32:58,282][123090] Updated weights for policy 1, policy_version 1362635 (0.0007) [2023-12-26 10:32:58,345][123090] Updated weights for policy 1, policy_version 1362645 (0.0008) [2023-12-26 10:32:58,415][123090] Updated weights for policy 1, policy_version 1362655 (0.0008) [2023-12-26 10:32:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17613.6, 300 sec: 17716.9). Total num frames: 700137472. Throughput: 0: 8960.9, 1: 8772.3. Samples: 700133212. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:32:58,785][121949] Avg episode reward: [(0, '6316.721'), (1, '5860.699')] [2023-12-26 10:32:58,818][123091] Updated weights for policy 0, policy_version 1372244 (0.0009) [2023-12-26 10:32:58,896][123091] Updated weights for policy 0, policy_version 1372254 (0.0007) [2023-12-26 10:32:58,963][123091] Updated weights for policy 0, policy_version 1372264 (0.0008) [2023-12-26 10:32:59,294][123090] Updated weights for policy 1, policy_version 1362665 (0.0009) [2023-12-26 10:32:59,364][123090] Updated weights for policy 1, policy_version 1362675 (0.0010) [2023-12-26 10:32:59,422][123090] Updated weights for policy 1, policy_version 1362685 (0.0009) [2023-12-26 10:32:59,820][123091] Updated weights for policy 0, policy_version 1372274 (0.0010) [2023-12-26 10:32:59,886][123091] Updated weights for policy 0, policy_version 1372284 (0.0010) [2023-12-26 10:32:59,950][123091] Updated weights for policy 0, policy_version 1372294 (0.0009) [2023-12-26 10:33:00,011][123091] Updated weights for policy 0, policy_version 1372304 (0.0006) [2023-12-26 10:33:00,237][123090] Updated weights for policy 1, policy_version 1362695 (0.0009) [2023-12-26 10:33:00,284][123090] Updated weights for policy 1, policy_version 1362705 (0.0008) [2023-12-26 10:33:00,331][123090] Updated weights for policy 1, policy_version 1362715 (0.0008) [2023-12-26 10:33:00,824][123091] Updated weights for policy 0, policy_version 1372314 (0.0010) [2023-12-26 10:33:00,879][123091] Updated weights for policy 0, policy_version 1372324 (0.0009) [2023-12-26 10:33:00,931][123091] Updated weights for policy 0, policy_version 1372334 (0.0009) [2023-12-26 10:33:01,056][123090] Updated weights for policy 1, policy_version 1362725 (0.0009) [2023-12-26 10:33:01,121][123090] Updated weights for policy 1, policy_version 1362735 (0.0009) [2023-12-26 10:33:01,194][123090] Updated weights for policy 1, policy_version 1362745 (0.0010) [2023-12-26 10:33:01,825][123091] Updated weights for policy 0, policy_version 1372344 (0.0010) [2023-12-26 10:33:01,885][123091] Updated weights for policy 0, policy_version 1372354 (0.0009) [2023-12-26 10:33:01,910][123090] Updated weights for policy 1, policy_version 1362755 (0.0009) [2023-12-26 10:33:01,952][123091] Updated weights for policy 0, policy_version 1372364 (0.0005) [2023-12-26 10:33:01,971][123090] Updated weights for policy 1, policy_version 1362765 (0.0008) [2023-12-26 10:33:02,032][123090] Updated weights for policy 1, policy_version 1362775 (0.0010) [2023-12-26 10:33:02,606][123091] Updated weights for policy 0, policy_version 1372374 (0.0007) [2023-12-26 10:33:02,680][123091] Updated weights for policy 0, policy_version 1372384 (0.0008) [2023-12-26 10:33:02,749][123091] Updated weights for policy 0, policy_version 1372394 (0.0008) [2023-12-26 10:33:02,780][123090] Updated weights for policy 1, policy_version 1362785 (0.0009) [2023-12-26 10:33:02,848][123090] Updated weights for policy 1, policy_version 1362795 (0.0005) [2023-12-26 10:33:02,912][123090] Updated weights for policy 1, policy_version 1362805 (0.0005) [2023-12-26 10:33:02,991][123090] Updated weights for policy 1, policy_version 1362815 (0.0005) [2023-12-26 10:33:03,508][123091] Updated weights for policy 0, policy_version 1372404 (0.0008) [2023-12-26 10:33:03,564][123091] Updated weights for policy 0, policy_version 1372414 (0.0009) [2023-12-26 10:33:03,600][123090] Updated weights for policy 1, policy_version 1362825 (0.0009) [2023-12-26 10:33:03,612][123091] Updated weights for policy 0, policy_version 1372424 (0.0006) [2023-12-26 10:33:03,668][123090] Updated weights for policy 1, policy_version 1362835 (0.0008) [2023-12-26 10:33:03,713][123090] Updated weights for policy 1, policy_version 1362845 (0.0006) [2023-12-26 10:33:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 700235776. Throughput: 0: 8851.3, 1: 8849.1. Samples: 700241524. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:33:03,785][121949] Avg episode reward: [(0, '6325.918'), (1, '5978.954')] [2023-12-26 10:33:04,355][123091] Updated weights for policy 0, policy_version 1372434 (0.0008) [2023-12-26 10:33:04,412][123091] Updated weights for policy 0, policy_version 1372444 (0.0009) [2023-12-26 10:33:04,477][123091] Updated weights for policy 0, policy_version 1372454 (0.0009) [2023-12-26 10:33:04,506][123090] Updated weights for policy 1, policy_version 1362855 (0.0007) [2023-12-26 10:33:04,541][123091] Updated weights for policy 0, policy_version 1372464 (0.0009) [2023-12-26 10:33:04,569][123090] Updated weights for policy 1, policy_version 1362865 (0.0010) [2023-12-26 10:33:04,630][123090] Updated weights for policy 1, policy_version 1362875 (0.0009) [2023-12-26 10:33:05,377][123091] Updated weights for policy 0, policy_version 1372475 (0.0010) [2023-12-26 10:33:05,428][123091] Updated weights for policy 0, policy_version 1372485 (0.0009) [2023-12-26 10:33:05,461][123090] Updated weights for policy 1, policy_version 1362885 (0.0009) [2023-12-26 10:33:05,477][123091] Updated weights for policy 0, policy_version 1372495 (0.0008) [2023-12-26 10:33:05,518][123090] Updated weights for policy 1, policy_version 1362895 (0.0009) [2023-12-26 10:33:05,579][123090] Updated weights for policy 1, policy_version 1362905 (0.0008) [2023-12-26 10:33:06,274][123091] Updated weights for policy 0, policy_version 1372505 (0.0006) [2023-12-26 10:33:06,337][123090] Updated weights for policy 1, policy_version 1362915 (0.0008) [2023-12-26 10:33:06,341][123091] Updated weights for policy 0, policy_version 1372515 (0.0008) [2023-12-26 10:33:06,401][123091] Updated weights for policy 0, policy_version 1372525 (0.0011) [2023-12-26 10:33:06,409][123090] Updated weights for policy 1, policy_version 1362925 (0.0009) [2023-12-26 10:33:06,481][123090] Updated weights for policy 1, policy_version 1362935 (0.0006) [2023-12-26 10:33:07,138][123091] Updated weights for policy 0, policy_version 1372535 (0.0011) [2023-12-26 10:33:07,190][123091] Updated weights for policy 0, policy_version 1372545 (0.0010) [2023-12-26 10:33:07,242][123091] Updated weights for policy 0, policy_version 1372555 (0.0006) [2023-12-26 10:33:07,310][123090] Updated weights for policy 1, policy_version 1362945 (0.0009) [2023-12-26 10:33:07,367][123090] Updated weights for policy 1, policy_version 1362955 (0.0010) [2023-12-26 10:33:07,416][123090] Updated weights for policy 1, policy_version 1362966 (0.0008) [2023-12-26 10:33:07,476][123090] Updated weights for policy 1, policy_version 1362976 (0.0009) [2023-12-26 10:33:08,026][123091] Updated weights for policy 0, policy_version 1372565 (0.0005) [2023-12-26 10:33:08,093][123091] Updated weights for policy 0, policy_version 1372575 (0.0006) [2023-12-26 10:33:08,153][123091] Updated weights for policy 0, policy_version 1372585 (0.0005) [2023-12-26 10:33:08,400][123090] Updated weights for policy 1, policy_version 1362986 (0.0010) [2023-12-26 10:33:08,470][123090] Updated weights for policy 1, policy_version 1362996 (0.0010) [2023-12-26 10:33:08,537][123090] Updated weights for policy 1, policy_version 1363006 (0.0009) [2023-12-26 10:33:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 700317696. Throughput: 0: 8845.6, 1: 8890.9. Samples: 700294576. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:33:08,785][121949] Avg episode reward: [(0, '6430.811'), (1, '5975.626')] [2023-12-26 10:33:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001372592_351387648.pth... [2023-12-26 10:33:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001363008_348930048.pth... [2023-12-26 10:33:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001361952_348659712.pth [2023-12-26 10:33:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001371568_351125504.pth [2023-12-26 10:33:08,927][123091] Updated weights for policy 0, policy_version 1372595 (0.0010) [2023-12-26 10:33:08,996][123091] Updated weights for policy 0, policy_version 1372605 (0.0011) [2023-12-26 10:33:09,059][123091] Updated weights for policy 0, policy_version 1372615 (0.0010) [2023-12-26 10:33:09,448][123090] Updated weights for policy 1, policy_version 1363016 (0.0009) [2023-12-26 10:33:09,520][123090] Updated weights for policy 1, policy_version 1363026 (0.0010) [2023-12-26 10:33:09,590][123090] Updated weights for policy 1, policy_version 1363036 (0.0010) [2023-12-26 10:33:09,817][123091] Updated weights for policy 0, policy_version 1372625 (0.0007) [2023-12-26 10:33:09,889][123091] Updated weights for policy 0, policy_version 1372635 (0.0010) [2023-12-26 10:33:09,964][123091] Updated weights for policy 0, policy_version 1372645 (0.0009) [2023-12-26 10:33:10,036][123091] Updated weights for policy 0, policy_version 1372655 (0.0007) [2023-12-26 10:33:10,497][123090] Updated weights for policy 1, policy_version 1363046 (0.0009) [2023-12-26 10:33:10,559][123090] Updated weights for policy 1, policy_version 1363056 (0.0007) [2023-12-26 10:33:10,617][123090] Updated weights for policy 1, policy_version 1363066 (0.0008) [2023-12-26 10:33:10,700][123091] Updated weights for policy 0, policy_version 1372665 (0.0009) [2023-12-26 10:33:10,757][123091] Updated weights for policy 0, policy_version 1372675 (0.0010) [2023-12-26 10:33:10,814][123091] Updated weights for policy 0, policy_version 1372686 (0.0010) [2023-12-26 10:33:11,366][123090] Updated weights for policy 1, policy_version 1363076 (0.0010) [2023-12-26 10:33:11,439][123090] Updated weights for policy 1, policy_version 1363086 (0.0009) [2023-12-26 10:33:11,504][123090] Updated weights for policy 1, policy_version 1363096 (0.0010) [2023-12-26 10:33:11,706][123091] Updated weights for policy 0, policy_version 1372696 (0.0007) [2023-12-26 10:33:11,776][123091] Updated weights for policy 0, policy_version 1372706 (0.0008) [2023-12-26 10:33:11,830][123091] Updated weights for policy 0, policy_version 1372716 (0.0008) [2023-12-26 10:33:12,309][123090] Updated weights for policy 1, policy_version 1363106 (0.0009) [2023-12-26 10:33:12,391][123090] Updated weights for policy 1, policy_version 1363116 (0.0008) [2023-12-26 10:33:12,469][123090] Updated weights for policy 1, policy_version 1363126 (0.0006) [2023-12-26 10:33:12,523][123090] Updated weights for policy 1, policy_version 1363136 (0.0006) [2023-12-26 10:33:12,617][123091] Updated weights for policy 0, policy_version 1372726 (0.0006) [2023-12-26 10:33:12,679][123091] Updated weights for policy 0, policy_version 1372736 (0.0005) [2023-12-26 10:33:12,743][123091] Updated weights for policy 0, policy_version 1372746 (0.0006) [2023-12-26 10:33:13,244][123090] Updated weights for policy 1, policy_version 1363146 (0.0005) [2023-12-26 10:33:13,300][123090] Updated weights for policy 1, policy_version 1363156 (0.0005) [2023-12-26 10:33:13,356][123090] Updated weights for policy 1, policy_version 1363166 (0.0009) [2023-12-26 10:33:13,441][123091] Updated weights for policy 0, policy_version 1372756 (0.0008) [2023-12-26 10:33:13,512][123091] Updated weights for policy 0, policy_version 1372766 (0.0005) [2023-12-26 10:33:13,569][123091] Updated weights for policy 0, policy_version 1372776 (0.0005) [2023-12-26 10:33:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 700407808. Throughput: 0: 8888.0, 1: 8819.9. Samples: 700398740. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:33:13,785][121949] Avg episode reward: [(0, '6383.939'), (1, '5976.053')] [2023-12-26 10:33:14,082][123090] Updated weights for policy 1, policy_version 1363176 (0.0006) [2023-12-26 10:33:14,141][123090] Updated weights for policy 1, policy_version 1363186 (0.0005) [2023-12-26 10:33:14,163][123091] Updated weights for policy 0, policy_version 1372786 (0.0005) [2023-12-26 10:33:14,196][123090] Updated weights for policy 1, policy_version 1363196 (0.0008) [2023-12-26 10:33:14,212][123091] Updated weights for policy 0, policy_version 1372796 (0.0005) [2023-12-26 10:33:14,273][123091] Updated weights for policy 0, policy_version 1372806 (0.0005) [2023-12-26 10:33:14,327][123091] Updated weights for policy 0, policy_version 1372816 (0.0005) [2023-12-26 10:33:15,009][123090] Updated weights for policy 1, policy_version 1363206 (0.0011) [2023-12-26 10:33:15,060][123091] Updated weights for policy 0, policy_version 1372826 (0.0011) [2023-12-26 10:33:15,070][123090] Updated weights for policy 1, policy_version 1363216 (0.0010) [2023-12-26 10:33:15,125][123091] Updated weights for policy 0, policy_version 1372836 (0.0009) [2023-12-26 10:33:15,127][123090] Updated weights for policy 1, policy_version 1363226 (0.0011) [2023-12-26 10:33:15,192][123091] Updated weights for policy 0, policy_version 1372846 (0.0011) [2023-12-26 10:33:15,922][123091] Updated weights for policy 0, policy_version 1372856 (0.0006) [2023-12-26 10:33:15,963][123090] Updated weights for policy 1, policy_version 1363236 (0.0011) [2023-12-26 10:33:15,970][123091] Updated weights for policy 0, policy_version 1372866 (0.0006) [2023-12-26 10:33:16,021][123091] Updated weights for policy 0, policy_version 1372876 (0.0006) [2023-12-26 10:33:16,022][123090] Updated weights for policy 1, policy_version 1363246 (0.0010) [2023-12-26 10:33:16,088][123090] Updated weights for policy 1, policy_version 1363256 (0.0010) [2023-12-26 10:33:16,727][123091] Updated weights for policy 0, policy_version 1372886 (0.0007) [2023-12-26 10:33:16,792][123091] Updated weights for policy 0, policy_version 1372896 (0.0005) [2023-12-26 10:33:16,837][123090] Updated weights for policy 1, policy_version 1363266 (0.0009) [2023-12-26 10:33:16,862][123091] Updated weights for policy 0, policy_version 1372906 (0.0005) [2023-12-26 10:33:16,897][123090] Updated weights for policy 1, policy_version 1363276 (0.0007) [2023-12-26 10:33:16,963][123090] Updated weights for policy 1, policy_version 1363286 (0.0008) [2023-12-26 10:33:17,030][123090] Updated weights for policy 1, policy_version 1363296 (0.0006) [2023-12-26 10:33:17,572][123091] Updated weights for policy 0, policy_version 1372916 (0.0005) [2023-12-26 10:33:17,620][123091] Updated weights for policy 0, policy_version 1372926 (0.0005) [2023-12-26 10:33:17,645][123090] Updated weights for policy 1, policy_version 1363306 (0.0005) [2023-12-26 10:33:17,665][123091] Updated weights for policy 0, policy_version 1372936 (0.0005) [2023-12-26 10:33:17,692][123090] Updated weights for policy 1, policy_version 1363316 (0.0005) [2023-12-26 10:33:17,742][123090] Updated weights for policy 1, policy_version 1363326 (0.0005) [2023-12-26 10:33:18,332][123091] Updated weights for policy 0, policy_version 1372946 (0.0009) [2023-12-26 10:33:18,397][123091] Updated weights for policy 0, policy_version 1372956 (0.0007) [2023-12-26 10:33:18,400][123090] Updated weights for policy 1, policy_version 1363336 (0.0010) [2023-12-26 10:33:18,461][123090] Updated weights for policy 1, policy_version 1363346 (0.0011) [2023-12-26 10:33:18,465][123091] Updated weights for policy 0, policy_version 1372966 (0.0006) [2023-12-26 10:33:18,529][123090] Updated weights for policy 1, policy_version 1363356 (0.0010) [2023-12-26 10:33:18,534][123091] Updated weights for policy 0, policy_version 1372976 (0.0006) [2023-12-26 10:33:18,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 700506112. Throughput: 0: 8991.0, 1: 8923.2. Samples: 700514420. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:33:18,785][121949] Avg episode reward: [(0, '6369.252'), (1, '5870.685')] [2023-12-26 10:33:19,210][123091] Updated weights for policy 0, policy_version 1372986 (0.0006) [2023-12-26 10:33:19,282][123091] Updated weights for policy 0, policy_version 1372996 (0.0007) [2023-12-26 10:33:19,356][123091] Updated weights for policy 0, policy_version 1373006 (0.0007) [2023-12-26 10:33:19,373][123090] Updated weights for policy 1, policy_version 1363366 (0.0010) [2023-12-26 10:33:19,435][123090] Updated weights for policy 1, policy_version 1363376 (0.0010) [2023-12-26 10:33:19,486][123090] Updated weights for policy 1, policy_version 1363386 (0.0010) [2023-12-26 10:33:20,126][123091] Updated weights for policy 0, policy_version 1373016 (0.0010) [2023-12-26 10:33:20,193][123091] Updated weights for policy 0, policy_version 1373026 (0.0010) [2023-12-26 10:33:20,255][123091] Updated weights for policy 0, policy_version 1373036 (0.0009) [2023-12-26 10:33:20,374][123090] Updated weights for policy 1, policy_version 1363396 (0.0009) [2023-12-26 10:33:20,431][123090] Updated weights for policy 1, policy_version 1363406 (0.0009) [2023-12-26 10:33:20,481][123090] Updated weights for policy 1, policy_version 1363416 (0.0009) [2023-12-26 10:33:21,121][123091] Updated weights for policy 0, policy_version 1373046 (0.0008) [2023-12-26 10:33:21,193][123091] Updated weights for policy 0, policy_version 1373056 (0.0007) [2023-12-26 10:33:21,273][123091] Updated weights for policy 0, policy_version 1373066 (0.0006) [2023-12-26 10:33:21,342][123090] Updated weights for policy 1, policy_version 1363426 (0.0009) [2023-12-26 10:33:21,420][123090] Updated weights for policy 1, policy_version 1363436 (0.0010) [2023-12-26 10:33:21,492][123090] Updated weights for policy 1, policy_version 1363446 (0.0008) [2023-12-26 10:33:21,568][123090] Updated weights for policy 1, policy_version 1363456 (0.0008) [2023-12-26 10:33:22,011][123091] Updated weights for policy 0, policy_version 1373076 (0.0006) [2023-12-26 10:33:22,081][123091] Updated weights for policy 0, policy_version 1373086 (0.0006) [2023-12-26 10:33:22,144][123091] Updated weights for policy 0, policy_version 1373096 (0.0006) [2023-12-26 10:33:22,304][123090] Updated weights for policy 1, policy_version 1363466 (0.0010) [2023-12-26 10:33:22,377][123090] Updated weights for policy 1, policy_version 1363476 (0.0010) [2023-12-26 10:33:22,440][123090] Updated weights for policy 1, policy_version 1363486 (0.0008) [2023-12-26 10:33:22,803][123091] Updated weights for policy 0, policy_version 1373106 (0.0006) [2023-12-26 10:33:22,871][123091] Updated weights for policy 0, policy_version 1373116 (0.0007) [2023-12-26 10:33:22,938][123091] Updated weights for policy 0, policy_version 1373126 (0.0006) [2023-12-26 10:33:23,006][123091] Updated weights for policy 0, policy_version 1373136 (0.0005) [2023-12-26 10:33:23,284][123090] Updated weights for policy 1, policy_version 1363496 (0.0006) [2023-12-26 10:33:23,352][123090] Updated weights for policy 1, policy_version 1363506 (0.0005) [2023-12-26 10:33:23,422][123090] Updated weights for policy 1, policy_version 1363516 (0.0005) [2023-12-26 10:33:23,709][123091] Updated weights for policy 0, policy_version 1373146 (0.0009) [2023-12-26 10:33:23,760][123091] Updated weights for policy 0, policy_version 1373157 (0.0010) [2023-12-26 10:33:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 700588032. Throughput: 0: 8987.1, 1: 8910.8. Samples: 700565976. Policy #0 lag: (min: 23.0, avg: 30.3, max: 55.0) [2023-12-26 10:33:23,786][121949] Avg episode reward: [(0, '6351.125'), (1, '5787.707')] [2023-12-26 10:33:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001363520_349061120.pth... [2023-12-26 10:33:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001362464_348790784.pth [2023-12-26 10:33:23,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001373168_351535104.pth... [2023-12-26 10:33:23,817][123091] Updated weights for policy 0, policy_version 1373168 (0.0010) [2023-12-26 10:33:23,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001372080_351256576.pth [2023-12-26 10:33:24,102][123090] Updated weights for policy 1, policy_version 1363526 (0.0005) [2023-12-26 10:33:24,157][123090] Updated weights for policy 1, policy_version 1363536 (0.0006) [2023-12-26 10:33:24,213][123090] Updated weights for policy 1, policy_version 1363546 (0.0005) [2023-12-26 10:33:24,639][123091] Updated weights for policy 0, policy_version 1373178 (0.0005) [2023-12-26 10:33:24,693][123091] Updated weights for policy 0, policy_version 1373188 (0.0006) [2023-12-26 10:33:24,762][123091] Updated weights for policy 0, policy_version 1373198 (0.0007) [2023-12-26 10:33:24,943][123090] Updated weights for policy 1, policy_version 1363556 (0.0006) [2023-12-26 10:33:25,008][123090] Updated weights for policy 1, policy_version 1363566 (0.0011) [2023-12-26 10:33:25,071][123090] Updated weights for policy 1, policy_version 1363576 (0.0011) [2023-12-26 10:33:25,451][123091] Updated weights for policy 0, policy_version 1373208 (0.0006) [2023-12-26 10:33:25,498][123091] Updated weights for policy 0, policy_version 1373218 (0.0005) [2023-12-26 10:33:25,550][123091] Updated weights for policy 0, policy_version 1373228 (0.0005) [2023-12-26 10:33:25,882][123090] Updated weights for policy 1, policy_version 1363586 (0.0011) [2023-12-26 10:33:25,933][123090] Updated weights for policy 1, policy_version 1363596 (0.0010) [2023-12-26 10:33:26,002][123090] Updated weights for policy 1, policy_version 1363606 (0.0011) [2023-12-26 10:33:26,074][123090] Updated weights for policy 1, policy_version 1363616 (0.0011) [2023-12-26 10:33:26,234][123091] Updated weights for policy 0, policy_version 1373238 (0.0005) [2023-12-26 10:33:26,294][123091] Updated weights for policy 0, policy_version 1373248 (0.0005) [2023-12-26 10:33:26,355][123091] Updated weights for policy 0, policy_version 1373258 (0.0005) [2023-12-26 10:33:26,891][123090] Updated weights for policy 1, policy_version 1363626 (0.0010) [2023-12-26 10:33:26,938][123090] Updated weights for policy 1, policy_version 1363636 (0.0010) [2023-12-26 10:33:26,994][123090] Updated weights for policy 1, policy_version 1363646 (0.0010) [2023-12-26 10:33:27,142][123091] Updated weights for policy 0, policy_version 1373268 (0.0010) [2023-12-26 10:33:27,189][123091] Updated weights for policy 0, policy_version 1373278 (0.0010) [2023-12-26 10:33:27,244][123091] Updated weights for policy 0, policy_version 1373288 (0.0006) [2023-12-26 10:33:27,798][123090] Updated weights for policy 1, policy_version 1363656 (0.0009) [2023-12-26 10:33:27,845][123090] Updated weights for policy 1, policy_version 1363666 (0.0008) [2023-12-26 10:33:27,890][123090] Updated weights for policy 1, policy_version 1363676 (0.0007) [2023-12-26 10:33:28,034][123091] Updated weights for policy 0, policy_version 1373298 (0.0006) [2023-12-26 10:33:28,092][123091] Updated weights for policy 0, policy_version 1373308 (0.0010) [2023-12-26 10:33:28,143][123091] Updated weights for policy 0, policy_version 1373318 (0.0010) [2023-12-26 10:33:28,189][123091] Updated weights for policy 0, policy_version 1373328 (0.0010) [2023-12-26 10:33:28,633][123090] Updated weights for policy 1, policy_version 1363686 (0.0005) [2023-12-26 10:33:28,702][123090] Updated weights for policy 1, policy_version 1363696 (0.0009) [2023-12-26 10:33:28,772][123090] Updated weights for policy 1, policy_version 1363706 (0.0011) [2023-12-26 10:33:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 700678144. Throughput: 0: 9116.8, 1: 9002.5. Samples: 700677584. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:28,785][121949] Avg episode reward: [(0, '6322.959'), (1, '5886.658')] [2023-12-26 10:33:29,048][123091] Updated weights for policy 0, policy_version 1373338 (0.0005) [2023-12-26 10:33:29,114][123091] Updated weights for policy 0, policy_version 1373348 (0.0005) [2023-12-26 10:33:29,175][123091] Updated weights for policy 0, policy_version 1373358 (0.0005) [2023-12-26 10:33:29,457][123090] Updated weights for policy 1, policy_version 1363716 (0.0011) [2023-12-26 10:33:29,512][123090] Updated weights for policy 1, policy_version 1363726 (0.0010) [2023-12-26 10:33:29,564][123090] Updated weights for policy 1, policy_version 1363736 (0.0008) [2023-12-26 10:33:29,910][123091] Updated weights for policy 0, policy_version 1373368 (0.0011) [2023-12-26 10:33:29,981][123091] Updated weights for policy 0, policy_version 1373378 (0.0011) [2023-12-26 10:33:30,047][123091] Updated weights for policy 0, policy_version 1373388 (0.0008) [2023-12-26 10:33:30,258][123090] Updated weights for policy 1, policy_version 1363746 (0.0005) [2023-12-26 10:33:30,329][123090] Updated weights for policy 1, policy_version 1363756 (0.0005) [2023-12-26 10:33:30,398][123090] Updated weights for policy 1, policy_version 1363766 (0.0007) [2023-12-26 10:33:30,462][123090] Updated weights for policy 1, policy_version 1363776 (0.0008) [2023-12-26 10:33:30,819][123091] Updated weights for policy 0, policy_version 1373398 (0.0008) [2023-12-26 10:33:30,867][123091] Updated weights for policy 0, policy_version 1373408 (0.0011) [2023-12-26 10:33:30,917][123091] Updated weights for policy 0, policy_version 1373418 (0.0010) [2023-12-26 10:33:31,257][123090] Updated weights for policy 1, policy_version 1363786 (0.0007) [2023-12-26 10:33:31,319][123090] Updated weights for policy 1, policy_version 1363796 (0.0006) [2023-12-26 10:33:31,395][123090] Updated weights for policy 1, policy_version 1363806 (0.0010) [2023-12-26 10:33:31,756][123091] Updated weights for policy 0, policy_version 1373428 (0.0009) [2023-12-26 10:33:31,820][123091] Updated weights for policy 0, policy_version 1373438 (0.0007) [2023-12-26 10:33:31,873][123091] Updated weights for policy 0, policy_version 1373448 (0.0009) [2023-12-26 10:33:32,176][123090] Updated weights for policy 1, policy_version 1363816 (0.0010) [2023-12-26 10:33:32,239][123090] Updated weights for policy 1, policy_version 1363826 (0.0011) [2023-12-26 10:33:32,297][123090] Updated weights for policy 1, policy_version 1363836 (0.0006) [2023-12-26 10:33:32,692][123091] Updated weights for policy 0, policy_version 1373458 (0.0009) [2023-12-26 10:33:32,749][123091] Updated weights for policy 0, policy_version 1373468 (0.0006) [2023-12-26 10:33:32,803][123091] Updated weights for policy 0, policy_version 1373478 (0.0005) [2023-12-26 10:33:32,863][123091] Updated weights for policy 0, policy_version 1373488 (0.0005) [2023-12-26 10:33:33,050][123090] Updated weights for policy 1, policy_version 1363846 (0.0008) [2023-12-26 10:33:33,096][123090] Updated weights for policy 1, policy_version 1363856 (0.0010) [2023-12-26 10:33:33,143][123090] Updated weights for policy 1, policy_version 1363866 (0.0010) [2023-12-26 10:33:33,504][123091] Updated weights for policy 0, policy_version 1373498 (0.0009) [2023-12-26 10:33:33,553][123091] Updated weights for policy 0, policy_version 1373508 (0.0005) [2023-12-26 10:33:33,600][123091] Updated weights for policy 0, policy_version 1373518 (0.0005) [2023-12-26 10:33:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 700776448. Throughput: 0: 9157.4, 1: 9035.2. Samples: 700787096. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:33,785][121949] Avg episode reward: [(0, '6330.012'), (1, '5837.061')] [2023-12-26 10:33:33,881][123090] Updated weights for policy 1, policy_version 1363876 (0.0010) [2023-12-26 10:33:33,933][123090] Updated weights for policy 1, policy_version 1363886 (0.0010) [2023-12-26 10:33:33,981][123090] Updated weights for policy 1, policy_version 1363896 (0.0010) [2023-12-26 10:33:34,244][123091] Updated weights for policy 0, policy_version 1373528 (0.0009) [2023-12-26 10:33:34,306][123091] Updated weights for policy 0, policy_version 1373538 (0.0009) [2023-12-26 10:33:34,371][123091] Updated weights for policy 0, policy_version 1373548 (0.0007) [2023-12-26 10:33:34,837][123090] Updated weights for policy 1, policy_version 1363906 (0.0010) [2023-12-26 10:33:34,900][123090] Updated weights for policy 1, policy_version 1363916 (0.0010) [2023-12-26 10:33:34,954][123090] Updated weights for policy 1, policy_version 1363926 (0.0010) [2023-12-26 10:33:35,013][123090] Updated weights for policy 1, policy_version 1363936 (0.0010) [2023-12-26 10:33:35,187][123091] Updated weights for policy 0, policy_version 1373558 (0.0007) [2023-12-26 10:33:35,236][123091] Updated weights for policy 0, policy_version 1373568 (0.0007) [2023-12-26 10:33:35,286][123091] Updated weights for policy 0, policy_version 1373578 (0.0005) [2023-12-26 10:33:35,812][123090] Updated weights for policy 1, policy_version 1363946 (0.0005) [2023-12-26 10:33:35,874][123090] Updated weights for policy 1, policy_version 1363956 (0.0005) [2023-12-26 10:33:35,938][123090] Updated weights for policy 1, policy_version 1363966 (0.0008) [2023-12-26 10:33:36,082][123091] Updated weights for policy 0, policy_version 1373588 (0.0007) [2023-12-26 10:33:36,157][123091] Updated weights for policy 0, policy_version 1373598 (0.0011) [2023-12-26 10:33:36,229][123091] Updated weights for policy 0, policy_version 1373608 (0.0011) [2023-12-26 10:33:36,740][123090] Updated weights for policy 1, policy_version 1363976 (0.0009) [2023-12-26 10:33:36,808][123090] Updated weights for policy 1, policy_version 1363986 (0.0009) [2023-12-26 10:33:36,859][123090] Updated weights for policy 1, policy_version 1363996 (0.0009) [2023-12-26 10:33:37,036][123091] Updated weights for policy 0, policy_version 1373618 (0.0010) [2023-12-26 10:33:37,089][123091] Updated weights for policy 0, policy_version 1373628 (0.0006) [2023-12-26 10:33:37,141][123091] Updated weights for policy 0, policy_version 1373638 (0.0009) [2023-12-26 10:33:37,202][123091] Updated weights for policy 0, policy_version 1373648 (0.0010) [2023-12-26 10:33:37,652][123090] Updated weights for policy 1, policy_version 1364006 (0.0007) [2023-12-26 10:33:37,711][123090] Updated weights for policy 1, policy_version 1364016 (0.0006) [2023-12-26 10:33:37,758][123090] Updated weights for policy 1, policy_version 1364026 (0.0005) [2023-12-26 10:33:37,904][123091] Updated weights for policy 0, policy_version 1373658 (0.0006) [2023-12-26 10:33:37,956][123091] Updated weights for policy 0, policy_version 1373668 (0.0006) [2023-12-26 10:33:38,019][123091] Updated weights for policy 0, policy_version 1373678 (0.0005) [2023-12-26 10:33:38,568][123090] Updated weights for policy 1, policy_version 1364036 (0.0005) [2023-12-26 10:33:38,635][123090] Updated weights for policy 1, policy_version 1364046 (0.0006) [2023-12-26 10:33:38,695][123090] Updated weights for policy 1, policy_version 1364056 (0.0009) [2023-12-26 10:33:38,751][123091] Updated weights for policy 0, policy_version 1373688 (0.0010) [2023-12-26 10:33:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 700866560. Throughput: 0: 9185.9, 1: 9060.3. Samples: 700841092. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:38,785][121949] Avg episode reward: [(0, '6252.032'), (1, '5835.992')] [2023-12-26 10:33:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001364064_349200384.pth... [2023-12-26 10:33:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001363008_348930048.pth [2023-12-26 10:33:38,805][123091] Updated weights for policy 0, policy_version 1373698 (0.0009) [2023-12-26 10:33:38,860][123091] Updated weights for policy 0, policy_version 1373708 (0.0005) [2023-12-26 10:33:38,879][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001373712_351674368.pth... [2023-12-26 10:33:38,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001372592_351387648.pth [2023-12-26 10:33:39,419][123090] Updated weights for policy 1, policy_version 1364066 (0.0007) [2023-12-26 10:33:39,484][123090] Updated weights for policy 1, policy_version 1364076 (0.0009) [2023-12-26 10:33:39,558][123090] Updated weights for policy 1, policy_version 1364086 (0.0009) [2023-12-26 10:33:39,635][123090] Updated weights for policy 1, policy_version 1364096 (0.0010) [2023-12-26 10:33:39,635][123091] Updated weights for policy 0, policy_version 1373718 (0.0007) [2023-12-26 10:33:39,700][123091] Updated weights for policy 0, policy_version 1373728 (0.0008) [2023-12-26 10:33:39,770][123091] Updated weights for policy 0, policy_version 1373738 (0.0006) [2023-12-26 10:33:40,398][123090] Updated weights for policy 1, policy_version 1364106 (0.0010) [2023-12-26 10:33:40,468][123090] Updated weights for policy 1, policy_version 1364116 (0.0009) [2023-12-26 10:33:40,521][123090] Updated weights for policy 1, policy_version 1364126 (0.0009) [2023-12-26 10:33:40,576][123091] Updated weights for policy 0, policy_version 1373748 (0.0009) [2023-12-26 10:33:40,635][123091] Updated weights for policy 0, policy_version 1373758 (0.0009) [2023-12-26 10:33:40,704][123091] Updated weights for policy 0, policy_version 1373768 (0.0009) [2023-12-26 10:33:41,300][123090] Updated weights for policy 1, policy_version 1364136 (0.0010) [2023-12-26 10:33:41,360][123090] Updated weights for policy 1, policy_version 1364146 (0.0010) [2023-12-26 10:33:41,430][123090] Updated weights for policy 1, policy_version 1364156 (0.0008) [2023-12-26 10:33:41,606][123091] Updated weights for policy 0, policy_version 1373778 (0.0010) [2023-12-26 10:33:41,675][123091] Updated weights for policy 0, policy_version 1373788 (0.0009) [2023-12-26 10:33:41,745][123091] Updated weights for policy 0, policy_version 1373798 (0.0010) [2023-12-26 10:33:41,807][123091] Updated weights for policy 0, policy_version 1373808 (0.0009) [2023-12-26 10:33:42,251][123090] Updated weights for policy 1, policy_version 1364166 (0.0008) [2023-12-26 10:33:42,322][123090] Updated weights for policy 1, policy_version 1364176 (0.0007) [2023-12-26 10:33:42,393][123090] Updated weights for policy 1, policy_version 1364186 (0.0008) [2023-12-26 10:33:42,690][123091] Updated weights for policy 0, policy_version 1373818 (0.0010) [2023-12-26 10:33:42,757][123091] Updated weights for policy 0, policy_version 1373828 (0.0011) [2023-12-26 10:33:42,828][123091] Updated weights for policy 0, policy_version 1373838 (0.0010) [2023-12-26 10:33:43,102][123090] Updated weights for policy 1, policy_version 1364196 (0.0007) [2023-12-26 10:33:43,149][123090] Updated weights for policy 1, policy_version 1364206 (0.0005) [2023-12-26 10:33:43,202][123090] Updated weights for policy 1, policy_version 1364216 (0.0005) [2023-12-26 10:33:43,543][123091] Updated weights for policy 0, policy_version 1373848 (0.0007) [2023-12-26 10:33:43,599][123091] Updated weights for policy 0, policy_version 1373858 (0.0008) [2023-12-26 10:33:43,658][123091] Updated weights for policy 0, policy_version 1373868 (0.0006) [2023-12-26 10:33:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 700956672. Throughput: 0: 9137.3, 1: 8968.4. Samples: 700947972. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:43,785][121949] Avg episode reward: [(0, '6244.101'), (1, '5870.636')] [2023-12-26 10:33:43,886][123090] Updated weights for policy 1, policy_version 1364226 (0.0006) [2023-12-26 10:33:43,957][123090] Updated weights for policy 1, policy_version 1364236 (0.0007) [2023-12-26 10:33:44,020][123090] Updated weights for policy 1, policy_version 1364246 (0.0010) [2023-12-26 10:33:44,087][123090] Updated weights for policy 1, policy_version 1364256 (0.0011) [2023-12-26 10:33:44,470][123091] Updated weights for policy 0, policy_version 1373878 (0.0009) [2023-12-26 10:33:44,528][123091] Updated weights for policy 0, policy_version 1373888 (0.0009) [2023-12-26 10:33:44,588][123091] Updated weights for policy 0, policy_version 1373898 (0.0010) [2023-12-26 10:33:44,826][123090] Updated weights for policy 1, policy_version 1364266 (0.0011) [2023-12-26 10:33:44,872][123090] Updated weights for policy 1, policy_version 1364276 (0.0009) [2023-12-26 10:33:44,924][123090] Updated weights for policy 1, policy_version 1364286 (0.0005) [2023-12-26 10:33:45,504][123091] Updated weights for policy 0, policy_version 1373908 (0.0009) [2023-12-26 10:33:45,570][123091] Updated weights for policy 0, policy_version 1373918 (0.0009) [2023-12-26 10:33:45,640][123091] Updated weights for policy 0, policy_version 1373928 (0.0010) [2023-12-26 10:33:45,643][123090] Updated weights for policy 1, policy_version 1364296 (0.0005) [2023-12-26 10:33:45,696][123090] Updated weights for policy 1, policy_version 1364306 (0.0005) [2023-12-26 10:33:45,758][123090] Updated weights for policy 1, policy_version 1364316 (0.0006) [2023-12-26 10:33:46,495][123090] Updated weights for policy 1, policy_version 1364326 (0.0008) [2023-12-26 10:33:46,504][123091] Updated weights for policy 0, policy_version 1373938 (0.0009) [2023-12-26 10:33:46,549][123090] Updated weights for policy 1, policy_version 1364336 (0.0008) [2023-12-26 10:33:46,570][123091] Updated weights for policy 0, policy_version 1373948 (0.0009) [2023-12-26 10:33:46,618][123090] Updated weights for policy 1, policy_version 1364346 (0.0008) [2023-12-26 10:33:46,630][123091] Updated weights for policy 0, policy_version 1373958 (0.0009) [2023-12-26 10:33:46,684][123091] Updated weights for policy 0, policy_version 1373968 (0.0008) [2023-12-26 10:33:47,381][123090] Updated weights for policy 1, policy_version 1364356 (0.0008) [2023-12-26 10:33:47,396][123091] Updated weights for policy 0, policy_version 1373978 (0.0005) [2023-12-26 10:33:47,429][123090] Updated weights for policy 1, policy_version 1364366 (0.0006) [2023-12-26 10:33:47,471][123091] Updated weights for policy 0, policy_version 1373988 (0.0007) [2023-12-26 10:33:47,489][123090] Updated weights for policy 1, policy_version 1364376 (0.0006) [2023-12-26 10:33:47,520][123091] Updated weights for policy 0, policy_version 1373998 (0.0005) [2023-12-26 10:33:48,137][123090] Updated weights for policy 1, policy_version 1364386 (0.0009) [2023-12-26 10:33:48,190][123090] Updated weights for policy 1, policy_version 1364396 (0.0005) [2023-12-26 10:33:48,220][123091] Updated weights for policy 0, policy_version 1374008 (0.0005) [2023-12-26 10:33:48,244][123090] Updated weights for policy 1, policy_version 1364406 (0.0009) [2023-12-26 10:33:48,280][123091] Updated weights for policy 0, policy_version 1374018 (0.0005) [2023-12-26 10:33:48,296][123090] Updated weights for policy 1, policy_version 1364416 (0.0010) [2023-12-26 10:33:48,342][123091] Updated weights for policy 0, policy_version 1374028 (0.0006) [2023-12-26 10:33:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 701046784. Throughput: 0: 9189.8, 1: 8999.2. Samples: 701060028. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:48,785][121949] Avg episode reward: [(0, '6222.165'), (1, '5802.212')] [2023-12-26 10:33:49,006][123090] Updated weights for policy 1, policy_version 1364426 (0.0007) [2023-12-26 10:33:49,076][123090] Updated weights for policy 1, policy_version 1364436 (0.0008) [2023-12-26 10:33:49,102][123091] Updated weights for policy 0, policy_version 1374038 (0.0007) [2023-12-26 10:33:49,146][123090] Updated weights for policy 1, policy_version 1364446 (0.0011) [2023-12-26 10:33:49,154][123091] Updated weights for policy 0, policy_version 1374048 (0.0008) [2023-12-26 10:33:49,209][123091] Updated weights for policy 0, policy_version 1374058 (0.0008) [2023-12-26 10:33:49,919][123090] Updated weights for policy 1, policy_version 1364456 (0.0011) [2023-12-26 10:33:49,975][123090] Updated weights for policy 1, policy_version 1364466 (0.0010) [2023-12-26 10:33:50,024][123090] Updated weights for policy 1, policy_version 1364476 (0.0010) [2023-12-26 10:33:50,032][123091] Updated weights for policy 0, policy_version 1374068 (0.0010) [2023-12-26 10:33:50,097][123091] Updated weights for policy 0, policy_version 1374078 (0.0010) [2023-12-26 10:33:50,169][123091] Updated weights for policy 0, policy_version 1374088 (0.0011) [2023-12-26 10:33:50,856][123090] Updated weights for policy 1, policy_version 1364486 (0.0007) [2023-12-26 10:33:50,897][123091] Updated weights for policy 0, policy_version 1374098 (0.0011) [2023-12-26 10:33:50,923][123090] Updated weights for policy 1, policy_version 1364496 (0.0010) [2023-12-26 10:33:50,968][123091] Updated weights for policy 0, policy_version 1374108 (0.0008) [2023-12-26 10:33:51,004][123090] Updated weights for policy 1, policy_version 1364506 (0.0011) [2023-12-26 10:33:51,051][123091] Updated weights for policy 0, policy_version 1374118 (0.0007) [2023-12-26 10:33:51,133][123091] Updated weights for policy 0, policy_version 1374128 (0.0006) [2023-12-26 10:33:51,795][123090] Updated weights for policy 1, policy_version 1364516 (0.0008) [2023-12-26 10:33:51,860][123090] Updated weights for policy 1, policy_version 1364526 (0.0008) [2023-12-26 10:33:51,874][123091] Updated weights for policy 0, policy_version 1374138 (0.0008) [2023-12-26 10:33:51,926][123090] Updated weights for policy 1, policy_version 1364536 (0.0007) [2023-12-26 10:33:51,935][123091] Updated weights for policy 0, policy_version 1374148 (0.0008) [2023-12-26 10:33:51,998][123091] Updated weights for policy 0, policy_version 1374158 (0.0008) [2023-12-26 10:33:52,703][123091] Updated weights for policy 0, policy_version 1374168 (0.0010) [2023-12-26 10:33:52,753][123091] Updated weights for policy 0, policy_version 1374178 (0.0009) [2023-12-26 10:33:52,784][123090] Updated weights for policy 1, policy_version 1364546 (0.0007) [2023-12-26 10:33:52,809][123091] Updated weights for policy 0, policy_version 1374188 (0.0008) [2023-12-26 10:33:52,846][123090] Updated weights for policy 1, policy_version 1364556 (0.0010) [2023-12-26 10:33:52,903][123090] Updated weights for policy 1, policy_version 1364566 (0.0009) [2023-12-26 10:33:52,964][123090] Updated weights for policy 1, policy_version 1364576 (0.0009) [2023-12-26 10:33:53,661][123091] Updated weights for policy 0, policy_version 1374198 (0.0008) [2023-12-26 10:33:53,726][123091] Updated weights for policy 0, policy_version 1374208 (0.0009) [2023-12-26 10:33:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 701128704. Throughput: 0: 9193.0, 1: 9023.8. Samples: 701114336. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:53,785][121949] Avg episode reward: [(0, '6329.907'), (1, '5763.922')] [2023-12-26 10:33:53,789][123091] Updated weights for policy 0, policy_version 1374218 (0.0010) [2023-12-26 10:33:53,813][123090] Updated weights for policy 1, policy_version 1364586 (0.0008) [2023-12-26 10:33:53,821][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001374224_351805440.pth... [2023-12-26 10:33:53,824][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001373168_351535104.pth [2023-12-26 10:33:53,825][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001374224_351805440.pth [2023-12-26 10:33:53,875][123090] Updated weights for policy 1, policy_version 1364596 (0.0009) [2023-12-26 10:33:53,936][123090] Updated weights for policy 1, policy_version 1364606 (0.0008) [2023-12-26 10:33:53,945][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001364608_349339648.pth... [2023-12-26 10:33:53,950][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001363520_349061120.pth [2023-12-26 10:33:53,950][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001364608_349339648.pth [2023-12-26 10:33:54,561][123091] Updated weights for policy 0, policy_version 1374228 (0.0009) [2023-12-26 10:33:54,621][123091] Updated weights for policy 0, policy_version 1374238 (0.0011) [2023-12-26 10:33:54,675][123091] Updated weights for policy 0, policy_version 1374248 (0.0010) [2023-12-26 10:33:54,775][123090] Updated weights for policy 1, policy_version 1364616 (0.0010) [2023-12-26 10:33:54,826][123090] Updated weights for policy 1, policy_version 1364626 (0.0009) [2023-12-26 10:33:54,877][123090] Updated weights for policy 1, policy_version 1364636 (0.0010) [2023-12-26 10:33:55,483][123091] Updated weights for policy 0, policy_version 1374258 (0.0010) [2023-12-26 10:33:55,533][123091] Updated weights for policy 0, policy_version 1374268 (0.0009) [2023-12-26 10:33:55,583][123091] Updated weights for policy 0, policy_version 1374278 (0.0009) [2023-12-26 10:33:55,644][123091] Updated weights for policy 0, policy_version 1374288 (0.0010) [2023-12-26 10:33:55,758][123090] Updated weights for policy 1, policy_version 1364646 (0.0011) [2023-12-26 10:33:55,813][123090] Updated weights for policy 1, policy_version 1364657 (0.0010) [2023-12-26 10:33:55,866][123090] Updated weights for policy 1, policy_version 1364667 (0.0010) [2023-12-26 10:33:56,379][123091] Updated weights for policy 0, policy_version 1374298 (0.0005) [2023-12-26 10:33:56,446][123091] Updated weights for policy 0, policy_version 1374308 (0.0006) [2023-12-26 10:33:56,494][123091] Updated weights for policy 0, policy_version 1374318 (0.0005) [2023-12-26 10:33:56,809][123090] Updated weights for policy 1, policy_version 1364677 (0.0010) [2023-12-26 10:33:56,862][123090] Updated weights for policy 1, policy_version 1364687 (0.0009) [2023-12-26 10:33:56,921][123090] Updated weights for policy 1, policy_version 1364697 (0.0009) [2023-12-26 10:33:57,223][123091] Updated weights for policy 0, policy_version 1374328 (0.0009) [2023-12-26 10:33:57,270][123091] Updated weights for policy 0, policy_version 1374338 (0.0010) [2023-12-26 10:33:57,325][123091] Updated weights for policy 0, policy_version 1374348 (0.0011) [2023-12-26 10:33:57,681][123090] Updated weights for policy 1, policy_version 1364707 (0.0007) [2023-12-26 10:33:57,728][123090] Updated weights for policy 1, policy_version 1364717 (0.0005) [2023-12-26 10:33:57,776][123090] Updated weights for policy 1, policy_version 1364727 (0.0005) [2023-12-26 10:33:58,142][123091] Updated weights for policy 0, policy_version 1374358 (0.0011) [2023-12-26 10:33:58,205][123091] Updated weights for policy 0, policy_version 1374368 (0.0010) [2023-12-26 10:33:58,272][123091] Updated weights for policy 0, policy_version 1374378 (0.0010) [2023-12-26 10:33:58,574][123090] Updated weights for policy 1, policy_version 1364737 (0.0005) [2023-12-26 10:33:58,645][123090] Updated weights for policy 1, policy_version 1364747 (0.0008) [2023-12-26 10:33:58,715][123090] Updated weights for policy 1, policy_version 1364757 (0.0009) [2023-12-26 10:33:58,781][123090] Updated weights for policy 1, policy_version 1364767 (0.0009) [2023-12-26 10:33:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 701218816. Throughput: 0: 9178.6, 1: 9029.1. Samples: 701218076. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:33:58,784][121949] Avg episode reward: [(0, '6414.314'), (1, '5768.230')] [2023-12-26 10:33:59,139][123091] Updated weights for policy 0, policy_version 1374388 (0.0011) [2023-12-26 10:33:59,201][123091] Updated weights for policy 0, policy_version 1374398 (0.0010) [2023-12-26 10:33:59,279][123091] Updated weights for policy 0, policy_version 1374408 (0.0010) [2023-12-26 10:33:59,529][123090] Updated weights for policy 1, policy_version 1364777 (0.0009) [2023-12-26 10:33:59,587][123090] Updated weights for policy 1, policy_version 1364787 (0.0009) [2023-12-26 10:33:59,647][123090] Updated weights for policy 1, policy_version 1364797 (0.0009) [2023-12-26 10:34:00,107][123091] Updated weights for policy 0, policy_version 1374418 (0.0011) [2023-12-26 10:34:00,165][123091] Updated weights for policy 0, policy_version 1374428 (0.0011) [2023-12-26 10:34:00,215][123091] Updated weights for policy 0, policy_version 1374438 (0.0010) [2023-12-26 10:34:00,262][123091] Updated weights for policy 0, policy_version 1374448 (0.0010) [2023-12-26 10:34:00,510][123090] Updated weights for policy 1, policy_version 1364807 (0.0009) [2023-12-26 10:34:00,584][123090] Updated weights for policy 1, policy_version 1364817 (0.0010) [2023-12-26 10:34:00,656][123090] Updated weights for policy 1, policy_version 1364827 (0.0008) [2023-12-26 10:34:01,065][123091] Updated weights for policy 0, policy_version 1374458 (0.0010) [2023-12-26 10:34:01,125][123091] Updated weights for policy 0, policy_version 1374468 (0.0011) [2023-12-26 10:34:01,194][123091] Updated weights for policy 0, policy_version 1374478 (0.0009) [2023-12-26 10:34:01,491][123090] Updated weights for policy 1, policy_version 1364837 (0.0007) [2023-12-26 10:34:01,569][123090] Updated weights for policy 1, policy_version 1364847 (0.0005) [2023-12-26 10:34:01,641][123090] Updated weights for policy 1, policy_version 1364857 (0.0009) [2023-12-26 10:34:01,913][123091] Updated weights for policy 0, policy_version 1374488 (0.0008) [2023-12-26 10:34:01,970][123091] Updated weights for policy 0, policy_version 1374498 (0.0010) [2023-12-26 10:34:02,028][123091] Updated weights for policy 0, policy_version 1374508 (0.0008) [2023-12-26 10:34:02,430][123090] Updated weights for policy 1, policy_version 1364867 (0.0008) [2023-12-26 10:34:02,491][123090] Updated weights for policy 1, policy_version 1364877 (0.0010) [2023-12-26 10:34:02,550][123090] Updated weights for policy 1, policy_version 1364887 (0.0008) [2023-12-26 10:34:02,864][123091] Updated weights for policy 0, policy_version 1374518 (0.0009) [2023-12-26 10:34:02,944][123091] Updated weights for policy 0, policy_version 1374528 (0.0009) [2023-12-26 10:34:03,005][123091] Updated weights for policy 0, policy_version 1374538 (0.0010) [2023-12-26 10:34:03,332][123090] Updated weights for policy 1, policy_version 1364897 (0.0009) [2023-12-26 10:34:03,376][123090] Updated weights for policy 1, policy_version 1364907 (0.0005) [2023-12-26 10:34:03,430][123090] Updated weights for policy 1, policy_version 1364917 (0.0005) [2023-12-26 10:34:03,498][123090] Updated weights for policy 1, policy_version 1364927 (0.0005) [2023-12-26 10:34:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 701308928. Throughput: 0: 9018.2, 1: 8952.7. Samples: 701323112. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:03,785][121949] Avg episode reward: [(0, '6369.700'), (1, '5823.652')] [2023-12-26 10:34:03,862][123091] Updated weights for policy 0, policy_version 1374548 (0.0010) [2023-12-26 10:34:03,918][123091] Updated weights for policy 0, policy_version 1374558 (0.0009) [2023-12-26 10:34:03,981][123091] Updated weights for policy 0, policy_version 1374569 (0.0010) [2023-12-26 10:34:04,139][123090] Updated weights for policy 1, policy_version 1364937 (0.0009) [2023-12-26 10:34:04,204][123090] Updated weights for policy 1, policy_version 1364947 (0.0008) [2023-12-26 10:34:04,270][123090] Updated weights for policy 1, policy_version 1364957 (0.0010) [2023-12-26 10:34:04,828][123091] Updated weights for policy 0, policy_version 1374579 (0.0010) [2023-12-26 10:34:04,876][123091] Updated weights for policy 0, policy_version 1374589 (0.0009) [2023-12-26 10:34:04,928][123091] Updated weights for policy 0, policy_version 1374599 (0.0009) [2023-12-26 10:34:05,066][123090] Updated weights for policy 1, policy_version 1364967 (0.0009) [2023-12-26 10:34:05,130][123090] Updated weights for policy 1, policy_version 1364977 (0.0010) [2023-12-26 10:34:05,186][123090] Updated weights for policy 1, policy_version 1364987 (0.0010) [2023-12-26 10:34:05,793][123091] Updated weights for policy 0, policy_version 1374609 (0.0010) [2023-12-26 10:34:05,844][123091] Updated weights for policy 0, policy_version 1374619 (0.0010) [2023-12-26 10:34:05,892][123091] Updated weights for policy 0, policy_version 1374629 (0.0008) [2023-12-26 10:34:05,953][123091] Updated weights for policy 0, policy_version 1374639 (0.0009) [2023-12-26 10:34:06,046][123090] Updated weights for policy 1, policy_version 1364997 (0.0009) [2023-12-26 10:34:06,109][123090] Updated weights for policy 1, policy_version 1365007 (0.0009) [2023-12-26 10:34:06,168][123090] Updated weights for policy 1, policy_version 1365017 (0.0009) [2023-12-26 10:34:06,804][123091] Updated weights for policy 0, policy_version 1374649 (0.0011) [2023-12-26 10:34:06,859][123091] Updated weights for policy 0, policy_version 1374659 (0.0010) [2023-12-26 10:34:06,921][123091] Updated weights for policy 0, policy_version 1374669 (0.0011) [2023-12-26 10:34:07,011][123090] Updated weights for policy 1, policy_version 1365027 (0.0008) [2023-12-26 10:34:07,080][123090] Updated weights for policy 1, policy_version 1365037 (0.0005) [2023-12-26 10:34:07,147][123090] Updated weights for policy 1, policy_version 1365047 (0.0005) [2023-12-26 10:34:07,744][123091] Updated weights for policy 0, policy_version 1374679 (0.0011) [2023-12-26 10:34:07,796][123091] Updated weights for policy 0, policy_version 1374689 (0.0010) [2023-12-26 10:34:07,828][123090] Updated weights for policy 1, policy_version 1365057 (0.0005) [2023-12-26 10:34:07,860][123091] Updated weights for policy 0, policy_version 1374699 (0.0011) [2023-12-26 10:34:07,887][123090] Updated weights for policy 1, policy_version 1365067 (0.0007) [2023-12-26 10:34:07,934][123090] Updated weights for policy 1, policy_version 1365077 (0.0010) [2023-12-26 10:34:07,990][123090] Updated weights for policy 1, policy_version 1365087 (0.0010) [2023-12-26 10:34:08,637][123091] Updated weights for policy 0, policy_version 1374709 (0.0010) [2023-12-26 10:34:08,700][123091] Updated weights for policy 0, policy_version 1374719 (0.0011) [2023-12-26 10:34:08,753][123091] Updated weights for policy 0, policy_version 1374729 (0.0005) [2023-12-26 10:34:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 701390848. Throughput: 0: 8980.6, 1: 8967.0. Samples: 701373612. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:08,785][121949] Avg episode reward: [(0, '6328.168'), (1, '5892.285')] [2023-12-26 10:34:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001374736_351936512.pth... [2023-12-26 10:34:08,789][123090] Updated weights for policy 1, policy_version 1365097 (0.0010) [2023-12-26 10:34:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001373712_351674368.pth [2023-12-26 10:34:08,863][123090] Updated weights for policy 1, policy_version 1365107 (0.0010) [2023-12-26 10:34:08,923][123090] Updated weights for policy 1, policy_version 1365117 (0.0009) [2023-12-26 10:34:08,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001365120_349470720.pth... [2023-12-26 10:34:08,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001364064_349200384.pth [2023-12-26 10:34:09,491][123091] Updated weights for policy 0, policy_version 1374739 (0.0007) [2023-12-26 10:34:09,555][123091] Updated weights for policy 0, policy_version 1374749 (0.0010) [2023-12-26 10:34:09,619][123091] Updated weights for policy 0, policy_version 1374760 (0.0010) [2023-12-26 10:34:09,681][123090] Updated weights for policy 1, policy_version 1365127 (0.0009) [2023-12-26 10:34:09,740][123090] Updated weights for policy 1, policy_version 1365137 (0.0009) [2023-12-26 10:34:09,811][123090] Updated weights for policy 1, policy_version 1365147 (0.0011) [2023-12-26 10:34:10,444][123091] Updated weights for policy 0, policy_version 1374770 (0.0009) [2023-12-26 10:34:10,518][123091] Updated weights for policy 0, policy_version 1374780 (0.0010) [2023-12-26 10:34:10,584][123091] Updated weights for policy 0, policy_version 1374790 (0.0010) [2023-12-26 10:34:10,623][123090] Updated weights for policy 1, policy_version 1365157 (0.0009) [2023-12-26 10:34:10,640][123091] Updated weights for policy 0, policy_version 1374800 (0.0006) [2023-12-26 10:34:10,688][123090] Updated weights for policy 1, policy_version 1365167 (0.0006) [2023-12-26 10:34:10,750][123090] Updated weights for policy 1, policy_version 1365177 (0.0006) [2023-12-26 10:34:11,426][123091] Updated weights for policy 0, policy_version 1374810 (0.0010) [2023-12-26 10:34:11,491][123091] Updated weights for policy 0, policy_version 1374820 (0.0010) [2023-12-26 10:34:11,557][123090] Updated weights for policy 1, policy_version 1365187 (0.0008) [2023-12-26 10:34:11,560][123091] Updated weights for policy 0, policy_version 1374830 (0.0009) [2023-12-26 10:34:11,619][123090] Updated weights for policy 1, policy_version 1365197 (0.0010) [2023-12-26 10:34:11,692][123090] Updated weights for policy 1, policy_version 1365207 (0.0010) [2023-12-26 10:34:12,357][123091] Updated weights for policy 0, policy_version 1374840 (0.0010) [2023-12-26 10:34:12,430][123091] Updated weights for policy 0, policy_version 1374850 (0.0010) [2023-12-26 10:34:12,504][123091] Updated weights for policy 0, policy_version 1374860 (0.0006) [2023-12-26 10:34:12,559][123090] Updated weights for policy 1, policy_version 1365217 (0.0010) [2023-12-26 10:34:12,625][123090] Updated weights for policy 1, policy_version 1365227 (0.0010) [2023-12-26 10:34:12,692][123090] Updated weights for policy 1, policy_version 1365237 (0.0010) [2023-12-26 10:34:12,765][123090] Updated weights for policy 1, policy_version 1365247 (0.0010) [2023-12-26 10:34:13,244][123091] Updated weights for policy 0, policy_version 1374870 (0.0010) [2023-12-26 10:34:13,303][123091] Updated weights for policy 0, policy_version 1374880 (0.0010) [2023-12-26 10:34:13,362][123091] Updated weights for policy 0, policy_version 1374890 (0.0010) [2023-12-26 10:34:13,554][123090] Updated weights for policy 1, policy_version 1365257 (0.0006) [2023-12-26 10:34:13,613][123090] Updated weights for policy 1, policy_version 1365267 (0.0005) [2023-12-26 10:34:13,662][123090] Updated weights for policy 1, policy_version 1365277 (0.0005) [2023-12-26 10:34:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 701489152. Throughput: 0: 8875.1, 1: 8945.5. Samples: 701479512. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:13,786][121949] Avg episode reward: [(0, '6335.273'), (1, '5877.674')] [2023-12-26 10:34:14,295][123091] Updated weights for policy 0, policy_version 1374900 (0.0009) [2023-12-26 10:34:14,296][123090] Updated weights for policy 1, policy_version 1365287 (0.0005) [2023-12-26 10:34:14,349][123091] Updated weights for policy 0, policy_version 1374910 (0.0009) [2023-12-26 10:34:14,350][123090] Updated weights for policy 1, policy_version 1365297 (0.0006) [2023-12-26 10:34:14,398][123091] Updated weights for policy 0, policy_version 1374920 (0.0009) [2023-12-26 10:34:14,406][123090] Updated weights for policy 1, policy_version 1365307 (0.0005) [2023-12-26 10:34:15,104][123090] Updated weights for policy 1, policy_version 1365317 (0.0006) [2023-12-26 10:34:15,173][123090] Updated weights for policy 1, policy_version 1365327 (0.0008) [2023-12-26 10:34:15,233][123091] Updated weights for policy 0, policy_version 1374930 (0.0008) [2023-12-26 10:34:15,238][123090] Updated weights for policy 1, policy_version 1365337 (0.0008) [2023-12-26 10:34:15,298][123091] Updated weights for policy 0, policy_version 1374940 (0.0010) [2023-12-26 10:34:15,363][123091] Updated weights for policy 0, policy_version 1374950 (0.0009) [2023-12-26 10:34:15,415][123091] Updated weights for policy 0, policy_version 1374960 (0.0008) [2023-12-26 10:34:16,036][123091] Updated weights for policy 0, policy_version 1374970 (0.0005) [2023-12-26 10:34:16,057][123090] Updated weights for policy 1, policy_version 1365347 (0.0011) [2023-12-26 10:34:16,106][123091] Updated weights for policy 0, policy_version 1374980 (0.0006) [2023-12-26 10:34:16,124][123090] Updated weights for policy 1, policy_version 1365357 (0.0011) [2023-12-26 10:34:16,169][123091] Updated weights for policy 0, policy_version 1374990 (0.0005) [2023-12-26 10:34:16,185][123090] Updated weights for policy 1, policy_version 1365367 (0.0008) [2023-12-26 10:34:16,846][123090] Updated weights for policy 1, policy_version 1365377 (0.0005) [2023-12-26 10:34:16,909][123090] Updated weights for policy 1, policy_version 1365387 (0.0008) [2023-12-26 10:34:16,935][123091] Updated weights for policy 0, policy_version 1375000 (0.0005) [2023-12-26 10:34:16,961][123090] Updated weights for policy 1, policy_version 1365397 (0.0010) [2023-12-26 10:34:16,992][123091] Updated weights for policy 0, policy_version 1375010 (0.0005) [2023-12-26 10:34:17,013][123090] Updated weights for policy 1, policy_version 1365407 (0.0010) [2023-12-26 10:34:17,060][123091] Updated weights for policy 0, policy_version 1375020 (0.0005) [2023-12-26 10:34:17,726][123091] Updated weights for policy 0, policy_version 1375030 (0.0005) [2023-12-26 10:34:17,770][123091] Updated weights for policy 0, policy_version 1375040 (0.0005) [2023-12-26 10:34:17,820][123090] Updated weights for policy 1, policy_version 1365417 (0.0010) [2023-12-26 10:34:17,823][123091] Updated weights for policy 0, policy_version 1375050 (0.0005) [2023-12-26 10:34:17,872][123090] Updated weights for policy 1, policy_version 1365427 (0.0010) [2023-12-26 10:34:17,921][123090] Updated weights for policy 1, policy_version 1365437 (0.0008) [2023-12-26 10:34:18,564][123091] Updated weights for policy 0, policy_version 1375060 (0.0007) [2023-12-26 10:34:18,633][123091] Updated weights for policy 0, policy_version 1375070 (0.0005) [2023-12-26 10:34:18,691][123091] Updated weights for policy 0, policy_version 1375080 (0.0010) [2023-12-26 10:34:18,776][123090] Updated weights for policy 1, policy_version 1365447 (0.0007) [2023-12-26 10:34:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 701579264. Throughput: 0: 8916.0, 1: 8952.0. Samples: 701591156. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:18,785][121949] Avg episode reward: [(0, '6438.386'), (1, '5847.762')] [2023-12-26 10:34:18,836][123090] Updated weights for policy 1, policy_version 1365457 (0.0010) [2023-12-26 10:34:18,893][123090] Updated weights for policy 1, policy_version 1365467 (0.0010) [2023-12-26 10:34:19,541][123091] Updated weights for policy 0, policy_version 1375090 (0.0009) [2023-12-26 10:34:19,598][123091] Updated weights for policy 0, policy_version 1375100 (0.0009) [2023-12-26 10:34:19,667][123091] Updated weights for policy 0, policy_version 1375110 (0.0009) [2023-12-26 10:34:19,695][123090] Updated weights for policy 1, policy_version 1365477 (0.0011) [2023-12-26 10:34:19,720][123091] Updated weights for policy 0, policy_version 1375120 (0.0006) [2023-12-26 10:34:19,760][123090] Updated weights for policy 1, policy_version 1365487 (0.0011) [2023-12-26 10:34:19,834][123090] Updated weights for policy 1, policy_version 1365497 (0.0011) [2023-12-26 10:34:20,510][123091] Updated weights for policy 0, policy_version 1375130 (0.0006) [2023-12-26 10:34:20,580][123091] Updated weights for policy 0, policy_version 1375140 (0.0006) [2023-12-26 10:34:20,637][123090] Updated weights for policy 1, policy_version 1365507 (0.0009) [2023-12-26 10:34:20,640][123091] Updated weights for policy 0, policy_version 1375150 (0.0010) [2023-12-26 10:34:20,711][123090] Updated weights for policy 1, policy_version 1365517 (0.0005) [2023-12-26 10:34:20,778][123090] Updated weights for policy 1, policy_version 1365527 (0.0006) [2023-12-26 10:34:21,485][123091] Updated weights for policy 0, policy_version 1375160 (0.0009) [2023-12-26 10:34:21,547][123091] Updated weights for policy 0, policy_version 1375170 (0.0009) [2023-12-26 10:34:21,582][123090] Updated weights for policy 1, policy_version 1365537 (0.0010) [2023-12-26 10:34:21,610][123091] Updated weights for policy 0, policy_version 1375180 (0.0009) [2023-12-26 10:34:21,646][123090] Updated weights for policy 1, policy_version 1365547 (0.0009) [2023-12-26 10:34:21,715][123090] Updated weights for policy 1, policy_version 1365557 (0.0009) [2023-12-26 10:34:21,790][123090] Updated weights for policy 1, policy_version 1365567 (0.0006) [2023-12-26 10:34:22,487][123091] Updated weights for policy 0, policy_version 1375190 (0.0010) [2023-12-26 10:34:22,558][123090] Updated weights for policy 1, policy_version 1365577 (0.0006) [2023-12-26 10:34:22,559][123091] Updated weights for policy 0, policy_version 1375200 (0.0006) [2023-12-26 10:34:22,617][123090] Updated weights for policy 1, policy_version 1365587 (0.0007) [2023-12-26 10:34:22,628][123091] Updated weights for policy 0, policy_version 1375210 (0.0009) [2023-12-26 10:34:22,684][123090] Updated weights for policy 1, policy_version 1365597 (0.0007) [2023-12-26 10:34:23,244][123090] Updated weights for policy 1, policy_version 1365607 (0.0008) [2023-12-26 10:34:23,302][123090] Updated weights for policy 1, policy_version 1365617 (0.0009) [2023-12-26 10:34:23,368][123090] Updated weights for policy 1, policy_version 1365627 (0.0009) [2023-12-26 10:34:23,411][123091] Updated weights for policy 0, policy_version 1375220 (0.0010) [2023-12-26 10:34:23,469][123091] Updated weights for policy 0, policy_version 1375230 (0.0009) [2023-12-26 10:34:23,523][123091] Updated weights for policy 0, policy_version 1375241 (0.0010) [2023-12-26 10:34:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 701669376. Throughput: 0: 8869.3, 1: 8940.5. Samples: 701642536. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:23,785][121949] Avg episode reward: [(0, '6433.193'), (1, '5876.999')] [2023-12-26 10:34:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001375248_352067584.pth... [2023-12-26 10:34:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001365632_349601792.pth... [2023-12-26 10:34:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001364608_349339648.pth [2023-12-26 10:34:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001374224_351805440.pth [2023-12-26 10:34:24,214][123091] Updated weights for policy 0, policy_version 1375251 (0.0009) [2023-12-26 10:34:24,259][123090] Updated weights for policy 1, policy_version 1365637 (0.0010) [2023-12-26 10:34:24,272][123091] Updated weights for policy 0, policy_version 1375261 (0.0007) [2023-12-26 10:34:24,322][123090] Updated weights for policy 1, policy_version 1365647 (0.0009) [2023-12-26 10:34:24,326][123091] Updated weights for policy 0, policy_version 1375271 (0.0010) [2023-12-26 10:34:24,385][123090] Updated weights for policy 1, policy_version 1365657 (0.0010) [2023-12-26 10:34:25,022][123091] Updated weights for policy 0, policy_version 1375281 (0.0006) [2023-12-26 10:34:25,081][123091] Updated weights for policy 0, policy_version 1375291 (0.0010) [2023-12-26 10:34:25,140][123091] Updated weights for policy 0, policy_version 1375301 (0.0011) [2023-12-26 10:34:25,158][123090] Updated weights for policy 1, policy_version 1365667 (0.0009) [2023-12-26 10:34:25,192][123091] Updated weights for policy 0, policy_version 1375311 (0.0008) [2023-12-26 10:34:25,225][123090] Updated weights for policy 1, policy_version 1365677 (0.0006) [2023-12-26 10:34:25,295][123090] Updated weights for policy 1, policy_version 1365687 (0.0005) [2023-12-26 10:34:25,905][123091] Updated weights for policy 0, policy_version 1375321 (0.0005) [2023-12-26 10:34:25,965][123091] Updated weights for policy 0, policy_version 1375331 (0.0005) [2023-12-26 10:34:26,015][123090] Updated weights for policy 1, policy_version 1365697 (0.0006) [2023-12-26 10:34:26,021][123091] Updated weights for policy 0, policy_version 1375341 (0.0005) [2023-12-26 10:34:26,071][123090] Updated weights for policy 1, policy_version 1365707 (0.0005) [2023-12-26 10:34:26,126][123090] Updated weights for policy 1, policy_version 1365717 (0.0005) [2023-12-26 10:34:26,174][123090] Updated weights for policy 1, policy_version 1365727 (0.0005) [2023-12-26 10:34:26,666][123091] Updated weights for policy 0, policy_version 1375351 (0.0007) [2023-12-26 10:34:26,728][123091] Updated weights for policy 0, policy_version 1375361 (0.0009) [2023-12-26 10:34:26,776][123091] Updated weights for policy 0, policy_version 1375371 (0.0010) [2023-12-26 10:34:26,860][123090] Updated weights for policy 1, policy_version 1365737 (0.0005) [2023-12-26 10:34:26,918][123090] Updated weights for policy 1, policy_version 1365747 (0.0005) [2023-12-26 10:34:26,979][123090] Updated weights for policy 1, policy_version 1365757 (0.0005) [2023-12-26 10:34:27,437][123091] Updated weights for policy 0, policy_version 1375381 (0.0008) [2023-12-26 10:34:27,484][123091] Updated weights for policy 0, policy_version 1375391 (0.0010) [2023-12-26 10:34:27,531][123091] Updated weights for policy 0, policy_version 1375401 (0.0010) [2023-12-26 10:34:27,547][123090] Updated weights for policy 1, policy_version 1365767 (0.0005) [2023-12-26 10:34:27,598][123090] Updated weights for policy 1, policy_version 1365777 (0.0007) [2023-12-26 10:34:27,653][123090] Updated weights for policy 1, policy_version 1365787 (0.0010) [2023-12-26 10:34:28,300][123091] Updated weights for policy 0, policy_version 1375411 (0.0010) [2023-12-26 10:34:28,371][123090] Updated weights for policy 1, policy_version 1365797 (0.0007) [2023-12-26 10:34:28,381][123091] Updated weights for policy 0, policy_version 1375421 (0.0009) [2023-12-26 10:34:28,427][123090] Updated weights for policy 1, policy_version 1365807 (0.0010) [2023-12-26 10:34:28,439][123091] Updated weights for policy 0, policy_version 1375431 (0.0007) [2023-12-26 10:34:28,483][123090] Updated weights for policy 1, policy_version 1365817 (0.0010) [2023-12-26 10:34:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 701767680. Throughput: 0: 8940.2, 1: 9022.9. Samples: 701756316. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:28,785][121949] Avg episode reward: [(0, '6398.248'), (1, '5886.355')] [2023-12-26 10:34:29,243][123090] Updated weights for policy 1, policy_version 1365827 (0.0009) [2023-12-26 10:34:29,303][123090] Updated weights for policy 1, policy_version 1365837 (0.0010) [2023-12-26 10:34:29,356][123091] Updated weights for policy 0, policy_version 1375441 (0.0006) [2023-12-26 10:34:29,374][123090] Updated weights for policy 1, policy_version 1365847 (0.0010) [2023-12-26 10:34:29,432][123091] Updated weights for policy 0, policy_version 1375451 (0.0007) [2023-12-26 10:34:29,500][123091] Updated weights for policy 0, policy_version 1375461 (0.0006) [2023-12-26 10:34:29,553][123091] Updated weights for policy 0, policy_version 1375471 (0.0009) [2023-12-26 10:34:30,188][123090] Updated weights for policy 1, policy_version 1365857 (0.0011) [2023-12-26 10:34:30,250][123090] Updated weights for policy 1, policy_version 1365867 (0.0009) [2023-12-26 10:34:30,316][123090] Updated weights for policy 1, policy_version 1365877 (0.0010) [2023-12-26 10:34:30,364][123091] Updated weights for policy 0, policy_version 1375481 (0.0006) [2023-12-26 10:34:30,374][123090] Updated weights for policy 1, policy_version 1365887 (0.0008) [2023-12-26 10:34:30,438][123091] Updated weights for policy 0, policy_version 1375491 (0.0007) [2023-12-26 10:34:30,493][123091] Updated weights for policy 0, policy_version 1375501 (0.0010) [2023-12-26 10:34:31,198][123090] Updated weights for policy 1, policy_version 1365897 (0.0009) [2023-12-26 10:34:31,253][123090] Updated weights for policy 1, policy_version 1365907 (0.0009) [2023-12-26 10:34:31,289][123091] Updated weights for policy 0, policy_version 1375511 (0.0010) [2023-12-26 10:34:31,312][123090] Updated weights for policy 1, policy_version 1365917 (0.0007) [2023-12-26 10:34:31,339][123091] Updated weights for policy 0, policy_version 1375521 (0.0008) [2023-12-26 10:34:31,407][123091] Updated weights for policy 0, policy_version 1375531 (0.0010) [2023-12-26 10:34:32,163][123090] Updated weights for policy 1, policy_version 1365927 (0.0010) [2023-12-26 10:34:32,228][123090] Updated weights for policy 1, policy_version 1365937 (0.0010) [2023-12-26 10:34:32,234][123091] Updated weights for policy 0, policy_version 1375541 (0.0007) [2023-12-26 10:34:32,298][123090] Updated weights for policy 1, policy_version 1365947 (0.0010) [2023-12-26 10:34:32,300][123091] Updated weights for policy 0, policy_version 1375551 (0.0008) [2023-12-26 10:34:32,364][123091] Updated weights for policy 0, policy_version 1375561 (0.0008) [2023-12-26 10:34:33,100][123090] Updated weights for policy 1, policy_version 1365957 (0.0010) [2023-12-26 10:34:33,133][123091] Updated weights for policy 0, policy_version 1375571 (0.0008) [2023-12-26 10:34:33,156][123090] Updated weights for policy 1, policy_version 1365967 (0.0010) [2023-12-26 10:34:33,199][123091] Updated weights for policy 0, policy_version 1375581 (0.0006) [2023-12-26 10:34:33,214][123090] Updated weights for policy 1, policy_version 1365977 (0.0010) [2023-12-26 10:34:33,263][123091] Updated weights for policy 0, policy_version 1375591 (0.0006) [2023-12-26 10:34:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 701849600. Throughput: 0: 8893.7, 1: 8918.5. Samples: 701861576. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:33,785][121949] Avg episode reward: [(0, '6326.098'), (1, '5915.099')] [2023-12-26 10:34:33,971][123090] Updated weights for policy 1, policy_version 1365987 (0.0009) [2023-12-26 10:34:34,021][123090] Updated weights for policy 1, policy_version 1365997 (0.0008) [2023-12-26 10:34:34,075][123090] Updated weights for policy 1, policy_version 1366007 (0.0006) [2023-12-26 10:34:34,096][123091] Updated weights for policy 0, policy_version 1375601 (0.0009) [2023-12-26 10:34:34,166][123091] Updated weights for policy 0, policy_version 1375611 (0.0009) [2023-12-26 10:34:34,221][123091] Updated weights for policy 0, policy_version 1375621 (0.0009) [2023-12-26 10:34:34,283][123091] Updated weights for policy 0, policy_version 1375631 (0.0009) [2023-12-26 10:34:34,904][123090] Updated weights for policy 1, policy_version 1366017 (0.0006) [2023-12-26 10:34:34,970][123090] Updated weights for policy 1, policy_version 1366027 (0.0010) [2023-12-26 10:34:35,041][123090] Updated weights for policy 1, policy_version 1366037 (0.0010) [2023-12-26 10:34:35,102][123091] Updated weights for policy 0, policy_version 1375641 (0.0007) [2023-12-26 10:34:35,104][123090] Updated weights for policy 1, policy_version 1366047 (0.0010) [2023-12-26 10:34:35,162][123091] Updated weights for policy 0, policy_version 1375651 (0.0008) [2023-12-26 10:34:35,229][123091] Updated weights for policy 0, policy_version 1375661 (0.0009) [2023-12-26 10:34:35,781][123090] Updated weights for policy 1, policy_version 1366057 (0.0006) [2023-12-26 10:34:35,841][123090] Updated weights for policy 1, policy_version 1366067 (0.0005) [2023-12-26 10:34:35,904][123090] Updated weights for policy 1, policy_version 1366077 (0.0005) [2023-12-26 10:34:36,142][123091] Updated weights for policy 0, policy_version 1375671 (0.0009) [2023-12-26 10:34:36,206][123091] Updated weights for policy 0, policy_version 1375681 (0.0009) [2023-12-26 10:34:36,271][123091] Updated weights for policy 0, policy_version 1375691 (0.0009) [2023-12-26 10:34:36,648][123090] Updated weights for policy 1, policy_version 1366087 (0.0009) [2023-12-26 10:34:36,717][123090] Updated weights for policy 1, policy_version 1366097 (0.0011) [2023-12-26 10:34:36,786][123090] Updated weights for policy 1, policy_version 1366107 (0.0011) [2023-12-26 10:34:37,119][123091] Updated weights for policy 0, policy_version 1375701 (0.0009) [2023-12-26 10:34:37,175][123091] Updated weights for policy 0, policy_version 1375711 (0.0009) [2023-12-26 10:34:37,223][123091] Updated weights for policy 0, policy_version 1375721 (0.0009) [2023-12-26 10:34:37,602][123090] Updated weights for policy 1, policy_version 1366117 (0.0010) [2023-12-26 10:34:37,651][123090] Updated weights for policy 1, policy_version 1366127 (0.0010) [2023-12-26 10:34:37,706][123090] Updated weights for policy 1, policy_version 1366137 (0.0010) [2023-12-26 10:34:38,072][123091] Updated weights for policy 0, policy_version 1375731 (0.0009) [2023-12-26 10:34:38,133][123091] Updated weights for policy 0, policy_version 1375741 (0.0009) [2023-12-26 10:34:38,200][123091] Updated weights for policy 0, policy_version 1375751 (0.0010) [2023-12-26 10:34:38,571][123090] Updated weights for policy 1, policy_version 1366147 (0.0010) [2023-12-26 10:34:38,632][123090] Updated weights for policy 1, policy_version 1366157 (0.0010) [2023-12-26 10:34:38,695][123090] Updated weights for policy 1, policy_version 1366167 (0.0008) [2023-12-26 10:34:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 701939712. Throughput: 0: 8844.8, 1: 8925.7. Samples: 701914008. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:38,785][121949] Avg episode reward: [(0, '6329.070'), (1, '5921.111')] [2023-12-26 10:34:38,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001366176_349741056.pth... [2023-12-26 10:34:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001375760_352198656.pth... [2023-12-26 10:34:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001365120_349470720.pth [2023-12-26 10:34:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001374736_351936512.pth [2023-12-26 10:34:39,020][123091] Updated weights for policy 0, policy_version 1375761 (0.0009) [2023-12-26 10:34:39,087][123091] Updated weights for policy 0, policy_version 1375771 (0.0009) [2023-12-26 10:34:39,152][123091] Updated weights for policy 0, policy_version 1375781 (0.0009) [2023-12-26 10:34:39,219][123091] Updated weights for policy 0, policy_version 1375791 (0.0010) [2023-12-26 10:34:39,564][123090] Updated weights for policy 1, policy_version 1366177 (0.0009) [2023-12-26 10:34:39,637][123090] Updated weights for policy 1, policy_version 1366187 (0.0006) [2023-12-26 10:34:39,701][123090] Updated weights for policy 1, policy_version 1366197 (0.0009) [2023-12-26 10:34:39,769][123090] Updated weights for policy 1, policy_version 1366207 (0.0010) [2023-12-26 10:34:40,062][123091] Updated weights for policy 0, policy_version 1375801 (0.0009) [2023-12-26 10:34:40,130][123091] Updated weights for policy 0, policy_version 1375811 (0.0008) [2023-12-26 10:34:40,201][123091] Updated weights for policy 0, policy_version 1375821 (0.0009) [2023-12-26 10:34:40,571][123090] Updated weights for policy 1, policy_version 1366217 (0.0010) [2023-12-26 10:34:40,641][123090] Updated weights for policy 1, policy_version 1366227 (0.0010) [2023-12-26 10:34:40,709][123090] Updated weights for policy 1, policy_version 1366237 (0.0009) [2023-12-26 10:34:41,068][123091] Updated weights for policy 0, policy_version 1375831 (0.0010) [2023-12-26 10:34:41,162][123091] Updated weights for policy 0, policy_version 1375841 (0.0010) [2023-12-26 10:34:41,218][123091] Updated weights for policy 0, policy_version 1375851 (0.0010) [2023-12-26 10:34:41,524][123090] Updated weights for policy 1, policy_version 1366247 (0.0009) [2023-12-26 10:34:41,597][123090] Updated weights for policy 1, policy_version 1366257 (0.0010) [2023-12-26 10:34:41,668][123090] Updated weights for policy 1, policy_version 1366267 (0.0008) [2023-12-26 10:34:42,079][123091] Updated weights for policy 0, policy_version 1375861 (0.0009) [2023-12-26 10:34:42,144][123091] Updated weights for policy 0, policy_version 1375871 (0.0010) [2023-12-26 10:34:42,210][123091] Updated weights for policy 0, policy_version 1375881 (0.0010) [2023-12-26 10:34:42,485][123090] Updated weights for policy 1, policy_version 1366277 (0.0008) [2023-12-26 10:34:42,555][123090] Updated weights for policy 1, policy_version 1366287 (0.0010) [2023-12-26 10:34:42,630][123090] Updated weights for policy 1, policy_version 1366297 (0.0012) [2023-12-26 10:34:42,959][123091] Updated weights for policy 0, policy_version 1375891 (0.0008) [2023-12-26 10:34:43,016][123091] Updated weights for policy 0, policy_version 1375901 (0.0005) [2023-12-26 10:34:43,074][123091] Updated weights for policy 0, policy_version 1375911 (0.0005) [2023-12-26 10:34:43,389][123090] Updated weights for policy 1, policy_version 1366307 (0.0007) [2023-12-26 10:34:43,437][123090] Updated weights for policy 1, policy_version 1366317 (0.0009) [2023-12-26 10:34:43,484][123090] Updated weights for policy 1, policy_version 1366327 (0.0008) [2023-12-26 10:34:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 702021632. Throughput: 0: 8755.6, 1: 8945.2. Samples: 702014616. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:43,785][121949] Avg episode reward: [(0, '6378.486'), (1, '5883.951')] [2023-12-26 10:34:43,802][123091] Updated weights for policy 0, policy_version 1375921 (0.0006) [2023-12-26 10:34:43,864][123091] Updated weights for policy 0, policy_version 1375931 (0.0006) [2023-12-26 10:34:43,918][123091] Updated weights for policy 0, policy_version 1375941 (0.0005) [2023-12-26 10:34:43,981][123091] Updated weights for policy 0, policy_version 1375951 (0.0006) [2023-12-26 10:34:44,398][123090] Updated weights for policy 1, policy_version 1366337 (0.0010) [2023-12-26 10:34:44,464][123090] Updated weights for policy 1, policy_version 1366347 (0.0009) [2023-12-26 10:34:44,528][123090] Updated weights for policy 1, policy_version 1366357 (0.0009) [2023-12-26 10:34:44,594][123090] Updated weights for policy 1, policy_version 1366367 (0.0009) [2023-12-26 10:34:44,722][123091] Updated weights for policy 0, policy_version 1375961 (0.0009) [2023-12-26 10:34:44,795][123091] Updated weights for policy 0, policy_version 1375971 (0.0010) [2023-12-26 10:34:44,865][123091] Updated weights for policy 0, policy_version 1375981 (0.0010) [2023-12-26 10:34:45,416][123090] Updated weights for policy 1, policy_version 1366377 (0.0009) [2023-12-26 10:34:45,482][123090] Updated weights for policy 1, policy_version 1366387 (0.0008) [2023-12-26 10:34:45,553][123090] Updated weights for policy 1, policy_version 1366397 (0.0009) [2023-12-26 10:34:45,652][123091] Updated weights for policy 0, policy_version 1375991 (0.0007) [2023-12-26 10:34:45,707][123091] Updated weights for policy 0, policy_version 1376001 (0.0005) [2023-12-26 10:34:45,779][123091] Updated weights for policy 0, policy_version 1376011 (0.0005) [2023-12-26 10:34:46,338][123090] Updated weights for policy 1, policy_version 1366407 (0.0006) [2023-12-26 10:34:46,405][123090] Updated weights for policy 1, policy_version 1366417 (0.0007) [2023-12-26 10:34:46,473][123090] Updated weights for policy 1, policy_version 1366427 (0.0008) [2023-12-26 10:34:46,496][123091] Updated weights for policy 0, policy_version 1376021 (0.0010) [2023-12-26 10:34:46,563][123091] Updated weights for policy 0, policy_version 1376031 (0.0010) [2023-12-26 10:34:46,623][123091] Updated weights for policy 0, policy_version 1376041 (0.0009) [2023-12-26 10:34:47,263][123090] Updated weights for policy 1, policy_version 1366437 (0.0008) [2023-12-26 10:34:47,317][123090] Updated weights for policy 1, policy_version 1366447 (0.0009) [2023-12-26 10:34:47,374][123090] Updated weights for policy 1, policy_version 1366457 (0.0005) [2023-12-26 10:34:47,426][123091] Updated weights for policy 0, policy_version 1376051 (0.0009) [2023-12-26 10:34:47,485][123091] Updated weights for policy 0, policy_version 1376061 (0.0009) [2023-12-26 10:34:47,538][123091] Updated weights for policy 0, policy_version 1376072 (0.0010) [2023-12-26 10:34:48,116][123090] Updated weights for policy 1, policy_version 1366467 (0.0005) [2023-12-26 10:34:48,170][123090] Updated weights for policy 1, policy_version 1366477 (0.0005) [2023-12-26 10:34:48,231][123090] Updated weights for policy 1, policy_version 1366487 (0.0005) [2023-12-26 10:34:48,407][123091] Updated weights for policy 0, policy_version 1376082 (0.0010) [2023-12-26 10:34:48,474][123091] Updated weights for policy 0, policy_version 1376092 (0.0010) [2023-12-26 10:34:48,537][123091] Updated weights for policy 0, policy_version 1376102 (0.0010) [2023-12-26 10:34:48,600][123091] Updated weights for policy 0, policy_version 1376112 (0.0010) [2023-12-26 10:34:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 702111744. Throughput: 0: 8796.9, 1: 8954.4. Samples: 702121920. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:48,785][121949] Avg episode reward: [(0, '6338.477'), (1, '5837.796')] [2023-12-26 10:34:48,927][123090] Updated weights for policy 1, policy_version 1366497 (0.0005) [2023-12-26 10:34:48,987][123090] Updated weights for policy 1, policy_version 1366507 (0.0006) [2023-12-26 10:34:49,042][123090] Updated weights for policy 1, policy_version 1366517 (0.0010) [2023-12-26 10:34:49,094][123090] Updated weights for policy 1, policy_version 1366527 (0.0010) [2023-12-26 10:34:49,495][123091] Updated weights for policy 0, policy_version 1376122 (0.0005) [2023-12-26 10:34:49,575][123091] Updated weights for policy 0, policy_version 1376132 (0.0006) [2023-12-26 10:34:49,639][123091] Updated weights for policy 0, policy_version 1376142 (0.0009) [2023-12-26 10:34:49,896][123090] Updated weights for policy 1, policy_version 1366537 (0.0010) [2023-12-26 10:34:49,970][123090] Updated weights for policy 1, policy_version 1366547 (0.0009) [2023-12-26 10:34:50,034][123090] Updated weights for policy 1, policy_version 1366557 (0.0008) [2023-12-26 10:34:50,377][123091] Updated weights for policy 0, policy_version 1376152 (0.0007) [2023-12-26 10:34:50,445][123091] Updated weights for policy 0, policy_version 1376162 (0.0009) [2023-12-26 10:34:50,503][123091] Updated weights for policy 0, policy_version 1376172 (0.0009) [2023-12-26 10:34:50,844][123090] Updated weights for policy 1, policy_version 1366567 (0.0009) [2023-12-26 10:34:50,893][123090] Updated weights for policy 1, policy_version 1366577 (0.0009) [2023-12-26 10:34:50,942][123090] Updated weights for policy 1, policy_version 1366587 (0.0009) [2023-12-26 10:34:51,305][123091] Updated weights for policy 0, policy_version 1376182 (0.0009) [2023-12-26 10:34:51,369][123091] Updated weights for policy 0, policy_version 1376192 (0.0009) [2023-12-26 10:34:51,428][123091] Updated weights for policy 0, policy_version 1376202 (0.0010) [2023-12-26 10:34:51,820][123090] Updated weights for policy 1, policy_version 1366597 (0.0010) [2023-12-26 10:34:51,880][123090] Updated weights for policy 1, policy_version 1366607 (0.0008) [2023-12-26 10:34:51,944][123090] Updated weights for policy 1, policy_version 1366617 (0.0009) [2023-12-26 10:34:52,292][123091] Updated weights for policy 0, policy_version 1376212 (0.0009) [2023-12-26 10:34:52,362][123091] Updated weights for policy 0, policy_version 1376222 (0.0007) [2023-12-26 10:34:52,416][123091] Updated weights for policy 0, policy_version 1376232 (0.0010) [2023-12-26 10:34:52,792][123090] Updated weights for policy 1, policy_version 1366627 (0.0011) [2023-12-26 10:34:52,848][123090] Updated weights for policy 1, policy_version 1366637 (0.0011) [2023-12-26 10:34:52,903][123090] Updated weights for policy 1, policy_version 1366647 (0.0010) [2023-12-26 10:34:53,231][123091] Updated weights for policy 0, policy_version 1376242 (0.0010) [2023-12-26 10:34:53,275][123091] Updated weights for policy 0, policy_version 1376252 (0.0010) [2023-12-26 10:34:53,318][123091] Updated weights for policy 0, policy_version 1376262 (0.0006) [2023-12-26 10:34:53,371][123091] Updated weights for policy 0, policy_version 1376272 (0.0005) [2023-12-26 10:34:53,657][123090] Updated weights for policy 1, policy_version 1366657 (0.0010) [2023-12-26 10:34:53,712][123090] Updated weights for policy 1, policy_version 1366667 (0.0005) [2023-12-26 10:34:53,763][123090] Updated weights for policy 1, policy_version 1366677 (0.0009) [2023-12-26 10:34:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 702193664. Throughput: 0: 8813.0, 1: 8974.5. Samples: 702174056. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:53,785][121949] Avg episode reward: [(0, '6333.530'), (1, '5729.919')] [2023-12-26 10:34:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001376272_352329728.pth... [2023-12-26 10:34:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001375248_352067584.pth [2023-12-26 10:34:53,819][123090] Updated weights for policy 1, policy_version 1366687 (0.0010) [2023-12-26 10:34:53,821][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001366688_349872128.pth... [2023-12-26 10:34:53,826][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001365632_349601792.pth [2023-12-26 10:34:54,216][123091] Updated weights for policy 0, policy_version 1376282 (0.0011) [2023-12-26 10:34:54,272][123091] Updated weights for policy 0, policy_version 1376292 (0.0010) [2023-12-26 10:34:54,337][123091] Updated weights for policy 0, policy_version 1376302 (0.0010) [2023-12-26 10:34:54,603][123090] Updated weights for policy 1, policy_version 1366697 (0.0008) [2023-12-26 10:34:54,651][123090] Updated weights for policy 1, policy_version 1366707 (0.0009) [2023-12-26 10:34:54,700][123090] Updated weights for policy 1, policy_version 1366717 (0.0008) [2023-12-26 10:34:55,155][123091] Updated weights for policy 0, policy_version 1376312 (0.0011) [2023-12-26 10:34:55,220][123091] Updated weights for policy 0, policy_version 1376322 (0.0011) [2023-12-26 10:34:55,287][123091] Updated weights for policy 0, policy_version 1376332 (0.0011) [2023-12-26 10:34:55,580][123090] Updated weights for policy 1, policy_version 1366727 (0.0009) [2023-12-26 10:34:55,644][123090] Updated weights for policy 1, policy_version 1366737 (0.0009) [2023-12-26 10:34:55,708][123090] Updated weights for policy 1, policy_version 1366747 (0.0009) [2023-12-26 10:34:56,096][123091] Updated weights for policy 0, policy_version 1376342 (0.0011) [2023-12-26 10:34:56,148][123091] Updated weights for policy 0, policy_version 1376352 (0.0010) [2023-12-26 10:34:56,202][123091] Updated weights for policy 0, policy_version 1376362 (0.0010) [2023-12-26 10:34:56,547][123090] Updated weights for policy 1, policy_version 1366757 (0.0009) [2023-12-26 10:34:56,608][123090] Updated weights for policy 1, policy_version 1366767 (0.0006) [2023-12-26 10:34:56,679][123090] Updated weights for policy 1, policy_version 1366777 (0.0005) [2023-12-26 10:34:57,044][123091] Updated weights for policy 0, policy_version 1376372 (0.0010) [2023-12-26 10:34:57,098][123091] Updated weights for policy 0, policy_version 1376382 (0.0010) [2023-12-26 10:34:57,148][123091] Updated weights for policy 0, policy_version 1376392 (0.0009) [2023-12-26 10:34:57,455][123090] Updated weights for policy 1, policy_version 1366787 (0.0008) [2023-12-26 10:34:57,509][123090] Updated weights for policy 1, policy_version 1366797 (0.0008) [2023-12-26 10:34:57,557][123090] Updated weights for policy 1, policy_version 1366807 (0.0008) [2023-12-26 10:34:57,906][123091] Updated weights for policy 0, policy_version 1376402 (0.0006) [2023-12-26 10:34:57,973][123091] Updated weights for policy 0, policy_version 1376412 (0.0011) [2023-12-26 10:34:58,037][123091] Updated weights for policy 0, policy_version 1376422 (0.0010) [2023-12-26 10:34:58,101][123091] Updated weights for policy 0, policy_version 1376432 (0.0008) [2023-12-26 10:34:58,407][123090] Updated weights for policy 1, policy_version 1366817 (0.0009) [2023-12-26 10:34:58,484][123090] Updated weights for policy 1, policy_version 1366828 (0.0009) [2023-12-26 10:34:58,542][123090] Updated weights for policy 1, policy_version 1366838 (0.0008) [2023-12-26 10:34:58,599][123090] Updated weights for policy 1, policy_version 1366848 (0.0008) [2023-12-26 10:34:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 702283776. Throughput: 0: 8792.8, 1: 8948.2. Samples: 702277848. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:34:58,785][121949] Avg episode reward: [(0, '6386.641'), (1, '5759.099')] [2023-12-26 10:34:59,064][123091] Updated weights for policy 0, policy_version 1376442 (0.0007) [2023-12-26 10:34:59,125][123091] Updated weights for policy 0, policy_version 1376452 (0.0006) [2023-12-26 10:34:59,186][123091] Updated weights for policy 0, policy_version 1376462 (0.0009) [2023-12-26 10:34:59,538][123090] Updated weights for policy 1, policy_version 1366858 (0.0009) [2023-12-26 10:34:59,588][123090] Updated weights for policy 1, policy_version 1366868 (0.0009) [2023-12-26 10:34:59,643][123090] Updated weights for policy 1, policy_version 1366879 (0.0009) [2023-12-26 10:35:00,008][123091] Updated weights for policy 0, policy_version 1376472 (0.0006) [2023-12-26 10:35:00,056][123091] Updated weights for policy 0, policy_version 1376482 (0.0008) [2023-12-26 10:35:00,108][123091] Updated weights for policy 0, policy_version 1376492 (0.0006) [2023-12-26 10:35:00,519][123090] Updated weights for policy 1, policy_version 1366889 (0.0010) [2023-12-26 10:35:00,581][123090] Updated weights for policy 1, policy_version 1366899 (0.0009) [2023-12-26 10:35:00,647][123090] Updated weights for policy 1, policy_version 1366909 (0.0009) [2023-12-26 10:35:00,947][123091] Updated weights for policy 0, policy_version 1376502 (0.0008) [2023-12-26 10:35:00,995][123091] Updated weights for policy 0, policy_version 1376512 (0.0009) [2023-12-26 10:35:01,054][123091] Updated weights for policy 0, policy_version 1376522 (0.0010) [2023-12-26 10:35:01,400][123090] Updated weights for policy 1, policy_version 1366919 (0.0009) [2023-12-26 10:35:01,458][123090] Updated weights for policy 1, policy_version 1366929 (0.0009) [2023-12-26 10:35:01,511][123090] Updated weights for policy 1, policy_version 1366939 (0.0009) [2023-12-26 10:35:01,944][123091] Updated weights for policy 0, policy_version 1376532 (0.0010) [2023-12-26 10:35:02,010][123091] Updated weights for policy 0, policy_version 1376542 (0.0010) [2023-12-26 10:35:02,076][123091] Updated weights for policy 0, policy_version 1376552 (0.0010) [2023-12-26 10:35:02,355][123090] Updated weights for policy 1, policy_version 1366949 (0.0010) [2023-12-26 10:35:02,417][123090] Updated weights for policy 1, policy_version 1366959 (0.0010) [2023-12-26 10:35:02,473][123090] Updated weights for policy 1, policy_version 1366969 (0.0009) [2023-12-26 10:35:02,917][123091] Updated weights for policy 0, policy_version 1376562 (0.0010) [2023-12-26 10:35:02,976][123091] Updated weights for policy 0, policy_version 1376572 (0.0010) [2023-12-26 10:35:03,026][123091] Updated weights for policy 0, policy_version 1376583 (0.0010) [2023-12-26 10:35:03,301][123090] Updated weights for policy 1, policy_version 1366979 (0.0009) [2023-12-26 10:35:03,360][123090] Updated weights for policy 1, policy_version 1366989 (0.0008) [2023-12-26 10:35:03,412][123090] Updated weights for policy 1, policy_version 1366999 (0.0009) [2023-12-26 10:35:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 702365696. Throughput: 0: 8693.2, 1: 8815.2. Samples: 702379032. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:35:03,785][121949] Avg episode reward: [(0, '6385.729'), (1, '5868.979')] [2023-12-26 10:35:03,810][123091] Updated weights for policy 0, policy_version 1376593 (0.0009) [2023-12-26 10:35:03,878][123091] Updated weights for policy 0, policy_version 1376603 (0.0011) [2023-12-26 10:35:03,945][123091] Updated weights for policy 0, policy_version 1376613 (0.0011) [2023-12-26 10:35:04,010][123091] Updated weights for policy 0, policy_version 1376623 (0.0008) [2023-12-26 10:35:04,267][123090] Updated weights for policy 1, policy_version 1367009 (0.0009) [2023-12-26 10:35:04,345][123090] Updated weights for policy 1, policy_version 1367019 (0.0006) [2023-12-26 10:35:04,416][123090] Updated weights for policy 1, policy_version 1367029 (0.0006) [2023-12-26 10:35:04,481][123090] Updated weights for policy 1, policy_version 1367039 (0.0009) [2023-12-26 10:35:04,797][123091] Updated weights for policy 0, policy_version 1376633 (0.0010) [2023-12-26 10:35:04,859][123091] Updated weights for policy 0, policy_version 1376643 (0.0011) [2023-12-26 10:35:04,914][123091] Updated weights for policy 0, policy_version 1376653 (0.0010) [2023-12-26 10:35:05,235][123090] Updated weights for policy 1, policy_version 1367049 (0.0009) [2023-12-26 10:35:05,283][123090] Updated weights for policy 1, policy_version 1367059 (0.0008) [2023-12-26 10:35:05,336][123090] Updated weights for policy 1, policy_version 1367069 (0.0010) [2023-12-26 10:35:05,614][123091] Updated weights for policy 0, policy_version 1376663 (0.0007) [2023-12-26 10:35:05,670][123091] Updated weights for policy 0, policy_version 1376673 (0.0005) [2023-12-26 10:35:05,726][123091] Updated weights for policy 0, policy_version 1376683 (0.0005) [2023-12-26 10:35:06,275][123090] Updated weights for policy 1, policy_version 1367079 (0.0010) [2023-12-26 10:35:06,347][123090] Updated weights for policy 1, policy_version 1367089 (0.0008) [2023-12-26 10:35:06,415][123091] Updated weights for policy 0, policy_version 1376693 (0.0005) [2023-12-26 10:35:06,416][123090] Updated weights for policy 1, policy_version 1367099 (0.0007) [2023-12-26 10:35:06,480][123091] Updated weights for policy 0, policy_version 1376703 (0.0006) [2023-12-26 10:35:06,548][123091] Updated weights for policy 0, policy_version 1376713 (0.0006) [2023-12-26 10:35:07,154][123090] Updated weights for policy 1, policy_version 1367109 (0.0009) [2023-12-26 10:35:07,210][123090] Updated weights for policy 1, policy_version 1367119 (0.0009) [2023-12-26 10:35:07,271][123090] Updated weights for policy 1, policy_version 1367129 (0.0009) [2023-12-26 10:35:07,335][123091] Updated weights for policy 0, policy_version 1376723 (0.0007) [2023-12-26 10:35:07,400][123091] Updated weights for policy 0, policy_version 1376733 (0.0009) [2023-12-26 10:35:07,459][123091] Updated weights for policy 0, policy_version 1376743 (0.0009) [2023-12-26 10:35:08,103][123090] Updated weights for policy 1, policy_version 1367139 (0.0008) [2023-12-26 10:35:08,166][123090] Updated weights for policy 1, policy_version 1367149 (0.0005) [2023-12-26 10:35:08,231][123090] Updated weights for policy 1, policy_version 1367159 (0.0005) [2023-12-26 10:35:08,259][123091] Updated weights for policy 0, policy_version 1376753 (0.0009) [2023-12-26 10:35:08,310][123091] Updated weights for policy 0, policy_version 1376763 (0.0009) [2023-12-26 10:35:08,385][123091] Updated weights for policy 0, policy_version 1376773 (0.0010) [2023-12-26 10:35:08,444][123091] Updated weights for policy 0, policy_version 1376783 (0.0007) [2023-12-26 10:35:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 702455808. Throughput: 0: 8744.0, 1: 8802.7. Samples: 702432136. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:35:08,785][121949] Avg episode reward: [(0, '6378.073'), (1, '5899.988')] [2023-12-26 10:35:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001376784_352460800.pth... [2023-12-26 10:35:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001367168_349995008.pth... [2023-12-26 10:35:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001366176_349741056.pth [2023-12-26 10:35:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001375760_352198656.pth [2023-12-26 10:35:09,045][123090] Updated weights for policy 1, policy_version 1367169 (0.0006) [2023-12-26 10:35:09,116][123090] Updated weights for policy 1, policy_version 1367179 (0.0010) [2023-12-26 10:35:09,178][123090] Updated weights for policy 1, policy_version 1367189 (0.0009) [2023-12-26 10:35:09,244][123090] Updated weights for policy 1, policy_version 1367199 (0.0009) [2023-12-26 10:35:09,251][123091] Updated weights for policy 0, policy_version 1376793 (0.0007) [2023-12-26 10:35:09,318][123091] Updated weights for policy 0, policy_version 1376803 (0.0010) [2023-12-26 10:35:09,387][123091] Updated weights for policy 0, policy_version 1376813 (0.0009) [2023-12-26 10:35:10,081][123090] Updated weights for policy 1, policy_version 1367209 (0.0010) [2023-12-26 10:35:10,136][123090] Updated weights for policy 1, policy_version 1367219 (0.0009) [2023-12-26 10:35:10,200][123090] Updated weights for policy 1, policy_version 1367229 (0.0009) [2023-12-26 10:35:10,226][123091] Updated weights for policy 0, policy_version 1376823 (0.0010) [2023-12-26 10:35:10,289][123091] Updated weights for policy 0, policy_version 1376833 (0.0010) [2023-12-26 10:35:10,352][123091] Updated weights for policy 0, policy_version 1376843 (0.0010) [2023-12-26 10:35:11,042][123090] Updated weights for policy 1, policy_version 1367239 (0.0009) [2023-12-26 10:35:11,098][123090] Updated weights for policy 1, policy_version 1367249 (0.0009) [2023-12-26 10:35:11,166][123090] Updated weights for policy 1, policy_version 1367259 (0.0009) [2023-12-26 10:35:11,264][123091] Updated weights for policy 0, policy_version 1376853 (0.0009) [2023-12-26 10:35:11,324][123091] Updated weights for policy 0, policy_version 1376863 (0.0009) [2023-12-26 10:35:11,393][123091] Updated weights for policy 0, policy_version 1376873 (0.0010) [2023-12-26 10:35:12,060][123090] Updated weights for policy 1, policy_version 1367269 (0.0008) [2023-12-26 10:35:12,139][123090] Updated weights for policy 1, policy_version 1367279 (0.0011) [2023-12-26 10:35:12,209][123091] Updated weights for policy 0, policy_version 1376883 (0.0008) [2023-12-26 10:35:12,214][123090] Updated weights for policy 1, policy_version 1367289 (0.0006) [2023-12-26 10:35:12,278][123091] Updated weights for policy 0, policy_version 1376893 (0.0006) [2023-12-26 10:35:12,346][123091] Updated weights for policy 0, policy_version 1376903 (0.0007) [2023-12-26 10:35:13,014][123090] Updated weights for policy 1, policy_version 1367299 (0.0009) [2023-12-26 10:35:13,039][123091] Updated weights for policy 0, policy_version 1376913 (0.0008) [2023-12-26 10:35:13,062][123090] Updated weights for policy 1, policy_version 1367309 (0.0010) [2023-12-26 10:35:13,093][123091] Updated weights for policy 0, policy_version 1376923 (0.0006) [2023-12-26 10:35:13,115][123090] Updated weights for policy 1, policy_version 1367319 (0.0009) [2023-12-26 10:35:13,150][123091] Updated weights for policy 0, policy_version 1376933 (0.0006) [2023-12-26 10:35:13,201][123091] Updated weights for policy 0, policy_version 1376943 (0.0005) [2023-12-26 10:35:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 702537728. Throughput: 0: 8634.0, 1: 8666.2. Samples: 702534820. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:35:13,784][121949] Avg episode reward: [(0, '6385.628'), (1, '5847.607')] [2023-12-26 10:35:13,887][123090] Updated weights for policy 1, policy_version 1367329 (0.0010) [2023-12-26 10:35:13,887][123091] Updated weights for policy 0, policy_version 1376953 (0.0009) [2023-12-26 10:35:13,940][123091] Updated weights for policy 0, policy_version 1376963 (0.0009) [2023-12-26 10:35:13,945][123090] Updated weights for policy 1, policy_version 1367339 (0.0005) [2023-12-26 10:35:14,002][123090] Updated weights for policy 1, policy_version 1367349 (0.0005) [2023-12-26 10:35:14,006][123091] Updated weights for policy 0, policy_version 1376973 (0.0011) [2023-12-26 10:35:14,061][123090] Updated weights for policy 1, policy_version 1367359 (0.0005) [2023-12-26 10:35:14,829][123091] Updated weights for policy 0, policy_version 1376983 (0.0009) [2023-12-26 10:35:14,829][123090] Updated weights for policy 1, policy_version 1367369 (0.0010) [2023-12-26 10:35:14,895][123091] Updated weights for policy 0, policy_version 1376993 (0.0006) [2023-12-26 10:35:14,896][123090] Updated weights for policy 1, policy_version 1367379 (0.0011) [2023-12-26 10:35:14,956][123091] Updated weights for policy 0, policy_version 1377003 (0.0006) [2023-12-26 10:35:14,958][123090] Updated weights for policy 1, policy_version 1367389 (0.0011) [2023-12-26 10:35:15,594][123091] Updated weights for policy 0, policy_version 1377013 (0.0006) [2023-12-26 10:35:15,656][123091] Updated weights for policy 0, policy_version 1377023 (0.0005) [2023-12-26 10:35:15,723][123091] Updated weights for policy 0, policy_version 1377033 (0.0006) [2023-12-26 10:35:15,744][123090] Updated weights for policy 1, policy_version 1367399 (0.0007) [2023-12-26 10:35:15,796][123090] Updated weights for policy 1, policy_version 1367409 (0.0009) [2023-12-26 10:35:15,847][123090] Updated weights for policy 1, policy_version 1367419 (0.0010) [2023-12-26 10:35:16,492][123091] Updated weights for policy 0, policy_version 1377043 (0.0009) [2023-12-26 10:35:16,545][123091] Updated weights for policy 0, policy_version 1377053 (0.0010) [2023-12-26 10:35:16,558][123090] Updated weights for policy 1, policy_version 1367429 (0.0009) [2023-12-26 10:35:16,595][123091] Updated weights for policy 0, policy_version 1377063 (0.0009) [2023-12-26 10:35:16,621][123090] Updated weights for policy 1, policy_version 1367439 (0.0007) [2023-12-26 10:35:16,686][123090] Updated weights for policy 1, policy_version 1367449 (0.0007) [2023-12-26 10:35:17,398][123091] Updated weights for policy 0, policy_version 1377073 (0.0009) [2023-12-26 10:35:17,442][123090] Updated weights for policy 1, policy_version 1367459 (0.0006) [2023-12-26 10:35:17,455][123091] Updated weights for policy 0, policy_version 1377083 (0.0007) [2023-12-26 10:35:17,492][123090] Updated weights for policy 1, policy_version 1367469 (0.0006) [2023-12-26 10:35:17,499][123091] Updated weights for policy 0, policy_version 1377093 (0.0010) [2023-12-26 10:35:17,550][123090] Updated weights for policy 1, policy_version 1367479 (0.0007) [2023-12-26 10:35:17,555][123091] Updated weights for policy 0, policy_version 1377103 (0.0008) [2023-12-26 10:35:18,219][123091] Updated weights for policy 0, policy_version 1377113 (0.0006) [2023-12-26 10:35:18,272][123091] Updated weights for policy 0, policy_version 1377123 (0.0005) [2023-12-26 10:35:18,361][123091] Updated weights for policy 0, policy_version 1377133 (0.0008) [2023-12-26 10:35:18,434][123090] Updated weights for policy 1, policy_version 1367489 (0.0010) [2023-12-26 10:35:18,504][123090] Updated weights for policy 1, policy_version 1367499 (0.0009) [2023-12-26 10:35:18,574][123090] Updated weights for policy 1, policy_version 1367509 (0.0009) [2023-12-26 10:35:18,645][123090] Updated weights for policy 1, policy_version 1367519 (0.0007) [2023-12-26 10:35:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 702636032. Throughput: 0: 8751.2, 1: 8675.2. Samples: 702645764. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:35:18,785][121949] Avg episode reward: [(0, '6374.339'), (1, '5868.377')] [2023-12-26 10:35:19,065][123091] Updated weights for policy 0, policy_version 1377143 (0.0008) [2023-12-26 10:35:19,126][123091] Updated weights for policy 0, policy_version 1377153 (0.0009) [2023-12-26 10:35:19,178][123091] Updated weights for policy 0, policy_version 1377163 (0.0010) [2023-12-26 10:35:19,399][123090] Updated weights for policy 1, policy_version 1367529 (0.0009) [2023-12-26 10:35:19,459][123090] Updated weights for policy 1, policy_version 1367539 (0.0009) [2023-12-26 10:35:19,526][123090] Updated weights for policy 1, policy_version 1367549 (0.0009) [2023-12-26 10:35:20,022][123091] Updated weights for policy 0, policy_version 1377173 (0.0011) [2023-12-26 10:35:20,082][123091] Updated weights for policy 0, policy_version 1377183 (0.0011) [2023-12-26 10:35:20,142][123091] Updated weights for policy 0, policy_version 1377193 (0.0011) [2023-12-26 10:35:20,378][123090] Updated weights for policy 1, policy_version 1367559 (0.0010) [2023-12-26 10:35:20,442][123090] Updated weights for policy 1, policy_version 1367569 (0.0010) [2023-12-26 10:35:20,498][123090] Updated weights for policy 1, policy_version 1367579 (0.0009) [2023-12-26 10:35:20,909][123091] Updated weights for policy 0, policy_version 1377203 (0.0011) [2023-12-26 10:35:20,979][123091] Updated weights for policy 0, policy_version 1377213 (0.0009) [2023-12-26 10:35:21,043][123091] Updated weights for policy 0, policy_version 1377223 (0.0010) [2023-12-26 10:35:21,398][123090] Updated weights for policy 1, policy_version 1367589 (0.0009) [2023-12-26 10:35:21,452][123090] Updated weights for policy 1, policy_version 1367599 (0.0009) [2023-12-26 10:35:21,510][123090] Updated weights for policy 1, policy_version 1367609 (0.0009) [2023-12-26 10:35:21,998][123091] Updated weights for policy 0, policy_version 1377233 (0.0009) [2023-12-26 10:35:22,059][123091] Updated weights for policy 0, policy_version 1377243 (0.0006) [2023-12-26 10:35:22,117][123091] Updated weights for policy 0, policy_version 1377253 (0.0005) [2023-12-26 10:35:22,186][123091] Updated weights for policy 0, policy_version 1377263 (0.0006) [2023-12-26 10:35:22,400][123090] Updated weights for policy 1, policy_version 1367619 (0.0009) [2023-12-26 10:35:22,472][123090] Updated weights for policy 1, policy_version 1367629 (0.0009) [2023-12-26 10:35:22,535][123090] Updated weights for policy 1, policy_version 1367639 (0.0007) [2023-12-26 10:35:22,914][123091] Updated weights for policy 0, policy_version 1377273 (0.0006) [2023-12-26 10:35:22,988][123091] Updated weights for policy 0, policy_version 1377283 (0.0006) [2023-12-26 10:35:23,055][123091] Updated weights for policy 0, policy_version 1377293 (0.0006) [2023-12-26 10:35:23,305][123090] Updated weights for policy 1, policy_version 1367649 (0.0008) [2023-12-26 10:35:23,366][123090] Updated weights for policy 1, policy_version 1367659 (0.0009) [2023-12-26 10:35:23,421][123090] Updated weights for policy 1, policy_version 1367669 (0.0009) [2023-12-26 10:35:23,472][123090] Updated weights for policy 1, policy_version 1367679 (0.0009) [2023-12-26 10:35:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 702717952. Throughput: 0: 8764.1, 1: 8607.1. Samples: 702695712. Policy #0 lag: (min: 31.0, avg: 35.5, max: 63.0) [2023-12-26 10:35:23,785][121949] Avg episode reward: [(0, '6239.211'), (1, '5920.927')] [2023-12-26 10:35:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001367680_350126080.pth... [2023-12-26 10:35:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001366688_349872128.pth [2023-12-26 10:35:23,800][123091] Updated weights for policy 0, policy_version 1377303 (0.0008) [2023-12-26 10:35:23,853][123091] Updated weights for policy 0, policy_version 1377313 (0.0009) [2023-12-26 10:35:23,911][123091] Updated weights for policy 0, policy_version 1377323 (0.0009) [2023-12-26 10:35:23,933][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001377328_352600064.pth... [2023-12-26 10:35:23,936][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001376272_352329728.pth [2023-12-26 10:35:24,361][123090] Updated weights for policy 1, policy_version 1367689 (0.0008) [2023-12-26 10:35:24,408][123090] Updated weights for policy 1, policy_version 1367699 (0.0005) [2023-12-26 10:35:24,475][123090] Updated weights for policy 1, policy_version 1367709 (0.0005) [2023-12-26 10:35:24,643][123091] Updated weights for policy 0, policy_version 1377333 (0.0007) [2023-12-26 10:35:24,688][123091] Updated weights for policy 0, policy_version 1377343 (0.0005) [2023-12-26 10:35:24,737][123091] Updated weights for policy 0, policy_version 1377353 (0.0005) [2023-12-26 10:35:25,305][123090] Updated weights for policy 1, policy_version 1367719 (0.0008) [2023-12-26 10:35:25,357][123090] Updated weights for policy 1, policy_version 1367729 (0.0009) [2023-12-26 10:35:25,405][123090] Updated weights for policy 1, policy_version 1367739 (0.0006) [2023-12-26 10:35:25,455][123091] Updated weights for policy 0, policy_version 1377363 (0.0007) [2023-12-26 10:35:25,515][123091] Updated weights for policy 0, policy_version 1377373 (0.0009) [2023-12-26 10:35:25,576][123091] Updated weights for policy 0, policy_version 1377383 (0.0009) [2023-12-26 10:35:26,209][123090] Updated weights for policy 1, policy_version 1367749 (0.0007) [2023-12-26 10:35:26,265][123090] Updated weights for policy 1, policy_version 1367759 (0.0005) [2023-12-26 10:35:26,321][123090] Updated weights for policy 1, policy_version 1367769 (0.0005) [2023-12-26 10:35:26,334][123091] Updated weights for policy 0, policy_version 1377393 (0.0010) [2023-12-26 10:35:26,384][123091] Updated weights for policy 0, policy_version 1377403 (0.0005) [2023-12-26 10:35:26,431][123091] Updated weights for policy 0, policy_version 1377413 (0.0005) [2023-12-26 10:35:26,502][123091] Updated weights for policy 0, policy_version 1377423 (0.0006) [2023-12-26 10:35:26,961][123090] Updated weights for policy 1, policy_version 1367779 (0.0005) [2023-12-26 10:35:27,022][123090] Updated weights for policy 1, policy_version 1367789 (0.0005) [2023-12-26 10:35:27,083][123090] Updated weights for policy 1, policy_version 1367799 (0.0005) [2023-12-26 10:35:27,334][123091] Updated weights for policy 0, policy_version 1377433 (0.0009) [2023-12-26 10:35:27,389][123091] Updated weights for policy 0, policy_version 1377443 (0.0009) [2023-12-26 10:35:27,436][123091] Updated weights for policy 0, policy_version 1377454 (0.0009) [2023-12-26 10:35:27,783][123090] Updated weights for policy 1, policy_version 1367809 (0.0007) [2023-12-26 10:35:27,833][123090] Updated weights for policy 1, policy_version 1367819 (0.0005) [2023-12-26 10:35:27,880][123090] Updated weights for policy 1, policy_version 1367829 (0.0005) [2023-12-26 10:35:27,928][123090] Updated weights for policy 1, policy_version 1367839 (0.0005) [2023-12-26 10:35:28,246][123091] Updated weights for policy 0, policy_version 1377464 (0.0006) [2023-12-26 10:35:28,297][123091] Updated weights for policy 0, policy_version 1377474 (0.0008) [2023-12-26 10:35:28,360][123091] Updated weights for policy 0, policy_version 1377484 (0.0010) [2023-12-26 10:35:28,685][123090] Updated weights for policy 1, policy_version 1367849 (0.0006) [2023-12-26 10:35:28,754][123090] Updated weights for policy 1, policy_version 1367859 (0.0006) [2023-12-26 10:35:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17744.7). Total num frames: 702808064. Throughput: 0: 8882.4, 1: 8674.6. Samples: 702804680. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:28,784][121949] Avg episode reward: [(0, '6190.856'), (1, '5887.824')] [2023-12-26 10:35:28,832][123090] Updated weights for policy 1, policy_version 1367869 (0.0006) [2023-12-26 10:35:29,010][123091] Updated weights for policy 0, policy_version 1377494 (0.0006) [2023-12-26 10:35:29,076][123091] Updated weights for policy 0, policy_version 1377504 (0.0009) [2023-12-26 10:35:29,139][123091] Updated weights for policy 0, policy_version 1377514 (0.0009) [2023-12-26 10:35:29,500][123090] Updated weights for policy 1, policy_version 1367879 (0.0006) [2023-12-26 10:35:29,564][123090] Updated weights for policy 1, policy_version 1367889 (0.0006) [2023-12-26 10:35:29,618][123090] Updated weights for policy 1, policy_version 1367899 (0.0005) [2023-12-26 10:35:29,959][123091] Updated weights for policy 0, policy_version 1377524 (0.0008) [2023-12-26 10:35:30,020][123091] Updated weights for policy 0, policy_version 1377534 (0.0006) [2023-12-26 10:35:30,085][123091] Updated weights for policy 0, policy_version 1377544 (0.0005) [2023-12-26 10:35:30,408][123090] Updated weights for policy 1, policy_version 1367909 (0.0006) [2023-12-26 10:35:30,458][123090] Updated weights for policy 1, policy_version 1367919 (0.0005) [2023-12-26 10:35:30,519][123090] Updated weights for policy 1, policy_version 1367929 (0.0006) [2023-12-26 10:35:30,818][123091] Updated weights for policy 0, policy_version 1377554 (0.0006) [2023-12-26 10:35:30,869][123091] Updated weights for policy 0, policy_version 1377564 (0.0010) [2023-12-26 10:35:30,919][123091] Updated weights for policy 0, policy_version 1377574 (0.0008) [2023-12-26 10:35:30,967][123091] Updated weights for policy 0, policy_version 1377584 (0.0005) [2023-12-26 10:35:31,296][123090] Updated weights for policy 1, policy_version 1367939 (0.0006) [2023-12-26 10:35:31,362][123090] Updated weights for policy 1, policy_version 1367949 (0.0006) [2023-12-26 10:35:31,423][123090] Updated weights for policy 1, policy_version 1367959 (0.0007) [2023-12-26 10:35:31,765][123091] Updated weights for policy 0, policy_version 1377594 (0.0008) [2023-12-26 10:35:31,824][123091] Updated weights for policy 0, policy_version 1377604 (0.0008) [2023-12-26 10:35:31,893][123091] Updated weights for policy 0, policy_version 1377614 (0.0008) [2023-12-26 10:35:32,223][123090] Updated weights for policy 1, policy_version 1367969 (0.0008) [2023-12-26 10:35:32,288][123090] Updated weights for policy 1, policy_version 1367979 (0.0010) [2023-12-26 10:35:32,356][123090] Updated weights for policy 1, policy_version 1367989 (0.0007) [2023-12-26 10:35:32,423][123090] Updated weights for policy 1, policy_version 1367999 (0.0008) [2023-12-26 10:35:32,620][123091] Updated weights for policy 0, policy_version 1377624 (0.0006) [2023-12-26 10:35:32,692][123091] Updated weights for policy 0, policy_version 1377634 (0.0005) [2023-12-26 10:35:32,755][123091] Updated weights for policy 0, policy_version 1377644 (0.0005) [2023-12-26 10:35:33,219][123090] Updated weights for policy 1, policy_version 1368009 (0.0007) [2023-12-26 10:35:33,266][123090] Updated weights for policy 1, policy_version 1368019 (0.0008) [2023-12-26 10:35:33,327][123090] Updated weights for policy 1, policy_version 1368029 (0.0010) [2023-12-26 10:35:33,478][123091] Updated weights for policy 0, policy_version 1377654 (0.0008) [2023-12-26 10:35:33,529][123091] Updated weights for policy 0, policy_version 1377664 (0.0009) [2023-12-26 10:35:33,575][123091] Updated weights for policy 0, policy_version 1377674 (0.0009) [2023-12-26 10:35:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 702906368. Throughput: 0: 8922.6, 1: 8709.7. Samples: 702915372. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:33,785][121949] Avg episode reward: [(0, '6226.109'), (1, '5882.888')] [2023-12-26 10:35:34,174][123090] Updated weights for policy 1, policy_version 1368039 (0.0009) [2023-12-26 10:35:34,244][123090] Updated weights for policy 1, policy_version 1368049 (0.0009) [2023-12-26 10:35:34,321][123090] Updated weights for policy 1, policy_version 1368059 (0.0009) [2023-12-26 10:35:34,338][123091] Updated weights for policy 0, policy_version 1377684 (0.0010) [2023-12-26 10:35:34,402][123091] Updated weights for policy 0, policy_version 1377694 (0.0008) [2023-12-26 10:35:34,468][123091] Updated weights for policy 0, policy_version 1377704 (0.0010) [2023-12-26 10:35:34,965][123090] Updated weights for policy 1, policy_version 1368069 (0.0008) [2023-12-26 10:35:35,029][123090] Updated weights for policy 1, policy_version 1368079 (0.0006) [2023-12-26 10:35:35,082][123090] Updated weights for policy 1, policy_version 1368089 (0.0008) [2023-12-26 10:35:35,340][123091] Updated weights for policy 0, policy_version 1377714 (0.0009) [2023-12-26 10:35:35,390][123091] Updated weights for policy 0, policy_version 1377724 (0.0007) [2023-12-26 10:35:35,450][123091] Updated weights for policy 0, policy_version 1377734 (0.0009) [2023-12-26 10:35:35,509][123091] Updated weights for policy 0, policy_version 1377744 (0.0010) [2023-12-26 10:35:35,904][123090] Updated weights for policy 1, policy_version 1368099 (0.0010) [2023-12-26 10:35:35,960][123090] Updated weights for policy 1, policy_version 1368109 (0.0009) [2023-12-26 10:35:36,020][123090] Updated weights for policy 1, policy_version 1368119 (0.0009) [2023-12-26 10:35:36,326][123091] Updated weights for policy 0, policy_version 1377754 (0.0010) [2023-12-26 10:35:36,395][123091] Updated weights for policy 0, policy_version 1377764 (0.0010) [2023-12-26 10:35:36,465][123091] Updated weights for policy 0, policy_version 1377774 (0.0008) [2023-12-26 10:35:36,802][123090] Updated weights for policy 1, policy_version 1368129 (0.0009) [2023-12-26 10:35:36,862][123090] Updated weights for policy 1, policy_version 1368139 (0.0009) [2023-12-26 10:35:36,912][123090] Updated weights for policy 1, policy_version 1368149 (0.0010) [2023-12-26 10:35:36,967][123090] Updated weights for policy 1, policy_version 1368159 (0.0010) [2023-12-26 10:35:37,289][123091] Updated weights for policy 0, policy_version 1377784 (0.0009) [2023-12-26 10:35:37,337][123091] Updated weights for policy 0, policy_version 1377794 (0.0009) [2023-12-26 10:35:37,385][123091] Updated weights for policy 0, policy_version 1377804 (0.0009) [2023-12-26 10:35:37,815][123090] Updated weights for policy 1, policy_version 1368169 (0.0011) [2023-12-26 10:35:37,879][123090] Updated weights for policy 1, policy_version 1368179 (0.0011) [2023-12-26 10:35:37,942][123090] Updated weights for policy 1, policy_version 1368189 (0.0010) [2023-12-26 10:35:38,266][123091] Updated weights for policy 0, policy_version 1377814 (0.0009) [2023-12-26 10:35:38,326][123091] Updated weights for policy 0, policy_version 1377824 (0.0009) [2023-12-26 10:35:38,391][123091] Updated weights for policy 0, policy_version 1377834 (0.0009) [2023-12-26 10:35:38,735][123090] Updated weights for policy 1, policy_version 1368199 (0.0010) [2023-12-26 10:35:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 702988288. Throughput: 0: 8929.6, 1: 8719.7. Samples: 702968272. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:38,785][121949] Avg episode reward: [(0, '6203.904'), (1, '5907.943')] [2023-12-26 10:35:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001377840_352731136.pth... [2023-12-26 10:35:38,790][123090] Updated weights for policy 1, policy_version 1368209 (0.0010) [2023-12-26 10:35:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001376784_352460800.pth [2023-12-26 10:35:38,850][123090] Updated weights for policy 1, policy_version 1368219 (0.0010) [2023-12-26 10:35:38,876][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001368224_350265344.pth... [2023-12-26 10:35:38,879][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001367168_349995008.pth [2023-12-26 10:35:39,233][123091] Updated weights for policy 0, policy_version 1377844 (0.0009) [2023-12-26 10:35:39,290][123091] Updated weights for policy 0, policy_version 1377854 (0.0009) [2023-12-26 10:35:39,357][123091] Updated weights for policy 0, policy_version 1377864 (0.0010) [2023-12-26 10:35:39,671][123090] Updated weights for policy 1, policy_version 1368229 (0.0008) [2023-12-26 10:35:39,739][123090] Updated weights for policy 1, policy_version 1368239 (0.0005) [2023-12-26 10:35:39,813][123090] Updated weights for policy 1, policy_version 1368249 (0.0006) [2023-12-26 10:35:40,256][123091] Updated weights for policy 0, policy_version 1377874 (0.0008) [2023-12-26 10:35:40,329][123091] Updated weights for policy 0, policy_version 1377884 (0.0006) [2023-12-26 10:35:40,394][123091] Updated weights for policy 0, policy_version 1377894 (0.0005) [2023-12-26 10:35:40,459][123091] Updated weights for policy 0, policy_version 1377904 (0.0005) [2023-12-26 10:35:40,577][123090] Updated weights for policy 1, policy_version 1368259 (0.0009) [2023-12-26 10:35:40,632][123090] Updated weights for policy 1, policy_version 1368269 (0.0011) [2023-12-26 10:35:40,695][123090] Updated weights for policy 1, policy_version 1368279 (0.0011) [2023-12-26 10:35:41,188][123091] Updated weights for policy 0, policy_version 1377914 (0.0008) [2023-12-26 10:35:41,248][123091] Updated weights for policy 0, policy_version 1377924 (0.0009) [2023-12-26 10:35:41,311][123091] Updated weights for policy 0, policy_version 1377934 (0.0006) [2023-12-26 10:35:41,575][123090] Updated weights for policy 1, policy_version 1368289 (0.0011) [2023-12-26 10:35:41,647][123090] Updated weights for policy 1, policy_version 1368299 (0.0010) [2023-12-26 10:35:41,707][123090] Updated weights for policy 1, policy_version 1368309 (0.0011) [2023-12-26 10:35:41,773][123090] Updated weights for policy 1, policy_version 1368319 (0.0009) [2023-12-26 10:35:42,101][123091] Updated weights for policy 0, policy_version 1377944 (0.0006) [2023-12-26 10:35:42,160][123091] Updated weights for policy 0, policy_version 1377954 (0.0006) [2023-12-26 10:35:42,215][123091] Updated weights for policy 0, policy_version 1377964 (0.0010) [2023-12-26 10:35:42,601][123090] Updated weights for policy 1, policy_version 1368329 (0.0009) [2023-12-26 10:35:42,658][123090] Updated weights for policy 1, policy_version 1368339 (0.0009) [2023-12-26 10:35:42,714][123090] Updated weights for policy 1, policy_version 1368349 (0.0009) [2023-12-26 10:35:43,014][123091] Updated weights for policy 0, policy_version 1377974 (0.0009) [2023-12-26 10:35:43,062][123091] Updated weights for policy 0, policy_version 1377984 (0.0010) [2023-12-26 10:35:43,122][123091] Updated weights for policy 0, policy_version 1377994 (0.0011) [2023-12-26 10:35:43,527][123090] Updated weights for policy 1, policy_version 1368359 (0.0006) [2023-12-26 10:35:43,575][123090] Updated weights for policy 1, policy_version 1368369 (0.0005) [2023-12-26 10:35:43,624][123090] Updated weights for policy 1, policy_version 1368379 (0.0005) [2023-12-26 10:35:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 703078400. Throughput: 0: 8917.3, 1: 8712.4. Samples: 703071188. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:43,785][121949] Avg episode reward: [(0, '6306.579'), (1, '5860.119')] [2023-12-26 10:35:43,926][123091] Updated weights for policy 0, policy_version 1378004 (0.0011) [2023-12-26 10:35:43,977][123091] Updated weights for policy 0, policy_version 1378014 (0.0010) [2023-12-26 10:35:44,024][123091] Updated weights for policy 0, policy_version 1378024 (0.0010) [2023-12-26 10:35:44,287][123090] Updated weights for policy 1, policy_version 1368389 (0.0005) [2023-12-26 10:35:44,342][123090] Updated weights for policy 1, policy_version 1368399 (0.0007) [2023-12-26 10:35:44,394][123090] Updated weights for policy 1, policy_version 1368409 (0.0010) [2023-12-26 10:35:44,907][123091] Updated weights for policy 0, policy_version 1378034 (0.0011) [2023-12-26 10:35:44,971][123091] Updated weights for policy 0, policy_version 1378044 (0.0011) [2023-12-26 10:35:45,028][123091] Updated weights for policy 0, policy_version 1378054 (0.0011) [2023-12-26 10:35:45,084][123091] Updated weights for policy 0, policy_version 1378064 (0.0011) [2023-12-26 10:35:45,126][123090] Updated weights for policy 1, policy_version 1368419 (0.0010) [2023-12-26 10:35:45,186][123090] Updated weights for policy 1, policy_version 1368429 (0.0011) [2023-12-26 10:35:45,250][123090] Updated weights for policy 1, policy_version 1368439 (0.0010) [2023-12-26 10:35:45,934][123091] Updated weights for policy 0, policy_version 1378074 (0.0011) [2023-12-26 10:35:45,996][123091] Updated weights for policy 0, policy_version 1378084 (0.0010) [2023-12-26 10:35:46,054][123091] Updated weights for policy 0, policy_version 1378094 (0.0010) [2023-12-26 10:35:46,088][123090] Updated weights for policy 1, policy_version 1368449 (0.0011) [2023-12-26 10:35:46,150][123090] Updated weights for policy 1, policy_version 1368459 (0.0010) [2023-12-26 10:35:46,216][123090] Updated weights for policy 1, policy_version 1368469 (0.0010) [2023-12-26 10:35:46,278][123090] Updated weights for policy 1, policy_version 1368479 (0.0010) [2023-12-26 10:35:46,875][123091] Updated weights for policy 0, policy_version 1378104 (0.0011) [2023-12-26 10:35:46,922][123091] Updated weights for policy 0, policy_version 1378114 (0.0010) [2023-12-26 10:35:46,977][123091] Updated weights for policy 0, policy_version 1378124 (0.0010) [2023-12-26 10:35:47,082][123090] Updated weights for policy 1, policy_version 1368489 (0.0010) [2023-12-26 10:35:47,137][123090] Updated weights for policy 1, policy_version 1368499 (0.0010) [2023-12-26 10:35:47,182][123090] Updated weights for policy 1, policy_version 1368509 (0.0009) [2023-12-26 10:35:47,809][123091] Updated weights for policy 0, policy_version 1378134 (0.0010) [2023-12-26 10:35:47,853][123091] Updated weights for policy 0, policy_version 1378144 (0.0010) [2023-12-26 10:35:47,897][123091] Updated weights for policy 0, policy_version 1378154 (0.0010) [2023-12-26 10:35:47,899][123090] Updated weights for policy 1, policy_version 1368519 (0.0008) [2023-12-26 10:35:47,965][123090] Updated weights for policy 1, policy_version 1368529 (0.0010) [2023-12-26 10:35:48,020][123090] Updated weights for policy 1, policy_version 1368539 (0.0010) [2023-12-26 10:35:48,737][123091] Updated weights for policy 0, policy_version 1378164 (0.0010) [2023-12-26 10:35:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 703160320. Throughput: 0: 8932.3, 1: 8827.1. Samples: 703178204. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:48,785][121949] Avg episode reward: [(0, '6336.681'), (1, '5848.183')] [2023-12-26 10:35:48,788][123091] Updated weights for policy 0, policy_version 1378174 (0.0008) [2023-12-26 10:35:48,798][123090] Updated weights for policy 1, policy_version 1368549 (0.0010) [2023-12-26 10:35:48,850][123091] Updated weights for policy 0, policy_version 1378184 (0.0009) [2023-12-26 10:35:48,850][123090] Updated weights for policy 1, policy_version 1368559 (0.0007) [2023-12-26 10:35:48,914][123090] Updated weights for policy 1, policy_version 1368569 (0.0010) [2023-12-26 10:35:49,639][123091] Updated weights for policy 0, policy_version 1378194 (0.0007) [2023-12-26 10:35:49,693][123091] Updated weights for policy 0, policy_version 1378204 (0.0010) [2023-12-26 10:35:49,748][123090] Updated weights for policy 1, policy_version 1368579 (0.0009) [2023-12-26 10:35:49,753][123091] Updated weights for policy 0, policy_version 1378214 (0.0009) [2023-12-26 10:35:49,809][123090] Updated weights for policy 1, policy_version 1368589 (0.0006) [2023-12-26 10:35:49,818][123091] Updated weights for policy 0, policy_version 1378224 (0.0009) [2023-12-26 10:35:49,869][123090] Updated weights for policy 1, policy_version 1368599 (0.0007) [2023-12-26 10:35:50,639][123090] Updated weights for policy 1, policy_version 1368609 (0.0006) [2023-12-26 10:35:50,702][123090] Updated weights for policy 1, policy_version 1368619 (0.0010) [2023-12-26 10:35:50,747][123091] Updated weights for policy 0, policy_version 1378234 (0.0007) [2023-12-26 10:35:50,770][123090] Updated weights for policy 1, policy_version 1368629 (0.0007) [2023-12-26 10:35:50,821][123091] Updated weights for policy 0, policy_version 1378244 (0.0006) [2023-12-26 10:35:50,848][123090] Updated weights for policy 1, policy_version 1368639 (0.0009) [2023-12-26 10:35:50,893][123091] Updated weights for policy 0, policy_version 1378254 (0.0006) [2023-12-26 10:35:51,669][123090] Updated weights for policy 1, policy_version 1368649 (0.0008) [2023-12-26 10:35:51,679][123091] Updated weights for policy 0, policy_version 1378264 (0.0008) [2023-12-26 10:35:51,737][123090] Updated weights for policy 1, policy_version 1368659 (0.0008) [2023-12-26 10:35:51,746][123091] Updated weights for policy 0, policy_version 1378274 (0.0008) [2023-12-26 10:35:51,806][123090] Updated weights for policy 1, policy_version 1368669 (0.0008) [2023-12-26 10:35:51,811][123091] Updated weights for policy 0, policy_version 1378284 (0.0007) [2023-12-26 10:35:52,489][123090] Updated weights for policy 1, policy_version 1368679 (0.0005) [2023-12-26 10:35:52,534][123091] Updated weights for policy 0, policy_version 1378294 (0.0007) [2023-12-26 10:35:52,556][123090] Updated weights for policy 1, policy_version 1368689 (0.0005) [2023-12-26 10:35:52,590][123091] Updated weights for policy 0, policy_version 1378304 (0.0008) [2023-12-26 10:35:52,622][123090] Updated weights for policy 1, policy_version 1368699 (0.0006) [2023-12-26 10:35:52,652][123091] Updated weights for policy 0, policy_version 1378314 (0.0008) [2023-12-26 10:35:53,388][123091] Updated weights for policy 0, policy_version 1378324 (0.0007) [2023-12-26 10:35:53,392][123090] Updated weights for policy 1, policy_version 1368709 (0.0007) [2023-12-26 10:35:53,446][123090] Updated weights for policy 1, policy_version 1368719 (0.0009) [2023-12-26 10:35:53,446][123091] Updated weights for policy 0, policy_version 1378334 (0.0005) [2023-12-26 10:35:53,499][123090] Updated weights for policy 1, policy_version 1368729 (0.0009) [2023-12-26 10:35:53,506][123091] Updated weights for policy 0, policy_version 1378344 (0.0008) [2023-12-26 10:35:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 703258624. Throughput: 0: 8885.1, 1: 8839.9. Samples: 703229760. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:53,785][121949] Avg episode reward: [(0, '6409.927'), (1, '5895.622')] [2023-12-26 10:35:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001378352_352862208.pth... [2023-12-26 10:35:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001368736_350396416.pth... [2023-12-26 10:35:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001377328_352600064.pth [2023-12-26 10:35:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001367680_350126080.pth [2023-12-26 10:35:54,214][123091] Updated weights for policy 0, policy_version 1378354 (0.0007) [2023-12-26 10:35:54,285][123091] Updated weights for policy 0, policy_version 1378364 (0.0007) [2023-12-26 10:35:54,340][123091] Updated weights for policy 0, policy_version 1378374 (0.0009) [2023-12-26 10:35:54,383][123090] Updated weights for policy 1, policy_version 1368739 (0.0009) [2023-12-26 10:35:54,404][123091] Updated weights for policy 0, policy_version 1378384 (0.0008) [2023-12-26 10:35:54,450][123090] Updated weights for policy 1, policy_version 1368749 (0.0007) [2023-12-26 10:35:54,502][123090] Updated weights for policy 1, policy_version 1368759 (0.0005) [2023-12-26 10:35:55,228][123091] Updated weights for policy 0, policy_version 1378394 (0.0009) [2023-12-26 10:35:55,232][123090] Updated weights for policy 1, policy_version 1368769 (0.0006) [2023-12-26 10:35:55,283][123090] Updated weights for policy 1, policy_version 1368779 (0.0010) [2023-12-26 10:35:55,285][123091] Updated weights for policy 0, policy_version 1378404 (0.0009) [2023-12-26 10:35:55,334][123090] Updated weights for policy 1, policy_version 1368789 (0.0010) [2023-12-26 10:35:55,341][123091] Updated weights for policy 0, policy_version 1378414 (0.0006) [2023-12-26 10:35:55,389][123090] Updated weights for policy 1, policy_version 1368799 (0.0010) [2023-12-26 10:35:56,200][123091] Updated weights for policy 0, policy_version 1378424 (0.0006) [2023-12-26 10:35:56,242][123090] Updated weights for policy 1, policy_version 1368809 (0.0011) [2023-12-26 10:35:56,260][123091] Updated weights for policy 0, policy_version 1378434 (0.0007) [2023-12-26 10:35:56,309][123090] Updated weights for policy 1, policy_version 1368819 (0.0010) [2023-12-26 10:35:56,316][123091] Updated weights for policy 0, policy_version 1378444 (0.0007) [2023-12-26 10:35:56,369][123090] Updated weights for policy 1, policy_version 1368829 (0.0010) [2023-12-26 10:35:56,975][123091] Updated weights for policy 0, policy_version 1378454 (0.0006) [2023-12-26 10:35:57,030][123091] Updated weights for policy 0, policy_version 1378464 (0.0006) [2023-12-26 10:35:57,083][123091] Updated weights for policy 0, policy_version 1378475 (0.0010) [2023-12-26 10:35:57,135][123090] Updated weights for policy 1, policy_version 1368839 (0.0007) [2023-12-26 10:35:57,187][123090] Updated weights for policy 1, policy_version 1368849 (0.0009) [2023-12-26 10:35:57,242][123090] Updated weights for policy 1, policy_version 1368859 (0.0010) [2023-12-26 10:35:57,839][123091] Updated weights for policy 0, policy_version 1378485 (0.0007) [2023-12-26 10:35:57,888][123091] Updated weights for policy 0, policy_version 1378495 (0.0005) [2023-12-26 10:35:57,922][123090] Updated weights for policy 1, policy_version 1368869 (0.0008) [2023-12-26 10:35:57,934][123091] Updated weights for policy 0, policy_version 1378505 (0.0005) [2023-12-26 10:35:57,972][123090] Updated weights for policy 1, policy_version 1368879 (0.0005) [2023-12-26 10:35:58,026][123090] Updated weights for policy 1, policy_version 1368889 (0.0006) [2023-12-26 10:35:58,673][123091] Updated weights for policy 0, policy_version 1378515 (0.0007) [2023-12-26 10:35:58,744][123091] Updated weights for policy 0, policy_version 1378525 (0.0010) [2023-12-26 10:35:58,786][121949] Fps is (10 sec: 18018.9, 60 sec: 17612.2, 300 sec: 17772.4). Total num frames: 703340544. Throughput: 0: 8960.4, 1: 8918.9. Samples: 703339424. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:35:58,790][121949] Avg episode reward: [(0, '6353.308'), (1, '5946.694')] [2023-12-26 10:35:58,817][123091] Updated weights for policy 0, policy_version 1378535 (0.0009) [2023-12-26 10:35:58,820][123090] Updated weights for policy 1, policy_version 1368899 (0.0008) [2023-12-26 10:35:58,897][123090] Updated weights for policy 1, policy_version 1368909 (0.0009) [2023-12-26 10:35:58,954][123090] Updated weights for policy 1, policy_version 1368919 (0.0008) [2023-12-26 10:35:59,689][123091] Updated weights for policy 0, policy_version 1378545 (0.0009) [2023-12-26 10:35:59,752][123091] Updated weights for policy 0, policy_version 1378555 (0.0009) [2023-12-26 10:35:59,803][123090] Updated weights for policy 1, policy_version 1368929 (0.0007) [2023-12-26 10:35:59,813][123091] Updated weights for policy 0, policy_version 1378565 (0.0009) [2023-12-26 10:35:59,872][123090] Updated weights for policy 1, policy_version 1368939 (0.0008) [2023-12-26 10:35:59,882][123091] Updated weights for policy 0, policy_version 1378575 (0.0010) [2023-12-26 10:35:59,934][123090] Updated weights for policy 1, policy_version 1368949 (0.0007) [2023-12-26 10:36:00,004][123090] Updated weights for policy 1, policy_version 1368959 (0.0006) [2023-12-26 10:36:00,653][123091] Updated weights for policy 0, policy_version 1378585 (0.0009) [2023-12-26 10:36:00,678][123090] Updated weights for policy 1, policy_version 1368969 (0.0006) [2023-12-26 10:36:00,701][123091] Updated weights for policy 0, policy_version 1378595 (0.0008) [2023-12-26 10:36:00,725][123090] Updated weights for policy 1, policy_version 1368979 (0.0005) [2023-12-26 10:36:00,760][123091] Updated weights for policy 0, policy_version 1378605 (0.0010) [2023-12-26 10:36:00,774][123090] Updated weights for policy 1, policy_version 1368989 (0.0005) [2023-12-26 10:36:01,524][123090] Updated weights for policy 1, policy_version 1368999 (0.0009) [2023-12-26 10:36:01,572][123090] Updated weights for policy 1, policy_version 1369009 (0.0009) [2023-12-26 10:36:01,610][123091] Updated weights for policy 0, policy_version 1378615 (0.0008) [2023-12-26 10:36:01,626][123090] Updated weights for policy 1, policy_version 1369019 (0.0008) [2023-12-26 10:36:01,671][123091] Updated weights for policy 0, policy_version 1378625 (0.0009) [2023-12-26 10:36:01,737][123091] Updated weights for policy 0, policy_version 1378635 (0.0010) [2023-12-26 10:36:02,344][123090] Updated weights for policy 1, policy_version 1369029 (0.0009) [2023-12-26 10:36:02,416][123090] Updated weights for policy 1, policy_version 1369039 (0.0009) [2023-12-26 10:36:02,472][123090] Updated weights for policy 1, policy_version 1369049 (0.0008) [2023-12-26 10:36:02,593][123091] Updated weights for policy 0, policy_version 1378645 (0.0010) [2023-12-26 10:36:02,660][123091] Updated weights for policy 0, policy_version 1378655 (0.0010) [2023-12-26 10:36:02,709][123091] Updated weights for policy 0, policy_version 1378665 (0.0009) [2023-12-26 10:36:03,251][123090] Updated weights for policy 1, policy_version 1369059 (0.0007) [2023-12-26 10:36:03,302][123090] Updated weights for policy 1, policy_version 1369069 (0.0006) [2023-12-26 10:36:03,352][123090] Updated weights for policy 1, policy_version 1369079 (0.0009) [2023-12-26 10:36:03,423][123091] Updated weights for policy 0, policy_version 1378675 (0.0008) [2023-12-26 10:36:03,479][123091] Updated weights for policy 0, policy_version 1378685 (0.0005) [2023-12-26 10:36:03,541][123091] Updated weights for policy 0, policy_version 1378695 (0.0005) [2023-12-26 10:36:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 703438848. Throughput: 0: 8859.1, 1: 8940.3. Samples: 703446740. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:03,785][121949] Avg episode reward: [(0, '6370.183'), (1, '5897.585')] [2023-12-26 10:36:04,249][123090] Updated weights for policy 1, policy_version 1369089 (0.0009) [2023-12-26 10:36:04,315][123090] Updated weights for policy 1, policy_version 1369099 (0.0006) [2023-12-26 10:36:04,325][123091] Updated weights for policy 0, policy_version 1378705 (0.0007) [2023-12-26 10:36:04,380][123090] Updated weights for policy 1, policy_version 1369109 (0.0007) [2023-12-26 10:36:04,393][123091] Updated weights for policy 0, policy_version 1378715 (0.0008) [2023-12-26 10:36:04,446][123090] Updated weights for policy 1, policy_version 1369119 (0.0007) [2023-12-26 10:36:04,458][123091] Updated weights for policy 0, policy_version 1378725 (0.0009) [2023-12-26 10:36:04,520][123091] Updated weights for policy 0, policy_version 1378735 (0.0009) [2023-12-26 10:36:05,213][123091] Updated weights for policy 0, policy_version 1378745 (0.0006) [2023-12-26 10:36:05,232][123090] Updated weights for policy 1, policy_version 1369129 (0.0009) [2023-12-26 10:36:05,261][123091] Updated weights for policy 0, policy_version 1378755 (0.0005) [2023-12-26 10:36:05,290][123090] Updated weights for policy 1, policy_version 1369139 (0.0009) [2023-12-26 10:36:05,309][123091] Updated weights for policy 0, policy_version 1378765 (0.0005) [2023-12-26 10:36:05,341][123090] Updated weights for policy 1, policy_version 1369149 (0.0009) [2023-12-26 10:36:06,050][123091] Updated weights for policy 0, policy_version 1378775 (0.0007) [2023-12-26 10:36:06,115][123091] Updated weights for policy 0, policy_version 1378785 (0.0006) [2023-12-26 10:36:06,189][123091] Updated weights for policy 0, policy_version 1378795 (0.0006) [2023-12-26 10:36:06,225][123090] Updated weights for policy 1, policy_version 1369159 (0.0006) [2023-12-26 10:36:06,279][123090] Updated weights for policy 1, policy_version 1369169 (0.0006) [2023-12-26 10:36:06,343][123090] Updated weights for policy 1, policy_version 1369179 (0.0007) [2023-12-26 10:36:06,991][123091] Updated weights for policy 0, policy_version 1378805 (0.0007) [2023-12-26 10:36:07,048][123091] Updated weights for policy 0, policy_version 1378815 (0.0009) [2023-12-26 10:36:07,117][123091] Updated weights for policy 0, policy_version 1378825 (0.0009) [2023-12-26 10:36:07,127][123090] Updated weights for policy 1, policy_version 1369189 (0.0008) [2023-12-26 10:36:07,191][123090] Updated weights for policy 1, policy_version 1369199 (0.0011) [2023-12-26 10:36:07,254][123090] Updated weights for policy 1, policy_version 1369209 (0.0010) [2023-12-26 10:36:07,958][123090] Updated weights for policy 1, policy_version 1369219 (0.0010) [2023-12-26 10:36:07,977][123091] Updated weights for policy 0, policy_version 1378835 (0.0006) [2023-12-26 10:36:08,009][123090] Updated weights for policy 1, policy_version 1369229 (0.0009) [2023-12-26 10:36:08,035][123091] Updated weights for policy 0, policy_version 1378845 (0.0009) [2023-12-26 10:36:08,063][123090] Updated weights for policy 1, policy_version 1369239 (0.0008) [2023-12-26 10:36:08,088][123091] Updated weights for policy 0, policy_version 1378855 (0.0005) [2023-12-26 10:36:08,778][123090] Updated weights for policy 1, policy_version 1369249 (0.0005) [2023-12-26 10:36:08,784][121949] Fps is (10 sec: 18025.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 703520768. Throughput: 0: 8916.5, 1: 8963.3. Samples: 703500300. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:08,785][121949] Avg episode reward: [(0, '6401.545'), (1, '5912.491')] [2023-12-26 10:36:08,799][123091] Updated weights for policy 0, policy_version 1378865 (0.0005) [2023-12-26 10:36:08,855][123090] Updated weights for policy 1, policy_version 1369259 (0.0008) [2023-12-26 10:36:08,862][123091] Updated weights for policy 0, policy_version 1378875 (0.0010) [2023-12-26 10:36:08,925][123091] Updated weights for policy 0, policy_version 1378885 (0.0008) [2023-12-26 10:36:08,926][123090] Updated weights for policy 1, policy_version 1369269 (0.0008) [2023-12-26 10:36:08,979][123090] Updated weights for policy 1, policy_version 1369279 (0.0007) [2023-12-26 10:36:08,983][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001369280_350535680.pth... [2023-12-26 10:36:08,986][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001368224_350265344.pth [2023-12-26 10:36:08,995][123091] Updated weights for policy 0, policy_version 1378895 (0.0009) [2023-12-26 10:36:09,000][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001378896_353001472.pth... [2023-12-26 10:36:09,005][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001377840_352731136.pth [2023-12-26 10:36:09,780][123090] Updated weights for policy 1, policy_version 1369289 (0.0009) [2023-12-26 10:36:09,843][123090] Updated weights for policy 1, policy_version 1369299 (0.0007) [2023-12-26 10:36:09,862][123091] Updated weights for policy 0, policy_version 1378905 (0.0009) [2023-12-26 10:36:09,912][123090] Updated weights for policy 1, policy_version 1369309 (0.0008) [2023-12-26 10:36:09,929][123091] Updated weights for policy 0, policy_version 1378915 (0.0009) [2023-12-26 10:36:09,999][123091] Updated weights for policy 0, policy_version 1378925 (0.0009) [2023-12-26 10:36:10,731][123090] Updated weights for policy 1, policy_version 1369319 (0.0010) [2023-12-26 10:36:10,793][123090] Updated weights for policy 1, policy_version 1369329 (0.0010) [2023-12-26 10:36:10,835][123091] Updated weights for policy 0, policy_version 1378935 (0.0007) [2023-12-26 10:36:10,862][123090] Updated weights for policy 1, policy_version 1369339 (0.0010) [2023-12-26 10:36:10,914][123091] Updated weights for policy 0, policy_version 1378945 (0.0009) [2023-12-26 10:36:10,974][123091] Updated weights for policy 0, policy_version 1378955 (0.0010) [2023-12-26 10:36:11,677][123090] Updated weights for policy 1, policy_version 1369349 (0.0010) [2023-12-26 10:36:11,745][123090] Updated weights for policy 1, policy_version 1369359 (0.0009) [2023-12-26 10:36:11,815][123090] Updated weights for policy 1, policy_version 1369369 (0.0008) [2023-12-26 10:36:11,882][123091] Updated weights for policy 0, policy_version 1378965 (0.0010) [2023-12-26 10:36:11,942][123091] Updated weights for policy 0, policy_version 1378975 (0.0009) [2023-12-26 10:36:12,012][123091] Updated weights for policy 0, policy_version 1378985 (0.0010) [2023-12-26 10:36:12,665][123090] Updated weights for policy 1, policy_version 1369379 (0.0008) [2023-12-26 10:36:12,730][123090] Updated weights for policy 1, policy_version 1369389 (0.0009) [2023-12-26 10:36:12,792][123091] Updated weights for policy 0, policy_version 1378995 (0.0010) [2023-12-26 10:36:12,793][123090] Updated weights for policy 1, policy_version 1369399 (0.0009) [2023-12-26 10:36:12,859][123091] Updated weights for policy 0, policy_version 1379005 (0.0009) [2023-12-26 10:36:12,926][123091] Updated weights for policy 0, policy_version 1379015 (0.0010) [2023-12-26 10:36:13,586][123090] Updated weights for policy 1, policy_version 1369409 (0.0008) [2023-12-26 10:36:13,653][123090] Updated weights for policy 1, policy_version 1369419 (0.0010) [2023-12-26 10:36:13,718][123090] Updated weights for policy 1, policy_version 1369429 (0.0010) [2023-12-26 10:36:13,745][123091] Updated weights for policy 0, policy_version 1379025 (0.0009) [2023-12-26 10:36:13,784][123090] Updated weights for policy 1, policy_version 1369439 (0.0010) [2023-12-26 10:36:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 703602688. Throughput: 0: 8810.0, 1: 8941.0. Samples: 703603476. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:13,785][121949] Avg episode reward: [(0, '6401.540'), (1, '5917.254')] [2023-12-26 10:36:13,806][123091] Updated weights for policy 0, policy_version 1379035 (0.0009) [2023-12-26 10:36:13,859][123091] Updated weights for policy 0, policy_version 1379045 (0.0009) [2023-12-26 10:36:13,919][123091] Updated weights for policy 0, policy_version 1379055 (0.0009) [2023-12-26 10:36:14,542][123090] Updated weights for policy 1, policy_version 1369449 (0.0010) [2023-12-26 10:36:14,593][123090] Updated weights for policy 1, policy_version 1369459 (0.0010) [2023-12-26 10:36:14,619][123091] Updated weights for policy 0, policy_version 1379065 (0.0006) [2023-12-26 10:36:14,649][123090] Updated weights for policy 1, policy_version 1369469 (0.0010) [2023-12-26 10:36:14,667][123091] Updated weights for policy 0, policy_version 1379075 (0.0005) [2023-12-26 10:36:14,712][123091] Updated weights for policy 0, policy_version 1379085 (0.0005) [2023-12-26 10:36:15,471][123091] Updated weights for policy 0, policy_version 1379095 (0.0009) [2023-12-26 10:36:15,496][123090] Updated weights for policy 1, policy_version 1369479 (0.0010) [2023-12-26 10:36:15,540][123091] Updated weights for policy 0, policy_version 1379105 (0.0011) [2023-12-26 10:36:15,560][123090] Updated weights for policy 1, policy_version 1369489 (0.0011) [2023-12-26 10:36:15,599][123091] Updated weights for policy 0, policy_version 1379115 (0.0011) [2023-12-26 10:36:15,623][123090] Updated weights for policy 1, policy_version 1369499 (0.0010) [2023-12-26 10:36:16,418][123091] Updated weights for policy 0, policy_version 1379125 (0.0008) [2023-12-26 10:36:16,468][123091] Updated weights for policy 0, policy_version 1379135 (0.0005) [2023-12-26 10:36:16,468][123090] Updated weights for policy 1, policy_version 1369509 (0.0010) [2023-12-26 10:36:16,516][123091] Updated weights for policy 0, policy_version 1379145 (0.0010) [2023-12-26 10:36:16,532][123090] Updated weights for policy 1, policy_version 1369519 (0.0008) [2023-12-26 10:36:16,583][123090] Updated weights for policy 1, policy_version 1369529 (0.0007) [2023-12-26 10:36:17,333][123090] Updated weights for policy 1, policy_version 1369539 (0.0009) [2023-12-26 10:36:17,370][123091] Updated weights for policy 0, policy_version 1379155 (0.0009) [2023-12-26 10:36:17,380][123090] Updated weights for policy 1, policy_version 1369549 (0.0010) [2023-12-26 10:36:17,417][123091] Updated weights for policy 0, policy_version 1379165 (0.0005) [2023-12-26 10:36:17,428][123090] Updated weights for policy 1, policy_version 1369559 (0.0010) [2023-12-26 10:36:17,464][123091] Updated weights for policy 0, policy_version 1379175 (0.0005) [2023-12-26 10:36:18,240][123090] Updated weights for policy 1, policy_version 1369569 (0.0010) [2023-12-26 10:36:18,270][123091] Updated weights for policy 0, policy_version 1379185 (0.0005) [2023-12-26 10:36:18,302][123090] Updated weights for policy 1, policy_version 1369579 (0.0010) [2023-12-26 10:36:18,330][123091] Updated weights for policy 0, policy_version 1379195 (0.0007) [2023-12-26 10:36:18,368][123090] Updated weights for policy 1, policy_version 1369589 (0.0008) [2023-12-26 10:36:18,399][123091] Updated weights for policy 0, policy_version 1379205 (0.0008) [2023-12-26 10:36:18,427][123090] Updated weights for policy 1, policy_version 1369599 (0.0005) [2023-12-26 10:36:18,467][123091] Updated weights for policy 0, policy_version 1379215 (0.0010) [2023-12-26 10:36:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 703700992. Throughput: 0: 8755.4, 1: 8907.1. Samples: 703710180. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:18,784][121949] Avg episode reward: [(0, '6370.846'), (1, '5860.334')] [2023-12-26 10:36:19,209][123090] Updated weights for policy 1, policy_version 1369609 (0.0005) [2023-12-26 10:36:19,284][123090] Updated weights for policy 1, policy_version 1369619 (0.0008) [2023-12-26 10:36:19,291][123091] Updated weights for policy 0, policy_version 1379225 (0.0009) [2023-12-26 10:36:19,355][123090] Updated weights for policy 1, policy_version 1369629 (0.0009) [2023-12-26 10:36:19,359][123091] Updated weights for policy 0, policy_version 1379235 (0.0008) [2023-12-26 10:36:19,421][123091] Updated weights for policy 0, policy_version 1379245 (0.0008) [2023-12-26 10:36:20,213][123090] Updated weights for policy 1, policy_version 1369639 (0.0009) [2023-12-26 10:36:20,243][123091] Updated weights for policy 0, policy_version 1379255 (0.0010) [2023-12-26 10:36:20,278][123090] Updated weights for policy 1, policy_version 1369649 (0.0010) [2023-12-26 10:36:20,304][123091] Updated weights for policy 0, policy_version 1379265 (0.0011) [2023-12-26 10:36:20,337][123090] Updated weights for policy 1, policy_version 1369659 (0.0008) [2023-12-26 10:36:20,369][123091] Updated weights for policy 0, policy_version 1379275 (0.0010) [2023-12-26 10:36:21,200][123090] Updated weights for policy 1, policy_version 1369669 (0.0007) [2023-12-26 10:36:21,207][123091] Updated weights for policy 0, policy_version 1379285 (0.0010) [2023-12-26 10:36:21,261][123090] Updated weights for policy 1, policy_version 1369679 (0.0006) [2023-12-26 10:36:21,271][123091] Updated weights for policy 0, policy_version 1379295 (0.0011) [2023-12-26 10:36:21,317][123090] Updated weights for policy 1, policy_version 1369689 (0.0008) [2023-12-26 10:36:21,323][123091] Updated weights for policy 0, policy_version 1379305 (0.0011) [2023-12-26 10:36:22,164][123090] Updated weights for policy 1, policy_version 1369699 (0.0007) [2023-12-26 10:36:22,202][123091] Updated weights for policy 0, policy_version 1379315 (0.0010) [2023-12-26 10:36:22,234][123090] Updated weights for policy 1, policy_version 1369709 (0.0006) [2023-12-26 10:36:22,266][123091] Updated weights for policy 0, policy_version 1379325 (0.0008) [2023-12-26 10:36:22,318][123090] Updated weights for policy 1, policy_version 1369719 (0.0008) [2023-12-26 10:36:22,335][123091] Updated weights for policy 0, policy_version 1379335 (0.0006) [2023-12-26 10:36:23,107][123090] Updated weights for policy 1, policy_version 1369729 (0.0009) [2023-12-26 10:36:23,115][123091] Updated weights for policy 0, policy_version 1379345 (0.0010) [2023-12-26 10:36:23,166][123090] Updated weights for policy 1, policy_version 1369739 (0.0008) [2023-12-26 10:36:23,168][123091] Updated weights for policy 0, policy_version 1379355 (0.0011) [2023-12-26 10:36:23,223][123090] Updated weights for policy 1, policy_version 1369749 (0.0007) [2023-12-26 10:36:23,228][123091] Updated weights for policy 0, policy_version 1379365 (0.0010) [2023-12-26 10:36:23,270][123090] Updated weights for policy 1, policy_version 1369759 (0.0008) [2023-12-26 10:36:23,276][123091] Updated weights for policy 0, policy_version 1379375 (0.0010) [2023-12-26 10:36:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 703782912. Throughput: 0: 8741.1, 1: 8859.0. Samples: 703760280. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:23,785][121949] Avg episode reward: [(0, '6412.700'), (1, '5914.484')] [2023-12-26 10:36:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001369760_350658560.pth... [2023-12-26 10:36:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001379376_353124352.pth... [2023-12-26 10:36:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001368736_350396416.pth [2023-12-26 10:36:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001378352_352862208.pth [2023-12-26 10:36:24,069][123090] Updated weights for policy 1, policy_version 1369769 (0.0006) [2023-12-26 10:36:24,123][123091] Updated weights for policy 0, policy_version 1379385 (0.0010) [2023-12-26 10:36:24,134][123090] Updated weights for policy 1, policy_version 1369779 (0.0008) [2023-12-26 10:36:24,181][123091] Updated weights for policy 0, policy_version 1379395 (0.0010) [2023-12-26 10:36:24,199][123090] Updated weights for policy 1, policy_version 1369789 (0.0008) [2023-12-26 10:36:24,240][123091] Updated weights for policy 0, policy_version 1379405 (0.0011) [2023-12-26 10:36:24,855][123090] Updated weights for policy 1, policy_version 1369799 (0.0006) [2023-12-26 10:36:24,909][123090] Updated weights for policy 1, policy_version 1369809 (0.0005) [2023-12-26 10:36:24,968][123090] Updated weights for policy 1, policy_version 1369819 (0.0006) [2023-12-26 10:36:25,009][123091] Updated weights for policy 0, policy_version 1379415 (0.0007) [2023-12-26 10:36:25,060][123091] Updated weights for policy 0, policy_version 1379425 (0.0010) [2023-12-26 10:36:25,108][123091] Updated weights for policy 0, policy_version 1379435 (0.0010) [2023-12-26 10:36:25,702][123090] Updated weights for policy 1, policy_version 1369829 (0.0008) [2023-12-26 10:36:25,749][123090] Updated weights for policy 1, policy_version 1369839 (0.0010) [2023-12-26 10:36:25,805][123090] Updated weights for policy 1, policy_version 1369849 (0.0010) [2023-12-26 10:36:25,842][123091] Updated weights for policy 0, policy_version 1379445 (0.0008) [2023-12-26 10:36:25,907][123091] Updated weights for policy 0, policy_version 1379455 (0.0005) [2023-12-26 10:36:25,960][123091] Updated weights for policy 0, policy_version 1379465 (0.0005) [2023-12-26 10:36:26,615][123091] Updated weights for policy 0, policy_version 1379475 (0.0006) [2023-12-26 10:36:26,638][123090] Updated weights for policy 1, policy_version 1369859 (0.0010) [2023-12-26 10:36:26,674][123091] Updated weights for policy 0, policy_version 1379485 (0.0005) [2023-12-26 10:36:26,694][123090] Updated weights for policy 1, policy_version 1369869 (0.0010) [2023-12-26 10:36:26,730][123091] Updated weights for policy 0, policy_version 1379495 (0.0005) [2023-12-26 10:36:26,760][123090] Updated weights for policy 1, policy_version 1369879 (0.0010) [2023-12-26 10:36:27,351][123091] Updated weights for policy 0, policy_version 1379505 (0.0006) [2023-12-26 10:36:27,402][123091] Updated weights for policy 0, policy_version 1379515 (0.0010) [2023-12-26 10:36:27,464][123091] Updated weights for policy 0, policy_version 1379525 (0.0010) [2023-12-26 10:36:27,510][123091] Updated weights for policy 0, policy_version 1379535 (0.0010) [2023-12-26 10:36:27,581][123090] Updated weights for policy 1, policy_version 1369889 (0.0010) [2023-12-26 10:36:27,629][123090] Updated weights for policy 1, policy_version 1369899 (0.0008) [2023-12-26 10:36:27,679][123090] Updated weights for policy 1, policy_version 1369910 (0.0009) [2023-12-26 10:36:27,733][123090] Updated weights for policy 1, policy_version 1369920 (0.0010) [2023-12-26 10:36:28,248][123091] Updated weights for policy 0, policy_version 1379545 (0.0010) [2023-12-26 10:36:28,291][123091] Updated weights for policy 0, policy_version 1379555 (0.0010) [2023-12-26 10:36:28,347][123091] Updated weights for policy 0, policy_version 1379565 (0.0010) [2023-12-26 10:36:28,569][123090] Updated weights for policy 1, policy_version 1369930 (0.0008) [2023-12-26 10:36:28,640][123090] Updated weights for policy 1, policy_version 1369940 (0.0006) [2023-12-26 10:36:28,707][123090] Updated weights for policy 1, policy_version 1369950 (0.0005) [2023-12-26 10:36:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 703881216. Throughput: 0: 8859.4, 1: 8922.0. Samples: 703871348. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:28,785][121949] Avg episode reward: [(0, '6340.947'), (1, '5975.897')] [2023-12-26 10:36:29,170][123091] Updated weights for policy 0, policy_version 1379575 (0.0010) [2023-12-26 10:36:29,226][123091] Updated weights for policy 0, policy_version 1379585 (0.0010) [2023-12-26 10:36:29,290][123091] Updated weights for policy 0, policy_version 1379595 (0.0007) [2023-12-26 10:36:29,369][123090] Updated weights for policy 1, policy_version 1369960 (0.0008) [2023-12-26 10:36:29,433][123090] Updated weights for policy 1, policy_version 1369970 (0.0011) [2023-12-26 10:36:29,492][123090] Updated weights for policy 1, policy_version 1369980 (0.0010) [2023-12-26 10:36:30,055][123091] Updated weights for policy 0, policy_version 1379605 (0.0008) [2023-12-26 10:36:30,114][123091] Updated weights for policy 0, policy_version 1379615 (0.0009) [2023-12-26 10:36:30,165][123091] Updated weights for policy 0, policy_version 1379625 (0.0010) [2023-12-26 10:36:30,278][123090] Updated weights for policy 1, policy_version 1369990 (0.0010) [2023-12-26 10:36:30,327][123090] Updated weights for policy 1, policy_version 1370000 (0.0011) [2023-12-26 10:36:30,382][123090] Updated weights for policy 1, policy_version 1370010 (0.0011) [2023-12-26 10:36:31,075][123090] Updated weights for policy 1, policy_version 1370020 (0.0007) [2023-12-26 10:36:31,105][123091] Updated weights for policy 0, policy_version 1379635 (0.0009) [2023-12-26 10:36:31,148][123090] Updated weights for policy 1, policy_version 1370030 (0.0010) [2023-12-26 10:36:31,172][123091] Updated weights for policy 0, policy_version 1379645 (0.0007) [2023-12-26 10:36:31,208][123090] Updated weights for policy 1, policy_version 1370040 (0.0011) [2023-12-26 10:36:31,236][123091] Updated weights for policy 0, policy_version 1379655 (0.0006) [2023-12-26 10:36:32,034][123090] Updated weights for policy 1, policy_version 1370050 (0.0012) [2023-12-26 10:36:32,066][123091] Updated weights for policy 0, policy_version 1379665 (0.0008) [2023-12-26 10:36:32,090][123090] Updated weights for policy 1, policy_version 1370060 (0.0008) [2023-12-26 10:36:32,129][123091] Updated weights for policy 0, policy_version 1379675 (0.0007) [2023-12-26 10:36:32,143][123090] Updated weights for policy 1, policy_version 1370070 (0.0006) [2023-12-26 10:36:32,186][123091] Updated weights for policy 0, policy_version 1379685 (0.0009) [2023-12-26 10:36:32,190][123090] Updated weights for policy 1, policy_version 1370080 (0.0005) [2023-12-26 10:36:32,247][123091] Updated weights for policy 0, policy_version 1379695 (0.0010) [2023-12-26 10:36:32,924][123090] Updated weights for policy 1, policy_version 1370090 (0.0008) [2023-12-26 10:36:32,973][123090] Updated weights for policy 1, policy_version 1370100 (0.0009) [2023-12-26 10:36:33,027][123090] Updated weights for policy 1, policy_version 1370110 (0.0009) [2023-12-26 10:36:33,040][123091] Updated weights for policy 0, policy_version 1379705 (0.0008) [2023-12-26 10:36:33,095][123091] Updated weights for policy 0, policy_version 1379715 (0.0009) [2023-12-26 10:36:33,157][123091] Updated weights for policy 0, policy_version 1379725 (0.0009) [2023-12-26 10:36:33,771][123090] Updated weights for policy 1, policy_version 1370120 (0.0008) [2023-12-26 10:36:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 703963136. Throughput: 0: 8870.5, 1: 8928.8. Samples: 703979172. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:33,785][121949] Avg episode reward: [(0, '6320.535'), (1, '5927.529')] [2023-12-26 10:36:33,822][123090] Updated weights for policy 1, policy_version 1370130 (0.0008) [2023-12-26 10:36:33,874][123090] Updated weights for policy 1, policy_version 1370140 (0.0009) [2023-12-26 10:36:34,044][123091] Updated weights for policy 0, policy_version 1379735 (0.0010) [2023-12-26 10:36:34,098][123091] Updated weights for policy 0, policy_version 1379745 (0.0010) [2023-12-26 10:36:34,153][123091] Updated weights for policy 0, policy_version 1379755 (0.0010) [2023-12-26 10:36:34,711][123090] Updated weights for policy 1, policy_version 1370150 (0.0008) [2023-12-26 10:36:34,758][123090] Updated weights for policy 1, policy_version 1370160 (0.0009) [2023-12-26 10:36:34,818][123090] Updated weights for policy 1, policy_version 1370170 (0.0009) [2023-12-26 10:36:34,972][123091] Updated weights for policy 0, policy_version 1379765 (0.0011) [2023-12-26 10:36:35,039][123091] Updated weights for policy 0, policy_version 1379775 (0.0011) [2023-12-26 10:36:35,100][123091] Updated weights for policy 0, policy_version 1379785 (0.0010) [2023-12-26 10:36:35,626][123090] Updated weights for policy 1, policy_version 1370180 (0.0009) [2023-12-26 10:36:35,677][123090] Updated weights for policy 1, policy_version 1370190 (0.0009) [2023-12-26 10:36:35,739][123090] Updated weights for policy 1, policy_version 1370200 (0.0005) [2023-12-26 10:36:35,773][123091] Updated weights for policy 0, policy_version 1379795 (0.0006) [2023-12-26 10:36:35,828][123091] Updated weights for policy 0, policy_version 1379805 (0.0005) [2023-12-26 10:36:35,876][123091] Updated weights for policy 0, policy_version 1379815 (0.0005) [2023-12-26 10:36:36,481][123090] Updated weights for policy 1, policy_version 1370210 (0.0006) [2023-12-26 10:36:36,551][123090] Updated weights for policy 1, policy_version 1370220 (0.0009) [2023-12-26 10:36:36,619][123090] Updated weights for policy 1, policy_version 1370230 (0.0009) [2023-12-26 10:36:36,685][123090] Updated weights for policy 1, policy_version 1370240 (0.0009) [2023-12-26 10:36:36,726][123091] Updated weights for policy 0, policy_version 1379825 (0.0007) [2023-12-26 10:36:36,788][123091] Updated weights for policy 0, policy_version 1379835 (0.0008) [2023-12-26 10:36:36,846][123091] Updated weights for policy 0, policy_version 1379845 (0.0010) [2023-12-26 10:36:36,899][123091] Updated weights for policy 0, policy_version 1379855 (0.0009) [2023-12-26 10:36:37,496][123090] Updated weights for policy 1, policy_version 1370250 (0.0009) [2023-12-26 10:36:37,545][123090] Updated weights for policy 1, policy_version 1370260 (0.0009) [2023-12-26 10:36:37,609][123090] Updated weights for policy 1, policy_version 1370270 (0.0006) [2023-12-26 10:36:37,737][123091] Updated weights for policy 0, policy_version 1379865 (0.0006) [2023-12-26 10:36:37,809][123091] Updated weights for policy 0, policy_version 1379875 (0.0007) [2023-12-26 10:36:37,868][123091] Updated weights for policy 0, policy_version 1379885 (0.0011) [2023-12-26 10:36:38,347][123090] Updated weights for policy 1, policy_version 1370280 (0.0008) [2023-12-26 10:36:38,404][123090] Updated weights for policy 1, policy_version 1370290 (0.0009) [2023-12-26 10:36:38,463][123090] Updated weights for policy 1, policy_version 1370300 (0.0009) [2023-12-26 10:36:38,602][123091] Updated weights for policy 0, policy_version 1379895 (0.0007) [2023-12-26 10:36:38,658][123091] Updated weights for policy 0, policy_version 1379905 (0.0006) [2023-12-26 10:36:38,715][123091] Updated weights for policy 0, policy_version 1379915 (0.0006) [2023-12-26 10:36:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 704061440. Throughput: 0: 8898.4, 1: 8949.4. Samples: 704032912. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:38,785][121949] Avg episode reward: [(0, '6367.576'), (1, '5929.966')] [2023-12-26 10:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001379920_353263616.pth... [2023-12-26 10:36:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001370304_350797824.pth... [2023-12-26 10:36:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001369280_350535680.pth [2023-12-26 10:36:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001378896_353001472.pth [2023-12-26 10:36:39,201][123090] Updated weights for policy 1, policy_version 1370310 (0.0007) [2023-12-26 10:36:39,273][123090] Updated weights for policy 1, policy_version 1370320 (0.0008) [2023-12-26 10:36:39,340][123090] Updated weights for policy 1, policy_version 1370330 (0.0008) [2023-12-26 10:36:39,497][123091] Updated weights for policy 0, policy_version 1379925 (0.0008) [2023-12-26 10:36:39,560][123091] Updated weights for policy 0, policy_version 1379935 (0.0010) [2023-12-26 10:36:39,628][123091] Updated weights for policy 0, policy_version 1379945 (0.0010) [2023-12-26 10:36:40,179][123090] Updated weights for policy 1, policy_version 1370340 (0.0009) [2023-12-26 10:36:40,241][123090] Updated weights for policy 1, policy_version 1370350 (0.0010) [2023-12-26 10:36:40,306][123090] Updated weights for policy 1, policy_version 1370360 (0.0009) [2023-12-26 10:36:40,500][123091] Updated weights for policy 0, policy_version 1379955 (0.0010) [2023-12-26 10:36:40,560][123091] Updated weights for policy 0, policy_version 1379965 (0.0009) [2023-12-26 10:36:40,612][123091] Updated weights for policy 0, policy_version 1379975 (0.0009) [2023-12-26 10:36:41,167][123090] Updated weights for policy 1, policy_version 1370370 (0.0010) [2023-12-26 10:36:41,227][123090] Updated weights for policy 1, policy_version 1370380 (0.0008) [2023-12-26 10:36:41,297][123090] Updated weights for policy 1, policy_version 1370390 (0.0009) [2023-12-26 10:36:41,370][123090] Updated weights for policy 1, policy_version 1370400 (0.0010) [2023-12-26 10:36:41,486][123091] Updated weights for policy 0, policy_version 1379985 (0.0009) [2023-12-26 10:36:41,556][123091] Updated weights for policy 0, policy_version 1379995 (0.0009) [2023-12-26 10:36:41,618][123091] Updated weights for policy 0, policy_version 1380005 (0.0010) [2023-12-26 10:36:41,691][123091] Updated weights for policy 0, policy_version 1380015 (0.0010) [2023-12-26 10:36:42,210][123090] Updated weights for policy 1, policy_version 1370410 (0.0006) [2023-12-26 10:36:42,282][123090] Updated weights for policy 1, policy_version 1370420 (0.0007) [2023-12-26 10:36:42,341][123090] Updated weights for policy 1, policy_version 1370430 (0.0008) [2023-12-26 10:36:42,562][123091] Updated weights for policy 0, policy_version 1380025 (0.0009) [2023-12-26 10:36:42,617][123091] Updated weights for policy 0, policy_version 1380035 (0.0009) [2023-12-26 10:36:42,669][123091] Updated weights for policy 0, policy_version 1380045 (0.0009) [2023-12-26 10:36:43,104][123090] Updated weights for policy 1, policy_version 1370440 (0.0010) [2023-12-26 10:36:43,156][123090] Updated weights for policy 1, policy_version 1370450 (0.0010) [2023-12-26 10:36:43,200][123090] Updated weights for policy 1, policy_version 1370460 (0.0010) [2023-12-26 10:36:43,564][123091] Updated weights for policy 0, policy_version 1380055 (0.0010) [2023-12-26 10:36:43,619][123091] Updated weights for policy 0, policy_version 1380065 (0.0010) [2023-12-26 10:36:43,681][123091] Updated weights for policy 0, policy_version 1380075 (0.0008) [2023-12-26 10:36:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 704143360. Throughput: 0: 8811.5, 1: 8903.6. Samples: 704136572. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:43,785][121949] Avg episode reward: [(0, '6392.475'), (1, '5928.639')] [2023-12-26 10:36:43,963][123090] Updated weights for policy 1, policy_version 1370470 (0.0010) [2023-12-26 10:36:44,010][123090] Updated weights for policy 1, policy_version 1370480 (0.0010) [2023-12-26 10:36:44,053][123090] Updated weights for policy 1, policy_version 1370490 (0.0009) [2023-12-26 10:36:44,580][123091] Updated weights for policy 0, policy_version 1380085 (0.0009) [2023-12-26 10:36:44,639][123091] Updated weights for policy 0, policy_version 1380095 (0.0010) [2023-12-26 10:36:44,694][123091] Updated weights for policy 0, policy_version 1380106 (0.0011) [2023-12-26 10:36:44,758][123090] Updated weights for policy 1, policy_version 1370500 (0.0006) [2023-12-26 10:36:44,833][123090] Updated weights for policy 1, policy_version 1370510 (0.0009) [2023-12-26 10:36:44,905][123090] Updated weights for policy 1, policy_version 1370520 (0.0011) [2023-12-26 10:36:45,595][123091] Updated weights for policy 0, policy_version 1380117 (0.0010) [2023-12-26 10:36:45,648][123090] Updated weights for policy 1, policy_version 1370530 (0.0008) [2023-12-26 10:36:45,656][123091] Updated weights for policy 0, policy_version 1380127 (0.0009) [2023-12-26 10:36:45,707][123090] Updated weights for policy 1, policy_version 1370540 (0.0005) [2023-12-26 10:36:45,717][123091] Updated weights for policy 0, policy_version 1380137 (0.0009) [2023-12-26 10:36:45,777][123090] Updated weights for policy 1, policy_version 1370550 (0.0005) [2023-12-26 10:36:45,848][123090] Updated weights for policy 1, policy_version 1370560 (0.0007) [2023-12-26 10:36:46,566][123090] Updated weights for policy 1, policy_version 1370570 (0.0009) [2023-12-26 10:36:46,576][123091] Updated weights for policy 0, policy_version 1380147 (0.0009) [2023-12-26 10:36:46,628][123090] Updated weights for policy 1, policy_version 1370580 (0.0009) [2023-12-26 10:36:46,643][123091] Updated weights for policy 0, policy_version 1380157 (0.0008) [2023-12-26 10:36:46,694][123090] Updated weights for policy 1, policy_version 1370590 (0.0008) [2023-12-26 10:36:46,709][123091] Updated weights for policy 0, policy_version 1380167 (0.0008) [2023-12-26 10:36:47,432][123090] Updated weights for policy 1, policy_version 1370600 (0.0008) [2023-12-26 10:36:47,492][123090] Updated weights for policy 1, policy_version 1370610 (0.0009) [2023-12-26 10:36:47,542][123091] Updated weights for policy 0, policy_version 1380177 (0.0009) [2023-12-26 10:36:47,557][123090] Updated weights for policy 1, policy_version 1370620 (0.0009) [2023-12-26 10:36:47,610][123091] Updated weights for policy 0, policy_version 1380187 (0.0007) [2023-12-26 10:36:47,675][123091] Updated weights for policy 0, policy_version 1380197 (0.0010) [2023-12-26 10:36:47,744][123091] Updated weights for policy 0, policy_version 1380207 (0.0009) [2023-12-26 10:36:48,387][123090] Updated weights for policy 1, policy_version 1370630 (0.0010) [2023-12-26 10:36:48,458][123090] Updated weights for policy 1, policy_version 1370640 (0.0010) [2023-12-26 10:36:48,514][123090] Updated weights for policy 1, policy_version 1370650 (0.0010) [2023-12-26 10:36:48,538][123091] Updated weights for policy 0, policy_version 1380217 (0.0008) [2023-12-26 10:36:48,598][123091] Updated weights for policy 0, policy_version 1380227 (0.0008) [2023-12-26 10:36:48,661][123091] Updated weights for policy 0, policy_version 1380237 (0.0010) [2023-12-26 10:36:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 704233472. Throughput: 0: 8736.1, 1: 8904.7. Samples: 704240576. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:48,784][121949] Avg episode reward: [(0, '6347.210'), (1, '5940.542')] [2023-12-26 10:36:49,344][123090] Updated weights for policy 1, policy_version 1370660 (0.0009) [2023-12-26 10:36:49,406][123090] Updated weights for policy 1, policy_version 1370670 (0.0010) [2023-12-26 10:36:49,458][123090] Updated weights for policy 1, policy_version 1370680 (0.0009) [2023-12-26 10:36:49,513][123091] Updated weights for policy 0, policy_version 1380247 (0.0007) [2023-12-26 10:36:49,579][123091] Updated weights for policy 0, policy_version 1380257 (0.0006) [2023-12-26 10:36:49,634][123091] Updated weights for policy 0, policy_version 1380267 (0.0006) [2023-12-26 10:36:50,339][123091] Updated weights for policy 0, policy_version 1380277 (0.0008) [2023-12-26 10:36:50,342][123090] Updated weights for policy 1, policy_version 1370690 (0.0008) [2023-12-26 10:36:50,398][123091] Updated weights for policy 0, policy_version 1380287 (0.0008) [2023-12-26 10:36:50,405][123090] Updated weights for policy 1, policy_version 1370700 (0.0008) [2023-12-26 10:36:50,448][123091] Updated weights for policy 0, policy_version 1380297 (0.0009) [2023-12-26 10:36:50,468][123090] Updated weights for policy 1, policy_version 1370710 (0.0009) [2023-12-26 10:36:50,532][123090] Updated weights for policy 1, policy_version 1370720 (0.0009) [2023-12-26 10:36:51,314][123091] Updated weights for policy 0, policy_version 1380307 (0.0008) [2023-12-26 10:36:51,374][123091] Updated weights for policy 0, policy_version 1380317 (0.0009) [2023-12-26 10:36:51,382][123090] Updated weights for policy 1, policy_version 1370730 (0.0008) [2023-12-26 10:36:51,443][123091] Updated weights for policy 0, policy_version 1380327 (0.0006) [2023-12-26 10:36:51,452][123090] Updated weights for policy 1, policy_version 1370740 (0.0009) [2023-12-26 10:36:51,520][123090] Updated weights for policy 1, policy_version 1370750 (0.0009) [2023-12-26 10:36:52,263][123091] Updated weights for policy 0, policy_version 1380337 (0.0008) [2023-12-26 10:36:52,326][123091] Updated weights for policy 0, policy_version 1380347 (0.0008) [2023-12-26 10:36:52,384][123091] Updated weights for policy 0, policy_version 1380357 (0.0009) [2023-12-26 10:36:52,419][123090] Updated weights for policy 1, policy_version 1370760 (0.0006) [2023-12-26 10:36:52,445][123091] Updated weights for policy 0, policy_version 1380367 (0.0008) [2023-12-26 10:36:52,485][123090] Updated weights for policy 1, policy_version 1370770 (0.0005) [2023-12-26 10:36:52,545][123090] Updated weights for policy 1, policy_version 1370780 (0.0009) [2023-12-26 10:36:53,277][123090] Updated weights for policy 1, policy_version 1370790 (0.0008) [2023-12-26 10:36:53,292][123091] Updated weights for policy 0, policy_version 1380377 (0.0010) [2023-12-26 10:36:53,340][123090] Updated weights for policy 1, policy_version 1370800 (0.0008) [2023-12-26 10:36:53,343][123091] Updated weights for policy 0, policy_version 1380387 (0.0008) [2023-12-26 10:36:53,392][123091] Updated weights for policy 0, policy_version 1380397 (0.0009) [2023-12-26 10:36:53,398][123090] Updated weights for policy 1, policy_version 1370810 (0.0008) [2023-12-26 10:36:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.9). Total num frames: 704315392. Throughput: 0: 8697.6, 1: 8881.6. Samples: 704291364. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:53,785][121949] Avg episode reward: [(0, '6323.827'), (1, '5902.552')] [2023-12-26 10:36:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001380400_353386496.pth... [2023-12-26 10:36:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001370816_350928896.pth... [2023-12-26 10:36:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001369760_350658560.pth [2023-12-26 10:36:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001379376_353124352.pth [2023-12-26 10:36:54,082][123090] Updated weights for policy 1, policy_version 1370820 (0.0010) [2023-12-26 10:36:54,130][123090] Updated weights for policy 1, policy_version 1370830 (0.0010) [2023-12-26 10:36:54,189][123090] Updated weights for policy 1, policy_version 1370840 (0.0010) [2023-12-26 10:36:54,279][123091] Updated weights for policy 0, policy_version 1380407 (0.0008) [2023-12-26 10:36:54,333][123091] Updated weights for policy 0, policy_version 1380417 (0.0009) [2023-12-26 10:36:54,389][123091] Updated weights for policy 0, policy_version 1380427 (0.0009) [2023-12-26 10:36:54,969][123090] Updated weights for policy 1, policy_version 1370850 (0.0011) [2023-12-26 10:36:55,029][123090] Updated weights for policy 1, policy_version 1370860 (0.0011) [2023-12-26 10:36:55,098][123090] Updated weights for policy 1, policy_version 1370870 (0.0011) [2023-12-26 10:36:55,155][123090] Updated weights for policy 1, policy_version 1370880 (0.0011) [2023-12-26 10:36:55,276][123091] Updated weights for policy 0, policy_version 1380437 (0.0007) [2023-12-26 10:36:55,333][123091] Updated weights for policy 0, policy_version 1380447 (0.0008) [2023-12-26 10:36:55,396][123091] Updated weights for policy 0, policy_version 1380457 (0.0010) [2023-12-26 10:36:55,949][123090] Updated weights for policy 1, policy_version 1370890 (0.0009) [2023-12-26 10:36:56,008][123090] Updated weights for policy 1, policy_version 1370900 (0.0010) [2023-12-26 10:36:56,060][123091] Updated weights for policy 0, policy_version 1380467 (0.0009) [2023-12-26 10:36:56,067][123090] Updated weights for policy 1, policy_version 1370910 (0.0010) [2023-12-26 10:36:56,133][123091] Updated weights for policy 0, policy_version 1380477 (0.0007) [2023-12-26 10:36:56,196][123091] Updated weights for policy 0, policy_version 1380487 (0.0008) [2023-12-26 10:36:56,797][123090] Updated weights for policy 1, policy_version 1370920 (0.0010) [2023-12-26 10:36:56,863][123090] Updated weights for policy 1, policy_version 1370930 (0.0010) [2023-12-26 10:36:56,925][123090] Updated weights for policy 1, policy_version 1370940 (0.0010) [2023-12-26 10:36:57,020][123091] Updated weights for policy 0, policy_version 1380497 (0.0009) [2023-12-26 10:36:57,084][123091] Updated weights for policy 0, policy_version 1380507 (0.0009) [2023-12-26 10:36:57,148][123091] Updated weights for policy 0, policy_version 1380517 (0.0009) [2023-12-26 10:36:57,204][123091] Updated weights for policy 0, policy_version 1380527 (0.0008) [2023-12-26 10:36:57,752][123090] Updated weights for policy 1, policy_version 1370950 (0.0010) [2023-12-26 10:36:57,807][123090] Updated weights for policy 1, policy_version 1370960 (0.0010) [2023-12-26 10:36:57,861][123090] Updated weights for policy 1, policy_version 1370970 (0.0010) [2023-12-26 10:36:58,031][123091] Updated weights for policy 0, policy_version 1380537 (0.0009) [2023-12-26 10:36:58,098][123091] Updated weights for policy 0, policy_version 1380547 (0.0009) [2023-12-26 10:36:58,157][123091] Updated weights for policy 0, policy_version 1380557 (0.0009) [2023-12-26 10:36:58,747][123090] Updated weights for policy 1, policy_version 1370980 (0.0011) [2023-12-26 10:36:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17613.4, 300 sec: 17744.7). Total num frames: 704397312. Throughput: 0: 8706.9, 1: 8921.3. Samples: 704396740. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:36:58,784][121949] Avg episode reward: [(0, '6347.324'), (1, '5944.500')] [2023-12-26 10:36:58,816][123090] Updated weights for policy 1, policy_version 1370990 (0.0010) [2023-12-26 10:36:58,891][123090] Updated weights for policy 1, policy_version 1371000 (0.0010) [2023-12-26 10:36:59,109][123091] Updated weights for policy 0, policy_version 1380567 (0.0009) [2023-12-26 10:36:59,169][123091] Updated weights for policy 0, policy_version 1380577 (0.0009) [2023-12-26 10:36:59,231][123091] Updated weights for policy 0, policy_version 1380587 (0.0010) [2023-12-26 10:36:59,685][123090] Updated weights for policy 1, policy_version 1371010 (0.0009) [2023-12-26 10:36:59,742][123090] Updated weights for policy 1, policy_version 1371020 (0.0007) [2023-12-26 10:36:59,809][123090] Updated weights for policy 1, policy_version 1371030 (0.0009) [2023-12-26 10:36:59,887][123090] Updated weights for policy 1, policy_version 1371040 (0.0009) [2023-12-26 10:37:00,070][123091] Updated weights for policy 0, policy_version 1380597 (0.0009) [2023-12-26 10:37:00,128][123091] Updated weights for policy 0, policy_version 1380607 (0.0010) [2023-12-26 10:37:00,182][123091] Updated weights for policy 0, policy_version 1380617 (0.0008) [2023-12-26 10:37:00,665][123090] Updated weights for policy 1, policy_version 1371050 (0.0010) [2023-12-26 10:37:00,718][123090] Updated weights for policy 1, policy_version 1371060 (0.0010) [2023-12-26 10:37:00,773][123090] Updated weights for policy 1, policy_version 1371070 (0.0009) [2023-12-26 10:37:00,965][123091] Updated weights for policy 0, policy_version 1380627 (0.0009) [2023-12-26 10:37:01,034][123091] Updated weights for policy 0, policy_version 1380637 (0.0006) [2023-12-26 10:37:01,092][123091] Updated weights for policy 0, policy_version 1380647 (0.0008) [2023-12-26 10:37:01,697][123090] Updated weights for policy 1, policy_version 1371080 (0.0010) [2023-12-26 10:37:01,763][123090] Updated weights for policy 1, policy_version 1371090 (0.0009) [2023-12-26 10:37:01,820][123090] Updated weights for policy 1, policy_version 1371100 (0.0010) [2023-12-26 10:37:01,863][123091] Updated weights for policy 0, policy_version 1380657 (0.0009) [2023-12-26 10:37:01,913][123091] Updated weights for policy 0, policy_version 1380667 (0.0006) [2023-12-26 10:37:01,963][123091] Updated weights for policy 0, policy_version 1380677 (0.0005) [2023-12-26 10:37:02,013][123091] Updated weights for policy 0, policy_version 1380687 (0.0005) [2023-12-26 10:37:02,684][123090] Updated weights for policy 1, policy_version 1371110 (0.0010) [2023-12-26 10:37:02,741][123090] Updated weights for policy 1, policy_version 1371120 (0.0011) [2023-12-26 10:37:02,789][123090] Updated weights for policy 1, policy_version 1371130 (0.0010) [2023-12-26 10:37:02,853][123091] Updated weights for policy 0, policy_version 1380697 (0.0008) [2023-12-26 10:37:02,923][123091] Updated weights for policy 0, policy_version 1380707 (0.0009) [2023-12-26 10:37:02,983][123091] Updated weights for policy 0, policy_version 1380717 (0.0009) [2023-12-26 10:37:03,554][123090] Updated weights for policy 1, policy_version 1371140 (0.0008) [2023-12-26 10:37:03,625][123090] Updated weights for policy 1, policy_version 1371150 (0.0005) [2023-12-26 10:37:03,702][123090] Updated weights for policy 1, policy_version 1371160 (0.0007) [2023-12-26 10:37:03,756][123091] Updated weights for policy 0, policy_version 1380727 (0.0007) [2023-12-26 10:37:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 704487424. Throughput: 0: 8679.7, 1: 8854.5. Samples: 704499220. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:37:03,784][121949] Avg episode reward: [(0, '6365.275'), (1, '5983.348')] [2023-12-26 10:37:03,816][123091] Updated weights for policy 0, policy_version 1380737 (0.0009) [2023-12-26 10:37:03,881][123091] Updated weights for policy 0, policy_version 1380747 (0.0009) [2023-12-26 10:37:04,388][123090] Updated weights for policy 1, policy_version 1371170 (0.0010) [2023-12-26 10:37:04,451][123090] Updated weights for policy 1, policy_version 1371180 (0.0006) [2023-12-26 10:37:04,507][123090] Updated weights for policy 1, policy_version 1371190 (0.0005) [2023-12-26 10:37:04,562][123090] Updated weights for policy 1, policy_version 1371200 (0.0005) [2023-12-26 10:37:04,748][123091] Updated weights for policy 0, policy_version 1380757 (0.0007) [2023-12-26 10:37:04,798][123091] Updated weights for policy 0, policy_version 1380767 (0.0005) [2023-12-26 10:37:04,849][123091] Updated weights for policy 0, policy_version 1380777 (0.0005) [2023-12-26 10:37:05,365][123090] Updated weights for policy 1, policy_version 1371210 (0.0010) [2023-12-26 10:37:05,419][123090] Updated weights for policy 1, policy_version 1371220 (0.0010) [2023-12-26 10:37:05,444][123091] Updated weights for policy 0, policy_version 1380787 (0.0005) [2023-12-26 10:37:05,477][123090] Updated weights for policy 1, policy_version 1371230 (0.0008) [2023-12-26 10:37:05,505][123091] Updated weights for policy 0, policy_version 1380797 (0.0006) [2023-12-26 10:37:05,566][123091] Updated weights for policy 0, policy_version 1380807 (0.0010) [2023-12-26 10:37:06,312][123091] Updated weights for policy 0, policy_version 1380817 (0.0009) [2023-12-26 10:37:06,377][123090] Updated weights for policy 1, policy_version 1371240 (0.0009) [2023-12-26 10:37:06,380][123091] Updated weights for policy 0, policy_version 1380827 (0.0006) [2023-12-26 10:37:06,441][123090] Updated weights for policy 1, policy_version 1371250 (0.0009) [2023-12-26 10:37:06,447][123091] Updated weights for policy 0, policy_version 1380837 (0.0006) [2023-12-26 10:37:06,500][123090] Updated weights for policy 1, policy_version 1371260 (0.0009) [2023-12-26 10:37:06,517][123091] Updated weights for policy 0, policy_version 1380847 (0.0006) [2023-12-26 10:37:07,217][123091] Updated weights for policy 0, policy_version 1380857 (0.0006) [2023-12-26 10:37:07,285][123091] Updated weights for policy 0, policy_version 1380867 (0.0008) [2023-12-26 10:37:07,301][123090] Updated weights for policy 1, policy_version 1371270 (0.0007) [2023-12-26 10:37:07,349][123091] Updated weights for policy 0, policy_version 1380877 (0.0011) [2023-12-26 10:37:07,356][123090] Updated weights for policy 1, policy_version 1371280 (0.0009) [2023-12-26 10:37:07,407][123090] Updated weights for policy 1, policy_version 1371290 (0.0006) [2023-12-26 10:37:08,072][123091] Updated weights for policy 0, policy_version 1380887 (0.0010) [2023-12-26 10:37:08,123][123091] Updated weights for policy 0, policy_version 1380897 (0.0008) [2023-12-26 10:37:08,174][123091] Updated weights for policy 0, policy_version 1380907 (0.0005) [2023-12-26 10:37:08,284][123090] Updated weights for policy 1, policy_version 1371300 (0.0009) [2023-12-26 10:37:08,343][123090] Updated weights for policy 1, policy_version 1371311 (0.0010) [2023-12-26 10:37:08,408][123090] Updated weights for policy 1, policy_version 1371321 (0.0009) [2023-12-26 10:37:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 704577536. Throughput: 0: 8732.8, 1: 8888.8. Samples: 704553248. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:37:08,785][121949] Avg episode reward: [(0, '6260.493'), (1, '5986.406')] [2023-12-26 10:37:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001371328_351059968.pth... [2023-12-26 10:37:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001380912_353517568.pth... [2023-12-26 10:37:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001370304_350797824.pth [2023-12-26 10:37:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001379920_353263616.pth [2023-12-26 10:37:08,878][123091] Updated weights for policy 0, policy_version 1380917 (0.0005) [2023-12-26 10:37:08,934][123091] Updated weights for policy 0, policy_version 1380927 (0.0005) [2023-12-26 10:37:08,984][123091] Updated weights for policy 0, policy_version 1380937 (0.0005) [2023-12-26 10:37:09,360][123090] Updated weights for policy 1, policy_version 1371331 (0.0009) [2023-12-26 10:37:09,433][123090] Updated weights for policy 1, policy_version 1371341 (0.0009) [2023-12-26 10:37:09,491][123090] Updated weights for policy 1, policy_version 1371351 (0.0006) [2023-12-26 10:37:09,666][123091] Updated weights for policy 0, policy_version 1380947 (0.0007) [2023-12-26 10:37:09,723][123091] Updated weights for policy 0, policy_version 1380957 (0.0011) [2023-12-26 10:37:09,779][123091] Updated weights for policy 0, policy_version 1380967 (0.0011) [2023-12-26 10:37:10,254][123090] Updated weights for policy 1, policy_version 1371361 (0.0007) [2023-12-26 10:37:10,330][123090] Updated weights for policy 1, policy_version 1371371 (0.0007) [2023-12-26 10:37:10,402][123090] Updated weights for policy 1, policy_version 1371381 (0.0009) [2023-12-26 10:37:10,472][123090] Updated weights for policy 1, policy_version 1371391 (0.0008) [2023-12-26 10:37:10,617][123091] Updated weights for policy 0, policy_version 1380977 (0.0010) [2023-12-26 10:37:10,670][123091] Updated weights for policy 0, policy_version 1380987 (0.0010) [2023-12-26 10:37:10,728][123091] Updated weights for policy 0, policy_version 1380997 (0.0010) [2023-12-26 10:37:10,784][123091] Updated weights for policy 0, policy_version 1381007 (0.0009) [2023-12-26 10:37:11,277][123090] Updated weights for policy 1, policy_version 1371401 (0.0009) [2023-12-26 10:37:11,330][123090] Updated weights for policy 1, policy_version 1371411 (0.0009) [2023-12-26 10:37:11,407][123090] Updated weights for policy 1, policy_version 1371421 (0.0010) [2023-12-26 10:37:11,718][123091] Updated weights for policy 0, policy_version 1381017 (0.0010) [2023-12-26 10:37:11,786][123091] Updated weights for policy 0, policy_version 1381027 (0.0008) [2023-12-26 10:37:11,854][123091] Updated weights for policy 0, policy_version 1381037 (0.0005) [2023-12-26 10:37:12,292][123090] Updated weights for policy 1, policy_version 1371431 (0.0010) [2023-12-26 10:37:12,363][123090] Updated weights for policy 1, policy_version 1371441 (0.0010) [2023-12-26 10:37:12,429][123090] Updated weights for policy 1, policy_version 1371451 (0.0009) [2023-12-26 10:37:12,560][123091] Updated weights for policy 0, policy_version 1381047 (0.0010) [2023-12-26 10:37:12,623][123091] Updated weights for policy 0, policy_version 1381057 (0.0009) [2023-12-26 10:37:12,694][123091] Updated weights for policy 0, policy_version 1381067 (0.0010) [2023-12-26 10:37:13,260][123090] Updated weights for policy 1, policy_version 1371461 (0.0009) [2023-12-26 10:37:13,319][123090] Updated weights for policy 1, policy_version 1371471 (0.0008) [2023-12-26 10:37:13,384][123090] Updated weights for policy 1, policy_version 1371481 (0.0009) [2023-12-26 10:37:13,525][123091] Updated weights for policy 0, policy_version 1381077 (0.0011) [2023-12-26 10:37:13,583][123091] Updated weights for policy 0, policy_version 1381087 (0.0010) [2023-12-26 10:37:13,642][123091] Updated weights for policy 0, policy_version 1381097 (0.0010) [2023-12-26 10:37:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 704667648. Throughput: 0: 8694.3, 1: 8788.8. Samples: 704658092. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:37:13,785][121949] Avg episode reward: [(0, '6320.065'), (1, '5903.081')] [2023-12-26 10:37:14,202][123090] Updated weights for policy 1, policy_version 1371491 (0.0009) [2023-12-26 10:37:14,260][123090] Updated weights for policy 1, policy_version 1371501 (0.0010) [2023-12-26 10:37:14,314][123090] Updated weights for policy 1, policy_version 1371511 (0.0010) [2023-12-26 10:37:14,460][123091] Updated weights for policy 0, policy_version 1381107 (0.0010) [2023-12-26 10:37:14,523][123091] Updated weights for policy 0, policy_version 1381117 (0.0011) [2023-12-26 10:37:14,577][123091] Updated weights for policy 0, policy_version 1381127 (0.0010) [2023-12-26 10:37:15,102][123090] Updated weights for policy 1, policy_version 1371521 (0.0010) [2023-12-26 10:37:15,172][123090] Updated weights for policy 1, policy_version 1371531 (0.0006) [2023-12-26 10:37:15,249][123090] Updated weights for policy 1, policy_version 1371541 (0.0005) [2023-12-26 10:37:15,311][123091] Updated weights for policy 0, policy_version 1381137 (0.0011) [2023-12-26 10:37:15,316][123090] Updated weights for policy 1, policy_version 1371551 (0.0005) [2023-12-26 10:37:15,375][123091] Updated weights for policy 0, policy_version 1381147 (0.0011) [2023-12-26 10:37:15,447][123091] Updated weights for policy 0, policy_version 1381157 (0.0011) [2023-12-26 10:37:15,510][123091] Updated weights for policy 0, policy_version 1381167 (0.0011) [2023-12-26 10:37:15,926][123090] Updated weights for policy 1, policy_version 1371561 (0.0006) [2023-12-26 10:37:15,980][123090] Updated weights for policy 1, policy_version 1371571 (0.0010) [2023-12-26 10:37:16,042][123090] Updated weights for policy 1, policy_version 1371581 (0.0010) [2023-12-26 10:37:16,313][123091] Updated weights for policy 0, policy_version 1381177 (0.0010) [2023-12-26 10:37:16,371][123091] Updated weights for policy 0, policy_version 1381187 (0.0010) [2023-12-26 10:37:16,433][123091] Updated weights for policy 0, policy_version 1381197 (0.0010) [2023-12-26 10:37:16,782][123090] Updated weights for policy 1, policy_version 1371591 (0.0011) [2023-12-26 10:37:16,845][123090] Updated weights for policy 1, policy_version 1371601 (0.0010) [2023-12-26 10:37:16,892][123090] Updated weights for policy 1, policy_version 1371611 (0.0010) [2023-12-26 10:37:17,262][123091] Updated weights for policy 0, policy_version 1381207 (0.0011) [2023-12-26 10:37:17,323][123091] Updated weights for policy 0, policy_version 1381217 (0.0010) [2023-12-26 10:37:17,381][123091] Updated weights for policy 0, policy_version 1381227 (0.0010) [2023-12-26 10:37:17,692][123090] Updated weights for policy 1, policy_version 1371621 (0.0008) [2023-12-26 10:37:17,749][123090] Updated weights for policy 1, policy_version 1371631 (0.0005) [2023-12-26 10:37:17,819][123090] Updated weights for policy 1, policy_version 1371641 (0.0009) [2023-12-26 10:37:18,201][123091] Updated weights for policy 0, policy_version 1381237 (0.0011) [2023-12-26 10:37:18,266][123091] Updated weights for policy 0, policy_version 1381247 (0.0011) [2023-12-26 10:37:18,329][123091] Updated weights for policy 0, policy_version 1381257 (0.0011) [2023-12-26 10:37:18,606][123090] Updated weights for policy 1, policy_version 1371651 (0.0008) [2023-12-26 10:37:18,662][123090] Updated weights for policy 1, policy_version 1371661 (0.0010) [2023-12-26 10:37:18,726][123090] Updated weights for policy 1, policy_version 1371671 (0.0011) [2023-12-26 10:37:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 704757760. Throughput: 0: 8703.9, 1: 8758.2. Samples: 704764968. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:37:18,784][121949] Avg episode reward: [(0, '6295.214'), (1, '5873.051')] [2023-12-26 10:37:19,024][123091] Updated weights for policy 0, policy_version 1381267 (0.0009) [2023-12-26 10:37:19,084][123091] Updated weights for policy 0, policy_version 1381277 (0.0006) [2023-12-26 10:37:19,146][123091] Updated weights for policy 0, policy_version 1381287 (0.0006) [2023-12-26 10:37:19,535][123090] Updated weights for policy 1, policy_version 1371681 (0.0011) [2023-12-26 10:37:19,605][123090] Updated weights for policy 1, policy_version 1371691 (0.0010) [2023-12-26 10:37:19,669][123090] Updated weights for policy 1, policy_version 1371701 (0.0011) [2023-12-26 10:37:19,728][123090] Updated weights for policy 1, policy_version 1371711 (0.0010) [2023-12-26 10:37:19,966][123091] Updated weights for policy 0, policy_version 1381297 (0.0006) [2023-12-26 10:37:20,032][123091] Updated weights for policy 0, policy_version 1381307 (0.0009) [2023-12-26 10:37:20,085][123091] Updated weights for policy 0, policy_version 1381317 (0.0009) [2023-12-26 10:37:20,156][123091] Updated weights for policy 0, policy_version 1381327 (0.0009) [2023-12-26 10:37:20,486][123090] Updated weights for policy 1, policy_version 1371721 (0.0010) [2023-12-26 10:37:20,535][123090] Updated weights for policy 1, policy_version 1371731 (0.0010) [2023-12-26 10:37:20,601][123090] Updated weights for policy 1, policy_version 1371741 (0.0009) [2023-12-26 10:37:21,041][123091] Updated weights for policy 0, policy_version 1381337 (0.0008) [2023-12-26 10:37:21,107][123091] Updated weights for policy 0, policy_version 1381347 (0.0008) [2023-12-26 10:37:21,176][123091] Updated weights for policy 0, policy_version 1381357 (0.0009) [2023-12-26 10:37:21,368][123090] Updated weights for policy 1, policy_version 1371751 (0.0009) [2023-12-26 10:37:21,434][123090] Updated weights for policy 1, policy_version 1371761 (0.0010) [2023-12-26 10:37:21,490][123090] Updated weights for policy 1, policy_version 1371771 (0.0010) [2023-12-26 10:37:21,963][123091] Updated weights for policy 0, policy_version 1381367 (0.0010) [2023-12-26 10:37:22,018][123091] Updated weights for policy 0, policy_version 1381377 (0.0011) [2023-12-26 10:37:22,072][123091] Updated weights for policy 0, policy_version 1381387 (0.0009) [2023-12-26 10:37:22,361][123090] Updated weights for policy 1, policy_version 1371781 (0.0011) [2023-12-26 10:37:22,436][123090] Updated weights for policy 1, policy_version 1371791 (0.0010) [2023-12-26 10:37:22,499][123090] Updated weights for policy 1, policy_version 1371801 (0.0010) [2023-12-26 10:37:22,833][123091] Updated weights for policy 0, policy_version 1381397 (0.0006) [2023-12-26 10:37:22,881][123091] Updated weights for policy 0, policy_version 1381407 (0.0005) [2023-12-26 10:37:22,929][123091] Updated weights for policy 0, policy_version 1381417 (0.0005) [2023-12-26 10:37:23,238][123090] Updated weights for policy 1, policy_version 1371811 (0.0009) [2023-12-26 10:37:23,300][123090] Updated weights for policy 1, policy_version 1371821 (0.0005) [2023-12-26 10:37:23,352][123090] Updated weights for policy 1, policy_version 1371831 (0.0005) [2023-12-26 10:37:23,580][123091] Updated weights for policy 0, policy_version 1381427 (0.0005) [2023-12-26 10:37:23,630][123091] Updated weights for policy 0, policy_version 1381437 (0.0005) [2023-12-26 10:37:23,681][123091] Updated weights for policy 0, policy_version 1381447 (0.0005) [2023-12-26 10:37:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 704847872. Throughput: 0: 8691.3, 1: 8755.5. Samples: 704818020. Policy #0 lag: (min: 31.0, avg: 47.1, max: 63.0) [2023-12-26 10:37:23,785][121949] Avg episode reward: [(0, '6332.867'), (1, '5911.107')] [2023-12-26 10:37:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001381456_353656832.pth... [2023-12-26 10:37:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001371840_351191040.pth... [2023-12-26 10:37:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001380400_353386496.pth [2023-12-26 10:37:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001370816_350928896.pth [2023-12-26 10:37:24,018][123090] Updated weights for policy 1, policy_version 1371841 (0.0005) [2023-12-26 10:37:24,080][123090] Updated weights for policy 1, policy_version 1371851 (0.0005) [2023-12-26 10:37:24,149][123090] Updated weights for policy 1, policy_version 1371861 (0.0006) [2023-12-26 10:37:24,206][123090] Updated weights for policy 1, policy_version 1371871 (0.0006) [2023-12-26 10:37:24,330][123091] Updated weights for policy 0, policy_version 1381457 (0.0006) [2023-12-26 10:37:24,380][123091] Updated weights for policy 0, policy_version 1381467 (0.0008) [2023-12-26 10:37:24,426][123091] Updated weights for policy 0, policy_version 1381477 (0.0005) [2023-12-26 10:37:24,486][123091] Updated weights for policy 0, policy_version 1381487 (0.0005) [2023-12-26 10:37:24,909][123090] Updated weights for policy 1, policy_version 1371881 (0.0005) [2023-12-26 10:37:24,982][123090] Updated weights for policy 1, policy_version 1371891 (0.0005) [2023-12-26 10:37:25,054][123090] Updated weights for policy 1, policy_version 1371901 (0.0006) [2023-12-26 10:37:25,177][123091] Updated weights for policy 0, policy_version 1381497 (0.0005) [2023-12-26 10:37:25,237][123091] Updated weights for policy 0, policy_version 1381507 (0.0006) [2023-12-26 10:37:25,294][123091] Updated weights for policy 0, policy_version 1381517 (0.0005) [2023-12-26 10:37:25,736][123090] Updated weights for policy 1, policy_version 1371911 (0.0007) [2023-12-26 10:37:25,785][123090] Updated weights for policy 1, policy_version 1371921 (0.0005) [2023-12-26 10:37:25,838][123090] Updated weights for policy 1, policy_version 1371931 (0.0005) [2023-12-26 10:37:25,963][123091] Updated weights for policy 0, policy_version 1381527 (0.0005) [2023-12-26 10:37:26,021][123091] Updated weights for policy 0, policy_version 1381537 (0.0005) [2023-12-26 10:37:26,083][123091] Updated weights for policy 0, policy_version 1381547 (0.0005) [2023-12-26 10:37:26,445][123090] Updated weights for policy 1, policy_version 1371941 (0.0006) [2023-12-26 10:37:26,499][123090] Updated weights for policy 1, policy_version 1371951 (0.0007) [2023-12-26 10:37:26,563][123090] Updated weights for policy 1, policy_version 1371961 (0.0007) [2023-12-26 10:37:26,790][123091] Updated weights for policy 0, policy_version 1381557 (0.0008) [2023-12-26 10:37:26,841][123091] Updated weights for policy 0, policy_version 1381567 (0.0010) [2023-12-26 10:37:26,885][123091] Updated weights for policy 0, policy_version 1381577 (0.0010) [2023-12-26 10:37:27,295][123090] Updated weights for policy 1, policy_version 1371971 (0.0010) [2023-12-26 10:37:27,346][123090] Updated weights for policy 1, policy_version 1371981 (0.0010) [2023-12-26 10:37:27,395][123090] Updated weights for policy 1, policy_version 1371991 (0.0009) [2023-12-26 10:37:27,723][123091] Updated weights for policy 0, policy_version 1381587 (0.0010) [2023-12-26 10:37:27,770][123091] Updated weights for policy 0, policy_version 1381597 (0.0010) [2023-12-26 10:37:27,828][123091] Updated weights for policy 0, policy_version 1381607 (0.0010) [2023-12-26 10:37:28,021][123090] Updated weights for policy 1, policy_version 1372001 (0.0005) [2023-12-26 10:37:28,070][123090] Updated weights for policy 1, policy_version 1372011 (0.0005) [2023-12-26 10:37:28,129][123090] Updated weights for policy 1, policy_version 1372021 (0.0005) [2023-12-26 10:37:28,184][123090] Updated weights for policy 1, policy_version 1372031 (0.0006) [2023-12-26 10:37:28,658][123091] Updated weights for policy 0, policy_version 1381617 (0.0010) [2023-12-26 10:37:28,712][123091] Updated weights for policy 0, policy_version 1381627 (0.0010) [2023-12-26 10:37:28,763][123091] Updated weights for policy 0, policy_version 1381637 (0.0010) [2023-12-26 10:37:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 704937984. Throughput: 0: 8869.5, 1: 8885.7. Samples: 704935552. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:28,784][121949] Avg episode reward: [(0, '6389.923'), (1, '5917.362')] [2023-12-26 10:37:28,830][123091] Updated weights for policy 0, policy_version 1381647 (0.0008) [2023-12-26 10:37:28,974][123090] Updated weights for policy 1, policy_version 1372041 (0.0009) [2023-12-26 10:37:29,028][123090] Updated weights for policy 1, policy_version 1372051 (0.0010) [2023-12-26 10:37:29,085][123090] Updated weights for policy 1, policy_version 1372061 (0.0009) [2023-12-26 10:37:29,628][123091] Updated weights for policy 0, policy_version 1381657 (0.0009) [2023-12-26 10:37:29,688][123091] Updated weights for policy 0, policy_version 1381667 (0.0008) [2023-12-26 10:37:29,752][123091] Updated weights for policy 0, policy_version 1381677 (0.0008) [2023-12-26 10:37:29,929][123090] Updated weights for policy 1, policy_version 1372071 (0.0009) [2023-12-26 10:37:29,995][123090] Updated weights for policy 1, policy_version 1372081 (0.0009) [2023-12-26 10:37:30,057][123090] Updated weights for policy 1, policy_version 1372091 (0.0006) [2023-12-26 10:37:30,577][123091] Updated weights for policy 0, policy_version 1381687 (0.0009) [2023-12-26 10:37:30,643][123091] Updated weights for policy 0, policy_version 1381697 (0.0009) [2023-12-26 10:37:30,714][123091] Updated weights for policy 0, policy_version 1381707 (0.0009) [2023-12-26 10:37:30,883][123090] Updated weights for policy 1, policy_version 1372101 (0.0007) [2023-12-26 10:37:30,935][123090] Updated weights for policy 1, policy_version 1372111 (0.0009) [2023-12-26 10:37:30,990][123090] Updated weights for policy 1, policy_version 1372121 (0.0009) [2023-12-26 10:37:31,540][123091] Updated weights for policy 0, policy_version 1381717 (0.0009) [2023-12-26 10:37:31,596][123091] Updated weights for policy 0, policy_version 1381727 (0.0009) [2023-12-26 10:37:31,664][123091] Updated weights for policy 0, policy_version 1381737 (0.0010) [2023-12-26 10:37:31,845][123090] Updated weights for policy 1, policy_version 1372131 (0.0009) [2023-12-26 10:37:31,902][123090] Updated weights for policy 1, policy_version 1372141 (0.0009) [2023-12-26 10:37:31,969][123090] Updated weights for policy 1, policy_version 1372151 (0.0010) [2023-12-26 10:37:32,499][123091] Updated weights for policy 0, policy_version 1381747 (0.0010) [2023-12-26 10:37:32,553][123091] Updated weights for policy 0, policy_version 1381757 (0.0010) [2023-12-26 10:37:32,609][123091] Updated weights for policy 0, policy_version 1381767 (0.0010) [2023-12-26 10:37:32,808][123090] Updated weights for policy 1, policy_version 1372161 (0.0011) [2023-12-26 10:37:32,858][123090] Updated weights for policy 1, policy_version 1372171 (0.0009) [2023-12-26 10:37:32,916][123090] Updated weights for policy 1, policy_version 1372182 (0.0010) [2023-12-26 10:37:32,984][123090] Updated weights for policy 1, policy_version 1372192 (0.0007) [2023-12-26 10:37:33,367][123091] Updated weights for policy 0, policy_version 1381777 (0.0006) [2023-12-26 10:37:33,422][123091] Updated weights for policy 0, policy_version 1381787 (0.0010) [2023-12-26 10:37:33,473][123091] Updated weights for policy 0, policy_version 1381797 (0.0010) [2023-12-26 10:37:33,528][123091] Updated weights for policy 0, policy_version 1381807 (0.0010) [2023-12-26 10:37:33,784][123090] Updated weights for policy 1, policy_version 1372202 (0.0005) [2023-12-26 10:37:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 705028096. Throughput: 0: 8941.2, 1: 8834.6. Samples: 705040488. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:33,785][121949] Avg episode reward: [(0, '6449.575'), (1, '5972.421')] [2023-12-26 10:37:33,852][123090] Updated weights for policy 1, policy_version 1372212 (0.0006) [2023-12-26 10:37:33,921][123090] Updated weights for policy 1, policy_version 1372222 (0.0005) [2023-12-26 10:37:34,388][123091] Updated weights for policy 0, policy_version 1381817 (0.0009) [2023-12-26 10:37:34,484][123091] Updated weights for policy 0, policy_version 1381827 (0.0011) [2023-12-26 10:37:34,558][123091] Updated weights for policy 0, policy_version 1381837 (0.0011) [2023-12-26 10:37:34,629][123090] Updated weights for policy 1, policy_version 1372232 (0.0009) [2023-12-26 10:37:34,695][123090] Updated weights for policy 1, policy_version 1372242 (0.0011) [2023-12-26 10:37:34,752][123090] Updated weights for policy 1, policy_version 1372252 (0.0008) [2023-12-26 10:37:35,320][123091] Updated weights for policy 0, policy_version 1381847 (0.0007) [2023-12-26 10:37:35,385][123091] Updated weights for policy 0, policy_version 1381857 (0.0010) [2023-12-26 10:37:35,437][123091] Updated weights for policy 0, policy_version 1381867 (0.0010) [2023-12-26 10:37:35,560][123090] Updated weights for policy 1, policy_version 1372262 (0.0008) [2023-12-26 10:37:35,622][123090] Updated weights for policy 1, policy_version 1372272 (0.0010) [2023-12-26 10:37:35,687][123090] Updated weights for policy 1, policy_version 1372282 (0.0010) [2023-12-26 10:37:36,105][123091] Updated weights for policy 0, policy_version 1381877 (0.0009) [2023-12-26 10:37:36,172][123091] Updated weights for policy 0, policy_version 1381887 (0.0007) [2023-12-26 10:37:36,245][123091] Updated weights for policy 0, policy_version 1381897 (0.0007) [2023-12-26 10:37:36,448][123090] Updated weights for policy 1, policy_version 1372292 (0.0009) [2023-12-26 10:37:36,518][123090] Updated weights for policy 1, policy_version 1372302 (0.0008) [2023-12-26 10:37:36,588][123090] Updated weights for policy 1, policy_version 1372312 (0.0006) [2023-12-26 10:37:36,982][123091] Updated weights for policy 0, policy_version 1381907 (0.0008) [2023-12-26 10:37:37,054][123091] Updated weights for policy 0, policy_version 1381917 (0.0006) [2023-12-26 10:37:37,124][123091] Updated weights for policy 0, policy_version 1381927 (0.0006) [2023-12-26 10:37:37,398][123090] Updated weights for policy 1, policy_version 1372322 (0.0006) [2023-12-26 10:37:37,464][123090] Updated weights for policy 1, policy_version 1372332 (0.0010) [2023-12-26 10:37:37,527][123090] Updated weights for policy 1, policy_version 1372342 (0.0010) [2023-12-26 10:37:37,575][123090] Updated weights for policy 1, policy_version 1372352 (0.0011) [2023-12-26 10:37:37,755][123091] Updated weights for policy 0, policy_version 1381937 (0.0006) [2023-12-26 10:37:37,803][123091] Updated weights for policy 0, policy_version 1381947 (0.0009) [2023-12-26 10:37:37,858][123091] Updated weights for policy 0, policy_version 1381957 (0.0009) [2023-12-26 10:37:37,918][123091] Updated weights for policy 0, policy_version 1381967 (0.0010) [2023-12-26 10:37:38,346][123090] Updated weights for policy 1, policy_version 1372362 (0.0007) [2023-12-26 10:37:38,415][123090] Updated weights for policy 1, policy_version 1372372 (0.0007) [2023-12-26 10:37:38,476][123090] Updated weights for policy 1, policy_version 1372382 (0.0009) [2023-12-26 10:37:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 705118208. Throughput: 0: 8975.0, 1: 8905.3. Samples: 705095980. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:38,785][121949] Avg episode reward: [(0, '6423.799'), (1, '5991.014')] [2023-12-26 10:37:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001372384_351330304.pth... [2023-12-26 10:37:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001371328_351059968.pth [2023-12-26 10:37:38,847][123091] Updated weights for policy 0, policy_version 1381977 (0.0009) [2023-12-26 10:37:38,902][123091] Updated weights for policy 0, policy_version 1381987 (0.0010) [2023-12-26 10:37:38,964][123091] Updated weights for policy 0, policy_version 1381997 (0.0009) [2023-12-26 10:37:38,979][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001382000_353796096.pth... [2023-12-26 10:37:38,982][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001380912_353517568.pth [2023-12-26 10:37:39,244][123090] Updated weights for policy 1, policy_version 1372392 (0.0009) [2023-12-26 10:37:39,305][123090] Updated weights for policy 1, policy_version 1372402 (0.0008) [2023-12-26 10:37:39,376][123090] Updated weights for policy 1, policy_version 1372412 (0.0008) [2023-12-26 10:37:39,817][123091] Updated weights for policy 0, policy_version 1382007 (0.0010) [2023-12-26 10:37:39,885][123091] Updated weights for policy 0, policy_version 1382017 (0.0010) [2023-12-26 10:37:39,949][123091] Updated weights for policy 0, policy_version 1382027 (0.0010) [2023-12-26 10:37:40,213][123090] Updated weights for policy 1, policy_version 1372422 (0.0010) [2023-12-26 10:37:40,270][123090] Updated weights for policy 1, policy_version 1372432 (0.0009) [2023-12-26 10:37:40,331][123090] Updated weights for policy 1, policy_version 1372442 (0.0009) [2023-12-26 10:37:40,760][123091] Updated weights for policy 0, policy_version 1382037 (0.0006) [2023-12-26 10:37:40,822][123091] Updated weights for policy 0, policy_version 1382047 (0.0008) [2023-12-26 10:37:40,886][123091] Updated weights for policy 0, policy_version 1382057 (0.0009) [2023-12-26 10:37:41,209][123090] Updated weights for policy 1, policy_version 1372452 (0.0009) [2023-12-26 10:37:41,279][123090] Updated weights for policy 1, policy_version 1372462 (0.0010) [2023-12-26 10:37:41,352][123090] Updated weights for policy 1, policy_version 1372472 (0.0009) [2023-12-26 10:37:41,798][123091] Updated weights for policy 0, policy_version 1382067 (0.0009) [2023-12-26 10:37:41,851][123091] Updated weights for policy 0, policy_version 1382077 (0.0008) [2023-12-26 10:37:41,914][123091] Updated weights for policy 0, policy_version 1382087 (0.0008) [2023-12-26 10:37:42,136][123090] Updated weights for policy 1, policy_version 1372482 (0.0007) [2023-12-26 10:37:42,197][123090] Updated weights for policy 1, policy_version 1372492 (0.0007) [2023-12-26 10:37:42,263][123090] Updated weights for policy 1, policy_version 1372502 (0.0010) [2023-12-26 10:37:42,324][123090] Updated weights for policy 1, policy_version 1372512 (0.0008) [2023-12-26 10:37:42,655][123091] Updated weights for policy 0, policy_version 1382097 (0.0006) [2023-12-26 10:37:42,725][123091] Updated weights for policy 0, policy_version 1382107 (0.0006) [2023-12-26 10:37:42,791][123091] Updated weights for policy 0, policy_version 1382117 (0.0007) [2023-12-26 10:37:42,849][123091] Updated weights for policy 0, policy_version 1382127 (0.0005) [2023-12-26 10:37:43,174][123090] Updated weights for policy 1, policy_version 1372522 (0.0010) [2023-12-26 10:37:43,232][123090] Updated weights for policy 1, policy_version 1372532 (0.0010) [2023-12-26 10:37:43,291][123090] Updated weights for policy 1, policy_version 1372542 (0.0010) [2023-12-26 10:37:43,405][123091] Updated weights for policy 0, policy_version 1382137 (0.0005) [2023-12-26 10:37:43,461][123091] Updated weights for policy 0, policy_version 1382147 (0.0005) [2023-12-26 10:37:43,513][123091] Updated weights for policy 0, policy_version 1382157 (0.0005) [2023-12-26 10:37:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 705208320. Throughput: 0: 9009.9, 1: 8836.3. Samples: 705199816. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:43,784][121949] Avg episode reward: [(0, '6371.916'), (1, '5993.432')] [2023-12-26 10:37:44,121][123091] Updated weights for policy 0, policy_version 1382167 (0.0005) [2023-12-26 10:37:44,173][123091] Updated weights for policy 0, policy_version 1382177 (0.0005) [2023-12-26 10:37:44,210][123090] Updated weights for policy 1, policy_version 1372552 (0.0009) [2023-12-26 10:37:44,234][123091] Updated weights for policy 0, policy_version 1382187 (0.0005) [2023-12-26 10:37:44,264][123090] Updated weights for policy 1, policy_version 1372562 (0.0009) [2023-12-26 10:37:44,314][123090] Updated weights for policy 1, policy_version 1372572 (0.0009) [2023-12-26 10:37:44,991][123091] Updated weights for policy 0, policy_version 1382197 (0.0009) [2023-12-26 10:37:45,053][123091] Updated weights for policy 0, policy_version 1382207 (0.0009) [2023-12-26 10:37:45,112][123091] Updated weights for policy 0, policy_version 1382217 (0.0010) [2023-12-26 10:37:45,167][123090] Updated weights for policy 1, policy_version 1372582 (0.0010) [2023-12-26 10:37:45,217][123090] Updated weights for policy 1, policy_version 1372592 (0.0009) [2023-12-26 10:37:45,268][123090] Updated weights for policy 1, policy_version 1372602 (0.0009) [2023-12-26 10:37:45,960][123091] Updated weights for policy 0, policy_version 1382227 (0.0009) [2023-12-26 10:37:46,014][123091] Updated weights for policy 0, policy_version 1382238 (0.0009) [2023-12-26 10:37:46,070][123091] Updated weights for policy 0, policy_version 1382249 (0.0010) [2023-12-26 10:37:46,093][123090] Updated weights for policy 1, policy_version 1372612 (0.0009) [2023-12-26 10:37:46,155][123090] Updated weights for policy 1, policy_version 1372622 (0.0009) [2023-12-26 10:37:46,220][123090] Updated weights for policy 1, policy_version 1372632 (0.0009) [2023-12-26 10:37:46,925][123091] Updated weights for policy 0, policy_version 1382259 (0.0010) [2023-12-26 10:37:46,983][123091] Updated weights for policy 0, policy_version 1382269 (0.0009) [2023-12-26 10:37:47,042][123090] Updated weights for policy 1, policy_version 1372643 (0.0009) [2023-12-26 10:37:47,052][123091] Updated weights for policy 0, policy_version 1382279 (0.0010) [2023-12-26 10:37:47,109][123090] Updated weights for policy 1, policy_version 1372653 (0.0007) [2023-12-26 10:37:47,170][123090] Updated weights for policy 1, policy_version 1372663 (0.0009) [2023-12-26 10:37:47,890][123090] Updated weights for policy 1, policy_version 1372673 (0.0009) [2023-12-26 10:37:47,941][123091] Updated weights for policy 0, policy_version 1382289 (0.0009) [2023-12-26 10:37:47,960][123090] Updated weights for policy 1, policy_version 1372683 (0.0005) [2023-12-26 10:37:47,999][123091] Updated weights for policy 0, policy_version 1382299 (0.0008) [2023-12-26 10:37:48,025][123090] Updated weights for policy 1, policy_version 1372693 (0.0009) [2023-12-26 10:37:48,048][123091] Updated weights for policy 0, policy_version 1382309 (0.0010) [2023-12-26 10:37:48,072][123090] Updated weights for policy 1, policy_version 1372703 (0.0010) [2023-12-26 10:37:48,114][123091] Updated weights for policy 0, policy_version 1382319 (0.0007) [2023-12-26 10:37:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 705290240. Throughput: 0: 9041.0, 1: 8864.4. Samples: 705304960. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:48,785][121949] Avg episode reward: [(0, '6444.952'), (1, '5918.308')] [2023-12-26 10:37:48,872][123090] Updated weights for policy 1, policy_version 1372713 (0.0010) [2023-12-26 10:37:48,936][123090] Updated weights for policy 1, policy_version 1372723 (0.0009) [2023-12-26 10:37:48,995][123090] Updated weights for policy 1, policy_version 1372733 (0.0007) [2023-12-26 10:37:49,001][123091] Updated weights for policy 0, policy_version 1382329 (0.0009) [2023-12-26 10:37:49,058][123091] Updated weights for policy 0, policy_version 1382339 (0.0009) [2023-12-26 10:37:49,116][123091] Updated weights for policy 0, policy_version 1382349 (0.0009) [2023-12-26 10:37:49,830][123090] Updated weights for policy 1, policy_version 1372743 (0.0009) [2023-12-26 10:37:49,897][123090] Updated weights for policy 1, policy_version 1372753 (0.0009) [2023-12-26 10:37:49,964][123091] Updated weights for policy 0, policy_version 1382359 (0.0009) [2023-12-26 10:37:49,968][123090] Updated weights for policy 1, policy_version 1372763 (0.0009) [2023-12-26 10:37:50,028][123091] Updated weights for policy 0, policy_version 1382369 (0.0008) [2023-12-26 10:37:50,088][123091] Updated weights for policy 0, policy_version 1382379 (0.0008) [2023-12-26 10:37:50,761][123090] Updated weights for policy 1, policy_version 1372773 (0.0006) [2023-12-26 10:37:50,826][123090] Updated weights for policy 1, policy_version 1372783 (0.0009) [2023-12-26 10:37:50,900][123090] Updated weights for policy 1, policy_version 1372793 (0.0009) [2023-12-26 10:37:50,910][123091] Updated weights for policy 0, policy_version 1382389 (0.0007) [2023-12-26 10:37:50,973][123091] Updated weights for policy 0, policy_version 1382399 (0.0006) [2023-12-26 10:37:51,041][123091] Updated weights for policy 0, policy_version 1382409 (0.0006) [2023-12-26 10:37:51,695][123090] Updated weights for policy 1, policy_version 1372803 (0.0009) [2023-12-26 10:37:51,765][123090] Updated weights for policy 1, policy_version 1372813 (0.0010) [2023-12-26 10:37:51,826][123091] Updated weights for policy 0, policy_version 1382419 (0.0009) [2023-12-26 10:37:51,828][123090] Updated weights for policy 1, policy_version 1372823 (0.0009) [2023-12-26 10:37:51,881][123091] Updated weights for policy 0, policy_version 1382429 (0.0006) [2023-12-26 10:37:51,953][123091] Updated weights for policy 0, policy_version 1382439 (0.0005) [2023-12-26 10:37:52,699][123091] Updated weights for policy 0, policy_version 1382449 (0.0006) [2023-12-26 10:37:52,716][123090] Updated weights for policy 1, policy_version 1372833 (0.0009) [2023-12-26 10:37:52,761][123091] Updated weights for policy 0, policy_version 1382459 (0.0010) [2023-12-26 10:37:52,772][123090] Updated weights for policy 1, policy_version 1372843 (0.0006) [2023-12-26 10:37:52,819][123091] Updated weights for policy 0, policy_version 1382469 (0.0007) [2023-12-26 10:37:52,822][123090] Updated weights for policy 1, policy_version 1372853 (0.0007) [2023-12-26 10:37:52,869][123091] Updated weights for policy 0, policy_version 1382479 (0.0009) [2023-12-26 10:37:52,877][123090] Updated weights for policy 1, policy_version 1372863 (0.0007) [2023-12-26 10:37:53,692][123090] Updated weights for policy 1, policy_version 1372873 (0.0009) [2023-12-26 10:37:53,717][123091] Updated weights for policy 0, policy_version 1382489 (0.0009) [2023-12-26 10:37:53,761][123090] Updated weights for policy 1, policy_version 1372883 (0.0008) [2023-12-26 10:37:53,775][123091] Updated weights for policy 0, policy_version 1382499 (0.0009) [2023-12-26 10:37:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 705372160. Throughput: 0: 8989.7, 1: 8848.8. Samples: 705355980. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:53,785][121949] Avg episode reward: [(0, '6457.725'), (1, '5920.043')] [2023-12-26 10:37:53,820][123090] Updated weights for policy 1, policy_version 1372893 (0.0008) [2023-12-26 10:37:53,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001372896_351461376.pth... [2023-12-26 10:37:53,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001371840_351191040.pth [2023-12-26 10:37:53,838][123091] Updated weights for policy 0, policy_version 1382509 (0.0008) [2023-12-26 10:37:53,856][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001382512_353927168.pth... [2023-12-26 10:37:53,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001381456_353656832.pth [2023-12-26 10:37:54,620][123090] Updated weights for policy 1, policy_version 1372903 (0.0010) [2023-12-26 10:37:54,672][123091] Updated weights for policy 0, policy_version 1382519 (0.0010) [2023-12-26 10:37:54,683][123090] Updated weights for policy 1, policy_version 1372913 (0.0008) [2023-12-26 10:37:54,733][123091] Updated weights for policy 0, policy_version 1382529 (0.0009) [2023-12-26 10:37:54,735][123090] Updated weights for policy 1, policy_version 1372923 (0.0006) [2023-12-26 10:37:54,785][123091] Updated weights for policy 0, policy_version 1382539 (0.0008) [2023-12-26 10:37:55,452][123090] Updated weights for policy 1, policy_version 1372933 (0.0005) [2023-12-26 10:37:55,506][123090] Updated weights for policy 1, policy_version 1372943 (0.0005) [2023-12-26 10:37:55,557][123090] Updated weights for policy 1, policy_version 1372953 (0.0005) [2023-12-26 10:37:55,707][123091] Updated weights for policy 0, policy_version 1382550 (0.0010) [2023-12-26 10:37:55,761][123091] Updated weights for policy 0, policy_version 1382563 (0.0010) [2023-12-26 10:37:55,815][123091] Updated weights for policy 0, policy_version 1382574 (0.0010) [2023-12-26 10:37:56,207][123090] Updated weights for policy 1, policy_version 1372963 (0.0005) [2023-12-26 10:37:56,266][123090] Updated weights for policy 1, policy_version 1372973 (0.0005) [2023-12-26 10:37:56,322][123090] Updated weights for policy 1, policy_version 1372983 (0.0005) [2023-12-26 10:37:56,783][123091] Updated weights for policy 0, policy_version 1382584 (0.0010) [2023-12-26 10:37:56,842][123091] Updated weights for policy 0, policy_version 1382594 (0.0010) [2023-12-26 10:37:56,906][123091] Updated weights for policy 0, policy_version 1382604 (0.0009) [2023-12-26 10:37:57,014][123090] Updated weights for policy 1, policy_version 1372993 (0.0006) [2023-12-26 10:37:57,089][123090] Updated weights for policy 1, policy_version 1373003 (0.0006) [2023-12-26 10:37:57,145][123090] Updated weights for policy 1, policy_version 1373013 (0.0010) [2023-12-26 10:37:57,203][123090] Updated weights for policy 1, policy_version 1373023 (0.0010) [2023-12-26 10:37:57,781][123091] Updated weights for policy 0, policy_version 1382614 (0.0010) [2023-12-26 10:37:57,834][123091] Updated weights for policy 0, policy_version 1382624 (0.0009) [2023-12-26 10:37:57,891][123090] Updated weights for policy 1, policy_version 1373033 (0.0006) [2023-12-26 10:37:57,892][123091] Updated weights for policy 0, policy_version 1382634 (0.0009) [2023-12-26 10:37:57,944][123090] Updated weights for policy 1, policy_version 1373043 (0.0005) [2023-12-26 10:37:58,009][123090] Updated weights for policy 1, policy_version 1373053 (0.0006) [2023-12-26 10:37:58,747][123090] Updated weights for policy 1, policy_version 1373063 (0.0009) [2023-12-26 10:37:58,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 705462272. Throughput: 0: 8882.1, 1: 8990.6. Samples: 705462364. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:37:58,785][121949] Avg episode reward: [(0, '6467.304'), (1, '5989.219')] [2023-12-26 10:37:58,821][123090] Updated weights for policy 1, policy_version 1373073 (0.0008) [2023-12-26 10:37:58,875][123091] Updated weights for policy 0, policy_version 1382644 (0.0008) [2023-12-26 10:37:58,876][123090] Updated weights for policy 1, policy_version 1373083 (0.0008) [2023-12-26 10:37:58,939][123091] Updated weights for policy 0, policy_version 1382654 (0.0008) [2023-12-26 10:37:58,993][123091] Updated weights for policy 0, policy_version 1382664 (0.0009) [2023-12-26 10:37:59,753][123090] Updated weights for policy 1, policy_version 1373093 (0.0009) [2023-12-26 10:37:59,821][123090] Updated weights for policy 1, policy_version 1373103 (0.0009) [2023-12-26 10:37:59,880][123091] Updated weights for policy 0, policy_version 1382674 (0.0009) [2023-12-26 10:37:59,890][123090] Updated weights for policy 1, policy_version 1373113 (0.0010) [2023-12-26 10:37:59,943][123091] Updated weights for policy 0, policy_version 1382684 (0.0007) [2023-12-26 10:37:59,990][123091] Updated weights for policy 0, policy_version 1382694 (0.0009) [2023-12-26 10:38:00,043][123091] Updated weights for policy 0, policy_version 1382704 (0.0009) [2023-12-26 10:38:00,672][123090] Updated weights for policy 1, policy_version 1373123 (0.0011) [2023-12-26 10:38:00,732][123090] Updated weights for policy 1, policy_version 1373133 (0.0010) [2023-12-26 10:38:00,796][123090] Updated weights for policy 1, policy_version 1373143 (0.0010) [2023-12-26 10:38:00,832][123091] Updated weights for policy 0, policy_version 1382714 (0.0005) [2023-12-26 10:38:00,883][123091] Updated weights for policy 0, policy_version 1382725 (0.0008) [2023-12-26 10:38:00,931][123091] Updated weights for policy 0, policy_version 1382735 (0.0005) [2023-12-26 10:38:01,618][123090] Updated weights for policy 1, policy_version 1373153 (0.0009) [2023-12-26 10:38:01,689][123090] Updated weights for policy 1, policy_version 1373163 (0.0010) [2023-12-26 10:38:01,755][123090] Updated weights for policy 1, policy_version 1373173 (0.0008) [2023-12-26 10:38:01,780][123091] Updated weights for policy 0, policy_version 1382745 (0.0009) [2023-12-26 10:38:01,818][123090] Updated weights for policy 1, policy_version 1373183 (0.0009) [2023-12-26 10:38:01,829][123091] Updated weights for policy 0, policy_version 1382755 (0.0009) [2023-12-26 10:38:01,890][123091] Updated weights for policy 0, policy_version 1382765 (0.0010) [2023-12-26 10:38:02,641][123090] Updated weights for policy 1, policy_version 1373193 (0.0009) [2023-12-26 10:38:02,698][123090] Updated weights for policy 1, policy_version 1373203 (0.0010) [2023-12-26 10:38:02,714][123091] Updated weights for policy 0, policy_version 1382775 (0.0008) [2023-12-26 10:38:02,747][123090] Updated weights for policy 1, policy_version 1373213 (0.0007) [2023-12-26 10:38:02,766][123091] Updated weights for policy 0, policy_version 1382785 (0.0008) [2023-12-26 10:38:02,826][123091] Updated weights for policy 0, policy_version 1382795 (0.0010) [2023-12-26 10:38:03,574][123091] Updated weights for policy 0, policy_version 1382805 (0.0008) [2023-12-26 10:38:03,578][123090] Updated weights for policy 1, policy_version 1373223 (0.0006) [2023-12-26 10:38:03,636][123090] Updated weights for policy 1, policy_version 1373233 (0.0005) [2023-12-26 10:38:03,644][123091] Updated weights for policy 0, policy_version 1382815 (0.0010) [2023-12-26 10:38:03,693][123090] Updated weights for policy 1, policy_version 1373243 (0.0006) [2023-12-26 10:38:03,699][123091] Updated weights for policy 0, policy_version 1382825 (0.0010) [2023-12-26 10:38:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 705560576. Throughput: 0: 8854.1, 1: 8952.0. Samples: 705566244. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:03,785][121949] Avg episode reward: [(0, '6371.804'), (1, '5988.178')] [2023-12-26 10:38:04,454][123091] Updated weights for policy 0, policy_version 1382835 (0.0009) [2023-12-26 10:38:04,490][123090] Updated weights for policy 1, policy_version 1373253 (0.0007) [2023-12-26 10:38:04,518][123091] Updated weights for policy 0, policy_version 1382845 (0.0010) [2023-12-26 10:38:04,550][123090] Updated weights for policy 1, policy_version 1373263 (0.0006) [2023-12-26 10:38:04,584][123091] Updated weights for policy 0, policy_version 1382855 (0.0009) [2023-12-26 10:38:04,611][123090] Updated weights for policy 1, policy_version 1373273 (0.0009) [2023-12-26 10:38:05,277][123091] Updated weights for policy 0, policy_version 1382865 (0.0007) [2023-12-26 10:38:05,335][123091] Updated weights for policy 0, policy_version 1382875 (0.0006) [2023-12-26 10:38:05,384][123091] Updated weights for policy 0, policy_version 1382885 (0.0005) [2023-12-26 10:38:05,449][123091] Updated weights for policy 0, policy_version 1382895 (0.0006) [2023-12-26 10:38:05,489][123090] Updated weights for policy 1, policy_version 1373283 (0.0008) [2023-12-26 10:38:05,554][123090] Updated weights for policy 1, policy_version 1373293 (0.0008) [2023-12-26 10:38:05,627][123090] Updated weights for policy 1, policy_version 1373303 (0.0006) [2023-12-26 10:38:06,055][123091] Updated weights for policy 0, policy_version 1382905 (0.0006) [2023-12-26 10:38:06,122][123091] Updated weights for policy 0, policy_version 1382915 (0.0008) [2023-12-26 10:38:06,190][123091] Updated weights for policy 0, policy_version 1382925 (0.0011) [2023-12-26 10:38:06,334][123090] Updated weights for policy 1, policy_version 1373313 (0.0007) [2023-12-26 10:38:06,387][123090] Updated weights for policy 1, policy_version 1373323 (0.0009) [2023-12-26 10:38:06,458][123090] Updated weights for policy 1, policy_version 1373333 (0.0010) [2023-12-26 10:38:06,522][123090] Updated weights for policy 1, policy_version 1373343 (0.0009) [2023-12-26 10:38:06,985][123091] Updated weights for policy 0, policy_version 1382935 (0.0010) [2023-12-26 10:38:07,042][123091] Updated weights for policy 0, policy_version 1382945 (0.0009) [2023-12-26 10:38:07,106][123091] Updated weights for policy 0, policy_version 1382955 (0.0009) [2023-12-26 10:38:07,350][123090] Updated weights for policy 1, policy_version 1373353 (0.0009) [2023-12-26 10:38:07,410][123090] Updated weights for policy 1, policy_version 1373363 (0.0009) [2023-12-26 10:38:07,474][123090] Updated weights for policy 1, policy_version 1373373 (0.0011) [2023-12-26 10:38:07,945][123091] Updated weights for policy 0, policy_version 1382965 (0.0007) [2023-12-26 10:38:08,007][123091] Updated weights for policy 0, policy_version 1382975 (0.0005) [2023-12-26 10:38:08,064][123091] Updated weights for policy 0, policy_version 1382985 (0.0005) [2023-12-26 10:38:08,281][123090] Updated weights for policy 1, policy_version 1373383 (0.0010) [2023-12-26 10:38:08,336][123090] Updated weights for policy 1, policy_version 1373393 (0.0012) [2023-12-26 10:38:08,392][123090] Updated weights for policy 1, policy_version 1373403 (0.0007) [2023-12-26 10:38:08,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 705642496. Throughput: 0: 8916.5, 1: 8927.3. Samples: 705620992. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:08,785][121949] Avg episode reward: [(0, '6311.712'), (1, '5933.975')] [2023-12-26 10:38:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001373408_351592448.pth... [2023-12-26 10:38:08,793][123091] Updated weights for policy 0, policy_version 1382995 (0.0007) [2023-12-26 10:38:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001372384_351330304.pth [2023-12-26 10:38:08,848][123091] Updated weights for policy 0, policy_version 1383005 (0.0010) [2023-12-26 10:38:08,904][123091] Updated weights for policy 0, policy_version 1383015 (0.0011) [2023-12-26 10:38:08,958][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001383024_354058240.pth... [2023-12-26 10:38:08,964][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001382000_353796096.pth [2023-12-26 10:38:09,187][123090] Updated weights for policy 1, policy_version 1373413 (0.0008) [2023-12-26 10:38:09,250][123090] Updated weights for policy 1, policy_version 1373423 (0.0011) [2023-12-26 10:38:09,316][123090] Updated weights for policy 1, policy_version 1373433 (0.0009) [2023-12-26 10:38:09,742][123091] Updated weights for policy 0, policy_version 1383025 (0.0011) [2023-12-26 10:38:09,808][123091] Updated weights for policy 0, policy_version 1383035 (0.0010) [2023-12-26 10:38:09,881][123091] Updated weights for policy 0, policy_version 1383045 (0.0011) [2023-12-26 10:38:09,953][123091] Updated weights for policy 0, policy_version 1383055 (0.0011) [2023-12-26 10:38:10,159][123090] Updated weights for policy 1, policy_version 1373443 (0.0010) [2023-12-26 10:38:10,218][123090] Updated weights for policy 1, policy_version 1373453 (0.0008) [2023-12-26 10:38:10,284][123090] Updated weights for policy 1, policy_version 1373463 (0.0008) [2023-12-26 10:38:10,768][123091] Updated weights for policy 0, policy_version 1383065 (0.0010) [2023-12-26 10:38:10,827][123091] Updated weights for policy 0, policy_version 1383075 (0.0011) [2023-12-26 10:38:10,874][123091] Updated weights for policy 0, policy_version 1383085 (0.0010) [2023-12-26 10:38:11,005][123090] Updated weights for policy 1, policy_version 1373473 (0.0008) [2023-12-26 10:38:11,071][123090] Updated weights for policy 1, policy_version 1373483 (0.0010) [2023-12-26 10:38:11,133][123090] Updated weights for policy 1, policy_version 1373493 (0.0010) [2023-12-26 10:38:11,198][123090] Updated weights for policy 1, policy_version 1373503 (0.0010) [2023-12-26 10:38:11,767][123091] Updated weights for policy 0, policy_version 1383095 (0.0010) [2023-12-26 10:38:11,825][123091] Updated weights for policy 0, policy_version 1383105 (0.0010) [2023-12-26 10:38:11,892][123091] Updated weights for policy 0, policy_version 1383115 (0.0010) [2023-12-26 10:38:12,045][123090] Updated weights for policy 1, policy_version 1373513 (0.0010) [2023-12-26 10:38:12,101][123090] Updated weights for policy 1, policy_version 1373523 (0.0006) [2023-12-26 10:38:12,172][123090] Updated weights for policy 1, policy_version 1373533 (0.0007) [2023-12-26 10:38:12,796][123091] Updated weights for policy 0, policy_version 1383125 (0.0009) [2023-12-26 10:38:12,853][123091] Updated weights for policy 0, policy_version 1383135 (0.0010) [2023-12-26 10:38:12,905][123091] Updated weights for policy 0, policy_version 1383145 (0.0010) [2023-12-26 10:38:12,982][123090] Updated weights for policy 1, policy_version 1373543 (0.0007) [2023-12-26 10:38:13,034][123090] Updated weights for policy 1, policy_version 1373553 (0.0009) [2023-12-26 10:38:13,097][123090] Updated weights for policy 1, policy_version 1373563 (0.0008) [2023-12-26 10:38:13,754][123091] Updated weights for policy 0, policy_version 1383155 (0.0010) [2023-12-26 10:38:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 705724416. Throughput: 0: 8735.5, 1: 8791.8. Samples: 705724284. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:13,785][121949] Avg episode reward: [(0, '6288.678'), (1, '5847.799')] [2023-12-26 10:38:13,811][123091] Updated weights for policy 0, policy_version 1383165 (0.0009) [2023-12-26 10:38:13,877][123091] Updated weights for policy 0, policy_version 1383175 (0.0009) [2023-12-26 10:38:13,925][123090] Updated weights for policy 1, policy_version 1373573 (0.0009) [2023-12-26 10:38:13,989][123090] Updated weights for policy 1, policy_version 1373583 (0.0005) [2023-12-26 10:38:14,049][123090] Updated weights for policy 1, policy_version 1373593 (0.0005) [2023-12-26 10:38:14,713][123091] Updated weights for policy 0, policy_version 1383185 (0.0009) [2023-12-26 10:38:14,768][123091] Updated weights for policy 0, policy_version 1383196 (0.0010) [2023-12-26 10:38:14,834][123091] Updated weights for policy 0, policy_version 1383206 (0.0008) [2023-12-26 10:38:14,836][123090] Updated weights for policy 1, policy_version 1373603 (0.0009) [2023-12-26 10:38:14,901][123091] Updated weights for policy 0, policy_version 1383216 (0.0009) [2023-12-26 10:38:14,902][123090] Updated weights for policy 1, policy_version 1373613 (0.0009) [2023-12-26 10:38:14,969][123090] Updated weights for policy 1, policy_version 1373623 (0.0010) [2023-12-26 10:38:15,681][123090] Updated weights for policy 1, policy_version 1373633 (0.0008) [2023-12-26 10:38:15,746][123090] Updated weights for policy 1, policy_version 1373643 (0.0008) [2023-12-26 10:38:15,758][123091] Updated weights for policy 0, policy_version 1383226 (0.0009) [2023-12-26 10:38:15,809][123090] Updated weights for policy 1, policy_version 1373653 (0.0005) [2023-12-26 10:38:15,818][123091] Updated weights for policy 0, policy_version 1383236 (0.0009) [2023-12-26 10:38:15,873][123090] Updated weights for policy 1, policy_version 1373663 (0.0008) [2023-12-26 10:38:15,876][123091] Updated weights for policy 0, policy_version 1383246 (0.0008) [2023-12-26 10:38:16,632][123090] Updated weights for policy 1, policy_version 1373673 (0.0007) [2023-12-26 10:38:16,701][123090] Updated weights for policy 1, policy_version 1373683 (0.0008) [2023-12-26 10:38:16,726][123091] Updated weights for policy 0, policy_version 1383256 (0.0010) [2023-12-26 10:38:16,753][123090] Updated weights for policy 1, policy_version 1373693 (0.0007) [2023-12-26 10:38:16,784][123091] Updated weights for policy 0, policy_version 1383266 (0.0008) [2023-12-26 10:38:16,842][123091] Updated weights for policy 0, policy_version 1383276 (0.0010) [2023-12-26 10:38:17,521][123090] Updated weights for policy 1, policy_version 1373703 (0.0009) [2023-12-26 10:38:17,581][123090] Updated weights for policy 1, policy_version 1373713 (0.0009) [2023-12-26 10:38:17,642][123090] Updated weights for policy 1, policy_version 1373723 (0.0009) [2023-12-26 10:38:17,674][123091] Updated weights for policy 0, policy_version 1383286 (0.0009) [2023-12-26 10:38:17,739][123091] Updated weights for policy 0, policy_version 1383296 (0.0009) [2023-12-26 10:38:17,800][123091] Updated weights for policy 0, policy_version 1383306 (0.0010) [2023-12-26 10:38:18,356][123090] Updated weights for policy 1, policy_version 1373733 (0.0008) [2023-12-26 10:38:18,418][123090] Updated weights for policy 1, policy_version 1373743 (0.0006) [2023-12-26 10:38:18,479][123090] Updated weights for policy 1, policy_version 1373753 (0.0005) [2023-12-26 10:38:18,731][123091] Updated weights for policy 0, policy_version 1383316 (0.0010) [2023-12-26 10:38:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 705814528. Throughput: 0: 8676.5, 1: 8847.2. Samples: 705829052. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:18,785][121949] Avg episode reward: [(0, '6395.210'), (1, '5798.229')] [2023-12-26 10:38:18,794][123091] Updated weights for policy 0, policy_version 1383326 (0.0008) [2023-12-26 10:38:18,858][123091] Updated weights for policy 0, policy_version 1383336 (0.0009) [2023-12-26 10:38:19,204][123090] Updated weights for policy 1, policy_version 1373763 (0.0007) [2023-12-26 10:38:19,275][123090] Updated weights for policy 1, policy_version 1373773 (0.0008) [2023-12-26 10:38:19,348][123090] Updated weights for policy 1, policy_version 1373783 (0.0007) [2023-12-26 10:38:19,669][123091] Updated weights for policy 0, policy_version 1383346 (0.0008) [2023-12-26 10:38:19,748][123091] Updated weights for policy 0, policy_version 1383356 (0.0006) [2023-12-26 10:38:19,823][123091] Updated weights for policy 0, policy_version 1383366 (0.0007) [2023-12-26 10:38:19,893][123091] Updated weights for policy 0, policy_version 1383376 (0.0009) [2023-12-26 10:38:20,166][123090] Updated weights for policy 1, policy_version 1373793 (0.0008) [2023-12-26 10:38:20,230][123090] Updated weights for policy 1, policy_version 1373803 (0.0008) [2023-12-26 10:38:20,309][123090] Updated weights for policy 1, policy_version 1373813 (0.0008) [2023-12-26 10:38:20,376][123090] Updated weights for policy 1, policy_version 1373823 (0.0008) [2023-12-26 10:38:20,650][123091] Updated weights for policy 0, policy_version 1383386 (0.0009) [2023-12-26 10:38:20,717][123091] Updated weights for policy 0, policy_version 1383396 (0.0009) [2023-12-26 10:38:20,778][123091] Updated weights for policy 0, policy_version 1383406 (0.0010) [2023-12-26 10:38:21,240][123090] Updated weights for policy 1, policy_version 1373833 (0.0010) [2023-12-26 10:38:21,300][123090] Updated weights for policy 1, policy_version 1373843 (0.0010) [2023-12-26 10:38:21,368][123090] Updated weights for policy 1, policy_version 1373853 (0.0009) [2023-12-26 10:38:21,595][123091] Updated weights for policy 0, policy_version 1383416 (0.0010) [2023-12-26 10:38:21,669][123091] Updated weights for policy 0, policy_version 1383426 (0.0009) [2023-12-26 10:38:21,739][123091] Updated weights for policy 0, policy_version 1383436 (0.0007) [2023-12-26 10:38:22,186][123090] Updated weights for policy 1, policy_version 1373863 (0.0010) [2023-12-26 10:38:22,248][123090] Updated weights for policy 1, policy_version 1373873 (0.0010) [2023-12-26 10:38:22,323][123090] Updated weights for policy 1, policy_version 1373883 (0.0009) [2023-12-26 10:38:22,584][123091] Updated weights for policy 0, policy_version 1383446 (0.0010) [2023-12-26 10:38:22,651][123091] Updated weights for policy 0, policy_version 1383456 (0.0006) [2023-12-26 10:38:22,729][123091] Updated weights for policy 0, policy_version 1383466 (0.0006) [2023-12-26 10:38:23,173][123090] Updated weights for policy 1, policy_version 1373893 (0.0007) [2023-12-26 10:38:23,228][123090] Updated weights for policy 1, policy_version 1373903 (0.0006) [2023-12-26 10:38:23,286][123090] Updated weights for policy 1, policy_version 1373913 (0.0008) [2023-12-26 10:38:23,457][123091] Updated weights for policy 0, policy_version 1383476 (0.0007) [2023-12-26 10:38:23,522][123091] Updated weights for policy 0, policy_version 1383487 (0.0010) [2023-12-26 10:38:23,576][123091] Updated weights for policy 0, policy_version 1383497 (0.0010) [2023-12-26 10:38:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 705904640. Throughput: 0: 8634.6, 1: 8784.5. Samples: 705879840. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:23,785][121949] Avg episode reward: [(0, '6484.400'), (1, '5809.033')] [2023-12-26 10:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001383504_354181120.pth... [2023-12-26 10:38:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001373920_351723520.pth... [2023-12-26 10:38:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001382512_353927168.pth [2023-12-26 10:38:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001372896_351461376.pth [2023-12-26 10:38:23,979][123090] Updated weights for policy 1, policy_version 1373923 (0.0006) [2023-12-26 10:38:24,045][123090] Updated weights for policy 1, policy_version 1373933 (0.0009) [2023-12-26 10:38:24,109][123090] Updated weights for policy 1, policy_version 1373944 (0.0007) [2023-12-26 10:38:24,469][123091] Updated weights for policy 0, policy_version 1383507 (0.0009) [2023-12-26 10:38:24,521][123091] Updated weights for policy 0, policy_version 1383517 (0.0009) [2023-12-26 10:38:24,570][123091] Updated weights for policy 0, policy_version 1383527 (0.0009) [2023-12-26 10:38:24,847][123090] Updated weights for policy 1, policy_version 1373954 (0.0006) [2023-12-26 10:38:24,916][123090] Updated weights for policy 1, policy_version 1373964 (0.0005) [2023-12-26 10:38:24,986][123090] Updated weights for policy 1, policy_version 1373974 (0.0005) [2023-12-26 10:38:25,051][123090] Updated weights for policy 1, policy_version 1373984 (0.0005) [2023-12-26 10:38:25,492][123091] Updated weights for policy 0, policy_version 1383537 (0.0010) [2023-12-26 10:38:25,547][123091] Updated weights for policy 0, policy_version 1383548 (0.0010) [2023-12-26 10:38:25,602][123091] Updated weights for policy 0, policy_version 1383558 (0.0010) [2023-12-26 10:38:25,661][123091] Updated weights for policy 0, policy_version 1383568 (0.0009) [2023-12-26 10:38:25,713][123090] Updated weights for policy 1, policy_version 1373994 (0.0010) [2023-12-26 10:38:25,763][123090] Updated weights for policy 1, policy_version 1374004 (0.0010) [2023-12-26 10:38:25,813][123090] Updated weights for policy 1, policy_version 1374014 (0.0010) [2023-12-26 10:38:26,537][123091] Updated weights for policy 0, policy_version 1383578 (0.0009) [2023-12-26 10:38:26,570][123090] Updated weights for policy 1, policy_version 1374024 (0.0008) [2023-12-26 10:38:26,595][123091] Updated weights for policy 0, policy_version 1383588 (0.0007) [2023-12-26 10:38:26,620][123090] Updated weights for policy 1, policy_version 1374034 (0.0009) [2023-12-26 10:38:26,640][123091] Updated weights for policy 0, policy_version 1383598 (0.0007) [2023-12-26 10:38:26,673][123090] Updated weights for policy 1, policy_version 1374044 (0.0008) [2023-12-26 10:38:27,372][123090] Updated weights for policy 1, policy_version 1374054 (0.0007) [2023-12-26 10:38:27,431][123090] Updated weights for policy 1, policy_version 1374064 (0.0010) [2023-12-26 10:38:27,492][123090] Updated weights for policy 1, policy_version 1374074 (0.0010) [2023-12-26 10:38:27,541][123091] Updated weights for policy 0, policy_version 1383608 (0.0005) [2023-12-26 10:38:27,601][123091] Updated weights for policy 0, policy_version 1383619 (0.0008) [2023-12-26 10:38:27,667][123091] Updated weights for policy 0, policy_version 1383629 (0.0005) [2023-12-26 10:38:28,270][123091] Updated weights for policy 0, policy_version 1383639 (0.0005) [2023-12-26 10:38:28,319][123091] Updated weights for policy 0, policy_version 1383649 (0.0005) [2023-12-26 10:38:28,384][123090] Updated weights for policy 1, policy_version 1374084 (0.0009) [2023-12-26 10:38:28,392][123091] Updated weights for policy 0, policy_version 1383659 (0.0007) [2023-12-26 10:38:28,449][123090] Updated weights for policy 1, policy_version 1374094 (0.0010) [2023-12-26 10:38:28,502][123090] Updated weights for policy 1, policy_version 1374104 (0.0008) [2023-12-26 10:38:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 705994752. Throughput: 0: 8572.1, 1: 8894.1. Samples: 705985796. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:28,784][121949] Avg episode reward: [(0, '6411.079'), (1, '5877.944')] [2023-12-26 10:38:29,115][123091] Updated weights for policy 0, policy_version 1383669 (0.0007) [2023-12-26 10:38:29,174][123091] Updated weights for policy 0, policy_version 1383680 (0.0009) [2023-12-26 10:38:29,240][123091] Updated weights for policy 0, policy_version 1383690 (0.0009) [2023-12-26 10:38:29,391][123090] Updated weights for policy 1, policy_version 1374114 (0.0009) [2023-12-26 10:38:29,458][123090] Updated weights for policy 1, policy_version 1374124 (0.0011) [2023-12-26 10:38:29,529][123090] Updated weights for policy 1, policy_version 1374134 (0.0011) [2023-12-26 10:38:29,588][123090] Updated weights for policy 1, policy_version 1374144 (0.0010) [2023-12-26 10:38:30,092][123091] Updated weights for policy 0, policy_version 1383700 (0.0009) [2023-12-26 10:38:30,144][123091] Updated weights for policy 0, policy_version 1383710 (0.0008) [2023-12-26 10:38:30,208][123091] Updated weights for policy 0, policy_version 1383720 (0.0009) [2023-12-26 10:38:30,399][123090] Updated weights for policy 1, policy_version 1374154 (0.0010) [2023-12-26 10:38:30,446][123090] Updated weights for policy 1, policy_version 1374164 (0.0010) [2023-12-26 10:38:30,502][123090] Updated weights for policy 1, policy_version 1374174 (0.0010) [2023-12-26 10:38:31,060][123091] Updated weights for policy 0, policy_version 1383730 (0.0009) [2023-12-26 10:38:31,124][123091] Updated weights for policy 0, policy_version 1383740 (0.0009) [2023-12-26 10:38:31,192][123091] Updated weights for policy 0, policy_version 1383750 (0.0009) [2023-12-26 10:38:31,259][123091] Updated weights for policy 0, policy_version 1383760 (0.0009) [2023-12-26 10:38:31,375][123090] Updated weights for policy 1, policy_version 1374184 (0.0011) [2023-12-26 10:38:31,428][123090] Updated weights for policy 1, policy_version 1374194 (0.0010) [2023-12-26 10:38:31,475][123090] Updated weights for policy 1, policy_version 1374204 (0.0010) [2023-12-26 10:38:32,086][123091] Updated weights for policy 0, policy_version 1383770 (0.0009) [2023-12-26 10:38:32,146][123091] Updated weights for policy 0, policy_version 1383780 (0.0008) [2023-12-26 10:38:32,209][123091] Updated weights for policy 0, policy_version 1383790 (0.0008) [2023-12-26 10:38:32,305][123090] Updated weights for policy 1, policy_version 1374214 (0.0010) [2023-12-26 10:38:32,380][123090] Updated weights for policy 1, policy_version 1374224 (0.0011) [2023-12-26 10:38:32,436][123090] Updated weights for policy 1, policy_version 1374234 (0.0010) [2023-12-26 10:38:33,038][123091] Updated weights for policy 0, policy_version 1383800 (0.0009) [2023-12-26 10:38:33,089][123091] Updated weights for policy 0, policy_version 1383810 (0.0008) [2023-12-26 10:38:33,141][123091] Updated weights for policy 0, policy_version 1383820 (0.0008) [2023-12-26 10:38:33,252][123090] Updated weights for policy 1, policy_version 1374244 (0.0011) [2023-12-26 10:38:33,303][123090] Updated weights for policy 1, policy_version 1374254 (0.0010) [2023-12-26 10:38:33,362][123090] Updated weights for policy 1, policy_version 1374264 (0.0011) [2023-12-26 10:38:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 706076672. Throughput: 0: 8551.8, 1: 8861.3. Samples: 706088552. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:33,784][121949] Avg episode reward: [(0, '6382.743'), (1, '5900.131')] [2023-12-26 10:38:33,986][123091] Updated weights for policy 0, policy_version 1383830 (0.0007) [2023-12-26 10:38:34,037][123091] Updated weights for policy 0, policy_version 1383840 (0.0005) [2023-12-26 10:38:34,090][123091] Updated weights for policy 0, policy_version 1383850 (0.0005) [2023-12-26 10:38:34,202][123090] Updated weights for policy 1, policy_version 1374274 (0.0010) [2023-12-26 10:38:34,259][123090] Updated weights for policy 1, policy_version 1374284 (0.0011) [2023-12-26 10:38:34,331][123090] Updated weights for policy 1, policy_version 1374294 (0.0008) [2023-12-26 10:38:34,391][123090] Updated weights for policy 1, policy_version 1374304 (0.0006) [2023-12-26 10:38:34,842][123091] Updated weights for policy 0, policy_version 1383860 (0.0008) [2023-12-26 10:38:34,903][123091] Updated weights for policy 0, policy_version 1383870 (0.0009) [2023-12-26 10:38:34,963][123091] Updated weights for policy 0, policy_version 1383880 (0.0009) [2023-12-26 10:38:35,120][123090] Updated weights for policy 1, policy_version 1374314 (0.0007) [2023-12-26 10:38:35,164][123090] Updated weights for policy 1, policy_version 1374324 (0.0010) [2023-12-26 10:38:35,212][123090] Updated weights for policy 1, policy_version 1374334 (0.0010) [2023-12-26 10:38:35,767][123091] Updated weights for policy 0, policy_version 1383890 (0.0009) [2023-12-26 10:38:35,833][123091] Updated weights for policy 0, policy_version 1383900 (0.0009) [2023-12-26 10:38:35,886][123091] Updated weights for policy 0, policy_version 1383910 (0.0009) [2023-12-26 10:38:35,935][123091] Updated weights for policy 0, policy_version 1383920 (0.0007) [2023-12-26 10:38:35,953][123090] Updated weights for policy 1, policy_version 1374344 (0.0009) [2023-12-26 10:38:36,008][123090] Updated weights for policy 1, policy_version 1374354 (0.0010) [2023-12-26 10:38:36,063][123090] Updated weights for policy 1, policy_version 1374364 (0.0010) [2023-12-26 10:38:36,799][123091] Updated weights for policy 0, policy_version 1383930 (0.0009) [2023-12-26 10:38:36,858][123091] Updated weights for policy 0, policy_version 1383940 (0.0009) [2023-12-26 10:38:36,911][123090] Updated weights for policy 1, policy_version 1374374 (0.0011) [2023-12-26 10:38:36,923][123091] Updated weights for policy 0, policy_version 1383950 (0.0007) [2023-12-26 10:38:36,978][123090] Updated weights for policy 1, policy_version 1374384 (0.0010) [2023-12-26 10:38:37,037][123090] Updated weights for policy 1, policy_version 1374394 (0.0010) [2023-12-26 10:38:37,757][123091] Updated weights for policy 0, policy_version 1383960 (0.0009) [2023-12-26 10:38:37,810][123091] Updated weights for policy 0, policy_version 1383970 (0.0009) [2023-12-26 10:38:37,847][123090] Updated weights for policy 1, policy_version 1374404 (0.0010) [2023-12-26 10:38:37,864][123091] Updated weights for policy 0, policy_version 1383980 (0.0007) [2023-12-26 10:38:37,907][123090] Updated weights for policy 1, policy_version 1374414 (0.0010) [2023-12-26 10:38:37,959][123090] Updated weights for policy 1, policy_version 1374424 (0.0010) [2023-12-26 10:38:38,717][123091] Updated weights for policy 0, policy_version 1383990 (0.0009) [2023-12-26 10:38:38,766][123091] Updated weights for policy 0, policy_version 1384000 (0.0009) [2023-12-26 10:38:38,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 706158592. Throughput: 0: 8572.1, 1: 8905.9. Samples: 706142488. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:38,785][121949] Avg episode reward: [(0, '6399.484'), (1, '5813.164')] [2023-12-26 10:38:38,799][123090] Updated weights for policy 1, policy_version 1374434 (0.0010) [2023-12-26 10:38:38,823][123091] Updated weights for policy 0, policy_version 1384010 (0.0007) [2023-12-26 10:38:38,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001384016_354312192.pth... [2023-12-26 10:38:38,854][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001383024_354058240.pth [2023-12-26 10:38:38,859][123090] Updated weights for policy 1, policy_version 1374444 (0.0010) [2023-12-26 10:38:38,925][123090] Updated weights for policy 1, policy_version 1374454 (0.0010) [2023-12-26 10:38:38,991][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001374464_351862784.pth... [2023-12-26 10:38:38,991][123090] Updated weights for policy 1, policy_version 1374464 (0.0010) [2023-12-26 10:38:38,996][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001373408_351592448.pth [2023-12-26 10:38:39,698][123091] Updated weights for policy 0, policy_version 1384020 (0.0008) [2023-12-26 10:38:39,747][123091] Updated weights for policy 0, policy_version 1384030 (0.0009) [2023-12-26 10:38:39,811][123091] Updated weights for policy 0, policy_version 1384040 (0.0009) [2023-12-26 10:38:39,876][123090] Updated weights for policy 1, policy_version 1374475 (0.0009) [2023-12-26 10:38:39,943][123090] Updated weights for policy 1, policy_version 1374485 (0.0011) [2023-12-26 10:38:40,015][123090] Updated weights for policy 1, policy_version 1374495 (0.0011) [2023-12-26 10:38:40,694][123091] Updated weights for policy 0, policy_version 1384050 (0.0009) [2023-12-26 10:38:40,758][123091] Updated weights for policy 0, policy_version 1384060 (0.0009) [2023-12-26 10:38:40,796][123090] Updated weights for policy 1, policy_version 1374505 (0.0007) [2023-12-26 10:38:40,822][123091] Updated weights for policy 0, policy_version 1384070 (0.0010) [2023-12-26 10:38:40,860][123090] Updated weights for policy 1, policy_version 1374515 (0.0009) [2023-12-26 10:38:40,885][123091] Updated weights for policy 0, policy_version 1384080 (0.0008) [2023-12-26 10:38:40,926][123090] Updated weights for policy 1, policy_version 1374525 (0.0010) [2023-12-26 10:38:41,663][123091] Updated weights for policy 0, policy_version 1384091 (0.0009) [2023-12-26 10:38:41,725][123090] Updated weights for policy 1, policy_version 1374535 (0.0008) [2023-12-26 10:38:41,731][123091] Updated weights for policy 0, policy_version 1384101 (0.0009) [2023-12-26 10:38:41,798][123090] Updated weights for policy 1, policy_version 1374545 (0.0006) [2023-12-26 10:38:41,801][123091] Updated weights for policy 0, policy_version 1384111 (0.0011) [2023-12-26 10:38:41,852][123090] Updated weights for policy 1, policy_version 1374555 (0.0007) [2023-12-26 10:38:42,568][123090] Updated weights for policy 1, policy_version 1374565 (0.0009) [2023-12-26 10:38:42,626][123091] Updated weights for policy 0, policy_version 1384121 (0.0011) [2023-12-26 10:38:42,629][123090] Updated weights for policy 1, policy_version 1374575 (0.0009) [2023-12-26 10:38:42,681][123090] Updated weights for policy 1, policy_version 1374585 (0.0005) [2023-12-26 10:38:42,683][123091] Updated weights for policy 0, policy_version 1384131 (0.0006) [2023-12-26 10:38:42,750][123091] Updated weights for policy 0, policy_version 1384141 (0.0005) [2023-12-26 10:38:43,445][123090] Updated weights for policy 1, policy_version 1374595 (0.0007) [2023-12-26 10:38:43,507][123091] Updated weights for policy 0, policy_version 1384151 (0.0006) [2023-12-26 10:38:43,508][123090] Updated weights for policy 1, policy_version 1374605 (0.0010) [2023-12-26 10:38:43,570][123091] Updated weights for policy 0, policy_version 1384161 (0.0008) [2023-12-26 10:38:43,572][123090] Updated weights for policy 1, policy_version 1374615 (0.0006) [2023-12-26 10:38:43,636][123091] Updated weights for policy 0, policy_version 1384171 (0.0008) [2023-12-26 10:38:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 706256896. Throughput: 0: 8581.0, 1: 8810.1. Samples: 706244960. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:43,785][121949] Avg episode reward: [(0, '6356.004'), (1, '5764.308')] [2023-12-26 10:38:44,389][123090] Updated weights for policy 1, policy_version 1374625 (0.0006) [2023-12-26 10:38:44,441][123090] Updated weights for policy 1, policy_version 1374635 (0.0009) [2023-12-26 10:38:44,470][123091] Updated weights for policy 0, policy_version 1384181 (0.0010) [2023-12-26 10:38:44,511][123090] Updated weights for policy 1, policy_version 1374645 (0.0008) [2023-12-26 10:38:44,533][123091] Updated weights for policy 0, policy_version 1384191 (0.0006) [2023-12-26 10:38:44,575][123090] Updated weights for policy 1, policy_version 1374655 (0.0009) [2023-12-26 10:38:44,599][123091] Updated weights for policy 0, policy_version 1384201 (0.0008) [2023-12-26 10:38:45,406][123091] Updated weights for policy 0, policy_version 1384211 (0.0011) [2023-12-26 10:38:45,434][123090] Updated weights for policy 1, policy_version 1374665 (0.0007) [2023-12-26 10:38:45,465][123091] Updated weights for policy 0, policy_version 1384221 (0.0011) [2023-12-26 10:38:45,499][123090] Updated weights for policy 1, policy_version 1374675 (0.0006) [2023-12-26 10:38:45,529][123091] Updated weights for policy 0, policy_version 1384231 (0.0011) [2023-12-26 10:38:45,566][123090] Updated weights for policy 1, policy_version 1374685 (0.0006) [2023-12-26 10:38:46,294][123090] Updated weights for policy 1, policy_version 1374695 (0.0009) [2023-12-26 10:38:46,350][123090] Updated weights for policy 1, policy_version 1374705 (0.0009) [2023-12-26 10:38:46,368][123091] Updated weights for policy 0, policy_version 1384241 (0.0010) [2023-12-26 10:38:46,414][123091] Updated weights for policy 0, policy_version 1384251 (0.0008) [2023-12-26 10:38:46,415][123090] Updated weights for policy 1, policy_version 1374715 (0.0009) [2023-12-26 10:38:46,463][123091] Updated weights for policy 0, policy_version 1384261 (0.0006) [2023-12-26 10:38:46,517][123091] Updated weights for policy 0, policy_version 1384271 (0.0005) [2023-12-26 10:38:47,192][123091] Updated weights for policy 0, policy_version 1384281 (0.0008) [2023-12-26 10:38:47,250][123091] Updated weights for policy 0, policy_version 1384291 (0.0010) [2023-12-26 10:38:47,294][123090] Updated weights for policy 1, policy_version 1374725 (0.0008) [2023-12-26 10:38:47,308][123091] Updated weights for policy 0, policy_version 1384301 (0.0010) [2023-12-26 10:38:47,360][123090] Updated weights for policy 1, policy_version 1374735 (0.0008) [2023-12-26 10:38:47,409][123090] Updated weights for policy 1, policy_version 1374745 (0.0007) [2023-12-26 10:38:48,037][123091] Updated weights for policy 0, policy_version 1384311 (0.0007) [2023-12-26 10:38:48,049][123090] Updated weights for policy 1, policy_version 1374755 (0.0005) [2023-12-26 10:38:48,095][123091] Updated weights for policy 0, policy_version 1384321 (0.0006) [2023-12-26 10:38:48,104][123090] Updated weights for policy 1, policy_version 1374765 (0.0005) [2023-12-26 10:38:48,150][123091] Updated weights for policy 0, policy_version 1384331 (0.0007) [2023-12-26 10:38:48,170][123090] Updated weights for policy 1, policy_version 1374775 (0.0008) [2023-12-26 10:38:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 706338816. Throughput: 0: 8662.8, 1: 8806.5. Samples: 706352364. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:48,785][121949] Avg episode reward: [(0, '6354.819'), (1, '5801.924')] [2023-12-26 10:38:48,921][123091] Updated weights for policy 0, policy_version 1384341 (0.0011) [2023-12-26 10:38:48,969][123091] Updated weights for policy 0, policy_version 1384351 (0.0010) [2023-12-26 10:38:48,992][123090] Updated weights for policy 1, policy_version 1374785 (0.0008) [2023-12-26 10:38:49,017][123091] Updated weights for policy 0, policy_version 1384361 (0.0010) [2023-12-26 10:38:49,052][123090] Updated weights for policy 1, policy_version 1374795 (0.0005) [2023-12-26 10:38:49,113][123090] Updated weights for policy 1, policy_version 1374805 (0.0005) [2023-12-26 10:38:49,164][123090] Updated weights for policy 1, policy_version 1374815 (0.0005) [2023-12-26 10:38:49,840][123091] Updated weights for policy 0, policy_version 1384371 (0.0010) [2023-12-26 10:38:49,908][123091] Updated weights for policy 0, policy_version 1384381 (0.0007) [2023-12-26 10:38:49,962][123090] Updated weights for policy 1, policy_version 1374825 (0.0007) [2023-12-26 10:38:49,976][123091] Updated weights for policy 0, policy_version 1384391 (0.0008) [2023-12-26 10:38:50,021][123090] Updated weights for policy 1, policy_version 1374835 (0.0008) [2023-12-26 10:38:50,092][123090] Updated weights for policy 1, policy_version 1374845 (0.0008) [2023-12-26 10:38:50,735][123091] Updated weights for policy 0, policy_version 1384401 (0.0008) [2023-12-26 10:38:50,801][123091] Updated weights for policy 0, policy_version 1384411 (0.0010) [2023-12-26 10:38:50,868][123091] Updated weights for policy 0, policy_version 1384421 (0.0009) [2023-12-26 10:38:50,932][123091] Updated weights for policy 0, policy_version 1384431 (0.0009) [2023-12-26 10:38:50,938][123090] Updated weights for policy 1, policy_version 1374855 (0.0009) [2023-12-26 10:38:51,007][123090] Updated weights for policy 1, policy_version 1374865 (0.0009) [2023-12-26 10:38:51,066][123090] Updated weights for policy 1, policy_version 1374875 (0.0009) [2023-12-26 10:38:51,799][123091] Updated weights for policy 0, policy_version 1384441 (0.0010) [2023-12-26 10:38:51,860][123091] Updated weights for policy 0, policy_version 1384451 (0.0009) [2023-12-26 10:38:51,918][123090] Updated weights for policy 1, policy_version 1374885 (0.0008) [2023-12-26 10:38:51,925][123091] Updated weights for policy 0, policy_version 1384461 (0.0010) [2023-12-26 10:38:51,980][123090] Updated weights for policy 1, policy_version 1374895 (0.0009) [2023-12-26 10:38:52,043][123090] Updated weights for policy 1, policy_version 1374905 (0.0009) [2023-12-26 10:38:52,744][123091] Updated weights for policy 0, policy_version 1384471 (0.0010) [2023-12-26 10:38:52,796][123091] Updated weights for policy 0, policy_version 1384481 (0.0011) [2023-12-26 10:38:52,806][123090] Updated weights for policy 1, policy_version 1374915 (0.0009) [2023-12-26 10:38:52,851][123091] Updated weights for policy 0, policy_version 1384491 (0.0011) [2023-12-26 10:38:52,863][123090] Updated weights for policy 1, policy_version 1374925 (0.0006) [2023-12-26 10:38:52,931][123090] Updated weights for policy 1, policy_version 1374935 (0.0008) [2023-12-26 10:38:53,691][123091] Updated weights for policy 0, policy_version 1384501 (0.0011) [2023-12-26 10:38:53,739][123091] Updated weights for policy 0, policy_version 1384511 (0.0011) [2023-12-26 10:38:53,755][123090] Updated weights for policy 1, policy_version 1374945 (0.0009) [2023-12-26 10:38:53,784][123091] Updated weights for policy 0, policy_version 1384521 (0.0008) [2023-12-26 10:38:53,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 706420736. Throughput: 0: 8600.7, 1: 8812.7. Samples: 706404596. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:53,785][121949] Avg episode reward: [(0, '6372.250'), (1, '5760.972')] [2023-12-26 10:38:53,813][123090] Updated weights for policy 1, policy_version 1374955 (0.0009) [2023-12-26 10:38:53,825][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001384528_354443264.pth... [2023-12-26 10:38:53,828][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001383504_354181120.pth [2023-12-26 10:38:53,876][123090] Updated weights for policy 1, policy_version 1374965 (0.0010) [2023-12-26 10:38:53,928][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001374976_351993856.pth... [2023-12-26 10:38:53,930][123090] Updated weights for policy 1, policy_version 1374976 (0.0006) [2023-12-26 10:38:53,931][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001373920_351723520.pth [2023-12-26 10:38:54,644][123090] Updated weights for policy 1, policy_version 1374986 (0.0008) [2023-12-26 10:38:54,657][123091] Updated weights for policy 0, policy_version 1384531 (0.0007) [2023-12-26 10:38:54,710][123090] Updated weights for policy 1, policy_version 1374996 (0.0009) [2023-12-26 10:38:54,715][123091] Updated weights for policy 0, policy_version 1384541 (0.0007) [2023-12-26 10:38:54,760][123091] Updated weights for policy 0, policy_version 1384551 (0.0008) [2023-12-26 10:38:54,771][123090] Updated weights for policy 1, policy_version 1375006 (0.0008) [2023-12-26 10:38:55,545][123091] Updated weights for policy 0, policy_version 1384561 (0.0009) [2023-12-26 10:38:55,559][123090] Updated weights for policy 1, policy_version 1375016 (0.0009) [2023-12-26 10:38:55,607][123090] Updated weights for policy 1, policy_version 1375026 (0.0009) [2023-12-26 10:38:55,610][123091] Updated weights for policy 0, policy_version 1384571 (0.0008) [2023-12-26 10:38:55,670][123090] Updated weights for policy 1, policy_version 1375036 (0.0009) [2023-12-26 10:38:55,677][123091] Updated weights for policy 0, policy_version 1384581 (0.0006) [2023-12-26 10:38:55,733][123091] Updated weights for policy 0, policy_version 1384591 (0.0008) [2023-12-26 10:38:56,345][123091] Updated weights for policy 0, policy_version 1384601 (0.0010) [2023-12-26 10:38:56,397][123091] Updated weights for policy 0, policy_version 1384611 (0.0009) [2023-12-26 10:38:56,453][123091] Updated weights for policy 0, policy_version 1384621 (0.0009) [2023-12-26 10:38:56,567][123090] Updated weights for policy 1, policy_version 1375046 (0.0008) [2023-12-26 10:38:56,624][123090] Updated weights for policy 1, policy_version 1375056 (0.0008) [2023-12-26 10:38:56,680][123090] Updated weights for policy 1, policy_version 1375066 (0.0009) [2023-12-26 10:38:57,144][123091] Updated weights for policy 0, policy_version 1384631 (0.0007) [2023-12-26 10:38:57,201][123091] Updated weights for policy 0, policy_version 1384641 (0.0005) [2023-12-26 10:38:57,259][123091] Updated weights for policy 0, policy_version 1384651 (0.0006) [2023-12-26 10:38:57,581][123090] Updated weights for policy 1, policy_version 1375076 (0.0009) [2023-12-26 10:38:57,645][123090] Updated weights for policy 1, policy_version 1375086 (0.0009) [2023-12-26 10:38:57,711][123090] Updated weights for policy 1, policy_version 1375096 (0.0010) [2023-12-26 10:38:58,012][123091] Updated weights for policy 0, policy_version 1384661 (0.0007) [2023-12-26 10:38:58,080][123091] Updated weights for policy 0, policy_version 1384671 (0.0006) [2023-12-26 10:38:58,148][123091] Updated weights for policy 0, policy_version 1384681 (0.0007) [2023-12-26 10:38:58,541][123090] Updated weights for policy 1, policy_version 1375106 (0.0008) [2023-12-26 10:38:58,607][123090] Updated weights for policy 1, policy_version 1375116 (0.0011) [2023-12-26 10:38:58,668][123090] Updated weights for policy 1, policy_version 1375126 (0.0007) [2023-12-26 10:38:58,741][123090] Updated weights for policy 1, policy_version 1375136 (0.0007) [2023-12-26 10:38:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 706519040. Throughput: 0: 8666.9, 1: 8811.3. Samples: 706510804. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:38:58,785][121949] Avg episode reward: [(0, '6388.358'), (1, '5794.833')] [2023-12-26 10:38:59,015][123091] Updated weights for policy 0, policy_version 1384691 (0.0007) [2023-12-26 10:38:59,082][123091] Updated weights for policy 0, policy_version 1384701 (0.0008) [2023-12-26 10:38:59,148][123091] Updated weights for policy 0, policy_version 1384711 (0.0010) [2023-12-26 10:38:59,666][123090] Updated weights for policy 1, policy_version 1375146 (0.0005) [2023-12-26 10:38:59,738][123090] Updated weights for policy 1, policy_version 1375156 (0.0006) [2023-12-26 10:38:59,804][123090] Updated weights for policy 1, policy_version 1375166 (0.0009) [2023-12-26 10:38:59,853][123091] Updated weights for policy 0, policy_version 1384721 (0.0013) [2023-12-26 10:38:59,917][123091] Updated weights for policy 0, policy_version 1384731 (0.0010) [2023-12-26 10:38:59,986][123091] Updated weights for policy 0, policy_version 1384741 (0.0008) [2023-12-26 10:39:00,056][123091] Updated weights for policy 0, policy_version 1384751 (0.0008) [2023-12-26 10:39:00,528][123090] Updated weights for policy 1, policy_version 1375176 (0.0008) [2023-12-26 10:39:00,603][123090] Updated weights for policy 1, policy_version 1375186 (0.0008) [2023-12-26 10:39:00,672][123090] Updated weights for policy 1, policy_version 1375196 (0.0008) [2023-12-26 10:39:00,787][123091] Updated weights for policy 0, policy_version 1384761 (0.0006) [2023-12-26 10:39:00,862][123091] Updated weights for policy 0, policy_version 1384771 (0.0007) [2023-12-26 10:39:00,925][123091] Updated weights for policy 0, policy_version 1384781 (0.0009) [2023-12-26 10:39:01,434][123090] Updated weights for policy 1, policy_version 1375206 (0.0008) [2023-12-26 10:39:01,497][123090] Updated weights for policy 1, policy_version 1375216 (0.0008) [2023-12-26 10:39:01,556][123090] Updated weights for policy 1, policy_version 1375226 (0.0008) [2023-12-26 10:39:01,746][123091] Updated weights for policy 0, policy_version 1384791 (0.0009) [2023-12-26 10:39:01,810][123091] Updated weights for policy 0, policy_version 1384801 (0.0009) [2023-12-26 10:39:01,866][123091] Updated weights for policy 0, policy_version 1384811 (0.0009) [2023-12-26 10:39:02,359][123090] Updated weights for policy 1, policy_version 1375236 (0.0009) [2023-12-26 10:39:02,431][123090] Updated weights for policy 1, policy_version 1375246 (0.0009) [2023-12-26 10:39:02,499][123090] Updated weights for policy 1, policy_version 1375256 (0.0008) [2023-12-26 10:39:02,735][123091] Updated weights for policy 0, policy_version 1384822 (0.0008) [2023-12-26 10:39:02,793][123091] Updated weights for policy 0, policy_version 1384832 (0.0011) [2023-12-26 10:39:02,845][123091] Updated weights for policy 0, policy_version 1384842 (0.0010) [2023-12-26 10:39:03,174][123090] Updated weights for policy 1, policy_version 1375266 (0.0006) [2023-12-26 10:39:03,236][123090] Updated weights for policy 1, policy_version 1375276 (0.0005) [2023-12-26 10:39:03,314][123090] Updated weights for policy 1, policy_version 1375286 (0.0009) [2023-12-26 10:39:03,368][123090] Updated weights for policy 1, policy_version 1375296 (0.0009) [2023-12-26 10:39:03,539][123091] Updated weights for policy 0, policy_version 1384852 (0.0008) [2023-12-26 10:39:03,589][123091] Updated weights for policy 0, policy_version 1384862 (0.0005) [2023-12-26 10:39:03,641][123091] Updated weights for policy 0, policy_version 1384872 (0.0009) [2023-12-26 10:39:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 706609152. Throughput: 0: 8761.6, 1: 8752.5. Samples: 706617188. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:39:03,785][121949] Avg episode reward: [(0, '6384.917'), (1, '5838.247')] [2023-12-26 10:39:04,126][123090] Updated weights for policy 1, policy_version 1375306 (0.0006) [2023-12-26 10:39:04,198][123090] Updated weights for policy 1, policy_version 1375316 (0.0005) [2023-12-26 10:39:04,271][123090] Updated weights for policy 1, policy_version 1375326 (0.0006) [2023-12-26 10:39:04,461][123091] Updated weights for policy 0, policy_version 1384882 (0.0009) [2023-12-26 10:39:04,527][123091] Updated weights for policy 0, policy_version 1384892 (0.0007) [2023-12-26 10:39:04,583][123091] Updated weights for policy 0, policy_version 1384902 (0.0006) [2023-12-26 10:39:04,648][123091] Updated weights for policy 0, policy_version 1384912 (0.0007) [2023-12-26 10:39:05,020][123090] Updated weights for policy 1, policy_version 1375336 (0.0008) [2023-12-26 10:39:05,083][123090] Updated weights for policy 1, policy_version 1375346 (0.0006) [2023-12-26 10:39:05,141][123090] Updated weights for policy 1, policy_version 1375356 (0.0005) [2023-12-26 10:39:05,414][123091] Updated weights for policy 0, policy_version 1384922 (0.0010) [2023-12-26 10:39:05,458][123091] Updated weights for policy 0, policy_version 1384932 (0.0010) [2023-12-26 10:39:05,506][123091] Updated weights for policy 0, policy_version 1384942 (0.0010) [2023-12-26 10:39:05,835][123090] Updated weights for policy 1, policy_version 1375366 (0.0005) [2023-12-26 10:39:05,888][123090] Updated weights for policy 1, policy_version 1375376 (0.0005) [2023-12-26 10:39:05,945][123090] Updated weights for policy 1, policy_version 1375386 (0.0005) [2023-12-26 10:39:06,371][123091] Updated weights for policy 0, policy_version 1384952 (0.0011) [2023-12-26 10:39:06,444][123091] Updated weights for policy 0, policy_version 1384962 (0.0011) [2023-12-26 10:39:06,520][123091] Updated weights for policy 0, policy_version 1384972 (0.0011) [2023-12-26 10:39:06,687][123090] Updated weights for policy 1, policy_version 1375396 (0.0005) [2023-12-26 10:39:06,759][123090] Updated weights for policy 1, policy_version 1375406 (0.0007) [2023-12-26 10:39:06,821][123090] Updated weights for policy 1, policy_version 1375416 (0.0009) [2023-12-26 10:39:07,333][123091] Updated weights for policy 0, policy_version 1384982 (0.0013) [2023-12-26 10:39:07,392][123091] Updated weights for policy 0, policy_version 1384992 (0.0011) [2023-12-26 10:39:07,463][123091] Updated weights for policy 0, policy_version 1385002 (0.0011) [2023-12-26 10:39:07,650][123090] Updated weights for policy 1, policy_version 1375426 (0.0009) [2023-12-26 10:39:07,710][123090] Updated weights for policy 1, policy_version 1375436 (0.0010) [2023-12-26 10:39:07,775][123090] Updated weights for policy 1, policy_version 1375446 (0.0010) [2023-12-26 10:39:07,843][123090] Updated weights for policy 1, policy_version 1375456 (0.0009) [2023-12-26 10:39:08,130][123091] Updated weights for policy 0, policy_version 1385012 (0.0009) [2023-12-26 10:39:08,184][123091] Updated weights for policy 0, policy_version 1385022 (0.0006) [2023-12-26 10:39:08,240][123091] Updated weights for policy 0, policy_version 1385032 (0.0008) [2023-12-26 10:39:08,646][123090] Updated weights for policy 1, policy_version 1375466 (0.0005) [2023-12-26 10:39:08,708][123090] Updated weights for policy 1, policy_version 1375476 (0.0006) [2023-12-26 10:39:08,772][123090] Updated weights for policy 1, policy_version 1375486 (0.0005) [2023-12-26 10:39:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 706691072. Throughput: 0: 8768.3, 1: 8824.4. Samples: 706671512. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:39:08,785][121949] Avg episode reward: [(0, '6336.409'), (1, '5845.231')] [2023-12-26 10:39:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001385040_354574336.pth... [2023-12-26 10:39:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001375488_352124928.pth... [2023-12-26 10:39:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001374464_351862784.pth [2023-12-26 10:39:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001384016_354312192.pth [2023-12-26 10:39:08,952][123091] Updated weights for policy 0, policy_version 1385042 (0.0010) [2023-12-26 10:39:09,004][123091] Updated weights for policy 0, policy_version 1385052 (0.0010) [2023-12-26 10:39:09,057][123091] Updated weights for policy 0, policy_version 1385062 (0.0006) [2023-12-26 10:39:09,123][123091] Updated weights for policy 0, policy_version 1385072 (0.0005) [2023-12-26 10:39:09,430][123090] Updated weights for policy 1, policy_version 1375496 (0.0008) [2023-12-26 10:39:09,486][123090] Updated weights for policy 1, policy_version 1375506 (0.0007) [2023-12-26 10:39:09,545][123090] Updated weights for policy 1, policy_version 1375516 (0.0006) [2023-12-26 10:39:09,947][123091] Updated weights for policy 0, policy_version 1385082 (0.0009) [2023-12-26 10:39:10,018][123091] Updated weights for policy 0, policy_version 1385092 (0.0010) [2023-12-26 10:39:10,079][123091] Updated weights for policy 0, policy_version 1385102 (0.0010) [2023-12-26 10:39:10,408][123090] Updated weights for policy 1, policy_version 1375526 (0.0009) [2023-12-26 10:39:10,464][123090] Updated weights for policy 1, policy_version 1375536 (0.0011) [2023-12-26 10:39:10,512][123090] Updated weights for policy 1, policy_version 1375546 (0.0011) [2023-12-26 10:39:10,849][123091] Updated weights for policy 0, policy_version 1385112 (0.0007) [2023-12-26 10:39:10,913][123091] Updated weights for policy 0, policy_version 1385122 (0.0009) [2023-12-26 10:39:10,983][123091] Updated weights for policy 0, policy_version 1385132 (0.0005) [2023-12-26 10:39:11,280][123090] Updated weights for policy 1, policy_version 1375556 (0.0010) [2023-12-26 10:39:11,350][123090] Updated weights for policy 1, policy_version 1375566 (0.0008) [2023-12-26 10:39:11,429][123090] Updated weights for policy 1, policy_version 1375576 (0.0008) [2023-12-26 10:39:11,742][123091] Updated weights for policy 0, policy_version 1385142 (0.0007) [2023-12-26 10:39:11,805][123091] Updated weights for policy 0, policy_version 1385152 (0.0009) [2023-12-26 10:39:11,866][123091] Updated weights for policy 0, policy_version 1385162 (0.0009) [2023-12-26 10:39:12,227][123090] Updated weights for policy 1, policy_version 1375586 (0.0008) [2023-12-26 10:39:12,299][123090] Updated weights for policy 1, policy_version 1375596 (0.0010) [2023-12-26 10:39:12,363][123090] Updated weights for policy 1, policy_version 1375606 (0.0009) [2023-12-26 10:39:12,428][123090] Updated weights for policy 1, policy_version 1375616 (0.0009) [2023-12-26 10:39:12,704][123091] Updated weights for policy 0, policy_version 1385172 (0.0010) [2023-12-26 10:39:12,758][123091] Updated weights for policy 0, policy_version 1385182 (0.0009) [2023-12-26 10:39:12,823][123091] Updated weights for policy 0, policy_version 1385192 (0.0008) [2023-12-26 10:39:13,220][123090] Updated weights for policy 1, policy_version 1375626 (0.0010) [2023-12-26 10:39:13,273][123090] Updated weights for policy 1, policy_version 1375636 (0.0010) [2023-12-26 10:39:13,332][123090] Updated weights for policy 1, policy_version 1375646 (0.0011) [2023-12-26 10:39:13,670][123091] Updated weights for policy 0, policy_version 1385202 (0.0009) [2023-12-26 10:39:13,742][123091] Updated weights for policy 0, policy_version 1385212 (0.0009) [2023-12-26 10:39:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 706781184. Throughput: 0: 8871.4, 1: 8747.2. Samples: 706778640. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:39:13,785][121949] Avg episode reward: [(0, '6349.581'), (1, '5868.775')] [2023-12-26 10:39:13,816][123091] Updated weights for policy 0, policy_version 1385222 (0.0008) [2023-12-26 10:39:13,888][123091] Updated weights for policy 0, policy_version 1385232 (0.0009) [2023-12-26 10:39:14,149][123090] Updated weights for policy 1, policy_version 1375656 (0.0007) [2023-12-26 10:39:14,215][123090] Updated weights for policy 1, policy_version 1375666 (0.0008) [2023-12-26 10:39:14,276][123090] Updated weights for policy 1, policy_version 1375676 (0.0009) [2023-12-26 10:39:14,695][123091] Updated weights for policy 0, policy_version 1385242 (0.0010) [2023-12-26 10:39:14,748][123091] Updated weights for policy 0, policy_version 1385252 (0.0010) [2023-12-26 10:39:14,815][123091] Updated weights for policy 0, policy_version 1385262 (0.0010) [2023-12-26 10:39:15,047][123090] Updated weights for policy 1, policy_version 1375686 (0.0009) [2023-12-26 10:39:15,117][123090] Updated weights for policy 1, policy_version 1375696 (0.0008) [2023-12-26 10:39:15,173][123090] Updated weights for policy 1, policy_version 1375706 (0.0006) [2023-12-26 10:39:15,733][123091] Updated weights for policy 0, policy_version 1385272 (0.0010) [2023-12-26 10:39:15,800][123091] Updated weights for policy 0, policy_version 1385282 (0.0008) [2023-12-26 10:39:15,850][123090] Updated weights for policy 1, policy_version 1375716 (0.0008) [2023-12-26 10:39:15,865][123091] Updated weights for policy 0, policy_version 1385292 (0.0007) [2023-12-26 10:39:15,906][123090] Updated weights for policy 1, policy_version 1375726 (0.0011) [2023-12-26 10:39:15,959][123090] Updated weights for policy 1, policy_version 1375736 (0.0011) [2023-12-26 10:39:16,700][123091] Updated weights for policy 0, policy_version 1385302 (0.0006) [2023-12-26 10:39:16,757][123091] Updated weights for policy 0, policy_version 1385312 (0.0009) [2023-12-26 10:39:16,769][123090] Updated weights for policy 1, policy_version 1375746 (0.0006) [2023-12-26 10:39:16,801][123091] Updated weights for policy 0, policy_version 1385322 (0.0008) [2023-12-26 10:39:16,835][123090] Updated weights for policy 1, policy_version 1375756 (0.0009) [2023-12-26 10:39:16,898][123090] Updated weights for policy 1, policy_version 1375766 (0.0009) [2023-12-26 10:39:16,965][123090] Updated weights for policy 1, policy_version 1375776 (0.0009) [2023-12-26 10:39:17,624][123091] Updated weights for policy 0, policy_version 1385332 (0.0009) [2023-12-26 10:39:17,678][123091] Updated weights for policy 0, policy_version 1385342 (0.0009) [2023-12-26 10:39:17,732][123091] Updated weights for policy 0, policy_version 1385352 (0.0009) [2023-12-26 10:39:17,756][123090] Updated weights for policy 1, policy_version 1375786 (0.0008) [2023-12-26 10:39:17,811][123090] Updated weights for policy 1, policy_version 1375796 (0.0009) [2023-12-26 10:39:17,867][123090] Updated weights for policy 1, policy_version 1375806 (0.0009) [2023-12-26 10:39:18,608][123090] Updated weights for policy 1, policy_version 1375816 (0.0006) [2023-12-26 10:39:18,614][123091] Updated weights for policy 0, policy_version 1385362 (0.0010) [2023-12-26 10:39:18,666][123091] Updated weights for policy 0, policy_version 1385372 (0.0008) [2023-12-26 10:39:18,672][123090] Updated weights for policy 1, policy_version 1375826 (0.0010) [2023-12-26 10:39:18,725][123090] Updated weights for policy 1, policy_version 1375836 (0.0010) [2023-12-26 10:39:18,726][123091] Updated weights for policy 0, policy_version 1385382 (0.0007) [2023-12-26 10:39:18,777][123091] Updated weights for policy 0, policy_version 1385392 (0.0009) [2023-12-26 10:39:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 706879488. Throughput: 0: 8810.1, 1: 8863.8. Samples: 706883880. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:39:18,785][121949] Avg episode reward: [(0, '6448.708'), (1, '5924.004')] [2023-12-26 10:39:19,496][123090] Updated weights for policy 1, policy_version 1375846 (0.0008) [2023-12-26 10:39:19,565][123090] Updated weights for policy 1, policy_version 1375856 (0.0009) [2023-12-26 10:39:19,626][123090] Updated weights for policy 1, policy_version 1375866 (0.0009) [2023-12-26 10:39:19,631][123091] Updated weights for policy 0, policy_version 1385402 (0.0008) [2023-12-26 10:39:19,688][123091] Updated weights for policy 0, policy_version 1385412 (0.0009) [2023-12-26 10:39:19,745][123091] Updated weights for policy 0, policy_version 1385422 (0.0010) [2023-12-26 10:39:20,403][123090] Updated weights for policy 1, policy_version 1375876 (0.0006) [2023-12-26 10:39:20,453][123090] Updated weights for policy 1, policy_version 1375886 (0.0005) [2023-12-26 10:39:20,510][123090] Updated weights for policy 1, policy_version 1375896 (0.0005) [2023-12-26 10:39:20,625][123091] Updated weights for policy 0, policy_version 1385432 (0.0008) [2023-12-26 10:39:20,696][123091] Updated weights for policy 0, policy_version 1385442 (0.0008) [2023-12-26 10:39:20,748][123091] Updated weights for policy 0, policy_version 1385452 (0.0008) [2023-12-26 10:39:21,298][123090] Updated weights for policy 1, policy_version 1375906 (0.0007) [2023-12-26 10:39:21,371][123090] Updated weights for policy 1, policy_version 1375916 (0.0009) [2023-12-26 10:39:21,435][123090] Updated weights for policy 1, policy_version 1375926 (0.0008) [2023-12-26 10:39:21,495][123090] Updated weights for policy 1, policy_version 1375936 (0.0010) [2023-12-26 10:39:21,584][123091] Updated weights for policy 0, policy_version 1385462 (0.0009) [2023-12-26 10:39:21,650][123091] Updated weights for policy 0, policy_version 1385473 (0.0009) [2023-12-26 10:39:21,717][123091] Updated weights for policy 0, policy_version 1385483 (0.0010) [2023-12-26 10:39:22,227][123090] Updated weights for policy 1, policy_version 1375946 (0.0006) [2023-12-26 10:39:22,300][123090] Updated weights for policy 1, policy_version 1375956 (0.0007) [2023-12-26 10:39:22,369][123090] Updated weights for policy 1, policy_version 1375966 (0.0008) [2023-12-26 10:39:22,622][123091] Updated weights for policy 0, policy_version 1385493 (0.0010) [2023-12-26 10:39:22,688][123091] Updated weights for policy 0, policy_version 1385503 (0.0009) [2023-12-26 10:39:22,757][123091] Updated weights for policy 0, policy_version 1385513 (0.0010) [2023-12-26 10:39:23,013][123090] Updated weights for policy 1, policy_version 1375976 (0.0005) [2023-12-26 10:39:23,080][123090] Updated weights for policy 1, policy_version 1375986 (0.0007) [2023-12-26 10:39:23,142][123090] Updated weights for policy 1, policy_version 1375996 (0.0009) [2023-12-26 10:39:23,602][123091] Updated weights for policy 0, policy_version 1385523 (0.0008) [2023-12-26 10:39:23,653][123091] Updated weights for policy 0, policy_version 1385533 (0.0005) [2023-12-26 10:39:23,700][123091] Updated weights for policy 0, policy_version 1385543 (0.0005) [2023-12-26 10:39:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 706961408. Throughput: 0: 8777.2, 1: 8841.1. Samples: 706935308. Policy #0 lag: (min: 9.0, avg: 32.5, max: 41.0) [2023-12-26 10:39:23,785][121949] Avg episode reward: [(0, '6450.109'), (1, '5921.295')] [2023-12-26 10:39:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001385552_354705408.pth... [2023-12-26 10:39:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001376000_352256000.pth... [2023-12-26 10:39:23,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001384528_354443264.pth [2023-12-26 10:39:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001374976_351993856.pth [2023-12-26 10:39:23,903][123090] Updated weights for policy 1, policy_version 1376006 (0.0008) [2023-12-26 10:39:23,962][123090] Updated weights for policy 1, policy_version 1376016 (0.0008) [2023-12-26 10:39:24,031][123090] Updated weights for policy 1, policy_version 1376026 (0.0006) [2023-12-26 10:39:24,512][123091] Updated weights for policy 0, policy_version 1385553 (0.0006) [2023-12-26 10:39:24,567][123091] Updated weights for policy 0, policy_version 1385563 (0.0010) [2023-12-26 10:39:24,621][123091] Updated weights for policy 0, policy_version 1385573 (0.0010) [2023-12-26 10:39:24,678][123091] Updated weights for policy 0, policy_version 1385583 (0.0010) [2023-12-26 10:39:24,753][123090] Updated weights for policy 1, policy_version 1376036 (0.0006) [2023-12-26 10:39:24,799][123090] Updated weights for policy 1, policy_version 1376046 (0.0005) [2023-12-26 10:39:24,861][123090] Updated weights for policy 1, policy_version 1376056 (0.0005) [2023-12-26 10:39:25,569][123090] Updated weights for policy 1, policy_version 1376066 (0.0006) [2023-12-26 10:39:25,585][123091] Updated weights for policy 0, policy_version 1385593 (0.0009) [2023-12-26 10:39:25,636][123090] Updated weights for policy 1, policy_version 1376076 (0.0005) [2023-12-26 10:39:25,637][123091] Updated weights for policy 0, policy_version 1385603 (0.0008) [2023-12-26 10:39:25,690][123091] Updated weights for policy 0, policy_version 1385613 (0.0010) [2023-12-26 10:39:25,702][123090] Updated weights for policy 1, policy_version 1376086 (0.0005) [2023-12-26 10:39:25,749][123090] Updated weights for policy 1, policy_version 1376096 (0.0005) [2023-12-26 10:39:26,296][123090] Updated weights for policy 1, policy_version 1376106 (0.0007) [2023-12-26 10:39:26,343][123090] Updated weights for policy 1, policy_version 1376116 (0.0005) [2023-12-26 10:39:26,403][123090] Updated weights for policy 1, policy_version 1376126 (0.0005) [2023-12-26 10:39:26,581][123091] Updated weights for policy 0, policy_version 1385623 (0.0009) [2023-12-26 10:39:26,636][123091] Updated weights for policy 0, policy_version 1385633 (0.0008) [2023-12-26 10:39:26,688][123091] Updated weights for policy 0, policy_version 1385643 (0.0010) [2023-12-26 10:39:27,177][123090] Updated weights for policy 1, policy_version 1376136 (0.0008) [2023-12-26 10:39:27,226][123090] Updated weights for policy 1, policy_version 1376146 (0.0009) [2023-12-26 10:39:27,285][123090] Updated weights for policy 1, policy_version 1376156 (0.0009) [2023-12-26 10:39:27,515][123091] Updated weights for policy 0, policy_version 1385653 (0.0010) [2023-12-26 10:39:27,567][123091] Updated weights for policy 0, policy_version 1385663 (0.0010) [2023-12-26 10:39:27,635][123091] Updated weights for policy 0, policy_version 1385673 (0.0008) [2023-12-26 10:39:28,095][123090] Updated weights for policy 1, policy_version 1376166 (0.0009) [2023-12-26 10:39:28,155][123090] Updated weights for policy 1, policy_version 1376176 (0.0009) [2023-12-26 10:39:28,220][123090] Updated weights for policy 1, policy_version 1376186 (0.0009) [2023-12-26 10:39:28,525][123091] Updated weights for policy 0, policy_version 1385683 (0.0009) [2023-12-26 10:39:28,594][123091] Updated weights for policy 0, policy_version 1385693 (0.0009) [2023-12-26 10:39:28,651][123091] Updated weights for policy 0, policy_version 1385703 (0.0009) [2023-12-26 10:39:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 707051520. Throughput: 0: 8753.4, 1: 8976.3. Samples: 707042796. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:28,785][121949] Avg episode reward: [(0, '6427.071'), (1, '5870.692')] [2023-12-26 10:39:28,913][123090] Updated weights for policy 1, policy_version 1376196 (0.0007) [2023-12-26 10:39:28,982][123090] Updated weights for policy 1, policy_version 1376206 (0.0007) [2023-12-26 10:39:29,046][123090] Updated weights for policy 1, policy_version 1376216 (0.0009) [2023-12-26 10:39:29,490][123091] Updated weights for policy 0, policy_version 1385713 (0.0009) [2023-12-26 10:39:29,549][123091] Updated weights for policy 0, policy_version 1385723 (0.0010) [2023-12-26 10:39:29,619][123091] Updated weights for policy 0, policy_version 1385733 (0.0011) [2023-12-26 10:39:29,678][123091] Updated weights for policy 0, policy_version 1385743 (0.0008) [2023-12-26 10:39:29,869][123090] Updated weights for policy 1, policy_version 1376226 (0.0009) [2023-12-26 10:39:29,933][123090] Updated weights for policy 1, policy_version 1376236 (0.0010) [2023-12-26 10:39:29,989][123090] Updated weights for policy 1, policy_version 1376246 (0.0009) [2023-12-26 10:39:30,047][123090] Updated weights for policy 1, policy_version 1376256 (0.0009) [2023-12-26 10:39:30,366][123091] Updated weights for policy 0, policy_version 1385753 (0.0006) [2023-12-26 10:39:30,414][123091] Updated weights for policy 0, policy_version 1385763 (0.0005) [2023-12-26 10:39:30,468][123091] Updated weights for policy 0, policy_version 1385773 (0.0005) [2023-12-26 10:39:30,908][123090] Updated weights for policy 1, policy_version 1376266 (0.0010) [2023-12-26 10:39:30,956][123090] Updated weights for policy 1, policy_version 1376276 (0.0010) [2023-12-26 10:39:31,003][123090] Updated weights for policy 1, policy_version 1376286 (0.0010) [2023-12-26 10:39:31,159][123091] Updated weights for policy 0, policy_version 1385783 (0.0007) [2023-12-26 10:39:31,220][123091] Updated weights for policy 0, policy_version 1385793 (0.0011) [2023-12-26 10:39:31,280][123091] Updated weights for policy 0, policy_version 1385803 (0.0010) [2023-12-26 10:39:31,881][123090] Updated weights for policy 1, policy_version 1376296 (0.0009) [2023-12-26 10:39:31,948][123090] Updated weights for policy 1, policy_version 1376306 (0.0005) [2023-12-26 10:39:32,014][123090] Updated weights for policy 1, policy_version 1376316 (0.0007) [2023-12-26 10:39:32,133][123091] Updated weights for policy 0, policy_version 1385813 (0.0010) [2023-12-26 10:39:32,199][123091] Updated weights for policy 0, policy_version 1385823 (0.0009) [2023-12-26 10:39:32,272][123091] Updated weights for policy 0, policy_version 1385833 (0.0009) [2023-12-26 10:39:32,727][123090] Updated weights for policy 1, policy_version 1376326 (0.0008) [2023-12-26 10:39:32,797][123090] Updated weights for policy 1, policy_version 1376336 (0.0010) [2023-12-26 10:39:32,879][123090] Updated weights for policy 1, policy_version 1376346 (0.0010) [2023-12-26 10:39:32,973][123091] Updated weights for policy 0, policy_version 1385843 (0.0008) [2023-12-26 10:39:33,023][123091] Updated weights for policy 0, policy_version 1385853 (0.0009) [2023-12-26 10:39:33,079][123091] Updated weights for policy 0, policy_version 1385863 (0.0007) [2023-12-26 10:39:33,731][123090] Updated weights for policy 1, policy_version 1376356 (0.0009) [2023-12-26 10:39:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 707133440. Throughput: 0: 8757.8, 1: 8979.4. Samples: 707150536. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:33,784][121949] Avg episode reward: [(0, '6390.947'), (1, '5885.165')] [2023-12-26 10:39:33,786][123090] Updated weights for policy 1, policy_version 1376366 (0.0009) [2023-12-26 10:39:33,796][123091] Updated weights for policy 0, policy_version 1385873 (0.0007) [2023-12-26 10:39:33,836][123090] Updated weights for policy 1, policy_version 1376376 (0.0009) [2023-12-26 10:39:33,847][123091] Updated weights for policy 0, policy_version 1385883 (0.0005) [2023-12-26 10:39:33,891][123091] Updated weights for policy 0, policy_version 1385893 (0.0005) [2023-12-26 10:39:33,950][123091] Updated weights for policy 0, policy_version 1385903 (0.0006) [2023-12-26 10:39:34,681][123090] Updated weights for policy 1, policy_version 1376386 (0.0009) [2023-12-26 10:39:34,745][123090] Updated weights for policy 1, policy_version 1376396 (0.0010) [2023-12-26 10:39:34,754][123091] Updated weights for policy 0, policy_version 1385913 (0.0011) [2023-12-26 10:39:34,808][123090] Updated weights for policy 1, policy_version 1376406 (0.0011) [2023-12-26 10:39:34,817][123091] Updated weights for policy 0, policy_version 1385923 (0.0010) [2023-12-26 10:39:34,870][123090] Updated weights for policy 1, policy_version 1376416 (0.0008) [2023-12-26 10:39:34,884][123091] Updated weights for policy 0, policy_version 1385933 (0.0010) [2023-12-26 10:39:35,620][123090] Updated weights for policy 1, policy_version 1376426 (0.0007) [2023-12-26 10:39:35,682][123090] Updated weights for policy 1, policy_version 1376436 (0.0006) [2023-12-26 10:39:35,697][123091] Updated weights for policy 0, policy_version 1385943 (0.0011) [2023-12-26 10:39:35,736][123090] Updated weights for policy 1, policy_version 1376446 (0.0005) [2023-12-26 10:39:35,770][123091] Updated weights for policy 0, policy_version 1385953 (0.0010) [2023-12-26 10:39:35,842][123091] Updated weights for policy 0, policy_version 1385963 (0.0009) [2023-12-26 10:39:36,422][123090] Updated weights for policy 1, policy_version 1376456 (0.0006) [2023-12-26 10:39:36,489][123090] Updated weights for policy 1, policy_version 1376466 (0.0008) [2023-12-26 10:39:36,541][123090] Updated weights for policy 1, policy_version 1376476 (0.0010) [2023-12-26 10:39:36,651][123091] Updated weights for policy 0, policy_version 1385973 (0.0010) [2023-12-26 10:39:36,714][123091] Updated weights for policy 0, policy_version 1385983 (0.0009) [2023-12-26 10:39:36,786][123091] Updated weights for policy 0, policy_version 1385993 (0.0009) [2023-12-26 10:39:37,269][123090] Updated weights for policy 1, policy_version 1376486 (0.0007) [2023-12-26 10:39:37,334][123090] Updated weights for policy 1, policy_version 1376496 (0.0005) [2023-12-26 10:39:37,403][123090] Updated weights for policy 1, policy_version 1376506 (0.0008) [2023-12-26 10:39:37,616][123091] Updated weights for policy 0, policy_version 1386003 (0.0008) [2023-12-26 10:39:37,670][123091] Updated weights for policy 0, policy_version 1386013 (0.0006) [2023-12-26 10:39:37,731][123091] Updated weights for policy 0, policy_version 1386023 (0.0006) [2023-12-26 10:39:38,206][123090] Updated weights for policy 1, policy_version 1376516 (0.0011) [2023-12-26 10:39:38,261][123090] Updated weights for policy 1, policy_version 1376526 (0.0010) [2023-12-26 10:39:38,322][123090] Updated weights for policy 1, policy_version 1376536 (0.0010) [2023-12-26 10:39:38,381][123091] Updated weights for policy 0, policy_version 1386033 (0.0005) [2023-12-26 10:39:38,443][123091] Updated weights for policy 0, policy_version 1386043 (0.0006) [2023-12-26 10:39:38,510][123091] Updated weights for policy 0, policy_version 1386053 (0.0007) [2023-12-26 10:39:38,566][123091] Updated weights for policy 0, policy_version 1386063 (0.0007) [2023-12-26 10:39:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 707231744. Throughput: 0: 8758.9, 1: 9019.8. Samples: 707204640. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:38,785][121949] Avg episode reward: [(0, '6456.853'), (1, '5863.604')] [2023-12-26 10:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001386064_354836480.pth... [2023-12-26 10:39:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001376544_352395264.pth... [2023-12-26 10:39:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001385040_354574336.pth [2023-12-26 10:39:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001375488_352124928.pth [2023-12-26 10:39:39,164][123090] Updated weights for policy 1, policy_version 1376546 (0.0011) [2023-12-26 10:39:39,233][123090] Updated weights for policy 1, policy_version 1376556 (0.0011) [2023-12-26 10:39:39,304][123090] Updated weights for policy 1, policy_version 1376566 (0.0011) [2023-12-26 10:39:39,322][123091] Updated weights for policy 0, policy_version 1386073 (0.0007) [2023-12-26 10:39:39,373][123090] Updated weights for policy 1, policy_version 1376576 (0.0010) [2023-12-26 10:39:39,393][123091] Updated weights for policy 0, policy_version 1386083 (0.0008) [2023-12-26 10:39:39,459][123091] Updated weights for policy 0, policy_version 1386093 (0.0008) [2023-12-26 10:39:40,196][123091] Updated weights for policy 0, policy_version 1386103 (0.0008) [2023-12-26 10:39:40,204][123090] Updated weights for policy 1, policy_version 1376586 (0.0007) [2023-12-26 10:39:40,258][123091] Updated weights for policy 0, policy_version 1386113 (0.0008) [2023-12-26 10:39:40,261][123090] Updated weights for policy 1, policy_version 1376596 (0.0005) [2023-12-26 10:39:40,314][123091] Updated weights for policy 0, policy_version 1386123 (0.0008) [2023-12-26 10:39:40,327][123090] Updated weights for policy 1, policy_version 1376606 (0.0005) [2023-12-26 10:39:40,995][123091] Updated weights for policy 0, policy_version 1386133 (0.0007) [2023-12-26 10:39:41,019][123090] Updated weights for policy 1, policy_version 1376616 (0.0006) [2023-12-26 10:39:41,059][123091] Updated weights for policy 0, policy_version 1386143 (0.0008) [2023-12-26 10:39:41,093][123090] Updated weights for policy 1, policy_version 1376626 (0.0009) [2023-12-26 10:39:41,131][123091] Updated weights for policy 0, policy_version 1386153 (0.0008) [2023-12-26 10:39:41,168][123090] Updated weights for policy 1, policy_version 1376636 (0.0009) [2023-12-26 10:39:41,954][123091] Updated weights for policy 0, policy_version 1386163 (0.0009) [2023-12-26 10:39:41,983][123090] Updated weights for policy 1, policy_version 1376646 (0.0009) [2023-12-26 10:39:42,021][123091] Updated weights for policy 0, policy_version 1386173 (0.0008) [2023-12-26 10:39:42,051][123090] Updated weights for policy 1, policy_version 1376656 (0.0008) [2023-12-26 10:39:42,086][123091] Updated weights for policy 0, policy_version 1386183 (0.0011) [2023-12-26 10:39:42,116][123090] Updated weights for policy 1, policy_version 1376666 (0.0007) [2023-12-26 10:39:42,924][123090] Updated weights for policy 1, policy_version 1376676 (0.0010) [2023-12-26 10:39:42,937][123091] Updated weights for policy 0, policy_version 1386193 (0.0009) [2023-12-26 10:39:42,991][123090] Updated weights for policy 1, policy_version 1376686 (0.0009) [2023-12-26 10:39:42,996][123091] Updated weights for policy 0, policy_version 1386203 (0.0007) [2023-12-26 10:39:43,053][123091] Updated weights for policy 0, policy_version 1386213 (0.0008) [2023-12-26 10:39:43,055][123090] Updated weights for policy 1, policy_version 1376696 (0.0009) [2023-12-26 10:39:43,099][123091] Updated weights for policy 0, policy_version 1386223 (0.0007) [2023-12-26 10:39:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 707313664. Throughput: 0: 8764.9, 1: 9039.3. Samples: 707311992. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:43,785][121949] Avg episode reward: [(0, '6477.596'), (1, '5841.217')] [2023-12-26 10:39:43,834][123090] Updated weights for policy 1, policy_version 1376706 (0.0009) [2023-12-26 10:39:43,882][123090] Updated weights for policy 1, policy_version 1376716 (0.0009) [2023-12-26 10:39:43,947][123090] Updated weights for policy 1, policy_version 1376726 (0.0010) [2023-12-26 10:39:43,954][123091] Updated weights for policy 0, policy_version 1386233 (0.0008) [2023-12-26 10:39:43,997][123090] Updated weights for policy 1, policy_version 1376736 (0.0008) [2023-12-26 10:39:44,003][123091] Updated weights for policy 0, policy_version 1386243 (0.0007) [2023-12-26 10:39:44,054][123091] Updated weights for policy 0, policy_version 1386254 (0.0009) [2023-12-26 10:39:44,798][123090] Updated weights for policy 1, policy_version 1376746 (0.0010) [2023-12-26 10:39:44,836][123091] Updated weights for policy 0, policy_version 1386264 (0.0008) [2023-12-26 10:39:44,860][123090] Updated weights for policy 1, policy_version 1376756 (0.0008) [2023-12-26 10:39:44,886][123091] Updated weights for policy 0, policy_version 1386274 (0.0008) [2023-12-26 10:39:44,921][123090] Updated weights for policy 1, policy_version 1376766 (0.0008) [2023-12-26 10:39:44,939][123091] Updated weights for policy 0, policy_version 1386284 (0.0006) [2023-12-26 10:39:45,711][123090] Updated weights for policy 1, policy_version 1376776 (0.0009) [2023-12-26 10:39:45,768][123090] Updated weights for policy 1, policy_version 1376786 (0.0009) [2023-12-26 10:39:45,793][123091] Updated weights for policy 0, policy_version 1386294 (0.0008) [2023-12-26 10:39:45,821][123090] Updated weights for policy 1, policy_version 1376796 (0.0006) [2023-12-26 10:39:45,857][123091] Updated weights for policy 0, policy_version 1386304 (0.0010) [2023-12-26 10:39:45,920][123091] Updated weights for policy 0, policy_version 1386314 (0.0009) [2023-12-26 10:39:46,569][123090] Updated weights for policy 1, policy_version 1376806 (0.0008) [2023-12-26 10:39:46,619][123090] Updated weights for policy 1, policy_version 1376816 (0.0007) [2023-12-26 10:39:46,674][123090] Updated weights for policy 1, policy_version 1376826 (0.0005) [2023-12-26 10:39:46,757][123091] Updated weights for policy 0, policy_version 1386324 (0.0009) [2023-12-26 10:39:46,819][123091] Updated weights for policy 0, policy_version 1386334 (0.0010) [2023-12-26 10:39:46,868][123091] Updated weights for policy 0, policy_version 1386344 (0.0009) [2023-12-26 10:39:47,399][123090] Updated weights for policy 1, policy_version 1376836 (0.0005) [2023-12-26 10:39:47,468][123090] Updated weights for policy 1, policy_version 1376846 (0.0005) [2023-12-26 10:39:47,530][123090] Updated weights for policy 1, policy_version 1376856 (0.0008) [2023-12-26 10:39:47,711][123091] Updated weights for policy 0, policy_version 1386354 (0.0009) [2023-12-26 10:39:47,760][123091] Updated weights for policy 0, policy_version 1386364 (0.0009) [2023-12-26 10:39:47,808][123091] Updated weights for policy 0, policy_version 1386374 (0.0009) [2023-12-26 10:39:47,871][123091] Updated weights for policy 0, policy_version 1386384 (0.0010) [2023-12-26 10:39:48,284][123090] Updated weights for policy 1, policy_version 1376866 (0.0008) [2023-12-26 10:39:48,340][123090] Updated weights for policy 1, policy_version 1376876 (0.0007) [2023-12-26 10:39:48,406][123090] Updated weights for policy 1, policy_version 1376886 (0.0009) [2023-12-26 10:39:48,461][123090] Updated weights for policy 1, policy_version 1376896 (0.0008) [2023-12-26 10:39:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 707403776. Throughput: 0: 8710.1, 1: 9071.4. Samples: 707417352. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:48,784][121949] Avg episode reward: [(0, '6334.791'), (1, '5799.933')] [2023-12-26 10:39:48,788][123091] Updated weights for policy 0, policy_version 1386394 (0.0005) [2023-12-26 10:39:48,851][123091] Updated weights for policy 0, policy_version 1386404 (0.0008) [2023-12-26 10:39:48,904][123091] Updated weights for policy 0, policy_version 1386414 (0.0010) [2023-12-26 10:39:49,293][123090] Updated weights for policy 1, policy_version 1376906 (0.0009) [2023-12-26 10:39:49,355][123090] Updated weights for policy 1, policy_version 1376916 (0.0009) [2023-12-26 10:39:49,423][123090] Updated weights for policy 1, policy_version 1376926 (0.0009) [2023-12-26 10:39:49,715][123091] Updated weights for policy 0, policy_version 1386424 (0.0009) [2023-12-26 10:39:49,763][123091] Updated weights for policy 0, policy_version 1386434 (0.0009) [2023-12-26 10:39:49,812][123091] Updated weights for policy 0, policy_version 1386444 (0.0009) [2023-12-26 10:39:50,213][123090] Updated weights for policy 1, policy_version 1376936 (0.0009) [2023-12-26 10:39:50,270][123090] Updated weights for policy 1, policy_version 1376946 (0.0009) [2023-12-26 10:39:50,329][123090] Updated weights for policy 1, policy_version 1376956 (0.0009) [2023-12-26 10:39:50,669][123091] Updated weights for policy 0, policy_version 1386454 (0.0008) [2023-12-26 10:39:50,721][123091] Updated weights for policy 0, policy_version 1386464 (0.0007) [2023-12-26 10:39:50,787][123091] Updated weights for policy 0, policy_version 1386474 (0.0005) [2023-12-26 10:39:51,235][123090] Updated weights for policy 1, policy_version 1376966 (0.0009) [2023-12-26 10:39:51,305][123090] Updated weights for policy 1, policy_version 1376976 (0.0010) [2023-12-26 10:39:51,380][123090] Updated weights for policy 1, policy_version 1376986 (0.0010) [2023-12-26 10:39:51,500][123091] Updated weights for policy 0, policy_version 1386484 (0.0007) [2023-12-26 10:39:51,554][123091] Updated weights for policy 0, policy_version 1386494 (0.0009) [2023-12-26 10:39:51,615][123091] Updated weights for policy 0, policy_version 1386504 (0.0009) [2023-12-26 10:39:52,236][123090] Updated weights for policy 1, policy_version 1376996 (0.0008) [2023-12-26 10:39:52,301][123090] Updated weights for policy 1, policy_version 1377006 (0.0007) [2023-12-26 10:39:52,364][123090] Updated weights for policy 1, policy_version 1377016 (0.0008) [2023-12-26 10:39:52,479][123091] Updated weights for policy 0, policy_version 1386514 (0.0009) [2023-12-26 10:39:52,541][123091] Updated weights for policy 0, policy_version 1386524 (0.0009) [2023-12-26 10:39:52,605][123091] Updated weights for policy 0, policy_version 1386534 (0.0010) [2023-12-26 10:39:52,676][123091] Updated weights for policy 0, policy_version 1386544 (0.0010) [2023-12-26 10:39:53,124][123090] Updated weights for policy 1, policy_version 1377026 (0.0009) [2023-12-26 10:39:53,180][123090] Updated weights for policy 1, policy_version 1377036 (0.0008) [2023-12-26 10:39:53,241][123090] Updated weights for policy 1, policy_version 1377046 (0.0008) [2023-12-26 10:39:53,293][123090] Updated weights for policy 1, policy_version 1377056 (0.0010) [2023-12-26 10:39:53,487][123091] Updated weights for policy 0, policy_version 1386554 (0.0005) [2023-12-26 10:39:53,534][123091] Updated weights for policy 0, policy_version 1386564 (0.0005) [2023-12-26 10:39:53,581][123091] Updated weights for policy 0, policy_version 1386574 (0.0005) [2023-12-26 10:39:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 707493888. Throughput: 0: 8726.9, 1: 8984.2. Samples: 707468512. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:53,785][121949] Avg episode reward: [(0, '6176.807'), (1, '5846.933')] [2023-12-26 10:39:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001386576_354967552.pth... [2023-12-26 10:39:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001377056_352526336.pth... [2023-12-26 10:39:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001385552_354705408.pth [2023-12-26 10:39:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001376000_352256000.pth [2023-12-26 10:39:54,126][123090] Updated weights for policy 1, policy_version 1377066 (0.0006) [2023-12-26 10:39:54,183][123091] Updated weights for policy 0, policy_version 1386584 (0.0008) [2023-12-26 10:39:54,189][123090] Updated weights for policy 1, policy_version 1377076 (0.0008) [2023-12-26 10:39:54,236][123091] Updated weights for policy 0, policy_version 1386594 (0.0007) [2023-12-26 10:39:54,252][123090] Updated weights for policy 1, policy_version 1377086 (0.0010) [2023-12-26 10:39:54,308][123091] Updated weights for policy 0, policy_version 1386604 (0.0010) [2023-12-26 10:39:55,023][123090] Updated weights for policy 1, policy_version 1377096 (0.0010) [2023-12-26 10:39:55,075][123090] Updated weights for policy 1, policy_version 1377106 (0.0010) [2023-12-26 10:39:55,127][123090] Updated weights for policy 1, policy_version 1377116 (0.0010) [2023-12-26 10:39:55,138][123091] Updated weights for policy 0, policy_version 1386614 (0.0007) [2023-12-26 10:39:55,202][123091] Updated weights for policy 0, policy_version 1386624 (0.0007) [2023-12-26 10:39:55,265][123091] Updated weights for policy 0, policy_version 1386634 (0.0005) [2023-12-26 10:39:55,947][123090] Updated weights for policy 1, policy_version 1377126 (0.0010) [2023-12-26 10:39:56,005][123090] Updated weights for policy 1, policy_version 1377136 (0.0010) [2023-12-26 10:39:56,007][123091] Updated weights for policy 0, policy_version 1386644 (0.0007) [2023-12-26 10:39:56,057][123091] Updated weights for policy 0, policy_version 1386654 (0.0008) [2023-12-26 10:39:56,075][123090] Updated weights for policy 1, policy_version 1377146 (0.0010) [2023-12-26 10:39:56,109][123091] Updated weights for policy 0, policy_version 1386664 (0.0010) [2023-12-26 10:39:56,830][123090] Updated weights for policy 1, policy_version 1377156 (0.0008) [2023-12-26 10:39:56,878][123090] Updated weights for policy 1, policy_version 1377166 (0.0005) [2023-12-26 10:39:56,933][123090] Updated weights for policy 1, policy_version 1377176 (0.0005) [2023-12-26 10:39:56,993][123091] Updated weights for policy 0, policy_version 1386674 (0.0009) [2023-12-26 10:39:57,040][123091] Updated weights for policy 0, policy_version 1386684 (0.0009) [2023-12-26 10:39:57,093][123091] Updated weights for policy 0, policy_version 1386694 (0.0009) [2023-12-26 10:39:57,151][123091] Updated weights for policy 0, policy_version 1386704 (0.0009) [2023-12-26 10:39:57,701][123090] Updated weights for policy 1, policy_version 1377186 (0.0008) [2023-12-26 10:39:57,764][123090] Updated weights for policy 1, policy_version 1377196 (0.0009) [2023-12-26 10:39:57,818][123090] Updated weights for policy 1, policy_version 1377206 (0.0009) [2023-12-26 10:39:57,876][123090] Updated weights for policy 1, policy_version 1377216 (0.0009) [2023-12-26 10:39:57,948][123091] Updated weights for policy 0, policy_version 1386714 (0.0008) [2023-12-26 10:39:57,993][123091] Updated weights for policy 0, policy_version 1386724 (0.0006) [2023-12-26 10:39:58,059][123091] Updated weights for policy 0, policy_version 1386734 (0.0010) [2023-12-26 10:39:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 707575808. Throughput: 0: 8692.2, 1: 9003.2. Samples: 707574932. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:39:58,785][121949] Avg episode reward: [(0, '6248.803'), (1, '5884.779')] [2023-12-26 10:39:58,790][123090] Updated weights for policy 1, policy_version 1377226 (0.0008) [2023-12-26 10:39:58,865][123090] Updated weights for policy 1, policy_version 1377236 (0.0009) [2023-12-26 10:39:58,929][123090] Updated weights for policy 1, policy_version 1377246 (0.0009) [2023-12-26 10:39:58,952][123091] Updated weights for policy 0, policy_version 1386744 (0.0008) [2023-12-26 10:39:59,018][123091] Updated weights for policy 0, policy_version 1386754 (0.0008) [2023-12-26 10:39:59,079][123091] Updated weights for policy 0, policy_version 1386764 (0.0008) [2023-12-26 10:39:59,790][123091] Updated weights for policy 0, policy_version 1386774 (0.0009) [2023-12-26 10:39:59,850][123091] Updated weights for policy 0, policy_version 1386784 (0.0009) [2023-12-26 10:39:59,857][123090] Updated weights for policy 1, policy_version 1377256 (0.0008) [2023-12-26 10:39:59,899][123091] Updated weights for policy 0, policy_version 1386794 (0.0008) [2023-12-26 10:39:59,906][123090] Updated weights for policy 1, policy_version 1377266 (0.0008) [2023-12-26 10:39:59,977][123090] Updated weights for policy 1, policy_version 1377276 (0.0006) [2023-12-26 10:40:00,671][123091] Updated weights for policy 0, policy_version 1386804 (0.0010) [2023-12-26 10:40:00,722][123091] Updated weights for policy 0, policy_version 1386814 (0.0009) [2023-12-26 10:40:00,774][123090] Updated weights for policy 1, policy_version 1377286 (0.0008) [2023-12-26 10:40:00,776][123091] Updated weights for policy 0, policy_version 1386824 (0.0008) [2023-12-26 10:40:00,833][123090] Updated weights for policy 1, policy_version 1377296 (0.0006) [2023-12-26 10:40:00,888][123090] Updated weights for policy 1, policy_version 1377306 (0.0006) [2023-12-26 10:40:01,636][123091] Updated weights for policy 0, policy_version 1386834 (0.0009) [2023-12-26 10:40:01,696][123091] Updated weights for policy 0, policy_version 1386844 (0.0009) [2023-12-26 10:40:01,712][123090] Updated weights for policy 1, policy_version 1377316 (0.0007) [2023-12-26 10:40:01,766][123091] Updated weights for policy 0, policy_version 1386854 (0.0007) [2023-12-26 10:40:01,777][123090] Updated weights for policy 1, policy_version 1377326 (0.0008) [2023-12-26 10:40:01,826][123091] Updated weights for policy 0, policy_version 1386864 (0.0006) [2023-12-26 10:40:01,844][123090] Updated weights for policy 1, policy_version 1377336 (0.0008) [2023-12-26 10:40:02,626][123091] Updated weights for policy 0, policy_version 1386874 (0.0008) [2023-12-26 10:40:02,647][123090] Updated weights for policy 1, policy_version 1377346 (0.0010) [2023-12-26 10:40:02,674][123091] Updated weights for policy 0, policy_version 1386884 (0.0008) [2023-12-26 10:40:02,716][123090] Updated weights for policy 1, policy_version 1377356 (0.0009) [2023-12-26 10:40:02,736][123091] Updated weights for policy 0, policy_version 1386894 (0.0007) [2023-12-26 10:40:02,775][123090] Updated weights for policy 1, policy_version 1377366 (0.0006) [2023-12-26 10:40:03,543][123090] Updated weights for policy 1, policy_version 1377377 (0.0010) [2023-12-26 10:40:03,574][123091] Updated weights for policy 0, policy_version 1386904 (0.0009) [2023-12-26 10:40:03,598][123090] Updated weights for policy 1, policy_version 1377387 (0.0009) [2023-12-26 10:40:03,626][123091] Updated weights for policy 0, policy_version 1386914 (0.0008) [2023-12-26 10:40:03,651][123090] Updated weights for policy 1, policy_version 1377397 (0.0009) [2023-12-26 10:40:03,682][123091] Updated weights for policy 0, policy_version 1386924 (0.0009) [2023-12-26 10:40:03,707][123090] Updated weights for policy 1, policy_version 1377407 (0.0007) [2023-12-26 10:40:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 707674112. Throughput: 0: 8740.5, 1: 8894.0. Samples: 707677436. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:03,785][121949] Avg episode reward: [(0, '6367.791'), (1, '5873.887')] [2023-12-26 10:40:04,494][123090] Updated weights for policy 1, policy_version 1377417 (0.0006) [2023-12-26 10:40:04,551][123090] Updated weights for policy 1, policy_version 1377427 (0.0007) [2023-12-26 10:40:04,566][123091] Updated weights for policy 0, policy_version 1386934 (0.0007) [2023-12-26 10:40:04,605][123090] Updated weights for policy 1, policy_version 1377437 (0.0005) [2023-12-26 10:40:04,625][123091] Updated weights for policy 0, policy_version 1386944 (0.0007) [2023-12-26 10:40:04,698][123091] Updated weights for policy 0, policy_version 1386954 (0.0010) [2023-12-26 10:40:05,331][123090] Updated weights for policy 1, policy_version 1377447 (0.0005) [2023-12-26 10:40:05,375][123090] Updated weights for policy 1, policy_version 1377457 (0.0006) [2023-12-26 10:40:05,421][123090] Updated weights for policy 1, policy_version 1377467 (0.0005) [2023-12-26 10:40:05,596][123091] Updated weights for policy 0, policy_version 1386964 (0.0009) [2023-12-26 10:40:05,657][123091] Updated weights for policy 0, policy_version 1386974 (0.0010) [2023-12-26 10:40:05,704][123091] Updated weights for policy 0, policy_version 1386984 (0.0009) [2023-12-26 10:40:06,119][123090] Updated weights for policy 1, policy_version 1377477 (0.0007) [2023-12-26 10:40:06,188][123090] Updated weights for policy 1, policy_version 1377487 (0.0008) [2023-12-26 10:40:06,257][123090] Updated weights for policy 1, policy_version 1377497 (0.0009) [2023-12-26 10:40:06,585][123091] Updated weights for policy 0, policy_version 1386995 (0.0009) [2023-12-26 10:40:06,635][123091] Updated weights for policy 0, policy_version 1387005 (0.0009) [2023-12-26 10:40:06,685][123091] Updated weights for policy 0, policy_version 1387015 (0.0009) [2023-12-26 10:40:07,081][123090] Updated weights for policy 1, policy_version 1377507 (0.0010) [2023-12-26 10:40:07,137][123090] Updated weights for policy 1, policy_version 1377517 (0.0009) [2023-12-26 10:40:07,203][123090] Updated weights for policy 1, policy_version 1377527 (0.0008) [2023-12-26 10:40:07,567][123091] Updated weights for policy 0, policy_version 1387025 (0.0009) [2023-12-26 10:40:07,622][123091] Updated weights for policy 0, policy_version 1387035 (0.0010) [2023-12-26 10:40:07,679][123091] Updated weights for policy 0, policy_version 1387045 (0.0010) [2023-12-26 10:40:07,733][123091] Updated weights for policy 0, policy_version 1387055 (0.0010) [2023-12-26 10:40:08,050][123090] Updated weights for policy 1, policy_version 1377537 (0.0010) [2023-12-26 10:40:08,106][123090] Updated weights for policy 1, policy_version 1377547 (0.0009) [2023-12-26 10:40:08,154][123090] Updated weights for policy 1, policy_version 1377557 (0.0009) [2023-12-26 10:40:08,203][123090] Updated weights for policy 1, policy_version 1377567 (0.0009) [2023-12-26 10:40:08,627][123091] Updated weights for policy 0, policy_version 1387065 (0.0010) [2023-12-26 10:40:08,677][123091] Updated weights for policy 0, policy_version 1387075 (0.0009) [2023-12-26 10:40:08,726][123091] Updated weights for policy 0, policy_version 1387085 (0.0009) [2023-12-26 10:40:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 707756032. Throughput: 0: 8727.6, 1: 8947.7. Samples: 707730692. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:08,785][121949] Avg episode reward: [(0, '6400.177'), (1, '5911.738')] [2023-12-26 10:40:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001387088_355098624.pth... [2023-12-26 10:40:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001377568_352657408.pth... [2023-12-26 10:40:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001376544_352395264.pth [2023-12-26 10:40:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001386064_354836480.pth [2023-12-26 10:40:09,048][123090] Updated weights for policy 1, policy_version 1377577 (0.0011) [2023-12-26 10:40:09,107][123090] Updated weights for policy 1, policy_version 1377587 (0.0009) [2023-12-26 10:40:09,165][123090] Updated weights for policy 1, policy_version 1377597 (0.0009) [2023-12-26 10:40:09,661][123091] Updated weights for policy 0, policy_version 1387095 (0.0010) [2023-12-26 10:40:09,714][123091] Updated weights for policy 0, policy_version 1387105 (0.0009) [2023-12-26 10:40:09,768][123091] Updated weights for policy 0, policy_version 1387115 (0.0010) [2023-12-26 10:40:10,019][123090] Updated weights for policy 1, policy_version 1377607 (0.0009) [2023-12-26 10:40:10,076][123090] Updated weights for policy 1, policy_version 1377617 (0.0009) [2023-12-26 10:40:10,140][123090] Updated weights for policy 1, policy_version 1377627 (0.0009) [2023-12-26 10:40:10,557][123091] Updated weights for policy 0, policy_version 1387125 (0.0010) [2023-12-26 10:40:10,617][123091] Updated weights for policy 0, policy_version 1387135 (0.0010) [2023-12-26 10:40:10,686][123091] Updated weights for policy 0, policy_version 1387145 (0.0010) [2023-12-26 10:40:10,990][123090] Updated weights for policy 1, policy_version 1377637 (0.0008) [2023-12-26 10:40:11,066][123090] Updated weights for policy 1, policy_version 1377647 (0.0008) [2023-12-26 10:40:11,124][123090] Updated weights for policy 1, policy_version 1377657 (0.0010) [2023-12-26 10:40:11,538][123091] Updated weights for policy 0, policy_version 1387155 (0.0010) [2023-12-26 10:40:11,599][123091] Updated weights for policy 0, policy_version 1387165 (0.0008) [2023-12-26 10:40:11,671][123091] Updated weights for policy 0, policy_version 1387175 (0.0008) [2023-12-26 10:40:11,973][123090] Updated weights for policy 1, policy_version 1377667 (0.0009) [2023-12-26 10:40:12,032][123090] Updated weights for policy 1, policy_version 1377677 (0.0010) [2023-12-26 10:40:12,084][123090] Updated weights for policy 1, policy_version 1377687 (0.0011) [2023-12-26 10:40:12,480][123091] Updated weights for policy 0, policy_version 1387185 (0.0009) [2023-12-26 10:40:12,555][123091] Updated weights for policy 0, policy_version 1387195 (0.0009) [2023-12-26 10:40:12,625][123091] Updated weights for policy 0, policy_version 1387205 (0.0009) [2023-12-26 10:40:12,689][123091] Updated weights for policy 0, policy_version 1387215 (0.0009) [2023-12-26 10:40:12,929][123090] Updated weights for policy 1, policy_version 1377697 (0.0010) [2023-12-26 10:40:12,994][123090] Updated weights for policy 1, policy_version 1377707 (0.0009) [2023-12-26 10:40:13,063][123090] Updated weights for policy 1, policy_version 1377717 (0.0010) [2023-12-26 10:40:13,133][123090] Updated weights for policy 1, policy_version 1377727 (0.0009) [2023-12-26 10:40:13,503][123091] Updated weights for policy 0, policy_version 1387225 (0.0009) [2023-12-26 10:40:13,558][123091] Updated weights for policy 0, policy_version 1387235 (0.0009) [2023-12-26 10:40:13,612][123091] Updated weights for policy 0, policy_version 1387245 (0.0010) [2023-12-26 10:40:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 707837952. Throughput: 0: 8741.4, 1: 8780.1. Samples: 707831264. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:13,785][121949] Avg episode reward: [(0, '6362.433'), (1, '5911.537')] [2023-12-26 10:40:13,946][123090] Updated weights for policy 1, policy_version 1377737 (0.0006) [2023-12-26 10:40:14,000][123090] Updated weights for policy 1, policy_version 1377747 (0.0005) [2023-12-26 10:40:14,048][123090] Updated weights for policy 1, policy_version 1377757 (0.0005) [2023-12-26 10:40:14,476][123091] Updated weights for policy 0, policy_version 1387255 (0.0010) [2023-12-26 10:40:14,533][123091] Updated weights for policy 0, policy_version 1387266 (0.0010) [2023-12-26 10:40:14,594][123091] Updated weights for policy 0, policy_version 1387276 (0.0010) [2023-12-26 10:40:14,732][123090] Updated weights for policy 1, policy_version 1377767 (0.0005) [2023-12-26 10:40:14,802][123090] Updated weights for policy 1, policy_version 1377777 (0.0007) [2023-12-26 10:40:14,874][123090] Updated weights for policy 1, policy_version 1377787 (0.0007) [2023-12-26 10:40:15,437][123091] Updated weights for policy 0, policy_version 1387286 (0.0009) [2023-12-26 10:40:15,486][123091] Updated weights for policy 0, policy_version 1387296 (0.0009) [2023-12-26 10:40:15,544][123091] Updated weights for policy 0, policy_version 1387306 (0.0009) [2023-12-26 10:40:15,680][123090] Updated weights for policy 1, policy_version 1377797 (0.0009) [2023-12-26 10:40:15,732][123090] Updated weights for policy 1, policy_version 1377807 (0.0008) [2023-12-26 10:40:15,789][123090] Updated weights for policy 1, policy_version 1377817 (0.0008) [2023-12-26 10:40:16,413][123091] Updated weights for policy 0, policy_version 1387316 (0.0009) [2023-12-26 10:40:16,476][123091] Updated weights for policy 0, policy_version 1387326 (0.0009) [2023-12-26 10:40:16,541][123091] Updated weights for policy 0, policy_version 1387336 (0.0010) [2023-12-26 10:40:16,613][123090] Updated weights for policy 1, policy_version 1377827 (0.0008) [2023-12-26 10:40:16,660][123090] Updated weights for policy 1, policy_version 1377837 (0.0005) [2023-12-26 10:40:16,715][123090] Updated weights for policy 1, policy_version 1377847 (0.0005) [2023-12-26 10:40:17,373][123090] Updated weights for policy 1, policy_version 1377857 (0.0006) [2023-12-26 10:40:17,424][123091] Updated weights for policy 0, policy_version 1387346 (0.0010) [2023-12-26 10:40:17,431][123090] Updated weights for policy 1, policy_version 1377867 (0.0009) [2023-12-26 10:40:17,473][123091] Updated weights for policy 0, policy_version 1387356 (0.0007) [2023-12-26 10:40:17,476][123090] Updated weights for policy 1, policy_version 1377877 (0.0007) [2023-12-26 10:40:17,537][123091] Updated weights for policy 0, policy_version 1387366 (0.0010) [2023-12-26 10:40:17,540][123090] Updated weights for policy 1, policy_version 1377887 (0.0005) [2023-12-26 10:40:17,594][123091] Updated weights for policy 0, policy_version 1387376 (0.0005) [2023-12-26 10:40:18,275][123091] Updated weights for policy 0, policy_version 1387386 (0.0005) [2023-12-26 10:40:18,324][123091] Updated weights for policy 0, policy_version 1387396 (0.0007) [2023-12-26 10:40:18,329][123090] Updated weights for policy 1, policy_version 1377897 (0.0006) [2023-12-26 10:40:18,395][123091] Updated weights for policy 0, policy_version 1387406 (0.0010) [2023-12-26 10:40:18,396][123090] Updated weights for policy 1, policy_version 1377907 (0.0008) [2023-12-26 10:40:18,463][123090] Updated weights for policy 1, policy_version 1377917 (0.0010) [2023-12-26 10:40:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 707928064. Throughput: 0: 8661.5, 1: 8837.3. Samples: 707937984. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:18,785][121949] Avg episode reward: [(0, '6385.406'), (1, '5999.792')] [2023-12-26 10:40:19,232][123091] Updated weights for policy 0, policy_version 1387416 (0.0009) [2023-12-26 10:40:19,246][123090] Updated weights for policy 1, policy_version 1377927 (0.0010) [2023-12-26 10:40:19,298][123091] Updated weights for policy 0, policy_version 1387426 (0.0007) [2023-12-26 10:40:19,305][123090] Updated weights for policy 1, policy_version 1377937 (0.0009) [2023-12-26 10:40:19,361][123091] Updated weights for policy 0, policy_version 1387436 (0.0009) [2023-12-26 10:40:19,381][123090] Updated weights for policy 1, policy_version 1377947 (0.0007) [2023-12-26 10:40:20,175][123091] Updated weights for policy 0, policy_version 1387446 (0.0006) [2023-12-26 10:40:20,191][123090] Updated weights for policy 1, policy_version 1377957 (0.0009) [2023-12-26 10:40:20,243][123091] Updated weights for policy 0, policy_version 1387456 (0.0008) [2023-12-26 10:40:20,259][123090] Updated weights for policy 1, policy_version 1377967 (0.0007) [2023-12-26 10:40:20,310][123091] Updated weights for policy 0, policy_version 1387466 (0.0011) [2023-12-26 10:40:20,325][123090] Updated weights for policy 1, policy_version 1377977 (0.0005) [2023-12-26 10:40:21,092][123091] Updated weights for policy 0, policy_version 1387476 (0.0011) [2023-12-26 10:40:21,160][123090] Updated weights for policy 1, policy_version 1377987 (0.0007) [2023-12-26 10:40:21,167][123091] Updated weights for policy 0, policy_version 1387486 (0.0010) [2023-12-26 10:40:21,219][123090] Updated weights for policy 1, policy_version 1377997 (0.0006) [2023-12-26 10:40:21,230][123091] Updated weights for policy 0, policy_version 1387496 (0.0009) [2023-12-26 10:40:21,292][123090] Updated weights for policy 1, policy_version 1378007 (0.0007) [2023-12-26 10:40:21,988][123091] Updated weights for policy 0, policy_version 1387506 (0.0008) [2023-12-26 10:40:22,051][123091] Updated weights for policy 0, policy_version 1387516 (0.0009) [2023-12-26 10:40:22,105][123091] Updated weights for policy 0, policy_version 1387526 (0.0006) [2023-12-26 10:40:22,166][123091] Updated weights for policy 0, policy_version 1387536 (0.0005) [2023-12-26 10:40:22,179][123090] Updated weights for policy 1, policy_version 1378017 (0.0008) [2023-12-26 10:40:22,245][123090] Updated weights for policy 1, policy_version 1378027 (0.0009) [2023-12-26 10:40:22,308][123090] Updated weights for policy 1, policy_version 1378037 (0.0010) [2023-12-26 10:40:22,377][123090] Updated weights for policy 1, policy_version 1378047 (0.0009) [2023-12-26 10:40:22,998][123091] Updated weights for policy 0, policy_version 1387546 (0.0010) [2023-12-26 10:40:23,051][123091] Updated weights for policy 0, policy_version 1387556 (0.0010) [2023-12-26 10:40:23,106][123091] Updated weights for policy 0, policy_version 1387567 (0.0010) [2023-12-26 10:40:23,202][123090] Updated weights for policy 1, policy_version 1378057 (0.0006) [2023-12-26 10:40:23,271][123090] Updated weights for policy 1, policy_version 1378067 (0.0007) [2023-12-26 10:40:23,339][123090] Updated weights for policy 1, policy_version 1378077 (0.0008) [2023-12-26 10:40:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 708009984. Throughput: 0: 8649.0, 1: 8792.3. Samples: 707989500. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:23,785][121949] Avg episode reward: [(0, '6349.119'), (1, '5890.556')] [2023-12-26 10:40:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001387568_355221504.pth... [2023-12-26 10:40:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001378080_352788480.pth... [2023-12-26 10:40:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001386576_354967552.pth [2023-12-26 10:40:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001377056_352526336.pth [2023-12-26 10:40:23,891][123091] Updated weights for policy 0, policy_version 1387577 (0.0006) [2023-12-26 10:40:23,959][123091] Updated weights for policy 0, policy_version 1387587 (0.0006) [2023-12-26 10:40:24,025][123091] Updated weights for policy 0, policy_version 1387597 (0.0009) [2023-12-26 10:40:24,128][123090] Updated weights for policy 1, policy_version 1378087 (0.0008) [2023-12-26 10:40:24,195][123090] Updated weights for policy 1, policy_version 1378097 (0.0009) [2023-12-26 10:40:24,266][123090] Updated weights for policy 1, policy_version 1378107 (0.0010) [2023-12-26 10:40:24,700][123091] Updated weights for policy 0, policy_version 1387607 (0.0007) [2023-12-26 10:40:24,752][123091] Updated weights for policy 0, policy_version 1387617 (0.0005) [2023-12-26 10:40:24,812][123091] Updated weights for policy 0, policy_version 1387627 (0.0005) [2023-12-26 10:40:25,202][123090] Updated weights for policy 1, policy_version 1378118 (0.0010) [2023-12-26 10:40:25,273][123090] Updated weights for policy 1, policy_version 1378128 (0.0008) [2023-12-26 10:40:25,329][123090] Updated weights for policy 1, policy_version 1378138 (0.0008) [2023-12-26 10:40:25,569][123091] Updated weights for policy 0, policy_version 1387637 (0.0007) [2023-12-26 10:40:25,623][123091] Updated weights for policy 0, policy_version 1387648 (0.0010) [2023-12-26 10:40:25,669][123091] Updated weights for policy 0, policy_version 1387658 (0.0008) [2023-12-26 10:40:26,125][123090] Updated weights for policy 1, policy_version 1378148 (0.0009) [2023-12-26 10:40:26,182][123090] Updated weights for policy 1, policy_version 1378158 (0.0009) [2023-12-26 10:40:26,249][123090] Updated weights for policy 1, policy_version 1378168 (0.0009) [2023-12-26 10:40:26,494][123091] Updated weights for policy 0, policy_version 1387668 (0.0008) [2023-12-26 10:40:26,545][123091] Updated weights for policy 0, policy_version 1387678 (0.0005) [2023-12-26 10:40:26,602][123091] Updated weights for policy 0, policy_version 1387688 (0.0007) [2023-12-26 10:40:27,138][123090] Updated weights for policy 1, policy_version 1378178 (0.0009) [2023-12-26 10:40:27,191][123090] Updated weights for policy 1, policy_version 1378188 (0.0010) [2023-12-26 10:40:27,232][123091] Updated weights for policy 0, policy_version 1387698 (0.0010) [2023-12-26 10:40:27,244][123090] Updated weights for policy 1, policy_version 1378199 (0.0008) [2023-12-26 10:40:27,284][123091] Updated weights for policy 0, policy_version 1387708 (0.0008) [2023-12-26 10:40:27,340][123091] Updated weights for policy 0, policy_version 1387718 (0.0007) [2023-12-26 10:40:27,395][123091] Updated weights for policy 0, policy_version 1387728 (0.0009) [2023-12-26 10:40:28,090][123090] Updated weights for policy 1, policy_version 1378209 (0.0008) [2023-12-26 10:40:28,154][123090] Updated weights for policy 1, policy_version 1378219 (0.0008) [2023-12-26 10:40:28,183][123091] Updated weights for policy 0, policy_version 1387738 (0.0008) [2023-12-26 10:40:28,204][123090] Updated weights for policy 1, policy_version 1378229 (0.0008) [2023-12-26 10:40:28,249][123091] Updated weights for policy 0, policy_version 1387748 (0.0010) [2023-12-26 10:40:28,260][123090] Updated weights for policy 1, policy_version 1378239 (0.0007) [2023-12-26 10:40:28,303][123091] Updated weights for policy 0, policy_version 1387758 (0.0009) [2023-12-26 10:40:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 708100096. Throughput: 0: 8701.4, 1: 8714.3. Samples: 708095700. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:28,785][121949] Avg episode reward: [(0, '6364.627'), (1, '5895.178')] [2023-12-26 10:40:28,915][123090] Updated weights for policy 1, policy_version 1378249 (0.0006) [2023-12-26 10:40:28,971][123090] Updated weights for policy 1, policy_version 1378259 (0.0007) [2023-12-26 10:40:29,025][123090] Updated weights for policy 1, policy_version 1378269 (0.0005) [2023-12-26 10:40:29,223][123091] Updated weights for policy 0, policy_version 1387768 (0.0009) [2023-12-26 10:40:29,288][123091] Updated weights for policy 0, policy_version 1387778 (0.0007) [2023-12-26 10:40:29,350][123091] Updated weights for policy 0, policy_version 1387788 (0.0007) [2023-12-26 10:40:29,797][123090] Updated weights for policy 1, policy_version 1378279 (0.0008) [2023-12-26 10:40:29,856][123090] Updated weights for policy 1, policy_version 1378289 (0.0010) [2023-12-26 10:40:29,912][123090] Updated weights for policy 1, policy_version 1378299 (0.0010) [2023-12-26 10:40:30,175][123091] Updated weights for policy 0, policy_version 1387798 (0.0008) [2023-12-26 10:40:30,245][123091] Updated weights for policy 0, policy_version 1387808 (0.0009) [2023-12-26 10:40:30,323][123091] Updated weights for policy 0, policy_version 1387818 (0.0009) [2023-12-26 10:40:30,659][123090] Updated weights for policy 1, policy_version 1378309 (0.0007) [2023-12-26 10:40:30,725][123090] Updated weights for policy 1, policy_version 1378319 (0.0005) [2023-12-26 10:40:30,798][123090] Updated weights for policy 1, policy_version 1378329 (0.0005) [2023-12-26 10:40:30,935][123091] Updated weights for policy 0, policy_version 1387828 (0.0008) [2023-12-26 10:40:31,003][123091] Updated weights for policy 0, policy_version 1387838 (0.0005) [2023-12-26 10:40:31,079][123091] Updated weights for policy 0, policy_version 1387851 (0.0007) [2023-12-26 10:40:31,466][123090] Updated weights for policy 1, policy_version 1378339 (0.0005) [2023-12-26 10:40:31,539][123090] Updated weights for policy 1, policy_version 1378349 (0.0005) [2023-12-26 10:40:31,605][123090] Updated weights for policy 1, policy_version 1378359 (0.0006) [2023-12-26 10:40:31,859][123091] Updated weights for policy 0, policy_version 1387861 (0.0008) [2023-12-26 10:40:31,921][123091] Updated weights for policy 0, policy_version 1387871 (0.0011) [2023-12-26 10:40:31,991][123091] Updated weights for policy 0, policy_version 1387881 (0.0011) [2023-12-26 10:40:32,299][123090] Updated weights for policy 1, policy_version 1378369 (0.0008) [2023-12-26 10:40:32,376][123090] Updated weights for policy 1, policy_version 1378379 (0.0006) [2023-12-26 10:40:32,434][123090] Updated weights for policy 1, policy_version 1378389 (0.0006) [2023-12-26 10:40:32,509][123090] Updated weights for policy 1, policy_version 1378399 (0.0007) [2023-12-26 10:40:32,681][123091] Updated weights for policy 0, policy_version 1387891 (0.0009) [2023-12-26 10:40:32,746][123091] Updated weights for policy 0, policy_version 1387901 (0.0005) [2023-12-26 10:40:32,817][123091] Updated weights for policy 0, policy_version 1387911 (0.0005) [2023-12-26 10:40:33,238][123090] Updated weights for policy 1, policy_version 1378409 (0.0009) [2023-12-26 10:40:33,292][123090] Updated weights for policy 1, policy_version 1378419 (0.0010) [2023-12-26 10:40:33,347][123090] Updated weights for policy 1, policy_version 1378430 (0.0010) [2023-12-26 10:40:33,432][123091] Updated weights for policy 0, policy_version 1387921 (0.0005) [2023-12-26 10:40:33,479][123091] Updated weights for policy 0, policy_version 1387931 (0.0005) [2023-12-26 10:40:33,528][123091] Updated weights for policy 0, policy_version 1387941 (0.0005) [2023-12-26 10:40:33,570][123091] Updated weights for policy 0, policy_version 1387951 (0.0005) [2023-12-26 10:40:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 708198400. Throughput: 0: 8800.5, 1: 8768.2. Samples: 708207944. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:33,785][121949] Avg episode reward: [(0, '6353.784'), (1, '5933.075')] [2023-12-26 10:40:34,237][123090] Updated weights for policy 1, policy_version 1378440 (0.0009) [2023-12-26 10:40:34,296][123090] Updated weights for policy 1, policy_version 1378450 (0.0010) [2023-12-26 10:40:34,356][123090] Updated weights for policy 1, policy_version 1378460 (0.0010) [2023-12-26 10:40:34,388][123091] Updated weights for policy 0, policy_version 1387961 (0.0010) [2023-12-26 10:40:34,452][123091] Updated weights for policy 0, policy_version 1387971 (0.0011) [2023-12-26 10:40:34,504][123091] Updated weights for policy 0, policy_version 1387981 (0.0011) [2023-12-26 10:40:35,187][123091] Updated weights for policy 0, policy_version 1387991 (0.0011) [2023-12-26 10:40:35,220][123090] Updated weights for policy 1, policy_version 1378470 (0.0005) [2023-12-26 10:40:35,251][123091] Updated weights for policy 0, policy_version 1388001 (0.0011) [2023-12-26 10:40:35,282][123090] Updated weights for policy 1, policy_version 1378480 (0.0006) [2023-12-26 10:40:35,315][123091] Updated weights for policy 0, policy_version 1388011 (0.0011) [2023-12-26 10:40:35,339][123090] Updated weights for policy 1, policy_version 1378490 (0.0006) [2023-12-26 10:40:35,958][123090] Updated weights for policy 1, policy_version 1378500 (0.0009) [2023-12-26 10:40:36,012][123090] Updated weights for policy 1, policy_version 1378510 (0.0009) [2023-12-26 10:40:36,064][123090] Updated weights for policy 1, policy_version 1378520 (0.0009) [2023-12-26 10:40:36,143][123091] Updated weights for policy 0, policy_version 1388021 (0.0011) [2023-12-26 10:40:36,199][123091] Updated weights for policy 0, policy_version 1388031 (0.0011) [2023-12-26 10:40:36,262][123091] Updated weights for policy 0, policy_version 1388041 (0.0010) [2023-12-26 10:40:36,949][123090] Updated weights for policy 1, policy_version 1378530 (0.0009) [2023-12-26 10:40:37,007][123090] Updated weights for policy 1, policy_version 1378540 (0.0009) [2023-12-26 10:40:37,064][123090] Updated weights for policy 1, policy_version 1378550 (0.0009) [2023-12-26 10:40:37,089][123091] Updated weights for policy 0, policy_version 1388051 (0.0011) [2023-12-26 10:40:37,110][123090] Updated weights for policy 1, policy_version 1378560 (0.0008) [2023-12-26 10:40:37,144][123091] Updated weights for policy 0, policy_version 1388061 (0.0010) [2023-12-26 10:40:37,205][123091] Updated weights for policy 0, policy_version 1388071 (0.0010) [2023-12-26 10:40:37,987][123090] Updated weights for policy 1, policy_version 1378570 (0.0009) [2023-12-26 10:40:38,021][123091] Updated weights for policy 0, policy_version 1388081 (0.0010) [2023-12-26 10:40:38,051][123090] Updated weights for policy 1, policy_version 1378580 (0.0008) [2023-12-26 10:40:38,073][123091] Updated weights for policy 0, policy_version 1388091 (0.0010) [2023-12-26 10:40:38,110][123090] Updated weights for policy 1, policy_version 1378590 (0.0007) [2023-12-26 10:40:38,124][123091] Updated weights for policy 0, policy_version 1388101 (0.0010) [2023-12-26 10:40:38,171][123091] Updated weights for policy 0, policy_version 1388111 (0.0010) [2023-12-26 10:40:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 708280320. Throughput: 0: 8804.3, 1: 8800.7. Samples: 708260736. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:38,785][121949] Avg episode reward: [(0, '6320.522'), (1, '5984.634')] [2023-12-26 10:40:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001378592_352919552.pth... [2023-12-26 10:40:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001388112_355360768.pth... [2023-12-26 10:40:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001377568_352657408.pth [2023-12-26 10:40:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001387088_355098624.pth [2023-12-26 10:40:38,963][123090] Updated weights for policy 1, policy_version 1378600 (0.0008) [2023-12-26 10:40:39,014][123091] Updated weights for policy 0, policy_version 1388121 (0.0010) [2023-12-26 10:40:39,030][123090] Updated weights for policy 1, policy_version 1378610 (0.0008) [2023-12-26 10:40:39,060][123091] Updated weights for policy 0, policy_version 1388131 (0.0007) [2023-12-26 10:40:39,083][123090] Updated weights for policy 1, policy_version 1378620 (0.0010) [2023-12-26 10:40:39,114][123091] Updated weights for policy 0, policy_version 1388141 (0.0007) [2023-12-26 10:40:39,941][123090] Updated weights for policy 1, policy_version 1378630 (0.0009) [2023-12-26 10:40:40,003][123091] Updated weights for policy 0, policy_version 1388151 (0.0008) [2023-12-26 10:40:40,014][123090] Updated weights for policy 1, policy_version 1378640 (0.0009) [2023-12-26 10:40:40,057][123091] Updated weights for policy 0, policy_version 1388161 (0.0007) [2023-12-26 10:40:40,078][123090] Updated weights for policy 1, policy_version 1378650 (0.0008) [2023-12-26 10:40:40,121][123091] Updated weights for policy 0, policy_version 1388171 (0.0009) [2023-12-26 10:40:40,913][123091] Updated weights for policy 0, policy_version 1388181 (0.0008) [2023-12-26 10:40:40,941][123090] Updated weights for policy 1, policy_version 1378660 (0.0007) [2023-12-26 10:40:40,977][123091] Updated weights for policy 0, policy_version 1388191 (0.0005) [2023-12-26 10:40:40,991][123090] Updated weights for policy 1, policy_version 1378670 (0.0009) [2023-12-26 10:40:41,043][123091] Updated weights for policy 0, policy_version 1388201 (0.0007) [2023-12-26 10:40:41,055][123090] Updated weights for policy 1, policy_version 1378680 (0.0008) [2023-12-26 10:40:41,802][123091] Updated weights for policy 0, policy_version 1388211 (0.0007) [2023-12-26 10:40:41,866][123091] Updated weights for policy 0, policy_version 1388221 (0.0006) [2023-12-26 10:40:41,902][123090] Updated weights for policy 1, policy_version 1378690 (0.0009) [2023-12-26 10:40:41,933][123091] Updated weights for policy 0, policy_version 1388231 (0.0009) [2023-12-26 10:40:41,968][123090] Updated weights for policy 1, policy_version 1378700 (0.0005) [2023-12-26 10:40:42,034][123090] Updated weights for policy 1, policy_version 1378710 (0.0010) [2023-12-26 10:40:42,094][123090] Updated weights for policy 1, policy_version 1378720 (0.0008) [2023-12-26 10:40:42,768][123091] Updated weights for policy 0, policy_version 1388241 (0.0009) [2023-12-26 10:40:42,830][123091] Updated weights for policy 0, policy_version 1388251 (0.0010) [2023-12-26 10:40:42,896][123091] Updated weights for policy 0, policy_version 1388261 (0.0006) [2023-12-26 10:40:42,900][123090] Updated weights for policy 1, policy_version 1378730 (0.0009) [2023-12-26 10:40:42,960][123090] Updated weights for policy 1, policy_version 1378740 (0.0009) [2023-12-26 10:40:42,969][123091] Updated weights for policy 0, policy_version 1388271 (0.0006) [2023-12-26 10:40:43,016][123090] Updated weights for policy 1, policy_version 1378750 (0.0009) [2023-12-26 10:40:43,748][123091] Updated weights for policy 0, policy_version 1388281 (0.0009) [2023-12-26 10:40:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 708362240. Throughput: 0: 8770.0, 1: 8713.2. Samples: 708361676. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:43,785][121949] Avg episode reward: [(0, '6306.034'), (1, '5882.354')] [2023-12-26 10:40:43,808][123091] Updated weights for policy 0, policy_version 1388291 (0.0010) [2023-12-26 10:40:43,868][123091] Updated weights for policy 0, policy_version 1388301 (0.0010) [2023-12-26 10:40:43,875][123090] Updated weights for policy 1, policy_version 1378760 (0.0009) [2023-12-26 10:40:43,931][123090] Updated weights for policy 1, policy_version 1378770 (0.0009) [2023-12-26 10:40:43,998][123090] Updated weights for policy 1, policy_version 1378780 (0.0010) [2023-12-26 10:40:44,605][123091] Updated weights for policy 0, policy_version 1388311 (0.0010) [2023-12-26 10:40:44,668][123091] Updated weights for policy 0, policy_version 1388321 (0.0010) [2023-12-26 10:40:44,733][123091] Updated weights for policy 0, policy_version 1388331 (0.0010) [2023-12-26 10:40:44,900][123090] Updated weights for policy 1, policy_version 1378790 (0.0009) [2023-12-26 10:40:44,953][123090] Updated weights for policy 1, policy_version 1378800 (0.0009) [2023-12-26 10:40:45,006][123090] Updated weights for policy 1, policy_version 1378810 (0.0008) [2023-12-26 10:40:45,459][123091] Updated weights for policy 0, policy_version 1388341 (0.0009) [2023-12-26 10:40:45,529][123091] Updated weights for policy 0, policy_version 1388351 (0.0010) [2023-12-26 10:40:45,599][123091] Updated weights for policy 0, policy_version 1388361 (0.0010) [2023-12-26 10:40:45,846][123090] Updated weights for policy 1, policy_version 1378820 (0.0008) [2023-12-26 10:40:45,900][123090] Updated weights for policy 1, policy_version 1378830 (0.0007) [2023-12-26 10:40:45,950][123090] Updated weights for policy 1, policy_version 1378840 (0.0009) [2023-12-26 10:40:46,466][123091] Updated weights for policy 0, policy_version 1388371 (0.0010) [2023-12-26 10:40:46,513][123091] Updated weights for policy 0, policy_version 1388381 (0.0010) [2023-12-26 10:40:46,561][123091] Updated weights for policy 0, policy_version 1388391 (0.0010) [2023-12-26 10:40:46,757][123090] Updated weights for policy 1, policy_version 1378850 (0.0009) [2023-12-26 10:40:46,810][123090] Updated weights for policy 1, policy_version 1378860 (0.0009) [2023-12-26 10:40:46,862][123090] Updated weights for policy 1, policy_version 1378870 (0.0009) [2023-12-26 10:40:46,915][123090] Updated weights for policy 1, policy_version 1378880 (0.0009) [2023-12-26 10:40:47,397][123091] Updated weights for policy 0, policy_version 1388401 (0.0010) [2023-12-26 10:40:47,451][123091] Updated weights for policy 0, policy_version 1388411 (0.0010) [2023-12-26 10:40:47,517][123091] Updated weights for policy 0, policy_version 1388421 (0.0010) [2023-12-26 10:40:47,575][123091] Updated weights for policy 0, policy_version 1388431 (0.0010) [2023-12-26 10:40:47,771][123090] Updated weights for policy 1, policy_version 1378890 (0.0005) [2023-12-26 10:40:47,821][123090] Updated weights for policy 1, policy_version 1378900 (0.0005) [2023-12-26 10:40:47,867][123090] Updated weights for policy 1, policy_version 1378910 (0.0005) [2023-12-26 10:40:48,387][123091] Updated weights for policy 0, policy_version 1388441 (0.0011) [2023-12-26 10:40:48,443][123091] Updated weights for policy 0, policy_version 1388451 (0.0011) [2023-12-26 10:40:48,509][123091] Updated weights for policy 0, policy_version 1388461 (0.0011) [2023-12-26 10:40:48,683][123090] Updated weights for policy 1, policy_version 1378920 (0.0009) [2023-12-26 10:40:48,742][123090] Updated weights for policy 1, policy_version 1378930 (0.0010) [2023-12-26 10:40:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 708452352. Throughput: 0: 8795.0, 1: 8724.6. Samples: 708465820. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:48,785][121949] Avg episode reward: [(0, '6357.404'), (1, '5879.072')] [2023-12-26 10:40:48,802][123090] Updated weights for policy 1, policy_version 1378940 (0.0010) [2023-12-26 10:40:49,349][123091] Updated weights for policy 0, policy_version 1388471 (0.0011) [2023-12-26 10:40:49,419][123091] Updated weights for policy 0, policy_version 1388481 (0.0011) [2023-12-26 10:40:49,478][123091] Updated weights for policy 0, policy_version 1388491 (0.0010) [2023-12-26 10:40:49,653][123090] Updated weights for policy 1, policy_version 1378950 (0.0011) [2023-12-26 10:40:49,714][123090] Updated weights for policy 1, policy_version 1378960 (0.0011) [2023-12-26 10:40:49,766][123090] Updated weights for policy 1, policy_version 1378970 (0.0010) [2023-12-26 10:40:50,287][123091] Updated weights for policy 0, policy_version 1388501 (0.0010) [2023-12-26 10:40:50,352][123091] Updated weights for policy 0, policy_version 1388511 (0.0010) [2023-12-26 10:40:50,415][123091] Updated weights for policy 0, policy_version 1388521 (0.0010) [2023-12-26 10:40:50,607][123090] Updated weights for policy 1, policy_version 1378980 (0.0010) [2023-12-26 10:40:50,665][123090] Updated weights for policy 1, policy_version 1378990 (0.0008) [2023-12-26 10:40:50,727][123090] Updated weights for policy 1, policy_version 1379000 (0.0005) [2023-12-26 10:40:51,240][123091] Updated weights for policy 0, policy_version 1388531 (0.0011) [2023-12-26 10:40:51,307][123091] Updated weights for policy 0, policy_version 1388541 (0.0011) [2023-12-26 10:40:51,381][123091] Updated weights for policy 0, policy_version 1388551 (0.0013) [2023-12-26 10:40:51,495][123090] Updated weights for policy 1, policy_version 1379010 (0.0005) [2023-12-26 10:40:51,568][123090] Updated weights for policy 1, policy_version 1379020 (0.0009) [2023-12-26 10:40:51,636][123090] Updated weights for policy 1, policy_version 1379030 (0.0009) [2023-12-26 10:40:51,717][123090] Updated weights for policy 1, policy_version 1379040 (0.0009) [2023-12-26 10:40:52,179][123091] Updated weights for policy 0, policy_version 1388561 (0.0011) [2023-12-26 10:40:52,241][123091] Updated weights for policy 0, policy_version 1388571 (0.0011) [2023-12-26 10:40:52,301][123091] Updated weights for policy 0, policy_version 1388581 (0.0011) [2023-12-26 10:40:52,370][123091] Updated weights for policy 0, policy_version 1388591 (0.0009) [2023-12-26 10:40:52,539][123090] Updated weights for policy 1, policy_version 1379050 (0.0005) [2023-12-26 10:40:52,609][123090] Updated weights for policy 1, policy_version 1379060 (0.0009) [2023-12-26 10:40:52,667][123090] Updated weights for policy 1, policy_version 1379070 (0.0005) [2023-12-26 10:40:53,108][123091] Updated weights for policy 0, policy_version 1388601 (0.0010) [2023-12-26 10:40:53,170][123091] Updated weights for policy 0, policy_version 1388611 (0.0011) [2023-12-26 10:40:53,244][123091] Updated weights for policy 0, policy_version 1388621 (0.0011) [2023-12-26 10:40:53,344][123090] Updated weights for policy 1, policy_version 1379080 (0.0005) [2023-12-26 10:40:53,394][123090] Updated weights for policy 1, policy_version 1379090 (0.0005) [2023-12-26 10:40:53,448][123090] Updated weights for policy 1, policy_version 1379100 (0.0005) [2023-12-26 10:40:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17633.7). Total num frames: 708542464. Throughput: 0: 8819.0, 1: 8674.1. Samples: 708517884. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:53,784][121949] Avg episode reward: [(0, '6391.569'), (1, '5916.566')] [2023-12-26 10:40:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001388624_355491840.pth... [2023-12-26 10:40:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001379104_353050624.pth... [2023-12-26 10:40:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001387568_355221504.pth [2023-12-26 10:40:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001378080_352788480.pth [2023-12-26 10:40:54,003][123091] Updated weights for policy 0, policy_version 1388631 (0.0007) [2023-12-26 10:40:54,071][123091] Updated weights for policy 0, policy_version 1388641 (0.0005) [2023-12-26 10:40:54,127][123091] Updated weights for policy 0, policy_version 1388651 (0.0009) [2023-12-26 10:40:54,285][123090] Updated weights for policy 1, policy_version 1379110 (0.0007) [2023-12-26 10:40:54,353][123090] Updated weights for policy 1, policy_version 1379120 (0.0009) [2023-12-26 10:40:54,414][123090] Updated weights for policy 1, policy_version 1379130 (0.0008) [2023-12-26 10:40:54,840][123091] Updated weights for policy 0, policy_version 1388661 (0.0008) [2023-12-26 10:40:54,885][123091] Updated weights for policy 0, policy_version 1388671 (0.0006) [2023-12-26 10:40:54,937][123091] Updated weights for policy 0, policy_version 1388681 (0.0010) [2023-12-26 10:40:55,087][123090] Updated weights for policy 1, policy_version 1379140 (0.0007) [2023-12-26 10:40:55,140][123090] Updated weights for policy 1, policy_version 1379150 (0.0009) [2023-12-26 10:40:55,193][123090] Updated weights for policy 1, policy_version 1379160 (0.0009) [2023-12-26 10:40:55,763][123091] Updated weights for policy 0, policy_version 1388691 (0.0011) [2023-12-26 10:40:55,810][123091] Updated weights for policy 0, policy_version 1388701 (0.0010) [2023-12-26 10:40:55,869][123091] Updated weights for policy 0, policy_version 1388711 (0.0011) [2023-12-26 10:40:55,992][123090] Updated weights for policy 1, policy_version 1379170 (0.0009) [2023-12-26 10:40:56,058][123090] Updated weights for policy 1, policy_version 1379180 (0.0008) [2023-12-26 10:40:56,123][123090] Updated weights for policy 1, policy_version 1379190 (0.0009) [2023-12-26 10:40:56,188][123090] Updated weights for policy 1, policy_version 1379200 (0.0009) [2023-12-26 10:40:56,698][123091] Updated weights for policy 0, policy_version 1388721 (0.0010) [2023-12-26 10:40:56,756][123091] Updated weights for policy 0, policy_version 1388731 (0.0010) [2023-12-26 10:40:56,818][123091] Updated weights for policy 0, policy_version 1388741 (0.0011) [2023-12-26 10:40:56,892][123091] Updated weights for policy 0, policy_version 1388751 (0.0011) [2023-12-26 10:40:56,948][123090] Updated weights for policy 1, policy_version 1379210 (0.0005) [2023-12-26 10:40:57,012][123090] Updated weights for policy 1, policy_version 1379220 (0.0007) [2023-12-26 10:40:57,072][123090] Updated weights for policy 1, policy_version 1379230 (0.0009) [2023-12-26 10:40:57,691][123091] Updated weights for policy 0, policy_version 1388761 (0.0007) [2023-12-26 10:40:57,751][123091] Updated weights for policy 0, policy_version 1388771 (0.0011) [2023-12-26 10:40:57,807][123091] Updated weights for policy 0, policy_version 1388781 (0.0007) [2023-12-26 10:40:57,807][123090] Updated weights for policy 1, policy_version 1379240 (0.0006) [2023-12-26 10:40:57,874][123090] Updated weights for policy 1, policy_version 1379250 (0.0005) [2023-12-26 10:40:57,945][123090] Updated weights for policy 1, policy_version 1379260 (0.0005) [2023-12-26 10:40:58,572][123091] Updated weights for policy 0, policy_version 1388791 (0.0009) [2023-12-26 10:40:58,634][123091] Updated weights for policy 0, policy_version 1388801 (0.0010) [2023-12-26 10:40:58,708][123091] Updated weights for policy 0, policy_version 1388811 (0.0010) [2023-12-26 10:40:58,732][123090] Updated weights for policy 1, policy_version 1379270 (0.0007) [2023-12-26 10:40:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 708632576. Throughput: 0: 8901.3, 1: 8760.7. Samples: 708626056. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:40:58,785][121949] Avg episode reward: [(0, '6398.805'), (1, '5928.349')] [2023-12-26 10:40:58,807][123090] Updated weights for policy 1, policy_version 1379281 (0.0010) [2023-12-26 10:40:58,876][123090] Updated weights for policy 1, policy_version 1379291 (0.0009) [2023-12-26 10:40:59,673][123091] Updated weights for policy 0, policy_version 1388821 (0.0008) [2023-12-26 10:40:59,682][123090] Updated weights for policy 1, policy_version 1379301 (0.0008) [2023-12-26 10:40:59,725][123091] Updated weights for policy 0, policy_version 1388831 (0.0009) [2023-12-26 10:40:59,742][123090] Updated weights for policy 1, policy_version 1379311 (0.0008) [2023-12-26 10:40:59,786][123091] Updated weights for policy 0, policy_version 1388841 (0.0011) [2023-12-26 10:40:59,802][123090] Updated weights for policy 1, policy_version 1379321 (0.0007) [2023-12-26 10:41:00,594][123090] Updated weights for policy 1, policy_version 1379331 (0.0008) [2023-12-26 10:41:00,628][123091] Updated weights for policy 0, policy_version 1388851 (0.0008) [2023-12-26 10:41:00,643][123090] Updated weights for policy 1, policy_version 1379341 (0.0009) [2023-12-26 10:41:00,680][123091] Updated weights for policy 0, policy_version 1388861 (0.0008) [2023-12-26 10:41:00,696][123090] Updated weights for policy 1, policy_version 1379351 (0.0007) [2023-12-26 10:41:00,736][123091] Updated weights for policy 0, policy_version 1388871 (0.0010) [2023-12-26 10:41:01,534][123090] Updated weights for policy 1, policy_version 1379361 (0.0008) [2023-12-26 10:41:01,591][123090] Updated weights for policy 1, policy_version 1379371 (0.0009) [2023-12-26 10:41:01,604][123091] Updated weights for policy 0, policy_version 1388881 (0.0008) [2023-12-26 10:41:01,662][123090] Updated weights for policy 1, policy_version 1379381 (0.0014) [2023-12-26 10:41:01,665][123091] Updated weights for policy 0, policy_version 1388891 (0.0006) [2023-12-26 10:41:01,728][123090] Updated weights for policy 1, policy_version 1379391 (0.0007) [2023-12-26 10:41:01,738][123091] Updated weights for policy 0, policy_version 1388901 (0.0009) [2023-12-26 10:41:01,805][123091] Updated weights for policy 0, policy_version 1388911 (0.0007) [2023-12-26 10:41:02,415][123091] Updated weights for policy 0, policy_version 1388921 (0.0006) [2023-12-26 10:41:02,470][123090] Updated weights for policy 1, policy_version 1379401 (0.0008) [2023-12-26 10:41:02,479][123091] Updated weights for policy 0, policy_version 1388931 (0.0008) [2023-12-26 10:41:02,536][123090] Updated weights for policy 1, policy_version 1379411 (0.0008) [2023-12-26 10:41:02,544][123091] Updated weights for policy 0, policy_version 1388941 (0.0008) [2023-12-26 10:41:02,602][123090] Updated weights for policy 1, policy_version 1379421 (0.0009) [2023-12-26 10:41:03,201][123090] Updated weights for policy 1, policy_version 1379431 (0.0007) [2023-12-26 10:41:03,224][123091] Updated weights for policy 0, policy_version 1388951 (0.0008) [2023-12-26 10:41:03,252][123090] Updated weights for policy 1, policy_version 1379441 (0.0005) [2023-12-26 10:41:03,273][123091] Updated weights for policy 0, policy_version 1388961 (0.0009) [2023-12-26 10:41:03,313][123090] Updated weights for policy 1, policy_version 1379451 (0.0005) [2023-12-26 10:41:03,332][123091] Updated weights for policy 0, policy_version 1388972 (0.0009) [2023-12-26 10:41:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 708722688. Throughput: 0: 8915.3, 1: 8752.2. Samples: 708733020. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:41:03,785][121949] Avg episode reward: [(0, '6356.333'), (1, '5811.861')] [2023-12-26 10:41:04,050][123090] Updated weights for policy 1, policy_version 1379461 (0.0006) [2023-12-26 10:41:04,115][123090] Updated weights for policy 1, policy_version 1379471 (0.0005) [2023-12-26 10:41:04,181][123090] Updated weights for policy 1, policy_version 1379481 (0.0006) [2023-12-26 10:41:04,241][123091] Updated weights for policy 0, policy_version 1388982 (0.0009) [2023-12-26 10:41:04,298][123091] Updated weights for policy 0, policy_version 1388992 (0.0009) [2023-12-26 10:41:04,363][123091] Updated weights for policy 0, policy_version 1389002 (0.0010) [2023-12-26 10:41:04,874][123090] Updated weights for policy 1, policy_version 1379491 (0.0006) [2023-12-26 10:41:04,931][123090] Updated weights for policy 1, policy_version 1379501 (0.0005) [2023-12-26 10:41:04,990][123090] Updated weights for policy 1, policy_version 1379511 (0.0005) [2023-12-26 10:41:05,243][123091] Updated weights for policy 0, policy_version 1389012 (0.0009) [2023-12-26 10:41:05,299][123091] Updated weights for policy 0, policy_version 1389022 (0.0008) [2023-12-26 10:41:05,361][123091] Updated weights for policy 0, policy_version 1389032 (0.0009) [2023-12-26 10:41:05,722][123090] Updated weights for policy 1, policy_version 1379521 (0.0006) [2023-12-26 10:41:05,789][123090] Updated weights for policy 1, policy_version 1379531 (0.0010) [2023-12-26 10:41:05,851][123090] Updated weights for policy 1, policy_version 1379541 (0.0009) [2023-12-26 10:41:05,917][123090] Updated weights for policy 1, policy_version 1379551 (0.0010) [2023-12-26 10:41:06,212][123091] Updated weights for policy 0, policy_version 1389042 (0.0009) [2023-12-26 10:41:06,272][123091] Updated weights for policy 0, policy_version 1389052 (0.0009) [2023-12-26 10:41:06,334][123091] Updated weights for policy 0, policy_version 1389062 (0.0009) [2023-12-26 10:41:06,395][123091] Updated weights for policy 0, policy_version 1389072 (0.0009) [2023-12-26 10:41:06,761][123090] Updated weights for policy 1, policy_version 1379561 (0.0006) [2023-12-26 10:41:06,827][123090] Updated weights for policy 1, policy_version 1379571 (0.0006) [2023-12-26 10:41:06,894][123090] Updated weights for policy 1, policy_version 1379581 (0.0006) [2023-12-26 10:41:07,287][123091] Updated weights for policy 0, policy_version 1389082 (0.0009) [2023-12-26 10:41:07,343][123091] Updated weights for policy 0, policy_version 1389092 (0.0009) [2023-12-26 10:41:07,405][123091] Updated weights for policy 0, policy_version 1389102 (0.0010) [2023-12-26 10:41:07,643][123090] Updated weights for policy 1, policy_version 1379591 (0.0007) [2023-12-26 10:41:07,705][123090] Updated weights for policy 1, policy_version 1379601 (0.0007) [2023-12-26 10:41:07,756][123090] Updated weights for policy 1, policy_version 1379611 (0.0007) [2023-12-26 10:41:08,348][123091] Updated weights for policy 0, policy_version 1389112 (0.0009) [2023-12-26 10:41:08,402][123091] Updated weights for policy 0, policy_version 1389122 (0.0006) [2023-12-26 10:41:08,469][123091] Updated weights for policy 0, policy_version 1389132 (0.0006) [2023-12-26 10:41:08,487][123090] Updated weights for policy 1, policy_version 1379621 (0.0008) [2023-12-26 10:41:08,541][123090] Updated weights for policy 1, policy_version 1379631 (0.0006) [2023-12-26 10:41:08,606][123090] Updated weights for policy 1, policy_version 1379641 (0.0006) [2023-12-26 10:41:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 708812800. Throughput: 0: 8886.6, 1: 8794.9. Samples: 708785164. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:41:08,784][121949] Avg episode reward: [(0, '6393.695'), (1, '5741.448')] [2023-12-26 10:41:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001389136_355622912.pth... [2023-12-26 10:41:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001379648_353189888.pth... [2023-12-26 10:41:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001378592_352919552.pth [2023-12-26 10:41:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001388112_355360768.pth [2023-12-26 10:41:09,226][123091] Updated weights for policy 0, policy_version 1389142 (0.0006) [2023-12-26 10:41:09,287][123091] Updated weights for policy 0, policy_version 1389152 (0.0007) [2023-12-26 10:41:09,358][123091] Updated weights for policy 0, policy_version 1389162 (0.0010) [2023-12-26 10:41:09,412][123090] Updated weights for policy 1, policy_version 1379651 (0.0007) [2023-12-26 10:41:09,488][123090] Updated weights for policy 1, policy_version 1379661 (0.0011) [2023-12-26 10:41:09,555][123090] Updated weights for policy 1, policy_version 1379671 (0.0011) [2023-12-26 10:41:10,124][123091] Updated weights for policy 0, policy_version 1389172 (0.0008) [2023-12-26 10:41:10,184][123091] Updated weights for policy 0, policy_version 1389182 (0.0007) [2023-12-26 10:41:10,251][123091] Updated weights for policy 0, policy_version 1389192 (0.0006) [2023-12-26 10:41:10,380][123090] Updated weights for policy 1, policy_version 1379681 (0.0011) [2023-12-26 10:41:10,440][123090] Updated weights for policy 1, policy_version 1379691 (0.0011) [2023-12-26 10:41:10,488][123090] Updated weights for policy 1, policy_version 1379701 (0.0010) [2023-12-26 10:41:10,539][123090] Updated weights for policy 1, policy_version 1379711 (0.0010) [2023-12-26 10:41:10,854][123091] Updated weights for policy 0, policy_version 1389202 (0.0005) [2023-12-26 10:41:10,911][123091] Updated weights for policy 0, policy_version 1389212 (0.0008) [2023-12-26 10:41:10,959][123091] Updated weights for policy 0, policy_version 1389222 (0.0008) [2023-12-26 10:41:11,008][123091] Updated weights for policy 0, policy_version 1389232 (0.0009) [2023-12-26 10:41:11,395][123090] Updated weights for policy 1, policy_version 1379721 (0.0009) [2023-12-26 10:41:11,475][123090] Updated weights for policy 1, policy_version 1379731 (0.0010) [2023-12-26 10:41:11,548][123090] Updated weights for policy 1, policy_version 1379741 (0.0008) [2023-12-26 10:41:11,954][123091] Updated weights for policy 0, policy_version 1389242 (0.0007) [2023-12-26 10:41:12,018][123091] Updated weights for policy 0, policy_version 1389252 (0.0011) [2023-12-26 10:41:12,079][123091] Updated weights for policy 0, policy_version 1389262 (0.0011) [2023-12-26 10:41:12,387][123090] Updated weights for policy 1, policy_version 1379751 (0.0010) [2023-12-26 10:41:12,439][123090] Updated weights for policy 1, policy_version 1379761 (0.0010) [2023-12-26 10:41:12,503][123090] Updated weights for policy 1, policy_version 1379771 (0.0011) [2023-12-26 10:41:12,905][123091] Updated weights for policy 0, policy_version 1389272 (0.0011) [2023-12-26 10:41:12,960][123091] Updated weights for policy 0, policy_version 1389282 (0.0011) [2023-12-26 10:41:13,015][123091] Updated weights for policy 0, policy_version 1389292 (0.0010) [2023-12-26 10:41:13,330][123090] Updated weights for policy 1, policy_version 1379781 (0.0010) [2023-12-26 10:41:13,377][123090] Updated weights for policy 1, policy_version 1379791 (0.0010) [2023-12-26 10:41:13,428][123090] Updated weights for policy 1, policy_version 1379801 (0.0010) [2023-12-26 10:41:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 708894720. Throughput: 0: 8790.5, 1: 8866.5. Samples: 708890264. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:41:13,785][121949] Avg episode reward: [(0, '6385.239'), (1, '5821.732')] [2023-12-26 10:41:13,840][123091] Updated weights for policy 0, policy_version 1389302 (0.0010) [2023-12-26 10:41:13,895][123091] Updated weights for policy 0, policy_version 1389312 (0.0011) [2023-12-26 10:41:13,962][123091] Updated weights for policy 0, policy_version 1389322 (0.0008) [2023-12-26 10:41:14,295][123090] Updated weights for policy 1, policy_version 1379811 (0.0008) [2023-12-26 10:41:14,354][123090] Updated weights for policy 1, policy_version 1379821 (0.0007) [2023-12-26 10:41:14,415][123090] Updated weights for policy 1, policy_version 1379831 (0.0008) [2023-12-26 10:41:14,726][123091] Updated weights for policy 0, policy_version 1389332 (0.0007) [2023-12-26 10:41:14,793][123091] Updated weights for policy 0, policy_version 1389342 (0.0009) [2023-12-26 10:41:14,855][123091] Updated weights for policy 0, policy_version 1389352 (0.0009) [2023-12-26 10:41:15,241][123090] Updated weights for policy 1, policy_version 1379841 (0.0010) [2023-12-26 10:41:15,308][123090] Updated weights for policy 1, policy_version 1379851 (0.0011) [2023-12-26 10:41:15,361][123090] Updated weights for policy 1, policy_version 1379861 (0.0011) [2023-12-26 10:41:15,413][123090] Updated weights for policy 1, policy_version 1379871 (0.0011) [2023-12-26 10:41:15,710][123091] Updated weights for policy 0, policy_version 1389362 (0.0009) [2023-12-26 10:41:15,762][123091] Updated weights for policy 0, policy_version 1389372 (0.0009) [2023-12-26 10:41:15,815][123091] Updated weights for policy 0, policy_version 1389382 (0.0009) [2023-12-26 10:41:15,875][123091] Updated weights for policy 0, policy_version 1389392 (0.0009) [2023-12-26 10:41:16,175][123090] Updated weights for policy 1, policy_version 1379881 (0.0006) [2023-12-26 10:41:16,225][123090] Updated weights for policy 1, policy_version 1379891 (0.0008) [2023-12-26 10:41:16,290][123090] Updated weights for policy 1, policy_version 1379901 (0.0010) [2023-12-26 10:41:16,765][123091] Updated weights for policy 0, policy_version 1389402 (0.0009) [2023-12-26 10:41:16,813][123091] Updated weights for policy 0, policy_version 1389412 (0.0009) [2023-12-26 10:41:16,864][123091] Updated weights for policy 0, policy_version 1389422 (0.0009) [2023-12-26 10:41:17,034][123090] Updated weights for policy 1, policy_version 1379911 (0.0009) [2023-12-26 10:41:17,099][123090] Updated weights for policy 1, policy_version 1379921 (0.0008) [2023-12-26 10:41:17,169][123090] Updated weights for policy 1, policy_version 1379931 (0.0008) [2023-12-26 10:41:17,742][123091] Updated weights for policy 0, policy_version 1389432 (0.0009) [2023-12-26 10:41:17,791][123091] Updated weights for policy 0, policy_version 1389442 (0.0009) [2023-12-26 10:41:17,842][123091] Updated weights for policy 0, policy_version 1389452 (0.0008) [2023-12-26 10:41:17,921][123090] Updated weights for policy 1, policy_version 1379941 (0.0008) [2023-12-26 10:41:17,979][123090] Updated weights for policy 1, policy_version 1379951 (0.0009) [2023-12-26 10:41:18,040][123090] Updated weights for policy 1, policy_version 1379961 (0.0009) [2023-12-26 10:41:18,713][123091] Updated weights for policy 0, policy_version 1389462 (0.0009) [2023-12-26 10:41:18,768][123091] Updated weights for policy 0, policy_version 1389472 (0.0010) [2023-12-26 10:41:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 708976640. Throughput: 0: 8675.2, 1: 8769.2. Samples: 708992940. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:41:18,785][121949] Avg episode reward: [(0, '6321.035'), (1, '5787.213')] [2023-12-26 10:41:18,837][123091] Updated weights for policy 0, policy_version 1389482 (0.0010) [2023-12-26 10:41:18,853][123090] Updated weights for policy 1, policy_version 1379971 (0.0009) [2023-12-26 10:41:18,923][123090] Updated weights for policy 1, policy_version 1379981 (0.0010) [2023-12-26 10:41:18,980][123090] Updated weights for policy 1, policy_version 1379991 (0.0009) [2023-12-26 10:41:19,727][123091] Updated weights for policy 0, policy_version 1389492 (0.0008) [2023-12-26 10:41:19,783][123090] Updated weights for policy 1, policy_version 1380001 (0.0009) [2023-12-26 10:41:19,789][123091] Updated weights for policy 0, policy_version 1389502 (0.0010) [2023-12-26 10:41:19,850][123090] Updated weights for policy 1, policy_version 1380011 (0.0008) [2023-12-26 10:41:19,853][123091] Updated weights for policy 0, policy_version 1389512 (0.0008) [2023-12-26 10:41:19,915][123090] Updated weights for policy 1, policy_version 1380021 (0.0008) [2023-12-26 10:41:19,979][123090] Updated weights for policy 1, policy_version 1380031 (0.0009) [2023-12-26 10:41:20,664][123091] Updated weights for policy 0, policy_version 1389522 (0.0007) [2023-12-26 10:41:20,730][123091] Updated weights for policy 0, policy_version 1389532 (0.0010) [2023-12-26 10:41:20,792][123091] Updated weights for policy 0, policy_version 1389542 (0.0010) [2023-12-26 10:41:20,857][123091] Updated weights for policy 0, policy_version 1389552 (0.0010) [2023-12-26 10:41:20,887][123090] Updated weights for policy 1, policy_version 1380041 (0.0009) [2023-12-26 10:41:20,939][123090] Updated weights for policy 1, policy_version 1380051 (0.0010) [2023-12-26 10:41:20,996][123090] Updated weights for policy 1, policy_version 1380062 (0.0010) [2023-12-26 10:41:21,599][123091] Updated weights for policy 0, policy_version 1389562 (0.0009) [2023-12-26 10:41:21,654][123091] Updated weights for policy 0, policy_version 1389572 (0.0009) [2023-12-26 10:41:21,713][123091] Updated weights for policy 0, policy_version 1389582 (0.0010) [2023-12-26 10:41:21,962][123090] Updated weights for policy 1, policy_version 1380072 (0.0010) [2023-12-26 10:41:22,021][123090] Updated weights for policy 1, policy_version 1380082 (0.0009) [2023-12-26 10:41:22,089][123090] Updated weights for policy 1, policy_version 1380092 (0.0006) [2023-12-26 10:41:22,647][123091] Updated weights for policy 0, policy_version 1389592 (0.0009) [2023-12-26 10:41:22,708][123091] Updated weights for policy 0, policy_version 1389602 (0.0009) [2023-12-26 10:41:22,759][123091] Updated weights for policy 0, policy_version 1389612 (0.0009) [2023-12-26 10:41:22,831][123090] Updated weights for policy 1, policy_version 1380102 (0.0009) [2023-12-26 10:41:22,894][123090] Updated weights for policy 1, policy_version 1380112 (0.0010) [2023-12-26 10:41:22,957][123090] Updated weights for policy 1, policy_version 1380122 (0.0010) [2023-12-26 10:41:23,532][123091] Updated weights for policy 0, policy_version 1389622 (0.0010) [2023-12-26 10:41:23,597][123091] Updated weights for policy 0, policy_version 1389632 (0.0011) [2023-12-26 10:41:23,653][123091] Updated weights for policy 0, policy_version 1389642 (0.0011) [2023-12-26 10:41:23,661][123090] Updated weights for policy 1, policy_version 1380132 (0.0008) [2023-12-26 10:41:23,729][123090] Updated weights for policy 1, policy_version 1380142 (0.0008) [2023-12-26 10:41:23,784][123090] Updated weights for policy 1, policy_version 1380152 (0.0010) [2023-12-26 10:41:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 709066752. Throughput: 0: 8643.6, 1: 8744.6. Samples: 709043208. Policy #0 lag: (min: 17.0, avg: 34.3, max: 49.0) [2023-12-26 10:41:23,785][121949] Avg episode reward: [(0, '6239.087'), (1, '5859.841')] [2023-12-26 10:41:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001389648_355753984.pth... [2023-12-26 10:41:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001388624_355491840.pth [2023-12-26 10:41:23,819][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001380160_353320960.pth... [2023-12-26 10:41:23,823][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001379104_353050624.pth [2023-12-26 10:41:24,442][123091] Updated weights for policy 0, policy_version 1389652 (0.0009) [2023-12-26 10:41:24,501][123091] Updated weights for policy 0, policy_version 1389662 (0.0005) [2023-12-26 10:41:24,551][123091] Updated weights for policy 0, policy_version 1389672 (0.0005) [2023-12-26 10:41:24,578][123090] Updated weights for policy 1, policy_version 1380162 (0.0010) [2023-12-26 10:41:24,635][123090] Updated weights for policy 1, policy_version 1380172 (0.0010) [2023-12-26 10:41:24,686][123090] Updated weights for policy 1, policy_version 1380182 (0.0010) [2023-12-26 10:41:24,736][123090] Updated weights for policy 1, policy_version 1380192 (0.0010) [2023-12-26 10:41:25,269][123091] Updated weights for policy 0, policy_version 1389682 (0.0006) [2023-12-26 10:41:25,321][123091] Updated weights for policy 0, policy_version 1389692 (0.0009) [2023-12-26 10:41:25,372][123091] Updated weights for policy 0, policy_version 1389702 (0.0009) [2023-12-26 10:41:25,424][123091] Updated weights for policy 0, policy_version 1389712 (0.0009) [2023-12-26 10:41:25,576][123090] Updated weights for policy 1, policy_version 1380202 (0.0006) [2023-12-26 10:41:25,628][123090] Updated weights for policy 1, policy_version 1380212 (0.0005) [2023-12-26 10:41:25,675][123090] Updated weights for policy 1, policy_version 1380222 (0.0005) [2023-12-26 10:41:26,160][123091] Updated weights for policy 0, policy_version 1389722 (0.0005) [2023-12-26 10:41:26,207][123091] Updated weights for policy 0, policy_version 1389732 (0.0005) [2023-12-26 10:41:26,254][123091] Updated weights for policy 0, policy_version 1389742 (0.0005) [2023-12-26 10:41:26,344][123090] Updated weights for policy 1, policy_version 1380232 (0.0005) [2023-12-26 10:41:26,394][123090] Updated weights for policy 1, policy_version 1380242 (0.0005) [2023-12-26 10:41:26,443][123090] Updated weights for policy 1, policy_version 1380252 (0.0005) [2023-12-26 10:41:26,915][123091] Updated weights for policy 0, policy_version 1389752 (0.0005) [2023-12-26 10:41:26,963][123091] Updated weights for policy 0, policy_version 1389762 (0.0005) [2023-12-26 10:41:27,017][123091] Updated weights for policy 0, policy_version 1389772 (0.0005) [2023-12-26 10:41:27,127][123090] Updated weights for policy 1, policy_version 1380262 (0.0006) [2023-12-26 10:41:27,177][123090] Updated weights for policy 1, policy_version 1380272 (0.0005) [2023-12-26 10:41:27,229][123090] Updated weights for policy 1, policy_version 1380282 (0.0006) [2023-12-26 10:41:27,684][123091] Updated weights for policy 0, policy_version 1389782 (0.0005) [2023-12-26 10:41:27,749][123091] Updated weights for policy 0, policy_version 1389792 (0.0006) [2023-12-26 10:41:27,798][123091] Updated weights for policy 0, policy_version 1389802 (0.0005) [2023-12-26 10:41:28,036][123090] Updated weights for policy 1, policy_version 1380292 (0.0007) [2023-12-26 10:41:28,083][123090] Updated weights for policy 1, policy_version 1380302 (0.0010) [2023-12-26 10:41:28,145][123090] Updated weights for policy 1, policy_version 1380312 (0.0010) [2023-12-26 10:41:28,396][123091] Updated weights for policy 0, policy_version 1389812 (0.0007) [2023-12-26 10:41:28,463][123091] Updated weights for policy 0, policy_version 1389822 (0.0006) [2023-12-26 10:41:28,534][123091] Updated weights for policy 0, policy_version 1389832 (0.0005) [2023-12-26 10:41:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 709165056. Throughput: 0: 8769.3, 1: 8896.3. Samples: 709156624. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:28,785][121949] Avg episode reward: [(0, '6266.014'), (1, '5909.199')] [2023-12-26 10:41:28,966][123090] Updated weights for policy 1, policy_version 1380322 (0.0009) [2023-12-26 10:41:29,043][123090] Updated weights for policy 1, policy_version 1380332 (0.0006) [2023-12-26 10:41:29,102][123090] Updated weights for policy 1, policy_version 1380342 (0.0010) [2023-12-26 10:41:29,164][123090] Updated weights for policy 1, policy_version 1380352 (0.0010) [2023-12-26 10:41:29,184][123091] Updated weights for policy 0, policy_version 1389842 (0.0005) [2023-12-26 10:41:29,253][123091] Updated weights for policy 0, policy_version 1389852 (0.0007) [2023-12-26 10:41:29,323][123091] Updated weights for policy 0, policy_version 1389862 (0.0006) [2023-12-26 10:41:29,383][123091] Updated weights for policy 0, policy_version 1389872 (0.0008) [2023-12-26 10:41:29,981][123090] Updated weights for policy 1, policy_version 1380362 (0.0010) [2023-12-26 10:41:30,033][123090] Updated weights for policy 1, policy_version 1380372 (0.0010) [2023-12-26 10:41:30,081][123090] Updated weights for policy 1, policy_version 1380382 (0.0010) [2023-12-26 10:41:30,084][123091] Updated weights for policy 0, policy_version 1389882 (0.0007) [2023-12-26 10:41:30,135][123091] Updated weights for policy 0, policy_version 1389892 (0.0008) [2023-12-26 10:41:30,189][123091] Updated weights for policy 0, policy_version 1389902 (0.0009) [2023-12-26 10:41:30,891][123090] Updated weights for policy 1, policy_version 1380392 (0.0006) [2023-12-26 10:41:30,938][123090] Updated weights for policy 1, policy_version 1380402 (0.0005) [2023-12-26 10:41:30,985][123090] Updated weights for policy 1, policy_version 1380412 (0.0005) [2023-12-26 10:41:31,024][123091] Updated weights for policy 0, policy_version 1389912 (0.0006) [2023-12-26 10:41:31,091][123091] Updated weights for policy 0, policy_version 1389922 (0.0007) [2023-12-26 10:41:31,155][123091] Updated weights for policy 0, policy_version 1389932 (0.0008) [2023-12-26 10:41:31,739][123090] Updated weights for policy 1, policy_version 1380422 (0.0006) [2023-12-26 10:41:31,778][123091] Updated weights for policy 0, policy_version 1389942 (0.0007) [2023-12-26 10:41:31,797][123090] Updated weights for policy 1, policy_version 1380432 (0.0006) [2023-12-26 10:41:31,826][123091] Updated weights for policy 0, policy_version 1389952 (0.0009) [2023-12-26 10:41:31,870][123090] Updated weights for policy 1, policy_version 1380442 (0.0006) [2023-12-26 10:41:31,884][123091] Updated weights for policy 0, policy_version 1389962 (0.0009) [2023-12-26 10:41:32,622][123090] Updated weights for policy 1, policy_version 1380452 (0.0007) [2023-12-26 10:41:32,681][123090] Updated weights for policy 1, policy_version 1380462 (0.0006) [2023-12-26 10:41:32,739][123090] Updated weights for policy 1, policy_version 1380472 (0.0005) [2023-12-26 10:41:32,749][123091] Updated weights for policy 0, policy_version 1389972 (0.0008) [2023-12-26 10:41:32,800][123091] Updated weights for policy 0, policy_version 1389982 (0.0006) [2023-12-26 10:41:32,857][123091] Updated weights for policy 0, policy_version 1389992 (0.0010) [2023-12-26 10:41:33,334][123090] Updated weights for policy 1, policy_version 1380482 (0.0005) [2023-12-26 10:41:33,396][123090] Updated weights for policy 1, policy_version 1380492 (0.0005) [2023-12-26 10:41:33,464][123090] Updated weights for policy 1, policy_version 1380502 (0.0005) [2023-12-26 10:41:33,534][123090] Updated weights for policy 1, policy_version 1380512 (0.0005) [2023-12-26 10:41:33,637][123091] Updated weights for policy 0, policy_version 1390003 (0.0009) [2023-12-26 10:41:33,690][123091] Updated weights for policy 0, policy_version 1390013 (0.0005) [2023-12-26 10:41:33,749][123091] Updated weights for policy 0, policy_version 1390023 (0.0009) [2023-12-26 10:41:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 709255168. Throughput: 0: 8870.1, 1: 8987.9. Samples: 709269432. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:33,785][121949] Avg episode reward: [(0, '6315.245'), (1, '5916.409')] [2023-12-26 10:41:34,178][123090] Updated weights for policy 1, policy_version 1380522 (0.0007) [2023-12-26 10:41:34,244][123090] Updated weights for policy 1, policy_version 1380532 (0.0007) [2023-12-26 10:41:34,296][123090] Updated weights for policy 1, policy_version 1380542 (0.0005) [2023-12-26 10:41:34,552][123091] Updated weights for policy 0, policy_version 1390033 (0.0010) [2023-12-26 10:41:34,608][123091] Updated weights for policy 0, policy_version 1390043 (0.0011) [2023-12-26 10:41:34,674][123091] Updated weights for policy 0, policy_version 1390053 (0.0011) [2023-12-26 10:41:34,733][123091] Updated weights for policy 0, policy_version 1390063 (0.0011) [2023-12-26 10:41:35,018][123090] Updated weights for policy 1, policy_version 1380552 (0.0006) [2023-12-26 10:41:35,083][123090] Updated weights for policy 1, policy_version 1380562 (0.0005) [2023-12-26 10:41:35,133][123090] Updated weights for policy 1, policy_version 1380572 (0.0006) [2023-12-26 10:41:35,523][123091] Updated weights for policy 0, policy_version 1390073 (0.0010) [2023-12-26 10:41:35,570][123091] Updated weights for policy 0, policy_version 1390083 (0.0010) [2023-12-26 10:41:35,630][123091] Updated weights for policy 0, policy_version 1390093 (0.0010) [2023-12-26 10:41:35,875][123090] Updated weights for policy 1, policy_version 1380582 (0.0009) [2023-12-26 10:41:35,938][123090] Updated weights for policy 1, policy_version 1380592 (0.0005) [2023-12-26 10:41:36,007][123090] Updated weights for policy 1, policy_version 1380602 (0.0007) [2023-12-26 10:41:36,343][123091] Updated weights for policy 0, policy_version 1390103 (0.0006) [2023-12-26 10:41:36,405][123091] Updated weights for policy 0, policy_version 1390113 (0.0010) [2023-12-26 10:41:36,461][123091] Updated weights for policy 0, policy_version 1390123 (0.0010) [2023-12-26 10:41:36,723][123090] Updated weights for policy 1, policy_version 1380612 (0.0008) [2023-12-26 10:41:36,782][123090] Updated weights for policy 1, policy_version 1380622 (0.0010) [2023-12-26 10:41:36,845][123090] Updated weights for policy 1, policy_version 1380632 (0.0008) [2023-12-26 10:41:37,322][123091] Updated weights for policy 0, policy_version 1390133 (0.0010) [2023-12-26 10:41:37,380][123091] Updated weights for policy 0, policy_version 1390143 (0.0010) [2023-12-26 10:41:37,431][123091] Updated weights for policy 0, policy_version 1390153 (0.0010) [2023-12-26 10:41:37,577][123090] Updated weights for policy 1, policy_version 1380642 (0.0006) [2023-12-26 10:41:37,645][123090] Updated weights for policy 1, policy_version 1380652 (0.0007) [2023-12-26 10:41:37,710][123090] Updated weights for policy 1, policy_version 1380662 (0.0007) [2023-12-26 10:41:37,771][123090] Updated weights for policy 1, policy_version 1380672 (0.0010) [2023-12-26 10:41:38,285][123091] Updated weights for policy 0, policy_version 1390163 (0.0011) [2023-12-26 10:41:38,351][123091] Updated weights for policy 0, policy_version 1390173 (0.0010) [2023-12-26 10:41:38,417][123091] Updated weights for policy 0, policy_version 1390183 (0.0011) [2023-12-26 10:41:38,575][123090] Updated weights for policy 1, policy_version 1380682 (0.0010) [2023-12-26 10:41:38,625][123090] Updated weights for policy 1, policy_version 1380692 (0.0009) [2023-12-26 10:41:38,680][123090] Updated weights for policy 1, policy_version 1380702 (0.0009) [2023-12-26 10:41:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 709353472. Throughput: 0: 8908.2, 1: 9046.3. Samples: 709325836. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:38,784][121949] Avg episode reward: [(0, '6429.076'), (1, '5877.218')] [2023-12-26 10:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001390192_355893248.pth... [2023-12-26 10:41:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001380704_353460224.pth... [2023-12-26 10:41:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001389136_355622912.pth [2023-12-26 10:41:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001379648_353189888.pth [2023-12-26 10:41:39,084][123091] Updated weights for policy 0, policy_version 1390193 (0.0010) [2023-12-26 10:41:39,159][123091] Updated weights for policy 0, policy_version 1390203 (0.0006) [2023-12-26 10:41:39,226][123091] Updated weights for policy 0, policy_version 1390213 (0.0007) [2023-12-26 10:41:39,301][123091] Updated weights for policy 0, policy_version 1390223 (0.0008) [2023-12-26 10:41:39,429][123090] Updated weights for policy 1, policy_version 1380712 (0.0009) [2023-12-26 10:41:39,502][123090] Updated weights for policy 1, policy_version 1380722 (0.0010) [2023-12-26 10:41:39,572][123090] Updated weights for policy 1, policy_version 1380732 (0.0011) [2023-12-26 10:41:40,138][123091] Updated weights for policy 0, policy_version 1390233 (0.0008) [2023-12-26 10:41:40,206][123091] Updated weights for policy 0, policy_version 1390243 (0.0011) [2023-12-26 10:41:40,259][123091] Updated weights for policy 0, policy_version 1390253 (0.0011) [2023-12-26 10:41:40,400][123090] Updated weights for policy 1, policy_version 1380742 (0.0009) [2023-12-26 10:41:40,458][123090] Updated weights for policy 1, policy_version 1380752 (0.0009) [2023-12-26 10:41:40,510][123090] Updated weights for policy 1, policy_version 1380762 (0.0008) [2023-12-26 10:41:41,084][123091] Updated weights for policy 0, policy_version 1390263 (0.0011) [2023-12-26 10:41:41,149][123091] Updated weights for policy 0, policy_version 1390273 (0.0012) [2023-12-26 10:41:41,205][123091] Updated weights for policy 0, policy_version 1390283 (0.0011) [2023-12-26 10:41:41,377][123090] Updated weights for policy 1, policy_version 1380772 (0.0008) [2023-12-26 10:41:41,453][123090] Updated weights for policy 1, policy_version 1380782 (0.0007) [2023-12-26 10:41:41,525][123090] Updated weights for policy 1, policy_version 1380792 (0.0009) [2023-12-26 10:41:42,124][123091] Updated weights for policy 0, policy_version 1390293 (0.0010) [2023-12-26 10:41:42,189][123091] Updated weights for policy 0, policy_version 1390303 (0.0011) [2023-12-26 10:41:42,253][123091] Updated weights for policy 0, policy_version 1390313 (0.0011) [2023-12-26 10:41:42,346][123090] Updated weights for policy 1, policy_version 1380802 (0.0009) [2023-12-26 10:41:42,417][123090] Updated weights for policy 1, policy_version 1380812 (0.0009) [2023-12-26 10:41:42,483][123090] Updated weights for policy 1, policy_version 1380822 (0.0009) [2023-12-26 10:41:42,539][123090] Updated weights for policy 1, policy_version 1380832 (0.0008) [2023-12-26 10:41:43,122][123091] Updated weights for policy 0, policy_version 1390323 (0.0011) [2023-12-26 10:41:43,173][123091] Updated weights for policy 0, policy_version 1390333 (0.0010) [2023-12-26 10:41:43,229][123091] Updated weights for policy 0, policy_version 1390343 (0.0010) [2023-12-26 10:41:43,406][123090] Updated weights for policy 1, policy_version 1380842 (0.0010) [2023-12-26 10:41:43,469][123090] Updated weights for policy 1, policy_version 1380852 (0.0010) [2023-12-26 10:41:43,533][123090] Updated weights for policy 1, policy_version 1380862 (0.0010) [2023-12-26 10:41:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 709435392. Throughput: 0: 8846.5, 1: 8994.5. Samples: 709428908. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:43,785][121949] Avg episode reward: [(0, '6390.830'), (1, '5774.033')] [2023-12-26 10:41:43,862][123091] Updated weights for policy 0, policy_version 1390353 (0.0010) [2023-12-26 10:41:43,920][123091] Updated weights for policy 0, policy_version 1390363 (0.0009) [2023-12-26 10:41:43,968][123091] Updated weights for policy 0, policy_version 1390373 (0.0010) [2023-12-26 10:41:44,016][123091] Updated weights for policy 0, policy_version 1390383 (0.0010) [2023-12-26 10:41:44,272][123090] Updated weights for policy 1, policy_version 1380872 (0.0008) [2023-12-26 10:41:44,336][123090] Updated weights for policy 1, policy_version 1380882 (0.0010) [2023-12-26 10:41:44,401][123090] Updated weights for policy 1, policy_version 1380892 (0.0010) [2023-12-26 10:41:44,870][123091] Updated weights for policy 0, policy_version 1390393 (0.0010) [2023-12-26 10:41:44,944][123091] Updated weights for policy 0, policy_version 1390403 (0.0010) [2023-12-26 10:41:45,008][123091] Updated weights for policy 0, policy_version 1390413 (0.0011) [2023-12-26 10:41:45,139][123090] Updated weights for policy 1, policy_version 1380902 (0.0008) [2023-12-26 10:41:45,208][123090] Updated weights for policy 1, policy_version 1380912 (0.0008) [2023-12-26 10:41:45,274][123090] Updated weights for policy 1, policy_version 1380922 (0.0009) [2023-12-26 10:41:45,814][123091] Updated weights for policy 0, policy_version 1390423 (0.0010) [2023-12-26 10:41:45,865][123091] Updated weights for policy 0, policy_version 1390433 (0.0010) [2023-12-26 10:41:45,917][123091] Updated weights for policy 0, policy_version 1390443 (0.0010) [2023-12-26 10:41:45,993][123090] Updated weights for policy 1, policy_version 1380932 (0.0007) [2023-12-26 10:41:46,041][123090] Updated weights for policy 1, policy_version 1380942 (0.0005) [2023-12-26 10:41:46,088][123090] Updated weights for policy 1, policy_version 1380952 (0.0005) [2023-12-26 10:41:46,760][123091] Updated weights for policy 0, policy_version 1390453 (0.0010) [2023-12-26 10:41:46,799][123090] Updated weights for policy 1, policy_version 1380962 (0.0005) [2023-12-26 10:41:46,831][123091] Updated weights for policy 0, policy_version 1390463 (0.0011) [2023-12-26 10:41:46,855][123090] Updated weights for policy 1, policy_version 1380972 (0.0011) [2023-12-26 10:41:46,893][123091] Updated weights for policy 0, policy_version 1390473 (0.0010) [2023-12-26 10:41:46,911][123090] Updated weights for policy 1, policy_version 1380982 (0.0010) [2023-12-26 10:41:46,966][123090] Updated weights for policy 1, policy_version 1380992 (0.0010) [2023-12-26 10:41:47,617][123091] Updated weights for policy 0, policy_version 1390483 (0.0009) [2023-12-26 10:41:47,674][123091] Updated weights for policy 0, policy_version 1390493 (0.0006) [2023-12-26 10:41:47,728][123091] Updated weights for policy 0, policy_version 1390503 (0.0008) [2023-12-26 10:41:47,822][123090] Updated weights for policy 1, policy_version 1381002 (0.0011) [2023-12-26 10:41:47,885][123090] Updated weights for policy 1, policy_version 1381012 (0.0010) [2023-12-26 10:41:47,938][123090] Updated weights for policy 1, policy_version 1381022 (0.0009) [2023-12-26 10:41:48,405][123091] Updated weights for policy 0, policy_version 1390513 (0.0010) [2023-12-26 10:41:48,470][123091] Updated weights for policy 0, policy_version 1390523 (0.0009) [2023-12-26 10:41:48,525][123091] Updated weights for policy 0, policy_version 1390533 (0.0010) [2023-12-26 10:41:48,577][123091] Updated weights for policy 0, policy_version 1390543 (0.0009) [2023-12-26 10:41:48,729][123090] Updated weights for policy 1, policy_version 1381032 (0.0009) [2023-12-26 10:41:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 709525504. Throughput: 0: 8886.0, 1: 8999.3. Samples: 709537856. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:48,784][121949] Avg episode reward: [(0, '6342.705'), (1, '5687.676')] [2023-12-26 10:41:48,797][123090] Updated weights for policy 1, policy_version 1381042 (0.0010) [2023-12-26 10:41:48,864][123090] Updated weights for policy 1, policy_version 1381052 (0.0009) [2023-12-26 10:41:49,456][123091] Updated weights for policy 0, policy_version 1390553 (0.0009) [2023-12-26 10:41:49,514][123091] Updated weights for policy 0, policy_version 1390563 (0.0009) [2023-12-26 10:41:49,574][123091] Updated weights for policy 0, policy_version 1390573 (0.0009) [2023-12-26 10:41:49,661][123090] Updated weights for policy 1, policy_version 1381062 (0.0010) [2023-12-26 10:41:49,716][123090] Updated weights for policy 1, policy_version 1381072 (0.0009) [2023-12-26 10:41:49,769][123090] Updated weights for policy 1, policy_version 1381082 (0.0010) [2023-12-26 10:41:50,366][123091] Updated weights for policy 0, policy_version 1390583 (0.0009) [2023-12-26 10:41:50,424][123091] Updated weights for policy 0, policy_version 1390593 (0.0009) [2023-12-26 10:41:50,490][123091] Updated weights for policy 0, policy_version 1390603 (0.0010) [2023-12-26 10:41:50,534][123090] Updated weights for policy 1, policy_version 1381092 (0.0009) [2023-12-26 10:41:50,601][123090] Updated weights for policy 1, policy_version 1381102 (0.0009) [2023-12-26 10:41:50,661][123090] Updated weights for policy 1, policy_version 1381112 (0.0010) [2023-12-26 10:41:51,342][123091] Updated weights for policy 0, policy_version 1390613 (0.0010) [2023-12-26 10:41:51,409][123091] Updated weights for policy 0, policy_version 1390623 (0.0009) [2023-12-26 10:41:51,469][123091] Updated weights for policy 0, policy_version 1390633 (0.0009) [2023-12-26 10:41:51,530][123090] Updated weights for policy 1, policy_version 1381122 (0.0009) [2023-12-26 10:41:51,589][123090] Updated weights for policy 1, policy_version 1381132 (0.0009) [2023-12-26 10:41:51,664][123090] Updated weights for policy 1, policy_version 1381142 (0.0008) [2023-12-26 10:41:51,721][123090] Updated weights for policy 1, policy_version 1381152 (0.0009) [2023-12-26 10:41:52,306][123091] Updated weights for policy 0, policy_version 1390643 (0.0009) [2023-12-26 10:41:52,375][123091] Updated weights for policy 0, policy_version 1390653 (0.0008) [2023-12-26 10:41:52,432][123091] Updated weights for policy 0, policy_version 1390663 (0.0008) [2023-12-26 10:41:52,590][123090] Updated weights for policy 1, policy_version 1381162 (0.0009) [2023-12-26 10:41:52,657][123090] Updated weights for policy 1, policy_version 1381172 (0.0010) [2023-12-26 10:41:52,727][123090] Updated weights for policy 1, policy_version 1381182 (0.0010) [2023-12-26 10:41:53,181][123091] Updated weights for policy 0, policy_version 1390673 (0.0008) [2023-12-26 10:41:53,243][123091] Updated weights for policy 0, policy_version 1390683 (0.0005) [2023-12-26 10:41:53,313][123091] Updated weights for policy 0, policy_version 1390693 (0.0005) [2023-12-26 10:41:53,384][123091] Updated weights for policy 0, policy_version 1390703 (0.0005) [2023-12-26 10:41:53,604][123090] Updated weights for policy 1, policy_version 1381192 (0.0009) [2023-12-26 10:41:53,673][123090] Updated weights for policy 1, policy_version 1381202 (0.0010) [2023-12-26 10:41:53,735][123090] Updated weights for policy 1, policy_version 1381212 (0.0009) [2023-12-26 10:41:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 709615616. Throughput: 0: 8905.1, 1: 8949.2. Samples: 709588612. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:53,785][121949] Avg episode reward: [(0, '6361.424'), (1, '5762.596')] [2023-12-26 10:41:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001381216_353591296.pth... [2023-12-26 10:41:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001390704_356024320.pth... [2023-12-26 10:41:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001380160_353320960.pth [2023-12-26 10:41:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001389648_355753984.pth [2023-12-26 10:41:54,030][123091] Updated weights for policy 0, policy_version 1390713 (0.0005) [2023-12-26 10:41:54,083][123091] Updated weights for policy 0, policy_version 1390723 (0.0005) [2023-12-26 10:41:54,145][123091] Updated weights for policy 0, policy_version 1390733 (0.0005) [2023-12-26 10:41:54,534][123090] Updated weights for policy 1, policy_version 1381222 (0.0008) [2023-12-26 10:41:54,603][123090] Updated weights for policy 1, policy_version 1381232 (0.0005) [2023-12-26 10:41:54,667][123090] Updated weights for policy 1, policy_version 1381242 (0.0005) [2023-12-26 10:41:54,806][123091] Updated weights for policy 0, policy_version 1390743 (0.0005) [2023-12-26 10:41:54,864][123091] Updated weights for policy 0, policy_version 1390753 (0.0005) [2023-12-26 10:41:54,911][123091] Updated weights for policy 0, policy_version 1390763 (0.0005) [2023-12-26 10:41:55,367][123090] Updated weights for policy 1, policy_version 1381252 (0.0005) [2023-12-26 10:41:55,425][123090] Updated weights for policy 1, policy_version 1381262 (0.0005) [2023-12-26 10:41:55,483][123090] Updated weights for policy 1, policy_version 1381272 (0.0005) [2023-12-26 10:41:55,596][123091] Updated weights for policy 0, policy_version 1390773 (0.0006) [2023-12-26 10:41:55,641][123091] Updated weights for policy 0, policy_version 1390783 (0.0010) [2023-12-26 10:41:55,696][123091] Updated weights for policy 0, policy_version 1390793 (0.0010) [2023-12-26 10:41:56,177][123090] Updated weights for policy 1, policy_version 1381282 (0.0006) [2023-12-26 10:41:56,241][123090] Updated weights for policy 1, policy_version 1381292 (0.0005) [2023-12-26 10:41:56,298][123090] Updated weights for policy 1, policy_version 1381302 (0.0005) [2023-12-26 10:41:56,349][123090] Updated weights for policy 1, policy_version 1381312 (0.0005) [2023-12-26 10:41:56,363][123091] Updated weights for policy 0, policy_version 1390803 (0.0009) [2023-12-26 10:41:56,424][123091] Updated weights for policy 0, policy_version 1390813 (0.0005) [2023-12-26 10:41:56,483][123091] Updated weights for policy 0, policy_version 1390823 (0.0005) [2023-12-26 10:41:56,899][123090] Updated weights for policy 1, policy_version 1381322 (0.0005) [2023-12-26 10:41:56,969][123090] Updated weights for policy 1, policy_version 1381332 (0.0005) [2023-12-26 10:41:57,042][123090] Updated weights for policy 1, policy_version 1381342 (0.0005) [2023-12-26 10:41:57,060][123091] Updated weights for policy 0, policy_version 1390833 (0.0006) [2023-12-26 10:41:57,129][123091] Updated weights for policy 0, policy_version 1390843 (0.0008) [2023-12-26 10:41:57,179][123091] Updated weights for policy 0, policy_version 1390853 (0.0008) [2023-12-26 10:41:57,235][123091] Updated weights for policy 0, policy_version 1390863 (0.0009) [2023-12-26 10:41:57,783][123090] Updated weights for policy 1, policy_version 1381352 (0.0008) [2023-12-26 10:41:57,850][123090] Updated weights for policy 1, policy_version 1381362 (0.0009) [2023-12-26 10:41:57,910][123090] Updated weights for policy 1, policy_version 1381372 (0.0009) [2023-12-26 10:41:57,930][123091] Updated weights for policy 0, policy_version 1390873 (0.0010) [2023-12-26 10:41:57,984][123091] Updated weights for policy 0, policy_version 1390883 (0.0010) [2023-12-26 10:41:58,047][123091] Updated weights for policy 0, policy_version 1390893 (0.0010) [2023-12-26 10:41:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 709705728. Throughput: 0: 9073.0, 1: 9017.3. Samples: 709704328. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:41:58,785][121949] Avg episode reward: [(0, '6246.275'), (1, '5872.683')] [2023-12-26 10:41:58,790][123090] Updated weights for policy 1, policy_version 1381382 (0.0007) [2023-12-26 10:41:58,861][123090] Updated weights for policy 1, policy_version 1381392 (0.0009) [2023-12-26 10:41:58,925][123091] Updated weights for policy 0, policy_version 1390903 (0.0009) [2023-12-26 10:41:58,928][123090] Updated weights for policy 1, policy_version 1381402 (0.0008) [2023-12-26 10:41:58,989][123091] Updated weights for policy 0, policy_version 1390913 (0.0009) [2023-12-26 10:41:59,038][123091] Updated weights for policy 0, policy_version 1390923 (0.0007) [2023-12-26 10:41:59,609][123090] Updated weights for policy 1, policy_version 1381412 (0.0008) [2023-12-26 10:41:59,668][123090] Updated weights for policy 1, policy_version 1381422 (0.0009) [2023-12-26 10:41:59,736][123090] Updated weights for policy 1, policy_version 1381432 (0.0009) [2023-12-26 10:41:59,839][123091] Updated weights for policy 0, policy_version 1390933 (0.0011) [2023-12-26 10:41:59,902][123091] Updated weights for policy 0, policy_version 1390943 (0.0011) [2023-12-26 10:41:59,962][123091] Updated weights for policy 0, policy_version 1390953 (0.0011) [2023-12-26 10:42:00,663][123091] Updated weights for policy 0, policy_version 1390963 (0.0009) [2023-12-26 10:42:00,664][123090] Updated weights for policy 1, policy_version 1381442 (0.0009) [2023-12-26 10:42:00,714][123091] Updated weights for policy 0, policy_version 1390973 (0.0005) [2023-12-26 10:42:00,731][123090] Updated weights for policy 1, policy_version 1381452 (0.0008) [2023-12-26 10:42:00,776][123091] Updated weights for policy 0, policy_version 1390983 (0.0008) [2023-12-26 10:42:00,792][123090] Updated weights for policy 1, policy_version 1381462 (0.0007) [2023-12-26 10:42:00,849][123090] Updated weights for policy 1, policy_version 1381472 (0.0008) [2023-12-26 10:42:01,566][123091] Updated weights for policy 0, policy_version 1390993 (0.0009) [2023-12-26 10:42:01,630][123091] Updated weights for policy 0, policy_version 1391003 (0.0007) [2023-12-26 10:42:01,659][123090] Updated weights for policy 1, policy_version 1381482 (0.0008) [2023-12-26 10:42:01,699][123091] Updated weights for policy 0, policy_version 1391013 (0.0009) [2023-12-26 10:42:01,722][123090] Updated weights for policy 1, policy_version 1381492 (0.0008) [2023-12-26 10:42:01,759][123091] Updated weights for policy 0, policy_version 1391023 (0.0008) [2023-12-26 10:42:01,788][123090] Updated weights for policy 1, policy_version 1381502 (0.0008) [2023-12-26 10:42:02,489][123091] Updated weights for policy 0, policy_version 1391033 (0.0009) [2023-12-26 10:42:02,540][123091] Updated weights for policy 0, policy_version 1391043 (0.0010) [2023-12-26 10:42:02,593][123091] Updated weights for policy 0, policy_version 1391053 (0.0010) [2023-12-26 10:42:02,635][123090] Updated weights for policy 1, policy_version 1381512 (0.0009) [2023-12-26 10:42:02,700][123090] Updated weights for policy 1, policy_version 1381522 (0.0009) [2023-12-26 10:42:02,748][123090] Updated weights for policy 1, policy_version 1381532 (0.0009) [2023-12-26 10:42:03,379][123091] Updated weights for policy 0, policy_version 1391063 (0.0006) [2023-12-26 10:42:03,437][123091] Updated weights for policy 0, policy_version 1391073 (0.0005) [2023-12-26 10:42:03,501][123091] Updated weights for policy 0, policy_version 1391083 (0.0005) [2023-12-26 10:42:03,628][123090] Updated weights for policy 1, policy_version 1381542 (0.0010) [2023-12-26 10:42:03,693][123090] Updated weights for policy 1, policy_version 1381552 (0.0009) [2023-12-26 10:42:03,753][123090] Updated weights for policy 1, policy_version 1381562 (0.0009) [2023-12-26 10:42:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 709795840. Throughput: 0: 9185.8, 1: 8980.7. Samples: 709810432. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:03,785][121949] Avg episode reward: [(0, '6246.189'), (1, '5890.058')] [2023-12-26 10:42:04,233][123091] Updated weights for policy 0, policy_version 1391093 (0.0008) [2023-12-26 10:42:04,286][123091] Updated weights for policy 0, policy_version 1391103 (0.0009) [2023-12-26 10:42:04,346][123091] Updated weights for policy 0, policy_version 1391113 (0.0006) [2023-12-26 10:42:04,633][123090] Updated weights for policy 1, policy_version 1381572 (0.0009) [2023-12-26 10:42:04,694][123090] Updated weights for policy 1, policy_version 1381582 (0.0009) [2023-12-26 10:42:04,751][123090] Updated weights for policy 1, policy_version 1381592 (0.0008) [2023-12-26 10:42:05,082][123091] Updated weights for policy 0, policy_version 1391123 (0.0007) [2023-12-26 10:42:05,140][123091] Updated weights for policy 0, policy_version 1391133 (0.0009) [2023-12-26 10:42:05,194][123091] Updated weights for policy 0, policy_version 1391143 (0.0009) [2023-12-26 10:42:05,583][123090] Updated weights for policy 1, policy_version 1381602 (0.0009) [2023-12-26 10:42:05,639][123090] Updated weights for policy 1, policy_version 1381612 (0.0009) [2023-12-26 10:42:05,692][123090] Updated weights for policy 1, policy_version 1381622 (0.0009) [2023-12-26 10:42:05,754][123090] Updated weights for policy 1, policy_version 1381632 (0.0008) [2023-12-26 10:42:06,027][123091] Updated weights for policy 0, policy_version 1391153 (0.0009) [2023-12-26 10:42:06,077][123091] Updated weights for policy 0, policy_version 1391163 (0.0009) [2023-12-26 10:42:06,139][123091] Updated weights for policy 0, policy_version 1391173 (0.0010) [2023-12-26 10:42:06,204][123091] Updated weights for policy 0, policy_version 1391183 (0.0009) [2023-12-26 10:42:06,622][123090] Updated weights for policy 1, policy_version 1381642 (0.0008) [2023-12-26 10:42:06,682][123090] Updated weights for policy 1, policy_version 1381652 (0.0007) [2023-12-26 10:42:06,737][123090] Updated weights for policy 1, policy_version 1381662 (0.0007) [2023-12-26 10:42:07,013][123091] Updated weights for policy 0, policy_version 1391193 (0.0007) [2023-12-26 10:42:07,062][123091] Updated weights for policy 0, policy_version 1391203 (0.0005) [2023-12-26 10:42:07,107][123091] Updated weights for policy 0, policy_version 1391213 (0.0005) [2023-12-26 10:42:07,590][123090] Updated weights for policy 1, policy_version 1381672 (0.0009) [2023-12-26 10:42:07,642][123090] Updated weights for policy 1, policy_version 1381682 (0.0010) [2023-12-26 10:42:07,706][123090] Updated weights for policy 1, policy_version 1381692 (0.0010) [2023-12-26 10:42:07,899][123091] Updated weights for policy 0, policy_version 1391223 (0.0009) [2023-12-26 10:42:07,969][123091] Updated weights for policy 0, policy_version 1391233 (0.0010) [2023-12-26 10:42:08,031][123091] Updated weights for policy 0, policy_version 1391243 (0.0009) [2023-12-26 10:42:08,499][123090] Updated weights for policy 1, policy_version 1381702 (0.0010) [2023-12-26 10:42:08,552][123090] Updated weights for policy 1, policy_version 1381712 (0.0009) [2023-12-26 10:42:08,608][123090] Updated weights for policy 1, policy_version 1381722 (0.0010) [2023-12-26 10:42:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 709885952. Throughput: 0: 9227.3, 1: 8977.8. Samples: 709862436. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:08,785][121949] Avg episode reward: [(0, '6300.281'), (1, '5871.067')] [2023-12-26 10:42:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001381728_353722368.pth... [2023-12-26 10:42:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001380704_353460224.pth [2023-12-26 10:42:08,826][123091] Updated weights for policy 0, policy_version 1391253 (0.0008) [2023-12-26 10:42:08,883][123091] Updated weights for policy 0, policy_version 1391263 (0.0009) [2023-12-26 10:42:08,937][123091] Updated weights for policy 0, policy_version 1391273 (0.0009) [2023-12-26 10:42:08,977][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001391280_356171776.pth... [2023-12-26 10:42:08,980][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001390192_355893248.pth [2023-12-26 10:42:09,477][123090] Updated weights for policy 1, policy_version 1381732 (0.0009) [2023-12-26 10:42:09,538][123090] Updated weights for policy 1, policy_version 1381742 (0.0010) [2023-12-26 10:42:09,602][123090] Updated weights for policy 1, policy_version 1381752 (0.0010) [2023-12-26 10:42:09,796][123091] Updated weights for policy 0, policy_version 1391283 (0.0008) [2023-12-26 10:42:09,873][123091] Updated weights for policy 0, policy_version 1391293 (0.0008) [2023-12-26 10:42:09,948][123091] Updated weights for policy 0, policy_version 1391303 (0.0008) [2023-12-26 10:42:10,553][123090] Updated weights for policy 1, policy_version 1381762 (0.0009) [2023-12-26 10:42:10,617][123090] Updated weights for policy 1, policy_version 1381772 (0.0009) [2023-12-26 10:42:10,679][123090] Updated weights for policy 1, policy_version 1381782 (0.0010) [2023-12-26 10:42:10,680][123091] Updated weights for policy 0, policy_version 1391313 (0.0008) [2023-12-26 10:42:10,742][123090] Updated weights for policy 1, policy_version 1381792 (0.0010) [2023-12-26 10:42:10,744][123091] Updated weights for policy 0, policy_version 1391323 (0.0006) [2023-12-26 10:42:10,799][123091] Updated weights for policy 0, policy_version 1391333 (0.0009) [2023-12-26 10:42:10,859][123091] Updated weights for policy 0, policy_version 1391343 (0.0009) [2023-12-26 10:42:11,660][123090] Updated weights for policy 1, policy_version 1381802 (0.0008) [2023-12-26 10:42:11,715][123091] Updated weights for policy 0, policy_version 1391353 (0.0008) [2023-12-26 10:42:11,733][123090] Updated weights for policy 1, policy_version 1381812 (0.0010) [2023-12-26 10:42:11,782][123091] Updated weights for policy 0, policy_version 1391363 (0.0008) [2023-12-26 10:42:11,802][123090] Updated weights for policy 1, policy_version 1381822 (0.0006) [2023-12-26 10:42:11,845][123091] Updated weights for policy 0, policy_version 1391373 (0.0008) [2023-12-26 10:42:12,584][123091] Updated weights for policy 0, policy_version 1391384 (0.0010) [2023-12-26 10:42:12,632][123090] Updated weights for policy 1, policy_version 1381832 (0.0008) [2023-12-26 10:42:12,642][123091] Updated weights for policy 0, policy_version 1391394 (0.0009) [2023-12-26 10:42:12,697][123091] Updated weights for policy 0, policy_version 1391404 (0.0006) [2023-12-26 10:42:12,697][123090] Updated weights for policy 1, policy_version 1381842 (0.0009) [2023-12-26 10:42:12,763][123090] Updated weights for policy 1, policy_version 1381852 (0.0010) [2023-12-26 10:42:13,490][123091] Updated weights for policy 0, policy_version 1391414 (0.0009) [2023-12-26 10:42:13,540][123091] Updated weights for policy 0, policy_version 1391424 (0.0010) [2023-12-26 10:42:13,597][123091] Updated weights for policy 0, policy_version 1391434 (0.0008) [2023-12-26 10:42:13,616][123090] Updated weights for policy 1, policy_version 1381862 (0.0010) [2023-12-26 10:42:13,677][123090] Updated weights for policy 1, policy_version 1381872 (0.0009) [2023-12-26 10:42:13,734][123090] Updated weights for policy 1, policy_version 1381882 (0.0009) [2023-12-26 10:42:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 709976064. Throughput: 0: 9129.9, 1: 8810.2. Samples: 709963932. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:13,785][121949] Avg episode reward: [(0, '6277.836'), (1, '5813.195')] [2023-12-26 10:42:14,460][123091] Updated weights for policy 0, policy_version 1391444 (0.0007) [2023-12-26 10:42:14,523][123091] Updated weights for policy 0, policy_version 1391454 (0.0009) [2023-12-26 10:42:14,583][123090] Updated weights for policy 1, policy_version 1381892 (0.0007) [2023-12-26 10:42:14,587][123091] Updated weights for policy 0, policy_version 1391464 (0.0009) [2023-12-26 10:42:14,650][123090] Updated weights for policy 1, policy_version 1381902 (0.0007) [2023-12-26 10:42:14,727][123090] Updated weights for policy 1, policy_version 1381912 (0.0006) [2023-12-26 10:42:15,463][123091] Updated weights for policy 0, policy_version 1391474 (0.0010) [2023-12-26 10:42:15,488][123090] Updated weights for policy 1, policy_version 1381922 (0.0008) [2023-12-26 10:42:15,525][123091] Updated weights for policy 0, policy_version 1391484 (0.0009) [2023-12-26 10:42:15,553][123090] Updated weights for policy 1, policy_version 1381932 (0.0005) [2023-12-26 10:42:15,596][123091] Updated weights for policy 0, policy_version 1391494 (0.0009) [2023-12-26 10:42:15,616][123090] Updated weights for policy 1, policy_version 1381942 (0.0005) [2023-12-26 10:42:15,663][123091] Updated weights for policy 0, policy_version 1391504 (0.0009) [2023-12-26 10:42:15,663][123090] Updated weights for policy 1, policy_version 1381952 (0.0005) [2023-12-26 10:42:16,316][123090] Updated weights for policy 1, policy_version 1381962 (0.0005) [2023-12-26 10:42:16,375][123090] Updated weights for policy 1, policy_version 1381972 (0.0005) [2023-12-26 10:42:16,432][123090] Updated weights for policy 1, policy_version 1381982 (0.0005) [2023-12-26 10:42:16,543][123091] Updated weights for policy 0, policy_version 1391514 (0.0010) [2023-12-26 10:42:16,591][123091] Updated weights for policy 0, policy_version 1391524 (0.0005) [2023-12-26 10:42:16,649][123091] Updated weights for policy 0, policy_version 1391534 (0.0005) [2023-12-26 10:42:17,115][123090] Updated weights for policy 1, policy_version 1381992 (0.0005) [2023-12-26 10:42:17,180][123090] Updated weights for policy 1, policy_version 1382002 (0.0005) [2023-12-26 10:42:17,252][123090] Updated weights for policy 1, policy_version 1382012 (0.0005) [2023-12-26 10:42:17,386][123091] Updated weights for policy 0, policy_version 1391544 (0.0008) [2023-12-26 10:42:17,456][123091] Updated weights for policy 0, policy_version 1391554 (0.0009) [2023-12-26 10:42:17,515][123091] Updated weights for policy 0, policy_version 1391564 (0.0009) [2023-12-26 10:42:17,974][123090] Updated weights for policy 1, policy_version 1382022 (0.0005) [2023-12-26 10:42:18,029][123090] Updated weights for policy 1, policy_version 1382032 (0.0006) [2023-12-26 10:42:18,087][123090] Updated weights for policy 1, policy_version 1382042 (0.0009) [2023-12-26 10:42:18,195][123091] Updated weights for policy 0, policy_version 1391574 (0.0007) [2023-12-26 10:42:18,247][123091] Updated weights for policy 0, policy_version 1391584 (0.0005) [2023-12-26 10:42:18,307][123091] Updated weights for policy 0, policy_version 1391594 (0.0005) [2023-12-26 10:42:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 710057984. Throughput: 0: 9004.4, 1: 8821.0. Samples: 710071576. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:18,785][121949] Avg episode reward: [(0, '6335.080'), (1, '5871.365')] [2023-12-26 10:42:18,887][123090] Updated weights for policy 1, policy_version 1382052 (0.0010) [2023-12-26 10:42:18,950][123090] Updated weights for policy 1, policy_version 1382062 (0.0010) [2023-12-26 10:42:18,997][123090] Updated weights for policy 1, policy_version 1382072 (0.0010) [2023-12-26 10:42:19,106][123091] Updated weights for policy 0, policy_version 1391604 (0.0010) [2023-12-26 10:42:19,165][123091] Updated weights for policy 0, policy_version 1391614 (0.0011) [2023-12-26 10:42:19,229][123091] Updated weights for policy 0, policy_version 1391624 (0.0009) [2023-12-26 10:42:19,730][123090] Updated weights for policy 1, policy_version 1382082 (0.0010) [2023-12-26 10:42:19,778][123090] Updated weights for policy 1, policy_version 1382092 (0.0010) [2023-12-26 10:42:19,863][123090] Updated weights for policy 1, policy_version 1382102 (0.0010) [2023-12-26 10:42:19,933][123090] Updated weights for policy 1, policy_version 1382112 (0.0008) [2023-12-26 10:42:20,104][123091] Updated weights for policy 0, policy_version 1391634 (0.0009) [2023-12-26 10:42:20,168][123091] Updated weights for policy 0, policy_version 1391644 (0.0010) [2023-12-26 10:42:20,236][123091] Updated weights for policy 0, policy_version 1391654 (0.0009) [2023-12-26 10:42:20,299][123091] Updated weights for policy 0, policy_version 1391664 (0.0009) [2023-12-26 10:42:20,777][123090] Updated weights for policy 1, policy_version 1382122 (0.0011) [2023-12-26 10:42:20,841][123090] Updated weights for policy 1, policy_version 1382132 (0.0011) [2023-12-26 10:42:20,893][123090] Updated weights for policy 1, policy_version 1382142 (0.0010) [2023-12-26 10:42:21,164][123091] Updated weights for policy 0, policy_version 1391674 (0.0009) [2023-12-26 10:42:21,232][123091] Updated weights for policy 0, policy_version 1391684 (0.0009) [2023-12-26 10:42:21,292][123091] Updated weights for policy 0, policy_version 1391694 (0.0009) [2023-12-26 10:42:21,756][123090] Updated weights for policy 1, policy_version 1382152 (0.0009) [2023-12-26 10:42:21,804][123090] Updated weights for policy 1, policy_version 1382162 (0.0008) [2023-12-26 10:42:21,857][123090] Updated weights for policy 1, policy_version 1382172 (0.0008) [2023-12-26 10:42:22,142][123091] Updated weights for policy 0, policy_version 1391704 (0.0009) [2023-12-26 10:42:22,215][123091] Updated weights for policy 0, policy_version 1391714 (0.0009) [2023-12-26 10:42:22,290][123091] Updated weights for policy 0, policy_version 1391724 (0.0009) [2023-12-26 10:42:22,643][123090] Updated weights for policy 1, policy_version 1382182 (0.0008) [2023-12-26 10:42:22,710][123090] Updated weights for policy 1, policy_version 1382192 (0.0008) [2023-12-26 10:42:22,777][123090] Updated weights for policy 1, policy_version 1382202 (0.0009) [2023-12-26 10:42:23,113][123091] Updated weights for policy 0, policy_version 1391734 (0.0010) [2023-12-26 10:42:23,181][123091] Updated weights for policy 0, policy_version 1391744 (0.0010) [2023-12-26 10:42:23,250][123091] Updated weights for policy 0, policy_version 1391754 (0.0010) [2023-12-26 10:42:23,583][123090] Updated weights for policy 1, policy_version 1382212 (0.0010) [2023-12-26 10:42:23,634][123090] Updated weights for policy 1, policy_version 1382222 (0.0008) [2023-12-26 10:42:23,687][123090] Updated weights for policy 1, policy_version 1382232 (0.0009) [2023-12-26 10:42:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 710148096. Throughput: 0: 8946.4, 1: 8741.7. Samples: 710121800. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:23,785][121949] Avg episode reward: [(0, '6314.476'), (1, '5961.459')] [2023-12-26 10:42:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001391760_356294656.pth... [2023-12-26 10:42:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001382240_353853440.pth... [2023-12-26 10:42:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001381216_353591296.pth [2023-12-26 10:42:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001390704_356024320.pth [2023-12-26 10:42:24,045][123091] Updated weights for policy 0, policy_version 1391764 (0.0008) [2023-12-26 10:42:24,101][123091] Updated weights for policy 0, policy_version 1391774 (0.0005) [2023-12-26 10:42:24,160][123091] Updated weights for policy 0, policy_version 1391784 (0.0005) [2023-12-26 10:42:24,613][123090] Updated weights for policy 1, policy_version 1382242 (0.0009) [2023-12-26 10:42:24,670][123090] Updated weights for policy 1, policy_version 1382252 (0.0009) [2023-12-26 10:42:24,720][123090] Updated weights for policy 1, policy_version 1382262 (0.0009) [2023-12-26 10:42:24,777][123090] Updated weights for policy 1, policy_version 1382272 (0.0009) [2023-12-26 10:42:24,833][123091] Updated weights for policy 0, policy_version 1391794 (0.0006) [2023-12-26 10:42:24,894][123091] Updated weights for policy 0, policy_version 1391804 (0.0005) [2023-12-26 10:42:24,954][123091] Updated weights for policy 0, policy_version 1391814 (0.0010) [2023-12-26 10:42:25,013][123091] Updated weights for policy 0, policy_version 1391824 (0.0010) [2023-12-26 10:42:25,607][123090] Updated weights for policy 1, policy_version 1382282 (0.0005) [2023-12-26 10:42:25,653][123090] Updated weights for policy 1, policy_version 1382292 (0.0005) [2023-12-26 10:42:25,697][123090] Updated weights for policy 1, policy_version 1382302 (0.0005) [2023-12-26 10:42:25,822][123091] Updated weights for policy 0, policy_version 1391834 (0.0011) [2023-12-26 10:42:25,889][123091] Updated weights for policy 0, policy_version 1391844 (0.0006) [2023-12-26 10:42:25,960][123091] Updated weights for policy 0, policy_version 1391854 (0.0005) [2023-12-26 10:42:26,407][123090] Updated weights for policy 1, policy_version 1382312 (0.0005) [2023-12-26 10:42:26,456][123090] Updated weights for policy 1, policy_version 1382322 (0.0005) [2023-12-26 10:42:26,502][123090] Updated weights for policy 1, policy_version 1382332 (0.0005) [2023-12-26 10:42:26,588][123091] Updated weights for policy 0, policy_version 1391864 (0.0008) [2023-12-26 10:42:26,651][123091] Updated weights for policy 0, policy_version 1391874 (0.0011) [2023-12-26 10:42:26,719][123091] Updated weights for policy 0, policy_version 1391884 (0.0011) [2023-12-26 10:42:27,111][123090] Updated weights for policy 1, policy_version 1382342 (0.0005) [2023-12-26 10:42:27,157][123090] Updated weights for policy 1, policy_version 1382352 (0.0005) [2023-12-26 10:42:27,203][123090] Updated weights for policy 1, policy_version 1382362 (0.0005) [2023-12-26 10:42:27,349][123091] Updated weights for policy 0, policy_version 1391894 (0.0007) [2023-12-26 10:42:27,410][123091] Updated weights for policy 0, policy_version 1391904 (0.0005) [2023-12-26 10:42:27,460][123091] Updated weights for policy 0, policy_version 1391914 (0.0010) [2023-12-26 10:42:27,889][123090] Updated weights for policy 1, policy_version 1382372 (0.0005) [2023-12-26 10:42:27,938][123090] Updated weights for policy 1, policy_version 1382382 (0.0005) [2023-12-26 10:42:27,989][123090] Updated weights for policy 1, policy_version 1382392 (0.0005) [2023-12-26 10:42:28,163][123091] Updated weights for policy 0, policy_version 1391924 (0.0008) [2023-12-26 10:42:28,216][123091] Updated weights for policy 0, policy_version 1391934 (0.0005) [2023-12-26 10:42:28,268][123091] Updated weights for policy 0, policy_version 1391944 (0.0005) [2023-12-26 10:42:28,643][123090] Updated weights for policy 1, policy_version 1382402 (0.0006) [2023-12-26 10:42:28,705][123090] Updated weights for policy 1, policy_version 1382412 (0.0008) [2023-12-26 10:42:28,772][123090] Updated weights for policy 1, policy_version 1382422 (0.0008) [2023-12-26 10:42:28,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 710238208. Throughput: 0: 9045.9, 1: 8818.8. Samples: 710232816. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:28,785][121949] Avg episode reward: [(0, '6273.511'), (1, '5898.114')] [2023-12-26 10:42:28,837][123090] Updated weights for policy 1, policy_version 1382432 (0.0008) [2023-12-26 10:42:28,988][123091] Updated weights for policy 0, policy_version 1391954 (0.0006) [2023-12-26 10:42:29,043][123091] Updated weights for policy 0, policy_version 1391964 (0.0005) [2023-12-26 10:42:29,092][123091] Updated weights for policy 0, policy_version 1391974 (0.0005) [2023-12-26 10:42:29,151][123091] Updated weights for policy 0, policy_version 1391984 (0.0006) [2023-12-26 10:42:29,533][123090] Updated weights for policy 1, policy_version 1382442 (0.0005) [2023-12-26 10:42:29,587][123090] Updated weights for policy 1, policy_version 1382452 (0.0005) [2023-12-26 10:42:29,642][123090] Updated weights for policy 1, policy_version 1382462 (0.0005) [2023-12-26 10:42:29,881][123091] Updated weights for policy 0, policy_version 1391994 (0.0010) [2023-12-26 10:42:29,949][123091] Updated weights for policy 0, policy_version 1392004 (0.0011) [2023-12-26 10:42:30,013][123091] Updated weights for policy 0, policy_version 1392014 (0.0011) [2023-12-26 10:42:30,389][123090] Updated weights for policy 1, policy_version 1382472 (0.0008) [2023-12-26 10:42:30,438][123090] Updated weights for policy 1, policy_version 1382482 (0.0009) [2023-12-26 10:42:30,493][123090] Updated weights for policy 1, policy_version 1382492 (0.0009) [2023-12-26 10:42:30,812][123091] Updated weights for policy 0, policy_version 1392024 (0.0010) [2023-12-26 10:42:30,866][123091] Updated weights for policy 0, policy_version 1392034 (0.0010) [2023-12-26 10:42:30,921][123091] Updated weights for policy 0, policy_version 1392044 (0.0010) [2023-12-26 10:42:31,363][123090] Updated weights for policy 1, policy_version 1382502 (0.0009) [2023-12-26 10:42:31,412][123090] Updated weights for policy 1, policy_version 1382512 (0.0009) [2023-12-26 10:42:31,464][123090] Updated weights for policy 1, policy_version 1382522 (0.0008) [2023-12-26 10:42:31,761][123091] Updated weights for policy 0, policy_version 1392054 (0.0010) [2023-12-26 10:42:31,816][123091] Updated weights for policy 0, policy_version 1392064 (0.0010) [2023-12-26 10:42:31,874][123091] Updated weights for policy 0, policy_version 1392074 (0.0010) [2023-12-26 10:42:32,309][123090] Updated weights for policy 1, policy_version 1382532 (0.0008) [2023-12-26 10:42:32,362][123090] Updated weights for policy 1, policy_version 1382542 (0.0008) [2023-12-26 10:42:32,422][123090] Updated weights for policy 1, policy_version 1382552 (0.0009) [2023-12-26 10:42:32,702][123091] Updated weights for policy 0, policy_version 1392084 (0.0011) [2023-12-26 10:42:32,772][123091] Updated weights for policy 0, policy_version 1392094 (0.0009) [2023-12-26 10:42:32,841][123091] Updated weights for policy 0, policy_version 1392104 (0.0005) [2023-12-26 10:42:33,188][123090] Updated weights for policy 1, policy_version 1382562 (0.0009) [2023-12-26 10:42:33,242][123090] Updated weights for policy 1, policy_version 1382572 (0.0010) [2023-12-26 10:42:33,292][123090] Updated weights for policy 1, policy_version 1382582 (0.0010) [2023-12-26 10:42:33,348][123090] Updated weights for policy 1, policy_version 1382592 (0.0008) [2023-12-26 10:42:33,514][123091] Updated weights for policy 0, policy_version 1392114 (0.0008) [2023-12-26 10:42:33,563][123091] Updated weights for policy 0, policy_version 1392124 (0.0005) [2023-12-26 10:42:33,607][123091] Updated weights for policy 0, policy_version 1392134 (0.0005) [2023-12-26 10:42:33,660][123091] Updated weights for policy 0, policy_version 1392144 (0.0005) [2023-12-26 10:42:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 710336512. Throughput: 0: 9094.4, 1: 8840.1. Samples: 710344912. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:33,785][121949] Avg episode reward: [(0, '6358.538'), (1, '5873.600')] [2023-12-26 10:42:33,999][123090] Updated weights for policy 1, policy_version 1382602 (0.0005) [2023-12-26 10:42:34,043][123090] Updated weights for policy 1, policy_version 1382612 (0.0005) [2023-12-26 10:42:34,105][123090] Updated weights for policy 1, policy_version 1382622 (0.0005) [2023-12-26 10:42:34,383][123091] Updated weights for policy 0, policy_version 1392154 (0.0006) [2023-12-26 10:42:34,452][123091] Updated weights for policy 0, policy_version 1392164 (0.0009) [2023-12-26 10:42:34,509][123091] Updated weights for policy 0, policy_version 1392174 (0.0009) [2023-12-26 10:42:34,865][123090] Updated weights for policy 1, policy_version 1382632 (0.0005) [2023-12-26 10:42:34,932][123090] Updated weights for policy 1, policy_version 1382642 (0.0010) [2023-12-26 10:42:34,999][123090] Updated weights for policy 1, policy_version 1382652 (0.0010) [2023-12-26 10:42:35,254][123091] Updated weights for policy 0, policy_version 1392184 (0.0006) [2023-12-26 10:42:35,312][123091] Updated weights for policy 0, policy_version 1392194 (0.0008) [2023-12-26 10:42:35,365][123091] Updated weights for policy 0, policy_version 1392204 (0.0008) [2023-12-26 10:42:35,736][123090] Updated weights for policy 1, policy_version 1382662 (0.0010) [2023-12-26 10:42:35,798][123090] Updated weights for policy 1, policy_version 1382672 (0.0010) [2023-12-26 10:42:35,865][123090] Updated weights for policy 1, policy_version 1382682 (0.0011) [2023-12-26 10:42:36,131][123091] Updated weights for policy 0, policy_version 1392214 (0.0007) [2023-12-26 10:42:36,195][123091] Updated weights for policy 0, policy_version 1392224 (0.0006) [2023-12-26 10:42:36,255][123091] Updated weights for policy 0, policy_version 1392234 (0.0007) [2023-12-26 10:42:36,694][123090] Updated weights for policy 1, policy_version 1382692 (0.0011) [2023-12-26 10:42:36,741][123090] Updated weights for policy 1, policy_version 1382702 (0.0009) [2023-12-26 10:42:36,798][123090] Updated weights for policy 1, policy_version 1382712 (0.0009) [2023-12-26 10:42:37,014][123091] Updated weights for policy 0, policy_version 1392244 (0.0007) [2023-12-26 10:42:37,070][123091] Updated weights for policy 0, policy_version 1392254 (0.0008) [2023-12-26 10:42:37,125][123091] Updated weights for policy 0, policy_version 1392264 (0.0008) [2023-12-26 10:42:37,659][123090] Updated weights for policy 1, policy_version 1382722 (0.0009) [2023-12-26 10:42:37,709][123090] Updated weights for policy 1, policy_version 1382732 (0.0006) [2023-12-26 10:42:37,757][123090] Updated weights for policy 1, policy_version 1382742 (0.0005) [2023-12-26 10:42:37,817][123090] Updated weights for policy 1, policy_version 1382752 (0.0005) [2023-12-26 10:42:37,963][123091] Updated weights for policy 0, policy_version 1392274 (0.0008) [2023-12-26 10:42:38,029][123091] Updated weights for policy 0, policy_version 1392284 (0.0010) [2023-12-26 10:42:38,089][123091] Updated weights for policy 0, policy_version 1392294 (0.0009) [2023-12-26 10:42:38,148][123091] Updated weights for policy 0, policy_version 1392304 (0.0010) [2023-12-26 10:42:38,632][123090] Updated weights for policy 1, policy_version 1382762 (0.0005) [2023-12-26 10:42:38,711][123090] Updated weights for policy 1, policy_version 1382772 (0.0005) [2023-12-26 10:42:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 710418432. Throughput: 0: 9144.4, 1: 8891.0. Samples: 710400208. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:38,785][121949] Avg episode reward: [(0, '6399.905'), (1, '5927.178')] [2023-12-26 10:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001392304_356433920.pth... [2023-12-26 10:42:38,791][123090] Updated weights for policy 1, policy_version 1382782 (0.0006) [2023-12-26 10:42:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001391280_356171776.pth [2023-12-26 10:42:38,801][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001382784_353992704.pth... [2023-12-26 10:42:38,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001381728_353722368.pth [2023-12-26 10:42:38,894][123091] Updated weights for policy 0, policy_version 1392314 (0.0008) [2023-12-26 10:42:38,950][123091] Updated weights for policy 0, policy_version 1392324 (0.0009) [2023-12-26 10:42:39,007][123091] Updated weights for policy 0, policy_version 1392334 (0.0010) [2023-12-26 10:42:39,468][123090] Updated weights for policy 1, policy_version 1382792 (0.0009) [2023-12-26 10:42:39,531][123090] Updated weights for policy 1, policy_version 1382802 (0.0010) [2023-12-26 10:42:39,596][123090] Updated weights for policy 1, policy_version 1382812 (0.0009) [2023-12-26 10:42:39,864][123091] Updated weights for policy 0, policy_version 1392344 (0.0010) [2023-12-26 10:42:39,935][123091] Updated weights for policy 0, policy_version 1392354 (0.0010) [2023-12-26 10:42:39,989][123091] Updated weights for policy 0, policy_version 1392364 (0.0010) [2023-12-26 10:42:40,430][123090] Updated weights for policy 1, policy_version 1382822 (0.0009) [2023-12-26 10:42:40,492][123090] Updated weights for policy 1, policy_version 1382832 (0.0010) [2023-12-26 10:42:40,552][123090] Updated weights for policy 1, policy_version 1382842 (0.0010) [2023-12-26 10:42:40,823][123091] Updated weights for policy 0, policy_version 1392374 (0.0010) [2023-12-26 10:42:40,878][123091] Updated weights for policy 0, policy_version 1392384 (0.0010) [2023-12-26 10:42:40,936][123091] Updated weights for policy 0, policy_version 1392394 (0.0010) [2023-12-26 10:42:41,405][123090] Updated weights for policy 1, policy_version 1382852 (0.0009) [2023-12-26 10:42:41,458][123090] Updated weights for policy 1, policy_version 1382862 (0.0009) [2023-12-26 10:42:41,529][123090] Updated weights for policy 1, policy_version 1382872 (0.0009) [2023-12-26 10:42:41,797][123091] Updated weights for policy 0, policy_version 1392404 (0.0010) [2023-12-26 10:42:41,864][123091] Updated weights for policy 0, policy_version 1392414 (0.0011) [2023-12-26 10:42:41,930][123091] Updated weights for policy 0, policy_version 1392424 (0.0006) [2023-12-26 10:42:42,365][123090] Updated weights for policy 1, policy_version 1382882 (0.0009) [2023-12-26 10:42:42,432][123090] Updated weights for policy 1, policy_version 1382892 (0.0008) [2023-12-26 10:42:42,496][123090] Updated weights for policy 1, policy_version 1382902 (0.0008) [2023-12-26 10:42:42,564][123090] Updated weights for policy 1, policy_version 1382912 (0.0010) [2023-12-26 10:42:42,730][123091] Updated weights for policy 0, policy_version 1392434 (0.0010) [2023-12-26 10:42:42,798][123091] Updated weights for policy 0, policy_version 1392444 (0.0009) [2023-12-26 10:42:42,865][123091] Updated weights for policy 0, policy_version 1392454 (0.0007) [2023-12-26 10:42:42,925][123091] Updated weights for policy 0, policy_version 1392464 (0.0009) [2023-12-26 10:42:43,392][123090] Updated weights for policy 1, policy_version 1382922 (0.0010) [2023-12-26 10:42:43,458][123090] Updated weights for policy 1, policy_version 1382932 (0.0009) [2023-12-26 10:42:43,527][123090] Updated weights for policy 1, policy_version 1382942 (0.0011) [2023-12-26 10:42:43,723][123091] Updated weights for policy 0, policy_version 1392474 (0.0009) [2023-12-26 10:42:43,780][123091] Updated weights for policy 0, policy_version 1392484 (0.0006) [2023-12-26 10:42:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 710508544. Throughput: 0: 8970.6, 1: 8798.4. Samples: 710503932. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:43,785][121949] Avg episode reward: [(0, '6410.482'), (1, '5867.373')] [2023-12-26 10:42:43,850][123091] Updated weights for policy 0, policy_version 1392494 (0.0005) [2023-12-26 10:42:44,369][123090] Updated weights for policy 1, policy_version 1382952 (0.0010) [2023-12-26 10:42:44,426][123090] Updated weights for policy 1, policy_version 1382962 (0.0009) [2023-12-26 10:42:44,499][123090] Updated weights for policy 1, policy_version 1382973 (0.0008) [2023-12-26 10:42:44,566][123091] Updated weights for policy 0, policy_version 1392504 (0.0008) [2023-12-26 10:42:44,630][123091] Updated weights for policy 0, policy_version 1392514 (0.0010) [2023-12-26 10:42:44,695][123091] Updated weights for policy 0, policy_version 1392524 (0.0009) [2023-12-26 10:42:45,373][123090] Updated weights for policy 1, policy_version 1382983 (0.0010) [2023-12-26 10:42:45,438][123090] Updated weights for policy 1, policy_version 1382993 (0.0009) [2023-12-26 10:42:45,487][123091] Updated weights for policy 0, policy_version 1392534 (0.0007) [2023-12-26 10:42:45,504][123090] Updated weights for policy 1, policy_version 1383003 (0.0009) [2023-12-26 10:42:45,546][123091] Updated weights for policy 0, policy_version 1392544 (0.0009) [2023-12-26 10:42:45,603][123091] Updated weights for policy 0, policy_version 1392554 (0.0010) [2023-12-26 10:42:46,276][123090] Updated weights for policy 1, policy_version 1383013 (0.0008) [2023-12-26 10:42:46,335][123090] Updated weights for policy 1, policy_version 1383023 (0.0006) [2023-12-26 10:42:46,400][123090] Updated weights for policy 1, policy_version 1383033 (0.0007) [2023-12-26 10:42:46,461][123091] Updated weights for policy 0, policy_version 1392564 (0.0008) [2023-12-26 10:42:46,526][123091] Updated weights for policy 0, policy_version 1392574 (0.0008) [2023-12-26 10:42:46,597][123091] Updated weights for policy 0, policy_version 1392584 (0.0008) [2023-12-26 10:42:47,119][123090] Updated weights for policy 1, policy_version 1383043 (0.0009) [2023-12-26 10:42:47,174][123090] Updated weights for policy 1, policy_version 1383053 (0.0005) [2023-12-26 10:42:47,235][123090] Updated weights for policy 1, policy_version 1383063 (0.0005) [2023-12-26 10:42:47,319][123091] Updated weights for policy 0, policy_version 1392594 (0.0009) [2023-12-26 10:42:47,365][123091] Updated weights for policy 0, policy_version 1392604 (0.0005) [2023-12-26 10:42:47,424][123091] Updated weights for policy 0, policy_version 1392614 (0.0005) [2023-12-26 10:42:47,496][123091] Updated weights for policy 0, policy_version 1392624 (0.0005) [2023-12-26 10:42:47,915][123090] Updated weights for policy 1, policy_version 1383073 (0.0005) [2023-12-26 10:42:47,975][123090] Updated weights for policy 1, policy_version 1383083 (0.0005) [2023-12-26 10:42:48,034][123090] Updated weights for policy 1, policy_version 1383093 (0.0006) [2023-12-26 10:42:48,096][123090] Updated weights for policy 1, policy_version 1383103 (0.0006) [2023-12-26 10:42:48,156][123091] Updated weights for policy 0, policy_version 1392634 (0.0010) [2023-12-26 10:42:48,221][123091] Updated weights for policy 0, policy_version 1392644 (0.0010) [2023-12-26 10:42:48,289][123091] Updated weights for policy 0, policy_version 1392654 (0.0006) [2023-12-26 10:42:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 710598656. Throughput: 0: 8988.8, 1: 8873.1. Samples: 710614216. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:48,785][121949] Avg episode reward: [(0, '6366.344'), (1, '5826.831')] [2023-12-26 10:42:48,906][123090] Updated weights for policy 1, policy_version 1383113 (0.0010) [2023-12-26 10:42:48,912][123091] Updated weights for policy 0, policy_version 1392664 (0.0005) [2023-12-26 10:42:48,978][123091] Updated weights for policy 0, policy_version 1392674 (0.0006) [2023-12-26 10:42:48,984][123090] Updated weights for policy 1, policy_version 1383123 (0.0011) [2023-12-26 10:42:49,036][123091] Updated weights for policy 0, policy_version 1392684 (0.0005) [2023-12-26 10:42:49,054][123090] Updated weights for policy 1, policy_version 1383133 (0.0010) [2023-12-26 10:42:49,724][123091] Updated weights for policy 0, policy_version 1392694 (0.0008) [2023-12-26 10:42:49,790][123091] Updated weights for policy 0, policy_version 1392704 (0.0011) [2023-12-26 10:42:49,865][123091] Updated weights for policy 0, policy_version 1392714 (0.0011) [2023-12-26 10:42:49,867][123090] Updated weights for policy 1, policy_version 1383143 (0.0009) [2023-12-26 10:42:49,934][123090] Updated weights for policy 1, policy_version 1383153 (0.0007) [2023-12-26 10:42:50,006][123090] Updated weights for policy 1, policy_version 1383163 (0.0007) [2023-12-26 10:42:50,594][123091] Updated weights for policy 0, policy_version 1392724 (0.0010) [2023-12-26 10:42:50,661][123091] Updated weights for policy 0, policy_version 1392734 (0.0009) [2023-12-26 10:42:50,723][123091] Updated weights for policy 0, policy_version 1392744 (0.0009) [2023-12-26 10:42:50,757][123090] Updated weights for policy 1, policy_version 1383173 (0.0008) [2023-12-26 10:42:50,817][123090] Updated weights for policy 1, policy_version 1383183 (0.0010) [2023-12-26 10:42:50,883][123090] Updated weights for policy 1, policy_version 1383193 (0.0010) [2023-12-26 10:42:51,551][123091] Updated weights for policy 0, policy_version 1392754 (0.0007) [2023-12-26 10:42:51,625][123091] Updated weights for policy 0, policy_version 1392764 (0.0008) [2023-12-26 10:42:51,693][123091] Updated weights for policy 0, policy_version 1392774 (0.0009) [2023-12-26 10:42:51,715][123090] Updated weights for policy 1, policy_version 1383203 (0.0009) [2023-12-26 10:42:51,761][123091] Updated weights for policy 0, policy_version 1392784 (0.0008) [2023-12-26 10:42:51,784][123090] Updated weights for policy 1, policy_version 1383213 (0.0011) [2023-12-26 10:42:51,848][123090] Updated weights for policy 1, policy_version 1383223 (0.0011) [2023-12-26 10:42:52,477][123091] Updated weights for policy 0, policy_version 1392794 (0.0008) [2023-12-26 10:42:52,546][123091] Updated weights for policy 0, policy_version 1392804 (0.0006) [2023-12-26 10:42:52,606][123091] Updated weights for policy 0, policy_version 1392814 (0.0010) [2023-12-26 10:42:52,620][123090] Updated weights for policy 1, policy_version 1383233 (0.0011) [2023-12-26 10:42:52,680][123090] Updated weights for policy 1, policy_version 1383243 (0.0009) [2023-12-26 10:42:52,737][123090] Updated weights for policy 1, policy_version 1383253 (0.0008) [2023-12-26 10:42:52,797][123090] Updated weights for policy 1, policy_version 1383263 (0.0009) [2023-12-26 10:42:53,285][123091] Updated weights for policy 0, policy_version 1392824 (0.0006) [2023-12-26 10:42:53,346][123091] Updated weights for policy 0, policy_version 1392834 (0.0005) [2023-12-26 10:42:53,394][123091] Updated weights for policy 0, policy_version 1392844 (0.0005) [2023-12-26 10:42:53,622][123090] Updated weights for policy 1, policy_version 1383273 (0.0006) [2023-12-26 10:42:53,671][123090] Updated weights for policy 1, policy_version 1383283 (0.0005) [2023-12-26 10:42:53,736][123090] Updated weights for policy 1, policy_version 1383293 (0.0005) [2023-12-26 10:42:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 710696960. Throughput: 0: 8997.1, 1: 8900.5. Samples: 710667824. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:53,785][121949] Avg episode reward: [(0, '6413.098'), (1, '5877.197')] [2023-12-26 10:42:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001383296_354123776.pth... [2023-12-26 10:42:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001392848_356573184.pth... [2023-12-26 10:42:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001391760_356294656.pth [2023-12-26 10:42:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001382240_353853440.pth [2023-12-26 10:42:54,043][123091] Updated weights for policy 0, policy_version 1392854 (0.0005) [2023-12-26 10:42:54,092][123091] Updated weights for policy 0, policy_version 1392864 (0.0005) [2023-12-26 10:42:54,148][123091] Updated weights for policy 0, policy_version 1392874 (0.0007) [2023-12-26 10:42:54,459][123090] Updated weights for policy 1, policy_version 1383303 (0.0009) [2023-12-26 10:42:54,515][123090] Updated weights for policy 1, policy_version 1383313 (0.0010) [2023-12-26 10:42:54,567][123090] Updated weights for policy 1, policy_version 1383323 (0.0010) [2023-12-26 10:42:54,842][123091] Updated weights for policy 0, policy_version 1392884 (0.0008) [2023-12-26 10:42:54,894][123091] Updated weights for policy 0, policy_version 1392894 (0.0010) [2023-12-26 10:42:54,958][123091] Updated weights for policy 0, policy_version 1392904 (0.0008) [2023-12-26 10:42:55,318][123090] Updated weights for policy 1, policy_version 1383333 (0.0009) [2023-12-26 10:42:55,377][123090] Updated weights for policy 1, policy_version 1383343 (0.0006) [2023-12-26 10:42:55,424][123090] Updated weights for policy 1, policy_version 1383353 (0.0005) [2023-12-26 10:42:55,762][123091] Updated weights for policy 0, policy_version 1392914 (0.0011) [2023-12-26 10:42:55,816][123091] Updated weights for policy 0, policy_version 1392924 (0.0010) [2023-12-26 10:42:55,866][123091] Updated weights for policy 0, policy_version 1392934 (0.0010) [2023-12-26 10:42:55,910][123091] Updated weights for policy 0, policy_version 1392944 (0.0010) [2023-12-26 10:42:56,072][123090] Updated weights for policy 1, policy_version 1383363 (0.0006) [2023-12-26 10:42:56,137][123090] Updated weights for policy 1, policy_version 1383373 (0.0008) [2023-12-26 10:42:56,203][123090] Updated weights for policy 1, policy_version 1383383 (0.0009) [2023-12-26 10:42:56,684][123091] Updated weights for policy 0, policy_version 1392954 (0.0010) [2023-12-26 10:42:56,735][123091] Updated weights for policy 0, policy_version 1392964 (0.0010) [2023-12-26 10:42:56,778][123091] Updated weights for policy 0, policy_version 1392974 (0.0010) [2023-12-26 10:42:56,976][123090] Updated weights for policy 1, policy_version 1383393 (0.0010) [2023-12-26 10:42:57,030][123090] Updated weights for policy 1, policy_version 1383403 (0.0005) [2023-12-26 10:42:57,080][123090] Updated weights for policy 1, policy_version 1383413 (0.0005) [2023-12-26 10:42:57,136][123090] Updated weights for policy 1, policy_version 1383423 (0.0007) [2023-12-26 10:42:57,602][123091] Updated weights for policy 0, policy_version 1392984 (0.0010) [2023-12-26 10:42:57,656][123091] Updated weights for policy 0, policy_version 1392994 (0.0010) [2023-12-26 10:42:57,717][123091] Updated weights for policy 0, policy_version 1393004 (0.0009) [2023-12-26 10:42:57,855][123090] Updated weights for policy 1, policy_version 1383433 (0.0010) [2023-12-26 10:42:57,922][123090] Updated weights for policy 1, policy_version 1383444 (0.0010) [2023-12-26 10:42:57,976][123090] Updated weights for policy 1, policy_version 1383454 (0.0011) [2023-12-26 10:42:58,531][123091] Updated weights for policy 0, policy_version 1393014 (0.0008) [2023-12-26 10:42:58,607][123091] Updated weights for policy 0, policy_version 1393024 (0.0008) [2023-12-26 10:42:58,676][123091] Updated weights for policy 0, policy_version 1393034 (0.0008) [2023-12-26 10:42:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 710787072. Throughput: 0: 9100.7, 1: 9078.5. Samples: 710781992. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:42:58,785][121949] Avg episode reward: [(0, '6421.147'), (1, '5988.435')] [2023-12-26 10:42:58,847][123090] Updated weights for policy 1, policy_version 1383464 (0.0010) [2023-12-26 10:42:58,907][123090] Updated weights for policy 1, policy_version 1383474 (0.0009) [2023-12-26 10:42:58,962][123090] Updated weights for policy 1, policy_version 1383484 (0.0009) [2023-12-26 10:42:59,469][123091] Updated weights for policy 0, policy_version 1393044 (0.0008) [2023-12-26 10:42:59,532][123091] Updated weights for policy 0, policy_version 1393054 (0.0009) [2023-12-26 10:42:59,587][123091] Updated weights for policy 0, policy_version 1393064 (0.0009) [2023-12-26 10:42:59,797][123090] Updated weights for policy 1, policy_version 1383494 (0.0010) [2023-12-26 10:42:59,862][123090] Updated weights for policy 1, policy_version 1383504 (0.0009) [2023-12-26 10:42:59,920][123090] Updated weights for policy 1, policy_version 1383514 (0.0009) [2023-12-26 10:43:00,427][123091] Updated weights for policy 0, policy_version 1393074 (0.0008) [2023-12-26 10:43:00,489][123091] Updated weights for policy 0, policy_version 1393084 (0.0005) [2023-12-26 10:43:00,548][123091] Updated weights for policy 0, policy_version 1393094 (0.0006) [2023-12-26 10:43:00,596][123091] Updated weights for policy 0, policy_version 1393104 (0.0009) [2023-12-26 10:43:00,772][123090] Updated weights for policy 1, policy_version 1383524 (0.0010) [2023-12-26 10:43:00,834][123090] Updated weights for policy 1, policy_version 1383534 (0.0010) [2023-12-26 10:43:00,892][123090] Updated weights for policy 1, policy_version 1383544 (0.0007) [2023-12-26 10:43:01,396][123091] Updated weights for policy 0, policy_version 1393114 (0.0010) [2023-12-26 10:43:01,459][123091] Updated weights for policy 0, policy_version 1393124 (0.0011) [2023-12-26 10:43:01,515][123091] Updated weights for policy 0, policy_version 1393134 (0.0011) [2023-12-26 10:43:01,693][123090] Updated weights for policy 1, policy_version 1383554 (0.0009) [2023-12-26 10:43:01,763][123090] Updated weights for policy 1, policy_version 1383564 (0.0007) [2023-12-26 10:43:01,827][123090] Updated weights for policy 1, policy_version 1383574 (0.0006) [2023-12-26 10:43:01,900][123090] Updated weights for policy 1, policy_version 1383584 (0.0006) [2023-12-26 10:43:02,328][123091] Updated weights for policy 0, policy_version 1393144 (0.0010) [2023-12-26 10:43:02,395][123091] Updated weights for policy 0, policy_version 1393154 (0.0010) [2023-12-26 10:43:02,464][123091] Updated weights for policy 0, policy_version 1393164 (0.0008) [2023-12-26 10:43:02,651][123090] Updated weights for policy 1, policy_version 1383594 (0.0009) [2023-12-26 10:43:02,722][123090] Updated weights for policy 1, policy_version 1383604 (0.0008) [2023-12-26 10:43:02,771][123090] Updated weights for policy 1, policy_version 1383614 (0.0006) [2023-12-26 10:43:03,278][123091] Updated weights for policy 0, policy_version 1393174 (0.0010) [2023-12-26 10:43:03,334][123091] Updated weights for policy 0, policy_version 1393184 (0.0009) [2023-12-26 10:43:03,389][123090] Updated weights for policy 1, policy_version 1383624 (0.0005) [2023-12-26 10:43:03,396][123091] Updated weights for policy 0, policy_version 1393194 (0.0009) [2023-12-26 10:43:03,446][123090] Updated weights for policy 1, policy_version 1383634 (0.0005) [2023-12-26 10:43:03,508][123090] Updated weights for policy 1, policy_version 1383644 (0.0005) [2023-12-26 10:43:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 710877184. Throughput: 0: 9087.6, 1: 9027.6. Samples: 710886756. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:43:03,785][121949] Avg episode reward: [(0, '6433.219'), (1, '5887.288')] [2023-12-26 10:43:04,125][123091] Updated weights for policy 0, policy_version 1393204 (0.0007) [2023-12-26 10:43:04,183][123091] Updated weights for policy 0, policy_version 1393214 (0.0009) [2023-12-26 10:43:04,186][123090] Updated weights for policy 1, policy_version 1383654 (0.0007) [2023-12-26 10:43:04,228][123091] Updated weights for policy 0, policy_version 1393224 (0.0010) [2023-12-26 10:43:04,251][123090] Updated weights for policy 1, policy_version 1383664 (0.0008) [2023-12-26 10:43:04,322][123090] Updated weights for policy 1, policy_version 1383674 (0.0008) [2023-12-26 10:43:05,018][123091] Updated weights for policy 0, policy_version 1393234 (0.0010) [2023-12-26 10:43:05,069][123091] Updated weights for policy 0, policy_version 1393244 (0.0005) [2023-12-26 10:43:05,135][123091] Updated weights for policy 0, policy_version 1393254 (0.0005) [2023-12-26 10:43:05,157][123090] Updated weights for policy 1, policy_version 1383684 (0.0009) [2023-12-26 10:43:05,198][123091] Updated weights for policy 0, policy_version 1393264 (0.0008) [2023-12-26 10:43:05,219][123090] Updated weights for policy 1, policy_version 1383694 (0.0007) [2023-12-26 10:43:05,271][123090] Updated weights for policy 1, policy_version 1383704 (0.0008) [2023-12-26 10:43:05,992][123090] Updated weights for policy 1, policy_version 1383714 (0.0008) [2023-12-26 10:43:06,037][123091] Updated weights for policy 0, policy_version 1393274 (0.0007) [2023-12-26 10:43:06,055][123090] Updated weights for policy 1, policy_version 1383724 (0.0010) [2023-12-26 10:43:06,101][123091] Updated weights for policy 0, policy_version 1393284 (0.0007) [2023-12-26 10:43:06,110][123090] Updated weights for policy 1, policy_version 1383734 (0.0010) [2023-12-26 10:43:06,170][123091] Updated weights for policy 0, policy_version 1393294 (0.0009) [2023-12-26 10:43:06,175][123090] Updated weights for policy 1, policy_version 1383744 (0.0011) [2023-12-26 10:43:06,869][123091] Updated weights for policy 0, policy_version 1393304 (0.0006) [2023-12-26 10:43:06,931][123091] Updated weights for policy 0, policy_version 1393314 (0.0005) [2023-12-26 10:43:06,988][123091] Updated weights for policy 0, policy_version 1393324 (0.0005) [2023-12-26 10:43:07,037][123090] Updated weights for policy 1, policy_version 1383754 (0.0011) [2023-12-26 10:43:07,093][123090] Updated weights for policy 1, policy_version 1383764 (0.0006) [2023-12-26 10:43:07,149][123090] Updated weights for policy 1, policy_version 1383774 (0.0005) [2023-12-26 10:43:07,748][123091] Updated weights for policy 0, policy_version 1393334 (0.0008) [2023-12-26 10:43:07,797][123091] Updated weights for policy 0, policy_version 1393344 (0.0009) [2023-12-26 10:43:07,851][123091] Updated weights for policy 0, policy_version 1393354 (0.0008) [2023-12-26 10:43:07,872][123090] Updated weights for policy 1, policy_version 1383784 (0.0009) [2023-12-26 10:43:07,924][123090] Updated weights for policy 1, policy_version 1383794 (0.0010) [2023-12-26 10:43:07,983][123090] Updated weights for policy 1, policy_version 1383804 (0.0010) [2023-12-26 10:43:08,731][123091] Updated weights for policy 0, policy_version 1393364 (0.0009) [2023-12-26 10:43:08,774][123090] Updated weights for policy 1, policy_version 1383814 (0.0008) [2023-12-26 10:43:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 710959104. Throughput: 0: 9160.5, 1: 9058.3. Samples: 710941648. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:43:08,785][121949] Avg episode reward: [(0, '6427.692'), (1, '5813.797')] [2023-12-26 10:43:08,793][123091] Updated weights for policy 0, policy_version 1393374 (0.0008) [2023-12-26 10:43:08,841][123090] Updated weights for policy 1, policy_version 1383824 (0.0011) [2023-12-26 10:43:08,858][123091] Updated weights for policy 0, policy_version 1393384 (0.0008) [2023-12-26 10:43:08,894][123090] Updated weights for policy 1, policy_version 1383834 (0.0011) [2023-12-26 10:43:08,908][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001393392_356712448.pth... [2023-12-26 10:43:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001392304_356433920.pth [2023-12-26 10:43:08,930][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001383840_354263040.pth... [2023-12-26 10:43:08,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001382784_353992704.pth [2023-12-26 10:43:09,651][123091] Updated weights for policy 0, policy_version 1393394 (0.0008) [2023-12-26 10:43:09,724][123091] Updated weights for policy 0, policy_version 1393404 (0.0009) [2023-12-26 10:43:09,753][123090] Updated weights for policy 1, policy_version 1383844 (0.0010) [2023-12-26 10:43:09,783][123091] Updated weights for policy 0, policy_version 1393414 (0.0007) [2023-12-26 10:43:09,823][123090] Updated weights for policy 1, policy_version 1383854 (0.0011) [2023-12-26 10:43:09,856][123091] Updated weights for policy 0, policy_version 1393424 (0.0010) [2023-12-26 10:43:09,894][123090] Updated weights for policy 1, policy_version 1383864 (0.0008) [2023-12-26 10:43:10,636][123090] Updated weights for policy 1, policy_version 1383874 (0.0009) [2023-12-26 10:43:10,655][123091] Updated weights for policy 0, policy_version 1393434 (0.0006) [2023-12-26 10:43:10,703][123090] Updated weights for policy 1, policy_version 1383884 (0.0010) [2023-12-26 10:43:10,712][123091] Updated weights for policy 0, policy_version 1393444 (0.0007) [2023-12-26 10:43:10,772][123090] Updated weights for policy 1, policy_version 1383894 (0.0008) [2023-12-26 10:43:10,776][123091] Updated weights for policy 0, policy_version 1393454 (0.0010) [2023-12-26 10:43:10,839][123090] Updated weights for policy 1, policy_version 1383904 (0.0006) [2023-12-26 10:43:11,603][123090] Updated weights for policy 1, policy_version 1383914 (0.0008) [2023-12-26 10:43:11,604][123091] Updated weights for policy 0, policy_version 1393464 (0.0008) [2023-12-26 10:43:11,680][123090] Updated weights for policy 1, policy_version 1383924 (0.0009) [2023-12-26 10:43:11,680][123091] Updated weights for policy 0, policy_version 1393474 (0.0010) [2023-12-26 10:43:11,741][123091] Updated weights for policy 0, policy_version 1393484 (0.0009) [2023-12-26 10:43:11,763][123090] Updated weights for policy 1, policy_version 1383934 (0.0009) [2023-12-26 10:43:12,474][123090] Updated weights for policy 1, policy_version 1383944 (0.0007) [2023-12-26 10:43:12,540][123090] Updated weights for policy 1, policy_version 1383954 (0.0005) [2023-12-26 10:43:12,604][123090] Updated weights for policy 1, policy_version 1383964 (0.0006) [2023-12-26 10:43:12,611][123091] Updated weights for policy 0, policy_version 1393494 (0.0008) [2023-12-26 10:43:12,680][123091] Updated weights for policy 0, policy_version 1393504 (0.0009) [2023-12-26 10:43:12,748][123091] Updated weights for policy 0, policy_version 1393514 (0.0007) [2023-12-26 10:43:13,374][123090] Updated weights for policy 1, policy_version 1383974 (0.0007) [2023-12-26 10:43:13,423][123090] Updated weights for policy 1, policy_version 1383984 (0.0005) [2023-12-26 10:43:13,479][123091] Updated weights for policy 0, policy_version 1393524 (0.0005) [2023-12-26 10:43:13,484][123090] Updated weights for policy 1, policy_version 1383994 (0.0006) [2023-12-26 10:43:13,531][123091] Updated weights for policy 0, policy_version 1393534 (0.0008) [2023-12-26 10:43:13,586][123091] Updated weights for policy 0, policy_version 1393545 (0.0011) [2023-12-26 10:43:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 711057408. Throughput: 0: 9076.1, 1: 9034.3. Samples: 711047788. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:43:13,785][121949] Avg episode reward: [(0, '6427.453'), (1, '5789.797')] [2023-12-26 10:43:14,261][123090] Updated weights for policy 1, policy_version 1384004 (0.0007) [2023-12-26 10:43:14,310][123090] Updated weights for policy 1, policy_version 1384014 (0.0009) [2023-12-26 10:43:14,371][123090] Updated weights for policy 1, policy_version 1384024 (0.0009) [2023-12-26 10:43:14,418][123091] Updated weights for policy 0, policy_version 1393555 (0.0010) [2023-12-26 10:43:14,477][123091] Updated weights for policy 0, policy_version 1393565 (0.0009) [2023-12-26 10:43:14,543][123091] Updated weights for policy 0, policy_version 1393575 (0.0009) [2023-12-26 10:43:15,224][123090] Updated weights for policy 1, policy_version 1384034 (0.0009) [2023-12-26 10:43:15,290][123090] Updated weights for policy 1, policy_version 1384044 (0.0009) [2023-12-26 10:43:15,357][123090] Updated weights for policy 1, policy_version 1384054 (0.0009) [2023-12-26 10:43:15,413][123091] Updated weights for policy 0, policy_version 1393585 (0.0009) [2023-12-26 10:43:15,423][123090] Updated weights for policy 1, policy_version 1384064 (0.0009) [2023-12-26 10:43:15,472][123091] Updated weights for policy 0, policy_version 1393595 (0.0006) [2023-12-26 10:43:15,540][123091] Updated weights for policy 0, policy_version 1393605 (0.0006) [2023-12-26 10:43:15,597][123091] Updated weights for policy 0, policy_version 1393615 (0.0006) [2023-12-26 10:43:16,127][123090] Updated weights for policy 1, policy_version 1384074 (0.0009) [2023-12-26 10:43:16,221][123090] Updated weights for policy 1, policy_version 1384084 (0.0008) [2023-12-26 10:43:16,259][123091] Updated weights for policy 0, policy_version 1393625 (0.0011) [2023-12-26 10:43:16,297][123090] Updated weights for policy 1, policy_version 1384094 (0.0005) [2023-12-26 10:43:16,329][123091] Updated weights for policy 0, policy_version 1393635 (0.0008) [2023-12-26 10:43:16,395][123091] Updated weights for policy 0, policy_version 1393645 (0.0011) [2023-12-26 10:43:16,976][123090] Updated weights for policy 1, policy_version 1384104 (0.0005) [2023-12-26 10:43:16,994][123091] Updated weights for policy 0, policy_version 1393655 (0.0011) [2023-12-26 10:43:17,031][123090] Updated weights for policy 1, policy_version 1384114 (0.0005) [2023-12-26 10:43:17,053][123091] Updated weights for policy 0, policy_version 1393665 (0.0010) [2023-12-26 10:43:17,089][123090] Updated weights for policy 1, policy_version 1384124 (0.0005) [2023-12-26 10:43:17,108][123091] Updated weights for policy 0, policy_version 1393675 (0.0011) [2023-12-26 10:43:17,734][123090] Updated weights for policy 1, policy_version 1384134 (0.0006) [2023-12-26 10:43:17,783][123090] Updated weights for policy 1, policy_version 1384144 (0.0005) [2023-12-26 10:43:17,841][123090] Updated weights for policy 1, policy_version 1384154 (0.0006) [2023-12-26 10:43:17,958][123091] Updated weights for policy 0, policy_version 1393685 (0.0010) [2023-12-26 10:43:18,012][123091] Updated weights for policy 0, policy_version 1393697 (0.0011) [2023-12-26 10:43:18,066][123091] Updated weights for policy 0, policy_version 1393707 (0.0010) [2023-12-26 10:43:18,548][123090] Updated weights for policy 1, policy_version 1384164 (0.0007) [2023-12-26 10:43:18,599][123090] Updated weights for policy 1, policy_version 1384174 (0.0010) [2023-12-26 10:43:18,651][123090] Updated weights for policy 1, policy_version 1384184 (0.0010) [2023-12-26 10:43:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18159.0, 300 sec: 17772.5). Total num frames: 711147520. Throughput: 0: 9015.8, 1: 9041.3. Samples: 711157476. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:43:18,785][121949] Avg episode reward: [(0, '6440.838'), (1, '5760.249')] [2023-12-26 10:43:18,955][123091] Updated weights for policy 0, policy_version 1393717 (0.0010) [2023-12-26 10:43:19,016][123091] Updated weights for policy 0, policy_version 1393727 (0.0008) [2023-12-26 10:43:19,080][123091] Updated weights for policy 0, policy_version 1393737 (0.0011) [2023-12-26 10:43:19,461][123090] Updated weights for policy 1, policy_version 1384194 (0.0010) [2023-12-26 10:43:19,532][123090] Updated weights for policy 1, policy_version 1384204 (0.0009) [2023-12-26 10:43:19,600][123090] Updated weights for policy 1, policy_version 1384214 (0.0007) [2023-12-26 10:43:19,674][123090] Updated weights for policy 1, policy_version 1384224 (0.0009) [2023-12-26 10:43:19,923][123091] Updated weights for policy 0, policy_version 1393747 (0.0011) [2023-12-26 10:43:19,991][123091] Updated weights for policy 0, policy_version 1393757 (0.0011) [2023-12-26 10:43:20,055][123091] Updated weights for policy 0, policy_version 1393767 (0.0011) [2023-12-26 10:43:20,479][123090] Updated weights for policy 1, policy_version 1384234 (0.0011) [2023-12-26 10:43:20,553][123090] Updated weights for policy 1, policy_version 1384244 (0.0010) [2023-12-26 10:43:20,621][123090] Updated weights for policy 1, policy_version 1384254 (0.0009) [2023-12-26 10:43:20,867][123091] Updated weights for policy 0, policy_version 1393777 (0.0007) [2023-12-26 10:43:20,922][123091] Updated weights for policy 0, policy_version 1393787 (0.0010) [2023-12-26 10:43:20,983][123091] Updated weights for policy 0, policy_version 1393797 (0.0009) [2023-12-26 10:43:21,081][123091] Updated weights for policy 0, policy_version 1393807 (0.0010) [2023-12-26 10:43:21,408][123090] Updated weights for policy 1, policy_version 1384264 (0.0009) [2023-12-26 10:43:21,475][123090] Updated weights for policy 1, policy_version 1384274 (0.0008) [2023-12-26 10:43:21,544][123090] Updated weights for policy 1, policy_version 1384284 (0.0008) [2023-12-26 10:43:21,938][123091] Updated weights for policy 0, policy_version 1393817 (0.0009) [2023-12-26 10:43:21,996][123091] Updated weights for policy 0, policy_version 1393827 (0.0009) [2023-12-26 10:43:22,061][123091] Updated weights for policy 0, policy_version 1393837 (0.0009) [2023-12-26 10:43:22,359][123090] Updated weights for policy 1, policy_version 1384294 (0.0007) [2023-12-26 10:43:22,426][123090] Updated weights for policy 1, policy_version 1384304 (0.0008) [2023-12-26 10:43:22,489][123090] Updated weights for policy 1, policy_version 1384314 (0.0008) [2023-12-26 10:43:22,946][123091] Updated weights for policy 0, policy_version 1393847 (0.0010) [2023-12-26 10:43:23,003][123091] Updated weights for policy 0, policy_version 1393857 (0.0010) [2023-12-26 10:43:23,062][123091] Updated weights for policy 0, policy_version 1393867 (0.0010) [2023-12-26 10:43:23,241][123090] Updated weights for policy 1, policy_version 1384324 (0.0009) [2023-12-26 10:43:23,295][123090] Updated weights for policy 1, policy_version 1384334 (0.0009) [2023-12-26 10:43:23,352][123090] Updated weights for policy 1, policy_version 1384344 (0.0010) [2023-12-26 10:43:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 711229440. Throughput: 0: 8956.8, 1: 8998.5. Samples: 711208200. Policy #0 lag: (min: 15.0, avg: 31.6, max: 32.0) [2023-12-26 10:43:23,786][121949] Avg episode reward: [(0, '6436.220'), (1, '5763.939')] [2023-12-26 10:43:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001393872_356835328.pth... [2023-12-26 10:43:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001384352_354394112.pth... [2023-12-26 10:43:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001392848_356573184.pth [2023-12-26 10:43:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001383296_354123776.pth [2023-12-26 10:43:23,866][123091] Updated weights for policy 0, policy_version 1393877 (0.0008) [2023-12-26 10:43:23,919][123091] Updated weights for policy 0, policy_version 1393887 (0.0005) [2023-12-26 10:43:23,978][123091] Updated weights for policy 0, policy_version 1393897 (0.0005) [2023-12-26 10:43:24,269][123090] Updated weights for policy 1, policy_version 1384354 (0.0010) [2023-12-26 10:43:24,325][123090] Updated weights for policy 1, policy_version 1384364 (0.0009) [2023-12-26 10:43:24,378][123090] Updated weights for policy 1, policy_version 1384374 (0.0008) [2023-12-26 10:43:24,431][123090] Updated weights for policy 1, policy_version 1384384 (0.0009) [2023-12-26 10:43:24,666][123091] Updated weights for policy 0, policy_version 1393907 (0.0007) [2023-12-26 10:43:24,728][123091] Updated weights for policy 0, policy_version 1393917 (0.0008) [2023-12-26 10:43:24,792][123091] Updated weights for policy 0, policy_version 1393927 (0.0009) [2023-12-26 10:43:25,313][123090] Updated weights for policy 1, policy_version 1384394 (0.0010) [2023-12-26 10:43:25,367][123090] Updated weights for policy 1, policy_version 1384405 (0.0010) [2023-12-26 10:43:25,425][123090] Updated weights for policy 1, policy_version 1384415 (0.0010) [2023-12-26 10:43:25,507][123091] Updated weights for policy 0, policy_version 1393937 (0.0009) [2023-12-26 10:43:25,564][123091] Updated weights for policy 0, policy_version 1393947 (0.0005) [2023-12-26 10:43:25,619][123091] Updated weights for policy 0, policy_version 1393957 (0.0005) [2023-12-26 10:43:25,675][123091] Updated weights for policy 0, policy_version 1393967 (0.0005) [2023-12-26 10:43:26,352][123090] Updated weights for policy 1, policy_version 1384425 (0.0009) [2023-12-26 10:43:26,377][123091] Updated weights for policy 0, policy_version 1393977 (0.0008) [2023-12-26 10:43:26,399][123090] Updated weights for policy 1, policy_version 1384435 (0.0008) [2023-12-26 10:43:26,421][123091] Updated weights for policy 0, policy_version 1393987 (0.0005) [2023-12-26 10:43:26,453][123090] Updated weights for policy 1, policy_version 1384445 (0.0010) [2023-12-26 10:43:26,487][123091] Updated weights for policy 0, policy_version 1393997 (0.0006) [2023-12-26 10:43:27,215][123091] Updated weights for policy 0, policy_version 1394007 (0.0007) [2023-12-26 10:43:27,278][123091] Updated weights for policy 0, policy_version 1394017 (0.0005) [2023-12-26 10:43:27,341][123091] Updated weights for policy 0, policy_version 1394027 (0.0006) [2023-12-26 10:43:27,355][123090] Updated weights for policy 1, policy_version 1384455 (0.0009) [2023-12-26 10:43:27,423][123090] Updated weights for policy 1, policy_version 1384465 (0.0010) [2023-12-26 10:43:27,484][123090] Updated weights for policy 1, policy_version 1384475 (0.0010) [2023-12-26 10:43:27,972][123091] Updated weights for policy 0, policy_version 1394037 (0.0006) [2023-12-26 10:43:28,018][123091] Updated weights for policy 0, policy_version 1394047 (0.0006) [2023-12-26 10:43:28,067][123091] Updated weights for policy 0, policy_version 1394057 (0.0005) [2023-12-26 10:43:28,350][123090] Updated weights for policy 1, policy_version 1384485 (0.0010) [2023-12-26 10:43:28,406][123090] Updated weights for policy 1, policy_version 1384495 (0.0010) [2023-12-26 10:43:28,460][123090] Updated weights for policy 1, policy_version 1384505 (0.0010) [2023-12-26 10:43:28,740][123091] Updated weights for policy 0, policy_version 1394067 (0.0005) [2023-12-26 10:43:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 711319552. Throughput: 0: 9038.8, 1: 8948.3. Samples: 711313352. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:28,785][121949] Avg episode reward: [(0, '6456.314'), (1, '5768.064')] [2023-12-26 10:43:28,800][123091] Updated weights for policy 0, policy_version 1394077 (0.0008) [2023-12-26 10:43:28,858][123091] Updated weights for policy 0, policy_version 1394087 (0.0010) [2023-12-26 10:43:29,291][123090] Updated weights for policy 1, policy_version 1384515 (0.0009) [2023-12-26 10:43:29,355][123090] Updated weights for policy 1, policy_version 1384525 (0.0008) [2023-12-26 10:43:29,421][123090] Updated weights for policy 1, policy_version 1384535 (0.0008) [2023-12-26 10:43:29,665][123091] Updated weights for policy 0, policy_version 1394097 (0.0011) [2023-12-26 10:43:29,735][123091] Updated weights for policy 0, policy_version 1394107 (0.0011) [2023-12-26 10:43:29,803][123091] Updated weights for policy 0, policy_version 1394117 (0.0009) [2023-12-26 10:43:29,875][123091] Updated weights for policy 0, policy_version 1394127 (0.0008) [2023-12-26 10:43:30,194][123090] Updated weights for policy 1, policy_version 1384545 (0.0005) [2023-12-26 10:43:30,257][123090] Updated weights for policy 1, policy_version 1384555 (0.0009) [2023-12-26 10:43:30,324][123090] Updated weights for policy 1, policy_version 1384565 (0.0009) [2023-12-26 10:43:30,387][123090] Updated weights for policy 1, policy_version 1384575 (0.0010) [2023-12-26 10:43:30,620][123091] Updated weights for policy 0, policy_version 1394137 (0.0009) [2023-12-26 10:43:30,676][123091] Updated weights for policy 0, policy_version 1394147 (0.0009) [2023-12-26 10:43:30,724][123091] Updated weights for policy 0, policy_version 1394157 (0.0011) [2023-12-26 10:43:31,188][123090] Updated weights for policy 1, policy_version 1384585 (0.0010) [2023-12-26 10:43:31,248][123090] Updated weights for policy 1, policy_version 1384595 (0.0010) [2023-12-26 10:43:31,307][123090] Updated weights for policy 1, policy_version 1384605 (0.0011) [2023-12-26 10:43:31,585][123091] Updated weights for policy 0, policy_version 1394167 (0.0009) [2023-12-26 10:43:31,647][123091] Updated weights for policy 0, policy_version 1394177 (0.0009) [2023-12-26 10:43:31,701][123091] Updated weights for policy 0, policy_version 1394187 (0.0009) [2023-12-26 10:43:32,166][123090] Updated weights for policy 1, policy_version 1384615 (0.0010) [2023-12-26 10:43:32,232][123090] Updated weights for policy 1, policy_version 1384625 (0.0010) [2023-12-26 10:43:32,292][123090] Updated weights for policy 1, policy_version 1384635 (0.0010) [2023-12-26 10:43:32,467][123091] Updated weights for policy 0, policy_version 1394197 (0.0010) [2023-12-26 10:43:32,529][123091] Updated weights for policy 0, policy_version 1394207 (0.0010) [2023-12-26 10:43:32,585][123091] Updated weights for policy 0, policy_version 1394217 (0.0008) [2023-12-26 10:43:33,104][123090] Updated weights for policy 1, policy_version 1384645 (0.0010) [2023-12-26 10:43:33,166][123090] Updated weights for policy 1, policy_version 1384655 (0.0010) [2023-12-26 10:43:33,238][123090] Updated weights for policy 1, policy_version 1384665 (0.0010) [2023-12-26 10:43:33,346][123091] Updated weights for policy 0, policy_version 1394227 (0.0005) [2023-12-26 10:43:33,397][123091] Updated weights for policy 0, policy_version 1394237 (0.0005) [2023-12-26 10:43:33,450][123091] Updated weights for policy 0, policy_version 1394247 (0.0005) [2023-12-26 10:43:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 711409664. Throughput: 0: 9008.7, 1: 8896.0. Samples: 711419928. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:33,785][121949] Avg episode reward: [(0, '6373.386'), (1, '5743.138')] [2023-12-26 10:43:33,951][123090] Updated weights for policy 1, policy_version 1384675 (0.0009) [2023-12-26 10:43:34,016][123090] Updated weights for policy 1, policy_version 1384685 (0.0005) [2023-12-26 10:43:34,076][123090] Updated weights for policy 1, policy_version 1384695 (0.0006) [2023-12-26 10:43:34,124][123091] Updated weights for policy 0, policy_version 1394257 (0.0009) [2023-12-26 10:43:34,193][123091] Updated weights for policy 0, policy_version 1394267 (0.0008) [2023-12-26 10:43:34,254][123091] Updated weights for policy 0, policy_version 1394277 (0.0008) [2023-12-26 10:43:34,320][123091] Updated weights for policy 0, policy_version 1394287 (0.0008) [2023-12-26 10:43:34,881][123090] Updated weights for policy 1, policy_version 1384705 (0.0011) [2023-12-26 10:43:34,943][123090] Updated weights for policy 1, policy_version 1384715 (0.0010) [2023-12-26 10:43:35,010][123090] Updated weights for policy 1, policy_version 1384725 (0.0011) [2023-12-26 10:43:35,073][123090] Updated weights for policy 1, policy_version 1384735 (0.0010) [2023-12-26 10:43:35,076][123091] Updated weights for policy 0, policy_version 1394297 (0.0010) [2023-12-26 10:43:35,138][123091] Updated weights for policy 0, policy_version 1394307 (0.0010) [2023-12-26 10:43:35,194][123091] Updated weights for policy 0, policy_version 1394317 (0.0010) [2023-12-26 10:43:35,879][123090] Updated weights for policy 1, policy_version 1384745 (0.0011) [2023-12-26 10:43:35,920][123091] Updated weights for policy 0, policy_version 1394327 (0.0007) [2023-12-26 10:43:35,930][123090] Updated weights for policy 1, policy_version 1384755 (0.0010) [2023-12-26 10:43:35,984][123090] Updated weights for policy 1, policy_version 1384765 (0.0006) [2023-12-26 10:43:35,985][123091] Updated weights for policy 0, policy_version 1394337 (0.0008) [2023-12-26 10:43:36,046][123091] Updated weights for policy 0, policy_version 1394347 (0.0010) [2023-12-26 10:43:36,823][123090] Updated weights for policy 1, policy_version 1384775 (0.0009) [2023-12-26 10:43:36,851][123091] Updated weights for policy 0, policy_version 1394357 (0.0009) [2023-12-26 10:43:36,887][123090] Updated weights for policy 1, policy_version 1384785 (0.0011) [2023-12-26 10:43:36,903][123091] Updated weights for policy 0, policy_version 1394367 (0.0007) [2023-12-26 10:43:36,949][123091] Updated weights for policy 0, policy_version 1394377 (0.0008) [2023-12-26 10:43:36,954][123090] Updated weights for policy 1, policy_version 1384795 (0.0011) [2023-12-26 10:43:37,620][123090] Updated weights for policy 1, policy_version 1384805 (0.0007) [2023-12-26 10:43:37,677][123090] Updated weights for policy 1, policy_version 1384815 (0.0005) [2023-12-26 10:43:37,748][123091] Updated weights for policy 0, policy_version 1394387 (0.0009) [2023-12-26 10:43:37,749][123090] Updated weights for policy 1, policy_version 1384825 (0.0006) [2023-12-26 10:43:37,810][123091] Updated weights for policy 0, policy_version 1394397 (0.0009) [2023-12-26 10:43:37,881][123091] Updated weights for policy 0, policy_version 1394407 (0.0010) [2023-12-26 10:43:38,475][123090] Updated weights for policy 1, policy_version 1384835 (0.0007) [2023-12-26 10:43:38,534][123090] Updated weights for policy 1, policy_version 1384845 (0.0008) [2023-12-26 10:43:38,591][123090] Updated weights for policy 1, policy_version 1384855 (0.0005) [2023-12-26 10:43:38,671][123091] Updated weights for policy 0, policy_version 1394417 (0.0007) [2023-12-26 10:43:38,739][123091] Updated weights for policy 0, policy_version 1394427 (0.0005) [2023-12-26 10:43:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 711499776. Throughput: 0: 9028.7, 1: 8915.9. Samples: 711475332. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:38,785][121949] Avg episode reward: [(0, '6382.772'), (1, '5783.494')] [2023-12-26 10:43:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001384864_354525184.pth... [2023-12-26 10:43:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001383840_354263040.pth [2023-12-26 10:43:38,805][123091] Updated weights for policy 0, policy_version 1394437 (0.0006) [2023-12-26 10:43:38,863][123091] Updated weights for policy 0, policy_version 1394447 (0.0009) [2023-12-26 10:43:38,870][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001394448_356982784.pth... [2023-12-26 10:43:38,875][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001393392_356712448.pth [2023-12-26 10:43:39,412][123090] Updated weights for policy 1, policy_version 1384865 (0.0006) [2023-12-26 10:43:39,487][123090] Updated weights for policy 1, policy_version 1384875 (0.0011) [2023-12-26 10:43:39,548][123090] Updated weights for policy 1, policy_version 1384885 (0.0010) [2023-12-26 10:43:39,616][123090] Updated weights for policy 1, policy_version 1384895 (0.0008) [2023-12-26 10:43:39,666][123091] Updated weights for policy 0, policy_version 1394457 (0.0010) [2023-12-26 10:43:39,726][123091] Updated weights for policy 0, policy_version 1394467 (0.0010) [2023-12-26 10:43:39,786][123091] Updated weights for policy 0, policy_version 1394477 (0.0009) [2023-12-26 10:43:40,497][123090] Updated weights for policy 1, policy_version 1384905 (0.0010) [2023-12-26 10:43:40,549][123091] Updated weights for policy 0, policy_version 1394487 (0.0010) [2023-12-26 10:43:40,561][123090] Updated weights for policy 1, policy_version 1384915 (0.0008) [2023-12-26 10:43:40,603][123091] Updated weights for policy 0, policy_version 1394497 (0.0008) [2023-12-26 10:43:40,616][123090] Updated weights for policy 1, policy_version 1384925 (0.0008) [2023-12-26 10:43:40,660][123091] Updated weights for policy 0, policy_version 1394507 (0.0009) [2023-12-26 10:43:41,481][123090] Updated weights for policy 1, policy_version 1384935 (0.0010) [2023-12-26 10:43:41,528][123091] Updated weights for policy 0, policy_version 1394517 (0.0010) [2023-12-26 10:43:41,539][123090] Updated weights for policy 1, policy_version 1384945 (0.0008) [2023-12-26 10:43:41,583][123091] Updated weights for policy 0, policy_version 1394527 (0.0008) [2023-12-26 10:43:41,597][123090] Updated weights for policy 1, policy_version 1384955 (0.0010) [2023-12-26 10:43:41,645][123091] Updated weights for policy 0, policy_version 1394537 (0.0009) [2023-12-26 10:43:42,505][123091] Updated weights for policy 0, policy_version 1394547 (0.0009) [2023-12-26 10:43:42,507][123090] Updated weights for policy 1, policy_version 1384965 (0.0010) [2023-12-26 10:43:42,561][123091] Updated weights for policy 0, policy_version 1394557 (0.0009) [2023-12-26 10:43:42,572][123090] Updated weights for policy 1, policy_version 1384975 (0.0007) [2023-12-26 10:43:42,624][123091] Updated weights for policy 0, policy_version 1394567 (0.0008) [2023-12-26 10:43:42,644][123090] Updated weights for policy 1, policy_version 1384985 (0.0010) [2023-12-26 10:43:43,420][123090] Updated weights for policy 1, policy_version 1384995 (0.0008) [2023-12-26 10:43:43,457][123091] Updated weights for policy 0, policy_version 1394577 (0.0008) [2023-12-26 10:43:43,481][123090] Updated weights for policy 1, policy_version 1385005 (0.0005) [2023-12-26 10:43:43,514][123091] Updated weights for policy 0, policy_version 1394587 (0.0009) [2023-12-26 10:43:43,546][123090] Updated weights for policy 1, policy_version 1385015 (0.0006) [2023-12-26 10:43:43,569][123091] Updated weights for policy 0, policy_version 1394597 (0.0010) [2023-12-26 10:43:43,622][123091] Updated weights for policy 0, policy_version 1394607 (0.0009) [2023-12-26 10:43:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 711589888. Throughput: 0: 8915.6, 1: 8789.9. Samples: 711578736. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:43,784][121949] Avg episode reward: [(0, '6494.724'), (1, '5836.060')] [2023-12-26 10:43:44,290][123090] Updated weights for policy 1, policy_version 1385025 (0.0006) [2023-12-26 10:43:44,353][123090] Updated weights for policy 1, policy_version 1385036 (0.0010) [2023-12-26 10:43:44,414][123090] Updated weights for policy 1, policy_version 1385046 (0.0010) [2023-12-26 10:43:44,466][123091] Updated weights for policy 0, policy_version 1394617 (0.0007) [2023-12-26 10:43:44,470][123090] Updated weights for policy 1, policy_version 1385056 (0.0010) [2023-12-26 10:43:44,527][123091] Updated weights for policy 0, policy_version 1394627 (0.0009) [2023-12-26 10:43:44,581][123091] Updated weights for policy 0, policy_version 1394637 (0.0009) [2023-12-26 10:43:45,338][123090] Updated weights for policy 1, policy_version 1385066 (0.0009) [2023-12-26 10:43:45,405][123090] Updated weights for policy 1, policy_version 1385076 (0.0009) [2023-12-26 10:43:45,445][123091] Updated weights for policy 0, policy_version 1394647 (0.0010) [2023-12-26 10:43:45,458][123090] Updated weights for policy 1, policy_version 1385086 (0.0009) [2023-12-26 10:43:45,508][123091] Updated weights for policy 0, policy_version 1394657 (0.0009) [2023-12-26 10:43:45,568][123091] Updated weights for policy 0, policy_version 1394667 (0.0010) [2023-12-26 10:43:46,271][123090] Updated weights for policy 1, policy_version 1385096 (0.0010) [2023-12-26 10:43:46,338][123090] Updated weights for policy 1, policy_version 1385106 (0.0010) [2023-12-26 10:43:46,400][123091] Updated weights for policy 0, policy_version 1394677 (0.0008) [2023-12-26 10:43:46,402][123090] Updated weights for policy 1, policy_version 1385116 (0.0008) [2023-12-26 10:43:46,459][123091] Updated weights for policy 0, policy_version 1394687 (0.0009) [2023-12-26 10:43:46,525][123091] Updated weights for policy 0, policy_version 1394697 (0.0009) [2023-12-26 10:43:47,080][123090] Updated weights for policy 1, policy_version 1385126 (0.0006) [2023-12-26 10:43:47,149][123090] Updated weights for policy 1, policy_version 1385136 (0.0005) [2023-12-26 10:43:47,214][123090] Updated weights for policy 1, policy_version 1385146 (0.0007) [2023-12-26 10:43:47,415][123091] Updated weights for policy 0, policy_version 1394707 (0.0010) [2023-12-26 10:43:47,469][123091] Updated weights for policy 0, policy_version 1394717 (0.0010) [2023-12-26 10:43:47,522][123091] Updated weights for policy 0, policy_version 1394727 (0.0009) [2023-12-26 10:43:47,841][123090] Updated weights for policy 1, policy_version 1385156 (0.0006) [2023-12-26 10:43:47,901][123090] Updated weights for policy 1, policy_version 1385166 (0.0006) [2023-12-26 10:43:47,956][123090] Updated weights for policy 1, policy_version 1385176 (0.0010) [2023-12-26 10:43:48,428][123091] Updated weights for policy 0, policy_version 1394737 (0.0010) [2023-12-26 10:43:48,495][123091] Updated weights for policy 0, policy_version 1394747 (0.0009) [2023-12-26 10:43:48,558][123091] Updated weights for policy 0, policy_version 1394757 (0.0010) [2023-12-26 10:43:48,620][123091] Updated weights for policy 0, policy_version 1394767 (0.0009) [2023-12-26 10:43:48,741][123090] Updated weights for policy 1, policy_version 1385186 (0.0010) [2023-12-26 10:43:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 711671808. Throughput: 0: 8879.4, 1: 8832.2. Samples: 711683784. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:48,785][121949] Avg episode reward: [(0, '6482.482'), (1, '5803.188')] [2023-12-26 10:43:48,797][123090] Updated weights for policy 1, policy_version 1385196 (0.0009) [2023-12-26 10:43:48,867][123090] Updated weights for policy 1, policy_version 1385206 (0.0009) [2023-12-26 10:43:48,927][123090] Updated weights for policy 1, policy_version 1385216 (0.0009) [2023-12-26 10:43:49,483][123091] Updated weights for policy 0, policy_version 1394777 (0.0010) [2023-12-26 10:43:49,548][123091] Updated weights for policy 0, policy_version 1394787 (0.0009) [2023-12-26 10:43:49,605][123091] Updated weights for policy 0, policy_version 1394797 (0.0009) [2023-12-26 10:43:49,806][123090] Updated weights for policy 1, policy_version 1385226 (0.0009) [2023-12-26 10:43:49,878][123090] Updated weights for policy 1, policy_version 1385236 (0.0009) [2023-12-26 10:43:49,949][123090] Updated weights for policy 1, policy_version 1385246 (0.0007) [2023-12-26 10:43:50,452][123091] Updated weights for policy 0, policy_version 1394807 (0.0010) [2023-12-26 10:43:50,513][123091] Updated weights for policy 0, policy_version 1394817 (0.0009) [2023-12-26 10:43:50,575][123091] Updated weights for policy 0, policy_version 1394827 (0.0010) [2023-12-26 10:43:50,693][123090] Updated weights for policy 1, policy_version 1385256 (0.0009) [2023-12-26 10:43:50,753][123090] Updated weights for policy 1, policy_version 1385266 (0.0006) [2023-12-26 10:43:50,817][123090] Updated weights for policy 1, policy_version 1385276 (0.0009) [2023-12-26 10:43:51,451][123091] Updated weights for policy 0, policy_version 1394837 (0.0009) [2023-12-26 10:43:51,515][123091] Updated weights for policy 0, policy_version 1394847 (0.0009) [2023-12-26 10:43:51,576][123091] Updated weights for policy 0, policy_version 1394857 (0.0009) [2023-12-26 10:43:51,690][123090] Updated weights for policy 1, policy_version 1385286 (0.0011) [2023-12-26 10:43:51,759][123090] Updated weights for policy 1, policy_version 1385296 (0.0010) [2023-12-26 10:43:51,830][123090] Updated weights for policy 1, policy_version 1385306 (0.0011) [2023-12-26 10:43:52,440][123091] Updated weights for policy 0, policy_version 1394867 (0.0009) [2023-12-26 10:43:52,504][123091] Updated weights for policy 0, policy_version 1394877 (0.0010) [2023-12-26 10:43:52,567][123091] Updated weights for policy 0, policy_version 1394887 (0.0009) [2023-12-26 10:43:52,633][123090] Updated weights for policy 1, policy_version 1385316 (0.0010) [2023-12-26 10:43:52,696][123090] Updated weights for policy 1, policy_version 1385326 (0.0010) [2023-12-26 10:43:52,751][123090] Updated weights for policy 1, policy_version 1385336 (0.0009) [2023-12-26 10:43:53,437][123091] Updated weights for policy 0, policy_version 1394897 (0.0010) [2023-12-26 10:43:53,443][123090] Updated weights for policy 1, policy_version 1385346 (0.0008) [2023-12-26 10:43:53,487][123091] Updated weights for policy 0, policy_version 1394907 (0.0006) [2023-12-26 10:43:53,493][123090] Updated weights for policy 1, policy_version 1385356 (0.0008) [2023-12-26 10:43:53,536][123091] Updated weights for policy 0, policy_version 1394917 (0.0008) [2023-12-26 10:43:53,542][123090] Updated weights for policy 1, policy_version 1385366 (0.0008) [2023-12-26 10:43:53,583][123091] Updated weights for policy 0, policy_version 1394927 (0.0005) [2023-12-26 10:43:53,592][123090] Updated weights for policy 1, policy_version 1385376 (0.0008) [2023-12-26 10:43:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 711761920. Throughput: 0: 8811.8, 1: 8805.8. Samples: 711734440. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:53,785][121949] Avg episode reward: [(0, '6479.857'), (1, '5878.083')] [2023-12-26 10:43:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001394928_357105664.pth... [2023-12-26 10:43:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001385376_354656256.pth... [2023-12-26 10:43:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001393872_356835328.pth [2023-12-26 10:43:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001384352_354394112.pth [2023-12-26 10:43:54,299][123090] Updated weights for policy 1, policy_version 1385386 (0.0008) [2023-12-26 10:43:54,346][123090] Updated weights for policy 1, policy_version 1385396 (0.0010) [2023-12-26 10:43:54,394][123090] Updated weights for policy 1, policy_version 1385406 (0.0010) [2023-12-26 10:43:54,507][123091] Updated weights for policy 0, policy_version 1394937 (0.0009) [2023-12-26 10:43:54,561][123091] Updated weights for policy 0, policy_version 1394947 (0.0010) [2023-12-26 10:43:54,615][123091] Updated weights for policy 0, policy_version 1394958 (0.0009) [2023-12-26 10:43:55,061][123090] Updated weights for policy 1, policy_version 1385416 (0.0009) [2023-12-26 10:43:55,124][123090] Updated weights for policy 1, policy_version 1385426 (0.0009) [2023-12-26 10:43:55,184][123090] Updated weights for policy 1, policy_version 1385436 (0.0009) [2023-12-26 10:43:55,490][123091] Updated weights for policy 0, policy_version 1394968 (0.0010) [2023-12-26 10:43:55,546][123091] Updated weights for policy 0, policy_version 1394978 (0.0009) [2023-12-26 10:43:55,607][123091] Updated weights for policy 0, policy_version 1394988 (0.0009) [2023-12-26 10:43:55,984][123090] Updated weights for policy 1, policy_version 1385447 (0.0010) [2023-12-26 10:43:56,029][123090] Updated weights for policy 1, policy_version 1385457 (0.0006) [2023-12-26 10:43:56,076][123090] Updated weights for policy 1, policy_version 1385467 (0.0006) [2023-12-26 10:43:56,511][123091] Updated weights for policy 0, policy_version 1394998 (0.0009) [2023-12-26 10:43:56,564][123091] Updated weights for policy 0, policy_version 1395008 (0.0010) [2023-12-26 10:43:56,617][123091] Updated weights for policy 0, policy_version 1395019 (0.0010) [2023-12-26 10:43:56,815][123090] Updated weights for policy 1, policy_version 1385477 (0.0007) [2023-12-26 10:43:56,862][123090] Updated weights for policy 1, policy_version 1385487 (0.0009) [2023-12-26 10:43:56,917][123090] Updated weights for policy 1, policy_version 1385497 (0.0006) [2023-12-26 10:43:57,464][123091] Updated weights for policy 0, policy_version 1395030 (0.0007) [2023-12-26 10:43:57,522][123091] Updated weights for policy 0, policy_version 1395040 (0.0005) [2023-12-26 10:43:57,582][123091] Updated weights for policy 0, policy_version 1395050 (0.0008) [2023-12-26 10:43:57,715][123090] Updated weights for policy 1, policy_version 1385507 (0.0008) [2023-12-26 10:43:57,768][123090] Updated weights for policy 1, policy_version 1385517 (0.0006) [2023-12-26 10:43:57,829][123090] Updated weights for policy 1, policy_version 1385527 (0.0006) [2023-12-26 10:43:58,195][123091] Updated weights for policy 0, policy_version 1395060 (0.0008) [2023-12-26 10:43:58,255][123091] Updated weights for policy 0, policy_version 1395070 (0.0009) [2023-12-26 10:43:58,328][123091] Updated weights for policy 0, policy_version 1395080 (0.0007) [2023-12-26 10:43:58,572][123090] Updated weights for policy 1, policy_version 1385537 (0.0005) [2023-12-26 10:43:58,643][123090] Updated weights for policy 1, policy_version 1385547 (0.0006) [2023-12-26 10:43:58,714][123090] Updated weights for policy 1, policy_version 1385557 (0.0007) [2023-12-26 10:43:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 711843840. Throughput: 0: 8777.7, 1: 8851.8. Samples: 711841112. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:43:58,785][121949] Avg episode reward: [(0, '6406.753'), (1, '5875.507')] [2023-12-26 10:43:58,791][123090] Updated weights for policy 1, policy_version 1385567 (0.0007) [2023-12-26 10:43:59,170][123091] Updated weights for policy 0, policy_version 1395090 (0.0008) [2023-12-26 10:43:59,242][123091] Updated weights for policy 0, policy_version 1395100 (0.0008) [2023-12-26 10:43:59,310][123091] Updated weights for policy 0, policy_version 1395110 (0.0007) [2023-12-26 10:43:59,377][123091] Updated weights for policy 0, policy_version 1395120 (0.0011) [2023-12-26 10:43:59,495][123090] Updated weights for policy 1, policy_version 1385577 (0.0005) [2023-12-26 10:43:59,564][123090] Updated weights for policy 1, policy_version 1385587 (0.0010) [2023-12-26 10:43:59,627][123090] Updated weights for policy 1, policy_version 1385597 (0.0009) [2023-12-26 10:44:00,055][123091] Updated weights for policy 0, policy_version 1395130 (0.0010) [2023-12-26 10:44:00,118][123091] Updated weights for policy 0, policy_version 1395140 (0.0010) [2023-12-26 10:44:00,175][123091] Updated weights for policy 0, policy_version 1395150 (0.0009) [2023-12-26 10:44:00,382][123090] Updated weights for policy 1, policy_version 1385607 (0.0005) [2023-12-26 10:44:00,453][123090] Updated weights for policy 1, policy_version 1385617 (0.0005) [2023-12-26 10:44:00,524][123090] Updated weights for policy 1, policy_version 1385627 (0.0005) [2023-12-26 10:44:00,865][123091] Updated weights for policy 0, policy_version 1395160 (0.0006) [2023-12-26 10:44:00,912][123091] Updated weights for policy 0, policy_version 1395170 (0.0005) [2023-12-26 10:44:00,961][123091] Updated weights for policy 0, policy_version 1395180 (0.0007) [2023-12-26 10:44:01,286][123090] Updated weights for policy 1, policy_version 1385637 (0.0007) [2023-12-26 10:44:01,343][123090] Updated weights for policy 1, policy_version 1385647 (0.0009) [2023-12-26 10:44:01,410][123090] Updated weights for policy 1, policy_version 1385657 (0.0010) [2023-12-26 10:44:01,741][123091] Updated weights for policy 0, policy_version 1395190 (0.0008) [2023-12-26 10:44:01,801][123091] Updated weights for policy 0, policy_version 1395200 (0.0010) [2023-12-26 10:44:01,864][123091] Updated weights for policy 0, policy_version 1395210 (0.0009) [2023-12-26 10:44:02,266][123090] Updated weights for policy 1, policy_version 1385667 (0.0009) [2023-12-26 10:44:02,328][123090] Updated weights for policy 1, policy_version 1385677 (0.0009) [2023-12-26 10:44:02,393][123090] Updated weights for policy 1, policy_version 1385687 (0.0010) [2023-12-26 10:44:02,709][123091] Updated weights for policy 0, policy_version 1395220 (0.0009) [2023-12-26 10:44:02,770][123091] Updated weights for policy 0, policy_version 1395230 (0.0009) [2023-12-26 10:44:02,836][123091] Updated weights for policy 0, policy_version 1395240 (0.0010) [2023-12-26 10:44:03,218][123090] Updated weights for policy 1, policy_version 1385697 (0.0009) [2023-12-26 10:44:03,280][123090] Updated weights for policy 1, policy_version 1385707 (0.0010) [2023-12-26 10:44:03,345][123090] Updated weights for policy 1, policy_version 1385717 (0.0010) [2023-12-26 10:44:03,408][123090] Updated weights for policy 1, policy_version 1385727 (0.0010) [2023-12-26 10:44:03,487][123091] Updated weights for policy 0, policy_version 1395250 (0.0008) [2023-12-26 10:44:03,535][123091] Updated weights for policy 0, policy_version 1395260 (0.0005) [2023-12-26 10:44:03,581][123091] Updated weights for policy 0, policy_version 1395270 (0.0005) [2023-12-26 10:44:03,627][123091] Updated weights for policy 0, policy_version 1395280 (0.0005) [2023-12-26 10:44:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 711942144. Throughput: 0: 8832.3, 1: 8797.2. Samples: 711950808. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:03,785][121949] Avg episode reward: [(0, '6306.225'), (1, '5802.096')] [2023-12-26 10:44:04,168][123090] Updated weights for policy 1, policy_version 1385737 (0.0011) [2023-12-26 10:44:04,224][123090] Updated weights for policy 1, policy_version 1385747 (0.0010) [2023-12-26 10:44:04,284][123090] Updated weights for policy 1, policy_version 1385757 (0.0011) [2023-12-26 10:44:04,320][123091] Updated weights for policy 0, policy_version 1395290 (0.0006) [2023-12-26 10:44:04,391][123091] Updated weights for policy 0, policy_version 1395300 (0.0005) [2023-12-26 10:44:04,467][123091] Updated weights for policy 0, policy_version 1395310 (0.0009) [2023-12-26 10:44:05,032][123090] Updated weights for policy 1, policy_version 1385767 (0.0007) [2023-12-26 10:44:05,083][123090] Updated weights for policy 1, policy_version 1385777 (0.0005) [2023-12-26 10:44:05,131][123090] Updated weights for policy 1, policy_version 1385787 (0.0005) [2023-12-26 10:44:05,225][123091] Updated weights for policy 0, policy_version 1395320 (0.0006) [2023-12-26 10:44:05,290][123091] Updated weights for policy 0, policy_version 1395330 (0.0005) [2023-12-26 10:44:05,363][123091] Updated weights for policy 0, policy_version 1395340 (0.0005) [2023-12-26 10:44:05,935][123090] Updated weights for policy 1, policy_version 1385797 (0.0008) [2023-12-26 10:44:05,982][123090] Updated weights for policy 1, policy_version 1385807 (0.0010) [2023-12-26 10:44:06,038][123090] Updated weights for policy 1, policy_version 1385817 (0.0010) [2023-12-26 10:44:06,127][123091] Updated weights for policy 0, policy_version 1395350 (0.0009) [2023-12-26 10:44:06,190][123091] Updated weights for policy 0, policy_version 1395360 (0.0011) [2023-12-26 10:44:06,254][123091] Updated weights for policy 0, policy_version 1395370 (0.0011) [2023-12-26 10:44:06,763][123090] Updated weights for policy 1, policy_version 1385827 (0.0009) [2023-12-26 10:44:06,835][123090] Updated weights for policy 1, policy_version 1385837 (0.0005) [2023-12-26 10:44:06,898][123090] Updated weights for policy 1, policy_version 1385847 (0.0005) [2023-12-26 10:44:07,085][123091] Updated weights for policy 0, policy_version 1395380 (0.0011) [2023-12-26 10:44:07,144][123091] Updated weights for policy 0, policy_version 1395390 (0.0011) [2023-12-26 10:44:07,210][123091] Updated weights for policy 0, policy_version 1395400 (0.0011) [2023-12-26 10:44:07,530][123090] Updated weights for policy 1, policy_version 1385857 (0.0005) [2023-12-26 10:44:07,593][123090] Updated weights for policy 1, policy_version 1385867 (0.0010) [2023-12-26 10:44:07,649][123090] Updated weights for policy 1, policy_version 1385877 (0.0010) [2023-12-26 10:44:07,706][123090] Updated weights for policy 1, policy_version 1385887 (0.0010) [2023-12-26 10:44:08,021][123091] Updated weights for policy 0, policy_version 1395410 (0.0011) [2023-12-26 10:44:08,091][123091] Updated weights for policy 0, policy_version 1395420 (0.0011) [2023-12-26 10:44:08,157][123091] Updated weights for policy 0, policy_version 1395430 (0.0011) [2023-12-26 10:44:08,223][123091] Updated weights for policy 0, policy_version 1395440 (0.0011) [2023-12-26 10:44:08,386][123090] Updated weights for policy 1, policy_version 1385897 (0.0008) [2023-12-26 10:44:08,455][123090] Updated weights for policy 1, policy_version 1385907 (0.0006) [2023-12-26 10:44:08,516][123090] Updated weights for policy 1, policy_version 1385917 (0.0009) [2023-12-26 10:44:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 712032256. Throughput: 0: 8909.0, 1: 8844.9. Samples: 712007120. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:08,785][121949] Avg episode reward: [(0, '6360.310'), (1, '5767.150')] [2023-12-26 10:44:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001385920_354795520.pth... [2023-12-26 10:44:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001395440_357236736.pth... [2023-12-26 10:44:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001384864_354525184.pth [2023-12-26 10:44:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001394448_356982784.pth [2023-12-26 10:44:08,924][123091] Updated weights for policy 0, policy_version 1395450 (0.0005) [2023-12-26 10:44:08,970][123091] Updated weights for policy 0, policy_version 1395460 (0.0005) [2023-12-26 10:44:09,023][123091] Updated weights for policy 0, policy_version 1395470 (0.0005) [2023-12-26 10:44:09,320][123090] Updated weights for policy 1, policy_version 1385927 (0.0009) [2023-12-26 10:44:09,392][123090] Updated weights for policy 1, policy_version 1385937 (0.0008) [2023-12-26 10:44:09,461][123090] Updated weights for policy 1, policy_version 1385947 (0.0009) [2023-12-26 10:44:09,851][123091] Updated weights for policy 0, policy_version 1395480 (0.0009) [2023-12-26 10:44:09,907][123091] Updated weights for policy 0, policy_version 1395490 (0.0010) [2023-12-26 10:44:09,981][123091] Updated weights for policy 0, policy_version 1395500 (0.0009) [2023-12-26 10:44:10,274][123090] Updated weights for policy 1, policy_version 1385957 (0.0008) [2023-12-26 10:44:10,345][123090] Updated weights for policy 1, policy_version 1385967 (0.0009) [2023-12-26 10:44:10,406][123090] Updated weights for policy 1, policy_version 1385977 (0.0008) [2023-12-26 10:44:10,734][123091] Updated weights for policy 0, policy_version 1395510 (0.0009) [2023-12-26 10:44:10,797][123091] Updated weights for policy 0, policy_version 1395520 (0.0011) [2023-12-26 10:44:10,859][123091] Updated weights for policy 0, policy_version 1395530 (0.0008) [2023-12-26 10:44:11,186][123090] Updated weights for policy 1, policy_version 1385987 (0.0010) [2023-12-26 10:44:11,257][123090] Updated weights for policy 1, policy_version 1385997 (0.0010) [2023-12-26 10:44:11,319][123090] Updated weights for policy 1, policy_version 1386007 (0.0011) [2023-12-26 10:44:11,734][123091] Updated weights for policy 0, policy_version 1395540 (0.0010) [2023-12-26 10:44:11,799][123091] Updated weights for policy 0, policy_version 1395550 (0.0009) [2023-12-26 10:44:11,860][123091] Updated weights for policy 0, policy_version 1395560 (0.0008) [2023-12-26 10:44:12,188][123090] Updated weights for policy 1, policy_version 1386017 (0.0010) [2023-12-26 10:44:12,243][123090] Updated weights for policy 1, policy_version 1386027 (0.0010) [2023-12-26 10:44:12,306][123090] Updated weights for policy 1, policy_version 1386037 (0.0010) [2023-12-26 10:44:12,387][123090] Updated weights for policy 1, policy_version 1386047 (0.0011) [2023-12-26 10:44:12,626][123091] Updated weights for policy 0, policy_version 1395570 (0.0008) [2023-12-26 10:44:12,682][123091] Updated weights for policy 0, policy_version 1395580 (0.0009) [2023-12-26 10:44:12,746][123091] Updated weights for policy 0, policy_version 1395590 (0.0009) [2023-12-26 10:44:12,804][123091] Updated weights for policy 0, policy_version 1395600 (0.0010) [2023-12-26 10:44:13,161][123090] Updated weights for policy 1, policy_version 1386057 (0.0009) [2023-12-26 10:44:13,213][123090] Updated weights for policy 1, policy_version 1386067 (0.0009) [2023-12-26 10:44:13,269][123090] Updated weights for policy 1, policy_version 1386078 (0.0010) [2023-12-26 10:44:13,684][123091] Updated weights for policy 0, policy_version 1395610 (0.0009) [2023-12-26 10:44:13,742][123091] Updated weights for policy 0, policy_version 1395620 (0.0010) [2023-12-26 10:44:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 712114176. Throughput: 0: 8835.0, 1: 8948.4. Samples: 712113600. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:13,784][121949] Avg episode reward: [(0, '6358.603'), (1, '5733.228')] [2023-12-26 10:44:13,809][123091] Updated weights for policy 0, policy_version 1395630 (0.0009) [2023-12-26 10:44:14,074][123090] Updated weights for policy 1, policy_version 1386088 (0.0009) [2023-12-26 10:44:14,128][123090] Updated weights for policy 1, policy_version 1386098 (0.0011) [2023-12-26 10:44:14,187][123090] Updated weights for policy 1, policy_version 1386108 (0.0010) [2023-12-26 10:44:14,661][123091] Updated weights for policy 0, policy_version 1395640 (0.0009) [2023-12-26 10:44:14,720][123091] Updated weights for policy 0, policy_version 1395650 (0.0009) [2023-12-26 10:44:14,785][123091] Updated weights for policy 0, policy_version 1395660 (0.0009) [2023-12-26 10:44:14,962][123090] Updated weights for policy 1, policy_version 1386118 (0.0009) [2023-12-26 10:44:15,029][123090] Updated weights for policy 1, policy_version 1386128 (0.0011) [2023-12-26 10:44:15,093][123090] Updated weights for policy 1, policy_version 1386138 (0.0011) [2023-12-26 10:44:15,638][123091] Updated weights for policy 0, policy_version 1395670 (0.0008) [2023-12-26 10:44:15,694][123091] Updated weights for policy 0, policy_version 1395680 (0.0011) [2023-12-26 10:44:15,756][123091] Updated weights for policy 0, policy_version 1395690 (0.0010) [2023-12-26 10:44:15,835][123090] Updated weights for policy 1, policy_version 1386148 (0.0009) [2023-12-26 10:44:15,900][123090] Updated weights for policy 1, policy_version 1386158 (0.0005) [2023-12-26 10:44:15,969][123090] Updated weights for policy 1, policy_version 1386168 (0.0005) [2023-12-26 10:44:16,593][123091] Updated weights for policy 0, policy_version 1395700 (0.0009) [2023-12-26 10:44:16,651][123091] Updated weights for policy 0, policy_version 1395711 (0.0009) [2023-12-26 10:44:16,727][123091] Updated weights for policy 0, policy_version 1395721 (0.0006) [2023-12-26 10:44:16,787][123090] Updated weights for policy 1, policy_version 1386178 (0.0008) [2023-12-26 10:44:16,844][123090] Updated weights for policy 1, policy_version 1386188 (0.0010) [2023-12-26 10:44:16,903][123090] Updated weights for policy 1, policy_version 1386198 (0.0008) [2023-12-26 10:44:16,957][123090] Updated weights for policy 1, policy_version 1386208 (0.0009) [2023-12-26 10:44:17,523][123091] Updated weights for policy 0, policy_version 1395731 (0.0006) [2023-12-26 10:44:17,577][123091] Updated weights for policy 0, policy_version 1395741 (0.0007) [2023-12-26 10:44:17,630][123091] Updated weights for policy 0, policy_version 1395751 (0.0008) [2023-12-26 10:44:17,651][123090] Updated weights for policy 1, policy_version 1386218 (0.0009) [2023-12-26 10:44:17,701][123090] Updated weights for policy 1, policy_version 1386228 (0.0009) [2023-12-26 10:44:17,756][123090] Updated weights for policy 1, policy_version 1386238 (0.0010) [2023-12-26 10:44:18,359][123091] Updated weights for policy 0, policy_version 1395761 (0.0006) [2023-12-26 10:44:18,427][123091] Updated weights for policy 0, policy_version 1395771 (0.0010) [2023-12-26 10:44:18,485][123091] Updated weights for policy 0, policy_version 1395781 (0.0010) [2023-12-26 10:44:18,552][123091] Updated weights for policy 0, policy_version 1395791 (0.0010) [2023-12-26 10:44:18,613][123090] Updated weights for policy 1, policy_version 1386248 (0.0007) [2023-12-26 10:44:18,689][123090] Updated weights for policy 1, policy_version 1386258 (0.0006) [2023-12-26 10:44:18,760][123090] Updated weights for policy 1, policy_version 1386268 (0.0006) [2023-12-26 10:44:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 712204288. Throughput: 0: 8738.6, 1: 9003.5. Samples: 712218320. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:18,785][121949] Avg episode reward: [(0, '6433.433'), (1, '5825.110')] [2023-12-26 10:44:19,397][123090] Updated weights for policy 1, policy_version 1386278 (0.0006) [2023-12-26 10:44:19,445][123091] Updated weights for policy 0, policy_version 1395801 (0.0008) [2023-12-26 10:44:19,459][123090] Updated weights for policy 1, policy_version 1386288 (0.0009) [2023-12-26 10:44:19,517][123091] Updated weights for policy 0, policy_version 1395811 (0.0008) [2023-12-26 10:44:19,532][123090] Updated weights for policy 1, policy_version 1386298 (0.0008) [2023-12-26 10:44:19,583][123091] Updated weights for policy 0, policy_version 1395821 (0.0006) [2023-12-26 10:44:20,344][123091] Updated weights for policy 0, policy_version 1395831 (0.0008) [2023-12-26 10:44:20,399][123090] Updated weights for policy 1, policy_version 1386308 (0.0007) [2023-12-26 10:44:20,411][123091] Updated weights for policy 0, policy_version 1395841 (0.0009) [2023-12-26 10:44:20,458][123090] Updated weights for policy 1, policy_version 1386318 (0.0009) [2023-12-26 10:44:20,480][123091] Updated weights for policy 0, policy_version 1395851 (0.0008) [2023-12-26 10:44:20,524][123090] Updated weights for policy 1, policy_version 1386328 (0.0009) [2023-12-26 10:44:21,314][123091] Updated weights for policy 0, policy_version 1395861 (0.0009) [2023-12-26 10:44:21,386][123091] Updated weights for policy 0, policy_version 1395871 (0.0010) [2023-12-26 10:44:21,387][123090] Updated weights for policy 1, policy_version 1386338 (0.0009) [2023-12-26 10:44:21,440][123091] Updated weights for policy 0, policy_version 1395881 (0.0009) [2023-12-26 10:44:21,458][123090] Updated weights for policy 1, policy_version 1386348 (0.0005) [2023-12-26 10:44:21,528][123090] Updated weights for policy 1, policy_version 1386358 (0.0008) [2023-12-26 10:44:21,598][123090] Updated weights for policy 1, policy_version 1386368 (0.0009) [2023-12-26 10:44:22,290][123091] Updated weights for policy 0, policy_version 1395891 (0.0009) [2023-12-26 10:44:22,345][123091] Updated weights for policy 0, policy_version 1395901 (0.0009) [2023-12-26 10:44:22,415][123091] Updated weights for policy 0, policy_version 1395911 (0.0007) [2023-12-26 10:44:22,490][123090] Updated weights for policy 1, policy_version 1386378 (0.0008) [2023-12-26 10:44:22,557][123090] Updated weights for policy 1, policy_version 1386388 (0.0010) [2023-12-26 10:44:22,619][123090] Updated weights for policy 1, policy_version 1386398 (0.0009) [2023-12-26 10:44:23,255][123091] Updated weights for policy 0, policy_version 1395921 (0.0006) [2023-12-26 10:44:23,309][123091] Updated weights for policy 0, policy_version 1395931 (0.0009) [2023-12-26 10:44:23,328][123090] Updated weights for policy 1, policy_version 1386408 (0.0008) [2023-12-26 10:44:23,359][123091] Updated weights for policy 0, policy_version 1395941 (0.0010) [2023-12-26 10:44:23,390][123090] Updated weights for policy 1, policy_version 1386418 (0.0009) [2023-12-26 10:44:23,420][123091] Updated weights for policy 0, policy_version 1395951 (0.0009) [2023-12-26 10:44:23,455][123090] Updated weights for policy 1, policy_version 1386428 (0.0009) [2023-12-26 10:44:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 712294400. Throughput: 0: 8664.0, 1: 8989.6. Samples: 712269744. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:23,785][121949] Avg episode reward: [(0, '6390.427'), (1, '5846.318')] [2023-12-26 10:44:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001395952_357367808.pth... [2023-12-26 10:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001386432_354926592.pth... [2023-12-26 10:44:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001394928_357105664.pth [2023-12-26 10:44:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001385376_354656256.pth [2023-12-26 10:44:24,183][123090] Updated weights for policy 1, policy_version 1386438 (0.0010) [2023-12-26 10:44:24,239][123090] Updated weights for policy 1, policy_version 1386448 (0.0009) [2023-12-26 10:44:24,289][123090] Updated weights for policy 1, policy_version 1386458 (0.0005) [2023-12-26 10:44:24,298][123091] Updated weights for policy 0, policy_version 1395961 (0.0009) [2023-12-26 10:44:24,353][123091] Updated weights for policy 0, policy_version 1395971 (0.0009) [2023-12-26 10:44:24,405][123091] Updated weights for policy 0, policy_version 1395981 (0.0010) [2023-12-26 10:44:24,940][123090] Updated weights for policy 1, policy_version 1386468 (0.0005) [2023-12-26 10:44:24,986][123090] Updated weights for policy 1, policy_version 1386478 (0.0005) [2023-12-26 10:44:25,032][123090] Updated weights for policy 1, policy_version 1386488 (0.0005) [2023-12-26 10:44:25,373][123091] Updated weights for policy 0, policy_version 1395992 (0.0007) [2023-12-26 10:44:25,436][123091] Updated weights for policy 0, policy_version 1396002 (0.0005) [2023-12-26 10:44:25,488][123091] Updated weights for policy 0, policy_version 1396012 (0.0005) [2023-12-26 10:44:25,729][123090] Updated weights for policy 1, policy_version 1386498 (0.0006) [2023-12-26 10:44:25,777][123090] Updated weights for policy 1, policy_version 1386508 (0.0006) [2023-12-26 10:44:25,838][123090] Updated weights for policy 1, policy_version 1386518 (0.0008) [2023-12-26 10:44:25,900][123090] Updated weights for policy 1, policy_version 1386528 (0.0009) [2023-12-26 10:44:26,238][123091] Updated weights for policy 0, policy_version 1396022 (0.0005) [2023-12-26 10:44:26,283][123091] Updated weights for policy 0, policy_version 1396032 (0.0005) [2023-12-26 10:44:26,330][123091] Updated weights for policy 0, policy_version 1396042 (0.0005) [2023-12-26 10:44:26,590][123090] Updated weights for policy 1, policy_version 1386539 (0.0009) [2023-12-26 10:44:26,651][123090] Updated weights for policy 1, policy_version 1386549 (0.0008) [2023-12-26 10:44:26,712][123090] Updated weights for policy 1, policy_version 1386559 (0.0006) [2023-12-26 10:44:27,116][123091] Updated weights for policy 0, policy_version 1396052 (0.0007) [2023-12-26 10:44:27,169][123091] Updated weights for policy 0, policy_version 1396062 (0.0010) [2023-12-26 10:44:27,222][123091] Updated weights for policy 0, policy_version 1396072 (0.0009) [2023-12-26 10:44:27,430][123090] Updated weights for policy 1, policy_version 1386569 (0.0005) [2023-12-26 10:44:27,478][123090] Updated weights for policy 1, policy_version 1386579 (0.0005) [2023-12-26 10:44:27,533][123090] Updated weights for policy 1, policy_version 1386589 (0.0005) [2023-12-26 10:44:27,937][123091] Updated weights for policy 0, policy_version 1396082 (0.0009) [2023-12-26 10:44:28,001][123091] Updated weights for policy 0, policy_version 1396092 (0.0006) [2023-12-26 10:44:28,065][123091] Updated weights for policy 0, policy_version 1396102 (0.0009) [2023-12-26 10:44:28,134][123091] Updated weights for policy 0, policy_version 1396112 (0.0010) [2023-12-26 10:44:28,164][123090] Updated weights for policy 1, policy_version 1386599 (0.0006) [2023-12-26 10:44:28,221][123090] Updated weights for policy 1, policy_version 1386609 (0.0005) [2023-12-26 10:44:28,264][123090] Updated weights for policy 1, policy_version 1386619 (0.0005) [2023-12-26 10:44:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 712384512. Throughput: 0: 8655.6, 1: 9141.5. Samples: 712379608. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:28,785][121949] Avg episode reward: [(0, '6286.161'), (1, '5773.868')] [2023-12-26 10:44:28,937][123091] Updated weights for policy 0, policy_version 1396122 (0.0009) [2023-12-26 10:44:28,988][123091] Updated weights for policy 0, policy_version 1396132 (0.0009) [2023-12-26 10:44:29,037][123091] Updated weights for policy 0, policy_version 1396142 (0.0006) [2023-12-26 10:44:29,059][123090] Updated weights for policy 1, policy_version 1386629 (0.0007) [2023-12-26 10:44:29,113][123090] Updated weights for policy 1, policy_version 1386639 (0.0007) [2023-12-26 10:44:29,181][123090] Updated weights for policy 1, policy_version 1386649 (0.0005) [2023-12-26 10:44:29,852][123091] Updated weights for policy 0, policy_version 1396152 (0.0007) [2023-12-26 10:44:29,862][123090] Updated weights for policy 1, policy_version 1386659 (0.0007) [2023-12-26 10:44:29,912][123091] Updated weights for policy 0, policy_version 1396162 (0.0008) [2023-12-26 10:44:29,931][123090] Updated weights for policy 1, policy_version 1386669 (0.0007) [2023-12-26 10:44:29,975][123091] Updated weights for policy 0, policy_version 1396172 (0.0009) [2023-12-26 10:44:30,003][123090] Updated weights for policy 1, policy_version 1386679 (0.0007) [2023-12-26 10:44:30,715][123090] Updated weights for policy 1, policy_version 1386689 (0.0005) [2023-12-26 10:44:30,737][123091] Updated weights for policy 0, policy_version 1396182 (0.0007) [2023-12-26 10:44:30,788][123090] Updated weights for policy 1, policy_version 1386699 (0.0005) [2023-12-26 10:44:30,790][123091] Updated weights for policy 0, policy_version 1396192 (0.0006) [2023-12-26 10:44:30,838][123091] Updated weights for policy 0, policy_version 1396202 (0.0007) [2023-12-26 10:44:30,850][123090] Updated weights for policy 1, policy_version 1386709 (0.0005) [2023-12-26 10:44:30,911][123090] Updated weights for policy 1, policy_version 1386719 (0.0005) [2023-12-26 10:44:31,603][123091] Updated weights for policy 0, policy_version 1396212 (0.0007) [2023-12-26 10:44:31,635][123090] Updated weights for policy 1, policy_version 1386729 (0.0007) [2023-12-26 10:44:31,669][123091] Updated weights for policy 0, policy_version 1396222 (0.0007) [2023-12-26 10:44:31,695][123090] Updated weights for policy 1, policy_version 1386739 (0.0006) [2023-12-26 10:44:31,734][123091] Updated weights for policy 0, policy_version 1396232 (0.0006) [2023-12-26 10:44:31,764][123090] Updated weights for policy 1, policy_version 1386749 (0.0009) [2023-12-26 10:44:32,420][123091] Updated weights for policy 0, policy_version 1396242 (0.0007) [2023-12-26 10:44:32,480][123091] Updated weights for policy 0, policy_version 1396252 (0.0006) [2023-12-26 10:44:32,543][123091] Updated weights for policy 0, policy_version 1396262 (0.0008) [2023-12-26 10:44:32,613][123091] Updated weights for policy 0, policy_version 1396272 (0.0008) [2023-12-26 10:44:32,636][123090] Updated weights for policy 1, policy_version 1386759 (0.0009) [2023-12-26 10:44:32,699][123090] Updated weights for policy 1, policy_version 1386769 (0.0008) [2023-12-26 10:44:32,762][123090] Updated weights for policy 1, policy_version 1386779 (0.0009) [2023-12-26 10:44:33,384][123091] Updated weights for policy 0, policy_version 1396282 (0.0006) [2023-12-26 10:44:33,454][123091] Updated weights for policy 0, policy_version 1396292 (0.0006) [2023-12-26 10:44:33,519][123091] Updated weights for policy 0, policy_version 1396302 (0.0005) [2023-12-26 10:44:33,549][123090] Updated weights for policy 1, policy_version 1386789 (0.0007) [2023-12-26 10:44:33,606][123090] Updated weights for policy 1, policy_version 1386799 (0.0006) [2023-12-26 10:44:33,674][123090] Updated weights for policy 1, policy_version 1386809 (0.0005) [2023-12-26 10:44:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 712482816. Throughput: 0: 8770.5, 1: 9171.8. Samples: 712491188. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:33,785][121949] Avg episode reward: [(0, '6310.386'), (1, '5588.851')] [2023-12-26 10:44:34,270][123091] Updated weights for policy 0, policy_version 1396312 (0.0010) [2023-12-26 10:44:34,319][123090] Updated weights for policy 1, policy_version 1386819 (0.0006) [2023-12-26 10:44:34,330][123091] Updated weights for policy 0, policy_version 1396322 (0.0010) [2023-12-26 10:44:34,380][123090] Updated weights for policy 1, policy_version 1386829 (0.0006) [2023-12-26 10:44:34,398][123091] Updated weights for policy 0, policy_version 1396332 (0.0011) [2023-12-26 10:44:34,446][123090] Updated weights for policy 1, policy_version 1386839 (0.0007) [2023-12-26 10:44:35,167][123091] Updated weights for policy 0, policy_version 1396342 (0.0010) [2023-12-26 10:44:35,201][123090] Updated weights for policy 1, policy_version 1386849 (0.0007) [2023-12-26 10:44:35,230][123091] Updated weights for policy 0, policy_version 1396352 (0.0011) [2023-12-26 10:44:35,266][123090] Updated weights for policy 1, policy_version 1386859 (0.0005) [2023-12-26 10:44:35,296][123091] Updated weights for policy 0, policy_version 1396362 (0.0011) [2023-12-26 10:44:35,330][123090] Updated weights for policy 1, policy_version 1386869 (0.0005) [2023-12-26 10:44:35,382][123090] Updated weights for policy 1, policy_version 1386879 (0.0005) [2023-12-26 10:44:36,060][123090] Updated weights for policy 1, policy_version 1386889 (0.0005) [2023-12-26 10:44:36,076][123091] Updated weights for policy 0, policy_version 1396372 (0.0010) [2023-12-26 10:44:36,131][123090] Updated weights for policy 1, policy_version 1386899 (0.0009) [2023-12-26 10:44:36,141][123091] Updated weights for policy 0, policy_version 1396382 (0.0006) [2023-12-26 10:44:36,202][123090] Updated weights for policy 1, policy_version 1386909 (0.0008) [2023-12-26 10:44:36,214][123091] Updated weights for policy 0, policy_version 1396392 (0.0006) [2023-12-26 10:44:36,888][123090] Updated weights for policy 1, policy_version 1386919 (0.0009) [2023-12-26 10:44:36,942][123090] Updated weights for policy 1, policy_version 1386929 (0.0009) [2023-12-26 10:44:36,995][123090] Updated weights for policy 1, policy_version 1386939 (0.0009) [2023-12-26 10:44:37,002][123091] Updated weights for policy 0, policy_version 1396402 (0.0006) [2023-12-26 10:44:37,070][123091] Updated weights for policy 0, policy_version 1396412 (0.0009) [2023-12-26 10:44:37,127][123091] Updated weights for policy 0, policy_version 1396422 (0.0007) [2023-12-26 10:44:37,182][123091] Updated weights for policy 0, policy_version 1396432 (0.0006) [2023-12-26 10:44:37,892][123090] Updated weights for policy 1, policy_version 1386949 (0.0008) [2023-12-26 10:44:37,913][123091] Updated weights for policy 0, policy_version 1396442 (0.0007) [2023-12-26 10:44:37,954][123090] Updated weights for policy 1, policy_version 1386959 (0.0009) [2023-12-26 10:44:37,975][123091] Updated weights for policy 0, policy_version 1396452 (0.0007) [2023-12-26 10:44:38,017][123090] Updated weights for policy 1, policy_version 1386969 (0.0008) [2023-12-26 10:44:38,032][123091] Updated weights for policy 0, policy_version 1396462 (0.0009) [2023-12-26 10:44:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 712564736. Throughput: 0: 8816.4, 1: 9252.7. Samples: 712547548. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:38,785][121949] Avg episode reward: [(0, '6393.002'), (1, '5697.045')] [2023-12-26 10:44:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001386976_355065856.pth... [2023-12-26 10:44:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001385920_354795520.pth [2023-12-26 10:44:38,826][123091] Updated weights for policy 0, policy_version 1396472 (0.0008) [2023-12-26 10:44:38,891][123091] Updated weights for policy 0, policy_version 1396482 (0.0009) [2023-12-26 10:44:38,896][123090] Updated weights for policy 1, policy_version 1386979 (0.0009) [2023-12-26 10:44:38,957][123090] Updated weights for policy 1, policy_version 1386989 (0.0007) [2023-12-26 10:44:38,962][123091] Updated weights for policy 0, policy_version 1396492 (0.0009) [2023-12-26 10:44:38,984][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001396496_357507072.pth... [2023-12-26 10:44:38,988][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001395440_357236736.pth [2023-12-26 10:44:39,019][123090] Updated weights for policy 1, policy_version 1386999 (0.0006) [2023-12-26 10:44:39,793][123091] Updated weights for policy 0, policy_version 1396502 (0.0010) [2023-12-26 10:44:39,821][123090] Updated weights for policy 1, policy_version 1387009 (0.0010) [2023-12-26 10:44:39,866][123091] Updated weights for policy 0, policy_version 1396512 (0.0010) [2023-12-26 10:44:39,891][123090] Updated weights for policy 1, policy_version 1387019 (0.0008) [2023-12-26 10:44:39,934][123091] Updated weights for policy 0, policy_version 1396522 (0.0009) [2023-12-26 10:44:39,957][123090] Updated weights for policy 1, policy_version 1387029 (0.0007) [2023-12-26 10:44:40,026][123090] Updated weights for policy 1, policy_version 1387039 (0.0009) [2023-12-26 10:44:40,699][123090] Updated weights for policy 1, policy_version 1387049 (0.0011) [2023-12-26 10:44:40,762][123090] Updated weights for policy 1, policy_version 1387059 (0.0010) [2023-12-26 10:44:40,812][123091] Updated weights for policy 0, policy_version 1396532 (0.0007) [2023-12-26 10:44:40,830][123090] Updated weights for policy 1, policy_version 1387069 (0.0011) [2023-12-26 10:44:40,877][123091] Updated weights for policy 0, policy_version 1396542 (0.0007) [2023-12-26 10:44:40,928][123091] Updated weights for policy 0, policy_version 1396552 (0.0010) [2023-12-26 10:44:41,609][123090] Updated weights for policy 1, policy_version 1387079 (0.0009) [2023-12-26 10:44:41,687][123090] Updated weights for policy 1, policy_version 1387089 (0.0008) [2023-12-26 10:44:41,762][123090] Updated weights for policy 1, policy_version 1387099 (0.0009) [2023-12-26 10:44:41,799][123091] Updated weights for policy 0, policy_version 1396562 (0.0009) [2023-12-26 10:44:41,871][123091] Updated weights for policy 0, policy_version 1396572 (0.0007) [2023-12-26 10:44:41,934][123091] Updated weights for policy 0, policy_version 1396582 (0.0008) [2023-12-26 10:44:42,000][123091] Updated weights for policy 0, policy_version 1396592 (0.0008) [2023-12-26 10:44:42,551][123090] Updated weights for policy 1, policy_version 1387109 (0.0009) [2023-12-26 10:44:42,599][123090] Updated weights for policy 1, policy_version 1387119 (0.0006) [2023-12-26 10:44:42,651][123090] Updated weights for policy 1, policy_version 1387129 (0.0005) [2023-12-26 10:44:42,755][123091] Updated weights for policy 0, policy_version 1396602 (0.0009) [2023-12-26 10:44:42,811][123091] Updated weights for policy 0, policy_version 1396612 (0.0010) [2023-12-26 10:44:42,870][123091] Updated weights for policy 0, policy_version 1396623 (0.0010) [2023-12-26 10:44:43,468][123090] Updated weights for policy 1, policy_version 1387139 (0.0008) [2023-12-26 10:44:43,532][123090] Updated weights for policy 1, policy_version 1387149 (0.0009) [2023-12-26 10:44:43,594][123090] Updated weights for policy 1, policy_version 1387159 (0.0009) [2023-12-26 10:44:43,730][123091] Updated weights for policy 0, policy_version 1396633 (0.0009) [2023-12-26 10:44:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 712654848. Throughput: 0: 8857.7, 1: 9132.4. Samples: 712650672. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:43,785][121949] Avg episode reward: [(0, '6353.496'), (1, '5721.591')] [2023-12-26 10:44:43,794][123091] Updated weights for policy 0, policy_version 1396643 (0.0008) [2023-12-26 10:44:43,861][123091] Updated weights for policy 0, policy_version 1396653 (0.0010) [2023-12-26 10:44:44,411][123090] Updated weights for policy 1, policy_version 1387169 (0.0009) [2023-12-26 10:44:44,469][123090] Updated weights for policy 1, policy_version 1387179 (0.0009) [2023-12-26 10:44:44,527][123090] Updated weights for policy 1, policy_version 1387189 (0.0008) [2023-12-26 10:44:44,575][123090] Updated weights for policy 1, policy_version 1387199 (0.0009) [2023-12-26 10:44:44,667][123091] Updated weights for policy 0, policy_version 1396663 (0.0007) [2023-12-26 10:44:44,725][123091] Updated weights for policy 0, policy_version 1396673 (0.0009) [2023-12-26 10:44:44,785][123091] Updated weights for policy 0, policy_version 1396683 (0.0009) [2023-12-26 10:44:45,475][123090] Updated weights for policy 1, policy_version 1387209 (0.0010) [2023-12-26 10:44:45,530][123091] Updated weights for policy 0, policy_version 1396693 (0.0007) [2023-12-26 10:44:45,532][123090] Updated weights for policy 1, policy_version 1387219 (0.0008) [2023-12-26 10:44:45,587][123091] Updated weights for policy 0, policy_version 1396703 (0.0008) [2023-12-26 10:44:45,599][123090] Updated weights for policy 1, policy_version 1387229 (0.0009) [2023-12-26 10:44:45,652][123091] Updated weights for policy 0, policy_version 1396713 (0.0009) [2023-12-26 10:44:46,439][123090] Updated weights for policy 1, policy_version 1387239 (0.0008) [2023-12-26 10:44:46,458][123091] Updated weights for policy 0, policy_version 1396723 (0.0010) [2023-12-26 10:44:46,491][123090] Updated weights for policy 1, policy_version 1387249 (0.0009) [2023-12-26 10:44:46,519][123091] Updated weights for policy 0, policy_version 1396733 (0.0007) [2023-12-26 10:44:46,544][123090] Updated weights for policy 1, policy_version 1387259 (0.0007) [2023-12-26 10:44:46,581][123091] Updated weights for policy 0, policy_version 1396743 (0.0009) [2023-12-26 10:44:47,400][123091] Updated weights for policy 0, policy_version 1396753 (0.0009) [2023-12-26 10:44:47,402][123090] Updated weights for policy 1, policy_version 1387269 (0.0009) [2023-12-26 10:44:47,452][123091] Updated weights for policy 0, policy_version 1396763 (0.0008) [2023-12-26 10:44:47,459][123090] Updated weights for policy 1, policy_version 1387279 (0.0008) [2023-12-26 10:44:47,511][123091] Updated weights for policy 0, policy_version 1396773 (0.0010) [2023-12-26 10:44:47,522][123090] Updated weights for policy 1, policy_version 1387289 (0.0008) [2023-12-26 10:44:47,573][123091] Updated weights for policy 0, policy_version 1396783 (0.0008) [2023-12-26 10:44:48,366][123090] Updated weights for policy 1, policy_version 1387299 (0.0009) [2023-12-26 10:44:48,418][123091] Updated weights for policy 0, policy_version 1396793 (0.0009) [2023-12-26 10:44:48,432][123090] Updated weights for policy 1, policy_version 1387309 (0.0009) [2023-12-26 10:44:48,484][123091] Updated weights for policy 0, policy_version 1396803 (0.0009) [2023-12-26 10:44:48,504][123090] Updated weights for policy 1, policy_version 1387319 (0.0007) [2023-12-26 10:44:48,551][123091] Updated weights for policy 0, policy_version 1396813 (0.0009) [2023-12-26 10:44:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 712744960. Throughput: 0: 8758.8, 1: 9063.4. Samples: 712752804. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:48,785][121949] Avg episode reward: [(0, '6342.020'), (1, '5755.531')] [2023-12-26 10:44:49,258][123090] Updated weights for policy 1, policy_version 1387329 (0.0006) [2023-12-26 10:44:49,321][123090] Updated weights for policy 1, policy_version 1387339 (0.0010) [2023-12-26 10:44:49,392][123091] Updated weights for policy 0, policy_version 1396823 (0.0008) [2023-12-26 10:44:49,392][123090] Updated weights for policy 1, policy_version 1387349 (0.0010) [2023-12-26 10:44:49,449][123090] Updated weights for policy 1, policy_version 1387359 (0.0006) [2023-12-26 10:44:49,455][123091] Updated weights for policy 0, policy_version 1396833 (0.0011) [2023-12-26 10:44:49,518][123091] Updated weights for policy 0, policy_version 1396843 (0.0011) [2023-12-26 10:44:50,222][123090] Updated weights for policy 1, policy_version 1387369 (0.0010) [2023-12-26 10:44:50,252][123091] Updated weights for policy 0, policy_version 1396853 (0.0010) [2023-12-26 10:44:50,273][123090] Updated weights for policy 1, policy_version 1387379 (0.0009) [2023-12-26 10:44:50,305][123091] Updated weights for policy 0, policy_version 1396863 (0.0009) [2023-12-26 10:44:50,330][123090] Updated weights for policy 1, policy_version 1387389 (0.0007) [2023-12-26 10:44:50,355][123091] Updated weights for policy 0, policy_version 1396873 (0.0007) [2023-12-26 10:44:51,209][123090] Updated weights for policy 1, policy_version 1387399 (0.0010) [2023-12-26 10:44:51,278][123090] Updated weights for policy 1, policy_version 1387409 (0.0011) [2023-12-26 10:44:51,284][123091] Updated weights for policy 0, policy_version 1396883 (0.0010) [2023-12-26 10:44:51,346][123090] Updated weights for policy 1, policy_version 1387419 (0.0010) [2023-12-26 10:44:51,377][123091] Updated weights for policy 0, policy_version 1396893 (0.0009) [2023-12-26 10:44:51,439][123091] Updated weights for policy 0, policy_version 1396903 (0.0009) [2023-12-26 10:44:52,152][123091] Updated weights for policy 0, policy_version 1396913 (0.0009) [2023-12-26 10:44:52,174][123090] Updated weights for policy 1, policy_version 1387429 (0.0011) [2023-12-26 10:44:52,220][123091] Updated weights for policy 0, policy_version 1396923 (0.0008) [2023-12-26 10:44:52,237][123090] Updated weights for policy 1, policy_version 1387439 (0.0011) [2023-12-26 10:44:52,287][123091] Updated weights for policy 0, policy_version 1396933 (0.0009) [2023-12-26 10:44:52,305][123090] Updated weights for policy 1, policy_version 1387449 (0.0011) [2023-12-26 10:44:52,355][123091] Updated weights for policy 0, policy_version 1396943 (0.0010) [2023-12-26 10:44:53,101][123090] Updated weights for policy 1, policy_version 1387459 (0.0008) [2023-12-26 10:44:53,151][123091] Updated weights for policy 0, policy_version 1396953 (0.0011) [2023-12-26 10:44:53,165][123090] Updated weights for policy 1, policy_version 1387469 (0.0005) [2023-12-26 10:44:53,213][123091] Updated weights for policy 0, policy_version 1396963 (0.0010) [2023-12-26 10:44:53,229][123090] Updated weights for policy 1, policy_version 1387479 (0.0005) [2023-12-26 10:44:53,272][123091] Updated weights for policy 0, policy_version 1396973 (0.0011) [2023-12-26 10:44:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 712826880. Throughput: 0: 8691.2, 1: 9020.7. Samples: 712804156. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:53,785][121949] Avg episode reward: [(0, '6411.838'), (1, '5733.541')] [2023-12-26 10:44:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001396976_357629952.pth... [2023-12-26 10:44:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001387488_355196928.pth... [2023-12-26 10:44:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001386432_354926592.pth [2023-12-26 10:44:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001395952_357367808.pth [2023-12-26 10:44:53,981][123090] Updated weights for policy 1, policy_version 1387489 (0.0005) [2023-12-26 10:44:54,041][123090] Updated weights for policy 1, policy_version 1387499 (0.0005) [2023-12-26 10:44:54,078][123091] Updated weights for policy 0, policy_version 1396983 (0.0009) [2023-12-26 10:44:54,108][123090] Updated weights for policy 1, policy_version 1387509 (0.0005) [2023-12-26 10:44:54,144][123091] Updated weights for policy 0, policy_version 1396993 (0.0009) [2023-12-26 10:44:54,168][123090] Updated weights for policy 1, policy_version 1387519 (0.0008) [2023-12-26 10:44:54,211][123091] Updated weights for policy 0, policy_version 1397003 (0.0009) [2023-12-26 10:44:54,951][123090] Updated weights for policy 1, policy_version 1387529 (0.0006) [2023-12-26 10:44:55,002][123090] Updated weights for policy 1, policy_version 1387539 (0.0009) [2023-12-26 10:44:55,035][123091] Updated weights for policy 0, policy_version 1397013 (0.0008) [2023-12-26 10:44:55,068][123090] Updated weights for policy 1, policy_version 1387549 (0.0008) [2023-12-26 10:44:55,088][123091] Updated weights for policy 0, policy_version 1397023 (0.0007) [2023-12-26 10:44:55,141][123091] Updated weights for policy 0, policy_version 1397033 (0.0010) [2023-12-26 10:44:55,869][123090] Updated weights for policy 1, policy_version 1387559 (0.0010) [2023-12-26 10:44:55,921][123091] Updated weights for policy 0, policy_version 1397043 (0.0008) [2023-12-26 10:44:55,941][123090] Updated weights for policy 1, policy_version 1387569 (0.0009) [2023-12-26 10:44:55,979][123091] Updated weights for policy 0, policy_version 1397053 (0.0005) [2023-12-26 10:44:56,008][123090] Updated weights for policy 1, policy_version 1387579 (0.0009) [2023-12-26 10:44:56,039][123091] Updated weights for policy 0, policy_version 1397063 (0.0005) [2023-12-26 10:44:56,734][123091] Updated weights for policy 0, policy_version 1397073 (0.0006) [2023-12-26 10:44:56,782][123091] Updated weights for policy 0, policy_version 1397083 (0.0005) [2023-12-26 10:44:56,845][123091] Updated weights for policy 0, policy_version 1397093 (0.0007) [2023-12-26 10:44:56,876][123090] Updated weights for policy 1, policy_version 1387589 (0.0008) [2023-12-26 10:44:56,902][123091] Updated weights for policy 0, policy_version 1397103 (0.0006) [2023-12-26 10:44:56,932][123090] Updated weights for policy 1, policy_version 1387599 (0.0006) [2023-12-26 10:44:56,986][123090] Updated weights for policy 1, policy_version 1387609 (0.0006) [2023-12-26 10:44:57,697][123090] Updated weights for policy 1, policy_version 1387619 (0.0009) [2023-12-26 10:44:57,744][123091] Updated weights for policy 0, policy_version 1397113 (0.0009) [2023-12-26 10:44:57,745][123090] Updated weights for policy 1, policy_version 1387629 (0.0005) [2023-12-26 10:44:57,793][123091] Updated weights for policy 0, policy_version 1397124 (0.0008) [2023-12-26 10:44:57,795][123090] Updated weights for policy 1, policy_version 1387639 (0.0005) [2023-12-26 10:44:57,847][123091] Updated weights for policy 0, policy_version 1397134 (0.0009) [2023-12-26 10:44:58,649][123090] Updated weights for policy 1, policy_version 1387649 (0.0005) [2023-12-26 10:44:58,718][123090] Updated weights for policy 1, policy_version 1387659 (0.0009) [2023-12-26 10:44:58,725][123091] Updated weights for policy 0, policy_version 1397144 (0.0008) [2023-12-26 10:44:58,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 712908800. Throughput: 0: 8732.9, 1: 9012.6. Samples: 712912152. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:44:58,785][123090] Updated weights for policy 1, policy_version 1387669 (0.0009) [2023-12-26 10:44:58,785][121949] Avg episode reward: [(0, '6457.183'), (1, '5724.049')] [2023-12-26 10:44:58,791][123091] Updated weights for policy 0, policy_version 1397154 (0.0008) [2023-12-26 10:44:58,854][123091] Updated weights for policy 0, policy_version 1397164 (0.0009) [2023-12-26 10:44:58,856][123090] Updated weights for policy 1, policy_version 1387679 (0.0008) [2023-12-26 10:44:59,711][123091] Updated weights for policy 0, policy_version 1397174 (0.0008) [2023-12-26 10:44:59,724][123090] Updated weights for policy 1, policy_version 1387689 (0.0006) [2023-12-26 10:44:59,761][123091] Updated weights for policy 0, policy_version 1397184 (0.0009) [2023-12-26 10:44:59,775][123090] Updated weights for policy 1, policy_version 1387699 (0.0005) [2023-12-26 10:44:59,810][123091] Updated weights for policy 0, policy_version 1397194 (0.0009) [2023-12-26 10:44:59,830][123090] Updated weights for policy 1, policy_version 1387709 (0.0007) [2023-12-26 10:45:00,652][123090] Updated weights for policy 1, policy_version 1387719 (0.0010) [2023-12-26 10:45:00,673][123091] Updated weights for policy 0, policy_version 1397204 (0.0010) [2023-12-26 10:45:00,716][123090] Updated weights for policy 1, policy_version 1387729 (0.0010) [2023-12-26 10:45:00,736][123091] Updated weights for policy 0, policy_version 1397214 (0.0009) [2023-12-26 10:45:00,781][123090] Updated weights for policy 1, policy_version 1387739 (0.0009) [2023-12-26 10:45:00,801][123091] Updated weights for policy 0, policy_version 1397224 (0.0008) [2023-12-26 10:45:01,501][123090] Updated weights for policy 1, policy_version 1387749 (0.0005) [2023-12-26 10:45:01,561][123090] Updated weights for policy 1, policy_version 1387759 (0.0006) [2023-12-26 10:45:01,564][123091] Updated weights for policy 0, policy_version 1397234 (0.0010) [2023-12-26 10:45:01,624][123091] Updated weights for policy 0, policy_version 1397244 (0.0009) [2023-12-26 10:45:01,631][123090] Updated weights for policy 1, policy_version 1387769 (0.0007) [2023-12-26 10:45:01,693][123091] Updated weights for policy 0, policy_version 1397254 (0.0008) [2023-12-26 10:45:01,764][123091] Updated weights for policy 0, policy_version 1397264 (0.0008) [2023-12-26 10:45:02,408][123090] Updated weights for policy 1, policy_version 1387779 (0.0007) [2023-12-26 10:45:02,472][123090] Updated weights for policy 1, policy_version 1387789 (0.0009) [2023-12-26 10:45:02,537][123090] Updated weights for policy 1, policy_version 1387799 (0.0009) [2023-12-26 10:45:02,580][123091] Updated weights for policy 0, policy_version 1397274 (0.0006) [2023-12-26 10:45:02,638][123091] Updated weights for policy 0, policy_version 1397284 (0.0010) [2023-12-26 10:45:02,698][123091] Updated weights for policy 0, policy_version 1397294 (0.0010) [2023-12-26 10:45:03,327][123091] Updated weights for policy 0, policy_version 1397304 (0.0005) [2023-12-26 10:45:03,386][123091] Updated weights for policy 0, policy_version 1397314 (0.0005) [2023-12-26 10:45:03,444][123090] Updated weights for policy 1, policy_version 1387809 (0.0009) [2023-12-26 10:45:03,445][123091] Updated weights for policy 0, policy_version 1397324 (0.0006) [2023-12-26 10:45:03,498][123090] Updated weights for policy 1, policy_version 1387819 (0.0009) [2023-12-26 10:45:03,556][123090] Updated weights for policy 1, policy_version 1387830 (0.0010) [2023-12-26 10:45:03,610][123090] Updated weights for policy 1, policy_version 1387840 (0.0010) [2023-12-26 10:45:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 713007104. Throughput: 0: 8771.6, 1: 8967.6. Samples: 713016584. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:03,785][121949] Avg episode reward: [(0, '6446.717'), (1, '5569.695')] [2023-12-26 10:45:04,110][123091] Updated weights for policy 0, policy_version 1397334 (0.0007) [2023-12-26 10:45:04,172][123091] Updated weights for policy 0, policy_version 1397344 (0.0009) [2023-12-26 10:45:04,240][123091] Updated weights for policy 0, policy_version 1397354 (0.0011) [2023-12-26 10:45:04,465][123090] Updated weights for policy 1, policy_version 1387850 (0.0009) [2023-12-26 10:45:04,535][123090] Updated weights for policy 1, policy_version 1387860 (0.0009) [2023-12-26 10:45:04,613][123090] Updated weights for policy 1, policy_version 1387870 (0.0006) [2023-12-26 10:45:04,940][123091] Updated weights for policy 0, policy_version 1397364 (0.0009) [2023-12-26 10:45:04,988][123091] Updated weights for policy 0, policy_version 1397374 (0.0005) [2023-12-26 10:45:05,038][123091] Updated weights for policy 0, policy_version 1397384 (0.0006) [2023-12-26 10:45:05,301][123090] Updated weights for policy 1, policy_version 1387880 (0.0005) [2023-12-26 10:45:05,362][123090] Updated weights for policy 1, policy_version 1387890 (0.0005) [2023-12-26 10:45:05,429][123090] Updated weights for policy 1, policy_version 1387900 (0.0005) [2023-12-26 10:45:05,691][123091] Updated weights for policy 0, policy_version 1397394 (0.0005) [2023-12-26 10:45:05,770][123091] Updated weights for policy 0, policy_version 1397404 (0.0005) [2023-12-26 10:45:05,849][123091] Updated weights for policy 0, policy_version 1397414 (0.0005) [2023-12-26 10:45:05,924][123091] Updated weights for policy 0, policy_version 1397424 (0.0005) [2023-12-26 10:45:06,057][123090] Updated weights for policy 1, policy_version 1387910 (0.0008) [2023-12-26 10:45:06,115][123090] Updated weights for policy 1, policy_version 1387920 (0.0010) [2023-12-26 10:45:06,181][123090] Updated weights for policy 1, policy_version 1387930 (0.0009) [2023-12-26 10:45:06,491][123091] Updated weights for policy 0, policy_version 1397434 (0.0011) [2023-12-26 10:45:06,546][123091] Updated weights for policy 0, policy_version 1397444 (0.0011) [2023-12-26 10:45:06,612][123091] Updated weights for policy 0, policy_version 1397454 (0.0010) [2023-12-26 10:45:07,051][123090] Updated weights for policy 1, policy_version 1387940 (0.0010) [2023-12-26 10:45:07,100][123090] Updated weights for policy 1, policy_version 1387950 (0.0009) [2023-12-26 10:45:07,157][123090] Updated weights for policy 1, policy_version 1387960 (0.0009) [2023-12-26 10:45:07,414][123091] Updated weights for policy 0, policy_version 1397464 (0.0006) [2023-12-26 10:45:07,474][123091] Updated weights for policy 0, policy_version 1397474 (0.0006) [2023-12-26 10:45:07,547][123091] Updated weights for policy 0, policy_version 1397484 (0.0005) [2023-12-26 10:45:08,095][123090] Updated weights for policy 1, policy_version 1387970 (0.0009) [2023-12-26 10:45:08,150][123090] Updated weights for policy 1, policy_version 1387980 (0.0009) [2023-12-26 10:45:08,158][123091] Updated weights for policy 0, policy_version 1397494 (0.0006) [2023-12-26 10:45:08,202][123090] Updated weights for policy 1, policy_version 1387990 (0.0009) [2023-12-26 10:45:08,222][123091] Updated weights for policy 0, policy_version 1397504 (0.0009) [2023-12-26 10:45:08,271][123090] Updated weights for policy 1, policy_version 1388000 (0.0009) [2023-12-26 10:45:08,281][123091] Updated weights for policy 0, policy_version 1397514 (0.0005) [2023-12-26 10:45:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 713097216. Throughput: 0: 8886.4, 1: 8998.8. Samples: 713074580. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:08,785][121949] Avg episode reward: [(0, '6365.539'), (1, '5521.999')] [2023-12-26 10:45:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001397520_357769216.pth... [2023-12-26 10:45:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001388000_355328000.pth... [2023-12-26 10:45:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001386976_355065856.pth [2023-12-26 10:45:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001396496_357507072.pth [2023-12-26 10:45:09,062][123091] Updated weights for policy 0, policy_version 1397524 (0.0007) [2023-12-26 10:45:09,121][123091] Updated weights for policy 0, policy_version 1397534 (0.0009) [2023-12-26 10:45:09,134][123090] Updated weights for policy 1, policy_version 1388010 (0.0007) [2023-12-26 10:45:09,172][123091] Updated weights for policy 0, policy_version 1397544 (0.0009) [2023-12-26 10:45:09,197][123090] Updated weights for policy 1, policy_version 1388020 (0.0008) [2023-12-26 10:45:09,263][123090] Updated weights for policy 1, policy_version 1388030 (0.0008) [2023-12-26 10:45:10,020][123090] Updated weights for policy 1, policy_version 1388040 (0.0009) [2023-12-26 10:45:10,073][123091] Updated weights for policy 0, policy_version 1397554 (0.0008) [2023-12-26 10:45:10,097][123090] Updated weights for policy 1, policy_version 1388050 (0.0009) [2023-12-26 10:45:10,121][123091] Updated weights for policy 0, policy_version 1397564 (0.0007) [2023-12-26 10:45:10,164][123090] Updated weights for policy 1, policy_version 1388060 (0.0008) [2023-12-26 10:45:10,177][123091] Updated weights for policy 0, policy_version 1397574 (0.0008) [2023-12-26 10:45:10,233][123091] Updated weights for policy 0, policy_version 1397584 (0.0006) [2023-12-26 10:45:10,969][123090] Updated weights for policy 1, policy_version 1388070 (0.0007) [2023-12-26 10:45:11,017][123090] Updated weights for policy 1, policy_version 1388080 (0.0005) [2023-12-26 10:45:11,085][123090] Updated weights for policy 1, policy_version 1388090 (0.0007) [2023-12-26 10:45:11,092][123091] Updated weights for policy 0, policy_version 1397594 (0.0010) [2023-12-26 10:45:11,158][123091] Updated weights for policy 0, policy_version 1397605 (0.0009) [2023-12-26 10:45:11,225][123091] Updated weights for policy 0, policy_version 1397615 (0.0009) [2023-12-26 10:45:11,894][123090] Updated weights for policy 1, policy_version 1388100 (0.0006) [2023-12-26 10:45:11,959][123090] Updated weights for policy 1, policy_version 1388110 (0.0005) [2023-12-26 10:45:12,010][123090] Updated weights for policy 1, policy_version 1388120 (0.0005) [2023-12-26 10:45:12,115][123091] Updated weights for policy 0, policy_version 1397625 (0.0009) [2023-12-26 10:45:12,162][123091] Updated weights for policy 0, policy_version 1397635 (0.0006) [2023-12-26 10:45:12,226][123091] Updated weights for policy 0, policy_version 1397645 (0.0007) [2023-12-26 10:45:12,807][123090] Updated weights for policy 1, policy_version 1388130 (0.0009) [2023-12-26 10:45:12,875][123090] Updated weights for policy 1, policy_version 1388140 (0.0011) [2023-12-26 10:45:12,943][123090] Updated weights for policy 1, policy_version 1388150 (0.0010) [2023-12-26 10:45:13,006][123090] Updated weights for policy 1, policy_version 1388160 (0.0005) [2023-12-26 10:45:13,115][123091] Updated weights for policy 0, policy_version 1397655 (0.0010) [2023-12-26 10:45:13,178][123091] Updated weights for policy 0, policy_version 1397665 (0.0010) [2023-12-26 10:45:13,240][123091] Updated weights for policy 0, policy_version 1397675 (0.0010) [2023-12-26 10:45:13,692][123090] Updated weights for policy 1, policy_version 1388170 (0.0005) [2023-12-26 10:45:13,753][123090] Updated weights for policy 1, policy_version 1388180 (0.0005) [2023-12-26 10:45:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 713179136. Throughput: 0: 8893.0, 1: 8841.7. Samples: 713177668. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:13,785][121949] Avg episode reward: [(0, '6310.972'), (1, '5706.895')] [2023-12-26 10:45:13,819][123090] Updated weights for policy 1, policy_version 1388190 (0.0005) [2023-12-26 10:45:14,172][123091] Updated weights for policy 0, policy_version 1397685 (0.0009) [2023-12-26 10:45:14,236][123091] Updated weights for policy 0, policy_version 1397695 (0.0009) [2023-12-26 10:45:14,290][123091] Updated weights for policy 0, policy_version 1397705 (0.0009) [2023-12-26 10:45:14,405][123090] Updated weights for policy 1, policy_version 1388200 (0.0009) [2023-12-26 10:45:14,460][123090] Updated weights for policy 1, policy_version 1388210 (0.0010) [2023-12-26 10:45:14,515][123090] Updated weights for policy 1, policy_version 1388220 (0.0010) [2023-12-26 10:45:15,139][123091] Updated weights for policy 0, policy_version 1397715 (0.0009) [2023-12-26 10:45:15,204][123091] Updated weights for policy 0, policy_version 1397725 (0.0009) [2023-12-26 10:45:15,269][123091] Updated weights for policy 0, policy_version 1397735 (0.0009) [2023-12-26 10:45:15,396][123090] Updated weights for policy 1, policy_version 1388230 (0.0011) [2023-12-26 10:45:15,465][123090] Updated weights for policy 1, policy_version 1388240 (0.0010) [2023-12-26 10:45:15,528][123090] Updated weights for policy 1, policy_version 1388250 (0.0010) [2023-12-26 10:45:16,110][123091] Updated weights for policy 0, policy_version 1397745 (0.0009) [2023-12-26 10:45:16,183][123091] Updated weights for policy 0, policy_version 1397755 (0.0009) [2023-12-26 10:45:16,248][123091] Updated weights for policy 0, policy_version 1397765 (0.0009) [2023-12-26 10:45:16,296][123091] Updated weights for policy 0, policy_version 1397775 (0.0009) [2023-12-26 10:45:16,352][123090] Updated weights for policy 1, policy_version 1388260 (0.0010) [2023-12-26 10:45:16,419][123090] Updated weights for policy 1, policy_version 1388270 (0.0010) [2023-12-26 10:45:16,479][123090] Updated weights for policy 1, policy_version 1388280 (0.0010) [2023-12-26 10:45:17,149][123091] Updated weights for policy 0, policy_version 1397785 (0.0010) [2023-12-26 10:45:17,211][123091] Updated weights for policy 0, policy_version 1397795 (0.0010) [2023-12-26 10:45:17,271][123091] Updated weights for policy 0, policy_version 1397805 (0.0009) [2023-12-26 10:45:17,295][123090] Updated weights for policy 1, policy_version 1388290 (0.0011) [2023-12-26 10:45:17,358][123090] Updated weights for policy 1, policy_version 1388300 (0.0010) [2023-12-26 10:45:17,417][123090] Updated weights for policy 1, policy_version 1388310 (0.0010) [2023-12-26 10:45:17,481][123090] Updated weights for policy 1, policy_version 1388320 (0.0011) [2023-12-26 10:45:18,101][123091] Updated weights for policy 0, policy_version 1397815 (0.0009) [2023-12-26 10:45:18,155][123091] Updated weights for policy 0, policy_version 1397825 (0.0009) [2023-12-26 10:45:18,219][123091] Updated weights for policy 0, policy_version 1397835 (0.0009) [2023-12-26 10:45:18,317][123090] Updated weights for policy 1, policy_version 1388330 (0.0011) [2023-12-26 10:45:18,384][123090] Updated weights for policy 1, policy_version 1388340 (0.0011) [2023-12-26 10:45:18,445][123090] Updated weights for policy 1, policy_version 1388350 (0.0011) [2023-12-26 10:45:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 713269248. Throughput: 0: 8760.6, 1: 8773.8. Samples: 713280236. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:18,785][121949] Avg episode reward: [(0, '6245.971'), (1, '5772.408')] [2023-12-26 10:45:19,084][123091] Updated weights for policy 0, policy_version 1397845 (0.0008) [2023-12-26 10:45:19,150][123091] Updated weights for policy 0, policy_version 1397855 (0.0008) [2023-12-26 10:45:19,211][123091] Updated weights for policy 0, policy_version 1397865 (0.0006) [2023-12-26 10:45:19,223][123090] Updated weights for policy 1, policy_version 1388360 (0.0009) [2023-12-26 10:45:19,296][123090] Updated weights for policy 1, policy_version 1388370 (0.0008) [2023-12-26 10:45:19,362][123090] Updated weights for policy 1, policy_version 1388380 (0.0010) [2023-12-26 10:45:20,099][123091] Updated weights for policy 0, policy_version 1397875 (0.0009) [2023-12-26 10:45:20,157][123091] Updated weights for policy 0, policy_version 1397885 (0.0009) [2023-12-26 10:45:20,231][123091] Updated weights for policy 0, policy_version 1397895 (0.0009) [2023-12-26 10:45:20,273][123090] Updated weights for policy 1, policy_version 1388390 (0.0010) [2023-12-26 10:45:20,341][123090] Updated weights for policy 1, policy_version 1388400 (0.0007) [2023-12-26 10:45:20,416][123090] Updated weights for policy 1, policy_version 1388410 (0.0006) [2023-12-26 10:45:21,174][123091] Updated weights for policy 0, policy_version 1397905 (0.0009) [2023-12-26 10:45:21,223][123090] Updated weights for policy 1, policy_version 1388420 (0.0007) [2023-12-26 10:45:21,234][123091] Updated weights for policy 0, policy_version 1397915 (0.0009) [2023-12-26 10:45:21,305][123091] Updated weights for policy 0, policy_version 1397925 (0.0009) [2023-12-26 10:45:21,312][123090] Updated weights for policy 1, policy_version 1388430 (0.0009) [2023-12-26 10:45:21,383][123091] Updated weights for policy 0, policy_version 1397935 (0.0009) [2023-12-26 10:45:21,397][123090] Updated weights for policy 1, policy_version 1388440 (0.0010) [2023-12-26 10:45:22,267][123091] Updated weights for policy 0, policy_version 1397945 (0.0009) [2023-12-26 10:45:22,294][123090] Updated weights for policy 1, policy_version 1388450 (0.0009) [2023-12-26 10:45:22,324][123091] Updated weights for policy 0, policy_version 1397955 (0.0008) [2023-12-26 10:45:22,359][123090] Updated weights for policy 1, policy_version 1388460 (0.0008) [2023-12-26 10:45:22,399][123091] Updated weights for policy 0, policy_version 1397965 (0.0008) [2023-12-26 10:45:22,428][123090] Updated weights for policy 1, policy_version 1388470 (0.0010) [2023-12-26 10:45:22,482][123090] Updated weights for policy 1, policy_version 1388480 (0.0009) [2023-12-26 10:45:23,227][123091] Updated weights for policy 0, policy_version 1397975 (0.0009) [2023-12-26 10:45:23,284][123091] Updated weights for policy 0, policy_version 1397985 (0.0009) [2023-12-26 10:45:23,337][123091] Updated weights for policy 0, policy_version 1397995 (0.0009) [2023-12-26 10:45:23,359][123090] Updated weights for policy 1, policy_version 1388490 (0.0007) [2023-12-26 10:45:23,408][123090] Updated weights for policy 1, policy_version 1388500 (0.0009) [2023-12-26 10:45:23,470][123090] Updated weights for policy 1, policy_version 1388510 (0.0009) [2023-12-26 10:45:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 713351168. Throughput: 0: 8693.4, 1: 8642.9. Samples: 713327684. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:23,785][121949] Avg episode reward: [(0, '6321.625'), (1, '5854.549')] [2023-12-26 10:45:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001398000_357892096.pth... [2023-12-26 10:45:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001388512_355459072.pth... [2023-12-26 10:45:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001396976_357629952.pth [2023-12-26 10:45:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001387488_355196928.pth [2023-12-26 10:45:24,192][123091] Updated weights for policy 0, policy_version 1398005 (0.0010) [2023-12-26 10:45:24,256][123091] Updated weights for policy 0, policy_version 1398015 (0.0010) [2023-12-26 10:45:24,310][123091] Updated weights for policy 0, policy_version 1398025 (0.0009) [2023-12-26 10:45:24,327][123090] Updated weights for policy 1, policy_version 1388520 (0.0007) [2023-12-26 10:45:24,384][123090] Updated weights for policy 1, policy_version 1388530 (0.0007) [2023-12-26 10:45:24,444][123090] Updated weights for policy 1, policy_version 1388540 (0.0006) [2023-12-26 10:45:25,146][123091] Updated weights for policy 0, policy_version 1398035 (0.0010) [2023-12-26 10:45:25,206][123091] Updated weights for policy 0, policy_version 1398045 (0.0008) [2023-12-26 10:45:25,207][123090] Updated weights for policy 1, policy_version 1388550 (0.0009) [2023-12-26 10:45:25,270][123091] Updated weights for policy 0, policy_version 1398055 (0.0006) [2023-12-26 10:45:25,271][123090] Updated weights for policy 1, policy_version 1388560 (0.0011) [2023-12-26 10:45:25,335][123090] Updated weights for policy 1, policy_version 1388570 (0.0009) [2023-12-26 10:45:26,031][123090] Updated weights for policy 1, policy_version 1388580 (0.0006) [2023-12-26 10:45:26,097][123091] Updated weights for policy 0, policy_version 1398065 (0.0006) [2023-12-26 10:45:26,099][123090] Updated weights for policy 1, policy_version 1388590 (0.0009) [2023-12-26 10:45:26,161][123091] Updated weights for policy 0, policy_version 1398075 (0.0006) [2023-12-26 10:45:26,162][123090] Updated weights for policy 1, policy_version 1388600 (0.0010) [2023-12-26 10:45:26,222][123091] Updated weights for policy 0, policy_version 1398085 (0.0007) [2023-12-26 10:45:26,276][123091] Updated weights for policy 0, policy_version 1398095 (0.0009) [2023-12-26 10:45:26,863][123090] Updated weights for policy 1, policy_version 1388610 (0.0010) [2023-12-26 10:45:26,913][123090] Updated weights for policy 1, policy_version 1388620 (0.0010) [2023-12-26 10:45:26,979][123090] Updated weights for policy 1, policy_version 1388630 (0.0010) [2023-12-26 10:45:27,045][123090] Updated weights for policy 1, policy_version 1388640 (0.0010) [2023-12-26 10:45:27,131][123091] Updated weights for policy 0, policy_version 1398105 (0.0010) [2023-12-26 10:45:27,189][123091] Updated weights for policy 0, policy_version 1398115 (0.0009) [2023-12-26 10:45:27,245][123091] Updated weights for policy 0, policy_version 1398125 (0.0010) [2023-12-26 10:45:27,812][123090] Updated weights for policy 1, policy_version 1388650 (0.0009) [2023-12-26 10:45:27,862][123090] Updated weights for policy 1, policy_version 1388660 (0.0009) [2023-12-26 10:45:27,909][123090] Updated weights for policy 1, policy_version 1388670 (0.0009) [2023-12-26 10:45:28,088][123091] Updated weights for policy 0, policy_version 1398135 (0.0010) [2023-12-26 10:45:28,155][123091] Updated weights for policy 0, policy_version 1398145 (0.0009) [2023-12-26 10:45:28,210][123091] Updated weights for policy 0, policy_version 1398155 (0.0008) [2023-12-26 10:45:28,763][123090] Updated weights for policy 1, policy_version 1388680 (0.0011) [2023-12-26 10:45:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 713433088. Throughput: 0: 8654.7, 1: 8694.3. Samples: 713431376. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 10:45:28,785][121949] Avg episode reward: [(0, '6375.701'), (1, '5880.434')] [2023-12-26 10:45:28,830][123090] Updated weights for policy 1, policy_version 1388690 (0.0010) [2023-12-26 10:45:28,893][123090] Updated weights for policy 1, policy_version 1388700 (0.0011) [2023-12-26 10:45:29,044][123091] Updated weights for policy 0, policy_version 1398165 (0.0009) [2023-12-26 10:45:29,098][123091] Updated weights for policy 0, policy_version 1398175 (0.0008) [2023-12-26 10:45:29,149][123091] Updated weights for policy 0, policy_version 1398185 (0.0008) [2023-12-26 10:45:29,688][123090] Updated weights for policy 1, policy_version 1388710 (0.0010) [2023-12-26 10:45:29,735][123090] Updated weights for policy 1, policy_version 1388720 (0.0010) [2023-12-26 10:45:29,783][123090] Updated weights for policy 1, policy_version 1388730 (0.0010) [2023-12-26 10:45:30,001][123091] Updated weights for policy 0, policy_version 1398196 (0.0009) [2023-12-26 10:45:30,049][123091] Updated weights for policy 0, policy_version 1398206 (0.0008) [2023-12-26 10:45:30,101][123091] Updated weights for policy 0, policy_version 1398216 (0.0009) [2023-12-26 10:45:30,648][123090] Updated weights for policy 1, policy_version 1388740 (0.0010) [2023-12-26 10:45:30,707][123090] Updated weights for policy 1, policy_version 1388750 (0.0010) [2023-12-26 10:45:30,766][123090] Updated weights for policy 1, policy_version 1388760 (0.0010) [2023-12-26 10:45:30,934][123091] Updated weights for policy 0, policy_version 1398226 (0.0008) [2023-12-26 10:45:30,998][123091] Updated weights for policy 0, policy_version 1398236 (0.0010) [2023-12-26 10:45:31,061][123091] Updated weights for policy 0, policy_version 1398246 (0.0008) [2023-12-26 10:45:31,130][123091] Updated weights for policy 0, policy_version 1398256 (0.0009) [2023-12-26 10:45:31,625][123090] Updated weights for policy 1, policy_version 1388770 (0.0010) [2023-12-26 10:45:31,689][123090] Updated weights for policy 1, policy_version 1388780 (0.0008) [2023-12-26 10:45:31,761][123090] Updated weights for policy 1, policy_version 1388790 (0.0009) [2023-12-26 10:45:31,823][123090] Updated weights for policy 1, policy_version 1388800 (0.0009) [2023-12-26 10:45:31,903][123091] Updated weights for policy 0, policy_version 1398266 (0.0007) [2023-12-26 10:45:31,972][123091] Updated weights for policy 0, policy_version 1398276 (0.0005) [2023-12-26 10:45:32,036][123091] Updated weights for policy 0, policy_version 1398286 (0.0005) [2023-12-26 10:45:32,588][123090] Updated weights for policy 1, policy_version 1388810 (0.0009) [2023-12-26 10:45:32,651][123090] Updated weights for policy 1, policy_version 1388820 (0.0009) [2023-12-26 10:45:32,719][123090] Updated weights for policy 1, policy_version 1388830 (0.0009) [2023-12-26 10:45:32,769][123091] Updated weights for policy 0, policy_version 1398296 (0.0006) [2023-12-26 10:45:32,830][123091] Updated weights for policy 0, policy_version 1398306 (0.0010) [2023-12-26 10:45:32,885][123091] Updated weights for policy 0, policy_version 1398316 (0.0010) [2023-12-26 10:45:33,441][123090] Updated weights for policy 1, policy_version 1388840 (0.0006) [2023-12-26 10:45:33,502][123090] Updated weights for policy 1, policy_version 1388850 (0.0005) [2023-12-26 10:45:33,562][123090] Updated weights for policy 1, policy_version 1388860 (0.0005) [2023-12-26 10:45:33,612][123091] Updated weights for policy 0, policy_version 1398326 (0.0007) [2023-12-26 10:45:33,659][123091] Updated weights for policy 0, policy_version 1398336 (0.0005) [2023-12-26 10:45:33,723][123091] Updated weights for policy 0, policy_version 1398346 (0.0005) [2023-12-26 10:45:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 713531392. Throughput: 0: 8697.7, 1: 8736.8. Samples: 713537356. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:33,784][121949] Avg episode reward: [(0, '6314.866'), (1, '5857.572')] [2023-12-26 10:45:34,201][123090] Updated weights for policy 1, policy_version 1388870 (0.0008) [2023-12-26 10:45:34,266][123090] Updated weights for policy 1, policy_version 1388880 (0.0009) [2023-12-26 10:45:34,336][123090] Updated weights for policy 1, policy_version 1388890 (0.0009) [2023-12-26 10:45:34,555][123091] Updated weights for policy 0, policy_version 1398356 (0.0009) [2023-12-26 10:45:34,620][123091] Updated weights for policy 0, policy_version 1398366 (0.0008) [2023-12-26 10:45:34,687][123091] Updated weights for policy 0, policy_version 1398376 (0.0008) [2023-12-26 10:45:35,186][123090] Updated weights for policy 1, policy_version 1388900 (0.0009) [2023-12-26 10:45:35,253][123090] Updated weights for policy 1, policy_version 1388910 (0.0009) [2023-12-26 10:45:35,317][123090] Updated weights for policy 1, policy_version 1388920 (0.0009) [2023-12-26 10:45:35,344][123091] Updated weights for policy 0, policy_version 1398386 (0.0008) [2023-12-26 10:45:35,399][123091] Updated weights for policy 0, policy_version 1398396 (0.0008) [2023-12-26 10:45:35,469][123091] Updated weights for policy 0, policy_version 1398406 (0.0010) [2023-12-26 10:45:35,534][123091] Updated weights for policy 0, policy_version 1398416 (0.0009) [2023-12-26 10:45:36,107][123090] Updated weights for policy 1, policy_version 1388930 (0.0010) [2023-12-26 10:45:36,172][123090] Updated weights for policy 1, policy_version 1388940 (0.0010) [2023-12-26 10:45:36,242][123090] Updated weights for policy 1, policy_version 1388950 (0.0010) [2023-12-26 10:45:36,312][123090] Updated weights for policy 1, policy_version 1388960 (0.0010) [2023-12-26 10:45:36,370][123091] Updated weights for policy 0, policy_version 1398426 (0.0009) [2023-12-26 10:45:36,429][123091] Updated weights for policy 0, policy_version 1398436 (0.0010) [2023-12-26 10:45:36,481][123091] Updated weights for policy 0, policy_version 1398446 (0.0009) [2023-12-26 10:45:37,150][123090] Updated weights for policy 1, policy_version 1388970 (0.0010) [2023-12-26 10:45:37,213][123090] Updated weights for policy 1, policy_version 1388980 (0.0008) [2023-12-26 10:45:37,276][123090] Updated weights for policy 1, policy_version 1388990 (0.0007) [2023-12-26 10:45:37,331][123091] Updated weights for policy 0, policy_version 1398456 (0.0007) [2023-12-26 10:45:37,383][123091] Updated weights for policy 0, policy_version 1398466 (0.0009) [2023-12-26 10:45:37,435][123091] Updated weights for policy 0, policy_version 1398476 (0.0005) [2023-12-26 10:45:38,079][123091] Updated weights for policy 0, policy_version 1398486 (0.0008) [2023-12-26 10:45:38,134][123090] Updated weights for policy 1, policy_version 1389000 (0.0008) [2023-12-26 10:45:38,134][123091] Updated weights for policy 0, policy_version 1398496 (0.0009) [2023-12-26 10:45:38,187][123091] Updated weights for policy 0, policy_version 1398506 (0.0007) [2023-12-26 10:45:38,196][123090] Updated weights for policy 1, policy_version 1389010 (0.0010) [2023-12-26 10:45:38,257][123090] Updated weights for policy 1, policy_version 1389020 (0.0009) [2023-12-26 10:45:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 713613312. Throughput: 0: 8711.2, 1: 8756.0. Samples: 713590180. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:38,785][121949] Avg episode reward: [(0, '6231.218'), (1, '5923.268')] [2023-12-26 10:45:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001398512_358023168.pth... [2023-12-26 10:45:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001389024_355590144.pth... [2023-12-26 10:45:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001388000_355328000.pth [2023-12-26 10:45:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001397520_357769216.pth [2023-12-26 10:45:39,028][123091] Updated weights for policy 0, policy_version 1398516 (0.0008) [2023-12-26 10:45:39,084][123090] Updated weights for policy 1, policy_version 1389030 (0.0007) [2023-12-26 10:45:39,086][123091] Updated weights for policy 0, policy_version 1398527 (0.0009) [2023-12-26 10:45:39,134][123091] Updated weights for policy 0, policy_version 1398537 (0.0008) [2023-12-26 10:45:39,144][123090] Updated weights for policy 1, policy_version 1389040 (0.0009) [2023-12-26 10:45:39,203][123090] Updated weights for policy 1, policy_version 1389050 (0.0010) [2023-12-26 10:45:40,053][123091] Updated weights for policy 0, policy_version 1398547 (0.0007) [2023-12-26 10:45:40,054][123090] Updated weights for policy 1, policy_version 1389060 (0.0009) [2023-12-26 10:45:40,111][123090] Updated weights for policy 1, policy_version 1389070 (0.0006) [2023-12-26 10:45:40,111][123091] Updated weights for policy 0, policy_version 1398557 (0.0008) [2023-12-26 10:45:40,171][123090] Updated weights for policy 1, policy_version 1389080 (0.0011) [2023-12-26 10:45:40,174][123091] Updated weights for policy 0, policy_version 1398567 (0.0009) [2023-12-26 10:45:40,958][123091] Updated weights for policy 0, policy_version 1398577 (0.0006) [2023-12-26 10:45:40,996][123090] Updated weights for policy 1, policy_version 1389090 (0.0011) [2023-12-26 10:45:41,024][123091] Updated weights for policy 0, policy_version 1398587 (0.0007) [2023-12-26 10:45:41,059][123090] Updated weights for policy 1, policy_version 1389100 (0.0010) [2023-12-26 10:45:41,097][123091] Updated weights for policy 0, policy_version 1398597 (0.0010) [2023-12-26 10:45:41,124][123090] Updated weights for policy 1, policy_version 1389110 (0.0011) [2023-12-26 10:45:41,168][123091] Updated weights for policy 0, policy_version 1398607 (0.0014) [2023-12-26 10:45:41,190][123090] Updated weights for policy 1, policy_version 1389120 (0.0010) [2023-12-26 10:45:41,997][123091] Updated weights for policy 0, policy_version 1398617 (0.0007) [2023-12-26 10:45:42,054][123091] Updated weights for policy 0, policy_version 1398627 (0.0011) [2023-12-26 10:45:42,054][123090] Updated weights for policy 1, policy_version 1389130 (0.0011) [2023-12-26 10:45:42,107][123091] Updated weights for policy 0, policy_version 1398637 (0.0010) [2023-12-26 10:45:42,107][123090] Updated weights for policy 1, policy_version 1389140 (0.0011) [2023-12-26 10:45:42,179][123090] Updated weights for policy 1, policy_version 1389150 (0.0009) [2023-12-26 10:45:42,958][123091] Updated weights for policy 0, policy_version 1398647 (0.0009) [2023-12-26 10:45:42,994][123090] Updated weights for policy 1, policy_version 1389160 (0.0010) [2023-12-26 10:45:43,020][123091] Updated weights for policy 0, policy_version 1398657 (0.0006) [2023-12-26 10:45:43,055][123090] Updated weights for policy 1, policy_version 1389170 (0.0011) [2023-12-26 10:45:43,085][123091] Updated weights for policy 0, policy_version 1398667 (0.0006) [2023-12-26 10:45:43,119][123090] Updated weights for policy 1, policy_version 1389180 (0.0007) [2023-12-26 10:45:43,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17772.5). Total num frames: 713695232. Throughput: 0: 8674.0, 1: 8685.6. Samples: 713693332. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:43,785][121949] Avg episode reward: [(0, '6127.880'), (1, '5999.051')] [2023-12-26 10:45:43,852][123090] Updated weights for policy 1, policy_version 1389190 (0.0005) [2023-12-26 10:45:43,912][123090] Updated weights for policy 1, policy_version 1389200 (0.0005) [2023-12-26 10:45:43,956][123090] Updated weights for policy 1, policy_version 1389210 (0.0007) [2023-12-26 10:45:43,975][123091] Updated weights for policy 0, policy_version 1398677 (0.0009) [2023-12-26 10:45:44,035][123091] Updated weights for policy 0, policy_version 1398687 (0.0008) [2023-12-26 10:45:44,096][123091] Updated weights for policy 0, policy_version 1398697 (0.0010) [2023-12-26 10:45:44,530][123090] Updated weights for policy 1, policy_version 1389220 (0.0005) [2023-12-26 10:45:44,591][123090] Updated weights for policy 1, policy_version 1389230 (0.0007) [2023-12-26 10:45:44,655][123090] Updated weights for policy 1, policy_version 1389240 (0.0009) [2023-12-26 10:45:44,992][123091] Updated weights for policy 0, policy_version 1398707 (0.0008) [2023-12-26 10:45:45,067][123091] Updated weights for policy 0, policy_version 1398717 (0.0006) [2023-12-26 10:45:45,138][123091] Updated weights for policy 0, policy_version 1398727 (0.0006) [2023-12-26 10:45:45,428][123090] Updated weights for policy 1, policy_version 1389250 (0.0010) [2023-12-26 10:45:45,498][123090] Updated weights for policy 1, policy_version 1389260 (0.0011) [2023-12-26 10:45:45,556][123090] Updated weights for policy 1, policy_version 1389270 (0.0010) [2023-12-26 10:45:45,608][123090] Updated weights for policy 1, policy_version 1389280 (0.0010) [2023-12-26 10:45:45,853][123091] Updated weights for policy 0, policy_version 1398737 (0.0006) [2023-12-26 10:45:45,924][123091] Updated weights for policy 0, policy_version 1398747 (0.0006) [2023-12-26 10:45:45,994][123091] Updated weights for policy 0, policy_version 1398757 (0.0010) [2023-12-26 10:45:46,062][123091] Updated weights for policy 0, policy_version 1398767 (0.0005) [2023-12-26 10:45:46,377][123090] Updated weights for policy 1, policy_version 1389290 (0.0008) [2023-12-26 10:45:46,443][123090] Updated weights for policy 1, policy_version 1389300 (0.0008) [2023-12-26 10:45:46,510][123090] Updated weights for policy 1, policy_version 1389310 (0.0008) [2023-12-26 10:45:46,767][123091] Updated weights for policy 0, policy_version 1398777 (0.0010) [2023-12-26 10:45:46,832][123091] Updated weights for policy 0, policy_version 1398787 (0.0010) [2023-12-26 10:45:46,898][123091] Updated weights for policy 0, policy_version 1398797 (0.0011) [2023-12-26 10:45:47,320][123090] Updated weights for policy 1, policy_version 1389320 (0.0010) [2023-12-26 10:45:47,387][123090] Updated weights for policy 1, policy_version 1389330 (0.0007) [2023-12-26 10:45:47,459][123090] Updated weights for policy 1, policy_version 1389340 (0.0005) [2023-12-26 10:45:47,700][123091] Updated weights for policy 0, policy_version 1398807 (0.0010) [2023-12-26 10:45:47,756][123091] Updated weights for policy 0, policy_version 1398817 (0.0006) [2023-12-26 10:45:47,817][123091] Updated weights for policy 0, policy_version 1398827 (0.0005) [2023-12-26 10:45:48,211][123090] Updated weights for policy 1, policy_version 1389350 (0.0009) [2023-12-26 10:45:48,263][123090] Updated weights for policy 1, policy_version 1389360 (0.0009) [2023-12-26 10:45:48,316][123090] Updated weights for policy 1, policy_version 1389370 (0.0009) [2023-12-26 10:45:48,583][123091] Updated weights for policy 0, policy_version 1398837 (0.0008) [2023-12-26 10:45:48,643][123091] Updated weights for policy 0, policy_version 1398847 (0.0011) [2023-12-26 10:45:48,699][123091] Updated weights for policy 0, policy_version 1398857 (0.0011) [2023-12-26 10:45:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 713793536. Throughput: 0: 8666.0, 1: 8756.7. Samples: 713800608. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:48,785][121949] Avg episode reward: [(0, '6148.581'), (1, '5955.768')] [2023-12-26 10:45:49,130][123090] Updated weights for policy 1, policy_version 1389380 (0.0008) [2023-12-26 10:45:49,177][123090] Updated weights for policy 1, policy_version 1389390 (0.0005) [2023-12-26 10:45:49,240][123090] Updated weights for policy 1, policy_version 1389400 (0.0006) [2023-12-26 10:45:49,561][123091] Updated weights for policy 0, policy_version 1398867 (0.0011) [2023-12-26 10:45:49,627][123091] Updated weights for policy 0, policy_version 1398877 (0.0011) [2023-12-26 10:45:49,687][123091] Updated weights for policy 0, policy_version 1398887 (0.0011) [2023-12-26 10:45:49,988][123090] Updated weights for policy 1, policy_version 1389410 (0.0008) [2023-12-26 10:45:50,052][123090] Updated weights for policy 1, policy_version 1389420 (0.0009) [2023-12-26 10:45:50,118][123090] Updated weights for policy 1, policy_version 1389430 (0.0010) [2023-12-26 10:45:50,184][123090] Updated weights for policy 1, policy_version 1389440 (0.0009) [2023-12-26 10:45:50,419][123091] Updated weights for policy 0, policy_version 1398897 (0.0010) [2023-12-26 10:45:50,482][123091] Updated weights for policy 0, policy_version 1398907 (0.0006) [2023-12-26 10:45:50,529][123091] Updated weights for policy 0, policy_version 1398917 (0.0010) [2023-12-26 10:45:50,593][123091] Updated weights for policy 0, policy_version 1398927 (0.0011) [2023-12-26 10:45:51,044][123090] Updated weights for policy 1, policy_version 1389450 (0.0007) [2023-12-26 10:45:51,109][123090] Updated weights for policy 1, policy_version 1389460 (0.0006) [2023-12-26 10:45:51,180][123090] Updated weights for policy 1, policy_version 1389470 (0.0007) [2023-12-26 10:45:51,461][123091] Updated weights for policy 0, policy_version 1398937 (0.0007) [2023-12-26 10:45:51,535][123091] Updated weights for policy 0, policy_version 1398947 (0.0011) [2023-12-26 10:45:51,603][123091] Updated weights for policy 0, policy_version 1398957 (0.0011) [2023-12-26 10:45:51,954][123090] Updated weights for policy 1, policy_version 1389480 (0.0009) [2023-12-26 10:45:52,025][123090] Updated weights for policy 1, policy_version 1389490 (0.0009) [2023-12-26 10:45:52,100][123090] Updated weights for policy 1, policy_version 1389500 (0.0009) [2023-12-26 10:45:52,467][123091] Updated weights for policy 0, policy_version 1398967 (0.0011) [2023-12-26 10:45:52,523][123091] Updated weights for policy 0, policy_version 1398977 (0.0011) [2023-12-26 10:45:52,590][123091] Updated weights for policy 0, policy_version 1398987 (0.0011) [2023-12-26 10:45:52,941][123090] Updated weights for policy 1, policy_version 1389510 (0.0009) [2023-12-26 10:45:52,999][123090] Updated weights for policy 1, policy_version 1389520 (0.0009) [2023-12-26 10:45:53,064][123090] Updated weights for policy 1, policy_version 1389530 (0.0010) [2023-12-26 10:45:53,430][123091] Updated weights for policy 0, policy_version 1398997 (0.0008) [2023-12-26 10:45:53,496][123091] Updated weights for policy 0, policy_version 1399007 (0.0006) [2023-12-26 10:45:53,572][123091] Updated weights for policy 0, policy_version 1399017 (0.0006) [2023-12-26 10:45:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 713875456. Throughput: 0: 8574.8, 1: 8746.1. Samples: 713854024. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:53,785][121949] Avg episode reward: [(0, '6266.784'), (1, '5954.683')] [2023-12-26 10:45:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001399024_358154240.pth... [2023-12-26 10:45:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001389536_355721216.pth... [2023-12-26 10:45:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001398000_357892096.pth [2023-12-26 10:45:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001388512_355459072.pth [2023-12-26 10:45:53,925][123090] Updated weights for policy 1, policy_version 1389540 (0.0010) [2023-12-26 10:45:53,978][123090] Updated weights for policy 1, policy_version 1389551 (0.0010) [2023-12-26 10:45:54,039][123090] Updated weights for policy 1, policy_version 1389561 (0.0009) [2023-12-26 10:45:54,110][123091] Updated weights for policy 0, policy_version 1399027 (0.0007) [2023-12-26 10:45:54,170][123091] Updated weights for policy 0, policy_version 1399037 (0.0011) [2023-12-26 10:45:54,236][123091] Updated weights for policy 0, policy_version 1399047 (0.0011) [2023-12-26 10:45:54,888][123090] Updated weights for policy 1, policy_version 1389572 (0.0010) [2023-12-26 10:45:54,945][123090] Updated weights for policy 1, policy_version 1389582 (0.0008) [2023-12-26 10:45:55,017][123090] Updated weights for policy 1, policy_version 1389592 (0.0005) [2023-12-26 10:45:55,039][123091] Updated weights for policy 0, policy_version 1399057 (0.0010) [2023-12-26 10:45:55,099][123091] Updated weights for policy 0, policy_version 1399067 (0.0006) [2023-12-26 10:45:55,153][123091] Updated weights for policy 0, policy_version 1399077 (0.0006) [2023-12-26 10:45:55,215][123091] Updated weights for policy 0, policy_version 1399087 (0.0006) [2023-12-26 10:45:55,720][123090] Updated weights for policy 1, policy_version 1389602 (0.0006) [2023-12-26 10:45:55,792][123090] Updated weights for policy 1, policy_version 1389612 (0.0005) [2023-12-26 10:45:55,853][123090] Updated weights for policy 1, policy_version 1389622 (0.0005) [2023-12-26 10:45:55,914][123090] Updated weights for policy 1, policy_version 1389632 (0.0005) [2023-12-26 10:45:56,000][123091] Updated weights for policy 0, policy_version 1399097 (0.0010) [2023-12-26 10:45:56,050][123091] Updated weights for policy 0, policy_version 1399107 (0.0010) [2023-12-26 10:45:56,112][123091] Updated weights for policy 0, policy_version 1399117 (0.0010) [2023-12-26 10:45:56,636][123090] Updated weights for policy 1, policy_version 1389642 (0.0006) [2023-12-26 10:45:56,683][123090] Updated weights for policy 1, policy_version 1389652 (0.0005) [2023-12-26 10:45:56,728][123090] Updated weights for policy 1, policy_version 1389662 (0.0005) [2023-12-26 10:45:56,918][123091] Updated weights for policy 0, policy_version 1399127 (0.0010) [2023-12-26 10:45:56,982][123091] Updated weights for policy 0, policy_version 1399137 (0.0006) [2023-12-26 10:45:57,038][123091] Updated weights for policy 0, policy_version 1399147 (0.0006) [2023-12-26 10:45:57,427][123090] Updated weights for policy 1, policy_version 1389672 (0.0010) [2023-12-26 10:45:57,501][123090] Updated weights for policy 1, policy_version 1389682 (0.0010) [2023-12-26 10:45:57,549][123090] Updated weights for policy 1, policy_version 1389692 (0.0007) [2023-12-26 10:45:57,737][123091] Updated weights for policy 0, policy_version 1399157 (0.0008) [2023-12-26 10:45:57,788][123091] Updated weights for policy 0, policy_version 1399167 (0.0010) [2023-12-26 10:45:57,853][123091] Updated weights for policy 0, policy_version 1399177 (0.0010) [2023-12-26 10:45:58,305][123090] Updated weights for policy 1, policy_version 1389702 (0.0008) [2023-12-26 10:45:58,381][123090] Updated weights for policy 1, policy_version 1389712 (0.0009) [2023-12-26 10:45:58,448][123090] Updated weights for policy 1, policy_version 1389722 (0.0010) [2023-12-26 10:45:58,762][123091] Updated weights for policy 0, policy_version 1399187 (0.0010) [2023-12-26 10:45:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 713965568. Throughput: 0: 8617.3, 1: 8801.4. Samples: 713961512. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:45:58,785][121949] Avg episode reward: [(0, '6333.581'), (1, '5927.107')] [2023-12-26 10:45:58,829][123091] Updated weights for policy 0, policy_version 1399197 (0.0008) [2023-12-26 10:45:58,877][123091] Updated weights for policy 0, policy_version 1399207 (0.0008) [2023-12-26 10:45:59,335][123090] Updated weights for policy 1, policy_version 1389732 (0.0009) [2023-12-26 10:45:59,403][123090] Updated weights for policy 1, policy_version 1389742 (0.0009) [2023-12-26 10:45:59,469][123090] Updated weights for policy 1, policy_version 1389752 (0.0010) [2023-12-26 10:45:59,713][123091] Updated weights for policy 0, policy_version 1399217 (0.0008) [2023-12-26 10:45:59,772][123091] Updated weights for policy 0, policy_version 1399227 (0.0009) [2023-12-26 10:45:59,828][123091] Updated weights for policy 0, policy_version 1399237 (0.0009) [2023-12-26 10:45:59,885][123091] Updated weights for policy 0, policy_version 1399247 (0.0009) [2023-12-26 10:46:00,287][123090] Updated weights for policy 1, policy_version 1389762 (0.0010) [2023-12-26 10:46:00,334][123090] Updated weights for policy 1, policy_version 1389772 (0.0010) [2023-12-26 10:46:00,397][123090] Updated weights for policy 1, policy_version 1389782 (0.0010) [2023-12-26 10:46:00,453][123090] Updated weights for policy 1, policy_version 1389792 (0.0010) [2023-12-26 10:46:00,718][123091] Updated weights for policy 0, policy_version 1399257 (0.0007) [2023-12-26 10:46:00,764][123091] Updated weights for policy 0, policy_version 1399267 (0.0009) [2023-12-26 10:46:00,813][123091] Updated weights for policy 0, policy_version 1399277 (0.0009) [2023-12-26 10:46:01,250][123090] Updated weights for policy 1, policy_version 1389802 (0.0008) [2023-12-26 10:46:01,311][123090] Updated weights for policy 1, policy_version 1389812 (0.0006) [2023-12-26 10:46:01,385][123090] Updated weights for policy 1, policy_version 1389822 (0.0008) [2023-12-26 10:46:01,690][123091] Updated weights for policy 0, policy_version 1399287 (0.0009) [2023-12-26 10:46:01,745][123091] Updated weights for policy 0, policy_version 1399297 (0.0009) [2023-12-26 10:46:01,817][123091] Updated weights for policy 0, policy_version 1399307 (0.0009) [2023-12-26 10:46:02,192][123090] Updated weights for policy 1, policy_version 1389832 (0.0010) [2023-12-26 10:46:02,265][123090] Updated weights for policy 1, policy_version 1389842 (0.0010) [2023-12-26 10:46:02,337][123090] Updated weights for policy 1, policy_version 1389852 (0.0010) [2023-12-26 10:46:02,645][123091] Updated weights for policy 0, policy_version 1399317 (0.0007) [2023-12-26 10:46:02,703][123091] Updated weights for policy 0, policy_version 1399327 (0.0006) [2023-12-26 10:46:02,769][123091] Updated weights for policy 0, policy_version 1399337 (0.0006) [2023-12-26 10:46:03,086][123090] Updated weights for policy 1, policy_version 1389862 (0.0006) [2023-12-26 10:46:03,134][123090] Updated weights for policy 1, policy_version 1389872 (0.0005) [2023-12-26 10:46:03,181][123090] Updated weights for policy 1, policy_version 1389882 (0.0005) [2023-12-26 10:46:03,329][123091] Updated weights for policy 0, policy_version 1399347 (0.0006) [2023-12-26 10:46:03,387][123091] Updated weights for policy 0, policy_version 1399357 (0.0006) [2023-12-26 10:46:03,446][123091] Updated weights for policy 0, policy_version 1399367 (0.0006) [2023-12-26 10:46:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 714055680. Throughput: 0: 8698.1, 1: 8789.0. Samples: 714067160. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:03,785][121949] Avg episode reward: [(0, '6329.763'), (1, '5847.123')] [2023-12-26 10:46:03,996][123090] Updated weights for policy 1, policy_version 1389892 (0.0007) [2023-12-26 10:46:04,062][123090] Updated weights for policy 1, policy_version 1389902 (0.0010) [2023-12-26 10:46:04,127][123090] Updated weights for policy 1, policy_version 1389912 (0.0010) [2023-12-26 10:46:04,163][123091] Updated weights for policy 0, policy_version 1399377 (0.0007) [2023-12-26 10:46:04,225][123091] Updated weights for policy 0, policy_version 1399387 (0.0006) [2023-12-26 10:46:04,287][123091] Updated weights for policy 0, policy_version 1399397 (0.0009) [2023-12-26 10:46:04,355][123091] Updated weights for policy 0, policy_version 1399407 (0.0009) [2023-12-26 10:46:04,895][123090] Updated weights for policy 1, policy_version 1389922 (0.0008) [2023-12-26 10:46:04,960][123090] Updated weights for policy 1, policy_version 1389932 (0.0005) [2023-12-26 10:46:05,021][123090] Updated weights for policy 1, policy_version 1389942 (0.0005) [2023-12-26 10:46:05,073][123090] Updated weights for policy 1, policy_version 1389952 (0.0006) [2023-12-26 10:46:05,101][123091] Updated weights for policy 0, policy_version 1399417 (0.0006) [2023-12-26 10:46:05,165][123091] Updated weights for policy 0, policy_version 1399427 (0.0005) [2023-12-26 10:46:05,235][123091] Updated weights for policy 0, policy_version 1399437 (0.0005) [2023-12-26 10:46:05,745][123090] Updated weights for policy 1, policy_version 1389962 (0.0006) [2023-12-26 10:46:05,811][123090] Updated weights for policy 1, policy_version 1389972 (0.0010) [2023-12-26 10:46:05,871][123090] Updated weights for policy 1, policy_version 1389982 (0.0008) [2023-12-26 10:46:05,890][123091] Updated weights for policy 0, policy_version 1399447 (0.0009) [2023-12-26 10:46:05,939][123091] Updated weights for policy 0, policy_version 1399457 (0.0005) [2023-12-26 10:46:05,999][123091] Updated weights for policy 0, policy_version 1399467 (0.0005) [2023-12-26 10:46:06,633][123090] Updated weights for policy 1, policy_version 1389992 (0.0009) [2023-12-26 10:46:06,706][123090] Updated weights for policy 1, policy_version 1390002 (0.0010) [2023-12-26 10:46:06,717][123091] Updated weights for policy 0, policy_version 1399477 (0.0006) [2023-12-26 10:46:06,769][123090] Updated weights for policy 1, policy_version 1390012 (0.0007) [2023-12-26 10:46:06,774][123091] Updated weights for policy 0, policy_version 1399487 (0.0009) [2023-12-26 10:46:06,831][123091] Updated weights for policy 0, policy_version 1399497 (0.0009) [2023-12-26 10:46:07,470][123090] Updated weights for policy 1, policy_version 1390022 (0.0008) [2023-12-26 10:46:07,539][123090] Updated weights for policy 1, policy_version 1390032 (0.0010) [2023-12-26 10:46:07,608][123090] Updated weights for policy 1, policy_version 1390042 (0.0007) [2023-12-26 10:46:07,719][123091] Updated weights for policy 0, policy_version 1399507 (0.0008) [2023-12-26 10:46:07,792][123091] Updated weights for policy 0, policy_version 1399517 (0.0005) [2023-12-26 10:46:07,861][123091] Updated weights for policy 0, policy_version 1399527 (0.0005) [2023-12-26 10:46:08,325][123090] Updated weights for policy 1, policy_version 1390052 (0.0008) [2023-12-26 10:46:08,392][123090] Updated weights for policy 1, policy_version 1390062 (0.0009) [2023-12-26 10:46:08,484][123091] Updated weights for policy 0, policy_version 1399537 (0.0005) [2023-12-26 10:46:08,493][123090] Updated weights for policy 1, policy_version 1390072 (0.0009) [2023-12-26 10:46:08,539][123091] Updated weights for policy 0, policy_version 1399547 (0.0006) [2023-12-26 10:46:08,599][123091] Updated weights for policy 0, policy_version 1399557 (0.0007) [2023-12-26 10:46:08,666][123091] Updated weights for policy 0, policy_version 1399567 (0.0010) [2023-12-26 10:46:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 714153984. Throughput: 0: 8834.1, 1: 8874.0. Samples: 714124552. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:08,785][121949] Avg episode reward: [(0, '6257.075'), (1, '5843.541')] [2023-12-26 10:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001399568_358293504.pth... [2023-12-26 10:46:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001390080_355860480.pth... [2023-12-26 10:46:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001389024_355590144.pth [2023-12-26 10:46:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001398512_358023168.pth [2023-12-26 10:46:09,339][123090] Updated weights for policy 1, policy_version 1390082 (0.0009) [2023-12-26 10:46:09,386][123091] Updated weights for policy 0, policy_version 1399577 (0.0008) [2023-12-26 10:46:09,406][123090] Updated weights for policy 1, policy_version 1390092 (0.0009) [2023-12-26 10:46:09,455][123091] Updated weights for policy 0, policy_version 1399587 (0.0009) [2023-12-26 10:46:09,475][123090] Updated weights for policy 1, policy_version 1390102 (0.0009) [2023-12-26 10:46:09,517][123091] Updated weights for policy 0, policy_version 1399597 (0.0009) [2023-12-26 10:46:09,540][123090] Updated weights for policy 1, policy_version 1390112 (0.0010) [2023-12-26 10:46:10,307][123091] Updated weights for policy 0, policy_version 1399607 (0.0006) [2023-12-26 10:46:10,382][123091] Updated weights for policy 0, policy_version 1399617 (0.0007) [2023-12-26 10:46:10,423][123090] Updated weights for policy 1, policy_version 1390122 (0.0009) [2023-12-26 10:46:10,450][123091] Updated weights for policy 0, policy_version 1399627 (0.0006) [2023-12-26 10:46:10,492][123090] Updated weights for policy 1, policy_version 1390132 (0.0008) [2023-12-26 10:46:10,548][123090] Updated weights for policy 1, policy_version 1390142 (0.0010) [2023-12-26 10:46:11,131][123091] Updated weights for policy 0, policy_version 1399637 (0.0008) [2023-12-26 10:46:11,199][123091] Updated weights for policy 0, policy_version 1399647 (0.0007) [2023-12-26 10:46:11,273][123091] Updated weights for policy 0, policy_version 1399657 (0.0008) [2023-12-26 10:46:11,359][123090] Updated weights for policy 1, policy_version 1390152 (0.0011) [2023-12-26 10:46:11,422][123090] Updated weights for policy 1, policy_version 1390162 (0.0006) [2023-12-26 10:46:11,477][123090] Updated weights for policy 1, policy_version 1390172 (0.0008) [2023-12-26 10:46:12,048][123091] Updated weights for policy 0, policy_version 1399667 (0.0009) [2023-12-26 10:46:12,110][123091] Updated weights for policy 0, policy_version 1399677 (0.0006) [2023-12-26 10:46:12,178][123091] Updated weights for policy 0, policy_version 1399687 (0.0008) [2023-12-26 10:46:12,280][123090] Updated weights for policy 1, policy_version 1390182 (0.0006) [2023-12-26 10:46:12,346][123090] Updated weights for policy 1, policy_version 1390192 (0.0008) [2023-12-26 10:46:12,415][123090] Updated weights for policy 1, policy_version 1390202 (0.0011) [2023-12-26 10:46:12,904][123091] Updated weights for policy 0, policy_version 1399697 (0.0009) [2023-12-26 10:46:12,956][123091] Updated weights for policy 0, policy_version 1399707 (0.0009) [2023-12-26 10:46:13,006][123091] Updated weights for policy 0, policy_version 1399717 (0.0009) [2023-12-26 10:46:13,062][123091] Updated weights for policy 0, policy_version 1399727 (0.0009) [2023-12-26 10:46:13,206][123090] Updated weights for policy 1, policy_version 1390212 (0.0008) [2023-12-26 10:46:13,257][123090] Updated weights for policy 1, policy_version 1390222 (0.0010) [2023-12-26 10:46:13,316][123090] Updated weights for policy 1, policy_version 1390232 (0.0010) [2023-12-26 10:46:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 714235904. Throughput: 0: 8943.9, 1: 8838.1. Samples: 714231568. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:13,785][121949] Avg episode reward: [(0, '6221.154'), (1, '5855.382')] [2023-12-26 10:46:13,902][123091] Updated weights for policy 0, policy_version 1399737 (0.0007) [2023-12-26 10:46:13,955][123091] Updated weights for policy 0, policy_version 1399747 (0.0010) [2023-12-26 10:46:13,969][123090] Updated weights for policy 1, policy_version 1390242 (0.0009) [2023-12-26 10:46:14,005][123091] Updated weights for policy 0, policy_version 1399757 (0.0009) [2023-12-26 10:46:14,022][123090] Updated weights for policy 1, policy_version 1390252 (0.0006) [2023-12-26 10:46:14,080][123090] Updated weights for policy 1, policy_version 1390262 (0.0005) [2023-12-26 10:46:14,143][123090] Updated weights for policy 1, policy_version 1390272 (0.0010) [2023-12-26 10:46:14,631][123091] Updated weights for policy 0, policy_version 1399767 (0.0008) [2023-12-26 10:46:14,682][123091] Updated weights for policy 0, policy_version 1399777 (0.0008) [2023-12-26 10:46:14,730][123091] Updated weights for policy 0, policy_version 1399787 (0.0009) [2023-12-26 10:46:14,919][123090] Updated weights for policy 1, policy_version 1390282 (0.0005) [2023-12-26 10:46:14,980][123090] Updated weights for policy 1, policy_version 1390292 (0.0011) [2023-12-26 10:46:15,046][123090] Updated weights for policy 1, policy_version 1390302 (0.0011) [2023-12-26 10:46:15,612][123091] Updated weights for policy 0, policy_version 1399797 (0.0009) [2023-12-26 10:46:15,684][123091] Updated weights for policy 0, policy_version 1399807 (0.0007) [2023-12-26 10:46:15,744][123091] Updated weights for policy 0, policy_version 1399817 (0.0009) [2023-12-26 10:46:15,863][123090] Updated weights for policy 1, policy_version 1390312 (0.0011) [2023-12-26 10:46:15,912][123090] Updated weights for policy 1, policy_version 1390322 (0.0010) [2023-12-26 10:46:15,965][123090] Updated weights for policy 1, policy_version 1390332 (0.0007) [2023-12-26 10:46:16,549][123091] Updated weights for policy 0, policy_version 1399827 (0.0008) [2023-12-26 10:46:16,604][123091] Updated weights for policy 0, policy_version 1399838 (0.0010) [2023-12-26 10:46:16,661][123091] Updated weights for policy 0, policy_version 1399848 (0.0010) [2023-12-26 10:46:16,707][123090] Updated weights for policy 1, policy_version 1390342 (0.0006) [2023-12-26 10:46:16,769][123090] Updated weights for policy 1, policy_version 1390352 (0.0006) [2023-12-26 10:46:16,854][123090] Updated weights for policy 1, policy_version 1390362 (0.0005) [2023-12-26 10:46:17,454][123091] Updated weights for policy 0, policy_version 1399858 (0.0008) [2023-12-26 10:46:17,493][123090] Updated weights for policy 1, policy_version 1390372 (0.0006) [2023-12-26 10:46:17,509][123091] Updated weights for policy 0, policy_version 1399868 (0.0010) [2023-12-26 10:46:17,555][123090] Updated weights for policy 1, policy_version 1390382 (0.0010) [2023-12-26 10:46:17,556][123091] Updated weights for policy 0, policy_version 1399878 (0.0010) [2023-12-26 10:46:17,608][123091] Updated weights for policy 0, policy_version 1399888 (0.0010) [2023-12-26 10:46:17,615][123090] Updated weights for policy 1, policy_version 1390392 (0.0010) [2023-12-26 10:46:18,434][123090] Updated weights for policy 1, policy_version 1390402 (0.0010) [2023-12-26 10:46:18,472][123091] Updated weights for policy 0, policy_version 1399898 (0.0010) [2023-12-26 10:46:18,504][123090] Updated weights for policy 1, policy_version 1390412 (0.0005) [2023-12-26 10:46:18,525][123091] Updated weights for policy 0, policy_version 1399908 (0.0009) [2023-12-26 10:46:18,576][123090] Updated weights for policy 1, policy_version 1390422 (0.0007) [2023-12-26 10:46:18,582][123091] Updated weights for policy 0, policy_version 1399918 (0.0010) [2023-12-26 10:46:18,636][123090] Updated weights for policy 1, policy_version 1390432 (0.0009) [2023-12-26 10:46:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 714334208. Throughput: 0: 8952.2, 1: 8908.0. Samples: 714341068. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:18,785][121949] Avg episode reward: [(0, '6241.879'), (1, '5711.248')] [2023-12-26 10:46:19,286][123091] Updated weights for policy 0, policy_version 1399928 (0.0010) [2023-12-26 10:46:19,345][123091] Updated weights for policy 0, policy_version 1399938 (0.0009) [2023-12-26 10:46:19,379][123090] Updated weights for policy 1, policy_version 1390442 (0.0006) [2023-12-26 10:46:19,409][123091] Updated weights for policy 0, policy_version 1399948 (0.0009) [2023-12-26 10:46:19,429][123090] Updated weights for policy 1, policy_version 1390452 (0.0005) [2023-12-26 10:46:19,491][123090] Updated weights for policy 1, policy_version 1390462 (0.0006) [2023-12-26 10:46:20,283][123091] Updated weights for policy 0, policy_version 1399958 (0.0009) [2023-12-26 10:46:20,301][123090] Updated weights for policy 1, policy_version 1390472 (0.0009) [2023-12-26 10:46:20,337][123091] Updated weights for policy 0, policy_version 1399968 (0.0009) [2023-12-26 10:46:20,366][123090] Updated weights for policy 1, policy_version 1390482 (0.0008) [2023-12-26 10:46:20,394][123091] Updated weights for policy 0, policy_version 1399978 (0.0009) [2023-12-26 10:46:20,431][123090] Updated weights for policy 1, policy_version 1390492 (0.0007) [2023-12-26 10:46:21,223][123091] Updated weights for policy 0, policy_version 1399988 (0.0008) [2023-12-26 10:46:21,285][123091] Updated weights for policy 0, policy_version 1399998 (0.0008) [2023-12-26 10:46:21,294][123090] Updated weights for policy 1, policy_version 1390502 (0.0010) [2023-12-26 10:46:21,352][123091] Updated weights for policy 0, policy_version 1400008 (0.0008) [2023-12-26 10:46:21,367][123090] Updated weights for policy 1, policy_version 1390512 (0.0011) [2023-12-26 10:46:21,431][123090] Updated weights for policy 1, policy_version 1390522 (0.0011) [2023-12-26 10:46:22,183][123091] Updated weights for policy 0, policy_version 1400018 (0.0009) [2023-12-26 10:46:22,240][123091] Updated weights for policy 0, policy_version 1400028 (0.0009) [2023-12-26 10:46:22,293][123090] Updated weights for policy 1, policy_version 1390532 (0.0011) [2023-12-26 10:46:22,304][123091] Updated weights for policy 0, policy_version 1400038 (0.0010) [2023-12-26 10:46:22,367][123090] Updated weights for policy 1, policy_version 1390542 (0.0011) [2023-12-26 10:46:22,378][123091] Updated weights for policy 0, policy_version 1400048 (0.0008) [2023-12-26 10:46:22,431][123090] Updated weights for policy 1, policy_version 1390552 (0.0011) [2023-12-26 10:46:23,186][123090] Updated weights for policy 1, policy_version 1390562 (0.0010) [2023-12-26 10:46:23,244][123090] Updated weights for policy 1, policy_version 1390572 (0.0007) [2023-12-26 10:46:23,279][123091] Updated weights for policy 0, policy_version 1400058 (0.0008) [2023-12-26 10:46:23,302][123090] Updated weights for policy 1, policy_version 1390582 (0.0006) [2023-12-26 10:46:23,346][123091] Updated weights for policy 0, policy_version 1400068 (0.0009) [2023-12-26 10:46:23,354][123090] Updated weights for policy 1, policy_version 1390592 (0.0005) [2023-12-26 10:46:23,405][123091] Updated weights for policy 0, policy_version 1400078 (0.0010) [2023-12-26 10:46:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 714416128. Throughput: 0: 8961.7, 1: 8886.6. Samples: 714393352. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:23,785][121949] Avg episode reward: [(0, '6187.042'), (1, '5582.039')] [2023-12-26 10:46:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001400080_358424576.pth... [2023-12-26 10:46:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001390592_355991552.pth... [2023-12-26 10:46:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001399024_358154240.pth [2023-12-26 10:46:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001389536_355721216.pth [2023-12-26 10:46:24,103][123090] Updated weights for policy 1, policy_version 1390602 (0.0009) [2023-12-26 10:46:24,165][123090] Updated weights for policy 1, policy_version 1390612 (0.0005) [2023-12-26 10:46:24,219][123090] Updated weights for policy 1, policy_version 1390622 (0.0007) [2023-12-26 10:46:24,248][123091] Updated weights for policy 0, policy_version 1400088 (0.0006) [2023-12-26 10:46:24,310][123091] Updated weights for policy 0, policy_version 1400098 (0.0006) [2023-12-26 10:46:24,361][123091] Updated weights for policy 0, policy_version 1400108 (0.0005) [2023-12-26 10:46:24,929][123090] Updated weights for policy 1, policy_version 1390632 (0.0006) [2023-12-26 10:46:24,982][123090] Updated weights for policy 1, policy_version 1390642 (0.0005) [2023-12-26 10:46:25,035][123090] Updated weights for policy 1, policy_version 1390652 (0.0005) [2023-12-26 10:46:25,085][123091] Updated weights for policy 0, policy_version 1400118 (0.0005) [2023-12-26 10:46:25,149][123091] Updated weights for policy 0, policy_version 1400128 (0.0005) [2023-12-26 10:46:25,226][123091] Updated weights for policy 0, policy_version 1400138 (0.0005) [2023-12-26 10:46:25,716][123090] Updated weights for policy 1, policy_version 1390662 (0.0006) [2023-12-26 10:46:25,770][123090] Updated weights for policy 1, policy_version 1390672 (0.0007) [2023-12-26 10:46:25,838][123090] Updated weights for policy 1, policy_version 1390682 (0.0008) [2023-12-26 10:46:25,877][123091] Updated weights for policy 0, policy_version 1400148 (0.0006) [2023-12-26 10:46:25,926][123091] Updated weights for policy 0, policy_version 1400158 (0.0010) [2023-12-26 10:46:25,984][123091] Updated weights for policy 0, policy_version 1400168 (0.0010) [2023-12-26 10:46:26,665][123090] Updated weights for policy 1, policy_version 1390692 (0.0010) [2023-12-26 10:46:26,672][123091] Updated weights for policy 0, policy_version 1400178 (0.0010) [2023-12-26 10:46:26,722][123091] Updated weights for policy 0, policy_version 1400188 (0.0009) [2023-12-26 10:46:26,726][123090] Updated weights for policy 1, policy_version 1390702 (0.0009) [2023-12-26 10:46:26,765][123091] Updated weights for policy 0, policy_version 1400198 (0.0010) [2023-12-26 10:46:26,786][123090] Updated weights for policy 1, policy_version 1390712 (0.0005) [2023-12-26 10:46:26,811][123091] Updated weights for policy 0, policy_version 1400208 (0.0009) [2023-12-26 10:46:27,537][123091] Updated weights for policy 0, policy_version 1400218 (0.0005) [2023-12-26 10:46:27,550][123090] Updated weights for policy 1, policy_version 1390722 (0.0007) [2023-12-26 10:46:27,585][123091] Updated weights for policy 0, policy_version 1400228 (0.0005) [2023-12-26 10:46:27,606][123090] Updated weights for policy 1, policy_version 1390732 (0.0005) [2023-12-26 10:46:27,633][123091] Updated weights for policy 0, policy_version 1400238 (0.0005) [2023-12-26 10:46:27,656][123090] Updated weights for policy 1, policy_version 1390742 (0.0005) [2023-12-26 10:46:27,706][123090] Updated weights for policy 1, policy_version 1390752 (0.0005) [2023-12-26 10:46:28,233][123091] Updated weights for policy 0, policy_version 1400248 (0.0005) [2023-12-26 10:46:28,280][123091] Updated weights for policy 0, policy_version 1400258 (0.0005) [2023-12-26 10:46:28,344][123091] Updated weights for policy 0, policy_version 1400268 (0.0006) [2023-12-26 10:46:28,530][123090] Updated weights for policy 1, policy_version 1390762 (0.0005) [2023-12-26 10:46:28,587][123090] Updated weights for policy 1, policy_version 1390772 (0.0005) [2023-12-26 10:46:28,642][123090] Updated weights for policy 1, policy_version 1390782 (0.0005) [2023-12-26 10:46:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 714514432. Throughput: 0: 9014.9, 1: 9015.4. Samples: 714504692. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:28,784][121949] Avg episode reward: [(0, '6193.889'), (1, '5624.258')] [2023-12-26 10:46:29,039][123091] Updated weights for policy 0, policy_version 1400278 (0.0010) [2023-12-26 10:46:29,104][123091] Updated weights for policy 0, policy_version 1400288 (0.0010) [2023-12-26 10:46:29,162][123091] Updated weights for policy 0, policy_version 1400298 (0.0010) [2023-12-26 10:46:29,408][123090] Updated weights for policy 1, policy_version 1390792 (0.0008) [2023-12-26 10:46:29,457][123090] Updated weights for policy 1, policy_version 1390802 (0.0009) [2023-12-26 10:46:29,512][123090] Updated weights for policy 1, policy_version 1390813 (0.0010) [2023-12-26 10:46:29,917][123091] Updated weights for policy 0, policy_version 1400308 (0.0011) [2023-12-26 10:46:29,977][123091] Updated weights for policy 0, policy_version 1400318 (0.0009) [2023-12-26 10:46:30,036][123091] Updated weights for policy 0, policy_version 1400328 (0.0009) [2023-12-26 10:46:30,393][123090] Updated weights for policy 1, policy_version 1390824 (0.0010) [2023-12-26 10:46:30,455][123090] Updated weights for policy 1, policy_version 1390834 (0.0010) [2023-12-26 10:46:30,506][123090] Updated weights for policy 1, policy_version 1390844 (0.0010) [2023-12-26 10:46:30,815][123091] Updated weights for policy 0, policy_version 1400338 (0.0008) [2023-12-26 10:46:30,861][123091] Updated weights for policy 0, policy_version 1400348 (0.0005) [2023-12-26 10:46:30,913][123091] Updated weights for policy 0, policy_version 1400358 (0.0005) [2023-12-26 10:46:30,957][123091] Updated weights for policy 0, policy_version 1400368 (0.0005) [2023-12-26 10:46:31,224][123090] Updated weights for policy 1, policy_version 1390854 (0.0007) [2023-12-26 10:46:31,294][123090] Updated weights for policy 1, policy_version 1390864 (0.0008) [2023-12-26 10:46:31,366][123090] Updated weights for policy 1, policy_version 1390874 (0.0008) [2023-12-26 10:46:31,685][123091] Updated weights for policy 0, policy_version 1400378 (0.0008) [2023-12-26 10:46:31,751][123091] Updated weights for policy 0, policy_version 1400388 (0.0009) [2023-12-26 10:46:31,804][123091] Updated weights for policy 0, policy_version 1400398 (0.0007) [2023-12-26 10:46:32,211][123090] Updated weights for policy 1, policy_version 1390884 (0.0009) [2023-12-26 10:46:32,269][123090] Updated weights for policy 1, policy_version 1390894 (0.0007) [2023-12-26 10:46:32,327][123090] Updated weights for policy 1, policy_version 1390904 (0.0010) [2023-12-26 10:46:32,536][123091] Updated weights for policy 0, policy_version 1400408 (0.0009) [2023-12-26 10:46:32,601][123091] Updated weights for policy 0, policy_version 1400418 (0.0010) [2023-12-26 10:46:32,660][123091] Updated weights for policy 0, policy_version 1400428 (0.0010) [2023-12-26 10:46:33,149][123090] Updated weights for policy 1, policy_version 1390914 (0.0009) [2023-12-26 10:46:33,198][123090] Updated weights for policy 1, policy_version 1390924 (0.0005) [2023-12-26 10:46:33,265][123090] Updated weights for policy 1, policy_version 1390934 (0.0005) [2023-12-26 10:46:33,320][123090] Updated weights for policy 1, policy_version 1390944 (0.0005) [2023-12-26 10:46:33,377][123091] Updated weights for policy 0, policy_version 1400438 (0.0007) [2023-12-26 10:46:33,442][123091] Updated weights for policy 0, policy_version 1400448 (0.0008) [2023-12-26 10:46:33,503][123091] Updated weights for policy 0, policy_version 1400458 (0.0006) [2023-12-26 10:46:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 714604544. Throughput: 0: 9162.2, 1: 8973.6. Samples: 714616720. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:33,785][121949] Avg episode reward: [(0, '6145.976'), (1, '5702.576')] [2023-12-26 10:46:33,870][123090] Updated weights for policy 1, policy_version 1390954 (0.0005) [2023-12-26 10:46:33,944][123090] Updated weights for policy 1, policy_version 1390964 (0.0005) [2023-12-26 10:46:34,001][123090] Updated weights for policy 1, policy_version 1390974 (0.0005) [2023-12-26 10:46:34,149][123091] Updated weights for policy 0, policy_version 1400468 (0.0009) [2023-12-26 10:46:34,219][123091] Updated weights for policy 0, policy_version 1400478 (0.0011) [2023-12-26 10:46:34,290][123091] Updated weights for policy 0, policy_version 1400488 (0.0011) [2023-12-26 10:46:34,697][123090] Updated weights for policy 1, policy_version 1390984 (0.0005) [2023-12-26 10:46:34,768][123090] Updated weights for policy 1, policy_version 1390994 (0.0005) [2023-12-26 10:46:34,825][123090] Updated weights for policy 1, policy_version 1391004 (0.0006) [2023-12-26 10:46:35,049][123091] Updated weights for policy 0, policy_version 1400498 (0.0011) [2023-12-26 10:46:35,103][123091] Updated weights for policy 0, policy_version 1400508 (0.0010) [2023-12-26 10:46:35,165][123091] Updated weights for policy 0, policy_version 1400518 (0.0010) [2023-12-26 10:46:35,216][123091] Updated weights for policy 0, policy_version 1400528 (0.0010) [2023-12-26 10:46:35,514][123090] Updated weights for policy 1, policy_version 1391014 (0.0005) [2023-12-26 10:46:35,583][123090] Updated weights for policy 1, policy_version 1391024 (0.0008) [2023-12-26 10:46:35,649][123090] Updated weights for policy 1, policy_version 1391034 (0.0006) [2023-12-26 10:46:35,934][123091] Updated weights for policy 0, policy_version 1400538 (0.0005) [2023-12-26 10:46:35,986][123091] Updated weights for policy 0, policy_version 1400548 (0.0005) [2023-12-26 10:46:36,032][123091] Updated weights for policy 0, policy_version 1400558 (0.0005) [2023-12-26 10:46:36,288][123090] Updated weights for policy 1, policy_version 1391044 (0.0005) [2023-12-26 10:46:36,336][123090] Updated weights for policy 1, policy_version 1391054 (0.0010) [2023-12-26 10:46:36,389][123090] Updated weights for policy 1, policy_version 1391064 (0.0006) [2023-12-26 10:46:36,776][123091] Updated weights for policy 0, policy_version 1400568 (0.0006) [2023-12-26 10:46:36,840][123091] Updated weights for policy 0, policy_version 1400578 (0.0006) [2023-12-26 10:46:36,904][123091] Updated weights for policy 0, policy_version 1400588 (0.0011) [2023-12-26 10:46:37,077][123090] Updated weights for policy 1, policy_version 1391074 (0.0006) [2023-12-26 10:46:37,141][123090] Updated weights for policy 1, policy_version 1391084 (0.0008) [2023-12-26 10:46:37,205][123090] Updated weights for policy 1, policy_version 1391094 (0.0006) [2023-12-26 10:46:37,262][123090] Updated weights for policy 1, policy_version 1391104 (0.0006) [2023-12-26 10:46:37,612][123091] Updated weights for policy 0, policy_version 1400598 (0.0011) [2023-12-26 10:46:37,661][123091] Updated weights for policy 0, policy_version 1400608 (0.0009) [2023-12-26 10:46:37,710][123091] Updated weights for policy 0, policy_version 1400618 (0.0006) [2023-12-26 10:46:37,978][123090] Updated weights for policy 1, policy_version 1391114 (0.0006) [2023-12-26 10:46:38,040][123090] Updated weights for policy 1, policy_version 1391124 (0.0006) [2023-12-26 10:46:38,120][123090] Updated weights for policy 1, policy_version 1391134 (0.0006) [2023-12-26 10:46:38,450][123091] Updated weights for policy 0, policy_version 1400628 (0.0007) [2023-12-26 10:46:38,501][123091] Updated weights for policy 0, policy_version 1400638 (0.0009) [2023-12-26 10:46:38,555][123091] Updated weights for policy 0, policy_version 1400648 (0.0009) [2023-12-26 10:46:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 714702848. Throughput: 0: 9220.4, 1: 9032.7. Samples: 714675412. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:38,785][121949] Avg episode reward: [(0, '6249.904'), (1, '5722.208')] [2023-12-26 10:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001400656_358572032.pth... [2023-12-26 10:46:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001391136_356130816.pth... [2023-12-26 10:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001399568_358293504.pth [2023-12-26 10:46:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001390080_355860480.pth [2023-12-26 10:46:38,868][123090] Updated weights for policy 1, policy_version 1391144 (0.0010) [2023-12-26 10:46:38,934][123090] Updated weights for policy 1, policy_version 1391154 (0.0010) [2023-12-26 10:46:38,996][123090] Updated weights for policy 1, policy_version 1391164 (0.0010) [2023-12-26 10:46:39,242][123091] Updated weights for policy 0, policy_version 1400658 (0.0008) [2023-12-26 10:46:39,300][123091] Updated weights for policy 0, policy_version 1400668 (0.0006) [2023-12-26 10:46:39,362][123091] Updated weights for policy 0, policy_version 1400678 (0.0010) [2023-12-26 10:46:39,429][123091] Updated weights for policy 0, policy_version 1400688 (0.0011) [2023-12-26 10:46:39,783][123090] Updated weights for policy 1, policy_version 1391174 (0.0007) [2023-12-26 10:46:39,855][123090] Updated weights for policy 1, policy_version 1391184 (0.0008) [2023-12-26 10:46:39,922][123090] Updated weights for policy 1, policy_version 1391194 (0.0006) [2023-12-26 10:46:40,297][123091] Updated weights for policy 0, policy_version 1400698 (0.0010) [2023-12-26 10:46:40,351][123091] Updated weights for policy 0, policy_version 1400708 (0.0010) [2023-12-26 10:46:40,398][123091] Updated weights for policy 0, policy_version 1400718 (0.0006) [2023-12-26 10:46:40,628][123090] Updated weights for policy 1, policy_version 1391204 (0.0009) [2023-12-26 10:46:40,684][123090] Updated weights for policy 1, policy_version 1391214 (0.0005) [2023-12-26 10:46:40,739][123090] Updated weights for policy 1, policy_version 1391224 (0.0005) [2023-12-26 10:46:41,119][123091] Updated weights for policy 0, policy_version 1400728 (0.0007) [2023-12-26 10:46:41,184][123091] Updated weights for policy 0, policy_version 1400738 (0.0006) [2023-12-26 10:46:41,244][123091] Updated weights for policy 0, policy_version 1400748 (0.0008) [2023-12-26 10:46:41,496][123090] Updated weights for policy 1, policy_version 1391234 (0.0005) [2023-12-26 10:46:41,569][123090] Updated weights for policy 1, policy_version 1391244 (0.0008) [2023-12-26 10:46:41,642][123090] Updated weights for policy 1, policy_version 1391254 (0.0010) [2023-12-26 10:46:41,702][123090] Updated weights for policy 1, policy_version 1391264 (0.0010) [2023-12-26 10:46:42,048][123091] Updated weights for policy 0, policy_version 1400758 (0.0010) [2023-12-26 10:46:42,112][123091] Updated weights for policy 0, policy_version 1400768 (0.0011) [2023-12-26 10:46:42,176][123091] Updated weights for policy 0, policy_version 1400778 (0.0011) [2023-12-26 10:46:42,522][123090] Updated weights for policy 1, policy_version 1391274 (0.0005) [2023-12-26 10:46:42,597][123090] Updated weights for policy 1, policy_version 1391284 (0.0007) [2023-12-26 10:46:42,661][123090] Updated weights for policy 1, policy_version 1391294 (0.0010) [2023-12-26 10:46:42,929][123091] Updated weights for policy 0, policy_version 1400788 (0.0008) [2023-12-26 10:46:42,996][123091] Updated weights for policy 0, policy_version 1400798 (0.0005) [2023-12-26 10:46:43,067][123091] Updated weights for policy 0, policy_version 1400808 (0.0007) [2023-12-26 10:46:43,416][123090] Updated weights for policy 1, policy_version 1391304 (0.0006) [2023-12-26 10:46:43,485][123090] Updated weights for policy 1, policy_version 1391314 (0.0008) [2023-12-26 10:46:43,551][123090] Updated weights for policy 1, policy_version 1391324 (0.0006) [2023-12-26 10:46:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18295.5, 300 sec: 17855.8). Total num frames: 714792960. Throughput: 0: 9249.7, 1: 9072.9. Samples: 714786028. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:43,785][121949] Avg episode reward: [(0, '6288.649'), (1, '5835.833')] [2023-12-26 10:46:43,837][123091] Updated weights for policy 0, policy_version 1400818 (0.0011) [2023-12-26 10:46:43,880][123091] Updated weights for policy 0, policy_version 1400828 (0.0010) [2023-12-26 10:46:43,931][123091] Updated weights for policy 0, policy_version 1400838 (0.0010) [2023-12-26 10:46:43,982][123091] Updated weights for policy 0, policy_version 1400848 (0.0010) [2023-12-26 10:46:44,257][123090] Updated weights for policy 1, policy_version 1391334 (0.0008) [2023-12-26 10:46:44,323][123090] Updated weights for policy 1, policy_version 1391344 (0.0010) [2023-12-26 10:46:44,396][123090] Updated weights for policy 1, policy_version 1391354 (0.0008) [2023-12-26 10:46:44,803][123091] Updated weights for policy 0, policy_version 1400858 (0.0011) [2023-12-26 10:46:44,856][123091] Updated weights for policy 0, policy_version 1400868 (0.0011) [2023-12-26 10:46:44,921][123091] Updated weights for policy 0, policy_version 1400878 (0.0011) [2023-12-26 10:46:45,249][123090] Updated weights for policy 1, policy_version 1391364 (0.0009) [2023-12-26 10:46:45,317][123090] Updated weights for policy 1, policy_version 1391374 (0.0011) [2023-12-26 10:46:45,389][123090] Updated weights for policy 1, policy_version 1391384 (0.0010) [2023-12-26 10:46:45,745][123091] Updated weights for policy 0, policy_version 1400888 (0.0010) [2023-12-26 10:46:45,797][123091] Updated weights for policy 0, policy_version 1400898 (0.0006) [2023-12-26 10:46:45,843][123091] Updated weights for policy 0, policy_version 1400908 (0.0005) [2023-12-26 10:46:46,191][123090] Updated weights for policy 1, policy_version 1391394 (0.0010) [2023-12-26 10:46:46,241][123090] Updated weights for policy 1, policy_version 1391404 (0.0009) [2023-12-26 10:46:46,296][123090] Updated weights for policy 1, policy_version 1391414 (0.0010) [2023-12-26 10:46:46,352][123090] Updated weights for policy 1, policy_version 1391424 (0.0010) [2023-12-26 10:46:46,667][123091] Updated weights for policy 0, policy_version 1400918 (0.0006) [2023-12-26 10:46:46,722][123091] Updated weights for policy 0, policy_version 1400928 (0.0005) [2023-12-26 10:46:46,791][123091] Updated weights for policy 0, policy_version 1400938 (0.0006) [2023-12-26 10:46:47,206][123090] Updated weights for policy 1, policy_version 1391434 (0.0009) [2023-12-26 10:46:47,259][123090] Updated weights for policy 1, policy_version 1391444 (0.0009) [2023-12-26 10:46:47,312][123090] Updated weights for policy 1, policy_version 1391454 (0.0009) [2023-12-26 10:46:47,554][123091] Updated weights for policy 0, policy_version 1400948 (0.0007) [2023-12-26 10:46:47,621][123091] Updated weights for policy 0, policy_version 1400958 (0.0010) [2023-12-26 10:46:47,690][123091] Updated weights for policy 0, policy_version 1400968 (0.0009) [2023-12-26 10:46:48,044][123090] Updated weights for policy 1, policy_version 1391464 (0.0010) [2023-12-26 10:46:48,107][123090] Updated weights for policy 1, policy_version 1391474 (0.0010) [2023-12-26 10:46:48,167][123090] Updated weights for policy 1, policy_version 1391484 (0.0010) [2023-12-26 10:46:48,389][123091] Updated weights for policy 0, policy_version 1400978 (0.0006) [2023-12-26 10:46:48,448][123091] Updated weights for policy 0, policy_version 1400988 (0.0009) [2023-12-26 10:46:48,506][123091] Updated weights for policy 0, policy_version 1400998 (0.0009) [2023-12-26 10:46:48,560][123091] Updated weights for policy 0, policy_version 1401008 (0.0008) [2023-12-26 10:46:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 714883072. Throughput: 0: 9286.0, 1: 9097.8. Samples: 714894432. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:48,785][121949] Avg episode reward: [(0, '6156.567'), (1, '5670.953')] [2023-12-26 10:46:48,880][123090] Updated weights for policy 1, policy_version 1391494 (0.0009) [2023-12-26 10:46:48,935][123090] Updated weights for policy 1, policy_version 1391504 (0.0010) [2023-12-26 10:46:48,998][123090] Updated weights for policy 1, policy_version 1391514 (0.0010) [2023-12-26 10:46:49,409][123091] Updated weights for policy 0, policy_version 1401018 (0.0006) [2023-12-26 10:46:49,480][123091] Updated weights for policy 0, policy_version 1401028 (0.0006) [2023-12-26 10:46:49,551][123091] Updated weights for policy 0, policy_version 1401038 (0.0005) [2023-12-26 10:46:49,806][123090] Updated weights for policy 1, policy_version 1391524 (0.0009) [2023-12-26 10:46:49,875][123090] Updated weights for policy 1, policy_version 1391534 (0.0007) [2023-12-26 10:46:49,945][123090] Updated weights for policy 1, policy_version 1391544 (0.0008) [2023-12-26 10:46:50,223][123091] Updated weights for policy 0, policy_version 1401048 (0.0009) [2023-12-26 10:46:50,278][123091] Updated weights for policy 0, policy_version 1401058 (0.0009) [2023-12-26 10:46:50,334][123091] Updated weights for policy 0, policy_version 1401068 (0.0009) [2023-12-26 10:46:50,675][123090] Updated weights for policy 1, policy_version 1391554 (0.0007) [2023-12-26 10:46:50,743][123090] Updated weights for policy 1, policy_version 1391564 (0.0009) [2023-12-26 10:46:50,812][123090] Updated weights for policy 1, policy_version 1391574 (0.0010) [2023-12-26 10:46:50,883][123090] Updated weights for policy 1, policy_version 1391584 (0.0009) [2023-12-26 10:46:51,183][123091] Updated weights for policy 0, policy_version 1401078 (0.0009) [2023-12-26 10:46:51,239][123091] Updated weights for policy 0, policy_version 1401088 (0.0010) [2023-12-26 10:46:51,301][123091] Updated weights for policy 0, policy_version 1401098 (0.0010) [2023-12-26 10:46:51,773][123090] Updated weights for policy 1, policy_version 1391594 (0.0009) [2023-12-26 10:46:51,844][123090] Updated weights for policy 1, policy_version 1391604 (0.0009) [2023-12-26 10:46:51,911][123090] Updated weights for policy 1, policy_version 1391614 (0.0010) [2023-12-26 10:46:52,093][123091] Updated weights for policy 0, policy_version 1401108 (0.0010) [2023-12-26 10:46:52,162][123091] Updated weights for policy 0, policy_version 1401118 (0.0009) [2023-12-26 10:46:52,227][123091] Updated weights for policy 0, policy_version 1401128 (0.0009) [2023-12-26 10:46:52,768][123090] Updated weights for policy 1, policy_version 1391624 (0.0007) [2023-12-26 10:46:52,822][123090] Updated weights for policy 1, policy_version 1391634 (0.0009) [2023-12-26 10:46:52,887][123090] Updated weights for policy 1, policy_version 1391644 (0.0009) [2023-12-26 10:46:53,063][123091] Updated weights for policy 0, policy_version 1401138 (0.0009) [2023-12-26 10:46:53,115][123091] Updated weights for policy 0, policy_version 1401148 (0.0009) [2023-12-26 10:46:53,166][123091] Updated weights for policy 0, policy_version 1401158 (0.0009) [2023-12-26 10:46:53,216][123091] Updated weights for policy 0, policy_version 1401168 (0.0010) [2023-12-26 10:46:53,731][123090] Updated weights for policy 1, policy_version 1391654 (0.0010) [2023-12-26 10:46:53,783][123090] Updated weights for policy 1, policy_version 1391664 (0.0010) [2023-12-26 10:46:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 714964992. Throughput: 0: 9209.9, 1: 9070.5. Samples: 714947168. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:53,784][121949] Avg episode reward: [(0, '6147.389'), (1, '5690.879')] [2023-12-26 10:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001401168_358703104.pth... [2023-12-26 10:46:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001400080_358424576.pth [2023-12-26 10:46:53,849][123090] Updated weights for policy 1, policy_version 1391674 (0.0010) [2023-12-26 10:46:53,889][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001391680_356270080.pth... [2023-12-26 10:46:53,894][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001390592_355991552.pth [2023-12-26 10:46:54,090][123091] Updated weights for policy 0, policy_version 1401178 (0.0009) [2023-12-26 10:46:54,151][123091] Updated weights for policy 0, policy_version 1401188 (0.0009) [2023-12-26 10:46:54,211][123091] Updated weights for policy 0, policy_version 1401198 (0.0009) [2023-12-26 10:46:54,690][123090] Updated weights for policy 1, policy_version 1391684 (0.0011) [2023-12-26 10:46:54,743][123090] Updated weights for policy 1, policy_version 1391694 (0.0010) [2023-12-26 10:46:54,798][123090] Updated weights for policy 1, policy_version 1391704 (0.0010) [2023-12-26 10:46:55,051][123091] Updated weights for policy 0, policy_version 1401208 (0.0009) [2023-12-26 10:46:55,112][123091] Updated weights for policy 0, policy_version 1401219 (0.0010) [2023-12-26 10:46:55,178][123091] Updated weights for policy 0, policy_version 1401229 (0.0010) [2023-12-26 10:46:55,622][123090] Updated weights for policy 1, policy_version 1391714 (0.0009) [2023-12-26 10:46:55,693][123090] Updated weights for policy 1, policy_version 1391724 (0.0005) [2023-12-26 10:46:55,764][123090] Updated weights for policy 1, policy_version 1391734 (0.0006) [2023-12-26 10:46:55,840][123090] Updated weights for policy 1, policy_version 1391744 (0.0005) [2023-12-26 10:46:56,052][123091] Updated weights for policy 0, policy_version 1401239 (0.0009) [2023-12-26 10:46:56,118][123091] Updated weights for policy 0, policy_version 1401249 (0.0010) [2023-12-26 10:46:56,177][123091] Updated weights for policy 0, policy_version 1401260 (0.0010) [2023-12-26 10:46:56,513][123090] Updated weights for policy 1, policy_version 1391754 (0.0010) [2023-12-26 10:46:56,586][123090] Updated weights for policy 1, policy_version 1391764 (0.0010) [2023-12-26 10:46:56,648][123090] Updated weights for policy 1, policy_version 1391774 (0.0010) [2023-12-26 10:46:57,004][123091] Updated weights for policy 0, policy_version 1401270 (0.0009) [2023-12-26 10:46:57,063][123091] Updated weights for policy 0, policy_version 1401280 (0.0009) [2023-12-26 10:46:57,127][123091] Updated weights for policy 0, policy_version 1401290 (0.0009) [2023-12-26 10:46:57,422][123090] Updated weights for policy 1, policy_version 1391784 (0.0010) [2023-12-26 10:46:57,484][123090] Updated weights for policy 1, policy_version 1391794 (0.0010) [2023-12-26 10:46:57,553][123090] Updated weights for policy 1, policy_version 1391804 (0.0010) [2023-12-26 10:46:57,834][123091] Updated weights for policy 0, policy_version 1401300 (0.0008) [2023-12-26 10:46:57,891][123091] Updated weights for policy 0, policy_version 1401310 (0.0005) [2023-12-26 10:46:57,957][123091] Updated weights for policy 0, policy_version 1401320 (0.0005) [2023-12-26 10:46:58,356][123090] Updated weights for policy 1, policy_version 1391814 (0.0009) [2023-12-26 10:46:58,419][123090] Updated weights for policy 1, policy_version 1391824 (0.0008) [2023-12-26 10:46:58,486][123090] Updated weights for policy 1, policy_version 1391834 (0.0008) [2023-12-26 10:46:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 715055104. Throughput: 0: 9132.6, 1: 9081.1. Samples: 715051180. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:46:58,785][121949] Avg episode reward: [(0, '6273.440'), (1, '5749.122')] [2023-12-26 10:46:58,868][123091] Updated weights for policy 0, policy_version 1401330 (0.0008) [2023-12-26 10:46:58,940][123091] Updated weights for policy 0, policy_version 1401340 (0.0008) [2023-12-26 10:46:59,005][123091] Updated weights for policy 0, policy_version 1401350 (0.0008) [2023-12-26 10:46:59,069][123091] Updated weights for policy 0, policy_version 1401360 (0.0008) [2023-12-26 10:46:59,381][123090] Updated weights for policy 1, policy_version 1391844 (0.0008) [2023-12-26 10:46:59,451][123090] Updated weights for policy 1, policy_version 1391854 (0.0006) [2023-12-26 10:46:59,525][123090] Updated weights for policy 1, policy_version 1391864 (0.0005) [2023-12-26 10:46:59,746][123091] Updated weights for policy 0, policy_version 1401370 (0.0006) [2023-12-26 10:46:59,827][123091] Updated weights for policy 0, policy_version 1401380 (0.0006) [2023-12-26 10:46:59,896][123091] Updated weights for policy 0, policy_version 1401390 (0.0006) [2023-12-26 10:47:00,187][123090] Updated weights for policy 1, policy_version 1391874 (0.0006) [2023-12-26 10:47:00,246][123090] Updated weights for policy 1, policy_version 1391884 (0.0010) [2023-12-26 10:47:00,308][123090] Updated weights for policy 1, policy_version 1391894 (0.0010) [2023-12-26 10:47:00,370][123090] Updated weights for policy 1, policy_version 1391904 (0.0010) [2023-12-26 10:47:00,600][123091] Updated weights for policy 0, policy_version 1401400 (0.0005) [2023-12-26 10:47:00,667][123091] Updated weights for policy 0, policy_version 1401410 (0.0005) [2023-12-26 10:47:00,737][123091] Updated weights for policy 0, policy_version 1401420 (0.0005) [2023-12-26 10:47:01,062][123090] Updated weights for policy 1, policy_version 1391914 (0.0006) [2023-12-26 10:47:01,132][123090] Updated weights for policy 1, policy_version 1391924 (0.0006) [2023-12-26 10:47:01,199][123090] Updated weights for policy 1, policy_version 1391934 (0.0010) [2023-12-26 10:47:01,314][123091] Updated weights for policy 0, policy_version 1401430 (0.0008) [2023-12-26 10:47:01,362][123091] Updated weights for policy 0, policy_version 1401440 (0.0008) [2023-12-26 10:47:01,419][123091] Updated weights for policy 0, policy_version 1401450 (0.0006) [2023-12-26 10:47:01,990][123090] Updated weights for policy 1, policy_version 1391944 (0.0006) [2023-12-26 10:47:02,062][123090] Updated weights for policy 1, policy_version 1391954 (0.0005) [2023-12-26 10:47:02,129][123090] Updated weights for policy 1, policy_version 1391964 (0.0005) [2023-12-26 10:47:02,255][123091] Updated weights for policy 0, policy_version 1401460 (0.0007) [2023-12-26 10:47:02,307][123091] Updated weights for policy 0, policy_version 1401470 (0.0010) [2023-12-26 10:47:02,365][123091] Updated weights for policy 0, policy_version 1401480 (0.0010) [2023-12-26 10:47:02,898][123090] Updated weights for policy 1, policy_version 1391974 (0.0007) [2023-12-26 10:47:02,953][123090] Updated weights for policy 1, policy_version 1391984 (0.0009) [2023-12-26 10:47:03,006][123090] Updated weights for policy 1, policy_version 1391994 (0.0009) [2023-12-26 10:47:03,110][123091] Updated weights for policy 0, policy_version 1401490 (0.0008) [2023-12-26 10:47:03,161][123091] Updated weights for policy 0, policy_version 1401500 (0.0010) [2023-12-26 10:47:03,226][123091] Updated weights for policy 0, policy_version 1401510 (0.0010) [2023-12-26 10:47:03,287][123091] Updated weights for policy 0, policy_version 1401520 (0.0010) [2023-12-26 10:47:03,765][123090] Updated weights for policy 1, policy_version 1392005 (0.0008) [2023-12-26 10:47:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 715145216. Throughput: 0: 9167.1, 1: 9053.6. Samples: 715161000. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:03,784][121949] Avg episode reward: [(0, '6330.170'), (1, '5743.715')] [2023-12-26 10:47:03,812][123090] Updated weights for policy 1, policy_version 1392015 (0.0005) [2023-12-26 10:47:03,882][123090] Updated weights for policy 1, policy_version 1392026 (0.0008) [2023-12-26 10:47:04,043][123091] Updated weights for policy 0, policy_version 1401530 (0.0007) [2023-12-26 10:47:04,101][123091] Updated weights for policy 0, policy_version 1401540 (0.0007) [2023-12-26 10:47:04,172][123091] Updated weights for policy 0, policy_version 1401550 (0.0006) [2023-12-26 10:47:04,528][123090] Updated weights for policy 1, policy_version 1392036 (0.0006) [2023-12-26 10:47:04,593][123090] Updated weights for policy 1, policy_version 1392046 (0.0005) [2023-12-26 10:47:04,657][123090] Updated weights for policy 1, policy_version 1392056 (0.0005) [2023-12-26 10:47:04,915][123091] Updated weights for policy 0, policy_version 1401560 (0.0006) [2023-12-26 10:47:04,964][123091] Updated weights for policy 0, policy_version 1401570 (0.0005) [2023-12-26 10:47:05,027][123091] Updated weights for policy 0, policy_version 1401580 (0.0005) [2023-12-26 10:47:05,413][123090] Updated weights for policy 1, policy_version 1392066 (0.0006) [2023-12-26 10:47:05,460][123090] Updated weights for policy 1, policy_version 1392076 (0.0010) [2023-12-26 10:47:05,519][123090] Updated weights for policy 1, policy_version 1392086 (0.0010) [2023-12-26 10:47:05,566][123090] Updated weights for policy 1, policy_version 1392096 (0.0010) [2023-12-26 10:47:05,720][123091] Updated weights for policy 0, policy_version 1401590 (0.0007) [2023-12-26 10:47:05,788][123091] Updated weights for policy 0, policy_version 1401600 (0.0010) [2023-12-26 10:47:05,859][123091] Updated weights for policy 0, policy_version 1401610 (0.0011) [2023-12-26 10:47:06,393][123090] Updated weights for policy 1, policy_version 1392106 (0.0005) [2023-12-26 10:47:06,453][123090] Updated weights for policy 1, policy_version 1392116 (0.0006) [2023-12-26 10:47:06,505][123090] Updated weights for policy 1, policy_version 1392126 (0.0005) [2023-12-26 10:47:06,656][123091] Updated weights for policy 0, policy_version 1401620 (0.0011) [2023-12-26 10:47:06,726][123091] Updated weights for policy 0, policy_version 1401630 (0.0011) [2023-12-26 10:47:06,789][123091] Updated weights for policy 0, policy_version 1401640 (0.0011) [2023-12-26 10:47:07,260][123090] Updated weights for policy 1, policy_version 1392136 (0.0005) [2023-12-26 10:47:07,316][123090] Updated weights for policy 1, policy_version 1392146 (0.0005) [2023-12-26 10:47:07,378][123090] Updated weights for policy 1, policy_version 1392156 (0.0007) [2023-12-26 10:47:07,603][123091] Updated weights for policy 0, policy_version 1401650 (0.0010) [2023-12-26 10:47:07,666][123091] Updated weights for policy 0, policy_version 1401660 (0.0011) [2023-12-26 10:47:07,728][123091] Updated weights for policy 0, policy_version 1401670 (0.0011) [2023-12-26 10:47:07,791][123091] Updated weights for policy 0, policy_version 1401680 (0.0011) [2023-12-26 10:47:07,980][123090] Updated weights for policy 1, policy_version 1392166 (0.0007) [2023-12-26 10:47:08,026][123090] Updated weights for policy 1, policy_version 1392176 (0.0005) [2023-12-26 10:47:08,082][123090] Updated weights for policy 1, policy_version 1392186 (0.0005) [2023-12-26 10:47:08,545][123091] Updated weights for policy 0, policy_version 1401690 (0.0006) [2023-12-26 10:47:08,597][123091] Updated weights for policy 0, policy_version 1401700 (0.0010) [2023-12-26 10:47:08,649][123091] Updated weights for policy 0, policy_version 1401710 (0.0010) [2023-12-26 10:47:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 715243520. Throughput: 0: 9204.8, 1: 9096.5. Samples: 715216908. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:08,785][121949] Avg episode reward: [(0, '6271.500'), (1, '5568.611')] [2023-12-26 10:47:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001401712_358842368.pth... [2023-12-26 10:47:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001400656_358572032.pth [2023-12-26 10:47:08,823][123090] Updated weights for policy 1, policy_version 1392196 (0.0008) [2023-12-26 10:47:08,890][123090] Updated weights for policy 1, policy_version 1392206 (0.0010) [2023-12-26 10:47:08,953][123090] Updated weights for policy 1, policy_version 1392216 (0.0011) [2023-12-26 10:47:09,011][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001392224_356409344.pth... [2023-12-26 10:47:09,016][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001391136_356130816.pth [2023-12-26 10:47:09,508][123091] Updated weights for policy 0, policy_version 1401720 (0.0006) [2023-12-26 10:47:09,579][123091] Updated weights for policy 0, policy_version 1401730 (0.0007) [2023-12-26 10:47:09,644][123091] Updated weights for policy 0, policy_version 1401740 (0.0007) [2023-12-26 10:47:09,784][123090] Updated weights for policy 1, policy_version 1392226 (0.0010) [2023-12-26 10:47:09,850][123090] Updated weights for policy 1, policy_version 1392236 (0.0009) [2023-12-26 10:47:09,924][123090] Updated weights for policy 1, policy_version 1392246 (0.0010) [2023-12-26 10:47:09,992][123090] Updated weights for policy 1, policy_version 1392256 (0.0010) [2023-12-26 10:47:10,377][123091] Updated weights for policy 0, policy_version 1401750 (0.0008) [2023-12-26 10:47:10,446][123091] Updated weights for policy 0, policy_version 1401760 (0.0010) [2023-12-26 10:47:10,513][123091] Updated weights for policy 0, policy_version 1401770 (0.0005) [2023-12-26 10:47:10,848][123090] Updated weights for policy 1, policy_version 1392266 (0.0010) [2023-12-26 10:47:10,912][123090] Updated weights for policy 1, policy_version 1392276 (0.0007) [2023-12-26 10:47:10,980][123090] Updated weights for policy 1, policy_version 1392286 (0.0005) [2023-12-26 10:47:11,307][123091] Updated weights for policy 0, policy_version 1401780 (0.0010) [2023-12-26 10:47:11,376][123091] Updated weights for policy 0, policy_version 1401790 (0.0009) [2023-12-26 10:47:11,440][123091] Updated weights for policy 0, policy_version 1401800 (0.0008) [2023-12-26 10:47:11,846][123090] Updated weights for policy 1, policy_version 1392296 (0.0008) [2023-12-26 10:47:11,900][123090] Updated weights for policy 1, policy_version 1392306 (0.0008) [2023-12-26 10:47:11,960][123090] Updated weights for policy 1, policy_version 1392316 (0.0009) [2023-12-26 10:47:12,211][123091] Updated weights for policy 0, policy_version 1401810 (0.0007) [2023-12-26 10:47:12,280][123091] Updated weights for policy 0, policy_version 1401820 (0.0010) [2023-12-26 10:47:12,344][123091] Updated weights for policy 0, policy_version 1401830 (0.0010) [2023-12-26 10:47:12,408][123091] Updated weights for policy 0, policy_version 1401840 (0.0010) [2023-12-26 10:47:12,840][123090] Updated weights for policy 1, policy_version 1392326 (0.0009) [2023-12-26 10:47:12,904][123090] Updated weights for policy 1, policy_version 1392336 (0.0008) [2023-12-26 10:47:12,964][123090] Updated weights for policy 1, policy_version 1392346 (0.0009) [2023-12-26 10:47:13,212][123091] Updated weights for policy 0, policy_version 1401850 (0.0009) [2023-12-26 10:47:13,271][123091] Updated weights for policy 0, policy_version 1401860 (0.0010) [2023-12-26 10:47:13,330][123091] Updated weights for policy 0, policy_version 1401870 (0.0010) [2023-12-26 10:47:13,765][123090] Updated weights for policy 1, policy_version 1392356 (0.0010) [2023-12-26 10:47:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18159.0, 300 sec: 17855.8). Total num frames: 715325440. Throughput: 0: 9142.0, 1: 9016.1. Samples: 715321808. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:13,785][121949] Avg episode reward: [(0, '6224.870'), (1, '5460.784')] [2023-12-26 10:47:13,817][123090] Updated weights for policy 1, policy_version 1392366 (0.0009) [2023-12-26 10:47:13,866][123090] Updated weights for policy 1, policy_version 1392376 (0.0009) [2023-12-26 10:47:14,180][123091] Updated weights for policy 0, policy_version 1401880 (0.0010) [2023-12-26 10:47:14,235][123091] Updated weights for policy 0, policy_version 1401890 (0.0009) [2023-12-26 10:47:14,288][123091] Updated weights for policy 0, policy_version 1401901 (0.0010) [2023-12-26 10:47:14,651][123090] Updated weights for policy 1, policy_version 1392386 (0.0008) [2023-12-26 10:47:14,699][123090] Updated weights for policy 1, policy_version 1392396 (0.0005) [2023-12-26 10:47:14,744][123090] Updated weights for policy 1, policy_version 1392406 (0.0005) [2023-12-26 10:47:14,806][123090] Updated weights for policy 1, policy_version 1392416 (0.0007) [2023-12-26 10:47:15,189][123091] Updated weights for policy 0, policy_version 1401911 (0.0010) [2023-12-26 10:47:15,253][123091] Updated weights for policy 0, policy_version 1401921 (0.0008) [2023-12-26 10:47:15,308][123091] Updated weights for policy 0, policy_version 1401931 (0.0005) [2023-12-26 10:47:15,682][123090] Updated weights for policy 1, policy_version 1392426 (0.0009) [2023-12-26 10:47:15,735][123090] Updated weights for policy 1, policy_version 1392436 (0.0010) [2023-12-26 10:47:15,800][123090] Updated weights for policy 1, policy_version 1392446 (0.0009) [2023-12-26 10:47:16,025][123091] Updated weights for policy 0, policy_version 1401941 (0.0007) [2023-12-26 10:47:16,073][123091] Updated weights for policy 0, policy_version 1401951 (0.0009) [2023-12-26 10:47:16,120][123091] Updated weights for policy 0, policy_version 1401961 (0.0008) [2023-12-26 10:47:16,658][123090] Updated weights for policy 1, policy_version 1392456 (0.0009) [2023-12-26 10:47:16,724][123090] Updated weights for policy 1, policy_version 1392466 (0.0010) [2023-12-26 10:47:16,782][123090] Updated weights for policy 1, policy_version 1392476 (0.0010) [2023-12-26 10:47:16,997][123091] Updated weights for policy 0, policy_version 1401972 (0.0010) [2023-12-26 10:47:17,061][123091] Updated weights for policy 0, policy_version 1401982 (0.0009) [2023-12-26 10:47:17,116][123091] Updated weights for policy 0, policy_version 1401992 (0.0009) [2023-12-26 10:47:17,619][123090] Updated weights for policy 1, policy_version 1392486 (0.0009) [2023-12-26 10:47:17,669][123090] Updated weights for policy 1, policy_version 1392496 (0.0009) [2023-12-26 10:47:17,726][123090] Updated weights for policy 1, policy_version 1392506 (0.0008) [2023-12-26 10:47:17,960][123091] Updated weights for policy 0, policy_version 1402002 (0.0009) [2023-12-26 10:47:18,011][123091] Updated weights for policy 0, policy_version 1402012 (0.0010) [2023-12-26 10:47:18,066][123091] Updated weights for policy 0, policy_version 1402022 (0.0011) [2023-12-26 10:47:18,114][123091] Updated weights for policy 0, policy_version 1402032 (0.0010) [2023-12-26 10:47:18,585][123090] Updated weights for policy 1, policy_version 1392516 (0.0009) [2023-12-26 10:47:18,635][123090] Updated weights for policy 1, policy_version 1392526 (0.0009) [2023-12-26 10:47:18,695][123090] Updated weights for policy 1, policy_version 1392536 (0.0009) [2023-12-26 10:47:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 715415552. Throughput: 0: 8980.2, 1: 8991.8. Samples: 715425464. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:18,785][121949] Avg episode reward: [(0, '6156.392'), (1, '5509.354')] [2023-12-26 10:47:18,966][123091] Updated weights for policy 0, policy_version 1402042 (0.0011) [2023-12-26 10:47:19,029][123091] Updated weights for policy 0, policy_version 1402052 (0.0010) [2023-12-26 10:47:19,080][123091] Updated weights for policy 0, policy_version 1402062 (0.0011) [2023-12-26 10:47:19,549][123090] Updated weights for policy 1, policy_version 1392546 (0.0009) [2023-12-26 10:47:19,615][123090] Updated weights for policy 1, policy_version 1392556 (0.0009) [2023-12-26 10:47:19,678][123090] Updated weights for policy 1, policy_version 1392566 (0.0009) [2023-12-26 10:47:19,750][123090] Updated weights for policy 1, policy_version 1392576 (0.0009) [2023-12-26 10:47:19,914][123091] Updated weights for policy 0, policy_version 1402072 (0.0007) [2023-12-26 10:47:19,985][123091] Updated weights for policy 0, policy_version 1402082 (0.0010) [2023-12-26 10:47:20,053][123091] Updated weights for policy 0, policy_version 1402092 (0.0011) [2023-12-26 10:47:20,502][123090] Updated weights for policy 1, policy_version 1392586 (0.0008) [2023-12-26 10:47:20,552][123090] Updated weights for policy 1, policy_version 1392596 (0.0008) [2023-12-26 10:47:20,629][123090] Updated weights for policy 1, policy_version 1392606 (0.0008) [2023-12-26 10:47:20,793][123091] Updated weights for policy 0, policy_version 1402102 (0.0009) [2023-12-26 10:47:20,861][123091] Updated weights for policy 0, policy_version 1402112 (0.0006) [2023-12-26 10:47:20,938][123091] Updated weights for policy 0, policy_version 1402122 (0.0006) [2023-12-26 10:47:21,441][123090] Updated weights for policy 1, policy_version 1392616 (0.0009) [2023-12-26 10:47:21,502][123090] Updated weights for policy 1, policy_version 1392626 (0.0009) [2023-12-26 10:47:21,563][123090] Updated weights for policy 1, policy_version 1392636 (0.0010) [2023-12-26 10:47:21,672][123091] Updated weights for policy 0, policy_version 1402132 (0.0006) [2023-12-26 10:47:21,745][123091] Updated weights for policy 0, policy_version 1402142 (0.0008) [2023-12-26 10:47:21,812][123091] Updated weights for policy 0, policy_version 1402152 (0.0010) [2023-12-26 10:47:22,338][123090] Updated weights for policy 1, policy_version 1392646 (0.0010) [2023-12-26 10:47:22,414][123090] Updated weights for policy 1, policy_version 1392656 (0.0009) [2023-12-26 10:47:22,480][123090] Updated weights for policy 1, policy_version 1392666 (0.0006) [2023-12-26 10:47:22,579][123091] Updated weights for policy 0, policy_version 1402162 (0.0010) [2023-12-26 10:47:22,637][123091] Updated weights for policy 0, policy_version 1402172 (0.0006) [2023-12-26 10:47:22,692][123091] Updated weights for policy 0, policy_version 1402182 (0.0005) [2023-12-26 10:47:22,755][123091] Updated weights for policy 0, policy_version 1402192 (0.0009) [2023-12-26 10:47:23,175][123090] Updated weights for policy 1, policy_version 1392676 (0.0006) [2023-12-26 10:47:23,223][123090] Updated weights for policy 1, policy_version 1392686 (0.0005) [2023-12-26 10:47:23,279][123090] Updated weights for policy 1, policy_version 1392696 (0.0005) [2023-12-26 10:47:23,393][123091] Updated weights for policy 0, policy_version 1402202 (0.0008) [2023-12-26 10:47:23,455][123091] Updated weights for policy 0, policy_version 1402212 (0.0009) [2023-12-26 10:47:23,514][123091] Updated weights for policy 0, policy_version 1402222 (0.0011) [2023-12-26 10:47:23,784][121949] Fps is (10 sec: 18021.7, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 715505664. Throughput: 0: 8929.7, 1: 8891.5. Samples: 715477372. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:23,785][121949] Avg episode reward: [(0, '6171.219'), (1, '5628.351')] [2023-12-26 10:47:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001402224_358973440.pth... [2023-12-26 10:47:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001392704_356532224.pth... [2023-12-26 10:47:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001401168_358703104.pth [2023-12-26 10:47:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001391680_356270080.pth [2023-12-26 10:47:23,955][123090] Updated weights for policy 1, policy_version 1392706 (0.0005) [2023-12-26 10:47:24,009][123090] Updated weights for policy 1, policy_version 1392716 (0.0005) [2023-12-26 10:47:24,058][123090] Updated weights for policy 1, policy_version 1392726 (0.0005) [2023-12-26 10:47:24,122][123090] Updated weights for policy 1, policy_version 1392736 (0.0005) [2023-12-26 10:47:24,266][123091] Updated weights for policy 0, policy_version 1402232 (0.0007) [2023-12-26 10:47:24,329][123091] Updated weights for policy 0, policy_version 1402242 (0.0008) [2023-12-26 10:47:24,393][123091] Updated weights for policy 0, policy_version 1402252 (0.0011) [2023-12-26 10:47:24,828][123090] Updated weights for policy 1, policy_version 1392746 (0.0005) [2023-12-26 10:47:24,885][123090] Updated weights for policy 1, policy_version 1392756 (0.0005) [2023-12-26 10:47:24,942][123090] Updated weights for policy 1, policy_version 1392766 (0.0005) [2023-12-26 10:47:25,204][123091] Updated weights for policy 0, policy_version 1402262 (0.0011) [2023-12-26 10:47:25,263][123091] Updated weights for policy 0, policy_version 1402272 (0.0010) [2023-12-26 10:47:25,307][123091] Updated weights for policy 0, policy_version 1402282 (0.0010) [2023-12-26 10:47:25,615][123090] Updated weights for policy 1, policy_version 1392776 (0.0008) [2023-12-26 10:47:25,676][123090] Updated weights for policy 1, policy_version 1392786 (0.0009) [2023-12-26 10:47:25,724][123090] Updated weights for policy 1, policy_version 1392796 (0.0009) [2023-12-26 10:47:26,152][123091] Updated weights for policy 0, policy_version 1402292 (0.0010) [2023-12-26 10:47:26,200][123091] Updated weights for policy 0, policy_version 1402302 (0.0010) [2023-12-26 10:47:26,244][123091] Updated weights for policy 0, policy_version 1402312 (0.0010) [2023-12-26 10:47:26,571][123090] Updated weights for policy 1, policy_version 1392806 (0.0009) [2023-12-26 10:47:26,636][123090] Updated weights for policy 1, policy_version 1392816 (0.0009) [2023-12-26 10:47:26,699][123090] Updated weights for policy 1, policy_version 1392826 (0.0009) [2023-12-26 10:47:27,092][123091] Updated weights for policy 0, policy_version 1402322 (0.0010) [2023-12-26 10:47:27,151][123091] Updated weights for policy 0, policy_version 1402332 (0.0011) [2023-12-26 10:47:27,218][123091] Updated weights for policy 0, policy_version 1402342 (0.0011) [2023-12-26 10:47:27,281][123091] Updated weights for policy 0, policy_version 1402352 (0.0010) [2023-12-26 10:47:27,534][123090] Updated weights for policy 1, policy_version 1392836 (0.0009) [2023-12-26 10:47:27,589][123090] Updated weights for policy 1, policy_version 1392846 (0.0008) [2023-12-26 10:47:27,652][123090] Updated weights for policy 1, policy_version 1392856 (0.0009) [2023-12-26 10:47:28,085][123091] Updated weights for policy 0, policy_version 1402362 (0.0010) [2023-12-26 10:47:28,146][123091] Updated weights for policy 0, policy_version 1402372 (0.0010) [2023-12-26 10:47:28,211][123091] Updated weights for policy 0, policy_version 1402382 (0.0010) [2023-12-26 10:47:28,481][123090] Updated weights for policy 1, policy_version 1392866 (0.0008) [2023-12-26 10:47:28,541][123090] Updated weights for policy 1, policy_version 1392876 (0.0009) [2023-12-26 10:47:28,588][123090] Updated weights for policy 1, policy_version 1392886 (0.0009) [2023-12-26 10:47:28,655][123090] Updated weights for policy 1, policy_version 1392896 (0.0009) [2023-12-26 10:47:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 715595776. Throughput: 0: 8889.3, 1: 8911.8. Samples: 715587080. Policy #0 lag: (min: 26.0, avg: 47.3, max: 48.0) [2023-12-26 10:47:28,785][121949] Avg episode reward: [(0, '6240.159'), (1, '5796.641')] [2023-12-26 10:47:29,035][123091] Updated weights for policy 0, policy_version 1402392 (0.0010) [2023-12-26 10:47:29,096][123091] Updated weights for policy 0, policy_version 1402402 (0.0010) [2023-12-26 10:47:29,146][123091] Updated weights for policy 0, policy_version 1402412 (0.0010) [2023-12-26 10:47:29,489][123090] Updated weights for policy 1, policy_version 1392906 (0.0009) [2023-12-26 10:47:29,542][123090] Updated weights for policy 1, policy_version 1392916 (0.0009) [2023-12-26 10:47:29,610][123090] Updated weights for policy 1, policy_version 1392926 (0.0009) [2023-12-26 10:47:29,968][123091] Updated weights for policy 0, policy_version 1402422 (0.0010) [2023-12-26 10:47:30,035][123091] Updated weights for policy 0, policy_version 1402432 (0.0011) [2023-12-26 10:47:30,101][123091] Updated weights for policy 0, policy_version 1402442 (0.0010) [2023-12-26 10:47:30,433][123090] Updated weights for policy 1, policy_version 1392936 (0.0009) [2023-12-26 10:47:30,485][123090] Updated weights for policy 1, policy_version 1392946 (0.0008) [2023-12-26 10:47:30,532][123090] Updated weights for policy 1, policy_version 1392956 (0.0009) [2023-12-26 10:47:30,933][123091] Updated weights for policy 0, policy_version 1402452 (0.0010) [2023-12-26 10:47:30,990][123091] Updated weights for policy 0, policy_version 1402462 (0.0010) [2023-12-26 10:47:31,046][123091] Updated weights for policy 0, policy_version 1402472 (0.0010) [2023-12-26 10:47:31,399][123090] Updated weights for policy 1, policy_version 1392966 (0.0009) [2023-12-26 10:47:31,464][123090] Updated weights for policy 1, policy_version 1392976 (0.0006) [2023-12-26 10:47:31,539][123090] Updated weights for policy 1, policy_version 1392986 (0.0005) [2023-12-26 10:47:31,879][123091] Updated weights for policy 0, policy_version 1402482 (0.0010) [2023-12-26 10:47:31,943][123091] Updated weights for policy 0, policy_version 1402492 (0.0007) [2023-12-26 10:47:32,010][123091] Updated weights for policy 0, policy_version 1402502 (0.0009) [2023-12-26 10:47:32,077][123091] Updated weights for policy 0, policy_version 1402512 (0.0011) [2023-12-26 10:47:32,346][123090] Updated weights for policy 1, policy_version 1392996 (0.0007) [2023-12-26 10:47:32,414][123090] Updated weights for policy 1, policy_version 1393006 (0.0010) [2023-12-26 10:47:32,473][123090] Updated weights for policy 1, policy_version 1393016 (0.0009) [2023-12-26 10:47:32,793][123091] Updated weights for policy 0, policy_version 1402522 (0.0005) [2023-12-26 10:47:32,862][123091] Updated weights for policy 0, policy_version 1402532 (0.0008) [2023-12-26 10:47:32,919][123091] Updated weights for policy 0, policy_version 1402542 (0.0008) [2023-12-26 10:47:33,232][123090] Updated weights for policy 1, policy_version 1393026 (0.0010) [2023-12-26 10:47:33,286][123090] Updated weights for policy 1, policy_version 1393036 (0.0009) [2023-12-26 10:47:33,341][123090] Updated weights for policy 1, policy_version 1393046 (0.0010) [2023-12-26 10:47:33,399][123090] Updated weights for policy 1, policy_version 1393056 (0.0010) [2023-12-26 10:47:33,667][123091] Updated weights for policy 0, policy_version 1402552 (0.0006) [2023-12-26 10:47:33,715][123091] Updated weights for policy 0, policy_version 1402562 (0.0006) [2023-12-26 10:47:33,766][123091] Updated weights for policy 0, policy_version 1402572 (0.0005) [2023-12-26 10:47:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 715677696. Throughput: 0: 8862.4, 1: 8860.7. Samples: 715691968. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:33,785][121949] Avg episode reward: [(0, '6282.705'), (1, '5738.886')] [2023-12-26 10:47:34,165][123090] Updated weights for policy 1, policy_version 1393066 (0.0007) [2023-12-26 10:47:34,234][123090] Updated weights for policy 1, policy_version 1393076 (0.0010) [2023-12-26 10:47:34,303][123090] Updated weights for policy 1, policy_version 1393086 (0.0010) [2023-12-26 10:47:34,487][123091] Updated weights for policy 0, policy_version 1402582 (0.0008) [2023-12-26 10:47:34,550][123091] Updated weights for policy 0, policy_version 1402592 (0.0011) [2023-12-26 10:47:34,612][123091] Updated weights for policy 0, policy_version 1402602 (0.0007) [2023-12-26 10:47:35,087][123090] Updated weights for policy 1, policy_version 1393096 (0.0009) [2023-12-26 10:47:35,155][123090] Updated weights for policy 1, policy_version 1393106 (0.0009) [2023-12-26 10:47:35,225][123090] Updated weights for policy 1, policy_version 1393116 (0.0010) [2023-12-26 10:47:35,257][123091] Updated weights for policy 0, policy_version 1402612 (0.0005) [2023-12-26 10:47:35,328][123091] Updated weights for policy 0, policy_version 1402622 (0.0005) [2023-12-26 10:47:35,401][123091] Updated weights for policy 0, policy_version 1402632 (0.0005) [2023-12-26 10:47:35,989][123091] Updated weights for policy 0, policy_version 1402642 (0.0005) [2023-12-26 10:47:36,011][123090] Updated weights for policy 1, policy_version 1393126 (0.0010) [2023-12-26 10:47:36,046][123091] Updated weights for policy 0, policy_version 1402652 (0.0005) [2023-12-26 10:47:36,066][123090] Updated weights for policy 1, policy_version 1393136 (0.0010) [2023-12-26 10:47:36,105][123091] Updated weights for policy 0, policy_version 1402662 (0.0006) [2023-12-26 10:47:36,132][123090] Updated weights for policy 1, policy_version 1393146 (0.0008) [2023-12-26 10:47:36,169][123091] Updated weights for policy 0, policy_version 1402672 (0.0009) [2023-12-26 10:47:36,936][123091] Updated weights for policy 0, policy_version 1402682 (0.0009) [2023-12-26 10:47:36,986][123091] Updated weights for policy 0, policy_version 1402692 (0.0010) [2023-12-26 10:47:36,998][123090] Updated weights for policy 1, policy_version 1393156 (0.0007) [2023-12-26 10:47:37,046][123091] Updated weights for policy 0, policy_version 1402702 (0.0010) [2023-12-26 10:47:37,058][123090] Updated weights for policy 1, policy_version 1393166 (0.0008) [2023-12-26 10:47:37,118][123090] Updated weights for policy 1, policy_version 1393176 (0.0010) [2023-12-26 10:47:37,858][123091] Updated weights for policy 0, policy_version 1402712 (0.0010) [2023-12-26 10:47:37,910][123091] Updated weights for policy 0, policy_version 1402722 (0.0009) [2023-12-26 10:47:37,959][123091] Updated weights for policy 0, policy_version 1402732 (0.0009) [2023-12-26 10:47:37,973][123090] Updated weights for policy 1, policy_version 1393186 (0.0009) [2023-12-26 10:47:38,029][123090] Updated weights for policy 1, policy_version 1393196 (0.0009) [2023-12-26 10:47:38,082][123090] Updated weights for policy 1, policy_version 1393206 (0.0010) [2023-12-26 10:47:38,135][123090] Updated weights for policy 1, policy_version 1393216 (0.0009) [2023-12-26 10:47:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 715767808. Throughput: 0: 8940.6, 1: 8873.3. Samples: 715748796. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:38,786][121949] Avg episode reward: [(0, '6148.202'), (1, '5689.751')] [2023-12-26 10:47:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001402736_359104512.pth... [2023-12-26 10:47:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001393216_356663296.pth... [2023-12-26 10:47:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001401712_358842368.pth [2023-12-26 10:47:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001392224_356409344.pth [2023-12-26 10:47:38,840][123091] Updated weights for policy 0, policy_version 1402742 (0.0009) [2023-12-26 10:47:38,893][123091] Updated weights for policy 0, policy_version 1402752 (0.0010) [2023-12-26 10:47:38,950][123091] Updated weights for policy 0, policy_version 1402762 (0.0010) [2023-12-26 10:47:38,951][123090] Updated weights for policy 1, policy_version 1393226 (0.0007) [2023-12-26 10:47:39,007][123090] Updated weights for policy 1, policy_version 1393236 (0.0009) [2023-12-26 10:47:39,076][123090] Updated weights for policy 1, policy_version 1393246 (0.0009) [2023-12-26 10:47:39,817][123091] Updated weights for policy 0, policy_version 1402772 (0.0009) [2023-12-26 10:47:39,890][123091] Updated weights for policy 0, policy_version 1402782 (0.0009) [2023-12-26 10:47:39,943][123090] Updated weights for policy 1, policy_version 1393256 (0.0011) [2023-12-26 10:47:39,958][123091] Updated weights for policy 0, policy_version 1402792 (0.0007) [2023-12-26 10:47:40,009][123090] Updated weights for policy 1, policy_version 1393266 (0.0010) [2023-12-26 10:47:40,076][123090] Updated weights for policy 1, policy_version 1393276 (0.0011) [2023-12-26 10:47:40,699][123091] Updated weights for policy 0, policy_version 1402802 (0.0007) [2023-12-26 10:47:40,768][123091] Updated weights for policy 0, policy_version 1402812 (0.0009) [2023-12-26 10:47:40,827][123091] Updated weights for policy 0, policy_version 1402822 (0.0008) [2023-12-26 10:47:40,850][123090] Updated weights for policy 1, policy_version 1393286 (0.0011) [2023-12-26 10:47:40,879][123091] Updated weights for policy 0, policy_version 1402832 (0.0007) [2023-12-26 10:47:40,913][123090] Updated weights for policy 1, policy_version 1393296 (0.0011) [2023-12-26 10:47:40,978][123090] Updated weights for policy 1, policy_version 1393306 (0.0010) [2023-12-26 10:47:41,692][123091] Updated weights for policy 0, policy_version 1402842 (0.0006) [2023-12-26 10:47:41,770][123091] Updated weights for policy 0, policy_version 1402852 (0.0008) [2023-12-26 10:47:41,796][123090] Updated weights for policy 1, policy_version 1393316 (0.0006) [2023-12-26 10:47:41,838][123091] Updated weights for policy 0, policy_version 1402862 (0.0008) [2023-12-26 10:47:41,867][123090] Updated weights for policy 1, policy_version 1393326 (0.0006) [2023-12-26 10:47:41,928][123090] Updated weights for policy 1, policy_version 1393336 (0.0006) [2023-12-26 10:47:42,542][123091] Updated weights for policy 0, policy_version 1402872 (0.0007) [2023-12-26 10:47:42,600][123091] Updated weights for policy 0, policy_version 1402882 (0.0005) [2023-12-26 10:47:42,665][123091] Updated weights for policy 0, policy_version 1402892 (0.0005) [2023-12-26 10:47:42,744][123090] Updated weights for policy 1, policy_version 1393346 (0.0006) [2023-12-26 10:47:42,818][123090] Updated weights for policy 1, policy_version 1393356 (0.0006) [2023-12-26 10:47:42,899][123090] Updated weights for policy 1, policy_version 1393366 (0.0007) [2023-12-26 10:47:42,969][123090] Updated weights for policy 1, policy_version 1393376 (0.0009) [2023-12-26 10:47:43,410][123091] Updated weights for policy 0, policy_version 1402902 (0.0005) [2023-12-26 10:47:43,466][123091] Updated weights for policy 0, policy_version 1402912 (0.0005) [2023-12-26 10:47:43,522][123091] Updated weights for policy 0, policy_version 1402922 (0.0009) [2023-12-26 10:47:43,728][123090] Updated weights for policy 1, policy_version 1393386 (0.0005) [2023-12-26 10:47:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 715857920. Throughput: 0: 8968.6, 1: 8845.7. Samples: 715852824. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:43,784][121949] Avg episode reward: [(0, '6122.333'), (1, '5474.369')] [2023-12-26 10:47:43,786][123090] Updated weights for policy 1, policy_version 1393396 (0.0005) [2023-12-26 10:47:43,844][123090] Updated weights for policy 1, policy_version 1393406 (0.0005) [2023-12-26 10:47:44,353][123091] Updated weights for policy 0, policy_version 1402932 (0.0009) [2023-12-26 10:47:44,412][123091] Updated weights for policy 0, policy_version 1402942 (0.0010) [2023-12-26 10:47:44,464][123091] Updated weights for policy 0, policy_version 1402953 (0.0010) [2023-12-26 10:47:44,547][123090] Updated weights for policy 1, policy_version 1393416 (0.0009) [2023-12-26 10:47:44,607][123090] Updated weights for policy 1, policy_version 1393426 (0.0009) [2023-12-26 10:47:44,678][123090] Updated weights for policy 1, policy_version 1393436 (0.0008) [2023-12-26 10:47:45,336][123091] Updated weights for policy 0, policy_version 1402963 (0.0010) [2023-12-26 10:47:45,402][123091] Updated weights for policy 0, policy_version 1402973 (0.0009) [2023-12-26 10:47:45,466][123091] Updated weights for policy 0, policy_version 1402983 (0.0010) [2023-12-26 10:47:45,515][123090] Updated weights for policy 1, policy_version 1393446 (0.0008) [2023-12-26 10:47:45,576][123090] Updated weights for policy 1, policy_version 1393456 (0.0009) [2023-12-26 10:47:45,628][123090] Updated weights for policy 1, policy_version 1393466 (0.0009) [2023-12-26 10:47:46,322][123091] Updated weights for policy 0, policy_version 1402993 (0.0008) [2023-12-26 10:47:46,385][123091] Updated weights for policy 0, policy_version 1403003 (0.0009) [2023-12-26 10:47:46,422][123090] Updated weights for policy 1, policy_version 1393476 (0.0009) [2023-12-26 10:47:46,446][123091] Updated weights for policy 0, policy_version 1403013 (0.0008) [2023-12-26 10:47:46,490][123090] Updated weights for policy 1, policy_version 1393486 (0.0008) [2023-12-26 10:47:46,496][123091] Updated weights for policy 0, policy_version 1403023 (0.0008) [2023-12-26 10:47:46,559][123090] Updated weights for policy 1, policy_version 1393496 (0.0010) [2023-12-26 10:47:47,334][123091] Updated weights for policy 0, policy_version 1403033 (0.0009) [2023-12-26 10:47:47,365][123090] Updated weights for policy 1, policy_version 1393506 (0.0009) [2023-12-26 10:47:47,395][123091] Updated weights for policy 0, policy_version 1403043 (0.0008) [2023-12-26 10:47:47,427][123090] Updated weights for policy 1, policy_version 1393516 (0.0009) [2023-12-26 10:47:47,455][123091] Updated weights for policy 0, policy_version 1403053 (0.0009) [2023-12-26 10:47:47,485][123090] Updated weights for policy 1, policy_version 1393526 (0.0008) [2023-12-26 10:47:48,281][123091] Updated weights for policy 0, policy_version 1403063 (0.0009) [2023-12-26 10:47:48,325][123090] Updated weights for policy 1, policy_version 1393537 (0.0008) [2023-12-26 10:47:48,344][123091] Updated weights for policy 0, policy_version 1403073 (0.0009) [2023-12-26 10:47:48,400][123090] Updated weights for policy 1, policy_version 1393547 (0.0009) [2023-12-26 10:47:48,411][123091] Updated weights for policy 0, policy_version 1403083 (0.0007) [2023-12-26 10:47:48,468][123090] Updated weights for policy 1, policy_version 1393557 (0.0009) [2023-12-26 10:47:48,538][123090] Updated weights for policy 1, policy_version 1393567 (0.0010) [2023-12-26 10:47:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 715948032. Throughput: 0: 8873.9, 1: 8802.0. Samples: 715956420. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:48,785][121949] Avg episode reward: [(0, '6233.056'), (1, '5554.107')] [2023-12-26 10:47:49,228][123090] Updated weights for policy 1, policy_version 1393577 (0.0008) [2023-12-26 10:47:49,268][123091] Updated weights for policy 0, policy_version 1403093 (0.0006) [2023-12-26 10:47:49,299][123090] Updated weights for policy 1, policy_version 1393587 (0.0008) [2023-12-26 10:47:49,343][123091] Updated weights for policy 0, policy_version 1403103 (0.0008) [2023-12-26 10:47:49,367][123090] Updated weights for policy 1, policy_version 1393597 (0.0007) [2023-12-26 10:47:49,409][123091] Updated weights for policy 0, policy_version 1403113 (0.0010) [2023-12-26 10:47:50,167][123091] Updated weights for policy 0, policy_version 1403123 (0.0010) [2023-12-26 10:47:50,216][123090] Updated weights for policy 1, policy_version 1393607 (0.0010) [2023-12-26 10:47:50,231][123091] Updated weights for policy 0, policy_version 1403133 (0.0006) [2023-12-26 10:47:50,280][123090] Updated weights for policy 1, policy_version 1393617 (0.0010) [2023-12-26 10:47:50,299][123091] Updated weights for policy 0, policy_version 1403143 (0.0007) [2023-12-26 10:47:50,347][123090] Updated weights for policy 1, policy_version 1393627 (0.0009) [2023-12-26 10:47:51,102][123090] Updated weights for policy 1, policy_version 1393637 (0.0006) [2023-12-26 10:47:51,147][123091] Updated weights for policy 0, policy_version 1403153 (0.0008) [2023-12-26 10:47:51,175][123090] Updated weights for policy 1, policy_version 1393647 (0.0008) [2023-12-26 10:47:51,213][123091] Updated weights for policy 0, policy_version 1403163 (0.0008) [2023-12-26 10:47:51,235][123090] Updated weights for policy 1, policy_version 1393657 (0.0006) [2023-12-26 10:47:51,281][123091] Updated weights for policy 0, policy_version 1403173 (0.0008) [2023-12-26 10:47:51,352][123091] Updated weights for policy 0, policy_version 1403183 (0.0010) [2023-12-26 10:47:52,062][123090] Updated weights for policy 1, policy_version 1393667 (0.0009) [2023-12-26 10:47:52,129][123090] Updated weights for policy 1, policy_version 1393677 (0.0010) [2023-12-26 10:47:52,177][123091] Updated weights for policy 0, policy_version 1403193 (0.0010) [2023-12-26 10:47:52,181][123090] Updated weights for policy 1, policy_version 1393687 (0.0010) [2023-12-26 10:47:52,231][123091] Updated weights for policy 0, policy_version 1403203 (0.0006) [2023-12-26 10:47:52,287][123091] Updated weights for policy 0, policy_version 1403213 (0.0009) [2023-12-26 10:47:53,024][123090] Updated weights for policy 1, policy_version 1393697 (0.0011) [2023-12-26 10:47:53,087][123090] Updated weights for policy 1, policy_version 1393707 (0.0011) [2023-12-26 10:47:53,146][123090] Updated weights for policy 1, policy_version 1393717 (0.0010) [2023-12-26 10:47:53,153][123091] Updated weights for policy 0, policy_version 1403223 (0.0007) [2023-12-26 10:47:53,205][123090] Updated weights for policy 1, policy_version 1393727 (0.0010) [2023-12-26 10:47:53,212][123091] Updated weights for policy 0, policy_version 1403233 (0.0006) [2023-12-26 10:47:53,275][123091] Updated weights for policy 0, policy_version 1403243 (0.0008) [2023-12-26 10:47:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 716029952. Throughput: 0: 8811.2, 1: 8772.4. Samples: 716008176. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:53,785][121949] Avg episode reward: [(0, '6295.205'), (1, '5696.666')] [2023-12-26 10:47:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001403248_359235584.pth... [2023-12-26 10:47:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001393728_356794368.pth... [2023-12-26 10:47:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001402224_358973440.pth [2023-12-26 10:47:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001392704_356532224.pth [2023-12-26 10:47:54,022][123090] Updated weights for policy 1, policy_version 1393737 (0.0010) [2023-12-26 10:47:54,075][123090] Updated weights for policy 1, policy_version 1393747 (0.0010) [2023-12-26 10:47:54,105][123091] Updated weights for policy 0, policy_version 1403253 (0.0009) [2023-12-26 10:47:54,131][123090] Updated weights for policy 1, policy_version 1393757 (0.0010) [2023-12-26 10:47:54,169][123091] Updated weights for policy 0, policy_version 1403263 (0.0007) [2023-12-26 10:47:54,232][123091] Updated weights for policy 0, policy_version 1403273 (0.0009) [2023-12-26 10:47:54,969][123090] Updated weights for policy 1, policy_version 1393767 (0.0009) [2023-12-26 10:47:55,034][123090] Updated weights for policy 1, policy_version 1393777 (0.0008) [2023-12-26 10:47:55,071][123091] Updated weights for policy 0, policy_version 1403283 (0.0009) [2023-12-26 10:47:55,108][123090] Updated weights for policy 1, policy_version 1393787 (0.0008) [2023-12-26 10:47:55,127][123091] Updated weights for policy 0, policy_version 1403293 (0.0008) [2023-12-26 10:47:55,188][123091] Updated weights for policy 0, policy_version 1403303 (0.0009) [2023-12-26 10:47:55,821][123090] Updated weights for policy 1, policy_version 1393797 (0.0007) [2023-12-26 10:47:55,877][123090] Updated weights for policy 1, policy_version 1393807 (0.0009) [2023-12-26 10:47:55,929][123090] Updated weights for policy 1, policy_version 1393817 (0.0011) [2023-12-26 10:47:56,078][123091] Updated weights for policy 0, policy_version 1403313 (0.0010) [2023-12-26 10:47:56,134][123091] Updated weights for policy 0, policy_version 1403323 (0.0010) [2023-12-26 10:47:56,197][123091] Updated weights for policy 0, policy_version 1403333 (0.0009) [2023-12-26 10:47:56,266][123091] Updated weights for policy 0, policy_version 1403343 (0.0010) [2023-12-26 10:47:56,702][123090] Updated weights for policy 1, policy_version 1393827 (0.0009) [2023-12-26 10:47:56,749][123090] Updated weights for policy 1, policy_version 1393837 (0.0005) [2023-12-26 10:47:56,802][123090] Updated weights for policy 1, policy_version 1393847 (0.0005) [2023-12-26 10:47:57,160][123091] Updated weights for policy 0, policy_version 1403353 (0.0010) [2023-12-26 10:47:57,231][123091] Updated weights for policy 0, policy_version 1403363 (0.0010) [2023-12-26 10:47:57,297][123091] Updated weights for policy 0, policy_version 1403373 (0.0010) [2023-12-26 10:47:57,460][123090] Updated weights for policy 1, policy_version 1393857 (0.0005) [2023-12-26 10:47:57,506][123090] Updated weights for policy 1, policy_version 1393867 (0.0005) [2023-12-26 10:47:57,574][123090] Updated weights for policy 1, policy_version 1393877 (0.0006) [2023-12-26 10:47:57,644][123090] Updated weights for policy 1, policy_version 1393887 (0.0010) [2023-12-26 10:47:58,182][123091] Updated weights for policy 0, policy_version 1403383 (0.0009) [2023-12-26 10:47:58,254][123091] Updated weights for policy 0, policy_version 1403393 (0.0007) [2023-12-26 10:47:58,326][123091] Updated weights for policy 0, policy_version 1403403 (0.0010) [2023-12-26 10:47:58,354][123090] Updated weights for policy 1, policy_version 1393897 (0.0010) [2023-12-26 10:47:58,429][123090] Updated weights for policy 1, policy_version 1393907 (0.0010) [2023-12-26 10:47:58,504][123090] Updated weights for policy 1, policy_version 1393917 (0.0007) [2023-12-26 10:47:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 716120064. Throughput: 0: 8742.9, 1: 8827.8. Samples: 716112492. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:47:58,785][121949] Avg episode reward: [(0, '6349.433'), (1, '5642.675')] [2023-12-26 10:47:59,174][123091] Updated weights for policy 0, policy_version 1403413 (0.0009) [2023-12-26 10:47:59,236][123091] Updated weights for policy 0, policy_version 1403423 (0.0006) [2023-12-26 10:47:59,299][123091] Updated weights for policy 0, policy_version 1403433 (0.0008) [2023-12-26 10:47:59,301][123090] Updated weights for policy 1, policy_version 1393927 (0.0007) [2023-12-26 10:47:59,375][123090] Updated weights for policy 1, policy_version 1393937 (0.0008) [2023-12-26 10:47:59,435][123090] Updated weights for policy 1, policy_version 1393947 (0.0010) [2023-12-26 10:48:00,066][123091] Updated weights for policy 0, policy_version 1403443 (0.0009) [2023-12-26 10:48:00,125][123091] Updated weights for policy 0, policy_version 1403453 (0.0010) [2023-12-26 10:48:00,132][123090] Updated weights for policy 1, policy_version 1393957 (0.0006) [2023-12-26 10:48:00,185][123091] Updated weights for policy 0, policy_version 1403463 (0.0010) [2023-12-26 10:48:00,188][123090] Updated weights for policy 1, policy_version 1393967 (0.0006) [2023-12-26 10:48:00,240][123090] Updated weights for policy 1, policy_version 1393977 (0.0008) [2023-12-26 10:48:01,020][123091] Updated weights for policy 0, policy_version 1403473 (0.0010) [2023-12-26 10:48:01,084][123090] Updated weights for policy 1, policy_version 1393987 (0.0008) [2023-12-26 10:48:01,090][123091] Updated weights for policy 0, policy_version 1403483 (0.0010) [2023-12-26 10:48:01,143][123090] Updated weights for policy 1, policy_version 1393997 (0.0006) [2023-12-26 10:48:01,157][123091] Updated weights for policy 0, policy_version 1403493 (0.0011) [2023-12-26 10:48:01,213][123090] Updated weights for policy 1, policy_version 1394007 (0.0007) [2023-12-26 10:48:01,219][123091] Updated weights for policy 0, policy_version 1403503 (0.0011) [2023-12-26 10:48:02,028][123091] Updated weights for policy 0, policy_version 1403513 (0.0009) [2023-12-26 10:48:02,070][123090] Updated weights for policy 1, policy_version 1394017 (0.0007) [2023-12-26 10:48:02,082][123091] Updated weights for policy 0, policy_version 1403523 (0.0009) [2023-12-26 10:48:02,122][123090] Updated weights for policy 1, policy_version 1394027 (0.0005) [2023-12-26 10:48:02,143][123091] Updated weights for policy 0, policy_version 1403533 (0.0008) [2023-12-26 10:48:02,187][123090] Updated weights for policy 1, policy_version 1394037 (0.0007) [2023-12-26 10:48:02,264][123090] Updated weights for policy 1, policy_version 1394047 (0.0009) [2023-12-26 10:48:03,002][123091] Updated weights for policy 0, policy_version 1403543 (0.0007) [2023-12-26 10:48:03,073][123091] Updated weights for policy 0, policy_version 1403553 (0.0005) [2023-12-26 10:48:03,087][123090] Updated weights for policy 1, policy_version 1394057 (0.0009) [2023-12-26 10:48:03,139][123091] Updated weights for policy 0, policy_version 1403563 (0.0005) [2023-12-26 10:48:03,144][123090] Updated weights for policy 1, policy_version 1394067 (0.0009) [2023-12-26 10:48:03,211][123090] Updated weights for policy 1, policy_version 1394077 (0.0010) [2023-12-26 10:48:03,719][123091] Updated weights for policy 0, policy_version 1403573 (0.0005) [2023-12-26 10:48:03,771][123091] Updated weights for policy 0, policy_version 1403583 (0.0005) [2023-12-26 10:48:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 716201984. Throughput: 0: 8778.6, 1: 8834.8. Samples: 716218064. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:03,785][121949] Avg episode reward: [(0, '6323.308'), (1, '5418.456')] [2023-12-26 10:48:03,820][123091] Updated weights for policy 0, policy_version 1403593 (0.0008) [2023-12-26 10:48:03,994][123090] Updated weights for policy 1, policy_version 1394087 (0.0010) [2023-12-26 10:48:04,054][123090] Updated weights for policy 1, policy_version 1394097 (0.0011) [2023-12-26 10:48:04,119][123090] Updated weights for policy 1, policy_version 1394107 (0.0010) [2023-12-26 10:48:04,619][123091] Updated weights for policy 0, policy_version 1403603 (0.0008) [2023-12-26 10:48:04,672][123091] Updated weights for policy 0, policy_version 1403613 (0.0009) [2023-12-26 10:48:04,728][123091] Updated weights for policy 0, policy_version 1403623 (0.0008) [2023-12-26 10:48:04,875][123090] Updated weights for policy 1, policy_version 1394117 (0.0008) [2023-12-26 10:48:04,922][123090] Updated weights for policy 1, policy_version 1394127 (0.0005) [2023-12-26 10:48:04,968][123090] Updated weights for policy 1, policy_version 1394137 (0.0005) [2023-12-26 10:48:05,658][123091] Updated weights for policy 0, policy_version 1403633 (0.0010) [2023-12-26 10:48:05,686][123090] Updated weights for policy 1, policy_version 1394147 (0.0007) [2023-12-26 10:48:05,714][123091] Updated weights for policy 0, policy_version 1403643 (0.0007) [2023-12-26 10:48:05,734][123090] Updated weights for policy 1, policy_version 1394157 (0.0010) [2023-12-26 10:48:05,770][123091] Updated weights for policy 0, policy_version 1403653 (0.0006) [2023-12-26 10:48:05,793][123090] Updated weights for policy 1, policy_version 1394167 (0.0008) [2023-12-26 10:48:05,825][123091] Updated weights for policy 0, policy_version 1403663 (0.0009) [2023-12-26 10:48:06,607][123090] Updated weights for policy 1, policy_version 1394177 (0.0010) [2023-12-26 10:48:06,670][123090] Updated weights for policy 1, policy_version 1394187 (0.0010) [2023-12-26 10:48:06,694][123091] Updated weights for policy 0, policy_version 1403673 (0.0008) [2023-12-26 10:48:06,730][123090] Updated weights for policy 1, policy_version 1394197 (0.0010) [2023-12-26 10:48:06,751][123091] Updated weights for policy 0, policy_version 1403683 (0.0007) [2023-12-26 10:48:06,798][123090] Updated weights for policy 1, policy_version 1394207 (0.0010) [2023-12-26 10:48:06,818][123091] Updated weights for policy 0, policy_version 1403693 (0.0008) [2023-12-26 10:48:07,514][123091] Updated weights for policy 0, policy_version 1403703 (0.0008) [2023-12-26 10:48:07,574][123091] Updated weights for policy 0, policy_version 1403713 (0.0009) [2023-12-26 10:48:07,625][123090] Updated weights for policy 1, policy_version 1394217 (0.0010) [2023-12-26 10:48:07,637][123091] Updated weights for policy 0, policy_version 1403723 (0.0007) [2023-12-26 10:48:07,688][123090] Updated weights for policy 1, policy_version 1394227 (0.0010) [2023-12-26 10:48:07,744][123090] Updated weights for policy 1, policy_version 1394237 (0.0010) [2023-12-26 10:48:08,340][123091] Updated weights for policy 0, policy_version 1403733 (0.0008) [2023-12-26 10:48:08,400][123091] Updated weights for policy 0, policy_version 1403743 (0.0009) [2023-12-26 10:48:08,464][123091] Updated weights for policy 0, policy_version 1403753 (0.0008) [2023-12-26 10:48:08,552][123090] Updated weights for policy 1, policy_version 1394247 (0.0007) [2023-12-26 10:48:08,616][123090] Updated weights for policy 1, policy_version 1394257 (0.0005) [2023-12-26 10:48:08,673][123090] Updated weights for policy 1, policy_version 1394267 (0.0005) [2023-12-26 10:48:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 716300288. Throughput: 0: 8743.9, 1: 8907.1. Samples: 716271660. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:08,785][121949] Avg episode reward: [(0, '6274.513'), (1, '5244.193')] [2023-12-26 10:48:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001403760_359366656.pth... [2023-12-26 10:48:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001394272_356933632.pth... [2023-12-26 10:48:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001393216_356663296.pth [2023-12-26 10:48:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001402736_359104512.pth [2023-12-26 10:48:09,205][123091] Updated weights for policy 0, policy_version 1403763 (0.0008) [2023-12-26 10:48:09,269][123091] Updated weights for policy 0, policy_version 1403773 (0.0009) [2023-12-26 10:48:09,322][123091] Updated weights for policy 0, policy_version 1403783 (0.0009) [2023-12-26 10:48:09,486][123090] Updated weights for policy 1, policy_version 1394277 (0.0008) [2023-12-26 10:48:09,561][123090] Updated weights for policy 1, policy_version 1394287 (0.0008) [2023-12-26 10:48:09,628][123090] Updated weights for policy 1, policy_version 1394297 (0.0008) [2023-12-26 10:48:10,178][123091] Updated weights for policy 0, policy_version 1403793 (0.0009) [2023-12-26 10:48:10,251][123091] Updated weights for policy 0, policy_version 1403803 (0.0009) [2023-12-26 10:48:10,315][123091] Updated weights for policy 0, policy_version 1403813 (0.0009) [2023-12-26 10:48:10,324][123090] Updated weights for policy 1, policy_version 1394307 (0.0006) [2023-12-26 10:48:10,381][123091] Updated weights for policy 0, policy_version 1403823 (0.0007) [2023-12-26 10:48:10,391][123090] Updated weights for policy 1, policy_version 1394317 (0.0010) [2023-12-26 10:48:10,456][123090] Updated weights for policy 1, policy_version 1394327 (0.0011) [2023-12-26 10:48:11,217][123091] Updated weights for policy 0, policy_version 1403833 (0.0009) [2023-12-26 10:48:11,235][123090] Updated weights for policy 1, policy_version 1394337 (0.0010) [2023-12-26 10:48:11,284][123091] Updated weights for policy 0, policy_version 1403843 (0.0009) [2023-12-26 10:48:11,307][123090] Updated weights for policy 1, policy_version 1394347 (0.0010) [2023-12-26 10:48:11,345][123091] Updated weights for policy 0, policy_version 1403853 (0.0007) [2023-12-26 10:48:11,376][123090] Updated weights for policy 1, policy_version 1394357 (0.0011) [2023-12-26 10:48:11,454][123090] Updated weights for policy 1, policy_version 1394367 (0.0009) [2023-12-26 10:48:12,234][123091] Updated weights for policy 0, policy_version 1403863 (0.0009) [2023-12-26 10:48:12,282][123090] Updated weights for policy 1, policy_version 1394377 (0.0010) [2023-12-26 10:48:12,299][123091] Updated weights for policy 0, policy_version 1403873 (0.0008) [2023-12-26 10:48:12,352][123090] Updated weights for policy 1, policy_version 1394387 (0.0012) [2023-12-26 10:48:12,368][123091] Updated weights for policy 0, policy_version 1403883 (0.0009) [2023-12-26 10:48:12,419][123090] Updated weights for policy 1, policy_version 1394397 (0.0010) [2023-12-26 10:48:13,218][123091] Updated weights for policy 0, policy_version 1403893 (0.0008) [2023-12-26 10:48:13,234][123090] Updated weights for policy 1, policy_version 1394407 (0.0010) [2023-12-26 10:48:13,275][123091] Updated weights for policy 0, policy_version 1403903 (0.0006) [2023-12-26 10:48:13,285][123090] Updated weights for policy 1, policy_version 1394417 (0.0010) [2023-12-26 10:48:13,335][123091] Updated weights for policy 0, policy_version 1403913 (0.0006) [2023-12-26 10:48:13,344][123090] Updated weights for policy 1, policy_version 1394427 (0.0010) [2023-12-26 10:48:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 716382208. Throughput: 0: 8724.3, 1: 8809.4. Samples: 716376096. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:13,785][121949] Avg episode reward: [(0, '6247.218'), (1, '5283.852')] [2023-12-26 10:48:14,086][123090] Updated weights for policy 1, policy_version 1394437 (0.0008) [2023-12-26 10:48:14,138][123090] Updated weights for policy 1, policy_version 1394447 (0.0005) [2023-12-26 10:48:14,202][123090] Updated weights for policy 1, policy_version 1394457 (0.0008) [2023-12-26 10:48:14,210][123091] Updated weights for policy 0, policy_version 1403923 (0.0008) [2023-12-26 10:48:14,270][123091] Updated weights for policy 0, policy_version 1403933 (0.0007) [2023-12-26 10:48:14,338][123091] Updated weights for policy 0, policy_version 1403943 (0.0009) [2023-12-26 10:48:14,936][123090] Updated weights for policy 1, policy_version 1394467 (0.0010) [2023-12-26 10:48:15,000][123090] Updated weights for policy 1, policy_version 1394477 (0.0011) [2023-12-26 10:48:15,065][123090] Updated weights for policy 1, policy_version 1394487 (0.0011) [2023-12-26 10:48:15,211][123091] Updated weights for policy 0, policy_version 1403953 (0.0010) [2023-12-26 10:48:15,276][123091] Updated weights for policy 0, policy_version 1403963 (0.0009) [2023-12-26 10:48:15,345][123091] Updated weights for policy 0, policy_version 1403973 (0.0009) [2023-12-26 10:48:15,409][123091] Updated weights for policy 0, policy_version 1403983 (0.0009) [2023-12-26 10:48:15,903][123090] Updated weights for policy 1, policy_version 1394497 (0.0011) [2023-12-26 10:48:15,963][123090] Updated weights for policy 1, policy_version 1394507 (0.0010) [2023-12-26 10:48:16,026][123090] Updated weights for policy 1, policy_version 1394517 (0.0010) [2023-12-26 10:48:16,086][123090] Updated weights for policy 1, policy_version 1394527 (0.0010) [2023-12-26 10:48:16,158][123091] Updated weights for policy 0, policy_version 1403993 (0.0006) [2023-12-26 10:48:16,219][123091] Updated weights for policy 0, policy_version 1404003 (0.0005) [2023-12-26 10:48:16,291][123091] Updated weights for policy 0, policy_version 1404013 (0.0007) [2023-12-26 10:48:16,796][123090] Updated weights for policy 1, policy_version 1394537 (0.0006) [2023-12-26 10:48:16,845][123090] Updated weights for policy 1, policy_version 1394547 (0.0005) [2023-12-26 10:48:16,875][123091] Updated weights for policy 0, policy_version 1404023 (0.0006) [2023-12-26 10:48:16,900][123090] Updated weights for policy 1, policy_version 1394557 (0.0007) [2023-12-26 10:48:16,941][123091] Updated weights for policy 0, policy_version 1404033 (0.0010) [2023-12-26 10:48:16,993][123091] Updated weights for policy 0, policy_version 1404043 (0.0010) [2023-12-26 10:48:17,706][123090] Updated weights for policy 1, policy_version 1394567 (0.0010) [2023-12-26 10:48:17,757][123090] Updated weights for policy 1, policy_version 1394577 (0.0009) [2023-12-26 10:48:17,816][123090] Updated weights for policy 1, policy_version 1394587 (0.0009) [2023-12-26 10:48:17,825][123091] Updated weights for policy 0, policy_version 1404053 (0.0008) [2023-12-26 10:48:17,877][123091] Updated weights for policy 0, policy_version 1404063 (0.0005) [2023-12-26 10:48:17,935][123091] Updated weights for policy 0, policy_version 1404073 (0.0009) [2023-12-26 10:48:18,590][123090] Updated weights for policy 1, policy_version 1394597 (0.0010) [2023-12-26 10:48:18,642][123090] Updated weights for policy 1, policy_version 1394607 (0.0010) [2023-12-26 10:48:18,700][123090] Updated weights for policy 1, policy_version 1394617 (0.0009) [2023-12-26 10:48:18,781][123091] Updated weights for policy 0, policy_version 1404083 (0.0009) [2023-12-26 10:48:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 716472320. Throughput: 0: 8716.9, 1: 8868.6. Samples: 716483316. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:18,785][121949] Avg episode reward: [(0, '6283.310'), (1, '5378.524')] [2023-12-26 10:48:18,830][123091] Updated weights for policy 0, policy_version 1404093 (0.0009) [2023-12-26 10:48:18,888][123091] Updated weights for policy 0, policy_version 1404103 (0.0009) [2023-12-26 10:48:19,512][123090] Updated weights for policy 1, policy_version 1394627 (0.0010) [2023-12-26 10:48:19,573][123090] Updated weights for policy 1, policy_version 1394637 (0.0006) [2023-12-26 10:48:19,636][123090] Updated weights for policy 1, policy_version 1394647 (0.0009) [2023-12-26 10:48:19,778][123091] Updated weights for policy 0, policy_version 1404113 (0.0009) [2023-12-26 10:48:19,840][123091] Updated weights for policy 0, policy_version 1404123 (0.0010) [2023-12-26 10:48:19,898][123091] Updated weights for policy 0, policy_version 1404133 (0.0009) [2023-12-26 10:48:19,970][123091] Updated weights for policy 0, policy_version 1404143 (0.0009) [2023-12-26 10:48:20,491][123090] Updated weights for policy 1, policy_version 1394657 (0.0009) [2023-12-26 10:48:20,556][123090] Updated weights for policy 1, policy_version 1394667 (0.0009) [2023-12-26 10:48:20,624][123090] Updated weights for policy 1, policy_version 1394677 (0.0009) [2023-12-26 10:48:20,680][123090] Updated weights for policy 1, policy_version 1394687 (0.0009) [2023-12-26 10:48:20,844][123091] Updated weights for policy 0, policy_version 1404153 (0.0007) [2023-12-26 10:48:20,915][123091] Updated weights for policy 0, policy_version 1404163 (0.0006) [2023-12-26 10:48:20,980][123091] Updated weights for policy 0, policy_version 1404173 (0.0008) [2023-12-26 10:48:21,589][123090] Updated weights for policy 1, policy_version 1394697 (0.0009) [2023-12-26 10:48:21,655][123090] Updated weights for policy 1, policy_version 1394707 (0.0008) [2023-12-26 10:48:21,716][123090] Updated weights for policy 1, policy_version 1394717 (0.0009) [2023-12-26 10:48:21,719][123091] Updated weights for policy 0, policy_version 1404183 (0.0009) [2023-12-26 10:48:21,790][123091] Updated weights for policy 0, policy_version 1404193 (0.0010) [2023-12-26 10:48:21,862][123091] Updated weights for policy 0, policy_version 1404203 (0.0009) [2023-12-26 10:48:22,609][123090] Updated weights for policy 1, policy_version 1394727 (0.0010) [2023-12-26 10:48:22,653][123091] Updated weights for policy 0, policy_version 1404213 (0.0008) [2023-12-26 10:48:22,681][123090] Updated weights for policy 1, policy_version 1394737 (0.0008) [2023-12-26 10:48:22,707][123091] Updated weights for policy 0, policy_version 1404223 (0.0009) [2023-12-26 10:48:22,746][123090] Updated weights for policy 1, policy_version 1394747 (0.0010) [2023-12-26 10:48:22,763][123091] Updated weights for policy 0, policy_version 1404233 (0.0007) [2023-12-26 10:48:23,488][123091] Updated weights for policy 0, policy_version 1404243 (0.0009) [2023-12-26 10:48:23,539][123091] Updated weights for policy 0, policy_version 1404253 (0.0010) [2023-12-26 10:48:23,591][123091] Updated weights for policy 0, policy_version 1404263 (0.0010) [2023-12-26 10:48:23,602][123090] Updated weights for policy 1, policy_version 1394757 (0.0008) [2023-12-26 10:48:23,653][123090] Updated weights for policy 1, policy_version 1394767 (0.0008) [2023-12-26 10:48:23,704][123090] Updated weights for policy 1, policy_version 1394777 (0.0009) [2023-12-26 10:48:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 716562432. Throughput: 0: 8615.6, 1: 8822.6. Samples: 716533512. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:23,785][121949] Avg episode reward: [(0, '6215.779'), (1, '5290.933')] [2023-12-26 10:48:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001404272_359497728.pth... [2023-12-26 10:48:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001394784_357064704.pth... [2023-12-26 10:48:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001403248_359235584.pth [2023-12-26 10:48:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001393728_356794368.pth [2023-12-26 10:48:24,440][123091] Updated weights for policy 0, policy_version 1404273 (0.0007) [2023-12-26 10:48:24,516][123091] Updated weights for policy 0, policy_version 1404283 (0.0005) [2023-12-26 10:48:24,578][123090] Updated weights for policy 1, policy_version 1394787 (0.0010) [2023-12-26 10:48:24,588][123091] Updated weights for policy 0, policy_version 1404293 (0.0006) [2023-12-26 10:48:24,627][123090] Updated weights for policy 1, policy_version 1394797 (0.0008) [2023-12-26 10:48:24,645][123091] Updated weights for policy 0, policy_version 1404303 (0.0009) [2023-12-26 10:48:24,683][123090] Updated weights for policy 1, policy_version 1394807 (0.0008) [2023-12-26 10:48:25,364][123091] Updated weights for policy 0, policy_version 1404313 (0.0006) [2023-12-26 10:48:25,426][123091] Updated weights for policy 0, policy_version 1404323 (0.0006) [2023-12-26 10:48:25,486][123091] Updated weights for policy 0, policy_version 1404333 (0.0010) [2023-12-26 10:48:25,573][123090] Updated weights for policy 1, policy_version 1394817 (0.0010) [2023-12-26 10:48:25,621][123090] Updated weights for policy 1, policy_version 1394827 (0.0008) [2023-12-26 10:48:25,673][123090] Updated weights for policy 1, policy_version 1394837 (0.0009) [2023-12-26 10:48:25,731][123090] Updated weights for policy 1, policy_version 1394847 (0.0010) [2023-12-26 10:48:26,193][123091] Updated weights for policy 0, policy_version 1404343 (0.0007) [2023-12-26 10:48:26,250][123091] Updated weights for policy 0, policy_version 1404353 (0.0007) [2023-12-26 10:48:26,309][123091] Updated weights for policy 0, policy_version 1404363 (0.0011) [2023-12-26 10:48:26,697][123090] Updated weights for policy 1, policy_version 1394857 (0.0010) [2023-12-26 10:48:26,756][123090] Updated weights for policy 1, policy_version 1394868 (0.0010) [2023-12-26 10:48:26,815][123090] Updated weights for policy 1, policy_version 1394878 (0.0010) [2023-12-26 10:48:26,974][123091] Updated weights for policy 0, policy_version 1404373 (0.0007) [2023-12-26 10:48:27,025][123091] Updated weights for policy 0, policy_version 1404383 (0.0005) [2023-12-26 10:48:27,089][123091] Updated weights for policy 0, policy_version 1404393 (0.0010) [2023-12-26 10:48:27,704][123090] Updated weights for policy 1, policy_version 1394888 (0.0009) [2023-12-26 10:48:27,760][123090] Updated weights for policy 1, policy_version 1394898 (0.0010) [2023-12-26 10:48:27,808][123090] Updated weights for policy 1, policy_version 1394908 (0.0009) [2023-12-26 10:48:27,870][123091] Updated weights for policy 0, policy_version 1404403 (0.0010) [2023-12-26 10:48:27,927][123091] Updated weights for policy 0, policy_version 1404413 (0.0010) [2023-12-26 10:48:27,977][123091] Updated weights for policy 0, policy_version 1404423 (0.0010) [2023-12-26 10:48:28,665][123090] Updated weights for policy 1, policy_version 1394919 (0.0007) [2023-12-26 10:48:28,714][123090] Updated weights for policy 1, policy_version 1394929 (0.0005) [2023-12-26 10:48:28,734][123091] Updated weights for policy 0, policy_version 1404433 (0.0010) [2023-12-26 10:48:28,765][123090] Updated weights for policy 1, policy_version 1394939 (0.0005) [2023-12-26 10:48:28,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 716636160. Throughput: 0: 8671.9, 1: 8767.2. Samples: 716637584. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:28,785][121949] Avg episode reward: [(0, '6222.037'), (1, '5235.836')] [2023-12-26 10:48:28,794][123091] Updated weights for policy 0, policy_version 1404443 (0.0006) [2023-12-26 10:48:28,851][123091] Updated weights for policy 0, policy_version 1404453 (0.0005) [2023-12-26 10:48:28,911][123091] Updated weights for policy 0, policy_version 1404463 (0.0005) [2023-12-26 10:48:29,552][123090] Updated weights for policy 1, policy_version 1394949 (0.0008) [2023-12-26 10:48:29,603][123090] Updated weights for policy 1, policy_version 1394959 (0.0009) [2023-12-26 10:48:29,633][123091] Updated weights for policy 0, policy_version 1404473 (0.0005) [2023-12-26 10:48:29,654][123090] Updated weights for policy 1, policy_version 1394969 (0.0009) [2023-12-26 10:48:29,694][123091] Updated weights for policy 0, policy_version 1404483 (0.0007) [2023-12-26 10:48:29,753][123091] Updated weights for policy 0, policy_version 1404493 (0.0005) [2023-12-26 10:48:30,481][123091] Updated weights for policy 0, policy_version 1404503 (0.0008) [2023-12-26 10:48:30,534][123091] Updated weights for policy 0, policy_version 1404513 (0.0010) [2023-12-26 10:48:30,549][123090] Updated weights for policy 1, policy_version 1394979 (0.0008) [2023-12-26 10:48:30,591][123091] Updated weights for policy 0, policy_version 1404523 (0.0011) [2023-12-26 10:48:30,607][123090] Updated weights for policy 1, policy_version 1394989 (0.0007) [2023-12-26 10:48:30,673][123090] Updated weights for policy 1, policy_version 1394999 (0.0007) [2023-12-26 10:48:31,374][123090] Updated weights for policy 1, policy_version 1395009 (0.0006) [2023-12-26 10:48:31,440][123091] Updated weights for policy 0, policy_version 1404533 (0.0008) [2023-12-26 10:48:31,445][123090] Updated weights for policy 1, policy_version 1395019 (0.0010) [2023-12-26 10:48:31,485][123091] Updated weights for policy 0, policy_version 1404543 (0.0005) [2023-12-26 10:48:31,499][123090] Updated weights for policy 1, policy_version 1395029 (0.0010) [2023-12-26 10:48:31,531][123091] Updated weights for policy 0, policy_version 1404553 (0.0005) [2023-12-26 10:48:31,554][123090] Updated weights for policy 1, policy_version 1395039 (0.0009) [2023-12-26 10:48:32,258][123091] Updated weights for policy 0, policy_version 1404563 (0.0007) [2023-12-26 10:48:32,323][123091] Updated weights for policy 0, policy_version 1404573 (0.0009) [2023-12-26 10:48:32,394][123091] Updated weights for policy 0, policy_version 1404583 (0.0007) [2023-12-26 10:48:32,449][123090] Updated weights for policy 1, policy_version 1395049 (0.0008) [2023-12-26 10:48:32,507][123090] Updated weights for policy 1, policy_version 1395059 (0.0009) [2023-12-26 10:48:32,567][123090] Updated weights for policy 1, policy_version 1395070 (0.0010) [2023-12-26 10:48:33,102][123091] Updated weights for policy 0, policy_version 1404593 (0.0006) [2023-12-26 10:48:33,150][123091] Updated weights for policy 0, policy_version 1404603 (0.0005) [2023-12-26 10:48:33,194][123091] Updated weights for policy 0, policy_version 1404613 (0.0007) [2023-12-26 10:48:33,241][123091] Updated weights for policy 0, policy_version 1404623 (0.0010) [2023-12-26 10:48:33,329][123090] Updated weights for policy 1, policy_version 1395080 (0.0006) [2023-12-26 10:48:33,391][123090] Updated weights for policy 1, policy_version 1395090 (0.0005) [2023-12-26 10:48:33,444][123090] Updated weights for policy 1, policy_version 1395100 (0.0005) [2023-12-26 10:48:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 716734464. Throughput: 0: 8784.2, 1: 8764.9. Samples: 716746128. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:33,785][121949] Avg episode reward: [(0, '6405.896'), (1, '5237.934')] [2023-12-26 10:48:34,064][123091] Updated weights for policy 0, policy_version 1404633 (0.0007) [2023-12-26 10:48:34,116][123090] Updated weights for policy 1, policy_version 1395110 (0.0006) [2023-12-26 10:48:34,125][123091] Updated weights for policy 0, policy_version 1404643 (0.0006) [2023-12-26 10:48:34,190][123090] Updated weights for policy 1, policy_version 1395120 (0.0010) [2023-12-26 10:48:34,192][123091] Updated weights for policy 0, policy_version 1404653 (0.0011) [2023-12-26 10:48:34,248][123090] Updated weights for policy 1, policy_version 1395130 (0.0008) [2023-12-26 10:48:35,018][123090] Updated weights for policy 1, policy_version 1395140 (0.0008) [2023-12-26 10:48:35,042][123091] Updated weights for policy 0, policy_version 1404663 (0.0008) [2023-12-26 10:48:35,075][123090] Updated weights for policy 1, policy_version 1395150 (0.0007) [2023-12-26 10:48:35,100][123091] Updated weights for policy 0, policy_version 1404673 (0.0010) [2023-12-26 10:48:35,137][123090] Updated weights for policy 1, policy_version 1395160 (0.0006) [2023-12-26 10:48:35,157][123091] Updated weights for policy 0, policy_version 1404683 (0.0009) [2023-12-26 10:48:35,750][123090] Updated weights for policy 1, policy_version 1395170 (0.0008) [2023-12-26 10:48:35,821][123090] Updated weights for policy 1, policy_version 1395180 (0.0011) [2023-12-26 10:48:35,888][123090] Updated weights for policy 1, policy_version 1395190 (0.0011) [2023-12-26 10:48:35,954][123090] Updated weights for policy 1, policy_version 1395200 (0.0011) [2023-12-26 10:48:36,007][123091] Updated weights for policy 0, policy_version 1404693 (0.0008) [2023-12-26 10:48:36,062][123091] Updated weights for policy 0, policy_version 1404703 (0.0007) [2023-12-26 10:48:36,113][123091] Updated weights for policy 0, policy_version 1404713 (0.0010) [2023-12-26 10:48:36,777][123090] Updated weights for policy 1, policy_version 1395210 (0.0008) [2023-12-26 10:48:36,851][123090] Updated weights for policy 1, policy_version 1395220 (0.0006) [2023-12-26 10:48:36,922][123090] Updated weights for policy 1, policy_version 1395230 (0.0005) [2023-12-26 10:48:36,969][123091] Updated weights for policy 0, policy_version 1404723 (0.0010) [2023-12-26 10:48:37,031][123091] Updated weights for policy 0, policy_version 1404733 (0.0011) [2023-12-26 10:48:37,098][123091] Updated weights for policy 0, policy_version 1404743 (0.0010) [2023-12-26 10:48:37,713][123090] Updated weights for policy 1, policy_version 1395240 (0.0008) [2023-12-26 10:48:37,779][123090] Updated weights for policy 1, policy_version 1395250 (0.0009) [2023-12-26 10:48:37,836][123090] Updated weights for policy 1, policy_version 1395260 (0.0008) [2023-12-26 10:48:37,921][123091] Updated weights for policy 0, policy_version 1404753 (0.0010) [2023-12-26 10:48:37,968][123091] Updated weights for policy 0, policy_version 1404763 (0.0010) [2023-12-26 10:48:38,020][123091] Updated weights for policy 0, policy_version 1404773 (0.0009) [2023-12-26 10:48:38,071][123091] Updated weights for policy 0, policy_version 1404783 (0.0005) [2023-12-26 10:48:38,713][123090] Updated weights for policy 1, policy_version 1395270 (0.0008) [2023-12-26 10:48:38,723][123091] Updated weights for policy 0, policy_version 1404793 (0.0008) [2023-12-26 10:48:38,777][123090] Updated weights for policy 1, policy_version 1395280 (0.0008) [2023-12-26 10:48:38,782][123091] Updated weights for policy 0, policy_version 1404803 (0.0007) [2023-12-26 10:48:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 716816384. Throughput: 0: 8787.6, 1: 8798.3. Samples: 716799536. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:38,784][121949] Avg episode reward: [(0, '6386.982'), (1, '5241.922')] [2023-12-26 10:48:38,842][123090] Updated weights for policy 1, policy_version 1395290 (0.0009) [2023-12-26 10:48:38,851][123091] Updated weights for policy 0, policy_version 1404813 (0.0005) [2023-12-26 10:48:38,871][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001404816_359636992.pth... [2023-12-26 10:48:38,876][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001403760_359366656.pth [2023-12-26 10:48:38,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001395296_357195776.pth... [2023-12-26 10:48:38,882][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001394272_356933632.pth [2023-12-26 10:48:39,600][123091] Updated weights for policy 0, policy_version 1404823 (0.0006) [2023-12-26 10:48:39,672][123091] Updated weights for policy 0, policy_version 1404833 (0.0009) [2023-12-26 10:48:39,731][123090] Updated weights for policy 1, policy_version 1395300 (0.0008) [2023-12-26 10:48:39,740][123091] Updated weights for policy 0, policy_version 1404843 (0.0008) [2023-12-26 10:48:39,799][123090] Updated weights for policy 1, policy_version 1395310 (0.0009) [2023-12-26 10:48:39,867][123090] Updated weights for policy 1, policy_version 1395320 (0.0009) [2023-12-26 10:48:40,521][123091] Updated weights for policy 0, policy_version 1404853 (0.0009) [2023-12-26 10:48:40,572][123091] Updated weights for policy 0, policy_version 1404863 (0.0009) [2023-12-26 10:48:40,620][123091] Updated weights for policy 0, policy_version 1404873 (0.0008) [2023-12-26 10:48:40,637][123090] Updated weights for policy 1, policy_version 1395330 (0.0009) [2023-12-26 10:48:40,698][123090] Updated weights for policy 1, policy_version 1395340 (0.0010) [2023-12-26 10:48:40,756][123090] Updated weights for policy 1, policy_version 1395350 (0.0010) [2023-12-26 10:48:40,812][123090] Updated weights for policy 1, policy_version 1395360 (0.0010) [2023-12-26 10:48:41,417][123091] Updated weights for policy 0, policy_version 1404883 (0.0007) [2023-12-26 10:48:41,486][123091] Updated weights for policy 0, policy_version 1404893 (0.0005) [2023-12-26 10:48:41,546][123091] Updated weights for policy 0, policy_version 1404903 (0.0006) [2023-12-26 10:48:41,709][123090] Updated weights for policy 1, policy_version 1395370 (0.0010) [2023-12-26 10:48:41,781][123090] Updated weights for policy 1, policy_version 1395380 (0.0008) [2023-12-26 10:48:41,852][123090] Updated weights for policy 1, policy_version 1395390 (0.0008) [2023-12-26 10:48:42,287][123091] Updated weights for policy 0, policy_version 1404913 (0.0006) [2023-12-26 10:48:42,352][123091] Updated weights for policy 0, policy_version 1404923 (0.0009) [2023-12-26 10:48:42,422][123091] Updated weights for policy 0, policy_version 1404933 (0.0010) [2023-12-26 10:48:42,491][123091] Updated weights for policy 0, policy_version 1404943 (0.0010) [2023-12-26 10:48:42,661][123090] Updated weights for policy 1, policy_version 1395400 (0.0009) [2023-12-26 10:48:42,731][123090] Updated weights for policy 1, policy_version 1395410 (0.0009) [2023-12-26 10:48:42,798][123090] Updated weights for policy 1, policy_version 1395420 (0.0010) [2023-12-26 10:48:43,352][123091] Updated weights for policy 0, policy_version 1404954 (0.0010) [2023-12-26 10:48:43,409][123091] Updated weights for policy 0, policy_version 1404964 (0.0010) [2023-12-26 10:48:43,462][123091] Updated weights for policy 0, policy_version 1404974 (0.0007) [2023-12-26 10:48:43,504][123090] Updated weights for policy 1, policy_version 1395430 (0.0008) [2023-12-26 10:48:43,549][123090] Updated weights for policy 1, policy_version 1395440 (0.0008) [2023-12-26 10:48:43,609][123090] Updated weights for policy 1, policy_version 1395450 (0.0009) [2023-12-26 10:48:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 716914688. Throughput: 0: 8896.4, 1: 8687.0. Samples: 716903748. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:43,785][121949] Avg episode reward: [(0, '6329.935'), (1, '5297.009')] [2023-12-26 10:48:44,206][123091] Updated weights for policy 0, policy_version 1404984 (0.0005) [2023-12-26 10:48:44,274][123091] Updated weights for policy 0, policy_version 1404994 (0.0005) [2023-12-26 10:48:44,335][123091] Updated weights for policy 0, policy_version 1405004 (0.0005) [2023-12-26 10:48:44,446][123090] Updated weights for policy 1, policy_version 1395460 (0.0010) [2023-12-26 10:48:44,501][123090] Updated weights for policy 1, policy_version 1395470 (0.0010) [2023-12-26 10:48:44,553][123090] Updated weights for policy 1, policy_version 1395480 (0.0010) [2023-12-26 10:48:45,050][123091] Updated weights for policy 0, policy_version 1405014 (0.0008) [2023-12-26 10:48:45,108][123091] Updated weights for policy 0, policy_version 1405024 (0.0009) [2023-12-26 10:48:45,170][123091] Updated weights for policy 0, policy_version 1405034 (0.0006) [2023-12-26 10:48:45,415][123090] Updated weights for policy 1, policy_version 1395490 (0.0009) [2023-12-26 10:48:45,484][123090] Updated weights for policy 1, policy_version 1395500 (0.0007) [2023-12-26 10:48:45,562][123090] Updated weights for policy 1, policy_version 1395510 (0.0006) [2023-12-26 10:48:45,631][123090] Updated weights for policy 1, policy_version 1395520 (0.0007) [2023-12-26 10:48:45,870][123091] Updated weights for policy 0, policy_version 1405044 (0.0011) [2023-12-26 10:48:45,913][123091] Updated weights for policy 0, policy_version 1405054 (0.0010) [2023-12-26 10:48:45,975][123091] Updated weights for policy 0, policy_version 1405064 (0.0010) [2023-12-26 10:48:46,382][123090] Updated weights for policy 1, policy_version 1395530 (0.0010) [2023-12-26 10:48:46,442][123090] Updated weights for policy 1, policy_version 1395540 (0.0008) [2023-12-26 10:48:46,501][123090] Updated weights for policy 1, policy_version 1395550 (0.0005) [2023-12-26 10:48:46,760][123091] Updated weights for policy 0, policy_version 1405074 (0.0009) [2023-12-26 10:48:46,823][123091] Updated weights for policy 0, policy_version 1405084 (0.0007) [2023-12-26 10:48:46,875][123091] Updated weights for policy 0, policy_version 1405094 (0.0009) [2023-12-26 10:48:46,932][123091] Updated weights for policy 0, policy_version 1405104 (0.0010) [2023-12-26 10:48:47,270][123090] Updated weights for policy 1, policy_version 1395560 (0.0009) [2023-12-26 10:48:47,325][123090] Updated weights for policy 1, policy_version 1395570 (0.0008) [2023-12-26 10:48:47,387][123090] Updated weights for policy 1, policy_version 1395580 (0.0009) [2023-12-26 10:48:47,775][123091] Updated weights for policy 0, policy_version 1405114 (0.0009) [2023-12-26 10:48:47,836][123091] Updated weights for policy 0, policy_version 1405124 (0.0009) [2023-12-26 10:48:47,905][123091] Updated weights for policy 0, policy_version 1405134 (0.0009) [2023-12-26 10:48:48,249][123090] Updated weights for policy 1, policy_version 1395590 (0.0010) [2023-12-26 10:48:48,310][123090] Updated weights for policy 1, policy_version 1395600 (0.0009) [2023-12-26 10:48:48,375][123090] Updated weights for policy 1, policy_version 1395610 (0.0010) [2023-12-26 10:48:48,751][123091] Updated weights for policy 0, policy_version 1405144 (0.0008) [2023-12-26 10:48:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 716996608. Throughput: 0: 8917.7, 1: 8691.9. Samples: 717010500. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:48,785][121949] Avg episode reward: [(0, '6347.250'), (1, '4946.672')] [2023-12-26 10:48:48,814][123091] Updated weights for policy 0, policy_version 1405154 (0.0008) [2023-12-26 10:48:48,880][123091] Updated weights for policy 0, policy_version 1405164 (0.0007) [2023-12-26 10:48:49,181][123090] Updated weights for policy 1, policy_version 1395620 (0.0008) [2023-12-26 10:48:49,247][123090] Updated weights for policy 1, policy_version 1395630 (0.0010) [2023-12-26 10:48:49,310][123090] Updated weights for policy 1, policy_version 1395640 (0.0010) [2023-12-26 10:48:49,570][123091] Updated weights for policy 0, policy_version 1405174 (0.0006) [2023-12-26 10:48:49,638][123091] Updated weights for policy 0, policy_version 1405184 (0.0005) [2023-12-26 10:48:49,716][123091] Updated weights for policy 0, policy_version 1405194 (0.0005) [2023-12-26 10:48:50,177][123090] Updated weights for policy 1, policy_version 1395650 (0.0009) [2023-12-26 10:48:50,243][123090] Updated weights for policy 1, policy_version 1395660 (0.0005) [2023-12-26 10:48:50,300][123090] Updated weights for policy 1, policy_version 1395670 (0.0009) [2023-12-26 10:48:50,351][123090] Updated weights for policy 1, policy_version 1395680 (0.0010) [2023-12-26 10:48:50,484][123091] Updated weights for policy 0, policy_version 1405204 (0.0007) [2023-12-26 10:48:50,563][123091] Updated weights for policy 0, policy_version 1405214 (0.0006) [2023-12-26 10:48:50,634][123091] Updated weights for policy 0, policy_version 1405224 (0.0008) [2023-12-26 10:48:51,180][123090] Updated weights for policy 1, policy_version 1395690 (0.0008) [2023-12-26 10:48:51,247][123090] Updated weights for policy 1, policy_version 1395700 (0.0008) [2023-12-26 10:48:51,315][123090] Updated weights for policy 1, policy_version 1395710 (0.0011) [2023-12-26 10:48:51,484][123091] Updated weights for policy 0, policy_version 1405234 (0.0007) [2023-12-26 10:48:51,551][123091] Updated weights for policy 0, policy_version 1405244 (0.0009) [2023-12-26 10:48:51,605][123091] Updated weights for policy 0, policy_version 1405254 (0.0010) [2023-12-26 10:48:51,669][123091] Updated weights for policy 0, policy_version 1405264 (0.0007) [2023-12-26 10:48:52,070][123090] Updated weights for policy 1, policy_version 1395720 (0.0008) [2023-12-26 10:48:52,120][123090] Updated weights for policy 1, policy_version 1395730 (0.0005) [2023-12-26 10:48:52,192][123090] Updated weights for policy 1, policy_version 1395740 (0.0006) [2023-12-26 10:48:52,514][123091] Updated weights for policy 0, policy_version 1405274 (0.0009) [2023-12-26 10:48:52,577][123091] Updated weights for policy 0, policy_version 1405284 (0.0009) [2023-12-26 10:48:52,642][123091] Updated weights for policy 0, policy_version 1405294 (0.0010) [2023-12-26 10:48:52,988][123090] Updated weights for policy 1, policy_version 1395750 (0.0006) [2023-12-26 10:48:53,055][123090] Updated weights for policy 1, policy_version 1395760 (0.0007) [2023-12-26 10:48:53,121][123090] Updated weights for policy 1, policy_version 1395770 (0.0010) [2023-12-26 10:48:53,514][123091] Updated weights for policy 0, policy_version 1405304 (0.0006) [2023-12-26 10:48:53,571][123091] Updated weights for policy 0, policy_version 1405314 (0.0005) [2023-12-26 10:48:53,636][123091] Updated weights for policy 0, policy_version 1405324 (0.0005) [2023-12-26 10:48:53,766][123090] Updated weights for policy 1, policy_version 1395780 (0.0008) [2023-12-26 10:48:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 717086720. Throughput: 0: 8962.5, 1: 8634.7. Samples: 717063532. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:53,784][121949] Avg episode reward: [(0, '6445.207'), (1, '4841.536')] [2023-12-26 10:48:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001405328_359768064.pth... [2023-12-26 10:48:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001404272_359497728.pth [2023-12-26 10:48:53,844][123090] Updated weights for policy 1, policy_version 1395790 (0.0006) [2023-12-26 10:48:53,924][123090] Updated weights for policy 1, policy_version 1395800 (0.0005) [2023-12-26 10:48:53,981][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001395808_357326848.pth... [2023-12-26 10:48:53,987][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001394784_357064704.pth [2023-12-26 10:48:54,313][123091] Updated weights for policy 0, policy_version 1405334 (0.0008) [2023-12-26 10:48:54,366][123091] Updated weights for policy 0, policy_version 1405344 (0.0010) [2023-12-26 10:48:54,428][123091] Updated weights for policy 0, policy_version 1405354 (0.0010) [2023-12-26 10:48:54,524][123090] Updated weights for policy 1, policy_version 1395810 (0.0005) [2023-12-26 10:48:54,586][123090] Updated weights for policy 1, policy_version 1395820 (0.0008) [2023-12-26 10:48:54,656][123090] Updated weights for policy 1, policy_version 1395830 (0.0010) [2023-12-26 10:48:54,722][123090] Updated weights for policy 1, policy_version 1395840 (0.0010) [2023-12-26 10:48:55,222][123091] Updated weights for policy 0, policy_version 1405364 (0.0008) [2023-12-26 10:48:55,286][123091] Updated weights for policy 0, policy_version 1405374 (0.0009) [2023-12-26 10:48:55,363][123091] Updated weights for policy 0, policy_version 1405384 (0.0005) [2023-12-26 10:48:55,458][123090] Updated weights for policy 1, policy_version 1395850 (0.0010) [2023-12-26 10:48:55,513][123090] Updated weights for policy 1, policy_version 1395860 (0.0010) [2023-12-26 10:48:55,577][123090] Updated weights for policy 1, policy_version 1395870 (0.0010) [2023-12-26 10:48:55,969][123091] Updated weights for policy 0, policy_version 1405394 (0.0006) [2023-12-26 10:48:56,021][123091] Updated weights for policy 0, policy_version 1405404 (0.0009) [2023-12-26 10:48:56,085][123091] Updated weights for policy 0, policy_version 1405415 (0.0010) [2023-12-26 10:48:56,338][123090] Updated weights for policy 1, policy_version 1395880 (0.0006) [2023-12-26 10:48:56,387][123090] Updated weights for policy 1, policy_version 1395890 (0.0006) [2023-12-26 10:48:56,430][123090] Updated weights for policy 1, policy_version 1395900 (0.0010) [2023-12-26 10:48:56,912][123091] Updated weights for policy 0, policy_version 1405426 (0.0010) [2023-12-26 10:48:56,972][123091] Updated weights for policy 0, policy_version 1405436 (0.0009) [2023-12-26 10:48:57,029][123091] Updated weights for policy 0, policy_version 1405446 (0.0009) [2023-12-26 10:48:57,084][123091] Updated weights for policy 0, policy_version 1405456 (0.0009) [2023-12-26 10:48:57,250][123090] Updated weights for policy 1, policy_version 1395910 (0.0007) [2023-12-26 10:48:57,314][123090] Updated weights for policy 1, policy_version 1395920 (0.0005) [2023-12-26 10:48:57,379][123090] Updated weights for policy 1, policy_version 1395930 (0.0007) [2023-12-26 10:48:57,934][123091] Updated weights for policy 0, policy_version 1405466 (0.0005) [2023-12-26 10:48:57,983][123091] Updated weights for policy 0, policy_version 1405476 (0.0009) [2023-12-26 10:48:58,044][123091] Updated weights for policy 0, policy_version 1405486 (0.0009) [2023-12-26 10:48:58,155][123090] Updated weights for policy 1, policy_version 1395940 (0.0010) [2023-12-26 10:48:58,219][123090] Updated weights for policy 1, policy_version 1395950 (0.0010) [2023-12-26 10:48:58,286][123090] Updated weights for policy 1, policy_version 1395960 (0.0010) [2023-12-26 10:48:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 717176832. Throughput: 0: 8985.3, 1: 8745.9. Samples: 717174004. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:48:58,785][121949] Avg episode reward: [(0, '6363.235'), (1, '5007.280')] [2023-12-26 10:48:58,880][123091] Updated weights for policy 0, policy_version 1405496 (0.0008) [2023-12-26 10:48:58,941][123091] Updated weights for policy 0, policy_version 1405506 (0.0008) [2023-12-26 10:48:58,999][123091] Updated weights for policy 0, policy_version 1405516 (0.0007) [2023-12-26 10:48:59,168][123090] Updated weights for policy 1, policy_version 1395970 (0.0010) [2023-12-26 10:48:59,230][123090] Updated weights for policy 1, policy_version 1395980 (0.0009) [2023-12-26 10:48:59,296][123090] Updated weights for policy 1, policy_version 1395990 (0.0008) [2023-12-26 10:48:59,365][123090] Updated weights for policy 1, policy_version 1396000 (0.0009) [2023-12-26 10:48:59,916][123091] Updated weights for policy 0, policy_version 1405526 (0.0009) [2023-12-26 10:48:59,977][123091] Updated weights for policy 0, policy_version 1405536 (0.0007) [2023-12-26 10:49:00,033][123091] Updated weights for policy 0, policy_version 1405546 (0.0006) [2023-12-26 10:49:00,173][123090] Updated weights for policy 1, policy_version 1396010 (0.0009) [2023-12-26 10:49:00,245][123090] Updated weights for policy 1, policy_version 1396020 (0.0009) [2023-12-26 10:49:00,309][123090] Updated weights for policy 1, policy_version 1396030 (0.0009) [2023-12-26 10:49:00,803][123091] Updated weights for policy 0, policy_version 1405556 (0.0007) [2023-12-26 10:49:00,866][123091] Updated weights for policy 0, policy_version 1405566 (0.0008) [2023-12-26 10:49:00,924][123091] Updated weights for policy 0, policy_version 1405576 (0.0006) [2023-12-26 10:49:01,057][123090] Updated weights for policy 1, policy_version 1396040 (0.0009) [2023-12-26 10:49:01,137][123090] Updated weights for policy 1, policy_version 1396050 (0.0010) [2023-12-26 10:49:01,227][123090] Updated weights for policy 1, policy_version 1396060 (0.0010) [2023-12-26 10:49:01,755][123091] Updated weights for policy 0, policy_version 1405586 (0.0007) [2023-12-26 10:49:01,813][123091] Updated weights for policy 0, policy_version 1405596 (0.0010) [2023-12-26 10:49:01,875][123091] Updated weights for policy 0, policy_version 1405606 (0.0010) [2023-12-26 10:49:01,944][123091] Updated weights for policy 0, policy_version 1405616 (0.0009) [2023-12-26 10:49:01,997][123090] Updated weights for policy 1, policy_version 1396070 (0.0010) [2023-12-26 10:49:02,060][123090] Updated weights for policy 1, policy_version 1396080 (0.0009) [2023-12-26 10:49:02,130][123090] Updated weights for policy 1, policy_version 1396090 (0.0009) [2023-12-26 10:49:02,766][123091] Updated weights for policy 0, policy_version 1405626 (0.0006) [2023-12-26 10:49:02,828][123091] Updated weights for policy 0, policy_version 1405636 (0.0006) [2023-12-26 10:49:02,882][123091] Updated weights for policy 0, policy_version 1405646 (0.0005) [2023-12-26 10:49:02,894][123090] Updated weights for policy 1, policy_version 1396100 (0.0007) [2023-12-26 10:49:02,947][123090] Updated weights for policy 1, policy_version 1396110 (0.0005) [2023-12-26 10:49:03,002][123090] Updated weights for policy 1, policy_version 1396120 (0.0008) [2023-12-26 10:49:03,520][123091] Updated weights for policy 0, policy_version 1405656 (0.0006) [2023-12-26 10:49:03,565][123091] Updated weights for policy 0, policy_version 1405666 (0.0005) [2023-12-26 10:49:03,611][123091] Updated weights for policy 0, policy_version 1405676 (0.0005) [2023-12-26 10:49:03,717][123090] Updated weights for policy 1, policy_version 1396130 (0.0009) [2023-12-26 10:49:03,776][123090] Updated weights for policy 1, policy_version 1396140 (0.0006) [2023-12-26 10:49:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 717266944. Throughput: 0: 8981.1, 1: 8707.9. Samples: 717279320. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:03,784][121949] Avg episode reward: [(0, '6330.947'), (1, '5090.120')] [2023-12-26 10:49:03,827][123090] Updated weights for policy 1, policy_version 1396150 (0.0006) [2023-12-26 10:49:03,898][123090] Updated weights for policy 1, policy_version 1396160 (0.0009) [2023-12-26 10:49:04,389][123091] Updated weights for policy 0, policy_version 1405686 (0.0005) [2023-12-26 10:49:04,451][123091] Updated weights for policy 0, policy_version 1405696 (0.0005) [2023-12-26 10:49:04,523][123091] Updated weights for policy 0, policy_version 1405706 (0.0005) [2023-12-26 10:49:04,667][123090] Updated weights for policy 1, policy_version 1396170 (0.0010) [2023-12-26 10:49:04,721][123090] Updated weights for policy 1, policy_version 1396180 (0.0010) [2023-12-26 10:49:04,772][123090] Updated weights for policy 1, policy_version 1396190 (0.0010) [2023-12-26 10:49:05,308][123091] Updated weights for policy 0, policy_version 1405716 (0.0007) [2023-12-26 10:49:05,376][123091] Updated weights for policy 0, policy_version 1405726 (0.0009) [2023-12-26 10:49:05,436][123091] Updated weights for policy 0, policy_version 1405736 (0.0009) [2023-12-26 10:49:05,512][123090] Updated weights for policy 1, policy_version 1396200 (0.0006) [2023-12-26 10:49:05,570][123090] Updated weights for policy 1, policy_version 1396210 (0.0005) [2023-12-26 10:49:05,635][123090] Updated weights for policy 1, policy_version 1396220 (0.0008) [2023-12-26 10:49:06,302][123091] Updated weights for policy 0, policy_version 1405746 (0.0009) [2023-12-26 10:49:06,370][123091] Updated weights for policy 0, policy_version 1405756 (0.0010) [2023-12-26 10:49:06,390][123090] Updated weights for policy 1, policy_version 1396230 (0.0008) [2023-12-26 10:49:06,428][123091] Updated weights for policy 0, policy_version 1405766 (0.0008) [2023-12-26 10:49:06,444][123090] Updated weights for policy 1, policy_version 1396240 (0.0008) [2023-12-26 10:49:06,503][123090] Updated weights for policy 1, policy_version 1396250 (0.0007) [2023-12-26 10:49:06,514][123091] Updated weights for policy 0, policy_version 1405776 (0.0009) [2023-12-26 10:49:07,323][123091] Updated weights for policy 0, policy_version 1405786 (0.0009) [2023-12-26 10:49:07,363][123090] Updated weights for policy 1, policy_version 1396260 (0.0009) [2023-12-26 10:49:07,375][123091] Updated weights for policy 0, policy_version 1405796 (0.0009) [2023-12-26 10:49:07,422][123090] Updated weights for policy 1, policy_version 1396270 (0.0007) [2023-12-26 10:49:07,430][123091] Updated weights for policy 0, policy_version 1405806 (0.0010) [2023-12-26 10:49:07,479][123090] Updated weights for policy 1, policy_version 1396280 (0.0009) [2023-12-26 10:49:08,261][123091] Updated weights for policy 0, policy_version 1405816 (0.0009) [2023-12-26 10:49:08,319][123091] Updated weights for policy 0, policy_version 1405826 (0.0008) [2023-12-26 10:49:08,324][123090] Updated weights for policy 1, policy_version 1396290 (0.0009) [2023-12-26 10:49:08,387][123091] Updated weights for policy 0, policy_version 1405836 (0.0008) [2023-12-26 10:49:08,388][123090] Updated weights for policy 1, policy_version 1396300 (0.0009) [2023-12-26 10:49:08,443][123090] Updated weights for policy 1, policy_version 1396310 (0.0009) [2023-12-26 10:49:08,502][123090] Updated weights for policy 1, policy_version 1396320 (0.0009) [2023-12-26 10:49:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 717357056. Throughput: 0: 8993.6, 1: 8779.2. Samples: 717333288. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:08,785][121949] Avg episode reward: [(0, '6304.818'), (1, '5155.433')] [2023-12-26 10:49:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001405840_359899136.pth... [2023-12-26 10:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001396320_357457920.pth... [2023-12-26 10:49:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001404816_359636992.pth [2023-12-26 10:49:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001395296_357195776.pth [2023-12-26 10:49:09,193][123091] Updated weights for policy 0, policy_version 1405846 (0.0009) [2023-12-26 10:49:09,266][123091] Updated weights for policy 0, policy_version 1405856 (0.0010) [2023-12-26 10:49:09,331][123091] Updated weights for policy 0, policy_version 1405866 (0.0009) [2023-12-26 10:49:09,367][123090] Updated weights for policy 1, policy_version 1396330 (0.0009) [2023-12-26 10:49:09,434][123090] Updated weights for policy 1, policy_version 1396340 (0.0008) [2023-12-26 10:49:09,502][123090] Updated weights for policy 1, policy_version 1396350 (0.0009) [2023-12-26 10:49:10,160][123091] Updated weights for policy 0, policy_version 1405876 (0.0009) [2023-12-26 10:49:10,220][123091] Updated weights for policy 0, policy_version 1405886 (0.0009) [2023-12-26 10:49:10,289][123091] Updated weights for policy 0, policy_version 1405896 (0.0009) [2023-12-26 10:49:10,321][123090] Updated weights for policy 1, policy_version 1396360 (0.0010) [2023-12-26 10:49:10,389][123090] Updated weights for policy 1, policy_version 1396370 (0.0011) [2023-12-26 10:49:10,458][123090] Updated weights for policy 1, policy_version 1396380 (0.0010) [2023-12-26 10:49:11,059][123091] Updated weights for policy 0, policy_version 1405906 (0.0006) [2023-12-26 10:49:11,128][123091] Updated weights for policy 0, policy_version 1405916 (0.0007) [2023-12-26 10:49:11,198][123091] Updated weights for policy 0, policy_version 1405926 (0.0011) [2023-12-26 10:49:11,242][123090] Updated weights for policy 1, policy_version 1396390 (0.0009) [2023-12-26 10:49:11,263][123091] Updated weights for policy 0, policy_version 1405936 (0.0010) [2023-12-26 10:49:11,307][123090] Updated weights for policy 1, policy_version 1396400 (0.0011) [2023-12-26 10:49:11,376][123090] Updated weights for policy 1, policy_version 1396410 (0.0010) [2023-12-26 10:49:12,078][123091] Updated weights for policy 0, policy_version 1405946 (0.0009) [2023-12-26 10:49:12,137][123091] Updated weights for policy 0, policy_version 1405956 (0.0009) [2023-12-26 10:49:12,149][123090] Updated weights for policy 1, policy_version 1396420 (0.0010) [2023-12-26 10:49:12,187][123091] Updated weights for policy 0, policy_version 1405966 (0.0008) [2023-12-26 10:49:12,199][123090] Updated weights for policy 1, policy_version 1396430 (0.0010) [2023-12-26 10:49:12,262][123090] Updated weights for policy 1, policy_version 1396440 (0.0010) [2023-12-26 10:49:13,073][123091] Updated weights for policy 0, policy_version 1405976 (0.0007) [2023-12-26 10:49:13,077][123090] Updated weights for policy 1, policy_version 1396450 (0.0009) [2023-12-26 10:49:13,129][123090] Updated weights for policy 1, policy_version 1396460 (0.0010) [2023-12-26 10:49:13,130][123091] Updated weights for policy 0, policy_version 1405986 (0.0005) [2023-12-26 10:49:13,189][123090] Updated weights for policy 1, policy_version 1396470 (0.0010) [2023-12-26 10:49:13,191][123091] Updated weights for policy 0, policy_version 1405996 (0.0006) [2023-12-26 10:49:13,257][123090] Updated weights for policy 1, policy_version 1396480 (0.0011) [2023-12-26 10:49:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 717438976. Throughput: 0: 8900.4, 1: 8835.9. Samples: 717435716. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:13,785][121949] Avg episode reward: [(0, '6370.524'), (1, '5399.303')] [2023-12-26 10:49:13,844][123091] Updated weights for policy 0, policy_version 1406006 (0.0008) [2023-12-26 10:49:13,898][123091] Updated weights for policy 0, policy_version 1406016 (0.0010) [2023-12-26 10:49:13,954][123091] Updated weights for policy 0, policy_version 1406026 (0.0005) [2023-12-26 10:49:14,115][123090] Updated weights for policy 1, policy_version 1396490 (0.0010) [2023-12-26 10:49:14,166][123090] Updated weights for policy 1, policy_version 1396500 (0.0010) [2023-12-26 10:49:14,217][123090] Updated weights for policy 1, policy_version 1396510 (0.0010) [2023-12-26 10:49:14,658][123091] Updated weights for policy 0, policy_version 1406036 (0.0007) [2023-12-26 10:49:14,713][123091] Updated weights for policy 0, policy_version 1406046 (0.0008) [2023-12-26 10:49:14,761][123091] Updated weights for policy 0, policy_version 1406056 (0.0008) [2023-12-26 10:49:15,066][123090] Updated weights for policy 1, policy_version 1396520 (0.0006) [2023-12-26 10:49:15,137][123090] Updated weights for policy 1, policy_version 1396530 (0.0005) [2023-12-26 10:49:15,211][123090] Updated weights for policy 1, policy_version 1396540 (0.0006) [2023-12-26 10:49:15,497][123091] Updated weights for policy 0, policy_version 1406066 (0.0008) [2023-12-26 10:49:15,562][123091] Updated weights for policy 0, policy_version 1406076 (0.0010) [2023-12-26 10:49:15,632][123091] Updated weights for policy 0, policy_version 1406086 (0.0010) [2023-12-26 10:49:15,691][123091] Updated weights for policy 0, policy_version 1406096 (0.0010) [2023-12-26 10:49:15,828][123090] Updated weights for policy 1, policy_version 1396550 (0.0008) [2023-12-26 10:49:15,875][123090] Updated weights for policy 1, policy_version 1396560 (0.0010) [2023-12-26 10:49:15,938][123090] Updated weights for policy 1, policy_version 1396570 (0.0010) [2023-12-26 10:49:16,374][123091] Updated weights for policy 0, policy_version 1406106 (0.0005) [2023-12-26 10:49:16,426][123091] Updated weights for policy 0, policy_version 1406116 (0.0007) [2023-12-26 10:49:16,484][123091] Updated weights for policy 0, policy_version 1406126 (0.0010) [2023-12-26 10:49:16,767][123090] Updated weights for policy 1, policy_version 1396580 (0.0008) [2023-12-26 10:49:16,814][123090] Updated weights for policy 1, policy_version 1396590 (0.0005) [2023-12-26 10:49:16,862][123090] Updated weights for policy 1, policy_version 1396600 (0.0005) [2023-12-26 10:49:17,243][123091] Updated weights for policy 0, policy_version 1406136 (0.0010) [2023-12-26 10:49:17,309][123091] Updated weights for policy 0, policy_version 1406146 (0.0010) [2023-12-26 10:49:17,375][123091] Updated weights for policy 0, policy_version 1406156 (0.0007) [2023-12-26 10:49:17,600][123090] Updated weights for policy 1, policy_version 1396610 (0.0006) [2023-12-26 10:49:17,668][123090] Updated weights for policy 1, policy_version 1396620 (0.0005) [2023-12-26 10:49:17,740][123090] Updated weights for policy 1, policy_version 1396630 (0.0008) [2023-12-26 10:49:17,807][123090] Updated weights for policy 1, policy_version 1396640 (0.0008) [2023-12-26 10:49:18,118][123091] Updated weights for policy 0, policy_version 1406166 (0.0008) [2023-12-26 10:49:18,174][123091] Updated weights for policy 0, policy_version 1406176 (0.0008) [2023-12-26 10:49:18,238][123091] Updated weights for policy 0, policy_version 1406186 (0.0009) [2023-12-26 10:49:18,556][123090] Updated weights for policy 1, policy_version 1396650 (0.0006) [2023-12-26 10:49:18,624][123090] Updated weights for policy 1, policy_version 1396660 (0.0010) [2023-12-26 10:49:18,699][123090] Updated weights for policy 1, policy_version 1396670 (0.0009) [2023-12-26 10:49:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 717537280. Throughput: 0: 8909.7, 1: 8860.6. Samples: 717545788. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:18,784][121949] Avg episode reward: [(0, '6353.513'), (1, '5620.641')] [2023-12-26 10:49:19,004][123091] Updated weights for policy 0, policy_version 1406196 (0.0008) [2023-12-26 10:49:19,053][123091] Updated weights for policy 0, policy_version 1406206 (0.0006) [2023-12-26 10:49:19,102][123091] Updated weights for policy 0, policy_version 1406216 (0.0005) [2023-12-26 10:49:19,432][123090] Updated weights for policy 1, policy_version 1396680 (0.0007) [2023-12-26 10:49:19,511][123090] Updated weights for policy 1, policy_version 1396690 (0.0006) [2023-12-26 10:49:19,584][123090] Updated weights for policy 1, policy_version 1396700 (0.0009) [2023-12-26 10:49:19,909][123091] Updated weights for policy 0, policy_version 1406226 (0.0007) [2023-12-26 10:49:19,977][123091] Updated weights for policy 0, policy_version 1406236 (0.0010) [2023-12-26 10:49:20,042][123091] Updated weights for policy 0, policy_version 1406247 (0.0009) [2023-12-26 10:49:20,367][123090] Updated weights for policy 1, policy_version 1396710 (0.0009) [2023-12-26 10:49:20,430][123090] Updated weights for policy 1, policy_version 1396720 (0.0010) [2023-12-26 10:49:20,500][123090] Updated weights for policy 1, policy_version 1396730 (0.0009) [2023-12-26 10:49:20,931][123091] Updated weights for policy 0, policy_version 1406257 (0.0010) [2023-12-26 10:49:20,999][123091] Updated weights for policy 0, policy_version 1406267 (0.0010) [2023-12-26 10:49:21,068][123091] Updated weights for policy 0, policy_version 1406277 (0.0010) [2023-12-26 10:49:21,139][123091] Updated weights for policy 0, policy_version 1406287 (0.0010) [2023-12-26 10:49:21,338][123090] Updated weights for policy 1, policy_version 1396740 (0.0009) [2023-12-26 10:49:21,411][123090] Updated weights for policy 1, policy_version 1396750 (0.0009) [2023-12-26 10:49:21,477][123090] Updated weights for policy 1, policy_version 1396760 (0.0009) [2023-12-26 10:49:21,924][123091] Updated weights for policy 0, policy_version 1406297 (0.0010) [2023-12-26 10:49:21,975][123091] Updated weights for policy 0, policy_version 1406307 (0.0010) [2023-12-26 10:49:22,042][123091] Updated weights for policy 0, policy_version 1406317 (0.0009) [2023-12-26 10:49:22,318][123090] Updated weights for policy 1, policy_version 1396770 (0.0009) [2023-12-26 10:49:22,389][123090] Updated weights for policy 1, policy_version 1396780 (0.0008) [2023-12-26 10:49:22,457][123090] Updated weights for policy 1, policy_version 1396790 (0.0009) [2023-12-26 10:49:22,519][123090] Updated weights for policy 1, policy_version 1396800 (0.0009) [2023-12-26 10:49:22,925][123091] Updated weights for policy 0, policy_version 1406327 (0.0009) [2023-12-26 10:49:22,971][123091] Updated weights for policy 0, policy_version 1406337 (0.0009) [2023-12-26 10:49:23,034][123091] Updated weights for policy 0, policy_version 1406348 (0.0009) [2023-12-26 10:49:23,326][123090] Updated weights for policy 1, policy_version 1396810 (0.0008) [2023-12-26 10:49:23,390][123090] Updated weights for policy 1, policy_version 1396820 (0.0010) [2023-12-26 10:49:23,449][123090] Updated weights for policy 1, policy_version 1396830 (0.0010) [2023-12-26 10:49:23,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 717619200. Throughput: 0: 8923.2, 1: 8802.7. Samples: 717597208. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:23,785][121949] Avg episode reward: [(0, '6348.998'), (1, '5464.138')] [2023-12-26 10:49:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001396832_357588992.pth... [2023-12-26 10:49:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001406352_360030208.pth... [2023-12-26 10:49:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001395808_357326848.pth [2023-12-26 10:49:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001405328_359768064.pth [2023-12-26 10:49:23,859][123091] Updated weights for policy 0, policy_version 1406358 (0.0010) [2023-12-26 10:49:23,909][123091] Updated weights for policy 0, policy_version 1406368 (0.0009) [2023-12-26 10:49:23,956][123091] Updated weights for policy 0, policy_version 1406378 (0.0009) [2023-12-26 10:49:24,315][123090] Updated weights for policy 1, policy_version 1396840 (0.0008) [2023-12-26 10:49:24,377][123090] Updated weights for policy 1, policy_version 1396851 (0.0009) [2023-12-26 10:49:24,442][123090] Updated weights for policy 1, policy_version 1396861 (0.0009) [2023-12-26 10:49:24,722][123091] Updated weights for policy 0, policy_version 1406388 (0.0010) [2023-12-26 10:49:24,775][123091] Updated weights for policy 0, policy_version 1406398 (0.0009) [2023-12-26 10:49:24,826][123091] Updated weights for policy 0, policy_version 1406409 (0.0010) [2023-12-26 10:49:25,309][123090] Updated weights for policy 1, policy_version 1396871 (0.0009) [2023-12-26 10:49:25,360][123090] Updated weights for policy 1, policy_version 1396881 (0.0009) [2023-12-26 10:49:25,412][123090] Updated weights for policy 1, policy_version 1396891 (0.0009) [2023-12-26 10:49:25,658][123091] Updated weights for policy 0, policy_version 1406419 (0.0010) [2023-12-26 10:49:25,709][123091] Updated weights for policy 0, policy_version 1406429 (0.0009) [2023-12-26 10:49:25,769][123091] Updated weights for policy 0, policy_version 1406439 (0.0010) [2023-12-26 10:49:26,301][123090] Updated weights for policy 1, policy_version 1396901 (0.0010) [2023-12-26 10:49:26,358][123090] Updated weights for policy 1, policy_version 1396911 (0.0009) [2023-12-26 10:49:26,413][123090] Updated weights for policy 1, policy_version 1396921 (0.0009) [2023-12-26 10:49:26,549][123091] Updated weights for policy 0, policy_version 1406449 (0.0009) [2023-12-26 10:49:26,600][123091] Updated weights for policy 0, policy_version 1406459 (0.0007) [2023-12-26 10:49:26,645][123091] Updated weights for policy 0, policy_version 1406469 (0.0005) [2023-12-26 10:49:26,704][123091] Updated weights for policy 0, policy_version 1406479 (0.0005) [2023-12-26 10:49:27,219][123090] Updated weights for policy 1, policy_version 1396931 (0.0008) [2023-12-26 10:49:27,267][123090] Updated weights for policy 1, policy_version 1396941 (0.0005) [2023-12-26 10:49:27,323][123090] Updated weights for policy 1, policy_version 1396951 (0.0005) [2023-12-26 10:49:27,527][123091] Updated weights for policy 0, policy_version 1406489 (0.0010) [2023-12-26 10:49:27,586][123091] Updated weights for policy 0, policy_version 1406499 (0.0010) [2023-12-26 10:49:27,645][123091] Updated weights for policy 0, policy_version 1406509 (0.0010) [2023-12-26 10:49:27,977][123090] Updated weights for policy 1, policy_version 1396961 (0.0007) [2023-12-26 10:49:28,032][123090] Updated weights for policy 1, policy_version 1396971 (0.0006) [2023-12-26 10:49:28,097][123090] Updated weights for policy 1, policy_version 1396981 (0.0005) [2023-12-26 10:49:28,178][123090] Updated weights for policy 1, policy_version 1396991 (0.0005) [2023-12-26 10:49:28,298][123091] Updated weights for policy 0, policy_version 1406519 (0.0006) [2023-12-26 10:49:28,363][123091] Updated weights for policy 0, policy_version 1406529 (0.0009) [2023-12-26 10:49:28,429][123091] Updated weights for policy 0, policy_version 1406539 (0.0010) [2023-12-26 10:49:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 717709312. Throughput: 0: 8897.2, 1: 8849.5. Samples: 717702348. Policy #0 lag: (min: 31.0, avg: 31.5, max: 51.0) [2023-12-26 10:49:28,785][121949] Avg episode reward: [(0, '6461.714'), (1, '5353.644')] [2023-12-26 10:49:28,867][123090] Updated weights for policy 1, policy_version 1397001 (0.0008) [2023-12-26 10:49:28,941][123090] Updated weights for policy 1, policy_version 1397011 (0.0007) [2023-12-26 10:49:29,014][123090] Updated weights for policy 1, policy_version 1397021 (0.0005) [2023-12-26 10:49:29,256][123091] Updated weights for policy 0, policy_version 1406549 (0.0011) [2023-12-26 10:49:29,325][123091] Updated weights for policy 0, policy_version 1406559 (0.0007) [2023-12-26 10:49:29,395][123091] Updated weights for policy 0, policy_version 1406569 (0.0006) [2023-12-26 10:49:29,723][123090] Updated weights for policy 1, policy_version 1397031 (0.0008) [2023-12-26 10:49:29,785][123090] Updated weights for policy 1, policy_version 1397041 (0.0009) [2023-12-26 10:49:29,857][123090] Updated weights for policy 1, policy_version 1397051 (0.0010) [2023-12-26 10:49:30,122][123091] Updated weights for policy 0, policy_version 1406579 (0.0007) [2023-12-26 10:49:30,172][123091] Updated weights for policy 0, policy_version 1406589 (0.0009) [2023-12-26 10:49:30,223][123091] Updated weights for policy 0, policy_version 1406599 (0.0008) [2023-12-26 10:49:30,607][123090] Updated weights for policy 1, policy_version 1397061 (0.0010) [2023-12-26 10:49:30,654][123090] Updated weights for policy 1, policy_version 1397071 (0.0008) [2023-12-26 10:49:30,700][123090] Updated weights for policy 1, policy_version 1397081 (0.0006) [2023-12-26 10:49:31,085][123091] Updated weights for policy 0, policy_version 1406609 (0.0009) [2023-12-26 10:49:31,151][123091] Updated weights for policy 0, policy_version 1406619 (0.0006) [2023-12-26 10:49:31,221][123091] Updated weights for policy 0, policy_version 1406629 (0.0009) [2023-12-26 10:49:31,284][123091] Updated weights for policy 0, policy_version 1406639 (0.0008) [2023-12-26 10:49:31,482][123090] Updated weights for policy 1, policy_version 1397091 (0.0006) [2023-12-26 10:49:31,537][123090] Updated weights for policy 1, policy_version 1397101 (0.0009) [2023-12-26 10:49:31,588][123090] Updated weights for policy 1, policy_version 1397111 (0.0009) [2023-12-26 10:49:32,033][123091] Updated weights for policy 0, policy_version 1406649 (0.0010) [2023-12-26 10:49:32,085][123091] Updated weights for policy 0, policy_version 1406659 (0.0010) [2023-12-26 10:49:32,148][123091] Updated weights for policy 0, policy_version 1406669 (0.0011) [2023-12-26 10:49:32,372][123090] Updated weights for policy 1, policy_version 1397121 (0.0009) [2023-12-26 10:49:32,444][123090] Updated weights for policy 1, policy_version 1397131 (0.0007) [2023-12-26 10:49:32,503][123090] Updated weights for policy 1, policy_version 1397141 (0.0006) [2023-12-26 10:49:32,576][123090] Updated weights for policy 1, policy_version 1397151 (0.0006) [2023-12-26 10:49:32,976][123091] Updated weights for policy 0, policy_version 1406679 (0.0011) [2023-12-26 10:49:33,042][123091] Updated weights for policy 0, policy_version 1406689 (0.0010) [2023-12-26 10:49:33,105][123091] Updated weights for policy 0, policy_version 1406699 (0.0011) [2023-12-26 10:49:33,328][123090] Updated weights for policy 1, policy_version 1397161 (0.0008) [2023-12-26 10:49:33,384][123090] Updated weights for policy 1, policy_version 1397171 (0.0009) [2023-12-26 10:49:33,437][123090] Updated weights for policy 1, policy_version 1397181 (0.0009) [2023-12-26 10:49:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 717799424. Throughput: 0: 8890.9, 1: 8930.6. Samples: 717812464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:33,785][121949] Avg episode reward: [(0, '6357.734'), (1, '5092.848')] [2023-12-26 10:49:33,807][123091] Updated weights for policy 0, policy_version 1406709 (0.0008) [2023-12-26 10:49:33,856][123091] Updated weights for policy 0, policy_version 1406719 (0.0005) [2023-12-26 10:49:33,909][123091] Updated weights for policy 0, policy_version 1406729 (0.0009) [2023-12-26 10:49:34,197][123090] Updated weights for policy 1, policy_version 1397191 (0.0009) [2023-12-26 10:49:34,255][123090] Updated weights for policy 1, policy_version 1397201 (0.0005) [2023-12-26 10:49:34,320][123090] Updated weights for policy 1, policy_version 1397211 (0.0005) [2023-12-26 10:49:34,730][123091] Updated weights for policy 0, policy_version 1406739 (0.0011) [2023-12-26 10:49:34,789][123091] Updated weights for policy 0, policy_version 1406749 (0.0010) [2023-12-26 10:49:34,844][123091] Updated weights for policy 0, policy_version 1406759 (0.0010) [2023-12-26 10:49:35,012][123090] Updated weights for policy 1, policy_version 1397221 (0.0005) [2023-12-26 10:49:35,062][123090] Updated weights for policy 1, policy_version 1397231 (0.0005) [2023-12-26 10:49:35,109][123090] Updated weights for policy 1, policy_version 1397241 (0.0005) [2023-12-26 10:49:35,666][123091] Updated weights for policy 0, policy_version 1406769 (0.0010) [2023-12-26 10:49:35,720][123091] Updated weights for policy 0, policy_version 1406779 (0.0010) [2023-12-26 10:49:35,769][123091] Updated weights for policy 0, policy_version 1406789 (0.0009) [2023-12-26 10:49:35,782][123090] Updated weights for policy 1, policy_version 1397251 (0.0005) [2023-12-26 10:49:35,828][123091] Updated weights for policy 0, policy_version 1406799 (0.0007) [2023-12-26 10:49:35,842][123090] Updated weights for policy 1, policy_version 1397261 (0.0009) [2023-12-26 10:49:35,909][123090] Updated weights for policy 1, policy_version 1397271 (0.0009) [2023-12-26 10:49:36,647][123091] Updated weights for policy 0, policy_version 1406809 (0.0011) [2023-12-26 10:49:36,703][123091] Updated weights for policy 0, policy_version 1406819 (0.0011) [2023-12-26 10:49:36,731][123090] Updated weights for policy 1, policy_version 1397281 (0.0009) [2023-12-26 10:49:36,758][123091] Updated weights for policy 0, policy_version 1406829 (0.0011) [2023-12-26 10:49:36,787][123090] Updated weights for policy 1, policy_version 1397291 (0.0006) [2023-12-26 10:49:36,844][123090] Updated weights for policy 1, policy_version 1397301 (0.0009) [2023-12-26 10:49:36,892][123090] Updated weights for policy 1, policy_version 1397311 (0.0008) [2023-12-26 10:49:37,584][123091] Updated weights for policy 0, policy_version 1406839 (0.0010) [2023-12-26 10:49:37,647][123091] Updated weights for policy 0, policy_version 1406849 (0.0011) [2023-12-26 10:49:37,717][123091] Updated weights for policy 0, policy_version 1406859 (0.0011) [2023-12-26 10:49:37,781][123090] Updated weights for policy 1, policy_version 1397321 (0.0006) [2023-12-26 10:49:37,854][123090] Updated weights for policy 1, policy_version 1397331 (0.0005) [2023-12-26 10:49:37,921][123090] Updated weights for policy 1, policy_version 1397341 (0.0005) [2023-12-26 10:49:38,501][123091] Updated weights for policy 0, policy_version 1406869 (0.0008) [2023-12-26 10:49:38,556][123090] Updated weights for policy 1, policy_version 1397351 (0.0009) [2023-12-26 10:49:38,567][123091] Updated weights for policy 0, policy_version 1406879 (0.0005) [2023-12-26 10:49:38,624][123090] Updated weights for policy 1, policy_version 1397361 (0.0011) [2023-12-26 10:49:38,624][123091] Updated weights for policy 0, policy_version 1406889 (0.0010) [2023-12-26 10:49:38,683][123090] Updated weights for policy 1, policy_version 1397371 (0.0010) [2023-12-26 10:49:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 717897728. Throughput: 0: 8884.8, 1: 9002.6. Samples: 717868464. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:38,785][121949] Avg episode reward: [(0, '6307.386'), (1, '5205.305')] [2023-12-26 10:49:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001406896_360169472.pth... [2023-12-26 10:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001397376_357728256.pth... [2023-12-26 10:49:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001396320_357457920.pth [2023-12-26 10:49:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001405840_359899136.pth [2023-12-26 10:49:39,433][123091] Updated weights for policy 0, policy_version 1406899 (0.0010) [2023-12-26 10:49:39,460][123090] Updated weights for policy 1, policy_version 1397381 (0.0011) [2023-12-26 10:49:39,493][123091] Updated weights for policy 0, policy_version 1406909 (0.0010) [2023-12-26 10:49:39,528][123090] Updated weights for policy 1, policy_version 1397391 (0.0011) [2023-12-26 10:49:39,548][123091] Updated weights for policy 0, policy_version 1406919 (0.0008) [2023-12-26 10:49:39,598][123090] Updated weights for policy 1, policy_version 1397401 (0.0010) [2023-12-26 10:49:40,451][123091] Updated weights for policy 0, policy_version 1406929 (0.0008) [2023-12-26 10:49:40,452][123090] Updated weights for policy 1, policy_version 1397411 (0.0011) [2023-12-26 10:49:40,507][123091] Updated weights for policy 0, policy_version 1406939 (0.0006) [2023-12-26 10:49:40,509][123090] Updated weights for policy 1, policy_version 1397421 (0.0010) [2023-12-26 10:49:40,563][123091] Updated weights for policy 0, policy_version 1406949 (0.0006) [2023-12-26 10:49:40,569][123090] Updated weights for policy 1, policy_version 1397431 (0.0011) [2023-12-26 10:49:40,622][123091] Updated weights for policy 0, policy_version 1406959 (0.0005) [2023-12-26 10:49:41,436][123090] Updated weights for policy 1, policy_version 1397441 (0.0010) [2023-12-26 10:49:41,477][123091] Updated weights for policy 0, policy_version 1406969 (0.0008) [2023-12-26 10:49:41,503][123090] Updated weights for policy 1, policy_version 1397451 (0.0009) [2023-12-26 10:49:41,543][123091] Updated weights for policy 0, policy_version 1406979 (0.0007) [2023-12-26 10:49:41,571][123090] Updated weights for policy 1, policy_version 1397461 (0.0011) [2023-12-26 10:49:41,611][123091] Updated weights for policy 0, policy_version 1406989 (0.0007) [2023-12-26 10:49:41,637][123090] Updated weights for policy 1, policy_version 1397471 (0.0010) [2023-12-26 10:49:42,389][123090] Updated weights for policy 1, policy_version 1397481 (0.0011) [2023-12-26 10:49:42,457][123091] Updated weights for policy 0, policy_version 1406999 (0.0007) [2023-12-26 10:49:42,457][123090] Updated weights for policy 1, policy_version 1397491 (0.0011) [2023-12-26 10:49:42,514][123090] Updated weights for policy 1, policy_version 1397501 (0.0011) [2023-12-26 10:49:42,526][123091] Updated weights for policy 0, policy_version 1407009 (0.0005) [2023-12-26 10:49:42,588][123091] Updated weights for policy 0, policy_version 1407019 (0.0009) [2023-12-26 10:49:43,346][123090] Updated weights for policy 1, policy_version 1397511 (0.0010) [2023-12-26 10:49:43,362][123091] Updated weights for policy 0, policy_version 1407029 (0.0007) [2023-12-26 10:49:43,410][123090] Updated weights for policy 1, policy_version 1397521 (0.0010) [2023-12-26 10:49:43,421][123091] Updated weights for policy 0, policy_version 1407039 (0.0005) [2023-12-26 10:49:43,480][123090] Updated weights for policy 1, policy_version 1397531 (0.0010) [2023-12-26 10:49:43,481][123091] Updated weights for policy 0, policy_version 1407049 (0.0009) [2023-12-26 10:49:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 717979648. Throughput: 0: 8826.8, 1: 8893.2. Samples: 717971400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:43,785][121949] Avg episode reward: [(0, '6267.039'), (1, '5320.233')] [2023-12-26 10:49:44,285][123091] Updated weights for policy 0, policy_version 1407059 (0.0011) [2023-12-26 10:49:44,289][123090] Updated weights for policy 1, policy_version 1397541 (0.0010) [2023-12-26 10:49:44,340][123091] Updated weights for policy 0, policy_version 1407069 (0.0010) [2023-12-26 10:49:44,353][123090] Updated weights for policy 1, policy_version 1397551 (0.0010) [2023-12-26 10:49:44,396][123091] Updated weights for policy 0, policy_version 1407079 (0.0010) [2023-12-26 10:49:44,415][123090] Updated weights for policy 1, policy_version 1397561 (0.0007) [2023-12-26 10:49:45,202][123091] Updated weights for policy 0, policy_version 1407089 (0.0011) [2023-12-26 10:49:45,272][123090] Updated weights for policy 1, policy_version 1397571 (0.0011) [2023-12-26 10:49:45,274][123091] Updated weights for policy 0, policy_version 1407099 (0.0011) [2023-12-26 10:49:45,341][123090] Updated weights for policy 1, policy_version 1397581 (0.0011) [2023-12-26 10:49:45,345][123091] Updated weights for policy 0, policy_version 1407109 (0.0011) [2023-12-26 10:49:45,410][123090] Updated weights for policy 1, policy_version 1397591 (0.0011) [2023-12-26 10:49:45,413][123091] Updated weights for policy 0, policy_version 1407119 (0.0011) [2023-12-26 10:49:46,156][123090] Updated weights for policy 1, policy_version 1397601 (0.0011) [2023-12-26 10:49:46,202][123091] Updated weights for policy 0, policy_version 1407129 (0.0011) [2023-12-26 10:49:46,213][123090] Updated weights for policy 1, policy_version 1397611 (0.0009) [2023-12-26 10:49:46,258][123091] Updated weights for policy 0, policy_version 1407139 (0.0010) [2023-12-26 10:49:46,281][123090] Updated weights for policy 1, policy_version 1397621 (0.0010) [2023-12-26 10:49:46,309][123091] Updated weights for policy 0, policy_version 1407149 (0.0010) [2023-12-26 10:49:46,347][123090] Updated weights for policy 1, policy_version 1397631 (0.0007) [2023-12-26 10:49:47,050][123090] Updated weights for policy 1, policy_version 1397641 (0.0010) [2023-12-26 10:49:47,050][123091] Updated weights for policy 0, policy_version 1407159 (0.0009) [2023-12-26 10:49:47,094][123091] Updated weights for policy 0, policy_version 1407169 (0.0010) [2023-12-26 10:49:47,116][123090] Updated weights for policy 1, policy_version 1397651 (0.0010) [2023-12-26 10:49:47,142][123091] Updated weights for policy 0, policy_version 1407179 (0.0010) [2023-12-26 10:49:47,178][123090] Updated weights for policy 1, policy_version 1397661 (0.0010) [2023-12-26 10:49:47,959][123091] Updated weights for policy 0, policy_version 1407189 (0.0010) [2023-12-26 10:49:48,013][123090] Updated weights for policy 1, policy_version 1397671 (0.0010) [2023-12-26 10:49:48,015][123091] Updated weights for policy 0, policy_version 1407199 (0.0010) [2023-12-26 10:49:48,070][123090] Updated weights for policy 1, policy_version 1397681 (0.0011) [2023-12-26 10:49:48,071][123091] Updated weights for policy 0, policy_version 1407209 (0.0011) [2023-12-26 10:49:48,126][123090] Updated weights for policy 1, policy_version 1397691 (0.0010) [2023-12-26 10:49:48,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 718061568. Throughput: 0: 8842.7, 1: 8882.1. Samples: 718076940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:48,785][121949] Avg episode reward: [(0, '6241.104'), (1, '4928.681')] [2023-12-26 10:49:48,845][123091] Updated weights for policy 0, policy_version 1407219 (0.0009) [2023-12-26 10:49:48,903][123091] Updated weights for policy 0, policy_version 1407229 (0.0005) [2023-12-26 10:49:48,955][123091] Updated weights for policy 0, policy_version 1407239 (0.0005) [2023-12-26 10:49:48,992][123090] Updated weights for policy 1, policy_version 1397701 (0.0011) [2023-12-26 10:49:49,048][123090] Updated weights for policy 1, policy_version 1397711 (0.0010) [2023-12-26 10:49:49,111][123090] Updated weights for policy 1, policy_version 1397721 (0.0011) [2023-12-26 10:49:49,696][123091] Updated weights for policy 0, policy_version 1407249 (0.0008) [2023-12-26 10:49:49,757][123091] Updated weights for policy 0, policy_version 1407259 (0.0009) [2023-12-26 10:49:49,812][123091] Updated weights for policy 0, policy_version 1407269 (0.0008) [2023-12-26 10:49:49,881][123091] Updated weights for policy 0, policy_version 1407279 (0.0008) [2023-12-26 10:49:49,983][123090] Updated weights for policy 1, policy_version 1397731 (0.0010) [2023-12-26 10:49:50,043][123090] Updated weights for policy 1, policy_version 1397741 (0.0009) [2023-12-26 10:49:50,100][123090] Updated weights for policy 1, policy_version 1397751 (0.0009) [2023-12-26 10:49:50,713][123091] Updated weights for policy 0, policy_version 1407289 (0.0009) [2023-12-26 10:49:50,774][123091] Updated weights for policy 0, policy_version 1407299 (0.0009) [2023-12-26 10:49:50,828][123091] Updated weights for policy 0, policy_version 1407309 (0.0009) [2023-12-26 10:49:50,947][123090] Updated weights for policy 1, policy_version 1397761 (0.0009) [2023-12-26 10:49:51,033][123090] Updated weights for policy 1, policy_version 1397771 (0.0009) [2023-12-26 10:49:51,100][123090] Updated weights for policy 1, policy_version 1397781 (0.0009) [2023-12-26 10:49:51,169][123090] Updated weights for policy 1, policy_version 1397791 (0.0009) [2023-12-26 10:49:51,747][123091] Updated weights for policy 0, policy_version 1407319 (0.0010) [2023-12-26 10:49:51,800][123091] Updated weights for policy 0, policy_version 1407329 (0.0011) [2023-12-26 10:49:51,852][123091] Updated weights for policy 0, policy_version 1407339 (0.0011) [2023-12-26 10:49:51,973][123090] Updated weights for policy 1, policy_version 1397801 (0.0009) [2023-12-26 10:49:52,026][123090] Updated weights for policy 1, policy_version 1397811 (0.0009) [2023-12-26 10:49:52,088][123090] Updated weights for policy 1, policy_version 1397821 (0.0009) [2023-12-26 10:49:52,717][123091] Updated weights for policy 0, policy_version 1407349 (0.0010) [2023-12-26 10:49:52,780][123091] Updated weights for policy 0, policy_version 1407359 (0.0011) [2023-12-26 10:49:52,836][123091] Updated weights for policy 0, policy_version 1407369 (0.0010) [2023-12-26 10:49:52,944][123090] Updated weights for policy 1, policy_version 1397831 (0.0010) [2023-12-26 10:49:53,003][123090] Updated weights for policy 1, policy_version 1397841 (0.0009) [2023-12-26 10:49:53,067][123090] Updated weights for policy 1, policy_version 1397851 (0.0010) [2023-12-26 10:49:53,461][123091] Updated weights for policy 0, policy_version 1407379 (0.0006) [2023-12-26 10:49:53,535][123091] Updated weights for policy 0, policy_version 1407389 (0.0005) [2023-12-26 10:49:53,588][123091] Updated weights for policy 0, policy_version 1407399 (0.0008) [2023-12-26 10:49:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 718151680. Throughput: 0: 8837.2, 1: 8809.3. Samples: 718127384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:53,785][121949] Avg episode reward: [(0, '6286.712'), (1, '5129.705')] [2023-12-26 10:49:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001407408_360300544.pth... [2023-12-26 10:49:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001397856_357851136.pth... [2023-12-26 10:49:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001396832_357588992.pth [2023-12-26 10:49:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001406352_360030208.pth [2023-12-26 10:49:53,949][123090] Updated weights for policy 1, policy_version 1397861 (0.0009) [2023-12-26 10:49:54,005][123090] Updated weights for policy 1, policy_version 1397871 (0.0008) [2023-12-26 10:49:54,057][123090] Updated weights for policy 1, policy_version 1397881 (0.0009) [2023-12-26 10:49:54,347][123091] Updated weights for policy 0, policy_version 1407409 (0.0009) [2023-12-26 10:49:54,406][123091] Updated weights for policy 0, policy_version 1407419 (0.0009) [2023-12-26 10:49:54,459][123091] Updated weights for policy 0, policy_version 1407429 (0.0010) [2023-12-26 10:49:54,513][123091] Updated weights for policy 0, policy_version 1407440 (0.0010) [2023-12-26 10:49:54,825][123090] Updated weights for policy 1, policy_version 1397891 (0.0008) [2023-12-26 10:49:54,884][123090] Updated weights for policy 1, policy_version 1397901 (0.0006) [2023-12-26 10:49:54,945][123090] Updated weights for policy 1, policy_version 1397911 (0.0006) [2023-12-26 10:49:55,249][123091] Updated weights for policy 0, policy_version 1407450 (0.0009) [2023-12-26 10:49:55,303][123091] Updated weights for policy 0, policy_version 1407460 (0.0009) [2023-12-26 10:49:55,350][123091] Updated weights for policy 0, policy_version 1407470 (0.0005) [2023-12-26 10:49:55,758][123090] Updated weights for policy 1, policy_version 1397921 (0.0009) [2023-12-26 10:49:55,823][123090] Updated weights for policy 1, policy_version 1397931 (0.0010) [2023-12-26 10:49:55,883][123090] Updated weights for policy 1, policy_version 1397941 (0.0010) [2023-12-26 10:49:55,948][123090] Updated weights for policy 1, policy_version 1397951 (0.0010) [2023-12-26 10:49:56,071][123091] Updated weights for policy 0, policy_version 1407480 (0.0005) [2023-12-26 10:49:56,131][123091] Updated weights for policy 0, policy_version 1407490 (0.0005) [2023-12-26 10:49:56,198][123091] Updated weights for policy 0, policy_version 1407500 (0.0005) [2023-12-26 10:49:56,753][123090] Updated weights for policy 1, policy_version 1397961 (0.0010) [2023-12-26 10:49:56,802][123090] Updated weights for policy 1, policy_version 1397971 (0.0010) [2023-12-26 10:49:56,832][123091] Updated weights for policy 0, policy_version 1407510 (0.0005) [2023-12-26 10:49:56,858][123090] Updated weights for policy 1, policy_version 1397981 (0.0010) [2023-12-26 10:49:56,882][123091] Updated weights for policy 0, policy_version 1407520 (0.0010) [2023-12-26 10:49:56,933][123091] Updated weights for policy 0, policy_version 1407530 (0.0010) [2023-12-26 10:49:57,599][123091] Updated weights for policy 0, policy_version 1407540 (0.0008) [2023-12-26 10:49:57,665][123091] Updated weights for policy 0, policy_version 1407550 (0.0005) [2023-12-26 10:49:57,703][123090] Updated weights for policy 1, policy_version 1397991 (0.0010) [2023-12-26 10:49:57,729][123091] Updated weights for policy 0, policy_version 1407560 (0.0006) [2023-12-26 10:49:57,762][123090] Updated weights for policy 1, policy_version 1398001 (0.0010) [2023-12-26 10:49:57,827][123090] Updated weights for policy 1, policy_version 1398011 (0.0010) [2023-12-26 10:49:58,478][123091] Updated weights for policy 0, policy_version 1407570 (0.0007) [2023-12-26 10:49:58,533][123091] Updated weights for policy 0, policy_version 1407580 (0.0008) [2023-12-26 10:49:58,600][123091] Updated weights for policy 0, policy_version 1407590 (0.0008) [2023-12-26 10:49:58,658][123090] Updated weights for policy 1, policy_version 1398021 (0.0010) [2023-12-26 10:49:58,663][123091] Updated weights for policy 0, policy_version 1407600 (0.0008) [2023-12-26 10:49:58,731][123090] Updated weights for policy 1, policy_version 1398031 (0.0009) [2023-12-26 10:49:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 718241792. Throughput: 0: 8984.3, 1: 8821.6. Samples: 718236980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:49:58,785][121949] Avg episode reward: [(0, '6220.770'), (1, '5498.000')] [2023-12-26 10:49:58,810][123090] Updated weights for policy 1, policy_version 1398041 (0.0009) [2023-12-26 10:49:59,571][123091] Updated weights for policy 0, policy_version 1407610 (0.0007) [2023-12-26 10:49:59,630][123091] Updated weights for policy 0, policy_version 1407620 (0.0007) [2023-12-26 10:49:59,690][123090] Updated weights for policy 1, policy_version 1398051 (0.0008) [2023-12-26 10:49:59,703][123091] Updated weights for policy 0, policy_version 1407630 (0.0010) [2023-12-26 10:49:59,760][123090] Updated weights for policy 1, policy_version 1398061 (0.0007) [2023-12-26 10:49:59,833][123090] Updated weights for policy 1, policy_version 1398071 (0.0009) [2023-12-26 10:50:00,508][123091] Updated weights for policy 0, policy_version 1407640 (0.0011) [2023-12-26 10:50:00,577][123091] Updated weights for policy 0, policy_version 1407650 (0.0010) [2023-12-26 10:50:00,621][123090] Updated weights for policy 1, policy_version 1398081 (0.0009) [2023-12-26 10:50:00,626][123091] Updated weights for policy 0, policy_version 1407660 (0.0010) [2023-12-26 10:50:00,670][123090] Updated weights for policy 1, policy_version 1398091 (0.0005) [2023-12-26 10:50:00,725][123090] Updated weights for policy 1, policy_version 1398101 (0.0006) [2023-12-26 10:50:00,790][123090] Updated weights for policy 1, policy_version 1398111 (0.0007) [2023-12-26 10:50:01,453][123091] Updated weights for policy 0, policy_version 1407670 (0.0009) [2023-12-26 10:50:01,488][123090] Updated weights for policy 1, policy_version 1398121 (0.0008) [2023-12-26 10:50:01,505][123091] Updated weights for policy 0, policy_version 1407680 (0.0008) [2023-12-26 10:50:01,538][123090] Updated weights for policy 1, policy_version 1398131 (0.0007) [2023-12-26 10:50:01,568][123091] Updated weights for policy 0, policy_version 1407690 (0.0007) [2023-12-26 10:50:01,592][123090] Updated weights for policy 1, policy_version 1398141 (0.0005) [2023-12-26 10:50:02,375][123091] Updated weights for policy 0, policy_version 1407700 (0.0009) [2023-12-26 10:50:02,400][123090] Updated weights for policy 1, policy_version 1398151 (0.0008) [2023-12-26 10:50:02,435][123091] Updated weights for policy 0, policy_version 1407710 (0.0010) [2023-12-26 10:50:02,459][123090] Updated weights for policy 1, policy_version 1398161 (0.0005) [2023-12-26 10:50:02,493][123091] Updated weights for policy 0, policy_version 1407720 (0.0010) [2023-12-26 10:50:02,510][123090] Updated weights for policy 1, policy_version 1398171 (0.0008) [2023-12-26 10:50:03,246][123090] Updated weights for policy 1, policy_version 1398181 (0.0008) [2023-12-26 10:50:03,253][123091] Updated weights for policy 0, policy_version 1407730 (0.0010) [2023-12-26 10:50:03,312][123090] Updated weights for policy 1, policy_version 1398191 (0.0005) [2023-12-26 10:50:03,321][123091] Updated weights for policy 0, policy_version 1407740 (0.0005) [2023-12-26 10:50:03,368][123090] Updated weights for policy 1, policy_version 1398201 (0.0005) [2023-12-26 10:50:03,382][123091] Updated weights for policy 0, policy_version 1407750 (0.0010) [2023-12-26 10:50:03,437][123091] Updated weights for policy 0, policy_version 1407760 (0.0010) [2023-12-26 10:50:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 718331904. Throughput: 0: 8889.3, 1: 8808.2. Samples: 718342180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:03,785][121949] Avg episode reward: [(0, '6212.028'), (1, '5823.756')] [2023-12-26 10:50:04,022][123090] Updated weights for policy 1, policy_version 1398211 (0.0006) [2023-12-26 10:50:04,086][123090] Updated weights for policy 1, policy_version 1398221 (0.0010) [2023-12-26 10:50:04,134][123091] Updated weights for policy 0, policy_version 1407770 (0.0011) [2023-12-26 10:50:04,146][123090] Updated weights for policy 1, policy_version 1398231 (0.0010) [2023-12-26 10:50:04,198][123091] Updated weights for policy 0, policy_version 1407780 (0.0011) [2023-12-26 10:50:04,254][123091] Updated weights for policy 0, policy_version 1407790 (0.0011) [2023-12-26 10:50:04,955][123090] Updated weights for policy 1, policy_version 1398241 (0.0009) [2023-12-26 10:50:05,019][123090] Updated weights for policy 1, policy_version 1398251 (0.0009) [2023-12-26 10:50:05,048][123091] Updated weights for policy 0, policy_version 1407800 (0.0011) [2023-12-26 10:50:05,076][123090] Updated weights for policy 1, policy_version 1398261 (0.0005) [2023-12-26 10:50:05,103][123091] Updated weights for policy 0, policy_version 1407810 (0.0010) [2023-12-26 10:50:05,139][123090] Updated weights for policy 1, policy_version 1398271 (0.0006) [2023-12-26 10:50:05,158][123091] Updated weights for policy 0, policy_version 1407820 (0.0010) [2023-12-26 10:50:05,819][123090] Updated weights for policy 1, policy_version 1398281 (0.0009) [2023-12-26 10:50:05,867][123090] Updated weights for policy 1, policy_version 1398291 (0.0005) [2023-12-26 10:50:05,885][123091] Updated weights for policy 0, policy_version 1407830 (0.0007) [2023-12-26 10:50:05,914][123090] Updated weights for policy 1, policy_version 1398301 (0.0005) [2023-12-26 10:50:05,951][123091] Updated weights for policy 0, policy_version 1407840 (0.0010) [2023-12-26 10:50:06,016][123091] Updated weights for policy 0, policy_version 1407850 (0.0010) [2023-12-26 10:50:06,678][123090] Updated weights for policy 1, policy_version 1398311 (0.0008) [2023-12-26 10:50:06,736][123090] Updated weights for policy 1, policy_version 1398321 (0.0009) [2023-12-26 10:50:06,790][123090] Updated weights for policy 1, policy_version 1398331 (0.0009) [2023-12-26 10:50:06,841][123091] Updated weights for policy 0, policy_version 1407860 (0.0010) [2023-12-26 10:50:06,908][123091] Updated weights for policy 0, policy_version 1407870 (0.0011) [2023-12-26 10:50:06,976][123091] Updated weights for policy 0, policy_version 1407880 (0.0011) [2023-12-26 10:50:07,552][123090] Updated weights for policy 1, policy_version 1398341 (0.0007) [2023-12-26 10:50:07,609][123090] Updated weights for policy 1, policy_version 1398351 (0.0005) [2023-12-26 10:50:07,660][123090] Updated weights for policy 1, policy_version 1398361 (0.0005) [2023-12-26 10:50:07,784][123091] Updated weights for policy 0, policy_version 1407890 (0.0011) [2023-12-26 10:50:07,842][123091] Updated weights for policy 0, policy_version 1407900 (0.0010) [2023-12-26 10:50:07,893][123091] Updated weights for policy 0, policy_version 1407910 (0.0010) [2023-12-26 10:50:07,944][123091] Updated weights for policy 0, policy_version 1407920 (0.0010) [2023-12-26 10:50:08,353][123090] Updated weights for policy 1, policy_version 1398371 (0.0007) [2023-12-26 10:50:08,413][123090] Updated weights for policy 1, policy_version 1398381 (0.0008) [2023-12-26 10:50:08,479][123090] Updated weights for policy 1, policy_version 1398391 (0.0009) [2023-12-26 10:50:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 718422016. Throughput: 0: 8928.3, 1: 8865.4. Samples: 718397916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:08,785][121949] Avg episode reward: [(0, '6301.143'), (1, '5625.918')] [2023-12-26 10:50:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001398400_357990400.pth... [2023-12-26 10:50:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001397376_357728256.pth [2023-12-26 10:50:08,813][123091] Updated weights for policy 0, policy_version 1407930 (0.0011) [2023-12-26 10:50:08,875][123091] Updated weights for policy 0, policy_version 1407940 (0.0010) [2023-12-26 10:50:08,931][123091] Updated weights for policy 0, policy_version 1407950 (0.0005) [2023-12-26 10:50:08,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001407952_360439808.pth... [2023-12-26 10:50:08,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001406896_360169472.pth [2023-12-26 10:50:09,241][123090] Updated weights for policy 1, policy_version 1398401 (0.0009) [2023-12-26 10:50:09,306][123090] Updated weights for policy 1, policy_version 1398411 (0.0007) [2023-12-26 10:50:09,376][123090] Updated weights for policy 1, policy_version 1398421 (0.0008) [2023-12-26 10:50:09,450][123090] Updated weights for policy 1, policy_version 1398431 (0.0007) [2023-12-26 10:50:09,752][123091] Updated weights for policy 0, policy_version 1407960 (0.0010) [2023-12-26 10:50:09,805][123091] Updated weights for policy 0, policy_version 1407970 (0.0011) [2023-12-26 10:50:09,871][123091] Updated weights for policy 0, policy_version 1407981 (0.0008) [2023-12-26 10:50:10,279][123090] Updated weights for policy 1, policy_version 1398441 (0.0010) [2023-12-26 10:50:10,332][123090] Updated weights for policy 1, policy_version 1398451 (0.0011) [2023-12-26 10:50:10,399][123090] Updated weights for policy 1, policy_version 1398461 (0.0011) [2023-12-26 10:50:10,696][123091] Updated weights for policy 0, policy_version 1407991 (0.0008) [2023-12-26 10:50:10,756][123091] Updated weights for policy 0, policy_version 1408001 (0.0009) [2023-12-26 10:50:10,820][123091] Updated weights for policy 0, policy_version 1408011 (0.0009) [2023-12-26 10:50:11,253][123090] Updated weights for policy 1, policy_version 1398471 (0.0011) [2023-12-26 10:50:11,323][123090] Updated weights for policy 1, policy_version 1398481 (0.0011) [2023-12-26 10:50:11,402][123090] Updated weights for policy 1, policy_version 1398491 (0.0011) [2023-12-26 10:50:11,709][123091] Updated weights for policy 0, policy_version 1408021 (0.0009) [2023-12-26 10:50:11,782][123091] Updated weights for policy 0, policy_version 1408031 (0.0008) [2023-12-26 10:50:11,856][123091] Updated weights for policy 0, policy_version 1408041 (0.0008) [2023-12-26 10:50:12,142][123090] Updated weights for policy 1, policy_version 1398501 (0.0008) [2023-12-26 10:50:12,205][123090] Updated weights for policy 1, policy_version 1398511 (0.0005) [2023-12-26 10:50:12,276][123090] Updated weights for policy 1, policy_version 1398521 (0.0006) [2023-12-26 10:50:12,632][123091] Updated weights for policy 0, policy_version 1408051 (0.0009) [2023-12-26 10:50:12,685][123091] Updated weights for policy 0, policy_version 1408061 (0.0010) [2023-12-26 10:50:12,735][123091] Updated weights for policy 0, policy_version 1408071 (0.0010) [2023-12-26 10:50:13,036][123090] Updated weights for policy 1, policy_version 1398531 (0.0008) [2023-12-26 10:50:13,103][123090] Updated weights for policy 1, policy_version 1398541 (0.0010) [2023-12-26 10:50:13,158][123090] Updated weights for policy 1, policy_version 1398551 (0.0010) [2023-12-26 10:50:13,604][123091] Updated weights for policy 0, policy_version 1408081 (0.0010) [2023-12-26 10:50:13,659][123091] Updated weights for policy 0, policy_version 1408091 (0.0009) [2023-12-26 10:50:13,723][123091] Updated weights for policy 0, policy_version 1408101 (0.0009) [2023-12-26 10:50:13,779][123091] Updated weights for policy 0, policy_version 1408111 (0.0009) [2023-12-26 10:50:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 718503936. Throughput: 0: 8877.5, 1: 8922.3. Samples: 718503340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:13,786][121949] Avg episode reward: [(0, '6363.046'), (1, '5683.560')] [2023-12-26 10:50:13,977][123090] Updated weights for policy 1, policy_version 1398561 (0.0010) [2023-12-26 10:50:14,043][123090] Updated weights for policy 1, policy_version 1398571 (0.0010) [2023-12-26 10:50:14,109][123090] Updated weights for policy 1, policy_version 1398581 (0.0010) [2023-12-26 10:50:14,175][123090] Updated weights for policy 1, policy_version 1398591 (0.0010) [2023-12-26 10:50:14,607][123091] Updated weights for policy 0, policy_version 1408121 (0.0010) [2023-12-26 10:50:14,658][123091] Updated weights for policy 0, policy_version 1408131 (0.0009) [2023-12-26 10:50:14,705][123091] Updated weights for policy 0, policy_version 1408142 (0.0009) [2023-12-26 10:50:14,971][123090] Updated weights for policy 1, policy_version 1398601 (0.0009) [2023-12-26 10:50:15,034][123090] Updated weights for policy 1, policy_version 1398611 (0.0008) [2023-12-26 10:50:15,087][123090] Updated weights for policy 1, policy_version 1398621 (0.0009) [2023-12-26 10:50:15,627][123091] Updated weights for policy 0, policy_version 1408152 (0.0009) [2023-12-26 10:50:15,694][123091] Updated weights for policy 0, policy_version 1408162 (0.0010) [2023-12-26 10:50:15,757][123091] Updated weights for policy 0, policy_version 1408172 (0.0009) [2023-12-26 10:50:15,875][123090] Updated weights for policy 1, policy_version 1398631 (0.0010) [2023-12-26 10:50:15,929][123090] Updated weights for policy 1, policy_version 1398641 (0.0008) [2023-12-26 10:50:15,982][123090] Updated weights for policy 1, policy_version 1398651 (0.0009) [2023-12-26 10:50:16,651][123091] Updated weights for policy 0, policy_version 1408182 (0.0009) [2023-12-26 10:50:16,701][123090] Updated weights for policy 1, policy_version 1398661 (0.0008) [2023-12-26 10:50:16,701][123091] Updated weights for policy 0, policy_version 1408192 (0.0009) [2023-12-26 10:50:16,750][123090] Updated weights for policy 1, policy_version 1398671 (0.0005) [2023-12-26 10:50:16,759][123091] Updated weights for policy 0, policy_version 1408202 (0.0008) [2023-12-26 10:50:16,800][123090] Updated weights for policy 1, policy_version 1398681 (0.0005) [2023-12-26 10:50:17,492][123090] Updated weights for policy 1, policy_version 1398691 (0.0005) [2023-12-26 10:50:17,517][123091] Updated weights for policy 0, policy_version 1408212 (0.0008) [2023-12-26 10:50:17,541][123090] Updated weights for policy 1, policy_version 1398701 (0.0005) [2023-12-26 10:50:17,565][123091] Updated weights for policy 0, policy_version 1408222 (0.0006) [2023-12-26 10:50:17,594][123090] Updated weights for policy 1, policy_version 1398711 (0.0005) [2023-12-26 10:50:17,614][123091] Updated weights for policy 0, policy_version 1408233 (0.0008) [2023-12-26 10:50:18,338][123090] Updated weights for policy 1, policy_version 1398721 (0.0006) [2023-12-26 10:50:18,410][123090] Updated weights for policy 1, policy_version 1398731 (0.0011) [2023-12-26 10:50:18,478][123090] Updated weights for policy 1, policy_version 1398741 (0.0011) [2023-12-26 10:50:18,501][123091] Updated weights for policy 0, policy_version 1408243 (0.0009) [2023-12-26 10:50:18,541][123090] Updated weights for policy 1, policy_version 1398751 (0.0010) [2023-12-26 10:50:18,558][123091] Updated weights for policy 0, policy_version 1408253 (0.0007) [2023-12-26 10:50:18,619][123091] Updated weights for policy 0, policy_version 1408263 (0.0009) [2023-12-26 10:50:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 718602240. Throughput: 0: 8798.1, 1: 8911.6. Samples: 718609400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:18,785][121949] Avg episode reward: [(0, '6436.617'), (1, '5713.772')] [2023-12-26 10:50:19,357][123090] Updated weights for policy 1, policy_version 1398761 (0.0011) [2023-12-26 10:50:19,427][123090] Updated weights for policy 1, policy_version 1398771 (0.0010) [2023-12-26 10:50:19,462][123091] Updated weights for policy 0, policy_version 1408273 (0.0009) [2023-12-26 10:50:19,487][123090] Updated weights for policy 1, policy_version 1398781 (0.0010) [2023-12-26 10:50:19,524][123091] Updated weights for policy 0, policy_version 1408283 (0.0009) [2023-12-26 10:50:19,578][123091] Updated weights for policy 0, policy_version 1408293 (0.0011) [2023-12-26 10:50:19,645][123091] Updated weights for policy 0, policy_version 1408303 (0.0009) [2023-12-26 10:50:20,318][123090] Updated weights for policy 1, policy_version 1398791 (0.0007) [2023-12-26 10:50:20,393][123090] Updated weights for policy 1, policy_version 1398801 (0.0007) [2023-12-26 10:50:20,457][123090] Updated weights for policy 1, policy_version 1398811 (0.0010) [2023-12-26 10:50:20,526][123091] Updated weights for policy 0, policy_version 1408313 (0.0006) [2023-12-26 10:50:20,590][123091] Updated weights for policy 0, policy_version 1408323 (0.0008) [2023-12-26 10:50:20,652][123091] Updated weights for policy 0, policy_version 1408333 (0.0005) [2023-12-26 10:50:21,307][123090] Updated weights for policy 1, policy_version 1398821 (0.0011) [2023-12-26 10:50:21,376][123090] Updated weights for policy 1, policy_version 1398831 (0.0012) [2023-12-26 10:50:21,444][123090] Updated weights for policy 1, policy_version 1398841 (0.0009) [2023-12-26 10:50:21,461][123091] Updated weights for policy 0, policy_version 1408343 (0.0006) [2023-12-26 10:50:21,530][123091] Updated weights for policy 0, policy_version 1408353 (0.0007) [2023-12-26 10:50:21,603][123091] Updated weights for policy 0, policy_version 1408363 (0.0007) [2023-12-26 10:50:22,269][123090] Updated weights for policy 1, policy_version 1398851 (0.0011) [2023-12-26 10:50:22,328][123090] Updated weights for policy 1, policy_version 1398861 (0.0009) [2023-12-26 10:50:22,398][123091] Updated weights for policy 0, policy_version 1408373 (0.0009) [2023-12-26 10:50:22,397][123090] Updated weights for policy 1, policy_version 1398871 (0.0009) [2023-12-26 10:50:22,458][123091] Updated weights for policy 0, policy_version 1408383 (0.0009) [2023-12-26 10:50:22,523][123091] Updated weights for policy 0, policy_version 1408393 (0.0009) [2023-12-26 10:50:23,223][123090] Updated weights for policy 1, policy_version 1398881 (0.0009) [2023-12-26 10:50:23,291][123090] Updated weights for policy 1, policy_version 1398891 (0.0009) [2023-12-26 10:50:23,303][123091] Updated weights for policy 0, policy_version 1408403 (0.0009) [2023-12-26 10:50:23,354][123091] Updated weights for policy 0, policy_version 1408413 (0.0009) [2023-12-26 10:50:23,359][123090] Updated weights for policy 1, policy_version 1398901 (0.0007) [2023-12-26 10:50:23,416][123091] Updated weights for policy 0, policy_version 1408423 (0.0007) [2023-12-26 10:50:23,427][123090] Updated weights for policy 1, policy_version 1398911 (0.0010) [2023-12-26 10:50:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 718684160. Throughput: 0: 8760.9, 1: 8820.4. Samples: 718659620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:23,785][121949] Avg episode reward: [(0, '6402.027'), (1, '5699.705')] [2023-12-26 10:50:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001398912_358121472.pth... [2023-12-26 10:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001408432_360562688.pth... [2023-12-26 10:50:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001397856_357851136.pth [2023-12-26 10:50:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001407408_360300544.pth [2023-12-26 10:50:24,118][123090] Updated weights for policy 1, policy_version 1398921 (0.0009) [2023-12-26 10:50:24,192][123090] Updated weights for policy 1, policy_version 1398931 (0.0009) [2023-12-26 10:50:24,231][123091] Updated weights for policy 0, policy_version 1408433 (0.0009) [2023-12-26 10:50:24,259][123090] Updated weights for policy 1, policy_version 1398941 (0.0009) [2023-12-26 10:50:24,293][123091] Updated weights for policy 0, policy_version 1408443 (0.0007) [2023-12-26 10:50:24,349][123091] Updated weights for policy 0, policy_version 1408453 (0.0005) [2023-12-26 10:50:24,396][123091] Updated weights for policy 0, policy_version 1408463 (0.0005) [2023-12-26 10:50:25,004][123090] Updated weights for policy 1, policy_version 1398951 (0.0007) [2023-12-26 10:50:25,068][123090] Updated weights for policy 1, policy_version 1398961 (0.0005) [2023-12-26 10:50:25,115][123091] Updated weights for policy 0, policy_version 1408473 (0.0007) [2023-12-26 10:50:25,137][123090] Updated weights for policy 1, policy_version 1398971 (0.0008) [2023-12-26 10:50:25,175][123091] Updated weights for policy 0, policy_version 1408483 (0.0007) [2023-12-26 10:50:25,227][123091] Updated weights for policy 0, policy_version 1408493 (0.0006) [2023-12-26 10:50:25,809][123090] Updated weights for policy 1, policy_version 1398981 (0.0007) [2023-12-26 10:50:25,855][123090] Updated weights for policy 1, policy_version 1398991 (0.0005) [2023-12-26 10:50:25,907][123090] Updated weights for policy 1, policy_version 1399001 (0.0005) [2023-12-26 10:50:26,003][123091] Updated weights for policy 0, policy_version 1408503 (0.0010) [2023-12-26 10:50:26,070][123091] Updated weights for policy 0, policy_version 1408513 (0.0010) [2023-12-26 10:50:26,136][123091] Updated weights for policy 0, policy_version 1408523 (0.0010) [2023-12-26 10:50:26,595][123090] Updated weights for policy 1, policy_version 1399011 (0.0005) [2023-12-26 10:50:26,650][123090] Updated weights for policy 1, policy_version 1399021 (0.0005) [2023-12-26 10:50:26,696][123090] Updated weights for policy 1, policy_version 1399031 (0.0005) [2023-12-26 10:50:26,983][123091] Updated weights for policy 0, policy_version 1408533 (0.0010) [2023-12-26 10:50:27,035][123091] Updated weights for policy 0, policy_version 1408543 (0.0010) [2023-12-26 10:50:27,085][123091] Updated weights for policy 0, policy_version 1408553 (0.0010) [2023-12-26 10:50:27,316][123090] Updated weights for policy 1, policy_version 1399041 (0.0007) [2023-12-26 10:50:27,385][123090] Updated weights for policy 1, policy_version 1399051 (0.0006) [2023-12-26 10:50:27,439][123090] Updated weights for policy 1, policy_version 1399061 (0.0005) [2023-12-26 10:50:27,498][123090] Updated weights for policy 1, policy_version 1399071 (0.0005) [2023-12-26 10:50:27,890][123091] Updated weights for policy 0, policy_version 1408563 (0.0010) [2023-12-26 10:50:27,958][123091] Updated weights for policy 0, policy_version 1408573 (0.0010) [2023-12-26 10:50:28,016][123091] Updated weights for policy 0, policy_version 1408583 (0.0010) [2023-12-26 10:50:28,184][123090] Updated weights for policy 1, policy_version 1399081 (0.0009) [2023-12-26 10:50:28,239][123090] Updated weights for policy 1, policy_version 1399091 (0.0008) [2023-12-26 10:50:28,305][123090] Updated weights for policy 1, policy_version 1399101 (0.0009) [2023-12-26 10:50:28,742][123091] Updated weights for policy 0, policy_version 1408593 (0.0010) [2023-12-26 10:50:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 718774272. Throughput: 0: 8832.7, 1: 8911.8. Samples: 718769904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:28,785][121949] Avg episode reward: [(0, '6371.072'), (1, '5668.893')] [2023-12-26 10:50:28,807][123091] Updated weights for policy 0, policy_version 1408603 (0.0006) [2023-12-26 10:50:28,868][123091] Updated weights for policy 0, policy_version 1408613 (0.0006) [2023-12-26 10:50:28,933][123091] Updated weights for policy 0, policy_version 1408623 (0.0006) [2023-12-26 10:50:29,216][123090] Updated weights for policy 1, policy_version 1399111 (0.0007) [2023-12-26 10:50:29,284][123090] Updated weights for policy 1, policy_version 1399121 (0.0009) [2023-12-26 10:50:29,341][123090] Updated weights for policy 1, policy_version 1399131 (0.0008) [2023-12-26 10:50:29,615][123091] Updated weights for policy 0, policy_version 1408633 (0.0006) [2023-12-26 10:50:29,681][123091] Updated weights for policy 0, policy_version 1408643 (0.0005) [2023-12-26 10:50:29,729][123091] Updated weights for policy 0, policy_version 1408653 (0.0005) [2023-12-26 10:50:30,202][123090] Updated weights for policy 1, policy_version 1399141 (0.0009) [2023-12-26 10:50:30,262][123090] Updated weights for policy 1, policy_version 1399151 (0.0010) [2023-12-26 10:50:30,324][123090] Updated weights for policy 1, policy_version 1399161 (0.0009) [2023-12-26 10:50:30,338][123091] Updated weights for policy 0, policy_version 1408663 (0.0005) [2023-12-26 10:50:30,395][123091] Updated weights for policy 0, policy_version 1408673 (0.0009) [2023-12-26 10:50:30,447][123091] Updated weights for policy 0, policy_version 1408683 (0.0010) [2023-12-26 10:50:31,193][123091] Updated weights for policy 0, policy_version 1408693 (0.0008) [2023-12-26 10:50:31,195][123090] Updated weights for policy 1, policy_version 1399171 (0.0008) [2023-12-26 10:50:31,258][123091] Updated weights for policy 0, policy_version 1408703 (0.0009) [2023-12-26 10:50:31,262][123090] Updated weights for policy 1, policy_version 1399181 (0.0008) [2023-12-26 10:50:31,312][123091] Updated weights for policy 0, policy_version 1408713 (0.0007) [2023-12-26 10:50:31,319][123090] Updated weights for policy 1, policy_version 1399191 (0.0009) [2023-12-26 10:50:32,145][123090] Updated weights for policy 1, policy_version 1399201 (0.0008) [2023-12-26 10:50:32,175][123091] Updated weights for policy 0, policy_version 1408723 (0.0009) [2023-12-26 10:50:32,207][123090] Updated weights for policy 1, policy_version 1399211 (0.0009) [2023-12-26 10:50:32,226][123091] Updated weights for policy 0, policy_version 1408733 (0.0009) [2023-12-26 10:50:32,263][123090] Updated weights for policy 1, policy_version 1399221 (0.0008) [2023-12-26 10:50:32,283][123091] Updated weights for policy 0, policy_version 1408743 (0.0009) [2023-12-26 10:50:32,325][123090] Updated weights for policy 1, policy_version 1399231 (0.0009) [2023-12-26 10:50:33,101][123091] Updated weights for policy 0, policy_version 1408753 (0.0006) [2023-12-26 10:50:33,134][123090] Updated weights for policy 1, policy_version 1399241 (0.0008) [2023-12-26 10:50:33,167][123091] Updated weights for policy 0, policy_version 1408763 (0.0008) [2023-12-26 10:50:33,198][123090] Updated weights for policy 1, policy_version 1399251 (0.0010) [2023-12-26 10:50:33,228][123091] Updated weights for policy 0, policy_version 1408773 (0.0008) [2023-12-26 10:50:33,248][123090] Updated weights for policy 1, policy_version 1399261 (0.0008) [2023-12-26 10:50:33,287][123091] Updated weights for policy 0, policy_version 1408783 (0.0008) [2023-12-26 10:50:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 718864384. Throughput: 0: 8866.5, 1: 8886.0. Samples: 718875804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:33,785][121949] Avg episode reward: [(0, '6335.384'), (1, '5715.721')] [2023-12-26 10:50:34,095][123091] Updated weights for policy 0, policy_version 1408793 (0.0008) [2023-12-26 10:50:34,097][123090] Updated weights for policy 1, policy_version 1399271 (0.0007) [2023-12-26 10:50:34,155][123091] Updated weights for policy 0, policy_version 1408803 (0.0008) [2023-12-26 10:50:34,165][123090] Updated weights for policy 1, policy_version 1399281 (0.0009) [2023-12-26 10:50:34,216][123091] Updated weights for policy 0, policy_version 1408813 (0.0007) [2023-12-26 10:50:34,231][123090] Updated weights for policy 1, policy_version 1399291 (0.0009) [2023-12-26 10:50:35,031][123091] Updated weights for policy 0, policy_version 1408823 (0.0009) [2023-12-26 10:50:35,047][123090] Updated weights for policy 1, policy_version 1399301 (0.0008) [2023-12-26 10:50:35,089][123091] Updated weights for policy 0, policy_version 1408833 (0.0008) [2023-12-26 10:50:35,115][123090] Updated weights for policy 1, policy_version 1399311 (0.0010) [2023-12-26 10:50:35,140][123091] Updated weights for policy 0, policy_version 1408843 (0.0006) [2023-12-26 10:50:35,176][123090] Updated weights for policy 1, policy_version 1399321 (0.0009) [2023-12-26 10:50:35,822][123091] Updated weights for policy 0, policy_version 1408853 (0.0008) [2023-12-26 10:50:35,832][123090] Updated weights for policy 1, policy_version 1399331 (0.0009) [2023-12-26 10:50:35,878][123091] Updated weights for policy 0, policy_version 1408863 (0.0006) [2023-12-26 10:50:35,893][123090] Updated weights for policy 1, policy_version 1399341 (0.0005) [2023-12-26 10:50:35,947][123091] Updated weights for policy 0, policy_version 1408873 (0.0005) [2023-12-26 10:50:35,952][123090] Updated weights for policy 1, policy_version 1399351 (0.0005) [2023-12-26 10:50:36,690][123090] Updated weights for policy 1, policy_version 1399361 (0.0006) [2023-12-26 10:50:36,756][123091] Updated weights for policy 0, policy_version 1408883 (0.0006) [2023-12-26 10:50:36,768][123090] Updated weights for policy 1, policy_version 1399371 (0.0006) [2023-12-26 10:50:36,824][123091] Updated weights for policy 0, policy_version 1408893 (0.0008) [2023-12-26 10:50:36,830][123090] Updated weights for policy 1, policy_version 1399381 (0.0009) [2023-12-26 10:50:36,890][123091] Updated weights for policy 0, policy_version 1408903 (0.0008) [2023-12-26 10:50:36,894][123090] Updated weights for policy 1, policy_version 1399391 (0.0009) [2023-12-26 10:50:37,606][123090] Updated weights for policy 1, policy_version 1399401 (0.0006) [2023-12-26 10:50:37,679][123090] Updated weights for policy 1, policy_version 1399411 (0.0006) [2023-12-26 10:50:37,726][123091] Updated weights for policy 0, policy_version 1408913 (0.0010) [2023-12-26 10:50:37,742][123090] Updated weights for policy 1, policy_version 1399421 (0.0006) [2023-12-26 10:50:37,779][123091] Updated weights for policy 0, policy_version 1408923 (0.0011) [2023-12-26 10:50:37,843][123091] Updated weights for policy 0, policy_version 1408933 (0.0011) [2023-12-26 10:50:37,905][123091] Updated weights for policy 0, policy_version 1408943 (0.0011) [2023-12-26 10:50:38,452][123090] Updated weights for policy 1, policy_version 1399431 (0.0006) [2023-12-26 10:50:38,499][123090] Updated weights for policy 1, policy_version 1399441 (0.0005) [2023-12-26 10:50:38,561][123090] Updated weights for policy 1, policy_version 1399451 (0.0006) [2023-12-26 10:50:38,724][123091] Updated weights for policy 0, policy_version 1408953 (0.0010) [2023-12-26 10:50:38,768][123091] Updated weights for policy 0, policy_version 1408963 (0.0010) [2023-12-26 10:50:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 718954496. Throughput: 0: 8900.6, 1: 8954.8. Samples: 718930872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:38,785][121949] Avg episode reward: [(0, '6323.289'), (1, '5687.268')] [2023-12-26 10:50:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001399456_358260736.pth... [2023-12-26 10:50:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001398400_357990400.pth [2023-12-26 10:50:38,824][123091] Updated weights for policy 0, policy_version 1408973 (0.0011) [2023-12-26 10:50:38,837][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001408976_360701952.pth... [2023-12-26 10:50:38,840][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001407952_360439808.pth [2023-12-26 10:50:39,369][123090] Updated weights for policy 1, policy_version 1399461 (0.0009) [2023-12-26 10:50:39,442][123090] Updated weights for policy 1, policy_version 1399471 (0.0008) [2023-12-26 10:50:39,514][123090] Updated weights for policy 1, policy_version 1399481 (0.0007) [2023-12-26 10:50:39,646][123091] Updated weights for policy 0, policy_version 1408983 (0.0007) [2023-12-26 10:50:39,696][123091] Updated weights for policy 0, policy_version 1408993 (0.0006) [2023-12-26 10:50:39,754][123091] Updated weights for policy 0, policy_version 1409003 (0.0006) [2023-12-26 10:50:40,282][123090] Updated weights for policy 1, policy_version 1399491 (0.0007) [2023-12-26 10:50:40,342][123090] Updated weights for policy 1, policy_version 1399501 (0.0008) [2023-12-26 10:50:40,412][123090] Updated weights for policy 1, policy_version 1399511 (0.0008) [2023-12-26 10:50:40,587][123091] Updated weights for policy 0, policy_version 1409013 (0.0008) [2023-12-26 10:50:40,643][123091] Updated weights for policy 0, policy_version 1409023 (0.0009) [2023-12-26 10:50:40,698][123091] Updated weights for policy 0, policy_version 1409033 (0.0009) [2023-12-26 10:50:41,145][123090] Updated weights for policy 1, policy_version 1399521 (0.0008) [2023-12-26 10:50:41,214][123090] Updated weights for policy 1, policy_version 1399531 (0.0009) [2023-12-26 10:50:41,280][123090] Updated weights for policy 1, policy_version 1399541 (0.0010) [2023-12-26 10:50:41,346][123090] Updated weights for policy 1, policy_version 1399551 (0.0010) [2023-12-26 10:50:41,573][123091] Updated weights for policy 0, policy_version 1409043 (0.0010) [2023-12-26 10:50:41,633][123091] Updated weights for policy 0, policy_version 1409053 (0.0010) [2023-12-26 10:50:41,690][123091] Updated weights for policy 0, policy_version 1409063 (0.0009) [2023-12-26 10:50:42,188][123090] Updated weights for policy 1, policy_version 1399561 (0.0008) [2023-12-26 10:50:42,243][123090] Updated weights for policy 1, policy_version 1399571 (0.0009) [2023-12-26 10:50:42,305][123090] Updated weights for policy 1, policy_version 1399581 (0.0010) [2023-12-26 10:50:42,547][123091] Updated weights for policy 0, policy_version 1409073 (0.0010) [2023-12-26 10:50:42,613][123091] Updated weights for policy 0, policy_version 1409083 (0.0009) [2023-12-26 10:50:42,680][123091] Updated weights for policy 0, policy_version 1409093 (0.0010) [2023-12-26 10:50:42,749][123091] Updated weights for policy 0, policy_version 1409103 (0.0009) [2023-12-26 10:50:43,097][123090] Updated weights for policy 1, policy_version 1399591 (0.0007) [2023-12-26 10:50:43,159][123090] Updated weights for policy 1, policy_version 1399601 (0.0005) [2023-12-26 10:50:43,229][123090] Updated weights for policy 1, policy_version 1399611 (0.0009) [2023-12-26 10:50:43,613][123091] Updated weights for policy 0, policy_version 1409113 (0.0010) [2023-12-26 10:50:43,666][123091] Updated weights for policy 0, policy_version 1409123 (0.0010) [2023-12-26 10:50:43,717][123091] Updated weights for policy 0, policy_version 1409135 (0.0009) [2023-12-26 10:50:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 719044608. Throughput: 0: 8734.7, 1: 8998.7. Samples: 719034984. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:43,785][121949] Avg episode reward: [(0, '6137.282'), (1, '5768.655')] [2023-12-26 10:50:43,987][123090] Updated weights for policy 1, policy_version 1399621 (0.0007) [2023-12-26 10:50:44,046][123090] Updated weights for policy 1, policy_version 1399631 (0.0005) [2023-12-26 10:50:44,110][123090] Updated weights for policy 1, policy_version 1399641 (0.0005) [2023-12-26 10:50:44,617][123091] Updated weights for policy 0, policy_version 1409145 (0.0006) [2023-12-26 10:50:44,671][123091] Updated weights for policy 0, policy_version 1409155 (0.0005) [2023-12-26 10:50:44,719][123091] Updated weights for policy 0, policy_version 1409165 (0.0005) [2023-12-26 10:50:44,780][123090] Updated weights for policy 1, policy_version 1399651 (0.0007) [2023-12-26 10:50:44,848][123090] Updated weights for policy 1, policy_version 1399661 (0.0011) [2023-12-26 10:50:44,912][123090] Updated weights for policy 1, policy_version 1399671 (0.0010) [2023-12-26 10:50:45,530][123091] Updated weights for policy 0, policy_version 1409175 (0.0009) [2023-12-26 10:50:45,589][123091] Updated weights for policy 0, policy_version 1409185 (0.0009) [2023-12-26 10:50:45,651][123091] Updated weights for policy 0, policy_version 1409195 (0.0008) [2023-12-26 10:50:45,732][123090] Updated weights for policy 1, policy_version 1399681 (0.0011) [2023-12-26 10:50:45,798][123090] Updated weights for policy 1, policy_version 1399691 (0.0010) [2023-12-26 10:50:45,868][123090] Updated weights for policy 1, policy_version 1399701 (0.0010) [2023-12-26 10:50:45,938][123090] Updated weights for policy 1, policy_version 1399711 (0.0010) [2023-12-26 10:50:46,474][123091] Updated weights for policy 0, policy_version 1409205 (0.0008) [2023-12-26 10:50:46,532][123091] Updated weights for policy 0, policy_version 1409215 (0.0010) [2023-12-26 10:50:46,589][123091] Updated weights for policy 0, policy_version 1409225 (0.0009) [2023-12-26 10:50:46,731][123090] Updated weights for policy 1, policy_version 1399721 (0.0010) [2023-12-26 10:50:46,793][123090] Updated weights for policy 1, policy_version 1399731 (0.0010) [2023-12-26 10:50:46,863][123090] Updated weights for policy 1, policy_version 1399741 (0.0009) [2023-12-26 10:50:47,293][123091] Updated weights for policy 0, policy_version 1409235 (0.0007) [2023-12-26 10:50:47,344][123091] Updated weights for policy 0, policy_version 1409245 (0.0005) [2023-12-26 10:50:47,393][123091] Updated weights for policy 0, policy_version 1409255 (0.0006) [2023-12-26 10:50:47,566][123090] Updated weights for policy 1, policy_version 1399751 (0.0009) [2023-12-26 10:50:47,623][123090] Updated weights for policy 1, policy_version 1399762 (0.0010) [2023-12-26 10:50:47,676][123090] Updated weights for policy 1, policy_version 1399772 (0.0010) [2023-12-26 10:50:48,138][123091] Updated weights for policy 0, policy_version 1409265 (0.0006) [2023-12-26 10:50:48,202][123091] Updated weights for policy 0, policy_version 1409275 (0.0008) [2023-12-26 10:50:48,271][123091] Updated weights for policy 0, policy_version 1409285 (0.0005) [2023-12-26 10:50:48,348][123091] Updated weights for policy 0, policy_version 1409295 (0.0006) [2023-12-26 10:50:48,574][123090] Updated weights for policy 1, policy_version 1399783 (0.0008) [2023-12-26 10:50:48,641][123090] Updated weights for policy 1, policy_version 1399793 (0.0005) [2023-12-26 10:50:48,708][123090] Updated weights for policy 1, policy_version 1399803 (0.0006) [2023-12-26 10:50:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 719134720. Throughput: 0: 8753.1, 1: 9023.1. Samples: 719142112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:48,785][121949] Avg episode reward: [(0, '6211.495'), (1, '5727.896')] [2023-12-26 10:50:49,145][123091] Updated weights for policy 0, policy_version 1409305 (0.0009) [2023-12-26 10:50:49,204][123091] Updated weights for policy 0, policy_version 1409315 (0.0010) [2023-12-26 10:50:49,270][123091] Updated weights for policy 0, policy_version 1409325 (0.0010) [2023-12-26 10:50:49,390][123090] Updated weights for policy 1, policy_version 1399813 (0.0005) [2023-12-26 10:50:49,448][123090] Updated weights for policy 1, policy_version 1399823 (0.0005) [2023-12-26 10:50:49,509][123090] Updated weights for policy 1, policy_version 1399833 (0.0005) [2023-12-26 10:50:50,140][123091] Updated weights for policy 0, policy_version 1409335 (0.0007) [2023-12-26 10:50:50,202][123091] Updated weights for policy 0, policy_version 1409345 (0.0006) [2023-12-26 10:50:50,238][123090] Updated weights for policy 1, policy_version 1399843 (0.0007) [2023-12-26 10:50:50,261][123091] Updated weights for policy 0, policy_version 1409355 (0.0006) [2023-12-26 10:50:50,299][123090] Updated weights for policy 1, policy_version 1399853 (0.0009) [2023-12-26 10:50:50,359][123090] Updated weights for policy 1, policy_version 1399863 (0.0010) [2023-12-26 10:50:51,005][123091] Updated weights for policy 0, policy_version 1409365 (0.0008) [2023-12-26 10:50:51,076][123091] Updated weights for policy 0, policy_version 1409375 (0.0010) [2023-12-26 10:50:51,136][123091] Updated weights for policy 0, policy_version 1409385 (0.0010) [2023-12-26 10:50:51,275][123090] Updated weights for policy 1, policy_version 1399873 (0.0010) [2023-12-26 10:50:51,338][123090] Updated weights for policy 1, policy_version 1399883 (0.0010) [2023-12-26 10:50:51,403][123090] Updated weights for policy 1, policy_version 1399893 (0.0010) [2023-12-26 10:50:51,468][123090] Updated weights for policy 1, policy_version 1399903 (0.0009) [2023-12-26 10:50:52,011][123091] Updated weights for policy 0, policy_version 1409395 (0.0009) [2023-12-26 10:50:52,068][123091] Updated weights for policy 0, policy_version 1409405 (0.0005) [2023-12-26 10:50:52,137][123091] Updated weights for policy 0, policy_version 1409415 (0.0009) [2023-12-26 10:50:52,282][123090] Updated weights for policy 1, policy_version 1399913 (0.0010) [2023-12-26 10:50:52,358][123090] Updated weights for policy 1, policy_version 1399923 (0.0011) [2023-12-26 10:50:52,429][123090] Updated weights for policy 1, policy_version 1399933 (0.0010) [2023-12-26 10:50:52,892][123091] Updated weights for policy 0, policy_version 1409425 (0.0009) [2023-12-26 10:50:52,944][123091] Updated weights for policy 0, policy_version 1409435 (0.0010) [2023-12-26 10:50:52,992][123091] Updated weights for policy 0, policy_version 1409445 (0.0010) [2023-12-26 10:50:53,040][123091] Updated weights for policy 0, policy_version 1409455 (0.0010) [2023-12-26 10:50:53,219][123090] Updated weights for policy 1, policy_version 1399943 (0.0011) [2023-12-26 10:50:53,285][123090] Updated weights for policy 1, policy_version 1399953 (0.0010) [2023-12-26 10:50:53,358][123090] Updated weights for policy 1, policy_version 1399963 (0.0011) [2023-12-26 10:50:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 719216640. Throughput: 0: 8710.0, 1: 8996.7. Samples: 719194720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:53,785][121949] Avg episode reward: [(0, '6364.473'), (1, '5637.471')] [2023-12-26 10:50:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001409456_360824832.pth... [2023-12-26 10:50:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001399968_358391808.pth... [2023-12-26 10:50:53,791][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001408432_360562688.pth [2023-12-26 10:50:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001398912_358121472.pth [2023-12-26 10:50:53,876][123091] Updated weights for policy 0, policy_version 1409465 (0.0010) [2023-12-26 10:50:53,928][123091] Updated weights for policy 0, policy_version 1409475 (0.0010) [2023-12-26 10:50:53,978][123091] Updated weights for policy 0, policy_version 1409485 (0.0010) [2023-12-26 10:50:54,058][123090] Updated weights for policy 1, policy_version 1399973 (0.0010) [2023-12-26 10:50:54,120][123090] Updated weights for policy 1, policy_version 1399983 (0.0008) [2023-12-26 10:50:54,181][123090] Updated weights for policy 1, policy_version 1399993 (0.0005) [2023-12-26 10:50:54,717][123091] Updated weights for policy 0, policy_version 1409495 (0.0010) [2023-12-26 10:50:54,762][123091] Updated weights for policy 0, policy_version 1409506 (0.0010) [2023-12-26 10:50:54,820][123091] Updated weights for policy 0, policy_version 1409517 (0.0010) [2023-12-26 10:50:54,949][123090] Updated weights for policy 1, policy_version 1400003 (0.0006) [2023-12-26 10:50:55,009][123090] Updated weights for policy 1, policy_version 1400013 (0.0007) [2023-12-26 10:50:55,072][123090] Updated weights for policy 1, policy_version 1400023 (0.0010) [2023-12-26 10:50:55,632][123091] Updated weights for policy 0, policy_version 1409527 (0.0007) [2023-12-26 10:50:55,677][123091] Updated weights for policy 0, policy_version 1409537 (0.0005) [2023-12-26 10:50:55,726][123091] Updated weights for policy 0, policy_version 1409547 (0.0005) [2023-12-26 10:50:55,739][123090] Updated weights for policy 1, policy_version 1400033 (0.0006) [2023-12-26 10:50:55,796][123090] Updated weights for policy 1, policy_version 1400043 (0.0005) [2023-12-26 10:50:55,852][123090] Updated weights for policy 1, policy_version 1400053 (0.0005) [2023-12-26 10:50:55,923][123090] Updated weights for policy 1, policy_version 1400063 (0.0008) [2023-12-26 10:50:56,455][123091] Updated weights for policy 0, policy_version 1409557 (0.0006) [2023-12-26 10:50:56,509][123091] Updated weights for policy 0, policy_version 1409567 (0.0006) [2023-12-26 10:50:56,574][123091] Updated weights for policy 0, policy_version 1409577 (0.0008) [2023-12-26 10:50:56,727][123090] Updated weights for policy 1, policy_version 1400073 (0.0011) [2023-12-26 10:50:56,793][123090] Updated weights for policy 1, policy_version 1400083 (0.0010) [2023-12-26 10:50:56,851][123090] Updated weights for policy 1, policy_version 1400093 (0.0010) [2023-12-26 10:50:57,303][123091] Updated weights for policy 0, policy_version 1409587 (0.0009) [2023-12-26 10:50:57,352][123091] Updated weights for policy 0, policy_version 1409597 (0.0007) [2023-12-26 10:50:57,403][123091] Updated weights for policy 0, policy_version 1409607 (0.0008) [2023-12-26 10:50:57,657][123090] Updated weights for policy 1, policy_version 1400103 (0.0010) [2023-12-26 10:50:57,703][123090] Updated weights for policy 1, policy_version 1400113 (0.0010) [2023-12-26 10:50:57,758][123090] Updated weights for policy 1, policy_version 1400123 (0.0010) [2023-12-26 10:50:58,019][123091] Updated weights for policy 0, policy_version 1409617 (0.0007) [2023-12-26 10:50:58,088][123091] Updated weights for policy 0, policy_version 1409627 (0.0008) [2023-12-26 10:50:58,151][123091] Updated weights for policy 0, policy_version 1409637 (0.0008) [2023-12-26 10:50:58,208][123091] Updated weights for policy 0, policy_version 1409647 (0.0008) [2023-12-26 10:50:58,604][123090] Updated weights for policy 1, policy_version 1400133 (0.0009) [2023-12-26 10:50:58,680][123090] Updated weights for policy 1, policy_version 1400143 (0.0009) [2023-12-26 10:50:58,757][123090] Updated weights for policy 1, policy_version 1400153 (0.0008) [2023-12-26 10:50:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 719306752. Throughput: 0: 8831.2, 1: 8989.2. Samples: 719305256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:50:58,785][121949] Avg episode reward: [(0, '6409.377'), (1, '5579.114')] [2023-12-26 10:50:59,088][123091] Updated weights for policy 0, policy_version 1409657 (0.0010) [2023-12-26 10:50:59,136][123091] Updated weights for policy 0, policy_version 1409667 (0.0010) [2023-12-26 10:50:59,187][123091] Updated weights for policy 0, policy_version 1409677 (0.0010) [2023-12-26 10:50:59,648][123090] Updated weights for policy 1, policy_version 1400163 (0.0009) [2023-12-26 10:50:59,700][123090] Updated weights for policy 1, policy_version 1400173 (0.0009) [2023-12-26 10:50:59,747][123090] Updated weights for policy 1, policy_version 1400183 (0.0009) [2023-12-26 10:51:00,044][123091] Updated weights for policy 0, policy_version 1409687 (0.0010) [2023-12-26 10:51:00,103][123091] Updated weights for policy 0, policy_version 1409697 (0.0009) [2023-12-26 10:51:00,162][123091] Updated weights for policy 0, policy_version 1409707 (0.0010) [2023-12-26 10:51:00,605][123090] Updated weights for policy 1, policy_version 1400193 (0.0009) [2023-12-26 10:51:00,668][123090] Updated weights for policy 1, policy_version 1400203 (0.0008) [2023-12-26 10:51:00,736][123090] Updated weights for policy 1, policy_version 1400214 (0.0009) [2023-12-26 10:51:00,785][123090] Updated weights for policy 1, policy_version 1400224 (0.0009) [2023-12-26 10:51:00,954][123091] Updated weights for policy 0, policy_version 1409717 (0.0009) [2023-12-26 10:51:01,002][123091] Updated weights for policy 0, policy_version 1409727 (0.0009) [2023-12-26 10:51:01,068][123091] Updated weights for policy 0, policy_version 1409737 (0.0009) [2023-12-26 10:51:01,635][123090] Updated weights for policy 1, policy_version 1400234 (0.0009) [2023-12-26 10:51:01,709][123090] Updated weights for policy 1, policy_version 1400244 (0.0007) [2023-12-26 10:51:01,777][123090] Updated weights for policy 1, policy_version 1400254 (0.0010) [2023-12-26 10:51:01,943][123091] Updated weights for policy 0, policy_version 1409747 (0.0009) [2023-12-26 10:51:01,999][123091] Updated weights for policy 0, policy_version 1409757 (0.0009) [2023-12-26 10:51:02,062][123091] Updated weights for policy 0, policy_version 1409767 (0.0010) [2023-12-26 10:51:02,592][123090] Updated weights for policy 1, policy_version 1400264 (0.0006) [2023-12-26 10:51:02,664][123090] Updated weights for policy 1, policy_version 1400274 (0.0005) [2023-12-26 10:51:02,732][123090] Updated weights for policy 1, policy_version 1400284 (0.0010) [2023-12-26 10:51:02,937][123091] Updated weights for policy 0, policy_version 1409777 (0.0009) [2023-12-26 10:51:02,989][123091] Updated weights for policy 0, policy_version 1409787 (0.0010) [2023-12-26 10:51:03,044][123091] Updated weights for policy 0, policy_version 1409797 (0.0010) [2023-12-26 10:51:03,105][123091] Updated weights for policy 0, policy_version 1409807 (0.0010) [2023-12-26 10:51:03,487][123090] Updated weights for policy 1, policy_version 1400294 (0.0007) [2023-12-26 10:51:03,537][123090] Updated weights for policy 1, policy_version 1400304 (0.0005) [2023-12-26 10:51:03,604][123090] Updated weights for policy 1, policy_version 1400314 (0.0006) [2023-12-26 10:51:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 719396864. Throughput: 0: 8861.8, 1: 8878.7. Samples: 719407720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:03,784][121949] Avg episode reward: [(0, '6405.792'), (1, '5408.240')] [2023-12-26 10:51:03,897][123091] Updated weights for policy 0, policy_version 1409817 (0.0010) [2023-12-26 10:51:03,958][123091] Updated weights for policy 0, policy_version 1409827 (0.0010) [2023-12-26 10:51:04,013][123091] Updated weights for policy 0, policy_version 1409837 (0.0010) [2023-12-26 10:51:04,395][123090] Updated weights for policy 1, policy_version 1400324 (0.0009) [2023-12-26 10:51:04,463][123090] Updated weights for policy 1, policy_version 1400334 (0.0009) [2023-12-26 10:51:04,533][123090] Updated weights for policy 1, policy_version 1400344 (0.0009) [2023-12-26 10:51:04,819][123091] Updated weights for policy 0, policy_version 1409847 (0.0010) [2023-12-26 10:51:04,871][123091] Updated weights for policy 0, policy_version 1409857 (0.0010) [2023-12-26 10:51:04,921][123091] Updated weights for policy 0, policy_version 1409868 (0.0010) [2023-12-26 10:51:05,379][123090] Updated weights for policy 1, policy_version 1400354 (0.0009) [2023-12-26 10:51:05,429][123090] Updated weights for policy 1, policy_version 1400364 (0.0008) [2023-12-26 10:51:05,483][123090] Updated weights for policy 1, policy_version 1400374 (0.0008) [2023-12-26 10:51:05,542][123090] Updated weights for policy 1, policy_version 1400384 (0.0009) [2023-12-26 10:51:05,640][123091] Updated weights for policy 0, policy_version 1409878 (0.0009) [2023-12-26 10:51:05,704][123091] Updated weights for policy 0, policy_version 1409888 (0.0010) [2023-12-26 10:51:05,769][123091] Updated weights for policy 0, policy_version 1409898 (0.0009) [2023-12-26 10:51:06,463][123090] Updated weights for policy 1, policy_version 1400394 (0.0009) [2023-12-26 10:51:06,488][123091] Updated weights for policy 0, policy_version 1409908 (0.0007) [2023-12-26 10:51:06,530][123090] Updated weights for policy 1, policy_version 1400404 (0.0009) [2023-12-26 10:51:06,550][123091] Updated weights for policy 0, policy_version 1409918 (0.0007) [2023-12-26 10:51:06,597][123090] Updated weights for policy 1, policy_version 1400414 (0.0009) [2023-12-26 10:51:06,621][123091] Updated weights for policy 0, policy_version 1409928 (0.0005) [2023-12-26 10:51:07,417][123091] Updated weights for policy 0, policy_version 1409938 (0.0006) [2023-12-26 10:51:07,433][123090] Updated weights for policy 1, policy_version 1400424 (0.0008) [2023-12-26 10:51:07,478][123091] Updated weights for policy 0, policy_version 1409948 (0.0006) [2023-12-26 10:51:07,489][123090] Updated weights for policy 1, policy_version 1400434 (0.0008) [2023-12-26 10:51:07,529][123091] Updated weights for policy 0, policy_version 1409958 (0.0006) [2023-12-26 10:51:07,539][123090] Updated weights for policy 1, policy_version 1400444 (0.0009) [2023-12-26 10:51:07,584][123091] Updated weights for policy 0, policy_version 1409968 (0.0010) [2023-12-26 10:51:08,341][123091] Updated weights for policy 0, policy_version 1409978 (0.0011) [2023-12-26 10:51:08,409][123091] Updated weights for policy 0, policy_version 1409988 (0.0008) [2023-12-26 10:51:08,426][123090] Updated weights for policy 1, policy_version 1400454 (0.0006) [2023-12-26 10:51:08,475][123091] Updated weights for policy 0, policy_version 1409998 (0.0006) [2023-12-26 10:51:08,495][123090] Updated weights for policy 1, policy_version 1400464 (0.0007) [2023-12-26 10:51:08,545][123090] Updated weights for policy 1, policy_version 1400474 (0.0005) [2023-12-26 10:51:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 719486976. Throughput: 0: 8913.5, 1: 8866.9. Samples: 719459740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:08,785][121949] Avg episode reward: [(0, '6362.944'), (1, '5448.464')] [2023-12-26 10:51:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001400480_358522880.pth... [2023-12-26 10:51:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001410000_360964096.pth... [2023-12-26 10:51:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001399456_358260736.pth [2023-12-26 10:51:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001408976_360701952.pth [2023-12-26 10:51:09,158][123091] Updated weights for policy 0, policy_version 1410008 (0.0005) [2023-12-26 10:51:09,211][123091] Updated weights for policy 0, policy_version 1410018 (0.0005) [2023-12-26 10:51:09,264][123090] Updated weights for policy 1, policy_version 1400484 (0.0007) [2023-12-26 10:51:09,279][123091] Updated weights for policy 0, policy_version 1410028 (0.0008) [2023-12-26 10:51:09,333][123090] Updated weights for policy 1, policy_version 1400494 (0.0009) [2023-12-26 10:51:09,402][123090] Updated weights for policy 1, policy_version 1400504 (0.0009) [2023-12-26 10:51:10,067][123091] Updated weights for policy 0, policy_version 1410038 (0.0007) [2023-12-26 10:51:10,138][123091] Updated weights for policy 0, policy_version 1410048 (0.0006) [2023-12-26 10:51:10,202][123091] Updated weights for policy 0, policy_version 1410058 (0.0009) [2023-12-26 10:51:10,252][123090] Updated weights for policy 1, policy_version 1400514 (0.0009) [2023-12-26 10:51:10,304][123090] Updated weights for policy 1, policy_version 1400524 (0.0010) [2023-12-26 10:51:10,360][123090] Updated weights for policy 1, policy_version 1400534 (0.0011) [2023-12-26 10:51:10,417][123090] Updated weights for policy 1, policy_version 1400544 (0.0011) [2023-12-26 10:51:10,906][123091] Updated weights for policy 0, policy_version 1410068 (0.0009) [2023-12-26 10:51:10,962][123091] Updated weights for policy 0, policy_version 1410078 (0.0008) [2023-12-26 10:51:11,030][123091] Updated weights for policy 0, policy_version 1410088 (0.0006) [2023-12-26 10:51:11,304][123090] Updated weights for policy 1, policy_version 1400554 (0.0011) [2023-12-26 10:51:11,362][123090] Updated weights for policy 1, policy_version 1400564 (0.0010) [2023-12-26 10:51:11,428][123090] Updated weights for policy 1, policy_version 1400574 (0.0007) [2023-12-26 10:51:11,790][123091] Updated weights for policy 0, policy_version 1410098 (0.0008) [2023-12-26 10:51:11,857][123091] Updated weights for policy 0, policy_version 1410108 (0.0010) [2023-12-26 10:51:11,923][123091] Updated weights for policy 0, policy_version 1410118 (0.0010) [2023-12-26 10:51:11,987][123091] Updated weights for policy 0, policy_version 1410128 (0.0009) [2023-12-26 10:51:12,193][123090] Updated weights for policy 1, policy_version 1400584 (0.0006) [2023-12-26 10:51:12,267][123090] Updated weights for policy 1, policy_version 1400594 (0.0006) [2023-12-26 10:51:12,338][123090] Updated weights for policy 1, policy_version 1400604 (0.0007) [2023-12-26 10:51:12,875][123091] Updated weights for policy 0, policy_version 1410138 (0.0009) [2023-12-26 10:51:12,940][123091] Updated weights for policy 0, policy_version 1410148 (0.0009) [2023-12-26 10:51:12,993][123091] Updated weights for policy 0, policy_version 1410158 (0.0009) [2023-12-26 10:51:13,150][123090] Updated weights for policy 1, policy_version 1400614 (0.0009) [2023-12-26 10:51:13,218][123090] Updated weights for policy 1, policy_version 1400624 (0.0005) [2023-12-26 10:51:13,278][123090] Updated weights for policy 1, policy_version 1400634 (0.0005) [2023-12-26 10:51:13,722][123091] Updated weights for policy 0, policy_version 1410168 (0.0006) [2023-12-26 10:51:13,784][123091] Updated weights for policy 0, policy_version 1410178 (0.0005) [2023-12-26 10:51:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 719568896. Throughput: 0: 8922.1, 1: 8763.2. Samples: 719565744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:13,785][121949] Avg episode reward: [(0, '6194.567'), (1, '5740.013')] [2023-12-26 10:51:13,845][123091] Updated weights for policy 0, policy_version 1410188 (0.0005) [2023-12-26 10:51:14,071][123090] Updated weights for policy 1, policy_version 1400644 (0.0005) [2023-12-26 10:51:14,127][123090] Updated weights for policy 1, policy_version 1400654 (0.0005) [2023-12-26 10:51:14,186][123090] Updated weights for policy 1, policy_version 1400664 (0.0006) [2023-12-26 10:51:14,581][123091] Updated weights for policy 0, policy_version 1410198 (0.0006) [2023-12-26 10:51:14,657][123091] Updated weights for policy 0, policy_version 1410208 (0.0005) [2023-12-26 10:51:14,716][123091] Updated weights for policy 0, policy_version 1410218 (0.0005) [2023-12-26 10:51:14,875][123090] Updated weights for policy 1, policy_version 1400674 (0.0006) [2023-12-26 10:51:14,936][123090] Updated weights for policy 1, policy_version 1400684 (0.0007) [2023-12-26 10:51:15,000][123090] Updated weights for policy 1, policy_version 1400694 (0.0008) [2023-12-26 10:51:15,064][123090] Updated weights for policy 1, policy_version 1400704 (0.0008) [2023-12-26 10:51:15,427][123091] Updated weights for policy 0, policy_version 1410228 (0.0007) [2023-12-26 10:51:15,498][123091] Updated weights for policy 0, policy_version 1410238 (0.0010) [2023-12-26 10:51:15,563][123091] Updated weights for policy 0, policy_version 1410248 (0.0008) [2023-12-26 10:51:15,808][123090] Updated weights for policy 1, policy_version 1400715 (0.0010) [2023-12-26 10:51:15,862][123090] Updated weights for policy 1, policy_version 1400726 (0.0011) [2023-12-26 10:51:16,234][123091] Updated weights for policy 0, policy_version 1410258 (0.0006) [2023-12-26 10:51:16,280][123091] Updated weights for policy 0, policy_version 1410268 (0.0005) [2023-12-26 10:51:16,326][123091] Updated weights for policy 0, policy_version 1410278 (0.0005) [2023-12-26 10:51:16,371][123091] Updated weights for policy 0, policy_version 1410288 (0.0005) [2023-12-26 10:51:16,847][123090] Updated weights for policy 1, policy_version 1400738 (0.0009) [2023-12-26 10:51:16,900][123090] Updated weights for policy 1, policy_version 1400748 (0.0010) [2023-12-26 10:51:16,953][123090] Updated weights for policy 1, policy_version 1400758 (0.0010) [2023-12-26 10:51:17,007][123090] Updated weights for policy 1, policy_version 1400768 (0.0009) [2023-12-26 10:51:17,041][123091] Updated weights for policy 0, policy_version 1410298 (0.0008) [2023-12-26 10:51:17,089][123091] Updated weights for policy 0, policy_version 1410308 (0.0006) [2023-12-26 10:51:17,134][123091] Updated weights for policy 0, policy_version 1410318 (0.0005) [2023-12-26 10:51:17,876][123090] Updated weights for policy 1, policy_version 1400778 (0.0010) [2023-12-26 10:51:17,947][123090] Updated weights for policy 1, policy_version 1400788 (0.0010) [2023-12-26 10:51:17,960][123091] Updated weights for policy 0, policy_version 1410328 (0.0007) [2023-12-26 10:51:18,007][123090] Updated weights for policy 1, policy_version 1400798 (0.0010) [2023-12-26 10:51:18,019][123091] Updated weights for policy 0, policy_version 1410338 (0.0009) [2023-12-26 10:51:18,072][123091] Updated weights for policy 0, policy_version 1410348 (0.0009) [2023-12-26 10:51:18,723][123091] Updated weights for policy 0, policy_version 1410358 (0.0007) [2023-12-26 10:51:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 719659008. Throughput: 0: 9000.9, 1: 8783.6. Samples: 719676100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:18,785][121949] Avg episode reward: [(0, '6173.691'), (1, '5793.744')] [2023-12-26 10:51:18,798][123091] Updated weights for policy 0, policy_version 1410368 (0.0008) [2023-12-26 10:51:18,844][123090] Updated weights for policy 1, policy_version 1400808 (0.0010) [2023-12-26 10:51:18,863][123091] Updated weights for policy 0, policy_version 1410378 (0.0007) [2023-12-26 10:51:18,903][123090] Updated weights for policy 1, policy_version 1400818 (0.0008) [2023-12-26 10:51:18,963][123090] Updated weights for policy 1, policy_version 1400828 (0.0007) [2023-12-26 10:51:19,660][123091] Updated weights for policy 0, policy_version 1410388 (0.0010) [2023-12-26 10:51:19,728][123091] Updated weights for policy 0, policy_version 1410398 (0.0010) [2023-12-26 10:51:19,776][123090] Updated weights for policy 1, policy_version 1400838 (0.0006) [2023-12-26 10:51:19,799][123091] Updated weights for policy 0, policy_version 1410408 (0.0011) [2023-12-26 10:51:19,845][123090] Updated weights for policy 1, policy_version 1400848 (0.0008) [2023-12-26 10:51:19,921][123090] Updated weights for policy 1, policy_version 1400858 (0.0009) [2023-12-26 10:51:20,652][123091] Updated weights for policy 0, policy_version 1410418 (0.0009) [2023-12-26 10:51:20,718][123091] Updated weights for policy 0, policy_version 1410428 (0.0007) [2023-12-26 10:51:20,722][123090] Updated weights for policy 1, policy_version 1400868 (0.0008) [2023-12-26 10:51:20,790][123091] Updated weights for policy 0, policy_version 1410438 (0.0009) [2023-12-26 10:51:20,793][123090] Updated weights for policy 1, policy_version 1400878 (0.0008) [2023-12-26 10:51:20,855][123091] Updated weights for policy 0, policy_version 1410448 (0.0008) [2023-12-26 10:51:20,864][123090] Updated weights for policy 1, policy_version 1400888 (0.0009) [2023-12-26 10:51:21,665][123091] Updated weights for policy 0, policy_version 1410458 (0.0009) [2023-12-26 10:51:21,734][123091] Updated weights for policy 0, policy_version 1410468 (0.0012) [2023-12-26 10:51:21,777][123090] Updated weights for policy 1, policy_version 1400898 (0.0009) [2023-12-26 10:51:21,802][123091] Updated weights for policy 0, policy_version 1410478 (0.0010) [2023-12-26 10:51:21,841][123090] Updated weights for policy 1, policy_version 1400908 (0.0009) [2023-12-26 10:51:21,902][123090] Updated weights for policy 1, policy_version 1400918 (0.0009) [2023-12-26 10:51:21,967][123090] Updated weights for policy 1, policy_version 1400928 (0.0009) [2023-12-26 10:51:22,642][123091] Updated weights for policy 0, policy_version 1410488 (0.0011) [2023-12-26 10:51:22,706][123091] Updated weights for policy 0, policy_version 1410498 (0.0011) [2023-12-26 10:51:22,774][123091] Updated weights for policy 0, policy_version 1410508 (0.0011) [2023-12-26 10:51:22,776][123090] Updated weights for policy 1, policy_version 1400938 (0.0005) [2023-12-26 10:51:22,835][123090] Updated weights for policy 1, policy_version 1400948 (0.0008) [2023-12-26 10:51:22,885][123090] Updated weights for policy 1, policy_version 1400958 (0.0009) [2023-12-26 10:51:23,588][123090] Updated weights for policy 1, policy_version 1400968 (0.0008) [2023-12-26 10:51:23,612][123091] Updated weights for policy 0, policy_version 1410518 (0.0011) [2023-12-26 10:51:23,662][123090] Updated weights for policy 1, policy_version 1400978 (0.0006) [2023-12-26 10:51:23,672][123091] Updated weights for policy 0, policy_version 1410528 (0.0011) [2023-12-26 10:51:23,719][123090] Updated weights for policy 1, policy_version 1400988 (0.0008) [2023-12-26 10:51:23,738][123091] Updated weights for policy 0, policy_version 1410538 (0.0011) [2023-12-26 10:51:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 719757312. Throughput: 0: 8970.5, 1: 8721.5. Samples: 719727016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:23,785][121949] Avg episode reward: [(0, '6263.904'), (1, '5763.607')] [2023-12-26 10:51:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001410544_361103360.pth... [2023-12-26 10:51:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001400992_358653952.pth... [2023-12-26 10:51:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001409456_360824832.pth [2023-12-26 10:51:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001399968_358391808.pth [2023-12-26 10:51:24,451][123090] Updated weights for policy 1, policy_version 1400998 (0.0006) [2023-12-26 10:51:24,523][123090] Updated weights for policy 1, policy_version 1401008 (0.0005) [2023-12-26 10:51:24,550][123091] Updated weights for policy 0, policy_version 1410548 (0.0010) [2023-12-26 10:51:24,581][123090] Updated weights for policy 1, policy_version 1401018 (0.0007) [2023-12-26 10:51:24,598][123091] Updated weights for policy 0, policy_version 1410558 (0.0010) [2023-12-26 10:51:24,653][123091] Updated weights for policy 0, policy_version 1410568 (0.0010) [2023-12-26 10:51:25,309][123090] Updated weights for policy 1, policy_version 1401028 (0.0006) [2023-12-26 10:51:25,372][123090] Updated weights for policy 1, policy_version 1401038 (0.0009) [2023-12-26 10:51:25,447][123090] Updated weights for policy 1, policy_version 1401048 (0.0009) [2023-12-26 10:51:25,498][123091] Updated weights for policy 0, policy_version 1410578 (0.0010) [2023-12-26 10:51:25,545][123091] Updated weights for policy 0, policy_version 1410588 (0.0010) [2023-12-26 10:51:25,600][123091] Updated weights for policy 0, policy_version 1410598 (0.0010) [2023-12-26 10:51:25,661][123091] Updated weights for policy 0, policy_version 1410608 (0.0007) [2023-12-26 10:51:26,233][123090] Updated weights for policy 1, policy_version 1401058 (0.0008) [2023-12-26 10:51:26,282][123090] Updated weights for policy 1, policy_version 1401068 (0.0005) [2023-12-26 10:51:26,330][123090] Updated weights for policy 1, policy_version 1401078 (0.0005) [2023-12-26 10:51:26,377][123090] Updated weights for policy 1, policy_version 1401088 (0.0006) [2023-12-26 10:51:26,409][123091] Updated weights for policy 0, policy_version 1410618 (0.0011) [2023-12-26 10:51:26,468][123091] Updated weights for policy 0, policy_version 1410628 (0.0010) [2023-12-26 10:51:26,527][123091] Updated weights for policy 0, policy_version 1410638 (0.0010) [2023-12-26 10:51:27,048][123090] Updated weights for policy 1, policy_version 1401098 (0.0010) [2023-12-26 10:51:27,095][123090] Updated weights for policy 1, policy_version 1401108 (0.0010) [2023-12-26 10:51:27,145][123090] Updated weights for policy 1, policy_version 1401118 (0.0010) [2023-12-26 10:51:27,230][123091] Updated weights for policy 0, policy_version 1410648 (0.0006) [2023-12-26 10:51:27,296][123091] Updated weights for policy 0, policy_version 1410658 (0.0005) [2023-12-26 10:51:27,349][123091] Updated weights for policy 0, policy_version 1410668 (0.0005) [2023-12-26 10:51:27,901][123090] Updated weights for policy 1, policy_version 1401128 (0.0006) [2023-12-26 10:51:27,944][123090] Updated weights for policy 1, policy_version 1401138 (0.0005) [2023-12-26 10:51:27,989][123090] Updated weights for policy 1, policy_version 1401148 (0.0005) [2023-12-26 10:51:28,008][123091] Updated weights for policy 0, policy_version 1410678 (0.0007) [2023-12-26 10:51:28,056][123091] Updated weights for policy 0, policy_version 1410688 (0.0010) [2023-12-26 10:51:28,108][123091] Updated weights for policy 0, policy_version 1410698 (0.0006) [2023-12-26 10:51:28,717][123090] Updated weights for policy 1, policy_version 1401158 (0.0008) [2023-12-26 10:51:28,778][123091] Updated weights for policy 0, policy_version 1410708 (0.0007) [2023-12-26 10:51:28,781][123090] Updated weights for policy 1, policy_version 1401168 (0.0011) [2023-12-26 10:51:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 719839232. Throughput: 0: 9033.3, 1: 8773.3. Samples: 719836276. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 10:51:28,785][121949] Avg episode reward: [(0, '6245.672'), (1, '5755.293')] [2023-12-26 10:51:28,826][123091] Updated weights for policy 0, policy_version 1410718 (0.0010) [2023-12-26 10:51:28,840][123090] Updated weights for policy 1, policy_version 1401178 (0.0010) [2023-12-26 10:51:28,878][123091] Updated weights for policy 0, policy_version 1410728 (0.0010) [2023-12-26 10:51:29,590][123090] Updated weights for policy 1, policy_version 1401188 (0.0008) [2023-12-26 10:51:29,655][123090] Updated weights for policy 1, policy_version 1401198 (0.0005) [2023-12-26 10:51:29,711][123091] Updated weights for policy 0, policy_version 1410738 (0.0011) [2023-12-26 10:51:29,721][123090] Updated weights for policy 1, policy_version 1401208 (0.0005) [2023-12-26 10:51:29,762][123091] Updated weights for policy 0, policy_version 1410748 (0.0010) [2023-12-26 10:51:29,826][123091] Updated weights for policy 0, policy_version 1410758 (0.0011) [2023-12-26 10:51:29,897][123091] Updated weights for policy 0, policy_version 1410768 (0.0011) [2023-12-26 10:51:30,500][123090] Updated weights for policy 1, policy_version 1401218 (0.0010) [2023-12-26 10:51:30,561][123090] Updated weights for policy 1, policy_version 1401228 (0.0009) [2023-12-26 10:51:30,617][123090] Updated weights for policy 1, policy_version 1401238 (0.0009) [2023-12-26 10:51:30,668][123091] Updated weights for policy 0, policy_version 1410778 (0.0010) [2023-12-26 10:51:30,676][123090] Updated weights for policy 1, policy_version 1401248 (0.0008) [2023-12-26 10:51:30,715][123091] Updated weights for policy 0, policy_version 1410788 (0.0010) [2023-12-26 10:51:30,758][123091] Updated weights for policy 0, policy_version 1410798 (0.0010) [2023-12-26 10:51:31,495][123090] Updated weights for policy 1, policy_version 1401258 (0.0006) [2023-12-26 10:51:31,548][123091] Updated weights for policy 0, policy_version 1410808 (0.0008) [2023-12-26 10:51:31,552][123090] Updated weights for policy 1, policy_version 1401268 (0.0005) [2023-12-26 10:51:31,600][123091] Updated weights for policy 0, policy_version 1410818 (0.0008) [2023-12-26 10:51:31,609][123090] Updated weights for policy 1, policy_version 1401278 (0.0005) [2023-12-26 10:51:31,666][123091] Updated weights for policy 0, policy_version 1410828 (0.0008) [2023-12-26 10:51:32,333][123090] Updated weights for policy 1, policy_version 1401288 (0.0009) [2023-12-26 10:51:32,391][123090] Updated weights for policy 1, policy_version 1401298 (0.0007) [2023-12-26 10:51:32,448][123090] Updated weights for policy 1, policy_version 1401308 (0.0005) [2023-12-26 10:51:32,496][123091] Updated weights for policy 0, policy_version 1410838 (0.0010) [2023-12-26 10:51:32,561][123091] Updated weights for policy 0, policy_version 1410848 (0.0010) [2023-12-26 10:51:32,628][123091] Updated weights for policy 0, policy_version 1410858 (0.0009) [2023-12-26 10:51:33,275][123090] Updated weights for policy 1, policy_version 1401318 (0.0008) [2023-12-26 10:51:33,322][123090] Updated weights for policy 1, policy_version 1401328 (0.0009) [2023-12-26 10:51:33,369][123090] Updated weights for policy 1, policy_version 1401338 (0.0009) [2023-12-26 10:51:33,416][123091] Updated weights for policy 0, policy_version 1410868 (0.0009) [2023-12-26 10:51:33,477][123091] Updated weights for policy 0, policy_version 1410878 (0.0010) [2023-12-26 10:51:33,533][123091] Updated weights for policy 0, policy_version 1410888 (0.0009) [2023-12-26 10:51:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 719937536. Throughput: 0: 9071.1, 1: 8789.6. Samples: 719945844. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:33,785][121949] Avg episode reward: [(0, '6322.350'), (1, '5571.718')] [2023-12-26 10:51:34,244][123090] Updated weights for policy 1, policy_version 1401348 (0.0007) [2023-12-26 10:51:34,248][123091] Updated weights for policy 0, policy_version 1410898 (0.0009) [2023-12-26 10:51:34,310][123091] Updated weights for policy 0, policy_version 1410908 (0.0009) [2023-12-26 10:51:34,313][123090] Updated weights for policy 1, policy_version 1401358 (0.0005) [2023-12-26 10:51:34,373][123091] Updated weights for policy 0, policy_version 1410918 (0.0009) [2023-12-26 10:51:34,378][123090] Updated weights for policy 1, policy_version 1401368 (0.0008) [2023-12-26 10:51:34,439][123091] Updated weights for policy 0, policy_version 1410928 (0.0009) [2023-12-26 10:51:35,123][123090] Updated weights for policy 1, policy_version 1401378 (0.0007) [2023-12-26 10:51:35,180][123090] Updated weights for policy 1, policy_version 1401388 (0.0009) [2023-12-26 10:51:35,236][123090] Updated weights for policy 1, policy_version 1401400 (0.0010) [2023-12-26 10:51:35,264][123091] Updated weights for policy 0, policy_version 1410938 (0.0005) [2023-12-26 10:51:35,323][123091] Updated weights for policy 0, policy_version 1410948 (0.0005) [2023-12-26 10:51:35,386][123091] Updated weights for policy 0, policy_version 1410958 (0.0005) [2023-12-26 10:51:36,113][123090] Updated weights for policy 1, policy_version 1401410 (0.0009) [2023-12-26 10:51:36,177][123090] Updated weights for policy 1, policy_version 1401420 (0.0009) [2023-12-26 10:51:36,180][123091] Updated weights for policy 0, policy_version 1410968 (0.0007) [2023-12-26 10:51:36,227][123090] Updated weights for policy 1, policy_version 1401430 (0.0008) [2023-12-26 10:51:36,242][123091] Updated weights for policy 0, policy_version 1410978 (0.0009) [2023-12-26 10:51:36,286][123090] Updated weights for policy 1, policy_version 1401440 (0.0009) [2023-12-26 10:51:36,298][123091] Updated weights for policy 0, policy_version 1410988 (0.0006) [2023-12-26 10:51:37,015][123091] Updated weights for policy 0, policy_version 1410998 (0.0008) [2023-12-26 10:51:37,073][123091] Updated weights for policy 0, policy_version 1411008 (0.0008) [2023-12-26 10:51:37,112][123090] Updated weights for policy 1, policy_version 1401450 (0.0009) [2023-12-26 10:51:37,125][123091] Updated weights for policy 0, policy_version 1411018 (0.0010) [2023-12-26 10:51:37,173][123090] Updated weights for policy 1, policy_version 1401460 (0.0008) [2023-12-26 10:51:37,237][123090] Updated weights for policy 1, policy_version 1401470 (0.0009) [2023-12-26 10:51:37,979][123091] Updated weights for policy 0, policy_version 1411028 (0.0010) [2023-12-26 10:51:38,039][123091] Updated weights for policy 0, policy_version 1411038 (0.0008) [2023-12-26 10:51:38,073][123090] Updated weights for policy 1, policy_version 1401480 (0.0009) [2023-12-26 10:51:38,092][123091] Updated weights for policy 0, policy_version 1411048 (0.0009) [2023-12-26 10:51:38,133][123090] Updated weights for policy 1, policy_version 1401490 (0.0008) [2023-12-26 10:51:38,198][123090] Updated weights for policy 1, policy_version 1401500 (0.0009) [2023-12-26 10:51:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 720019456. Throughput: 0: 9108.0, 1: 8763.9. Samples: 719998956. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:38,785][121949] Avg episode reward: [(0, '6287.581'), (1, '5469.373')] [2023-12-26 10:51:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001411056_361234432.pth... [2023-12-26 10:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001401504_358785024.pth... [2023-12-26 10:51:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001400480_358522880.pth [2023-12-26 10:51:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001410000_360964096.pth [2023-12-26 10:51:38,897][123091] Updated weights for policy 0, policy_version 1411058 (0.0007) [2023-12-26 10:51:38,937][123090] Updated weights for policy 1, policy_version 1401510 (0.0008) [2023-12-26 10:51:38,956][123091] Updated weights for policy 0, policy_version 1411068 (0.0009) [2023-12-26 10:51:38,999][123090] Updated weights for policy 1, policy_version 1401520 (0.0008) [2023-12-26 10:51:39,016][123091] Updated weights for policy 0, policy_version 1411078 (0.0009) [2023-12-26 10:51:39,064][123090] Updated weights for policy 1, policy_version 1401530 (0.0008) [2023-12-26 10:51:39,079][123091] Updated weights for policy 0, policy_version 1411088 (0.0009) [2023-12-26 10:51:39,943][123090] Updated weights for policy 1, policy_version 1401540 (0.0009) [2023-12-26 10:51:39,957][123091] Updated weights for policy 0, policy_version 1411098 (0.0009) [2023-12-26 10:51:39,998][123090] Updated weights for policy 1, policy_version 1401550 (0.0007) [2023-12-26 10:51:40,024][123091] Updated weights for policy 0, policy_version 1411108 (0.0008) [2023-12-26 10:51:40,061][123090] Updated weights for policy 1, policy_version 1401560 (0.0009) [2023-12-26 10:51:40,084][123091] Updated weights for policy 0, policy_version 1411118 (0.0008) [2023-12-26 10:51:40,846][123091] Updated weights for policy 0, policy_version 1411128 (0.0010) [2023-12-26 10:51:40,883][123090] Updated weights for policy 1, policy_version 1401570 (0.0006) [2023-12-26 10:51:40,903][123091] Updated weights for policy 0, policy_version 1411138 (0.0011) [2023-12-26 10:51:40,942][123090] Updated weights for policy 1, policy_version 1401580 (0.0007) [2023-12-26 10:51:40,959][123091] Updated weights for policy 0, policy_version 1411148 (0.0009) [2023-12-26 10:51:40,999][123090] Updated weights for policy 1, policy_version 1401590 (0.0009) [2023-12-26 10:51:41,071][123090] Updated weights for policy 1, policy_version 1401600 (0.0009) [2023-12-26 10:51:41,776][123091] Updated weights for policy 0, policy_version 1411158 (0.0008) [2023-12-26 10:51:41,846][123091] Updated weights for policy 0, policy_version 1411168 (0.0007) [2023-12-26 10:51:41,918][123091] Updated weights for policy 0, policy_version 1411178 (0.0006) [2023-12-26 10:51:41,970][123090] Updated weights for policy 1, policy_version 1401610 (0.0006) [2023-12-26 10:51:42,030][123090] Updated weights for policy 1, policy_version 1401620 (0.0006) [2023-12-26 10:51:42,087][123090] Updated weights for policy 1, policy_version 1401630 (0.0006) [2023-12-26 10:51:42,597][123091] Updated weights for policy 0, policy_version 1411188 (0.0008) [2023-12-26 10:51:42,664][123091] Updated weights for policy 0, policy_version 1411198 (0.0008) [2023-12-26 10:51:42,733][123091] Updated weights for policy 0, policy_version 1411208 (0.0008) [2023-12-26 10:51:42,870][123090] Updated weights for policy 1, policy_version 1401640 (0.0008) [2023-12-26 10:51:42,918][123090] Updated weights for policy 1, policy_version 1401650 (0.0009) [2023-12-26 10:51:42,968][123090] Updated weights for policy 1, policy_version 1401660 (0.0009) [2023-12-26 10:51:43,565][123091] Updated weights for policy 0, policy_version 1411218 (0.0008) [2023-12-26 10:51:43,633][123091] Updated weights for policy 0, policy_version 1411228 (0.0009) [2023-12-26 10:51:43,693][123091] Updated weights for policy 0, policy_version 1411238 (0.0008) [2023-12-26 10:51:43,721][123090] Updated weights for policy 1, policy_version 1401671 (0.0009) [2023-12-26 10:51:43,753][123091] Updated weights for policy 0, policy_version 1411248 (0.0009) [2023-12-26 10:51:43,774][123090] Updated weights for policy 1, policy_version 1401681 (0.0008) [2023-12-26 10:51:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 720109568. Throughput: 0: 9018.8, 1: 8697.2. Samples: 720102472. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:43,784][121949] Avg episode reward: [(0, '6188.958'), (1, '5611.613')] [2023-12-26 10:51:43,829][123090] Updated weights for policy 1, policy_version 1401691 (0.0010) [2023-12-26 10:51:44,604][123091] Updated weights for policy 0, policy_version 1411258 (0.0010) [2023-12-26 10:51:44,641][123090] Updated weights for policy 1, policy_version 1401701 (0.0009) [2023-12-26 10:51:44,660][123091] Updated weights for policy 0, policy_version 1411268 (0.0007) [2023-12-26 10:51:44,693][123090] Updated weights for policy 1, policy_version 1401711 (0.0009) [2023-12-26 10:51:44,709][123091] Updated weights for policy 0, policy_version 1411278 (0.0006) [2023-12-26 10:51:44,739][123090] Updated weights for policy 1, policy_version 1401721 (0.0008) [2023-12-26 10:51:45,511][123090] Updated weights for policy 1, policy_version 1401731 (0.0006) [2023-12-26 10:51:45,521][123091] Updated weights for policy 0, policy_version 1411288 (0.0008) [2023-12-26 10:51:45,569][123091] Updated weights for policy 0, policy_version 1411298 (0.0009) [2023-12-26 10:51:45,579][123090] Updated weights for policy 1, policy_version 1401741 (0.0005) [2023-12-26 10:51:45,628][123091] Updated weights for policy 0, policy_version 1411308 (0.0008) [2023-12-26 10:51:45,645][123090] Updated weights for policy 1, policy_version 1401751 (0.0005) [2023-12-26 10:51:46,387][123090] Updated weights for policy 1, policy_version 1401761 (0.0006) [2023-12-26 10:51:46,445][123090] Updated weights for policy 1, policy_version 1401771 (0.0009) [2023-12-26 10:51:46,493][123090] Updated weights for policy 1, policy_version 1401781 (0.0009) [2023-12-26 10:51:46,496][123091] Updated weights for policy 0, policy_version 1411318 (0.0009) [2023-12-26 10:51:46,554][123090] Updated weights for policy 1, policy_version 1401791 (0.0009) [2023-12-26 10:51:46,556][123091] Updated weights for policy 0, policy_version 1411328 (0.0008) [2023-12-26 10:51:46,609][123091] Updated weights for policy 0, policy_version 1411338 (0.0009) [2023-12-26 10:51:47,375][123090] Updated weights for policy 1, policy_version 1401801 (0.0007) [2023-12-26 10:51:47,381][123091] Updated weights for policy 0, policy_version 1411348 (0.0007) [2023-12-26 10:51:47,432][123090] Updated weights for policy 1, policy_version 1401811 (0.0006) [2023-12-26 10:51:47,434][123091] Updated weights for policy 0, policy_version 1411358 (0.0005) [2023-12-26 10:51:47,492][123090] Updated weights for policy 1, policy_version 1401821 (0.0008) [2023-12-26 10:51:47,493][123091] Updated weights for policy 0, policy_version 1411368 (0.0005) [2023-12-26 10:51:48,120][123091] Updated weights for policy 0, policy_version 1411378 (0.0005) [2023-12-26 10:51:48,172][123091] Updated weights for policy 0, policy_version 1411388 (0.0005) [2023-12-26 10:51:48,174][123090] Updated weights for policy 1, policy_version 1401831 (0.0010) [2023-12-26 10:51:48,225][123091] Updated weights for policy 0, policy_version 1411398 (0.0005) [2023-12-26 10:51:48,240][123090] Updated weights for policy 1, policy_version 1401841 (0.0009) [2023-12-26 10:51:48,284][123091] Updated weights for policy 0, policy_version 1411408 (0.0005) [2023-12-26 10:51:48,299][123090] Updated weights for policy 1, policy_version 1401851 (0.0009) [2023-12-26 10:51:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 720199680. Throughput: 0: 9069.0, 1: 8811.7. Samples: 720212352. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:48,785][121949] Avg episode reward: [(0, '6238.159'), (1, '5736.768')] [2023-12-26 10:51:49,101][123091] Updated weights for policy 0, policy_version 1411418 (0.0009) [2023-12-26 10:51:49,148][123090] Updated weights for policy 1, policy_version 1401861 (0.0009) [2023-12-26 10:51:49,168][123091] Updated weights for policy 0, policy_version 1411428 (0.0008) [2023-12-26 10:51:49,215][123090] Updated weights for policy 1, policy_version 1401871 (0.0009) [2023-12-26 10:51:49,231][123091] Updated weights for policy 0, policy_version 1411438 (0.0009) [2023-12-26 10:51:49,289][123090] Updated weights for policy 1, policy_version 1401881 (0.0007) [2023-12-26 10:51:50,021][123090] Updated weights for policy 1, policy_version 1401891 (0.0007) [2023-12-26 10:51:50,077][123090] Updated weights for policy 1, policy_version 1401901 (0.0008) [2023-12-26 10:51:50,082][123091] Updated weights for policy 0, policy_version 1411448 (0.0007) [2023-12-26 10:51:50,140][123090] Updated weights for policy 1, policy_version 1401911 (0.0010) [2023-12-26 10:51:50,145][123091] Updated weights for policy 0, policy_version 1411458 (0.0008) [2023-12-26 10:51:50,219][123091] Updated weights for policy 0, policy_version 1411468 (0.0006) [2023-12-26 10:51:50,844][123091] Updated weights for policy 0, policy_version 1411478 (0.0007) [2023-12-26 10:51:50,910][123091] Updated weights for policy 0, policy_version 1411488 (0.0008) [2023-12-26 10:51:50,948][123090] Updated weights for policy 1, policy_version 1401921 (0.0009) [2023-12-26 10:51:50,974][123091] Updated weights for policy 0, policy_version 1411498 (0.0009) [2023-12-26 10:51:51,004][123090] Updated weights for policy 1, policy_version 1401931 (0.0008) [2023-12-26 10:51:51,077][123090] Updated weights for policy 1, policy_version 1401941 (0.0009) [2023-12-26 10:51:51,154][123090] Updated weights for policy 1, policy_version 1401951 (0.0009) [2023-12-26 10:51:51,788][123091] Updated weights for policy 0, policy_version 1411508 (0.0009) [2023-12-26 10:51:51,845][123091] Updated weights for policy 0, policy_version 1411518 (0.0009) [2023-12-26 10:51:51,903][123091] Updated weights for policy 0, policy_version 1411528 (0.0007) [2023-12-26 10:51:51,939][123090] Updated weights for policy 1, policy_version 1401961 (0.0009) [2023-12-26 10:51:52,008][123090] Updated weights for policy 1, policy_version 1401971 (0.0010) [2023-12-26 10:51:52,080][123090] Updated weights for policy 1, policy_version 1401981 (0.0010) [2023-12-26 10:51:52,755][123091] Updated weights for policy 0, policy_version 1411538 (0.0006) [2023-12-26 10:51:52,822][123091] Updated weights for policy 0, policy_version 1411548 (0.0006) [2023-12-26 10:51:52,889][123091] Updated weights for policy 0, policy_version 1411558 (0.0010) [2023-12-26 10:51:52,918][123090] Updated weights for policy 1, policy_version 1401991 (0.0008) [2023-12-26 10:51:52,938][123091] Updated weights for policy 0, policy_version 1411568 (0.0008) [2023-12-26 10:51:52,983][123090] Updated weights for policy 1, policy_version 1402001 (0.0009) [2023-12-26 10:51:53,045][123090] Updated weights for policy 1, policy_version 1402011 (0.0009) [2023-12-26 10:51:53,690][123091] Updated weights for policy 0, policy_version 1411578 (0.0010) [2023-12-26 10:51:53,741][123091] Updated weights for policy 0, policy_version 1411588 (0.0010) [2023-12-26 10:51:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 720281600. Throughput: 0: 9054.7, 1: 8848.0. Samples: 720265360. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:53,785][121949] Avg episode reward: [(0, '6242.936'), (1, '5525.961')] [2023-12-26 10:51:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001402016_358916096.pth... [2023-12-26 10:51:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001400992_358653952.pth [2023-12-26 10:51:53,800][123091] Updated weights for policy 0, policy_version 1411598 (0.0010) [2023-12-26 10:51:53,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001411600_361373696.pth... [2023-12-26 10:51:53,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001410544_361103360.pth [2023-12-26 10:51:53,882][123090] Updated weights for policy 1, policy_version 1402021 (0.0009) [2023-12-26 10:51:53,934][123090] Updated weights for policy 1, policy_version 1402031 (0.0009) [2023-12-26 10:51:54,013][123090] Updated weights for policy 1, policy_version 1402041 (0.0009) [2023-12-26 10:51:54,592][123091] Updated weights for policy 0, policy_version 1411608 (0.0009) [2023-12-26 10:51:54,655][123091] Updated weights for policy 0, policy_version 1411618 (0.0010) [2023-12-26 10:51:54,715][123091] Updated weights for policy 0, policy_version 1411628 (0.0010) [2023-12-26 10:51:54,834][123090] Updated weights for policy 1, policy_version 1402051 (0.0009) [2023-12-26 10:51:54,894][123090] Updated weights for policy 1, policy_version 1402062 (0.0009) [2023-12-26 10:51:54,958][123090] Updated weights for policy 1, policy_version 1402072 (0.0008) [2023-12-26 10:51:55,427][123091] Updated weights for policy 0, policy_version 1411638 (0.0009) [2023-12-26 10:51:55,480][123091] Updated weights for policy 0, policy_version 1411648 (0.0009) [2023-12-26 10:51:55,533][123091] Updated weights for policy 0, policy_version 1411660 (0.0009) [2023-12-26 10:51:55,788][123090] Updated weights for policy 1, policy_version 1402082 (0.0006) [2023-12-26 10:51:55,853][123090] Updated weights for policy 1, policy_version 1402092 (0.0009) [2023-12-26 10:51:55,910][123090] Updated weights for policy 1, policy_version 1402102 (0.0009) [2023-12-26 10:51:56,422][123091] Updated weights for policy 0, policy_version 1411670 (0.0009) [2023-12-26 10:51:56,473][123091] Updated weights for policy 0, policy_version 1411680 (0.0009) [2023-12-26 10:51:56,531][123091] Updated weights for policy 0, policy_version 1411691 (0.0010) [2023-12-26 10:51:56,597][123090] Updated weights for policy 1, policy_version 1402113 (0.0010) [2023-12-26 10:51:56,669][123090] Updated weights for policy 1, policy_version 1402123 (0.0009) [2023-12-26 10:51:56,732][123090] Updated weights for policy 1, policy_version 1402133 (0.0009) [2023-12-26 10:51:56,795][123090] Updated weights for policy 1, policy_version 1402143 (0.0008) [2023-12-26 10:51:57,392][123091] Updated weights for policy 0, policy_version 1411702 (0.0007) [2023-12-26 10:51:57,454][123091] Updated weights for policy 0, policy_version 1411712 (0.0006) [2023-12-26 10:51:57,508][123091] Updated weights for policy 0, policy_version 1411722 (0.0008) [2023-12-26 10:51:57,589][123090] Updated weights for policy 1, policy_version 1402153 (0.0009) [2023-12-26 10:51:57,645][123090] Updated weights for policy 1, policy_version 1402163 (0.0008) [2023-12-26 10:51:57,692][123090] Updated weights for policy 1, policy_version 1402173 (0.0009) [2023-12-26 10:51:58,269][123091] Updated weights for policy 0, policy_version 1411732 (0.0010) [2023-12-26 10:51:58,327][123091] Updated weights for policy 0, policy_version 1411742 (0.0010) [2023-12-26 10:51:58,396][123091] Updated weights for policy 0, policy_version 1411752 (0.0008) [2023-12-26 10:51:58,590][123090] Updated weights for policy 1, policy_version 1402183 (0.0009) [2023-12-26 10:51:58,669][123090] Updated weights for policy 1, policy_version 1402193 (0.0009) [2023-12-26 10:51:58,735][123090] Updated weights for policy 1, policy_version 1402203 (0.0010) [2023-12-26 10:51:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 720379904. Throughput: 0: 9001.2, 1: 8859.1. Samples: 720369456. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:51:58,785][121949] Avg episode reward: [(0, '6203.682'), (1, '5486.685')] [2023-12-26 10:51:59,277][123091] Updated weights for policy 0, policy_version 1411762 (0.0008) [2023-12-26 10:51:59,374][123091] Updated weights for policy 0, policy_version 1411772 (0.0009) [2023-12-26 10:51:59,433][123091] Updated weights for policy 0, policy_version 1411782 (0.0009) [2023-12-26 10:51:59,490][123091] Updated weights for policy 0, policy_version 1411792 (0.0010) [2023-12-26 10:51:59,604][123090] Updated weights for policy 1, policy_version 1402213 (0.0009) [2023-12-26 10:51:59,665][123090] Updated weights for policy 1, policy_version 1402223 (0.0010) [2023-12-26 10:51:59,730][123090] Updated weights for policy 1, policy_version 1402233 (0.0009) [2023-12-26 10:52:00,265][123091] Updated weights for policy 0, policy_version 1411802 (0.0010) [2023-12-26 10:52:00,325][123091] Updated weights for policy 0, policy_version 1411812 (0.0010) [2023-12-26 10:52:00,375][123091] Updated weights for policy 0, policy_version 1411822 (0.0008) [2023-12-26 10:52:00,611][123090] Updated weights for policy 1, policy_version 1402243 (0.0009) [2023-12-26 10:52:00,674][123090] Updated weights for policy 1, policy_version 1402253 (0.0009) [2023-12-26 10:52:00,741][123090] Updated weights for policy 1, policy_version 1402263 (0.0010) [2023-12-26 10:52:01,197][123091] Updated weights for policy 0, policy_version 1411832 (0.0008) [2023-12-26 10:52:01,249][123091] Updated weights for policy 0, policy_version 1411842 (0.0009) [2023-12-26 10:52:01,302][123091] Updated weights for policy 0, policy_version 1411852 (0.0008) [2023-12-26 10:52:01,600][123090] Updated weights for policy 1, policy_version 1402273 (0.0009) [2023-12-26 10:52:01,662][123090] Updated weights for policy 1, policy_version 1402283 (0.0009) [2023-12-26 10:52:01,732][123090] Updated weights for policy 1, policy_version 1402293 (0.0009) [2023-12-26 10:52:01,797][123090] Updated weights for policy 1, policy_version 1402303 (0.0009) [2023-12-26 10:52:02,135][123091] Updated weights for policy 0, policy_version 1411862 (0.0009) [2023-12-26 10:52:02,184][123091] Updated weights for policy 0, policy_version 1411872 (0.0009) [2023-12-26 10:52:02,231][123091] Updated weights for policy 0, policy_version 1411882 (0.0008) [2023-12-26 10:52:02,608][123090] Updated weights for policy 1, policy_version 1402313 (0.0009) [2023-12-26 10:52:02,663][123090] Updated weights for policy 1, policy_version 1402323 (0.0009) [2023-12-26 10:52:02,719][123090] Updated weights for policy 1, policy_version 1402333 (0.0009) [2023-12-26 10:52:03,108][123091] Updated weights for policy 0, policy_version 1411892 (0.0010) [2023-12-26 10:52:03,160][123091] Updated weights for policy 0, policy_version 1411902 (0.0009) [2023-12-26 10:52:03,213][123091] Updated weights for policy 0, policy_version 1411912 (0.0009) [2023-12-26 10:52:03,552][123090] Updated weights for policy 1, policy_version 1402343 (0.0010) [2023-12-26 10:52:03,612][123090] Updated weights for policy 1, policy_version 1402353 (0.0009) [2023-12-26 10:52:03,668][123090] Updated weights for policy 1, policy_version 1402363 (0.0008) [2023-12-26 10:52:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 720461824. Throughput: 0: 8874.7, 1: 8797.0. Samples: 720471324. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:03,785][121949] Avg episode reward: [(0, '6246.890'), (1, '5637.946')] [2023-12-26 10:52:04,074][123091] Updated weights for policy 0, policy_version 1411922 (0.0009) [2023-12-26 10:52:04,144][123091] Updated weights for policy 0, policy_version 1411932 (0.0010) [2023-12-26 10:52:04,219][123091] Updated weights for policy 0, policy_version 1411942 (0.0010) [2023-12-26 10:52:04,287][123091] Updated weights for policy 0, policy_version 1411952 (0.0010) [2023-12-26 10:52:04,427][123090] Updated weights for policy 1, policy_version 1402373 (0.0005) [2023-12-26 10:52:04,482][123090] Updated weights for policy 1, policy_version 1402383 (0.0005) [2023-12-26 10:52:04,541][123090] Updated weights for policy 1, policy_version 1402393 (0.0005) [2023-12-26 10:52:04,911][123091] Updated weights for policy 0, policy_version 1411962 (0.0005) [2023-12-26 10:52:04,970][123091] Updated weights for policy 0, policy_version 1411972 (0.0005) [2023-12-26 10:52:05,028][123091] Updated weights for policy 0, policy_version 1411982 (0.0006) [2023-12-26 10:52:05,355][123090] Updated weights for policy 1, policy_version 1402403 (0.0007) [2023-12-26 10:52:05,417][123090] Updated weights for policy 1, policy_version 1402413 (0.0010) [2023-12-26 10:52:05,469][123090] Updated weights for policy 1, policy_version 1402423 (0.0010) [2023-12-26 10:52:05,655][123091] Updated weights for policy 0, policy_version 1411992 (0.0010) [2023-12-26 10:52:05,699][123091] Updated weights for policy 0, policy_version 1412002 (0.0010) [2023-12-26 10:52:05,746][123091] Updated weights for policy 0, policy_version 1412012 (0.0010) [2023-12-26 10:52:06,288][123090] Updated weights for policy 1, policy_version 1402433 (0.0010) [2023-12-26 10:52:06,359][123090] Updated weights for policy 1, policy_version 1402443 (0.0005) [2023-12-26 10:52:06,431][123090] Updated weights for policy 1, policy_version 1402453 (0.0005) [2023-12-26 10:52:06,506][123090] Updated weights for policy 1, policy_version 1402463 (0.0011) [2023-12-26 10:52:06,595][123091] Updated weights for policy 0, policy_version 1412022 (0.0009) [2023-12-26 10:52:06,656][123091] Updated weights for policy 0, policy_version 1412032 (0.0009) [2023-12-26 10:52:06,728][123091] Updated weights for policy 0, policy_version 1412042 (0.0009) [2023-12-26 10:52:07,256][123090] Updated weights for policy 1, policy_version 1402473 (0.0006) [2023-12-26 10:52:07,316][123090] Updated weights for policy 1, policy_version 1402483 (0.0005) [2023-12-26 10:52:07,364][123090] Updated weights for policy 1, policy_version 1402493 (0.0005) [2023-12-26 10:52:07,601][123091] Updated weights for policy 0, policy_version 1412052 (0.0010) [2023-12-26 10:52:07,653][123091] Updated weights for policy 0, policy_version 1412062 (0.0009) [2023-12-26 10:52:07,708][123091] Updated weights for policy 0, policy_version 1412072 (0.0010) [2023-12-26 10:52:08,091][123090] Updated weights for policy 1, policy_version 1402503 (0.0005) [2023-12-26 10:52:08,154][123090] Updated weights for policy 1, policy_version 1402513 (0.0005) [2023-12-26 10:52:08,222][123090] Updated weights for policy 1, policy_version 1402523 (0.0006) [2023-12-26 10:52:08,580][123091] Updated weights for policy 0, policy_version 1412082 (0.0009) [2023-12-26 10:52:08,632][123091] Updated weights for policy 0, policy_version 1412092 (0.0009) [2023-12-26 10:52:08,688][123091] Updated weights for policy 0, policy_version 1412102 (0.0009) [2023-12-26 10:52:08,740][123091] Updated weights for policy 0, policy_version 1412112 (0.0009) [2023-12-26 10:52:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 720551936. Throughput: 0: 8914.7, 1: 8829.0. Samples: 720525480. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:08,786][121949] Avg episode reward: [(0, '6359.789'), (1, '5547.996')] [2023-12-26 10:52:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001412112_361504768.pth... [2023-12-26 10:52:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001411056_361234432.pth [2023-12-26 10:52:08,834][123090] Updated weights for policy 1, policy_version 1402533 (0.0006) [2023-12-26 10:52:08,900][123090] Updated weights for policy 1, policy_version 1402543 (0.0005) [2023-12-26 10:52:08,965][123090] Updated weights for policy 1, policy_version 1402553 (0.0008) [2023-12-26 10:52:09,002][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001402560_359055360.pth... [2023-12-26 10:52:09,005][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001401504_358785024.pth [2023-12-26 10:52:09,612][123091] Updated weights for policy 0, policy_version 1412122 (0.0011) [2023-12-26 10:52:09,661][123091] Updated weights for policy 0, policy_version 1412132 (0.0010) [2023-12-26 10:52:09,716][123091] Updated weights for policy 0, policy_version 1412142 (0.0009) [2023-12-26 10:52:09,761][123090] Updated weights for policy 1, policy_version 1402563 (0.0007) [2023-12-26 10:52:09,816][123090] Updated weights for policy 1, policy_version 1402573 (0.0010) [2023-12-26 10:52:09,874][123090] Updated weights for policy 1, policy_version 1402583 (0.0007) [2023-12-26 10:52:10,594][123091] Updated weights for policy 0, policy_version 1412152 (0.0010) [2023-12-26 10:52:10,662][123091] Updated weights for policy 0, policy_version 1412162 (0.0009) [2023-12-26 10:52:10,720][123090] Updated weights for policy 1, policy_version 1402593 (0.0009) [2023-12-26 10:52:10,721][123091] Updated weights for policy 0, policy_version 1412172 (0.0010) [2023-12-26 10:52:10,777][123090] Updated weights for policy 1, policy_version 1402603 (0.0008) [2023-12-26 10:52:10,841][123090] Updated weights for policy 1, policy_version 1402613 (0.0009) [2023-12-26 10:52:10,911][123090] Updated weights for policy 1, policy_version 1402623 (0.0010) [2023-12-26 10:52:11,582][123091] Updated weights for policy 0, policy_version 1412182 (0.0009) [2023-12-26 10:52:11,652][123091] Updated weights for policy 0, policy_version 1412192 (0.0008) [2023-12-26 10:52:11,717][123091] Updated weights for policy 0, policy_version 1412202 (0.0009) [2023-12-26 10:52:11,836][123090] Updated weights for policy 1, policy_version 1402633 (0.0010) [2023-12-26 10:52:11,899][123090] Updated weights for policy 1, policy_version 1402643 (0.0010) [2023-12-26 10:52:11,957][123090] Updated weights for policy 1, policy_version 1402653 (0.0010) [2023-12-26 10:52:12,561][123091] Updated weights for policy 0, policy_version 1412212 (0.0008) [2023-12-26 10:52:12,614][123091] Updated weights for policy 0, policy_version 1412222 (0.0007) [2023-12-26 10:52:12,667][123091] Updated weights for policy 0, policy_version 1412232 (0.0006) [2023-12-26 10:52:12,825][123090] Updated weights for policy 1, policy_version 1402663 (0.0009) [2023-12-26 10:52:12,892][123090] Updated weights for policy 1, policy_version 1402673 (0.0005) [2023-12-26 10:52:12,963][123090] Updated weights for policy 1, policy_version 1402683 (0.0005) [2023-12-26 10:52:13,410][123091] Updated weights for policy 0, policy_version 1412242 (0.0006) [2023-12-26 10:52:13,466][123091] Updated weights for policy 0, policy_version 1412252 (0.0009) [2023-12-26 10:52:13,517][123091] Updated weights for policy 0, policy_version 1412262 (0.0010) [2023-12-26 10:52:13,565][123091] Updated weights for policy 0, policy_version 1412272 (0.0009) [2023-12-26 10:52:13,683][123090] Updated weights for policy 1, policy_version 1402693 (0.0006) [2023-12-26 10:52:13,747][123090] Updated weights for policy 1, policy_version 1402703 (0.0011) [2023-12-26 10:52:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 720633856. Throughput: 0: 8830.4, 1: 8774.2. Samples: 720628484. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:13,785][121949] Avg episode reward: [(0, '6328.350'), (1, '5457.739')] [2023-12-26 10:52:13,813][123090] Updated weights for policy 1, policy_version 1402713 (0.0010) [2023-12-26 10:52:14,372][123091] Updated weights for policy 0, policy_version 1412282 (0.0009) [2023-12-26 10:52:14,443][123091] Updated weights for policy 0, policy_version 1412292 (0.0009) [2023-12-26 10:52:14,502][123091] Updated weights for policy 0, policy_version 1412302 (0.0008) [2023-12-26 10:52:14,618][123090] Updated weights for policy 1, policy_version 1402723 (0.0010) [2023-12-26 10:52:14,676][123090] Updated weights for policy 1, policy_version 1402733 (0.0010) [2023-12-26 10:52:14,747][123090] Updated weights for policy 1, policy_version 1402743 (0.0011) [2023-12-26 10:52:15,326][123091] Updated weights for policy 0, policy_version 1412312 (0.0010) [2023-12-26 10:52:15,378][123091] Updated weights for policy 0, policy_version 1412322 (0.0011) [2023-12-26 10:52:15,442][123091] Updated weights for policy 0, policy_version 1412332 (0.0011) [2023-12-26 10:52:15,573][123090] Updated weights for policy 1, policy_version 1402753 (0.0011) [2023-12-26 10:52:15,630][123090] Updated weights for policy 1, policy_version 1402763 (0.0010) [2023-12-26 10:52:15,697][123090] Updated weights for policy 1, policy_version 1402773 (0.0010) [2023-12-26 10:52:15,762][123090] Updated weights for policy 1, policy_version 1402783 (0.0009) [2023-12-26 10:52:16,169][123091] Updated weights for policy 0, policy_version 1412342 (0.0008) [2023-12-26 10:52:16,216][123091] Updated weights for policy 0, policy_version 1412352 (0.0005) [2023-12-26 10:52:16,268][123091] Updated weights for policy 0, policy_version 1412362 (0.0005) [2023-12-26 10:52:16,493][123090] Updated weights for policy 1, policy_version 1402793 (0.0010) [2023-12-26 10:52:16,548][123090] Updated weights for policy 1, policy_version 1402803 (0.0010) [2023-12-26 10:52:16,610][123090] Updated weights for policy 1, policy_version 1402813 (0.0010) [2023-12-26 10:52:16,953][123091] Updated weights for policy 0, policy_version 1412372 (0.0005) [2023-12-26 10:52:17,001][123091] Updated weights for policy 0, policy_version 1412382 (0.0005) [2023-12-26 10:52:17,069][123091] Updated weights for policy 0, policy_version 1412392 (0.0005) [2023-12-26 10:52:17,342][123090] Updated weights for policy 1, policy_version 1402823 (0.0007) [2023-12-26 10:52:17,389][123090] Updated weights for policy 1, policy_version 1402833 (0.0005) [2023-12-26 10:52:17,439][123090] Updated weights for policy 1, policy_version 1402843 (0.0005) [2023-12-26 10:52:17,733][123091] Updated weights for policy 0, policy_version 1412402 (0.0006) [2023-12-26 10:52:17,787][123091] Updated weights for policy 0, policy_version 1412412 (0.0005) [2023-12-26 10:52:17,855][123091] Updated weights for policy 0, policy_version 1412422 (0.0007) [2023-12-26 10:52:17,917][123091] Updated weights for policy 0, policy_version 1412432 (0.0008) [2023-12-26 10:52:18,177][123090] Updated weights for policy 1, policy_version 1402853 (0.0008) [2023-12-26 10:52:18,239][123090] Updated weights for policy 1, policy_version 1402863 (0.0010) [2023-12-26 10:52:18,305][123090] Updated weights for policy 1, policy_version 1402873 (0.0010) [2023-12-26 10:52:18,592][123091] Updated weights for policy 0, policy_version 1412442 (0.0011) [2023-12-26 10:52:18,660][123091] Updated weights for policy 0, policy_version 1412452 (0.0010) [2023-12-26 10:52:18,727][123091] Updated weights for policy 0, policy_version 1412462 (0.0010) [2023-12-26 10:52:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 720732160. Throughput: 0: 8892.9, 1: 8770.2. Samples: 720740684. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:18,785][121949] Avg episode reward: [(0, '6322.790'), (1, '5522.107')] [2023-12-26 10:52:19,040][123090] Updated weights for policy 1, policy_version 1402883 (0.0011) [2023-12-26 10:52:19,103][123090] Updated weights for policy 1, policy_version 1402893 (0.0010) [2023-12-26 10:52:19,166][123090] Updated weights for policy 1, policy_version 1402903 (0.0010) [2023-12-26 10:52:19,436][123091] Updated weights for policy 0, policy_version 1412472 (0.0009) [2023-12-26 10:52:19,497][123091] Updated weights for policy 0, policy_version 1412482 (0.0007) [2023-12-26 10:52:19,565][123091] Updated weights for policy 0, policy_version 1412492 (0.0006) [2023-12-26 10:52:20,030][123090] Updated weights for policy 1, policy_version 1402913 (0.0010) [2023-12-26 10:52:20,094][123090] Updated weights for policy 1, policy_version 1402923 (0.0011) [2023-12-26 10:52:20,156][123090] Updated weights for policy 1, policy_version 1402933 (0.0011) [2023-12-26 10:52:20,220][123090] Updated weights for policy 1, policy_version 1402943 (0.0011) [2023-12-26 10:52:20,388][123091] Updated weights for policy 0, policy_version 1412502 (0.0007) [2023-12-26 10:52:20,441][123091] Updated weights for policy 0, policy_version 1412512 (0.0009) [2023-12-26 10:52:20,500][123091] Updated weights for policy 0, policy_version 1412522 (0.0009) [2023-12-26 10:52:21,061][123090] Updated weights for policy 1, policy_version 1402953 (0.0009) [2023-12-26 10:52:21,128][123090] Updated weights for policy 1, policy_version 1402963 (0.0011) [2023-12-26 10:52:21,196][123090] Updated weights for policy 1, policy_version 1402973 (0.0006) [2023-12-26 10:52:21,372][123091] Updated weights for policy 0, policy_version 1412532 (0.0007) [2023-12-26 10:52:21,446][123091] Updated weights for policy 0, policy_version 1412542 (0.0009) [2023-12-26 10:52:21,507][123091] Updated weights for policy 0, policy_version 1412552 (0.0010) [2023-12-26 10:52:21,992][123090] Updated weights for policy 1, policy_version 1402983 (0.0008) [2023-12-26 10:52:22,056][123090] Updated weights for policy 1, policy_version 1402993 (0.0010) [2023-12-26 10:52:22,112][123090] Updated weights for policy 1, policy_version 1403003 (0.0010) [2023-12-26 10:52:22,351][123091] Updated weights for policy 0, policy_version 1412562 (0.0009) [2023-12-26 10:52:22,417][123091] Updated weights for policy 0, policy_version 1412572 (0.0010) [2023-12-26 10:52:22,477][123091] Updated weights for policy 0, policy_version 1412582 (0.0010) [2023-12-26 10:52:22,523][123091] Updated weights for policy 0, policy_version 1412592 (0.0008) [2023-12-26 10:52:23,027][123090] Updated weights for policy 1, policy_version 1403013 (0.0010) [2023-12-26 10:52:23,095][123090] Updated weights for policy 1, policy_version 1403023 (0.0009) [2023-12-26 10:52:23,159][123090] Updated weights for policy 1, policy_version 1403033 (0.0009) [2023-12-26 10:52:23,342][123091] Updated weights for policy 0, policy_version 1412602 (0.0010) [2023-12-26 10:52:23,401][123091] Updated weights for policy 0, policy_version 1412612 (0.0010) [2023-12-26 10:52:23,471][123091] Updated weights for policy 0, policy_version 1412622 (0.0008) [2023-12-26 10:52:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 720814080. Throughput: 0: 8855.0, 1: 8775.5. Samples: 720792332. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:23,785][121949] Avg episode reward: [(0, '6363.295'), (1, '5394.761')] [2023-12-26 10:52:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001412624_361635840.pth... [2023-12-26 10:52:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001403040_359178240.pth... [2023-12-26 10:52:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001402016_358916096.pth [2023-12-26 10:52:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001411600_361373696.pth [2023-12-26 10:52:24,011][123090] Updated weights for policy 1, policy_version 1403043 (0.0008) [2023-12-26 10:52:24,058][123090] Updated weights for policy 1, policy_version 1403053 (0.0005) [2023-12-26 10:52:24,104][123090] Updated weights for policy 1, policy_version 1403063 (0.0007) [2023-12-26 10:52:24,288][123091] Updated weights for policy 0, policy_version 1412632 (0.0010) [2023-12-26 10:52:24,340][123091] Updated weights for policy 0, policy_version 1412643 (0.0009) [2023-12-26 10:52:24,407][123091] Updated weights for policy 0, policy_version 1412653 (0.0009) [2023-12-26 10:52:24,953][123090] Updated weights for policy 1, policy_version 1403073 (0.0009) [2023-12-26 10:52:25,019][123090] Updated weights for policy 1, policy_version 1403083 (0.0009) [2023-12-26 10:52:25,083][123090] Updated weights for policy 1, policy_version 1403093 (0.0006) [2023-12-26 10:52:25,150][123090] Updated weights for policy 1, policy_version 1403103 (0.0005) [2023-12-26 10:52:25,230][123091] Updated weights for policy 0, policy_version 1412663 (0.0007) [2023-12-26 10:52:25,294][123091] Updated weights for policy 0, policy_version 1412673 (0.0006) [2023-12-26 10:52:25,356][123091] Updated weights for policy 0, policy_version 1412683 (0.0006) [2023-12-26 10:52:25,874][123090] Updated weights for policy 1, policy_version 1403113 (0.0009) [2023-12-26 10:52:25,933][123090] Updated weights for policy 1, policy_version 1403123 (0.0007) [2023-12-26 10:52:25,998][123090] Updated weights for policy 1, policy_version 1403133 (0.0008) [2023-12-26 10:52:26,134][123091] Updated weights for policy 0, policy_version 1412693 (0.0011) [2023-12-26 10:52:26,194][123091] Updated weights for policy 0, policy_version 1412703 (0.0006) [2023-12-26 10:52:26,245][123091] Updated weights for policy 0, policy_version 1412713 (0.0005) [2023-12-26 10:52:26,855][123090] Updated weights for policy 1, policy_version 1403143 (0.0009) [2023-12-26 10:52:26,900][123091] Updated weights for policy 0, policy_version 1412723 (0.0005) [2023-12-26 10:52:26,921][123090] Updated weights for policy 1, policy_version 1403153 (0.0009) [2023-12-26 10:52:26,951][123091] Updated weights for policy 0, policy_version 1412733 (0.0007) [2023-12-26 10:52:26,975][123090] Updated weights for policy 1, policy_version 1403163 (0.0007) [2023-12-26 10:52:27,003][123091] Updated weights for policy 0, policy_version 1412743 (0.0005) [2023-12-26 10:52:27,685][123091] Updated weights for policy 0, policy_version 1412753 (0.0005) [2023-12-26 10:52:27,729][123091] Updated weights for policy 0, policy_version 1412763 (0.0005) [2023-12-26 10:52:27,774][123091] Updated weights for policy 0, policy_version 1412773 (0.0005) [2023-12-26 10:52:27,820][123091] Updated weights for policy 0, policy_version 1412783 (0.0005) [2023-12-26 10:52:27,856][123090] Updated weights for policy 1, policy_version 1403173 (0.0009) [2023-12-26 10:52:27,911][123090] Updated weights for policy 1, policy_version 1403184 (0.0011) [2023-12-26 10:52:27,965][123090] Updated weights for policy 1, policy_version 1403194 (0.0009) [2023-12-26 10:52:28,484][123091] Updated weights for policy 0, policy_version 1412793 (0.0005) [2023-12-26 10:52:28,543][123091] Updated weights for policy 0, policy_version 1412803 (0.0005) [2023-12-26 10:52:28,604][123091] Updated weights for policy 0, policy_version 1412813 (0.0005) [2023-12-26 10:52:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 720904192. Throughput: 0: 8913.6, 1: 8760.0. Samples: 720897788. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:28,785][121949] Avg episode reward: [(0, '6360.747'), (1, '5341.044')] [2023-12-26 10:52:28,914][123090] Updated weights for policy 1, policy_version 1403205 (0.0010) [2023-12-26 10:52:28,968][123090] Updated weights for policy 1, policy_version 1403215 (0.0010) [2023-12-26 10:52:29,031][123090] Updated weights for policy 1, policy_version 1403225 (0.0010) [2023-12-26 10:52:29,189][123091] Updated weights for policy 0, policy_version 1412823 (0.0005) [2023-12-26 10:52:29,260][123091] Updated weights for policy 0, policy_version 1412833 (0.0007) [2023-12-26 10:52:29,335][123091] Updated weights for policy 0, policy_version 1412843 (0.0006) [2023-12-26 10:52:29,911][123090] Updated weights for policy 1, policy_version 1403235 (0.0012) [2023-12-26 10:52:29,974][123090] Updated weights for policy 1, policy_version 1403245 (0.0010) [2023-12-26 10:52:30,030][123090] Updated weights for policy 1, policy_version 1403255 (0.0009) [2023-12-26 10:52:30,083][123091] Updated weights for policy 0, policy_version 1412853 (0.0010) [2023-12-26 10:52:30,152][123091] Updated weights for policy 0, policy_version 1412863 (0.0010) [2023-12-26 10:52:30,219][123091] Updated weights for policy 0, policy_version 1412873 (0.0011) [2023-12-26 10:52:30,912][123090] Updated weights for policy 1, policy_version 1403265 (0.0009) [2023-12-26 10:52:30,957][123091] Updated weights for policy 0, policy_version 1412883 (0.0009) [2023-12-26 10:52:30,977][123090] Updated weights for policy 1, policy_version 1403275 (0.0010) [2023-12-26 10:52:31,013][123091] Updated weights for policy 0, policy_version 1412893 (0.0005) [2023-12-26 10:52:31,048][123090] Updated weights for policy 1, policy_version 1403285 (0.0009) [2023-12-26 10:52:31,081][123091] Updated weights for policy 0, policy_version 1412903 (0.0010) [2023-12-26 10:52:31,105][123090] Updated weights for policy 1, policy_version 1403295 (0.0006) [2023-12-26 10:52:31,802][123090] Updated weights for policy 1, policy_version 1403305 (0.0009) [2023-12-26 10:52:31,870][123090] Updated weights for policy 1, policy_version 1403315 (0.0008) [2023-12-26 10:52:31,883][123091] Updated weights for policy 0, policy_version 1412913 (0.0011) [2023-12-26 10:52:31,932][123090] Updated weights for policy 1, policy_version 1403325 (0.0008) [2023-12-26 10:52:31,945][123091] Updated weights for policy 0, policy_version 1412923 (0.0011) [2023-12-26 10:52:32,007][123091] Updated weights for policy 0, policy_version 1412933 (0.0011) [2023-12-26 10:52:32,067][123091] Updated weights for policy 0, policy_version 1412943 (0.0008) [2023-12-26 10:52:32,767][123091] Updated weights for policy 0, policy_version 1412953 (0.0010) [2023-12-26 10:52:32,800][123090] Updated weights for policy 1, policy_version 1403335 (0.0009) [2023-12-26 10:52:32,822][123091] Updated weights for policy 0, policy_version 1412963 (0.0010) [2023-12-26 10:52:32,858][123090] Updated weights for policy 1, policy_version 1403345 (0.0009) [2023-12-26 10:52:32,883][123091] Updated weights for policy 0, policy_version 1412973 (0.0007) [2023-12-26 10:52:32,913][123090] Updated weights for policy 1, policy_version 1403355 (0.0009) [2023-12-26 10:52:33,611][123090] Updated weights for policy 1, policy_version 1403365 (0.0007) [2023-12-26 10:52:33,686][123090] Updated weights for policy 1, policy_version 1403375 (0.0005) [2023-12-26 10:52:33,702][123091] Updated weights for policy 0, policy_version 1412983 (0.0010) [2023-12-26 10:52:33,740][123090] Updated weights for policy 1, policy_version 1403385 (0.0010) [2023-12-26 10:52:33,753][123091] Updated weights for policy 0, policy_version 1412993 (0.0010) [2023-12-26 10:52:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 720994304. Throughput: 0: 8988.0, 1: 8650.9. Samples: 721006100. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:33,784][121949] Avg episode reward: [(0, '6342.096'), (1, '5447.984')] [2023-12-26 10:52:33,803][123091] Updated weights for policy 0, policy_version 1413003 (0.0010) [2023-12-26 10:52:34,520][123090] Updated weights for policy 1, policy_version 1403395 (0.0010) [2023-12-26 10:52:34,580][123090] Updated weights for policy 1, policy_version 1403405 (0.0008) [2023-12-26 10:52:34,598][123091] Updated weights for policy 0, policy_version 1413013 (0.0010) [2023-12-26 10:52:34,643][123090] Updated weights for policy 1, policy_version 1403415 (0.0008) [2023-12-26 10:52:34,665][123091] Updated weights for policy 0, policy_version 1413023 (0.0011) [2023-12-26 10:52:34,732][123091] Updated weights for policy 0, policy_version 1413033 (0.0011) [2023-12-26 10:52:35,384][123090] Updated weights for policy 1, policy_version 1403425 (0.0007) [2023-12-26 10:52:35,440][123090] Updated weights for policy 1, policy_version 1403435 (0.0005) [2023-12-26 10:52:35,485][123091] Updated weights for policy 0, policy_version 1413043 (0.0009) [2023-12-26 10:52:35,498][123090] Updated weights for policy 1, policy_version 1403445 (0.0005) [2023-12-26 10:52:35,558][123090] Updated weights for policy 1, policy_version 1403455 (0.0006) [2023-12-26 10:52:35,560][123091] Updated weights for policy 0, policy_version 1413053 (0.0007) [2023-12-26 10:52:35,622][123091] Updated weights for policy 0, policy_version 1413063 (0.0010) [2023-12-26 10:52:36,332][123090] Updated weights for policy 1, policy_version 1403465 (0.0009) [2023-12-26 10:52:36,404][123090] Updated weights for policy 1, policy_version 1403475 (0.0009) [2023-12-26 10:52:36,424][123091] Updated weights for policy 0, policy_version 1413073 (0.0010) [2023-12-26 10:52:36,474][123090] Updated weights for policy 1, policy_version 1403485 (0.0006) [2023-12-26 10:52:36,480][123091] Updated weights for policy 0, policy_version 1413083 (0.0011) [2023-12-26 10:52:36,544][123091] Updated weights for policy 0, policy_version 1413093 (0.0011) [2023-12-26 10:52:36,609][123091] Updated weights for policy 0, policy_version 1413103 (0.0010) [2023-12-26 10:52:37,325][123091] Updated weights for policy 0, policy_version 1413113 (0.0006) [2023-12-26 10:52:37,349][123090] Updated weights for policy 1, policy_version 1403495 (0.0008) [2023-12-26 10:52:37,378][123091] Updated weights for policy 0, policy_version 1413123 (0.0005) [2023-12-26 10:52:37,406][123090] Updated weights for policy 1, policy_version 1403505 (0.0008) [2023-12-26 10:52:37,433][123091] Updated weights for policy 0, policy_version 1413133 (0.0006) [2023-12-26 10:52:37,459][123090] Updated weights for policy 1, policy_version 1403515 (0.0009) [2023-12-26 10:52:38,069][123091] Updated weights for policy 0, policy_version 1413143 (0.0006) [2023-12-26 10:52:38,137][123091] Updated weights for policy 0, policy_version 1413153 (0.0005) [2023-12-26 10:52:38,200][123091] Updated weights for policy 0, policy_version 1413163 (0.0005) [2023-12-26 10:52:38,399][123090] Updated weights for policy 1, policy_version 1403525 (0.0010) [2023-12-26 10:52:38,459][123090] Updated weights for policy 1, policy_version 1403535 (0.0010) [2023-12-26 10:52:38,521][123090] Updated weights for policy 1, policy_version 1403545 (0.0010) [2023-12-26 10:52:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 721084416. Throughput: 0: 8986.4, 1: 8658.1. Samples: 721059364. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:38,785][121949] Avg episode reward: [(0, '6376.604'), (1, '5310.485')] [2023-12-26 10:52:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001413168_361775104.pth... [2023-12-26 10:52:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001403552_359309312.pth... [2023-12-26 10:52:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001412112_361504768.pth [2023-12-26 10:52:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001402560_359055360.pth [2023-12-26 10:52:38,843][123091] Updated weights for policy 0, policy_version 1413173 (0.0008) [2023-12-26 10:52:38,904][123091] Updated weights for policy 0, policy_version 1413183 (0.0011) [2023-12-26 10:52:38,971][123091] Updated weights for policy 0, policy_version 1413193 (0.0011) [2023-12-26 10:52:39,300][123090] Updated weights for policy 1, policy_version 1403555 (0.0010) [2023-12-26 10:52:39,373][123090] Updated weights for policy 1, policy_version 1403565 (0.0010) [2023-12-26 10:52:39,453][123090] Updated weights for policy 1, policy_version 1403575 (0.0009) [2023-12-26 10:52:39,798][123091] Updated weights for policy 0, policy_version 1413203 (0.0010) [2023-12-26 10:52:39,867][123091] Updated weights for policy 0, policy_version 1413213 (0.0009) [2023-12-26 10:52:39,938][123091] Updated weights for policy 0, policy_version 1413223 (0.0009) [2023-12-26 10:52:40,273][123090] Updated weights for policy 1, policy_version 1403585 (0.0011) [2023-12-26 10:52:40,333][123090] Updated weights for policy 1, policy_version 1403595 (0.0009) [2023-12-26 10:52:40,396][123090] Updated weights for policy 1, policy_version 1403605 (0.0006) [2023-12-26 10:52:40,461][123090] Updated weights for policy 1, policy_version 1403615 (0.0007) [2023-12-26 10:52:40,768][123091] Updated weights for policy 0, policy_version 1413233 (0.0010) [2023-12-26 10:52:40,822][123091] Updated weights for policy 0, policy_version 1413244 (0.0010) [2023-12-26 10:52:40,876][123091] Updated weights for policy 0, policy_version 1413254 (0.0009) [2023-12-26 10:52:40,934][123091] Updated weights for policy 0, policy_version 1413264 (0.0009) [2023-12-26 10:52:41,254][123090] Updated weights for policy 1, policy_version 1403625 (0.0009) [2023-12-26 10:52:41,318][123090] Updated weights for policy 1, policy_version 1403635 (0.0010) [2023-12-26 10:52:41,393][123090] Updated weights for policy 1, policy_version 1403645 (0.0009) [2023-12-26 10:52:41,829][123091] Updated weights for policy 0, policy_version 1413274 (0.0010) [2023-12-26 10:52:41,891][123091] Updated weights for policy 0, policy_version 1413284 (0.0009) [2023-12-26 10:52:41,953][123091] Updated weights for policy 0, policy_version 1413294 (0.0010) [2023-12-26 10:52:42,210][123090] Updated weights for policy 1, policy_version 1403655 (0.0010) [2023-12-26 10:52:42,270][123090] Updated weights for policy 1, policy_version 1403665 (0.0009) [2023-12-26 10:52:42,326][123090] Updated weights for policy 1, policy_version 1403675 (0.0009) [2023-12-26 10:52:42,740][123091] Updated weights for policy 0, policy_version 1413304 (0.0006) [2023-12-26 10:52:42,810][123091] Updated weights for policy 0, policy_version 1413314 (0.0011) [2023-12-26 10:52:42,879][123091] Updated weights for policy 0, policy_version 1413324 (0.0008) [2023-12-26 10:52:43,156][123090] Updated weights for policy 1, policy_version 1403685 (0.0008) [2023-12-26 10:52:43,220][123090] Updated weights for policy 1, policy_version 1403695 (0.0005) [2023-12-26 10:52:43,289][123090] Updated weights for policy 1, policy_version 1403705 (0.0005) [2023-12-26 10:52:43,585][123091] Updated weights for policy 0, policy_version 1413334 (0.0007) [2023-12-26 10:52:43,638][123091] Updated weights for policy 0, policy_version 1413344 (0.0005) [2023-12-26 10:52:43,691][123091] Updated weights for policy 0, policy_version 1413354 (0.0006) [2023-12-26 10:52:43,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 721174528. Throughput: 0: 9036.4, 1: 8615.5. Samples: 721163796. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:43,785][121949] Avg episode reward: [(0, '6287.830'), (1, '5323.012')] [2023-12-26 10:52:43,955][123090] Updated weights for policy 1, policy_version 1403715 (0.0005) [2023-12-26 10:52:44,012][123090] Updated weights for policy 1, policy_version 1403725 (0.0005) [2023-12-26 10:52:44,067][123090] Updated weights for policy 1, policy_version 1403735 (0.0006) [2023-12-26 10:52:44,381][123091] Updated weights for policy 0, policy_version 1413364 (0.0005) [2023-12-26 10:52:44,431][123091] Updated weights for policy 0, policy_version 1413374 (0.0006) [2023-12-26 10:52:44,492][123091] Updated weights for policy 0, policy_version 1413384 (0.0005) [2023-12-26 10:52:44,732][123090] Updated weights for policy 1, policy_version 1403745 (0.0007) [2023-12-26 10:52:44,801][123090] Updated weights for policy 1, policy_version 1403755 (0.0009) [2023-12-26 10:52:44,868][123090] Updated weights for policy 1, policy_version 1403765 (0.0010) [2023-12-26 10:52:44,921][123090] Updated weights for policy 1, policy_version 1403775 (0.0006) [2023-12-26 10:52:45,264][123091] Updated weights for policy 0, policy_version 1413394 (0.0006) [2023-12-26 10:52:45,328][123091] Updated weights for policy 0, policy_version 1413404 (0.0010) [2023-12-26 10:52:45,393][123091] Updated weights for policy 0, policy_version 1413414 (0.0010) [2023-12-26 10:52:45,462][123091] Updated weights for policy 0, policy_version 1413424 (0.0010) [2023-12-26 10:52:45,762][123090] Updated weights for policy 1, policy_version 1403785 (0.0006) [2023-12-26 10:52:45,828][123090] Updated weights for policy 1, policy_version 1403795 (0.0006) [2023-12-26 10:52:45,886][123090] Updated weights for policy 1, policy_version 1403805 (0.0009) [2023-12-26 10:52:46,311][123091] Updated weights for policy 0, policy_version 1413434 (0.0011) [2023-12-26 10:52:46,363][123091] Updated weights for policy 0, policy_version 1413444 (0.0005) [2023-12-26 10:52:46,421][123091] Updated weights for policy 0, policy_version 1413454 (0.0006) [2023-12-26 10:52:46,608][123090] Updated weights for policy 1, policy_version 1403815 (0.0006) [2023-12-26 10:52:46,677][123090] Updated weights for policy 1, policy_version 1403825 (0.0005) [2023-12-26 10:52:46,751][123090] Updated weights for policy 1, policy_version 1403835 (0.0005) [2023-12-26 10:52:47,128][123091] Updated weights for policy 0, policy_version 1413464 (0.0006) [2023-12-26 10:52:47,197][123091] Updated weights for policy 0, policy_version 1413474 (0.0008) [2023-12-26 10:52:47,264][123091] Updated weights for policy 0, policy_version 1413484 (0.0007) [2023-12-26 10:52:47,427][123090] Updated weights for policy 1, policy_version 1403845 (0.0008) [2023-12-26 10:52:47,476][123090] Updated weights for policy 1, policy_version 1403855 (0.0005) [2023-12-26 10:52:47,538][123090] Updated weights for policy 1, policy_version 1403865 (0.0005) [2023-12-26 10:52:47,871][123091] Updated weights for policy 0, policy_version 1413494 (0.0007) [2023-12-26 10:52:47,932][123091] Updated weights for policy 0, policy_version 1413504 (0.0009) [2023-12-26 10:52:47,994][123091] Updated weights for policy 0, policy_version 1413514 (0.0010) [2023-12-26 10:52:48,213][123090] Updated weights for policy 1, policy_version 1403875 (0.0007) [2023-12-26 10:52:48,264][123090] Updated weights for policy 1, policy_version 1403885 (0.0010) [2023-12-26 10:52:48,320][123090] Updated weights for policy 1, policy_version 1403895 (0.0010) [2023-12-26 10:52:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 721264640. Throughput: 0: 9120.6, 1: 8797.7. Samples: 721277648. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:48,784][121949] Avg episode reward: [(0, '6161.616'), (1, '5453.786')] [2023-12-26 10:52:48,857][123091] Updated weights for policy 0, policy_version 1413524 (0.0010) [2023-12-26 10:52:48,922][123091] Updated weights for policy 0, policy_version 1413534 (0.0009) [2023-12-26 10:52:48,970][123091] Updated weights for policy 0, policy_version 1413544 (0.0009) [2023-12-26 10:52:49,179][123090] Updated weights for policy 1, policy_version 1403905 (0.0010) [2023-12-26 10:52:49,251][123090] Updated weights for policy 1, policy_version 1403915 (0.0010) [2023-12-26 10:52:49,312][123090] Updated weights for policy 1, policy_version 1403925 (0.0008) [2023-12-26 10:52:49,387][123090] Updated weights for policy 1, policy_version 1403935 (0.0013) [2023-12-26 10:52:49,891][123091] Updated weights for policy 0, policy_version 1413554 (0.0008) [2023-12-26 10:52:49,956][123091] Updated weights for policy 0, policy_version 1413564 (0.0010) [2023-12-26 10:52:50,011][123091] Updated weights for policy 0, policy_version 1413574 (0.0010) [2023-12-26 10:52:50,084][123091] Updated weights for policy 0, policy_version 1413584 (0.0009) [2023-12-26 10:52:50,187][123090] Updated weights for policy 1, policy_version 1403945 (0.0007) [2023-12-26 10:52:50,251][123090] Updated weights for policy 1, policy_version 1403955 (0.0009) [2023-12-26 10:52:50,322][123090] Updated weights for policy 1, policy_version 1403965 (0.0005) [2023-12-26 10:52:50,874][123091] Updated weights for policy 0, policy_version 1413594 (0.0006) [2023-12-26 10:52:50,955][123091] Updated weights for policy 0, policy_version 1413604 (0.0007) [2023-12-26 10:52:51,023][123091] Updated weights for policy 0, policy_version 1413614 (0.0009) [2023-12-26 10:52:51,093][123090] Updated weights for policy 1, policy_version 1403975 (0.0009) [2023-12-26 10:52:51,159][123090] Updated weights for policy 1, policy_version 1403985 (0.0010) [2023-12-26 10:52:51,223][123090] Updated weights for policy 1, policy_version 1403995 (0.0011) [2023-12-26 10:52:51,743][123091] Updated weights for policy 0, policy_version 1413624 (0.0009) [2023-12-26 10:52:51,806][123091] Updated weights for policy 0, policy_version 1413634 (0.0009) [2023-12-26 10:52:51,858][123091] Updated weights for policy 0, policy_version 1413644 (0.0011) [2023-12-26 10:52:52,113][123090] Updated weights for policy 1, policy_version 1404005 (0.0008) [2023-12-26 10:52:52,181][123090] Updated weights for policy 1, policy_version 1404015 (0.0011) [2023-12-26 10:52:52,244][123090] Updated weights for policy 1, policy_version 1404025 (0.0010) [2023-12-26 10:52:52,721][123091] Updated weights for policy 0, policy_version 1413654 (0.0010) [2023-12-26 10:52:52,769][123091] Updated weights for policy 0, policy_version 1413664 (0.0009) [2023-12-26 10:52:52,814][123091] Updated weights for policy 0, policy_version 1413674 (0.0010) [2023-12-26 10:52:53,053][123090] Updated weights for policy 1, policy_version 1404035 (0.0009) [2023-12-26 10:52:53,120][123090] Updated weights for policy 1, policy_version 1404045 (0.0005) [2023-12-26 10:52:53,168][123090] Updated weights for policy 1, policy_version 1404055 (0.0005) [2023-12-26 10:52:53,608][123091] Updated weights for policy 0, policy_version 1413684 (0.0008) [2023-12-26 10:52:53,687][123091] Updated weights for policy 0, policy_version 1413694 (0.0007) [2023-12-26 10:52:53,755][123091] Updated weights for policy 0, policy_version 1413704 (0.0010) [2023-12-26 10:52:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 721346560. Throughput: 0: 9079.7, 1: 8788.5. Samples: 721329548. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:53,785][121949] Avg episode reward: [(0, '6149.469'), (1, '5103.121')] [2023-12-26 10:52:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001404064_359440384.pth... [2023-12-26 10:52:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001403040_359178240.pth [2023-12-26 10:52:53,802][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001413712_361914368.pth... [2023-12-26 10:52:53,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001412624_361635840.pth [2023-12-26 10:52:53,918][123090] Updated weights for policy 1, policy_version 1404065 (0.0008) [2023-12-26 10:52:53,977][123090] Updated weights for policy 1, policy_version 1404075 (0.0006) [2023-12-26 10:52:54,031][123090] Updated weights for policy 1, policy_version 1404085 (0.0006) [2023-12-26 10:52:54,082][123090] Updated weights for policy 1, policy_version 1404095 (0.0005) [2023-12-26 10:52:54,569][123091] Updated weights for policy 0, policy_version 1413714 (0.0010) [2023-12-26 10:52:54,637][123091] Updated weights for policy 0, policy_version 1413724 (0.0010) [2023-12-26 10:52:54,692][123091] Updated weights for policy 0, policy_version 1413734 (0.0009) [2023-12-26 10:52:54,752][123091] Updated weights for policy 0, policy_version 1413744 (0.0009) [2023-12-26 10:52:54,827][123090] Updated weights for policy 1, policy_version 1404105 (0.0009) [2023-12-26 10:52:54,882][123090] Updated weights for policy 1, policy_version 1404115 (0.0005) [2023-12-26 10:52:54,941][123090] Updated weights for policy 1, policy_version 1404125 (0.0006) [2023-12-26 10:52:55,561][123091] Updated weights for policy 0, policy_version 1413754 (0.0009) [2023-12-26 10:52:55,609][123091] Updated weights for policy 0, policy_version 1413764 (0.0008) [2023-12-26 10:52:55,657][123091] Updated weights for policy 0, policy_version 1413774 (0.0009) [2023-12-26 10:52:55,745][123090] Updated weights for policy 1, policy_version 1404135 (0.0007) [2023-12-26 10:52:55,806][123090] Updated weights for policy 1, policy_version 1404145 (0.0006) [2023-12-26 10:52:55,869][123090] Updated weights for policy 1, policy_version 1404155 (0.0010) [2023-12-26 10:52:56,449][123091] Updated weights for policy 0, policy_version 1413784 (0.0006) [2023-12-26 10:52:56,499][123091] Updated weights for policy 0, policy_version 1413794 (0.0005) [2023-12-26 10:52:56,515][123090] Updated weights for policy 1, policy_version 1404165 (0.0008) [2023-12-26 10:52:56,550][123091] Updated weights for policy 0, policy_version 1413804 (0.0005) [2023-12-26 10:52:56,571][123090] Updated weights for policy 1, policy_version 1404175 (0.0005) [2023-12-26 10:52:56,617][123090] Updated weights for policy 1, policy_version 1404185 (0.0005) [2023-12-26 10:52:57,281][123090] Updated weights for policy 1, policy_version 1404195 (0.0005) [2023-12-26 10:52:57,295][123091] Updated weights for policy 0, policy_version 1413814 (0.0005) [2023-12-26 10:52:57,337][123090] Updated weights for policy 1, policy_version 1404205 (0.0009) [2023-12-26 10:52:57,350][123091] Updated weights for policy 0, policy_version 1413824 (0.0007) [2023-12-26 10:52:57,394][123090] Updated weights for policy 1, policy_version 1404215 (0.0007) [2023-12-26 10:52:57,408][123091] Updated weights for policy 0, policy_version 1413834 (0.0009) [2023-12-26 10:52:58,174][123090] Updated weights for policy 1, policy_version 1404225 (0.0006) [2023-12-26 10:52:58,191][123091] Updated weights for policy 0, policy_version 1413844 (0.0009) [2023-12-26 10:52:58,231][123090] Updated weights for policy 1, policy_version 1404235 (0.0009) [2023-12-26 10:52:58,252][123091] Updated weights for policy 0, policy_version 1413854 (0.0009) [2023-12-26 10:52:58,293][123090] Updated weights for policy 1, policy_version 1404245 (0.0006) [2023-12-26 10:52:58,319][123091] Updated weights for policy 0, policy_version 1413864 (0.0010) [2023-12-26 10:52:58,362][123090] Updated weights for policy 1, policy_version 1404255 (0.0008) [2023-12-26 10:52:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 721444864. Throughput: 0: 9171.7, 1: 8850.2. Samples: 721439464. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:52:58,785][121949] Avg episode reward: [(0, '6214.352'), (1, '4862.602')] [2023-12-26 10:52:59,219][123091] Updated weights for policy 0, policy_version 1413874 (0.0010) [2023-12-26 10:52:59,279][123090] Updated weights for policy 1, policy_version 1404265 (0.0008) [2023-12-26 10:52:59,293][123091] Updated weights for policy 0, policy_version 1413884 (0.0011) [2023-12-26 10:52:59,347][123090] Updated weights for policy 1, policy_version 1404275 (0.0008) [2023-12-26 10:52:59,359][123091] Updated weights for policy 0, policy_version 1413894 (0.0011) [2023-12-26 10:52:59,406][123090] Updated weights for policy 1, policy_version 1404285 (0.0006) [2023-12-26 10:52:59,411][123091] Updated weights for policy 0, policy_version 1413904 (0.0005) [2023-12-26 10:53:00,117][123091] Updated weights for policy 0, policy_version 1413914 (0.0011) [2023-12-26 10:53:00,173][123091] Updated weights for policy 0, policy_version 1413924 (0.0011) [2023-12-26 10:53:00,232][123091] Updated weights for policy 0, policy_version 1413934 (0.0010) [2023-12-26 10:53:00,240][123090] Updated weights for policy 1, policy_version 1404295 (0.0007) [2023-12-26 10:53:00,287][123090] Updated weights for policy 1, policy_version 1404305 (0.0008) [2023-12-26 10:53:00,337][123090] Updated weights for policy 1, policy_version 1404315 (0.0008) [2023-12-26 10:53:00,980][123091] Updated weights for policy 0, policy_version 1413944 (0.0005) [2023-12-26 10:53:01,031][123091] Updated weights for policy 0, policy_version 1413954 (0.0006) [2023-12-26 10:53:01,099][123091] Updated weights for policy 0, policy_version 1413964 (0.0008) [2023-12-26 10:53:01,142][123090] Updated weights for policy 1, policy_version 1404325 (0.0010) [2023-12-26 10:53:01,211][123090] Updated weights for policy 1, policy_version 1404335 (0.0010) [2023-12-26 10:53:01,269][123090] Updated weights for policy 1, policy_version 1404345 (0.0009) [2023-12-26 10:53:01,948][123091] Updated weights for policy 0, policy_version 1413974 (0.0006) [2023-12-26 10:53:02,013][123091] Updated weights for policy 0, policy_version 1413984 (0.0005) [2023-12-26 10:53:02,072][123091] Updated weights for policy 0, policy_version 1413994 (0.0005) [2023-12-26 10:53:02,134][123090] Updated weights for policy 1, policy_version 1404355 (0.0010) [2023-12-26 10:53:02,194][123090] Updated weights for policy 1, policy_version 1404365 (0.0010) [2023-12-26 10:53:02,260][123090] Updated weights for policy 1, policy_version 1404375 (0.0009) [2023-12-26 10:53:02,754][123091] Updated weights for policy 0, policy_version 1414004 (0.0005) [2023-12-26 10:53:02,800][123091] Updated weights for policy 0, policy_version 1414014 (0.0007) [2023-12-26 10:53:02,847][123091] Updated weights for policy 0, policy_version 1414024 (0.0010) [2023-12-26 10:53:03,051][123090] Updated weights for policy 1, policy_version 1404385 (0.0011) [2023-12-26 10:53:03,109][123090] Updated weights for policy 1, policy_version 1404395 (0.0009) [2023-12-26 10:53:03,166][123090] Updated weights for policy 1, policy_version 1404405 (0.0005) [2023-12-26 10:53:03,229][123090] Updated weights for policy 1, policy_version 1404415 (0.0005) [2023-12-26 10:53:03,632][123091] Updated weights for policy 0, policy_version 1414034 (0.0010) [2023-12-26 10:53:03,700][123091] Updated weights for policy 0, policy_version 1414044 (0.0010) [2023-12-26 10:53:03,764][123091] Updated weights for policy 0, policy_version 1414054 (0.0010) [2023-12-26 10:53:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 721526784. Throughput: 0: 9095.7, 1: 8803.7. Samples: 721546160. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:03,785][121949] Avg episode reward: [(0, '6304.158'), (1, '4967.636')] [2023-12-26 10:53:03,813][123091] Updated weights for policy 0, policy_version 1414064 (0.0010) [2023-12-26 10:53:03,859][123090] Updated weights for policy 1, policy_version 1404425 (0.0007) [2023-12-26 10:53:03,920][123090] Updated weights for policy 1, policy_version 1404435 (0.0005) [2023-12-26 10:53:03,981][123090] Updated weights for policy 1, policy_version 1404445 (0.0008) [2023-12-26 10:53:04,461][123091] Updated weights for policy 0, policy_version 1414074 (0.0007) [2023-12-26 10:53:04,521][123091] Updated weights for policy 0, policy_version 1414084 (0.0007) [2023-12-26 10:53:04,572][123091] Updated weights for policy 0, policy_version 1414094 (0.0009) [2023-12-26 10:53:04,643][123090] Updated weights for policy 1, policy_version 1404455 (0.0008) [2023-12-26 10:53:04,700][123090] Updated weights for policy 1, policy_version 1404465 (0.0009) [2023-12-26 10:53:04,761][123090] Updated weights for policy 1, policy_version 1404475 (0.0009) [2023-12-26 10:53:05,387][123091] Updated weights for policy 0, policy_version 1414104 (0.0006) [2023-12-26 10:53:05,442][123091] Updated weights for policy 0, policy_version 1414114 (0.0009) [2023-12-26 10:53:05,504][123091] Updated weights for policy 0, policy_version 1414124 (0.0011) [2023-12-26 10:53:05,550][123090] Updated weights for policy 1, policy_version 1404485 (0.0007) [2023-12-26 10:53:05,595][123090] Updated weights for policy 1, policy_version 1404495 (0.0008) [2023-12-26 10:53:05,644][123090] Updated weights for policy 1, policy_version 1404505 (0.0009) [2023-12-26 10:53:06,246][123091] Updated weights for policy 0, policy_version 1414134 (0.0009) [2023-12-26 10:53:06,301][123090] Updated weights for policy 1, policy_version 1404515 (0.0008) [2023-12-26 10:53:06,313][123091] Updated weights for policy 0, policy_version 1414144 (0.0008) [2023-12-26 10:53:06,357][123090] Updated weights for policy 1, policy_version 1404525 (0.0007) [2023-12-26 10:53:06,376][123091] Updated weights for policy 0, policy_version 1414154 (0.0008) [2023-12-26 10:53:06,418][123090] Updated weights for policy 1, policy_version 1404535 (0.0006) [2023-12-26 10:53:07,144][123091] Updated weights for policy 0, policy_version 1414164 (0.0009) [2023-12-26 10:53:07,205][123090] Updated weights for policy 1, policy_version 1404545 (0.0006) [2023-12-26 10:53:07,213][123091] Updated weights for policy 0, policy_version 1414174 (0.0011) [2023-12-26 10:53:07,268][123090] Updated weights for policy 1, policy_version 1404555 (0.0008) [2023-12-26 10:53:07,270][123091] Updated weights for policy 0, policy_version 1414184 (0.0009) [2023-12-26 10:53:07,333][123090] Updated weights for policy 1, policy_version 1404565 (0.0008) [2023-12-26 10:53:07,397][123090] Updated weights for policy 1, policy_version 1404575 (0.0009) [2023-12-26 10:53:08,024][123091] Updated weights for policy 0, policy_version 1414194 (0.0010) [2023-12-26 10:53:08,087][123091] Updated weights for policy 0, policy_version 1414204 (0.0009) [2023-12-26 10:53:08,151][123091] Updated weights for policy 0, policy_version 1414214 (0.0009) [2023-12-26 10:53:08,200][123091] Updated weights for policy 0, policy_version 1414224 (0.0009) [2023-12-26 10:53:08,269][123090] Updated weights for policy 1, policy_version 1404585 (0.0008) [2023-12-26 10:53:08,355][123090] Updated weights for policy 1, policy_version 1404595 (0.0010) [2023-12-26 10:53:08,411][123090] Updated weights for policy 1, policy_version 1404605 (0.0010) [2023-12-26 10:53:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 721625088. Throughput: 0: 9131.4, 1: 8860.8. Samples: 721601980. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:08,785][121949] Avg episode reward: [(0, '6315.145'), (1, '4849.126')] [2023-12-26 10:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001414224_362045440.pth... [2023-12-26 10:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001404608_359579648.pth... [2023-12-26 10:53:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001413168_361775104.pth [2023-12-26 10:53:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001403552_359309312.pth [2023-12-26 10:53:09,038][123091] Updated weights for policy 0, policy_version 1414234 (0.0009) [2023-12-26 10:53:09,113][123091] Updated weights for policy 0, policy_version 1414244 (0.0007) [2023-12-26 10:53:09,178][123091] Updated weights for policy 0, policy_version 1414254 (0.0010) [2023-12-26 10:53:09,242][123090] Updated weights for policy 1, policy_version 1404615 (0.0009) [2023-12-26 10:53:09,296][123090] Updated weights for policy 1, policy_version 1404625 (0.0009) [2023-12-26 10:53:09,372][123090] Updated weights for policy 1, policy_version 1404635 (0.0010) [2023-12-26 10:53:09,947][123091] Updated weights for policy 0, policy_version 1414264 (0.0008) [2023-12-26 10:53:10,009][123091] Updated weights for policy 0, policy_version 1414274 (0.0008) [2023-12-26 10:53:10,076][123091] Updated weights for policy 0, policy_version 1414284 (0.0008) [2023-12-26 10:53:10,184][123090] Updated weights for policy 1, policy_version 1404645 (0.0009) [2023-12-26 10:53:10,252][123090] Updated weights for policy 1, policy_version 1404655 (0.0009) [2023-12-26 10:53:10,316][123090] Updated weights for policy 1, policy_version 1404665 (0.0009) [2023-12-26 10:53:10,907][123091] Updated weights for policy 0, policy_version 1414294 (0.0009) [2023-12-26 10:53:10,963][123091] Updated weights for policy 0, policy_version 1414304 (0.0009) [2023-12-26 10:53:11,028][123091] Updated weights for policy 0, policy_version 1414314 (0.0010) [2023-12-26 10:53:11,096][123090] Updated weights for policy 1, policy_version 1404675 (0.0010) [2023-12-26 10:53:11,163][123090] Updated weights for policy 1, policy_version 1404685 (0.0010) [2023-12-26 10:53:11,240][123090] Updated weights for policy 1, policy_version 1404695 (0.0006) [2023-12-26 10:53:11,969][123091] Updated weights for policy 0, policy_version 1414324 (0.0009) [2023-12-26 10:53:12,034][123091] Updated weights for policy 0, policy_version 1414334 (0.0010) [2023-12-26 10:53:12,071][123090] Updated weights for policy 1, policy_version 1404705 (0.0011) [2023-12-26 10:53:12,105][123091] Updated weights for policy 0, policy_version 1414344 (0.0008) [2023-12-26 10:53:12,135][123090] Updated weights for policy 1, policy_version 1404715 (0.0007) [2023-12-26 10:53:12,201][123090] Updated weights for policy 1, policy_version 1404725 (0.0006) [2023-12-26 10:53:12,273][123090] Updated weights for policy 1, policy_version 1404735 (0.0010) [2023-12-26 10:53:12,871][123091] Updated weights for policy 0, policy_version 1414354 (0.0008) [2023-12-26 10:53:12,930][123091] Updated weights for policy 0, policy_version 1414364 (0.0005) [2023-12-26 10:53:12,986][123091] Updated weights for policy 0, policy_version 1414374 (0.0005) [2023-12-26 10:53:13,039][123090] Updated weights for policy 1, policy_version 1404745 (0.0006) [2023-12-26 10:53:13,051][123091] Updated weights for policy 0, policy_version 1414384 (0.0008) [2023-12-26 10:53:13,111][123090] Updated weights for policy 1, policy_version 1404755 (0.0006) [2023-12-26 10:53:13,186][123090] Updated weights for policy 1, policy_version 1404765 (0.0006) [2023-12-26 10:53:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 721707008. Throughput: 0: 9066.2, 1: 8862.9. Samples: 721704592. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:13,785][121949] Avg episode reward: [(0, '6329.354'), (1, '5070.558')] [2023-12-26 10:53:13,815][123090] Updated weights for policy 1, policy_version 1404775 (0.0006) [2023-12-26 10:53:13,881][123091] Updated weights for policy 0, policy_version 1414394 (0.0007) [2023-12-26 10:53:13,881][123090] Updated weights for policy 1, policy_version 1404785 (0.0006) [2023-12-26 10:53:13,935][123090] Updated weights for policy 1, policy_version 1404795 (0.0006) [2023-12-26 10:53:13,938][123091] Updated weights for policy 0, policy_version 1414404 (0.0008) [2023-12-26 10:53:13,988][123091] Updated weights for policy 0, policy_version 1414414 (0.0009) [2023-12-26 10:53:14,609][123090] Updated weights for policy 1, policy_version 1404805 (0.0008) [2023-12-26 10:53:14,682][123090] Updated weights for policy 1, policy_version 1404815 (0.0005) [2023-12-26 10:53:14,738][123090] Updated weights for policy 1, policy_version 1404825 (0.0005) [2023-12-26 10:53:14,851][123091] Updated weights for policy 0, policy_version 1414424 (0.0008) [2023-12-26 10:53:14,916][123091] Updated weights for policy 0, policy_version 1414434 (0.0009) [2023-12-26 10:53:14,977][123091] Updated weights for policy 0, policy_version 1414444 (0.0009) [2023-12-26 10:53:15,512][123090] Updated weights for policy 1, policy_version 1404835 (0.0008) [2023-12-26 10:53:15,567][123090] Updated weights for policy 1, policy_version 1404845 (0.0010) [2023-12-26 10:53:15,619][123090] Updated weights for policy 1, policy_version 1404855 (0.0010) [2023-12-26 10:53:15,774][123091] Updated weights for policy 0, policy_version 1414454 (0.0009) [2023-12-26 10:53:15,823][123091] Updated weights for policy 0, policy_version 1414464 (0.0009) [2023-12-26 10:53:15,880][123091] Updated weights for policy 0, policy_version 1414474 (0.0009) [2023-12-26 10:53:16,458][123090] Updated weights for policy 1, policy_version 1404865 (0.0010) [2023-12-26 10:53:16,524][123090] Updated weights for policy 1, policy_version 1404875 (0.0010) [2023-12-26 10:53:16,579][123090] Updated weights for policy 1, policy_version 1404885 (0.0010) [2023-12-26 10:53:16,642][123090] Updated weights for policy 1, policy_version 1404895 (0.0010) [2023-12-26 10:53:16,745][123091] Updated weights for policy 0, policy_version 1414484 (0.0009) [2023-12-26 10:53:16,811][123091] Updated weights for policy 0, policy_version 1414494 (0.0010) [2023-12-26 10:53:16,864][123091] Updated weights for policy 0, policy_version 1414504 (0.0010) [2023-12-26 10:53:17,336][123090] Updated weights for policy 1, policy_version 1404905 (0.0008) [2023-12-26 10:53:17,391][123090] Updated weights for policy 1, policy_version 1404915 (0.0010) [2023-12-26 10:53:17,442][123090] Updated weights for policy 1, policy_version 1404925 (0.0010) [2023-12-26 10:53:17,770][123091] Updated weights for policy 0, policy_version 1414514 (0.0010) [2023-12-26 10:53:17,824][123091] Updated weights for policy 0, policy_version 1414524 (0.0009) [2023-12-26 10:53:17,878][123091] Updated weights for policy 0, policy_version 1414535 (0.0009) [2023-12-26 10:53:18,200][123090] Updated weights for policy 1, policy_version 1404935 (0.0009) [2023-12-26 10:53:18,269][123090] Updated weights for policy 1, policy_version 1404945 (0.0006) [2023-12-26 10:53:18,328][123090] Updated weights for policy 1, policy_version 1404955 (0.0006) [2023-12-26 10:53:18,775][123091] Updated weights for policy 0, policy_version 1414545 (0.0009) [2023-12-26 10:53:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 721797120. Throughput: 0: 8901.1, 1: 9010.8. Samples: 721812136. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:18,785][121949] Avg episode reward: [(0, '6349.702'), (1, '5309.615')] [2023-12-26 10:53:18,829][123091] Updated weights for policy 0, policy_version 1414555 (0.0010) [2023-12-26 10:53:18,885][123091] Updated weights for policy 0, policy_version 1414565 (0.0009) [2023-12-26 10:53:18,934][123091] Updated weights for policy 0, policy_version 1414575 (0.0009) [2023-12-26 10:53:19,053][123090] Updated weights for policy 1, policy_version 1404965 (0.0009) [2023-12-26 10:53:19,115][123090] Updated weights for policy 1, policy_version 1404975 (0.0010) [2023-12-26 10:53:19,175][123090] Updated weights for policy 1, policy_version 1404985 (0.0010) [2023-12-26 10:53:19,819][123091] Updated weights for policy 0, policy_version 1414585 (0.0008) [2023-12-26 10:53:19,885][123091] Updated weights for policy 0, policy_version 1414595 (0.0010) [2023-12-26 10:53:19,954][123091] Updated weights for policy 0, policy_version 1414606 (0.0010) [2023-12-26 10:53:20,000][123090] Updated weights for policy 1, policy_version 1404995 (0.0009) [2023-12-26 10:53:20,071][123090] Updated weights for policy 1, policy_version 1405005 (0.0005) [2023-12-26 10:53:20,137][123090] Updated weights for policy 1, policy_version 1405015 (0.0005) [2023-12-26 10:53:20,783][123091] Updated weights for policy 0, policy_version 1414616 (0.0007) [2023-12-26 10:53:20,851][123091] Updated weights for policy 0, policy_version 1414626 (0.0008) [2023-12-26 10:53:20,865][123090] Updated weights for policy 1, policy_version 1405025 (0.0005) [2023-12-26 10:53:20,918][123091] Updated weights for policy 0, policy_version 1414636 (0.0009) [2023-12-26 10:53:20,936][123090] Updated weights for policy 1, policy_version 1405035 (0.0006) [2023-12-26 10:53:21,005][123090] Updated weights for policy 1, policy_version 1405045 (0.0006) [2023-12-26 10:53:21,084][123090] Updated weights for policy 1, policy_version 1405055 (0.0007) [2023-12-26 10:53:21,787][123091] Updated weights for policy 0, policy_version 1414646 (0.0009) [2023-12-26 10:53:21,850][123091] Updated weights for policy 0, policy_version 1414656 (0.0009) [2023-12-26 10:53:21,883][123090] Updated weights for policy 1, policy_version 1405065 (0.0009) [2023-12-26 10:53:21,916][123091] Updated weights for policy 0, policy_version 1414666 (0.0009) [2023-12-26 10:53:21,951][123090] Updated weights for policy 1, policy_version 1405075 (0.0007) [2023-12-26 10:53:22,017][123090] Updated weights for policy 1, policy_version 1405085 (0.0009) [2023-12-26 10:53:22,785][123091] Updated weights for policy 0, policy_version 1414676 (0.0009) [2023-12-26 10:53:22,827][123090] Updated weights for policy 1, policy_version 1405095 (0.0010) [2023-12-26 10:53:22,839][123091] Updated weights for policy 0, policy_version 1414686 (0.0007) [2023-12-26 10:53:22,892][123090] Updated weights for policy 1, policy_version 1405105 (0.0011) [2023-12-26 10:53:22,905][123091] Updated weights for policy 0, policy_version 1414696 (0.0009) [2023-12-26 10:53:22,961][123090] Updated weights for policy 1, policy_version 1405115 (0.0011) [2023-12-26 10:53:23,650][123090] Updated weights for policy 1, policy_version 1405125 (0.0008) [2023-12-26 10:53:23,700][123090] Updated weights for policy 1, policy_version 1405135 (0.0005) [2023-12-26 10:53:23,760][123090] Updated weights for policy 1, policy_version 1405145 (0.0009) [2023-12-26 10:53:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 721879040. Throughput: 0: 8859.5, 1: 9018.4. Samples: 721863868. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:23,785][121949] Avg episode reward: [(0, '6307.564'), (1, '5156.064')] [2023-12-26 10:53:23,812][123091] Updated weights for policy 0, policy_version 1414706 (0.0010) [2023-12-26 10:53:23,812][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001405152_359718912.pth... [2023-12-26 10:53:23,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001404064_359440384.pth [2023-12-26 10:53:23,877][123091] Updated weights for policy 0, policy_version 1414716 (0.0008) [2023-12-26 10:53:23,942][123091] Updated weights for policy 0, policy_version 1414726 (0.0005) [2023-12-26 10:53:24,004][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001414736_362176512.pth... [2023-12-26 10:53:24,004][123091] Updated weights for policy 0, policy_version 1414736 (0.0005) [2023-12-26 10:53:24,007][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001413712_361914368.pth [2023-12-26 10:53:24,577][123090] Updated weights for policy 1, policy_version 1405155 (0.0008) [2023-12-26 10:53:24,638][123090] Updated weights for policy 1, policy_version 1405165 (0.0009) [2023-12-26 10:53:24,702][123090] Updated weights for policy 1, policy_version 1405175 (0.0009) [2023-12-26 10:53:24,745][123091] Updated weights for policy 0, policy_version 1414746 (0.0006) [2023-12-26 10:53:24,825][123091] Updated weights for policy 0, policy_version 1414756 (0.0005) [2023-12-26 10:53:24,893][123091] Updated weights for policy 0, policy_version 1414766 (0.0008) [2023-12-26 10:53:25,571][123091] Updated weights for policy 0, policy_version 1414776 (0.0006) [2023-12-26 10:53:25,573][123090] Updated weights for policy 1, policy_version 1405185 (0.0009) [2023-12-26 10:53:25,622][123091] Updated weights for policy 0, policy_version 1414786 (0.0006) [2023-12-26 10:53:25,642][123090] Updated weights for policy 1, policy_version 1405195 (0.0008) [2023-12-26 10:53:25,666][123091] Updated weights for policy 0, policy_version 1414796 (0.0010) [2023-12-26 10:53:25,694][123090] Updated weights for policy 1, policy_version 1405205 (0.0006) [2023-12-26 10:53:25,755][123090] Updated weights for policy 1, policy_version 1405215 (0.0005) [2023-12-26 10:53:26,483][123091] Updated weights for policy 0, policy_version 1414806 (0.0011) [2023-12-26 10:53:26,534][123091] Updated weights for policy 0, policy_version 1414816 (0.0010) [2023-12-26 10:53:26,552][123090] Updated weights for policy 1, policy_version 1405225 (0.0007) [2023-12-26 10:53:26,586][123091] Updated weights for policy 0, policy_version 1414826 (0.0010) [2023-12-26 10:53:26,606][123090] Updated weights for policy 1, policy_version 1405235 (0.0008) [2023-12-26 10:53:26,664][123090] Updated weights for policy 1, policy_version 1405245 (0.0008) [2023-12-26 10:53:27,336][123091] Updated weights for policy 0, policy_version 1414836 (0.0008) [2023-12-26 10:53:27,388][123091] Updated weights for policy 0, policy_version 1414846 (0.0005) [2023-12-26 10:53:27,440][123091] Updated weights for policy 0, policy_version 1414856 (0.0005) [2023-12-26 10:53:27,468][123090] Updated weights for policy 1, policy_version 1405255 (0.0006) [2023-12-26 10:53:27,520][123090] Updated weights for policy 1, policy_version 1405265 (0.0005) [2023-12-26 10:53:27,565][123090] Updated weights for policy 1, policy_version 1405275 (0.0005) [2023-12-26 10:53:28,118][123091] Updated weights for policy 0, policy_version 1414866 (0.0006) [2023-12-26 10:53:28,176][123091] Updated weights for policy 0, policy_version 1414876 (0.0010) [2023-12-26 10:53:28,190][123090] Updated weights for policy 1, policy_version 1405285 (0.0005) [2023-12-26 10:53:28,226][123091] Updated weights for policy 0, policy_version 1414886 (0.0010) [2023-12-26 10:53:28,240][123090] Updated weights for policy 1, policy_version 1405295 (0.0005) [2023-12-26 10:53:28,281][123091] Updated weights for policy 0, policy_version 1414896 (0.0010) [2023-12-26 10:53:28,291][123090] Updated weights for policy 1, policy_version 1405305 (0.0005) [2023-12-26 10:53:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 721977344. Throughput: 0: 8833.9, 1: 9073.0. Samples: 721969604. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 10:53:28,784][121949] Avg episode reward: [(0, '6331.485'), (1, '4509.783')] [2023-12-26 10:53:28,950][123090] Updated weights for policy 1, policy_version 1405315 (0.0006) [2023-12-26 10:53:29,007][123090] Updated weights for policy 1, policy_version 1405325 (0.0009) [2023-12-26 10:53:29,029][123091] Updated weights for policy 0, policy_version 1414906 (0.0005) [2023-12-26 10:53:29,074][123090] Updated weights for policy 1, policy_version 1405335 (0.0006) [2023-12-26 10:53:29,089][123091] Updated weights for policy 0, policy_version 1414916 (0.0005) [2023-12-26 10:53:29,153][123091] Updated weights for policy 0, policy_version 1414926 (0.0005) [2023-12-26 10:53:29,794][123090] Updated weights for policy 1, policy_version 1405345 (0.0005) [2023-12-26 10:53:29,833][123091] Updated weights for policy 0, policy_version 1414936 (0.0006) [2023-12-26 10:53:29,859][123090] Updated weights for policy 1, policy_version 1405355 (0.0007) [2023-12-26 10:53:29,900][123091] Updated weights for policy 0, policy_version 1414946 (0.0007) [2023-12-26 10:53:29,907][123090] Updated weights for policy 1, policy_version 1405365 (0.0008) [2023-12-26 10:53:29,971][123091] Updated weights for policy 0, policy_version 1414956 (0.0008) [2023-12-26 10:53:29,976][123090] Updated weights for policy 1, policy_version 1405375 (0.0008) [2023-12-26 10:53:30,604][123091] Updated weights for policy 0, policy_version 1414966 (0.0006) [2023-12-26 10:53:30,665][123091] Updated weights for policy 0, policy_version 1414976 (0.0005) [2023-12-26 10:53:30,716][123090] Updated weights for policy 1, policy_version 1405385 (0.0006) [2023-12-26 10:53:30,734][123091] Updated weights for policy 0, policy_version 1414986 (0.0007) [2023-12-26 10:53:30,777][123090] Updated weights for policy 1, policy_version 1405395 (0.0005) [2023-12-26 10:53:30,824][123090] Updated weights for policy 1, policy_version 1405405 (0.0008) [2023-12-26 10:53:31,510][123091] Updated weights for policy 0, policy_version 1414996 (0.0008) [2023-12-26 10:53:31,573][123091] Updated weights for policy 0, policy_version 1415006 (0.0006) [2023-12-26 10:53:31,646][123091] Updated weights for policy 0, policy_version 1415016 (0.0007) [2023-12-26 10:53:31,679][123090] Updated weights for policy 1, policy_version 1405415 (0.0008) [2023-12-26 10:53:31,755][123090] Updated weights for policy 1, policy_version 1405425 (0.0007) [2023-12-26 10:53:31,826][123090] Updated weights for policy 1, policy_version 1405435 (0.0007) [2023-12-26 10:53:32,431][123091] Updated weights for policy 0, policy_version 1415026 (0.0009) [2023-12-26 10:53:32,502][123091] Updated weights for policy 0, policy_version 1415036 (0.0009) [2023-12-26 10:53:32,561][123091] Updated weights for policy 0, policy_version 1415046 (0.0010) [2023-12-26 10:53:32,610][123090] Updated weights for policy 1, policy_version 1405445 (0.0007) [2023-12-26 10:53:32,627][123091] Updated weights for policy 0, policy_version 1415056 (0.0009) [2023-12-26 10:53:32,677][123090] Updated weights for policy 1, policy_version 1405455 (0.0005) [2023-12-26 10:53:32,731][123090] Updated weights for policy 1, policy_version 1405465 (0.0009) [2023-12-26 10:53:33,329][123091] Updated weights for policy 0, policy_version 1415066 (0.0008) [2023-12-26 10:53:33,377][123091] Updated weights for policy 0, policy_version 1415076 (0.0009) [2023-12-26 10:53:33,440][123091] Updated weights for policy 0, policy_version 1415086 (0.0009) [2023-12-26 10:53:33,521][123090] Updated weights for policy 1, policy_version 1405475 (0.0009) [2023-12-26 10:53:33,577][123090] Updated weights for policy 1, policy_version 1405485 (0.0007) [2023-12-26 10:53:33,631][123090] Updated weights for policy 1, policy_version 1405495 (0.0005) [2023-12-26 10:53:33,784][121949] Fps is (10 sec: 19661.0, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 722075648. Throughput: 0: 8848.7, 1: 9046.5. Samples: 722082932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:33,785][121949] Avg episode reward: [(0, '6380.330'), (1, '4242.769')] [2023-12-26 10:53:34,129][123091] Updated weights for policy 0, policy_version 1415096 (0.0011) [2023-12-26 10:53:34,199][123091] Updated weights for policy 0, policy_version 1415106 (0.0011) [2023-12-26 10:53:34,259][123090] Updated weights for policy 1, policy_version 1405505 (0.0005) [2023-12-26 10:53:34,268][123091] Updated weights for policy 0, policy_version 1415116 (0.0008) [2023-12-26 10:53:34,324][123090] Updated weights for policy 1, policy_version 1405515 (0.0010) [2023-12-26 10:53:34,386][123090] Updated weights for policy 1, policy_version 1405525 (0.0009) [2023-12-26 10:53:34,447][123090] Updated weights for policy 1, policy_version 1405535 (0.0010) [2023-12-26 10:53:35,035][123091] Updated weights for policy 0, policy_version 1415126 (0.0007) [2023-12-26 10:53:35,096][123091] Updated weights for policy 0, policy_version 1415136 (0.0005) [2023-12-26 10:53:35,150][123091] Updated weights for policy 0, policy_version 1415146 (0.0008) [2023-12-26 10:53:35,328][123090] Updated weights for policy 1, policy_version 1405545 (0.0009) [2023-12-26 10:53:35,383][123090] Updated weights for policy 1, policy_version 1405556 (0.0010) [2023-12-26 10:53:35,438][123090] Updated weights for policy 1, policy_version 1405566 (0.0010) [2023-12-26 10:53:35,865][123091] Updated weights for policy 0, policy_version 1415156 (0.0010) [2023-12-26 10:53:35,918][123091] Updated weights for policy 0, policy_version 1415167 (0.0010) [2023-12-26 10:53:35,972][123091] Updated weights for policy 0, policy_version 1415178 (0.0010) [2023-12-26 10:53:36,252][123090] Updated weights for policy 1, policy_version 1405576 (0.0010) [2023-12-26 10:53:36,302][123090] Updated weights for policy 1, policy_version 1405586 (0.0010) [2023-12-26 10:53:36,354][123090] Updated weights for policy 1, policy_version 1405596 (0.0010) [2023-12-26 10:53:36,862][123091] Updated weights for policy 0, policy_version 1415188 (0.0010) [2023-12-26 10:53:36,925][123091] Updated weights for policy 0, policy_version 1415198 (0.0007) [2023-12-26 10:53:36,971][123091] Updated weights for policy 0, policy_version 1415208 (0.0005) [2023-12-26 10:53:37,277][123090] Updated weights for policy 1, policy_version 1405606 (0.0010) [2023-12-26 10:53:37,341][123090] Updated weights for policy 1, policy_version 1405616 (0.0011) [2023-12-26 10:53:37,406][123090] Updated weights for policy 1, policy_version 1405626 (0.0005) [2023-12-26 10:53:37,648][123091] Updated weights for policy 0, policy_version 1415218 (0.0005) [2023-12-26 10:53:37,704][123091] Updated weights for policy 0, policy_version 1415228 (0.0006) [2023-12-26 10:53:37,763][123091] Updated weights for policy 0, policy_version 1415238 (0.0005) [2023-12-26 10:53:37,823][123091] Updated weights for policy 0, policy_version 1415248 (0.0005) [2023-12-26 10:53:38,102][123090] Updated weights for policy 1, policy_version 1405636 (0.0005) [2023-12-26 10:53:38,153][123090] Updated weights for policy 1, policy_version 1405646 (0.0005) [2023-12-26 10:53:38,206][123090] Updated weights for policy 1, policy_version 1405656 (0.0005) [2023-12-26 10:53:38,597][123091] Updated weights for policy 0, policy_version 1415258 (0.0011) [2023-12-26 10:53:38,660][123091] Updated weights for policy 0, policy_version 1415268 (0.0011) [2023-12-26 10:53:38,724][123091] Updated weights for policy 0, policy_version 1415278 (0.0010) [2023-12-26 10:53:38,784][121949] Fps is (10 sec: 18841.1, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 722165760. Throughput: 0: 8892.4, 1: 9061.8. Samples: 722137488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:38,785][121949] Avg episode reward: [(0, '6275.067'), (1, '4663.151')] [2023-12-26 10:53:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001415280_362315776.pth... [2023-12-26 10:53:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001405664_359849984.pth... [2023-12-26 10:53:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001414224_362045440.pth [2023-12-26 10:53:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001404608_359579648.pth [2023-12-26 10:53:39,025][123090] Updated weights for policy 1, policy_version 1405666 (0.0009) [2023-12-26 10:53:39,087][123090] Updated weights for policy 1, policy_version 1405676 (0.0007) [2023-12-26 10:53:39,140][123090] Updated weights for policy 1, policy_version 1405686 (0.0007) [2023-12-26 10:53:39,188][123090] Updated weights for policy 1, policy_version 1405696 (0.0010) [2023-12-26 10:53:39,515][123091] Updated weights for policy 0, policy_version 1415288 (0.0010) [2023-12-26 10:53:39,570][123091] Updated weights for policy 0, policy_version 1415298 (0.0011) [2023-12-26 10:53:39,631][123091] Updated weights for policy 0, policy_version 1415308 (0.0011) [2023-12-26 10:53:40,014][123090] Updated weights for policy 1, policy_version 1405706 (0.0007) [2023-12-26 10:53:40,085][123090] Updated weights for policy 1, policy_version 1405716 (0.0006) [2023-12-26 10:53:40,151][123090] Updated weights for policy 1, policy_version 1405726 (0.0011) [2023-12-26 10:53:40,451][123091] Updated weights for policy 0, policy_version 1415318 (0.0008) [2023-12-26 10:53:40,516][123091] Updated weights for policy 0, policy_version 1415328 (0.0009) [2023-12-26 10:53:40,581][123091] Updated weights for policy 0, policy_version 1415338 (0.0009) [2023-12-26 10:53:40,936][123090] Updated weights for policy 1, policy_version 1405736 (0.0010) [2023-12-26 10:53:40,984][123090] Updated weights for policy 1, policy_version 1405746 (0.0010) [2023-12-26 10:53:41,036][123090] Updated weights for policy 1, policy_version 1405756 (0.0010) [2023-12-26 10:53:41,448][123091] Updated weights for policy 0, policy_version 1415348 (0.0009) [2023-12-26 10:53:41,509][123091] Updated weights for policy 0, policy_version 1415358 (0.0008) [2023-12-26 10:53:41,562][123091] Updated weights for policy 0, policy_version 1415368 (0.0009) [2023-12-26 10:53:41,921][123090] Updated weights for policy 1, policy_version 1405766 (0.0010) [2023-12-26 10:53:41,992][123090] Updated weights for policy 1, policy_version 1405776 (0.0010) [2023-12-26 10:53:42,058][123090] Updated weights for policy 1, policy_version 1405786 (0.0009) [2023-12-26 10:53:42,435][123091] Updated weights for policy 0, policy_version 1415378 (0.0008) [2023-12-26 10:53:42,490][123091] Updated weights for policy 0, policy_version 1415388 (0.0006) [2023-12-26 10:53:42,551][123091] Updated weights for policy 0, policy_version 1415398 (0.0006) [2023-12-26 10:53:42,607][123091] Updated weights for policy 0, policy_version 1415408 (0.0006) [2023-12-26 10:53:42,912][123090] Updated weights for policy 1, policy_version 1405796 (0.0007) [2023-12-26 10:53:42,977][123090] Updated weights for policy 1, policy_version 1405806 (0.0005) [2023-12-26 10:53:43,053][123090] Updated weights for policy 1, policy_version 1405816 (0.0005) [2023-12-26 10:53:43,462][123091] Updated weights for policy 0, policy_version 1415418 (0.0005) [2023-12-26 10:53:43,519][123091] Updated weights for policy 0, policy_version 1415428 (0.0005) [2023-12-26 10:53:43,585][123091] Updated weights for policy 0, policy_version 1415438 (0.0005) [2023-12-26 10:53:43,781][123090] Updated weights for policy 1, policy_version 1405826 (0.0005) [2023-12-26 10:53:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 722247680. Throughput: 0: 8893.0, 1: 8956.0. Samples: 722242668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:43,784][121949] Avg episode reward: [(0, '6216.321'), (1, '4988.746')] [2023-12-26 10:53:43,836][123090] Updated weights for policy 1, policy_version 1405836 (0.0005) [2023-12-26 10:53:43,888][123090] Updated weights for policy 1, policy_version 1405846 (0.0005) [2023-12-26 10:53:43,948][123090] Updated weights for policy 1, policy_version 1405856 (0.0005) [2023-12-26 10:53:44,151][123091] Updated weights for policy 0, policy_version 1415448 (0.0005) [2023-12-26 10:53:44,208][123091] Updated weights for policy 0, policy_version 1415458 (0.0005) [2023-12-26 10:53:44,264][123091] Updated weights for policy 0, policy_version 1415468 (0.0005) [2023-12-26 10:53:44,662][123090] Updated weights for policy 1, policy_version 1405866 (0.0005) [2023-12-26 10:53:44,722][123090] Updated weights for policy 1, policy_version 1405876 (0.0006) [2023-12-26 10:53:44,796][123090] Updated weights for policy 1, policy_version 1405886 (0.0008) [2023-12-26 10:53:45,056][123091] Updated weights for policy 0, policy_version 1415478 (0.0007) [2023-12-26 10:53:45,121][123091] Updated weights for policy 0, policy_version 1415488 (0.0009) [2023-12-26 10:53:45,187][123091] Updated weights for policy 0, policy_version 1415498 (0.0009) [2023-12-26 10:53:45,609][123090] Updated weights for policy 1, policy_version 1405896 (0.0011) [2023-12-26 10:53:45,662][123090] Updated weights for policy 1, policy_version 1405906 (0.0011) [2023-12-26 10:53:45,724][123090] Updated weights for policy 1, policy_version 1405916 (0.0010) [2023-12-26 10:53:46,005][123091] Updated weights for policy 0, policy_version 1415508 (0.0008) [2023-12-26 10:53:46,056][123091] Updated weights for policy 0, policy_version 1415518 (0.0005) [2023-12-26 10:53:46,105][123091] Updated weights for policy 0, policy_version 1415528 (0.0005) [2023-12-26 10:53:46,604][123090] Updated weights for policy 1, policy_version 1405926 (0.0009) [2023-12-26 10:53:46,661][123090] Updated weights for policy 1, policy_version 1405936 (0.0010) [2023-12-26 10:53:46,717][123090] Updated weights for policy 1, policy_version 1405946 (0.0009) [2023-12-26 10:53:46,778][123091] Updated weights for policy 0, policy_version 1415538 (0.0009) [2023-12-26 10:53:46,838][123091] Updated weights for policy 0, policy_version 1415548 (0.0006) [2023-12-26 10:53:46,893][123091] Updated weights for policy 0, policy_version 1415558 (0.0005) [2023-12-26 10:53:46,946][123091] Updated weights for policy 0, policy_version 1415568 (0.0005) [2023-12-26 10:53:47,469][123090] Updated weights for policy 1, policy_version 1405956 (0.0010) [2023-12-26 10:53:47,525][123090] Updated weights for policy 1, policy_version 1405966 (0.0010) [2023-12-26 10:53:47,581][123090] Updated weights for policy 1, policy_version 1405976 (0.0009) [2023-12-26 10:53:47,655][123091] Updated weights for policy 0, policy_version 1415578 (0.0006) [2023-12-26 10:53:47,722][123091] Updated weights for policy 0, policy_version 1415588 (0.0006) [2023-12-26 10:53:47,791][123091] Updated weights for policy 0, policy_version 1415598 (0.0005) [2023-12-26 10:53:48,416][123090] Updated weights for policy 1, policy_version 1405986 (0.0009) [2023-12-26 10:53:48,474][123090] Updated weights for policy 1, policy_version 1405996 (0.0006) [2023-12-26 10:53:48,528][123090] Updated weights for policy 1, policy_version 1406006 (0.0005) [2023-12-26 10:53:48,546][123091] Updated weights for policy 0, policy_version 1415608 (0.0008) [2023-12-26 10:53:48,577][123090] Updated weights for policy 1, policy_version 1406016 (0.0006) [2023-12-26 10:53:48,607][123091] Updated weights for policy 0, policy_version 1415618 (0.0008) [2023-12-26 10:53:48,677][123091] Updated weights for policy 0, policy_version 1415628 (0.0008) [2023-12-26 10:53:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 722345984. Throughput: 0: 8926.5, 1: 8990.2. Samples: 722352408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:48,784][121949] Avg episode reward: [(0, '6206.617'), (1, '4946.227')] [2023-12-26 10:53:49,417][123090] Updated weights for policy 1, policy_version 1406026 (0.0007) [2023-12-26 10:53:49,461][123091] Updated weights for policy 0, policy_version 1415638 (0.0009) [2023-12-26 10:53:49,478][123090] Updated weights for policy 1, policy_version 1406036 (0.0007) [2023-12-26 10:53:49,528][123091] Updated weights for policy 0, policy_version 1415648 (0.0009) [2023-12-26 10:53:49,530][123090] Updated weights for policy 1, policy_version 1406046 (0.0007) [2023-12-26 10:53:49,597][123091] Updated weights for policy 0, policy_version 1415658 (0.0009) [2023-12-26 10:53:50,295][123090] Updated weights for policy 1, policy_version 1406056 (0.0010) [2023-12-26 10:53:50,373][123090] Updated weights for policy 1, policy_version 1406066 (0.0010) [2023-12-26 10:53:50,402][123091] Updated weights for policy 0, policy_version 1415668 (0.0008) [2023-12-26 10:53:50,440][123090] Updated weights for policy 1, policy_version 1406076 (0.0008) [2023-12-26 10:53:50,454][123091] Updated weights for policy 0, policy_version 1415678 (0.0006) [2023-12-26 10:53:50,508][123091] Updated weights for policy 0, policy_version 1415688 (0.0005) [2023-12-26 10:53:51,197][123090] Updated weights for policy 1, policy_version 1406086 (0.0009) [2023-12-26 10:53:51,267][123090] Updated weights for policy 1, policy_version 1406096 (0.0009) [2023-12-26 10:53:51,336][123090] Updated weights for policy 1, policy_version 1406106 (0.0009) [2023-12-26 10:53:51,403][123091] Updated weights for policy 0, policy_version 1415698 (0.0007) [2023-12-26 10:53:51,459][123091] Updated weights for policy 0, policy_version 1415708 (0.0010) [2023-12-26 10:53:51,511][123091] Updated weights for policy 0, policy_version 1415718 (0.0011) [2023-12-26 10:53:51,559][123091] Updated weights for policy 0, policy_version 1415728 (0.0010) [2023-12-26 10:53:52,169][123090] Updated weights for policy 1, policy_version 1406116 (0.0008) [2023-12-26 10:53:52,253][123090] Updated weights for policy 1, policy_version 1406126 (0.0006) [2023-12-26 10:53:52,319][123090] Updated weights for policy 1, policy_version 1406136 (0.0006) [2023-12-26 10:53:52,443][123091] Updated weights for policy 0, policy_version 1415738 (0.0007) [2023-12-26 10:53:52,503][123091] Updated weights for policy 0, policy_version 1415748 (0.0006) [2023-12-26 10:53:52,554][123091] Updated weights for policy 0, policy_version 1415758 (0.0007) [2023-12-26 10:53:53,102][123090] Updated weights for policy 1, policy_version 1406146 (0.0007) [2023-12-26 10:53:53,174][123090] Updated weights for policy 1, policy_version 1406156 (0.0005) [2023-12-26 10:53:53,245][123090] Updated weights for policy 1, policy_version 1406166 (0.0006) [2023-12-26 10:53:53,305][123091] Updated weights for policy 0, policy_version 1415768 (0.0009) [2023-12-26 10:53:53,311][123090] Updated weights for policy 1, policy_version 1406176 (0.0008) [2023-12-26 10:53:53,364][123091] Updated weights for policy 0, policy_version 1415778 (0.0008) [2023-12-26 10:53:53,413][123091] Updated weights for policy 0, policy_version 1415788 (0.0009) [2023-12-26 10:53:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 722427904. Throughput: 0: 8887.5, 1: 8933.8. Samples: 722403940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:53,785][121949] Avg episode reward: [(0, '6279.241'), (1, '4772.518')] [2023-12-26 10:53:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001415792_362446848.pth... [2023-12-26 10:53:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001406176_359981056.pth... [2023-12-26 10:53:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001414736_362176512.pth [2023-12-26 10:53:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001415792_362446848.pth [2023-12-26 10:53:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001405152_359718912.pth [2023-12-26 10:53:53,799][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001406176_359981056.pth [2023-12-26 10:53:54,038][123090] Updated weights for policy 1, policy_version 1406186 (0.0010) [2023-12-26 10:53:54,102][123090] Updated weights for policy 1, policy_version 1406196 (0.0010) [2023-12-26 10:53:54,173][123090] Updated weights for policy 1, policy_version 1406206 (0.0011) [2023-12-26 10:53:54,217][123091] Updated weights for policy 0, policy_version 1415798 (0.0010) [2023-12-26 10:53:54,277][123091] Updated weights for policy 0, policy_version 1415808 (0.0010) [2023-12-26 10:53:54,325][123091] Updated weights for policy 0, policy_version 1415818 (0.0010) [2023-12-26 10:53:54,876][123090] Updated weights for policy 1, policy_version 1406216 (0.0010) [2023-12-26 10:53:54,924][123090] Updated weights for policy 1, policy_version 1406226 (0.0010) [2023-12-26 10:53:54,990][123090] Updated weights for policy 1, policy_version 1406236 (0.0011) [2023-12-26 10:53:55,145][123091] Updated weights for policy 0, policy_version 1415828 (0.0008) [2023-12-26 10:53:55,214][123091] Updated weights for policy 0, policy_version 1415838 (0.0006) [2023-12-26 10:53:55,287][123091] Updated weights for policy 0, policy_version 1415848 (0.0010) [2023-12-26 10:53:55,736][123090] Updated weights for policy 1, policy_version 1406246 (0.0008) [2023-12-26 10:53:55,801][123090] Updated weights for policy 1, policy_version 1406256 (0.0005) [2023-12-26 10:53:55,862][123090] Updated weights for policy 1, policy_version 1406266 (0.0005) [2023-12-26 10:53:56,019][123091] Updated weights for policy 0, policy_version 1415858 (0.0009) [2023-12-26 10:53:56,074][123091] Updated weights for policy 0, policy_version 1415868 (0.0010) [2023-12-26 10:53:56,133][123091] Updated weights for policy 0, policy_version 1415878 (0.0009) [2023-12-26 10:53:56,204][123091] Updated weights for policy 0, policy_version 1415888 (0.0010) [2023-12-26 10:53:56,478][123090] Updated weights for policy 1, policy_version 1406276 (0.0005) [2023-12-26 10:53:56,556][123090] Updated weights for policy 1, policy_version 1406286 (0.0005) [2023-12-26 10:53:56,634][123090] Updated weights for policy 1, policy_version 1406296 (0.0005) [2023-12-26 10:53:56,993][123091] Updated weights for policy 0, policy_version 1415898 (0.0010) [2023-12-26 10:53:57,047][123091] Updated weights for policy 0, policy_version 1415908 (0.0010) [2023-12-26 10:53:57,099][123091] Updated weights for policy 0, policy_version 1415918 (0.0010) [2023-12-26 10:53:57,264][123090] Updated weights for policy 1, policy_version 1406306 (0.0005) [2023-12-26 10:53:57,328][123090] Updated weights for policy 1, policy_version 1406316 (0.0005) [2023-12-26 10:53:57,393][123090] Updated weights for policy 1, policy_version 1406326 (0.0005) [2023-12-26 10:53:57,460][123090] Updated weights for policy 1, policy_version 1406336 (0.0005) [2023-12-26 10:53:57,827][123091] Updated weights for policy 0, policy_version 1415928 (0.0010) [2023-12-26 10:53:57,878][123091] Updated weights for policy 0, policy_version 1415938 (0.0010) [2023-12-26 10:53:57,930][123091] Updated weights for policy 0, policy_version 1415948 (0.0007) [2023-12-26 10:53:58,060][123090] Updated weights for policy 1, policy_version 1406346 (0.0009) [2023-12-26 10:53:58,131][123090] Updated weights for policy 1, policy_version 1406356 (0.0010) [2023-12-26 10:53:58,191][123090] Updated weights for policy 1, policy_version 1406366 (0.0011) [2023-12-26 10:53:58,778][123091] Updated weights for policy 0, policy_version 1415958 (0.0007) [2023-12-26 10:53:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 722518016. Throughput: 0: 8933.8, 1: 9099.7. Samples: 722516100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:53:58,785][121949] Avg episode reward: [(0, '6265.283'), (1, '4661.712')] [2023-12-26 10:53:58,844][123091] Updated weights for policy 0, policy_version 1415968 (0.0008) [2023-12-26 10:53:58,922][123091] Updated weights for policy 0, policy_version 1415978 (0.0007) [2023-12-26 10:53:59,000][123090] Updated weights for policy 1, policy_version 1406376 (0.0006) [2023-12-26 10:53:59,065][123090] Updated weights for policy 1, policy_version 1406386 (0.0005) [2023-12-26 10:53:59,122][123090] Updated weights for policy 1, policy_version 1406396 (0.0007) [2023-12-26 10:53:59,717][123091] Updated weights for policy 0, policy_version 1415988 (0.0009) [2023-12-26 10:53:59,766][123091] Updated weights for policy 0, policy_version 1415998 (0.0009) [2023-12-26 10:53:59,816][123091] Updated weights for policy 0, policy_version 1416009 (0.0009) [2023-12-26 10:53:59,945][123090] Updated weights for policy 1, policy_version 1406406 (0.0008) [2023-12-26 10:54:00,021][123090] Updated weights for policy 1, policy_version 1406416 (0.0005) [2023-12-26 10:54:00,090][123090] Updated weights for policy 1, policy_version 1406426 (0.0006) [2023-12-26 10:54:00,633][123091] Updated weights for policy 0, policy_version 1416019 (0.0009) [2023-12-26 10:54:00,687][123091] Updated weights for policy 0, policy_version 1416029 (0.0010) [2023-12-26 10:54:00,739][123091] Updated weights for policy 0, policy_version 1416039 (0.0010) [2023-12-26 10:54:00,795][123090] Updated weights for policy 1, policy_version 1406436 (0.0007) [2023-12-26 10:54:00,845][123090] Updated weights for policy 1, policy_version 1406446 (0.0008) [2023-12-26 10:54:00,898][123090] Updated weights for policy 1, policy_version 1406456 (0.0009) [2023-12-26 10:54:01,616][123091] Updated weights for policy 0, policy_version 1416049 (0.0009) [2023-12-26 10:54:01,668][123091] Updated weights for policy 0, policy_version 1416059 (0.0009) [2023-12-26 10:54:01,721][123091] Updated weights for policy 0, policy_version 1416069 (0.0009) [2023-12-26 10:54:01,754][123090] Updated weights for policy 1, policy_version 1406466 (0.0008) [2023-12-26 10:54:01,780][123091] Updated weights for policy 0, policy_version 1416079 (0.0008) [2023-12-26 10:54:01,825][123090] Updated weights for policy 1, policy_version 1406476 (0.0007) [2023-12-26 10:54:01,882][123090] Updated weights for policy 1, policy_version 1406486 (0.0005) [2023-12-26 10:54:01,938][123090] Updated weights for policy 1, policy_version 1406496 (0.0009) [2023-12-26 10:54:02,652][123091] Updated weights for policy 0, policy_version 1416089 (0.0010) [2023-12-26 10:54:02,716][123091] Updated weights for policy 0, policy_version 1416099 (0.0008) [2023-12-26 10:54:02,736][123090] Updated weights for policy 1, policy_version 1406506 (0.0009) [2023-12-26 10:54:02,773][123091] Updated weights for policy 0, policy_version 1416109 (0.0007) [2023-12-26 10:54:02,785][123090] Updated weights for policy 1, policy_version 1406516 (0.0008) [2023-12-26 10:54:02,833][123090] Updated weights for policy 1, policy_version 1406526 (0.0008) [2023-12-26 10:54:03,584][123091] Updated weights for policy 0, policy_version 1416119 (0.0010) [2023-12-26 10:54:03,635][123091] Updated weights for policy 0, policy_version 1416129 (0.0009) [2023-12-26 10:54:03,688][123091] Updated weights for policy 0, policy_version 1416139 (0.0009) [2023-12-26 10:54:03,701][123090] Updated weights for policy 1, policy_version 1406536 (0.0008) [2023-12-26 10:54:03,756][123090] Updated weights for policy 1, policy_version 1406546 (0.0009) [2023-12-26 10:54:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 722608128. Throughput: 0: 8976.7, 1: 8999.1. Samples: 722621048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:03,784][121949] Avg episode reward: [(0, '6238.089'), (1, '4655.384')] [2023-12-26 10:54:03,810][123090] Updated weights for policy 1, policy_version 1406556 (0.0009) [2023-12-26 10:54:04,527][123091] Updated weights for policy 0, policy_version 1416149 (0.0008) [2023-12-26 10:54:04,597][123091] Updated weights for policy 0, policy_version 1416159 (0.0009) [2023-12-26 10:54:04,664][123091] Updated weights for policy 0, policy_version 1416169 (0.0010) [2023-12-26 10:54:04,676][123090] Updated weights for policy 1, policy_version 1406566 (0.0008) [2023-12-26 10:54:04,727][123090] Updated weights for policy 1, policy_version 1406576 (0.0009) [2023-12-26 10:54:04,775][123090] Updated weights for policy 1, policy_version 1406586 (0.0009) [2023-12-26 10:54:05,469][123091] Updated weights for policy 0, policy_version 1416179 (0.0007) [2023-12-26 10:54:05,529][123091] Updated weights for policy 0, policy_version 1416189 (0.0006) [2023-12-26 10:54:05,581][123091] Updated weights for policy 0, policy_version 1416199 (0.0006) [2023-12-26 10:54:05,649][123090] Updated weights for policy 1, policy_version 1406596 (0.0009) [2023-12-26 10:54:05,705][123090] Updated weights for policy 1, policy_version 1406606 (0.0010) [2023-12-26 10:54:05,761][123090] Updated weights for policy 1, policy_version 1406616 (0.0009) [2023-12-26 10:54:06,278][123091] Updated weights for policy 0, policy_version 1416209 (0.0006) [2023-12-26 10:54:06,336][123091] Updated weights for policy 0, policy_version 1416219 (0.0010) [2023-12-26 10:54:06,386][123091] Updated weights for policy 0, policy_version 1416229 (0.0009) [2023-12-26 10:54:06,441][123091] Updated weights for policy 0, policy_version 1416239 (0.0009) [2023-12-26 10:54:06,569][123090] Updated weights for policy 1, policy_version 1406626 (0.0008) [2023-12-26 10:54:06,637][123090] Updated weights for policy 1, policy_version 1406636 (0.0006) [2023-12-26 10:54:06,699][123090] Updated weights for policy 1, policy_version 1406646 (0.0005) [2023-12-26 10:54:06,774][123090] Updated weights for policy 1, policy_version 1406656 (0.0007) [2023-12-26 10:54:07,343][123091] Updated weights for policy 0, policy_version 1416249 (0.0009) [2023-12-26 10:54:07,408][123091] Updated weights for policy 0, policy_version 1416259 (0.0009) [2023-12-26 10:54:07,460][123091] Updated weights for policy 0, policy_version 1416269 (0.0010) [2023-12-26 10:54:07,498][123090] Updated weights for policy 1, policy_version 1406666 (0.0010) [2023-12-26 10:54:07,568][123090] Updated weights for policy 1, policy_version 1406676 (0.0010) [2023-12-26 10:54:07,634][123090] Updated weights for policy 1, policy_version 1406686 (0.0009) [2023-12-26 10:54:08,245][123091] Updated weights for policy 0, policy_version 1416280 (0.0009) [2023-12-26 10:54:08,298][123091] Updated weights for policy 0, policy_version 1416290 (0.0010) [2023-12-26 10:54:08,366][123091] Updated weights for policy 0, policy_version 1416300 (0.0009) [2023-12-26 10:54:08,514][123090] Updated weights for policy 1, policy_version 1406696 (0.0010) [2023-12-26 10:54:08,580][123090] Updated weights for policy 1, policy_version 1406706 (0.0009) [2023-12-26 10:54:08,646][123090] Updated weights for policy 1, policy_version 1406716 (0.0009) [2023-12-26 10:54:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 722698240. Throughput: 0: 8995.9, 1: 8968.3. Samples: 722672256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:08,785][121949] Avg episode reward: [(0, '6193.819'), (1, '4735.658')] [2023-12-26 10:54:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001406720_360120320.pth... [2023-12-26 10:54:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001416304_362577920.pth... [2023-12-26 10:54:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001415280_362315776.pth [2023-12-26 10:54:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001405664_359849984.pth [2023-12-26 10:54:09,194][123091] Updated weights for policy 0, policy_version 1416310 (0.0009) [2023-12-26 10:54:09,275][123091] Updated weights for policy 0, policy_version 1416320 (0.0010) [2023-12-26 10:54:09,336][123091] Updated weights for policy 0, policy_version 1416330 (0.0010) [2023-12-26 10:54:09,369][123090] Updated weights for policy 1, policy_version 1406726 (0.0008) [2023-12-26 10:54:09,440][123090] Updated weights for policy 1, policy_version 1406736 (0.0009) [2023-12-26 10:54:09,514][123090] Updated weights for policy 1, policy_version 1406746 (0.0007) [2023-12-26 10:54:10,086][123091] Updated weights for policy 0, policy_version 1416340 (0.0010) [2023-12-26 10:54:10,152][123091] Updated weights for policy 0, policy_version 1416350 (0.0009) [2023-12-26 10:54:10,211][123091] Updated weights for policy 0, policy_version 1416360 (0.0010) [2023-12-26 10:54:10,386][123090] Updated weights for policy 1, policy_version 1406756 (0.0009) [2023-12-26 10:54:10,445][123090] Updated weights for policy 1, policy_version 1406766 (0.0010) [2023-12-26 10:54:10,514][123090] Updated weights for policy 1, policy_version 1406776 (0.0010) [2023-12-26 10:54:11,094][123091] Updated weights for policy 0, policy_version 1416370 (0.0010) [2023-12-26 10:54:11,163][123091] Updated weights for policy 0, policy_version 1416380 (0.0010) [2023-12-26 10:54:11,224][123091] Updated weights for policy 0, policy_version 1416390 (0.0010) [2023-12-26 10:54:11,282][123091] Updated weights for policy 0, policy_version 1416400 (0.0010) [2023-12-26 10:54:11,403][123090] Updated weights for policy 1, policy_version 1406786 (0.0010) [2023-12-26 10:54:11,471][123090] Updated weights for policy 1, policy_version 1406796 (0.0010) [2023-12-26 10:54:11,524][123090] Updated weights for policy 1, policy_version 1406806 (0.0009) [2023-12-26 10:54:11,575][123090] Updated weights for policy 1, policy_version 1406816 (0.0008) [2023-12-26 10:54:12,150][123091] Updated weights for policy 0, policy_version 1416410 (0.0010) [2023-12-26 10:54:12,211][123091] Updated weights for policy 0, policy_version 1416420 (0.0009) [2023-12-26 10:54:12,276][123091] Updated weights for policy 0, policy_version 1416430 (0.0010) [2023-12-26 10:54:12,446][123090] Updated weights for policy 1, policy_version 1406826 (0.0009) [2023-12-26 10:54:12,501][123090] Updated weights for policy 1, policy_version 1406836 (0.0010) [2023-12-26 10:54:12,551][123090] Updated weights for policy 1, policy_version 1406846 (0.0009) [2023-12-26 10:54:13,055][123091] Updated weights for policy 0, policy_version 1416440 (0.0010) [2023-12-26 10:54:13,106][123091] Updated weights for policy 0, policy_version 1416450 (0.0010) [2023-12-26 10:54:13,153][123091] Updated weights for policy 0, policy_version 1416460 (0.0010) [2023-12-26 10:54:13,442][123090] Updated weights for policy 1, policy_version 1406856 (0.0007) [2023-12-26 10:54:13,503][123090] Updated weights for policy 1, policy_version 1406866 (0.0006) [2023-12-26 10:54:13,564][123090] Updated weights for policy 1, policy_version 1406876 (0.0006) [2023-12-26 10:54:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 722780160. Throughput: 0: 8935.8, 1: 8925.2. Samples: 722773352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:13,785][121949] Avg episode reward: [(0, '6284.818'), (1, '4768.175')] [2023-12-26 10:54:14,017][123091] Updated weights for policy 0, policy_version 1416470 (0.0010) [2023-12-26 10:54:14,072][123091] Updated weights for policy 0, policy_version 1416480 (0.0009) [2023-12-26 10:54:14,138][123091] Updated weights for policy 0, policy_version 1416490 (0.0009) [2023-12-26 10:54:14,244][123090] Updated weights for policy 1, policy_version 1406886 (0.0008) [2023-12-26 10:54:14,300][123090] Updated weights for policy 1, policy_version 1406896 (0.0009) [2023-12-26 10:54:14,353][123090] Updated weights for policy 1, policy_version 1406906 (0.0009) [2023-12-26 10:54:14,995][123091] Updated weights for policy 0, policy_version 1416500 (0.0010) [2023-12-26 10:54:15,056][123091] Updated weights for policy 0, policy_version 1416510 (0.0010) [2023-12-26 10:54:15,111][123091] Updated weights for policy 0, policy_version 1416520 (0.0009) [2023-12-26 10:54:15,134][123090] Updated weights for policy 1, policy_version 1406916 (0.0008) [2023-12-26 10:54:15,198][123090] Updated weights for policy 1, policy_version 1406926 (0.0006) [2023-12-26 10:54:15,267][123090] Updated weights for policy 1, policy_version 1406936 (0.0010) [2023-12-26 10:54:15,986][123091] Updated weights for policy 0, policy_version 1416530 (0.0009) [2023-12-26 10:54:16,046][123091] Updated weights for policy 0, policy_version 1416540 (0.0009) [2023-12-26 10:54:16,060][123090] Updated weights for policy 1, policy_version 1406946 (0.0010) [2023-12-26 10:54:16,106][123091] Updated weights for policy 0, policy_version 1416550 (0.0006) [2023-12-26 10:54:16,120][123090] Updated weights for policy 1, policy_version 1406956 (0.0010) [2023-12-26 10:54:16,163][123091] Updated weights for policy 0, policy_version 1416560 (0.0006) [2023-12-26 10:54:16,183][123090] Updated weights for policy 1, policy_version 1406966 (0.0010) [2023-12-26 10:54:16,251][123090] Updated weights for policy 1, policy_version 1406976 (0.0010) [2023-12-26 10:54:16,952][123091] Updated weights for policy 0, policy_version 1416570 (0.0010) [2023-12-26 10:54:17,014][123091] Updated weights for policy 0, policy_version 1416580 (0.0011) [2023-12-26 10:54:17,027][123090] Updated weights for policy 1, policy_version 1406986 (0.0007) [2023-12-26 10:54:17,074][123091] Updated weights for policy 0, policy_version 1416590 (0.0011) [2023-12-26 10:54:17,084][123090] Updated weights for policy 1, policy_version 1406996 (0.0010) [2023-12-26 10:54:17,147][123090] Updated weights for policy 1, policy_version 1407006 (0.0008) [2023-12-26 10:54:17,901][123091] Updated weights for policy 0, policy_version 1416600 (0.0006) [2023-12-26 10:54:17,965][123091] Updated weights for policy 0, policy_version 1416610 (0.0007) [2023-12-26 10:54:17,979][123090] Updated weights for policy 1, policy_version 1407016 (0.0006) [2023-12-26 10:54:18,025][123091] Updated weights for policy 0, policy_version 1416620 (0.0009) [2023-12-26 10:54:18,047][123090] Updated weights for policy 1, policy_version 1407026 (0.0006) [2023-12-26 10:54:18,101][123090] Updated weights for policy 1, policy_version 1407036 (0.0006) [2023-12-26 10:54:18,742][123090] Updated weights for policy 1, policy_version 1407046 (0.0005) [2023-12-26 10:54:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 722862080. Throughput: 0: 8824.4, 1: 8898.7. Samples: 722880468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:18,785][121949] Avg episode reward: [(0, '6269.136'), (1, '4572.534')] [2023-12-26 10:54:18,812][123091] Updated weights for policy 0, policy_version 1416630 (0.0008) [2023-12-26 10:54:18,814][123090] Updated weights for policy 1, policy_version 1407056 (0.0010) [2023-12-26 10:54:18,868][123091] Updated weights for policy 0, policy_version 1416640 (0.0006) [2023-12-26 10:54:18,878][123090] Updated weights for policy 1, policy_version 1407066 (0.0010) [2023-12-26 10:54:18,933][123091] Updated weights for policy 0, policy_version 1416650 (0.0006) [2023-12-26 10:54:19,681][123090] Updated weights for policy 1, policy_version 1407076 (0.0010) [2023-12-26 10:54:19,745][123090] Updated weights for policy 1, policy_version 1407086 (0.0009) [2023-12-26 10:54:19,781][123091] Updated weights for policy 0, policy_version 1416660 (0.0009) [2023-12-26 10:54:19,809][123090] Updated weights for policy 1, policy_version 1407096 (0.0009) [2023-12-26 10:54:19,844][123091] Updated weights for policy 0, policy_version 1416670 (0.0009) [2023-12-26 10:54:19,910][123091] Updated weights for policy 0, policy_version 1416680 (0.0008) [2023-12-26 10:54:20,608][123090] Updated weights for policy 1, policy_version 1407106 (0.0007) [2023-12-26 10:54:20,681][123090] Updated weights for policy 1, policy_version 1407116 (0.0008) [2023-12-26 10:54:20,740][123090] Updated weights for policy 1, policy_version 1407126 (0.0010) [2023-12-26 10:54:20,769][123091] Updated weights for policy 0, policy_version 1416690 (0.0007) [2023-12-26 10:54:20,808][123090] Updated weights for policy 1, policy_version 1407136 (0.0007) [2023-12-26 10:54:20,833][123091] Updated weights for policy 0, policy_version 1416700 (0.0009) [2023-12-26 10:54:20,886][123091] Updated weights for policy 0, policy_version 1416710 (0.0010) [2023-12-26 10:54:20,944][123091] Updated weights for policy 0, policy_version 1416720 (0.0010) [2023-12-26 10:54:21,518][123090] Updated weights for policy 1, policy_version 1407146 (0.0006) [2023-12-26 10:54:21,589][123090] Updated weights for policy 1, policy_version 1407156 (0.0009) [2023-12-26 10:54:21,658][123090] Updated weights for policy 1, policy_version 1407166 (0.0008) [2023-12-26 10:54:21,813][123091] Updated weights for policy 0, policy_version 1416730 (0.0010) [2023-12-26 10:54:21,881][123091] Updated weights for policy 0, policy_version 1416740 (0.0011) [2023-12-26 10:54:21,929][123091] Updated weights for policy 0, policy_version 1416750 (0.0011) [2023-12-26 10:54:22,448][123090] Updated weights for policy 1, policy_version 1407176 (0.0006) [2023-12-26 10:54:22,515][123090] Updated weights for policy 1, policy_version 1407186 (0.0005) [2023-12-26 10:54:22,582][123090] Updated weights for policy 1, policy_version 1407196 (0.0005) [2023-12-26 10:54:22,763][123091] Updated weights for policy 0, policy_version 1416760 (0.0009) [2023-12-26 10:54:22,834][123091] Updated weights for policy 0, policy_version 1416770 (0.0011) [2023-12-26 10:54:22,902][123091] Updated weights for policy 0, policy_version 1416780 (0.0011) [2023-12-26 10:54:23,338][123090] Updated weights for policy 1, policy_version 1407206 (0.0007) [2023-12-26 10:54:23,386][123090] Updated weights for policy 1, policy_version 1407216 (0.0009) [2023-12-26 10:54:23,448][123090] Updated weights for policy 1, policy_version 1407226 (0.0009) [2023-12-26 10:54:23,709][123091] Updated weights for policy 0, policy_version 1416790 (0.0010) [2023-12-26 10:54:23,776][123091] Updated weights for policy 0, policy_version 1416800 (0.0011) [2023-12-26 10:54:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 722952192. Throughput: 0: 8757.5, 1: 8888.8. Samples: 722931564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:23,785][121949] Avg episode reward: [(0, '6319.281'), (1, '4833.092')] [2023-12-26 10:54:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001407232_360251392.pth... [2023-12-26 10:54:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001406176_359981056.pth [2023-12-26 10:54:23,840][123091] Updated weights for policy 0, policy_version 1416810 (0.0011) [2023-12-26 10:54:23,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001416816_362708992.pth... [2023-12-26 10:54:23,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001415792_362446848.pth [2023-12-26 10:54:24,299][123090] Updated weights for policy 1, policy_version 1407236 (0.0009) [2023-12-26 10:54:24,364][123090] Updated weights for policy 1, policy_version 1407246 (0.0009) [2023-12-26 10:54:24,425][123090] Updated weights for policy 1, policy_version 1407256 (0.0009) [2023-12-26 10:54:24,673][123091] Updated weights for policy 0, policy_version 1416820 (0.0011) [2023-12-26 10:54:24,736][123091] Updated weights for policy 0, policy_version 1416830 (0.0011) [2023-12-26 10:54:24,800][123091] Updated weights for policy 0, policy_version 1416840 (0.0011) [2023-12-26 10:54:25,263][123090] Updated weights for policy 1, policy_version 1407266 (0.0008) [2023-12-26 10:54:25,316][123090] Updated weights for policy 1, policy_version 1407276 (0.0009) [2023-12-26 10:54:25,368][123090] Updated weights for policy 1, policy_version 1407286 (0.0008) [2023-12-26 10:54:25,430][123090] Updated weights for policy 1, policy_version 1407296 (0.0009) [2023-12-26 10:54:25,617][123091] Updated weights for policy 0, policy_version 1416850 (0.0011) [2023-12-26 10:54:25,673][123091] Updated weights for policy 0, policy_version 1416860 (0.0010) [2023-12-26 10:54:25,725][123091] Updated weights for policy 0, policy_version 1416870 (0.0010) [2023-12-26 10:54:25,799][123091] Updated weights for policy 0, policy_version 1416880 (0.0011) [2023-12-26 10:54:26,281][123090] Updated weights for policy 1, policy_version 1407306 (0.0007) [2023-12-26 10:54:26,341][123090] Updated weights for policy 1, policy_version 1407316 (0.0008) [2023-12-26 10:54:26,401][123090] Updated weights for policy 1, policy_version 1407326 (0.0008) [2023-12-26 10:54:26,625][123091] Updated weights for policy 0, policy_version 1416890 (0.0010) [2023-12-26 10:54:26,680][123091] Updated weights for policy 0, policy_version 1416900 (0.0010) [2023-12-26 10:54:26,734][123091] Updated weights for policy 0, policy_version 1416910 (0.0010) [2023-12-26 10:54:27,167][123090] Updated weights for policy 1, policy_version 1407336 (0.0006) [2023-12-26 10:54:27,238][123090] Updated weights for policy 1, policy_version 1407346 (0.0008) [2023-12-26 10:54:27,307][123090] Updated weights for policy 1, policy_version 1407356 (0.0005) [2023-12-26 10:54:27,559][123091] Updated weights for policy 0, policy_version 1416920 (0.0010) [2023-12-26 10:54:27,617][123091] Updated weights for policy 0, policy_version 1416930 (0.0010) [2023-12-26 10:54:27,669][123091] Updated weights for policy 0, policy_version 1416940 (0.0010) [2023-12-26 10:54:27,930][123090] Updated weights for policy 1, policy_version 1407366 (0.0005) [2023-12-26 10:54:27,996][123090] Updated weights for policy 1, policy_version 1407376 (0.0005) [2023-12-26 10:54:28,050][123090] Updated weights for policy 1, policy_version 1407386 (0.0005) [2023-12-26 10:54:28,509][123091] Updated weights for policy 0, policy_version 1416950 (0.0010) [2023-12-26 10:54:28,564][123091] Updated weights for policy 0, policy_version 1416960 (0.0011) [2023-12-26 10:54:28,622][123091] Updated weights for policy 0, policy_version 1416970 (0.0010) [2023-12-26 10:54:28,694][123090] Updated weights for policy 1, policy_version 1407396 (0.0005) [2023-12-26 10:54:28,756][123090] Updated weights for policy 1, policy_version 1407406 (0.0005) [2023-12-26 10:54:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 723042304. Throughput: 0: 8703.7, 1: 8919.1. Samples: 723035696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:28,785][121949] Avg episode reward: [(0, '6210.415'), (1, '5049.795')] [2023-12-26 10:54:28,830][123090] Updated weights for policy 1, policy_version 1407416 (0.0009) [2023-12-26 10:54:29,300][123091] Updated weights for policy 0, policy_version 1416980 (0.0007) [2023-12-26 10:54:29,364][123091] Updated weights for policy 0, policy_version 1416990 (0.0007) [2023-12-26 10:54:29,419][123091] Updated weights for policy 0, policy_version 1417000 (0.0006) [2023-12-26 10:54:29,625][123090] Updated weights for policy 1, policy_version 1407426 (0.0010) [2023-12-26 10:54:29,681][123090] Updated weights for policy 1, policy_version 1407436 (0.0010) [2023-12-26 10:54:29,744][123090] Updated weights for policy 1, policy_version 1407446 (0.0010) [2023-12-26 10:54:29,811][123090] Updated weights for policy 1, policy_version 1407456 (0.0010) [2023-12-26 10:54:30,225][123091] Updated weights for policy 0, policy_version 1417010 (0.0009) [2023-12-26 10:54:30,281][123091] Updated weights for policy 0, policy_version 1417020 (0.0009) [2023-12-26 10:54:30,341][123091] Updated weights for policy 0, policy_version 1417030 (0.0008) [2023-12-26 10:54:30,409][123091] Updated weights for policy 0, policy_version 1417040 (0.0009) [2023-12-26 10:54:30,648][123090] Updated weights for policy 1, policy_version 1407466 (0.0010) [2023-12-26 10:54:30,711][123090] Updated weights for policy 1, policy_version 1407476 (0.0010) [2023-12-26 10:54:30,776][123090] Updated weights for policy 1, policy_version 1407486 (0.0010) [2023-12-26 10:54:31,168][123091] Updated weights for policy 0, policy_version 1417050 (0.0009) [2023-12-26 10:54:31,218][123091] Updated weights for policy 0, policy_version 1417060 (0.0006) [2023-12-26 10:54:31,277][123091] Updated weights for policy 0, policy_version 1417070 (0.0007) [2023-12-26 10:54:31,531][123090] Updated weights for policy 1, policy_version 1407496 (0.0010) [2023-12-26 10:54:31,583][123090] Updated weights for policy 1, policy_version 1407506 (0.0010) [2023-12-26 10:54:31,647][123090] Updated weights for policy 1, policy_version 1407516 (0.0010) [2023-12-26 10:54:32,077][123091] Updated weights for policy 0, policy_version 1417080 (0.0010) [2023-12-26 10:54:32,129][123091] Updated weights for policy 0, policy_version 1417090 (0.0010) [2023-12-26 10:54:32,176][123091] Updated weights for policy 0, policy_version 1417100 (0.0010) [2023-12-26 10:54:32,472][123090] Updated weights for policy 1, policy_version 1407526 (0.0010) [2023-12-26 10:54:32,519][123090] Updated weights for policy 1, policy_version 1407536 (0.0010) [2023-12-26 10:54:32,567][123090] Updated weights for policy 1, policy_version 1407546 (0.0010) [2023-12-26 10:54:33,003][123091] Updated weights for policy 0, policy_version 1417110 (0.0011) [2023-12-26 10:54:33,067][123091] Updated weights for policy 0, policy_version 1417120 (0.0010) [2023-12-26 10:54:33,131][123091] Updated weights for policy 0, policy_version 1417130 (0.0011) [2023-12-26 10:54:33,419][123090] Updated weights for policy 1, policy_version 1407556 (0.0010) [2023-12-26 10:54:33,465][123090] Updated weights for policy 1, policy_version 1407566 (0.0010) [2023-12-26 10:54:33,508][123090] Updated weights for policy 1, policy_version 1407576 (0.0010) [2023-12-26 10:54:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 723132416. Throughput: 0: 8683.2, 1: 8904.0. Samples: 723143836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:33,785][121949] Avg episode reward: [(0, '6114.886'), (1, '5107.672')] [2023-12-26 10:54:33,935][123091] Updated weights for policy 0, policy_version 1417140 (0.0009) [2023-12-26 10:54:34,005][123091] Updated weights for policy 0, policy_version 1417150 (0.0010) [2023-12-26 10:54:34,080][123091] Updated weights for policy 0, policy_version 1417160 (0.0010) [2023-12-26 10:54:34,217][123090] Updated weights for policy 1, policy_version 1407586 (0.0010) [2023-12-26 10:54:34,280][123090] Updated weights for policy 1, policy_version 1407596 (0.0008) [2023-12-26 10:54:34,346][123090] Updated weights for policy 1, policy_version 1407606 (0.0008) [2023-12-26 10:54:34,402][123090] Updated weights for policy 1, policy_version 1407616 (0.0008) [2023-12-26 10:54:34,927][123091] Updated weights for policy 0, policy_version 1417170 (0.0009) [2023-12-26 10:54:34,986][123091] Updated weights for policy 0, policy_version 1417180 (0.0010) [2023-12-26 10:54:35,044][123091] Updated weights for policy 0, policy_version 1417190 (0.0010) [2023-12-26 10:54:35,095][123091] Updated weights for policy 0, policy_version 1417200 (0.0010) [2023-12-26 10:54:35,187][123090] Updated weights for policy 1, policy_version 1407626 (0.0006) [2023-12-26 10:54:35,248][123090] Updated weights for policy 1, policy_version 1407636 (0.0006) [2023-12-26 10:54:35,306][123090] Updated weights for policy 1, policy_version 1407646 (0.0006) [2023-12-26 10:54:35,989][123091] Updated weights for policy 0, policy_version 1417210 (0.0009) [2023-12-26 10:54:36,050][123091] Updated weights for policy 0, policy_version 1417220 (0.0007) [2023-12-26 10:54:36,064][123090] Updated weights for policy 1, policy_version 1407656 (0.0009) [2023-12-26 10:54:36,117][123091] Updated weights for policy 0, policy_version 1417230 (0.0007) [2023-12-26 10:54:36,128][123090] Updated weights for policy 1, policy_version 1407666 (0.0011) [2023-12-26 10:54:36,200][123090] Updated weights for policy 1, policy_version 1407676 (0.0011) [2023-12-26 10:54:36,823][123091] Updated weights for policy 0, policy_version 1417240 (0.0006) [2023-12-26 10:54:36,871][123091] Updated weights for policy 0, policy_version 1417250 (0.0005) [2023-12-26 10:54:36,927][123091] Updated weights for policy 0, policy_version 1417260 (0.0009) [2023-12-26 10:54:37,048][123090] Updated weights for policy 1, policy_version 1407686 (0.0009) [2023-12-26 10:54:37,115][123090] Updated weights for policy 1, policy_version 1407696 (0.0009) [2023-12-26 10:54:37,177][123090] Updated weights for policy 1, policy_version 1407706 (0.0009) [2023-12-26 10:54:37,709][123091] Updated weights for policy 0, policy_version 1417270 (0.0010) [2023-12-26 10:54:37,775][123091] Updated weights for policy 0, policy_version 1417280 (0.0010) [2023-12-26 10:54:37,829][123091] Updated weights for policy 0, policy_version 1417290 (0.0010) [2023-12-26 10:54:37,995][123090] Updated weights for policy 1, policy_version 1407716 (0.0008) [2023-12-26 10:54:38,053][123090] Updated weights for policy 1, policy_version 1407726 (0.0006) [2023-12-26 10:54:38,109][123090] Updated weights for policy 1, policy_version 1407736 (0.0005) [2023-12-26 10:54:38,711][123091] Updated weights for policy 0, policy_version 1417301 (0.0010) [2023-12-26 10:54:38,763][123091] Updated weights for policy 0, policy_version 1417311 (0.0009) [2023-12-26 10:54:38,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 723214336. Throughput: 0: 8667.0, 1: 8943.3. Samples: 723196404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:38,785][121949] Avg episode reward: [(0, '6167.020'), (1, '5270.494')] [2023-12-26 10:54:38,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001407744_360382464.pth... [2023-12-26 10:54:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001406720_360120320.pth [2023-12-26 10:54:38,825][123091] Updated weights for policy 0, policy_version 1417321 (0.0010) [2023-12-26 10:54:38,858][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001417328_362840064.pth... [2023-12-26 10:54:38,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001416304_362577920.pth [2023-12-26 10:54:38,894][123090] Updated weights for policy 1, policy_version 1407746 (0.0006) [2023-12-26 10:54:38,958][123090] Updated weights for policy 1, policy_version 1407756 (0.0009) [2023-12-26 10:54:39,010][123090] Updated weights for policy 1, policy_version 1407766 (0.0009) [2023-12-26 10:54:39,063][123090] Updated weights for policy 1, policy_version 1407776 (0.0009) [2023-12-26 10:54:39,720][123091] Updated weights for policy 0, policy_version 1417331 (0.0010) [2023-12-26 10:54:39,786][123091] Updated weights for policy 0, policy_version 1417341 (0.0010) [2023-12-26 10:54:39,857][123091] Updated weights for policy 0, policy_version 1417351 (0.0010) [2023-12-26 10:54:39,951][123090] Updated weights for policy 1, policy_version 1407786 (0.0009) [2023-12-26 10:54:40,018][123090] Updated weights for policy 1, policy_version 1407796 (0.0009) [2023-12-26 10:54:40,078][123090] Updated weights for policy 1, policy_version 1407806 (0.0008) [2023-12-26 10:54:40,729][123091] Updated weights for policy 0, policy_version 1417361 (0.0008) [2023-12-26 10:54:40,785][123091] Updated weights for policy 0, policy_version 1417371 (0.0010) [2023-12-26 10:54:40,846][123091] Updated weights for policy 0, policy_version 1417381 (0.0008) [2023-12-26 10:54:40,880][123090] Updated weights for policy 1, policy_version 1407816 (0.0009) [2023-12-26 10:54:40,900][123091] Updated weights for policy 0, policy_version 1417391 (0.0006) [2023-12-26 10:54:40,928][123090] Updated weights for policy 1, policy_version 1407826 (0.0009) [2023-12-26 10:54:40,974][123090] Updated weights for policy 1, policy_version 1407836 (0.0008) [2023-12-26 10:54:41,677][123091] Updated weights for policy 0, policy_version 1417401 (0.0008) [2023-12-26 10:54:41,741][123091] Updated weights for policy 0, policy_version 1417411 (0.0010) [2023-12-26 10:54:41,799][123091] Updated weights for policy 0, policy_version 1417421 (0.0010) [2023-12-26 10:54:41,814][123090] Updated weights for policy 1, policy_version 1407846 (0.0008) [2023-12-26 10:54:41,875][123090] Updated weights for policy 1, policy_version 1407856 (0.0009) [2023-12-26 10:54:41,936][123090] Updated weights for policy 1, policy_version 1407866 (0.0009) [2023-12-26 10:54:42,623][123091] Updated weights for policy 0, policy_version 1417431 (0.0007) [2023-12-26 10:54:42,691][123091] Updated weights for policy 0, policy_version 1417441 (0.0010) [2023-12-26 10:54:42,753][123091] Updated weights for policy 0, policy_version 1417451 (0.0010) [2023-12-26 10:54:42,767][123090] Updated weights for policy 1, policy_version 1407877 (0.0010) [2023-12-26 10:54:42,822][123090] Updated weights for policy 1, policy_version 1407887 (0.0009) [2023-12-26 10:54:42,873][123090] Updated weights for policy 1, policy_version 1407897 (0.0009) [2023-12-26 10:54:43,535][123091] Updated weights for policy 0, policy_version 1417461 (0.0006) [2023-12-26 10:54:43,601][123091] Updated weights for policy 0, policy_version 1417471 (0.0005) [2023-12-26 10:54:43,664][123091] Updated weights for policy 0, policy_version 1417481 (0.0009) [2023-12-26 10:54:43,739][123090] Updated weights for policy 1, policy_version 1407907 (0.0008) [2023-12-26 10:54:43,784][123090] Updated weights for policy 1, policy_version 1407917 (0.0005) [2023-12-26 10:54:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 723304448. Throughput: 0: 8607.6, 1: 8803.1. Samples: 723299584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:43,785][121949] Avg episode reward: [(0, '6189.382'), (1, '4879.266')] [2023-12-26 10:54:43,829][123090] Updated weights for policy 1, policy_version 1407927 (0.0005) [2023-12-26 10:54:44,454][123091] Updated weights for policy 0, policy_version 1417491 (0.0007) [2023-12-26 10:54:44,510][123091] Updated weights for policy 0, policy_version 1417501 (0.0009) [2023-12-26 10:54:44,569][123091] Updated weights for policy 0, policy_version 1417511 (0.0010) [2023-12-26 10:54:44,602][123090] Updated weights for policy 1, policy_version 1407937 (0.0006) [2023-12-26 10:54:44,670][123090] Updated weights for policy 1, policy_version 1407947 (0.0010) [2023-12-26 10:54:44,734][123090] Updated weights for policy 1, policy_version 1407957 (0.0009) [2023-12-26 10:54:44,809][123090] Updated weights for policy 1, policy_version 1407967 (0.0009) [2023-12-26 10:54:45,399][123091] Updated weights for policy 0, policy_version 1417521 (0.0008) [2023-12-26 10:54:45,466][123091] Updated weights for policy 0, policy_version 1417531 (0.0010) [2023-12-26 10:54:45,531][123091] Updated weights for policy 0, policy_version 1417541 (0.0010) [2023-12-26 10:54:45,577][123090] Updated weights for policy 1, policy_version 1407977 (0.0007) [2023-12-26 10:54:45,592][123091] Updated weights for policy 0, policy_version 1417551 (0.0010) [2023-12-26 10:54:45,642][123090] Updated weights for policy 1, policy_version 1407987 (0.0010) [2023-12-26 10:54:45,714][123090] Updated weights for policy 1, policy_version 1407997 (0.0011) [2023-12-26 10:54:46,220][123091] Updated weights for policy 0, policy_version 1417561 (0.0009) [2023-12-26 10:54:46,274][123091] Updated weights for policy 0, policy_version 1417571 (0.0010) [2023-12-26 10:54:46,333][123091] Updated weights for policy 0, policy_version 1417581 (0.0010) [2023-12-26 10:54:46,520][123090] Updated weights for policy 1, policy_version 1408007 (0.0009) [2023-12-26 10:54:46,568][123090] Updated weights for policy 1, policy_version 1408017 (0.0005) [2023-12-26 10:54:46,640][123090] Updated weights for policy 1, policy_version 1408027 (0.0006) [2023-12-26 10:54:47,187][123091] Updated weights for policy 0, policy_version 1417591 (0.0006) [2023-12-26 10:54:47,245][123091] Updated weights for policy 0, policy_version 1417601 (0.0005) [2023-12-26 10:54:47,316][123091] Updated weights for policy 0, policy_version 1417611 (0.0005) [2023-12-26 10:54:47,333][123090] Updated weights for policy 1, policy_version 1408037 (0.0008) [2023-12-26 10:54:47,384][123090] Updated weights for policy 1, policy_version 1408048 (0.0009) [2023-12-26 10:54:47,441][123090] Updated weights for policy 1, policy_version 1408058 (0.0009) [2023-12-26 10:54:47,897][123091] Updated weights for policy 0, policy_version 1417621 (0.0008) [2023-12-26 10:54:47,948][123091] Updated weights for policy 0, policy_version 1417631 (0.0010) [2023-12-26 10:54:48,003][123091] Updated weights for policy 0, policy_version 1417641 (0.0010) [2023-12-26 10:54:48,333][123090] Updated weights for policy 1, policy_version 1408069 (0.0010) [2023-12-26 10:54:48,391][123090] Updated weights for policy 1, policy_version 1408079 (0.0009) [2023-12-26 10:54:48,459][123090] Updated weights for policy 1, policy_version 1408089 (0.0007) [2023-12-26 10:54:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 723394560. Throughput: 0: 8654.1, 1: 8787.6. Samples: 723405928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:48,784][121949] Avg episode reward: [(0, '6230.686'), (1, '4600.726')] [2023-12-26 10:54:48,841][123091] Updated weights for policy 0, policy_version 1417651 (0.0010) [2023-12-26 10:54:48,897][123091] Updated weights for policy 0, policy_version 1417661 (0.0011) [2023-12-26 10:54:48,956][123091] Updated weights for policy 0, policy_version 1417671 (0.0011) [2023-12-26 10:54:49,306][123090] Updated weights for policy 1, policy_version 1408099 (0.0007) [2023-12-26 10:54:49,375][123090] Updated weights for policy 1, policy_version 1408109 (0.0010) [2023-12-26 10:54:49,433][123090] Updated weights for policy 1, policy_version 1408119 (0.0010) [2023-12-26 10:54:49,706][123091] Updated weights for policy 0, policy_version 1417681 (0.0009) [2023-12-26 10:54:49,777][123091] Updated weights for policy 0, policy_version 1417691 (0.0006) [2023-12-26 10:54:49,854][123091] Updated weights for policy 0, policy_version 1417701 (0.0007) [2023-12-26 10:54:49,921][123091] Updated weights for policy 0, policy_version 1417711 (0.0008) [2023-12-26 10:54:50,229][123090] Updated weights for policy 1, policy_version 1408129 (0.0011) [2023-12-26 10:54:50,293][123090] Updated weights for policy 1, policy_version 1408139 (0.0007) [2023-12-26 10:54:50,355][123090] Updated weights for policy 1, policy_version 1408149 (0.0010) [2023-12-26 10:54:50,417][123090] Updated weights for policy 1, policy_version 1408159 (0.0008) [2023-12-26 10:54:50,739][123091] Updated weights for policy 0, policy_version 1417721 (0.0009) [2023-12-26 10:54:50,806][123091] Updated weights for policy 0, policy_version 1417731 (0.0009) [2023-12-26 10:54:50,875][123091] Updated weights for policy 0, policy_version 1417741 (0.0010) [2023-12-26 10:54:51,222][123090] Updated weights for policy 1, policy_version 1408169 (0.0010) [2023-12-26 10:54:51,280][123090] Updated weights for policy 1, policy_version 1408179 (0.0011) [2023-12-26 10:54:51,339][123090] Updated weights for policy 1, policy_version 1408189 (0.0010) [2023-12-26 10:54:51,730][123091] Updated weights for policy 0, policy_version 1417751 (0.0007) [2023-12-26 10:54:51,801][123091] Updated weights for policy 0, policy_version 1417761 (0.0008) [2023-12-26 10:54:51,875][123091] Updated weights for policy 0, policy_version 1417771 (0.0005) [2023-12-26 10:54:52,230][123090] Updated weights for policy 1, policy_version 1408199 (0.0009) [2023-12-26 10:54:52,293][123090] Updated weights for policy 1, policy_version 1408209 (0.0007) [2023-12-26 10:54:52,353][123090] Updated weights for policy 1, policy_version 1408219 (0.0007) [2023-12-26 10:54:52,570][123091] Updated weights for policy 0, policy_version 1417781 (0.0006) [2023-12-26 10:54:52,618][123091] Updated weights for policy 0, policy_version 1417791 (0.0005) [2023-12-26 10:54:52,674][123091] Updated weights for policy 0, policy_version 1417801 (0.0009) [2023-12-26 10:54:53,172][123090] Updated weights for policy 1, policy_version 1408229 (0.0009) [2023-12-26 10:54:53,241][123090] Updated weights for policy 1, policy_version 1408239 (0.0010) [2023-12-26 10:54:53,304][123090] Updated weights for policy 1, policy_version 1408249 (0.0010) [2023-12-26 10:54:53,501][123091] Updated weights for policy 0, policy_version 1417811 (0.0009) [2023-12-26 10:54:53,557][123091] Updated weights for policy 0, policy_version 1417821 (0.0009) [2023-12-26 10:54:53,621][123091] Updated weights for policy 0, policy_version 1417831 (0.0009) [2023-12-26 10:54:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 723484672. Throughput: 0: 8664.9, 1: 8799.2. Samples: 723458140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:53,785][121949] Avg episode reward: [(0, '6092.270'), (1, '4619.233')] [2023-12-26 10:54:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001417840_362971136.pth... [2023-12-26 10:54:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001408256_360513536.pth... [2023-12-26 10:54:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001416816_362708992.pth [2023-12-26 10:54:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001407232_360251392.pth [2023-12-26 10:54:54,122][123090] Updated weights for policy 1, policy_version 1408259 (0.0009) [2023-12-26 10:54:54,193][123090] Updated weights for policy 1, policy_version 1408269 (0.0008) [2023-12-26 10:54:54,262][123090] Updated weights for policy 1, policy_version 1408279 (0.0008) [2023-12-26 10:54:54,446][123091] Updated weights for policy 0, policy_version 1417841 (0.0009) [2023-12-26 10:54:54,506][123091] Updated weights for policy 0, policy_version 1417851 (0.0008) [2023-12-26 10:54:54,568][123091] Updated weights for policy 0, policy_version 1417861 (0.0009) [2023-12-26 10:54:54,632][123091] Updated weights for policy 0, policy_version 1417871 (0.0009) [2023-12-26 10:54:55,032][123090] Updated weights for policy 1, policy_version 1408289 (0.0011) [2023-12-26 10:54:55,088][123090] Updated weights for policy 1, policy_version 1408299 (0.0011) [2023-12-26 10:54:55,140][123090] Updated weights for policy 1, policy_version 1408309 (0.0010) [2023-12-26 10:54:55,192][123090] Updated weights for policy 1, policy_version 1408319 (0.0010) [2023-12-26 10:54:55,415][123091] Updated weights for policy 0, policy_version 1417881 (0.0005) [2023-12-26 10:54:55,460][123091] Updated weights for policy 0, policy_version 1417891 (0.0005) [2023-12-26 10:54:55,507][123091] Updated weights for policy 0, policy_version 1417901 (0.0005) [2023-12-26 10:54:56,010][123090] Updated weights for policy 1, policy_version 1408329 (0.0011) [2023-12-26 10:54:56,079][123090] Updated weights for policy 1, policy_version 1408339 (0.0011) [2023-12-26 10:54:56,147][123090] Updated weights for policy 1, policy_version 1408349 (0.0011) [2023-12-26 10:54:56,250][123091] Updated weights for policy 0, policy_version 1417911 (0.0009) [2023-12-26 10:54:56,315][123091] Updated weights for policy 0, policy_version 1417921 (0.0007) [2023-12-26 10:54:56,371][123091] Updated weights for policy 0, policy_version 1417931 (0.0005) [2023-12-26 10:54:56,840][123090] Updated weights for policy 1, policy_version 1408359 (0.0007) [2023-12-26 10:54:56,890][123090] Updated weights for policy 1, policy_version 1408369 (0.0005) [2023-12-26 10:54:56,936][123090] Updated weights for policy 1, policy_version 1408379 (0.0006) [2023-12-26 10:54:57,015][123091] Updated weights for policy 0, policy_version 1417941 (0.0005) [2023-12-26 10:54:57,070][123091] Updated weights for policy 0, policy_version 1417951 (0.0005) [2023-12-26 10:54:57,123][123091] Updated weights for policy 0, policy_version 1417961 (0.0005) [2023-12-26 10:54:57,681][123090] Updated weights for policy 1, policy_version 1408389 (0.0010) [2023-12-26 10:54:57,745][123091] Updated weights for policy 0, policy_version 1417971 (0.0007) [2023-12-26 10:54:57,747][123090] Updated weights for policy 1, policy_version 1408399 (0.0010) [2023-12-26 10:54:57,799][123091] Updated weights for policy 0, policy_version 1417981 (0.0010) [2023-12-26 10:54:57,808][123090] Updated weights for policy 1, policy_version 1408409 (0.0010) [2023-12-26 10:54:57,857][123091] Updated weights for policy 0, policy_version 1417991 (0.0010) [2023-12-26 10:54:58,635][123091] Updated weights for policy 0, policy_version 1418001 (0.0010) [2023-12-26 10:54:58,647][123090] Updated weights for policy 1, policy_version 1408419 (0.0010) [2023-12-26 10:54:58,706][123091] Updated weights for policy 0, policy_version 1418011 (0.0007) [2023-12-26 10:54:58,719][123090] Updated weights for policy 1, policy_version 1408429 (0.0009) [2023-12-26 10:54:58,783][123091] Updated weights for policy 0, policy_version 1418021 (0.0011) [2023-12-26 10:54:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 723566592. Throughput: 0: 8793.7, 1: 8860.7. Samples: 723567800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:54:58,785][121949] Avg episode reward: [(0, '6105.020'), (1, '4320.696')] [2023-12-26 10:54:58,798][123090] Updated weights for policy 1, policy_version 1408439 (0.0008) [2023-12-26 10:54:58,853][123091] Updated weights for policy 0, policy_version 1418031 (0.0008) [2023-12-26 10:54:59,666][123090] Updated weights for policy 1, policy_version 1408449 (0.0011) [2023-12-26 10:54:59,729][123090] Updated weights for policy 1, policy_version 1408459 (0.0010) [2023-12-26 10:54:59,740][123091] Updated weights for policy 0, policy_version 1418041 (0.0008) [2023-12-26 10:54:59,776][123090] Updated weights for policy 1, policy_version 1408469 (0.0010) [2023-12-26 10:54:59,792][123091] Updated weights for policy 0, policy_version 1418051 (0.0006) [2023-12-26 10:54:59,844][123090] Updated weights for policy 1, policy_version 1408479 (0.0011) [2023-12-26 10:54:59,851][123091] Updated weights for policy 0, policy_version 1418061 (0.0007) [2023-12-26 10:55:00,599][123091] Updated weights for policy 0, policy_version 1418071 (0.0006) [2023-12-26 10:55:00,655][123091] Updated weights for policy 0, policy_version 1418081 (0.0005) [2023-12-26 10:55:00,660][123090] Updated weights for policy 1, policy_version 1408489 (0.0010) [2023-12-26 10:55:00,709][123091] Updated weights for policy 0, policy_version 1418091 (0.0005) [2023-12-26 10:55:00,714][123090] Updated weights for policy 1, policy_version 1408499 (0.0010) [2023-12-26 10:55:00,768][123090] Updated weights for policy 1, policy_version 1408509 (0.0010) [2023-12-26 10:55:01,483][123091] Updated weights for policy 0, policy_version 1418101 (0.0007) [2023-12-26 10:55:01,543][123091] Updated weights for policy 0, policy_version 1418111 (0.0009) [2023-12-26 10:55:01,605][123091] Updated weights for policy 0, policy_version 1418121 (0.0007) [2023-12-26 10:55:01,615][123090] Updated weights for policy 1, policy_version 1408519 (0.0010) [2023-12-26 10:55:01,688][123090] Updated weights for policy 1, policy_version 1408529 (0.0010) [2023-12-26 10:55:01,766][123090] Updated weights for policy 1, policy_version 1408539 (0.0010) [2023-12-26 10:55:02,437][123091] Updated weights for policy 0, policy_version 1418131 (0.0009) [2023-12-26 10:55:02,500][123091] Updated weights for policy 0, policy_version 1418141 (0.0009) [2023-12-26 10:55:02,562][123091] Updated weights for policy 0, policy_version 1418151 (0.0010) [2023-12-26 10:55:02,576][123090] Updated weights for policy 1, policy_version 1408549 (0.0010) [2023-12-26 10:55:02,632][123090] Updated weights for policy 1, policy_version 1408559 (0.0008) [2023-12-26 10:55:02,691][123090] Updated weights for policy 1, policy_version 1408569 (0.0009) [2023-12-26 10:55:03,384][123091] Updated weights for policy 0, policy_version 1418161 (0.0010) [2023-12-26 10:55:03,444][123091] Updated weights for policy 0, policy_version 1418171 (0.0009) [2023-12-26 10:55:03,504][123091] Updated weights for policy 0, policy_version 1418181 (0.0009) [2023-12-26 10:55:03,524][123090] Updated weights for policy 1, policy_version 1408579 (0.0009) [2023-12-26 10:55:03,567][123091] Updated weights for policy 0, policy_version 1418191 (0.0009) [2023-12-26 10:55:03,576][123090] Updated weights for policy 1, policy_version 1408589 (0.0008) [2023-12-26 10:55:03,635][123090] Updated weights for policy 1, policy_version 1408599 (0.0009) [2023-12-26 10:55:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 723664896. Throughput: 0: 8791.0, 1: 8764.9. Samples: 723670484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:03,785][121949] Avg episode reward: [(0, '6219.040'), (1, '4478.358')] [2023-12-26 10:55:04,408][123091] Updated weights for policy 0, policy_version 1418201 (0.0009) [2023-12-26 10:55:04,458][123091] Updated weights for policy 0, policy_version 1418211 (0.0010) [2023-12-26 10:55:04,498][123090] Updated weights for policy 1, policy_version 1408609 (0.0008) [2023-12-26 10:55:04,514][123091] Updated weights for policy 0, policy_version 1418222 (0.0009) [2023-12-26 10:55:04,564][123090] Updated weights for policy 1, policy_version 1408619 (0.0010) [2023-12-26 10:55:04,631][123090] Updated weights for policy 1, policy_version 1408629 (0.0009) [2023-12-26 10:55:04,694][123090] Updated weights for policy 1, policy_version 1408639 (0.0009) [2023-12-26 10:55:05,377][123091] Updated weights for policy 0, policy_version 1418232 (0.0009) [2023-12-26 10:55:05,429][123091] Updated weights for policy 0, policy_version 1418242 (0.0008) [2023-12-26 10:55:05,483][123091] Updated weights for policy 0, policy_version 1418252 (0.0009) [2023-12-26 10:55:05,506][123090] Updated weights for policy 1, policy_version 1408649 (0.0009) [2023-12-26 10:55:05,562][123090] Updated weights for policy 1, policy_version 1408659 (0.0009) [2023-12-26 10:55:05,611][123090] Updated weights for policy 1, policy_version 1408669 (0.0009) [2023-12-26 10:55:06,320][123091] Updated weights for policy 0, policy_version 1418262 (0.0008) [2023-12-26 10:55:06,381][123091] Updated weights for policy 0, policy_version 1418272 (0.0009) [2023-12-26 10:55:06,443][123091] Updated weights for policy 0, policy_version 1418282 (0.0008) [2023-12-26 10:55:06,451][123090] Updated weights for policy 1, policy_version 1408679 (0.0007) [2023-12-26 10:55:06,514][123090] Updated weights for policy 1, policy_version 1408689 (0.0009) [2023-12-26 10:55:06,581][123090] Updated weights for policy 1, policy_version 1408699 (0.0010) [2023-12-26 10:55:07,326][123091] Updated weights for policy 0, policy_version 1418292 (0.0010) [2023-12-26 10:55:07,353][123090] Updated weights for policy 1, policy_version 1408709 (0.0007) [2023-12-26 10:55:07,381][123091] Updated weights for policy 0, policy_version 1418302 (0.0009) [2023-12-26 10:55:07,418][123090] Updated weights for policy 1, policy_version 1408719 (0.0006) [2023-12-26 10:55:07,446][123091] Updated weights for policy 0, policy_version 1418312 (0.0009) [2023-12-26 10:55:07,485][123090] Updated weights for policy 1, policy_version 1408729 (0.0005) [2023-12-26 10:55:08,124][123090] Updated weights for policy 1, policy_version 1408739 (0.0006) [2023-12-26 10:55:08,185][123090] Updated weights for policy 1, policy_version 1408749 (0.0008) [2023-12-26 10:55:08,235][123090] Updated weights for policy 1, policy_version 1408759 (0.0009) [2023-12-26 10:55:08,309][123091] Updated weights for policy 0, policy_version 1418322 (0.0010) [2023-12-26 10:55:08,375][123091] Updated weights for policy 0, policy_version 1418332 (0.0010) [2023-12-26 10:55:08,433][123091] Updated weights for policy 0, policy_version 1418342 (0.0010) [2023-12-26 10:55:08,480][123091] Updated weights for policy 0, policy_version 1418352 (0.0009) [2023-12-26 10:55:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 723746816. Throughput: 0: 8810.8, 1: 8741.2. Samples: 723721404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:08,785][121949] Avg episode reward: [(0, '6228.643'), (1, '4756.297')] [2023-12-26 10:55:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001408768_360644608.pth... [2023-12-26 10:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001418352_363102208.pth... [2023-12-26 10:55:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001407744_360382464.pth [2023-12-26 10:55:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001417328_362840064.pth [2023-12-26 10:55:09,062][123090] Updated weights for policy 1, policy_version 1408769 (0.0009) [2023-12-26 10:55:09,116][123090] Updated weights for policy 1, policy_version 1408779 (0.0008) [2023-12-26 10:55:09,173][123090] Updated weights for policy 1, policy_version 1408789 (0.0009) [2023-12-26 10:55:09,237][123090] Updated weights for policy 1, policy_version 1408799 (0.0009) [2023-12-26 10:55:09,358][123091] Updated weights for policy 0, policy_version 1418362 (0.0008) [2023-12-26 10:55:09,430][123091] Updated weights for policy 0, policy_version 1418372 (0.0010) [2023-12-26 10:55:09,490][123091] Updated weights for policy 0, policy_version 1418382 (0.0009) [2023-12-26 10:55:10,014][123090] Updated weights for policy 1, policy_version 1408809 (0.0008) [2023-12-26 10:55:10,066][123090] Updated weights for policy 1, policy_version 1408819 (0.0008) [2023-12-26 10:55:10,132][123090] Updated weights for policy 1, policy_version 1408829 (0.0008) [2023-12-26 10:55:10,423][123091] Updated weights for policy 0, policy_version 1418392 (0.0010) [2023-12-26 10:55:10,477][123091] Updated weights for policy 0, policy_version 1418402 (0.0010) [2023-12-26 10:55:10,532][123091] Updated weights for policy 0, policy_version 1418413 (0.0010) [2023-12-26 10:55:10,865][123090] Updated weights for policy 1, policy_version 1408839 (0.0006) [2023-12-26 10:55:10,920][123090] Updated weights for policy 1, policy_version 1408849 (0.0006) [2023-12-26 10:55:10,973][123090] Updated weights for policy 1, policy_version 1408859 (0.0005) [2023-12-26 10:55:11,501][123091] Updated weights for policy 0, policy_version 1418423 (0.0011) [2023-12-26 10:55:11,557][123091] Updated weights for policy 0, policy_version 1418433 (0.0011) [2023-12-26 10:55:11,629][123091] Updated weights for policy 0, policy_version 1418443 (0.0011) [2023-12-26 10:55:11,811][123090] Updated weights for policy 1, policy_version 1408869 (0.0008) [2023-12-26 10:55:11,877][123090] Updated weights for policy 1, policy_version 1408879 (0.0010) [2023-12-26 10:55:11,933][123090] Updated weights for policy 1, policy_version 1408889 (0.0010) [2023-12-26 10:55:12,479][123091] Updated weights for policy 0, policy_version 1418453 (0.0010) [2023-12-26 10:55:12,548][123091] Updated weights for policy 0, policy_version 1418463 (0.0009) [2023-12-26 10:55:12,612][123091] Updated weights for policy 0, policy_version 1418473 (0.0008) [2023-12-26 10:55:12,808][123090] Updated weights for policy 1, policy_version 1408899 (0.0009) [2023-12-26 10:55:12,878][123090] Updated weights for policy 1, policy_version 1408909 (0.0009) [2023-12-26 10:55:12,934][123090] Updated weights for policy 1, policy_version 1408919 (0.0009) [2023-12-26 10:55:13,327][123091] Updated weights for policy 0, policy_version 1418483 (0.0009) [2023-12-26 10:55:13,395][123091] Updated weights for policy 0, policy_version 1418493 (0.0009) [2023-12-26 10:55:13,442][123091] Updated weights for policy 0, policy_version 1418503 (0.0009) [2023-12-26 10:55:13,777][123090] Updated weights for policy 1, policy_version 1408929 (0.0009) [2023-12-26 10:55:13,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 723828736. Throughput: 0: 8745.6, 1: 8786.2. Samples: 723824628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:13,785][121949] Avg episode reward: [(0, '6176.576'), (1, '4669.520')] [2023-12-26 10:55:13,835][123090] Updated weights for policy 1, policy_version 1408939 (0.0009) [2023-12-26 10:55:13,884][123090] Updated weights for policy 1, policy_version 1408949 (0.0009) [2023-12-26 10:55:13,933][123090] Updated weights for policy 1, policy_version 1408959 (0.0009) [2023-12-26 10:55:14,244][123091] Updated weights for policy 0, policy_version 1418513 (0.0009) [2023-12-26 10:55:14,301][123091] Updated weights for policy 0, policy_version 1418523 (0.0010) [2023-12-26 10:55:14,360][123091] Updated weights for policy 0, policy_version 1418533 (0.0009) [2023-12-26 10:55:14,411][123091] Updated weights for policy 0, policy_version 1418543 (0.0009) [2023-12-26 10:55:14,718][123090] Updated weights for policy 1, policy_version 1408969 (0.0009) [2023-12-26 10:55:14,782][123090] Updated weights for policy 1, policy_version 1408979 (0.0009) [2023-12-26 10:55:14,844][123090] Updated weights for policy 1, policy_version 1408989 (0.0009) [2023-12-26 10:55:15,230][123091] Updated weights for policy 0, policy_version 1418553 (0.0009) [2023-12-26 10:55:15,302][123091] Updated weights for policy 0, policy_version 1418563 (0.0010) [2023-12-26 10:55:15,371][123091] Updated weights for policy 0, policy_version 1418573 (0.0009) [2023-12-26 10:55:15,706][123090] Updated weights for policy 1, policy_version 1408999 (0.0010) [2023-12-26 10:55:15,769][123090] Updated weights for policy 1, policy_version 1409009 (0.0009) [2023-12-26 10:55:15,824][123090] Updated weights for policy 1, policy_version 1409019 (0.0009) [2023-12-26 10:55:16,115][123091] Updated weights for policy 0, policy_version 1418583 (0.0005) [2023-12-26 10:55:16,171][123091] Updated weights for policy 0, policy_version 1418593 (0.0005) [2023-12-26 10:55:16,223][123091] Updated weights for policy 0, policy_version 1418603 (0.0005) [2023-12-26 10:55:16,645][123090] Updated weights for policy 1, policy_version 1409029 (0.0007) [2023-12-26 10:55:16,699][123090] Updated weights for policy 1, policy_version 1409039 (0.0005) [2023-12-26 10:55:16,748][123090] Updated weights for policy 1, policy_version 1409049 (0.0005) [2023-12-26 10:55:16,976][123091] Updated weights for policy 0, policy_version 1418613 (0.0008) [2023-12-26 10:55:17,026][123091] Updated weights for policy 0, policy_version 1418623 (0.0010) [2023-12-26 10:55:17,081][123091] Updated weights for policy 0, policy_version 1418633 (0.0011) [2023-12-26 10:55:17,474][123090] Updated weights for policy 1, policy_version 1409059 (0.0007) [2023-12-26 10:55:17,522][123090] Updated weights for policy 1, policy_version 1409069 (0.0010) [2023-12-26 10:55:17,566][123090] Updated weights for policy 1, policy_version 1409079 (0.0010) [2023-12-26 10:55:17,914][123091] Updated weights for policy 0, policy_version 1418643 (0.0010) [2023-12-26 10:55:17,976][123091] Updated weights for policy 0, policy_version 1418653 (0.0009) [2023-12-26 10:55:18,036][123091] Updated weights for policy 0, policy_version 1418663 (0.0009) [2023-12-26 10:55:18,421][123090] Updated weights for policy 1, policy_version 1409089 (0.0010) [2023-12-26 10:55:18,489][123090] Updated weights for policy 1, policy_version 1409099 (0.0005) [2023-12-26 10:55:18,559][123090] Updated weights for policy 1, policy_version 1409109 (0.0006) [2023-12-26 10:55:18,617][123090] Updated weights for policy 1, policy_version 1409119 (0.0005) [2023-12-26 10:55:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 723918848. Throughput: 0: 8720.6, 1: 8766.0. Samples: 723930732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:18,785][121949] Avg episode reward: [(0, '6177.261'), (1, '4818.957')] [2023-12-26 10:55:18,973][123091] Updated weights for policy 0, policy_version 1418673 (0.0009) [2023-12-26 10:55:19,038][123091] Updated weights for policy 0, policy_version 1418683 (0.0009) [2023-12-26 10:55:19,090][123091] Updated weights for policy 0, policy_version 1418693 (0.0009) [2023-12-26 10:55:19,142][123091] Updated weights for policy 0, policy_version 1418704 (0.0009) [2023-12-26 10:55:19,239][123090] Updated weights for policy 1, policy_version 1409129 (0.0007) [2023-12-26 10:55:19,299][123090] Updated weights for policy 1, policy_version 1409139 (0.0006) [2023-12-26 10:55:19,363][123090] Updated weights for policy 1, policy_version 1409149 (0.0008) [2023-12-26 10:55:20,013][123091] Updated weights for policy 0, policy_version 1418714 (0.0006) [2023-12-26 10:55:20,072][123090] Updated weights for policy 1, policy_version 1409159 (0.0006) [2023-12-26 10:55:20,076][123091] Updated weights for policy 0, policy_version 1418724 (0.0006) [2023-12-26 10:55:20,141][123091] Updated weights for policy 0, policy_version 1418734 (0.0008) [2023-12-26 10:55:20,145][123090] Updated weights for policy 1, policy_version 1409169 (0.0006) [2023-12-26 10:55:20,215][123090] Updated weights for policy 1, policy_version 1409179 (0.0008) [2023-12-26 10:55:21,005][123090] Updated weights for policy 1, policy_version 1409189 (0.0008) [2023-12-26 10:55:21,027][123091] Updated weights for policy 0, policy_version 1418744 (0.0009) [2023-12-26 10:55:21,081][123090] Updated weights for policy 1, policy_version 1409199 (0.0008) [2023-12-26 10:55:21,100][123091] Updated weights for policy 0, policy_version 1418754 (0.0009) [2023-12-26 10:55:21,159][123090] Updated weights for policy 1, policy_version 1409209 (0.0007) [2023-12-26 10:55:21,164][123091] Updated weights for policy 0, policy_version 1418764 (0.0009) [2023-12-26 10:55:21,988][123090] Updated weights for policy 1, policy_version 1409219 (0.0009) [2023-12-26 10:55:21,999][123091] Updated weights for policy 0, policy_version 1418774 (0.0009) [2023-12-26 10:55:22,054][123090] Updated weights for policy 1, policy_version 1409229 (0.0009) [2023-12-26 10:55:22,056][123091] Updated weights for policy 0, policy_version 1418784 (0.0008) [2023-12-26 10:55:22,109][123091] Updated weights for policy 0, policy_version 1418794 (0.0009) [2023-12-26 10:55:22,110][123090] Updated weights for policy 1, policy_version 1409239 (0.0010) [2023-12-26 10:55:22,908][123090] Updated weights for policy 1, policy_version 1409249 (0.0010) [2023-12-26 10:55:22,928][123091] Updated weights for policy 0, policy_version 1418804 (0.0006) [2023-12-26 10:55:22,976][123090] Updated weights for policy 1, policy_version 1409259 (0.0008) [2023-12-26 10:55:22,987][123091] Updated weights for policy 0, policy_version 1418814 (0.0008) [2023-12-26 10:55:23,048][123091] Updated weights for policy 0, policy_version 1418824 (0.0009) [2023-12-26 10:55:23,051][123090] Updated weights for policy 1, policy_version 1409269 (0.0006) [2023-12-26 10:55:23,112][123090] Updated weights for policy 1, policy_version 1409279 (0.0009) [2023-12-26 10:55:23,753][123091] Updated weights for policy 0, policy_version 1418834 (0.0008) [2023-12-26 10:55:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 724000768. Throughput: 0: 8700.5, 1: 8774.6. Samples: 723982788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:23,785][121949] Avg episode reward: [(0, '6189.185'), (1, '5168.546')] [2023-12-26 10:55:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001409280_360775680.pth... [2023-12-26 10:55:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001408256_360513536.pth [2023-12-26 10:55:23,810][123091] Updated weights for policy 0, policy_version 1418844 (0.0005) [2023-12-26 10:55:23,869][123091] Updated weights for policy 0, policy_version 1418854 (0.0005) [2023-12-26 10:55:23,916][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001418864_363233280.pth... [2023-12-26 10:55:23,916][123091] Updated weights for policy 0, policy_version 1418864 (0.0005) [2023-12-26 10:55:23,917][123090] Updated weights for policy 1, policy_version 1409289 (0.0008) [2023-12-26 10:55:23,920][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001417840_362971136.pth [2023-12-26 10:55:23,984][123090] Updated weights for policy 1, policy_version 1409299 (0.0010) [2023-12-26 10:55:24,042][123090] Updated weights for policy 1, policy_version 1409309 (0.0010) [2023-12-26 10:55:24,578][123091] Updated weights for policy 0, policy_version 1418874 (0.0006) [2023-12-26 10:55:24,635][123091] Updated weights for policy 0, policy_version 1418884 (0.0005) [2023-12-26 10:55:24,691][123091] Updated weights for policy 0, policy_version 1418894 (0.0005) [2023-12-26 10:55:24,899][123090] Updated weights for policy 1, policy_version 1409319 (0.0009) [2023-12-26 10:55:24,963][123090] Updated weights for policy 1, policy_version 1409329 (0.0010) [2023-12-26 10:55:25,038][123090] Updated weights for policy 1, policy_version 1409339 (0.0010) [2023-12-26 10:55:25,424][123091] Updated weights for policy 0, policy_version 1418904 (0.0008) [2023-12-26 10:55:25,476][123091] Updated weights for policy 0, policy_version 1418914 (0.0009) [2023-12-26 10:55:25,536][123091] Updated weights for policy 0, policy_version 1418924 (0.0009) [2023-12-26 10:55:25,836][123090] Updated weights for policy 1, policy_version 1409349 (0.0010) [2023-12-26 10:55:25,887][123090] Updated weights for policy 1, policy_version 1409359 (0.0010) [2023-12-26 10:55:25,949][123090] Updated weights for policy 1, policy_version 1409369 (0.0010) [2023-12-26 10:55:26,387][123091] Updated weights for policy 0, policy_version 1418934 (0.0008) [2023-12-26 10:55:26,460][123091] Updated weights for policy 0, policy_version 1418944 (0.0009) [2023-12-26 10:55:26,520][123091] Updated weights for policy 0, policy_version 1418954 (0.0009) [2023-12-26 10:55:26,783][123090] Updated weights for policy 1, policy_version 1409379 (0.0010) [2023-12-26 10:55:26,844][123090] Updated weights for policy 1, policy_version 1409389 (0.0011) [2023-12-26 10:55:26,903][123090] Updated weights for policy 1, policy_version 1409399 (0.0009) [2023-12-26 10:55:27,385][123091] Updated weights for policy 0, policy_version 1418964 (0.0007) [2023-12-26 10:55:27,440][123091] Updated weights for policy 0, policy_version 1418974 (0.0005) [2023-12-26 10:55:27,507][123091] Updated weights for policy 0, policy_version 1418984 (0.0008) [2023-12-26 10:55:27,654][123090] Updated weights for policy 1, policy_version 1409409 (0.0006) [2023-12-26 10:55:27,704][123090] Updated weights for policy 1, policy_version 1409419 (0.0007) [2023-12-26 10:55:27,748][123090] Updated weights for policy 1, policy_version 1409429 (0.0005) [2023-12-26 10:55:27,799][123090] Updated weights for policy 1, policy_version 1409439 (0.0005) [2023-12-26 10:55:28,215][123091] Updated weights for policy 0, policy_version 1418994 (0.0009) [2023-12-26 10:55:28,285][123091] Updated weights for policy 0, policy_version 1419004 (0.0005) [2023-12-26 10:55:28,339][123091] Updated weights for policy 0, policy_version 1419014 (0.0006) [2023-12-26 10:55:28,406][123091] Updated weights for policy 0, policy_version 1419024 (0.0008) [2023-12-26 10:55:28,533][123090] Updated weights for policy 1, policy_version 1409449 (0.0005) [2023-12-26 10:55:28,587][123090] Updated weights for policy 1, policy_version 1409459 (0.0005) [2023-12-26 10:55:28,640][123090] Updated weights for policy 1, policy_version 1409469 (0.0005) [2023-12-26 10:55:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 724099072. Throughput: 0: 8774.8, 1: 8761.3. Samples: 724088712. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:28,785][121949] Avg episode reward: [(0, '6171.116'), (1, '4846.896')] [2023-12-26 10:55:29,111][123091] Updated weights for policy 0, policy_version 1419034 (0.0010) [2023-12-26 10:55:29,180][123091] Updated weights for policy 0, policy_version 1419044 (0.0010) [2023-12-26 10:55:29,244][123091] Updated weights for policy 0, policy_version 1419054 (0.0009) [2023-12-26 10:55:29,452][123090] Updated weights for policy 1, policy_version 1409479 (0.0009) [2023-12-26 10:55:29,506][123090] Updated weights for policy 1, policy_version 1409489 (0.0010) [2023-12-26 10:55:29,564][123090] Updated weights for policy 1, policy_version 1409499 (0.0010) [2023-12-26 10:55:29,988][123091] Updated weights for policy 0, policy_version 1419064 (0.0009) [2023-12-26 10:55:30,036][123091] Updated weights for policy 0, policy_version 1419074 (0.0010) [2023-12-26 10:55:30,084][123091] Updated weights for policy 0, policy_version 1419084 (0.0010) [2023-12-26 10:55:30,398][123090] Updated weights for policy 1, policy_version 1409509 (0.0009) [2023-12-26 10:55:30,454][123090] Updated weights for policy 1, policy_version 1409519 (0.0008) [2023-12-26 10:55:30,505][123090] Updated weights for policy 1, policy_version 1409529 (0.0008) [2023-12-26 10:55:30,927][123091] Updated weights for policy 0, policy_version 1419094 (0.0010) [2023-12-26 10:55:30,992][123091] Updated weights for policy 0, policy_version 1419104 (0.0010) [2023-12-26 10:55:31,055][123091] Updated weights for policy 0, policy_version 1419114 (0.0011) [2023-12-26 10:55:31,309][123090] Updated weights for policy 1, policy_version 1409539 (0.0009) [2023-12-26 10:55:31,380][123090] Updated weights for policy 1, policy_version 1409549 (0.0010) [2023-12-26 10:55:31,446][123090] Updated weights for policy 1, policy_version 1409559 (0.0010) [2023-12-26 10:55:31,871][123091] Updated weights for policy 0, policy_version 1419124 (0.0011) [2023-12-26 10:55:31,932][123091] Updated weights for policy 0, policy_version 1419134 (0.0010) [2023-12-26 10:55:31,987][123091] Updated weights for policy 0, policy_version 1419144 (0.0010) [2023-12-26 10:55:32,280][123090] Updated weights for policy 1, policy_version 1409569 (0.0010) [2023-12-26 10:55:32,347][123090] Updated weights for policy 1, policy_version 1409579 (0.0010) [2023-12-26 10:55:32,418][123090] Updated weights for policy 1, policy_version 1409589 (0.0010) [2023-12-26 10:55:32,484][123090] Updated weights for policy 1, policy_version 1409599 (0.0010) [2023-12-26 10:55:32,805][123091] Updated weights for policy 0, policy_version 1419154 (0.0010) [2023-12-26 10:55:32,868][123091] Updated weights for policy 0, policy_version 1419164 (0.0009) [2023-12-26 10:55:32,939][123091] Updated weights for policy 0, policy_version 1419174 (0.0007) [2023-12-26 10:55:33,005][123091] Updated weights for policy 0, policy_version 1419184 (0.0006) [2023-12-26 10:55:33,255][123090] Updated weights for policy 1, policy_version 1409609 (0.0006) [2023-12-26 10:55:33,310][123090] Updated weights for policy 1, policy_version 1409619 (0.0005) [2023-12-26 10:55:33,367][123090] Updated weights for policy 1, policy_version 1409629 (0.0005) [2023-12-26 10:55:33,676][123091] Updated weights for policy 0, policy_version 1419194 (0.0005) [2023-12-26 10:55:33,723][123091] Updated weights for policy 0, policy_version 1419204 (0.0005) [2023-12-26 10:55:33,769][123091] Updated weights for policy 0, policy_version 1419214 (0.0005) [2023-12-26 10:55:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 724189184. Throughput: 0: 8791.1, 1: 8797.1. Samples: 724197396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:33,785][121949] Avg episode reward: [(0, '6209.345'), (1, '5091.387')] [2023-12-26 10:55:33,967][123090] Updated weights for policy 1, policy_version 1409639 (0.0005) [2023-12-26 10:55:34,033][123090] Updated weights for policy 1, policy_version 1409649 (0.0005) [2023-12-26 10:55:34,082][123090] Updated weights for policy 1, policy_version 1409659 (0.0005) [2023-12-26 10:55:34,519][123091] Updated weights for policy 0, policy_version 1419224 (0.0008) [2023-12-26 10:55:34,573][123091] Updated weights for policy 0, policy_version 1419234 (0.0010) [2023-12-26 10:55:34,633][123091] Updated weights for policy 0, policy_version 1419244 (0.0010) [2023-12-26 10:55:34,817][123090] Updated weights for policy 1, policy_version 1409669 (0.0005) [2023-12-26 10:55:34,876][123090] Updated weights for policy 1, policy_version 1409679 (0.0005) [2023-12-26 10:55:34,939][123090] Updated weights for policy 1, policy_version 1409689 (0.0006) [2023-12-26 10:55:35,534][123091] Updated weights for policy 0, policy_version 1419254 (0.0011) [2023-12-26 10:55:35,563][123090] Updated weights for policy 1, policy_version 1409699 (0.0005) [2023-12-26 10:55:35,594][123091] Updated weights for policy 0, policy_version 1419264 (0.0009) [2023-12-26 10:55:35,624][123090] Updated weights for policy 1, policy_version 1409709 (0.0007) [2023-12-26 10:55:35,657][123091] Updated weights for policy 0, policy_version 1419274 (0.0011) [2023-12-26 10:55:35,698][123090] Updated weights for policy 1, policy_version 1409719 (0.0005) [2023-12-26 10:55:36,386][123090] Updated weights for policy 1, policy_version 1409729 (0.0006) [2023-12-26 10:55:36,453][123090] Updated weights for policy 1, policy_version 1409739 (0.0010) [2023-12-26 10:55:36,506][123091] Updated weights for policy 0, policy_version 1419284 (0.0011) [2023-12-26 10:55:36,518][123090] Updated weights for policy 1, policy_version 1409749 (0.0011) [2023-12-26 10:55:36,572][123091] Updated weights for policy 0, policy_version 1419294 (0.0011) [2023-12-26 10:55:36,586][123090] Updated weights for policy 1, policy_version 1409759 (0.0011) [2023-12-26 10:55:36,633][123091] Updated weights for policy 0, policy_version 1419304 (0.0011) [2023-12-26 10:55:37,350][123090] Updated weights for policy 1, policy_version 1409769 (0.0006) [2023-12-26 10:55:37,408][123090] Updated weights for policy 1, policy_version 1409779 (0.0006) [2023-12-26 10:55:37,421][123091] Updated weights for policy 0, policy_version 1419314 (0.0010) [2023-12-26 10:55:37,467][123090] Updated weights for policy 1, policy_version 1409789 (0.0007) [2023-12-26 10:55:37,490][123091] Updated weights for policy 0, policy_version 1419324 (0.0006) [2023-12-26 10:55:37,559][123091] Updated weights for policy 0, policy_version 1419334 (0.0007) [2023-12-26 10:55:37,620][123091] Updated weights for policy 0, policy_version 1419344 (0.0005) [2023-12-26 10:55:38,207][123090] Updated weights for policy 1, policy_version 1409799 (0.0008) [2023-12-26 10:55:38,264][123090] Updated weights for policy 1, policy_version 1409809 (0.0008) [2023-12-26 10:55:38,322][123090] Updated weights for policy 1, policy_version 1409819 (0.0010) [2023-12-26 10:55:38,358][123091] Updated weights for policy 0, policy_version 1419354 (0.0008) [2023-12-26 10:55:38,427][123091] Updated weights for policy 0, policy_version 1419364 (0.0006) [2023-12-26 10:55:38,499][123091] Updated weights for policy 0, policy_version 1419374 (0.0006) [2023-12-26 10:55:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 724279296. Throughput: 0: 8773.6, 1: 8874.8. Samples: 724252320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:38,785][121949] Avg episode reward: [(0, '6220.076'), (1, '4951.539')] [2023-12-26 10:55:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001409824_360914944.pth... [2023-12-26 10:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001419376_363364352.pth... [2023-12-26 10:55:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001408768_360644608.pth [2023-12-26 10:55:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001418352_363102208.pth [2023-12-26 10:55:39,043][123090] Updated weights for policy 1, policy_version 1409829 (0.0009) [2023-12-26 10:55:39,094][123090] Updated weights for policy 1, policy_version 1409839 (0.0006) [2023-12-26 10:55:39,153][123090] Updated weights for policy 1, policy_version 1409849 (0.0005) [2023-12-26 10:55:39,299][123091] Updated weights for policy 0, policy_version 1419384 (0.0008) [2023-12-26 10:55:39,358][123091] Updated weights for policy 0, policy_version 1419394 (0.0008) [2023-12-26 10:55:39,417][123091] Updated weights for policy 0, policy_version 1419404 (0.0007) [2023-12-26 10:55:39,893][123090] Updated weights for policy 1, policy_version 1409859 (0.0005) [2023-12-26 10:55:39,976][123090] Updated weights for policy 1, policy_version 1409869 (0.0008) [2023-12-26 10:55:40,046][123090] Updated weights for policy 1, policy_version 1409879 (0.0008) [2023-12-26 10:55:40,197][123091] Updated weights for policy 0, policy_version 1419414 (0.0008) [2023-12-26 10:55:40,259][123091] Updated weights for policy 0, policy_version 1419424 (0.0009) [2023-12-26 10:55:40,323][123091] Updated weights for policy 0, policy_version 1419434 (0.0010) [2023-12-26 10:55:40,797][123090] Updated weights for policy 1, policy_version 1409889 (0.0008) [2023-12-26 10:55:40,873][123090] Updated weights for policy 1, policy_version 1409899 (0.0005) [2023-12-26 10:55:40,946][123090] Updated weights for policy 1, policy_version 1409909 (0.0005) [2023-12-26 10:55:41,010][123090] Updated weights for policy 1, policy_version 1409919 (0.0005) [2023-12-26 10:55:41,096][123091] Updated weights for policy 0, policy_version 1419444 (0.0009) [2023-12-26 10:55:41,169][123091] Updated weights for policy 0, policy_version 1419454 (0.0009) [2023-12-26 10:55:41,239][123091] Updated weights for policy 0, policy_version 1419464 (0.0009) [2023-12-26 10:55:41,784][123090] Updated weights for policy 1, policy_version 1409929 (0.0009) [2023-12-26 10:55:41,849][123090] Updated weights for policy 1, policy_version 1409939 (0.0010) [2023-12-26 10:55:41,900][123090] Updated weights for policy 1, policy_version 1409949 (0.0009) [2023-12-26 10:55:42,017][123091] Updated weights for policy 0, policy_version 1419474 (0.0010) [2023-12-26 10:55:42,085][123091] Updated weights for policy 0, policy_version 1419484 (0.0010) [2023-12-26 10:55:42,151][123091] Updated weights for policy 0, policy_version 1419494 (0.0010) [2023-12-26 10:55:42,214][123091] Updated weights for policy 0, policy_version 1419504 (0.0010) [2023-12-26 10:55:42,759][123090] Updated weights for policy 1, policy_version 1409959 (0.0008) [2023-12-26 10:55:42,808][123090] Updated weights for policy 1, policy_version 1409969 (0.0009) [2023-12-26 10:55:42,861][123090] Updated weights for policy 1, policy_version 1409979 (0.0009) [2023-12-26 10:55:43,134][123091] Updated weights for policy 0, policy_version 1419514 (0.0008) [2023-12-26 10:55:43,192][123091] Updated weights for policy 0, policy_version 1419524 (0.0010) [2023-12-26 10:55:43,250][123091] Updated weights for policy 0, policy_version 1419534 (0.0009) [2023-12-26 10:55:43,653][123090] Updated weights for policy 1, policy_version 1409989 (0.0008) [2023-12-26 10:55:43,717][123090] Updated weights for policy 1, policy_version 1409999 (0.0005) [2023-12-26 10:55:43,778][123090] Updated weights for policy 1, policy_version 1410009 (0.0008) [2023-12-26 10:55:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 724361216. Throughput: 0: 8692.4, 1: 8905.5. Samples: 724359704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:43,784][121949] Avg episode reward: [(0, '6299.777'), (1, '4761.717')] [2023-12-26 10:55:44,067][123091] Updated weights for policy 0, policy_version 1419544 (0.0009) [2023-12-26 10:55:44,130][123091] Updated weights for policy 0, policy_version 1419554 (0.0010) [2023-12-26 10:55:44,181][123091] Updated weights for policy 0, policy_version 1419564 (0.0008) [2023-12-26 10:55:44,481][123090] Updated weights for policy 1, policy_version 1410019 (0.0009) [2023-12-26 10:55:44,533][123090] Updated weights for policy 1, policy_version 1410029 (0.0008) [2023-12-26 10:55:44,588][123090] Updated weights for policy 1, policy_version 1410039 (0.0005) [2023-12-26 10:55:45,053][123091] Updated weights for policy 0, policy_version 1419574 (0.0008) [2023-12-26 10:55:45,117][123091] Updated weights for policy 0, policy_version 1419584 (0.0010) [2023-12-26 10:55:45,185][123091] Updated weights for policy 0, policy_version 1419594 (0.0008) [2023-12-26 10:55:45,405][123090] Updated weights for policy 1, policy_version 1410049 (0.0006) [2023-12-26 10:55:45,464][123090] Updated weights for policy 1, policy_version 1410059 (0.0009) [2023-12-26 10:55:45,515][123090] Updated weights for policy 1, policy_version 1410069 (0.0010) [2023-12-26 10:55:45,564][123090] Updated weights for policy 1, policy_version 1410079 (0.0009) [2023-12-26 10:55:45,861][123091] Updated weights for policy 0, policy_version 1419604 (0.0008) [2023-12-26 10:55:45,908][123091] Updated weights for policy 0, policy_version 1419614 (0.0010) [2023-12-26 10:55:45,962][123091] Updated weights for policy 0, policy_version 1419624 (0.0010) [2023-12-26 10:55:46,340][123090] Updated weights for policy 1, policy_version 1410089 (0.0010) [2023-12-26 10:55:46,398][123090] Updated weights for policy 1, policy_version 1410099 (0.0009) [2023-12-26 10:55:46,455][123090] Updated weights for policy 1, policy_version 1410109 (0.0010) [2023-12-26 10:55:46,662][123091] Updated weights for policy 0, policy_version 1419634 (0.0009) [2023-12-26 10:55:46,728][123091] Updated weights for policy 0, policy_version 1419644 (0.0009) [2023-12-26 10:55:46,797][123091] Updated weights for policy 0, policy_version 1419654 (0.0010) [2023-12-26 10:55:46,864][123091] Updated weights for policy 0, policy_version 1419664 (0.0006) [2023-12-26 10:55:47,290][123090] Updated weights for policy 1, policy_version 1410119 (0.0010) [2023-12-26 10:55:47,354][123090] Updated weights for policy 1, policy_version 1410129 (0.0009) [2023-12-26 10:55:47,426][123090] Updated weights for policy 1, policy_version 1410139 (0.0009) [2023-12-26 10:55:47,486][123091] Updated weights for policy 0, policy_version 1419674 (0.0008) [2023-12-26 10:55:47,547][123091] Updated weights for policy 0, policy_version 1419684 (0.0009) [2023-12-26 10:55:47,611][123091] Updated weights for policy 0, policy_version 1419694 (0.0010) [2023-12-26 10:55:48,203][123090] Updated weights for policy 1, policy_version 1410149 (0.0009) [2023-12-26 10:55:48,251][123090] Updated weights for policy 1, policy_version 1410159 (0.0009) [2023-12-26 10:55:48,297][123090] Updated weights for policy 1, policy_version 1410169 (0.0009) [2023-12-26 10:55:48,490][123091] Updated weights for policy 0, policy_version 1419704 (0.0010) [2023-12-26 10:55:48,548][123091] Updated weights for policy 0, policy_version 1419714 (0.0009) [2023-12-26 10:55:48,601][123091] Updated weights for policy 0, policy_version 1419724 (0.0009) [2023-12-26 10:55:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 724459520. Throughput: 0: 8726.8, 1: 8993.0. Samples: 724467872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:48,785][121949] Avg episode reward: [(0, '6238.076'), (1, '5033.430')] [2023-12-26 10:55:49,106][123090] Updated weights for policy 1, policy_version 1410179 (0.0008) [2023-12-26 10:55:49,167][123090] Updated weights for policy 1, policy_version 1410189 (0.0006) [2023-12-26 10:55:49,233][123090] Updated weights for policy 1, policy_version 1410199 (0.0008) [2023-12-26 10:55:49,414][123091] Updated weights for policy 0, policy_version 1419735 (0.0007) [2023-12-26 10:55:49,475][123091] Updated weights for policy 0, policy_version 1419745 (0.0005) [2023-12-26 10:55:49,543][123091] Updated weights for policy 0, policy_version 1419755 (0.0006) [2023-12-26 10:55:49,930][123090] Updated weights for policy 1, policy_version 1410209 (0.0008) [2023-12-26 10:55:49,995][123090] Updated weights for policy 1, policy_version 1410219 (0.0010) [2023-12-26 10:55:50,053][123090] Updated weights for policy 1, policy_version 1410229 (0.0010) [2023-12-26 10:55:50,112][123090] Updated weights for policy 1, policy_version 1410240 (0.0010) [2023-12-26 10:55:50,237][123091] Updated weights for policy 0, policy_version 1419765 (0.0008) [2023-12-26 10:55:50,295][123091] Updated weights for policy 0, policy_version 1419775 (0.0011) [2023-12-26 10:55:50,358][123091] Updated weights for policy 0, policy_version 1419785 (0.0011) [2023-12-26 10:55:50,945][123090] Updated weights for policy 1, policy_version 1410250 (0.0009) [2023-12-26 10:55:51,016][123090] Updated weights for policy 1, policy_version 1410260 (0.0009) [2023-12-26 10:55:51,082][123090] Updated weights for policy 1, policy_version 1410270 (0.0009) [2023-12-26 10:55:51,185][123091] Updated weights for policy 0, policy_version 1419795 (0.0010) [2023-12-26 10:55:51,244][123091] Updated weights for policy 0, policy_version 1419805 (0.0008) [2023-12-26 10:55:51,301][123091] Updated weights for policy 0, policy_version 1419815 (0.0008) [2023-12-26 10:55:51,884][123090] Updated weights for policy 1, policy_version 1410280 (0.0007) [2023-12-26 10:55:51,957][123090] Updated weights for policy 1, policy_version 1410290 (0.0006) [2023-12-26 10:55:52,023][123090] Updated weights for policy 1, policy_version 1410300 (0.0006) [2023-12-26 10:55:52,081][123091] Updated weights for policy 0, policy_version 1419825 (0.0008) [2023-12-26 10:55:52,149][123091] Updated weights for policy 0, policy_version 1419835 (0.0006) [2023-12-26 10:55:52,216][123091] Updated weights for policy 0, policy_version 1419845 (0.0006) [2023-12-26 10:55:52,284][123091] Updated weights for policy 0, policy_version 1419855 (0.0007) [2023-12-26 10:55:52,775][123090] Updated weights for policy 1, policy_version 1410310 (0.0006) [2023-12-26 10:55:52,837][123090] Updated weights for policy 1, policy_version 1410320 (0.0006) [2023-12-26 10:55:52,896][123090] Updated weights for policy 1, policy_version 1410330 (0.0006) [2023-12-26 10:55:52,969][123091] Updated weights for policy 0, policy_version 1419865 (0.0010) [2023-12-26 10:55:53,028][123091] Updated weights for policy 0, policy_version 1419875 (0.0011) [2023-12-26 10:55:53,080][123091] Updated weights for policy 0, policy_version 1419885 (0.0010) [2023-12-26 10:55:53,548][123090] Updated weights for policy 1, policy_version 1410340 (0.0005) [2023-12-26 10:55:53,607][123090] Updated weights for policy 1, policy_version 1410350 (0.0005) [2023-12-26 10:55:53,659][123090] Updated weights for policy 1, policy_version 1410360 (0.0005) [2023-12-26 10:55:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 724549632. Throughput: 0: 8760.1, 1: 9017.3. Samples: 724521388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:53,785][121949] Avg episode reward: [(0, '6087.756'), (1, '5224.655')] [2023-12-26 10:55:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001419888_363495424.pth... [2023-12-26 10:55:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001410368_361054208.pth... [2023-12-26 10:55:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001418864_363233280.pth [2023-12-26 10:55:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001409280_360775680.pth [2023-12-26 10:55:53,901][123091] Updated weights for policy 0, policy_version 1419895 (0.0011) [2023-12-26 10:55:53,960][123091] Updated weights for policy 0, policy_version 1419905 (0.0008) [2023-12-26 10:55:54,009][123091] Updated weights for policy 0, policy_version 1419915 (0.0005) [2023-12-26 10:55:54,433][123090] Updated weights for policy 1, policy_version 1410370 (0.0010) [2023-12-26 10:55:54,496][123090] Updated weights for policy 1, policy_version 1410380 (0.0009) [2023-12-26 10:55:54,553][123090] Updated weights for policy 1, policy_version 1410390 (0.0009) [2023-12-26 10:55:54,614][123090] Updated weights for policy 1, policy_version 1410400 (0.0009) [2023-12-26 10:55:54,777][123091] Updated weights for policy 0, policy_version 1419925 (0.0005) [2023-12-26 10:55:54,831][123091] Updated weights for policy 0, policy_version 1419935 (0.0005) [2023-12-26 10:55:54,888][123091] Updated weights for policy 0, policy_version 1419945 (0.0006) [2023-12-26 10:55:55,419][123090] Updated weights for policy 1, policy_version 1410410 (0.0005) [2023-12-26 10:55:55,495][123090] Updated weights for policy 1, policy_version 1410420 (0.0005) [2023-12-26 10:55:55,564][123090] Updated weights for policy 1, policy_version 1410430 (0.0005) [2023-12-26 10:55:55,597][123091] Updated weights for policy 0, policy_version 1419955 (0.0007) [2023-12-26 10:55:55,657][123091] Updated weights for policy 0, policy_version 1419965 (0.0006) [2023-12-26 10:55:55,723][123091] Updated weights for policy 0, policy_version 1419975 (0.0006) [2023-12-26 10:55:56,242][123090] Updated weights for policy 1, policy_version 1410440 (0.0005) [2023-12-26 10:55:56,302][123090] Updated weights for policy 1, policy_version 1410450 (0.0009) [2023-12-26 10:55:56,362][123090] Updated weights for policy 1, policy_version 1410460 (0.0010) [2023-12-26 10:55:56,418][123091] Updated weights for policy 0, policy_version 1419985 (0.0005) [2023-12-26 10:55:56,472][123091] Updated weights for policy 0, policy_version 1419995 (0.0005) [2023-12-26 10:55:56,524][123091] Updated weights for policy 0, policy_version 1420005 (0.0005) [2023-12-26 10:55:56,587][123091] Updated weights for policy 0, policy_version 1420015 (0.0005) [2023-12-26 10:55:57,013][123090] Updated weights for policy 1, policy_version 1410470 (0.0006) [2023-12-26 10:55:57,068][123090] Updated weights for policy 1, policy_version 1410480 (0.0005) [2023-12-26 10:55:57,127][123090] Updated weights for policy 1, policy_version 1410490 (0.0005) [2023-12-26 10:55:57,251][123091] Updated weights for policy 0, policy_version 1420025 (0.0006) [2023-12-26 10:55:57,311][123091] Updated weights for policy 0, policy_version 1420035 (0.0008) [2023-12-26 10:55:57,368][123091] Updated weights for policy 0, policy_version 1420045 (0.0008) [2023-12-26 10:55:57,824][123090] Updated weights for policy 1, policy_version 1410500 (0.0008) [2023-12-26 10:55:57,896][123090] Updated weights for policy 1, policy_version 1410510 (0.0008) [2023-12-26 10:55:57,959][123090] Updated weights for policy 1, policy_version 1410520 (0.0010) [2023-12-26 10:55:58,141][123091] Updated weights for policy 0, policy_version 1420055 (0.0010) [2023-12-26 10:55:58,209][123091] Updated weights for policy 0, policy_version 1420065 (0.0011) [2023-12-26 10:55:58,281][123091] Updated weights for policy 0, policy_version 1420075 (0.0010) [2023-12-26 10:55:58,712][123090] Updated weights for policy 1, policy_version 1410530 (0.0009) [2023-12-26 10:55:58,781][123090] Updated weights for policy 1, policy_version 1410541 (0.0009) [2023-12-26 10:55:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 724639744. Throughput: 0: 8986.2, 1: 9084.0. Samples: 724637788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:55:58,785][121949] Avg episode reward: [(0, '6130.850'), (1, '4859.362')] [2023-12-26 10:55:58,850][123090] Updated weights for policy 1, policy_version 1410551 (0.0009) [2023-12-26 10:55:59,110][123091] Updated weights for policy 0, policy_version 1420085 (0.0011) [2023-12-26 10:55:59,158][123091] Updated weights for policy 0, policy_version 1420095 (0.0010) [2023-12-26 10:55:59,214][123091] Updated weights for policy 0, policy_version 1420105 (0.0010) [2023-12-26 10:55:59,663][123090] Updated weights for policy 1, policy_version 1410561 (0.0008) [2023-12-26 10:55:59,721][123090] Updated weights for policy 1, policy_version 1410571 (0.0006) [2023-12-26 10:55:59,777][123090] Updated weights for policy 1, policy_version 1410581 (0.0005) [2023-12-26 10:55:59,841][123090] Updated weights for policy 1, policy_version 1410591 (0.0007) [2023-12-26 10:56:00,051][123091] Updated weights for policy 0, policy_version 1420115 (0.0010) [2023-12-26 10:56:00,112][123091] Updated weights for policy 0, policy_version 1420125 (0.0008) [2023-12-26 10:56:00,177][123091] Updated weights for policy 0, policy_version 1420135 (0.0008) [2023-12-26 10:56:00,583][123090] Updated weights for policy 1, policy_version 1410601 (0.0009) [2023-12-26 10:56:00,636][123090] Updated weights for policy 1, policy_version 1410611 (0.0005) [2023-12-26 10:56:00,691][123090] Updated weights for policy 1, policy_version 1410621 (0.0005) [2023-12-26 10:56:00,963][123091] Updated weights for policy 0, policy_version 1420145 (0.0008) [2023-12-26 10:56:01,031][123091] Updated weights for policy 0, policy_version 1420155 (0.0010) [2023-12-26 10:56:01,098][123091] Updated weights for policy 0, policy_version 1420165 (0.0011) [2023-12-26 10:56:01,169][123091] Updated weights for policy 0, policy_version 1420175 (0.0010) [2023-12-26 10:56:01,399][123090] Updated weights for policy 1, policy_version 1410631 (0.0007) [2023-12-26 10:56:01,451][123090] Updated weights for policy 1, policy_version 1410641 (0.0008) [2023-12-26 10:56:01,503][123090] Updated weights for policy 1, policy_version 1410651 (0.0009) [2023-12-26 10:56:01,980][123091] Updated weights for policy 0, policy_version 1420185 (0.0011) [2023-12-26 10:56:02,036][123091] Updated weights for policy 0, policy_version 1420195 (0.0011) [2023-12-26 10:56:02,084][123091] Updated weights for policy 0, policy_version 1420205 (0.0011) [2023-12-26 10:56:02,310][123090] Updated weights for policy 1, policy_version 1410661 (0.0007) [2023-12-26 10:56:02,372][123090] Updated weights for policy 1, policy_version 1410671 (0.0007) [2023-12-26 10:56:02,440][123090] Updated weights for policy 1, policy_version 1410681 (0.0006) [2023-12-26 10:56:02,978][123091] Updated weights for policy 0, policy_version 1420215 (0.0010) [2023-12-26 10:56:03,043][123091] Updated weights for policy 0, policy_version 1420225 (0.0010) [2023-12-26 10:56:03,095][123091] Updated weights for policy 0, policy_version 1420236 (0.0010) [2023-12-26 10:56:03,117][123090] Updated weights for policy 1, policy_version 1410691 (0.0005) [2023-12-26 10:56:03,164][123090] Updated weights for policy 1, policy_version 1410701 (0.0005) [2023-12-26 10:56:03,213][123090] Updated weights for policy 1, policy_version 1410711 (0.0006) [2023-12-26 10:56:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 724729856. Throughput: 0: 8911.2, 1: 9171.3. Samples: 724744440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:03,784][121949] Avg episode reward: [(0, '6170.116'), (1, '5067.676')] [2023-12-26 10:56:03,861][123090] Updated weights for policy 1, policy_version 1410721 (0.0005) [2023-12-26 10:56:03,926][123090] Updated weights for policy 1, policy_version 1410731 (0.0006) [2023-12-26 10:56:03,995][123090] Updated weights for policy 1, policy_version 1410741 (0.0006) [2023-12-26 10:56:04,006][123091] Updated weights for policy 0, policy_version 1420246 (0.0008) [2023-12-26 10:56:04,058][123090] Updated weights for policy 1, policy_version 1410751 (0.0006) [2023-12-26 10:56:04,062][123091] Updated weights for policy 0, policy_version 1420257 (0.0008) [2023-12-26 10:56:04,128][123091] Updated weights for policy 0, policy_version 1420267 (0.0005) [2023-12-26 10:56:04,870][123090] Updated weights for policy 1, policy_version 1410761 (0.0009) [2023-12-26 10:56:04,925][123091] Updated weights for policy 0, policy_version 1420277 (0.0008) [2023-12-26 10:56:04,927][123090] Updated weights for policy 1, policy_version 1410771 (0.0008) [2023-12-26 10:56:04,985][123090] Updated weights for policy 1, policy_version 1410781 (0.0008) [2023-12-26 10:56:04,993][123091] Updated weights for policy 0, policy_version 1420287 (0.0010) [2023-12-26 10:56:05,054][123091] Updated weights for policy 0, policy_version 1420297 (0.0007) [2023-12-26 10:56:05,752][123090] Updated weights for policy 1, policy_version 1410791 (0.0007) [2023-12-26 10:56:05,810][123090] Updated weights for policy 1, policy_version 1410801 (0.0006) [2023-12-26 10:56:05,812][123091] Updated weights for policy 0, policy_version 1420307 (0.0007) [2023-12-26 10:56:05,868][123090] Updated weights for policy 1, policy_version 1410811 (0.0008) [2023-12-26 10:56:05,875][123091] Updated weights for policy 0, policy_version 1420317 (0.0011) [2023-12-26 10:56:05,934][123091] Updated weights for policy 0, policy_version 1420327 (0.0011) [2023-12-26 10:56:06,682][123091] Updated weights for policy 0, policy_version 1420337 (0.0010) [2023-12-26 10:56:06,734][123091] Updated weights for policy 0, policy_version 1420347 (0.0005) [2023-12-26 10:56:06,754][123090] Updated weights for policy 1, policy_version 1410821 (0.0008) [2023-12-26 10:56:06,788][123091] Updated weights for policy 0, policy_version 1420357 (0.0005) [2023-12-26 10:56:06,817][123090] Updated weights for policy 1, policy_version 1410831 (0.0009) [2023-12-26 10:56:06,855][123091] Updated weights for policy 0, policy_version 1420367 (0.0008) [2023-12-26 10:56:06,877][123090] Updated weights for policy 1, policy_version 1410841 (0.0008) [2023-12-26 10:56:07,623][123091] Updated weights for policy 0, policy_version 1420377 (0.0006) [2023-12-26 10:56:07,675][123091] Updated weights for policy 0, policy_version 1420387 (0.0005) [2023-12-26 10:56:07,739][123091] Updated weights for policy 0, policy_version 1420397 (0.0006) [2023-12-26 10:56:07,766][123090] Updated weights for policy 1, policy_version 1410851 (0.0009) [2023-12-26 10:56:07,820][123090] Updated weights for policy 1, policy_version 1410861 (0.0010) [2023-12-26 10:56:07,875][123090] Updated weights for policy 1, policy_version 1410871 (0.0010) [2023-12-26 10:56:08,394][123091] Updated weights for policy 0, policy_version 1420407 (0.0008) [2023-12-26 10:56:08,464][123091] Updated weights for policy 0, policy_version 1420417 (0.0006) [2023-12-26 10:56:08,523][123091] Updated weights for policy 0, policy_version 1420427 (0.0006) [2023-12-26 10:56:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.3). Total num frames: 724819968. Throughput: 0: 8977.6, 1: 9136.4. Samples: 724797916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:08,785][121949] Avg episode reward: [(0, '6146.368'), (1, '5117.369')] [2023-12-26 10:56:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001420432_363634688.pth... [2023-12-26 10:56:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001410880_361185280.pth... [2023-12-26 10:56:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001419376_363364352.pth [2023-12-26 10:56:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001409824_360914944.pth [2023-12-26 10:56:08,829][123090] Updated weights for policy 1, policy_version 1410882 (0.0010) [2023-12-26 10:56:08,883][123090] Updated weights for policy 1, policy_version 1410893 (0.0010) [2023-12-26 10:56:08,936][123090] Updated weights for policy 1, policy_version 1410903 (0.0010) [2023-12-26 10:56:09,142][123091] Updated weights for policy 0, policy_version 1420437 (0.0007) [2023-12-26 10:56:09,196][123091] Updated weights for policy 0, policy_version 1420447 (0.0005) [2023-12-26 10:56:09,261][123091] Updated weights for policy 0, policy_version 1420457 (0.0007) [2023-12-26 10:56:09,852][123090] Updated weights for policy 1, policy_version 1410913 (0.0010) [2023-12-26 10:56:09,905][123090] Updated weights for policy 1, policy_version 1410923 (0.0009) [2023-12-26 10:56:09,973][123090] Updated weights for policy 1, policy_version 1410933 (0.0008) [2023-12-26 10:56:10,042][123090] Updated weights for policy 1, policy_version 1410943 (0.0006) [2023-12-26 10:56:10,108][123091] Updated weights for policy 0, policy_version 1420467 (0.0007) [2023-12-26 10:56:10,177][123091] Updated weights for policy 0, policy_version 1420477 (0.0011) [2023-12-26 10:56:10,249][123091] Updated weights for policy 0, policy_version 1420487 (0.0011) [2023-12-26 10:56:10,886][123090] Updated weights for policy 1, policy_version 1410953 (0.0009) [2023-12-26 10:56:10,948][123090] Updated weights for policy 1, policy_version 1410963 (0.0009) [2023-12-26 10:56:11,000][123090] Updated weights for policy 1, policy_version 1410973 (0.0009) [2023-12-26 10:56:11,066][123091] Updated weights for policy 0, policy_version 1420497 (0.0010) [2023-12-26 10:56:11,135][123091] Updated weights for policy 0, policy_version 1420507 (0.0009) [2023-12-26 10:56:11,203][123091] Updated weights for policy 0, policy_version 1420517 (0.0012) [2023-12-26 10:56:11,273][123091] Updated weights for policy 0, policy_version 1420527 (0.0010) [2023-12-26 10:56:11,949][123090] Updated weights for policy 1, policy_version 1410983 (0.0007) [2023-12-26 10:56:12,010][123090] Updated weights for policy 1, policy_version 1410993 (0.0009) [2023-12-26 10:56:12,017][123091] Updated weights for policy 0, policy_version 1420537 (0.0007) [2023-12-26 10:56:12,063][123090] Updated weights for policy 1, policy_version 1411003 (0.0006) [2023-12-26 10:56:12,085][123091] Updated weights for policy 0, policy_version 1420547 (0.0011) [2023-12-26 10:56:12,153][123091] Updated weights for policy 0, policy_version 1420557 (0.0011) [2023-12-26 10:56:12,853][123091] Updated weights for policy 0, policy_version 1420567 (0.0009) [2023-12-26 10:56:12,906][123090] Updated weights for policy 1, policy_version 1411013 (0.0007) [2023-12-26 10:56:12,917][123091] Updated weights for policy 0, policy_version 1420577 (0.0011) [2023-12-26 10:56:12,966][123090] Updated weights for policy 1, policy_version 1411023 (0.0006) [2023-12-26 10:56:12,984][123091] Updated weights for policy 0, policy_version 1420587 (0.0011) [2023-12-26 10:56:13,038][123090] Updated weights for policy 1, policy_version 1411033 (0.0007) [2023-12-26 10:56:13,730][123091] Updated weights for policy 0, policy_version 1420597 (0.0009) [2023-12-26 10:56:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 724901888. Throughput: 0: 9003.7, 1: 9063.8. Samples: 724901744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:13,784][121949] Avg episode reward: [(0, '6174.933'), (1, '5331.817')] [2023-12-26 10:56:13,790][123091] Updated weights for policy 0, policy_version 1420607 (0.0009) [2023-12-26 10:56:13,842][123091] Updated weights for policy 0, policy_version 1420617 (0.0009) [2023-12-26 10:56:13,874][123090] Updated weights for policy 1, policy_version 1411043 (0.0009) [2023-12-26 10:56:13,934][123090] Updated weights for policy 1, policy_version 1411053 (0.0010) [2023-12-26 10:56:13,995][123090] Updated weights for policy 1, policy_version 1411063 (0.0010) [2023-12-26 10:56:14,643][123091] Updated weights for policy 0, policy_version 1420627 (0.0010) [2023-12-26 10:56:14,692][123091] Updated weights for policy 0, policy_version 1420637 (0.0009) [2023-12-26 10:56:14,759][123091] Updated weights for policy 0, policy_version 1420647 (0.0009) [2023-12-26 10:56:14,828][123090] Updated weights for policy 1, policy_version 1411073 (0.0008) [2023-12-26 10:56:14,903][123090] Updated weights for policy 1, policy_version 1411083 (0.0006) [2023-12-26 10:56:14,965][123090] Updated weights for policy 1, policy_version 1411093 (0.0006) [2023-12-26 10:56:15,038][123090] Updated weights for policy 1, policy_version 1411103 (0.0006) [2023-12-26 10:56:15,673][123091] Updated weights for policy 0, policy_version 1420657 (0.0010) [2023-12-26 10:56:15,724][123091] Updated weights for policy 0, policy_version 1420667 (0.0010) [2023-12-26 10:56:15,759][123090] Updated weights for policy 1, policy_version 1411113 (0.0010) [2023-12-26 10:56:15,775][123091] Updated weights for policy 0, policy_version 1420677 (0.0010) [2023-12-26 10:56:15,814][123090] Updated weights for policy 1, policy_version 1411123 (0.0010) [2023-12-26 10:56:15,830][123091] Updated weights for policy 0, policy_version 1420687 (0.0010) [2023-12-26 10:56:15,866][123090] Updated weights for policy 1, policy_version 1411133 (0.0010) [2023-12-26 10:56:16,582][123090] Updated weights for policy 1, policy_version 1411143 (0.0007) [2023-12-26 10:56:16,585][123091] Updated weights for policy 0, policy_version 1420697 (0.0009) [2023-12-26 10:56:16,635][123090] Updated weights for policy 1, policy_version 1411153 (0.0005) [2023-12-26 10:56:16,638][123091] Updated weights for policy 0, policy_version 1420707 (0.0009) [2023-12-26 10:56:16,692][123090] Updated weights for policy 1, policy_version 1411163 (0.0006) [2023-12-26 10:56:16,695][123091] Updated weights for policy 0, policy_version 1420717 (0.0009) [2023-12-26 10:56:17,470][123091] Updated weights for policy 0, policy_version 1420727 (0.0007) [2023-12-26 10:56:17,491][123090] Updated weights for policy 1, policy_version 1411173 (0.0009) [2023-12-26 10:56:17,523][123091] Updated weights for policy 0, policy_version 1420737 (0.0006) [2023-12-26 10:56:17,549][123090] Updated weights for policy 1, policy_version 1411183 (0.0009) [2023-12-26 10:56:17,577][123091] Updated weights for policy 0, policy_version 1420747 (0.0005) [2023-12-26 10:56:17,604][123090] Updated weights for policy 1, policy_version 1411193 (0.0008) [2023-12-26 10:56:18,303][123091] Updated weights for policy 0, policy_version 1420757 (0.0007) [2023-12-26 10:56:18,368][123091] Updated weights for policy 0, policy_version 1420767 (0.0010) [2023-12-26 10:56:18,435][123091] Updated weights for policy 0, policy_version 1420777 (0.0009) [2023-12-26 10:56:18,518][123090] Updated weights for policy 1, policy_version 1411204 (0.0010) [2023-12-26 10:56:18,576][123090] Updated weights for policy 1, policy_version 1411214 (0.0010) [2023-12-26 10:56:18,630][123090] Updated weights for policy 1, policy_version 1411224 (0.0010) [2023-12-26 10:56:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 725000192. Throughput: 0: 8998.8, 1: 9018.5. Samples: 725008172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:18,785][121949] Avg episode reward: [(0, '6012.180'), (1, '5469.221')] [2023-12-26 10:56:19,180][123091] Updated weights for policy 0, policy_version 1420787 (0.0007) [2023-12-26 10:56:19,233][123091] Updated weights for policy 0, policy_version 1420797 (0.0009) [2023-12-26 10:56:19,298][123091] Updated weights for policy 0, policy_version 1420807 (0.0009) [2023-12-26 10:56:19,505][123090] Updated weights for policy 1, policy_version 1411234 (0.0009) [2023-12-26 10:56:19,568][123090] Updated weights for policy 1, policy_version 1411244 (0.0009) [2023-12-26 10:56:19,619][123090] Updated weights for policy 1, policy_version 1411254 (0.0009) [2023-12-26 10:56:19,674][123090] Updated weights for policy 1, policy_version 1411264 (0.0009) [2023-12-26 10:56:20,161][123091] Updated weights for policy 0, policy_version 1420817 (0.0010) [2023-12-26 10:56:20,220][123091] Updated weights for policy 0, policy_version 1420827 (0.0009) [2023-12-26 10:56:20,282][123091] Updated weights for policy 0, policy_version 1420837 (0.0009) [2023-12-26 10:56:20,347][123091] Updated weights for policy 0, policy_version 1420847 (0.0009) [2023-12-26 10:56:20,546][123090] Updated weights for policy 1, policy_version 1411274 (0.0011) [2023-12-26 10:56:20,616][123090] Updated weights for policy 1, policy_version 1411284 (0.0009) [2023-12-26 10:56:20,690][123090] Updated weights for policy 1, policy_version 1411294 (0.0012) [2023-12-26 10:56:21,150][123091] Updated weights for policy 0, policy_version 1420857 (0.0010) [2023-12-26 10:56:21,203][123091] Updated weights for policy 0, policy_version 1420867 (0.0009) [2023-12-26 10:56:21,264][123091] Updated weights for policy 0, policy_version 1420877 (0.0009) [2023-12-26 10:56:21,464][123090] Updated weights for policy 1, policy_version 1411304 (0.0010) [2023-12-26 10:56:21,537][123090] Updated weights for policy 1, policy_version 1411314 (0.0010) [2023-12-26 10:56:21,606][123090] Updated weights for policy 1, policy_version 1411324 (0.0009) [2023-12-26 10:56:22,072][123091] Updated weights for policy 0, policy_version 1420887 (0.0008) [2023-12-26 10:56:22,137][123091] Updated weights for policy 0, policy_version 1420897 (0.0007) [2023-12-26 10:56:22,201][123091] Updated weights for policy 0, policy_version 1420907 (0.0006) [2023-12-26 10:56:22,536][123090] Updated weights for policy 1, policy_version 1411334 (0.0009) [2023-12-26 10:56:22,591][123090] Updated weights for policy 1, policy_version 1411344 (0.0009) [2023-12-26 10:56:22,642][123090] Updated weights for policy 1, policy_version 1411354 (0.0010) [2023-12-26 10:56:23,002][123091] Updated weights for policy 0, policy_version 1420917 (0.0008) [2023-12-26 10:56:23,074][123091] Updated weights for policy 0, policy_version 1420927 (0.0009) [2023-12-26 10:56:23,139][123091] Updated weights for policy 0, policy_version 1420937 (0.0010) [2023-12-26 10:56:23,408][123090] Updated weights for policy 1, policy_version 1411364 (0.0010) [2023-12-26 10:56:23,467][123090] Updated weights for policy 1, policy_version 1411375 (0.0009) [2023-12-26 10:56:23,517][123090] Updated weights for policy 1, policy_version 1411385 (0.0009) [2023-12-26 10:56:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 725082112. Throughput: 0: 9008.8, 1: 8919.2. Samples: 725059080. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:23,785][121949] Avg episode reward: [(0, '6065.681'), (1, '5138.317')] [2023-12-26 10:56:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001420944_363765760.pth... [2023-12-26 10:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001411392_361316352.pth... [2023-12-26 10:56:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001419888_363495424.pth [2023-12-26 10:56:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001410368_361054208.pth [2023-12-26 10:56:23,964][123091] Updated weights for policy 0, policy_version 1420947 (0.0010) [2023-12-26 10:56:24,019][123091] Updated weights for policy 0, policy_version 1420957 (0.0009) [2023-12-26 10:56:24,074][123091] Updated weights for policy 0, policy_version 1420967 (0.0010) [2023-12-26 10:56:24,376][123090] Updated weights for policy 1, policy_version 1411395 (0.0008) [2023-12-26 10:56:24,443][123090] Updated weights for policy 1, policy_version 1411405 (0.0005) [2023-12-26 10:56:24,523][123090] Updated weights for policy 1, policy_version 1411415 (0.0008) [2023-12-26 10:56:24,832][123091] Updated weights for policy 0, policy_version 1420977 (0.0008) [2023-12-26 10:56:24,905][123091] Updated weights for policy 0, policy_version 1420987 (0.0006) [2023-12-26 10:56:24,967][123091] Updated weights for policy 0, policy_version 1420997 (0.0010) [2023-12-26 10:56:25,017][123091] Updated weights for policy 0, policy_version 1421007 (0.0009) [2023-12-26 10:56:25,267][123090] Updated weights for policy 1, policy_version 1411425 (0.0009) [2023-12-26 10:56:25,328][123090] Updated weights for policy 1, policy_version 1411435 (0.0005) [2023-12-26 10:56:25,383][123090] Updated weights for policy 1, policy_version 1411445 (0.0006) [2023-12-26 10:56:25,436][123090] Updated weights for policy 1, policy_version 1411455 (0.0007) [2023-12-26 10:56:25,800][123091] Updated weights for policy 0, policy_version 1421017 (0.0006) [2023-12-26 10:56:25,852][123091] Updated weights for policy 0, policy_version 1421027 (0.0005) [2023-12-26 10:56:25,902][123091] Updated weights for policy 0, policy_version 1421037 (0.0005) [2023-12-26 10:56:26,167][123090] Updated weights for policy 1, policy_version 1411465 (0.0005) [2023-12-26 10:56:26,218][123090] Updated weights for policy 1, policy_version 1411475 (0.0005) [2023-12-26 10:56:26,275][123090] Updated weights for policy 1, policy_version 1411485 (0.0005) [2023-12-26 10:56:26,567][123091] Updated weights for policy 0, policy_version 1421047 (0.0005) [2023-12-26 10:56:26,628][123091] Updated weights for policy 0, policy_version 1421057 (0.0006) [2023-12-26 10:56:26,690][123091] Updated weights for policy 0, policy_version 1421067 (0.0005) [2023-12-26 10:56:26,959][123090] Updated weights for policy 1, policy_version 1411495 (0.0005) [2023-12-26 10:56:27,020][123090] Updated weights for policy 1, policy_version 1411505 (0.0006) [2023-12-26 10:56:27,098][123090] Updated weights for policy 1, policy_version 1411515 (0.0008) [2023-12-26 10:56:27,360][123091] Updated weights for policy 0, policy_version 1421077 (0.0008) [2023-12-26 10:56:27,407][123091] Updated weights for policy 0, policy_version 1421087 (0.0010) [2023-12-26 10:56:27,461][123091] Updated weights for policy 0, policy_version 1421097 (0.0005) [2023-12-26 10:56:27,742][123090] Updated weights for policy 1, policy_version 1411525 (0.0008) [2023-12-26 10:56:27,805][123090] Updated weights for policy 1, policy_version 1411535 (0.0011) [2023-12-26 10:56:27,859][123090] Updated weights for policy 1, policy_version 1411545 (0.0008) [2023-12-26 10:56:28,170][123091] Updated weights for policy 0, policy_version 1421107 (0.0008) [2023-12-26 10:56:28,223][123091] Updated weights for policy 0, policy_version 1421117 (0.0005) [2023-12-26 10:56:28,273][123091] Updated weights for policy 0, policy_version 1421127 (0.0005) [2023-12-26 10:56:28,618][123090] Updated weights for policy 1, policy_version 1411555 (0.0009) [2023-12-26 10:56:28,690][123090] Updated weights for policy 1, policy_version 1411565 (0.0008) [2023-12-26 10:56:28,753][123090] Updated weights for policy 1, policy_version 1411575 (0.0010) [2023-12-26 10:56:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 725172224. Throughput: 0: 9073.8, 1: 8936.8. Samples: 725170180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:28,785][121949] Avg episode reward: [(0, '6271.161'), (1, '5292.774')] [2023-12-26 10:56:28,982][123091] Updated weights for policy 0, policy_version 1421137 (0.0005) [2023-12-26 10:56:29,039][123091] Updated weights for policy 0, policy_version 1421147 (0.0006) [2023-12-26 10:56:29,098][123091] Updated weights for policy 0, policy_version 1421157 (0.0005) [2023-12-26 10:56:29,146][123091] Updated weights for policy 0, policy_version 1421167 (0.0005) [2023-12-26 10:56:29,444][123090] Updated weights for policy 1, policy_version 1411585 (0.0006) [2023-12-26 10:56:29,506][123090] Updated weights for policy 1, policy_version 1411595 (0.0005) [2023-12-26 10:56:29,557][123090] Updated weights for policy 1, policy_version 1411605 (0.0006) [2023-12-26 10:56:29,619][123090] Updated weights for policy 1, policy_version 1411615 (0.0010) [2023-12-26 10:56:29,831][123091] Updated weights for policy 0, policy_version 1421177 (0.0008) [2023-12-26 10:56:29,898][123091] Updated weights for policy 0, policy_version 1421187 (0.0007) [2023-12-26 10:56:29,961][123091] Updated weights for policy 0, policy_version 1421197 (0.0007) [2023-12-26 10:56:30,402][123090] Updated weights for policy 1, policy_version 1411625 (0.0011) [2023-12-26 10:56:30,457][123090] Updated weights for policy 1, policy_version 1411635 (0.0010) [2023-12-26 10:56:30,521][123090] Updated weights for policy 1, policy_version 1411645 (0.0010) [2023-12-26 10:56:30,656][123091] Updated weights for policy 0, policy_version 1421207 (0.0008) [2023-12-26 10:56:30,719][123091] Updated weights for policy 0, policy_version 1421217 (0.0009) [2023-12-26 10:56:30,785][123091] Updated weights for policy 0, policy_version 1421227 (0.0007) [2023-12-26 10:56:31,314][123090] Updated weights for policy 1, policy_version 1411655 (0.0010) [2023-12-26 10:56:31,390][123090] Updated weights for policy 1, policy_version 1411665 (0.0010) [2023-12-26 10:56:31,459][123090] Updated weights for policy 1, policy_version 1411675 (0.0009) [2023-12-26 10:56:31,560][123091] Updated weights for policy 0, policy_version 1421237 (0.0006) [2023-12-26 10:56:31,616][123091] Updated weights for policy 0, policy_version 1421248 (0.0010) [2023-12-26 10:56:31,685][123091] Updated weights for policy 0, policy_version 1421258 (0.0009) [2023-12-26 10:56:32,268][123090] Updated weights for policy 1, policy_version 1411685 (0.0008) [2023-12-26 10:56:32,323][123090] Updated weights for policy 1, policy_version 1411695 (0.0008) [2023-12-26 10:56:32,394][123090] Updated weights for policy 1, policy_version 1411705 (0.0009) [2023-12-26 10:56:32,520][123091] Updated weights for policy 0, policy_version 1421268 (0.0009) [2023-12-26 10:56:32,576][123091] Updated weights for policy 0, policy_version 1421278 (0.0006) [2023-12-26 10:56:32,630][123091] Updated weights for policy 0, policy_version 1421288 (0.0008) [2023-12-26 10:56:33,177][123090] Updated weights for policy 1, policy_version 1411715 (0.0009) [2023-12-26 10:56:33,227][123090] Updated weights for policy 1, policy_version 1411725 (0.0010) [2023-12-26 10:56:33,285][123090] Updated weights for policy 1, policy_version 1411735 (0.0010) [2023-12-26 10:56:33,459][123091] Updated weights for policy 0, policy_version 1421298 (0.0009) [2023-12-26 10:56:33,510][123091] Updated weights for policy 0, policy_version 1421309 (0.0009) [2023-12-26 10:56:33,569][123091] Updated weights for policy 0, policy_version 1421319 (0.0009) [2023-12-26 10:56:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 725270528. Throughput: 0: 9105.8, 1: 8944.1. Samples: 725280124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:33,785][121949] Avg episode reward: [(0, '6256.251'), (1, '5553.858')] [2023-12-26 10:56:34,007][123090] Updated weights for policy 1, policy_version 1411745 (0.0010) [2023-12-26 10:56:34,061][123090] Updated weights for policy 1, policy_version 1411755 (0.0005) [2023-12-26 10:56:34,124][123090] Updated weights for policy 1, policy_version 1411765 (0.0005) [2023-12-26 10:56:34,209][123090] Updated weights for policy 1, policy_version 1411775 (0.0008) [2023-12-26 10:56:34,372][123091] Updated weights for policy 0, policy_version 1421329 (0.0009) [2023-12-26 10:56:34,442][123091] Updated weights for policy 0, policy_version 1421339 (0.0009) [2023-12-26 10:56:34,505][123091] Updated weights for policy 0, policy_version 1421349 (0.0010) [2023-12-26 10:56:34,578][123091] Updated weights for policy 0, policy_version 1421359 (0.0011) [2023-12-26 10:56:34,913][123090] Updated weights for policy 1, policy_version 1411785 (0.0009) [2023-12-26 10:56:34,967][123090] Updated weights for policy 1, policy_version 1411795 (0.0005) [2023-12-26 10:56:35,028][123090] Updated weights for policy 1, policy_version 1411805 (0.0005) [2023-12-26 10:56:35,386][123091] Updated weights for policy 0, policy_version 1421369 (0.0007) [2023-12-26 10:56:35,441][123091] Updated weights for policy 0, policy_version 1421379 (0.0010) [2023-12-26 10:56:35,493][123091] Updated weights for policy 0, policy_version 1421389 (0.0010) [2023-12-26 10:56:35,616][123090] Updated weights for policy 1, policy_version 1411815 (0.0009) [2023-12-26 10:56:35,688][123090] Updated weights for policy 1, policy_version 1411825 (0.0010) [2023-12-26 10:56:35,757][123090] Updated weights for policy 1, policy_version 1411835 (0.0010) [2023-12-26 10:56:36,165][123091] Updated weights for policy 0, policy_version 1421399 (0.0008) [2023-12-26 10:56:36,235][123091] Updated weights for policy 0, policy_version 1421409 (0.0006) [2023-12-26 10:56:36,305][123091] Updated weights for policy 0, policy_version 1421419 (0.0007) [2023-12-26 10:56:36,708][123090] Updated weights for policy 1, policy_version 1411845 (0.0009) [2023-12-26 10:56:36,778][123090] Updated weights for policy 1, policy_version 1411855 (0.0010) [2023-12-26 10:56:36,834][123090] Updated weights for policy 1, policy_version 1411865 (0.0009) [2023-12-26 10:56:37,099][123091] Updated weights for policy 0, policy_version 1421429 (0.0009) [2023-12-26 10:56:37,155][123091] Updated weights for policy 0, policy_version 1421439 (0.0010) [2023-12-26 10:56:37,210][123091] Updated weights for policy 0, policy_version 1421449 (0.0010) [2023-12-26 10:56:37,594][123090] Updated weights for policy 1, policy_version 1411875 (0.0008) [2023-12-26 10:56:37,668][123090] Updated weights for policy 1, policy_version 1411885 (0.0005) [2023-12-26 10:56:37,736][123090] Updated weights for policy 1, policy_version 1411895 (0.0006) [2023-12-26 10:56:37,985][123091] Updated weights for policy 0, policy_version 1421459 (0.0009) [2023-12-26 10:56:38,057][123091] Updated weights for policy 0, policy_version 1421469 (0.0005) [2023-12-26 10:56:38,126][123091] Updated weights for policy 0, policy_version 1421479 (0.0005) [2023-12-26 10:56:38,424][123090] Updated weights for policy 1, policy_version 1411905 (0.0006) [2023-12-26 10:56:38,480][123090] Updated weights for policy 1, policy_version 1411915 (0.0008) [2023-12-26 10:56:38,538][123090] Updated weights for policy 1, policy_version 1411925 (0.0006) [2023-12-26 10:56:38,596][123090] Updated weights for policy 1, policy_version 1411935 (0.0005) [2023-12-26 10:56:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 725360640. Throughput: 0: 9119.8, 1: 8961.4. Samples: 725335036. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:38,784][121949] Avg episode reward: [(0, '6215.959'), (1, '5476.460')] [2023-12-26 10:56:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001411936_361455616.pth... [2023-12-26 10:56:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001421488_363905024.pth... [2023-12-26 10:56:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001420432_363634688.pth [2023-12-26 10:56:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001410880_361185280.pth [2023-12-26 10:56:38,815][123091] Updated weights for policy 0, policy_version 1421489 (0.0005) [2023-12-26 10:56:38,868][123091] Updated weights for policy 0, policy_version 1421499 (0.0007) [2023-12-26 10:56:38,930][123091] Updated weights for policy 0, policy_version 1421509 (0.0008) [2023-12-26 10:56:38,978][123091] Updated weights for policy 0, policy_version 1421519 (0.0008) [2023-12-26 10:56:39,299][123090] Updated weights for policy 1, policy_version 1411945 (0.0010) [2023-12-26 10:56:39,363][123090] Updated weights for policy 1, policy_version 1411955 (0.0010) [2023-12-26 10:56:39,432][123090] Updated weights for policy 1, policy_version 1411965 (0.0011) [2023-12-26 10:56:39,776][123091] Updated weights for policy 0, policy_version 1421529 (0.0010) [2023-12-26 10:56:39,847][123091] Updated weights for policy 0, policy_version 1421539 (0.0011) [2023-12-26 10:56:39,916][123091] Updated weights for policy 0, policy_version 1421549 (0.0013) [2023-12-26 10:56:40,233][123090] Updated weights for policy 1, policy_version 1411975 (0.0009) [2023-12-26 10:56:40,296][123090] Updated weights for policy 1, policy_version 1411985 (0.0008) [2023-12-26 10:56:40,360][123090] Updated weights for policy 1, policy_version 1411995 (0.0006) [2023-12-26 10:56:40,681][123091] Updated weights for policy 0, policy_version 1421559 (0.0005) [2023-12-26 10:56:40,752][123091] Updated weights for policy 0, policy_version 1421569 (0.0005) [2023-12-26 10:56:40,815][123091] Updated weights for policy 0, policy_version 1421579 (0.0009) [2023-12-26 10:56:41,148][123090] Updated weights for policy 1, policy_version 1412005 (0.0008) [2023-12-26 10:56:41,220][123090] Updated weights for policy 1, policy_version 1412015 (0.0006) [2023-12-26 10:56:41,294][123090] Updated weights for policy 1, policy_version 1412025 (0.0008) [2023-12-26 10:56:41,594][123091] Updated weights for policy 0, policy_version 1421589 (0.0009) [2023-12-26 10:56:41,665][123091] Updated weights for policy 0, policy_version 1421599 (0.0007) [2023-12-26 10:56:41,745][123091] Updated weights for policy 0, policy_version 1421609 (0.0007) [2023-12-26 10:56:42,148][123090] Updated weights for policy 1, policy_version 1412035 (0.0010) [2023-12-26 10:56:42,211][123090] Updated weights for policy 1, policy_version 1412045 (0.0008) [2023-12-26 10:56:42,281][123090] Updated weights for policy 1, policy_version 1412055 (0.0009) [2023-12-26 10:56:42,522][123091] Updated weights for policy 0, policy_version 1421619 (0.0007) [2023-12-26 10:56:42,588][123091] Updated weights for policy 0, policy_version 1421629 (0.0009) [2023-12-26 10:56:42,651][123091] Updated weights for policy 0, policy_version 1421639 (0.0009) [2023-12-26 10:56:43,136][123090] Updated weights for policy 1, policy_version 1412065 (0.0009) [2023-12-26 10:56:43,197][123090] Updated weights for policy 1, policy_version 1412075 (0.0009) [2023-12-26 10:56:43,249][123090] Updated weights for policy 1, policy_version 1412085 (0.0009) [2023-12-26 10:56:43,309][123090] Updated weights for policy 1, policy_version 1412095 (0.0007) [2023-12-26 10:56:43,369][123091] Updated weights for policy 0, policy_version 1421649 (0.0009) [2023-12-26 10:56:43,439][123091] Updated weights for policy 0, policy_version 1421659 (0.0005) [2023-12-26 10:56:43,511][123091] Updated weights for policy 0, policy_version 1421669 (0.0006) [2023-12-26 10:56:43,570][123091] Updated weights for policy 0, policy_version 1421679 (0.0005) [2023-12-26 10:56:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 725450752. Throughput: 0: 9027.2, 1: 8865.6. Samples: 725442968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:43,785][121949] Avg episode reward: [(0, '6241.881'), (1, '5603.125')] [2023-12-26 10:56:44,119][123090] Updated weights for policy 1, policy_version 1412105 (0.0010) [2023-12-26 10:56:44,185][123090] Updated weights for policy 1, policy_version 1412115 (0.0007) [2023-12-26 10:56:44,215][123091] Updated weights for policy 0, policy_version 1421689 (0.0009) [2023-12-26 10:56:44,242][123090] Updated weights for policy 1, policy_version 1412125 (0.0005) [2023-12-26 10:56:44,272][123091] Updated weights for policy 0, policy_version 1421699 (0.0009) [2023-12-26 10:56:44,324][123091] Updated weights for policy 0, policy_version 1421709 (0.0005) [2023-12-26 10:56:45,053][123090] Updated weights for policy 1, policy_version 1412135 (0.0007) [2023-12-26 10:56:45,054][123091] Updated weights for policy 0, policy_version 1421719 (0.0006) [2023-12-26 10:56:45,109][123091] Updated weights for policy 0, policy_version 1421729 (0.0007) [2023-12-26 10:56:45,117][123090] Updated weights for policy 1, policy_version 1412145 (0.0010) [2023-12-26 10:56:45,173][123091] Updated weights for policy 0, policy_version 1421739 (0.0008) [2023-12-26 10:56:45,181][123090] Updated weights for policy 1, policy_version 1412155 (0.0007) [2023-12-26 10:56:45,864][123090] Updated weights for policy 1, policy_version 1412165 (0.0008) [2023-12-26 10:56:45,932][123090] Updated weights for policy 1, policy_version 1412175 (0.0005) [2023-12-26 10:56:45,952][123091] Updated weights for policy 0, policy_version 1421749 (0.0007) [2023-12-26 10:56:45,988][123090] Updated weights for policy 1, policy_version 1412185 (0.0005) [2023-12-26 10:56:46,008][123091] Updated weights for policy 0, policy_version 1421759 (0.0008) [2023-12-26 10:56:46,069][123091] Updated weights for policy 0, policy_version 1421769 (0.0009) [2023-12-26 10:56:46,638][123090] Updated weights for policy 1, policy_version 1412195 (0.0005) [2023-12-26 10:56:46,687][123090] Updated weights for policy 1, policy_version 1412205 (0.0006) [2023-12-26 10:56:46,744][123090] Updated weights for policy 1, policy_version 1412215 (0.0005) [2023-12-26 10:56:46,951][123091] Updated weights for policy 0, policy_version 1421779 (0.0009) [2023-12-26 10:56:47,008][123091] Updated weights for policy 0, policy_version 1421789 (0.0006) [2023-12-26 10:56:47,077][123091] Updated weights for policy 0, policy_version 1421799 (0.0006) [2023-12-26 10:56:47,440][123090] Updated weights for policy 1, policy_version 1412225 (0.0006) [2023-12-26 10:56:47,503][123090] Updated weights for policy 1, policy_version 1412235 (0.0010) [2023-12-26 10:56:47,550][123090] Updated weights for policy 1, policy_version 1412245 (0.0010) [2023-12-26 10:56:47,594][123090] Updated weights for policy 1, policy_version 1412255 (0.0010) [2023-12-26 10:56:47,761][123091] Updated weights for policy 0, policy_version 1421809 (0.0007) [2023-12-26 10:56:47,825][123091] Updated weights for policy 0, policy_version 1421819 (0.0010) [2023-12-26 10:56:47,887][123091] Updated weights for policy 0, policy_version 1421829 (0.0009) [2023-12-26 10:56:47,954][123091] Updated weights for policy 0, policy_version 1421839 (0.0009) [2023-12-26 10:56:48,406][123090] Updated weights for policy 1, policy_version 1412265 (0.0007) [2023-12-26 10:56:48,466][123090] Updated weights for policy 1, policy_version 1412275 (0.0011) [2023-12-26 10:56:48,522][123090] Updated weights for policy 1, policy_version 1412285 (0.0010) [2023-12-26 10:56:48,769][123091] Updated weights for policy 0, policy_version 1421849 (0.0009) [2023-12-26 10:56:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 725540864. Throughput: 0: 9146.5, 1: 8854.9. Samples: 725554504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:48,785][121949] Avg episode reward: [(0, '6288.649'), (1, '5634.022')] [2023-12-26 10:56:48,825][123091] Updated weights for policy 0, policy_version 1421859 (0.0009) [2023-12-26 10:56:48,874][123091] Updated weights for policy 0, policy_version 1421869 (0.0009) [2023-12-26 10:56:49,363][123090] Updated weights for policy 1, policy_version 1412295 (0.0011) [2023-12-26 10:56:49,422][123090] Updated weights for policy 1, policy_version 1412305 (0.0010) [2023-12-26 10:56:49,485][123090] Updated weights for policy 1, policy_version 1412315 (0.0006) [2023-12-26 10:56:49,724][123091] Updated weights for policy 0, policy_version 1421879 (0.0007) [2023-12-26 10:56:49,796][123091] Updated weights for policy 0, policy_version 1421889 (0.0009) [2023-12-26 10:56:49,867][123091] Updated weights for policy 0, policy_version 1421899 (0.0009) [2023-12-26 10:56:50,254][123090] Updated weights for policy 1, policy_version 1412325 (0.0007) [2023-12-26 10:56:50,316][123090] Updated weights for policy 1, policy_version 1412335 (0.0009) [2023-12-26 10:56:50,375][123090] Updated weights for policy 1, policy_version 1412345 (0.0009) [2023-12-26 10:56:50,642][123091] Updated weights for policy 0, policy_version 1421909 (0.0009) [2023-12-26 10:56:50,702][123091] Updated weights for policy 0, policy_version 1421919 (0.0010) [2023-12-26 10:56:50,756][123091] Updated weights for policy 0, policy_version 1421929 (0.0010) [2023-12-26 10:56:51,209][123090] Updated weights for policy 1, policy_version 1412355 (0.0010) [2023-12-26 10:56:51,273][123090] Updated weights for policy 1, policy_version 1412365 (0.0008) [2023-12-26 10:56:51,338][123090] Updated weights for policy 1, policy_version 1412375 (0.0010) [2023-12-26 10:56:51,675][123091] Updated weights for policy 0, policy_version 1421939 (0.0009) [2023-12-26 10:56:51,738][123091] Updated weights for policy 0, policy_version 1421949 (0.0007) [2023-12-26 10:56:51,801][123091] Updated weights for policy 0, policy_version 1421959 (0.0005) [2023-12-26 10:56:52,217][123090] Updated weights for policy 1, policy_version 1412385 (0.0010) [2023-12-26 10:56:52,272][123090] Updated weights for policy 1, policy_version 1412395 (0.0009) [2023-12-26 10:56:52,340][123090] Updated weights for policy 1, policy_version 1412405 (0.0009) [2023-12-26 10:56:52,414][123090] Updated weights for policy 1, policy_version 1412415 (0.0008) [2023-12-26 10:56:52,541][123091] Updated weights for policy 0, policy_version 1421969 (0.0006) [2023-12-26 10:56:52,605][123091] Updated weights for policy 0, policy_version 1421979 (0.0006) [2023-12-26 10:56:52,681][123091] Updated weights for policy 0, policy_version 1421989 (0.0006) [2023-12-26 10:56:52,756][123091] Updated weights for policy 0, policy_version 1421999 (0.0005) [2023-12-26 10:56:53,217][123090] Updated weights for policy 1, policy_version 1412425 (0.0006) [2023-12-26 10:56:53,275][123090] Updated weights for policy 1, policy_version 1412435 (0.0005) [2023-12-26 10:56:53,332][123090] Updated weights for policy 1, policy_version 1412445 (0.0005) [2023-12-26 10:56:53,371][123091] Updated weights for policy 0, policy_version 1422009 (0.0005) [2023-12-26 10:56:53,431][123091] Updated weights for policy 0, policy_version 1422019 (0.0005) [2023-12-26 10:56:53,490][123091] Updated weights for policy 0, policy_version 1422029 (0.0006) [2023-12-26 10:56:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 725630976. Throughput: 0: 9113.7, 1: 8836.7. Samples: 725605684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:53,785][121949] Avg episode reward: [(0, '6371.841'), (1, '5558.667')] [2023-12-26 10:56:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001412448_361586688.pth... [2023-12-26 10:56:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001422032_364044288.pth... [2023-12-26 10:56:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001411392_361316352.pth [2023-12-26 10:56:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001420944_363765760.pth [2023-12-26 10:56:54,123][123091] Updated weights for policy 0, policy_version 1422039 (0.0005) [2023-12-26 10:56:54,161][123090] Updated weights for policy 1, policy_version 1412455 (0.0007) [2023-12-26 10:56:54,186][123091] Updated weights for policy 0, policy_version 1422049 (0.0006) [2023-12-26 10:56:54,222][123090] Updated weights for policy 1, policy_version 1412465 (0.0010) [2023-12-26 10:56:54,231][123091] Updated weights for policy 0, policy_version 1422059 (0.0007) [2023-12-26 10:56:54,289][123090] Updated weights for policy 1, policy_version 1412475 (0.0008) [2023-12-26 10:56:54,921][123091] Updated weights for policy 0, policy_version 1422069 (0.0007) [2023-12-26 10:56:54,984][123091] Updated weights for policy 0, policy_version 1422079 (0.0009) [2023-12-26 10:56:55,048][123091] Updated weights for policy 0, policy_version 1422089 (0.0010) [2023-12-26 10:56:55,132][123090] Updated weights for policy 1, policy_version 1412485 (0.0009) [2023-12-26 10:56:55,193][123090] Updated weights for policy 1, policy_version 1412495 (0.0009) [2023-12-26 10:56:55,245][123090] Updated weights for policy 1, policy_version 1412505 (0.0009) [2023-12-26 10:56:55,834][123091] Updated weights for policy 0, policy_version 1422099 (0.0010) [2023-12-26 10:56:55,884][123091] Updated weights for policy 0, policy_version 1422109 (0.0009) [2023-12-26 10:56:55,939][123091] Updated weights for policy 0, policy_version 1422119 (0.0009) [2023-12-26 10:56:56,114][123090] Updated weights for policy 1, policy_version 1412516 (0.0010) [2023-12-26 10:56:56,163][123090] Updated weights for policy 1, policy_version 1412527 (0.0009) [2023-12-26 10:56:56,215][123090] Updated weights for policy 1, policy_version 1412537 (0.0009) [2023-12-26 10:56:56,718][123091] Updated weights for policy 0, policy_version 1422129 (0.0009) [2023-12-26 10:56:56,773][123091] Updated weights for policy 0, policy_version 1422139 (0.0006) [2023-12-26 10:56:56,835][123091] Updated weights for policy 0, policy_version 1422149 (0.0005) [2023-12-26 10:56:56,890][123091] Updated weights for policy 0, policy_version 1422159 (0.0006) [2023-12-26 10:56:57,096][123090] Updated weights for policy 1, policy_version 1412547 (0.0010) [2023-12-26 10:56:57,153][123090] Updated weights for policy 1, policy_version 1412557 (0.0010) [2023-12-26 10:56:57,206][123090] Updated weights for policy 1, policy_version 1412567 (0.0010) [2023-12-26 10:56:57,562][123091] Updated weights for policy 0, policy_version 1422169 (0.0005) [2023-12-26 10:56:57,621][123091] Updated weights for policy 0, policy_version 1422179 (0.0006) [2023-12-26 10:56:57,677][123091] Updated weights for policy 0, policy_version 1422189 (0.0009) [2023-12-26 10:56:58,101][123090] Updated weights for policy 1, policy_version 1412577 (0.0009) [2023-12-26 10:56:58,168][123090] Updated weights for policy 1, policy_version 1412587 (0.0007) [2023-12-26 10:56:58,234][123090] Updated weights for policy 1, policy_version 1412597 (0.0010) [2023-12-26 10:56:58,296][123090] Updated weights for policy 1, policy_version 1412607 (0.0010) [2023-12-26 10:56:58,523][123091] Updated weights for policy 0, policy_version 1422199 (0.0009) [2023-12-26 10:56:58,599][123091] Updated weights for policy 0, policy_version 1422210 (0.0009) [2023-12-26 10:56:58,665][123091] Updated weights for policy 0, policy_version 1422220 (0.0009) [2023-12-26 10:56:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 18021.8, 300 sec: 17827.9). Total num frames: 725721088. Throughput: 0: 9158.9, 1: 8884.8. Samples: 725713744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:56:58,786][121949] Avg episode reward: [(0, '6239.771'), (1, '5635.284')] [2023-12-26 10:56:59,120][123090] Updated weights for policy 1, policy_version 1412617 (0.0008) [2023-12-26 10:56:59,194][123090] Updated weights for policy 1, policy_version 1412627 (0.0008) [2023-12-26 10:56:59,262][123090] Updated weights for policy 1, policy_version 1412637 (0.0009) [2023-12-26 10:56:59,597][123091] Updated weights for policy 0, policy_version 1422230 (0.0010) [2023-12-26 10:56:59,664][123091] Updated weights for policy 0, policy_version 1422240 (0.0009) [2023-12-26 10:56:59,730][123091] Updated weights for policy 0, policy_version 1422250 (0.0009) [2023-12-26 10:57:00,054][123090] Updated weights for policy 1, policy_version 1412647 (0.0007) [2023-12-26 10:57:00,124][123090] Updated weights for policy 1, policy_version 1412657 (0.0006) [2023-12-26 10:57:00,182][123090] Updated weights for policy 1, policy_version 1412667 (0.0006) [2023-12-26 10:57:00,624][123091] Updated weights for policy 0, policy_version 1422260 (0.0009) [2023-12-26 10:57:00,685][123091] Updated weights for policy 0, policy_version 1422270 (0.0007) [2023-12-26 10:57:00,747][123091] Updated weights for policy 0, policy_version 1422280 (0.0008) [2023-12-26 10:57:00,875][123090] Updated weights for policy 1, policy_version 1412677 (0.0007) [2023-12-26 10:57:00,926][123090] Updated weights for policy 1, policy_version 1412687 (0.0009) [2023-12-26 10:57:00,988][123090] Updated weights for policy 1, policy_version 1412697 (0.0010) [2023-12-26 10:57:01,562][123091] Updated weights for policy 0, policy_version 1422290 (0.0010) [2023-12-26 10:57:01,629][123091] Updated weights for policy 0, policy_version 1422300 (0.0009) [2023-12-26 10:57:01,695][123091] Updated weights for policy 0, policy_version 1422310 (0.0007) [2023-12-26 10:57:01,773][123091] Updated weights for policy 0, policy_version 1422320 (0.0007) [2023-12-26 10:57:01,861][123090] Updated weights for policy 1, policy_version 1412707 (0.0008) [2023-12-26 10:57:01,916][123090] Updated weights for policy 1, policy_version 1412717 (0.0006) [2023-12-26 10:57:01,972][123090] Updated weights for policy 1, policy_version 1412727 (0.0005) [2023-12-26 10:57:02,452][123091] Updated weights for policy 0, policy_version 1422330 (0.0006) [2023-12-26 10:57:02,522][123091] Updated weights for policy 0, policy_version 1422340 (0.0007) [2023-12-26 10:57:02,534][123090] Updated weights for policy 1, policy_version 1412737 (0.0007) [2023-12-26 10:57:02,592][123090] Updated weights for policy 1, policy_version 1412747 (0.0006) [2023-12-26 10:57:02,593][123091] Updated weights for policy 0, policy_version 1422350 (0.0006) [2023-12-26 10:57:02,656][123090] Updated weights for policy 1, policy_version 1412757 (0.0006) [2023-12-26 10:57:02,718][123090] Updated weights for policy 1, policy_version 1412767 (0.0005) [2023-12-26 10:57:03,359][123091] Updated weights for policy 0, policy_version 1422360 (0.0008) [2023-12-26 10:57:03,411][123091] Updated weights for policy 0, policy_version 1422370 (0.0010) [2023-12-26 10:57:03,455][123091] Updated weights for policy 0, policy_version 1422380 (0.0009) [2023-12-26 10:57:03,457][123090] Updated weights for policy 1, policy_version 1412777 (0.0008) [2023-12-26 10:57:03,504][123090] Updated weights for policy 1, policy_version 1412787 (0.0008) [2023-12-26 10:57:03,569][123090] Updated weights for policy 1, policy_version 1412797 (0.0009) [2023-12-26 10:57:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 725811200. Throughput: 0: 9075.3, 1: 8924.6. Samples: 725818168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:03,785][121949] Avg episode reward: [(0, '6066.221'), (1, '5782.940')] [2023-12-26 10:57:04,345][123091] Updated weights for policy 0, policy_version 1422390 (0.0008) [2023-12-26 10:57:04,393][123090] Updated weights for policy 1, policy_version 1412807 (0.0007) [2023-12-26 10:57:04,415][123091] Updated weights for policy 0, policy_version 1422400 (0.0008) [2023-12-26 10:57:04,452][123090] Updated weights for policy 1, policy_version 1412817 (0.0005) [2023-12-26 10:57:04,481][123091] Updated weights for policy 0, policy_version 1422410 (0.0008) [2023-12-26 10:57:04,504][123090] Updated weights for policy 1, policy_version 1412827 (0.0005) [2023-12-26 10:57:05,151][123090] Updated weights for policy 1, policy_version 1412837 (0.0005) [2023-12-26 10:57:05,207][123090] Updated weights for policy 1, policy_version 1412847 (0.0005) [2023-12-26 10:57:05,258][123090] Updated weights for policy 1, policy_version 1412857 (0.0005) [2023-12-26 10:57:05,327][123091] Updated weights for policy 0, policy_version 1422420 (0.0007) [2023-12-26 10:57:05,374][123091] Updated weights for policy 0, policy_version 1422430 (0.0005) [2023-12-26 10:57:05,421][123091] Updated weights for policy 0, policy_version 1422440 (0.0005) [2023-12-26 10:57:06,071][123090] Updated weights for policy 1, policy_version 1412867 (0.0008) [2023-12-26 10:57:06,143][123090] Updated weights for policy 1, policy_version 1412877 (0.0009) [2023-12-26 10:57:06,170][123091] Updated weights for policy 0, policy_version 1422450 (0.0006) [2023-12-26 10:57:06,210][123090] Updated weights for policy 1, policy_version 1412887 (0.0007) [2023-12-26 10:57:06,239][123091] Updated weights for policy 0, policy_version 1422460 (0.0007) [2023-12-26 10:57:06,291][123091] Updated weights for policy 0, policy_version 1422470 (0.0009) [2023-12-26 10:57:06,341][123091] Updated weights for policy 0, policy_version 1422480 (0.0009) [2023-12-26 10:57:06,971][123090] Updated weights for policy 1, policy_version 1412897 (0.0009) [2023-12-26 10:57:07,038][123090] Updated weights for policy 1, policy_version 1412907 (0.0008) [2023-12-26 10:57:07,102][123090] Updated weights for policy 1, policy_version 1412917 (0.0008) [2023-12-26 10:57:07,169][123090] Updated weights for policy 1, policy_version 1412927 (0.0008) [2023-12-26 10:57:07,218][123091] Updated weights for policy 0, policy_version 1422490 (0.0010) [2023-12-26 10:57:07,298][123091] Updated weights for policy 0, policy_version 1422500 (0.0010) [2023-12-26 10:57:07,364][123091] Updated weights for policy 0, policy_version 1422510 (0.0009) [2023-12-26 10:57:07,901][123090] Updated weights for policy 1, policy_version 1412937 (0.0009) [2023-12-26 10:57:07,957][123090] Updated weights for policy 1, policy_version 1412947 (0.0008) [2023-12-26 10:57:08,031][123090] Updated weights for policy 1, policy_version 1412957 (0.0009) [2023-12-26 10:57:08,215][123091] Updated weights for policy 0, policy_version 1422520 (0.0009) [2023-12-26 10:57:08,281][123091] Updated weights for policy 0, policy_version 1422530 (0.0010) [2023-12-26 10:57:08,349][123091] Updated weights for policy 0, policy_version 1422540 (0.0010) [2023-12-26 10:57:08,784][121949] Fps is (10 sec: 17206.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 725893120. Throughput: 0: 9071.6, 1: 8985.4. Samples: 725871648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:08,785][121949] Avg episode reward: [(0, '6195.852'), (1, '5688.971')] [2023-12-26 10:57:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001422544_364175360.pth... [2023-12-26 10:57:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001412960_361717760.pth... [2023-12-26 10:57:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001421488_363905024.pth [2023-12-26 10:57:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001411936_361455616.pth [2023-12-26 10:57:08,860][123090] Updated weights for policy 1, policy_version 1412967 (0.0007) [2023-12-26 10:57:08,928][123090] Updated weights for policy 1, policy_version 1412977 (0.0009) [2023-12-26 10:57:08,990][123090] Updated weights for policy 1, policy_version 1412987 (0.0007) [2023-12-26 10:57:09,207][123091] Updated weights for policy 0, policy_version 1422550 (0.0009) [2023-12-26 10:57:09,280][123091] Updated weights for policy 0, policy_version 1422560 (0.0010) [2023-12-26 10:57:09,344][123091] Updated weights for policy 0, policy_version 1422570 (0.0009) [2023-12-26 10:57:09,787][123090] Updated weights for policy 1, policy_version 1412997 (0.0008) [2023-12-26 10:57:09,850][123090] Updated weights for policy 1, policy_version 1413007 (0.0008) [2023-12-26 10:57:09,921][123090] Updated weights for policy 1, policy_version 1413017 (0.0006) [2023-12-26 10:57:10,240][123091] Updated weights for policy 0, policy_version 1422580 (0.0009) [2023-12-26 10:57:10,305][123091] Updated weights for policy 0, policy_version 1422590 (0.0009) [2023-12-26 10:57:10,359][123091] Updated weights for policy 0, policy_version 1422600 (0.0009) [2023-12-26 10:57:10,738][123090] Updated weights for policy 1, policy_version 1413027 (0.0010) [2023-12-26 10:57:10,798][123090] Updated weights for policy 1, policy_version 1413037 (0.0009) [2023-12-26 10:57:10,874][123090] Updated weights for policy 1, policy_version 1413047 (0.0009) [2023-12-26 10:57:11,207][123091] Updated weights for policy 0, policy_version 1422610 (0.0009) [2023-12-26 10:57:11,276][123091] Updated weights for policy 0, policy_version 1422620 (0.0009) [2023-12-26 10:57:11,344][123091] Updated weights for policy 0, policy_version 1422630 (0.0010) [2023-12-26 10:57:11,413][123091] Updated weights for policy 0, policy_version 1422640 (0.0009) [2023-12-26 10:57:11,619][123090] Updated weights for policy 1, policy_version 1413057 (0.0009) [2023-12-26 10:57:11,689][123090] Updated weights for policy 1, policy_version 1413067 (0.0010) [2023-12-26 10:57:11,757][123090] Updated weights for policy 1, policy_version 1413077 (0.0009) [2023-12-26 10:57:11,824][123090] Updated weights for policy 1, policy_version 1413087 (0.0009) [2023-12-26 10:57:12,252][123091] Updated weights for policy 0, policy_version 1422650 (0.0010) [2023-12-26 10:57:12,311][123091] Updated weights for policy 0, policy_version 1422660 (0.0010) [2023-12-26 10:57:12,377][123091] Updated weights for policy 0, policy_version 1422670 (0.0010) [2023-12-26 10:57:12,636][123090] Updated weights for policy 1, policy_version 1413097 (0.0010) [2023-12-26 10:57:12,698][123090] Updated weights for policy 1, policy_version 1413107 (0.0008) [2023-12-26 10:57:12,763][123090] Updated weights for policy 1, policy_version 1413117 (0.0009) [2023-12-26 10:57:13,216][123091] Updated weights for policy 0, policy_version 1422680 (0.0010) [2023-12-26 10:57:13,269][123091] Updated weights for policy 0, policy_version 1422690 (0.0010) [2023-12-26 10:57:13,325][123091] Updated weights for policy 0, policy_version 1422700 (0.0009) [2023-12-26 10:57:13,511][123090] Updated weights for policy 1, policy_version 1413127 (0.0006) [2023-12-26 10:57:13,578][123090] Updated weights for policy 1, policy_version 1413137 (0.0009) [2023-12-26 10:57:13,643][123090] Updated weights for policy 1, policy_version 1413147 (0.0010) [2023-12-26 10:57:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 725983232. Throughput: 0: 8920.5, 1: 8935.8. Samples: 725973716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:13,784][121949] Avg episode reward: [(0, '6192.814'), (1, '5698.264')] [2023-12-26 10:57:14,080][123091] Updated weights for policy 0, policy_version 1422710 (0.0007) [2023-12-26 10:57:14,127][123091] Updated weights for policy 0, policy_version 1422720 (0.0005) [2023-12-26 10:57:14,173][123091] Updated weights for policy 0, policy_version 1422730 (0.0005) [2023-12-26 10:57:14,526][123090] Updated weights for policy 1, policy_version 1413157 (0.0007) [2023-12-26 10:57:14,594][123090] Updated weights for policy 1, policy_version 1413167 (0.0007) [2023-12-26 10:57:14,649][123090] Updated weights for policy 1, policy_version 1413177 (0.0009) [2023-12-26 10:57:14,974][123091] Updated weights for policy 0, policy_version 1422740 (0.0006) [2023-12-26 10:57:15,041][123091] Updated weights for policy 0, policy_version 1422750 (0.0008) [2023-12-26 10:57:15,108][123091] Updated weights for policy 0, policy_version 1422760 (0.0009) [2023-12-26 10:57:15,466][123090] Updated weights for policy 1, policy_version 1413187 (0.0008) [2023-12-26 10:57:15,515][123090] Updated weights for policy 1, policy_version 1413197 (0.0009) [2023-12-26 10:57:15,573][123090] Updated weights for policy 1, policy_version 1413207 (0.0009) [2023-12-26 10:57:15,925][123091] Updated weights for policy 0, policy_version 1422770 (0.0007) [2023-12-26 10:57:15,994][123091] Updated weights for policy 0, policy_version 1422780 (0.0007) [2023-12-26 10:57:16,047][123091] Updated weights for policy 0, policy_version 1422790 (0.0009) [2023-12-26 10:57:16,100][123091] Updated weights for policy 0, policy_version 1422800 (0.0010) [2023-12-26 10:57:16,348][123090] Updated weights for policy 1, policy_version 1413217 (0.0009) [2023-12-26 10:57:16,404][123090] Updated weights for policy 1, policy_version 1413227 (0.0009) [2023-12-26 10:57:16,465][123090] Updated weights for policy 1, policy_version 1413237 (0.0009) [2023-12-26 10:57:16,516][123090] Updated weights for policy 1, policy_version 1413247 (0.0009) [2023-12-26 10:57:16,888][123091] Updated weights for policy 0, policy_version 1422810 (0.0005) [2023-12-26 10:57:16,955][123091] Updated weights for policy 0, policy_version 1422820 (0.0005) [2023-12-26 10:57:17,012][123091] Updated weights for policy 0, policy_version 1422830 (0.0005) [2023-12-26 10:57:17,423][123090] Updated weights for policy 1, policy_version 1413257 (0.0010) [2023-12-26 10:57:17,475][123090] Updated weights for policy 1, policy_version 1413267 (0.0009) [2023-12-26 10:57:17,534][123090] Updated weights for policy 1, policy_version 1413277 (0.0010) [2023-12-26 10:57:17,600][123091] Updated weights for policy 0, policy_version 1422840 (0.0005) [2023-12-26 10:57:17,656][123091] Updated weights for policy 0, policy_version 1422850 (0.0005) [2023-12-26 10:57:17,712][123091] Updated weights for policy 0, policy_version 1422860 (0.0006) [2023-12-26 10:57:18,385][123091] Updated weights for policy 0, policy_version 1422870 (0.0006) [2023-12-26 10:57:18,437][123091] Updated weights for policy 0, policy_version 1422880 (0.0005) [2023-12-26 10:57:18,476][123090] Updated weights for policy 1, policy_version 1413287 (0.0009) [2023-12-26 10:57:18,497][123091] Updated weights for policy 0, policy_version 1422890 (0.0006) [2023-12-26 10:57:18,533][123090] Updated weights for policy 1, policy_version 1413297 (0.0008) [2023-12-26 10:57:18,593][123090] Updated weights for policy 1, policy_version 1413307 (0.0009) [2023-12-26 10:57:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 726073344. Throughput: 0: 8953.2, 1: 8841.2. Samples: 726080868. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:18,784][121949] Avg episode reward: [(0, '6219.277'), (1, '5640.073')] [2023-12-26 10:57:19,284][123091] Updated weights for policy 0, policy_version 1422900 (0.0007) [2023-12-26 10:57:19,348][123091] Updated weights for policy 0, policy_version 1422910 (0.0011) [2023-12-26 10:57:19,407][123091] Updated weights for policy 0, policy_version 1422920 (0.0011) [2023-12-26 10:57:19,470][123090] Updated weights for policy 1, policy_version 1413317 (0.0009) [2023-12-26 10:57:19,540][123090] Updated weights for policy 1, policy_version 1413327 (0.0009) [2023-12-26 10:57:19,603][123090] Updated weights for policy 1, policy_version 1413337 (0.0009) [2023-12-26 10:57:20,303][123091] Updated weights for policy 0, policy_version 1422930 (0.0011) [2023-12-26 10:57:20,364][123091] Updated weights for policy 0, policy_version 1422940 (0.0010) [2023-12-26 10:57:20,428][123091] Updated weights for policy 0, policy_version 1422950 (0.0010) [2023-12-26 10:57:20,456][123090] Updated weights for policy 1, policy_version 1413347 (0.0008) [2023-12-26 10:57:20,488][123091] Updated weights for policy 0, policy_version 1422960 (0.0011) [2023-12-26 10:57:20,524][123090] Updated weights for policy 1, policy_version 1413357 (0.0007) [2023-12-26 10:57:20,593][123090] Updated weights for policy 1, policy_version 1413367 (0.0008) [2023-12-26 10:57:21,314][123091] Updated weights for policy 0, policy_version 1422970 (0.0010) [2023-12-26 10:57:21,382][123091] Updated weights for policy 0, policy_version 1422980 (0.0010) [2023-12-26 10:57:21,393][123090] Updated weights for policy 1, policy_version 1413377 (0.0010) [2023-12-26 10:57:21,447][123091] Updated weights for policy 0, policy_version 1422990 (0.0008) [2023-12-26 10:57:21,463][123090] Updated weights for policy 1, policy_version 1413387 (0.0009) [2023-12-26 10:57:21,526][123090] Updated weights for policy 1, policy_version 1413397 (0.0005) [2023-12-26 10:57:21,589][123090] Updated weights for policy 1, policy_version 1413407 (0.0008) [2023-12-26 10:57:22,228][123091] Updated weights for policy 0, policy_version 1423000 (0.0006) [2023-12-26 10:57:22,298][123091] Updated weights for policy 0, policy_version 1423010 (0.0010) [2023-12-26 10:57:22,362][123091] Updated weights for policy 0, policy_version 1423020 (0.0009) [2023-12-26 10:57:22,420][123090] Updated weights for policy 1, policy_version 1413417 (0.0006) [2023-12-26 10:57:22,473][123090] Updated weights for policy 1, policy_version 1413427 (0.0006) [2023-12-26 10:57:22,530][123090] Updated weights for policy 1, policy_version 1413437 (0.0007) [2023-12-26 10:57:23,187][123091] Updated weights for policy 0, policy_version 1423030 (0.0010) [2023-12-26 10:57:23,248][123091] Updated weights for policy 0, policy_version 1423040 (0.0009) [2023-12-26 10:57:23,300][123091] Updated weights for policy 0, policy_version 1423050 (0.0009) [2023-12-26 10:57:23,362][123090] Updated weights for policy 1, policy_version 1413447 (0.0009) [2023-12-26 10:57:23,416][123090] Updated weights for policy 1, policy_version 1413457 (0.0009) [2023-12-26 10:57:23,465][123090] Updated weights for policy 1, policy_version 1413467 (0.0009) [2023-12-26 10:57:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 726155264. Throughput: 0: 8902.7, 1: 8799.3. Samples: 726131624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:23,784][121949] Avg episode reward: [(0, '6131.842'), (1, '5400.586')] [2023-12-26 10:57:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001423056_364306432.pth... [2023-12-26 10:57:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001413472_361848832.pth... [2023-12-26 10:57:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001422032_364044288.pth [2023-12-26 10:57:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001412448_361586688.pth [2023-12-26 10:57:24,120][123091] Updated weights for policy 0, policy_version 1423060 (0.0008) [2023-12-26 10:57:24,168][123091] Updated weights for policy 0, policy_version 1423070 (0.0006) [2023-12-26 10:57:24,218][123091] Updated weights for policy 0, policy_version 1423080 (0.0009) [2023-12-26 10:57:24,226][123090] Updated weights for policy 1, policy_version 1413477 (0.0010) [2023-12-26 10:57:24,290][123090] Updated weights for policy 1, policy_version 1413487 (0.0010) [2023-12-26 10:57:24,352][123090] Updated weights for policy 1, policy_version 1413497 (0.0010) [2023-12-26 10:57:25,013][123091] Updated weights for policy 0, policy_version 1423090 (0.0009) [2023-12-26 10:57:25,076][123091] Updated weights for policy 0, policy_version 1423100 (0.0007) [2023-12-26 10:57:25,148][123091] Updated weights for policy 0, policy_version 1423110 (0.0008) [2023-12-26 10:57:25,179][123090] Updated weights for policy 1, policy_version 1413507 (0.0011) [2023-12-26 10:57:25,203][123091] Updated weights for policy 0, policy_version 1423120 (0.0008) [2023-12-26 10:57:25,231][123090] Updated weights for policy 1, policy_version 1413517 (0.0010) [2023-12-26 10:57:25,286][123090] Updated weights for policy 1, policy_version 1413527 (0.0010) [2023-12-26 10:57:25,976][123091] Updated weights for policy 0, policy_version 1423130 (0.0009) [2023-12-26 10:57:26,041][123091] Updated weights for policy 0, policy_version 1423140 (0.0010) [2023-12-26 10:57:26,088][123091] Updated weights for policy 0, policy_version 1423150 (0.0005) [2023-12-26 10:57:26,124][123090] Updated weights for policy 1, policy_version 1413537 (0.0010) [2023-12-26 10:57:26,173][123090] Updated weights for policy 1, policy_version 1413547 (0.0010) [2023-12-26 10:57:26,221][123090] Updated weights for policy 1, policy_version 1413557 (0.0010) [2023-12-26 10:57:26,276][123090] Updated weights for policy 1, policy_version 1413567 (0.0010) [2023-12-26 10:57:26,806][123091] Updated weights for policy 0, policy_version 1423160 (0.0006) [2023-12-26 10:57:26,867][123091] Updated weights for policy 0, policy_version 1423170 (0.0005) [2023-12-26 10:57:26,930][123091] Updated weights for policy 0, policy_version 1423180 (0.0005) [2023-12-26 10:57:27,049][123090] Updated weights for policy 1, policy_version 1413577 (0.0006) [2023-12-26 10:57:27,121][123090] Updated weights for policy 1, policy_version 1413587 (0.0005) [2023-12-26 10:57:27,187][123090] Updated weights for policy 1, policy_version 1413597 (0.0005) [2023-12-26 10:57:27,645][123091] Updated weights for policy 0, policy_version 1423190 (0.0006) [2023-12-26 10:57:27,694][123091] Updated weights for policy 0, policy_version 1423200 (0.0006) [2023-12-26 10:57:27,744][123091] Updated weights for policy 0, policy_version 1423210 (0.0006) [2023-12-26 10:57:27,802][123090] Updated weights for policy 1, policy_version 1413607 (0.0005) [2023-12-26 10:57:27,860][123090] Updated weights for policy 1, policy_version 1413617 (0.0009) [2023-12-26 10:57:27,908][123090] Updated weights for policy 1, policy_version 1413627 (0.0010) [2023-12-26 10:57:28,441][123091] Updated weights for policy 0, policy_version 1423220 (0.0007) [2023-12-26 10:57:28,495][123091] Updated weights for policy 0, policy_version 1423230 (0.0008) [2023-12-26 10:57:28,558][123091] Updated weights for policy 0, policy_version 1423240 (0.0008) [2023-12-26 10:57:28,738][123090] Updated weights for policy 1, policy_version 1413637 (0.0010) [2023-12-26 10:57:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 726245376. Throughput: 0: 8907.8, 1: 8794.9. Samples: 726239588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:28,785][121949] Avg episode reward: [(0, '5962.174'), (1, '5372.789')] [2023-12-26 10:57:28,789][123090] Updated weights for policy 1, policy_version 1413647 (0.0010) [2023-12-26 10:57:28,835][123090] Updated weights for policy 1, policy_version 1413657 (0.0005) [2023-12-26 10:57:29,324][123091] Updated weights for policy 0, policy_version 1423250 (0.0007) [2023-12-26 10:57:29,395][123091] Updated weights for policy 0, policy_version 1423260 (0.0009) [2023-12-26 10:57:29,461][123091] Updated weights for policy 0, policy_version 1423270 (0.0006) [2023-12-26 10:57:29,526][123091] Updated weights for policy 0, policy_version 1423280 (0.0005) [2023-12-26 10:57:29,604][123090] Updated weights for policy 1, policy_version 1413667 (0.0005) [2023-12-26 10:57:29,667][123090] Updated weights for policy 1, policy_version 1413677 (0.0005) [2023-12-26 10:57:29,725][123090] Updated weights for policy 1, policy_version 1413687 (0.0005) [2023-12-26 10:57:30,234][123091] Updated weights for policy 0, policy_version 1423290 (0.0008) [2023-12-26 10:57:30,290][123091] Updated weights for policy 0, policy_version 1423300 (0.0005) [2023-12-26 10:57:30,323][123090] Updated weights for policy 1, policy_version 1413697 (0.0005) [2023-12-26 10:57:30,349][123091] Updated weights for policy 0, policy_version 1423310 (0.0007) [2023-12-26 10:57:30,386][123090] Updated weights for policy 1, policy_version 1413707 (0.0006) [2023-12-26 10:57:30,453][123090] Updated weights for policy 1, policy_version 1413717 (0.0006) [2023-12-26 10:57:30,522][123090] Updated weights for policy 1, policy_version 1413727 (0.0006) [2023-12-26 10:57:31,055][123091] Updated weights for policy 0, policy_version 1423320 (0.0008) [2023-12-26 10:57:31,121][123091] Updated weights for policy 0, policy_version 1423330 (0.0007) [2023-12-26 10:57:31,189][123091] Updated weights for policy 0, policy_version 1423340 (0.0007) [2023-12-26 10:57:31,189][123090] Updated weights for policy 1, policy_version 1413737 (0.0006) [2023-12-26 10:57:31,258][123090] Updated weights for policy 1, policy_version 1413747 (0.0006) [2023-12-26 10:57:31,326][123090] Updated weights for policy 1, policy_version 1413757 (0.0009) [2023-12-26 10:57:31,887][123091] Updated weights for policy 0, policy_version 1423350 (0.0007) [2023-12-26 10:57:31,938][123091] Updated weights for policy 0, policy_version 1423360 (0.0005) [2023-12-26 10:57:31,997][123091] Updated weights for policy 0, policy_version 1423370 (0.0005) [2023-12-26 10:57:32,129][123090] Updated weights for policy 1, policy_version 1413767 (0.0008) [2023-12-26 10:57:32,194][123090] Updated weights for policy 1, policy_version 1413777 (0.0009) [2023-12-26 10:57:32,262][123090] Updated weights for policy 1, policy_version 1413787 (0.0008) [2023-12-26 10:57:32,777][123091] Updated weights for policy 0, policy_version 1423380 (0.0007) [2023-12-26 10:57:32,833][123091] Updated weights for policy 0, policy_version 1423390 (0.0009) [2023-12-26 10:57:32,897][123091] Updated weights for policy 0, policy_version 1423400 (0.0009) [2023-12-26 10:57:32,912][123090] Updated weights for policy 1, policy_version 1413797 (0.0006) [2023-12-26 10:57:32,980][123090] Updated weights for policy 1, policy_version 1413807 (0.0006) [2023-12-26 10:57:33,049][123090] Updated weights for policy 1, policy_version 1413817 (0.0010) [2023-12-26 10:57:33,650][123091] Updated weights for policy 0, policy_version 1423410 (0.0007) [2023-12-26 10:57:33,729][123091] Updated weights for policy 0, policy_version 1423420 (0.0006) [2023-12-26 10:57:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 726335488. Throughput: 0: 8926.7, 1: 8821.3. Samples: 726353160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:57:33,784][121949] Avg episode reward: [(0, '5979.446'), (1, '5247.743')] [2023-12-26 10:57:33,798][123091] Updated weights for policy 0, policy_version 1423430 (0.0005) [2023-12-26 10:57:33,810][123090] Updated weights for policy 1, policy_version 1413827 (0.0010) [2023-12-26 10:57:33,852][123091] Updated weights for policy 0, policy_version 1423440 (0.0005) [2023-12-26 10:57:33,857][123090] Updated weights for policy 1, policy_version 1413837 (0.0010) [2023-12-26 10:57:33,915][123090] Updated weights for policy 1, policy_version 1413847 (0.0010) [2023-12-26 10:57:34,523][123091] Updated weights for policy 0, policy_version 1423450 (0.0011) [2023-12-26 10:57:34,571][123091] Updated weights for policy 0, policy_version 1423460 (0.0010) [2023-12-26 10:57:34,631][123091] Updated weights for policy 0, policy_version 1423470 (0.0011) [2023-12-26 10:57:34,776][123090] Updated weights for policy 1, policy_version 1413857 (0.0010) [2023-12-26 10:57:34,846][123090] Updated weights for policy 1, policy_version 1413867 (0.0010) [2023-12-26 10:57:34,901][123090] Updated weights for policy 1, policy_version 1413877 (0.0010) [2023-12-26 10:57:34,957][123090] Updated weights for policy 1, policy_version 1413887 (0.0010) [2023-12-26 10:57:35,409][123091] Updated weights for policy 0, policy_version 1423480 (0.0006) [2023-12-26 10:57:35,464][123091] Updated weights for policy 0, policy_version 1423490 (0.0005) [2023-12-26 10:57:35,509][123091] Updated weights for policy 0, policy_version 1423500 (0.0005) [2023-12-26 10:57:35,702][123090] Updated weights for policy 1, policy_version 1413897 (0.0007) [2023-12-26 10:57:35,778][123090] Updated weights for policy 1, policy_version 1413907 (0.0006) [2023-12-26 10:57:35,843][123090] Updated weights for policy 1, policy_version 1413917 (0.0006) [2023-12-26 10:57:36,188][123091] Updated weights for policy 0, policy_version 1423510 (0.0005) [2023-12-26 10:57:36,247][123091] Updated weights for policy 0, policy_version 1423520 (0.0005) [2023-12-26 10:57:36,315][123091] Updated weights for policy 0, policy_version 1423530 (0.0005) [2023-12-26 10:57:36,549][123090] Updated weights for policy 1, policy_version 1413927 (0.0008) [2023-12-26 10:57:36,616][123090] Updated weights for policy 1, policy_version 1413937 (0.0009) [2023-12-26 10:57:36,679][123090] Updated weights for policy 1, policy_version 1413947 (0.0010) [2023-12-26 10:57:37,008][123091] Updated weights for policy 0, policy_version 1423540 (0.0007) [2023-12-26 10:57:37,081][123091] Updated weights for policy 0, policy_version 1423550 (0.0008) [2023-12-26 10:57:37,146][123091] Updated weights for policy 0, policy_version 1423560 (0.0008) [2023-12-26 10:57:37,543][123090] Updated weights for policy 1, policy_version 1413957 (0.0008) [2023-12-26 10:57:37,596][123090] Updated weights for policy 1, policy_version 1413967 (0.0005) [2023-12-26 10:57:37,664][123090] Updated weights for policy 1, policy_version 1413977 (0.0006) [2023-12-26 10:57:37,915][123091] Updated weights for policy 0, policy_version 1423570 (0.0009) [2023-12-26 10:57:37,965][123091] Updated weights for policy 0, policy_version 1423580 (0.0010) [2023-12-26 10:57:38,027][123091] Updated weights for policy 0, policy_version 1423590 (0.0010) [2023-12-26 10:57:38,082][123091] Updated weights for policy 0, policy_version 1423600 (0.0010) [2023-12-26 10:57:38,444][123090] Updated weights for policy 1, policy_version 1413987 (0.0009) [2023-12-26 10:57:38,507][123090] Updated weights for policy 1, policy_version 1413997 (0.0010) [2023-12-26 10:57:38,582][123090] Updated weights for policy 1, policy_version 1414007 (0.0011) [2023-12-26 10:57:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 726433792. Throughput: 0: 9020.6, 1: 8845.4. Samples: 726409648. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:57:38,785][121949] Avg episode reward: [(0, '5938.227'), (1, '5210.828')] [2023-12-26 10:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001414016_361988096.pth... [2023-12-26 10:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001423600_364445696.pth... [2023-12-26 10:57:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001412960_361717760.pth [2023-12-26 10:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001422544_364175360.pth [2023-12-26 10:57:38,940][123091] Updated weights for policy 0, policy_version 1423610 (0.0010) [2023-12-26 10:57:38,998][123091] Updated weights for policy 0, policy_version 1423620 (0.0010) [2023-12-26 10:57:39,050][123091] Updated weights for policy 0, policy_version 1423630 (0.0010) [2023-12-26 10:57:39,396][123090] Updated weights for policy 1, policy_version 1414017 (0.0010) [2023-12-26 10:57:39,467][123090] Updated weights for policy 1, policy_version 1414027 (0.0007) [2023-12-26 10:57:39,538][123090] Updated weights for policy 1, policy_version 1414037 (0.0008) [2023-12-26 10:57:39,603][123090] Updated weights for policy 1, policy_version 1414047 (0.0009) [2023-12-26 10:57:39,853][123091] Updated weights for policy 0, policy_version 1423640 (0.0008) [2023-12-26 10:57:39,924][123091] Updated weights for policy 0, policy_version 1423650 (0.0008) [2023-12-26 10:57:39,996][123091] Updated weights for policy 0, policy_version 1423660 (0.0012) [2023-12-26 10:57:40,427][123090] Updated weights for policy 1, policy_version 1414057 (0.0006) [2023-12-26 10:57:40,496][123090] Updated weights for policy 1, policy_version 1414067 (0.0005) [2023-12-26 10:57:40,559][123090] Updated weights for policy 1, policy_version 1414077 (0.0005) [2023-12-26 10:57:40,698][123091] Updated weights for policy 0, policy_version 1423670 (0.0006) [2023-12-26 10:57:40,766][123091] Updated weights for policy 0, policy_version 1423680 (0.0006) [2023-12-26 10:57:40,842][123091] Updated weights for policy 0, policy_version 1423690 (0.0006) [2023-12-26 10:57:41,333][123090] Updated weights for policy 1, policy_version 1414087 (0.0009) [2023-12-26 10:57:41,409][123090] Updated weights for policy 1, policy_version 1414097 (0.0010) [2023-12-26 10:57:41,475][123090] Updated weights for policy 1, policy_version 1414107 (0.0009) [2023-12-26 10:57:41,595][123091] Updated weights for policy 0, policy_version 1423700 (0.0009) [2023-12-26 10:57:41,667][123091] Updated weights for policy 0, policy_version 1423710 (0.0008) [2023-12-26 10:57:41,739][123091] Updated weights for policy 0, policy_version 1423720 (0.0008) [2023-12-26 10:57:42,320][123090] Updated weights for policy 1, policy_version 1414117 (0.0009) [2023-12-26 10:57:42,390][123090] Updated weights for policy 1, policy_version 1414127 (0.0009) [2023-12-26 10:57:42,451][123090] Updated weights for policy 1, policy_version 1414137 (0.0009) [2023-12-26 10:57:42,555][123091] Updated weights for policy 0, policy_version 1423730 (0.0011) [2023-12-26 10:57:42,632][123091] Updated weights for policy 0, policy_version 1423740 (0.0009) [2023-12-26 10:57:42,689][123091] Updated weights for policy 0, policy_version 1423750 (0.0009) [2023-12-26 10:57:42,744][123091] Updated weights for policy 0, policy_version 1423760 (0.0009) [2023-12-26 10:57:43,301][123090] Updated weights for policy 1, policy_version 1414147 (0.0010) [2023-12-26 10:57:43,357][123090] Updated weights for policy 1, policy_version 1414157 (0.0010) [2023-12-26 10:57:43,416][123090] Updated weights for policy 1, policy_version 1414167 (0.0010) [2023-12-26 10:57:43,518][123091] Updated weights for policy 0, policy_version 1423770 (0.0005) [2023-12-26 10:57:43,579][123091] Updated weights for policy 0, policy_version 1423780 (0.0006) [2023-12-26 10:57:43,649][123091] Updated weights for policy 0, policy_version 1423790 (0.0005) [2023-12-26 10:57:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 726523904. Throughput: 0: 8914.7, 1: 8860.6. Samples: 726513600. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:57:43,784][121949] Avg episode reward: [(0, '5984.350'), (1, '5376.084')] [2023-12-26 10:57:44,231][123090] Updated weights for policy 1, policy_version 1414177 (0.0010) [2023-12-26 10:57:44,270][123091] Updated weights for policy 0, policy_version 1423800 (0.0008) [2023-12-26 10:57:44,289][123090] Updated weights for policy 1, policy_version 1414187 (0.0006) [2023-12-26 10:57:44,342][123091] Updated weights for policy 0, policy_version 1423810 (0.0006) [2023-12-26 10:57:44,343][123090] Updated weights for policy 1, policy_version 1414197 (0.0007) [2023-12-26 10:57:44,395][123090] Updated weights for policy 1, policy_version 1414207 (0.0005) [2023-12-26 10:57:44,406][123091] Updated weights for policy 0, policy_version 1423820 (0.0005) [2023-12-26 10:57:45,063][123090] Updated weights for policy 1, policy_version 1414217 (0.0007) [2023-12-26 10:57:45,103][123091] Updated weights for policy 0, policy_version 1423830 (0.0007) [2023-12-26 10:57:45,130][123090] Updated weights for policy 1, policy_version 1414227 (0.0007) [2023-12-26 10:57:45,169][123091] Updated weights for policy 0, policy_version 1423840 (0.0008) [2023-12-26 10:57:45,200][123090] Updated weights for policy 1, policy_version 1414237 (0.0009) [2023-12-26 10:57:45,233][123091] Updated weights for policy 0, policy_version 1423850 (0.0006) [2023-12-26 10:57:45,925][123091] Updated weights for policy 0, policy_version 1423860 (0.0005) [2023-12-26 10:57:45,981][123091] Updated weights for policy 0, policy_version 1423870 (0.0005) [2023-12-26 10:57:45,982][123090] Updated weights for policy 1, policy_version 1414247 (0.0010) [2023-12-26 10:57:46,035][123091] Updated weights for policy 0, policy_version 1423880 (0.0005) [2023-12-26 10:57:46,038][123090] Updated weights for policy 1, policy_version 1414257 (0.0010) [2023-12-26 10:57:46,097][123090] Updated weights for policy 1, policy_version 1414267 (0.0010) [2023-12-26 10:57:46,701][123091] Updated weights for policy 0, policy_version 1423890 (0.0007) [2023-12-26 10:57:46,760][123091] Updated weights for policy 0, policy_version 1423900 (0.0011) [2023-12-26 10:57:46,827][123091] Updated weights for policy 0, policy_version 1423910 (0.0011) [2023-12-26 10:57:46,888][123091] Updated weights for policy 0, policy_version 1423920 (0.0010) [2023-12-26 10:57:46,950][123090] Updated weights for policy 1, policy_version 1414277 (0.0009) [2023-12-26 10:57:47,003][123090] Updated weights for policy 1, policy_version 1414287 (0.0005) [2023-12-26 10:57:47,050][123090] Updated weights for policy 1, policy_version 1414297 (0.0008) [2023-12-26 10:57:47,730][123091] Updated weights for policy 0, policy_version 1423930 (0.0010) [2023-12-26 10:57:47,784][123091] Updated weights for policy 0, policy_version 1423942 (0.0010) [2023-12-26 10:57:47,810][123090] Updated weights for policy 1, policy_version 1414307 (0.0008) [2023-12-26 10:57:47,835][123091] Updated weights for policy 0, policy_version 1423952 (0.0009) [2023-12-26 10:57:47,867][123090] Updated weights for policy 1, policy_version 1414317 (0.0008) [2023-12-26 10:57:47,924][123090] Updated weights for policy 1, policy_version 1414327 (0.0009) [2023-12-26 10:57:48,628][123090] Updated weights for policy 1, policy_version 1414337 (0.0009) [2023-12-26 10:57:48,691][123090] Updated weights for policy 1, policy_version 1414347 (0.0010) [2023-12-26 10:57:48,749][123091] Updated weights for policy 0, policy_version 1423962 (0.0006) [2023-12-26 10:57:48,754][123090] Updated weights for policy 1, policy_version 1414357 (0.0010) [2023-12-26 10:57:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 726605824. Throughput: 0: 9034.1, 1: 8877.9. Samples: 726624208. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:57:48,785][121949] Avg episode reward: [(0, '6028.694'), (1, '5656.069')] [2023-12-26 10:57:48,805][123091] Updated weights for policy 0, policy_version 1423972 (0.0008) [2023-12-26 10:57:48,818][123090] Updated weights for policy 1, policy_version 1414367 (0.0010) [2023-12-26 10:57:48,868][123091] Updated weights for policy 0, policy_version 1423982 (0.0009) [2023-12-26 10:57:49,644][123090] Updated weights for policy 1, policy_version 1414377 (0.0010) [2023-12-26 10:57:49,651][123091] Updated weights for policy 0, policy_version 1423992 (0.0006) [2023-12-26 10:57:49,697][123090] Updated weights for policy 1, policy_version 1414387 (0.0010) [2023-12-26 10:57:49,708][123091] Updated weights for policy 0, policy_version 1424002 (0.0006) [2023-12-26 10:57:49,744][123090] Updated weights for policy 1, policy_version 1414397 (0.0010) [2023-12-26 10:57:49,772][123091] Updated weights for policy 0, policy_version 1424012 (0.0006) [2023-12-26 10:57:50,560][123091] Updated weights for policy 0, policy_version 1424022 (0.0008) [2023-12-26 10:57:50,611][123090] Updated weights for policy 1, policy_version 1414407 (0.0011) [2023-12-26 10:57:50,619][123091] Updated weights for policy 0, policy_version 1424032 (0.0006) [2023-12-26 10:57:50,679][123090] Updated weights for policy 1, policy_version 1414417 (0.0010) [2023-12-26 10:57:50,687][123091] Updated weights for policy 0, policy_version 1424042 (0.0009) [2023-12-26 10:57:50,738][123090] Updated weights for policy 1, policy_version 1414427 (0.0010) [2023-12-26 10:57:51,525][123091] Updated weights for policy 0, policy_version 1424052 (0.0008) [2023-12-26 10:57:51,556][123090] Updated weights for policy 1, policy_version 1414437 (0.0010) [2023-12-26 10:57:51,584][123091] Updated weights for policy 0, policy_version 1424062 (0.0009) [2023-12-26 10:57:51,621][123090] Updated weights for policy 1, policy_version 1414447 (0.0010) [2023-12-26 10:57:51,648][123091] Updated weights for policy 0, policy_version 1424072 (0.0010) [2023-12-26 10:57:51,686][123090] Updated weights for policy 1, policy_version 1414457 (0.0009) [2023-12-26 10:57:52,493][123091] Updated weights for policy 0, policy_version 1424082 (0.0008) [2023-12-26 10:57:52,533][123090] Updated weights for policy 1, policy_version 1414467 (0.0010) [2023-12-26 10:57:52,552][123091] Updated weights for policy 0, policy_version 1424092 (0.0011) [2023-12-26 10:57:52,593][123090] Updated weights for policy 1, policy_version 1414477 (0.0010) [2023-12-26 10:57:52,615][123091] Updated weights for policy 0, policy_version 1424102 (0.0011) [2023-12-26 10:57:52,648][123090] Updated weights for policy 1, policy_version 1414487 (0.0010) [2023-12-26 10:57:52,671][123091] Updated weights for policy 0, policy_version 1424112 (0.0010) [2023-12-26 10:57:53,372][123091] Updated weights for policy 0, policy_version 1424122 (0.0010) [2023-12-26 10:57:53,397][123090] Updated weights for policy 1, policy_version 1414497 (0.0010) [2023-12-26 10:57:53,430][123091] Updated weights for policy 0, policy_version 1424132 (0.0009) [2023-12-26 10:57:53,461][123090] Updated weights for policy 1, policy_version 1414507 (0.0007) [2023-12-26 10:57:53,484][123091] Updated weights for policy 0, policy_version 1424142 (0.0007) [2023-12-26 10:57:53,520][123090] Updated weights for policy 1, policy_version 1414517 (0.0005) [2023-12-26 10:57:53,576][123090] Updated weights for policy 1, policy_version 1414527 (0.0005) [2023-12-26 10:57:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 726704128. Throughput: 0: 9056.6, 1: 8825.3. Samples: 726676332. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:57:53,785][121949] Avg episode reward: [(0, '6215.816'), (1, '5361.283')] [2023-12-26 10:57:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001414528_362119168.pth... [2023-12-26 10:57:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001424144_364584960.pth... [2023-12-26 10:57:53,791][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001413472_361848832.pth [2023-12-26 10:57:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001423056_364306432.pth [2023-12-26 10:57:54,168][123091] Updated weights for policy 0, policy_version 1424152 (0.0006) [2023-12-26 10:57:54,228][123091] Updated weights for policy 0, policy_version 1424162 (0.0006) [2023-12-26 10:57:54,260][123090] Updated weights for policy 1, policy_version 1414537 (0.0005) [2023-12-26 10:57:54,290][123091] Updated weights for policy 0, policy_version 1424172 (0.0006) [2023-12-26 10:57:54,319][123090] Updated weights for policy 1, policy_version 1414547 (0.0005) [2023-12-26 10:57:54,391][123090] Updated weights for policy 1, policy_version 1414557 (0.0006) [2023-12-26 10:57:54,995][123091] Updated weights for policy 0, policy_version 1424182 (0.0009) [2023-12-26 10:57:55,055][123091] Updated weights for policy 0, policy_version 1424192 (0.0009) [2023-12-26 10:57:55,106][123091] Updated weights for policy 0, policy_version 1424202 (0.0009) [2023-12-26 10:57:55,163][123090] Updated weights for policy 1, policy_version 1414567 (0.0008) [2023-12-26 10:57:55,211][123090] Updated weights for policy 1, policy_version 1414577 (0.0010) [2023-12-26 10:57:55,262][123090] Updated weights for policy 1, policy_version 1414587 (0.0010) [2023-12-26 10:57:55,826][123091] Updated weights for policy 0, policy_version 1424212 (0.0009) [2023-12-26 10:57:55,878][123091] Updated weights for policy 0, policy_version 1424222 (0.0009) [2023-12-26 10:57:55,942][123091] Updated weights for policy 0, policy_version 1424232 (0.0009) [2023-12-26 10:57:56,092][123090] Updated weights for policy 1, policy_version 1414597 (0.0010) [2023-12-26 10:57:56,143][123090] Updated weights for policy 1, policy_version 1414607 (0.0010) [2023-12-26 10:57:56,198][123090] Updated weights for policy 1, policy_version 1414617 (0.0010) [2023-12-26 10:57:56,766][123091] Updated weights for policy 0, policy_version 1424242 (0.0009) [2023-12-26 10:57:56,825][123091] Updated weights for policy 0, policy_version 1424252 (0.0009) [2023-12-26 10:57:56,887][123091] Updated weights for policy 0, policy_version 1424262 (0.0008) [2023-12-26 10:57:56,946][123091] Updated weights for policy 0, policy_version 1424272 (0.0009) [2023-12-26 10:57:57,022][123090] Updated weights for policy 1, policy_version 1414627 (0.0010) [2023-12-26 10:57:57,076][123090] Updated weights for policy 1, policy_version 1414637 (0.0010) [2023-12-26 10:57:57,143][123090] Updated weights for policy 1, policy_version 1414647 (0.0010) [2023-12-26 10:57:57,740][123091] Updated weights for policy 0, policy_version 1424282 (0.0005) [2023-12-26 10:57:57,788][123091] Updated weights for policy 0, policy_version 1424292 (0.0005) [2023-12-26 10:57:57,831][123091] Updated weights for policy 0, policy_version 1424302 (0.0005) [2023-12-26 10:57:57,949][123090] Updated weights for policy 1, policy_version 1414657 (0.0010) [2023-12-26 10:57:58,015][123090] Updated weights for policy 1, policy_version 1414667 (0.0006) [2023-12-26 10:57:58,087][123090] Updated weights for policy 1, policy_version 1414677 (0.0007) [2023-12-26 10:57:58,163][123090] Updated weights for policy 1, policy_version 1414687 (0.0006) [2023-12-26 10:57:58,571][123091] Updated weights for policy 0, policy_version 1424312 (0.0009) [2023-12-26 10:57:58,644][123091] Updated weights for policy 0, policy_version 1424322 (0.0011) [2023-12-26 10:57:58,713][123091] Updated weights for policy 0, policy_version 1424332 (0.0009) [2023-12-26 10:57:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17886.4, 300 sec: 17855.8). Total num frames: 726794240. Throughput: 0: 9206.7, 1: 8846.3. Samples: 726786104. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:57:58,785][121949] Avg episode reward: [(0, '6283.848'), (1, '5201.588')] [2023-12-26 10:57:59,042][123090] Updated weights for policy 1, policy_version 1414697 (0.0009) [2023-12-26 10:57:59,099][123090] Updated weights for policy 1, policy_version 1414707 (0.0010) [2023-12-26 10:57:59,167][123090] Updated weights for policy 1, policy_version 1414717 (0.0009) [2023-12-26 10:57:59,550][123091] Updated weights for policy 0, policy_version 1424342 (0.0009) [2023-12-26 10:57:59,613][123091] Updated weights for policy 0, policy_version 1424352 (0.0010) [2023-12-26 10:57:59,670][123091] Updated weights for policy 0, policy_version 1424362 (0.0010) [2023-12-26 10:57:59,986][123090] Updated weights for policy 1, policy_version 1414727 (0.0010) [2023-12-26 10:58:00,035][123090] Updated weights for policy 1, policy_version 1414737 (0.0008) [2023-12-26 10:58:00,090][123090] Updated weights for policy 1, policy_version 1414747 (0.0009) [2023-12-26 10:58:00,499][123091] Updated weights for policy 0, policy_version 1424372 (0.0010) [2023-12-26 10:58:00,546][123091] Updated weights for policy 0, policy_version 1424382 (0.0009) [2023-12-26 10:58:00,605][123091] Updated weights for policy 0, policy_version 1424392 (0.0008) [2023-12-26 10:58:00,978][123090] Updated weights for policy 1, policy_version 1414757 (0.0010) [2023-12-26 10:58:01,042][123090] Updated weights for policy 1, policy_version 1414767 (0.0009) [2023-12-26 10:58:01,113][123090] Updated weights for policy 1, policy_version 1414777 (0.0008) [2023-12-26 10:58:01,333][123091] Updated weights for policy 0, policy_version 1424402 (0.0007) [2023-12-26 10:58:01,415][123091] Updated weights for policy 0, policy_version 1424412 (0.0009) [2023-12-26 10:58:01,472][123091] Updated weights for policy 0, policy_version 1424422 (0.0010) [2023-12-26 10:58:01,538][123091] Updated weights for policy 0, policy_version 1424432 (0.0010) [2023-12-26 10:58:01,976][123090] Updated weights for policy 1, policy_version 1414787 (0.0009) [2023-12-26 10:58:02,033][123090] Updated weights for policy 1, policy_version 1414797 (0.0009) [2023-12-26 10:58:02,092][123090] Updated weights for policy 1, policy_version 1414807 (0.0010) [2023-12-26 10:58:02,312][123091] Updated weights for policy 0, policy_version 1424442 (0.0010) [2023-12-26 10:58:02,379][123091] Updated weights for policy 0, policy_version 1424452 (0.0010) [2023-12-26 10:58:02,449][123091] Updated weights for policy 0, policy_version 1424462 (0.0009) [2023-12-26 10:58:02,890][123090] Updated weights for policy 1, policy_version 1414817 (0.0008) [2023-12-26 10:58:02,939][123090] Updated weights for policy 1, policy_version 1414827 (0.0009) [2023-12-26 10:58:02,990][123090] Updated weights for policy 1, policy_version 1414837 (0.0009) [2023-12-26 10:58:03,042][123090] Updated weights for policy 1, policy_version 1414847 (0.0006) [2023-12-26 10:58:03,287][123091] Updated weights for policy 0, policy_version 1424472 (0.0009) [2023-12-26 10:58:03,339][123091] Updated weights for policy 0, policy_version 1424482 (0.0009) [2023-12-26 10:58:03,390][123091] Updated weights for policy 0, policy_version 1424492 (0.0009) [2023-12-26 10:58:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 726876160. Throughput: 0: 9126.9, 1: 8850.3. Samples: 726889844. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:03,785][121949] Avg episode reward: [(0, '6226.832'), (1, '5422.010')] [2023-12-26 10:58:03,858][123090] Updated weights for policy 1, policy_version 1414857 (0.0009) [2023-12-26 10:58:03,915][123090] Updated weights for policy 1, policy_version 1414867 (0.0010) [2023-12-26 10:58:03,969][123090] Updated weights for policy 1, policy_version 1414877 (0.0009) [2023-12-26 10:58:04,233][123091] Updated weights for policy 0, policy_version 1424502 (0.0007) [2023-12-26 10:58:04,301][123091] Updated weights for policy 0, policy_version 1424512 (0.0005) [2023-12-26 10:58:04,367][123091] Updated weights for policy 0, policy_version 1424522 (0.0005) [2023-12-26 10:58:04,763][123090] Updated weights for policy 1, policy_version 1414887 (0.0006) [2023-12-26 10:58:04,823][123090] Updated weights for policy 1, policy_version 1414897 (0.0005) [2023-12-26 10:58:04,884][123090] Updated weights for policy 1, policy_version 1414907 (0.0005) [2023-12-26 10:58:05,171][123091] Updated weights for policy 0, policy_version 1424532 (0.0007) [2023-12-26 10:58:05,219][123091] Updated weights for policy 0, policy_version 1424542 (0.0006) [2023-12-26 10:58:05,284][123091] Updated weights for policy 0, policy_version 1424552 (0.0006) [2023-12-26 10:58:05,493][123090] Updated weights for policy 1, policy_version 1414917 (0.0007) [2023-12-26 10:58:05,539][123090] Updated weights for policy 1, policy_version 1414927 (0.0005) [2023-12-26 10:58:05,587][123090] Updated weights for policy 1, policy_version 1414937 (0.0005) [2023-12-26 10:58:05,891][123091] Updated weights for policy 0, policy_version 1424562 (0.0006) [2023-12-26 10:58:05,943][123091] Updated weights for policy 0, policy_version 1424572 (0.0008) [2023-12-26 10:58:05,991][123091] Updated weights for policy 0, policy_version 1424582 (0.0010) [2023-12-26 10:58:06,050][123091] Updated weights for policy 0, policy_version 1424592 (0.0011) [2023-12-26 10:58:06,303][123090] Updated weights for policy 1, policy_version 1414947 (0.0005) [2023-12-26 10:58:06,386][123090] Updated weights for policy 1, policy_version 1414957 (0.0005) [2023-12-26 10:58:06,460][123090] Updated weights for policy 1, policy_version 1414967 (0.0007) [2023-12-26 10:58:06,815][123091] Updated weights for policy 0, policy_version 1424602 (0.0005) [2023-12-26 10:58:06,885][123091] Updated weights for policy 0, policy_version 1424612 (0.0009) [2023-12-26 10:58:06,951][123091] Updated weights for policy 0, policy_version 1424622 (0.0011) [2023-12-26 10:58:07,240][123090] Updated weights for policy 1, policy_version 1414977 (0.0010) [2023-12-26 10:58:07,306][123090] Updated weights for policy 1, policy_version 1414987 (0.0009) [2023-12-26 10:58:07,372][123090] Updated weights for policy 1, policy_version 1414997 (0.0009) [2023-12-26 10:58:07,442][123090] Updated weights for policy 1, policy_version 1415007 (0.0009) [2023-12-26 10:58:07,727][123091] Updated weights for policy 0, policy_version 1424632 (0.0011) [2023-12-26 10:58:07,789][123091] Updated weights for policy 0, policy_version 1424642 (0.0011) [2023-12-26 10:58:07,851][123091] Updated weights for policy 0, policy_version 1424652 (0.0011) [2023-12-26 10:58:08,289][123090] Updated weights for policy 1, policy_version 1415017 (0.0010) [2023-12-26 10:58:08,343][123090] Updated weights for policy 1, policy_version 1415027 (0.0009) [2023-12-26 10:58:08,403][123090] Updated weights for policy 1, policy_version 1415037 (0.0010) [2023-12-26 10:58:08,601][123091] Updated weights for policy 0, policy_version 1424662 (0.0009) [2023-12-26 10:58:08,663][123091] Updated weights for policy 0, policy_version 1424672 (0.0008) [2023-12-26 10:58:08,735][123091] Updated weights for policy 0, policy_version 1424682 (0.0007) [2023-12-26 10:58:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 726974464. Throughput: 0: 9184.2, 1: 8947.9. Samples: 726947568. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:08,785][121949] Avg episode reward: [(0, '6103.645'), (1, '5316.125')] [2023-12-26 10:58:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001424688_364724224.pth... [2023-12-26 10:58:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001415040_362250240.pth... [2023-12-26 10:58:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001414016_361988096.pth [2023-12-26 10:58:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001423600_364445696.pth [2023-12-26 10:58:09,349][123090] Updated weights for policy 1, policy_version 1415047 (0.0009) [2023-12-26 10:58:09,406][123091] Updated weights for policy 0, policy_version 1424692 (0.0008) [2023-12-26 10:58:09,417][123090] Updated weights for policy 1, policy_version 1415057 (0.0008) [2023-12-26 10:58:09,470][123090] Updated weights for policy 1, policy_version 1415067 (0.0009) [2023-12-26 10:58:09,474][123091] Updated weights for policy 0, policy_version 1424702 (0.0006) [2023-12-26 10:58:09,541][123091] Updated weights for policy 0, policy_version 1424712 (0.0005) [2023-12-26 10:58:10,308][123090] Updated weights for policy 1, policy_version 1415077 (0.0010) [2023-12-26 10:58:10,347][123091] Updated weights for policy 0, policy_version 1424722 (0.0007) [2023-12-26 10:58:10,375][123090] Updated weights for policy 1, policy_version 1415087 (0.0007) [2023-12-26 10:58:10,407][123091] Updated weights for policy 0, policy_version 1424732 (0.0011) [2023-12-26 10:58:10,435][123090] Updated weights for policy 1, policy_version 1415097 (0.0005) [2023-12-26 10:58:10,466][123091] Updated weights for policy 0, policy_version 1424742 (0.0011) [2023-12-26 10:58:10,529][123091] Updated weights for policy 0, policy_version 1424752 (0.0010) [2023-12-26 10:58:11,235][123090] Updated weights for policy 1, policy_version 1415107 (0.0007) [2023-12-26 10:58:11,306][123090] Updated weights for policy 1, policy_version 1415117 (0.0009) [2023-12-26 10:58:11,364][123091] Updated weights for policy 0, policy_version 1424762 (0.0006) [2023-12-26 10:58:11,384][123090] Updated weights for policy 1, policy_version 1415127 (0.0007) [2023-12-26 10:58:11,432][123091] Updated weights for policy 0, policy_version 1424772 (0.0008) [2023-12-26 10:58:11,489][123091] Updated weights for policy 0, policy_version 1424782 (0.0010) [2023-12-26 10:58:12,206][123090] Updated weights for policy 1, policy_version 1415137 (0.0006) [2023-12-26 10:58:12,268][123090] Updated weights for policy 1, policy_version 1415147 (0.0009) [2023-12-26 10:58:12,309][123091] Updated weights for policy 0, policy_version 1424792 (0.0008) [2023-12-26 10:58:12,335][123090] Updated weights for policy 1, policy_version 1415157 (0.0009) [2023-12-26 10:58:12,377][123091] Updated weights for policy 0, policy_version 1424802 (0.0008) [2023-12-26 10:58:12,404][123090] Updated weights for policy 1, policy_version 1415167 (0.0008) [2023-12-26 10:58:12,442][123091] Updated weights for policy 0, policy_version 1424812 (0.0008) [2023-12-26 10:58:13,180][123091] Updated weights for policy 0, policy_version 1424822 (0.0007) [2023-12-26 10:58:13,236][123090] Updated weights for policy 1, policy_version 1415177 (0.0007) [2023-12-26 10:58:13,241][123091] Updated weights for policy 0, policy_version 1424832 (0.0005) [2023-12-26 10:58:13,296][123090] Updated weights for policy 1, policy_version 1415187 (0.0010) [2023-12-26 10:58:13,308][123091] Updated weights for policy 0, policy_version 1424842 (0.0006) [2023-12-26 10:58:13,366][123090] Updated weights for policy 1, policy_version 1415197 (0.0009) [2023-12-26 10:58:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 727056384. Throughput: 0: 9171.0, 1: 8849.4. Samples: 727050508. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:13,785][121949] Avg episode reward: [(0, '6123.834'), (1, '5055.697')] [2023-12-26 10:58:13,882][123091] Updated weights for policy 0, policy_version 1424852 (0.0006) [2023-12-26 10:58:13,931][123091] Updated weights for policy 0, policy_version 1424862 (0.0007) [2023-12-26 10:58:13,990][123091] Updated weights for policy 0, policy_version 1424872 (0.0010) [2023-12-26 10:58:14,188][123090] Updated weights for policy 1, policy_version 1415207 (0.0006) [2023-12-26 10:58:14,250][123090] Updated weights for policy 1, policy_version 1415217 (0.0009) [2023-12-26 10:58:14,306][123090] Updated weights for policy 1, policy_version 1415227 (0.0008) [2023-12-26 10:58:14,731][123091] Updated weights for policy 0, policy_version 1424882 (0.0010) [2023-12-26 10:58:14,798][123091] Updated weights for policy 0, policy_version 1424892 (0.0010) [2023-12-26 10:58:14,859][123091] Updated weights for policy 0, policy_version 1424902 (0.0008) [2023-12-26 10:58:14,929][123091] Updated weights for policy 0, policy_version 1424912 (0.0007) [2023-12-26 10:58:14,994][123090] Updated weights for policy 1, policy_version 1415237 (0.0010) [2023-12-26 10:58:15,058][123090] Updated weights for policy 1, policy_version 1415247 (0.0011) [2023-12-26 10:58:15,122][123090] Updated weights for policy 1, policy_version 1415257 (0.0010) [2023-12-26 10:58:15,712][123091] Updated weights for policy 0, policy_version 1424922 (0.0009) [2023-12-26 10:58:15,772][123091] Updated weights for policy 0, policy_version 1424932 (0.0007) [2023-12-26 10:58:15,827][123091] Updated weights for policy 0, policy_version 1424942 (0.0010) [2023-12-26 10:58:15,877][123090] Updated weights for policy 1, policy_version 1415267 (0.0009) [2023-12-26 10:58:15,950][123090] Updated weights for policy 1, policy_version 1415277 (0.0005) [2023-12-26 10:58:16,013][123090] Updated weights for policy 1, policy_version 1415287 (0.0005) [2023-12-26 10:58:16,544][123091] Updated weights for policy 0, policy_version 1424952 (0.0006) [2023-12-26 10:58:16,612][123091] Updated weights for policy 0, policy_version 1424962 (0.0005) [2023-12-26 10:58:16,667][123090] Updated weights for policy 1, policy_version 1415297 (0.0005) [2023-12-26 10:58:16,673][123091] Updated weights for policy 0, policy_version 1424972 (0.0006) [2023-12-26 10:58:16,715][123090] Updated weights for policy 1, policy_version 1415307 (0.0005) [2023-12-26 10:58:16,763][123090] Updated weights for policy 1, policy_version 1415317 (0.0005) [2023-12-26 10:58:16,817][123090] Updated weights for policy 1, policy_version 1415327 (0.0005) [2023-12-26 10:58:17,307][123091] Updated weights for policy 0, policy_version 1424982 (0.0006) [2023-12-26 10:58:17,360][123091] Updated weights for policy 0, policy_version 1424992 (0.0006) [2023-12-26 10:58:17,425][123091] Updated weights for policy 0, policy_version 1425002 (0.0005) [2023-12-26 10:58:17,602][123090] Updated weights for policy 1, policy_version 1415337 (0.0010) [2023-12-26 10:58:17,676][123090] Updated weights for policy 1, policy_version 1415347 (0.0011) [2023-12-26 10:58:17,742][123090] Updated weights for policy 1, policy_version 1415357 (0.0011) [2023-12-26 10:58:18,101][123091] Updated weights for policy 0, policy_version 1425012 (0.0006) [2023-12-26 10:58:18,154][123091] Updated weights for policy 0, policy_version 1425022 (0.0008) [2023-12-26 10:58:18,201][123091] Updated weights for policy 0, policy_version 1425032 (0.0010) [2023-12-26 10:58:18,437][123090] Updated weights for policy 1, policy_version 1415367 (0.0007) [2023-12-26 10:58:18,503][123090] Updated weights for policy 1, policy_version 1415377 (0.0005) [2023-12-26 10:58:18,559][123090] Updated weights for policy 1, policy_version 1415387 (0.0008) [2023-12-26 10:58:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 727154688. Throughput: 0: 9232.3, 1: 8820.5. Samples: 727165536. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:18,785][121949] Avg episode reward: [(0, '6078.674'), (1, '5322.614')] [2023-12-26 10:58:18,946][123091] Updated weights for policy 0, policy_version 1425042 (0.0005) [2023-12-26 10:58:19,009][123091] Updated weights for policy 0, policy_version 1425052 (0.0005) [2023-12-26 10:58:19,073][123091] Updated weights for policy 0, policy_version 1425062 (0.0006) [2023-12-26 10:58:19,130][123091] Updated weights for policy 0, policy_version 1425072 (0.0006) [2023-12-26 10:58:19,398][123090] Updated weights for policy 1, policy_version 1415397 (0.0010) [2023-12-26 10:58:19,459][123090] Updated weights for policy 1, policy_version 1415407 (0.0009) [2023-12-26 10:58:19,525][123090] Updated weights for policy 1, policy_version 1415417 (0.0010) [2023-12-26 10:58:19,883][123091] Updated weights for policy 0, policy_version 1425082 (0.0009) [2023-12-26 10:58:19,953][123091] Updated weights for policy 0, policy_version 1425092 (0.0010) [2023-12-26 10:58:20,006][123091] Updated weights for policy 0, policy_version 1425102 (0.0009) [2023-12-26 10:58:20,369][123090] Updated weights for policy 1, policy_version 1415428 (0.0008) [2023-12-26 10:58:20,432][123090] Updated weights for policy 1, policy_version 1415438 (0.0005) [2023-12-26 10:58:20,500][123090] Updated weights for policy 1, policy_version 1415448 (0.0006) [2023-12-26 10:58:20,741][123091] Updated weights for policy 0, policy_version 1425112 (0.0010) [2023-12-26 10:58:20,805][123091] Updated weights for policy 0, policy_version 1425122 (0.0011) [2023-12-26 10:58:20,871][123091] Updated weights for policy 0, policy_version 1425132 (0.0011) [2023-12-26 10:58:21,222][123090] Updated weights for policy 1, policy_version 1415458 (0.0008) [2023-12-26 10:58:21,288][123090] Updated weights for policy 1, policy_version 1415468 (0.0009) [2023-12-26 10:58:21,357][123090] Updated weights for policy 1, policy_version 1415478 (0.0009) [2023-12-26 10:58:21,423][123090] Updated weights for policy 1, policy_version 1415488 (0.0009) [2023-12-26 10:58:21,674][123091] Updated weights for policy 0, policy_version 1425142 (0.0009) [2023-12-26 10:58:21,748][123091] Updated weights for policy 0, policy_version 1425152 (0.0007) [2023-12-26 10:58:21,820][123091] Updated weights for policy 0, policy_version 1425162 (0.0009) [2023-12-26 10:58:22,326][123090] Updated weights for policy 1, policy_version 1415498 (0.0009) [2023-12-26 10:58:22,396][123090] Updated weights for policy 1, policy_version 1415508 (0.0008) [2023-12-26 10:58:22,460][123090] Updated weights for policy 1, policy_version 1415518 (0.0008) [2023-12-26 10:58:22,553][123091] Updated weights for policy 0, policy_version 1425172 (0.0009) [2023-12-26 10:58:22,612][123091] Updated weights for policy 0, policy_version 1425182 (0.0010) [2023-12-26 10:58:22,668][123091] Updated weights for policy 0, policy_version 1425192 (0.0011) [2023-12-26 10:58:23,280][123090] Updated weights for policy 1, policy_version 1415528 (0.0010) [2023-12-26 10:58:23,341][123090] Updated weights for policy 1, policy_version 1415538 (0.0009) [2023-12-26 10:58:23,359][123091] Updated weights for policy 0, policy_version 1425202 (0.0010) [2023-12-26 10:58:23,400][123090] Updated weights for policy 1, policy_version 1415548 (0.0010) [2023-12-26 10:58:23,419][123091] Updated weights for policy 0, policy_version 1425212 (0.0005) [2023-12-26 10:58:23,479][123091] Updated weights for policy 0, policy_version 1425222 (0.0006) [2023-12-26 10:58:23,529][123091] Updated weights for policy 0, policy_version 1425232 (0.0009) [2023-12-26 10:58:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 727244800. Throughput: 0: 9192.7, 1: 8784.5. Samples: 727218624. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:23,785][121949] Avg episode reward: [(0, '5927.669'), (1, '5468.593')] [2023-12-26 10:58:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001425232_364863488.pth... [2023-12-26 10:58:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001415552_362381312.pth... [2023-12-26 10:58:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001424144_364584960.pth [2023-12-26 10:58:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001414528_362119168.pth [2023-12-26 10:58:24,083][123090] Updated weights for policy 1, policy_version 1415558 (0.0007) [2023-12-26 10:58:24,151][123090] Updated weights for policy 1, policy_version 1415569 (0.0008) [2023-12-26 10:58:24,201][123090] Updated weights for policy 1, policy_version 1415579 (0.0009) [2023-12-26 10:58:24,231][123091] Updated weights for policy 0, policy_version 1425242 (0.0009) [2023-12-26 10:58:24,289][123091] Updated weights for policy 0, policy_version 1425252 (0.0010) [2023-12-26 10:58:24,337][123091] Updated weights for policy 0, policy_version 1425262 (0.0010) [2023-12-26 10:58:24,936][123090] Updated weights for policy 1, policy_version 1415589 (0.0007) [2023-12-26 10:58:24,985][123090] Updated weights for policy 1, policy_version 1415599 (0.0005) [2023-12-26 10:58:25,040][123090] Updated weights for policy 1, policy_version 1415609 (0.0007) [2023-12-26 10:58:25,046][123091] Updated weights for policy 0, policy_version 1425272 (0.0009) [2023-12-26 10:58:25,105][123091] Updated weights for policy 0, policy_version 1425282 (0.0010) [2023-12-26 10:58:25,149][123091] Updated weights for policy 0, policy_version 1425292 (0.0010) [2023-12-26 10:58:25,681][123090] Updated weights for policy 1, policy_version 1415619 (0.0010) [2023-12-26 10:58:25,739][123090] Updated weights for policy 1, policy_version 1415629 (0.0010) [2023-12-26 10:58:25,790][123090] Updated weights for policy 1, policy_version 1415639 (0.0010) [2023-12-26 10:58:25,991][123091] Updated weights for policy 0, policy_version 1425302 (0.0010) [2023-12-26 10:58:26,063][123091] Updated weights for policy 0, policy_version 1425312 (0.0009) [2023-12-26 10:58:26,130][123091] Updated weights for policy 0, policy_version 1425322 (0.0009) [2023-12-26 10:58:26,619][123090] Updated weights for policy 1, policy_version 1415649 (0.0010) [2023-12-26 10:58:26,671][123090] Updated weights for policy 1, policy_version 1415659 (0.0010) [2023-12-26 10:58:26,734][123090] Updated weights for policy 1, policy_version 1415669 (0.0011) [2023-12-26 10:58:26,804][123090] Updated weights for policy 1, policy_version 1415679 (0.0006) [2023-12-26 10:58:26,886][123091] Updated weights for policy 0, policy_version 1425332 (0.0008) [2023-12-26 10:58:26,938][123091] Updated weights for policy 0, policy_version 1425342 (0.0005) [2023-12-26 10:58:26,988][123091] Updated weights for policy 0, policy_version 1425352 (0.0007) [2023-12-26 10:58:27,547][123090] Updated weights for policy 1, policy_version 1415689 (0.0010) [2023-12-26 10:58:27,606][123090] Updated weights for policy 1, policy_version 1415699 (0.0011) [2023-12-26 10:58:27,669][123090] Updated weights for policy 1, policy_version 1415709 (0.0011) [2023-12-26 10:58:27,705][123091] Updated weights for policy 0, policy_version 1425362 (0.0009) [2023-12-26 10:58:27,772][123091] Updated weights for policy 0, policy_version 1425372 (0.0010) [2023-12-26 10:58:27,843][123091] Updated weights for policy 0, policy_version 1425382 (0.0010) [2023-12-26 10:58:27,907][123091] Updated weights for policy 0, policy_version 1425392 (0.0009) [2023-12-26 10:58:28,382][123090] Updated weights for policy 1, policy_version 1415719 (0.0007) [2023-12-26 10:58:28,437][123090] Updated weights for policy 1, policy_version 1415729 (0.0005) [2023-12-26 10:58:28,492][123090] Updated weights for policy 1, policy_version 1415739 (0.0009) [2023-12-26 10:58:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 727334912. Throughput: 0: 9266.4, 1: 8883.7. Samples: 727330356. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:28,785][121949] Avg episode reward: [(0, '6102.518'), (1, '5493.690')] [2023-12-26 10:58:28,818][123091] Updated weights for policy 0, policy_version 1425402 (0.0010) [2023-12-26 10:58:28,872][123091] Updated weights for policy 0, policy_version 1425412 (0.0010) [2023-12-26 10:58:28,927][123091] Updated weights for policy 0, policy_version 1425422 (0.0010) [2023-12-26 10:58:29,243][123090] Updated weights for policy 1, policy_version 1415749 (0.0010) [2023-12-26 10:58:29,307][123090] Updated weights for policy 1, policy_version 1415759 (0.0011) [2023-12-26 10:58:29,377][123090] Updated weights for policy 1, policy_version 1415769 (0.0011) [2023-12-26 10:58:29,701][123091] Updated weights for policy 0, policy_version 1425432 (0.0010) [2023-12-26 10:58:29,764][123091] Updated weights for policy 0, policy_version 1425442 (0.0010) [2023-12-26 10:58:29,832][123091] Updated weights for policy 0, policy_version 1425452 (0.0010) [2023-12-26 10:58:30,161][123090] Updated weights for policy 1, policy_version 1415779 (0.0010) [2023-12-26 10:58:30,227][123090] Updated weights for policy 1, policy_version 1415789 (0.0010) [2023-12-26 10:58:30,294][123090] Updated weights for policy 1, policy_version 1415799 (0.0009) [2023-12-26 10:58:30,666][123091] Updated weights for policy 0, policy_version 1425462 (0.0009) [2023-12-26 10:58:30,720][123091] Updated weights for policy 0, policy_version 1425472 (0.0009) [2023-12-26 10:58:30,772][123091] Updated weights for policy 0, policy_version 1425482 (0.0009) [2023-12-26 10:58:31,068][123090] Updated weights for policy 1, policy_version 1415809 (0.0009) [2023-12-26 10:58:31,134][123090] Updated weights for policy 1, policy_version 1415819 (0.0008) [2023-12-26 10:58:31,201][123090] Updated weights for policy 1, policy_version 1415829 (0.0010) [2023-12-26 10:58:31,267][123090] Updated weights for policy 1, policy_version 1415839 (0.0009) [2023-12-26 10:58:31,646][123091] Updated weights for policy 0, policy_version 1425492 (0.0009) [2023-12-26 10:58:31,696][123091] Updated weights for policy 0, policy_version 1425502 (0.0009) [2023-12-26 10:58:31,765][123091] Updated weights for policy 0, policy_version 1425512 (0.0010) [2023-12-26 10:58:32,135][123090] Updated weights for policy 1, policy_version 1415849 (0.0008) [2023-12-26 10:58:32,190][123090] Updated weights for policy 1, policy_version 1415859 (0.0005) [2023-12-26 10:58:32,244][123090] Updated weights for policy 1, policy_version 1415869 (0.0009) [2023-12-26 10:58:32,611][123091] Updated weights for policy 0, policy_version 1425522 (0.0009) [2023-12-26 10:58:32,672][123091] Updated weights for policy 0, policy_version 1425532 (0.0009) [2023-12-26 10:58:32,725][123091] Updated weights for policy 0, policy_version 1425542 (0.0009) [2023-12-26 10:58:32,782][123091] Updated weights for policy 0, policy_version 1425552 (0.0009) [2023-12-26 10:58:33,013][123090] Updated weights for policy 1, policy_version 1415879 (0.0007) [2023-12-26 10:58:33,069][123090] Updated weights for policy 1, policy_version 1415889 (0.0005) [2023-12-26 10:58:33,134][123090] Updated weights for policy 1, policy_version 1415899 (0.0006) [2023-12-26 10:58:33,632][123091] Updated weights for policy 0, policy_version 1425562 (0.0005) [2023-12-26 10:58:33,685][123091] Updated weights for policy 0, policy_version 1425572 (0.0005) [2023-12-26 10:58:33,755][123091] Updated weights for policy 0, policy_version 1425582 (0.0005) [2023-12-26 10:58:33,770][123090] Updated weights for policy 1, policy_version 1415909 (0.0007) [2023-12-26 10:58:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 727425024. Throughput: 0: 9124.8, 1: 8905.6. Samples: 727435576. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:33,785][121949] Avg episode reward: [(0, '6285.854'), (1, '5422.435')] [2023-12-26 10:58:33,825][123090] Updated weights for policy 1, policy_version 1415919 (0.0005) [2023-12-26 10:58:33,878][123090] Updated weights for policy 1, policy_version 1415929 (0.0006) [2023-12-26 10:58:34,475][123091] Updated weights for policy 0, policy_version 1425592 (0.0009) [2023-12-26 10:58:34,525][123090] Updated weights for policy 1, policy_version 1415939 (0.0006) [2023-12-26 10:58:34,536][123091] Updated weights for policy 0, policy_version 1425602 (0.0010) [2023-12-26 10:58:34,578][123090] Updated weights for policy 1, policy_version 1415949 (0.0007) [2023-12-26 10:58:34,594][123091] Updated weights for policy 0, policy_version 1425612 (0.0009) [2023-12-26 10:58:34,637][123090] Updated weights for policy 1, policy_version 1415959 (0.0009) [2023-12-26 10:58:35,422][123091] Updated weights for policy 0, policy_version 1425622 (0.0009) [2023-12-26 10:58:35,424][123090] Updated weights for policy 1, policy_version 1415969 (0.0010) [2023-12-26 10:58:35,473][123090] Updated weights for policy 1, policy_version 1415979 (0.0006) [2023-12-26 10:58:35,487][123091] Updated weights for policy 0, policy_version 1425632 (0.0010) [2023-12-26 10:58:35,518][123090] Updated weights for policy 1, policy_version 1415989 (0.0008) [2023-12-26 10:58:35,544][123091] Updated weights for policy 0, policy_version 1425642 (0.0008) [2023-12-26 10:58:35,569][123090] Updated weights for policy 1, policy_version 1415999 (0.0008) [2023-12-26 10:58:36,330][123091] Updated weights for policy 0, policy_version 1425652 (0.0009) [2023-12-26 10:58:36,394][123091] Updated weights for policy 0, policy_version 1425662 (0.0008) [2023-12-26 10:58:36,452][123091] Updated weights for policy 0, policy_version 1425672 (0.0006) [2023-12-26 10:58:36,461][123090] Updated weights for policy 1, policy_version 1416009 (0.0009) [2023-12-26 10:58:36,528][123090] Updated weights for policy 1, policy_version 1416019 (0.0009) [2023-12-26 10:58:36,590][123090] Updated weights for policy 1, policy_version 1416029 (0.0006) [2023-12-26 10:58:37,270][123091] Updated weights for policy 0, policy_version 1425682 (0.0007) [2023-12-26 10:58:37,334][123091] Updated weights for policy 0, policy_version 1425692 (0.0005) [2023-12-26 10:58:37,357][123090] Updated weights for policy 1, policy_version 1416039 (0.0009) [2023-12-26 10:58:37,394][123091] Updated weights for policy 0, policy_version 1425702 (0.0005) [2023-12-26 10:58:37,410][123090] Updated weights for policy 1, policy_version 1416049 (0.0009) [2023-12-26 10:58:37,446][123091] Updated weights for policy 0, policy_version 1425712 (0.0006) [2023-12-26 10:58:37,478][123090] Updated weights for policy 1, policy_version 1416059 (0.0009) [2023-12-26 10:58:38,286][123091] Updated weights for policy 0, policy_version 1425722 (0.0011) [2023-12-26 10:58:38,299][123090] Updated weights for policy 1, policy_version 1416069 (0.0008) [2023-12-26 10:58:38,353][123091] Updated weights for policy 0, policy_version 1425732 (0.0008) [2023-12-26 10:58:38,367][123090] Updated weights for policy 1, policy_version 1416079 (0.0007) [2023-12-26 10:58:38,418][123091] Updated weights for policy 0, policy_version 1425742 (0.0009) [2023-12-26 10:58:38,434][123090] Updated weights for policy 1, policy_version 1416089 (0.0007) [2023-12-26 10:58:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 727515136. Throughput: 0: 9135.7, 1: 8946.3. Samples: 727490024. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:38,785][121949] Avg episode reward: [(0, '6209.423'), (1, '5391.233')] [2023-12-26 10:58:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001425744_364994560.pth... [2023-12-26 10:58:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001416096_362520576.pth... [2023-12-26 10:58:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001424688_364724224.pth [2023-12-26 10:58:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001415040_362250240.pth [2023-12-26 10:58:39,139][123090] Updated weights for policy 1, policy_version 1416099 (0.0009) [2023-12-26 10:58:39,208][123090] Updated weights for policy 1, policy_version 1416109 (0.0010) [2023-12-26 10:58:39,282][123090] Updated weights for policy 1, policy_version 1416119 (0.0009) [2023-12-26 10:58:39,296][123091] Updated weights for policy 0, policy_version 1425752 (0.0009) [2023-12-26 10:58:39,369][123091] Updated weights for policy 0, policy_version 1425762 (0.0008) [2023-12-26 10:58:39,437][123091] Updated weights for policy 0, policy_version 1425772 (0.0008) [2023-12-26 10:58:40,007][123090] Updated weights for policy 1, policy_version 1416129 (0.0008) [2023-12-26 10:58:40,082][123090] Updated weights for policy 1, policy_version 1416139 (0.0006) [2023-12-26 10:58:40,148][123090] Updated weights for policy 1, policy_version 1416149 (0.0008) [2023-12-26 10:58:40,213][123090] Updated weights for policy 1, policy_version 1416159 (0.0010) [2023-12-26 10:58:40,284][123091] Updated weights for policy 0, policy_version 1425782 (0.0009) [2023-12-26 10:58:40,354][123091] Updated weights for policy 0, policy_version 1425792 (0.0010) [2023-12-26 10:58:40,416][123091] Updated weights for policy 0, policy_version 1425802 (0.0009) [2023-12-26 10:58:40,923][123090] Updated weights for policy 1, policy_version 1416169 (0.0005) [2023-12-26 10:58:40,986][123090] Updated weights for policy 1, policy_version 1416179 (0.0005) [2023-12-26 10:58:41,046][123090] Updated weights for policy 1, policy_version 1416189 (0.0008) [2023-12-26 10:58:41,271][123091] Updated weights for policy 0, policy_version 1425812 (0.0009) [2023-12-26 10:58:41,340][123091] Updated weights for policy 0, policy_version 1425822 (0.0008) [2023-12-26 10:58:41,415][123091] Updated weights for policy 0, policy_version 1425832 (0.0009) [2023-12-26 10:58:41,855][123090] Updated weights for policy 1, policy_version 1416199 (0.0010) [2023-12-26 10:58:41,924][123090] Updated weights for policy 1, policy_version 1416209 (0.0010) [2023-12-26 10:58:41,987][123090] Updated weights for policy 1, policy_version 1416219 (0.0009) [2023-12-26 10:58:42,236][123091] Updated weights for policy 0, policy_version 1425842 (0.0008) [2023-12-26 10:58:42,301][123091] Updated weights for policy 0, policy_version 1425852 (0.0010) [2023-12-26 10:58:42,371][123091] Updated weights for policy 0, policy_version 1425862 (0.0010) [2023-12-26 10:58:42,447][123091] Updated weights for policy 0, policy_version 1425872 (0.0009) [2023-12-26 10:58:42,756][123090] Updated weights for policy 1, policy_version 1416229 (0.0008) [2023-12-26 10:58:42,814][123090] Updated weights for policy 1, policy_version 1416239 (0.0008) [2023-12-26 10:58:42,863][123090] Updated weights for policy 1, policy_version 1416249 (0.0009) [2023-12-26 10:58:43,347][123091] Updated weights for policy 0, policy_version 1425882 (0.0009) [2023-12-26 10:58:43,402][123091] Updated weights for policy 0, policy_version 1425892 (0.0010) [2023-12-26 10:58:43,456][123091] Updated weights for policy 0, policy_version 1425902 (0.0010) [2023-12-26 10:58:43,551][123090] Updated weights for policy 1, policy_version 1416259 (0.0008) [2023-12-26 10:58:43,614][123090] Updated weights for policy 1, policy_version 1416269 (0.0008) [2023-12-26 10:58:43,679][123090] Updated weights for policy 1, policy_version 1416279 (0.0007) [2023-12-26 10:58:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 727605248. Throughput: 0: 8992.6, 1: 8948.7. Samples: 727593460. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:43,784][121949] Avg episode reward: [(0, '6031.876'), (1, '5314.430')] [2023-12-26 10:58:44,322][123091] Updated weights for policy 0, policy_version 1425912 (0.0009) [2023-12-26 10:58:44,381][123091] Updated weights for policy 0, policy_version 1425922 (0.0009) [2023-12-26 10:58:44,432][123091] Updated weights for policy 0, policy_version 1425932 (0.0010) [2023-12-26 10:58:44,475][123090] Updated weights for policy 1, policy_version 1416289 (0.0006) [2023-12-26 10:58:44,525][123090] Updated weights for policy 1, policy_version 1416299 (0.0008) [2023-12-26 10:58:44,574][123090] Updated weights for policy 1, policy_version 1416309 (0.0009) [2023-12-26 10:58:44,644][123090] Updated weights for policy 1, policy_version 1416319 (0.0009) [2023-12-26 10:58:45,308][123091] Updated weights for policy 0, policy_version 1425942 (0.0010) [2023-12-26 10:58:45,370][123091] Updated weights for policy 0, policy_version 1425952 (0.0010) [2023-12-26 10:58:45,425][123091] Updated weights for policy 0, policy_version 1425962 (0.0010) [2023-12-26 10:58:45,482][123090] Updated weights for policy 1, policy_version 1416329 (0.0006) [2023-12-26 10:58:45,536][123090] Updated weights for policy 1, policy_version 1416339 (0.0005) [2023-12-26 10:58:45,602][123090] Updated weights for policy 1, policy_version 1416349 (0.0005) [2023-12-26 10:58:46,340][123091] Updated weights for policy 0, policy_version 1425972 (0.0009) [2023-12-26 10:58:46,340][123090] Updated weights for policy 1, policy_version 1416359 (0.0005) [2023-12-26 10:58:46,389][123091] Updated weights for policy 0, policy_version 1425982 (0.0008) [2023-12-26 10:58:46,392][123090] Updated weights for policy 1, policy_version 1416369 (0.0005) [2023-12-26 10:58:46,437][123091] Updated weights for policy 0, policy_version 1425992 (0.0008) [2023-12-26 10:58:46,444][123090] Updated weights for policy 1, policy_version 1416379 (0.0005) [2023-12-26 10:58:47,138][123090] Updated weights for policy 1, policy_version 1416389 (0.0007) [2023-12-26 10:58:47,183][123091] Updated weights for policy 0, policy_version 1426002 (0.0009) [2023-12-26 10:58:47,207][123090] Updated weights for policy 1, policy_version 1416399 (0.0007) [2023-12-26 10:58:47,243][123091] Updated weights for policy 0, policy_version 1426012 (0.0010) [2023-12-26 10:58:47,263][123090] Updated weights for policy 1, policy_version 1416409 (0.0006) [2023-12-26 10:58:47,304][123091] Updated weights for policy 0, policy_version 1426022 (0.0008) [2023-12-26 10:58:47,363][123091] Updated weights for policy 0, policy_version 1426032 (0.0009) [2023-12-26 10:58:48,002][123090] Updated weights for policy 1, policy_version 1416419 (0.0009) [2023-12-26 10:58:48,067][123090] Updated weights for policy 1, policy_version 1416429 (0.0010) [2023-12-26 10:58:48,132][123090] Updated weights for policy 1, policy_version 1416439 (0.0008) [2023-12-26 10:58:48,240][123091] Updated weights for policy 0, policy_version 1426042 (0.0010) [2023-12-26 10:58:48,308][123091] Updated weights for policy 0, policy_version 1426052 (0.0010) [2023-12-26 10:58:48,376][123091] Updated weights for policy 0, policy_version 1426062 (0.0008) [2023-12-26 10:58:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 727687168. Throughput: 0: 8922.9, 1: 9074.9. Samples: 727699744. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:48,785][121949] Avg episode reward: [(0, '6085.732'), (1, '5211.754')] [2023-12-26 10:58:48,951][123090] Updated weights for policy 1, policy_version 1416449 (0.0007) [2023-12-26 10:58:49,016][123090] Updated weights for policy 1, policy_version 1416459 (0.0009) [2023-12-26 10:58:49,078][123090] Updated weights for policy 1, policy_version 1416469 (0.0010) [2023-12-26 10:58:49,147][123090] Updated weights for policy 1, policy_version 1416480 (0.0008) [2023-12-26 10:58:49,249][123091] Updated weights for policy 0, policy_version 1426072 (0.0009) [2023-12-26 10:58:49,313][123091] Updated weights for policy 0, policy_version 1426082 (0.0010) [2023-12-26 10:58:49,380][123091] Updated weights for policy 0, policy_version 1426092 (0.0008) [2023-12-26 10:58:49,996][123090] Updated weights for policy 1, policy_version 1416490 (0.0010) [2023-12-26 10:58:50,052][123090] Updated weights for policy 1, policy_version 1416501 (0.0011) [2023-12-26 10:58:50,119][123090] Updated weights for policy 1, policy_version 1416511 (0.0009) [2023-12-26 10:58:50,122][123091] Updated weights for policy 0, policy_version 1426102 (0.0005) [2023-12-26 10:58:50,193][123091] Updated weights for policy 0, policy_version 1426112 (0.0009) [2023-12-26 10:58:50,257][123091] Updated weights for policy 0, policy_version 1426122 (0.0009) [2023-12-26 10:58:50,928][123090] Updated weights for policy 1, policy_version 1416521 (0.0006) [2023-12-26 10:58:50,984][123090] Updated weights for policy 1, policy_version 1416531 (0.0008) [2023-12-26 10:58:50,989][123091] Updated weights for policy 0, policy_version 1426132 (0.0010) [2023-12-26 10:58:51,045][123090] Updated weights for policy 1, policy_version 1416541 (0.0012) [2023-12-26 10:58:51,057][123091] Updated weights for policy 0, policy_version 1426142 (0.0008) [2023-12-26 10:58:51,118][123091] Updated weights for policy 0, policy_version 1426152 (0.0009) [2023-12-26 10:58:51,809][123090] Updated weights for policy 1, policy_version 1416551 (0.0009) [2023-12-26 10:58:51,879][123090] Updated weights for policy 1, policy_version 1416561 (0.0010) [2023-12-26 10:58:51,897][123091] Updated weights for policy 0, policy_version 1426162 (0.0009) [2023-12-26 10:58:51,939][123090] Updated weights for policy 1, policy_version 1416571 (0.0009) [2023-12-26 10:58:51,960][123091] Updated weights for policy 0, policy_version 1426172 (0.0006) [2023-12-26 10:58:52,024][123091] Updated weights for policy 0, policy_version 1426182 (0.0010) [2023-12-26 10:58:52,081][123091] Updated weights for policy 0, policy_version 1426192 (0.0009) [2023-12-26 10:58:52,759][123090] Updated weights for policy 1, policy_version 1416581 (0.0009) [2023-12-26 10:58:52,815][123090] Updated weights for policy 1, policy_version 1416591 (0.0009) [2023-12-26 10:58:52,864][123091] Updated weights for policy 0, policy_version 1426202 (0.0009) [2023-12-26 10:58:52,874][123090] Updated weights for policy 1, policy_version 1416601 (0.0009) [2023-12-26 10:58:52,918][123091] Updated weights for policy 0, policy_version 1426212 (0.0009) [2023-12-26 10:58:52,976][123091] Updated weights for policy 0, policy_version 1426222 (0.0009) [2023-12-26 10:58:53,653][123090] Updated weights for policy 1, policy_version 1416611 (0.0008) [2023-12-26 10:58:53,715][123090] Updated weights for policy 1, policy_version 1416621 (0.0008) [2023-12-26 10:58:53,782][123090] Updated weights for policy 1, policy_version 1416631 (0.0011) [2023-12-26 10:58:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 727769088. Throughput: 0: 8884.7, 1: 9000.0. Samples: 727752380. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:53,785][121949] Avg episode reward: [(0, '6177.041'), (1, '5456.895')] [2023-12-26 10:58:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001426224_365117440.pth... [2023-12-26 10:58:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001425232_364863488.pth [2023-12-26 10:58:53,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001416640_362659840.pth... [2023-12-26 10:58:53,837][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001415552_362381312.pth [2023-12-26 10:58:53,851][123091] Updated weights for policy 0, policy_version 1426232 (0.0007) [2023-12-26 10:58:53,902][123091] Updated weights for policy 0, policy_version 1426242 (0.0009) [2023-12-26 10:58:53,963][123091] Updated weights for policy 0, policy_version 1426252 (0.0009) [2023-12-26 10:58:54,667][123090] Updated weights for policy 1, policy_version 1416641 (0.0010) [2023-12-26 10:58:54,714][123091] Updated weights for policy 0, policy_version 1426262 (0.0008) [2023-12-26 10:58:54,728][123090] Updated weights for policy 1, policy_version 1416651 (0.0009) [2023-12-26 10:58:54,762][123091] Updated weights for policy 0, policy_version 1426272 (0.0007) [2023-12-26 10:58:54,778][123090] Updated weights for policy 1, policy_version 1416661 (0.0009) [2023-12-26 10:58:54,814][123091] Updated weights for policy 0, policy_version 1426282 (0.0009) [2023-12-26 10:58:54,830][123090] Updated weights for policy 1, policy_version 1416671 (0.0007) [2023-12-26 10:58:55,590][123090] Updated weights for policy 1, policy_version 1416681 (0.0006) [2023-12-26 10:58:55,638][123090] Updated weights for policy 1, policy_version 1416691 (0.0005) [2023-12-26 10:58:55,686][123090] Updated weights for policy 1, policy_version 1416701 (0.0005) [2023-12-26 10:58:55,701][123091] Updated weights for policy 0, policy_version 1426292 (0.0007) [2023-12-26 10:58:55,748][123091] Updated weights for policy 0, policy_version 1426302 (0.0005) [2023-12-26 10:58:55,793][123091] Updated weights for policy 0, policy_version 1426312 (0.0005) [2023-12-26 10:58:56,409][123090] Updated weights for policy 1, policy_version 1416711 (0.0005) [2023-12-26 10:58:56,469][123090] Updated weights for policy 1, policy_version 1416721 (0.0005) [2023-12-26 10:58:56,523][123091] Updated weights for policy 0, policy_version 1426322 (0.0006) [2023-12-26 10:58:56,541][123090] Updated weights for policy 1, policy_version 1416731 (0.0005) [2023-12-26 10:58:56,572][123091] Updated weights for policy 0, policy_version 1426332 (0.0009) [2023-12-26 10:58:56,626][123091] Updated weights for policy 0, policy_version 1426343 (0.0010) [2023-12-26 10:58:57,175][123090] Updated weights for policy 1, policy_version 1416741 (0.0005) [2023-12-26 10:58:57,228][123090] Updated weights for policy 1, policy_version 1416751 (0.0006) [2023-12-26 10:58:57,283][123090] Updated weights for policy 1, policy_version 1416761 (0.0010) [2023-12-26 10:58:57,532][123091] Updated weights for policy 0, policy_version 1426353 (0.0010) [2023-12-26 10:58:57,587][123091] Updated weights for policy 0, policy_version 1426363 (0.0010) [2023-12-26 10:58:57,639][123091] Updated weights for policy 0, policy_version 1426373 (0.0010) [2023-12-26 10:58:57,690][123091] Updated weights for policy 0, policy_version 1426383 (0.0010) [2023-12-26 10:58:57,946][123090] Updated weights for policy 1, policy_version 1416771 (0.0008) [2023-12-26 10:58:58,003][123090] Updated weights for policy 1, policy_version 1416781 (0.0005) [2023-12-26 10:58:58,068][123090] Updated weights for policy 1, policy_version 1416791 (0.0006) [2023-12-26 10:58:58,502][123091] Updated weights for policy 0, policy_version 1426393 (0.0008) [2023-12-26 10:58:58,574][123091] Updated weights for policy 0, policy_version 1426403 (0.0008) [2023-12-26 10:58:58,651][123091] Updated weights for policy 0, policy_version 1426413 (0.0008) [2023-12-26 10:58:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 727867392. Throughput: 0: 8872.7, 1: 9137.6. Samples: 727860972. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:58:58,785][121949] Avg episode reward: [(0, '6217.953'), (1, '5336.707')] [2023-12-26 10:58:58,961][123090] Updated weights for policy 1, policy_version 1416801 (0.0006) [2023-12-26 10:58:59,025][123090] Updated weights for policy 1, policy_version 1416811 (0.0008) [2023-12-26 10:58:59,091][123090] Updated weights for policy 1, policy_version 1416821 (0.0008) [2023-12-26 10:58:59,153][123090] Updated weights for policy 1, policy_version 1416831 (0.0009) [2023-12-26 10:58:59,446][123091] Updated weights for policy 0, policy_version 1426423 (0.0007) [2023-12-26 10:58:59,510][123091] Updated weights for policy 0, policy_version 1426433 (0.0008) [2023-12-26 10:58:59,562][123091] Updated weights for policy 0, policy_version 1426443 (0.0010) [2023-12-26 10:58:59,896][123090] Updated weights for policy 1, policy_version 1416841 (0.0006) [2023-12-26 10:58:59,965][123090] Updated weights for policy 1, policy_version 1416851 (0.0007) [2023-12-26 10:59:00,040][123090] Updated weights for policy 1, policy_version 1416861 (0.0006) [2023-12-26 10:59:00,275][123091] Updated weights for policy 0, policy_version 1426453 (0.0009) [2023-12-26 10:59:00,337][123091] Updated weights for policy 0, policy_version 1426463 (0.0005) [2023-12-26 10:59:00,400][123091] Updated weights for policy 0, policy_version 1426473 (0.0010) [2023-12-26 10:59:00,667][123090] Updated weights for policy 1, policy_version 1416871 (0.0005) [2023-12-26 10:59:00,724][123090] Updated weights for policy 1, policy_version 1416881 (0.0005) [2023-12-26 10:59:00,784][123090] Updated weights for policy 1, policy_version 1416891 (0.0006) [2023-12-26 10:59:01,087][123091] Updated weights for policy 0, policy_version 1426483 (0.0009) [2023-12-26 10:59:01,159][123091] Updated weights for policy 0, policy_version 1426493 (0.0007) [2023-12-26 10:59:01,215][123091] Updated weights for policy 0, policy_version 1426503 (0.0006) [2023-12-26 10:59:01,486][123090] Updated weights for policy 1, policy_version 1416901 (0.0008) [2023-12-26 10:59:01,545][123090] Updated weights for policy 1, policy_version 1416911 (0.0010) [2023-12-26 10:59:01,606][123090] Updated weights for policy 1, policy_version 1416921 (0.0010) [2023-12-26 10:59:02,047][123091] Updated weights for policy 0, policy_version 1426513 (0.0007) [2023-12-26 10:59:02,104][123091] Updated weights for policy 0, policy_version 1426523 (0.0010) [2023-12-26 10:59:02,160][123091] Updated weights for policy 0, policy_version 1426533 (0.0010) [2023-12-26 10:59:02,220][123091] Updated weights for policy 0, policy_version 1426543 (0.0010) [2023-12-26 10:59:02,486][123090] Updated weights for policy 1, policy_version 1416931 (0.0008) [2023-12-26 10:59:02,551][123090] Updated weights for policy 1, policy_version 1416941 (0.0009) [2023-12-26 10:59:02,615][123090] Updated weights for policy 1, policy_version 1416951 (0.0009) [2023-12-26 10:59:02,966][123091] Updated weights for policy 0, policy_version 1426553 (0.0005) [2023-12-26 10:59:03,023][123091] Updated weights for policy 0, policy_version 1426563 (0.0005) [2023-12-26 10:59:03,084][123091] Updated weights for policy 0, policy_version 1426573 (0.0006) [2023-12-26 10:59:03,516][123090] Updated weights for policy 1, policy_version 1416961 (0.0010) [2023-12-26 10:59:03,575][123090] Updated weights for policy 1, policy_version 1416971 (0.0008) [2023-12-26 10:59:03,630][123090] Updated weights for policy 1, policy_version 1416981 (0.0009) [2023-12-26 10:59:03,689][123091] Updated weights for policy 0, policy_version 1426583 (0.0008) [2023-12-26 10:59:03,694][123090] Updated weights for policy 1, policy_version 1416991 (0.0008) [2023-12-26 10:59:03,743][123091] Updated weights for policy 0, policy_version 1426593 (0.0008) [2023-12-26 10:59:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 727957504. Throughput: 0: 8790.1, 1: 9077.7. Samples: 727969588. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:03,784][121949] Avg episode reward: [(0, '6243.981'), (1, '5035.293')] [2023-12-26 10:59:03,800][123091] Updated weights for policy 0, policy_version 1426603 (0.0006) [2023-12-26 10:59:04,568][123090] Updated weights for policy 1, policy_version 1417001 (0.0010) [2023-12-26 10:59:04,593][123091] Updated weights for policy 0, policy_version 1426613 (0.0008) [2023-12-26 10:59:04,635][123090] Updated weights for policy 1, policy_version 1417011 (0.0010) [2023-12-26 10:59:04,661][123091] Updated weights for policy 0, policy_version 1426623 (0.0009) [2023-12-26 10:59:04,703][123090] Updated weights for policy 1, policy_version 1417021 (0.0008) [2023-12-26 10:59:04,723][123091] Updated weights for policy 0, policy_version 1426633 (0.0008) [2023-12-26 10:59:05,451][123091] Updated weights for policy 0, policy_version 1426643 (0.0006) [2023-12-26 10:59:05,514][123091] Updated weights for policy 0, policy_version 1426653 (0.0006) [2023-12-26 10:59:05,563][123091] Updated weights for policy 0, policy_version 1426663 (0.0009) [2023-12-26 10:59:05,594][123090] Updated weights for policy 1, policy_version 1417031 (0.0010) [2023-12-26 10:59:05,659][123090] Updated weights for policy 1, policy_version 1417041 (0.0008) [2023-12-26 10:59:05,726][123090] Updated weights for policy 1, policy_version 1417051 (0.0009) [2023-12-26 10:59:06,355][123091] Updated weights for policy 0, policy_version 1426673 (0.0007) [2023-12-26 10:59:06,413][123091] Updated weights for policy 0, policy_version 1426683 (0.0007) [2023-12-26 10:59:06,467][123091] Updated weights for policy 0, policy_version 1426693 (0.0009) [2023-12-26 10:59:06,517][123091] Updated weights for policy 0, policy_version 1426703 (0.0010) [2023-12-26 10:59:06,578][123090] Updated weights for policy 1, policy_version 1417061 (0.0008) [2023-12-26 10:59:06,633][123090] Updated weights for policy 1, policy_version 1417071 (0.0009) [2023-12-26 10:59:06,697][123090] Updated weights for policy 1, policy_version 1417081 (0.0009) [2023-12-26 10:59:07,397][123091] Updated weights for policy 0, policy_version 1426713 (0.0009) [2023-12-26 10:59:07,464][123091] Updated weights for policy 0, policy_version 1426723 (0.0009) [2023-12-26 10:59:07,499][123090] Updated weights for policy 1, policy_version 1417091 (0.0008) [2023-12-26 10:59:07,523][123091] Updated weights for policy 0, policy_version 1426733 (0.0011) [2023-12-26 10:59:07,560][123090] Updated weights for policy 1, policy_version 1417101 (0.0008) [2023-12-26 10:59:07,620][123090] Updated weights for policy 1, policy_version 1417111 (0.0010) [2023-12-26 10:59:08,268][123091] Updated weights for policy 0, policy_version 1426743 (0.0005) [2023-12-26 10:59:08,340][123091] Updated weights for policy 0, policy_version 1426753 (0.0008) [2023-12-26 10:59:08,409][123091] Updated weights for policy 0, policy_version 1426763 (0.0011) [2023-12-26 10:59:08,533][123090] Updated weights for policy 1, policy_version 1417121 (0.0009) [2023-12-26 10:59:08,589][123090] Updated weights for policy 1, policy_version 1417131 (0.0009) [2023-12-26 10:59:08,653][123090] Updated weights for policy 1, policy_version 1417141 (0.0008) [2023-12-26 10:59:08,710][123090] Updated weights for policy 1, policy_version 1417151 (0.0009) [2023-12-26 10:59:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 728047616. Throughput: 0: 8775.6, 1: 9062.5. Samples: 728021344. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:08,785][121949] Avg episode reward: [(0, '6277.206'), (1, '5124.072')] [2023-12-26 10:59:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001426768_365256704.pth... [2023-12-26 10:59:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001417152_362790912.pth... [2023-12-26 10:59:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001425744_364994560.pth [2023-12-26 10:59:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001416096_362520576.pth [2023-12-26 10:59:09,182][123091] Updated weights for policy 0, policy_version 1426773 (0.0008) [2023-12-26 10:59:09,255][123091] Updated weights for policy 0, policy_version 1426783 (0.0008) [2023-12-26 10:59:09,307][123091] Updated weights for policy 0, policy_version 1426793 (0.0006) [2023-12-26 10:59:09,558][123090] Updated weights for policy 1, policy_version 1417161 (0.0010) [2023-12-26 10:59:09,607][123090] Updated weights for policy 1, policy_version 1417171 (0.0010) [2023-12-26 10:59:09,661][123090] Updated weights for policy 1, policy_version 1417181 (0.0010) [2023-12-26 10:59:10,078][123091] Updated weights for policy 0, policy_version 1426803 (0.0013) [2023-12-26 10:59:10,138][123091] Updated weights for policy 0, policy_version 1426813 (0.0010) [2023-12-26 10:59:10,192][123091] Updated weights for policy 0, policy_version 1426823 (0.0010) [2023-12-26 10:59:10,476][123090] Updated weights for policy 1, policy_version 1417191 (0.0009) [2023-12-26 10:59:10,529][123090] Updated weights for policy 1, policy_version 1417201 (0.0009) [2023-12-26 10:59:10,592][123090] Updated weights for policy 1, policy_version 1417211 (0.0010) [2023-12-26 10:59:11,054][123091] Updated weights for policy 0, policy_version 1426833 (0.0010) [2023-12-26 10:59:11,124][123091] Updated weights for policy 0, policy_version 1426843 (0.0009) [2023-12-26 10:59:11,184][123091] Updated weights for policy 0, policy_version 1426853 (0.0009) [2023-12-26 10:59:11,241][123091] Updated weights for policy 0, policy_version 1426863 (0.0009) [2023-12-26 10:59:11,452][123090] Updated weights for policy 1, policy_version 1417221 (0.0010) [2023-12-26 10:59:11,497][123090] Updated weights for policy 1, policy_version 1417231 (0.0010) [2023-12-26 10:59:11,549][123090] Updated weights for policy 1, policy_version 1417241 (0.0010) [2023-12-26 10:59:12,148][123091] Updated weights for policy 0, policy_version 1426873 (0.0010) [2023-12-26 10:59:12,207][123091] Updated weights for policy 0, policy_version 1426883 (0.0010) [2023-12-26 10:59:12,265][123091] Updated weights for policy 0, policy_version 1426893 (0.0009) [2023-12-26 10:59:12,300][123090] Updated weights for policy 1, policy_version 1417251 (0.0010) [2023-12-26 10:59:12,367][123090] Updated weights for policy 1, policy_version 1417261 (0.0010) [2023-12-26 10:59:12,433][123090] Updated weights for policy 1, policy_version 1417271 (0.0008) [2023-12-26 10:59:13,161][123091] Updated weights for policy 0, policy_version 1426903 (0.0009) [2023-12-26 10:59:13,167][123090] Updated weights for policy 1, policy_version 1417281 (0.0010) [2023-12-26 10:59:13,209][123091] Updated weights for policy 0, policy_version 1426913 (0.0009) [2023-12-26 10:59:13,225][123090] Updated weights for policy 1, policy_version 1417291 (0.0006) [2023-12-26 10:59:13,271][123091] Updated weights for policy 0, policy_version 1426923 (0.0010) [2023-12-26 10:59:13,283][123090] Updated weights for policy 1, policy_version 1417301 (0.0008) [2023-12-26 10:59:13,330][123090] Updated weights for policy 1, policy_version 1417311 (0.0005) [2023-12-26 10:59:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 728129536. Throughput: 0: 8650.4, 1: 8969.6. Samples: 728123256. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:13,784][121949] Avg episode reward: [(0, '6328.879'), (1, '5415.900')] [2023-12-26 10:59:14,043][123090] Updated weights for policy 1, policy_version 1417321 (0.0005) [2023-12-26 10:59:14,098][123091] Updated weights for policy 0, policy_version 1426933 (0.0011) [2023-12-26 10:59:14,101][123090] Updated weights for policy 1, policy_version 1417331 (0.0005) [2023-12-26 10:59:14,153][123090] Updated weights for policy 1, policy_version 1417341 (0.0005) [2023-12-26 10:59:14,153][123091] Updated weights for policy 0, policy_version 1426943 (0.0010) [2023-12-26 10:59:14,209][123091] Updated weights for policy 0, policy_version 1426953 (0.0011) [2023-12-26 10:59:14,863][123090] Updated weights for policy 1, policy_version 1417351 (0.0009) [2023-12-26 10:59:14,916][123090] Updated weights for policy 1, policy_version 1417361 (0.0010) [2023-12-26 10:59:14,972][123090] Updated weights for policy 1, policy_version 1417371 (0.0011) [2023-12-26 10:59:15,000][123091] Updated weights for policy 0, policy_version 1426963 (0.0009) [2023-12-26 10:59:15,067][123091] Updated weights for policy 0, policy_version 1426973 (0.0010) [2023-12-26 10:59:15,130][123091] Updated weights for policy 0, policy_version 1426983 (0.0009) [2023-12-26 10:59:15,696][123090] Updated weights for policy 1, policy_version 1417381 (0.0008) [2023-12-26 10:59:15,742][123090] Updated weights for policy 1, policy_version 1417391 (0.0005) [2023-12-26 10:59:15,792][123090] Updated weights for policy 1, policy_version 1417401 (0.0005) [2023-12-26 10:59:16,039][123091] Updated weights for policy 0, policy_version 1426993 (0.0010) [2023-12-26 10:59:16,096][123091] Updated weights for policy 0, policy_version 1427004 (0.0010) [2023-12-26 10:59:16,161][123091] Updated weights for policy 0, policy_version 1427014 (0.0010) [2023-12-26 10:59:16,215][123091] Updated weights for policy 0, policy_version 1427024 (0.0009) [2023-12-26 10:59:16,506][123090] Updated weights for policy 1, policy_version 1417411 (0.0007) [2023-12-26 10:59:16,568][123090] Updated weights for policy 1, policy_version 1417421 (0.0010) [2023-12-26 10:59:16,631][123090] Updated weights for policy 1, policy_version 1417431 (0.0010) [2023-12-26 10:59:17,073][123091] Updated weights for policy 0, policy_version 1427034 (0.0009) [2023-12-26 10:59:17,138][123091] Updated weights for policy 0, policy_version 1427044 (0.0009) [2023-12-26 10:59:17,200][123091] Updated weights for policy 0, policy_version 1427054 (0.0009) [2023-12-26 10:59:17,390][123090] Updated weights for policy 1, policy_version 1417441 (0.0010) [2023-12-26 10:59:17,438][123090] Updated weights for policy 1, policy_version 1417451 (0.0005) [2023-12-26 10:59:17,495][123090] Updated weights for policy 1, policy_version 1417461 (0.0005) [2023-12-26 10:59:17,545][123090] Updated weights for policy 1, policy_version 1417471 (0.0006) [2023-12-26 10:59:17,976][123091] Updated weights for policy 0, policy_version 1427064 (0.0007) [2023-12-26 10:59:18,041][123091] Updated weights for policy 0, policy_version 1427074 (0.0007) [2023-12-26 10:59:18,101][123091] Updated weights for policy 0, policy_version 1427084 (0.0005) [2023-12-26 10:59:18,190][123090] Updated weights for policy 1, policy_version 1417481 (0.0006) [2023-12-26 10:59:18,240][123090] Updated weights for policy 1, policy_version 1417491 (0.0007) [2023-12-26 10:59:18,295][123090] Updated weights for policy 1, policy_version 1417502 (0.0010) [2023-12-26 10:59:18,760][123091] Updated weights for policy 0, policy_version 1427094 (0.0009) [2023-12-26 10:59:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 728219648. Throughput: 0: 8695.4, 1: 9037.9. Samples: 728233572. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:18,785][121949] Avg episode reward: [(0, '6281.198'), (1, '5560.036')] [2023-12-26 10:59:18,819][123091] Updated weights for policy 0, policy_version 1427104 (0.0006) [2023-12-26 10:59:18,872][123091] Updated weights for policy 0, policy_version 1427114 (0.0005) [2023-12-26 10:59:19,157][123090] Updated weights for policy 1, policy_version 1417512 (0.0010) [2023-12-26 10:59:19,204][123090] Updated weights for policy 1, policy_version 1417522 (0.0008) [2023-12-26 10:59:19,273][123090] Updated weights for policy 1, policy_version 1417532 (0.0009) [2023-12-26 10:59:19,547][123091] Updated weights for policy 0, policy_version 1427124 (0.0006) [2023-12-26 10:59:19,615][123091] Updated weights for policy 0, policy_version 1427134 (0.0008) [2023-12-26 10:59:19,681][123091] Updated weights for policy 0, policy_version 1427144 (0.0009) [2023-12-26 10:59:20,160][123090] Updated weights for policy 1, policy_version 1417542 (0.0009) [2023-12-26 10:59:20,231][123090] Updated weights for policy 1, policy_version 1417552 (0.0009) [2023-12-26 10:59:20,298][123090] Updated weights for policy 1, policy_version 1417562 (0.0011) [2023-12-26 10:59:20,457][123091] Updated weights for policy 0, policy_version 1427154 (0.0009) [2023-12-26 10:59:20,517][123091] Updated weights for policy 0, policy_version 1427164 (0.0008) [2023-12-26 10:59:20,589][123091] Updated weights for policy 0, policy_version 1427174 (0.0008) [2023-12-26 10:59:20,655][123091] Updated weights for policy 0, policy_version 1427184 (0.0008) [2023-12-26 10:59:21,054][123090] Updated weights for policy 1, policy_version 1417573 (0.0008) [2023-12-26 10:59:21,127][123090] Updated weights for policy 1, policy_version 1417583 (0.0009) [2023-12-26 10:59:21,195][123090] Updated weights for policy 1, policy_version 1417593 (0.0011) [2023-12-26 10:59:21,531][123091] Updated weights for policy 0, policy_version 1427194 (0.0010) [2023-12-26 10:59:21,587][123091] Updated weights for policy 0, policy_version 1427204 (0.0009) [2023-12-26 10:59:21,658][123091] Updated weights for policy 0, policy_version 1427214 (0.0009) [2023-12-26 10:59:21,965][123090] Updated weights for policy 1, policy_version 1417603 (0.0009) [2023-12-26 10:59:22,032][123090] Updated weights for policy 1, policy_version 1417613 (0.0005) [2023-12-26 10:59:22,097][123090] Updated weights for policy 1, policy_version 1417623 (0.0008) [2023-12-26 10:59:22,555][123091] Updated weights for policy 0, policy_version 1427224 (0.0010) [2023-12-26 10:59:22,611][123091] Updated weights for policy 0, policy_version 1427234 (0.0011) [2023-12-26 10:59:22,670][123091] Updated weights for policy 0, policy_version 1427244 (0.0011) [2023-12-26 10:59:22,920][123090] Updated weights for policy 1, policy_version 1417633 (0.0010) [2023-12-26 10:59:22,983][123090] Updated weights for policy 1, policy_version 1417643 (0.0010) [2023-12-26 10:59:23,041][123090] Updated weights for policy 1, policy_version 1417653 (0.0009) [2023-12-26 10:59:23,103][123090] Updated weights for policy 1, policy_version 1417663 (0.0009) [2023-12-26 10:59:23,513][123091] Updated weights for policy 0, policy_version 1427254 (0.0007) [2023-12-26 10:59:23,575][123091] Updated weights for policy 0, policy_version 1427264 (0.0006) [2023-12-26 10:59:23,645][123091] Updated weights for policy 0, policy_version 1427274 (0.0008) [2023-12-26 10:59:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 728309760. Throughput: 0: 8681.4, 1: 9015.2. Samples: 728286368. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:23,785][121949] Avg episode reward: [(0, '6189.588'), (1, '5204.058')] [2023-12-26 10:59:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001427280_365387776.pth... [2023-12-26 10:59:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001426224_365117440.pth [2023-12-26 10:59:23,845][123090] Updated weights for policy 1, policy_version 1417673 (0.0006) [2023-12-26 10:59:23,902][123090] Updated weights for policy 1, policy_version 1417683 (0.0007) [2023-12-26 10:59:23,957][123090] Updated weights for policy 1, policy_version 1417693 (0.0005) [2023-12-26 10:59:23,973][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001417696_362930176.pth... [2023-12-26 10:59:23,976][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001416640_362659840.pth [2023-12-26 10:59:24,412][123091] Updated weights for policy 0, policy_version 1427284 (0.0011) [2023-12-26 10:59:24,460][123091] Updated weights for policy 0, policy_version 1427294 (0.0010) [2023-12-26 10:59:24,519][123091] Updated weights for policy 0, policy_version 1427304 (0.0011) [2023-12-26 10:59:24,576][123090] Updated weights for policy 1, policy_version 1417703 (0.0005) [2023-12-26 10:59:24,636][123090] Updated weights for policy 1, policy_version 1417713 (0.0005) [2023-12-26 10:59:24,701][123090] Updated weights for policy 1, policy_version 1417723 (0.0005) [2023-12-26 10:59:25,360][123091] Updated weights for policy 0, policy_version 1427314 (0.0010) [2023-12-26 10:59:25,402][123090] Updated weights for policy 1, policy_version 1417733 (0.0006) [2023-12-26 10:59:25,411][123091] Updated weights for policy 0, policy_version 1427324 (0.0010) [2023-12-26 10:59:25,458][123091] Updated weights for policy 0, policy_version 1427334 (0.0005) [2023-12-26 10:59:25,465][123090] Updated weights for policy 1, policy_version 1417743 (0.0009) [2023-12-26 10:59:25,501][123091] Updated weights for policy 0, policy_version 1427344 (0.0005) [2023-12-26 10:59:25,528][123090] Updated weights for policy 1, policy_version 1417753 (0.0009) [2023-12-26 10:59:26,184][123091] Updated weights for policy 0, policy_version 1427354 (0.0005) [2023-12-26 10:59:26,237][123091] Updated weights for policy 0, policy_version 1427364 (0.0005) [2023-12-26 10:59:26,291][123091] Updated weights for policy 0, policy_version 1427374 (0.0005) [2023-12-26 10:59:26,462][123090] Updated weights for policy 1, policy_version 1417763 (0.0010) [2023-12-26 10:59:26,520][123090] Updated weights for policy 1, policy_version 1417773 (0.0010) [2023-12-26 10:59:26,573][123090] Updated weights for policy 1, policy_version 1417783 (0.0010) [2023-12-26 10:59:26,987][123091] Updated weights for policy 0, policy_version 1427384 (0.0005) [2023-12-26 10:59:27,049][123091] Updated weights for policy 0, policy_version 1427394 (0.0008) [2023-12-26 10:59:27,103][123091] Updated weights for policy 0, policy_version 1427404 (0.0010) [2023-12-26 10:59:27,458][123090] Updated weights for policy 1, policy_version 1417793 (0.0010) [2023-12-26 10:59:27,517][123090] Updated weights for policy 1, policy_version 1417803 (0.0009) [2023-12-26 10:59:27,576][123090] Updated weights for policy 1, policy_version 1417813 (0.0009) [2023-12-26 10:59:27,644][123090] Updated weights for policy 1, policy_version 1417823 (0.0009) [2023-12-26 10:59:27,837][123091] Updated weights for policy 0, policy_version 1427414 (0.0010) [2023-12-26 10:59:27,881][123091] Updated weights for policy 0, policy_version 1427424 (0.0010) [2023-12-26 10:59:27,931][123091] Updated weights for policy 0, policy_version 1427434 (0.0010) [2023-12-26 10:59:28,507][123090] Updated weights for policy 1, policy_version 1417833 (0.0010) [2023-12-26 10:59:28,570][123090] Updated weights for policy 1, policy_version 1417843 (0.0009) [2023-12-26 10:59:28,630][123090] Updated weights for policy 1, policy_version 1417853 (0.0010) [2023-12-26 10:59:28,688][123091] Updated weights for policy 0, policy_version 1427444 (0.0008) [2023-12-26 10:59:28,750][123091] Updated weights for policy 0, policy_version 1427454 (0.0010) [2023-12-26 10:59:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 728399872. Throughput: 0: 8806.6, 1: 8994.4. Samples: 728394504. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:28,785][121949] Avg episode reward: [(0, '6259.146'), (1, '5155.125')] [2023-12-26 10:59:28,817][123091] Updated weights for policy 0, policy_version 1427464 (0.0011) [2023-12-26 10:59:29,458][123090] Updated weights for policy 1, policy_version 1417863 (0.0009) [2023-12-26 10:59:29,514][123090] Updated weights for policy 1, policy_version 1417873 (0.0009) [2023-12-26 10:59:29,581][123090] Updated weights for policy 1, policy_version 1417883 (0.0009) [2023-12-26 10:59:29,634][123091] Updated weights for policy 0, policy_version 1427474 (0.0009) [2023-12-26 10:59:29,682][123091] Updated weights for policy 0, policy_version 1427484 (0.0009) [2023-12-26 10:59:29,730][123091] Updated weights for policy 0, policy_version 1427494 (0.0009) [2023-12-26 10:59:29,780][123091] Updated weights for policy 0, policy_version 1427504 (0.0009) [2023-12-26 10:59:30,430][123090] Updated weights for policy 1, policy_version 1417893 (0.0010) [2023-12-26 10:59:30,485][123090] Updated weights for policy 1, policy_version 1417903 (0.0009) [2023-12-26 10:59:30,535][123090] Updated weights for policy 1, policy_version 1417913 (0.0009) [2023-12-26 10:59:30,561][123091] Updated weights for policy 0, policy_version 1427514 (0.0005) [2023-12-26 10:59:30,611][123091] Updated weights for policy 0, policy_version 1427524 (0.0005) [2023-12-26 10:59:30,655][123091] Updated weights for policy 0, policy_version 1427534 (0.0005) [2023-12-26 10:59:31,441][123091] Updated weights for policy 0, policy_version 1427544 (0.0009) [2023-12-26 10:59:31,451][123090] Updated weights for policy 1, policy_version 1417923 (0.0008) [2023-12-26 10:59:31,491][123091] Updated weights for policy 0, policy_version 1427554 (0.0009) [2023-12-26 10:59:31,516][123090] Updated weights for policy 1, policy_version 1417933 (0.0009) [2023-12-26 10:59:31,549][123091] Updated weights for policy 0, policy_version 1427564 (0.0008) [2023-12-26 10:59:31,576][123090] Updated weights for policy 1, policy_version 1417943 (0.0008) [2023-12-26 10:59:32,414][123091] Updated weights for policy 0, policy_version 1427574 (0.0009) [2023-12-26 10:59:32,446][123090] Updated weights for policy 1, policy_version 1417953 (0.0010) [2023-12-26 10:59:32,467][123091] Updated weights for policy 0, policy_version 1427584 (0.0008) [2023-12-26 10:59:32,503][123090] Updated weights for policy 1, policy_version 1417963 (0.0009) [2023-12-26 10:59:32,519][123091] Updated weights for policy 0, policy_version 1427594 (0.0007) [2023-12-26 10:59:32,566][123090] Updated weights for policy 1, policy_version 1417973 (0.0007) [2023-12-26 10:59:32,620][123090] Updated weights for policy 1, policy_version 1417983 (0.0008) [2023-12-26 10:59:33,358][123091] Updated weights for policy 0, policy_version 1427604 (0.0010) [2023-12-26 10:59:33,408][123091] Updated weights for policy 0, policy_version 1427614 (0.0010) [2023-12-26 10:59:33,450][123090] Updated weights for policy 1, policy_version 1417993 (0.0007) [2023-12-26 10:59:33,459][123091] Updated weights for policy 0, policy_version 1427624 (0.0010) [2023-12-26 10:59:33,505][123090] Updated weights for policy 1, policy_version 1418003 (0.0006) [2023-12-26 10:59:33,558][123090] Updated weights for policy 1, policy_version 1418013 (0.0009) [2023-12-26 10:59:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17883.5). Total num frames: 728489984. Throughput: 0: 8893.7, 1: 8845.0. Samples: 728497984. Policy #0 lag: (min: 11.0, avg: 14.4, max: 43.0) [2023-12-26 10:59:33,785][121949] Avg episode reward: [(0, '6144.606'), (1, '5419.513')] [2023-12-26 10:59:34,275][123091] Updated weights for policy 0, policy_version 1427634 (0.0010) [2023-12-26 10:59:34,342][123091] Updated weights for policy 0, policy_version 1427644 (0.0008) [2023-12-26 10:59:34,375][123090] Updated weights for policy 1, policy_version 1418023 (0.0008) [2023-12-26 10:59:34,409][123091] Updated weights for policy 0, policy_version 1427654 (0.0009) [2023-12-26 10:59:34,444][123090] Updated weights for policy 1, policy_version 1418033 (0.0009) [2023-12-26 10:59:34,478][123091] Updated weights for policy 0, policy_version 1427664 (0.0008) [2023-12-26 10:59:34,508][123090] Updated weights for policy 1, policy_version 1418043 (0.0008) [2023-12-26 10:59:35,226][123091] Updated weights for policy 0, policy_version 1427674 (0.0009) [2023-12-26 10:59:35,275][123091] Updated weights for policy 0, policy_version 1427684 (0.0009) [2023-12-26 10:59:35,329][123091] Updated weights for policy 0, policy_version 1427694 (0.0010) [2023-12-26 10:59:35,363][123090] Updated weights for policy 1, policy_version 1418053 (0.0008) [2023-12-26 10:59:35,427][123090] Updated weights for policy 1, policy_version 1418063 (0.0005) [2023-12-26 10:59:35,485][123090] Updated weights for policy 1, policy_version 1418073 (0.0005) [2023-12-26 10:59:36,106][123091] Updated weights for policy 0, policy_version 1427704 (0.0007) [2023-12-26 10:59:36,167][123090] Updated weights for policy 1, policy_version 1418083 (0.0006) [2023-12-26 10:59:36,175][123091] Updated weights for policy 0, policy_version 1427714 (0.0009) [2023-12-26 10:59:36,222][123090] Updated weights for policy 1, policy_version 1418093 (0.0006) [2023-12-26 10:59:36,236][123091] Updated weights for policy 0, policy_version 1427724 (0.0009) [2023-12-26 10:59:36,281][123090] Updated weights for policy 1, policy_version 1418103 (0.0005) [2023-12-26 10:59:37,002][123091] Updated weights for policy 0, policy_version 1427734 (0.0010) [2023-12-26 10:59:37,052][123091] Updated weights for policy 0, policy_version 1427744 (0.0010) [2023-12-26 10:59:37,074][123090] Updated weights for policy 1, policy_version 1418113 (0.0008) [2023-12-26 10:59:37,101][123091] Updated weights for policy 0, policy_version 1427754 (0.0009) [2023-12-26 10:59:37,138][123090] Updated weights for policy 1, policy_version 1418123 (0.0008) [2023-12-26 10:59:37,192][123090] Updated weights for policy 1, policy_version 1418133 (0.0009) [2023-12-26 10:59:37,252][123090] Updated weights for policy 1, policy_version 1418143 (0.0009) [2023-12-26 10:59:37,967][123091] Updated weights for policy 0, policy_version 1427764 (0.0010) [2023-12-26 10:59:38,037][123091] Updated weights for policy 0, policy_version 1427774 (0.0010) [2023-12-26 10:59:38,086][123090] Updated weights for policy 1, policy_version 1418153 (0.0006) [2023-12-26 10:59:38,104][123091] Updated weights for policy 0, policy_version 1427784 (0.0010) [2023-12-26 10:59:38,151][123090] Updated weights for policy 1, policy_version 1418163 (0.0008) [2023-12-26 10:59:38,216][123090] Updated weights for policy 1, policy_version 1418173 (0.0009) [2023-12-26 10:59:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17855.8). Total num frames: 728571904. Throughput: 0: 8911.0, 1: 8858.3. Samples: 728552000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:59:38,785][121949] Avg episode reward: [(0, '6021.893'), (1, '5449.967')] [2023-12-26 10:59:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001418176_363053056.pth... [2023-12-26 10:59:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001427792_365518848.pth... [2023-12-26 10:59:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001417152_362790912.pth [2023-12-26 10:59:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001426768_365256704.pth [2023-12-26 10:59:38,950][123091] Updated weights for policy 0, policy_version 1427794 (0.0007) [2023-12-26 10:59:39,029][123091] Updated weights for policy 0, policy_version 1427804 (0.0007) [2023-12-26 10:59:39,048][123090] Updated weights for policy 1, policy_version 1418183 (0.0008) [2023-12-26 10:59:39,081][123091] Updated weights for policy 0, policy_version 1427814 (0.0006) [2023-12-26 10:59:39,117][123090] Updated weights for policy 1, policy_version 1418193 (0.0009) [2023-12-26 10:59:39,145][123091] Updated weights for policy 0, policy_version 1427824 (0.0008) [2023-12-26 10:59:39,178][123090] Updated weights for policy 1, policy_version 1418203 (0.0009) [2023-12-26 10:59:39,986][123091] Updated weights for policy 0, policy_version 1427834 (0.0010) [2023-12-26 10:59:40,045][123091] Updated weights for policy 0, policy_version 1427844 (0.0008) [2023-12-26 10:59:40,048][123090] Updated weights for policy 1, policy_version 1418213 (0.0009) [2023-12-26 10:59:40,105][123090] Updated weights for policy 1, policy_version 1418223 (0.0007) [2023-12-26 10:59:40,110][123091] Updated weights for policy 0, policy_version 1427854 (0.0010) [2023-12-26 10:59:40,174][123090] Updated weights for policy 1, policy_version 1418233 (0.0009) [2023-12-26 10:59:40,976][123091] Updated weights for policy 0, policy_version 1427864 (0.0009) [2023-12-26 10:59:40,992][123090] Updated weights for policy 1, policy_version 1418244 (0.0008) [2023-12-26 10:59:41,039][123091] Updated weights for policy 0, policy_version 1427874 (0.0007) [2023-12-26 10:59:41,067][123090] Updated weights for policy 1, policy_version 1418254 (0.0009) [2023-12-26 10:59:41,106][123091] Updated weights for policy 0, policy_version 1427884 (0.0009) [2023-12-26 10:59:41,131][123090] Updated weights for policy 1, policy_version 1418264 (0.0009) [2023-12-26 10:59:41,957][123091] Updated weights for policy 0, policy_version 1427894 (0.0008) [2023-12-26 10:59:42,013][123090] Updated weights for policy 1, policy_version 1418274 (0.0009) [2023-12-26 10:59:42,020][123091] Updated weights for policy 0, policy_version 1427904 (0.0010) [2023-12-26 10:59:42,073][123090] Updated weights for policy 1, policy_version 1418284 (0.0009) [2023-12-26 10:59:42,077][123091] Updated weights for policy 0, policy_version 1427914 (0.0008) [2023-12-26 10:59:42,134][123090] Updated weights for policy 1, policy_version 1418294 (0.0009) [2023-12-26 10:59:42,956][123091] Updated weights for policy 0, policy_version 1427924 (0.0008) [2023-12-26 10:59:42,975][123090] Updated weights for policy 1, policy_version 1418305 (0.0010) [2023-12-26 10:59:43,016][123091] Updated weights for policy 0, policy_version 1427934 (0.0007) [2023-12-26 10:59:43,038][123090] Updated weights for policy 1, policy_version 1418315 (0.0009) [2023-12-26 10:59:43,078][123091] Updated weights for policy 0, policy_version 1427944 (0.0008) [2023-12-26 10:59:43,088][123090] Updated weights for policy 1, policy_version 1418325 (0.0011) [2023-12-26 10:59:43,147][123090] Updated weights for policy 1, policy_version 1418335 (0.0009) [2023-12-26 10:59:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 728653824. Throughput: 0: 8835.8, 1: 8749.0. Samples: 728652292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:59:43,785][121949] Avg episode reward: [(0, '6149.813'), (1, '5513.510')] [2023-12-26 10:59:43,876][123091] Updated weights for policy 0, policy_version 1427954 (0.0007) [2023-12-26 10:59:43,920][123090] Updated weights for policy 1, policy_version 1418345 (0.0010) [2023-12-26 10:59:43,935][123091] Updated weights for policy 0, policy_version 1427964 (0.0007) [2023-12-26 10:59:43,984][123090] Updated weights for policy 1, policy_version 1418355 (0.0009) [2023-12-26 10:59:43,992][123091] Updated weights for policy 0, policy_version 1427974 (0.0006) [2023-12-26 10:59:44,041][123091] Updated weights for policy 0, policy_version 1427984 (0.0007) [2023-12-26 10:59:44,047][123090] Updated weights for policy 1, policy_version 1418365 (0.0009) [2023-12-26 10:59:44,704][123091] Updated weights for policy 0, policy_version 1427994 (0.0009) [2023-12-26 10:59:44,763][123091] Updated weights for policy 0, policy_version 1428004 (0.0009) [2023-12-26 10:59:44,826][123091] Updated weights for policy 0, policy_version 1428014 (0.0011) [2023-12-26 10:59:44,927][123090] Updated weights for policy 1, policy_version 1418375 (0.0009) [2023-12-26 10:59:44,995][123090] Updated weights for policy 1, policy_version 1418385 (0.0007) [2023-12-26 10:59:45,065][123090] Updated weights for policy 1, policy_version 1418395 (0.0006) [2023-12-26 10:59:45,656][123091] Updated weights for policy 0, policy_version 1428024 (0.0010) [2023-12-26 10:59:45,665][123090] Updated weights for policy 1, policy_version 1418405 (0.0005) [2023-12-26 10:59:45,714][123091] Updated weights for policy 0, policy_version 1428034 (0.0010) [2023-12-26 10:59:45,726][123090] Updated weights for policy 1, policy_version 1418415 (0.0007) [2023-12-26 10:59:45,773][123091] Updated weights for policy 0, policy_version 1428044 (0.0010) [2023-12-26 10:59:45,780][123090] Updated weights for policy 1, policy_version 1418425 (0.0008) [2023-12-26 10:59:46,466][123091] Updated weights for policy 0, policy_version 1428054 (0.0007) [2023-12-26 10:59:46,526][123091] Updated weights for policy 0, policy_version 1428064 (0.0005) [2023-12-26 10:59:46,582][123091] Updated weights for policy 0, policy_version 1428074 (0.0005) [2023-12-26 10:59:46,633][123090] Updated weights for policy 1, policy_version 1418435 (0.0008) [2023-12-26 10:59:46,694][123090] Updated weights for policy 1, policy_version 1418445 (0.0009) [2023-12-26 10:59:46,752][123090] Updated weights for policy 1, policy_version 1418455 (0.0009) [2023-12-26 10:59:47,263][123091] Updated weights for policy 0, policy_version 1428084 (0.0005) [2023-12-26 10:59:47,328][123091] Updated weights for policy 0, policy_version 1428094 (0.0005) [2023-12-26 10:59:47,377][123091] Updated weights for policy 0, policy_version 1428104 (0.0005) [2023-12-26 10:59:47,634][123090] Updated weights for policy 1, policy_version 1418465 (0.0009) [2023-12-26 10:59:47,690][123090] Updated weights for policy 1, policy_version 1418475 (0.0006) [2023-12-26 10:59:47,746][123090] Updated weights for policy 1, policy_version 1418485 (0.0005) [2023-12-26 10:59:47,810][123090] Updated weights for policy 1, policy_version 1418495 (0.0005) [2023-12-26 10:59:48,132][123091] Updated weights for policy 0, policy_version 1428114 (0.0005) [2023-12-26 10:59:48,199][123091] Updated weights for policy 0, policy_version 1428125 (0.0009) [2023-12-26 10:59:48,247][123091] Updated weights for policy 0, policy_version 1428135 (0.0006) [2023-12-26 10:59:48,608][123090] Updated weights for policy 1, policy_version 1418505 (0.0009) [2023-12-26 10:59:48,661][123090] Updated weights for policy 1, policy_version 1418515 (0.0009) [2023-12-26 10:59:48,714][123090] Updated weights for policy 1, policy_version 1418525 (0.0011) [2023-12-26 10:59:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 728752128. Throughput: 0: 8851.8, 1: 8728.3. Samples: 728760692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:59:48,785][121949] Avg episode reward: [(0, '6237.572'), (1, '5732.347')] [2023-12-26 10:59:48,956][123091] Updated weights for policy 0, policy_version 1428145 (0.0006) [2023-12-26 10:59:49,014][123091] Updated weights for policy 0, policy_version 1428155 (0.0010) [2023-12-26 10:59:49,075][123091] Updated weights for policy 0, policy_version 1428165 (0.0009) [2023-12-26 10:59:49,131][123091] Updated weights for policy 0, policy_version 1428175 (0.0009) [2023-12-26 10:59:49,536][123090] Updated weights for policy 1, policy_version 1418535 (0.0009) [2023-12-26 10:59:49,601][123090] Updated weights for policy 1, policy_version 1418545 (0.0010) [2023-12-26 10:59:49,668][123090] Updated weights for policy 1, policy_version 1418555 (0.0008) [2023-12-26 10:59:49,973][123091] Updated weights for policy 0, policy_version 1428185 (0.0009) [2023-12-26 10:59:50,033][123091] Updated weights for policy 0, policy_version 1428195 (0.0008) [2023-12-26 10:59:50,097][123091] Updated weights for policy 0, policy_version 1428205 (0.0008) [2023-12-26 10:59:50,428][123090] Updated weights for policy 1, policy_version 1418565 (0.0008) [2023-12-26 10:59:50,494][123090] Updated weights for policy 1, policy_version 1418575 (0.0006) [2023-12-26 10:59:50,563][123090] Updated weights for policy 1, policy_version 1418585 (0.0006) [2023-12-26 10:59:50,879][123091] Updated weights for policy 0, policy_version 1428215 (0.0007) [2023-12-26 10:59:50,950][123091] Updated weights for policy 0, policy_version 1428225 (0.0006) [2023-12-26 10:59:51,008][123091] Updated weights for policy 0, policy_version 1428235 (0.0006) [2023-12-26 10:59:51,292][123090] Updated weights for policy 1, policy_version 1418595 (0.0008) [2023-12-26 10:59:51,368][123090] Updated weights for policy 1, policy_version 1418605 (0.0008) [2023-12-26 10:59:51,436][123090] Updated weights for policy 1, policy_version 1418615 (0.0011) [2023-12-26 10:59:51,756][123091] Updated weights for policy 0, policy_version 1428245 (0.0009) [2023-12-26 10:59:51,821][123091] Updated weights for policy 0, policy_version 1428255 (0.0009) [2023-12-26 10:59:51,882][123091] Updated weights for policy 0, policy_version 1428265 (0.0009) [2023-12-26 10:59:52,202][123090] Updated weights for policy 1, policy_version 1418625 (0.0010) [2023-12-26 10:59:52,270][123090] Updated weights for policy 1, policy_version 1418635 (0.0006) [2023-12-26 10:59:52,339][123090] Updated weights for policy 1, policy_version 1418645 (0.0006) [2023-12-26 10:59:52,409][123090] Updated weights for policy 1, policy_version 1418655 (0.0010) [2023-12-26 10:59:52,673][123091] Updated weights for policy 0, policy_version 1428275 (0.0006) [2023-12-26 10:59:52,743][123091] Updated weights for policy 0, policy_version 1428285 (0.0006) [2023-12-26 10:59:52,810][123091] Updated weights for policy 0, policy_version 1428295 (0.0010) [2023-12-26 10:59:53,173][123090] Updated weights for policy 1, policy_version 1418665 (0.0009) [2023-12-26 10:59:53,234][123090] Updated weights for policy 1, policy_version 1418675 (0.0007) [2023-12-26 10:59:53,297][123090] Updated weights for policy 1, policy_version 1418685 (0.0011) [2023-12-26 10:59:53,557][123091] Updated weights for policy 0, policy_version 1428305 (0.0009) [2023-12-26 10:59:53,619][123091] Updated weights for policy 0, policy_version 1428315 (0.0009) [2023-12-26 10:59:53,675][123091] Updated weights for policy 0, policy_version 1428325 (0.0009) [2023-12-26 10:59:53,735][123091] Updated weights for policy 0, policy_version 1428335 (0.0009) [2023-12-26 10:59:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 728842240. Throughput: 0: 8850.8, 1: 8771.9. Samples: 728814368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:59:53,786][121949] Avg episode reward: [(0, '6221.083'), (1, '5559.234')] [2023-12-26 10:59:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001428336_365658112.pth... [2023-12-26 10:59:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001418688_363184128.pth... [2023-12-26 10:59:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001427280_365387776.pth [2023-12-26 10:59:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001417696_362930176.pth [2023-12-26 10:59:54,101][123090] Updated weights for policy 1, policy_version 1418695 (0.0009) [2023-12-26 10:59:54,153][123090] Updated weights for policy 1, policy_version 1418705 (0.0007) [2023-12-26 10:59:54,205][123090] Updated weights for policy 1, policy_version 1418715 (0.0009) [2023-12-26 10:59:54,564][123091] Updated weights for policy 0, policy_version 1428345 (0.0009) [2023-12-26 10:59:54,629][123091] Updated weights for policy 0, policy_version 1428355 (0.0009) [2023-12-26 10:59:54,681][123091] Updated weights for policy 0, policy_version 1428365 (0.0009) [2023-12-26 10:59:54,927][123090] Updated weights for policy 1, policy_version 1418725 (0.0009) [2023-12-26 10:59:54,997][123090] Updated weights for policy 1, policy_version 1418735 (0.0009) [2023-12-26 10:59:55,054][123090] Updated weights for policy 1, policy_version 1418745 (0.0010) [2023-12-26 10:59:55,457][123091] Updated weights for policy 0, policy_version 1428375 (0.0007) [2023-12-26 10:59:55,507][123091] Updated weights for policy 0, policy_version 1428385 (0.0005) [2023-12-26 10:59:55,559][123091] Updated weights for policy 0, policy_version 1428395 (0.0005) [2023-12-26 10:59:55,942][123090] Updated weights for policy 1, policy_version 1418755 (0.0009) [2023-12-26 10:59:55,998][123090] Updated weights for policy 1, policy_version 1418765 (0.0005) [2023-12-26 10:59:56,060][123090] Updated weights for policy 1, policy_version 1418775 (0.0005) [2023-12-26 10:59:56,354][123091] Updated weights for policy 0, policy_version 1428405 (0.0007) [2023-12-26 10:59:56,409][123091] Updated weights for policy 0, policy_version 1428415 (0.0009) [2023-12-26 10:59:56,476][123091] Updated weights for policy 0, policy_version 1428425 (0.0010) [2023-12-26 10:59:56,797][123090] Updated weights for policy 1, policy_version 1418785 (0.0008) [2023-12-26 10:59:56,862][123090] Updated weights for policy 1, policy_version 1418795 (0.0007) [2023-12-26 10:59:56,906][123090] Updated weights for policy 1, policy_version 1418805 (0.0005) [2023-12-26 10:59:56,968][123090] Updated weights for policy 1, policy_version 1418815 (0.0007) [2023-12-26 10:59:57,323][123091] Updated weights for policy 0, policy_version 1428435 (0.0010) [2023-12-26 10:59:57,372][123091] Updated weights for policy 0, policy_version 1428445 (0.0006) [2023-12-26 10:59:57,436][123091] Updated weights for policy 0, policy_version 1428455 (0.0007) [2023-12-26 10:59:57,673][123090] Updated weights for policy 1, policy_version 1418825 (0.0010) [2023-12-26 10:59:57,739][123090] Updated weights for policy 1, policy_version 1418835 (0.0010) [2023-12-26 10:59:57,807][123090] Updated weights for policy 1, policy_version 1418845 (0.0010) [2023-12-26 10:59:58,156][123091] Updated weights for policy 0, policy_version 1428465 (0.0008) [2023-12-26 10:59:58,222][123091] Updated weights for policy 0, policy_version 1428475 (0.0011) [2023-12-26 10:59:58,289][123091] Updated weights for policy 0, policy_version 1428485 (0.0010) [2023-12-26 10:59:58,372][123091] Updated weights for policy 0, policy_version 1428495 (0.0010) [2023-12-26 10:59:58,663][123090] Updated weights for policy 1, policy_version 1418855 (0.0009) [2023-12-26 10:59:58,736][123090] Updated weights for policy 1, policy_version 1418865 (0.0009) [2023-12-26 10:59:58,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 728924160. Throughput: 0: 8911.9, 1: 8850.7. Samples: 728922576. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 10:59:58,785][121949] Avg episode reward: [(0, '6265.264'), (1, '5546.405')] [2023-12-26 10:59:58,820][123090] Updated weights for policy 1, policy_version 1418875 (0.0008) [2023-12-26 10:59:59,237][123091] Updated weights for policy 0, policy_version 1428505 (0.0009) [2023-12-26 10:59:59,308][123091] Updated weights for policy 0, policy_version 1428515 (0.0010) [2023-12-26 10:59:59,373][123091] Updated weights for policy 0, policy_version 1428525 (0.0010) [2023-12-26 10:59:59,670][123090] Updated weights for policy 1, policy_version 1418885 (0.0010) [2023-12-26 10:59:59,745][123090] Updated weights for policy 1, policy_version 1418895 (0.0010) [2023-12-26 10:59:59,815][123090] Updated weights for policy 1, policy_version 1418905 (0.0011) [2023-12-26 11:00:00,066][123091] Updated weights for policy 0, policy_version 1428535 (0.0010) [2023-12-26 11:00:00,129][123091] Updated weights for policy 0, policy_version 1428545 (0.0011) [2023-12-26 11:00:00,196][123091] Updated weights for policy 0, policy_version 1428555 (0.0010) [2023-12-26 11:00:00,545][123090] Updated weights for policy 1, policy_version 1418915 (0.0009) [2023-12-26 11:00:00,610][123090] Updated weights for policy 1, policy_version 1418925 (0.0005) [2023-12-26 11:00:00,680][123090] Updated weights for policy 1, policy_version 1418935 (0.0010) [2023-12-26 11:00:00,990][123091] Updated weights for policy 0, policy_version 1428565 (0.0009) [2023-12-26 11:00:01,055][123091] Updated weights for policy 0, policy_version 1428575 (0.0009) [2023-12-26 11:00:01,111][123091] Updated weights for policy 0, policy_version 1428585 (0.0009) [2023-12-26 11:00:01,471][123090] Updated weights for policy 1, policy_version 1418945 (0.0010) [2023-12-26 11:00:01,530][123090] Updated weights for policy 1, policy_version 1418955 (0.0010) [2023-12-26 11:00:01,585][123090] Updated weights for policy 1, policy_version 1418965 (0.0010) [2023-12-26 11:00:01,645][123090] Updated weights for policy 1, policy_version 1418975 (0.0010) [2023-12-26 11:00:01,958][123091] Updated weights for policy 0, policy_version 1428595 (0.0009) [2023-12-26 11:00:02,024][123091] Updated weights for policy 0, policy_version 1428605 (0.0010) [2023-12-26 11:00:02,086][123091] Updated weights for policy 0, policy_version 1428615 (0.0010) [2023-12-26 11:00:02,445][123090] Updated weights for policy 1, policy_version 1418985 (0.0010) [2023-12-26 11:00:02,509][123090] Updated weights for policy 1, policy_version 1418995 (0.0009) [2023-12-26 11:00:02,569][123090] Updated weights for policy 1, policy_version 1419005 (0.0009) [2023-12-26 11:00:02,876][123091] Updated weights for policy 0, policy_version 1428625 (0.0010) [2023-12-26 11:00:02,946][123091] Updated weights for policy 0, policy_version 1428635 (0.0010) [2023-12-26 11:00:03,003][123091] Updated weights for policy 0, policy_version 1428645 (0.0009) [2023-12-26 11:00:03,051][123091] Updated weights for policy 0, policy_version 1428655 (0.0008) [2023-12-26 11:00:03,382][123090] Updated weights for policy 1, policy_version 1419015 (0.0007) [2023-12-26 11:00:03,430][123090] Updated weights for policy 1, policy_version 1419025 (0.0005) [2023-12-26 11:00:03,475][123090] Updated weights for policy 1, policy_version 1419035 (0.0005) [2023-12-26 11:00:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 729014272. Throughput: 0: 8916.8, 1: 8712.6. Samples: 729026896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:03,785][121949] Avg episode reward: [(0, '6243.718'), (1, '5681.893')] [2023-12-26 11:00:03,896][123091] Updated weights for policy 0, policy_version 1428665 (0.0008) [2023-12-26 11:00:03,952][123091] Updated weights for policy 0, policy_version 1428675 (0.0005) [2023-12-26 11:00:04,019][123091] Updated weights for policy 0, policy_version 1428685 (0.0005) [2023-12-26 11:00:04,207][123090] Updated weights for policy 1, policy_version 1419045 (0.0007) [2023-12-26 11:00:04,260][123090] Updated weights for policy 1, policy_version 1419055 (0.0010) [2023-12-26 11:00:04,312][123090] Updated weights for policy 1, policy_version 1419065 (0.0010) [2023-12-26 11:00:04,747][123091] Updated weights for policy 0, policy_version 1428695 (0.0009) [2023-12-26 11:00:04,800][123091] Updated weights for policy 0, policy_version 1428706 (0.0010) [2023-12-26 11:00:04,853][123091] Updated weights for policy 0, policy_version 1428717 (0.0010) [2023-12-26 11:00:05,018][123090] Updated weights for policy 1, policy_version 1419075 (0.0009) [2023-12-26 11:00:05,081][123090] Updated weights for policy 1, policy_version 1419085 (0.0005) [2023-12-26 11:00:05,140][123090] Updated weights for policy 1, policy_version 1419095 (0.0005) [2023-12-26 11:00:05,740][123090] Updated weights for policy 1, policy_version 1419105 (0.0005) [2023-12-26 11:00:05,795][123090] Updated weights for policy 1, policy_version 1419115 (0.0006) [2023-12-26 11:00:05,798][123091] Updated weights for policy 0, policy_version 1428727 (0.0010) [2023-12-26 11:00:05,857][123091] Updated weights for policy 0, policy_version 1428737 (0.0009) [2023-12-26 11:00:05,865][123090] Updated weights for policy 1, policy_version 1419125 (0.0005) [2023-12-26 11:00:05,910][123091] Updated weights for policy 0, policy_version 1428747 (0.0009) [2023-12-26 11:00:05,916][123090] Updated weights for policy 1, policy_version 1419135 (0.0005) [2023-12-26 11:00:06,637][123090] Updated weights for policy 1, policy_version 1419145 (0.0007) [2023-12-26 11:00:06,695][123090] Updated weights for policy 1, policy_version 1419155 (0.0006) [2023-12-26 11:00:06,751][123090] Updated weights for policy 1, policy_version 1419165 (0.0005) [2023-12-26 11:00:06,838][123091] Updated weights for policy 0, policy_version 1428757 (0.0009) [2023-12-26 11:00:06,902][123091] Updated weights for policy 0, policy_version 1428767 (0.0009) [2023-12-26 11:00:06,966][123091] Updated weights for policy 0, policy_version 1428777 (0.0009) [2023-12-26 11:00:07,498][123090] Updated weights for policy 1, policy_version 1419175 (0.0009) [2023-12-26 11:00:07,553][123090] Updated weights for policy 1, policy_version 1419185 (0.0009) [2023-12-26 11:00:07,606][123090] Updated weights for policy 1, policy_version 1419195 (0.0008) [2023-12-26 11:00:07,837][123091] Updated weights for policy 0, policy_version 1428787 (0.0009) [2023-12-26 11:00:07,898][123091] Updated weights for policy 0, policy_version 1428797 (0.0009) [2023-12-26 11:00:07,958][123091] Updated weights for policy 0, policy_version 1428807 (0.0008) [2023-12-26 11:00:08,387][123090] Updated weights for policy 1, policy_version 1419205 (0.0010) [2023-12-26 11:00:08,448][123090] Updated weights for policy 1, policy_version 1419215 (0.0008) [2023-12-26 11:00:08,515][123090] Updated weights for policy 1, policy_version 1419225 (0.0010) [2023-12-26 11:00:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 729104384. Throughput: 0: 8881.9, 1: 8801.3. Samples: 729082112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:08,785][123091] Updated weights for policy 0, policy_version 1428817 (0.0010) [2023-12-26 11:00:08,785][121949] Avg episode reward: [(0, '6246.609'), (1, '5656.044')] [2023-12-26 11:00:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001419232_363323392.pth... [2023-12-26 11:00:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001418176_363053056.pth [2023-12-26 11:00:08,836][123091] Updated weights for policy 0, policy_version 1428827 (0.0005) [2023-12-26 11:00:08,901][123091] Updated weights for policy 0, policy_version 1428837 (0.0005) [2023-12-26 11:00:08,968][123091] Updated weights for policy 0, policy_version 1428847 (0.0008) [2023-12-26 11:00:08,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001428848_365789184.pth... [2023-12-26 11:00:08,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001427792_365518848.pth [2023-12-26 11:00:09,397][123090] Updated weights for policy 1, policy_version 1419235 (0.0009) [2023-12-26 11:00:09,471][123090] Updated weights for policy 1, policy_version 1419245 (0.0010) [2023-12-26 11:00:09,537][123090] Updated weights for policy 1, policy_version 1419255 (0.0009) [2023-12-26 11:00:09,677][123091] Updated weights for policy 0, policy_version 1428857 (0.0007) [2023-12-26 11:00:09,737][123091] Updated weights for policy 0, policy_version 1428867 (0.0009) [2023-12-26 11:00:09,802][123091] Updated weights for policy 0, policy_version 1428877 (0.0010) [2023-12-26 11:00:10,380][123090] Updated weights for policy 1, policy_version 1419265 (0.0010) [2023-12-26 11:00:10,446][123090] Updated weights for policy 1, policy_version 1419275 (0.0008) [2023-12-26 11:00:10,509][123090] Updated weights for policy 1, policy_version 1419285 (0.0005) [2023-12-26 11:00:10,564][123090] Updated weights for policy 1, policy_version 1419295 (0.0005) [2023-12-26 11:00:10,620][123091] Updated weights for policy 0, policy_version 1428887 (0.0011) [2023-12-26 11:00:10,682][123091] Updated weights for policy 0, policy_version 1428897 (0.0011) [2023-12-26 11:00:10,733][123091] Updated weights for policy 0, policy_version 1428907 (0.0010) [2023-12-26 11:00:11,336][123090] Updated weights for policy 1, policy_version 1419305 (0.0008) [2023-12-26 11:00:11,401][123090] Updated weights for policy 1, policy_version 1419315 (0.0009) [2023-12-26 11:00:11,464][123090] Updated weights for policy 1, policy_version 1419325 (0.0009) [2023-12-26 11:00:11,582][123091] Updated weights for policy 0, policy_version 1428917 (0.0010) [2023-12-26 11:00:11,654][123091] Updated weights for policy 0, policy_version 1428927 (0.0011) [2023-12-26 11:00:11,722][123091] Updated weights for policy 0, policy_version 1428937 (0.0011) [2023-12-26 11:00:12,355][123090] Updated weights for policy 1, policy_version 1419335 (0.0010) [2023-12-26 11:00:12,432][123090] Updated weights for policy 1, policy_version 1419345 (0.0009) [2023-12-26 11:00:12,506][123090] Updated weights for policy 1, policy_version 1419355 (0.0008) [2023-12-26 11:00:12,565][123091] Updated weights for policy 0, policy_version 1428947 (0.0010) [2023-12-26 11:00:12,616][123091] Updated weights for policy 0, policy_version 1428957 (0.0008) [2023-12-26 11:00:12,676][123091] Updated weights for policy 0, policy_version 1428967 (0.0008) [2023-12-26 11:00:13,355][123090] Updated weights for policy 1, policy_version 1419365 (0.0009) [2023-12-26 11:00:13,395][123091] Updated weights for policy 0, policy_version 1428977 (0.0007) [2023-12-26 11:00:13,406][123090] Updated weights for policy 1, policy_version 1419375 (0.0009) [2023-12-26 11:00:13,452][123091] Updated weights for policy 0, policy_version 1428987 (0.0005) [2023-12-26 11:00:13,458][123090] Updated weights for policy 1, policy_version 1419385 (0.0008) [2023-12-26 11:00:13,511][123091] Updated weights for policy 0, policy_version 1428997 (0.0005) [2023-12-26 11:00:13,561][123091] Updated weights for policy 0, policy_version 1429007 (0.0007) [2023-12-26 11:00:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 729194496. Throughput: 0: 8792.3, 1: 8766.6. Samples: 729184660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:13,785][121949] Avg episode reward: [(0, '6306.138'), (1, '5758.611')] [2023-12-26 11:00:14,209][123090] Updated weights for policy 1, policy_version 1419395 (0.0007) [2023-12-26 11:00:14,237][123091] Updated weights for policy 0, policy_version 1429017 (0.0006) [2023-12-26 11:00:14,287][123090] Updated weights for policy 1, policy_version 1419405 (0.0006) [2023-12-26 11:00:14,297][123091] Updated weights for policy 0, policy_version 1429027 (0.0007) [2023-12-26 11:00:14,343][123090] Updated weights for policy 1, policy_version 1419415 (0.0007) [2023-12-26 11:00:14,356][123091] Updated weights for policy 0, policy_version 1429037 (0.0011) [2023-12-26 11:00:14,995][123091] Updated weights for policy 0, policy_version 1429047 (0.0007) [2023-12-26 11:00:15,043][123090] Updated weights for policy 1, policy_version 1419425 (0.0006) [2023-12-26 11:00:15,066][123091] Updated weights for policy 0, policy_version 1429057 (0.0006) [2023-12-26 11:00:15,108][123090] Updated weights for policy 1, policy_version 1419435 (0.0006) [2023-12-26 11:00:15,137][123091] Updated weights for policy 0, policy_version 1429067 (0.0007) [2023-12-26 11:00:15,182][123090] Updated weights for policy 1, policy_version 1419445 (0.0006) [2023-12-26 11:00:15,258][123090] Updated weights for policy 1, policy_version 1419455 (0.0009) [2023-12-26 11:00:15,784][123091] Updated weights for policy 0, policy_version 1429077 (0.0007) [2023-12-26 11:00:15,853][123091] Updated weights for policy 0, policy_version 1429087 (0.0006) [2023-12-26 11:00:15,922][123091] Updated weights for policy 0, policy_version 1429097 (0.0006) [2023-12-26 11:00:16,049][123090] Updated weights for policy 1, policy_version 1419465 (0.0009) [2023-12-26 11:00:16,108][123090] Updated weights for policy 1, policy_version 1419475 (0.0010) [2023-12-26 11:00:16,171][123090] Updated weights for policy 1, policy_version 1419485 (0.0006) [2023-12-26 11:00:16,514][123091] Updated weights for policy 0, policy_version 1429107 (0.0006) [2023-12-26 11:00:16,569][123091] Updated weights for policy 0, policy_version 1429117 (0.0005) [2023-12-26 11:00:16,620][123091] Updated weights for policy 0, policy_version 1429127 (0.0007) [2023-12-26 11:00:16,840][123090] Updated weights for policy 1, policy_version 1419495 (0.0009) [2023-12-26 11:00:16,912][123090] Updated weights for policy 1, policy_version 1419505 (0.0011) [2023-12-26 11:00:16,972][123090] Updated weights for policy 1, policy_version 1419515 (0.0011) [2023-12-26 11:00:17,300][123091] Updated weights for policy 0, policy_version 1429137 (0.0005) [2023-12-26 11:00:17,358][123091] Updated weights for policy 0, policy_version 1429147 (0.0007) [2023-12-26 11:00:17,423][123091] Updated weights for policy 0, policy_version 1429157 (0.0011) [2023-12-26 11:00:17,482][123091] Updated weights for policy 0, policy_version 1429167 (0.0011) [2023-12-26 11:00:17,722][123090] Updated weights for policy 1, policy_version 1419525 (0.0010) [2023-12-26 11:00:17,777][123090] Updated weights for policy 1, policy_version 1419535 (0.0010) [2023-12-26 11:00:17,832][123090] Updated weights for policy 1, policy_version 1419545 (0.0010) [2023-12-26 11:00:18,196][123091] Updated weights for policy 0, policy_version 1429177 (0.0011) [2023-12-26 11:00:18,247][123091] Updated weights for policy 0, policy_version 1429187 (0.0010) [2023-12-26 11:00:18,301][123091] Updated weights for policy 0, policy_version 1429197 (0.0007) [2023-12-26 11:00:18,697][123090] Updated weights for policy 1, policy_version 1419555 (0.0010) [2023-12-26 11:00:18,761][123090] Updated weights for policy 1, policy_version 1419565 (0.0008) [2023-12-26 11:00:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17911.3). Total num frames: 729284608. Throughput: 0: 8947.8, 1: 8859.5. Samples: 729299308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:18,785][121949] Avg episode reward: [(0, '6299.690'), (1, '5862.291')] [2023-12-26 11:00:18,819][123090] Updated weights for policy 1, policy_version 1419575 (0.0007) [2023-12-26 11:00:19,102][123091] Updated weights for policy 0, policy_version 1429207 (0.0006) [2023-12-26 11:00:19,169][123091] Updated weights for policy 0, policy_version 1429217 (0.0007) [2023-12-26 11:00:19,238][123091] Updated weights for policy 0, policy_version 1429227 (0.0007) [2023-12-26 11:00:19,675][123090] Updated weights for policy 1, policy_version 1419585 (0.0009) [2023-12-26 11:00:19,739][123090] Updated weights for policy 1, policy_version 1419595 (0.0008) [2023-12-26 11:00:19,809][123090] Updated weights for policy 1, policy_version 1419605 (0.0006) [2023-12-26 11:00:19,877][123090] Updated weights for policy 1, policy_version 1419615 (0.0008) [2023-12-26 11:00:20,053][123091] Updated weights for policy 0, policy_version 1429237 (0.0008) [2023-12-26 11:00:20,125][123091] Updated weights for policy 0, policy_version 1429247 (0.0010) [2023-12-26 11:00:20,194][123091] Updated weights for policy 0, policy_version 1429257 (0.0009) [2023-12-26 11:00:20,632][123090] Updated weights for policy 1, policy_version 1419625 (0.0009) [2023-12-26 11:00:20,708][123090] Updated weights for policy 1, policy_version 1419635 (0.0010) [2023-12-26 11:00:20,776][123090] Updated weights for policy 1, policy_version 1419645 (0.0010) [2023-12-26 11:00:21,005][123091] Updated weights for policy 0, policy_version 1429267 (0.0010) [2023-12-26 11:00:21,080][123091] Updated weights for policy 0, policy_version 1429277 (0.0010) [2023-12-26 11:00:21,147][123091] Updated weights for policy 0, policy_version 1429287 (0.0010) [2023-12-26 11:00:21,640][123090] Updated weights for policy 1, policy_version 1419655 (0.0009) [2023-12-26 11:00:21,713][123090] Updated weights for policy 1, policy_version 1419665 (0.0010) [2023-12-26 11:00:21,770][123090] Updated weights for policy 1, policy_version 1419675 (0.0010) [2023-12-26 11:00:22,054][123091] Updated weights for policy 0, policy_version 1429297 (0.0011) [2023-12-26 11:00:22,120][123091] Updated weights for policy 0, policy_version 1429307 (0.0010) [2023-12-26 11:00:22,184][123091] Updated weights for policy 0, policy_version 1429317 (0.0009) [2023-12-26 11:00:22,254][123091] Updated weights for policy 0, policy_version 1429327 (0.0010) [2023-12-26 11:00:22,610][123090] Updated weights for policy 1, policy_version 1419685 (0.0008) [2023-12-26 11:00:22,679][123090] Updated weights for policy 1, policy_version 1419695 (0.0008) [2023-12-26 11:00:22,754][123090] Updated weights for policy 1, policy_version 1419705 (0.0007) [2023-12-26 11:00:23,141][123091] Updated weights for policy 0, policy_version 1429337 (0.0007) [2023-12-26 11:00:23,207][123091] Updated weights for policy 0, policy_version 1429347 (0.0007) [2023-12-26 11:00:23,258][123091] Updated weights for policy 0, policy_version 1429357 (0.0010) [2023-12-26 11:00:23,506][123090] Updated weights for policy 1, policy_version 1419715 (0.0008) [2023-12-26 11:00:23,573][123090] Updated weights for policy 1, policy_version 1419725 (0.0008) [2023-12-26 11:00:23,639][123090] Updated weights for policy 1, policy_version 1419735 (0.0008) [2023-12-26 11:00:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 729374720. Throughput: 0: 8908.0, 1: 8823.4. Samples: 729349920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:23,785][121949] Avg episode reward: [(0, '6292.960'), (1, '5866.311')] [2023-12-26 11:00:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001429360_365920256.pth... [2023-12-26 11:00:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001419744_363454464.pth... [2023-12-26 11:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001428336_365658112.pth [2023-12-26 11:00:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001418688_363184128.pth [2023-12-26 11:00:24,102][123091] Updated weights for policy 0, policy_version 1429367 (0.0007) [2023-12-26 11:00:24,170][123091] Updated weights for policy 0, policy_version 1429377 (0.0006) [2023-12-26 11:00:24,229][123091] Updated weights for policy 0, policy_version 1429387 (0.0006) [2023-12-26 11:00:24,413][123090] Updated weights for policy 1, policy_version 1419745 (0.0008) [2023-12-26 11:00:24,480][123090] Updated weights for policy 1, policy_version 1419755 (0.0008) [2023-12-26 11:00:24,537][123090] Updated weights for policy 1, policy_version 1419765 (0.0008) [2023-12-26 11:00:24,602][123090] Updated weights for policy 1, policy_version 1419775 (0.0009) [2023-12-26 11:00:24,999][123091] Updated weights for policy 0, policy_version 1429397 (0.0007) [2023-12-26 11:00:25,062][123091] Updated weights for policy 0, policy_version 1429407 (0.0010) [2023-12-26 11:00:25,116][123091] Updated weights for policy 0, policy_version 1429417 (0.0010) [2023-12-26 11:00:25,459][123090] Updated weights for policy 1, policy_version 1419785 (0.0006) [2023-12-26 11:00:25,516][123090] Updated weights for policy 1, policy_version 1419795 (0.0007) [2023-12-26 11:00:25,581][123090] Updated weights for policy 1, policy_version 1419805 (0.0006) [2023-12-26 11:00:25,833][123091] Updated weights for policy 0, policy_version 1429427 (0.0009) [2023-12-26 11:00:25,896][123091] Updated weights for policy 0, policy_version 1429437 (0.0005) [2023-12-26 11:00:25,953][123091] Updated weights for policy 0, policy_version 1429447 (0.0005) [2023-12-26 11:00:26,255][123090] Updated weights for policy 1, policy_version 1419815 (0.0006) [2023-12-26 11:00:26,317][123090] Updated weights for policy 1, policy_version 1419825 (0.0007) [2023-12-26 11:00:26,377][123090] Updated weights for policy 1, policy_version 1419835 (0.0006) [2023-12-26 11:00:26,713][123091] Updated weights for policy 0, policy_version 1429457 (0.0006) [2023-12-26 11:00:26,771][123091] Updated weights for policy 0, policy_version 1429467 (0.0010) [2023-12-26 11:00:26,826][123091] Updated weights for policy 0, policy_version 1429477 (0.0008) [2023-12-26 11:00:26,872][123091] Updated weights for policy 0, policy_version 1429487 (0.0007) [2023-12-26 11:00:27,119][123090] Updated weights for policy 1, policy_version 1419845 (0.0009) [2023-12-26 11:00:27,168][123090] Updated weights for policy 1, policy_version 1419855 (0.0010) [2023-12-26 11:00:27,211][123090] Updated weights for policy 1, policy_version 1419865 (0.0010) [2023-12-26 11:00:27,699][123091] Updated weights for policy 0, policy_version 1429497 (0.0006) [2023-12-26 11:00:27,748][123091] Updated weights for policy 0, policy_version 1429507 (0.0005) [2023-12-26 11:00:27,792][123091] Updated weights for policy 0, policy_version 1429517 (0.0005) [2023-12-26 11:00:28,079][123090] Updated weights for policy 1, policy_version 1419876 (0.0010) [2023-12-26 11:00:28,147][123090] Updated weights for policy 1, policy_version 1419886 (0.0007) [2023-12-26 11:00:28,212][123090] Updated weights for policy 1, policy_version 1419896 (0.0006) [2023-12-26 11:00:28,515][123091] Updated weights for policy 0, policy_version 1429527 (0.0006) [2023-12-26 11:00:28,580][123091] Updated weights for policy 0, policy_version 1429537 (0.0006) [2023-12-26 11:00:28,631][123091] Updated weights for policy 0, policy_version 1429547 (0.0010) [2023-12-26 11:00:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 729464832. Throughput: 0: 8956.8, 1: 8883.2. Samples: 729455088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:28,784][121949] Avg episode reward: [(0, '6287.121'), (1, '5708.771')] [2023-12-26 11:00:28,959][123090] Updated weights for policy 1, policy_version 1419906 (0.0010) [2023-12-26 11:00:29,023][123090] Updated weights for policy 1, policy_version 1419916 (0.0005) [2023-12-26 11:00:29,078][123090] Updated weights for policy 1, policy_version 1419926 (0.0008) [2023-12-26 11:00:29,132][123090] Updated weights for policy 1, policy_version 1419936 (0.0009) [2023-12-26 11:00:29,390][123091] Updated weights for policy 0, policy_version 1429557 (0.0009) [2023-12-26 11:00:29,456][123091] Updated weights for policy 0, policy_version 1429567 (0.0009) [2023-12-26 11:00:29,523][123091] Updated weights for policy 0, policy_version 1429577 (0.0008) [2023-12-26 11:00:29,991][123090] Updated weights for policy 1, policy_version 1419946 (0.0009) [2023-12-26 11:00:30,053][123090] Updated weights for policy 1, policy_version 1419956 (0.0009) [2023-12-26 11:00:30,116][123090] Updated weights for policy 1, policy_version 1419966 (0.0009) [2023-12-26 11:00:30,336][123091] Updated weights for policy 0, policy_version 1429587 (0.0009) [2023-12-26 11:00:30,396][123091] Updated weights for policy 0, policy_version 1429597 (0.0010) [2023-12-26 11:00:30,459][123091] Updated weights for policy 0, policy_version 1429607 (0.0010) [2023-12-26 11:00:30,890][123090] Updated weights for policy 1, policy_version 1419976 (0.0006) [2023-12-26 11:00:30,947][123090] Updated weights for policy 1, policy_version 1419986 (0.0006) [2023-12-26 11:00:31,033][123090] Updated weights for policy 1, policy_version 1419996 (0.0009) [2023-12-26 11:00:31,277][123091] Updated weights for policy 0, policy_version 1429617 (0.0009) [2023-12-26 11:00:31,341][123091] Updated weights for policy 0, policy_version 1429627 (0.0009) [2023-12-26 11:00:31,415][123091] Updated weights for policy 0, policy_version 1429637 (0.0009) [2023-12-26 11:00:31,481][123091] Updated weights for policy 0, policy_version 1429647 (0.0010) [2023-12-26 11:00:31,804][123090] Updated weights for policy 1, policy_version 1420006 (0.0009) [2023-12-26 11:00:31,860][123090] Updated weights for policy 1, policy_version 1420016 (0.0009) [2023-12-26 11:00:31,915][123090] Updated weights for policy 1, policy_version 1420026 (0.0009) [2023-12-26 11:00:32,193][123091] Updated weights for policy 0, policy_version 1429657 (0.0006) [2023-12-26 11:00:32,264][123091] Updated weights for policy 0, policy_version 1429667 (0.0006) [2023-12-26 11:00:32,326][123091] Updated weights for policy 0, policy_version 1429677 (0.0008) [2023-12-26 11:00:32,729][123090] Updated weights for policy 1, policy_version 1420036 (0.0010) [2023-12-26 11:00:32,790][123090] Updated weights for policy 1, policy_version 1420046 (0.0010) [2023-12-26 11:00:32,862][123090] Updated weights for policy 1, policy_version 1420056 (0.0008) [2023-12-26 11:00:33,098][123091] Updated weights for policy 0, policy_version 1429687 (0.0010) [2023-12-26 11:00:33,157][123091] Updated weights for policy 0, policy_version 1429697 (0.0009) [2023-12-26 11:00:33,219][123091] Updated weights for policy 0, policy_version 1429708 (0.0009) [2023-12-26 11:00:33,676][123090] Updated weights for policy 1, policy_version 1420066 (0.0010) [2023-12-26 11:00:33,736][123090] Updated weights for policy 1, policy_version 1420076 (0.0010) [2023-12-26 11:00:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 729546752. Throughput: 0: 8912.1, 1: 8889.6. Samples: 729561772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:33,785][121949] Avg episode reward: [(0, '6173.917'), (1, '5734.788')] [2023-12-26 11:00:33,802][123090] Updated weights for policy 1, policy_version 1420086 (0.0009) [2023-12-26 11:00:33,859][123090] Updated weights for policy 1, policy_version 1420096 (0.0008) [2023-12-26 11:00:34,050][123091] Updated weights for policy 0, policy_version 1429718 (0.0008) [2023-12-26 11:00:34,128][123091] Updated weights for policy 0, policy_version 1429728 (0.0009) [2023-12-26 11:00:34,191][123091] Updated weights for policy 0, policy_version 1429738 (0.0010) [2023-12-26 11:00:34,734][123090] Updated weights for policy 1, policy_version 1420106 (0.0010) [2023-12-26 11:00:34,787][123090] Updated weights for policy 1, policy_version 1420116 (0.0009) [2023-12-26 11:00:34,849][123090] Updated weights for policy 1, policy_version 1420126 (0.0009) [2023-12-26 11:00:34,929][123091] Updated weights for policy 0, policy_version 1429748 (0.0007) [2023-12-26 11:00:34,978][123091] Updated weights for policy 0, policy_version 1429758 (0.0005) [2023-12-26 11:00:35,030][123091] Updated weights for policy 0, policy_version 1429768 (0.0007) [2023-12-26 11:00:35,695][123090] Updated weights for policy 1, policy_version 1420136 (0.0009) [2023-12-26 11:00:35,747][123090] Updated weights for policy 1, policy_version 1420146 (0.0010) [2023-12-26 11:00:35,802][123090] Updated weights for policy 1, policy_version 1420157 (0.0010) [2023-12-26 11:00:35,818][123091] Updated weights for policy 0, policy_version 1429778 (0.0010) [2023-12-26 11:00:35,887][123091] Updated weights for policy 0, policy_version 1429788 (0.0008) [2023-12-26 11:00:35,935][123091] Updated weights for policy 0, policy_version 1429798 (0.0005) [2023-12-26 11:00:35,990][123091] Updated weights for policy 0, policy_version 1429808 (0.0005) [2023-12-26 11:00:36,665][123090] Updated weights for policy 1, policy_version 1420167 (0.0009) [2023-12-26 11:00:36,733][123090] Updated weights for policy 1, policy_version 1420177 (0.0009) [2023-12-26 11:00:36,803][123090] Updated weights for policy 1, policy_version 1420187 (0.0008) [2023-12-26 11:00:36,824][123091] Updated weights for policy 0, policy_version 1429818 (0.0008) [2023-12-26 11:00:36,896][123091] Updated weights for policy 0, policy_version 1429828 (0.0006) [2023-12-26 11:00:36,967][123091] Updated weights for policy 0, policy_version 1429838 (0.0006) [2023-12-26 11:00:37,550][123090] Updated weights for policy 1, policy_version 1420197 (0.0006) [2023-12-26 11:00:37,610][123090] Updated weights for policy 1, policy_version 1420207 (0.0007) [2023-12-26 11:00:37,625][123091] Updated weights for policy 0, policy_version 1429848 (0.0007) [2023-12-26 11:00:37,673][123090] Updated weights for policy 1, policy_version 1420217 (0.0007) [2023-12-26 11:00:37,695][123091] Updated weights for policy 0, policy_version 1429858 (0.0007) [2023-12-26 11:00:37,767][123091] Updated weights for policy 0, policy_version 1429868 (0.0009) [2023-12-26 11:00:38,385][123090] Updated weights for policy 1, policy_version 1420227 (0.0009) [2023-12-26 11:00:38,434][123090] Updated weights for policy 1, policy_version 1420237 (0.0009) [2023-12-26 11:00:38,483][123090] Updated weights for policy 1, policy_version 1420247 (0.0008) [2023-12-26 11:00:38,549][123091] Updated weights for policy 0, policy_version 1429878 (0.0011) [2023-12-26 11:00:38,617][123091] Updated weights for policy 0, policy_version 1429888 (0.0011) [2023-12-26 11:00:38,683][123091] Updated weights for policy 0, policy_version 1429898 (0.0010) [2023-12-26 11:00:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 729645056. Throughput: 0: 8910.4, 1: 8860.8. Samples: 729614068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:38,785][121949] Avg episode reward: [(0, '6194.229'), (1, '5741.183')] [2023-12-26 11:00:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001420256_363585536.pth... [2023-12-26 11:00:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001429904_366059520.pth... [2023-12-26 11:00:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001419232_363323392.pth [2023-12-26 11:00:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001428848_365789184.pth [2023-12-26 11:00:39,384][123090] Updated weights for policy 1, policy_version 1420257 (0.0009) [2023-12-26 11:00:39,457][123090] Updated weights for policy 1, policy_version 1420267 (0.0009) [2023-12-26 11:00:39,473][123091] Updated weights for policy 0, policy_version 1429908 (0.0006) [2023-12-26 11:00:39,522][123090] Updated weights for policy 1, policy_version 1420277 (0.0006) [2023-12-26 11:00:39,529][123091] Updated weights for policy 0, policy_version 1429918 (0.0009) [2023-12-26 11:00:39,588][123090] Updated weights for policy 1, policy_version 1420287 (0.0008) [2023-12-26 11:00:39,595][123091] Updated weights for policy 0, policy_version 1429928 (0.0008) [2023-12-26 11:00:40,440][123090] Updated weights for policy 1, policy_version 1420297 (0.0010) [2023-12-26 11:00:40,462][123091] Updated weights for policy 0, policy_version 1429938 (0.0006) [2023-12-26 11:00:40,498][123090] Updated weights for policy 1, policy_version 1420307 (0.0009) [2023-12-26 11:00:40,534][123091] Updated weights for policy 0, policy_version 1429948 (0.0006) [2023-12-26 11:00:40,555][123090] Updated weights for policy 1, policy_version 1420317 (0.0008) [2023-12-26 11:00:40,601][123091] Updated weights for policy 0, policy_version 1429958 (0.0006) [2023-12-26 11:00:40,672][123091] Updated weights for policy 0, policy_version 1429968 (0.0006) [2023-12-26 11:00:41,421][123091] Updated weights for policy 0, policy_version 1429978 (0.0008) [2023-12-26 11:00:41,431][123090] Updated weights for policy 1, policy_version 1420327 (0.0009) [2023-12-26 11:00:41,480][123091] Updated weights for policy 0, policy_version 1429988 (0.0007) [2023-12-26 11:00:41,489][123090] Updated weights for policy 1, policy_version 1420337 (0.0010) [2023-12-26 11:00:41,537][123091] Updated weights for policy 0, policy_version 1429998 (0.0008) [2023-12-26 11:00:41,552][123090] Updated weights for policy 1, policy_version 1420347 (0.0010) [2023-12-26 11:00:42,311][123091] Updated weights for policy 0, policy_version 1430008 (0.0009) [2023-12-26 11:00:42,373][123091] Updated weights for policy 0, policy_version 1430018 (0.0009) [2023-12-26 11:00:42,399][123090] Updated weights for policy 1, policy_version 1420357 (0.0009) [2023-12-26 11:00:42,446][123091] Updated weights for policy 0, policy_version 1430028 (0.0007) [2023-12-26 11:00:42,464][123090] Updated weights for policy 1, policy_version 1420367 (0.0010) [2023-12-26 11:00:42,532][123090] Updated weights for policy 1, policy_version 1420377 (0.0009) [2023-12-26 11:00:43,230][123091] Updated weights for policy 0, policy_version 1430038 (0.0010) [2023-12-26 11:00:43,284][123091] Updated weights for policy 0, policy_version 1430048 (0.0009) [2023-12-26 11:00:43,338][123091] Updated weights for policy 0, policy_version 1430058 (0.0009) [2023-12-26 11:00:43,379][123090] Updated weights for policy 1, policy_version 1420387 (0.0009) [2023-12-26 11:00:43,434][123090] Updated weights for policy 1, policy_version 1420397 (0.0009) [2023-12-26 11:00:43,495][123090] Updated weights for policy 1, policy_version 1420407 (0.0009) [2023-12-26 11:00:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 729726976. Throughput: 0: 8894.0, 1: 8785.5. Samples: 729718152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:43,785][121949] Avg episode reward: [(0, '6162.369'), (1, '5760.749')] [2023-12-26 11:00:44,097][123091] Updated weights for policy 0, policy_version 1430068 (0.0008) [2023-12-26 11:00:44,152][123091] Updated weights for policy 0, policy_version 1430078 (0.0006) [2023-12-26 11:00:44,204][123091] Updated weights for policy 0, policy_version 1430088 (0.0007) [2023-12-26 11:00:44,347][123090] Updated weights for policy 1, policy_version 1420417 (0.0009) [2023-12-26 11:00:44,400][123090] Updated weights for policy 1, policy_version 1420427 (0.0009) [2023-12-26 11:00:44,450][123090] Updated weights for policy 1, policy_version 1420437 (0.0008) [2023-12-26 11:00:44,506][123090] Updated weights for policy 1, policy_version 1420447 (0.0005) [2023-12-26 11:00:45,016][123091] Updated weights for policy 0, policy_version 1430098 (0.0009) [2023-12-26 11:00:45,084][123091] Updated weights for policy 0, policy_version 1430108 (0.0009) [2023-12-26 11:00:45,145][123091] Updated weights for policy 0, policy_version 1430118 (0.0008) [2023-12-26 11:00:45,217][123091] Updated weights for policy 0, policy_version 1430128 (0.0006) [2023-12-26 11:00:45,311][123090] Updated weights for policy 1, policy_version 1420457 (0.0005) [2023-12-26 11:00:45,389][123090] Updated weights for policy 1, policy_version 1420467 (0.0009) [2023-12-26 11:00:45,460][123090] Updated weights for policy 1, policy_version 1420477 (0.0010) [2023-12-26 11:00:45,969][123091] Updated weights for policy 0, policy_version 1430138 (0.0010) [2023-12-26 11:00:46,018][123091] Updated weights for policy 0, policy_version 1430148 (0.0009) [2023-12-26 11:00:46,077][123091] Updated weights for policy 0, policy_version 1430158 (0.0009) [2023-12-26 11:00:46,133][123090] Updated weights for policy 1, policy_version 1420487 (0.0009) [2023-12-26 11:00:46,189][123090] Updated weights for policy 1, policy_version 1420497 (0.0009) [2023-12-26 11:00:46,245][123090] Updated weights for policy 1, policy_version 1420508 (0.0008) [2023-12-26 11:00:46,906][123091] Updated weights for policy 0, policy_version 1430168 (0.0009) [2023-12-26 11:00:46,971][123091] Updated weights for policy 0, policy_version 1430178 (0.0009) [2023-12-26 11:00:47,023][123091] Updated weights for policy 0, policy_version 1430188 (0.0010) [2023-12-26 11:00:47,082][123090] Updated weights for policy 1, policy_version 1420518 (0.0009) [2023-12-26 11:00:47,132][123090] Updated weights for policy 1, policy_version 1420528 (0.0009) [2023-12-26 11:00:47,181][123090] Updated weights for policy 1, policy_version 1420538 (0.0009) [2023-12-26 11:00:47,816][123091] Updated weights for policy 0, policy_version 1430198 (0.0007) [2023-12-26 11:00:47,883][123091] Updated weights for policy 0, policy_version 1430208 (0.0005) [2023-12-26 11:00:47,941][123091] Updated weights for policy 0, policy_version 1430218 (0.0005) [2023-12-26 11:00:47,973][123090] Updated weights for policy 1, policy_version 1420548 (0.0008) [2023-12-26 11:00:48,038][123090] Updated weights for policy 1, policy_version 1420558 (0.0005) [2023-12-26 11:00:48,098][123090] Updated weights for policy 1, policy_version 1420568 (0.0006) [2023-12-26 11:00:48,715][123091] Updated weights for policy 0, policy_version 1430228 (0.0008) [2023-12-26 11:00:48,774][123091] Updated weights for policy 0, policy_version 1430238 (0.0011) [2023-12-26 11:00:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 729808896. Throughput: 0: 8938.0, 1: 8813.0. Samples: 729825692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:48,785][121949] Avg episode reward: [(0, '6048.158'), (1, '5932.900')] [2023-12-26 11:00:48,809][123090] Updated weights for policy 1, policy_version 1420578 (0.0006) [2023-12-26 11:00:48,837][123091] Updated weights for policy 0, policy_version 1430248 (0.0011) [2023-12-26 11:00:48,861][123090] Updated weights for policy 1, policy_version 1420588 (0.0006) [2023-12-26 11:00:48,928][123090] Updated weights for policy 1, policy_version 1420598 (0.0005) [2023-12-26 11:00:48,983][123090] Updated weights for policy 1, policy_version 1420608 (0.0008) [2023-12-26 11:00:49,666][123091] Updated weights for policy 0, policy_version 1430258 (0.0011) [2023-12-26 11:00:49,732][123091] Updated weights for policy 0, policy_version 1430268 (0.0010) [2023-12-26 11:00:49,759][123090] Updated weights for policy 1, policy_version 1420618 (0.0006) [2023-12-26 11:00:49,791][123091] Updated weights for policy 0, policy_version 1430278 (0.0011) [2023-12-26 11:00:49,828][123090] Updated weights for policy 1, policy_version 1420628 (0.0007) [2023-12-26 11:00:49,856][123091] Updated weights for policy 0, policy_version 1430288 (0.0011) [2023-12-26 11:00:49,894][123090] Updated weights for policy 1, policy_version 1420638 (0.0009) [2023-12-26 11:00:50,646][123090] Updated weights for policy 1, policy_version 1420648 (0.0010) [2023-12-26 11:00:50,697][123091] Updated weights for policy 0, policy_version 1430298 (0.0009) [2023-12-26 11:00:50,714][123090] Updated weights for policy 1, policy_version 1420658 (0.0009) [2023-12-26 11:00:50,757][123091] Updated weights for policy 0, policy_version 1430308 (0.0008) [2023-12-26 11:00:50,778][123090] Updated weights for policy 1, policy_version 1420668 (0.0006) [2023-12-26 11:00:50,816][123091] Updated weights for policy 0, policy_version 1430318 (0.0008) [2023-12-26 11:00:51,629][123090] Updated weights for policy 1, policy_version 1420678 (0.0009) [2023-12-26 11:00:51,644][123091] Updated weights for policy 0, policy_version 1430328 (0.0008) [2023-12-26 11:00:51,691][123090] Updated weights for policy 1, policy_version 1420688 (0.0008) [2023-12-26 11:00:51,709][123091] Updated weights for policy 0, policy_version 1430338 (0.0010) [2023-12-26 11:00:51,761][123090] Updated weights for policy 1, policy_version 1420698 (0.0009) [2023-12-26 11:00:51,777][123091] Updated weights for policy 0, policy_version 1430348 (0.0008) [2023-12-26 11:00:52,595][123090] Updated weights for policy 1, policy_version 1420708 (0.0010) [2023-12-26 11:00:52,602][123091] Updated weights for policy 0, policy_version 1430358 (0.0008) [2023-12-26 11:00:52,647][123090] Updated weights for policy 1, policy_version 1420718 (0.0008) [2023-12-26 11:00:52,667][123091] Updated weights for policy 0, policy_version 1430368 (0.0010) [2023-12-26 11:00:52,712][123090] Updated weights for policy 1, policy_version 1420728 (0.0009) [2023-12-26 11:00:52,730][123091] Updated weights for policy 0, policy_version 1430378 (0.0008) [2023-12-26 11:00:53,417][123090] Updated weights for policy 1, policy_version 1420738 (0.0008) [2023-12-26 11:00:53,431][123091] Updated weights for policy 0, policy_version 1430388 (0.0006) [2023-12-26 11:00:53,468][123090] Updated weights for policy 1, policy_version 1420748 (0.0007) [2023-12-26 11:00:53,503][123091] Updated weights for policy 0, policy_version 1430398 (0.0005) [2023-12-26 11:00:53,533][123090] Updated weights for policy 1, policy_version 1420758 (0.0005) [2023-12-26 11:00:53,565][123091] Updated weights for policy 0, policy_version 1430408 (0.0005) [2023-12-26 11:00:53,600][123090] Updated weights for policy 1, policy_version 1420768 (0.0005) [2023-12-26 11:00:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 729907200. Throughput: 0: 8950.6, 1: 8728.3. Samples: 729877660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:53,785][121949] Avg episode reward: [(0, '6083.583'), (1, '5761.209')] [2023-12-26 11:00:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001420768_363716608.pth... [2023-12-26 11:00:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001430416_366190592.pth... [2023-12-26 11:00:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001429360_365920256.pth [2023-12-26 11:00:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001419744_363454464.pth [2023-12-26 11:00:54,327][123091] Updated weights for policy 0, policy_version 1430418 (0.0011) [2023-12-26 11:00:54,389][123090] Updated weights for policy 1, policy_version 1420778 (0.0010) [2023-12-26 11:00:54,390][123091] Updated weights for policy 0, policy_version 1430428 (0.0011) [2023-12-26 11:00:54,445][123090] Updated weights for policy 1, policy_version 1420788 (0.0011) [2023-12-26 11:00:54,449][123091] Updated weights for policy 0, policy_version 1430438 (0.0011) [2023-12-26 11:00:54,498][123090] Updated weights for policy 1, policy_version 1420798 (0.0008) [2023-12-26 11:00:54,504][123091] Updated weights for policy 0, policy_version 1430448 (0.0010) [2023-12-26 11:00:55,227][123090] Updated weights for policy 1, policy_version 1420808 (0.0005) [2023-12-26 11:00:55,279][123090] Updated weights for policy 1, policy_version 1420818 (0.0005) [2023-12-26 11:00:55,320][123091] Updated weights for policy 0, policy_version 1430458 (0.0010) [2023-12-26 11:00:55,338][123090] Updated weights for policy 1, policy_version 1420828 (0.0005) [2023-12-26 11:00:55,375][123091] Updated weights for policy 0, policy_version 1430468 (0.0010) [2023-12-26 11:00:55,432][123091] Updated weights for policy 0, policy_version 1430478 (0.0011) [2023-12-26 11:00:56,080][123090] Updated weights for policy 1, policy_version 1420838 (0.0006) [2023-12-26 11:00:56,142][123090] Updated weights for policy 1, policy_version 1420848 (0.0005) [2023-12-26 11:00:56,193][123090] Updated weights for policy 1, policy_version 1420858 (0.0005) [2023-12-26 11:00:56,264][123091] Updated weights for policy 0, policy_version 1430488 (0.0010) [2023-12-26 11:00:56,319][123091] Updated weights for policy 0, policy_version 1430498 (0.0010) [2023-12-26 11:00:56,366][123091] Updated weights for policy 0, policy_version 1430508 (0.0010) [2023-12-26 11:00:56,782][123090] Updated weights for policy 1, policy_version 1420868 (0.0005) [2023-12-26 11:00:56,856][123090] Updated weights for policy 1, policy_version 1420878 (0.0008) [2023-12-26 11:00:56,928][123090] Updated weights for policy 1, policy_version 1420888 (0.0011) [2023-12-26 11:00:57,124][123091] Updated weights for policy 0, policy_version 1430518 (0.0007) [2023-12-26 11:00:57,168][123091] Updated weights for policy 0, policy_version 1430528 (0.0005) [2023-12-26 11:00:57,222][123091] Updated weights for policy 0, policy_version 1430538 (0.0005) [2023-12-26 11:00:57,701][123090] Updated weights for policy 1, policy_version 1420898 (0.0010) [2023-12-26 11:00:57,761][123090] Updated weights for policy 1, policy_version 1420908 (0.0005) [2023-12-26 11:00:57,770][123091] Updated weights for policy 0, policy_version 1430548 (0.0005) [2023-12-26 11:00:57,810][123090] Updated weights for policy 1, policy_version 1420918 (0.0005) [2023-12-26 11:00:57,819][123091] Updated weights for policy 0, policy_version 1430558 (0.0005) [2023-12-26 11:00:57,861][123090] Updated weights for policy 1, policy_version 1420928 (0.0005) [2023-12-26 11:00:57,877][123091] Updated weights for policy 0, policy_version 1430568 (0.0005) [2023-12-26 11:00:58,687][123090] Updated weights for policy 1, policy_version 1420938 (0.0008) [2023-12-26 11:00:58,712][123091] Updated weights for policy 0, policy_version 1430578 (0.0007) [2023-12-26 11:00:58,753][123090] Updated weights for policy 1, policy_version 1420948 (0.0008) [2023-12-26 11:00:58,778][123091] Updated weights for policy 0, policy_version 1430588 (0.0009) [2023-12-26 11:00:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 729989120. Throughput: 0: 9040.6, 1: 8829.8. Samples: 729988828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:00:58,785][121949] Avg episode reward: [(0, '6126.212'), (1, '5723.770')] [2023-12-26 11:00:58,832][123090] Updated weights for policy 1, policy_version 1420958 (0.0010) [2023-12-26 11:00:58,855][123091] Updated weights for policy 0, policy_version 1430598 (0.0008) [2023-12-26 11:00:58,923][123091] Updated weights for policy 0, policy_version 1430608 (0.0008) [2023-12-26 11:00:59,657][123090] Updated weights for policy 1, policy_version 1420968 (0.0010) [2023-12-26 11:00:59,731][123090] Updated weights for policy 1, policy_version 1420978 (0.0009) [2023-12-26 11:00:59,794][123090] Updated weights for policy 1, policy_version 1420988 (0.0010) [2023-12-26 11:00:59,864][123091] Updated weights for policy 0, policy_version 1430618 (0.0010) [2023-12-26 11:00:59,928][123091] Updated weights for policy 0, policy_version 1430628 (0.0010) [2023-12-26 11:00:59,979][123091] Updated weights for policy 0, policy_version 1430638 (0.0010) [2023-12-26 11:01:00,643][123090] Updated weights for policy 1, policy_version 1420998 (0.0009) [2023-12-26 11:01:00,698][123090] Updated weights for policy 1, policy_version 1421008 (0.0010) [2023-12-26 11:01:00,753][123091] Updated weights for policy 0, policy_version 1430648 (0.0006) [2023-12-26 11:01:00,761][123090] Updated weights for policy 1, policy_version 1421018 (0.0010) [2023-12-26 11:01:00,822][123091] Updated weights for policy 0, policy_version 1430658 (0.0005) [2023-12-26 11:01:00,878][123091] Updated weights for policy 0, policy_version 1430668 (0.0005) [2023-12-26 11:01:01,625][123090] Updated weights for policy 1, policy_version 1421028 (0.0010) [2023-12-26 11:01:01,658][123091] Updated weights for policy 0, policy_version 1430678 (0.0008) [2023-12-26 11:01:01,690][123090] Updated weights for policy 1, policy_version 1421038 (0.0011) [2023-12-26 11:01:01,729][123091] Updated weights for policy 0, policy_version 1430688 (0.0010) [2023-12-26 11:01:01,753][123090] Updated weights for policy 1, policy_version 1421048 (0.0010) [2023-12-26 11:01:01,787][123091] Updated weights for policy 0, policy_version 1430698 (0.0010) [2023-12-26 11:01:02,533][123090] Updated weights for policy 1, policy_version 1421058 (0.0010) [2023-12-26 11:01:02,568][123091] Updated weights for policy 0, policy_version 1430708 (0.0010) [2023-12-26 11:01:02,589][123090] Updated weights for policy 1, policy_version 1421068 (0.0009) [2023-12-26 11:01:02,615][123091] Updated weights for policy 0, policy_version 1430718 (0.0010) [2023-12-26 11:01:02,636][123090] Updated weights for policy 1, policy_version 1421078 (0.0006) [2023-12-26 11:01:02,659][123091] Updated weights for policy 0, policy_version 1430728 (0.0010) [2023-12-26 11:01:02,692][123090] Updated weights for policy 1, policy_version 1421088 (0.0006) [2023-12-26 11:01:03,508][123091] Updated weights for policy 0, policy_version 1430738 (0.0010) [2023-12-26 11:01:03,530][123090] Updated weights for policy 1, policy_version 1421098 (0.0006) [2023-12-26 11:01:03,576][123091] Updated weights for policy 0, policy_version 1430748 (0.0011) [2023-12-26 11:01:03,587][123090] Updated weights for policy 1, policy_version 1421108 (0.0007) [2023-12-26 11:01:03,629][123091] Updated weights for policy 0, policy_version 1430758 (0.0011) [2023-12-26 11:01:03,649][123090] Updated weights for policy 1, policy_version 1421118 (0.0006) [2023-12-26 11:01:03,693][123091] Updated weights for policy 0, policy_version 1430768 (0.0011) [2023-12-26 11:01:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 730087424. Throughput: 0: 8852.4, 1: 8777.0. Samples: 730092636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:03,785][121949] Avg episode reward: [(0, '6245.351'), (1, '5761.742')] [2023-12-26 11:01:04,471][123090] Updated weights for policy 1, policy_version 1421128 (0.0009) [2023-12-26 11:01:04,520][123090] Updated weights for policy 1, policy_version 1421138 (0.0006) [2023-12-26 11:01:04,530][123091] Updated weights for policy 0, policy_version 1430778 (0.0011) [2023-12-26 11:01:04,572][123090] Updated weights for policy 1, policy_version 1421148 (0.0009) [2023-12-26 11:01:04,597][123091] Updated weights for policy 0, policy_version 1430788 (0.0011) [2023-12-26 11:01:04,656][123091] Updated weights for policy 0, policy_version 1430798 (0.0011) [2023-12-26 11:01:05,399][123090] Updated weights for policy 1, policy_version 1421158 (0.0008) [2023-12-26 11:01:05,461][123090] Updated weights for policy 1, policy_version 1421168 (0.0008) [2023-12-26 11:01:05,463][123091] Updated weights for policy 0, policy_version 1430808 (0.0011) [2023-12-26 11:01:05,511][123091] Updated weights for policy 0, policy_version 1430818 (0.0010) [2023-12-26 11:01:05,516][123090] Updated weights for policy 1, policy_version 1421178 (0.0005) [2023-12-26 11:01:05,559][123091] Updated weights for policy 0, policy_version 1430828 (0.0010) [2023-12-26 11:01:06,158][123090] Updated weights for policy 1, policy_version 1421188 (0.0007) [2023-12-26 11:01:06,229][123090] Updated weights for policy 1, policy_version 1421198 (0.0010) [2023-12-26 11:01:06,298][123090] Updated weights for policy 1, policy_version 1421208 (0.0011) [2023-12-26 11:01:06,400][123091] Updated weights for policy 0, policy_version 1430838 (0.0008) [2023-12-26 11:01:06,473][123091] Updated weights for policy 0, policy_version 1430848 (0.0005) [2023-12-26 11:01:06,543][123091] Updated weights for policy 0, policy_version 1430858 (0.0006) [2023-12-26 11:01:07,129][123090] Updated weights for policy 1, policy_version 1421218 (0.0011) [2023-12-26 11:01:07,191][123090] Updated weights for policy 1, policy_version 1421228 (0.0010) [2023-12-26 11:01:07,242][123091] Updated weights for policy 0, policy_version 1430868 (0.0007) [2023-12-26 11:01:07,258][123090] Updated weights for policy 1, policy_version 1421238 (0.0010) [2023-12-26 11:01:07,303][123091] Updated weights for policy 0, policy_version 1430878 (0.0005) [2023-12-26 11:01:07,325][123090] Updated weights for policy 1, policy_version 1421248 (0.0010) [2023-12-26 11:01:07,356][123091] Updated weights for policy 0, policy_version 1430888 (0.0006) [2023-12-26 11:01:08,045][123090] Updated weights for policy 1, policy_version 1421258 (0.0010) [2023-12-26 11:01:08,092][123091] Updated weights for policy 0, policy_version 1430898 (0.0006) [2023-12-26 11:01:08,113][123090] Updated weights for policy 1, policy_version 1421268 (0.0010) [2023-12-26 11:01:08,140][123091] Updated weights for policy 0, policy_version 1430908 (0.0011) [2023-12-26 11:01:08,175][123090] Updated weights for policy 1, policy_version 1421278 (0.0006) [2023-12-26 11:01:08,191][123091] Updated weights for policy 0, policy_version 1430918 (0.0010) [2023-12-26 11:01:08,239][123091] Updated weights for policy 0, policy_version 1430928 (0.0010) [2023-12-26 11:01:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 730169344. Throughput: 0: 8863.3, 1: 8817.6. Samples: 730145556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:08,785][121949] Avg episode reward: [(0, '6154.055'), (1, '5835.798')] [2023-12-26 11:01:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001430928_366321664.pth... [2023-12-26 11:01:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001421280_363847680.pth... [2023-12-26 11:01:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001420256_363585536.pth [2023-12-26 11:01:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001429904_366059520.pth [2023-12-26 11:01:08,867][123090] Updated weights for policy 1, policy_version 1421288 (0.0009) [2023-12-26 11:01:08,932][123090] Updated weights for policy 1, policy_version 1421299 (0.0010) [2023-12-26 11:01:08,997][123090] Updated weights for policy 1, policy_version 1421309 (0.0010) [2023-12-26 11:01:09,161][123091] Updated weights for policy 0, policy_version 1430938 (0.0011) [2023-12-26 11:01:09,234][123091] Updated weights for policy 0, policy_version 1430948 (0.0010) [2023-12-26 11:01:09,310][123091] Updated weights for policy 0, policy_version 1430958 (0.0006) [2023-12-26 11:01:09,886][123090] Updated weights for policy 1, policy_version 1421319 (0.0010) [2023-12-26 11:01:09,950][123090] Updated weights for policy 1, policy_version 1421329 (0.0010) [2023-12-26 11:01:10,008][123090] Updated weights for policy 1, policy_version 1421339 (0.0010) [2023-12-26 11:01:10,081][123091] Updated weights for policy 0, policy_version 1430968 (0.0007) [2023-12-26 11:01:10,142][123091] Updated weights for policy 0, policy_version 1430978 (0.0010) [2023-12-26 11:01:10,202][123091] Updated weights for policy 0, policy_version 1430988 (0.0011) [2023-12-26 11:01:10,825][123090] Updated weights for policy 1, policy_version 1421349 (0.0009) [2023-12-26 11:01:10,878][123090] Updated weights for policy 1, policy_version 1421359 (0.0009) [2023-12-26 11:01:10,935][123090] Updated weights for policy 1, policy_version 1421369 (0.0008) [2023-12-26 11:01:11,022][123091] Updated weights for policy 0, policy_version 1430998 (0.0008) [2023-12-26 11:01:11,090][123091] Updated weights for policy 0, policy_version 1431008 (0.0008) [2023-12-26 11:01:11,153][123091] Updated weights for policy 0, policy_version 1431018 (0.0008) [2023-12-26 11:01:11,860][123090] Updated weights for policy 1, policy_version 1421379 (0.0009) [2023-12-26 11:01:11,924][123090] Updated weights for policy 1, policy_version 1421389 (0.0009) [2023-12-26 11:01:11,948][123091] Updated weights for policy 0, policy_version 1431028 (0.0008) [2023-12-26 11:01:11,992][123090] Updated weights for policy 1, policy_version 1421399 (0.0008) [2023-12-26 11:01:12,004][123091] Updated weights for policy 0, policy_version 1431038 (0.0009) [2023-12-26 11:01:12,061][123091] Updated weights for policy 0, policy_version 1431048 (0.0010) [2023-12-26 11:01:12,811][123090] Updated weights for policy 1, policy_version 1421409 (0.0008) [2023-12-26 11:01:12,873][123090] Updated weights for policy 1, policy_version 1421419 (0.0007) [2023-12-26 11:01:12,925][123091] Updated weights for policy 0, policy_version 1431058 (0.0009) [2023-12-26 11:01:12,938][123090] Updated weights for policy 1, policy_version 1421429 (0.0005) [2023-12-26 11:01:12,985][123091] Updated weights for policy 0, policy_version 1431068 (0.0009) [2023-12-26 11:01:13,002][123090] Updated weights for policy 1, policy_version 1421439 (0.0007) [2023-12-26 11:01:13,045][123091] Updated weights for policy 0, policy_version 1431078 (0.0008) [2023-12-26 11:01:13,100][123091] Updated weights for policy 0, policy_version 1431088 (0.0010) [2023-12-26 11:01:13,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 730251264. Throughput: 0: 8893.0, 1: 8786.1. Samples: 730250648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:13,785][121949] Avg episode reward: [(0, '6144.371'), (1, '5887.311')] [2023-12-26 11:01:13,812][123090] Updated weights for policy 1, policy_version 1421449 (0.0009) [2023-12-26 11:01:13,866][123090] Updated weights for policy 1, policy_version 1421459 (0.0010) [2023-12-26 11:01:13,912][123090] Updated weights for policy 1, policy_version 1421469 (0.0008) [2023-12-26 11:01:13,913][123091] Updated weights for policy 0, policy_version 1431098 (0.0009) [2023-12-26 11:01:13,979][123091] Updated weights for policy 0, policy_version 1431108 (0.0008) [2023-12-26 11:01:14,041][123091] Updated weights for policy 0, policy_version 1431118 (0.0006) [2023-12-26 11:01:14,680][123091] Updated weights for policy 0, policy_version 1431128 (0.0005) [2023-12-26 11:01:14,736][123091] Updated weights for policy 0, policy_version 1431138 (0.0005) [2023-12-26 11:01:14,801][123091] Updated weights for policy 0, policy_version 1431148 (0.0007) [2023-12-26 11:01:14,867][123090] Updated weights for policy 1, policy_version 1421479 (0.0009) [2023-12-26 11:01:14,925][123090] Updated weights for policy 1, policy_version 1421489 (0.0010) [2023-12-26 11:01:14,981][123090] Updated weights for policy 1, policy_version 1421499 (0.0010) [2023-12-26 11:01:15,453][123091] Updated weights for policy 0, policy_version 1431158 (0.0006) [2023-12-26 11:01:15,513][123091] Updated weights for policy 0, policy_version 1431168 (0.0006) [2023-12-26 11:01:15,578][123091] Updated weights for policy 0, policy_version 1431178 (0.0005) [2023-12-26 11:01:15,891][123090] Updated weights for policy 1, policy_version 1421509 (0.0009) [2023-12-26 11:01:15,947][123090] Updated weights for policy 1, policy_version 1421519 (0.0008) [2023-12-26 11:01:16,003][123090] Updated weights for policy 1, policy_version 1421529 (0.0009) [2023-12-26 11:01:16,355][123091] Updated weights for policy 0, policy_version 1431188 (0.0008) [2023-12-26 11:01:16,420][123091] Updated weights for policy 0, policy_version 1431198 (0.0009) [2023-12-26 11:01:16,485][123091] Updated weights for policy 0, policy_version 1431208 (0.0009) [2023-12-26 11:01:16,859][123090] Updated weights for policy 1, policy_version 1421539 (0.0010) [2023-12-26 11:01:16,915][123090] Updated weights for policy 1, policy_version 1421549 (0.0009) [2023-12-26 11:01:16,971][123090] Updated weights for policy 1, policy_version 1421559 (0.0009) [2023-12-26 11:01:17,325][123091] Updated weights for policy 0, policy_version 1431218 (0.0010) [2023-12-26 11:01:17,384][123091] Updated weights for policy 0, policy_version 1431228 (0.0009) [2023-12-26 11:01:17,448][123091] Updated weights for policy 0, policy_version 1431238 (0.0009) [2023-12-26 11:01:17,499][123091] Updated weights for policy 0, policy_version 1431248 (0.0009) [2023-12-26 11:01:17,796][123090] Updated weights for policy 1, policy_version 1421569 (0.0010) [2023-12-26 11:01:17,851][123090] Updated weights for policy 1, policy_version 1421579 (0.0009) [2023-12-26 11:01:17,905][123090] Updated weights for policy 1, policy_version 1421589 (0.0008) [2023-12-26 11:01:17,970][123090] Updated weights for policy 1, policy_version 1421599 (0.0010) [2023-12-26 11:01:18,296][123091] Updated weights for policy 0, policy_version 1431258 (0.0005) [2023-12-26 11:01:18,366][123091] Updated weights for policy 0, policy_version 1431268 (0.0007) [2023-12-26 11:01:18,421][123091] Updated weights for policy 0, policy_version 1431278 (0.0008) [2023-12-26 11:01:18,732][123090] Updated weights for policy 1, policy_version 1421609 (0.0009) [2023-12-26 11:01:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 730341376. Throughput: 0: 8913.5, 1: 8739.6. Samples: 730356160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:18,785][121949] Avg episode reward: [(0, '6229.679'), (1, '5896.393')] [2023-12-26 11:01:18,790][123090] Updated weights for policy 1, policy_version 1421619 (0.0010) [2023-12-26 11:01:18,864][123090] Updated weights for policy 1, policy_version 1421629 (0.0010) [2023-12-26 11:01:19,102][123091] Updated weights for policy 0, policy_version 1431288 (0.0009) [2023-12-26 11:01:19,165][123091] Updated weights for policy 0, policy_version 1431298 (0.0009) [2023-12-26 11:01:19,229][123091] Updated weights for policy 0, policy_version 1431308 (0.0009) [2023-12-26 11:01:19,687][123090] Updated weights for policy 1, policy_version 1421639 (0.0007) [2023-12-26 11:01:19,755][123090] Updated weights for policy 1, policy_version 1421649 (0.0010) [2023-12-26 11:01:19,822][123090] Updated weights for policy 1, policy_version 1421659 (0.0011) [2023-12-26 11:01:20,034][123091] Updated weights for policy 0, policy_version 1431318 (0.0009) [2023-12-26 11:01:20,100][123091] Updated weights for policy 0, policy_version 1431328 (0.0009) [2023-12-26 11:01:20,162][123091] Updated weights for policy 0, policy_version 1431338 (0.0009) [2023-12-26 11:01:20,538][123090] Updated weights for policy 1, policy_version 1421669 (0.0008) [2023-12-26 11:01:20,610][123090] Updated weights for policy 1, policy_version 1421679 (0.0009) [2023-12-26 11:01:20,673][123090] Updated weights for policy 1, policy_version 1421689 (0.0010) [2023-12-26 11:01:21,028][123091] Updated weights for policy 0, policy_version 1431348 (0.0010) [2023-12-26 11:01:21,097][123091] Updated weights for policy 0, policy_version 1431358 (0.0010) [2023-12-26 11:01:21,161][123091] Updated weights for policy 0, policy_version 1431368 (0.0009) [2023-12-26 11:01:21,470][123090] Updated weights for policy 1, policy_version 1421700 (0.0007) [2023-12-26 11:01:21,526][123090] Updated weights for policy 1, policy_version 1421710 (0.0009) [2023-12-26 11:01:21,589][123090] Updated weights for policy 1, policy_version 1421720 (0.0009) [2023-12-26 11:01:22,028][123091] Updated weights for policy 0, policy_version 1431378 (0.0009) [2023-12-26 11:01:22,094][123091] Updated weights for policy 0, policy_version 1431388 (0.0010) [2023-12-26 11:01:22,152][123091] Updated weights for policy 0, policy_version 1431398 (0.0009) [2023-12-26 11:01:22,212][123091] Updated weights for policy 0, policy_version 1431408 (0.0009) [2023-12-26 11:01:22,456][123090] Updated weights for policy 1, policy_version 1421730 (0.0008) [2023-12-26 11:01:22,526][123090] Updated weights for policy 1, policy_version 1421740 (0.0008) [2023-12-26 11:01:22,592][123090] Updated weights for policy 1, policy_version 1421750 (0.0008) [2023-12-26 11:01:22,664][123090] Updated weights for policy 1, policy_version 1421760 (0.0009) [2023-12-26 11:01:23,057][123091] Updated weights for policy 0, policy_version 1431418 (0.0010) [2023-12-26 11:01:23,118][123091] Updated weights for policy 0, policy_version 1431428 (0.0008) [2023-12-26 11:01:23,175][123091] Updated weights for policy 0, policy_version 1431438 (0.0009) [2023-12-26 11:01:23,467][123090] Updated weights for policy 1, policy_version 1421770 (0.0010) [2023-12-26 11:01:23,529][123090] Updated weights for policy 1, policy_version 1421780 (0.0009) [2023-12-26 11:01:23,582][123090] Updated weights for policy 1, policy_version 1421790 (0.0009) [2023-12-26 11:01:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 730431488. Throughput: 0: 8885.4, 1: 8766.9. Samples: 730408424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:23,785][121949] Avg episode reward: [(0, '6025.384'), (1, '5892.376')] [2023-12-26 11:01:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001431440_366452736.pth... [2023-12-26 11:01:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001421792_363978752.pth... [2023-12-26 11:01:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001430416_366190592.pth [2023-12-26 11:01:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001420768_363716608.pth [2023-12-26 11:01:23,866][123091] Updated weights for policy 0, policy_version 1431448 (0.0008) [2023-12-26 11:01:23,930][123091] Updated weights for policy 0, policy_version 1431458 (0.0009) [2023-12-26 11:01:23,991][123091] Updated weights for policy 0, policy_version 1431468 (0.0009) [2023-12-26 11:01:24,492][123090] Updated weights for policy 1, policy_version 1421800 (0.0009) [2023-12-26 11:01:24,562][123090] Updated weights for policy 1, policy_version 1421810 (0.0009) [2023-12-26 11:01:24,625][123090] Updated weights for policy 1, policy_version 1421820 (0.0009) [2023-12-26 11:01:24,785][123091] Updated weights for policy 0, policy_version 1431478 (0.0007) [2023-12-26 11:01:24,853][123091] Updated weights for policy 0, policy_version 1431488 (0.0008) [2023-12-26 11:01:24,916][123091] Updated weights for policy 0, policy_version 1431498 (0.0009) [2023-12-26 11:01:25,473][123090] Updated weights for policy 1, policy_version 1421830 (0.0010) [2023-12-26 11:01:25,527][123090] Updated weights for policy 1, policy_version 1421840 (0.0010) [2023-12-26 11:01:25,585][123090] Updated weights for policy 1, policy_version 1421850 (0.0010) [2023-12-26 11:01:25,696][123091] Updated weights for policy 0, policy_version 1431508 (0.0008) [2023-12-26 11:01:25,761][123091] Updated weights for policy 0, policy_version 1431518 (0.0005) [2023-12-26 11:01:25,827][123091] Updated weights for policy 0, policy_version 1431528 (0.0005) [2023-12-26 11:01:26,432][123090] Updated weights for policy 1, policy_version 1421860 (0.0009) [2023-12-26 11:01:26,489][123090] Updated weights for policy 1, policy_version 1421870 (0.0009) [2023-12-26 11:01:26,542][123090] Updated weights for policy 1, policy_version 1421880 (0.0009) [2023-12-26 11:01:26,550][123091] Updated weights for policy 0, policy_version 1431538 (0.0005) [2023-12-26 11:01:26,604][123091] Updated weights for policy 0, policy_version 1431548 (0.0007) [2023-12-26 11:01:26,666][123091] Updated weights for policy 0, policy_version 1431558 (0.0008) [2023-12-26 11:01:26,719][123091] Updated weights for policy 0, policy_version 1431568 (0.0009) [2023-12-26 11:01:27,390][123090] Updated weights for policy 1, policy_version 1421890 (0.0010) [2023-12-26 11:01:27,448][123090] Updated weights for policy 1, policy_version 1421900 (0.0008) [2023-12-26 11:01:27,496][123090] Updated weights for policy 1, policy_version 1421910 (0.0009) [2023-12-26 11:01:27,543][123090] Updated weights for policy 1, policy_version 1421920 (0.0009) [2023-12-26 11:01:27,587][123091] Updated weights for policy 0, policy_version 1431578 (0.0008) [2023-12-26 11:01:27,647][123091] Updated weights for policy 0, policy_version 1431588 (0.0009) [2023-12-26 11:01:27,711][123091] Updated weights for policy 0, policy_version 1431598 (0.0009) [2023-12-26 11:01:28,385][123090] Updated weights for policy 1, policy_version 1421930 (0.0009) [2023-12-26 11:01:28,443][123090] Updated weights for policy 1, policy_version 1421940 (0.0009) [2023-12-26 11:01:28,501][123090] Updated weights for policy 1, policy_version 1421950 (0.0008) [2023-12-26 11:01:28,513][123091] Updated weights for policy 0, policy_version 1431608 (0.0009) [2023-12-26 11:01:28,567][123091] Updated weights for policy 0, policy_version 1431618 (0.0009) [2023-12-26 11:01:28,630][123091] Updated weights for policy 0, policy_version 1431628 (0.0013) [2023-12-26 11:01:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 730521600. Throughput: 0: 8894.0, 1: 8740.2. Samples: 730511692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:28,785][121949] Avg episode reward: [(0, '6071.091'), (1, '5750.131')] [2023-12-26 11:01:29,334][123090] Updated weights for policy 1, policy_version 1421960 (0.0009) [2023-12-26 11:01:29,390][123090] Updated weights for policy 1, policy_version 1421970 (0.0009) [2023-12-26 11:01:29,451][123090] Updated weights for policy 1, policy_version 1421980 (0.0010) [2023-12-26 11:01:29,499][123091] Updated weights for policy 0, policy_version 1431638 (0.0009) [2023-12-26 11:01:29,548][123091] Updated weights for policy 0, policy_version 1431648 (0.0009) [2023-12-26 11:01:29,601][123091] Updated weights for policy 0, policy_version 1431658 (0.0010) [2023-12-26 11:01:30,239][123090] Updated weights for policy 1, policy_version 1421990 (0.0009) [2023-12-26 11:01:30,307][123090] Updated weights for policy 1, policy_version 1422000 (0.0009) [2023-12-26 11:01:30,368][123090] Updated weights for policy 1, policy_version 1422010 (0.0010) [2023-12-26 11:01:30,446][123091] Updated weights for policy 0, policy_version 1431668 (0.0009) [2023-12-26 11:01:30,498][123091] Updated weights for policy 0, policy_version 1431678 (0.0008) [2023-12-26 11:01:30,560][123091] Updated weights for policy 0, policy_version 1431688 (0.0009) [2023-12-26 11:01:31,205][123090] Updated weights for policy 1, policy_version 1422020 (0.0009) [2023-12-26 11:01:31,280][123090] Updated weights for policy 1, policy_version 1422030 (0.0007) [2023-12-26 11:01:31,347][123090] Updated weights for policy 1, policy_version 1422040 (0.0008) [2023-12-26 11:01:31,417][123091] Updated weights for policy 0, policy_version 1431698 (0.0009) [2023-12-26 11:01:31,475][123091] Updated weights for policy 0, policy_version 1431708 (0.0010) [2023-12-26 11:01:31,532][123091] Updated weights for policy 0, policy_version 1431718 (0.0009) [2023-12-26 11:01:31,585][123091] Updated weights for policy 0, policy_version 1431728 (0.0010) [2023-12-26 11:01:32,095][123090] Updated weights for policy 1, policy_version 1422050 (0.0007) [2023-12-26 11:01:32,154][123090] Updated weights for policy 1, policy_version 1422060 (0.0010) [2023-12-26 11:01:32,219][123090] Updated weights for policy 1, policy_version 1422070 (0.0009) [2023-12-26 11:01:32,286][123090] Updated weights for policy 1, policy_version 1422080 (0.0007) [2023-12-26 11:01:32,496][123091] Updated weights for policy 0, policy_version 1431738 (0.0009) [2023-12-26 11:01:32,563][123091] Updated weights for policy 0, policy_version 1431748 (0.0010) [2023-12-26 11:01:32,630][123091] Updated weights for policy 0, policy_version 1431758 (0.0009) [2023-12-26 11:01:33,066][123090] Updated weights for policy 1, policy_version 1422090 (0.0008) [2023-12-26 11:01:33,118][123090] Updated weights for policy 1, policy_version 1422100 (0.0009) [2023-12-26 11:01:33,170][123090] Updated weights for policy 1, policy_version 1422110 (0.0010) [2023-12-26 11:01:33,431][123091] Updated weights for policy 0, policy_version 1431768 (0.0010) [2023-12-26 11:01:33,490][123091] Updated weights for policy 0, policy_version 1431778 (0.0008) [2023-12-26 11:01:33,562][123091] Updated weights for policy 0, policy_version 1431788 (0.0005) [2023-12-26 11:01:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 730603520. Throughput: 0: 8809.1, 1: 8730.5. Samples: 730614972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:01:33,785][121949] Avg episode reward: [(0, '6179.829'), (1, '5746.576')] [2023-12-26 11:01:33,844][123090] Updated weights for policy 1, policy_version 1422120 (0.0010) [2023-12-26 11:01:33,894][123090] Updated weights for policy 1, policy_version 1422130 (0.0010) [2023-12-26 11:01:33,937][123090] Updated weights for policy 1, policy_version 1422140 (0.0010) [2023-12-26 11:01:34,263][123091] Updated weights for policy 0, policy_version 1431798 (0.0007) [2023-12-26 11:01:34,323][123091] Updated weights for policy 0, policy_version 1431808 (0.0008) [2023-12-26 11:01:34,386][123091] Updated weights for policy 0, policy_version 1431818 (0.0008) [2023-12-26 11:01:34,794][123090] Updated weights for policy 1, policy_version 1422150 (0.0010) [2023-12-26 11:01:34,854][123090] Updated weights for policy 1, policy_version 1422160 (0.0011) [2023-12-26 11:01:34,909][123090] Updated weights for policy 1, policy_version 1422170 (0.0010) [2023-12-26 11:01:35,143][123091] Updated weights for policy 0, policy_version 1431828 (0.0009) [2023-12-26 11:01:35,210][123091] Updated weights for policy 0, policy_version 1431838 (0.0011) [2023-12-26 11:01:35,268][123091] Updated weights for policy 0, policy_version 1431848 (0.0010) [2023-12-26 11:01:35,641][123090] Updated weights for policy 1, policy_version 1422180 (0.0008) [2023-12-26 11:01:35,716][123090] Updated weights for policy 1, policy_version 1422190 (0.0006) [2023-12-26 11:01:35,792][123090] Updated weights for policy 1, policy_version 1422200 (0.0010) [2023-12-26 11:01:36,087][123091] Updated weights for policy 0, policy_version 1431858 (0.0011) [2023-12-26 11:01:36,154][123091] Updated weights for policy 0, policy_version 1431868 (0.0011) [2023-12-26 11:01:36,215][123091] Updated weights for policy 0, policy_version 1431878 (0.0010) [2023-12-26 11:01:36,281][123091] Updated weights for policy 0, policy_version 1431888 (0.0011) [2023-12-26 11:01:36,558][123090] Updated weights for policy 1, policy_version 1422210 (0.0010) [2023-12-26 11:01:36,625][123090] Updated weights for policy 1, policy_version 1422220 (0.0009) [2023-12-26 11:01:36,685][123090] Updated weights for policy 1, policy_version 1422230 (0.0009) [2023-12-26 11:01:36,748][123090] Updated weights for policy 1, policy_version 1422240 (0.0009) [2023-12-26 11:01:37,100][123091] Updated weights for policy 0, policy_version 1431898 (0.0006) [2023-12-26 11:01:37,167][123091] Updated weights for policy 0, policy_version 1431908 (0.0005) [2023-12-26 11:01:37,233][123091] Updated weights for policy 0, policy_version 1431918 (0.0006) [2023-12-26 11:01:37,614][123090] Updated weights for policy 1, policy_version 1422250 (0.0010) [2023-12-26 11:01:37,672][123090] Updated weights for policy 1, policy_version 1422260 (0.0009) [2023-12-26 11:01:37,731][123090] Updated weights for policy 1, policy_version 1422270 (0.0010) [2023-12-26 11:01:37,954][123091] Updated weights for policy 0, policy_version 1431928 (0.0010) [2023-12-26 11:01:38,023][123091] Updated weights for policy 0, policy_version 1431938 (0.0008) [2023-12-26 11:01:38,083][123091] Updated weights for policy 0, policy_version 1431948 (0.0006) [2023-12-26 11:01:38,532][123090] Updated weights for policy 1, policy_version 1422280 (0.0010) [2023-12-26 11:01:38,584][123090] Updated weights for policy 1, policy_version 1422291 (0.0010) [2023-12-26 11:01:38,649][123090] Updated weights for policy 1, policy_version 1422301 (0.0009) [2023-12-26 11:01:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 730693632. Throughput: 0: 8848.0, 1: 8748.8. Samples: 730669516. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:01:38,785][121949] Avg episode reward: [(0, '6241.464'), (1, '5709.720')] [2023-12-26 11:01:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001422304_364109824.pth... [2023-12-26 11:01:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001421280_363847680.pth [2023-12-26 11:01:38,824][123091] Updated weights for policy 0, policy_version 1431958 (0.0006) [2023-12-26 11:01:38,891][123091] Updated weights for policy 0, policy_version 1431968 (0.0006) [2023-12-26 11:01:38,949][123091] Updated weights for policy 0, policy_version 1431978 (0.0006) [2023-12-26 11:01:38,982][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001431984_366592000.pth... [2023-12-26 11:01:38,985][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001430928_366321664.pth [2023-12-26 11:01:39,416][123090] Updated weights for policy 1, policy_version 1422311 (0.0010) [2023-12-26 11:01:39,491][123090] Updated weights for policy 1, policy_version 1422321 (0.0009) [2023-12-26 11:01:39,554][123090] Updated weights for policy 1, policy_version 1422331 (0.0009) [2023-12-26 11:01:39,735][123091] Updated weights for policy 0, policy_version 1431988 (0.0006) [2023-12-26 11:01:39,809][123091] Updated weights for policy 0, policy_version 1431998 (0.0009) [2023-12-26 11:01:39,885][123091] Updated weights for policy 0, policy_version 1432008 (0.0008) [2023-12-26 11:01:40,446][123090] Updated weights for policy 1, policy_version 1422341 (0.0010) [2023-12-26 11:01:40,500][123090] Updated weights for policy 1, policy_version 1422351 (0.0009) [2023-12-26 11:01:40,551][123090] Updated weights for policy 1, policy_version 1422361 (0.0010) [2023-12-26 11:01:40,611][123091] Updated weights for policy 0, policy_version 1432018 (0.0008) [2023-12-26 11:01:40,681][123091] Updated weights for policy 0, policy_version 1432028 (0.0008) [2023-12-26 11:01:40,745][123091] Updated weights for policy 0, policy_version 1432038 (0.0008) [2023-12-26 11:01:40,808][123091] Updated weights for policy 0, policy_version 1432048 (0.0009) [2023-12-26 11:01:41,428][123090] Updated weights for policy 1, policy_version 1422371 (0.0009) [2023-12-26 11:01:41,491][123090] Updated weights for policy 1, policy_version 1422381 (0.0006) [2023-12-26 11:01:41,552][123090] Updated weights for policy 1, policy_version 1422391 (0.0006) [2023-12-26 11:01:41,659][123091] Updated weights for policy 0, policy_version 1432058 (0.0009) [2023-12-26 11:01:41,738][123091] Updated weights for policy 0, policy_version 1432068 (0.0009) [2023-12-26 11:01:41,812][123091] Updated weights for policy 0, policy_version 1432078 (0.0010) [2023-12-26 11:01:42,388][123090] Updated weights for policy 1, policy_version 1422401 (0.0008) [2023-12-26 11:01:42,457][123090] Updated weights for policy 1, policy_version 1422411 (0.0010) [2023-12-26 11:01:42,524][123090] Updated weights for policy 1, policy_version 1422421 (0.0009) [2023-12-26 11:01:42,588][123090] Updated weights for policy 1, policy_version 1422431 (0.0010) [2023-12-26 11:01:42,631][123091] Updated weights for policy 0, policy_version 1432088 (0.0009) [2023-12-26 11:01:42,690][123091] Updated weights for policy 0, policy_version 1432098 (0.0010) [2023-12-26 11:01:42,748][123091] Updated weights for policy 0, policy_version 1432108 (0.0009) [2023-12-26 11:01:43,390][123090] Updated weights for policy 1, policy_version 1422441 (0.0008) [2023-12-26 11:01:43,437][123090] Updated weights for policy 1, policy_version 1422451 (0.0005) [2023-12-26 11:01:43,490][123090] Updated weights for policy 1, policy_version 1422461 (0.0005) [2023-12-26 11:01:43,597][123091] Updated weights for policy 0, policy_version 1432118 (0.0008) [2023-12-26 11:01:43,653][123091] Updated weights for policy 0, policy_version 1432128 (0.0005) [2023-12-26 11:01:43,713][123091] Updated weights for policy 0, policy_version 1432138 (0.0005) [2023-12-26 11:01:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 730783744. Throughput: 0: 8809.5, 1: 8615.1. Samples: 730772936. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:01:43,785][121949] Avg episode reward: [(0, '6351.097'), (1, '5694.828')] [2023-12-26 11:01:44,244][123090] Updated weights for policy 1, policy_version 1422471 (0.0008) [2023-12-26 11:01:44,305][123090] Updated weights for policy 1, policy_version 1422481 (0.0007) [2023-12-26 11:01:44,371][123090] Updated weights for policy 1, policy_version 1422491 (0.0006) [2023-12-26 11:01:44,383][123091] Updated weights for policy 0, policy_version 1432148 (0.0007) [2023-12-26 11:01:44,446][123091] Updated weights for policy 0, policy_version 1432158 (0.0010) [2023-12-26 11:01:44,498][123091] Updated weights for policy 0, policy_version 1432168 (0.0008) [2023-12-26 11:01:45,211][123090] Updated weights for policy 1, policy_version 1422501 (0.0007) [2023-12-26 11:01:45,236][123091] Updated weights for policy 0, policy_version 1432178 (0.0005) [2023-12-26 11:01:45,269][123090] Updated weights for policy 1, policy_version 1422511 (0.0008) [2023-12-26 11:01:45,307][123091] Updated weights for policy 0, policy_version 1432188 (0.0006) [2023-12-26 11:01:45,342][123090] Updated weights for policy 1, policy_version 1422521 (0.0009) [2023-12-26 11:01:45,374][123091] Updated weights for policy 0, policy_version 1432198 (0.0006) [2023-12-26 11:01:45,446][123091] Updated weights for policy 0, policy_version 1432208 (0.0006) [2023-12-26 11:01:46,137][123091] Updated weights for policy 0, policy_version 1432219 (0.0010) [2023-12-26 11:01:46,191][123091] Updated weights for policy 0, policy_version 1432229 (0.0008) [2023-12-26 11:01:46,192][123090] Updated weights for policy 1, policy_version 1422531 (0.0009) [2023-12-26 11:01:46,241][123090] Updated weights for policy 1, policy_version 1422541 (0.0005) [2023-12-26 11:01:46,241][123091] Updated weights for policy 0, policy_version 1432239 (0.0010) [2023-12-26 11:01:46,297][123090] Updated weights for policy 1, policy_version 1422551 (0.0006) [2023-12-26 11:01:46,981][123090] Updated weights for policy 1, policy_version 1422561 (0.0006) [2023-12-26 11:01:47,040][123090] Updated weights for policy 1, policy_version 1422571 (0.0009) [2023-12-26 11:01:47,042][123091] Updated weights for policy 0, policy_version 1432249 (0.0006) [2023-12-26 11:01:47,092][123090] Updated weights for policy 1, policy_version 1422581 (0.0009) [2023-12-26 11:01:47,094][123091] Updated weights for policy 0, policy_version 1432259 (0.0005) [2023-12-26 11:01:47,138][123091] Updated weights for policy 0, policy_version 1432269 (0.0005) [2023-12-26 11:01:47,151][123090] Updated weights for policy 1, policy_version 1422591 (0.0010) [2023-12-26 11:01:47,743][123091] Updated weights for policy 0, policy_version 1432279 (0.0005) [2023-12-26 11:01:47,810][123091] Updated weights for policy 0, policy_version 1432289 (0.0005) [2023-12-26 11:01:47,879][123091] Updated weights for policy 0, policy_version 1432299 (0.0008) [2023-12-26 11:01:47,958][123090] Updated weights for policy 1, policy_version 1422601 (0.0009) [2023-12-26 11:01:48,016][123090] Updated weights for policy 1, policy_version 1422611 (0.0006) [2023-12-26 11:01:48,087][123090] Updated weights for policy 1, policy_version 1422621 (0.0005) [2023-12-26 11:01:48,558][123091] Updated weights for policy 0, policy_version 1432309 (0.0009) [2023-12-26 11:01:48,603][123091] Updated weights for policy 0, policy_version 1432319 (0.0005) [2023-12-26 11:01:48,657][123091] Updated weights for policy 0, policy_version 1432329 (0.0006) [2023-12-26 11:01:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 730873856. Throughput: 0: 8929.9, 1: 8661.5. Samples: 730884244. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:01:48,785][121949] Avg episode reward: [(0, '6412.161'), (1, '5721.929')] [2023-12-26 11:01:48,870][123090] Updated weights for policy 1, policy_version 1422631 (0.0009) [2023-12-26 11:01:48,933][123090] Updated weights for policy 1, policy_version 1422641 (0.0010) [2023-12-26 11:01:48,981][123090] Updated weights for policy 1, policy_version 1422651 (0.0010) [2023-12-26 11:01:49,458][123091] Updated weights for policy 0, policy_version 1432339 (0.0008) [2023-12-26 11:01:49,520][123091] Updated weights for policy 0, policy_version 1432349 (0.0009) [2023-12-26 11:01:49,581][123091] Updated weights for policy 0, policy_version 1432359 (0.0010) [2023-12-26 11:01:49,770][123090] Updated weights for policy 1, policy_version 1422661 (0.0008) [2023-12-26 11:01:49,822][123090] Updated weights for policy 1, policy_version 1422671 (0.0006) [2023-12-26 11:01:49,894][123090] Updated weights for policy 1, policy_version 1422681 (0.0006) [2023-12-26 11:01:50,450][123091] Updated weights for policy 0, policy_version 1432369 (0.0010) [2023-12-26 11:01:50,517][123091] Updated weights for policy 0, policy_version 1432379 (0.0011) [2023-12-26 11:01:50,580][123091] Updated weights for policy 0, policy_version 1432389 (0.0011) [2023-12-26 11:01:50,636][123091] Updated weights for policy 0, policy_version 1432399 (0.0010) [2023-12-26 11:01:50,711][123090] Updated weights for policy 1, policy_version 1422691 (0.0008) [2023-12-26 11:01:50,780][123090] Updated weights for policy 1, policy_version 1422701 (0.0007) [2023-12-26 11:01:50,856][123090] Updated weights for policy 1, policy_version 1422711 (0.0006) [2023-12-26 11:01:51,526][123091] Updated weights for policy 0, policy_version 1432409 (0.0009) [2023-12-26 11:01:51,582][123090] Updated weights for policy 1, policy_version 1422721 (0.0006) [2023-12-26 11:01:51,587][123091] Updated weights for policy 0, policy_version 1432419 (0.0009) [2023-12-26 11:01:51,642][123090] Updated weights for policy 1, policy_version 1422731 (0.0008) [2023-12-26 11:01:51,652][123091] Updated weights for policy 0, policy_version 1432429 (0.0009) [2023-12-26 11:01:51,704][123090] Updated weights for policy 1, policy_version 1422741 (0.0008) [2023-12-26 11:01:51,770][123090] Updated weights for policy 1, policy_version 1422751 (0.0008) [2023-12-26 11:01:52,493][123091] Updated weights for policy 0, policy_version 1432439 (0.0009) [2023-12-26 11:01:52,560][123091] Updated weights for policy 0, policy_version 1432449 (0.0007) [2023-12-26 11:01:52,571][123090] Updated weights for policy 1, policy_version 1422761 (0.0010) [2023-12-26 11:01:52,621][123091] Updated weights for policy 0, policy_version 1432459 (0.0006) [2023-12-26 11:01:52,630][123090] Updated weights for policy 1, policy_version 1422771 (0.0010) [2023-12-26 11:01:52,678][123090] Updated weights for policy 1, policy_version 1422781 (0.0010) [2023-12-26 11:01:53,350][123091] Updated weights for policy 0, policy_version 1432469 (0.0006) [2023-12-26 11:01:53,423][123091] Updated weights for policy 0, policy_version 1432479 (0.0005) [2023-12-26 11:01:53,460][123090] Updated weights for policy 1, policy_version 1422791 (0.0007) [2023-12-26 11:01:53,481][123091] Updated weights for policy 0, policy_version 1432489 (0.0005) [2023-12-26 11:01:53,525][123090] Updated weights for policy 1, policy_version 1422801 (0.0006) [2023-12-26 11:01:53,578][123090] Updated weights for policy 1, policy_version 1422811 (0.0005) [2023-12-26 11:01:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.6). Total num frames: 730963968. Throughput: 0: 8910.9, 1: 8665.8. Samples: 730936508. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:01:53,785][121949] Avg episode reward: [(0, '6335.736'), (1, '5767.815')] [2023-12-26 11:01:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001432496_366723072.pth... [2023-12-26 11:01:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001422816_364240896.pth... [2023-12-26 11:01:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001431440_366452736.pth [2023-12-26 11:01:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001421792_363978752.pth [2023-12-26 11:01:54,228][123090] Updated weights for policy 1, policy_version 1422821 (0.0007) [2023-12-26 11:01:54,280][123090] Updated weights for policy 1, policy_version 1422831 (0.0010) [2023-12-26 11:01:54,290][123091] Updated weights for policy 0, policy_version 1432499 (0.0006) [2023-12-26 11:01:54,347][123090] Updated weights for policy 1, policy_version 1422841 (0.0011) [2023-12-26 11:01:54,353][123091] Updated weights for policy 0, policy_version 1432509 (0.0008) [2023-12-26 11:01:54,411][123091] Updated weights for policy 0, policy_version 1432519 (0.0008) [2023-12-26 11:01:55,123][123090] Updated weights for policy 1, policy_version 1422851 (0.0010) [2023-12-26 11:01:55,185][123090] Updated weights for policy 1, policy_version 1422861 (0.0010) [2023-12-26 11:01:55,248][123090] Updated weights for policy 1, policy_version 1422871 (0.0008) [2023-12-26 11:01:55,270][123091] Updated weights for policy 0, policy_version 1432529 (0.0009) [2023-12-26 11:01:55,333][123091] Updated weights for policy 0, policy_version 1432539 (0.0009) [2023-12-26 11:01:55,384][123091] Updated weights for policy 0, policy_version 1432549 (0.0007) [2023-12-26 11:01:55,432][123091] Updated weights for policy 0, policy_version 1432559 (0.0009) [2023-12-26 11:01:56,032][123090] Updated weights for policy 1, policy_version 1422881 (0.0011) [2023-12-26 11:01:56,086][123090] Updated weights for policy 1, policy_version 1422891 (0.0010) [2023-12-26 11:01:56,138][123090] Updated weights for policy 1, policy_version 1422901 (0.0010) [2023-12-26 11:01:56,166][123091] Updated weights for policy 0, policy_version 1432569 (0.0006) [2023-12-26 11:01:56,189][123090] Updated weights for policy 1, policy_version 1422911 (0.0010) [2023-12-26 11:01:56,219][123091] Updated weights for policy 0, policy_version 1432579 (0.0009) [2023-12-26 11:01:56,276][123091] Updated weights for policy 0, policy_version 1432589 (0.0009) [2023-12-26 11:01:56,891][123090] Updated weights for policy 1, policy_version 1422921 (0.0005) [2023-12-26 11:01:56,939][123090] Updated weights for policy 1, policy_version 1422931 (0.0005) [2023-12-26 11:01:56,989][123090] Updated weights for policy 1, policy_version 1422941 (0.0005) [2023-12-26 11:01:57,180][123091] Updated weights for policy 0, policy_version 1432599 (0.0010) [2023-12-26 11:01:57,240][123091] Updated weights for policy 0, policy_version 1432609 (0.0010) [2023-12-26 11:01:57,294][123091] Updated weights for policy 0, policy_version 1432619 (0.0009) [2023-12-26 11:01:57,680][123090] Updated weights for policy 1, policy_version 1422951 (0.0005) [2023-12-26 11:01:57,739][123090] Updated weights for policy 1, policy_version 1422961 (0.0005) [2023-12-26 11:01:57,783][123090] Updated weights for policy 1, policy_version 1422971 (0.0005) [2023-12-26 11:01:57,976][123091] Updated weights for policy 0, policy_version 1432629 (0.0008) [2023-12-26 11:01:58,042][123091] Updated weights for policy 0, policy_version 1432639 (0.0006) [2023-12-26 11:01:58,108][123091] Updated weights for policy 0, policy_version 1432649 (0.0008) [2023-12-26 11:01:58,495][123090] Updated weights for policy 1, policy_version 1422981 (0.0008) [2023-12-26 11:01:58,559][123090] Updated weights for policy 1, policy_version 1422991 (0.0011) [2023-12-26 11:01:58,619][123090] Updated weights for policy 1, policy_version 1423001 (0.0011) [2023-12-26 11:01:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 731054080. Throughput: 0: 8876.2, 1: 8779.0. Samples: 731045132. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:01:58,785][121949] Avg episode reward: [(0, '6194.034'), (1, '5706.661')] [2023-12-26 11:01:58,885][123091] Updated weights for policy 0, policy_version 1432659 (0.0009) [2023-12-26 11:01:58,957][123091] Updated weights for policy 0, policy_version 1432669 (0.0006) [2023-12-26 11:01:59,028][123091] Updated weights for policy 0, policy_version 1432679 (0.0008) [2023-12-26 11:01:59,491][123090] Updated weights for policy 1, policy_version 1423011 (0.0009) [2023-12-26 11:01:59,549][123090] Updated weights for policy 1, policy_version 1423021 (0.0005) [2023-12-26 11:01:59,609][123090] Updated weights for policy 1, policy_version 1423031 (0.0006) [2023-12-26 11:01:59,776][123091] Updated weights for policy 0, policy_version 1432689 (0.0008) [2023-12-26 11:01:59,841][123091] Updated weights for policy 0, policy_version 1432699 (0.0009) [2023-12-26 11:01:59,899][123091] Updated weights for policy 0, policy_version 1432709 (0.0009) [2023-12-26 11:01:59,960][123091] Updated weights for policy 0, policy_version 1432719 (0.0009) [2023-12-26 11:02:00,401][123090] Updated weights for policy 1, policy_version 1423041 (0.0010) [2023-12-26 11:02:00,457][123090] Updated weights for policy 1, policy_version 1423051 (0.0006) [2023-12-26 11:02:00,510][123090] Updated weights for policy 1, policy_version 1423061 (0.0005) [2023-12-26 11:02:00,555][123090] Updated weights for policy 1, policy_version 1423071 (0.0005) [2023-12-26 11:02:00,801][123091] Updated weights for policy 0, policy_version 1432729 (0.0009) [2023-12-26 11:02:00,863][123091] Updated weights for policy 0, policy_version 1432739 (0.0009) [2023-12-26 11:02:00,914][123091] Updated weights for policy 0, policy_version 1432749 (0.0009) [2023-12-26 11:02:01,151][123090] Updated weights for policy 1, policy_version 1423081 (0.0007) [2023-12-26 11:02:01,211][123090] Updated weights for policy 1, policy_version 1423091 (0.0009) [2023-12-26 11:02:01,270][123090] Updated weights for policy 1, policy_version 1423101 (0.0009) [2023-12-26 11:02:01,741][123091] Updated weights for policy 0, policy_version 1432759 (0.0009) [2023-12-26 11:02:01,791][123091] Updated weights for policy 0, policy_version 1432769 (0.0009) [2023-12-26 11:02:01,857][123091] Updated weights for policy 0, policy_version 1432779 (0.0010) [2023-12-26 11:02:02,142][123090] Updated weights for policy 1, policy_version 1423111 (0.0009) [2023-12-26 11:02:02,193][123090] Updated weights for policy 1, policy_version 1423121 (0.0009) [2023-12-26 11:02:02,244][123090] Updated weights for policy 1, policy_version 1423131 (0.0009) [2023-12-26 11:02:02,716][123091] Updated weights for policy 0, policy_version 1432789 (0.0009) [2023-12-26 11:02:02,768][123091] Updated weights for policy 0, policy_version 1432799 (0.0009) [2023-12-26 11:02:02,826][123091] Updated weights for policy 0, policy_version 1432809 (0.0009) [2023-12-26 11:02:03,099][123090] Updated weights for policy 1, policy_version 1423141 (0.0009) [2023-12-26 11:02:03,162][123090] Updated weights for policy 1, policy_version 1423151 (0.0009) [2023-12-26 11:02:03,232][123090] Updated weights for policy 1, policy_version 1423161 (0.0009) [2023-12-26 11:02:03,619][123091] Updated weights for policy 0, policy_version 1432819 (0.0008) [2023-12-26 11:02:03,686][123091] Updated weights for policy 0, policy_version 1432829 (0.0005) [2023-12-26 11:02:03,737][123091] Updated weights for policy 0, policy_version 1432839 (0.0005) [2023-12-26 11:02:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 731144192. Throughput: 0: 8844.5, 1: 8854.9. Samples: 731152636. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:03,785][121949] Avg episode reward: [(0, '6007.224'), (1, '5633.706')] [2023-12-26 11:02:04,083][123090] Updated weights for policy 1, policy_version 1423171 (0.0009) [2023-12-26 11:02:04,145][123090] Updated weights for policy 1, policy_version 1423181 (0.0009) [2023-12-26 11:02:04,210][123090] Updated weights for policy 1, policy_version 1423191 (0.0009) [2023-12-26 11:02:04,513][123091] Updated weights for policy 0, policy_version 1432849 (0.0010) [2023-12-26 11:02:04,580][123091] Updated weights for policy 0, policy_version 1432859 (0.0010) [2023-12-26 11:02:04,641][123091] Updated weights for policy 0, policy_version 1432869 (0.0009) [2023-12-26 11:02:04,696][123091] Updated weights for policy 0, policy_version 1432879 (0.0009) [2023-12-26 11:02:05,068][123090] Updated weights for policy 1, policy_version 1423201 (0.0009) [2023-12-26 11:02:05,118][123090] Updated weights for policy 1, policy_version 1423211 (0.0009) [2023-12-26 11:02:05,171][123090] Updated weights for policy 1, policy_version 1423221 (0.0009) [2023-12-26 11:02:05,225][123090] Updated weights for policy 1, policy_version 1423231 (0.0009) [2023-12-26 11:02:05,551][123091] Updated weights for policy 0, policy_version 1432889 (0.0009) [2023-12-26 11:02:05,610][123091] Updated weights for policy 0, policy_version 1432899 (0.0009) [2023-12-26 11:02:05,661][123091] Updated weights for policy 0, policy_version 1432909 (0.0009) [2023-12-26 11:02:06,041][123090] Updated weights for policy 1, policy_version 1423241 (0.0006) [2023-12-26 11:02:06,087][123090] Updated weights for policy 1, policy_version 1423251 (0.0005) [2023-12-26 11:02:06,151][123090] Updated weights for policy 1, policy_version 1423261 (0.0007) [2023-12-26 11:02:06,486][123091] Updated weights for policy 0, policy_version 1432919 (0.0010) [2023-12-26 11:02:06,541][123091] Updated weights for policy 0, policy_version 1432929 (0.0010) [2023-12-26 11:02:06,594][123091] Updated weights for policy 0, policy_version 1432939 (0.0009) [2023-12-26 11:02:06,893][123090] Updated weights for policy 1, policy_version 1423271 (0.0008) [2023-12-26 11:02:06,947][123090] Updated weights for policy 1, policy_version 1423281 (0.0010) [2023-12-26 11:02:07,002][123090] Updated weights for policy 1, policy_version 1423291 (0.0008) [2023-12-26 11:02:07,463][123091] Updated weights for policy 0, policy_version 1432949 (0.0010) [2023-12-26 11:02:07,526][123091] Updated weights for policy 0, policy_version 1432959 (0.0009) [2023-12-26 11:02:07,584][123091] Updated weights for policy 0, policy_version 1432969 (0.0010) [2023-12-26 11:02:07,841][123090] Updated weights for policy 1, policy_version 1423301 (0.0007) [2023-12-26 11:02:07,897][123090] Updated weights for policy 1, policy_version 1423311 (0.0005) [2023-12-26 11:02:07,947][123090] Updated weights for policy 1, policy_version 1423321 (0.0006) [2023-12-26 11:02:08,439][123091] Updated weights for policy 0, policy_version 1432979 (0.0009) [2023-12-26 11:02:08,496][123091] Updated weights for policy 0, policy_version 1432989 (0.0013) [2023-12-26 11:02:08,555][123091] Updated weights for policy 0, policy_version 1432999 (0.0010) [2023-12-26 11:02:08,692][123090] Updated weights for policy 1, policy_version 1423331 (0.0008) [2023-12-26 11:02:08,763][123090] Updated weights for policy 1, policy_version 1423341 (0.0007) [2023-12-26 11:02:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 731226112. Throughput: 0: 8841.0, 1: 8859.6. Samples: 731204948. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:08,785][121949] Avg episode reward: [(0, '6031.670'), (1, '5706.217')] [2023-12-26 11:02:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001433008_366854144.pth... [2023-12-26 11:02:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001431984_366592000.pth [2023-12-26 11:02:08,840][123090] Updated weights for policy 1, policy_version 1423351 (0.0006) [2023-12-26 11:02:08,902][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001423360_364380160.pth... [2023-12-26 11:02:08,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001422304_364109824.pth [2023-12-26 11:02:09,498][123091] Updated weights for policy 0, policy_version 1433009 (0.0009) [2023-12-26 11:02:09,563][123091] Updated weights for policy 0, policy_version 1433019 (0.0008) [2023-12-26 11:02:09,575][123090] Updated weights for policy 1, policy_version 1423361 (0.0006) [2023-12-26 11:02:09,623][123091] Updated weights for policy 0, policy_version 1433029 (0.0008) [2023-12-26 11:02:09,641][123090] Updated weights for policy 1, policy_version 1423371 (0.0008) [2023-12-26 11:02:09,677][123091] Updated weights for policy 0, policy_version 1433039 (0.0010) [2023-12-26 11:02:09,706][123090] Updated weights for policy 1, policy_version 1423381 (0.0009) [2023-12-26 11:02:09,777][123090] Updated weights for policy 1, policy_version 1423391 (0.0009) [2023-12-26 11:02:10,468][123091] Updated weights for policy 0, policy_version 1433049 (0.0010) [2023-12-26 11:02:10,535][123090] Updated weights for policy 1, policy_version 1423401 (0.0007) [2023-12-26 11:02:10,538][123091] Updated weights for policy 0, policy_version 1433059 (0.0008) [2023-12-26 11:02:10,603][123090] Updated weights for policy 1, policy_version 1423411 (0.0005) [2023-12-26 11:02:10,612][123091] Updated weights for policy 0, policy_version 1433069 (0.0007) [2023-12-26 11:02:10,662][123090] Updated weights for policy 1, policy_version 1423421 (0.0005) [2023-12-26 11:02:11,435][123091] Updated weights for policy 0, policy_version 1433079 (0.0009) [2023-12-26 11:02:11,453][123090] Updated weights for policy 1, policy_version 1423431 (0.0005) [2023-12-26 11:02:11,489][123091] Updated weights for policy 0, policy_version 1433089 (0.0008) [2023-12-26 11:02:11,512][123090] Updated weights for policy 1, policy_version 1423441 (0.0006) [2023-12-26 11:02:11,550][123091] Updated weights for policy 0, policy_version 1433099 (0.0009) [2023-12-26 11:02:11,566][123090] Updated weights for policy 1, policy_version 1423451 (0.0007) [2023-12-26 11:02:12,400][123090] Updated weights for policy 1, policy_version 1423461 (0.0008) [2023-12-26 11:02:12,433][123091] Updated weights for policy 0, policy_version 1433109 (0.0009) [2023-12-26 11:02:12,473][123090] Updated weights for policy 1, policy_version 1423471 (0.0009) [2023-12-26 11:02:12,491][123091] Updated weights for policy 0, policy_version 1433119 (0.0008) [2023-12-26 11:02:12,538][123090] Updated weights for policy 1, policy_version 1423481 (0.0009) [2023-12-26 11:02:12,554][123091] Updated weights for policy 0, policy_version 1433129 (0.0008) [2023-12-26 11:02:13,332][123091] Updated weights for policy 0, policy_version 1433139 (0.0009) [2023-12-26 11:02:13,362][123090] Updated weights for policy 1, policy_version 1423491 (0.0009) [2023-12-26 11:02:13,388][123091] Updated weights for policy 0, policy_version 1433149 (0.0009) [2023-12-26 11:02:13,429][123090] Updated weights for policy 1, policy_version 1423501 (0.0008) [2023-12-26 11:02:13,445][123091] Updated weights for policy 0, policy_version 1433159 (0.0006) [2023-12-26 11:02:13,482][123090] Updated weights for policy 1, policy_version 1423511 (0.0007) [2023-12-26 11:02:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 731316224. Throughput: 0: 8758.1, 1: 8914.4. Samples: 731306952. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:13,785][121949] Avg episode reward: [(0, '6126.203'), (1, '5745.842')] [2023-12-26 11:02:14,265][123091] Updated weights for policy 0, policy_version 1433169 (0.0008) [2023-12-26 11:02:14,312][123090] Updated weights for policy 1, policy_version 1423521 (0.0009) [2023-12-26 11:02:14,323][123091] Updated weights for policy 0, policy_version 1433179 (0.0005) [2023-12-26 11:02:14,367][123090] Updated weights for policy 1, policy_version 1423531 (0.0009) [2023-12-26 11:02:14,385][123091] Updated weights for policy 0, policy_version 1433189 (0.0005) [2023-12-26 11:02:14,429][123090] Updated weights for policy 1, policy_version 1423541 (0.0008) [2023-12-26 11:02:14,449][123091] Updated weights for policy 0, policy_version 1433199 (0.0008) [2023-12-26 11:02:14,484][123090] Updated weights for policy 1, policy_version 1423551 (0.0009) [2023-12-26 11:02:15,203][123091] Updated weights for policy 0, policy_version 1433209 (0.0009) [2023-12-26 11:02:15,265][123091] Updated weights for policy 0, policy_version 1433219 (0.0009) [2023-12-26 11:02:15,331][123091] Updated weights for policy 0, policy_version 1433229 (0.0009) [2023-12-26 11:02:15,384][123090] Updated weights for policy 1, policy_version 1423561 (0.0009) [2023-12-26 11:02:15,453][123090] Updated weights for policy 1, policy_version 1423571 (0.0010) [2023-12-26 11:02:15,515][123090] Updated weights for policy 1, policy_version 1423581 (0.0010) [2023-12-26 11:02:16,111][123091] Updated weights for policy 0, policy_version 1433239 (0.0006) [2023-12-26 11:02:16,173][123091] Updated weights for policy 0, policy_version 1433249 (0.0010) [2023-12-26 11:02:16,241][123091] Updated weights for policy 0, policy_version 1433259 (0.0009) [2023-12-26 11:02:16,374][123090] Updated weights for policy 1, policy_version 1423591 (0.0009) [2023-12-26 11:02:16,429][123090] Updated weights for policy 1, policy_version 1423602 (0.0010) [2023-12-26 11:02:16,478][123090] Updated weights for policy 1, policy_version 1423612 (0.0009) [2023-12-26 11:02:17,087][123091] Updated weights for policy 0, policy_version 1433269 (0.0009) [2023-12-26 11:02:17,154][123091] Updated weights for policy 0, policy_version 1433279 (0.0009) [2023-12-26 11:02:17,215][123091] Updated weights for policy 0, policy_version 1433289 (0.0009) [2023-12-26 11:02:17,307][123090] Updated weights for policy 1, policy_version 1423622 (0.0009) [2023-12-26 11:02:17,371][123090] Updated weights for policy 1, policy_version 1423632 (0.0008) [2023-12-26 11:02:17,438][123090] Updated weights for policy 1, policy_version 1423642 (0.0009) [2023-12-26 11:02:18,044][123091] Updated weights for policy 0, policy_version 1433299 (0.0010) [2023-12-26 11:02:18,107][123091] Updated weights for policy 0, policy_version 1433309 (0.0010) [2023-12-26 11:02:18,165][123091] Updated weights for policy 0, policy_version 1433319 (0.0009) [2023-12-26 11:02:18,257][123090] Updated weights for policy 1, policy_version 1423652 (0.0009) [2023-12-26 11:02:18,316][123090] Updated weights for policy 1, policy_version 1423662 (0.0009) [2023-12-26 11:02:18,381][123090] Updated weights for policy 1, policy_version 1423672 (0.0008) [2023-12-26 11:02:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 731398144. Throughput: 0: 8822.0, 1: 8850.7. Samples: 731410248. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:18,785][121949] Avg episode reward: [(0, '6139.696'), (1, '5882.956')] [2023-12-26 11:02:18,926][123091] Updated weights for policy 0, policy_version 1433329 (0.0008) [2023-12-26 11:02:18,999][123091] Updated weights for policy 0, policy_version 1433339 (0.0006) [2023-12-26 11:02:19,074][123091] Updated weights for policy 0, policy_version 1433349 (0.0005) [2023-12-26 11:02:19,129][123091] Updated weights for policy 0, policy_version 1433359 (0.0009) [2023-12-26 11:02:19,141][123090] Updated weights for policy 1, policy_version 1423682 (0.0009) [2023-12-26 11:02:19,196][123090] Updated weights for policy 1, policy_version 1423692 (0.0009) [2023-12-26 11:02:19,271][123090] Updated weights for policy 1, policy_version 1423702 (0.0010) [2023-12-26 11:02:19,341][123090] Updated weights for policy 1, policy_version 1423712 (0.0010) [2023-12-26 11:02:19,893][123091] Updated weights for policy 0, policy_version 1433369 (0.0009) [2023-12-26 11:02:19,960][123091] Updated weights for policy 0, policy_version 1433379 (0.0010) [2023-12-26 11:02:20,030][123091] Updated weights for policy 0, policy_version 1433389 (0.0010) [2023-12-26 11:02:20,207][123090] Updated weights for policy 1, policy_version 1423722 (0.0011) [2023-12-26 11:02:20,267][123090] Updated weights for policy 1, policy_version 1423732 (0.0010) [2023-12-26 11:02:20,338][123090] Updated weights for policy 1, policy_version 1423742 (0.0011) [2023-12-26 11:02:20,888][123091] Updated weights for policy 0, policy_version 1433399 (0.0009) [2023-12-26 11:02:20,957][123091] Updated weights for policy 0, policy_version 1433409 (0.0009) [2023-12-26 11:02:21,031][123091] Updated weights for policy 0, policy_version 1433419 (0.0009) [2023-12-26 11:02:21,175][123090] Updated weights for policy 1, policy_version 1423752 (0.0011) [2023-12-26 11:02:21,242][123090] Updated weights for policy 1, policy_version 1423762 (0.0010) [2023-12-26 11:02:21,309][123090] Updated weights for policy 1, policy_version 1423772 (0.0011) [2023-12-26 11:02:21,909][123091] Updated weights for policy 0, policy_version 1433429 (0.0007) [2023-12-26 11:02:21,980][123091] Updated weights for policy 0, policy_version 1433439 (0.0006) [2023-12-26 11:02:22,054][123091] Updated weights for policy 0, policy_version 1433449 (0.0006) [2023-12-26 11:02:22,138][123090] Updated weights for policy 1, policy_version 1423782 (0.0010) [2023-12-26 11:02:22,197][123090] Updated weights for policy 1, policy_version 1423792 (0.0010) [2023-12-26 11:02:22,263][123090] Updated weights for policy 1, policy_version 1423802 (0.0010) [2023-12-26 11:02:22,831][123091] Updated weights for policy 0, policy_version 1433459 (0.0008) [2023-12-26 11:02:22,891][123091] Updated weights for policy 0, policy_version 1433469 (0.0009) [2023-12-26 11:02:22,959][123091] Updated weights for policy 0, policy_version 1433479 (0.0009) [2023-12-26 11:02:23,027][123090] Updated weights for policy 1, policy_version 1423812 (0.0009) [2023-12-26 11:02:23,091][123090] Updated weights for policy 1, policy_version 1423822 (0.0008) [2023-12-26 11:02:23,160][123090] Updated weights for policy 1, policy_version 1423832 (0.0008) [2023-12-26 11:02:23,750][123091] Updated weights for policy 0, policy_version 1433489 (0.0009) [2023-12-26 11:02:23,784][121949] Fps is (10 sec: 16383.5, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 731480064. Throughput: 0: 8789.5, 1: 8821.0. Samples: 731461992. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:23,785][121949] Avg episode reward: [(0, '6254.022'), (1, '5933.581')] [2023-12-26 11:02:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001423840_364503040.pth... [2023-12-26 11:02:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001422816_364240896.pth [2023-12-26 11:02:23,810][123091] Updated weights for policy 0, policy_version 1433499 (0.0007) [2023-12-26 11:02:23,875][123091] Updated weights for policy 0, policy_version 1433509 (0.0008) [2023-12-26 11:02:23,927][123090] Updated weights for policy 1, policy_version 1423842 (0.0009) [2023-12-26 11:02:23,936][123091] Updated weights for policy 0, policy_version 1433519 (0.0008) [2023-12-26 11:02:23,941][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001433520_366985216.pth... [2023-12-26 11:02:23,946][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001432496_366723072.pth [2023-12-26 11:02:23,982][123090] Updated weights for policy 1, policy_version 1423852 (0.0010) [2023-12-26 11:02:24,030][123090] Updated weights for policy 1, policy_version 1423862 (0.0010) [2023-12-26 11:02:24,081][123090] Updated weights for policy 1, policy_version 1423872 (0.0010) [2023-12-26 11:02:24,699][123091] Updated weights for policy 0, policy_version 1433529 (0.0008) [2023-12-26 11:02:24,754][123091] Updated weights for policy 0, policy_version 1433539 (0.0008) [2023-12-26 11:02:24,805][123091] Updated weights for policy 0, policy_version 1433549 (0.0008) [2023-12-26 11:02:24,879][123090] Updated weights for policy 1, policy_version 1423882 (0.0010) [2023-12-26 11:02:24,931][123090] Updated weights for policy 1, policy_version 1423892 (0.0010) [2023-12-26 11:02:24,987][123090] Updated weights for policy 1, policy_version 1423902 (0.0010) [2023-12-26 11:02:25,617][123091] Updated weights for policy 0, policy_version 1433559 (0.0009) [2023-12-26 11:02:25,685][123091] Updated weights for policy 0, policy_version 1433569 (0.0008) [2023-12-26 11:02:25,728][123090] Updated weights for policy 1, policy_version 1423912 (0.0008) [2023-12-26 11:02:25,747][123091] Updated weights for policy 0, policy_version 1433579 (0.0008) [2023-12-26 11:02:25,791][123090] Updated weights for policy 1, policy_version 1423922 (0.0008) [2023-12-26 11:02:25,854][123090] Updated weights for policy 1, policy_version 1423932 (0.0010) [2023-12-26 11:02:26,332][123091] Updated weights for policy 0, policy_version 1433589 (0.0007) [2023-12-26 11:02:26,404][123091] Updated weights for policy 0, policy_version 1433599 (0.0010) [2023-12-26 11:02:26,474][123091] Updated weights for policy 0, policy_version 1433609 (0.0011) [2023-12-26 11:02:26,743][123090] Updated weights for policy 1, policy_version 1423942 (0.0010) [2023-12-26 11:02:26,811][123090] Updated weights for policy 1, policy_version 1423952 (0.0009) [2023-12-26 11:02:26,874][123090] Updated weights for policy 1, policy_version 1423962 (0.0009) [2023-12-26 11:02:27,092][123091] Updated weights for policy 0, policy_version 1433619 (0.0010) [2023-12-26 11:02:27,158][123091] Updated weights for policy 0, policy_version 1433629 (0.0007) [2023-12-26 11:02:27,214][123091] Updated weights for policy 0, policy_version 1433639 (0.0006) [2023-12-26 11:02:27,590][123090] Updated weights for policy 1, policy_version 1423972 (0.0007) [2023-12-26 11:02:27,648][123090] Updated weights for policy 1, policy_version 1423982 (0.0006) [2023-12-26 11:02:27,705][123090] Updated weights for policy 1, policy_version 1423992 (0.0010) [2023-12-26 11:02:27,896][123091] Updated weights for policy 0, policy_version 1433649 (0.0007) [2023-12-26 11:02:27,950][123091] Updated weights for policy 0, policy_version 1433659 (0.0006) [2023-12-26 11:02:28,005][123091] Updated weights for policy 0, policy_version 1433669 (0.0006) [2023-12-26 11:02:28,051][123091] Updated weights for policy 0, policy_version 1433679 (0.0005) [2023-12-26 11:02:28,363][123090] Updated weights for policy 1, policy_version 1424002 (0.0010) [2023-12-26 11:02:28,419][123090] Updated weights for policy 1, policy_version 1424012 (0.0009) [2023-12-26 11:02:28,467][123090] Updated weights for policy 1, policy_version 1424022 (0.0010) [2023-12-26 11:02:28,522][123090] Updated weights for policy 1, policy_version 1424032 (0.0010) [2023-12-26 11:02:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 731578368. Throughput: 0: 8835.1, 1: 8897.6. Samples: 731570908. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:28,785][121949] Avg episode reward: [(0, '6228.602'), (1, '5937.137')] [2023-12-26 11:02:28,814][123091] Updated weights for policy 0, policy_version 1433689 (0.0010) [2023-12-26 11:02:28,877][123091] Updated weights for policy 0, policy_version 1433699 (0.0010) [2023-12-26 11:02:28,940][123091] Updated weights for policy 0, policy_version 1433709 (0.0005) [2023-12-26 11:02:29,391][123090] Updated weights for policy 1, policy_version 1424042 (0.0011) [2023-12-26 11:02:29,448][123090] Updated weights for policy 1, policy_version 1424052 (0.0010) [2023-12-26 11:02:29,503][123090] Updated weights for policy 1, policy_version 1424062 (0.0010) [2023-12-26 11:02:29,624][123091] Updated weights for policy 0, policy_version 1433719 (0.0005) [2023-12-26 11:02:29,680][123091] Updated weights for policy 0, policy_version 1433729 (0.0005) [2023-12-26 11:02:29,741][123091] Updated weights for policy 0, policy_version 1433739 (0.0005) [2023-12-26 11:02:30,335][123090] Updated weights for policy 1, policy_version 1424072 (0.0007) [2023-12-26 11:02:30,389][123090] Updated weights for policy 1, policy_version 1424082 (0.0010) [2023-12-26 11:02:30,437][123090] Updated weights for policy 1, policy_version 1424092 (0.0010) [2023-12-26 11:02:30,459][123091] Updated weights for policy 0, policy_version 1433749 (0.0005) [2023-12-26 11:02:30,518][123091] Updated weights for policy 0, policy_version 1433759 (0.0008) [2023-12-26 11:02:30,578][123091] Updated weights for policy 0, policy_version 1433769 (0.0010) [2023-12-26 11:02:31,243][123090] Updated weights for policy 1, policy_version 1424102 (0.0010) [2023-12-26 11:02:31,297][123090] Updated weights for policy 1, policy_version 1424112 (0.0009) [2023-12-26 11:02:31,351][123090] Updated weights for policy 1, policy_version 1424122 (0.0009) [2023-12-26 11:02:31,430][123091] Updated weights for policy 0, policy_version 1433780 (0.0010) [2023-12-26 11:02:31,482][123091] Updated weights for policy 0, policy_version 1433790 (0.0010) [2023-12-26 11:02:31,532][123091] Updated weights for policy 0, policy_version 1433800 (0.0009) [2023-12-26 11:02:32,145][123090] Updated weights for policy 1, policy_version 1424132 (0.0008) [2023-12-26 11:02:32,212][123090] Updated weights for policy 1, policy_version 1424142 (0.0005) [2023-12-26 11:02:32,272][123090] Updated weights for policy 1, policy_version 1424152 (0.0006) [2023-12-26 11:02:32,375][123091] Updated weights for policy 0, policy_version 1433810 (0.0009) [2023-12-26 11:02:32,430][123091] Updated weights for policy 0, policy_version 1433820 (0.0009) [2023-12-26 11:02:32,495][123091] Updated weights for policy 0, policy_version 1433831 (0.0009) [2023-12-26 11:02:32,936][123090] Updated weights for policy 1, policy_version 1424162 (0.0007) [2023-12-26 11:02:32,981][123090] Updated weights for policy 1, policy_version 1424172 (0.0007) [2023-12-26 11:02:33,034][123090] Updated weights for policy 1, policy_version 1424182 (0.0010) [2023-12-26 11:02:33,085][123090] Updated weights for policy 1, policy_version 1424192 (0.0010) [2023-12-26 11:02:33,389][123091] Updated weights for policy 0, policy_version 1433841 (0.0010) [2023-12-26 11:02:33,445][123091] Updated weights for policy 0, policy_version 1433851 (0.0010) [2023-12-26 11:02:33,506][123091] Updated weights for policy 0, policy_version 1433861 (0.0010) [2023-12-26 11:02:33,569][123091] Updated weights for policy 0, policy_version 1433871 (0.0008) [2023-12-26 11:02:33,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 731668480. Throughput: 0: 8766.6, 1: 8920.6. Samples: 731680168. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:33,785][121949] Avg episode reward: [(0, '6180.221'), (1, '5866.681')] [2023-12-26 11:02:33,842][123090] Updated weights for policy 1, policy_version 1424202 (0.0005) [2023-12-26 11:02:33,900][123090] Updated weights for policy 1, policy_version 1424212 (0.0006) [2023-12-26 11:02:33,969][123090] Updated weights for policy 1, policy_version 1424222 (0.0010) [2023-12-26 11:02:34,267][123091] Updated weights for policy 0, policy_version 1433881 (0.0010) [2023-12-26 11:02:34,326][123091] Updated weights for policy 0, policy_version 1433891 (0.0010) [2023-12-26 11:02:34,392][123091] Updated weights for policy 0, policy_version 1433901 (0.0010) [2023-12-26 11:02:34,805][123090] Updated weights for policy 1, policy_version 1424232 (0.0010) [2023-12-26 11:02:34,874][123090] Updated weights for policy 1, policy_version 1424242 (0.0010) [2023-12-26 11:02:34,938][123090] Updated weights for policy 1, policy_version 1424252 (0.0009) [2023-12-26 11:02:35,092][123091] Updated weights for policy 0, policy_version 1433911 (0.0007) [2023-12-26 11:02:35,159][123091] Updated weights for policy 0, policy_version 1433921 (0.0005) [2023-12-26 11:02:35,219][123091] Updated weights for policy 0, policy_version 1433931 (0.0010) [2023-12-26 11:02:35,811][123091] Updated weights for policy 0, policy_version 1433941 (0.0008) [2023-12-26 11:02:35,837][123090] Updated weights for policy 1, policy_version 1424262 (0.0009) [2023-12-26 11:02:35,874][123091] Updated weights for policy 0, policy_version 1433951 (0.0008) [2023-12-26 11:02:35,902][123090] Updated weights for policy 1, policy_version 1424272 (0.0009) [2023-12-26 11:02:35,943][123091] Updated weights for policy 0, policy_version 1433961 (0.0011) [2023-12-26 11:02:35,967][123090] Updated weights for policy 1, policy_version 1424282 (0.0005) [2023-12-26 11:02:36,732][123091] Updated weights for policy 0, policy_version 1433971 (0.0010) [2023-12-26 11:02:36,790][123090] Updated weights for policy 1, policy_version 1424292 (0.0007) [2023-12-26 11:02:36,812][123091] Updated weights for policy 0, policy_version 1433981 (0.0009) [2023-12-26 11:02:36,861][123090] Updated weights for policy 1, policy_version 1424302 (0.0006) [2023-12-26 11:02:36,887][123091] Updated weights for policy 0, policy_version 1433991 (0.0009) [2023-12-26 11:02:36,934][123090] Updated weights for policy 1, policy_version 1424312 (0.0006) [2023-12-26 11:02:37,638][123091] Updated weights for policy 0, policy_version 1434001 (0.0008) [2023-12-26 11:02:37,670][123090] Updated weights for policy 1, policy_version 1424322 (0.0006) [2023-12-26 11:02:37,692][123091] Updated weights for policy 0, policy_version 1434011 (0.0007) [2023-12-26 11:02:37,724][123090] Updated weights for policy 1, policy_version 1424332 (0.0011) [2023-12-26 11:02:37,748][123091] Updated weights for policy 0, policy_version 1434021 (0.0011) [2023-12-26 11:02:37,783][123090] Updated weights for policy 1, policy_version 1424342 (0.0010) [2023-12-26 11:02:37,807][123091] Updated weights for policy 0, policy_version 1434031 (0.0010) [2023-12-26 11:02:37,847][123090] Updated weights for policy 1, policy_version 1424352 (0.0011) [2023-12-26 11:02:38,501][123091] Updated weights for policy 0, policy_version 1434041 (0.0008) [2023-12-26 11:02:38,565][123091] Updated weights for policy 0, policy_version 1434051 (0.0007) [2023-12-26 11:02:38,570][123090] Updated weights for policy 1, policy_version 1424362 (0.0006) [2023-12-26 11:02:38,623][123090] Updated weights for policy 1, policy_version 1424372 (0.0010) [2023-12-26 11:02:38,626][123091] Updated weights for policy 0, policy_version 1434061 (0.0007) [2023-12-26 11:02:38,689][123090] Updated weights for policy 1, policy_version 1424382 (0.0010) [2023-12-26 11:02:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 731766784. Throughput: 0: 8870.2, 1: 8879.1. Samples: 731735228. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:38,785][121949] Avg episode reward: [(0, '6262.262'), (1, '5768.815')] [2023-12-26 11:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001434064_367124480.pth... [2023-12-26 11:02:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001424384_364642304.pth... [2023-12-26 11:02:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001423360_364380160.pth [2023-12-26 11:02:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001433008_366854144.pth [2023-12-26 11:02:39,350][123091] Updated weights for policy 0, policy_version 1434071 (0.0009) [2023-12-26 11:02:39,433][123091] Updated weights for policy 0, policy_version 1434081 (0.0009) [2023-12-26 11:02:39,453][123090] Updated weights for policy 1, policy_version 1424392 (0.0009) [2023-12-26 11:02:39,500][123091] Updated weights for policy 0, policy_version 1434091 (0.0009) [2023-12-26 11:02:39,515][123090] Updated weights for policy 1, policy_version 1424402 (0.0009) [2023-12-26 11:02:39,580][123090] Updated weights for policy 1, policy_version 1424412 (0.0009) [2023-12-26 11:02:40,400][123090] Updated weights for policy 1, policy_version 1424422 (0.0010) [2023-12-26 11:02:40,420][123091] Updated weights for policy 0, policy_version 1434101 (0.0006) [2023-12-26 11:02:40,464][123090] Updated weights for policy 1, policy_version 1424432 (0.0011) [2023-12-26 11:02:40,476][123091] Updated weights for policy 0, policy_version 1434111 (0.0007) [2023-12-26 11:02:40,536][123090] Updated weights for policy 1, policy_version 1424442 (0.0010) [2023-12-26 11:02:40,537][123091] Updated weights for policy 0, policy_version 1434121 (0.0006) [2023-12-26 11:02:41,316][123091] Updated weights for policy 0, policy_version 1434131 (0.0007) [2023-12-26 11:02:41,359][123090] Updated weights for policy 1, policy_version 1424452 (0.0009) [2023-12-26 11:02:41,390][123091] Updated weights for policy 0, policy_version 1434141 (0.0009) [2023-12-26 11:02:41,430][123090] Updated weights for policy 1, policy_version 1424462 (0.0008) [2023-12-26 11:02:41,455][123091] Updated weights for policy 0, policy_version 1434151 (0.0009) [2023-12-26 11:02:41,492][123090] Updated weights for policy 1, policy_version 1424472 (0.0009) [2023-12-26 11:02:42,314][123090] Updated weights for policy 1, policy_version 1424482 (0.0010) [2023-12-26 11:02:42,327][123091] Updated weights for policy 0, policy_version 1434161 (0.0009) [2023-12-26 11:02:42,386][123090] Updated weights for policy 1, policy_version 1424492 (0.0009) [2023-12-26 11:02:42,398][123091] Updated weights for policy 0, policy_version 1434171 (0.0007) [2023-12-26 11:02:42,452][123091] Updated weights for policy 0, policy_version 1434181 (0.0010) [2023-12-26 11:02:42,452][123090] Updated weights for policy 1, policy_version 1424502 (0.0008) [2023-12-26 11:02:42,514][123091] Updated weights for policy 0, policy_version 1434191 (0.0010) [2023-12-26 11:02:42,520][123090] Updated weights for policy 1, policy_version 1424512 (0.0009) [2023-12-26 11:02:43,313][123090] Updated weights for policy 1, policy_version 1424522 (0.0009) [2023-12-26 11:02:43,360][123091] Updated weights for policy 0, policy_version 1434201 (0.0009) [2023-12-26 11:02:43,371][123090] Updated weights for policy 1, policy_version 1424532 (0.0009) [2023-12-26 11:02:43,417][123091] Updated weights for policy 0, policy_version 1434211 (0.0007) [2023-12-26 11:02:43,428][123090] Updated weights for policy 1, policy_version 1424542 (0.0009) [2023-12-26 11:02:43,481][123091] Updated weights for policy 0, policy_version 1434221 (0.0009) [2023-12-26 11:02:43,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17749.2, 300 sec: 17772.4). Total num frames: 731848704. Throughput: 0: 8870.9, 1: 8801.9. Samples: 731840416. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:43,785][121949] Avg episode reward: [(0, '6217.258'), (1, '5726.028')] [2023-12-26 11:02:44,194][123090] Updated weights for policy 1, policy_version 1424552 (0.0009) [2023-12-26 11:02:44,247][123090] Updated weights for policy 1, policy_version 1424562 (0.0009) [2023-12-26 11:02:44,302][123090] Updated weights for policy 1, policy_version 1424572 (0.0009) [2023-12-26 11:02:44,327][123091] Updated weights for policy 0, policy_version 1434231 (0.0008) [2023-12-26 11:02:44,378][123091] Updated weights for policy 0, policy_version 1434241 (0.0009) [2023-12-26 11:02:44,438][123091] Updated weights for policy 0, policy_version 1434252 (0.0009) [2023-12-26 11:02:45,130][123090] Updated weights for policy 1, policy_version 1424582 (0.0010) [2023-12-26 11:02:45,197][123090] Updated weights for policy 1, policy_version 1424592 (0.0009) [2023-12-26 11:02:45,267][123090] Updated weights for policy 1, policy_version 1424602 (0.0010) [2023-12-26 11:02:45,308][123091] Updated weights for policy 0, policy_version 1434262 (0.0008) [2023-12-26 11:02:45,367][123091] Updated weights for policy 0, policy_version 1434272 (0.0006) [2023-12-26 11:02:45,438][123091] Updated weights for policy 0, policy_version 1434282 (0.0006) [2023-12-26 11:02:46,125][123091] Updated weights for policy 0, policy_version 1434292 (0.0006) [2023-12-26 11:02:46,146][123090] Updated weights for policy 1, policy_version 1424612 (0.0009) [2023-12-26 11:02:46,181][123091] Updated weights for policy 0, policy_version 1434302 (0.0005) [2023-12-26 11:02:46,202][123090] Updated weights for policy 1, policy_version 1424622 (0.0010) [2023-12-26 11:02:46,238][123091] Updated weights for policy 0, policy_version 1434312 (0.0005) [2023-12-26 11:02:46,257][123090] Updated weights for policy 1, policy_version 1424632 (0.0010) [2023-12-26 11:02:46,952][123090] Updated weights for policy 1, policy_version 1424642 (0.0009) [2023-12-26 11:02:46,999][123090] Updated weights for policy 1, policy_version 1424652 (0.0005) [2023-12-26 11:02:47,039][123091] Updated weights for policy 0, policy_version 1434322 (0.0007) [2023-12-26 11:02:47,053][123090] Updated weights for policy 1, policy_version 1424662 (0.0005) [2023-12-26 11:02:47,107][123091] Updated weights for policy 0, policy_version 1434332 (0.0007) [2023-12-26 11:02:47,110][123090] Updated weights for policy 1, policy_version 1424672 (0.0010) [2023-12-26 11:02:47,162][123091] Updated weights for policy 0, policy_version 1434342 (0.0008) [2023-12-26 11:02:47,209][123091] Updated weights for policy 0, policy_version 1434352 (0.0008) [2023-12-26 11:02:47,823][123090] Updated weights for policy 1, policy_version 1424682 (0.0005) [2023-12-26 11:02:47,886][123090] Updated weights for policy 1, policy_version 1424692 (0.0005) [2023-12-26 11:02:47,942][123090] Updated weights for policy 1, policy_version 1424702 (0.0005) [2023-12-26 11:02:48,126][123091] Updated weights for policy 0, policy_version 1434362 (0.0010) [2023-12-26 11:02:48,184][123091] Updated weights for policy 0, policy_version 1434372 (0.0010) [2023-12-26 11:02:48,250][123091] Updated weights for policy 0, policy_version 1434382 (0.0010) [2023-12-26 11:02:48,572][123090] Updated weights for policy 1, policy_version 1424712 (0.0005) [2023-12-26 11:02:48,621][123090] Updated weights for policy 1, policy_version 1424722 (0.0005) [2023-12-26 11:02:48,668][123090] Updated weights for policy 1, policy_version 1424732 (0.0005) [2023-12-26 11:02:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 731938816. Throughput: 0: 8820.2, 1: 8847.2. Samples: 731947668. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:48,785][121949] Avg episode reward: [(0, '6268.782'), (1, '5806.156')] [2023-12-26 11:02:49,180][123091] Updated weights for policy 0, policy_version 1434392 (0.0009) [2023-12-26 11:02:49,247][123091] Updated weights for policy 0, policy_version 1434402 (0.0008) [2023-12-26 11:02:49,260][123090] Updated weights for policy 1, policy_version 1424742 (0.0007) [2023-12-26 11:02:49,310][123091] Updated weights for policy 0, policy_version 1434412 (0.0008) [2023-12-26 11:02:49,320][123090] Updated weights for policy 1, policy_version 1424752 (0.0007) [2023-12-26 11:02:49,396][123090] Updated weights for policy 1, policy_version 1424762 (0.0009) [2023-12-26 11:02:50,065][123091] Updated weights for policy 0, policy_version 1434422 (0.0008) [2023-12-26 11:02:50,114][123091] Updated weights for policy 0, policy_version 1434432 (0.0008) [2023-12-26 11:02:50,162][123091] Updated weights for policy 0, policy_version 1434442 (0.0008) [2023-12-26 11:02:50,224][123090] Updated weights for policy 1, policy_version 1424772 (0.0009) [2023-12-26 11:02:50,278][123090] Updated weights for policy 1, policy_version 1424782 (0.0010) [2023-12-26 11:02:50,341][123090] Updated weights for policy 1, policy_version 1424792 (0.0009) [2023-12-26 11:02:50,917][123091] Updated weights for policy 0, policy_version 1434452 (0.0009) [2023-12-26 11:02:50,980][123091] Updated weights for policy 0, policy_version 1434462 (0.0009) [2023-12-26 11:02:51,044][123091] Updated weights for policy 0, policy_version 1434472 (0.0010) [2023-12-26 11:02:51,135][123090] Updated weights for policy 1, policy_version 1424802 (0.0009) [2023-12-26 11:02:51,208][123090] Updated weights for policy 1, policy_version 1424812 (0.0009) [2023-12-26 11:02:51,268][123090] Updated weights for policy 1, policy_version 1424822 (0.0009) [2023-12-26 11:02:51,323][123090] Updated weights for policy 1, policy_version 1424832 (0.0009) [2023-12-26 11:02:51,904][123091] Updated weights for policy 0, policy_version 1434482 (0.0010) [2023-12-26 11:02:51,972][123091] Updated weights for policy 0, policy_version 1434492 (0.0010) [2023-12-26 11:02:52,039][123091] Updated weights for policy 0, policy_version 1434502 (0.0009) [2023-12-26 11:02:52,106][123091] Updated weights for policy 0, policy_version 1434512 (0.0010) [2023-12-26 11:02:52,201][123090] Updated weights for policy 1, policy_version 1424842 (0.0009) [2023-12-26 11:02:52,262][123090] Updated weights for policy 1, policy_version 1424852 (0.0010) [2023-12-26 11:02:52,319][123090] Updated weights for policy 1, policy_version 1424862 (0.0009) [2023-12-26 11:02:52,883][123091] Updated weights for policy 0, policy_version 1434522 (0.0009) [2023-12-26 11:02:52,937][123091] Updated weights for policy 0, policy_version 1434532 (0.0010) [2023-12-26 11:02:52,996][123091] Updated weights for policy 0, policy_version 1434542 (0.0009) [2023-12-26 11:02:53,192][123090] Updated weights for policy 1, policy_version 1424872 (0.0009) [2023-12-26 11:02:53,252][123090] Updated weights for policy 1, policy_version 1424882 (0.0009) [2023-12-26 11:02:53,315][123090] Updated weights for policy 1, policy_version 1424892 (0.0009) [2023-12-26 11:02:53,727][123091] Updated weights for policy 0, policy_version 1434552 (0.0006) [2023-12-26 11:02:53,777][123091] Updated weights for policy 0, policy_version 1434562 (0.0005) [2023-12-26 11:02:53,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 732020736. Throughput: 0: 8827.6, 1: 8850.8. Samples: 732000472. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:53,785][121949] Avg episode reward: [(0, '6312.239'), (1, '5865.318')] [2023-12-26 11:02:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001424896_364773376.pth... [2023-12-26 11:02:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001423840_364503040.pth [2023-12-26 11:02:53,844][123091] Updated weights for policy 0, policy_version 1434572 (0.0005) [2023-12-26 11:02:53,872][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001434576_367255552.pth... [2023-12-26 11:02:53,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001433520_366985216.pth [2023-12-26 11:02:53,995][123090] Updated weights for policy 1, policy_version 1424902 (0.0006) [2023-12-26 11:02:54,045][123090] Updated weights for policy 1, policy_version 1424912 (0.0005) [2023-12-26 11:02:54,106][123090] Updated weights for policy 1, policy_version 1424922 (0.0005) [2023-12-26 11:02:54,542][123091] Updated weights for policy 0, policy_version 1434582 (0.0007) [2023-12-26 11:02:54,598][123091] Updated weights for policy 0, policy_version 1434592 (0.0010) [2023-12-26 11:02:54,654][123091] Updated weights for policy 0, policy_version 1434602 (0.0010) [2023-12-26 11:02:54,787][123090] Updated weights for policy 1, policy_version 1424933 (0.0006) [2023-12-26 11:02:54,856][123090] Updated weights for policy 1, policy_version 1424943 (0.0010) [2023-12-26 11:02:54,915][123090] Updated weights for policy 1, policy_version 1424953 (0.0009) [2023-12-26 11:02:55,476][123091] Updated weights for policy 0, policy_version 1434612 (0.0008) [2023-12-26 11:02:55,530][123091] Updated weights for policy 0, policy_version 1434623 (0.0011) [2023-12-26 11:02:55,590][123091] Updated weights for policy 0, policy_version 1434634 (0.0010) [2023-12-26 11:02:55,652][123090] Updated weights for policy 1, policy_version 1424963 (0.0008) [2023-12-26 11:02:55,704][123090] Updated weights for policy 1, policy_version 1424973 (0.0007) [2023-12-26 11:02:55,767][123090] Updated weights for policy 1, policy_version 1424983 (0.0005) [2023-12-26 11:02:56,455][123091] Updated weights for policy 0, policy_version 1434644 (0.0010) [2023-12-26 11:02:56,464][123090] Updated weights for policy 1, policy_version 1424993 (0.0005) [2023-12-26 11:02:56,510][123091] Updated weights for policy 0, policy_version 1434654 (0.0011) [2023-12-26 11:02:56,534][123090] Updated weights for policy 1, policy_version 1425003 (0.0009) [2023-12-26 11:02:56,580][123091] Updated weights for policy 0, policy_version 1434664 (0.0011) [2023-12-26 11:02:56,595][123090] Updated weights for policy 1, policy_version 1425013 (0.0005) [2023-12-26 11:02:56,659][123090] Updated weights for policy 1, policy_version 1425023 (0.0005) [2023-12-26 11:02:57,266][123090] Updated weights for policy 1, policy_version 1425033 (0.0005) [2023-12-26 11:02:57,320][123091] Updated weights for policy 0, policy_version 1434674 (0.0010) [2023-12-26 11:02:57,327][123090] Updated weights for policy 1, policy_version 1425043 (0.0006) [2023-12-26 11:02:57,387][123091] Updated weights for policy 0, policy_version 1434684 (0.0006) [2023-12-26 11:02:57,390][123090] Updated weights for policy 1, policy_version 1425053 (0.0005) [2023-12-26 11:02:57,444][123091] Updated weights for policy 0, policy_version 1434694 (0.0005) [2023-12-26 11:02:57,500][123091] Updated weights for policy 0, policy_version 1434704 (0.0006) [2023-12-26 11:02:58,072][123090] Updated weights for policy 1, policy_version 1425063 (0.0007) [2023-12-26 11:02:58,140][123090] Updated weights for policy 1, policy_version 1425073 (0.0008) [2023-12-26 11:02:58,203][123090] Updated weights for policy 1, policy_version 1425083 (0.0008) [2023-12-26 11:02:58,209][123091] Updated weights for policy 0, policy_version 1434714 (0.0011) [2023-12-26 11:02:58,274][123091] Updated weights for policy 0, policy_version 1434724 (0.0009) [2023-12-26 11:02:58,341][123091] Updated weights for policy 0, policy_version 1434734 (0.0008) [2023-12-26 11:02:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 732119040. Throughput: 0: 8934.3, 1: 8978.0. Samples: 732113008. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:02:58,785][121949] Avg episode reward: [(0, '6293.736'), (1, '5850.568')] [2023-12-26 11:02:59,057][123090] Updated weights for policy 1, policy_version 1425093 (0.0008) [2023-12-26 11:02:59,125][123090] Updated weights for policy 1, policy_version 1425103 (0.0008) [2023-12-26 11:02:59,187][123090] Updated weights for policy 1, policy_version 1425113 (0.0008) [2023-12-26 11:02:59,188][123091] Updated weights for policy 0, policy_version 1434744 (0.0011) [2023-12-26 11:02:59,257][123091] Updated weights for policy 0, policy_version 1434754 (0.0010) [2023-12-26 11:02:59,333][123091] Updated weights for policy 0, policy_version 1434764 (0.0010) [2023-12-26 11:03:00,004][123090] Updated weights for policy 1, policy_version 1425123 (0.0009) [2023-12-26 11:03:00,065][123090] Updated weights for policy 1, policy_version 1425133 (0.0008) [2023-12-26 11:03:00,091][123091] Updated weights for policy 0, policy_version 1434774 (0.0009) [2023-12-26 11:03:00,125][123090] Updated weights for policy 1, policy_version 1425143 (0.0008) [2023-12-26 11:03:00,155][123091] Updated weights for policy 0, policy_version 1434784 (0.0009) [2023-12-26 11:03:00,214][123091] Updated weights for policy 0, policy_version 1434794 (0.0010) [2023-12-26 11:03:00,901][123090] Updated weights for policy 1, policy_version 1425153 (0.0007) [2023-12-26 11:03:00,901][123091] Updated weights for policy 0, policy_version 1434804 (0.0007) [2023-12-26 11:03:00,949][123091] Updated weights for policy 0, policy_version 1434814 (0.0005) [2023-12-26 11:03:00,958][123090] Updated weights for policy 1, policy_version 1425163 (0.0005) [2023-12-26 11:03:00,995][123091] Updated weights for policy 0, policy_version 1434824 (0.0005) [2023-12-26 11:03:01,019][123090] Updated weights for policy 1, policy_version 1425173 (0.0005) [2023-12-26 11:03:01,091][123090] Updated weights for policy 1, policy_version 1425183 (0.0008) [2023-12-26 11:03:01,722][123091] Updated weights for policy 0, policy_version 1434834 (0.0007) [2023-12-26 11:03:01,790][123091] Updated weights for policy 0, policy_version 1434844 (0.0007) [2023-12-26 11:03:01,834][123090] Updated weights for policy 1, policy_version 1425193 (0.0010) [2023-12-26 11:03:01,853][123091] Updated weights for policy 0, policy_version 1434854 (0.0007) [2023-12-26 11:03:01,898][123090] Updated weights for policy 1, policy_version 1425203 (0.0008) [2023-12-26 11:03:01,909][123091] Updated weights for policy 0, policy_version 1434864 (0.0008) [2023-12-26 11:03:01,953][123090] Updated weights for policy 1, policy_version 1425213 (0.0007) [2023-12-26 11:03:02,687][123091] Updated weights for policy 0, policy_version 1434874 (0.0008) [2023-12-26 11:03:02,742][123091] Updated weights for policy 0, policy_version 1434884 (0.0009) [2023-12-26 11:03:02,801][123091] Updated weights for policy 0, policy_version 1434894 (0.0009) [2023-12-26 11:03:02,809][123090] Updated weights for policy 1, policy_version 1425223 (0.0009) [2023-12-26 11:03:02,866][123090] Updated weights for policy 1, policy_version 1425233 (0.0010) [2023-12-26 11:03:02,922][123090] Updated weights for policy 1, policy_version 1425243 (0.0009) [2023-12-26 11:03:03,568][123091] Updated weights for policy 0, policy_version 1434904 (0.0009) [2023-12-26 11:03:03,624][123091] Updated weights for policy 0, policy_version 1434914 (0.0009) [2023-12-26 11:03:03,678][123091] Updated weights for policy 0, policy_version 1434924 (0.0009) [2023-12-26 11:03:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 732209152. Throughput: 0: 8980.1, 1: 9017.8. Samples: 732220152. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:03,784][121949] Avg episode reward: [(0, '6288.992'), (1, '5864.875')] [2023-12-26 11:03:03,790][123090] Updated weights for policy 1, policy_version 1425253 (0.0007) [2023-12-26 11:03:03,857][123090] Updated weights for policy 1, policy_version 1425263 (0.0007) [2023-12-26 11:03:03,921][123090] Updated weights for policy 1, policy_version 1425273 (0.0009) [2023-12-26 11:03:04,507][123091] Updated weights for policy 0, policy_version 1434935 (0.0008) [2023-12-26 11:03:04,573][123091] Updated weights for policy 0, policy_version 1434945 (0.0008) [2023-12-26 11:03:04,628][123091] Updated weights for policy 0, policy_version 1434955 (0.0010) [2023-12-26 11:03:04,689][123090] Updated weights for policy 1, policy_version 1425283 (0.0008) [2023-12-26 11:03:04,762][123090] Updated weights for policy 1, policy_version 1425293 (0.0005) [2023-12-26 11:03:04,826][123090] Updated weights for policy 1, policy_version 1425303 (0.0008) [2023-12-26 11:03:05,429][123091] Updated weights for policy 0, policy_version 1434965 (0.0008) [2023-12-26 11:03:05,474][123090] Updated weights for policy 1, policy_version 1425313 (0.0007) [2023-12-26 11:03:05,493][123091] Updated weights for policy 0, policy_version 1434975 (0.0007) [2023-12-26 11:03:05,543][123090] Updated weights for policy 1, policy_version 1425323 (0.0010) [2023-12-26 11:03:05,543][123091] Updated weights for policy 0, policy_version 1434985 (0.0006) [2023-12-26 11:03:05,615][123090] Updated weights for policy 1, policy_version 1425333 (0.0010) [2023-12-26 11:03:05,682][123090] Updated weights for policy 1, policy_version 1425343 (0.0005) [2023-12-26 11:03:06,269][123091] Updated weights for policy 0, policy_version 1434995 (0.0006) [2023-12-26 11:03:06,333][123091] Updated weights for policy 0, policy_version 1435005 (0.0006) [2023-12-26 11:03:06,401][123091] Updated weights for policy 0, policy_version 1435015 (0.0010) [2023-12-26 11:03:06,416][123090] Updated weights for policy 1, policy_version 1425353 (0.0007) [2023-12-26 11:03:06,474][123090] Updated weights for policy 1, policy_version 1425363 (0.0010) [2023-12-26 11:03:06,528][123090] Updated weights for policy 1, policy_version 1425373 (0.0011) [2023-12-26 11:03:07,149][123091] Updated weights for policy 0, policy_version 1435025 (0.0009) [2023-12-26 11:03:07,210][123091] Updated weights for policy 0, policy_version 1435035 (0.0009) [2023-12-26 11:03:07,273][123091] Updated weights for policy 0, policy_version 1435045 (0.0007) [2023-12-26 11:03:07,341][123091] Updated weights for policy 0, policy_version 1435055 (0.0005) [2023-12-26 11:03:07,389][123090] Updated weights for policy 1, policy_version 1425383 (0.0011) [2023-12-26 11:03:07,441][123090] Updated weights for policy 1, policy_version 1425393 (0.0011) [2023-12-26 11:03:07,513][123090] Updated weights for policy 1, policy_version 1425403 (0.0011) [2023-12-26 11:03:07,963][123091] Updated weights for policy 0, policy_version 1435065 (0.0005) [2023-12-26 11:03:08,026][123091] Updated weights for policy 0, policy_version 1435075 (0.0005) [2023-12-26 11:03:08,091][123091] Updated weights for policy 0, policy_version 1435085 (0.0005) [2023-12-26 11:03:08,349][123090] Updated weights for policy 1, policy_version 1425413 (0.0011) [2023-12-26 11:03:08,416][123090] Updated weights for policy 1, policy_version 1425423 (0.0009) [2023-12-26 11:03:08,492][123090] Updated weights for policy 1, policy_version 1425433 (0.0006) [2023-12-26 11:03:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 732299264. Throughput: 0: 9010.8, 1: 9062.0. Samples: 732275264. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:08,785][121949] Avg episode reward: [(0, '6279.058'), (1, '5897.560')] [2023-12-26 11:03:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001435088_367386624.pth... [2023-12-26 11:03:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001425440_364912640.pth... [2023-12-26 11:03:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001424384_364642304.pth [2023-12-26 11:03:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001434064_367124480.pth [2023-12-26 11:03:08,909][123091] Updated weights for policy 0, policy_version 1435095 (0.0008) [2023-12-26 11:03:08,969][123091] Updated weights for policy 0, policy_version 1435105 (0.0009) [2023-12-26 11:03:09,032][123091] Updated weights for policy 0, policy_version 1435115 (0.0010) [2023-12-26 11:03:09,223][123090] Updated weights for policy 1, policy_version 1425443 (0.0008) [2023-12-26 11:03:09,289][123090] Updated weights for policy 1, policy_version 1425453 (0.0011) [2023-12-26 11:03:09,354][123090] Updated weights for policy 1, policy_version 1425463 (0.0011) [2023-12-26 11:03:09,845][123091] Updated weights for policy 0, policy_version 1435125 (0.0009) [2023-12-26 11:03:09,914][123091] Updated weights for policy 0, policy_version 1435135 (0.0006) [2023-12-26 11:03:09,981][123091] Updated weights for policy 0, policy_version 1435145 (0.0008) [2023-12-26 11:03:10,144][123090] Updated weights for policy 1, policy_version 1425473 (0.0009) [2023-12-26 11:03:10,213][123090] Updated weights for policy 1, policy_version 1425483 (0.0011) [2023-12-26 11:03:10,281][123090] Updated weights for policy 1, policy_version 1425493 (0.0011) [2023-12-26 11:03:10,349][123090] Updated weights for policy 1, policy_version 1425503 (0.0011) [2023-12-26 11:03:10,829][123091] Updated weights for policy 0, policy_version 1435155 (0.0009) [2023-12-26 11:03:10,883][123091] Updated weights for policy 0, policy_version 1435165 (0.0009) [2023-12-26 11:03:10,934][123091] Updated weights for policy 0, policy_version 1435175 (0.0009) [2023-12-26 11:03:10,978][123090] Updated weights for policy 1, policy_version 1425513 (0.0006) [2023-12-26 11:03:11,052][123090] Updated weights for policy 1, policy_version 1425523 (0.0010) [2023-12-26 11:03:11,125][123090] Updated weights for policy 1, policy_version 1425533 (0.0010) [2023-12-26 11:03:11,868][123091] Updated weights for policy 0, policy_version 1435185 (0.0009) [2023-12-26 11:03:11,888][123090] Updated weights for policy 1, policy_version 1425543 (0.0010) [2023-12-26 11:03:11,925][123091] Updated weights for policy 0, policy_version 1435195 (0.0005) [2023-12-26 11:03:11,956][123090] Updated weights for policy 1, policy_version 1425553 (0.0011) [2023-12-26 11:03:11,985][123091] Updated weights for policy 0, policy_version 1435205 (0.0008) [2023-12-26 11:03:12,026][123090] Updated weights for policy 1, policy_version 1425563 (0.0006) [2023-12-26 11:03:12,046][123091] Updated weights for policy 0, policy_version 1435215 (0.0009) [2023-12-26 11:03:12,815][123090] Updated weights for policy 1, policy_version 1425573 (0.0007) [2023-12-26 11:03:12,878][123090] Updated weights for policy 1, policy_version 1425583 (0.0007) [2023-12-26 11:03:12,883][123091] Updated weights for policy 0, policy_version 1435225 (0.0007) [2023-12-26 11:03:12,947][123090] Updated weights for policy 1, policy_version 1425593 (0.0007) [2023-12-26 11:03:12,947][123091] Updated weights for policy 0, policy_version 1435235 (0.0009) [2023-12-26 11:03:13,012][123091] Updated weights for policy 0, policy_version 1435245 (0.0010) [2023-12-26 11:03:13,714][123090] Updated weights for policy 1, policy_version 1425603 (0.0011) [2023-12-26 11:03:13,772][123090] Updated weights for policy 1, policy_version 1425613 (0.0010) [2023-12-26 11:03:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 732381184. Throughput: 0: 8946.4, 1: 9068.6. Samples: 732381584. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:13,785][121949] Avg episode reward: [(0, '6246.491'), (1, '5753.853')] [2023-12-26 11:03:13,815][123091] Updated weights for policy 0, policy_version 1435255 (0.0007) [2023-12-26 11:03:13,821][123090] Updated weights for policy 1, policy_version 1425623 (0.0010) [2023-12-26 11:03:13,870][123091] Updated weights for policy 0, policy_version 1435265 (0.0005) [2023-12-26 11:03:13,917][123091] Updated weights for policy 0, policy_version 1435275 (0.0008) [2023-12-26 11:03:14,476][123090] Updated weights for policy 1, policy_version 1425633 (0.0010) [2023-12-26 11:03:14,548][123090] Updated weights for policy 1, policy_version 1425643 (0.0006) [2023-12-26 11:03:14,616][123090] Updated weights for policy 1, policy_version 1425653 (0.0005) [2023-12-26 11:03:14,671][123090] Updated weights for policy 1, policy_version 1425663 (0.0005) [2023-12-26 11:03:14,793][123091] Updated weights for policy 0, policy_version 1435285 (0.0009) [2023-12-26 11:03:14,861][123091] Updated weights for policy 0, policy_version 1435295 (0.0009) [2023-12-26 11:03:14,923][123091] Updated weights for policy 0, policy_version 1435305 (0.0010) [2023-12-26 11:03:15,439][123090] Updated weights for policy 1, policy_version 1425673 (0.0009) [2023-12-26 11:03:15,494][123090] Updated weights for policy 1, policy_version 1425683 (0.0010) [2023-12-26 11:03:15,552][123090] Updated weights for policy 1, policy_version 1425693 (0.0009) [2023-12-26 11:03:15,816][123091] Updated weights for policy 0, policy_version 1435315 (0.0009) [2023-12-26 11:03:15,879][123091] Updated weights for policy 0, policy_version 1435325 (0.0010) [2023-12-26 11:03:15,931][123091] Updated weights for policy 0, policy_version 1435335 (0.0009) [2023-12-26 11:03:16,358][123090] Updated weights for policy 1, policy_version 1425703 (0.0009) [2023-12-26 11:03:16,412][123090] Updated weights for policy 1, policy_version 1425713 (0.0010) [2023-12-26 11:03:16,476][123090] Updated weights for policy 1, policy_version 1425723 (0.0009) [2023-12-26 11:03:16,751][123091] Updated weights for policy 0, policy_version 1435345 (0.0010) [2023-12-26 11:03:16,806][123091] Updated weights for policy 0, policy_version 1435355 (0.0009) [2023-12-26 11:03:16,857][123091] Updated weights for policy 0, policy_version 1435365 (0.0009) [2023-12-26 11:03:16,911][123091] Updated weights for policy 0, policy_version 1435375 (0.0010) [2023-12-26 11:03:17,271][123090] Updated weights for policy 1, policy_version 1425733 (0.0008) [2023-12-26 11:03:17,332][123090] Updated weights for policy 1, policy_version 1425743 (0.0008) [2023-12-26 11:03:17,401][123090] Updated weights for policy 1, policy_version 1425753 (0.0008) [2023-12-26 11:03:17,837][123091] Updated weights for policy 0, policy_version 1435385 (0.0009) [2023-12-26 11:03:17,900][123091] Updated weights for policy 0, policy_version 1435395 (0.0009) [2023-12-26 11:03:17,967][123091] Updated weights for policy 0, policy_version 1435405 (0.0009) [2023-12-26 11:03:18,046][123090] Updated weights for policy 1, policy_version 1425763 (0.0007) [2023-12-26 11:03:18,113][123090] Updated weights for policy 1, policy_version 1425773 (0.0006) [2023-12-26 11:03:18,182][123090] Updated weights for policy 1, policy_version 1425783 (0.0008) [2023-12-26 11:03:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 732471296. Throughput: 0: 8832.5, 1: 9100.2. Samples: 732487140. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:18,785][121949] Avg episode reward: [(0, '6264.559'), (1, '5713.017')] [2023-12-26 11:03:18,865][123091] Updated weights for policy 0, policy_version 1435415 (0.0008) [2023-12-26 11:03:18,883][123090] Updated weights for policy 1, policy_version 1425793 (0.0009) [2023-12-26 11:03:18,929][123091] Updated weights for policy 0, policy_version 1435425 (0.0007) [2023-12-26 11:03:18,951][123090] Updated weights for policy 1, policy_version 1425803 (0.0010) [2023-12-26 11:03:18,991][123091] Updated weights for policy 0, policy_version 1435435 (0.0007) [2023-12-26 11:03:19,011][123090] Updated weights for policy 1, policy_version 1425813 (0.0010) [2023-12-26 11:03:19,070][123090] Updated weights for policy 1, policy_version 1425823 (0.0010) [2023-12-26 11:03:19,803][123091] Updated weights for policy 0, policy_version 1435445 (0.0007) [2023-12-26 11:03:19,876][123091] Updated weights for policy 0, policy_version 1435455 (0.0008) [2023-12-26 11:03:19,876][123090] Updated weights for policy 1, policy_version 1425833 (0.0009) [2023-12-26 11:03:19,947][123091] Updated weights for policy 0, policy_version 1435465 (0.0008) [2023-12-26 11:03:19,949][123090] Updated weights for policy 1, policy_version 1425843 (0.0009) [2023-12-26 11:03:20,017][123090] Updated weights for policy 1, policy_version 1425853 (0.0009) [2023-12-26 11:03:20,667][123091] Updated weights for policy 0, policy_version 1435475 (0.0006) [2023-12-26 11:03:20,722][123091] Updated weights for policy 0, policy_version 1435485 (0.0008) [2023-12-26 11:03:20,790][123091] Updated weights for policy 0, policy_version 1435495 (0.0010) [2023-12-26 11:03:20,885][123090] Updated weights for policy 1, policy_version 1425863 (0.0009) [2023-12-26 11:03:20,938][123090] Updated weights for policy 1, policy_version 1425873 (0.0009) [2023-12-26 11:03:20,988][123090] Updated weights for policy 1, policy_version 1425883 (0.0010) [2023-12-26 11:03:21,620][123091] Updated weights for policy 0, policy_version 1435505 (0.0009) [2023-12-26 11:03:21,693][123091] Updated weights for policy 0, policy_version 1435515 (0.0008) [2023-12-26 11:03:21,763][123091] Updated weights for policy 0, policy_version 1435525 (0.0010) [2023-12-26 11:03:21,822][123091] Updated weights for policy 0, policy_version 1435535 (0.0011) [2023-12-26 11:03:21,868][123090] Updated weights for policy 1, policy_version 1425893 (0.0009) [2023-12-26 11:03:21,926][123090] Updated weights for policy 1, policy_version 1425903 (0.0009) [2023-12-26 11:03:21,988][123090] Updated weights for policy 1, policy_version 1425913 (0.0010) [2023-12-26 11:03:22,587][123091] Updated weights for policy 0, policy_version 1435545 (0.0011) [2023-12-26 11:03:22,647][123091] Updated weights for policy 0, policy_version 1435555 (0.0011) [2023-12-26 11:03:22,715][123091] Updated weights for policy 0, policy_version 1435565 (0.0011) [2023-12-26 11:03:22,871][123090] Updated weights for policy 1, policy_version 1425923 (0.0010) [2023-12-26 11:03:22,935][123090] Updated weights for policy 1, policy_version 1425933 (0.0009) [2023-12-26 11:03:23,002][123090] Updated weights for policy 1, policy_version 1425943 (0.0010) [2023-12-26 11:03:23,456][123091] Updated weights for policy 0, policy_version 1435575 (0.0010) [2023-12-26 11:03:23,516][123091] Updated weights for policy 0, policy_version 1435585 (0.0011) [2023-12-26 11:03:23,572][123091] Updated weights for policy 0, policy_version 1435595 (0.0009) [2023-12-26 11:03:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 732561408. Throughput: 0: 8755.8, 1: 9096.2. Samples: 732538568. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:23,785][121949] Avg episode reward: [(0, '6261.389'), (1, '5688.729')] [2023-12-26 11:03:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001435600_367517696.pth... [2023-12-26 11:03:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001425952_365043712.pth... [2023-12-26 11:03:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001434576_367255552.pth [2023-12-26 11:03:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001424896_364773376.pth [2023-12-26 11:03:23,857][123090] Updated weights for policy 1, policy_version 1425953 (0.0009) [2023-12-26 11:03:23,920][123090] Updated weights for policy 1, policy_version 1425963 (0.0007) [2023-12-26 11:03:23,985][123090] Updated weights for policy 1, policy_version 1425973 (0.0009) [2023-12-26 11:03:24,072][123090] Updated weights for policy 1, policy_version 1425983 (0.0009) [2023-12-26 11:03:24,328][123091] Updated weights for policy 0, policy_version 1435605 (0.0005) [2023-12-26 11:03:24,374][123091] Updated weights for policy 0, policy_version 1435615 (0.0009) [2023-12-26 11:03:24,424][123091] Updated weights for policy 0, policy_version 1435625 (0.0008) [2023-12-26 11:03:24,845][123090] Updated weights for policy 1, policy_version 1425993 (0.0010) [2023-12-26 11:03:24,904][123090] Updated weights for policy 1, policy_version 1426003 (0.0010) [2023-12-26 11:03:24,955][123090] Updated weights for policy 1, policy_version 1426013 (0.0010) [2023-12-26 11:03:25,124][123091] Updated weights for policy 0, policy_version 1435635 (0.0005) [2023-12-26 11:03:25,193][123091] Updated weights for policy 0, policy_version 1435645 (0.0005) [2023-12-26 11:03:25,259][123091] Updated weights for policy 0, policy_version 1435655 (0.0005) [2023-12-26 11:03:25,807][123090] Updated weights for policy 1, policy_version 1426023 (0.0010) [2023-12-26 11:03:25,870][123090] Updated weights for policy 1, policy_version 1426033 (0.0010) [2023-12-26 11:03:25,933][123090] Updated weights for policy 1, policy_version 1426043 (0.0010) [2023-12-26 11:03:26,038][123091] Updated weights for policy 0, policy_version 1435665 (0.0009) [2023-12-26 11:03:26,091][123091] Updated weights for policy 0, policy_version 1435675 (0.0009) [2023-12-26 11:03:26,149][123091] Updated weights for policy 0, policy_version 1435685 (0.0006) [2023-12-26 11:03:26,209][123091] Updated weights for policy 0, policy_version 1435695 (0.0006) [2023-12-26 11:03:26,649][123090] Updated weights for policy 1, policy_version 1426053 (0.0010) [2023-12-26 11:03:26,701][123090] Updated weights for policy 1, policy_version 1426063 (0.0010) [2023-12-26 11:03:26,753][123090] Updated weights for policy 1, policy_version 1426073 (0.0005) [2023-12-26 11:03:26,882][123091] Updated weights for policy 0, policy_version 1435705 (0.0010) [2023-12-26 11:03:26,965][123091] Updated weights for policy 0, policy_version 1435715 (0.0010) [2023-12-26 11:03:27,024][123091] Updated weights for policy 0, policy_version 1435725 (0.0010) [2023-12-26 11:03:27,484][123090] Updated weights for policy 1, policy_version 1426083 (0.0007) [2023-12-26 11:03:27,538][123090] Updated weights for policy 1, policy_version 1426093 (0.0010) [2023-12-26 11:03:27,585][123090] Updated weights for policy 1, policy_version 1426103 (0.0010) [2023-12-26 11:03:27,819][123091] Updated weights for policy 0, policy_version 1435735 (0.0007) [2023-12-26 11:03:27,878][123091] Updated weights for policy 0, policy_version 1435745 (0.0005) [2023-12-26 11:03:27,930][123091] Updated weights for policy 0, policy_version 1435755 (0.0005) [2023-12-26 11:03:28,288][123090] Updated weights for policy 1, policy_version 1426113 (0.0008) [2023-12-26 11:03:28,357][123090] Updated weights for policy 1, policy_version 1426123 (0.0007) [2023-12-26 11:03:28,433][123090] Updated weights for policy 1, policy_version 1426133 (0.0006) [2023-12-26 11:03:28,497][123090] Updated weights for policy 1, policy_version 1426143 (0.0007) [2023-12-26 11:03:28,545][123091] Updated weights for policy 0, policy_version 1435765 (0.0005) [2023-12-26 11:03:28,603][123091] Updated weights for policy 0, policy_version 1435775 (0.0005) [2023-12-26 11:03:28,657][123091] Updated weights for policy 0, policy_version 1435785 (0.0010) [2023-12-26 11:03:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 732659712. Throughput: 0: 8852.6, 1: 9078.3. Samples: 732647300. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:28,785][121949] Avg episode reward: [(0, '6162.978'), (1, '5719.361')] [2023-12-26 11:03:29,147][123090] Updated weights for policy 1, policy_version 1426153 (0.0005) [2023-12-26 11:03:29,215][123090] Updated weights for policy 1, policy_version 1426163 (0.0005) [2023-12-26 11:03:29,287][123090] Updated weights for policy 1, policy_version 1426173 (0.0007) [2023-12-26 11:03:29,497][123091] Updated weights for policy 0, policy_version 1435795 (0.0011) [2023-12-26 11:03:29,557][123091] Updated weights for policy 0, policy_version 1435805 (0.0011) [2023-12-26 11:03:29,616][123091] Updated weights for policy 0, policy_version 1435815 (0.0011) [2023-12-26 11:03:29,979][123090] Updated weights for policy 1, policy_version 1426183 (0.0009) [2023-12-26 11:03:30,042][123090] Updated weights for policy 1, policy_version 1426193 (0.0011) [2023-12-26 11:03:30,109][123090] Updated weights for policy 1, policy_version 1426203 (0.0010) [2023-12-26 11:03:30,419][123091] Updated weights for policy 0, policy_version 1435825 (0.0010) [2023-12-26 11:03:30,491][123091] Updated weights for policy 0, policy_version 1435835 (0.0005) [2023-12-26 11:03:30,541][123091] Updated weights for policy 0, policy_version 1435845 (0.0005) [2023-12-26 11:03:30,588][123091] Updated weights for policy 0, policy_version 1435855 (0.0009) [2023-12-26 11:03:30,827][123090] Updated weights for policy 1, policy_version 1426213 (0.0010) [2023-12-26 11:03:30,880][123090] Updated weights for policy 1, policy_version 1426224 (0.0010) [2023-12-26 11:03:30,934][123090] Updated weights for policy 1, policy_version 1426235 (0.0010) [2023-12-26 11:03:31,229][123091] Updated weights for policy 0, policy_version 1435865 (0.0006) [2023-12-26 11:03:31,300][123091] Updated weights for policy 0, policy_version 1435875 (0.0009) [2023-12-26 11:03:31,372][123091] Updated weights for policy 0, policy_version 1435885 (0.0010) [2023-12-26 11:03:31,870][123090] Updated weights for policy 1, policy_version 1426246 (0.0010) [2023-12-26 11:03:31,931][123090] Updated weights for policy 1, policy_version 1426256 (0.0009) [2023-12-26 11:03:31,987][123090] Updated weights for policy 1, policy_version 1426266 (0.0008) [2023-12-26 11:03:32,181][123091] Updated weights for policy 0, policy_version 1435895 (0.0011) [2023-12-26 11:03:32,235][123091] Updated weights for policy 0, policy_version 1435905 (0.0010) [2023-12-26 11:03:32,314][123091] Updated weights for policy 0, policy_version 1435915 (0.0010) [2023-12-26 11:03:32,850][123090] Updated weights for policy 1, policy_version 1426276 (0.0009) [2023-12-26 11:03:32,917][123090] Updated weights for policy 1, policy_version 1426286 (0.0008) [2023-12-26 11:03:32,969][123090] Updated weights for policy 1, policy_version 1426296 (0.0009) [2023-12-26 11:03:33,111][123091] Updated weights for policy 0, policy_version 1435925 (0.0011) [2023-12-26 11:03:33,158][123091] Updated weights for policy 0, policy_version 1435935 (0.0010) [2023-12-26 11:03:33,204][123091] Updated weights for policy 0, policy_version 1435945 (0.0010) [2023-12-26 11:03:33,734][123090] Updated weights for policy 1, policy_version 1426306 (0.0008) [2023-12-26 11:03:33,782][123090] Updated weights for policy 1, policy_version 1426316 (0.0005) [2023-12-26 11:03:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 732741632. Throughput: 0: 8924.6, 1: 9059.2. Samples: 732756940. Policy #0 lag: (min: 31.0, avg: 39.5, max: 63.0) [2023-12-26 11:03:33,785][121949] Avg episode reward: [(0, '6179.115'), (1, '5857.811')] [2023-12-26 11:03:33,830][123090] Updated weights for policy 1, policy_version 1426326 (0.0005) [2023-12-26 11:03:33,882][123090] Updated weights for policy 1, policy_version 1426336 (0.0006) [2023-12-26 11:03:33,975][123091] Updated weights for policy 0, policy_version 1435955 (0.0009) [2023-12-26 11:03:34,032][123091] Updated weights for policy 0, policy_version 1435965 (0.0008) [2023-12-26 11:03:34,086][123091] Updated weights for policy 0, policy_version 1435975 (0.0010) [2023-12-26 11:03:34,657][123090] Updated weights for policy 1, policy_version 1426346 (0.0009) [2023-12-26 11:03:34,722][123090] Updated weights for policy 1, policy_version 1426356 (0.0009) [2023-12-26 11:03:34,795][123090] Updated weights for policy 1, policy_version 1426366 (0.0005) [2023-12-26 11:03:34,927][123091] Updated weights for policy 0, policy_version 1435985 (0.0011) [2023-12-26 11:03:34,994][123091] Updated weights for policy 0, policy_version 1435995 (0.0010) [2023-12-26 11:03:35,057][123091] Updated weights for policy 0, policy_version 1436005 (0.0010) [2023-12-26 11:03:35,113][123091] Updated weights for policy 0, policy_version 1436015 (0.0008) [2023-12-26 11:03:35,622][123090] Updated weights for policy 1, policy_version 1426376 (0.0009) [2023-12-26 11:03:35,676][123090] Updated weights for policy 1, policy_version 1426386 (0.0010) [2023-12-26 11:03:35,729][123090] Updated weights for policy 1, policy_version 1426398 (0.0010) [2023-12-26 11:03:35,769][123091] Updated weights for policy 0, policy_version 1436025 (0.0005) [2023-12-26 11:03:35,825][123091] Updated weights for policy 0, policy_version 1436035 (0.0005) [2023-12-26 11:03:35,872][123091] Updated weights for policy 0, policy_version 1436045 (0.0005) [2023-12-26 11:03:36,505][123091] Updated weights for policy 0, policy_version 1436055 (0.0006) [2023-12-26 11:03:36,546][123090] Updated weights for policy 1, policy_version 1426408 (0.0009) [2023-12-26 11:03:36,563][123091] Updated weights for policy 0, policy_version 1436065 (0.0008) [2023-12-26 11:03:36,616][123090] Updated weights for policy 1, policy_version 1426418 (0.0006) [2023-12-26 11:03:36,635][123091] Updated weights for policy 0, policy_version 1436075 (0.0006) [2023-12-26 11:03:36,684][123090] Updated weights for policy 1, policy_version 1426428 (0.0009) [2023-12-26 11:03:37,445][123091] Updated weights for policy 0, policy_version 1436085 (0.0010) [2023-12-26 11:03:37,508][123091] Updated weights for policy 0, policy_version 1436095 (0.0011) [2023-12-26 11:03:37,511][123090] Updated weights for policy 1, policy_version 1426438 (0.0008) [2023-12-26 11:03:37,562][123090] Updated weights for policy 1, policy_version 1426448 (0.0010) [2023-12-26 11:03:37,568][123091] Updated weights for policy 0, policy_version 1436105 (0.0010) [2023-12-26 11:03:37,615][123090] Updated weights for policy 1, policy_version 1426458 (0.0006) [2023-12-26 11:03:38,361][123090] Updated weights for policy 1, policy_version 1426468 (0.0007) [2023-12-26 11:03:38,413][123091] Updated weights for policy 0, policy_version 1436115 (0.0010) [2023-12-26 11:03:38,418][123090] Updated weights for policy 1, policy_version 1426478 (0.0006) [2023-12-26 11:03:38,467][123091] Updated weights for policy 0, policy_version 1436125 (0.0009) [2023-12-26 11:03:38,481][123090] Updated weights for policy 1, policy_version 1426488 (0.0008) [2023-12-26 11:03:38,527][123091] Updated weights for policy 0, policy_version 1436135 (0.0008) [2023-12-26 11:03:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 732839936. Throughput: 0: 8995.5, 1: 9059.7. Samples: 732812956. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:03:38,785][121949] Avg episode reward: [(0, '6244.436'), (1, '5759.483')] [2023-12-26 11:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001436144_367656960.pth... [2023-12-26 11:03:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001426496_365182976.pth... [2023-12-26 11:03:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001435088_367386624.pth [2023-12-26 11:03:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001425440_364912640.pth [2023-12-26 11:03:39,105][123090] Updated weights for policy 1, policy_version 1426498 (0.0010) [2023-12-26 11:03:39,163][123090] Updated weights for policy 1, policy_version 1426508 (0.0010) [2023-12-26 11:03:39,217][123090] Updated weights for policy 1, policy_version 1426518 (0.0008) [2023-12-26 11:03:39,286][123090] Updated weights for policy 1, policy_version 1426528 (0.0009) [2023-12-26 11:03:39,480][123091] Updated weights for policy 0, policy_version 1436145 (0.0009) [2023-12-26 11:03:39,552][123091] Updated weights for policy 0, policy_version 1436155 (0.0008) [2023-12-26 11:03:39,621][123091] Updated weights for policy 0, policy_version 1436165 (0.0008) [2023-12-26 11:03:39,690][123091] Updated weights for policy 0, policy_version 1436175 (0.0007) [2023-12-26 11:03:40,117][123090] Updated weights for policy 1, policy_version 1426538 (0.0011) [2023-12-26 11:03:40,186][123090] Updated weights for policy 1, policy_version 1426548 (0.0011) [2023-12-26 11:03:40,243][123090] Updated weights for policy 1, policy_version 1426558 (0.0011) [2023-12-26 11:03:40,487][123091] Updated weights for policy 0, policy_version 1436185 (0.0007) [2023-12-26 11:03:40,537][123091] Updated weights for policy 0, policy_version 1436195 (0.0005) [2023-12-26 11:03:40,587][123091] Updated weights for policy 0, policy_version 1436205 (0.0005) [2023-12-26 11:03:41,007][123090] Updated weights for policy 1, policy_version 1426568 (0.0007) [2023-12-26 11:03:41,081][123090] Updated weights for policy 1, policy_version 1426578 (0.0009) [2023-12-26 11:03:41,156][123090] Updated weights for policy 1, policy_version 1426588 (0.0009) [2023-12-26 11:03:41,284][123091] Updated weights for policy 0, policy_version 1436215 (0.0007) [2023-12-26 11:03:41,359][123091] Updated weights for policy 0, policy_version 1436225 (0.0008) [2023-12-26 11:03:41,431][123091] Updated weights for policy 0, policy_version 1436235 (0.0010) [2023-12-26 11:03:41,954][123090] Updated weights for policy 1, policy_version 1426598 (0.0009) [2023-12-26 11:03:42,024][123090] Updated weights for policy 1, policy_version 1426608 (0.0006) [2023-12-26 11:03:42,095][123090] Updated weights for policy 1, policy_version 1426618 (0.0005) [2023-12-26 11:03:42,200][123091] Updated weights for policy 0, policy_version 1436245 (0.0010) [2023-12-26 11:03:42,268][123091] Updated weights for policy 0, policy_version 1436255 (0.0010) [2023-12-26 11:03:42,336][123091] Updated weights for policy 0, policy_version 1436265 (0.0010) [2023-12-26 11:03:42,778][123090] Updated weights for policy 1, policy_version 1426628 (0.0009) [2023-12-26 11:03:42,845][123090] Updated weights for policy 1, policy_version 1426638 (0.0011) [2023-12-26 11:03:42,908][123090] Updated weights for policy 1, policy_version 1426648 (0.0007) [2023-12-26 11:03:43,134][123091] Updated weights for policy 0, policy_version 1436275 (0.0009) [2023-12-26 11:03:43,196][123091] Updated weights for policy 0, policy_version 1436285 (0.0007) [2023-12-26 11:03:43,247][123091] Updated weights for policy 0, policy_version 1436295 (0.0010) [2023-12-26 11:03:43,645][123090] Updated weights for policy 1, policy_version 1426658 (0.0006) [2023-12-26 11:03:43,704][123090] Updated weights for policy 1, policy_version 1426668 (0.0010) [2023-12-26 11:03:43,762][123090] Updated weights for policy 1, policy_version 1426678 (0.0010) [2023-12-26 11:03:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 732921856. Throughput: 0: 8926.2, 1: 8973.9. Samples: 732918516. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:03:43,785][121949] Avg episode reward: [(0, '6287.007'), (1, '5733.572')] [2023-12-26 11:03:43,813][123090] Updated weights for policy 1, policy_version 1426688 (0.0010) [2023-12-26 11:03:44,018][123091] Updated weights for policy 0, policy_version 1436306 (0.0009) [2023-12-26 11:03:44,070][123091] Updated weights for policy 0, policy_version 1436316 (0.0010) [2023-12-26 11:03:44,128][123091] Updated weights for policy 0, policy_version 1436326 (0.0010) [2023-12-26 11:03:44,194][123091] Updated weights for policy 0, policy_version 1436336 (0.0010) [2023-12-26 11:03:44,560][123090] Updated weights for policy 1, policy_version 1426698 (0.0009) [2023-12-26 11:03:44,617][123090] Updated weights for policy 1, policy_version 1426709 (0.0010) [2023-12-26 11:03:44,677][123090] Updated weights for policy 1, policy_version 1426719 (0.0009) [2023-12-26 11:03:45,013][123091] Updated weights for policy 0, policy_version 1436346 (0.0007) [2023-12-26 11:03:45,071][123091] Updated weights for policy 0, policy_version 1436356 (0.0006) [2023-12-26 11:03:45,132][123091] Updated weights for policy 0, policy_version 1436366 (0.0006) [2023-12-26 11:03:45,612][123090] Updated weights for policy 1, policy_version 1426729 (0.0006) [2023-12-26 11:03:45,678][123090] Updated weights for policy 1, policy_version 1426739 (0.0005) [2023-12-26 11:03:45,750][123090] Updated weights for policy 1, policy_version 1426749 (0.0005) [2023-12-26 11:03:45,803][123091] Updated weights for policy 0, policy_version 1436376 (0.0009) [2023-12-26 11:03:45,864][123091] Updated weights for policy 0, policy_version 1436386 (0.0010) [2023-12-26 11:03:45,922][123091] Updated weights for policy 0, policy_version 1436396 (0.0009) [2023-12-26 11:03:46,416][123090] Updated weights for policy 1, policy_version 1426759 (0.0008) [2023-12-26 11:03:46,478][123090] Updated weights for policy 1, policy_version 1426769 (0.0010) [2023-12-26 11:03:46,539][123090] Updated weights for policy 1, policy_version 1426779 (0.0009) [2023-12-26 11:03:46,753][123091] Updated weights for policy 0, policy_version 1436406 (0.0008) [2023-12-26 11:03:46,803][123091] Updated weights for policy 0, policy_version 1436416 (0.0005) [2023-12-26 11:03:46,866][123091] Updated weights for policy 0, policy_version 1436426 (0.0009) [2023-12-26 11:03:47,408][123090] Updated weights for policy 1, policy_version 1426789 (0.0009) [2023-12-26 11:03:47,466][123090] Updated weights for policy 1, policy_version 1426800 (0.0009) [2023-12-26 11:03:47,525][123090] Updated weights for policy 1, policy_version 1426810 (0.0007) [2023-12-26 11:03:47,612][123091] Updated weights for policy 0, policy_version 1436436 (0.0009) [2023-12-26 11:03:47,676][123091] Updated weights for policy 0, policy_version 1436446 (0.0005) [2023-12-26 11:03:47,735][123091] Updated weights for policy 0, policy_version 1436456 (0.0007) [2023-12-26 11:03:48,262][123090] Updated weights for policy 1, policy_version 1426820 (0.0006) [2023-12-26 11:03:48,332][123090] Updated weights for policy 1, policy_version 1426830 (0.0010) [2023-12-26 11:03:48,399][123090] Updated weights for policy 1, policy_version 1426840 (0.0010) [2023-12-26 11:03:48,450][123091] Updated weights for policy 0, policy_version 1436466 (0.0010) [2023-12-26 11:03:48,514][123091] Updated weights for policy 0, policy_version 1436476 (0.0010) [2023-12-26 11:03:48,588][123091] Updated weights for policy 0, policy_version 1436486 (0.0011) [2023-12-26 11:03:48,663][123091] Updated weights for policy 0, policy_version 1436496 (0.0011) [2023-12-26 11:03:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 733020160. Throughput: 0: 8943.2, 1: 9017.3. Samples: 733028380. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:03:48,785][121949] Avg episode reward: [(0, '6348.045'), (1, '5688.066')] [2023-12-26 11:03:49,076][123090] Updated weights for policy 1, policy_version 1426850 (0.0009) [2023-12-26 11:03:49,135][123090] Updated weights for policy 1, policy_version 1426860 (0.0005) [2023-12-26 11:03:49,197][123090] Updated weights for policy 1, policy_version 1426870 (0.0005) [2023-12-26 11:03:49,269][123090] Updated weights for policy 1, policy_version 1426880 (0.0009) [2023-12-26 11:03:49,448][123091] Updated weights for policy 0, policy_version 1436506 (0.0007) [2023-12-26 11:03:49,518][123091] Updated weights for policy 0, policy_version 1436516 (0.0007) [2023-12-26 11:03:49,593][123091] Updated weights for policy 0, policy_version 1436526 (0.0011) [2023-12-26 11:03:49,995][123090] Updated weights for policy 1, policy_version 1426890 (0.0006) [2023-12-26 11:03:50,074][123090] Updated weights for policy 1, policy_version 1426900 (0.0006) [2023-12-26 11:03:50,137][123090] Updated weights for policy 1, policy_version 1426910 (0.0008) [2023-12-26 11:03:50,387][123091] Updated weights for policy 0, policy_version 1436536 (0.0011) [2023-12-26 11:03:50,454][123091] Updated weights for policy 0, policy_version 1436546 (0.0011) [2023-12-26 11:03:50,524][123091] Updated weights for policy 0, policy_version 1436556 (0.0011) [2023-12-26 11:03:50,936][123090] Updated weights for policy 1, policy_version 1426920 (0.0007) [2023-12-26 11:03:51,003][123090] Updated weights for policy 1, policy_version 1426930 (0.0005) [2023-12-26 11:03:51,069][123090] Updated weights for policy 1, policy_version 1426940 (0.0009) [2023-12-26 11:03:51,354][123091] Updated weights for policy 0, policy_version 1436566 (0.0011) [2023-12-26 11:03:51,429][123091] Updated weights for policy 0, policy_version 1436576 (0.0010) [2023-12-26 11:03:51,495][123091] Updated weights for policy 0, policy_version 1436586 (0.0011) [2023-12-26 11:03:51,851][123090] Updated weights for policy 1, policy_version 1426950 (0.0009) [2023-12-26 11:03:51,920][123090] Updated weights for policy 1, policy_version 1426960 (0.0008) [2023-12-26 11:03:51,987][123090] Updated weights for policy 1, policy_version 1426970 (0.0009) [2023-12-26 11:03:52,308][123091] Updated weights for policy 0, policy_version 1436596 (0.0010) [2023-12-26 11:03:52,383][123091] Updated weights for policy 0, policy_version 1436606 (0.0010) [2023-12-26 11:03:52,447][123091] Updated weights for policy 0, policy_version 1436616 (0.0009) [2023-12-26 11:03:52,784][123090] Updated weights for policy 1, policy_version 1426980 (0.0009) [2023-12-26 11:03:52,847][123090] Updated weights for policy 1, policy_version 1426990 (0.0009) [2023-12-26 11:03:52,913][123090] Updated weights for policy 1, policy_version 1427000 (0.0009) [2023-12-26 11:03:53,220][123091] Updated weights for policy 0, policy_version 1436626 (0.0009) [2023-12-26 11:03:53,281][123091] Updated weights for policy 0, policy_version 1436636 (0.0009) [2023-12-26 11:03:53,330][123091] Updated weights for policy 0, policy_version 1436646 (0.0010) [2023-12-26 11:03:53,381][123091] Updated weights for policy 0, policy_version 1436656 (0.0010) [2023-12-26 11:03:53,660][123090] Updated weights for policy 1, policy_version 1427010 (0.0007) [2023-12-26 11:03:53,724][123090] Updated weights for policy 1, policy_version 1427020 (0.0005) [2023-12-26 11:03:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 733102080. Throughput: 0: 8901.5, 1: 9013.6. Samples: 733081444. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:03:53,785][121949] Avg episode reward: [(0, '6289.619'), (1, '5687.060')] [2023-12-26 11:03:53,793][123090] Updated weights for policy 1, policy_version 1427030 (0.0005) [2023-12-26 11:03:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001436656_367788032.pth... [2023-12-26 11:03:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001435600_367517696.pth [2023-12-26 11:03:53,846][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001427040_365322240.pth... [2023-12-26 11:03:53,847][123090] Updated weights for policy 1, policy_version 1427040 (0.0005) [2023-12-26 11:03:53,849][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001425952_365043712.pth [2023-12-26 11:03:54,133][123091] Updated weights for policy 0, policy_version 1436666 (0.0008) [2023-12-26 11:03:54,195][123091] Updated weights for policy 0, policy_version 1436676 (0.0008) [2023-12-26 11:03:54,255][123091] Updated weights for policy 0, policy_version 1436686 (0.0007) [2023-12-26 11:03:54,501][123090] Updated weights for policy 1, policy_version 1427050 (0.0006) [2023-12-26 11:03:54,558][123090] Updated weights for policy 1, policy_version 1427060 (0.0005) [2023-12-26 11:03:54,620][123090] Updated weights for policy 1, policy_version 1427070 (0.0005) [2023-12-26 11:03:54,942][123091] Updated weights for policy 0, policy_version 1436696 (0.0007) [2023-12-26 11:03:55,009][123091] Updated weights for policy 0, policy_version 1436706 (0.0011) [2023-12-26 11:03:55,072][123091] Updated weights for policy 0, policy_version 1436716 (0.0011) [2023-12-26 11:03:55,296][123090] Updated weights for policy 1, policy_version 1427080 (0.0007) [2023-12-26 11:03:55,364][123090] Updated weights for policy 1, policy_version 1427090 (0.0007) [2023-12-26 11:03:55,429][123090] Updated weights for policy 1, policy_version 1427100 (0.0009) [2023-12-26 11:03:55,837][123091] Updated weights for policy 0, policy_version 1436726 (0.0011) [2023-12-26 11:03:55,896][123091] Updated weights for policy 0, policy_version 1436736 (0.0011) [2023-12-26 11:03:55,959][123091] Updated weights for policy 0, policy_version 1436746 (0.0011) [2023-12-26 11:03:56,278][123090] Updated weights for policy 1, policy_version 1427110 (0.0009) [2023-12-26 11:03:56,340][123090] Updated weights for policy 1, policy_version 1427120 (0.0010) [2023-12-26 11:03:56,397][123090] Updated weights for policy 1, policy_version 1427130 (0.0009) [2023-12-26 11:03:56,671][123091] Updated weights for policy 0, policy_version 1436756 (0.0009) [2023-12-26 11:03:56,732][123091] Updated weights for policy 0, policy_version 1436766 (0.0010) [2023-12-26 11:03:56,790][123091] Updated weights for policy 0, policy_version 1436776 (0.0011) [2023-12-26 11:03:57,173][123090] Updated weights for policy 1, policy_version 1427140 (0.0008) [2023-12-26 11:03:57,227][123090] Updated weights for policy 1, policy_version 1427150 (0.0008) [2023-12-26 11:03:57,275][123090] Updated weights for policy 1, policy_version 1427161 (0.0009) [2023-12-26 11:03:57,560][123091] Updated weights for policy 0, policy_version 1436786 (0.0010) [2023-12-26 11:03:57,622][123091] Updated weights for policy 0, policy_version 1436796 (0.0010) [2023-12-26 11:03:57,684][123091] Updated weights for policy 0, policy_version 1436806 (0.0010) [2023-12-26 11:03:57,745][123091] Updated weights for policy 0, policy_version 1436816 (0.0010) [2023-12-26 11:03:58,040][123090] Updated weights for policy 1, policy_version 1427171 (0.0009) [2023-12-26 11:03:58,108][123090] Updated weights for policy 1, policy_version 1427181 (0.0009) [2023-12-26 11:03:58,164][123090] Updated weights for policy 1, policy_version 1427191 (0.0009) [2023-12-26 11:03:58,547][123091] Updated weights for policy 0, policy_version 1436826 (0.0010) [2023-12-26 11:03:58,610][123091] Updated weights for policy 0, policy_version 1436836 (0.0010) [2023-12-26 11:03:58,679][123091] Updated weights for policy 0, policy_version 1436846 (0.0007) [2023-12-26 11:03:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 733200384. Throughput: 0: 8979.1, 1: 9047.3. Samples: 733192772. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:03:58,785][121949] Avg episode reward: [(0, '6265.041'), (1, '5788.594')] [2023-12-26 11:03:59,120][123090] Updated weights for policy 1, policy_version 1427201 (0.0009) [2023-12-26 11:03:59,190][123090] Updated weights for policy 1, policy_version 1427211 (0.0010) [2023-12-26 11:03:59,259][123090] Updated weights for policy 1, policy_version 1427221 (0.0010) [2023-12-26 11:03:59,331][123090] Updated weights for policy 1, policy_version 1427231 (0.0010) [2023-12-26 11:03:59,557][123091] Updated weights for policy 0, policy_version 1436856 (0.0010) [2023-12-26 11:03:59,614][123091] Updated weights for policy 0, policy_version 1436866 (0.0010) [2023-12-26 11:03:59,674][123091] Updated weights for policy 0, policy_version 1436876 (0.0011) [2023-12-26 11:04:00,084][123090] Updated weights for policy 1, policy_version 1427241 (0.0010) [2023-12-26 11:04:00,159][123090] Updated weights for policy 1, policy_version 1427251 (0.0011) [2023-12-26 11:04:00,207][123090] Updated weights for policy 1, policy_version 1427261 (0.0010) [2023-12-26 11:04:00,504][123091] Updated weights for policy 0, policy_version 1436886 (0.0008) [2023-12-26 11:04:00,562][123091] Updated weights for policy 0, policy_version 1436896 (0.0009) [2023-12-26 11:04:00,616][123091] Updated weights for policy 0, policy_version 1436906 (0.0009) [2023-12-26 11:04:01,021][123090] Updated weights for policy 1, policy_version 1427271 (0.0010) [2023-12-26 11:04:01,092][123090] Updated weights for policy 1, policy_version 1427281 (0.0010) [2023-12-26 11:04:01,164][123090] Updated weights for policy 1, policy_version 1427291 (0.0010) [2023-12-26 11:04:01,378][123091] Updated weights for policy 0, policy_version 1436916 (0.0009) [2023-12-26 11:04:01,434][123091] Updated weights for policy 0, policy_version 1436926 (0.0009) [2023-12-26 11:04:01,488][123091] Updated weights for policy 0, policy_version 1436936 (0.0009) [2023-12-26 11:04:01,976][123090] Updated weights for policy 1, policy_version 1427301 (0.0010) [2023-12-26 11:04:02,034][123090] Updated weights for policy 1, policy_version 1427311 (0.0010) [2023-12-26 11:04:02,105][123090] Updated weights for policy 1, policy_version 1427321 (0.0010) [2023-12-26 11:04:02,313][123091] Updated weights for policy 0, policy_version 1436946 (0.0008) [2023-12-26 11:04:02,376][123091] Updated weights for policy 0, policy_version 1436956 (0.0008) [2023-12-26 11:04:02,427][123091] Updated weights for policy 0, policy_version 1436966 (0.0007) [2023-12-26 11:04:02,477][123091] Updated weights for policy 0, policy_version 1436976 (0.0010) [2023-12-26 11:04:02,928][123090] Updated weights for policy 1, policy_version 1427331 (0.0010) [2023-12-26 11:04:02,971][123090] Updated weights for policy 1, policy_version 1427341 (0.0010) [2023-12-26 11:04:03,025][123090] Updated weights for policy 1, policy_version 1427351 (0.0010) [2023-12-26 11:04:03,142][123091] Updated weights for policy 0, policy_version 1436986 (0.0005) [2023-12-26 11:04:03,203][123091] Updated weights for policy 0, policy_version 1436996 (0.0005) [2023-12-26 11:04:03,263][123091] Updated weights for policy 0, policy_version 1437006 (0.0005) [2023-12-26 11:04:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 733282304. Throughput: 0: 9088.7, 1: 8926.5. Samples: 733297824. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:03,784][121949] Avg episode reward: [(0, '6202.263'), (1, '5786.828')] [2023-12-26 11:04:03,865][123091] Updated weights for policy 0, policy_version 1437016 (0.0007) [2023-12-26 11:04:03,869][123090] Updated weights for policy 1, policy_version 1427361 (0.0010) [2023-12-26 11:04:03,929][123090] Updated weights for policy 1, policy_version 1427371 (0.0010) [2023-12-26 11:04:03,930][123091] Updated weights for policy 0, policy_version 1437026 (0.0010) [2023-12-26 11:04:03,992][123090] Updated weights for policy 1, policy_version 1427381 (0.0008) [2023-12-26 11:04:03,994][123091] Updated weights for policy 0, policy_version 1437036 (0.0011) [2023-12-26 11:04:04,062][123090] Updated weights for policy 1, policy_version 1427391 (0.0008) [2023-12-26 11:04:04,722][123091] Updated weights for policy 0, policy_version 1437046 (0.0007) [2023-12-26 11:04:04,779][123091] Updated weights for policy 0, policy_version 1437056 (0.0005) [2023-12-26 11:04:04,837][123091] Updated weights for policy 0, policy_version 1437066 (0.0005) [2023-12-26 11:04:04,867][123090] Updated weights for policy 1, policy_version 1427401 (0.0006) [2023-12-26 11:04:04,937][123090] Updated weights for policy 1, policy_version 1427411 (0.0008) [2023-12-26 11:04:04,988][123090] Updated weights for policy 1, policy_version 1427421 (0.0010) [2023-12-26 11:04:05,545][123091] Updated weights for policy 0, policy_version 1437076 (0.0008) [2023-12-26 11:04:05,592][123091] Updated weights for policy 0, policy_version 1437086 (0.0010) [2023-12-26 11:04:05,643][123091] Updated weights for policy 0, policy_version 1437096 (0.0010) [2023-12-26 11:04:05,782][123090] Updated weights for policy 1, policy_version 1427431 (0.0009) [2023-12-26 11:04:05,847][123090] Updated weights for policy 1, policy_version 1427441 (0.0009) [2023-12-26 11:04:05,915][123090] Updated weights for policy 1, policy_version 1427451 (0.0010) [2023-12-26 11:04:06,390][123091] Updated weights for policy 0, policy_version 1437106 (0.0009) [2023-12-26 11:04:06,455][123091] Updated weights for policy 0, policy_version 1437116 (0.0008) [2023-12-26 11:04:06,515][123091] Updated weights for policy 0, policy_version 1437126 (0.0011) [2023-12-26 11:04:06,567][123091] Updated weights for policy 0, policy_version 1437136 (0.0011) [2023-12-26 11:04:06,839][123090] Updated weights for policy 1, policy_version 1427461 (0.0010) [2023-12-26 11:04:06,903][123090] Updated weights for policy 1, policy_version 1427471 (0.0010) [2023-12-26 11:04:06,963][123090] Updated weights for policy 1, policy_version 1427481 (0.0010) [2023-12-26 11:04:07,369][123091] Updated weights for policy 0, policy_version 1437146 (0.0009) [2023-12-26 11:04:07,425][123091] Updated weights for policy 0, policy_version 1437156 (0.0010) [2023-12-26 11:04:07,489][123091] Updated weights for policy 0, policy_version 1437166 (0.0011) [2023-12-26 11:04:07,805][123090] Updated weights for policy 1, policy_version 1427491 (0.0011) [2023-12-26 11:04:07,857][123090] Updated weights for policy 1, policy_version 1427501 (0.0010) [2023-12-26 11:04:07,913][123090] Updated weights for policy 1, policy_version 1427511 (0.0010) [2023-12-26 11:04:08,291][123091] Updated weights for policy 0, policy_version 1437176 (0.0010) [2023-12-26 11:04:08,351][123091] Updated weights for policy 0, policy_version 1437186 (0.0011) [2023-12-26 11:04:08,410][123091] Updated weights for policy 0, policy_version 1437196 (0.0010) [2023-12-26 11:04:08,680][123090] Updated weights for policy 1, policy_version 1427521 (0.0009) [2023-12-26 11:04:08,736][123090] Updated weights for policy 1, policy_version 1427531 (0.0008) [2023-12-26 11:04:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 733372416. Throughput: 0: 9137.8, 1: 8927.7. Samples: 733351512. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:08,785][121949] Avg episode reward: [(0, '6208.710'), (1, '5724.623')] [2023-12-26 11:04:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001437200_367927296.pth... [2023-12-26 11:04:08,791][123090] Updated weights for policy 1, policy_version 1427541 (0.0010) [2023-12-26 11:04:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001436144_367656960.pth [2023-12-26 11:04:08,854][123090] Updated weights for policy 1, policy_version 1427551 (0.0010) [2023-12-26 11:04:08,858][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001427552_365453312.pth... [2023-12-26 11:04:08,861][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001426496_365182976.pth [2023-12-26 11:04:09,245][123091] Updated weights for policy 0, policy_version 1437206 (0.0008) [2023-12-26 11:04:09,317][123091] Updated weights for policy 0, policy_version 1437216 (0.0009) [2023-12-26 11:04:09,414][123091] Updated weights for policy 0, policy_version 1437226 (0.0010) [2023-12-26 11:04:09,574][123090] Updated weights for policy 1, policy_version 1427561 (0.0006) [2023-12-26 11:04:09,630][123090] Updated weights for policy 1, policy_version 1427571 (0.0005) [2023-12-26 11:04:09,690][123090] Updated weights for policy 1, policy_version 1427581 (0.0005) [2023-12-26 11:04:10,218][123091] Updated weights for policy 0, policy_version 1437236 (0.0011) [2023-12-26 11:04:10,279][123091] Updated weights for policy 0, policy_version 1437246 (0.0011) [2023-12-26 11:04:10,338][123091] Updated weights for policy 0, policy_version 1437256 (0.0010) [2023-12-26 11:04:10,495][123090] Updated weights for policy 1, policy_version 1427591 (0.0006) [2023-12-26 11:04:10,561][123090] Updated weights for policy 1, policy_version 1427601 (0.0006) [2023-12-26 11:04:10,633][123090] Updated weights for policy 1, policy_version 1427611 (0.0006) [2023-12-26 11:04:11,119][123091] Updated weights for policy 0, policy_version 1437266 (0.0010) [2023-12-26 11:04:11,188][123091] Updated weights for policy 0, policy_version 1437276 (0.0009) [2023-12-26 11:04:11,246][123091] Updated weights for policy 0, policy_version 1437286 (0.0009) [2023-12-26 11:04:11,317][123091] Updated weights for policy 0, policy_version 1437296 (0.0009) [2023-12-26 11:04:11,429][123090] Updated weights for policy 1, policy_version 1427621 (0.0009) [2023-12-26 11:04:11,487][123090] Updated weights for policy 1, policy_version 1427631 (0.0009) [2023-12-26 11:04:11,545][123090] Updated weights for policy 1, policy_version 1427641 (0.0006) [2023-12-26 11:04:12,194][123091] Updated weights for policy 0, policy_version 1437306 (0.0008) [2023-12-26 11:04:12,254][123091] Updated weights for policy 0, policy_version 1437316 (0.0010) [2023-12-26 11:04:12,321][123091] Updated weights for policy 0, policy_version 1437326 (0.0007) [2023-12-26 11:04:12,362][123090] Updated weights for policy 1, policy_version 1427651 (0.0008) [2023-12-26 11:04:12,434][123090] Updated weights for policy 1, policy_version 1427661 (0.0010) [2023-12-26 11:04:12,504][123090] Updated weights for policy 1, policy_version 1427671 (0.0009) [2023-12-26 11:04:12,982][123091] Updated weights for policy 0, policy_version 1437336 (0.0006) [2023-12-26 11:04:13,054][123091] Updated weights for policy 0, policy_version 1437346 (0.0006) [2023-12-26 11:04:13,118][123091] Updated weights for policy 0, policy_version 1437356 (0.0008) [2023-12-26 11:04:13,404][123090] Updated weights for policy 1, policy_version 1427681 (0.0010) [2023-12-26 11:04:13,471][123090] Updated weights for policy 1, policy_version 1427691 (0.0006) [2023-12-26 11:04:13,522][123090] Updated weights for policy 1, policy_version 1427701 (0.0008) [2023-12-26 11:04:13,578][123090] Updated weights for policy 1, policy_version 1427711 (0.0010) [2023-12-26 11:04:13,759][123091] Updated weights for policy 0, policy_version 1437366 (0.0006) [2023-12-26 11:04:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 733462528. Throughput: 0: 9041.2, 1: 8925.0. Samples: 733455776. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:13,784][121949] Avg episode reward: [(0, '6300.469'), (1, '5788.946')] [2023-12-26 11:04:13,819][123091] Updated weights for policy 0, policy_version 1437376 (0.0005) [2023-12-26 11:04:13,892][123091] Updated weights for policy 0, policy_version 1437386 (0.0005) [2023-12-26 11:04:14,309][123090] Updated weights for policy 1, policy_version 1427721 (0.0009) [2023-12-26 11:04:14,374][123090] Updated weights for policy 1, policy_version 1427731 (0.0009) [2023-12-26 11:04:14,425][123090] Updated weights for policy 1, policy_version 1427741 (0.0008) [2023-12-26 11:04:14,645][123091] Updated weights for policy 0, policy_version 1437396 (0.0010) [2023-12-26 11:04:14,692][123091] Updated weights for policy 0, policy_version 1437406 (0.0010) [2023-12-26 11:04:14,743][123091] Updated weights for policy 0, policy_version 1437416 (0.0010) [2023-12-26 11:04:15,284][123090] Updated weights for policy 1, policy_version 1427751 (0.0009) [2023-12-26 11:04:15,347][123090] Updated weights for policy 1, policy_version 1427761 (0.0009) [2023-12-26 11:04:15,413][123090] Updated weights for policy 1, policy_version 1427771 (0.0010) [2023-12-26 11:04:15,548][123091] Updated weights for policy 0, policy_version 1437426 (0.0010) [2023-12-26 11:04:15,616][123091] Updated weights for policy 0, policy_version 1437436 (0.0011) [2023-12-26 11:04:15,667][123091] Updated weights for policy 0, policy_version 1437446 (0.0008) [2023-12-26 11:04:15,726][123091] Updated weights for policy 0, policy_version 1437456 (0.0007) [2023-12-26 11:04:16,319][123090] Updated weights for policy 1, policy_version 1427781 (0.0008) [2023-12-26 11:04:16,369][123090] Updated weights for policy 1, policy_version 1427791 (0.0005) [2023-12-26 11:04:16,424][123090] Updated weights for policy 1, policy_version 1427801 (0.0005) [2023-12-26 11:04:16,463][123091] Updated weights for policy 0, policy_version 1437466 (0.0009) [2023-12-26 11:04:16,515][123091] Updated weights for policy 0, policy_version 1437476 (0.0010) [2023-12-26 11:04:16,569][123091] Updated weights for policy 0, policy_version 1437486 (0.0010) [2023-12-26 11:04:17,097][123090] Updated weights for policy 1, policy_version 1427811 (0.0007) [2023-12-26 11:04:17,148][123090] Updated weights for policy 1, policy_version 1427821 (0.0009) [2023-12-26 11:04:17,203][123090] Updated weights for policy 1, policy_version 1427831 (0.0009) [2023-12-26 11:04:17,319][123091] Updated weights for policy 0, policy_version 1437496 (0.0010) [2023-12-26 11:04:17,381][123091] Updated weights for policy 0, policy_version 1437506 (0.0010) [2023-12-26 11:04:17,444][123091] Updated weights for policy 0, policy_version 1437516 (0.0009) [2023-12-26 11:04:18,039][123090] Updated weights for policy 1, policy_version 1427841 (0.0009) [2023-12-26 11:04:18,104][123090] Updated weights for policy 1, policy_version 1427851 (0.0008) [2023-12-26 11:04:18,166][123090] Updated weights for policy 1, policy_version 1427861 (0.0008) [2023-12-26 11:04:18,235][123090] Updated weights for policy 1, policy_version 1427871 (0.0009) [2023-12-26 11:04:18,302][123091] Updated weights for policy 0, policy_version 1437526 (0.0010) [2023-12-26 11:04:18,360][123091] Updated weights for policy 0, policy_version 1437536 (0.0011) [2023-12-26 11:04:18,421][123091] Updated weights for policy 0, policy_version 1437546 (0.0013) [2023-12-26 11:04:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 733552640. Throughput: 0: 9061.3, 1: 8868.5. Samples: 733563776. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:18,785][121949] Avg episode reward: [(0, '6392.197'), (1, '5862.043')] [2023-12-26 11:04:19,041][123090] Updated weights for policy 1, policy_version 1427881 (0.0008) [2023-12-26 11:04:19,103][123090] Updated weights for policy 1, policy_version 1427891 (0.0009) [2023-12-26 11:04:19,160][123090] Updated weights for policy 1, policy_version 1427901 (0.0009) [2023-12-26 11:04:19,241][123091] Updated weights for policy 0, policy_version 1437556 (0.0010) [2023-12-26 11:04:19,310][123091] Updated weights for policy 0, policy_version 1437566 (0.0007) [2023-12-26 11:04:19,380][123091] Updated weights for policy 0, policy_version 1437576 (0.0009) [2023-12-26 11:04:20,036][123090] Updated weights for policy 1, policy_version 1427911 (0.0009) [2023-12-26 11:04:20,100][123090] Updated weights for policy 1, policy_version 1427921 (0.0009) [2023-12-26 11:04:20,168][123090] Updated weights for policy 1, policy_version 1427931 (0.0010) [2023-12-26 11:04:20,187][123091] Updated weights for policy 0, policy_version 1437586 (0.0008) [2023-12-26 11:04:20,249][123091] Updated weights for policy 0, policy_version 1437596 (0.0006) [2023-12-26 11:04:20,302][123091] Updated weights for policy 0, policy_version 1437606 (0.0009) [2023-12-26 11:04:20,359][123091] Updated weights for policy 0, policy_version 1437616 (0.0008) [2023-12-26 11:04:21,012][123090] Updated weights for policy 1, policy_version 1427941 (0.0009) [2023-12-26 11:04:21,087][123090] Updated weights for policy 1, policy_version 1427951 (0.0009) [2023-12-26 11:04:21,153][123090] Updated weights for policy 1, policy_version 1427961 (0.0009) [2023-12-26 11:04:21,208][123091] Updated weights for policy 0, policy_version 1437626 (0.0009) [2023-12-26 11:04:21,278][123091] Updated weights for policy 0, policy_version 1437636 (0.0009) [2023-12-26 11:04:21,355][123091] Updated weights for policy 0, policy_version 1437646 (0.0008) [2023-12-26 11:04:22,023][123090] Updated weights for policy 1, policy_version 1427971 (0.0009) [2023-12-26 11:04:22,078][123090] Updated weights for policy 1, policy_version 1427981 (0.0008) [2023-12-26 11:04:22,138][123090] Updated weights for policy 1, policy_version 1427991 (0.0009) [2023-12-26 11:04:22,163][123091] Updated weights for policy 0, policy_version 1437656 (0.0007) [2023-12-26 11:04:22,235][123091] Updated weights for policy 0, policy_version 1437666 (0.0007) [2023-12-26 11:04:22,306][123091] Updated weights for policy 0, policy_version 1437676 (0.0010) [2023-12-26 11:04:22,970][123090] Updated weights for policy 1, policy_version 1428001 (0.0010) [2023-12-26 11:04:23,029][123090] Updated weights for policy 1, policy_version 1428011 (0.0008) [2023-12-26 11:04:23,089][123090] Updated weights for policy 1, policy_version 1428021 (0.0009) [2023-12-26 11:04:23,127][123091] Updated weights for policy 0, policy_version 1437686 (0.0010) [2023-12-26 11:04:23,146][123090] Updated weights for policy 1, policy_version 1428031 (0.0006) [2023-12-26 11:04:23,192][123091] Updated weights for policy 0, policy_version 1437696 (0.0010) [2023-12-26 11:04:23,251][123091] Updated weights for policy 0, policy_version 1437706 (0.0011) [2023-12-26 11:04:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 733634560. Throughput: 0: 8987.9, 1: 8816.1. Samples: 733614140. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:23,785][121949] Avg episode reward: [(0, '6323.359'), (1, '5827.959')] [2023-12-26 11:04:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001437712_368058368.pth... [2023-12-26 11:04:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001428032_365576192.pth... [2023-12-26 11:04:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001427040_365322240.pth [2023-12-26 11:04:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001436656_367788032.pth [2023-12-26 11:04:23,934][123090] Updated weights for policy 1, policy_version 1428041 (0.0005) [2023-12-26 11:04:23,989][123090] Updated weights for policy 1, policy_version 1428051 (0.0005) [2023-12-26 11:04:24,036][123091] Updated weights for policy 0, policy_version 1437716 (0.0008) [2023-12-26 11:04:24,050][123090] Updated weights for policy 1, policy_version 1428061 (0.0007) [2023-12-26 11:04:24,090][123091] Updated weights for policy 0, policy_version 1437726 (0.0006) [2023-12-26 11:04:24,149][123091] Updated weights for policy 0, policy_version 1437736 (0.0005) [2023-12-26 11:04:24,787][123090] Updated weights for policy 1, policy_version 1428071 (0.0008) [2023-12-26 11:04:24,808][123091] Updated weights for policy 0, policy_version 1437746 (0.0006) [2023-12-26 11:04:24,841][123090] Updated weights for policy 1, policy_version 1428081 (0.0010) [2023-12-26 11:04:24,854][123091] Updated weights for policy 0, policy_version 1437756 (0.0005) [2023-12-26 11:04:24,897][123090] Updated weights for policy 1, policy_version 1428091 (0.0010) [2023-12-26 11:04:24,906][123091] Updated weights for policy 0, policy_version 1437766 (0.0005) [2023-12-26 11:04:24,963][123091] Updated weights for policy 0, policy_version 1437776 (0.0005) [2023-12-26 11:04:25,503][123090] Updated weights for policy 1, policy_version 1428101 (0.0006) [2023-12-26 11:04:25,568][123090] Updated weights for policy 1, policy_version 1428111 (0.0006) [2023-12-26 11:04:25,626][123091] Updated weights for policy 0, policy_version 1437786 (0.0007) [2023-12-26 11:04:25,641][123090] Updated weights for policy 1, policy_version 1428121 (0.0006) [2023-12-26 11:04:25,686][123091] Updated weights for policy 0, policy_version 1437796 (0.0007) [2023-12-26 11:04:25,760][123091] Updated weights for policy 0, policy_version 1437806 (0.0006) [2023-12-26 11:04:26,395][123090] Updated weights for policy 1, policy_version 1428131 (0.0010) [2023-12-26 11:04:26,431][123091] Updated weights for policy 0, policy_version 1437816 (0.0005) [2023-12-26 11:04:26,464][123090] Updated weights for policy 1, policy_version 1428141 (0.0010) [2023-12-26 11:04:26,489][123091] Updated weights for policy 0, policy_version 1437826 (0.0005) [2023-12-26 11:04:26,530][123090] Updated weights for policy 1, policy_version 1428151 (0.0010) [2023-12-26 11:04:26,551][123091] Updated weights for policy 0, policy_version 1437836 (0.0005) [2023-12-26 11:04:27,140][123090] Updated weights for policy 1, policy_version 1428161 (0.0010) [2023-12-26 11:04:27,205][123090] Updated weights for policy 1, policy_version 1428171 (0.0006) [2023-12-26 11:04:27,250][123091] Updated weights for policy 0, policy_version 1437846 (0.0008) [2023-12-26 11:04:27,266][123090] Updated weights for policy 1, policy_version 1428181 (0.0005) [2023-12-26 11:04:27,310][123091] Updated weights for policy 0, policy_version 1437856 (0.0008) [2023-12-26 11:04:27,315][123090] Updated weights for policy 1, policy_version 1428191 (0.0007) [2023-12-26 11:04:27,372][123091] Updated weights for policy 0, policy_version 1437866 (0.0009) [2023-12-26 11:04:27,950][123090] Updated weights for policy 1, policy_version 1428201 (0.0006) [2023-12-26 11:04:28,009][123090] Updated weights for policy 1, policy_version 1428211 (0.0006) [2023-12-26 11:04:28,068][123090] Updated weights for policy 1, policy_version 1428221 (0.0010) [2023-12-26 11:04:28,139][123091] Updated weights for policy 0, policy_version 1437876 (0.0008) [2023-12-26 11:04:28,193][123091] Updated weights for policy 0, policy_version 1437886 (0.0005) [2023-12-26 11:04:28,236][123091] Updated weights for policy 0, policy_version 1437896 (0.0005) [2023-12-26 11:04:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 733732864. Throughput: 0: 9091.1, 1: 8877.3. Samples: 733727092. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:28,785][121949] Avg episode reward: [(0, '6324.551'), (1, '5717.631')] [2023-12-26 11:04:28,904][123090] Updated weights for policy 1, policy_version 1428231 (0.0010) [2023-12-26 11:04:28,971][123090] Updated weights for policy 1, policy_version 1428241 (0.0009) [2023-12-26 11:04:29,012][123091] Updated weights for policy 0, policy_version 1437906 (0.0005) [2023-12-26 11:04:29,033][123090] Updated weights for policy 1, policy_version 1428251 (0.0009) [2023-12-26 11:04:29,077][123091] Updated weights for policy 0, policy_version 1437916 (0.0008) [2023-12-26 11:04:29,132][123091] Updated weights for policy 0, policy_version 1437926 (0.0009) [2023-12-26 11:04:29,180][123091] Updated weights for policy 0, policy_version 1437936 (0.0008) [2023-12-26 11:04:29,846][123090] Updated weights for policy 1, policy_version 1428261 (0.0009) [2023-12-26 11:04:29,903][123090] Updated weights for policy 1, policy_version 1428271 (0.0006) [2023-12-26 11:04:29,970][123090] Updated weights for policy 1, policy_version 1428281 (0.0007) [2023-12-26 11:04:29,979][123091] Updated weights for policy 0, policy_version 1437946 (0.0009) [2023-12-26 11:04:30,043][123091] Updated weights for policy 0, policy_version 1437956 (0.0006) [2023-12-26 11:04:30,105][123091] Updated weights for policy 0, policy_version 1437966 (0.0005) [2023-12-26 11:04:30,636][123090] Updated weights for policy 1, policy_version 1428291 (0.0007) [2023-12-26 11:04:30,692][123090] Updated weights for policy 1, policy_version 1428301 (0.0005) [2023-12-26 11:04:30,759][123090] Updated weights for policy 1, policy_version 1428311 (0.0005) [2023-12-26 11:04:30,924][123091] Updated weights for policy 0, policy_version 1437976 (0.0007) [2023-12-26 11:04:30,987][123091] Updated weights for policy 0, policy_version 1437986 (0.0010) [2023-12-26 11:04:31,050][123091] Updated weights for policy 0, policy_version 1437996 (0.0009) [2023-12-26 11:04:31,519][123090] Updated weights for policy 1, policy_version 1428321 (0.0005) [2023-12-26 11:04:31,568][123090] Updated weights for policy 1, policy_version 1428331 (0.0005) [2023-12-26 11:04:31,627][123090] Updated weights for policy 1, policy_version 1428341 (0.0005) [2023-12-26 11:04:31,681][123090] Updated weights for policy 1, policy_version 1428351 (0.0006) [2023-12-26 11:04:31,889][123091] Updated weights for policy 0, policy_version 1438006 (0.0007) [2023-12-26 11:04:31,945][123091] Updated weights for policy 0, policy_version 1438016 (0.0005) [2023-12-26 11:04:32,013][123091] Updated weights for policy 0, policy_version 1438026 (0.0007) [2023-12-26 11:04:32,503][123090] Updated weights for policy 1, policy_version 1428361 (0.0008) [2023-12-26 11:04:32,573][123090] Updated weights for policy 1, policy_version 1428371 (0.0008) [2023-12-26 11:04:32,631][123090] Updated weights for policy 1, policy_version 1428381 (0.0010) [2023-12-26 11:04:32,728][123091] Updated weights for policy 0, policy_version 1438036 (0.0009) [2023-12-26 11:04:32,779][123091] Updated weights for policy 0, policy_version 1438046 (0.0009) [2023-12-26 11:04:32,841][123091] Updated weights for policy 0, policy_version 1438056 (0.0009) [2023-12-26 11:04:33,452][123090] Updated weights for policy 1, policy_version 1428391 (0.0007) [2023-12-26 11:04:33,499][123090] Updated weights for policy 1, policy_version 1428401 (0.0005) [2023-12-26 11:04:33,544][123090] Updated weights for policy 1, policy_version 1428411 (0.0005) [2023-12-26 11:04:33,663][123091] Updated weights for policy 0, policy_version 1438066 (0.0009) [2023-12-26 11:04:33,743][123091] Updated weights for policy 0, policy_version 1438076 (0.0005) [2023-12-26 11:04:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 733822976. Throughput: 0: 9056.9, 1: 8883.9. Samples: 733835716. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:33,785][121949] Avg episode reward: [(0, '6287.465'), (1, '5771.715')] [2023-12-26 11:04:33,801][123091] Updated weights for policy 0, policy_version 1438086 (0.0005) [2023-12-26 11:04:33,853][123091] Updated weights for policy 0, policy_version 1438096 (0.0005) [2023-12-26 11:04:34,263][123090] Updated weights for policy 1, policy_version 1428421 (0.0007) [2023-12-26 11:04:34,325][123090] Updated weights for policy 1, policy_version 1428431 (0.0008) [2023-12-26 11:04:34,392][123090] Updated weights for policy 1, policy_version 1428441 (0.0007) [2023-12-26 11:04:34,552][123091] Updated weights for policy 0, policy_version 1438106 (0.0010) [2023-12-26 11:04:34,618][123091] Updated weights for policy 0, policy_version 1438116 (0.0008) [2023-12-26 11:04:34,679][123091] Updated weights for policy 0, policy_version 1438126 (0.0009) [2023-12-26 11:04:35,174][123090] Updated weights for policy 1, policy_version 1428451 (0.0009) [2023-12-26 11:04:35,236][123090] Updated weights for policy 1, policy_version 1428461 (0.0010) [2023-12-26 11:04:35,285][123090] Updated weights for policy 1, policy_version 1428471 (0.0009) [2023-12-26 11:04:35,470][123091] Updated weights for policy 0, policy_version 1438136 (0.0006) [2023-12-26 11:04:35,521][123091] Updated weights for policy 0, policy_version 1438146 (0.0005) [2023-12-26 11:04:35,568][123091] Updated weights for policy 0, policy_version 1438156 (0.0005) [2023-12-26 11:04:36,147][123090] Updated weights for policy 1, policy_version 1428481 (0.0009) [2023-12-26 11:04:36,209][123090] Updated weights for policy 1, policy_version 1428491 (0.0010) [2023-12-26 11:04:36,266][123090] Updated weights for policy 1, policy_version 1428501 (0.0008) [2023-12-26 11:04:36,273][123091] Updated weights for policy 0, policy_version 1438166 (0.0008) [2023-12-26 11:04:36,320][123091] Updated weights for policy 0, policy_version 1438176 (0.0008) [2023-12-26 11:04:36,332][123090] Updated weights for policy 1, policy_version 1428511 (0.0008) [2023-12-26 11:04:36,369][123091] Updated weights for policy 0, policy_version 1438186 (0.0009) [2023-12-26 11:04:37,159][123090] Updated weights for policy 1, policy_version 1428521 (0.0009) [2023-12-26 11:04:37,207][123091] Updated weights for policy 0, policy_version 1438196 (0.0010) [2023-12-26 11:04:37,226][123090] Updated weights for policy 1, policy_version 1428531 (0.0009) [2023-12-26 11:04:37,266][123091] Updated weights for policy 0, policy_version 1438206 (0.0009) [2023-12-26 11:04:37,282][123090] Updated weights for policy 1, policy_version 1428541 (0.0007) [2023-12-26 11:04:37,314][123091] Updated weights for policy 0, policy_version 1438216 (0.0009) [2023-12-26 11:04:38,047][123090] Updated weights for policy 1, policy_version 1428551 (0.0010) [2023-12-26 11:04:38,108][123090] Updated weights for policy 1, policy_version 1428561 (0.0009) [2023-12-26 11:04:38,168][123090] Updated weights for policy 1, policy_version 1428571 (0.0009) [2023-12-26 11:04:38,199][123091] Updated weights for policy 0, policy_version 1438226 (0.0008) [2023-12-26 11:04:38,255][123091] Updated weights for policy 0, policy_version 1438236 (0.0006) [2023-12-26 11:04:38,307][123091] Updated weights for policy 0, policy_version 1438246 (0.0006) [2023-12-26 11:04:38,395][123091] Updated weights for policy 0, policy_version 1438256 (0.0007) [2023-12-26 11:04:38,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17885.7, 300 sec: 17828.0). Total num frames: 733913088. Throughput: 0: 9110.5, 1: 8857.5. Samples: 733890008. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:38,786][121949] Avg episode reward: [(0, '6289.504'), (1, '5701.334')] [2023-12-26 11:04:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001428576_365715456.pth... [2023-12-26 11:04:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001438256_368197632.pth... [2023-12-26 11:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001427552_365453312.pth [2023-12-26 11:04:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001437200_367927296.pth [2023-12-26 11:04:39,093][123090] Updated weights for policy 1, policy_version 1428581 (0.0008) [2023-12-26 11:04:39,113][123091] Updated weights for policy 0, policy_version 1438266 (0.0010) [2023-12-26 11:04:39,147][123090] Updated weights for policy 1, policy_version 1428591 (0.0009) [2023-12-26 11:04:39,167][123091] Updated weights for policy 0, policy_version 1438276 (0.0006) [2023-12-26 11:04:39,195][123090] Updated weights for policy 1, policy_version 1428601 (0.0008) [2023-12-26 11:04:39,218][123091] Updated weights for policy 0, policy_version 1438286 (0.0008) [2023-12-26 11:04:40,078][123090] Updated weights for policy 1, policy_version 1428611 (0.0008) [2023-12-26 11:04:40,098][123091] Updated weights for policy 0, policy_version 1438296 (0.0009) [2023-12-26 11:04:40,141][123090] Updated weights for policy 1, policy_version 1428621 (0.0007) [2023-12-26 11:04:40,153][123091] Updated weights for policy 0, policy_version 1438306 (0.0008) [2023-12-26 11:04:40,203][123090] Updated weights for policy 1, policy_version 1428631 (0.0010) [2023-12-26 11:04:40,207][123091] Updated weights for policy 0, policy_version 1438316 (0.0007) [2023-12-26 11:04:41,072][123091] Updated weights for policy 0, policy_version 1438326 (0.0009) [2023-12-26 11:04:41,108][123090] Updated weights for policy 1, policy_version 1428641 (0.0010) [2023-12-26 11:04:41,131][123091] Updated weights for policy 0, policy_version 1438336 (0.0009) [2023-12-26 11:04:41,170][123090] Updated weights for policy 1, policy_version 1428651 (0.0008) [2023-12-26 11:04:41,194][123091] Updated weights for policy 0, policy_version 1438346 (0.0007) [2023-12-26 11:04:41,234][123090] Updated weights for policy 1, policy_version 1428661 (0.0005) [2023-12-26 11:04:41,308][123090] Updated weights for policy 1, policy_version 1428671 (0.0006) [2023-12-26 11:04:42,075][123091] Updated weights for policy 0, policy_version 1438356 (0.0009) [2023-12-26 11:04:42,132][123090] Updated weights for policy 1, policy_version 1428681 (0.0007) [2023-12-26 11:04:42,133][123091] Updated weights for policy 0, policy_version 1438366 (0.0009) [2023-12-26 11:04:42,192][123091] Updated weights for policy 0, policy_version 1438376 (0.0006) [2023-12-26 11:04:42,203][123090] Updated weights for policy 1, policy_version 1428691 (0.0009) [2023-12-26 11:04:42,273][123090] Updated weights for policy 1, policy_version 1428701 (0.0009) [2023-12-26 11:04:42,909][123091] Updated weights for policy 0, policy_version 1438386 (0.0006) [2023-12-26 11:04:42,970][123091] Updated weights for policy 0, policy_version 1438396 (0.0006) [2023-12-26 11:04:43,024][123091] Updated weights for policy 0, policy_version 1438406 (0.0005) [2023-12-26 11:04:43,073][123091] Updated weights for policy 0, policy_version 1438416 (0.0005) [2023-12-26 11:04:43,175][123090] Updated weights for policy 1, policy_version 1428711 (0.0007) [2023-12-26 11:04:43,236][123090] Updated weights for policy 1, policy_version 1428721 (0.0005) [2023-12-26 11:04:43,297][123090] Updated weights for policy 1, policy_version 1428731 (0.0005) [2023-12-26 11:04:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 733995008. Throughput: 0: 9016.1, 1: 8725.5. Samples: 733991144. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:43,785][121949] Avg episode reward: [(0, '6215.709'), (1, '5660.636')] [2023-12-26 11:04:43,812][123091] Updated weights for policy 0, policy_version 1438426 (0.0006) [2023-12-26 11:04:43,866][123091] Updated weights for policy 0, policy_version 1438436 (0.0005) [2023-12-26 11:04:43,926][123091] Updated weights for policy 0, policy_version 1438446 (0.0005) [2023-12-26 11:04:44,043][123090] Updated weights for policy 1, policy_version 1428741 (0.0007) [2023-12-26 11:04:44,100][123090] Updated weights for policy 1, policy_version 1428751 (0.0010) [2023-12-26 11:04:44,172][123090] Updated weights for policy 1, policy_version 1428761 (0.0010) [2023-12-26 11:04:44,666][123091] Updated weights for policy 0, policy_version 1438456 (0.0009) [2023-12-26 11:04:44,717][123091] Updated weights for policy 0, policy_version 1438466 (0.0010) [2023-12-26 11:04:44,776][123091] Updated weights for policy 0, policy_version 1438476 (0.0009) [2023-12-26 11:04:45,013][123090] Updated weights for policy 1, policy_version 1428771 (0.0009) [2023-12-26 11:04:45,066][123090] Updated weights for policy 1, policy_version 1428781 (0.0009) [2023-12-26 11:04:45,120][123090] Updated weights for policy 1, policy_version 1428791 (0.0008) [2023-12-26 11:04:45,574][123091] Updated weights for policy 0, policy_version 1438486 (0.0007) [2023-12-26 11:04:45,638][123091] Updated weights for policy 0, policy_version 1438496 (0.0005) [2023-12-26 11:04:45,694][123091] Updated weights for policy 0, policy_version 1438506 (0.0005) [2023-12-26 11:04:46,091][123090] Updated weights for policy 1, policy_version 1428801 (0.0009) [2023-12-26 11:04:46,153][123090] Updated weights for policy 1, policy_version 1428811 (0.0009) [2023-12-26 11:04:46,212][123090] Updated weights for policy 1, policy_version 1428821 (0.0008) [2023-12-26 11:04:46,266][123090] Updated weights for policy 1, policy_version 1428831 (0.0009) [2023-12-26 11:04:46,382][123091] Updated weights for policy 0, policy_version 1438516 (0.0005) [2023-12-26 11:04:46,436][123091] Updated weights for policy 0, policy_version 1438526 (0.0005) [2023-12-26 11:04:46,492][123091] Updated weights for policy 0, policy_version 1438536 (0.0005) [2023-12-26 11:04:46,940][123090] Updated weights for policy 1, policy_version 1428841 (0.0006) [2023-12-26 11:04:47,005][123090] Updated weights for policy 1, policy_version 1428851 (0.0006) [2023-12-26 11:04:47,078][123090] Updated weights for policy 1, policy_version 1428861 (0.0005) [2023-12-26 11:04:47,191][123091] Updated weights for policy 0, policy_version 1438546 (0.0005) [2023-12-26 11:04:47,257][123091] Updated weights for policy 0, policy_version 1438556 (0.0005) [2023-12-26 11:04:47,322][123091] Updated weights for policy 0, policy_version 1438566 (0.0006) [2023-12-26 11:04:47,389][123091] Updated weights for policy 0, policy_version 1438576 (0.0005) [2023-12-26 11:04:47,693][123090] Updated weights for policy 1, policy_version 1428871 (0.0008) [2023-12-26 11:04:47,752][123090] Updated weights for policy 1, policy_version 1428881 (0.0010) [2023-12-26 11:04:47,810][123090] Updated weights for policy 1, policy_version 1428891 (0.0010) [2023-12-26 11:04:47,967][123091] Updated weights for policy 0, policy_version 1438586 (0.0005) [2023-12-26 11:04:48,026][123091] Updated weights for policy 0, policy_version 1438596 (0.0006) [2023-12-26 11:04:48,099][123091] Updated weights for policy 0, policy_version 1438606 (0.0006) [2023-12-26 11:04:48,704][123090] Updated weights for policy 1, policy_version 1428901 (0.0009) [2023-12-26 11:04:48,766][123090] Updated weights for policy 1, policy_version 1428911 (0.0009) [2023-12-26 11:04:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 734085120. Throughput: 0: 9125.8, 1: 8759.7. Samples: 734102676. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:48,785][121949] Avg episode reward: [(0, '6134.258'), (1, '5660.051')] [2023-12-26 11:04:48,829][123090] Updated weights for policy 1, policy_version 1428921 (0.0009) [2023-12-26 11:04:48,842][123091] Updated weights for policy 0, policy_version 1438616 (0.0009) [2023-12-26 11:04:48,901][123091] Updated weights for policy 0, policy_version 1438626 (0.0010) [2023-12-26 11:04:48,948][123091] Updated weights for policy 0, policy_version 1438636 (0.0010) [2023-12-26 11:04:49,696][123090] Updated weights for policy 1, policy_version 1428931 (0.0010) [2023-12-26 11:04:49,746][123090] Updated weights for policy 1, policy_version 1428941 (0.0009) [2023-12-26 11:04:49,793][123091] Updated weights for policy 0, policy_version 1438646 (0.0010) [2023-12-26 11:04:49,801][123090] Updated weights for policy 1, policy_version 1428951 (0.0008) [2023-12-26 11:04:49,862][123091] Updated weights for policy 0, policy_version 1438656 (0.0011) [2023-12-26 11:04:49,929][123091] Updated weights for policy 0, policy_version 1438666 (0.0010) [2023-12-26 11:04:50,646][123091] Updated weights for policy 0, policy_version 1438676 (0.0008) [2023-12-26 11:04:50,705][123090] Updated weights for policy 1, policy_version 1428961 (0.0010) [2023-12-26 11:04:50,712][123091] Updated weights for policy 0, policy_version 1438686 (0.0005) [2023-12-26 11:04:50,771][123090] Updated weights for policy 1, policy_version 1428971 (0.0009) [2023-12-26 11:04:50,774][123091] Updated weights for policy 0, policy_version 1438696 (0.0005) [2023-12-26 11:04:50,838][123090] Updated weights for policy 1, policy_version 1428981 (0.0009) [2023-12-26 11:04:50,900][123090] Updated weights for policy 1, policy_version 1428991 (0.0009) [2023-12-26 11:04:51,513][123091] Updated weights for policy 0, policy_version 1438706 (0.0007) [2023-12-26 11:04:51,575][123091] Updated weights for policy 0, policy_version 1438716 (0.0006) [2023-12-26 11:04:51,646][123091] Updated weights for policy 0, policy_version 1438726 (0.0008) [2023-12-26 11:04:51,711][123091] Updated weights for policy 0, policy_version 1438736 (0.0008) [2023-12-26 11:04:51,754][123090] Updated weights for policy 1, policy_version 1429001 (0.0009) [2023-12-26 11:04:51,813][123090] Updated weights for policy 1, policy_version 1429011 (0.0009) [2023-12-26 11:04:51,872][123090] Updated weights for policy 1, policy_version 1429021 (0.0009) [2023-12-26 11:04:52,382][123091] Updated weights for policy 0, policy_version 1438746 (0.0010) [2023-12-26 11:04:52,450][123091] Updated weights for policy 0, policy_version 1438756 (0.0010) [2023-12-26 11:04:52,508][123091] Updated weights for policy 0, policy_version 1438766 (0.0010) [2023-12-26 11:04:52,748][123090] Updated weights for policy 1, policy_version 1429031 (0.0009) [2023-12-26 11:04:52,810][123090] Updated weights for policy 1, policy_version 1429041 (0.0010) [2023-12-26 11:04:52,875][123090] Updated weights for policy 1, policy_version 1429051 (0.0009) [2023-12-26 11:04:53,383][123091] Updated weights for policy 0, policy_version 1438776 (0.0009) [2023-12-26 11:04:53,442][123091] Updated weights for policy 0, policy_version 1438786 (0.0009) [2023-12-26 11:04:53,507][123091] Updated weights for policy 0, policy_version 1438796 (0.0009) [2023-12-26 11:04:53,538][123090] Updated weights for policy 1, policy_version 1429061 (0.0007) [2023-12-26 11:04:53,606][123090] Updated weights for policy 1, policy_version 1429071 (0.0007) [2023-12-26 11:04:53,671][123090] Updated weights for policy 1, policy_version 1429081 (0.0006) [2023-12-26 11:04:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 734183424. Throughput: 0: 9092.0, 1: 8744.4. Samples: 734154156. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:53,785][121949] Avg episode reward: [(0, '6258.524'), (1, '5319.574')] [2023-12-26 11:04:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001438800_368336896.pth... [2023-12-26 11:04:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001429088_365846528.pth... [2023-12-26 11:04:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001437712_368058368.pth [2023-12-26 11:04:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001428032_365576192.pth [2023-12-26 11:04:54,267][123090] Updated weights for policy 1, policy_version 1429091 (0.0005) [2023-12-26 11:04:54,333][123090] Updated weights for policy 1, policy_version 1429101 (0.0009) [2023-12-26 11:04:54,341][123091] Updated weights for policy 0, policy_version 1438806 (0.0007) [2023-12-26 11:04:54,392][123090] Updated weights for policy 1, policy_version 1429111 (0.0008) [2023-12-26 11:04:54,395][123091] Updated weights for policy 0, policy_version 1438816 (0.0007) [2023-12-26 11:04:54,460][123091] Updated weights for policy 0, policy_version 1438826 (0.0009) [2023-12-26 11:04:55,081][123090] Updated weights for policy 1, policy_version 1429121 (0.0005) [2023-12-26 11:04:55,139][123090] Updated weights for policy 1, policy_version 1429131 (0.0005) [2023-12-26 11:04:55,200][123090] Updated weights for policy 1, policy_version 1429141 (0.0006) [2023-12-26 11:04:55,213][123091] Updated weights for policy 0, policy_version 1438836 (0.0008) [2023-12-26 11:04:55,249][123090] Updated weights for policy 1, policy_version 1429151 (0.0005) [2023-12-26 11:04:55,268][123091] Updated weights for policy 0, policy_version 1438846 (0.0005) [2023-12-26 11:04:55,335][123091] Updated weights for policy 0, policy_version 1438856 (0.0005) [2023-12-26 11:04:55,966][123091] Updated weights for policy 0, policy_version 1438866 (0.0006) [2023-12-26 11:04:56,030][123091] Updated weights for policy 0, policy_version 1438876 (0.0011) [2023-12-26 11:04:56,037][123090] Updated weights for policy 1, policy_version 1429161 (0.0010) [2023-12-26 11:04:56,093][123091] Updated weights for policy 0, policy_version 1438886 (0.0011) [2023-12-26 11:04:56,101][123090] Updated weights for policy 1, policy_version 1429171 (0.0011) [2023-12-26 11:04:56,156][123091] Updated weights for policy 0, policy_version 1438896 (0.0011) [2023-12-26 11:04:56,161][123090] Updated weights for policy 1, policy_version 1429181 (0.0010) [2023-12-26 11:04:56,852][123091] Updated weights for policy 0, policy_version 1438906 (0.0010) [2023-12-26 11:04:56,907][123091] Updated weights for policy 0, policy_version 1438916 (0.0010) [2023-12-26 11:04:56,954][123091] Updated weights for policy 0, policy_version 1438926 (0.0010) [2023-12-26 11:04:56,975][123090] Updated weights for policy 1, policy_version 1429191 (0.0010) [2023-12-26 11:04:57,029][123090] Updated weights for policy 1, policy_version 1429201 (0.0010) [2023-12-26 11:04:57,086][123090] Updated weights for policy 1, policy_version 1429211 (0.0010) [2023-12-26 11:04:57,675][123091] Updated weights for policy 0, policy_version 1438936 (0.0008) [2023-12-26 11:04:57,726][123091] Updated weights for policy 0, policy_version 1438946 (0.0010) [2023-12-26 11:04:57,777][123091] Updated weights for policy 0, policy_version 1438956 (0.0010) [2023-12-26 11:04:57,918][123090] Updated weights for policy 1, policy_version 1429221 (0.0010) [2023-12-26 11:04:57,972][123090] Updated weights for policy 1, policy_version 1429231 (0.0008) [2023-12-26 11:04:58,035][123090] Updated weights for policy 1, policy_version 1429241 (0.0008) [2023-12-26 11:04:58,641][123091] Updated weights for policy 0, policy_version 1438966 (0.0010) [2023-12-26 11:04:58,712][123091] Updated weights for policy 0, policy_version 1438976 (0.0013) [2023-12-26 11:04:58,781][123091] Updated weights for policy 0, policy_version 1438986 (0.0010) [2023-12-26 11:04:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 734265344. Throughput: 0: 9185.2, 1: 8813.7. Samples: 734265728. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:04:58,785][121949] Avg episode reward: [(0, '6314.865'), (1, '5383.417')] [2023-12-26 11:04:58,892][123090] Updated weights for policy 1, policy_version 1429251 (0.0009) [2023-12-26 11:04:58,951][123090] Updated weights for policy 1, policy_version 1429261 (0.0009) [2023-12-26 11:04:59,015][123090] Updated weights for policy 1, policy_version 1429271 (0.0009) [2023-12-26 11:04:59,582][123091] Updated weights for policy 0, policy_version 1438996 (0.0008) [2023-12-26 11:04:59,632][123091] Updated weights for policy 0, policy_version 1439006 (0.0005) [2023-12-26 11:04:59,695][123091] Updated weights for policy 0, policy_version 1439016 (0.0005) [2023-12-26 11:04:59,783][123090] Updated weights for policy 1, policy_version 1429281 (0.0009) [2023-12-26 11:04:59,854][123090] Updated weights for policy 1, policy_version 1429291 (0.0008) [2023-12-26 11:04:59,913][123090] Updated weights for policy 1, policy_version 1429301 (0.0010) [2023-12-26 11:04:59,977][123090] Updated weights for policy 1, policy_version 1429311 (0.0008) [2023-12-26 11:05:00,493][123091] Updated weights for policy 0, policy_version 1439026 (0.0007) [2023-12-26 11:05:00,559][123091] Updated weights for policy 0, policy_version 1439036 (0.0010) [2023-12-26 11:05:00,615][123091] Updated weights for policy 0, policy_version 1439048 (0.0009) [2023-12-26 11:05:00,749][123090] Updated weights for policy 1, policy_version 1429321 (0.0009) [2023-12-26 11:05:00,804][123090] Updated weights for policy 1, policy_version 1429331 (0.0009) [2023-12-26 11:05:00,865][123090] Updated weights for policy 1, policy_version 1429341 (0.0009) [2023-12-26 11:05:01,465][123091] Updated weights for policy 0, policy_version 1439058 (0.0010) [2023-12-26 11:05:01,520][123091] Updated weights for policy 0, policy_version 1439068 (0.0009) [2023-12-26 11:05:01,572][123091] Updated weights for policy 0, policy_version 1439078 (0.0009) [2023-12-26 11:05:01,642][123091] Updated weights for policy 0, policy_version 1439088 (0.0009) [2023-12-26 11:05:01,728][123090] Updated weights for policy 1, policy_version 1429351 (0.0009) [2023-12-26 11:05:01,794][123090] Updated weights for policy 1, policy_version 1429361 (0.0010) [2023-12-26 11:05:01,848][123090] Updated weights for policy 1, policy_version 1429371 (0.0010) [2023-12-26 11:05:02,466][123091] Updated weights for policy 0, policy_version 1439098 (0.0007) [2023-12-26 11:05:02,536][123091] Updated weights for policy 0, policy_version 1439108 (0.0005) [2023-12-26 11:05:02,609][123091] Updated weights for policy 0, policy_version 1439118 (0.0005) [2023-12-26 11:05:02,727][123090] Updated weights for policy 1, policy_version 1429381 (0.0010) [2023-12-26 11:05:02,789][123090] Updated weights for policy 1, policy_version 1429391 (0.0010) [2023-12-26 11:05:02,841][123090] Updated weights for policy 1, policy_version 1429401 (0.0008) [2023-12-26 11:05:03,254][123091] Updated weights for policy 0, policy_version 1439128 (0.0009) [2023-12-26 11:05:03,307][123091] Updated weights for policy 0, policy_version 1439139 (0.0010) [2023-12-26 11:05:03,361][123091] Updated weights for policy 0, policy_version 1439151 (0.0010) [2023-12-26 11:05:03,616][123090] Updated weights for policy 1, policy_version 1429411 (0.0008) [2023-12-26 11:05:03,678][123090] Updated weights for policy 1, policy_version 1429421 (0.0006) [2023-12-26 11:05:03,732][123090] Updated weights for policy 1, policy_version 1429431 (0.0005) [2023-12-26 11:05:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 734363648. Throughput: 0: 9104.5, 1: 8802.5. Samples: 734369592. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:03,785][121949] Avg episode reward: [(0, '6221.299'), (1, '5584.556')] [2023-12-26 11:05:04,253][123091] Updated weights for policy 0, policy_version 1439161 (0.0008) [2023-12-26 11:05:04,322][123091] Updated weights for policy 0, policy_version 1439171 (0.0005) [2023-12-26 11:05:04,391][123091] Updated weights for policy 0, policy_version 1439181 (0.0005) [2023-12-26 11:05:04,554][123090] Updated weights for policy 1, policy_version 1429441 (0.0007) [2023-12-26 11:05:04,627][123090] Updated weights for policy 1, policy_version 1429451 (0.0010) [2023-12-26 11:05:04,701][123090] Updated weights for policy 1, policy_version 1429461 (0.0010) [2023-12-26 11:05:04,771][123090] Updated weights for policy 1, policy_version 1429471 (0.0009) [2023-12-26 11:05:05,106][123091] Updated weights for policy 0, policy_version 1439191 (0.0008) [2023-12-26 11:05:05,172][123091] Updated weights for policy 0, policy_version 1439201 (0.0009) [2023-12-26 11:05:05,229][123091] Updated weights for policy 0, policy_version 1439211 (0.0009) [2023-12-26 11:05:05,592][123090] Updated weights for policy 1, policy_version 1429481 (0.0009) [2023-12-26 11:05:05,646][123090] Updated weights for policy 1, policy_version 1429491 (0.0009) [2023-12-26 11:05:05,705][123090] Updated weights for policy 1, policy_version 1429501 (0.0009) [2023-12-26 11:05:06,018][123091] Updated weights for policy 0, policy_version 1439221 (0.0007) [2023-12-26 11:05:06,078][123091] Updated weights for policy 0, policy_version 1439231 (0.0009) [2023-12-26 11:05:06,139][123091] Updated weights for policy 0, policy_version 1439241 (0.0009) [2023-12-26 11:05:06,469][123090] Updated weights for policy 1, policy_version 1429511 (0.0007) [2023-12-26 11:05:06,529][123090] Updated weights for policy 1, policy_version 1429521 (0.0005) [2023-12-26 11:05:06,578][123090] Updated weights for policy 1, policy_version 1429531 (0.0005) [2023-12-26 11:05:06,903][123091] Updated weights for policy 0, policy_version 1439251 (0.0008) [2023-12-26 11:05:06,968][123091] Updated weights for policy 0, policy_version 1439261 (0.0005) [2023-12-26 11:05:07,036][123091] Updated weights for policy 0, policy_version 1439271 (0.0006) [2023-12-26 11:05:07,443][123090] Updated weights for policy 1, policy_version 1429541 (0.0008) [2023-12-26 11:05:07,490][123090] Updated weights for policy 1, policy_version 1429551 (0.0009) [2023-12-26 11:05:07,539][123090] Updated weights for policy 1, policy_version 1429561 (0.0008) [2023-12-26 11:05:07,807][123091] Updated weights for policy 0, policy_version 1439281 (0.0006) [2023-12-26 11:05:07,862][123091] Updated weights for policy 0, policy_version 1439291 (0.0010) [2023-12-26 11:05:07,921][123091] Updated weights for policy 0, policy_version 1439301 (0.0011) [2023-12-26 11:05:07,984][123091] Updated weights for policy 0, policy_version 1439311 (0.0009) [2023-12-26 11:05:08,397][123090] Updated weights for policy 1, policy_version 1429571 (0.0008) [2023-12-26 11:05:08,465][123090] Updated weights for policy 1, policy_version 1429581 (0.0010) [2023-12-26 11:05:08,532][123090] Updated weights for policy 1, policy_version 1429591 (0.0009) [2023-12-26 11:05:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 734445568. Throughput: 0: 9135.5, 1: 8845.9. Samples: 734423300. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:08,785][121949] Avg episode reward: [(0, '6200.583'), (1, '5682.489')] [2023-12-26 11:05:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001429600_365977600.pth... [2023-12-26 11:05:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001428576_365715456.pth [2023-12-26 11:05:08,809][123091] Updated weights for policy 0, policy_version 1439321 (0.0009) [2023-12-26 11:05:08,880][123091] Updated weights for policy 0, policy_version 1439331 (0.0011) [2023-12-26 11:05:08,945][123091] Updated weights for policy 0, policy_version 1439341 (0.0011) [2023-12-26 11:05:08,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001439344_368476160.pth... [2023-12-26 11:05:08,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001438256_368197632.pth [2023-12-26 11:05:09,452][123090] Updated weights for policy 1, policy_version 1429601 (0.0009) [2023-12-26 11:05:09,515][123090] Updated weights for policy 1, policy_version 1429611 (0.0009) [2023-12-26 11:05:09,584][123090] Updated weights for policy 1, policy_version 1429621 (0.0008) [2023-12-26 11:05:09,652][123090] Updated weights for policy 1, policy_version 1429631 (0.0005) [2023-12-26 11:05:09,774][123091] Updated weights for policy 0, policy_version 1439351 (0.0009) [2023-12-26 11:05:09,849][123091] Updated weights for policy 0, policy_version 1439361 (0.0010) [2023-12-26 11:05:09,915][123091] Updated weights for policy 0, policy_version 1439371 (0.0010) [2023-12-26 11:05:10,401][123090] Updated weights for policy 1, policy_version 1429641 (0.0010) [2023-12-26 11:05:10,454][123090] Updated weights for policy 1, policy_version 1429651 (0.0011) [2023-12-26 11:05:10,506][123090] Updated weights for policy 1, policy_version 1429661 (0.0010) [2023-12-26 11:05:10,743][123091] Updated weights for policy 0, policy_version 1439381 (0.0007) [2023-12-26 11:05:10,808][123091] Updated weights for policy 0, policy_version 1439391 (0.0005) [2023-12-26 11:05:10,873][123091] Updated weights for policy 0, policy_version 1439401 (0.0007) [2023-12-26 11:05:11,333][123090] Updated weights for policy 1, policy_version 1429671 (0.0011) [2023-12-26 11:05:11,401][123090] Updated weights for policy 1, policy_version 1429681 (0.0011) [2023-12-26 11:05:11,467][123090] Updated weights for policy 1, policy_version 1429691 (0.0011) [2023-12-26 11:05:11,625][123091] Updated weights for policy 0, policy_version 1439411 (0.0010) [2023-12-26 11:05:11,692][123091] Updated weights for policy 0, policy_version 1439421 (0.0010) [2023-12-26 11:05:11,760][123091] Updated weights for policy 0, policy_version 1439431 (0.0010) [2023-12-26 11:05:12,285][123090] Updated weights for policy 1, policy_version 1429701 (0.0010) [2023-12-26 11:05:12,354][123090] Updated weights for policy 1, policy_version 1429711 (0.0010) [2023-12-26 11:05:12,426][123090] Updated weights for policy 1, policy_version 1429721 (0.0011) [2023-12-26 11:05:12,615][123091] Updated weights for policy 0, policy_version 1439441 (0.0009) [2023-12-26 11:05:12,684][123091] Updated weights for policy 0, policy_version 1439451 (0.0008) [2023-12-26 11:05:12,753][123091] Updated weights for policy 0, policy_version 1439461 (0.0010) [2023-12-26 11:05:12,815][123091] Updated weights for policy 0, policy_version 1439471 (0.0010) [2023-12-26 11:05:13,229][123090] Updated weights for policy 1, policy_version 1429731 (0.0009) [2023-12-26 11:05:13,283][123090] Updated weights for policy 1, policy_version 1429741 (0.0009) [2023-12-26 11:05:13,338][123090] Updated weights for policy 1, policy_version 1429751 (0.0009) [2023-12-26 11:05:13,623][123091] Updated weights for policy 0, policy_version 1439481 (0.0008) [2023-12-26 11:05:13,680][123091] Updated weights for policy 0, policy_version 1439491 (0.0010) [2023-12-26 11:05:13,742][123091] Updated weights for policy 0, policy_version 1439501 (0.0009) [2023-12-26 11:05:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 734535680. Throughput: 0: 9053.7, 1: 8689.7. Samples: 734525544. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:13,785][121949] Avg episode reward: [(0, '6221.419'), (1, '5543.288')] [2023-12-26 11:05:14,160][123090] Updated weights for policy 1, policy_version 1429761 (0.0009) [2023-12-26 11:05:14,219][123090] Updated weights for policy 1, policy_version 1429771 (0.0008) [2023-12-26 11:05:14,283][123090] Updated weights for policy 1, policy_version 1429781 (0.0008) [2023-12-26 11:05:14,342][123090] Updated weights for policy 1, policy_version 1429791 (0.0009) [2023-12-26 11:05:14,550][123091] Updated weights for policy 0, policy_version 1439511 (0.0007) [2023-12-26 11:05:14,607][123091] Updated weights for policy 0, policy_version 1439521 (0.0006) [2023-12-26 11:05:14,664][123091] Updated weights for policy 0, policy_version 1439531 (0.0006) [2023-12-26 11:05:15,254][123090] Updated weights for policy 1, policy_version 1429801 (0.0009) [2023-12-26 11:05:15,303][123090] Updated weights for policy 1, policy_version 1429811 (0.0009) [2023-12-26 11:05:15,361][123090] Updated weights for policy 1, policy_version 1429821 (0.0007) [2023-12-26 11:05:15,367][123091] Updated weights for policy 0, policy_version 1439541 (0.0009) [2023-12-26 11:05:15,418][123091] Updated weights for policy 0, policy_version 1439551 (0.0010) [2023-12-26 11:05:15,477][123091] Updated weights for policy 0, policy_version 1439561 (0.0010) [2023-12-26 11:05:16,188][123090] Updated weights for policy 1, policy_version 1429831 (0.0006) [2023-12-26 11:05:16,234][123091] Updated weights for policy 0, policy_version 1439571 (0.0009) [2023-12-26 11:05:16,246][123090] Updated weights for policy 1, policy_version 1429841 (0.0005) [2023-12-26 11:05:16,282][123091] Updated weights for policy 0, policy_version 1439581 (0.0005) [2023-12-26 11:05:16,309][123090] Updated weights for policy 1, policy_version 1429851 (0.0006) [2023-12-26 11:05:16,337][123091] Updated weights for policy 0, policy_version 1439591 (0.0005) [2023-12-26 11:05:16,916][123091] Updated weights for policy 0, policy_version 1439601 (0.0005) [2023-12-26 11:05:16,948][123090] Updated weights for policy 1, policy_version 1429861 (0.0005) [2023-12-26 11:05:16,973][123091] Updated weights for policy 0, policy_version 1439611 (0.0005) [2023-12-26 11:05:17,010][123090] Updated weights for policy 1, policy_version 1429871 (0.0005) [2023-12-26 11:05:17,034][123091] Updated weights for policy 0, policy_version 1439621 (0.0005) [2023-12-26 11:05:17,069][123090] Updated weights for policy 1, policy_version 1429881 (0.0007) [2023-12-26 11:05:17,079][123091] Updated weights for policy 0, policy_version 1439631 (0.0005) [2023-12-26 11:05:17,794][123091] Updated weights for policy 0, policy_version 1439641 (0.0005) [2023-12-26 11:05:17,864][123090] Updated weights for policy 1, policy_version 1429891 (0.0009) [2023-12-26 11:05:17,866][123091] Updated weights for policy 0, policy_version 1439651 (0.0005) [2023-12-26 11:05:17,923][123091] Updated weights for policy 0, policy_version 1439661 (0.0009) [2023-12-26 11:05:17,925][123090] Updated weights for policy 1, policy_version 1429901 (0.0008) [2023-12-26 11:05:17,976][123090] Updated weights for policy 1, policy_version 1429911 (0.0010) [2023-12-26 11:05:18,643][123091] Updated weights for policy 0, policy_version 1439671 (0.0007) [2023-12-26 11:05:18,716][123091] Updated weights for policy 0, policy_version 1439681 (0.0007) [2023-12-26 11:05:18,780][123091] Updated weights for policy 0, policy_version 1439691 (0.0006) [2023-12-26 11:05:18,780][123090] Updated weights for policy 1, policy_version 1429921 (0.0010) [2023-12-26 11:05:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 734617600. Throughput: 0: 9109.2, 1: 8669.3. Samples: 734635744. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:18,785][121949] Avg episode reward: [(0, '6273.792'), (1, '5335.118')] [2023-12-26 11:05:18,840][123090] Updated weights for policy 1, policy_version 1429931 (0.0011) [2023-12-26 11:05:18,905][123090] Updated weights for policy 1, policy_version 1429941 (0.0011) [2023-12-26 11:05:18,966][123090] Updated weights for policy 1, policy_version 1429951 (0.0011) [2023-12-26 11:05:19,524][123091] Updated weights for policy 0, policy_version 1439701 (0.0007) [2023-12-26 11:05:19,583][123091] Updated weights for policy 0, policy_version 1439711 (0.0008) [2023-12-26 11:05:19,641][123091] Updated weights for policy 0, policy_version 1439721 (0.0010) [2023-12-26 11:05:19,806][123090] Updated weights for policy 1, policy_version 1429961 (0.0008) [2023-12-26 11:05:19,878][123090] Updated weights for policy 1, policy_version 1429971 (0.0011) [2023-12-26 11:05:19,950][123090] Updated weights for policy 1, policy_version 1429981 (0.0011) [2023-12-26 11:05:20,472][123091] Updated weights for policy 0, policy_version 1439731 (0.0011) [2023-12-26 11:05:20,532][123091] Updated weights for policy 0, policy_version 1439741 (0.0011) [2023-12-26 11:05:20,594][123091] Updated weights for policy 0, policy_version 1439751 (0.0010) [2023-12-26 11:05:20,785][123090] Updated weights for policy 1, policy_version 1429991 (0.0011) [2023-12-26 11:05:20,846][123090] Updated weights for policy 1, policy_version 1430001 (0.0007) [2023-12-26 11:05:20,910][123090] Updated weights for policy 1, policy_version 1430011 (0.0005) [2023-12-26 11:05:21,418][123091] Updated weights for policy 0, policy_version 1439761 (0.0010) [2023-12-26 11:05:21,482][123091] Updated weights for policy 0, policy_version 1439771 (0.0009) [2023-12-26 11:05:21,546][123091] Updated weights for policy 0, policy_version 1439781 (0.0009) [2023-12-26 11:05:21,612][123091] Updated weights for policy 0, policy_version 1439791 (0.0010) [2023-12-26 11:05:21,683][123090] Updated weights for policy 1, policy_version 1430021 (0.0007) [2023-12-26 11:05:21,752][123090] Updated weights for policy 1, policy_version 1430031 (0.0009) [2023-12-26 11:05:21,814][123090] Updated weights for policy 1, policy_version 1430041 (0.0008) [2023-12-26 11:05:22,472][123091] Updated weights for policy 0, policy_version 1439801 (0.0011) [2023-12-26 11:05:22,540][123091] Updated weights for policy 0, policy_version 1439811 (0.0011) [2023-12-26 11:05:22,606][123091] Updated weights for policy 0, policy_version 1439821 (0.0006) [2023-12-26 11:05:22,714][123090] Updated weights for policy 1, policy_version 1430051 (0.0010) [2023-12-26 11:05:22,786][123090] Updated weights for policy 1, policy_version 1430061 (0.0009) [2023-12-26 11:05:22,856][123090] Updated weights for policy 1, policy_version 1430071 (0.0005) [2023-12-26 11:05:23,303][123091] Updated weights for policy 0, policy_version 1439831 (0.0005) [2023-12-26 11:05:23,355][123091] Updated weights for policy 0, policy_version 1439841 (0.0005) [2023-12-26 11:05:23,418][123091] Updated weights for policy 0, policy_version 1439851 (0.0006) [2023-12-26 11:05:23,658][123090] Updated weights for policy 1, policy_version 1430081 (0.0009) [2023-12-26 11:05:23,720][123090] Updated weights for policy 1, policy_version 1430091 (0.0010) [2023-12-26 11:05:23,782][123090] Updated weights for policy 1, policy_version 1430101 (0.0010) [2023-12-26 11:05:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 734707712. Throughput: 0: 9065.0, 1: 8646.0. Samples: 734686996. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:23,785][121949] Avg episode reward: [(0, '6148.402'), (1, '5326.565')] [2023-12-26 11:05:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001439856_368607232.pth... [2023-12-26 11:05:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001438800_368336896.pth [2023-12-26 11:05:23,841][123090] Updated weights for policy 1, policy_version 1430111 (0.0010) [2023-12-26 11:05:23,846][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001430112_366108672.pth... [2023-12-26 11:05:23,849][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001429088_365846528.pth [2023-12-26 11:05:24,155][123091] Updated weights for policy 0, policy_version 1439861 (0.0005) [2023-12-26 11:05:24,214][123091] Updated weights for policy 0, policy_version 1439871 (0.0006) [2023-12-26 11:05:24,267][123091] Updated weights for policy 0, policy_version 1439881 (0.0010) [2023-12-26 11:05:24,638][123090] Updated weights for policy 1, policy_version 1430121 (0.0006) [2023-12-26 11:05:24,683][123090] Updated weights for policy 1, policy_version 1430131 (0.0005) [2023-12-26 11:05:24,730][123090] Updated weights for policy 1, policy_version 1430141 (0.0005) [2023-12-26 11:05:25,071][123091] Updated weights for policy 0, policy_version 1439891 (0.0010) [2023-12-26 11:05:25,126][123091] Updated weights for policy 0, policy_version 1439901 (0.0010) [2023-12-26 11:05:25,173][123091] Updated weights for policy 0, policy_version 1439911 (0.0010) [2023-12-26 11:05:25,440][123090] Updated weights for policy 1, policy_version 1430151 (0.0009) [2023-12-26 11:05:25,484][123090] Updated weights for policy 1, policy_version 1430161 (0.0010) [2023-12-26 11:05:25,535][123090] Updated weights for policy 1, policy_version 1430171 (0.0010) [2023-12-26 11:05:25,935][123091] Updated weights for policy 0, policy_version 1439921 (0.0011) [2023-12-26 11:05:25,985][123091] Updated weights for policy 0, policy_version 1439931 (0.0010) [2023-12-26 11:05:26,033][123091] Updated weights for policy 0, policy_version 1439941 (0.0010) [2023-12-26 11:05:26,084][123091] Updated weights for policy 0, policy_version 1439951 (0.0010) [2023-12-26 11:05:26,204][123090] Updated weights for policy 1, policy_version 1430181 (0.0010) [2023-12-26 11:05:26,264][123090] Updated weights for policy 1, policy_version 1430191 (0.0011) [2023-12-26 11:05:26,324][123090] Updated weights for policy 1, policy_version 1430201 (0.0010) [2023-12-26 11:05:26,866][123091] Updated weights for policy 0, policy_version 1439961 (0.0010) [2023-12-26 11:05:26,919][123091] Updated weights for policy 0, policy_version 1439971 (0.0010) [2023-12-26 11:05:26,985][123091] Updated weights for policy 0, policy_version 1439981 (0.0010) [2023-12-26 11:05:27,130][123090] Updated weights for policy 1, policy_version 1430211 (0.0009) [2023-12-26 11:05:27,177][123090] Updated weights for policy 1, policy_version 1430221 (0.0005) [2023-12-26 11:05:27,234][123090] Updated weights for policy 1, policy_version 1430231 (0.0005) [2023-12-26 11:05:27,771][123091] Updated weights for policy 0, policy_version 1439991 (0.0007) [2023-12-26 11:05:27,816][123091] Updated weights for policy 0, policy_version 1440001 (0.0005) [2023-12-26 11:05:27,872][123091] Updated weights for policy 0, policy_version 1440011 (0.0009) [2023-12-26 11:05:27,942][123090] Updated weights for policy 1, policy_version 1430241 (0.0006) [2023-12-26 11:05:28,007][123090] Updated weights for policy 1, policy_version 1430251 (0.0006) [2023-12-26 11:05:28,060][123090] Updated weights for policy 1, policy_version 1430261 (0.0009) [2023-12-26 11:05:28,115][123090] Updated weights for policy 1, policy_version 1430271 (0.0010) [2023-12-26 11:05:28,569][123091] Updated weights for policy 0, policy_version 1440021 (0.0008) [2023-12-26 11:05:28,620][123091] Updated weights for policy 0, policy_version 1440031 (0.0006) [2023-12-26 11:05:28,668][123091] Updated weights for policy 0, policy_version 1440041 (0.0006) [2023-12-26 11:05:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 734806016. Throughput: 0: 9154.1, 1: 8748.4. Samples: 734796752. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:28,785][121949] Avg episode reward: [(0, '6126.478'), (1, '5369.915')] [2023-12-26 11:05:28,836][123090] Updated weights for policy 1, policy_version 1430281 (0.0006) [2023-12-26 11:05:28,908][123090] Updated weights for policy 1, policy_version 1430291 (0.0006) [2023-12-26 11:05:28,965][123090] Updated weights for policy 1, policy_version 1430301 (0.0005) [2023-12-26 11:05:29,404][123091] Updated weights for policy 0, policy_version 1440051 (0.0007) [2023-12-26 11:05:29,463][123091] Updated weights for policy 0, policy_version 1440061 (0.0010) [2023-12-26 11:05:29,517][123091] Updated weights for policy 0, policy_version 1440071 (0.0010) [2023-12-26 11:05:29,634][123090] Updated weights for policy 1, policy_version 1430311 (0.0008) [2023-12-26 11:05:29,681][123090] Updated weights for policy 1, policy_version 1430321 (0.0009) [2023-12-26 11:05:29,734][123090] Updated weights for policy 1, policy_version 1430331 (0.0005) [2023-12-26 11:05:30,307][123091] Updated weights for policy 0, policy_version 1440081 (0.0010) [2023-12-26 11:05:30,365][123091] Updated weights for policy 0, policy_version 1440091 (0.0005) [2023-12-26 11:05:30,415][123091] Updated weights for policy 0, policy_version 1440101 (0.0006) [2023-12-26 11:05:30,483][123090] Updated weights for policy 1, policy_version 1430341 (0.0007) [2023-12-26 11:05:30,489][123091] Updated weights for policy 0, policy_version 1440111 (0.0008) [2023-12-26 11:05:30,543][123090] Updated weights for policy 1, policy_version 1430351 (0.0007) [2023-12-26 11:05:30,598][123090] Updated weights for policy 1, policy_version 1430361 (0.0009) [2023-12-26 11:05:31,284][123091] Updated weights for policy 0, policy_version 1440121 (0.0010) [2023-12-26 11:05:31,335][123091] Updated weights for policy 0, policy_version 1440131 (0.0010) [2023-12-26 11:05:31,396][123090] Updated weights for policy 1, policy_version 1430371 (0.0008) [2023-12-26 11:05:31,401][123091] Updated weights for policy 0, policy_version 1440141 (0.0009) [2023-12-26 11:05:31,461][123090] Updated weights for policy 1, policy_version 1430381 (0.0008) [2023-12-26 11:05:31,521][123090] Updated weights for policy 1, policy_version 1430391 (0.0008) [2023-12-26 11:05:32,240][123091] Updated weights for policy 0, policy_version 1440151 (0.0008) [2023-12-26 11:05:32,299][123091] Updated weights for policy 0, policy_version 1440162 (0.0010) [2023-12-26 11:05:32,356][123091] Updated weights for policy 0, policy_version 1440172 (0.0008) [2023-12-26 11:05:32,356][123090] Updated weights for policy 1, policy_version 1430401 (0.0009) [2023-12-26 11:05:32,423][123090] Updated weights for policy 1, policy_version 1430411 (0.0009) [2023-12-26 11:05:32,494][123090] Updated weights for policy 1, policy_version 1430421 (0.0006) [2023-12-26 11:05:32,557][123090] Updated weights for policy 1, policy_version 1430431 (0.0009) [2023-12-26 11:05:33,086][123091] Updated weights for policy 0, policy_version 1440182 (0.0008) [2023-12-26 11:05:33,143][123091] Updated weights for policy 0, policy_version 1440192 (0.0009) [2023-12-26 11:05:33,198][123091] Updated weights for policy 0, policy_version 1440202 (0.0008) [2023-12-26 11:05:33,398][123090] Updated weights for policy 1, policy_version 1430441 (0.0009) [2023-12-26 11:05:33,444][123090] Updated weights for policy 1, policy_version 1430451 (0.0008) [2023-12-26 11:05:33,505][123090] Updated weights for policy 1, policy_version 1430461 (0.0010) [2023-12-26 11:05:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 734896128. Throughput: 0: 9052.4, 1: 8798.3. Samples: 734905960. Policy #0 lag: (min: 31.0, avg: 33.7, max: 63.0) [2023-12-26 11:05:33,785][121949] Avg episode reward: [(0, '6276.425'), (1, '5387.035')] [2023-12-26 11:05:33,958][123091] Updated weights for policy 0, policy_version 1440212 (0.0008) [2023-12-26 11:05:34,005][123091] Updated weights for policy 0, policy_version 1440222 (0.0005) [2023-12-26 11:05:34,063][123091] Updated weights for policy 0, policy_version 1440232 (0.0005) [2023-12-26 11:05:34,369][123090] Updated weights for policy 1, policy_version 1430471 (0.0008) [2023-12-26 11:05:34,432][123090] Updated weights for policy 1, policy_version 1430481 (0.0006) [2023-12-26 11:05:34,490][123090] Updated weights for policy 1, policy_version 1430491 (0.0005) [2023-12-26 11:05:34,893][123091] Updated weights for policy 0, policy_version 1440242 (0.0010) [2023-12-26 11:05:34,940][123091] Updated weights for policy 0, policy_version 1440252 (0.0010) [2023-12-26 11:05:34,999][123091] Updated weights for policy 0, policy_version 1440262 (0.0010) [2023-12-26 11:05:35,053][123091] Updated weights for policy 0, policy_version 1440272 (0.0010) [2023-12-26 11:05:35,196][123090] Updated weights for policy 1, policy_version 1430501 (0.0005) [2023-12-26 11:05:35,260][123090] Updated weights for policy 1, policy_version 1430511 (0.0008) [2023-12-26 11:05:35,325][123090] Updated weights for policy 1, policy_version 1430521 (0.0007) [2023-12-26 11:05:35,780][123091] Updated weights for policy 0, policy_version 1440282 (0.0011) [2023-12-26 11:05:35,836][123091] Updated weights for policy 0, policy_version 1440292 (0.0011) [2023-12-26 11:05:35,909][123091] Updated weights for policy 0, policy_version 1440302 (0.0009) [2023-12-26 11:05:36,054][123090] Updated weights for policy 1, policy_version 1430531 (0.0005) [2023-12-26 11:05:36,107][123090] Updated weights for policy 1, policy_version 1430541 (0.0008) [2023-12-26 11:05:36,171][123090] Updated weights for policy 1, policy_version 1430551 (0.0011) [2023-12-26 11:05:36,707][123091] Updated weights for policy 0, policy_version 1440312 (0.0006) [2023-12-26 11:05:36,763][123091] Updated weights for policy 0, policy_version 1440322 (0.0007) [2023-12-26 11:05:36,823][123091] Updated weights for policy 0, policy_version 1440332 (0.0009) [2023-12-26 11:05:37,012][123090] Updated weights for policy 1, policy_version 1430561 (0.0011) [2023-12-26 11:05:37,083][123090] Updated weights for policy 1, policy_version 1430571 (0.0010) [2023-12-26 11:05:37,153][123090] Updated weights for policy 1, policy_version 1430581 (0.0010) [2023-12-26 11:05:37,222][123090] Updated weights for policy 1, policy_version 1430591 (0.0010) [2023-12-26 11:05:37,626][123091] Updated weights for policy 0, policy_version 1440342 (0.0009) [2023-12-26 11:05:37,674][123091] Updated weights for policy 0, policy_version 1440352 (0.0008) [2023-12-26 11:05:37,727][123091] Updated weights for policy 0, policy_version 1440362 (0.0007) [2023-12-26 11:05:38,023][123090] Updated weights for policy 1, policy_version 1430601 (0.0010) [2023-12-26 11:05:38,086][123090] Updated weights for policy 1, policy_version 1430611 (0.0010) [2023-12-26 11:05:38,141][123090] Updated weights for policy 1, policy_version 1430621 (0.0010) [2023-12-26 11:05:38,543][123091] Updated weights for policy 0, policy_version 1440372 (0.0007) [2023-12-26 11:05:38,596][123091] Updated weights for policy 0, policy_version 1440382 (0.0009) [2023-12-26 11:05:38,649][123091] Updated weights for policy 0, policy_version 1440392 (0.0009) [2023-12-26 11:05:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 734986240. Throughput: 0: 9076.3, 1: 8854.6. Samples: 734961044. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:05:38,785][121949] Avg episode reward: [(0, '6367.993'), (1, '5412.274')] [2023-12-26 11:05:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001440400_368746496.pth... [2023-12-26 11:05:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001430624_366239744.pth... [2023-12-26 11:05:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001439344_368476160.pth [2023-12-26 11:05:38,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001429600_365977600.pth [2023-12-26 11:05:38,969][123090] Updated weights for policy 1, policy_version 1430631 (0.0010) [2023-12-26 11:05:39,032][123090] Updated weights for policy 1, policy_version 1430641 (0.0008) [2023-12-26 11:05:39,107][123090] Updated weights for policy 1, policy_version 1430651 (0.0008) [2023-12-26 11:05:39,353][123091] Updated weights for policy 0, policy_version 1440402 (0.0007) [2023-12-26 11:05:39,430][123091] Updated weights for policy 0, policy_version 1440412 (0.0010) [2023-12-26 11:05:39,495][123091] Updated weights for policy 0, policy_version 1440422 (0.0009) [2023-12-26 11:05:39,558][123091] Updated weights for policy 0, policy_version 1440432 (0.0009) [2023-12-26 11:05:39,944][123090] Updated weights for policy 1, policy_version 1430661 (0.0010) [2023-12-26 11:05:40,013][123090] Updated weights for policy 1, policy_version 1430671 (0.0010) [2023-12-26 11:05:40,080][123090] Updated weights for policy 1, policy_version 1430681 (0.0009) [2023-12-26 11:05:40,440][123091] Updated weights for policy 0, policy_version 1440442 (0.0010) [2023-12-26 11:05:40,503][123091] Updated weights for policy 0, policy_version 1440452 (0.0009) [2023-12-26 11:05:40,556][123091] Updated weights for policy 0, policy_version 1440462 (0.0010) [2023-12-26 11:05:40,979][123090] Updated weights for policy 1, policy_version 1430691 (0.0010) [2023-12-26 11:05:41,044][123090] Updated weights for policy 1, policy_version 1430701 (0.0010) [2023-12-26 11:05:41,116][123090] Updated weights for policy 1, policy_version 1430711 (0.0010) [2023-12-26 11:05:41,302][123091] Updated weights for policy 0, policy_version 1440472 (0.0009) [2023-12-26 11:05:41,360][123091] Updated weights for policy 0, policy_version 1440482 (0.0007) [2023-12-26 11:05:41,426][123091] Updated weights for policy 0, policy_version 1440492 (0.0010) [2023-12-26 11:05:41,998][123090] Updated weights for policy 1, policy_version 1430721 (0.0009) [2023-12-26 11:05:42,066][123090] Updated weights for policy 1, policy_version 1430731 (0.0006) [2023-12-26 11:05:42,133][123090] Updated weights for policy 1, policy_version 1430741 (0.0010) [2023-12-26 11:05:42,149][123091] Updated weights for policy 0, policy_version 1440502 (0.0011) [2023-12-26 11:05:42,194][123090] Updated weights for policy 1, policy_version 1430751 (0.0011) [2023-12-26 11:05:42,213][123091] Updated weights for policy 0, policy_version 1440512 (0.0011) [2023-12-26 11:05:42,281][123091] Updated weights for policy 0, policy_version 1440522 (0.0011) [2023-12-26 11:05:42,962][123090] Updated weights for policy 1, policy_version 1430761 (0.0005) [2023-12-26 11:05:42,996][123091] Updated weights for policy 0, policy_version 1440532 (0.0009) [2023-12-26 11:05:43,011][123090] Updated weights for policy 1, policy_version 1430771 (0.0005) [2023-12-26 11:05:43,064][123090] Updated weights for policy 1, policy_version 1430781 (0.0005) [2023-12-26 11:05:43,073][123091] Updated weights for policy 0, policy_version 1440542 (0.0005) [2023-12-26 11:05:43,140][123091] Updated weights for policy 0, policy_version 1440552 (0.0005) [2023-12-26 11:05:43,782][123091] Updated weights for policy 0, policy_version 1440562 (0.0005) [2023-12-26 11:05:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 735068160. Throughput: 0: 9005.0, 1: 8735.1. Samples: 735064032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:05:43,784][121949] Avg episode reward: [(0, '6287.039'), (1, '5589.626')] [2023-12-26 11:05:43,820][123090] Updated weights for policy 1, policy_version 1430791 (0.0006) [2023-12-26 11:05:43,841][123091] Updated weights for policy 0, policy_version 1440572 (0.0005) [2023-12-26 11:05:43,875][123090] Updated weights for policy 1, policy_version 1430801 (0.0005) [2023-12-26 11:05:43,893][123091] Updated weights for policy 0, policy_version 1440582 (0.0005) [2023-12-26 11:05:43,930][123090] Updated weights for policy 1, policy_version 1430811 (0.0008) [2023-12-26 11:05:43,951][123091] Updated weights for policy 0, policy_version 1440592 (0.0005) [2023-12-26 11:05:44,553][123090] Updated weights for policy 1, policy_version 1430821 (0.0007) [2023-12-26 11:05:44,615][123090] Updated weights for policy 1, policy_version 1430831 (0.0005) [2023-12-26 11:05:44,685][123090] Updated weights for policy 1, policy_version 1430841 (0.0005) [2023-12-26 11:05:44,711][123091] Updated weights for policy 0, policy_version 1440602 (0.0010) [2023-12-26 11:05:44,754][123091] Updated weights for policy 0, policy_version 1440612 (0.0010) [2023-12-26 11:05:44,821][123091] Updated weights for policy 0, policy_version 1440622 (0.0010) [2023-12-26 11:05:45,402][123090] Updated weights for policy 1, policy_version 1430851 (0.0007) [2023-12-26 11:05:45,465][123090] Updated weights for policy 1, policy_version 1430861 (0.0010) [2023-12-26 11:05:45,535][123090] Updated weights for policy 1, policy_version 1430871 (0.0011) [2023-12-26 11:05:45,585][123091] Updated weights for policy 0, policy_version 1440632 (0.0009) [2023-12-26 11:05:45,643][123091] Updated weights for policy 0, policy_version 1440642 (0.0010) [2023-12-26 11:05:45,705][123091] Updated weights for policy 0, policy_version 1440652 (0.0010) [2023-12-26 11:05:46,246][123090] Updated weights for policy 1, policy_version 1430881 (0.0010) [2023-12-26 11:05:46,297][123090] Updated weights for policy 1, policy_version 1430891 (0.0005) [2023-12-26 11:05:46,356][123090] Updated weights for policy 1, policy_version 1430901 (0.0007) [2023-12-26 11:05:46,416][123090] Updated weights for policy 1, policy_version 1430911 (0.0009) [2023-12-26 11:05:46,523][123091] Updated weights for policy 0, policy_version 1440662 (0.0010) [2023-12-26 11:05:46,579][123091] Updated weights for policy 0, policy_version 1440672 (0.0008) [2023-12-26 11:05:46,641][123091] Updated weights for policy 0, policy_version 1440682 (0.0006) [2023-12-26 11:05:47,121][123090] Updated weights for policy 1, policy_version 1430921 (0.0010) [2023-12-26 11:05:47,181][123090] Updated weights for policy 1, policy_version 1430931 (0.0011) [2023-12-26 11:05:47,233][123090] Updated weights for policy 1, policy_version 1430941 (0.0010) [2023-12-26 11:05:47,331][123091] Updated weights for policy 0, policy_version 1440692 (0.0005) [2023-12-26 11:05:47,390][123091] Updated weights for policy 0, policy_version 1440702 (0.0005) [2023-12-26 11:05:47,464][123091] Updated weights for policy 0, policy_version 1440712 (0.0006) [2023-12-26 11:05:48,075][123090] Updated weights for policy 1, policy_version 1430951 (0.0011) [2023-12-26 11:05:48,116][123091] Updated weights for policy 0, policy_version 1440722 (0.0005) [2023-12-26 11:05:48,139][123090] Updated weights for policy 1, policy_version 1430961 (0.0011) [2023-12-26 11:05:48,176][123091] Updated weights for policy 0, policy_version 1440732 (0.0005) [2023-12-26 11:05:48,192][123090] Updated weights for policy 1, policy_version 1430971 (0.0010) [2023-12-26 11:05:48,236][123091] Updated weights for policy 0, policy_version 1440742 (0.0005) [2023-12-26 11:05:48,299][123091] Updated weights for policy 0, policy_version 1440752 (0.0005) [2023-12-26 11:05:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 735166464. Throughput: 0: 9155.8, 1: 8857.2. Samples: 735180180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:05:48,785][121949] Avg episode reward: [(0, '6287.366'), (1, '5733.299')] [2023-12-26 11:05:48,965][123090] Updated weights for policy 1, policy_version 1430981 (0.0008) [2023-12-26 11:05:49,019][123090] Updated weights for policy 1, policy_version 1430991 (0.0007) [2023-12-26 11:05:49,055][123091] Updated weights for policy 0, policy_version 1440762 (0.0011) [2023-12-26 11:05:49,082][123090] Updated weights for policy 1, policy_version 1431001 (0.0005) [2023-12-26 11:05:49,115][123091] Updated weights for policy 0, policy_version 1440772 (0.0010) [2023-12-26 11:05:49,177][123091] Updated weights for policy 0, policy_version 1440782 (0.0010) [2023-12-26 11:05:49,833][123090] Updated weights for policy 1, policy_version 1431011 (0.0007) [2023-12-26 11:05:49,909][123090] Updated weights for policy 1, policy_version 1431021 (0.0008) [2023-12-26 11:05:49,974][123090] Updated weights for policy 1, policy_version 1431031 (0.0006) [2023-12-26 11:05:50,058][123091] Updated weights for policy 0, policy_version 1440792 (0.0011) [2023-12-26 11:05:50,128][123091] Updated weights for policy 0, policy_version 1440802 (0.0011) [2023-12-26 11:05:50,199][123091] Updated weights for policy 0, policy_version 1440812 (0.0011) [2023-12-26 11:05:50,646][123090] Updated weights for policy 1, policy_version 1431041 (0.0006) [2023-12-26 11:05:50,719][123090] Updated weights for policy 1, policy_version 1431051 (0.0010) [2023-12-26 11:05:50,786][123090] Updated weights for policy 1, policy_version 1431061 (0.0011) [2023-12-26 11:05:50,854][123090] Updated weights for policy 1, policy_version 1431071 (0.0011) [2023-12-26 11:05:51,018][123091] Updated weights for policy 0, policy_version 1440822 (0.0008) [2023-12-26 11:05:51,087][123091] Updated weights for policy 0, policy_version 1440832 (0.0009) [2023-12-26 11:05:51,159][123091] Updated weights for policy 0, policy_version 1440842 (0.0010) [2023-12-26 11:05:51,689][123090] Updated weights for policy 1, policy_version 1431081 (0.0007) [2023-12-26 11:05:51,766][123090] Updated weights for policy 1, policy_version 1431091 (0.0008) [2023-12-26 11:05:51,836][123090] Updated weights for policy 1, policy_version 1431101 (0.0010) [2023-12-26 11:05:51,993][123091] Updated weights for policy 0, policy_version 1440852 (0.0009) [2023-12-26 11:05:52,060][123091] Updated weights for policy 0, policy_version 1440862 (0.0009) [2023-12-26 11:05:52,128][123091] Updated weights for policy 0, policy_version 1440872 (0.0010) [2023-12-26 11:05:52,634][123090] Updated weights for policy 1, policy_version 1431111 (0.0010) [2023-12-26 11:05:52,703][123090] Updated weights for policy 1, policy_version 1431121 (0.0009) [2023-12-26 11:05:52,766][123090] Updated weights for policy 1, policy_version 1431131 (0.0009) [2023-12-26 11:05:52,968][123091] Updated weights for policy 0, policy_version 1440882 (0.0010) [2023-12-26 11:05:53,034][123091] Updated weights for policy 0, policy_version 1440892 (0.0009) [2023-12-26 11:05:53,089][123091] Updated weights for policy 0, policy_version 1440902 (0.0009) [2023-12-26 11:05:53,587][123090] Updated weights for policy 1, policy_version 1431141 (0.0009) [2023-12-26 11:05:53,650][123090] Updated weights for policy 1, policy_version 1431151 (0.0010) [2023-12-26 11:05:53,714][123090] Updated weights for policy 1, policy_version 1431161 (0.0010) [2023-12-26 11:05:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 735256576. Throughput: 0: 9102.1, 1: 8896.1. Samples: 735233220. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:05:53,785][121949] Avg episode reward: [(0, '6296.990'), (1, '5474.768')] [2023-12-26 11:05:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001431168_366379008.pth... [2023-12-26 11:05:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001440912_368877568.pth... [2023-12-26 11:05:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001439856_368607232.pth [2023-12-26 11:05:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001430112_366108672.pth [2023-12-26 11:05:53,922][123091] Updated weights for policy 0, policy_version 1440913 (0.0010) [2023-12-26 11:05:53,977][123091] Updated weights for policy 0, policy_version 1440923 (0.0008) [2023-12-26 11:05:54,043][123091] Updated weights for policy 0, policy_version 1440933 (0.0009) [2023-12-26 11:05:54,118][123091] Updated weights for policy 0, policy_version 1440943 (0.0010) [2023-12-26 11:05:54,450][123090] Updated weights for policy 1, policy_version 1431171 (0.0007) [2023-12-26 11:05:54,508][123090] Updated weights for policy 1, policy_version 1431181 (0.0006) [2023-12-26 11:05:54,567][123090] Updated weights for policy 1, policy_version 1431191 (0.0005) [2023-12-26 11:05:55,007][123091] Updated weights for policy 0, policy_version 1440953 (0.0010) [2023-12-26 11:05:55,058][123091] Updated weights for policy 0, policy_version 1440963 (0.0010) [2023-12-26 11:05:55,121][123091] Updated weights for policy 0, policy_version 1440973 (0.0011) [2023-12-26 11:05:55,297][123090] Updated weights for policy 1, policy_version 1431201 (0.0006) [2023-12-26 11:05:55,360][123090] Updated weights for policy 1, policy_version 1431211 (0.0010) [2023-12-26 11:05:55,422][123090] Updated weights for policy 1, policy_version 1431221 (0.0005) [2023-12-26 11:05:55,468][123090] Updated weights for policy 1, policy_version 1431231 (0.0005) [2023-12-26 11:05:55,942][123091] Updated weights for policy 0, policy_version 1440983 (0.0010) [2023-12-26 11:05:56,008][123091] Updated weights for policy 0, policy_version 1440993 (0.0009) [2023-12-26 11:05:56,057][123091] Updated weights for policy 0, policy_version 1441003 (0.0009) [2023-12-26 11:05:56,206][123090] Updated weights for policy 1, policy_version 1431241 (0.0006) [2023-12-26 11:05:56,260][123090] Updated weights for policy 1, policy_version 1431251 (0.0005) [2023-12-26 11:05:56,315][123090] Updated weights for policy 1, policy_version 1431261 (0.0006) [2023-12-26 11:05:56,934][123091] Updated weights for policy 0, policy_version 1441013 (0.0011) [2023-12-26 11:05:56,990][123091] Updated weights for policy 0, policy_version 1441023 (0.0009) [2023-12-26 11:05:57,009][123090] Updated weights for policy 1, policy_version 1431271 (0.0005) [2023-12-26 11:05:57,052][123091] Updated weights for policy 0, policy_version 1441033 (0.0010) [2023-12-26 11:05:57,066][123090] Updated weights for policy 1, policy_version 1431281 (0.0005) [2023-12-26 11:05:57,127][123090] Updated weights for policy 1, policy_version 1431291 (0.0005) [2023-12-26 11:05:57,797][123091] Updated weights for policy 0, policy_version 1441043 (0.0007) [2023-12-26 11:05:57,864][123091] Updated weights for policy 0, policy_version 1441053 (0.0009) [2023-12-26 11:05:57,912][123091] Updated weights for policy 0, policy_version 1441063 (0.0008) [2023-12-26 11:05:57,945][123090] Updated weights for policy 1, policy_version 1431301 (0.0009) [2023-12-26 11:05:57,992][123090] Updated weights for policy 1, policy_version 1431311 (0.0009) [2023-12-26 11:05:58,051][123090] Updated weights for policy 1, policy_version 1431321 (0.0008) [2023-12-26 11:05:58,773][123091] Updated weights for policy 0, policy_version 1441073 (0.0007) [2023-12-26 11:05:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 735338496. Throughput: 0: 9050.3, 1: 8997.8. Samples: 735337704. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:05:58,784][121949] Avg episode reward: [(0, '6264.174'), (1, '5345.247')] [2023-12-26 11:05:58,833][123091] Updated weights for policy 0, policy_version 1441083 (0.0010) [2023-12-26 11:05:58,894][123091] Updated weights for policy 0, policy_version 1441093 (0.0009) [2023-12-26 11:05:58,936][123090] Updated weights for policy 1, policy_version 1431331 (0.0009) [2023-12-26 11:05:58,948][123091] Updated weights for policy 0, policy_version 1441103 (0.0008) [2023-12-26 11:05:58,990][123090] Updated weights for policy 1, policy_version 1431341 (0.0009) [2023-12-26 11:05:59,051][123090] Updated weights for policy 1, policy_version 1431351 (0.0009) [2023-12-26 11:05:59,729][123091] Updated weights for policy 0, policy_version 1441113 (0.0010) [2023-12-26 11:05:59,780][123091] Updated weights for policy 0, policy_version 1441123 (0.0008) [2023-12-26 11:05:59,844][123091] Updated weights for policy 0, policy_version 1441133 (0.0007) [2023-12-26 11:05:59,924][123090] Updated weights for policy 1, policy_version 1431361 (0.0008) [2023-12-26 11:05:59,987][123090] Updated weights for policy 1, policy_version 1431371 (0.0010) [2023-12-26 11:06:00,044][123090] Updated weights for policy 1, policy_version 1431381 (0.0006) [2023-12-26 11:06:00,093][123090] Updated weights for policy 1, policy_version 1431391 (0.0005) [2023-12-26 11:06:00,612][123091] Updated weights for policy 0, policy_version 1441143 (0.0006) [2023-12-26 11:06:00,671][123091] Updated weights for policy 0, policy_version 1441153 (0.0006) [2023-12-26 11:06:00,743][123091] Updated weights for policy 0, policy_version 1441163 (0.0005) [2023-12-26 11:06:00,892][123090] Updated weights for policy 1, policy_version 1431401 (0.0010) [2023-12-26 11:06:00,961][123090] Updated weights for policy 1, policy_version 1431411 (0.0010) [2023-12-26 11:06:01,030][123090] Updated weights for policy 1, policy_version 1431421 (0.0010) [2023-12-26 11:06:01,383][123091] Updated weights for policy 0, policy_version 1441173 (0.0007) [2023-12-26 11:06:01,443][123091] Updated weights for policy 0, policy_version 1441183 (0.0011) [2023-12-26 11:06:01,503][123091] Updated weights for policy 0, policy_version 1441193 (0.0011) [2023-12-26 11:06:01,783][123090] Updated weights for policy 1, policy_version 1431431 (0.0007) [2023-12-26 11:06:01,836][123090] Updated weights for policy 1, policy_version 1431441 (0.0005) [2023-12-26 11:06:01,888][123090] Updated weights for policy 1, policy_version 1431451 (0.0005) [2023-12-26 11:06:02,313][123091] Updated weights for policy 0, policy_version 1441203 (0.0009) [2023-12-26 11:06:02,381][123091] Updated weights for policy 0, policy_version 1441213 (0.0007) [2023-12-26 11:06:02,440][123091] Updated weights for policy 0, policy_version 1441223 (0.0011) [2023-12-26 11:06:02,654][123090] Updated weights for policy 1, policy_version 1431461 (0.0007) [2023-12-26 11:06:02,711][123090] Updated weights for policy 1, policy_version 1431471 (0.0009) [2023-12-26 11:06:02,776][123090] Updated weights for policy 1, policy_version 1431481 (0.0009) [2023-12-26 11:06:03,240][123091] Updated weights for policy 0, policy_version 1441233 (0.0010) [2023-12-26 11:06:03,296][123091] Updated weights for policy 0, policy_version 1441243 (0.0009) [2023-12-26 11:06:03,348][123091] Updated weights for policy 0, policy_version 1441253 (0.0009) [2023-12-26 11:06:03,396][123091] Updated weights for policy 0, policy_version 1441263 (0.0008) [2023-12-26 11:06:03,559][123090] Updated weights for policy 1, policy_version 1431491 (0.0008) [2023-12-26 11:06:03,613][123090] Updated weights for policy 1, policy_version 1431501 (0.0006) [2023-12-26 11:06:03,666][123090] Updated weights for policy 1, policy_version 1431511 (0.0010) [2023-12-26 11:06:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 735436800. Throughput: 0: 9011.0, 1: 8976.4. Samples: 735445176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:03,785][121949] Avg episode reward: [(0, '6267.656'), (1, '5364.007')] [2023-12-26 11:06:04,205][123091] Updated weights for policy 0, policy_version 1441273 (0.0009) [2023-12-26 11:06:04,278][123091] Updated weights for policy 0, policy_version 1441283 (0.0010) [2023-12-26 11:06:04,343][123091] Updated weights for policy 0, policy_version 1441293 (0.0009) [2023-12-26 11:06:04,458][123090] Updated weights for policy 1, policy_version 1431521 (0.0010) [2023-12-26 11:06:04,532][123090] Updated weights for policy 1, policy_version 1431531 (0.0010) [2023-12-26 11:06:04,596][123090] Updated weights for policy 1, policy_version 1431541 (0.0009) [2023-12-26 11:06:04,659][123090] Updated weights for policy 1, policy_version 1431551 (0.0009) [2023-12-26 11:06:05,143][123091] Updated weights for policy 0, policy_version 1441303 (0.0010) [2023-12-26 11:06:05,196][123091] Updated weights for policy 0, policy_version 1441314 (0.0010) [2023-12-26 11:06:05,247][123091] Updated weights for policy 0, policy_version 1441324 (0.0009) [2023-12-26 11:06:05,368][123090] Updated weights for policy 1, policy_version 1431561 (0.0006) [2023-12-26 11:06:05,416][123090] Updated weights for policy 1, policy_version 1431571 (0.0005) [2023-12-26 11:06:05,464][123090] Updated weights for policy 1, policy_version 1431581 (0.0005) [2023-12-26 11:06:06,168][123091] Updated weights for policy 0, policy_version 1441334 (0.0008) [2023-12-26 11:06:06,229][123091] Updated weights for policy 0, policy_version 1441344 (0.0007) [2023-12-26 11:06:06,244][123090] Updated weights for policy 1, policy_version 1431591 (0.0009) [2023-12-26 11:06:06,289][123091] Updated weights for policy 0, policy_version 1441354 (0.0009) [2023-12-26 11:06:06,295][123090] Updated weights for policy 1, policy_version 1431601 (0.0008) [2023-12-26 11:06:06,358][123090] Updated weights for policy 1, policy_version 1431611 (0.0008) [2023-12-26 11:06:07,064][123091] Updated weights for policy 0, policy_version 1441364 (0.0009) [2023-12-26 11:06:07,130][123091] Updated weights for policy 0, policy_version 1441374 (0.0007) [2023-12-26 11:06:07,192][123091] Updated weights for policy 0, policy_version 1441384 (0.0009) [2023-12-26 11:06:07,197][123090] Updated weights for policy 1, policy_version 1431621 (0.0007) [2023-12-26 11:06:07,258][123090] Updated weights for policy 1, policy_version 1431631 (0.0005) [2023-12-26 11:06:07,325][123090] Updated weights for policy 1, policy_version 1431641 (0.0005) [2023-12-26 11:06:07,939][123090] Updated weights for policy 1, policy_version 1431651 (0.0005) [2023-12-26 11:06:07,986][123090] Updated weights for policy 1, policy_version 1431661 (0.0007) [2023-12-26 11:06:08,036][123090] Updated weights for policy 1, policy_version 1431671 (0.0005) [2023-12-26 11:06:08,054][123091] Updated weights for policy 0, policy_version 1441394 (0.0009) [2023-12-26 11:06:08,115][123091] Updated weights for policy 0, policy_version 1441404 (0.0007) [2023-12-26 11:06:08,183][123091] Updated weights for policy 0, policy_version 1441414 (0.0005) [2023-12-26 11:06:08,242][123091] Updated weights for policy 0, policy_version 1441424 (0.0009) [2023-12-26 11:06:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 735518720. Throughput: 0: 9007.1, 1: 9009.9. Samples: 735497760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:08,785][121949] Avg episode reward: [(0, '6255.965'), (1, '5204.428')] [2023-12-26 11:06:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001441424_369008640.pth... [2023-12-26 11:06:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001431680_366510080.pth... [2023-12-26 11:06:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001430624_366239744.pth [2023-12-26 11:06:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001440400_368746496.pth [2023-12-26 11:06:08,812][123090] Updated weights for policy 1, policy_version 1431681 (0.0008) [2023-12-26 11:06:08,882][123090] Updated weights for policy 1, policy_version 1431691 (0.0010) [2023-12-26 11:06:08,950][123090] Updated weights for policy 1, policy_version 1431701 (0.0009) [2023-12-26 11:06:08,980][123091] Updated weights for policy 0, policy_version 1441434 (0.0008) [2023-12-26 11:06:09,018][123090] Updated weights for policy 1, policy_version 1431711 (0.0008) [2023-12-26 11:06:09,038][123091] Updated weights for policy 0, policy_version 1441444 (0.0006) [2023-12-26 11:06:09,092][123091] Updated weights for policy 0, policy_version 1441454 (0.0005) [2023-12-26 11:06:09,864][123090] Updated weights for policy 1, policy_version 1431721 (0.0008) [2023-12-26 11:06:09,884][123091] Updated weights for policy 0, policy_version 1441464 (0.0009) [2023-12-26 11:06:09,929][123090] Updated weights for policy 1, policy_version 1431731 (0.0009) [2023-12-26 11:06:09,955][123091] Updated weights for policy 0, policy_version 1441474 (0.0009) [2023-12-26 11:06:10,000][123090] Updated weights for policy 1, policy_version 1431741 (0.0009) [2023-12-26 11:06:10,021][123091] Updated weights for policy 0, policy_version 1441484 (0.0007) [2023-12-26 11:06:10,705][123091] Updated weights for policy 0, policy_version 1441494 (0.0006) [2023-12-26 11:06:10,764][123091] Updated weights for policy 0, policy_version 1441504 (0.0008) [2023-12-26 11:06:10,770][123090] Updated weights for policy 1, policy_version 1431751 (0.0007) [2023-12-26 11:06:10,828][123091] Updated weights for policy 0, policy_version 1441514 (0.0008) [2023-12-26 11:06:10,844][123090] Updated weights for policy 1, policy_version 1431761 (0.0006) [2023-12-26 11:06:10,915][123090] Updated weights for policy 1, policy_version 1431771 (0.0008) [2023-12-26 11:06:11,633][123091] Updated weights for policy 0, policy_version 1441524 (0.0007) [2023-12-26 11:06:11,701][123091] Updated weights for policy 0, policy_version 1441534 (0.0008) [2023-12-26 11:06:11,737][123090] Updated weights for policy 1, policy_version 1431781 (0.0007) [2023-12-26 11:06:11,770][123091] Updated weights for policy 0, policy_version 1441544 (0.0005) [2023-12-26 11:06:11,810][123090] Updated weights for policy 1, policy_version 1431791 (0.0010) [2023-12-26 11:06:11,873][123090] Updated weights for policy 1, policy_version 1431801 (0.0010) [2023-12-26 11:06:12,557][123091] Updated weights for policy 0, policy_version 1441554 (0.0007) [2023-12-26 11:06:12,616][123091] Updated weights for policy 0, policy_version 1441564 (0.0010) [2023-12-26 11:06:12,671][123090] Updated weights for policy 1, policy_version 1431811 (0.0009) [2023-12-26 11:06:12,684][123091] Updated weights for policy 0, policy_version 1441574 (0.0009) [2023-12-26 11:06:12,732][123090] Updated weights for policy 1, policy_version 1431821 (0.0007) [2023-12-26 11:06:12,748][123091] Updated weights for policy 0, policy_version 1441584 (0.0008) [2023-12-26 11:06:12,799][123090] Updated weights for policy 1, policy_version 1431831 (0.0007) [2023-12-26 11:06:13,533][123090] Updated weights for policy 1, policy_version 1431841 (0.0006) [2023-12-26 11:06:13,587][123090] Updated weights for policy 1, policy_version 1431851 (0.0006) [2023-12-26 11:06:13,636][123090] Updated weights for policy 1, policy_version 1431861 (0.0007) [2023-12-26 11:06:13,653][123091] Updated weights for policy 0, policy_version 1441594 (0.0008) [2023-12-26 11:06:13,690][123090] Updated weights for policy 1, policy_version 1431871 (0.0006) [2023-12-26 11:06:13,720][123091] Updated weights for policy 0, policy_version 1441604 (0.0008) [2023-12-26 11:06:13,780][123091] Updated weights for policy 0, policy_version 1441614 (0.0009) [2023-12-26 11:06:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 735608832. Throughput: 0: 8956.1, 1: 8986.4. Samples: 735604164. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:13,785][121949] Avg episode reward: [(0, '6381.375'), (1, '5330.969')] [2023-12-26 11:06:14,512][123091] Updated weights for policy 0, policy_version 1441624 (0.0008) [2023-12-26 11:06:14,536][123090] Updated weights for policy 1, policy_version 1431881 (0.0010) [2023-12-26 11:06:14,573][123091] Updated weights for policy 0, policy_version 1441634 (0.0007) [2023-12-26 11:06:14,588][123090] Updated weights for policy 1, policy_version 1431891 (0.0010) [2023-12-26 11:06:14,633][123091] Updated weights for policy 0, policy_version 1441644 (0.0005) [2023-12-26 11:06:14,647][123090] Updated weights for policy 1, policy_version 1431901 (0.0010) [2023-12-26 11:06:15,364][123090] Updated weights for policy 1, policy_version 1431911 (0.0006) [2023-12-26 11:06:15,434][123090] Updated weights for policy 1, policy_version 1431921 (0.0006) [2023-12-26 11:06:15,517][123090] Updated weights for policy 1, policy_version 1431931 (0.0006) [2023-12-26 11:06:15,529][123091] Updated weights for policy 0, policy_version 1441654 (0.0009) [2023-12-26 11:06:15,604][123091] Updated weights for policy 0, policy_version 1441664 (0.0009) [2023-12-26 11:06:15,661][123091] Updated weights for policy 0, policy_version 1441674 (0.0010) [2023-12-26 11:06:16,207][123090] Updated weights for policy 1, policy_version 1431941 (0.0007) [2023-12-26 11:06:16,274][123090] Updated weights for policy 1, policy_version 1431951 (0.0009) [2023-12-26 11:06:16,329][123090] Updated weights for policy 1, policy_version 1431961 (0.0007) [2023-12-26 11:06:16,541][123091] Updated weights for policy 0, policy_version 1441685 (0.0011) [2023-12-26 11:06:16,596][123091] Updated weights for policy 0, policy_version 1441695 (0.0010) [2023-12-26 11:06:16,674][123091] Updated weights for policy 0, policy_version 1441705 (0.0009) [2023-12-26 11:06:17,040][123090] Updated weights for policy 1, policy_version 1431971 (0.0005) [2023-12-26 11:06:17,123][123090] Updated weights for policy 1, policy_version 1431981 (0.0005) [2023-12-26 11:06:17,197][123090] Updated weights for policy 1, policy_version 1431991 (0.0005) [2023-12-26 11:06:17,362][123091] Updated weights for policy 0, policy_version 1441715 (0.0006) [2023-12-26 11:06:17,417][123091] Updated weights for policy 0, policy_version 1441725 (0.0005) [2023-12-26 11:06:17,463][123091] Updated weights for policy 0, policy_version 1441735 (0.0006) [2023-12-26 11:06:17,792][123090] Updated weights for policy 1, policy_version 1432001 (0.0005) [2023-12-26 11:06:17,864][123090] Updated weights for policy 1, policy_version 1432011 (0.0005) [2023-12-26 11:06:17,927][123090] Updated weights for policy 1, policy_version 1432021 (0.0006) [2023-12-26 11:06:17,996][123090] Updated weights for policy 1, policy_version 1432031 (0.0006) [2023-12-26 11:06:18,197][123091] Updated weights for policy 0, policy_version 1441745 (0.0005) [2023-12-26 11:06:18,258][123091] Updated weights for policy 0, policy_version 1441755 (0.0006) [2023-12-26 11:06:18,307][123091] Updated weights for policy 0, policy_version 1441765 (0.0009) [2023-12-26 11:06:18,366][123091] Updated weights for policy 0, policy_version 1441775 (0.0009) [2023-12-26 11:06:18,753][123090] Updated weights for policy 1, policy_version 1432041 (0.0010) [2023-12-26 11:06:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 735698944. Throughput: 0: 8905.9, 1: 9056.4. Samples: 735714260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:18,784][121949] Avg episode reward: [(0, '6407.987'), (1, '5511.275')] [2023-12-26 11:06:18,814][123090] Updated weights for policy 1, policy_version 1432051 (0.0010) [2023-12-26 11:06:18,864][123090] Updated weights for policy 1, policy_version 1432061 (0.0009) [2023-12-26 11:06:19,103][123091] Updated weights for policy 0, policy_version 1441785 (0.0006) [2023-12-26 11:06:19,158][123091] Updated weights for policy 0, policy_version 1441795 (0.0005) [2023-12-26 11:06:19,216][123091] Updated weights for policy 0, policy_version 1441805 (0.0006) [2023-12-26 11:06:19,706][123090] Updated weights for policy 1, policy_version 1432071 (0.0009) [2023-12-26 11:06:19,761][123090] Updated weights for policy 1, policy_version 1432081 (0.0010) [2023-12-26 11:06:19,825][123090] Updated weights for policy 1, policy_version 1432091 (0.0009) [2023-12-26 11:06:20,058][123091] Updated weights for policy 0, policy_version 1441815 (0.0007) [2023-12-26 11:06:20,130][123091] Updated weights for policy 0, policy_version 1441825 (0.0006) [2023-12-26 11:06:20,200][123091] Updated weights for policy 0, policy_version 1441835 (0.0009) [2023-12-26 11:06:20,579][123090] Updated weights for policy 1, policy_version 1432101 (0.0009) [2023-12-26 11:06:20,646][123090] Updated weights for policy 1, policy_version 1432111 (0.0010) [2023-12-26 11:06:20,705][123090] Updated weights for policy 1, policy_version 1432121 (0.0010) [2023-12-26 11:06:20,934][123091] Updated weights for policy 0, policy_version 1441845 (0.0010) [2023-12-26 11:06:21,002][123091] Updated weights for policy 0, policy_version 1441855 (0.0009) [2023-12-26 11:06:21,075][123091] Updated weights for policy 0, policy_version 1441865 (0.0007) [2023-12-26 11:06:21,515][123090] Updated weights for policy 1, policy_version 1432131 (0.0009) [2023-12-26 11:06:21,583][123090] Updated weights for policy 1, policy_version 1432141 (0.0005) [2023-12-26 11:06:21,657][123090] Updated weights for policy 1, policy_version 1432151 (0.0008) [2023-12-26 11:06:21,863][123091] Updated weights for policy 0, policy_version 1441875 (0.0006) [2023-12-26 11:06:21,911][123091] Updated weights for policy 0, policy_version 1441885 (0.0009) [2023-12-26 11:06:21,967][123091] Updated weights for policy 0, policy_version 1441895 (0.0009) [2023-12-26 11:06:22,471][123090] Updated weights for policy 1, policy_version 1432161 (0.0011) [2023-12-26 11:06:22,531][123090] Updated weights for policy 1, policy_version 1432171 (0.0011) [2023-12-26 11:06:22,598][123090] Updated weights for policy 1, policy_version 1432181 (0.0011) [2023-12-26 11:06:22,662][123090] Updated weights for policy 1, policy_version 1432191 (0.0011) [2023-12-26 11:06:22,831][123091] Updated weights for policy 0, policy_version 1441905 (0.0009) [2023-12-26 11:06:22,892][123091] Updated weights for policy 0, policy_version 1441915 (0.0010) [2023-12-26 11:06:22,941][123091] Updated weights for policy 0, policy_version 1441925 (0.0009) [2023-12-26 11:06:22,998][123091] Updated weights for policy 0, policy_version 1441935 (0.0009) [2023-12-26 11:06:23,491][123090] Updated weights for policy 1, policy_version 1432201 (0.0011) [2023-12-26 11:06:23,551][123090] Updated weights for policy 1, policy_version 1432211 (0.0010) [2023-12-26 11:06:23,615][123090] Updated weights for policy 1, policy_version 1432221 (0.0010) [2023-12-26 11:06:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 735789056. Throughput: 0: 8884.3, 1: 9034.3. Samples: 735767376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:23,785][121949] Avg episode reward: [(0, '6348.530'), (1, '5369.919')] [2023-12-26 11:06:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001441936_369139712.pth... [2023-12-26 11:06:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001432224_366649344.pth... [2023-12-26 11:06:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001431168_366379008.pth [2023-12-26 11:06:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001440912_368877568.pth [2023-12-26 11:06:23,870][123091] Updated weights for policy 0, policy_version 1441945 (0.0011) [2023-12-26 11:06:23,932][123091] Updated weights for policy 0, policy_version 1441955 (0.0011) [2023-12-26 11:06:24,004][123091] Updated weights for policy 0, policy_version 1441965 (0.0006) [2023-12-26 11:06:24,310][123090] Updated weights for policy 1, policy_version 1432231 (0.0011) [2023-12-26 11:06:24,378][123090] Updated weights for policy 1, policy_version 1432241 (0.0011) [2023-12-26 11:06:24,447][123090] Updated weights for policy 1, policy_version 1432251 (0.0011) [2023-12-26 11:06:24,786][123091] Updated weights for policy 0, policy_version 1441975 (0.0009) [2023-12-26 11:06:24,842][123091] Updated weights for policy 0, policy_version 1441985 (0.0010) [2023-12-26 11:06:24,894][123091] Updated weights for policy 0, policy_version 1441995 (0.0010) [2023-12-26 11:06:25,231][123090] Updated weights for policy 1, policy_version 1432261 (0.0008) [2023-12-26 11:06:25,292][123090] Updated weights for policy 1, policy_version 1432271 (0.0005) [2023-12-26 11:06:25,349][123090] Updated weights for policy 1, policy_version 1432281 (0.0006) [2023-12-26 11:06:25,710][123091] Updated weights for policy 0, policy_version 1442005 (0.0008) [2023-12-26 11:06:25,769][123091] Updated weights for policy 0, policy_version 1442015 (0.0005) [2023-12-26 11:06:25,822][123091] Updated weights for policy 0, policy_version 1442025 (0.0005) [2023-12-26 11:06:26,015][123090] Updated weights for policy 1, policy_version 1432291 (0.0010) [2023-12-26 11:06:26,074][123090] Updated weights for policy 1, policy_version 1432301 (0.0010) [2023-12-26 11:06:26,133][123090] Updated weights for policy 1, policy_version 1432311 (0.0009) [2023-12-26 11:06:26,495][123091] Updated weights for policy 0, policy_version 1442035 (0.0007) [2023-12-26 11:06:26,546][123091] Updated weights for policy 0, policy_version 1442045 (0.0010) [2023-12-26 11:06:26,597][123091] Updated weights for policy 0, policy_version 1442055 (0.0010) [2023-12-26 11:06:26,842][123090] Updated weights for policy 1, policy_version 1432321 (0.0005) [2023-12-26 11:06:26,908][123090] Updated weights for policy 1, policy_version 1432331 (0.0006) [2023-12-26 11:06:26,974][123090] Updated weights for policy 1, policy_version 1432341 (0.0005) [2023-12-26 11:06:27,041][123090] Updated weights for policy 1, policy_version 1432351 (0.0008) [2023-12-26 11:06:27,412][123091] Updated weights for policy 0, policy_version 1442065 (0.0010) [2023-12-26 11:06:27,470][123091] Updated weights for policy 0, policy_version 1442075 (0.0010) [2023-12-26 11:06:27,535][123091] Updated weights for policy 0, policy_version 1442085 (0.0010) [2023-12-26 11:06:27,589][123091] Updated weights for policy 0, policy_version 1442095 (0.0010) [2023-12-26 11:06:27,789][123090] Updated weights for policy 1, policy_version 1432361 (0.0010) [2023-12-26 11:06:27,850][123090] Updated weights for policy 1, policy_version 1432371 (0.0010) [2023-12-26 11:06:27,908][123090] Updated weights for policy 1, policy_version 1432381 (0.0010) [2023-12-26 11:06:28,272][123091] Updated weights for policy 0, policy_version 1442105 (0.0006) [2023-12-26 11:06:28,329][123091] Updated weights for policy 0, policy_version 1442115 (0.0007) [2023-12-26 11:06:28,393][123091] Updated weights for policy 0, policy_version 1442125 (0.0006) [2023-12-26 11:06:28,689][123090] Updated weights for policy 1, policy_version 1432391 (0.0009) [2023-12-26 11:06:28,748][123090] Updated weights for policy 1, policy_version 1432401 (0.0005) [2023-12-26 11:06:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 735879168. Throughput: 0: 8886.4, 1: 9148.5. Samples: 735875604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:28,785][121949] Avg episode reward: [(0, '6270.638'), (1, '5445.989')] [2023-12-26 11:06:28,800][123090] Updated weights for policy 1, policy_version 1432411 (0.0005) [2023-12-26 11:06:29,114][123091] Updated weights for policy 0, policy_version 1442135 (0.0008) [2023-12-26 11:06:29,170][123091] Updated weights for policy 0, policy_version 1442145 (0.0009) [2023-12-26 11:06:29,258][123091] Updated weights for policy 0, policy_version 1442155 (0.0009) [2023-12-26 11:06:29,577][123090] Updated weights for policy 1, policy_version 1432421 (0.0008) [2023-12-26 11:06:29,624][123090] Updated weights for policy 1, policy_version 1432431 (0.0010) [2023-12-26 11:06:29,679][123090] Updated weights for policy 1, policy_version 1432441 (0.0010) [2023-12-26 11:06:30,086][123091] Updated weights for policy 0, policy_version 1442165 (0.0009) [2023-12-26 11:06:30,134][123091] Updated weights for policy 0, policy_version 1442175 (0.0009) [2023-12-26 11:06:30,191][123091] Updated weights for policy 0, policy_version 1442185 (0.0009) [2023-12-26 11:06:30,526][123090] Updated weights for policy 1, policy_version 1432451 (0.0009) [2023-12-26 11:06:30,577][123090] Updated weights for policy 1, policy_version 1432461 (0.0005) [2023-12-26 11:06:30,624][123090] Updated weights for policy 1, policy_version 1432471 (0.0005) [2023-12-26 11:06:31,078][123091] Updated weights for policy 0, policy_version 1442195 (0.0009) [2023-12-26 11:06:31,146][123091] Updated weights for policy 0, policy_version 1442205 (0.0009) [2023-12-26 11:06:31,199][123091] Updated weights for policy 0, policy_version 1442215 (0.0008) [2023-12-26 11:06:31,344][123090] Updated weights for policy 1, policy_version 1432481 (0.0005) [2023-12-26 11:06:31,416][123090] Updated weights for policy 1, policy_version 1432491 (0.0010) [2023-12-26 11:06:31,477][123090] Updated weights for policy 1, policy_version 1432501 (0.0006) [2023-12-26 11:06:31,537][123090] Updated weights for policy 1, policy_version 1432511 (0.0010) [2023-12-26 11:06:32,063][123091] Updated weights for policy 0, policy_version 1442225 (0.0006) [2023-12-26 11:06:32,117][123091] Updated weights for policy 0, policy_version 1442235 (0.0010) [2023-12-26 11:06:32,168][123091] Updated weights for policy 0, policy_version 1442245 (0.0009) [2023-12-26 11:06:32,221][123091] Updated weights for policy 0, policy_version 1442255 (0.0009) [2023-12-26 11:06:32,242][123090] Updated weights for policy 1, policy_version 1432521 (0.0006) [2023-12-26 11:06:32,304][123090] Updated weights for policy 1, policy_version 1432531 (0.0009) [2023-12-26 11:06:32,371][123090] Updated weights for policy 1, policy_version 1432541 (0.0009) [2023-12-26 11:06:33,077][123090] Updated weights for policy 1, policy_version 1432551 (0.0009) [2023-12-26 11:06:33,101][123091] Updated weights for policy 0, policy_version 1442265 (0.0007) [2023-12-26 11:06:33,124][123090] Updated weights for policy 1, policy_version 1432561 (0.0010) [2023-12-26 11:06:33,153][123091] Updated weights for policy 0, policy_version 1442275 (0.0007) [2023-12-26 11:06:33,177][123090] Updated weights for policy 1, policy_version 1432571 (0.0008) [2023-12-26 11:06:33,200][123091] Updated weights for policy 0, policy_version 1442285 (0.0008) [2023-12-26 11:06:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 735969280. Throughput: 0: 8744.7, 1: 9104.2. Samples: 735983376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:33,784][121949] Avg episode reward: [(0, '6162.186'), (1, '5477.356')] [2023-12-26 11:06:33,955][123090] Updated weights for policy 1, policy_version 1432581 (0.0009) [2023-12-26 11:06:34,025][123090] Updated weights for policy 1, policy_version 1432591 (0.0010) [2023-12-26 11:06:34,088][123090] Updated weights for policy 1, policy_version 1432601 (0.0010) [2023-12-26 11:06:34,099][123091] Updated weights for policy 0, policy_version 1442295 (0.0008) [2023-12-26 11:06:34,172][123091] Updated weights for policy 0, policy_version 1442305 (0.0008) [2023-12-26 11:06:34,228][123091] Updated weights for policy 0, policy_version 1442315 (0.0009) [2023-12-26 11:06:34,901][123090] Updated weights for policy 1, policy_version 1432611 (0.0010) [2023-12-26 11:06:34,971][123090] Updated weights for policy 1, policy_version 1432621 (0.0010) [2023-12-26 11:06:35,035][123090] Updated weights for policy 1, policy_version 1432631 (0.0010) [2023-12-26 11:06:35,051][123091] Updated weights for policy 0, policy_version 1442325 (0.0009) [2023-12-26 11:06:35,100][123091] Updated weights for policy 0, policy_version 1442335 (0.0009) [2023-12-26 11:06:35,148][123091] Updated weights for policy 0, policy_version 1442345 (0.0009) [2023-12-26 11:06:35,756][123090] Updated weights for policy 1, policy_version 1432641 (0.0010) [2023-12-26 11:06:35,818][123090] Updated weights for policy 1, policy_version 1432651 (0.0005) [2023-12-26 11:06:35,875][123090] Updated weights for policy 1, policy_version 1432661 (0.0005) [2023-12-26 11:06:35,932][123090] Updated weights for policy 1, policy_version 1432671 (0.0007) [2023-12-26 11:06:36,019][123091] Updated weights for policy 0, policy_version 1442355 (0.0008) [2023-12-26 11:06:36,098][123091] Updated weights for policy 0, policy_version 1442365 (0.0006) [2023-12-26 11:06:36,171][123091] Updated weights for policy 0, policy_version 1442375 (0.0008) [2023-12-26 11:06:36,704][123090] Updated weights for policy 1, policy_version 1432681 (0.0010) [2023-12-26 11:06:36,760][123090] Updated weights for policy 1, policy_version 1432691 (0.0010) [2023-12-26 11:06:36,827][123090] Updated weights for policy 1, policy_version 1432701 (0.0011) [2023-12-26 11:06:36,914][123091] Updated weights for policy 0, policy_version 1442385 (0.0008) [2023-12-26 11:06:36,972][123091] Updated weights for policy 0, policy_version 1442395 (0.0010) [2023-12-26 11:06:37,037][123091] Updated weights for policy 0, policy_version 1442405 (0.0011) [2023-12-26 11:06:37,101][123091] Updated weights for policy 0, policy_version 1442415 (0.0007) [2023-12-26 11:06:37,560][123090] Updated weights for policy 1, policy_version 1432711 (0.0007) [2023-12-26 11:06:37,615][123090] Updated weights for policy 1, policy_version 1432721 (0.0005) [2023-12-26 11:06:37,693][123090] Updated weights for policy 1, policy_version 1432731 (0.0006) [2023-12-26 11:06:37,769][123091] Updated weights for policy 0, policy_version 1442425 (0.0005) [2023-12-26 11:06:37,839][123091] Updated weights for policy 0, policy_version 1442435 (0.0005) [2023-12-26 11:06:37,901][123091] Updated weights for policy 0, policy_version 1442445 (0.0005) [2023-12-26 11:06:38,365][123090] Updated weights for policy 1, policy_version 1432741 (0.0007) [2023-12-26 11:06:38,436][123090] Updated weights for policy 1, policy_version 1432751 (0.0011) [2023-12-26 11:06:38,500][123090] Updated weights for policy 1, policy_version 1432761 (0.0010) [2023-12-26 11:06:38,582][123091] Updated weights for policy 0, policy_version 1442455 (0.0009) [2023-12-26 11:06:38,644][123091] Updated weights for policy 0, policy_version 1442465 (0.0010) [2023-12-26 11:06:38,709][123091] Updated weights for policy 0, policy_version 1442475 (0.0010) [2023-12-26 11:06:38,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 736067584. Throughput: 0: 8755.7, 1: 9091.1. Samples: 736036320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:38,785][121949] Avg episode reward: [(0, '6183.413'), (1, '5651.984')] [2023-12-26 11:06:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001442480_369278976.pth... [2023-12-26 11:06:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001432768_366788608.pth... [2023-12-26 11:06:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001441424_369008640.pth [2023-12-26 11:06:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001431680_366510080.pth [2023-12-26 11:06:39,303][123090] Updated weights for policy 1, policy_version 1432771 (0.0011) [2023-12-26 11:06:39,380][123090] Updated weights for policy 1, policy_version 1432781 (0.0011) [2023-12-26 11:06:39,448][123090] Updated weights for policy 1, policy_version 1432791 (0.0008) [2023-12-26 11:06:39,552][123091] Updated weights for policy 0, policy_version 1442485 (0.0011) [2023-12-26 11:06:39,617][123091] Updated weights for policy 0, policy_version 1442495 (0.0011) [2023-12-26 11:06:39,683][123091] Updated weights for policy 0, policy_version 1442505 (0.0011) [2023-12-26 11:06:40,203][123090] Updated weights for policy 1, policy_version 1432801 (0.0007) [2023-12-26 11:06:40,268][123090] Updated weights for policy 1, policy_version 1432811 (0.0008) [2023-12-26 11:06:40,321][123090] Updated weights for policy 1, policy_version 1432821 (0.0008) [2023-12-26 11:06:40,388][123090] Updated weights for policy 1, policy_version 1432831 (0.0005) [2023-12-26 11:06:40,516][123091] Updated weights for policy 0, policy_version 1442515 (0.0010) [2023-12-26 11:06:40,580][123091] Updated weights for policy 0, policy_version 1442525 (0.0010) [2023-12-26 11:06:40,635][123091] Updated weights for policy 0, policy_version 1442535 (0.0010) [2023-12-26 11:06:41,143][123090] Updated weights for policy 1, policy_version 1432841 (0.0007) [2023-12-26 11:06:41,207][123090] Updated weights for policy 1, policy_version 1432851 (0.0010) [2023-12-26 11:06:41,273][123090] Updated weights for policy 1, policy_version 1432861 (0.0011) [2023-12-26 11:06:41,568][123091] Updated weights for policy 0, policy_version 1442545 (0.0010) [2023-12-26 11:06:41,633][123091] Updated weights for policy 0, policy_version 1442555 (0.0009) [2023-12-26 11:06:41,692][123091] Updated weights for policy 0, policy_version 1442565 (0.0009) [2023-12-26 11:06:41,751][123091] Updated weights for policy 0, policy_version 1442575 (0.0009) [2023-12-26 11:06:42,062][123090] Updated weights for policy 1, policy_version 1432871 (0.0007) [2023-12-26 11:06:42,132][123090] Updated weights for policy 1, policy_version 1432881 (0.0009) [2023-12-26 11:06:42,203][123090] Updated weights for policy 1, policy_version 1432891 (0.0006) [2023-12-26 11:06:42,657][123091] Updated weights for policy 0, policy_version 1442585 (0.0009) [2023-12-26 11:06:42,723][123091] Updated weights for policy 0, policy_version 1442595 (0.0009) [2023-12-26 11:06:42,787][123091] Updated weights for policy 0, policy_version 1442605 (0.0009) [2023-12-26 11:06:43,005][123090] Updated weights for policy 1, policy_version 1432901 (0.0006) [2023-12-26 11:06:43,061][123090] Updated weights for policy 1, policy_version 1432911 (0.0005) [2023-12-26 11:06:43,118][123090] Updated weights for policy 1, policy_version 1432921 (0.0005) [2023-12-26 11:06:43,590][123091] Updated weights for policy 0, policy_version 1442615 (0.0009) [2023-12-26 11:06:43,638][123091] Updated weights for policy 0, policy_version 1442625 (0.0005) [2023-12-26 11:06:43,694][123091] Updated weights for policy 0, policy_version 1442635 (0.0005) [2023-12-26 11:06:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 736149504. Throughput: 0: 8804.2, 1: 9089.8. Samples: 736142932. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:43,785][121949] Avg episode reward: [(0, '6114.473'), (1, '5595.228')] [2023-12-26 11:06:43,820][123090] Updated weights for policy 1, policy_version 1432931 (0.0005) [2023-12-26 11:06:43,878][123090] Updated weights for policy 1, policy_version 1432941 (0.0008) [2023-12-26 11:06:43,940][123090] Updated weights for policy 1, policy_version 1432951 (0.0010) [2023-12-26 11:06:44,399][123091] Updated weights for policy 0, policy_version 1442645 (0.0005) [2023-12-26 11:06:44,460][123091] Updated weights for policy 0, policy_version 1442655 (0.0007) [2023-12-26 11:06:44,530][123091] Updated weights for policy 0, policy_version 1442665 (0.0010) [2023-12-26 11:06:44,661][123090] Updated weights for policy 1, policy_version 1432961 (0.0010) [2023-12-26 11:06:44,712][123090] Updated weights for policy 1, policy_version 1432971 (0.0009) [2023-12-26 11:06:44,767][123090] Updated weights for policy 1, policy_version 1432981 (0.0009) [2023-12-26 11:06:44,835][123090] Updated weights for policy 1, policy_version 1432991 (0.0007) [2023-12-26 11:06:45,375][123091] Updated weights for policy 0, policy_version 1442675 (0.0010) [2023-12-26 11:06:45,441][123091] Updated weights for policy 0, policy_version 1442685 (0.0010) [2023-12-26 11:06:45,507][123091] Updated weights for policy 0, policy_version 1442695 (0.0009) [2023-12-26 11:06:45,640][123090] Updated weights for policy 1, policy_version 1433001 (0.0009) [2023-12-26 11:06:45,689][123090] Updated weights for policy 1, policy_version 1433011 (0.0009) [2023-12-26 11:06:45,747][123090] Updated weights for policy 1, policy_version 1433021 (0.0009) [2023-12-26 11:06:46,321][123091] Updated weights for policy 0, policy_version 1442705 (0.0009) [2023-12-26 11:06:46,384][123091] Updated weights for policy 0, policy_version 1442715 (0.0007) [2023-12-26 11:06:46,440][123091] Updated weights for policy 0, policy_version 1442725 (0.0009) [2023-12-26 11:06:46,494][123091] Updated weights for policy 0, policy_version 1442735 (0.0008) [2023-12-26 11:06:46,512][123090] Updated weights for policy 1, policy_version 1433031 (0.0010) [2023-12-26 11:06:46,578][123090] Updated weights for policy 1, policy_version 1433041 (0.0010) [2023-12-26 11:06:46,644][123090] Updated weights for policy 1, policy_version 1433051 (0.0010) [2023-12-26 11:06:47,197][123091] Updated weights for policy 0, policy_version 1442745 (0.0006) [2023-12-26 11:06:47,246][123091] Updated weights for policy 0, policy_version 1442755 (0.0006) [2023-12-26 11:06:47,291][123091] Updated weights for policy 0, policy_version 1442765 (0.0005) [2023-12-26 11:06:47,393][123090] Updated weights for policy 1, policy_version 1433061 (0.0008) [2023-12-26 11:06:47,440][123090] Updated weights for policy 1, policy_version 1433071 (0.0005) [2023-12-26 11:06:47,487][123090] Updated weights for policy 1, policy_version 1433081 (0.0005) [2023-12-26 11:06:47,860][123091] Updated weights for policy 0, policy_version 1442775 (0.0005) [2023-12-26 11:06:47,921][123091] Updated weights for policy 0, policy_version 1442785 (0.0005) [2023-12-26 11:06:47,974][123091] Updated weights for policy 0, policy_version 1442795 (0.0005) [2023-12-26 11:06:48,119][123090] Updated weights for policy 1, policy_version 1433091 (0.0005) [2023-12-26 11:06:48,171][123090] Updated weights for policy 1, policy_version 1433101 (0.0007) [2023-12-26 11:06:48,238][123090] Updated weights for policy 1, policy_version 1433111 (0.0006) [2023-12-26 11:06:48,777][123091] Updated weights for policy 0, policy_version 1442805 (0.0008) [2023-12-26 11:06:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 736239616. Throughput: 0: 8813.3, 1: 9183.0. Samples: 736255012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:48,785][121949] Avg episode reward: [(0, '6125.169'), (1, '5596.416')] [2023-12-26 11:06:48,838][123091] Updated weights for policy 0, policy_version 1442815 (0.0006) [2023-12-26 11:06:48,899][123091] Updated weights for policy 0, policy_version 1442825 (0.0009) [2023-12-26 11:06:49,014][123090] Updated weights for policy 1, policy_version 1433121 (0.0006) [2023-12-26 11:06:49,077][123090] Updated weights for policy 1, policy_version 1433131 (0.0010) [2023-12-26 11:06:49,132][123090] Updated weights for policy 1, policy_version 1433141 (0.0010) [2023-12-26 11:06:49,198][123090] Updated weights for policy 1, policy_version 1433151 (0.0010) [2023-12-26 11:06:49,791][123091] Updated weights for policy 0, policy_version 1442835 (0.0009) [2023-12-26 11:06:49,853][123091] Updated weights for policy 0, policy_version 1442845 (0.0009) [2023-12-26 11:06:49,908][123091] Updated weights for policy 0, policy_version 1442855 (0.0008) [2023-12-26 11:06:49,987][123090] Updated weights for policy 1, policy_version 1433162 (0.0009) [2023-12-26 11:06:50,047][123090] Updated weights for policy 1, policy_version 1433172 (0.0009) [2023-12-26 11:06:50,094][123090] Updated weights for policy 1, policy_version 1433182 (0.0008) [2023-12-26 11:06:50,744][123091] Updated weights for policy 0, policy_version 1442865 (0.0008) [2023-12-26 11:06:50,809][123091] Updated weights for policy 0, policy_version 1442876 (0.0009) [2023-12-26 11:06:50,875][123091] Updated weights for policy 0, policy_version 1442886 (0.0010) [2023-12-26 11:06:50,934][123090] Updated weights for policy 1, policy_version 1433192 (0.0010) [2023-12-26 11:06:50,937][123091] Updated weights for policy 0, policy_version 1442896 (0.0008) [2023-12-26 11:06:50,987][123090] Updated weights for policy 1, policy_version 1433202 (0.0007) [2023-12-26 11:06:51,049][123090] Updated weights for policy 1, policy_version 1433212 (0.0009) [2023-12-26 11:06:51,800][123090] Updated weights for policy 1, policy_version 1433222 (0.0010) [2023-12-26 11:06:51,836][123091] Updated weights for policy 0, policy_version 1442906 (0.0007) [2023-12-26 11:06:51,864][123090] Updated weights for policy 1, policy_version 1433232 (0.0008) [2023-12-26 11:06:51,889][123091] Updated weights for policy 0, policy_version 1442916 (0.0006) [2023-12-26 11:06:51,932][123090] Updated weights for policy 1, policy_version 1433242 (0.0009) [2023-12-26 11:06:51,940][123091] Updated weights for policy 0, policy_version 1442926 (0.0008) [2023-12-26 11:06:52,770][123090] Updated weights for policy 1, policy_version 1433252 (0.0010) [2023-12-26 11:06:52,803][123091] Updated weights for policy 0, policy_version 1442936 (0.0008) [2023-12-26 11:06:52,834][123090] Updated weights for policy 1, policy_version 1433262 (0.0009) [2023-12-26 11:06:52,867][123091] Updated weights for policy 0, policy_version 1442946 (0.0007) [2023-12-26 11:06:52,898][123090] Updated weights for policy 1, policy_version 1433272 (0.0009) [2023-12-26 11:06:52,928][123091] Updated weights for policy 0, policy_version 1442956 (0.0007) [2023-12-26 11:06:53,720][123090] Updated weights for policy 1, policy_version 1433282 (0.0009) [2023-12-26 11:06:53,749][123091] Updated weights for policy 0, policy_version 1442966 (0.0008) [2023-12-26 11:06:53,780][123090] Updated weights for policy 1, policy_version 1433292 (0.0009) [2023-12-26 11:06:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 736321536. Throughput: 0: 8781.9, 1: 9167.0. Samples: 736305468. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:53,785][121949] Avg episode reward: [(0, '6152.882'), (1, '5723.742')] [2023-12-26 11:06:53,805][123091] Updated weights for policy 0, policy_version 1442976 (0.0007) [2023-12-26 11:06:53,839][123090] Updated weights for policy 1, policy_version 1433302 (0.0007) [2023-12-26 11:06:53,859][123091] Updated weights for policy 0, policy_version 1442986 (0.0008) [2023-12-26 11:06:53,896][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001442992_369410048.pth... [2023-12-26 11:06:53,898][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001433312_366927872.pth... [2023-12-26 11:06:53,899][123090] Updated weights for policy 1, policy_version 1433312 (0.0007) [2023-12-26 11:06:53,900][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001441936_369139712.pth [2023-12-26 11:06:53,901][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001432224_366649344.pth [2023-12-26 11:06:54,698][123091] Updated weights for policy 0, policy_version 1442996 (0.0009) [2023-12-26 11:06:54,748][123090] Updated weights for policy 1, policy_version 1433322 (0.0009) [2023-12-26 11:06:54,748][123091] Updated weights for policy 0, policy_version 1443006 (0.0009) [2023-12-26 11:06:54,793][123091] Updated weights for policy 0, policy_version 1443016 (0.0008) [2023-12-26 11:06:54,814][123090] Updated weights for policy 1, policy_version 1433332 (0.0008) [2023-12-26 11:06:54,876][123090] Updated weights for policy 1, policy_version 1433342 (0.0009) [2023-12-26 11:06:55,634][123091] Updated weights for policy 0, policy_version 1443026 (0.0009) [2023-12-26 11:06:55,685][123091] Updated weights for policy 0, policy_version 1443036 (0.0008) [2023-12-26 11:06:55,692][123090] Updated weights for policy 1, policy_version 1433352 (0.0010) [2023-12-26 11:06:55,734][123091] Updated weights for policy 0, policy_version 1443046 (0.0009) [2023-12-26 11:06:55,747][123090] Updated weights for policy 1, policy_version 1433362 (0.0008) [2023-12-26 11:06:55,792][123091] Updated weights for policy 0, policy_version 1443056 (0.0010) [2023-12-26 11:06:55,815][123090] Updated weights for policy 1, policy_version 1433372 (0.0008) [2023-12-26 11:06:56,639][123090] Updated weights for policy 1, policy_version 1433382 (0.0009) [2023-12-26 11:06:56,654][123091] Updated weights for policy 0, policy_version 1443066 (0.0008) [2023-12-26 11:06:56,692][123090] Updated weights for policy 1, policy_version 1433392 (0.0009) [2023-12-26 11:06:56,703][123091] Updated weights for policy 0, policy_version 1443076 (0.0007) [2023-12-26 11:06:56,743][123090] Updated weights for policy 1, policy_version 1433402 (0.0009) [2023-12-26 11:06:56,750][123091] Updated weights for policy 0, policy_version 1443086 (0.0006) [2023-12-26 11:06:57,606][123090] Updated weights for policy 1, policy_version 1433412 (0.0008) [2023-12-26 11:06:57,618][123091] Updated weights for policy 0, policy_version 1443096 (0.0007) [2023-12-26 11:06:57,654][123090] Updated weights for policy 1, policy_version 1433422 (0.0010) [2023-12-26 11:06:57,666][123091] Updated weights for policy 0, policy_version 1443106 (0.0006) [2023-12-26 11:06:57,710][123090] Updated weights for policy 1, policy_version 1433432 (0.0006) [2023-12-26 11:06:57,715][123091] Updated weights for policy 0, policy_version 1443116 (0.0008) [2023-12-26 11:06:58,575][123090] Updated weights for policy 1, policy_version 1433442 (0.0006) [2023-12-26 11:06:58,641][123090] Updated weights for policy 1, policy_version 1433452 (0.0009) [2023-12-26 11:06:58,644][123091] Updated weights for policy 0, policy_version 1443126 (0.0009) [2023-12-26 11:06:58,715][123091] Updated weights for policy 0, policy_version 1443136 (0.0009) [2023-12-26 11:06:58,721][123090] Updated weights for policy 1, policy_version 1433462 (0.0008) [2023-12-26 11:06:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 736403456. Throughput: 0: 8729.5, 1: 9119.3. Samples: 736407360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:06:58,785][121949] Avg episode reward: [(0, '6258.560'), (1, '5788.628')] [2023-12-26 11:06:58,792][123090] Updated weights for policy 1, policy_version 1433472 (0.0008) [2023-12-26 11:06:58,794][123091] Updated weights for policy 0, policy_version 1443146 (0.0009) [2023-12-26 11:06:59,631][123090] Updated weights for policy 1, policy_version 1433482 (0.0005) [2023-12-26 11:06:59,661][123091] Updated weights for policy 0, policy_version 1443156 (0.0008) [2023-12-26 11:06:59,708][123090] Updated weights for policy 1, policy_version 1433492 (0.0005) [2023-12-26 11:06:59,737][123091] Updated weights for policy 0, policy_version 1443166 (0.0006) [2023-12-26 11:06:59,774][123090] Updated weights for policy 1, policy_version 1433502 (0.0005) [2023-12-26 11:06:59,799][123091] Updated weights for policy 0, policy_version 1443176 (0.0005) [2023-12-26 11:07:00,497][123090] Updated weights for policy 1, policy_version 1433512 (0.0009) [2023-12-26 11:07:00,519][123091] Updated weights for policy 0, policy_version 1443186 (0.0008) [2023-12-26 11:07:00,551][123090] Updated weights for policy 1, policy_version 1433522 (0.0008) [2023-12-26 11:07:00,564][123091] Updated weights for policy 0, policy_version 1443196 (0.0005) [2023-12-26 11:07:00,612][123090] Updated weights for policy 1, policy_version 1433532 (0.0008) [2023-12-26 11:07:00,622][123091] Updated weights for policy 0, policy_version 1443206 (0.0005) [2023-12-26 11:07:00,666][123091] Updated weights for policy 0, policy_version 1443216 (0.0005) [2023-12-26 11:07:01,373][123091] Updated weights for policy 0, policy_version 1443226 (0.0008) [2023-12-26 11:07:01,440][123091] Updated weights for policy 0, policy_version 1443236 (0.0008) [2023-12-26 11:07:01,502][123091] Updated weights for policy 0, policy_version 1443246 (0.0008) [2023-12-26 11:07:01,537][123090] Updated weights for policy 1, policy_version 1433542 (0.0006) [2023-12-26 11:07:01,614][123090] Updated weights for policy 1, policy_version 1433552 (0.0005) [2023-12-26 11:07:01,681][123090] Updated weights for policy 1, policy_version 1433562 (0.0009) [2023-12-26 11:07:02,287][123091] Updated weights for policy 0, policy_version 1443256 (0.0009) [2023-12-26 11:07:02,334][123091] Updated weights for policy 0, policy_version 1443266 (0.0006) [2023-12-26 11:07:02,393][123091] Updated weights for policy 0, policy_version 1443276 (0.0008) [2023-12-26 11:07:02,500][123090] Updated weights for policy 1, policy_version 1433572 (0.0007) [2023-12-26 11:07:02,573][123090] Updated weights for policy 1, policy_version 1433582 (0.0005) [2023-12-26 11:07:02,637][123090] Updated weights for policy 1, policy_version 1433592 (0.0005) [2023-12-26 11:07:03,045][123091] Updated weights for policy 0, policy_version 1443286 (0.0010) [2023-12-26 11:07:03,092][123091] Updated weights for policy 0, policy_version 1443296 (0.0010) [2023-12-26 11:07:03,144][123091] Updated weights for policy 0, policy_version 1443306 (0.0010) [2023-12-26 11:07:03,182][123090] Updated weights for policy 1, policy_version 1433602 (0.0005) [2023-12-26 11:07:03,232][123090] Updated weights for policy 1, policy_version 1433612 (0.0005) [2023-12-26 11:07:03,287][123090] Updated weights for policy 1, policy_version 1433622 (0.0005) [2023-12-26 11:07:03,350][123090] Updated weights for policy 1, policy_version 1433632 (0.0005) [2023-12-26 11:07:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 736501760. Throughput: 0: 8787.5, 1: 9036.3. Samples: 736516328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:03,785][121949] Avg episode reward: [(0, '6249.962'), (1, '5760.448')] [2023-12-26 11:07:03,867][123091] Updated weights for policy 0, policy_version 1443316 (0.0009) [2023-12-26 11:07:03,922][123091] Updated weights for policy 0, policy_version 1443326 (0.0006) [2023-12-26 11:07:03,982][123090] Updated weights for policy 1, policy_version 1433642 (0.0005) [2023-12-26 11:07:03,989][123091] Updated weights for policy 0, policy_version 1443336 (0.0009) [2023-12-26 11:07:04,053][123090] Updated weights for policy 1, policy_version 1433652 (0.0005) [2023-12-26 11:07:04,126][123090] Updated weights for policy 1, policy_version 1433662 (0.0006) [2023-12-26 11:07:04,680][123091] Updated weights for policy 0, policy_version 1443346 (0.0007) [2023-12-26 11:07:04,729][123091] Updated weights for policy 0, policy_version 1443356 (0.0007) [2023-12-26 11:07:04,789][123091] Updated weights for policy 0, policy_version 1443366 (0.0009) [2023-12-26 11:07:04,852][123091] Updated weights for policy 0, policy_version 1443376 (0.0009) [2023-12-26 11:07:04,896][123090] Updated weights for policy 1, policy_version 1433672 (0.0008) [2023-12-26 11:07:04,966][123090] Updated weights for policy 1, policy_version 1433682 (0.0009) [2023-12-26 11:07:05,037][123090] Updated weights for policy 1, policy_version 1433692 (0.0010) [2023-12-26 11:07:05,522][123091] Updated weights for policy 0, policy_version 1443386 (0.0007) [2023-12-26 11:07:05,594][123091] Updated weights for policy 0, policy_version 1443396 (0.0007) [2023-12-26 11:07:05,650][123091] Updated weights for policy 0, policy_version 1443406 (0.0010) [2023-12-26 11:07:05,845][123090] Updated weights for policy 1, policy_version 1433702 (0.0009) [2023-12-26 11:07:05,894][123090] Updated weights for policy 1, policy_version 1433712 (0.0009) [2023-12-26 11:07:05,950][123090] Updated weights for policy 1, policy_version 1433722 (0.0009) [2023-12-26 11:07:06,362][123091] Updated weights for policy 0, policy_version 1443416 (0.0010) [2023-12-26 11:07:06,431][123091] Updated weights for policy 0, policy_version 1443426 (0.0010) [2023-12-26 11:07:06,500][123091] Updated weights for policy 0, policy_version 1443436 (0.0010) [2023-12-26 11:07:06,863][123090] Updated weights for policy 1, policy_version 1433732 (0.0007) [2023-12-26 11:07:06,943][123090] Updated weights for policy 1, policy_version 1433742 (0.0006) [2023-12-26 11:07:07,011][123090] Updated weights for policy 1, policy_version 1433752 (0.0006) [2023-12-26 11:07:07,221][123091] Updated weights for policy 0, policy_version 1443446 (0.0008) [2023-12-26 11:07:07,280][123091] Updated weights for policy 0, policy_version 1443456 (0.0009) [2023-12-26 11:07:07,332][123091] Updated weights for policy 0, policy_version 1443466 (0.0009) [2023-12-26 11:07:07,680][123090] Updated weights for policy 1, policy_version 1433762 (0.0008) [2023-12-26 11:07:07,746][123090] Updated weights for policy 1, policy_version 1433772 (0.0005) [2023-12-26 11:07:07,814][123090] Updated weights for policy 1, policy_version 1433782 (0.0005) [2023-12-26 11:07:07,878][123090] Updated weights for policy 1, policy_version 1433792 (0.0005) [2023-12-26 11:07:08,218][123091] Updated weights for policy 0, policy_version 1443476 (0.0010) [2023-12-26 11:07:08,272][123091] Updated weights for policy 0, policy_version 1443486 (0.0010) [2023-12-26 11:07:08,325][123091] Updated weights for policy 0, policy_version 1443496 (0.0009) [2023-12-26 11:07:08,578][123090] Updated weights for policy 1, policy_version 1433802 (0.0010) [2023-12-26 11:07:08,650][123090] Updated weights for policy 1, policy_version 1433812 (0.0007) [2023-12-26 11:07:08,726][123090] Updated weights for policy 1, policy_version 1433822 (0.0005) [2023-12-26 11:07:08,784][121949] Fps is (10 sec: 19660.6, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 736600064. Throughput: 0: 8828.5, 1: 9036.2. Samples: 736571292. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:08,785][121949] Avg episode reward: [(0, '6233.018'), (1, '5534.571')] [2023-12-26 11:07:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001443504_369541120.pth... [2023-12-26 11:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001433824_367058944.pth... [2023-12-26 11:07:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001442480_369278976.pth [2023-12-26 11:07:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001432768_366788608.pth [2023-12-26 11:07:09,201][123091] Updated weights for policy 0, policy_version 1443506 (0.0007) [2023-12-26 11:07:09,266][123091] Updated weights for policy 0, policy_version 1443516 (0.0007) [2023-12-26 11:07:09,329][123091] Updated weights for policy 0, policy_version 1443526 (0.0007) [2023-12-26 11:07:09,403][123091] Updated weights for policy 0, policy_version 1443536 (0.0009) [2023-12-26 11:07:09,450][123090] Updated weights for policy 1, policy_version 1433832 (0.0007) [2023-12-26 11:07:09,519][123090] Updated weights for policy 1, policy_version 1433842 (0.0007) [2023-12-26 11:07:09,588][123090] Updated weights for policy 1, policy_version 1433852 (0.0010) [2023-12-26 11:07:10,223][123091] Updated weights for policy 0, policy_version 1443546 (0.0008) [2023-12-26 11:07:10,282][123091] Updated weights for policy 0, policy_version 1443556 (0.0009) [2023-12-26 11:07:10,343][123091] Updated weights for policy 0, policy_version 1443566 (0.0010) [2023-12-26 11:07:10,400][123090] Updated weights for policy 1, policy_version 1433862 (0.0009) [2023-12-26 11:07:10,464][123090] Updated weights for policy 1, policy_version 1433872 (0.0006) [2023-12-26 11:07:10,530][123090] Updated weights for policy 1, policy_version 1433882 (0.0005) [2023-12-26 11:07:11,166][123091] Updated weights for policy 0, policy_version 1443576 (0.0009) [2023-12-26 11:07:11,219][123090] Updated weights for policy 1, policy_version 1433892 (0.0007) [2023-12-26 11:07:11,232][123091] Updated weights for policy 0, policy_version 1443586 (0.0006) [2023-12-26 11:07:11,289][123090] Updated weights for policy 1, policy_version 1433902 (0.0007) [2023-12-26 11:07:11,300][123091] Updated weights for policy 0, policy_version 1443596 (0.0007) [2023-12-26 11:07:11,363][123090] Updated weights for policy 1, policy_version 1433912 (0.0007) [2023-12-26 11:07:12,100][123091] Updated weights for policy 0, policy_version 1443606 (0.0008) [2023-12-26 11:07:12,118][123090] Updated weights for policy 1, policy_version 1433922 (0.0008) [2023-12-26 11:07:12,167][123091] Updated weights for policy 0, policy_version 1443616 (0.0008) [2023-12-26 11:07:12,191][123090] Updated weights for policy 1, policy_version 1433932 (0.0007) [2023-12-26 11:07:12,239][123091] Updated weights for policy 0, policy_version 1443626 (0.0009) [2023-12-26 11:07:12,262][123090] Updated weights for policy 1, policy_version 1433942 (0.0007) [2023-12-26 11:07:12,332][123090] Updated weights for policy 1, policy_version 1433952 (0.0007) [2023-12-26 11:07:13,076][123091] Updated weights for policy 0, policy_version 1443636 (0.0008) [2023-12-26 11:07:13,113][123090] Updated weights for policy 1, policy_version 1433962 (0.0006) [2023-12-26 11:07:13,140][123091] Updated weights for policy 0, policy_version 1443646 (0.0009) [2023-12-26 11:07:13,173][123090] Updated weights for policy 1, policy_version 1433972 (0.0007) [2023-12-26 11:07:13,200][123091] Updated weights for policy 0, policy_version 1443656 (0.0009) [2023-12-26 11:07:13,236][123090] Updated weights for policy 1, policy_version 1433982 (0.0006) [2023-12-26 11:07:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 736681984. Throughput: 0: 8794.2, 1: 9031.6. Samples: 736677760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:13,785][121949] Avg episode reward: [(0, '6137.179'), (1, '5528.807')] [2023-12-26 11:07:13,946][123091] Updated weights for policy 0, policy_version 1443666 (0.0009) [2023-12-26 11:07:13,958][123090] Updated weights for policy 1, policy_version 1433992 (0.0005) [2023-12-26 11:07:14,011][123091] Updated weights for policy 0, policy_version 1443676 (0.0005) [2023-12-26 11:07:14,012][123090] Updated weights for policy 1, policy_version 1434002 (0.0008) [2023-12-26 11:07:14,065][123090] Updated weights for policy 1, policy_version 1434012 (0.0009) [2023-12-26 11:07:14,084][123091] Updated weights for policy 0, policy_version 1443686 (0.0006) [2023-12-26 11:07:14,140][123091] Updated weights for policy 0, policy_version 1443696 (0.0009) [2023-12-26 11:07:14,811][123090] Updated weights for policy 1, policy_version 1434022 (0.0009) [2023-12-26 11:07:14,876][123090] Updated weights for policy 1, policy_version 1434032 (0.0009) [2023-12-26 11:07:14,896][123091] Updated weights for policy 0, policy_version 1443706 (0.0008) [2023-12-26 11:07:14,939][123090] Updated weights for policy 1, policy_version 1434042 (0.0008) [2023-12-26 11:07:14,953][123091] Updated weights for policy 0, policy_version 1443716 (0.0010) [2023-12-26 11:07:15,020][123091] Updated weights for policy 0, policy_version 1443726 (0.0007) [2023-12-26 11:07:15,798][123090] Updated weights for policy 1, policy_version 1434052 (0.0009) [2023-12-26 11:07:15,817][123091] Updated weights for policy 0, policy_version 1443736 (0.0007) [2023-12-26 11:07:15,857][123090] Updated weights for policy 1, policy_version 1434062 (0.0011) [2023-12-26 11:07:15,876][123091] Updated weights for policy 0, policy_version 1443746 (0.0007) [2023-12-26 11:07:15,927][123090] Updated weights for policy 1, policy_version 1434072 (0.0010) [2023-12-26 11:07:15,930][123091] Updated weights for policy 0, policy_version 1443756 (0.0006) [2023-12-26 11:07:16,644][123091] Updated weights for policy 0, policy_version 1443766 (0.0007) [2023-12-26 11:07:16,699][123091] Updated weights for policy 0, policy_version 1443776 (0.0009) [2023-12-26 11:07:16,744][123090] Updated weights for policy 1, policy_version 1434082 (0.0011) [2023-12-26 11:07:16,756][123091] Updated weights for policy 0, policy_version 1443786 (0.0009) [2023-12-26 11:07:16,798][123090] Updated weights for policy 1, policy_version 1434092 (0.0010) [2023-12-26 11:07:16,859][123090] Updated weights for policy 1, policy_version 1434102 (0.0010) [2023-12-26 11:07:16,918][123090] Updated weights for policy 1, policy_version 1434112 (0.0010) [2023-12-26 11:07:17,597][123091] Updated weights for policy 0, policy_version 1443796 (0.0010) [2023-12-26 11:07:17,647][123091] Updated weights for policy 0, policy_version 1443806 (0.0009) [2023-12-26 11:07:17,679][123090] Updated weights for policy 1, policy_version 1434122 (0.0005) [2023-12-26 11:07:17,709][123091] Updated weights for policy 0, policy_version 1443816 (0.0009) [2023-12-26 11:07:17,733][123090] Updated weights for policy 1, policy_version 1434132 (0.0005) [2023-12-26 11:07:17,794][123090] Updated weights for policy 1, policy_version 1434142 (0.0010) [2023-12-26 11:07:18,412][123091] Updated weights for policy 0, policy_version 1443826 (0.0007) [2023-12-26 11:07:18,473][123091] Updated weights for policy 0, policy_version 1443836 (0.0005) [2023-12-26 11:07:18,501][123090] Updated weights for policy 1, policy_version 1434152 (0.0006) [2023-12-26 11:07:18,545][123091] Updated weights for policy 0, policy_version 1443846 (0.0008) [2023-12-26 11:07:18,567][123090] Updated weights for policy 1, policy_version 1434162 (0.0005) [2023-12-26 11:07:18,599][123091] Updated weights for policy 0, policy_version 1443856 (0.0008) [2023-12-26 11:07:18,626][123090] Updated weights for policy 1, policy_version 1434172 (0.0005) [2023-12-26 11:07:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17966.9). Total num frames: 736780288. Throughput: 0: 8850.4, 1: 9022.6. Samples: 736787660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:18,785][121949] Avg episode reward: [(0, '6045.538'), (1, '5530.306')] [2023-12-26 11:07:19,379][123090] Updated weights for policy 1, policy_version 1434182 (0.0007) [2023-12-26 11:07:19,409][123091] Updated weights for policy 0, policy_version 1443866 (0.0007) [2023-12-26 11:07:19,454][123090] Updated weights for policy 1, policy_version 1434192 (0.0007) [2023-12-26 11:07:19,479][123091] Updated weights for policy 0, policy_version 1443876 (0.0009) [2023-12-26 11:07:19,527][123090] Updated weights for policy 1, policy_version 1434202 (0.0008) [2023-12-26 11:07:19,556][123091] Updated weights for policy 0, policy_version 1443886 (0.0009) [2023-12-26 11:07:20,306][123090] Updated weights for policy 1, policy_version 1434212 (0.0009) [2023-12-26 11:07:20,366][123090] Updated weights for policy 1, policy_version 1434222 (0.0008) [2023-12-26 11:07:20,378][123091] Updated weights for policy 0, policy_version 1443896 (0.0008) [2023-12-26 11:07:20,435][123090] Updated weights for policy 1, policy_version 1434232 (0.0008) [2023-12-26 11:07:20,444][123091] Updated weights for policy 0, policy_version 1443906 (0.0010) [2023-12-26 11:07:20,504][123091] Updated weights for policy 0, policy_version 1443916 (0.0010) [2023-12-26 11:07:21,309][123090] Updated weights for policy 1, policy_version 1434242 (0.0006) [2023-12-26 11:07:21,370][123091] Updated weights for policy 0, policy_version 1443926 (0.0009) [2023-12-26 11:07:21,385][123090] Updated weights for policy 1, policy_version 1434252 (0.0011) [2023-12-26 11:07:21,438][123091] Updated weights for policy 0, policy_version 1443936 (0.0009) [2023-12-26 11:07:21,459][123090] Updated weights for policy 1, policy_version 1434262 (0.0009) [2023-12-26 11:07:21,504][123091] Updated weights for policy 0, policy_version 1443946 (0.0010) [2023-12-26 11:07:21,528][123090] Updated weights for policy 1, policy_version 1434272 (0.0011) [2023-12-26 11:07:22,376][123090] Updated weights for policy 1, policy_version 1434282 (0.0010) [2023-12-26 11:07:22,396][123091] Updated weights for policy 0, policy_version 1443956 (0.0008) [2023-12-26 11:07:22,444][123090] Updated weights for policy 1, policy_version 1434292 (0.0009) [2023-12-26 11:07:22,460][123091] Updated weights for policy 0, policy_version 1443966 (0.0009) [2023-12-26 11:07:22,501][123090] Updated weights for policy 1, policy_version 1434302 (0.0008) [2023-12-26 11:07:22,521][123091] Updated weights for policy 0, policy_version 1443976 (0.0008) [2023-12-26 11:07:23,341][123090] Updated weights for policy 1, policy_version 1434312 (0.0009) [2023-12-26 11:07:23,357][123091] Updated weights for policy 0, policy_version 1443986 (0.0010) [2023-12-26 11:07:23,395][123090] Updated weights for policy 1, policy_version 1434322 (0.0008) [2023-12-26 11:07:23,406][123091] Updated weights for policy 0, policy_version 1443996 (0.0007) [2023-12-26 11:07:23,440][123090] Updated weights for policy 1, policy_version 1434332 (0.0008) [2023-12-26 11:07:23,455][123091] Updated weights for policy 0, policy_version 1444006 (0.0007) [2023-12-26 11:07:23,509][123091] Updated weights for policy 0, policy_version 1444016 (0.0009) [2023-12-26 11:07:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 736862208. Throughput: 0: 8827.7, 1: 8976.4. Samples: 736837508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:23,786][121949] Avg episode reward: [(0, '6151.947'), (1, '5571.922')] [2023-12-26 11:07:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001434336_367190016.pth... [2023-12-26 11:07:23,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001444016_369672192.pth... [2023-12-26 11:07:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001433312_366927872.pth [2023-12-26 11:07:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001442992_369410048.pth [2023-12-26 11:07:24,272][123090] Updated weights for policy 1, policy_version 1434342 (0.0009) [2023-12-26 11:07:24,329][123090] Updated weights for policy 1, policy_version 1434352 (0.0009) [2023-12-26 11:07:24,379][123091] Updated weights for policy 0, policy_version 1444026 (0.0008) [2023-12-26 11:07:24,388][123090] Updated weights for policy 1, policy_version 1434362 (0.0009) [2023-12-26 11:07:24,434][123091] Updated weights for policy 0, policy_version 1444036 (0.0009) [2023-12-26 11:07:24,483][123091] Updated weights for policy 0, policy_version 1444046 (0.0009) [2023-12-26 11:07:25,212][123090] Updated weights for policy 1, policy_version 1434372 (0.0008) [2023-12-26 11:07:25,256][123090] Updated weights for policy 1, policy_version 1434382 (0.0010) [2023-12-26 11:07:25,275][123091] Updated weights for policy 0, policy_version 1444056 (0.0006) [2023-12-26 11:07:25,316][123090] Updated weights for policy 1, policy_version 1434392 (0.0010) [2023-12-26 11:07:25,328][123091] Updated weights for policy 0, policy_version 1444066 (0.0006) [2023-12-26 11:07:25,377][123091] Updated weights for policy 0, policy_version 1444076 (0.0008) [2023-12-26 11:07:25,981][123090] Updated weights for policy 1, policy_version 1434402 (0.0006) [2023-12-26 11:07:26,037][123090] Updated weights for policy 1, policy_version 1434412 (0.0006) [2023-12-26 11:07:26,104][123090] Updated weights for policy 1, policy_version 1434422 (0.0006) [2023-12-26 11:07:26,162][123090] Updated weights for policy 1, policy_version 1434432 (0.0006) [2023-12-26 11:07:26,299][123091] Updated weights for policy 0, policy_version 1444087 (0.0007) [2023-12-26 11:07:26,366][123091] Updated weights for policy 0, policy_version 1444097 (0.0005) [2023-12-26 11:07:26,414][123091] Updated weights for policy 0, policy_version 1444107 (0.0005) [2023-12-26 11:07:26,849][123090] Updated weights for policy 1, policy_version 1434442 (0.0009) [2023-12-26 11:07:26,906][123090] Updated weights for policy 1, policy_version 1434452 (0.0009) [2023-12-26 11:07:26,955][123090] Updated weights for policy 1, policy_version 1434462 (0.0009) [2023-12-26 11:07:27,067][123091] Updated weights for policy 0, policy_version 1444117 (0.0008) [2023-12-26 11:07:27,136][123091] Updated weights for policy 0, policy_version 1444127 (0.0009) [2023-12-26 11:07:27,190][123091] Updated weights for policy 0, policy_version 1444137 (0.0010) [2023-12-26 11:07:27,802][123090] Updated weights for policy 1, policy_version 1434472 (0.0009) [2023-12-26 11:07:27,854][123090] Updated weights for policy 1, policy_version 1434482 (0.0009) [2023-12-26 11:07:27,907][123090] Updated weights for policy 1, policy_version 1434494 (0.0011) [2023-12-26 11:07:28,013][123091] Updated weights for policy 0, policy_version 1444147 (0.0008) [2023-12-26 11:07:28,067][123091] Updated weights for policy 0, policy_version 1444157 (0.0006) [2023-12-26 11:07:28,121][123091] Updated weights for policy 0, policy_version 1444167 (0.0006) [2023-12-26 11:07:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 736944128. Throughput: 0: 8818.0, 1: 8949.2. Samples: 736942452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:28,785][121949] Avg episode reward: [(0, '6264.829'), (1, '5229.210')] [2023-12-26 11:07:28,824][123090] Updated weights for policy 1, policy_version 1434504 (0.0009) [2023-12-26 11:07:28,846][123091] Updated weights for policy 0, policy_version 1444177 (0.0009) [2023-12-26 11:07:28,879][123090] Updated weights for policy 1, policy_version 1434514 (0.0009) [2023-12-26 11:07:28,906][123091] Updated weights for policy 0, policy_version 1444187 (0.0009) [2023-12-26 11:07:28,939][123090] Updated weights for policy 1, policy_version 1434524 (0.0007) [2023-12-26 11:07:28,967][123091] Updated weights for policy 0, policy_version 1444197 (0.0009) [2023-12-26 11:07:29,019][123091] Updated weights for policy 0, policy_version 1444207 (0.0008) [2023-12-26 11:07:29,738][123090] Updated weights for policy 1, policy_version 1434534 (0.0007) [2023-12-26 11:07:29,808][123090] Updated weights for policy 1, policy_version 1434544 (0.0005) [2023-12-26 11:07:29,874][123090] Updated weights for policy 1, policy_version 1434554 (0.0008) [2023-12-26 11:07:29,878][123091] Updated weights for policy 0, policy_version 1444217 (0.0009) [2023-12-26 11:07:29,944][123091] Updated weights for policy 0, policy_version 1444227 (0.0010) [2023-12-26 11:07:29,997][123091] Updated weights for policy 0, policy_version 1444237 (0.0009) [2023-12-26 11:07:30,661][123090] Updated weights for policy 1, policy_version 1434564 (0.0009) [2023-12-26 11:07:30,719][123090] Updated weights for policy 1, policy_version 1434574 (0.0010) [2023-12-26 11:07:30,770][123090] Updated weights for policy 1, policy_version 1434584 (0.0010) [2023-12-26 11:07:30,853][123091] Updated weights for policy 0, policy_version 1444247 (0.0009) [2023-12-26 11:07:30,905][123091] Updated weights for policy 0, policy_version 1444257 (0.0009) [2023-12-26 11:07:30,953][123091] Updated weights for policy 0, policy_version 1444267 (0.0009) [2023-12-26 11:07:31,579][123090] Updated weights for policy 1, policy_version 1434594 (0.0010) [2023-12-26 11:07:31,651][123090] Updated weights for policy 1, policy_version 1434604 (0.0008) [2023-12-26 11:07:31,713][123090] Updated weights for policy 1, policy_version 1434614 (0.0009) [2023-12-26 11:07:31,778][123091] Updated weights for policy 0, policy_version 1444277 (0.0009) [2023-12-26 11:07:31,780][123090] Updated weights for policy 1, policy_version 1434624 (0.0008) [2023-12-26 11:07:31,838][123091] Updated weights for policy 0, policy_version 1444287 (0.0009) [2023-12-26 11:07:31,896][123091] Updated weights for policy 0, policy_version 1444297 (0.0008) [2023-12-26 11:07:32,558][123090] Updated weights for policy 1, policy_version 1434634 (0.0010) [2023-12-26 11:07:32,617][123090] Updated weights for policy 1, policy_version 1434644 (0.0010) [2023-12-26 11:07:32,671][123090] Updated weights for policy 1, policy_version 1434655 (0.0010) [2023-12-26 11:07:32,709][123091] Updated weights for policy 0, policy_version 1444307 (0.0008) [2023-12-26 11:07:32,758][123091] Updated weights for policy 0, policy_version 1444317 (0.0009) [2023-12-26 11:07:32,818][123091] Updated weights for policy 0, policy_version 1444327 (0.0010) [2023-12-26 11:07:33,463][123090] Updated weights for policy 1, policy_version 1434665 (0.0006) [2023-12-26 11:07:33,523][123090] Updated weights for policy 1, policy_version 1434675 (0.0005) [2023-12-26 11:07:33,570][123090] Updated weights for policy 1, policy_version 1434685 (0.0005) [2023-12-26 11:07:33,699][123091] Updated weights for policy 0, policy_version 1444338 (0.0008) [2023-12-26 11:07:33,756][123091] Updated weights for policy 0, policy_version 1444348 (0.0010) [2023-12-26 11:07:33,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 737034240. Throughput: 0: 8742.1, 1: 8868.9. Samples: 737047508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 11:07:33,785][121949] Avg episode reward: [(0, '6181.058'), (1, '5239.023')] [2023-12-26 11:07:33,812][123091] Updated weights for policy 0, policy_version 1444358 (0.0009) [2023-12-26 11:07:33,866][123091] Updated weights for policy 0, policy_version 1444368 (0.0010) [2023-12-26 11:07:34,205][123090] Updated weights for policy 1, policy_version 1434695 (0.0006) [2023-12-26 11:07:34,268][123090] Updated weights for policy 1, policy_version 1434705 (0.0005) [2023-12-26 11:07:34,331][123090] Updated weights for policy 1, policy_version 1434715 (0.0005) [2023-12-26 11:07:34,712][123091] Updated weights for policy 0, policy_version 1444378 (0.0011) [2023-12-26 11:07:34,768][123091] Updated weights for policy 0, policy_version 1444388 (0.0011) [2023-12-26 11:07:34,827][123091] Updated weights for policy 0, policy_version 1444398 (0.0011) [2023-12-26 11:07:35,074][123090] Updated weights for policy 1, policy_version 1434725 (0.0006) [2023-12-26 11:07:35,123][123090] Updated weights for policy 1, policy_version 1434735 (0.0006) [2023-12-26 11:07:35,180][123090] Updated weights for policy 1, policy_version 1434745 (0.0006) [2023-12-26 11:07:35,533][123091] Updated weights for policy 0, policy_version 1444408 (0.0010) [2023-12-26 11:07:35,591][123091] Updated weights for policy 0, policy_version 1444418 (0.0010) [2023-12-26 11:07:35,646][123091] Updated weights for policy 0, policy_version 1444428 (0.0010) [2023-12-26 11:07:35,893][123090] Updated weights for policy 1, policy_version 1434755 (0.0007) [2023-12-26 11:07:35,952][123090] Updated weights for policy 1, policy_version 1434765 (0.0009) [2023-12-26 11:07:36,007][123090] Updated weights for policy 1, policy_version 1434775 (0.0008) [2023-12-26 11:07:36,495][123091] Updated weights for policy 0, policy_version 1444438 (0.0011) [2023-12-26 11:07:36,555][123091] Updated weights for policy 0, policy_version 1444448 (0.0011) [2023-12-26 11:07:36,619][123091] Updated weights for policy 0, policy_version 1444458 (0.0011) [2023-12-26 11:07:36,784][123090] Updated weights for policy 1, policy_version 1434785 (0.0009) [2023-12-26 11:07:36,839][123090] Updated weights for policy 1, policy_version 1434795 (0.0007) [2023-12-26 11:07:36,892][123090] Updated weights for policy 1, policy_version 1434805 (0.0009) [2023-12-26 11:07:36,953][123090] Updated weights for policy 1, policy_version 1434815 (0.0009) [2023-12-26 11:07:37,448][123091] Updated weights for policy 0, policy_version 1444468 (0.0010) [2023-12-26 11:07:37,502][123091] Updated weights for policy 0, policy_version 1444478 (0.0009) [2023-12-26 11:07:37,552][123091] Updated weights for policy 0, policy_version 1444488 (0.0009) [2023-12-26 11:07:37,807][123090] Updated weights for policy 1, policy_version 1434825 (0.0009) [2023-12-26 11:07:37,876][123090] Updated weights for policy 1, policy_version 1434835 (0.0009) [2023-12-26 11:07:37,941][123090] Updated weights for policy 1, policy_version 1434845 (0.0009) [2023-12-26 11:07:38,408][123091] Updated weights for policy 0, policy_version 1444498 (0.0010) [2023-12-26 11:07:38,468][123091] Updated weights for policy 0, policy_version 1444508 (0.0011) [2023-12-26 11:07:38,516][123091] Updated weights for policy 0, policy_version 1444518 (0.0010) [2023-12-26 11:07:38,574][123091] Updated weights for policy 0, policy_version 1444528 (0.0011) [2023-12-26 11:07:38,737][123090] Updated weights for policy 1, policy_version 1434855 (0.0007) [2023-12-26 11:07:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 737124352. Throughput: 0: 8798.2, 1: 8929.0. Samples: 737103188. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:07:38,785][121949] Avg episode reward: [(0, '6194.319'), (1, '5265.931')] [2023-12-26 11:07:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001444528_369803264.pth... [2023-12-26 11:07:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001443504_369541120.pth [2023-12-26 11:07:38,801][123090] Updated weights for policy 1, policy_version 1434865 (0.0007) [2023-12-26 11:07:38,854][123090] Updated weights for policy 1, policy_version 1434875 (0.0011) [2023-12-26 11:07:38,884][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001434880_367329280.pth... [2023-12-26 11:07:38,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001433824_367058944.pth [2023-12-26 11:07:39,446][123091] Updated weights for policy 0, policy_version 1444538 (0.0010) [2023-12-26 11:07:39,500][123091] Updated weights for policy 0, policy_version 1444548 (0.0009) [2023-12-26 11:07:39,558][123091] Updated weights for policy 0, policy_version 1444558 (0.0009) [2023-12-26 11:07:39,699][123090] Updated weights for policy 1, policy_version 1434885 (0.0010) [2023-12-26 11:07:39,769][123090] Updated weights for policy 1, policy_version 1434895 (0.0010) [2023-12-26 11:07:39,841][123090] Updated weights for policy 1, policy_version 1434905 (0.0011) [2023-12-26 11:07:40,447][123091] Updated weights for policy 0, policy_version 1444568 (0.0009) [2023-12-26 11:07:40,503][123091] Updated weights for policy 0, policy_version 1444578 (0.0009) [2023-12-26 11:07:40,567][123091] Updated weights for policy 0, policy_version 1444588 (0.0009) [2023-12-26 11:07:40,678][123090] Updated weights for policy 1, policy_version 1434915 (0.0011) [2023-12-26 11:07:40,740][123090] Updated weights for policy 1, policy_version 1434925 (0.0010) [2023-12-26 11:07:40,799][123090] Updated weights for policy 1, policy_version 1434935 (0.0010) [2023-12-26 11:07:41,406][123091] Updated weights for policy 0, policy_version 1444598 (0.0009) [2023-12-26 11:07:41,460][123091] Updated weights for policy 0, policy_version 1444608 (0.0009) [2023-12-26 11:07:41,512][123091] Updated weights for policy 0, policy_version 1444618 (0.0009) [2023-12-26 11:07:41,632][123090] Updated weights for policy 1, policy_version 1434945 (0.0010) [2023-12-26 11:07:41,689][123090] Updated weights for policy 1, policy_version 1434955 (0.0011) [2023-12-26 11:07:41,755][123090] Updated weights for policy 1, policy_version 1434965 (0.0010) [2023-12-26 11:07:41,807][123090] Updated weights for policy 1, policy_version 1434975 (0.0010) [2023-12-26 11:07:42,413][123091] Updated weights for policy 0, policy_version 1444628 (0.0008) [2023-12-26 11:07:42,479][123091] Updated weights for policy 0, policy_version 1444638 (0.0009) [2023-12-26 11:07:42,546][123091] Updated weights for policy 0, policy_version 1444648 (0.0009) [2023-12-26 11:07:42,613][123090] Updated weights for policy 1, policy_version 1434985 (0.0010) [2023-12-26 11:07:42,683][123090] Updated weights for policy 1, policy_version 1434995 (0.0009) [2023-12-26 11:07:42,754][123090] Updated weights for policy 1, policy_version 1435005 (0.0006) [2023-12-26 11:07:43,368][123091] Updated weights for policy 0, policy_version 1444658 (0.0010) [2023-12-26 11:07:43,420][123091] Updated weights for policy 0, policy_version 1444668 (0.0006) [2023-12-26 11:07:43,434][123090] Updated weights for policy 1, policy_version 1435015 (0.0006) [2023-12-26 11:07:43,467][123091] Updated weights for policy 0, policy_version 1444678 (0.0010) [2023-12-26 11:07:43,486][123090] Updated weights for policy 1, policy_version 1435025 (0.0010) [2023-12-26 11:07:43,514][123091] Updated weights for policy 0, policy_version 1444688 (0.0010) [2023-12-26 11:07:43,533][123090] Updated weights for policy 1, policy_version 1435035 (0.0010) [2023-12-26 11:07:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 737214464. Throughput: 0: 8771.2, 1: 8926.4. Samples: 737203752. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:07:43,784][121949] Avg episode reward: [(0, '6317.017'), (1, '5422.527')] [2023-12-26 11:07:44,275][123090] Updated weights for policy 1, policy_version 1435045 (0.0010) [2023-12-26 11:07:44,330][123090] Updated weights for policy 1, policy_version 1435055 (0.0010) [2023-12-26 11:07:44,332][123091] Updated weights for policy 0, policy_version 1444698 (0.0011) [2023-12-26 11:07:44,390][123091] Updated weights for policy 0, policy_version 1444708 (0.0010) [2023-12-26 11:07:44,393][123090] Updated weights for policy 1, policy_version 1435065 (0.0010) [2023-12-26 11:07:44,452][123091] Updated weights for policy 0, policy_version 1444718 (0.0011) [2023-12-26 11:07:45,192][123090] Updated weights for policy 1, policy_version 1435075 (0.0011) [2023-12-26 11:07:45,222][123091] Updated weights for policy 0, policy_version 1444728 (0.0009) [2023-12-26 11:07:45,252][123090] Updated weights for policy 1, policy_version 1435085 (0.0011) [2023-12-26 11:07:45,287][123091] Updated weights for policy 0, policy_version 1444738 (0.0009) [2023-12-26 11:07:45,312][123090] Updated weights for policy 1, policy_version 1435095 (0.0011) [2023-12-26 11:07:45,349][123091] Updated weights for policy 0, policy_version 1444748 (0.0009) [2023-12-26 11:07:46,092][123090] Updated weights for policy 1, policy_version 1435105 (0.0011) [2023-12-26 11:07:46,105][123091] Updated weights for policy 0, policy_version 1444758 (0.0006) [2023-12-26 11:07:46,155][123090] Updated weights for policy 1, policy_version 1435115 (0.0010) [2023-12-26 11:07:46,158][123091] Updated weights for policy 0, policy_version 1444768 (0.0005) [2023-12-26 11:07:46,206][123090] Updated weights for policy 1, policy_version 1435125 (0.0010) [2023-12-26 11:07:46,212][123091] Updated weights for policy 0, policy_version 1444778 (0.0005) [2023-12-26 11:07:46,262][123090] Updated weights for policy 1, policy_version 1435135 (0.0010) [2023-12-26 11:07:46,873][123091] Updated weights for policy 0, policy_version 1444788 (0.0005) [2023-12-26 11:07:46,918][123091] Updated weights for policy 0, policy_version 1444798 (0.0005) [2023-12-26 11:07:46,965][123091] Updated weights for policy 0, policy_version 1444808 (0.0005) [2023-12-26 11:07:47,029][123090] Updated weights for policy 1, policy_version 1435145 (0.0010) [2023-12-26 11:07:47,088][123090] Updated weights for policy 1, policy_version 1435155 (0.0010) [2023-12-26 11:07:47,140][123090] Updated weights for policy 1, policy_version 1435165 (0.0010) [2023-12-26 11:07:47,609][123091] Updated weights for policy 0, policy_version 1444818 (0.0006) [2023-12-26 11:07:47,670][123091] Updated weights for policy 0, policy_version 1444828 (0.0010) [2023-12-26 11:07:47,737][123091] Updated weights for policy 0, policy_version 1444838 (0.0011) [2023-12-26 11:07:47,801][123091] Updated weights for policy 0, policy_version 1444848 (0.0011) [2023-12-26 11:07:47,940][123090] Updated weights for policy 1, policy_version 1435175 (0.0010) [2023-12-26 11:07:48,003][123090] Updated weights for policy 1, policy_version 1435185 (0.0010) [2023-12-26 11:07:48,070][123090] Updated weights for policy 1, policy_version 1435195 (0.0009) [2023-12-26 11:07:48,616][123091] Updated weights for policy 0, policy_version 1444859 (0.0010) [2023-12-26 11:07:48,676][123091] Updated weights for policy 0, policy_version 1444869 (0.0010) [2023-12-26 11:07:48,736][123091] Updated weights for policy 0, policy_version 1444879 (0.0011) [2023-12-26 11:07:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17911.3). Total num frames: 737304576. Throughput: 0: 8797.5, 1: 8946.4. Samples: 737314804. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:07:48,785][121949] Avg episode reward: [(0, '6318.096'), (1, '5574.199')] [2023-12-26 11:07:48,931][123090] Updated weights for policy 1, policy_version 1435205 (0.0009) [2023-12-26 11:07:48,996][123090] Updated weights for policy 1, policy_version 1435215 (0.0009) [2023-12-26 11:07:49,048][123090] Updated weights for policy 1, policy_version 1435225 (0.0008) [2023-12-26 11:07:49,572][123091] Updated weights for policy 0, policy_version 1444889 (0.0006) [2023-12-26 11:07:49,636][123091] Updated weights for policy 0, policy_version 1444899 (0.0005) [2023-12-26 11:07:49,696][123091] Updated weights for policy 0, policy_version 1444909 (0.0005) [2023-12-26 11:07:49,910][123090] Updated weights for policy 1, policy_version 1435235 (0.0010) [2023-12-26 11:07:49,979][123090] Updated weights for policy 1, policy_version 1435245 (0.0011) [2023-12-26 11:07:50,045][123090] Updated weights for policy 1, policy_version 1435255 (0.0011) [2023-12-26 11:07:50,446][123091] Updated weights for policy 0, policy_version 1444919 (0.0009) [2023-12-26 11:07:50,498][123091] Updated weights for policy 0, policy_version 1444929 (0.0010) [2023-12-26 11:07:50,548][123091] Updated weights for policy 0, policy_version 1444940 (0.0009) [2023-12-26 11:07:50,667][123090] Updated weights for policy 1, policy_version 1435265 (0.0007) [2023-12-26 11:07:50,728][123090] Updated weights for policy 1, policy_version 1435275 (0.0009) [2023-12-26 11:07:50,787][123090] Updated weights for policy 1, policy_version 1435285 (0.0005) [2023-12-26 11:07:50,847][123090] Updated weights for policy 1, policy_version 1435295 (0.0007) [2023-12-26 11:07:51,431][123091] Updated weights for policy 0, policy_version 1444950 (0.0010) [2023-12-26 11:07:51,494][123091] Updated weights for policy 0, policy_version 1444960 (0.0009) [2023-12-26 11:07:51,557][123091] Updated weights for policy 0, policy_version 1444970 (0.0009) [2023-12-26 11:07:51,677][123090] Updated weights for policy 1, policy_version 1435305 (0.0009) [2023-12-26 11:07:51,752][123090] Updated weights for policy 1, policy_version 1435315 (0.0009) [2023-12-26 11:07:51,811][123090] Updated weights for policy 1, policy_version 1435325 (0.0010) [2023-12-26 11:07:52,427][123091] Updated weights for policy 0, policy_version 1444980 (0.0009) [2023-12-26 11:07:52,480][123091] Updated weights for policy 0, policy_version 1444990 (0.0010) [2023-12-26 11:07:52,516][123090] Updated weights for policy 1, policy_version 1435335 (0.0009) [2023-12-26 11:07:52,536][123091] Updated weights for policy 0, policy_version 1445000 (0.0009) [2023-12-26 11:07:52,568][123090] Updated weights for policy 1, policy_version 1435345 (0.0008) [2023-12-26 11:07:52,621][123090] Updated weights for policy 1, policy_version 1435355 (0.0009) [2023-12-26 11:07:53,408][123090] Updated weights for policy 1, policy_version 1435365 (0.0009) [2023-12-26 11:07:53,451][123091] Updated weights for policy 0, policy_version 1445010 (0.0009) [2023-12-26 11:07:53,456][123090] Updated weights for policy 1, policy_version 1435375 (0.0009) [2023-12-26 11:07:53,501][123091] Updated weights for policy 0, policy_version 1445020 (0.0009) [2023-12-26 11:07:53,517][123090] Updated weights for policy 1, policy_version 1435385 (0.0008) [2023-12-26 11:07:53,547][123091] Updated weights for policy 0, policy_version 1445030 (0.0007) [2023-12-26 11:07:53,595][123091] Updated weights for policy 0, policy_version 1445040 (0.0009) [2023-12-26 11:07:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 737394688. Throughput: 0: 8722.1, 1: 8961.7. Samples: 737367064. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:07:53,785][121949] Avg episode reward: [(0, '6335.053'), (1, '5455.072')] [2023-12-26 11:07:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001445040_369934336.pth... [2023-12-26 11:07:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001435392_367460352.pth... [2023-12-26 11:07:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001444016_369672192.pth [2023-12-26 11:07:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001434336_367190016.pth [2023-12-26 11:07:54,257][123090] Updated weights for policy 1, policy_version 1435395 (0.0007) [2023-12-26 11:07:54,312][123090] Updated weights for policy 1, policy_version 1435405 (0.0005) [2023-12-26 11:07:54,369][123090] Updated weights for policy 1, policy_version 1435415 (0.0005) [2023-12-26 11:07:54,486][123091] Updated weights for policy 0, policy_version 1445050 (0.0009) [2023-12-26 11:07:54,548][123091] Updated weights for policy 0, policy_version 1445060 (0.0009) [2023-12-26 11:07:54,613][123091] Updated weights for policy 0, policy_version 1445070 (0.0009) [2023-12-26 11:07:55,131][123090] Updated weights for policy 1, policy_version 1435425 (0.0009) [2023-12-26 11:07:55,183][123090] Updated weights for policy 1, policy_version 1435435 (0.0009) [2023-12-26 11:07:55,240][123090] Updated weights for policy 1, policy_version 1435445 (0.0009) [2023-12-26 11:07:55,307][123090] Updated weights for policy 1, policy_version 1435455 (0.0009) [2023-12-26 11:07:55,435][123091] Updated weights for policy 0, policy_version 1445080 (0.0009) [2023-12-26 11:07:55,501][123091] Updated weights for policy 0, policy_version 1445090 (0.0009) [2023-12-26 11:07:55,573][123091] Updated weights for policy 0, policy_version 1445100 (0.0009) [2023-12-26 11:07:56,129][123090] Updated weights for policy 1, policy_version 1435465 (0.0010) [2023-12-26 11:07:56,176][123090] Updated weights for policy 1, policy_version 1435475 (0.0009) [2023-12-26 11:07:56,230][123090] Updated weights for policy 1, policy_version 1435485 (0.0009) [2023-12-26 11:07:56,383][123091] Updated weights for policy 0, policy_version 1445110 (0.0008) [2023-12-26 11:07:56,442][123091] Updated weights for policy 0, policy_version 1445120 (0.0010) [2023-12-26 11:07:56,495][123091] Updated weights for policy 0, policy_version 1445130 (0.0009) [2023-12-26 11:07:56,972][123090] Updated weights for policy 1, policy_version 1435495 (0.0006) [2023-12-26 11:07:57,016][123090] Updated weights for policy 1, policy_version 1435505 (0.0005) [2023-12-26 11:07:57,063][123090] Updated weights for policy 1, policy_version 1435515 (0.0005) [2023-12-26 11:07:57,219][123091] Updated weights for policy 0, policy_version 1445140 (0.0005) [2023-12-26 11:07:57,265][123091] Updated weights for policy 0, policy_version 1445150 (0.0005) [2023-12-26 11:07:57,321][123091] Updated weights for policy 0, policy_version 1445160 (0.0005) [2023-12-26 11:07:57,710][123090] Updated weights for policy 1, policy_version 1435525 (0.0007) [2023-12-26 11:07:57,781][123090] Updated weights for policy 1, policy_version 1435535 (0.0005) [2023-12-26 11:07:57,853][123090] Updated weights for policy 1, policy_version 1435545 (0.0005) [2023-12-26 11:07:58,036][123091] Updated weights for policy 0, policy_version 1445170 (0.0006) [2023-12-26 11:07:58,099][123091] Updated weights for policy 0, policy_version 1445180 (0.0008) [2023-12-26 11:07:58,157][123091] Updated weights for policy 0, policy_version 1445190 (0.0008) [2023-12-26 11:07:58,210][123091] Updated weights for policy 0, policy_version 1445200 (0.0008) [2023-12-26 11:07:58,596][123090] Updated weights for policy 1, policy_version 1435555 (0.0006) [2023-12-26 11:07:58,672][123090] Updated weights for policy 1, policy_version 1435565 (0.0007) [2023-12-26 11:07:58,748][123090] Updated weights for policy 1, policy_version 1435575 (0.0007) [2023-12-26 11:07:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 737476608. Throughput: 0: 8725.5, 1: 8981.4. Samples: 737474572. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:07:58,785][121949] Avg episode reward: [(0, '6315.358'), (1, '5488.678')] [2023-12-26 11:07:59,052][123091] Updated weights for policy 0, policy_version 1445210 (0.0006) [2023-12-26 11:07:59,126][123091] Updated weights for policy 0, policy_version 1445220 (0.0006) [2023-12-26 11:07:59,199][123091] Updated weights for policy 0, policy_version 1445230 (0.0006) [2023-12-26 11:07:59,479][123090] Updated weights for policy 1, policy_version 1435585 (0.0008) [2023-12-26 11:07:59,533][123090] Updated weights for policy 1, policy_version 1435595 (0.0009) [2023-12-26 11:07:59,586][123090] Updated weights for policy 1, policy_version 1435605 (0.0008) [2023-12-26 11:07:59,642][123090] Updated weights for policy 1, policy_version 1435615 (0.0009) [2023-12-26 11:07:59,919][123091] Updated weights for policy 0, policy_version 1445240 (0.0010) [2023-12-26 11:07:59,987][123091] Updated weights for policy 0, policy_version 1445250 (0.0011) [2023-12-26 11:08:00,047][123091] Updated weights for policy 0, policy_version 1445260 (0.0009) [2023-12-26 11:08:00,583][123090] Updated weights for policy 1, policy_version 1435625 (0.0009) [2023-12-26 11:08:00,641][123090] Updated weights for policy 1, policy_version 1435635 (0.0009) [2023-12-26 11:08:00,699][123090] Updated weights for policy 1, policy_version 1435645 (0.0009) [2023-12-26 11:08:00,728][123091] Updated weights for policy 0, policy_version 1445270 (0.0005) [2023-12-26 11:08:00,785][123091] Updated weights for policy 0, policy_version 1445280 (0.0005) [2023-12-26 11:08:00,830][123091] Updated weights for policy 0, policy_version 1445290 (0.0005) [2023-12-26 11:08:01,616][123090] Updated weights for policy 1, policy_version 1435655 (0.0009) [2023-12-26 11:08:01,620][123091] Updated weights for policy 0, policy_version 1445300 (0.0007) [2023-12-26 11:08:01,679][123091] Updated weights for policy 0, policy_version 1445310 (0.0009) [2023-12-26 11:08:01,680][123090] Updated weights for policy 1, policy_version 1435665 (0.0007) [2023-12-26 11:08:01,740][123091] Updated weights for policy 0, policy_version 1445320 (0.0007) [2023-12-26 11:08:01,745][123090] Updated weights for policy 1, policy_version 1435675 (0.0009) [2023-12-26 11:08:02,373][123090] Updated weights for policy 1, policy_version 1435685 (0.0007) [2023-12-26 11:08:02,432][123090] Updated weights for policy 1, policy_version 1435695 (0.0006) [2023-12-26 11:08:02,488][123090] Updated weights for policy 1, policy_version 1435705 (0.0005) [2023-12-26 11:08:02,642][123091] Updated weights for policy 0, policy_version 1445330 (0.0010) [2023-12-26 11:08:02,695][123091] Updated weights for policy 0, policy_version 1445340 (0.0009) [2023-12-26 11:08:02,758][123091] Updated weights for policy 0, policy_version 1445350 (0.0010) [2023-12-26 11:08:02,814][123091] Updated weights for policy 0, policy_version 1445360 (0.0009) [2023-12-26 11:08:03,190][123090] Updated weights for policy 1, policy_version 1435715 (0.0005) [2023-12-26 11:08:03,252][123090] Updated weights for policy 1, policy_version 1435725 (0.0006) [2023-12-26 11:08:03,311][123090] Updated weights for policy 1, policy_version 1435735 (0.0005) [2023-12-26 11:08:03,763][123091] Updated weights for policy 0, policy_version 1445370 (0.0010) [2023-12-26 11:08:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 737566720. Throughput: 0: 8677.8, 1: 8971.9. Samples: 737581896. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:03,785][121949] Avg episode reward: [(0, '6201.858'), (1, '5734.947')] [2023-12-26 11:08:03,816][123091] Updated weights for policy 0, policy_version 1445380 (0.0009) [2023-12-26 11:08:03,875][123091] Updated weights for policy 0, policy_version 1445390 (0.0008) [2023-12-26 11:08:03,978][123090] Updated weights for policy 1, policy_version 1435745 (0.0005) [2023-12-26 11:08:04,044][123090] Updated weights for policy 1, policy_version 1435755 (0.0005) [2023-12-26 11:08:04,113][123090] Updated weights for policy 1, policy_version 1435765 (0.0006) [2023-12-26 11:08:04,182][123090] Updated weights for policy 1, policy_version 1435775 (0.0006) [2023-12-26 11:08:04,729][123091] Updated weights for policy 0, policy_version 1445400 (0.0010) [2023-12-26 11:08:04,782][123091] Updated weights for policy 0, policy_version 1445410 (0.0008) [2023-12-26 11:08:04,809][123090] Updated weights for policy 1, policy_version 1435785 (0.0010) [2023-12-26 11:08:04,841][123091] Updated weights for policy 0, policy_version 1445420 (0.0006) [2023-12-26 11:08:04,868][123090] Updated weights for policy 1, policy_version 1435795 (0.0010) [2023-12-26 11:08:04,926][123090] Updated weights for policy 1, policy_version 1435805 (0.0010) [2023-12-26 11:08:05,672][123090] Updated weights for policy 1, policy_version 1435815 (0.0010) [2023-12-26 11:08:05,728][123091] Updated weights for policy 0, policy_version 1445430 (0.0007) [2023-12-26 11:08:05,738][123090] Updated weights for policy 1, policy_version 1435825 (0.0010) [2023-12-26 11:08:05,784][123091] Updated weights for policy 0, policy_version 1445440 (0.0007) [2023-12-26 11:08:05,801][123090] Updated weights for policy 1, policy_version 1435835 (0.0010) [2023-12-26 11:08:05,841][123091] Updated weights for policy 0, policy_version 1445450 (0.0007) [2023-12-26 11:08:06,584][123090] Updated weights for policy 1, policy_version 1435845 (0.0008) [2023-12-26 11:08:06,647][123090] Updated weights for policy 1, policy_version 1435855 (0.0008) [2023-12-26 11:08:06,711][123090] Updated weights for policy 1, policy_version 1435865 (0.0005) [2023-12-26 11:08:06,714][123091] Updated weights for policy 0, policy_version 1445460 (0.0009) [2023-12-26 11:08:06,764][123091] Updated weights for policy 0, policy_version 1445471 (0.0010) [2023-12-26 11:08:06,817][123091] Updated weights for policy 0, policy_version 1445482 (0.0010) [2023-12-26 11:08:07,378][123090] Updated weights for policy 1, policy_version 1435875 (0.0006) [2023-12-26 11:08:07,446][123090] Updated weights for policy 1, policy_version 1435885 (0.0007) [2023-12-26 11:08:07,508][123090] Updated weights for policy 1, policy_version 1435895 (0.0008) [2023-12-26 11:08:07,703][123091] Updated weights for policy 0, policy_version 1445492 (0.0010) [2023-12-26 11:08:07,766][123091] Updated weights for policy 0, policy_version 1445502 (0.0010) [2023-12-26 11:08:07,827][123091] Updated weights for policy 0, policy_version 1445512 (0.0010) [2023-12-26 11:08:08,218][123090] Updated weights for policy 1, policy_version 1435905 (0.0008) [2023-12-26 11:08:08,269][123090] Updated weights for policy 1, policy_version 1435915 (0.0010) [2023-12-26 11:08:08,324][123090] Updated weights for policy 1, policy_version 1435925 (0.0010) [2023-12-26 11:08:08,403][123090] Updated weights for policy 1, policy_version 1435935 (0.0011) [2023-12-26 11:08:08,695][123091] Updated weights for policy 0, policy_version 1445522 (0.0009) [2023-12-26 11:08:08,768][123091] Updated weights for policy 0, policy_version 1445532 (0.0009) [2023-12-26 11:08:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17883.6). Total num frames: 737656832. Throughput: 0: 8676.5, 1: 9062.8. Samples: 737635772. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:08,784][121949] Avg episode reward: [(0, '6091.884'), (1, '5589.229')] [2023-12-26 11:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001435936_367599616.pth... [2023-12-26 11:08:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001434880_367329280.pth [2023-12-26 11:08:08,833][123091] Updated weights for policy 0, policy_version 1445542 (0.0008) [2023-12-26 11:08:08,887][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001445552_370065408.pth... [2023-12-26 11:08:08,890][123091] Updated weights for policy 0, policy_version 1445552 (0.0009) [2023-12-26 11:08:08,890][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001444528_369803264.pth [2023-12-26 11:08:09,216][123090] Updated weights for policy 1, policy_version 1435945 (0.0011) [2023-12-26 11:08:09,278][123090] Updated weights for policy 1, policy_version 1435955 (0.0010) [2023-12-26 11:08:09,352][123090] Updated weights for policy 1, policy_version 1435965 (0.0009) [2023-12-26 11:08:09,742][123091] Updated weights for policy 0, policy_version 1445562 (0.0010) [2023-12-26 11:08:09,804][123091] Updated weights for policy 0, policy_version 1445572 (0.0010) [2023-12-26 11:08:09,886][123091] Updated weights for policy 0, policy_version 1445582 (0.0007) [2023-12-26 11:08:10,163][123090] Updated weights for policy 1, policy_version 1435975 (0.0009) [2023-12-26 11:08:10,217][123090] Updated weights for policy 1, policy_version 1435985 (0.0009) [2023-12-26 11:08:10,279][123090] Updated weights for policy 1, policy_version 1435995 (0.0009) [2023-12-26 11:08:10,680][123091] Updated weights for policy 0, policy_version 1445592 (0.0010) [2023-12-26 11:08:10,729][123091] Updated weights for policy 0, policy_version 1445602 (0.0009) [2023-12-26 11:08:10,779][123091] Updated weights for policy 0, policy_version 1445613 (0.0010) [2023-12-26 11:08:11,134][123090] Updated weights for policy 1, policy_version 1436005 (0.0010) [2023-12-26 11:08:11,201][123090] Updated weights for policy 1, policy_version 1436015 (0.0009) [2023-12-26 11:08:11,267][123090] Updated weights for policy 1, policy_version 1436025 (0.0010) [2023-12-26 11:08:11,662][123091] Updated weights for policy 0, policy_version 1445623 (0.0010) [2023-12-26 11:08:11,734][123091] Updated weights for policy 0, policy_version 1445633 (0.0011) [2023-12-26 11:08:11,797][123091] Updated weights for policy 0, policy_version 1445643 (0.0011) [2023-12-26 11:08:12,149][123090] Updated weights for policy 1, policy_version 1436035 (0.0010) [2023-12-26 11:08:12,214][123090] Updated weights for policy 1, policy_version 1436045 (0.0006) [2023-12-26 11:08:12,284][123090] Updated weights for policy 1, policy_version 1436055 (0.0009) [2023-12-26 11:08:12,603][123091] Updated weights for policy 0, policy_version 1445653 (0.0010) [2023-12-26 11:08:12,657][123091] Updated weights for policy 0, policy_version 1445663 (0.0006) [2023-12-26 11:08:12,713][123091] Updated weights for policy 0, policy_version 1445673 (0.0005) [2023-12-26 11:08:13,138][123090] Updated weights for policy 1, policy_version 1436065 (0.0010) [2023-12-26 11:08:13,204][123090] Updated weights for policy 1, policy_version 1436075 (0.0009) [2023-12-26 11:08:13,274][123090] Updated weights for policy 1, policy_version 1436085 (0.0009) [2023-12-26 11:08:13,336][123090] Updated weights for policy 1, policy_version 1436095 (0.0009) [2023-12-26 11:08:13,522][123091] Updated weights for policy 0, policy_version 1445683 (0.0009) [2023-12-26 11:08:13,584][123091] Updated weights for policy 0, policy_version 1445693 (0.0010) [2023-12-26 11:08:13,642][123091] Updated weights for policy 0, policy_version 1445703 (0.0011) [2023-12-26 11:08:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 737746944. Throughput: 0: 8641.6, 1: 9036.4. Samples: 737737964. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:13,785][121949] Avg episode reward: [(0, '6114.531'), (1, '5510.815')] [2023-12-26 11:08:14,175][123090] Updated weights for policy 1, policy_version 1436105 (0.0008) [2023-12-26 11:08:14,238][123090] Updated weights for policy 1, policy_version 1436115 (0.0009) [2023-12-26 11:08:14,301][123090] Updated weights for policy 1, policy_version 1436125 (0.0008) [2023-12-26 11:08:14,465][123091] Updated weights for policy 0, policy_version 1445713 (0.0010) [2023-12-26 11:08:14,530][123091] Updated weights for policy 0, policy_version 1445723 (0.0011) [2023-12-26 11:08:14,603][123091] Updated weights for policy 0, policy_version 1445733 (0.0011) [2023-12-26 11:08:14,673][123091] Updated weights for policy 0, policy_version 1445743 (0.0009) [2023-12-26 11:08:15,174][123090] Updated weights for policy 1, policy_version 1436135 (0.0009) [2023-12-26 11:08:15,236][123090] Updated weights for policy 1, policy_version 1436145 (0.0009) [2023-12-26 11:08:15,294][123090] Updated weights for policy 1, policy_version 1436155 (0.0009) [2023-12-26 11:08:15,424][123091] Updated weights for policy 0, policy_version 1445753 (0.0006) [2023-12-26 11:08:15,486][123091] Updated weights for policy 0, policy_version 1445763 (0.0005) [2023-12-26 11:08:15,534][123091] Updated weights for policy 0, policy_version 1445773 (0.0005) [2023-12-26 11:08:16,184][123091] Updated weights for policy 0, policy_version 1445783 (0.0005) [2023-12-26 11:08:16,236][123090] Updated weights for policy 1, policy_version 1436165 (0.0009) [2023-12-26 11:08:16,249][123091] Updated weights for policy 0, policy_version 1445793 (0.0005) [2023-12-26 11:08:16,290][123090] Updated weights for policy 1, policy_version 1436175 (0.0009) [2023-12-26 11:08:16,310][123091] Updated weights for policy 0, policy_version 1445803 (0.0006) [2023-12-26 11:08:16,339][123090] Updated weights for policy 1, policy_version 1436185 (0.0009) [2023-12-26 11:08:16,989][123091] Updated weights for policy 0, policy_version 1445813 (0.0007) [2023-12-26 11:08:17,045][123091] Updated weights for policy 0, policy_version 1445823 (0.0011) [2023-12-26 11:08:17,095][123091] Updated weights for policy 0, policy_version 1445833 (0.0010) [2023-12-26 11:08:17,168][123090] Updated weights for policy 1, policy_version 1436195 (0.0009) [2023-12-26 11:08:17,216][123090] Updated weights for policy 1, policy_version 1436205 (0.0009) [2023-12-26 11:08:17,277][123090] Updated weights for policy 1, policy_version 1436215 (0.0009) [2023-12-26 11:08:17,817][123091] Updated weights for policy 0, policy_version 1445843 (0.0009) [2023-12-26 11:08:17,888][123091] Updated weights for policy 0, policy_version 1445853 (0.0008) [2023-12-26 11:08:17,954][123091] Updated weights for policy 0, policy_version 1445863 (0.0010) [2023-12-26 11:08:18,109][123090] Updated weights for policy 1, policy_version 1436225 (0.0008) [2023-12-26 11:08:18,176][123090] Updated weights for policy 1, policy_version 1436235 (0.0005) [2023-12-26 11:08:18,241][123090] Updated weights for policy 1, policy_version 1436245 (0.0005) [2023-12-26 11:08:18,306][123090] Updated weights for policy 1, policy_version 1436255 (0.0008) [2023-12-26 11:08:18,746][123091] Updated weights for policy 0, policy_version 1445873 (0.0011) [2023-12-26 11:08:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 737828864. Throughput: 0: 8739.0, 1: 8968.7. Samples: 737844356. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:18,784][121949] Avg episode reward: [(0, '6280.592'), (1, '5622.304')] [2023-12-26 11:08:18,816][123091] Updated weights for policy 0, policy_version 1445883 (0.0011) [2023-12-26 11:08:18,875][123091] Updated weights for policy 0, policy_version 1445893 (0.0011) [2023-12-26 11:08:18,945][123091] Updated weights for policy 0, policy_version 1445903 (0.0011) [2023-12-26 11:08:19,112][123090] Updated weights for policy 1, policy_version 1436265 (0.0009) [2023-12-26 11:08:19,191][123090] Updated weights for policy 1, policy_version 1436275 (0.0007) [2023-12-26 11:08:19,262][123090] Updated weights for policy 1, policy_version 1436285 (0.0008) [2023-12-26 11:08:19,732][123091] Updated weights for policy 0, policy_version 1445913 (0.0011) [2023-12-26 11:08:19,800][123091] Updated weights for policy 0, policy_version 1445923 (0.0011) [2023-12-26 11:08:19,875][123091] Updated weights for policy 0, policy_version 1445933 (0.0011) [2023-12-26 11:08:20,072][123090] Updated weights for policy 1, policy_version 1436295 (0.0008) [2023-12-26 11:08:20,134][123090] Updated weights for policy 1, policy_version 1436305 (0.0010) [2023-12-26 11:08:20,204][123090] Updated weights for policy 1, policy_version 1436315 (0.0010) [2023-12-26 11:08:20,662][123091] Updated weights for policy 0, policy_version 1445943 (0.0008) [2023-12-26 11:08:20,736][123091] Updated weights for policy 0, policy_version 1445953 (0.0009) [2023-12-26 11:08:20,811][123091] Updated weights for policy 0, policy_version 1445963 (0.0007) [2023-12-26 11:08:21,097][123090] Updated weights for policy 1, policy_version 1436325 (0.0009) [2023-12-26 11:08:21,171][123090] Updated weights for policy 1, policy_version 1436335 (0.0010) [2023-12-26 11:08:21,230][123090] Updated weights for policy 1, policy_version 1436345 (0.0009) [2023-12-26 11:08:21,566][123091] Updated weights for policy 0, policy_version 1445973 (0.0007) [2023-12-26 11:08:21,617][123091] Updated weights for policy 0, policy_version 1445983 (0.0010) [2023-12-26 11:08:21,686][123091] Updated weights for policy 0, policy_version 1445993 (0.0009) [2023-12-26 11:08:22,114][123090] Updated weights for policy 1, policy_version 1436355 (0.0009) [2023-12-26 11:08:22,167][123090] Updated weights for policy 1, policy_version 1436365 (0.0009) [2023-12-26 11:08:22,224][123090] Updated weights for policy 1, policy_version 1436375 (0.0009) [2023-12-26 11:08:22,534][123091] Updated weights for policy 0, policy_version 1446003 (0.0009) [2023-12-26 11:08:22,589][123091] Updated weights for policy 0, policy_version 1446013 (0.0009) [2023-12-26 11:08:22,650][123091] Updated weights for policy 0, policy_version 1446023 (0.0009) [2023-12-26 11:08:23,127][123090] Updated weights for policy 1, policy_version 1436385 (0.0009) [2023-12-26 11:08:23,193][123090] Updated weights for policy 1, policy_version 1436395 (0.0009) [2023-12-26 11:08:23,261][123090] Updated weights for policy 1, policy_version 1436405 (0.0009) [2023-12-26 11:08:23,317][123090] Updated weights for policy 1, policy_version 1436415 (0.0008) [2023-12-26 11:08:23,463][123091] Updated weights for policy 0, policy_version 1446033 (0.0009) [2023-12-26 11:08:23,529][123091] Updated weights for policy 0, policy_version 1446043 (0.0010) [2023-12-26 11:08:23,576][123091] Updated weights for policy 0, policy_version 1446053 (0.0010) [2023-12-26 11:08:23,622][123091] Updated weights for policy 0, policy_version 1446063 (0.0010) [2023-12-26 11:08:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 737918976. Throughput: 0: 8740.6, 1: 8866.8. Samples: 737895520. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:23,785][121949] Avg episode reward: [(0, '6179.146'), (1, '5632.234')] [2023-12-26 11:08:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001446064_370196480.pth... [2023-12-26 11:08:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001436416_367722496.pth... [2023-12-26 11:08:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001445040_369934336.pth [2023-12-26 11:08:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001435392_367460352.pth [2023-12-26 11:08:24,090][123090] Updated weights for policy 1, policy_version 1436425 (0.0006) [2023-12-26 11:08:24,163][123090] Updated weights for policy 1, policy_version 1436435 (0.0005) [2023-12-26 11:08:24,225][123090] Updated weights for policy 1, policy_version 1436445 (0.0008) [2023-12-26 11:08:24,445][123091] Updated weights for policy 0, policy_version 1446073 (0.0011) [2023-12-26 11:08:24,508][123091] Updated weights for policy 0, policy_version 1446083 (0.0011) [2023-12-26 11:08:24,579][123091] Updated weights for policy 0, policy_version 1446093 (0.0011) [2023-12-26 11:08:24,899][123090] Updated weights for policy 1, policy_version 1436455 (0.0005) [2023-12-26 11:08:24,953][123090] Updated weights for policy 1, policy_version 1436465 (0.0005) [2023-12-26 11:08:25,016][123090] Updated weights for policy 1, policy_version 1436475 (0.0005) [2023-12-26 11:08:25,392][123091] Updated weights for policy 0, policy_version 1446103 (0.0010) [2023-12-26 11:08:25,442][123091] Updated weights for policy 0, policy_version 1446113 (0.0010) [2023-12-26 11:08:25,500][123091] Updated weights for policy 0, policy_version 1446123 (0.0010) [2023-12-26 11:08:25,591][123090] Updated weights for policy 1, policy_version 1436485 (0.0005) [2023-12-26 11:08:25,644][123090] Updated weights for policy 1, policy_version 1436495 (0.0005) [2023-12-26 11:08:25,701][123090] Updated weights for policy 1, policy_version 1436505 (0.0009) [2023-12-26 11:08:26,265][123091] Updated weights for policy 0, policy_version 1446133 (0.0010) [2023-12-26 11:08:26,324][123091] Updated weights for policy 0, policy_version 1446143 (0.0010) [2023-12-26 11:08:26,385][123091] Updated weights for policy 0, policy_version 1446153 (0.0010) [2023-12-26 11:08:26,540][123090] Updated weights for policy 1, policy_version 1436515 (0.0008) [2023-12-26 11:08:26,596][123090] Updated weights for policy 1, policy_version 1436525 (0.0005) [2023-12-26 11:08:26,651][123090] Updated weights for policy 1, policy_version 1436535 (0.0005) [2023-12-26 11:08:27,196][123091] Updated weights for policy 0, policy_version 1446163 (0.0010) [2023-12-26 11:08:27,246][123091] Updated weights for policy 0, policy_version 1446173 (0.0010) [2023-12-26 11:08:27,296][123090] Updated weights for policy 1, policy_version 1436545 (0.0005) [2023-12-26 11:08:27,300][123091] Updated weights for policy 0, policy_version 1446183 (0.0010) [2023-12-26 11:08:27,349][123090] Updated weights for policy 1, policy_version 1436555 (0.0007) [2023-12-26 11:08:27,404][123090] Updated weights for policy 1, policy_version 1436565 (0.0005) [2023-12-26 11:08:27,468][123090] Updated weights for policy 1, policy_version 1436575 (0.0005) [2023-12-26 11:08:28,121][123091] Updated weights for policy 0, policy_version 1446193 (0.0010) [2023-12-26 11:08:28,153][123090] Updated weights for policy 1, policy_version 1436585 (0.0009) [2023-12-26 11:08:28,179][123091] Updated weights for policy 0, policy_version 1446203 (0.0010) [2023-12-26 11:08:28,217][123090] Updated weights for policy 1, policy_version 1436595 (0.0010) [2023-12-26 11:08:28,231][123091] Updated weights for policy 0, policy_version 1446213 (0.0010) [2023-12-26 11:08:28,272][123090] Updated weights for policy 1, policy_version 1436605 (0.0010) [2023-12-26 11:08:28,282][123091] Updated weights for policy 0, policy_version 1446223 (0.0010) [2023-12-26 11:08:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 738009088. Throughput: 0: 8792.1, 1: 8983.4. Samples: 738003648. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:28,784][121949] Avg episode reward: [(0, '6088.012'), (1, '5452.452')] [2023-12-26 11:08:29,048][123091] Updated weights for policy 0, policy_version 1446233 (0.0006) [2023-12-26 11:08:29,093][123091] Updated weights for policy 0, policy_version 1446243 (0.0005) [2023-12-26 11:08:29,102][123090] Updated weights for policy 1, policy_version 1436615 (0.0010) [2023-12-26 11:08:29,152][123091] Updated weights for policy 0, policy_version 1446253 (0.0005) [2023-12-26 11:08:29,165][123090] Updated weights for policy 1, policy_version 1436625 (0.0010) [2023-12-26 11:08:29,223][123090] Updated weights for policy 1, policy_version 1436635 (0.0010) [2023-12-26 11:08:29,907][123091] Updated weights for policy 0, policy_version 1446263 (0.0008) [2023-12-26 11:08:29,972][123091] Updated weights for policy 0, policy_version 1446273 (0.0008) [2023-12-26 11:08:29,996][123090] Updated weights for policy 1, policy_version 1436645 (0.0009) [2023-12-26 11:08:30,045][123091] Updated weights for policy 0, policy_version 1446283 (0.0005) [2023-12-26 11:08:30,056][123090] Updated weights for policy 1, policy_version 1436655 (0.0010) [2023-12-26 11:08:30,113][123090] Updated weights for policy 1, policy_version 1436665 (0.0011) [2023-12-26 11:08:30,878][123091] Updated weights for policy 0, policy_version 1446293 (0.0009) [2023-12-26 11:08:30,892][123090] Updated weights for policy 1, policy_version 1436675 (0.0009) [2023-12-26 11:08:30,936][123091] Updated weights for policy 0, policy_version 1446303 (0.0008) [2023-12-26 11:08:30,946][123090] Updated weights for policy 1, policy_version 1436685 (0.0006) [2023-12-26 11:08:31,000][123091] Updated weights for policy 0, policy_version 1446313 (0.0009) [2023-12-26 11:08:31,019][123090] Updated weights for policy 1, policy_version 1436695 (0.0006) [2023-12-26 11:08:31,828][123090] Updated weights for policy 1, policy_version 1436705 (0.0010) [2023-12-26 11:08:31,850][123091] Updated weights for policy 0, policy_version 1446323 (0.0008) [2023-12-26 11:08:31,894][123090] Updated weights for policy 1, policy_version 1436715 (0.0008) [2023-12-26 11:08:31,908][123091] Updated weights for policy 0, policy_version 1446333 (0.0007) [2023-12-26 11:08:31,960][123090] Updated weights for policy 1, policy_version 1436725 (0.0009) [2023-12-26 11:08:31,964][123091] Updated weights for policy 0, policy_version 1446343 (0.0008) [2023-12-26 11:08:32,023][123090] Updated weights for policy 1, policy_version 1436735 (0.0010) [2023-12-26 11:08:32,806][123091] Updated weights for policy 0, policy_version 1446353 (0.0009) [2023-12-26 11:08:32,841][123090] Updated weights for policy 1, policy_version 1436745 (0.0010) [2023-12-26 11:08:32,864][123091] Updated weights for policy 0, policy_version 1446363 (0.0010) [2023-12-26 11:08:32,896][123090] Updated weights for policy 1, policy_version 1436755 (0.0010) [2023-12-26 11:08:32,926][123091] Updated weights for policy 0, policy_version 1446373 (0.0011) [2023-12-26 11:08:32,955][123090] Updated weights for policy 1, policy_version 1436765 (0.0010) [2023-12-26 11:08:32,981][123091] Updated weights for policy 0, policy_version 1446383 (0.0010) [2023-12-26 11:08:33,691][123090] Updated weights for policy 1, policy_version 1436775 (0.0010) [2023-12-26 11:08:33,742][123090] Updated weights for policy 1, policy_version 1436785 (0.0009) [2023-12-26 11:08:33,774][123091] Updated weights for policy 0, policy_version 1446393 (0.0006) [2023-12-26 11:08:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 738091008. Throughput: 0: 8700.5, 1: 8961.2. Samples: 738109576. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:33,785][121949] Avg episode reward: [(0, '6233.689'), (1, '5385.789')] [2023-12-26 11:08:33,794][123090] Updated weights for policy 1, policy_version 1436795 (0.0009) [2023-12-26 11:08:33,821][123091] Updated weights for policy 0, policy_version 1446403 (0.0005) [2023-12-26 11:08:33,879][123091] Updated weights for policy 0, policy_version 1446413 (0.0006) [2023-12-26 11:08:34,524][123091] Updated weights for policy 0, policy_version 1446423 (0.0008) [2023-12-26 11:08:34,575][123091] Updated weights for policy 0, policy_version 1446433 (0.0008) [2023-12-26 11:08:34,629][123091] Updated weights for policy 0, policy_version 1446443 (0.0008) [2023-12-26 11:08:34,721][123090] Updated weights for policy 1, policy_version 1436805 (0.0009) [2023-12-26 11:08:34,785][123090] Updated weights for policy 1, policy_version 1436815 (0.0009) [2023-12-26 11:08:34,840][123090] Updated weights for policy 1, policy_version 1436825 (0.0008) [2023-12-26 11:08:35,450][123091] Updated weights for policy 0, policy_version 1446453 (0.0008) [2023-12-26 11:08:35,512][123091] Updated weights for policy 0, policy_version 1446463 (0.0011) [2023-12-26 11:08:35,584][123091] Updated weights for policy 0, policy_version 1446473 (0.0006) [2023-12-26 11:08:35,669][123090] Updated weights for policy 1, policy_version 1436835 (0.0009) [2023-12-26 11:08:35,719][123090] Updated weights for policy 1, policy_version 1436845 (0.0009) [2023-12-26 11:08:35,774][123090] Updated weights for policy 1, policy_version 1436855 (0.0005) [2023-12-26 11:08:36,357][123091] Updated weights for policy 0, policy_version 1446483 (0.0009) [2023-12-26 11:08:36,419][123091] Updated weights for policy 0, policy_version 1446493 (0.0005) [2023-12-26 11:08:36,485][123091] Updated weights for policy 0, policy_version 1446503 (0.0005) [2023-12-26 11:08:36,549][123090] Updated weights for policy 1, policy_version 1436865 (0.0005) [2023-12-26 11:08:36,613][123090] Updated weights for policy 1, policy_version 1436875 (0.0005) [2023-12-26 11:08:36,674][123090] Updated weights for policy 1, policy_version 1436885 (0.0006) [2023-12-26 11:08:36,738][123090] Updated weights for policy 1, policy_version 1436895 (0.0006) [2023-12-26 11:08:37,103][123091] Updated weights for policy 0, policy_version 1446513 (0.0006) [2023-12-26 11:08:37,172][123091] Updated weights for policy 0, policy_version 1446523 (0.0006) [2023-12-26 11:08:37,237][123091] Updated weights for policy 0, policy_version 1446533 (0.0010) [2023-12-26 11:08:37,291][123091] Updated weights for policy 0, policy_version 1446543 (0.0005) [2023-12-26 11:08:37,408][123090] Updated weights for policy 1, policy_version 1436905 (0.0006) [2023-12-26 11:08:37,473][123090] Updated weights for policy 1, policy_version 1436915 (0.0006) [2023-12-26 11:08:37,539][123090] Updated weights for policy 1, policy_version 1436925 (0.0010) [2023-12-26 11:08:37,956][123091] Updated weights for policy 0, policy_version 1446553 (0.0005) [2023-12-26 11:08:38,002][123091] Updated weights for policy 0, policy_version 1446563 (0.0005) [2023-12-26 11:08:38,065][123091] Updated weights for policy 0, policy_version 1446573 (0.0007) [2023-12-26 11:08:38,252][123090] Updated weights for policy 1, policy_version 1436935 (0.0010) [2023-12-26 11:08:38,303][123090] Updated weights for policy 1, policy_version 1436945 (0.0010) [2023-12-26 11:08:38,359][123090] Updated weights for policy 1, policy_version 1436955 (0.0009) [2023-12-26 11:08:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 738189312. Throughput: 0: 8759.3, 1: 8945.9. Samples: 738163796. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:38,785][121949] Avg episode reward: [(0, '6234.531'), (1, '5356.410')] [2023-12-26 11:08:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001446576_370327552.pth... [2023-12-26 11:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001436960_367861760.pth... [2023-12-26 11:08:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001445552_370065408.pth [2023-12-26 11:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001435936_367599616.pth [2023-12-26 11:08:38,848][123091] Updated weights for policy 0, policy_version 1446583 (0.0008) [2023-12-26 11:08:38,900][123091] Updated weights for policy 0, policy_version 1446593 (0.0009) [2023-12-26 11:08:38,951][123091] Updated weights for policy 0, policy_version 1446604 (0.0009) [2023-12-26 11:08:39,060][123090] Updated weights for policy 1, policy_version 1436965 (0.0008) [2023-12-26 11:08:39,128][123090] Updated weights for policy 1, policy_version 1436975 (0.0005) [2023-12-26 11:08:39,193][123090] Updated weights for policy 1, policy_version 1436985 (0.0007) [2023-12-26 11:08:39,768][123091] Updated weights for policy 0, policy_version 1446614 (0.0008) [2023-12-26 11:08:39,839][123091] Updated weights for policy 0, policy_version 1446624 (0.0010) [2023-12-26 11:08:39,908][123091] Updated weights for policy 0, policy_version 1446634 (0.0010) [2023-12-26 11:08:40,026][123090] Updated weights for policy 1, policy_version 1436995 (0.0010) [2023-12-26 11:08:40,095][123090] Updated weights for policy 1, policy_version 1437005 (0.0009) [2023-12-26 11:08:40,162][123090] Updated weights for policy 1, policy_version 1437015 (0.0010) [2023-12-26 11:08:40,724][123091] Updated weights for policy 0, policy_version 1446644 (0.0009) [2023-12-26 11:08:40,785][123091] Updated weights for policy 0, policy_version 1446654 (0.0010) [2023-12-26 11:08:40,857][123091] Updated weights for policy 0, policy_version 1446664 (0.0010) [2023-12-26 11:08:40,985][123090] Updated weights for policy 1, policy_version 1437025 (0.0009) [2023-12-26 11:08:41,060][123090] Updated weights for policy 1, policy_version 1437035 (0.0008) [2023-12-26 11:08:41,126][123090] Updated weights for policy 1, policy_version 1437045 (0.0009) [2023-12-26 11:08:41,193][123090] Updated weights for policy 1, policy_version 1437055 (0.0009) [2023-12-26 11:08:41,712][123091] Updated weights for policy 0, policy_version 1446674 (0.0010) [2023-12-26 11:08:41,776][123091] Updated weights for policy 0, policy_version 1446684 (0.0009) [2023-12-26 11:08:41,837][123091] Updated weights for policy 0, policy_version 1446694 (0.0009) [2023-12-26 11:08:41,890][123091] Updated weights for policy 0, policy_version 1446704 (0.0009) [2023-12-26 11:08:42,045][123090] Updated weights for policy 1, policy_version 1437065 (0.0010) [2023-12-26 11:08:42,102][123090] Updated weights for policy 1, policy_version 1437075 (0.0010) [2023-12-26 11:08:42,165][123090] Updated weights for policy 1, policy_version 1437085 (0.0010) [2023-12-26 11:08:42,738][123091] Updated weights for policy 0, policy_version 1446714 (0.0009) [2023-12-26 11:08:42,803][123091] Updated weights for policy 0, policy_version 1446724 (0.0008) [2023-12-26 11:08:42,871][123091] Updated weights for policy 0, policy_version 1446734 (0.0009) [2023-12-26 11:08:43,048][123090] Updated weights for policy 1, policy_version 1437095 (0.0011) [2023-12-26 11:08:43,111][123090] Updated weights for policy 1, policy_version 1437105 (0.0010) [2023-12-26 11:08:43,160][123090] Updated weights for policy 1, policy_version 1437115 (0.0011) [2023-12-26 11:08:43,749][123091] Updated weights for policy 0, policy_version 1446744 (0.0009) [2023-12-26 11:08:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 738271232. Throughput: 0: 8810.4, 1: 8878.7. Samples: 738270584. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:43,785][121949] Avg episode reward: [(0, '6106.821'), (1, '5313.357')] [2023-12-26 11:08:43,817][123091] Updated weights for policy 0, policy_version 1446754 (0.0009) [2023-12-26 11:08:43,880][123091] Updated weights for policy 0, policy_version 1446764 (0.0009) [2023-12-26 11:08:43,916][123090] Updated weights for policy 1, policy_version 1437125 (0.0011) [2023-12-26 11:08:43,984][123090] Updated weights for policy 1, policy_version 1437135 (0.0011) [2023-12-26 11:08:44,035][123090] Updated weights for policy 1, policy_version 1437145 (0.0010) [2023-12-26 11:08:44,723][123091] Updated weights for policy 0, policy_version 1446774 (0.0008) [2023-12-26 11:08:44,785][123091] Updated weights for policy 0, policy_version 1446784 (0.0010) [2023-12-26 11:08:44,787][123090] Updated weights for policy 1, policy_version 1437155 (0.0010) [2023-12-26 11:08:44,842][123091] Updated weights for policy 0, policy_version 1446794 (0.0009) [2023-12-26 11:08:44,855][123090] Updated weights for policy 1, policy_version 1437165 (0.0006) [2023-12-26 11:08:44,920][123090] Updated weights for policy 1, policy_version 1437175 (0.0011) [2023-12-26 11:08:45,664][123090] Updated weights for policy 1, policy_version 1437185 (0.0010) [2023-12-26 11:08:45,725][123090] Updated weights for policy 1, policy_version 1437195 (0.0007) [2023-12-26 11:08:45,757][123091] Updated weights for policy 0, policy_version 1446804 (0.0007) [2023-12-26 11:08:45,792][123090] Updated weights for policy 1, policy_version 1437205 (0.0011) [2023-12-26 11:08:45,821][123091] Updated weights for policy 0, policy_version 1446814 (0.0006) [2023-12-26 11:08:45,856][123090] Updated weights for policy 1, policy_version 1437215 (0.0011) [2023-12-26 11:08:45,881][123091] Updated weights for policy 0, policy_version 1446824 (0.0007) [2023-12-26 11:08:46,641][123090] Updated weights for policy 1, policy_version 1437225 (0.0007) [2023-12-26 11:08:46,709][123090] Updated weights for policy 1, policy_version 1437235 (0.0007) [2023-12-26 11:08:46,715][123091] Updated weights for policy 0, policy_version 1446834 (0.0009) [2023-12-26 11:08:46,771][123091] Updated weights for policy 0, policy_version 1446844 (0.0009) [2023-12-26 11:08:46,774][123090] Updated weights for policy 1, policy_version 1437245 (0.0008) [2023-12-26 11:08:46,827][123091] Updated weights for policy 0, policy_version 1446854 (0.0008) [2023-12-26 11:08:46,883][123091] Updated weights for policy 0, policy_version 1446864 (0.0009) [2023-12-26 11:08:47,527][123090] Updated weights for policy 1, policy_version 1437255 (0.0007) [2023-12-26 11:08:47,586][123090] Updated weights for policy 1, policy_version 1437265 (0.0005) [2023-12-26 11:08:47,643][123090] Updated weights for policy 1, policy_version 1437275 (0.0005) [2023-12-26 11:08:47,738][123091] Updated weights for policy 0, policy_version 1446874 (0.0009) [2023-12-26 11:08:47,796][123091] Updated weights for policy 0, policy_version 1446884 (0.0009) [2023-12-26 11:08:47,847][123091] Updated weights for policy 0, policy_version 1446894 (0.0008) [2023-12-26 11:08:48,392][123090] Updated weights for policy 1, policy_version 1437285 (0.0008) [2023-12-26 11:08:48,455][123090] Updated weights for policy 1, policy_version 1437295 (0.0006) [2023-12-26 11:08:48,525][123090] Updated weights for policy 1, policy_version 1437305 (0.0007) [2023-12-26 11:08:48,603][123091] Updated weights for policy 0, policy_version 1446904 (0.0009) [2023-12-26 11:08:48,675][123091] Updated weights for policy 0, policy_version 1446914 (0.0010) [2023-12-26 11:08:48,741][123091] Updated weights for policy 0, policy_version 1446924 (0.0010) [2023-12-26 11:08:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 738369536. Throughput: 0: 8750.8, 1: 8897.0. Samples: 738376044. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:48,784][121949] Avg episode reward: [(0, '6111.225'), (1, '5380.461')] [2023-12-26 11:08:49,305][123090] Updated weights for policy 1, policy_version 1437315 (0.0007) [2023-12-26 11:08:49,374][123090] Updated weights for policy 1, policy_version 1437325 (0.0010) [2023-12-26 11:08:49,424][123090] Updated weights for policy 1, policy_version 1437335 (0.0009) [2023-12-26 11:08:49,568][123091] Updated weights for policy 0, policy_version 1446934 (0.0008) [2023-12-26 11:08:49,629][123091] Updated weights for policy 0, policy_version 1446944 (0.0006) [2023-12-26 11:08:49,683][123091] Updated weights for policy 0, policy_version 1446954 (0.0005) [2023-12-26 11:08:50,267][123090] Updated weights for policy 1, policy_version 1437345 (0.0009) [2023-12-26 11:08:50,322][123090] Updated weights for policy 1, policy_version 1437355 (0.0010) [2023-12-26 11:08:50,380][123090] Updated weights for policy 1, policy_version 1437365 (0.0010) [2023-12-26 11:08:50,414][123091] Updated weights for policy 0, policy_version 1446964 (0.0006) [2023-12-26 11:08:50,431][123090] Updated weights for policy 1, policy_version 1437375 (0.0009) [2023-12-26 11:08:50,463][123091] Updated weights for policy 0, policy_version 1446974 (0.0005) [2023-12-26 11:08:50,507][123091] Updated weights for policy 0, policy_version 1446984 (0.0005) [2023-12-26 11:08:51,329][123090] Updated weights for policy 1, policy_version 1437385 (0.0009) [2023-12-26 11:08:51,337][123091] Updated weights for policy 0, policy_version 1446994 (0.0008) [2023-12-26 11:08:51,403][123090] Updated weights for policy 1, policy_version 1437395 (0.0009) [2023-12-26 11:08:51,406][123091] Updated weights for policy 0, policy_version 1447004 (0.0008) [2023-12-26 11:08:51,462][123091] Updated weights for policy 0, policy_version 1447014 (0.0007) [2023-12-26 11:08:51,463][123090] Updated weights for policy 1, policy_version 1437405 (0.0009) [2023-12-26 11:08:51,518][123091] Updated weights for policy 0, policy_version 1447024 (0.0008) [2023-12-26 11:08:52,226][123091] Updated weights for policy 0, policy_version 1447034 (0.0005) [2023-12-26 11:08:52,297][123091] Updated weights for policy 0, policy_version 1447044 (0.0008) [2023-12-26 11:08:52,348][123090] Updated weights for policy 1, policy_version 1437415 (0.0010) [2023-12-26 11:08:52,363][123091] Updated weights for policy 0, policy_version 1447054 (0.0007) [2023-12-26 11:08:52,423][123090] Updated weights for policy 1, policy_version 1437425 (0.0009) [2023-12-26 11:08:52,498][123090] Updated weights for policy 1, policy_version 1437435 (0.0009) [2023-12-26 11:08:53,065][123091] Updated weights for policy 0, policy_version 1447064 (0.0008) [2023-12-26 11:08:53,112][123091] Updated weights for policy 0, policy_version 1447074 (0.0009) [2023-12-26 11:08:53,159][123091] Updated weights for policy 0, policy_version 1447084 (0.0009) [2023-12-26 11:08:53,321][123090] Updated weights for policy 1, policy_version 1437445 (0.0009) [2023-12-26 11:08:53,374][123090] Updated weights for policy 1, policy_version 1437455 (0.0010) [2023-12-26 11:08:53,428][123090] Updated weights for policy 1, policy_version 1437465 (0.0009) [2023-12-26 11:08:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 738451456. Throughput: 0: 8797.8, 1: 8794.6. Samples: 738427432. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:53,785][121949] Avg episode reward: [(0, '6205.034'), (1, '5384.686')] [2023-12-26 11:08:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001447088_370458624.pth... [2023-12-26 11:08:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001437472_367992832.pth... [2023-12-26 11:08:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001446064_370196480.pth [2023-12-26 11:08:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001436416_367722496.pth [2023-12-26 11:08:53,892][123091] Updated weights for policy 0, policy_version 1447094 (0.0008) [2023-12-26 11:08:53,955][123091] Updated weights for policy 0, policy_version 1447104 (0.0011) [2023-12-26 11:08:54,003][123091] Updated weights for policy 0, policy_version 1447114 (0.0010) [2023-12-26 11:08:54,176][123090] Updated weights for policy 1, policy_version 1437475 (0.0009) [2023-12-26 11:08:54,239][123090] Updated weights for policy 1, policy_version 1437485 (0.0008) [2023-12-26 11:08:54,292][123090] Updated weights for policy 1, policy_version 1437495 (0.0009) [2023-12-26 11:08:54,763][123091] Updated weights for policy 0, policy_version 1447124 (0.0010) [2023-12-26 11:08:54,810][123091] Updated weights for policy 0, policy_version 1447134 (0.0010) [2023-12-26 11:08:54,864][123091] Updated weights for policy 0, policy_version 1447144 (0.0010) [2023-12-26 11:08:55,143][123090] Updated weights for policy 1, policy_version 1437505 (0.0009) [2023-12-26 11:08:55,203][123090] Updated weights for policy 1, policy_version 1437515 (0.0008) [2023-12-26 11:08:55,263][123090] Updated weights for policy 1, policy_version 1437525 (0.0009) [2023-12-26 11:08:55,323][123090] Updated weights for policy 1, policy_version 1437535 (0.0009) [2023-12-26 11:08:55,697][123091] Updated weights for policy 0, policy_version 1447154 (0.0010) [2023-12-26 11:08:55,755][123091] Updated weights for policy 0, policy_version 1447164 (0.0010) [2023-12-26 11:08:55,817][123091] Updated weights for policy 0, policy_version 1447174 (0.0010) [2023-12-26 11:08:55,879][123091] Updated weights for policy 0, policy_version 1447184 (0.0010) [2023-12-26 11:08:56,155][123090] Updated weights for policy 1, policy_version 1437545 (0.0006) [2023-12-26 11:08:56,227][123090] Updated weights for policy 1, policy_version 1437555 (0.0005) [2023-12-26 11:08:56,292][123090] Updated weights for policy 1, policy_version 1437565 (0.0006) [2023-12-26 11:08:56,661][123091] Updated weights for policy 0, policy_version 1447194 (0.0008) [2023-12-26 11:08:56,711][123091] Updated weights for policy 0, policy_version 1447204 (0.0008) [2023-12-26 11:08:56,764][123091] Updated weights for policy 0, policy_version 1447214 (0.0008) [2023-12-26 11:08:57,074][123090] Updated weights for policy 1, policy_version 1437575 (0.0009) [2023-12-26 11:08:57,142][123090] Updated weights for policy 1, policy_version 1437585 (0.0009) [2023-12-26 11:08:57,194][123090] Updated weights for policy 1, policy_version 1437595 (0.0010) [2023-12-26 11:08:57,471][123091] Updated weights for policy 0, policy_version 1447224 (0.0006) [2023-12-26 11:08:57,538][123091] Updated weights for policy 0, policy_version 1447234 (0.0008) [2023-12-26 11:08:57,592][123091] Updated weights for policy 0, policy_version 1447244 (0.0010) [2023-12-26 11:08:57,985][123090] Updated weights for policy 1, policy_version 1437605 (0.0008) [2023-12-26 11:08:58,057][123090] Updated weights for policy 1, policy_version 1437615 (0.0008) [2023-12-26 11:08:58,127][123090] Updated weights for policy 1, policy_version 1437625 (0.0011) [2023-12-26 11:08:58,380][123091] Updated weights for policy 0, policy_version 1447254 (0.0009) [2023-12-26 11:08:58,442][123091] Updated weights for policy 0, policy_version 1447264 (0.0009) [2023-12-26 11:08:58,513][123091] Updated weights for policy 0, policy_version 1447274 (0.0010) [2023-12-26 11:08:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 738541568. Throughput: 0: 8960.1, 1: 8765.7. Samples: 738535624. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:08:58,785][121949] Avg episode reward: [(0, '6304.427'), (1, '5690.065')] [2023-12-26 11:08:59,016][123090] Updated weights for policy 1, policy_version 1437635 (0.0011) [2023-12-26 11:08:59,076][123090] Updated weights for policy 1, policy_version 1437645 (0.0009) [2023-12-26 11:08:59,131][123090] Updated weights for policy 1, policy_version 1437655 (0.0010) [2023-12-26 11:08:59,375][123091] Updated weights for policy 0, policy_version 1447284 (0.0009) [2023-12-26 11:08:59,425][123091] Updated weights for policy 0, policy_version 1447294 (0.0005) [2023-12-26 11:08:59,490][123091] Updated weights for policy 0, policy_version 1447304 (0.0005) [2023-12-26 11:08:59,891][123090] Updated weights for policy 1, policy_version 1437665 (0.0009) [2023-12-26 11:08:59,958][123090] Updated weights for policy 1, policy_version 1437675 (0.0009) [2023-12-26 11:09:00,023][123090] Updated weights for policy 1, policy_version 1437685 (0.0009) [2023-12-26 11:09:00,083][123090] Updated weights for policy 1, policy_version 1437695 (0.0007) [2023-12-26 11:09:00,252][123091] Updated weights for policy 0, policy_version 1447314 (0.0008) [2023-12-26 11:09:00,306][123091] Updated weights for policy 0, policy_version 1447324 (0.0010) [2023-12-26 11:09:00,350][123091] Updated weights for policy 0, policy_version 1447334 (0.0010) [2023-12-26 11:09:00,398][123091] Updated weights for policy 0, policy_version 1447344 (0.0010) [2023-12-26 11:09:00,786][123090] Updated weights for policy 1, policy_version 1437705 (0.0006) [2023-12-26 11:09:00,848][123090] Updated weights for policy 1, policy_version 1437715 (0.0008) [2023-12-26 11:09:00,895][123090] Updated weights for policy 1, policy_version 1437725 (0.0009) [2023-12-26 11:09:01,266][123091] Updated weights for policy 0, policy_version 1447354 (0.0007) [2023-12-26 11:09:01,318][123091] Updated weights for policy 0, policy_version 1447364 (0.0010) [2023-12-26 11:09:01,391][123091] Updated weights for policy 0, policy_version 1447374 (0.0008) [2023-12-26 11:09:01,700][123090] Updated weights for policy 1, policy_version 1437735 (0.0008) [2023-12-26 11:09:01,767][123090] Updated weights for policy 1, policy_version 1437745 (0.0008) [2023-12-26 11:09:01,833][123090] Updated weights for policy 1, policy_version 1437755 (0.0008) [2023-12-26 11:09:02,147][123091] Updated weights for policy 0, policy_version 1447384 (0.0008) [2023-12-26 11:09:02,198][123091] Updated weights for policy 0, policy_version 1447394 (0.0008) [2023-12-26 11:09:02,267][123091] Updated weights for policy 0, policy_version 1447404 (0.0008) [2023-12-26 11:09:02,680][123090] Updated weights for policy 1, policy_version 1437765 (0.0009) [2023-12-26 11:09:02,750][123090] Updated weights for policy 1, policy_version 1437775 (0.0010) [2023-12-26 11:09:02,828][123090] Updated weights for policy 1, policy_version 1437785 (0.0009) [2023-12-26 11:09:02,977][123091] Updated weights for policy 0, policy_version 1447414 (0.0007) [2023-12-26 11:09:03,033][123091] Updated weights for policy 0, policy_version 1447424 (0.0005) [2023-12-26 11:09:03,081][123091] Updated weights for policy 0, policy_version 1447434 (0.0005) [2023-12-26 11:09:03,618][123090] Updated weights for policy 1, policy_version 1437795 (0.0009) [2023-12-26 11:09:03,670][123090] Updated weights for policy 1, policy_version 1437805 (0.0010) [2023-12-26 11:09:03,725][123090] Updated weights for policy 1, policy_version 1437815 (0.0009) [2023-12-26 11:09:03,780][123091] Updated weights for policy 0, policy_version 1447444 (0.0005) [2023-12-26 11:09:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 738631680. Throughput: 0: 8905.1, 1: 8832.9. Samples: 738642564. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:03,785][121949] Avg episode reward: [(0, '6344.400'), (1, '5754.927')] [2023-12-26 11:09:03,833][123091] Updated weights for policy 0, policy_version 1447454 (0.0005) [2023-12-26 11:09:03,896][123091] Updated weights for policy 0, policy_version 1447464 (0.0008) [2023-12-26 11:09:04,564][123091] Updated weights for policy 0, policy_version 1447474 (0.0008) [2023-12-26 11:09:04,579][123090] Updated weights for policy 1, policy_version 1437825 (0.0009) [2023-12-26 11:09:04,613][123091] Updated weights for policy 0, policy_version 1447484 (0.0006) [2023-12-26 11:09:04,639][123090] Updated weights for policy 1, policy_version 1437835 (0.0010) [2023-12-26 11:09:04,661][123091] Updated weights for policy 0, policy_version 1447494 (0.0006) [2023-12-26 11:09:04,687][123090] Updated weights for policy 1, policy_version 1437845 (0.0010) [2023-12-26 11:09:04,712][123091] Updated weights for policy 0, policy_version 1447504 (0.0005) [2023-12-26 11:09:04,731][123090] Updated weights for policy 1, policy_version 1437855 (0.0010) [2023-12-26 11:09:05,387][123091] Updated weights for policy 0, policy_version 1447514 (0.0005) [2023-12-26 11:09:05,432][123091] Updated weights for policy 0, policy_version 1447524 (0.0005) [2023-12-26 11:09:05,477][123091] Updated weights for policy 0, policy_version 1447534 (0.0005) [2023-12-26 11:09:05,510][123090] Updated weights for policy 1, policy_version 1437865 (0.0009) [2023-12-26 11:09:05,565][123090] Updated weights for policy 1, policy_version 1437877 (0.0011) [2023-12-26 11:09:05,620][123090] Updated weights for policy 1, policy_version 1437888 (0.0010) [2023-12-26 11:09:06,207][123091] Updated weights for policy 0, policy_version 1447544 (0.0009) [2023-12-26 11:09:06,277][123091] Updated weights for policy 0, policy_version 1447554 (0.0009) [2023-12-26 11:09:06,344][123091] Updated weights for policy 0, policy_version 1447564 (0.0010) [2023-12-26 11:09:06,532][123090] Updated weights for policy 1, policy_version 1437898 (0.0010) [2023-12-26 11:09:06,594][123090] Updated weights for policy 1, policy_version 1437908 (0.0009) [2023-12-26 11:09:06,645][123090] Updated weights for policy 1, policy_version 1437918 (0.0010) [2023-12-26 11:09:07,102][123091] Updated weights for policy 0, policy_version 1447574 (0.0009) [2023-12-26 11:09:07,173][123091] Updated weights for policy 0, policy_version 1447584 (0.0011) [2023-12-26 11:09:07,229][123091] Updated weights for policy 0, policy_version 1447594 (0.0011) [2023-12-26 11:09:07,543][123090] Updated weights for policy 1, policy_version 1437928 (0.0010) [2023-12-26 11:09:07,596][123090] Updated weights for policy 1, policy_version 1437938 (0.0009) [2023-12-26 11:09:07,651][123090] Updated weights for policy 1, policy_version 1437950 (0.0010) [2023-12-26 11:09:07,929][123091] Updated weights for policy 0, policy_version 1447604 (0.0009) [2023-12-26 11:09:07,980][123091] Updated weights for policy 0, policy_version 1447615 (0.0007) [2023-12-26 11:09:08,028][123091] Updated weights for policy 0, policy_version 1447625 (0.0008) [2023-12-26 11:09:08,558][123090] Updated weights for policy 1, policy_version 1437960 (0.0008) [2023-12-26 11:09:08,641][123090] Updated weights for policy 1, policy_version 1437970 (0.0009) [2023-12-26 11:09:08,702][123090] Updated weights for policy 1, policy_version 1437980 (0.0010) [2023-12-26 11:09:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 738721792. Throughput: 0: 8972.6, 1: 8861.2. Samples: 738698044. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:08,785][121949] Avg episode reward: [(0, '6369.206'), (1, '5631.123')] [2023-12-26 11:09:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001437984_368123904.pth... [2023-12-26 11:09:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001447632_370597888.pth... [2023-12-26 11:09:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001436960_367861760.pth [2023-12-26 11:09:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001446576_370327552.pth [2023-12-26 11:09:08,849][123091] Updated weights for policy 0, policy_version 1447635 (0.0009) [2023-12-26 11:09:08,904][123091] Updated weights for policy 0, policy_version 1447645 (0.0010) [2023-12-26 11:09:08,958][123091] Updated weights for policy 0, policy_version 1447655 (0.0009) [2023-12-26 11:09:09,486][123090] Updated weights for policy 1, policy_version 1437990 (0.0008) [2023-12-26 11:09:09,551][123090] Updated weights for policy 1, policy_version 1438000 (0.0006) [2023-12-26 11:09:09,617][123090] Updated weights for policy 1, policy_version 1438010 (0.0005) [2023-12-26 11:09:09,833][123091] Updated weights for policy 0, policy_version 1447665 (0.0009) [2023-12-26 11:09:09,903][123091] Updated weights for policy 0, policy_version 1447675 (0.0010) [2023-12-26 11:09:09,962][123091] Updated weights for policy 0, policy_version 1447685 (0.0009) [2023-12-26 11:09:10,041][123091] Updated weights for policy 0, policy_version 1447695 (0.0009) [2023-12-26 11:09:10,324][123090] Updated weights for policy 1, policy_version 1438020 (0.0006) [2023-12-26 11:09:10,397][123090] Updated weights for policy 1, policy_version 1438030 (0.0005) [2023-12-26 11:09:10,472][123090] Updated weights for policy 1, policy_version 1438040 (0.0006) [2023-12-26 11:09:10,917][123091] Updated weights for policy 0, policy_version 1447705 (0.0009) [2023-12-26 11:09:10,985][123091] Updated weights for policy 0, policy_version 1447715 (0.0010) [2023-12-26 11:09:11,063][123091] Updated weights for policy 0, policy_version 1447725 (0.0010) [2023-12-26 11:09:11,198][123090] Updated weights for policy 1, policy_version 1438050 (0.0006) [2023-12-26 11:09:11,268][123090] Updated weights for policy 1, policy_version 1438060 (0.0009) [2023-12-26 11:09:11,333][123090] Updated weights for policy 1, policy_version 1438070 (0.0011) [2023-12-26 11:09:11,408][123090] Updated weights for policy 1, policy_version 1438080 (0.0009) [2023-12-26 11:09:11,961][123091] Updated weights for policy 0, policy_version 1447735 (0.0009) [2023-12-26 11:09:12,030][123091] Updated weights for policy 0, policy_version 1447745 (0.0009) [2023-12-26 11:09:12,098][123091] Updated weights for policy 0, policy_version 1447755 (0.0010) [2023-12-26 11:09:12,241][123090] Updated weights for policy 1, policy_version 1438090 (0.0005) [2023-12-26 11:09:12,314][123090] Updated weights for policy 1, policy_version 1438100 (0.0009) [2023-12-26 11:09:12,386][123090] Updated weights for policy 1, policy_version 1438110 (0.0009) [2023-12-26 11:09:12,942][123091] Updated weights for policy 0, policy_version 1447765 (0.0010) [2023-12-26 11:09:12,996][123091] Updated weights for policy 0, policy_version 1447775 (0.0009) [2023-12-26 11:09:13,052][123091] Updated weights for policy 0, policy_version 1447785 (0.0009) [2023-12-26 11:09:13,189][123090] Updated weights for policy 1, policy_version 1438120 (0.0009) [2023-12-26 11:09:13,251][123090] Updated weights for policy 1, policy_version 1438130 (0.0010) [2023-12-26 11:09:13,312][123090] Updated weights for policy 1, policy_version 1438140 (0.0009) [2023-12-26 11:09:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 738803712. Throughput: 0: 8956.2, 1: 8751.0. Samples: 738800476. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:13,785][121949] Avg episode reward: [(0, '6316.567'), (1, '5696.877')] [2023-12-26 11:09:13,852][123091] Updated weights for policy 0, policy_version 1447795 (0.0009) [2023-12-26 11:09:13,928][123091] Updated weights for policy 0, policy_version 1447805 (0.0005) [2023-12-26 11:09:13,987][123091] Updated weights for policy 0, policy_version 1447815 (0.0006) [2023-12-26 11:09:14,122][123090] Updated weights for policy 1, policy_version 1438150 (0.0009) [2023-12-26 11:09:14,183][123090] Updated weights for policy 1, policy_version 1438160 (0.0010) [2023-12-26 11:09:14,247][123090] Updated weights for policy 1, policy_version 1438170 (0.0010) [2023-12-26 11:09:14,672][123091] Updated weights for policy 0, policy_version 1447825 (0.0007) [2023-12-26 11:09:14,727][123091] Updated weights for policy 0, policy_version 1447835 (0.0005) [2023-12-26 11:09:14,788][123091] Updated weights for policy 0, policy_version 1447845 (0.0007) [2023-12-26 11:09:14,859][123091] Updated weights for policy 0, policy_version 1447855 (0.0008) [2023-12-26 11:09:15,070][123090] Updated weights for policy 1, policy_version 1438180 (0.0010) [2023-12-26 11:09:15,126][123090] Updated weights for policy 1, policy_version 1438190 (0.0010) [2023-12-26 11:09:15,184][123090] Updated weights for policy 1, policy_version 1438200 (0.0010) [2023-12-26 11:09:15,655][123091] Updated weights for policy 0, policy_version 1447865 (0.0009) [2023-12-26 11:09:15,717][123091] Updated weights for policy 0, policy_version 1447875 (0.0010) [2023-12-26 11:09:15,783][123091] Updated weights for policy 0, policy_version 1447885 (0.0010) [2023-12-26 11:09:15,951][123090] Updated weights for policy 1, policy_version 1438210 (0.0009) [2023-12-26 11:09:16,002][123090] Updated weights for policy 1, policy_version 1438220 (0.0005) [2023-12-26 11:09:16,051][123090] Updated weights for policy 1, policy_version 1438230 (0.0005) [2023-12-26 11:09:16,108][123090] Updated weights for policy 1, policy_version 1438240 (0.0006) [2023-12-26 11:09:16,588][123091] Updated weights for policy 0, policy_version 1447895 (0.0009) [2023-12-26 11:09:16,637][123091] Updated weights for policy 0, policy_version 1447905 (0.0009) [2023-12-26 11:09:16,691][123091] Updated weights for policy 0, policy_version 1447915 (0.0009) [2023-12-26 11:09:16,843][123090] Updated weights for policy 1, policy_version 1438250 (0.0010) [2023-12-26 11:09:16,903][123090] Updated weights for policy 1, policy_version 1438260 (0.0009) [2023-12-26 11:09:16,952][123090] Updated weights for policy 1, policy_version 1438270 (0.0009) [2023-12-26 11:09:17,540][123091] Updated weights for policy 0, policy_version 1447925 (0.0010) [2023-12-26 11:09:17,590][123091] Updated weights for policy 0, policy_version 1447935 (0.0009) [2023-12-26 11:09:17,654][123091] Updated weights for policy 0, policy_version 1447945 (0.0009) [2023-12-26 11:09:17,756][123090] Updated weights for policy 1, policy_version 1438280 (0.0006) [2023-12-26 11:09:17,822][123090] Updated weights for policy 1, policy_version 1438290 (0.0008) [2023-12-26 11:09:17,888][123090] Updated weights for policy 1, policy_version 1438300 (0.0010) [2023-12-26 11:09:18,413][123091] Updated weights for policy 0, policy_version 1447955 (0.0009) [2023-12-26 11:09:18,486][123091] Updated weights for policy 0, policy_version 1447965 (0.0009) [2023-12-26 11:09:18,541][123091] Updated weights for policy 0, policy_version 1447975 (0.0009) [2023-12-26 11:09:18,627][123090] Updated weights for policy 1, policy_version 1438310 (0.0007) [2023-12-26 11:09:18,698][123090] Updated weights for policy 1, policy_version 1438320 (0.0005) [2023-12-26 11:09:18,752][123090] Updated weights for policy 1, policy_version 1438330 (0.0005) [2023-12-26 11:09:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 738902016. Throughput: 0: 8984.1, 1: 8750.5. Samples: 738907632. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:18,785][121949] Avg episode reward: [(0, '6318.219'), (1, '5678.280')] [2023-12-26 11:09:19,356][123091] Updated weights for policy 0, policy_version 1447985 (0.0008) [2023-12-26 11:09:19,421][123091] Updated weights for policy 0, policy_version 1447995 (0.0010) [2023-12-26 11:09:19,489][123091] Updated weights for policy 0, policy_version 1448005 (0.0009) [2023-12-26 11:09:19,499][123090] Updated weights for policy 1, policy_version 1438340 (0.0007) [2023-12-26 11:09:19,559][123091] Updated weights for policy 0, policy_version 1448015 (0.0010) [2023-12-26 11:09:19,559][123090] Updated weights for policy 1, policy_version 1438350 (0.0006) [2023-12-26 11:09:19,608][123090] Updated weights for policy 1, policy_version 1438360 (0.0009) [2023-12-26 11:09:20,403][123091] Updated weights for policy 0, policy_version 1448025 (0.0009) [2023-12-26 11:09:20,438][123090] Updated weights for policy 1, policy_version 1438370 (0.0008) [2023-12-26 11:09:20,475][123091] Updated weights for policy 0, policy_version 1448035 (0.0009) [2023-12-26 11:09:20,500][123090] Updated weights for policy 1, policy_version 1438380 (0.0005) [2023-12-26 11:09:20,534][123091] Updated weights for policy 0, policy_version 1448045 (0.0008) [2023-12-26 11:09:20,550][123090] Updated weights for policy 1, policy_version 1438390 (0.0008) [2023-12-26 11:09:20,623][123090] Updated weights for policy 1, policy_version 1438400 (0.0008) [2023-12-26 11:09:21,343][123091] Updated weights for policy 0, policy_version 1448055 (0.0007) [2023-12-26 11:09:21,400][123090] Updated weights for policy 1, policy_version 1438410 (0.0009) [2023-12-26 11:09:21,415][123091] Updated weights for policy 0, policy_version 1448065 (0.0008) [2023-12-26 11:09:21,465][123090] Updated weights for policy 1, policy_version 1438420 (0.0009) [2023-12-26 11:09:21,479][123091] Updated weights for policy 0, policy_version 1448075 (0.0009) [2023-12-26 11:09:21,526][123090] Updated weights for policy 1, policy_version 1438430 (0.0007) [2023-12-26 11:09:22,272][123090] Updated weights for policy 1, policy_version 1438440 (0.0008) [2023-12-26 11:09:22,316][123091] Updated weights for policy 0, policy_version 1448085 (0.0010) [2023-12-26 11:09:22,344][123090] Updated weights for policy 1, policy_version 1438450 (0.0009) [2023-12-26 11:09:22,382][123091] Updated weights for policy 0, policy_version 1448095 (0.0008) [2023-12-26 11:09:22,414][123090] Updated weights for policy 1, policy_version 1438460 (0.0007) [2023-12-26 11:09:22,446][123091] Updated weights for policy 0, policy_version 1448105 (0.0006) [2023-12-26 11:09:23,151][123090] Updated weights for policy 1, policy_version 1438470 (0.0008) [2023-12-26 11:09:23,202][123090] Updated weights for policy 1, policy_version 1438480 (0.0009) [2023-12-26 11:09:23,212][123091] Updated weights for policy 0, policy_version 1448115 (0.0006) [2023-12-26 11:09:23,257][123090] Updated weights for policy 1, policy_version 1438490 (0.0006) [2023-12-26 11:09:23,281][123091] Updated weights for policy 0, policy_version 1448125 (0.0009) [2023-12-26 11:09:23,332][123091] Updated weights for policy 0, policy_version 1448135 (0.0005) [2023-12-26 11:09:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 738983936. Throughput: 0: 8915.7, 1: 8759.6. Samples: 738959188. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:23,785][121949] Avg episode reward: [(0, '6255.386'), (1, '5694.051')] [2023-12-26 11:09:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001448144_370728960.pth... [2023-12-26 11:09:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001438496_368254976.pth... [2023-12-26 11:09:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001447088_370458624.pth [2023-12-26 11:09:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001437472_367992832.pth [2023-12-26 11:09:24,020][123090] Updated weights for policy 1, policy_version 1438500 (0.0005) [2023-12-26 11:09:24,089][123090] Updated weights for policy 1, policy_version 1438510 (0.0005) [2023-12-26 11:09:24,110][123091] Updated weights for policy 0, policy_version 1448145 (0.0008) [2023-12-26 11:09:24,143][123090] Updated weights for policy 1, policy_version 1438520 (0.0006) [2023-12-26 11:09:24,172][123091] Updated weights for policy 0, policy_version 1448155 (0.0009) [2023-12-26 11:09:24,238][123091] Updated weights for policy 0, policy_version 1448165 (0.0010) [2023-12-26 11:09:24,303][123091] Updated weights for policy 0, policy_version 1448175 (0.0010) [2023-12-26 11:09:24,900][123090] Updated weights for policy 1, policy_version 1438530 (0.0006) [2023-12-26 11:09:24,961][123090] Updated weights for policy 1, policy_version 1438540 (0.0010) [2023-12-26 11:09:25,021][123090] Updated weights for policy 1, policy_version 1438550 (0.0010) [2023-12-26 11:09:25,083][123090] Updated weights for policy 1, policy_version 1438560 (0.0010) [2023-12-26 11:09:25,131][123091] Updated weights for policy 0, policy_version 1448185 (0.0008) [2023-12-26 11:09:25,182][123091] Updated weights for policy 0, policy_version 1448195 (0.0008) [2023-12-26 11:09:25,233][123091] Updated weights for policy 0, policy_version 1448205 (0.0009) [2023-12-26 11:09:25,810][123090] Updated weights for policy 1, policy_version 1438570 (0.0009) [2023-12-26 11:09:25,862][123090] Updated weights for policy 1, policy_version 1438580 (0.0005) [2023-12-26 11:09:25,908][123090] Updated weights for policy 1, policy_version 1438590 (0.0005) [2023-12-26 11:09:26,139][123091] Updated weights for policy 0, policy_version 1448215 (0.0010) [2023-12-26 11:09:26,201][123091] Updated weights for policy 0, policy_version 1448225 (0.0009) [2023-12-26 11:09:26,259][123091] Updated weights for policy 0, policy_version 1448235 (0.0009) [2023-12-26 11:09:26,538][123090] Updated weights for policy 1, policy_version 1438600 (0.0005) [2023-12-26 11:09:26,608][123090] Updated weights for policy 1, policy_version 1438610 (0.0005) [2023-12-26 11:09:26,671][123090] Updated weights for policy 1, policy_version 1438620 (0.0005) [2023-12-26 11:09:27,151][123091] Updated weights for policy 0, policy_version 1448245 (0.0009) [2023-12-26 11:09:27,202][123091] Updated weights for policy 0, policy_version 1448255 (0.0009) [2023-12-26 11:09:27,253][123091] Updated weights for policy 0, policy_version 1448265 (0.0009) [2023-12-26 11:09:27,371][123090] Updated weights for policy 1, policy_version 1438630 (0.0009) [2023-12-26 11:09:27,419][123090] Updated weights for policy 1, policy_version 1438640 (0.0010) [2023-12-26 11:09:27,465][123090] Updated weights for policy 1, policy_version 1438650 (0.0010) [2023-12-26 11:09:28,054][123091] Updated weights for policy 0, policy_version 1448275 (0.0008) [2023-12-26 11:09:28,120][123091] Updated weights for policy 0, policy_version 1448285 (0.0008) [2023-12-26 11:09:28,189][123091] Updated weights for policy 0, policy_version 1448295 (0.0009) [2023-12-26 11:09:28,310][123090] Updated weights for policy 1, policy_version 1438660 (0.0010) [2023-12-26 11:09:28,374][123090] Updated weights for policy 1, policy_version 1438670 (0.0011) [2023-12-26 11:09:28,432][123090] Updated weights for policy 1, policy_version 1438680 (0.0009) [2023-12-26 11:09:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 739074048. Throughput: 0: 8860.9, 1: 8861.7. Samples: 739068100. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:28,784][121949] Avg episode reward: [(0, '6159.946'), (1, '5711.703')] [2023-12-26 11:09:29,024][123091] Updated weights for policy 0, policy_version 1448305 (0.0006) [2023-12-26 11:09:29,086][123091] Updated weights for policy 0, policy_version 1448315 (0.0008) [2023-12-26 11:09:29,144][123091] Updated weights for policy 0, policy_version 1448325 (0.0008) [2023-12-26 11:09:29,147][123090] Updated weights for policy 1, policy_version 1438690 (0.0009) [2023-12-26 11:09:29,194][123091] Updated weights for policy 0, policy_version 1448335 (0.0008) [2023-12-26 11:09:29,198][123090] Updated weights for policy 1, policy_version 1438700 (0.0005) [2023-12-26 11:09:29,267][123090] Updated weights for policy 1, policy_version 1438710 (0.0007) [2023-12-26 11:09:29,344][123090] Updated weights for policy 1, policy_version 1438720 (0.0007) [2023-12-26 11:09:30,067][123091] Updated weights for policy 0, policy_version 1448345 (0.0009) [2023-12-26 11:09:30,079][123090] Updated weights for policy 1, policy_version 1438730 (0.0008) [2023-12-26 11:09:30,116][123091] Updated weights for policy 0, policy_version 1448355 (0.0010) [2023-12-26 11:09:30,131][123090] Updated weights for policy 1, policy_version 1438740 (0.0010) [2023-12-26 11:09:30,165][123091] Updated weights for policy 0, policy_version 1448365 (0.0007) [2023-12-26 11:09:30,187][123090] Updated weights for policy 1, policy_version 1438750 (0.0008) [2023-12-26 11:09:30,878][123090] Updated weights for policy 1, policy_version 1438760 (0.0009) [2023-12-26 11:09:30,939][123090] Updated weights for policy 1, policy_version 1438770 (0.0010) [2023-12-26 11:09:30,994][123090] Updated weights for policy 1, policy_version 1438780 (0.0010) [2023-12-26 11:09:31,044][123091] Updated weights for policy 0, policy_version 1448375 (0.0008) [2023-12-26 11:09:31,099][123091] Updated weights for policy 0, policy_version 1448385 (0.0009) [2023-12-26 11:09:31,168][123091] Updated weights for policy 0, policy_version 1448395 (0.0009) [2023-12-26 11:09:31,832][123090] Updated weights for policy 1, policy_version 1438790 (0.0009) [2023-12-26 11:09:31,896][123090] Updated weights for policy 1, policy_version 1438800 (0.0009) [2023-12-26 11:09:31,960][123090] Updated weights for policy 1, policy_version 1438810 (0.0009) [2023-12-26 11:09:31,995][123091] Updated weights for policy 0, policy_version 1448405 (0.0008) [2023-12-26 11:09:32,050][123091] Updated weights for policy 0, policy_version 1448415 (0.0005) [2023-12-26 11:09:32,114][123091] Updated weights for policy 0, policy_version 1448425 (0.0007) [2023-12-26 11:09:32,722][123090] Updated weights for policy 1, policy_version 1438820 (0.0006) [2023-12-26 11:09:32,789][123090] Updated weights for policy 1, policy_version 1438830 (0.0007) [2023-12-26 11:09:32,796][123091] Updated weights for policy 0, policy_version 1448435 (0.0008) [2023-12-26 11:09:32,850][123090] Updated weights for policy 1, policy_version 1438840 (0.0009) [2023-12-26 11:09:32,856][123091] Updated weights for policy 0, policy_version 1448445 (0.0010) [2023-12-26 11:09:32,904][123091] Updated weights for policy 0, policy_version 1448455 (0.0006) [2023-12-26 11:09:33,602][123090] Updated weights for policy 1, policy_version 1438850 (0.0008) [2023-12-26 11:09:33,667][123090] Updated weights for policy 1, policy_version 1438860 (0.0006) [2023-12-26 11:09:33,680][123091] Updated weights for policy 0, policy_version 1448465 (0.0009) [2023-12-26 11:09:33,728][123090] Updated weights for policy 1, policy_version 1438870 (0.0005) [2023-12-26 11:09:33,739][123091] Updated weights for policy 0, policy_version 1448475 (0.0011) [2023-12-26 11:09:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 739164160. Throughput: 0: 8906.8, 1: 8858.9. Samples: 739175500. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 11:09:33,784][123090] Updated weights for policy 1, policy_version 1438880 (0.0005) [2023-12-26 11:09:33,784][121949] Avg episode reward: [(0, '6144.325'), (1, '5479.995')] [2023-12-26 11:09:33,791][123091] Updated weights for policy 0, policy_version 1448485 (0.0010) [2023-12-26 11:09:33,842][123091] Updated weights for policy 0, policy_version 1448495 (0.0010) [2023-12-26 11:09:34,553][123090] Updated weights for policy 1, policy_version 1438890 (0.0010) [2023-12-26 11:09:34,620][123090] Updated weights for policy 1, policy_version 1438900 (0.0011) [2023-12-26 11:09:34,689][123090] Updated weights for policy 1, policy_version 1438910 (0.0007) [2023-12-26 11:09:34,704][123091] Updated weights for policy 0, policy_version 1448505 (0.0007) [2023-12-26 11:09:34,775][123091] Updated weights for policy 0, policy_version 1448515 (0.0011) [2023-12-26 11:09:34,834][123091] Updated weights for policy 0, policy_version 1448525 (0.0010) [2023-12-26 11:09:35,474][123090] Updated weights for policy 1, policy_version 1438920 (0.0006) [2023-12-26 11:09:35,523][123090] Updated weights for policy 1, policy_version 1438930 (0.0005) [2023-12-26 11:09:35,574][123090] Updated weights for policy 1, policy_version 1438940 (0.0005) [2023-12-26 11:09:35,630][123091] Updated weights for policy 0, policy_version 1448535 (0.0010) [2023-12-26 11:09:35,682][123091] Updated weights for policy 0, policy_version 1448545 (0.0010) [2023-12-26 11:09:35,743][123091] Updated weights for policy 0, policy_version 1448555 (0.0010) [2023-12-26 11:09:36,297][123090] Updated weights for policy 1, policy_version 1438950 (0.0007) [2023-12-26 11:09:36,353][123090] Updated weights for policy 1, policy_version 1438960 (0.0008) [2023-12-26 11:09:36,409][123090] Updated weights for policy 1, policy_version 1438970 (0.0008) [2023-12-26 11:09:36,586][123091] Updated weights for policy 0, policy_version 1448565 (0.0011) [2023-12-26 11:09:36,650][123091] Updated weights for policy 0, policy_version 1448575 (0.0011) [2023-12-26 11:09:36,714][123091] Updated weights for policy 0, policy_version 1448585 (0.0011) [2023-12-26 11:09:37,139][123090] Updated weights for policy 1, policy_version 1438980 (0.0008) [2023-12-26 11:09:37,203][123090] Updated weights for policy 1, policy_version 1438990 (0.0008) [2023-12-26 11:09:37,266][123090] Updated weights for policy 1, policy_version 1439000 (0.0005) [2023-12-26 11:09:37,535][123091] Updated weights for policy 0, policy_version 1448595 (0.0011) [2023-12-26 11:09:37,601][123091] Updated weights for policy 0, policy_version 1448605 (0.0010) [2023-12-26 11:09:37,664][123091] Updated weights for policy 0, policy_version 1448615 (0.0011) [2023-12-26 11:09:38,016][123090] Updated weights for policy 1, policy_version 1439010 (0.0006) [2023-12-26 11:09:38,087][123090] Updated weights for policy 1, policy_version 1439020 (0.0009) [2023-12-26 11:09:38,153][123090] Updated weights for policy 1, policy_version 1439030 (0.0010) [2023-12-26 11:09:38,216][123090] Updated weights for policy 1, policy_version 1439040 (0.0008) [2023-12-26 11:09:38,483][123091] Updated weights for policy 0, policy_version 1448625 (0.0010) [2023-12-26 11:09:38,541][123091] Updated weights for policy 0, policy_version 1448635 (0.0005) [2023-12-26 11:09:38,606][123091] Updated weights for policy 0, policy_version 1448645 (0.0010) [2023-12-26 11:09:38,670][123091] Updated weights for policy 0, policy_version 1448655 (0.0011) [2023-12-26 11:09:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 739254272. Throughput: 0: 8887.6, 1: 8919.7. Samples: 739228764. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:09:38,785][121949] Avg episode reward: [(0, '6346.864'), (1, '5424.104')] [2023-12-26 11:09:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001448656_370860032.pth... [2023-12-26 11:09:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001439040_368394240.pth... [2023-12-26 11:09:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001447632_370597888.pth [2023-12-26 11:09:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001437984_368123904.pth [2023-12-26 11:09:38,990][123090] Updated weights for policy 1, policy_version 1439050 (0.0007) [2023-12-26 11:09:39,054][123090] Updated weights for policy 1, policy_version 1439060 (0.0009) [2023-12-26 11:09:39,122][123090] Updated weights for policy 1, policy_version 1439070 (0.0009) [2023-12-26 11:09:39,500][123091] Updated weights for policy 0, policy_version 1448665 (0.0009) [2023-12-26 11:09:39,570][123091] Updated weights for policy 0, policy_version 1448675 (0.0006) [2023-12-26 11:09:39,638][123091] Updated weights for policy 0, policy_version 1448686 (0.0010) [2023-12-26 11:09:39,939][123090] Updated weights for policy 1, policy_version 1439080 (0.0007) [2023-12-26 11:09:40,006][123090] Updated weights for policy 1, policy_version 1439090 (0.0008) [2023-12-26 11:09:40,072][123090] Updated weights for policy 1, policy_version 1439100 (0.0009) [2023-12-26 11:09:40,469][123091] Updated weights for policy 0, policy_version 1448696 (0.0008) [2023-12-26 11:09:40,531][123091] Updated weights for policy 0, policy_version 1448706 (0.0008) [2023-12-26 11:09:40,594][123091] Updated weights for policy 0, policy_version 1448716 (0.0008) [2023-12-26 11:09:40,923][123090] Updated weights for policy 1, policy_version 1439112 (0.0010) [2023-12-26 11:09:40,986][123090] Updated weights for policy 1, policy_version 1439122 (0.0009) [2023-12-26 11:09:41,042][123090] Updated weights for policy 1, policy_version 1439132 (0.0010) [2023-12-26 11:09:41,414][123091] Updated weights for policy 0, policy_version 1448726 (0.0010) [2023-12-26 11:09:41,477][123091] Updated weights for policy 0, policy_version 1448736 (0.0009) [2023-12-26 11:09:41,532][123091] Updated weights for policy 0, policy_version 1448746 (0.0009) [2023-12-26 11:09:41,867][123090] Updated weights for policy 1, policy_version 1439142 (0.0010) [2023-12-26 11:09:41,931][123090] Updated weights for policy 1, policy_version 1439152 (0.0009) [2023-12-26 11:09:41,995][123090] Updated weights for policy 1, policy_version 1439162 (0.0010) [2023-12-26 11:09:42,390][123091] Updated weights for policy 0, policy_version 1448756 (0.0009) [2023-12-26 11:09:42,451][123091] Updated weights for policy 0, policy_version 1448766 (0.0009) [2023-12-26 11:09:42,518][123091] Updated weights for policy 0, policy_version 1448776 (0.0009) [2023-12-26 11:09:42,851][123090] Updated weights for policy 1, policy_version 1439172 (0.0010) [2023-12-26 11:09:42,909][123090] Updated weights for policy 1, policy_version 1439182 (0.0009) [2023-12-26 11:09:42,969][123090] Updated weights for policy 1, policy_version 1439192 (0.0009) [2023-12-26 11:09:43,362][123091] Updated weights for policy 0, policy_version 1448786 (0.0009) [2023-12-26 11:09:43,419][123091] Updated weights for policy 0, policy_version 1448796 (0.0009) [2023-12-26 11:09:43,468][123091] Updated weights for policy 0, policy_version 1448806 (0.0009) [2023-12-26 11:09:43,540][123091] Updated weights for policy 0, policy_version 1448816 (0.0009) [2023-12-26 11:09:43,779][123090] Updated weights for policy 1, policy_version 1439202 (0.0009) [2023-12-26 11:09:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 739336192. Throughput: 0: 8747.7, 1: 8943.2. Samples: 739331716. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:09:43,785][121949] Avg episode reward: [(0, '6305.869'), (1, '5599.935')] [2023-12-26 11:09:43,848][123090] Updated weights for policy 1, policy_version 1439212 (0.0009) [2023-12-26 11:09:43,906][123090] Updated weights for policy 1, policy_version 1439222 (0.0010) [2023-12-26 11:09:43,966][123090] Updated weights for policy 1, policy_version 1439232 (0.0009) [2023-12-26 11:09:44,384][123091] Updated weights for policy 0, policy_version 1448826 (0.0010) [2023-12-26 11:09:44,439][123091] Updated weights for policy 0, policy_version 1448837 (0.0010) [2023-12-26 11:09:44,493][123091] Updated weights for policy 0, policy_version 1448847 (0.0010) [2023-12-26 11:09:44,692][123090] Updated weights for policy 1, policy_version 1439242 (0.0005) [2023-12-26 11:09:44,736][123090] Updated weights for policy 1, policy_version 1439252 (0.0005) [2023-12-26 11:09:44,800][123090] Updated weights for policy 1, policy_version 1439262 (0.0009) [2023-12-26 11:09:45,355][123091] Updated weights for policy 0, policy_version 1448857 (0.0010) [2023-12-26 11:09:45,420][123091] Updated weights for policy 0, policy_version 1448867 (0.0010) [2023-12-26 11:09:45,490][123091] Updated weights for policy 0, policy_version 1448877 (0.0010) [2023-12-26 11:09:45,617][123090] Updated weights for policy 1, policy_version 1439272 (0.0010) [2023-12-26 11:09:45,676][123090] Updated weights for policy 1, policy_version 1439282 (0.0009) [2023-12-26 11:09:45,742][123090] Updated weights for policy 1, policy_version 1439292 (0.0009) [2023-12-26 11:09:46,309][123091] Updated weights for policy 0, policy_version 1448887 (0.0009) [2023-12-26 11:09:46,373][123091] Updated weights for policy 0, policy_version 1448897 (0.0010) [2023-12-26 11:09:46,433][123091] Updated weights for policy 0, policy_version 1448907 (0.0010) [2023-12-26 11:09:46,501][123090] Updated weights for policy 1, policy_version 1439302 (0.0008) [2023-12-26 11:09:46,570][123090] Updated weights for policy 1, policy_version 1439312 (0.0009) [2023-12-26 11:09:46,634][123090] Updated weights for policy 1, policy_version 1439322 (0.0009) [2023-12-26 11:09:47,251][123091] Updated weights for policy 0, policy_version 1448917 (0.0010) [2023-12-26 11:09:47,303][123091] Updated weights for policy 0, policy_version 1448927 (0.0009) [2023-12-26 11:09:47,362][123091] Updated weights for policy 0, policy_version 1448937 (0.0009) [2023-12-26 11:09:47,469][123090] Updated weights for policy 1, policy_version 1439332 (0.0007) [2023-12-26 11:09:47,528][123090] Updated weights for policy 1, policy_version 1439342 (0.0006) [2023-12-26 11:09:47,574][123090] Updated weights for policy 1, policy_version 1439352 (0.0005) [2023-12-26 11:09:48,204][123091] Updated weights for policy 0, policy_version 1448947 (0.0009) [2023-12-26 11:09:48,267][123091] Updated weights for policy 0, policy_version 1448957 (0.0009) [2023-12-26 11:09:48,279][123090] Updated weights for policy 1, policy_version 1439362 (0.0006) [2023-12-26 11:09:48,328][123091] Updated weights for policy 0, policy_version 1448967 (0.0006) [2023-12-26 11:09:48,343][123090] Updated weights for policy 1, policy_version 1439372 (0.0011) [2023-12-26 11:09:48,407][123090] Updated weights for policy 1, policy_version 1439382 (0.0011) [2023-12-26 11:09:48,471][123090] Updated weights for policy 1, policy_version 1439392 (0.0011) [2023-12-26 11:09:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 739426304. Throughput: 0: 8677.1, 1: 8941.3. Samples: 739435392. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:09:48,785][121949] Avg episode reward: [(0, '6043.898'), (1, '5745.518')] [2023-12-26 11:09:49,135][123091] Updated weights for policy 0, policy_version 1448977 (0.0008) [2023-12-26 11:09:49,187][123091] Updated weights for policy 0, policy_version 1448987 (0.0009) [2023-12-26 11:09:49,248][123091] Updated weights for policy 0, policy_version 1448997 (0.0010) [2023-12-26 11:09:49,309][123090] Updated weights for policy 1, policy_version 1439402 (0.0008) [2023-12-26 11:09:49,310][123091] Updated weights for policy 0, policy_version 1449007 (0.0006) [2023-12-26 11:09:49,382][123090] Updated weights for policy 1, policy_version 1439412 (0.0008) [2023-12-26 11:09:49,446][123090] Updated weights for policy 1, policy_version 1439422 (0.0009) [2023-12-26 11:09:50,109][123091] Updated weights for policy 0, policy_version 1449017 (0.0010) [2023-12-26 11:09:50,153][123091] Updated weights for policy 0, policy_version 1449027 (0.0010) [2023-12-26 11:09:50,217][123091] Updated weights for policy 0, policy_version 1449037 (0.0011) [2023-12-26 11:09:50,312][123090] Updated weights for policy 1, policy_version 1439432 (0.0006) [2023-12-26 11:09:50,386][123090] Updated weights for policy 1, policy_version 1439442 (0.0007) [2023-12-26 11:09:50,466][123090] Updated weights for policy 1, policy_version 1439452 (0.0006) [2023-12-26 11:09:51,011][123091] Updated weights for policy 0, policy_version 1449047 (0.0010) [2023-12-26 11:09:51,083][123091] Updated weights for policy 0, policy_version 1449057 (0.0010) [2023-12-26 11:09:51,156][123091] Updated weights for policy 0, policy_version 1449067 (0.0010) [2023-12-26 11:09:51,226][123090] Updated weights for policy 1, policy_version 1439462 (0.0007) [2023-12-26 11:09:51,294][123090] Updated weights for policy 1, policy_version 1439472 (0.0008) [2023-12-26 11:09:51,365][123090] Updated weights for policy 1, policy_version 1439482 (0.0009) [2023-12-26 11:09:51,981][123091] Updated weights for policy 0, policy_version 1449077 (0.0008) [2023-12-26 11:09:52,056][123091] Updated weights for policy 0, policy_version 1449087 (0.0008) [2023-12-26 11:09:52,127][123091] Updated weights for policy 0, policy_version 1449097 (0.0010) [2023-12-26 11:09:52,149][123090] Updated weights for policy 1, policy_version 1439492 (0.0008) [2023-12-26 11:09:52,212][123090] Updated weights for policy 1, policy_version 1439502 (0.0010) [2023-12-26 11:09:52,279][123090] Updated weights for policy 1, policy_version 1439512 (0.0010) [2023-12-26 11:09:52,971][123091] Updated weights for policy 0, policy_version 1449107 (0.0010) [2023-12-26 11:09:53,023][123091] Updated weights for policy 0, policy_version 1449117 (0.0010) [2023-12-26 11:09:53,029][123090] Updated weights for policy 1, policy_version 1439522 (0.0008) [2023-12-26 11:09:53,079][123091] Updated weights for policy 0, policy_version 1449127 (0.0011) [2023-12-26 11:09:53,095][123090] Updated weights for policy 1, policy_version 1439532 (0.0006) [2023-12-26 11:09:53,162][123090] Updated weights for policy 1, policy_version 1439542 (0.0005) [2023-12-26 11:09:53,214][123090] Updated weights for policy 1, policy_version 1439552 (0.0005) [2023-12-26 11:09:53,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 739508224. Throughput: 0: 8596.4, 1: 8952.1. Samples: 739487728. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:09:53,785][121949] Avg episode reward: [(0, '6018.904'), (1, '5894.869')] [2023-12-26 11:09:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001449136_370982912.pth... [2023-12-26 11:09:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001448144_370728960.pth [2023-12-26 11:09:53,808][123090] Updated weights for policy 1, policy_version 1439562 (0.0005) [2023-12-26 11:09:53,821][123091] Updated weights for policy 0, policy_version 1449137 (0.0010) [2023-12-26 11:09:53,868][123090] Updated weights for policy 1, policy_version 1439572 (0.0006) [2023-12-26 11:09:53,876][123091] Updated weights for policy 0, policy_version 1449147 (0.0008) [2023-12-26 11:09:53,921][123090] Updated weights for policy 1, policy_version 1439582 (0.0009) [2023-12-26 11:09:53,930][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001439584_368533504.pth... [2023-12-26 11:09:53,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001438496_368254976.pth [2023-12-26 11:09:53,944][123091] Updated weights for policy 0, policy_version 1449157 (0.0009) [2023-12-26 11:09:53,993][123091] Updated weights for policy 0, policy_version 1449167 (0.0009) [2023-12-26 11:09:54,721][123090] Updated weights for policy 1, policy_version 1439592 (0.0009) [2023-12-26 11:09:54,783][123090] Updated weights for policy 1, policy_version 1439602 (0.0007) [2023-12-26 11:09:54,793][123091] Updated weights for policy 0, policy_version 1449177 (0.0011) [2023-12-26 11:09:54,840][123090] Updated weights for policy 1, policy_version 1439612 (0.0006) [2023-12-26 11:09:54,854][123091] Updated weights for policy 0, policy_version 1449187 (0.0011) [2023-12-26 11:09:54,914][123091] Updated weights for policy 0, policy_version 1449197 (0.0011) [2023-12-26 11:09:55,693][123090] Updated weights for policy 1, policy_version 1439622 (0.0008) [2023-12-26 11:09:55,756][123090] Updated weights for policy 1, policy_version 1439632 (0.0009) [2023-12-26 11:09:55,757][123091] Updated weights for policy 0, policy_version 1449207 (0.0011) [2023-12-26 11:09:55,812][123090] Updated weights for policy 1, policy_version 1439642 (0.0009) [2023-12-26 11:09:55,818][123091] Updated weights for policy 0, policy_version 1449217 (0.0011) [2023-12-26 11:09:55,870][123091] Updated weights for policy 0, policy_version 1449227 (0.0010) [2023-12-26 11:09:56,637][123090] Updated weights for policy 1, policy_version 1439652 (0.0007) [2023-12-26 11:09:56,685][123090] Updated weights for policy 1, policy_version 1439663 (0.0008) [2023-12-26 11:09:56,695][123091] Updated weights for policy 0, policy_version 1449237 (0.0010) [2023-12-26 11:09:56,736][123090] Updated weights for policy 1, policy_version 1439673 (0.0007) [2023-12-26 11:09:56,742][123091] Updated weights for policy 0, policy_version 1449247 (0.0010) [2023-12-26 11:09:56,797][123091] Updated weights for policy 0, policy_version 1449257 (0.0010) [2023-12-26 11:09:57,581][123090] Updated weights for policy 1, policy_version 1439683 (0.0007) [2023-12-26 11:09:57,633][123090] Updated weights for policy 1, policy_version 1439694 (0.0008) [2023-12-26 11:09:57,635][123091] Updated weights for policy 0, policy_version 1449267 (0.0010) [2023-12-26 11:09:57,686][123090] Updated weights for policy 1, policy_version 1439704 (0.0008) [2023-12-26 11:09:57,699][123091] Updated weights for policy 0, policy_version 1449277 (0.0011) [2023-12-26 11:09:57,758][123091] Updated weights for policy 0, policy_version 1449287 (0.0010) [2023-12-26 11:09:58,583][123090] Updated weights for policy 1, policy_version 1439714 (0.0008) [2023-12-26 11:09:58,611][123091] Updated weights for policy 0, policy_version 1449297 (0.0010) [2023-12-26 11:09:58,648][123090] Updated weights for policy 1, policy_version 1439724 (0.0009) [2023-12-26 11:09:58,676][123091] Updated weights for policy 0, policy_version 1449307 (0.0008) [2023-12-26 11:09:58,722][123090] Updated weights for policy 1, policy_version 1439734 (0.0008) [2023-12-26 11:09:58,746][123091] Updated weights for policy 0, policy_version 1449317 (0.0008) [2023-12-26 11:09:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 739590144. Throughput: 0: 8614.9, 1: 9009.8. Samples: 739593588. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:09:58,785][121949] Avg episode reward: [(0, '6166.496'), (1, '5933.508')] [2023-12-26 11:09:58,792][123090] Updated weights for policy 1, policy_version 1439744 (0.0009) [2023-12-26 11:09:58,831][123091] Updated weights for policy 0, policy_version 1449327 (0.0013) [2023-12-26 11:09:59,663][123090] Updated weights for policy 1, policy_version 1439754 (0.0006) [2023-12-26 11:09:59,688][123091] Updated weights for policy 0, policy_version 1449337 (0.0011) [2023-12-26 11:09:59,729][123090] Updated weights for policy 1, policy_version 1439764 (0.0007) [2023-12-26 11:09:59,747][123091] Updated weights for policy 0, policy_version 1449347 (0.0011) [2023-12-26 11:09:59,792][123090] Updated weights for policy 1, policy_version 1439774 (0.0006) [2023-12-26 11:09:59,808][123091] Updated weights for policy 0, policy_version 1449357 (0.0010) [2023-12-26 11:10:00,527][123090] Updated weights for policy 1, policy_version 1439784 (0.0006) [2023-12-26 11:10:00,556][123091] Updated weights for policy 0, policy_version 1449367 (0.0006) [2023-12-26 11:10:00,589][123090] Updated weights for policy 1, policy_version 1439794 (0.0005) [2023-12-26 11:10:00,611][123091] Updated weights for policy 0, policy_version 1449377 (0.0006) [2023-12-26 11:10:00,649][123090] Updated weights for policy 1, policy_version 1439804 (0.0005) [2023-12-26 11:10:00,659][123091] Updated weights for policy 0, policy_version 1449387 (0.0009) [2023-12-26 11:10:01,293][123090] Updated weights for policy 1, policy_version 1439814 (0.0007) [2023-12-26 11:10:01,365][123090] Updated weights for policy 1, policy_version 1439824 (0.0009) [2023-12-26 11:10:01,426][123090] Updated weights for policy 1, policy_version 1439834 (0.0009) [2023-12-26 11:10:01,457][123091] Updated weights for policy 0, policy_version 1449397 (0.0010) [2023-12-26 11:10:01,519][123091] Updated weights for policy 0, policy_version 1449407 (0.0010) [2023-12-26 11:10:01,581][123091] Updated weights for policy 0, policy_version 1449417 (0.0010) [2023-12-26 11:10:02,288][123091] Updated weights for policy 0, policy_version 1449427 (0.0010) [2023-12-26 11:10:02,307][123090] Updated weights for policy 1, policy_version 1439844 (0.0007) [2023-12-26 11:10:02,357][123091] Updated weights for policy 0, policy_version 1449437 (0.0008) [2023-12-26 11:10:02,381][123090] Updated weights for policy 1, policy_version 1439854 (0.0008) [2023-12-26 11:10:02,410][123091] Updated weights for policy 0, policy_version 1449447 (0.0007) [2023-12-26 11:10:02,441][123090] Updated weights for policy 1, policy_version 1439864 (0.0010) [2023-12-26 11:10:03,194][123091] Updated weights for policy 0, policy_version 1449457 (0.0008) [2023-12-26 11:10:03,267][123090] Updated weights for policy 1, policy_version 1439874 (0.0009) [2023-12-26 11:10:03,267][123091] Updated weights for policy 0, policy_version 1449467 (0.0008) [2023-12-26 11:10:03,326][123091] Updated weights for policy 0, policy_version 1449477 (0.0007) [2023-12-26 11:10:03,331][123090] Updated weights for policy 1, policy_version 1439884 (0.0008) [2023-12-26 11:10:03,387][123091] Updated weights for policy 0, policy_version 1449487 (0.0008) [2023-12-26 11:10:03,391][123090] Updated weights for policy 1, policy_version 1439894 (0.0008) [2023-12-26 11:10:03,453][123090] Updated weights for policy 1, policy_version 1439904 (0.0009) [2023-12-26 11:10:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 739688448. Throughput: 0: 8601.1, 1: 8975.9. Samples: 739698596. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:03,785][121949] Avg episode reward: [(0, '6204.061'), (1, '5814.391')] [2023-12-26 11:10:04,032][123091] Updated weights for policy 0, policy_version 1449497 (0.0007) [2023-12-26 11:10:04,105][123091] Updated weights for policy 0, policy_version 1449507 (0.0007) [2023-12-26 11:10:04,165][123091] Updated weights for policy 0, policy_version 1449517 (0.0009) [2023-12-26 11:10:04,290][123090] Updated weights for policy 1, policy_version 1439914 (0.0010) [2023-12-26 11:10:04,348][123090] Updated weights for policy 1, policy_version 1439924 (0.0008) [2023-12-26 11:10:04,403][123090] Updated weights for policy 1, policy_version 1439934 (0.0009) [2023-12-26 11:10:04,917][123091] Updated weights for policy 0, policy_version 1449527 (0.0007) [2023-12-26 11:10:04,983][123091] Updated weights for policy 0, policy_version 1449537 (0.0006) [2023-12-26 11:10:05,051][123091] Updated weights for policy 0, policy_version 1449547 (0.0008) [2023-12-26 11:10:05,277][123090] Updated weights for policy 1, policy_version 1439944 (0.0009) [2023-12-26 11:10:05,332][123090] Updated weights for policy 1, policy_version 1439954 (0.0010) [2023-12-26 11:10:05,381][123090] Updated weights for policy 1, policy_version 1439964 (0.0010) [2023-12-26 11:10:05,857][123091] Updated weights for policy 0, policy_version 1449557 (0.0009) [2023-12-26 11:10:05,908][123091] Updated weights for policy 0, policy_version 1449567 (0.0009) [2023-12-26 11:10:05,961][123091] Updated weights for policy 0, policy_version 1449577 (0.0009) [2023-12-26 11:10:06,101][123090] Updated weights for policy 1, policy_version 1439974 (0.0009) [2023-12-26 11:10:06,170][123090] Updated weights for policy 1, policy_version 1439984 (0.0009) [2023-12-26 11:10:06,234][123090] Updated weights for policy 1, policy_version 1439994 (0.0010) [2023-12-26 11:10:06,853][123091] Updated weights for policy 0, policy_version 1449587 (0.0009) [2023-12-26 11:10:06,905][123091] Updated weights for policy 0, policy_version 1449597 (0.0010) [2023-12-26 11:10:06,965][123091] Updated weights for policy 0, policy_version 1449608 (0.0010) [2023-12-26 11:10:07,046][123090] Updated weights for policy 1, policy_version 1440004 (0.0008) [2023-12-26 11:10:07,113][123090] Updated weights for policy 1, policy_version 1440014 (0.0009) [2023-12-26 11:10:07,167][123090] Updated weights for policy 1, policy_version 1440024 (0.0010) [2023-12-26 11:10:07,833][123091] Updated weights for policy 0, policy_version 1449619 (0.0011) [2023-12-26 11:10:07,897][123091] Updated weights for policy 0, policy_version 1449629 (0.0009) [2023-12-26 11:10:07,963][123090] Updated weights for policy 1, policy_version 1440034 (0.0009) [2023-12-26 11:10:07,965][123091] Updated weights for policy 0, policy_version 1449639 (0.0009) [2023-12-26 11:10:08,026][123090] Updated weights for policy 1, policy_version 1440044 (0.0009) [2023-12-26 11:10:08,084][123090] Updated weights for policy 1, policy_version 1440054 (0.0009) [2023-12-26 11:10:08,148][123090] Updated weights for policy 1, policy_version 1440064 (0.0009) [2023-12-26 11:10:08,768][123091] Updated weights for policy 0, policy_version 1449649 (0.0008) [2023-12-26 11:10:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17744.7). Total num frames: 739770368. Throughput: 0: 8638.8, 1: 8955.3. Samples: 739750920. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:08,784][121949] Avg episode reward: [(0, '6241.053'), (1, '5757.308')] [2023-12-26 11:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001440064_368656384.pth... [2023-12-26 11:10:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001439040_368394240.pth [2023-12-26 11:10:08,833][123091] Updated weights for policy 0, policy_version 1449659 (0.0010) [2023-12-26 11:10:08,886][123091] Updated weights for policy 0, policy_version 1449669 (0.0010) [2023-12-26 11:10:08,950][123091] Updated weights for policy 0, policy_version 1449679 (0.0010) [2023-12-26 11:10:08,956][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001449680_371122176.pth... [2023-12-26 11:10:08,961][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001448656_370860032.pth [2023-12-26 11:10:08,965][123090] Updated weights for policy 1, policy_version 1440074 (0.0006) [2023-12-26 11:10:09,026][123090] Updated weights for policy 1, policy_version 1440084 (0.0009) [2023-12-26 11:10:09,082][123090] Updated weights for policy 1, policy_version 1440094 (0.0009) [2023-12-26 11:10:09,699][123091] Updated weights for policy 0, policy_version 1449689 (0.0011) [2023-12-26 11:10:09,767][123091] Updated weights for policy 0, policy_version 1449699 (0.0011) [2023-12-26 11:10:09,831][123091] Updated weights for policy 0, policy_version 1449709 (0.0010) [2023-12-26 11:10:09,967][123090] Updated weights for policy 1, policy_version 1440104 (0.0009) [2023-12-26 11:10:10,029][123090] Updated weights for policy 1, policy_version 1440114 (0.0010) [2023-12-26 11:10:10,094][123090] Updated weights for policy 1, policy_version 1440124 (0.0009) [2023-12-26 11:10:10,641][123091] Updated weights for policy 0, policy_version 1449719 (0.0010) [2023-12-26 11:10:10,699][123091] Updated weights for policy 0, policy_version 1449729 (0.0009) [2023-12-26 11:10:10,754][123091] Updated weights for policy 0, policy_version 1449739 (0.0009) [2023-12-26 11:10:10,932][123090] Updated weights for policy 1, policy_version 1440134 (0.0010) [2023-12-26 11:10:10,981][123090] Updated weights for policy 1, policy_version 1440144 (0.0009) [2023-12-26 11:10:11,039][123090] Updated weights for policy 1, policy_version 1440154 (0.0009) [2023-12-26 11:10:11,618][123091] Updated weights for policy 0, policy_version 1449749 (0.0009) [2023-12-26 11:10:11,687][123091] Updated weights for policy 0, policy_version 1449759 (0.0010) [2023-12-26 11:10:11,756][123091] Updated weights for policy 0, policy_version 1449769 (0.0008) [2023-12-26 11:10:11,982][123090] Updated weights for policy 1, policy_version 1440164 (0.0010) [2023-12-26 11:10:12,042][123090] Updated weights for policy 1, policy_version 1440174 (0.0009) [2023-12-26 11:10:12,099][123090] Updated weights for policy 1, policy_version 1440184 (0.0009) [2023-12-26 11:10:12,538][123091] Updated weights for policy 0, policy_version 1449779 (0.0007) [2023-12-26 11:10:12,599][123091] Updated weights for policy 0, policy_version 1449789 (0.0010) [2023-12-26 11:10:12,661][123091] Updated weights for policy 0, policy_version 1449799 (0.0009) [2023-12-26 11:10:12,903][123090] Updated weights for policy 1, policy_version 1440194 (0.0009) [2023-12-26 11:10:12,957][123090] Updated weights for policy 1, policy_version 1440204 (0.0009) [2023-12-26 11:10:13,017][123090] Updated weights for policy 1, policy_version 1440214 (0.0009) [2023-12-26 11:10:13,074][123090] Updated weights for policy 1, policy_version 1440224 (0.0009) [2023-12-26 11:10:13,484][123091] Updated weights for policy 0, policy_version 1449809 (0.0009) [2023-12-26 11:10:13,549][123091] Updated weights for policy 0, policy_version 1449819 (0.0006) [2023-12-26 11:10:13,608][123091] Updated weights for policy 0, policy_version 1449829 (0.0006) [2023-12-26 11:10:13,666][123091] Updated weights for policy 0, policy_version 1449839 (0.0005) [2023-12-26 11:10:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 739860480. Throughput: 0: 8635.7, 1: 8795.5. Samples: 739852504. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:13,784][121949] Avg episode reward: [(0, '6295.243'), (1, '5728.054')] [2023-12-26 11:10:13,978][123090] Updated weights for policy 1, policy_version 1440234 (0.0009) [2023-12-26 11:10:14,036][123090] Updated weights for policy 1, policy_version 1440244 (0.0009) [2023-12-26 11:10:14,105][123090] Updated weights for policy 1, policy_version 1440254 (0.0009) [2023-12-26 11:10:14,414][123091] Updated weights for policy 0, policy_version 1449849 (0.0009) [2023-12-26 11:10:14,471][123091] Updated weights for policy 0, policy_version 1449859 (0.0007) [2023-12-26 11:10:14,530][123091] Updated weights for policy 0, policy_version 1449869 (0.0005) [2023-12-26 11:10:14,958][123090] Updated weights for policy 1, policy_version 1440264 (0.0009) [2023-12-26 11:10:15,024][123090] Updated weights for policy 1, policy_version 1440274 (0.0010) [2023-12-26 11:10:15,096][123090] Updated weights for policy 1, policy_version 1440284 (0.0010) [2023-12-26 11:10:15,319][123091] Updated weights for policy 0, policy_version 1449879 (0.0009) [2023-12-26 11:10:15,376][123091] Updated weights for policy 0, policy_version 1449889 (0.0009) [2023-12-26 11:10:15,434][123091] Updated weights for policy 0, policy_version 1449899 (0.0009) [2023-12-26 11:10:15,929][123090] Updated weights for policy 1, policy_version 1440294 (0.0007) [2023-12-26 11:10:15,999][123090] Updated weights for policy 1, policy_version 1440304 (0.0008) [2023-12-26 11:10:16,068][123090] Updated weights for policy 1, policy_version 1440314 (0.0010) [2023-12-26 11:10:16,259][123091] Updated weights for policy 0, policy_version 1449909 (0.0010) [2023-12-26 11:10:16,306][123091] Updated weights for policy 0, policy_version 1449919 (0.0010) [2023-12-26 11:10:16,353][123091] Updated weights for policy 0, policy_version 1449929 (0.0010) [2023-12-26 11:10:16,856][123090] Updated weights for policy 1, policy_version 1440324 (0.0010) [2023-12-26 11:10:16,916][123090] Updated weights for policy 1, policy_version 1440334 (0.0010) [2023-12-26 11:10:16,964][123090] Updated weights for policy 1, policy_version 1440344 (0.0010) [2023-12-26 11:10:17,040][123091] Updated weights for policy 0, policy_version 1449939 (0.0006) [2023-12-26 11:10:17,103][123091] Updated weights for policy 0, policy_version 1449949 (0.0010) [2023-12-26 11:10:17,170][123091] Updated weights for policy 0, policy_version 1449959 (0.0011) [2023-12-26 11:10:17,763][123090] Updated weights for policy 1, policy_version 1440354 (0.0009) [2023-12-26 11:10:17,834][123090] Updated weights for policy 1, policy_version 1440364 (0.0006) [2023-12-26 11:10:17,903][123090] Updated weights for policy 1, policy_version 1440374 (0.0005) [2023-12-26 11:10:17,908][123091] Updated weights for policy 0, policy_version 1449969 (0.0010) [2023-12-26 11:10:17,953][123090] Updated weights for policy 1, policy_version 1440384 (0.0005) [2023-12-26 11:10:17,974][123091] Updated weights for policy 0, policy_version 1449979 (0.0007) [2023-12-26 11:10:18,037][123091] Updated weights for policy 0, policy_version 1449989 (0.0010) [2023-12-26 11:10:18,087][123091] Updated weights for policy 0, policy_version 1449999 (0.0009) [2023-12-26 11:10:18,646][123090] Updated weights for policy 1, policy_version 1440394 (0.0009) [2023-12-26 11:10:18,703][123090] Updated weights for policy 1, policy_version 1440404 (0.0009) [2023-12-26 11:10:18,752][123090] Updated weights for policy 1, policy_version 1440414 (0.0009) [2023-12-26 11:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 739950592. Throughput: 0: 8700.9, 1: 8729.4. Samples: 739959864. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:18,785][121949] Avg episode reward: [(0, '6310.944'), (1, '5637.574')] [2023-12-26 11:10:18,914][123091] Updated weights for policy 0, policy_version 1450009 (0.0011) [2023-12-26 11:10:18,973][123091] Updated weights for policy 0, policy_version 1450019 (0.0010) [2023-12-26 11:10:19,034][123091] Updated weights for policy 0, policy_version 1450029 (0.0011) [2023-12-26 11:10:19,611][123090] Updated weights for policy 1, policy_version 1440424 (0.0010) [2023-12-26 11:10:19,663][123090] Updated weights for policy 1, policy_version 1440434 (0.0010) [2023-12-26 11:10:19,731][123090] Updated weights for policy 1, policy_version 1440444 (0.0009) [2023-12-26 11:10:19,786][123091] Updated weights for policy 0, policy_version 1450039 (0.0009) [2023-12-26 11:10:19,848][123091] Updated weights for policy 0, policy_version 1450049 (0.0008) [2023-12-26 11:10:19,914][123091] Updated weights for policy 0, policy_version 1450059 (0.0008) [2023-12-26 11:10:20,630][123090] Updated weights for policy 1, policy_version 1440454 (0.0008) [2023-12-26 11:10:20,637][123091] Updated weights for policy 0, policy_version 1450069 (0.0008) [2023-12-26 11:10:20,702][123090] Updated weights for policy 1, policy_version 1440464 (0.0008) [2023-12-26 11:10:20,706][123091] Updated weights for policy 0, policy_version 1450079 (0.0008) [2023-12-26 11:10:20,763][123090] Updated weights for policy 1, policy_version 1440474 (0.0007) [2023-12-26 11:10:20,776][123091] Updated weights for policy 0, policy_version 1450089 (0.0008) [2023-12-26 11:10:21,563][123090] Updated weights for policy 1, policy_version 1440484 (0.0006) [2023-12-26 11:10:21,584][123091] Updated weights for policy 0, policy_version 1450099 (0.0008) [2023-12-26 11:10:21,635][123090] Updated weights for policy 1, policy_version 1440494 (0.0009) [2023-12-26 11:10:21,653][123091] Updated weights for policy 0, policy_version 1450109 (0.0009) [2023-12-26 11:10:21,701][123090] Updated weights for policy 1, policy_version 1440504 (0.0006) [2023-12-26 11:10:21,734][123091] Updated weights for policy 0, policy_version 1450119 (0.0008) [2023-12-26 11:10:22,530][123091] Updated weights for policy 0, policy_version 1450129 (0.0010) [2023-12-26 11:10:22,562][123090] Updated weights for policy 1, policy_version 1440514 (0.0007) [2023-12-26 11:10:22,591][123091] Updated weights for policy 0, policy_version 1450139 (0.0007) [2023-12-26 11:10:22,625][123090] Updated weights for policy 1, policy_version 1440524 (0.0008) [2023-12-26 11:10:22,656][123091] Updated weights for policy 0, policy_version 1450149 (0.0008) [2023-12-26 11:10:22,682][123090] Updated weights for policy 1, policy_version 1440534 (0.0009) [2023-12-26 11:10:22,723][123091] Updated weights for policy 0, policy_version 1450159 (0.0009) [2023-12-26 11:10:22,744][123090] Updated weights for policy 1, policy_version 1440544 (0.0007) [2023-12-26 11:10:23,473][123091] Updated weights for policy 0, policy_version 1450169 (0.0010) [2023-12-26 11:10:23,521][123091] Updated weights for policy 0, policy_version 1450179 (0.0010) [2023-12-26 11:10:23,565][123091] Updated weights for policy 0, policy_version 1450189 (0.0010) [2023-12-26 11:10:23,582][123090] Updated weights for policy 1, policy_version 1440554 (0.0005) [2023-12-26 11:10:23,650][123090] Updated weights for policy 1, policy_version 1440564 (0.0009) [2023-12-26 11:10:23,715][123090] Updated weights for policy 1, policy_version 1440574 (0.0009) [2023-12-26 11:10:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 740040704. Throughput: 0: 8728.1, 1: 8664.6. Samples: 740011432. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:23,784][121949] Avg episode reward: [(0, '6291.326'), (1, '5622.893')] [2023-12-26 11:10:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001450192_371253248.pth... [2023-12-26 11:10:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001440576_368787456.pth... [2023-12-26 11:10:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001449136_370982912.pth [2023-12-26 11:10:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001439584_368533504.pth [2023-12-26 11:10:24,412][123091] Updated weights for policy 0, policy_version 1450199 (0.0009) [2023-12-26 11:10:24,476][123091] Updated weights for policy 0, policy_version 1450209 (0.0005) [2023-12-26 11:10:24,523][123090] Updated weights for policy 1, policy_version 1440584 (0.0009) [2023-12-26 11:10:24,534][123091] Updated weights for policy 0, policy_version 1450219 (0.0005) [2023-12-26 11:10:24,581][123090] Updated weights for policy 1, policy_version 1440594 (0.0010) [2023-12-26 11:10:24,640][123090] Updated weights for policy 1, policy_version 1440604 (0.0009) [2023-12-26 11:10:25,184][123091] Updated weights for policy 0, policy_version 1450229 (0.0006) [2023-12-26 11:10:25,237][123091] Updated weights for policy 0, policy_version 1450239 (0.0009) [2023-12-26 11:10:25,299][123091] Updated weights for policy 0, policy_version 1450249 (0.0009) [2023-12-26 11:10:25,468][123090] Updated weights for policy 1, policy_version 1440614 (0.0010) [2023-12-26 11:10:25,526][123090] Updated weights for policy 1, policy_version 1440624 (0.0009) [2023-12-26 11:10:25,572][123090] Updated weights for policy 1, policy_version 1440634 (0.0005) [2023-12-26 11:10:26,109][123091] Updated weights for policy 0, policy_version 1450259 (0.0008) [2023-12-26 11:10:26,160][123091] Updated weights for policy 0, policy_version 1450269 (0.0010) [2023-12-26 11:10:26,224][123091] Updated weights for policy 0, policy_version 1450279 (0.0009) [2023-12-26 11:10:26,413][123090] Updated weights for policy 1, policy_version 1440644 (0.0009) [2023-12-26 11:10:26,474][123090] Updated weights for policy 1, policy_version 1440655 (0.0009) [2023-12-26 11:10:26,536][123090] Updated weights for policy 1, policy_version 1440665 (0.0010) [2023-12-26 11:10:27,106][123091] Updated weights for policy 0, policy_version 1450290 (0.0010) [2023-12-26 11:10:27,162][123091] Updated weights for policy 0, policy_version 1450300 (0.0009) [2023-12-26 11:10:27,218][123091] Updated weights for policy 0, policy_version 1450310 (0.0010) [2023-12-26 11:10:27,284][123090] Updated weights for policy 1, policy_version 1440675 (0.0008) [2023-12-26 11:10:27,355][123090] Updated weights for policy 1, policy_version 1440685 (0.0007) [2023-12-26 11:10:27,428][123090] Updated weights for policy 1, policy_version 1440695 (0.0005) [2023-12-26 11:10:27,968][123090] Updated weights for policy 1, policy_version 1440705 (0.0005) [2023-12-26 11:10:28,023][123090] Updated weights for policy 1, policy_version 1440715 (0.0005) [2023-12-26 11:10:28,077][123090] Updated weights for policy 1, policy_version 1440725 (0.0005) [2023-12-26 11:10:28,113][123091] Updated weights for policy 0, policy_version 1450321 (0.0009) [2023-12-26 11:10:28,134][123090] Updated weights for policy 1, policy_version 1440735 (0.0005) [2023-12-26 11:10:28,163][123091] Updated weights for policy 0, policy_version 1450331 (0.0009) [2023-12-26 11:10:28,216][123091] Updated weights for policy 0, policy_version 1450341 (0.0010) [2023-12-26 11:10:28,266][123091] Updated weights for policy 0, policy_version 1450351 (0.0010) [2023-12-26 11:10:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 740122624. Throughput: 0: 8766.4, 1: 8692.6. Samples: 740117372. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:28,785][121949] Avg episode reward: [(0, '6316.399'), (1, '5586.290')] [2023-12-26 11:10:28,917][123090] Updated weights for policy 1, policy_version 1440745 (0.0009) [2023-12-26 11:10:28,977][123090] Updated weights for policy 1, policy_version 1440755 (0.0010) [2023-12-26 11:10:29,045][123090] Updated weights for policy 1, policy_version 1440765 (0.0009) [2023-12-26 11:10:29,107][123091] Updated weights for policy 0, policy_version 1450361 (0.0010) [2023-12-26 11:10:29,160][123091] Updated weights for policy 0, policy_version 1450371 (0.0009) [2023-12-26 11:10:29,213][123091] Updated weights for policy 0, policy_version 1450381 (0.0009) [2023-12-26 11:10:29,862][123090] Updated weights for policy 1, policy_version 1440775 (0.0009) [2023-12-26 11:10:29,934][123090] Updated weights for policy 1, policy_version 1440785 (0.0010) [2023-12-26 11:10:30,000][123090] Updated weights for policy 1, policy_version 1440795 (0.0009) [2023-12-26 11:10:30,012][123091] Updated weights for policy 0, policy_version 1450391 (0.0008) [2023-12-26 11:10:30,063][123091] Updated weights for policy 0, policy_version 1450401 (0.0009) [2023-12-26 11:10:30,119][123091] Updated weights for policy 0, policy_version 1450411 (0.0010) [2023-12-26 11:10:30,850][123090] Updated weights for policy 1, policy_version 1440805 (0.0009) [2023-12-26 11:10:30,851][123091] Updated weights for policy 0, policy_version 1450421 (0.0008) [2023-12-26 11:10:30,901][123091] Updated weights for policy 0, policy_version 1450431 (0.0005) [2023-12-26 11:10:30,904][123090] Updated weights for policy 1, policy_version 1440815 (0.0008) [2023-12-26 11:10:30,949][123091] Updated weights for policy 0, policy_version 1450441 (0.0005) [2023-12-26 11:10:30,965][123090] Updated weights for policy 1, policy_version 1440826 (0.0009) [2023-12-26 11:10:31,654][123091] Updated weights for policy 0, policy_version 1450451 (0.0005) [2023-12-26 11:10:31,717][123091] Updated weights for policy 0, policy_version 1450461 (0.0007) [2023-12-26 11:10:31,785][123091] Updated weights for policy 0, policy_version 1450471 (0.0008) [2023-12-26 11:10:31,791][123090] Updated weights for policy 1, policy_version 1440836 (0.0008) [2023-12-26 11:10:31,861][123090] Updated weights for policy 1, policy_version 1440846 (0.0006) [2023-12-26 11:10:31,936][123090] Updated weights for policy 1, policy_version 1440856 (0.0008) [2023-12-26 11:10:32,556][123091] Updated weights for policy 0, policy_version 1450481 (0.0008) [2023-12-26 11:10:32,626][123091] Updated weights for policy 0, policy_version 1450491 (0.0005) [2023-12-26 11:10:32,691][123091] Updated weights for policy 0, policy_version 1450501 (0.0006) [2023-12-26 11:10:32,738][123090] Updated weights for policy 1, policy_version 1440866 (0.0009) [2023-12-26 11:10:32,760][123091] Updated weights for policy 0, policy_version 1450511 (0.0006) [2023-12-26 11:10:32,796][123090] Updated weights for policy 1, policy_version 1440876 (0.0009) [2023-12-26 11:10:32,855][123090] Updated weights for policy 1, policy_version 1440886 (0.0009) [2023-12-26 11:10:33,466][123091] Updated weights for policy 0, policy_version 1450521 (0.0009) [2023-12-26 11:10:33,533][123091] Updated weights for policy 0, policy_version 1450531 (0.0006) [2023-12-26 11:10:33,598][123091] Updated weights for policy 0, policy_version 1450541 (0.0006) [2023-12-26 11:10:33,737][123090] Updated weights for policy 1, policy_version 1440897 (0.0010) [2023-12-26 11:10:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 740212736. Throughput: 0: 8881.3, 1: 8688.4. Samples: 740226032. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:33,784][121949] Avg episode reward: [(0, '6276.935'), (1, '5761.754')] [2023-12-26 11:10:33,795][123090] Updated weights for policy 1, policy_version 1440907 (0.0010) [2023-12-26 11:10:33,847][123090] Updated weights for policy 1, policy_version 1440917 (0.0009) [2023-12-26 11:10:34,282][123091] Updated weights for policy 0, policy_version 1450551 (0.0006) [2023-12-26 11:10:34,342][123091] Updated weights for policy 0, policy_version 1450561 (0.0005) [2023-12-26 11:10:34,409][123091] Updated weights for policy 0, policy_version 1450571 (0.0005) [2023-12-26 11:10:34,727][123090] Updated weights for policy 1, policy_version 1440929 (0.0010) [2023-12-26 11:10:34,799][123090] Updated weights for policy 1, policy_version 1440939 (0.0010) [2023-12-26 11:10:34,867][123090] Updated weights for policy 1, policy_version 1440949 (0.0010) [2023-12-26 11:10:34,923][123090] Updated weights for policy 1, policy_version 1440959 (0.0009) [2023-12-26 11:10:34,948][123091] Updated weights for policy 0, policy_version 1450581 (0.0008) [2023-12-26 11:10:35,012][123091] Updated weights for policy 0, policy_version 1450591 (0.0010) [2023-12-26 11:10:35,075][123091] Updated weights for policy 0, policy_version 1450601 (0.0005) [2023-12-26 11:10:35,719][123091] Updated weights for policy 0, policy_version 1450611 (0.0005) [2023-12-26 11:10:35,773][123091] Updated weights for policy 0, policy_version 1450621 (0.0005) [2023-12-26 11:10:35,821][123090] Updated weights for policy 1, policy_version 1440969 (0.0010) [2023-12-26 11:10:35,827][123091] Updated weights for policy 0, policy_version 1450631 (0.0005) [2023-12-26 11:10:35,876][123090] Updated weights for policy 1, policy_version 1440979 (0.0011) [2023-12-26 11:10:35,927][123090] Updated weights for policy 1, policy_version 1440989 (0.0010) [2023-12-26 11:10:36,612][123091] Updated weights for policy 0, policy_version 1450641 (0.0006) [2023-12-26 11:10:36,672][123091] Updated weights for policy 0, policy_version 1450651 (0.0011) [2023-12-26 11:10:36,703][123090] Updated weights for policy 1, policy_version 1440999 (0.0009) [2023-12-26 11:10:36,728][123091] Updated weights for policy 0, policy_version 1450661 (0.0011) [2023-12-26 11:10:36,757][123090] Updated weights for policy 1, policy_version 1441009 (0.0007) [2023-12-26 11:10:36,777][123091] Updated weights for policy 0, policy_version 1450671 (0.0010) [2023-12-26 11:10:36,812][123090] Updated weights for policy 1, policy_version 1441019 (0.0008) [2023-12-26 11:10:37,639][123091] Updated weights for policy 0, policy_version 1450681 (0.0011) [2023-12-26 11:10:37,683][123090] Updated weights for policy 1, policy_version 1441029 (0.0008) [2023-12-26 11:10:37,702][123091] Updated weights for policy 0, policy_version 1450691 (0.0011) [2023-12-26 11:10:37,740][123090] Updated weights for policy 1, policy_version 1441039 (0.0007) [2023-12-26 11:10:37,754][123091] Updated weights for policy 0, policy_version 1450701 (0.0010) [2023-12-26 11:10:37,789][123090] Updated weights for policy 1, policy_version 1441049 (0.0007) [2023-12-26 11:10:38,603][123091] Updated weights for policy 0, policy_version 1450711 (0.0011) [2023-12-26 11:10:38,658][123091] Updated weights for policy 0, policy_version 1450721 (0.0010) [2023-12-26 11:10:38,663][123090] Updated weights for policy 1, policy_version 1441059 (0.0009) [2023-12-26 11:10:38,710][123091] Updated weights for policy 0, policy_version 1450731 (0.0010) [2023-12-26 11:10:38,725][123090] Updated weights for policy 1, policy_version 1441069 (0.0006) [2023-12-26 11:10:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 740302848. Throughput: 0: 8963.7, 1: 8665.0. Samples: 740281016. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:38,785][121949] Avg episode reward: [(0, '6317.112'), (1, '5646.316')] [2023-12-26 11:10:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001450736_371392512.pth... [2023-12-26 11:10:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001449680_371122176.pth [2023-12-26 11:10:38,797][123090] Updated weights for policy 1, policy_version 1441079 (0.0008) [2023-12-26 11:10:38,849][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001441088_368918528.pth... [2023-12-26 11:10:38,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001440064_368656384.pth [2023-12-26 11:10:39,566][123091] Updated weights for policy 0, policy_version 1450741 (0.0011) [2023-12-26 11:10:39,630][123091] Updated weights for policy 0, policy_version 1450751 (0.0011) [2023-12-26 11:10:39,638][123090] Updated weights for policy 1, policy_version 1441089 (0.0009) [2023-12-26 11:10:39,693][123091] Updated weights for policy 0, policy_version 1450761 (0.0011) [2023-12-26 11:10:39,705][123090] Updated weights for policy 1, policy_version 1441099 (0.0007) [2023-12-26 11:10:39,756][123090] Updated weights for policy 1, policy_version 1441109 (0.0007) [2023-12-26 11:10:39,806][123090] Updated weights for policy 1, policy_version 1441119 (0.0007) [2023-12-26 11:10:40,544][123090] Updated weights for policy 1, policy_version 1441129 (0.0006) [2023-12-26 11:10:40,550][123091] Updated weights for policy 0, policy_version 1450771 (0.0011) [2023-12-26 11:10:40,603][123090] Updated weights for policy 1, policy_version 1441139 (0.0009) [2023-12-26 11:10:40,606][123091] Updated weights for policy 0, policy_version 1450781 (0.0010) [2023-12-26 11:10:40,663][123090] Updated weights for policy 1, policy_version 1441149 (0.0010) [2023-12-26 11:10:40,669][123091] Updated weights for policy 0, policy_version 1450791 (0.0011) [2023-12-26 11:10:41,506][123090] Updated weights for policy 1, policy_version 1441159 (0.0009) [2023-12-26 11:10:41,530][123091] Updated weights for policy 0, policy_version 1450801 (0.0011) [2023-12-26 11:10:41,559][123090] Updated weights for policy 1, policy_version 1441169 (0.0008) [2023-12-26 11:10:41,586][123091] Updated weights for policy 0, policy_version 1450811 (0.0011) [2023-12-26 11:10:41,623][123090] Updated weights for policy 1, policy_version 1441179 (0.0006) [2023-12-26 11:10:41,658][123091] Updated weights for policy 0, policy_version 1450821 (0.0011) [2023-12-26 11:10:41,711][123091] Updated weights for policy 0, policy_version 1450831 (0.0011) [2023-12-26 11:10:42,552][123091] Updated weights for policy 0, policy_version 1450841 (0.0009) [2023-12-26 11:10:42,553][123090] Updated weights for policy 1, policy_version 1441189 (0.0008) [2023-12-26 11:10:42,612][123090] Updated weights for policy 1, policy_version 1441199 (0.0009) [2023-12-26 11:10:42,615][123091] Updated weights for policy 0, policy_version 1450851 (0.0007) [2023-12-26 11:10:42,677][123090] Updated weights for policy 1, policy_version 1441209 (0.0008) [2023-12-26 11:10:42,684][123091] Updated weights for policy 0, policy_version 1450861 (0.0006) [2023-12-26 11:10:43,429][123090] Updated weights for policy 1, policy_version 1441219 (0.0009) [2023-12-26 11:10:43,466][123091] Updated weights for policy 0, policy_version 1450871 (0.0009) [2023-12-26 11:10:43,494][123090] Updated weights for policy 1, policy_version 1441229 (0.0005) [2023-12-26 11:10:43,513][123091] Updated weights for policy 0, policy_version 1450881 (0.0010) [2023-12-26 11:10:43,549][123090] Updated weights for policy 1, policy_version 1441239 (0.0007) [2023-12-26 11:10:43,560][123091] Updated weights for policy 0, policy_version 1450891 (0.0010) [2023-12-26 11:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 740392960. Throughput: 0: 8925.7, 1: 8585.7. Samples: 740381600. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:43,785][121949] Avg episode reward: [(0, '6259.059'), (1, '5476.256')] [2023-12-26 11:10:44,227][123090] Updated weights for policy 1, policy_version 1441249 (0.0010) [2023-12-26 11:10:44,296][123090] Updated weights for policy 1, policy_version 1441259 (0.0009) [2023-12-26 11:10:44,353][123091] Updated weights for policy 0, policy_version 1450901 (0.0009) [2023-12-26 11:10:44,366][123090] Updated weights for policy 1, policy_version 1441269 (0.0008) [2023-12-26 11:10:44,426][123091] Updated weights for policy 0, policy_version 1450911 (0.0009) [2023-12-26 11:10:44,439][123090] Updated weights for policy 1, policy_version 1441279 (0.0005) [2023-12-26 11:10:44,488][123091] Updated weights for policy 0, policy_version 1450921 (0.0009) [2023-12-26 11:10:45,122][123090] Updated weights for policy 1, policy_version 1441289 (0.0005) [2023-12-26 11:10:45,186][123090] Updated weights for policy 1, policy_version 1441299 (0.0005) [2023-12-26 11:10:45,249][123090] Updated weights for policy 1, policy_version 1441309 (0.0008) [2023-12-26 11:10:45,388][123091] Updated weights for policy 0, policy_version 1450931 (0.0009) [2023-12-26 11:10:45,453][123091] Updated weights for policy 0, policy_version 1450941 (0.0009) [2023-12-26 11:10:45,505][123091] Updated weights for policy 0, policy_version 1450951 (0.0009) [2023-12-26 11:10:45,940][123090] Updated weights for policy 1, policy_version 1441319 (0.0010) [2023-12-26 11:10:46,009][123090] Updated weights for policy 1, policy_version 1441329 (0.0009) [2023-12-26 11:10:46,065][123090] Updated weights for policy 1, policy_version 1441339 (0.0009) [2023-12-26 11:10:46,309][123091] Updated weights for policy 0, policy_version 1450961 (0.0009) [2023-12-26 11:10:46,361][123091] Updated weights for policy 0, policy_version 1450971 (0.0008) [2023-12-26 11:10:46,406][123091] Updated weights for policy 0, policy_version 1450981 (0.0006) [2023-12-26 11:10:46,460][123091] Updated weights for policy 0, policy_version 1450991 (0.0005) [2023-12-26 11:10:46,904][123090] Updated weights for policy 1, policy_version 1441349 (0.0009) [2023-12-26 11:10:46,952][123090] Updated weights for policy 1, policy_version 1441359 (0.0009) [2023-12-26 11:10:47,000][123090] Updated weights for policy 1, policy_version 1441369 (0.0009) [2023-12-26 11:10:47,269][123091] Updated weights for policy 0, policy_version 1451001 (0.0010) [2023-12-26 11:10:47,335][123091] Updated weights for policy 0, policy_version 1451011 (0.0011) [2023-12-26 11:10:47,406][123091] Updated weights for policy 0, policy_version 1451021 (0.0011) [2023-12-26 11:10:47,861][123090] Updated weights for policy 1, policy_version 1441379 (0.0009) [2023-12-26 11:10:47,909][123090] Updated weights for policy 1, policy_version 1441389 (0.0009) [2023-12-26 11:10:47,971][123090] Updated weights for policy 1, policy_version 1441399 (0.0010) [2023-12-26 11:10:48,210][123091] Updated weights for policy 0, policy_version 1451031 (0.0007) [2023-12-26 11:10:48,264][123091] Updated weights for policy 0, policy_version 1451041 (0.0005) [2023-12-26 11:10:48,322][123091] Updated weights for policy 0, policy_version 1451051 (0.0006) [2023-12-26 11:10:48,763][123090] Updated weights for policy 1, policy_version 1441409 (0.0010) [2023-12-26 11:10:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 740474880. Throughput: 0: 8922.9, 1: 8648.3. Samples: 740489300. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:48,785][121949] Avg episode reward: [(0, '6264.190'), (1, '5527.386')] [2023-12-26 11:10:48,839][123090] Updated weights for policy 1, policy_version 1441419 (0.0007) [2023-12-26 11:10:48,901][123090] Updated weights for policy 1, policy_version 1441429 (0.0009) [2023-12-26 11:10:48,974][123090] Updated weights for policy 1, policy_version 1441439 (0.0009) [2023-12-26 11:10:49,110][123091] Updated weights for policy 0, policy_version 1451061 (0.0009) [2023-12-26 11:10:49,169][123091] Updated weights for policy 0, policy_version 1451071 (0.0011) [2023-12-26 11:10:49,227][123091] Updated weights for policy 0, policy_version 1451081 (0.0010) [2023-12-26 11:10:49,808][123090] Updated weights for policy 1, policy_version 1441449 (0.0006) [2023-12-26 11:10:49,882][123090] Updated weights for policy 1, policy_version 1441459 (0.0010) [2023-12-26 11:10:49,959][123090] Updated weights for policy 1, policy_version 1441469 (0.0009) [2023-12-26 11:10:49,961][123091] Updated weights for policy 0, policy_version 1451091 (0.0008) [2023-12-26 11:10:50,027][123091] Updated weights for policy 0, policy_version 1451101 (0.0008) [2023-12-26 11:10:50,099][123091] Updated weights for policy 0, policy_version 1451111 (0.0008) [2023-12-26 11:10:50,686][123090] Updated weights for policy 1, policy_version 1441479 (0.0006) [2023-12-26 11:10:50,748][123090] Updated weights for policy 1, policy_version 1441489 (0.0008) [2023-12-26 11:10:50,819][123090] Updated weights for policy 1, policy_version 1441499 (0.0006) [2023-12-26 11:10:50,899][123091] Updated weights for policy 0, policy_version 1451121 (0.0008) [2023-12-26 11:10:50,950][123091] Updated weights for policy 0, policy_version 1451131 (0.0011) [2023-12-26 11:10:51,006][123091] Updated weights for policy 0, policy_version 1451141 (0.0010) [2023-12-26 11:10:51,069][123091] Updated weights for policy 0, policy_version 1451151 (0.0008) [2023-12-26 11:10:51,538][123090] Updated weights for policy 1, policy_version 1441509 (0.0006) [2023-12-26 11:10:51,617][123090] Updated weights for policy 1, policy_version 1441519 (0.0006) [2023-12-26 11:10:51,694][123090] Updated weights for policy 1, policy_version 1441529 (0.0007) [2023-12-26 11:10:51,884][123091] Updated weights for policy 0, policy_version 1451161 (0.0009) [2023-12-26 11:10:51,937][123091] Updated weights for policy 0, policy_version 1451171 (0.0005) [2023-12-26 11:10:51,991][123091] Updated weights for policy 0, policy_version 1451181 (0.0006) [2023-12-26 11:10:52,460][123090] Updated weights for policy 1, policy_version 1441539 (0.0008) [2023-12-26 11:10:52,531][123090] Updated weights for policy 1, policy_version 1441549 (0.0010) [2023-12-26 11:10:52,603][123090] Updated weights for policy 1, policy_version 1441559 (0.0010) [2023-12-26 11:10:52,724][123091] Updated weights for policy 0, policy_version 1451191 (0.0006) [2023-12-26 11:10:52,789][123091] Updated weights for policy 0, policy_version 1451201 (0.0009) [2023-12-26 11:10:52,857][123091] Updated weights for policy 0, policy_version 1451211 (0.0010) [2023-12-26 11:10:53,437][123090] Updated weights for policy 1, policy_version 1441569 (0.0009) [2023-12-26 11:10:53,490][123090] Updated weights for policy 1, policy_version 1441579 (0.0010) [2023-12-26 11:10:53,557][123090] Updated weights for policy 1, policy_version 1441589 (0.0010) [2023-12-26 11:10:53,582][123091] Updated weights for policy 0, policy_version 1451221 (0.0008) [2023-12-26 11:10:53,627][123090] Updated weights for policy 1, policy_version 1441599 (0.0008) [2023-12-26 11:10:53,628][123091] Updated weights for policy 0, policy_version 1451231 (0.0005) [2023-12-26 11:10:53,681][123091] Updated weights for policy 0, policy_version 1451241 (0.0005) [2023-12-26 11:10:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 740573184. Throughput: 0: 8926.5, 1: 8690.9. Samples: 740543704. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:53,785][121949] Avg episode reward: [(0, '6276.006'), (1, '5450.708')] [2023-12-26 11:10:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001441600_369049600.pth... [2023-12-26 11:10:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001451248_371523584.pth... [2023-12-26 11:10:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001440576_368787456.pth [2023-12-26 11:10:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001450192_371253248.pth [2023-12-26 11:10:54,420][123090] Updated weights for policy 1, policy_version 1441609 (0.0010) [2023-12-26 11:10:54,468][123091] Updated weights for policy 0, policy_version 1451251 (0.0005) [2023-12-26 11:10:54,476][123090] Updated weights for policy 1, policy_version 1441619 (0.0005) [2023-12-26 11:10:54,541][123091] Updated weights for policy 0, policy_version 1451261 (0.0007) [2023-12-26 11:10:54,547][123090] Updated weights for policy 1, policy_version 1441629 (0.0008) [2023-12-26 11:10:54,612][123091] Updated weights for policy 0, policy_version 1451271 (0.0006) [2023-12-26 11:10:55,248][123090] Updated weights for policy 1, policy_version 1441639 (0.0006) [2023-12-26 11:10:55,271][123091] Updated weights for policy 0, policy_version 1451281 (0.0005) [2023-12-26 11:10:55,304][123090] Updated weights for policy 1, policy_version 1441649 (0.0005) [2023-12-26 11:10:55,320][123091] Updated weights for policy 0, policy_version 1451291 (0.0007) [2023-12-26 11:10:55,360][123090] Updated weights for policy 1, policy_version 1441659 (0.0006) [2023-12-26 11:10:55,378][123091] Updated weights for policy 0, policy_version 1451301 (0.0010) [2023-12-26 11:10:55,433][123091] Updated weights for policy 0, policy_version 1451311 (0.0010) [2023-12-26 11:10:56,160][123091] Updated weights for policy 0, policy_version 1451321 (0.0011) [2023-12-26 11:10:56,161][123090] Updated weights for policy 1, policy_version 1441669 (0.0006) [2023-12-26 11:10:56,215][123091] Updated weights for policy 0, policy_version 1451331 (0.0010) [2023-12-26 11:10:56,222][123090] Updated weights for policy 1, policy_version 1441679 (0.0006) [2023-12-26 11:10:56,277][123091] Updated weights for policy 0, policy_version 1451341 (0.0008) [2023-12-26 11:10:56,285][123090] Updated weights for policy 1, policy_version 1441689 (0.0008) [2023-12-26 11:10:57,045][123091] Updated weights for policy 0, policy_version 1451351 (0.0007) [2023-12-26 11:10:57,100][123091] Updated weights for policy 0, policy_version 1451361 (0.0005) [2023-12-26 11:10:57,122][123090] Updated weights for policy 1, policy_version 1441699 (0.0009) [2023-12-26 11:10:57,164][123091] Updated weights for policy 0, policy_version 1451371 (0.0007) [2023-12-26 11:10:57,177][123090] Updated weights for policy 1, policy_version 1441709 (0.0008) [2023-12-26 11:10:57,233][123090] Updated weights for policy 1, policy_version 1441719 (0.0010) [2023-12-26 11:10:57,847][123091] Updated weights for policy 0, policy_version 1451381 (0.0007) [2023-12-26 11:10:57,902][123091] Updated weights for policy 0, policy_version 1451391 (0.0008) [2023-12-26 11:10:57,955][123091] Updated weights for policy 0, policy_version 1451401 (0.0010) [2023-12-26 11:10:58,096][123090] Updated weights for policy 1, policy_version 1441729 (0.0010) [2023-12-26 11:10:58,165][123090] Updated weights for policy 1, policy_version 1441739 (0.0009) [2023-12-26 11:10:58,224][123090] Updated weights for policy 1, policy_version 1441749 (0.0010) [2023-12-26 11:10:58,287][123090] Updated weights for policy 1, policy_version 1441759 (0.0008) [2023-12-26 11:10:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 740655104. Throughput: 0: 9065.5, 1: 8723.8. Samples: 740653024. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:10:58,785][121949] Avg episode reward: [(0, '5987.382'), (1, '5424.016')] [2023-12-26 11:10:58,874][123091] Updated weights for policy 0, policy_version 1451411 (0.0008) [2023-12-26 11:10:58,932][123091] Updated weights for policy 0, policy_version 1451421 (0.0006) [2023-12-26 11:10:59,004][123091] Updated weights for policy 0, policy_version 1451431 (0.0008) [2023-12-26 11:10:59,210][123090] Updated weights for policy 1, policy_version 1441769 (0.0010) [2023-12-26 11:10:59,275][123090] Updated weights for policy 1, policy_version 1441779 (0.0009) [2023-12-26 11:10:59,339][123090] Updated weights for policy 1, policy_version 1441789 (0.0009) [2023-12-26 11:10:59,735][123091] Updated weights for policy 0, policy_version 1451441 (0.0008) [2023-12-26 11:10:59,787][123091] Updated weights for policy 0, policy_version 1451451 (0.0006) [2023-12-26 11:10:59,857][123091] Updated weights for policy 0, policy_version 1451461 (0.0010) [2023-12-26 11:10:59,929][123091] Updated weights for policy 0, policy_version 1451471 (0.0008) [2023-12-26 11:11:00,139][123090] Updated weights for policy 1, policy_version 1441799 (0.0009) [2023-12-26 11:11:00,203][123090] Updated weights for policy 1, policy_version 1441809 (0.0009) [2023-12-26 11:11:00,264][123090] Updated weights for policy 1, policy_version 1441819 (0.0010) [2023-12-26 11:11:00,758][123091] Updated weights for policy 0, policy_version 1451481 (0.0009) [2023-12-26 11:11:00,822][123091] Updated weights for policy 0, policy_version 1451491 (0.0009) [2023-12-26 11:11:00,879][123091] Updated weights for policy 0, policy_version 1451501 (0.0009) [2023-12-26 11:11:01,091][123090] Updated weights for policy 1, policy_version 1441829 (0.0010) [2023-12-26 11:11:01,148][123090] Updated weights for policy 1, policy_version 1441839 (0.0008) [2023-12-26 11:11:01,221][123090] Updated weights for policy 1, policy_version 1441849 (0.0006) [2023-12-26 11:11:01,683][123091] Updated weights for policy 0, policy_version 1451511 (0.0007) [2023-12-26 11:11:01,756][123091] Updated weights for policy 0, policy_version 1451521 (0.0008) [2023-12-26 11:11:01,819][123091] Updated weights for policy 0, policy_version 1451531 (0.0011) [2023-12-26 11:11:01,945][123090] Updated weights for policy 1, policy_version 1441859 (0.0008) [2023-12-26 11:11:01,994][123090] Updated weights for policy 1, policy_version 1441869 (0.0009) [2023-12-26 11:11:02,043][123090] Updated weights for policy 1, policy_version 1441879 (0.0009) [2023-12-26 11:11:02,580][123091] Updated weights for policy 0, policy_version 1451541 (0.0006) [2023-12-26 11:11:02,627][123091] Updated weights for policy 0, policy_version 1451551 (0.0005) [2023-12-26 11:11:02,687][123091] Updated weights for policy 0, policy_version 1451561 (0.0005) [2023-12-26 11:11:02,947][123090] Updated weights for policy 1, policy_version 1441889 (0.0009) [2023-12-26 11:11:03,014][123090] Updated weights for policy 1, policy_version 1441899 (0.0011) [2023-12-26 11:11:03,071][123090] Updated weights for policy 1, policy_version 1441909 (0.0011) [2023-12-26 11:11:03,123][123090] Updated weights for policy 1, policy_version 1441919 (0.0006) [2023-12-26 11:11:03,448][123091] Updated weights for policy 0, policy_version 1451571 (0.0005) [2023-12-26 11:11:03,510][123091] Updated weights for policy 0, policy_version 1451581 (0.0010) [2023-12-26 11:11:03,564][123091] Updated weights for policy 0, policy_version 1451591 (0.0010) [2023-12-26 11:11:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 740745216. Throughput: 0: 9003.1, 1: 8704.2. Samples: 740756692. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:03,784][121949] Avg episode reward: [(0, '6086.909'), (1, '5589.304')] [2023-12-26 11:11:03,791][123090] Updated weights for policy 1, policy_version 1441929 (0.0010) [2023-12-26 11:11:03,850][123090] Updated weights for policy 1, policy_version 1441939 (0.0009) [2023-12-26 11:11:03,912][123090] Updated weights for policy 1, policy_version 1441949 (0.0010) [2023-12-26 11:11:04,423][123091] Updated weights for policy 0, policy_version 1451602 (0.0010) [2023-12-26 11:11:04,476][123091] Updated weights for policy 0, policy_version 1451612 (0.0009) [2023-12-26 11:11:04,529][123091] Updated weights for policy 0, policy_version 1451622 (0.0009) [2023-12-26 11:11:04,585][123091] Updated weights for policy 0, policy_version 1451632 (0.0009) [2023-12-26 11:11:04,754][123090] Updated weights for policy 1, policy_version 1441959 (0.0007) [2023-12-26 11:11:04,803][123090] Updated weights for policy 1, policy_version 1441969 (0.0005) [2023-12-26 11:11:04,853][123090] Updated weights for policy 1, policy_version 1441979 (0.0006) [2023-12-26 11:11:05,503][123091] Updated weights for policy 0, policy_version 1451642 (0.0009) [2023-12-26 11:11:05,557][123091] Updated weights for policy 0, policy_version 1451652 (0.0009) [2023-12-26 11:11:05,576][123090] Updated weights for policy 1, policy_version 1441989 (0.0006) [2023-12-26 11:11:05,606][123091] Updated weights for policy 0, policy_version 1451662 (0.0008) [2023-12-26 11:11:05,626][123090] Updated weights for policy 1, policy_version 1441999 (0.0005) [2023-12-26 11:11:05,686][123090] Updated weights for policy 1, policy_version 1442009 (0.0005) [2023-12-26 11:11:06,352][123091] Updated weights for policy 0, policy_version 1451672 (0.0007) [2023-12-26 11:11:06,365][123090] Updated weights for policy 1, policy_version 1442019 (0.0006) [2023-12-26 11:11:06,402][123091] Updated weights for policy 0, policy_version 1451682 (0.0007) [2023-12-26 11:11:06,417][123090] Updated weights for policy 1, policy_version 1442029 (0.0008) [2023-12-26 11:11:06,451][123091] Updated weights for policy 0, policy_version 1451692 (0.0006) [2023-12-26 11:11:06,478][123090] Updated weights for policy 1, policy_version 1442039 (0.0010) [2023-12-26 11:11:07,215][123090] Updated weights for policy 1, policy_version 1442049 (0.0010) [2023-12-26 11:11:07,281][123090] Updated weights for policy 1, policy_version 1442059 (0.0006) [2023-12-26 11:11:07,357][123090] Updated weights for policy 1, policy_version 1442069 (0.0005) [2023-12-26 11:11:07,375][123091] Updated weights for policy 0, policy_version 1451702 (0.0008) [2023-12-26 11:11:07,421][123090] Updated weights for policy 1, policy_version 1442079 (0.0005) [2023-12-26 11:11:07,425][123091] Updated weights for policy 0, policy_version 1451712 (0.0008) [2023-12-26 11:11:07,482][123091] Updated weights for policy 0, policy_version 1451722 (0.0006) [2023-12-26 11:11:08,108][123090] Updated weights for policy 1, policy_version 1442089 (0.0007) [2023-12-26 11:11:08,122][123091] Updated weights for policy 0, policy_version 1451732 (0.0005) [2023-12-26 11:11:08,179][123090] Updated weights for policy 1, policy_version 1442099 (0.0008) [2023-12-26 11:11:08,197][123091] Updated weights for policy 0, policy_version 1451742 (0.0005) [2023-12-26 11:11:08,250][123090] Updated weights for policy 1, policy_version 1442109 (0.0009) [2023-12-26 11:11:08,252][123091] Updated weights for policy 0, policy_version 1451752 (0.0010) [2023-12-26 11:11:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 740835328. Throughput: 0: 8978.4, 1: 8784.3. Samples: 740810756. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:08,785][121949] Avg episode reward: [(0, '6281.720'), (1, '5776.341')] [2023-12-26 11:11:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001451760_371654656.pth... [2023-12-26 11:11:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001442112_369180672.pth... [2023-12-26 11:11:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001450736_371392512.pth [2023-12-26 11:11:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001441088_368918528.pth [2023-12-26 11:11:08,892][123091] Updated weights for policy 0, policy_version 1451762 (0.0009) [2023-12-26 11:11:08,959][123091] Updated weights for policy 0, policy_version 1451772 (0.0007) [2023-12-26 11:11:08,989][123090] Updated weights for policy 1, policy_version 1442119 (0.0006) [2023-12-26 11:11:09,019][123091] Updated weights for policy 0, policy_version 1451782 (0.0011) [2023-12-26 11:11:09,043][123090] Updated weights for policy 1, policy_version 1442129 (0.0007) [2023-12-26 11:11:09,079][123091] Updated weights for policy 0, policy_version 1451792 (0.0011) [2023-12-26 11:11:09,101][123090] Updated weights for policy 1, policy_version 1442139 (0.0006) [2023-12-26 11:11:09,836][123091] Updated weights for policy 0, policy_version 1451803 (0.0010) [2023-12-26 11:11:09,904][123090] Updated weights for policy 1, policy_version 1442149 (0.0007) [2023-12-26 11:11:09,904][123091] Updated weights for policy 0, policy_version 1451813 (0.0009) [2023-12-26 11:11:09,973][123091] Updated weights for policy 0, policy_version 1451823 (0.0008) [2023-12-26 11:11:09,977][123090] Updated weights for policy 1, policy_version 1442159 (0.0008) [2023-12-26 11:11:10,051][123090] Updated weights for policy 1, policy_version 1442169 (0.0008) [2023-12-26 11:11:10,768][123090] Updated weights for policy 1, policy_version 1442179 (0.0006) [2023-12-26 11:11:10,827][123090] Updated weights for policy 1, policy_version 1442189 (0.0005) [2023-12-26 11:11:10,852][123091] Updated weights for policy 0, policy_version 1451833 (0.0005) [2023-12-26 11:11:10,878][123090] Updated weights for policy 1, policy_version 1442199 (0.0005) [2023-12-26 11:11:10,908][123091] Updated weights for policy 0, policy_version 1451843 (0.0005) [2023-12-26 11:11:10,964][123091] Updated weights for policy 0, policy_version 1451853 (0.0006) [2023-12-26 11:11:11,699][123090] Updated weights for policy 1, policy_version 1442209 (0.0005) [2023-12-26 11:11:11,773][123090] Updated weights for policy 1, policy_version 1442219 (0.0007) [2023-12-26 11:11:11,789][123091] Updated weights for policy 0, policy_version 1451863 (0.0009) [2023-12-26 11:11:11,836][123090] Updated weights for policy 1, policy_version 1442229 (0.0007) [2023-12-26 11:11:11,850][123091] Updated weights for policy 0, policy_version 1451873 (0.0008) [2023-12-26 11:11:11,899][123090] Updated weights for policy 1, policy_version 1442239 (0.0007) [2023-12-26 11:11:11,916][123091] Updated weights for policy 0, policy_version 1451883 (0.0006) [2023-12-26 11:11:12,672][123091] Updated weights for policy 0, policy_version 1451893 (0.0005) [2023-12-26 11:11:12,744][123091] Updated weights for policy 0, policy_version 1451903 (0.0007) [2023-12-26 11:11:12,745][123090] Updated weights for policy 1, policy_version 1442249 (0.0008) [2023-12-26 11:11:12,807][123090] Updated weights for policy 1, policy_version 1442259 (0.0006) [2023-12-26 11:11:12,816][123091] Updated weights for policy 0, policy_version 1451913 (0.0009) [2023-12-26 11:11:12,869][123090] Updated weights for policy 1, policy_version 1442269 (0.0007) [2023-12-26 11:11:13,357][123090] Updated weights for policy 1, policy_version 1442279 (0.0006) [2023-12-26 11:11:13,411][123090] Updated weights for policy 1, policy_version 1442289 (0.0005) [2023-12-26 11:11:13,468][123090] Updated weights for policy 1, policy_version 1442299 (0.0005) [2023-12-26 11:11:13,677][123091] Updated weights for policy 0, policy_version 1451923 (0.0009) [2023-12-26 11:11:13,739][123091] Updated weights for policy 0, policy_version 1451933 (0.0010) [2023-12-26 11:11:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 740925440. Throughput: 0: 8999.5, 1: 8840.4. Samples: 740920172. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:13,785][121949] Avg episode reward: [(0, '6069.221'), (1, '5661.229')] [2023-12-26 11:11:13,793][123091] Updated weights for policy 0, policy_version 1451944 (0.0011) [2023-12-26 11:11:14,129][123090] Updated weights for policy 1, policy_version 1442309 (0.0005) [2023-12-26 11:11:14,186][123090] Updated weights for policy 1, policy_version 1442319 (0.0009) [2023-12-26 11:11:14,235][123090] Updated weights for policy 1, policy_version 1442329 (0.0010) [2023-12-26 11:11:14,614][123091] Updated weights for policy 0, policy_version 1451954 (0.0010) [2023-12-26 11:11:14,671][123091] Updated weights for policy 0, policy_version 1451964 (0.0009) [2023-12-26 11:11:14,723][123091] Updated weights for policy 0, policy_version 1451974 (0.0009) [2023-12-26 11:11:14,776][123091] Updated weights for policy 0, policy_version 1451984 (0.0008) [2023-12-26 11:11:15,085][123090] Updated weights for policy 1, policy_version 1442339 (0.0011) [2023-12-26 11:11:15,149][123090] Updated weights for policy 1, policy_version 1442349 (0.0011) [2023-12-26 11:11:15,222][123090] Updated weights for policy 1, policy_version 1442359 (0.0011) [2023-12-26 11:11:15,629][123091] Updated weights for policy 0, policy_version 1451994 (0.0010) [2023-12-26 11:11:15,688][123091] Updated weights for policy 0, policy_version 1452004 (0.0009) [2023-12-26 11:11:15,753][123091] Updated weights for policy 0, policy_version 1452014 (0.0010) [2023-12-26 11:11:15,992][123090] Updated weights for policy 1, policy_version 1442369 (0.0010) [2023-12-26 11:11:16,051][123090] Updated weights for policy 1, policy_version 1442379 (0.0005) [2023-12-26 11:11:16,099][123090] Updated weights for policy 1, policy_version 1442389 (0.0007) [2023-12-26 11:11:16,148][123090] Updated weights for policy 1, policy_version 1442399 (0.0009) [2023-12-26 11:11:16,649][123091] Updated weights for policy 0, policy_version 1452024 (0.0010) [2023-12-26 11:11:16,712][123091] Updated weights for policy 0, policy_version 1452034 (0.0010) [2023-12-26 11:11:16,777][123091] Updated weights for policy 0, policy_version 1452044 (0.0009) [2023-12-26 11:11:16,834][123090] Updated weights for policy 1, policy_version 1442409 (0.0006) [2023-12-26 11:11:16,883][123090] Updated weights for policy 1, policy_version 1442419 (0.0005) [2023-12-26 11:11:16,933][123090] Updated weights for policy 1, policy_version 1442429 (0.0005) [2023-12-26 11:11:17,642][123091] Updated weights for policy 0, policy_version 1452054 (0.0008) [2023-12-26 11:11:17,661][123090] Updated weights for policy 1, policy_version 1442439 (0.0009) [2023-12-26 11:11:17,710][123091] Updated weights for policy 0, policy_version 1452064 (0.0005) [2023-12-26 11:11:17,724][123090] Updated weights for policy 1, policy_version 1442449 (0.0010) [2023-12-26 11:11:17,771][123091] Updated weights for policy 0, policy_version 1452074 (0.0005) [2023-12-26 11:11:17,779][123090] Updated weights for policy 1, policy_version 1442459 (0.0010) [2023-12-26 11:11:18,542][123091] Updated weights for policy 0, policy_version 1452084 (0.0005) [2023-12-26 11:11:18,592][123090] Updated weights for policy 1, policy_version 1442469 (0.0008) [2023-12-26 11:11:18,600][123091] Updated weights for policy 0, policy_version 1452094 (0.0005) [2023-12-26 11:11:18,662][123090] Updated weights for policy 1, policy_version 1442479 (0.0006) [2023-12-26 11:11:18,667][123091] Updated weights for policy 0, policy_version 1452104 (0.0007) [2023-12-26 11:11:18,722][123090] Updated weights for policy 1, policy_version 1442489 (0.0005) [2023-12-26 11:11:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 741023744. Throughput: 0: 8871.7, 1: 8931.1. Samples: 741027160. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:18,785][121949] Avg episode reward: [(0, '5907.335'), (1, '5591.584')] [2023-12-26 11:11:19,443][123090] Updated weights for policy 1, policy_version 1442499 (0.0006) [2023-12-26 11:11:19,519][123090] Updated weights for policy 1, policy_version 1442509 (0.0008) [2023-12-26 11:11:19,577][123091] Updated weights for policy 0, policy_version 1452114 (0.0010) [2023-12-26 11:11:19,580][123090] Updated weights for policy 1, policy_version 1442519 (0.0008) [2023-12-26 11:11:19,641][123091] Updated weights for policy 0, policy_version 1452124 (0.0010) [2023-12-26 11:11:19,701][123091] Updated weights for policy 0, policy_version 1452134 (0.0010) [2023-12-26 11:11:19,770][123091] Updated weights for policy 0, policy_version 1452144 (0.0010) [2023-12-26 11:11:20,314][123090] Updated weights for policy 1, policy_version 1442529 (0.0007) [2023-12-26 11:11:20,378][123090] Updated weights for policy 1, policy_version 1442539 (0.0009) [2023-12-26 11:11:20,453][123090] Updated weights for policy 1, policy_version 1442549 (0.0009) [2023-12-26 11:11:20,512][123090] Updated weights for policy 1, policy_version 1442559 (0.0010) [2023-12-26 11:11:20,573][123091] Updated weights for policy 0, policy_version 1452154 (0.0006) [2023-12-26 11:11:20,635][123091] Updated weights for policy 0, policy_version 1452164 (0.0008) [2023-12-26 11:11:20,698][123091] Updated weights for policy 0, policy_version 1452174 (0.0006) [2023-12-26 11:11:21,334][123090] Updated weights for policy 1, policy_version 1442569 (0.0009) [2023-12-26 11:11:21,400][123090] Updated weights for policy 1, policy_version 1442579 (0.0009) [2023-12-26 11:11:21,464][123090] Updated weights for policy 1, policy_version 1442589 (0.0010) [2023-12-26 11:11:21,507][123091] Updated weights for policy 0, policy_version 1452184 (0.0006) [2023-12-26 11:11:21,577][123091] Updated weights for policy 0, policy_version 1452194 (0.0007) [2023-12-26 11:11:21,644][123091] Updated weights for policy 0, policy_version 1452204 (0.0008) [2023-12-26 11:11:22,370][123090] Updated weights for policy 1, policy_version 1442599 (0.0010) [2023-12-26 11:11:22,418][123090] Updated weights for policy 1, policy_version 1442609 (0.0009) [2023-12-26 11:11:22,423][123091] Updated weights for policy 0, policy_version 1452214 (0.0009) [2023-12-26 11:11:22,476][123090] Updated weights for policy 1, policy_version 1442619 (0.0009) [2023-12-26 11:11:22,488][123091] Updated weights for policy 0, policy_version 1452224 (0.0009) [2023-12-26 11:11:22,554][123091] Updated weights for policy 0, policy_version 1452234 (0.0008) [2023-12-26 11:11:23,319][123090] Updated weights for policy 1, policy_version 1442629 (0.0007) [2023-12-26 11:11:23,353][123091] Updated weights for policy 0, policy_version 1452244 (0.0008) [2023-12-26 11:11:23,387][123090] Updated weights for policy 1, policy_version 1442639 (0.0005) [2023-12-26 11:11:23,411][123091] Updated weights for policy 0, policy_version 1452254 (0.0005) [2023-12-26 11:11:23,457][123090] Updated weights for policy 1, policy_version 1442649 (0.0005) [2023-12-26 11:11:23,465][123091] Updated weights for policy 0, policy_version 1452264 (0.0005) [2023-12-26 11:11:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 741105664. Throughput: 0: 8760.1, 1: 8976.8. Samples: 741079176. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:23,785][121949] Avg episode reward: [(0, '6135.716'), (1, '5554.783')] [2023-12-26 11:11:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001452272_371785728.pth... [2023-12-26 11:11:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001442656_369319936.pth... [2023-12-26 11:11:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001451248_371523584.pth [2023-12-26 11:11:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001441600_369049600.pth [2023-12-26 11:11:24,074][123090] Updated weights for policy 1, policy_version 1442659 (0.0005) [2023-12-26 11:11:24,143][123090] Updated weights for policy 1, policy_version 1442669 (0.0006) [2023-12-26 11:11:24,207][123090] Updated weights for policy 1, policy_version 1442679 (0.0011) [2023-12-26 11:11:24,251][123091] Updated weights for policy 0, policy_version 1452274 (0.0007) [2023-12-26 11:11:24,310][123091] Updated weights for policy 0, policy_version 1452284 (0.0009) [2023-12-26 11:11:24,367][123091] Updated weights for policy 0, policy_version 1452294 (0.0009) [2023-12-26 11:11:24,416][123091] Updated weights for policy 0, policy_version 1452304 (0.0009) [2023-12-26 11:11:24,981][123090] Updated weights for policy 1, policy_version 1442689 (0.0010) [2023-12-26 11:11:25,048][123090] Updated weights for policy 1, policy_version 1442699 (0.0010) [2023-12-26 11:11:25,127][123090] Updated weights for policy 1, policy_version 1442709 (0.0011) [2023-12-26 11:11:25,195][123090] Updated weights for policy 1, policy_version 1442719 (0.0011) [2023-12-26 11:11:25,235][123091] Updated weights for policy 0, policy_version 1452314 (0.0008) [2023-12-26 11:11:25,283][123091] Updated weights for policy 0, policy_version 1452324 (0.0008) [2023-12-26 11:11:25,334][123091] Updated weights for policy 0, policy_version 1452334 (0.0008) [2023-12-26 11:11:25,923][123090] Updated weights for policy 1, policy_version 1442729 (0.0008) [2023-12-26 11:11:25,970][123090] Updated weights for policy 1, policy_version 1442739 (0.0009) [2023-12-26 11:11:26,018][123090] Updated weights for policy 1, policy_version 1442750 (0.0010) [2023-12-26 11:11:26,216][123091] Updated weights for policy 0, policy_version 1452344 (0.0009) [2023-12-26 11:11:26,265][123091] Updated weights for policy 0, policy_version 1452354 (0.0009) [2023-12-26 11:11:26,317][123091] Updated weights for policy 0, policy_version 1452364 (0.0010) [2023-12-26 11:11:26,757][123090] Updated weights for policy 1, policy_version 1442760 (0.0005) [2023-12-26 11:11:26,805][123090] Updated weights for policy 1, policy_version 1442770 (0.0005) [2023-12-26 11:11:26,850][123090] Updated weights for policy 1, policy_version 1442780 (0.0005) [2023-12-26 11:11:27,191][123091] Updated weights for policy 0, policy_version 1452374 (0.0007) [2023-12-26 11:11:27,246][123091] Updated weights for policy 0, policy_version 1452384 (0.0006) [2023-12-26 11:11:27,300][123091] Updated weights for policy 0, policy_version 1452394 (0.0005) [2023-12-26 11:11:27,650][123090] Updated weights for policy 1, policy_version 1442790 (0.0008) [2023-12-26 11:11:27,705][123090] Updated weights for policy 1, policy_version 1442801 (0.0008) [2023-12-26 11:11:27,756][123090] Updated weights for policy 1, policy_version 1442811 (0.0005) [2023-12-26 11:11:28,046][123091] Updated weights for policy 0, policy_version 1452404 (0.0007) [2023-12-26 11:11:28,094][123091] Updated weights for policy 0, policy_version 1452414 (0.0007) [2023-12-26 11:11:28,150][123091] Updated weights for policy 0, policy_version 1452424 (0.0009) [2023-12-26 11:11:28,384][123090] Updated weights for policy 1, policy_version 1442821 (0.0007) [2023-12-26 11:11:28,459][123090] Updated weights for policy 1, policy_version 1442831 (0.0010) [2023-12-26 11:11:28,526][123090] Updated weights for policy 1, policy_version 1442841 (0.0009) [2023-12-26 11:11:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 741195776. Throughput: 0: 8817.0, 1: 9076.7. Samples: 741186816. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:28,785][121949] Avg episode reward: [(0, '6237.744'), (1, '5607.048')] [2023-12-26 11:11:29,005][123091] Updated weights for policy 0, policy_version 1452434 (0.0009) [2023-12-26 11:11:29,065][123091] Updated weights for policy 0, policy_version 1452444 (0.0009) [2023-12-26 11:11:29,113][123091] Updated weights for policy 0, policy_version 1452454 (0.0009) [2023-12-26 11:11:29,176][123091] Updated weights for policy 0, policy_version 1452464 (0.0010) [2023-12-26 11:11:29,339][123090] Updated weights for policy 1, policy_version 1442851 (0.0008) [2023-12-26 11:11:29,399][123090] Updated weights for policy 1, policy_version 1442861 (0.0008) [2023-12-26 11:11:29,454][123090] Updated weights for policy 1, policy_version 1442871 (0.0008) [2023-12-26 11:11:30,023][123091] Updated weights for policy 0, policy_version 1452474 (0.0011) [2023-12-26 11:11:30,091][123091] Updated weights for policy 0, policy_version 1452484 (0.0011) [2023-12-26 11:11:30,154][123091] Updated weights for policy 0, policy_version 1452494 (0.0011) [2023-12-26 11:11:30,293][123090] Updated weights for policy 1, policy_version 1442881 (0.0009) [2023-12-26 11:11:30,352][123090] Updated weights for policy 1, policy_version 1442891 (0.0010) [2023-12-26 11:11:30,403][123090] Updated weights for policy 1, policy_version 1442901 (0.0010) [2023-12-26 11:11:30,451][123090] Updated weights for policy 1, policy_version 1442911 (0.0010) [2023-12-26 11:11:30,892][123091] Updated weights for policy 0, policy_version 1452504 (0.0011) [2023-12-26 11:11:30,949][123091] Updated weights for policy 0, policy_version 1452514 (0.0006) [2023-12-26 11:11:31,022][123091] Updated weights for policy 0, policy_version 1452524 (0.0006) [2023-12-26 11:11:31,245][123090] Updated weights for policy 1, policy_version 1442921 (0.0011) [2023-12-26 11:11:31,313][123090] Updated weights for policy 1, policy_version 1442931 (0.0011) [2023-12-26 11:11:31,386][123090] Updated weights for policy 1, policy_version 1442941 (0.0013) [2023-12-26 11:11:31,804][123091] Updated weights for policy 0, policy_version 1452534 (0.0011) [2023-12-26 11:11:31,855][123091] Updated weights for policy 0, policy_version 1452544 (0.0010) [2023-12-26 11:11:31,903][123091] Updated weights for policy 0, policy_version 1452554 (0.0010) [2023-12-26 11:11:32,094][123090] Updated weights for policy 1, policy_version 1442951 (0.0006) [2023-12-26 11:11:32,157][123090] Updated weights for policy 1, policy_version 1442961 (0.0005) [2023-12-26 11:11:32,222][123090] Updated weights for policy 1, policy_version 1442971 (0.0006) [2023-12-26 11:11:32,794][123091] Updated weights for policy 0, policy_version 1452564 (0.0010) [2023-12-26 11:11:32,852][123091] Updated weights for policy 0, policy_version 1452574 (0.0010) [2023-12-26 11:11:32,910][123091] Updated weights for policy 0, policy_version 1452584 (0.0010) [2023-12-26 11:11:32,958][123090] Updated weights for policy 1, policy_version 1442981 (0.0008) [2023-12-26 11:11:33,012][123090] Updated weights for policy 1, policy_version 1442991 (0.0010) [2023-12-26 11:11:33,071][123090] Updated weights for policy 1, policy_version 1443001 (0.0010) [2023-12-26 11:11:33,593][123091] Updated weights for policy 0, policy_version 1452594 (0.0008) [2023-12-26 11:11:33,646][123091] Updated weights for policy 0, policy_version 1452604 (0.0005) [2023-12-26 11:11:33,694][123091] Updated weights for policy 0, policy_version 1452614 (0.0005) [2023-12-26 11:11:33,765][123091] Updated weights for policy 0, policy_version 1452624 (0.0005) [2023-12-26 11:11:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 741285888. Throughput: 0: 8836.6, 1: 9078.4. Samples: 741295476. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:33,785][121949] Avg episode reward: [(0, '6278.572'), (1, '5713.991')] [2023-12-26 11:11:33,850][123090] Updated weights for policy 1, policy_version 1443011 (0.0009) [2023-12-26 11:11:33,922][123090] Updated weights for policy 1, policy_version 1443021 (0.0008) [2023-12-26 11:11:33,997][123090] Updated weights for policy 1, policy_version 1443031 (0.0010) [2023-12-26 11:11:34,471][123091] Updated weights for policy 0, policy_version 1452634 (0.0006) [2023-12-26 11:11:34,541][123091] Updated weights for policy 0, policy_version 1452644 (0.0006) [2023-12-26 11:11:34,612][123091] Updated weights for policy 0, policy_version 1452654 (0.0006) [2023-12-26 11:11:34,905][123090] Updated weights for policy 1, policy_version 1443041 (0.0010) [2023-12-26 11:11:34,964][123090] Updated weights for policy 1, policy_version 1443051 (0.0010) [2023-12-26 11:11:35,017][123090] Updated weights for policy 1, policy_version 1443061 (0.0010) [2023-12-26 11:11:35,079][123090] Updated weights for policy 1, policy_version 1443071 (0.0011) [2023-12-26 11:11:35,195][123091] Updated weights for policy 0, policy_version 1452664 (0.0007) [2023-12-26 11:11:35,259][123091] Updated weights for policy 0, policy_version 1452674 (0.0006) [2023-12-26 11:11:35,316][123091] Updated weights for policy 0, policy_version 1452684 (0.0006) [2023-12-26 11:11:35,868][123090] Updated weights for policy 1, policy_version 1443081 (0.0010) [2023-12-26 11:11:35,928][123090] Updated weights for policy 1, policy_version 1443091 (0.0007) [2023-12-26 11:11:35,978][123090] Updated weights for policy 1, policy_version 1443101 (0.0005) [2023-12-26 11:11:36,067][123091] Updated weights for policy 0, policy_version 1452694 (0.0005) [2023-12-26 11:11:36,123][123091] Updated weights for policy 0, policy_version 1452704 (0.0006) [2023-12-26 11:11:36,195][123091] Updated weights for policy 0, policy_version 1452714 (0.0006) [2023-12-26 11:11:36,695][123090] Updated weights for policy 1, policy_version 1443111 (0.0009) [2023-12-26 11:11:36,770][123090] Updated weights for policy 1, policy_version 1443121 (0.0011) [2023-12-26 11:11:36,833][123090] Updated weights for policy 1, policy_version 1443131 (0.0010) [2023-12-26 11:11:36,983][123091] Updated weights for policy 0, policy_version 1452724 (0.0010) [2023-12-26 11:11:37,040][123091] Updated weights for policy 0, policy_version 1452734 (0.0009) [2023-12-26 11:11:37,088][123091] Updated weights for policy 0, policy_version 1452744 (0.0009) [2023-12-26 11:11:37,567][123090] Updated weights for policy 1, policy_version 1443141 (0.0008) [2023-12-26 11:11:37,625][123090] Updated weights for policy 1, policy_version 1443151 (0.0005) [2023-12-26 11:11:37,680][123090] Updated weights for policy 1, policy_version 1443161 (0.0005) [2023-12-26 11:11:37,736][123091] Updated weights for policy 0, policy_version 1452754 (0.0009) [2023-12-26 11:11:37,797][123091] Updated weights for policy 0, policy_version 1452764 (0.0010) [2023-12-26 11:11:37,856][123091] Updated weights for policy 0, policy_version 1452774 (0.0010) [2023-12-26 11:11:37,918][123091] Updated weights for policy 0, policy_version 1452784 (0.0009) [2023-12-26 11:11:38,318][123090] Updated weights for policy 1, policy_version 1443171 (0.0006) [2023-12-26 11:11:38,372][123090] Updated weights for policy 1, policy_version 1443181 (0.0008) [2023-12-26 11:11:38,419][123090] Updated weights for policy 1, policy_version 1443191 (0.0006) [2023-12-26 11:11:38,757][123091] Updated weights for policy 0, policy_version 1452794 (0.0009) [2023-12-26 11:11:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 741376000. Throughput: 0: 8891.8, 1: 9051.8. Samples: 741351168. Policy #0 lag: (min: 2.0, avg: 7.8, max: 34.0) [2023-12-26 11:11:38,785][121949] Avg episode reward: [(0, '6197.511'), (1, '5772.428')] [2023-12-26 11:11:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001443200_369459200.pth... [2023-12-26 11:11:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001442112_369180672.pth [2023-12-26 11:11:38,812][123091] Updated weights for policy 0, policy_version 1452804 (0.0009) [2023-12-26 11:11:38,861][123091] Updated weights for policy 0, policy_version 1452814 (0.0009) [2023-12-26 11:11:38,873][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001452816_371924992.pth... [2023-12-26 11:11:38,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001451760_371654656.pth [2023-12-26 11:11:39,235][123090] Updated weights for policy 1, policy_version 1443201 (0.0006) [2023-12-26 11:11:39,305][123090] Updated weights for policy 1, policy_version 1443211 (0.0008) [2023-12-26 11:11:39,376][123090] Updated weights for policy 1, policy_version 1443221 (0.0009) [2023-12-26 11:11:39,449][123090] Updated weights for policy 1, policy_version 1443231 (0.0012) [2023-12-26 11:11:39,724][123091] Updated weights for policy 0, policy_version 1452824 (0.0009) [2023-12-26 11:11:39,775][123091] Updated weights for policy 0, policy_version 1452834 (0.0009) [2023-12-26 11:11:39,835][123091] Updated weights for policy 0, policy_version 1452844 (0.0010) [2023-12-26 11:11:40,200][123090] Updated weights for policy 1, policy_version 1443241 (0.0009) [2023-12-26 11:11:40,266][123090] Updated weights for policy 1, policy_version 1443251 (0.0009) [2023-12-26 11:11:40,332][123090] Updated weights for policy 1, policy_version 1443261 (0.0010) [2023-12-26 11:11:40,693][123091] Updated weights for policy 0, policy_version 1452854 (0.0007) [2023-12-26 11:11:40,748][123091] Updated weights for policy 0, policy_version 1452864 (0.0009) [2023-12-26 11:11:40,801][123091] Updated weights for policy 0, policy_version 1452874 (0.0009) [2023-12-26 11:11:41,111][123090] Updated weights for policy 1, policy_version 1443271 (0.0010) [2023-12-26 11:11:41,180][123090] Updated weights for policy 1, policy_version 1443281 (0.0010) [2023-12-26 11:11:41,246][123090] Updated weights for policy 1, policy_version 1443291 (0.0009) [2023-12-26 11:11:41,712][123091] Updated weights for policy 0, policy_version 1452884 (0.0008) [2023-12-26 11:11:41,781][123091] Updated weights for policy 0, policy_version 1452894 (0.0009) [2023-12-26 11:11:41,842][123091] Updated weights for policy 0, policy_version 1452904 (0.0005) [2023-12-26 11:11:42,122][123090] Updated weights for policy 1, policy_version 1443301 (0.0010) [2023-12-26 11:11:42,181][123090] Updated weights for policy 1, policy_version 1443311 (0.0009) [2023-12-26 11:11:42,249][123090] Updated weights for policy 1, policy_version 1443321 (0.0010) [2023-12-26 11:11:42,631][123091] Updated weights for policy 0, policy_version 1452914 (0.0008) [2023-12-26 11:11:42,693][123091] Updated weights for policy 0, policy_version 1452924 (0.0010) [2023-12-26 11:11:42,745][123091] Updated weights for policy 0, policy_version 1452934 (0.0009) [2023-12-26 11:11:42,810][123091] Updated weights for policy 0, policy_version 1452944 (0.0007) [2023-12-26 11:11:43,004][123090] Updated weights for policy 1, policy_version 1443331 (0.0009) [2023-12-26 11:11:43,061][123090] Updated weights for policy 1, policy_version 1443341 (0.0005) [2023-12-26 11:11:43,108][123090] Updated weights for policy 1, policy_version 1443351 (0.0005) [2023-12-26 11:11:43,489][123091] Updated weights for policy 0, policy_version 1452954 (0.0005) [2023-12-26 11:11:43,558][123091] Updated weights for policy 0, policy_version 1452964 (0.0009) [2023-12-26 11:11:43,629][123091] Updated weights for policy 0, policy_version 1452974 (0.0011) [2023-12-26 11:11:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 741466112. Throughput: 0: 8769.3, 1: 9096.4. Samples: 741456980. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:11:43,785][121949] Avg episode reward: [(0, '6260.670'), (1, '5775.690')] [2023-12-26 11:11:43,808][123090] Updated weights for policy 1, policy_version 1443361 (0.0006) [2023-12-26 11:11:43,881][123090] Updated weights for policy 1, policy_version 1443371 (0.0006) [2023-12-26 11:11:43,928][123090] Updated weights for policy 1, policy_version 1443381 (0.0010) [2023-12-26 11:11:43,976][123090] Updated weights for policy 1, policy_version 1443391 (0.0010) [2023-12-26 11:11:44,411][123091] Updated weights for policy 0, policy_version 1452984 (0.0011) [2023-12-26 11:11:44,471][123091] Updated weights for policy 0, policy_version 1452994 (0.0010) [2023-12-26 11:11:44,523][123091] Updated weights for policy 0, policy_version 1453004 (0.0010) [2023-12-26 11:11:44,790][123090] Updated weights for policy 1, policy_version 1443401 (0.0010) [2023-12-26 11:11:44,857][123090] Updated weights for policy 1, policy_version 1443411 (0.0010) [2023-12-26 11:11:44,933][123090] Updated weights for policy 1, policy_version 1443421 (0.0011) [2023-12-26 11:11:45,357][123091] Updated weights for policy 0, policy_version 1453014 (0.0008) [2023-12-26 11:11:45,433][123091] Updated weights for policy 0, policy_version 1453024 (0.0009) [2023-12-26 11:11:45,493][123091] Updated weights for policy 0, policy_version 1453034 (0.0011) [2023-12-26 11:11:45,641][123090] Updated weights for policy 1, policy_version 1443431 (0.0007) [2023-12-26 11:11:45,696][123090] Updated weights for policy 1, policy_version 1443441 (0.0005) [2023-12-26 11:11:45,753][123090] Updated weights for policy 1, policy_version 1443451 (0.0005) [2023-12-26 11:11:46,316][123091] Updated weights for policy 0, policy_version 1453044 (0.0010) [2023-12-26 11:11:46,378][123091] Updated weights for policy 0, policy_version 1453054 (0.0011) [2023-12-26 11:11:46,446][123091] Updated weights for policy 0, policy_version 1453064 (0.0009) [2023-12-26 11:11:46,505][123090] Updated weights for policy 1, policy_version 1443461 (0.0008) [2023-12-26 11:11:46,574][123090] Updated weights for policy 1, policy_version 1443471 (0.0011) [2023-12-26 11:11:46,644][123090] Updated weights for policy 1, policy_version 1443481 (0.0010) [2023-12-26 11:11:47,219][123091] Updated weights for policy 0, policy_version 1453074 (0.0009) [2023-12-26 11:11:47,265][123091] Updated weights for policy 0, policy_version 1453084 (0.0005) [2023-12-26 11:11:47,314][123091] Updated weights for policy 0, policy_version 1453094 (0.0005) [2023-12-26 11:11:47,368][123091] Updated weights for policy 0, policy_version 1453104 (0.0005) [2023-12-26 11:11:47,404][123090] Updated weights for policy 1, policy_version 1443491 (0.0009) [2023-12-26 11:11:47,468][123090] Updated weights for policy 1, policy_version 1443501 (0.0005) [2023-12-26 11:11:47,531][123090] Updated weights for policy 1, policy_version 1443511 (0.0009) [2023-12-26 11:11:48,150][123091] Updated weights for policy 0, policy_version 1453114 (0.0009) [2023-12-26 11:11:48,220][123091] Updated weights for policy 0, policy_version 1453124 (0.0009) [2023-12-26 11:11:48,220][123090] Updated weights for policy 1, policy_version 1443521 (0.0010) [2023-12-26 11:11:48,282][123091] Updated weights for policy 0, policy_version 1453134 (0.0007) [2023-12-26 11:11:48,285][123090] Updated weights for policy 1, policy_version 1443531 (0.0008) [2023-12-26 11:11:48,354][123090] Updated weights for policy 1, policy_version 1443541 (0.0009) [2023-12-26 11:11:48,421][123090] Updated weights for policy 1, policy_version 1443551 (0.0010) [2023-12-26 11:11:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 741556224. Throughput: 0: 8798.1, 1: 9211.6. Samples: 741567132. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:11:48,785][121949] Avg episode reward: [(0, '6311.531'), (1, '5590.146')] [2023-12-26 11:11:49,134][123091] Updated weights for policy 0, policy_version 1453144 (0.0010) [2023-12-26 11:11:49,199][123090] Updated weights for policy 1, policy_version 1443561 (0.0007) [2023-12-26 11:11:49,201][123091] Updated weights for policy 0, policy_version 1453154 (0.0009) [2023-12-26 11:11:49,270][123091] Updated weights for policy 0, policy_version 1453164 (0.0008) [2023-12-26 11:11:49,273][123090] Updated weights for policy 1, policy_version 1443571 (0.0009) [2023-12-26 11:11:49,348][123090] Updated weights for policy 1, policy_version 1443581 (0.0009) [2023-12-26 11:11:50,129][123090] Updated weights for policy 1, policy_version 1443591 (0.0009) [2023-12-26 11:11:50,135][123091] Updated weights for policy 0, policy_version 1453174 (0.0007) [2023-12-26 11:11:50,186][123090] Updated weights for policy 1, policy_version 1443601 (0.0008) [2023-12-26 11:11:50,201][123091] Updated weights for policy 0, policy_version 1453184 (0.0008) [2023-12-26 11:11:50,252][123090] Updated weights for policy 1, policy_version 1443611 (0.0007) [2023-12-26 11:11:50,270][123091] Updated weights for policy 0, policy_version 1453194 (0.0008) [2023-12-26 11:11:51,068][123091] Updated weights for policy 0, policy_version 1453204 (0.0008) [2023-12-26 11:11:51,076][123090] Updated weights for policy 1, policy_version 1443621 (0.0008) [2023-12-26 11:11:51,132][123091] Updated weights for policy 0, policy_version 1453214 (0.0008) [2023-12-26 11:11:51,145][123090] Updated weights for policy 1, policy_version 1443631 (0.0007) [2023-12-26 11:11:51,190][123091] Updated weights for policy 0, policy_version 1453224 (0.0009) [2023-12-26 11:11:51,201][123090] Updated weights for policy 1, policy_version 1443641 (0.0008) [2023-12-26 11:11:51,964][123090] Updated weights for policy 1, policy_version 1443651 (0.0007) [2023-12-26 11:11:52,022][123090] Updated weights for policy 1, policy_version 1443661 (0.0005) [2023-12-26 11:11:52,045][123091] Updated weights for policy 0, policy_version 1453234 (0.0009) [2023-12-26 11:11:52,080][123090] Updated weights for policy 1, policy_version 1443671 (0.0007) [2023-12-26 11:11:52,110][123091] Updated weights for policy 0, policy_version 1453244 (0.0009) [2023-12-26 11:11:52,176][123091] Updated weights for policy 0, policy_version 1453254 (0.0007) [2023-12-26 11:11:52,246][123091] Updated weights for policy 0, policy_version 1453264 (0.0009) [2023-12-26 11:11:52,879][123090] Updated weights for policy 1, policy_version 1443681 (0.0007) [2023-12-26 11:11:52,938][123090] Updated weights for policy 1, policy_version 1443691 (0.0005) [2023-12-26 11:11:53,004][123090] Updated weights for policy 1, policy_version 1443701 (0.0005) [2023-12-26 11:11:53,056][123090] Updated weights for policy 1, policy_version 1443711 (0.0005) [2023-12-26 11:11:53,067][123091] Updated weights for policy 0, policy_version 1453274 (0.0010) [2023-12-26 11:11:53,120][123091] Updated weights for policy 0, policy_version 1453285 (0.0010) [2023-12-26 11:11:53,181][123091] Updated weights for policy 0, policy_version 1453295 (0.0010) [2023-12-26 11:11:53,776][123090] Updated weights for policy 1, policy_version 1443721 (0.0009) [2023-12-26 11:11:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 741638144. Throughput: 0: 8787.7, 1: 9172.7. Samples: 741618976. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:11:53,785][121949] Avg episode reward: [(0, '6269.256'), (1, '5462.788')] [2023-12-26 11:11:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001453296_372047872.pth... [2023-12-26 11:11:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001452272_371785728.pth [2023-12-26 11:11:53,843][123090] Updated weights for policy 1, policy_version 1443731 (0.0009) [2023-12-26 11:11:53,898][123090] Updated weights for policy 1, policy_version 1443741 (0.0009) [2023-12-26 11:11:53,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001443744_369598464.pth... [2023-12-26 11:11:53,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001442656_369319936.pth [2023-12-26 11:11:54,061][123091] Updated weights for policy 0, policy_version 1453305 (0.0010) [2023-12-26 11:11:54,125][123091] Updated weights for policy 0, policy_version 1453315 (0.0009) [2023-12-26 11:11:54,184][123091] Updated weights for policy 0, policy_version 1453325 (0.0009) [2023-12-26 11:11:54,730][123090] Updated weights for policy 1, policy_version 1443751 (0.0009) [2023-12-26 11:11:54,790][123090] Updated weights for policy 1, policy_version 1443761 (0.0008) [2023-12-26 11:11:54,842][123090] Updated weights for policy 1, policy_version 1443771 (0.0008) [2023-12-26 11:11:54,985][123091] Updated weights for policy 0, policy_version 1453335 (0.0009) [2023-12-26 11:11:55,042][123091] Updated weights for policy 0, policy_version 1453345 (0.0009) [2023-12-26 11:11:55,095][123091] Updated weights for policy 0, policy_version 1453355 (0.0008) [2023-12-26 11:11:55,531][123090] Updated weights for policy 1, policy_version 1443781 (0.0007) [2023-12-26 11:11:55,601][123090] Updated weights for policy 1, policy_version 1443791 (0.0008) [2023-12-26 11:11:55,676][123090] Updated weights for policy 1, policy_version 1443801 (0.0006) [2023-12-26 11:11:55,960][123091] Updated weights for policy 0, policy_version 1453365 (0.0009) [2023-12-26 11:11:56,025][123091] Updated weights for policy 0, policy_version 1453375 (0.0010) [2023-12-26 11:11:56,095][123091] Updated weights for policy 0, policy_version 1453385 (0.0010) [2023-12-26 11:11:56,361][123090] Updated weights for policy 1, policy_version 1443811 (0.0006) [2023-12-26 11:11:56,414][123090] Updated weights for policy 1, policy_version 1443821 (0.0005) [2023-12-26 11:11:56,466][123090] Updated weights for policy 1, policy_version 1443831 (0.0005) [2023-12-26 11:11:56,982][123091] Updated weights for policy 0, policy_version 1453395 (0.0009) [2023-12-26 11:11:57,038][123091] Updated weights for policy 0, policy_version 1453405 (0.0009) [2023-12-26 11:11:57,090][123091] Updated weights for policy 0, policy_version 1453415 (0.0009) [2023-12-26 11:11:57,132][123090] Updated weights for policy 1, policy_version 1443841 (0.0005) [2023-12-26 11:11:57,195][123090] Updated weights for policy 1, policy_version 1443851 (0.0006) [2023-12-26 11:11:57,254][123090] Updated weights for policy 1, policy_version 1443861 (0.0005) [2023-12-26 11:11:57,323][123090] Updated weights for policy 1, policy_version 1443871 (0.0006) [2023-12-26 11:11:57,962][123090] Updated weights for policy 1, policy_version 1443881 (0.0005) [2023-12-26 11:11:57,981][123091] Updated weights for policy 0, policy_version 1453425 (0.0009) [2023-12-26 11:11:58,025][123090] Updated weights for policy 1, policy_version 1443891 (0.0007) [2023-12-26 11:11:58,045][123091] Updated weights for policy 0, policy_version 1453435 (0.0009) [2023-12-26 11:11:58,094][123090] Updated weights for policy 1, policy_version 1443901 (0.0007) [2023-12-26 11:11:58,104][123091] Updated weights for policy 0, policy_version 1453445 (0.0008) [2023-12-26 11:11:58,169][123091] Updated weights for policy 0, policy_version 1453455 (0.0008) [2023-12-26 11:11:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 741728256. Throughput: 0: 8703.9, 1: 9203.4. Samples: 741726000. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:11:58,785][121949] Avg episode reward: [(0, '6220.263'), (1, '5657.036')] [2023-12-26 11:11:58,898][123090] Updated weights for policy 1, policy_version 1443911 (0.0009) [2023-12-26 11:11:58,965][123090] Updated weights for policy 1, policy_version 1443921 (0.0010) [2023-12-26 11:11:59,041][123090] Updated weights for policy 1, policy_version 1443931 (0.0007) [2023-12-26 11:11:59,074][123091] Updated weights for policy 0, policy_version 1453465 (0.0009) [2023-12-26 11:11:59,138][123091] Updated weights for policy 0, policy_version 1453475 (0.0009) [2023-12-26 11:11:59,203][123091] Updated weights for policy 0, policy_version 1453485 (0.0009) [2023-12-26 11:11:59,888][123090] Updated weights for policy 1, policy_version 1443941 (0.0008) [2023-12-26 11:11:59,956][123090] Updated weights for policy 1, policy_version 1443951 (0.0009) [2023-12-26 11:11:59,962][123091] Updated weights for policy 0, policy_version 1453495 (0.0009) [2023-12-26 11:12:00,013][123091] Updated weights for policy 0, policy_version 1453505 (0.0009) [2023-12-26 11:12:00,015][123090] Updated weights for policy 1, policy_version 1443961 (0.0007) [2023-12-26 11:12:00,067][123091] Updated weights for policy 0, policy_version 1453515 (0.0009) [2023-12-26 11:12:00,802][123090] Updated weights for policy 1, policy_version 1443971 (0.0007) [2023-12-26 11:12:00,859][123091] Updated weights for policy 0, policy_version 1453525 (0.0007) [2023-12-26 11:12:00,859][123090] Updated weights for policy 1, policy_version 1443981 (0.0006) [2023-12-26 11:12:00,924][123091] Updated weights for policy 0, policy_version 1453535 (0.0005) [2023-12-26 11:12:00,934][123090] Updated weights for policy 1, policy_version 1443991 (0.0005) [2023-12-26 11:12:00,977][123091] Updated weights for policy 0, policy_version 1453546 (0.0009) [2023-12-26 11:12:01,618][123090] Updated weights for policy 1, policy_version 1444001 (0.0005) [2023-12-26 11:12:01,690][123090] Updated weights for policy 1, policy_version 1444011 (0.0009) [2023-12-26 11:12:01,759][123090] Updated weights for policy 1, policy_version 1444021 (0.0009) [2023-12-26 11:12:01,813][123090] Updated weights for policy 1, policy_version 1444031 (0.0009) [2023-12-26 11:12:01,901][123091] Updated weights for policy 0, policy_version 1453557 (0.0008) [2023-12-26 11:12:01,956][123091] Updated weights for policy 0, policy_version 1453567 (0.0005) [2023-12-26 11:12:02,012][123091] Updated weights for policy 0, policy_version 1453577 (0.0006) [2023-12-26 11:12:02,642][123090] Updated weights for policy 1, policy_version 1444041 (0.0010) [2023-12-26 11:12:02,708][123090] Updated weights for policy 1, policy_version 1444051 (0.0010) [2023-12-26 11:12:02,715][123091] Updated weights for policy 0, policy_version 1453587 (0.0006) [2023-12-26 11:12:02,765][123091] Updated weights for policy 0, policy_version 1453597 (0.0005) [2023-12-26 11:12:02,771][123090] Updated weights for policy 1, policy_version 1444061 (0.0010) [2023-12-26 11:12:02,813][123091] Updated weights for policy 0, policy_version 1453607 (0.0005) [2023-12-26 11:12:03,529][123091] Updated weights for policy 0, policy_version 1453617 (0.0007) [2023-12-26 11:12:03,570][123090] Updated weights for policy 1, policy_version 1444071 (0.0007) [2023-12-26 11:12:03,590][123091] Updated weights for policy 0, policy_version 1453627 (0.0010) [2023-12-26 11:12:03,622][123090] Updated weights for policy 1, policy_version 1444081 (0.0009) [2023-12-26 11:12:03,645][123091] Updated weights for policy 0, policy_version 1453637 (0.0010) [2023-12-26 11:12:03,677][123090] Updated weights for policy 1, policy_version 1444091 (0.0010) [2023-12-26 11:12:03,706][123091] Updated weights for policy 0, policy_version 1453647 (0.0010) [2023-12-26 11:12:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 741826560. Throughput: 0: 8762.6, 1: 9120.8. Samples: 741831916. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:03,785][121949] Avg episode reward: [(0, '6206.837'), (1, '5581.452')] [2023-12-26 11:12:04,506][123090] Updated weights for policy 1, policy_version 1444101 (0.0010) [2023-12-26 11:12:04,521][123091] Updated weights for policy 0, policy_version 1453657 (0.0008) [2023-12-26 11:12:04,560][123090] Updated weights for policy 1, policy_version 1444111 (0.0010) [2023-12-26 11:12:04,568][123091] Updated weights for policy 0, policy_version 1453667 (0.0008) [2023-12-26 11:12:04,619][123090] Updated weights for policy 1, policy_version 1444121 (0.0007) [2023-12-26 11:12:04,628][123091] Updated weights for policy 0, policy_version 1453677 (0.0008) [2023-12-26 11:12:05,335][123090] Updated weights for policy 1, policy_version 1444131 (0.0006) [2023-12-26 11:12:05,398][123090] Updated weights for policy 1, policy_version 1444141 (0.0007) [2023-12-26 11:12:05,456][123090] Updated weights for policy 1, policy_version 1444151 (0.0010) [2023-12-26 11:12:05,556][123091] Updated weights for policy 0, policy_version 1453687 (0.0010) [2023-12-26 11:12:05,621][123091] Updated weights for policy 0, policy_version 1453697 (0.0008) [2023-12-26 11:12:05,670][123091] Updated weights for policy 0, policy_version 1453707 (0.0010) [2023-12-26 11:12:06,259][123090] Updated weights for policy 1, policy_version 1444161 (0.0009) [2023-12-26 11:12:06,328][123090] Updated weights for policy 1, policy_version 1444171 (0.0010) [2023-12-26 11:12:06,396][123090] Updated weights for policy 1, policy_version 1444181 (0.0010) [2023-12-26 11:12:06,458][123090] Updated weights for policy 1, policy_version 1444191 (0.0009) [2023-12-26 11:12:06,505][123091] Updated weights for policy 0, policy_version 1453717 (0.0007) [2023-12-26 11:12:06,566][123091] Updated weights for policy 0, policy_version 1453727 (0.0009) [2023-12-26 11:12:06,621][123091] Updated weights for policy 0, policy_version 1453738 (0.0010) [2023-12-26 11:12:07,294][123090] Updated weights for policy 1, policy_version 1444201 (0.0009) [2023-12-26 11:12:07,342][123090] Updated weights for policy 1, policy_version 1444211 (0.0009) [2023-12-26 11:12:07,408][123090] Updated weights for policy 1, policy_version 1444221 (0.0009) [2023-12-26 11:12:07,449][123091] Updated weights for policy 0, policy_version 1453748 (0.0009) [2023-12-26 11:12:07,506][123091] Updated weights for policy 0, policy_version 1453758 (0.0009) [2023-12-26 11:12:07,574][123091] Updated weights for policy 0, policy_version 1453768 (0.0010) [2023-12-26 11:12:08,203][123090] Updated weights for policy 1, policy_version 1444231 (0.0007) [2023-12-26 11:12:08,257][123090] Updated weights for policy 1, policy_version 1444241 (0.0005) [2023-12-26 11:12:08,305][123090] Updated weights for policy 1, policy_version 1444251 (0.0005) [2023-12-26 11:12:08,450][123091] Updated weights for policy 0, policy_version 1453778 (0.0010) [2023-12-26 11:12:08,519][123091] Updated weights for policy 0, policy_version 1453788 (0.0008) [2023-12-26 11:12:08,580][123091] Updated weights for policy 0, policy_version 1453798 (0.0009) [2023-12-26 11:12:08,634][123091] Updated weights for policy 0, policy_version 1453808 (0.0009) [2023-12-26 11:12:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 741908480. Throughput: 0: 8764.5, 1: 9119.4. Samples: 741883956. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:08,785][121949] Avg episode reward: [(0, '6228.882'), (1, '5420.139')] [2023-12-26 11:12:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001453808_372178944.pth... [2023-12-26 11:12:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001444256_369729536.pth... [2023-12-26 11:12:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001452816_371924992.pth [2023-12-26 11:12:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001443200_369459200.pth [2023-12-26 11:12:08,973][123090] Updated weights for policy 1, policy_version 1444261 (0.0006) [2023-12-26 11:12:09,048][123090] Updated weights for policy 1, policy_version 1444271 (0.0005) [2023-12-26 11:12:09,109][123090] Updated weights for policy 1, policy_version 1444281 (0.0006) [2023-12-26 11:12:09,534][123091] Updated weights for policy 0, policy_version 1453818 (0.0009) [2023-12-26 11:12:09,589][123091] Updated weights for policy 0, policy_version 1453828 (0.0010) [2023-12-26 11:12:09,658][123091] Updated weights for policy 0, policy_version 1453838 (0.0008) [2023-12-26 11:12:09,861][123090] Updated weights for policy 1, policy_version 1444291 (0.0007) [2023-12-26 11:12:09,915][123090] Updated weights for policy 1, policy_version 1444301 (0.0010) [2023-12-26 11:12:09,985][123090] Updated weights for policy 1, policy_version 1444311 (0.0008) [2023-12-26 11:12:10,480][123091] Updated weights for policy 0, policy_version 1453848 (0.0011) [2023-12-26 11:12:10,550][123091] Updated weights for policy 0, policy_version 1453858 (0.0011) [2023-12-26 11:12:10,602][123091] Updated weights for policy 0, policy_version 1453868 (0.0010) [2023-12-26 11:12:10,763][123090] Updated weights for policy 1, policy_version 1444321 (0.0008) [2023-12-26 11:12:10,832][123090] Updated weights for policy 1, policy_version 1444331 (0.0005) [2023-12-26 11:12:10,897][123090] Updated weights for policy 1, policy_version 1444341 (0.0007) [2023-12-26 11:12:10,961][123090] Updated weights for policy 1, policy_version 1444351 (0.0008) [2023-12-26 11:12:11,414][123091] Updated weights for policy 0, policy_version 1453878 (0.0010) [2023-12-26 11:12:11,483][123091] Updated weights for policy 0, policy_version 1453888 (0.0010) [2023-12-26 11:12:11,545][123091] Updated weights for policy 0, policy_version 1453898 (0.0010) [2023-12-26 11:12:11,769][123090] Updated weights for policy 1, policy_version 1444361 (0.0010) [2023-12-26 11:12:11,837][123090] Updated weights for policy 1, policy_version 1444371 (0.0009) [2023-12-26 11:12:11,917][123090] Updated weights for policy 1, policy_version 1444381 (0.0008) [2023-12-26 11:12:12,424][123091] Updated weights for policy 0, policy_version 1453908 (0.0009) [2023-12-26 11:12:12,479][123091] Updated weights for policy 0, policy_version 1453918 (0.0010) [2023-12-26 11:12:12,529][123091] Updated weights for policy 0, policy_version 1453928 (0.0009) [2023-12-26 11:12:12,763][123090] Updated weights for policy 1, policy_version 1444391 (0.0009) [2023-12-26 11:12:12,820][123090] Updated weights for policy 1, policy_version 1444401 (0.0009) [2023-12-26 11:12:12,883][123090] Updated weights for policy 1, policy_version 1444411 (0.0010) [2023-12-26 11:12:13,275][123091] Updated weights for policy 0, policy_version 1453938 (0.0009) [2023-12-26 11:12:13,327][123091] Updated weights for policy 0, policy_version 1453948 (0.0005) [2023-12-26 11:12:13,378][123091] Updated weights for policy 0, policy_version 1453958 (0.0005) [2023-12-26 11:12:13,434][123091] Updated weights for policy 0, policy_version 1453968 (0.0010) [2023-12-26 11:12:13,699][123090] Updated weights for policy 1, policy_version 1444421 (0.0008) [2023-12-26 11:12:13,752][123090] Updated weights for policy 1, policy_version 1444431 (0.0005) [2023-12-26 11:12:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 741990400. Throughput: 0: 8688.9, 1: 9081.2. Samples: 741986472. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:13,784][121949] Avg episode reward: [(0, '6327.851'), (1, '5606.424')] [2023-12-26 11:12:13,804][123090] Updated weights for policy 1, policy_version 1444441 (0.0005) [2023-12-26 11:12:14,132][123091] Updated weights for policy 0, policy_version 1453978 (0.0006) [2023-12-26 11:12:14,184][123091] Updated weights for policy 0, policy_version 1453988 (0.0005) [2023-12-26 11:12:14,230][123091] Updated weights for policy 0, policy_version 1453998 (0.0005) [2023-12-26 11:12:14,467][123090] Updated weights for policy 1, policy_version 1444451 (0.0007) [2023-12-26 11:12:14,528][123090] Updated weights for policy 1, policy_version 1444461 (0.0006) [2023-12-26 11:12:14,576][123090] Updated weights for policy 1, policy_version 1444471 (0.0005) [2023-12-26 11:12:15,016][123091] Updated weights for policy 0, policy_version 1454008 (0.0010) [2023-12-26 11:12:15,077][123091] Updated weights for policy 0, policy_version 1454018 (0.0011) [2023-12-26 11:12:15,137][123091] Updated weights for policy 0, policy_version 1454028 (0.0011) [2023-12-26 11:12:15,326][123090] Updated weights for policy 1, policy_version 1444481 (0.0006) [2023-12-26 11:12:15,401][123090] Updated weights for policy 1, policy_version 1444491 (0.0005) [2023-12-26 11:12:15,472][123090] Updated weights for policy 1, policy_version 1444501 (0.0005) [2023-12-26 11:12:15,533][123090] Updated weights for policy 1, policy_version 1444511 (0.0005) [2023-12-26 11:12:15,913][123091] Updated weights for policy 0, policy_version 1454038 (0.0010) [2023-12-26 11:12:15,968][123091] Updated weights for policy 0, policy_version 1454048 (0.0010) [2023-12-26 11:12:16,026][123091] Updated weights for policy 0, policy_version 1454058 (0.0010) [2023-12-26 11:12:16,197][123090] Updated weights for policy 1, policy_version 1444521 (0.0008) [2023-12-26 11:12:16,256][123090] Updated weights for policy 1, policy_version 1444531 (0.0009) [2023-12-26 11:12:16,306][123090] Updated weights for policy 1, policy_version 1444541 (0.0009) [2023-12-26 11:12:16,728][123091] Updated weights for policy 0, policy_version 1454068 (0.0008) [2023-12-26 11:12:16,785][123091] Updated weights for policy 0, policy_version 1454078 (0.0005) [2023-12-26 11:12:16,854][123091] Updated weights for policy 0, policy_version 1454088 (0.0005) [2023-12-26 11:12:16,991][123090] Updated weights for policy 1, policy_version 1444551 (0.0006) [2023-12-26 11:12:17,057][123090] Updated weights for policy 1, policy_version 1444561 (0.0005) [2023-12-26 11:12:17,129][123090] Updated weights for policy 1, policy_version 1444571 (0.0007) [2023-12-26 11:12:17,495][123091] Updated weights for policy 0, policy_version 1454098 (0.0007) [2023-12-26 11:12:17,559][123091] Updated weights for policy 0, policy_version 1454108 (0.0009) [2023-12-26 11:12:17,625][123091] Updated weights for policy 0, policy_version 1454118 (0.0009) [2023-12-26 11:12:17,689][123091] Updated weights for policy 0, policy_version 1454128 (0.0010) [2023-12-26 11:12:17,905][123090] Updated weights for policy 1, policy_version 1444581 (0.0009) [2023-12-26 11:12:17,953][123090] Updated weights for policy 1, policy_version 1444591 (0.0009) [2023-12-26 11:12:18,011][123090] Updated weights for policy 1, policy_version 1444601 (0.0009) [2023-12-26 11:12:18,552][123091] Updated weights for policy 0, policy_version 1454138 (0.0010) [2023-12-26 11:12:18,620][123091] Updated weights for policy 0, policy_version 1454148 (0.0005) [2023-12-26 11:12:18,686][123091] Updated weights for policy 0, policy_version 1454158 (0.0005) [2023-12-26 11:12:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 742088704. Throughput: 0: 8760.9, 1: 9129.8. Samples: 742100556. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:18,785][121949] Avg episode reward: [(0, '6295.625'), (1, '5530.365')] [2023-12-26 11:12:18,828][123090] Updated weights for policy 1, policy_version 1444611 (0.0009) [2023-12-26 11:12:18,889][123090] Updated weights for policy 1, policy_version 1444621 (0.0010) [2023-12-26 11:12:18,942][123090] Updated weights for policy 1, policy_version 1444631 (0.0009) [2023-12-26 11:12:19,438][123091] Updated weights for policy 0, policy_version 1454168 (0.0007) [2023-12-26 11:12:19,505][123091] Updated weights for policy 0, policy_version 1454178 (0.0009) [2023-12-26 11:12:19,572][123091] Updated weights for policy 0, policy_version 1454188 (0.0010) [2023-12-26 11:12:19,857][123090] Updated weights for policy 1, policy_version 1444641 (0.0009) [2023-12-26 11:12:19,927][123090] Updated weights for policy 1, policy_version 1444651 (0.0008) [2023-12-26 11:12:19,989][123090] Updated weights for policy 1, policy_version 1444661 (0.0009) [2023-12-26 11:12:20,054][123090] Updated weights for policy 1, policy_version 1444671 (0.0009) [2023-12-26 11:12:20,410][123091] Updated weights for policy 0, policy_version 1454198 (0.0007) [2023-12-26 11:12:20,473][123091] Updated weights for policy 0, policy_version 1454208 (0.0009) [2023-12-26 11:12:20,537][123091] Updated weights for policy 0, policy_version 1454218 (0.0010) [2023-12-26 11:12:20,924][123090] Updated weights for policy 1, policy_version 1444681 (0.0009) [2023-12-26 11:12:20,986][123090] Updated weights for policy 1, policy_version 1444691 (0.0009) [2023-12-26 11:12:21,049][123090] Updated weights for policy 1, policy_version 1444701 (0.0009) [2023-12-26 11:12:21,384][123091] Updated weights for policy 0, policy_version 1454228 (0.0010) [2023-12-26 11:12:21,451][123091] Updated weights for policy 0, policy_version 1454238 (0.0010) [2023-12-26 11:12:21,505][123091] Updated weights for policy 0, policy_version 1454248 (0.0009) [2023-12-26 11:12:21,855][123090] Updated weights for policy 1, policy_version 1444711 (0.0007) [2023-12-26 11:12:21,914][123090] Updated weights for policy 1, policy_version 1444721 (0.0009) [2023-12-26 11:12:21,974][123090] Updated weights for policy 1, policy_version 1444731 (0.0010) [2023-12-26 11:12:22,402][123091] Updated weights for policy 0, policy_version 1454258 (0.0010) [2023-12-26 11:12:22,466][123091] Updated weights for policy 0, policy_version 1454268 (0.0009) [2023-12-26 11:12:22,529][123091] Updated weights for policy 0, policy_version 1454278 (0.0010) [2023-12-26 11:12:22,581][123091] Updated weights for policy 0, policy_version 1454288 (0.0009) [2023-12-26 11:12:22,813][123090] Updated weights for policy 1, policy_version 1444741 (0.0010) [2023-12-26 11:12:22,871][123090] Updated weights for policy 1, policy_version 1444751 (0.0010) [2023-12-26 11:12:22,929][123090] Updated weights for policy 1, policy_version 1444761 (0.0009) [2023-12-26 11:12:23,468][123091] Updated weights for policy 0, policy_version 1454298 (0.0010) [2023-12-26 11:12:23,529][123091] Updated weights for policy 0, policy_version 1454308 (0.0010) [2023-12-26 11:12:23,587][123091] Updated weights for policy 0, policy_version 1454319 (0.0010) [2023-12-26 11:12:23,652][123090] Updated weights for policy 1, policy_version 1444771 (0.0008) [2023-12-26 11:12:23,718][123090] Updated weights for policy 1, policy_version 1444781 (0.0005) [2023-12-26 11:12:23,775][123090] Updated weights for policy 1, policy_version 1444791 (0.0005) [2023-12-26 11:12:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 742170624. Throughput: 0: 8665.4, 1: 9091.0. Samples: 742150208. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:23,785][121949] Avg episode reward: [(0, '6386.322'), (1, '5348.501')] [2023-12-26 11:12:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001454320_372310016.pth... [2023-12-26 11:12:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001453296_372047872.pth [2023-12-26 11:12:23,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001444800_369868800.pth... [2023-12-26 11:12:23,836][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001443744_369598464.pth [2023-12-26 11:12:24,473][123091] Updated weights for policy 0, policy_version 1454329 (0.0006) [2023-12-26 11:12:24,494][123090] Updated weights for policy 1, policy_version 1444801 (0.0006) [2023-12-26 11:12:24,541][123091] Updated weights for policy 0, policy_version 1454339 (0.0007) [2023-12-26 11:12:24,554][123090] Updated weights for policy 1, policy_version 1444811 (0.0009) [2023-12-26 11:12:24,603][123091] Updated weights for policy 0, policy_version 1454349 (0.0008) [2023-12-26 11:12:24,610][123090] Updated weights for policy 1, policy_version 1444821 (0.0009) [2023-12-26 11:12:24,666][123090] Updated weights for policy 1, policy_version 1444831 (0.0009) [2023-12-26 11:12:25,313][123091] Updated weights for policy 0, policy_version 1454359 (0.0010) [2023-12-26 11:12:25,371][123091] Updated weights for policy 0, policy_version 1454369 (0.0011) [2023-12-26 11:12:25,422][123091] Updated weights for policy 0, policy_version 1454379 (0.0010) [2023-12-26 11:12:25,551][123090] Updated weights for policy 1, policy_version 1444841 (0.0009) [2023-12-26 11:12:25,615][123090] Updated weights for policy 1, policy_version 1444851 (0.0008) [2023-12-26 11:12:25,668][123090] Updated weights for policy 1, policy_version 1444861 (0.0009) [2023-12-26 11:12:26,260][123091] Updated weights for policy 0, policy_version 1454389 (0.0011) [2023-12-26 11:12:26,330][123091] Updated weights for policy 0, policy_version 1454399 (0.0011) [2023-12-26 11:12:26,382][123091] Updated weights for policy 0, policy_version 1454409 (0.0011) [2023-12-26 11:12:26,513][123090] Updated weights for policy 1, policy_version 1444871 (0.0009) [2023-12-26 11:12:26,570][123090] Updated weights for policy 1, policy_version 1444881 (0.0009) [2023-12-26 11:12:26,623][123090] Updated weights for policy 1, policy_version 1444891 (0.0009) [2023-12-26 11:12:27,125][123091] Updated weights for policy 0, policy_version 1454419 (0.0009) [2023-12-26 11:12:27,182][123091] Updated weights for policy 0, policy_version 1454429 (0.0005) [2023-12-26 11:12:27,243][123091] Updated weights for policy 0, policy_version 1454439 (0.0005) [2023-12-26 11:12:27,512][123090] Updated weights for policy 1, policy_version 1444901 (0.0008) [2023-12-26 11:12:27,564][123090] Updated weights for policy 1, policy_version 1444911 (0.0009) [2023-12-26 11:12:27,625][123090] Updated weights for policy 1, policy_version 1444921 (0.0009) [2023-12-26 11:12:28,019][123091] Updated weights for policy 0, policy_version 1454449 (0.0006) [2023-12-26 11:12:28,074][123091] Updated weights for policy 0, policy_version 1454459 (0.0011) [2023-12-26 11:12:28,134][123091] Updated weights for policy 0, policy_version 1454469 (0.0011) [2023-12-26 11:12:28,197][123091] Updated weights for policy 0, policy_version 1454479 (0.0010) [2023-12-26 11:12:28,412][123090] Updated weights for policy 1, policy_version 1444931 (0.0010) [2023-12-26 11:12:28,472][123090] Updated weights for policy 1, policy_version 1444941 (0.0011) [2023-12-26 11:12:28,521][123090] Updated weights for policy 1, policy_version 1444951 (0.0010) [2023-12-26 11:12:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 742260736. Throughput: 0: 8675.2, 1: 9060.7. Samples: 742255096. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:28,785][121949] Avg episode reward: [(0, '6357.811'), (1, '5482.705')] [2023-12-26 11:12:29,028][123091] Updated weights for policy 0, policy_version 1454489 (0.0011) [2023-12-26 11:12:29,087][123091] Updated weights for policy 0, policy_version 1454499 (0.0010) [2023-12-26 11:12:29,154][123091] Updated weights for policy 0, policy_version 1454509 (0.0011) [2023-12-26 11:12:29,203][123090] Updated weights for policy 1, policy_version 1444961 (0.0010) [2023-12-26 11:12:29,271][123090] Updated weights for policy 1, policy_version 1444971 (0.0007) [2023-12-26 11:12:29,340][123090] Updated weights for policy 1, policy_version 1444981 (0.0009) [2023-12-26 11:12:29,407][123090] Updated weights for policy 1, policy_version 1444991 (0.0009) [2023-12-26 11:12:29,976][123091] Updated weights for policy 0, policy_version 1454519 (0.0009) [2023-12-26 11:12:30,031][123091] Updated weights for policy 0, policy_version 1454529 (0.0009) [2023-12-26 11:12:30,101][123091] Updated weights for policy 0, policy_version 1454539 (0.0008) [2023-12-26 11:12:30,174][123090] Updated weights for policy 1, policy_version 1445001 (0.0010) [2023-12-26 11:12:30,244][123090] Updated weights for policy 1, policy_version 1445011 (0.0010) [2023-12-26 11:12:30,318][123090] Updated weights for policy 1, policy_version 1445021 (0.0009) [2023-12-26 11:12:30,788][123091] Updated weights for policy 0, policy_version 1454549 (0.0006) [2023-12-26 11:12:30,845][123091] Updated weights for policy 0, policy_version 1454559 (0.0005) [2023-12-26 11:12:30,887][123091] Updated weights for policy 0, policy_version 1454569 (0.0005) [2023-12-26 11:12:31,209][123090] Updated weights for policy 1, policy_version 1445031 (0.0010) [2023-12-26 11:12:31,278][123090] Updated weights for policy 1, policy_version 1445041 (0.0010) [2023-12-26 11:12:31,333][123090] Updated weights for policy 1, policy_version 1445051 (0.0009) [2023-12-26 11:12:31,616][123091] Updated weights for policy 0, policy_version 1454579 (0.0007) [2023-12-26 11:12:31,683][123091] Updated weights for policy 0, policy_version 1454589 (0.0007) [2023-12-26 11:12:31,745][123091] Updated weights for policy 0, policy_version 1454599 (0.0008) [2023-12-26 11:12:32,199][123090] Updated weights for policy 1, policy_version 1445061 (0.0010) [2023-12-26 11:12:32,257][123090] Updated weights for policy 1, policy_version 1445071 (0.0009) [2023-12-26 11:12:32,325][123090] Updated weights for policy 1, policy_version 1445081 (0.0010) [2023-12-26 11:12:32,553][123091] Updated weights for policy 0, policy_version 1454609 (0.0010) [2023-12-26 11:12:32,617][123091] Updated weights for policy 0, policy_version 1454619 (0.0010) [2023-12-26 11:12:32,670][123091] Updated weights for policy 0, policy_version 1454629 (0.0009) [2023-12-26 11:12:32,725][123091] Updated weights for policy 0, policy_version 1454639 (0.0009) [2023-12-26 11:12:33,173][123090] Updated weights for policy 1, policy_version 1445091 (0.0008) [2023-12-26 11:12:33,227][123090] Updated weights for policy 1, policy_version 1445101 (0.0009) [2023-12-26 11:12:33,291][123090] Updated weights for policy 1, policy_version 1445111 (0.0010) [2023-12-26 11:12:33,526][123091] Updated weights for policy 0, policy_version 1454649 (0.0009) [2023-12-26 11:12:33,574][123091] Updated weights for policy 0, policy_version 1454659 (0.0009) [2023-12-26 11:12:33,628][123091] Updated weights for policy 0, policy_version 1454671 (0.0010) [2023-12-26 11:12:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 742350848. Throughput: 0: 8678.2, 1: 8937.3. Samples: 742359824. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:33,785][121949] Avg episode reward: [(0, '6092.749'), (1, '5505.912')] [2023-12-26 11:12:34,116][123090] Updated weights for policy 1, policy_version 1445121 (0.0009) [2023-12-26 11:12:34,186][123090] Updated weights for policy 1, policy_version 1445131 (0.0007) [2023-12-26 11:12:34,245][123090] Updated weights for policy 1, policy_version 1445141 (0.0006) [2023-12-26 11:12:34,294][123090] Updated weights for policy 1, policy_version 1445151 (0.0005) [2023-12-26 11:12:34,453][123091] Updated weights for policy 0, policy_version 1454681 (0.0009) [2023-12-26 11:12:34,511][123091] Updated weights for policy 0, policy_version 1454691 (0.0009) [2023-12-26 11:12:34,565][123091] Updated weights for policy 0, policy_version 1454701 (0.0010) [2023-12-26 11:12:35,052][123090] Updated weights for policy 1, policy_version 1445161 (0.0006) [2023-12-26 11:12:35,101][123090] Updated weights for policy 1, policy_version 1445171 (0.0005) [2023-12-26 11:12:35,168][123090] Updated weights for policy 1, policy_version 1445181 (0.0006) [2023-12-26 11:12:35,438][123091] Updated weights for policy 0, policy_version 1454711 (0.0009) [2023-12-26 11:12:35,492][123091] Updated weights for policy 0, policy_version 1454721 (0.0010) [2023-12-26 11:12:35,547][123091] Updated weights for policy 0, policy_version 1454732 (0.0009) [2023-12-26 11:12:35,878][123090] Updated weights for policy 1, policy_version 1445191 (0.0007) [2023-12-26 11:12:35,943][123090] Updated weights for policy 1, policy_version 1445201 (0.0009) [2023-12-26 11:12:36,006][123090] Updated weights for policy 1, policy_version 1445211 (0.0009) [2023-12-26 11:12:36,405][123091] Updated weights for policy 0, policy_version 1454742 (0.0010) [2023-12-26 11:12:36,465][123091] Updated weights for policy 0, policy_version 1454752 (0.0011) [2023-12-26 11:12:36,524][123091] Updated weights for policy 0, policy_version 1454762 (0.0011) [2023-12-26 11:12:36,793][123090] Updated weights for policy 1, policy_version 1445221 (0.0009) [2023-12-26 11:12:36,850][123090] Updated weights for policy 1, policy_version 1445231 (0.0009) [2023-12-26 11:12:36,914][123090] Updated weights for policy 1, policy_version 1445241 (0.0009) [2023-12-26 11:12:37,263][123091] Updated weights for policy 0, policy_version 1454772 (0.0009) [2023-12-26 11:12:37,308][123091] Updated weights for policy 0, policy_version 1454782 (0.0006) [2023-12-26 11:12:37,355][123091] Updated weights for policy 0, policy_version 1454792 (0.0006) [2023-12-26 11:12:37,721][123090] Updated weights for policy 1, policy_version 1445251 (0.0009) [2023-12-26 11:12:37,774][123090] Updated weights for policy 1, policy_version 1445261 (0.0010) [2023-12-26 11:12:37,829][123090] Updated weights for policy 1, policy_version 1445271 (0.0009) [2023-12-26 11:12:38,113][123091] Updated weights for policy 0, policy_version 1454802 (0.0006) [2023-12-26 11:12:38,162][123091] Updated weights for policy 0, policy_version 1454812 (0.0005) [2023-12-26 11:12:38,214][123091] Updated weights for policy 0, policy_version 1454822 (0.0005) [2023-12-26 11:12:38,267][123091] Updated weights for policy 0, policy_version 1454832 (0.0008) [2023-12-26 11:12:38,653][123090] Updated weights for policy 1, policy_version 1445281 (0.0006) [2023-12-26 11:12:38,717][123090] Updated weights for policy 1, policy_version 1445291 (0.0009) [2023-12-26 11:12:38,770][123090] Updated weights for policy 1, policy_version 1445302 (0.0010) [2023-12-26 11:12:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 742432768. Throughput: 0: 8680.9, 1: 8948.5. Samples: 742412296. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:38,785][121949] Avg episode reward: [(0, '6052.420'), (1, '5461.286')] [2023-12-26 11:12:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001454832_372441088.pth... [2023-12-26 11:12:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001453808_372178944.pth [2023-12-26 11:12:38,833][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001445312_369999872.pth... [2023-12-26 11:12:38,833][123090] Updated weights for policy 1, policy_version 1445312 (0.0010) [2023-12-26 11:12:38,838][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001444256_369729536.pth [2023-12-26 11:12:39,034][123091] Updated weights for policy 0, policy_version 1454842 (0.0009) [2023-12-26 11:12:39,086][123091] Updated weights for policy 0, policy_version 1454852 (0.0009) [2023-12-26 11:12:39,136][123091] Updated weights for policy 0, policy_version 1454862 (0.0009) [2023-12-26 11:12:39,756][123090] Updated weights for policy 1, policy_version 1445322 (0.0010) [2023-12-26 11:12:39,823][123090] Updated weights for policy 1, policy_version 1445332 (0.0010) [2023-12-26 11:12:39,894][123090] Updated weights for policy 1, policy_version 1445342 (0.0009) [2023-12-26 11:12:39,977][123091] Updated weights for policy 0, policy_version 1454872 (0.0009) [2023-12-26 11:12:40,028][123091] Updated weights for policy 0, policy_version 1454882 (0.0010) [2023-12-26 11:12:40,085][123091] Updated weights for policy 0, policy_version 1454892 (0.0010) [2023-12-26 11:12:40,761][123090] Updated weights for policy 1, policy_version 1445352 (0.0010) [2023-12-26 11:12:40,828][123090] Updated weights for policy 1, policy_version 1445362 (0.0010) [2023-12-26 11:12:40,889][123091] Updated weights for policy 0, policy_version 1454902 (0.0009) [2023-12-26 11:12:40,897][123090] Updated weights for policy 1, policy_version 1445372 (0.0008) [2023-12-26 11:12:40,940][123091] Updated weights for policy 0, policy_version 1454912 (0.0009) [2023-12-26 11:12:40,988][123091] Updated weights for policy 0, policy_version 1454922 (0.0009) [2023-12-26 11:12:41,733][123090] Updated weights for policy 1, policy_version 1445382 (0.0009) [2023-12-26 11:12:41,801][123090] Updated weights for policy 1, policy_version 1445392 (0.0007) [2023-12-26 11:12:41,854][123090] Updated weights for policy 1, policy_version 1445402 (0.0005) [2023-12-26 11:12:41,912][123091] Updated weights for policy 0, policy_version 1454932 (0.0010) [2023-12-26 11:12:41,964][123091] Updated weights for policy 0, policy_version 1454942 (0.0009) [2023-12-26 11:12:42,021][123091] Updated weights for policy 0, policy_version 1454952 (0.0009) [2023-12-26 11:12:42,620][123090] Updated weights for policy 1, policy_version 1445412 (0.0005) [2023-12-26 11:12:42,691][123090] Updated weights for policy 1, policy_version 1445422 (0.0006) [2023-12-26 11:12:42,767][123090] Updated weights for policy 1, policy_version 1445432 (0.0007) [2023-12-26 11:12:42,922][123091] Updated weights for policy 0, policy_version 1454962 (0.0009) [2023-12-26 11:12:42,972][123091] Updated weights for policy 0, policy_version 1454972 (0.0009) [2023-12-26 11:12:43,019][123091] Updated weights for policy 0, policy_version 1454982 (0.0009) [2023-12-26 11:12:43,082][123091] Updated weights for policy 0, policy_version 1454992 (0.0009) [2023-12-26 11:12:43,557][123090] Updated weights for policy 1, policy_version 1445442 (0.0010) [2023-12-26 11:12:43,619][123090] Updated weights for policy 1, policy_version 1445452 (0.0009) [2023-12-26 11:12:43,670][123090] Updated weights for policy 1, policy_version 1445462 (0.0009) [2023-12-26 11:12:43,722][123090] Updated weights for policy 1, policy_version 1445472 (0.0009) [2023-12-26 11:12:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 742522880. Throughput: 0: 8746.0, 1: 8829.2. Samples: 742516888. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:43,785][121949] Avg episode reward: [(0, '6246.519'), (1, '5566.507')] [2023-12-26 11:12:43,923][123091] Updated weights for policy 0, policy_version 1455002 (0.0009) [2023-12-26 11:12:43,990][123091] Updated weights for policy 0, policy_version 1455012 (0.0010) [2023-12-26 11:12:44,058][123091] Updated weights for policy 0, policy_version 1455022 (0.0010) [2023-12-26 11:12:44,581][123090] Updated weights for policy 1, policy_version 1445482 (0.0011) [2023-12-26 11:12:44,644][123090] Updated weights for policy 1, policy_version 1445492 (0.0011) [2023-12-26 11:12:44,707][123090] Updated weights for policy 1, policy_version 1445502 (0.0010) [2023-12-26 11:12:44,883][123091] Updated weights for policy 0, policy_version 1455032 (0.0008) [2023-12-26 11:12:44,952][123091] Updated weights for policy 0, policy_version 1455042 (0.0010) [2023-12-26 11:12:45,024][123091] Updated weights for policy 0, policy_version 1455052 (0.0009) [2023-12-26 11:12:45,425][123090] Updated weights for policy 1, policy_version 1445512 (0.0009) [2023-12-26 11:12:45,500][123090] Updated weights for policy 1, policy_version 1445522 (0.0009) [2023-12-26 11:12:45,564][123090] Updated weights for policy 1, policy_version 1445532 (0.0009) [2023-12-26 11:12:45,863][123091] Updated weights for policy 0, policy_version 1455062 (0.0007) [2023-12-26 11:12:45,922][123091] Updated weights for policy 0, policy_version 1455072 (0.0005) [2023-12-26 11:12:45,987][123091] Updated weights for policy 0, policy_version 1455082 (0.0005) [2023-12-26 11:12:46,448][123090] Updated weights for policy 1, policy_version 1445542 (0.0009) [2023-12-26 11:12:46,504][123090] Updated weights for policy 1, policy_version 1445552 (0.0009) [2023-12-26 11:12:46,558][123090] Updated weights for policy 1, policy_version 1445562 (0.0008) [2023-12-26 11:12:46,638][123091] Updated weights for policy 0, policy_version 1455092 (0.0009) [2023-12-26 11:12:46,700][123091] Updated weights for policy 0, policy_version 1455102 (0.0010) [2023-12-26 11:12:46,769][123091] Updated weights for policy 0, policy_version 1455112 (0.0010) [2023-12-26 11:12:47,407][123090] Updated weights for policy 1, policy_version 1445572 (0.0009) [2023-12-26 11:12:47,470][123090] Updated weights for policy 1, policy_version 1445582 (0.0010) [2023-12-26 11:12:47,508][123091] Updated weights for policy 0, policy_version 1455122 (0.0006) [2023-12-26 11:12:47,526][123090] Updated weights for policy 1, policy_version 1445592 (0.0009) [2023-12-26 11:12:47,578][123091] Updated weights for policy 0, policy_version 1455132 (0.0011) [2023-12-26 11:12:47,648][123091] Updated weights for policy 0, policy_version 1455142 (0.0010) [2023-12-26 11:12:47,705][123091] Updated weights for policy 0, policy_version 1455152 (0.0010) [2023-12-26 11:12:48,269][123090] Updated weights for policy 1, policy_version 1445602 (0.0007) [2023-12-26 11:12:48,321][123090] Updated weights for policy 1, policy_version 1445612 (0.0010) [2023-12-26 11:12:48,386][123090] Updated weights for policy 1, policy_version 1445622 (0.0011) [2023-12-26 11:12:48,449][123091] Updated weights for policy 0, policy_version 1455162 (0.0011) [2023-12-26 11:12:48,449][123090] Updated weights for policy 1, policy_version 1445632 (0.0007) [2023-12-26 11:12:48,511][123091] Updated weights for policy 0, policy_version 1455172 (0.0010) [2023-12-26 11:12:48,576][123091] Updated weights for policy 0, policy_version 1455182 (0.0006) [2023-12-26 11:12:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 742612992. Throughput: 0: 8755.3, 1: 8798.9. Samples: 742621852. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:48,785][121949] Avg episode reward: [(0, '6388.470'), (1, '5557.285')] [2023-12-26 11:12:49,277][123090] Updated weights for policy 1, policy_version 1445642 (0.0010) [2023-12-26 11:12:49,334][123090] Updated weights for policy 1, policy_version 1445652 (0.0010) [2023-12-26 11:12:49,375][123091] Updated weights for policy 0, policy_version 1455192 (0.0009) [2023-12-26 11:12:49,400][123090] Updated weights for policy 1, policy_version 1445662 (0.0009) [2023-12-26 11:12:49,440][123091] Updated weights for policy 0, policy_version 1455202 (0.0009) [2023-12-26 11:12:49,497][123091] Updated weights for policy 0, policy_version 1455212 (0.0009) [2023-12-26 11:12:50,187][123090] Updated weights for policy 1, policy_version 1445672 (0.0009) [2023-12-26 11:12:50,243][123090] Updated weights for policy 1, policy_version 1445682 (0.0010) [2023-12-26 11:12:50,295][123090] Updated weights for policy 1, policy_version 1445692 (0.0010) [2023-12-26 11:12:50,403][123091] Updated weights for policy 0, policy_version 1455222 (0.0009) [2023-12-26 11:12:50,467][123091] Updated weights for policy 0, policy_version 1455232 (0.0009) [2023-12-26 11:12:50,533][123091] Updated weights for policy 0, policy_version 1455242 (0.0009) [2023-12-26 11:12:51,167][123090] Updated weights for policy 1, policy_version 1445702 (0.0009) [2023-12-26 11:12:51,237][123090] Updated weights for policy 1, policy_version 1445712 (0.0008) [2023-12-26 11:12:51,279][123091] Updated weights for policy 0, policy_version 1455252 (0.0010) [2023-12-26 11:12:51,303][123090] Updated weights for policy 1, policy_version 1445722 (0.0006) [2023-12-26 11:12:51,348][123091] Updated weights for policy 0, policy_version 1455262 (0.0009) [2023-12-26 11:12:51,415][123091] Updated weights for policy 0, policy_version 1455272 (0.0010) [2023-12-26 11:12:52,098][123090] Updated weights for policy 1, policy_version 1445732 (0.0008) [2023-12-26 11:12:52,156][123090] Updated weights for policy 1, policy_version 1445742 (0.0009) [2023-12-26 11:12:52,216][123090] Updated weights for policy 1, policy_version 1445752 (0.0008) [2023-12-26 11:12:52,271][123091] Updated weights for policy 0, policy_version 1455282 (0.0009) [2023-12-26 11:12:52,323][123091] Updated weights for policy 0, policy_version 1455292 (0.0009) [2023-12-26 11:12:52,389][123091] Updated weights for policy 0, policy_version 1455302 (0.0008) [2023-12-26 11:12:52,449][123091] Updated weights for policy 0, policy_version 1455312 (0.0005) [2023-12-26 11:12:53,084][123090] Updated weights for policy 1, policy_version 1445762 (0.0009) [2023-12-26 11:12:53,140][123090] Updated weights for policy 1, policy_version 1445772 (0.0007) [2023-12-26 11:12:53,192][123090] Updated weights for policy 1, policy_version 1445782 (0.0009) [2023-12-26 11:12:53,238][123091] Updated weights for policy 0, policy_version 1455322 (0.0009) [2023-12-26 11:12:53,247][123090] Updated weights for policy 1, policy_version 1445792 (0.0007) [2023-12-26 11:12:53,301][123091] Updated weights for policy 0, policy_version 1455332 (0.0010) [2023-12-26 11:12:53,356][123091] Updated weights for policy 0, policy_version 1455342 (0.0009) [2023-12-26 11:12:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 742694912. Throughput: 0: 8758.7, 1: 8780.6. Samples: 742673228. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:53,786][121949] Avg episode reward: [(0, '6465.317'), (1, '5321.650')] [2023-12-26 11:12:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001445792_370122752.pth... [2023-12-26 11:12:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001455344_372572160.pth... [2023-12-26 11:12:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001444800_369868800.pth [2023-12-26 11:12:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001454320_372310016.pth [2023-12-26 11:12:53,951][123090] Updated weights for policy 1, policy_version 1445802 (0.0008) [2023-12-26 11:12:53,998][123090] Updated weights for policy 1, policy_version 1445812 (0.0010) [2023-12-26 11:12:54,045][123090] Updated weights for policy 1, policy_version 1445822 (0.0010) [2023-12-26 11:12:54,250][123091] Updated weights for policy 0, policy_version 1455352 (0.0009) [2023-12-26 11:12:54,321][123091] Updated weights for policy 0, policy_version 1455362 (0.0009) [2023-12-26 11:12:54,370][123091] Updated weights for policy 0, policy_version 1455372 (0.0009) [2023-12-26 11:12:54,931][123090] Updated weights for policy 1, policy_version 1445832 (0.0010) [2023-12-26 11:12:54,991][123090] Updated weights for policy 1, policy_version 1445842 (0.0011) [2023-12-26 11:12:55,063][123090] Updated weights for policy 1, policy_version 1445852 (0.0011) [2023-12-26 11:12:55,170][123091] Updated weights for policy 0, policy_version 1455382 (0.0007) [2023-12-26 11:12:55,232][123091] Updated weights for policy 0, policy_version 1455392 (0.0006) [2023-12-26 11:12:55,284][123091] Updated weights for policy 0, policy_version 1455402 (0.0006) [2023-12-26 11:12:55,748][123090] Updated weights for policy 1, policy_version 1445862 (0.0007) [2023-12-26 11:12:55,816][123090] Updated weights for policy 1, policy_version 1445872 (0.0006) [2023-12-26 11:12:55,882][123090] Updated weights for policy 1, policy_version 1445882 (0.0005) [2023-12-26 11:12:56,015][123091] Updated weights for policy 0, policy_version 1455412 (0.0007) [2023-12-26 11:12:56,079][123091] Updated weights for policy 0, policy_version 1455422 (0.0009) [2023-12-26 11:12:56,130][123091] Updated weights for policy 0, policy_version 1455432 (0.0008) [2023-12-26 11:12:56,609][123090] Updated weights for policy 1, policy_version 1445892 (0.0007) [2023-12-26 11:12:56,660][123090] Updated weights for policy 1, policy_version 1445902 (0.0007) [2023-12-26 11:12:56,723][123090] Updated weights for policy 1, policy_version 1445912 (0.0007) [2023-12-26 11:12:56,869][123091] Updated weights for policy 0, policy_version 1455442 (0.0008) [2023-12-26 11:12:56,924][123091] Updated weights for policy 0, policy_version 1455452 (0.0005) [2023-12-26 11:12:56,982][123091] Updated weights for policy 0, policy_version 1455462 (0.0005) [2023-12-26 11:12:57,034][123091] Updated weights for policy 0, policy_version 1455472 (0.0005) [2023-12-26 11:12:57,412][123090] Updated weights for policy 1, policy_version 1445922 (0.0005) [2023-12-26 11:12:57,471][123090] Updated weights for policy 1, policy_version 1445932 (0.0005) [2023-12-26 11:12:57,530][123090] Updated weights for policy 1, policy_version 1445942 (0.0005) [2023-12-26 11:12:57,584][123090] Updated weights for policy 1, policy_version 1445952 (0.0006) [2023-12-26 11:12:57,680][123091] Updated weights for policy 0, policy_version 1455482 (0.0005) [2023-12-26 11:12:57,733][123091] Updated weights for policy 0, policy_version 1455492 (0.0006) [2023-12-26 11:12:57,788][123091] Updated weights for policy 0, policy_version 1455502 (0.0006) [2023-12-26 11:12:58,296][123090] Updated weights for policy 1, policy_version 1445962 (0.0008) [2023-12-26 11:12:58,373][123090] Updated weights for policy 1, policy_version 1445972 (0.0008) [2023-12-26 11:12:58,441][123090] Updated weights for policy 1, policy_version 1445982 (0.0007) [2023-12-26 11:12:58,605][123091] Updated weights for policy 0, policy_version 1455512 (0.0009) [2023-12-26 11:12:58,672][123091] Updated weights for policy 0, policy_version 1455522 (0.0010) [2023-12-26 11:12:58,739][123091] Updated weights for policy 0, policy_version 1455532 (0.0010) [2023-12-26 11:12:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 742793216. Throughput: 0: 8874.8, 1: 8828.7. Samples: 742783132. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:12:58,784][121949] Avg episode reward: [(0, '6337.246'), (1, '5177.783')] [2023-12-26 11:12:59,276][123090] Updated weights for policy 1, policy_version 1445992 (0.0008) [2023-12-26 11:12:59,343][123090] Updated weights for policy 1, policy_version 1446002 (0.0009) [2023-12-26 11:12:59,415][123090] Updated weights for policy 1, policy_version 1446012 (0.0010) [2023-12-26 11:12:59,604][123091] Updated weights for policy 0, policy_version 1455542 (0.0010) [2023-12-26 11:12:59,660][123091] Updated weights for policy 0, policy_version 1455553 (0.0010) [2023-12-26 11:12:59,718][123091] Updated weights for policy 0, policy_version 1455563 (0.0009) [2023-12-26 11:13:00,165][123090] Updated weights for policy 1, policy_version 1446022 (0.0007) [2023-12-26 11:13:00,225][123090] Updated weights for policy 1, policy_version 1446032 (0.0009) [2023-12-26 11:13:00,273][123090] Updated weights for policy 1, policy_version 1446042 (0.0009) [2023-12-26 11:13:00,595][123091] Updated weights for policy 0, policy_version 1455573 (0.0010) [2023-12-26 11:13:00,656][123091] Updated weights for policy 0, policy_version 1455583 (0.0009) [2023-12-26 11:13:00,705][123091] Updated weights for policy 0, policy_version 1455593 (0.0009) [2023-12-26 11:13:01,072][123090] Updated weights for policy 1, policy_version 1446052 (0.0009) [2023-12-26 11:13:01,143][123090] Updated weights for policy 1, policy_version 1446062 (0.0009) [2023-12-26 11:13:01,212][123090] Updated weights for policy 1, policy_version 1446072 (0.0009) [2023-12-26 11:13:01,558][123091] Updated weights for policy 0, policy_version 1455603 (0.0009) [2023-12-26 11:13:01,617][123091] Updated weights for policy 0, policy_version 1455613 (0.0008) [2023-12-26 11:13:01,683][123091] Updated weights for policy 0, policy_version 1455623 (0.0009) [2023-12-26 11:13:02,001][123090] Updated weights for policy 1, policy_version 1446082 (0.0010) [2023-12-26 11:13:02,049][123090] Updated weights for policy 1, policy_version 1446092 (0.0010) [2023-12-26 11:13:02,120][123090] Updated weights for policy 1, policy_version 1446102 (0.0011) [2023-12-26 11:13:02,179][123090] Updated weights for policy 1, policy_version 1446112 (0.0010) [2023-12-26 11:13:02,560][123091] Updated weights for policy 0, policy_version 1455633 (0.0009) [2023-12-26 11:13:02,622][123091] Updated weights for policy 0, policy_version 1455643 (0.0008) [2023-12-26 11:13:02,685][123091] Updated weights for policy 0, policy_version 1455653 (0.0008) [2023-12-26 11:13:02,748][123091] Updated weights for policy 0, policy_version 1455663 (0.0009) [2023-12-26 11:13:03,025][123090] Updated weights for policy 1, policy_version 1446122 (0.0005) [2023-12-26 11:13:03,093][123090] Updated weights for policy 1, policy_version 1446132 (0.0005) [2023-12-26 11:13:03,152][123090] Updated weights for policy 1, policy_version 1446142 (0.0008) [2023-12-26 11:13:03,583][123091] Updated weights for policy 0, policy_version 1455673 (0.0010) [2023-12-26 11:13:03,633][123091] Updated weights for policy 0, policy_version 1455684 (0.0009) [2023-12-26 11:13:03,686][123091] Updated weights for policy 0, policy_version 1455694 (0.0009) [2023-12-26 11:13:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 742875136. Throughput: 0: 8727.8, 1: 8731.4. Samples: 742886220. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:03,785][121949] Avg episode reward: [(0, '6309.580'), (1, '5173.435')] [2023-12-26 11:13:03,823][123090] Updated weights for policy 1, policy_version 1446152 (0.0008) [2023-12-26 11:13:03,896][123090] Updated weights for policy 1, policy_version 1446162 (0.0009) [2023-12-26 11:13:03,965][123090] Updated weights for policy 1, policy_version 1446172 (0.0009) [2023-12-26 11:13:04,552][123091] Updated weights for policy 0, policy_version 1455704 (0.0010) [2023-12-26 11:13:04,613][123091] Updated weights for policy 0, policy_version 1455714 (0.0009) [2023-12-26 11:13:04,678][123091] Updated weights for policy 0, policy_version 1455724 (0.0009) [2023-12-26 11:13:04,775][123090] Updated weights for policy 1, policy_version 1446182 (0.0010) [2023-12-26 11:13:04,845][123090] Updated weights for policy 1, policy_version 1446192 (0.0010) [2023-12-26 11:13:04,903][123090] Updated weights for policy 1, policy_version 1446202 (0.0010) [2023-12-26 11:13:05,443][123091] Updated weights for policy 0, policy_version 1455734 (0.0008) [2023-12-26 11:13:05,504][123091] Updated weights for policy 0, policy_version 1455744 (0.0010) [2023-12-26 11:13:05,564][123091] Updated weights for policy 0, policy_version 1455754 (0.0010) [2023-12-26 11:13:05,717][123090] Updated weights for policy 1, policy_version 1446212 (0.0009) [2023-12-26 11:13:05,779][123090] Updated weights for policy 1, policy_version 1446222 (0.0005) [2023-12-26 11:13:05,841][123090] Updated weights for policy 1, policy_version 1446232 (0.0006) [2023-12-26 11:13:06,438][123091] Updated weights for policy 0, policy_version 1455765 (0.0009) [2023-12-26 11:13:06,493][123091] Updated weights for policy 0, policy_version 1455775 (0.0010) [2023-12-26 11:13:06,554][123091] Updated weights for policy 0, policy_version 1455785 (0.0010) [2023-12-26 11:13:06,607][123090] Updated weights for policy 1, policy_version 1446242 (0.0007) [2023-12-26 11:13:06,660][123090] Updated weights for policy 1, policy_version 1446252 (0.0009) [2023-12-26 11:13:06,717][123090] Updated weights for policy 1, policy_version 1446262 (0.0009) [2023-12-26 11:13:06,782][123090] Updated weights for policy 1, policy_version 1446272 (0.0009) [2023-12-26 11:13:07,385][123091] Updated weights for policy 0, policy_version 1455795 (0.0010) [2023-12-26 11:13:07,440][123091] Updated weights for policy 0, policy_version 1455805 (0.0006) [2023-12-26 11:13:07,508][123091] Updated weights for policy 0, policy_version 1455815 (0.0005) [2023-12-26 11:13:07,643][123090] Updated weights for policy 1, policy_version 1446282 (0.0010) [2023-12-26 11:13:07,697][123090] Updated weights for policy 1, policy_version 1446292 (0.0010) [2023-12-26 11:13:07,755][123090] Updated weights for policy 1, policy_version 1446302 (0.0010) [2023-12-26 11:13:08,130][123091] Updated weights for policy 0, policy_version 1455825 (0.0006) [2023-12-26 11:13:08,188][123091] Updated weights for policy 0, policy_version 1455835 (0.0009) [2023-12-26 11:13:08,237][123091] Updated weights for policy 0, policy_version 1455845 (0.0009) [2023-12-26 11:13:08,300][123091] Updated weights for policy 0, policy_version 1455855 (0.0009) [2023-12-26 11:13:08,662][123090] Updated weights for policy 1, policy_version 1446312 (0.0009) [2023-12-26 11:13:08,727][123090] Updated weights for policy 1, policy_version 1446322 (0.0009) [2023-12-26 11:13:08,784][121949] Fps is (10 sec: 16383.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 742957056. Throughput: 0: 8731.8, 1: 8781.7. Samples: 742938316. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:08,785][121949] Avg episode reward: [(0, '6307.925'), (1, '5326.446')] [2023-12-26 11:13:08,789][123090] Updated weights for policy 1, policy_version 1446332 (0.0009) [2023-12-26 11:13:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001455856_372703232.pth... [2023-12-26 11:13:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001454832_372441088.pth [2023-12-26 11:13:08,813][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001446336_370262016.pth... [2023-12-26 11:13:08,819][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001445312_369999872.pth [2023-12-26 11:13:09,135][123091] Updated weights for policy 0, policy_version 1455865 (0.0010) [2023-12-26 11:13:09,202][123091] Updated weights for policy 0, policy_version 1455875 (0.0010) [2023-12-26 11:13:09,265][123091] Updated weights for policy 0, policy_version 1455885 (0.0010) [2023-12-26 11:13:09,627][123090] Updated weights for policy 1, policy_version 1446342 (0.0006) [2023-12-26 11:13:09,699][123090] Updated weights for policy 1, policy_version 1446352 (0.0005) [2023-12-26 11:13:09,780][123090] Updated weights for policy 1, policy_version 1446362 (0.0006) [2023-12-26 11:13:10,066][123091] Updated weights for policy 0, policy_version 1455895 (0.0011) [2023-12-26 11:13:10,135][123091] Updated weights for policy 0, policy_version 1455905 (0.0009) [2023-12-26 11:13:10,199][123091] Updated weights for policy 0, policy_version 1455915 (0.0010) [2023-12-26 11:13:10,463][123090] Updated weights for policy 1, policy_version 1446372 (0.0008) [2023-12-26 11:13:10,525][123090] Updated weights for policy 1, policy_version 1446382 (0.0010) [2023-12-26 11:13:10,586][123090] Updated weights for policy 1, policy_version 1446392 (0.0010) [2023-12-26 11:13:11,095][123091] Updated weights for policy 0, policy_version 1455925 (0.0009) [2023-12-26 11:13:11,172][123091] Updated weights for policy 0, policy_version 1455935 (0.0010) [2023-12-26 11:13:11,243][123091] Updated weights for policy 0, policy_version 1455945 (0.0010) [2023-12-26 11:13:11,367][123090] Updated weights for policy 1, policy_version 1446402 (0.0009) [2023-12-26 11:13:11,430][123090] Updated weights for policy 1, policy_version 1446412 (0.0010) [2023-12-26 11:13:11,502][123090] Updated weights for policy 1, policy_version 1446422 (0.0007) [2023-12-26 11:13:11,567][123090] Updated weights for policy 1, policy_version 1446432 (0.0007) [2023-12-26 11:13:12,059][123091] Updated weights for policy 0, policy_version 1455955 (0.0008) [2023-12-26 11:13:12,128][123091] Updated weights for policy 0, policy_version 1455965 (0.0008) [2023-12-26 11:13:12,196][123091] Updated weights for policy 0, policy_version 1455975 (0.0008) [2023-12-26 11:13:12,430][123090] Updated weights for policy 1, policy_version 1446442 (0.0008) [2023-12-26 11:13:12,498][123090] Updated weights for policy 1, policy_version 1446452 (0.0011) [2023-12-26 11:13:12,559][123090] Updated weights for policy 1, policy_version 1446462 (0.0011) [2023-12-26 11:13:12,861][123091] Updated weights for policy 0, policy_version 1455985 (0.0008) [2023-12-26 11:13:12,921][123091] Updated weights for policy 0, policy_version 1455995 (0.0006) [2023-12-26 11:13:12,978][123091] Updated weights for policy 0, policy_version 1456005 (0.0009) [2023-12-26 11:13:13,030][123091] Updated weights for policy 0, policy_version 1456015 (0.0009) [2023-12-26 11:13:13,309][123090] Updated weights for policy 1, policy_version 1446472 (0.0006) [2023-12-26 11:13:13,369][123090] Updated weights for policy 1, policy_version 1446482 (0.0005) [2023-12-26 11:13:13,425][123090] Updated weights for policy 1, policy_version 1446492 (0.0005) [2023-12-26 11:13:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 743047168. Throughput: 0: 8738.4, 1: 8740.6. Samples: 743041652. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:13,785][121949] Avg episode reward: [(0, '6253.650'), (1, '5539.219')] [2023-12-26 11:13:13,901][123091] Updated weights for policy 0, policy_version 1456025 (0.0009) [2023-12-26 11:13:13,965][123091] Updated weights for policy 0, policy_version 1456035 (0.0009) [2023-12-26 11:13:14,024][123091] Updated weights for policy 0, policy_version 1456045 (0.0009) [2023-12-26 11:13:14,111][123090] Updated weights for policy 1, policy_version 1446502 (0.0008) [2023-12-26 11:13:14,171][123090] Updated weights for policy 1, policy_version 1446512 (0.0008) [2023-12-26 11:13:14,235][123090] Updated weights for policy 1, policy_version 1446522 (0.0009) [2023-12-26 11:13:14,848][123091] Updated weights for policy 0, policy_version 1456055 (0.0009) [2023-12-26 11:13:14,904][123091] Updated weights for policy 0, policy_version 1456065 (0.0010) [2023-12-26 11:13:14,967][123091] Updated weights for policy 0, policy_version 1456075 (0.0009) [2023-12-26 11:13:14,981][123090] Updated weights for policy 1, policy_version 1446532 (0.0010) [2023-12-26 11:13:15,058][123090] Updated weights for policy 1, policy_version 1446542 (0.0009) [2023-12-26 11:13:15,122][123090] Updated weights for policy 1, policy_version 1446552 (0.0010) [2023-12-26 11:13:15,893][123090] Updated weights for policy 1, policy_version 1446562 (0.0006) [2023-12-26 11:13:15,907][123091] Updated weights for policy 0, policy_version 1456085 (0.0008) [2023-12-26 11:13:15,951][123090] Updated weights for policy 1, policy_version 1446572 (0.0009) [2023-12-26 11:13:15,965][123091] Updated weights for policy 0, policy_version 1456095 (0.0008) [2023-12-26 11:13:16,014][123090] Updated weights for policy 1, policy_version 1446582 (0.0007) [2023-12-26 11:13:16,027][123091] Updated weights for policy 0, policy_version 1456105 (0.0008) [2023-12-26 11:13:16,068][123090] Updated weights for policy 1, policy_version 1446592 (0.0006) [2023-12-26 11:13:16,758][123091] Updated weights for policy 0, policy_version 1456115 (0.0009) [2023-12-26 11:13:16,806][123091] Updated weights for policy 0, policy_version 1456125 (0.0010) [2023-12-26 11:13:16,839][123090] Updated weights for policy 1, policy_version 1446602 (0.0008) [2023-12-26 11:13:16,852][123091] Updated weights for policy 0, policy_version 1456135 (0.0009) [2023-12-26 11:13:16,903][123090] Updated weights for policy 1, policy_version 1446612 (0.0009) [2023-12-26 11:13:16,967][123090] Updated weights for policy 1, policy_version 1446622 (0.0008) [2023-12-26 11:13:17,677][123090] Updated weights for policy 1, policy_version 1446632 (0.0006) [2023-12-26 11:13:17,732][123091] Updated weights for policy 0, policy_version 1456145 (0.0007) [2023-12-26 11:13:17,737][123090] Updated weights for policy 1, policy_version 1446642 (0.0008) [2023-12-26 11:13:17,787][123091] Updated weights for policy 0, policy_version 1456155 (0.0009) [2023-12-26 11:13:17,803][123090] Updated weights for policy 1, policy_version 1446652 (0.0007) [2023-12-26 11:13:17,847][123091] Updated weights for policy 0, policy_version 1456165 (0.0010) [2023-12-26 11:13:17,918][123091] Updated weights for policy 0, policy_version 1456175 (0.0010) [2023-12-26 11:13:18,591][123090] Updated weights for policy 1, policy_version 1446662 (0.0007) [2023-12-26 11:13:18,648][123090] Updated weights for policy 1, policy_version 1446672 (0.0006) [2023-12-26 11:13:18,699][123090] Updated weights for policy 1, policy_version 1446682 (0.0009) [2023-12-26 11:13:18,734][123091] Updated weights for policy 0, policy_version 1456185 (0.0007) [2023-12-26 11:13:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 743137280. Throughput: 0: 8680.3, 1: 8843.1. Samples: 743148380. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:18,785][121949] Avg episode reward: [(0, '6307.935'), (1, '5538.609')] [2023-12-26 11:13:18,794][123091] Updated weights for policy 0, policy_version 1456195 (0.0005) [2023-12-26 11:13:18,843][123091] Updated weights for policy 0, policy_version 1456205 (0.0006) [2023-12-26 11:13:19,443][123090] Updated weights for policy 1, policy_version 1446692 (0.0009) [2023-12-26 11:13:19,519][123090] Updated weights for policy 1, policy_version 1446702 (0.0009) [2023-12-26 11:13:19,587][123090] Updated weights for policy 1, policy_version 1446712 (0.0010) [2023-12-26 11:13:19,687][123091] Updated weights for policy 0, policy_version 1456215 (0.0009) [2023-12-26 11:13:19,756][123091] Updated weights for policy 0, policy_version 1456225 (0.0011) [2023-12-26 11:13:19,837][123091] Updated weights for policy 0, policy_version 1456235 (0.0011) [2023-12-26 11:13:20,435][123090] Updated weights for policy 1, policy_version 1446722 (0.0009) [2023-12-26 11:13:20,485][123090] Updated weights for policy 1, policy_version 1446732 (0.0009) [2023-12-26 11:13:20,554][123090] Updated weights for policy 1, policy_version 1446742 (0.0009) [2023-12-26 11:13:20,620][123090] Updated weights for policy 1, policy_version 1446752 (0.0009) [2023-12-26 11:13:20,689][123091] Updated weights for policy 0, policy_version 1456245 (0.0010) [2023-12-26 11:13:20,754][123091] Updated weights for policy 0, policy_version 1456255 (0.0011) [2023-12-26 11:13:20,825][123091] Updated weights for policy 0, policy_version 1456265 (0.0010) [2023-12-26 11:13:21,564][123090] Updated weights for policy 1, policy_version 1446762 (0.0009) [2023-12-26 11:13:21,569][123091] Updated weights for policy 0, policy_version 1456275 (0.0009) [2023-12-26 11:13:21,632][123090] Updated weights for policy 1, policy_version 1446772 (0.0009) [2023-12-26 11:13:21,635][123091] Updated weights for policy 0, policy_version 1456285 (0.0008) [2023-12-26 11:13:21,695][123091] Updated weights for policy 0, policy_version 1456295 (0.0007) [2023-12-26 11:13:21,696][123090] Updated weights for policy 1, policy_version 1446782 (0.0009) [2023-12-26 11:13:22,506][123090] Updated weights for policy 1, policy_version 1446792 (0.0010) [2023-12-26 11:13:22,546][123091] Updated weights for policy 0, policy_version 1456305 (0.0009) [2023-12-26 11:13:22,573][123090] Updated weights for policy 1, policy_version 1446802 (0.0010) [2023-12-26 11:13:22,602][123091] Updated weights for policy 0, policy_version 1456315 (0.0006) [2023-12-26 11:13:22,637][123090] Updated weights for policy 1, policy_version 1446812 (0.0010) [2023-12-26 11:13:22,661][123091] Updated weights for policy 0, policy_version 1456325 (0.0009) [2023-12-26 11:13:22,730][123091] Updated weights for policy 0, policy_version 1456335 (0.0009) [2023-12-26 11:13:23,448][123090] Updated weights for policy 1, policy_version 1446822 (0.0007) [2023-12-26 11:13:23,504][123090] Updated weights for policy 1, policy_version 1446832 (0.0005) [2023-12-26 11:13:23,555][123090] Updated weights for policy 1, policy_version 1446842 (0.0007) [2023-12-26 11:13:23,571][123091] Updated weights for policy 0, policy_version 1456345 (0.0007) [2023-12-26 11:13:23,625][123091] Updated weights for policy 0, policy_version 1456355 (0.0008) [2023-12-26 11:13:23,673][123091] Updated weights for policy 0, policy_version 1456365 (0.0009) [2023-12-26 11:13:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 743227392. Throughput: 0: 8690.7, 1: 8795.6. Samples: 743199184. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:23,785][121949] Avg episode reward: [(0, '6362.932'), (1, '5690.879')] [2023-12-26 11:13:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001456368_372834304.pth... [2023-12-26 11:13:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001446848_370393088.pth... [2023-12-26 11:13:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001455344_372572160.pth [2023-12-26 11:13:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001445792_370122752.pth [2023-12-26 11:13:24,330][123090] Updated weights for policy 1, policy_version 1446852 (0.0010) [2023-12-26 11:13:24,380][123090] Updated weights for policy 1, policy_version 1446862 (0.0009) [2023-12-26 11:13:24,435][123090] Updated weights for policy 1, policy_version 1446872 (0.0010) [2023-12-26 11:13:24,481][123091] Updated weights for policy 0, policy_version 1456375 (0.0008) [2023-12-26 11:13:24,538][123091] Updated weights for policy 0, policy_version 1456385 (0.0009) [2023-12-26 11:13:24,605][123091] Updated weights for policy 0, policy_version 1456395 (0.0011) [2023-12-26 11:13:25,159][123090] Updated weights for policy 1, policy_version 1446882 (0.0008) [2023-12-26 11:13:25,231][123090] Updated weights for policy 1, policy_version 1446892 (0.0005) [2023-12-26 11:13:25,299][123090] Updated weights for policy 1, policy_version 1446902 (0.0008) [2023-12-26 11:13:25,369][123090] Updated weights for policy 1, policy_version 1446912 (0.0009) [2023-12-26 11:13:25,400][123091] Updated weights for policy 0, policy_version 1456405 (0.0010) [2023-12-26 11:13:25,448][123091] Updated weights for policy 0, policy_version 1456415 (0.0009) [2023-12-26 11:13:25,497][123091] Updated weights for policy 0, policy_version 1456425 (0.0009) [2023-12-26 11:13:26,186][123090] Updated weights for policy 1, policy_version 1446922 (0.0008) [2023-12-26 11:13:26,199][123091] Updated weights for policy 0, policy_version 1456436 (0.0007) [2023-12-26 11:13:26,251][123090] Updated weights for policy 1, policy_version 1446932 (0.0007) [2023-12-26 11:13:26,257][123091] Updated weights for policy 0, policy_version 1456446 (0.0006) [2023-12-26 11:13:26,314][123090] Updated weights for policy 1, policy_version 1446942 (0.0007) [2023-12-26 11:13:26,323][123091] Updated weights for policy 0, policy_version 1456456 (0.0008) [2023-12-26 11:13:26,934][123090] Updated weights for policy 1, policy_version 1446952 (0.0010) [2023-12-26 11:13:26,992][123090] Updated weights for policy 1, policy_version 1446962 (0.0010) [2023-12-26 11:13:27,036][123091] Updated weights for policy 0, policy_version 1456466 (0.0007) [2023-12-26 11:13:27,060][123090] Updated weights for policy 1, policy_version 1446972 (0.0007) [2023-12-26 11:13:27,094][123091] Updated weights for policy 0, policy_version 1456476 (0.0011) [2023-12-26 11:13:27,159][123091] Updated weights for policy 0, policy_version 1456486 (0.0011) [2023-12-26 11:13:27,212][123091] Updated weights for policy 0, policy_version 1456496 (0.0008) [2023-12-26 11:13:27,763][123090] Updated weights for policy 1, policy_version 1446982 (0.0008) [2023-12-26 11:13:27,824][123090] Updated weights for policy 1, policy_version 1446992 (0.0010) [2023-12-26 11:13:27,871][123091] Updated weights for policy 0, policy_version 1456506 (0.0005) [2023-12-26 11:13:27,879][123090] Updated weights for policy 1, policy_version 1447002 (0.0010) [2023-12-26 11:13:27,922][123091] Updated weights for policy 0, policy_version 1456516 (0.0005) [2023-12-26 11:13:27,976][123091] Updated weights for policy 0, policy_version 1456526 (0.0005) [2023-12-26 11:13:28,619][123090] Updated weights for policy 1, policy_version 1447012 (0.0010) [2023-12-26 11:13:28,674][123091] Updated weights for policy 0, policy_version 1456536 (0.0010) [2023-12-26 11:13:28,674][123090] Updated weights for policy 1, policy_version 1447022 (0.0010) [2023-12-26 11:13:28,734][123090] Updated weights for policy 1, policy_version 1447032 (0.0006) [2023-12-26 11:13:28,740][123091] Updated weights for policy 0, policy_version 1456546 (0.0011) [2023-12-26 11:13:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 743309312. Throughput: 0: 8719.3, 1: 8867.8. Samples: 743308308. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:28,785][121949] Avg episode reward: [(0, '6336.930'), (1, '5789.419')] [2023-12-26 11:13:28,805][123091] Updated weights for policy 0, policy_version 1456556 (0.0011) [2023-12-26 11:13:29,511][123090] Updated weights for policy 1, policy_version 1447042 (0.0009) [2023-12-26 11:13:29,578][123090] Updated weights for policy 1, policy_version 1447052 (0.0010) [2023-12-26 11:13:29,580][123091] Updated weights for policy 0, policy_version 1456566 (0.0008) [2023-12-26 11:13:29,630][123090] Updated weights for policy 1, policy_version 1447062 (0.0010) [2023-12-26 11:13:29,635][123091] Updated weights for policy 0, policy_version 1456576 (0.0005) [2023-12-26 11:13:29,688][123091] Updated weights for policy 0, policy_version 1456586 (0.0006) [2023-12-26 11:13:29,689][123090] Updated weights for policy 1, policy_version 1447072 (0.0010) [2023-12-26 11:13:30,408][123090] Updated weights for policy 1, policy_version 1447082 (0.0010) [2023-12-26 11:13:30,453][123090] Updated weights for policy 1, policy_version 1447092 (0.0008) [2023-12-26 11:13:30,511][123091] Updated weights for policy 0, policy_version 1456596 (0.0006) [2023-12-26 11:13:30,513][123090] Updated weights for policy 1, policy_version 1447102 (0.0009) [2023-12-26 11:13:30,570][123091] Updated weights for policy 0, policy_version 1456607 (0.0011) [2023-12-26 11:13:30,622][123091] Updated weights for policy 0, policy_version 1456617 (0.0008) [2023-12-26 11:13:31,235][123090] Updated weights for policy 1, policy_version 1447112 (0.0010) [2023-12-26 11:13:31,295][123090] Updated weights for policy 1, policy_version 1447122 (0.0010) [2023-12-26 11:13:31,365][123090] Updated weights for policy 1, policy_version 1447132 (0.0010) [2023-12-26 11:13:31,389][123091] Updated weights for policy 0, policy_version 1456628 (0.0010) [2023-12-26 11:13:31,449][123091] Updated weights for policy 0, policy_version 1456638 (0.0010) [2023-12-26 11:13:31,509][123091] Updated weights for policy 0, policy_version 1456648 (0.0010) [2023-12-26 11:13:32,168][123090] Updated weights for policy 1, policy_version 1447142 (0.0009) [2023-12-26 11:13:32,226][123090] Updated weights for policy 1, policy_version 1447152 (0.0010) [2023-12-26 11:13:32,290][123090] Updated weights for policy 1, policy_version 1447162 (0.0011) [2023-12-26 11:13:32,383][123091] Updated weights for policy 0, policy_version 1456658 (0.0010) [2023-12-26 11:13:32,450][123091] Updated weights for policy 0, policy_version 1456668 (0.0009) [2023-12-26 11:13:32,501][123091] Updated weights for policy 0, policy_version 1456678 (0.0006) [2023-12-26 11:13:32,562][123091] Updated weights for policy 0, policy_version 1456688 (0.0006) [2023-12-26 11:13:33,114][123090] Updated weights for policy 1, policy_version 1447172 (0.0010) [2023-12-26 11:13:33,167][123090] Updated weights for policy 1, policy_version 1447182 (0.0010) [2023-12-26 11:13:33,223][123090] Updated weights for policy 1, policy_version 1447193 (0.0009) [2023-12-26 11:13:33,293][123091] Updated weights for policy 0, policy_version 1456698 (0.0005) [2023-12-26 11:13:33,341][123091] Updated weights for policy 0, policy_version 1456708 (0.0010) [2023-12-26 11:13:33,395][123091] Updated weights for policy 0, policy_version 1456718 (0.0010) [2023-12-26 11:13:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 743407616. Throughput: 0: 8753.2, 1: 8942.3. Samples: 743418152. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:33,785][121949] Avg episode reward: [(0, '6220.214'), (1, '5754.625')] [2023-12-26 11:13:33,931][123090] Updated weights for policy 1, policy_version 1447203 (0.0005) [2023-12-26 11:13:34,003][123090] Updated weights for policy 1, policy_version 1447213 (0.0005) [2023-12-26 11:13:34,073][123090] Updated weights for policy 1, policy_version 1447223 (0.0005) [2023-12-26 11:13:34,220][123091] Updated weights for policy 0, policy_version 1456728 (0.0007) [2023-12-26 11:13:34,279][123091] Updated weights for policy 0, policy_version 1456738 (0.0006) [2023-12-26 11:13:34,336][123091] Updated weights for policy 0, policy_version 1456748 (0.0009) [2023-12-26 11:13:34,700][123090] Updated weights for policy 1, policy_version 1447233 (0.0006) [2023-12-26 11:13:34,764][123090] Updated weights for policy 1, policy_version 1447243 (0.0006) [2023-12-26 11:13:34,826][123090] Updated weights for policy 1, policy_version 1447253 (0.0007) [2023-12-26 11:13:34,895][123090] Updated weights for policy 1, policy_version 1447263 (0.0009) [2023-12-26 11:13:35,127][123091] Updated weights for policy 0, policy_version 1456758 (0.0007) [2023-12-26 11:13:35,181][123091] Updated weights for policy 0, policy_version 1456768 (0.0006) [2023-12-26 11:13:35,234][123091] Updated weights for policy 0, policy_version 1456778 (0.0005) [2023-12-26 11:13:35,577][123090] Updated weights for policy 1, policy_version 1447273 (0.0005) [2023-12-26 11:13:35,627][123090] Updated weights for policy 1, policy_version 1447283 (0.0006) [2023-12-26 11:13:35,695][123090] Updated weights for policy 1, policy_version 1447293 (0.0006) [2023-12-26 11:13:35,915][123091] Updated weights for policy 0, policy_version 1456788 (0.0007) [2023-12-26 11:13:35,979][123091] Updated weights for policy 0, policy_version 1456798 (0.0005) [2023-12-26 11:13:36,041][123091] Updated weights for policy 0, policy_version 1456808 (0.0005) [2023-12-26 11:13:36,409][123090] Updated weights for policy 1, policy_version 1447303 (0.0007) [2023-12-26 11:13:36,475][123090] Updated weights for policy 1, policy_version 1447313 (0.0006) [2023-12-26 11:13:36,549][123090] Updated weights for policy 1, policy_version 1447323 (0.0006) [2023-12-26 11:13:36,777][123091] Updated weights for policy 0, policy_version 1456818 (0.0007) [2023-12-26 11:13:36,842][123091] Updated weights for policy 0, policy_version 1456828 (0.0006) [2023-12-26 11:13:36,892][123091] Updated weights for policy 0, policy_version 1456838 (0.0005) [2023-12-26 11:13:36,951][123091] Updated weights for policy 0, policy_version 1456848 (0.0006) [2023-12-26 11:13:37,329][123090] Updated weights for policy 1, policy_version 1447333 (0.0006) [2023-12-26 11:13:37,376][123090] Updated weights for policy 1, policy_version 1447343 (0.0005) [2023-12-26 11:13:37,421][123090] Updated weights for policy 1, policy_version 1447353 (0.0005) [2023-12-26 11:13:37,655][123091] Updated weights for policy 0, policy_version 1456858 (0.0005) [2023-12-26 11:13:37,717][123091] Updated weights for policy 0, policy_version 1456868 (0.0006) [2023-12-26 11:13:37,775][123091] Updated weights for policy 0, policy_version 1456878 (0.0006) [2023-12-26 11:13:38,101][123090] Updated weights for policy 1, policy_version 1447363 (0.0007) [2023-12-26 11:13:38,148][123090] Updated weights for policy 1, policy_version 1447373 (0.0009) [2023-12-26 11:13:38,206][123090] Updated weights for policy 1, policy_version 1447383 (0.0006) [2023-12-26 11:13:38,512][123091] Updated weights for policy 0, policy_version 1456888 (0.0010) [2023-12-26 11:13:38,557][123091] Updated weights for policy 0, policy_version 1456898 (0.0007) [2023-12-26 11:13:38,619][123091] Updated weights for policy 0, policy_version 1456908 (0.0008) [2023-12-26 11:13:38,784][121949] Fps is (10 sec: 19660.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 743505920. Throughput: 0: 8823.3, 1: 9027.6. Samples: 743476516. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 11:13:38,785][121949] Avg episode reward: [(0, '6167.826'), (1, '5693.795')] [2023-12-26 11:13:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001456912_372973568.pth... [2023-12-26 11:13:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001447392_370532352.pth... [2023-12-26 11:13:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001446336_370262016.pth [2023-12-26 11:13:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001455856_372703232.pth [2023-12-26 11:13:38,993][123090] Updated weights for policy 1, policy_version 1447393 (0.0006) [2023-12-26 11:13:39,050][123090] Updated weights for policy 1, policy_version 1447403 (0.0009) [2023-12-26 11:13:39,111][123090] Updated weights for policy 1, policy_version 1447413 (0.0008) [2023-12-26 11:13:39,183][123090] Updated weights for policy 1, policy_version 1447423 (0.0009) [2023-12-26 11:13:39,411][123091] Updated weights for policy 0, policy_version 1456918 (0.0009) [2023-12-26 11:13:39,482][123091] Updated weights for policy 0, policy_version 1456928 (0.0009) [2023-12-26 11:13:39,550][123091] Updated weights for policy 0, policy_version 1456938 (0.0008) [2023-12-26 11:13:39,995][123090] Updated weights for policy 1, policy_version 1447433 (0.0007) [2023-12-26 11:13:40,051][123090] Updated weights for policy 1, policy_version 1447443 (0.0007) [2023-12-26 11:13:40,108][123090] Updated weights for policy 1, policy_version 1447453 (0.0009) [2023-12-26 11:13:40,352][123091] Updated weights for policy 0, policy_version 1456948 (0.0009) [2023-12-26 11:13:40,421][123091] Updated weights for policy 0, policy_version 1456958 (0.0007) [2023-12-26 11:13:40,491][123091] Updated weights for policy 0, policy_version 1456968 (0.0009) [2023-12-26 11:13:40,918][123090] Updated weights for policy 1, policy_version 1447463 (0.0009) [2023-12-26 11:13:40,976][123090] Updated weights for policy 1, policy_version 1447473 (0.0010) [2023-12-26 11:13:41,041][123090] Updated weights for policy 1, policy_version 1447483 (0.0009) [2023-12-26 11:13:41,284][123091] Updated weights for policy 0, policy_version 1456978 (0.0009) [2023-12-26 11:13:41,354][123091] Updated weights for policy 0, policy_version 1456988 (0.0012) [2023-12-26 11:13:41,410][123091] Updated weights for policy 0, policy_version 1456998 (0.0009) [2023-12-26 11:13:41,466][123091] Updated weights for policy 0, policy_version 1457008 (0.0011) [2023-12-26 11:13:41,894][123090] Updated weights for policy 1, policy_version 1447493 (0.0007) [2023-12-26 11:13:41,972][123090] Updated weights for policy 1, policy_version 1447503 (0.0005) [2023-12-26 11:13:42,049][123090] Updated weights for policy 1, policy_version 1447513 (0.0006) [2023-12-26 11:13:42,320][123091] Updated weights for policy 0, policy_version 1457018 (0.0007) [2023-12-26 11:13:42,393][123091] Updated weights for policy 0, policy_version 1457028 (0.0013) [2023-12-26 11:13:42,465][123091] Updated weights for policy 0, policy_version 1457038 (0.0011) [2023-12-26 11:13:42,896][123090] Updated weights for policy 1, policy_version 1447523 (0.0010) [2023-12-26 11:13:42,968][123090] Updated weights for policy 1, policy_version 1447533 (0.0007) [2023-12-26 11:13:43,042][123090] Updated weights for policy 1, policy_version 1447543 (0.0007) [2023-12-26 11:13:43,156][123091] Updated weights for policy 0, policy_version 1457048 (0.0007) [2023-12-26 11:13:43,229][123091] Updated weights for policy 0, policy_version 1457058 (0.0005) [2023-12-26 11:13:43,287][123091] Updated weights for policy 0, policy_version 1457068 (0.0005) [2023-12-26 11:13:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 743587840. Throughput: 0: 8816.0, 1: 8982.4. Samples: 743584060. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:13:43,785][121949] Avg episode reward: [(0, '6298.227'), (1, '5627.691')] [2023-12-26 11:13:43,821][123090] Updated weights for policy 1, policy_version 1447553 (0.0006) [2023-12-26 11:13:43,881][123090] Updated weights for policy 1, policy_version 1447563 (0.0010) [2023-12-26 11:13:43,933][123090] Updated weights for policy 1, policy_version 1447573 (0.0006) [2023-12-26 11:13:43,986][123090] Updated weights for policy 1, policy_version 1447583 (0.0005) [2023-12-26 11:13:44,038][123091] Updated weights for policy 0, policy_version 1457079 (0.0008) [2023-12-26 11:13:44,098][123091] Updated weights for policy 0, policy_version 1457089 (0.0009) [2023-12-26 11:13:44,162][123091] Updated weights for policy 0, policy_version 1457099 (0.0009) [2023-12-26 11:13:44,713][123090] Updated weights for policy 1, policy_version 1447593 (0.0005) [2023-12-26 11:13:44,768][123090] Updated weights for policy 1, policy_version 1447603 (0.0005) [2023-12-26 11:13:44,833][123090] Updated weights for policy 1, policy_version 1447613 (0.0008) [2023-12-26 11:13:45,049][123091] Updated weights for policy 0, policy_version 1457109 (0.0007) [2023-12-26 11:13:45,116][123091] Updated weights for policy 0, policy_version 1457119 (0.0008) [2023-12-26 11:13:45,164][123091] Updated weights for policy 0, policy_version 1457129 (0.0005) [2023-12-26 11:13:45,563][123090] Updated weights for policy 1, policy_version 1447623 (0.0007) [2023-12-26 11:13:45,638][123090] Updated weights for policy 1, policy_version 1447633 (0.0006) [2023-12-26 11:13:45,705][123090] Updated weights for policy 1, policy_version 1447643 (0.0005) [2023-12-26 11:13:45,986][123091] Updated weights for policy 0, policy_version 1457139 (0.0008) [2023-12-26 11:13:46,052][123091] Updated weights for policy 0, policy_version 1457149 (0.0009) [2023-12-26 11:13:46,114][123091] Updated weights for policy 0, policy_version 1457159 (0.0010) [2023-12-26 11:13:46,404][123090] Updated weights for policy 1, policy_version 1447653 (0.0006) [2023-12-26 11:13:46,456][123090] Updated weights for policy 1, policy_version 1447663 (0.0008) [2023-12-26 11:13:46,516][123090] Updated weights for policy 1, policy_version 1447673 (0.0009) [2023-12-26 11:13:46,967][123091] Updated weights for policy 0, policy_version 1457170 (0.0010) [2023-12-26 11:13:47,020][123091] Updated weights for policy 0, policy_version 1457180 (0.0010) [2023-12-26 11:13:47,083][123091] Updated weights for policy 0, policy_version 1457190 (0.0009) [2023-12-26 11:13:47,134][123091] Updated weights for policy 0, policy_version 1457200 (0.0010) [2023-12-26 11:13:47,323][123090] Updated weights for policy 1, policy_version 1447683 (0.0007) [2023-12-26 11:13:47,386][123090] Updated weights for policy 1, policy_version 1447693 (0.0005) [2023-12-26 11:13:47,441][123090] Updated weights for policy 1, policy_version 1447703 (0.0005) [2023-12-26 11:13:48,000][123091] Updated weights for policy 0, policy_version 1457210 (0.0009) [2023-12-26 11:13:48,058][123091] Updated weights for policy 0, policy_version 1457220 (0.0009) [2023-12-26 11:13:48,110][123091] Updated weights for policy 0, policy_version 1457230 (0.0009) [2023-12-26 11:13:48,218][123090] Updated weights for policy 1, policy_version 1447713 (0.0008) [2023-12-26 11:13:48,268][123090] Updated weights for policy 1, policy_version 1447723 (0.0005) [2023-12-26 11:13:48,316][123090] Updated weights for policy 1, policy_version 1447733 (0.0005) [2023-12-26 11:13:48,375][123090] Updated weights for policy 1, policy_version 1447743 (0.0008) [2023-12-26 11:13:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 743677952. Throughput: 0: 8835.6, 1: 9032.8. Samples: 743690296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:13:48,785][121949] Avg episode reward: [(0, '6320.022'), (1, '5630.492')] [2023-12-26 11:13:49,006][123091] Updated weights for policy 0, policy_version 1457240 (0.0009) [2023-12-26 11:13:49,058][123091] Updated weights for policy 0, policy_version 1457250 (0.0010) [2023-12-26 11:13:49,117][123091] Updated weights for policy 0, policy_version 1457260 (0.0009) [2023-12-26 11:13:49,126][123090] Updated weights for policy 1, policy_version 1447753 (0.0006) [2023-12-26 11:13:49,194][123090] Updated weights for policy 1, policy_version 1447763 (0.0010) [2023-12-26 11:13:49,266][123090] Updated weights for policy 1, policy_version 1447773 (0.0011) [2023-12-26 11:13:49,936][123091] Updated weights for policy 0, policy_version 1457270 (0.0009) [2023-12-26 11:13:50,002][123091] Updated weights for policy 0, policy_version 1457280 (0.0009) [2023-12-26 11:13:50,065][123091] Updated weights for policy 0, policy_version 1457290 (0.0009) [2023-12-26 11:13:50,105][123090] Updated weights for policy 1, policy_version 1447783 (0.0007) [2023-12-26 11:13:50,160][123090] Updated weights for policy 1, policy_version 1447793 (0.0005) [2023-12-26 11:13:50,210][123090] Updated weights for policy 1, policy_version 1447803 (0.0005) [2023-12-26 11:13:50,937][123090] Updated weights for policy 1, policy_version 1447813 (0.0008) [2023-12-26 11:13:50,951][123091] Updated weights for policy 0, policy_version 1457300 (0.0009) [2023-12-26 11:13:50,998][123090] Updated weights for policy 1, policy_version 1447823 (0.0011) [2023-12-26 11:13:51,020][123091] Updated weights for policy 0, policy_version 1457310 (0.0011) [2023-12-26 11:13:51,072][123090] Updated weights for policy 1, policy_version 1447833 (0.0010) [2023-12-26 11:13:51,089][123091] Updated weights for policy 0, policy_version 1457320 (0.0009) [2023-12-26 11:13:51,875][123091] Updated weights for policy 0, policy_version 1457330 (0.0009) [2023-12-26 11:13:51,927][123091] Updated weights for policy 0, policy_version 1457340 (0.0005) [2023-12-26 11:13:51,976][123090] Updated weights for policy 1, policy_version 1447843 (0.0010) [2023-12-26 11:13:51,983][123091] Updated weights for policy 0, policy_version 1457350 (0.0006) [2023-12-26 11:13:52,029][123090] Updated weights for policy 1, policy_version 1447853 (0.0006) [2023-12-26 11:13:52,039][123091] Updated weights for policy 0, policy_version 1457360 (0.0009) [2023-12-26 11:13:52,088][123090] Updated weights for policy 1, policy_version 1447863 (0.0006) [2023-12-26 11:13:52,801][123091] Updated weights for policy 0, policy_version 1457370 (0.0010) [2023-12-26 11:13:52,849][123090] Updated weights for policy 1, policy_version 1447873 (0.0006) [2023-12-26 11:13:52,858][123091] Updated weights for policy 0, policy_version 1457380 (0.0010) [2023-12-26 11:13:52,917][123090] Updated weights for policy 1, policy_version 1447883 (0.0008) [2023-12-26 11:13:52,925][123091] Updated weights for policy 0, policy_version 1457390 (0.0009) [2023-12-26 11:13:52,984][123090] Updated weights for policy 1, policy_version 1447893 (0.0010) [2023-12-26 11:13:53,048][123090] Updated weights for policy 1, policy_version 1447903 (0.0010) [2023-12-26 11:13:53,698][123090] Updated weights for policy 1, policy_version 1447913 (0.0010) [2023-12-26 11:13:53,761][123090] Updated weights for policy 1, policy_version 1447923 (0.0007) [2023-12-26 11:13:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 743759872. Throughput: 0: 8825.8, 1: 9024.0. Samples: 743741552. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:13:53,785][121949] Avg episode reward: [(0, '6270.806'), (1, '5743.136')] [2023-12-26 11:13:53,788][123091] Updated weights for policy 0, policy_version 1457400 (0.0009) [2023-12-26 11:13:53,829][123090] Updated weights for policy 1, policy_version 1447933 (0.0007) [2023-12-26 11:13:53,840][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001447936_370671616.pth... [2023-12-26 11:13:53,843][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001446848_370393088.pth [2023-12-26 11:13:53,844][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001447936_370671616.pth [2023-12-26 11:13:53,847][123091] Updated weights for policy 0, policy_version 1457410 (0.0009) [2023-12-26 11:13:53,899][123091] Updated weights for policy 0, policy_version 1457420 (0.0009) [2023-12-26 11:13:53,916][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001457424_373104640.pth... [2023-12-26 11:13:53,919][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001456368_372834304.pth [2023-12-26 11:13:53,920][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001457424_373104640.pth [2023-12-26 11:13:54,597][123090] Updated weights for policy 1, policy_version 1447943 (0.0009) [2023-12-26 11:13:54,645][123090] Updated weights for policy 1, policy_version 1447953 (0.0009) [2023-12-26 11:13:54,709][123090] Updated weights for policy 1, policy_version 1447963 (0.0009) [2023-12-26 11:13:54,740][123091] Updated weights for policy 0, policy_version 1457430 (0.0010) [2023-12-26 11:13:54,792][123091] Updated weights for policy 0, policy_version 1457440 (0.0010) [2023-12-26 11:13:54,836][123091] Updated weights for policy 0, policy_version 1457450 (0.0009) [2023-12-26 11:13:55,515][123090] Updated weights for policy 1, policy_version 1447973 (0.0007) [2023-12-26 11:13:55,569][123090] Updated weights for policy 1, policy_version 1447983 (0.0007) [2023-12-26 11:13:55,616][123090] Updated weights for policy 1, policy_version 1447993 (0.0009) [2023-12-26 11:13:55,682][123091] Updated weights for policy 0, policy_version 1457460 (0.0009) [2023-12-26 11:13:55,730][123091] Updated weights for policy 0, policy_version 1457470 (0.0011) [2023-12-26 11:13:55,781][123091] Updated weights for policy 0, policy_version 1457480 (0.0010) [2023-12-26 11:13:56,397][123090] Updated weights for policy 1, policy_version 1448003 (0.0008) [2023-12-26 11:13:56,457][123090] Updated weights for policy 1, policy_version 1448013 (0.0005) [2023-12-26 11:13:56,515][123090] Updated weights for policy 1, policy_version 1448023 (0.0006) [2023-12-26 11:13:56,605][123091] Updated weights for policy 0, policy_version 1457490 (0.0009) [2023-12-26 11:13:56,652][123091] Updated weights for policy 0, policy_version 1457500 (0.0005) [2023-12-26 11:13:56,705][123091] Updated weights for policy 0, policy_version 1457510 (0.0007) [2023-12-26 11:13:56,758][123091] Updated weights for policy 0, policy_version 1457520 (0.0009) [2023-12-26 11:13:57,341][123090] Updated weights for policy 1, policy_version 1448033 (0.0009) [2023-12-26 11:13:57,406][123090] Updated weights for policy 1, policy_version 1448043 (0.0005) [2023-12-26 11:13:57,470][123090] Updated weights for policy 1, policy_version 1448053 (0.0005) [2023-12-26 11:13:57,511][123091] Updated weights for policy 0, policy_version 1457530 (0.0006) [2023-12-26 11:13:57,522][123090] Updated weights for policy 1, policy_version 1448063 (0.0005) [2023-12-26 11:13:57,582][123091] Updated weights for policy 0, policy_version 1457540 (0.0005) [2023-12-26 11:13:57,650][123091] Updated weights for policy 0, policy_version 1457550 (0.0009) [2023-12-26 11:13:58,185][123090] Updated weights for policy 1, policy_version 1448073 (0.0008) [2023-12-26 11:13:58,244][123090] Updated weights for policy 1, policy_version 1448083 (0.0008) [2023-12-26 11:13:58,313][123090] Updated weights for policy 1, policy_version 1448093 (0.0009) [2023-12-26 11:13:58,386][123091] Updated weights for policy 0, policy_version 1457560 (0.0010) [2023-12-26 11:13:58,454][123091] Updated weights for policy 0, policy_version 1457570 (0.0010) [2023-12-26 11:13:58,529][123091] Updated weights for policy 0, policy_version 1457580 (0.0008) [2023-12-26 11:13:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 743858176. Throughput: 0: 8831.1, 1: 9114.1. Samples: 743849188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:13:58,785][121949] Avg episode reward: [(0, '6216.044'), (1, '5695.501')] [2023-12-26 11:13:59,184][123090] Updated weights for policy 1, policy_version 1448103 (0.0009) [2023-12-26 11:13:59,256][123090] Updated weights for policy 1, policy_version 1448113 (0.0008) [2023-12-26 11:13:59,317][123090] Updated weights for policy 1, policy_version 1448123 (0.0008) [2023-12-26 11:13:59,412][123091] Updated weights for policy 0, policy_version 1457590 (0.0010) [2023-12-26 11:13:59,467][123091] Updated weights for policy 0, policy_version 1457600 (0.0010) [2023-12-26 11:13:59,514][123091] Updated weights for policy 0, policy_version 1457610 (0.0010) [2023-12-26 11:14:00,060][123090] Updated weights for policy 1, policy_version 1448133 (0.0009) [2023-12-26 11:14:00,118][123090] Updated weights for policy 1, policy_version 1448143 (0.0009) [2023-12-26 11:14:00,173][123090] Updated weights for policy 1, policy_version 1448153 (0.0010) [2023-12-26 11:14:00,305][123091] Updated weights for policy 0, policy_version 1457620 (0.0009) [2023-12-26 11:14:00,371][123091] Updated weights for policy 0, policy_version 1457630 (0.0007) [2023-12-26 11:14:00,440][123091] Updated weights for policy 0, policy_version 1457640 (0.0007) [2023-12-26 11:14:01,085][123090] Updated weights for policy 1, policy_version 1448163 (0.0010) [2023-12-26 11:14:01,156][123090] Updated weights for policy 1, policy_version 1448173 (0.0009) [2023-12-26 11:14:01,172][123091] Updated weights for policy 0, policy_version 1457650 (0.0008) [2023-12-26 11:14:01,225][123090] Updated weights for policy 1, policy_version 1448183 (0.0008) [2023-12-26 11:14:01,226][123091] Updated weights for policy 0, policy_version 1457660 (0.0006) [2023-12-26 11:14:01,288][123091] Updated weights for policy 0, policy_version 1457670 (0.0006) [2023-12-26 11:14:01,347][123091] Updated weights for policy 0, policy_version 1457680 (0.0009) [2023-12-26 11:14:02,059][123090] Updated weights for policy 1, policy_version 1448193 (0.0009) [2023-12-26 11:14:02,118][123090] Updated weights for policy 1, policy_version 1448203 (0.0006) [2023-12-26 11:14:02,123][123091] Updated weights for policy 0, policy_version 1457690 (0.0006) [2023-12-26 11:14:02,171][123090] Updated weights for policy 1, policy_version 1448213 (0.0005) [2023-12-26 11:14:02,192][123091] Updated weights for policy 0, policy_version 1457700 (0.0005) [2023-12-26 11:14:02,228][123090] Updated weights for policy 1, policy_version 1448224 (0.0009) [2023-12-26 11:14:02,264][123091] Updated weights for policy 0, policy_version 1457710 (0.0007) [2023-12-26 11:14:03,004][123090] Updated weights for policy 1, policy_version 1448234 (0.0010) [2023-12-26 11:14:03,058][123091] Updated weights for policy 0, policy_version 1457720 (0.0008) [2023-12-26 11:14:03,060][123090] Updated weights for policy 1, policy_version 1448244 (0.0009) [2023-12-26 11:14:03,108][123091] Updated weights for policy 0, policy_version 1457730 (0.0008) [2023-12-26 11:14:03,121][123090] Updated weights for policy 1, policy_version 1448254 (0.0008) [2023-12-26 11:14:03,162][123091] Updated weights for policy 0, policy_version 1457740 (0.0010) [2023-12-26 11:14:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 743940096. Throughput: 0: 8892.1, 1: 9028.2. Samples: 743954792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:03,785][121949] Avg episode reward: [(0, '6159.677'), (1, '5691.387')] [2023-12-26 11:14:03,862][123091] Updated weights for policy 0, policy_version 1457750 (0.0009) [2023-12-26 11:14:03,882][123090] Updated weights for policy 1, policy_version 1448264 (0.0007) [2023-12-26 11:14:03,925][123091] Updated weights for policy 0, policy_version 1457760 (0.0006) [2023-12-26 11:14:03,944][123090] Updated weights for policy 1, policy_version 1448274 (0.0008) [2023-12-26 11:14:03,990][123091] Updated weights for policy 0, policy_version 1457770 (0.0005) [2023-12-26 11:14:04,002][123090] Updated weights for policy 1, policy_version 1448284 (0.0008) [2023-12-26 11:14:04,695][123090] Updated weights for policy 1, policy_version 1448294 (0.0007) [2023-12-26 11:14:04,745][123090] Updated weights for policy 1, policy_version 1448304 (0.0005) [2023-12-26 11:14:04,798][123090] Updated weights for policy 1, policy_version 1448314 (0.0006) [2023-12-26 11:14:04,848][123091] Updated weights for policy 0, policy_version 1457780 (0.0008) [2023-12-26 11:14:04,899][123091] Updated weights for policy 0, policy_version 1457790 (0.0007) [2023-12-26 11:14:04,948][123091] Updated weights for policy 0, policy_version 1457800 (0.0005) [2023-12-26 11:14:05,491][123090] Updated weights for policy 1, policy_version 1448324 (0.0005) [2023-12-26 11:14:05,544][123090] Updated weights for policy 1, policy_version 1448334 (0.0007) [2023-12-26 11:14:05,602][123090] Updated weights for policy 1, policy_version 1448344 (0.0005) [2023-12-26 11:14:05,814][123091] Updated weights for policy 0, policy_version 1457810 (0.0006) [2023-12-26 11:14:05,870][123091] Updated weights for policy 0, policy_version 1457820 (0.0009) [2023-12-26 11:14:05,932][123091] Updated weights for policy 0, policy_version 1457830 (0.0005) [2023-12-26 11:14:05,990][123091] Updated weights for policy 0, policy_version 1457840 (0.0006) [2023-12-26 11:14:06,294][123090] Updated weights for policy 1, policy_version 1448354 (0.0005) [2023-12-26 11:14:06,364][123090] Updated weights for policy 1, policy_version 1448364 (0.0006) [2023-12-26 11:14:06,437][123090] Updated weights for policy 1, policy_version 1448374 (0.0010) [2023-12-26 11:14:06,508][123090] Updated weights for policy 1, policy_version 1448384 (0.0011) [2023-12-26 11:14:06,830][123091] Updated weights for policy 0, policy_version 1457850 (0.0010) [2023-12-26 11:14:06,882][123091] Updated weights for policy 0, policy_version 1457860 (0.0009) [2023-12-26 11:14:06,948][123091] Updated weights for policy 0, policy_version 1457870 (0.0009) [2023-12-26 11:14:07,153][123090] Updated weights for policy 1, policy_version 1448394 (0.0006) [2023-12-26 11:14:07,206][123090] Updated weights for policy 1, policy_version 1448404 (0.0005) [2023-12-26 11:14:07,264][123090] Updated weights for policy 1, policy_version 1448414 (0.0005) [2023-12-26 11:14:07,720][123091] Updated weights for policy 0, policy_version 1457880 (0.0007) [2023-12-26 11:14:07,787][123091] Updated weights for policy 0, policy_version 1457890 (0.0005) [2023-12-26 11:14:07,864][123091] Updated weights for policy 0, policy_version 1457900 (0.0005) [2023-12-26 11:14:07,933][123090] Updated weights for policy 1, policy_version 1448424 (0.0005) [2023-12-26 11:14:07,998][123090] Updated weights for policy 1, policy_version 1448434 (0.0005) [2023-12-26 11:14:08,061][123090] Updated weights for policy 1, policy_version 1448444 (0.0005) [2023-12-26 11:14:08,562][123091] Updated weights for policy 0, policy_version 1457910 (0.0008) [2023-12-26 11:14:08,616][123091] Updated weights for policy 0, policy_version 1457920 (0.0009) [2023-12-26 11:14:08,674][123091] Updated weights for policy 0, policy_version 1457930 (0.0010) [2023-12-26 11:14:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 744038400. Throughput: 0: 8891.2, 1: 9143.2. Samples: 744010732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:08,785][121949] Avg episode reward: [(0, '6154.502'), (1, '5654.511')] [2023-12-26 11:14:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001448448_370802688.pth... [2023-12-26 11:14:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001457936_373235712.pth... [2023-12-26 11:14:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001456912_372973568.pth [2023-12-26 11:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001447392_370532352.pth [2023-12-26 11:14:08,865][123090] Updated weights for policy 1, policy_version 1448454 (0.0008) [2023-12-26 11:14:08,929][123090] Updated weights for policy 1, policy_version 1448464 (0.0010) [2023-12-26 11:14:08,990][123090] Updated weights for policy 1, policy_version 1448474 (0.0009) [2023-12-26 11:14:09,537][123091] Updated weights for policy 0, policy_version 1457940 (0.0010) [2023-12-26 11:14:09,602][123091] Updated weights for policy 0, policy_version 1457950 (0.0009) [2023-12-26 11:14:09,666][123091] Updated weights for policy 0, policy_version 1457960 (0.0009) [2023-12-26 11:14:09,805][123090] Updated weights for policy 1, policy_version 1448484 (0.0010) [2023-12-26 11:14:09,872][123090] Updated weights for policy 1, policy_version 1448494 (0.0010) [2023-12-26 11:14:09,937][123090] Updated weights for policy 1, policy_version 1448504 (0.0011) [2023-12-26 11:14:10,470][123091] Updated weights for policy 0, policy_version 1457970 (0.0010) [2023-12-26 11:14:10,522][123091] Updated weights for policy 0, policy_version 1457980 (0.0009) [2023-12-26 11:14:10,577][123091] Updated weights for policy 0, policy_version 1457990 (0.0009) [2023-12-26 11:14:10,624][123091] Updated weights for policy 0, policy_version 1458000 (0.0009) [2023-12-26 11:14:10,767][123090] Updated weights for policy 1, policy_version 1448514 (0.0010) [2023-12-26 11:14:10,820][123090] Updated weights for policy 1, policy_version 1448524 (0.0005) [2023-12-26 11:14:10,881][123090] Updated weights for policy 1, policy_version 1448534 (0.0005) [2023-12-26 11:14:10,938][123090] Updated weights for policy 1, policy_version 1448544 (0.0005) [2023-12-26 11:14:11,509][123091] Updated weights for policy 0, policy_version 1458010 (0.0009) [2023-12-26 11:14:11,573][123091] Updated weights for policy 0, policy_version 1458020 (0.0007) [2023-12-26 11:14:11,654][123091] Updated weights for policy 0, policy_version 1458030 (0.0007) [2023-12-26 11:14:11,801][123090] Updated weights for policy 1, policy_version 1448555 (0.0008) [2023-12-26 11:14:11,865][123090] Updated weights for policy 1, policy_version 1448565 (0.0006) [2023-12-26 11:14:11,931][123090] Updated weights for policy 1, policy_version 1448575 (0.0006) [2023-12-26 11:14:12,347][123091] Updated weights for policy 0, policy_version 1458040 (0.0009) [2023-12-26 11:14:12,399][123091] Updated weights for policy 0, policy_version 1458050 (0.0009) [2023-12-26 11:14:12,458][123091] Updated weights for policy 0, policy_version 1458060 (0.0010) [2023-12-26 11:14:12,729][123090] Updated weights for policy 1, policy_version 1448585 (0.0009) [2023-12-26 11:14:12,782][123090] Updated weights for policy 1, policy_version 1448595 (0.0009) [2023-12-26 11:14:12,832][123090] Updated weights for policy 1, policy_version 1448605 (0.0009) [2023-12-26 11:14:13,239][123091] Updated weights for policy 0, policy_version 1458071 (0.0010) [2023-12-26 11:14:13,296][123091] Updated weights for policy 0, policy_version 1458081 (0.0009) [2023-12-26 11:14:13,348][123091] Updated weights for policy 0, policy_version 1458091 (0.0009) [2023-12-26 11:14:13,711][123090] Updated weights for policy 1, policy_version 1448615 (0.0009) [2023-12-26 11:14:13,764][123090] Updated weights for policy 1, policy_version 1448625 (0.0010) [2023-12-26 11:14:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 744120320. Throughput: 0: 8866.0, 1: 9122.7. Samples: 744117804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:13,785][121949] Avg episode reward: [(0, '6168.621'), (1, '5600.701')] [2023-12-26 11:14:13,825][123090] Updated weights for policy 1, policy_version 1448635 (0.0010) [2023-12-26 11:14:14,140][123091] Updated weights for policy 0, policy_version 1458101 (0.0007) [2023-12-26 11:14:14,201][123091] Updated weights for policy 0, policy_version 1458111 (0.0008) [2023-12-26 11:14:14,261][123091] Updated weights for policy 0, policy_version 1458121 (0.0009) [2023-12-26 11:14:14,701][123090] Updated weights for policy 1, policy_version 1448645 (0.0010) [2023-12-26 11:14:14,757][123090] Updated weights for policy 1, policy_version 1448655 (0.0010) [2023-12-26 11:14:14,831][123090] Updated weights for policy 1, policy_version 1448665 (0.0009) [2023-12-26 11:14:15,080][123091] Updated weights for policy 0, policy_version 1458131 (0.0010) [2023-12-26 11:14:15,146][123091] Updated weights for policy 0, policy_version 1458141 (0.0010) [2023-12-26 11:14:15,212][123091] Updated weights for policy 0, policy_version 1458151 (0.0010) [2023-12-26 11:14:15,664][123090] Updated weights for policy 1, policy_version 1448675 (0.0008) [2023-12-26 11:14:15,730][123090] Updated weights for policy 1, policy_version 1448685 (0.0008) [2023-12-26 11:14:15,793][123090] Updated weights for policy 1, policy_version 1448695 (0.0010) [2023-12-26 11:14:16,062][123091] Updated weights for policy 0, policy_version 1458161 (0.0010) [2023-12-26 11:14:16,124][123091] Updated weights for policy 0, policy_version 1458171 (0.0010) [2023-12-26 11:14:16,177][123091] Updated weights for policy 0, policy_version 1458181 (0.0009) [2023-12-26 11:14:16,229][123091] Updated weights for policy 0, policy_version 1458191 (0.0009) [2023-12-26 11:14:16,528][123090] Updated weights for policy 1, policy_version 1448705 (0.0010) [2023-12-26 11:14:16,588][123090] Updated weights for policy 1, policy_version 1448715 (0.0005) [2023-12-26 11:14:16,647][123090] Updated weights for policy 1, policy_version 1448725 (0.0010) [2023-12-26 11:14:16,693][123090] Updated weights for policy 1, policy_version 1448735 (0.0005) [2023-12-26 11:14:16,976][123091] Updated weights for policy 0, policy_version 1458201 (0.0010) [2023-12-26 11:14:17,027][123091] Updated weights for policy 0, policy_version 1458211 (0.0010) [2023-12-26 11:14:17,076][123091] Updated weights for policy 0, policy_version 1458221 (0.0010) [2023-12-26 11:14:17,364][123090] Updated weights for policy 1, policy_version 1448745 (0.0005) [2023-12-26 11:14:17,415][123090] Updated weights for policy 1, policy_version 1448755 (0.0007) [2023-12-26 11:14:17,474][123090] Updated weights for policy 1, policy_version 1448765 (0.0010) [2023-12-26 11:14:17,887][123091] Updated weights for policy 0, policy_version 1458231 (0.0007) [2023-12-26 11:14:17,944][123091] Updated weights for policy 0, policy_version 1458241 (0.0005) [2023-12-26 11:14:18,000][123091] Updated weights for policy 0, policy_version 1458251 (0.0005) [2023-12-26 11:14:18,318][123090] Updated weights for policy 1, policy_version 1448775 (0.0009) [2023-12-26 11:14:18,410][123090] Updated weights for policy 1, policy_version 1448785 (0.0011) [2023-12-26 11:14:18,479][123090] Updated weights for policy 1, policy_version 1448795 (0.0007) [2023-12-26 11:14:18,735][123091] Updated weights for policy 0, policy_version 1458261 (0.0007) [2023-12-26 11:14:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 744210432. Throughput: 0: 8853.4, 1: 9065.6. Samples: 744224508. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:18,784][121949] Avg episode reward: [(0, '6224.237'), (1, '5726.279')] [2023-12-26 11:14:18,797][123091] Updated weights for policy 0, policy_version 1458271 (0.0009) [2023-12-26 11:14:18,862][123091] Updated weights for policy 0, policy_version 1458281 (0.0009) [2023-12-26 11:14:19,271][123090] Updated weights for policy 1, policy_version 1448805 (0.0009) [2023-12-26 11:14:19,344][123090] Updated weights for policy 1, policy_version 1448815 (0.0011) [2023-12-26 11:14:19,421][123090] Updated weights for policy 1, policy_version 1448825 (0.0010) [2023-12-26 11:14:19,722][123091] Updated weights for policy 0, policy_version 1458291 (0.0009) [2023-12-26 11:14:19,790][123091] Updated weights for policy 0, policy_version 1458301 (0.0009) [2023-12-26 11:14:19,858][123091] Updated weights for policy 0, policy_version 1458311 (0.0009) [2023-12-26 11:14:20,250][123090] Updated weights for policy 1, policy_version 1448835 (0.0011) [2023-12-26 11:14:20,317][123090] Updated weights for policy 1, policy_version 1448845 (0.0010) [2023-12-26 11:14:20,388][123090] Updated weights for policy 1, policy_version 1448855 (0.0010) [2023-12-26 11:14:20,711][123091] Updated weights for policy 0, policy_version 1458321 (0.0010) [2023-12-26 11:14:20,781][123091] Updated weights for policy 0, policy_version 1458331 (0.0009) [2023-12-26 11:14:20,836][123091] Updated weights for policy 0, policy_version 1458341 (0.0009) [2023-12-26 11:14:20,904][123091] Updated weights for policy 0, policy_version 1458351 (0.0009) [2023-12-26 11:14:21,178][123090] Updated weights for policy 1, policy_version 1448865 (0.0010) [2023-12-26 11:14:21,251][123090] Updated weights for policy 1, policy_version 1448875 (0.0008) [2023-12-26 11:14:21,319][123090] Updated weights for policy 1, policy_version 1448885 (0.0008) [2023-12-26 11:14:21,391][123090] Updated weights for policy 1, policy_version 1448895 (0.0008) [2023-12-26 11:14:21,701][123091] Updated weights for policy 0, policy_version 1458361 (0.0008) [2023-12-26 11:14:21,769][123091] Updated weights for policy 0, policy_version 1458371 (0.0009) [2023-12-26 11:14:21,830][123091] Updated weights for policy 0, policy_version 1458381 (0.0009) [2023-12-26 11:14:22,252][123090] Updated weights for policy 1, policy_version 1448905 (0.0011) [2023-12-26 11:14:22,325][123090] Updated weights for policy 1, policy_version 1448915 (0.0010) [2023-12-26 11:14:22,408][123090] Updated weights for policy 1, policy_version 1448925 (0.0011) [2023-12-26 11:14:22,647][123091] Updated weights for policy 0, policy_version 1458391 (0.0009) [2023-12-26 11:14:22,705][123091] Updated weights for policy 0, policy_version 1458401 (0.0009) [2023-12-26 11:14:22,765][123091] Updated weights for policy 0, policy_version 1458411 (0.0009) [2023-12-26 11:14:23,201][123090] Updated weights for policy 1, policy_version 1448935 (0.0010) [2023-12-26 11:14:23,268][123090] Updated weights for policy 1, policy_version 1448945 (0.0010) [2023-12-26 11:14:23,336][123090] Updated weights for policy 1, policy_version 1448955 (0.0010) [2023-12-26 11:14:23,571][123091] Updated weights for policy 0, policy_version 1458421 (0.0009) [2023-12-26 11:14:23,633][123091] Updated weights for policy 0, policy_version 1458431 (0.0008) [2023-12-26 11:14:23,697][123091] Updated weights for policy 0, policy_version 1458441 (0.0009) [2023-12-26 11:14:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 744300544. Throughput: 0: 8777.2, 1: 8966.4. Samples: 744274980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:23,785][121949] Avg episode reward: [(0, '6167.191'), (1, '5867.102')] [2023-12-26 11:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001448960_370933760.pth... [2023-12-26 11:14:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001458448_373366784.pth... [2023-12-26 11:14:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001447936_370671616.pth [2023-12-26 11:14:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001457424_373104640.pth [2023-12-26 11:14:24,131][123090] Updated weights for policy 1, policy_version 1448965 (0.0008) [2023-12-26 11:14:24,185][123090] Updated weights for policy 1, policy_version 1448975 (0.0005) [2023-12-26 11:14:24,235][123090] Updated weights for policy 1, policy_version 1448985 (0.0005) [2023-12-26 11:14:24,426][123091] Updated weights for policy 0, policy_version 1458451 (0.0009) [2023-12-26 11:14:24,486][123091] Updated weights for policy 0, policy_version 1458461 (0.0009) [2023-12-26 11:14:24,559][123091] Updated weights for policy 0, policy_version 1458472 (0.0010) [2023-12-26 11:14:24,943][123090] Updated weights for policy 1, policy_version 1448995 (0.0007) [2023-12-26 11:14:25,013][123090] Updated weights for policy 1, policy_version 1449005 (0.0009) [2023-12-26 11:14:25,062][123090] Updated weights for policy 1, policy_version 1449015 (0.0005) [2023-12-26 11:14:25,365][123091] Updated weights for policy 0, policy_version 1458482 (0.0010) [2023-12-26 11:14:25,419][123091] Updated weights for policy 0, policy_version 1458492 (0.0010) [2023-12-26 11:14:25,474][123091] Updated weights for policy 0, policy_version 1458502 (0.0010) [2023-12-26 11:14:25,521][123091] Updated weights for policy 0, policy_version 1458512 (0.0010) [2023-12-26 11:14:25,798][123090] Updated weights for policy 1, policy_version 1449025 (0.0006) [2023-12-26 11:14:25,845][123090] Updated weights for policy 1, policy_version 1449035 (0.0010) [2023-12-26 11:14:25,904][123090] Updated weights for policy 1, policy_version 1449045 (0.0010) [2023-12-26 11:14:25,959][123090] Updated weights for policy 1, policy_version 1449055 (0.0010) [2023-12-26 11:14:26,305][123091] Updated weights for policy 0, policy_version 1458522 (0.0005) [2023-12-26 11:14:26,364][123091] Updated weights for policy 0, policy_version 1458532 (0.0006) [2023-12-26 11:14:26,428][123091] Updated weights for policy 0, policy_version 1458542 (0.0005) [2023-12-26 11:14:26,794][123090] Updated weights for policy 1, policy_version 1449065 (0.0006) [2023-12-26 11:14:26,851][123090] Updated weights for policy 1, policy_version 1449075 (0.0006) [2023-12-26 11:14:26,906][123090] Updated weights for policy 1, policy_version 1449085 (0.0006) [2023-12-26 11:14:27,133][123091] Updated weights for policy 0, policy_version 1458552 (0.0006) [2023-12-26 11:14:27,199][123091] Updated weights for policy 0, policy_version 1458562 (0.0011) [2023-12-26 11:14:27,253][123091] Updated weights for policy 0, policy_version 1458572 (0.0010) [2023-12-26 11:14:27,510][123090] Updated weights for policy 1, policy_version 1449095 (0.0008) [2023-12-26 11:14:27,554][123090] Updated weights for policy 1, policy_version 1449105 (0.0007) [2023-12-26 11:14:27,604][123090] Updated weights for policy 1, policy_version 1449115 (0.0005) [2023-12-26 11:14:27,993][123091] Updated weights for policy 0, policy_version 1458582 (0.0007) [2023-12-26 11:14:28,049][123091] Updated weights for policy 0, policy_version 1458592 (0.0005) [2023-12-26 11:14:28,095][123091] Updated weights for policy 0, policy_version 1458602 (0.0005) [2023-12-26 11:14:28,356][123090] Updated weights for policy 1, policy_version 1449125 (0.0006) [2023-12-26 11:14:28,427][123090] Updated weights for policy 1, policy_version 1449135 (0.0005) [2023-12-26 11:14:28,498][123090] Updated weights for policy 1, policy_version 1449145 (0.0005) [2023-12-26 11:14:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 744390656. Throughput: 0: 8763.9, 1: 9000.8. Samples: 744383472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:28,785][121949] Avg episode reward: [(0, '6218.010'), (1, '5720.106')] [2023-12-26 11:14:28,810][123091] Updated weights for policy 0, policy_version 1458612 (0.0005) [2023-12-26 11:14:28,864][123091] Updated weights for policy 0, policy_version 1458622 (0.0006) [2023-12-26 11:14:28,930][123091] Updated weights for policy 0, policy_version 1458632 (0.0007) [2023-12-26 11:14:29,146][123090] Updated weights for policy 1, policy_version 1449155 (0.0007) [2023-12-26 11:14:29,194][123090] Updated weights for policy 1, policy_version 1449165 (0.0010) [2023-12-26 11:14:29,254][123090] Updated weights for policy 1, policy_version 1449175 (0.0010) [2023-12-26 11:14:29,718][123091] Updated weights for policy 0, policy_version 1458642 (0.0006) [2023-12-26 11:14:29,767][123091] Updated weights for policy 0, policy_version 1458652 (0.0009) [2023-12-26 11:14:29,840][123091] Updated weights for policy 0, policy_version 1458662 (0.0008) [2023-12-26 11:14:29,896][123091] Updated weights for policy 0, policy_version 1458672 (0.0009) [2023-12-26 11:14:30,095][123090] Updated weights for policy 1, policy_version 1449185 (0.0010) [2023-12-26 11:14:30,160][123090] Updated weights for policy 1, policy_version 1449195 (0.0005) [2023-12-26 11:14:30,221][123090] Updated weights for policy 1, policy_version 1449205 (0.0005) [2023-12-26 11:14:30,275][123090] Updated weights for policy 1, policy_version 1449215 (0.0005) [2023-12-26 11:14:30,827][123090] Updated weights for policy 1, policy_version 1449225 (0.0008) [2023-12-26 11:14:30,837][123091] Updated weights for policy 0, policy_version 1458682 (0.0010) [2023-12-26 11:14:30,888][123090] Updated weights for policy 1, policy_version 1449235 (0.0008) [2023-12-26 11:14:30,896][123091] Updated weights for policy 0, policy_version 1458692 (0.0008) [2023-12-26 11:14:30,957][123090] Updated weights for policy 1, policy_version 1449245 (0.0008) [2023-12-26 11:14:30,960][123091] Updated weights for policy 0, policy_version 1458702 (0.0007) [2023-12-26 11:14:31,798][123090] Updated weights for policy 1, policy_version 1449255 (0.0007) [2023-12-26 11:14:31,805][123091] Updated weights for policy 0, policy_version 1458712 (0.0008) [2023-12-26 11:14:31,854][123090] Updated weights for policy 1, policy_version 1449265 (0.0009) [2023-12-26 11:14:31,857][123091] Updated weights for policy 0, policy_version 1458722 (0.0008) [2023-12-26 11:14:31,911][123091] Updated weights for policy 0, policy_version 1458732 (0.0006) [2023-12-26 11:14:31,916][123090] Updated weights for policy 1, policy_version 1449275 (0.0009) [2023-12-26 11:14:32,633][123091] Updated weights for policy 0, policy_version 1458742 (0.0006) [2023-12-26 11:14:32,695][123091] Updated weights for policy 0, policy_version 1458752 (0.0006) [2023-12-26 11:14:32,708][123090] Updated weights for policy 1, policy_version 1449285 (0.0007) [2023-12-26 11:14:32,747][123091] Updated weights for policy 0, policy_version 1458762 (0.0009) [2023-12-26 11:14:32,760][123090] Updated weights for policy 1, policy_version 1449295 (0.0005) [2023-12-26 11:14:32,817][123090] Updated weights for policy 1, policy_version 1449305 (0.0009) [2023-12-26 11:14:33,514][123091] Updated weights for policy 0, policy_version 1458772 (0.0008) [2023-12-26 11:14:33,572][123091] Updated weights for policy 0, policy_version 1458782 (0.0010) [2023-12-26 11:14:33,598][123090] Updated weights for policy 1, policy_version 1449315 (0.0008) [2023-12-26 11:14:33,634][123091] Updated weights for policy 0, policy_version 1458792 (0.0010) [2023-12-26 11:14:33,652][123090] Updated weights for policy 1, policy_version 1449325 (0.0005) [2023-12-26 11:14:33,706][123090] Updated weights for policy 1, policy_version 1449335 (0.0005) [2023-12-26 11:14:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 744488960. Throughput: 0: 8838.2, 1: 9032.6. Samples: 744494480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:33,784][121949] Avg episode reward: [(0, '6297.643'), (1, '5759.203')] [2023-12-26 11:14:34,250][123091] Updated weights for policy 0, policy_version 1458802 (0.0010) [2023-12-26 11:14:34,312][123091] Updated weights for policy 0, policy_version 1458812 (0.0008) [2023-12-26 11:14:34,319][123090] Updated weights for policy 1, policy_version 1449345 (0.0006) [2023-12-26 11:14:34,371][123091] Updated weights for policy 0, policy_version 1458822 (0.0008) [2023-12-26 11:14:34,379][123090] Updated weights for policy 1, policy_version 1449355 (0.0011) [2023-12-26 11:14:34,437][123091] Updated weights for policy 0, policy_version 1458832 (0.0008) [2023-12-26 11:14:34,443][123090] Updated weights for policy 1, policy_version 1449365 (0.0011) [2023-12-26 11:14:34,515][123090] Updated weights for policy 1, policy_version 1449375 (0.0011) [2023-12-26 11:14:35,240][123091] Updated weights for policy 0, policy_version 1458842 (0.0009) [2023-12-26 11:14:35,292][123091] Updated weights for policy 0, policy_version 1458852 (0.0009) [2023-12-26 11:14:35,336][123090] Updated weights for policy 1, policy_version 1449385 (0.0006) [2023-12-26 11:14:35,340][123091] Updated weights for policy 0, policy_version 1458862 (0.0008) [2023-12-26 11:14:35,392][123090] Updated weights for policy 1, policy_version 1449395 (0.0005) [2023-12-26 11:14:35,445][123090] Updated weights for policy 1, policy_version 1449405 (0.0005) [2023-12-26 11:14:36,167][123090] Updated weights for policy 1, policy_version 1449415 (0.0008) [2023-12-26 11:14:36,224][123090] Updated weights for policy 1, policy_version 1449425 (0.0008) [2023-12-26 11:14:36,287][123090] Updated weights for policy 1, policy_version 1449435 (0.0008) [2023-12-26 11:14:36,290][123091] Updated weights for policy 0, policy_version 1458872 (0.0008) [2023-12-26 11:14:36,349][123091] Updated weights for policy 0, policy_version 1458882 (0.0009) [2023-12-26 11:14:36,410][123091] Updated weights for policy 0, policy_version 1458892 (0.0010) [2023-12-26 11:14:37,077][123090] Updated weights for policy 1, policy_version 1449445 (0.0006) [2023-12-26 11:14:37,145][123090] Updated weights for policy 1, policy_version 1449455 (0.0005) [2023-12-26 11:14:37,212][123090] Updated weights for policy 1, policy_version 1449465 (0.0006) [2023-12-26 11:14:37,280][123091] Updated weights for policy 0, policy_version 1458902 (0.0009) [2023-12-26 11:14:37,342][123091] Updated weights for policy 0, policy_version 1458912 (0.0010) [2023-12-26 11:14:37,394][123091] Updated weights for policy 0, policy_version 1458922 (0.0009) [2023-12-26 11:14:37,908][123090] Updated weights for policy 1, policy_version 1449475 (0.0006) [2023-12-26 11:14:37,972][123090] Updated weights for policy 1, policy_version 1449485 (0.0006) [2023-12-26 11:14:38,040][123090] Updated weights for policy 1, policy_version 1449495 (0.0008) [2023-12-26 11:14:38,193][123091] Updated weights for policy 0, policy_version 1458932 (0.0010) [2023-12-26 11:14:38,250][123091] Updated weights for policy 0, policy_version 1458942 (0.0009) [2023-12-26 11:14:38,306][123091] Updated weights for policy 0, policy_version 1458952 (0.0010) [2023-12-26 11:14:38,774][123090] Updated weights for policy 1, policy_version 1449505 (0.0011) [2023-12-26 11:14:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 744570880. Throughput: 0: 8864.7, 1: 9068.8. Samples: 744548560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:38,785][121949] Avg episode reward: [(0, '6383.381'), (1, '5797.444')] [2023-12-26 11:14:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001458960_373497856.pth... [2023-12-26 11:14:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001457936_373235712.pth [2023-12-26 11:14:38,830][123090] Updated weights for policy 1, policy_version 1449515 (0.0011) [2023-12-26 11:14:38,878][123090] Updated weights for policy 1, policy_version 1449525 (0.0010) [2023-12-26 11:14:38,931][123090] Updated weights for policy 1, policy_version 1449535 (0.0011) [2023-12-26 11:14:38,937][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001449536_371081216.pth... [2023-12-26 11:14:38,942][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001448448_370802688.pth [2023-12-26 11:14:39,207][123091] Updated weights for policy 0, policy_version 1458962 (0.0010) [2023-12-26 11:14:39,270][123091] Updated weights for policy 0, policy_version 1458972 (0.0009) [2023-12-26 11:14:39,335][123091] Updated weights for policy 0, policy_version 1458982 (0.0006) [2023-12-26 11:14:39,409][123091] Updated weights for policy 0, policy_version 1458992 (0.0008) [2023-12-26 11:14:39,794][123090] Updated weights for policy 1, policy_version 1449545 (0.0007) [2023-12-26 11:14:39,868][123090] Updated weights for policy 1, policy_version 1449555 (0.0008) [2023-12-26 11:14:39,939][123090] Updated weights for policy 1, policy_version 1449565 (0.0008) [2023-12-26 11:14:40,172][123091] Updated weights for policy 0, policy_version 1459002 (0.0006) [2023-12-26 11:14:40,239][123091] Updated weights for policy 0, policy_version 1459012 (0.0008) [2023-12-26 11:14:40,305][123091] Updated weights for policy 0, policy_version 1459022 (0.0008) [2023-12-26 11:14:40,747][123090] Updated weights for policy 1, policy_version 1449575 (0.0011) [2023-12-26 11:14:40,806][123090] Updated weights for policy 1, policy_version 1449585 (0.0010) [2023-12-26 11:14:40,869][123090] Updated weights for policy 1, policy_version 1449595 (0.0010) [2023-12-26 11:14:41,019][123091] Updated weights for policy 0, policy_version 1459032 (0.0007) [2023-12-26 11:14:41,078][123091] Updated weights for policy 0, policy_version 1459042 (0.0009) [2023-12-26 11:14:41,146][123091] Updated weights for policy 0, policy_version 1459052 (0.0009) [2023-12-26 11:14:41,675][123090] Updated weights for policy 1, policy_version 1449605 (0.0011) [2023-12-26 11:14:41,735][123090] Updated weights for policy 1, policy_version 1449615 (0.0007) [2023-12-26 11:14:41,802][123090] Updated weights for policy 1, policy_version 1449625 (0.0009) [2023-12-26 11:14:41,915][123091] Updated weights for policy 0, policy_version 1459062 (0.0008) [2023-12-26 11:14:41,974][123091] Updated weights for policy 0, policy_version 1459072 (0.0008) [2023-12-26 11:14:42,027][123091] Updated weights for policy 0, policy_version 1459082 (0.0008) [2023-12-26 11:14:42,652][123090] Updated weights for policy 1, policy_version 1449635 (0.0009) [2023-12-26 11:14:42,718][123090] Updated weights for policy 1, policy_version 1449645 (0.0008) [2023-12-26 11:14:42,789][123090] Updated weights for policy 1, policy_version 1449655 (0.0005) [2023-12-26 11:14:42,854][123091] Updated weights for policy 0, policy_version 1459092 (0.0008) [2023-12-26 11:14:42,921][123091] Updated weights for policy 0, policy_version 1459102 (0.0010) [2023-12-26 11:14:42,984][123091] Updated weights for policy 0, policy_version 1459112 (0.0010) [2023-12-26 11:14:43,492][123090] Updated weights for policy 1, policy_version 1449665 (0.0009) [2023-12-26 11:14:43,566][123090] Updated weights for policy 1, policy_version 1449675 (0.0010) [2023-12-26 11:14:43,619][123090] Updated weights for policy 1, policy_version 1449685 (0.0010) [2023-12-26 11:14:43,671][123090] Updated weights for policy 1, policy_version 1449696 (0.0010) [2023-12-26 11:14:43,727][123091] Updated weights for policy 0, policy_version 1459122 (0.0009) [2023-12-26 11:14:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 744660992. Throughput: 0: 8863.3, 1: 9042.9. Samples: 744654964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:43,784][121949] Avg episode reward: [(0, '6399.259'), (1, '5695.906')] [2023-12-26 11:14:43,787][123091] Updated weights for policy 0, policy_version 1459132 (0.0010) [2023-12-26 11:14:43,840][123091] Updated weights for policy 0, policy_version 1459142 (0.0009) [2023-12-26 11:14:43,906][123091] Updated weights for policy 0, policy_version 1459152 (0.0009) [2023-12-26 11:14:44,547][123090] Updated weights for policy 1, policy_version 1449706 (0.0009) [2023-12-26 11:14:44,610][123090] Updated weights for policy 1, policy_version 1449716 (0.0009) [2023-12-26 11:14:44,670][123090] Updated weights for policy 1, policy_version 1449726 (0.0008) [2023-12-26 11:14:44,711][123091] Updated weights for policy 0, policy_version 1459162 (0.0009) [2023-12-26 11:14:44,780][123091] Updated weights for policy 0, policy_version 1459172 (0.0009) [2023-12-26 11:14:44,850][123091] Updated weights for policy 0, policy_version 1459182 (0.0006) [2023-12-26 11:14:45,527][123090] Updated weights for policy 1, policy_version 1449736 (0.0010) [2023-12-26 11:14:45,589][123090] Updated weights for policy 1, policy_version 1449746 (0.0009) [2023-12-26 11:14:45,635][123091] Updated weights for policy 0, policy_version 1459192 (0.0007) [2023-12-26 11:14:45,653][123090] Updated weights for policy 1, policy_version 1449756 (0.0008) [2023-12-26 11:14:45,696][123091] Updated weights for policy 0, policy_version 1459202 (0.0009) [2023-12-26 11:14:45,748][123091] Updated weights for policy 0, policy_version 1459212 (0.0009) [2023-12-26 11:14:46,497][123090] Updated weights for policy 1, policy_version 1449766 (0.0009) [2023-12-26 11:14:46,545][123090] Updated weights for policy 1, policy_version 1449776 (0.0009) [2023-12-26 11:14:46,582][123091] Updated weights for policy 0, policy_version 1459222 (0.0010) [2023-12-26 11:14:46,594][123090] Updated weights for policy 1, policy_version 1449786 (0.0007) [2023-12-26 11:14:46,632][123091] Updated weights for policy 0, policy_version 1459232 (0.0010) [2023-12-26 11:14:46,685][123091] Updated weights for policy 0, policy_version 1459242 (0.0008) [2023-12-26 11:14:47,431][123090] Updated weights for policy 1, policy_version 1449796 (0.0006) [2023-12-26 11:14:47,443][123091] Updated weights for policy 0, policy_version 1459252 (0.0008) [2023-12-26 11:14:47,480][123090] Updated weights for policy 1, policy_version 1449806 (0.0005) [2023-12-26 11:14:47,511][123091] Updated weights for policy 0, policy_version 1459262 (0.0006) [2023-12-26 11:14:47,542][123090] Updated weights for policy 1, policy_version 1449816 (0.0005) [2023-12-26 11:14:47,583][123091] Updated weights for policy 0, policy_version 1459272 (0.0010) [2023-12-26 11:14:48,209][123090] Updated weights for policy 1, policy_version 1449826 (0.0005) [2023-12-26 11:14:48,229][123091] Updated weights for policy 0, policy_version 1459282 (0.0008) [2023-12-26 11:14:48,267][123090] Updated weights for policy 1, policy_version 1449836 (0.0005) [2023-12-26 11:14:48,300][123091] Updated weights for policy 0, policy_version 1459292 (0.0005) [2023-12-26 11:14:48,327][123090] Updated weights for policy 1, policy_version 1449846 (0.0006) [2023-12-26 11:14:48,366][123091] Updated weights for policy 0, policy_version 1459302 (0.0008) [2023-12-26 11:14:48,391][123090] Updated weights for policy 1, policy_version 1449856 (0.0010) [2023-12-26 11:14:48,428][123091] Updated weights for policy 0, policy_version 1459312 (0.0010) [2023-12-26 11:14:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 744751104. Throughput: 0: 8870.7, 1: 9074.5. Samples: 744762324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:48,785][121949] Avg episode reward: [(0, '6347.892'), (1, '5868.690')] [2023-12-26 11:14:49,196][123090] Updated weights for policy 1, policy_version 1449866 (0.0008) [2023-12-26 11:14:49,214][123091] Updated weights for policy 0, policy_version 1459322 (0.0009) [2023-12-26 11:14:49,262][123090] Updated weights for policy 1, policy_version 1449876 (0.0012) [2023-12-26 11:14:49,283][123091] Updated weights for policy 0, policy_version 1459332 (0.0008) [2023-12-26 11:14:49,319][123090] Updated weights for policy 1, policy_version 1449886 (0.0007) [2023-12-26 11:14:49,348][123091] Updated weights for policy 0, policy_version 1459342 (0.0008) [2023-12-26 11:14:50,106][123091] Updated weights for policy 0, policy_version 1459352 (0.0010) [2023-12-26 11:14:50,173][123091] Updated weights for policy 0, policy_version 1459362 (0.0011) [2023-12-26 11:14:50,174][123090] Updated weights for policy 1, policy_version 1449896 (0.0009) [2023-12-26 11:14:50,232][123090] Updated weights for policy 1, policy_version 1449906 (0.0008) [2023-12-26 11:14:50,233][123091] Updated weights for policy 0, policy_version 1459372 (0.0011) [2023-12-26 11:14:50,299][123090] Updated weights for policy 1, policy_version 1449916 (0.0008) [2023-12-26 11:14:51,082][123091] Updated weights for policy 0, policy_version 1459382 (0.0010) [2023-12-26 11:14:51,153][123091] Updated weights for policy 0, policy_version 1459392 (0.0010) [2023-12-26 11:14:51,158][123090] Updated weights for policy 1, policy_version 1449926 (0.0008) [2023-12-26 11:14:51,215][123091] Updated weights for policy 0, policy_version 1459402 (0.0008) [2023-12-26 11:14:51,215][123090] Updated weights for policy 1, policy_version 1449936 (0.0009) [2023-12-26 11:14:51,282][123090] Updated weights for policy 1, policy_version 1449946 (0.0009) [2023-12-26 11:14:52,035][123091] Updated weights for policy 0, policy_version 1459412 (0.0009) [2023-12-26 11:14:52,088][123091] Updated weights for policy 0, policy_version 1459422 (0.0008) [2023-12-26 11:14:52,151][123091] Updated weights for policy 0, policy_version 1459432 (0.0010) [2023-12-26 11:14:52,160][123090] Updated weights for policy 1, policy_version 1449956 (0.0008) [2023-12-26 11:14:52,223][123090] Updated weights for policy 1, policy_version 1449966 (0.0010) [2023-12-26 11:14:52,308][123090] Updated weights for policy 1, policy_version 1449976 (0.0010) [2023-12-26 11:14:53,031][123091] Updated weights for policy 0, policy_version 1459442 (0.0007) [2023-12-26 11:14:53,082][123090] Updated weights for policy 1, policy_version 1449986 (0.0010) [2023-12-26 11:14:53,090][123091] Updated weights for policy 0, policy_version 1459452 (0.0009) [2023-12-26 11:14:53,147][123090] Updated weights for policy 1, policy_version 1449996 (0.0009) [2023-12-26 11:14:53,150][123091] Updated weights for policy 0, policy_version 1459462 (0.0007) [2023-12-26 11:14:53,209][123090] Updated weights for policy 1, policy_version 1450006 (0.0008) [2023-12-26 11:14:53,216][123091] Updated weights for policy 0, policy_version 1459472 (0.0009) [2023-12-26 11:14:53,279][123090] Updated weights for policy 1, policy_version 1450016 (0.0009) [2023-12-26 11:14:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 744833024. Throughput: 0: 8874.8, 1: 8950.4. Samples: 744812864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:53,784][121949] Avg episode reward: [(0, '6318.256'), (1, '5820.848')] [2023-12-26 11:14:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001450016_371204096.pth... [2023-12-26 11:14:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001459472_373628928.pth... [2023-12-26 11:14:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001448960_370933760.pth [2023-12-26 11:14:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001458448_373366784.pth [2023-12-26 11:14:54,052][123091] Updated weights for policy 0, policy_version 1459482 (0.0010) [2023-12-26 11:14:54,106][123090] Updated weights for policy 1, policy_version 1450026 (0.0008) [2023-12-26 11:14:54,113][123091] Updated weights for policy 0, policy_version 1459492 (0.0010) [2023-12-26 11:14:54,170][123090] Updated weights for policy 1, policy_version 1450036 (0.0008) [2023-12-26 11:14:54,179][123091] Updated weights for policy 0, policy_version 1459502 (0.0010) [2023-12-26 11:14:54,225][123090] Updated weights for policy 1, policy_version 1450046 (0.0009) [2023-12-26 11:14:54,918][123091] Updated weights for policy 0, policy_version 1459512 (0.0010) [2023-12-26 11:14:54,978][123091] Updated weights for policy 0, policy_version 1459522 (0.0009) [2023-12-26 11:14:55,041][123091] Updated weights for policy 0, policy_version 1459532 (0.0009) [2023-12-26 11:14:55,048][123090] Updated weights for policy 1, policy_version 1450056 (0.0006) [2023-12-26 11:14:55,104][123090] Updated weights for policy 1, policy_version 1450066 (0.0006) [2023-12-26 11:14:55,156][123090] Updated weights for policy 1, policy_version 1450076 (0.0005) [2023-12-26 11:14:55,850][123090] Updated weights for policy 1, policy_version 1450086 (0.0007) [2023-12-26 11:14:55,909][123090] Updated weights for policy 1, policy_version 1450096 (0.0009) [2023-12-26 11:14:55,930][123091] Updated weights for policy 0, policy_version 1459542 (0.0009) [2023-12-26 11:14:55,966][123090] Updated weights for policy 1, policy_version 1450106 (0.0005) [2023-12-26 11:14:55,985][123091] Updated weights for policy 0, policy_version 1459552 (0.0009) [2023-12-26 11:14:56,044][123091] Updated weights for policy 0, policy_version 1459562 (0.0006) [2023-12-26 11:14:56,720][123091] Updated weights for policy 0, policy_version 1459572 (0.0008) [2023-12-26 11:14:56,783][123091] Updated weights for policy 0, policy_version 1459582 (0.0005) [2023-12-26 11:14:56,795][123090] Updated weights for policy 1, policy_version 1450116 (0.0008) [2023-12-26 11:14:56,830][123091] Updated weights for policy 0, policy_version 1459592 (0.0006) [2023-12-26 11:14:56,850][123090] Updated weights for policy 1, policy_version 1450126 (0.0010) [2023-12-26 11:14:56,901][123090] Updated weights for policy 1, policy_version 1450136 (0.0010) [2023-12-26 11:14:57,494][123091] Updated weights for policy 0, policy_version 1459602 (0.0005) [2023-12-26 11:14:57,543][123091] Updated weights for policy 0, policy_version 1459612 (0.0005) [2023-12-26 11:14:57,588][123091] Updated weights for policy 0, policy_version 1459622 (0.0005) [2023-12-26 11:14:57,636][123091] Updated weights for policy 0, policy_version 1459632 (0.0005) [2023-12-26 11:14:57,644][123090] Updated weights for policy 1, policy_version 1450146 (0.0009) [2023-12-26 11:14:57,690][123090] Updated weights for policy 1, policy_version 1450156 (0.0005) [2023-12-26 11:14:57,746][123090] Updated weights for policy 1, policy_version 1450166 (0.0006) [2023-12-26 11:14:57,808][123090] Updated weights for policy 1, policy_version 1450176 (0.0008) [2023-12-26 11:14:58,319][123091] Updated weights for policy 0, policy_version 1459642 (0.0008) [2023-12-26 11:14:58,390][123091] Updated weights for policy 0, policy_version 1459652 (0.0009) [2023-12-26 11:14:58,462][123091] Updated weights for policy 0, policy_version 1459662 (0.0010) [2023-12-26 11:14:58,647][123090] Updated weights for policy 1, policy_version 1450186 (0.0007) [2023-12-26 11:14:58,716][123090] Updated weights for policy 1, policy_version 1450196 (0.0008) [2023-12-26 11:14:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 744923136. Throughput: 0: 8891.1, 1: 8923.9. Samples: 744919480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:14:58,785][121949] Avg episode reward: [(0, '6198.252'), (1, '5738.189')] [2023-12-26 11:14:58,789][123090] Updated weights for policy 1, policy_version 1450206 (0.0007) [2023-12-26 11:14:59,396][123091] Updated weights for policy 0, policy_version 1459672 (0.0009) [2023-12-26 11:14:59,463][123091] Updated weights for policy 0, policy_version 1459682 (0.0010) [2023-12-26 11:14:59,534][123091] Updated weights for policy 0, policy_version 1459692 (0.0009) [2023-12-26 11:14:59,592][123090] Updated weights for policy 1, policy_version 1450216 (0.0008) [2023-12-26 11:14:59,654][123090] Updated weights for policy 1, policy_version 1450226 (0.0010) [2023-12-26 11:14:59,708][123090] Updated weights for policy 1, policy_version 1450236 (0.0010) [2023-12-26 11:15:00,268][123091] Updated weights for policy 0, policy_version 1459702 (0.0009) [2023-12-26 11:15:00,312][123091] Updated weights for policy 0, policy_version 1459712 (0.0010) [2023-12-26 11:15:00,359][123091] Updated weights for policy 0, policy_version 1459722 (0.0010) [2023-12-26 11:15:00,548][123090] Updated weights for policy 1, policy_version 1450246 (0.0010) [2023-12-26 11:15:00,597][123090] Updated weights for policy 1, policy_version 1450256 (0.0009) [2023-12-26 11:15:00,654][123090] Updated weights for policy 1, policy_version 1450266 (0.0008) [2023-12-26 11:15:01,212][123091] Updated weights for policy 0, policy_version 1459732 (0.0010) [2023-12-26 11:15:01,283][123091] Updated weights for policy 0, policy_version 1459742 (0.0010) [2023-12-26 11:15:01,339][123091] Updated weights for policy 0, policy_version 1459752 (0.0011) [2023-12-26 11:15:01,525][123090] Updated weights for policy 1, policy_version 1450276 (0.0009) [2023-12-26 11:15:01,586][123090] Updated weights for policy 1, policy_version 1450286 (0.0009) [2023-12-26 11:15:01,642][123090] Updated weights for policy 1, policy_version 1450296 (0.0009) [2023-12-26 11:15:02,183][123091] Updated weights for policy 0, policy_version 1459762 (0.0011) [2023-12-26 11:15:02,235][123091] Updated weights for policy 0, policy_version 1459772 (0.0011) [2023-12-26 11:15:02,302][123091] Updated weights for policy 0, policy_version 1459782 (0.0011) [2023-12-26 11:15:02,359][123091] Updated weights for policy 0, policy_version 1459792 (0.0011) [2023-12-26 11:15:02,489][123090] Updated weights for policy 1, policy_version 1450306 (0.0009) [2023-12-26 11:15:02,556][123090] Updated weights for policy 1, policy_version 1450316 (0.0009) [2023-12-26 11:15:02,609][123090] Updated weights for policy 1, policy_version 1450326 (0.0009) [2023-12-26 11:15:02,672][123090] Updated weights for policy 1, policy_version 1450336 (0.0008) [2023-12-26 11:15:03,183][123091] Updated weights for policy 0, policy_version 1459802 (0.0010) [2023-12-26 11:15:03,244][123091] Updated weights for policy 0, policy_version 1459812 (0.0010) [2023-12-26 11:15:03,305][123091] Updated weights for policy 0, policy_version 1459822 (0.0010) [2023-12-26 11:15:03,488][123090] Updated weights for policy 1, policy_version 1450346 (0.0008) [2023-12-26 11:15:03,540][123090] Updated weights for policy 1, policy_version 1450356 (0.0009) [2023-12-26 11:15:03,588][123090] Updated weights for policy 1, policy_version 1450366 (0.0009) [2023-12-26 11:15:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 745013248. Throughput: 0: 8828.2, 1: 8892.5. Samples: 745021940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:03,785][121949] Avg episode reward: [(0, '6207.575'), (1, '5877.252')] [2023-12-26 11:15:04,100][123091] Updated weights for policy 0, policy_version 1459832 (0.0011) [2023-12-26 11:15:04,167][123091] Updated weights for policy 0, policy_version 1459842 (0.0011) [2023-12-26 11:15:04,230][123091] Updated weights for policy 0, policy_version 1459852 (0.0011) [2023-12-26 11:15:04,458][123090] Updated weights for policy 1, policy_version 1450376 (0.0010) [2023-12-26 11:15:04,532][123090] Updated weights for policy 1, policy_version 1450386 (0.0011) [2023-12-26 11:15:04,591][123090] Updated weights for policy 1, policy_version 1450396 (0.0010) [2023-12-26 11:15:04,963][123091] Updated weights for policy 0, policy_version 1459862 (0.0009) [2023-12-26 11:15:05,029][123091] Updated weights for policy 0, policy_version 1459872 (0.0010) [2023-12-26 11:15:05,087][123091] Updated weights for policy 0, policy_version 1459882 (0.0010) [2023-12-26 11:15:05,391][123090] Updated weights for policy 1, policy_version 1450406 (0.0009) [2023-12-26 11:15:05,453][123090] Updated weights for policy 1, policy_version 1450416 (0.0010) [2023-12-26 11:15:05,515][123090] Updated weights for policy 1, policy_version 1450426 (0.0010) [2023-12-26 11:15:05,861][123091] Updated weights for policy 0, policy_version 1459892 (0.0008) [2023-12-26 11:15:05,915][123091] Updated weights for policy 0, policy_version 1459902 (0.0005) [2023-12-26 11:15:05,962][123091] Updated weights for policy 0, policy_version 1459912 (0.0005) [2023-12-26 11:15:06,263][123090] Updated weights for policy 1, policy_version 1450436 (0.0007) [2023-12-26 11:15:06,328][123090] Updated weights for policy 1, policy_version 1450446 (0.0010) [2023-12-26 11:15:06,393][123090] Updated weights for policy 1, policy_version 1450456 (0.0008) [2023-12-26 11:15:06,707][123091] Updated weights for policy 0, policy_version 1459922 (0.0006) [2023-12-26 11:15:06,774][123091] Updated weights for policy 0, policy_version 1459932 (0.0007) [2023-12-26 11:15:06,836][123091] Updated weights for policy 0, policy_version 1459942 (0.0005) [2023-12-26 11:15:06,905][123091] Updated weights for policy 0, policy_version 1459952 (0.0008) [2023-12-26 11:15:07,245][123090] Updated weights for policy 1, policy_version 1450466 (0.0009) [2023-12-26 11:15:07,293][123090] Updated weights for policy 1, policy_version 1450476 (0.0009) [2023-12-26 11:15:07,341][123090] Updated weights for policy 1, policy_version 1450486 (0.0008) [2023-12-26 11:15:07,389][123090] Updated weights for policy 1, policy_version 1450496 (0.0009) [2023-12-26 11:15:07,716][123091] Updated weights for policy 0, policy_version 1459962 (0.0011) [2023-12-26 11:15:07,765][123091] Updated weights for policy 0, policy_version 1459972 (0.0011) [2023-12-26 11:15:07,813][123091] Updated weights for policy 0, policy_version 1459982 (0.0010) [2023-12-26 11:15:08,163][123090] Updated weights for policy 1, policy_version 1450506 (0.0005) [2023-12-26 11:15:08,211][123090] Updated weights for policy 1, policy_version 1450516 (0.0007) [2023-12-26 11:15:08,260][123090] Updated weights for policy 1, policy_version 1450526 (0.0005) [2023-12-26 11:15:08,561][123091] Updated weights for policy 0, policy_version 1459992 (0.0011) [2023-12-26 11:15:08,627][123091] Updated weights for policy 0, policy_version 1460002 (0.0011) [2023-12-26 11:15:08,703][123091] Updated weights for policy 0, policy_version 1460012 (0.0011) [2023-12-26 11:15:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 745103360. Throughput: 0: 8908.6, 1: 8902.7. Samples: 745076488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:08,785][121949] Avg episode reward: [(0, '6307.014'), (1, '5867.373')] [2023-12-26 11:15:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001460016_373768192.pth... [2023-12-26 11:15:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001450528_371335168.pth... [2023-12-26 11:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001458960_373497856.pth [2023-12-26 11:15:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001449536_371081216.pth [2023-12-26 11:15:09,112][123090] Updated weights for policy 1, policy_version 1450536 (0.0009) [2023-12-26 11:15:09,172][123090] Updated weights for policy 1, policy_version 1450546 (0.0010) [2023-12-26 11:15:09,237][123090] Updated weights for policy 1, policy_version 1450556 (0.0010) [2023-12-26 11:15:09,462][123091] Updated weights for policy 0, policy_version 1460022 (0.0011) [2023-12-26 11:15:09,533][123091] Updated weights for policy 0, policy_version 1460032 (0.0011) [2023-12-26 11:15:09,602][123091] Updated weights for policy 0, policy_version 1460042 (0.0011) [2023-12-26 11:15:10,181][123090] Updated weights for policy 1, policy_version 1450566 (0.0010) [2023-12-26 11:15:10,244][123090] Updated weights for policy 1, policy_version 1450576 (0.0010) [2023-12-26 11:15:10,312][123090] Updated weights for policy 1, policy_version 1450586 (0.0009) [2023-12-26 11:15:10,314][123091] Updated weights for policy 0, policy_version 1460052 (0.0009) [2023-12-26 11:15:10,380][123091] Updated weights for policy 0, policy_version 1460062 (0.0009) [2023-12-26 11:15:10,448][123091] Updated weights for policy 0, policy_version 1460072 (0.0011) [2023-12-26 11:15:11,114][123091] Updated weights for policy 0, policy_version 1460082 (0.0010) [2023-12-26 11:15:11,188][123091] Updated weights for policy 0, policy_version 1460092 (0.0010) [2023-12-26 11:15:11,221][123090] Updated weights for policy 1, policy_version 1450596 (0.0007) [2023-12-26 11:15:11,252][123091] Updated weights for policy 0, policy_version 1460102 (0.0011) [2023-12-26 11:15:11,290][123090] Updated weights for policy 1, policy_version 1450606 (0.0007) [2023-12-26 11:15:11,314][123091] Updated weights for policy 0, policy_version 1460112 (0.0011) [2023-12-26 11:15:11,360][123090] Updated weights for policy 1, policy_version 1450616 (0.0008) [2023-12-26 11:15:12,132][123091] Updated weights for policy 0, policy_version 1460122 (0.0011) [2023-12-26 11:15:12,184][123091] Updated weights for policy 0, policy_version 1460132 (0.0011) [2023-12-26 11:15:12,220][123090] Updated weights for policy 1, policy_version 1450626 (0.0009) [2023-12-26 11:15:12,236][123091] Updated weights for policy 0, policy_version 1460142 (0.0011) [2023-12-26 11:15:12,279][123090] Updated weights for policy 1, policy_version 1450636 (0.0008) [2023-12-26 11:15:12,347][123090] Updated weights for policy 1, policy_version 1450646 (0.0009) [2023-12-26 11:15:12,417][123090] Updated weights for policy 1, policy_version 1450656 (0.0010) [2023-12-26 11:15:13,002][123091] Updated weights for policy 0, policy_version 1460152 (0.0009) [2023-12-26 11:15:13,065][123091] Updated weights for policy 0, policy_version 1460162 (0.0011) [2023-12-26 11:15:13,120][123091] Updated weights for policy 0, policy_version 1460172 (0.0010) [2023-12-26 11:15:13,313][123090] Updated weights for policy 1, policy_version 1450666 (0.0008) [2023-12-26 11:15:13,370][123090] Updated weights for policy 1, policy_version 1450676 (0.0008) [2023-12-26 11:15:13,421][123090] Updated weights for policy 1, policy_version 1450686 (0.0009) [2023-12-26 11:15:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 745185280. Throughput: 0: 8932.9, 1: 8783.1. Samples: 745180692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:13,784][121949] Avg episode reward: [(0, '6224.415'), (1, '5768.017')] [2023-12-26 11:15:13,860][123091] Updated weights for policy 0, policy_version 1460182 (0.0010) [2023-12-26 11:15:13,926][123091] Updated weights for policy 0, policy_version 1460192 (0.0011) [2023-12-26 11:15:13,987][123091] Updated weights for policy 0, policy_version 1460202 (0.0011) [2023-12-26 11:15:14,278][123090] Updated weights for policy 1, policy_version 1450696 (0.0007) [2023-12-26 11:15:14,343][123090] Updated weights for policy 1, policy_version 1450706 (0.0008) [2023-12-26 11:15:14,406][123090] Updated weights for policy 1, policy_version 1450716 (0.0008) [2023-12-26 11:15:14,806][123091] Updated weights for policy 0, policy_version 1460212 (0.0011) [2023-12-26 11:15:14,874][123091] Updated weights for policy 0, policy_version 1460222 (0.0011) [2023-12-26 11:15:14,939][123091] Updated weights for policy 0, policy_version 1460232 (0.0011) [2023-12-26 11:15:15,183][123090] Updated weights for policy 1, policy_version 1450726 (0.0009) [2023-12-26 11:15:15,258][123090] Updated weights for policy 1, policy_version 1450736 (0.0009) [2023-12-26 11:15:15,328][123090] Updated weights for policy 1, policy_version 1450746 (0.0009) [2023-12-26 11:15:15,803][123091] Updated weights for policy 0, policy_version 1460242 (0.0010) [2023-12-26 11:15:15,859][123091] Updated weights for policy 0, policy_version 1460252 (0.0011) [2023-12-26 11:15:15,925][123091] Updated weights for policy 0, policy_version 1460262 (0.0010) [2023-12-26 11:15:15,976][123091] Updated weights for policy 0, policy_version 1460272 (0.0010) [2023-12-26 11:15:16,088][123090] Updated weights for policy 1, policy_version 1450756 (0.0010) [2023-12-26 11:15:16,159][123090] Updated weights for policy 1, policy_version 1450766 (0.0008) [2023-12-26 11:15:16,219][123090] Updated weights for policy 1, policy_version 1450776 (0.0007) [2023-12-26 11:15:16,807][123091] Updated weights for policy 0, policy_version 1460282 (0.0011) [2023-12-26 11:15:16,870][123091] Updated weights for policy 0, policy_version 1460292 (0.0011) [2023-12-26 11:15:16,880][123090] Updated weights for policy 1, policy_version 1450786 (0.0008) [2023-12-26 11:15:16,929][123091] Updated weights for policy 0, policy_version 1460302 (0.0010) [2023-12-26 11:15:16,942][123090] Updated weights for policy 1, policy_version 1450796 (0.0005) [2023-12-26 11:15:17,014][123090] Updated weights for policy 1, policy_version 1450806 (0.0005) [2023-12-26 11:15:17,083][123090] Updated weights for policy 1, policy_version 1450816 (0.0008) [2023-12-26 11:15:17,748][123091] Updated weights for policy 0, policy_version 1460312 (0.0011) [2023-12-26 11:15:17,797][123091] Updated weights for policy 0, policy_version 1460322 (0.0011) [2023-12-26 11:15:17,845][123091] Updated weights for policy 0, policy_version 1460332 (0.0011) [2023-12-26 11:15:17,884][123090] Updated weights for policy 1, policy_version 1450826 (0.0009) [2023-12-26 11:15:17,933][123090] Updated weights for policy 1, policy_version 1450836 (0.0009) [2023-12-26 11:15:17,981][123090] Updated weights for policy 1, policy_version 1450846 (0.0009) [2023-12-26 11:15:18,685][123091] Updated weights for policy 0, policy_version 1460342 (0.0011) [2023-12-26 11:15:18,740][123091] Updated weights for policy 0, policy_version 1460352 (0.0010) [2023-12-26 11:15:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 745267200. Throughput: 0: 8899.6, 1: 8681.9. Samples: 745285652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:18,785][121949] Avg episode reward: [(0, '6256.880'), (1, '5975.532')] [2023-12-26 11:15:18,800][123091] Updated weights for policy 0, policy_version 1460362 (0.0011) [2023-12-26 11:15:18,882][123090] Updated weights for policy 1, policy_version 1450856 (0.0010) [2023-12-26 11:15:18,943][123090] Updated weights for policy 1, policy_version 1450866 (0.0010) [2023-12-26 11:15:19,015][123090] Updated weights for policy 1, policy_version 1450876 (0.0007) [2023-12-26 11:15:19,617][123091] Updated weights for policy 0, policy_version 1460372 (0.0010) [2023-12-26 11:15:19,685][123091] Updated weights for policy 0, policy_version 1460382 (0.0008) [2023-12-26 11:15:19,753][123091] Updated weights for policy 0, policy_version 1460392 (0.0008) [2023-12-26 11:15:19,768][123090] Updated weights for policy 1, policy_version 1450886 (0.0009) [2023-12-26 11:15:19,832][123090] Updated weights for policy 1, policy_version 1450896 (0.0010) [2023-12-26 11:15:19,909][123090] Updated weights for policy 1, policy_version 1450906 (0.0008) [2023-12-26 11:15:20,492][123091] Updated weights for policy 0, policy_version 1460402 (0.0009) [2023-12-26 11:15:20,581][123091] Updated weights for policy 0, policy_version 1460412 (0.0010) [2023-12-26 11:15:20,649][123091] Updated weights for policy 0, policy_version 1460422 (0.0010) [2023-12-26 11:15:20,689][123090] Updated weights for policy 1, policy_version 1450916 (0.0010) [2023-12-26 11:15:20,718][123091] Updated weights for policy 0, policy_version 1460432 (0.0011) [2023-12-26 11:15:20,755][123090] Updated weights for policy 1, policy_version 1450926 (0.0011) [2023-12-26 11:15:20,818][123090] Updated weights for policy 1, policy_version 1450936 (0.0010) [2023-12-26 11:15:21,622][123091] Updated weights for policy 0, policy_version 1460442 (0.0010) [2023-12-26 11:15:21,693][123091] Updated weights for policy 0, policy_version 1460452 (0.0008) [2023-12-26 11:15:21,693][123090] Updated weights for policy 1, policy_version 1450946 (0.0010) [2023-12-26 11:15:21,765][123090] Updated weights for policy 1, policy_version 1450956 (0.0010) [2023-12-26 11:15:21,776][123091] Updated weights for policy 0, policy_version 1460462 (0.0008) [2023-12-26 11:15:21,835][123090] Updated weights for policy 1, policy_version 1450966 (0.0010) [2023-12-26 11:15:21,899][123090] Updated weights for policy 1, policy_version 1450976 (0.0009) [2023-12-26 11:15:22,608][123091] Updated weights for policy 0, policy_version 1460472 (0.0008) [2023-12-26 11:15:22,681][123091] Updated weights for policy 0, policy_version 1460482 (0.0010) [2023-12-26 11:15:22,739][123090] Updated weights for policy 1, policy_version 1450986 (0.0009) [2023-12-26 11:15:22,742][123091] Updated weights for policy 0, policy_version 1460492 (0.0007) [2023-12-26 11:15:22,803][123090] Updated weights for policy 1, policy_version 1450996 (0.0008) [2023-12-26 11:15:22,871][123090] Updated weights for policy 1, policy_version 1451006 (0.0008) [2023-12-26 11:15:23,585][123091] Updated weights for policy 0, policy_version 1460502 (0.0010) [2023-12-26 11:15:23,646][123091] Updated weights for policy 0, policy_version 1460512 (0.0009) [2023-12-26 11:15:23,678][123090] Updated weights for policy 1, policy_version 1451016 (0.0008) [2023-12-26 11:15:23,710][123091] Updated weights for policy 0, policy_version 1460522 (0.0008) [2023-12-26 11:15:23,746][123090] Updated weights for policy 1, policy_version 1451026 (0.0007) [2023-12-26 11:15:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 745357312. Throughput: 0: 8884.2, 1: 8628.1. Samples: 745336612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:23,785][121949] Avg episode reward: [(0, '6321.731'), (1, '5986.444')] [2023-12-26 11:15:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001460528_373899264.pth... [2023-12-26 11:15:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001459472_373628928.pth [2023-12-26 11:15:23,819][123090] Updated weights for policy 1, policy_version 1451036 (0.0009) [2023-12-26 11:15:23,847][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001451040_371466240.pth... [2023-12-26 11:15:23,850][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001450016_371204096.pth [2023-12-26 11:15:24,439][123091] Updated weights for policy 0, policy_version 1460532 (0.0007) [2023-12-26 11:15:24,502][123091] Updated weights for policy 0, policy_version 1460542 (0.0010) [2023-12-26 11:15:24,569][123091] Updated weights for policy 0, policy_version 1460552 (0.0010) [2023-12-26 11:15:24,636][123090] Updated weights for policy 1, policy_version 1451046 (0.0011) [2023-12-26 11:15:24,704][123090] Updated weights for policy 1, policy_version 1451056 (0.0011) [2023-12-26 11:15:24,761][123090] Updated weights for policy 1, policy_version 1451066 (0.0010) [2023-12-26 11:15:25,400][123091] Updated weights for policy 0, policy_version 1460562 (0.0009) [2023-12-26 11:15:25,460][123091] Updated weights for policy 0, policy_version 1460572 (0.0008) [2023-12-26 11:15:25,528][123091] Updated weights for policy 0, policy_version 1460582 (0.0009) [2023-12-26 11:15:25,555][123090] Updated weights for policy 1, policy_version 1451076 (0.0009) [2023-12-26 11:15:25,593][123091] Updated weights for policy 0, policy_version 1460592 (0.0008) [2023-12-26 11:15:25,615][123090] Updated weights for policy 1, policy_version 1451086 (0.0008) [2023-12-26 11:15:25,680][123090] Updated weights for policy 1, policy_version 1451096 (0.0008) [2023-12-26 11:15:26,390][123090] Updated weights for policy 1, policy_version 1451106 (0.0009) [2023-12-26 11:15:26,447][123090] Updated weights for policy 1, policy_version 1451116 (0.0008) [2023-12-26 11:15:26,477][123091] Updated weights for policy 0, policy_version 1460602 (0.0009) [2023-12-26 11:15:26,502][123090] Updated weights for policy 1, policy_version 1451126 (0.0009) [2023-12-26 11:15:26,531][123091] Updated weights for policy 0, policy_version 1460612 (0.0008) [2023-12-26 11:15:26,563][123090] Updated weights for policy 1, policy_version 1451136 (0.0008) [2023-12-26 11:15:26,589][123091] Updated weights for policy 0, policy_version 1460622 (0.0010) [2023-12-26 11:15:27,333][123091] Updated weights for policy 0, policy_version 1460632 (0.0006) [2023-12-26 11:15:27,333][123090] Updated weights for policy 1, policy_version 1451146 (0.0007) [2023-12-26 11:15:27,386][123091] Updated weights for policy 0, policy_version 1460642 (0.0005) [2023-12-26 11:15:27,388][123090] Updated weights for policy 1, policy_version 1451156 (0.0005) [2023-12-26 11:15:27,436][123091] Updated weights for policy 0, policy_version 1460652 (0.0006) [2023-12-26 11:15:27,441][123090] Updated weights for policy 1, policy_version 1451166 (0.0007) [2023-12-26 11:15:28,142][123090] Updated weights for policy 1, policy_version 1451176 (0.0006) [2023-12-26 11:15:28,194][123090] Updated weights for policy 1, policy_version 1451186 (0.0005) [2023-12-26 11:15:28,244][123090] Updated weights for policy 1, policy_version 1451196 (0.0005) [2023-12-26 11:15:28,246][123091] Updated weights for policy 0, policy_version 1460662 (0.0010) [2023-12-26 11:15:28,289][123091] Updated weights for policy 0, policy_version 1460672 (0.0010) [2023-12-26 11:15:28,346][123091] Updated weights for policy 0, policy_version 1460682 (0.0008) [2023-12-26 11:15:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 745447424. Throughput: 0: 8849.8, 1: 8621.1. Samples: 745441152. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:28,785][121949] Avg episode reward: [(0, '6152.463'), (1, '5866.370')] [2023-12-26 11:15:28,921][123090] Updated weights for policy 1, policy_version 1451206 (0.0005) [2023-12-26 11:15:28,985][123090] Updated weights for policy 1, policy_version 1451216 (0.0005) [2023-12-26 11:15:29,042][123090] Updated weights for policy 1, policy_version 1451226 (0.0005) [2023-12-26 11:15:29,079][123091] Updated weights for policy 0, policy_version 1460692 (0.0009) [2023-12-26 11:15:29,126][123091] Updated weights for policy 0, policy_version 1460702 (0.0010) [2023-12-26 11:15:29,170][123091] Updated weights for policy 0, policy_version 1460712 (0.0010) [2023-12-26 11:15:29,786][123090] Updated weights for policy 1, policy_version 1451236 (0.0008) [2023-12-26 11:15:29,860][123090] Updated weights for policy 1, policy_version 1451246 (0.0007) [2023-12-26 11:15:29,933][123090] Updated weights for policy 1, policy_version 1451256 (0.0007) [2023-12-26 11:15:29,976][123091] Updated weights for policy 0, policy_version 1460722 (0.0010) [2023-12-26 11:15:30,043][123091] Updated weights for policy 0, policy_version 1460732 (0.0011) [2023-12-26 11:15:30,106][123091] Updated weights for policy 0, policy_version 1460742 (0.0010) [2023-12-26 11:15:30,176][123091] Updated weights for policy 0, policy_version 1460752 (0.0010) [2023-12-26 11:15:30,695][123090] Updated weights for policy 1, policy_version 1451266 (0.0008) [2023-12-26 11:15:30,757][123090] Updated weights for policy 1, policy_version 1451276 (0.0010) [2023-12-26 11:15:30,818][123090] Updated weights for policy 1, policy_version 1451286 (0.0010) [2023-12-26 11:15:30,880][123090] Updated weights for policy 1, policy_version 1451296 (0.0010) [2023-12-26 11:15:30,936][123091] Updated weights for policy 0, policy_version 1460762 (0.0005) [2023-12-26 11:15:30,994][123091] Updated weights for policy 0, policy_version 1460772 (0.0005) [2023-12-26 11:15:31,063][123091] Updated weights for policy 0, policy_version 1460782 (0.0007) [2023-12-26 11:15:31,668][123090] Updated weights for policy 1, policy_version 1451306 (0.0009) [2023-12-26 11:15:31,737][123090] Updated weights for policy 1, policy_version 1451316 (0.0007) [2023-12-26 11:15:31,796][123090] Updated weights for policy 1, policy_version 1451326 (0.0007) [2023-12-26 11:15:31,807][123091] Updated weights for policy 0, policy_version 1460792 (0.0008) [2023-12-26 11:15:31,879][123091] Updated weights for policy 0, policy_version 1460802 (0.0008) [2023-12-26 11:15:31,938][123091] Updated weights for policy 0, policy_version 1460812 (0.0006) [2023-12-26 11:15:32,511][123090] Updated weights for policy 1, policy_version 1451336 (0.0008) [2023-12-26 11:15:32,572][123090] Updated weights for policy 1, policy_version 1451346 (0.0009) [2023-12-26 11:15:32,638][123090] Updated weights for policy 1, policy_version 1451356 (0.0009) [2023-12-26 11:15:32,677][123091] Updated weights for policy 0, policy_version 1460822 (0.0007) [2023-12-26 11:15:32,729][123091] Updated weights for policy 0, policy_version 1460832 (0.0009) [2023-12-26 11:15:32,778][123091] Updated weights for policy 0, policy_version 1460842 (0.0009) [2023-12-26 11:15:33,489][123090] Updated weights for policy 1, policy_version 1451366 (0.0010) [2023-12-26 11:15:33,523][123091] Updated weights for policy 0, policy_version 1460852 (0.0007) [2023-12-26 11:15:33,551][123090] Updated weights for policy 1, policy_version 1451376 (0.0010) [2023-12-26 11:15:33,573][123091] Updated weights for policy 0, policy_version 1460862 (0.0005) [2023-12-26 11:15:33,600][123090] Updated weights for policy 1, policy_version 1451386 (0.0010) [2023-12-26 11:15:33,620][123091] Updated weights for policy 0, policy_version 1460872 (0.0005) [2023-12-26 11:15:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 745545728. Throughput: 0: 8881.1, 1: 8652.7. Samples: 745551348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:33,785][121949] Avg episode reward: [(0, '6169.345'), (1, '5907.945')] [2023-12-26 11:15:34,267][123091] Updated weights for policy 0, policy_version 1460882 (0.0006) [2023-12-26 11:15:34,340][123091] Updated weights for policy 0, policy_version 1460892 (0.0005) [2023-12-26 11:15:34,413][123091] Updated weights for policy 0, policy_version 1460902 (0.0005) [2023-12-26 11:15:34,426][123090] Updated weights for policy 1, policy_version 1451396 (0.0011) [2023-12-26 11:15:34,480][123091] Updated weights for policy 0, policy_version 1460912 (0.0005) [2023-12-26 11:15:34,494][123090] Updated weights for policy 1, policy_version 1451406 (0.0011) [2023-12-26 11:15:34,560][123090] Updated weights for policy 1, policy_version 1451416 (0.0010) [2023-12-26 11:15:35,183][123091] Updated weights for policy 0, policy_version 1460922 (0.0010) [2023-12-26 11:15:35,255][123091] Updated weights for policy 0, policy_version 1460932 (0.0011) [2023-12-26 11:15:35,325][123091] Updated weights for policy 0, policy_version 1460942 (0.0011) [2023-12-26 11:15:35,391][123090] Updated weights for policy 1, policy_version 1451426 (0.0009) [2023-12-26 11:15:35,445][123090] Updated weights for policy 1, policy_version 1451436 (0.0005) [2023-12-26 11:15:35,494][123090] Updated weights for policy 1, policy_version 1451446 (0.0005) [2023-12-26 11:15:35,544][123090] Updated weights for policy 1, policy_version 1451456 (0.0005) [2023-12-26 11:15:36,123][123091] Updated weights for policy 0, policy_version 1460952 (0.0011) [2023-12-26 11:15:36,181][123091] Updated weights for policy 0, policy_version 1460962 (0.0011) [2023-12-26 11:15:36,245][123091] Updated weights for policy 0, policy_version 1460972 (0.0011) [2023-12-26 11:15:36,252][123090] Updated weights for policy 1, policy_version 1451466 (0.0006) [2023-12-26 11:15:36,320][123090] Updated weights for policy 1, policy_version 1451476 (0.0005) [2023-12-26 11:15:36,390][123090] Updated weights for policy 1, policy_version 1451486 (0.0005) [2023-12-26 11:15:37,067][123090] Updated weights for policy 1, policy_version 1451496 (0.0007) [2023-12-26 11:15:37,077][123091] Updated weights for policy 0, policy_version 1460982 (0.0011) [2023-12-26 11:15:37,127][123090] Updated weights for policy 1, policy_version 1451506 (0.0008) [2023-12-26 11:15:37,133][123091] Updated weights for policy 0, policy_version 1460992 (0.0010) [2023-12-26 11:15:37,188][123090] Updated weights for policy 1, policy_version 1451516 (0.0005) [2023-12-26 11:15:37,192][123091] Updated weights for policy 0, policy_version 1461002 (0.0010) [2023-12-26 11:15:37,820][123090] Updated weights for policy 1, policy_version 1451526 (0.0006) [2023-12-26 11:15:37,873][123090] Updated weights for policy 1, policy_version 1451536 (0.0009) [2023-12-26 11:15:37,889][123091] Updated weights for policy 0, policy_version 1461012 (0.0008) [2023-12-26 11:15:37,941][123090] Updated weights for policy 1, policy_version 1451546 (0.0006) [2023-12-26 11:15:37,944][123091] Updated weights for policy 0, policy_version 1461022 (0.0005) [2023-12-26 11:15:38,018][123091] Updated weights for policy 0, policy_version 1461032 (0.0006) [2023-12-26 11:15:38,635][123090] Updated weights for policy 1, policy_version 1451556 (0.0007) [2023-12-26 11:15:38,687][123090] Updated weights for policy 1, policy_version 1451566 (0.0009) [2023-12-26 11:15:38,744][123090] Updated weights for policy 1, policy_version 1451576 (0.0009) [2023-12-26 11:15:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 745627648. Throughput: 0: 8907.9, 1: 8729.2. Samples: 745606540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:15:38,785][121949] Avg episode reward: [(0, '6208.964'), (1, '5901.446')] [2023-12-26 11:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001451584_371605504.pth... [2023-12-26 11:15:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001450528_371335168.pth [2023-12-26 11:15:38,808][123091] Updated weights for policy 0, policy_version 1461042 (0.0010) [2023-12-26 11:15:38,859][123091] Updated weights for policy 0, policy_version 1461052 (0.0010) [2023-12-26 11:15:38,919][123091] Updated weights for policy 0, policy_version 1461062 (0.0011) [2023-12-26 11:15:38,971][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001461072_374038528.pth... [2023-12-26 11:15:38,974][123091] Updated weights for policy 0, policy_version 1461072 (0.0011) [2023-12-26 11:15:38,975][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001460016_373768192.pth [2023-12-26 11:15:39,601][123090] Updated weights for policy 1, policy_version 1451586 (0.0009) [2023-12-26 11:15:39,666][123090] Updated weights for policy 1, policy_version 1451596 (0.0008) [2023-12-26 11:15:39,729][123090] Updated weights for policy 1, policy_version 1451606 (0.0008) [2023-12-26 11:15:39,784][123090] Updated weights for policy 1, policy_version 1451616 (0.0006) [2023-12-26 11:15:39,885][123091] Updated weights for policy 0, policy_version 1461082 (0.0010) [2023-12-26 11:15:39,957][123091] Updated weights for policy 0, policy_version 1461092 (0.0010) [2023-12-26 11:15:40,010][123091] Updated weights for policy 0, policy_version 1461102 (0.0011) [2023-12-26 11:15:40,613][123090] Updated weights for policy 1, policy_version 1451626 (0.0005) [2023-12-26 11:15:40,686][123090] Updated weights for policy 1, policy_version 1451636 (0.0006) [2023-12-26 11:15:40,746][123090] Updated weights for policy 1, policy_version 1451646 (0.0009) [2023-12-26 11:15:40,848][123091] Updated weights for policy 0, policy_version 1461112 (0.0011) [2023-12-26 11:15:40,907][123091] Updated weights for policy 0, policy_version 1461122 (0.0011) [2023-12-26 11:15:40,970][123091] Updated weights for policy 0, policy_version 1461132 (0.0010) [2023-12-26 11:15:41,523][123090] Updated weights for policy 1, policy_version 1451656 (0.0010) [2023-12-26 11:15:41,591][123090] Updated weights for policy 1, policy_version 1451666 (0.0011) [2023-12-26 11:15:41,664][123090] Updated weights for policy 1, policy_version 1451676 (0.0014) [2023-12-26 11:15:41,881][123091] Updated weights for policy 0, policy_version 1461142 (0.0010) [2023-12-26 11:15:41,945][123091] Updated weights for policy 0, policy_version 1461152 (0.0008) [2023-12-26 11:15:42,017][123091] Updated weights for policy 0, policy_version 1461162 (0.0009) [2023-12-26 11:15:42,486][123090] Updated weights for policy 1, policy_version 1451686 (0.0010) [2023-12-26 11:15:42,545][123090] Updated weights for policy 1, policy_version 1451696 (0.0010) [2023-12-26 11:15:42,601][123090] Updated weights for policy 1, policy_version 1451706 (0.0010) [2023-12-26 11:15:42,852][123091] Updated weights for policy 0, policy_version 1461172 (0.0009) [2023-12-26 11:15:42,922][123091] Updated weights for policy 0, policy_version 1461182 (0.0009) [2023-12-26 11:15:42,986][123091] Updated weights for policy 0, policy_version 1461192 (0.0009) [2023-12-26 11:15:43,434][123090] Updated weights for policy 1, policy_version 1451716 (0.0010) [2023-12-26 11:15:43,482][123090] Updated weights for policy 1, policy_version 1451726 (0.0010) [2023-12-26 11:15:43,537][123090] Updated weights for policy 1, policy_version 1451736 (0.0010) [2023-12-26 11:15:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 745717760. Throughput: 0: 8858.2, 1: 8760.0. Samples: 745712300. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:15:43,785][121949] Avg episode reward: [(0, '6243.330'), (1, '5761.742')] [2023-12-26 11:15:43,801][123091] Updated weights for policy 0, policy_version 1461202 (0.0009) [2023-12-26 11:15:43,849][123091] Updated weights for policy 0, policy_version 1461212 (0.0009) [2023-12-26 11:15:43,903][123091] Updated weights for policy 0, policy_version 1461222 (0.0008) [2023-12-26 11:15:43,968][123091] Updated weights for policy 0, policy_version 1461232 (0.0009) [2023-12-26 11:15:44,384][123090] Updated weights for policy 1, policy_version 1451746 (0.0010) [2023-12-26 11:15:44,432][123090] Updated weights for policy 1, policy_version 1451756 (0.0010) [2023-12-26 11:15:44,480][123090] Updated weights for policy 1, policy_version 1451766 (0.0010) [2023-12-26 11:15:44,535][123090] Updated weights for policy 1, policy_version 1451776 (0.0010) [2023-12-26 11:15:44,817][123091] Updated weights for policy 0, policy_version 1461242 (0.0010) [2023-12-26 11:15:44,888][123091] Updated weights for policy 0, policy_version 1461252 (0.0008) [2023-12-26 11:15:44,944][123091] Updated weights for policy 0, policy_version 1461262 (0.0009) [2023-12-26 11:15:45,404][123090] Updated weights for policy 1, policy_version 1451786 (0.0011) [2023-12-26 11:15:45,474][123090] Updated weights for policy 1, policy_version 1451796 (0.0011) [2023-12-26 11:15:45,534][123090] Updated weights for policy 1, policy_version 1451806 (0.0010) [2023-12-26 11:15:45,757][123091] Updated weights for policy 0, policy_version 1461272 (0.0009) [2023-12-26 11:15:45,814][123091] Updated weights for policy 0, policy_version 1461282 (0.0009) [2023-12-26 11:15:45,866][123091] Updated weights for policy 0, policy_version 1461292 (0.0009) [2023-12-26 11:15:46,343][123090] Updated weights for policy 1, policy_version 1451816 (0.0010) [2023-12-26 11:15:46,398][123090] Updated weights for policy 1, policy_version 1451826 (0.0010) [2023-12-26 11:15:46,462][123090] Updated weights for policy 1, policy_version 1451836 (0.0011) [2023-12-26 11:15:46,717][123091] Updated weights for policy 0, policy_version 1461302 (0.0009) [2023-12-26 11:15:46,776][123091] Updated weights for policy 0, policy_version 1461312 (0.0009) [2023-12-26 11:15:46,827][123091] Updated weights for policy 0, policy_version 1461322 (0.0008) [2023-12-26 11:15:47,294][123090] Updated weights for policy 1, policy_version 1451846 (0.0010) [2023-12-26 11:15:47,349][123090] Updated weights for policy 1, policy_version 1451856 (0.0010) [2023-12-26 11:15:47,410][123090] Updated weights for policy 1, policy_version 1451866 (0.0010) [2023-12-26 11:15:47,658][123091] Updated weights for policy 0, policy_version 1461332 (0.0009) [2023-12-26 11:15:47,726][123091] Updated weights for policy 0, policy_version 1461342 (0.0009) [2023-12-26 11:15:47,783][123091] Updated weights for policy 0, policy_version 1461352 (0.0010) [2023-12-26 11:15:48,117][123090] Updated weights for policy 1, policy_version 1451876 (0.0008) [2023-12-26 11:15:48,181][123090] Updated weights for policy 1, policy_version 1451886 (0.0005) [2023-12-26 11:15:48,258][123090] Updated weights for policy 1, policy_version 1451896 (0.0005) [2023-12-26 11:15:48,682][123091] Updated weights for policy 0, policy_version 1461362 (0.0009) [2023-12-26 11:15:48,754][123091] Updated weights for policy 0, policy_version 1461372 (0.0009) [2023-12-26 11:15:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 745799680. Throughput: 0: 8836.5, 1: 8798.7. Samples: 745815520. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:15:48,785][121949] Avg episode reward: [(0, '6295.522'), (1, '5665.935')] [2023-12-26 11:15:48,821][123091] Updated weights for policy 0, policy_version 1461382 (0.0010) [2023-12-26 11:15:48,889][123091] Updated weights for policy 0, policy_version 1461392 (0.0009) [2023-12-26 11:15:49,007][123090] Updated weights for policy 1, policy_version 1451906 (0.0009) [2023-12-26 11:15:49,078][123090] Updated weights for policy 1, policy_version 1451916 (0.0005) [2023-12-26 11:15:49,150][123090] Updated weights for policy 1, policy_version 1451926 (0.0006) [2023-12-26 11:15:49,221][123090] Updated weights for policy 1, policy_version 1451936 (0.0011) [2023-12-26 11:15:49,635][123091] Updated weights for policy 0, policy_version 1461402 (0.0005) [2023-12-26 11:15:49,685][123091] Updated weights for policy 0, policy_version 1461412 (0.0008) [2023-12-26 11:15:49,742][123091] Updated weights for policy 0, policy_version 1461422 (0.0009) [2023-12-26 11:15:50,057][123090] Updated weights for policy 1, policy_version 1451946 (0.0009) [2023-12-26 11:15:50,119][123090] Updated weights for policy 1, policy_version 1451956 (0.0009) [2023-12-26 11:15:50,175][123090] Updated weights for policy 1, policy_version 1451966 (0.0010) [2023-12-26 11:15:50,573][123091] Updated weights for policy 0, policy_version 1461432 (0.0007) [2023-12-26 11:15:50,646][123091] Updated weights for policy 0, policy_version 1461442 (0.0006) [2023-12-26 11:15:50,711][123091] Updated weights for policy 0, policy_version 1461452 (0.0006) [2023-12-26 11:15:51,012][123090] Updated weights for policy 1, policy_version 1451976 (0.0010) [2023-12-26 11:15:51,080][123090] Updated weights for policy 1, policy_version 1451986 (0.0010) [2023-12-26 11:15:51,151][123090] Updated weights for policy 1, policy_version 1451996 (0.0009) [2023-12-26 11:15:51,436][123091] Updated weights for policy 0, policy_version 1461462 (0.0006) [2023-12-26 11:15:51,484][123091] Updated weights for policy 0, policy_version 1461472 (0.0005) [2023-12-26 11:15:51,541][123091] Updated weights for policy 0, policy_version 1461482 (0.0008) [2023-12-26 11:15:51,944][123090] Updated weights for policy 1, policy_version 1452006 (0.0009) [2023-12-26 11:15:52,000][123090] Updated weights for policy 1, policy_version 1452016 (0.0010) [2023-12-26 11:15:52,058][123090] Updated weights for policy 1, policy_version 1452026 (0.0010) [2023-12-26 11:15:52,298][123091] Updated weights for policy 0, policy_version 1461492 (0.0009) [2023-12-26 11:15:52,364][123091] Updated weights for policy 0, policy_version 1461502 (0.0010) [2023-12-26 11:15:52,428][123091] Updated weights for policy 0, policy_version 1461512 (0.0006) [2023-12-26 11:15:52,899][123090] Updated weights for policy 1, policy_version 1452036 (0.0008) [2023-12-26 11:15:52,948][123090] Updated weights for policy 1, policy_version 1452046 (0.0009) [2023-12-26 11:15:52,996][123090] Updated weights for policy 1, policy_version 1452056 (0.0009) [2023-12-26 11:15:53,153][123091] Updated weights for policy 0, policy_version 1461522 (0.0005) [2023-12-26 11:15:53,213][123091] Updated weights for policy 0, policy_version 1461532 (0.0005) [2023-12-26 11:15:53,268][123091] Updated weights for policy 0, policy_version 1461542 (0.0005) [2023-12-26 11:15:53,324][123091] Updated weights for policy 0, policy_version 1461552 (0.0007) [2023-12-26 11:15:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 745889792. Throughput: 0: 8800.4, 1: 8788.7. Samples: 745867996. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:15:53,785][121949] Avg episode reward: [(0, '6313.808'), (1, '5665.901')] [2023-12-26 11:15:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001461552_374161408.pth... [2023-12-26 11:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001452064_371728384.pth... [2023-12-26 11:15:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001460528_373899264.pth [2023-12-26 11:15:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001451040_371466240.pth [2023-12-26 11:15:53,948][123090] Updated weights for policy 1, policy_version 1452066 (0.0009) [2023-12-26 11:15:53,985][123091] Updated weights for policy 0, policy_version 1461562 (0.0006) [2023-12-26 11:15:54,002][123090] Updated weights for policy 1, policy_version 1452076 (0.0008) [2023-12-26 11:15:54,052][123091] Updated weights for policy 0, policy_version 1461572 (0.0009) [2023-12-26 11:15:54,066][123090] Updated weights for policy 1, policy_version 1452086 (0.0008) [2023-12-26 11:15:54,120][123091] Updated weights for policy 0, policy_version 1461582 (0.0011) [2023-12-26 11:15:54,133][123090] Updated weights for policy 1, policy_version 1452096 (0.0009) [2023-12-26 11:15:54,884][123091] Updated weights for policy 0, policy_version 1461592 (0.0007) [2023-12-26 11:15:54,933][123091] Updated weights for policy 0, policy_version 1461602 (0.0005) [2023-12-26 11:15:54,988][123090] Updated weights for policy 1, policy_version 1452106 (0.0011) [2023-12-26 11:15:54,993][123091] Updated weights for policy 0, policy_version 1461612 (0.0008) [2023-12-26 11:15:55,048][123090] Updated weights for policy 1, policy_version 1452116 (0.0010) [2023-12-26 11:15:55,114][123090] Updated weights for policy 1, policy_version 1452126 (0.0010) [2023-12-26 11:15:55,817][123091] Updated weights for policy 0, policy_version 1461622 (0.0011) [2023-12-26 11:15:55,886][123091] Updated weights for policy 0, policy_version 1461632 (0.0011) [2023-12-26 11:15:55,927][123090] Updated weights for policy 1, policy_version 1452136 (0.0010) [2023-12-26 11:15:55,948][123091] Updated weights for policy 0, policy_version 1461642 (0.0010) [2023-12-26 11:15:55,985][123090] Updated weights for policy 1, policy_version 1452146 (0.0010) [2023-12-26 11:15:56,043][123090] Updated weights for policy 1, policy_version 1452156 (0.0010) [2023-12-26 11:15:56,750][123091] Updated weights for policy 0, policy_version 1461652 (0.0010) [2023-12-26 11:15:56,806][123091] Updated weights for policy 0, policy_version 1461662 (0.0010) [2023-12-26 11:15:56,807][123090] Updated weights for policy 1, policy_version 1452166 (0.0010) [2023-12-26 11:15:56,859][123091] Updated weights for policy 0, policy_version 1461672 (0.0007) [2023-12-26 11:15:56,873][123090] Updated weights for policy 1, policy_version 1452176 (0.0010) [2023-12-26 11:15:56,932][123090] Updated weights for policy 1, policy_version 1452186 (0.0010) [2023-12-26 11:15:57,621][123091] Updated weights for policy 0, policy_version 1461682 (0.0009) [2023-12-26 11:15:57,660][123090] Updated weights for policy 1, policy_version 1452196 (0.0008) [2023-12-26 11:15:57,672][123091] Updated weights for policy 0, policy_version 1461692 (0.0010) [2023-12-26 11:15:57,719][123091] Updated weights for policy 0, policy_version 1461702 (0.0010) [2023-12-26 11:15:57,732][123090] Updated weights for policy 1, policy_version 1452206 (0.0006) [2023-12-26 11:15:57,770][123091] Updated weights for policy 0, policy_version 1461712 (0.0010) [2023-12-26 11:15:57,798][123090] Updated weights for policy 1, policy_version 1452216 (0.0006) [2023-12-26 11:15:58,508][123090] Updated weights for policy 1, policy_version 1452226 (0.0005) [2023-12-26 11:15:58,579][123090] Updated weights for policy 1, policy_version 1452236 (0.0006) [2023-12-26 11:15:58,639][123091] Updated weights for policy 0, policy_version 1461722 (0.0011) [2023-12-26 11:15:58,651][123090] Updated weights for policy 1, policy_version 1452246 (0.0008) [2023-12-26 11:15:58,715][123090] Updated weights for policy 1, policy_version 1452256 (0.0009) [2023-12-26 11:15:58,721][123091] Updated weights for policy 0, policy_version 1461732 (0.0009) [2023-12-26 11:15:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 745979904. Throughput: 0: 8819.3, 1: 8828.2. Samples: 745974832. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:15:58,785][121949] Avg episode reward: [(0, '6201.004'), (1, '5649.074')] [2023-12-26 11:15:58,791][123091] Updated weights for policy 0, policy_version 1461742 (0.0009) [2023-12-26 11:15:59,527][123090] Updated weights for policy 1, policy_version 1452266 (0.0010) [2023-12-26 11:15:59,592][123090] Updated weights for policy 1, policy_version 1452276 (0.0009) [2023-12-26 11:15:59,624][123091] Updated weights for policy 0, policy_version 1461752 (0.0006) [2023-12-26 11:15:59,660][123090] Updated weights for policy 1, policy_version 1452287 (0.0009) [2023-12-26 11:15:59,674][123091] Updated weights for policy 0, policy_version 1461762 (0.0005) [2023-12-26 11:15:59,727][123091] Updated weights for policy 0, policy_version 1461772 (0.0006) [2023-12-26 11:16:00,500][123090] Updated weights for policy 1, policy_version 1452297 (0.0010) [2023-12-26 11:16:00,539][123091] Updated weights for policy 0, policy_version 1461782 (0.0009) [2023-12-26 11:16:00,557][123090] Updated weights for policy 1, policy_version 1452307 (0.0007) [2023-12-26 11:16:00,586][123091] Updated weights for policy 0, policy_version 1461792 (0.0009) [2023-12-26 11:16:00,618][123090] Updated weights for policy 1, policy_version 1452317 (0.0009) [2023-12-26 11:16:00,631][123091] Updated weights for policy 0, policy_version 1461802 (0.0006) [2023-12-26 11:16:01,391][123090] Updated weights for policy 1, policy_version 1452327 (0.0010) [2023-12-26 11:16:01,439][123090] Updated weights for policy 1, policy_version 1452337 (0.0010) [2023-12-26 11:16:01,491][123090] Updated weights for policy 1, policy_version 1452347 (0.0010) [2023-12-26 11:16:01,550][123091] Updated weights for policy 0, policy_version 1461812 (0.0009) [2023-12-26 11:16:01,598][123091] Updated weights for policy 0, policy_version 1461822 (0.0008) [2023-12-26 11:16:01,670][123091] Updated weights for policy 0, policy_version 1461832 (0.0009) [2023-12-26 11:16:02,267][123090] Updated weights for policy 1, policy_version 1452357 (0.0009) [2023-12-26 11:16:02,328][123090] Updated weights for policy 1, policy_version 1452367 (0.0006) [2023-12-26 11:16:02,394][123090] Updated weights for policy 1, policy_version 1452377 (0.0008) [2023-12-26 11:16:02,541][123091] Updated weights for policy 0, policy_version 1461842 (0.0007) [2023-12-26 11:16:02,597][123091] Updated weights for policy 0, policy_version 1461852 (0.0009) [2023-12-26 11:16:02,645][123091] Updated weights for policy 0, policy_version 1461862 (0.0009) [2023-12-26 11:16:02,693][123091] Updated weights for policy 0, policy_version 1461872 (0.0009) [2023-12-26 11:16:03,176][123090] Updated weights for policy 1, policy_version 1452387 (0.0009) [2023-12-26 11:16:03,226][123090] Updated weights for policy 1, policy_version 1452397 (0.0005) [2023-12-26 11:16:03,272][123090] Updated weights for policy 1, policy_version 1452407 (0.0005) [2023-12-26 11:16:03,512][123091] Updated weights for policy 0, policy_version 1461882 (0.0010) [2023-12-26 11:16:03,566][123091] Updated weights for policy 0, policy_version 1461893 (0.0010) [2023-12-26 11:16:03,624][123091] Updated weights for policy 0, policy_version 1461904 (0.0010) [2023-12-26 11:16:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 746070016. Throughput: 0: 8756.5, 1: 8889.4. Samples: 746079716. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:03,785][121949] Avg episode reward: [(0, '6243.165'), (1, '5739.769')] [2023-12-26 11:16:03,972][123090] Updated weights for policy 1, policy_version 1452417 (0.0006) [2023-12-26 11:16:04,035][123090] Updated weights for policy 1, policy_version 1452427 (0.0008) [2023-12-26 11:16:04,103][123090] Updated weights for policy 1, policy_version 1452437 (0.0008) [2023-12-26 11:16:04,174][123090] Updated weights for policy 1, policy_version 1452447 (0.0008) [2023-12-26 11:16:04,517][123091] Updated weights for policy 0, policy_version 1461914 (0.0009) [2023-12-26 11:16:04,572][123091] Updated weights for policy 0, policy_version 1461924 (0.0010) [2023-12-26 11:16:04,639][123091] Updated weights for policy 0, policy_version 1461934 (0.0009) [2023-12-26 11:16:04,902][123090] Updated weights for policy 1, policy_version 1452457 (0.0008) [2023-12-26 11:16:04,953][123090] Updated weights for policy 1, policy_version 1452467 (0.0005) [2023-12-26 11:16:05,007][123090] Updated weights for policy 1, policy_version 1452477 (0.0005) [2023-12-26 11:16:05,468][123091] Updated weights for policy 0, policy_version 1461944 (0.0007) [2023-12-26 11:16:05,541][123091] Updated weights for policy 0, policy_version 1461954 (0.0005) [2023-12-26 11:16:05,605][123091] Updated weights for policy 0, policy_version 1461964 (0.0009) [2023-12-26 11:16:05,678][123090] Updated weights for policy 1, policy_version 1452487 (0.0009) [2023-12-26 11:16:05,733][123090] Updated weights for policy 1, policy_version 1452497 (0.0010) [2023-12-26 11:16:05,776][123090] Updated weights for policy 1, policy_version 1452507 (0.0010) [2023-12-26 11:16:06,305][123091] Updated weights for policy 0, policy_version 1461974 (0.0009) [2023-12-26 11:16:06,374][123091] Updated weights for policy 0, policy_version 1461984 (0.0009) [2023-12-26 11:16:06,423][123091] Updated weights for policy 0, policy_version 1461994 (0.0009) [2023-12-26 11:16:06,601][123090] Updated weights for policy 1, policy_version 1452517 (0.0009) [2023-12-26 11:16:06,667][123090] Updated weights for policy 1, policy_version 1452527 (0.0009) [2023-12-26 11:16:06,727][123090] Updated weights for policy 1, policy_version 1452537 (0.0011) [2023-12-26 11:16:07,287][123091] Updated weights for policy 0, policy_version 1462004 (0.0009) [2023-12-26 11:16:07,351][123091] Updated weights for policy 0, policy_version 1462014 (0.0009) [2023-12-26 11:16:07,406][123091] Updated weights for policy 0, policy_version 1462024 (0.0009) [2023-12-26 11:16:07,528][123090] Updated weights for policy 1, policy_version 1452547 (0.0009) [2023-12-26 11:16:07,589][123090] Updated weights for policy 1, policy_version 1452557 (0.0008) [2023-12-26 11:16:07,641][123090] Updated weights for policy 1, policy_version 1452567 (0.0005) [2023-12-26 11:16:08,294][123091] Updated weights for policy 0, policy_version 1462034 (0.0008) [2023-12-26 11:16:08,339][123090] Updated weights for policy 1, policy_version 1452577 (0.0006) [2023-12-26 11:16:08,357][123091] Updated weights for policy 0, policy_version 1462044 (0.0008) [2023-12-26 11:16:08,394][123090] Updated weights for policy 1, policy_version 1452587 (0.0005) [2023-12-26 11:16:08,421][123091] Updated weights for policy 0, policy_version 1462054 (0.0009) [2023-12-26 11:16:08,460][123090] Updated weights for policy 1, policy_version 1452597 (0.0006) [2023-12-26 11:16:08,484][123091] Updated weights for policy 0, policy_version 1462064 (0.0008) [2023-12-26 11:16:08,517][123090] Updated weights for policy 1, policy_version 1452607 (0.0005) [2023-12-26 11:16:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 746160128. Throughput: 0: 8777.9, 1: 8952.0. Samples: 746134460. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:08,785][121949] Avg episode reward: [(0, '6196.684'), (1, '5725.098')] [2023-12-26 11:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001452608_371867648.pth... [2023-12-26 11:16:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001462064_374292480.pth... [2023-12-26 11:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001451584_371605504.pth [2023-12-26 11:16:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001461072_374038528.pth [2023-12-26 11:16:09,212][123091] Updated weights for policy 0, policy_version 1462074 (0.0006) [2023-12-26 11:16:09,278][123091] Updated weights for policy 0, policy_version 1462084 (0.0008) [2023-12-26 11:16:09,283][123090] Updated weights for policy 1, policy_version 1452617 (0.0007) [2023-12-26 11:16:09,345][123091] Updated weights for policy 0, policy_version 1462094 (0.0006) [2023-12-26 11:16:09,346][123090] Updated weights for policy 1, policy_version 1452627 (0.0008) [2023-12-26 11:16:09,425][123090] Updated weights for policy 1, policy_version 1452637 (0.0010) [2023-12-26 11:16:10,084][123091] Updated weights for policy 0, policy_version 1462104 (0.0009) [2023-12-26 11:16:10,144][123091] Updated weights for policy 0, policy_version 1462114 (0.0010) [2023-12-26 11:16:10,206][123091] Updated weights for policy 0, policy_version 1462124 (0.0009) [2023-12-26 11:16:10,284][123090] Updated weights for policy 1, policy_version 1452647 (0.0010) [2023-12-26 11:16:10,348][123090] Updated weights for policy 1, policy_version 1452657 (0.0009) [2023-12-26 11:16:10,414][123090] Updated weights for policy 1, policy_version 1452667 (0.0008) [2023-12-26 11:16:11,068][123091] Updated weights for policy 0, policy_version 1462134 (0.0009) [2023-12-26 11:16:11,131][123091] Updated weights for policy 0, policy_version 1462144 (0.0010) [2023-12-26 11:16:11,200][123091] Updated weights for policy 0, policy_version 1462154 (0.0010) [2023-12-26 11:16:11,306][123090] Updated weights for policy 1, policy_version 1452677 (0.0010) [2023-12-26 11:16:11,386][123090] Updated weights for policy 1, policy_version 1452687 (0.0011) [2023-12-26 11:16:11,447][123090] Updated weights for policy 1, policy_version 1452697 (0.0006) [2023-12-26 11:16:11,947][123091] Updated weights for policy 0, policy_version 1462164 (0.0010) [2023-12-26 11:16:12,012][123091] Updated weights for policy 0, policy_version 1462174 (0.0010) [2023-12-26 11:16:12,080][123091] Updated weights for policy 0, policy_version 1462184 (0.0010) [2023-12-26 11:16:12,281][123090] Updated weights for policy 1, policy_version 1452707 (0.0008) [2023-12-26 11:16:12,345][123090] Updated weights for policy 1, policy_version 1452717 (0.0010) [2023-12-26 11:16:12,415][123090] Updated weights for policy 1, policy_version 1452727 (0.0010) [2023-12-26 11:16:12,940][123091] Updated weights for policy 0, policy_version 1462194 (0.0009) [2023-12-26 11:16:12,994][123091] Updated weights for policy 0, policy_version 1462204 (0.0010) [2023-12-26 11:16:13,055][123091] Updated weights for policy 0, policy_version 1462214 (0.0009) [2023-12-26 11:16:13,106][123091] Updated weights for policy 0, policy_version 1462224 (0.0008) [2023-12-26 11:16:13,237][123090] Updated weights for policy 1, policy_version 1452737 (0.0009) [2023-12-26 11:16:13,287][123090] Updated weights for policy 1, policy_version 1452747 (0.0005) [2023-12-26 11:16:13,335][123090] Updated weights for policy 1, policy_version 1452757 (0.0005) [2023-12-26 11:16:13,388][123090] Updated weights for policy 1, policy_version 1452767 (0.0005) [2023-12-26 11:16:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 746242048. Throughput: 0: 8786.8, 1: 8920.9. Samples: 746238000. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:13,785][121949] Avg episode reward: [(0, '6200.103'), (1, '5777.688')] [2023-12-26 11:16:14,042][123091] Updated weights for policy 0, policy_version 1462234 (0.0010) [2023-12-26 11:16:14,078][123090] Updated weights for policy 1, policy_version 1452777 (0.0005) [2023-12-26 11:16:14,100][123091] Updated weights for policy 0, policy_version 1462244 (0.0009) [2023-12-26 11:16:14,137][123090] Updated weights for policy 1, policy_version 1452787 (0.0005) [2023-12-26 11:16:14,167][123091] Updated weights for policy 0, policy_version 1462254 (0.0008) [2023-12-26 11:16:14,187][123090] Updated weights for policy 1, policy_version 1452797 (0.0006) [2023-12-26 11:16:14,940][123091] Updated weights for policy 0, policy_version 1462264 (0.0007) [2023-12-26 11:16:14,964][123090] Updated weights for policy 1, policy_version 1452807 (0.0008) [2023-12-26 11:16:15,002][123091] Updated weights for policy 0, policy_version 1462274 (0.0008) [2023-12-26 11:16:15,028][123090] Updated weights for policy 1, policy_version 1452817 (0.0008) [2023-12-26 11:16:15,060][123091] Updated weights for policy 0, policy_version 1462284 (0.0009) [2023-12-26 11:16:15,091][123090] Updated weights for policy 1, policy_version 1452827 (0.0009) [2023-12-26 11:16:15,862][123091] Updated weights for policy 0, policy_version 1462294 (0.0009) [2023-12-26 11:16:15,913][123091] Updated weights for policy 0, policy_version 1462304 (0.0010) [2023-12-26 11:16:15,919][123090] Updated weights for policy 1, policy_version 1452837 (0.0008) [2023-12-26 11:16:15,967][123091] Updated weights for policy 0, policy_version 1462314 (0.0008) [2023-12-26 11:16:15,975][123090] Updated weights for policy 1, policy_version 1452847 (0.0008) [2023-12-26 11:16:16,025][123090] Updated weights for policy 1, policy_version 1452857 (0.0007) [2023-12-26 11:16:16,704][123091] Updated weights for policy 0, policy_version 1462324 (0.0012) [2023-12-26 11:16:16,768][123091] Updated weights for policy 0, policy_version 1462335 (0.0009) [2023-12-26 11:16:16,818][123091] Updated weights for policy 0, policy_version 1462345 (0.0009) [2023-12-26 11:16:16,900][123090] Updated weights for policy 1, policy_version 1452867 (0.0010) [2023-12-26 11:16:16,965][123090] Updated weights for policy 1, policy_version 1452877 (0.0009) [2023-12-26 11:16:17,022][123090] Updated weights for policy 1, policy_version 1452887 (0.0009) [2023-12-26 11:16:17,636][123091] Updated weights for policy 0, policy_version 1462355 (0.0009) [2023-12-26 11:16:17,698][123091] Updated weights for policy 0, policy_version 1462365 (0.0011) [2023-12-26 11:16:17,761][123091] Updated weights for policy 0, policy_version 1462375 (0.0011) [2023-12-26 11:16:17,845][123090] Updated weights for policy 1, policy_version 1452897 (0.0009) [2023-12-26 11:16:17,907][123090] Updated weights for policy 1, policy_version 1452907 (0.0008) [2023-12-26 11:16:17,981][123090] Updated weights for policy 1, policy_version 1452917 (0.0005) [2023-12-26 11:16:18,031][123090] Updated weights for policy 1, policy_version 1452927 (0.0005) [2023-12-26 11:16:18,548][123091] Updated weights for policy 0, policy_version 1462385 (0.0010) [2023-12-26 11:16:18,607][123091] Updated weights for policy 0, policy_version 1462395 (0.0008) [2023-12-26 11:16:18,651][123091] Updated weights for policy 0, policy_version 1462405 (0.0008) [2023-12-26 11:16:18,706][123091] Updated weights for policy 0, policy_version 1462415 (0.0009) [2023-12-26 11:16:18,713][123090] Updated weights for policy 1, policy_version 1452937 (0.0007) [2023-12-26 11:16:18,773][123090] Updated weights for policy 1, policy_version 1452947 (0.0009) [2023-12-26 11:16:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 746332160. Throughput: 0: 8725.9, 1: 8910.4. Samples: 746344976. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:18,784][121949] Avg episode reward: [(0, '6256.647'), (1, '5738.277')] [2023-12-26 11:16:18,826][123090] Updated weights for policy 1, policy_version 1452957 (0.0009) [2023-12-26 11:16:19,582][123090] Updated weights for policy 1, policy_version 1452967 (0.0007) [2023-12-26 11:16:19,626][123091] Updated weights for policy 0, policy_version 1462425 (0.0010) [2023-12-26 11:16:19,644][123090] Updated weights for policy 1, policy_version 1452977 (0.0006) [2023-12-26 11:16:19,686][123091] Updated weights for policy 0, policy_version 1462435 (0.0008) [2023-12-26 11:16:19,700][123090] Updated weights for policy 1, policy_version 1452987 (0.0008) [2023-12-26 11:16:19,751][123091] Updated weights for policy 0, policy_version 1462445 (0.0009) [2023-12-26 11:16:20,525][123090] Updated weights for policy 1, policy_version 1452997 (0.0008) [2023-12-26 11:16:20,549][123091] Updated weights for policy 0, policy_version 1462455 (0.0007) [2023-12-26 11:16:20,597][123090] Updated weights for policy 1, policy_version 1453007 (0.0008) [2023-12-26 11:16:20,614][123091] Updated weights for policy 0, policy_version 1462465 (0.0007) [2023-12-26 11:16:20,652][123090] Updated weights for policy 1, policy_version 1453017 (0.0009) [2023-12-26 11:16:20,669][123091] Updated weights for policy 0, policy_version 1462475 (0.0006) [2023-12-26 11:16:21,507][123091] Updated weights for policy 0, policy_version 1462485 (0.0008) [2023-12-26 11:16:21,543][123090] Updated weights for policy 1, policy_version 1453027 (0.0010) [2023-12-26 11:16:21,569][123091] Updated weights for policy 0, policy_version 1462495 (0.0008) [2023-12-26 11:16:21,599][123090] Updated weights for policy 1, policy_version 1453037 (0.0008) [2023-12-26 11:16:21,635][123091] Updated weights for policy 0, policy_version 1462505 (0.0007) [2023-12-26 11:16:21,666][123090] Updated weights for policy 1, policy_version 1453047 (0.0010) [2023-12-26 11:16:22,432][123091] Updated weights for policy 0, policy_version 1462515 (0.0007) [2023-12-26 11:16:22,482][123091] Updated weights for policy 0, policy_version 1462525 (0.0008) [2023-12-26 11:16:22,489][123090] Updated weights for policy 1, policy_version 1453057 (0.0009) [2023-12-26 11:16:22,547][123091] Updated weights for policy 0, policy_version 1462535 (0.0006) [2023-12-26 11:16:22,550][123090] Updated weights for policy 1, policy_version 1453067 (0.0009) [2023-12-26 11:16:22,619][123090] Updated weights for policy 1, policy_version 1453077 (0.0008) [2023-12-26 11:16:22,685][123090] Updated weights for policy 1, policy_version 1453087 (0.0010) [2023-12-26 11:16:23,239][123091] Updated weights for policy 0, policy_version 1462545 (0.0007) [2023-12-26 11:16:23,312][123091] Updated weights for policy 0, policy_version 1462555 (0.0005) [2023-12-26 11:16:23,375][123091] Updated weights for policy 0, policy_version 1462565 (0.0008) [2023-12-26 11:16:23,435][123091] Updated weights for policy 0, policy_version 1462575 (0.0008) [2023-12-26 11:16:23,610][123090] Updated weights for policy 1, policy_version 1453097 (0.0010) [2023-12-26 11:16:23,665][123090] Updated weights for policy 1, policy_version 1453108 (0.0010) [2023-12-26 11:16:23,718][123090] Updated weights for policy 1, policy_version 1453118 (0.0010) [2023-12-26 11:16:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 746422272. Throughput: 0: 8671.7, 1: 8862.1. Samples: 746395560. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:23,785][121949] Avg episode reward: [(0, '6242.994'), (1, '5621.282')] [2023-12-26 11:16:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001453120_371998720.pth... [2023-12-26 11:16:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001462576_374423552.pth... [2023-12-26 11:16:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001452064_371728384.pth [2023-12-26 11:16:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001461552_374161408.pth [2023-12-26 11:16:23,998][123091] Updated weights for policy 0, policy_version 1462585 (0.0005) [2023-12-26 11:16:24,065][123091] Updated weights for policy 0, policy_version 1462595 (0.0006) [2023-12-26 11:16:24,126][123091] Updated weights for policy 0, policy_version 1462605 (0.0011) [2023-12-26 11:16:24,651][123090] Updated weights for policy 1, policy_version 1453128 (0.0009) [2023-12-26 11:16:24,704][123090] Updated weights for policy 1, policy_version 1453138 (0.0009) [2023-12-26 11:16:24,753][123090] Updated weights for policy 1, policy_version 1453148 (0.0009) [2023-12-26 11:16:24,892][123091] Updated weights for policy 0, policy_version 1462615 (0.0010) [2023-12-26 11:16:24,943][123091] Updated weights for policy 0, policy_version 1462625 (0.0009) [2023-12-26 11:16:24,994][123091] Updated weights for policy 0, policy_version 1462635 (0.0010) [2023-12-26 11:16:25,509][123090] Updated weights for policy 1, policy_version 1453158 (0.0008) [2023-12-26 11:16:25,560][123090] Updated weights for policy 1, policy_version 1453168 (0.0009) [2023-12-26 11:16:25,620][123090] Updated weights for policy 1, policy_version 1453178 (0.0009) [2023-12-26 11:16:25,878][123091] Updated weights for policy 0, policy_version 1462646 (0.0008) [2023-12-26 11:16:25,931][123091] Updated weights for policy 0, policy_version 1462656 (0.0010) [2023-12-26 11:16:25,984][123091] Updated weights for policy 0, policy_version 1462666 (0.0009) [2023-12-26 11:16:26,505][123090] Updated weights for policy 1, policy_version 1453188 (0.0010) [2023-12-26 11:16:26,570][123090] Updated weights for policy 1, policy_version 1453198 (0.0009) [2023-12-26 11:16:26,626][123090] Updated weights for policy 1, policy_version 1453208 (0.0009) [2023-12-26 11:16:26,768][123091] Updated weights for policy 0, policy_version 1462676 (0.0009) [2023-12-26 11:16:26,820][123091] Updated weights for policy 0, policy_version 1462686 (0.0006) [2023-12-26 11:16:26,891][123091] Updated weights for policy 0, policy_version 1462696 (0.0006) [2023-12-26 11:16:27,513][123091] Updated weights for policy 0, policy_version 1462706 (0.0005) [2023-12-26 11:16:27,536][123090] Updated weights for policy 1, policy_version 1453218 (0.0009) [2023-12-26 11:16:27,562][123091] Updated weights for policy 0, policy_version 1462716 (0.0005) [2023-12-26 11:16:27,586][123090] Updated weights for policy 1, policy_version 1453228 (0.0009) [2023-12-26 11:16:27,614][123091] Updated weights for policy 0, policy_version 1462726 (0.0009) [2023-12-26 11:16:27,635][123090] Updated weights for policy 1, policy_version 1453238 (0.0007) [2023-12-26 11:16:27,673][123091] Updated weights for policy 0, policy_version 1462736 (0.0007) [2023-12-26 11:16:27,693][123090] Updated weights for policy 1, policy_version 1453248 (0.0009) [2023-12-26 11:16:28,434][123091] Updated weights for policy 0, policy_version 1462746 (0.0010) [2023-12-26 11:16:28,493][123091] Updated weights for policy 0, policy_version 1462756 (0.0009) [2023-12-26 11:16:28,552][123091] Updated weights for policy 0, policy_version 1462766 (0.0009) [2023-12-26 11:16:28,576][123090] Updated weights for policy 1, policy_version 1453258 (0.0008) [2023-12-26 11:16:28,623][123090] Updated weights for policy 1, policy_version 1453268 (0.0008) [2023-12-26 11:16:28,677][123090] Updated weights for policy 1, policy_version 1453278 (0.0009) [2023-12-26 11:16:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 746512384. Throughput: 0: 8798.0, 1: 8749.9. Samples: 746501960. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:28,785][121949] Avg episode reward: [(0, '6348.045'), (1, '5620.333')] [2023-12-26 11:16:29,357][123091] Updated weights for policy 0, policy_version 1462776 (0.0008) [2023-12-26 11:16:29,428][123091] Updated weights for policy 0, policy_version 1462786 (0.0006) [2023-12-26 11:16:29,501][123091] Updated weights for policy 0, policy_version 1462796 (0.0005) [2023-12-26 11:16:29,556][123090] Updated weights for policy 1, policy_version 1453288 (0.0009) [2023-12-26 11:16:29,610][123090] Updated weights for policy 1, policy_version 1453298 (0.0009) [2023-12-26 11:16:29,669][123090] Updated weights for policy 1, policy_version 1453308 (0.0010) [2023-12-26 11:16:30,129][123091] Updated weights for policy 0, policy_version 1462806 (0.0005) [2023-12-26 11:16:30,177][123091] Updated weights for policy 0, policy_version 1462816 (0.0005) [2023-12-26 11:16:30,235][123091] Updated weights for policy 0, policy_version 1462826 (0.0005) [2023-12-26 11:16:30,607][123090] Updated weights for policy 1, policy_version 1453318 (0.0010) [2023-12-26 11:16:30,675][123090] Updated weights for policy 1, policy_version 1453328 (0.0009) [2023-12-26 11:16:30,743][123090] Updated weights for policy 1, policy_version 1453338 (0.0010) [2023-12-26 11:16:30,844][123091] Updated weights for policy 0, policy_version 1462836 (0.0005) [2023-12-26 11:16:30,896][123091] Updated weights for policy 0, policy_version 1462846 (0.0010) [2023-12-26 11:16:30,947][123091] Updated weights for policy 0, policy_version 1462856 (0.0010) [2023-12-26 11:16:31,545][123090] Updated weights for policy 1, policy_version 1453348 (0.0010) [2023-12-26 11:16:31,598][123090] Updated weights for policy 1, policy_version 1453358 (0.0010) [2023-12-26 11:16:31,671][123090] Updated weights for policy 1, policy_version 1453368 (0.0011) [2023-12-26 11:16:31,776][123091] Updated weights for policy 0, policy_version 1462866 (0.0007) [2023-12-26 11:16:31,832][123091] Updated weights for policy 0, policy_version 1462876 (0.0008) [2023-12-26 11:16:31,890][123091] Updated weights for policy 0, policy_version 1462886 (0.0008) [2023-12-26 11:16:31,955][123091] Updated weights for policy 0, policy_version 1462896 (0.0008) [2023-12-26 11:16:32,499][123090] Updated weights for policy 1, policy_version 1453378 (0.0010) [2023-12-26 11:16:32,555][123090] Updated weights for policy 1, policy_version 1453388 (0.0010) [2023-12-26 11:16:32,607][123090] Updated weights for policy 1, policy_version 1453398 (0.0010) [2023-12-26 11:16:32,667][123090] Updated weights for policy 1, policy_version 1453408 (0.0010) [2023-12-26 11:16:32,709][123091] Updated weights for policy 0, policy_version 1462906 (0.0009) [2023-12-26 11:16:32,757][123091] Updated weights for policy 0, policy_version 1462916 (0.0008) [2023-12-26 11:16:32,812][123091] Updated weights for policy 0, policy_version 1462926 (0.0008) [2023-12-26 11:16:33,457][123090] Updated weights for policy 1, policy_version 1453418 (0.0010) [2023-12-26 11:16:33,523][123090] Updated weights for policy 1, policy_version 1453428 (0.0010) [2023-12-26 11:16:33,577][123090] Updated weights for policy 1, policy_version 1453438 (0.0010) [2023-12-26 11:16:33,667][123091] Updated weights for policy 0, policy_version 1462936 (0.0009) [2023-12-26 11:16:33,729][123091] Updated weights for policy 0, policy_version 1462946 (0.0009) [2023-12-26 11:16:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 746594304. Throughput: 0: 8928.1, 1: 8687.6. Samples: 746608228. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:33,785][121949] Avg episode reward: [(0, '6266.379'), (1, '5673.882')] [2023-12-26 11:16:33,788][123091] Updated weights for policy 0, policy_version 1462956 (0.0009) [2023-12-26 11:16:34,404][123090] Updated weights for policy 1, policy_version 1453448 (0.0010) [2023-12-26 11:16:34,480][123090] Updated weights for policy 1, policy_version 1453458 (0.0010) [2023-12-26 11:16:34,536][123090] Updated weights for policy 1, policy_version 1453468 (0.0010) [2023-12-26 11:16:34,628][123091] Updated weights for policy 0, policy_version 1462966 (0.0010) [2023-12-26 11:16:34,692][123091] Updated weights for policy 0, policy_version 1462976 (0.0009) [2023-12-26 11:16:34,749][123091] Updated weights for policy 0, policy_version 1462986 (0.0010) [2023-12-26 11:16:35,306][123090] Updated weights for policy 1, policy_version 1453478 (0.0010) [2023-12-26 11:16:35,358][123090] Updated weights for policy 1, policy_version 1453488 (0.0010) [2023-12-26 11:16:35,409][123090] Updated weights for policy 1, policy_version 1453498 (0.0010) [2023-12-26 11:16:35,602][123091] Updated weights for policy 0, policy_version 1462996 (0.0010) [2023-12-26 11:16:35,658][123091] Updated weights for policy 0, policy_version 1463006 (0.0009) [2023-12-26 11:16:35,713][123091] Updated weights for policy 0, policy_version 1463016 (0.0009) [2023-12-26 11:16:36,263][123090] Updated weights for policy 1, policy_version 1453508 (0.0010) [2023-12-26 11:16:36,330][123090] Updated weights for policy 1, policy_version 1453518 (0.0011) [2023-12-26 11:16:36,393][123090] Updated weights for policy 1, policy_version 1453528 (0.0010) [2023-12-26 11:16:36,486][123091] Updated weights for policy 0, policy_version 1463026 (0.0006) [2023-12-26 11:16:36,551][123091] Updated weights for policy 0, policy_version 1463036 (0.0009) [2023-12-26 11:16:36,621][123091] Updated weights for policy 0, policy_version 1463046 (0.0009) [2023-12-26 11:16:36,686][123091] Updated weights for policy 0, policy_version 1463056 (0.0009) [2023-12-26 11:16:37,190][123090] Updated weights for policy 1, policy_version 1453538 (0.0011) [2023-12-26 11:16:37,252][123090] Updated weights for policy 1, policy_version 1453548 (0.0010) [2023-12-26 11:16:37,310][123090] Updated weights for policy 1, policy_version 1453558 (0.0010) [2023-12-26 11:16:37,370][123090] Updated weights for policy 1, policy_version 1453568 (0.0010) [2023-12-26 11:16:37,531][123091] Updated weights for policy 0, policy_version 1463066 (0.0009) [2023-12-26 11:16:37,595][123091] Updated weights for policy 0, policy_version 1463076 (0.0009) [2023-12-26 11:16:37,656][123091] Updated weights for policy 0, policy_version 1463086 (0.0009) [2023-12-26 11:16:38,019][123090] Updated weights for policy 1, policy_version 1453578 (0.0006) [2023-12-26 11:16:38,092][123090] Updated weights for policy 1, policy_version 1453588 (0.0007) [2023-12-26 11:16:38,152][123090] Updated weights for policy 1, policy_version 1453598 (0.0010) [2023-12-26 11:16:38,565][123091] Updated weights for policy 0, policy_version 1463096 (0.0010) [2023-12-26 11:16:38,629][123091] Updated weights for policy 0, policy_version 1463107 (0.0010) [2023-12-26 11:16:38,684][123091] Updated weights for policy 0, policy_version 1463117 (0.0009) [2023-12-26 11:16:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 746684416. Throughput: 0: 8900.6, 1: 8697.0. Samples: 746659888. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:38,785][121949] Avg episode reward: [(0, '6274.522'), (1, '5745.581')] [2023-12-26 11:16:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001463120_374562816.pth... [2023-12-26 11:16:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001453600_372121600.pth... [2023-12-26 11:16:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001452608_371867648.pth [2023-12-26 11:16:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001462064_374292480.pth [2023-12-26 11:16:38,872][123090] Updated weights for policy 1, policy_version 1453608 (0.0007) [2023-12-26 11:16:38,935][123090] Updated weights for policy 1, policy_version 1453618 (0.0005) [2023-12-26 11:16:39,005][123090] Updated weights for policy 1, policy_version 1453628 (0.0006) [2023-12-26 11:16:39,579][123091] Updated weights for policy 0, policy_version 1463127 (0.0010) [2023-12-26 11:16:39,640][123091] Updated weights for policy 0, policy_version 1463137 (0.0010) [2023-12-26 11:16:39,708][123091] Updated weights for policy 0, policy_version 1463147 (0.0010) [2023-12-26 11:16:39,753][123090] Updated weights for policy 1, policy_version 1453638 (0.0008) [2023-12-26 11:16:39,825][123090] Updated weights for policy 1, policy_version 1453648 (0.0006) [2023-12-26 11:16:39,893][123090] Updated weights for policy 1, policy_version 1453658 (0.0009) [2023-12-26 11:16:40,598][123091] Updated weights for policy 0, policy_version 1463157 (0.0009) [2023-12-26 11:16:40,615][123090] Updated weights for policy 1, policy_version 1453668 (0.0009) [2023-12-26 11:16:40,648][123091] Updated weights for policy 0, policy_version 1463167 (0.0009) [2023-12-26 11:16:40,668][123090] Updated weights for policy 1, policy_version 1453678 (0.0008) [2023-12-26 11:16:40,693][123091] Updated weights for policy 0, policy_version 1463177 (0.0007) [2023-12-26 11:16:40,714][123090] Updated weights for policy 1, policy_version 1453688 (0.0007) [2023-12-26 11:16:41,576][123090] Updated weights for policy 1, policy_version 1453698 (0.0008) [2023-12-26 11:16:41,584][123091] Updated weights for policy 0, policy_version 1463187 (0.0009) [2023-12-26 11:16:41,644][123090] Updated weights for policy 1, policy_version 1453708 (0.0009) [2023-12-26 11:16:41,649][123091] Updated weights for policy 0, policy_version 1463197 (0.0009) [2023-12-26 11:16:41,713][123090] Updated weights for policy 1, policy_version 1453718 (0.0009) [2023-12-26 11:16:41,716][123091] Updated weights for policy 0, policy_version 1463207 (0.0008) [2023-12-26 11:16:41,783][123090] Updated weights for policy 1, policy_version 1453728 (0.0008) [2023-12-26 11:16:42,578][123091] Updated weights for policy 0, policy_version 1463217 (0.0009) [2023-12-26 11:16:42,624][123090] Updated weights for policy 1, policy_version 1453738 (0.0009) [2023-12-26 11:16:42,629][123091] Updated weights for policy 0, policy_version 1463227 (0.0009) [2023-12-26 11:16:42,682][123091] Updated weights for policy 0, policy_version 1463237 (0.0008) [2023-12-26 11:16:42,684][123090] Updated weights for policy 1, policy_version 1453748 (0.0008) [2023-12-26 11:16:42,740][123091] Updated weights for policy 0, policy_version 1463247 (0.0009) [2023-12-26 11:16:42,751][123090] Updated weights for policy 1, policy_version 1453758 (0.0008) [2023-12-26 11:16:43,559][123091] Updated weights for policy 0, policy_version 1463257 (0.0008) [2023-12-26 11:16:43,575][123090] Updated weights for policy 1, policy_version 1453768 (0.0010) [2023-12-26 11:16:43,623][123091] Updated weights for policy 0, policy_version 1463267 (0.0008) [2023-12-26 11:16:43,631][123090] Updated weights for policy 1, policy_version 1453778 (0.0010) [2023-12-26 11:16:43,688][123091] Updated weights for policy 0, policy_version 1463277 (0.0010) [2023-12-26 11:16:43,690][123090] Updated weights for policy 1, policy_version 1453788 (0.0010) [2023-12-26 11:16:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 746774528. Throughput: 0: 8734.2, 1: 8765.7. Samples: 746762328. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:43,785][121949] Avg episode reward: [(0, '6335.838'), (1, '5718.228')] [2023-12-26 11:16:44,446][123090] Updated weights for policy 1, policy_version 1453798 (0.0008) [2023-12-26 11:16:44,506][123090] Updated weights for policy 1, policy_version 1453808 (0.0007) [2023-12-26 11:16:44,531][123091] Updated weights for policy 0, policy_version 1463287 (0.0005) [2023-12-26 11:16:44,568][123090] Updated weights for policy 1, policy_version 1453818 (0.0009) [2023-12-26 11:16:44,582][123091] Updated weights for policy 0, policy_version 1463297 (0.0005) [2023-12-26 11:16:44,637][123091] Updated weights for policy 0, policy_version 1463307 (0.0006) [2023-12-26 11:16:45,229][123090] Updated weights for policy 1, policy_version 1453828 (0.0009) [2023-12-26 11:16:45,278][123090] Updated weights for policy 1, policy_version 1453838 (0.0011) [2023-12-26 11:16:45,334][123090] Updated weights for policy 1, policy_version 1453848 (0.0011) [2023-12-26 11:16:45,429][123091] Updated weights for policy 0, policy_version 1463317 (0.0008) [2023-12-26 11:16:45,488][123091] Updated weights for policy 0, policy_version 1463327 (0.0009) [2023-12-26 11:16:45,551][123091] Updated weights for policy 0, policy_version 1463337 (0.0008) [2023-12-26 11:16:46,159][123090] Updated weights for policy 1, policy_version 1453858 (0.0010) [2023-12-26 11:16:46,206][123090] Updated weights for policy 1, policy_version 1453868 (0.0005) [2023-12-26 11:16:46,266][123090] Updated weights for policy 1, policy_version 1453878 (0.0008) [2023-12-26 11:16:46,317][123090] Updated weights for policy 1, policy_version 1453888 (0.0010) [2023-12-26 11:16:46,397][123091] Updated weights for policy 0, policy_version 1463347 (0.0008) [2023-12-26 11:16:46,453][123091] Updated weights for policy 0, policy_version 1463357 (0.0009) [2023-12-26 11:16:46,509][123091] Updated weights for policy 0, policy_version 1463367 (0.0009) [2023-12-26 11:16:46,986][123090] Updated weights for policy 1, policy_version 1453898 (0.0009) [2023-12-26 11:16:47,044][123090] Updated weights for policy 1, policy_version 1453908 (0.0006) [2023-12-26 11:16:47,106][123090] Updated weights for policy 1, policy_version 1453918 (0.0007) [2023-12-26 11:16:47,427][123091] Updated weights for policy 0, policy_version 1463377 (0.0010) [2023-12-26 11:16:47,486][123091] Updated weights for policy 0, policy_version 1463387 (0.0010) [2023-12-26 11:16:47,552][123091] Updated weights for policy 0, policy_version 1463397 (0.0009) [2023-12-26 11:16:47,620][123091] Updated weights for policy 0, policy_version 1463407 (0.0010) [2023-12-26 11:16:47,887][123090] Updated weights for policy 1, policy_version 1453928 (0.0009) [2023-12-26 11:16:47,945][123090] Updated weights for policy 1, policy_version 1453938 (0.0008) [2023-12-26 11:16:48,005][123090] Updated weights for policy 1, policy_version 1453948 (0.0008) [2023-12-26 11:16:48,444][123091] Updated weights for policy 0, policy_version 1463417 (0.0008) [2023-12-26 11:16:48,506][123091] Updated weights for policy 0, policy_version 1463427 (0.0008) [2023-12-26 11:16:48,568][123091] Updated weights for policy 0, policy_version 1463437 (0.0008) [2023-12-26 11:16:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 746856448. Throughput: 0: 8738.3, 1: 8765.6. Samples: 746867392. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:48,785][121949] Avg episode reward: [(0, '6337.974'), (1, '5771.480')] [2023-12-26 11:16:48,842][123090] Updated weights for policy 1, policy_version 1453958 (0.0007) [2023-12-26 11:16:48,904][123090] Updated weights for policy 1, policy_version 1453968 (0.0005) [2023-12-26 11:16:48,973][123090] Updated weights for policy 1, policy_version 1453978 (0.0005) [2023-12-26 11:16:49,351][123091] Updated weights for policy 0, policy_version 1463447 (0.0009) [2023-12-26 11:16:49,416][123091] Updated weights for policy 0, policy_version 1463457 (0.0008) [2023-12-26 11:16:49,470][123091] Updated weights for policy 0, policy_version 1463467 (0.0005) [2023-12-26 11:16:49,724][123090] Updated weights for policy 1, policy_version 1453988 (0.0006) [2023-12-26 11:16:49,783][123090] Updated weights for policy 1, policy_version 1453998 (0.0008) [2023-12-26 11:16:49,850][123090] Updated weights for policy 1, policy_version 1454008 (0.0007) [2023-12-26 11:16:50,272][123091] Updated weights for policy 0, policy_version 1463477 (0.0007) [2023-12-26 11:16:50,340][123091] Updated weights for policy 0, policy_version 1463487 (0.0005) [2023-12-26 11:16:50,402][123091] Updated weights for policy 0, policy_version 1463497 (0.0005) [2023-12-26 11:16:50,544][123090] Updated weights for policy 1, policy_version 1454018 (0.0006) [2023-12-26 11:16:50,613][123090] Updated weights for policy 1, policy_version 1454028 (0.0011) [2023-12-26 11:16:50,682][123090] Updated weights for policy 1, policy_version 1454038 (0.0011) [2023-12-26 11:16:50,753][123090] Updated weights for policy 1, policy_version 1454048 (0.0011) [2023-12-26 11:16:51,166][123091] Updated weights for policy 0, policy_version 1463507 (0.0007) [2023-12-26 11:16:51,218][123091] Updated weights for policy 0, policy_version 1463517 (0.0011) [2023-12-26 11:16:51,283][123091] Updated weights for policy 0, policy_version 1463527 (0.0011) [2023-12-26 11:16:51,567][123090] Updated weights for policy 1, policy_version 1454058 (0.0009) [2023-12-26 11:16:51,633][123090] Updated weights for policy 1, policy_version 1454068 (0.0010) [2023-12-26 11:16:51,692][123090] Updated weights for policy 1, policy_version 1454078 (0.0011) [2023-12-26 11:16:52,152][123091] Updated weights for policy 0, policy_version 1463537 (0.0011) [2023-12-26 11:16:52,202][123091] Updated weights for policy 0, policy_version 1463547 (0.0008) [2023-12-26 11:16:52,256][123091] Updated weights for policy 0, policy_version 1463557 (0.0009) [2023-12-26 11:16:52,322][123091] Updated weights for policy 0, policy_version 1463567 (0.0009) [2023-12-26 11:16:52,594][123090] Updated weights for policy 1, policy_version 1454088 (0.0011) [2023-12-26 11:16:52,649][123090] Updated weights for policy 1, policy_version 1454098 (0.0010) [2023-12-26 11:16:52,713][123090] Updated weights for policy 1, policy_version 1454108 (0.0010) [2023-12-26 11:16:53,223][123091] Updated weights for policy 0, policy_version 1463577 (0.0009) [2023-12-26 11:16:53,276][123091] Updated weights for policy 0, policy_version 1463587 (0.0009) [2023-12-26 11:16:53,329][123091] Updated weights for policy 0, policy_version 1463597 (0.0009) [2023-12-26 11:16:53,544][123090] Updated weights for policy 1, policy_version 1454118 (0.0011) [2023-12-26 11:16:53,598][123090] Updated weights for policy 1, policy_version 1454128 (0.0010) [2023-12-26 11:16:53,647][123090] Updated weights for policy 1, policy_version 1454138 (0.0006) [2023-12-26 11:16:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 746946560. Throughput: 0: 8744.3, 1: 8734.8. Samples: 746921016. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:53,785][121949] Avg episode reward: [(0, '6215.795'), (1, '5800.829')] [2023-12-26 11:16:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001454144_372260864.pth... [2023-12-26 11:16:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001463600_374685696.pth... [2023-12-26 11:16:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001453120_371998720.pth [2023-12-26 11:16:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001462576_374423552.pth [2023-12-26 11:16:54,041][123091] Updated weights for policy 0, policy_version 1463607 (0.0010) [2023-12-26 11:16:54,108][123091] Updated weights for policy 0, policy_version 1463617 (0.0010) [2023-12-26 11:16:54,175][123091] Updated weights for policy 0, policy_version 1463627 (0.0010) [2023-12-26 11:16:54,341][123090] Updated weights for policy 1, policy_version 1454148 (0.0005) [2023-12-26 11:16:54,399][123090] Updated weights for policy 1, policy_version 1454158 (0.0006) [2023-12-26 11:16:54,463][123090] Updated weights for policy 1, policy_version 1454168 (0.0006) [2023-12-26 11:16:55,116][123091] Updated weights for policy 0, policy_version 1463637 (0.0010) [2023-12-26 11:16:55,169][123090] Updated weights for policy 1, policy_version 1454178 (0.0006) [2023-12-26 11:16:55,176][123091] Updated weights for policy 0, policy_version 1463647 (0.0009) [2023-12-26 11:16:55,230][123090] Updated weights for policy 1, policy_version 1454188 (0.0008) [2023-12-26 11:16:55,235][123091] Updated weights for policy 0, policy_version 1463657 (0.0009) [2023-12-26 11:16:55,298][123090] Updated weights for policy 1, policy_version 1454198 (0.0010) [2023-12-26 11:16:55,363][123090] Updated weights for policy 1, policy_version 1454208 (0.0008) [2023-12-26 11:16:55,965][123090] Updated weights for policy 1, policy_version 1454218 (0.0005) [2023-12-26 11:16:56,015][123090] Updated weights for policy 1, policy_version 1454228 (0.0005) [2023-12-26 11:16:56,079][123090] Updated weights for policy 1, policy_version 1454238 (0.0005) [2023-12-26 11:16:56,135][123091] Updated weights for policy 0, policy_version 1463667 (0.0009) [2023-12-26 11:16:56,197][123091] Updated weights for policy 0, policy_version 1463677 (0.0009) [2023-12-26 11:16:56,265][123091] Updated weights for policy 0, policy_version 1463687 (0.0009) [2023-12-26 11:16:56,839][123090] Updated weights for policy 1, policy_version 1454248 (0.0009) [2023-12-26 11:16:56,901][123090] Updated weights for policy 1, policy_version 1454258 (0.0010) [2023-12-26 11:16:56,963][123090] Updated weights for policy 1, policy_version 1454268 (0.0010) [2023-12-26 11:16:57,110][123091] Updated weights for policy 0, policy_version 1463697 (0.0009) [2023-12-26 11:16:57,177][123091] Updated weights for policy 0, policy_version 1463707 (0.0008) [2023-12-26 11:16:57,245][123091] Updated weights for policy 0, policy_version 1463717 (0.0006) [2023-12-26 11:16:57,312][123091] Updated weights for policy 0, policy_version 1463727 (0.0006) [2023-12-26 11:16:57,819][123090] Updated weights for policy 1, policy_version 1454278 (0.0009) [2023-12-26 11:16:57,880][123090] Updated weights for policy 1, policy_version 1454288 (0.0009) [2023-12-26 11:16:57,945][123090] Updated weights for policy 1, policy_version 1454298 (0.0009) [2023-12-26 11:16:57,995][123091] Updated weights for policy 0, policy_version 1463737 (0.0010) [2023-12-26 11:16:58,053][123091] Updated weights for policy 0, policy_version 1463747 (0.0009) [2023-12-26 11:16:58,119][123091] Updated weights for policy 0, policy_version 1463757 (0.0008) [2023-12-26 11:16:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 747028480. Throughput: 0: 8717.8, 1: 8808.8. Samples: 747026696. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:16:58,784][121949] Avg episode reward: [(0, '6187.100'), (1, '5742.130')] [2023-12-26 11:16:58,834][123090] Updated weights for policy 1, policy_version 1454308 (0.0009) [2023-12-26 11:16:58,892][123090] Updated weights for policy 1, policy_version 1454318 (0.0010) [2023-12-26 11:16:58,973][123090] Updated weights for policy 1, policy_version 1454328 (0.0008) [2023-12-26 11:16:59,010][123091] Updated weights for policy 0, policy_version 1463767 (0.0008) [2023-12-26 11:16:59,079][123091] Updated weights for policy 0, policy_version 1463777 (0.0009) [2023-12-26 11:16:59,139][123091] Updated weights for policy 0, policy_version 1463787 (0.0010) [2023-12-26 11:16:59,844][123090] Updated weights for policy 1, policy_version 1454338 (0.0008) [2023-12-26 11:16:59,914][123090] Updated weights for policy 1, policy_version 1454348 (0.0008) [2023-12-26 11:16:59,962][123091] Updated weights for policy 0, policy_version 1463797 (0.0007) [2023-12-26 11:16:59,975][123090] Updated weights for policy 1, policy_version 1454358 (0.0008) [2023-12-26 11:17:00,016][123091] Updated weights for policy 0, policy_version 1463807 (0.0009) [2023-12-26 11:17:00,040][123090] Updated weights for policy 1, policy_version 1454368 (0.0008) [2023-12-26 11:17:00,072][123091] Updated weights for policy 0, policy_version 1463817 (0.0008) [2023-12-26 11:17:00,808][123090] Updated weights for policy 1, policy_version 1454378 (0.0010) [2023-12-26 11:17:00,856][123090] Updated weights for policy 1, policy_version 1454388 (0.0009) [2023-12-26 11:17:00,908][123090] Updated weights for policy 1, policy_version 1454398 (0.0009) [2023-12-26 11:17:00,949][123091] Updated weights for policy 0, policy_version 1463827 (0.0009) [2023-12-26 11:17:01,007][123091] Updated weights for policy 0, policy_version 1463837 (0.0009) [2023-12-26 11:17:01,071][123091] Updated weights for policy 0, policy_version 1463847 (0.0008) [2023-12-26 11:17:01,831][123091] Updated weights for policy 0, policy_version 1463857 (0.0009) [2023-12-26 11:17:01,867][123090] Updated weights for policy 1, policy_version 1454408 (0.0009) [2023-12-26 11:17:01,884][123091] Updated weights for policy 0, policy_version 1463867 (0.0007) [2023-12-26 11:17:01,928][123090] Updated weights for policy 1, policy_version 1454418 (0.0009) [2023-12-26 11:17:01,929][123091] Updated weights for policy 0, policy_version 1463877 (0.0008) [2023-12-26 11:17:01,988][123090] Updated weights for policy 1, policy_version 1454428 (0.0007) [2023-12-26 11:17:01,992][123091] Updated weights for policy 0, policy_version 1463887 (0.0007) [2023-12-26 11:17:02,784][123090] Updated weights for policy 1, policy_version 1454438 (0.0006) [2023-12-26 11:17:02,854][123090] Updated weights for policy 1, policy_version 1454448 (0.0005) [2023-12-26 11:17:02,869][123091] Updated weights for policy 0, policy_version 1463897 (0.0009) [2023-12-26 11:17:02,917][123090] Updated weights for policy 1, policy_version 1454458 (0.0006) [2023-12-26 11:17:02,937][123091] Updated weights for policy 0, policy_version 1463907 (0.0007) [2023-12-26 11:17:02,994][123091] Updated weights for policy 0, policy_version 1463917 (0.0010) [2023-12-26 11:17:03,686][123090] Updated weights for policy 1, policy_version 1454468 (0.0008) [2023-12-26 11:17:03,751][123090] Updated weights for policy 1, policy_version 1454478 (0.0009) [2023-12-26 11:17:03,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 747110400. Throughput: 0: 8670.1, 1: 8742.1. Samples: 747128528. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:03,785][121949] Avg episode reward: [(0, '6207.534'), (1, '5840.212')] [2023-12-26 11:17:03,811][123091] Updated weights for policy 0, policy_version 1463927 (0.0007) [2023-12-26 11:17:03,813][123090] Updated weights for policy 1, policy_version 1454488 (0.0010) [2023-12-26 11:17:03,876][123091] Updated weights for policy 0, policy_version 1463937 (0.0007) [2023-12-26 11:17:03,937][123091] Updated weights for policy 0, policy_version 1463947 (0.0010) [2023-12-26 11:17:04,589][123090] Updated weights for policy 1, policy_version 1454498 (0.0010) [2023-12-26 11:17:04,641][123090] Updated weights for policy 1, policy_version 1454508 (0.0008) [2023-12-26 11:17:04,694][123090] Updated weights for policy 1, policy_version 1454518 (0.0005) [2023-12-26 11:17:04,744][123090] Updated weights for policy 1, policy_version 1454528 (0.0007) [2023-12-26 11:17:04,827][123091] Updated weights for policy 0, policy_version 1463957 (0.0010) [2023-12-26 11:17:04,894][123091] Updated weights for policy 0, policy_version 1463967 (0.0010) [2023-12-26 11:17:04,952][123091] Updated weights for policy 0, policy_version 1463977 (0.0010) [2023-12-26 11:17:05,439][123090] Updated weights for policy 1, policy_version 1454538 (0.0011) [2023-12-26 11:17:05,499][123090] Updated weights for policy 1, policy_version 1454548 (0.0010) [2023-12-26 11:17:05,568][123090] Updated weights for policy 1, policy_version 1454558 (0.0006) [2023-12-26 11:17:05,808][123091] Updated weights for policy 0, policy_version 1463987 (0.0009) [2023-12-26 11:17:05,863][123091] Updated weights for policy 0, policy_version 1463997 (0.0009) [2023-12-26 11:17:05,916][123091] Updated weights for policy 0, policy_version 1464007 (0.0010) [2023-12-26 11:17:06,292][123090] Updated weights for policy 1, policy_version 1454568 (0.0010) [2023-12-26 11:17:06,343][123090] Updated weights for policy 1, policy_version 1454578 (0.0010) [2023-12-26 11:17:06,395][123090] Updated weights for policy 1, policy_version 1454588 (0.0009) [2023-12-26 11:17:06,819][123091] Updated weights for policy 0, policy_version 1464017 (0.0009) [2023-12-26 11:17:06,871][123091] Updated weights for policy 0, policy_version 1464027 (0.0005) [2023-12-26 11:17:06,934][123091] Updated weights for policy 0, policy_version 1464037 (0.0005) [2023-12-26 11:17:06,997][123091] Updated weights for policy 0, policy_version 1464047 (0.0005) [2023-12-26 11:17:07,202][123090] Updated weights for policy 1, policy_version 1454598 (0.0007) [2023-12-26 11:17:07,264][123090] Updated weights for policy 1, policy_version 1454608 (0.0006) [2023-12-26 11:17:07,315][123090] Updated weights for policy 1, policy_version 1454618 (0.0005) [2023-12-26 11:17:07,798][123091] Updated weights for policy 0, policy_version 1464057 (0.0009) [2023-12-26 11:17:07,854][123091] Updated weights for policy 0, policy_version 1464067 (0.0009) [2023-12-26 11:17:07,914][123091] Updated weights for policy 0, policy_version 1464077 (0.0010) [2023-12-26 11:17:08,061][123090] Updated weights for policy 1, policy_version 1454628 (0.0006) [2023-12-26 11:17:08,127][123090] Updated weights for policy 1, policy_version 1454638 (0.0011) [2023-12-26 11:17:08,190][123090] Updated weights for policy 1, policy_version 1454648 (0.0010) [2023-12-26 11:17:08,712][123091] Updated weights for policy 0, policy_version 1464087 (0.0009) [2023-12-26 11:17:08,774][123091] Updated weights for policy 0, policy_version 1464097 (0.0009) [2023-12-26 11:17:08,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 747200512. Throughput: 0: 8660.0, 1: 8782.1. Samples: 747180456. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:08,785][121949] Avg episode reward: [(0, '6216.080'), (1, '5761.895')] [2023-12-26 11:17:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001454656_372391936.pth... [2023-12-26 11:17:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001453600_372121600.pth [2023-12-26 11:17:08,835][123091] Updated weights for policy 0, policy_version 1464107 (0.0009) [2023-12-26 11:17:08,864][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001464112_374816768.pth... [2023-12-26 11:17:08,869][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001463120_374562816.pth [2023-12-26 11:17:09,010][123090] Updated weights for policy 1, policy_version 1454658 (0.0011) [2023-12-26 11:17:09,065][123090] Updated weights for policy 1, policy_version 1454668 (0.0010) [2023-12-26 11:17:09,120][123090] Updated weights for policy 1, policy_version 1454678 (0.0010) [2023-12-26 11:17:09,183][123090] Updated weights for policy 1, policy_version 1454688 (0.0011) [2023-12-26 11:17:09,685][123091] Updated weights for policy 0, policy_version 1464117 (0.0010) [2023-12-26 11:17:09,750][123091] Updated weights for policy 0, policy_version 1464127 (0.0011) [2023-12-26 11:17:09,811][123091] Updated weights for policy 0, policy_version 1464137 (0.0011) [2023-12-26 11:17:10,013][123090] Updated weights for policy 1, policy_version 1454698 (0.0009) [2023-12-26 11:17:10,081][123090] Updated weights for policy 1, policy_version 1454708 (0.0008) [2023-12-26 11:17:10,140][123090] Updated weights for policy 1, policy_version 1454718 (0.0009) [2023-12-26 11:17:10,629][123091] Updated weights for policy 0, policy_version 1464147 (0.0011) [2023-12-26 11:17:10,703][123091] Updated weights for policy 0, policy_version 1464157 (0.0011) [2023-12-26 11:17:10,765][123091] Updated weights for policy 0, policy_version 1464167 (0.0011) [2023-12-26 11:17:11,001][123090] Updated weights for policy 1, policy_version 1454728 (0.0009) [2023-12-26 11:17:11,068][123090] Updated weights for policy 1, policy_version 1454738 (0.0009) [2023-12-26 11:17:11,129][123090] Updated weights for policy 1, policy_version 1454748 (0.0009) [2023-12-26 11:17:11,613][123091] Updated weights for policy 0, policy_version 1464177 (0.0011) [2023-12-26 11:17:11,680][123091] Updated weights for policy 0, policy_version 1464187 (0.0009) [2023-12-26 11:17:11,747][123091] Updated weights for policy 0, policy_version 1464197 (0.0010) [2023-12-26 11:17:11,815][123091] Updated weights for policy 0, policy_version 1464207 (0.0009) [2023-12-26 11:17:11,963][123090] Updated weights for policy 1, policy_version 1454758 (0.0010) [2023-12-26 11:17:12,028][123090] Updated weights for policy 1, policy_version 1454768 (0.0011) [2023-12-26 11:17:12,095][123090] Updated weights for policy 1, policy_version 1454778 (0.0010) [2023-12-26 11:17:12,657][123091] Updated weights for policy 0, policy_version 1464217 (0.0008) [2023-12-26 11:17:12,736][123091] Updated weights for policy 0, policy_version 1464227 (0.0009) [2023-12-26 11:17:12,811][123091] Updated weights for policy 0, policy_version 1464237 (0.0006) [2023-12-26 11:17:12,852][123090] Updated weights for policy 1, policy_version 1454788 (0.0010) [2023-12-26 11:17:12,919][123090] Updated weights for policy 1, policy_version 1454798 (0.0008) [2023-12-26 11:17:12,990][123090] Updated weights for policy 1, policy_version 1454808 (0.0009) [2023-12-26 11:17:13,577][123091] Updated weights for policy 0, policy_version 1464247 (0.0009) [2023-12-26 11:17:13,628][123091] Updated weights for policy 0, policy_version 1464257 (0.0010) [2023-12-26 11:17:13,693][123091] Updated weights for policy 0, policy_version 1464268 (0.0010) [2023-12-26 11:17:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 747290624. Throughput: 0: 8525.1, 1: 8843.4. Samples: 747283540. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:13,785][121949] Avg episode reward: [(0, '6224.692'), (1, '5654.777')] [2023-12-26 11:17:13,812][123090] Updated weights for policy 1, policy_version 1454818 (0.0009) [2023-12-26 11:17:13,879][123090] Updated weights for policy 1, policy_version 1454828 (0.0008) [2023-12-26 11:17:13,938][123090] Updated weights for policy 1, policy_version 1454838 (0.0008) [2023-12-26 11:17:13,996][123090] Updated weights for policy 1, policy_version 1454848 (0.0009) [2023-12-26 11:17:14,538][123091] Updated weights for policy 0, policy_version 1464278 (0.0009) [2023-12-26 11:17:14,597][123091] Updated weights for policy 0, policy_version 1464288 (0.0009) [2023-12-26 11:17:14,663][123091] Updated weights for policy 0, policy_version 1464298 (0.0009) [2023-12-26 11:17:14,803][123090] Updated weights for policy 1, policy_version 1454858 (0.0009) [2023-12-26 11:17:14,862][123090] Updated weights for policy 1, policy_version 1454868 (0.0008) [2023-12-26 11:17:14,916][123090] Updated weights for policy 1, policy_version 1454878 (0.0009) [2023-12-26 11:17:15,504][123091] Updated weights for policy 0, policy_version 1464308 (0.0010) [2023-12-26 11:17:15,572][123091] Updated weights for policy 0, policy_version 1464319 (0.0010) [2023-12-26 11:17:15,629][123091] Updated weights for policy 0, policy_version 1464329 (0.0009) [2023-12-26 11:17:15,729][123090] Updated weights for policy 1, policy_version 1454888 (0.0008) [2023-12-26 11:17:15,786][123090] Updated weights for policy 1, policy_version 1454898 (0.0009) [2023-12-26 11:17:15,841][123090] Updated weights for policy 1, policy_version 1454908 (0.0009) [2023-12-26 11:17:16,484][123091] Updated weights for policy 0, policy_version 1464339 (0.0010) [2023-12-26 11:17:16,537][123091] Updated weights for policy 0, policy_version 1464350 (0.0010) [2023-12-26 11:17:16,593][123090] Updated weights for policy 1, policy_version 1454918 (0.0007) [2023-12-26 11:17:16,594][123091] Updated weights for policy 0, policy_version 1464360 (0.0009) [2023-12-26 11:17:16,650][123090] Updated weights for policy 1, policy_version 1454928 (0.0008) [2023-12-26 11:17:16,725][123090] Updated weights for policy 1, policy_version 1454938 (0.0010) [2023-12-26 11:17:17,422][123091] Updated weights for policy 0, policy_version 1464370 (0.0009) [2023-12-26 11:17:17,485][123091] Updated weights for policy 0, policy_version 1464380 (0.0010) [2023-12-26 11:17:17,547][123091] Updated weights for policy 0, policy_version 1464390 (0.0008) [2023-12-26 11:17:17,558][123090] Updated weights for policy 1, policy_version 1454948 (0.0009) [2023-12-26 11:17:17,616][123091] Updated weights for policy 0, policy_version 1464400 (0.0006) [2023-12-26 11:17:17,626][123090] Updated weights for policy 1, policy_version 1454958 (0.0009) [2023-12-26 11:17:17,697][123090] Updated weights for policy 1, policy_version 1454968 (0.0008) [2023-12-26 11:17:18,376][123091] Updated weights for policy 0, policy_version 1464410 (0.0007) [2023-12-26 11:17:18,435][123091] Updated weights for policy 0, policy_version 1464420 (0.0006) [2023-12-26 11:17:18,461][123090] Updated weights for policy 1, policy_version 1454978 (0.0008) [2023-12-26 11:17:18,496][123091] Updated weights for policy 0, policy_version 1464430 (0.0008) [2023-12-26 11:17:18,522][123090] Updated weights for policy 1, policy_version 1454988 (0.0009) [2023-12-26 11:17:18,580][123090] Updated weights for policy 1, policy_version 1454998 (0.0009) [2023-12-26 11:17:18,638][123090] Updated weights for policy 1, policy_version 1455008 (0.0009) [2023-12-26 11:17:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 747380736. Throughput: 0: 8433.9, 1: 8894.9. Samples: 747388024. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:18,785][121949] Avg episode reward: [(0, '6164.241'), (1, '5538.939')] [2023-12-26 11:17:19,298][123091] Updated weights for policy 0, policy_version 1464440 (0.0009) [2023-12-26 11:17:19,374][123091] Updated weights for policy 0, policy_version 1464450 (0.0009) [2023-12-26 11:17:19,437][123091] Updated weights for policy 0, policy_version 1464460 (0.0007) [2023-12-26 11:17:19,497][123090] Updated weights for policy 1, policy_version 1455018 (0.0009) [2023-12-26 11:17:19,573][123090] Updated weights for policy 1, policy_version 1455028 (0.0009) [2023-12-26 11:17:19,637][123090] Updated weights for policy 1, policy_version 1455038 (0.0009) [2023-12-26 11:17:20,148][123091] Updated weights for policy 0, policy_version 1464470 (0.0006) [2023-12-26 11:17:20,219][123091] Updated weights for policy 0, policy_version 1464480 (0.0009) [2023-12-26 11:17:20,284][123091] Updated weights for policy 0, policy_version 1464490 (0.0009) [2023-12-26 11:17:20,514][123090] Updated weights for policy 1, policy_version 1455048 (0.0009) [2023-12-26 11:17:20,564][123090] Updated weights for policy 1, policy_version 1455058 (0.0009) [2023-12-26 11:17:20,628][123090] Updated weights for policy 1, policy_version 1455068 (0.0010) [2023-12-26 11:17:21,103][123091] Updated weights for policy 0, policy_version 1464500 (0.0009) [2023-12-26 11:17:21,168][123091] Updated weights for policy 0, policy_version 1464510 (0.0010) [2023-12-26 11:17:21,220][123091] Updated weights for policy 0, policy_version 1464520 (0.0010) [2023-12-26 11:17:21,512][123090] Updated weights for policy 1, policy_version 1455078 (0.0009) [2023-12-26 11:17:21,575][123090] Updated weights for policy 1, policy_version 1455088 (0.0009) [2023-12-26 11:17:21,642][123090] Updated weights for policy 1, policy_version 1455098 (0.0009) [2023-12-26 11:17:22,098][123091] Updated weights for policy 0, policy_version 1464530 (0.0010) [2023-12-26 11:17:22,161][123091] Updated weights for policy 0, policy_version 1464540 (0.0010) [2023-12-26 11:17:22,229][123091] Updated weights for policy 0, policy_version 1464550 (0.0011) [2023-12-26 11:17:22,296][123091] Updated weights for policy 0, policy_version 1464560 (0.0006) [2023-12-26 11:17:22,407][123090] Updated weights for policy 1, policy_version 1455108 (0.0008) [2023-12-26 11:17:22,480][123090] Updated weights for policy 1, policy_version 1455118 (0.0008) [2023-12-26 11:17:22,547][123090] Updated weights for policy 1, policy_version 1455128 (0.0008) [2023-12-26 11:17:23,010][123091] Updated weights for policy 0, policy_version 1464570 (0.0009) [2023-12-26 11:17:23,077][123091] Updated weights for policy 0, policy_version 1464580 (0.0006) [2023-12-26 11:17:23,129][123091] Updated weights for policy 0, policy_version 1464590 (0.0005) [2023-12-26 11:17:23,298][123090] Updated weights for policy 1, policy_version 1455138 (0.0009) [2023-12-26 11:17:23,357][123090] Updated weights for policy 1, policy_version 1455148 (0.0010) [2023-12-26 11:17:23,412][123090] Updated weights for policy 1, policy_version 1455158 (0.0010) [2023-12-26 11:17:23,479][123090] Updated weights for policy 1, policy_version 1455168 (0.0011) [2023-12-26 11:17:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 747462656. Throughput: 0: 8441.4, 1: 8859.2. Samples: 747438416. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:23,785][121949] Avg episode reward: [(0, '6216.918'), (1, '5676.955')] [2023-12-26 11:17:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001455168_372523008.pth... [2023-12-26 11:17:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001464592_374939648.pth... [2023-12-26 11:17:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001463600_374685696.pth [2023-12-26 11:17:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001454144_372260864.pth [2023-12-26 11:17:23,916][123091] Updated weights for policy 0, policy_version 1464600 (0.0008) [2023-12-26 11:17:23,964][123091] Updated weights for policy 0, policy_version 1464610 (0.0009) [2023-12-26 11:17:24,019][123091] Updated weights for policy 0, policy_version 1464620 (0.0009) [2023-12-26 11:17:24,313][123090] Updated weights for policy 1, policy_version 1455178 (0.0011) [2023-12-26 11:17:24,371][123090] Updated weights for policy 1, policy_version 1455188 (0.0010) [2023-12-26 11:17:24,434][123090] Updated weights for policy 1, policy_version 1455198 (0.0010) [2023-12-26 11:17:24,879][123091] Updated weights for policy 0, policy_version 1464630 (0.0009) [2023-12-26 11:17:24,931][123091] Updated weights for policy 0, policy_version 1464640 (0.0009) [2023-12-26 11:17:24,979][123091] Updated weights for policy 0, policy_version 1464650 (0.0009) [2023-12-26 11:17:25,262][123090] Updated weights for policy 1, policy_version 1455208 (0.0010) [2023-12-26 11:17:25,309][123090] Updated weights for policy 1, policy_version 1455218 (0.0010) [2023-12-26 11:17:25,368][123090] Updated weights for policy 1, policy_version 1455228 (0.0010) [2023-12-26 11:17:25,826][123091] Updated weights for policy 0, policy_version 1464660 (0.0009) [2023-12-26 11:17:25,880][123091] Updated weights for policy 0, policy_version 1464670 (0.0009) [2023-12-26 11:17:25,932][123091] Updated weights for policy 0, policy_version 1464680 (0.0009) [2023-12-26 11:17:26,212][123090] Updated weights for policy 1, policy_version 1455238 (0.0010) [2023-12-26 11:17:26,272][123090] Updated weights for policy 1, policy_version 1455248 (0.0011) [2023-12-26 11:17:26,332][123090] Updated weights for policy 1, policy_version 1455258 (0.0010) [2023-12-26 11:17:26,778][123091] Updated weights for policy 0, policy_version 1464690 (0.0009) [2023-12-26 11:17:26,826][123091] Updated weights for policy 0, policy_version 1464700 (0.0008) [2023-12-26 11:17:26,874][123091] Updated weights for policy 0, policy_version 1464710 (0.0008) [2023-12-26 11:17:26,929][123091] Updated weights for policy 0, policy_version 1464720 (0.0009) [2023-12-26 11:17:27,162][123090] Updated weights for policy 1, policy_version 1455268 (0.0010) [2023-12-26 11:17:27,232][123090] Updated weights for policy 1, policy_version 1455278 (0.0010) [2023-12-26 11:17:27,288][123090] Updated weights for policy 1, policy_version 1455288 (0.0010) [2023-12-26 11:17:27,813][123091] Updated weights for policy 0, policy_version 1464730 (0.0009) [2023-12-26 11:17:27,870][123091] Updated weights for policy 0, policy_version 1464740 (0.0009) [2023-12-26 11:17:27,923][123091] Updated weights for policy 0, policy_version 1464750 (0.0009) [2023-12-26 11:17:27,983][123090] Updated weights for policy 1, policy_version 1455298 (0.0009) [2023-12-26 11:17:28,031][123090] Updated weights for policy 1, policy_version 1455308 (0.0009) [2023-12-26 11:17:28,085][123090] Updated weights for policy 1, policy_version 1455318 (0.0009) [2023-12-26 11:17:28,144][123090] Updated weights for policy 1, policy_version 1455328 (0.0009) [2023-12-26 11:17:28,765][123091] Updated weights for policy 0, policy_version 1464760 (0.0009) [2023-12-26 11:17:28,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17203.3, 300 sec: 17605.9). Total num frames: 747544576. Throughput: 0: 8519.4, 1: 8820.0. Samples: 747542600. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:28,785][121949] Avg episode reward: [(0, '6155.757'), (1, '5857.625')] [2023-12-26 11:17:28,826][123091] Updated weights for policy 0, policy_version 1464770 (0.0010) [2023-12-26 11:17:28,890][123091] Updated weights for policy 0, policy_version 1464780 (0.0010) [2023-12-26 11:17:28,976][123090] Updated weights for policy 1, policy_version 1455338 (0.0009) [2023-12-26 11:17:29,025][123090] Updated weights for policy 1, policy_version 1455348 (0.0005) [2023-12-26 11:17:29,074][123090] Updated weights for policy 1, policy_version 1455358 (0.0005) [2023-12-26 11:17:29,704][123091] Updated weights for policy 0, policy_version 1464790 (0.0007) [2023-12-26 11:17:29,769][123091] Updated weights for policy 0, policy_version 1464800 (0.0006) [2023-12-26 11:17:29,842][123091] Updated weights for policy 0, policy_version 1464810 (0.0006) [2023-12-26 11:17:29,881][123090] Updated weights for policy 1, policy_version 1455368 (0.0007) [2023-12-26 11:17:29,953][123090] Updated weights for policy 1, policy_version 1455378 (0.0009) [2023-12-26 11:17:30,026][123090] Updated weights for policy 1, policy_version 1455388 (0.0008) [2023-12-26 11:17:30,559][123091] Updated weights for policy 0, policy_version 1464820 (0.0009) [2023-12-26 11:17:30,607][123091] Updated weights for policy 0, policy_version 1464830 (0.0009) [2023-12-26 11:17:30,669][123091] Updated weights for policy 0, policy_version 1464840 (0.0010) [2023-12-26 11:17:30,804][123090] Updated weights for policy 1, policy_version 1455398 (0.0007) [2023-12-26 11:17:30,860][123090] Updated weights for policy 1, policy_version 1455408 (0.0006) [2023-12-26 11:17:30,918][123090] Updated weights for policy 1, policy_version 1455418 (0.0010) [2023-12-26 11:17:31,531][123091] Updated weights for policy 0, policy_version 1464850 (0.0009) [2023-12-26 11:17:31,597][123091] Updated weights for policy 0, policy_version 1464860 (0.0010) [2023-12-26 11:17:31,664][123091] Updated weights for policy 0, policy_version 1464870 (0.0009) [2023-12-26 11:17:31,688][123090] Updated weights for policy 1, policy_version 1455428 (0.0009) [2023-12-26 11:17:31,721][123091] Updated weights for policy 0, policy_version 1464880 (0.0008) [2023-12-26 11:17:31,754][123090] Updated weights for policy 1, policy_version 1455438 (0.0009) [2023-12-26 11:17:31,822][123090] Updated weights for policy 1, policy_version 1455448 (0.0008) [2023-12-26 11:17:32,575][123091] Updated weights for policy 0, policy_version 1464890 (0.0006) [2023-12-26 11:17:32,632][123090] Updated weights for policy 1, policy_version 1455458 (0.0009) [2023-12-26 11:17:32,643][123091] Updated weights for policy 0, policy_version 1464900 (0.0009) [2023-12-26 11:17:32,692][123090] Updated weights for policy 1, policy_version 1455468 (0.0005) [2023-12-26 11:17:32,707][123091] Updated weights for policy 0, policy_version 1464910 (0.0008) [2023-12-26 11:17:32,750][123090] Updated weights for policy 1, policy_version 1455478 (0.0005) [2023-12-26 11:17:32,809][123090] Updated weights for policy 1, policy_version 1455488 (0.0005) [2023-12-26 11:17:33,423][123091] Updated weights for policy 0, policy_version 1464920 (0.0006) [2023-12-26 11:17:33,478][123091] Updated weights for policy 0, policy_version 1464930 (0.0005) [2023-12-26 11:17:33,531][123091] Updated weights for policy 0, policy_version 1464940 (0.0005) [2023-12-26 11:17:33,547][123090] Updated weights for policy 1, policy_version 1455498 (0.0007) [2023-12-26 11:17:33,619][123090] Updated weights for policy 1, policy_version 1455508 (0.0005) [2023-12-26 11:17:33,689][123090] Updated weights for policy 1, policy_version 1455518 (0.0005) [2023-12-26 11:17:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 747642880. Throughput: 0: 8580.9, 1: 8811.5. Samples: 747650048. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:33,785][121949] Avg episode reward: [(0, '6238.828'), (1, '5830.743')] [2023-12-26 11:17:34,121][123091] Updated weights for policy 0, policy_version 1464950 (0.0005) [2023-12-26 11:17:34,188][123091] Updated weights for policy 0, policy_version 1464960 (0.0007) [2023-12-26 11:17:34,259][123091] Updated weights for policy 0, policy_version 1464970 (0.0009) [2023-12-26 11:17:34,369][123090] Updated weights for policy 1, policy_version 1455528 (0.0008) [2023-12-26 11:17:34,422][123090] Updated weights for policy 1, policy_version 1455539 (0.0009) [2023-12-26 11:17:34,472][123090] Updated weights for policy 1, policy_version 1455549 (0.0009) [2023-12-26 11:17:35,038][123091] Updated weights for policy 0, policy_version 1464980 (0.0009) [2023-12-26 11:17:35,091][123091] Updated weights for policy 0, policy_version 1464990 (0.0006) [2023-12-26 11:17:35,159][123091] Updated weights for policy 0, policy_version 1465000 (0.0006) [2023-12-26 11:17:35,382][123090] Updated weights for policy 1, policy_version 1455559 (0.0007) [2023-12-26 11:17:35,450][123090] Updated weights for policy 1, policy_version 1455569 (0.0008) [2023-12-26 11:17:35,525][123090] Updated weights for policy 1, policy_version 1455579 (0.0005) [2023-12-26 11:17:35,881][123091] Updated weights for policy 0, policy_version 1465010 (0.0007) [2023-12-26 11:17:35,948][123091] Updated weights for policy 0, policy_version 1465020 (0.0008) [2023-12-26 11:17:36,002][123091] Updated weights for policy 0, policy_version 1465030 (0.0008) [2023-12-26 11:17:36,053][123091] Updated weights for policy 0, policy_version 1465040 (0.0009) [2023-12-26 11:17:36,165][123090] Updated weights for policy 1, policy_version 1455589 (0.0006) [2023-12-26 11:17:36,224][123090] Updated weights for policy 1, policy_version 1455599 (0.0007) [2023-12-26 11:17:36,278][123090] Updated weights for policy 1, policy_version 1455609 (0.0006) [2023-12-26 11:17:36,946][123091] Updated weights for policy 0, policy_version 1465050 (0.0005) [2023-12-26 11:17:37,013][123091] Updated weights for policy 0, policy_version 1465060 (0.0005) [2023-12-26 11:17:37,016][123090] Updated weights for policy 1, policy_version 1455619 (0.0005) [2023-12-26 11:17:37,076][123091] Updated weights for policy 0, policy_version 1465070 (0.0005) [2023-12-26 11:17:37,078][123090] Updated weights for policy 1, policy_version 1455629 (0.0005) [2023-12-26 11:17:37,152][123090] Updated weights for policy 1, policy_version 1455639 (0.0005) [2023-12-26 11:17:37,740][123091] Updated weights for policy 0, policy_version 1465080 (0.0009) [2023-12-26 11:17:37,751][123090] Updated weights for policy 1, policy_version 1455649 (0.0005) [2023-12-26 11:17:37,807][123091] Updated weights for policy 0, policy_version 1465090 (0.0009) [2023-12-26 11:17:37,814][123090] Updated weights for policy 1, policy_version 1455659 (0.0007) [2023-12-26 11:17:37,864][123091] Updated weights for policy 0, policy_version 1465100 (0.0008) [2023-12-26 11:17:37,876][123090] Updated weights for policy 1, policy_version 1455669 (0.0008) [2023-12-26 11:17:37,947][123090] Updated weights for policy 1, policy_version 1455679 (0.0006) [2023-12-26 11:17:38,699][123090] Updated weights for policy 1, policy_version 1455689 (0.0009) [2023-12-26 11:17:38,718][123091] Updated weights for policy 0, policy_version 1465110 (0.0011) [2023-12-26 11:17:38,763][123090] Updated weights for policy 1, policy_version 1455699 (0.0006) [2023-12-26 11:17:38,781][123091] Updated weights for policy 0, policy_version 1465120 (0.0010) [2023-12-26 11:17:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 747724800. Throughput: 0: 8612.0, 1: 8833.4. Samples: 747706056. Policy #0 lag: (min: 16.0, avg: 44.2, max: 48.0) [2023-12-26 11:17:38,785][121949] Avg episode reward: [(0, '6333.789'), (1, '5756.494')] [2023-12-26 11:17:38,824][123090] Updated weights for policy 1, policy_version 1455709 (0.0010) [2023-12-26 11:17:38,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001455712_372662272.pth... [2023-12-26 11:17:38,844][123091] Updated weights for policy 0, policy_version 1465130 (0.0010) [2023-12-26 11:17:38,847][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001454656_372391936.pth [2023-12-26 11:17:38,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001465136_375078912.pth... [2023-12-26 11:17:38,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001464112_374816768.pth [2023-12-26 11:17:39,567][123090] Updated weights for policy 1, policy_version 1455719 (0.0009) [2023-12-26 11:17:39,592][123091] Updated weights for policy 0, policy_version 1465140 (0.0008) [2023-12-26 11:17:39,631][123090] Updated weights for policy 1, policy_version 1455729 (0.0009) [2023-12-26 11:17:39,654][123091] Updated weights for policy 0, policy_version 1465150 (0.0008) [2023-12-26 11:17:39,692][123090] Updated weights for policy 1, policy_version 1455739 (0.0008) [2023-12-26 11:17:39,714][123091] Updated weights for policy 0, policy_version 1465160 (0.0008) [2023-12-26 11:17:40,531][123090] Updated weights for policy 1, policy_version 1455749 (0.0008) [2023-12-26 11:17:40,564][123091] Updated weights for policy 0, policy_version 1465170 (0.0008) [2023-12-26 11:17:40,593][123090] Updated weights for policy 1, policy_version 1455759 (0.0010) [2023-12-26 11:17:40,625][123091] Updated weights for policy 0, policy_version 1465180 (0.0007) [2023-12-26 11:17:40,653][123090] Updated weights for policy 1, policy_version 1455769 (0.0009) [2023-12-26 11:17:40,687][123091] Updated weights for policy 0, policy_version 1465190 (0.0008) [2023-12-26 11:17:40,753][123091] Updated weights for policy 0, policy_version 1465200 (0.0009) [2023-12-26 11:17:41,441][123090] Updated weights for policy 1, policy_version 1455779 (0.0008) [2023-12-26 11:17:41,505][123090] Updated weights for policy 1, policy_version 1455789 (0.0010) [2023-12-26 11:17:41,569][123090] Updated weights for policy 1, policy_version 1455799 (0.0011) [2023-12-26 11:17:41,602][123091] Updated weights for policy 0, policy_version 1465210 (0.0007) [2023-12-26 11:17:41,669][123091] Updated weights for policy 0, policy_version 1465220 (0.0009) [2023-12-26 11:17:41,739][123091] Updated weights for policy 0, policy_version 1465230 (0.0009) [2023-12-26 11:17:42,351][123090] Updated weights for policy 1, policy_version 1455809 (0.0011) [2023-12-26 11:17:42,408][123090] Updated weights for policy 1, policy_version 1455819 (0.0010) [2023-12-26 11:17:42,460][123090] Updated weights for policy 1, policy_version 1455829 (0.0010) [2023-12-26 11:17:42,525][123090] Updated weights for policy 1, policy_version 1455839 (0.0009) [2023-12-26 11:17:42,527][123091] Updated weights for policy 0, policy_version 1465240 (0.0010) [2023-12-26 11:17:42,584][123091] Updated weights for policy 0, policy_version 1465250 (0.0009) [2023-12-26 11:17:42,643][123091] Updated weights for policy 0, policy_version 1465260 (0.0008) [2023-12-26 11:17:43,352][123090] Updated weights for policy 1, policy_version 1455849 (0.0009) [2023-12-26 11:17:43,404][123090] Updated weights for policy 1, policy_version 1455859 (0.0009) [2023-12-26 11:17:43,462][123090] Updated weights for policy 1, policy_version 1455869 (0.0010) [2023-12-26 11:17:43,485][123091] Updated weights for policy 0, policy_version 1465270 (0.0009) [2023-12-26 11:17:43,537][123091] Updated weights for policy 0, policy_version 1465280 (0.0010) [2023-12-26 11:17:43,598][123091] Updated weights for policy 0, policy_version 1465290 (0.0010) [2023-12-26 11:17:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 747823104. Throughput: 0: 8648.4, 1: 8817.0. Samples: 747812636. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:17:43,784][121949] Avg episode reward: [(0, '6331.810'), (1, '5794.402')] [2023-12-26 11:17:44,271][123090] Updated weights for policy 1, policy_version 1455879 (0.0010) [2023-12-26 11:17:44,327][123090] Updated weights for policy 1, policy_version 1455890 (0.0010) [2023-12-26 11:17:44,380][123090] Updated weights for policy 1, policy_version 1455900 (0.0010) [2023-12-26 11:17:44,445][123091] Updated weights for policy 0, policy_version 1465300 (0.0010) [2023-12-26 11:17:44,508][123091] Updated weights for policy 0, policy_version 1465310 (0.0009) [2023-12-26 11:17:44,573][123091] Updated weights for policy 0, policy_version 1465320 (0.0010) [2023-12-26 11:17:45,170][123090] Updated weights for policy 1, policy_version 1455910 (0.0008) [2023-12-26 11:17:45,235][123090] Updated weights for policy 1, policy_version 1455920 (0.0009) [2023-12-26 11:17:45,302][123090] Updated weights for policy 1, policy_version 1455930 (0.0009) [2023-12-26 11:17:45,395][123091] Updated weights for policy 0, policy_version 1465330 (0.0010) [2023-12-26 11:17:45,468][123091] Updated weights for policy 0, policy_version 1465340 (0.0008) [2023-12-26 11:17:45,533][123091] Updated weights for policy 0, policy_version 1465350 (0.0010) [2023-12-26 11:17:45,584][123091] Updated weights for policy 0, policy_version 1465360 (0.0008) [2023-12-26 11:17:46,142][123090] Updated weights for policy 1, policy_version 1455940 (0.0009) [2023-12-26 11:17:46,204][123090] Updated weights for policy 1, policy_version 1455950 (0.0009) [2023-12-26 11:17:46,285][123090] Updated weights for policy 1, policy_version 1455960 (0.0009) [2023-12-26 11:17:46,354][123091] Updated weights for policy 0, policy_version 1465370 (0.0010) [2023-12-26 11:17:46,407][123091] Updated weights for policy 0, policy_version 1465380 (0.0009) [2023-12-26 11:17:46,463][123091] Updated weights for policy 0, policy_version 1465390 (0.0006) [2023-12-26 11:17:47,022][123090] Updated weights for policy 1, policy_version 1455970 (0.0009) [2023-12-26 11:17:47,083][123090] Updated weights for policy 1, policy_version 1455980 (0.0010) [2023-12-26 11:17:47,146][123090] Updated weights for policy 1, policy_version 1455990 (0.0010) [2023-12-26 11:17:47,157][123091] Updated weights for policy 0, policy_version 1465400 (0.0005) [2023-12-26 11:17:47,209][123090] Updated weights for policy 1, policy_version 1456000 (0.0010) [2023-12-26 11:17:47,210][123091] Updated weights for policy 0, policy_version 1465410 (0.0006) [2023-12-26 11:17:47,260][123091] Updated weights for policy 0, policy_version 1465420 (0.0010) [2023-12-26 11:17:48,012][123091] Updated weights for policy 0, policy_version 1465430 (0.0007) [2023-12-26 11:17:48,023][123090] Updated weights for policy 1, policy_version 1456010 (0.0006) [2023-12-26 11:17:48,061][123091] Updated weights for policy 0, policy_version 1465440 (0.0006) [2023-12-26 11:17:48,091][123090] Updated weights for policy 1, policy_version 1456020 (0.0006) [2023-12-26 11:17:48,129][123091] Updated weights for policy 0, policy_version 1465450 (0.0006) [2023-12-26 11:17:48,159][123090] Updated weights for policy 1, policy_version 1456030 (0.0006) [2023-12-26 11:17:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 747905024. Throughput: 0: 8731.8, 1: 8861.6. Samples: 747920232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:17:48,785][121949] Avg episode reward: [(0, '6253.208'), (1, '5697.346')] [2023-12-26 11:17:48,869][123091] Updated weights for policy 0, policy_version 1465460 (0.0008) [2023-12-26 11:17:48,904][123090] Updated weights for policy 1, policy_version 1456040 (0.0010) [2023-12-26 11:17:48,917][123091] Updated weights for policy 0, policy_version 1465470 (0.0011) [2023-12-26 11:17:48,964][123090] Updated weights for policy 1, policy_version 1456050 (0.0011) [2023-12-26 11:17:48,977][123091] Updated weights for policy 0, policy_version 1465480 (0.0011) [2023-12-26 11:17:49,016][123090] Updated weights for policy 1, policy_version 1456060 (0.0010) [2023-12-26 11:17:49,771][123091] Updated weights for policy 0, policy_version 1465490 (0.0011) [2023-12-26 11:17:49,834][123091] Updated weights for policy 0, policy_version 1465500 (0.0009) [2023-12-26 11:17:49,859][123090] Updated weights for policy 1, policy_version 1456070 (0.0009) [2023-12-26 11:17:49,893][123091] Updated weights for policy 0, policy_version 1465510 (0.0008) [2023-12-26 11:17:49,930][123090] Updated weights for policy 1, policy_version 1456080 (0.0010) [2023-12-26 11:17:49,959][123091] Updated weights for policy 0, policy_version 1465520 (0.0008) [2023-12-26 11:17:50,010][123090] Updated weights for policy 1, policy_version 1456090 (0.0011) [2023-12-26 11:17:50,677][123091] Updated weights for policy 0, policy_version 1465530 (0.0008) [2023-12-26 11:17:50,749][123091] Updated weights for policy 0, policy_version 1465540 (0.0007) [2023-12-26 11:17:50,770][123090] Updated weights for policy 1, policy_version 1456100 (0.0011) [2023-12-26 11:17:50,823][123091] Updated weights for policy 0, policy_version 1465550 (0.0008) [2023-12-26 11:17:50,834][123090] Updated weights for policy 1, policy_version 1456110 (0.0011) [2023-12-26 11:17:50,893][123090] Updated weights for policy 1, policy_version 1456121 (0.0011) [2023-12-26 11:17:51,613][123091] Updated weights for policy 0, policy_version 1465560 (0.0010) [2023-12-26 11:17:51,669][123091] Updated weights for policy 0, policy_version 1465570 (0.0011) [2023-12-26 11:17:51,729][123091] Updated weights for policy 0, policy_version 1465580 (0.0011) [2023-12-26 11:17:51,777][123090] Updated weights for policy 1, policy_version 1456131 (0.0010) [2023-12-26 11:17:51,842][123090] Updated weights for policy 1, policy_version 1456141 (0.0009) [2023-12-26 11:17:51,899][123090] Updated weights for policy 1, policy_version 1456151 (0.0010) [2023-12-26 11:17:52,453][123091] Updated weights for policy 0, policy_version 1465590 (0.0011) [2023-12-26 11:17:52,502][123091] Updated weights for policy 0, policy_version 1465600 (0.0011) [2023-12-26 11:17:52,565][123091] Updated weights for policy 0, policy_version 1465610 (0.0011) [2023-12-26 11:17:52,727][123090] Updated weights for policy 1, policy_version 1456161 (0.0009) [2023-12-26 11:17:52,787][123090] Updated weights for policy 1, policy_version 1456171 (0.0011) [2023-12-26 11:17:52,861][123090] Updated weights for policy 1, policy_version 1456181 (0.0005) [2023-12-26 11:17:52,933][123090] Updated weights for policy 1, policy_version 1456191 (0.0005) [2023-12-26 11:17:53,403][123091] Updated weights for policy 0, policy_version 1465620 (0.0009) [2023-12-26 11:17:53,450][123091] Updated weights for policy 0, policy_version 1465630 (0.0005) [2023-12-26 11:17:53,494][123091] Updated weights for policy 0, policy_version 1465640 (0.0005) [2023-12-26 11:17:53,682][123090] Updated weights for policy 1, policy_version 1456201 (0.0010) [2023-12-26 11:17:53,733][123090] Updated weights for policy 1, policy_version 1456211 (0.0010) [2023-12-26 11:17:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 747995136. Throughput: 0: 8808.8, 1: 8811.1. Samples: 747973352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:17:53,785][121949] Avg episode reward: [(0, '6246.951'), (1, '5545.506')] [2023-12-26 11:17:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001465648_375209984.pth... [2023-12-26 11:17:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001464592_374939648.pth [2023-12-26 11:17:53,796][123090] Updated weights for policy 1, policy_version 1456221 (0.0010) [2023-12-26 11:17:53,810][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001456224_372793344.pth... [2023-12-26 11:17:53,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001455168_372523008.pth [2023-12-26 11:17:54,201][123091] Updated weights for policy 0, policy_version 1465650 (0.0005) [2023-12-26 11:17:54,280][123091] Updated weights for policy 0, policy_version 1465660 (0.0008) [2023-12-26 11:17:54,330][123091] Updated weights for policy 0, policy_version 1465670 (0.0008) [2023-12-26 11:17:54,374][123091] Updated weights for policy 0, policy_version 1465680 (0.0008) [2023-12-26 11:17:54,638][123090] Updated weights for policy 1, policy_version 1456231 (0.0010) [2023-12-26 11:17:54,705][123090] Updated weights for policy 1, policy_version 1456241 (0.0010) [2023-12-26 11:17:54,761][123090] Updated weights for policy 1, policy_version 1456251 (0.0010) [2023-12-26 11:17:55,042][123091] Updated weights for policy 0, policy_version 1465690 (0.0011) [2023-12-26 11:17:55,104][123091] Updated weights for policy 0, policy_version 1465700 (0.0011) [2023-12-26 11:17:55,166][123091] Updated weights for policy 0, policy_version 1465710 (0.0010) [2023-12-26 11:17:55,572][123090] Updated weights for policy 1, policy_version 1456261 (0.0010) [2023-12-26 11:17:55,637][123090] Updated weights for policy 1, policy_version 1456271 (0.0010) [2023-12-26 11:17:55,700][123090] Updated weights for policy 1, policy_version 1456281 (0.0010) [2023-12-26 11:17:55,805][123091] Updated weights for policy 0, policy_version 1465720 (0.0006) [2023-12-26 11:17:55,870][123091] Updated weights for policy 0, policy_version 1465730 (0.0005) [2023-12-26 11:17:55,935][123091] Updated weights for policy 0, policy_version 1465740 (0.0007) [2023-12-26 11:17:56,460][123090] Updated weights for policy 1, policy_version 1456291 (0.0010) [2023-12-26 11:17:56,524][123090] Updated weights for policy 1, policy_version 1456301 (0.0009) [2023-12-26 11:17:56,598][123090] Updated weights for policy 1, policy_version 1456311 (0.0007) [2023-12-26 11:17:56,714][123091] Updated weights for policy 0, policy_version 1465750 (0.0008) [2023-12-26 11:17:56,786][123091] Updated weights for policy 0, policy_version 1465760 (0.0009) [2023-12-26 11:17:56,852][123091] Updated weights for policy 0, policy_version 1465770 (0.0010) [2023-12-26 11:17:57,330][123090] Updated weights for policy 1, policy_version 1456321 (0.0009) [2023-12-26 11:17:57,407][123090] Updated weights for policy 1, policy_version 1456331 (0.0006) [2023-12-26 11:17:57,481][123090] Updated weights for policy 1, policy_version 1456341 (0.0005) [2023-12-26 11:17:57,549][123090] Updated weights for policy 1, policy_version 1456351 (0.0005) [2023-12-26 11:17:57,578][123091] Updated weights for policy 0, policy_version 1465780 (0.0008) [2023-12-26 11:17:57,643][123091] Updated weights for policy 0, policy_version 1465790 (0.0005) [2023-12-26 11:17:57,711][123091] Updated weights for policy 0, policy_version 1465800 (0.0005) [2023-12-26 11:17:58,278][123090] Updated weights for policy 1, policy_version 1456361 (0.0007) [2023-12-26 11:17:58,350][123090] Updated weights for policy 1, policy_version 1456371 (0.0009) [2023-12-26 11:17:58,392][123091] Updated weights for policy 0, policy_version 1465810 (0.0007) [2023-12-26 11:17:58,414][123090] Updated weights for policy 1, policy_version 1456381 (0.0009) [2023-12-26 11:17:58,463][123091] Updated weights for policy 0, policy_version 1465820 (0.0010) [2023-12-26 11:17:58,525][123091] Updated weights for policy 0, policy_version 1465830 (0.0010) [2023-12-26 11:17:58,588][123091] Updated weights for policy 0, policy_version 1465840 (0.0011) [2023-12-26 11:17:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 748093440. Throughput: 0: 8943.0, 1: 8848.3. Samples: 748084148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:17:58,785][121949] Avg episode reward: [(0, '6239.437'), (1, '5709.728')] [2023-12-26 11:17:59,266][123090] Updated weights for policy 1, policy_version 1456391 (0.0007) [2023-12-26 11:17:59,327][123090] Updated weights for policy 1, policy_version 1456401 (0.0005) [2023-12-26 11:17:59,387][123091] Updated weights for policy 0, policy_version 1465850 (0.0011) [2023-12-26 11:17:59,392][123090] Updated weights for policy 1, policy_version 1456411 (0.0008) [2023-12-26 11:17:59,452][123091] Updated weights for policy 0, policy_version 1465860 (0.0011) [2023-12-26 11:17:59,518][123091] Updated weights for policy 0, policy_version 1465870 (0.0011) [2023-12-26 11:18:00,208][123090] Updated weights for policy 1, policy_version 1456421 (0.0010) [2023-12-26 11:18:00,262][123090] Updated weights for policy 1, policy_version 1456431 (0.0009) [2023-12-26 11:18:00,316][123090] Updated weights for policy 1, policy_version 1456441 (0.0010) [2023-12-26 11:18:00,341][123091] Updated weights for policy 0, policy_version 1465880 (0.0007) [2023-12-26 11:18:00,394][123091] Updated weights for policy 0, policy_version 1465890 (0.0008) [2023-12-26 11:18:00,458][123091] Updated weights for policy 0, policy_version 1465900 (0.0009) [2023-12-26 11:18:01,117][123090] Updated weights for policy 1, policy_version 1456451 (0.0008) [2023-12-26 11:18:01,190][123090] Updated weights for policy 1, policy_version 1456461 (0.0009) [2023-12-26 11:18:01,246][123090] Updated weights for policy 1, policy_version 1456471 (0.0009) [2023-12-26 11:18:01,393][123091] Updated weights for policy 0, policy_version 1465910 (0.0009) [2023-12-26 11:18:01,456][123091] Updated weights for policy 0, policy_version 1465920 (0.0010) [2023-12-26 11:18:01,516][123091] Updated weights for policy 0, policy_version 1465930 (0.0009) [2023-12-26 11:18:02,088][123090] Updated weights for policy 1, policy_version 1456481 (0.0009) [2023-12-26 11:18:02,145][123090] Updated weights for policy 1, policy_version 1456491 (0.0009) [2023-12-26 11:18:02,212][123090] Updated weights for policy 1, policy_version 1456501 (0.0009) [2023-12-26 11:18:02,276][123090] Updated weights for policy 1, policy_version 1456511 (0.0009) [2023-12-26 11:18:02,337][123091] Updated weights for policy 0, policy_version 1465940 (0.0010) [2023-12-26 11:18:02,395][123091] Updated weights for policy 0, policy_version 1465950 (0.0010) [2023-12-26 11:18:02,443][123091] Updated weights for policy 0, policy_version 1465960 (0.0005) [2023-12-26 11:18:03,122][123090] Updated weights for policy 1, policy_version 1456521 (0.0010) [2023-12-26 11:18:03,182][123090] Updated weights for policy 1, policy_version 1456531 (0.0009) [2023-12-26 11:18:03,235][123091] Updated weights for policy 0, policy_version 1465970 (0.0005) [2023-12-26 11:18:03,238][123090] Updated weights for policy 1, policy_version 1456541 (0.0009) [2023-12-26 11:18:03,283][123091] Updated weights for policy 0, policy_version 1465980 (0.0008) [2023-12-26 11:18:03,332][123091] Updated weights for policy 0, policy_version 1465990 (0.0009) [2023-12-26 11:18:03,380][123091] Updated weights for policy 0, policy_version 1466000 (0.0009) [2023-12-26 11:18:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 748175360. Throughput: 0: 8946.6, 1: 8819.6. Samples: 748187504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:03,785][121949] Avg episode reward: [(0, '6247.944'), (1, '5730.807')] [2023-12-26 11:18:04,029][123090] Updated weights for policy 1, policy_version 1456551 (0.0010) [2023-12-26 11:18:04,034][123091] Updated weights for policy 0, policy_version 1466010 (0.0006) [2023-12-26 11:18:04,089][123090] Updated weights for policy 1, policy_version 1456561 (0.0010) [2023-12-26 11:18:04,102][123091] Updated weights for policy 0, policy_version 1466020 (0.0009) [2023-12-26 11:18:04,150][123090] Updated weights for policy 1, policy_version 1456571 (0.0011) [2023-12-26 11:18:04,163][123091] Updated weights for policy 0, policy_version 1466030 (0.0007) [2023-12-26 11:18:04,899][123091] Updated weights for policy 0, policy_version 1466040 (0.0006) [2023-12-26 11:18:04,954][123091] Updated weights for policy 0, policy_version 1466050 (0.0006) [2023-12-26 11:18:04,997][123090] Updated weights for policy 1, policy_version 1456581 (0.0010) [2023-12-26 11:18:05,010][123091] Updated weights for policy 0, policy_version 1466060 (0.0006) [2023-12-26 11:18:05,065][123090] Updated weights for policy 1, policy_version 1456591 (0.0011) [2023-12-26 11:18:05,109][123090] Updated weights for policy 1, policy_version 1456601 (0.0010) [2023-12-26 11:18:05,850][123091] Updated weights for policy 0, policy_version 1466070 (0.0008) [2023-12-26 11:18:05,860][123090] Updated weights for policy 1, policy_version 1456611 (0.0009) [2023-12-26 11:18:05,897][123091] Updated weights for policy 0, policy_version 1466081 (0.0008) [2023-12-26 11:18:05,908][123090] Updated weights for policy 1, policy_version 1456621 (0.0008) [2023-12-26 11:18:05,945][123091] Updated weights for policy 0, policy_version 1466091 (0.0005) [2023-12-26 11:18:05,963][123090] Updated weights for policy 1, policy_version 1456631 (0.0010) [2023-12-26 11:18:06,792][123090] Updated weights for policy 1, policy_version 1456641 (0.0010) [2023-12-26 11:18:06,793][123091] Updated weights for policy 0, policy_version 1466101 (0.0008) [2023-12-26 11:18:06,845][123091] Updated weights for policy 0, policy_version 1466111 (0.0007) [2023-12-26 11:18:06,863][123090] Updated weights for policy 1, policy_version 1456651 (0.0009) [2023-12-26 11:18:06,894][123091] Updated weights for policy 0, policy_version 1466121 (0.0008) [2023-12-26 11:18:06,933][123090] Updated weights for policy 1, policy_version 1456661 (0.0006) [2023-12-26 11:18:06,998][123090] Updated weights for policy 1, policy_version 1456671 (0.0005) [2023-12-26 11:18:07,588][123091] Updated weights for policy 0, policy_version 1466131 (0.0007) [2023-12-26 11:18:07,611][123090] Updated weights for policy 1, policy_version 1456681 (0.0008) [2023-12-26 11:18:07,636][123091] Updated weights for policy 0, policy_version 1466141 (0.0008) [2023-12-26 11:18:07,674][123090] Updated weights for policy 1, policy_version 1456691 (0.0010) [2023-12-26 11:18:07,704][123091] Updated weights for policy 0, policy_version 1466151 (0.0009) [2023-12-26 11:18:07,739][123090] Updated weights for policy 1, policy_version 1456701 (0.0009) [2023-12-26 11:18:08,438][123090] Updated weights for policy 1, policy_version 1456711 (0.0010) [2023-12-26 11:18:08,496][123090] Updated weights for policy 1, policy_version 1456721 (0.0005) [2023-12-26 11:18:08,536][123091] Updated weights for policy 0, policy_version 1466161 (0.0009) [2023-12-26 11:18:08,565][123090] Updated weights for policy 1, policy_version 1456731 (0.0006) [2023-12-26 11:18:08,594][123091] Updated weights for policy 0, policy_version 1466171 (0.0007) [2023-12-26 11:18:08,653][123091] Updated weights for policy 0, policy_version 1466181 (0.0009) [2023-12-26 11:18:08,718][123091] Updated weights for policy 0, policy_version 1466191 (0.0005) [2023-12-26 11:18:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 748273664. Throughput: 0: 8965.1, 1: 8882.2. Samples: 748241540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:08,785][121949] Avg episode reward: [(0, '6288.871'), (1, '5677.828')] [2023-12-26 11:18:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001466192_375349248.pth... [2023-12-26 11:18:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001456736_372924416.pth... [2023-12-26 11:18:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001465136_375078912.pth [2023-12-26 11:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001455712_372662272.pth [2023-12-26 11:18:09,280][123090] Updated weights for policy 1, policy_version 1456741 (0.0009) [2023-12-26 11:18:09,347][123090] Updated weights for policy 1, policy_version 1456751 (0.0008) [2023-12-26 11:18:09,424][123090] Updated weights for policy 1, policy_version 1456761 (0.0008) [2023-12-26 11:18:09,469][123091] Updated weights for policy 0, policy_version 1466201 (0.0006) [2023-12-26 11:18:09,534][123091] Updated weights for policy 0, policy_version 1466211 (0.0006) [2023-12-26 11:18:09,597][123091] Updated weights for policy 0, policy_version 1466221 (0.0009) [2023-12-26 11:18:10,246][123090] Updated weights for policy 1, policy_version 1456771 (0.0009) [2023-12-26 11:18:10,306][123090] Updated weights for policy 1, policy_version 1456781 (0.0009) [2023-12-26 11:18:10,382][123090] Updated weights for policy 1, policy_version 1456792 (0.0009) [2023-12-26 11:18:10,402][123091] Updated weights for policy 0, policy_version 1466231 (0.0009) [2023-12-26 11:18:10,461][123091] Updated weights for policy 0, policy_version 1466241 (0.0008) [2023-12-26 11:18:10,519][123091] Updated weights for policy 0, policy_version 1466251 (0.0009) [2023-12-26 11:18:11,254][123090] Updated weights for policy 1, policy_version 1456802 (0.0009) [2023-12-26 11:18:11,318][123090] Updated weights for policy 1, policy_version 1456812 (0.0010) [2023-12-26 11:18:11,384][123091] Updated weights for policy 0, policy_version 1466261 (0.0009) [2023-12-26 11:18:11,386][123090] Updated weights for policy 1, policy_version 1456822 (0.0009) [2023-12-26 11:18:11,447][123091] Updated weights for policy 0, policy_version 1466271 (0.0008) [2023-12-26 11:18:11,453][123090] Updated weights for policy 1, policy_version 1456832 (0.0009) [2023-12-26 11:18:11,517][123091] Updated weights for policy 0, policy_version 1466281 (0.0008) [2023-12-26 11:18:12,337][123090] Updated weights for policy 1, policy_version 1456842 (0.0010) [2023-12-26 11:18:12,394][123091] Updated weights for policy 0, policy_version 1466291 (0.0009) [2023-12-26 11:18:12,402][123090] Updated weights for policy 1, policy_version 1456852 (0.0009) [2023-12-26 11:18:12,457][123091] Updated weights for policy 0, policy_version 1466301 (0.0008) [2023-12-26 11:18:12,467][123090] Updated weights for policy 1, policy_version 1456862 (0.0010) [2023-12-26 11:18:12,516][123091] Updated weights for policy 0, policy_version 1466311 (0.0009) [2023-12-26 11:18:13,303][123090] Updated weights for policy 1, policy_version 1456872 (0.0009) [2023-12-26 11:18:13,355][123091] Updated weights for policy 0, policy_version 1466321 (0.0009) [2023-12-26 11:18:13,358][123090] Updated weights for policy 1, policy_version 1456882 (0.0009) [2023-12-26 11:18:13,417][123090] Updated weights for policy 1, policy_version 1456892 (0.0007) [2023-12-26 11:18:13,430][123091] Updated weights for policy 0, policy_version 1466331 (0.0005) [2023-12-26 11:18:13,497][123091] Updated weights for policy 0, policy_version 1466341 (0.0006) [2023-12-26 11:18:13,561][123091] Updated weights for policy 0, policy_version 1466351 (0.0005) [2023-12-26 11:18:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 748355584. Throughput: 0: 8988.4, 1: 8877.4. Samples: 748346564. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:13,785][121949] Avg episode reward: [(0, '6282.737'), (1, '5701.679')] [2023-12-26 11:18:14,137][123091] Updated weights for policy 0, policy_version 1466361 (0.0005) [2023-12-26 11:18:14,207][123091] Updated weights for policy 0, policy_version 1466371 (0.0005) [2023-12-26 11:18:14,269][123091] Updated weights for policy 0, policy_version 1466381 (0.0008) [2023-12-26 11:18:14,327][123090] Updated weights for policy 1, policy_version 1456902 (0.0008) [2023-12-26 11:18:14,386][123090] Updated weights for policy 1, policy_version 1456912 (0.0009) [2023-12-26 11:18:14,451][123090] Updated weights for policy 1, policy_version 1456922 (0.0009) [2023-12-26 11:18:14,955][123091] Updated weights for policy 0, policy_version 1466391 (0.0010) [2023-12-26 11:18:15,021][123091] Updated weights for policy 0, policy_version 1466401 (0.0007) [2023-12-26 11:18:15,085][123091] Updated weights for policy 0, policy_version 1466411 (0.0010) [2023-12-26 11:18:15,337][123090] Updated weights for policy 1, policy_version 1456932 (0.0010) [2023-12-26 11:18:15,406][123090] Updated weights for policy 1, policy_version 1456942 (0.0010) [2023-12-26 11:18:15,480][123090] Updated weights for policy 1, policy_version 1456952 (0.0009) [2023-12-26 11:18:15,910][123091] Updated weights for policy 0, policy_version 1466421 (0.0010) [2023-12-26 11:18:15,965][123091] Updated weights for policy 0, policy_version 1466431 (0.0006) [2023-12-26 11:18:16,027][123091] Updated weights for policy 0, policy_version 1466441 (0.0005) [2023-12-26 11:18:16,326][123090] Updated weights for policy 1, policy_version 1456962 (0.0010) [2023-12-26 11:18:16,378][123090] Updated weights for policy 1, policy_version 1456972 (0.0009) [2023-12-26 11:18:16,427][123090] Updated weights for policy 1, policy_version 1456982 (0.0009) [2023-12-26 11:18:16,475][123090] Updated weights for policy 1, policy_version 1456992 (0.0009) [2023-12-26 11:18:16,785][123091] Updated weights for policy 0, policy_version 1466451 (0.0008) [2023-12-26 11:18:16,849][123091] Updated weights for policy 0, policy_version 1466461 (0.0009) [2023-12-26 11:18:16,915][123091] Updated weights for policy 0, policy_version 1466471 (0.0009) [2023-12-26 11:18:17,343][123090] Updated weights for policy 1, policy_version 1457002 (0.0009) [2023-12-26 11:18:17,413][123090] Updated weights for policy 1, policy_version 1457012 (0.0010) [2023-12-26 11:18:17,473][123090] Updated weights for policy 1, policy_version 1457022 (0.0008) [2023-12-26 11:18:17,729][123091] Updated weights for policy 0, policy_version 1466481 (0.0009) [2023-12-26 11:18:17,800][123091] Updated weights for policy 0, policy_version 1466491 (0.0008) [2023-12-26 11:18:17,863][123091] Updated weights for policy 0, policy_version 1466501 (0.0009) [2023-12-26 11:18:17,915][123091] Updated weights for policy 0, policy_version 1466511 (0.0010) [2023-12-26 11:18:18,327][123090] Updated weights for policy 1, policy_version 1457032 (0.0010) [2023-12-26 11:18:18,399][123090] Updated weights for policy 1, policy_version 1457042 (0.0010) [2023-12-26 11:18:18,459][123090] Updated weights for policy 1, policy_version 1457052 (0.0009) [2023-12-26 11:18:18,702][123091] Updated weights for policy 0, policy_version 1466521 (0.0006) [2023-12-26 11:18:18,770][123091] Updated weights for policy 0, policy_version 1466531 (0.0009) [2023-12-26 11:18:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 748437504. Throughput: 0: 9039.8, 1: 8756.4. Samples: 748450872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:18,785][121949] Avg episode reward: [(0, '6234.123'), (1, '5665.014')] [2023-12-26 11:18:18,835][123091] Updated weights for policy 0, policy_version 1466541 (0.0010) [2023-12-26 11:18:19,348][123090] Updated weights for policy 1, policy_version 1457062 (0.0009) [2023-12-26 11:18:19,421][123090] Updated weights for policy 1, policy_version 1457072 (0.0009) [2023-12-26 11:18:19,479][123090] Updated weights for policy 1, policy_version 1457082 (0.0010) [2023-12-26 11:18:19,557][123091] Updated weights for policy 0, policy_version 1466551 (0.0010) [2023-12-26 11:18:19,612][123091] Updated weights for policy 0, policy_version 1466561 (0.0010) [2023-12-26 11:18:19,664][123091] Updated weights for policy 0, policy_version 1466571 (0.0009) [2023-12-26 11:18:20,324][123090] Updated weights for policy 1, policy_version 1457092 (0.0009) [2023-12-26 11:18:20,390][123090] Updated weights for policy 1, policy_version 1457102 (0.0010) [2023-12-26 11:18:20,449][123090] Updated weights for policy 1, policy_version 1457112 (0.0010) [2023-12-26 11:18:20,545][123091] Updated weights for policy 0, policy_version 1466581 (0.0010) [2023-12-26 11:18:20,612][123091] Updated weights for policy 0, policy_version 1466591 (0.0010) [2023-12-26 11:18:20,679][123091] Updated weights for policy 0, policy_version 1466601 (0.0010) [2023-12-26 11:18:21,273][123090] Updated weights for policy 1, policy_version 1457122 (0.0009) [2023-12-26 11:18:21,332][123090] Updated weights for policy 1, policy_version 1457132 (0.0008) [2023-12-26 11:18:21,405][123090] Updated weights for policy 1, policy_version 1457142 (0.0008) [2023-12-26 11:18:21,480][123090] Updated weights for policy 1, policy_version 1457152 (0.0008) [2023-12-26 11:18:21,551][123091] Updated weights for policy 0, policy_version 1466611 (0.0008) [2023-12-26 11:18:21,611][123091] Updated weights for policy 0, policy_version 1466621 (0.0007) [2023-12-26 11:18:21,685][123091] Updated weights for policy 0, policy_version 1466631 (0.0007) [2023-12-26 11:18:22,318][123090] Updated weights for policy 1, policy_version 1457162 (0.0007) [2023-12-26 11:18:22,389][123090] Updated weights for policy 1, policy_version 1457172 (0.0009) [2023-12-26 11:18:22,449][123090] Updated weights for policy 1, policy_version 1457182 (0.0009) [2023-12-26 11:18:22,589][123091] Updated weights for policy 0, policy_version 1466641 (0.0010) [2023-12-26 11:18:22,657][123091] Updated weights for policy 0, policy_version 1466651 (0.0010) [2023-12-26 11:18:22,717][123091] Updated weights for policy 0, policy_version 1466661 (0.0009) [2023-12-26 11:18:22,776][123091] Updated weights for policy 0, policy_version 1466671 (0.0010) [2023-12-26 11:18:23,275][123090] Updated weights for policy 1, policy_version 1457192 (0.0010) [2023-12-26 11:18:23,340][123090] Updated weights for policy 1, policy_version 1457202 (0.0009) [2023-12-26 11:18:23,406][123090] Updated weights for policy 1, policy_version 1457212 (0.0009) [2023-12-26 11:18:23,641][123091] Updated weights for policy 0, policy_version 1466681 (0.0009) [2023-12-26 11:18:23,702][123091] Updated weights for policy 0, policy_version 1466691 (0.0009) [2023-12-26 11:18:23,767][123091] Updated weights for policy 0, policy_version 1466701 (0.0009) [2023-12-26 11:18:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 748527616. Throughput: 0: 8987.5, 1: 8693.4. Samples: 748501700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:23,785][121949] Avg episode reward: [(0, '6252.710'), (1, '5631.034')] [2023-12-26 11:18:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001457216_373047296.pth... [2023-12-26 11:18:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001466704_375480320.pth... [2023-12-26 11:18:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001456224_372793344.pth [2023-12-26 11:18:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001465648_375209984.pth [2023-12-26 11:18:24,216][123090] Updated weights for policy 1, policy_version 1457222 (0.0009) [2023-12-26 11:18:24,280][123090] Updated weights for policy 1, policy_version 1457232 (0.0010) [2023-12-26 11:18:24,336][123090] Updated weights for policy 1, policy_version 1457242 (0.0009) [2023-12-26 11:18:24,560][123091] Updated weights for policy 0, policy_version 1466711 (0.0010) [2023-12-26 11:18:24,620][123091] Updated weights for policy 0, policy_version 1466721 (0.0008) [2023-12-26 11:18:24,673][123091] Updated weights for policy 0, policy_version 1466731 (0.0009) [2023-12-26 11:18:25,190][123090] Updated weights for policy 1, policy_version 1457253 (0.0010) [2023-12-26 11:18:25,250][123090] Updated weights for policy 1, policy_version 1457263 (0.0008) [2023-12-26 11:18:25,317][123090] Updated weights for policy 1, policy_version 1457273 (0.0009) [2023-12-26 11:18:25,426][123091] Updated weights for policy 0, policy_version 1466741 (0.0010) [2023-12-26 11:18:25,493][123091] Updated weights for policy 0, policy_version 1466751 (0.0010) [2023-12-26 11:18:25,561][123091] Updated weights for policy 0, policy_version 1466761 (0.0010) [2023-12-26 11:18:26,076][123090] Updated weights for policy 1, policy_version 1457283 (0.0008) [2023-12-26 11:18:26,136][123090] Updated weights for policy 1, policy_version 1457293 (0.0005) [2023-12-26 11:18:26,185][123090] Updated weights for policy 1, policy_version 1457303 (0.0006) [2023-12-26 11:18:26,300][123091] Updated weights for policy 0, policy_version 1466771 (0.0009) [2023-12-26 11:18:26,364][123091] Updated weights for policy 0, policy_version 1466781 (0.0009) [2023-12-26 11:18:26,419][123091] Updated weights for policy 0, policy_version 1466791 (0.0008) [2023-12-26 11:18:27,007][123090] Updated weights for policy 1, policy_version 1457313 (0.0010) [2023-12-26 11:18:27,064][123090] Updated weights for policy 1, policy_version 1457323 (0.0009) [2023-12-26 11:18:27,120][123090] Updated weights for policy 1, policy_version 1457333 (0.0006) [2023-12-26 11:18:27,162][123091] Updated weights for policy 0, policy_version 1466801 (0.0006) [2023-12-26 11:18:27,175][123090] Updated weights for policy 1, policy_version 1457343 (0.0006) [2023-12-26 11:18:27,210][123091] Updated weights for policy 0, policy_version 1466811 (0.0010) [2023-12-26 11:18:27,257][123091] Updated weights for policy 0, policy_version 1466821 (0.0010) [2023-12-26 11:18:27,319][123091] Updated weights for policy 0, policy_version 1466831 (0.0010) [2023-12-26 11:18:27,841][123090] Updated weights for policy 1, policy_version 1457353 (0.0005) [2023-12-26 11:18:27,909][123090] Updated weights for policy 1, policy_version 1457363 (0.0009) [2023-12-26 11:18:27,974][123090] Updated weights for policy 1, policy_version 1457373 (0.0010) [2023-12-26 11:18:28,015][123091] Updated weights for policy 0, policy_version 1466841 (0.0006) [2023-12-26 11:18:28,071][123091] Updated weights for policy 0, policy_version 1466851 (0.0005) [2023-12-26 11:18:28,129][123091] Updated weights for policy 0, policy_version 1466861 (0.0005) [2023-12-26 11:18:28,750][123090] Updated weights for policy 1, policy_version 1457383 (0.0010) [2023-12-26 11:18:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 748609536. Throughput: 0: 8997.9, 1: 8660.7. Samples: 748607272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:28,785][121949] Avg episode reward: [(0, '6195.311'), (1, '5605.390')] [2023-12-26 11:18:28,805][123090] Updated weights for policy 1, policy_version 1457393 (0.0010) [2023-12-26 11:18:28,855][123091] Updated weights for policy 0, policy_version 1466871 (0.0005) [2023-12-26 11:18:28,857][123090] Updated weights for policy 1, policy_version 1457403 (0.0010) [2023-12-26 11:18:28,917][123091] Updated weights for policy 0, policy_version 1466881 (0.0007) [2023-12-26 11:18:28,969][123091] Updated weights for policy 0, policy_version 1466891 (0.0008) [2023-12-26 11:18:29,649][123090] Updated weights for policy 1, policy_version 1457413 (0.0010) [2023-12-26 11:18:29,700][123090] Updated weights for policy 1, policy_version 1457423 (0.0010) [2023-12-26 11:18:29,756][123090] Updated weights for policy 1, policy_version 1457433 (0.0010) [2023-12-26 11:18:29,807][123091] Updated weights for policy 0, policy_version 1466901 (0.0010) [2023-12-26 11:18:29,873][123091] Updated weights for policy 0, policy_version 1466911 (0.0010) [2023-12-26 11:18:29,947][123091] Updated weights for policy 0, policy_version 1466921 (0.0008) [2023-12-26 11:18:30,473][123090] Updated weights for policy 1, policy_version 1457443 (0.0009) [2023-12-26 11:18:30,524][123090] Updated weights for policy 1, policy_version 1457453 (0.0007) [2023-12-26 11:18:30,568][123090] Updated weights for policy 1, policy_version 1457463 (0.0009) [2023-12-26 11:18:30,685][123091] Updated weights for policy 0, policy_version 1466931 (0.0010) [2023-12-26 11:18:30,743][123091] Updated weights for policy 0, policy_version 1466942 (0.0011) [2023-12-26 11:18:30,801][123091] Updated weights for policy 0, policy_version 1466952 (0.0009) [2023-12-26 11:18:31,244][123090] Updated weights for policy 1, policy_version 1457473 (0.0006) [2023-12-26 11:18:31,311][123090] Updated weights for policy 1, policy_version 1457483 (0.0008) [2023-12-26 11:18:31,375][123090] Updated weights for policy 1, policy_version 1457493 (0.0008) [2023-12-26 11:18:31,430][123090] Updated weights for policy 1, policy_version 1457503 (0.0008) [2023-12-26 11:18:31,643][123091] Updated weights for policy 0, policy_version 1466962 (0.0009) [2023-12-26 11:18:31,695][123091] Updated weights for policy 0, policy_version 1466972 (0.0009) [2023-12-26 11:18:31,770][123091] Updated weights for policy 0, policy_version 1466982 (0.0010) [2023-12-26 11:18:31,837][123091] Updated weights for policy 0, policy_version 1466992 (0.0009) [2023-12-26 11:18:32,206][123090] Updated weights for policy 1, policy_version 1457513 (0.0010) [2023-12-26 11:18:32,276][123090] Updated weights for policy 1, policy_version 1457523 (0.0010) [2023-12-26 11:18:32,332][123090] Updated weights for policy 1, policy_version 1457533 (0.0010) [2023-12-26 11:18:32,653][123091] Updated weights for policy 0, policy_version 1467002 (0.0009) [2023-12-26 11:18:32,712][123091] Updated weights for policy 0, policy_version 1467012 (0.0009) [2023-12-26 11:18:32,760][123091] Updated weights for policy 0, policy_version 1467022 (0.0008) [2023-12-26 11:18:33,157][123090] Updated weights for policy 1, policy_version 1457543 (0.0010) [2023-12-26 11:18:33,229][123090] Updated weights for policy 1, policy_version 1457553 (0.0011) [2023-12-26 11:18:33,307][123090] Updated weights for policy 1, policy_version 1457563 (0.0011) [2023-12-26 11:18:33,487][123091] Updated weights for policy 0, policy_version 1467032 (0.0008) [2023-12-26 11:18:33,538][123091] Updated weights for policy 0, policy_version 1467042 (0.0005) [2023-12-26 11:18:33,584][123091] Updated weights for policy 0, policy_version 1467052 (0.0005) [2023-12-26 11:18:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 748707840. Throughput: 0: 8992.9, 1: 8714.7. Samples: 748717072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:33,785][121949] Avg episode reward: [(0, '6168.508'), (1, '5531.254')] [2023-12-26 11:18:34,016][123090] Updated weights for policy 1, policy_version 1457573 (0.0010) [2023-12-26 11:18:34,060][123090] Updated weights for policy 1, policy_version 1457583 (0.0010) [2023-12-26 11:18:34,112][123090] Updated weights for policy 1, policy_version 1457593 (0.0010) [2023-12-26 11:18:34,358][123091] Updated weights for policy 0, policy_version 1467062 (0.0008) [2023-12-26 11:18:34,412][123091] Updated weights for policy 0, policy_version 1467072 (0.0010) [2023-12-26 11:18:34,467][123091] Updated weights for policy 0, policy_version 1467082 (0.0009) [2023-12-26 11:18:34,952][123090] Updated weights for policy 1, policy_version 1457603 (0.0012) [2023-12-26 11:18:35,002][123090] Updated weights for policy 1, policy_version 1457613 (0.0009) [2023-12-26 11:18:35,054][123090] Updated weights for policy 1, policy_version 1457623 (0.0010) [2023-12-26 11:18:35,272][123091] Updated weights for policy 0, policy_version 1467092 (0.0008) [2023-12-26 11:18:35,332][123091] Updated weights for policy 0, policy_version 1467102 (0.0005) [2023-12-26 11:18:35,402][123091] Updated weights for policy 0, policy_version 1467112 (0.0005) [2023-12-26 11:18:35,949][123090] Updated weights for policy 1, policy_version 1457633 (0.0010) [2023-12-26 11:18:36,001][123090] Updated weights for policy 1, policy_version 1457643 (0.0009) [2023-12-26 11:18:36,054][123090] Updated weights for policy 1, policy_version 1457653 (0.0009) [2023-12-26 11:18:36,106][123090] Updated weights for policy 1, policy_version 1457663 (0.0009) [2023-12-26 11:18:36,129][123091] Updated weights for policy 0, policy_version 1467122 (0.0006) [2023-12-26 11:18:36,191][123091] Updated weights for policy 0, policy_version 1467132 (0.0006) [2023-12-26 11:18:36,251][123091] Updated weights for policy 0, policy_version 1467142 (0.0009) [2023-12-26 11:18:36,321][123091] Updated weights for policy 0, policy_version 1467152 (0.0010) [2023-12-26 11:18:36,975][123090] Updated weights for policy 1, policy_version 1457673 (0.0009) [2023-12-26 11:18:37,035][123090] Updated weights for policy 1, policy_version 1457683 (0.0010) [2023-12-26 11:18:37,091][123090] Updated weights for policy 1, policy_version 1457693 (0.0009) [2023-12-26 11:18:37,104][123091] Updated weights for policy 0, policy_version 1467162 (0.0007) [2023-12-26 11:18:37,159][123091] Updated weights for policy 0, policy_version 1467172 (0.0009) [2023-12-26 11:18:37,211][123091] Updated weights for policy 0, policy_version 1467182 (0.0010) [2023-12-26 11:18:37,929][123090] Updated weights for policy 1, policy_version 1457703 (0.0006) [2023-12-26 11:18:37,986][123090] Updated weights for policy 1, policy_version 1457713 (0.0009) [2023-12-26 11:18:38,042][123090] Updated weights for policy 1, policy_version 1457723 (0.0008) [2023-12-26 11:18:38,056][123091] Updated weights for policy 0, policy_version 1467192 (0.0010) [2023-12-26 11:18:38,116][123091] Updated weights for policy 0, policy_version 1467202 (0.0010) [2023-12-26 11:18:38,172][123091] Updated weights for policy 0, policy_version 1467212 (0.0006) [2023-12-26 11:18:38,744][123090] Updated weights for policy 1, policy_version 1457733 (0.0009) [2023-12-26 11:18:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 748789760. Throughput: 0: 8992.3, 1: 8728.7. Samples: 748770800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:38,785][121949] Avg episode reward: [(0, '6198.889'), (1, '5692.772')] [2023-12-26 11:18:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001467216_375611392.pth... [2023-12-26 11:18:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001466192_375349248.pth [2023-12-26 11:18:38,812][123090] Updated weights for policy 1, policy_version 1457743 (0.0010) [2023-12-26 11:18:38,878][123090] Updated weights for policy 1, policy_version 1457753 (0.0010) [2023-12-26 11:18:38,912][123091] Updated weights for policy 0, policy_version 1467222 (0.0005) [2023-12-26 11:18:38,918][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001457760_373186560.pth... [2023-12-26 11:18:38,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001456736_372924416.pth [2023-12-26 11:18:38,981][123091] Updated weights for policy 0, policy_version 1467232 (0.0005) [2023-12-26 11:18:39,050][123091] Updated weights for policy 0, policy_version 1467242 (0.0007) [2023-12-26 11:18:39,704][123090] Updated weights for policy 1, policy_version 1457763 (0.0008) [2023-12-26 11:18:39,770][123090] Updated weights for policy 1, policy_version 1457773 (0.0005) [2023-12-26 11:18:39,812][123091] Updated weights for policy 0, policy_version 1467252 (0.0007) [2023-12-26 11:18:39,842][123090] Updated weights for policy 1, policy_version 1457783 (0.0007) [2023-12-26 11:18:39,880][123091] Updated weights for policy 0, policy_version 1467262 (0.0009) [2023-12-26 11:18:39,940][123091] Updated weights for policy 0, policy_version 1467272 (0.0008) [2023-12-26 11:18:40,593][123090] Updated weights for policy 1, policy_version 1457793 (0.0007) [2023-12-26 11:18:40,663][123090] Updated weights for policy 1, policy_version 1457803 (0.0006) [2023-12-26 11:18:40,731][123090] Updated weights for policy 1, policy_version 1457813 (0.0005) [2023-12-26 11:18:40,775][123091] Updated weights for policy 0, policy_version 1467282 (0.0007) [2023-12-26 11:18:40,785][123090] Updated weights for policy 1, policy_version 1457823 (0.0006) [2023-12-26 11:18:40,838][123091] Updated weights for policy 0, policy_version 1467292 (0.0011) [2023-12-26 11:18:40,904][123091] Updated weights for policy 0, policy_version 1467302 (0.0011) [2023-12-26 11:18:40,971][123091] Updated weights for policy 0, policy_version 1467312 (0.0011) [2023-12-26 11:18:41,519][123090] Updated weights for policy 1, policy_version 1457833 (0.0008) [2023-12-26 11:18:41,569][123090] Updated weights for policy 1, policy_version 1457843 (0.0009) [2023-12-26 11:18:41,634][123090] Updated weights for policy 1, policy_version 1457853 (0.0009) [2023-12-26 11:18:41,803][123091] Updated weights for policy 0, policy_version 1467322 (0.0010) [2023-12-26 11:18:41,861][123091] Updated weights for policy 0, policy_version 1467332 (0.0009) [2023-12-26 11:18:41,925][123091] Updated weights for policy 0, policy_version 1467342 (0.0009) [2023-12-26 11:18:42,356][123090] Updated weights for policy 1, policy_version 1457863 (0.0009) [2023-12-26 11:18:42,431][123090] Updated weights for policy 1, policy_version 1457873 (0.0006) [2023-12-26 11:18:42,502][123090] Updated weights for policy 1, policy_version 1457883 (0.0007) [2023-12-26 11:18:42,826][123091] Updated weights for policy 0, policy_version 1467353 (0.0010) [2023-12-26 11:18:42,881][123091] Updated weights for policy 0, policy_version 1467366 (0.0011) [2023-12-26 11:18:43,174][123090] Updated weights for policy 1, policy_version 1457893 (0.0007) [2023-12-26 11:18:43,239][123090] Updated weights for policy 1, policy_version 1457903 (0.0009) [2023-12-26 11:18:43,304][123090] Updated weights for policy 1, policy_version 1457913 (0.0009) [2023-12-26 11:18:43,684][123091] Updated weights for policy 0, policy_version 1467377 (0.0010) [2023-12-26 11:18:43,744][123091] Updated weights for policy 0, policy_version 1467387 (0.0009) [2023-12-26 11:18:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 748879872. Throughput: 0: 8877.5, 1: 8732.4. Samples: 748876588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:43,785][121949] Avg episode reward: [(0, '6302.681'), (1, '5780.286')] [2023-12-26 11:18:43,801][123091] Updated weights for policy 0, policy_version 1467397 (0.0009) [2023-12-26 11:18:43,865][123091] Updated weights for policy 0, policy_version 1467407 (0.0010) [2023-12-26 11:18:44,146][123090] Updated weights for policy 1, policy_version 1457923 (0.0009) [2023-12-26 11:18:44,198][123090] Updated weights for policy 1, policy_version 1457933 (0.0009) [2023-12-26 11:18:44,249][123090] Updated weights for policy 1, policy_version 1457943 (0.0009) [2023-12-26 11:18:44,546][123091] Updated weights for policy 0, policy_version 1467417 (0.0008) [2023-12-26 11:18:44,608][123091] Updated weights for policy 0, policy_version 1467427 (0.0010) [2023-12-26 11:18:44,678][123091] Updated weights for policy 0, policy_version 1467437 (0.0007) [2023-12-26 11:18:45,038][123090] Updated weights for policy 1, policy_version 1457954 (0.0010) [2023-12-26 11:18:45,112][123090] Updated weights for policy 1, policy_version 1457964 (0.0006) [2023-12-26 11:18:45,188][123090] Updated weights for policy 1, policy_version 1457974 (0.0006) [2023-12-26 11:18:45,254][123090] Updated weights for policy 1, policy_version 1457984 (0.0010) [2023-12-26 11:18:45,475][123091] Updated weights for policy 0, policy_version 1467447 (0.0007) [2023-12-26 11:18:45,530][123091] Updated weights for policy 0, policy_version 1467457 (0.0011) [2023-12-26 11:18:45,577][123091] Updated weights for policy 0, policy_version 1467467 (0.0011) [2023-12-26 11:18:45,939][123090] Updated weights for policy 1, policy_version 1457994 (0.0005) [2023-12-26 11:18:46,015][123090] Updated weights for policy 1, policy_version 1458004 (0.0005) [2023-12-26 11:18:46,088][123090] Updated weights for policy 1, policy_version 1458014 (0.0005) [2023-12-26 11:18:46,389][123091] Updated weights for policy 0, policy_version 1467477 (0.0008) [2023-12-26 11:18:46,459][123091] Updated weights for policy 0, policy_version 1467487 (0.0007) [2023-12-26 11:18:46,530][123091] Updated weights for policy 0, policy_version 1467497 (0.0011) [2023-12-26 11:18:46,783][123090] Updated weights for policy 1, policy_version 1458024 (0.0009) [2023-12-26 11:18:46,834][123090] Updated weights for policy 1, policy_version 1458034 (0.0010) [2023-12-26 11:18:46,885][123090] Updated weights for policy 1, policy_version 1458044 (0.0010) [2023-12-26 11:18:47,197][123091] Updated weights for policy 0, policy_version 1467507 (0.0009) [2023-12-26 11:18:47,263][123091] Updated weights for policy 0, policy_version 1467517 (0.0005) [2023-12-26 11:18:47,320][123091] Updated weights for policy 0, policy_version 1467527 (0.0006) [2023-12-26 11:18:47,634][123090] Updated weights for policy 1, policy_version 1458054 (0.0007) [2023-12-26 11:18:47,696][123090] Updated weights for policy 1, policy_version 1458064 (0.0007) [2023-12-26 11:18:47,759][123090] Updated weights for policy 1, policy_version 1458074 (0.0006) [2023-12-26 11:18:47,932][123091] Updated weights for policy 0, policy_version 1467537 (0.0005) [2023-12-26 11:18:47,979][123091] Updated weights for policy 0, policy_version 1467547 (0.0005) [2023-12-26 11:18:48,042][123091] Updated weights for policy 0, policy_version 1467557 (0.0007) [2023-12-26 11:18:48,100][123091] Updated weights for policy 0, policy_version 1467567 (0.0006) [2023-12-26 11:18:48,429][123090] Updated weights for policy 1, policy_version 1458084 (0.0005) [2023-12-26 11:18:48,490][123090] Updated weights for policy 1, policy_version 1458094 (0.0005) [2023-12-26 11:18:48,550][123090] Updated weights for policy 1, policy_version 1458104 (0.0007) [2023-12-26 11:18:48,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 748978176. Throughput: 0: 8979.0, 1: 8852.2. Samples: 748989908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:48,785][121949] Avg episode reward: [(0, '6286.910'), (1, '5791.804')] [2023-12-26 11:18:48,893][123091] Updated weights for policy 0, policy_version 1467577 (0.0009) [2023-12-26 11:18:48,954][123091] Updated weights for policy 0, policy_version 1467587 (0.0010) [2023-12-26 11:18:49,014][123091] Updated weights for policy 0, policy_version 1467597 (0.0009) [2023-12-26 11:18:49,273][123090] Updated weights for policy 1, policy_version 1458114 (0.0008) [2023-12-26 11:18:49,334][123090] Updated weights for policy 1, policy_version 1458124 (0.0011) [2023-12-26 11:18:49,402][123090] Updated weights for policy 1, policy_version 1458134 (0.0009) [2023-12-26 11:18:49,459][123090] Updated weights for policy 1, policy_version 1458144 (0.0009) [2023-12-26 11:18:49,794][123091] Updated weights for policy 0, policy_version 1467607 (0.0009) [2023-12-26 11:18:49,853][123091] Updated weights for policy 0, policy_version 1467617 (0.0010) [2023-12-26 11:18:49,916][123091] Updated weights for policy 0, policy_version 1467627 (0.0009) [2023-12-26 11:18:50,287][123090] Updated weights for policy 1, policy_version 1458154 (0.0011) [2023-12-26 11:18:50,356][123090] Updated weights for policy 1, policy_version 1458164 (0.0010) [2023-12-26 11:18:50,422][123090] Updated weights for policy 1, policy_version 1458174 (0.0006) [2023-12-26 11:18:50,625][123091] Updated weights for policy 0, policy_version 1467637 (0.0009) [2023-12-26 11:18:50,688][123091] Updated weights for policy 0, policy_version 1467647 (0.0008) [2023-12-26 11:18:50,754][123091] Updated weights for policy 0, policy_version 1467657 (0.0008) [2023-12-26 11:18:51,102][123090] Updated weights for policy 1, policy_version 1458184 (0.0008) [2023-12-26 11:18:51,178][123090] Updated weights for policy 1, policy_version 1458194 (0.0008) [2023-12-26 11:18:51,248][123090] Updated weights for policy 1, policy_version 1458204 (0.0008) [2023-12-26 11:18:51,529][123091] Updated weights for policy 0, policy_version 1467667 (0.0009) [2023-12-26 11:18:51,579][123091] Updated weights for policy 0, policy_version 1467677 (0.0008) [2023-12-26 11:18:51,644][123091] Updated weights for policy 0, policy_version 1467687 (0.0007) [2023-12-26 11:18:52,072][123090] Updated weights for policy 1, policy_version 1458214 (0.0008) [2023-12-26 11:18:52,126][123090] Updated weights for policy 1, policy_version 1458224 (0.0009) [2023-12-26 11:18:52,187][123090] Updated weights for policy 1, policy_version 1458234 (0.0009) [2023-12-26 11:18:52,486][123091] Updated weights for policy 0, policy_version 1467697 (0.0008) [2023-12-26 11:18:52,549][123091] Updated weights for policy 0, policy_version 1467707 (0.0010) [2023-12-26 11:18:52,616][123091] Updated weights for policy 0, policy_version 1467717 (0.0009) [2023-12-26 11:18:52,677][123091] Updated weights for policy 0, policy_version 1467727 (0.0009) [2023-12-26 11:18:52,996][123090] Updated weights for policy 1, policy_version 1458244 (0.0008) [2023-12-26 11:18:53,055][123090] Updated weights for policy 1, policy_version 1458254 (0.0010) [2023-12-26 11:18:53,114][123090] Updated weights for policy 1, policy_version 1458264 (0.0010) [2023-12-26 11:18:53,530][123091] Updated weights for policy 0, policy_version 1467737 (0.0009) [2023-12-26 11:18:53,588][123091] Updated weights for policy 0, policy_version 1467747 (0.0005) [2023-12-26 11:18:53,636][123091] Updated weights for policy 0, policy_version 1467757 (0.0005) [2023-12-26 11:18:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 749068288. Throughput: 0: 8985.0, 1: 8856.6. Samples: 749044412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:53,785][121949] Avg episode reward: [(0, '6305.000'), (1, '5612.957')] [2023-12-26 11:18:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001467760_375750656.pth... [2023-12-26 11:18:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001458272_373317632.pth... [2023-12-26 11:18:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001457216_373047296.pth [2023-12-26 11:18:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001466704_375480320.pth [2023-12-26 11:18:53,927][123090] Updated weights for policy 1, policy_version 1458274 (0.0010) [2023-12-26 11:18:53,982][123090] Updated weights for policy 1, policy_version 1458285 (0.0010) [2023-12-26 11:18:54,038][123090] Updated weights for policy 1, policy_version 1458295 (0.0009) [2023-12-26 11:18:54,251][123091] Updated weights for policy 0, policy_version 1467767 (0.0008) [2023-12-26 11:18:54,308][123091] Updated weights for policy 0, policy_version 1467777 (0.0010) [2023-12-26 11:18:54,358][123091] Updated weights for policy 0, policy_version 1467787 (0.0009) [2023-12-26 11:18:54,850][123090] Updated weights for policy 1, policy_version 1458305 (0.0010) [2023-12-26 11:18:54,902][123090] Updated weights for policy 1, policy_version 1458315 (0.0009) [2023-12-26 11:18:54,974][123090] Updated weights for policy 1, policy_version 1458325 (0.0007) [2023-12-26 11:18:55,033][123090] Updated weights for policy 1, policy_version 1458335 (0.0007) [2023-12-26 11:18:55,192][123091] Updated weights for policy 0, policy_version 1467797 (0.0009) [2023-12-26 11:18:55,257][123091] Updated weights for policy 0, policy_version 1467807 (0.0009) [2023-12-26 11:18:55,322][123091] Updated weights for policy 0, policy_version 1467817 (0.0009) [2023-12-26 11:18:55,778][123090] Updated weights for policy 1, policy_version 1458345 (0.0005) [2023-12-26 11:18:55,841][123090] Updated weights for policy 1, policy_version 1458355 (0.0005) [2023-12-26 11:18:55,891][123090] Updated weights for policy 1, policy_version 1458365 (0.0005) [2023-12-26 11:18:56,164][123091] Updated weights for policy 0, policy_version 1467827 (0.0009) [2023-12-26 11:18:56,212][123091] Updated weights for policy 0, policy_version 1467837 (0.0008) [2023-12-26 11:18:56,263][123091] Updated weights for policy 0, policy_version 1467847 (0.0009) [2023-12-26 11:18:56,664][123090] Updated weights for policy 1, policy_version 1458375 (0.0009) [2023-12-26 11:18:56,722][123090] Updated weights for policy 1, policy_version 1458385 (0.0009) [2023-12-26 11:18:56,785][123090] Updated weights for policy 1, policy_version 1458395 (0.0010) [2023-12-26 11:18:57,147][123091] Updated weights for policy 0, policy_version 1467857 (0.0010) [2023-12-26 11:18:57,209][123091] Updated weights for policy 0, policy_version 1467867 (0.0009) [2023-12-26 11:18:57,276][123091] Updated weights for policy 0, policy_version 1467877 (0.0009) [2023-12-26 11:18:57,336][123091] Updated weights for policy 0, policy_version 1467887 (0.0009) [2023-12-26 11:18:57,569][123090] Updated weights for policy 1, policy_version 1458405 (0.0007) [2023-12-26 11:18:57,621][123090] Updated weights for policy 1, policy_version 1458415 (0.0006) [2023-12-26 11:18:57,681][123090] Updated weights for policy 1, policy_version 1458425 (0.0009) [2023-12-26 11:18:58,197][123091] Updated weights for policy 0, policy_version 1467897 (0.0010) [2023-12-26 11:18:58,259][123091] Updated weights for policy 0, policy_version 1467907 (0.0008) [2023-12-26 11:18:58,320][123091] Updated weights for policy 0, policy_version 1467917 (0.0010) [2023-12-26 11:18:58,467][123090] Updated weights for policy 1, policy_version 1458435 (0.0009) [2023-12-26 11:18:58,531][123090] Updated weights for policy 1, policy_version 1458445 (0.0011) [2023-12-26 11:18:58,606][123090] Updated weights for policy 1, policy_version 1458455 (0.0011) [2023-12-26 11:18:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 749158400. Throughput: 0: 8962.1, 1: 8907.5. Samples: 749150700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:18:58,785][121949] Avg episode reward: [(0, '6368.217'), (1, '5622.720')] [2023-12-26 11:18:59,269][123091] Updated weights for policy 0, policy_version 1467927 (0.0009) [2023-12-26 11:18:59,333][123091] Updated weights for policy 0, policy_version 1467937 (0.0009) [2023-12-26 11:18:59,405][123091] Updated weights for policy 0, policy_version 1467947 (0.0009) [2023-12-26 11:18:59,593][123090] Updated weights for policy 1, policy_version 1458465 (0.0010) [2023-12-26 11:18:59,650][123090] Updated weights for policy 1, policy_version 1458475 (0.0005) [2023-12-26 11:18:59,712][123090] Updated weights for policy 1, policy_version 1458485 (0.0005) [2023-12-26 11:18:59,766][123090] Updated weights for policy 1, policy_version 1458495 (0.0005) [2023-12-26 11:19:00,195][123091] Updated weights for policy 0, policy_version 1467957 (0.0009) [2023-12-26 11:19:00,256][123091] Updated weights for policy 0, policy_version 1467967 (0.0006) [2023-12-26 11:19:00,329][123091] Updated weights for policy 0, policy_version 1467977 (0.0005) [2023-12-26 11:19:00,468][123090] Updated weights for policy 1, policy_version 1458505 (0.0009) [2023-12-26 11:19:00,525][123090] Updated weights for policy 1, policy_version 1458515 (0.0009) [2023-12-26 11:19:00,582][123090] Updated weights for policy 1, policy_version 1458525 (0.0009) [2023-12-26 11:19:01,042][123091] Updated weights for policy 0, policy_version 1467987 (0.0006) [2023-12-26 11:19:01,103][123091] Updated weights for policy 0, policy_version 1467997 (0.0009) [2023-12-26 11:19:01,173][123091] Updated weights for policy 0, policy_version 1468007 (0.0009) [2023-12-26 11:19:01,412][123090] Updated weights for policy 1, policy_version 1458535 (0.0007) [2023-12-26 11:19:01,477][123090] Updated weights for policy 1, policy_version 1458545 (0.0006) [2023-12-26 11:19:01,548][123090] Updated weights for policy 1, policy_version 1458555 (0.0006) [2023-12-26 11:19:02,050][123091] Updated weights for policy 0, policy_version 1468017 (0.0009) [2023-12-26 11:19:02,099][123091] Updated weights for policy 0, policy_version 1468027 (0.0009) [2023-12-26 11:19:02,148][123091] Updated weights for policy 0, policy_version 1468037 (0.0009) [2023-12-26 11:19:02,200][123091] Updated weights for policy 0, policy_version 1468047 (0.0009) [2023-12-26 11:19:02,333][123090] Updated weights for policy 1, policy_version 1458565 (0.0008) [2023-12-26 11:19:02,393][123090] Updated weights for policy 1, policy_version 1458575 (0.0008) [2023-12-26 11:19:02,453][123090] Updated weights for policy 1, policy_version 1458585 (0.0008) [2023-12-26 11:19:02,995][123091] Updated weights for policy 0, policy_version 1468057 (0.0010) [2023-12-26 11:19:03,049][123091] Updated weights for policy 0, policy_version 1468067 (0.0008) [2023-12-26 11:19:03,098][123091] Updated weights for policy 0, policy_version 1468077 (0.0009) [2023-12-26 11:19:03,278][123090] Updated weights for policy 1, policy_version 1458595 (0.0010) [2023-12-26 11:19:03,332][123090] Updated weights for policy 1, policy_version 1458605 (0.0009) [2023-12-26 11:19:03,391][123090] Updated weights for policy 1, policy_version 1458615 (0.0009) [2023-12-26 11:19:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 749240320. Throughput: 0: 8896.3, 1: 8936.3. Samples: 749253344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:03,785][121949] Avg episode reward: [(0, '6296.326'), (1, '5702.872')] [2023-12-26 11:19:03,812][123091] Updated weights for policy 0, policy_version 1468087 (0.0006) [2023-12-26 11:19:03,883][123091] Updated weights for policy 0, policy_version 1468097 (0.0007) [2023-12-26 11:19:03,951][123091] Updated weights for policy 0, policy_version 1468107 (0.0007) [2023-12-26 11:19:04,384][123090] Updated weights for policy 1, policy_version 1458625 (0.0010) [2023-12-26 11:19:04,456][123090] Updated weights for policy 1, policy_version 1458635 (0.0009) [2023-12-26 11:19:04,518][123090] Updated weights for policy 1, policy_version 1458645 (0.0009) [2023-12-26 11:19:04,592][123090] Updated weights for policy 1, policy_version 1458655 (0.0009) [2023-12-26 11:19:04,731][123091] Updated weights for policy 0, policy_version 1468117 (0.0009) [2023-12-26 11:19:04,797][123091] Updated weights for policy 0, policy_version 1468128 (0.0010) [2023-12-26 11:19:04,860][123091] Updated weights for policy 0, policy_version 1468138 (0.0010) [2023-12-26 11:19:05,307][123090] Updated weights for policy 1, policy_version 1458665 (0.0007) [2023-12-26 11:19:05,367][123090] Updated weights for policy 1, policy_version 1458675 (0.0009) [2023-12-26 11:19:05,423][123090] Updated weights for policy 1, policy_version 1458685 (0.0009) [2023-12-26 11:19:05,745][123091] Updated weights for policy 0, policy_version 1468148 (0.0010) [2023-12-26 11:19:05,801][123091] Updated weights for policy 0, policy_version 1468158 (0.0009) [2023-12-26 11:19:05,853][123091] Updated weights for policy 0, policy_version 1468168 (0.0009) [2023-12-26 11:19:06,169][123090] Updated weights for policy 1, policy_version 1458695 (0.0009) [2023-12-26 11:19:06,230][123090] Updated weights for policy 1, policy_version 1458705 (0.0009) [2023-12-26 11:19:06,299][123090] Updated weights for policy 1, policy_version 1458715 (0.0009) [2023-12-26 11:19:06,720][123091] Updated weights for policy 0, policy_version 1468178 (0.0009) [2023-12-26 11:19:06,780][123091] Updated weights for policy 0, policy_version 1468188 (0.0009) [2023-12-26 11:19:06,848][123091] Updated weights for policy 0, policy_version 1468198 (0.0010) [2023-12-26 11:19:06,907][123091] Updated weights for policy 0, policy_version 1468208 (0.0008) [2023-12-26 11:19:07,137][123090] Updated weights for policy 1, policy_version 1458725 (0.0009) [2023-12-26 11:19:07,193][123090] Updated weights for policy 1, policy_version 1458735 (0.0008) [2023-12-26 11:19:07,256][123090] Updated weights for policy 1, policy_version 1458745 (0.0010) [2023-12-26 11:19:07,728][123091] Updated weights for policy 0, policy_version 1468218 (0.0010) [2023-12-26 11:19:07,778][123091] Updated weights for policy 0, policy_version 1468228 (0.0009) [2023-12-26 11:19:07,832][123091] Updated weights for policy 0, policy_version 1468239 (0.0010) [2023-12-26 11:19:08,103][123090] Updated weights for policy 1, policy_version 1458755 (0.0009) [2023-12-26 11:19:08,155][123090] Updated weights for policy 1, policy_version 1458765 (0.0009) [2023-12-26 11:19:08,206][123090] Updated weights for policy 1, policy_version 1458775 (0.0008) [2023-12-26 11:19:08,687][123091] Updated weights for policy 0, policy_version 1468249 (0.0010) [2023-12-26 11:19:08,745][123091] Updated weights for policy 0, policy_version 1468259 (0.0009) [2023-12-26 11:19:08,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 749322240. Throughput: 0: 8896.8, 1: 8947.0. Samples: 749304672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:08,785][121949] Avg episode reward: [(0, '6147.219'), (1, '5749.873')] [2023-12-26 11:19:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001458784_373448704.pth... [2023-12-26 11:19:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001457760_373186560.pth [2023-12-26 11:19:08,810][123091] Updated weights for policy 0, policy_version 1468269 (0.0009) [2023-12-26 11:19:08,824][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001468272_375881728.pth... [2023-12-26 11:19:08,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001467216_375611392.pth [2023-12-26 11:19:09,064][123090] Updated weights for policy 1, policy_version 1458785 (0.0009) [2023-12-26 11:19:09,130][123090] Updated weights for policy 1, policy_version 1458795 (0.0009) [2023-12-26 11:19:09,186][123090] Updated weights for policy 1, policy_version 1458805 (0.0009) [2023-12-26 11:19:09,244][123090] Updated weights for policy 1, policy_version 1458815 (0.0009) [2023-12-26 11:19:09,678][123091] Updated weights for policy 0, policy_version 1468279 (0.0010) [2023-12-26 11:19:09,737][123091] Updated weights for policy 0, policy_version 1468289 (0.0009) [2023-12-26 11:19:09,813][123091] Updated weights for policy 0, policy_version 1468299 (0.0010) [2023-12-26 11:19:10,071][123090] Updated weights for policy 1, policy_version 1458825 (0.0009) [2023-12-26 11:19:10,128][123090] Updated weights for policy 1, policy_version 1458835 (0.0010) [2023-12-26 11:19:10,182][123090] Updated weights for policy 1, policy_version 1458845 (0.0009) [2023-12-26 11:19:10,609][123091] Updated weights for policy 0, policy_version 1468309 (0.0010) [2023-12-26 11:19:10,670][123091] Updated weights for policy 0, policy_version 1468319 (0.0006) [2023-12-26 11:19:10,734][123091] Updated weights for policy 0, policy_version 1468329 (0.0005) [2023-12-26 11:19:11,070][123090] Updated weights for policy 1, policy_version 1458855 (0.0008) [2023-12-26 11:19:11,127][123090] Updated weights for policy 1, policy_version 1458865 (0.0008) [2023-12-26 11:19:11,195][123090] Updated weights for policy 1, policy_version 1458875 (0.0009) [2023-12-26 11:19:11,536][123091] Updated weights for policy 0, policy_version 1468339 (0.0007) [2023-12-26 11:19:11,590][123091] Updated weights for policy 0, policy_version 1468349 (0.0005) [2023-12-26 11:19:11,659][123091] Updated weights for policy 0, policy_version 1468359 (0.0009) [2023-12-26 11:19:12,044][123090] Updated weights for policy 1, policy_version 1458885 (0.0009) [2023-12-26 11:19:12,112][123090] Updated weights for policy 1, policy_version 1458895 (0.0009) [2023-12-26 11:19:12,166][123090] Updated weights for policy 1, policy_version 1458905 (0.0010) [2023-12-26 11:19:12,379][123091] Updated weights for policy 0, policy_version 1468369 (0.0009) [2023-12-26 11:19:12,446][123091] Updated weights for policy 0, policy_version 1468379 (0.0010) [2023-12-26 11:19:12,512][123091] Updated weights for policy 0, policy_version 1468389 (0.0009) [2023-12-26 11:19:12,572][123091] Updated weights for policy 0, policy_version 1468399 (0.0010) [2023-12-26 11:19:13,001][123090] Updated weights for policy 1, policy_version 1458916 (0.0010) [2023-12-26 11:19:13,070][123090] Updated weights for policy 1, policy_version 1458926 (0.0009) [2023-12-26 11:19:13,137][123090] Updated weights for policy 1, policy_version 1458936 (0.0010) [2023-12-26 11:19:13,423][123091] Updated weights for policy 0, policy_version 1468410 (0.0007) [2023-12-26 11:19:13,478][123091] Updated weights for policy 0, policy_version 1468420 (0.0009) [2023-12-26 11:19:13,526][123091] Updated weights for policy 0, policy_version 1468430 (0.0010) [2023-12-26 11:19:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 749412352. Throughput: 0: 8868.9, 1: 8890.7. Samples: 749406460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:13,785][121949] Avg episode reward: [(0, '6268.875'), (1, '5832.566')] [2023-12-26 11:19:13,906][123090] Updated weights for policy 1, policy_version 1458946 (0.0010) [2023-12-26 11:19:13,975][123090] Updated weights for policy 1, policy_version 1458956 (0.0009) [2023-12-26 11:19:14,028][123090] Updated weights for policy 1, policy_version 1458966 (0.0009) [2023-12-26 11:19:14,087][123090] Updated weights for policy 1, policy_version 1458976 (0.0010) [2023-12-26 11:19:14,281][123091] Updated weights for policy 0, policy_version 1468440 (0.0010) [2023-12-26 11:19:14,342][123091] Updated weights for policy 0, policy_version 1468450 (0.0010) [2023-12-26 11:19:14,408][123091] Updated weights for policy 0, policy_version 1468460 (0.0010) [2023-12-26 11:19:14,964][123090] Updated weights for policy 1, policy_version 1458986 (0.0009) [2023-12-26 11:19:15,029][123090] Updated weights for policy 1, policy_version 1458996 (0.0009) [2023-12-26 11:19:15,093][123090] Updated weights for policy 1, policy_version 1459006 (0.0009) [2023-12-26 11:19:15,190][123091] Updated weights for policy 0, policy_version 1468470 (0.0011) [2023-12-26 11:19:15,260][123091] Updated weights for policy 0, policy_version 1468480 (0.0010) [2023-12-26 11:19:15,326][123091] Updated weights for policy 0, policy_version 1468490 (0.0011) [2023-12-26 11:19:16,000][123090] Updated weights for policy 1, policy_version 1459016 (0.0010) [2023-12-26 11:19:16,042][123091] Updated weights for policy 0, policy_version 1468500 (0.0009) [2023-12-26 11:19:16,055][123090] Updated weights for policy 1, policy_version 1459026 (0.0009) [2023-12-26 11:19:16,104][123091] Updated weights for policy 0, policy_version 1468510 (0.0006) [2023-12-26 11:19:16,107][123090] Updated weights for policy 1, policy_version 1459036 (0.0009) [2023-12-26 11:19:16,151][123091] Updated weights for policy 0, policy_version 1468520 (0.0010) [2023-12-26 11:19:16,853][123091] Updated weights for policy 0, policy_version 1468530 (0.0006) [2023-12-26 11:19:16,913][123091] Updated weights for policy 0, policy_version 1468540 (0.0009) [2023-12-26 11:19:16,971][123091] Updated weights for policy 0, policy_version 1468550 (0.0010) [2023-12-26 11:19:17,025][123090] Updated weights for policy 1, policy_version 1459046 (0.0008) [2023-12-26 11:19:17,027][123091] Updated weights for policy 0, policy_version 1468560 (0.0008) [2023-12-26 11:19:17,081][123090] Updated weights for policy 1, policy_version 1459056 (0.0009) [2023-12-26 11:19:17,141][123090] Updated weights for policy 1, policy_version 1459066 (0.0010) [2023-12-26 11:19:17,920][123091] Updated weights for policy 0, policy_version 1468570 (0.0010) [2023-12-26 11:19:17,932][123090] Updated weights for policy 1, policy_version 1459076 (0.0008) [2023-12-26 11:19:17,979][123091] Updated weights for policy 0, policy_version 1468580 (0.0009) [2023-12-26 11:19:18,012][123090] Updated weights for policy 1, policy_version 1459086 (0.0006) [2023-12-26 11:19:18,048][123091] Updated weights for policy 0, policy_version 1468590 (0.0010) [2023-12-26 11:19:18,077][123090] Updated weights for policy 1, policy_version 1459096 (0.0005) [2023-12-26 11:19:18,769][123090] Updated weights for policy 1, policy_version 1459106 (0.0005) [2023-12-26 11:19:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 749494272. Throughput: 0: 8848.0, 1: 8813.4. Samples: 749511836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:18,785][121949] Avg episode reward: [(0, '6271.956'), (1, '5780.419')] [2023-12-26 11:19:18,839][123090] Updated weights for policy 1, policy_version 1459116 (0.0005) [2023-12-26 11:19:18,894][123090] Updated weights for policy 1, policy_version 1459126 (0.0005) [2023-12-26 11:19:18,917][123091] Updated weights for policy 0, policy_version 1468600 (0.0009) [2023-12-26 11:19:18,963][123090] Updated weights for policy 1, policy_version 1459136 (0.0005) [2023-12-26 11:19:18,975][123091] Updated weights for policy 0, policy_version 1468610 (0.0009) [2023-12-26 11:19:19,027][123091] Updated weights for policy 0, policy_version 1468620 (0.0009) [2023-12-26 11:19:19,741][123090] Updated weights for policy 1, policy_version 1459146 (0.0010) [2023-12-26 11:19:19,811][123090] Updated weights for policy 1, policy_version 1459156 (0.0009) [2023-12-26 11:19:19,887][123090] Updated weights for policy 1, policy_version 1459166 (0.0006) [2023-12-26 11:19:19,890][123091] Updated weights for policy 0, policy_version 1468630 (0.0008) [2023-12-26 11:19:19,957][123091] Updated weights for policy 0, policy_version 1468640 (0.0007) [2023-12-26 11:19:20,013][123091] Updated weights for policy 0, policy_version 1468650 (0.0006) [2023-12-26 11:19:20,645][123090] Updated weights for policy 1, policy_version 1459176 (0.0008) [2023-12-26 11:19:20,702][123090] Updated weights for policy 1, policy_version 1459186 (0.0010) [2023-12-26 11:19:20,763][123090] Updated weights for policy 1, policy_version 1459196 (0.0010) [2023-12-26 11:19:20,848][123091] Updated weights for policy 0, policy_version 1468660 (0.0009) [2023-12-26 11:19:20,916][123091] Updated weights for policy 0, policy_version 1468670 (0.0010) [2023-12-26 11:19:20,973][123091] Updated weights for policy 0, policy_version 1468680 (0.0009) [2023-12-26 11:19:21,587][123090] Updated weights for policy 1, policy_version 1459206 (0.0008) [2023-12-26 11:19:21,657][123090] Updated weights for policy 1, policy_version 1459216 (0.0008) [2023-12-26 11:19:21,713][123090] Updated weights for policy 1, policy_version 1459226 (0.0009) [2023-12-26 11:19:21,778][123091] Updated weights for policy 0, policy_version 1468691 (0.0010) [2023-12-26 11:19:21,840][123091] Updated weights for policy 0, policy_version 1468701 (0.0010) [2023-12-26 11:19:21,896][123091] Updated weights for policy 0, policy_version 1468711 (0.0009) [2023-12-26 11:19:22,535][123090] Updated weights for policy 1, policy_version 1459236 (0.0010) [2023-12-26 11:19:22,601][123090] Updated weights for policy 1, policy_version 1459246 (0.0008) [2023-12-26 11:19:22,667][123090] Updated weights for policy 1, policy_version 1459256 (0.0009) [2023-12-26 11:19:22,747][123091] Updated weights for policy 0, policy_version 1468721 (0.0010) [2023-12-26 11:19:22,808][123091] Updated weights for policy 0, policy_version 1468731 (0.0006) [2023-12-26 11:19:22,872][123091] Updated weights for policy 0, policy_version 1468741 (0.0009) [2023-12-26 11:19:22,939][123091] Updated weights for policy 0, policy_version 1468751 (0.0009) [2023-12-26 11:19:23,487][123090] Updated weights for policy 1, policy_version 1459266 (0.0009) [2023-12-26 11:19:23,547][123090] Updated weights for policy 1, policy_version 1459276 (0.0009) [2023-12-26 11:19:23,608][123090] Updated weights for policy 1, policy_version 1459286 (0.0009) [2023-12-26 11:19:23,660][123090] Updated weights for policy 1, policy_version 1459296 (0.0009) [2023-12-26 11:19:23,744][123091] Updated weights for policy 0, policy_version 1468761 (0.0009) [2023-12-26 11:19:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 749584384. Throughput: 0: 8790.0, 1: 8817.9. Samples: 749563160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:23,785][121949] Avg episode reward: [(0, '6233.232'), (1, '5738.858')] [2023-12-26 11:19:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001459296_373579776.pth... [2023-12-26 11:19:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001458272_373317632.pth [2023-12-26 11:19:23,796][123091] Updated weights for policy 0, policy_version 1468772 (0.0010) [2023-12-26 11:19:23,854][123091] Updated weights for policy 0, policy_version 1468782 (0.0010) [2023-12-26 11:19:23,864][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001468784_376012800.pth... [2023-12-26 11:19:23,868][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001467760_375750656.pth [2023-12-26 11:19:24,516][123090] Updated weights for policy 1, policy_version 1459306 (0.0009) [2023-12-26 11:19:24,564][123090] Updated weights for policy 1, policy_version 1459316 (0.0009) [2023-12-26 11:19:24,618][123090] Updated weights for policy 1, policy_version 1459326 (0.0008) [2023-12-26 11:19:24,651][123091] Updated weights for policy 0, policy_version 1468792 (0.0008) [2023-12-26 11:19:24,707][123091] Updated weights for policy 0, policy_version 1468802 (0.0005) [2023-12-26 11:19:24,756][123091] Updated weights for policy 0, policy_version 1468812 (0.0006) [2023-12-26 11:19:25,507][123091] Updated weights for policy 0, policy_version 1468822 (0.0009) [2023-12-26 11:19:25,546][123090] Updated weights for policy 1, policy_version 1459336 (0.0007) [2023-12-26 11:19:25,561][123091] Updated weights for policy 0, policy_version 1468832 (0.0010) [2023-12-26 11:19:25,602][123090] Updated weights for policy 1, policy_version 1459346 (0.0005) [2023-12-26 11:19:25,616][123091] Updated weights for policy 0, policy_version 1468842 (0.0010) [2023-12-26 11:19:25,662][123090] Updated weights for policy 1, policy_version 1459356 (0.0006) [2023-12-26 11:19:26,448][123091] Updated weights for policy 0, policy_version 1468852 (0.0010) [2023-12-26 11:19:26,507][123091] Updated weights for policy 0, policy_version 1468862 (0.0010) [2023-12-26 11:19:26,509][123090] Updated weights for policy 1, policy_version 1459366 (0.0007) [2023-12-26 11:19:26,562][123091] Updated weights for policy 0, policy_version 1468872 (0.0010) [2023-12-26 11:19:26,565][123090] Updated weights for policy 1, policy_version 1459376 (0.0006) [2023-12-26 11:19:26,610][123090] Updated weights for policy 1, policy_version 1459386 (0.0008) [2023-12-26 11:19:27,375][123090] Updated weights for policy 1, policy_version 1459396 (0.0009) [2023-12-26 11:19:27,389][123091] Updated weights for policy 0, policy_version 1468882 (0.0010) [2023-12-26 11:19:27,429][123090] Updated weights for policy 1, policy_version 1459406 (0.0005) [2023-12-26 11:19:27,443][123091] Updated weights for policy 0, policy_version 1468892 (0.0010) [2023-12-26 11:19:27,479][123090] Updated weights for policy 1, policy_version 1459416 (0.0006) [2023-12-26 11:19:27,501][123091] Updated weights for policy 0, policy_version 1468902 (0.0010) [2023-12-26 11:19:27,551][123091] Updated weights for policy 0, policy_version 1468912 (0.0010) [2023-12-26 11:19:28,327][123090] Updated weights for policy 1, policy_version 1459426 (0.0010) [2023-12-26 11:19:28,387][123091] Updated weights for policy 0, policy_version 1468922 (0.0008) [2023-12-26 11:19:28,394][123090] Updated weights for policy 1, policy_version 1459436 (0.0008) [2023-12-26 11:19:28,444][123091] Updated weights for policy 0, policy_version 1468932 (0.0008) [2023-12-26 11:19:28,455][123090] Updated weights for policy 1, policy_version 1459446 (0.0009) [2023-12-26 11:19:28,500][123091] Updated weights for policy 0, policy_version 1468942 (0.0006) [2023-12-26 11:19:28,515][123090] Updated weights for policy 1, policy_version 1459456 (0.0007) [2023-12-26 11:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 749674496. Throughput: 0: 8817.4, 1: 8746.7. Samples: 749666976. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:28,785][121949] Avg episode reward: [(0, '6178.533'), (1, '5889.853')] [2023-12-26 11:19:29,164][123090] Updated weights for policy 1, policy_version 1459466 (0.0006) [2023-12-26 11:19:29,228][123090] Updated weights for policy 1, policy_version 1459476 (0.0009) [2023-12-26 11:19:29,292][123090] Updated weights for policy 1, policy_version 1459486 (0.0009) [2023-12-26 11:19:29,350][123091] Updated weights for policy 0, policy_version 1468952 (0.0009) [2023-12-26 11:19:29,407][123091] Updated weights for policy 0, policy_version 1468962 (0.0011) [2023-12-26 11:19:29,462][123091] Updated weights for policy 0, policy_version 1468972 (0.0011) [2023-12-26 11:19:30,082][123090] Updated weights for policy 1, policy_version 1459496 (0.0009) [2023-12-26 11:19:30,143][123090] Updated weights for policy 1, policy_version 1459506 (0.0009) [2023-12-26 11:19:30,200][123090] Updated weights for policy 1, policy_version 1459516 (0.0008) [2023-12-26 11:19:30,217][123091] Updated weights for policy 0, policy_version 1468982 (0.0008) [2023-12-26 11:19:30,283][123091] Updated weights for policy 0, policy_version 1468992 (0.0009) [2023-12-26 11:19:30,345][123091] Updated weights for policy 0, policy_version 1469002 (0.0009) [2023-12-26 11:19:31,061][123090] Updated weights for policy 1, policy_version 1459526 (0.0009) [2023-12-26 11:19:31,109][123091] Updated weights for policy 0, policy_version 1469012 (0.0006) [2023-12-26 11:19:31,114][123090] Updated weights for policy 1, policy_version 1459536 (0.0006) [2023-12-26 11:19:31,184][123091] Updated weights for policy 0, policy_version 1469022 (0.0008) [2023-12-26 11:19:31,188][123090] Updated weights for policy 1, policy_version 1459546 (0.0009) [2023-12-26 11:19:31,243][123091] Updated weights for policy 0, policy_version 1469032 (0.0010) [2023-12-26 11:19:31,971][123091] Updated weights for policy 0, policy_version 1469042 (0.0010) [2023-12-26 11:19:32,032][123091] Updated weights for policy 0, policy_version 1469052 (0.0005) [2023-12-26 11:19:32,063][123090] Updated weights for policy 1, policy_version 1459556 (0.0008) [2023-12-26 11:19:32,096][123091] Updated weights for policy 0, policy_version 1469062 (0.0006) [2023-12-26 11:19:32,119][123090] Updated weights for policy 1, policy_version 1459566 (0.0009) [2023-12-26 11:19:32,148][123091] Updated weights for policy 0, policy_version 1469072 (0.0005) [2023-12-26 11:19:32,174][123090] Updated weights for policy 1, policy_version 1459576 (0.0010) [2023-12-26 11:19:32,815][123091] Updated weights for policy 0, policy_version 1469082 (0.0005) [2023-12-26 11:19:32,881][123091] Updated weights for policy 0, policy_version 1469092 (0.0006) [2023-12-26 11:19:32,943][123090] Updated weights for policy 1, policy_version 1459587 (0.0009) [2023-12-26 11:19:32,948][123091] Updated weights for policy 0, policy_version 1469102 (0.0009) [2023-12-26 11:19:32,993][123090] Updated weights for policy 1, policy_version 1459597 (0.0005) [2023-12-26 11:19:33,044][123090] Updated weights for policy 1, policy_version 1459607 (0.0005) [2023-12-26 11:19:33,680][123091] Updated weights for policy 0, policy_version 1469112 (0.0009) [2023-12-26 11:19:33,740][123091] Updated weights for policy 0, policy_version 1469122 (0.0009) [2023-12-26 11:19:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 749756416. Throughput: 0: 8763.7, 1: 8665.2. Samples: 749774204. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:33,785][121949] Avg episode reward: [(0, '6137.373'), (1, '5880.252')] [2023-12-26 11:19:33,788][123091] Updated weights for policy 0, policy_version 1469132 (0.0009) [2023-12-26 11:19:33,855][123090] Updated weights for policy 1, policy_version 1459617 (0.0006) [2023-12-26 11:19:33,921][123090] Updated weights for policy 1, policy_version 1459627 (0.0009) [2023-12-26 11:19:33,981][123090] Updated weights for policy 1, policy_version 1459637 (0.0008) [2023-12-26 11:19:34,045][123090] Updated weights for policy 1, policy_version 1459647 (0.0006) [2023-12-26 11:19:34,668][123091] Updated weights for policy 0, policy_version 1469142 (0.0009) [2023-12-26 11:19:34,722][123091] Updated weights for policy 0, policy_version 1469152 (0.0009) [2023-12-26 11:19:34,742][123090] Updated weights for policy 1, policy_version 1459657 (0.0006) [2023-12-26 11:19:34,784][123091] Updated weights for policy 0, policy_version 1469162 (0.0007) [2023-12-26 11:19:34,800][123090] Updated weights for policy 1, policy_version 1459667 (0.0010) [2023-12-26 11:19:34,859][123090] Updated weights for policy 1, policy_version 1459677 (0.0008) [2023-12-26 11:19:35,620][123091] Updated weights for policy 0, policy_version 1469172 (0.0008) [2023-12-26 11:19:35,668][123090] Updated weights for policy 1, policy_version 1459687 (0.0007) [2023-12-26 11:19:35,678][123091] Updated weights for policy 0, policy_version 1469182 (0.0009) [2023-12-26 11:19:35,724][123090] Updated weights for policy 1, policy_version 1459697 (0.0008) [2023-12-26 11:19:35,732][123091] Updated weights for policy 0, policy_version 1469192 (0.0008) [2023-12-26 11:19:35,786][123090] Updated weights for policy 1, policy_version 1459707 (0.0009) [2023-12-26 11:19:36,604][123091] Updated weights for policy 0, policy_version 1469202 (0.0007) [2023-12-26 11:19:36,640][123090] Updated weights for policy 1, policy_version 1459717 (0.0009) [2023-12-26 11:19:36,671][123091] Updated weights for policy 0, policy_version 1469212 (0.0008) [2023-12-26 11:19:36,701][123090] Updated weights for policy 1, policy_version 1459727 (0.0006) [2023-12-26 11:19:36,742][123091] Updated weights for policy 0, policy_version 1469222 (0.0007) [2023-12-26 11:19:36,767][123090] Updated weights for policy 1, policy_version 1459737 (0.0008) [2023-12-26 11:19:36,801][123091] Updated weights for policy 0, policy_version 1469232 (0.0006) [2023-12-26 11:19:37,529][123090] Updated weights for policy 1, policy_version 1459747 (0.0008) [2023-12-26 11:19:37,562][123091] Updated weights for policy 0, policy_version 1469242 (0.0009) [2023-12-26 11:19:37,592][123090] Updated weights for policy 1, policy_version 1459757 (0.0007) [2023-12-26 11:19:37,624][123091] Updated weights for policy 0, policy_version 1469252 (0.0009) [2023-12-26 11:19:37,650][123090] Updated weights for policy 1, policy_version 1459767 (0.0008) [2023-12-26 11:19:37,682][123091] Updated weights for policy 0, policy_version 1469262 (0.0008) [2023-12-26 11:19:38,453][123090] Updated weights for policy 1, policy_version 1459777 (0.0010) [2023-12-26 11:19:38,521][123090] Updated weights for policy 1, policy_version 1459787 (0.0010) [2023-12-26 11:19:38,534][123091] Updated weights for policy 0, policy_version 1469272 (0.0008) [2023-12-26 11:19:38,580][123090] Updated weights for policy 1, policy_version 1459797 (0.0008) [2023-12-26 11:19:38,597][123091] Updated weights for policy 0, policy_version 1469282 (0.0010) [2023-12-26 11:19:38,631][123090] Updated weights for policy 1, policy_version 1459807 (0.0005) [2023-12-26 11:19:38,652][123091] Updated weights for policy 0, policy_version 1469292 (0.0009) [2023-12-26 11:19:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 749854720. Throughput: 0: 8717.5, 1: 8649.2. Samples: 749825916. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:38,785][121949] Avg episode reward: [(0, '6018.927'), (1, '5560.112')] [2023-12-26 11:19:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001459808_373710848.pth... [2023-12-26 11:19:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001469296_376143872.pth... [2023-12-26 11:19:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001458784_373448704.pth [2023-12-26 11:19:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001468272_375881728.pth [2023-12-26 11:19:39,430][123090] Updated weights for policy 1, policy_version 1459817 (0.0009) [2023-12-26 11:19:39,492][123090] Updated weights for policy 1, policy_version 1459827 (0.0009) [2023-12-26 11:19:39,518][123091] Updated weights for policy 0, policy_version 1469302 (0.0009) [2023-12-26 11:19:39,545][123090] Updated weights for policy 1, policy_version 1459837 (0.0007) [2023-12-26 11:19:39,577][123091] Updated weights for policy 0, policy_version 1469312 (0.0008) [2023-12-26 11:19:39,644][123091] Updated weights for policy 0, policy_version 1469322 (0.0008) [2023-12-26 11:19:40,342][123090] Updated weights for policy 1, policy_version 1459847 (0.0010) [2023-12-26 11:19:40,406][123090] Updated weights for policy 1, policy_version 1459857 (0.0010) [2023-12-26 11:19:40,466][123091] Updated weights for policy 0, policy_version 1469332 (0.0009) [2023-12-26 11:19:40,467][123090] Updated weights for policy 1, policy_version 1459867 (0.0007) [2023-12-26 11:19:40,518][123091] Updated weights for policy 0, policy_version 1469342 (0.0008) [2023-12-26 11:19:40,577][123091] Updated weights for policy 0, policy_version 1469352 (0.0008) [2023-12-26 11:19:41,237][123090] Updated weights for policy 1, policy_version 1459877 (0.0009) [2023-12-26 11:19:41,299][123090] Updated weights for policy 1, policy_version 1459887 (0.0011) [2023-12-26 11:19:41,371][123090] Updated weights for policy 1, policy_version 1459897 (0.0010) [2023-12-26 11:19:41,413][123091] Updated weights for policy 0, policy_version 1469362 (0.0009) [2023-12-26 11:19:41,474][123091] Updated weights for policy 0, policy_version 1469372 (0.0008) [2023-12-26 11:19:41,530][123091] Updated weights for policy 0, policy_version 1469382 (0.0010) [2023-12-26 11:19:41,594][123091] Updated weights for policy 0, policy_version 1469392 (0.0011) [2023-12-26 11:19:42,250][123090] Updated weights for policy 1, policy_version 1459907 (0.0009) [2023-12-26 11:19:42,308][123090] Updated weights for policy 1, policy_version 1459917 (0.0009) [2023-12-26 11:19:42,374][123090] Updated weights for policy 1, policy_version 1459927 (0.0008) [2023-12-26 11:19:42,403][123091] Updated weights for policy 0, policy_version 1469402 (0.0009) [2023-12-26 11:19:42,463][123091] Updated weights for policy 0, policy_version 1469412 (0.0011) [2023-12-26 11:19:42,526][123091] Updated weights for policy 0, policy_version 1469422 (0.0011) [2023-12-26 11:19:43,223][123090] Updated weights for policy 1, policy_version 1459937 (0.0009) [2023-12-26 11:19:43,282][123090] Updated weights for policy 1, policy_version 1459947 (0.0009) [2023-12-26 11:19:43,344][123090] Updated weights for policy 1, policy_version 1459957 (0.0007) [2023-12-26 11:19:43,353][123091] Updated weights for policy 0, policy_version 1469432 (0.0011) [2023-12-26 11:19:43,406][123090] Updated weights for policy 1, policy_version 1459967 (0.0007) [2023-12-26 11:19:43,412][123091] Updated weights for policy 0, policy_version 1469442 (0.0010) [2023-12-26 11:19:43,474][123091] Updated weights for policy 0, policy_version 1469452 (0.0006) [2023-12-26 11:19:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 749936640. Throughput: 0: 8695.3, 1: 8591.3. Samples: 749928596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:43,785][121949] Avg episode reward: [(0, '6073.701'), (1, '5651.547')] [2023-12-26 11:19:44,131][123090] Updated weights for policy 1, policy_version 1459977 (0.0006) [2023-12-26 11:19:44,151][123091] Updated weights for policy 0, policy_version 1469462 (0.0008) [2023-12-26 11:19:44,189][123090] Updated weights for policy 1, policy_version 1459987 (0.0010) [2023-12-26 11:19:44,215][123091] Updated weights for policy 0, policy_version 1469472 (0.0006) [2023-12-26 11:19:44,243][123090] Updated weights for policy 1, policy_version 1459997 (0.0010) [2023-12-26 11:19:44,264][123091] Updated weights for policy 0, policy_version 1469482 (0.0007) [2023-12-26 11:19:45,069][123090] Updated weights for policy 1, policy_version 1460007 (0.0009) [2023-12-26 11:19:45,104][123091] Updated weights for policy 0, policy_version 1469492 (0.0009) [2023-12-26 11:19:45,129][123090] Updated weights for policy 1, policy_version 1460017 (0.0008) [2023-12-26 11:19:45,165][123091] Updated weights for policy 0, policy_version 1469502 (0.0008) [2023-12-26 11:19:45,197][123090] Updated weights for policy 1, policy_version 1460027 (0.0009) [2023-12-26 11:19:45,223][123091] Updated weights for policy 0, policy_version 1469512 (0.0006) [2023-12-26 11:19:46,017][123091] Updated weights for policy 0, policy_version 1469522 (0.0009) [2023-12-26 11:19:46,027][123090] Updated weights for policy 1, policy_version 1460037 (0.0010) [2023-12-26 11:19:46,065][123091] Updated weights for policy 0, policy_version 1469532 (0.0008) [2023-12-26 11:19:46,075][123090] Updated weights for policy 1, policy_version 1460047 (0.0009) [2023-12-26 11:19:46,124][123091] Updated weights for policy 0, policy_version 1469542 (0.0009) [2023-12-26 11:19:46,125][123090] Updated weights for policy 1, policy_version 1460057 (0.0007) [2023-12-26 11:19:46,187][123091] Updated weights for policy 0, policy_version 1469552 (0.0009) [2023-12-26 11:19:46,948][123090] Updated weights for policy 1, policy_version 1460067 (0.0007) [2023-12-26 11:19:46,955][123091] Updated weights for policy 0, policy_version 1469562 (0.0007) [2023-12-26 11:19:47,001][123090] Updated weights for policy 1, policy_version 1460077 (0.0007) [2023-12-26 11:19:47,009][123091] Updated weights for policy 0, policy_version 1469572 (0.0008) [2023-12-26 11:19:47,062][123091] Updated weights for policy 0, policy_version 1469582 (0.0006) [2023-12-26 11:19:47,063][123090] Updated weights for policy 1, policy_version 1460087 (0.0011) [2023-12-26 11:19:47,768][123090] Updated weights for policy 1, policy_version 1460097 (0.0010) [2023-12-26 11:19:47,783][123091] Updated weights for policy 0, policy_version 1469592 (0.0006) [2023-12-26 11:19:47,829][123090] Updated weights for policy 1, policy_version 1460107 (0.0005) [2023-12-26 11:19:47,835][123091] Updated weights for policy 0, policy_version 1469602 (0.0005) [2023-12-26 11:19:47,883][123091] Updated weights for policy 0, policy_version 1469612 (0.0005) [2023-12-26 11:19:47,884][123090] Updated weights for policy 1, policy_version 1460117 (0.0006) [2023-12-26 11:19:47,938][123090] Updated weights for policy 1, policy_version 1460127 (0.0005) [2023-12-26 11:19:48,615][123090] Updated weights for policy 1, policy_version 1460137 (0.0009) [2023-12-26 11:19:48,686][123090] Updated weights for policy 1, policy_version 1460147 (0.0007) [2023-12-26 11:19:48,694][123091] Updated weights for policy 0, policy_version 1469622 (0.0006) [2023-12-26 11:19:48,760][123090] Updated weights for policy 1, policy_version 1460157 (0.0006) [2023-12-26 11:19:48,771][123091] Updated weights for policy 0, policy_version 1469632 (0.0006) [2023-12-26 11:19:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 750026752. Throughput: 0: 8760.2, 1: 8693.3. Samples: 750038748. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:48,785][121949] Avg episode reward: [(0, '6326.428'), (1, '5699.904')] [2023-12-26 11:19:48,852][123091] Updated weights for policy 0, policy_version 1469642 (0.0006) [2023-12-26 11:19:49,428][123090] Updated weights for policy 1, policy_version 1460167 (0.0008) [2023-12-26 11:19:49,479][123090] Updated weights for policy 1, policy_version 1460177 (0.0009) [2023-12-26 11:19:49,536][123090] Updated weights for policy 1, policy_version 1460187 (0.0009) [2023-12-26 11:19:49,605][123091] Updated weights for policy 0, policy_version 1469652 (0.0009) [2023-12-26 11:19:49,668][123091] Updated weights for policy 0, policy_version 1469662 (0.0010) [2023-12-26 11:19:49,716][123091] Updated weights for policy 0, policy_version 1469672 (0.0008) [2023-12-26 11:19:50,447][123090] Updated weights for policy 1, policy_version 1460197 (0.0008) [2023-12-26 11:19:50,512][123090] Updated weights for policy 1, policy_version 1460207 (0.0008) [2023-12-26 11:19:50,537][123091] Updated weights for policy 0, policy_version 1469682 (0.0008) [2023-12-26 11:19:50,587][123090] Updated weights for policy 1, policy_version 1460217 (0.0008) [2023-12-26 11:19:50,603][123091] Updated weights for policy 0, policy_version 1469692 (0.0009) [2023-12-26 11:19:50,663][123091] Updated weights for policy 0, policy_version 1469702 (0.0009) [2023-12-26 11:19:50,723][123091] Updated weights for policy 0, policy_version 1469712 (0.0009) [2023-12-26 11:19:51,327][123090] Updated weights for policy 1, policy_version 1460227 (0.0008) [2023-12-26 11:19:51,394][123090] Updated weights for policy 1, policy_version 1460237 (0.0010) [2023-12-26 11:19:51,464][123090] Updated weights for policy 1, policy_version 1460247 (0.0010) [2023-12-26 11:19:51,589][123091] Updated weights for policy 0, policy_version 1469722 (0.0005) [2023-12-26 11:19:51,655][123091] Updated weights for policy 0, policy_version 1469732 (0.0007) [2023-12-26 11:19:51,728][123091] Updated weights for policy 0, policy_version 1469742 (0.0009) [2023-12-26 11:19:52,353][123090] Updated weights for policy 1, policy_version 1460257 (0.0006) [2023-12-26 11:19:52,375][123091] Updated weights for policy 0, policy_version 1469752 (0.0008) [2023-12-26 11:19:52,422][123090] Updated weights for policy 1, policy_version 1460267 (0.0009) [2023-12-26 11:19:52,433][123091] Updated weights for policy 0, policy_version 1469762 (0.0008) [2023-12-26 11:19:52,488][123090] Updated weights for policy 1, policy_version 1460277 (0.0006) [2023-12-26 11:19:52,493][123091] Updated weights for policy 0, policy_version 1469772 (0.0008) [2023-12-26 11:19:52,557][123090] Updated weights for policy 1, policy_version 1460287 (0.0007) [2023-12-26 11:19:53,314][123091] Updated weights for policy 0, policy_version 1469782 (0.0010) [2023-12-26 11:19:53,348][123090] Updated weights for policy 1, policy_version 1460297 (0.0010) [2023-12-26 11:19:53,377][123091] Updated weights for policy 0, policy_version 1469792 (0.0011) [2023-12-26 11:19:53,396][123090] Updated weights for policy 1, policy_version 1460307 (0.0010) [2023-12-26 11:19:53,440][123091] Updated weights for policy 0, policy_version 1469802 (0.0011) [2023-12-26 11:19:53,444][123090] Updated weights for policy 1, policy_version 1460317 (0.0010) [2023-12-26 11:19:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 750116864. Throughput: 0: 8764.6, 1: 8702.7. Samples: 750090700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:53,785][121949] Avg episode reward: [(0, '6372.210'), (1, '5544.546')] [2023-12-26 11:19:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001469808_376274944.pth... [2023-12-26 11:19:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001460320_373841920.pth... [2023-12-26 11:19:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001468784_376012800.pth [2023-12-26 11:19:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001459296_373579776.pth [2023-12-26 11:19:54,191][123090] Updated weights for policy 1, policy_version 1460327 (0.0010) [2023-12-26 11:19:54,250][123090] Updated weights for policy 1, policy_version 1460337 (0.0010) [2023-12-26 11:19:54,255][123091] Updated weights for policy 0, policy_version 1469812 (0.0011) [2023-12-26 11:19:54,299][123090] Updated weights for policy 1, policy_version 1460347 (0.0010) [2023-12-26 11:19:54,319][123091] Updated weights for policy 0, policy_version 1469822 (0.0011) [2023-12-26 11:19:54,384][123091] Updated weights for policy 0, policy_version 1469832 (0.0010) [2023-12-26 11:19:55,140][123090] Updated weights for policy 1, policy_version 1460357 (0.0008) [2023-12-26 11:19:55,183][123091] Updated weights for policy 0, policy_version 1469842 (0.0011) [2023-12-26 11:19:55,205][123090] Updated weights for policy 1, policy_version 1460367 (0.0005) [2023-12-26 11:19:55,242][123091] Updated weights for policy 0, policy_version 1469852 (0.0009) [2023-12-26 11:19:55,266][123090] Updated weights for policy 1, policy_version 1460377 (0.0005) [2023-12-26 11:19:55,297][123091] Updated weights for policy 0, policy_version 1469862 (0.0006) [2023-12-26 11:19:55,363][123091] Updated weights for policy 0, policy_version 1469872 (0.0005) [2023-12-26 11:19:55,935][123090] Updated weights for policy 1, policy_version 1460387 (0.0005) [2023-12-26 11:19:55,993][123090] Updated weights for policy 1, policy_version 1460397 (0.0007) [2023-12-26 11:19:56,027][123091] Updated weights for policy 0, policy_version 1469882 (0.0006) [2023-12-26 11:19:56,060][123090] Updated weights for policy 1, policy_version 1460407 (0.0006) [2023-12-26 11:19:56,086][123091] Updated weights for policy 0, policy_version 1469892 (0.0007) [2023-12-26 11:19:56,133][123091] Updated weights for policy 0, policy_version 1469902 (0.0006) [2023-12-26 11:19:56,727][123090] Updated weights for policy 1, policy_version 1460417 (0.0006) [2023-12-26 11:19:56,783][123090] Updated weights for policy 1, policy_version 1460427 (0.0008) [2023-12-26 11:19:56,785][123091] Updated weights for policy 0, policy_version 1469912 (0.0009) [2023-12-26 11:19:56,826][123090] Updated weights for policy 1, policy_version 1460437 (0.0007) [2023-12-26 11:19:56,839][123091] Updated weights for policy 0, policy_version 1469922 (0.0010) [2023-12-26 11:19:56,873][123090] Updated weights for policy 1, policy_version 1460447 (0.0005) [2023-12-26 11:19:56,886][123091] Updated weights for policy 0, policy_version 1469932 (0.0010) [2023-12-26 11:19:57,495][123090] Updated weights for policy 1, policy_version 1460457 (0.0008) [2023-12-26 11:19:57,560][123090] Updated weights for policy 1, policy_version 1460467 (0.0009) [2023-12-26 11:19:57,625][123090] Updated weights for policy 1, policy_version 1460477 (0.0010) [2023-12-26 11:19:57,641][123091] Updated weights for policy 0, policy_version 1469942 (0.0008) [2023-12-26 11:19:57,692][123091] Updated weights for policy 0, policy_version 1469952 (0.0010) [2023-12-26 11:19:57,744][123091] Updated weights for policy 0, policy_version 1469962 (0.0010) [2023-12-26 11:19:58,471][123090] Updated weights for policy 1, policy_version 1460487 (0.0008) [2023-12-26 11:19:58,533][123091] Updated weights for policy 0, policy_version 1469972 (0.0009) [2023-12-26 11:19:58,540][123090] Updated weights for policy 1, policy_version 1460497 (0.0008) [2023-12-26 11:19:58,606][123091] Updated weights for policy 0, policy_version 1469982 (0.0008) [2023-12-26 11:19:58,616][123090] Updated weights for policy 1, policy_version 1460507 (0.0007) [2023-12-26 11:19:58,681][123091] Updated weights for policy 0, policy_version 1469992 (0.0008) [2023-12-26 11:19:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 750215168. Throughput: 0: 8862.2, 1: 8822.4. Samples: 750202260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:19:58,784][121949] Avg episode reward: [(0, '6255.075'), (1, '5712.298')] [2023-12-26 11:19:59,467][123090] Updated weights for policy 1, policy_version 1460517 (0.0010) [2023-12-26 11:19:59,520][123090] Updated weights for policy 1, policy_version 1460527 (0.0010) [2023-12-26 11:19:59,573][123090] Updated weights for policy 1, policy_version 1460537 (0.0010) [2023-12-26 11:19:59,622][123091] Updated weights for policy 0, policy_version 1470002 (0.0007) [2023-12-26 11:19:59,695][123091] Updated weights for policy 0, policy_version 1470012 (0.0008) [2023-12-26 11:19:59,752][123091] Updated weights for policy 0, policy_version 1470022 (0.0005) [2023-12-26 11:19:59,815][123091] Updated weights for policy 0, policy_version 1470032 (0.0006) [2023-12-26 11:20:00,416][123090] Updated weights for policy 1, policy_version 1460547 (0.0008) [2023-12-26 11:20:00,483][123090] Updated weights for policy 1, policy_version 1460557 (0.0005) [2023-12-26 11:20:00,548][123090] Updated weights for policy 1, policy_version 1460567 (0.0010) [2023-12-26 11:20:00,646][123091] Updated weights for policy 0, policy_version 1470042 (0.0007) [2023-12-26 11:20:00,698][123091] Updated weights for policy 0, policy_version 1470052 (0.0005) [2023-12-26 11:20:00,745][123091] Updated weights for policy 0, policy_version 1470062 (0.0007) [2023-12-26 11:20:01,349][123090] Updated weights for policy 1, policy_version 1460577 (0.0011) [2023-12-26 11:20:01,408][123090] Updated weights for policy 1, policy_version 1460587 (0.0010) [2023-12-26 11:20:01,464][123090] Updated weights for policy 1, policy_version 1460597 (0.0010) [2023-12-26 11:20:01,513][123090] Updated weights for policy 1, policy_version 1460607 (0.0010) [2023-12-26 11:20:01,534][123091] Updated weights for policy 0, policy_version 1470072 (0.0007) [2023-12-26 11:20:01,584][123091] Updated weights for policy 0, policy_version 1470082 (0.0009) [2023-12-26 11:20:01,654][123091] Updated weights for policy 0, policy_version 1470092 (0.0009) [2023-12-26 11:20:02,335][123090] Updated weights for policy 1, policy_version 1460617 (0.0010) [2023-12-26 11:20:02,399][123090] Updated weights for policy 1, policy_version 1460627 (0.0010) [2023-12-26 11:20:02,446][123090] Updated weights for policy 1, policy_version 1460637 (0.0008) [2023-12-26 11:20:02,504][123091] Updated weights for policy 0, policy_version 1470102 (0.0009) [2023-12-26 11:20:02,573][123091] Updated weights for policy 0, policy_version 1470112 (0.0005) [2023-12-26 11:20:02,636][123091] Updated weights for policy 0, policy_version 1470122 (0.0006) [2023-12-26 11:20:03,275][123090] Updated weights for policy 1, policy_version 1460647 (0.0006) [2023-12-26 11:20:03,342][123090] Updated weights for policy 1, policy_version 1460657 (0.0005) [2023-12-26 11:20:03,405][123090] Updated weights for policy 1, policy_version 1460667 (0.0009) [2023-12-26 11:20:03,440][123091] Updated weights for policy 0, policy_version 1470132 (0.0008) [2023-12-26 11:20:03,497][123091] Updated weights for policy 0, policy_version 1470142 (0.0008) [2023-12-26 11:20:03,560][123091] Updated weights for policy 0, policy_version 1470152 (0.0009) [2023-12-26 11:20:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 750297088. Throughput: 0: 8817.2, 1: 8806.8. Samples: 750304920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:03,785][121949] Avg episode reward: [(0, '6247.125'), (1, '5706.895')] [2023-12-26 11:20:04,212][123090] Updated weights for policy 1, policy_version 1460677 (0.0010) [2023-12-26 11:20:04,280][123090] Updated weights for policy 1, policy_version 1460687 (0.0010) [2023-12-26 11:20:04,344][123090] Updated weights for policy 1, policy_version 1460697 (0.0009) [2023-12-26 11:20:04,353][123091] Updated weights for policy 0, policy_version 1470162 (0.0010) [2023-12-26 11:20:04,412][123091] Updated weights for policy 0, policy_version 1470172 (0.0009) [2023-12-26 11:20:04,466][123091] Updated weights for policy 0, policy_version 1470182 (0.0010) [2023-12-26 11:20:04,518][123091] Updated weights for policy 0, policy_version 1470192 (0.0009) [2023-12-26 11:20:05,224][123090] Updated weights for policy 1, policy_version 1460707 (0.0008) [2023-12-26 11:20:05,278][123090] Updated weights for policy 1, policy_version 1460717 (0.0007) [2023-12-26 11:20:05,279][123091] Updated weights for policy 0, policy_version 1470202 (0.0010) [2023-12-26 11:20:05,327][123090] Updated weights for policy 1, policy_version 1460727 (0.0007) [2023-12-26 11:20:05,340][123091] Updated weights for policy 0, policy_version 1470212 (0.0008) [2023-12-26 11:20:05,385][123091] Updated weights for policy 0, policy_version 1470222 (0.0005) [2023-12-26 11:20:06,186][123090] Updated weights for policy 1, policy_version 1460737 (0.0010) [2023-12-26 11:20:06,191][123091] Updated weights for policy 0, policy_version 1470232 (0.0008) [2023-12-26 11:20:06,247][123091] Updated weights for policy 0, policy_version 1470242 (0.0008) [2023-12-26 11:20:06,254][123090] Updated weights for policy 1, policy_version 1460748 (0.0008) [2023-12-26 11:20:06,300][123091] Updated weights for policy 0, policy_version 1470252 (0.0008) [2023-12-26 11:20:06,303][123090] Updated weights for policy 1, policy_version 1460758 (0.0007) [2023-12-26 11:20:06,356][123090] Updated weights for policy 1, policy_version 1460768 (0.0008) [2023-12-26 11:20:07,128][123091] Updated weights for policy 0, policy_version 1470262 (0.0007) [2023-12-26 11:20:07,199][123091] Updated weights for policy 0, policy_version 1470272 (0.0005) [2023-12-26 11:20:07,226][123090] Updated weights for policy 1, policy_version 1460778 (0.0006) [2023-12-26 11:20:07,261][123091] Updated weights for policy 0, policy_version 1470282 (0.0009) [2023-12-26 11:20:07,290][123090] Updated weights for policy 1, policy_version 1460788 (0.0006) [2023-12-26 11:20:07,342][123090] Updated weights for policy 1, policy_version 1460798 (0.0005) [2023-12-26 11:20:07,962][123091] Updated weights for policy 0, policy_version 1470292 (0.0009) [2023-12-26 11:20:08,014][123091] Updated weights for policy 0, policy_version 1470302 (0.0009) [2023-12-26 11:20:08,068][123091] Updated weights for policy 0, policy_version 1470312 (0.0007) [2023-12-26 11:20:08,121][123090] Updated weights for policy 1, policy_version 1460808 (0.0006) [2023-12-26 11:20:08,188][123090] Updated weights for policy 1, policy_version 1460818 (0.0007) [2023-12-26 11:20:08,255][123090] Updated weights for policy 1, policy_version 1460828 (0.0006) [2023-12-26 11:20:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 750379008. Throughput: 0: 8858.2, 1: 8777.0. Samples: 750356740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:08,785][121949] Avg episode reward: [(0, '6311.333'), (1, '5688.302')] [2023-12-26 11:20:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001470320_376406016.pth... [2023-12-26 11:20:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001460832_373972992.pth... [2023-12-26 11:20:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001469296_376143872.pth [2023-12-26 11:20:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001459808_373710848.pth [2023-12-26 11:20:08,822][123091] Updated weights for policy 0, policy_version 1470322 (0.0010) [2023-12-26 11:20:08,890][123091] Updated weights for policy 0, policy_version 1470332 (0.0009) [2023-12-26 11:20:08,955][123091] Updated weights for policy 0, policy_version 1470342 (0.0008) [2023-12-26 11:20:09,017][123090] Updated weights for policy 1, policy_version 1460838 (0.0009) [2023-12-26 11:20:09,020][123091] Updated weights for policy 0, policy_version 1470352 (0.0007) [2023-12-26 11:20:09,085][123090] Updated weights for policy 1, policy_version 1460848 (0.0011) [2023-12-26 11:20:09,156][123090] Updated weights for policy 1, policy_version 1460858 (0.0011) [2023-12-26 11:20:09,815][123091] Updated weights for policy 0, policy_version 1470362 (0.0009) [2023-12-26 11:20:09,906][123091] Updated weights for policy 0, policy_version 1470372 (0.0010) [2023-12-26 11:20:09,976][123091] Updated weights for policy 0, policy_version 1470382 (0.0006) [2023-12-26 11:20:10,010][123090] Updated weights for policy 1, policy_version 1460868 (0.0010) [2023-12-26 11:20:10,070][123090] Updated weights for policy 1, policy_version 1460878 (0.0009) [2023-12-26 11:20:10,135][123090] Updated weights for policy 1, policy_version 1460888 (0.0009) [2023-12-26 11:20:10,668][123091] Updated weights for policy 0, policy_version 1470392 (0.0009) [2023-12-26 11:20:10,735][123091] Updated weights for policy 0, policy_version 1470402 (0.0006) [2023-12-26 11:20:10,782][123091] Updated weights for policy 0, policy_version 1470412 (0.0005) [2023-12-26 11:20:11,050][123090] Updated weights for policy 1, policy_version 1460898 (0.0010) [2023-12-26 11:20:11,117][123090] Updated weights for policy 1, policy_version 1460908 (0.0009) [2023-12-26 11:20:11,197][123090] Updated weights for policy 1, policy_version 1460918 (0.0009) [2023-12-26 11:20:11,271][123090] Updated weights for policy 1, policy_version 1460928 (0.0010) [2023-12-26 11:20:11,546][123091] Updated weights for policy 0, policy_version 1470422 (0.0005) [2023-12-26 11:20:11,611][123091] Updated weights for policy 0, policy_version 1470432 (0.0006) [2023-12-26 11:20:11,687][123091] Updated weights for policy 0, policy_version 1470442 (0.0010) [2023-12-26 11:20:12,117][123090] Updated weights for policy 1, policy_version 1460938 (0.0008) [2023-12-26 11:20:12,167][123090] Updated weights for policy 1, policy_version 1460948 (0.0009) [2023-12-26 11:20:12,227][123090] Updated weights for policy 1, policy_version 1460958 (0.0010) [2023-12-26 11:20:12,423][123091] Updated weights for policy 0, policy_version 1470452 (0.0009) [2023-12-26 11:20:12,490][123091] Updated weights for policy 0, policy_version 1470462 (0.0009) [2023-12-26 11:20:12,541][123091] Updated weights for policy 0, policy_version 1470472 (0.0009) [2023-12-26 11:20:13,055][123090] Updated weights for policy 1, policy_version 1460968 (0.0010) [2023-12-26 11:20:13,110][123090] Updated weights for policy 1, policy_version 1460979 (0.0010) [2023-12-26 11:20:13,168][123090] Updated weights for policy 1, policy_version 1460989 (0.0009) [2023-12-26 11:20:13,330][123091] Updated weights for policy 0, policy_version 1470482 (0.0008) [2023-12-26 11:20:13,383][123091] Updated weights for policy 0, policy_version 1470492 (0.0005) [2023-12-26 11:20:13,429][123091] Updated weights for policy 0, policy_version 1470502 (0.0008) [2023-12-26 11:20:13,492][123091] Updated weights for policy 0, policy_version 1470512 (0.0011) [2023-12-26 11:20:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 750469120. Throughput: 0: 8904.4, 1: 8765.4. Samples: 750462120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:13,785][121949] Avg episode reward: [(0, '6335.346'), (1, '5451.731')] [2023-12-26 11:20:14,077][123090] Updated weights for policy 1, policy_version 1460999 (0.0009) [2023-12-26 11:20:14,147][123090] Updated weights for policy 1, policy_version 1461009 (0.0010) [2023-12-26 11:20:14,207][123090] Updated weights for policy 1, policy_version 1461019 (0.0006) [2023-12-26 11:20:14,259][123091] Updated weights for policy 0, policy_version 1470522 (0.0008) [2023-12-26 11:20:14,317][123091] Updated weights for policy 0, policy_version 1470532 (0.0010) [2023-12-26 11:20:14,376][123091] Updated weights for policy 0, policy_version 1470542 (0.0010) [2023-12-26 11:20:14,866][123090] Updated weights for policy 1, policy_version 1461029 (0.0007) [2023-12-26 11:20:14,918][123090] Updated weights for policy 1, policy_version 1461039 (0.0008) [2023-12-26 11:20:14,978][123090] Updated weights for policy 1, policy_version 1461049 (0.0008) [2023-12-26 11:20:15,242][123091] Updated weights for policy 0, policy_version 1470552 (0.0007) [2023-12-26 11:20:15,313][123091] Updated weights for policy 0, policy_version 1470562 (0.0006) [2023-12-26 11:20:15,384][123091] Updated weights for policy 0, policy_version 1470572 (0.0006) [2023-12-26 11:20:15,788][123090] Updated weights for policy 1, policy_version 1461059 (0.0007) [2023-12-26 11:20:15,850][123090] Updated weights for policy 1, policy_version 1461069 (0.0006) [2023-12-26 11:20:15,911][123090] Updated weights for policy 1, policy_version 1461079 (0.0010) [2023-12-26 11:20:16,085][123091] Updated weights for policy 0, policy_version 1470582 (0.0007) [2023-12-26 11:20:16,143][123091] Updated weights for policy 0, policy_version 1470592 (0.0009) [2023-12-26 11:20:16,198][123091] Updated weights for policy 0, policy_version 1470602 (0.0009) [2023-12-26 11:20:16,737][123090] Updated weights for policy 1, policy_version 1461089 (0.0011) [2023-12-26 11:20:16,796][123090] Updated weights for policy 1, policy_version 1461099 (0.0010) [2023-12-26 11:20:16,859][123090] Updated weights for policy 1, policy_version 1461109 (0.0010) [2023-12-26 11:20:16,921][123090] Updated weights for policy 1, policy_version 1461119 (0.0010) [2023-12-26 11:20:16,930][123091] Updated weights for policy 0, policy_version 1470612 (0.0010) [2023-12-26 11:20:16,989][123091] Updated weights for policy 0, policy_version 1470622 (0.0009) [2023-12-26 11:20:17,060][123091] Updated weights for policy 0, policy_version 1470632 (0.0009) [2023-12-26 11:20:17,723][123090] Updated weights for policy 1, policy_version 1461129 (0.0009) [2023-12-26 11:20:17,786][123090] Updated weights for policy 1, policy_version 1461139 (0.0006) [2023-12-26 11:20:17,825][123091] Updated weights for policy 0, policy_version 1470642 (0.0009) [2023-12-26 11:20:17,836][123090] Updated weights for policy 1, policy_version 1461149 (0.0005) [2023-12-26 11:20:17,879][123091] Updated weights for policy 0, policy_version 1470652 (0.0009) [2023-12-26 11:20:17,953][123091] Updated weights for policy 0, policy_version 1470662 (0.0006) [2023-12-26 11:20:18,028][123091] Updated weights for policy 0, policy_version 1470672 (0.0006) [2023-12-26 11:20:18,595][123090] Updated weights for policy 1, policy_version 1461159 (0.0009) [2023-12-26 11:20:18,653][123090] Updated weights for policy 1, policy_version 1461169 (0.0011) [2023-12-26 11:20:18,717][123090] Updated weights for policy 1, policy_version 1461179 (0.0011) [2023-12-26 11:20:18,759][123091] Updated weights for policy 0, policy_version 1470682 (0.0010) [2023-12-26 11:20:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 750559232. Throughput: 0: 8903.1, 1: 8786.2. Samples: 750570224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:18,785][121949] Avg episode reward: [(0, '6284.355'), (1, '5507.981')] [2023-12-26 11:20:18,820][123091] Updated weights for policy 0, policy_version 1470692 (0.0009) [2023-12-26 11:20:18,879][123091] Updated weights for policy 0, policy_version 1470702 (0.0010) [2023-12-26 11:20:19,494][123090] Updated weights for policy 1, policy_version 1461189 (0.0009) [2023-12-26 11:20:19,556][123090] Updated weights for policy 1, policy_version 1461199 (0.0008) [2023-12-26 11:20:19,617][123090] Updated weights for policy 1, policy_version 1461209 (0.0008) [2023-12-26 11:20:19,780][123091] Updated weights for policy 0, policy_version 1470712 (0.0010) [2023-12-26 11:20:19,851][123091] Updated weights for policy 0, policy_version 1470722 (0.0011) [2023-12-26 11:20:19,926][123091] Updated weights for policy 0, policy_version 1470732 (0.0009) [2023-12-26 11:20:20,447][123090] Updated weights for policy 1, policy_version 1461219 (0.0009) [2023-12-26 11:20:20,514][123090] Updated weights for policy 1, policy_version 1461229 (0.0011) [2023-12-26 11:20:20,589][123090] Updated weights for policy 1, policy_version 1461239 (0.0010) [2023-12-26 11:20:20,779][123091] Updated weights for policy 0, policy_version 1470742 (0.0009) [2023-12-26 11:20:20,840][123091] Updated weights for policy 0, policy_version 1470752 (0.0009) [2023-12-26 11:20:20,890][123091] Updated weights for policy 0, policy_version 1470762 (0.0009) [2023-12-26 11:20:21,445][123090] Updated weights for policy 1, policy_version 1461249 (0.0009) [2023-12-26 11:20:21,514][123090] Updated weights for policy 1, policy_version 1461259 (0.0009) [2023-12-26 11:20:21,577][123090] Updated weights for policy 1, policy_version 1461269 (0.0008) [2023-12-26 11:20:21,654][123090] Updated weights for policy 1, policy_version 1461279 (0.0008) [2023-12-26 11:20:21,819][123091] Updated weights for policy 0, policy_version 1470772 (0.0010) [2023-12-26 11:20:21,884][123091] Updated weights for policy 0, policy_version 1470782 (0.0010) [2023-12-26 11:20:21,945][123091] Updated weights for policy 0, policy_version 1470792 (0.0010) [2023-12-26 11:20:22,481][123090] Updated weights for policy 1, policy_version 1461289 (0.0009) [2023-12-26 11:20:22,543][123090] Updated weights for policy 1, policy_version 1461299 (0.0010) [2023-12-26 11:20:22,615][123090] Updated weights for policy 1, policy_version 1461309 (0.0009) [2023-12-26 11:20:22,787][123091] Updated weights for policy 0, policy_version 1470802 (0.0010) [2023-12-26 11:20:22,854][123091] Updated weights for policy 0, policy_version 1470812 (0.0007) [2023-12-26 11:20:22,919][123091] Updated weights for policy 0, policy_version 1470822 (0.0009) [2023-12-26 11:20:22,984][123091] Updated weights for policy 0, policy_version 1470832 (0.0009) [2023-12-26 11:20:23,504][123090] Updated weights for policy 1, policy_version 1461319 (0.0011) [2023-12-26 11:20:23,566][123090] Updated weights for policy 1, policy_version 1461329 (0.0010) [2023-12-26 11:20:23,610][123090] Updated weights for policy 1, policy_version 1461339 (0.0010) [2023-12-26 11:20:23,705][123091] Updated weights for policy 0, policy_version 1470842 (0.0007) [2023-12-26 11:20:23,752][123091] Updated weights for policy 0, policy_version 1470852 (0.0005) [2023-12-26 11:20:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 750641152. Throughput: 0: 8882.0, 1: 8757.1. Samples: 750619672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:23,785][121949] Avg episode reward: [(0, '6188.916'), (1, '5605.797')] [2023-12-26 11:20:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001461344_374104064.pth... [2023-12-26 11:20:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001460320_373841920.pth [2023-12-26 11:20:23,831][123091] Updated weights for policy 0, policy_version 1470862 (0.0005) [2023-12-26 11:20:23,844][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001470864_376545280.pth... [2023-12-26 11:20:23,850][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001469808_376274944.pth [2023-12-26 11:20:24,363][123090] Updated weights for policy 1, policy_version 1461349 (0.0008) [2023-12-26 11:20:24,430][123090] Updated weights for policy 1, policy_version 1461359 (0.0009) [2023-12-26 11:20:24,472][123091] Updated weights for policy 0, policy_version 1470872 (0.0007) [2023-12-26 11:20:24,491][123090] Updated weights for policy 1, policy_version 1461369 (0.0009) [2023-12-26 11:20:24,525][123091] Updated weights for policy 0, policy_version 1470882 (0.0009) [2023-12-26 11:20:24,585][123091] Updated weights for policy 0, policy_version 1470892 (0.0008) [2023-12-26 11:20:25,305][123090] Updated weights for policy 1, policy_version 1461379 (0.0008) [2023-12-26 11:20:25,357][123090] Updated weights for policy 1, policy_version 1461389 (0.0008) [2023-12-26 11:20:25,371][123091] Updated weights for policy 0, policy_version 1470902 (0.0006) [2023-12-26 11:20:25,410][123090] Updated weights for policy 1, policy_version 1461399 (0.0010) [2023-12-26 11:20:25,429][123091] Updated weights for policy 0, policy_version 1470912 (0.0010) [2023-12-26 11:20:25,485][123091] Updated weights for policy 0, policy_version 1470922 (0.0010) [2023-12-26 11:20:26,148][123090] Updated weights for policy 1, policy_version 1461409 (0.0010) [2023-12-26 11:20:26,193][123091] Updated weights for policy 0, policy_version 1470932 (0.0008) [2023-12-26 11:20:26,215][123090] Updated weights for policy 1, policy_version 1461419 (0.0005) [2023-12-26 11:20:26,255][123091] Updated weights for policy 0, policy_version 1470942 (0.0005) [2023-12-26 11:20:26,289][123090] Updated weights for policy 1, policy_version 1461429 (0.0005) [2023-12-26 11:20:26,316][123091] Updated weights for policy 0, policy_version 1470952 (0.0006) [2023-12-26 11:20:26,361][123090] Updated weights for policy 1, policy_version 1461439 (0.0006) [2023-12-26 11:20:26,885][123091] Updated weights for policy 0, policy_version 1470962 (0.0005) [2023-12-26 11:20:26,933][123091] Updated weights for policy 0, policy_version 1470972 (0.0005) [2023-12-26 11:20:26,984][123091] Updated weights for policy 0, policy_version 1470982 (0.0005) [2023-12-26 11:20:27,002][123090] Updated weights for policy 1, policy_version 1461449 (0.0005) [2023-12-26 11:20:27,043][123091] Updated weights for policy 0, policy_version 1470992 (0.0005) [2023-12-26 11:20:27,049][123090] Updated weights for policy 1, policy_version 1461459 (0.0005) [2023-12-26 11:20:27,104][123090] Updated weights for policy 1, policy_version 1461469 (0.0005) [2023-12-26 11:20:27,765][123090] Updated weights for policy 1, policy_version 1461479 (0.0007) [2023-12-26 11:20:27,768][123091] Updated weights for policy 0, policy_version 1471002 (0.0005) [2023-12-26 11:20:27,825][123090] Updated weights for policy 1, policy_version 1461489 (0.0007) [2023-12-26 11:20:27,831][123091] Updated weights for policy 0, policy_version 1471012 (0.0010) [2023-12-26 11:20:27,886][123091] Updated weights for policy 0, policy_version 1471022 (0.0008) [2023-12-26 11:20:27,886][123090] Updated weights for policy 1, policy_version 1461499 (0.0009) [2023-12-26 11:20:28,692][123091] Updated weights for policy 0, policy_version 1471032 (0.0009) [2023-12-26 11:20:28,711][123090] Updated weights for policy 1, policy_version 1461509 (0.0009) [2023-12-26 11:20:28,745][123091] Updated weights for policy 0, policy_version 1471042 (0.0009) [2023-12-26 11:20:28,768][123090] Updated weights for policy 1, policy_version 1461519 (0.0009) [2023-12-26 11:20:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 750731264. Throughput: 0: 9038.5, 1: 8844.8. Samples: 750733344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:28,784][121949] Avg episode reward: [(0, '6268.913'), (1, '5444.098')] [2023-12-26 11:20:28,792][123091] Updated weights for policy 0, policy_version 1471052 (0.0009) [2023-12-26 11:20:28,834][123090] Updated weights for policy 1, policy_version 1461529 (0.0007) [2023-12-26 11:20:29,662][123091] Updated weights for policy 0, policy_version 1471062 (0.0009) [2023-12-26 11:20:29,666][123090] Updated weights for policy 1, policy_version 1461539 (0.0009) [2023-12-26 11:20:29,714][123091] Updated weights for policy 0, policy_version 1471072 (0.0009) [2023-12-26 11:20:29,730][123090] Updated weights for policy 1, policy_version 1461549 (0.0008) [2023-12-26 11:20:29,761][123091] Updated weights for policy 0, policy_version 1471082 (0.0008) [2023-12-26 11:20:29,791][123090] Updated weights for policy 1, policy_version 1461559 (0.0008) [2023-12-26 11:20:30,594][123091] Updated weights for policy 0, policy_version 1471092 (0.0009) [2023-12-26 11:20:30,603][123090] Updated weights for policy 1, policy_version 1461569 (0.0009) [2023-12-26 11:20:30,650][123091] Updated weights for policy 0, policy_version 1471102 (0.0007) [2023-12-26 11:20:30,656][123090] Updated weights for policy 1, policy_version 1461579 (0.0009) [2023-12-26 11:20:30,702][123090] Updated weights for policy 1, policy_version 1461589 (0.0009) [2023-12-26 11:20:30,714][123091] Updated weights for policy 0, policy_version 1471112 (0.0008) [2023-12-26 11:20:30,763][123090] Updated weights for policy 1, policy_version 1461599 (0.0009) [2023-12-26 11:20:31,539][123091] Updated weights for policy 0, policy_version 1471122 (0.0008) [2023-12-26 11:20:31,599][123091] Updated weights for policy 0, policy_version 1471132 (0.0010) [2023-12-26 11:20:31,649][123090] Updated weights for policy 1, policy_version 1461609 (0.0008) [2023-12-26 11:20:31,668][123091] Updated weights for policy 0, policy_version 1471142 (0.0009) [2023-12-26 11:20:31,710][123090] Updated weights for policy 1, policy_version 1461619 (0.0008) [2023-12-26 11:20:31,732][123091] Updated weights for policy 0, policy_version 1471152 (0.0007) [2023-12-26 11:20:31,770][123090] Updated weights for policy 1, policy_version 1461629 (0.0010) [2023-12-26 11:20:32,507][123091] Updated weights for policy 0, policy_version 1471162 (0.0010) [2023-12-26 11:20:32,557][123091] Updated weights for policy 0, policy_version 1471172 (0.0009) [2023-12-26 11:20:32,614][123091] Updated weights for policy 0, policy_version 1471182 (0.0008) [2023-12-26 11:20:32,621][123090] Updated weights for policy 1, policy_version 1461639 (0.0009) [2023-12-26 11:20:32,672][123090] Updated weights for policy 1, policy_version 1461649 (0.0009) [2023-12-26 11:20:32,736][123090] Updated weights for policy 1, policy_version 1461659 (0.0009) [2023-12-26 11:20:33,279][123091] Updated weights for policy 0, policy_version 1471192 (0.0006) [2023-12-26 11:20:33,323][123091] Updated weights for policy 0, policy_version 1471202 (0.0005) [2023-12-26 11:20:33,383][123091] Updated weights for policy 0, policy_version 1471212 (0.0005) [2023-12-26 11:20:33,663][123090] Updated weights for policy 1, policy_version 1461670 (0.0010) [2023-12-26 11:20:33,716][123090] Updated weights for policy 1, policy_version 1461680 (0.0010) [2023-12-26 11:20:33,768][123090] Updated weights for policy 1, policy_version 1461690 (0.0009) [2023-12-26 11:20:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 750821376. Throughput: 0: 9002.7, 1: 8737.7. Samples: 750837064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:33,785][121949] Avg episode reward: [(0, '6305.411'), (1, '5634.483')] [2023-12-26 11:20:34,057][123091] Updated weights for policy 0, policy_version 1471222 (0.0006) [2023-12-26 11:20:34,129][123091] Updated weights for policy 0, policy_version 1471232 (0.0006) [2023-12-26 11:20:34,200][123091] Updated weights for policy 0, policy_version 1471242 (0.0010) [2023-12-26 11:20:34,643][123090] Updated weights for policy 1, policy_version 1461700 (0.0010) [2023-12-26 11:20:34,713][123090] Updated weights for policy 1, policy_version 1461710 (0.0009) [2023-12-26 11:20:34,774][123090] Updated weights for policy 1, policy_version 1461720 (0.0009) [2023-12-26 11:20:34,954][123091] Updated weights for policy 0, policy_version 1471252 (0.0010) [2023-12-26 11:20:35,013][123091] Updated weights for policy 0, policy_version 1471262 (0.0009) [2023-12-26 11:20:35,071][123091] Updated weights for policy 0, policy_version 1471272 (0.0005) [2023-12-26 11:20:35,680][123090] Updated weights for policy 1, policy_version 1461730 (0.0009) [2023-12-26 11:20:35,727][123091] Updated weights for policy 0, policy_version 1471282 (0.0005) [2023-12-26 11:20:35,735][123090] Updated weights for policy 1, policy_version 1461740 (0.0008) [2023-12-26 11:20:35,783][123090] Updated weights for policy 1, policy_version 1461750 (0.0008) [2023-12-26 11:20:35,793][123091] Updated weights for policy 0, policy_version 1471292 (0.0006) [2023-12-26 11:20:35,849][123090] Updated weights for policy 1, policy_version 1461760 (0.0005) [2023-12-26 11:20:35,852][123091] Updated weights for policy 0, policy_version 1471302 (0.0011) [2023-12-26 11:20:35,914][123091] Updated weights for policy 0, policy_version 1471312 (0.0011) [2023-12-26 11:20:36,699][123090] Updated weights for policy 1, policy_version 1461770 (0.0011) [2023-12-26 11:20:36,746][123091] Updated weights for policy 0, policy_version 1471322 (0.0007) [2023-12-26 11:20:36,768][123090] Updated weights for policy 1, policy_version 1461780 (0.0008) [2023-12-26 11:20:36,803][123091] Updated weights for policy 0, policy_version 1471332 (0.0011) [2023-12-26 11:20:36,833][123090] Updated weights for policy 1, policy_version 1461790 (0.0006) [2023-12-26 11:20:36,866][123091] Updated weights for policy 0, policy_version 1471342 (0.0011) [2023-12-26 11:20:37,595][123090] Updated weights for policy 1, policy_version 1461800 (0.0008) [2023-12-26 11:20:37,653][123090] Updated weights for policy 1, policy_version 1461810 (0.0009) [2023-12-26 11:20:37,694][123091] Updated weights for policy 0, policy_version 1471352 (0.0009) [2023-12-26 11:20:37,716][123090] Updated weights for policy 1, policy_version 1461820 (0.0007) [2023-12-26 11:20:37,755][123091] Updated weights for policy 0, policy_version 1471362 (0.0009) [2023-12-26 11:20:37,814][123091] Updated weights for policy 0, policy_version 1471372 (0.0007) [2023-12-26 11:20:38,507][123090] Updated weights for policy 1, policy_version 1461830 (0.0006) [2023-12-26 11:20:38,578][123090] Updated weights for policy 1, policy_version 1461840 (0.0006) [2023-12-26 11:20:38,622][123091] Updated weights for policy 0, policy_version 1471382 (0.0008) [2023-12-26 11:20:38,652][123090] Updated weights for policy 1, policy_version 1461850 (0.0006) [2023-12-26 11:20:38,680][123091] Updated weights for policy 0, policy_version 1471392 (0.0008) [2023-12-26 11:20:38,737][123091] Updated weights for policy 0, policy_version 1471402 (0.0010) [2023-12-26 11:20:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 750919680. Throughput: 0: 9064.4, 1: 8713.2. Samples: 750890696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:38,785][121949] Avg episode reward: [(0, '6205.473'), (1, '5840.731')] [2023-12-26 11:20:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001461856_374235136.pth... [2023-12-26 11:20:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001471408_376684544.pth... [2023-12-26 11:20:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001460832_373972992.pth [2023-12-26 11:20:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001470320_376406016.pth [2023-12-26 11:20:39,248][123090] Updated weights for policy 1, policy_version 1461860 (0.0007) [2023-12-26 11:20:39,314][123090] Updated weights for policy 1, policy_version 1461870 (0.0009) [2023-12-26 11:20:39,382][123090] Updated weights for policy 1, policy_version 1461880 (0.0008) [2023-12-26 11:20:39,640][123091] Updated weights for policy 0, policy_version 1471412 (0.0009) [2023-12-26 11:20:39,712][123091] Updated weights for policy 0, policy_version 1471422 (0.0006) [2023-12-26 11:20:39,782][123091] Updated weights for policy 0, policy_version 1471432 (0.0009) [2023-12-26 11:20:40,215][123090] Updated weights for policy 1, policy_version 1461890 (0.0010) [2023-12-26 11:20:40,291][123090] Updated weights for policy 1, policy_version 1461900 (0.0011) [2023-12-26 11:20:40,355][123090] Updated weights for policy 1, policy_version 1461910 (0.0011) [2023-12-26 11:20:40,420][123090] Updated weights for policy 1, policy_version 1461920 (0.0007) [2023-12-26 11:20:40,566][123091] Updated weights for policy 0, policy_version 1471442 (0.0010) [2023-12-26 11:20:40,634][123091] Updated weights for policy 0, policy_version 1471452 (0.0009) [2023-12-26 11:20:40,700][123091] Updated weights for policy 0, policy_version 1471462 (0.0010) [2023-12-26 11:20:40,765][123091] Updated weights for policy 0, policy_version 1471472 (0.0009) [2023-12-26 11:20:41,234][123090] Updated weights for policy 1, policy_version 1461930 (0.0011) [2023-12-26 11:20:41,299][123090] Updated weights for policy 1, policy_version 1461940 (0.0011) [2023-12-26 11:20:41,391][123090] Updated weights for policy 1, policy_version 1461950 (0.0010) [2023-12-26 11:20:41,631][123091] Updated weights for policy 0, policy_version 1471482 (0.0009) [2023-12-26 11:20:41,697][123091] Updated weights for policy 0, policy_version 1471492 (0.0009) [2023-12-26 11:20:41,766][123091] Updated weights for policy 0, policy_version 1471502 (0.0008) [2023-12-26 11:20:42,217][123090] Updated weights for policy 1, policy_version 1461960 (0.0006) [2023-12-26 11:20:42,284][123090] Updated weights for policy 1, policy_version 1461970 (0.0007) [2023-12-26 11:20:42,349][123090] Updated weights for policy 1, policy_version 1461980 (0.0008) [2023-12-26 11:20:42,653][123091] Updated weights for policy 0, policy_version 1471512 (0.0008) [2023-12-26 11:20:42,717][123091] Updated weights for policy 0, policy_version 1471522 (0.0007) [2023-12-26 11:20:42,786][123091] Updated weights for policy 0, policy_version 1471532 (0.0006) [2023-12-26 11:20:43,027][123090] Updated weights for policy 1, policy_version 1461990 (0.0008) [2023-12-26 11:20:43,092][123090] Updated weights for policy 1, policy_version 1462000 (0.0009) [2023-12-26 11:20:43,153][123090] Updated weights for policy 1, policy_version 1462010 (0.0006) [2023-12-26 11:20:43,584][123091] Updated weights for policy 0, policy_version 1471542 (0.0010) [2023-12-26 11:20:43,639][123091] Updated weights for policy 0, policy_version 1471552 (0.0011) [2023-12-26 11:20:43,701][123091] Updated weights for policy 0, policy_version 1471562 (0.0005) [2023-12-26 11:20:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 751001600. Throughput: 0: 8923.6, 1: 8658.7. Samples: 750993460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:43,784][121949] Avg episode reward: [(0, '6182.174'), (1, '5686.633')] [2023-12-26 11:20:43,850][123090] Updated weights for policy 1, policy_version 1462020 (0.0009) [2023-12-26 11:20:43,903][123090] Updated weights for policy 1, policy_version 1462030 (0.0010) [2023-12-26 11:20:43,958][123090] Updated weights for policy 1, policy_version 1462040 (0.0006) [2023-12-26 11:20:44,393][123091] Updated weights for policy 0, policy_version 1471572 (0.0005) [2023-12-26 11:20:44,454][123091] Updated weights for policy 0, policy_version 1471582 (0.0005) [2023-12-26 11:20:44,531][123091] Updated weights for policy 0, policy_version 1471592 (0.0005) [2023-12-26 11:20:44,839][123090] Updated weights for policy 1, policy_version 1462050 (0.0006) [2023-12-26 11:20:44,915][123090] Updated weights for policy 1, policy_version 1462060 (0.0011) [2023-12-26 11:20:44,979][123090] Updated weights for policy 1, policy_version 1462070 (0.0011) [2023-12-26 11:20:45,033][123090] Updated weights for policy 1, policy_version 1462080 (0.0010) [2023-12-26 11:20:45,172][123091] Updated weights for policy 0, policy_version 1471602 (0.0007) [2023-12-26 11:20:45,230][123091] Updated weights for policy 0, policy_version 1471612 (0.0013) [2023-12-26 11:20:45,299][123091] Updated weights for policy 0, policy_version 1471622 (0.0010) [2023-12-26 11:20:45,361][123091] Updated weights for policy 0, policy_version 1471632 (0.0008) [2023-12-26 11:20:45,737][123090] Updated weights for policy 1, policy_version 1462090 (0.0006) [2023-12-26 11:20:45,784][123090] Updated weights for policy 1, policy_version 1462100 (0.0005) [2023-12-26 11:20:45,849][123090] Updated weights for policy 1, policy_version 1462110 (0.0006) [2023-12-26 11:20:46,083][123091] Updated weights for policy 0, policy_version 1471642 (0.0008) [2023-12-26 11:20:46,154][123091] Updated weights for policy 0, policy_version 1471652 (0.0008) [2023-12-26 11:20:46,227][123091] Updated weights for policy 0, policy_version 1471662 (0.0008) [2023-12-26 11:20:46,526][123090] Updated weights for policy 1, policy_version 1462120 (0.0005) [2023-12-26 11:20:46,582][123090] Updated weights for policy 1, policy_version 1462130 (0.0009) [2023-12-26 11:20:46,637][123090] Updated weights for policy 1, policy_version 1462140 (0.0010) [2023-12-26 11:20:46,854][123091] Updated weights for policy 0, policy_version 1471672 (0.0008) [2023-12-26 11:20:46,917][123091] Updated weights for policy 0, policy_version 1471682 (0.0009) [2023-12-26 11:20:46,981][123091] Updated weights for policy 0, policy_version 1471692 (0.0009) [2023-12-26 11:20:47,333][123090] Updated weights for policy 1, policy_version 1462150 (0.0007) [2023-12-26 11:20:47,380][123090] Updated weights for policy 1, policy_version 1462160 (0.0010) [2023-12-26 11:20:47,435][123090] Updated weights for policy 1, policy_version 1462170 (0.0010) [2023-12-26 11:20:47,750][123091] Updated weights for policy 0, policy_version 1471702 (0.0009) [2023-12-26 11:20:47,799][123091] Updated weights for policy 0, policy_version 1471712 (0.0009) [2023-12-26 11:20:47,852][123091] Updated weights for policy 0, policy_version 1471722 (0.0009) [2023-12-26 11:20:48,256][123090] Updated weights for policy 1, policy_version 1462180 (0.0010) [2023-12-26 11:20:48,307][123090] Updated weights for policy 1, policy_version 1462190 (0.0010) [2023-12-26 11:20:48,380][123090] Updated weights for policy 1, policy_version 1462200 (0.0009) [2023-12-26 11:20:48,668][123091] Updated weights for policy 0, policy_version 1471732 (0.0007) [2023-12-26 11:20:48,721][123091] Updated weights for policy 0, policy_version 1471742 (0.0005) [2023-12-26 11:20:48,778][123091] Updated weights for policy 0, policy_version 1471752 (0.0005) [2023-12-26 11:20:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 751091712. Throughput: 0: 9057.1, 1: 8764.5. Samples: 751106896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:48,785][121949] Avg episode reward: [(0, '6147.068'), (1, '5765.119')] [2023-12-26 11:20:49,179][123090] Updated weights for policy 1, policy_version 1462210 (0.0010) [2023-12-26 11:20:49,243][123090] Updated weights for policy 1, policy_version 1462220 (0.0008) [2023-12-26 11:20:49,314][123090] Updated weights for policy 1, policy_version 1462230 (0.0011) [2023-12-26 11:20:49,381][123090] Updated weights for policy 1, policy_version 1462240 (0.0011) [2023-12-26 11:20:49,460][123091] Updated weights for policy 0, policy_version 1471762 (0.0006) [2023-12-26 11:20:49,527][123091] Updated weights for policy 0, policy_version 1471772 (0.0005) [2023-12-26 11:20:49,593][123091] Updated weights for policy 0, policy_version 1471782 (0.0005) [2023-12-26 11:20:49,666][123091] Updated weights for policy 0, policy_version 1471792 (0.0005) [2023-12-26 11:20:50,158][123090] Updated weights for policy 1, policy_version 1462250 (0.0011) [2023-12-26 11:20:50,219][123090] Updated weights for policy 1, policy_version 1462260 (0.0011) [2023-12-26 11:20:50,278][123090] Updated weights for policy 1, policy_version 1462270 (0.0011) [2023-12-26 11:20:50,362][123091] Updated weights for policy 0, policy_version 1471802 (0.0008) [2023-12-26 11:20:50,421][123091] Updated weights for policy 0, policy_version 1471812 (0.0007) [2023-12-26 11:20:50,480][123091] Updated weights for policy 0, policy_version 1471822 (0.0005) [2023-12-26 11:20:51,139][123090] Updated weights for policy 1, policy_version 1462280 (0.0011) [2023-12-26 11:20:51,204][123090] Updated weights for policy 1, policy_version 1462290 (0.0011) [2023-12-26 11:20:51,259][123091] Updated weights for policy 0, policy_version 1471832 (0.0008) [2023-12-26 11:20:51,272][123090] Updated weights for policy 1, policy_version 1462300 (0.0011) [2023-12-26 11:20:51,314][123091] Updated weights for policy 0, policy_version 1471842 (0.0010) [2023-12-26 11:20:51,383][123091] Updated weights for policy 0, policy_version 1471852 (0.0009) [2023-12-26 11:20:52,065][123090] Updated weights for policy 1, policy_version 1462310 (0.0008) [2023-12-26 11:20:52,126][123090] Updated weights for policy 1, policy_version 1462320 (0.0005) [2023-12-26 11:20:52,190][123090] Updated weights for policy 1, policy_version 1462330 (0.0005) [2023-12-26 11:20:52,253][123091] Updated weights for policy 0, policy_version 1471862 (0.0010) [2023-12-26 11:20:52,323][123091] Updated weights for policy 0, policy_version 1471872 (0.0009) [2023-12-26 11:20:52,396][123091] Updated weights for policy 0, policy_version 1471882 (0.0009) [2023-12-26 11:20:52,921][123090] Updated weights for policy 1, policy_version 1462340 (0.0007) [2023-12-26 11:20:52,981][123090] Updated weights for policy 1, policy_version 1462350 (0.0011) [2023-12-26 11:20:53,036][123090] Updated weights for policy 1, policy_version 1462360 (0.0008) [2023-12-26 11:20:53,177][123091] Updated weights for policy 0, policy_version 1471892 (0.0009) [2023-12-26 11:20:53,250][123091] Updated weights for policy 0, policy_version 1471902 (0.0008) [2023-12-26 11:20:53,312][123091] Updated weights for policy 0, policy_version 1471912 (0.0010) [2023-12-26 11:20:53,778][123090] Updated weights for policy 1, policy_version 1462370 (0.0005) [2023-12-26 11:20:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 751181824. Throughput: 0: 9076.8, 1: 8780.2. Samples: 751160308. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:53,785][121949] Avg episode reward: [(0, '6101.304'), (1, '5801.653')] [2023-12-26 11:20:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001471920_376815616.pth... [2023-12-26 11:20:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001470864_376545280.pth [2023-12-26 11:20:53,836][123090] Updated weights for policy 1, policy_version 1462380 (0.0005) [2023-12-26 11:20:53,907][123090] Updated weights for policy 1, policy_version 1462390 (0.0005) [2023-12-26 11:20:53,969][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001462400_374374400.pth... [2023-12-26 11:20:53,970][123090] Updated weights for policy 1, policy_version 1462400 (0.0005) [2023-12-26 11:20:53,972][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001461344_374104064.pth [2023-12-26 11:20:54,115][123091] Updated weights for policy 0, policy_version 1471922 (0.0009) [2023-12-26 11:20:54,179][123091] Updated weights for policy 0, policy_version 1471932 (0.0009) [2023-12-26 11:20:54,226][123091] Updated weights for policy 0, policy_version 1471942 (0.0009) [2023-12-26 11:20:54,291][123091] Updated weights for policy 0, policy_version 1471952 (0.0010) [2023-12-26 11:20:54,711][123090] Updated weights for policy 1, policy_version 1462410 (0.0010) [2023-12-26 11:20:54,769][123090] Updated weights for policy 1, policy_version 1462420 (0.0010) [2023-12-26 11:20:54,817][123090] Updated weights for policy 1, policy_version 1462430 (0.0010) [2023-12-26 11:20:55,138][123091] Updated weights for policy 0, policy_version 1471962 (0.0009) [2023-12-26 11:20:55,197][123091] Updated weights for policy 0, policy_version 1471972 (0.0008) [2023-12-26 11:20:55,254][123091] Updated weights for policy 0, policy_version 1471982 (0.0009) [2023-12-26 11:20:55,531][123090] Updated weights for policy 1, policy_version 1462440 (0.0006) [2023-12-26 11:20:55,602][123090] Updated weights for policy 1, policy_version 1462450 (0.0005) [2023-12-26 11:20:55,671][123090] Updated weights for policy 1, policy_version 1462460 (0.0005) [2023-12-26 11:20:55,954][123091] Updated weights for policy 0, policy_version 1471992 (0.0008) [2023-12-26 11:20:56,016][123091] Updated weights for policy 0, policy_version 1472002 (0.0010) [2023-12-26 11:20:56,074][123091] Updated weights for policy 0, policy_version 1472012 (0.0010) [2023-12-26 11:20:56,311][123090] Updated weights for policy 1, policy_version 1462470 (0.0008) [2023-12-26 11:20:56,377][123090] Updated weights for policy 1, policy_version 1462480 (0.0010) [2023-12-26 11:20:56,424][123090] Updated weights for policy 1, policy_version 1462490 (0.0010) [2023-12-26 11:20:56,843][123091] Updated weights for policy 0, policy_version 1472022 (0.0008) [2023-12-26 11:20:56,897][123091] Updated weights for policy 0, policy_version 1472032 (0.0006) [2023-12-26 11:20:56,952][123091] Updated weights for policy 0, policy_version 1472042 (0.0006) [2023-12-26 11:20:57,243][123090] Updated weights for policy 1, policy_version 1462500 (0.0010) [2023-12-26 11:20:57,298][123090] Updated weights for policy 1, policy_version 1462510 (0.0010) [2023-12-26 11:20:57,350][123090] Updated weights for policy 1, policy_version 1462520 (0.0006) [2023-12-26 11:20:57,598][123091] Updated weights for policy 0, policy_version 1472052 (0.0008) [2023-12-26 11:20:57,647][123091] Updated weights for policy 0, policy_version 1472063 (0.0009) [2023-12-26 11:20:57,699][123091] Updated weights for policy 0, policy_version 1472073 (0.0009) [2023-12-26 11:20:58,155][123090] Updated weights for policy 1, policy_version 1462530 (0.0010) [2023-12-26 11:20:58,217][123090] Updated weights for policy 1, policy_version 1462540 (0.0008) [2023-12-26 11:20:58,283][123090] Updated weights for policy 1, policy_version 1462550 (0.0008) [2023-12-26 11:20:58,349][123090] Updated weights for policy 1, policy_version 1462560 (0.0008) [2023-12-26 11:20:58,481][123091] Updated weights for policy 0, policy_version 1472083 (0.0009) [2023-12-26 11:20:58,542][123091] Updated weights for policy 0, policy_version 1472093 (0.0010) [2023-12-26 11:20:58,597][123091] Updated weights for policy 0, policy_version 1472103 (0.0009) [2023-12-26 11:20:58,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 751280128. Throughput: 0: 9074.0, 1: 8907.7. Samples: 751271300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:20:58,785][121949] Avg episode reward: [(0, '6099.111'), (1, '5850.612')] [2023-12-26 11:20:59,250][123090] Updated weights for policy 1, policy_version 1462570 (0.0011) [2023-12-26 11:20:59,322][123090] Updated weights for policy 1, policy_version 1462580 (0.0008) [2023-12-26 11:20:59,394][123090] Updated weights for policy 1, policy_version 1462590 (0.0010) [2023-12-26 11:20:59,535][123091] Updated weights for policy 0, policy_version 1472113 (0.0010) [2023-12-26 11:20:59,610][123091] Updated weights for policy 0, policy_version 1472123 (0.0006) [2023-12-26 11:20:59,687][123091] Updated weights for policy 0, policy_version 1472133 (0.0009) [2023-12-26 11:20:59,749][123091] Updated weights for policy 0, policy_version 1472143 (0.0010) [2023-12-26 11:20:59,982][123090] Updated weights for policy 1, policy_version 1462600 (0.0009) [2023-12-26 11:21:00,037][123090] Updated weights for policy 1, policy_version 1462610 (0.0009) [2023-12-26 11:21:00,094][123090] Updated weights for policy 1, policy_version 1462620 (0.0011) [2023-12-26 11:21:00,515][123091] Updated weights for policy 0, policy_version 1472153 (0.0009) [2023-12-26 11:21:00,563][123091] Updated weights for policy 0, policy_version 1472163 (0.0009) [2023-12-26 11:21:00,619][123091] Updated weights for policy 0, policy_version 1472173 (0.0009) [2023-12-26 11:21:00,945][123090] Updated weights for policy 1, policy_version 1462630 (0.0010) [2023-12-26 11:21:01,009][123090] Updated weights for policy 1, policy_version 1462640 (0.0011) [2023-12-26 11:21:01,081][123090] Updated weights for policy 1, policy_version 1462650 (0.0011) [2023-12-26 11:21:01,503][123091] Updated weights for policy 0, policy_version 1472183 (0.0009) [2023-12-26 11:21:01,553][123091] Updated weights for policy 0, policy_version 1472193 (0.0008) [2023-12-26 11:21:01,617][123091] Updated weights for policy 0, policy_version 1472203 (0.0006) [2023-12-26 11:21:01,897][123090] Updated weights for policy 1, policy_version 1462660 (0.0010) [2023-12-26 11:21:01,958][123090] Updated weights for policy 1, policy_version 1462670 (0.0008) [2023-12-26 11:21:02,031][123090] Updated weights for policy 1, policy_version 1462680 (0.0008) [2023-12-26 11:21:02,469][123091] Updated weights for policy 0, policy_version 1472213 (0.0007) [2023-12-26 11:21:02,526][123091] Updated weights for policy 0, policy_version 1472223 (0.0008) [2023-12-26 11:21:02,575][123091] Updated weights for policy 0, policy_version 1472233 (0.0008) [2023-12-26 11:21:02,773][123090] Updated weights for policy 1, policy_version 1462690 (0.0008) [2023-12-26 11:21:02,824][123090] Updated weights for policy 1, policy_version 1462700 (0.0010) [2023-12-26 11:21:02,873][123090] Updated weights for policy 1, policy_version 1462710 (0.0009) [2023-12-26 11:21:02,925][123090] Updated weights for policy 1, policy_version 1462720 (0.0008) [2023-12-26 11:21:03,397][123091] Updated weights for policy 0, policy_version 1472243 (0.0009) [2023-12-26 11:21:03,447][123091] Updated weights for policy 0, policy_version 1472253 (0.0009) [2023-12-26 11:21:03,498][123091] Updated weights for policy 0, policy_version 1472263 (0.0010) [2023-12-26 11:21:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 751362048. Throughput: 0: 8985.4, 1: 8882.0. Samples: 751374252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:03,785][121949] Avg episode reward: [(0, '6276.389'), (1, '5839.111')] [2023-12-26 11:21:03,793][123090] Updated weights for policy 1, policy_version 1462730 (0.0009) [2023-12-26 11:21:03,855][123090] Updated weights for policy 1, policy_version 1462740 (0.0010) [2023-12-26 11:21:03,919][123090] Updated weights for policy 1, policy_version 1462750 (0.0009) [2023-12-26 11:21:04,236][123091] Updated weights for policy 0, policy_version 1472273 (0.0008) [2023-12-26 11:21:04,309][123091] Updated weights for policy 0, policy_version 1472283 (0.0007) [2023-12-26 11:21:04,371][123091] Updated weights for policy 0, policy_version 1472293 (0.0008) [2023-12-26 11:21:04,440][123091] Updated weights for policy 0, policy_version 1472303 (0.0008) [2023-12-26 11:21:04,802][123090] Updated weights for policy 1, policy_version 1462760 (0.0010) [2023-12-26 11:21:04,862][123090] Updated weights for policy 1, policy_version 1462770 (0.0009) [2023-12-26 11:21:04,928][123090] Updated weights for policy 1, policy_version 1462780 (0.0009) [2023-12-26 11:21:05,212][123091] Updated weights for policy 0, policy_version 1472313 (0.0006) [2023-12-26 11:21:05,278][123091] Updated weights for policy 0, policy_version 1472323 (0.0005) [2023-12-26 11:21:05,327][123091] Updated weights for policy 0, policy_version 1472333 (0.0005) [2023-12-26 11:21:05,687][123090] Updated weights for policy 1, policy_version 1462790 (0.0007) [2023-12-26 11:21:05,758][123090] Updated weights for policy 1, policy_version 1462800 (0.0005) [2023-12-26 11:21:05,830][123090] Updated weights for policy 1, policy_version 1462810 (0.0008) [2023-12-26 11:21:06,117][123091] Updated weights for policy 0, policy_version 1472343 (0.0008) [2023-12-26 11:21:06,184][123091] Updated weights for policy 0, policy_version 1472353 (0.0009) [2023-12-26 11:21:06,242][123091] Updated weights for policy 0, policy_version 1472363 (0.0010) [2023-12-26 11:21:06,586][123090] Updated weights for policy 1, policy_version 1462820 (0.0011) [2023-12-26 11:21:06,659][123090] Updated weights for policy 1, policy_version 1462830 (0.0010) [2023-12-26 11:21:06,727][123090] Updated weights for policy 1, policy_version 1462840 (0.0010) [2023-12-26 11:21:07,124][123091] Updated weights for policy 0, policy_version 1472373 (0.0009) [2023-12-26 11:21:07,174][123091] Updated weights for policy 0, policy_version 1472383 (0.0009) [2023-12-26 11:21:07,231][123091] Updated weights for policy 0, policy_version 1472393 (0.0009) [2023-12-26 11:21:07,553][123090] Updated weights for policy 1, policy_version 1462850 (0.0010) [2023-12-26 11:21:07,618][123090] Updated weights for policy 1, policy_version 1462860 (0.0010) [2023-12-26 11:21:07,680][123090] Updated weights for policy 1, policy_version 1462870 (0.0010) [2023-12-26 11:21:07,747][123090] Updated weights for policy 1, policy_version 1462880 (0.0010) [2023-12-26 11:21:08,054][123091] Updated weights for policy 0, policy_version 1472403 (0.0009) [2023-12-26 11:21:08,109][123091] Updated weights for policy 0, policy_version 1472413 (0.0009) [2023-12-26 11:21:08,167][123091] Updated weights for policy 0, policy_version 1472423 (0.0010) [2023-12-26 11:21:08,485][123090] Updated weights for policy 1, policy_version 1462890 (0.0010) [2023-12-26 11:21:08,551][123090] Updated weights for policy 1, policy_version 1462900 (0.0010) [2023-12-26 11:21:08,611][123090] Updated weights for policy 1, policy_version 1462910 (0.0010) [2023-12-26 11:21:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 751452160. Throughput: 0: 9050.1, 1: 8891.0. Samples: 751427024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:08,785][121949] Avg episode reward: [(0, '6205.031'), (1, '5549.430')] [2023-12-26 11:21:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001462912_374505472.pth... [2023-12-26 11:21:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001472432_376946688.pth... [2023-12-26 11:21:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001461856_374235136.pth [2023-12-26 11:21:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001471408_376684544.pth [2023-12-26 11:21:09,052][123091] Updated weights for policy 0, policy_version 1472433 (0.0009) [2023-12-26 11:21:09,116][123091] Updated weights for policy 0, policy_version 1472443 (0.0006) [2023-12-26 11:21:09,182][123091] Updated weights for policy 0, policy_version 1472453 (0.0006) [2023-12-26 11:21:09,251][123091] Updated weights for policy 0, policy_version 1472463 (0.0007) [2023-12-26 11:21:09,448][123090] Updated weights for policy 1, policy_version 1462920 (0.0007) [2023-12-26 11:21:09,504][123090] Updated weights for policy 1, policy_version 1462930 (0.0009) [2023-12-26 11:21:09,561][123090] Updated weights for policy 1, policy_version 1462940 (0.0010) [2023-12-26 11:21:10,063][123091] Updated weights for policy 0, policy_version 1472473 (0.0006) [2023-12-26 11:21:10,140][123091] Updated weights for policy 0, policy_version 1472483 (0.0007) [2023-12-26 11:21:10,211][123091] Updated weights for policy 0, policy_version 1472493 (0.0011) [2023-12-26 11:21:10,359][123090] Updated weights for policy 1, policy_version 1462950 (0.0008) [2023-12-26 11:21:10,420][123090] Updated weights for policy 1, policy_version 1462960 (0.0006) [2023-12-26 11:21:10,491][123090] Updated weights for policy 1, policy_version 1462970 (0.0010) [2023-12-26 11:21:10,983][123091] Updated weights for policy 0, policy_version 1472503 (0.0010) [2023-12-26 11:21:11,055][123091] Updated weights for policy 0, policy_version 1472513 (0.0009) [2023-12-26 11:21:11,123][123091] Updated weights for policy 0, policy_version 1472523 (0.0009) [2023-12-26 11:21:11,296][123090] Updated weights for policy 1, policy_version 1462980 (0.0008) [2023-12-26 11:21:11,353][123090] Updated weights for policy 1, policy_version 1462990 (0.0006) [2023-12-26 11:21:11,416][123090] Updated weights for policy 1, policy_version 1463000 (0.0013) [2023-12-26 11:21:11,970][123091] Updated weights for policy 0, policy_version 1472533 (0.0008) [2023-12-26 11:21:12,036][123091] Updated weights for policy 0, policy_version 1472543 (0.0009) [2023-12-26 11:21:12,093][123091] Updated weights for policy 0, policy_version 1472553 (0.0009) [2023-12-26 11:21:12,336][123090] Updated weights for policy 1, policy_version 1463010 (0.0010) [2023-12-26 11:21:12,414][123090] Updated weights for policy 1, policy_version 1463020 (0.0011) [2023-12-26 11:21:12,468][123090] Updated weights for policy 1, policy_version 1463030 (0.0010) [2023-12-26 11:21:12,531][123090] Updated weights for policy 1, policy_version 1463040 (0.0010) [2023-12-26 11:21:12,895][123091] Updated weights for policy 0, policy_version 1472563 (0.0008) [2023-12-26 11:21:12,962][123091] Updated weights for policy 0, policy_version 1472573 (0.0006) [2023-12-26 11:21:13,022][123091] Updated weights for policy 0, policy_version 1472583 (0.0006) [2023-12-26 11:21:13,394][123090] Updated weights for policy 1, policy_version 1463050 (0.0010) [2023-12-26 11:21:13,449][123090] Updated weights for policy 1, policy_version 1463060 (0.0010) [2023-12-26 11:21:13,497][123090] Updated weights for policy 1, policy_version 1463070 (0.0010) [2023-12-26 11:21:13,660][123091] Updated weights for policy 0, policy_version 1472593 (0.0006) [2023-12-26 11:21:13,727][123091] Updated weights for policy 0, policy_version 1472603 (0.0005) [2023-12-26 11:21:13,779][123091] Updated weights for policy 0, policy_version 1472613 (0.0005) [2023-12-26 11:21:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 751534080. Throughput: 0: 8903.0, 1: 8787.2. Samples: 751529404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:13,785][121949] Avg episode reward: [(0, '6153.627'), (1, '5644.936')] [2023-12-26 11:21:13,826][123091] Updated weights for policy 0, policy_version 1472623 (0.0005) [2023-12-26 11:21:14,358][123090] Updated weights for policy 1, policy_version 1463080 (0.0010) [2023-12-26 11:21:14,417][123090] Updated weights for policy 1, policy_version 1463090 (0.0010) [2023-12-26 11:21:14,468][123090] Updated weights for policy 1, policy_version 1463100 (0.0010) [2023-12-26 11:21:14,494][123091] Updated weights for policy 0, policy_version 1472633 (0.0005) [2023-12-26 11:21:14,545][123091] Updated weights for policy 0, policy_version 1472643 (0.0005) [2023-12-26 11:21:14,610][123091] Updated weights for policy 0, policy_version 1472653 (0.0006) [2023-12-26 11:21:15,309][123090] Updated weights for policy 1, policy_version 1463110 (0.0010) [2023-12-26 11:21:15,336][123091] Updated weights for policy 0, policy_version 1472663 (0.0009) [2023-12-26 11:21:15,372][123090] Updated weights for policy 1, policy_version 1463120 (0.0010) [2023-12-26 11:21:15,392][123091] Updated weights for policy 0, policy_version 1472673 (0.0011) [2023-12-26 11:21:15,435][123090] Updated weights for policy 1, policy_version 1463130 (0.0011) [2023-12-26 11:21:15,444][123091] Updated weights for policy 0, policy_version 1472683 (0.0010) [2023-12-26 11:21:16,262][123090] Updated weights for policy 1, policy_version 1463140 (0.0010) [2023-12-26 11:21:16,291][123091] Updated weights for policy 0, policy_version 1472693 (0.0011) [2023-12-26 11:21:16,328][123090] Updated weights for policy 1, policy_version 1463150 (0.0010) [2023-12-26 11:21:16,354][123091] Updated weights for policy 0, policy_version 1472703 (0.0010) [2023-12-26 11:21:16,387][123090] Updated weights for policy 1, policy_version 1463160 (0.0010) [2023-12-26 11:21:16,405][123091] Updated weights for policy 0, policy_version 1472713 (0.0010) [2023-12-26 11:21:17,160][123091] Updated weights for policy 0, policy_version 1472723 (0.0009) [2023-12-26 11:21:17,197][123090] Updated weights for policy 1, policy_version 1463170 (0.0010) [2023-12-26 11:21:17,223][123091] Updated weights for policy 0, policy_version 1472733 (0.0005) [2023-12-26 11:21:17,263][123090] Updated weights for policy 1, policy_version 1463180 (0.0010) [2023-12-26 11:21:17,281][123091] Updated weights for policy 0, policy_version 1472743 (0.0010) [2023-12-26 11:21:17,322][123090] Updated weights for policy 1, policy_version 1463190 (0.0010) [2023-12-26 11:21:17,384][123090] Updated weights for policy 1, policy_version 1463200 (0.0010) [2023-12-26 11:21:17,988][123091] Updated weights for policy 0, policy_version 1472753 (0.0010) [2023-12-26 11:21:18,038][123091] Updated weights for policy 0, policy_version 1472763 (0.0010) [2023-12-26 11:21:18,089][123091] Updated weights for policy 0, policy_version 1472773 (0.0010) [2023-12-26 11:21:18,150][123091] Updated weights for policy 0, policy_version 1472783 (0.0009) [2023-12-26 11:21:18,197][123090] Updated weights for policy 1, policy_version 1463210 (0.0010) [2023-12-26 11:21:18,263][123090] Updated weights for policy 1, policy_version 1463220 (0.0010) [2023-12-26 11:21:18,322][123090] Updated weights for policy 1, policy_version 1463230 (0.0010) [2023-12-26 11:21:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 751624192. Throughput: 0: 8993.0, 1: 8812.2. Samples: 751638304. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:18,785][121949] Avg episode reward: [(0, '6097.484'), (1, '5753.247')] [2023-12-26 11:21:18,826][123091] Updated weights for policy 0, policy_version 1472793 (0.0005) [2023-12-26 11:21:18,901][123091] Updated weights for policy 0, policy_version 1472803 (0.0005) [2023-12-26 11:21:18,971][123091] Updated weights for policy 0, policy_version 1472813 (0.0005) [2023-12-26 11:21:19,137][123090] Updated weights for policy 1, policy_version 1463240 (0.0010) [2023-12-26 11:21:19,184][123090] Updated weights for policy 1, policy_version 1463250 (0.0010) [2023-12-26 11:21:19,258][123090] Updated weights for policy 1, policy_version 1463260 (0.0011) [2023-12-26 11:21:19,593][123091] Updated weights for policy 0, policy_version 1472823 (0.0009) [2023-12-26 11:21:19,653][123091] Updated weights for policy 0, policy_version 1472833 (0.0011) [2023-12-26 11:21:19,712][123091] Updated weights for policy 0, policy_version 1472843 (0.0011) [2023-12-26 11:21:20,120][123090] Updated weights for policy 1, policy_version 1463270 (0.0011) [2023-12-26 11:21:20,187][123090] Updated weights for policy 1, policy_version 1463280 (0.0011) [2023-12-26 11:21:20,255][123090] Updated weights for policy 1, policy_version 1463290 (0.0011) [2023-12-26 11:21:20,524][123091] Updated weights for policy 0, policy_version 1472853 (0.0011) [2023-12-26 11:21:20,585][123091] Updated weights for policy 0, policy_version 1472863 (0.0011) [2023-12-26 11:21:20,648][123091] Updated weights for policy 0, policy_version 1472873 (0.0011) [2023-12-26 11:21:21,089][123090] Updated weights for policy 1, policy_version 1463300 (0.0011) [2023-12-26 11:21:21,153][123090] Updated weights for policy 1, policy_version 1463310 (0.0011) [2023-12-26 11:21:21,216][123090] Updated weights for policy 1, policy_version 1463320 (0.0011) [2023-12-26 11:21:21,486][123091] Updated weights for policy 0, policy_version 1472883 (0.0011) [2023-12-26 11:21:21,553][123091] Updated weights for policy 0, policy_version 1472893 (0.0011) [2023-12-26 11:21:21,622][123091] Updated weights for policy 0, policy_version 1472903 (0.0011) [2023-12-26 11:21:21,989][123090] Updated weights for policy 1, policy_version 1463330 (0.0009) [2023-12-26 11:21:22,062][123090] Updated weights for policy 1, policy_version 1463340 (0.0008) [2023-12-26 11:21:22,136][123090] Updated weights for policy 1, policy_version 1463350 (0.0006) [2023-12-26 11:21:22,211][123090] Updated weights for policy 1, policy_version 1463360 (0.0007) [2023-12-26 11:21:22,463][123091] Updated weights for policy 0, policy_version 1472913 (0.0010) [2023-12-26 11:21:22,531][123091] Updated weights for policy 0, policy_version 1472923 (0.0011) [2023-12-26 11:21:22,583][123091] Updated weights for policy 0, policy_version 1472933 (0.0010) [2023-12-26 11:21:22,642][123091] Updated weights for policy 0, policy_version 1472943 (0.0010) [2023-12-26 11:21:22,972][123090] Updated weights for policy 1, policy_version 1463370 (0.0011) [2023-12-26 11:21:23,016][123090] Updated weights for policy 1, policy_version 1463380 (0.0010) [2023-12-26 11:21:23,064][123090] Updated weights for policy 1, policy_version 1463390 (0.0010) [2023-12-26 11:21:23,458][123091] Updated weights for policy 0, policy_version 1472953 (0.0010) [2023-12-26 11:21:23,520][123091] Updated weights for policy 0, policy_version 1472963 (0.0011) [2023-12-26 11:21:23,596][123091] Updated weights for policy 0, policy_version 1472973 (0.0006) [2023-12-26 11:21:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 751714304. Throughput: 0: 8947.4, 1: 8819.1. Samples: 751690188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:23,785][121949] Avg episode reward: [(0, '6233.135'), (1, '5442.068')] [2023-12-26 11:21:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001472976_377085952.pth... [2023-12-26 11:21:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001463392_374628352.pth... [2023-12-26 11:21:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001471920_376815616.pth [2023-12-26 11:21:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001462400_374374400.pth [2023-12-26 11:21:23,933][123090] Updated weights for policy 1, policy_version 1463400 (0.0010) [2023-12-26 11:21:24,017][123090] Updated weights for policy 1, policy_version 1463410 (0.0010) [2023-12-26 11:21:24,084][123090] Updated weights for policy 1, policy_version 1463420 (0.0010) [2023-12-26 11:21:24,329][123091] Updated weights for policy 0, policy_version 1472983 (0.0005) [2023-12-26 11:21:24,386][123091] Updated weights for policy 0, policy_version 1472993 (0.0005) [2023-12-26 11:21:24,443][123091] Updated weights for policy 0, policy_version 1473003 (0.0006) [2023-12-26 11:21:24,812][123090] Updated weights for policy 1, policy_version 1463430 (0.0005) [2023-12-26 11:21:24,882][123090] Updated weights for policy 1, policy_version 1463440 (0.0006) [2023-12-26 11:21:24,942][123090] Updated weights for policy 1, policy_version 1463450 (0.0005) [2023-12-26 11:21:25,275][123091] Updated weights for policy 0, policy_version 1473013 (0.0007) [2023-12-26 11:21:25,340][123091] Updated weights for policy 0, policy_version 1473023 (0.0010) [2023-12-26 11:21:25,402][123091] Updated weights for policy 0, policy_version 1473033 (0.0009) [2023-12-26 11:21:25,625][123090] Updated weights for policy 1, policy_version 1463460 (0.0007) [2023-12-26 11:21:25,680][123090] Updated weights for policy 1, policy_version 1463470 (0.0010) [2023-12-26 11:21:25,746][123090] Updated weights for policy 1, policy_version 1463480 (0.0010) [2023-12-26 11:21:26,178][123091] Updated weights for policy 0, policy_version 1473043 (0.0009) [2023-12-26 11:21:26,252][123091] Updated weights for policy 0, policy_version 1473053 (0.0005) [2023-12-26 11:21:26,326][123091] Updated weights for policy 0, policy_version 1473063 (0.0005) [2023-12-26 11:21:26,474][123090] Updated weights for policy 1, policy_version 1463490 (0.0009) [2023-12-26 11:21:26,527][123090] Updated weights for policy 1, policy_version 1463500 (0.0005) [2023-12-26 11:21:26,587][123090] Updated weights for policy 1, policy_version 1463510 (0.0005) [2023-12-26 11:21:26,655][123090] Updated weights for policy 1, policy_version 1463520 (0.0005) [2023-12-26 11:21:27,008][123091] Updated weights for policy 0, policy_version 1473073 (0.0006) [2023-12-26 11:21:27,077][123091] Updated weights for policy 0, policy_version 1473083 (0.0010) [2023-12-26 11:21:27,128][123091] Updated weights for policy 0, policy_version 1473093 (0.0008) [2023-12-26 11:21:27,189][123091] Updated weights for policy 0, policy_version 1473103 (0.0009) [2023-12-26 11:21:27,393][123090] Updated weights for policy 1, policy_version 1463530 (0.0005) [2023-12-26 11:21:27,451][123090] Updated weights for policy 1, policy_version 1463540 (0.0007) [2023-12-26 11:21:27,506][123090] Updated weights for policy 1, policy_version 1463550 (0.0010) [2023-12-26 11:21:27,935][123091] Updated weights for policy 0, policy_version 1473113 (0.0006) [2023-12-26 11:21:27,992][123091] Updated weights for policy 0, policy_version 1473123 (0.0006) [2023-12-26 11:21:28,050][123091] Updated weights for policy 0, policy_version 1473133 (0.0006) [2023-12-26 11:21:28,416][123090] Updated weights for policy 1, policy_version 1463560 (0.0007) [2023-12-26 11:21:28,481][123090] Updated weights for policy 1, policy_version 1463570 (0.0008) [2023-12-26 11:21:28,552][123090] Updated weights for policy 1, policy_version 1463580 (0.0011) [2023-12-26 11:21:28,712][123091] Updated weights for policy 0, policy_version 1473143 (0.0005) [2023-12-26 11:21:28,773][123091] Updated weights for policy 0, policy_version 1473153 (0.0006) [2023-12-26 11:21:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 751804416. Throughput: 0: 9057.5, 1: 8853.6. Samples: 751799460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:28,785][121949] Avg episode reward: [(0, '6306.316'), (1, '5387.067')] [2023-12-26 11:21:28,826][123091] Updated weights for policy 0, policy_version 1473163 (0.0005) [2023-12-26 11:21:29,294][123090] Updated weights for policy 1, policy_version 1463590 (0.0011) [2023-12-26 11:21:29,356][123090] Updated weights for policy 1, policy_version 1463600 (0.0011) [2023-12-26 11:21:29,423][123090] Updated weights for policy 1, policy_version 1463610 (0.0010) [2023-12-26 11:21:29,442][123091] Updated weights for policy 0, policy_version 1473173 (0.0008) [2023-12-26 11:21:29,488][123091] Updated weights for policy 0, policy_version 1473183 (0.0008) [2023-12-26 11:21:29,544][123091] Updated weights for policy 0, policy_version 1473193 (0.0009) [2023-12-26 11:21:30,227][123090] Updated weights for policy 1, policy_version 1463620 (0.0010) [2023-12-26 11:21:30,292][123090] Updated weights for policy 1, policy_version 1463630 (0.0009) [2023-12-26 11:21:30,356][123090] Updated weights for policy 1, policy_version 1463640 (0.0009) [2023-12-26 11:21:30,375][123091] Updated weights for policy 0, policy_version 1473203 (0.0007) [2023-12-26 11:21:30,433][123091] Updated weights for policy 0, policy_version 1473213 (0.0006) [2023-12-26 11:21:30,481][123091] Updated weights for policy 0, policy_version 1473223 (0.0006) [2023-12-26 11:21:31,212][123090] Updated weights for policy 1, policy_version 1463650 (0.0009) [2023-12-26 11:21:31,285][123090] Updated weights for policy 1, policy_version 1463660 (0.0009) [2023-12-26 11:21:31,295][123091] Updated weights for policy 0, policy_version 1473233 (0.0006) [2023-12-26 11:21:31,340][123090] Updated weights for policy 1, policy_version 1463670 (0.0008) [2023-12-26 11:21:31,373][123091] Updated weights for policy 0, policy_version 1473243 (0.0008) [2023-12-26 11:21:31,407][123090] Updated weights for policy 1, policy_version 1463680 (0.0008) [2023-12-26 11:21:31,436][123091] Updated weights for policy 0, policy_version 1473253 (0.0008) [2023-12-26 11:21:31,491][123091] Updated weights for policy 0, policy_version 1473263 (0.0008) [2023-12-26 11:21:32,210][123090] Updated weights for policy 1, policy_version 1463690 (0.0005) [2023-12-26 11:21:32,217][123091] Updated weights for policy 0, policy_version 1473273 (0.0006) [2023-12-26 11:21:32,283][123090] Updated weights for policy 1, policy_version 1463700 (0.0007) [2023-12-26 11:21:32,288][123091] Updated weights for policy 0, policy_version 1473283 (0.0007) [2023-12-26 11:21:32,353][123090] Updated weights for policy 1, policy_version 1463710 (0.0008) [2023-12-26 11:21:32,359][123091] Updated weights for policy 0, policy_version 1473293 (0.0008) [2023-12-26 11:21:33,039][123091] Updated weights for policy 0, policy_version 1473303 (0.0006) [2023-12-26 11:21:33,096][123091] Updated weights for policy 0, policy_version 1473313 (0.0005) [2023-12-26 11:21:33,151][123091] Updated weights for policy 0, policy_version 1473323 (0.0005) [2023-12-26 11:21:33,192][123090] Updated weights for policy 1, policy_version 1463720 (0.0005) [2023-12-26 11:21:33,237][123090] Updated weights for policy 1, policy_version 1463730 (0.0005) [2023-12-26 11:21:33,284][123090] Updated weights for policy 1, policy_version 1463740 (0.0005) [2023-12-26 11:21:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 751894528. Throughput: 0: 9082.8, 1: 8761.7. Samples: 751909900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:33,785][121949] Avg episode reward: [(0, '6246.129'), (1, '5621.150')] [2023-12-26 11:21:33,815][123091] Updated weights for policy 0, policy_version 1473333 (0.0007) [2023-12-26 11:21:33,871][123091] Updated weights for policy 0, policy_version 1473343 (0.0009) [2023-12-26 11:21:33,934][123091] Updated weights for policy 0, policy_version 1473353 (0.0005) [2023-12-26 11:21:34,048][123090] Updated weights for policy 1, policy_version 1463750 (0.0008) [2023-12-26 11:21:34,113][123090] Updated weights for policy 1, policy_version 1463760 (0.0009) [2023-12-26 11:21:34,185][123090] Updated weights for policy 1, policy_version 1463770 (0.0009) [2023-12-26 11:21:34,681][123091] Updated weights for policy 0, policy_version 1473363 (0.0007) [2023-12-26 11:21:34,745][123091] Updated weights for policy 0, policy_version 1473373 (0.0011) [2023-12-26 11:21:34,807][123091] Updated weights for policy 0, policy_version 1473383 (0.0011) [2023-12-26 11:21:34,944][123090] Updated weights for policy 1, policy_version 1463781 (0.0011) [2023-12-26 11:21:35,002][123090] Updated weights for policy 1, policy_version 1463791 (0.0010) [2023-12-26 11:21:35,052][123090] Updated weights for policy 1, policy_version 1463801 (0.0005) [2023-12-26 11:21:35,619][123091] Updated weights for policy 0, policy_version 1473393 (0.0011) [2023-12-26 11:21:35,670][123091] Updated weights for policy 0, policy_version 1473403 (0.0011) [2023-12-26 11:21:35,716][123090] Updated weights for policy 1, policy_version 1463811 (0.0005) [2023-12-26 11:21:35,725][123091] Updated weights for policy 0, policy_version 1473413 (0.0010) [2023-12-26 11:21:35,768][123090] Updated weights for policy 1, policy_version 1463821 (0.0006) [2023-12-26 11:21:35,776][123091] Updated weights for policy 0, policy_version 1473423 (0.0010) [2023-12-26 11:21:35,821][123090] Updated weights for policy 1, policy_version 1463831 (0.0006) [2023-12-26 11:21:36,490][123090] Updated weights for policy 1, policy_version 1463841 (0.0006) [2023-12-26 11:21:36,549][123090] Updated weights for policy 1, policy_version 1463851 (0.0006) [2023-12-26 11:21:36,568][123091] Updated weights for policy 0, policy_version 1473433 (0.0011) [2023-12-26 11:21:36,614][123090] Updated weights for policy 1, policy_version 1463861 (0.0011) [2023-12-26 11:21:36,633][123091] Updated weights for policy 0, policy_version 1473443 (0.0011) [2023-12-26 11:21:36,675][123090] Updated weights for policy 1, policy_version 1463871 (0.0011) [2023-12-26 11:21:36,693][123091] Updated weights for policy 0, policy_version 1473453 (0.0011) [2023-12-26 11:21:37,474][123090] Updated weights for policy 1, policy_version 1463881 (0.0009) [2023-12-26 11:21:37,510][123091] Updated weights for policy 0, policy_version 1473463 (0.0011) [2023-12-26 11:21:37,545][123090] Updated weights for policy 1, policy_version 1463891 (0.0010) [2023-12-26 11:21:37,571][123091] Updated weights for policy 0, policy_version 1473473 (0.0011) [2023-12-26 11:21:37,608][123090] Updated weights for policy 1, policy_version 1463901 (0.0008) [2023-12-26 11:21:37,639][123091] Updated weights for policy 0, policy_version 1473483 (0.0011) [2023-12-26 11:21:38,383][123090] Updated weights for policy 1, policy_version 1463911 (0.0009) [2023-12-26 11:21:38,438][123091] Updated weights for policy 0, policy_version 1473493 (0.0009) [2023-12-26 11:21:38,443][123090] Updated weights for policy 1, policy_version 1463921 (0.0008) [2023-12-26 11:21:38,492][123091] Updated weights for policy 0, policy_version 1473503 (0.0005) [2023-12-26 11:21:38,498][123090] Updated weights for policy 1, policy_version 1463931 (0.0008) [2023-12-26 11:21:38,555][123091] Updated weights for policy 0, policy_version 1473513 (0.0008) [2023-12-26 11:21:38,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 751992832. Throughput: 0: 9066.1, 1: 8844.7. Samples: 751966292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:21:38,785][121949] Avg episode reward: [(0, '6175.873'), (1, '5583.241')] [2023-12-26 11:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001473520_377225216.pth... [2023-12-26 11:21:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001463936_374767616.pth... [2023-12-26 11:21:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001472432_376946688.pth [2023-12-26 11:21:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001462912_374505472.pth [2023-12-26 11:21:39,356][123090] Updated weights for policy 1, policy_version 1463941 (0.0009) [2023-12-26 11:21:39,369][123091] Updated weights for policy 0, policy_version 1473523 (0.0006) [2023-12-26 11:21:39,427][123090] Updated weights for policy 1, policy_version 1463951 (0.0009) [2023-12-26 11:21:39,440][123091] Updated weights for policy 0, policy_version 1473533 (0.0008) [2023-12-26 11:21:39,489][123090] Updated weights for policy 1, policy_version 1463961 (0.0008) [2023-12-26 11:21:39,506][123091] Updated weights for policy 0, policy_version 1473543 (0.0008) [2023-12-26 11:21:40,201][123091] Updated weights for policy 0, policy_version 1473553 (0.0007) [2023-12-26 11:21:40,255][123091] Updated weights for policy 0, policy_version 1473563 (0.0005) [2023-12-26 11:21:40,303][123091] Updated weights for policy 0, policy_version 1473573 (0.0006) [2023-12-26 11:21:40,362][123091] Updated weights for policy 0, policy_version 1473583 (0.0006) [2023-12-26 11:21:40,390][123090] Updated weights for policy 1, policy_version 1463971 (0.0009) [2023-12-26 11:21:40,463][123090] Updated weights for policy 1, policy_version 1463981 (0.0009) [2023-12-26 11:21:40,534][123090] Updated weights for policy 1, policy_version 1463991 (0.0010) [2023-12-26 11:21:40,955][123091] Updated weights for policy 0, policy_version 1473593 (0.0006) [2023-12-26 11:21:41,014][123091] Updated weights for policy 0, policy_version 1473603 (0.0011) [2023-12-26 11:21:41,082][123091] Updated weights for policy 0, policy_version 1473613 (0.0009) [2023-12-26 11:21:41,435][123090] Updated weights for policy 1, policy_version 1464001 (0.0009) [2023-12-26 11:21:41,501][123090] Updated weights for policy 1, policy_version 1464011 (0.0009) [2023-12-26 11:21:41,569][123090] Updated weights for policy 1, policy_version 1464021 (0.0009) [2023-12-26 11:21:41,641][123090] Updated weights for policy 1, policy_version 1464031 (0.0010) [2023-12-26 11:21:41,924][123091] Updated weights for policy 0, policy_version 1473623 (0.0008) [2023-12-26 11:21:41,993][123091] Updated weights for policy 0, policy_version 1473633 (0.0010) [2023-12-26 11:21:42,059][123091] Updated weights for policy 0, policy_version 1473643 (0.0009) [2023-12-26 11:21:42,504][123090] Updated weights for policy 1, policy_version 1464041 (0.0009) [2023-12-26 11:21:42,575][123090] Updated weights for policy 1, policy_version 1464052 (0.0009) [2023-12-26 11:21:42,639][123090] Updated weights for policy 1, policy_version 1464062 (0.0009) [2023-12-26 11:21:42,898][123091] Updated weights for policy 0, policy_version 1473653 (0.0009) [2023-12-26 11:21:42,950][123091] Updated weights for policy 0, policy_version 1473663 (0.0009) [2023-12-26 11:21:43,002][123091] Updated weights for policy 0, policy_version 1473673 (0.0008) [2023-12-26 11:21:43,431][123090] Updated weights for policy 1, policy_version 1464072 (0.0006) [2023-12-26 11:21:43,481][123090] Updated weights for policy 1, policy_version 1464082 (0.0005) [2023-12-26 11:21:43,532][123090] Updated weights for policy 1, policy_version 1464092 (0.0006) [2023-12-26 11:21:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 752074752. Throughput: 0: 9031.8, 1: 8692.1. Samples: 752068880. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:21:43,785][121949] Avg episode reward: [(0, '6019.952'), (1, '5482.801')] [2023-12-26 11:21:43,844][123091] Updated weights for policy 0, policy_version 1473683 (0.0008) [2023-12-26 11:21:43,905][123091] Updated weights for policy 0, policy_version 1473693 (0.0005) [2023-12-26 11:21:43,971][123091] Updated weights for policy 0, policy_version 1473703 (0.0009) [2023-12-26 11:21:44,339][123090] Updated weights for policy 1, policy_version 1464102 (0.0009) [2023-12-26 11:21:44,406][123090] Updated weights for policy 1, policy_version 1464112 (0.0008) [2023-12-26 11:21:44,457][123090] Updated weights for policy 1, policy_version 1464122 (0.0008) [2023-12-26 11:21:44,780][123091] Updated weights for policy 0, policy_version 1473713 (0.0009) [2023-12-26 11:21:44,853][123091] Updated weights for policy 0, policy_version 1473723 (0.0011) [2023-12-26 11:21:44,913][123091] Updated weights for policy 0, policy_version 1473733 (0.0010) [2023-12-26 11:21:44,972][123091] Updated weights for policy 0, policy_version 1473743 (0.0011) [2023-12-26 11:21:45,202][123090] Updated weights for policy 1, policy_version 1464132 (0.0008) [2023-12-26 11:21:45,266][123090] Updated weights for policy 1, policy_version 1464142 (0.0006) [2023-12-26 11:21:45,314][123090] Updated weights for policy 1, policy_version 1464152 (0.0009) [2023-12-26 11:21:45,783][123091] Updated weights for policy 0, policy_version 1473753 (0.0010) [2023-12-26 11:21:45,834][123091] Updated weights for policy 0, policy_version 1473763 (0.0010) [2023-12-26 11:21:45,884][123091] Updated weights for policy 0, policy_version 1473773 (0.0010) [2023-12-26 11:21:45,987][123090] Updated weights for policy 1, policy_version 1464162 (0.0008) [2023-12-26 11:21:46,048][123090] Updated weights for policy 1, policy_version 1464172 (0.0005) [2023-12-26 11:21:46,111][123090] Updated weights for policy 1, policy_version 1464182 (0.0005) [2023-12-26 11:21:46,172][123090] Updated weights for policy 1, policy_version 1464192 (0.0006) [2023-12-26 11:21:46,728][123091] Updated weights for policy 0, policy_version 1473783 (0.0010) [2023-12-26 11:21:46,779][123091] Updated weights for policy 0, policy_version 1473793 (0.0010) [2023-12-26 11:21:46,830][123091] Updated weights for policy 0, policy_version 1473803 (0.0010) [2023-12-26 11:21:46,932][123090] Updated weights for policy 1, policy_version 1464202 (0.0005) [2023-12-26 11:21:46,982][123090] Updated weights for policy 1, policy_version 1464212 (0.0005) [2023-12-26 11:21:47,047][123090] Updated weights for policy 1, policy_version 1464222 (0.0005) [2023-12-26 11:21:47,663][123091] Updated weights for policy 0, policy_version 1473813 (0.0010) [2023-12-26 11:21:47,710][123091] Updated weights for policy 0, policy_version 1473823 (0.0010) [2023-12-26 11:21:47,753][123091] Updated weights for policy 0, policy_version 1473833 (0.0010) [2023-12-26 11:21:47,808][123090] Updated weights for policy 1, policy_version 1464232 (0.0008) [2023-12-26 11:21:47,861][123090] Updated weights for policy 1, policy_version 1464242 (0.0009) [2023-12-26 11:21:47,925][123090] Updated weights for policy 1, policy_version 1464252 (0.0009) [2023-12-26 11:21:48,594][123091] Updated weights for policy 0, policy_version 1473843 (0.0009) [2023-12-26 11:21:48,659][123091] Updated weights for policy 0, policy_version 1473853 (0.0010) [2023-12-26 11:21:48,728][123091] Updated weights for policy 0, policy_version 1473863 (0.0010) [2023-12-26 11:21:48,774][123090] Updated weights for policy 1, policy_version 1464262 (0.0009) [2023-12-26 11:21:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 752164864. Throughput: 0: 9069.3, 1: 8752.8. Samples: 752176248. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:21:48,784][121949] Avg episode reward: [(0, '6129.441'), (1, '5492.382')] [2023-12-26 11:21:48,834][123090] Updated weights for policy 1, policy_version 1464272 (0.0007) [2023-12-26 11:21:48,908][123090] Updated weights for policy 1, policy_version 1464282 (0.0005) [2023-12-26 11:21:49,457][123091] Updated weights for policy 0, policy_version 1473873 (0.0008) [2023-12-26 11:21:49,529][123091] Updated weights for policy 0, policy_version 1473883 (0.0007) [2023-12-26 11:21:49,592][123091] Updated weights for policy 0, policy_version 1473893 (0.0008) [2023-12-26 11:21:49,665][123091] Updated weights for policy 0, policy_version 1473903 (0.0007) [2023-12-26 11:21:49,694][123090] Updated weights for policy 1, policy_version 1464292 (0.0007) [2023-12-26 11:21:49,756][123090] Updated weights for policy 1, policy_version 1464302 (0.0009) [2023-12-26 11:21:49,824][123090] Updated weights for policy 1, policy_version 1464312 (0.0009) [2023-12-26 11:21:50,399][123091] Updated weights for policy 0, policy_version 1473913 (0.0006) [2023-12-26 11:21:50,453][123091] Updated weights for policy 0, policy_version 1473923 (0.0005) [2023-12-26 11:21:50,511][123091] Updated weights for policy 0, policy_version 1473933 (0.0005) [2023-12-26 11:21:50,736][123090] Updated weights for policy 1, policy_version 1464322 (0.0009) [2023-12-26 11:21:50,802][123090] Updated weights for policy 1, policy_version 1464332 (0.0009) [2023-12-26 11:21:50,856][123090] Updated weights for policy 1, policy_version 1464342 (0.0010) [2023-12-26 11:21:50,908][123090] Updated weights for policy 1, policy_version 1464352 (0.0009) [2023-12-26 11:21:51,257][123091] Updated weights for policy 0, policy_version 1473943 (0.0009) [2023-12-26 11:21:51,311][123091] Updated weights for policy 0, policy_version 1473953 (0.0009) [2023-12-26 11:21:51,371][123091] Updated weights for policy 0, policy_version 1473963 (0.0009) [2023-12-26 11:21:51,774][123090] Updated weights for policy 1, policy_version 1464362 (0.0008) [2023-12-26 11:21:51,838][123090] Updated weights for policy 1, policy_version 1464372 (0.0010) [2023-12-26 11:21:51,908][123090] Updated weights for policy 1, policy_version 1464382 (0.0010) [2023-12-26 11:21:52,224][123091] Updated weights for policy 0, policy_version 1473973 (0.0009) [2023-12-26 11:21:52,288][123091] Updated weights for policy 0, policy_version 1473983 (0.0009) [2023-12-26 11:21:52,348][123091] Updated weights for policy 0, policy_version 1473993 (0.0009) [2023-12-26 11:21:52,696][123090] Updated weights for policy 1, policy_version 1464392 (0.0010) [2023-12-26 11:21:52,764][123090] Updated weights for policy 1, policy_version 1464402 (0.0011) [2023-12-26 11:21:52,828][123090] Updated weights for policy 1, policy_version 1464412 (0.0011) [2023-12-26 11:21:53,221][123091] Updated weights for policy 0, policy_version 1474003 (0.0008) [2023-12-26 11:21:53,287][123091] Updated weights for policy 0, policy_version 1474013 (0.0007) [2023-12-26 11:21:53,340][123091] Updated weights for policy 0, policy_version 1474023 (0.0005) [2023-12-26 11:21:53,592][123090] Updated weights for policy 1, policy_version 1464422 (0.0008) [2023-12-26 11:21:53,654][123090] Updated weights for policy 1, policy_version 1464432 (0.0010) [2023-12-26 11:21:53,727][123090] Updated weights for policy 1, policy_version 1464442 (0.0010) [2023-12-26 11:21:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 752254976. Throughput: 0: 9081.5, 1: 8728.7. Samples: 752228492. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:21:53,786][121949] Avg episode reward: [(0, '6201.195'), (1, '5518.799')] [2023-12-26 11:21:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001474032_377356288.pth... [2023-12-26 11:21:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001464448_374898688.pth... [2023-12-26 11:21:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001472976_377085952.pth [2023-12-26 11:21:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001463392_374628352.pth [2023-12-26 11:21:54,195][123091] Updated weights for policy 0, policy_version 1474033 (0.0008) [2023-12-26 11:21:54,265][123091] Updated weights for policy 0, policy_version 1474043 (0.0007) [2023-12-26 11:21:54,331][123091] Updated weights for policy 0, policy_version 1474053 (0.0008) [2023-12-26 11:21:54,395][123091] Updated weights for policy 0, policy_version 1474063 (0.0009) [2023-12-26 11:21:54,425][123090] Updated weights for policy 1, policy_version 1464452 (0.0010) [2023-12-26 11:21:54,481][123090] Updated weights for policy 1, policy_version 1464462 (0.0010) [2023-12-26 11:21:54,532][123090] Updated weights for policy 1, policy_version 1464472 (0.0010) [2023-12-26 11:21:55,223][123091] Updated weights for policy 0, policy_version 1474073 (0.0009) [2023-12-26 11:21:55,273][123090] Updated weights for policy 1, policy_version 1464482 (0.0009) [2023-12-26 11:21:55,279][123091] Updated weights for policy 0, policy_version 1474084 (0.0009) [2023-12-26 11:21:55,321][123090] Updated weights for policy 1, policy_version 1464492 (0.0005) [2023-12-26 11:21:55,337][123091] Updated weights for policy 0, policy_version 1474094 (0.0009) [2023-12-26 11:21:55,370][123090] Updated weights for policy 1, policy_version 1464502 (0.0005) [2023-12-26 11:21:55,419][123090] Updated weights for policy 1, policy_version 1464512 (0.0005) [2023-12-26 11:21:56,168][123090] Updated weights for policy 1, policy_version 1464522 (0.0009) [2023-12-26 11:21:56,220][123090] Updated weights for policy 1, policy_version 1464532 (0.0009) [2023-12-26 11:21:56,239][123091] Updated weights for policy 0, policy_version 1474104 (0.0008) [2023-12-26 11:21:56,273][123090] Updated weights for policy 1, policy_version 1464542 (0.0008) [2023-12-26 11:21:56,301][123091] Updated weights for policy 0, policy_version 1474114 (0.0009) [2023-12-26 11:21:56,371][123091] Updated weights for policy 0, policy_version 1474124 (0.0008) [2023-12-26 11:21:57,038][123090] Updated weights for policy 1, policy_version 1464552 (0.0006) [2023-12-26 11:21:57,085][123090] Updated weights for policy 1, policy_version 1464562 (0.0005) [2023-12-26 11:21:57,130][123090] Updated weights for policy 1, policy_version 1464572 (0.0005) [2023-12-26 11:21:57,193][123091] Updated weights for policy 0, policy_version 1474134 (0.0010) [2023-12-26 11:21:57,253][123091] Updated weights for policy 0, policy_version 1474144 (0.0009) [2023-12-26 11:21:57,310][123091] Updated weights for policy 0, policy_version 1474154 (0.0010) [2023-12-26 11:21:57,879][123090] Updated weights for policy 1, policy_version 1464582 (0.0005) [2023-12-26 11:21:57,935][123090] Updated weights for policy 1, policy_version 1464592 (0.0005) [2023-12-26 11:21:57,995][123090] Updated weights for policy 1, policy_version 1464602 (0.0005) [2023-12-26 11:21:58,200][123091] Updated weights for policy 0, policy_version 1474164 (0.0007) [2023-12-26 11:21:58,258][123091] Updated weights for policy 0, policy_version 1474175 (0.0010) [2023-12-26 11:21:58,312][123091] Updated weights for policy 0, policy_version 1474185 (0.0010) [2023-12-26 11:21:58,704][123090] Updated weights for policy 1, policy_version 1464612 (0.0007) [2023-12-26 11:21:58,774][123090] Updated weights for policy 1, policy_version 1464622 (0.0008) [2023-12-26 11:21:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 752336896. Throughput: 0: 9044.4, 1: 8839.0. Samples: 752334152. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:21:58,785][121949] Avg episode reward: [(0, '6163.785'), (1, '5704.869')] [2023-12-26 11:21:58,837][123090] Updated weights for policy 1, policy_version 1464632 (0.0008) [2023-12-26 11:21:59,127][123091] Updated weights for policy 0, policy_version 1474195 (0.0009) [2023-12-26 11:21:59,189][123091] Updated weights for policy 0, policy_version 1474205 (0.0010) [2023-12-26 11:21:59,250][123091] Updated weights for policy 0, policy_version 1474215 (0.0010) [2023-12-26 11:21:59,551][123090] Updated weights for policy 1, policy_version 1464642 (0.0008) [2023-12-26 11:21:59,620][123090] Updated weights for policy 1, policy_version 1464652 (0.0009) [2023-12-26 11:21:59,681][123090] Updated weights for policy 1, policy_version 1464662 (0.0009) [2023-12-26 11:21:59,731][123090] Updated weights for policy 1, policy_version 1464672 (0.0009) [2023-12-26 11:22:00,049][123091] Updated weights for policy 0, policy_version 1474225 (0.0006) [2023-12-26 11:22:00,105][123091] Updated weights for policy 0, policy_version 1474235 (0.0010) [2023-12-26 11:22:00,155][123091] Updated weights for policy 0, policy_version 1474245 (0.0010) [2023-12-26 11:22:00,210][123091] Updated weights for policy 0, policy_version 1474256 (0.0010) [2023-12-26 11:22:00,586][123090] Updated weights for policy 1, policy_version 1464682 (0.0010) [2023-12-26 11:22:00,645][123090] Updated weights for policy 1, policy_version 1464692 (0.0009) [2023-12-26 11:22:00,706][123090] Updated weights for policy 1, policy_version 1464702 (0.0009) [2023-12-26 11:22:01,053][123091] Updated weights for policy 0, policy_version 1474266 (0.0009) [2023-12-26 11:22:01,110][123091] Updated weights for policy 0, policy_version 1474276 (0.0009) [2023-12-26 11:22:01,171][123091] Updated weights for policy 0, policy_version 1474286 (0.0010) [2023-12-26 11:22:01,501][123090] Updated weights for policy 1, policy_version 1464712 (0.0008) [2023-12-26 11:22:01,566][123090] Updated weights for policy 1, policy_version 1464722 (0.0005) [2023-12-26 11:22:01,635][123090] Updated weights for policy 1, policy_version 1464732 (0.0008) [2023-12-26 11:22:02,095][123091] Updated weights for policy 0, policy_version 1474296 (0.0009) [2023-12-26 11:22:02,148][123091] Updated weights for policy 0, policy_version 1474306 (0.0009) [2023-12-26 11:22:02,198][123091] Updated weights for policy 0, policy_version 1474316 (0.0009) [2023-12-26 11:22:02,430][123090] Updated weights for policy 1, policy_version 1464742 (0.0010) [2023-12-26 11:22:02,482][123090] Updated weights for policy 1, policy_version 1464752 (0.0010) [2023-12-26 11:22:02,530][123090] Updated weights for policy 1, policy_version 1464762 (0.0006) [2023-12-26 11:22:03,083][123091] Updated weights for policy 0, policy_version 1474326 (0.0009) [2023-12-26 11:22:03,148][123091] Updated weights for policy 0, policy_version 1474336 (0.0009) [2023-12-26 11:22:03,210][123091] Updated weights for policy 0, policy_version 1474346 (0.0009) [2023-12-26 11:22:03,320][123090] Updated weights for policy 1, policy_version 1464772 (0.0007) [2023-12-26 11:22:03,368][123090] Updated weights for policy 1, policy_version 1464782 (0.0009) [2023-12-26 11:22:03,422][123090] Updated weights for policy 1, policy_version 1464792 (0.0008) [2023-12-26 11:22:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 752427008. Throughput: 0: 8866.4, 1: 8902.2. Samples: 752437892. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:03,785][121949] Avg episode reward: [(0, '6275.726'), (1, '5873.784')] [2023-12-26 11:22:04,096][123091] Updated weights for policy 0, policy_version 1474356 (0.0009) [2023-12-26 11:22:04,150][123091] Updated weights for policy 0, policy_version 1474366 (0.0010) [2023-12-26 11:22:04,192][123090] Updated weights for policy 1, policy_version 1464802 (0.0007) [2023-12-26 11:22:04,208][123091] Updated weights for policy 0, policy_version 1474376 (0.0008) [2023-12-26 11:22:04,254][123090] Updated weights for policy 1, policy_version 1464812 (0.0009) [2023-12-26 11:22:04,324][123090] Updated weights for policy 1, policy_version 1464822 (0.0009) [2023-12-26 11:22:04,396][123090] Updated weights for policy 1, policy_version 1464832 (0.0010) [2023-12-26 11:22:05,070][123091] Updated weights for policy 0, policy_version 1474386 (0.0009) [2023-12-26 11:22:05,130][123091] Updated weights for policy 0, policy_version 1474396 (0.0009) [2023-12-26 11:22:05,188][123091] Updated weights for policy 0, policy_version 1474406 (0.0009) [2023-12-26 11:22:05,217][123090] Updated weights for policy 1, policy_version 1464842 (0.0008) [2023-12-26 11:22:05,250][123091] Updated weights for policy 0, policy_version 1474416 (0.0009) [2023-12-26 11:22:05,283][123090] Updated weights for policy 1, policy_version 1464852 (0.0010) [2023-12-26 11:22:05,352][123090] Updated weights for policy 1, policy_version 1464862 (0.0010) [2023-12-26 11:22:06,075][123091] Updated weights for policy 0, policy_version 1474426 (0.0010) [2023-12-26 11:22:06,141][123091] Updated weights for policy 0, policy_version 1474436 (0.0010) [2023-12-26 11:22:06,183][123090] Updated weights for policy 1, policy_version 1464872 (0.0007) [2023-12-26 11:22:06,202][123091] Updated weights for policy 0, policy_version 1474446 (0.0010) [2023-12-26 11:22:06,239][123090] Updated weights for policy 1, policy_version 1464882 (0.0008) [2023-12-26 11:22:06,307][123090] Updated weights for policy 1, policy_version 1464892 (0.0010) [2023-12-26 11:22:07,059][123091] Updated weights for policy 0, policy_version 1474456 (0.0010) [2023-12-26 11:22:07,130][123091] Updated weights for policy 0, policy_version 1474466 (0.0008) [2023-12-26 11:22:07,153][123090] Updated weights for policy 1, policy_version 1464902 (0.0010) [2023-12-26 11:22:07,187][123091] Updated weights for policy 0, policy_version 1474476 (0.0006) [2023-12-26 11:22:07,214][123090] Updated weights for policy 1, policy_version 1464912 (0.0008) [2023-12-26 11:22:07,284][123090] Updated weights for policy 1, policy_version 1464922 (0.0009) [2023-12-26 11:22:08,024][123091] Updated weights for policy 0, policy_version 1474486 (0.0010) [2023-12-26 11:22:08,067][123090] Updated weights for policy 1, policy_version 1464932 (0.0009) [2023-12-26 11:22:08,073][123091] Updated weights for policy 0, policy_version 1474496 (0.0009) [2023-12-26 11:22:08,123][123090] Updated weights for policy 1, policy_version 1464942 (0.0008) [2023-12-26 11:22:08,134][123091] Updated weights for policy 0, policy_version 1474506 (0.0009) [2023-12-26 11:22:08,177][123090] Updated weights for policy 1, policy_version 1464952 (0.0008) [2023-12-26 11:22:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 752508928. Throughput: 0: 8828.4, 1: 8919.6. Samples: 752488844. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:08,785][121949] Avg episode reward: [(0, '6193.754'), (1, '5823.553')] [2023-12-26 11:22:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001474512_377479168.pth... [2023-12-26 11:22:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001464960_375029760.pth... [2023-12-26 11:22:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001473520_377225216.pth [2023-12-26 11:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001463936_374767616.pth [2023-12-26 11:22:09,028][123091] Updated weights for policy 0, policy_version 1474516 (0.0009) [2023-12-26 11:22:09,062][123090] Updated weights for policy 1, policy_version 1464962 (0.0008) [2023-12-26 11:22:09,093][123091] Updated weights for policy 0, policy_version 1474526 (0.0010) [2023-12-26 11:22:09,121][123090] Updated weights for policy 1, policy_version 1464972 (0.0008) [2023-12-26 11:22:09,151][123091] Updated weights for policy 0, policy_version 1474536 (0.0007) [2023-12-26 11:22:09,175][123090] Updated weights for policy 1, policy_version 1464982 (0.0008) [2023-12-26 11:22:09,230][123090] Updated weights for policy 1, policy_version 1464992 (0.0008) [2023-12-26 11:22:09,973][123091] Updated weights for policy 0, policy_version 1474546 (0.0009) [2023-12-26 11:22:10,030][123090] Updated weights for policy 1, policy_version 1465002 (0.0010) [2023-12-26 11:22:10,038][123091] Updated weights for policy 0, policy_version 1474556 (0.0006) [2023-12-26 11:22:10,099][123090] Updated weights for policy 1, policy_version 1465012 (0.0008) [2023-12-26 11:22:10,107][123091] Updated weights for policy 0, policy_version 1474566 (0.0005) [2023-12-26 11:22:10,163][123090] Updated weights for policy 1, policy_version 1465022 (0.0009) [2023-12-26 11:22:10,166][123091] Updated weights for policy 0, policy_version 1474576 (0.0006) [2023-12-26 11:22:10,878][123091] Updated weights for policy 0, policy_version 1474586 (0.0005) [2023-12-26 11:22:10,944][123091] Updated weights for policy 0, policy_version 1474596 (0.0005) [2023-12-26 11:22:10,954][123090] Updated weights for policy 1, policy_version 1465032 (0.0007) [2023-12-26 11:22:11,003][123090] Updated weights for policy 1, policy_version 1465042 (0.0007) [2023-12-26 11:22:11,006][123091] Updated weights for policy 0, policy_version 1474606 (0.0005) [2023-12-26 11:22:11,066][123090] Updated weights for policy 1, policy_version 1465052 (0.0008) [2023-12-26 11:22:11,789][123091] Updated weights for policy 0, policy_version 1474616 (0.0007) [2023-12-26 11:22:11,857][123091] Updated weights for policy 0, policy_version 1474626 (0.0006) [2023-12-26 11:22:11,925][123091] Updated weights for policy 0, policy_version 1474636 (0.0006) [2023-12-26 11:22:11,996][123090] Updated weights for policy 1, policy_version 1465062 (0.0008) [2023-12-26 11:22:12,064][123090] Updated weights for policy 1, policy_version 1465072 (0.0009) [2023-12-26 11:22:12,139][123090] Updated weights for policy 1, policy_version 1465082 (0.0010) [2023-12-26 11:22:12,665][123091] Updated weights for policy 0, policy_version 1474646 (0.0008) [2023-12-26 11:22:12,726][123091] Updated weights for policy 0, policy_version 1474656 (0.0008) [2023-12-26 11:22:12,782][123091] Updated weights for policy 0, policy_version 1474666 (0.0009) [2023-12-26 11:22:12,989][123090] Updated weights for policy 1, policy_version 1465092 (0.0010) [2023-12-26 11:22:13,044][123090] Updated weights for policy 1, policy_version 1465102 (0.0010) [2023-12-26 11:22:13,098][123090] Updated weights for policy 1, policy_version 1465112 (0.0010) [2023-12-26 11:22:13,649][123091] Updated weights for policy 0, policy_version 1474676 (0.0009) [2023-12-26 11:22:13,704][123091] Updated weights for policy 0, policy_version 1474686 (0.0010) [2023-12-26 11:22:13,759][123091] Updated weights for policy 0, policy_version 1474696 (0.0010) [2023-12-26 11:22:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 752590848. Throughput: 0: 8796.3, 1: 8823.4. Samples: 752592344. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:13,785][121949] Avg episode reward: [(0, '6014.660'), (1, '5782.987')] [2023-12-26 11:22:13,847][123090] Updated weights for policy 1, policy_version 1465122 (0.0010) [2023-12-26 11:22:13,922][123090] Updated weights for policy 1, policy_version 1465132 (0.0008) [2023-12-26 11:22:13,991][123090] Updated weights for policy 1, policy_version 1465142 (0.0005) [2023-12-26 11:22:14,060][123090] Updated weights for policy 1, policy_version 1465152 (0.0005) [2023-12-26 11:22:14,692][123090] Updated weights for policy 1, policy_version 1465162 (0.0005) [2023-12-26 11:22:14,699][123091] Updated weights for policy 0, policy_version 1474706 (0.0010) [2023-12-26 11:22:14,746][123090] Updated weights for policy 1, policy_version 1465172 (0.0005) [2023-12-26 11:22:14,753][123091] Updated weights for policy 0, policy_version 1474716 (0.0009) [2023-12-26 11:22:14,820][123090] Updated weights for policy 1, policy_version 1465182 (0.0011) [2023-12-26 11:22:14,820][123091] Updated weights for policy 0, policy_version 1474726 (0.0010) [2023-12-26 11:22:14,886][123091] Updated weights for policy 0, policy_version 1474736 (0.0009) [2023-12-26 11:22:15,614][123090] Updated weights for policy 1, policy_version 1465192 (0.0010) [2023-12-26 11:22:15,677][123090] Updated weights for policy 1, policy_version 1465202 (0.0010) [2023-12-26 11:22:15,727][123091] Updated weights for policy 0, policy_version 1474746 (0.0007) [2023-12-26 11:22:15,736][123090] Updated weights for policy 1, policy_version 1465212 (0.0010) [2023-12-26 11:22:15,791][123091] Updated weights for policy 0, policy_version 1474756 (0.0007) [2023-12-26 11:22:15,839][123091] Updated weights for policy 0, policy_version 1474766 (0.0008) [2023-12-26 11:22:16,537][123090] Updated weights for policy 1, policy_version 1465222 (0.0007) [2023-12-26 11:22:16,589][123090] Updated weights for policy 1, policy_version 1465232 (0.0005) [2023-12-26 11:22:16,645][123090] Updated weights for policy 1, policy_version 1465242 (0.0005) [2023-12-26 11:22:16,665][123091] Updated weights for policy 0, policy_version 1474776 (0.0008) [2023-12-26 11:22:16,728][123091] Updated weights for policy 0, policy_version 1474786 (0.0009) [2023-12-26 11:22:16,801][123091] Updated weights for policy 0, policy_version 1474796 (0.0007) [2023-12-26 11:22:17,323][123090] Updated weights for policy 1, policy_version 1465252 (0.0008) [2023-12-26 11:22:17,391][123090] Updated weights for policy 1, policy_version 1465262 (0.0005) [2023-12-26 11:22:17,463][123090] Updated weights for policy 1, policy_version 1465272 (0.0005) [2023-12-26 11:22:17,620][123091] Updated weights for policy 0, policy_version 1474806 (0.0007) [2023-12-26 11:22:17,692][123091] Updated weights for policy 0, policy_version 1474816 (0.0009) [2023-12-26 11:22:17,761][123091] Updated weights for policy 0, policy_version 1474826 (0.0008) [2023-12-26 11:22:18,028][123090] Updated weights for policy 1, policy_version 1465282 (0.0005) [2023-12-26 11:22:18,086][123090] Updated weights for policy 1, policy_version 1465292 (0.0005) [2023-12-26 11:22:18,137][123090] Updated weights for policy 1, policy_version 1465302 (0.0005) [2023-12-26 11:22:18,186][123090] Updated weights for policy 1, policy_version 1465312 (0.0005) [2023-12-26 11:22:18,413][123091] Updated weights for policy 0, policy_version 1474836 (0.0009) [2023-12-26 11:22:18,480][123091] Updated weights for policy 0, policy_version 1474846 (0.0008) [2023-12-26 11:22:18,545][123091] Updated weights for policy 0, policy_version 1474856 (0.0008) [2023-12-26 11:22:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 752689152. Throughput: 0: 8620.3, 1: 8927.5. Samples: 752699548. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:18,784][121949] Avg episode reward: [(0, '6199.205'), (1, '5744.903')] [2023-12-26 11:22:18,967][123090] Updated weights for policy 1, policy_version 1465322 (0.0010) [2023-12-26 11:22:19,026][123090] Updated weights for policy 1, policy_version 1465332 (0.0010) [2023-12-26 11:22:19,103][123090] Updated weights for policy 1, policy_version 1465342 (0.0010) [2023-12-26 11:22:19,294][123091] Updated weights for policy 0, policy_version 1474866 (0.0008) [2023-12-26 11:22:19,364][123091] Updated weights for policy 0, policy_version 1474876 (0.0008) [2023-12-26 11:22:19,426][123091] Updated weights for policy 0, policy_version 1474886 (0.0008) [2023-12-26 11:22:19,478][123091] Updated weights for policy 0, policy_version 1474896 (0.0008) [2023-12-26 11:22:19,949][123090] Updated weights for policy 1, policy_version 1465352 (0.0009) [2023-12-26 11:22:20,012][123090] Updated weights for policy 1, policy_version 1465362 (0.0010) [2023-12-26 11:22:20,082][123090] Updated weights for policy 1, policy_version 1465372 (0.0010) [2023-12-26 11:22:20,265][123091] Updated weights for policy 0, policy_version 1474906 (0.0010) [2023-12-26 11:22:20,331][123091] Updated weights for policy 0, policy_version 1474916 (0.0008) [2023-12-26 11:22:20,394][123091] Updated weights for policy 0, policy_version 1474926 (0.0010) [2023-12-26 11:22:20,980][123090] Updated weights for policy 1, policy_version 1465382 (0.0010) [2023-12-26 11:22:21,041][123090] Updated weights for policy 1, policy_version 1465392 (0.0010) [2023-12-26 11:22:21,111][123090] Updated weights for policy 1, policy_version 1465402 (0.0009) [2023-12-26 11:22:21,193][123091] Updated weights for policy 0, policy_version 1474936 (0.0009) [2023-12-26 11:22:21,263][123091] Updated weights for policy 0, policy_version 1474946 (0.0009) [2023-12-26 11:22:21,338][123091] Updated weights for policy 0, policy_version 1474956 (0.0010) [2023-12-26 11:22:21,939][123090] Updated weights for policy 1, policy_version 1465412 (0.0008) [2023-12-26 11:22:22,011][123090] Updated weights for policy 1, policy_version 1465422 (0.0005) [2023-12-26 11:22:22,067][123090] Updated weights for policy 1, policy_version 1465432 (0.0009) [2023-12-26 11:22:22,204][123091] Updated weights for policy 0, policy_version 1474966 (0.0010) [2023-12-26 11:22:22,264][123091] Updated weights for policy 0, policy_version 1474976 (0.0008) [2023-12-26 11:22:22,324][123091] Updated weights for policy 0, policy_version 1474986 (0.0010) [2023-12-26 11:22:22,883][123090] Updated weights for policy 1, policy_version 1465442 (0.0009) [2023-12-26 11:22:22,949][123090] Updated weights for policy 1, policy_version 1465452 (0.0010) [2023-12-26 11:22:23,015][123090] Updated weights for policy 1, policy_version 1465462 (0.0009) [2023-12-26 11:22:23,083][123090] Updated weights for policy 1, policy_version 1465472 (0.0009) [2023-12-26 11:22:23,196][123091] Updated weights for policy 0, policy_version 1474996 (0.0010) [2023-12-26 11:22:23,259][123091] Updated weights for policy 0, policy_version 1475006 (0.0009) [2023-12-26 11:22:23,324][123091] Updated weights for policy 0, policy_version 1475016 (0.0009) [2023-12-26 11:22:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 752771072. Throughput: 0: 8600.2, 1: 8828.8. Samples: 752750596. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:23,785][121949] Avg episode reward: [(0, '6256.833'), (1, '5696.826')] [2023-12-26 11:22:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001475024_377610240.pth... [2023-12-26 11:22:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001474032_377356288.pth [2023-12-26 11:22:23,841][123090] Updated weights for policy 1, policy_version 1465482 (0.0005) [2023-12-26 11:22:23,914][123090] Updated weights for policy 1, policy_version 1465492 (0.0005) [2023-12-26 11:22:23,983][123090] Updated weights for policy 1, policy_version 1465502 (0.0009) [2023-12-26 11:22:23,998][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001465504_375169024.pth... [2023-12-26 11:22:24,004][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001464448_374898688.pth [2023-12-26 11:22:24,207][123091] Updated weights for policy 0, policy_version 1475026 (0.0008) [2023-12-26 11:22:24,271][123091] Updated weights for policy 0, policy_version 1475036 (0.0009) [2023-12-26 11:22:24,328][123091] Updated weights for policy 0, policy_version 1475046 (0.0009) [2023-12-26 11:22:24,389][123091] Updated weights for policy 0, policy_version 1475056 (0.0009) [2023-12-26 11:22:24,621][123090] Updated weights for policy 1, policy_version 1465512 (0.0007) [2023-12-26 11:22:24,678][123090] Updated weights for policy 1, policy_version 1465522 (0.0005) [2023-12-26 11:22:24,736][123090] Updated weights for policy 1, policy_version 1465532 (0.0005) [2023-12-26 11:22:25,297][123091] Updated weights for policy 0, policy_version 1475066 (0.0010) [2023-12-26 11:22:25,355][123091] Updated weights for policy 0, policy_version 1475076 (0.0009) [2023-12-26 11:22:25,403][123090] Updated weights for policy 1, policy_version 1465542 (0.0005) [2023-12-26 11:22:25,409][123091] Updated weights for policy 0, policy_version 1475086 (0.0009) [2023-12-26 11:22:25,459][123090] Updated weights for policy 1, policy_version 1465552 (0.0005) [2023-12-26 11:22:25,509][123090] Updated weights for policy 1, policy_version 1465562 (0.0005) [2023-12-26 11:22:26,163][123090] Updated weights for policy 1, policy_version 1465572 (0.0007) [2023-12-26 11:22:26,221][123090] Updated weights for policy 1, policy_version 1465582 (0.0010) [2023-12-26 11:22:26,275][123090] Updated weights for policy 1, policy_version 1465592 (0.0010) [2023-12-26 11:22:26,285][123091] Updated weights for policy 0, policy_version 1475096 (0.0006) [2023-12-26 11:22:26,346][123091] Updated weights for policy 0, policy_version 1475106 (0.0006) [2023-12-26 11:22:26,399][123091] Updated weights for policy 0, policy_version 1475116 (0.0005) [2023-12-26 11:22:27,078][123090] Updated weights for policy 1, policy_version 1465602 (0.0010) [2023-12-26 11:22:27,133][123090] Updated weights for policy 1, policy_version 1465612 (0.0010) [2023-12-26 11:22:27,152][123091] Updated weights for policy 0, policy_version 1475126 (0.0008) [2023-12-26 11:22:27,185][123090] Updated weights for policy 1, policy_version 1465622 (0.0010) [2023-12-26 11:22:27,211][123091] Updated weights for policy 0, policy_version 1475136 (0.0011) [2023-12-26 11:22:27,234][123090] Updated weights for policy 1, policy_version 1465632 (0.0010) [2023-12-26 11:22:27,273][123091] Updated weights for policy 0, policy_version 1475146 (0.0011) [2023-12-26 11:22:27,975][123091] Updated weights for policy 0, policy_version 1475156 (0.0008) [2023-12-26 11:22:28,031][123090] Updated weights for policy 1, policy_version 1465642 (0.0010) [2023-12-26 11:22:28,035][123091] Updated weights for policy 0, policy_version 1475166 (0.0009) [2023-12-26 11:22:28,079][123090] Updated weights for policy 1, policy_version 1465652 (0.0010) [2023-12-26 11:22:28,086][123091] Updated weights for policy 0, policy_version 1475176 (0.0010) [2023-12-26 11:22:28,133][123090] Updated weights for policy 1, policy_version 1465662 (0.0010) [2023-12-26 11:22:28,770][123091] Updated weights for policy 0, policy_version 1475186 (0.0006) [2023-12-26 11:22:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 752861184. Throughput: 0: 8546.7, 1: 8994.3. Samples: 752858220. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:28,784][121949] Avg episode reward: [(0, '6291.212'), (1, '5774.468')] [2023-12-26 11:22:28,837][123091] Updated weights for policy 0, policy_version 1475196 (0.0005) [2023-12-26 11:22:28,900][123091] Updated weights for policy 0, policy_version 1475206 (0.0006) [2023-12-26 11:22:28,962][123091] Updated weights for policy 0, policy_version 1475216 (0.0007) [2023-12-26 11:22:28,967][123090] Updated weights for policy 1, policy_version 1465672 (0.0010) [2023-12-26 11:22:29,029][123090] Updated weights for policy 1, policy_version 1465682 (0.0010) [2023-12-26 11:22:29,092][123090] Updated weights for policy 1, policy_version 1465692 (0.0010) [2023-12-26 11:22:29,605][123091] Updated weights for policy 0, policy_version 1475226 (0.0005) [2023-12-26 11:22:29,659][123091] Updated weights for policy 0, policy_version 1475236 (0.0005) [2023-12-26 11:22:29,707][123091] Updated weights for policy 0, policy_version 1475246 (0.0005) [2023-12-26 11:22:29,807][123090] Updated weights for policy 1, policy_version 1465702 (0.0008) [2023-12-26 11:22:29,879][123090] Updated weights for policy 1, policy_version 1465712 (0.0008) [2023-12-26 11:22:29,947][123090] Updated weights for policy 1, policy_version 1465722 (0.0010) [2023-12-26 11:22:30,372][123091] Updated weights for policy 0, policy_version 1475256 (0.0009) [2023-12-26 11:22:30,426][123091] Updated weights for policy 0, policy_version 1475266 (0.0010) [2023-12-26 11:22:30,479][123091] Updated weights for policy 0, policy_version 1475276 (0.0007) [2023-12-26 11:22:30,711][123090] Updated weights for policy 1, policy_version 1465732 (0.0008) [2023-12-26 11:22:30,769][123090] Updated weights for policy 1, policy_version 1465742 (0.0005) [2023-12-26 11:22:30,824][123090] Updated weights for policy 1, policy_version 1465752 (0.0005) [2023-12-26 11:22:31,199][123091] Updated weights for policy 0, policy_version 1475286 (0.0005) [2023-12-26 11:22:31,262][123091] Updated weights for policy 0, policy_version 1475296 (0.0007) [2023-12-26 11:22:31,317][123091] Updated weights for policy 0, policy_version 1475306 (0.0009) [2023-12-26 11:22:31,662][123090] Updated weights for policy 1, policy_version 1465762 (0.0007) [2023-12-26 11:22:31,715][123090] Updated weights for policy 1, policy_version 1465772 (0.0010) [2023-12-26 11:22:31,783][123090] Updated weights for policy 1, policy_version 1465782 (0.0011) [2023-12-26 11:22:31,840][123090] Updated weights for policy 1, policy_version 1465792 (0.0005) [2023-12-26 11:22:32,096][123091] Updated weights for policy 0, policy_version 1475316 (0.0011) [2023-12-26 11:22:32,159][123091] Updated weights for policy 0, policy_version 1475326 (0.0010) [2023-12-26 11:22:32,225][123091] Updated weights for policy 0, policy_version 1475336 (0.0011) [2023-12-26 11:22:32,612][123090] Updated weights for policy 1, policy_version 1465802 (0.0009) [2023-12-26 11:22:32,681][123090] Updated weights for policy 1, policy_version 1465812 (0.0011) [2023-12-26 11:22:32,744][123090] Updated weights for policy 1, policy_version 1465822 (0.0010) [2023-12-26 11:22:33,018][123091] Updated weights for policy 0, policy_version 1475346 (0.0010) [2023-12-26 11:22:33,073][123091] Updated weights for policy 0, policy_version 1475356 (0.0010) [2023-12-26 11:22:33,123][123091] Updated weights for policy 0, policy_version 1475366 (0.0010) [2023-12-26 11:22:33,173][123091] Updated weights for policy 0, policy_version 1475376 (0.0010) [2023-12-26 11:22:33,563][123090] Updated weights for policy 1, policy_version 1465832 (0.0010) [2023-12-26 11:22:33,611][123090] Updated weights for policy 1, policy_version 1465842 (0.0010) [2023-12-26 11:22:33,669][123090] Updated weights for policy 1, policy_version 1465852 (0.0010) [2023-12-26 11:22:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 752959488. Throughput: 0: 8681.4, 1: 8967.8. Samples: 752970464. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:33,785][121949] Avg episode reward: [(0, '6301.759'), (1, '5671.267')] [2023-12-26 11:22:33,885][123091] Updated weights for policy 0, policy_version 1475386 (0.0006) [2023-12-26 11:22:33,938][123091] Updated weights for policy 0, policy_version 1475396 (0.0005) [2023-12-26 11:22:34,006][123091] Updated weights for policy 0, policy_version 1475406 (0.0008) [2023-12-26 11:22:34,479][123090] Updated weights for policy 1, policy_version 1465862 (0.0010) [2023-12-26 11:22:34,527][123090] Updated weights for policy 1, policy_version 1465872 (0.0010) [2023-12-26 11:22:34,587][123090] Updated weights for policy 1, policy_version 1465882 (0.0011) [2023-12-26 11:22:34,786][123091] Updated weights for policy 0, policy_version 1475416 (0.0010) [2023-12-26 11:22:34,854][123091] Updated weights for policy 0, policy_version 1475426 (0.0008) [2023-12-26 11:22:34,902][123091] Updated weights for policy 0, policy_version 1475436 (0.0010) [2023-12-26 11:22:35,416][123090] Updated weights for policy 1, policy_version 1465892 (0.0011) [2023-12-26 11:22:35,472][123090] Updated weights for policy 1, policy_version 1465902 (0.0010) [2023-12-26 11:22:35,527][123090] Updated weights for policy 1, policy_version 1465912 (0.0010) [2023-12-26 11:22:35,716][123091] Updated weights for policy 0, policy_version 1475446 (0.0010) [2023-12-26 11:22:35,763][123091] Updated weights for policy 0, policy_version 1475456 (0.0010) [2023-12-26 11:22:35,814][123091] Updated weights for policy 0, policy_version 1475466 (0.0010) [2023-12-26 11:22:36,348][123090] Updated weights for policy 1, policy_version 1465922 (0.0010) [2023-12-26 11:22:36,422][123090] Updated weights for policy 1, policy_version 1465932 (0.0008) [2023-12-26 11:22:36,494][123090] Updated weights for policy 1, policy_version 1465942 (0.0008) [2023-12-26 11:22:36,515][123091] Updated weights for policy 0, policy_version 1475476 (0.0010) [2023-12-26 11:22:36,561][123090] Updated weights for policy 1, policy_version 1465952 (0.0008) [2023-12-26 11:22:36,576][123091] Updated weights for policy 0, policy_version 1475486 (0.0007) [2023-12-26 11:22:36,631][123091] Updated weights for policy 0, policy_version 1475496 (0.0005) [2023-12-26 11:22:37,290][123090] Updated weights for policy 1, policy_version 1465962 (0.0008) [2023-12-26 11:22:37,339][123091] Updated weights for policy 0, policy_version 1475506 (0.0007) [2023-12-26 11:22:37,359][123090] Updated weights for policy 1, policy_version 1465972 (0.0007) [2023-12-26 11:22:37,391][123091] Updated weights for policy 0, policy_version 1475516 (0.0010) [2023-12-26 11:22:37,415][123090] Updated weights for policy 1, policy_version 1465982 (0.0008) [2023-12-26 11:22:37,439][123091] Updated weights for policy 0, policy_version 1475526 (0.0010) [2023-12-26 11:22:37,494][123091] Updated weights for policy 0, policy_version 1475536 (0.0010) [2023-12-26 11:22:38,214][123091] Updated weights for policy 0, policy_version 1475546 (0.0005) [2023-12-26 11:22:38,246][123090] Updated weights for policy 1, policy_version 1465992 (0.0005) [2023-12-26 11:22:38,276][123091] Updated weights for policy 0, policy_version 1475556 (0.0008) [2023-12-26 11:22:38,299][123090] Updated weights for policy 1, policy_version 1466002 (0.0005) [2023-12-26 11:22:38,346][123091] Updated weights for policy 0, policy_version 1475566 (0.0011) [2023-12-26 11:22:38,371][123090] Updated weights for policy 1, policy_version 1466012 (0.0010) [2023-12-26 11:22:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 753049600. Throughput: 0: 8683.2, 1: 8988.0. Samples: 753023688. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:38,784][121949] Avg episode reward: [(0, '6117.841'), (1, '5563.105')] [2023-12-26 11:22:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001475568_377749504.pth... [2023-12-26 11:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001466016_375300096.pth... [2023-12-26 11:22:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001474512_377479168.pth [2023-12-26 11:22:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001464960_375029760.pth [2023-12-26 11:22:39,164][123091] Updated weights for policy 0, policy_version 1475576 (0.0011) [2023-12-26 11:22:39,186][123090] Updated weights for policy 1, policy_version 1466022 (0.0007) [2023-12-26 11:22:39,225][123091] Updated weights for policy 0, policy_version 1475586 (0.0011) [2023-12-26 11:22:39,256][123090] Updated weights for policy 1, policy_version 1466032 (0.0007) [2023-12-26 11:22:39,304][123091] Updated weights for policy 0, policy_version 1475596 (0.0009) [2023-12-26 11:22:39,322][123090] Updated weights for policy 1, policy_version 1466042 (0.0006) [2023-12-26 11:22:40,051][123091] Updated weights for policy 0, policy_version 1475606 (0.0008) [2023-12-26 11:22:40,119][123091] Updated weights for policy 0, policy_version 1475616 (0.0006) [2023-12-26 11:22:40,145][123090] Updated weights for policy 1, policy_version 1466052 (0.0009) [2023-12-26 11:22:40,186][123091] Updated weights for policy 0, policy_version 1475626 (0.0008) [2023-12-26 11:22:40,207][123090] Updated weights for policy 1, policy_version 1466062 (0.0008) [2023-12-26 11:22:40,275][123090] Updated weights for policy 1, policy_version 1466072 (0.0009) [2023-12-26 11:22:40,933][123091] Updated weights for policy 0, policy_version 1475636 (0.0008) [2023-12-26 11:22:41,002][123091] Updated weights for policy 0, policy_version 1475646 (0.0009) [2023-12-26 11:22:41,079][123091] Updated weights for policy 0, policy_version 1475656 (0.0010) [2023-12-26 11:22:41,152][123090] Updated weights for policy 1, policy_version 1466082 (0.0010) [2023-12-26 11:22:41,219][123090] Updated weights for policy 1, policy_version 1466092 (0.0009) [2023-12-26 11:22:41,289][123090] Updated weights for policy 1, policy_version 1466102 (0.0009) [2023-12-26 11:22:41,363][123090] Updated weights for policy 1, policy_version 1466112 (0.0009) [2023-12-26 11:22:41,903][123091] Updated weights for policy 0, policy_version 1475666 (0.0009) [2023-12-26 11:22:41,966][123091] Updated weights for policy 0, policy_version 1475676 (0.0010) [2023-12-26 11:22:42,031][123091] Updated weights for policy 0, policy_version 1475686 (0.0010) [2023-12-26 11:22:42,097][123091] Updated weights for policy 0, policy_version 1475696 (0.0010) [2023-12-26 11:22:42,197][123090] Updated weights for policy 1, policy_version 1466122 (0.0010) [2023-12-26 11:22:42,264][123090] Updated weights for policy 1, policy_version 1466132 (0.0009) [2023-12-26 11:22:42,336][123090] Updated weights for policy 1, policy_version 1466142 (0.0009) [2023-12-26 11:22:42,865][123091] Updated weights for policy 0, policy_version 1475706 (0.0006) [2023-12-26 11:22:42,924][123091] Updated weights for policy 0, policy_version 1475716 (0.0006) [2023-12-26 11:22:42,978][123091] Updated weights for policy 0, policy_version 1475726 (0.0005) [2023-12-26 11:22:43,061][123090] Updated weights for policy 1, policy_version 1466152 (0.0010) [2023-12-26 11:22:43,115][123090] Updated weights for policy 1, policy_version 1466163 (0.0010) [2023-12-26 11:22:43,165][123090] Updated weights for policy 1, policy_version 1466173 (0.0009) [2023-12-26 11:22:43,591][123091] Updated weights for policy 0, policy_version 1475736 (0.0005) [2023-12-26 11:22:43,639][123091] Updated weights for policy 0, policy_version 1475746 (0.0005) [2023-12-26 11:22:43,690][123091] Updated weights for policy 0, policy_version 1475756 (0.0005) [2023-12-26 11:22:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 753139712. Throughput: 0: 8795.0, 1: 8864.0. Samples: 753128808. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:43,785][121949] Avg episode reward: [(0, '5974.625'), (1, '5675.534')] [2023-12-26 11:22:44,001][123090] Updated weights for policy 1, policy_version 1466183 (0.0006) [2023-12-26 11:22:44,063][123090] Updated weights for policy 1, policy_version 1466193 (0.0006) [2023-12-26 11:22:44,114][123090] Updated weights for policy 1, policy_version 1466203 (0.0010) [2023-12-26 11:22:44,394][123091] Updated weights for policy 0, policy_version 1475766 (0.0005) [2023-12-26 11:22:44,441][123091] Updated weights for policy 0, policy_version 1475776 (0.0006) [2023-12-26 11:22:44,504][123091] Updated weights for policy 0, policy_version 1475786 (0.0008) [2023-12-26 11:22:44,870][123090] Updated weights for policy 1, policy_version 1466213 (0.0008) [2023-12-26 11:22:44,939][123090] Updated weights for policy 1, policy_version 1466223 (0.0006) [2023-12-26 11:22:45,005][123090] Updated weights for policy 1, policy_version 1466233 (0.0006) [2023-12-26 11:22:45,394][123091] Updated weights for policy 0, policy_version 1475796 (0.0009) [2023-12-26 11:22:45,457][123091] Updated weights for policy 0, policy_version 1475806 (0.0008) [2023-12-26 11:22:45,517][123091] Updated weights for policy 0, policy_version 1475816 (0.0009) [2023-12-26 11:22:45,713][123090] Updated weights for policy 1, policy_version 1466243 (0.0006) [2023-12-26 11:22:45,779][123090] Updated weights for policy 1, policy_version 1466253 (0.0006) [2023-12-26 11:22:45,849][123090] Updated weights for policy 1, policy_version 1466263 (0.0007) [2023-12-26 11:22:46,330][123091] Updated weights for policy 0, policy_version 1475826 (0.0009) [2023-12-26 11:22:46,393][123091] Updated weights for policy 0, policy_version 1475836 (0.0010) [2023-12-26 11:22:46,452][123091] Updated weights for policy 0, policy_version 1475846 (0.0011) [2023-12-26 11:22:46,507][123091] Updated weights for policy 0, policy_version 1475856 (0.0010) [2023-12-26 11:22:46,524][123090] Updated weights for policy 1, policy_version 1466273 (0.0009) [2023-12-26 11:22:46,587][123090] Updated weights for policy 1, policy_version 1466283 (0.0005) [2023-12-26 11:22:46,646][123090] Updated weights for policy 1, policy_version 1466293 (0.0006) [2023-12-26 11:22:46,708][123090] Updated weights for policy 1, policy_version 1466303 (0.0009) [2023-12-26 11:22:47,299][123091] Updated weights for policy 0, policy_version 1475866 (0.0005) [2023-12-26 11:22:47,367][123091] Updated weights for policy 0, policy_version 1475876 (0.0005) [2023-12-26 11:22:47,437][123091] Updated weights for policy 0, policy_version 1475886 (0.0005) [2023-12-26 11:22:47,497][123090] Updated weights for policy 1, policy_version 1466313 (0.0010) [2023-12-26 11:22:47,564][123090] Updated weights for policy 1, policy_version 1466323 (0.0008) [2023-12-26 11:22:47,635][123090] Updated weights for policy 1, policy_version 1466333 (0.0005) [2023-12-26 11:22:48,141][123091] Updated weights for policy 0, policy_version 1475896 (0.0009) [2023-12-26 11:22:48,196][123091] Updated weights for policy 0, policy_version 1475906 (0.0010) [2023-12-26 11:22:48,254][123091] Updated weights for policy 0, policy_version 1475916 (0.0010) [2023-12-26 11:22:48,343][123090] Updated weights for policy 1, policy_version 1466343 (0.0008) [2023-12-26 11:22:48,406][123090] Updated weights for policy 1, policy_version 1466353 (0.0009) [2023-12-26 11:22:48,471][123090] Updated weights for policy 1, policy_version 1466363 (0.0009) [2023-12-26 11:22:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 753229824. Throughput: 0: 8916.7, 1: 8893.7. Samples: 753239360. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:48,785][121949] Avg episode reward: [(0, '6050.147'), (1, '5620.242')] [2023-12-26 11:22:49,098][123091] Updated weights for policy 0, policy_version 1475926 (0.0011) [2023-12-26 11:22:49,157][123091] Updated weights for policy 0, policy_version 1475936 (0.0011) [2023-12-26 11:22:49,223][123091] Updated weights for policy 0, policy_version 1475946 (0.0010) [2023-12-26 11:22:49,326][123090] Updated weights for policy 1, policy_version 1466373 (0.0009) [2023-12-26 11:22:49,402][123090] Updated weights for policy 1, policy_version 1466383 (0.0008) [2023-12-26 11:22:49,466][123090] Updated weights for policy 1, policy_version 1466393 (0.0009) [2023-12-26 11:22:49,992][123091] Updated weights for policy 0, policy_version 1475956 (0.0009) [2023-12-26 11:22:50,038][123091] Updated weights for policy 0, policy_version 1475966 (0.0006) [2023-12-26 11:22:50,095][123091] Updated weights for policy 0, policy_version 1475976 (0.0009) [2023-12-26 11:22:50,319][123090] Updated weights for policy 1, policy_version 1466403 (0.0010) [2023-12-26 11:22:50,390][123090] Updated weights for policy 1, policy_version 1466413 (0.0011) [2023-12-26 11:22:50,446][123090] Updated weights for policy 1, policy_version 1466423 (0.0011) [2023-12-26 11:22:50,901][123091] Updated weights for policy 0, policy_version 1475986 (0.0009) [2023-12-26 11:22:50,961][123091] Updated weights for policy 0, policy_version 1475996 (0.0006) [2023-12-26 11:22:51,020][123091] Updated weights for policy 0, policy_version 1476006 (0.0006) [2023-12-26 11:22:51,086][123091] Updated weights for policy 0, policy_version 1476016 (0.0009) [2023-12-26 11:22:51,200][123090] Updated weights for policy 1, policy_version 1466433 (0.0010) [2023-12-26 11:22:51,268][123090] Updated weights for policy 1, policy_version 1466443 (0.0007) [2023-12-26 11:22:51,330][123090] Updated weights for policy 1, policy_version 1466453 (0.0010) [2023-12-26 11:22:51,403][123090] Updated weights for policy 1, policy_version 1466463 (0.0009) [2023-12-26 11:22:51,834][123091] Updated weights for policy 0, policy_version 1476026 (0.0005) [2023-12-26 11:22:51,895][123091] Updated weights for policy 0, policy_version 1476036 (0.0006) [2023-12-26 11:22:51,963][123091] Updated weights for policy 0, policy_version 1476046 (0.0006) [2023-12-26 11:22:52,253][123090] Updated weights for policy 1, policy_version 1466473 (0.0010) [2023-12-26 11:22:52,308][123090] Updated weights for policy 1, policy_version 1466483 (0.0009) [2023-12-26 11:22:52,375][123090] Updated weights for policy 1, policy_version 1466493 (0.0009) [2023-12-26 11:22:52,760][123091] Updated weights for policy 0, policy_version 1476056 (0.0008) [2023-12-26 11:22:52,810][123091] Updated weights for policy 0, policy_version 1476066 (0.0009) [2023-12-26 11:22:52,869][123091] Updated weights for policy 0, policy_version 1476076 (0.0009) [2023-12-26 11:22:53,217][123090] Updated weights for policy 1, policy_version 1466503 (0.0010) [2023-12-26 11:22:53,269][123090] Updated weights for policy 1, policy_version 1466513 (0.0010) [2023-12-26 11:22:53,328][123090] Updated weights for policy 1, policy_version 1466523 (0.0010) [2023-12-26 11:22:53,728][123091] Updated weights for policy 0, policy_version 1476086 (0.0009) [2023-12-26 11:22:53,776][123091] Updated weights for policy 0, policy_version 1476096 (0.0009) [2023-12-26 11:22:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 753311744. Throughput: 0: 8972.6, 1: 8889.0. Samples: 753292624. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:53,785][121949] Avg episode reward: [(0, '6295.714'), (1, '5501.430')] [2023-12-26 11:22:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001466528_375431168.pth... [2023-12-26 11:22:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001465504_375169024.pth [2023-12-26 11:22:53,837][123091] Updated weights for policy 0, policy_version 1476106 (0.0009) [2023-12-26 11:22:53,871][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001476112_377888768.pth... [2023-12-26 11:22:53,875][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001475024_377610240.pth [2023-12-26 11:22:54,154][123090] Updated weights for policy 1, policy_version 1466533 (0.0010) [2023-12-26 11:22:54,206][123090] Updated weights for policy 1, policy_version 1466543 (0.0010) [2023-12-26 11:22:54,279][123090] Updated weights for policy 1, policy_version 1466553 (0.0010) [2023-12-26 11:22:54,653][123091] Updated weights for policy 0, policy_version 1476116 (0.0007) [2023-12-26 11:22:54,720][123091] Updated weights for policy 0, policy_version 1476126 (0.0008) [2023-12-26 11:22:54,784][123091] Updated weights for policy 0, policy_version 1476136 (0.0009) [2023-12-26 11:22:55,088][123090] Updated weights for policy 1, policy_version 1466563 (0.0010) [2023-12-26 11:22:55,160][123090] Updated weights for policy 1, policy_version 1466573 (0.0011) [2023-12-26 11:22:55,222][123090] Updated weights for policy 1, policy_version 1466583 (0.0010) [2023-12-26 11:22:55,562][123091] Updated weights for policy 0, policy_version 1476146 (0.0009) [2023-12-26 11:22:55,633][123091] Updated weights for policy 0, policy_version 1476156 (0.0010) [2023-12-26 11:22:55,699][123091] Updated weights for policy 0, policy_version 1476166 (0.0009) [2023-12-26 11:22:55,748][123091] Updated weights for policy 0, policy_version 1476176 (0.0009) [2023-12-26 11:22:56,028][123090] Updated weights for policy 1, policy_version 1466593 (0.0010) [2023-12-26 11:22:56,087][123090] Updated weights for policy 1, policy_version 1466603 (0.0010) [2023-12-26 11:22:56,142][123090] Updated weights for policy 1, policy_version 1466613 (0.0010) [2023-12-26 11:22:56,197][123090] Updated weights for policy 1, policy_version 1466623 (0.0010) [2023-12-26 11:22:56,463][123091] Updated weights for policy 0, policy_version 1476186 (0.0009) [2023-12-26 11:22:56,530][123091] Updated weights for policy 0, policy_version 1476196 (0.0010) [2023-12-26 11:22:56,585][123091] Updated weights for policy 0, policy_version 1476206 (0.0010) [2023-12-26 11:22:57,024][123090] Updated weights for policy 1, policy_version 1466633 (0.0010) [2023-12-26 11:22:57,089][123090] Updated weights for policy 1, policy_version 1466643 (0.0010) [2023-12-26 11:22:57,146][123090] Updated weights for policy 1, policy_version 1466653 (0.0010) [2023-12-26 11:22:57,358][123091] Updated weights for policy 0, policy_version 1476216 (0.0008) [2023-12-26 11:22:57,422][123091] Updated weights for policy 0, policy_version 1476226 (0.0009) [2023-12-26 11:22:57,485][123091] Updated weights for policy 0, policy_version 1476236 (0.0009) [2023-12-26 11:22:57,954][123090] Updated weights for policy 1, policy_version 1466663 (0.0010) [2023-12-26 11:22:58,013][123090] Updated weights for policy 1, policy_version 1466673 (0.0010) [2023-12-26 11:22:58,090][123090] Updated weights for policy 1, policy_version 1466683 (0.0008) [2023-12-26 11:22:58,329][123091] Updated weights for policy 0, policy_version 1476246 (0.0009) [2023-12-26 11:22:58,401][123091] Updated weights for policy 0, policy_version 1476256 (0.0007) [2023-12-26 11:22:58,469][123091] Updated weights for policy 0, policy_version 1476266 (0.0009) [2023-12-26 11:22:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 753401856. Throughput: 0: 8976.8, 1: 8917.8. Samples: 753397600. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:22:58,785][121949] Avg episode reward: [(0, '6208.365'), (1, '5670.582')] [2023-12-26 11:22:58,980][123090] Updated weights for policy 1, policy_version 1466693 (0.0009) [2023-12-26 11:22:59,042][123090] Updated weights for policy 1, policy_version 1466703 (0.0008) [2023-12-26 11:22:59,107][123090] Updated weights for policy 1, policy_version 1466713 (0.0007) [2023-12-26 11:22:59,402][123091] Updated weights for policy 0, policy_version 1476276 (0.0008) [2023-12-26 11:22:59,471][123091] Updated weights for policy 0, policy_version 1476286 (0.0008) [2023-12-26 11:22:59,541][123091] Updated weights for policy 0, policy_version 1476296 (0.0008) [2023-12-26 11:22:59,903][123090] Updated weights for policy 1, policy_version 1466723 (0.0010) [2023-12-26 11:22:59,964][123090] Updated weights for policy 1, policy_version 1466733 (0.0009) [2023-12-26 11:23:00,028][123090] Updated weights for policy 1, policy_version 1466743 (0.0009) [2023-12-26 11:23:00,260][123091] Updated weights for policy 0, policy_version 1476306 (0.0008) [2023-12-26 11:23:00,317][123091] Updated weights for policy 0, policy_version 1476316 (0.0010) [2023-12-26 11:23:00,377][123091] Updated weights for policy 0, policy_version 1476326 (0.0009) [2023-12-26 11:23:00,435][123091] Updated weights for policy 0, policy_version 1476336 (0.0008) [2023-12-26 11:23:00,923][123090] Updated weights for policy 1, policy_version 1466753 (0.0009) [2023-12-26 11:23:00,978][123090] Updated weights for policy 1, policy_version 1466763 (0.0009) [2023-12-26 11:23:01,026][123090] Updated weights for policy 1, policy_version 1466773 (0.0009) [2023-12-26 11:23:01,093][123090] Updated weights for policy 1, policy_version 1466783 (0.0008) [2023-12-26 11:23:01,102][123091] Updated weights for policy 0, policy_version 1476346 (0.0008) [2023-12-26 11:23:01,180][123091] Updated weights for policy 0, policy_version 1476356 (0.0010) [2023-12-26 11:23:01,248][123091] Updated weights for policy 0, policy_version 1476366 (0.0010) [2023-12-26 11:23:01,903][123090] Updated weights for policy 1, policy_version 1466793 (0.0008) [2023-12-26 11:23:01,969][123090] Updated weights for policy 1, policy_version 1466803 (0.0010) [2023-12-26 11:23:02,022][123090] Updated weights for policy 1, policy_version 1466813 (0.0009) [2023-12-26 11:23:02,089][123091] Updated weights for policy 0, policy_version 1476376 (0.0009) [2023-12-26 11:23:02,143][123091] Updated weights for policy 0, policy_version 1476386 (0.0010) [2023-12-26 11:23:02,198][123091] Updated weights for policy 0, policy_version 1476396 (0.0010) [2023-12-26 11:23:02,778][123090] Updated weights for policy 1, policy_version 1466823 (0.0009) [2023-12-26 11:23:02,835][123090] Updated weights for policy 1, policy_version 1466833 (0.0009) [2023-12-26 11:23:02,900][123090] Updated weights for policy 1, policy_version 1466843 (0.0009) [2023-12-26 11:23:03,081][123091] Updated weights for policy 0, policy_version 1476406 (0.0011) [2023-12-26 11:23:03,139][123091] Updated weights for policy 0, policy_version 1476416 (0.0006) [2023-12-26 11:23:03,207][123091] Updated weights for policy 0, policy_version 1476426 (0.0008) [2023-12-26 11:23:03,590][123090] Updated weights for policy 1, policy_version 1466853 (0.0006) [2023-12-26 11:23:03,661][123090] Updated weights for policy 1, policy_version 1466863 (0.0005) [2023-12-26 11:23:03,739][123090] Updated weights for policy 1, policy_version 1466873 (0.0005) [2023-12-26 11:23:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 753483776. Throughput: 0: 9020.3, 1: 8811.5. Samples: 753501984. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:03,785][121949] Avg episode reward: [(0, '6221.836'), (1, '5701.104')] [2023-12-26 11:23:03,830][123091] Updated weights for policy 0, policy_version 1476436 (0.0011) [2023-12-26 11:23:03,898][123091] Updated weights for policy 0, policy_version 1476446 (0.0010) [2023-12-26 11:23:03,966][123091] Updated weights for policy 0, policy_version 1476456 (0.0007) [2023-12-26 11:23:04,515][123090] Updated weights for policy 1, policy_version 1466883 (0.0008) [2023-12-26 11:23:04,570][123090] Updated weights for policy 1, policy_version 1466893 (0.0009) [2023-12-26 11:23:04,633][123090] Updated weights for policy 1, policy_version 1466903 (0.0010) [2023-12-26 11:23:04,670][123091] Updated weights for policy 0, policy_version 1476466 (0.0008) [2023-12-26 11:23:04,740][123091] Updated weights for policy 0, policy_version 1476477 (0.0008) [2023-12-26 11:23:04,806][123091] Updated weights for policy 0, policy_version 1476487 (0.0008) [2023-12-26 11:23:05,505][123090] Updated weights for policy 1, policy_version 1466913 (0.0009) [2023-12-26 11:23:05,563][123091] Updated weights for policy 0, policy_version 1476497 (0.0008) [2023-12-26 11:23:05,569][123090] Updated weights for policy 1, policy_version 1466923 (0.0010) [2023-12-26 11:23:05,626][123091] Updated weights for policy 0, policy_version 1476507 (0.0009) [2023-12-26 11:23:05,629][123090] Updated weights for policy 1, policy_version 1466933 (0.0007) [2023-12-26 11:23:05,687][123091] Updated weights for policy 0, policy_version 1476517 (0.0008) [2023-12-26 11:23:05,690][123090] Updated weights for policy 1, policy_version 1466943 (0.0008) [2023-12-26 11:23:05,746][123091] Updated weights for policy 0, policy_version 1476527 (0.0008) [2023-12-26 11:23:06,505][123090] Updated weights for policy 1, policy_version 1466953 (0.0008) [2023-12-26 11:23:06,528][123091] Updated weights for policy 0, policy_version 1476537 (0.0010) [2023-12-26 11:23:06,562][123090] Updated weights for policy 1, policy_version 1466963 (0.0006) [2023-12-26 11:23:06,594][123091] Updated weights for policy 0, policy_version 1476547 (0.0010) [2023-12-26 11:23:06,623][123090] Updated weights for policy 1, policy_version 1466973 (0.0008) [2023-12-26 11:23:06,648][123091] Updated weights for policy 0, policy_version 1476557 (0.0009) [2023-12-26 11:23:07,441][123090] Updated weights for policy 1, policy_version 1466983 (0.0010) [2023-12-26 11:23:07,475][123091] Updated weights for policy 0, policy_version 1476567 (0.0009) [2023-12-26 11:23:07,500][123090] Updated weights for policy 1, policy_version 1466993 (0.0007) [2023-12-26 11:23:07,520][123091] Updated weights for policy 0, policy_version 1476577 (0.0008) [2023-12-26 11:23:07,566][123091] Updated weights for policy 0, policy_version 1476587 (0.0009) [2023-12-26 11:23:07,574][123090] Updated weights for policy 1, policy_version 1467003 (0.0008) [2023-12-26 11:23:08,395][123090] Updated weights for policy 1, policy_version 1467013 (0.0010) [2023-12-26 11:23:08,435][123091] Updated weights for policy 0, policy_version 1476597 (0.0009) [2023-12-26 11:23:08,450][123090] Updated weights for policy 1, policy_version 1467023 (0.0009) [2023-12-26 11:23:08,498][123091] Updated weights for policy 0, policy_version 1476607 (0.0009) [2023-12-26 11:23:08,511][123090] Updated weights for policy 1, policy_version 1467033 (0.0010) [2023-12-26 11:23:08,560][123091] Updated weights for policy 0, policy_version 1476617 (0.0006) [2023-12-26 11:23:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 753582080. Throughput: 0: 9057.0, 1: 8826.1. Samples: 753555340. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:08,785][121949] Avg episode reward: [(0, '6093.169'), (1, '5684.341')] [2023-12-26 11:23:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001476624_378019840.pth... [2023-12-26 11:23:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001467040_375562240.pth... [2023-12-26 11:23:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001466016_375300096.pth [2023-12-26 11:23:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001475568_377749504.pth [2023-12-26 11:23:09,288][123090] Updated weights for policy 1, policy_version 1467043 (0.0010) [2023-12-26 11:23:09,358][123090] Updated weights for policy 1, policy_version 1467053 (0.0007) [2023-12-26 11:23:09,384][123091] Updated weights for policy 0, policy_version 1476627 (0.0006) [2023-12-26 11:23:09,430][123090] Updated weights for policy 1, policy_version 1467063 (0.0008) [2023-12-26 11:23:09,451][123091] Updated weights for policy 0, policy_version 1476637 (0.0007) [2023-12-26 11:23:09,517][123091] Updated weights for policy 0, policy_version 1476647 (0.0008) [2023-12-26 11:23:10,223][123090] Updated weights for policy 1, policy_version 1467073 (0.0008) [2023-12-26 11:23:10,285][123090] Updated weights for policy 1, policy_version 1467083 (0.0009) [2023-12-26 11:23:10,346][123090] Updated weights for policy 1, policy_version 1467093 (0.0009) [2023-12-26 11:23:10,398][123091] Updated weights for policy 0, policy_version 1476657 (0.0011) [2023-12-26 11:23:10,401][123090] Updated weights for policy 1, policy_version 1467103 (0.0010) [2023-12-26 11:23:10,452][123091] Updated weights for policy 0, policy_version 1476667 (0.0011) [2023-12-26 11:23:10,506][123091] Updated weights for policy 0, policy_version 1476678 (0.0010) [2023-12-26 11:23:10,561][123091] Updated weights for policy 0, policy_version 1476688 (0.0010) [2023-12-26 11:23:11,229][123090] Updated weights for policy 1, policy_version 1467113 (0.0010) [2023-12-26 11:23:11,298][123090] Updated weights for policy 1, policy_version 1467123 (0.0009) [2023-12-26 11:23:11,373][123090] Updated weights for policy 1, policy_version 1467133 (0.0009) [2023-12-26 11:23:11,416][123091] Updated weights for policy 0, policy_version 1476698 (0.0010) [2023-12-26 11:23:11,475][123091] Updated weights for policy 0, policy_version 1476708 (0.0010) [2023-12-26 11:23:11,530][123091] Updated weights for policy 0, policy_version 1476718 (0.0010) [2023-12-26 11:23:12,184][123090] Updated weights for policy 1, policy_version 1467143 (0.0009) [2023-12-26 11:23:12,251][123090] Updated weights for policy 1, policy_version 1467153 (0.0009) [2023-12-26 11:23:12,316][123091] Updated weights for policy 0, policy_version 1476728 (0.0009) [2023-12-26 11:23:12,321][123090] Updated weights for policy 1, policy_version 1467163 (0.0009) [2023-12-26 11:23:12,385][123091] Updated weights for policy 0, policy_version 1476738 (0.0008) [2023-12-26 11:23:12,447][123091] Updated weights for policy 0, policy_version 1476748 (0.0007) [2023-12-26 11:23:13,111][123091] Updated weights for policy 0, policy_version 1476758 (0.0006) [2023-12-26 11:23:13,125][123090] Updated weights for policy 1, policy_version 1467173 (0.0008) [2023-12-26 11:23:13,177][123091] Updated weights for policy 0, policy_version 1476768 (0.0005) [2023-12-26 11:23:13,191][123090] Updated weights for policy 1, policy_version 1467183 (0.0010) [2023-12-26 11:23:13,245][123091] Updated weights for policy 0, policy_version 1476778 (0.0006) [2023-12-26 11:23:13,256][123090] Updated weights for policy 1, policy_version 1467193 (0.0008) [2023-12-26 11:23:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 753664000. Throughput: 0: 9057.2, 1: 8733.0. Samples: 753658784. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:13,785][121949] Avg episode reward: [(0, '6152.033'), (1, '5652.604')] [2023-12-26 11:23:13,981][123091] Updated weights for policy 0, policy_version 1476788 (0.0008) [2023-12-26 11:23:14,027][123091] Updated weights for policy 0, policy_version 1476798 (0.0006) [2023-12-26 11:23:14,083][123091] Updated weights for policy 0, policy_version 1476808 (0.0005) [2023-12-26 11:23:14,091][123090] Updated weights for policy 1, policy_version 1467203 (0.0010) [2023-12-26 11:23:14,152][123090] Updated weights for policy 1, policy_version 1467213 (0.0008) [2023-12-26 11:23:14,207][123090] Updated weights for policy 1, policy_version 1467225 (0.0010) [2023-12-26 11:23:14,789][123091] Updated weights for policy 0, policy_version 1476818 (0.0006) [2023-12-26 11:23:14,854][123091] Updated weights for policy 0, policy_version 1476828 (0.0009) [2023-12-26 11:23:14,913][123091] Updated weights for policy 0, policy_version 1476838 (0.0008) [2023-12-26 11:23:14,978][123091] Updated weights for policy 0, policy_version 1476848 (0.0007) [2023-12-26 11:23:15,133][123090] Updated weights for policy 1, policy_version 1467236 (0.0010) [2023-12-26 11:23:15,194][123090] Updated weights for policy 1, policy_version 1467246 (0.0010) [2023-12-26 11:23:15,261][123090] Updated weights for policy 1, policy_version 1467256 (0.0010) [2023-12-26 11:23:15,657][123091] Updated weights for policy 0, policy_version 1476858 (0.0009) [2023-12-26 11:23:15,708][123091] Updated weights for policy 0, policy_version 1476868 (0.0009) [2023-12-26 11:23:15,766][123091] Updated weights for policy 0, policy_version 1476878 (0.0010) [2023-12-26 11:23:16,076][123090] Updated weights for policy 1, policy_version 1467266 (0.0010) [2023-12-26 11:23:16,141][123090] Updated weights for policy 1, policy_version 1467277 (0.0007) [2023-12-26 11:23:16,195][123090] Updated weights for policy 1, policy_version 1467287 (0.0007) [2023-12-26 11:23:16,470][123091] Updated weights for policy 0, policy_version 1476888 (0.0007) [2023-12-26 11:23:16,533][123091] Updated weights for policy 0, policy_version 1476898 (0.0009) [2023-12-26 11:23:16,596][123091] Updated weights for policy 0, policy_version 1476908 (0.0010) [2023-12-26 11:23:17,066][123090] Updated weights for policy 1, policy_version 1467298 (0.0009) [2023-12-26 11:23:17,117][123090] Updated weights for policy 1, policy_version 1467308 (0.0008) [2023-12-26 11:23:17,178][123090] Updated weights for policy 1, policy_version 1467318 (0.0006) [2023-12-26 11:23:17,238][123090] Updated weights for policy 1, policy_version 1467328 (0.0009) [2023-12-26 11:23:17,367][123091] Updated weights for policy 0, policy_version 1476918 (0.0007) [2023-12-26 11:23:17,425][123091] Updated weights for policy 0, policy_version 1476928 (0.0005) [2023-12-26 11:23:17,480][123091] Updated weights for policy 0, policy_version 1476938 (0.0005) [2023-12-26 11:23:18,040][123090] Updated weights for policy 1, policy_version 1467338 (0.0005) [2023-12-26 11:23:18,099][123090] Updated weights for policy 1, policy_version 1467348 (0.0010) [2023-12-26 11:23:18,102][123091] Updated weights for policy 0, policy_version 1476948 (0.0008) [2023-12-26 11:23:18,149][123091] Updated weights for policy 0, policy_version 1476958 (0.0010) [2023-12-26 11:23:18,162][123090] Updated weights for policy 1, policy_version 1467358 (0.0010) [2023-12-26 11:23:18,196][123091] Updated weights for policy 0, policy_version 1476968 (0.0010) [2023-12-26 11:23:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 753754112. Throughput: 0: 9062.1, 1: 8647.7. Samples: 753767400. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:18,785][121949] Avg episode reward: [(0, '6354.808'), (1, '5467.936')] [2023-12-26 11:23:18,998][123091] Updated weights for policy 0, policy_version 1476978 (0.0010) [2023-12-26 11:23:19,000][123090] Updated weights for policy 1, policy_version 1467368 (0.0006) [2023-12-26 11:23:19,056][123090] Updated weights for policy 1, policy_version 1467378 (0.0008) [2023-12-26 11:23:19,065][123091] Updated weights for policy 0, policy_version 1476988 (0.0011) [2023-12-26 11:23:19,115][123090] Updated weights for policy 1, policy_version 1467388 (0.0010) [2023-12-26 11:23:19,120][123091] Updated weights for policy 0, policy_version 1476998 (0.0010) [2023-12-26 11:23:19,167][123091] Updated weights for policy 0, policy_version 1477008 (0.0010) [2023-12-26 11:23:19,991][123091] Updated weights for policy 0, policy_version 1477018 (0.0011) [2023-12-26 11:23:20,011][123090] Updated weights for policy 1, policy_version 1467398 (0.0008) [2023-12-26 11:23:20,049][123091] Updated weights for policy 0, policy_version 1477028 (0.0010) [2023-12-26 11:23:20,079][123090] Updated weights for policy 1, policy_version 1467408 (0.0009) [2023-12-26 11:23:20,118][123091] Updated weights for policy 0, policy_version 1477038 (0.0011) [2023-12-26 11:23:20,147][123090] Updated weights for policy 1, policy_version 1467418 (0.0007) [2023-12-26 11:23:20,823][123090] Updated weights for policy 1, policy_version 1467428 (0.0007) [2023-12-26 11:23:20,879][123090] Updated weights for policy 1, policy_version 1467438 (0.0008) [2023-12-26 11:23:20,952][123090] Updated weights for policy 1, policy_version 1467448 (0.0007) [2023-12-26 11:23:20,953][123091] Updated weights for policy 0, policy_version 1477048 (0.0010) [2023-12-26 11:23:21,008][123091] Updated weights for policy 0, policy_version 1477058 (0.0009) [2023-12-26 11:23:21,070][123091] Updated weights for policy 0, policy_version 1477068 (0.0011) [2023-12-26 11:23:21,808][123090] Updated weights for policy 1, policy_version 1467458 (0.0008) [2023-12-26 11:23:21,868][123090] Updated weights for policy 1, policy_version 1467468 (0.0010) [2023-12-26 11:23:21,919][123091] Updated weights for policy 0, policy_version 1477078 (0.0011) [2023-12-26 11:23:21,937][123090] Updated weights for policy 1, policy_version 1467478 (0.0008) [2023-12-26 11:23:21,986][123091] Updated weights for policy 0, policy_version 1477088 (0.0011) [2023-12-26 11:23:22,007][123090] Updated weights for policy 1, policy_version 1467488 (0.0007) [2023-12-26 11:23:22,051][123091] Updated weights for policy 0, policy_version 1477098 (0.0009) [2023-12-26 11:23:22,699][123091] Updated weights for policy 0, policy_version 1477108 (0.0006) [2023-12-26 11:23:22,760][123091] Updated weights for policy 0, policy_version 1477118 (0.0009) [2023-12-26 11:23:22,763][123090] Updated weights for policy 1, policy_version 1467498 (0.0006) [2023-12-26 11:23:22,824][123091] Updated weights for policy 0, policy_version 1477128 (0.0009) [2023-12-26 11:23:22,830][123090] Updated weights for policy 1, policy_version 1467508 (0.0005) [2023-12-26 11:23:22,898][123090] Updated weights for policy 1, policy_version 1467518 (0.0006) [2023-12-26 11:23:23,555][123090] Updated weights for policy 1, policy_version 1467528 (0.0005) [2023-12-26 11:23:23,596][123091] Updated weights for policy 0, policy_version 1477138 (0.0008) [2023-12-26 11:23:23,618][123090] Updated weights for policy 1, policy_version 1467538 (0.0011) [2023-12-26 11:23:23,647][123091] Updated weights for policy 0, policy_version 1477148 (0.0010) [2023-12-26 11:23:23,673][123090] Updated weights for policy 1, policy_version 1467548 (0.0010) [2023-12-26 11:23:23,699][123091] Updated weights for policy 0, policy_version 1477158 (0.0010) [2023-12-26 11:23:23,759][123091] Updated weights for policy 0, policy_version 1477168 (0.0010) [2023-12-26 11:23:23,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 753852416. Throughput: 0: 9034.6, 1: 8651.4. Samples: 753819556. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:23,785][121949] Avg episode reward: [(0, '6417.128'), (1, '5403.601')] [2023-12-26 11:23:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001477168_378159104.pth... [2023-12-26 11:23:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001467552_375693312.pth... [2023-12-26 11:23:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001466528_375431168.pth [2023-12-26 11:23:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001476112_377888768.pth [2023-12-26 11:23:24,404][123090] Updated weights for policy 1, policy_version 1467558 (0.0007) [2023-12-26 11:23:24,469][123090] Updated weights for policy 1, policy_version 1467568 (0.0006) [2023-12-26 11:23:24,543][123090] Updated weights for policy 1, policy_version 1467578 (0.0006) [2023-12-26 11:23:24,567][123091] Updated weights for policy 0, policy_version 1477178 (0.0005) [2023-12-26 11:23:24,633][123091] Updated weights for policy 0, policy_version 1477188 (0.0006) [2023-12-26 11:23:24,696][123091] Updated weights for policy 0, policy_version 1477198 (0.0005) [2023-12-26 11:23:25,188][123090] Updated weights for policy 1, policy_version 1467588 (0.0007) [2023-12-26 11:23:25,247][123090] Updated weights for policy 1, policy_version 1467598 (0.0006) [2023-12-26 11:23:25,305][123090] Updated weights for policy 1, policy_version 1467608 (0.0005) [2023-12-26 11:23:25,393][123091] Updated weights for policy 0, policy_version 1477208 (0.0009) [2023-12-26 11:23:25,463][123091] Updated weights for policy 0, policy_version 1477218 (0.0011) [2023-12-26 11:23:25,518][123091] Updated weights for policy 0, policy_version 1477228 (0.0010) [2023-12-26 11:23:25,951][123090] Updated weights for policy 1, policy_version 1467618 (0.0006) [2023-12-26 11:23:26,013][123090] Updated weights for policy 1, policy_version 1467628 (0.0010) [2023-12-26 11:23:26,073][123090] Updated weights for policy 1, policy_version 1467638 (0.0010) [2023-12-26 11:23:26,132][123090] Updated weights for policy 1, policy_version 1467648 (0.0010) [2023-12-26 11:23:26,306][123091] Updated weights for policy 0, policy_version 1477238 (0.0007) [2023-12-26 11:23:26,355][123091] Updated weights for policy 0, policy_version 1477248 (0.0005) [2023-12-26 11:23:26,408][123091] Updated weights for policy 0, policy_version 1477258 (0.0005) [2023-12-26 11:23:26,990][123090] Updated weights for policy 1, policy_version 1467658 (0.0007) [2023-12-26 11:23:26,990][123091] Updated weights for policy 0, policy_version 1477268 (0.0005) [2023-12-26 11:23:27,046][123091] Updated weights for policy 0, policy_version 1477278 (0.0005) [2023-12-26 11:23:27,061][123090] Updated weights for policy 1, policy_version 1467668 (0.0008) [2023-12-26 11:23:27,091][123091] Updated weights for policy 0, policy_version 1477288 (0.0006) [2023-12-26 11:23:27,122][123090] Updated weights for policy 1, policy_version 1467678 (0.0010) [2023-12-26 11:23:27,779][123090] Updated weights for policy 1, policy_version 1467688 (0.0006) [2023-12-26 11:23:27,831][123090] Updated weights for policy 1, policy_version 1467698 (0.0005) [2023-12-26 11:23:27,841][123091] Updated weights for policy 0, policy_version 1477298 (0.0010) [2023-12-26 11:23:27,879][123090] Updated weights for policy 1, policy_version 1467708 (0.0005) [2023-12-26 11:23:27,888][123091] Updated weights for policy 0, policy_version 1477308 (0.0010) [2023-12-26 11:23:27,943][123091] Updated weights for policy 0, policy_version 1477318 (0.0010) [2023-12-26 11:23:27,995][123091] Updated weights for policy 0, policy_version 1477328 (0.0010) [2023-12-26 11:23:28,526][123090] Updated weights for policy 1, policy_version 1467718 (0.0005) [2023-12-26 11:23:28,599][123090] Updated weights for policy 1, policy_version 1467728 (0.0010) [2023-12-26 11:23:28,666][123090] Updated weights for policy 1, policy_version 1467738 (0.0010) [2023-12-26 11:23:28,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 753942528. Throughput: 0: 9099.3, 1: 8817.6. Samples: 753935068. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:28,784][121949] Avg episode reward: [(0, '6281.683'), (1, '5588.450')] [2023-12-26 11:23:28,830][123091] Updated weights for policy 0, policy_version 1477338 (0.0011) [2023-12-26 11:23:28,896][123091] Updated weights for policy 0, policy_version 1477348 (0.0010) [2023-12-26 11:23:28,964][123091] Updated weights for policy 0, policy_version 1477358 (0.0011) [2023-12-26 11:23:29,416][123090] Updated weights for policy 1, policy_version 1467748 (0.0009) [2023-12-26 11:23:29,471][123090] Updated weights for policy 1, policy_version 1467758 (0.0007) [2023-12-26 11:23:29,540][123090] Updated weights for policy 1, policy_version 1467768 (0.0005) [2023-12-26 11:23:29,696][123091] Updated weights for policy 0, policy_version 1477368 (0.0007) [2023-12-26 11:23:29,769][123091] Updated weights for policy 0, policy_version 1477378 (0.0006) [2023-12-26 11:23:29,824][123091] Updated weights for policy 0, policy_version 1477388 (0.0010) [2023-12-26 11:23:30,263][123090] Updated weights for policy 1, policy_version 1467778 (0.0005) [2023-12-26 11:23:30,333][123090] Updated weights for policy 1, policy_version 1467788 (0.0005) [2023-12-26 11:23:30,403][123090] Updated weights for policy 1, policy_version 1467798 (0.0005) [2023-12-26 11:23:30,474][123090] Updated weights for policy 1, policy_version 1467808 (0.0005) [2023-12-26 11:23:30,554][123091] Updated weights for policy 0, policy_version 1477398 (0.0007) [2023-12-26 11:23:30,611][123091] Updated weights for policy 0, policy_version 1477408 (0.0005) [2023-12-26 11:23:30,659][123091] Updated weights for policy 0, policy_version 1477418 (0.0005) [2023-12-26 11:23:31,093][123090] Updated weights for policy 1, policy_version 1467818 (0.0008) [2023-12-26 11:23:31,158][123090] Updated weights for policy 1, policy_version 1467828 (0.0010) [2023-12-26 11:23:31,228][123090] Updated weights for policy 1, policy_version 1467838 (0.0010) [2023-12-26 11:23:31,385][123091] Updated weights for policy 0, policy_version 1477428 (0.0008) [2023-12-26 11:23:31,439][123091] Updated weights for policy 0, policy_version 1477438 (0.0009) [2023-12-26 11:23:31,495][123091] Updated weights for policy 0, policy_version 1477448 (0.0005) [2023-12-26 11:23:32,009][123090] Updated weights for policy 1, policy_version 1467848 (0.0009) [2023-12-26 11:23:32,070][123090] Updated weights for policy 1, policy_version 1467858 (0.0008) [2023-12-26 11:23:32,130][123090] Updated weights for policy 1, policy_version 1467868 (0.0009) [2023-12-26 11:23:32,193][123091] Updated weights for policy 0, policy_version 1477458 (0.0005) [2023-12-26 11:23:32,239][123091] Updated weights for policy 0, policy_version 1477468 (0.0005) [2023-12-26 11:23:32,296][123091] Updated weights for policy 0, policy_version 1477478 (0.0006) [2023-12-26 11:23:32,352][123091] Updated weights for policy 0, policy_version 1477488 (0.0006) [2023-12-26 11:23:32,978][123090] Updated weights for policy 1, policy_version 1467878 (0.0010) [2023-12-26 11:23:33,030][123090] Updated weights for policy 1, policy_version 1467888 (0.0010) [2023-12-26 11:23:33,088][123090] Updated weights for policy 1, policy_version 1467898 (0.0009) [2023-12-26 11:23:33,116][123091] Updated weights for policy 0, policy_version 1477498 (0.0006) [2023-12-26 11:23:33,179][123091] Updated weights for policy 0, policy_version 1477508 (0.0010) [2023-12-26 11:23:33,237][123091] Updated weights for policy 0, policy_version 1477518 (0.0010) [2023-12-26 11:23:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 754032640. Throughput: 0: 9110.3, 1: 8833.9. Samples: 754046848. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:33,785][121949] Avg episode reward: [(0, '6150.674'), (1, '5628.692')] [2023-12-26 11:23:33,949][123090] Updated weights for policy 1, policy_version 1467908 (0.0009) [2023-12-26 11:23:34,012][123090] Updated weights for policy 1, policy_version 1467918 (0.0009) [2023-12-26 11:23:34,026][123091] Updated weights for policy 0, policy_version 1477528 (0.0007) [2023-12-26 11:23:34,077][123090] Updated weights for policy 1, policy_version 1467928 (0.0010) [2023-12-26 11:23:34,087][123091] Updated weights for policy 0, policy_version 1477538 (0.0005) [2023-12-26 11:23:34,153][123091] Updated weights for policy 0, policy_version 1477548 (0.0006) [2023-12-26 11:23:34,903][123091] Updated weights for policy 0, policy_version 1477558 (0.0009) [2023-12-26 11:23:34,958][123090] Updated weights for policy 1, policy_version 1467938 (0.0008) [2023-12-26 11:23:34,960][123091] Updated weights for policy 0, policy_version 1477568 (0.0009) [2023-12-26 11:23:35,015][123091] Updated weights for policy 0, policy_version 1477578 (0.0009) [2023-12-26 11:23:35,028][123090] Updated weights for policy 1, policy_version 1467948 (0.0006) [2023-12-26 11:23:35,092][123090] Updated weights for policy 1, policy_version 1467958 (0.0008) [2023-12-26 11:23:35,151][123090] Updated weights for policy 1, policy_version 1467968 (0.0005) [2023-12-26 11:23:35,844][123090] Updated weights for policy 1, policy_version 1467978 (0.0006) [2023-12-26 11:23:35,865][123091] Updated weights for policy 0, policy_version 1477588 (0.0007) [2023-12-26 11:23:35,910][123090] Updated weights for policy 1, policy_version 1467988 (0.0005) [2023-12-26 11:23:35,925][123091] Updated weights for policy 0, policy_version 1477598 (0.0009) [2023-12-26 11:23:35,968][123090] Updated weights for policy 1, policy_version 1467998 (0.0010) [2023-12-26 11:23:35,988][123091] Updated weights for policy 0, policy_version 1477608 (0.0009) [2023-12-26 11:23:36,720][123090] Updated weights for policy 1, policy_version 1468008 (0.0011) [2023-12-26 11:23:36,780][123090] Updated weights for policy 1, policy_version 1468018 (0.0011) [2023-12-26 11:23:36,799][123091] Updated weights for policy 0, policy_version 1477618 (0.0008) [2023-12-26 11:23:36,848][123090] Updated weights for policy 1, policy_version 1468028 (0.0011) [2023-12-26 11:23:36,889][123091] Updated weights for policy 0, policy_version 1477628 (0.0007) [2023-12-26 11:23:36,940][123091] Updated weights for policy 0, policy_version 1477638 (0.0008) [2023-12-26 11:23:36,993][123091] Updated weights for policy 0, policy_version 1477648 (0.0010) [2023-12-26 11:23:37,423][123090] Updated weights for policy 1, policy_version 1468038 (0.0010) [2023-12-26 11:23:37,471][123090] Updated weights for policy 1, policy_version 1468048 (0.0010) [2023-12-26 11:23:37,519][123090] Updated weights for policy 1, policy_version 1468058 (0.0010) [2023-12-26 11:23:37,819][123091] Updated weights for policy 0, policy_version 1477658 (0.0005) [2023-12-26 11:23:37,886][123091] Updated weights for policy 0, policy_version 1477668 (0.0006) [2023-12-26 11:23:37,941][123091] Updated weights for policy 0, policy_version 1477678 (0.0005) [2023-12-26 11:23:38,359][123090] Updated weights for policy 1, policy_version 1468068 (0.0010) [2023-12-26 11:23:38,421][123090] Updated weights for policy 1, policy_version 1468078 (0.0009) [2023-12-26 11:23:38,489][123090] Updated weights for policy 1, policy_version 1468088 (0.0009) [2023-12-26 11:23:38,661][123091] Updated weights for policy 0, policy_version 1477688 (0.0005) [2023-12-26 11:23:38,732][123091] Updated weights for policy 0, policy_version 1477698 (0.0006) [2023-12-26 11:23:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 754122752. Throughput: 0: 9081.7, 1: 8849.6. Samples: 754099532. Policy #0 lag: (min: 22.0, avg: 24.0, max: 54.0) [2023-12-26 11:23:38,785][121949] Avg episode reward: [(0, '6070.300'), (1, '5626.651')] [2023-12-26 11:23:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001468096_375832576.pth... [2023-12-26 11:23:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001467040_375562240.pth [2023-12-26 11:23:38,798][123091] Updated weights for policy 0, policy_version 1477708 (0.0009) [2023-12-26 11:23:38,821][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001477712_378298368.pth... [2023-12-26 11:23:38,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001476624_378019840.pth [2023-12-26 11:23:39,227][123090] Updated weights for policy 1, policy_version 1468098 (0.0009) [2023-12-26 11:23:39,292][123090] Updated weights for policy 1, policy_version 1468108 (0.0006) [2023-12-26 11:23:39,344][123090] Updated weights for policy 1, policy_version 1468118 (0.0009) [2023-12-26 11:23:39,419][123090] Updated weights for policy 1, policy_version 1468128 (0.0009) [2023-12-26 11:23:39,616][123091] Updated weights for policy 0, policy_version 1477718 (0.0011) [2023-12-26 11:23:39,684][123091] Updated weights for policy 0, policy_version 1477728 (0.0011) [2023-12-26 11:23:39,754][123091] Updated weights for policy 0, policy_version 1477738 (0.0011) [2023-12-26 11:23:40,245][123090] Updated weights for policy 1, policy_version 1468138 (0.0011) [2023-12-26 11:23:40,299][123090] Updated weights for policy 1, policy_version 1468148 (0.0009) [2023-12-26 11:23:40,358][123090] Updated weights for policy 1, policy_version 1468158 (0.0010) [2023-12-26 11:23:40,575][123091] Updated weights for policy 0, policy_version 1477748 (0.0011) [2023-12-26 11:23:40,650][123091] Updated weights for policy 0, policy_version 1477758 (0.0011) [2023-12-26 11:23:40,705][123091] Updated weights for policy 0, policy_version 1477768 (0.0010) [2023-12-26 11:23:41,074][123090] Updated weights for policy 1, policy_version 1468168 (0.0012) [2023-12-26 11:23:41,129][123090] Updated weights for policy 1, policy_version 1468178 (0.0009) [2023-12-26 11:23:41,192][123090] Updated weights for policy 1, policy_version 1468188 (0.0008) [2023-12-26 11:23:41,551][123091] Updated weights for policy 0, policy_version 1477778 (0.0011) [2023-12-26 11:23:41,613][123091] Updated weights for policy 0, policy_version 1477788 (0.0010) [2023-12-26 11:23:41,681][123091] Updated weights for policy 0, policy_version 1477798 (0.0008) [2023-12-26 11:23:41,751][123091] Updated weights for policy 0, policy_version 1477808 (0.0009) [2023-12-26 11:23:42,011][123090] Updated weights for policy 1, policy_version 1468198 (0.0009) [2023-12-26 11:23:42,072][123090] Updated weights for policy 1, policy_version 1468208 (0.0010) [2023-12-26 11:23:42,124][123090] Updated weights for policy 1, policy_version 1468218 (0.0010) [2023-12-26 11:23:42,650][123091] Updated weights for policy 0, policy_version 1477818 (0.0009) [2023-12-26 11:23:42,727][123091] Updated weights for policy 0, policy_version 1477828 (0.0009) [2023-12-26 11:23:42,785][123091] Updated weights for policy 0, policy_version 1477838 (0.0010) [2023-12-26 11:23:42,930][123090] Updated weights for policy 1, policy_version 1468228 (0.0010) [2023-12-26 11:23:42,982][123090] Updated weights for policy 1, policy_version 1468238 (0.0009) [2023-12-26 11:23:43,036][123090] Updated weights for policy 1, policy_version 1468248 (0.0010) [2023-12-26 11:23:43,530][123091] Updated weights for policy 0, policy_version 1477848 (0.0006) [2023-12-26 11:23:43,584][123091] Updated weights for policy 0, policy_version 1477858 (0.0005) [2023-12-26 11:23:43,630][123091] Updated weights for policy 0, policy_version 1477868 (0.0005) [2023-12-26 11:23:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 754212864. Throughput: 0: 9045.0, 1: 8910.6. Samples: 754205600. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:23:43,785][121949] Avg episode reward: [(0, '6184.235'), (1, '5672.837')] [2023-12-26 11:23:43,890][123090] Updated weights for policy 1, policy_version 1468258 (0.0008) [2023-12-26 11:23:43,943][123090] Updated weights for policy 1, policy_version 1468268 (0.0005) [2023-12-26 11:23:43,991][123090] Updated weights for policy 1, policy_version 1468278 (0.0005) [2023-12-26 11:23:44,041][123090] Updated weights for policy 1, policy_version 1468288 (0.0005) [2023-12-26 11:23:44,387][123091] Updated weights for policy 0, policy_version 1477878 (0.0008) [2023-12-26 11:23:44,453][123091] Updated weights for policy 0, policy_version 1477888 (0.0009) [2023-12-26 11:23:44,515][123091] Updated weights for policy 0, policy_version 1477898 (0.0009) [2023-12-26 11:23:44,759][123090] Updated weights for policy 1, policy_version 1468298 (0.0009) [2023-12-26 11:23:44,820][123090] Updated weights for policy 1, policy_version 1468308 (0.0007) [2023-12-26 11:23:44,882][123090] Updated weights for policy 1, policy_version 1468318 (0.0007) [2023-12-26 11:23:45,397][123091] Updated weights for policy 0, policy_version 1477909 (0.0010) [2023-12-26 11:23:45,462][123091] Updated weights for policy 0, policy_version 1477919 (0.0010) [2023-12-26 11:23:45,516][123091] Updated weights for policy 0, policy_version 1477929 (0.0009) [2023-12-26 11:23:45,661][123090] Updated weights for policy 1, policy_version 1468328 (0.0009) [2023-12-26 11:23:45,718][123090] Updated weights for policy 1, policy_version 1468338 (0.0009) [2023-12-26 11:23:45,786][123090] Updated weights for policy 1, policy_version 1468348 (0.0007) [2023-12-26 11:23:46,349][123091] Updated weights for policy 0, policy_version 1477939 (0.0008) [2023-12-26 11:23:46,408][123091] Updated weights for policy 0, policy_version 1477949 (0.0005) [2023-12-26 11:23:46,442][123090] Updated weights for policy 1, policy_version 1468358 (0.0005) [2023-12-26 11:23:46,465][123091] Updated weights for policy 0, policy_version 1477959 (0.0008) [2023-12-26 11:23:46,487][123090] Updated weights for policy 1, policy_version 1468368 (0.0005) [2023-12-26 11:23:46,547][123090] Updated weights for policy 1, policy_version 1468378 (0.0005) [2023-12-26 11:23:47,256][123091] Updated weights for policy 0, policy_version 1477969 (0.0009) [2023-12-26 11:23:47,309][123091] Updated weights for policy 0, policy_version 1477979 (0.0010) [2023-12-26 11:23:47,356][123090] Updated weights for policy 1, policy_version 1468388 (0.0007) [2023-12-26 11:23:47,357][123091] Updated weights for policy 0, policy_version 1477989 (0.0009) [2023-12-26 11:23:47,404][123090] Updated weights for policy 1, policy_version 1468398 (0.0006) [2023-12-26 11:23:47,413][123091] Updated weights for policy 0, policy_version 1477999 (0.0010) [2023-12-26 11:23:47,465][123090] Updated weights for policy 1, policy_version 1468408 (0.0005) [2023-12-26 11:23:48,071][123090] Updated weights for policy 1, policy_version 1468418 (0.0005) [2023-12-26 11:23:48,128][123090] Updated weights for policy 1, policy_version 1468428 (0.0007) [2023-12-26 11:23:48,176][123090] Updated weights for policy 1, policy_version 1468438 (0.0009) [2023-12-26 11:23:48,225][123090] Updated weights for policy 1, policy_version 1468448 (0.0009) [2023-12-26 11:23:48,326][123091] Updated weights for policy 0, policy_version 1478009 (0.0009) [2023-12-26 11:23:48,396][123091] Updated weights for policy 0, policy_version 1478019 (0.0010) [2023-12-26 11:23:48,453][123091] Updated weights for policy 0, policy_version 1478029 (0.0010) [2023-12-26 11:23:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 754302976. Throughput: 0: 9019.6, 1: 9002.6. Samples: 754312984. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:23:48,785][121949] Avg episode reward: [(0, '6214.384'), (1, '5637.861')] [2023-12-26 11:23:49,080][123090] Updated weights for policy 1, policy_version 1468458 (0.0009) [2023-12-26 11:23:49,134][123090] Updated weights for policy 1, policy_version 1468468 (0.0009) [2023-12-26 11:23:49,202][123090] Updated weights for policy 1, policy_version 1468478 (0.0009) [2023-12-26 11:23:49,326][123091] Updated weights for policy 0, policy_version 1478039 (0.0009) [2023-12-26 11:23:49,387][123091] Updated weights for policy 0, policy_version 1478049 (0.0008) [2023-12-26 11:23:49,452][123091] Updated weights for policy 0, policy_version 1478059 (0.0008) [2023-12-26 11:23:50,091][123090] Updated weights for policy 1, policy_version 1468488 (0.0009) [2023-12-26 11:23:50,146][123090] Updated weights for policy 1, policy_version 1468498 (0.0010) [2023-12-26 11:23:50,212][123090] Updated weights for policy 1, policy_version 1468508 (0.0010) [2023-12-26 11:23:50,269][123091] Updated weights for policy 0, policy_version 1478069 (0.0009) [2023-12-26 11:23:50,330][123091] Updated weights for policy 0, policy_version 1478079 (0.0009) [2023-12-26 11:23:50,386][123091] Updated weights for policy 0, policy_version 1478089 (0.0008) [2023-12-26 11:23:51,054][123090] Updated weights for policy 1, policy_version 1468518 (0.0008) [2023-12-26 11:23:51,109][123090] Updated weights for policy 1, policy_version 1468528 (0.0010) [2023-12-26 11:23:51,178][123090] Updated weights for policy 1, policy_version 1468538 (0.0010) [2023-12-26 11:23:51,250][123091] Updated weights for policy 0, policy_version 1478099 (0.0010) [2023-12-26 11:23:51,314][123091] Updated weights for policy 0, policy_version 1478109 (0.0007) [2023-12-26 11:23:51,382][123091] Updated weights for policy 0, policy_version 1478119 (0.0008) [2023-12-26 11:23:52,053][123090] Updated weights for policy 1, policy_version 1468548 (0.0010) [2023-12-26 11:23:52,111][123090] Updated weights for policy 1, policy_version 1468558 (0.0010) [2023-12-26 11:23:52,165][123090] Updated weights for policy 1, policy_version 1468568 (0.0009) [2023-12-26 11:23:52,172][123091] Updated weights for policy 0, policy_version 1478129 (0.0008) [2023-12-26 11:23:52,231][123091] Updated weights for policy 0, policy_version 1478139 (0.0008) [2023-12-26 11:23:52,295][123091] Updated weights for policy 0, policy_version 1478149 (0.0009) [2023-12-26 11:23:52,353][123091] Updated weights for policy 0, policy_version 1478159 (0.0009) [2023-12-26 11:23:53,011][123090] Updated weights for policy 1, policy_version 1468578 (0.0010) [2023-12-26 11:23:53,070][123090] Updated weights for policy 1, policy_version 1468589 (0.0009) [2023-12-26 11:23:53,137][123090] Updated weights for policy 1, policy_version 1468599 (0.0009) [2023-12-26 11:23:53,206][123091] Updated weights for policy 0, policy_version 1478169 (0.0010) [2023-12-26 11:23:53,258][123091] Updated weights for policy 0, policy_version 1478179 (0.0009) [2023-12-26 11:23:53,315][123091] Updated weights for policy 0, policy_version 1478189 (0.0009) [2023-12-26 11:23:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 754384896. Throughput: 0: 8959.7, 1: 8984.1. Samples: 754362804. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:23:53,785][121949] Avg episode reward: [(0, '6286.816'), (1, '5668.884')] [2023-12-26 11:23:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001478192_378421248.pth... [2023-12-26 11:23:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001468608_375963648.pth... [2023-12-26 11:23:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001477168_378159104.pth [2023-12-26 11:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001467552_375693312.pth [2023-12-26 11:23:53,928][123090] Updated weights for policy 1, policy_version 1468609 (0.0008) [2023-12-26 11:23:53,998][123090] Updated weights for policy 1, policy_version 1468619 (0.0007) [2023-12-26 11:23:54,063][123090] Updated weights for policy 1, policy_version 1468629 (0.0009) [2023-12-26 11:23:54,127][123090] Updated weights for policy 1, policy_version 1468639 (0.0009) [2023-12-26 11:23:54,168][123091] Updated weights for policy 0, policy_version 1478199 (0.0009) [2023-12-26 11:23:54,223][123091] Updated weights for policy 0, policy_version 1478210 (0.0010) [2023-12-26 11:23:54,272][123091] Updated weights for policy 0, policy_version 1478221 (0.0010) [2023-12-26 11:23:54,929][123090] Updated weights for policy 1, policy_version 1468649 (0.0009) [2023-12-26 11:23:55,000][123090] Updated weights for policy 1, policy_version 1468659 (0.0010) [2023-12-26 11:23:55,061][123090] Updated weights for policy 1, policy_version 1468669 (0.0009) [2023-12-26 11:23:55,161][123091] Updated weights for policy 0, policy_version 1478231 (0.0010) [2023-12-26 11:23:55,220][123091] Updated weights for policy 0, policy_version 1478241 (0.0009) [2023-12-26 11:23:55,277][123091] Updated weights for policy 0, policy_version 1478251 (0.0009) [2023-12-26 11:23:55,891][123090] Updated weights for policy 1, policy_version 1468679 (0.0009) [2023-12-26 11:23:55,943][123090] Updated weights for policy 1, policy_version 1468689 (0.0010) [2023-12-26 11:23:55,997][123090] Updated weights for policy 1, policy_version 1468699 (0.0009) [2023-12-26 11:23:56,115][123091] Updated weights for policy 0, policy_version 1478261 (0.0009) [2023-12-26 11:23:56,162][123091] Updated weights for policy 0, policy_version 1478271 (0.0008) [2023-12-26 11:23:56,210][123091] Updated weights for policy 0, policy_version 1478281 (0.0009) [2023-12-26 11:23:56,855][123090] Updated weights for policy 1, policy_version 1468709 (0.0010) [2023-12-26 11:23:56,918][123090] Updated weights for policy 1, policy_version 1468719 (0.0010) [2023-12-26 11:23:56,975][123090] Updated weights for policy 1, policy_version 1468729 (0.0010) [2023-12-26 11:23:57,002][123091] Updated weights for policy 0, policy_version 1478292 (0.0008) [2023-12-26 11:23:57,055][123091] Updated weights for policy 0, policy_version 1478302 (0.0007) [2023-12-26 11:23:57,117][123091] Updated weights for policy 0, policy_version 1478312 (0.0006) [2023-12-26 11:23:57,782][123091] Updated weights for policy 0, policy_version 1478322 (0.0005) [2023-12-26 11:23:57,841][123091] Updated weights for policy 0, policy_version 1478332 (0.0005) [2023-12-26 11:23:57,894][123091] Updated weights for policy 0, policy_version 1478342 (0.0005) [2023-12-26 11:23:57,899][123090] Updated weights for policy 1, policy_version 1468739 (0.0007) [2023-12-26 11:23:57,942][123091] Updated weights for policy 0, policy_version 1478352 (0.0005) [2023-12-26 11:23:57,946][123090] Updated weights for policy 1, policy_version 1468749 (0.0008) [2023-12-26 11:23:58,012][123090] Updated weights for policy 1, policy_version 1468759 (0.0009) [2023-12-26 11:23:58,756][123091] Updated weights for policy 0, policy_version 1478362 (0.0009) [2023-12-26 11:23:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 754466816. Throughput: 0: 8993.1, 1: 8943.6. Samples: 754465932. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:23:58,785][121949] Avg episode reward: [(0, '6291.283'), (1, '5457.561')] [2023-12-26 11:23:58,811][123091] Updated weights for policy 0, policy_version 1478372 (0.0008) [2023-12-26 11:23:58,863][123091] Updated weights for policy 0, policy_version 1478382 (0.0007) [2023-12-26 11:23:59,016][123090] Updated weights for policy 1, policy_version 1468769 (0.0010) [2023-12-26 11:23:59,080][123090] Updated weights for policy 1, policy_version 1468779 (0.0009) [2023-12-26 11:23:59,148][123090] Updated weights for policy 1, policy_version 1468789 (0.0009) [2023-12-26 11:23:59,206][123090] Updated weights for policy 1, policy_version 1468799 (0.0009) [2023-12-26 11:23:59,635][123091] Updated weights for policy 0, policy_version 1478392 (0.0006) [2023-12-26 11:23:59,693][123091] Updated weights for policy 0, policy_version 1478402 (0.0005) [2023-12-26 11:23:59,752][123091] Updated weights for policy 0, policy_version 1478412 (0.0005) [2023-12-26 11:24:00,046][123090] Updated weights for policy 1, policy_version 1468809 (0.0009) [2023-12-26 11:24:00,109][123090] Updated weights for policy 1, policy_version 1468819 (0.0009) [2023-12-26 11:24:00,178][123090] Updated weights for policy 1, policy_version 1468829 (0.0009) [2023-12-26 11:24:00,483][123091] Updated weights for policy 0, policy_version 1478422 (0.0008) [2023-12-26 11:24:00,541][123091] Updated weights for policy 0, policy_version 1478432 (0.0008) [2023-12-26 11:24:00,597][123091] Updated weights for policy 0, policy_version 1478442 (0.0009) [2023-12-26 11:24:00,954][123090] Updated weights for policy 1, policy_version 1468839 (0.0010) [2023-12-26 11:24:01,003][123090] Updated weights for policy 1, policy_version 1468849 (0.0009) [2023-12-26 11:24:01,067][123090] Updated weights for policy 1, policy_version 1468859 (0.0008) [2023-12-26 11:24:01,463][123091] Updated weights for policy 0, policy_version 1478452 (0.0008) [2023-12-26 11:24:01,524][123091] Updated weights for policy 0, policy_version 1478462 (0.0006) [2023-12-26 11:24:01,583][123091] Updated weights for policy 0, policy_version 1478472 (0.0005) [2023-12-26 11:24:01,889][123090] Updated weights for policy 1, policy_version 1468869 (0.0008) [2023-12-26 11:24:01,948][123090] Updated weights for policy 1, policy_version 1468879 (0.0009) [2023-12-26 11:24:02,004][123090] Updated weights for policy 1, policy_version 1468889 (0.0009) [2023-12-26 11:24:02,375][123091] Updated weights for policy 0, policy_version 1478482 (0.0008) [2023-12-26 11:24:02,443][123091] Updated weights for policy 0, policy_version 1478492 (0.0009) [2023-12-26 11:24:02,506][123091] Updated weights for policy 0, policy_version 1478502 (0.0009) [2023-12-26 11:24:02,558][123091] Updated weights for policy 0, policy_version 1478512 (0.0009) [2023-12-26 11:24:02,802][123090] Updated weights for policy 1, policy_version 1468900 (0.0010) [2023-12-26 11:24:02,862][123090] Updated weights for policy 1, policy_version 1468910 (0.0008) [2023-12-26 11:24:02,911][123090] Updated weights for policy 1, policy_version 1468920 (0.0008) [2023-12-26 11:24:03,470][123091] Updated weights for policy 0, policy_version 1478522 (0.0005) [2023-12-26 11:24:03,545][123091] Updated weights for policy 0, policy_version 1478532 (0.0005) [2023-12-26 11:24:03,603][123091] Updated weights for policy 0, policy_version 1478542 (0.0005) [2023-12-26 11:24:03,655][123090] Updated weights for policy 1, policy_version 1468930 (0.0006) [2023-12-26 11:24:03,712][123090] Updated weights for policy 1, policy_version 1468940 (0.0008) [2023-12-26 11:24:03,760][123090] Updated weights for policy 1, policy_version 1468950 (0.0009) [2023-12-26 11:24:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 754556928. Throughput: 0: 8874.3, 1: 8973.5. Samples: 754570552. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:03,785][121949] Avg episode reward: [(0, '6374.809'), (1, '5329.762')] [2023-12-26 11:24:03,814][123090] Updated weights for policy 1, policy_version 1468960 (0.0008) [2023-12-26 11:24:04,308][123091] Updated weights for policy 0, policy_version 1478552 (0.0009) [2023-12-26 11:24:04,371][123091] Updated weights for policy 0, policy_version 1478562 (0.0010) [2023-12-26 11:24:04,440][123091] Updated weights for policy 0, policy_version 1478572 (0.0009) [2023-12-26 11:24:04,658][123090] Updated weights for policy 1, policy_version 1468970 (0.0009) [2023-12-26 11:24:04,714][123090] Updated weights for policy 1, policy_version 1468980 (0.0009) [2023-12-26 11:24:04,779][123090] Updated weights for policy 1, policy_version 1468990 (0.0009) [2023-12-26 11:24:05,189][123091] Updated weights for policy 0, policy_version 1478582 (0.0007) [2023-12-26 11:24:05,257][123091] Updated weights for policy 0, policy_version 1478592 (0.0006) [2023-12-26 11:24:05,302][123091] Updated weights for policy 0, policy_version 1478602 (0.0005) [2023-12-26 11:24:05,667][123090] Updated weights for policy 1, policy_version 1469000 (0.0008) [2023-12-26 11:24:05,730][123090] Updated weights for policy 1, policy_version 1469010 (0.0009) [2023-12-26 11:24:05,798][123090] Updated weights for policy 1, policy_version 1469020 (0.0009) [2023-12-26 11:24:06,028][123091] Updated weights for policy 0, policy_version 1478612 (0.0008) [2023-12-26 11:24:06,092][123091] Updated weights for policy 0, policy_version 1478622 (0.0011) [2023-12-26 11:24:06,162][123091] Updated weights for policy 0, policy_version 1478632 (0.0010) [2023-12-26 11:24:06,721][123090] Updated weights for policy 1, policy_version 1469030 (0.0010) [2023-12-26 11:24:06,771][123090] Updated weights for policy 1, policy_version 1469040 (0.0009) [2023-12-26 11:24:06,827][123090] Updated weights for policy 1, policy_version 1469050 (0.0009) [2023-12-26 11:24:06,961][123091] Updated weights for policy 0, policy_version 1478642 (0.0009) [2023-12-26 11:24:07,009][123091] Updated weights for policy 0, policy_version 1478652 (0.0010) [2023-12-26 11:24:07,068][123091] Updated weights for policy 0, policy_version 1478662 (0.0010) [2023-12-26 11:24:07,127][123091] Updated weights for policy 0, policy_version 1478672 (0.0010) [2023-12-26 11:24:07,657][123090] Updated weights for policy 1, policy_version 1469060 (0.0009) [2023-12-26 11:24:07,713][123090] Updated weights for policy 1, policy_version 1469070 (0.0008) [2023-12-26 11:24:07,767][123090] Updated weights for policy 1, policy_version 1469080 (0.0005) [2023-12-26 11:24:07,918][123091] Updated weights for policy 0, policy_version 1478682 (0.0006) [2023-12-26 11:24:07,980][123091] Updated weights for policy 0, policy_version 1478692 (0.0006) [2023-12-26 11:24:08,052][123091] Updated weights for policy 0, policy_version 1478702 (0.0007) [2023-12-26 11:24:08,543][123090] Updated weights for policy 1, policy_version 1469090 (0.0006) [2023-12-26 11:24:08,614][123090] Updated weights for policy 1, policy_version 1469100 (0.0010) [2023-12-26 11:24:08,670][123090] Updated weights for policy 1, policy_version 1469110 (0.0010) [2023-12-26 11:24:08,728][123090] Updated weights for policy 1, policy_version 1469120 (0.0010) [2023-12-26 11:24:08,784][123091] Updated weights for policy 0, policy_version 1478712 (0.0009) [2023-12-26 11:24:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 754647040. Throughput: 0: 8890.1, 1: 8945.9. Samples: 754622176. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:08,785][121949] Avg episode reward: [(0, '6396.547'), (1, '5419.203')] [2023-12-26 11:24:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001469120_376094720.pth... [2023-12-26 11:24:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001468096_375832576.pth [2023-12-26 11:24:08,853][123091] Updated weights for policy 0, policy_version 1478722 (0.0006) [2023-12-26 11:24:08,928][123091] Updated weights for policy 0, policy_version 1478732 (0.0005) [2023-12-26 11:24:08,961][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001478736_378560512.pth... [2023-12-26 11:24:08,966][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001477712_378298368.pth [2023-12-26 11:24:09,609][123090] Updated weights for policy 1, policy_version 1469130 (0.0009) [2023-12-26 11:24:09,674][123090] Updated weights for policy 1, policy_version 1469140 (0.0009) [2023-12-26 11:24:09,718][123091] Updated weights for policy 0, policy_version 1478742 (0.0009) [2023-12-26 11:24:09,740][123090] Updated weights for policy 1, policy_version 1469150 (0.0007) [2023-12-26 11:24:09,794][123091] Updated weights for policy 0, policy_version 1478752 (0.0011) [2023-12-26 11:24:09,860][123091] Updated weights for policy 0, policy_version 1478762 (0.0009) [2023-12-26 11:24:10,517][123090] Updated weights for policy 1, policy_version 1469160 (0.0008) [2023-12-26 11:24:10,571][123090] Updated weights for policy 1, policy_version 1469170 (0.0006) [2023-12-26 11:24:10,615][123091] Updated weights for policy 0, policy_version 1478772 (0.0009) [2023-12-26 11:24:10,623][123090] Updated weights for policy 1, policy_version 1469180 (0.0005) [2023-12-26 11:24:10,667][123091] Updated weights for policy 0, policy_version 1478782 (0.0010) [2023-12-26 11:24:10,730][123091] Updated weights for policy 0, policy_version 1478792 (0.0011) [2023-12-26 11:24:11,321][123090] Updated weights for policy 1, policy_version 1469190 (0.0006) [2023-12-26 11:24:11,407][123090] Updated weights for policy 1, policy_version 1469200 (0.0008) [2023-12-26 11:24:11,474][123090] Updated weights for policy 1, policy_version 1469210 (0.0008) [2023-12-26 11:24:11,620][123091] Updated weights for policy 0, policy_version 1478802 (0.0011) [2023-12-26 11:24:11,688][123091] Updated weights for policy 0, policy_version 1478812 (0.0011) [2023-12-26 11:24:11,761][123091] Updated weights for policy 0, policy_version 1478822 (0.0011) [2023-12-26 11:24:11,831][123091] Updated weights for policy 0, policy_version 1478832 (0.0009) [2023-12-26 11:24:12,313][123090] Updated weights for policy 1, policy_version 1469220 (0.0008) [2023-12-26 11:24:12,379][123090] Updated weights for policy 1, policy_version 1469230 (0.0009) [2023-12-26 11:24:12,450][123090] Updated weights for policy 1, policy_version 1469240 (0.0008) [2023-12-26 11:24:12,588][123091] Updated weights for policy 0, policy_version 1478842 (0.0005) [2023-12-26 11:24:12,649][123091] Updated weights for policy 0, policy_version 1478852 (0.0007) [2023-12-26 11:24:12,704][123091] Updated weights for policy 0, policy_version 1478862 (0.0008) [2023-12-26 11:24:13,205][123090] Updated weights for policy 1, policy_version 1469250 (0.0009) [2023-12-26 11:24:13,272][123090] Updated weights for policy 1, policy_version 1469260 (0.0010) [2023-12-26 11:24:13,335][123090] Updated weights for policy 1, policy_version 1469270 (0.0010) [2023-12-26 11:24:13,400][123090] Updated weights for policy 1, policy_version 1469280 (0.0010) [2023-12-26 11:24:13,515][123091] Updated weights for policy 0, policy_version 1478872 (0.0007) [2023-12-26 11:24:13,580][123091] Updated weights for policy 0, policy_version 1478882 (0.0005) [2023-12-26 11:24:13,637][123091] Updated weights for policy 0, policy_version 1478892 (0.0006) [2023-12-26 11:24:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 754737152. Throughput: 0: 8803.0, 1: 8811.9. Samples: 754727740. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:13,785][121949] Avg episode reward: [(0, '6252.055'), (1, '5436.084')] [2023-12-26 11:24:14,257][123090] Updated weights for policy 1, policy_version 1469290 (0.0010) [2023-12-26 11:24:14,287][123091] Updated weights for policy 0, policy_version 1478902 (0.0008) [2023-12-26 11:24:14,327][123090] Updated weights for policy 1, policy_version 1469300 (0.0008) [2023-12-26 11:24:14,337][123091] Updated weights for policy 0, policy_version 1478912 (0.0010) [2023-12-26 11:24:14,391][123091] Updated weights for policy 0, policy_version 1478922 (0.0008) [2023-12-26 11:24:14,393][123090] Updated weights for policy 1, policy_version 1469310 (0.0008) [2023-12-26 11:24:15,198][123090] Updated weights for policy 1, policy_version 1469320 (0.0006) [2023-12-26 11:24:15,272][123090] Updated weights for policy 1, policy_version 1469330 (0.0006) [2023-12-26 11:24:15,290][123091] Updated weights for policy 0, policy_version 1478932 (0.0009) [2023-12-26 11:24:15,345][123090] Updated weights for policy 1, policy_version 1469340 (0.0006) [2023-12-26 11:24:15,359][123091] Updated weights for policy 0, policy_version 1478942 (0.0008) [2023-12-26 11:24:15,419][123091] Updated weights for policy 0, policy_version 1478952 (0.0006) [2023-12-26 11:24:16,115][123090] Updated weights for policy 1, policy_version 1469350 (0.0009) [2023-12-26 11:24:16,123][123091] Updated weights for policy 0, policy_version 1478962 (0.0006) [2023-12-26 11:24:16,168][123090] Updated weights for policy 1, policy_version 1469360 (0.0007) [2023-12-26 11:24:16,186][123091] Updated weights for policy 0, policy_version 1478972 (0.0010) [2023-12-26 11:24:16,218][123090] Updated weights for policy 1, policy_version 1469370 (0.0008) [2023-12-26 11:24:16,246][123091] Updated weights for policy 0, policy_version 1478982 (0.0007) [2023-12-26 11:24:16,302][123091] Updated weights for policy 0, policy_version 1478992 (0.0010) [2023-12-26 11:24:16,930][123090] Updated weights for policy 1, policy_version 1469380 (0.0008) [2023-12-26 11:24:16,985][123090] Updated weights for policy 1, policy_version 1469390 (0.0005) [2023-12-26 11:24:17,043][123090] Updated weights for policy 1, policy_version 1469400 (0.0005) [2023-12-26 11:24:17,160][123091] Updated weights for policy 0, policy_version 1479002 (0.0010) [2023-12-26 11:24:17,209][123091] Updated weights for policy 0, policy_version 1479013 (0.0010) [2023-12-26 11:24:17,256][123091] Updated weights for policy 0, policy_version 1479023 (0.0010) [2023-12-26 11:24:17,768][123090] Updated weights for policy 1, policy_version 1469410 (0.0006) [2023-12-26 11:24:17,827][123090] Updated weights for policy 1, policy_version 1469420 (0.0009) [2023-12-26 11:24:17,894][123090] Updated weights for policy 1, policy_version 1469430 (0.0010) [2023-12-26 11:24:17,952][123090] Updated weights for policy 1, policy_version 1469440 (0.0010) [2023-12-26 11:24:18,082][123091] Updated weights for policy 0, policy_version 1479033 (0.0010) [2023-12-26 11:24:18,138][123091] Updated weights for policy 0, policy_version 1479043 (0.0009) [2023-12-26 11:24:18,209][123091] Updated weights for policy 0, policy_version 1479053 (0.0009) [2023-12-26 11:24:18,737][123090] Updated weights for policy 1, policy_version 1469450 (0.0006) [2023-12-26 11:24:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 754819072. Throughput: 0: 8726.8, 1: 8751.2. Samples: 754833360. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:18,785][121949] Avg episode reward: [(0, '6037.136'), (1, '5514.226')] [2023-12-26 11:24:18,798][123090] Updated weights for policy 1, policy_version 1469460 (0.0006) [2023-12-26 11:24:18,860][123090] Updated weights for policy 1, policy_version 1469470 (0.0007) [2023-12-26 11:24:19,137][123091] Updated weights for policy 0, policy_version 1479063 (0.0009) [2023-12-26 11:24:19,205][123091] Updated weights for policy 0, policy_version 1479073 (0.0010) [2023-12-26 11:24:19,272][123091] Updated weights for policy 0, policy_version 1479083 (0.0009) [2023-12-26 11:24:19,607][123090] Updated weights for policy 1, policy_version 1469480 (0.0005) [2023-12-26 11:24:19,678][123090] Updated weights for policy 1, policy_version 1469490 (0.0005) [2023-12-26 11:24:19,751][123090] Updated weights for policy 1, policy_version 1469500 (0.0005) [2023-12-26 11:24:20,150][123091] Updated weights for policy 0, policy_version 1479093 (0.0010) [2023-12-26 11:24:20,218][123091] Updated weights for policy 0, policy_version 1479103 (0.0011) [2023-12-26 11:24:20,285][123091] Updated weights for policy 0, policy_version 1479113 (0.0011) [2023-12-26 11:24:20,520][123090] Updated weights for policy 1, policy_version 1469510 (0.0007) [2023-12-26 11:24:20,584][123090] Updated weights for policy 1, policy_version 1469520 (0.0009) [2023-12-26 11:24:20,648][123090] Updated weights for policy 1, policy_version 1469530 (0.0009) [2023-12-26 11:24:21,110][123091] Updated weights for policy 0, policy_version 1479123 (0.0011) [2023-12-26 11:24:21,176][123091] Updated weights for policy 0, policy_version 1479133 (0.0011) [2023-12-26 11:24:21,228][123091] Updated weights for policy 0, policy_version 1479143 (0.0010) [2023-12-26 11:24:21,531][123090] Updated weights for policy 1, policy_version 1469540 (0.0009) [2023-12-26 11:24:21,596][123090] Updated weights for policy 1, policy_version 1469550 (0.0009) [2023-12-26 11:24:21,662][123090] Updated weights for policy 1, policy_version 1469560 (0.0009) [2023-12-26 11:24:22,101][123091] Updated weights for policy 0, policy_version 1479153 (0.0011) [2023-12-26 11:24:22,168][123091] Updated weights for policy 0, policy_version 1479163 (0.0011) [2023-12-26 11:24:22,224][123091] Updated weights for policy 0, policy_version 1479173 (0.0011) [2023-12-26 11:24:22,283][123091] Updated weights for policy 0, policy_version 1479183 (0.0011) [2023-12-26 11:24:22,530][123090] Updated weights for policy 1, policy_version 1469570 (0.0009) [2023-12-26 11:24:22,595][123090] Updated weights for policy 1, policy_version 1469580 (0.0009) [2023-12-26 11:24:22,648][123090] Updated weights for policy 1, policy_version 1469590 (0.0009) [2023-12-26 11:24:22,705][123090] Updated weights for policy 1, policy_version 1469600 (0.0009) [2023-12-26 11:24:23,066][123091] Updated weights for policy 0, policy_version 1479193 (0.0008) [2023-12-26 11:24:23,137][123091] Updated weights for policy 0, policy_version 1479203 (0.0005) [2023-12-26 11:24:23,195][123091] Updated weights for policy 0, policy_version 1479213 (0.0005) [2023-12-26 11:24:23,604][123090] Updated weights for policy 1, policy_version 1469610 (0.0009) [2023-12-26 11:24:23,659][123090] Updated weights for policy 1, policy_version 1469620 (0.0009) [2023-12-26 11:24:23,712][123090] Updated weights for policy 1, policy_version 1469630 (0.0009) [2023-12-26 11:24:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 754909184. Throughput: 0: 8689.3, 1: 8758.1. Samples: 754884664. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:23,786][121949] Avg episode reward: [(0, '6031.634'), (1, '5602.961')] [2023-12-26 11:24:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001469632_376225792.pth... [2023-12-26 11:24:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001468608_375963648.pth [2023-12-26 11:24:23,840][123091] Updated weights for policy 0, policy_version 1479223 (0.0008) [2023-12-26 11:24:23,896][123091] Updated weights for policy 0, policy_version 1479233 (0.0009) [2023-12-26 11:24:23,950][123091] Updated weights for policy 0, policy_version 1479243 (0.0010) [2023-12-26 11:24:23,981][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001479248_378691584.pth... [2023-12-26 11:24:23,985][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001478192_378421248.pth [2023-12-26 11:24:24,552][123090] Updated weights for policy 1, policy_version 1469640 (0.0007) [2023-12-26 11:24:24,614][123090] Updated weights for policy 1, policy_version 1469650 (0.0005) [2023-12-26 11:24:24,683][123090] Updated weights for policy 1, policy_version 1469660 (0.0005) [2023-12-26 11:24:24,783][123091] Updated weights for policy 0, policy_version 1479253 (0.0007) [2023-12-26 11:24:24,844][123091] Updated weights for policy 0, policy_version 1479263 (0.0005) [2023-12-26 11:24:24,908][123091] Updated weights for policy 0, policy_version 1479273 (0.0005) [2023-12-26 11:24:25,405][123090] Updated weights for policy 1, policy_version 1469670 (0.0005) [2023-12-26 11:24:25,452][123090] Updated weights for policy 1, policy_version 1469680 (0.0008) [2023-12-26 11:24:25,502][123090] Updated weights for policy 1, policy_version 1469690 (0.0008) [2023-12-26 11:24:25,684][123091] Updated weights for policy 0, policy_version 1479283 (0.0006) [2023-12-26 11:24:25,744][123091] Updated weights for policy 0, policy_version 1479293 (0.0009) [2023-12-26 11:24:25,805][123091] Updated weights for policy 0, policy_version 1479303 (0.0009) [2023-12-26 11:24:26,199][123090] Updated weights for policy 1, policy_version 1469700 (0.0008) [2023-12-26 11:24:26,266][123090] Updated weights for policy 1, policy_version 1469710 (0.0006) [2023-12-26 11:24:26,341][123090] Updated weights for policy 1, policy_version 1469720 (0.0006) [2023-12-26 11:24:26,551][123091] Updated weights for policy 0, policy_version 1479313 (0.0009) [2023-12-26 11:24:26,606][123091] Updated weights for policy 0, policy_version 1479323 (0.0006) [2023-12-26 11:24:26,658][123091] Updated weights for policy 0, policy_version 1479333 (0.0005) [2023-12-26 11:24:26,705][123091] Updated weights for policy 0, policy_version 1479343 (0.0005) [2023-12-26 11:24:26,964][123090] Updated weights for policy 1, policy_version 1469730 (0.0005) [2023-12-26 11:24:27,023][123090] Updated weights for policy 1, policy_version 1469740 (0.0006) [2023-12-26 11:24:27,089][123090] Updated weights for policy 1, policy_version 1469750 (0.0005) [2023-12-26 11:24:27,156][123090] Updated weights for policy 1, policy_version 1469760 (0.0005) [2023-12-26 11:24:27,400][123091] Updated weights for policy 0, policy_version 1479353 (0.0005) [2023-12-26 11:24:27,455][123091] Updated weights for policy 0, policy_version 1479363 (0.0005) [2023-12-26 11:24:27,505][123091] Updated weights for policy 0, policy_version 1479373 (0.0009) [2023-12-26 11:24:27,812][123090] Updated weights for policy 1, policy_version 1469770 (0.0005) [2023-12-26 11:24:27,871][123090] Updated weights for policy 1, policy_version 1469780 (0.0005) [2023-12-26 11:24:27,941][123090] Updated weights for policy 1, policy_version 1469790 (0.0005) [2023-12-26 11:24:28,250][123091] Updated weights for policy 0, policy_version 1479383 (0.0010) [2023-12-26 11:24:28,294][123091] Updated weights for policy 0, policy_version 1479393 (0.0010) [2023-12-26 11:24:28,353][123091] Updated weights for policy 0, policy_version 1479403 (0.0010) [2023-12-26 11:24:28,595][123090] Updated weights for policy 1, policy_version 1469800 (0.0005) [2023-12-26 11:24:28,664][123090] Updated weights for policy 1, policy_version 1469810 (0.0006) [2023-12-26 11:24:28,724][123090] Updated weights for policy 1, policy_version 1469820 (0.0005) [2023-12-26 11:24:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 755007488. Throughput: 0: 8789.4, 1: 8755.8. Samples: 754995136. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:28,784][121949] Avg episode reward: [(0, '6346.723'), (1, '5464.149')] [2023-12-26 11:24:29,202][123091] Updated weights for policy 0, policy_version 1479413 (0.0011) [2023-12-26 11:24:29,277][123091] Updated weights for policy 0, policy_version 1479423 (0.0010) [2023-12-26 11:24:29,320][123090] Updated weights for policy 1, policy_version 1469830 (0.0008) [2023-12-26 11:24:29,342][123091] Updated weights for policy 0, policy_version 1479433 (0.0010) [2023-12-26 11:24:29,389][123090] Updated weights for policy 1, policy_version 1469840 (0.0009) [2023-12-26 11:24:29,437][123090] Updated weights for policy 1, policy_version 1469850 (0.0009) [2023-12-26 11:24:30,143][123091] Updated weights for policy 0, policy_version 1479443 (0.0009) [2023-12-26 11:24:30,208][123091] Updated weights for policy 0, policy_version 1479453 (0.0008) [2023-12-26 11:24:30,274][123091] Updated weights for policy 0, policy_version 1479463 (0.0009) [2023-12-26 11:24:30,319][123090] Updated weights for policy 1, policy_version 1469860 (0.0009) [2023-12-26 11:24:30,375][123090] Updated weights for policy 1, policy_version 1469870 (0.0010) [2023-12-26 11:24:30,426][123090] Updated weights for policy 1, policy_version 1469880 (0.0010) [2023-12-26 11:24:31,037][123091] Updated weights for policy 0, policy_version 1479473 (0.0007) [2023-12-26 11:24:31,105][123091] Updated weights for policy 0, policy_version 1479483 (0.0008) [2023-12-26 11:24:31,136][123090] Updated weights for policy 1, policy_version 1469890 (0.0009) [2023-12-26 11:24:31,160][123091] Updated weights for policy 0, policy_version 1479493 (0.0009) [2023-12-26 11:24:31,197][123090] Updated weights for policy 1, policy_version 1469900 (0.0009) [2023-12-26 11:24:31,217][123091] Updated weights for policy 0, policy_version 1479503 (0.0008) [2023-12-26 11:24:31,255][123090] Updated weights for policy 1, policy_version 1469910 (0.0010) [2023-12-26 11:24:31,306][123090] Updated weights for policy 1, policy_version 1469920 (0.0009) [2023-12-26 11:24:32,024][123091] Updated weights for policy 0, policy_version 1479513 (0.0010) [2023-12-26 11:24:32,088][123091] Updated weights for policy 0, policy_version 1479523 (0.0010) [2023-12-26 11:24:32,149][123091] Updated weights for policy 0, policy_version 1479533 (0.0007) [2023-12-26 11:24:32,154][123090] Updated weights for policy 1, policy_version 1469930 (0.0009) [2023-12-26 11:24:32,214][123090] Updated weights for policy 1, policy_version 1469940 (0.0008) [2023-12-26 11:24:32,270][123090] Updated weights for policy 1, policy_version 1469950 (0.0009) [2023-12-26 11:24:32,933][123091] Updated weights for policy 0, policy_version 1479543 (0.0007) [2023-12-26 11:24:32,986][123091] Updated weights for policy 0, policy_version 1479553 (0.0005) [2023-12-26 11:24:33,046][123091] Updated weights for policy 0, policy_version 1479563 (0.0010) [2023-12-26 11:24:33,128][123090] Updated weights for policy 1, policy_version 1469960 (0.0009) [2023-12-26 11:24:33,195][123090] Updated weights for policy 1, policy_version 1469970 (0.0009) [2023-12-26 11:24:33,254][123090] Updated weights for policy 1, policy_version 1469980 (0.0010) [2023-12-26 11:24:33,712][123091] Updated weights for policy 0, policy_version 1479573 (0.0007) [2023-12-26 11:24:33,756][123091] Updated weights for policy 0, policy_version 1479583 (0.0005) [2023-12-26 11:24:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 755089408. Throughput: 0: 8858.6, 1: 8728.9. Samples: 755104420. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:33,785][121949] Avg episode reward: [(0, '6235.716'), (1, '5282.792')] [2023-12-26 11:24:33,805][123091] Updated weights for policy 0, policy_version 1479593 (0.0007) [2023-12-26 11:24:34,175][123090] Updated weights for policy 1, policy_version 1469990 (0.0008) [2023-12-26 11:24:34,245][123090] Updated weights for policy 1, policy_version 1470000 (0.0008) [2023-12-26 11:24:34,306][123090] Updated weights for policy 1, policy_version 1470010 (0.0006) [2023-12-26 11:24:34,544][123091] Updated weights for policy 0, policy_version 1479603 (0.0009) [2023-12-26 11:24:34,608][123091] Updated weights for policy 0, policy_version 1479613 (0.0010) [2023-12-26 11:24:34,674][123091] Updated weights for policy 0, policy_version 1479623 (0.0010) [2023-12-26 11:24:35,107][123090] Updated weights for policy 1, policy_version 1470020 (0.0010) [2023-12-26 11:24:35,169][123090] Updated weights for policy 1, policy_version 1470030 (0.0009) [2023-12-26 11:24:35,228][123090] Updated weights for policy 1, policy_version 1470040 (0.0009) [2023-12-26 11:24:35,512][123091] Updated weights for policy 0, policy_version 1479633 (0.0010) [2023-12-26 11:24:35,566][123091] Updated weights for policy 0, policy_version 1479643 (0.0010) [2023-12-26 11:24:35,615][123091] Updated weights for policy 0, policy_version 1479653 (0.0009) [2023-12-26 11:24:35,664][123091] Updated weights for policy 0, policy_version 1479663 (0.0010) [2023-12-26 11:24:36,077][123090] Updated weights for policy 1, policy_version 1470050 (0.0009) [2023-12-26 11:24:36,149][123090] Updated weights for policy 1, policy_version 1470060 (0.0009) [2023-12-26 11:24:36,215][123090] Updated weights for policy 1, policy_version 1470070 (0.0009) [2023-12-26 11:24:36,277][123090] Updated weights for policy 1, policy_version 1470080 (0.0009) [2023-12-26 11:24:36,432][123091] Updated weights for policy 0, policy_version 1479673 (0.0010) [2023-12-26 11:24:36,489][123091] Updated weights for policy 0, policy_version 1479683 (0.0010) [2023-12-26 11:24:36,542][123091] Updated weights for policy 0, policy_version 1479693 (0.0010) [2023-12-26 11:24:37,151][123090] Updated weights for policy 1, policy_version 1470090 (0.0009) [2023-12-26 11:24:37,209][123090] Updated weights for policy 1, policy_version 1470101 (0.0009) [2023-12-26 11:24:37,270][123090] Updated weights for policy 1, policy_version 1470111 (0.0010) [2023-12-26 11:24:37,363][123091] Updated weights for policy 0, policy_version 1479703 (0.0010) [2023-12-26 11:24:37,426][123091] Updated weights for policy 0, policy_version 1479713 (0.0009) [2023-12-26 11:24:37,490][123091] Updated weights for policy 0, policy_version 1479723 (0.0009) [2023-12-26 11:24:38,086][123090] Updated weights for policy 1, policy_version 1470121 (0.0005) [2023-12-26 11:24:38,141][123090] Updated weights for policy 1, policy_version 1470131 (0.0005) [2023-12-26 11:24:38,192][123090] Updated weights for policy 1, policy_version 1470141 (0.0006) [2023-12-26 11:24:38,270][123091] Updated weights for policy 0, policy_version 1479733 (0.0007) [2023-12-26 11:24:38,343][123091] Updated weights for policy 0, policy_version 1479743 (0.0010) [2023-12-26 11:24:38,411][123091] Updated weights for policy 0, policy_version 1479753 (0.0010) [2023-12-26 11:24:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 755179520. Throughput: 0: 8895.0, 1: 8735.8. Samples: 755156192. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:38,785][121949] Avg episode reward: [(0, '6087.410'), (1, '5154.966')] [2023-12-26 11:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001479760_378822656.pth... [2023-12-26 11:24:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001470144_376356864.pth... [2023-12-26 11:24:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001478736_378560512.pth [2023-12-26 11:24:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001469120_376094720.pth [2023-12-26 11:24:38,984][123090] Updated weights for policy 1, policy_version 1470151 (0.0008) [2023-12-26 11:24:39,051][123090] Updated weights for policy 1, policy_version 1470161 (0.0009) [2023-12-26 11:24:39,107][123090] Updated weights for policy 1, policy_version 1470171 (0.0008) [2023-12-26 11:24:39,212][123091] Updated weights for policy 0, policy_version 1479763 (0.0010) [2023-12-26 11:24:39,289][123091] Updated weights for policy 0, policy_version 1479773 (0.0007) [2023-12-26 11:24:39,350][123091] Updated weights for policy 0, policy_version 1479783 (0.0008) [2023-12-26 11:24:40,012][123090] Updated weights for policy 1, policy_version 1470181 (0.0009) [2023-12-26 11:24:40,064][123091] Updated weights for policy 0, policy_version 1479793 (0.0008) [2023-12-26 11:24:40,085][123090] Updated weights for policy 1, policy_version 1470191 (0.0009) [2023-12-26 11:24:40,120][123091] Updated weights for policy 0, policy_version 1479803 (0.0007) [2023-12-26 11:24:40,147][123090] Updated weights for policy 1, policy_version 1470201 (0.0009) [2023-12-26 11:24:40,173][123091] Updated weights for policy 0, policy_version 1479813 (0.0008) [2023-12-26 11:24:40,228][123091] Updated weights for policy 0, policy_version 1479823 (0.0010) [2023-12-26 11:24:40,973][123091] Updated weights for policy 0, policy_version 1479833 (0.0009) [2023-12-26 11:24:41,011][123090] Updated weights for policy 1, policy_version 1470211 (0.0009) [2023-12-26 11:24:41,028][123091] Updated weights for policy 0, policy_version 1479843 (0.0009) [2023-12-26 11:24:41,087][123090] Updated weights for policy 1, policy_version 1470221 (0.0010) [2023-12-26 11:24:41,098][123091] Updated weights for policy 0, policy_version 1479853 (0.0008) [2023-12-26 11:24:41,156][123090] Updated weights for policy 1, policy_version 1470231 (0.0009) [2023-12-26 11:24:41,895][123091] Updated weights for policy 0, policy_version 1479863 (0.0009) [2023-12-26 11:24:41,947][123091] Updated weights for policy 0, policy_version 1479873 (0.0009) [2023-12-26 11:24:42,004][123091] Updated weights for policy 0, policy_version 1479883 (0.0010) [2023-12-26 11:24:42,042][123090] Updated weights for policy 1, policy_version 1470241 (0.0010) [2023-12-26 11:24:42,096][123090] Updated weights for policy 1, policy_version 1470251 (0.0009) [2023-12-26 11:24:42,162][123090] Updated weights for policy 1, policy_version 1470261 (0.0010) [2023-12-26 11:24:42,223][123090] Updated weights for policy 1, policy_version 1470271 (0.0010) [2023-12-26 11:24:42,861][123091] Updated weights for policy 0, policy_version 1479893 (0.0007) [2023-12-26 11:24:42,918][123091] Updated weights for policy 0, policy_version 1479903 (0.0011) [2023-12-26 11:24:42,968][123091] Updated weights for policy 0, policy_version 1479913 (0.0008) [2023-12-26 11:24:43,066][123090] Updated weights for policy 1, policy_version 1470281 (0.0006) [2023-12-26 11:24:43,125][123090] Updated weights for policy 1, policy_version 1470291 (0.0007) [2023-12-26 11:24:43,181][123090] Updated weights for policy 1, policy_version 1470301 (0.0008) [2023-12-26 11:24:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 755261440. Throughput: 0: 8903.6, 1: 8724.7. Samples: 755259204. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:43,785][121949] Avg episode reward: [(0, '6086.483'), (1, '5117.413')] [2023-12-26 11:24:43,788][123091] Updated weights for policy 0, policy_version 1479923 (0.0011) [2023-12-26 11:24:43,840][123091] Updated weights for policy 0, policy_version 1479933 (0.0011) [2023-12-26 11:24:43,876][123090] Updated weights for policy 1, policy_version 1470311 (0.0006) [2023-12-26 11:24:43,903][123091] Updated weights for policy 0, policy_version 1479943 (0.0011) [2023-12-26 11:24:43,940][123090] Updated weights for policy 1, policy_version 1470321 (0.0006) [2023-12-26 11:24:44,006][123090] Updated weights for policy 1, policy_version 1470331 (0.0008) [2023-12-26 11:24:44,614][123091] Updated weights for policy 0, policy_version 1479953 (0.0010) [2023-12-26 11:24:44,664][123091] Updated weights for policy 0, policy_version 1479963 (0.0006) [2023-12-26 11:24:44,722][123091] Updated weights for policy 0, policy_version 1479973 (0.0005) [2023-12-26 11:24:44,786][123091] Updated weights for policy 0, policy_version 1479983 (0.0008) [2023-12-26 11:24:44,915][123090] Updated weights for policy 1, policy_version 1470341 (0.0010) [2023-12-26 11:24:44,985][123090] Updated weights for policy 1, policy_version 1470351 (0.0009) [2023-12-26 11:24:45,058][123090] Updated weights for policy 1, policy_version 1470361 (0.0010) [2023-12-26 11:24:45,570][123091] Updated weights for policy 0, policy_version 1479994 (0.0011) [2023-12-26 11:24:45,620][123091] Updated weights for policy 0, policy_version 1480004 (0.0008) [2023-12-26 11:24:45,669][123091] Updated weights for policy 0, policy_version 1480014 (0.0009) [2023-12-26 11:24:45,915][123090] Updated weights for policy 1, policy_version 1470371 (0.0010) [2023-12-26 11:24:45,974][123090] Updated weights for policy 1, policy_version 1470381 (0.0010) [2023-12-26 11:24:46,020][123090] Updated weights for policy 1, policy_version 1470391 (0.0008) [2023-12-26 11:24:46,528][123091] Updated weights for policy 0, policy_version 1480024 (0.0010) [2023-12-26 11:24:46,595][123091] Updated weights for policy 0, policy_version 1480034 (0.0009) [2023-12-26 11:24:46,659][123091] Updated weights for policy 0, policy_version 1480044 (0.0009) [2023-12-26 11:24:46,872][123090] Updated weights for policy 1, policy_version 1470401 (0.0009) [2023-12-26 11:24:46,925][123090] Updated weights for policy 1, policy_version 1470411 (0.0009) [2023-12-26 11:24:46,974][123090] Updated weights for policy 1, policy_version 1470421 (0.0009) [2023-12-26 11:24:47,032][123090] Updated weights for policy 1, policy_version 1470431 (0.0010) [2023-12-26 11:24:47,415][123091] Updated weights for policy 0, policy_version 1480054 (0.0006) [2023-12-26 11:24:47,474][123091] Updated weights for policy 0, policy_version 1480064 (0.0005) [2023-12-26 11:24:47,541][123091] Updated weights for policy 0, policy_version 1480074 (0.0006) [2023-12-26 11:24:47,925][123090] Updated weights for policy 1, policy_version 1470441 (0.0006) [2023-12-26 11:24:47,977][123090] Updated weights for policy 1, policy_version 1470451 (0.0008) [2023-12-26 11:24:48,041][123090] Updated weights for policy 1, policy_version 1470461 (0.0009) [2023-12-26 11:24:48,148][123091] Updated weights for policy 0, policy_version 1480084 (0.0007) [2023-12-26 11:24:48,218][123091] Updated weights for policy 0, policy_version 1480094 (0.0009) [2023-12-26 11:24:48,275][123091] Updated weights for policy 0, policy_version 1480104 (0.0009) [2023-12-26 11:24:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 755351552. Throughput: 0: 8960.1, 1: 8709.5. Samples: 755365684. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:48,785][121949] Avg episode reward: [(0, '6121.916'), (1, '5052.957')] [2023-12-26 11:24:48,869][123090] Updated weights for policy 1, policy_version 1470471 (0.0009) [2023-12-26 11:24:48,924][123090] Updated weights for policy 1, policy_version 1470481 (0.0010) [2023-12-26 11:24:48,990][123090] Updated weights for policy 1, policy_version 1470491 (0.0006) [2023-12-26 11:24:49,122][123091] Updated weights for policy 0, policy_version 1480114 (0.0009) [2023-12-26 11:24:49,188][123091] Updated weights for policy 0, policy_version 1480124 (0.0010) [2023-12-26 11:24:49,264][123091] Updated weights for policy 0, policy_version 1480134 (0.0009) [2023-12-26 11:24:49,332][123091] Updated weights for policy 0, policy_version 1480144 (0.0009) [2023-12-26 11:24:49,771][123090] Updated weights for policy 1, policy_version 1470501 (0.0007) [2023-12-26 11:24:49,827][123090] Updated weights for policy 1, policy_version 1470511 (0.0010) [2023-12-26 11:24:49,894][123090] Updated weights for policy 1, policy_version 1470521 (0.0009) [2023-12-26 11:24:50,104][123091] Updated weights for policy 0, policy_version 1480154 (0.0010) [2023-12-26 11:24:50,172][123091] Updated weights for policy 0, policy_version 1480164 (0.0009) [2023-12-26 11:24:50,224][123091] Updated weights for policy 0, policy_version 1480174 (0.0010) [2023-12-26 11:24:50,688][123090] Updated weights for policy 1, policy_version 1470531 (0.0009) [2023-12-26 11:24:50,750][123090] Updated weights for policy 1, policy_version 1470541 (0.0010) [2023-12-26 11:24:50,814][123090] Updated weights for policy 1, policy_version 1470551 (0.0010) [2023-12-26 11:24:51,085][123091] Updated weights for policy 0, policy_version 1480184 (0.0009) [2023-12-26 11:24:51,155][123091] Updated weights for policy 0, policy_version 1480194 (0.0008) [2023-12-26 11:24:51,217][123091] Updated weights for policy 0, policy_version 1480204 (0.0008) [2023-12-26 11:24:51,577][123090] Updated weights for policy 1, policy_version 1470561 (0.0006) [2023-12-26 11:24:51,648][123090] Updated weights for policy 1, policy_version 1470571 (0.0008) [2023-12-26 11:24:51,715][123090] Updated weights for policy 1, policy_version 1470581 (0.0010) [2023-12-26 11:24:51,795][123090] Updated weights for policy 1, policy_version 1470591 (0.0007) [2023-12-26 11:24:52,050][123091] Updated weights for policy 0, policy_version 1480214 (0.0007) [2023-12-26 11:24:52,130][123091] Updated weights for policy 0, policy_version 1480224 (0.0006) [2023-12-26 11:24:52,184][123091] Updated weights for policy 0, policy_version 1480234 (0.0005) [2023-12-26 11:24:52,586][123090] Updated weights for policy 1, policy_version 1470601 (0.0010) [2023-12-26 11:24:52,658][123090] Updated weights for policy 1, policy_version 1470611 (0.0009) [2023-12-26 11:24:52,729][123090] Updated weights for policy 1, policy_version 1470621 (0.0009) [2023-12-26 11:24:52,981][123091] Updated weights for policy 0, policy_version 1480244 (0.0007) [2023-12-26 11:24:53,034][123091] Updated weights for policy 0, policy_version 1480254 (0.0009) [2023-12-26 11:24:53,105][123091] Updated weights for policy 0, policy_version 1480264 (0.0009) [2023-12-26 11:24:53,531][123090] Updated weights for policy 1, policy_version 1470631 (0.0006) [2023-12-26 11:24:53,587][123090] Updated weights for policy 1, policy_version 1470641 (0.0005) [2023-12-26 11:24:53,644][123090] Updated weights for policy 1, policy_version 1470651 (0.0008) [2023-12-26 11:24:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 755441664. Throughput: 0: 8929.8, 1: 8749.3. Samples: 755417736. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:53,785][121949] Avg episode reward: [(0, '6087.607'), (1, '5230.992')] [2023-12-26 11:24:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001470656_376487936.pth... [2023-12-26 11:24:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001480272_378953728.pth... [2023-12-26 11:24:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001479248_378691584.pth [2023-12-26 11:24:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001469632_376225792.pth [2023-12-26 11:24:53,865][123091] Updated weights for policy 0, policy_version 1480274 (0.0009) [2023-12-26 11:24:53,924][123091] Updated weights for policy 0, policy_version 1480284 (0.0010) [2023-12-26 11:24:53,975][123091] Updated weights for policy 0, policy_version 1480294 (0.0010) [2023-12-26 11:24:54,034][123091] Updated weights for policy 0, policy_version 1480304 (0.0010) [2023-12-26 11:24:54,463][123090] Updated weights for policy 1, policy_version 1470661 (0.0009) [2023-12-26 11:24:54,522][123090] Updated weights for policy 1, policy_version 1470672 (0.0010) [2023-12-26 11:24:54,576][123090] Updated weights for policy 1, policy_version 1470682 (0.0009) [2023-12-26 11:24:54,770][123091] Updated weights for policy 0, policy_version 1480314 (0.0010) [2023-12-26 11:24:54,814][123091] Updated weights for policy 0, policy_version 1480324 (0.0010) [2023-12-26 11:24:54,858][123091] Updated weights for policy 0, policy_version 1480334 (0.0010) [2023-12-26 11:24:55,412][123090] Updated weights for policy 1, policy_version 1470692 (0.0009) [2023-12-26 11:24:55,468][123090] Updated weights for policy 1, policy_version 1470702 (0.0011) [2023-12-26 11:24:55,522][123090] Updated weights for policy 1, policy_version 1470713 (0.0010) [2023-12-26 11:24:55,692][123091] Updated weights for policy 0, policy_version 1480344 (0.0010) [2023-12-26 11:24:55,736][123091] Updated weights for policy 0, policy_version 1480354 (0.0010) [2023-12-26 11:24:55,780][123091] Updated weights for policy 0, policy_version 1480364 (0.0007) [2023-12-26 11:24:56,403][123090] Updated weights for policy 1, policy_version 1470724 (0.0010) [2023-12-26 11:24:56,458][123090] Updated weights for policy 1, policy_version 1470734 (0.0008) [2023-12-26 11:24:56,516][123090] Updated weights for policy 1, policy_version 1470744 (0.0008) [2023-12-26 11:24:56,518][123091] Updated weights for policy 0, policy_version 1480374 (0.0008) [2023-12-26 11:24:56,580][123091] Updated weights for policy 0, policy_version 1480384 (0.0008) [2023-12-26 11:24:56,654][123091] Updated weights for policy 0, policy_version 1480394 (0.0005) [2023-12-26 11:24:57,236][123091] Updated weights for policy 0, policy_version 1480404 (0.0005) [2023-12-26 11:24:57,312][123091] Updated weights for policy 0, policy_version 1480414 (0.0005) [2023-12-26 11:24:57,374][123091] Updated weights for policy 0, policy_version 1480424 (0.0005) [2023-12-26 11:24:57,429][123090] Updated weights for policy 1, policy_version 1470754 (0.0008) [2023-12-26 11:24:57,494][123090] Updated weights for policy 1, policy_version 1470764 (0.0010) [2023-12-26 11:24:57,546][123090] Updated weights for policy 1, policy_version 1470774 (0.0009) [2023-12-26 11:24:57,602][123090] Updated weights for policy 1, policy_version 1470784 (0.0010) [2023-12-26 11:24:57,957][123091] Updated weights for policy 0, policy_version 1480434 (0.0005) [2023-12-26 11:24:58,011][123091] Updated weights for policy 0, policy_version 1480444 (0.0006) [2023-12-26 11:24:58,077][123091] Updated weights for policy 0, policy_version 1480454 (0.0007) [2023-12-26 11:24:58,143][123091] Updated weights for policy 0, policy_version 1480464 (0.0008) [2023-12-26 11:24:58,533][123090] Updated weights for policy 1, policy_version 1470794 (0.0008) [2023-12-26 11:24:58,602][123090] Updated weights for policy 1, policy_version 1470804 (0.0008) [2023-12-26 11:24:58,665][123090] Updated weights for policy 1, policy_version 1470814 (0.0009) [2023-12-26 11:24:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 755531776. Throughput: 0: 8999.4, 1: 8717.2. Samples: 755524988. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:24:58,785][121949] Avg episode reward: [(0, '6207.772'), (1, '5167.989')] [2023-12-26 11:24:58,922][123091] Updated weights for policy 0, policy_version 1480474 (0.0007) [2023-12-26 11:24:58,994][123091] Updated weights for policy 0, policy_version 1480484 (0.0007) [2023-12-26 11:24:59,063][123091] Updated weights for policy 0, policy_version 1480494 (0.0008) [2023-12-26 11:24:59,537][123090] Updated weights for policy 1, policy_version 1470824 (0.0008) [2023-12-26 11:24:59,597][123090] Updated weights for policy 1, policy_version 1470834 (0.0006) [2023-12-26 11:24:59,664][123090] Updated weights for policy 1, policy_version 1470844 (0.0010) [2023-12-26 11:24:59,861][123091] Updated weights for policy 0, policy_version 1480504 (0.0009) [2023-12-26 11:24:59,928][123091] Updated weights for policy 0, policy_version 1480514 (0.0009) [2023-12-26 11:24:59,994][123091] Updated weights for policy 0, policy_version 1480524 (0.0009) [2023-12-26 11:25:00,399][123090] Updated weights for policy 1, policy_version 1470854 (0.0007) [2023-12-26 11:25:00,455][123090] Updated weights for policy 1, policy_version 1470864 (0.0009) [2023-12-26 11:25:00,517][123090] Updated weights for policy 1, policy_version 1470874 (0.0008) [2023-12-26 11:25:00,878][123091] Updated weights for policy 0, policy_version 1480534 (0.0010) [2023-12-26 11:25:00,930][123091] Updated weights for policy 0, policy_version 1480545 (0.0010) [2023-12-26 11:25:00,983][123091] Updated weights for policy 0, policy_version 1480557 (0.0010) [2023-12-26 11:25:01,135][123090] Updated weights for policy 1, policy_version 1470884 (0.0007) [2023-12-26 11:25:01,202][123090] Updated weights for policy 1, policy_version 1470894 (0.0010) [2023-12-26 11:25:01,268][123090] Updated weights for policy 1, policy_version 1470904 (0.0009) [2023-12-26 11:25:01,846][123091] Updated weights for policy 0, policy_version 1480567 (0.0010) [2023-12-26 11:25:01,899][123091] Updated weights for policy 0, policy_version 1480577 (0.0010) [2023-12-26 11:25:01,954][123091] Updated weights for policy 0, policy_version 1480587 (0.0010) [2023-12-26 11:25:02,003][123090] Updated weights for policy 1, policy_version 1470914 (0.0008) [2023-12-26 11:25:02,066][123090] Updated weights for policy 1, policy_version 1470924 (0.0007) [2023-12-26 11:25:02,118][123090] Updated weights for policy 1, policy_version 1470934 (0.0009) [2023-12-26 11:25:02,168][123090] Updated weights for policy 1, policy_version 1470944 (0.0009) [2023-12-26 11:25:02,809][123090] Updated weights for policy 1, policy_version 1470954 (0.0008) [2023-12-26 11:25:02,864][123090] Updated weights for policy 1, policy_version 1470964 (0.0010) [2023-12-26 11:25:02,867][123091] Updated weights for policy 0, policy_version 1480597 (0.0007) [2023-12-26 11:25:02,917][123091] Updated weights for policy 0, policy_version 1480607 (0.0008) [2023-12-26 11:25:02,918][123090] Updated weights for policy 1, policy_version 1470974 (0.0008) [2023-12-26 11:25:02,969][123091] Updated weights for policy 0, policy_version 1480617 (0.0010) [2023-12-26 11:25:03,635][123090] Updated weights for policy 1, policy_version 1470984 (0.0009) [2023-12-26 11:25:03,700][123090] Updated weights for policy 1, policy_version 1470994 (0.0010) [2023-12-26 11:25:03,763][123090] Updated weights for policy 1, policy_version 1471004 (0.0010) [2023-12-26 11:25:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 755613696. Throughput: 0: 8967.8, 1: 8768.3. Samples: 755631488. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:03,785][121949] Avg episode reward: [(0, '6354.098'), (1, '4890.308')] [2023-12-26 11:25:03,873][123091] Updated weights for policy 0, policy_version 1480628 (0.0010) [2023-12-26 11:25:03,935][123091] Updated weights for policy 0, policy_version 1480638 (0.0009) [2023-12-26 11:25:03,995][123091] Updated weights for policy 0, policy_version 1480648 (0.0010) [2023-12-26 11:25:04,475][123090] Updated weights for policy 1, policy_version 1471014 (0.0007) [2023-12-26 11:25:04,526][123090] Updated weights for policy 1, policy_version 1471024 (0.0008) [2023-12-26 11:25:04,580][123090] Updated weights for policy 1, policy_version 1471034 (0.0006) [2023-12-26 11:25:04,843][123091] Updated weights for policy 0, policy_version 1480658 (0.0010) [2023-12-26 11:25:04,894][123091] Updated weights for policy 0, policy_version 1480668 (0.0008) [2023-12-26 11:25:04,942][123091] Updated weights for policy 0, policy_version 1480678 (0.0009) [2023-12-26 11:25:04,990][123091] Updated weights for policy 0, policy_version 1480688 (0.0010) [2023-12-26 11:25:05,379][123090] Updated weights for policy 1, policy_version 1471044 (0.0007) [2023-12-26 11:25:05,437][123090] Updated weights for policy 1, policy_version 1471054 (0.0009) [2023-12-26 11:25:05,490][123090] Updated weights for policy 1, policy_version 1471065 (0.0010) [2023-12-26 11:25:05,756][123091] Updated weights for policy 0, policy_version 1480698 (0.0005) [2023-12-26 11:25:05,824][123091] Updated weights for policy 0, policy_version 1480708 (0.0006) [2023-12-26 11:25:05,893][123091] Updated weights for policy 0, policy_version 1480718 (0.0007) [2023-12-26 11:25:06,423][123090] Updated weights for policy 1, policy_version 1471075 (0.0008) [2023-12-26 11:25:06,494][123090] Updated weights for policy 1, policy_version 1471085 (0.0005) [2023-12-26 11:25:06,565][123090] Updated weights for policy 1, policy_version 1471095 (0.0005) [2023-12-26 11:25:06,648][123091] Updated weights for policy 0, policy_version 1480728 (0.0010) [2023-12-26 11:25:06,712][123091] Updated weights for policy 0, policy_version 1480738 (0.0011) [2023-12-26 11:25:06,778][123091] Updated weights for policy 0, policy_version 1480748 (0.0011) [2023-12-26 11:25:07,216][123090] Updated weights for policy 1, policy_version 1471105 (0.0006) [2023-12-26 11:25:07,277][123090] Updated weights for policy 1, policy_version 1471115 (0.0009) [2023-12-26 11:25:07,341][123090] Updated weights for policy 1, policy_version 1471125 (0.0009) [2023-12-26 11:25:07,401][123090] Updated weights for policy 1, policy_version 1471135 (0.0009) [2023-12-26 11:25:07,595][123091] Updated weights for policy 0, policy_version 1480758 (0.0011) [2023-12-26 11:25:07,646][123091] Updated weights for policy 0, policy_version 1480768 (0.0010) [2023-12-26 11:25:07,702][123091] Updated weights for policy 0, policy_version 1480778 (0.0010) [2023-12-26 11:25:08,262][123090] Updated weights for policy 1, policy_version 1471145 (0.0010) [2023-12-26 11:25:08,315][123090] Updated weights for policy 1, policy_version 1471155 (0.0009) [2023-12-26 11:25:08,368][123090] Updated weights for policy 1, policy_version 1471165 (0.0009) [2023-12-26 11:25:08,445][123091] Updated weights for policy 0, policy_version 1480788 (0.0010) [2023-12-26 11:25:08,500][123091] Updated weights for policy 0, policy_version 1480798 (0.0008) [2023-12-26 11:25:08,564][123091] Updated weights for policy 0, policy_version 1480808 (0.0007) [2023-12-26 11:25:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 755712000. Throughput: 0: 9014.5, 1: 8762.4. Samples: 755684624. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:08,786][121949] Avg episode reward: [(0, '6342.646'), (1, '5280.132')] [2023-12-26 11:25:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001471168_376619008.pth... [2023-12-26 11:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001480816_379092992.pth... [2023-12-26 11:25:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001470144_376356864.pth [2023-12-26 11:25:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001479760_378822656.pth [2023-12-26 11:25:09,159][123090] Updated weights for policy 1, policy_version 1471175 (0.0009) [2023-12-26 11:25:09,220][123090] Updated weights for policy 1, policy_version 1471186 (0.0010) [2023-12-26 11:25:09,290][123090] Updated weights for policy 1, policy_version 1471196 (0.0008) [2023-12-26 11:25:09,446][123091] Updated weights for policy 0, policy_version 1480818 (0.0007) [2023-12-26 11:25:09,511][123091] Updated weights for policy 0, policy_version 1480828 (0.0010) [2023-12-26 11:25:09,567][123091] Updated weights for policy 0, policy_version 1480838 (0.0010) [2023-12-26 11:25:09,631][123091] Updated weights for policy 0, policy_version 1480848 (0.0010) [2023-12-26 11:25:10,179][123090] Updated weights for policy 1, policy_version 1471206 (0.0009) [2023-12-26 11:25:10,234][123090] Updated weights for policy 1, policy_version 1471216 (0.0009) [2023-12-26 11:25:10,289][123090] Updated weights for policy 1, policy_version 1471226 (0.0008) [2023-12-26 11:25:10,447][123091] Updated weights for policy 0, policy_version 1480858 (0.0005) [2023-12-26 11:25:10,513][123091] Updated weights for policy 0, policy_version 1480868 (0.0006) [2023-12-26 11:25:10,577][123091] Updated weights for policy 0, policy_version 1480878 (0.0006) [2023-12-26 11:25:11,053][123090] Updated weights for policy 1, policy_version 1471236 (0.0008) [2023-12-26 11:25:11,120][123090] Updated weights for policy 1, policy_version 1471246 (0.0008) [2023-12-26 11:25:11,188][123090] Updated weights for policy 1, policy_version 1471256 (0.0007) [2023-12-26 11:25:11,294][123091] Updated weights for policy 0, policy_version 1480888 (0.0008) [2023-12-26 11:25:11,361][123091] Updated weights for policy 0, policy_version 1480898 (0.0008) [2023-12-26 11:25:11,428][123091] Updated weights for policy 0, policy_version 1480908 (0.0008) [2023-12-26 11:25:11,975][123090] Updated weights for policy 1, policy_version 1471266 (0.0006) [2023-12-26 11:25:12,030][123090] Updated weights for policy 1, policy_version 1471276 (0.0008) [2023-12-26 11:25:12,082][123090] Updated weights for policy 1, policy_version 1471286 (0.0008) [2023-12-26 11:25:12,138][123090] Updated weights for policy 1, policy_version 1471296 (0.0007) [2023-12-26 11:25:12,203][123091] Updated weights for policy 0, policy_version 1480918 (0.0010) [2023-12-26 11:25:12,273][123091] Updated weights for policy 0, policy_version 1480928 (0.0011) [2023-12-26 11:25:12,350][123091] Updated weights for policy 0, policy_version 1480938 (0.0011) [2023-12-26 11:25:12,957][123090] Updated weights for policy 1, policy_version 1471306 (0.0010) [2023-12-26 11:25:13,012][123090] Updated weights for policy 1, policy_version 1471316 (0.0008) [2023-12-26 11:25:13,063][123090] Updated weights for policy 1, policy_version 1471326 (0.0009) [2023-12-26 11:25:13,204][123091] Updated weights for policy 0, policy_version 1480948 (0.0010) [2023-12-26 11:25:13,263][123091] Updated weights for policy 0, policy_version 1480958 (0.0009) [2023-12-26 11:25:13,316][123091] Updated weights for policy 0, policy_version 1480968 (0.0009) [2023-12-26 11:25:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 755793920. Throughput: 0: 8935.0, 1: 8732.1. Samples: 755790160. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:13,785][121949] Avg episode reward: [(0, '6334.951'), (1, '5429.909')] [2023-12-26 11:25:13,909][123090] Updated weights for policy 1, policy_version 1471336 (0.0008) [2023-12-26 11:25:13,972][123090] Updated weights for policy 1, policy_version 1471346 (0.0010) [2023-12-26 11:25:14,035][123090] Updated weights for policy 1, policy_version 1471356 (0.0010) [2023-12-26 11:25:14,119][123091] Updated weights for policy 0, policy_version 1480978 (0.0009) [2023-12-26 11:25:14,179][123091] Updated weights for policy 0, policy_version 1480988 (0.0005) [2023-12-26 11:25:14,225][123091] Updated weights for policy 0, policy_version 1480998 (0.0005) [2023-12-26 11:25:14,280][123091] Updated weights for policy 0, policy_version 1481008 (0.0010) [2023-12-26 11:25:14,750][123090] Updated weights for policy 1, policy_version 1471366 (0.0007) [2023-12-26 11:25:14,834][123090] Updated weights for policy 1, policy_version 1471376 (0.0007) [2023-12-26 11:25:14,898][123090] Updated weights for policy 1, policy_version 1471386 (0.0010) [2023-12-26 11:25:15,084][123091] Updated weights for policy 0, policy_version 1481018 (0.0006) [2023-12-26 11:25:15,154][123091] Updated weights for policy 0, policy_version 1481028 (0.0006) [2023-12-26 11:25:15,224][123091] Updated weights for policy 0, policy_version 1481038 (0.0007) [2023-12-26 11:25:15,795][123090] Updated weights for policy 1, policy_version 1471396 (0.0010) [2023-12-26 11:25:15,853][123090] Updated weights for policy 1, policy_version 1471406 (0.0008) [2023-12-26 11:25:15,883][123091] Updated weights for policy 0, policy_version 1481048 (0.0009) [2023-12-26 11:25:15,911][123090] Updated weights for policy 1, policy_version 1471416 (0.0010) [2023-12-26 11:25:15,951][123091] Updated weights for policy 0, policy_version 1481058 (0.0009) [2023-12-26 11:25:15,999][123091] Updated weights for policy 0, policy_version 1481068 (0.0009) [2023-12-26 11:25:16,682][123090] Updated weights for policy 1, policy_version 1471426 (0.0009) [2023-12-26 11:25:16,737][123090] Updated weights for policy 1, policy_version 1471436 (0.0010) [2023-12-26 11:25:16,761][123091] Updated weights for policy 0, policy_version 1481078 (0.0007) [2023-12-26 11:25:16,792][123090] Updated weights for policy 1, policy_version 1471446 (0.0010) [2023-12-26 11:25:16,808][123091] Updated weights for policy 0, policy_version 1481088 (0.0007) [2023-12-26 11:25:16,848][123090] Updated weights for policy 1, policy_version 1471456 (0.0010) [2023-12-26 11:25:16,855][123091] Updated weights for policy 0, policy_version 1481098 (0.0005) [2023-12-26 11:25:17,484][123091] Updated weights for policy 0, policy_version 1481108 (0.0005) [2023-12-26 11:25:17,539][123091] Updated weights for policy 0, policy_version 1481118 (0.0005) [2023-12-26 11:25:17,604][123091] Updated weights for policy 0, policy_version 1481128 (0.0005) [2023-12-26 11:25:17,670][123090] Updated weights for policy 1, policy_version 1471466 (0.0010) [2023-12-26 11:25:17,729][123090] Updated weights for policy 1, policy_version 1471476 (0.0010) [2023-12-26 11:25:17,788][123090] Updated weights for policy 1, policy_version 1471486 (0.0010) [2023-12-26 11:25:18,300][123091] Updated weights for policy 0, policy_version 1481138 (0.0006) [2023-12-26 11:25:18,366][123091] Updated weights for policy 0, policy_version 1481148 (0.0009) [2023-12-26 11:25:18,426][123091] Updated weights for policy 0, policy_version 1481158 (0.0008) [2023-12-26 11:25:18,482][123091] Updated weights for policy 0, policy_version 1481168 (0.0009) [2023-12-26 11:25:18,619][123090] Updated weights for policy 1, policy_version 1471496 (0.0009) [2023-12-26 11:25:18,687][123090] Updated weights for policy 1, policy_version 1471506 (0.0011) [2023-12-26 11:25:18,757][123090] Updated weights for policy 1, policy_version 1471516 (0.0010) [2023-12-26 11:25:18,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 755892224. Throughput: 0: 8985.2, 1: 8675.6. Samples: 755899152. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:18,784][121949] Avg episode reward: [(0, '6422.861'), (1, '5203.863')] [2023-12-26 11:25:19,329][123091] Updated weights for policy 0, policy_version 1481178 (0.0010) [2023-12-26 11:25:19,404][123091] Updated weights for policy 0, policy_version 1481188 (0.0010) [2023-12-26 11:25:19,468][123091] Updated weights for policy 0, policy_version 1481198 (0.0011) [2023-12-26 11:25:19,567][123090] Updated weights for policy 1, policy_version 1471526 (0.0009) [2023-12-26 11:25:19,636][123090] Updated weights for policy 1, policy_version 1471536 (0.0008) [2023-12-26 11:25:19,698][123090] Updated weights for policy 1, policy_version 1471546 (0.0007) [2023-12-26 11:25:20,264][123091] Updated weights for policy 0, policy_version 1481208 (0.0011) [2023-12-26 11:25:20,324][123091] Updated weights for policy 0, policy_version 1481218 (0.0007) [2023-12-26 11:25:20,386][123091] Updated weights for policy 0, policy_version 1481228 (0.0010) [2023-12-26 11:25:20,438][123090] Updated weights for policy 1, policy_version 1471556 (0.0007) [2023-12-26 11:25:20,500][123090] Updated weights for policy 1, policy_version 1471566 (0.0009) [2023-12-26 11:25:20,562][123090] Updated weights for policy 1, policy_version 1471576 (0.0008) [2023-12-26 11:25:21,204][123091] Updated weights for policy 0, policy_version 1481238 (0.0009) [2023-12-26 11:25:21,265][123091] Updated weights for policy 0, policy_version 1481248 (0.0010) [2023-12-26 11:25:21,329][123091] Updated weights for policy 0, policy_version 1481258 (0.0009) [2023-12-26 11:25:21,370][123090] Updated weights for policy 1, policy_version 1471586 (0.0010) [2023-12-26 11:25:21,445][123090] Updated weights for policy 1, policy_version 1471596 (0.0008) [2023-12-26 11:25:21,515][123090] Updated weights for policy 1, policy_version 1471606 (0.0008) [2023-12-26 11:25:21,589][123090] Updated weights for policy 1, policy_version 1471616 (0.0006) [2023-12-26 11:25:22,210][123091] Updated weights for policy 0, policy_version 1481268 (0.0010) [2023-12-26 11:25:22,275][123091] Updated weights for policy 0, policy_version 1481278 (0.0010) [2023-12-26 11:25:22,332][123091] Updated weights for policy 0, policy_version 1481288 (0.0011) [2023-12-26 11:25:22,382][123090] Updated weights for policy 1, policy_version 1471626 (0.0011) [2023-12-26 11:25:22,446][123090] Updated weights for policy 1, policy_version 1471636 (0.0010) [2023-12-26 11:25:22,501][123090] Updated weights for policy 1, policy_version 1471646 (0.0010) [2023-12-26 11:25:23,131][123091] Updated weights for policy 0, policy_version 1481298 (0.0009) [2023-12-26 11:25:23,198][123091] Updated weights for policy 0, policy_version 1481308 (0.0009) [2023-12-26 11:25:23,265][123091] Updated weights for policy 0, policy_version 1481318 (0.0009) [2023-12-26 11:25:23,316][123091] Updated weights for policy 0, policy_version 1481328 (0.0010) [2023-12-26 11:25:23,399][123090] Updated weights for policy 1, policy_version 1471656 (0.0010) [2023-12-26 11:25:23,456][123090] Updated weights for policy 1, policy_version 1471666 (0.0007) [2023-12-26 11:25:23,507][123090] Updated weights for policy 1, policy_version 1471676 (0.0005) [2023-12-26 11:25:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 755974144. Throughput: 0: 8956.8, 1: 8709.8. Samples: 755951196. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:23,785][121949] Avg episode reward: [(0, '6326.177'), (1, '5141.176')] [2023-12-26 11:25:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001481328_379224064.pth... [2023-12-26 11:25:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001471680_376750080.pth... [2023-12-26 11:25:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001480272_378953728.pth [2023-12-26 11:25:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001470656_376487936.pth [2023-12-26 11:25:24,022][123091] Updated weights for policy 0, policy_version 1481338 (0.0005) [2023-12-26 11:25:24,085][123091] Updated weights for policy 0, policy_version 1481348 (0.0005) [2023-12-26 11:25:24,160][123091] Updated weights for policy 0, policy_version 1481358 (0.0006) [2023-12-26 11:25:24,204][123090] Updated weights for policy 1, policy_version 1471686 (0.0005) [2023-12-26 11:25:24,266][123090] Updated weights for policy 1, policy_version 1471696 (0.0006) [2023-12-26 11:25:24,320][123090] Updated weights for policy 1, policy_version 1471706 (0.0006) [2023-12-26 11:25:24,840][123091] Updated weights for policy 0, policy_version 1481368 (0.0005) [2023-12-26 11:25:24,895][123091] Updated weights for policy 0, policy_version 1481378 (0.0005) [2023-12-26 11:25:24,962][123091] Updated weights for policy 0, policy_version 1481388 (0.0005) [2023-12-26 11:25:25,038][123090] Updated weights for policy 1, policy_version 1471716 (0.0005) [2023-12-26 11:25:25,093][123090] Updated weights for policy 1, policy_version 1471726 (0.0009) [2023-12-26 11:25:25,149][123090] Updated weights for policy 1, policy_version 1471736 (0.0009) [2023-12-26 11:25:25,665][123091] Updated weights for policy 0, policy_version 1481398 (0.0005) [2023-12-26 11:25:25,729][123091] Updated weights for policy 0, policy_version 1481408 (0.0008) [2023-12-26 11:25:25,798][123091] Updated weights for policy 0, policy_version 1481418 (0.0005) [2023-12-26 11:25:25,880][123090] Updated weights for policy 1, policy_version 1471746 (0.0009) [2023-12-26 11:25:25,930][123090] Updated weights for policy 1, policy_version 1471756 (0.0005) [2023-12-26 11:25:25,978][123090] Updated weights for policy 1, policy_version 1471766 (0.0005) [2023-12-26 11:25:26,030][123090] Updated weights for policy 1, policy_version 1471776 (0.0005) [2023-12-26 11:25:26,417][123091] Updated weights for policy 0, policy_version 1481428 (0.0005) [2023-12-26 11:25:26,479][123091] Updated weights for policy 0, policy_version 1481438 (0.0009) [2023-12-26 11:25:26,543][123091] Updated weights for policy 0, policy_version 1481448 (0.0007) [2023-12-26 11:25:26,721][123090] Updated weights for policy 1, policy_version 1471786 (0.0005) [2023-12-26 11:25:26,774][123090] Updated weights for policy 1, policy_version 1471796 (0.0005) [2023-12-26 11:25:26,826][123090] Updated weights for policy 1, policy_version 1471806 (0.0005) [2023-12-26 11:25:27,157][123091] Updated weights for policy 0, policy_version 1481458 (0.0005) [2023-12-26 11:25:27,210][123091] Updated weights for policy 0, policy_version 1481468 (0.0005) [2023-12-26 11:25:27,279][123091] Updated weights for policy 0, policy_version 1481478 (0.0005) [2023-12-26 11:25:27,329][123091] Updated weights for policy 0, policy_version 1481488 (0.0006) [2023-12-26 11:25:27,696][123090] Updated weights for policy 1, policy_version 1471816 (0.0009) [2023-12-26 11:25:27,750][123090] Updated weights for policy 1, policy_version 1471827 (0.0010) [2023-12-26 11:25:27,803][123090] Updated weights for policy 1, policy_version 1471839 (0.0010) [2023-12-26 11:25:27,961][123091] Updated weights for policy 0, policy_version 1481498 (0.0005) [2023-12-26 11:25:28,007][123091] Updated weights for policy 0, policy_version 1481508 (0.0005) [2023-12-26 11:25:28,059][123091] Updated weights for policy 0, policy_version 1481518 (0.0005) [2023-12-26 11:25:28,675][123091] Updated weights for policy 0, policy_version 1481528 (0.0005) [2023-12-26 11:25:28,732][123091] Updated weights for policy 0, policy_version 1481538 (0.0006) [2023-12-26 11:25:28,739][123090] Updated weights for policy 1, policy_version 1471849 (0.0009) [2023-12-26 11:25:28,784][123091] Updated weights for policy 0, policy_version 1481548 (0.0005) [2023-12-26 11:25:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 756064256. Throughput: 0: 9093.5, 1: 8821.4. Samples: 756065376. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:28,785][121949] Avg episode reward: [(0, '6270.906'), (1, '5191.481')] [2023-12-26 11:25:28,802][123090] Updated weights for policy 1, policy_version 1471859 (0.0009) [2023-12-26 11:25:28,872][123090] Updated weights for policy 1, policy_version 1471869 (0.0009) [2023-12-26 11:25:29,500][123091] Updated weights for policy 0, policy_version 1481558 (0.0009) [2023-12-26 11:25:29,559][123091] Updated weights for policy 0, policy_version 1481568 (0.0011) [2023-12-26 11:25:29,622][123091] Updated weights for policy 0, policy_version 1481578 (0.0011) [2023-12-26 11:25:29,776][123090] Updated weights for policy 1, policy_version 1471879 (0.0010) [2023-12-26 11:25:29,841][123090] Updated weights for policy 1, policy_version 1471889 (0.0010) [2023-12-26 11:25:29,905][123090] Updated weights for policy 1, policy_version 1471899 (0.0010) [2023-12-26 11:25:30,378][123091] Updated weights for policy 0, policy_version 1481588 (0.0008) [2023-12-26 11:25:30,441][123091] Updated weights for policy 0, policy_version 1481598 (0.0011) [2023-12-26 11:25:30,504][123091] Updated weights for policy 0, policy_version 1481608 (0.0011) [2023-12-26 11:25:30,695][123090] Updated weights for policy 1, policy_version 1471909 (0.0009) [2023-12-26 11:25:30,751][123090] Updated weights for policy 1, policy_version 1471919 (0.0009) [2023-12-26 11:25:30,807][123090] Updated weights for policy 1, policy_version 1471929 (0.0010) [2023-12-26 11:25:31,299][123091] Updated weights for policy 0, policy_version 1481618 (0.0007) [2023-12-26 11:25:31,367][123091] Updated weights for policy 0, policy_version 1481628 (0.0008) [2023-12-26 11:25:31,443][123091] Updated weights for policy 0, policy_version 1481638 (0.0007) [2023-12-26 11:25:31,511][123091] Updated weights for policy 0, policy_version 1481648 (0.0006) [2023-12-26 11:25:31,649][123090] Updated weights for policy 1, policy_version 1471939 (0.0010) [2023-12-26 11:25:31,718][123090] Updated weights for policy 1, policy_version 1471949 (0.0008) [2023-12-26 11:25:31,801][123090] Updated weights for policy 1, policy_version 1471959 (0.0008) [2023-12-26 11:25:32,323][123091] Updated weights for policy 0, policy_version 1481658 (0.0009) [2023-12-26 11:25:32,389][123091] Updated weights for policy 0, policy_version 1481668 (0.0008) [2023-12-26 11:25:32,440][123091] Updated weights for policy 0, policy_version 1481678 (0.0007) [2023-12-26 11:25:32,564][123090] Updated weights for policy 1, policy_version 1471969 (0.0008) [2023-12-26 11:25:32,631][123090] Updated weights for policy 1, policy_version 1471979 (0.0010) [2023-12-26 11:25:32,698][123090] Updated weights for policy 1, policy_version 1471989 (0.0010) [2023-12-26 11:25:32,753][123090] Updated weights for policy 1, policy_version 1471999 (0.0010) [2023-12-26 11:25:33,246][123091] Updated weights for policy 0, policy_version 1481688 (0.0008) [2023-12-26 11:25:33,297][123091] Updated weights for policy 0, policy_version 1481698 (0.0008) [2023-12-26 11:25:33,356][123091] Updated weights for policy 0, policy_version 1481708 (0.0008) [2023-12-26 11:25:33,561][123090] Updated weights for policy 1, policy_version 1472009 (0.0010) [2023-12-26 11:25:33,605][123090] Updated weights for policy 1, policy_version 1472019 (0.0010) [2023-12-26 11:25:33,663][123090] Updated weights for policy 1, policy_version 1472029 (0.0010) [2023-12-26 11:25:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 756162560. Throughput: 0: 9104.6, 1: 8795.3. Samples: 756171180. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:33,785][121949] Avg episode reward: [(0, '6375.987'), (1, '4981.104')] [2023-12-26 11:25:34,189][123091] Updated weights for policy 0, policy_version 1481718 (0.0009) [2023-12-26 11:25:34,241][123091] Updated weights for policy 0, policy_version 1481728 (0.0009) [2023-12-26 11:25:34,298][123091] Updated weights for policy 0, policy_version 1481738 (0.0009) [2023-12-26 11:25:34,502][123090] Updated weights for policy 1, policy_version 1472039 (0.0010) [2023-12-26 11:25:34,565][123090] Updated weights for policy 1, policy_version 1472049 (0.0010) [2023-12-26 11:25:34,629][123090] Updated weights for policy 1, policy_version 1472059 (0.0011) [2023-12-26 11:25:35,145][123091] Updated weights for policy 0, policy_version 1481748 (0.0009) [2023-12-26 11:25:35,202][123091] Updated weights for policy 0, policy_version 1481758 (0.0009) [2023-12-26 11:25:35,253][123091] Updated weights for policy 0, policy_version 1481768 (0.0009) [2023-12-26 11:25:35,464][123090] Updated weights for policy 1, policy_version 1472069 (0.0010) [2023-12-26 11:25:35,512][123090] Updated weights for policy 1, policy_version 1472079 (0.0010) [2023-12-26 11:25:35,563][123090] Updated weights for policy 1, policy_version 1472089 (0.0010) [2023-12-26 11:25:36,090][123091] Updated weights for policy 0, policy_version 1481778 (0.0009) [2023-12-26 11:25:36,157][123091] Updated weights for policy 0, policy_version 1481788 (0.0009) [2023-12-26 11:25:36,218][123091] Updated weights for policy 0, policy_version 1481798 (0.0009) [2023-12-26 11:25:36,287][123091] Updated weights for policy 0, policy_version 1481808 (0.0009) [2023-12-26 11:25:36,432][123090] Updated weights for policy 1, policy_version 1472099 (0.0010) [2023-12-26 11:25:36,503][123090] Updated weights for policy 1, policy_version 1472109 (0.0010) [2023-12-26 11:25:36,573][123090] Updated weights for policy 1, policy_version 1472119 (0.0011) [2023-12-26 11:25:37,124][123091] Updated weights for policy 0, policy_version 1481818 (0.0009) [2023-12-26 11:25:37,180][123091] Updated weights for policy 0, policy_version 1481828 (0.0009) [2023-12-26 11:25:37,229][123091] Updated weights for policy 0, policy_version 1481838 (0.0009) [2023-12-26 11:25:37,398][123090] Updated weights for policy 1, policy_version 1472129 (0.0011) [2023-12-26 11:25:37,450][123090] Updated weights for policy 1, policy_version 1472139 (0.0010) [2023-12-26 11:25:37,522][123090] Updated weights for policy 1, policy_version 1472149 (0.0011) [2023-12-26 11:25:37,585][123090] Updated weights for policy 1, policy_version 1472159 (0.0010) [2023-12-26 11:25:38,074][123091] Updated weights for policy 0, policy_version 1481848 (0.0009) [2023-12-26 11:25:38,126][123091] Updated weights for policy 0, policy_version 1481858 (0.0009) [2023-12-26 11:25:38,176][123091] Updated weights for policy 0, policy_version 1481868 (0.0008) [2023-12-26 11:25:38,429][123090] Updated weights for policy 1, policy_version 1472169 (0.0011) [2023-12-26 11:25:38,493][123090] Updated weights for policy 1, policy_version 1472179 (0.0011) [2023-12-26 11:25:38,556][123090] Updated weights for policy 1, policy_version 1472189 (0.0010) [2023-12-26 11:25:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 756244480. Throughput: 0: 9092.7, 1: 8771.8. Samples: 756221640. Policy #0 lag: (min: 16.0, avg: 40.7, max: 48.0) [2023-12-26 11:25:38,785][121949] Avg episode reward: [(0, '6244.552'), (1, '4913.057')] [2023-12-26 11:25:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001481872_379363328.pth... [2023-12-26 11:25:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001472192_376881152.pth... [2023-12-26 11:25:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001480816_379092992.pth [2023-12-26 11:25:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001471168_376619008.pth [2023-12-26 11:25:39,038][123091] Updated weights for policy 0, policy_version 1481878 (0.0009) [2023-12-26 11:25:39,095][123091] Updated weights for policy 0, policy_version 1481888 (0.0009) [2023-12-26 11:25:39,149][123091] Updated weights for policy 0, policy_version 1481898 (0.0009) [2023-12-26 11:25:39,391][123090] Updated weights for policy 1, policy_version 1472199 (0.0011) [2023-12-26 11:25:39,463][123090] Updated weights for policy 1, policy_version 1472209 (0.0011) [2023-12-26 11:25:39,531][123090] Updated weights for policy 1, policy_version 1472219 (0.0011) [2023-12-26 11:25:40,028][123091] Updated weights for policy 0, policy_version 1481908 (0.0009) [2023-12-26 11:25:40,093][123091] Updated weights for policy 0, policy_version 1481918 (0.0008) [2023-12-26 11:25:40,160][123091] Updated weights for policy 0, policy_version 1481928 (0.0010) [2023-12-26 11:25:40,323][123090] Updated weights for policy 1, policy_version 1472229 (0.0011) [2023-12-26 11:25:40,391][123090] Updated weights for policy 1, policy_version 1472239 (0.0011) [2023-12-26 11:25:40,442][123090] Updated weights for policy 1, policy_version 1472249 (0.0010) [2023-12-26 11:25:41,006][123091] Updated weights for policy 0, policy_version 1481938 (0.0009) [2023-12-26 11:25:41,073][123091] Updated weights for policy 0, policy_version 1481948 (0.0009) [2023-12-26 11:25:41,135][123091] Updated weights for policy 0, policy_version 1481958 (0.0010) [2023-12-26 11:25:41,200][123091] Updated weights for policy 0, policy_version 1481968 (0.0010) [2023-12-26 11:25:41,269][123090] Updated weights for policy 1, policy_version 1472259 (0.0010) [2023-12-26 11:25:41,330][123090] Updated weights for policy 1, policy_version 1472269 (0.0009) [2023-12-26 11:25:41,412][123090] Updated weights for policy 1, policy_version 1472279 (0.0009) [2023-12-26 11:25:42,116][123091] Updated weights for policy 0, policy_version 1481978 (0.0010) [2023-12-26 11:25:42,173][123091] Updated weights for policy 0, policy_version 1481988 (0.0010) [2023-12-26 11:25:42,223][123091] Updated weights for policy 0, policy_version 1481998 (0.0009) [2023-12-26 11:25:42,251][123090] Updated weights for policy 1, policy_version 1472289 (0.0010) [2023-12-26 11:25:42,321][123090] Updated weights for policy 1, policy_version 1472299 (0.0010) [2023-12-26 11:25:42,391][123090] Updated weights for policy 1, policy_version 1472309 (0.0008) [2023-12-26 11:25:42,460][123090] Updated weights for policy 1, policy_version 1472319 (0.0009) [2023-12-26 11:25:43,151][123090] Updated weights for policy 1, policy_version 1472329 (0.0006) [2023-12-26 11:25:43,171][123091] Updated weights for policy 0, policy_version 1482008 (0.0010) [2023-12-26 11:25:43,213][123090] Updated weights for policy 1, policy_version 1472339 (0.0008) [2023-12-26 11:25:43,224][123091] Updated weights for policy 0, policy_version 1482018 (0.0008) [2023-12-26 11:25:43,268][123090] Updated weights for policy 1, policy_version 1472349 (0.0007) [2023-12-26 11:25:43,278][123091] Updated weights for policy 0, policy_version 1482028 (0.0010) [2023-12-26 11:25:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 756326400. Throughput: 0: 8927.5, 1: 8776.8. Samples: 756321684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:25:43,786][121949] Avg episode reward: [(0, '6310.911'), (1, '5141.550')] [2023-12-26 11:25:43,982][123090] Updated weights for policy 1, policy_version 1472359 (0.0005) [2023-12-26 11:25:44,031][123090] Updated weights for policy 1, policy_version 1472369 (0.0005) [2023-12-26 11:25:44,089][123090] Updated weights for policy 1, policy_version 1472379 (0.0005) [2023-12-26 11:25:44,169][123091] Updated weights for policy 0, policy_version 1482038 (0.0009) [2023-12-26 11:25:44,232][123091] Updated weights for policy 0, policy_version 1482048 (0.0009) [2023-12-26 11:25:44,292][123091] Updated weights for policy 0, policy_version 1482058 (0.0008) [2023-12-26 11:25:44,849][123090] Updated weights for policy 1, policy_version 1472389 (0.0007) [2023-12-26 11:25:44,923][123090] Updated weights for policy 1, policy_version 1472399 (0.0010) [2023-12-26 11:25:44,983][123090] Updated weights for policy 1, policy_version 1472409 (0.0011) [2023-12-26 11:25:45,154][123091] Updated weights for policy 0, policy_version 1482068 (0.0009) [2023-12-26 11:25:45,211][123091] Updated weights for policy 0, policy_version 1482078 (0.0009) [2023-12-26 11:25:45,277][123091] Updated weights for policy 0, policy_version 1482088 (0.0009) [2023-12-26 11:25:45,743][123090] Updated weights for policy 1, policy_version 1472419 (0.0011) [2023-12-26 11:25:45,791][123090] Updated weights for policy 1, policy_version 1472429 (0.0010) [2023-12-26 11:25:45,839][123090] Updated weights for policy 1, policy_version 1472439 (0.0010) [2023-12-26 11:25:46,148][123091] Updated weights for policy 0, policy_version 1482098 (0.0010) [2023-12-26 11:25:46,201][123091] Updated weights for policy 0, policy_version 1482108 (0.0009) [2023-12-26 11:25:46,258][123091] Updated weights for policy 0, policy_version 1482118 (0.0009) [2023-12-26 11:25:46,311][123091] Updated weights for policy 0, policy_version 1482128 (0.0009) [2023-12-26 11:25:46,649][123090] Updated weights for policy 1, policy_version 1472449 (0.0010) [2023-12-26 11:25:46,720][123090] Updated weights for policy 1, policy_version 1472459 (0.0005) [2023-12-26 11:25:46,777][123090] Updated weights for policy 1, policy_version 1472469 (0.0007) [2023-12-26 11:25:46,834][123090] Updated weights for policy 1, policy_version 1472479 (0.0006) [2023-12-26 11:25:47,218][123091] Updated weights for policy 0, policy_version 1482138 (0.0009) [2023-12-26 11:25:47,281][123091] Updated weights for policy 0, policy_version 1482148 (0.0010) [2023-12-26 11:25:47,338][123091] Updated weights for policy 0, policy_version 1482158 (0.0009) [2023-12-26 11:25:47,610][123090] Updated weights for policy 1, policy_version 1472489 (0.0010) [2023-12-26 11:25:47,675][123090] Updated weights for policy 1, policy_version 1472499 (0.0009) [2023-12-26 11:25:47,744][123090] Updated weights for policy 1, policy_version 1472509 (0.0010) [2023-12-26 11:25:48,171][123091] Updated weights for policy 0, policy_version 1482168 (0.0009) [2023-12-26 11:25:48,227][123091] Updated weights for policy 0, policy_version 1482178 (0.0010) [2023-12-26 11:25:48,280][123091] Updated weights for policy 0, policy_version 1482188 (0.0009) [2023-12-26 11:25:48,519][123090] Updated weights for policy 1, policy_version 1472519 (0.0010) [2023-12-26 11:25:48,582][123090] Updated weights for policy 1, policy_version 1472529 (0.0010) [2023-12-26 11:25:48,640][123090] Updated weights for policy 1, policy_version 1472539 (0.0009) [2023-12-26 11:25:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 756416512. Throughput: 0: 8889.3, 1: 8747.1. Samples: 756425120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:25:48,785][121949] Avg episode reward: [(0, '6271.547'), (1, '5255.477')] [2023-12-26 11:25:49,113][123091] Updated weights for policy 0, policy_version 1482198 (0.0010) [2023-12-26 11:25:49,159][123091] Updated weights for policy 0, policy_version 1482208 (0.0008) [2023-12-26 11:25:49,212][123091] Updated weights for policy 0, policy_version 1482218 (0.0009) [2023-12-26 11:25:49,499][123090] Updated weights for policy 1, policy_version 1472549 (0.0009) [2023-12-26 11:25:49,558][123090] Updated weights for policy 1, policy_version 1472560 (0.0010) [2023-12-26 11:25:49,611][123090] Updated weights for policy 1, policy_version 1472570 (0.0009) [2023-12-26 11:25:50,055][123091] Updated weights for policy 0, policy_version 1482228 (0.0010) [2023-12-26 11:25:50,104][123091] Updated weights for policy 0, policy_version 1482238 (0.0010) [2023-12-26 11:25:50,156][123091] Updated weights for policy 0, policy_version 1482248 (0.0010) [2023-12-26 11:25:50,405][123090] Updated weights for policy 1, policy_version 1472580 (0.0009) [2023-12-26 11:25:50,472][123090] Updated weights for policy 1, policy_version 1472590 (0.0008) [2023-12-26 11:25:50,531][123090] Updated weights for policy 1, policy_version 1472600 (0.0005) [2023-12-26 11:25:51,007][123091] Updated weights for policy 0, policy_version 1482258 (0.0011) [2023-12-26 11:25:51,086][123091] Updated weights for policy 0, policy_version 1482268 (0.0011) [2023-12-26 11:25:51,156][123091] Updated weights for policy 0, policy_version 1482278 (0.0010) [2023-12-26 11:25:51,218][123091] Updated weights for policy 0, policy_version 1482288 (0.0009) [2023-12-26 11:25:51,290][123090] Updated weights for policy 1, policy_version 1472610 (0.0008) [2023-12-26 11:25:51,364][123090] Updated weights for policy 1, policy_version 1472620 (0.0006) [2023-12-26 11:25:51,434][123090] Updated weights for policy 1, policy_version 1472630 (0.0006) [2023-12-26 11:25:51,510][123090] Updated weights for policy 1, policy_version 1472640 (0.0005) [2023-12-26 11:25:52,010][123091] Updated weights for policy 0, policy_version 1482298 (0.0006) [2023-12-26 11:25:52,072][123091] Updated weights for policy 0, policy_version 1482308 (0.0006) [2023-12-26 11:25:52,144][123091] Updated weights for policy 0, policy_version 1482318 (0.0006) [2023-12-26 11:25:52,310][123090] Updated weights for policy 1, policy_version 1472650 (0.0009) [2023-12-26 11:25:52,363][123090] Updated weights for policy 1, policy_version 1472661 (0.0010) [2023-12-26 11:25:52,435][123090] Updated weights for policy 1, policy_version 1472671 (0.0010) [2023-12-26 11:25:52,824][123091] Updated weights for policy 0, policy_version 1482328 (0.0006) [2023-12-26 11:25:52,886][123091] Updated weights for policy 0, policy_version 1482338 (0.0005) [2023-12-26 11:25:52,947][123091] Updated weights for policy 0, policy_version 1482348 (0.0006) [2023-12-26 11:25:53,341][123090] Updated weights for policy 1, policy_version 1472681 (0.0009) [2023-12-26 11:25:53,394][123090] Updated weights for policy 1, policy_version 1472691 (0.0009) [2023-12-26 11:25:53,444][123090] Updated weights for policy 1, policy_version 1472701 (0.0009) [2023-12-26 11:25:53,714][123091] Updated weights for policy 0, policy_version 1482358 (0.0005) [2023-12-26 11:25:53,780][123091] Updated weights for policy 0, policy_version 1482368 (0.0006) [2023-12-26 11:25:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 756498432. Throughput: 0: 8863.0, 1: 8739.4. Samples: 756476728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:25:53,785][121949] Avg episode reward: [(0, '6208.480'), (1, '5267.601')] [2023-12-26 11:25:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001472704_377012224.pth... [2023-12-26 11:25:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001471680_376750080.pth [2023-12-26 11:25:53,830][123091] Updated weights for policy 0, policy_version 1482378 (0.0006) [2023-12-26 11:25:53,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001482384_379494400.pth... [2023-12-26 11:25:53,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001481328_379224064.pth [2023-12-26 11:25:54,334][123090] Updated weights for policy 1, policy_version 1472711 (0.0008) [2023-12-26 11:25:54,393][123090] Updated weights for policy 1, policy_version 1472721 (0.0009) [2023-12-26 11:25:54,450][123090] Updated weights for policy 1, policy_version 1472731 (0.0008) [2023-12-26 11:25:54,582][123091] Updated weights for policy 0, policy_version 1482388 (0.0007) [2023-12-26 11:25:54,647][123091] Updated weights for policy 0, policy_version 1482398 (0.0009) [2023-12-26 11:25:54,710][123091] Updated weights for policy 0, policy_version 1482408 (0.0009) [2023-12-26 11:25:55,226][123090] Updated weights for policy 1, policy_version 1472741 (0.0007) [2023-12-26 11:25:55,296][123090] Updated weights for policy 1, policy_version 1472751 (0.0009) [2023-12-26 11:25:55,358][123090] Updated weights for policy 1, policy_version 1472761 (0.0010) [2023-12-26 11:25:55,504][123091] Updated weights for policy 0, policy_version 1482418 (0.0008) [2023-12-26 11:25:55,550][123091] Updated weights for policy 0, policy_version 1482428 (0.0005) [2023-12-26 11:25:55,606][123091] Updated weights for policy 0, policy_version 1482438 (0.0005) [2023-12-26 11:25:55,658][123091] Updated weights for policy 0, policy_version 1482448 (0.0007) [2023-12-26 11:25:56,238][123091] Updated weights for policy 0, policy_version 1482458 (0.0006) [2023-12-26 11:25:56,290][123091] Updated weights for policy 0, policy_version 1482468 (0.0006) [2023-12-26 11:25:56,303][123090] Updated weights for policy 1, policy_version 1472771 (0.0010) [2023-12-26 11:25:56,348][123091] Updated weights for policy 0, policy_version 1482478 (0.0008) [2023-12-26 11:25:56,351][123090] Updated weights for policy 1, policy_version 1472781 (0.0009) [2023-12-26 11:25:56,401][123090] Updated weights for policy 1, policy_version 1472791 (0.0008) [2023-12-26 11:25:57,038][123091] Updated weights for policy 0, policy_version 1482488 (0.0006) [2023-12-26 11:25:57,087][123091] Updated weights for policy 0, policy_version 1482498 (0.0008) [2023-12-26 11:25:57,138][123091] Updated weights for policy 0, policy_version 1482508 (0.0010) [2023-12-26 11:25:57,306][123090] Updated weights for policy 1, policy_version 1472801 (0.0008) [2023-12-26 11:25:57,366][123090] Updated weights for policy 1, policy_version 1472811 (0.0008) [2023-12-26 11:25:57,424][123090] Updated weights for policy 1, policy_version 1472821 (0.0009) [2023-12-26 11:25:57,483][123090] Updated weights for policy 1, policy_version 1472831 (0.0008) [2023-12-26 11:25:57,965][123091] Updated weights for policy 0, policy_version 1482518 (0.0010) [2023-12-26 11:25:58,019][123091] Updated weights for policy 0, policy_version 1482528 (0.0010) [2023-12-26 11:25:58,086][123091] Updated weights for policy 0, policy_version 1482538 (0.0008) [2023-12-26 11:25:58,279][123090] Updated weights for policy 1, policy_version 1472841 (0.0008) [2023-12-26 11:25:58,358][123090] Updated weights for policy 1, policy_version 1472851 (0.0008) [2023-12-26 11:25:58,427][123090] Updated weights for policy 1, policy_version 1472861 (0.0007) [2023-12-26 11:25:58,785][121949] Fps is (10 sec: 17202.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 756588544. Throughput: 0: 8977.6, 1: 8640.9. Samples: 756583000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:25:58,785][121949] Avg episode reward: [(0, '6330.188'), (1, '5340.074')] [2023-12-26 11:25:58,941][123091] Updated weights for policy 0, policy_version 1482548 (0.0008) [2023-12-26 11:25:59,006][123091] Updated weights for policy 0, policy_version 1482558 (0.0008) [2023-12-26 11:25:59,072][123091] Updated weights for policy 0, policy_version 1482568 (0.0008) [2023-12-26 11:25:59,193][123090] Updated weights for policy 1, policy_version 1472871 (0.0007) [2023-12-26 11:25:59,260][123090] Updated weights for policy 1, policy_version 1472881 (0.0007) [2023-12-26 11:25:59,328][123090] Updated weights for policy 1, policy_version 1472891 (0.0005) [2023-12-26 11:25:59,811][123091] Updated weights for policy 0, policy_version 1482578 (0.0007) [2023-12-26 11:25:59,882][123091] Updated weights for policy 0, policy_version 1482588 (0.0011) [2023-12-26 11:25:59,947][123091] Updated weights for policy 0, policy_version 1482598 (0.0010) [2023-12-26 11:26:00,019][123091] Updated weights for policy 0, policy_version 1482608 (0.0010) [2023-12-26 11:26:00,131][123090] Updated weights for policy 1, policy_version 1472901 (0.0008) [2023-12-26 11:26:00,188][123090] Updated weights for policy 1, policy_version 1472911 (0.0009) [2023-12-26 11:26:00,236][123090] Updated weights for policy 1, policy_version 1472921 (0.0008) [2023-12-26 11:26:00,780][123091] Updated weights for policy 0, policy_version 1482618 (0.0009) [2023-12-26 11:26:00,839][123091] Updated weights for policy 0, policy_version 1482628 (0.0009) [2023-12-26 11:26:00,891][123091] Updated weights for policy 0, policy_version 1482638 (0.0009) [2023-12-26 11:26:01,056][123090] Updated weights for policy 1, policy_version 1472931 (0.0008) [2023-12-26 11:26:01,124][123090] Updated weights for policy 1, policy_version 1472941 (0.0010) [2023-12-26 11:26:01,187][123090] Updated weights for policy 1, policy_version 1472951 (0.0009) [2023-12-26 11:26:01,718][123091] Updated weights for policy 0, policy_version 1482648 (0.0009) [2023-12-26 11:26:01,793][123091] Updated weights for policy 0, policy_version 1482658 (0.0007) [2023-12-26 11:26:01,868][123091] Updated weights for policy 0, policy_version 1482668 (0.0006) [2023-12-26 11:26:01,945][123090] Updated weights for policy 1, policy_version 1472961 (0.0009) [2023-12-26 11:26:02,011][123090] Updated weights for policy 1, policy_version 1472971 (0.0009) [2023-12-26 11:26:02,072][123090] Updated weights for policy 1, policy_version 1472981 (0.0009) [2023-12-26 11:26:02,133][123090] Updated weights for policy 1, policy_version 1472991 (0.0009) [2023-12-26 11:26:02,576][123091] Updated weights for policy 0, policy_version 1482678 (0.0007) [2023-12-26 11:26:02,649][123091] Updated weights for policy 0, policy_version 1482688 (0.0008) [2023-12-26 11:26:02,719][123091] Updated weights for policy 0, policy_version 1482698 (0.0010) [2023-12-26 11:26:02,977][123090] Updated weights for policy 1, policy_version 1473001 (0.0008) [2023-12-26 11:26:03,042][123090] Updated weights for policy 1, policy_version 1473011 (0.0009) [2023-12-26 11:26:03,096][123090] Updated weights for policy 1, policy_version 1473021 (0.0009) [2023-12-26 11:26:03,499][123091] Updated weights for policy 0, policy_version 1482708 (0.0009) [2023-12-26 11:26:03,552][123091] Updated weights for policy 0, policy_version 1482718 (0.0009) [2023-12-26 11:26:03,617][123091] Updated weights for policy 0, policy_version 1482728 (0.0009) [2023-12-26 11:26:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 756678656. Throughput: 0: 8882.3, 1: 8646.1. Samples: 756687932. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:03,785][121949] Avg episode reward: [(0, '6347.743'), (1, '5421.344')] [2023-12-26 11:26:03,889][123090] Updated weights for policy 1, policy_version 1473031 (0.0007) [2023-12-26 11:26:03,952][123090] Updated weights for policy 1, policy_version 1473041 (0.0005) [2023-12-26 11:26:04,015][123090] Updated weights for policy 1, policy_version 1473051 (0.0006) [2023-12-26 11:26:04,507][123091] Updated weights for policy 0, policy_version 1482738 (0.0010) [2023-12-26 11:26:04,561][123091] Updated weights for policy 0, policy_version 1482748 (0.0008) [2023-12-26 11:26:04,611][123091] Updated weights for policy 0, policy_version 1482758 (0.0007) [2023-12-26 11:26:04,664][123091] Updated weights for policy 0, policy_version 1482768 (0.0005) [2023-12-26 11:26:04,743][123090] Updated weights for policy 1, policy_version 1473061 (0.0008) [2023-12-26 11:26:04,792][123090] Updated weights for policy 1, policy_version 1473071 (0.0005) [2023-12-26 11:26:04,842][123090] Updated weights for policy 1, policy_version 1473081 (0.0005) [2023-12-26 11:26:05,393][123091] Updated weights for policy 0, policy_version 1482778 (0.0006) [2023-12-26 11:26:05,454][123091] Updated weights for policy 0, policy_version 1482788 (0.0005) [2023-12-26 11:26:05,524][123091] Updated weights for policy 0, policy_version 1482798 (0.0006) [2023-12-26 11:26:05,536][123090] Updated weights for policy 1, policy_version 1473091 (0.0007) [2023-12-26 11:26:05,594][123090] Updated weights for policy 1, policy_version 1473101 (0.0010) [2023-12-26 11:26:05,656][123090] Updated weights for policy 1, policy_version 1473111 (0.0005) [2023-12-26 11:26:06,239][123091] Updated weights for policy 0, policy_version 1482808 (0.0007) [2023-12-26 11:26:06,309][123091] Updated weights for policy 0, policy_version 1482818 (0.0007) [2023-12-26 11:26:06,377][123091] Updated weights for policy 0, policy_version 1482828 (0.0006) [2023-12-26 11:26:06,428][123090] Updated weights for policy 1, policy_version 1473121 (0.0006) [2023-12-26 11:26:06,496][123090] Updated weights for policy 1, policy_version 1473131 (0.0009) [2023-12-26 11:26:06,564][123090] Updated weights for policy 1, policy_version 1473141 (0.0009) [2023-12-26 11:26:06,633][123090] Updated weights for policy 1, policy_version 1473151 (0.0010) [2023-12-26 11:26:07,040][123091] Updated weights for policy 0, policy_version 1482838 (0.0009) [2023-12-26 11:26:07,101][123091] Updated weights for policy 0, policy_version 1482848 (0.0007) [2023-12-26 11:26:07,175][123091] Updated weights for policy 0, policy_version 1482858 (0.0009) [2023-12-26 11:26:07,465][123090] Updated weights for policy 1, policy_version 1473161 (0.0010) [2023-12-26 11:26:07,530][123090] Updated weights for policy 1, policy_version 1473172 (0.0009) [2023-12-26 11:26:07,595][123090] Updated weights for policy 1, policy_version 1473182 (0.0009) [2023-12-26 11:26:07,944][123091] Updated weights for policy 0, policy_version 1482868 (0.0008) [2023-12-26 11:26:07,996][123091] Updated weights for policy 0, policy_version 1482878 (0.0010) [2023-12-26 11:26:08,054][123091] Updated weights for policy 0, policy_version 1482888 (0.0010) [2023-12-26 11:26:08,413][123090] Updated weights for policy 1, policy_version 1473192 (0.0009) [2023-12-26 11:26:08,480][123090] Updated weights for policy 1, policy_version 1473202 (0.0005) [2023-12-26 11:26:08,541][123090] Updated weights for policy 1, policy_version 1473212 (0.0007) [2023-12-26 11:26:08,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 756768768. Throughput: 0: 8946.7, 1: 8685.1. Samples: 756744624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:08,785][121949] Avg episode reward: [(0, '6208.058'), (1, '5482.722')] [2023-12-26 11:26:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001482896_379625472.pth... [2023-12-26 11:26:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001473216_377143296.pth... [2023-12-26 11:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001481872_379363328.pth [2023-12-26 11:26:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001472192_376881152.pth [2023-12-26 11:26:08,834][123091] Updated weights for policy 0, policy_version 1482898 (0.0009) [2023-12-26 11:26:08,901][123091] Updated weights for policy 0, policy_version 1482908 (0.0007) [2023-12-26 11:26:08,953][123091] Updated weights for policy 0, policy_version 1482918 (0.0010) [2023-12-26 11:26:09,001][123091] Updated weights for policy 0, policy_version 1482928 (0.0009) [2023-12-26 11:26:09,414][123090] Updated weights for policy 1, policy_version 1473222 (0.0009) [2023-12-26 11:26:09,465][123090] Updated weights for policy 1, policy_version 1473232 (0.0009) [2023-12-26 11:26:09,515][123090] Updated weights for policy 1, policy_version 1473242 (0.0009) [2023-12-26 11:26:09,773][123091] Updated weights for policy 0, policy_version 1482938 (0.0010) [2023-12-26 11:26:09,831][123091] Updated weights for policy 0, policy_version 1482948 (0.0010) [2023-12-26 11:26:09,899][123091] Updated weights for policy 0, policy_version 1482958 (0.0010) [2023-12-26 11:26:10,420][123090] Updated weights for policy 1, policy_version 1473252 (0.0010) [2023-12-26 11:26:10,480][123090] Updated weights for policy 1, policy_version 1473262 (0.0010) [2023-12-26 11:26:10,533][123090] Updated weights for policy 1, policy_version 1473272 (0.0009) [2023-12-26 11:26:10,748][123091] Updated weights for policy 0, policy_version 1482968 (0.0009) [2023-12-26 11:26:10,812][123091] Updated weights for policy 0, policy_version 1482978 (0.0009) [2023-12-26 11:26:10,873][123091] Updated weights for policy 0, policy_version 1482988 (0.0010) [2023-12-26 11:26:11,415][123090] Updated weights for policy 1, policy_version 1473282 (0.0009) [2023-12-26 11:26:11,485][123090] Updated weights for policy 1, policy_version 1473292 (0.0006) [2023-12-26 11:26:11,557][123090] Updated weights for policy 1, policy_version 1473302 (0.0008) [2023-12-26 11:26:11,623][123090] Updated weights for policy 1, policy_version 1473312 (0.0010) [2023-12-26 11:26:11,727][123091] Updated weights for policy 0, policy_version 1482998 (0.0009) [2023-12-26 11:26:11,791][123091] Updated weights for policy 0, policy_version 1483008 (0.0008) [2023-12-26 11:26:11,857][123091] Updated weights for policy 0, policy_version 1483018 (0.0008) [2023-12-26 11:26:12,502][123090] Updated weights for policy 1, policy_version 1473322 (0.0005) [2023-12-26 11:26:12,562][123090] Updated weights for policy 1, policy_version 1473332 (0.0006) [2023-12-26 11:26:12,619][123090] Updated weights for policy 1, policy_version 1473342 (0.0008) [2023-12-26 11:26:12,663][123091] Updated weights for policy 0, policy_version 1483028 (0.0009) [2023-12-26 11:26:12,724][123091] Updated weights for policy 0, policy_version 1483038 (0.0010) [2023-12-26 11:26:12,789][123091] Updated weights for policy 0, policy_version 1483048 (0.0010) [2023-12-26 11:26:13,484][123090] Updated weights for policy 1, policy_version 1473352 (0.0006) [2023-12-26 11:26:13,533][123091] Updated weights for policy 0, policy_version 1483058 (0.0009) [2023-12-26 11:26:13,553][123090] Updated weights for policy 1, policy_version 1473362 (0.0007) [2023-12-26 11:26:13,598][123091] Updated weights for policy 0, policy_version 1483068 (0.0005) [2023-12-26 11:26:13,618][123090] Updated weights for policy 1, policy_version 1473372 (0.0009) [2023-12-26 11:26:13,666][123091] Updated weights for policy 0, policy_version 1483078 (0.0005) [2023-12-26 11:26:13,719][123091] Updated weights for policy 0, policy_version 1483088 (0.0005) [2023-12-26 11:26:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 756858880. Throughput: 0: 8784.7, 1: 8577.4. Samples: 756846672. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:13,785][121949] Avg episode reward: [(0, '6314.549'), (1, '5489.892')] [2023-12-26 11:26:14,388][123090] Updated weights for policy 1, policy_version 1473382 (0.0009) [2023-12-26 11:26:14,450][123090] Updated weights for policy 1, policy_version 1473392 (0.0008) [2023-12-26 11:26:14,465][123091] Updated weights for policy 0, policy_version 1483098 (0.0011) [2023-12-26 11:26:14,513][123090] Updated weights for policy 1, policy_version 1473402 (0.0005) [2023-12-26 11:26:14,527][123091] Updated weights for policy 0, policy_version 1483108 (0.0011) [2023-12-26 11:26:14,578][123091] Updated weights for policy 0, policy_version 1483118 (0.0010) [2023-12-26 11:26:15,367][123091] Updated weights for policy 0, policy_version 1483128 (0.0008) [2023-12-26 11:26:15,376][123090] Updated weights for policy 1, policy_version 1473412 (0.0007) [2023-12-26 11:26:15,428][123091] Updated weights for policy 0, policy_version 1483138 (0.0009) [2023-12-26 11:26:15,443][123090] Updated weights for policy 1, policy_version 1473422 (0.0007) [2023-12-26 11:26:15,492][123091] Updated weights for policy 0, policy_version 1483148 (0.0011) [2023-12-26 11:26:15,504][123090] Updated weights for policy 1, policy_version 1473432 (0.0007) [2023-12-26 11:26:16,248][123091] Updated weights for policy 0, policy_version 1483158 (0.0011) [2023-12-26 11:26:16,310][123091] Updated weights for policy 0, policy_version 1483168 (0.0011) [2023-12-26 11:26:16,354][123090] Updated weights for policy 1, policy_version 1473442 (0.0008) [2023-12-26 11:26:16,380][123091] Updated weights for policy 0, policy_version 1483178 (0.0011) [2023-12-26 11:26:16,413][123090] Updated weights for policy 1, policy_version 1473452 (0.0008) [2023-12-26 11:26:16,464][123090] Updated weights for policy 1, policy_version 1473462 (0.0009) [2023-12-26 11:26:16,520][123090] Updated weights for policy 1, policy_version 1473472 (0.0009) [2023-12-26 11:26:17,180][123091] Updated weights for policy 0, policy_version 1483188 (0.0009) [2023-12-26 11:26:17,235][123091] Updated weights for policy 0, policy_version 1483198 (0.0005) [2023-12-26 11:26:17,259][123090] Updated weights for policy 1, policy_version 1473482 (0.0009) [2023-12-26 11:26:17,287][123091] Updated weights for policy 0, policy_version 1483208 (0.0009) [2023-12-26 11:26:17,316][123090] Updated weights for policy 1, policy_version 1473492 (0.0008) [2023-12-26 11:26:17,367][123090] Updated weights for policy 1, policy_version 1473502 (0.0009) [2023-12-26 11:26:17,921][123091] Updated weights for policy 0, policy_version 1483218 (0.0008) [2023-12-26 11:26:17,973][123091] Updated weights for policy 0, policy_version 1483228 (0.0008) [2023-12-26 11:26:18,036][123091] Updated weights for policy 0, policy_version 1483238 (0.0009) [2023-12-26 11:26:18,087][123091] Updated weights for policy 0, policy_version 1483248 (0.0009) [2023-12-26 11:26:18,268][123090] Updated weights for policy 1, policy_version 1473512 (0.0010) [2023-12-26 11:26:18,324][123090] Updated weights for policy 1, policy_version 1473522 (0.0010) [2023-12-26 11:26:18,393][123090] Updated weights for policy 1, policy_version 1473532 (0.0010) [2023-12-26 11:26:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 756940800. Throughput: 0: 8777.2, 1: 8594.4. Samples: 756952904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:18,785][121949] Avg episode reward: [(0, '6290.938'), (1, '5425.244')] [2023-12-26 11:26:18,938][123091] Updated weights for policy 0, policy_version 1483258 (0.0010) [2023-12-26 11:26:19,008][123091] Updated weights for policy 0, policy_version 1483268 (0.0010) [2023-12-26 11:26:19,071][123091] Updated weights for policy 0, policy_version 1483278 (0.0009) [2023-12-26 11:26:19,223][123090] Updated weights for policy 1, policy_version 1473542 (0.0011) [2023-12-26 11:26:19,293][123090] Updated weights for policy 1, policy_version 1473552 (0.0009) [2023-12-26 11:26:19,366][123090] Updated weights for policy 1, policy_version 1473562 (0.0009) [2023-12-26 11:26:19,933][123091] Updated weights for policy 0, policy_version 1483288 (0.0010) [2023-12-26 11:26:19,997][123091] Updated weights for policy 0, policy_version 1483298 (0.0010) [2023-12-26 11:26:20,067][123091] Updated weights for policy 0, policy_version 1483308 (0.0009) [2023-12-26 11:26:20,193][123090] Updated weights for policy 1, policy_version 1473572 (0.0008) [2023-12-26 11:26:20,267][123090] Updated weights for policy 1, policy_version 1473582 (0.0010) [2023-12-26 11:26:20,337][123090] Updated weights for policy 1, policy_version 1473592 (0.0010) [2023-12-26 11:26:20,911][123091] Updated weights for policy 0, policy_version 1483318 (0.0010) [2023-12-26 11:26:20,968][123091] Updated weights for policy 0, policy_version 1483328 (0.0009) [2023-12-26 11:26:21,025][123091] Updated weights for policy 0, policy_version 1483338 (0.0009) [2023-12-26 11:26:21,124][123090] Updated weights for policy 1, policy_version 1473602 (0.0009) [2023-12-26 11:26:21,192][123090] Updated weights for policy 1, policy_version 1473612 (0.0009) [2023-12-26 11:26:21,262][123090] Updated weights for policy 1, policy_version 1473622 (0.0010) [2023-12-26 11:26:21,938][123091] Updated weights for policy 0, policy_version 1483348 (0.0008) [2023-12-26 11:26:22,002][123091] Updated weights for policy 0, policy_version 1483358 (0.0008) [2023-12-26 11:26:22,058][123091] Updated weights for policy 0, policy_version 1483368 (0.0007) [2023-12-26 11:26:22,164][123090] Updated weights for policy 1, policy_version 1473633 (0.0009) [2023-12-26 11:26:22,228][123090] Updated weights for policy 1, policy_version 1473643 (0.0009) [2023-12-26 11:26:22,285][123090] Updated weights for policy 1, policy_version 1473653 (0.0009) [2023-12-26 11:26:22,352][123090] Updated weights for policy 1, policy_version 1473663 (0.0009) [2023-12-26 11:26:22,915][123091] Updated weights for policy 0, policy_version 1483378 (0.0008) [2023-12-26 11:26:22,986][123091] Updated weights for policy 0, policy_version 1483388 (0.0011) [2023-12-26 11:26:23,042][123091] Updated weights for policy 0, policy_version 1483398 (0.0011) [2023-12-26 11:26:23,098][123091] Updated weights for policy 0, policy_version 1483408 (0.0010) [2023-12-26 11:26:23,200][123090] Updated weights for policy 1, policy_version 1473673 (0.0008) [2023-12-26 11:26:23,253][123090] Updated weights for policy 1, policy_version 1473683 (0.0009) [2023-12-26 11:26:23,310][123090] Updated weights for policy 1, policy_version 1473693 (0.0009) [2023-12-26 11:26:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 757022720. Throughput: 0: 8764.9, 1: 8594.3. Samples: 757002804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:23,785][121949] Avg episode reward: [(0, '6232.893'), (1, '5485.189')] [2023-12-26 11:26:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001473696_377266176.pth... [2023-12-26 11:26:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001472704_377012224.pth [2023-12-26 11:26:23,856][123091] Updated weights for policy 0, policy_version 1483418 (0.0011) [2023-12-26 11:26:23,919][123091] Updated weights for policy 0, policy_version 1483428 (0.0007) [2023-12-26 11:26:23,967][123091] Updated weights for policy 0, policy_version 1483438 (0.0005) [2023-12-26 11:26:23,977][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001483440_379764736.pth... [2023-12-26 11:26:23,980][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001482384_379494400.pth [2023-12-26 11:26:24,177][123090] Updated weights for policy 1, policy_version 1473703 (0.0009) [2023-12-26 11:26:24,241][123090] Updated weights for policy 1, policy_version 1473713 (0.0008) [2023-12-26 11:26:24,301][123090] Updated weights for policy 1, policy_version 1473723 (0.0009) [2023-12-26 11:26:24,745][123091] Updated weights for policy 0, policy_version 1483448 (0.0010) [2023-12-26 11:26:24,793][123091] Updated weights for policy 0, policy_version 1483458 (0.0010) [2023-12-26 11:26:24,847][123091] Updated weights for policy 0, policy_version 1483468 (0.0010) [2023-12-26 11:26:25,147][123090] Updated weights for policy 1, policy_version 1473733 (0.0008) [2023-12-26 11:26:25,195][123090] Updated weights for policy 1, policy_version 1473743 (0.0009) [2023-12-26 11:26:25,255][123090] Updated weights for policy 1, policy_version 1473753 (0.0009) [2023-12-26 11:26:25,619][123091] Updated weights for policy 0, policy_version 1483478 (0.0010) [2023-12-26 11:26:25,663][123091] Updated weights for policy 0, policy_version 1483488 (0.0010) [2023-12-26 11:26:25,718][123091] Updated weights for policy 0, policy_version 1483498 (0.0010) [2023-12-26 11:26:26,114][123090] Updated weights for policy 1, policy_version 1473763 (0.0009) [2023-12-26 11:26:26,166][123090] Updated weights for policy 1, policy_version 1473773 (0.0009) [2023-12-26 11:26:26,219][123090] Updated weights for policy 1, policy_version 1473783 (0.0009) [2023-12-26 11:26:26,569][123091] Updated weights for policy 0, policy_version 1483508 (0.0010) [2023-12-26 11:26:26,624][123091] Updated weights for policy 0, policy_version 1483518 (0.0010) [2023-12-26 11:26:26,675][123091] Updated weights for policy 0, policy_version 1483528 (0.0010) [2023-12-26 11:26:27,083][123090] Updated weights for policy 1, policy_version 1473793 (0.0009) [2023-12-26 11:26:27,135][123090] Updated weights for policy 1, policy_version 1473803 (0.0008) [2023-12-26 11:26:27,183][123090] Updated weights for policy 1, policy_version 1473813 (0.0008) [2023-12-26 11:26:27,242][123090] Updated weights for policy 1, policy_version 1473823 (0.0009) [2023-12-26 11:26:27,517][123091] Updated weights for policy 0, policy_version 1483538 (0.0010) [2023-12-26 11:26:27,589][123091] Updated weights for policy 0, policy_version 1483548 (0.0010) [2023-12-26 11:26:27,651][123091] Updated weights for policy 0, policy_version 1483558 (0.0010) [2023-12-26 11:26:27,695][123091] Updated weights for policy 0, policy_version 1483568 (0.0010) [2023-12-26 11:26:28,022][123090] Updated weights for policy 1, policy_version 1473833 (0.0007) [2023-12-26 11:26:28,084][123090] Updated weights for policy 1, policy_version 1473843 (0.0006) [2023-12-26 11:26:28,155][123090] Updated weights for policy 1, policy_version 1473853 (0.0007) [2023-12-26 11:26:28,424][123091] Updated weights for policy 0, policy_version 1483578 (0.0011) [2023-12-26 11:26:28,485][123091] Updated weights for policy 0, policy_version 1483588 (0.0009) [2023-12-26 11:26:28,533][123091] Updated weights for policy 0, policy_version 1483598 (0.0010) [2023-12-26 11:26:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 757112832. Throughput: 0: 8829.5, 1: 8587.9. Samples: 757105468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:28,785][121949] Avg episode reward: [(0, '6234.279'), (1, '5490.818')] [2023-12-26 11:26:28,853][123090] Updated weights for policy 1, policy_version 1473863 (0.0009) [2023-12-26 11:26:28,915][123090] Updated weights for policy 1, policy_version 1473873 (0.0008) [2023-12-26 11:26:28,974][123090] Updated weights for policy 1, policy_version 1473883 (0.0010) [2023-12-26 11:26:29,316][123091] Updated weights for policy 0, policy_version 1483608 (0.0007) [2023-12-26 11:26:29,407][123091] Updated weights for policy 0, policy_version 1483618 (0.0007) [2023-12-26 11:26:29,485][123091] Updated weights for policy 0, policy_version 1483628 (0.0008) [2023-12-26 11:26:29,695][123090] Updated weights for policy 1, policy_version 1473893 (0.0008) [2023-12-26 11:26:29,759][123090] Updated weights for policy 1, policy_version 1473903 (0.0005) [2023-12-26 11:26:29,834][123090] Updated weights for policy 1, policy_version 1473913 (0.0006) [2023-12-26 11:26:30,205][123091] Updated weights for policy 0, policy_version 1483638 (0.0007) [2023-12-26 11:26:30,268][123091] Updated weights for policy 0, policy_version 1483648 (0.0005) [2023-12-26 11:26:30,333][123091] Updated weights for policy 0, policy_version 1483658 (0.0005) [2023-12-26 11:26:30,632][123090] Updated weights for policy 1, policy_version 1473923 (0.0008) [2023-12-26 11:26:30,700][123090] Updated weights for policy 1, policy_version 1473933 (0.0009) [2023-12-26 11:26:30,764][123090] Updated weights for policy 1, policy_version 1473943 (0.0009) [2023-12-26 11:26:31,059][123091] Updated weights for policy 0, policy_version 1483668 (0.0008) [2023-12-26 11:26:31,122][123091] Updated weights for policy 0, policy_version 1483678 (0.0010) [2023-12-26 11:26:31,194][123091] Updated weights for policy 0, policy_version 1483688 (0.0009) [2023-12-26 11:26:31,576][123090] Updated weights for policy 1, policy_version 1473953 (0.0010) [2023-12-26 11:26:31,640][123090] Updated weights for policy 1, policy_version 1473963 (0.0009) [2023-12-26 11:26:31,688][123090] Updated weights for policy 1, policy_version 1473973 (0.0008) [2023-12-26 11:26:31,757][123090] Updated weights for policy 1, policy_version 1473983 (0.0009) [2023-12-26 11:26:32,047][123091] Updated weights for policy 0, policy_version 1483698 (0.0009) [2023-12-26 11:26:32,105][123091] Updated weights for policy 0, policy_version 1483708 (0.0009) [2023-12-26 11:26:32,173][123091] Updated weights for policy 0, policy_version 1483718 (0.0009) [2023-12-26 11:26:32,242][123091] Updated weights for policy 0, policy_version 1483728 (0.0009) [2023-12-26 11:26:32,578][123090] Updated weights for policy 1, policy_version 1473993 (0.0008) [2023-12-26 11:26:32,639][123090] Updated weights for policy 1, policy_version 1474003 (0.0008) [2023-12-26 11:26:32,705][123090] Updated weights for policy 1, policy_version 1474013 (0.0010) [2023-12-26 11:26:33,037][123091] Updated weights for policy 0, policy_version 1483738 (0.0009) [2023-12-26 11:26:33,098][123091] Updated weights for policy 0, policy_version 1483748 (0.0008) [2023-12-26 11:26:33,159][123091] Updated weights for policy 0, policy_version 1483758 (0.0008) [2023-12-26 11:26:33,444][123090] Updated weights for policy 1, policy_version 1474023 (0.0007) [2023-12-26 11:26:33,507][123090] Updated weights for policy 1, policy_version 1474033 (0.0005) [2023-12-26 11:26:33,561][123090] Updated weights for policy 1, policy_version 1474043 (0.0005) [2023-12-26 11:26:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 757202944. Throughput: 0: 8943.7, 1: 8589.5. Samples: 757214116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:33,785][121949] Avg episode reward: [(0, '6308.060'), (1, '5227.937')] [2023-12-26 11:26:33,886][123091] Updated weights for policy 0, policy_version 1483768 (0.0007) [2023-12-26 11:26:33,942][123091] Updated weights for policy 0, policy_version 1483778 (0.0006) [2023-12-26 11:26:33,999][123091] Updated weights for policy 0, policy_version 1483788 (0.0006) [2023-12-26 11:26:34,221][123090] Updated weights for policy 1, policy_version 1474053 (0.0008) [2023-12-26 11:26:34,294][123090] Updated weights for policy 1, policy_version 1474063 (0.0008) [2023-12-26 11:26:34,364][123090] Updated weights for policy 1, policy_version 1474073 (0.0007) [2023-12-26 11:26:34,734][123091] Updated weights for policy 0, policy_version 1483798 (0.0005) [2023-12-26 11:26:34,792][123091] Updated weights for policy 0, policy_version 1483808 (0.0007) [2023-12-26 11:26:34,851][123091] Updated weights for policy 0, policy_version 1483818 (0.0006) [2023-12-26 11:26:35,139][123090] Updated weights for policy 1, policy_version 1474083 (0.0007) [2023-12-26 11:26:35,201][123090] Updated weights for policy 1, policy_version 1474093 (0.0010) [2023-12-26 11:26:35,252][123090] Updated weights for policy 1, policy_version 1474103 (0.0010) [2023-12-26 11:26:35,612][123091] Updated weights for policy 0, policy_version 1483828 (0.0008) [2023-12-26 11:26:35,674][123091] Updated weights for policy 0, policy_version 1483838 (0.0011) [2023-12-26 11:26:35,731][123091] Updated weights for policy 0, policy_version 1483848 (0.0011) [2023-12-26 11:26:36,091][123090] Updated weights for policy 1, policy_version 1474113 (0.0010) [2023-12-26 11:26:36,157][123090] Updated weights for policy 1, policy_version 1474123 (0.0010) [2023-12-26 11:26:36,212][123090] Updated weights for policy 1, policy_version 1474133 (0.0010) [2023-12-26 11:26:36,276][123090] Updated weights for policy 1, policy_version 1474143 (0.0010) [2023-12-26 11:26:36,536][123091] Updated weights for policy 0, policy_version 1483858 (0.0010) [2023-12-26 11:26:36,593][123091] Updated weights for policy 0, policy_version 1483868 (0.0011) [2023-12-26 11:26:36,649][123091] Updated weights for policy 0, policy_version 1483878 (0.0011) [2023-12-26 11:26:36,702][123091] Updated weights for policy 0, policy_version 1483888 (0.0010) [2023-12-26 11:26:37,113][123090] Updated weights for policy 1, policy_version 1474153 (0.0009) [2023-12-26 11:26:37,175][123090] Updated weights for policy 1, policy_version 1474163 (0.0008) [2023-12-26 11:26:37,238][123090] Updated weights for policy 1, policy_version 1474173 (0.0007) [2023-12-26 11:26:37,533][123091] Updated weights for policy 0, policy_version 1483898 (0.0005) [2023-12-26 11:26:37,594][123091] Updated weights for policy 0, policy_version 1483908 (0.0007) [2023-12-26 11:26:37,656][123091] Updated weights for policy 0, policy_version 1483918 (0.0007) [2023-12-26 11:26:38,065][123090] Updated weights for policy 1, policy_version 1474183 (0.0010) [2023-12-26 11:26:38,130][123090] Updated weights for policy 1, policy_version 1474193 (0.0010) [2023-12-26 11:26:38,195][123090] Updated weights for policy 1, policy_version 1474203 (0.0010) [2023-12-26 11:26:38,445][123091] Updated weights for policy 0, policy_version 1483928 (0.0009) [2023-12-26 11:26:38,506][123091] Updated weights for policy 0, policy_version 1483938 (0.0010) [2023-12-26 11:26:38,558][123091] Updated weights for policy 0, policy_version 1483948 (0.0009) [2023-12-26 11:26:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 757293056. Throughput: 0: 9006.5, 1: 8611.2. Samples: 757269524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:38,785][121949] Avg episode reward: [(0, '6309.583'), (1, '5395.577')] [2023-12-26 11:26:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001483952_379895808.pth... [2023-12-26 11:26:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001474208_377397248.pth... [2023-12-26 11:26:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001482896_379625472.pth [2023-12-26 11:26:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001473216_377143296.pth [2023-12-26 11:26:39,056][123090] Updated weights for policy 1, policy_version 1474213 (0.0010) [2023-12-26 11:26:39,116][123090] Updated weights for policy 1, policy_version 1474223 (0.0009) [2023-12-26 11:26:39,173][123090] Updated weights for policy 1, policy_version 1474233 (0.0008) [2023-12-26 11:26:39,416][123091] Updated weights for policy 0, policy_version 1483958 (0.0009) [2023-12-26 11:26:39,478][123091] Updated weights for policy 0, policy_version 1483968 (0.0007) [2023-12-26 11:26:39,544][123091] Updated weights for policy 0, policy_version 1483978 (0.0010) [2023-12-26 11:26:40,090][123090] Updated weights for policy 1, policy_version 1474243 (0.0009) [2023-12-26 11:26:40,148][123090] Updated weights for policy 1, policy_version 1474253 (0.0009) [2023-12-26 11:26:40,215][123090] Updated weights for policy 1, policy_version 1474263 (0.0009) [2023-12-26 11:26:40,298][123091] Updated weights for policy 0, policy_version 1483988 (0.0009) [2023-12-26 11:26:40,363][123091] Updated weights for policy 0, policy_version 1483998 (0.0009) [2023-12-26 11:26:40,426][123091] Updated weights for policy 0, policy_version 1484008 (0.0007) [2023-12-26 11:26:41,033][123090] Updated weights for policy 1, policy_version 1474273 (0.0009) [2023-12-26 11:26:41,099][123090] Updated weights for policy 1, policy_version 1474283 (0.0007) [2023-12-26 11:26:41,170][123090] Updated weights for policy 1, policy_version 1474293 (0.0007) [2023-12-26 11:26:41,223][123091] Updated weights for policy 0, policy_version 1484019 (0.0010) [2023-12-26 11:26:41,248][123090] Updated weights for policy 1, policy_version 1474303 (0.0006) [2023-12-26 11:26:41,286][123091] Updated weights for policy 0, policy_version 1484029 (0.0009) [2023-12-26 11:26:41,340][123091] Updated weights for policy 0, policy_version 1484039 (0.0009) [2023-12-26 11:26:42,005][123090] Updated weights for policy 1, policy_version 1474313 (0.0009) [2023-12-26 11:26:42,061][123090] Updated weights for policy 1, policy_version 1474323 (0.0009) [2023-12-26 11:26:42,112][123090] Updated weights for policy 1, policy_version 1474333 (0.0008) [2023-12-26 11:26:42,236][123091] Updated weights for policy 0, policy_version 1484049 (0.0009) [2023-12-26 11:26:42,305][123091] Updated weights for policy 0, policy_version 1484059 (0.0009) [2023-12-26 11:26:42,370][123091] Updated weights for policy 0, policy_version 1484069 (0.0010) [2023-12-26 11:26:42,439][123091] Updated weights for policy 0, policy_version 1484079 (0.0010) [2023-12-26 11:26:42,974][123090] Updated weights for policy 1, policy_version 1474343 (0.0010) [2023-12-26 11:26:43,037][123090] Updated weights for policy 1, policy_version 1474353 (0.0009) [2023-12-26 11:26:43,102][123090] Updated weights for policy 1, policy_version 1474363 (0.0010) [2023-12-26 11:26:43,254][123091] Updated weights for policy 0, policy_version 1484089 (0.0009) [2023-12-26 11:26:43,314][123091] Updated weights for policy 0, policy_version 1484099 (0.0009) [2023-12-26 11:26:43,362][123091] Updated weights for policy 0, policy_version 1484109 (0.0009) [2023-12-26 11:26:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 757374976. Throughput: 0: 8869.9, 1: 8653.4. Samples: 757371540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:43,785][121949] Avg episode reward: [(0, '6277.337'), (1, '5506.310')] [2023-12-26 11:26:43,887][123090] Updated weights for policy 1, policy_version 1474373 (0.0010) [2023-12-26 11:26:43,942][123090] Updated weights for policy 1, policy_version 1474383 (0.0010) [2023-12-26 11:26:43,998][123090] Updated weights for policy 1, policy_version 1474393 (0.0009) [2023-12-26 11:26:44,201][123091] Updated weights for policy 0, policy_version 1484119 (0.0010) [2023-12-26 11:26:44,252][123091] Updated weights for policy 0, policy_version 1484129 (0.0009) [2023-12-26 11:26:44,310][123091] Updated weights for policy 0, policy_version 1484139 (0.0010) [2023-12-26 11:26:44,807][123090] Updated weights for policy 1, policy_version 1474403 (0.0008) [2023-12-26 11:26:44,879][123090] Updated weights for policy 1, policy_version 1474413 (0.0009) [2023-12-26 11:26:44,950][123090] Updated weights for policy 1, policy_version 1474423 (0.0010) [2023-12-26 11:26:45,172][123091] Updated weights for policy 0, policy_version 1484150 (0.0007) [2023-12-26 11:26:45,239][123091] Updated weights for policy 0, policy_version 1484160 (0.0006) [2023-12-26 11:26:45,315][123091] Updated weights for policy 0, policy_version 1484170 (0.0006) [2023-12-26 11:26:45,825][123090] Updated weights for policy 1, policy_version 1474433 (0.0010) [2023-12-26 11:26:45,881][123090] Updated weights for policy 1, policy_version 1474443 (0.0009) [2023-12-26 11:26:45,936][123090] Updated weights for policy 1, policy_version 1474453 (0.0009) [2023-12-26 11:26:46,003][123090] Updated weights for policy 1, policy_version 1474463 (0.0009) [2023-12-26 11:26:46,018][123091] Updated weights for policy 0, policy_version 1484180 (0.0008) [2023-12-26 11:26:46,072][123091] Updated weights for policy 0, policy_version 1484190 (0.0010) [2023-12-26 11:26:46,131][123091] Updated weights for policy 0, policy_version 1484200 (0.0009) [2023-12-26 11:26:46,837][123090] Updated weights for policy 1, policy_version 1474473 (0.0007) [2023-12-26 11:26:46,901][123090] Updated weights for policy 1, policy_version 1474483 (0.0005) [2023-12-26 11:26:46,971][123091] Updated weights for policy 0, policy_version 1484210 (0.0009) [2023-12-26 11:26:46,972][123090] Updated weights for policy 1, policy_version 1474493 (0.0005) [2023-12-26 11:26:47,022][123091] Updated weights for policy 0, policy_version 1484220 (0.0009) [2023-12-26 11:26:47,075][123091] Updated weights for policy 0, policy_version 1484230 (0.0010) [2023-12-26 11:26:47,130][123091] Updated weights for policy 0, policy_version 1484240 (0.0010) [2023-12-26 11:26:47,675][123090] Updated weights for policy 1, policy_version 1474504 (0.0009) [2023-12-26 11:26:47,734][123090] Updated weights for policy 1, policy_version 1474514 (0.0010) [2023-12-26 11:26:47,794][123090] Updated weights for policy 1, policy_version 1474524 (0.0010) [2023-12-26 11:26:47,958][123091] Updated weights for policy 0, policy_version 1484250 (0.0006) [2023-12-26 11:26:48,033][123091] Updated weights for policy 0, policy_version 1484260 (0.0006) [2023-12-26 11:26:48,105][123091] Updated weights for policy 0, policy_version 1484270 (0.0005) [2023-12-26 11:26:48,656][123090] Updated weights for policy 1, policy_version 1474534 (0.0009) [2023-12-26 11:26:48,705][123090] Updated weights for policy 1, policy_version 1474544 (0.0009) [2023-12-26 11:26:48,755][123090] Updated weights for policy 1, policy_version 1474554 (0.0009) [2023-12-26 11:26:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 757456896. Throughput: 0: 8887.3, 1: 8629.5. Samples: 757476188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:48,785][121949] Avg episode reward: [(0, '6215.962'), (1, '5657.138')] [2023-12-26 11:26:48,820][123091] Updated weights for policy 0, policy_version 1484280 (0.0009) [2023-12-26 11:26:48,883][123091] Updated weights for policy 0, policy_version 1484290 (0.0010) [2023-12-26 11:26:48,948][123091] Updated weights for policy 0, policy_version 1484300 (0.0010) [2023-12-26 11:26:49,592][123091] Updated weights for policy 0, policy_version 1484310 (0.0006) [2023-12-26 11:26:49,661][123091] Updated weights for policy 0, policy_version 1484320 (0.0009) [2023-12-26 11:26:49,673][123090] Updated weights for policy 1, policy_version 1474564 (0.0009) [2023-12-26 11:26:49,718][123091] Updated weights for policy 0, policy_version 1484330 (0.0010) [2023-12-26 11:26:49,729][123090] Updated weights for policy 1, policy_version 1474574 (0.0008) [2023-12-26 11:26:49,799][123090] Updated weights for policy 1, policy_version 1474584 (0.0009) [2023-12-26 11:26:50,584][123091] Updated weights for policy 0, policy_version 1484340 (0.0009) [2023-12-26 11:26:50,651][123091] Updated weights for policy 0, policy_version 1484350 (0.0011) [2023-12-26 11:26:50,659][123090] Updated weights for policy 1, policy_version 1474594 (0.0009) [2023-12-26 11:26:50,715][123091] Updated weights for policy 0, policy_version 1484360 (0.0011) [2023-12-26 11:26:50,720][123090] Updated weights for policy 1, policy_version 1474604 (0.0007) [2023-12-26 11:26:50,781][123090] Updated weights for policy 1, policy_version 1474614 (0.0007) [2023-12-26 11:26:50,851][123090] Updated weights for policy 1, policy_version 1474624 (0.0005) [2023-12-26 11:26:51,454][123090] Updated weights for policy 1, policy_version 1474634 (0.0010) [2023-12-26 11:26:51,506][123090] Updated weights for policy 1, policy_version 1474644 (0.0010) [2023-12-26 11:26:51,568][123091] Updated weights for policy 0, policy_version 1484370 (0.0010) [2023-12-26 11:26:51,573][123090] Updated weights for policy 1, policy_version 1474654 (0.0010) [2023-12-26 11:26:51,646][123091] Updated weights for policy 0, policy_version 1484380 (0.0010) [2023-12-26 11:26:51,707][123091] Updated weights for policy 0, policy_version 1484390 (0.0010) [2023-12-26 11:26:51,779][123091] Updated weights for policy 0, policy_version 1484400 (0.0011) [2023-12-26 11:26:52,401][123090] Updated weights for policy 1, policy_version 1474664 (0.0009) [2023-12-26 11:26:52,456][123090] Updated weights for policy 1, policy_version 1474674 (0.0008) [2023-12-26 11:26:52,512][123090] Updated weights for policy 1, policy_version 1474684 (0.0005) [2023-12-26 11:26:52,602][123091] Updated weights for policy 0, policy_version 1484410 (0.0009) [2023-12-26 11:26:52,673][123091] Updated weights for policy 0, policy_version 1484420 (0.0007) [2023-12-26 11:26:52,740][123091] Updated weights for policy 0, policy_version 1484430 (0.0010) [2023-12-26 11:26:53,344][123090] Updated weights for policy 1, policy_version 1474694 (0.0006) [2023-12-26 11:26:53,400][123090] Updated weights for policy 1, policy_version 1474704 (0.0005) [2023-12-26 11:26:53,405][123091] Updated weights for policy 0, policy_version 1484440 (0.0006) [2023-12-26 11:26:53,465][123090] Updated weights for policy 1, policy_version 1474714 (0.0006) [2023-12-26 11:26:53,473][123091] Updated weights for policy 0, policy_version 1484450 (0.0005) [2023-12-26 11:26:53,527][123091] Updated weights for policy 0, policy_version 1484460 (0.0005) [2023-12-26 11:26:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 757555200. Throughput: 0: 8836.5, 1: 8574.3. Samples: 757528108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:53,785][121949] Avg episode reward: [(0, '6307.422'), (1, '5631.132')] [2023-12-26 11:26:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001484464_380026880.pth... [2023-12-26 11:26:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001474720_377528320.pth... [2023-12-26 11:26:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001483440_379764736.pth [2023-12-26 11:26:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001473696_377266176.pth [2023-12-26 11:26:54,167][123091] Updated weights for policy 0, policy_version 1484470 (0.0008) [2023-12-26 11:26:54,233][123091] Updated weights for policy 0, policy_version 1484480 (0.0010) [2023-12-26 11:26:54,256][123090] Updated weights for policy 1, policy_version 1474724 (0.0009) [2023-12-26 11:26:54,296][123091] Updated weights for policy 0, policy_version 1484490 (0.0010) [2023-12-26 11:26:54,308][123090] Updated weights for policy 1, policy_version 1474734 (0.0006) [2023-12-26 11:26:54,361][123090] Updated weights for policy 1, policy_version 1474744 (0.0009) [2023-12-26 11:26:55,108][123091] Updated weights for policy 0, policy_version 1484500 (0.0010) [2023-12-26 11:26:55,168][123091] Updated weights for policy 0, policy_version 1484510 (0.0010) [2023-12-26 11:26:55,200][123090] Updated weights for policy 1, policy_version 1474754 (0.0009) [2023-12-26 11:26:55,223][123091] Updated weights for policy 0, policy_version 1484520 (0.0010) [2023-12-26 11:26:55,247][123090] Updated weights for policy 1, policy_version 1474764 (0.0006) [2023-12-26 11:26:55,308][123090] Updated weights for policy 1, policy_version 1474774 (0.0007) [2023-12-26 11:26:55,361][123090] Updated weights for policy 1, policy_version 1474784 (0.0009) [2023-12-26 11:26:55,977][123091] Updated weights for policy 0, policy_version 1484530 (0.0009) [2023-12-26 11:26:56,042][123091] Updated weights for policy 0, policy_version 1484540 (0.0005) [2023-12-26 11:26:56,092][123091] Updated weights for policy 0, policy_version 1484550 (0.0005) [2023-12-26 11:26:56,145][123091] Updated weights for policy 0, policy_version 1484560 (0.0005) [2023-12-26 11:26:56,260][123090] Updated weights for policy 1, policy_version 1474794 (0.0010) [2023-12-26 11:26:56,324][123090] Updated weights for policy 1, policy_version 1474804 (0.0010) [2023-12-26 11:26:56,381][123090] Updated weights for policy 1, policy_version 1474814 (0.0010) [2023-12-26 11:26:56,822][123091] Updated weights for policy 0, policy_version 1484570 (0.0005) [2023-12-26 11:26:56,878][123091] Updated weights for policy 0, policy_version 1484580 (0.0008) [2023-12-26 11:26:56,934][123091] Updated weights for policy 0, policy_version 1484590 (0.0009) [2023-12-26 11:26:57,294][123090] Updated weights for policy 1, policy_version 1474824 (0.0009) [2023-12-26 11:26:57,350][123090] Updated weights for policy 1, policy_version 1474834 (0.0010) [2023-12-26 11:26:57,412][123090] Updated weights for policy 1, policy_version 1474844 (0.0007) [2023-12-26 11:26:57,518][123091] Updated weights for policy 0, policy_version 1484600 (0.0006) [2023-12-26 11:26:57,575][123091] Updated weights for policy 0, policy_version 1484610 (0.0006) [2023-12-26 11:26:57,633][123091] Updated weights for policy 0, policy_version 1484620 (0.0005) [2023-12-26 11:26:58,228][123090] Updated weights for policy 1, policy_version 1474854 (0.0008) [2023-12-26 11:26:58,297][123090] Updated weights for policy 1, policy_version 1474864 (0.0009) [2023-12-26 11:26:58,372][123090] Updated weights for policy 1, policy_version 1474874 (0.0009) [2023-12-26 11:26:58,386][123091] Updated weights for policy 0, policy_version 1484630 (0.0007) [2023-12-26 11:26:58,454][123091] Updated weights for policy 0, policy_version 1484640 (0.0009) [2023-12-26 11:26:58,530][123091] Updated weights for policy 0, policy_version 1484650 (0.0009) [2023-12-26 11:26:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17613.0, 300 sec: 17689.2). Total num frames: 757645312. Throughput: 0: 8962.6, 1: 8594.1. Samples: 757636724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:26:58,785][121949] Avg episode reward: [(0, '6357.992'), (1, '5523.189')] [2023-12-26 11:26:59,241][123090] Updated weights for policy 1, policy_version 1474884 (0.0008) [2023-12-26 11:26:59,311][123090] Updated weights for policy 1, policy_version 1474894 (0.0009) [2023-12-26 11:26:59,354][123091] Updated weights for policy 0, policy_version 1484660 (0.0010) [2023-12-26 11:26:59,379][123090] Updated weights for policy 1, policy_version 1474904 (0.0009) [2023-12-26 11:26:59,426][123091] Updated weights for policy 0, policy_version 1484670 (0.0010) [2023-12-26 11:26:59,485][123091] Updated weights for policy 0, policy_version 1484680 (0.0009) [2023-12-26 11:27:00,199][123091] Updated weights for policy 0, policy_version 1484690 (0.0009) [2023-12-26 11:27:00,249][123091] Updated weights for policy 0, policy_version 1484700 (0.0009) [2023-12-26 11:27:00,257][123090] Updated weights for policy 1, policy_version 1474914 (0.0006) [2023-12-26 11:27:00,297][123091] Updated weights for policy 0, policy_version 1484710 (0.0007) [2023-12-26 11:27:00,307][123090] Updated weights for policy 1, policy_version 1474924 (0.0009) [2023-12-26 11:27:00,367][123090] Updated weights for policy 1, policy_version 1474934 (0.0009) [2023-12-26 11:27:00,439][123090] Updated weights for policy 1, policy_version 1474944 (0.0010) [2023-12-26 11:27:01,139][123091] Updated weights for policy 0, policy_version 1484721 (0.0007) [2023-12-26 11:27:01,205][123091] Updated weights for policy 0, policy_version 1484731 (0.0006) [2023-12-26 11:27:01,267][123091] Updated weights for policy 0, policy_version 1484741 (0.0006) [2023-12-26 11:27:01,268][123090] Updated weights for policy 1, policy_version 1474954 (0.0008) [2023-12-26 11:27:01,324][123091] Updated weights for policy 0, policy_version 1484751 (0.0008) [2023-12-26 11:27:01,328][123090] Updated weights for policy 1, policy_version 1474964 (0.0005) [2023-12-26 11:27:01,408][123090] Updated weights for policy 1, policy_version 1474975 (0.0008) [2023-12-26 11:27:02,106][123091] Updated weights for policy 0, policy_version 1484761 (0.0011) [2023-12-26 11:27:02,109][123090] Updated weights for policy 1, policy_version 1474985 (0.0006) [2023-12-26 11:27:02,162][123091] Updated weights for policy 0, policy_version 1484771 (0.0011) [2023-12-26 11:27:02,167][123090] Updated weights for policy 1, policy_version 1474995 (0.0005) [2023-12-26 11:27:02,208][123091] Updated weights for policy 0, policy_version 1484781 (0.0005) [2023-12-26 11:27:02,247][123090] Updated weights for policy 1, policy_version 1475005 (0.0005) [2023-12-26 11:27:02,946][123091] Updated weights for policy 0, policy_version 1484791 (0.0007) [2023-12-26 11:27:02,990][123090] Updated weights for policy 1, policy_version 1475015 (0.0007) [2023-12-26 11:27:03,015][123091] Updated weights for policy 0, policy_version 1484801 (0.0008) [2023-12-26 11:27:03,041][123090] Updated weights for policy 1, policy_version 1475025 (0.0005) [2023-12-26 11:27:03,081][123091] Updated weights for policy 0, policy_version 1484811 (0.0006) [2023-12-26 11:27:03,098][123090] Updated weights for policy 1, policy_version 1475035 (0.0006) [2023-12-26 11:27:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 757727232. Throughput: 0: 8951.2, 1: 8611.2. Samples: 757743208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:03,785][121949] Avg episode reward: [(0, '6356.289'), (1, '5141.403')] [2023-12-26 11:27:03,791][123091] Updated weights for policy 0, policy_version 1484821 (0.0006) [2023-12-26 11:27:03,860][123091] Updated weights for policy 0, policy_version 1484831 (0.0007) [2023-12-26 11:27:03,917][123091] Updated weights for policy 0, policy_version 1484841 (0.0006) [2023-12-26 11:27:03,939][123090] Updated weights for policy 1, policy_version 1475045 (0.0009) [2023-12-26 11:27:03,997][123090] Updated weights for policy 1, policy_version 1475055 (0.0008) [2023-12-26 11:27:04,060][123090] Updated weights for policy 1, policy_version 1475065 (0.0009) [2023-12-26 11:27:04,691][123091] Updated weights for policy 0, policy_version 1484851 (0.0009) [2023-12-26 11:27:04,753][123091] Updated weights for policy 0, policy_version 1484861 (0.0010) [2023-12-26 11:27:04,811][123091] Updated weights for policy 0, policy_version 1484871 (0.0011) [2023-12-26 11:27:04,891][123090] Updated weights for policy 1, policy_version 1475075 (0.0009) [2023-12-26 11:27:04,954][123090] Updated weights for policy 1, policy_version 1475085 (0.0009) [2023-12-26 11:27:05,012][123090] Updated weights for policy 1, policy_version 1475095 (0.0008) [2023-12-26 11:27:05,627][123091] Updated weights for policy 0, policy_version 1484881 (0.0010) [2023-12-26 11:27:05,677][123091] Updated weights for policy 0, policy_version 1484891 (0.0010) [2023-12-26 11:27:05,739][123091] Updated weights for policy 0, policy_version 1484901 (0.0010) [2023-12-26 11:27:05,793][123091] Updated weights for policy 0, policy_version 1484911 (0.0010) [2023-12-26 11:27:05,820][123090] Updated weights for policy 1, policy_version 1475105 (0.0009) [2023-12-26 11:27:05,875][123090] Updated weights for policy 1, policy_version 1475115 (0.0009) [2023-12-26 11:27:05,936][123090] Updated weights for policy 1, policy_version 1475125 (0.0009) [2023-12-26 11:27:05,989][123090] Updated weights for policy 1, policy_version 1475135 (0.0009) [2023-12-26 11:27:06,629][123091] Updated weights for policy 0, policy_version 1484921 (0.0011) [2023-12-26 11:27:06,691][123091] Updated weights for policy 0, policy_version 1484931 (0.0011) [2023-12-26 11:27:06,750][123091] Updated weights for policy 0, policy_version 1484941 (0.0011) [2023-12-26 11:27:06,762][123090] Updated weights for policy 1, policy_version 1475145 (0.0005) [2023-12-26 11:27:06,813][123090] Updated weights for policy 1, policy_version 1475155 (0.0005) [2023-12-26 11:27:06,864][123090] Updated weights for policy 1, policy_version 1475165 (0.0005) [2023-12-26 11:27:07,573][123091] Updated weights for policy 0, policy_version 1484951 (0.0010) [2023-12-26 11:27:07,617][123090] Updated weights for policy 1, policy_version 1475175 (0.0006) [2023-12-26 11:27:07,640][123091] Updated weights for policy 0, policy_version 1484961 (0.0011) [2023-12-26 11:27:07,684][123090] Updated weights for policy 1, policy_version 1475185 (0.0006) [2023-12-26 11:27:07,707][123091] Updated weights for policy 0, policy_version 1484971 (0.0011) [2023-12-26 11:27:07,747][123090] Updated weights for policy 1, policy_version 1475195 (0.0006) [2023-12-26 11:27:08,502][123090] Updated weights for policy 1, policy_version 1475205 (0.0008) [2023-12-26 11:27:08,528][123091] Updated weights for policy 0, policy_version 1484981 (0.0011) [2023-12-26 11:27:08,567][123090] Updated weights for policy 1, policy_version 1475215 (0.0011) [2023-12-26 11:27:08,593][123091] Updated weights for policy 0, policy_version 1484991 (0.0011) [2023-12-26 11:27:08,628][123090] Updated weights for policy 1, policy_version 1475225 (0.0011) [2023-12-26 11:27:08,657][123091] Updated weights for policy 0, policy_version 1485001 (0.0011) [2023-12-26 11:27:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 757825536. Throughput: 0: 8987.3, 1: 8623.0. Samples: 757795268. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:08,785][121949] Avg episode reward: [(0, '6382.357'), (1, '5093.384')] [2023-12-26 11:27:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001485008_380166144.pth... [2023-12-26 11:27:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001475232_377659392.pth... [2023-12-26 11:27:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001483952_379895808.pth [2023-12-26 11:27:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001474208_377397248.pth [2023-12-26 11:27:09,471][123090] Updated weights for policy 1, policy_version 1475235 (0.0011) [2023-12-26 11:27:09,514][123091] Updated weights for policy 0, policy_version 1485011 (0.0010) [2023-12-26 11:27:09,528][123090] Updated weights for policy 1, policy_version 1475245 (0.0010) [2023-12-26 11:27:09,566][123091] Updated weights for policy 0, policy_version 1485021 (0.0008) [2023-12-26 11:27:09,593][123090] Updated weights for policy 1, policy_version 1475255 (0.0011) [2023-12-26 11:27:09,615][123091] Updated weights for policy 0, policy_version 1485031 (0.0008) [2023-12-26 11:27:10,441][123091] Updated weights for policy 0, policy_version 1485041 (0.0008) [2023-12-26 11:27:10,453][123090] Updated weights for policy 1, policy_version 1475265 (0.0010) [2023-12-26 11:27:10,504][123091] Updated weights for policy 0, policy_version 1485051 (0.0011) [2023-12-26 11:27:10,506][123090] Updated weights for policy 1, policy_version 1475275 (0.0010) [2023-12-26 11:27:10,559][123090] Updated weights for policy 1, policy_version 1475285 (0.0010) [2023-12-26 11:27:10,570][123091] Updated weights for policy 0, policy_version 1485061 (0.0011) [2023-12-26 11:27:10,612][123090] Updated weights for policy 1, policy_version 1475295 (0.0010) [2023-12-26 11:27:10,633][123091] Updated weights for policy 0, policy_version 1485071 (0.0010) [2023-12-26 11:27:11,448][123091] Updated weights for policy 0, policy_version 1485081 (0.0009) [2023-12-26 11:27:11,478][123090] Updated weights for policy 1, policy_version 1475305 (0.0010) [2023-12-26 11:27:11,508][123091] Updated weights for policy 0, policy_version 1485091 (0.0009) [2023-12-26 11:27:11,541][123090] Updated weights for policy 1, policy_version 1475315 (0.0010) [2023-12-26 11:27:11,571][123091] Updated weights for policy 0, policy_version 1485101 (0.0009) [2023-12-26 11:27:11,609][123090] Updated weights for policy 1, policy_version 1475325 (0.0006) [2023-12-26 11:27:12,406][123091] Updated weights for policy 0, policy_version 1485111 (0.0009) [2023-12-26 11:27:12,413][123090] Updated weights for policy 1, policy_version 1475335 (0.0008) [2023-12-26 11:27:12,468][123091] Updated weights for policy 0, policy_version 1485121 (0.0008) [2023-12-26 11:27:12,475][123090] Updated weights for policy 1, policy_version 1475345 (0.0006) [2023-12-26 11:27:12,531][123091] Updated weights for policy 0, policy_version 1485131 (0.0008) [2023-12-26 11:27:12,537][123090] Updated weights for policy 1, policy_version 1475355 (0.0006) [2023-12-26 11:27:13,153][123091] Updated weights for policy 0, policy_version 1485141 (0.0007) [2023-12-26 11:27:13,219][123091] Updated weights for policy 0, policy_version 1485151 (0.0005) [2023-12-26 11:27:13,244][123090] Updated weights for policy 1, policy_version 1475365 (0.0009) [2023-12-26 11:27:13,274][123091] Updated weights for policy 0, policy_version 1485161 (0.0005) [2023-12-26 11:27:13,298][123090] Updated weights for policy 1, policy_version 1475375 (0.0009) [2023-12-26 11:27:13,364][123090] Updated weights for policy 1, policy_version 1475385 (0.0010) [2023-12-26 11:27:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 757907456. Throughput: 0: 8959.3, 1: 8666.9. Samples: 757898640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:13,785][121949] Avg episode reward: [(0, '6364.526'), (1, '5233.547')] [2023-12-26 11:27:13,924][123091] Updated weights for policy 0, policy_version 1485171 (0.0006) [2023-12-26 11:27:13,991][123091] Updated weights for policy 0, policy_version 1485181 (0.0009) [2023-12-26 11:27:14,056][123091] Updated weights for policy 0, policy_version 1485191 (0.0010) [2023-12-26 11:27:14,193][123090] Updated weights for policy 1, policy_version 1475395 (0.0009) [2023-12-26 11:27:14,261][123090] Updated weights for policy 1, policy_version 1475405 (0.0009) [2023-12-26 11:27:14,313][123090] Updated weights for policy 1, policy_version 1475415 (0.0006) [2023-12-26 11:27:14,894][123091] Updated weights for policy 0, policy_version 1485201 (0.0009) [2023-12-26 11:27:14,955][123091] Updated weights for policy 0, policy_version 1485211 (0.0006) [2023-12-26 11:27:14,994][123090] Updated weights for policy 1, policy_version 1475425 (0.0005) [2023-12-26 11:27:15,030][123091] Updated weights for policy 0, policy_version 1485221 (0.0006) [2023-12-26 11:27:15,064][123090] Updated weights for policy 1, policy_version 1475435 (0.0010) [2023-12-26 11:27:15,092][123091] Updated weights for policy 0, policy_version 1485231 (0.0008) [2023-12-26 11:27:15,128][123090] Updated weights for policy 1, policy_version 1475445 (0.0007) [2023-12-26 11:27:15,198][123090] Updated weights for policy 1, policy_version 1475455 (0.0011) [2023-12-26 11:27:15,908][123090] Updated weights for policy 1, policy_version 1475465 (0.0007) [2023-12-26 11:27:15,923][123091] Updated weights for policy 0, policy_version 1485241 (0.0009) [2023-12-26 11:27:15,960][123090] Updated weights for policy 1, policy_version 1475475 (0.0005) [2023-12-26 11:27:15,979][123091] Updated weights for policy 0, policy_version 1485251 (0.0008) [2023-12-26 11:27:16,014][123090] Updated weights for policy 1, policy_version 1475485 (0.0006) [2023-12-26 11:27:16,032][123091] Updated weights for policy 0, policy_version 1485261 (0.0010) [2023-12-26 11:27:16,660][123090] Updated weights for policy 1, policy_version 1475495 (0.0009) [2023-12-26 11:27:16,712][123090] Updated weights for policy 1, policy_version 1475505 (0.0010) [2023-12-26 11:27:16,771][123090] Updated weights for policy 1, policy_version 1475515 (0.0010) [2023-12-26 11:27:16,931][123091] Updated weights for policy 0, policy_version 1485271 (0.0007) [2023-12-26 11:27:16,994][123091] Updated weights for policy 0, policy_version 1485281 (0.0005) [2023-12-26 11:27:17,059][123091] Updated weights for policy 0, policy_version 1485291 (0.0008) [2023-12-26 11:27:17,527][123090] Updated weights for policy 1, policy_version 1475525 (0.0008) [2023-12-26 11:27:17,583][123090] Updated weights for policy 1, policy_version 1475535 (0.0005) [2023-12-26 11:27:17,635][123090] Updated weights for policy 1, policy_version 1475545 (0.0005) [2023-12-26 11:27:17,945][123091] Updated weights for policy 0, policy_version 1485301 (0.0010) [2023-12-26 11:27:17,999][123091] Updated weights for policy 0, policy_version 1485311 (0.0010) [2023-12-26 11:27:18,051][123091] Updated weights for policy 0, policy_version 1485321 (0.0009) [2023-12-26 11:27:18,294][123090] Updated weights for policy 1, policy_version 1475555 (0.0005) [2023-12-26 11:27:18,370][123090] Updated weights for policy 1, policy_version 1475565 (0.0009) [2023-12-26 11:27:18,442][123090] Updated weights for policy 1, policy_version 1475575 (0.0011) [2023-12-26 11:27:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 757997568. Throughput: 0: 8921.7, 1: 8766.5. Samples: 758010084. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:18,785][121949] Avg episode reward: [(0, '6292.782'), (1, '5371.227')] [2023-12-26 11:27:18,921][123091] Updated weights for policy 0, policy_version 1485331 (0.0010) [2023-12-26 11:27:18,975][123091] Updated weights for policy 0, policy_version 1485341 (0.0010) [2023-12-26 11:27:19,029][123091] Updated weights for policy 0, policy_version 1485352 (0.0010) [2023-12-26 11:27:19,186][123090] Updated weights for policy 1, policy_version 1475585 (0.0010) [2023-12-26 11:27:19,259][123090] Updated weights for policy 1, policy_version 1475595 (0.0007) [2023-12-26 11:27:19,318][123090] Updated weights for policy 1, policy_version 1475605 (0.0007) [2023-12-26 11:27:19,388][123090] Updated weights for policy 1, policy_version 1475615 (0.0014) [2023-12-26 11:27:20,014][123091] Updated weights for policy 0, policy_version 1485363 (0.0010) [2023-12-26 11:27:20,059][123090] Updated weights for policy 1, policy_version 1475625 (0.0010) [2023-12-26 11:27:20,079][123091] Updated weights for policy 0, policy_version 1485373 (0.0006) [2023-12-26 11:27:20,128][123090] Updated weights for policy 1, policy_version 1475635 (0.0008) [2023-12-26 11:27:20,148][123091] Updated weights for policy 0, policy_version 1485383 (0.0008) [2023-12-26 11:27:20,199][123090] Updated weights for policy 1, policy_version 1475645 (0.0007) [2023-12-26 11:27:20,908][123090] Updated weights for policy 1, policy_version 1475655 (0.0010) [2023-12-26 11:27:20,965][123090] Updated weights for policy 1, policy_version 1475665 (0.0011) [2023-12-26 11:27:21,032][123090] Updated weights for policy 1, policy_version 1475675 (0.0010) [2023-12-26 11:27:21,048][123091] Updated weights for policy 0, policy_version 1485393 (0.0009) [2023-12-26 11:27:21,113][123091] Updated weights for policy 0, policy_version 1485403 (0.0007) [2023-12-26 11:27:21,171][123091] Updated weights for policy 0, policy_version 1485413 (0.0009) [2023-12-26 11:27:21,220][123091] Updated weights for policy 0, policy_version 1485423 (0.0009) [2023-12-26 11:27:21,912][123090] Updated weights for policy 1, policy_version 1475685 (0.0010) [2023-12-26 11:27:21,971][123090] Updated weights for policy 1, policy_version 1475695 (0.0010) [2023-12-26 11:27:22,030][123090] Updated weights for policy 1, policy_version 1475705 (0.0009) [2023-12-26 11:27:22,082][123091] Updated weights for policy 0, policy_version 1485433 (0.0009) [2023-12-26 11:27:22,134][123091] Updated weights for policy 0, policy_version 1485443 (0.0010) [2023-12-26 11:27:22,188][123091] Updated weights for policy 0, policy_version 1485453 (0.0010) [2023-12-26 11:27:22,804][123090] Updated weights for policy 1, policy_version 1475715 (0.0007) [2023-12-26 11:27:22,856][123090] Updated weights for policy 1, policy_version 1475725 (0.0005) [2023-12-26 11:27:22,912][123090] Updated weights for policy 1, policy_version 1475735 (0.0007) [2023-12-26 11:27:23,036][123091] Updated weights for policy 0, policy_version 1485463 (0.0010) [2023-12-26 11:27:23,107][123091] Updated weights for policy 0, policy_version 1485473 (0.0009) [2023-12-26 11:27:23,178][123091] Updated weights for policy 0, policy_version 1485483 (0.0010) [2023-12-26 11:27:23,550][123090] Updated weights for policy 1, policy_version 1475745 (0.0007) [2023-12-26 11:27:23,604][123090] Updated weights for policy 1, policy_version 1475755 (0.0006) [2023-12-26 11:27:23,659][123090] Updated weights for policy 1, policy_version 1475765 (0.0009) [2023-12-26 11:27:23,708][123090] Updated weights for policy 1, policy_version 1475775 (0.0009) [2023-12-26 11:27:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 758087680. Throughput: 0: 8819.2, 1: 8771.3. Samples: 758061104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:23,785][121949] Avg episode reward: [(0, '6219.354'), (1, '5141.272')] [2023-12-26 11:27:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001485488_380289024.pth... [2023-12-26 11:27:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001475776_377798656.pth... [2023-12-26 11:27:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001484464_380026880.pth [2023-12-26 11:27:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001474720_377528320.pth [2023-12-26 11:27:24,052][123091] Updated weights for policy 0, policy_version 1485493 (0.0008) [2023-12-26 11:27:24,118][123091] Updated weights for policy 0, policy_version 1485503 (0.0007) [2023-12-26 11:27:24,180][123091] Updated weights for policy 0, policy_version 1485513 (0.0005) [2023-12-26 11:27:24,539][123090] Updated weights for policy 1, policy_version 1475785 (0.0009) [2023-12-26 11:27:24,612][123090] Updated weights for policy 1, policy_version 1475796 (0.0010) [2023-12-26 11:27:24,666][123090] Updated weights for policy 1, policy_version 1475807 (0.0010) [2023-12-26 11:27:24,850][123091] Updated weights for policy 0, policy_version 1485523 (0.0005) [2023-12-26 11:27:24,905][123091] Updated weights for policy 0, policy_version 1485533 (0.0008) [2023-12-26 11:27:24,960][123091] Updated weights for policy 0, policy_version 1485543 (0.0009) [2023-12-26 11:27:25,499][123090] Updated weights for policy 1, policy_version 1475817 (0.0009) [2023-12-26 11:27:25,548][123090] Updated weights for policy 1, policy_version 1475827 (0.0007) [2023-12-26 11:27:25,602][123090] Updated weights for policy 1, policy_version 1475837 (0.0006) [2023-12-26 11:27:25,775][123091] Updated weights for policy 0, policy_version 1485553 (0.0010) [2023-12-26 11:27:25,826][123091] Updated weights for policy 0, policy_version 1485563 (0.0010) [2023-12-26 11:27:25,870][123091] Updated weights for policy 0, policy_version 1485573 (0.0010) [2023-12-26 11:27:25,917][123091] Updated weights for policy 0, policy_version 1485583 (0.0010) [2023-12-26 11:27:26,298][123090] Updated weights for policy 1, policy_version 1475847 (0.0005) [2023-12-26 11:27:26,370][123090] Updated weights for policy 1, policy_version 1475857 (0.0005) [2023-12-26 11:27:26,441][123090] Updated weights for policy 1, policy_version 1475867 (0.0005) [2023-12-26 11:27:26,728][123091] Updated weights for policy 0, policy_version 1485593 (0.0006) [2023-12-26 11:27:26,781][123091] Updated weights for policy 0, policy_version 1485603 (0.0005) [2023-12-26 11:27:26,834][123091] Updated weights for policy 0, policy_version 1485613 (0.0010) [2023-12-26 11:27:27,070][123090] Updated weights for policy 1, policy_version 1475877 (0.0008) [2023-12-26 11:27:27,128][123090] Updated weights for policy 1, policy_version 1475887 (0.0008) [2023-12-26 11:27:27,180][123090] Updated weights for policy 1, policy_version 1475897 (0.0005) [2023-12-26 11:27:27,555][123091] Updated weights for policy 0, policy_version 1485623 (0.0007) [2023-12-26 11:27:27,616][123091] Updated weights for policy 0, policy_version 1485633 (0.0009) [2023-12-26 11:27:27,678][123091] Updated weights for policy 0, policy_version 1485643 (0.0010) [2023-12-26 11:27:27,978][123090] Updated weights for policy 1, policy_version 1475907 (0.0010) [2023-12-26 11:27:28,025][123090] Updated weights for policy 1, policy_version 1475917 (0.0009) [2023-12-26 11:27:28,072][123090] Updated weights for policy 1, policy_version 1475927 (0.0008) [2023-12-26 11:27:28,477][123091] Updated weights for policy 0, policy_version 1485653 (0.0010) [2023-12-26 11:27:28,532][123091] Updated weights for policy 0, policy_version 1485663 (0.0010) [2023-12-26 11:27:28,583][123091] Updated weights for policy 0, policy_version 1485673 (0.0010) [2023-12-26 11:27:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 758177792. Throughput: 0: 8874.3, 1: 8905.8. Samples: 758171644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:28,785][121949] Avg episode reward: [(0, '6327.013'), (1, '5374.414')] [2023-12-26 11:27:28,925][123090] Updated weights for policy 1, policy_version 1475937 (0.0009) [2023-12-26 11:27:28,973][123090] Updated weights for policy 1, policy_version 1475947 (0.0008) [2023-12-26 11:27:29,020][123090] Updated weights for policy 1, policy_version 1475957 (0.0008) [2023-12-26 11:27:29,071][123090] Updated weights for policy 1, policy_version 1475967 (0.0008) [2023-12-26 11:27:29,429][123091] Updated weights for policy 0, policy_version 1485683 (0.0011) [2023-12-26 11:27:29,496][123091] Updated weights for policy 0, policy_version 1485693 (0.0011) [2023-12-26 11:27:29,559][123091] Updated weights for policy 0, policy_version 1485703 (0.0011) [2023-12-26 11:27:29,938][123090] Updated weights for policy 1, policy_version 1475977 (0.0009) [2023-12-26 11:27:29,998][123090] Updated weights for policy 1, policy_version 1475987 (0.0009) [2023-12-26 11:27:30,062][123090] Updated weights for policy 1, policy_version 1475997 (0.0009) [2023-12-26 11:27:30,386][123091] Updated weights for policy 0, policy_version 1485713 (0.0011) [2023-12-26 11:27:30,438][123091] Updated weights for policy 0, policy_version 1485723 (0.0010) [2023-12-26 11:27:30,497][123091] Updated weights for policy 0, policy_version 1485733 (0.0010) [2023-12-26 11:27:30,549][123091] Updated weights for policy 0, policy_version 1485743 (0.0011) [2023-12-26 11:27:30,888][123090] Updated weights for policy 1, policy_version 1476007 (0.0009) [2023-12-26 11:27:30,946][123090] Updated weights for policy 1, policy_version 1476017 (0.0008) [2023-12-26 11:27:30,997][123090] Updated weights for policy 1, policy_version 1476027 (0.0008) [2023-12-26 11:27:31,406][123091] Updated weights for policy 0, policy_version 1485753 (0.0010) [2023-12-26 11:27:31,465][123091] Updated weights for policy 0, policy_version 1485763 (0.0010) [2023-12-26 11:27:31,520][123091] Updated weights for policy 0, policy_version 1485773 (0.0010) [2023-12-26 11:27:31,853][123090] Updated weights for policy 1, policy_version 1476037 (0.0009) [2023-12-26 11:27:31,908][123090] Updated weights for policy 1, policy_version 1476047 (0.0008) [2023-12-26 11:27:31,955][123090] Updated weights for policy 1, policy_version 1476057 (0.0008) [2023-12-26 11:27:32,362][123091] Updated weights for policy 0, policy_version 1485783 (0.0010) [2023-12-26 11:27:32,434][123091] Updated weights for policy 0, policy_version 1485793 (0.0009) [2023-12-26 11:27:32,490][123091] Updated weights for policy 0, policy_version 1485803 (0.0008) [2023-12-26 11:27:32,816][123090] Updated weights for policy 1, policy_version 1476067 (0.0009) [2023-12-26 11:27:32,881][123090] Updated weights for policy 1, policy_version 1476077 (0.0005) [2023-12-26 11:27:32,943][123090] Updated weights for policy 1, policy_version 1476087 (0.0005) [2023-12-26 11:27:33,228][123091] Updated weights for policy 0, policy_version 1485813 (0.0007) [2023-12-26 11:27:33,277][123091] Updated weights for policy 0, policy_version 1485823 (0.0005) [2023-12-26 11:27:33,328][123091] Updated weights for policy 0, policy_version 1485833 (0.0005) [2023-12-26 11:27:33,619][123090] Updated weights for policy 1, policy_version 1476097 (0.0005) [2023-12-26 11:27:33,682][123090] Updated weights for policy 1, policy_version 1476107 (0.0005) [2023-12-26 11:27:33,741][123090] Updated weights for policy 1, policy_version 1476117 (0.0009) [2023-12-26 11:27:33,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 758259712. Throughput: 0: 8864.6, 1: 8924.4. Samples: 758276692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:33,784][121949] Avg episode reward: [(0, '6393.040'), (1, '5273.418')] [2023-12-26 11:27:33,800][123090] Updated weights for policy 1, policy_version 1476127 (0.0009) [2023-12-26 11:27:33,999][123091] Updated weights for policy 0, policy_version 1485843 (0.0005) [2023-12-26 11:27:34,076][123091] Updated weights for policy 0, policy_version 1485853 (0.0006) [2023-12-26 11:27:34,144][123091] Updated weights for policy 0, policy_version 1485863 (0.0007) [2023-12-26 11:27:34,524][123090] Updated weights for policy 1, policy_version 1476137 (0.0010) [2023-12-26 11:27:34,592][123090] Updated weights for policy 1, policy_version 1476147 (0.0008) [2023-12-26 11:27:34,653][123090] Updated weights for policy 1, policy_version 1476157 (0.0009) [2023-12-26 11:27:34,753][123091] Updated weights for policy 0, policy_version 1485873 (0.0006) [2023-12-26 11:27:34,815][123091] Updated weights for policy 0, policy_version 1485883 (0.0006) [2023-12-26 11:27:34,878][123091] Updated weights for policy 0, policy_version 1485893 (0.0006) [2023-12-26 11:27:34,949][123091] Updated weights for policy 0, policy_version 1485903 (0.0005) [2023-12-26 11:27:35,489][123090] Updated weights for policy 1, policy_version 1476167 (0.0010) [2023-12-26 11:27:35,490][123091] Updated weights for policy 0, policy_version 1485913 (0.0005) [2023-12-26 11:27:35,541][123091] Updated weights for policy 0, policy_version 1485923 (0.0007) [2023-12-26 11:27:35,545][123090] Updated weights for policy 1, policy_version 1476177 (0.0010) [2023-12-26 11:27:35,592][123091] Updated weights for policy 0, policy_version 1485933 (0.0009) [2023-12-26 11:27:35,598][123090] Updated weights for policy 1, policy_version 1476187 (0.0009) [2023-12-26 11:27:36,380][123090] Updated weights for policy 1, policy_version 1476197 (0.0010) [2023-12-26 11:27:36,414][123091] Updated weights for policy 0, policy_version 1485943 (0.0008) [2023-12-26 11:27:36,449][123090] Updated weights for policy 1, policy_version 1476207 (0.0009) [2023-12-26 11:27:36,478][123091] Updated weights for policy 0, policy_version 1485953 (0.0006) [2023-12-26 11:27:36,514][123090] Updated weights for policy 1, policy_version 1476217 (0.0009) [2023-12-26 11:27:36,539][123091] Updated weights for policy 0, policy_version 1485963 (0.0005) [2023-12-26 11:27:37,163][123090] Updated weights for policy 1, policy_version 1476227 (0.0006) [2023-12-26 11:27:37,225][123090] Updated weights for policy 1, policy_version 1476237 (0.0006) [2023-12-26 11:27:37,272][123090] Updated weights for policy 1, policy_version 1476247 (0.0009) [2023-12-26 11:27:37,323][123091] Updated weights for policy 0, policy_version 1485973 (0.0006) [2023-12-26 11:27:37,380][123091] Updated weights for policy 0, policy_version 1485983 (0.0009) [2023-12-26 11:27:37,430][123091] Updated weights for policy 0, policy_version 1485994 (0.0009) [2023-12-26 11:27:38,078][123090] Updated weights for policy 1, policy_version 1476257 (0.0009) [2023-12-26 11:27:38,135][123090] Updated weights for policy 1, policy_version 1476267 (0.0005) [2023-12-26 11:27:38,188][123090] Updated weights for policy 1, policy_version 1476277 (0.0005) [2023-12-26 11:27:38,251][123090] Updated weights for policy 1, policy_version 1476287 (0.0009) [2023-12-26 11:27:38,327][123091] Updated weights for policy 0, policy_version 1486004 (0.0010) [2023-12-26 11:27:38,385][123091] Updated weights for policy 0, policy_version 1486014 (0.0009) [2023-12-26 11:27:38,437][123091] Updated weights for policy 0, policy_version 1486024 (0.0005) [2023-12-26 11:27:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 758358016. Throughput: 0: 8932.4, 1: 8936.3. Samples: 758332196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:38,785][121949] Avg episode reward: [(0, '6275.445'), (1, '5256.504')] [2023-12-26 11:27:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001486032_380428288.pth... [2023-12-26 11:27:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001476288_377929728.pth... [2023-12-26 11:27:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001485008_380166144.pth [2023-12-26 11:27:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001475232_377659392.pth [2023-12-26 11:27:39,081][123090] Updated weights for policy 1, policy_version 1476297 (0.0008) [2023-12-26 11:27:39,132][123090] Updated weights for policy 1, policy_version 1476307 (0.0010) [2023-12-26 11:27:39,194][123090] Updated weights for policy 1, policy_version 1476317 (0.0010) [2023-12-26 11:27:39,201][123091] Updated weights for policy 0, policy_version 1486034 (0.0006) [2023-12-26 11:27:39,275][123091] Updated weights for policy 0, policy_version 1486044 (0.0009) [2023-12-26 11:27:39,342][123091] Updated weights for policy 0, policy_version 1486054 (0.0009) [2023-12-26 11:27:39,416][123091] Updated weights for policy 0, policy_version 1486064 (0.0010) [2023-12-26 11:27:40,110][123090] Updated weights for policy 1, policy_version 1476327 (0.0010) [2023-12-26 11:27:40,164][123090] Updated weights for policy 1, policy_version 1476337 (0.0010) [2023-12-26 11:27:40,215][123090] Updated weights for policy 1, policy_version 1476347 (0.0009) [2023-12-26 11:27:40,256][123091] Updated weights for policy 0, policy_version 1486074 (0.0010) [2023-12-26 11:27:40,322][123091] Updated weights for policy 0, policy_version 1486084 (0.0011) [2023-12-26 11:27:40,392][123091] Updated weights for policy 0, policy_version 1486094 (0.0010) [2023-12-26 11:27:41,083][123091] Updated weights for policy 0, policy_version 1486104 (0.0008) [2023-12-26 11:27:41,147][123091] Updated weights for policy 0, policy_version 1486114 (0.0007) [2023-12-26 11:27:41,170][123090] Updated weights for policy 1, policy_version 1476357 (0.0008) [2023-12-26 11:27:41,207][123091] Updated weights for policy 0, policy_version 1486124 (0.0009) [2023-12-26 11:27:41,231][123090] Updated weights for policy 1, policy_version 1476367 (0.0009) [2023-12-26 11:27:41,293][123090] Updated weights for policy 1, policy_version 1476377 (0.0010) [2023-12-26 11:27:42,001][123091] Updated weights for policy 0, policy_version 1486134 (0.0006) [2023-12-26 11:27:42,061][123090] Updated weights for policy 1, policy_version 1476387 (0.0008) [2023-12-26 11:27:42,072][123091] Updated weights for policy 0, policy_version 1486144 (0.0006) [2023-12-26 11:27:42,121][123090] Updated weights for policy 1, policy_version 1476397 (0.0006) [2023-12-26 11:27:42,132][123091] Updated weights for policy 0, policy_version 1486154 (0.0008) [2023-12-26 11:27:42,181][123090] Updated weights for policy 1, policy_version 1476407 (0.0007) [2023-12-26 11:27:42,889][123090] Updated weights for policy 1, policy_version 1476417 (0.0008) [2023-12-26 11:27:42,944][123091] Updated weights for policy 0, policy_version 1486164 (0.0008) [2023-12-26 11:27:42,954][123090] Updated weights for policy 1, policy_version 1476427 (0.0009) [2023-12-26 11:27:43,001][123091] Updated weights for policy 0, policy_version 1486174 (0.0007) [2023-12-26 11:27:43,012][123090] Updated weights for policy 1, policy_version 1476437 (0.0008) [2023-12-26 11:27:43,046][123091] Updated weights for policy 0, policy_version 1486184 (0.0007) [2023-12-26 11:27:43,058][123090] Updated weights for policy 1, policy_version 1476447 (0.0007) [2023-12-26 11:27:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 758439936. Throughput: 0: 8844.4, 1: 8958.5. Samples: 758437856. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:27:43,785][121949] Avg episode reward: [(0, '6217.013'), (1, '5297.468')] [2023-12-26 11:27:43,854][123090] Updated weights for policy 1, policy_version 1476457 (0.0009) [2023-12-26 11:27:43,871][123091] Updated weights for policy 0, policy_version 1486194 (0.0007) [2023-12-26 11:27:43,907][123090] Updated weights for policy 1, policy_version 1476467 (0.0009) [2023-12-26 11:27:43,925][123091] Updated weights for policy 0, policy_version 1486204 (0.0005) [2023-12-26 11:27:43,958][123090] Updated weights for policy 1, policy_version 1476477 (0.0009) [2023-12-26 11:27:43,984][123091] Updated weights for policy 0, policy_version 1486214 (0.0005) [2023-12-26 11:27:44,054][123091] Updated weights for policy 0, policy_version 1486224 (0.0005) [2023-12-26 11:27:44,679][123091] Updated weights for policy 0, policy_version 1486234 (0.0009) [2023-12-26 11:27:44,730][123091] Updated weights for policy 0, policy_version 1486244 (0.0009) [2023-12-26 11:27:44,784][123091] Updated weights for policy 0, policy_version 1486254 (0.0009) [2023-12-26 11:27:44,832][123090] Updated weights for policy 1, policy_version 1476487 (0.0008) [2023-12-26 11:27:44,893][123090] Updated weights for policy 1, policy_version 1476497 (0.0010) [2023-12-26 11:27:44,951][123090] Updated weights for policy 1, policy_version 1476507 (0.0009) [2023-12-26 11:27:45,617][123091] Updated weights for policy 0, policy_version 1486264 (0.0010) [2023-12-26 11:27:45,683][123091] Updated weights for policy 0, policy_version 1486274 (0.0009) [2023-12-26 11:27:45,756][123091] Updated weights for policy 0, policy_version 1486284 (0.0010) [2023-12-26 11:27:45,789][123090] Updated weights for policy 1, policy_version 1476517 (0.0008) [2023-12-26 11:27:45,845][123090] Updated weights for policy 1, policy_version 1476527 (0.0005) [2023-12-26 11:27:45,901][123090] Updated weights for policy 1, policy_version 1476537 (0.0005) [2023-12-26 11:27:46,497][123091] Updated weights for policy 0, policy_version 1486294 (0.0009) [2023-12-26 11:27:46,565][123091] Updated weights for policy 0, policy_version 1486304 (0.0006) [2023-12-26 11:27:46,635][123091] Updated weights for policy 0, policy_version 1486314 (0.0006) [2023-12-26 11:27:46,712][123090] Updated weights for policy 1, policy_version 1476547 (0.0007) [2023-12-26 11:27:46,767][123090] Updated weights for policy 1, policy_version 1476559 (0.0011) [2023-12-26 11:27:46,822][123090] Updated weights for policy 1, policy_version 1476569 (0.0010) [2023-12-26 11:27:47,273][123091] Updated weights for policy 0, policy_version 1486324 (0.0007) [2023-12-26 11:27:47,327][123091] Updated weights for policy 0, policy_version 1486334 (0.0006) [2023-12-26 11:27:47,378][123091] Updated weights for policy 0, policy_version 1486344 (0.0005) [2023-12-26 11:27:47,624][123090] Updated weights for policy 1, policy_version 1476579 (0.0008) [2023-12-26 11:27:47,681][123090] Updated weights for policy 1, policy_version 1476589 (0.0005) [2023-12-26 11:27:47,754][123090] Updated weights for policy 1, policy_version 1476599 (0.0005) [2023-12-26 11:27:48,063][123091] Updated weights for policy 0, policy_version 1486354 (0.0006) [2023-12-26 11:27:48,117][123091] Updated weights for policy 0, policy_version 1486364 (0.0010) [2023-12-26 11:27:48,172][123091] Updated weights for policy 0, policy_version 1486374 (0.0011) [2023-12-26 11:27:48,223][123091] Updated weights for policy 0, policy_version 1486384 (0.0010) [2023-12-26 11:27:48,511][123090] Updated weights for policy 1, policy_version 1476609 (0.0008) [2023-12-26 11:27:48,581][123090] Updated weights for policy 1, policy_version 1476619 (0.0008) [2023-12-26 11:27:48,642][123090] Updated weights for policy 1, policy_version 1476629 (0.0009) [2023-12-26 11:27:48,707][123090] Updated weights for policy 1, policy_version 1476639 (0.0009) [2023-12-26 11:27:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 758538240. Throughput: 0: 8869.4, 1: 9000.0. Samples: 758547332. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:27:48,785][121949] Avg episode reward: [(0, '6366.969'), (1, '5313.367')] [2023-12-26 11:27:49,054][123091] Updated weights for policy 0, policy_version 1486394 (0.0007) [2023-12-26 11:27:49,113][123091] Updated weights for policy 0, policy_version 1486404 (0.0007) [2023-12-26 11:27:49,175][123091] Updated weights for policy 0, policy_version 1486414 (0.0006) [2023-12-26 11:27:49,559][123090] Updated weights for policy 1, policy_version 1476649 (0.0008) [2023-12-26 11:27:49,629][123090] Updated weights for policy 1, policy_version 1476659 (0.0005) [2023-12-26 11:27:49,691][123090] Updated weights for policy 1, policy_version 1476669 (0.0007) [2023-12-26 11:27:49,999][123091] Updated weights for policy 0, policy_version 1486424 (0.0008) [2023-12-26 11:27:50,070][123091] Updated weights for policy 0, policy_version 1486434 (0.0009) [2023-12-26 11:27:50,134][123091] Updated weights for policy 0, policy_version 1486444 (0.0010) [2023-12-26 11:27:50,422][123090] Updated weights for policy 1, policy_version 1476679 (0.0008) [2023-12-26 11:27:50,483][123090] Updated weights for policy 1, policy_version 1476689 (0.0009) [2023-12-26 11:27:50,553][123090] Updated weights for policy 1, policy_version 1476699 (0.0009) [2023-12-26 11:27:50,995][123091] Updated weights for policy 0, policy_version 1486454 (0.0010) [2023-12-26 11:27:51,063][123091] Updated weights for policy 0, policy_version 1486464 (0.0010) [2023-12-26 11:27:51,128][123091] Updated weights for policy 0, policy_version 1486474 (0.0009) [2023-12-26 11:27:51,406][123090] Updated weights for policy 1, policy_version 1476709 (0.0009) [2023-12-26 11:27:51,468][123090] Updated weights for policy 1, policy_version 1476719 (0.0009) [2023-12-26 11:27:51,530][123090] Updated weights for policy 1, policy_version 1476729 (0.0005) [2023-12-26 11:27:51,980][123091] Updated weights for policy 0, policy_version 1486484 (0.0010) [2023-12-26 11:27:52,029][123091] Updated weights for policy 0, policy_version 1486494 (0.0010) [2023-12-26 11:27:52,089][123091] Updated weights for policy 0, policy_version 1486504 (0.0010) [2023-12-26 11:27:52,339][123090] Updated weights for policy 1, policy_version 1476739 (0.0007) [2023-12-26 11:27:52,397][123090] Updated weights for policy 1, policy_version 1476749 (0.0009) [2023-12-26 11:27:52,458][123090] Updated weights for policy 1, policy_version 1476759 (0.0009) [2023-12-26 11:27:52,929][123091] Updated weights for policy 0, policy_version 1486514 (0.0010) [2023-12-26 11:27:52,990][123091] Updated weights for policy 0, policy_version 1486524 (0.0009) [2023-12-26 11:27:53,043][123091] Updated weights for policy 0, policy_version 1486534 (0.0009) [2023-12-26 11:27:53,104][123091] Updated weights for policy 0, policy_version 1486544 (0.0009) [2023-12-26 11:27:53,340][123090] Updated weights for policy 1, policy_version 1476769 (0.0010) [2023-12-26 11:27:53,405][123090] Updated weights for policy 1, policy_version 1476779 (0.0009) [2023-12-26 11:27:53,458][123090] Updated weights for policy 1, policy_version 1476789 (0.0009) [2023-12-26 11:27:53,523][123090] Updated weights for policy 1, policy_version 1476799 (0.0009) [2023-12-26 11:27:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 758620160. Throughput: 0: 8846.3, 1: 8989.8. Samples: 758597892. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:27:53,785][121949] Avg episode reward: [(0, '6382.118'), (1, '5711.365')] [2023-12-26 11:27:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001476800_378060800.pth... [2023-12-26 11:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001486544_380559360.pth... [2023-12-26 11:27:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001475776_377798656.pth [2023-12-26 11:27:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001485488_380289024.pth [2023-12-26 11:27:53,916][123091] Updated weights for policy 0, policy_version 1486554 (0.0009) [2023-12-26 11:27:53,966][123091] Updated weights for policy 0, policy_version 1486564 (0.0009) [2023-12-26 11:27:54,024][123091] Updated weights for policy 0, policy_version 1486575 (0.0011) [2023-12-26 11:27:54,298][123090] Updated weights for policy 1, policy_version 1476809 (0.0005) [2023-12-26 11:27:54,355][123090] Updated weights for policy 1, policy_version 1476819 (0.0007) [2023-12-26 11:27:54,407][123090] Updated weights for policy 1, policy_version 1476829 (0.0007) [2023-12-26 11:27:54,928][123091] Updated weights for policy 0, policy_version 1486585 (0.0009) [2023-12-26 11:27:54,985][123091] Updated weights for policy 0, policy_version 1486595 (0.0009) [2023-12-26 11:27:55,049][123091] Updated weights for policy 0, policy_version 1486605 (0.0009) [2023-12-26 11:27:55,191][123090] Updated weights for policy 1, policy_version 1476839 (0.0008) [2023-12-26 11:27:55,249][123090] Updated weights for policy 1, policy_version 1476849 (0.0006) [2023-12-26 11:27:55,311][123090] Updated weights for policy 1, policy_version 1476859 (0.0007) [2023-12-26 11:27:55,881][123091] Updated weights for policy 0, policy_version 1486615 (0.0009) [2023-12-26 11:27:55,934][123091] Updated weights for policy 0, policy_version 1486626 (0.0010) [2023-12-26 11:27:55,990][123091] Updated weights for policy 0, policy_version 1486636 (0.0009) [2023-12-26 11:27:56,058][123090] Updated weights for policy 1, policy_version 1476869 (0.0009) [2023-12-26 11:27:56,110][123090] Updated weights for policy 1, policy_version 1476879 (0.0009) [2023-12-26 11:27:56,162][123090] Updated weights for policy 1, policy_version 1476889 (0.0009) [2023-12-26 11:27:56,816][123091] Updated weights for policy 0, policy_version 1486646 (0.0006) [2023-12-26 11:27:56,869][123091] Updated weights for policy 0, policy_version 1486656 (0.0005) [2023-12-26 11:27:56,923][123091] Updated weights for policy 0, policy_version 1486666 (0.0010) [2023-12-26 11:27:57,022][123090] Updated weights for policy 1, policy_version 1476899 (0.0008) [2023-12-26 11:27:57,082][123090] Updated weights for policy 1, policy_version 1476909 (0.0005) [2023-12-26 11:27:57,138][123090] Updated weights for policy 1, policy_version 1476919 (0.0005) [2023-12-26 11:27:57,670][123091] Updated weights for policy 0, policy_version 1486676 (0.0008) [2023-12-26 11:27:57,728][123091] Updated weights for policy 0, policy_version 1486686 (0.0005) [2023-12-26 11:27:57,750][123090] Updated weights for policy 1, policy_version 1476929 (0.0005) [2023-12-26 11:27:57,781][123091] Updated weights for policy 0, policy_version 1486696 (0.0005) [2023-12-26 11:27:57,822][123090] Updated weights for policy 1, policy_version 1476939 (0.0005) [2023-12-26 11:27:57,898][123090] Updated weights for policy 1, policy_version 1476949 (0.0005) [2023-12-26 11:27:57,971][123090] Updated weights for policy 1, policy_version 1476959 (0.0005) [2023-12-26 11:27:58,586][123091] Updated weights for policy 0, policy_version 1486706 (0.0006) [2023-12-26 11:27:58,653][123091] Updated weights for policy 0, policy_version 1486716 (0.0009) [2023-12-26 11:27:58,654][123090] Updated weights for policy 1, policy_version 1476969 (0.0008) [2023-12-26 11:27:58,721][123091] Updated weights for policy 0, policy_version 1486726 (0.0010) [2023-12-26 11:27:58,721][123090] Updated weights for policy 1, policy_version 1476979 (0.0008) [2023-12-26 11:27:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 758702080. Throughput: 0: 8866.6, 1: 9026.9. Samples: 758703848. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:27:58,785][121949] Avg episode reward: [(0, '6434.646'), (1, '5810.737')] [2023-12-26 11:27:58,791][123090] Updated weights for policy 1, policy_version 1476989 (0.0008) [2023-12-26 11:27:58,792][123091] Updated weights for policy 0, policy_version 1486736 (0.0009) [2023-12-26 11:27:59,653][123091] Updated weights for policy 0, policy_version 1486746 (0.0009) [2023-12-26 11:27:59,698][123090] Updated weights for policy 1, policy_version 1476999 (0.0011) [2023-12-26 11:27:59,709][123091] Updated weights for policy 0, policy_version 1486756 (0.0007) [2023-12-26 11:27:59,746][123090] Updated weights for policy 1, policy_version 1477009 (0.0010) [2023-12-26 11:27:59,766][123091] Updated weights for policy 0, policy_version 1486766 (0.0007) [2023-12-26 11:27:59,805][123090] Updated weights for policy 1, policy_version 1477019 (0.0010) [2023-12-26 11:28:00,617][123091] Updated weights for policy 0, policy_version 1486776 (0.0009) [2023-12-26 11:28:00,646][123090] Updated weights for policy 1, policy_version 1477029 (0.0009) [2023-12-26 11:28:00,664][123091] Updated weights for policy 0, policy_version 1486786 (0.0010) [2023-12-26 11:28:00,706][123090] Updated weights for policy 1, policy_version 1477039 (0.0006) [2023-12-26 11:28:00,718][123091] Updated weights for policy 0, policy_version 1486796 (0.0010) [2023-12-26 11:28:00,779][123090] Updated weights for policy 1, policy_version 1477049 (0.0006) [2023-12-26 11:28:01,497][123091] Updated weights for policy 0, policy_version 1486806 (0.0010) [2023-12-26 11:28:01,560][123091] Updated weights for policy 0, policy_version 1486816 (0.0009) [2023-12-26 11:28:01,598][123090] Updated weights for policy 1, policy_version 1477059 (0.0009) [2023-12-26 11:28:01,628][123091] Updated weights for policy 0, policy_version 1486826 (0.0008) [2023-12-26 11:28:01,673][123090] Updated weights for policy 1, policy_version 1477069 (0.0010) [2023-12-26 11:28:01,744][123090] Updated weights for policy 1, policy_version 1477079 (0.0010) [2023-12-26 11:28:02,443][123091] Updated weights for policy 0, policy_version 1486836 (0.0007) [2023-12-26 11:28:02,485][123090] Updated weights for policy 1, policy_version 1477089 (0.0011) [2023-12-26 11:28:02,494][123091] Updated weights for policy 0, policy_version 1486846 (0.0005) [2023-12-26 11:28:02,540][123091] Updated weights for policy 0, policy_version 1486856 (0.0005) [2023-12-26 11:28:02,547][123090] Updated weights for policy 1, policy_version 1477099 (0.0008) [2023-12-26 11:28:02,601][123090] Updated weights for policy 1, policy_version 1477109 (0.0006) [2023-12-26 11:28:02,652][123090] Updated weights for policy 1, policy_version 1477119 (0.0006) [2023-12-26 11:28:03,126][123091] Updated weights for policy 0, policy_version 1486866 (0.0006) [2023-12-26 11:28:03,191][123091] Updated weights for policy 0, policy_version 1486876 (0.0005) [2023-12-26 11:28:03,270][123091] Updated weights for policy 0, policy_version 1486886 (0.0005) [2023-12-26 11:28:03,304][123090] Updated weights for policy 1, policy_version 1477129 (0.0005) [2023-12-26 11:28:03,318][123091] Updated weights for policy 0, policy_version 1486896 (0.0005) [2023-12-26 11:28:03,360][123090] Updated weights for policy 1, policy_version 1477139 (0.0005) [2023-12-26 11:28:03,412][123090] Updated weights for policy 1, policy_version 1477149 (0.0006) [2023-12-26 11:28:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 758800384. Throughput: 0: 8911.6, 1: 8927.3. Samples: 758812832. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:03,785][121949] Avg episode reward: [(0, '6248.595'), (1, '5575.672')] [2023-12-26 11:28:03,907][123091] Updated weights for policy 0, policy_version 1486906 (0.0008) [2023-12-26 11:28:03,978][123091] Updated weights for policy 0, policy_version 1486916 (0.0005) [2023-12-26 11:28:04,040][123091] Updated weights for policy 0, policy_version 1486926 (0.0005) [2023-12-26 11:28:04,135][123090] Updated weights for policy 1, policy_version 1477159 (0.0008) [2023-12-26 11:28:04,196][123090] Updated weights for policy 1, policy_version 1477169 (0.0009) [2023-12-26 11:28:04,258][123090] Updated weights for policy 1, policy_version 1477179 (0.0009) [2023-12-26 11:28:04,785][123091] Updated weights for policy 0, policy_version 1486936 (0.0010) [2023-12-26 11:28:04,836][123091] Updated weights for policy 0, policy_version 1486946 (0.0009) [2023-12-26 11:28:04,890][123091] Updated weights for policy 0, policy_version 1486956 (0.0010) [2023-12-26 11:28:05,064][123090] Updated weights for policy 1, policy_version 1477189 (0.0009) [2023-12-26 11:28:05,120][123090] Updated weights for policy 1, policy_version 1477199 (0.0009) [2023-12-26 11:28:05,181][123090] Updated weights for policy 1, policy_version 1477209 (0.0009) [2023-12-26 11:28:05,784][123091] Updated weights for policy 0, policy_version 1486966 (0.0007) [2023-12-26 11:28:05,836][123091] Updated weights for policy 0, policy_version 1486976 (0.0005) [2023-12-26 11:28:05,893][123091] Updated weights for policy 0, policy_version 1486986 (0.0005) [2023-12-26 11:28:05,948][123090] Updated weights for policy 1, policy_version 1477219 (0.0008) [2023-12-26 11:28:06,012][123090] Updated weights for policy 1, policy_version 1477229 (0.0006) [2023-12-26 11:28:06,073][123090] Updated weights for policy 1, policy_version 1477239 (0.0005) [2023-12-26 11:28:06,602][123091] Updated weights for policy 0, policy_version 1486996 (0.0005) [2023-12-26 11:28:06,671][123091] Updated weights for policy 0, policy_version 1487006 (0.0009) [2023-12-26 11:28:06,740][123091] Updated weights for policy 0, policy_version 1487016 (0.0009) [2023-12-26 11:28:06,743][123090] Updated weights for policy 1, policy_version 1477249 (0.0007) [2023-12-26 11:28:06,812][123090] Updated weights for policy 1, policy_version 1477259 (0.0008) [2023-12-26 11:28:06,881][123090] Updated weights for policy 1, policy_version 1477269 (0.0008) [2023-12-26 11:28:06,952][123090] Updated weights for policy 1, policy_version 1477279 (0.0009) [2023-12-26 11:28:07,548][123091] Updated weights for policy 0, policy_version 1487026 (0.0009) [2023-12-26 11:28:07,605][123091] Updated weights for policy 0, policy_version 1487036 (0.0009) [2023-12-26 11:28:07,662][123091] Updated weights for policy 0, policy_version 1487046 (0.0010) [2023-12-26 11:28:07,715][123091] Updated weights for policy 0, policy_version 1487056 (0.0007) [2023-12-26 11:28:07,737][123090] Updated weights for policy 1, policy_version 1477289 (0.0009) [2023-12-26 11:28:07,801][123090] Updated weights for policy 1, policy_version 1477299 (0.0010) [2023-12-26 11:28:07,861][123090] Updated weights for policy 1, policy_version 1477309 (0.0009) [2023-12-26 11:28:08,396][123091] Updated weights for policy 0, policy_version 1487066 (0.0007) [2023-12-26 11:28:08,462][123091] Updated weights for policy 0, policy_version 1487076 (0.0010) [2023-12-26 11:28:08,526][123091] Updated weights for policy 0, policy_version 1487086 (0.0009) [2023-12-26 11:28:08,757][123090] Updated weights for policy 1, policy_version 1477319 (0.0010) [2023-12-26 11:28:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 758890496. Throughput: 0: 9010.8, 1: 8926.8. Samples: 758868292. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:08,785][121949] Avg episode reward: [(0, '6068.090'), (1, '5494.340')] [2023-12-26 11:28:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001487088_380698624.pth... [2023-12-26 11:28:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001486032_380428288.pth [2023-12-26 11:28:08,812][123090] Updated weights for policy 1, policy_version 1477330 (0.0010) [2023-12-26 11:28:08,872][123090] Updated weights for policy 1, policy_version 1477340 (0.0009) [2023-12-26 11:28:08,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001477344_378200064.pth... [2023-12-26 11:28:08,900][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001476288_377929728.pth [2023-12-26 11:28:09,257][123091] Updated weights for policy 0, policy_version 1487096 (0.0008) [2023-12-26 11:28:09,325][123091] Updated weights for policy 0, policy_version 1487106 (0.0010) [2023-12-26 11:28:09,393][123091] Updated weights for policy 0, policy_version 1487116 (0.0008) [2023-12-26 11:28:09,807][123090] Updated weights for policy 1, policy_version 1477350 (0.0008) [2023-12-26 11:28:09,876][123090] Updated weights for policy 1, policy_version 1477360 (0.0006) [2023-12-26 11:28:09,948][123090] Updated weights for policy 1, policy_version 1477370 (0.0007) [2023-12-26 11:28:10,203][123091] Updated weights for policy 0, policy_version 1487126 (0.0010) [2023-12-26 11:28:10,269][123091] Updated weights for policy 0, policy_version 1487136 (0.0009) [2023-12-26 11:28:10,344][123091] Updated weights for policy 0, policy_version 1487146 (0.0011) [2023-12-26 11:28:10,720][123090] Updated weights for policy 1, policy_version 1477380 (0.0009) [2023-12-26 11:28:10,778][123090] Updated weights for policy 1, policy_version 1477390 (0.0009) [2023-12-26 11:28:10,845][123090] Updated weights for policy 1, policy_version 1477400 (0.0009) [2023-12-26 11:28:11,078][123091] Updated weights for policy 0, policy_version 1487156 (0.0007) [2023-12-26 11:28:11,137][123091] Updated weights for policy 0, policy_version 1487166 (0.0007) [2023-12-26 11:28:11,200][123091] Updated weights for policy 0, policy_version 1487176 (0.0008) [2023-12-26 11:28:11,710][123090] Updated weights for policy 1, policy_version 1477410 (0.0009) [2023-12-26 11:28:11,774][123090] Updated weights for policy 1, policy_version 1477420 (0.0009) [2023-12-26 11:28:11,834][123090] Updated weights for policy 1, policy_version 1477430 (0.0008) [2023-12-26 11:28:11,900][123090] Updated weights for policy 1, policy_version 1477440 (0.0007) [2023-12-26 11:28:12,055][123091] Updated weights for policy 0, policy_version 1487186 (0.0009) [2023-12-26 11:28:12,119][123091] Updated weights for policy 0, policy_version 1487196 (0.0011) [2023-12-26 11:28:12,182][123091] Updated weights for policy 0, policy_version 1487206 (0.0011) [2023-12-26 11:28:12,246][123091] Updated weights for policy 0, policy_version 1487216 (0.0007) [2023-12-26 11:28:12,719][123090] Updated weights for policy 1, policy_version 1477450 (0.0006) [2023-12-26 11:28:12,791][123090] Updated weights for policy 1, policy_version 1477460 (0.0006) [2023-12-26 11:28:12,857][123090] Updated weights for policy 1, policy_version 1477470 (0.0009) [2023-12-26 11:28:12,979][123091] Updated weights for policy 0, policy_version 1487226 (0.0007) [2023-12-26 11:28:13,031][123091] Updated weights for policy 0, policy_version 1487236 (0.0005) [2023-12-26 11:28:13,086][123091] Updated weights for policy 0, policy_version 1487246 (0.0007) [2023-12-26 11:28:13,650][123090] Updated weights for policy 1, policy_version 1477480 (0.0010) [2023-12-26 11:28:13,714][123090] Updated weights for policy 1, policy_version 1477490 (0.0007) [2023-12-26 11:28:13,780][123090] Updated weights for policy 1, policy_version 1477500 (0.0006) [2023-12-26 11:28:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 758972416. Throughput: 0: 9001.3, 1: 8782.7. Samples: 758971924. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:13,785][121949] Avg episode reward: [(0, '6081.228'), (1, '5816.036')] [2023-12-26 11:28:13,861][123091] Updated weights for policy 0, policy_version 1487256 (0.0006) [2023-12-26 11:28:13,937][123091] Updated weights for policy 0, policy_version 1487266 (0.0007) [2023-12-26 11:28:14,004][123091] Updated weights for policy 0, policy_version 1487276 (0.0006) [2023-12-26 11:28:14,581][123090] Updated weights for policy 1, policy_version 1477510 (0.0009) [2023-12-26 11:28:14,644][123090] Updated weights for policy 1, policy_version 1477520 (0.0010) [2023-12-26 11:28:14,660][123091] Updated weights for policy 0, policy_version 1487286 (0.0006) [2023-12-26 11:28:14,708][123090] Updated weights for policy 1, policy_version 1477530 (0.0011) [2023-12-26 11:28:14,718][123091] Updated weights for policy 0, policy_version 1487296 (0.0009) [2023-12-26 11:28:14,783][123091] Updated weights for policy 0, policy_version 1487306 (0.0007) [2023-12-26 11:28:15,469][123090] Updated weights for policy 1, policy_version 1477540 (0.0011) [2023-12-26 11:28:15,533][123090] Updated weights for policy 1, policy_version 1477550 (0.0011) [2023-12-26 11:28:15,538][123091] Updated weights for policy 0, policy_version 1487316 (0.0008) [2023-12-26 11:28:15,594][123091] Updated weights for policy 0, policy_version 1487326 (0.0010) [2023-12-26 11:28:15,596][123090] Updated weights for policy 1, policy_version 1477560 (0.0010) [2023-12-26 11:28:15,643][123091] Updated weights for policy 0, policy_version 1487336 (0.0010) [2023-12-26 11:28:16,414][123090] Updated weights for policy 1, policy_version 1477570 (0.0011) [2023-12-26 11:28:16,475][123090] Updated weights for policy 1, policy_version 1477580 (0.0010) [2023-12-26 11:28:16,486][123091] Updated weights for policy 0, policy_version 1487346 (0.0010) [2023-12-26 11:28:16,530][123090] Updated weights for policy 1, policy_version 1477590 (0.0010) [2023-12-26 11:28:16,533][123091] Updated weights for policy 0, policy_version 1487356 (0.0010) [2023-12-26 11:28:16,581][123091] Updated weights for policy 0, policy_version 1487366 (0.0010) [2023-12-26 11:28:16,587][123090] Updated weights for policy 1, policy_version 1477600 (0.0007) [2023-12-26 11:28:16,632][123091] Updated weights for policy 0, policy_version 1487376 (0.0010) [2023-12-26 11:28:17,395][123091] Updated weights for policy 0, policy_version 1487386 (0.0011) [2023-12-26 11:28:17,419][123090] Updated weights for policy 1, policy_version 1477610 (0.0006) [2023-12-26 11:28:17,457][123091] Updated weights for policy 0, policy_version 1487396 (0.0010) [2023-12-26 11:28:17,482][123090] Updated weights for policy 1, policy_version 1477620 (0.0007) [2023-12-26 11:28:17,527][123091] Updated weights for policy 0, policy_version 1487406 (0.0011) [2023-12-26 11:28:17,528][123090] Updated weights for policy 1, policy_version 1477630 (0.0005) [2023-12-26 11:28:18,219][123090] Updated weights for policy 1, policy_version 1477640 (0.0008) [2023-12-26 11:28:18,283][123090] Updated weights for policy 1, policy_version 1477650 (0.0006) [2023-12-26 11:28:18,312][123091] Updated weights for policy 0, policy_version 1487416 (0.0010) [2023-12-26 11:28:18,347][123090] Updated weights for policy 1, policy_version 1477660 (0.0010) [2023-12-26 11:28:18,376][123091] Updated weights for policy 0, policy_version 1487426 (0.0010) [2023-12-26 11:28:18,435][123091] Updated weights for policy 0, policy_version 1487436 (0.0010) [2023-12-26 11:28:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 759070720. Throughput: 0: 9060.6, 1: 8811.4. Samples: 759080932. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:18,784][121949] Avg episode reward: [(0, '6075.247'), (1, '5882.094')] [2023-12-26 11:28:19,112][123091] Updated weights for policy 0, policy_version 1487446 (0.0006) [2023-12-26 11:28:19,177][123091] Updated weights for policy 0, policy_version 1487456 (0.0005) [2023-12-26 11:28:19,183][123090] Updated weights for policy 1, policy_version 1477670 (0.0007) [2023-12-26 11:28:19,258][123090] Updated weights for policy 1, policy_version 1477680 (0.0008) [2023-12-26 11:28:19,270][123091] Updated weights for policy 0, policy_version 1487466 (0.0007) [2023-12-26 11:28:19,324][123090] Updated weights for policy 1, policy_version 1477690 (0.0009) [2023-12-26 11:28:20,079][123091] Updated weights for policy 0, policy_version 1487476 (0.0009) [2023-12-26 11:28:20,142][123091] Updated weights for policy 0, policy_version 1487486 (0.0009) [2023-12-26 11:28:20,208][123091] Updated weights for policy 0, policy_version 1487496 (0.0009) [2023-12-26 11:28:20,228][123090] Updated weights for policy 1, policy_version 1477700 (0.0009) [2023-12-26 11:28:20,293][123090] Updated weights for policy 1, policy_version 1477710 (0.0009) [2023-12-26 11:28:20,367][123090] Updated weights for policy 1, policy_version 1477720 (0.0009) [2023-12-26 11:28:21,027][123091] Updated weights for policy 0, policy_version 1487506 (0.0009) [2023-12-26 11:28:21,088][123091] Updated weights for policy 0, policy_version 1487516 (0.0007) [2023-12-26 11:28:21,153][123091] Updated weights for policy 0, policy_version 1487526 (0.0009) [2023-12-26 11:28:21,192][123090] Updated weights for policy 1, policy_version 1477730 (0.0007) [2023-12-26 11:28:21,207][123091] Updated weights for policy 0, policy_version 1487536 (0.0010) [2023-12-26 11:28:21,253][123090] Updated weights for policy 1, policy_version 1477740 (0.0006) [2023-12-26 11:28:21,327][123090] Updated weights for policy 1, policy_version 1477750 (0.0008) [2023-12-26 11:28:21,402][123090] Updated weights for policy 1, policy_version 1477760 (0.0010) [2023-12-26 11:28:22,114][123091] Updated weights for policy 0, policy_version 1487546 (0.0010) [2023-12-26 11:28:22,175][123091] Updated weights for policy 0, policy_version 1487556 (0.0008) [2023-12-26 11:28:22,194][123090] Updated weights for policy 1, policy_version 1477770 (0.0009) [2023-12-26 11:28:22,235][123091] Updated weights for policy 0, policy_version 1487566 (0.0009) [2023-12-26 11:28:22,265][123090] Updated weights for policy 1, policy_version 1477780 (0.0007) [2023-12-26 11:28:22,324][123090] Updated weights for policy 1, policy_version 1477790 (0.0009) [2023-12-26 11:28:23,086][123090] Updated weights for policy 1, policy_version 1477800 (0.0010) [2023-12-26 11:28:23,131][123091] Updated weights for policy 0, policy_version 1487576 (0.0010) [2023-12-26 11:28:23,139][123090] Updated weights for policy 1, policy_version 1477810 (0.0007) [2023-12-26 11:28:23,191][123090] Updated weights for policy 1, policy_version 1477820 (0.0006) [2023-12-26 11:28:23,192][123091] Updated weights for policy 0, policy_version 1487586 (0.0009) [2023-12-26 11:28:23,256][123091] Updated weights for policy 0, policy_version 1487596 (0.0008) [2023-12-26 11:28:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 759152640. Throughput: 0: 8983.7, 1: 8782.1. Samples: 759131660. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:23,785][121949] Avg episode reward: [(0, '6176.824'), (1, '5836.264')] [2023-12-26 11:28:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001487600_380829696.pth... [2023-12-26 11:28:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001477824_378322944.pth... [2023-12-26 11:28:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001476800_378060800.pth [2023-12-26 11:28:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001486544_380559360.pth [2023-12-26 11:28:23,969][123090] Updated weights for policy 1, policy_version 1477830 (0.0008) [2023-12-26 11:28:24,033][123090] Updated weights for policy 1, policy_version 1477840 (0.0008) [2023-12-26 11:28:24,068][123091] Updated weights for policy 0, policy_version 1487606 (0.0008) [2023-12-26 11:28:24,100][123090] Updated weights for policy 1, policy_version 1477850 (0.0007) [2023-12-26 11:28:24,131][123091] Updated weights for policy 0, policy_version 1487616 (0.0005) [2023-12-26 11:28:24,202][123091] Updated weights for policy 0, policy_version 1487626 (0.0008) [2023-12-26 11:28:24,909][123090] Updated weights for policy 1, policy_version 1477860 (0.0008) [2023-12-26 11:28:24,919][123091] Updated weights for policy 0, policy_version 1487636 (0.0008) [2023-12-26 11:28:24,974][123090] Updated weights for policy 1, policy_version 1477870 (0.0005) [2023-12-26 11:28:24,984][123091] Updated weights for policy 0, policy_version 1487646 (0.0010) [2023-12-26 11:28:25,037][123090] Updated weights for policy 1, policy_version 1477880 (0.0007) [2023-12-26 11:28:25,046][123091] Updated weights for policy 0, policy_version 1487656 (0.0010) [2023-12-26 11:28:25,748][123090] Updated weights for policy 1, policy_version 1477890 (0.0007) [2023-12-26 11:28:25,804][123090] Updated weights for policy 1, policy_version 1477900 (0.0009) [2023-12-26 11:28:25,833][123091] Updated weights for policy 0, policy_version 1487666 (0.0011) [2023-12-26 11:28:25,866][123090] Updated weights for policy 1, policy_version 1477910 (0.0007) [2023-12-26 11:28:25,885][123091] Updated weights for policy 0, policy_version 1487676 (0.0010) [2023-12-26 11:28:25,918][123090] Updated weights for policy 1, policy_version 1477920 (0.0006) [2023-12-26 11:28:25,933][123091] Updated weights for policy 0, policy_version 1487686 (0.0010) [2023-12-26 11:28:25,976][123091] Updated weights for policy 0, policy_version 1487696 (0.0010) [2023-12-26 11:28:26,783][123090] Updated weights for policy 1, policy_version 1477930 (0.0007) [2023-12-26 11:28:26,797][123091] Updated weights for policy 0, policy_version 1487706 (0.0009) [2023-12-26 11:28:26,844][123090] Updated weights for policy 1, policy_version 1477940 (0.0010) [2023-12-26 11:28:26,856][123091] Updated weights for policy 0, policy_version 1487716 (0.0008) [2023-12-26 11:28:26,897][123090] Updated weights for policy 1, policy_version 1477950 (0.0008) [2023-12-26 11:28:26,907][123091] Updated weights for policy 0, policy_version 1487726 (0.0007) [2023-12-26 11:28:27,670][123091] Updated weights for policy 0, policy_version 1487736 (0.0006) [2023-12-26 11:28:27,688][123090] Updated weights for policy 1, policy_version 1477960 (0.0006) [2023-12-26 11:28:27,728][123091] Updated weights for policy 0, policy_version 1487746 (0.0006) [2023-12-26 11:28:27,763][123090] Updated weights for policy 1, policy_version 1477970 (0.0006) [2023-12-26 11:28:27,790][123091] Updated weights for policy 0, policy_version 1487756 (0.0005) [2023-12-26 11:28:27,835][123090] Updated weights for policy 1, policy_version 1477980 (0.0005) [2023-12-26 11:28:28,433][123090] Updated weights for policy 1, policy_version 1477990 (0.0008) [2023-12-26 11:28:28,490][123091] Updated weights for policy 0, policy_version 1487766 (0.0006) [2023-12-26 11:28:28,492][123090] Updated weights for policy 1, policy_version 1478000 (0.0008) [2023-12-26 11:28:28,542][123091] Updated weights for policy 0, policy_version 1487776 (0.0007) [2023-12-26 11:28:28,552][123090] Updated weights for policy 1, policy_version 1478010 (0.0010) [2023-12-26 11:28:28,592][123091] Updated weights for policy 0, policy_version 1487786 (0.0008) [2023-12-26 11:28:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 759250944. Throughput: 0: 8969.1, 1: 8813.7. Samples: 759238080. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:28,784][121949] Avg episode reward: [(0, '6253.667'), (1, '5633.020')] [2023-12-26 11:28:29,296][123090] Updated weights for policy 1, policy_version 1478020 (0.0009) [2023-12-26 11:28:29,356][123090] Updated weights for policy 1, policy_version 1478030 (0.0009) [2023-12-26 11:28:29,414][123090] Updated weights for policy 1, policy_version 1478040 (0.0010) [2023-12-26 11:28:29,478][123091] Updated weights for policy 0, policy_version 1487796 (0.0009) [2023-12-26 11:28:29,531][123091] Updated weights for policy 0, policy_version 1487806 (0.0009) [2023-12-26 11:28:29,589][123091] Updated weights for policy 0, policy_version 1487816 (0.0009) [2023-12-26 11:28:30,186][123090] Updated weights for policy 1, policy_version 1478050 (0.0010) [2023-12-26 11:28:30,259][123090] Updated weights for policy 1, policy_version 1478060 (0.0010) [2023-12-26 11:28:30,317][123090] Updated weights for policy 1, policy_version 1478070 (0.0010) [2023-12-26 11:28:30,373][123090] Updated weights for policy 1, policy_version 1478080 (0.0010) [2023-12-26 11:28:30,435][123091] Updated weights for policy 0, policy_version 1487826 (0.0008) [2023-12-26 11:28:30,497][123091] Updated weights for policy 0, policy_version 1487836 (0.0005) [2023-12-26 11:28:30,559][123091] Updated weights for policy 0, policy_version 1487846 (0.0005) [2023-12-26 11:28:30,613][123091] Updated weights for policy 0, policy_version 1487856 (0.0006) [2023-12-26 11:28:31,174][123090] Updated weights for policy 1, policy_version 1478090 (0.0009) [2023-12-26 11:28:31,226][123090] Updated weights for policy 1, policy_version 1478100 (0.0007) [2023-12-26 11:28:31,284][123090] Updated weights for policy 1, policy_version 1478110 (0.0006) [2023-12-26 11:28:31,287][123091] Updated weights for policy 0, policy_version 1487866 (0.0009) [2023-12-26 11:28:31,345][123091] Updated weights for policy 0, policy_version 1487876 (0.0010) [2023-12-26 11:28:31,410][123091] Updated weights for policy 0, policy_version 1487886 (0.0009) [2023-12-26 11:28:32,106][123090] Updated weights for policy 1, policy_version 1478120 (0.0008) [2023-12-26 11:28:32,176][123090] Updated weights for policy 1, policy_version 1478130 (0.0010) [2023-12-26 11:28:32,193][123091] Updated weights for policy 0, policy_version 1487896 (0.0007) [2023-12-26 11:28:32,239][123090] Updated weights for policy 1, policy_version 1478140 (0.0009) [2023-12-26 11:28:32,253][123091] Updated weights for policy 0, policy_version 1487906 (0.0008) [2023-12-26 11:28:32,317][123091] Updated weights for policy 0, policy_version 1487916 (0.0010) [2023-12-26 11:28:33,004][123090] Updated weights for policy 1, policy_version 1478150 (0.0006) [2023-12-26 11:28:33,054][123090] Updated weights for policy 1, policy_version 1478160 (0.0005) [2023-12-26 11:28:33,081][123091] Updated weights for policy 0, policy_version 1487926 (0.0008) [2023-12-26 11:28:33,102][123090] Updated weights for policy 1, policy_version 1478170 (0.0008) [2023-12-26 11:28:33,146][123091] Updated weights for policy 0, policy_version 1487936 (0.0006) [2023-12-26 11:28:33,226][123091] Updated weights for policy 0, policy_version 1487946 (0.0005) [2023-12-26 11:28:33,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 759332864. Throughput: 0: 8938.3, 1: 8840.8. Samples: 759347392. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:33,785][121949] Avg episode reward: [(0, '6227.933'), (1, '5527.861')] [2023-12-26 11:28:33,844][123091] Updated weights for policy 0, policy_version 1487956 (0.0005) [2023-12-26 11:28:33,919][123091] Updated weights for policy 0, policy_version 1487966 (0.0005) [2023-12-26 11:28:33,957][123090] Updated weights for policy 1, policy_version 1478180 (0.0010) [2023-12-26 11:28:33,988][123091] Updated weights for policy 0, policy_version 1487976 (0.0006) [2023-12-26 11:28:34,036][123090] Updated weights for policy 1, policy_version 1478190 (0.0005) [2023-12-26 11:28:34,100][123090] Updated weights for policy 1, policy_version 1478200 (0.0005) [2023-12-26 11:28:34,715][123091] Updated weights for policy 0, policy_version 1487986 (0.0006) [2023-12-26 11:28:34,774][123091] Updated weights for policy 0, policy_version 1487996 (0.0010) [2023-12-26 11:28:34,835][123091] Updated weights for policy 0, policy_version 1488006 (0.0009) [2023-12-26 11:28:34,886][123090] Updated weights for policy 1, policy_version 1478210 (0.0007) [2023-12-26 11:28:34,897][123091] Updated weights for policy 0, policy_version 1488016 (0.0008) [2023-12-26 11:28:34,945][123090] Updated weights for policy 1, policy_version 1478220 (0.0009) [2023-12-26 11:28:35,005][123090] Updated weights for policy 1, policy_version 1478230 (0.0009) [2023-12-26 11:28:35,073][123090] Updated weights for policy 1, policy_version 1478240 (0.0009) [2023-12-26 11:28:35,752][123091] Updated weights for policy 0, policy_version 1488026 (0.0010) [2023-12-26 11:28:35,799][123090] Updated weights for policy 1, policy_version 1478250 (0.0009) [2023-12-26 11:28:35,803][123091] Updated weights for policy 0, policy_version 1488036 (0.0007) [2023-12-26 11:28:35,848][123090] Updated weights for policy 1, policy_version 1478260 (0.0008) [2023-12-26 11:28:35,855][123091] Updated weights for policy 0, policy_version 1488046 (0.0007) [2023-12-26 11:28:35,905][123090] Updated weights for policy 1, policy_version 1478270 (0.0009) [2023-12-26 11:28:36,720][123091] Updated weights for policy 0, policy_version 1488056 (0.0010) [2023-12-26 11:28:36,779][123090] Updated weights for policy 1, policy_version 1478280 (0.0009) [2023-12-26 11:28:36,784][123091] Updated weights for policy 0, policy_version 1488066 (0.0008) [2023-12-26 11:28:36,842][123091] Updated weights for policy 0, policy_version 1488076 (0.0009) [2023-12-26 11:28:36,843][123090] Updated weights for policy 1, policy_version 1478290 (0.0005) [2023-12-26 11:28:36,906][123090] Updated weights for policy 1, policy_version 1478300 (0.0006) [2023-12-26 11:28:37,672][123091] Updated weights for policy 0, policy_version 1488086 (0.0007) [2023-12-26 11:28:37,737][123090] Updated weights for policy 1, policy_version 1478310 (0.0009) [2023-12-26 11:28:37,739][123091] Updated weights for policy 0, policy_version 1488096 (0.0006) [2023-12-26 11:28:37,800][123090] Updated weights for policy 1, policy_version 1478320 (0.0008) [2023-12-26 11:28:37,802][123091] Updated weights for policy 0, policy_version 1488106 (0.0007) [2023-12-26 11:28:37,859][123090] Updated weights for policy 1, policy_version 1478330 (0.0009) [2023-12-26 11:28:38,591][123091] Updated weights for policy 0, policy_version 1488116 (0.0008) [2023-12-26 11:28:38,656][123091] Updated weights for policy 0, policy_version 1488126 (0.0009) [2023-12-26 11:28:38,718][123090] Updated weights for policy 1, policy_version 1478340 (0.0007) [2023-12-26 11:28:38,719][123091] Updated weights for policy 0, policy_version 1488136 (0.0009) [2023-12-26 11:28:38,780][123090] Updated weights for policy 1, policy_version 1478350 (0.0007) [2023-12-26 11:28:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 759422976. Throughput: 0: 8967.7, 1: 8865.7. Samples: 759400396. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:38,785][121949] Avg episode reward: [(0, '6266.344'), (1, '5529.286')] [2023-12-26 11:28:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001488144_380968960.pth... [2023-12-26 11:28:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001487088_380698624.pth [2023-12-26 11:28:38,831][123090] Updated weights for policy 1, policy_version 1478360 (0.0005) [2023-12-26 11:28:38,871][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001478368_378462208.pth... [2023-12-26 11:28:38,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001477344_378200064.pth [2023-12-26 11:28:39,504][123090] Updated weights for policy 1, policy_version 1478370 (0.0006) [2023-12-26 11:28:39,565][123090] Updated weights for policy 1, policy_version 1478380 (0.0010) [2023-12-26 11:28:39,576][123091] Updated weights for policy 0, policy_version 1488146 (0.0008) [2023-12-26 11:28:39,626][123090] Updated weights for policy 1, policy_version 1478390 (0.0009) [2023-12-26 11:28:39,643][123091] Updated weights for policy 0, policy_version 1488156 (0.0008) [2023-12-26 11:28:39,676][123090] Updated weights for policy 1, policy_version 1478400 (0.0007) [2023-12-26 11:28:39,702][123091] Updated weights for policy 0, policy_version 1488166 (0.0010) [2023-12-26 11:28:39,759][123091] Updated weights for policy 0, policy_version 1488176 (0.0010) [2023-12-26 11:28:40,521][123091] Updated weights for policy 0, policy_version 1488186 (0.0010) [2023-12-26 11:28:40,585][123091] Updated weights for policy 0, policy_version 1488196 (0.0010) [2023-12-26 11:28:40,602][123090] Updated weights for policy 1, policy_version 1478410 (0.0006) [2023-12-26 11:28:40,651][123091] Updated weights for policy 0, policy_version 1488206 (0.0010) [2023-12-26 11:28:40,663][123090] Updated weights for policy 1, policy_version 1478420 (0.0007) [2023-12-26 11:28:40,717][123090] Updated weights for policy 1, policy_version 1478430 (0.0009) [2023-12-26 11:28:41,541][123091] Updated weights for policy 0, policy_version 1488216 (0.0006) [2023-12-26 11:28:41,604][123091] Updated weights for policy 0, policy_version 1488226 (0.0009) [2023-12-26 11:28:41,627][123090] Updated weights for policy 1, policy_version 1478440 (0.0008) [2023-12-26 11:28:41,667][123091] Updated weights for policy 0, policy_version 1488236 (0.0010) [2023-12-26 11:28:41,697][123090] Updated weights for policy 1, policy_version 1478450 (0.0006) [2023-12-26 11:28:41,768][123090] Updated weights for policy 1, policy_version 1478460 (0.0009) [2023-12-26 11:28:42,396][123091] Updated weights for policy 0, policy_version 1488246 (0.0008) [2023-12-26 11:28:42,443][123091] Updated weights for policy 0, policy_version 1488256 (0.0009) [2023-12-26 11:28:42,491][123091] Updated weights for policy 0, policy_version 1488266 (0.0009) [2023-12-26 11:28:42,646][123090] Updated weights for policy 1, policy_version 1478470 (0.0008) [2023-12-26 11:28:42,707][123090] Updated weights for policy 1, policy_version 1478480 (0.0008) [2023-12-26 11:28:42,776][123090] Updated weights for policy 1, policy_version 1478490 (0.0008) [2023-12-26 11:28:43,310][123091] Updated weights for policy 0, policy_version 1488277 (0.0007) [2023-12-26 11:28:43,362][123091] Updated weights for policy 0, policy_version 1488287 (0.0005) [2023-12-26 11:28:43,405][123091] Updated weights for policy 0, policy_version 1488297 (0.0005) [2023-12-26 11:28:43,452][123090] Updated weights for policy 1, policy_version 1478500 (0.0006) [2023-12-26 11:28:43,506][123090] Updated weights for policy 1, policy_version 1478510 (0.0005) [2023-12-26 11:28:43,559][123090] Updated weights for policy 1, policy_version 1478520 (0.0005) [2023-12-26 11:28:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 759513088. Throughput: 0: 8970.8, 1: 8773.1. Samples: 759502324. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:43,785][121949] Avg episode reward: [(0, '6282.018'), (1, '5594.449')] [2023-12-26 11:28:44,036][123091] Updated weights for policy 0, policy_version 1488307 (0.0005) [2023-12-26 11:28:44,085][123091] Updated weights for policy 0, policy_version 1488317 (0.0005) [2023-12-26 11:28:44,144][123091] Updated weights for policy 0, policy_version 1488327 (0.0005) [2023-12-26 11:28:44,243][123090] Updated weights for policy 1, policy_version 1478530 (0.0005) [2023-12-26 11:28:44,310][123090] Updated weights for policy 1, policy_version 1478540 (0.0006) [2023-12-26 11:28:44,363][123090] Updated weights for policy 1, policy_version 1478550 (0.0005) [2023-12-26 11:28:44,418][123090] Updated weights for policy 1, policy_version 1478560 (0.0005) [2023-12-26 11:28:44,930][123091] Updated weights for policy 0, policy_version 1488337 (0.0006) [2023-12-26 11:28:44,997][123091] Updated weights for policy 0, policy_version 1488347 (0.0011) [2023-12-26 11:28:45,070][123091] Updated weights for policy 0, policy_version 1488357 (0.0011) [2023-12-26 11:28:45,099][123090] Updated weights for policy 1, policy_version 1478570 (0.0008) [2023-12-26 11:28:45,126][123091] Updated weights for policy 0, policy_version 1488367 (0.0011) [2023-12-26 11:28:45,161][123090] Updated weights for policy 1, policy_version 1478580 (0.0007) [2023-12-26 11:28:45,214][123090] Updated weights for policy 1, policy_version 1478590 (0.0008) [2023-12-26 11:28:45,945][123091] Updated weights for policy 0, policy_version 1488377 (0.0010) [2023-12-26 11:28:45,951][123090] Updated weights for policy 1, policy_version 1478600 (0.0007) [2023-12-26 11:28:45,996][123091] Updated weights for policy 0, policy_version 1488387 (0.0010) [2023-12-26 11:28:45,999][123090] Updated weights for policy 1, policy_version 1478610 (0.0006) [2023-12-26 11:28:46,053][123090] Updated weights for policy 1, policy_version 1478620 (0.0009) [2023-12-26 11:28:46,055][123091] Updated weights for policy 0, policy_version 1488397 (0.0010) [2023-12-26 11:28:46,810][123090] Updated weights for policy 1, policy_version 1478630 (0.0007) [2023-12-26 11:28:46,866][123090] Updated weights for policy 1, policy_version 1478640 (0.0006) [2023-12-26 11:28:46,887][123091] Updated weights for policy 0, policy_version 1488407 (0.0010) [2023-12-26 11:28:46,922][123090] Updated weights for policy 1, policy_version 1478650 (0.0005) [2023-12-26 11:28:46,946][123091] Updated weights for policy 0, policy_version 1488417 (0.0010) [2023-12-26 11:28:47,004][123091] Updated weights for policy 0, policy_version 1488427 (0.0010) [2023-12-26 11:28:47,645][123090] Updated weights for policy 1, policy_version 1478660 (0.0006) [2023-12-26 11:28:47,702][123090] Updated weights for policy 1, policy_version 1478670 (0.0007) [2023-12-26 11:28:47,761][123090] Updated weights for policy 1, policy_version 1478680 (0.0010) [2023-12-26 11:28:47,819][123091] Updated weights for policy 0, policy_version 1488437 (0.0010) [2023-12-26 11:28:47,866][123091] Updated weights for policy 0, policy_version 1488447 (0.0010) [2023-12-26 11:28:47,927][123091] Updated weights for policy 0, policy_version 1488457 (0.0010) [2023-12-26 11:28:48,521][123090] Updated weights for policy 1, policy_version 1478690 (0.0010) [2023-12-26 11:28:48,590][123090] Updated weights for policy 1, policy_version 1478700 (0.0009) [2023-12-26 11:28:48,650][123090] Updated weights for policy 1, policy_version 1478710 (0.0009) [2023-12-26 11:28:48,719][123090] Updated weights for policy 1, policy_version 1478720 (0.0009) [2023-12-26 11:28:48,754][123091] Updated weights for policy 0, policy_version 1488467 (0.0010) [2023-12-26 11:28:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 759603200. Throughput: 0: 8954.0, 1: 8871.1. Samples: 759614964. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:48,785][121949] Avg episode reward: [(0, '6204.631'), (1, '5737.708')] [2023-12-26 11:28:48,814][123091] Updated weights for policy 0, policy_version 1488477 (0.0010) [2023-12-26 11:28:48,880][123091] Updated weights for policy 0, policy_version 1488487 (0.0010) [2023-12-26 11:28:49,577][123090] Updated weights for policy 1, policy_version 1478730 (0.0009) [2023-12-26 11:28:49,611][123091] Updated weights for policy 0, policy_version 1488497 (0.0010) [2023-12-26 11:28:49,631][123090] Updated weights for policy 1, policy_version 1478740 (0.0009) [2023-12-26 11:28:49,678][123091] Updated weights for policy 0, policy_version 1488507 (0.0006) [2023-12-26 11:28:49,688][123090] Updated weights for policy 1, policy_version 1478750 (0.0008) [2023-12-26 11:28:49,756][123091] Updated weights for policy 0, policy_version 1488517 (0.0006) [2023-12-26 11:28:49,827][123091] Updated weights for policy 0, policy_version 1488527 (0.0007) [2023-12-26 11:28:50,445][123090] Updated weights for policy 1, policy_version 1478760 (0.0005) [2023-12-26 11:28:50,502][123090] Updated weights for policy 1, policy_version 1478770 (0.0006) [2023-12-26 11:28:50,559][123090] Updated weights for policy 1, policy_version 1478780 (0.0008) [2023-12-26 11:28:50,608][123091] Updated weights for policy 0, policy_version 1488537 (0.0011) [2023-12-26 11:28:50,669][123091] Updated weights for policy 0, policy_version 1488547 (0.0009) [2023-12-26 11:28:50,729][123091] Updated weights for policy 0, policy_version 1488557 (0.0011) [2023-12-26 11:28:51,388][123090] Updated weights for policy 1, policy_version 1478790 (0.0008) [2023-12-26 11:28:51,454][123090] Updated weights for policy 1, policy_version 1478801 (0.0009) [2023-12-26 11:28:51,511][123090] Updated weights for policy 1, policy_version 1478811 (0.0010) [2023-12-26 11:28:51,547][123091] Updated weights for policy 0, policy_version 1488567 (0.0010) [2023-12-26 11:28:51,600][123091] Updated weights for policy 0, policy_version 1488577 (0.0008) [2023-12-26 11:28:51,675][123091] Updated weights for policy 0, policy_version 1488587 (0.0008) [2023-12-26 11:28:52,345][123090] Updated weights for policy 1, policy_version 1478821 (0.0007) [2023-12-26 11:28:52,421][123090] Updated weights for policy 1, policy_version 1478831 (0.0008) [2023-12-26 11:28:52,456][123091] Updated weights for policy 0, policy_version 1488597 (0.0008) [2023-12-26 11:28:52,494][123090] Updated weights for policy 1, policy_version 1478841 (0.0008) [2023-12-26 11:28:52,515][123091] Updated weights for policy 0, policy_version 1488607 (0.0005) [2023-12-26 11:28:52,577][123091] Updated weights for policy 0, policy_version 1488617 (0.0006) [2023-12-26 11:28:53,219][123090] Updated weights for policy 1, policy_version 1478851 (0.0008) [2023-12-26 11:28:53,280][123091] Updated weights for policy 0, policy_version 1488627 (0.0006) [2023-12-26 11:28:53,282][123090] Updated weights for policy 1, policy_version 1478861 (0.0008) [2023-12-26 11:28:53,341][123091] Updated weights for policy 0, policy_version 1488637 (0.0007) [2023-12-26 11:28:53,345][123090] Updated weights for policy 1, policy_version 1478871 (0.0008) [2023-12-26 11:28:53,396][123091] Updated weights for policy 0, policy_version 1488647 (0.0008) [2023-12-26 11:28:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 759693312. Throughput: 0: 8913.8, 1: 8833.6. Samples: 759666924. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:53,785][121949] Avg episode reward: [(0, '6239.895'), (1, '5643.190')] [2023-12-26 11:28:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001488656_381100032.pth... [2023-12-26 11:28:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001478880_378593280.pth... [2023-12-26 11:28:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001487600_380829696.pth [2023-12-26 11:28:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001477824_378322944.pth [2023-12-26 11:28:54,054][123091] Updated weights for policy 0, policy_version 1488657 (0.0009) [2023-12-26 11:28:54,057][123090] Updated weights for policy 1, policy_version 1478881 (0.0008) [2023-12-26 11:28:54,112][123090] Updated weights for policy 1, policy_version 1478891 (0.0007) [2023-12-26 11:28:54,118][123091] Updated weights for policy 0, policy_version 1488667 (0.0005) [2023-12-26 11:28:54,165][123090] Updated weights for policy 1, policy_version 1478901 (0.0008) [2023-12-26 11:28:54,182][123091] Updated weights for policy 0, policy_version 1488677 (0.0005) [2023-12-26 11:28:54,226][123090] Updated weights for policy 1, policy_version 1478911 (0.0007) [2023-12-26 11:28:54,239][123091] Updated weights for policy 0, policy_version 1488687 (0.0009) [2023-12-26 11:28:54,855][123091] Updated weights for policy 0, policy_version 1488697 (0.0005) [2023-12-26 11:28:54,915][123091] Updated weights for policy 0, policy_version 1488707 (0.0009) [2023-12-26 11:28:54,969][123091] Updated weights for policy 0, policy_version 1488717 (0.0006) [2023-12-26 11:28:55,123][123090] Updated weights for policy 1, policy_version 1478921 (0.0011) [2023-12-26 11:28:55,177][123090] Updated weights for policy 1, policy_version 1478931 (0.0008) [2023-12-26 11:28:55,235][123090] Updated weights for policy 1, policy_version 1478941 (0.0008) [2023-12-26 11:28:55,641][123091] Updated weights for policy 0, policy_version 1488727 (0.0005) [2023-12-26 11:28:55,713][123091] Updated weights for policy 0, policy_version 1488737 (0.0006) [2023-12-26 11:28:55,775][123091] Updated weights for policy 0, policy_version 1488747 (0.0009) [2023-12-26 11:28:56,057][123090] Updated weights for policy 1, policy_version 1478951 (0.0008) [2023-12-26 11:28:56,119][123090] Updated weights for policy 1, policy_version 1478961 (0.0006) [2023-12-26 11:28:56,186][123090] Updated weights for policy 1, policy_version 1478971 (0.0005) [2023-12-26 11:28:56,411][123091] Updated weights for policy 0, policy_version 1488757 (0.0007) [2023-12-26 11:28:56,467][123091] Updated weights for policy 0, policy_version 1488767 (0.0006) [2023-12-26 11:28:56,514][123091] Updated weights for policy 0, policy_version 1488777 (0.0005) [2023-12-26 11:28:56,805][123090] Updated weights for policy 1, policy_version 1478981 (0.0006) [2023-12-26 11:28:56,856][123090] Updated weights for policy 1, policy_version 1478991 (0.0005) [2023-12-26 11:28:56,913][123090] Updated weights for policy 1, policy_version 1479001 (0.0005) [2023-12-26 11:28:57,240][123091] Updated weights for policy 0, policy_version 1488787 (0.0006) [2023-12-26 11:28:57,291][123091] Updated weights for policy 0, policy_version 1488797 (0.0009) [2023-12-26 11:28:57,346][123091] Updated weights for policy 0, policy_version 1488807 (0.0006) [2023-12-26 11:28:57,618][123090] Updated weights for policy 1, policy_version 1479011 (0.0007) [2023-12-26 11:28:57,676][123090] Updated weights for policy 1, policy_version 1479021 (0.0010) [2023-12-26 11:28:57,735][123090] Updated weights for policy 1, policy_version 1479031 (0.0010) [2023-12-26 11:28:58,109][123091] Updated weights for policy 0, policy_version 1488817 (0.0006) [2023-12-26 11:28:58,171][123091] Updated weights for policy 0, policy_version 1488827 (0.0006) [2023-12-26 11:28:58,233][123091] Updated weights for policy 0, policy_version 1488837 (0.0006) [2023-12-26 11:28:58,297][123091] Updated weights for policy 0, policy_version 1488847 (0.0006) [2023-12-26 11:28:58,589][123090] Updated weights for policy 1, policy_version 1479041 (0.0010) [2023-12-26 11:28:58,656][123090] Updated weights for policy 1, policy_version 1479051 (0.0010) [2023-12-26 11:28:58,724][123090] Updated weights for policy 1, policy_version 1479061 (0.0008) [2023-12-26 11:28:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 759783424. Throughput: 0: 9062.2, 1: 8950.1. Samples: 759782480. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:28:58,785][121949] Avg episode reward: [(0, '6223.639'), (1, '5611.504')] [2023-12-26 11:28:58,790][123090] Updated weights for policy 1, policy_version 1479071 (0.0010) [2023-12-26 11:28:59,102][123091] Updated weights for policy 0, policy_version 1488857 (0.0010) [2023-12-26 11:28:59,164][123091] Updated weights for policy 0, policy_version 1488867 (0.0007) [2023-12-26 11:28:59,231][123091] Updated weights for policy 0, policy_version 1488877 (0.0006) [2023-12-26 11:28:59,704][123090] Updated weights for policy 1, policy_version 1479081 (0.0008) [2023-12-26 11:28:59,769][123090] Updated weights for policy 1, policy_version 1479091 (0.0008) [2023-12-26 11:28:59,826][123090] Updated weights for policy 1, policy_version 1479101 (0.0009) [2023-12-26 11:28:59,952][123091] Updated weights for policy 0, policy_version 1488887 (0.0009) [2023-12-26 11:29:00,004][123091] Updated weights for policy 0, policy_version 1488897 (0.0006) [2023-12-26 11:29:00,066][123091] Updated weights for policy 0, policy_version 1488907 (0.0009) [2023-12-26 11:29:00,604][123090] Updated weights for policy 1, policy_version 1479111 (0.0010) [2023-12-26 11:29:00,653][123090] Updated weights for policy 1, policy_version 1479121 (0.0009) [2023-12-26 11:29:00,712][123090] Updated weights for policy 1, policy_version 1479131 (0.0008) [2023-12-26 11:29:00,925][123091] Updated weights for policy 0, policy_version 1488917 (0.0009) [2023-12-26 11:29:00,998][123091] Updated weights for policy 0, policy_version 1488927 (0.0008) [2023-12-26 11:29:01,073][123091] Updated weights for policy 0, policy_version 1488937 (0.0008) [2023-12-26 11:29:01,569][123090] Updated weights for policy 1, policy_version 1479141 (0.0009) [2023-12-26 11:29:01,624][123090] Updated weights for policy 1, policy_version 1479151 (0.0009) [2023-12-26 11:29:01,685][123090] Updated weights for policy 1, policy_version 1479161 (0.0009) [2023-12-26 11:29:01,870][123091] Updated weights for policy 0, policy_version 1488947 (0.0009) [2023-12-26 11:29:01,935][123091] Updated weights for policy 0, policy_version 1488957 (0.0010) [2023-12-26 11:29:02,004][123091] Updated weights for policy 0, policy_version 1488967 (0.0009) [2023-12-26 11:29:02,523][123090] Updated weights for policy 1, policy_version 1479171 (0.0009) [2023-12-26 11:29:02,593][123090] Updated weights for policy 1, policy_version 1479181 (0.0006) [2023-12-26 11:29:02,662][123090] Updated weights for policy 1, policy_version 1479191 (0.0006) [2023-12-26 11:29:02,871][123091] Updated weights for policy 0, policy_version 1488977 (0.0009) [2023-12-26 11:29:02,930][123091] Updated weights for policy 0, policy_version 1488987 (0.0009) [2023-12-26 11:29:02,986][123091] Updated weights for policy 0, policy_version 1488998 (0.0010) [2023-12-26 11:29:03,042][123091] Updated weights for policy 0, policy_version 1489008 (0.0009) [2023-12-26 11:29:03,323][123090] Updated weights for policy 1, policy_version 1479201 (0.0006) [2023-12-26 11:29:03,379][123090] Updated weights for policy 1, policy_version 1479211 (0.0009) [2023-12-26 11:29:03,440][123090] Updated weights for policy 1, policy_version 1479221 (0.0005) [2023-12-26 11:29:03,504][123090] Updated weights for policy 1, policy_version 1479231 (0.0005) [2023-12-26 11:29:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 759873536. Throughput: 0: 9008.0, 1: 8907.6. Samples: 759887136. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:03,785][121949] Avg episode reward: [(0, '6158.078'), (1, '5746.201')] [2023-12-26 11:29:03,786][123091] Updated weights for policy 0, policy_version 1489018 (0.0005) [2023-12-26 11:29:03,863][123091] Updated weights for policy 0, policy_version 1489028 (0.0009) [2023-12-26 11:29:03,922][123091] Updated weights for policy 0, policy_version 1489038 (0.0011) [2023-12-26 11:29:04,144][123090] Updated weights for policy 1, policy_version 1479241 (0.0005) [2023-12-26 11:29:04,214][123090] Updated weights for policy 1, policy_version 1479251 (0.0005) [2023-12-26 11:29:04,294][123090] Updated weights for policy 1, policy_version 1479261 (0.0006) [2023-12-26 11:29:04,530][123091] Updated weights for policy 0, policy_version 1489048 (0.0010) [2023-12-26 11:29:04,588][123091] Updated weights for policy 0, policy_version 1489058 (0.0010) [2023-12-26 11:29:04,651][123091] Updated weights for policy 0, policy_version 1489068 (0.0011) [2023-12-26 11:29:04,994][123090] Updated weights for policy 1, policy_version 1479271 (0.0009) [2023-12-26 11:29:05,053][123090] Updated weights for policy 1, policy_version 1479281 (0.0008) [2023-12-26 11:29:05,109][123090] Updated weights for policy 1, policy_version 1479291 (0.0010) [2023-12-26 11:29:05,478][123091] Updated weights for policy 0, policy_version 1489078 (0.0011) [2023-12-26 11:29:05,538][123091] Updated weights for policy 0, policy_version 1489088 (0.0010) [2023-12-26 11:29:05,602][123091] Updated weights for policy 0, policy_version 1489098 (0.0009) [2023-12-26 11:29:05,891][123090] Updated weights for policy 1, policy_version 1479301 (0.0008) [2023-12-26 11:29:05,946][123090] Updated weights for policy 1, policy_version 1479311 (0.0006) [2023-12-26 11:29:05,994][123090] Updated weights for policy 1, policy_version 1479321 (0.0007) [2023-12-26 11:29:06,453][123091] Updated weights for policy 0, policy_version 1489108 (0.0010) [2023-12-26 11:29:06,516][123091] Updated weights for policy 0, policy_version 1489118 (0.0010) [2023-12-26 11:29:06,573][123091] Updated weights for policy 0, policy_version 1489128 (0.0009) [2023-12-26 11:29:06,656][123090] Updated weights for policy 1, policy_version 1479331 (0.0006) [2023-12-26 11:29:06,716][123090] Updated weights for policy 1, policy_version 1479341 (0.0010) [2023-12-26 11:29:06,776][123090] Updated weights for policy 1, policy_version 1479351 (0.0010) [2023-12-26 11:29:07,435][123091] Updated weights for policy 0, policy_version 1489138 (0.0010) [2023-12-26 11:29:07,499][123091] Updated weights for policy 0, policy_version 1489148 (0.0010) [2023-12-26 11:29:07,521][123090] Updated weights for policy 1, policy_version 1479361 (0.0010) [2023-12-26 11:29:07,558][123091] Updated weights for policy 0, policy_version 1489158 (0.0009) [2023-12-26 11:29:07,589][123090] Updated weights for policy 1, policy_version 1479371 (0.0008) [2023-12-26 11:29:07,622][123091] Updated weights for policy 0, policy_version 1489168 (0.0009) [2023-12-26 11:29:07,650][123090] Updated weights for policy 1, policy_version 1479381 (0.0008) [2023-12-26 11:29:07,715][123090] Updated weights for policy 1, policy_version 1479391 (0.0006) [2023-12-26 11:29:08,326][123090] Updated weights for policy 1, policy_version 1479401 (0.0006) [2023-12-26 11:29:08,390][123090] Updated weights for policy 1, policy_version 1479411 (0.0007) [2023-12-26 11:29:08,449][123090] Updated weights for policy 1, policy_version 1479421 (0.0005) [2023-12-26 11:29:08,535][123091] Updated weights for policy 0, policy_version 1489178 (0.0009) [2023-12-26 11:29:08,585][123091] Updated weights for policy 0, policy_version 1489188 (0.0009) [2023-12-26 11:29:08,646][123091] Updated weights for policy 0, policy_version 1489198 (0.0009) [2023-12-26 11:29:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 759971840. Throughput: 0: 9028.7, 1: 9006.4. Samples: 759943232. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:08,785][121949] Avg episode reward: [(0, '6132.334'), (1, '5634.171')] [2023-12-26 11:29:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001489200_381239296.pth... [2023-12-26 11:29:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001479424_378732544.pth... [2023-12-26 11:29:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001478368_378462208.pth [2023-12-26 11:29:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001488144_380968960.pth [2023-12-26 11:29:09,296][123090] Updated weights for policy 1, policy_version 1479431 (0.0009) [2023-12-26 11:29:09,362][123090] Updated weights for policy 1, policy_version 1479441 (0.0009) [2023-12-26 11:29:09,428][123090] Updated weights for policy 1, policy_version 1479451 (0.0009) [2023-12-26 11:29:09,518][123091] Updated weights for policy 0, policy_version 1489208 (0.0009) [2023-12-26 11:29:09,570][123091] Updated weights for policy 0, policy_version 1489218 (0.0009) [2023-12-26 11:29:09,628][123091] Updated weights for policy 0, policy_version 1489228 (0.0009) [2023-12-26 11:29:10,226][123090] Updated weights for policy 1, policy_version 1479461 (0.0008) [2023-12-26 11:29:10,300][123090] Updated weights for policy 1, policy_version 1479471 (0.0008) [2023-12-26 11:29:10,348][123090] Updated weights for policy 1, policy_version 1479481 (0.0008) [2023-12-26 11:29:10,499][123091] Updated weights for policy 0, policy_version 1489238 (0.0007) [2023-12-26 11:29:10,566][123091] Updated weights for policy 0, policy_version 1489248 (0.0005) [2023-12-26 11:29:10,632][123091] Updated weights for policy 0, policy_version 1489258 (0.0006) [2023-12-26 11:29:11,249][123090] Updated weights for policy 1, policy_version 1479491 (0.0007) [2023-12-26 11:29:11,326][123090] Updated weights for policy 1, policy_version 1479501 (0.0010) [2023-12-26 11:29:11,334][123091] Updated weights for policy 0, policy_version 1489268 (0.0008) [2023-12-26 11:29:11,396][123090] Updated weights for policy 1, policy_version 1479511 (0.0009) [2023-12-26 11:29:11,411][123091] Updated weights for policy 0, policy_version 1489278 (0.0009) [2023-12-26 11:29:11,480][123091] Updated weights for policy 0, policy_version 1489288 (0.0009) [2023-12-26 11:29:12,225][123090] Updated weights for policy 1, policy_version 1479521 (0.0008) [2023-12-26 11:29:12,290][123090] Updated weights for policy 1, policy_version 1479531 (0.0009) [2023-12-26 11:29:12,338][123091] Updated weights for policy 0, policy_version 1489298 (0.0009) [2023-12-26 11:29:12,360][123090] Updated weights for policy 1, policy_version 1479541 (0.0008) [2023-12-26 11:29:12,409][123091] Updated weights for policy 0, policy_version 1489308 (0.0008) [2023-12-26 11:29:12,426][123090] Updated weights for policy 1, policy_version 1479551 (0.0007) [2023-12-26 11:29:12,471][123091] Updated weights for policy 0, policy_version 1489318 (0.0009) [2023-12-26 11:29:12,541][123091] Updated weights for policy 0, policy_version 1489328 (0.0009) [2023-12-26 11:29:13,279][123090] Updated weights for policy 1, policy_version 1479561 (0.0009) [2023-12-26 11:29:13,327][123090] Updated weights for policy 1, policy_version 1479571 (0.0009) [2023-12-26 11:29:13,391][123090] Updated weights for policy 1, policy_version 1479581 (0.0009) [2023-12-26 11:29:13,391][123091] Updated weights for policy 0, policy_version 1489338 (0.0010) [2023-12-26 11:29:13,439][123091] Updated weights for policy 0, policy_version 1489348 (0.0010) [2023-12-26 11:29:13,484][123091] Updated weights for policy 0, policy_version 1489358 (0.0010) [2023-12-26 11:29:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 760053760. Throughput: 0: 8967.3, 1: 8971.9. Samples: 760045344. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:13,785][121949] Avg episode reward: [(0, '6236.337'), (1, '5337.672')] [2023-12-26 11:29:14,250][123091] Updated weights for policy 0, policy_version 1489368 (0.0007) [2023-12-26 11:29:14,282][123090] Updated weights for policy 1, policy_version 1479591 (0.0009) [2023-12-26 11:29:14,309][123091] Updated weights for policy 0, policy_version 1489378 (0.0006) [2023-12-26 11:29:14,337][123090] Updated weights for policy 1, policy_version 1479601 (0.0009) [2023-12-26 11:29:14,372][123091] Updated weights for policy 0, policy_version 1489388 (0.0005) [2023-12-26 11:29:14,386][123090] Updated weights for policy 1, policy_version 1479611 (0.0009) [2023-12-26 11:29:15,085][123091] Updated weights for policy 0, policy_version 1489398 (0.0008) [2023-12-26 11:29:15,154][123091] Updated weights for policy 0, policy_version 1489408 (0.0010) [2023-12-26 11:29:15,226][123091] Updated weights for policy 0, policy_version 1489418 (0.0011) [2023-12-26 11:29:15,291][123090] Updated weights for policy 1, policy_version 1479621 (0.0009) [2023-12-26 11:29:15,360][123090] Updated weights for policy 1, policy_version 1479631 (0.0010) [2023-12-26 11:29:15,419][123090] Updated weights for policy 1, policy_version 1479641 (0.0010) [2023-12-26 11:29:15,846][123091] Updated weights for policy 0, policy_version 1489428 (0.0009) [2023-12-26 11:29:15,904][123091] Updated weights for policy 0, policy_version 1489438 (0.0010) [2023-12-26 11:29:15,948][123091] Updated weights for policy 0, policy_version 1489448 (0.0010) [2023-12-26 11:29:16,341][123090] Updated weights for policy 1, policy_version 1479651 (0.0009) [2023-12-26 11:29:16,408][123090] Updated weights for policy 1, policy_version 1479661 (0.0005) [2023-12-26 11:29:16,471][123090] Updated weights for policy 1, policy_version 1479671 (0.0005) [2023-12-26 11:29:16,675][123091] Updated weights for policy 0, policy_version 1489458 (0.0006) [2023-12-26 11:29:16,737][123091] Updated weights for policy 0, policy_version 1489468 (0.0008) [2023-12-26 11:29:16,797][123091] Updated weights for policy 0, policy_version 1489478 (0.0011) [2023-12-26 11:29:16,859][123091] Updated weights for policy 0, policy_version 1489488 (0.0010) [2023-12-26 11:29:17,242][123090] Updated weights for policy 1, policy_version 1479681 (0.0006) [2023-12-26 11:29:17,298][123090] Updated weights for policy 1, policy_version 1479692 (0.0010) [2023-12-26 11:29:17,352][123090] Updated weights for policy 1, policy_version 1479702 (0.0010) [2023-12-26 11:29:17,405][123090] Updated weights for policy 1, policy_version 1479712 (0.0010) [2023-12-26 11:29:17,578][123091] Updated weights for policy 0, policy_version 1489498 (0.0007) [2023-12-26 11:29:17,634][123091] Updated weights for policy 0, policy_version 1489508 (0.0008) [2023-12-26 11:29:17,688][123091] Updated weights for policy 0, policy_version 1489518 (0.0009) [2023-12-26 11:29:18,286][123090] Updated weights for policy 1, policy_version 1479722 (0.0010) [2023-12-26 11:29:18,382][123090] Updated weights for policy 1, policy_version 1479732 (0.0010) [2023-12-26 11:29:18,449][123090] Updated weights for policy 1, policy_version 1479742 (0.0010) [2023-12-26 11:29:18,523][123091] Updated weights for policy 0, policy_version 1489528 (0.0009) [2023-12-26 11:29:18,588][123091] Updated weights for policy 0, policy_version 1489538 (0.0009) [2023-12-26 11:29:18,653][123091] Updated weights for policy 0, policy_version 1489548 (0.0009) [2023-12-26 11:29:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 760143872. Throughput: 0: 8998.6, 1: 8859.3. Samples: 760150996. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:18,785][121949] Avg episode reward: [(0, '6238.707'), (1, '5324.417')] [2023-12-26 11:29:19,191][123090] Updated weights for policy 1, policy_version 1479752 (0.0006) [2023-12-26 11:29:19,262][123090] Updated weights for policy 1, policy_version 1479762 (0.0009) [2023-12-26 11:29:19,328][123090] Updated weights for policy 1, policy_version 1479772 (0.0009) [2023-12-26 11:29:19,526][123091] Updated weights for policy 0, policy_version 1489558 (0.0009) [2023-12-26 11:29:19,592][123091] Updated weights for policy 0, policy_version 1489568 (0.0009) [2023-12-26 11:29:19,645][123091] Updated weights for policy 0, policy_version 1489578 (0.0010) [2023-12-26 11:29:20,150][123090] Updated weights for policy 1, policy_version 1479782 (0.0007) [2023-12-26 11:29:20,214][123090] Updated weights for policy 1, policy_version 1479792 (0.0009) [2023-12-26 11:29:20,279][123090] Updated weights for policy 1, policy_version 1479802 (0.0009) [2023-12-26 11:29:20,497][123091] Updated weights for policy 0, policy_version 1489588 (0.0009) [2023-12-26 11:29:20,574][123091] Updated weights for policy 0, policy_version 1489598 (0.0010) [2023-12-26 11:29:20,671][123091] Updated weights for policy 0, policy_version 1489608 (0.0010) [2023-12-26 11:29:21,058][123090] Updated weights for policy 1, policy_version 1479812 (0.0010) [2023-12-26 11:29:21,131][123090] Updated weights for policy 1, policy_version 1479822 (0.0009) [2023-12-26 11:29:21,199][123090] Updated weights for policy 1, policy_version 1479832 (0.0008) [2023-12-26 11:29:21,479][123091] Updated weights for policy 0, policy_version 1489618 (0.0008) [2023-12-26 11:29:21,542][123091] Updated weights for policy 0, policy_version 1489628 (0.0005) [2023-12-26 11:29:21,600][123091] Updated weights for policy 0, policy_version 1489638 (0.0006) [2023-12-26 11:29:21,673][123091] Updated weights for policy 0, policy_version 1489648 (0.0009) [2023-12-26 11:29:22,090][123090] Updated weights for policy 1, policy_version 1479842 (0.0007) [2023-12-26 11:29:22,139][123090] Updated weights for policy 1, policy_version 1479852 (0.0009) [2023-12-26 11:29:22,196][123090] Updated weights for policy 1, policy_version 1479862 (0.0009) [2023-12-26 11:29:22,261][123090] Updated weights for policy 1, policy_version 1479872 (0.0009) [2023-12-26 11:29:22,484][123091] Updated weights for policy 0, policy_version 1489658 (0.0010) [2023-12-26 11:29:22,541][123091] Updated weights for policy 0, policy_version 1489668 (0.0009) [2023-12-26 11:29:22,596][123091] Updated weights for policy 0, policy_version 1489678 (0.0009) [2023-12-26 11:29:23,124][123090] Updated weights for policy 1, policy_version 1479882 (0.0009) [2023-12-26 11:29:23,189][123090] Updated weights for policy 1, policy_version 1479892 (0.0009) [2023-12-26 11:29:23,261][123090] Updated weights for policy 1, policy_version 1479902 (0.0010) [2023-12-26 11:29:23,458][123091] Updated weights for policy 0, policy_version 1489688 (0.0010) [2023-12-26 11:29:23,514][123091] Updated weights for policy 0, policy_version 1489698 (0.0009) [2023-12-26 11:29:23,574][123091] Updated weights for policy 0, policy_version 1489708 (0.0010) [2023-12-26 11:29:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 760225792. Throughput: 0: 8966.3, 1: 8855.5. Samples: 760202376. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:23,785][121949] Avg episode reward: [(0, '6068.388'), (1, '5630.552')] [2023-12-26 11:29:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001489712_381370368.pth... [2023-12-26 11:29:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001479904_378855424.pth... [2023-12-26 11:29:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001488656_381100032.pth [2023-12-26 11:29:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001478880_378593280.pth [2023-12-26 11:29:24,105][123090] Updated weights for policy 1, policy_version 1479912 (0.0007) [2023-12-26 11:29:24,178][123090] Updated weights for policy 1, policy_version 1479922 (0.0006) [2023-12-26 11:29:24,254][123090] Updated weights for policy 1, policy_version 1479932 (0.0005) [2023-12-26 11:29:24,440][123091] Updated weights for policy 0, policy_version 1489718 (0.0008) [2023-12-26 11:29:24,505][123091] Updated weights for policy 0, policy_version 1489728 (0.0009) [2023-12-26 11:29:24,560][123091] Updated weights for policy 0, policy_version 1489738 (0.0010) [2023-12-26 11:29:25,018][123090] Updated weights for policy 1, policy_version 1479942 (0.0006) [2023-12-26 11:29:25,092][123090] Updated weights for policy 1, policy_version 1479952 (0.0005) [2023-12-26 11:29:25,160][123090] Updated weights for policy 1, policy_version 1479962 (0.0005) [2023-12-26 11:29:25,324][123091] Updated weights for policy 0, policy_version 1489748 (0.0010) [2023-12-26 11:29:25,377][123091] Updated weights for policy 0, policy_version 1489758 (0.0006) [2023-12-26 11:29:25,424][123091] Updated weights for policy 0, policy_version 1489768 (0.0005) [2023-12-26 11:29:25,825][123090] Updated weights for policy 1, policy_version 1479972 (0.0007) [2023-12-26 11:29:25,890][123090] Updated weights for policy 1, policy_version 1479982 (0.0009) [2023-12-26 11:29:25,937][123090] Updated weights for policy 1, policy_version 1479992 (0.0010) [2023-12-26 11:29:26,104][123091] Updated weights for policy 0, policy_version 1489778 (0.0006) [2023-12-26 11:29:26,157][123091] Updated weights for policy 0, policy_version 1489788 (0.0010) [2023-12-26 11:29:26,211][123091] Updated weights for policy 0, policy_version 1489798 (0.0009) [2023-12-26 11:29:26,262][123091] Updated weights for policy 0, policy_version 1489808 (0.0008) [2023-12-26 11:29:26,676][123090] Updated weights for policy 1, policy_version 1480002 (0.0009) [2023-12-26 11:29:26,730][123090] Updated weights for policy 1, policy_version 1480012 (0.0005) [2023-12-26 11:29:26,785][123090] Updated weights for policy 1, policy_version 1480022 (0.0008) [2023-12-26 11:29:26,840][123090] Updated weights for policy 1, policy_version 1480032 (0.0010) [2023-12-26 11:29:27,141][123091] Updated weights for policy 0, policy_version 1489818 (0.0009) [2023-12-26 11:29:27,196][123091] Updated weights for policy 0, policy_version 1489828 (0.0009) [2023-12-26 11:29:27,256][123091] Updated weights for policy 0, policy_version 1489838 (0.0009) [2023-12-26 11:29:27,658][123090] Updated weights for policy 1, policy_version 1480042 (0.0009) [2023-12-26 11:29:27,703][123090] Updated weights for policy 1, policy_version 1480052 (0.0008) [2023-12-26 11:29:27,752][123090] Updated weights for policy 1, policy_version 1480062 (0.0009) [2023-12-26 11:29:28,022][123091] Updated weights for policy 0, policy_version 1489848 (0.0009) [2023-12-26 11:29:28,074][123091] Updated weights for policy 0, policy_version 1489858 (0.0009) [2023-12-26 11:29:28,126][123091] Updated weights for policy 0, policy_version 1489868 (0.0009) [2023-12-26 11:29:28,550][123090] Updated weights for policy 1, policy_version 1480072 (0.0010) [2023-12-26 11:29:28,606][123090] Updated weights for policy 1, policy_version 1480083 (0.0010) [2023-12-26 11:29:28,661][123090] Updated weights for policy 1, policy_version 1480094 (0.0011) [2023-12-26 11:29:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 760315904. Throughput: 0: 8977.9, 1: 8944.6. Samples: 760308832. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:28,785][121949] Avg episode reward: [(0, '6187.565'), (1, '5845.031')] [2023-12-26 11:29:28,882][123091] Updated weights for policy 0, policy_version 1489878 (0.0009) [2023-12-26 11:29:28,945][123091] Updated weights for policy 0, policy_version 1489888 (0.0008) [2023-12-26 11:29:29,016][123091] Updated weights for policy 0, policy_version 1489898 (0.0007) [2023-12-26 11:29:29,442][123090] Updated weights for policy 1, policy_version 1480104 (0.0006) [2023-12-26 11:29:29,508][123090] Updated weights for policy 1, policy_version 1480114 (0.0006) [2023-12-26 11:29:29,573][123090] Updated weights for policy 1, policy_version 1480124 (0.0006) [2023-12-26 11:29:29,783][123091] Updated weights for policy 0, policy_version 1489908 (0.0007) [2023-12-26 11:29:29,867][123091] Updated weights for policy 0, policy_version 1489918 (0.0009) [2023-12-26 11:29:29,936][123091] Updated weights for policy 0, policy_version 1489928 (0.0007) [2023-12-26 11:29:30,304][123090] Updated weights for policy 1, policy_version 1480134 (0.0008) [2023-12-26 11:29:30,361][123090] Updated weights for policy 1, policy_version 1480144 (0.0009) [2023-12-26 11:29:30,418][123090] Updated weights for policy 1, policy_version 1480154 (0.0009) [2023-12-26 11:29:30,647][123091] Updated weights for policy 0, policy_version 1489938 (0.0006) [2023-12-26 11:29:30,697][123091] Updated weights for policy 0, policy_version 1489948 (0.0005) [2023-12-26 11:29:30,750][123091] Updated weights for policy 0, policy_version 1489958 (0.0005) [2023-12-26 11:29:30,804][123091] Updated weights for policy 0, policy_version 1489968 (0.0005) [2023-12-26 11:29:31,198][123090] Updated weights for policy 1, policy_version 1480164 (0.0009) [2023-12-26 11:29:31,256][123090] Updated weights for policy 1, policy_version 1480174 (0.0010) [2023-12-26 11:29:31,318][123090] Updated weights for policy 1, policy_version 1480184 (0.0010) [2023-12-26 11:29:31,577][123091] Updated weights for policy 0, policy_version 1489978 (0.0009) [2023-12-26 11:29:31,644][123091] Updated weights for policy 0, policy_version 1489988 (0.0008) [2023-12-26 11:29:31,718][123091] Updated weights for policy 0, policy_version 1489998 (0.0007) [2023-12-26 11:29:32,172][123090] Updated weights for policy 1, policy_version 1480194 (0.0009) [2023-12-26 11:29:32,224][123090] Updated weights for policy 1, policy_version 1480204 (0.0009) [2023-12-26 11:29:32,293][123090] Updated weights for policy 1, policy_version 1480214 (0.0010) [2023-12-26 11:29:32,368][123090] Updated weights for policy 1, policy_version 1480224 (0.0010) [2023-12-26 11:29:32,443][123091] Updated weights for policy 0, policy_version 1490008 (0.0006) [2023-12-26 11:29:32,490][123091] Updated weights for policy 0, policy_version 1490018 (0.0005) [2023-12-26 11:29:32,538][123091] Updated weights for policy 0, policy_version 1490028 (0.0005) [2023-12-26 11:29:33,145][123091] Updated weights for policy 0, policy_version 1490038 (0.0005) [2023-12-26 11:29:33,164][123090] Updated weights for policy 1, policy_version 1480234 (0.0006) [2023-12-26 11:29:33,190][123091] Updated weights for policy 0, policy_version 1490048 (0.0005) [2023-12-26 11:29:33,231][123090] Updated weights for policy 1, policy_version 1480244 (0.0005) [2023-12-26 11:29:33,235][123091] Updated weights for policy 0, policy_version 1490058 (0.0005) [2023-12-26 11:29:33,302][123090] Updated weights for policy 1, policy_version 1480254 (0.0005) [2023-12-26 11:29:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 760406016. Throughput: 0: 9076.8, 1: 8832.8. Samples: 760420904. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:33,785][121949] Avg episode reward: [(0, '6338.010'), (1, '5813.611')] [2023-12-26 11:29:33,896][123091] Updated weights for policy 0, policy_version 1490068 (0.0005) [2023-12-26 11:29:33,916][123090] Updated weights for policy 1, policy_version 1480264 (0.0005) [2023-12-26 11:29:33,942][123091] Updated weights for policy 0, policy_version 1490078 (0.0005) [2023-12-26 11:29:33,968][123090] Updated weights for policy 1, policy_version 1480274 (0.0005) [2023-12-26 11:29:33,986][123091] Updated weights for policy 0, policy_version 1490088 (0.0006) [2023-12-26 11:29:34,022][123090] Updated weights for policy 1, policy_version 1480284 (0.0005) [2023-12-26 11:29:34,736][123090] Updated weights for policy 1, policy_version 1480294 (0.0005) [2023-12-26 11:29:34,789][123090] Updated weights for policy 1, policy_version 1480304 (0.0006) [2023-12-26 11:29:34,794][123091] Updated weights for policy 0, policy_version 1490098 (0.0006) [2023-12-26 11:29:34,841][123090] Updated weights for policy 1, policy_version 1480314 (0.0005) [2023-12-26 11:29:34,853][123091] Updated weights for policy 0, policy_version 1490108 (0.0011) [2023-12-26 11:29:34,908][123091] Updated weights for policy 0, policy_version 1490118 (0.0011) [2023-12-26 11:29:34,956][123091] Updated weights for policy 0, policy_version 1490128 (0.0010) [2023-12-26 11:29:35,533][123090] Updated weights for policy 1, policy_version 1480324 (0.0006) [2023-12-26 11:29:35,587][123090] Updated weights for policy 1, policy_version 1480334 (0.0005) [2023-12-26 11:29:35,644][123090] Updated weights for policy 1, policy_version 1480344 (0.0005) [2023-12-26 11:29:35,756][123091] Updated weights for policy 0, policy_version 1490138 (0.0005) [2023-12-26 11:29:35,816][123091] Updated weights for policy 0, policy_version 1490148 (0.0006) [2023-12-26 11:29:35,877][123091] Updated weights for policy 0, policy_version 1490158 (0.0006) [2023-12-26 11:29:36,369][123090] Updated weights for policy 1, policy_version 1480354 (0.0006) [2023-12-26 11:29:36,433][123090] Updated weights for policy 1, policy_version 1480364 (0.0007) [2023-12-26 11:29:36,507][123090] Updated weights for policy 1, policy_version 1480374 (0.0007) [2023-12-26 11:29:36,572][123090] Updated weights for policy 1, policy_version 1480384 (0.0009) [2023-12-26 11:29:36,604][123091] Updated weights for policy 0, policy_version 1490168 (0.0008) [2023-12-26 11:29:36,669][123091] Updated weights for policy 0, policy_version 1490178 (0.0011) [2023-12-26 11:29:36,737][123091] Updated weights for policy 0, policy_version 1490188 (0.0011) [2023-12-26 11:29:37,375][123090] Updated weights for policy 1, policy_version 1480394 (0.0009) [2023-12-26 11:29:37,425][123090] Updated weights for policy 1, policy_version 1480404 (0.0009) [2023-12-26 11:29:37,485][123090] Updated weights for policy 1, policy_version 1480414 (0.0008) [2023-12-26 11:29:37,548][123091] Updated weights for policy 0, policy_version 1490198 (0.0011) [2023-12-26 11:29:37,600][123091] Updated weights for policy 0, policy_version 1490208 (0.0011) [2023-12-26 11:29:37,652][123091] Updated weights for policy 0, policy_version 1490218 (0.0010) [2023-12-26 11:29:38,348][123090] Updated weights for policy 1, policy_version 1480424 (0.0009) [2023-12-26 11:29:38,403][123090] Updated weights for policy 1, policy_version 1480434 (0.0008) [2023-12-26 11:29:38,465][123090] Updated weights for policy 1, policy_version 1480444 (0.0009) [2023-12-26 11:29:38,499][123091] Updated weights for policy 0, policy_version 1490228 (0.0010) [2023-12-26 11:29:38,565][123091] Updated weights for policy 0, policy_version 1490238 (0.0010) [2023-12-26 11:29:38,630][123091] Updated weights for policy 0, policy_version 1490248 (0.0010) [2023-12-26 11:29:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 760504320. Throughput: 0: 9118.2, 1: 8918.2. Samples: 760478564. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:38,785][121949] Avg episode reward: [(0, '6266.386'), (1, '5701.341')] [2023-12-26 11:29:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001490256_381509632.pth... [2023-12-26 11:29:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001480448_378994688.pth... [2023-12-26 11:29:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001479424_378732544.pth [2023-12-26 11:29:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001489200_381239296.pth [2023-12-26 11:29:39,341][123090] Updated weights for policy 1, policy_version 1480454 (0.0009) [2023-12-26 11:29:39,418][123090] Updated weights for policy 1, policy_version 1480464 (0.0009) [2023-12-26 11:29:39,482][123091] Updated weights for policy 0, policy_version 1490258 (0.0009) [2023-12-26 11:29:39,488][123090] Updated weights for policy 1, policy_version 1480474 (0.0008) [2023-12-26 11:29:39,546][123091] Updated weights for policy 0, policy_version 1490268 (0.0007) [2023-12-26 11:29:39,610][123091] Updated weights for policy 0, policy_version 1490278 (0.0008) [2023-12-26 11:29:39,670][123091] Updated weights for policy 0, policy_version 1490288 (0.0010) [2023-12-26 11:29:40,252][123090] Updated weights for policy 1, policy_version 1480484 (0.0008) [2023-12-26 11:29:40,314][123090] Updated weights for policy 1, policy_version 1480494 (0.0010) [2023-12-26 11:29:40,379][123090] Updated weights for policy 1, policy_version 1480504 (0.0009) [2023-12-26 11:29:40,524][123091] Updated weights for policy 0, policy_version 1490298 (0.0010) [2023-12-26 11:29:40,582][123091] Updated weights for policy 0, policy_version 1490308 (0.0010) [2023-12-26 11:29:40,638][123091] Updated weights for policy 0, policy_version 1490318 (0.0010) [2023-12-26 11:29:41,249][123090] Updated weights for policy 1, policy_version 1480514 (0.0009) [2023-12-26 11:29:41,314][123090] Updated weights for policy 1, policy_version 1480524 (0.0010) [2023-12-26 11:29:41,389][123090] Updated weights for policy 1, policy_version 1480534 (0.0008) [2023-12-26 11:29:41,437][123091] Updated weights for policy 0, policy_version 1490328 (0.0008) [2023-12-26 11:29:41,457][123090] Updated weights for policy 1, policy_version 1480544 (0.0006) [2023-12-26 11:29:41,496][123091] Updated weights for policy 0, policy_version 1490338 (0.0009) [2023-12-26 11:29:41,558][123091] Updated weights for policy 0, policy_version 1490348 (0.0006) [2023-12-26 11:29:42,217][123090] Updated weights for policy 1, policy_version 1480554 (0.0010) [2023-12-26 11:29:42,285][123090] Updated weights for policy 1, policy_version 1480564 (0.0010) [2023-12-26 11:29:42,332][123091] Updated weights for policy 0, policy_version 1490358 (0.0007) [2023-12-26 11:29:42,352][123090] Updated weights for policy 1, policy_version 1480574 (0.0009) [2023-12-26 11:29:42,399][123091] Updated weights for policy 0, policy_version 1490368 (0.0009) [2023-12-26 11:29:42,456][123091] Updated weights for policy 0, policy_version 1490378 (0.0009) [2023-12-26 11:29:43,156][123090] Updated weights for policy 1, policy_version 1480584 (0.0006) [2023-12-26 11:29:43,202][123090] Updated weights for policy 1, policy_version 1480594 (0.0005) [2023-12-26 11:29:43,215][123091] Updated weights for policy 0, policy_version 1490388 (0.0008) [2023-12-26 11:29:43,248][123090] Updated weights for policy 1, policy_version 1480604 (0.0007) [2023-12-26 11:29:43,272][123091] Updated weights for policy 0, policy_version 1490398 (0.0007) [2023-12-26 11:29:43,331][123091] Updated weights for policy 0, policy_version 1490408 (0.0010) [2023-12-26 11:29:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 760586240. Throughput: 0: 8901.7, 1: 8812.2. Samples: 760579608. Policy #0 lag: (min: 31.0, avg: 37.2, max: 63.0) [2023-12-26 11:29:43,785][121949] Avg episode reward: [(0, '6013.007'), (1, '5506.536')] [2023-12-26 11:29:43,934][123090] Updated weights for policy 1, policy_version 1480614 (0.0005) [2023-12-26 11:29:43,989][123090] Updated weights for policy 1, policy_version 1480624 (0.0005) [2023-12-26 11:29:44,047][123090] Updated weights for policy 1, policy_version 1480634 (0.0005) [2023-12-26 11:29:44,186][123091] Updated weights for policy 0, policy_version 1490419 (0.0010) [2023-12-26 11:29:44,249][123091] Updated weights for policy 0, policy_version 1490429 (0.0009) [2023-12-26 11:29:44,308][123091] Updated weights for policy 0, policy_version 1490439 (0.0009) [2023-12-26 11:29:44,770][123090] Updated weights for policy 1, policy_version 1480644 (0.0007) [2023-12-26 11:29:44,836][123090] Updated weights for policy 1, policy_version 1480654 (0.0009) [2023-12-26 11:29:44,908][123090] Updated weights for policy 1, policy_version 1480664 (0.0010) [2023-12-26 11:29:45,137][123091] Updated weights for policy 0, policy_version 1490449 (0.0009) [2023-12-26 11:29:45,206][123091] Updated weights for policy 0, policy_version 1490459 (0.0009) [2023-12-26 11:29:45,275][123091] Updated weights for policy 0, policy_version 1490469 (0.0009) [2023-12-26 11:29:45,344][123091] Updated weights for policy 0, policy_version 1490479 (0.0009) [2023-12-26 11:29:45,737][123090] Updated weights for policy 1, policy_version 1480674 (0.0010) [2023-12-26 11:29:45,784][123090] Updated weights for policy 1, policy_version 1480684 (0.0010) [2023-12-26 11:29:45,838][123090] Updated weights for policy 1, policy_version 1480694 (0.0010) [2023-12-26 11:29:45,904][123090] Updated weights for policy 1, policy_version 1480704 (0.0010) [2023-12-26 11:29:46,149][123091] Updated weights for policy 0, policy_version 1490489 (0.0009) [2023-12-26 11:29:46,208][123091] Updated weights for policy 0, policy_version 1490499 (0.0009) [2023-12-26 11:29:46,268][123091] Updated weights for policy 0, policy_version 1490509 (0.0009) [2023-12-26 11:29:46,738][123090] Updated weights for policy 1, policy_version 1480714 (0.0010) [2023-12-26 11:29:46,785][123090] Updated weights for policy 1, policy_version 1480724 (0.0010) [2023-12-26 11:29:46,833][123090] Updated weights for policy 1, policy_version 1480734 (0.0010) [2023-12-26 11:29:47,098][123091] Updated weights for policy 0, policy_version 1490519 (0.0009) [2023-12-26 11:29:47,149][123091] Updated weights for policy 0, policy_version 1490529 (0.0009) [2023-12-26 11:29:47,201][123091] Updated weights for policy 0, policy_version 1490539 (0.0009) [2023-12-26 11:29:47,677][123090] Updated weights for policy 1, policy_version 1480744 (0.0010) [2023-12-26 11:29:47,736][123090] Updated weights for policy 1, policy_version 1480754 (0.0010) [2023-12-26 11:29:47,780][123090] Updated weights for policy 1, policy_version 1480764 (0.0010) [2023-12-26 11:29:48,048][123091] Updated weights for policy 0, policy_version 1490549 (0.0009) [2023-12-26 11:29:48,116][123091] Updated weights for policy 0, policy_version 1490559 (0.0009) [2023-12-26 11:29:48,164][123091] Updated weights for policy 0, policy_version 1490569 (0.0009) [2023-12-26 11:29:48,622][123090] Updated weights for policy 1, policy_version 1480774 (0.0010) [2023-12-26 11:29:48,682][123090] Updated weights for policy 1, policy_version 1480784 (0.0010) [2023-12-26 11:29:48,738][123090] Updated weights for policy 1, policy_version 1480794 (0.0010) [2023-12-26 11:29:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 760676352. Throughput: 0: 8883.3, 1: 8863.8. Samples: 760685756. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:29:48,785][121949] Avg episode reward: [(0, '6078.817'), (1, '5567.621')] [2023-12-26 11:29:48,902][123091] Updated weights for policy 0, policy_version 1490579 (0.0009) [2023-12-26 11:29:48,963][123091] Updated weights for policy 0, policy_version 1490589 (0.0005) [2023-12-26 11:29:49,035][123091] Updated weights for policy 0, policy_version 1490599 (0.0005) [2023-12-26 11:29:49,530][123090] Updated weights for policy 1, policy_version 1480804 (0.0010) [2023-12-26 11:29:49,583][123090] Updated weights for policy 1, policy_version 1480814 (0.0007) [2023-12-26 11:29:49,636][123090] Updated weights for policy 1, policy_version 1480824 (0.0009) [2023-12-26 11:29:49,819][123091] Updated weights for policy 0, policy_version 1490609 (0.0010) [2023-12-26 11:29:49,882][123091] Updated weights for policy 0, policy_version 1490619 (0.0009) [2023-12-26 11:29:49,956][123091] Updated weights for policy 0, policy_version 1490629 (0.0009) [2023-12-26 11:29:50,024][123091] Updated weights for policy 0, policy_version 1490639 (0.0011) [2023-12-26 11:29:50,479][123090] Updated weights for policy 1, policy_version 1480834 (0.0008) [2023-12-26 11:29:50,533][123090] Updated weights for policy 1, policy_version 1480844 (0.0005) [2023-12-26 11:29:50,601][123090] Updated weights for policy 1, policy_version 1480854 (0.0007) [2023-12-26 11:29:50,665][123090] Updated weights for policy 1, policy_version 1480864 (0.0006) [2023-12-26 11:29:50,815][123091] Updated weights for policy 0, policy_version 1490649 (0.0006) [2023-12-26 11:29:50,867][123091] Updated weights for policy 0, policy_version 1490659 (0.0005) [2023-12-26 11:29:50,924][123091] Updated weights for policy 0, policy_version 1490669 (0.0009) [2023-12-26 11:29:51,423][123090] Updated weights for policy 1, policy_version 1480874 (0.0007) [2023-12-26 11:29:51,486][123090] Updated weights for policy 1, policy_version 1480884 (0.0005) [2023-12-26 11:29:51,556][123090] Updated weights for policy 1, policy_version 1480894 (0.0009) [2023-12-26 11:29:51,671][123091] Updated weights for policy 0, policy_version 1490679 (0.0009) [2023-12-26 11:29:51,741][123091] Updated weights for policy 0, policy_version 1490689 (0.0009) [2023-12-26 11:29:51,804][123091] Updated weights for policy 0, policy_version 1490699 (0.0009) [2023-12-26 11:29:52,382][123090] Updated weights for policy 1, policy_version 1480904 (0.0010) [2023-12-26 11:29:52,446][123090] Updated weights for policy 1, policy_version 1480914 (0.0011) [2023-12-26 11:29:52,513][123090] Updated weights for policy 1, policy_version 1480924 (0.0011) [2023-12-26 11:29:52,607][123091] Updated weights for policy 0, policy_version 1490709 (0.0007) [2023-12-26 11:29:52,671][123091] Updated weights for policy 0, policy_version 1490719 (0.0006) [2023-12-26 11:29:52,727][123091] Updated weights for policy 0, policy_version 1490729 (0.0009) [2023-12-26 11:29:53,335][123090] Updated weights for policy 1, policy_version 1480934 (0.0010) [2023-12-26 11:29:53,389][123090] Updated weights for policy 1, policy_version 1480944 (0.0010) [2023-12-26 11:29:53,444][123090] Updated weights for policy 1, policy_version 1480954 (0.0008) [2023-12-26 11:29:53,492][123091] Updated weights for policy 0, policy_version 1490739 (0.0009) [2023-12-26 11:29:53,552][123091] Updated weights for policy 0, policy_version 1490749 (0.0007) [2023-12-26 11:29:53,621][123091] Updated weights for policy 0, policy_version 1490759 (0.0006) [2023-12-26 11:29:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 760766464. Throughput: 0: 8900.3, 1: 8795.2. Samples: 760739528. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:29:53,785][121949] Avg episode reward: [(0, '6134.769'), (1, '5696.472')] [2023-12-26 11:29:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001490768_381640704.pth... [2023-12-26 11:29:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001480960_379125760.pth... [2023-12-26 11:29:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001479904_378855424.pth [2023-12-26 11:29:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001489712_381370368.pth [2023-12-26 11:29:54,242][123090] Updated weights for policy 1, policy_version 1480965 (0.0007) [2023-12-26 11:29:54,311][123091] Updated weights for policy 0, policy_version 1490769 (0.0005) [2023-12-26 11:29:54,319][123090] Updated weights for policy 1, policy_version 1480975 (0.0007) [2023-12-26 11:29:54,381][123090] Updated weights for policy 1, policy_version 1480985 (0.0008) [2023-12-26 11:29:54,381][123091] Updated weights for policy 0, policy_version 1490779 (0.0010) [2023-12-26 11:29:54,449][123091] Updated weights for policy 0, policy_version 1490789 (0.0011) [2023-12-26 11:29:54,517][123091] Updated weights for policy 0, policy_version 1490799 (0.0011) [2023-12-26 11:29:55,023][123090] Updated weights for policy 1, policy_version 1480995 (0.0007) [2023-12-26 11:29:55,084][123090] Updated weights for policy 1, policy_version 1481005 (0.0009) [2023-12-26 11:29:55,148][123090] Updated weights for policy 1, policy_version 1481015 (0.0009) [2023-12-26 11:29:55,295][123091] Updated weights for policy 0, policy_version 1490809 (0.0010) [2023-12-26 11:29:55,347][123091] Updated weights for policy 0, policy_version 1490819 (0.0010) [2023-12-26 11:29:55,414][123091] Updated weights for policy 0, policy_version 1490829 (0.0010) [2023-12-26 11:29:55,918][123090] Updated weights for policy 1, policy_version 1481025 (0.0008) [2023-12-26 11:29:55,973][123090] Updated weights for policy 1, policy_version 1481035 (0.0008) [2023-12-26 11:29:56,032][123090] Updated weights for policy 1, policy_version 1481045 (0.0008) [2023-12-26 11:29:56,084][123090] Updated weights for policy 1, policy_version 1481055 (0.0008) [2023-12-26 11:29:56,250][123091] Updated weights for policy 0, policy_version 1490839 (0.0010) [2023-12-26 11:29:56,310][123091] Updated weights for policy 0, policy_version 1490849 (0.0006) [2023-12-26 11:29:56,361][123091] Updated weights for policy 0, policy_version 1490859 (0.0005) [2023-12-26 11:29:56,940][123091] Updated weights for policy 0, policy_version 1490869 (0.0005) [2023-12-26 11:29:57,003][123091] Updated weights for policy 0, policy_version 1490879 (0.0005) [2023-12-26 11:29:57,010][123090] Updated weights for policy 1, policy_version 1481065 (0.0008) [2023-12-26 11:29:57,061][123091] Updated weights for policy 0, policy_version 1490889 (0.0010) [2023-12-26 11:29:57,080][123090] Updated weights for policy 1, policy_version 1481075 (0.0006) [2023-12-26 11:29:57,139][123090] Updated weights for policy 1, policy_version 1481085 (0.0008) [2023-12-26 11:29:57,831][123091] Updated weights for policy 0, policy_version 1490899 (0.0010) [2023-12-26 11:29:57,883][123091] Updated weights for policy 0, policy_version 1490909 (0.0009) [2023-12-26 11:29:57,931][123091] Updated weights for policy 0, policy_version 1490919 (0.0009) [2023-12-26 11:29:57,972][123090] Updated weights for policy 1, policy_version 1481095 (0.0006) [2023-12-26 11:29:58,044][123090] Updated weights for policy 1, policy_version 1481105 (0.0006) [2023-12-26 11:29:58,103][123090] Updated weights for policy 1, policy_version 1481115 (0.0007) [2023-12-26 11:29:58,769][123091] Updated weights for policy 0, policy_version 1490929 (0.0010) [2023-12-26 11:29:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 760848384. Throughput: 0: 9012.7, 1: 8813.5. Samples: 760847524. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:29:58,785][121949] Avg episode reward: [(0, '6132.663'), (1, '5723.907')] [2023-12-26 11:29:58,840][123091] Updated weights for policy 0, policy_version 1490939 (0.0007) [2023-12-26 11:29:58,867][123090] Updated weights for policy 1, policy_version 1481125 (0.0008) [2023-12-26 11:29:58,905][123091] Updated weights for policy 0, policy_version 1490949 (0.0007) [2023-12-26 11:29:58,931][123090] Updated weights for policy 1, policy_version 1481135 (0.0008) [2023-12-26 11:29:58,967][123091] Updated weights for policy 0, policy_version 1490959 (0.0010) [2023-12-26 11:29:58,979][123090] Updated weights for policy 1, policy_version 1481145 (0.0006) [2023-12-26 11:29:59,609][123091] Updated weights for policy 0, policy_version 1490969 (0.0006) [2023-12-26 11:29:59,682][123091] Updated weights for policy 0, policy_version 1490979 (0.0005) [2023-12-26 11:29:59,728][123091] Updated weights for policy 0, policy_version 1490989 (0.0005) [2023-12-26 11:29:59,894][123090] Updated weights for policy 1, policy_version 1481155 (0.0009) [2023-12-26 11:29:59,960][123090] Updated weights for policy 1, policy_version 1481165 (0.0010) [2023-12-26 11:30:00,015][123090] Updated weights for policy 1, policy_version 1481175 (0.0010) [2023-12-26 11:30:00,461][123091] Updated weights for policy 0, policy_version 1490999 (0.0007) [2023-12-26 11:30:00,519][123091] Updated weights for policy 0, policy_version 1491009 (0.0009) [2023-12-26 11:30:00,580][123091] Updated weights for policy 0, policy_version 1491019 (0.0009) [2023-12-26 11:30:00,870][123090] Updated weights for policy 1, policy_version 1481186 (0.0010) [2023-12-26 11:30:00,938][123090] Updated weights for policy 1, policy_version 1481196 (0.0010) [2023-12-26 11:30:00,996][123090] Updated weights for policy 1, policy_version 1481206 (0.0010) [2023-12-26 11:30:01,061][123090] Updated weights for policy 1, policy_version 1481216 (0.0010) [2023-12-26 11:30:01,437][123091] Updated weights for policy 0, policy_version 1491029 (0.0010) [2023-12-26 11:30:01,497][123091] Updated weights for policy 0, policy_version 1491039 (0.0009) [2023-12-26 11:30:01,561][123091] Updated weights for policy 0, policy_version 1491049 (0.0008) [2023-12-26 11:30:01,896][123090] Updated weights for policy 1, policy_version 1481226 (0.0011) [2023-12-26 11:30:01,948][123090] Updated weights for policy 1, policy_version 1481236 (0.0010) [2023-12-26 11:30:02,008][123090] Updated weights for policy 1, policy_version 1481246 (0.0010) [2023-12-26 11:30:02,423][123091] Updated weights for policy 0, policy_version 1491059 (0.0009) [2023-12-26 11:30:02,482][123091] Updated weights for policy 0, policy_version 1491069 (0.0010) [2023-12-26 11:30:02,543][123091] Updated weights for policy 0, policy_version 1491079 (0.0010) [2023-12-26 11:30:02,814][123090] Updated weights for policy 1, policy_version 1481256 (0.0006) [2023-12-26 11:30:02,866][123090] Updated weights for policy 1, policy_version 1481266 (0.0005) [2023-12-26 11:30:02,928][123090] Updated weights for policy 1, policy_version 1481276 (0.0005) [2023-12-26 11:30:03,418][123091] Updated weights for policy 0, policy_version 1491089 (0.0010) [2023-12-26 11:30:03,481][123091] Updated weights for policy 0, policy_version 1491099 (0.0009) [2023-12-26 11:30:03,539][123091] Updated weights for policy 0, policy_version 1491109 (0.0009) [2023-12-26 11:30:03,575][123090] Updated weights for policy 1, policy_version 1481286 (0.0008) [2023-12-26 11:30:03,595][123091] Updated weights for policy 0, policy_version 1491119 (0.0006) [2023-12-26 11:30:03,622][123090] Updated weights for policy 1, policy_version 1481296 (0.0009) [2023-12-26 11:30:03,668][123090] Updated weights for policy 1, policy_version 1481306 (0.0005) [2023-12-26 11:30:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 760946688. Throughput: 0: 8922.7, 1: 8887.3. Samples: 760952444. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:03,784][121949] Avg episode reward: [(0, '6161.727'), (1, '5749.235')] [2023-12-26 11:30:04,440][123090] Updated weights for policy 1, policy_version 1481316 (0.0007) [2023-12-26 11:30:04,487][123091] Updated weights for policy 0, policy_version 1491129 (0.0009) [2023-12-26 11:30:04,494][123090] Updated weights for policy 1, policy_version 1481326 (0.0008) [2023-12-26 11:30:04,537][123091] Updated weights for policy 0, policy_version 1491139 (0.0008) [2023-12-26 11:30:04,544][123090] Updated weights for policy 1, policy_version 1481336 (0.0007) [2023-12-26 11:30:04,590][123091] Updated weights for policy 0, policy_version 1491149 (0.0008) [2023-12-26 11:30:05,253][123091] Updated weights for policy 0, policy_version 1491159 (0.0010) [2023-12-26 11:30:05,304][123091] Updated weights for policy 0, policy_version 1491169 (0.0010) [2023-12-26 11:30:05,352][123091] Updated weights for policy 0, policy_version 1491179 (0.0010) [2023-12-26 11:30:05,361][123090] Updated weights for policy 1, policy_version 1481346 (0.0007) [2023-12-26 11:30:05,418][123090] Updated weights for policy 1, policy_version 1481356 (0.0008) [2023-12-26 11:30:05,465][123090] Updated weights for policy 1, policy_version 1481366 (0.0008) [2023-12-26 11:30:05,515][123090] Updated weights for policy 1, policy_version 1481376 (0.0009) [2023-12-26 11:30:06,100][123091] Updated weights for policy 0, policy_version 1491189 (0.0011) [2023-12-26 11:30:06,164][123091] Updated weights for policy 0, policy_version 1491199 (0.0008) [2023-12-26 11:30:06,220][123091] Updated weights for policy 0, policy_version 1491209 (0.0011) [2023-12-26 11:30:06,433][123090] Updated weights for policy 1, policy_version 1481386 (0.0010) [2023-12-26 11:30:06,489][123090] Updated weights for policy 1, policy_version 1481396 (0.0010) [2023-12-26 11:30:06,551][123090] Updated weights for policy 1, policy_version 1481406 (0.0009) [2023-12-26 11:30:06,927][123091] Updated weights for policy 0, policy_version 1491219 (0.0011) [2023-12-26 11:30:06,983][123091] Updated weights for policy 0, policy_version 1491229 (0.0011) [2023-12-26 11:30:07,038][123091] Updated weights for policy 0, policy_version 1491239 (0.0011) [2023-12-26 11:30:07,426][123090] Updated weights for policy 1, policy_version 1481416 (0.0010) [2023-12-26 11:30:07,491][123090] Updated weights for policy 1, policy_version 1481426 (0.0009) [2023-12-26 11:30:07,547][123090] Updated weights for policy 1, policy_version 1481436 (0.0009) [2023-12-26 11:30:07,736][123091] Updated weights for policy 0, policy_version 1491249 (0.0010) [2023-12-26 11:30:07,799][123091] Updated weights for policy 0, policy_version 1491259 (0.0007) [2023-12-26 11:30:07,861][123091] Updated weights for policy 0, policy_version 1491269 (0.0006) [2023-12-26 11:30:07,931][123091] Updated weights for policy 0, policy_version 1491279 (0.0006) [2023-12-26 11:30:08,522][123090] Updated weights for policy 1, policy_version 1481446 (0.0009) [2023-12-26 11:30:08,580][123090] Updated weights for policy 1, policy_version 1481456 (0.0009) [2023-12-26 11:30:08,605][123091] Updated weights for policy 0, policy_version 1491289 (0.0008) [2023-12-26 11:30:08,630][123090] Updated weights for policy 1, policy_version 1481466 (0.0008) [2023-12-26 11:30:08,663][123091] Updated weights for policy 0, policy_version 1491299 (0.0009) [2023-12-26 11:30:08,728][123091] Updated weights for policy 0, policy_version 1491309 (0.0009) [2023-12-26 11:30:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 761036800. Throughput: 0: 8991.7, 1: 8879.7. Samples: 761006588. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:08,785][121949] Avg episode reward: [(0, '6095.547'), (1, '5772.214')] [2023-12-26 11:30:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001491312_381779968.pth... [2023-12-26 11:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001481472_379256832.pth... [2023-12-26 11:30:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001480448_378994688.pth [2023-12-26 11:30:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001490256_381509632.pth [2023-12-26 11:30:09,485][123090] Updated weights for policy 1, policy_version 1481476 (0.0006) [2023-12-26 11:30:09,547][123090] Updated weights for policy 1, policy_version 1481486 (0.0006) [2023-12-26 11:30:09,609][123090] Updated weights for policy 1, policy_version 1481496 (0.0006) [2023-12-26 11:30:09,613][123091] Updated weights for policy 0, policy_version 1491319 (0.0008) [2023-12-26 11:30:09,674][123091] Updated weights for policy 0, policy_version 1491329 (0.0007) [2023-12-26 11:30:09,728][123091] Updated weights for policy 0, policy_version 1491339 (0.0008) [2023-12-26 11:30:10,363][123090] Updated weights for policy 1, policy_version 1481506 (0.0009) [2023-12-26 11:30:10,436][123090] Updated weights for policy 1, policy_version 1481516 (0.0008) [2023-12-26 11:30:10,504][123090] Updated weights for policy 1, policy_version 1481526 (0.0005) [2023-12-26 11:30:10,565][123090] Updated weights for policy 1, policy_version 1481536 (0.0005) [2023-12-26 11:30:10,593][123091] Updated weights for policy 0, policy_version 1491349 (0.0010) [2023-12-26 11:30:10,651][123091] Updated weights for policy 0, policy_version 1491359 (0.0009) [2023-12-26 11:30:10,721][123091] Updated weights for policy 0, policy_version 1491369 (0.0010) [2023-12-26 11:30:11,315][123090] Updated weights for policy 1, policy_version 1481546 (0.0008) [2023-12-26 11:30:11,403][123090] Updated weights for policy 1, policy_version 1481556 (0.0008) [2023-12-26 11:30:11,475][123090] Updated weights for policy 1, policy_version 1481566 (0.0008) [2023-12-26 11:30:11,586][123091] Updated weights for policy 0, policy_version 1491379 (0.0010) [2023-12-26 11:30:11,649][123091] Updated weights for policy 0, policy_version 1491389 (0.0010) [2023-12-26 11:30:11,722][123091] Updated weights for policy 0, policy_version 1491399 (0.0007) [2023-12-26 11:30:12,297][123090] Updated weights for policy 1, policy_version 1481576 (0.0009) [2023-12-26 11:30:12,370][123090] Updated weights for policy 1, policy_version 1481586 (0.0008) [2023-12-26 11:30:12,438][123090] Updated weights for policy 1, policy_version 1481596 (0.0007) [2023-12-26 11:30:12,535][123091] Updated weights for policy 0, policy_version 1491409 (0.0008) [2023-12-26 11:30:12,597][123091] Updated weights for policy 0, policy_version 1491419 (0.0010) [2023-12-26 11:30:12,666][123091] Updated weights for policy 0, policy_version 1491429 (0.0011) [2023-12-26 11:30:12,731][123091] Updated weights for policy 0, policy_version 1491439 (0.0010) [2023-12-26 11:30:13,255][123090] Updated weights for policy 1, policy_version 1481606 (0.0009) [2023-12-26 11:30:13,309][123090] Updated weights for policy 1, policy_version 1481616 (0.0009) [2023-12-26 11:30:13,376][123090] Updated weights for policy 1, policy_version 1481626 (0.0010) [2023-12-26 11:30:13,569][123091] Updated weights for policy 0, policy_version 1491449 (0.0010) [2023-12-26 11:30:13,618][123091] Updated weights for policy 0, policy_version 1491459 (0.0010) [2023-12-26 11:30:13,666][123091] Updated weights for policy 0, policy_version 1491469 (0.0010) [2023-12-26 11:30:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 761118720. Throughput: 0: 9005.3, 1: 8798.1. Samples: 761109988. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:13,785][121949] Avg episode reward: [(0, '6144.551'), (1, '5847.786')] [2023-12-26 11:30:14,142][123090] Updated weights for policy 1, policy_version 1481636 (0.0010) [2023-12-26 11:30:14,194][123090] Updated weights for policy 1, policy_version 1481646 (0.0010) [2023-12-26 11:30:14,253][123090] Updated weights for policy 1, policy_version 1481656 (0.0005) [2023-12-26 11:30:14,467][123091] Updated weights for policy 0, policy_version 1491479 (0.0011) [2023-12-26 11:30:14,523][123091] Updated weights for policy 0, policy_version 1491489 (0.0010) [2023-12-26 11:30:14,589][123091] Updated weights for policy 0, policy_version 1491499 (0.0011) [2023-12-26 11:30:14,913][123090] Updated weights for policy 1, policy_version 1481666 (0.0005) [2023-12-26 11:30:14,969][123090] Updated weights for policy 1, policy_version 1481676 (0.0009) [2023-12-26 11:30:15,019][123090] Updated weights for policy 1, policy_version 1481686 (0.0009) [2023-12-26 11:30:15,081][123090] Updated weights for policy 1, policy_version 1481696 (0.0009) [2023-12-26 11:30:15,384][123091] Updated weights for policy 0, policy_version 1491509 (0.0010) [2023-12-26 11:30:15,445][123091] Updated weights for policy 0, policy_version 1491519 (0.0009) [2023-12-26 11:30:15,499][123091] Updated weights for policy 0, policy_version 1491529 (0.0009) [2023-12-26 11:30:15,886][123090] Updated weights for policy 1, policy_version 1481706 (0.0005) [2023-12-26 11:30:15,944][123090] Updated weights for policy 1, policy_version 1481716 (0.0006) [2023-12-26 11:30:16,012][123090] Updated weights for policy 1, policy_version 1481726 (0.0009) [2023-12-26 11:30:16,337][123091] Updated weights for policy 0, policy_version 1491539 (0.0009) [2023-12-26 11:30:16,394][123091] Updated weights for policy 0, policy_version 1491549 (0.0006) [2023-12-26 11:30:16,460][123091] Updated weights for policy 0, policy_version 1491559 (0.0010) [2023-12-26 11:30:16,824][123090] Updated weights for policy 1, policy_version 1481736 (0.0009) [2023-12-26 11:30:16,884][123090] Updated weights for policy 1, policy_version 1481747 (0.0010) [2023-12-26 11:30:16,940][123090] Updated weights for policy 1, policy_version 1481758 (0.0009) [2023-12-26 11:30:17,222][123091] Updated weights for policy 0, policy_version 1491569 (0.0010) [2023-12-26 11:30:17,289][123091] Updated weights for policy 0, policy_version 1491579 (0.0010) [2023-12-26 11:30:17,356][123091] Updated weights for policy 0, policy_version 1491589 (0.0006) [2023-12-26 11:30:17,416][123091] Updated weights for policy 0, policy_version 1491599 (0.0007) [2023-12-26 11:30:17,815][123090] Updated weights for policy 1, policy_version 1481768 (0.0010) [2023-12-26 11:30:17,882][123090] Updated weights for policy 1, policy_version 1481778 (0.0010) [2023-12-26 11:30:17,952][123090] Updated weights for policy 1, policy_version 1481788 (0.0009) [2023-12-26 11:30:18,126][123091] Updated weights for policy 0, policy_version 1491609 (0.0006) [2023-12-26 11:30:18,175][123091] Updated weights for policy 0, policy_version 1491619 (0.0006) [2023-12-26 11:30:18,236][123091] Updated weights for policy 0, policy_version 1491629 (0.0009) [2023-12-26 11:30:18,633][123090] Updated weights for policy 1, policy_version 1481798 (0.0006) [2023-12-26 11:30:18,697][123090] Updated weights for policy 1, policy_version 1481808 (0.0009) [2023-12-26 11:30:18,758][123090] Updated weights for policy 1, policy_version 1481818 (0.0009) [2023-12-26 11:30:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 761200640. Throughput: 0: 8905.7, 1: 8805.3. Samples: 761217896. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:18,785][121949] Avg episode reward: [(0, '6282.071'), (1, '5861.652')] [2023-12-26 11:30:19,045][123091] Updated weights for policy 0, policy_version 1491639 (0.0009) [2023-12-26 11:30:19,094][123091] Updated weights for policy 0, policy_version 1491649 (0.0010) [2023-12-26 11:30:19,143][123091] Updated weights for policy 0, policy_version 1491659 (0.0010) [2023-12-26 11:30:19,657][123090] Updated weights for policy 1, policy_version 1481828 (0.0010) [2023-12-26 11:30:19,728][123090] Updated weights for policy 1, policy_version 1481838 (0.0010) [2023-12-26 11:30:19,799][123090] Updated weights for policy 1, policy_version 1481848 (0.0010) [2023-12-26 11:30:19,981][123091] Updated weights for policy 0, policy_version 1491669 (0.0010) [2023-12-26 11:30:20,052][123091] Updated weights for policy 0, policy_version 1491679 (0.0010) [2023-12-26 11:30:20,117][123091] Updated weights for policy 0, policy_version 1491689 (0.0009) [2023-12-26 11:30:20,636][123090] Updated weights for policy 1, policy_version 1481858 (0.0009) [2023-12-26 11:30:20,692][123090] Updated weights for policy 1, policy_version 1481868 (0.0010) [2023-12-26 11:30:20,753][123090] Updated weights for policy 1, policy_version 1481878 (0.0010) [2023-12-26 11:30:20,830][123090] Updated weights for policy 1, policy_version 1481888 (0.0011) [2023-12-26 11:30:20,976][123091] Updated weights for policy 0, policy_version 1491699 (0.0010) [2023-12-26 11:30:21,046][123091] Updated weights for policy 0, policy_version 1491709 (0.0009) [2023-12-26 11:30:21,113][123091] Updated weights for policy 0, policy_version 1491719 (0.0010) [2023-12-26 11:30:21,777][123090] Updated weights for policy 1, policy_version 1481898 (0.0009) [2023-12-26 11:30:21,841][123090] Updated weights for policy 1, policy_version 1481908 (0.0010) [2023-12-26 11:30:21,914][123090] Updated weights for policy 1, policy_version 1481918 (0.0011) [2023-12-26 11:30:21,956][123091] Updated weights for policy 0, policy_version 1491729 (0.0010) [2023-12-26 11:30:22,008][123091] Updated weights for policy 0, policy_version 1491739 (0.0008) [2023-12-26 11:30:22,057][123091] Updated weights for policy 0, policy_version 1491749 (0.0008) [2023-12-26 11:30:22,117][123091] Updated weights for policy 0, policy_version 1491759 (0.0008) [2023-12-26 11:30:22,768][123090] Updated weights for policy 1, policy_version 1481928 (0.0011) [2023-12-26 11:30:22,838][123090] Updated weights for policy 1, policy_version 1481938 (0.0011) [2023-12-26 11:30:22,902][123090] Updated weights for policy 1, policy_version 1481948 (0.0011) [2023-12-26 11:30:22,986][123091] Updated weights for policy 0, policy_version 1491769 (0.0009) [2023-12-26 11:30:23,048][123091] Updated weights for policy 0, policy_version 1491779 (0.0009) [2023-12-26 11:30:23,117][123091] Updated weights for policy 0, policy_version 1491789 (0.0009) [2023-12-26 11:30:23,726][123090] Updated weights for policy 1, policy_version 1481958 (0.0011) [2023-12-26 11:30:23,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 761282560. Throughput: 0: 8833.6, 1: 8683.6. Samples: 761266836. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:23,785][121949] Avg episode reward: [(0, '6080.656'), (1, '5968.744')] [2023-12-26 11:30:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001491792_381902848.pth... [2023-12-26 11:30:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001490768_381640704.pth [2023-12-26 11:30:23,796][123090] Updated weights for policy 1, policy_version 1481968 (0.0010) [2023-12-26 11:30:23,862][123090] Updated weights for policy 1, policy_version 1481978 (0.0010) [2023-12-26 11:30:23,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001481984_379387904.pth... [2023-12-26 11:30:23,896][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001480960_379125760.pth [2023-12-26 11:30:23,933][123091] Updated weights for policy 0, policy_version 1491799 (0.0007) [2023-12-26 11:30:24,024][123091] Updated weights for policy 0, policy_version 1491811 (0.0025) [2023-12-26 11:30:24,091][123091] Updated weights for policy 0, policy_version 1491821 (0.0007) [2023-12-26 11:30:24,626][123090] Updated weights for policy 1, policy_version 1481988 (0.0008) [2023-12-26 11:30:24,688][123090] Updated weights for policy 1, policy_version 1481998 (0.0010) [2023-12-26 11:30:24,756][123090] Updated weights for policy 1, policy_version 1482008 (0.0011) [2023-12-26 11:30:24,843][123091] Updated weights for policy 0, policy_version 1491831 (0.0011) [2023-12-26 11:30:24,901][123091] Updated weights for policy 0, policy_version 1491841 (0.0010) [2023-12-26 11:30:24,968][123091] Updated weights for policy 0, policy_version 1491851 (0.0010) [2023-12-26 11:30:25,506][123090] Updated weights for policy 1, policy_version 1482018 (0.0011) [2023-12-26 11:30:25,573][123090] Updated weights for policy 1, policy_version 1482028 (0.0011) [2023-12-26 11:30:25,648][123090] Updated weights for policy 1, policy_version 1482038 (0.0011) [2023-12-26 11:30:25,668][123091] Updated weights for policy 0, policy_version 1491861 (0.0009) [2023-12-26 11:30:25,709][123090] Updated weights for policy 1, policy_version 1482048 (0.0010) [2023-12-26 11:30:25,728][123091] Updated weights for policy 0, policy_version 1491871 (0.0006) [2023-12-26 11:30:25,794][123091] Updated weights for policy 0, policy_version 1491881 (0.0010) [2023-12-26 11:30:26,523][123090] Updated weights for policy 1, policy_version 1482058 (0.0009) [2023-12-26 11:30:26,584][123090] Updated weights for policy 1, policy_version 1482068 (0.0009) [2023-12-26 11:30:26,634][123091] Updated weights for policy 0, policy_version 1491891 (0.0009) [2023-12-26 11:30:26,647][123090] Updated weights for policy 1, policy_version 1482078 (0.0010) [2023-12-26 11:30:26,685][123091] Updated weights for policy 0, policy_version 1491901 (0.0008) [2023-12-26 11:30:26,739][123091] Updated weights for policy 0, policy_version 1491911 (0.0010) [2023-12-26 11:30:27,492][123090] Updated weights for policy 1, policy_version 1482088 (0.0010) [2023-12-26 11:30:27,551][123090] Updated weights for policy 1, policy_version 1482098 (0.0009) [2023-12-26 11:30:27,597][123091] Updated weights for policy 0, policy_version 1491921 (0.0009) [2023-12-26 11:30:27,601][123090] Updated weights for policy 1, policy_version 1482108 (0.0009) [2023-12-26 11:30:27,655][123091] Updated weights for policy 0, policy_version 1491931 (0.0009) [2023-12-26 11:30:27,707][123091] Updated weights for policy 0, policy_version 1491941 (0.0009) [2023-12-26 11:30:27,780][123091] Updated weights for policy 0, policy_version 1491951 (0.0010) [2023-12-26 11:30:28,241][123090] Updated weights for policy 1, policy_version 1482118 (0.0005) [2023-12-26 11:30:28,301][123090] Updated weights for policy 1, policy_version 1482128 (0.0005) [2023-12-26 11:30:28,374][123090] Updated weights for policy 1, policy_version 1482138 (0.0008) [2023-12-26 11:30:28,603][123091] Updated weights for policy 0, policy_version 1491961 (0.0008) [2023-12-26 11:30:28,664][123091] Updated weights for policy 0, policy_version 1491971 (0.0009) [2023-12-26 11:30:28,722][123091] Updated weights for policy 0, policy_version 1491981 (0.0010) [2023-12-26 11:30:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 761380864. Throughput: 0: 8869.7, 1: 8695.7. Samples: 761370052. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:28,785][121949] Avg episode reward: [(0, '6209.945'), (1, '5966.094')] [2023-12-26 11:30:29,172][123090] Updated weights for policy 1, policy_version 1482148 (0.0007) [2023-12-26 11:30:29,222][123090] Updated weights for policy 1, policy_version 1482158 (0.0007) [2023-12-26 11:30:29,284][123090] Updated weights for policy 1, policy_version 1482168 (0.0009) [2023-12-26 11:30:29,567][123091] Updated weights for policy 0, policy_version 1491991 (0.0007) [2023-12-26 11:30:29,629][123091] Updated weights for policy 0, policy_version 1492001 (0.0006) [2023-12-26 11:30:29,696][123091] Updated weights for policy 0, policy_version 1492011 (0.0005) [2023-12-26 11:30:29,994][123090] Updated weights for policy 1, policy_version 1482178 (0.0008) [2023-12-26 11:30:30,056][123090] Updated weights for policy 1, policy_version 1482188 (0.0008) [2023-12-26 11:30:30,104][123090] Updated weights for policy 1, policy_version 1482198 (0.0010) [2023-12-26 11:30:30,167][123090] Updated weights for policy 1, policy_version 1482208 (0.0010) [2023-12-26 11:30:30,441][123091] Updated weights for policy 0, policy_version 1492021 (0.0007) [2023-12-26 11:30:30,494][123091] Updated weights for policy 0, policy_version 1492031 (0.0010) [2023-12-26 11:30:30,546][123091] Updated weights for policy 0, policy_version 1492041 (0.0010) [2023-12-26 11:30:30,876][123090] Updated weights for policy 1, policy_version 1482218 (0.0005) [2023-12-26 11:30:30,924][123090] Updated weights for policy 1, policy_version 1482228 (0.0005) [2023-12-26 11:30:30,977][123090] Updated weights for policy 1, policy_version 1482238 (0.0005) [2023-12-26 11:30:31,409][123091] Updated weights for policy 0, policy_version 1492051 (0.0009) [2023-12-26 11:30:31,457][123091] Updated weights for policy 0, policy_version 1492061 (0.0009) [2023-12-26 11:30:31,511][123091] Updated weights for policy 0, policy_version 1492072 (0.0010) [2023-12-26 11:30:31,793][123090] Updated weights for policy 1, policy_version 1482248 (0.0010) [2023-12-26 11:30:31,852][123090] Updated weights for policy 1, policy_version 1482258 (0.0010) [2023-12-26 11:30:31,905][123090] Updated weights for policy 1, policy_version 1482268 (0.0005) [2023-12-26 11:30:32,428][123091] Updated weights for policy 0, policy_version 1492082 (0.0010) [2023-12-26 11:30:32,483][123091] Updated weights for policy 0, policy_version 1492092 (0.0010) [2023-12-26 11:30:32,537][123091] Updated weights for policy 0, policy_version 1492102 (0.0010) [2023-12-26 11:30:32,590][123091] Updated weights for policy 0, policy_version 1492112 (0.0009) [2023-12-26 11:30:32,617][123090] Updated weights for policy 1, policy_version 1482278 (0.0009) [2023-12-26 11:30:32,684][123090] Updated weights for policy 1, policy_version 1482288 (0.0011) [2023-12-26 11:30:32,747][123090] Updated weights for policy 1, policy_version 1482298 (0.0010) [2023-12-26 11:30:33,414][123091] Updated weights for policy 0, policy_version 1492122 (0.0006) [2023-12-26 11:30:33,440][123090] Updated weights for policy 1, policy_version 1482308 (0.0008) [2023-12-26 11:30:33,476][123091] Updated weights for policy 0, policy_version 1492132 (0.0007) [2023-12-26 11:30:33,505][123090] Updated weights for policy 1, policy_version 1482318 (0.0006) [2023-12-26 11:30:33,534][123091] Updated weights for policy 0, policy_version 1492142 (0.0010) [2023-12-26 11:30:33,554][123090] Updated weights for policy 1, policy_version 1482328 (0.0007) [2023-12-26 11:30:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 761470976. Throughput: 0: 8845.1, 1: 8772.7. Samples: 761478560. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:33,785][121949] Avg episode reward: [(0, '6284.556'), (1, '5735.362')] [2023-12-26 11:30:34,239][123090] Updated weights for policy 1, policy_version 1482338 (0.0006) [2023-12-26 11:30:34,304][123090] Updated weights for policy 1, policy_version 1482348 (0.0011) [2023-12-26 11:30:34,326][123091] Updated weights for policy 0, policy_version 1492152 (0.0009) [2023-12-26 11:30:34,374][123090] Updated weights for policy 1, policy_version 1482358 (0.0011) [2023-12-26 11:30:34,392][123091] Updated weights for policy 0, policy_version 1492162 (0.0011) [2023-12-26 11:30:34,440][123090] Updated weights for policy 1, policy_version 1482368 (0.0011) [2023-12-26 11:30:34,457][123091] Updated weights for policy 0, policy_version 1492172 (0.0011) [2023-12-26 11:30:35,169][123090] Updated weights for policy 1, policy_version 1482378 (0.0010) [2023-12-26 11:30:35,225][123090] Updated weights for policy 1, policy_version 1482388 (0.0010) [2023-12-26 11:30:35,258][123091] Updated weights for policy 0, policy_version 1492182 (0.0011) [2023-12-26 11:30:35,284][123090] Updated weights for policy 1, policy_version 1482398 (0.0010) [2023-12-26 11:30:35,312][123091] Updated weights for policy 0, policy_version 1492192 (0.0010) [2023-12-26 11:30:35,378][123091] Updated weights for policy 0, policy_version 1492202 (0.0011) [2023-12-26 11:30:36,004][123090] Updated weights for policy 1, policy_version 1482408 (0.0006) [2023-12-26 11:30:36,057][123090] Updated weights for policy 1, policy_version 1482418 (0.0005) [2023-12-26 11:30:36,113][123090] Updated weights for policy 1, policy_version 1482428 (0.0006) [2023-12-26 11:30:36,209][123091] Updated weights for policy 0, policy_version 1492212 (0.0011) [2023-12-26 11:30:36,272][123091] Updated weights for policy 0, policy_version 1492222 (0.0011) [2023-12-26 11:30:36,332][123091] Updated weights for policy 0, policy_version 1492232 (0.0011) [2023-12-26 11:30:36,886][123090] Updated weights for policy 1, policy_version 1482438 (0.0010) [2023-12-26 11:30:36,948][123090] Updated weights for policy 1, policy_version 1482448 (0.0010) [2023-12-26 11:30:37,008][123090] Updated weights for policy 1, policy_version 1482458 (0.0011) [2023-12-26 11:30:37,172][123091] Updated weights for policy 0, policy_version 1492242 (0.0010) [2023-12-26 11:30:37,235][123091] Updated weights for policy 0, policy_version 1492252 (0.0005) [2023-12-26 11:30:37,304][123091] Updated weights for policy 0, policy_version 1492262 (0.0005) [2023-12-26 11:30:37,364][123091] Updated weights for policy 0, policy_version 1492272 (0.0005) [2023-12-26 11:30:37,843][123090] Updated weights for policy 1, policy_version 1482468 (0.0010) [2023-12-26 11:30:37,907][123090] Updated weights for policy 1, policy_version 1482478 (0.0011) [2023-12-26 11:30:37,967][123090] Updated weights for policy 1, policy_version 1482488 (0.0011) [2023-12-26 11:30:38,052][123091] Updated weights for policy 0, policy_version 1492282 (0.0010) [2023-12-26 11:30:38,110][123091] Updated weights for policy 0, policy_version 1492292 (0.0006) [2023-12-26 11:30:38,176][123091] Updated weights for policy 0, policy_version 1492302 (0.0006) [2023-12-26 11:30:38,738][123090] Updated weights for policy 1, policy_version 1482498 (0.0011) [2023-12-26 11:30:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 761552896. Throughput: 0: 8807.0, 1: 8815.6. Samples: 761532544. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:38,785][121949] Avg episode reward: [(0, '6294.252'), (1, '5665.816')] [2023-12-26 11:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001492304_382033920.pth... [2023-12-26 11:30:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001491312_381779968.pth [2023-12-26 11:30:38,807][123090] Updated weights for policy 1, policy_version 1482508 (0.0010) [2023-12-26 11:30:38,874][123090] Updated weights for policy 1, policy_version 1482518 (0.0010) [2023-12-26 11:30:38,891][123091] Updated weights for policy 0, policy_version 1492312 (0.0006) [2023-12-26 11:30:38,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001482528_379527168.pth... [2023-12-26 11:30:38,939][123090] Updated weights for policy 1, policy_version 1482528 (0.0009) [2023-12-26 11:30:38,939][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001481472_379256832.pth [2023-12-26 11:30:38,956][123091] Updated weights for policy 0, policy_version 1492322 (0.0007) [2023-12-26 11:30:39,021][123091] Updated weights for policy 0, policy_version 1492332 (0.0008) [2023-12-26 11:30:39,744][123090] Updated weights for policy 1, policy_version 1482538 (0.0011) [2023-12-26 11:30:39,804][123091] Updated weights for policy 0, policy_version 1492342 (0.0006) [2023-12-26 11:30:39,817][123090] Updated weights for policy 1, policy_version 1482548 (0.0011) [2023-12-26 11:30:39,885][123091] Updated weights for policy 0, policy_version 1492352 (0.0007) [2023-12-26 11:30:39,891][123090] Updated weights for policy 1, policy_version 1482558 (0.0010) [2023-12-26 11:30:39,955][123091] Updated weights for policy 0, policy_version 1492362 (0.0008) [2023-12-26 11:30:40,641][123090] Updated weights for policy 1, policy_version 1482568 (0.0006) [2023-12-26 11:30:40,704][123090] Updated weights for policy 1, policy_version 1482578 (0.0008) [2023-12-26 11:30:40,771][123090] Updated weights for policy 1, policy_version 1482588 (0.0010) [2023-12-26 11:30:40,805][123091] Updated weights for policy 0, policy_version 1492372 (0.0008) [2023-12-26 11:30:40,870][123091] Updated weights for policy 0, policy_version 1492382 (0.0006) [2023-12-26 11:30:40,931][123091] Updated weights for policy 0, policy_version 1492392 (0.0009) [2023-12-26 11:30:41,615][123090] Updated weights for policy 1, policy_version 1482598 (0.0011) [2023-12-26 11:30:41,687][123090] Updated weights for policy 1, policy_version 1482608 (0.0011) [2023-12-26 11:30:41,752][123090] Updated weights for policy 1, policy_version 1482618 (0.0010) [2023-12-26 11:30:41,799][123091] Updated weights for policy 0, policy_version 1492402 (0.0009) [2023-12-26 11:30:41,866][123091] Updated weights for policy 0, policy_version 1492412 (0.0010) [2023-12-26 11:30:41,937][123091] Updated weights for policy 0, policy_version 1492422 (0.0009) [2023-12-26 11:30:42,006][123091] Updated weights for policy 0, policy_version 1492432 (0.0009) [2023-12-26 11:30:42,577][123090] Updated weights for policy 1, policy_version 1482628 (0.0008) [2023-12-26 11:30:42,652][123090] Updated weights for policy 1, policy_version 1482638 (0.0005) [2023-12-26 11:30:42,721][123090] Updated weights for policy 1, policy_version 1482648 (0.0009) [2023-12-26 11:30:42,913][123091] Updated weights for policy 0, policy_version 1492442 (0.0009) [2023-12-26 11:30:42,968][123091] Updated weights for policy 0, policy_version 1492452 (0.0009) [2023-12-26 11:30:43,016][123091] Updated weights for policy 0, policy_version 1492462 (0.0008) [2023-12-26 11:30:43,480][123090] Updated weights for policy 1, policy_version 1482658 (0.0009) [2023-12-26 11:30:43,555][123090] Updated weights for policy 1, policy_version 1482668 (0.0007) [2023-12-26 11:30:43,626][123090] Updated weights for policy 1, policy_version 1482678 (0.0010) [2023-12-26 11:30:43,691][123090] Updated weights for policy 1, policy_version 1482688 (0.0006) [2023-12-26 11:30:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 761643008. Throughput: 0: 8735.6, 1: 8809.4. Samples: 761637048. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:43,785][121949] Avg episode reward: [(0, '6388.771'), (1, '5826.611')] [2023-12-26 11:30:43,794][123091] Updated weights for policy 0, policy_version 1492472 (0.0006) [2023-12-26 11:30:43,858][123091] Updated weights for policy 0, policy_version 1492482 (0.0007) [2023-12-26 11:30:43,928][123091] Updated weights for policy 0, policy_version 1492492 (0.0009) [2023-12-26 11:30:44,459][123090] Updated weights for policy 1, policy_version 1482698 (0.0010) [2023-12-26 11:30:44,512][123090] Updated weights for policy 1, policy_version 1482708 (0.0010) [2023-12-26 11:30:44,564][123090] Updated weights for policy 1, policy_version 1482718 (0.0009) [2023-12-26 11:30:44,679][123091] Updated weights for policy 0, policy_version 1492502 (0.0007) [2023-12-26 11:30:44,734][123091] Updated weights for policy 0, policy_version 1492512 (0.0005) [2023-12-26 11:30:44,803][123091] Updated weights for policy 0, policy_version 1492522 (0.0010) [2023-12-26 11:30:45,448][123090] Updated weights for policy 1, policy_version 1482728 (0.0009) [2023-12-26 11:30:45,510][123090] Updated weights for policy 1, policy_version 1482738 (0.0009) [2023-12-26 11:30:45,574][123090] Updated weights for policy 1, policy_version 1482748 (0.0010) [2023-12-26 11:30:45,621][123091] Updated weights for policy 0, policy_version 1492532 (0.0009) [2023-12-26 11:30:45,683][123091] Updated weights for policy 0, policy_version 1492542 (0.0009) [2023-12-26 11:30:45,752][123091] Updated weights for policy 0, policy_version 1492552 (0.0010) [2023-12-26 11:30:46,261][123090] Updated weights for policy 1, policy_version 1482758 (0.0005) [2023-12-26 11:30:46,328][123090] Updated weights for policy 1, policy_version 1482768 (0.0006) [2023-12-26 11:30:46,399][123090] Updated weights for policy 1, policy_version 1482778 (0.0005) [2023-12-26 11:30:46,629][123091] Updated weights for policy 0, policy_version 1492562 (0.0009) [2023-12-26 11:30:46,683][123091] Updated weights for policy 0, policy_version 1492572 (0.0009) [2023-12-26 11:30:46,743][123091] Updated weights for policy 0, policy_version 1492582 (0.0010) [2023-12-26 11:30:46,801][123091] Updated weights for policy 0, policy_version 1492592 (0.0010) [2023-12-26 11:30:47,011][123090] Updated weights for policy 1, policy_version 1482788 (0.0006) [2023-12-26 11:30:47,087][123090] Updated weights for policy 1, policy_version 1482798 (0.0009) [2023-12-26 11:30:47,147][123090] Updated weights for policy 1, policy_version 1482808 (0.0009) [2023-12-26 11:30:47,545][123091] Updated weights for policy 0, policy_version 1492602 (0.0009) [2023-12-26 11:30:47,598][123091] Updated weights for policy 0, policy_version 1492612 (0.0006) [2023-12-26 11:30:47,667][123091] Updated weights for policy 0, policy_version 1492622 (0.0005) [2023-12-26 11:30:47,986][123090] Updated weights for policy 1, policy_version 1482818 (0.0009) [2023-12-26 11:30:48,048][123090] Updated weights for policy 1, policy_version 1482828 (0.0009) [2023-12-26 11:30:48,109][123090] Updated weights for policy 1, policy_version 1482838 (0.0009) [2023-12-26 11:30:48,174][123090] Updated weights for policy 1, policy_version 1482848 (0.0009) [2023-12-26 11:30:48,330][123091] Updated weights for policy 0, policy_version 1492632 (0.0006) [2023-12-26 11:30:48,401][123091] Updated weights for policy 0, policy_version 1492642 (0.0007) [2023-12-26 11:30:48,472][123091] Updated weights for policy 0, policy_version 1492652 (0.0009) [2023-12-26 11:30:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 761733120. Throughput: 0: 8794.4, 1: 8813.5. Samples: 761744808. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:48,786][121949] Avg episode reward: [(0, '6272.558'), (1, '5943.520')] [2023-12-26 11:30:49,026][123090] Updated weights for policy 1, policy_version 1482858 (0.0009) [2023-12-26 11:30:49,089][123090] Updated weights for policy 1, policy_version 1482868 (0.0009) [2023-12-26 11:30:49,150][123090] Updated weights for policy 1, policy_version 1482878 (0.0009) [2023-12-26 11:30:49,220][123091] Updated weights for policy 0, policy_version 1492662 (0.0006) [2023-12-26 11:30:49,287][123091] Updated weights for policy 0, policy_version 1492672 (0.0009) [2023-12-26 11:30:49,354][123091] Updated weights for policy 0, policy_version 1492682 (0.0008) [2023-12-26 11:30:49,961][123090] Updated weights for policy 1, policy_version 1482888 (0.0009) [2023-12-26 11:30:50,027][123090] Updated weights for policy 1, policy_version 1482898 (0.0005) [2023-12-26 11:30:50,105][123090] Updated weights for policy 1, policy_version 1482908 (0.0006) [2023-12-26 11:30:50,212][123091] Updated weights for policy 0, policy_version 1492692 (0.0009) [2023-12-26 11:30:50,278][123091] Updated weights for policy 0, policy_version 1492702 (0.0009) [2023-12-26 11:30:50,337][123091] Updated weights for policy 0, policy_version 1492712 (0.0009) [2023-12-26 11:30:50,904][123090] Updated weights for policy 1, policy_version 1482918 (0.0006) [2023-12-26 11:30:50,968][123090] Updated weights for policy 1, policy_version 1482928 (0.0009) [2023-12-26 11:30:51,032][123090] Updated weights for policy 1, policy_version 1482938 (0.0009) [2023-12-26 11:30:51,155][123091] Updated weights for policy 0, policy_version 1492722 (0.0009) [2023-12-26 11:30:51,225][123091] Updated weights for policy 0, policy_version 1492732 (0.0005) [2023-12-26 11:30:51,291][123091] Updated weights for policy 0, policy_version 1492742 (0.0008) [2023-12-26 11:30:51,365][123091] Updated weights for policy 0, policy_version 1492752 (0.0009) [2023-12-26 11:30:51,905][123090] Updated weights for policy 1, policy_version 1482948 (0.0009) [2023-12-26 11:30:51,954][123090] Updated weights for policy 1, policy_version 1482958 (0.0009) [2023-12-26 11:30:52,002][123090] Updated weights for policy 1, policy_version 1482968 (0.0008) [2023-12-26 11:30:52,135][123091] Updated weights for policy 0, policy_version 1492762 (0.0011) [2023-12-26 11:30:52,188][123091] Updated weights for policy 0, policy_version 1492772 (0.0010) [2023-12-26 11:30:52,251][123091] Updated weights for policy 0, policy_version 1492782 (0.0011) [2023-12-26 11:30:52,886][123091] Updated weights for policy 0, policy_version 1492792 (0.0006) [2023-12-26 11:30:52,918][123090] Updated weights for policy 1, policy_version 1482978 (0.0009) [2023-12-26 11:30:52,958][123091] Updated weights for policy 0, policy_version 1492802 (0.0005) [2023-12-26 11:30:52,975][123090] Updated weights for policy 1, policy_version 1482988 (0.0008) [2023-12-26 11:30:53,028][123091] Updated weights for policy 0, policy_version 1492812 (0.0006) [2023-12-26 11:30:53,043][123090] Updated weights for policy 1, policy_version 1482998 (0.0009) [2023-12-26 11:30:53,106][123090] Updated weights for policy 1, policy_version 1483008 (0.0008) [2023-12-26 11:30:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17717.0). Total num frames: 761815040. Throughput: 0: 8732.7, 1: 8815.0. Samples: 761796236. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:53,785][121949] Avg episode reward: [(0, '6161.250'), (1, '5761.844')] [2023-12-26 11:30:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001483008_379650048.pth... [2023-12-26 11:30:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001481984_379387904.pth [2023-12-26 11:30:53,799][123091] Updated weights for policy 0, policy_version 1492822 (0.0011) [2023-12-26 11:30:53,858][123091] Updated weights for policy 0, policy_version 1492832 (0.0011) [2023-12-26 11:30:53,918][123091] Updated weights for policy 0, policy_version 1492842 (0.0010) [2023-12-26 11:30:53,954][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001492848_382173184.pth... [2023-12-26 11:30:53,954][123090] Updated weights for policy 1, policy_version 1483018 (0.0006) [2023-12-26 11:30:53,958][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001491792_381902848.pth [2023-12-26 11:30:54,020][123090] Updated weights for policy 1, policy_version 1483028 (0.0009) [2023-12-26 11:30:54,077][123090] Updated weights for policy 1, policy_version 1483038 (0.0010) [2023-12-26 11:30:54,695][123091] Updated weights for policy 0, policy_version 1492852 (0.0011) [2023-12-26 11:30:54,750][123091] Updated weights for policy 0, policy_version 1492862 (0.0010) [2023-12-26 11:30:54,794][123091] Updated weights for policy 0, policy_version 1492872 (0.0010) [2023-12-26 11:30:54,978][123090] Updated weights for policy 1, policy_version 1483048 (0.0009) [2023-12-26 11:30:55,041][123090] Updated weights for policy 1, policy_version 1483058 (0.0009) [2023-12-26 11:30:55,110][123090] Updated weights for policy 1, policy_version 1483068 (0.0009) [2023-12-26 11:30:55,641][123091] Updated weights for policy 0, policy_version 1492882 (0.0010) [2023-12-26 11:30:55,697][123091] Updated weights for policy 0, policy_version 1492892 (0.0009) [2023-12-26 11:30:55,761][123091] Updated weights for policy 0, policy_version 1492902 (0.0009) [2023-12-26 11:30:55,816][123091] Updated weights for policy 0, policy_version 1492912 (0.0009) [2023-12-26 11:30:55,905][123090] Updated weights for policy 1, policy_version 1483078 (0.0007) [2023-12-26 11:30:55,968][123090] Updated weights for policy 1, policy_version 1483088 (0.0008) [2023-12-26 11:30:56,033][123090] Updated weights for policy 1, policy_version 1483098 (0.0009) [2023-12-26 11:30:56,562][123091] Updated weights for policy 0, policy_version 1492922 (0.0005) [2023-12-26 11:30:56,618][123091] Updated weights for policy 0, policy_version 1492932 (0.0005) [2023-12-26 11:30:56,684][123091] Updated weights for policy 0, policy_version 1492942 (0.0006) [2023-12-26 11:30:56,872][123090] Updated weights for policy 1, policy_version 1483108 (0.0008) [2023-12-26 11:30:56,933][123090] Updated weights for policy 1, policy_version 1483118 (0.0007) [2023-12-26 11:30:56,999][123090] Updated weights for policy 1, policy_version 1483128 (0.0009) [2023-12-26 11:30:57,401][123091] Updated weights for policy 0, policy_version 1492952 (0.0006) [2023-12-26 11:30:57,456][123091] Updated weights for policy 0, policy_version 1492962 (0.0005) [2023-12-26 11:30:57,510][123091] Updated weights for policy 0, policy_version 1492972 (0.0005) [2023-12-26 11:30:57,872][123090] Updated weights for policy 1, policy_version 1483138 (0.0010) [2023-12-26 11:30:57,932][123090] Updated weights for policy 1, policy_version 1483148 (0.0009) [2023-12-26 11:30:57,986][123090] Updated weights for policy 1, policy_version 1483158 (0.0010) [2023-12-26 11:30:58,188][123091] Updated weights for policy 0, policy_version 1492982 (0.0006) [2023-12-26 11:30:58,248][123091] Updated weights for policy 0, policy_version 1492992 (0.0006) [2023-12-26 11:30:58,316][123091] Updated weights for policy 0, policy_version 1493002 (0.0006) [2023-12-26 11:30:58,785][121949] Fps is (10 sec: 17201.4, 60 sec: 17612.4, 300 sec: 17716.9). Total num frames: 761905152. Throughput: 0: 8801.3, 1: 8786.7. Samples: 761901468. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:30:58,786][121949] Avg episode reward: [(0, '6189.294'), (1, '5554.330')] [2023-12-26 11:30:58,959][123090] Updated weights for policy 1, policy_version 1483169 (0.0010) [2023-12-26 11:30:59,027][123090] Updated weights for policy 1, policy_version 1483179 (0.0011) [2023-12-26 11:30:59,088][123090] Updated weights for policy 1, policy_version 1483189 (0.0011) [2023-12-26 11:30:59,155][123090] Updated weights for policy 1, policy_version 1483199 (0.0010) [2023-12-26 11:30:59,188][123091] Updated weights for policy 0, policy_version 1493013 (0.0008) [2023-12-26 11:30:59,256][123091] Updated weights for policy 0, policy_version 1493023 (0.0008) [2023-12-26 11:30:59,312][123091] Updated weights for policy 0, policy_version 1493033 (0.0008) [2023-12-26 11:30:59,939][123090] Updated weights for policy 1, policy_version 1483209 (0.0010) [2023-12-26 11:31:00,014][123090] Updated weights for policy 1, policy_version 1483219 (0.0007) [2023-12-26 11:31:00,077][123090] Updated weights for policy 1, policy_version 1483229 (0.0006) [2023-12-26 11:31:00,093][123091] Updated weights for policy 0, policy_version 1493043 (0.0009) [2023-12-26 11:31:00,157][123091] Updated weights for policy 0, policy_version 1493053 (0.0005) [2023-12-26 11:31:00,217][123091] Updated weights for policy 0, policy_version 1493063 (0.0006) [2023-12-26 11:31:00,802][123090] Updated weights for policy 1, policy_version 1483239 (0.0006) [2023-12-26 11:31:00,868][123090] Updated weights for policy 1, policy_version 1483249 (0.0010) [2023-12-26 11:31:00,903][123091] Updated weights for policy 0, policy_version 1493073 (0.0005) [2023-12-26 11:31:00,919][123090] Updated weights for policy 1, policy_version 1483259 (0.0010) [2023-12-26 11:31:00,955][123091] Updated weights for policy 0, policy_version 1493083 (0.0005) [2023-12-26 11:31:01,003][123091] Updated weights for policy 0, policy_version 1493093 (0.0005) [2023-12-26 11:31:01,066][123091] Updated weights for policy 0, policy_version 1493103 (0.0007) [2023-12-26 11:31:01,693][123090] Updated weights for policy 1, policy_version 1483269 (0.0009) [2023-12-26 11:31:01,760][123090] Updated weights for policy 1, policy_version 1483279 (0.0010) [2023-12-26 11:31:01,819][123090] Updated weights for policy 1, policy_version 1483289 (0.0009) [2023-12-26 11:31:01,834][123091] Updated weights for policy 0, policy_version 1493113 (0.0008) [2023-12-26 11:31:01,897][123091] Updated weights for policy 0, policy_version 1493123 (0.0008) [2023-12-26 11:31:01,958][123091] Updated weights for policy 0, policy_version 1493133 (0.0010) [2023-12-26 11:31:02,586][123090] Updated weights for policy 1, policy_version 1483299 (0.0007) [2023-12-26 11:31:02,646][123090] Updated weights for policy 1, policy_version 1483309 (0.0006) [2023-12-26 11:31:02,696][123090] Updated weights for policy 1, policy_version 1483319 (0.0005) [2023-12-26 11:31:02,762][123091] Updated weights for policy 0, policy_version 1493143 (0.0007) [2023-12-26 11:31:02,826][123091] Updated weights for policy 0, policy_version 1493153 (0.0007) [2023-12-26 11:31:02,892][123091] Updated weights for policy 0, policy_version 1493163 (0.0008) [2023-12-26 11:31:03,415][123090] Updated weights for policy 1, policy_version 1483329 (0.0006) [2023-12-26 11:31:03,479][123090] Updated weights for policy 1, policy_version 1483339 (0.0005) [2023-12-26 11:31:03,516][123091] Updated weights for policy 0, policy_version 1493173 (0.0008) [2023-12-26 11:31:03,542][123090] Updated weights for policy 1, policy_version 1483349 (0.0007) [2023-12-26 11:31:03,560][123091] Updated weights for policy 0, policy_version 1493183 (0.0007) [2023-12-26 11:31:03,606][123091] Updated weights for policy 0, policy_version 1493193 (0.0006) [2023-12-26 11:31:03,609][123090] Updated weights for policy 1, policy_version 1483359 (0.0008) [2023-12-26 11:31:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 762003456. Throughput: 0: 8845.0, 1: 8759.5. Samples: 762010096. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:03,785][121949] Avg episode reward: [(0, '6180.994'), (1, '5676.104')] [2023-12-26 11:31:04,391][123091] Updated weights for policy 0, policy_version 1493203 (0.0007) [2023-12-26 11:31:04,420][123090] Updated weights for policy 1, policy_version 1483369 (0.0007) [2023-12-26 11:31:04,458][123091] Updated weights for policy 0, policy_version 1493213 (0.0009) [2023-12-26 11:31:04,491][123090] Updated weights for policy 1, policy_version 1483379 (0.0006) [2023-12-26 11:31:04,507][123091] Updated weights for policy 0, policy_version 1493223 (0.0009) [2023-12-26 11:31:04,572][123090] Updated weights for policy 1, policy_version 1483389 (0.0006) [2023-12-26 11:31:05,194][123091] Updated weights for policy 0, policy_version 1493233 (0.0008) [2023-12-26 11:31:05,242][123091] Updated weights for policy 0, policy_version 1493243 (0.0009) [2023-12-26 11:31:05,297][123091] Updated weights for policy 0, policy_version 1493253 (0.0009) [2023-12-26 11:31:05,337][123090] Updated weights for policy 1, policy_version 1483399 (0.0010) [2023-12-26 11:31:05,344][123091] Updated weights for policy 0, policy_version 1493263 (0.0006) [2023-12-26 11:31:05,396][123090] Updated weights for policy 1, policy_version 1483409 (0.0010) [2023-12-26 11:31:05,459][123090] Updated weights for policy 1, policy_version 1483419 (0.0011) [2023-12-26 11:31:06,203][123090] Updated weights for policy 1, policy_version 1483429 (0.0009) [2023-12-26 11:31:06,245][123091] Updated weights for policy 0, policy_version 1493273 (0.0008) [2023-12-26 11:31:06,269][123090] Updated weights for policy 1, policy_version 1483439 (0.0010) [2023-12-26 11:31:06,309][123091] Updated weights for policy 0, policy_version 1493283 (0.0009) [2023-12-26 11:31:06,334][123090] Updated weights for policy 1, policy_version 1483449 (0.0007) [2023-12-26 11:31:06,368][123091] Updated weights for policy 0, policy_version 1493293 (0.0008) [2023-12-26 11:31:07,139][123090] Updated weights for policy 1, policy_version 1483459 (0.0008) [2023-12-26 11:31:07,197][123090] Updated weights for policy 1, policy_version 1483469 (0.0008) [2023-12-26 11:31:07,227][123091] Updated weights for policy 0, policy_version 1493303 (0.0010) [2023-12-26 11:31:07,260][123090] Updated weights for policy 1, policy_version 1483479 (0.0009) [2023-12-26 11:31:07,281][123091] Updated weights for policy 0, policy_version 1493313 (0.0009) [2023-12-26 11:31:07,331][123091] Updated weights for policy 0, policy_version 1493323 (0.0009) [2023-12-26 11:31:07,959][123090] Updated weights for policy 1, policy_version 1483489 (0.0009) [2023-12-26 11:31:08,049][123090] Updated weights for policy 1, policy_version 1483499 (0.0009) [2023-12-26 11:31:08,103][123090] Updated weights for policy 1, policy_version 1483509 (0.0008) [2023-12-26 11:31:08,158][123090] Updated weights for policy 1, policy_version 1483519 (0.0009) [2023-12-26 11:31:08,206][123091] Updated weights for policy 0, policy_version 1493333 (0.0009) [2023-12-26 11:31:08,263][123091] Updated weights for policy 0, policy_version 1493343 (0.0009) [2023-12-26 11:31:08,321][123091] Updated weights for policy 0, policy_version 1493353 (0.0009) [2023-12-26 11:31:08,784][121949] Fps is (10 sec: 18024.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 762085376. Throughput: 0: 8884.9, 1: 8811.0. Samples: 762063152. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:08,785][121949] Avg episode reward: [(0, '6265.941'), (1, '5812.556')] [2023-12-26 11:31:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001493360_382304256.pth... [2023-12-26 11:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001483520_379781120.pth... [2023-12-26 11:31:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001492304_382033920.pth [2023-12-26 11:31:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001482528_379527168.pth [2023-12-26 11:31:08,980][123090] Updated weights for policy 1, policy_version 1483529 (0.0010) [2023-12-26 11:31:09,035][123090] Updated weights for policy 1, policy_version 1483539 (0.0009) [2023-12-26 11:31:09,094][123090] Updated weights for policy 1, policy_version 1483549 (0.0009) [2023-12-26 11:31:09,149][123091] Updated weights for policy 0, policy_version 1493363 (0.0009) [2023-12-26 11:31:09,198][123091] Updated weights for policy 0, policy_version 1493373 (0.0009) [2023-12-26 11:31:09,256][123091] Updated weights for policy 0, policy_version 1493383 (0.0009) [2023-12-26 11:31:09,954][123090] Updated weights for policy 1, policy_version 1483559 (0.0009) [2023-12-26 11:31:10,018][123090] Updated weights for policy 1, policy_version 1483569 (0.0010) [2023-12-26 11:31:10,086][123090] Updated weights for policy 1, policy_version 1483579 (0.0009) [2023-12-26 11:31:10,146][123091] Updated weights for policy 0, policy_version 1493393 (0.0010) [2023-12-26 11:31:10,207][123091] Updated weights for policy 0, policy_version 1493403 (0.0009) [2023-12-26 11:31:10,270][123091] Updated weights for policy 0, policy_version 1493413 (0.0010) [2023-12-26 11:31:10,329][123091] Updated weights for policy 0, policy_version 1493423 (0.0010) [2023-12-26 11:31:10,888][123090] Updated weights for policy 1, policy_version 1483589 (0.0009) [2023-12-26 11:31:10,959][123090] Updated weights for policy 1, policy_version 1483599 (0.0010) [2023-12-26 11:31:11,019][123090] Updated weights for policy 1, policy_version 1483609 (0.0009) [2023-12-26 11:31:11,187][123091] Updated weights for policy 0, policy_version 1493433 (0.0008) [2023-12-26 11:31:11,249][123091] Updated weights for policy 0, policy_version 1493443 (0.0009) [2023-12-26 11:31:11,320][123091] Updated weights for policy 0, policy_version 1493453 (0.0010) [2023-12-26 11:31:11,924][123090] Updated weights for policy 1, policy_version 1483619 (0.0009) [2023-12-26 11:31:11,999][123090] Updated weights for policy 1, policy_version 1483629 (0.0011) [2023-12-26 11:31:12,071][123090] Updated weights for policy 1, policy_version 1483639 (0.0011) [2023-12-26 11:31:12,163][123091] Updated weights for policy 0, policy_version 1493463 (0.0011) [2023-12-26 11:31:12,233][123091] Updated weights for policy 0, policy_version 1493473 (0.0006) [2023-12-26 11:31:12,301][123091] Updated weights for policy 0, policy_version 1493483 (0.0007) [2023-12-26 11:31:12,863][123090] Updated weights for policy 1, policy_version 1483649 (0.0010) [2023-12-26 11:31:12,922][123090] Updated weights for policy 1, policy_version 1483659 (0.0005) [2023-12-26 11:31:12,971][123090] Updated weights for policy 1, policy_version 1483669 (0.0006) [2023-12-26 11:31:13,021][123090] Updated weights for policy 1, policy_version 1483679 (0.0005) [2023-12-26 11:31:13,099][123091] Updated weights for policy 0, policy_version 1493493 (0.0010) [2023-12-26 11:31:13,173][123091] Updated weights for policy 0, policy_version 1493503 (0.0011) [2023-12-26 11:31:13,248][123091] Updated weights for policy 0, policy_version 1493513 (0.0011) [2023-12-26 11:31:13,739][123090] Updated weights for policy 1, policy_version 1483689 (0.0005) [2023-12-26 11:31:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 762167296. Throughput: 0: 8830.7, 1: 8816.5. Samples: 762164172. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:13,785][121949] Avg episode reward: [(0, '6289.976'), (1, '5702.993')] [2023-12-26 11:31:13,812][123090] Updated weights for policy 1, policy_version 1483699 (0.0006) [2023-12-26 11:31:13,883][123090] Updated weights for policy 1, policy_version 1483709 (0.0006) [2023-12-26 11:31:13,971][123091] Updated weights for policy 0, policy_version 1493523 (0.0011) [2023-12-26 11:31:14,034][123091] Updated weights for policy 0, policy_version 1493533 (0.0011) [2023-12-26 11:31:14,094][123091] Updated weights for policy 0, policy_version 1493543 (0.0011) [2023-12-26 11:31:14,560][123090] Updated weights for policy 1, policy_version 1483719 (0.0006) [2023-12-26 11:31:14,613][123090] Updated weights for policy 1, policy_version 1483729 (0.0006) [2023-12-26 11:31:14,669][123090] Updated weights for policy 1, policy_version 1483739 (0.0005) [2023-12-26 11:31:14,941][123091] Updated weights for policy 0, policy_version 1493553 (0.0011) [2023-12-26 11:31:14,990][123091] Updated weights for policy 0, policy_version 1493563 (0.0011) [2023-12-26 11:31:15,046][123091] Updated weights for policy 0, policy_version 1493573 (0.0011) [2023-12-26 11:31:15,103][123091] Updated weights for policy 0, policy_version 1493583 (0.0011) [2023-12-26 11:31:15,463][123090] Updated weights for policy 1, policy_version 1483749 (0.0008) [2023-12-26 11:31:15,531][123090] Updated weights for policy 1, policy_version 1483759 (0.0011) [2023-12-26 11:31:15,594][123090] Updated weights for policy 1, policy_version 1483769 (0.0010) [2023-12-26 11:31:15,977][123091] Updated weights for policy 0, policy_version 1493593 (0.0011) [2023-12-26 11:31:16,038][123091] Updated weights for policy 0, policy_version 1493603 (0.0010) [2023-12-26 11:31:16,100][123091] Updated weights for policy 0, policy_version 1493613 (0.0010) [2023-12-26 11:31:16,309][123090] Updated weights for policy 1, policy_version 1483779 (0.0010) [2023-12-26 11:31:16,381][123090] Updated weights for policy 1, policy_version 1483789 (0.0009) [2023-12-26 11:31:16,453][123090] Updated weights for policy 1, policy_version 1483799 (0.0009) [2023-12-26 11:31:16,914][123091] Updated weights for policy 0, policy_version 1493623 (0.0011) [2023-12-26 11:31:16,970][123091] Updated weights for policy 0, policy_version 1493633 (0.0010) [2023-12-26 11:31:17,034][123091] Updated weights for policy 0, policy_version 1493643 (0.0011) [2023-12-26 11:31:17,156][123090] Updated weights for policy 1, policy_version 1483809 (0.0008) [2023-12-26 11:31:17,218][123090] Updated weights for policy 1, policy_version 1483819 (0.0005) [2023-12-26 11:31:17,270][123090] Updated weights for policy 1, policy_version 1483829 (0.0005) [2023-12-26 11:31:17,324][123090] Updated weights for policy 1, policy_version 1483839 (0.0005) [2023-12-26 11:31:17,850][123091] Updated weights for policy 0, policy_version 1493653 (0.0010) [2023-12-26 11:31:17,901][123091] Updated weights for policy 0, policy_version 1493663 (0.0010) [2023-12-26 11:31:17,948][123091] Updated weights for policy 0, policy_version 1493673 (0.0010) [2023-12-26 11:31:18,030][123090] Updated weights for policy 1, policy_version 1483849 (0.0006) [2023-12-26 11:31:18,085][123090] Updated weights for policy 1, policy_version 1483859 (0.0005) [2023-12-26 11:31:18,140][123090] Updated weights for policy 1, policy_version 1483869 (0.0007) [2023-12-26 11:31:18,704][123091] Updated weights for policy 0, policy_version 1493683 (0.0010) [2023-12-26 11:31:18,759][123091] Updated weights for policy 0, policy_version 1493693 (0.0010) [2023-12-26 11:31:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 762257408. Throughput: 0: 8865.9, 1: 8819.4. Samples: 762274396. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:18,785][121949] Avg episode reward: [(0, '6177.224'), (1, '5735.304')] [2023-12-26 11:31:18,818][123091] Updated weights for policy 0, policy_version 1493703 (0.0011) [2023-12-26 11:31:18,938][123090] Updated weights for policy 1, policy_version 1483879 (0.0009) [2023-12-26 11:31:18,999][123090] Updated weights for policy 1, policy_version 1483889 (0.0009) [2023-12-26 11:31:19,064][123090] Updated weights for policy 1, policy_version 1483899 (0.0010) [2023-12-26 11:31:19,669][123091] Updated weights for policy 0, policy_version 1493713 (0.0011) [2023-12-26 11:31:19,728][123091] Updated weights for policy 0, policy_version 1493723 (0.0011) [2023-12-26 11:31:19,780][123091] Updated weights for policy 0, policy_version 1493733 (0.0010) [2023-12-26 11:31:19,844][123091] Updated weights for policy 0, policy_version 1493743 (0.0011) [2023-12-26 11:31:19,927][123090] Updated weights for policy 1, policy_version 1483909 (0.0008) [2023-12-26 11:31:20,001][123090] Updated weights for policy 1, policy_version 1483919 (0.0008) [2023-12-26 11:31:20,072][123090] Updated weights for policy 1, policy_version 1483929 (0.0006) [2023-12-26 11:31:20,693][123091] Updated weights for policy 0, policy_version 1493753 (0.0011) [2023-12-26 11:31:20,747][123091] Updated weights for policy 0, policy_version 1493763 (0.0011) [2023-12-26 11:31:20,811][123091] Updated weights for policy 0, policy_version 1493773 (0.0011) [2023-12-26 11:31:20,869][123090] Updated weights for policy 1, policy_version 1483939 (0.0008) [2023-12-26 11:31:20,939][123090] Updated weights for policy 1, policy_version 1483949 (0.0011) [2023-12-26 11:31:21,000][123090] Updated weights for policy 1, policy_version 1483959 (0.0011) [2023-12-26 11:31:21,649][123091] Updated weights for policy 0, policy_version 1493783 (0.0009) [2023-12-26 11:31:21,723][123091] Updated weights for policy 0, policy_version 1493793 (0.0008) [2023-12-26 11:31:21,797][123091] Updated weights for policy 0, policy_version 1493803 (0.0009) [2023-12-26 11:31:21,820][123090] Updated weights for policy 1, policy_version 1483969 (0.0009) [2023-12-26 11:31:21,881][123090] Updated weights for policy 1, policy_version 1483979 (0.0009) [2023-12-26 11:31:21,943][123090] Updated weights for policy 1, policy_version 1483989 (0.0009) [2023-12-26 11:31:22,009][123090] Updated weights for policy 1, policy_version 1483999 (0.0009) [2023-12-26 11:31:22,604][123091] Updated weights for policy 0, policy_version 1493813 (0.0010) [2023-12-26 11:31:22,672][123091] Updated weights for policy 0, policy_version 1493823 (0.0009) [2023-12-26 11:31:22,745][123091] Updated weights for policy 0, policy_version 1493833 (0.0009) [2023-12-26 11:31:22,804][123090] Updated weights for policy 1, policy_version 1484009 (0.0007) [2023-12-26 11:31:22,875][123090] Updated weights for policy 1, policy_version 1484019 (0.0010) [2023-12-26 11:31:22,937][123090] Updated weights for policy 1, policy_version 1484029 (0.0010) [2023-12-26 11:31:23,526][123091] Updated weights for policy 0, policy_version 1493843 (0.0010) [2023-12-26 11:31:23,580][123091] Updated weights for policy 0, policy_version 1493853 (0.0010) [2023-12-26 11:31:23,635][123091] Updated weights for policy 0, policy_version 1493863 (0.0010) [2023-12-26 11:31:23,777][123090] Updated weights for policy 1, policy_version 1484039 (0.0009) [2023-12-26 11:31:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 762347520. Throughput: 0: 8862.5, 1: 8743.0. Samples: 762324792. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:23,785][121949] Avg episode reward: [(0, '6039.814'), (1, '5865.581')] [2023-12-26 11:31:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001493872_382435328.pth... [2023-12-26 11:31:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001492848_382173184.pth [2023-12-26 11:31:23,830][123090] Updated weights for policy 1, policy_version 1484049 (0.0008) [2023-12-26 11:31:23,891][123090] Updated weights for policy 1, policy_version 1484059 (0.0008) [2023-12-26 11:31:23,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001484064_379920384.pth... [2023-12-26 11:31:23,931][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001483008_379650048.pth [2023-12-26 11:31:24,469][123091] Updated weights for policy 0, policy_version 1493873 (0.0010) [2023-12-26 11:31:24,528][123091] Updated weights for policy 0, policy_version 1493883 (0.0008) [2023-12-26 11:31:24,591][123091] Updated weights for policy 0, policy_version 1493893 (0.0006) [2023-12-26 11:31:24,618][123090] Updated weights for policy 1, policy_version 1484069 (0.0007) [2023-12-26 11:31:24,645][123091] Updated weights for policy 0, policy_version 1493903 (0.0007) [2023-12-26 11:31:24,692][123090] Updated weights for policy 1, policy_version 1484079 (0.0005) [2023-12-26 11:31:24,763][123090] Updated weights for policy 1, policy_version 1484089 (0.0005) [2023-12-26 11:31:25,404][123091] Updated weights for policy 0, policy_version 1493913 (0.0006) [2023-12-26 11:31:25,452][123091] Updated weights for policy 0, policy_version 1493923 (0.0005) [2023-12-26 11:31:25,501][123091] Updated weights for policy 0, policy_version 1493933 (0.0005) [2023-12-26 11:31:25,573][123090] Updated weights for policy 1, policy_version 1484099 (0.0007) [2023-12-26 11:31:25,627][123090] Updated weights for policy 1, policy_version 1484109 (0.0010) [2023-12-26 11:31:25,690][123090] Updated weights for policy 1, policy_version 1484119 (0.0009) [2023-12-26 11:31:26,112][123091] Updated weights for policy 0, policy_version 1493943 (0.0005) [2023-12-26 11:31:26,165][123091] Updated weights for policy 0, policy_version 1493953 (0.0007) [2023-12-26 11:31:26,223][123091] Updated weights for policy 0, policy_version 1493963 (0.0010) [2023-12-26 11:31:26,510][123090] Updated weights for policy 1, policy_version 1484129 (0.0010) [2023-12-26 11:31:26,576][123090] Updated weights for policy 1, policy_version 1484139 (0.0011) [2023-12-26 11:31:26,642][123090] Updated weights for policy 1, policy_version 1484149 (0.0010) [2023-12-26 11:31:26,703][123090] Updated weights for policy 1, policy_version 1484159 (0.0010) [2023-12-26 11:31:26,948][123091] Updated weights for policy 0, policy_version 1493973 (0.0008) [2023-12-26 11:31:27,003][123091] Updated weights for policy 0, policy_version 1493983 (0.0008) [2023-12-26 11:31:27,055][123091] Updated weights for policy 0, policy_version 1493993 (0.0008) [2023-12-26 11:31:27,501][123090] Updated weights for policy 1, policy_version 1484169 (0.0010) [2023-12-26 11:31:27,562][123090] Updated weights for policy 1, policy_version 1484179 (0.0010) [2023-12-26 11:31:27,621][123090] Updated weights for policy 1, policy_version 1484189 (0.0010) [2023-12-26 11:31:27,828][123091] Updated weights for policy 0, policy_version 1494003 (0.0008) [2023-12-26 11:31:27,889][123091] Updated weights for policy 0, policy_version 1494013 (0.0005) [2023-12-26 11:31:27,941][123091] Updated weights for policy 0, policy_version 1494023 (0.0005) [2023-12-26 11:31:28,386][123090] Updated weights for policy 1, policy_version 1484199 (0.0008) [2023-12-26 11:31:28,444][123090] Updated weights for policy 1, policy_version 1484209 (0.0010) [2023-12-26 11:31:28,506][123090] Updated weights for policy 1, policy_version 1484219 (0.0011) [2023-12-26 11:31:28,731][123091] Updated weights for policy 0, policy_version 1494033 (0.0006) [2023-12-26 11:31:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 762437632. Throughput: 0: 8926.3, 1: 8733.8. Samples: 762431756. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:28,785][121949] Avg episode reward: [(0, '6164.297'), (1, '5895.895')] [2023-12-26 11:31:28,790][123091] Updated weights for policy 0, policy_version 1494043 (0.0010) [2023-12-26 11:31:28,853][123091] Updated weights for policy 0, policy_version 1494053 (0.0010) [2023-12-26 11:31:28,908][123091] Updated weights for policy 0, policy_version 1494063 (0.0010) [2023-12-26 11:31:29,247][123090] Updated weights for policy 1, policy_version 1484229 (0.0010) [2023-12-26 11:31:29,318][123090] Updated weights for policy 1, policy_version 1484239 (0.0009) [2023-12-26 11:31:29,384][123090] Updated weights for policy 1, policy_version 1484249 (0.0013) [2023-12-26 11:31:29,755][123091] Updated weights for policy 0, policy_version 1494073 (0.0010) [2023-12-26 11:31:29,813][123091] Updated weights for policy 0, policy_version 1494083 (0.0009) [2023-12-26 11:31:29,876][123091] Updated weights for policy 0, policy_version 1494093 (0.0009) [2023-12-26 11:31:30,092][123090] Updated weights for policy 1, policy_version 1484259 (0.0006) [2023-12-26 11:31:30,140][123090] Updated weights for policy 1, policy_version 1484269 (0.0005) [2023-12-26 11:31:30,197][123090] Updated weights for policy 1, policy_version 1484279 (0.0006) [2023-12-26 11:31:30,600][123091] Updated weights for policy 0, policy_version 1494103 (0.0008) [2023-12-26 11:31:30,650][123091] Updated weights for policy 0, policy_version 1494113 (0.0006) [2023-12-26 11:31:30,709][123091] Updated weights for policy 0, policy_version 1494123 (0.0009) [2023-12-26 11:31:30,914][123090] Updated weights for policy 1, policy_version 1484289 (0.0005) [2023-12-26 11:31:30,975][123090] Updated weights for policy 1, policy_version 1484299 (0.0005) [2023-12-26 11:31:31,031][123090] Updated weights for policy 1, policy_version 1484309 (0.0006) [2023-12-26 11:31:31,094][123090] Updated weights for policy 1, policy_version 1484319 (0.0007) [2023-12-26 11:31:31,451][123091] Updated weights for policy 0, policy_version 1494133 (0.0008) [2023-12-26 11:31:31,507][123091] Updated weights for policy 0, policy_version 1494143 (0.0005) [2023-12-26 11:31:31,573][123091] Updated weights for policy 0, policy_version 1494153 (0.0011) [2023-12-26 11:31:31,887][123090] Updated weights for policy 1, policy_version 1484329 (0.0008) [2023-12-26 11:31:31,941][123090] Updated weights for policy 1, policy_version 1484339 (0.0008) [2023-12-26 11:31:31,996][123090] Updated weights for policy 1, policy_version 1484349 (0.0010) [2023-12-26 11:31:32,349][123091] Updated weights for policy 0, policy_version 1494163 (0.0010) [2023-12-26 11:31:32,414][123091] Updated weights for policy 0, policy_version 1494173 (0.0009) [2023-12-26 11:31:32,471][123091] Updated weights for policy 0, policy_version 1494183 (0.0007) [2023-12-26 11:31:32,796][123090] Updated weights for policy 1, policy_version 1484359 (0.0007) [2023-12-26 11:31:32,843][123090] Updated weights for policy 1, policy_version 1484369 (0.0005) [2023-12-26 11:31:32,894][123090] Updated weights for policy 1, policy_version 1484379 (0.0005) [2023-12-26 11:31:33,161][123091] Updated weights for policy 0, policy_version 1494193 (0.0009) [2023-12-26 11:31:33,218][123091] Updated weights for policy 0, policy_version 1494203 (0.0010) [2023-12-26 11:31:33,271][123091] Updated weights for policy 0, policy_version 1494213 (0.0009) [2023-12-26 11:31:33,328][123091] Updated weights for policy 0, policy_version 1494224 (0.0010) [2023-12-26 11:31:33,557][123090] Updated weights for policy 1, policy_version 1484389 (0.0005) [2023-12-26 11:31:33,622][123090] Updated weights for policy 1, policy_version 1484399 (0.0007) [2023-12-26 11:31:33,688][123090] Updated weights for policy 1, policy_version 1484409 (0.0010) [2023-12-26 11:31:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 762535936. Throughput: 0: 8918.9, 1: 8843.4. Samples: 762544108. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:33,785][121949] Avg episode reward: [(0, '6426.022'), (1, '5784.249')] [2023-12-26 11:31:34,153][123091] Updated weights for policy 0, policy_version 1494234 (0.0010) [2023-12-26 11:31:34,209][123091] Updated weights for policy 0, policy_version 1494244 (0.0009) [2023-12-26 11:31:34,275][123091] Updated weights for policy 0, policy_version 1494254 (0.0009) [2023-12-26 11:31:34,399][123090] Updated weights for policy 1, policy_version 1484419 (0.0009) [2023-12-26 11:31:34,464][123090] Updated weights for policy 1, policy_version 1484429 (0.0009) [2023-12-26 11:31:34,530][123090] Updated weights for policy 1, policy_version 1484439 (0.0010) [2023-12-26 11:31:34,979][123091] Updated weights for policy 0, policy_version 1494264 (0.0009) [2023-12-26 11:31:35,040][123091] Updated weights for policy 0, policy_version 1494274 (0.0005) [2023-12-26 11:31:35,097][123091] Updated weights for policy 0, policy_version 1494284 (0.0005) [2023-12-26 11:31:35,416][123090] Updated weights for policy 1, policy_version 1484449 (0.0009) [2023-12-26 11:31:35,469][123090] Updated weights for policy 1, policy_version 1484459 (0.0009) [2023-12-26 11:31:35,523][123090] Updated weights for policy 1, policy_version 1484470 (0.0010) [2023-12-26 11:31:35,590][123090] Updated weights for policy 1, policy_version 1484480 (0.0010) [2023-12-26 11:31:35,779][123091] Updated weights for policy 0, policy_version 1494294 (0.0007) [2023-12-26 11:31:35,844][123091] Updated weights for policy 0, policy_version 1494304 (0.0007) [2023-12-26 11:31:35,914][123091] Updated weights for policy 0, policy_version 1494314 (0.0005) [2023-12-26 11:31:36,423][123090] Updated weights for policy 1, policy_version 1484490 (0.0011) [2023-12-26 11:31:36,477][123090] Updated weights for policy 1, policy_version 1484500 (0.0010) [2023-12-26 11:31:36,533][123090] Updated weights for policy 1, policy_version 1484510 (0.0011) [2023-12-26 11:31:36,700][123091] Updated weights for policy 0, policy_version 1494324 (0.0008) [2023-12-26 11:31:36,771][123091] Updated weights for policy 0, policy_version 1494334 (0.0011) [2023-12-26 11:31:36,841][123091] Updated weights for policy 0, policy_version 1494344 (0.0011) [2023-12-26 11:31:37,393][123090] Updated weights for policy 1, policy_version 1484520 (0.0011) [2023-12-26 11:31:37,464][123090] Updated weights for policy 1, policy_version 1484530 (0.0010) [2023-12-26 11:31:37,539][123090] Updated weights for policy 1, policy_version 1484540 (0.0011) [2023-12-26 11:31:37,573][123091] Updated weights for policy 0, policy_version 1494354 (0.0009) [2023-12-26 11:31:37,646][123091] Updated weights for policy 0, policy_version 1494364 (0.0006) [2023-12-26 11:31:37,717][123091] Updated weights for policy 0, policy_version 1494374 (0.0006) [2023-12-26 11:31:37,769][123091] Updated weights for policy 0, policy_version 1494384 (0.0005) [2023-12-26 11:31:38,359][123090] Updated weights for policy 1, policy_version 1484550 (0.0009) [2023-12-26 11:31:38,411][123090] Updated weights for policy 1, policy_version 1484560 (0.0006) [2023-12-26 11:31:38,455][123091] Updated weights for policy 0, policy_version 1494394 (0.0011) [2023-12-26 11:31:38,458][123090] Updated weights for policy 1, policy_version 1484570 (0.0005) [2023-12-26 11:31:38,522][123091] Updated weights for policy 0, policy_version 1494404 (0.0010) [2023-12-26 11:31:38,581][123091] Updated weights for policy 0, policy_version 1494414 (0.0010) [2023-12-26 11:31:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 762626048. Throughput: 0: 8999.2, 1: 8832.9. Samples: 762598680. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:38,785][121949] Avg episode reward: [(0, '6386.409'), (1, '5782.384')] [2023-12-26 11:31:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001494416_382574592.pth... [2023-12-26 11:31:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001484576_380051456.pth... [2023-12-26 11:31:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001493360_382304256.pth [2023-12-26 11:31:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001483520_379781120.pth [2023-12-26 11:31:39,211][123091] Updated weights for policy 0, policy_version 1494424 (0.0009) [2023-12-26 11:31:39,280][123091] Updated weights for policy 0, policy_version 1494434 (0.0009) [2023-12-26 11:31:39,301][123090] Updated weights for policy 1, policy_version 1484580 (0.0007) [2023-12-26 11:31:39,347][123091] Updated weights for policy 0, policy_version 1494444 (0.0010) [2023-12-26 11:31:39,363][123090] Updated weights for policy 1, policy_version 1484590 (0.0009) [2023-12-26 11:31:39,433][123090] Updated weights for policy 1, policy_version 1484600 (0.0009) [2023-12-26 11:31:40,189][123091] Updated weights for policy 0, policy_version 1494454 (0.0009) [2023-12-26 11:31:40,254][123091] Updated weights for policy 0, policy_version 1494464 (0.0006) [2023-12-26 11:31:40,292][123090] Updated weights for policy 1, policy_version 1484610 (0.0009) [2023-12-26 11:31:40,319][123091] Updated weights for policy 0, policy_version 1494474 (0.0008) [2023-12-26 11:31:40,356][123090] Updated weights for policy 1, policy_version 1484620 (0.0007) [2023-12-26 11:31:40,432][123090] Updated weights for policy 1, policy_version 1484630 (0.0006) [2023-12-26 11:31:40,495][123090] Updated weights for policy 1, policy_version 1484640 (0.0009) [2023-12-26 11:31:41,040][123091] Updated weights for policy 0, policy_version 1494484 (0.0008) [2023-12-26 11:31:41,104][123091] Updated weights for policy 0, policy_version 1494494 (0.0010) [2023-12-26 11:31:41,170][123091] Updated weights for policy 0, policy_version 1494504 (0.0010) [2023-12-26 11:31:41,335][123090] Updated weights for policy 1, policy_version 1484650 (0.0010) [2023-12-26 11:31:41,406][123090] Updated weights for policy 1, policy_version 1484660 (0.0009) [2023-12-26 11:31:41,469][123090] Updated weights for policy 1, policy_version 1484670 (0.0010) [2023-12-26 11:31:41,992][123091] Updated weights for policy 0, policy_version 1494514 (0.0008) [2023-12-26 11:31:42,050][123091] Updated weights for policy 0, policy_version 1494524 (0.0006) [2023-12-26 11:31:42,117][123091] Updated weights for policy 0, policy_version 1494534 (0.0006) [2023-12-26 11:31:42,185][123091] Updated weights for policy 0, policy_version 1494544 (0.0006) [2023-12-26 11:31:42,383][123090] Updated weights for policy 1, policy_version 1484680 (0.0009) [2023-12-26 11:31:42,437][123090] Updated weights for policy 1, policy_version 1484690 (0.0010) [2023-12-26 11:31:42,489][123090] Updated weights for policy 1, policy_version 1484700 (0.0010) [2023-12-26 11:31:42,947][123091] Updated weights for policy 0, policy_version 1494554 (0.0009) [2023-12-26 11:31:43,012][123091] Updated weights for policy 0, policy_version 1494564 (0.0009) [2023-12-26 11:31:43,068][123091] Updated weights for policy 0, policy_version 1494574 (0.0009) [2023-12-26 11:31:43,366][123090] Updated weights for policy 1, policy_version 1484710 (0.0010) [2023-12-26 11:31:43,427][123090] Updated weights for policy 1, policy_version 1484720 (0.0009) [2023-12-26 11:31:43,493][123090] Updated weights for policy 1, policy_version 1484730 (0.0009) [2023-12-26 11:31:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 762707968. Throughput: 0: 8980.1, 1: 8838.4. Samples: 762703284. Policy #0 lag: (min: 0.0, avg: 29.7, max: 32.0) [2023-12-26 11:31:43,786][121949] Avg episode reward: [(0, '6391.014'), (1, '5984.431')] [2023-12-26 11:31:43,880][123091] Updated weights for policy 0, policy_version 1494584 (0.0010) [2023-12-26 11:31:43,949][123091] Updated weights for policy 0, policy_version 1494594 (0.0009) [2023-12-26 11:31:44,010][123091] Updated weights for policy 0, policy_version 1494604 (0.0009) [2023-12-26 11:31:44,368][123090] Updated weights for policy 1, policy_version 1484740 (0.0008) [2023-12-26 11:31:44,431][123090] Updated weights for policy 1, policy_version 1484750 (0.0006) [2023-12-26 11:31:44,493][123090] Updated weights for policy 1, policy_version 1484760 (0.0006) [2023-12-26 11:31:44,711][123091] Updated weights for policy 0, policy_version 1494614 (0.0009) [2023-12-26 11:31:44,763][123091] Updated weights for policy 0, policy_version 1494624 (0.0006) [2023-12-26 11:31:44,826][123091] Updated weights for policy 0, policy_version 1494634 (0.0011) [2023-12-26 11:31:45,222][123090] Updated weights for policy 1, policy_version 1484770 (0.0007) [2023-12-26 11:31:45,302][123090] Updated weights for policy 1, policy_version 1484780 (0.0006) [2023-12-26 11:31:45,359][123090] Updated weights for policy 1, policy_version 1484790 (0.0009) [2023-12-26 11:31:45,420][123090] Updated weights for policy 1, policy_version 1484800 (0.0009) [2023-12-26 11:31:45,657][123091] Updated weights for policy 0, policy_version 1494644 (0.0011) [2023-12-26 11:31:45,710][123091] Updated weights for policy 0, policy_version 1494654 (0.0009) [2023-12-26 11:31:45,768][123091] Updated weights for policy 0, policy_version 1494664 (0.0010) [2023-12-26 11:31:46,208][123090] Updated weights for policy 1, policy_version 1484810 (0.0010) [2023-12-26 11:31:46,263][123090] Updated weights for policy 1, policy_version 1484820 (0.0010) [2023-12-26 11:31:46,314][123090] Updated weights for policy 1, policy_version 1484830 (0.0010) [2023-12-26 11:31:46,523][123091] Updated weights for policy 0, policy_version 1494674 (0.0009) [2023-12-26 11:31:46,589][123091] Updated weights for policy 0, policy_version 1494684 (0.0010) [2023-12-26 11:31:46,647][123091] Updated weights for policy 0, policy_version 1494694 (0.0007) [2023-12-26 11:31:46,707][123091] Updated weights for policy 0, policy_version 1494704 (0.0005) [2023-12-26 11:31:47,083][123090] Updated weights for policy 1, policy_version 1484840 (0.0010) [2023-12-26 11:31:47,138][123090] Updated weights for policy 1, policy_version 1484850 (0.0010) [2023-12-26 11:31:47,204][123090] Updated weights for policy 1, policy_version 1484860 (0.0010) [2023-12-26 11:31:47,393][123091] Updated weights for policy 0, policy_version 1494714 (0.0010) [2023-12-26 11:31:47,447][123091] Updated weights for policy 0, policy_version 1494724 (0.0010) [2023-12-26 11:31:47,506][123091] Updated weights for policy 0, policy_version 1494734 (0.0010) [2023-12-26 11:31:47,907][123090] Updated weights for policy 1, policy_version 1484870 (0.0007) [2023-12-26 11:31:47,956][123090] Updated weights for policy 1, policy_version 1484880 (0.0005) [2023-12-26 11:31:48,007][123090] Updated weights for policy 1, policy_version 1484890 (0.0006) [2023-12-26 11:31:48,294][123091] Updated weights for policy 0, policy_version 1494744 (0.0009) [2023-12-26 11:31:48,366][123091] Updated weights for policy 0, policy_version 1494754 (0.0009) [2023-12-26 11:31:48,435][123091] Updated weights for policy 0, policy_version 1494764 (0.0007) [2023-12-26 11:31:48,731][123090] Updated weights for policy 1, policy_version 1484900 (0.0010) [2023-12-26 11:31:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 762798080. Throughput: 0: 8969.3, 1: 8866.8. Samples: 762812716. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:31:48,784][121949] Avg episode reward: [(0, '6379.171'), (1, '5863.292')] [2023-12-26 11:31:48,787][123090] Updated weights for policy 1, policy_version 1484910 (0.0010) [2023-12-26 11:31:48,847][123090] Updated weights for policy 1, policy_version 1484920 (0.0010) [2023-12-26 11:31:49,194][123091] Updated weights for policy 0, policy_version 1494774 (0.0007) [2023-12-26 11:31:49,264][123091] Updated weights for policy 0, policy_version 1494784 (0.0009) [2023-12-26 11:31:49,321][123091] Updated weights for policy 0, policy_version 1494794 (0.0010) [2023-12-26 11:31:49,628][123090] Updated weights for policy 1, policy_version 1484930 (0.0009) [2023-12-26 11:31:49,694][123090] Updated weights for policy 1, policy_version 1484940 (0.0005) [2023-12-26 11:31:49,755][123090] Updated weights for policy 1, policy_version 1484950 (0.0005) [2023-12-26 11:31:49,823][123090] Updated weights for policy 1, policy_version 1484960 (0.0006) [2023-12-26 11:31:50,108][123091] Updated weights for policy 0, policy_version 1494804 (0.0009) [2023-12-26 11:31:50,162][123091] Updated weights for policy 0, policy_version 1494814 (0.0010) [2023-12-26 11:31:50,223][123091] Updated weights for policy 0, policy_version 1494824 (0.0010) [2023-12-26 11:31:50,504][123090] Updated weights for policy 1, policy_version 1484970 (0.0005) [2023-12-26 11:31:50,570][123090] Updated weights for policy 1, policy_version 1484980 (0.0006) [2023-12-26 11:31:50,627][123090] Updated weights for policy 1, policy_version 1484990 (0.0007) [2023-12-26 11:31:51,126][123091] Updated weights for policy 0, policy_version 1494834 (0.0009) [2023-12-26 11:31:51,196][123091] Updated weights for policy 0, policy_version 1494844 (0.0008) [2023-12-26 11:31:51,261][123091] Updated weights for policy 0, policy_version 1494854 (0.0009) [2023-12-26 11:31:51,325][123091] Updated weights for policy 0, policy_version 1494864 (0.0009) [2023-12-26 11:31:51,431][123090] Updated weights for policy 1, policy_version 1485000 (0.0007) [2023-12-26 11:31:51,487][123090] Updated weights for policy 1, policy_version 1485010 (0.0008) [2023-12-26 11:31:51,542][123090] Updated weights for policy 1, policy_version 1485020 (0.0007) [2023-12-26 11:31:52,176][123091] Updated weights for policy 0, policy_version 1494874 (0.0010) [2023-12-26 11:31:52,228][123091] Updated weights for policy 0, policy_version 1494884 (0.0009) [2023-12-26 11:31:52,288][123091] Updated weights for policy 0, policy_version 1494894 (0.0010) [2023-12-26 11:31:52,363][123090] Updated weights for policy 1, policy_version 1485030 (0.0008) [2023-12-26 11:31:52,428][123090] Updated weights for policy 1, policy_version 1485040 (0.0010) [2023-12-26 11:31:52,493][123090] Updated weights for policy 1, policy_version 1485050 (0.0009) [2023-12-26 11:31:53,119][123091] Updated weights for policy 0, policy_version 1494904 (0.0010) [2023-12-26 11:31:53,171][123091] Updated weights for policy 0, policy_version 1494914 (0.0010) [2023-12-26 11:31:53,223][123091] Updated weights for policy 0, policy_version 1494924 (0.0010) [2023-12-26 11:31:53,319][123090] Updated weights for policy 1, policy_version 1485060 (0.0009) [2023-12-26 11:31:53,367][123090] Updated weights for policy 1, policy_version 1485070 (0.0009) [2023-12-26 11:31:53,414][123090] Updated weights for policy 1, policy_version 1485080 (0.0008) [2023-12-26 11:31:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 762888192. Throughput: 0: 8942.4, 1: 8884.8. Samples: 762865376. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:31:53,785][121949] Avg episode reward: [(0, '6294.569'), (1, '5709.916')] [2023-12-26 11:31:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001494928_382705664.pth... [2023-12-26 11:31:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001485088_380182528.pth... [2023-12-26 11:31:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001484064_379920384.pth [2023-12-26 11:31:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001493872_382435328.pth [2023-12-26 11:31:54,066][123091] Updated weights for policy 0, policy_version 1494934 (0.0010) [2023-12-26 11:31:54,128][123091] Updated weights for policy 0, policy_version 1494944 (0.0010) [2023-12-26 11:31:54,194][123091] Updated weights for policy 0, policy_version 1494954 (0.0010) [2023-12-26 11:31:54,243][123090] Updated weights for policy 1, policy_version 1485090 (0.0009) [2023-12-26 11:31:54,296][123090] Updated weights for policy 1, policy_version 1485100 (0.0007) [2023-12-26 11:31:54,355][123090] Updated weights for policy 1, policy_version 1485110 (0.0005) [2023-12-26 11:31:54,425][123090] Updated weights for policy 1, policy_version 1485120 (0.0007) [2023-12-26 11:31:54,990][123091] Updated weights for policy 0, policy_version 1494964 (0.0011) [2023-12-26 11:31:55,054][123091] Updated weights for policy 0, policy_version 1494974 (0.0011) [2023-12-26 11:31:55,112][123091] Updated weights for policy 0, policy_version 1494984 (0.0011) [2023-12-26 11:31:55,218][123090] Updated weights for policy 1, policy_version 1485130 (0.0011) [2023-12-26 11:31:55,280][123090] Updated weights for policy 1, policy_version 1485140 (0.0008) [2023-12-26 11:31:55,351][123090] Updated weights for policy 1, policy_version 1485150 (0.0007) [2023-12-26 11:31:55,886][123091] Updated weights for policy 0, policy_version 1494994 (0.0011) [2023-12-26 11:31:55,934][123091] Updated weights for policy 0, policy_version 1495004 (0.0010) [2023-12-26 11:31:55,970][123090] Updated weights for policy 1, policy_version 1485160 (0.0006) [2023-12-26 11:31:55,996][123091] Updated weights for policy 0, policy_version 1495014 (0.0010) [2023-12-26 11:31:56,030][123090] Updated weights for policy 1, policy_version 1485170 (0.0007) [2023-12-26 11:31:56,048][123091] Updated weights for policy 0, policy_version 1495024 (0.0010) [2023-12-26 11:31:56,083][123090] Updated weights for policy 1, policy_version 1485180 (0.0009) [2023-12-26 11:31:56,644][123091] Updated weights for policy 0, policy_version 1495034 (0.0010) [2023-12-26 11:31:56,695][123091] Updated weights for policy 0, policy_version 1495044 (0.0010) [2023-12-26 11:31:56,743][123091] Updated weights for policy 0, policy_version 1495054 (0.0010) [2023-12-26 11:31:56,927][123090] Updated weights for policy 1, policy_version 1485190 (0.0007) [2023-12-26 11:31:56,986][123090] Updated weights for policy 1, policy_version 1485200 (0.0005) [2023-12-26 11:31:57,039][123090] Updated weights for policy 1, policy_version 1485210 (0.0005) [2023-12-26 11:31:57,525][123091] Updated weights for policy 0, policy_version 1495064 (0.0009) [2023-12-26 11:31:57,589][123091] Updated weights for policy 0, policy_version 1495074 (0.0008) [2023-12-26 11:31:57,647][123091] Updated weights for policy 0, policy_version 1495084 (0.0005) [2023-12-26 11:31:57,691][123090] Updated weights for policy 1, policy_version 1485220 (0.0005) [2023-12-26 11:31:57,748][123090] Updated weights for policy 1, policy_version 1485230 (0.0006) [2023-12-26 11:31:57,800][123090] Updated weights for policy 1, policy_version 1485240 (0.0005) [2023-12-26 11:31:58,437][123091] Updated weights for policy 0, policy_version 1495094 (0.0008) [2023-12-26 11:31:58,494][123091] Updated weights for policy 0, policy_version 1495104 (0.0009) [2023-12-26 11:31:58,556][123091] Updated weights for policy 0, policy_version 1495114 (0.0010) [2023-12-26 11:31:58,591][123090] Updated weights for policy 1, policy_version 1485250 (0.0006) [2023-12-26 11:31:58,663][123090] Updated weights for policy 1, policy_version 1485260 (0.0008) [2023-12-26 11:31:58,737][123090] Updated weights for policy 1, policy_version 1485270 (0.0009) [2023-12-26 11:31:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.3, 300 sec: 17800.2). Total num frames: 762978304. Throughput: 0: 9027.9, 1: 8967.3. Samples: 762973956. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:31:58,784][121949] Avg episode reward: [(0, '6214.004'), (1, '5550.568')] [2023-12-26 11:31:58,803][123090] Updated weights for policy 1, policy_version 1485280 (0.0010) [2023-12-26 11:31:59,531][123091] Updated weights for policy 0, policy_version 1495124 (0.0008) [2023-12-26 11:31:59,598][123091] Updated weights for policy 0, policy_version 1495134 (0.0005) [2023-12-26 11:31:59,657][123090] Updated weights for policy 1, policy_version 1485290 (0.0007) [2023-12-26 11:31:59,662][123091] Updated weights for policy 0, policy_version 1495144 (0.0008) [2023-12-26 11:31:59,712][123090] Updated weights for policy 1, policy_version 1485300 (0.0005) [2023-12-26 11:31:59,778][123090] Updated weights for policy 1, policy_version 1485310 (0.0005) [2023-12-26 11:32:00,372][123091] Updated weights for policy 0, policy_version 1495154 (0.0008) [2023-12-26 11:32:00,424][123091] Updated weights for policy 0, policy_version 1495164 (0.0010) [2023-12-26 11:32:00,489][123090] Updated weights for policy 1, policy_version 1485320 (0.0009) [2023-12-26 11:32:00,493][123091] Updated weights for policy 0, policy_version 1495174 (0.0010) [2023-12-26 11:32:00,536][123090] Updated weights for policy 1, policy_version 1485330 (0.0010) [2023-12-26 11:32:00,547][123091] Updated weights for policy 0, policy_version 1495184 (0.0010) [2023-12-26 11:32:00,586][123090] Updated weights for policy 1, policy_version 1485340 (0.0010) [2023-12-26 11:32:01,334][123091] Updated weights for policy 0, policy_version 1495194 (0.0008) [2023-12-26 11:32:01,402][123091] Updated weights for policy 0, policy_version 1495204 (0.0010) [2023-12-26 11:32:01,441][123090] Updated weights for policy 1, policy_version 1485350 (0.0010) [2023-12-26 11:32:01,468][123091] Updated weights for policy 0, policy_version 1495214 (0.0011) [2023-12-26 11:32:01,501][123090] Updated weights for policy 1, policy_version 1485360 (0.0010) [2023-12-26 11:32:01,567][123090] Updated weights for policy 1, policy_version 1485370 (0.0010) [2023-12-26 11:32:02,174][123091] Updated weights for policy 0, policy_version 1495224 (0.0007) [2023-12-26 11:32:02,251][123091] Updated weights for policy 0, policy_version 1495234 (0.0006) [2023-12-26 11:32:02,323][123091] Updated weights for policy 0, policy_version 1495244 (0.0007) [2023-12-26 11:32:02,333][123090] Updated weights for policy 1, policy_version 1485380 (0.0010) [2023-12-26 11:32:02,390][123090] Updated weights for policy 1, policy_version 1485390 (0.0009) [2023-12-26 11:32:02,442][123090] Updated weights for policy 1, policy_version 1485400 (0.0008) [2023-12-26 11:32:03,024][123091] Updated weights for policy 0, policy_version 1495254 (0.0007) [2023-12-26 11:32:03,085][123091] Updated weights for policy 0, policy_version 1495264 (0.0007) [2023-12-26 11:32:03,131][123091] Updated weights for policy 0, policy_version 1495274 (0.0005) [2023-12-26 11:32:03,231][123090] Updated weights for policy 1, policy_version 1485410 (0.0007) [2023-12-26 11:32:03,290][123090] Updated weights for policy 1, policy_version 1485420 (0.0005) [2023-12-26 11:32:03,344][123090] Updated weights for policy 1, policy_version 1485430 (0.0005) [2023-12-26 11:32:03,396][123090] Updated weights for policy 1, policy_version 1485440 (0.0005) [2023-12-26 11:32:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 763068416. Throughput: 0: 9056.6, 1: 8874.7. Samples: 763081308. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:03,785][121949] Avg episode reward: [(0, '6187.493'), (1, '5754.949')] [2023-12-26 11:32:03,957][123091] Updated weights for policy 0, policy_version 1495284 (0.0007) [2023-12-26 11:32:04,026][123091] Updated weights for policy 0, policy_version 1495294 (0.0009) [2023-12-26 11:32:04,084][123091] Updated weights for policy 0, policy_version 1495304 (0.0009) [2023-12-26 11:32:04,107][123090] Updated weights for policy 1, policy_version 1485450 (0.0006) [2023-12-26 11:32:04,163][123090] Updated weights for policy 1, policy_version 1485460 (0.0008) [2023-12-26 11:32:04,227][123090] Updated weights for policy 1, policy_version 1485470 (0.0010) [2023-12-26 11:32:04,933][123091] Updated weights for policy 0, policy_version 1495314 (0.0009) [2023-12-26 11:32:04,985][123091] Updated weights for policy 0, policy_version 1495324 (0.0008) [2023-12-26 11:32:05,044][123091] Updated weights for policy 0, policy_version 1495334 (0.0010) [2023-12-26 11:32:05,050][123090] Updated weights for policy 1, policy_version 1485480 (0.0011) [2023-12-26 11:32:05,104][123091] Updated weights for policy 0, policy_version 1495344 (0.0006) [2023-12-26 11:32:05,117][123090] Updated weights for policy 1, policy_version 1485490 (0.0010) [2023-12-26 11:32:05,180][123090] Updated weights for policy 1, policy_version 1485500 (0.0011) [2023-12-26 11:32:05,856][123090] Updated weights for policy 1, policy_version 1485510 (0.0007) [2023-12-26 11:32:05,865][123091] Updated weights for policy 0, policy_version 1495354 (0.0010) [2023-12-26 11:32:05,909][123090] Updated weights for policy 1, policy_version 1485520 (0.0005) [2023-12-26 11:32:05,923][123091] Updated weights for policy 0, policy_version 1495364 (0.0009) [2023-12-26 11:32:05,967][123090] Updated weights for policy 1, policy_version 1485530 (0.0005) [2023-12-26 11:32:05,977][123091] Updated weights for policy 0, policy_version 1495374 (0.0008) [2023-12-26 11:32:06,658][123090] Updated weights for policy 1, policy_version 1485540 (0.0005) [2023-12-26 11:32:06,712][123090] Updated weights for policy 1, policy_version 1485550 (0.0005) [2023-12-26 11:32:06,778][123090] Updated weights for policy 1, policy_version 1485560 (0.0005) [2023-12-26 11:32:06,786][123091] Updated weights for policy 0, policy_version 1495384 (0.0010) [2023-12-26 11:32:06,858][123091] Updated weights for policy 0, policy_version 1495394 (0.0011) [2023-12-26 11:32:06,925][123091] Updated weights for policy 0, policy_version 1495404 (0.0011) [2023-12-26 11:32:07,389][123090] Updated weights for policy 1, policy_version 1485570 (0.0006) [2023-12-26 11:32:07,440][123090] Updated weights for policy 1, policy_version 1485580 (0.0007) [2023-12-26 11:32:07,500][123090] Updated weights for policy 1, policy_version 1485590 (0.0010) [2023-12-26 11:32:07,555][123090] Updated weights for policy 1, policy_version 1485600 (0.0010) [2023-12-26 11:32:07,728][123091] Updated weights for policy 0, policy_version 1495414 (0.0010) [2023-12-26 11:32:07,776][123091] Updated weights for policy 0, policy_version 1495424 (0.0010) [2023-12-26 11:32:07,829][123091] Updated weights for policy 0, policy_version 1495434 (0.0010) [2023-12-26 11:32:08,256][123090] Updated weights for policy 1, policy_version 1485610 (0.0005) [2023-12-26 11:32:08,306][123090] Updated weights for policy 1, policy_version 1485620 (0.0009) [2023-12-26 11:32:08,366][123090] Updated weights for policy 1, policy_version 1485630 (0.0008) [2023-12-26 11:32:08,621][123091] Updated weights for policy 0, policy_version 1495444 (0.0008) [2023-12-26 11:32:08,690][123091] Updated weights for policy 0, policy_version 1495454 (0.0007) [2023-12-26 11:32:08,755][123091] Updated weights for policy 0, policy_version 1495464 (0.0008) [2023-12-26 11:32:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 763158528. Throughput: 0: 9063.4, 1: 8972.7. Samples: 763136416. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:08,785][121949] Avg episode reward: [(0, '6322.158'), (1, '5760.121')] [2023-12-26 11:32:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001485632_380321792.pth... [2023-12-26 11:32:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001484576_380051456.pth [2023-12-26 11:32:08,812][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001495472_382844928.pth... [2023-12-26 11:32:08,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001494416_382574592.pth [2023-12-26 11:32:09,185][123090] Updated weights for policy 1, policy_version 1485640 (0.0006) [2023-12-26 11:32:09,248][123090] Updated weights for policy 1, policy_version 1485650 (0.0006) [2023-12-26 11:32:09,317][123090] Updated weights for policy 1, policy_version 1485660 (0.0010) [2023-12-26 11:32:09,440][123091] Updated weights for policy 0, policy_version 1495474 (0.0009) [2023-12-26 11:32:09,497][123091] Updated weights for policy 0, policy_version 1495484 (0.0009) [2023-12-26 11:32:09,563][123091] Updated weights for policy 0, policy_version 1495494 (0.0010) [2023-12-26 11:32:09,619][123091] Updated weights for policy 0, policy_version 1495504 (0.0009) [2023-12-26 11:32:10,155][123090] Updated weights for policy 1, policy_version 1485670 (0.0007) [2023-12-26 11:32:10,222][123090] Updated weights for policy 1, policy_version 1485680 (0.0007) [2023-12-26 11:32:10,287][123090] Updated weights for policy 1, policy_version 1485690 (0.0006) [2023-12-26 11:32:10,511][123091] Updated weights for policy 0, policy_version 1495514 (0.0009) [2023-12-26 11:32:10,562][123091] Updated weights for policy 0, policy_version 1495524 (0.0009) [2023-12-26 11:32:10,625][123091] Updated weights for policy 0, policy_version 1495534 (0.0007) [2023-12-26 11:32:11,054][123090] Updated weights for policy 1, policy_version 1485700 (0.0008) [2023-12-26 11:32:11,104][123090] Updated weights for policy 1, policy_version 1485710 (0.0010) [2023-12-26 11:32:11,171][123090] Updated weights for policy 1, policy_version 1485720 (0.0010) [2023-12-26 11:32:11,489][123091] Updated weights for policy 0, policy_version 1495544 (0.0008) [2023-12-26 11:32:11,554][123091] Updated weights for policy 0, policy_version 1495554 (0.0010) [2023-12-26 11:32:11,618][123091] Updated weights for policy 0, policy_version 1495564 (0.0010) [2023-12-26 11:32:12,061][123090] Updated weights for policy 1, policy_version 1485730 (0.0010) [2023-12-26 11:32:12,128][123090] Updated weights for policy 1, policy_version 1485740 (0.0010) [2023-12-26 11:32:12,185][123090] Updated weights for policy 1, policy_version 1485750 (0.0010) [2023-12-26 11:32:12,245][123090] Updated weights for policy 1, policy_version 1485760 (0.0009) [2023-12-26 11:32:12,468][123091] Updated weights for policy 0, policy_version 1495574 (0.0009) [2023-12-26 11:32:12,535][123091] Updated weights for policy 0, policy_version 1495584 (0.0009) [2023-12-26 11:32:12,622][123091] Updated weights for policy 0, policy_version 1495594 (0.0009) [2023-12-26 11:32:13,088][123090] Updated weights for policy 1, policy_version 1485770 (0.0009) [2023-12-26 11:32:13,146][123090] Updated weights for policy 1, policy_version 1485780 (0.0010) [2023-12-26 11:32:13,201][123090] Updated weights for policy 1, policy_version 1485792 (0.0010) [2023-12-26 11:32:13,398][123091] Updated weights for policy 0, policy_version 1495604 (0.0008) [2023-12-26 11:32:13,460][123091] Updated weights for policy 0, policy_version 1495614 (0.0005) [2023-12-26 11:32:13,514][123091] Updated weights for policy 0, policy_version 1495624 (0.0009) [2023-12-26 11:32:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 763248640. Throughput: 0: 8986.8, 1: 9003.6. Samples: 763241324. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:13,785][121949] Avg episode reward: [(0, '6277.333'), (1, '5642.545')] [2023-12-26 11:32:14,144][123090] Updated weights for policy 1, policy_version 1485802 (0.0010) [2023-12-26 11:32:14,195][123090] Updated weights for policy 1, policy_version 1485812 (0.0010) [2023-12-26 11:32:14,198][123091] Updated weights for policy 0, policy_version 1495634 (0.0008) [2023-12-26 11:32:14,256][123090] Updated weights for policy 1, policy_version 1485822 (0.0009) [2023-12-26 11:32:14,258][123091] Updated weights for policy 0, policy_version 1495644 (0.0006) [2023-12-26 11:32:14,313][123091] Updated weights for policy 0, policy_version 1495654 (0.0009) [2023-12-26 11:32:14,373][123091] Updated weights for policy 0, policy_version 1495664 (0.0010) [2023-12-26 11:32:15,137][123090] Updated weights for policy 1, policy_version 1485832 (0.0009) [2023-12-26 11:32:15,205][123091] Updated weights for policy 0, policy_version 1495674 (0.0006) [2023-12-26 11:32:15,208][123090] Updated weights for policy 1, policy_version 1485842 (0.0008) [2023-12-26 11:32:15,274][123091] Updated weights for policy 0, policy_version 1495684 (0.0006) [2023-12-26 11:32:15,276][123090] Updated weights for policy 1, policy_version 1485852 (0.0006) [2023-12-26 11:32:15,362][123091] Updated weights for policy 0, policy_version 1495694 (0.0006) [2023-12-26 11:32:16,065][123090] Updated weights for policy 1, policy_version 1485862 (0.0008) [2023-12-26 11:32:16,085][123091] Updated weights for policy 0, policy_version 1495704 (0.0008) [2023-12-26 11:32:16,128][123090] Updated weights for policy 1, policy_version 1485872 (0.0008) [2023-12-26 11:32:16,143][123091] Updated weights for policy 0, policy_version 1495714 (0.0008) [2023-12-26 11:32:16,189][123090] Updated weights for policy 1, policy_version 1485882 (0.0007) [2023-12-26 11:32:16,201][123091] Updated weights for policy 0, policy_version 1495724 (0.0009) [2023-12-26 11:32:17,013][123090] Updated weights for policy 1, policy_version 1485892 (0.0010) [2023-12-26 11:32:17,037][123091] Updated weights for policy 0, policy_version 1495734 (0.0008) [2023-12-26 11:32:17,073][123090] Updated weights for policy 1, policy_version 1485902 (0.0008) [2023-12-26 11:32:17,093][123091] Updated weights for policy 0, policy_version 1495744 (0.0007) [2023-12-26 11:32:17,132][123090] Updated weights for policy 1, policy_version 1485912 (0.0008) [2023-12-26 11:32:17,141][123091] Updated weights for policy 0, policy_version 1495754 (0.0007) [2023-12-26 11:32:17,851][123091] Updated weights for policy 0, policy_version 1495764 (0.0006) [2023-12-26 11:32:17,920][123091] Updated weights for policy 0, policy_version 1495774 (0.0005) [2023-12-26 11:32:17,939][123090] Updated weights for policy 1, policy_version 1485922 (0.0008) [2023-12-26 11:32:17,978][123091] Updated weights for policy 0, policy_version 1495784 (0.0009) [2023-12-26 11:32:17,993][123090] Updated weights for policy 1, policy_version 1485932 (0.0005) [2023-12-26 11:32:18,048][123090] Updated weights for policy 1, policy_version 1485942 (0.0005) [2023-12-26 11:32:18,105][123090] Updated weights for policy 1, policy_version 1485952 (0.0006) [2023-12-26 11:32:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 763330560. Throughput: 0: 8987.8, 1: 8863.1. Samples: 763347392. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:18,785][121949] Avg episode reward: [(0, '6162.089'), (1, '5366.209')] [2023-12-26 11:32:18,789][123091] Updated weights for policy 0, policy_version 1495794 (0.0010) [2023-12-26 11:32:18,858][123091] Updated weights for policy 0, policy_version 1495804 (0.0009) [2023-12-26 11:32:18,889][123090] Updated weights for policy 1, policy_version 1485962 (0.0007) [2023-12-26 11:32:18,917][123091] Updated weights for policy 0, policy_version 1495814 (0.0007) [2023-12-26 11:32:18,944][123090] Updated weights for policy 1, policy_version 1485972 (0.0009) [2023-12-26 11:32:18,981][123091] Updated weights for policy 0, policy_version 1495824 (0.0009) [2023-12-26 11:32:19,003][123090] Updated weights for policy 1, policy_version 1485982 (0.0008) [2023-12-26 11:32:19,766][123091] Updated weights for policy 0, policy_version 1495834 (0.0009) [2023-12-26 11:32:19,841][123091] Updated weights for policy 0, policy_version 1495844 (0.0008) [2023-12-26 11:32:19,856][123090] Updated weights for policy 1, policy_version 1485992 (0.0008) [2023-12-26 11:32:19,907][123091] Updated weights for policy 0, policy_version 1495854 (0.0006) [2023-12-26 11:32:19,925][123090] Updated weights for policy 1, policy_version 1486002 (0.0008) [2023-12-26 11:32:19,991][123090] Updated weights for policy 1, policy_version 1486012 (0.0010) [2023-12-26 11:32:20,697][123091] Updated weights for policy 0, policy_version 1495864 (0.0009) [2023-12-26 11:32:20,751][123091] Updated weights for policy 0, policy_version 1495874 (0.0010) [2023-12-26 11:32:20,827][123091] Updated weights for policy 0, policy_version 1495884 (0.0008) [2023-12-26 11:32:20,842][123090] Updated weights for policy 1, policy_version 1486022 (0.0010) [2023-12-26 11:32:20,903][123090] Updated weights for policy 1, policy_version 1486032 (0.0008) [2023-12-26 11:32:20,967][123090] Updated weights for policy 1, policy_version 1486042 (0.0008) [2023-12-26 11:32:21,653][123091] Updated weights for policy 0, policy_version 1495894 (0.0009) [2023-12-26 11:32:21,718][123091] Updated weights for policy 0, policy_version 1495904 (0.0006) [2023-12-26 11:32:21,790][123091] Updated weights for policy 0, policy_version 1495914 (0.0009) [2023-12-26 11:32:21,850][123090] Updated weights for policy 1, policy_version 1486052 (0.0009) [2023-12-26 11:32:21,903][123090] Updated weights for policy 1, policy_version 1486062 (0.0008) [2023-12-26 11:32:21,959][123090] Updated weights for policy 1, policy_version 1486072 (0.0008) [2023-12-26 11:32:22,677][123091] Updated weights for policy 0, policy_version 1495924 (0.0009) [2023-12-26 11:32:22,737][123091] Updated weights for policy 0, policy_version 1495934 (0.0009) [2023-12-26 11:32:22,745][123090] Updated weights for policy 1, policy_version 1486082 (0.0008) [2023-12-26 11:32:22,803][123091] Updated weights for policy 0, policy_version 1495944 (0.0007) [2023-12-26 11:32:22,809][123090] Updated weights for policy 1, policy_version 1486092 (0.0008) [2023-12-26 11:32:22,872][123090] Updated weights for policy 1, policy_version 1486102 (0.0008) [2023-12-26 11:32:22,937][123090] Updated weights for policy 1, policy_version 1486112 (0.0009) [2023-12-26 11:32:23,657][123091] Updated weights for policy 0, policy_version 1495954 (0.0009) [2023-12-26 11:32:23,687][123090] Updated weights for policy 1, policy_version 1486122 (0.0008) [2023-12-26 11:32:23,723][123091] Updated weights for policy 0, policy_version 1495964 (0.0009) [2023-12-26 11:32:23,745][123090] Updated weights for policy 1, policy_version 1486132 (0.0009) [2023-12-26 11:32:23,775][123091] Updated weights for policy 0, policy_version 1495974 (0.0007) [2023-12-26 11:32:23,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 763412480. Throughput: 0: 8922.6, 1: 8841.6. Samples: 763398068. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:23,785][121949] Avg episode reward: [(0, '6138.882'), (1, '5295.422')] [2023-12-26 11:32:23,799][123090] Updated weights for policy 1, policy_version 1486142 (0.0009) [2023-12-26 11:32:23,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001486144_380452864.pth... [2023-12-26 11:32:23,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001485088_380182528.pth [2023-12-26 11:32:23,823][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001495984_382976000.pth... [2023-12-26 11:32:23,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001494928_382705664.pth [2023-12-26 11:32:23,827][123091] Updated weights for policy 0, policy_version 1495984 (0.0006) [2023-12-26 11:32:24,641][123091] Updated weights for policy 0, policy_version 1495994 (0.0007) [2023-12-26 11:32:24,650][123090] Updated weights for policy 1, policy_version 1486152 (0.0009) [2023-12-26 11:32:24,693][123091] Updated weights for policy 0, policy_version 1496004 (0.0008) [2023-12-26 11:32:24,700][123090] Updated weights for policy 1, policy_version 1486162 (0.0007) [2023-12-26 11:32:24,738][123091] Updated weights for policy 0, policy_version 1496014 (0.0006) [2023-12-26 11:32:24,745][123090] Updated weights for policy 1, policy_version 1486172 (0.0008) [2023-12-26 11:32:25,564][123091] Updated weights for policy 0, policy_version 1496024 (0.0009) [2023-12-26 11:32:25,566][123090] Updated weights for policy 1, policy_version 1486182 (0.0007) [2023-12-26 11:32:25,616][123091] Updated weights for policy 0, policy_version 1496034 (0.0006) [2023-12-26 11:32:25,629][123090] Updated weights for policy 1, policy_version 1486192 (0.0010) [2023-12-26 11:32:25,666][123091] Updated weights for policy 0, policy_version 1496044 (0.0010) [2023-12-26 11:32:25,687][123090] Updated weights for policy 1, policy_version 1486202 (0.0007) [2023-12-26 11:32:26,403][123091] Updated weights for policy 0, policy_version 1496054 (0.0010) [2023-12-26 11:32:26,459][123091] Updated weights for policy 0, policy_version 1496064 (0.0009) [2023-12-26 11:32:26,507][123091] Updated weights for policy 0, policy_version 1496074 (0.0009) [2023-12-26 11:32:26,547][123090] Updated weights for policy 1, policy_version 1486212 (0.0009) [2023-12-26 11:32:26,593][123090] Updated weights for policy 1, policy_version 1486222 (0.0008) [2023-12-26 11:32:26,648][123090] Updated weights for policy 1, policy_version 1486234 (0.0011) [2023-12-26 11:32:27,370][123091] Updated weights for policy 0, policy_version 1496084 (0.0010) [2023-12-26 11:32:27,403][123090] Updated weights for policy 1, policy_version 1486244 (0.0009) [2023-12-26 11:32:27,436][123091] Updated weights for policy 0, policy_version 1496094 (0.0010) [2023-12-26 11:32:27,455][123090] Updated weights for policy 1, policy_version 1486254 (0.0006) [2023-12-26 11:32:27,490][123091] Updated weights for policy 0, policy_version 1496104 (0.0010) [2023-12-26 11:32:27,507][123090] Updated weights for policy 1, policy_version 1486264 (0.0009) [2023-12-26 11:32:28,235][123091] Updated weights for policy 0, policy_version 1496114 (0.0010) [2023-12-26 11:32:28,299][123091] Updated weights for policy 0, policy_version 1496124 (0.0010) [2023-12-26 11:32:28,363][123091] Updated weights for policy 0, policy_version 1496134 (0.0009) [2023-12-26 11:32:28,381][123090] Updated weights for policy 1, policy_version 1486274 (0.0008) [2023-12-26 11:32:28,422][123091] Updated weights for policy 0, policy_version 1496144 (0.0009) [2023-12-26 11:32:28,446][123090] Updated weights for policy 1, policy_version 1486284 (0.0009) [2023-12-26 11:32:28,511][123090] Updated weights for policy 1, policy_version 1486294 (0.0009) [2023-12-26 11:32:28,576][123090] Updated weights for policy 1, policy_version 1486304 (0.0010) [2023-12-26 11:32:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17800.2). Total num frames: 763510784. Throughput: 0: 8839.1, 1: 8909.2. Samples: 763501948. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:28,785][121949] Avg episode reward: [(0, '6274.521'), (1, '5452.467')] [2023-12-26 11:32:29,161][123091] Updated weights for policy 0, policy_version 1496154 (0.0008) [2023-12-26 11:32:29,212][123091] Updated weights for policy 0, policy_version 1496164 (0.0010) [2023-12-26 11:32:29,279][123091] Updated weights for policy 0, policy_version 1496174 (0.0010) [2023-12-26 11:32:29,416][123090] Updated weights for policy 1, policy_version 1486314 (0.0008) [2023-12-26 11:32:29,466][123090] Updated weights for policy 1, policy_version 1486324 (0.0009) [2023-12-26 11:32:29,529][123090] Updated weights for policy 1, policy_version 1486334 (0.0009) [2023-12-26 11:32:30,075][123091] Updated weights for policy 0, policy_version 1496184 (0.0009) [2023-12-26 11:32:30,134][123091] Updated weights for policy 0, policy_version 1496194 (0.0008) [2023-12-26 11:32:30,187][123091] Updated weights for policy 0, policy_version 1496204 (0.0010) [2023-12-26 11:32:30,357][123090] Updated weights for policy 1, policy_version 1486344 (0.0007) [2023-12-26 11:32:30,418][123090] Updated weights for policy 1, policy_version 1486354 (0.0007) [2023-12-26 11:32:30,467][123090] Updated weights for policy 1, policy_version 1486364 (0.0009) [2023-12-26 11:32:31,026][123091] Updated weights for policy 0, policy_version 1496214 (0.0010) [2023-12-26 11:32:31,095][123091] Updated weights for policy 0, policy_version 1496225 (0.0010) [2023-12-26 11:32:31,158][123091] Updated weights for policy 0, policy_version 1496235 (0.0009) [2023-12-26 11:32:31,172][123090] Updated weights for policy 1, policy_version 1486374 (0.0009) [2023-12-26 11:32:31,235][123090] Updated weights for policy 1, policy_version 1486384 (0.0010) [2023-12-26 11:32:31,304][123090] Updated weights for policy 1, policy_version 1486394 (0.0010) [2023-12-26 11:32:31,920][123091] Updated weights for policy 0, policy_version 1496245 (0.0007) [2023-12-26 11:32:31,979][123091] Updated weights for policy 0, policy_version 1496255 (0.0005) [2023-12-26 11:32:32,039][123091] Updated weights for policy 0, policy_version 1496265 (0.0007) [2023-12-26 11:32:32,132][123090] Updated weights for policy 1, policy_version 1486404 (0.0009) [2023-12-26 11:32:32,187][123090] Updated weights for policy 1, policy_version 1486414 (0.0009) [2023-12-26 11:32:32,238][123090] Updated weights for policy 1, policy_version 1486424 (0.0008) [2023-12-26 11:32:32,839][123091] Updated weights for policy 0, policy_version 1496275 (0.0010) [2023-12-26 11:32:32,887][123091] Updated weights for policy 0, policy_version 1496286 (0.0008) [2023-12-26 11:32:32,933][123091] Updated weights for policy 0, policy_version 1496296 (0.0005) [2023-12-26 11:32:33,044][123090] Updated weights for policy 1, policy_version 1486434 (0.0010) [2023-12-26 11:32:33,097][123090] Updated weights for policy 1, policy_version 1486444 (0.0010) [2023-12-26 11:32:33,149][123090] Updated weights for policy 1, policy_version 1486455 (0.0009) [2023-12-26 11:32:33,729][123091] Updated weights for policy 0, policy_version 1496306 (0.0006) [2023-12-26 11:32:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 763592704. Throughput: 0: 8808.1, 1: 8866.6. Samples: 763608080. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:33,785][121949] Avg episode reward: [(0, '6289.688'), (1, '5393.903')] [2023-12-26 11:32:33,792][123091] Updated weights for policy 0, policy_version 1496316 (0.0009) [2023-12-26 11:32:33,852][123091] Updated weights for policy 0, policy_version 1496326 (0.0005) [2023-12-26 11:32:33,914][123091] Updated weights for policy 0, policy_version 1496336 (0.0005) [2023-12-26 11:32:33,999][123090] Updated weights for policy 1, policy_version 1486465 (0.0009) [2023-12-26 11:32:34,059][123090] Updated weights for policy 1, policy_version 1486476 (0.0011) [2023-12-26 11:32:34,116][123090] Updated weights for policy 1, policy_version 1486486 (0.0010) [2023-12-26 11:32:34,182][123090] Updated weights for policy 1, policy_version 1486496 (0.0008) [2023-12-26 11:32:34,642][123091] Updated weights for policy 0, policy_version 1496346 (0.0010) [2023-12-26 11:32:34,706][123091] Updated weights for policy 0, policy_version 1496356 (0.0010) [2023-12-26 11:32:34,769][123091] Updated weights for policy 0, policy_version 1496366 (0.0009) [2023-12-26 11:32:35,053][123090] Updated weights for policy 1, policy_version 1486506 (0.0005) [2023-12-26 11:32:35,110][123090] Updated weights for policy 1, policy_version 1486516 (0.0005) [2023-12-26 11:32:35,170][123090] Updated weights for policy 1, policy_version 1486526 (0.0006) [2023-12-26 11:32:35,623][123091] Updated weights for policy 0, policy_version 1496376 (0.0006) [2023-12-26 11:32:35,672][123091] Updated weights for policy 0, policy_version 1496386 (0.0006) [2023-12-26 11:32:35,727][123091] Updated weights for policy 0, policy_version 1496396 (0.0006) [2023-12-26 11:32:35,969][123090] Updated weights for policy 1, policy_version 1486536 (0.0006) [2023-12-26 11:32:36,016][123090] Updated weights for policy 1, policy_version 1486546 (0.0005) [2023-12-26 11:32:36,066][123090] Updated weights for policy 1, policy_version 1486556 (0.0006) [2023-12-26 11:32:36,563][123091] Updated weights for policy 0, policy_version 1496406 (0.0009) [2023-12-26 11:32:36,631][123091] Updated weights for policy 0, policy_version 1496416 (0.0006) [2023-12-26 11:32:36,691][123091] Updated weights for policy 0, policy_version 1496426 (0.0006) [2023-12-26 11:32:36,894][123090] Updated weights for policy 1, policy_version 1486566 (0.0010) [2023-12-26 11:32:36,960][123090] Updated weights for policy 1, policy_version 1486576 (0.0010) [2023-12-26 11:32:37,011][123090] Updated weights for policy 1, policy_version 1486586 (0.0010) [2023-12-26 11:32:37,482][123091] Updated weights for policy 0, policy_version 1496436 (0.0006) [2023-12-26 11:32:37,550][123091] Updated weights for policy 0, policy_version 1496446 (0.0006) [2023-12-26 11:32:37,616][123091] Updated weights for policy 0, policy_version 1496457 (0.0009) [2023-12-26 11:32:37,811][123090] Updated weights for policy 1, policy_version 1486596 (0.0009) [2023-12-26 11:32:37,876][123090] Updated weights for policy 1, policy_version 1486606 (0.0008) [2023-12-26 11:32:37,947][123090] Updated weights for policy 1, policy_version 1486616 (0.0005) [2023-12-26 11:32:38,328][123091] Updated weights for policy 0, policy_version 1496467 (0.0010) [2023-12-26 11:32:38,390][123091] Updated weights for policy 0, policy_version 1496477 (0.0011) [2023-12-26 11:32:38,459][123091] Updated weights for policy 0, policy_version 1496487 (0.0009) [2023-12-26 11:32:38,747][123090] Updated weights for policy 1, policy_version 1486626 (0.0008) [2023-12-26 11:32:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 763682816. Throughput: 0: 8826.2, 1: 8841.2. Samples: 763660412. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:38,785][121949] Avg episode reward: [(0, '6320.482'), (1, '5557.957')] [2023-12-26 11:32:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001496496_383107072.pth... [2023-12-26 11:32:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001495472_382844928.pth [2023-12-26 11:32:38,807][123090] Updated weights for policy 1, policy_version 1486636 (0.0009) [2023-12-26 11:32:38,860][123090] Updated weights for policy 1, policy_version 1486646 (0.0009) [2023-12-26 11:32:38,906][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001486656_380583936.pth... [2023-12-26 11:32:38,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001485632_380321792.pth [2023-12-26 11:32:38,910][123090] Updated weights for policy 1, policy_version 1486656 (0.0009) [2023-12-26 11:32:39,288][123091] Updated weights for policy 0, policy_version 1496497 (0.0010) [2023-12-26 11:32:39,349][123091] Updated weights for policy 0, policy_version 1496507 (0.0009) [2023-12-26 11:32:39,428][123091] Updated weights for policy 0, policy_version 1496517 (0.0011) [2023-12-26 11:32:39,492][123091] Updated weights for policy 0, policy_version 1496527 (0.0009) [2023-12-26 11:32:39,773][123090] Updated weights for policy 1, policy_version 1486666 (0.0007) [2023-12-26 11:32:39,849][123090] Updated weights for policy 1, policy_version 1486676 (0.0007) [2023-12-26 11:32:39,923][123090] Updated weights for policy 1, policy_version 1486686 (0.0009) [2023-12-26 11:32:40,374][123091] Updated weights for policy 0, policy_version 1496537 (0.0010) [2023-12-26 11:32:40,437][123091] Updated weights for policy 0, policy_version 1496547 (0.0010) [2023-12-26 11:32:40,498][123091] Updated weights for policy 0, policy_version 1496557 (0.0009) [2023-12-26 11:32:40,719][123090] Updated weights for policy 1, policy_version 1486696 (0.0009) [2023-12-26 11:32:40,781][123090] Updated weights for policy 1, policy_version 1486707 (0.0008) [2023-12-26 11:32:40,857][123090] Updated weights for policy 1, policy_version 1486717 (0.0010) [2023-12-26 11:32:41,386][123091] Updated weights for policy 0, policy_version 1496567 (0.0010) [2023-12-26 11:32:41,450][123091] Updated weights for policy 0, policy_version 1496577 (0.0009) [2023-12-26 11:32:41,511][123091] Updated weights for policy 0, policy_version 1496587 (0.0009) [2023-12-26 11:32:41,675][123090] Updated weights for policy 1, policy_version 1486727 (0.0007) [2023-12-26 11:32:41,757][123090] Updated weights for policy 1, policy_version 1486737 (0.0011) [2023-12-26 11:32:41,822][123090] Updated weights for policy 1, policy_version 1486747 (0.0010) [2023-12-26 11:32:42,302][123091] Updated weights for policy 0, policy_version 1496597 (0.0009) [2023-12-26 11:32:42,372][123091] Updated weights for policy 0, policy_version 1496607 (0.0008) [2023-12-26 11:32:42,437][123091] Updated weights for policy 0, policy_version 1496617 (0.0008) [2023-12-26 11:32:42,606][123090] Updated weights for policy 1, policy_version 1486757 (0.0010) [2023-12-26 11:32:42,671][123090] Updated weights for policy 1, policy_version 1486767 (0.0007) [2023-12-26 11:32:42,738][123090] Updated weights for policy 1, policy_version 1486777 (0.0005) [2023-12-26 11:32:43,273][123091] Updated weights for policy 0, policy_version 1496627 (0.0009) [2023-12-26 11:32:43,332][123091] Updated weights for policy 0, policy_version 1496637 (0.0008) [2023-12-26 11:32:43,347][123090] Updated weights for policy 1, policy_version 1486787 (0.0009) [2023-12-26 11:32:43,380][123091] Updated weights for policy 0, policy_version 1496647 (0.0006) [2023-12-26 11:32:43,398][123090] Updated weights for policy 1, policy_version 1486797 (0.0010) [2023-12-26 11:32:43,446][123090] Updated weights for policy 1, policy_version 1486807 (0.0010) [2023-12-26 11:32:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 763772928. Throughput: 0: 8776.9, 1: 8770.0. Samples: 763763572. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:43,785][121949] Avg episode reward: [(0, '6325.470'), (1, '5692.281')] [2023-12-26 11:32:44,222][123091] Updated weights for policy 0, policy_version 1496657 (0.0008) [2023-12-26 11:32:44,281][123091] Updated weights for policy 0, policy_version 1496667 (0.0008) [2023-12-26 11:32:44,289][123090] Updated weights for policy 1, policy_version 1486817 (0.0010) [2023-12-26 11:32:44,330][123091] Updated weights for policy 0, policy_version 1496677 (0.0007) [2023-12-26 11:32:44,349][123090] Updated weights for policy 1, policy_version 1486827 (0.0010) [2023-12-26 11:32:44,389][123091] Updated weights for policy 0, policy_version 1496687 (0.0008) [2023-12-26 11:32:44,419][123090] Updated weights for policy 1, policy_version 1486837 (0.0009) [2023-12-26 11:32:44,485][123090] Updated weights for policy 1, policy_version 1486847 (0.0010) [2023-12-26 11:32:45,183][123091] Updated weights for policy 0, policy_version 1496697 (0.0009) [2023-12-26 11:32:45,231][123090] Updated weights for policy 1, policy_version 1486857 (0.0010) [2023-12-26 11:32:45,243][123091] Updated weights for policy 0, policy_version 1496707 (0.0008) [2023-12-26 11:32:45,291][123090] Updated weights for policy 1, policy_version 1486867 (0.0011) [2023-12-26 11:32:45,295][123091] Updated weights for policy 0, policy_version 1496717 (0.0009) [2023-12-26 11:32:45,351][123090] Updated weights for policy 1, policy_version 1486877 (0.0011) [2023-12-26 11:32:46,095][123091] Updated weights for policy 0, policy_version 1496727 (0.0011) [2023-12-26 11:32:46,143][123090] Updated weights for policy 1, policy_version 1486887 (0.0007) [2023-12-26 11:32:46,149][123091] Updated weights for policy 0, policy_version 1496737 (0.0011) [2023-12-26 11:32:46,202][123090] Updated weights for policy 1, policy_version 1486897 (0.0006) [2023-12-26 11:32:46,209][123091] Updated weights for policy 0, policy_version 1496747 (0.0011) [2023-12-26 11:32:46,253][123090] Updated weights for policy 1, policy_version 1486907 (0.0008) [2023-12-26 11:32:47,003][123091] Updated weights for policy 0, policy_version 1496757 (0.0010) [2023-12-26 11:32:47,052][123091] Updated weights for policy 0, policy_version 1496767 (0.0005) [2023-12-26 11:32:47,115][123091] Updated weights for policy 0, policy_version 1496777 (0.0006) [2023-12-26 11:32:47,159][123090] Updated weights for policy 1, policy_version 1486917 (0.0009) [2023-12-26 11:32:47,229][123090] Updated weights for policy 1, policy_version 1486927 (0.0008) [2023-12-26 11:32:47,302][123090] Updated weights for policy 1, policy_version 1486937 (0.0009) [2023-12-26 11:32:47,749][123091] Updated weights for policy 0, policy_version 1496787 (0.0006) [2023-12-26 11:32:47,820][123091] Updated weights for policy 0, policy_version 1496797 (0.0006) [2023-12-26 11:32:47,880][123091] Updated weights for policy 0, policy_version 1496807 (0.0006) [2023-12-26 11:32:48,054][123090] Updated weights for policy 1, policy_version 1486947 (0.0008) [2023-12-26 11:32:48,109][123090] Updated weights for policy 1, policy_version 1486958 (0.0010) [2023-12-26 11:32:48,168][123090] Updated weights for policy 1, policy_version 1486968 (0.0010) [2023-12-26 11:32:48,606][123091] Updated weights for policy 0, policy_version 1496817 (0.0009) [2023-12-26 11:32:48,667][123091] Updated weights for policy 0, policy_version 1496827 (0.0009) [2023-12-26 11:32:48,728][123091] Updated weights for policy 0, policy_version 1496837 (0.0010) [2023-12-26 11:32:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 763854848. Throughput: 0: 8794.6, 1: 8760.1. Samples: 763871268. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:48,785][121949] Avg episode reward: [(0, '6113.902'), (1, '5552.789')] [2023-12-26 11:32:48,790][123091] Updated weights for policy 0, policy_version 1496847 (0.0009) [2023-12-26 11:32:49,058][123090] Updated weights for policy 1, policy_version 1486978 (0.0010) [2023-12-26 11:32:49,118][123090] Updated weights for policy 1, policy_version 1486988 (0.0009) [2023-12-26 11:32:49,178][123090] Updated weights for policy 1, policy_version 1486998 (0.0009) [2023-12-26 11:32:49,246][123090] Updated weights for policy 1, policy_version 1487008 (0.0010) [2023-12-26 11:32:49,572][123091] Updated weights for policy 0, policy_version 1496857 (0.0009) [2023-12-26 11:32:49,625][123091] Updated weights for policy 0, policy_version 1496867 (0.0009) [2023-12-26 11:32:49,674][123091] Updated weights for policy 0, policy_version 1496877 (0.0009) [2023-12-26 11:32:50,086][123090] Updated weights for policy 1, policy_version 1487018 (0.0011) [2023-12-26 11:32:50,138][123090] Updated weights for policy 1, policy_version 1487028 (0.0010) [2023-12-26 11:32:50,206][123090] Updated weights for policy 1, policy_version 1487038 (0.0010) [2023-12-26 11:32:50,552][123091] Updated weights for policy 0, policy_version 1496887 (0.0007) [2023-12-26 11:32:50,622][123091] Updated weights for policy 0, policy_version 1496897 (0.0007) [2023-12-26 11:32:50,683][123091] Updated weights for policy 0, policy_version 1496907 (0.0006) [2023-12-26 11:32:51,011][123090] Updated weights for policy 1, policy_version 1487048 (0.0009) [2023-12-26 11:32:51,081][123090] Updated weights for policy 1, policy_version 1487058 (0.0009) [2023-12-26 11:32:51,137][123090] Updated weights for policy 1, policy_version 1487068 (0.0008) [2023-12-26 11:32:51,488][123091] Updated weights for policy 0, policy_version 1496917 (0.0008) [2023-12-26 11:32:51,554][123091] Updated weights for policy 0, policy_version 1496927 (0.0009) [2023-12-26 11:32:51,621][123091] Updated weights for policy 0, policy_version 1496937 (0.0006) [2023-12-26 11:32:52,026][123090] Updated weights for policy 1, policy_version 1487078 (0.0009) [2023-12-26 11:32:52,082][123090] Updated weights for policy 1, policy_version 1487088 (0.0009) [2023-12-26 11:32:52,134][123090] Updated weights for policy 1, policy_version 1487098 (0.0008) [2023-12-26 11:32:52,448][123091] Updated weights for policy 0, policy_version 1496947 (0.0009) [2023-12-26 11:32:52,512][123091] Updated weights for policy 0, policy_version 1496957 (0.0011) [2023-12-26 11:32:52,576][123091] Updated weights for policy 0, policy_version 1496967 (0.0011) [2023-12-26 11:32:52,934][123090] Updated weights for policy 1, policy_version 1487108 (0.0009) [2023-12-26 11:32:52,983][123090] Updated weights for policy 1, policy_version 1487118 (0.0010) [2023-12-26 11:32:53,035][123090] Updated weights for policy 1, policy_version 1487128 (0.0006) [2023-12-26 11:32:53,377][123091] Updated weights for policy 0, policy_version 1496977 (0.0011) [2023-12-26 11:32:53,428][123091] Updated weights for policy 0, policy_version 1496987 (0.0010) [2023-12-26 11:32:53,490][123091] Updated weights for policy 0, policy_version 1496997 (0.0010) [2023-12-26 11:32:53,549][123091] Updated weights for policy 0, policy_version 1497007 (0.0010) [2023-12-26 11:32:53,780][123090] Updated weights for policy 1, policy_version 1487138 (0.0005) [2023-12-26 11:32:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 763944960. Throughput: 0: 8792.1, 1: 8669.6. Samples: 763922192. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:53,785][121949] Avg episode reward: [(0, '6047.068'), (1, '5477.928')] [2023-12-26 11:32:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001497008_383238144.pth... [2023-12-26 11:32:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001495984_382976000.pth [2023-12-26 11:32:53,840][123090] Updated weights for policy 1, policy_version 1487148 (0.0006) [2023-12-26 11:32:53,893][123090] Updated weights for policy 1, policy_version 1487158 (0.0005) [2023-12-26 11:32:53,944][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001487168_380715008.pth... [2023-12-26 11:32:53,946][123090] Updated weights for policy 1, policy_version 1487168 (0.0005) [2023-12-26 11:32:53,947][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001486144_380452864.pth [2023-12-26 11:32:54,349][123091] Updated weights for policy 0, policy_version 1497017 (0.0010) [2023-12-26 11:32:54,416][123091] Updated weights for policy 0, policy_version 1497027 (0.0010) [2023-12-26 11:32:54,482][123091] Updated weights for policy 0, policy_version 1497037 (0.0010) [2023-12-26 11:32:54,614][123090] Updated weights for policy 1, policy_version 1487178 (0.0005) [2023-12-26 11:32:54,668][123090] Updated weights for policy 1, policy_version 1487188 (0.0005) [2023-12-26 11:32:54,725][123090] Updated weights for policy 1, policy_version 1487198 (0.0009) [2023-12-26 11:32:55,302][123091] Updated weights for policy 0, policy_version 1497047 (0.0009) [2023-12-26 11:32:55,363][123091] Updated weights for policy 0, policy_version 1497057 (0.0009) [2023-12-26 11:32:55,424][123091] Updated weights for policy 0, policy_version 1497067 (0.0009) [2023-12-26 11:32:55,542][123090] Updated weights for policy 1, policy_version 1487208 (0.0010) [2023-12-26 11:32:55,594][123090] Updated weights for policy 1, policy_version 1487218 (0.0010) [2023-12-26 11:32:55,641][123090] Updated weights for policy 1, policy_version 1487228 (0.0010) [2023-12-26 11:32:56,262][123091] Updated weights for policy 0, policy_version 1497077 (0.0010) [2023-12-26 11:32:56,324][123091] Updated weights for policy 0, policy_version 1497087 (0.0010) [2023-12-26 11:32:56,390][123091] Updated weights for policy 0, policy_version 1497097 (0.0008) [2023-12-26 11:32:56,483][123090] Updated weights for policy 1, policy_version 1487238 (0.0011) [2023-12-26 11:32:56,542][123090] Updated weights for policy 1, policy_version 1487248 (0.0010) [2023-12-26 11:32:56,597][123090] Updated weights for policy 1, policy_version 1487258 (0.0010) [2023-12-26 11:32:57,061][123091] Updated weights for policy 0, policy_version 1497107 (0.0005) [2023-12-26 11:32:57,108][123091] Updated weights for policy 0, policy_version 1497117 (0.0005) [2023-12-26 11:32:57,167][123091] Updated weights for policy 0, policy_version 1497127 (0.0005) [2023-12-26 11:32:57,436][123090] Updated weights for policy 1, policy_version 1487268 (0.0010) [2023-12-26 11:32:57,497][123090] Updated weights for policy 1, policy_version 1487278 (0.0010) [2023-12-26 11:32:57,555][123090] Updated weights for policy 1, policy_version 1487288 (0.0010) [2023-12-26 11:32:57,947][123091] Updated weights for policy 0, policy_version 1497137 (0.0010) [2023-12-26 11:32:58,002][123091] Updated weights for policy 0, policy_version 1497147 (0.0008) [2023-12-26 11:32:58,069][123091] Updated weights for policy 0, policy_version 1497157 (0.0009) [2023-12-26 11:32:58,133][123091] Updated weights for policy 0, policy_version 1497167 (0.0010) [2023-12-26 11:32:58,326][123090] Updated weights for policy 1, policy_version 1487298 (0.0010) [2023-12-26 11:32:58,404][123090] Updated weights for policy 1, policy_version 1487309 (0.0009) [2023-12-26 11:32:58,469][123090] Updated weights for policy 1, policy_version 1487319 (0.0009) [2023-12-26 11:32:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 764035072. Throughput: 0: 8823.4, 1: 8690.5. Samples: 764029448. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:32:58,785][121949] Avg episode reward: [(0, '6186.447'), (1, '5418.033')] [2023-12-26 11:32:58,932][123091] Updated weights for policy 0, policy_version 1497177 (0.0006) [2023-12-26 11:32:58,980][123091] Updated weights for policy 0, policy_version 1497187 (0.0005) [2023-12-26 11:32:59,044][123091] Updated weights for policy 0, policy_version 1497197 (0.0006) [2023-12-26 11:32:59,278][123090] Updated weights for policy 1, policy_version 1487329 (0.0009) [2023-12-26 11:32:59,335][123090] Updated weights for policy 1, policy_version 1487339 (0.0010) [2023-12-26 11:32:59,394][123090] Updated weights for policy 1, policy_version 1487349 (0.0011) [2023-12-26 11:32:59,442][123090] Updated weights for policy 1, policy_version 1487359 (0.0010) [2023-12-26 11:32:59,812][123091] Updated weights for policy 0, policy_version 1497207 (0.0008) [2023-12-26 11:32:59,881][123091] Updated weights for policy 0, policy_version 1497217 (0.0009) [2023-12-26 11:32:59,945][123091] Updated weights for policy 0, policy_version 1497227 (0.0009) [2023-12-26 11:33:00,302][123090] Updated weights for policy 1, policy_version 1487369 (0.0011) [2023-12-26 11:33:00,375][123090] Updated weights for policy 1, policy_version 1487379 (0.0010) [2023-12-26 11:33:00,441][123090] Updated weights for policy 1, policy_version 1487389 (0.0010) [2023-12-26 11:33:00,740][123091] Updated weights for policy 0, policy_version 1497237 (0.0007) [2023-12-26 11:33:00,811][123091] Updated weights for policy 0, policy_version 1497247 (0.0005) [2023-12-26 11:33:00,874][123091] Updated weights for policy 0, policy_version 1497257 (0.0005) [2023-12-26 11:33:01,262][123090] Updated weights for policy 1, policy_version 1487399 (0.0011) [2023-12-26 11:33:01,318][123090] Updated weights for policy 1, policy_version 1487409 (0.0010) [2023-12-26 11:33:01,383][123090] Updated weights for policy 1, policy_version 1487419 (0.0007) [2023-12-26 11:33:01,573][123091] Updated weights for policy 0, policy_version 1497267 (0.0007) [2023-12-26 11:33:01,633][123091] Updated weights for policy 0, policy_version 1497277 (0.0009) [2023-12-26 11:33:01,695][123091] Updated weights for policy 0, policy_version 1497287 (0.0010) [2023-12-26 11:33:02,159][123090] Updated weights for policy 1, policy_version 1487429 (0.0008) [2023-12-26 11:33:02,223][123090] Updated weights for policy 1, policy_version 1487439 (0.0009) [2023-12-26 11:33:02,291][123090] Updated weights for policy 1, policy_version 1487449 (0.0007) [2023-12-26 11:33:02,569][123091] Updated weights for policy 0, policy_version 1497297 (0.0009) [2023-12-26 11:33:02,633][123091] Updated weights for policy 0, policy_version 1497307 (0.0009) [2023-12-26 11:33:02,698][123091] Updated weights for policy 0, policy_version 1497317 (0.0009) [2023-12-26 11:33:02,762][123091] Updated weights for policy 0, policy_version 1497327 (0.0009) [2023-12-26 11:33:03,089][123090] Updated weights for policy 1, policy_version 1487459 (0.0009) [2023-12-26 11:33:03,147][123090] Updated weights for policy 1, policy_version 1487469 (0.0010) [2023-12-26 11:33:03,205][123090] Updated weights for policy 1, policy_version 1487479 (0.0007) [2023-12-26 11:33:03,421][123091] Updated weights for policy 0, policy_version 1497337 (0.0006) [2023-12-26 11:33:03,470][123091] Updated weights for policy 0, policy_version 1497347 (0.0005) [2023-12-26 11:33:03,539][123091] Updated weights for policy 0, policy_version 1497357 (0.0006) [2023-12-26 11:33:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 764125184. Throughput: 0: 8829.4, 1: 8717.4. Samples: 764137000. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:03,784][121949] Avg episode reward: [(0, '6251.364'), (1, '5554.537')] [2023-12-26 11:33:03,863][123090] Updated weights for policy 1, policy_version 1487489 (0.0006) [2023-12-26 11:33:03,922][123090] Updated weights for policy 1, policy_version 1487499 (0.0010) [2023-12-26 11:33:03,988][123090] Updated weights for policy 1, policy_version 1487509 (0.0007) [2023-12-26 11:33:04,055][123090] Updated weights for policy 1, policy_version 1487519 (0.0007) [2023-12-26 11:33:04,207][123091] Updated weights for policy 0, policy_version 1497367 (0.0006) [2023-12-26 11:33:04,280][123091] Updated weights for policy 0, policy_version 1497377 (0.0008) [2023-12-26 11:33:04,343][123091] Updated weights for policy 0, policy_version 1497387 (0.0008) [2023-12-26 11:33:04,768][123090] Updated weights for policy 1, policy_version 1487529 (0.0006) [2023-12-26 11:33:04,821][123090] Updated weights for policy 1, policy_version 1487539 (0.0009) [2023-12-26 11:33:04,877][123090] Updated weights for policy 1, policy_version 1487549 (0.0009) [2023-12-26 11:33:04,950][123091] Updated weights for policy 0, policy_version 1497397 (0.0007) [2023-12-26 11:33:04,995][123091] Updated weights for policy 0, policy_version 1497407 (0.0005) [2023-12-26 11:33:05,044][123091] Updated weights for policy 0, policy_version 1497417 (0.0008) [2023-12-26 11:33:05,711][123090] Updated weights for policy 1, policy_version 1487559 (0.0011) [2023-12-26 11:33:05,776][123090] Updated weights for policy 1, policy_version 1487569 (0.0010) [2023-12-26 11:33:05,840][123090] Updated weights for policy 1, policy_version 1487579 (0.0011) [2023-12-26 11:33:05,872][123091] Updated weights for policy 0, policy_version 1497427 (0.0008) [2023-12-26 11:33:05,937][123091] Updated weights for policy 0, policy_version 1497437 (0.0008) [2023-12-26 11:33:06,003][123091] Updated weights for policy 0, policy_version 1497447 (0.0008) [2023-12-26 11:33:06,612][123090] Updated weights for policy 1, policy_version 1487589 (0.0006) [2023-12-26 11:33:06,674][123090] Updated weights for policy 1, policy_version 1487599 (0.0006) [2023-12-26 11:33:06,749][123090] Updated weights for policy 1, policy_version 1487609 (0.0005) [2023-12-26 11:33:06,771][123091] Updated weights for policy 0, policy_version 1497457 (0.0009) [2023-12-26 11:33:06,829][123091] Updated weights for policy 0, policy_version 1497467 (0.0009) [2023-12-26 11:33:06,881][123091] Updated weights for policy 0, policy_version 1497477 (0.0009) [2023-12-26 11:33:06,933][123091] Updated weights for policy 0, policy_version 1497487 (0.0009) [2023-12-26 11:33:07,539][123090] Updated weights for policy 1, policy_version 1487619 (0.0007) [2023-12-26 11:33:07,602][123090] Updated weights for policy 1, policy_version 1487629 (0.0010) [2023-12-26 11:33:07,657][123090] Updated weights for policy 1, policy_version 1487639 (0.0009) [2023-12-26 11:33:07,695][123091] Updated weights for policy 0, policy_version 1497497 (0.0006) [2023-12-26 11:33:07,763][123091] Updated weights for policy 0, policy_version 1497507 (0.0006) [2023-12-26 11:33:07,828][123091] Updated weights for policy 0, policy_version 1497517 (0.0006) [2023-12-26 11:33:08,462][123090] Updated weights for policy 1, policy_version 1487649 (0.0009) [2023-12-26 11:33:08,528][123090] Updated weights for policy 1, policy_version 1487659 (0.0006) [2023-12-26 11:33:08,586][123090] Updated weights for policy 1, policy_version 1487669 (0.0008) [2023-12-26 11:33:08,614][123091] Updated weights for policy 0, policy_version 1497527 (0.0008) [2023-12-26 11:33:08,653][123090] Updated weights for policy 1, policy_version 1487679 (0.0008) [2023-12-26 11:33:08,678][123091] Updated weights for policy 0, policy_version 1497537 (0.0010) [2023-12-26 11:33:08,743][123091] Updated weights for policy 0, policy_version 1497547 (0.0010) [2023-12-26 11:33:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 764223488. Throughput: 0: 8893.1, 1: 8782.3. Samples: 764193464. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:08,785][121949] Avg episode reward: [(0, '6067.167'), (1, '5566.688')] [2023-12-26 11:33:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001497552_383377408.pth... [2023-12-26 11:33:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001487680_380846080.pth... [2023-12-26 11:33:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001486656_380583936.pth [2023-12-26 11:33:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001496496_383107072.pth [2023-12-26 11:33:09,418][123090] Updated weights for policy 1, policy_version 1487689 (0.0009) [2023-12-26 11:33:09,474][123090] Updated weights for policy 1, policy_version 1487699 (0.0009) [2023-12-26 11:33:09,533][123090] Updated weights for policy 1, policy_version 1487709 (0.0009) [2023-12-26 11:33:09,564][123091] Updated weights for policy 0, policy_version 1497557 (0.0007) [2023-12-26 11:33:09,629][123091] Updated weights for policy 0, policy_version 1497567 (0.0008) [2023-12-26 11:33:09,697][123091] Updated weights for policy 0, policy_version 1497577 (0.0009) [2023-12-26 11:33:10,394][123090] Updated weights for policy 1, policy_version 1487719 (0.0009) [2023-12-26 11:33:10,456][123090] Updated weights for policy 1, policy_version 1487729 (0.0011) [2023-12-26 11:33:10,519][123091] Updated weights for policy 0, policy_version 1497587 (0.0008) [2023-12-26 11:33:10,524][123090] Updated weights for policy 1, policy_version 1487739 (0.0011) [2023-12-26 11:33:10,581][123091] Updated weights for policy 0, policy_version 1497597 (0.0007) [2023-12-26 11:33:10,643][123091] Updated weights for policy 0, policy_version 1497607 (0.0009) [2023-12-26 11:33:11,423][123090] Updated weights for policy 1, policy_version 1487749 (0.0010) [2023-12-26 11:33:11,481][123090] Updated weights for policy 1, policy_version 1487759 (0.0009) [2023-12-26 11:33:11,495][123091] Updated weights for policy 0, policy_version 1497617 (0.0009) [2023-12-26 11:33:11,540][123090] Updated weights for policy 1, policy_version 1487769 (0.0009) [2023-12-26 11:33:11,554][123091] Updated weights for policy 0, policy_version 1497627 (0.0009) [2023-12-26 11:33:11,611][123091] Updated weights for policy 0, policy_version 1497637 (0.0009) [2023-12-26 11:33:11,680][123091] Updated weights for policy 0, policy_version 1497647 (0.0009) [2023-12-26 11:33:12,295][123090] Updated weights for policy 1, policy_version 1487779 (0.0009) [2023-12-26 11:33:12,364][123090] Updated weights for policy 1, policy_version 1487789 (0.0010) [2023-12-26 11:33:12,420][123090] Updated weights for policy 1, policy_version 1487799 (0.0009) [2023-12-26 11:33:12,588][123091] Updated weights for policy 0, policy_version 1497657 (0.0008) [2023-12-26 11:33:12,654][123091] Updated weights for policy 0, policy_version 1497667 (0.0011) [2023-12-26 11:33:12,715][123091] Updated weights for policy 0, policy_version 1497677 (0.0010) [2023-12-26 11:33:13,249][123090] Updated weights for policy 1, policy_version 1487809 (0.0010) [2023-12-26 11:33:13,303][123090] Updated weights for policy 1, policy_version 1487819 (0.0005) [2023-12-26 11:33:13,351][123090] Updated weights for policy 1, policy_version 1487829 (0.0005) [2023-12-26 11:33:13,403][123090] Updated weights for policy 1, policy_version 1487839 (0.0005) [2023-12-26 11:33:13,521][123091] Updated weights for policy 0, policy_version 1497687 (0.0007) [2023-12-26 11:33:13,577][123091] Updated weights for policy 0, policy_version 1497697 (0.0006) [2023-12-26 11:33:13,632][123091] Updated weights for policy 0, policy_version 1497707 (0.0006) [2023-12-26 11:33:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 764305408. Throughput: 0: 8882.2, 1: 8760.8. Samples: 764295884. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:13,785][121949] Avg episode reward: [(0, '5975.257'), (1, '5461.041')] [2023-12-26 11:33:14,091][123090] Updated weights for policy 1, policy_version 1487849 (0.0010) [2023-12-26 11:33:14,157][123090] Updated weights for policy 1, policy_version 1487859 (0.0010) [2023-12-26 11:33:14,211][123090] Updated weights for policy 1, policy_version 1487869 (0.0010) [2023-12-26 11:33:14,329][123091] Updated weights for policy 0, policy_version 1497717 (0.0008) [2023-12-26 11:33:14,390][123091] Updated weights for policy 0, policy_version 1497727 (0.0007) [2023-12-26 11:33:14,445][123091] Updated weights for policy 0, policy_version 1497737 (0.0005) [2023-12-26 11:33:15,000][123090] Updated weights for policy 1, policy_version 1487879 (0.0007) [2023-12-26 11:33:15,065][123090] Updated weights for policy 1, policy_version 1487889 (0.0006) [2023-12-26 11:33:15,123][123090] Updated weights for policy 1, policy_version 1487899 (0.0006) [2023-12-26 11:33:15,262][123091] Updated weights for policy 0, policy_version 1497747 (0.0007) [2023-12-26 11:33:15,325][123091] Updated weights for policy 0, policy_version 1497757 (0.0010) [2023-12-26 11:33:15,387][123091] Updated weights for policy 0, policy_version 1497767 (0.0010) [2023-12-26 11:33:15,850][123090] Updated weights for policy 1, policy_version 1487909 (0.0008) [2023-12-26 11:33:15,916][123090] Updated weights for policy 1, policy_version 1487919 (0.0010) [2023-12-26 11:33:15,986][123090] Updated weights for policy 1, policy_version 1487929 (0.0010) [2023-12-26 11:33:16,144][123091] Updated weights for policy 0, policy_version 1497777 (0.0009) [2023-12-26 11:33:16,202][123091] Updated weights for policy 0, policy_version 1497787 (0.0006) [2023-12-26 11:33:16,257][123091] Updated weights for policy 0, policy_version 1497797 (0.0006) [2023-12-26 11:33:16,319][123091] Updated weights for policy 0, policy_version 1497807 (0.0006) [2023-12-26 11:33:16,650][123090] Updated weights for policy 1, policy_version 1487939 (0.0007) [2023-12-26 11:33:16,701][123090] Updated weights for policy 1, policy_version 1487949 (0.0006) [2023-12-26 11:33:16,757][123090] Updated weights for policy 1, policy_version 1487959 (0.0005) [2023-12-26 11:33:17,089][123091] Updated weights for policy 0, policy_version 1497817 (0.0010) [2023-12-26 11:33:17,157][123091] Updated weights for policy 0, policy_version 1497827 (0.0011) [2023-12-26 11:33:17,217][123091] Updated weights for policy 0, policy_version 1497837 (0.0011) [2023-12-26 11:33:17,455][123090] Updated weights for policy 1, policy_version 1487969 (0.0006) [2023-12-26 11:33:17,507][123090] Updated weights for policy 1, policy_version 1487979 (0.0007) [2023-12-26 11:33:17,563][123090] Updated weights for policy 1, policy_version 1487989 (0.0010) [2023-12-26 11:33:17,623][123090] Updated weights for policy 1, policy_version 1487999 (0.0010) [2023-12-26 11:33:17,997][123091] Updated weights for policy 0, policy_version 1497847 (0.0010) [2023-12-26 11:33:18,058][123091] Updated weights for policy 0, policy_version 1497857 (0.0009) [2023-12-26 11:33:18,109][123091] Updated weights for policy 0, policy_version 1497867 (0.0009) [2023-12-26 11:33:18,487][123090] Updated weights for policy 1, policy_version 1488009 (0.0010) [2023-12-26 11:33:18,559][123090] Updated weights for policy 1, policy_version 1488019 (0.0011) [2023-12-26 11:33:18,620][123090] Updated weights for policy 1, policy_version 1488029 (0.0010) [2023-12-26 11:33:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 764395520. Throughput: 0: 8900.8, 1: 8865.6. Samples: 764407564. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:18,785][121949] Avg episode reward: [(0, '6162.463'), (1, '5549.739')] [2023-12-26 11:33:18,965][123091] Updated weights for policy 0, policy_version 1497877 (0.0009) [2023-12-26 11:33:19,024][123091] Updated weights for policy 0, policy_version 1497887 (0.0009) [2023-12-26 11:33:19,075][123091] Updated weights for policy 0, policy_version 1497897 (0.0010) [2023-12-26 11:33:19,447][123090] Updated weights for policy 1, policy_version 1488039 (0.0009) [2023-12-26 11:33:19,517][123090] Updated weights for policy 1, policy_version 1488049 (0.0009) [2023-12-26 11:33:19,577][123090] Updated weights for policy 1, policy_version 1488059 (0.0009) [2023-12-26 11:33:19,928][123091] Updated weights for policy 0, policy_version 1497907 (0.0009) [2023-12-26 11:33:19,992][123091] Updated weights for policy 0, policy_version 1497917 (0.0010) [2023-12-26 11:33:20,049][123091] Updated weights for policy 0, policy_version 1497927 (0.0011) [2023-12-26 11:33:20,396][123090] Updated weights for policy 1, policy_version 1488069 (0.0008) [2023-12-26 11:33:20,462][123090] Updated weights for policy 1, policy_version 1488079 (0.0008) [2023-12-26 11:33:20,535][123090] Updated weights for policy 1, policy_version 1488089 (0.0009) [2023-12-26 11:33:20,788][123091] Updated weights for policy 0, policy_version 1497937 (0.0008) [2023-12-26 11:33:20,846][123091] Updated weights for policy 0, policy_version 1497947 (0.0007) [2023-12-26 11:33:20,899][123091] Updated weights for policy 0, policy_version 1497957 (0.0011) [2023-12-26 11:33:20,952][123091] Updated weights for policy 0, policy_version 1497967 (0.0011) [2023-12-26 11:33:21,300][123090] Updated weights for policy 1, policy_version 1488099 (0.0009) [2023-12-26 11:33:21,382][123090] Updated weights for policy 1, policy_version 1488109 (0.0006) [2023-12-26 11:33:21,443][123090] Updated weights for policy 1, policy_version 1488119 (0.0009) [2023-12-26 11:33:21,797][123091] Updated weights for policy 0, policy_version 1497977 (0.0008) [2023-12-26 11:33:21,863][123091] Updated weights for policy 0, policy_version 1497987 (0.0009) [2023-12-26 11:33:21,932][123091] Updated weights for policy 0, policy_version 1497997 (0.0010) [2023-12-26 11:33:22,247][123090] Updated weights for policy 1, policy_version 1488129 (0.0009) [2023-12-26 11:33:22,310][123090] Updated weights for policy 1, policy_version 1488139 (0.0008) [2023-12-26 11:33:22,373][123090] Updated weights for policy 1, policy_version 1488149 (0.0007) [2023-12-26 11:33:22,431][123090] Updated weights for policy 1, policy_version 1488159 (0.0005) [2023-12-26 11:33:22,762][123091] Updated weights for policy 0, policy_version 1498007 (0.0010) [2023-12-26 11:33:22,828][123091] Updated weights for policy 0, policy_version 1498017 (0.0010) [2023-12-26 11:33:22,895][123091] Updated weights for policy 0, policy_version 1498027 (0.0010) [2023-12-26 11:33:23,124][123090] Updated weights for policy 1, policy_version 1488169 (0.0005) [2023-12-26 11:33:23,188][123090] Updated weights for policy 1, policy_version 1488179 (0.0006) [2023-12-26 11:33:23,248][123090] Updated weights for policy 1, policy_version 1488189 (0.0005) [2023-12-26 11:33:23,778][123091] Updated weights for policy 0, policy_version 1498037 (0.0009) [2023-12-26 11:33:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 764477440. Throughput: 0: 8905.8, 1: 8847.9. Samples: 764459328. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:23,785][121949] Avg episode reward: [(0, '6207.674'), (1, '5714.072')] [2023-12-26 11:33:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001488192_380977152.pth... [2023-12-26 11:33:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001487168_380715008.pth [2023-12-26 11:33:23,846][123091] Updated weights for policy 0, policy_version 1498047 (0.0009) [2023-12-26 11:33:23,875][123090] Updated weights for policy 1, policy_version 1488199 (0.0009) [2023-12-26 11:33:23,905][123091] Updated weights for policy 0, policy_version 1498057 (0.0008) [2023-12-26 11:33:23,926][123090] Updated weights for policy 1, policy_version 1488209 (0.0006) [2023-12-26 11:33:23,945][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001498064_383508480.pth... [2023-12-26 11:33:23,950][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001497008_383238144.pth [2023-12-26 11:33:23,986][123090] Updated weights for policy 1, policy_version 1488219 (0.0005) [2023-12-26 11:33:24,615][123090] Updated weights for policy 1, policy_version 1488229 (0.0006) [2023-12-26 11:33:24,673][123090] Updated weights for policy 1, policy_version 1488239 (0.0005) [2023-12-26 11:33:24,714][123091] Updated weights for policy 0, policy_version 1498067 (0.0007) [2023-12-26 11:33:24,737][123090] Updated weights for policy 1, policy_version 1488249 (0.0005) [2023-12-26 11:33:24,774][123091] Updated weights for policy 0, policy_version 1498077 (0.0006) [2023-12-26 11:33:24,827][123091] Updated weights for policy 0, policy_version 1498088 (0.0010) [2023-12-26 11:33:25,421][123090] Updated weights for policy 1, policy_version 1488259 (0.0007) [2023-12-26 11:33:25,480][123090] Updated weights for policy 1, policy_version 1488269 (0.0009) [2023-12-26 11:33:25,544][123090] Updated weights for policy 1, policy_version 1488279 (0.0009) [2023-12-26 11:33:25,590][123091] Updated weights for policy 0, policy_version 1498098 (0.0008) [2023-12-26 11:33:25,654][123091] Updated weights for policy 0, policy_version 1498108 (0.0010) [2023-12-26 11:33:25,717][123091] Updated weights for policy 0, policy_version 1498118 (0.0010) [2023-12-26 11:33:25,783][123091] Updated weights for policy 0, policy_version 1498128 (0.0009) [2023-12-26 11:33:26,398][123090] Updated weights for policy 1, policy_version 1488289 (0.0009) [2023-12-26 11:33:26,471][123090] Updated weights for policy 1, policy_version 1488299 (0.0006) [2023-12-26 11:33:26,516][123091] Updated weights for policy 0, policy_version 1498138 (0.0007) [2023-12-26 11:33:26,531][123090] Updated weights for policy 1, policy_version 1488309 (0.0005) [2023-12-26 11:33:26,567][123091] Updated weights for policy 0, policy_version 1498148 (0.0005) [2023-12-26 11:33:26,581][123090] Updated weights for policy 1, policy_version 1488319 (0.0005) [2023-12-26 11:33:26,618][123091] Updated weights for policy 0, policy_version 1498158 (0.0005) [2023-12-26 11:33:27,240][123090] Updated weights for policy 1, policy_version 1488329 (0.0005) [2023-12-26 11:33:27,267][123091] Updated weights for policy 0, policy_version 1498168 (0.0006) [2023-12-26 11:33:27,304][123090] Updated weights for policy 1, policy_version 1488339 (0.0006) [2023-12-26 11:33:27,323][123091] Updated weights for policy 0, policy_version 1498178 (0.0006) [2023-12-26 11:33:27,368][123090] Updated weights for policy 1, policy_version 1488349 (0.0009) [2023-12-26 11:33:27,378][123091] Updated weights for policy 0, policy_version 1498188 (0.0005) [2023-12-26 11:33:28,095][123090] Updated weights for policy 1, policy_version 1488359 (0.0010) [2023-12-26 11:33:28,108][123091] Updated weights for policy 0, policy_version 1498198 (0.0007) [2023-12-26 11:33:28,151][123091] Updated weights for policy 0, policy_version 1498208 (0.0007) [2023-12-26 11:33:28,159][123090] Updated weights for policy 1, policy_version 1488369 (0.0007) [2023-12-26 11:33:28,204][123091] Updated weights for policy 0, policy_version 1498218 (0.0007) [2023-12-26 11:33:28,223][123090] Updated weights for policy 1, policy_version 1488379 (0.0007) [2023-12-26 11:33:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 764575744. Throughput: 0: 8958.0, 1: 8971.2. Samples: 764570384. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:28,785][121949] Avg episode reward: [(0, '6234.549'), (1, '5718.375')] [2023-12-26 11:33:29,012][123090] Updated weights for policy 1, policy_version 1488389 (0.0007) [2023-12-26 11:33:29,019][123091] Updated weights for policy 0, policy_version 1498228 (0.0008) [2023-12-26 11:33:29,076][123090] Updated weights for policy 1, policy_version 1488399 (0.0007) [2023-12-26 11:33:29,083][123091] Updated weights for policy 0, policy_version 1498238 (0.0009) [2023-12-26 11:33:29,141][123090] Updated weights for policy 1, policy_version 1488409 (0.0007) [2023-12-26 11:33:29,148][123091] Updated weights for policy 0, policy_version 1498248 (0.0009) [2023-12-26 11:33:29,802][123090] Updated weights for policy 1, policy_version 1488419 (0.0007) [2023-12-26 11:33:29,863][123090] Updated weights for policy 1, policy_version 1488429 (0.0009) [2023-12-26 11:33:29,931][123090] Updated weights for policy 1, policy_version 1488439 (0.0008) [2023-12-26 11:33:30,025][123091] Updated weights for policy 0, policy_version 1498258 (0.0010) [2023-12-26 11:33:30,083][123091] Updated weights for policy 0, policy_version 1498268 (0.0009) [2023-12-26 11:33:30,150][123091] Updated weights for policy 0, policy_version 1498278 (0.0009) [2023-12-26 11:33:30,211][123091] Updated weights for policy 0, policy_version 1498288 (0.0009) [2023-12-26 11:33:30,770][123090] Updated weights for policy 1, policy_version 1488449 (0.0008) [2023-12-26 11:33:30,820][123090] Updated weights for policy 1, policy_version 1488459 (0.0005) [2023-12-26 11:33:30,868][123090] Updated weights for policy 1, policy_version 1488469 (0.0007) [2023-12-26 11:33:30,913][123091] Updated weights for policy 0, policy_version 1498298 (0.0005) [2023-12-26 11:33:30,922][123090] Updated weights for policy 1, policy_version 1488479 (0.0009) [2023-12-26 11:33:30,960][123091] Updated weights for policy 0, policy_version 1498308 (0.0006) [2023-12-26 11:33:31,015][123091] Updated weights for policy 0, policy_version 1498318 (0.0006) [2023-12-26 11:33:31,719][123091] Updated weights for policy 0, policy_version 1498328 (0.0009) [2023-12-26 11:33:31,786][123090] Updated weights for policy 1, policy_version 1488489 (0.0009) [2023-12-26 11:33:31,787][123091] Updated weights for policy 0, policy_version 1498338 (0.0008) [2023-12-26 11:33:31,851][123091] Updated weights for policy 0, policy_version 1498348 (0.0007) [2023-12-26 11:33:31,857][123090] Updated weights for policy 1, policy_version 1488499 (0.0009) [2023-12-26 11:33:31,926][123090] Updated weights for policy 1, policy_version 1488509 (0.0009) [2023-12-26 11:33:32,658][123091] Updated weights for policy 0, policy_version 1498358 (0.0008) [2023-12-26 11:33:32,724][123091] Updated weights for policy 0, policy_version 1498368 (0.0007) [2023-12-26 11:33:32,733][123090] Updated weights for policy 1, policy_version 1488519 (0.0007) [2023-12-26 11:33:32,793][123091] Updated weights for policy 0, policy_version 1498378 (0.0008) [2023-12-26 11:33:32,798][123090] Updated weights for policy 1, policy_version 1488529 (0.0007) [2023-12-26 11:33:32,869][123090] Updated weights for policy 1, policy_version 1488539 (0.0006) [2023-12-26 11:33:33,466][123090] Updated weights for policy 1, policy_version 1488549 (0.0005) [2023-12-26 11:33:33,515][123090] Updated weights for policy 1, policy_version 1488559 (0.0005) [2023-12-26 11:33:33,523][123091] Updated weights for policy 0, policy_version 1498388 (0.0007) [2023-12-26 11:33:33,576][123090] Updated weights for policy 1, policy_version 1488569 (0.0005) [2023-12-26 11:33:33,576][123091] Updated weights for policy 0, policy_version 1498398 (0.0005) [2023-12-26 11:33:33,622][123091] Updated weights for policy 0, policy_version 1498408 (0.0005) [2023-12-26 11:33:33,784][121949] Fps is (10 sec: 19660.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 764674048. Throughput: 0: 8958.4, 1: 9021.0. Samples: 764680340. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:33,785][121949] Avg episode reward: [(0, '6308.979'), (1, '5413.342')] [2023-12-26 11:33:34,259][123090] Updated weights for policy 1, policy_version 1488579 (0.0005) [2023-12-26 11:33:34,293][123091] Updated weights for policy 0, policy_version 1498418 (0.0007) [2023-12-26 11:33:34,307][123090] Updated weights for policy 1, policy_version 1488589 (0.0005) [2023-12-26 11:33:34,357][123091] Updated weights for policy 0, policy_version 1498428 (0.0011) [2023-12-26 11:33:34,363][123090] Updated weights for policy 1, policy_version 1488599 (0.0005) [2023-12-26 11:33:34,428][123091] Updated weights for policy 0, policy_version 1498438 (0.0010) [2023-12-26 11:33:34,492][123091] Updated weights for policy 0, policy_version 1498448 (0.0011) [2023-12-26 11:33:35,064][123090] Updated weights for policy 1, policy_version 1488609 (0.0006) [2023-12-26 11:33:35,119][123090] Updated weights for policy 1, policy_version 1488619 (0.0009) [2023-12-26 11:33:35,171][123090] Updated weights for policy 1, policy_version 1488629 (0.0005) [2023-12-26 11:33:35,225][123090] Updated weights for policy 1, policy_version 1488639 (0.0005) [2023-12-26 11:33:35,271][123091] Updated weights for policy 0, policy_version 1498458 (0.0010) [2023-12-26 11:33:35,325][123091] Updated weights for policy 0, policy_version 1498468 (0.0010) [2023-12-26 11:33:35,372][123091] Updated weights for policy 0, policy_version 1498478 (0.0010) [2023-12-26 11:33:36,010][123090] Updated weights for policy 1, policy_version 1488649 (0.0010) [2023-12-26 11:33:36,068][123090] Updated weights for policy 1, policy_version 1488659 (0.0010) [2023-12-26 11:33:36,144][123090] Updated weights for policy 1, policy_version 1488669 (0.0011) [2023-12-26 11:33:36,233][123091] Updated weights for policy 0, policy_version 1498488 (0.0009) [2023-12-26 11:33:36,294][123091] Updated weights for policy 0, policy_version 1498498 (0.0009) [2023-12-26 11:33:36,355][123091] Updated weights for policy 0, policy_version 1498508 (0.0009) [2023-12-26 11:33:36,969][123090] Updated weights for policy 1, policy_version 1488679 (0.0010) [2023-12-26 11:33:37,050][123090] Updated weights for policy 1, policy_version 1488689 (0.0011) [2023-12-26 11:33:37,106][123090] Updated weights for policy 1, policy_version 1488699 (0.0010) [2023-12-26 11:33:37,112][123091] Updated weights for policy 0, policy_version 1498518 (0.0007) [2023-12-26 11:33:37,180][123091] Updated weights for policy 0, policy_version 1498528 (0.0006) [2023-12-26 11:33:37,236][123091] Updated weights for policy 0, policy_version 1498538 (0.0009) [2023-12-26 11:33:37,916][123090] Updated weights for policy 1, policy_version 1488709 (0.0011) [2023-12-26 11:33:37,963][123091] Updated weights for policy 0, policy_version 1498548 (0.0009) [2023-12-26 11:33:37,984][123090] Updated weights for policy 1, policy_version 1488719 (0.0007) [2023-12-26 11:33:38,018][123091] Updated weights for policy 0, policy_version 1498558 (0.0007) [2023-12-26 11:33:38,044][123090] Updated weights for policy 1, policy_version 1488729 (0.0009) [2023-12-26 11:33:38,075][123091] Updated weights for policy 0, policy_version 1498568 (0.0005) [2023-12-26 11:33:38,745][123090] Updated weights for policy 1, policy_version 1488739 (0.0006) [2023-12-26 11:33:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 764755968. Throughput: 0: 8973.9, 1: 9103.4. Samples: 764735668. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:38,785][121949] Avg episode reward: [(0, '6219.491'), (1, '5304.872')] [2023-12-26 11:33:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001498576_383639552.pth... [2023-12-26 11:33:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001497552_383377408.pth [2023-12-26 11:33:38,803][123090] Updated weights for policy 1, policy_version 1488749 (0.0006) [2023-12-26 11:33:38,874][123090] Updated weights for policy 1, policy_version 1488759 (0.0010) [2023-12-26 11:33:38,919][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001488768_381124608.pth... [2023-12-26 11:33:38,923][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001487680_380846080.pth [2023-12-26 11:33:38,975][123091] Updated weights for policy 0, policy_version 1498578 (0.0009) [2023-12-26 11:33:39,027][123091] Updated weights for policy 0, policy_version 1498588 (0.0009) [2023-12-26 11:33:39,080][123091] Updated weights for policy 0, policy_version 1498598 (0.0009) [2023-12-26 11:33:39,140][123091] Updated weights for policy 0, policy_version 1498608 (0.0010) [2023-12-26 11:33:39,671][123090] Updated weights for policy 1, policy_version 1488769 (0.0009) [2023-12-26 11:33:39,732][123090] Updated weights for policy 1, policy_version 1488779 (0.0006) [2023-12-26 11:33:39,804][123090] Updated weights for policy 1, policy_version 1488789 (0.0007) [2023-12-26 11:33:39,876][123090] Updated weights for policy 1, policy_version 1488799 (0.0008) [2023-12-26 11:33:40,044][123091] Updated weights for policy 0, policy_version 1498618 (0.0006) [2023-12-26 11:33:40,112][123091] Updated weights for policy 0, policy_version 1498628 (0.0008) [2023-12-26 11:33:40,177][123091] Updated weights for policy 0, policy_version 1498638 (0.0009) [2023-12-26 11:33:40,653][123090] Updated weights for policy 1, policy_version 1488809 (0.0009) [2023-12-26 11:33:40,724][123090] Updated weights for policy 1, policy_version 1488819 (0.0009) [2023-12-26 11:33:40,793][123090] Updated weights for policy 1, policy_version 1488829 (0.0009) [2023-12-26 11:33:40,986][123091] Updated weights for policy 0, policy_version 1498648 (0.0010) [2023-12-26 11:33:41,057][123091] Updated weights for policy 0, policy_version 1498658 (0.0009) [2023-12-26 11:33:41,128][123091] Updated weights for policy 0, policy_version 1498668 (0.0006) [2023-12-26 11:33:41,624][123090] Updated weights for policy 1, policy_version 1488839 (0.0008) [2023-12-26 11:33:41,697][123090] Updated weights for policy 1, policy_version 1488849 (0.0009) [2023-12-26 11:33:41,773][123090] Updated weights for policy 1, policy_version 1488859 (0.0010) [2023-12-26 11:33:41,930][123091] Updated weights for policy 0, policy_version 1498678 (0.0009) [2023-12-26 11:33:41,997][123091] Updated weights for policy 0, policy_version 1498688 (0.0009) [2023-12-26 11:33:42,057][123091] Updated weights for policy 0, policy_version 1498698 (0.0010) [2023-12-26 11:33:42,596][123090] Updated weights for policy 1, policy_version 1488869 (0.0010) [2023-12-26 11:33:42,660][123090] Updated weights for policy 1, policy_version 1488879 (0.0009) [2023-12-26 11:33:42,725][123090] Updated weights for policy 1, policy_version 1488889 (0.0010) [2023-12-26 11:33:42,913][123091] Updated weights for policy 0, policy_version 1498708 (0.0010) [2023-12-26 11:33:42,974][123091] Updated weights for policy 0, policy_version 1498718 (0.0010) [2023-12-26 11:33:43,032][123091] Updated weights for policy 0, policy_version 1498728 (0.0010) [2023-12-26 11:33:43,553][123090] Updated weights for policy 1, policy_version 1488899 (0.0009) [2023-12-26 11:33:43,606][123090] Updated weights for policy 1, policy_version 1488909 (0.0009) [2023-12-26 11:33:43,656][123090] Updated weights for policy 1, policy_version 1488919 (0.0010) [2023-12-26 11:33:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 764846080. Throughput: 0: 8931.6, 1: 9065.1. Samples: 764839296. Policy #0 lag: (min: 31.0, avg: 37.7, max: 63.0) [2023-12-26 11:33:43,785][121949] Avg episode reward: [(0, '6143.909'), (1, '5569.736')] [2023-12-26 11:33:43,881][123091] Updated weights for policy 0, policy_version 1498738 (0.0009) [2023-12-26 11:33:43,934][123091] Updated weights for policy 0, policy_version 1498748 (0.0009) [2023-12-26 11:33:43,984][123091] Updated weights for policy 0, policy_version 1498759 (0.0009) [2023-12-26 11:33:44,524][123090] Updated weights for policy 1, policy_version 1488929 (0.0009) [2023-12-26 11:33:44,572][123090] Updated weights for policy 1, policy_version 1488939 (0.0009) [2023-12-26 11:33:44,633][123090] Updated weights for policy 1, policy_version 1488949 (0.0009) [2023-12-26 11:33:44,689][123090] Updated weights for policy 1, policy_version 1488959 (0.0010) [2023-12-26 11:33:44,859][123091] Updated weights for policy 0, policy_version 1498769 (0.0010) [2023-12-26 11:33:44,924][123091] Updated weights for policy 0, policy_version 1498779 (0.0009) [2023-12-26 11:33:44,992][123091] Updated weights for policy 0, policy_version 1498789 (0.0010) [2023-12-26 11:33:45,063][123091] Updated weights for policy 0, policy_version 1498799 (0.0009) [2023-12-26 11:33:45,524][123090] Updated weights for policy 1, policy_version 1488969 (0.0010) [2023-12-26 11:33:45,594][123090] Updated weights for policy 1, policy_version 1488979 (0.0010) [2023-12-26 11:33:45,645][123090] Updated weights for policy 1, policy_version 1488990 (0.0009) [2023-12-26 11:33:45,858][123091] Updated weights for policy 0, policy_version 1498809 (0.0006) [2023-12-26 11:33:45,916][123091] Updated weights for policy 0, policy_version 1498819 (0.0005) [2023-12-26 11:33:45,979][123091] Updated weights for policy 0, policy_version 1498829 (0.0005) [2023-12-26 11:33:46,573][123090] Updated weights for policy 1, policy_version 1489000 (0.0010) [2023-12-26 11:33:46,624][123091] Updated weights for policy 0, policy_version 1498839 (0.0007) [2023-12-26 11:33:46,641][123090] Updated weights for policy 1, policy_version 1489010 (0.0009) [2023-12-26 11:33:46,689][123091] Updated weights for policy 0, policy_version 1498849 (0.0008) [2023-12-26 11:33:46,695][123090] Updated weights for policy 1, policy_version 1489020 (0.0009) [2023-12-26 11:33:46,754][123091] Updated weights for policy 0, policy_version 1498859 (0.0009) [2023-12-26 11:33:47,532][123090] Updated weights for policy 1, policy_version 1489030 (0.0009) [2023-12-26 11:33:47,566][123091] Updated weights for policy 0, policy_version 1498869 (0.0009) [2023-12-26 11:33:47,598][123090] Updated weights for policy 1, policy_version 1489040 (0.0009) [2023-12-26 11:33:47,616][123091] Updated weights for policy 0, policy_version 1498879 (0.0008) [2023-12-26 11:33:47,655][123090] Updated weights for policy 1, policy_version 1489050 (0.0009) [2023-12-26 11:33:47,662][123091] Updated weights for policy 0, policy_version 1498889 (0.0007) [2023-12-26 11:33:48,467][123090] Updated weights for policy 1, policy_version 1489060 (0.0007) [2023-12-26 11:33:48,540][123090] Updated weights for policy 1, policy_version 1489070 (0.0008) [2023-12-26 11:33:48,546][123091] Updated weights for policy 0, policy_version 1498899 (0.0009) [2023-12-26 11:33:48,604][123090] Updated weights for policy 1, policy_version 1489080 (0.0006) [2023-12-26 11:33:48,610][123091] Updated weights for policy 0, policy_version 1498909 (0.0010) [2023-12-26 11:33:48,677][123091] Updated weights for policy 0, policy_version 1498919 (0.0009) [2023-12-26 11:33:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 764936192. Throughput: 0: 8877.5, 1: 9018.8. Samples: 764942336. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:33:48,785][121949] Avg episode reward: [(0, '6104.242'), (1, '5651.797')] [2023-12-26 11:33:49,422][123090] Updated weights for policy 1, policy_version 1489090 (0.0006) [2023-12-26 11:33:49,483][123090] Updated weights for policy 1, policy_version 1489100 (0.0010) [2023-12-26 11:33:49,531][123091] Updated weights for policy 0, policy_version 1498929 (0.0010) [2023-12-26 11:33:49,541][123090] Updated weights for policy 1, policy_version 1489110 (0.0009) [2023-12-26 11:33:49,589][123091] Updated weights for policy 0, policy_version 1498939 (0.0008) [2023-12-26 11:33:49,601][123090] Updated weights for policy 1, policy_version 1489120 (0.0009) [2023-12-26 11:33:49,653][123091] Updated weights for policy 0, policy_version 1498949 (0.0010) [2023-12-26 11:33:49,712][123091] Updated weights for policy 0, policy_version 1498959 (0.0009) [2023-12-26 11:33:50,464][123090] Updated weights for policy 1, policy_version 1489130 (0.0009) [2023-12-26 11:33:50,524][123090] Updated weights for policy 1, policy_version 1489140 (0.0009) [2023-12-26 11:33:50,586][123091] Updated weights for policy 0, policy_version 1498969 (0.0008) [2023-12-26 11:33:50,598][123090] Updated weights for policy 1, policy_version 1489150 (0.0009) [2023-12-26 11:33:50,657][123091] Updated weights for policy 0, policy_version 1498979 (0.0006) [2023-12-26 11:33:50,725][123091] Updated weights for policy 0, policy_version 1498989 (0.0006) [2023-12-26 11:33:51,405][123090] Updated weights for policy 1, policy_version 1489160 (0.0008) [2023-12-26 11:33:51,421][123091] Updated weights for policy 0, policy_version 1498999 (0.0006) [2023-12-26 11:33:51,468][123090] Updated weights for policy 1, policy_version 1489170 (0.0008) [2023-12-26 11:33:51,470][123091] Updated weights for policy 0, policy_version 1499009 (0.0008) [2023-12-26 11:33:51,524][123091] Updated weights for policy 0, policy_version 1499019 (0.0009) [2023-12-26 11:33:51,533][123090] Updated weights for policy 1, policy_version 1489180 (0.0007) [2023-12-26 11:33:52,375][123090] Updated weights for policy 1, policy_version 1489190 (0.0008) [2023-12-26 11:33:52,435][123090] Updated weights for policy 1, policy_version 1489200 (0.0009) [2023-12-26 11:33:52,439][123091] Updated weights for policy 0, policy_version 1499029 (0.0011) [2023-12-26 11:33:52,493][123090] Updated weights for policy 1, policy_version 1489210 (0.0007) [2023-12-26 11:33:52,502][123091] Updated weights for policy 0, policy_version 1499039 (0.0011) [2023-12-26 11:33:52,554][123091] Updated weights for policy 0, policy_version 1499049 (0.0010) [2023-12-26 11:33:53,263][123090] Updated weights for policy 1, policy_version 1489220 (0.0009) [2023-12-26 11:33:53,318][123090] Updated weights for policy 1, policy_version 1489230 (0.0010) [2023-12-26 11:33:53,340][123091] Updated weights for policy 0, policy_version 1499059 (0.0009) [2023-12-26 11:33:53,376][123090] Updated weights for policy 1, policy_version 1489240 (0.0010) [2023-12-26 11:33:53,409][123091] Updated weights for policy 0, policy_version 1499069 (0.0005) [2023-12-26 11:33:53,482][123091] Updated weights for policy 0, policy_version 1499079 (0.0005) [2023-12-26 11:33:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 765018112. Throughput: 0: 8799.5, 1: 8968.5. Samples: 764993024. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:33:53,785][121949] Avg episode reward: [(0, '6204.058'), (1, '5715.516')] [2023-12-26 11:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001499088_383770624.pth... [2023-12-26 11:33:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001489248_381247488.pth... [2023-12-26 11:33:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001488192_380977152.pth [2023-12-26 11:33:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001498064_383508480.pth [2023-12-26 11:33:53,796][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001489248_381247488.pth [2023-12-26 11:33:53,796][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001499088_383770624.pth [2023-12-26 11:33:54,177][123091] Updated weights for policy 0, policy_version 1499089 (0.0006) [2023-12-26 11:33:54,243][123091] Updated weights for policy 0, policy_version 1499099 (0.0009) [2023-12-26 11:33:54,246][123090] Updated weights for policy 1, policy_version 1489250 (0.0008) [2023-12-26 11:33:54,298][123091] Updated weights for policy 0, policy_version 1499109 (0.0010) [2023-12-26 11:33:54,312][123090] Updated weights for policy 1, policy_version 1489260 (0.0007) [2023-12-26 11:33:54,359][123091] Updated weights for policy 0, policy_version 1499119 (0.0007) [2023-12-26 11:33:54,379][123090] Updated weights for policy 1, policy_version 1489270 (0.0010) [2023-12-26 11:33:54,445][123090] Updated weights for policy 1, policy_version 1489280 (0.0010) [2023-12-26 11:33:55,169][123091] Updated weights for policy 0, policy_version 1499129 (0.0009) [2023-12-26 11:33:55,232][123091] Updated weights for policy 0, policy_version 1499139 (0.0006) [2023-12-26 11:33:55,287][123091] Updated weights for policy 0, policy_version 1499149 (0.0006) [2023-12-26 11:33:55,294][123090] Updated weights for policy 1, policy_version 1489290 (0.0009) [2023-12-26 11:33:55,359][123090] Updated weights for policy 1, policy_version 1489300 (0.0009) [2023-12-26 11:33:55,426][123090] Updated weights for policy 1, policy_version 1489310 (0.0010) [2023-12-26 11:33:56,048][123091] Updated weights for policy 0, policy_version 1499159 (0.0008) [2023-12-26 11:33:56,111][123091] Updated weights for policy 0, policy_version 1499169 (0.0009) [2023-12-26 11:33:56,168][123091] Updated weights for policy 0, policy_version 1499179 (0.0009) [2023-12-26 11:33:56,277][123090] Updated weights for policy 1, policy_version 1489320 (0.0006) [2023-12-26 11:33:56,356][123090] Updated weights for policy 1, policy_version 1489330 (0.0005) [2023-12-26 11:33:56,421][123090] Updated weights for policy 1, policy_version 1489340 (0.0005) [2023-12-26 11:33:57,017][123091] Updated weights for policy 0, policy_version 1499189 (0.0009) [2023-12-26 11:33:57,068][123090] Updated weights for policy 1, policy_version 1489350 (0.0007) [2023-12-26 11:33:57,078][123091] Updated weights for policy 0, policy_version 1499199 (0.0009) [2023-12-26 11:33:57,132][123090] Updated weights for policy 1, policy_version 1489360 (0.0005) [2023-12-26 11:33:57,143][123091] Updated weights for policy 0, policy_version 1499209 (0.0009) [2023-12-26 11:33:57,199][123090] Updated weights for policy 1, policy_version 1489370 (0.0005) [2023-12-26 11:33:57,770][123091] Updated weights for policy 0, policy_version 1499219 (0.0008) [2023-12-26 11:33:57,818][123091] Updated weights for policy 0, policy_version 1499229 (0.0009) [2023-12-26 11:33:57,858][123090] Updated weights for policy 1, policy_version 1489380 (0.0007) [2023-12-26 11:33:57,875][123091] Updated weights for policy 0, policy_version 1499239 (0.0007) [2023-12-26 11:33:57,912][123090] Updated weights for policy 1, policy_version 1489390 (0.0010) [2023-12-26 11:33:57,973][123090] Updated weights for policy 1, policy_version 1489400 (0.0010) [2023-12-26 11:33:58,742][123091] Updated weights for policy 0, policy_version 1499249 (0.0010) [2023-12-26 11:33:58,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 765100032. Throughput: 0: 8866.9, 1: 9008.9. Samples: 765100292. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:33:58,784][121949] Avg episode reward: [(0, '6253.008'), (1, '5568.331')] [2023-12-26 11:33:58,810][123091] Updated weights for policy 0, policy_version 1499259 (0.0010) [2023-12-26 11:33:58,836][123090] Updated weights for policy 1, policy_version 1489410 (0.0010) [2023-12-26 11:33:58,877][123091] Updated weights for policy 0, policy_version 1499269 (0.0008) [2023-12-26 11:33:58,901][123090] Updated weights for policy 1, policy_version 1489420 (0.0010) [2023-12-26 11:33:58,941][123091] Updated weights for policy 0, policy_version 1499279 (0.0006) [2023-12-26 11:33:58,956][123090] Updated weights for policy 1, policy_version 1489430 (0.0010) [2023-12-26 11:33:59,012][123090] Updated weights for policy 1, policy_version 1489440 (0.0010) [2023-12-26 11:33:59,773][123090] Updated weights for policy 1, policy_version 1489450 (0.0010) [2023-12-26 11:33:59,788][123091] Updated weights for policy 0, policy_version 1499289 (0.0006) [2023-12-26 11:33:59,840][123090] Updated weights for policy 1, policy_version 1489460 (0.0010) [2023-12-26 11:33:59,859][123091] Updated weights for policy 0, policy_version 1499299 (0.0007) [2023-12-26 11:33:59,903][123090] Updated weights for policy 1, policy_version 1489470 (0.0010) [2023-12-26 11:33:59,923][123091] Updated weights for policy 0, policy_version 1499309 (0.0009) [2023-12-26 11:34:00,718][123090] Updated weights for policy 1, policy_version 1489480 (0.0010) [2023-12-26 11:34:00,725][123091] Updated weights for policy 0, policy_version 1499319 (0.0006) [2023-12-26 11:34:00,769][123090] Updated weights for policy 1, policy_version 1489490 (0.0010) [2023-12-26 11:34:00,784][123091] Updated weights for policy 0, policy_version 1499329 (0.0007) [2023-12-26 11:34:00,819][123090] Updated weights for policy 1, policy_version 1489500 (0.0005) [2023-12-26 11:34:00,838][123091] Updated weights for policy 0, policy_version 1499339 (0.0009) [2023-12-26 11:34:01,652][123090] Updated weights for policy 1, policy_version 1489510 (0.0007) [2023-12-26 11:34:01,653][123091] Updated weights for policy 0, policy_version 1499350 (0.0009) [2023-12-26 11:34:01,705][123091] Updated weights for policy 0, policy_version 1499360 (0.0008) [2023-12-26 11:34:01,716][123090] Updated weights for policy 1, policy_version 1489520 (0.0006) [2023-12-26 11:34:01,775][123091] Updated weights for policy 0, policy_version 1499370 (0.0008) [2023-12-26 11:34:01,783][123090] Updated weights for policy 1, policy_version 1489530 (0.0008) [2023-12-26 11:34:02,502][123091] Updated weights for policy 0, policy_version 1499380 (0.0009) [2023-12-26 11:34:02,566][123091] Updated weights for policy 0, policy_version 1499390 (0.0010) [2023-12-26 11:34:02,632][123091] Updated weights for policy 0, policy_version 1499400 (0.0005) [2023-12-26 11:34:02,658][123090] Updated weights for policy 1, policy_version 1489540 (0.0008) [2023-12-26 11:34:02,723][123090] Updated weights for policy 1, policy_version 1489550 (0.0008) [2023-12-26 11:34:02,783][123090] Updated weights for policy 1, policy_version 1489560 (0.0011) [2023-12-26 11:34:03,370][123091] Updated weights for policy 0, policy_version 1499410 (0.0006) [2023-12-26 11:34:03,422][123091] Updated weights for policy 0, policy_version 1499420 (0.0009) [2023-12-26 11:34:03,479][123091] Updated weights for policy 0, policy_version 1499430 (0.0009) [2023-12-26 11:34:03,538][123091] Updated weights for policy 0, policy_version 1499440 (0.0009) [2023-12-26 11:34:03,621][123090] Updated weights for policy 1, policy_version 1489570 (0.0009) [2023-12-26 11:34:03,674][123090] Updated weights for policy 1, policy_version 1489580 (0.0009) [2023-12-26 11:34:03,723][123090] Updated weights for policy 1, policy_version 1489591 (0.0009) [2023-12-26 11:34:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 765198336. Throughput: 0: 8823.8, 1: 8878.5. Samples: 765204172. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:03,785][121949] Avg episode reward: [(0, '6190.731'), (1, '5247.054')] [2023-12-26 11:34:04,358][123091] Updated weights for policy 0, policy_version 1499450 (0.0009) [2023-12-26 11:34:04,427][123091] Updated weights for policy 0, policy_version 1499460 (0.0010) [2023-12-26 11:34:04,490][123091] Updated weights for policy 0, policy_version 1499470 (0.0009) [2023-12-26 11:34:04,577][123090] Updated weights for policy 1, policy_version 1489601 (0.0009) [2023-12-26 11:34:04,652][123090] Updated weights for policy 1, policy_version 1489611 (0.0010) [2023-12-26 11:34:04,708][123090] Updated weights for policy 1, policy_version 1489621 (0.0009) [2023-12-26 11:34:04,760][123090] Updated weights for policy 1, policy_version 1489631 (0.0009) [2023-12-26 11:34:05,234][123091] Updated weights for policy 0, policy_version 1499480 (0.0010) [2023-12-26 11:34:05,290][123091] Updated weights for policy 0, policy_version 1499490 (0.0010) [2023-12-26 11:34:05,349][123091] Updated weights for policy 0, policy_version 1499500 (0.0010) [2023-12-26 11:34:05,611][123090] Updated weights for policy 1, policy_version 1489641 (0.0009) [2023-12-26 11:34:05,661][123090] Updated weights for policy 1, policy_version 1489651 (0.0009) [2023-12-26 11:34:05,715][123090] Updated weights for policy 1, policy_version 1489661 (0.0009) [2023-12-26 11:34:06,178][123091] Updated weights for policy 0, policy_version 1499510 (0.0010) [2023-12-26 11:34:06,243][123091] Updated weights for policy 0, policy_version 1499520 (0.0010) [2023-12-26 11:34:06,309][123091] Updated weights for policy 0, policy_version 1499530 (0.0010) [2023-12-26 11:34:06,611][123090] Updated weights for policy 1, policy_version 1489671 (0.0010) [2023-12-26 11:34:06,675][123090] Updated weights for policy 1, policy_version 1489681 (0.0010) [2023-12-26 11:34:06,731][123090] Updated weights for policy 1, policy_version 1489691 (0.0009) [2023-12-26 11:34:07,111][123091] Updated weights for policy 0, policy_version 1499540 (0.0010) [2023-12-26 11:34:07,174][123091] Updated weights for policy 0, policy_version 1499550 (0.0009) [2023-12-26 11:34:07,231][123091] Updated weights for policy 0, policy_version 1499560 (0.0009) [2023-12-26 11:34:07,564][123090] Updated weights for policy 1, policy_version 1489701 (0.0010) [2023-12-26 11:34:07,624][123090] Updated weights for policy 1, policy_version 1489711 (0.0009) [2023-12-26 11:34:07,678][123090] Updated weights for policy 1, policy_version 1489721 (0.0009) [2023-12-26 11:34:08,072][123091] Updated weights for policy 0, policy_version 1499570 (0.0010) [2023-12-26 11:34:08,121][123091] Updated weights for policy 0, policy_version 1499580 (0.0009) [2023-12-26 11:34:08,168][123091] Updated weights for policy 0, policy_version 1499590 (0.0008) [2023-12-26 11:34:08,226][123091] Updated weights for policy 0, policy_version 1499600 (0.0009) [2023-12-26 11:34:08,531][123090] Updated weights for policy 1, policy_version 1489731 (0.0009) [2023-12-26 11:34:08,581][123090] Updated weights for policy 1, policy_version 1489741 (0.0009) [2023-12-26 11:34:08,631][123090] Updated weights for policy 1, policy_version 1489751 (0.0009) [2023-12-26 11:34:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 765280256. Throughput: 0: 8819.9, 1: 8874.2. Samples: 765255564. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:08,785][121949] Avg episode reward: [(0, '6155.216'), (1, '5372.457')] [2023-12-26 11:34:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001489760_381378560.pth... [2023-12-26 11:34:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001499600_383901696.pth... [2023-12-26 11:34:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001488768_381124608.pth [2023-12-26 11:34:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001498576_383639552.pth [2023-12-26 11:34:09,103][123091] Updated weights for policy 0, policy_version 1499610 (0.0010) [2023-12-26 11:34:09,163][123091] Updated weights for policy 0, policy_version 1499620 (0.0009) [2023-12-26 11:34:09,221][123091] Updated weights for policy 0, policy_version 1499630 (0.0010) [2023-12-26 11:34:09,466][123090] Updated weights for policy 1, policy_version 1489761 (0.0009) [2023-12-26 11:34:09,539][123090] Updated weights for policy 1, policy_version 1489771 (0.0009) [2023-12-26 11:34:09,605][123090] Updated weights for policy 1, policy_version 1489781 (0.0009) [2023-12-26 11:34:09,676][123090] Updated weights for policy 1, policy_version 1489791 (0.0010) [2023-12-26 11:34:10,129][123091] Updated weights for policy 0, policy_version 1499640 (0.0007) [2023-12-26 11:34:10,194][123091] Updated weights for policy 0, policy_version 1499650 (0.0009) [2023-12-26 11:34:10,258][123091] Updated weights for policy 0, policy_version 1499660 (0.0009) [2023-12-26 11:34:10,497][123090] Updated weights for policy 1, policy_version 1489801 (0.0009) [2023-12-26 11:34:10,560][123090] Updated weights for policy 1, policy_version 1489811 (0.0009) [2023-12-26 11:34:10,634][123090] Updated weights for policy 1, policy_version 1489821 (0.0006) [2023-12-26 11:34:11,088][123091] Updated weights for policy 0, policy_version 1499670 (0.0009) [2023-12-26 11:34:11,157][123091] Updated weights for policy 0, policy_version 1499680 (0.0009) [2023-12-26 11:34:11,232][123091] Updated weights for policy 0, policy_version 1499690 (0.0010) [2023-12-26 11:34:11,357][123090] Updated weights for policy 1, policy_version 1489831 (0.0006) [2023-12-26 11:34:11,429][123090] Updated weights for policy 1, policy_version 1489841 (0.0008) [2023-12-26 11:34:11,497][123090] Updated weights for policy 1, policy_version 1489851 (0.0009) [2023-12-26 11:34:12,063][123091] Updated weights for policy 0, policy_version 1499700 (0.0009) [2023-12-26 11:34:12,137][123091] Updated weights for policy 0, policy_version 1499710 (0.0010) [2023-12-26 11:34:12,206][123091] Updated weights for policy 0, policy_version 1499720 (0.0011) [2023-12-26 11:34:12,371][123090] Updated weights for policy 1, policy_version 1489861 (0.0010) [2023-12-26 11:34:12,434][123090] Updated weights for policy 1, policy_version 1489872 (0.0009) [2023-12-26 11:34:12,498][123090] Updated weights for policy 1, policy_version 1489882 (0.0008) [2023-12-26 11:34:13,050][123091] Updated weights for policy 0, policy_version 1499730 (0.0010) [2023-12-26 11:34:13,110][123091] Updated weights for policy 0, policy_version 1499740 (0.0009) [2023-12-26 11:34:13,174][123091] Updated weights for policy 0, policy_version 1499750 (0.0009) [2023-12-26 11:34:13,246][123091] Updated weights for policy 0, policy_version 1499760 (0.0009) [2023-12-26 11:34:13,300][123090] Updated weights for policy 1, policy_version 1489892 (0.0008) [2023-12-26 11:34:13,364][123090] Updated weights for policy 1, policy_version 1489902 (0.0008) [2023-12-26 11:34:13,423][123090] Updated weights for policy 1, policy_version 1489912 (0.0010) [2023-12-26 11:34:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 765362176. Throughput: 0: 8747.6, 1: 8731.1. Samples: 765356924. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:13,784][121949] Avg episode reward: [(0, '6166.186'), (1, '5480.639')] [2023-12-26 11:34:14,124][123091] Updated weights for policy 0, policy_version 1499770 (0.0010) [2023-12-26 11:34:14,140][123090] Updated weights for policy 1, policy_version 1489922 (0.0007) [2023-12-26 11:34:14,182][123091] Updated weights for policy 0, policy_version 1499780 (0.0009) [2023-12-26 11:34:14,201][123090] Updated weights for policy 1, policy_version 1489932 (0.0005) [2023-12-26 11:34:14,247][123091] Updated weights for policy 0, policy_version 1499790 (0.0008) [2023-12-26 11:34:14,253][123090] Updated weights for policy 1, policy_version 1489942 (0.0010) [2023-12-26 11:34:14,311][123090] Updated weights for policy 1, policy_version 1489952 (0.0010) [2023-12-26 11:34:15,020][123091] Updated weights for policy 0, policy_version 1499800 (0.0009) [2023-12-26 11:34:15,079][123091] Updated weights for policy 0, policy_version 1499810 (0.0009) [2023-12-26 11:34:15,130][123090] Updated weights for policy 1, policy_version 1489962 (0.0008) [2023-12-26 11:34:15,140][123091] Updated weights for policy 0, policy_version 1499820 (0.0008) [2023-12-26 11:34:15,185][123090] Updated weights for policy 1, policy_version 1489972 (0.0009) [2023-12-26 11:34:15,252][123090] Updated weights for policy 1, policy_version 1489982 (0.0007) [2023-12-26 11:34:15,998][123091] Updated weights for policy 0, policy_version 1499830 (0.0010) [2023-12-26 11:34:16,038][123090] Updated weights for policy 1, policy_version 1489992 (0.0009) [2023-12-26 11:34:16,061][123091] Updated weights for policy 0, policy_version 1499840 (0.0011) [2023-12-26 11:34:16,090][123090] Updated weights for policy 1, policy_version 1490002 (0.0007) [2023-12-26 11:34:16,120][123091] Updated weights for policy 0, policy_version 1499850 (0.0011) [2023-12-26 11:34:16,145][123090] Updated weights for policy 1, policy_version 1490012 (0.0008) [2023-12-26 11:34:16,866][123091] Updated weights for policy 0, policy_version 1499860 (0.0010) [2023-12-26 11:34:16,920][123091] Updated weights for policy 0, policy_version 1499870 (0.0008) [2023-12-26 11:34:16,959][123090] Updated weights for policy 1, policy_version 1490022 (0.0009) [2023-12-26 11:34:16,972][123091] Updated weights for policy 0, policy_version 1499880 (0.0006) [2023-12-26 11:34:17,010][123090] Updated weights for policy 1, policy_version 1490032 (0.0009) [2023-12-26 11:34:17,068][123090] Updated weights for policy 1, policy_version 1490042 (0.0010) [2023-12-26 11:34:17,654][123091] Updated weights for policy 0, policy_version 1499890 (0.0006) [2023-12-26 11:34:17,723][123091] Updated weights for policy 0, policy_version 1499900 (0.0005) [2023-12-26 11:34:17,798][123091] Updated weights for policy 0, policy_version 1499910 (0.0005) [2023-12-26 11:34:17,867][123091] Updated weights for policy 0, policy_version 1499920 (0.0008) [2023-12-26 11:34:17,999][123090] Updated weights for policy 1, policy_version 1490052 (0.0009) [2023-12-26 11:34:18,058][123090] Updated weights for policy 1, policy_version 1490062 (0.0009) [2023-12-26 11:34:18,118][123090] Updated weights for policy 1, policy_version 1490072 (0.0008) [2023-12-26 11:34:18,598][123091] Updated weights for policy 0, policy_version 1499930 (0.0007) [2023-12-26 11:34:18,655][123091] Updated weights for policy 0, policy_version 1499940 (0.0005) [2023-12-26 11:34:18,728][123091] Updated weights for policy 0, policy_version 1499950 (0.0006) [2023-12-26 11:34:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 765452288. Throughput: 0: 8720.7, 1: 8670.4. Samples: 765462940. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:18,785][121949] Avg episode reward: [(0, '6211.182'), (1, '5227.460')] [2023-12-26 11:34:18,981][123090] Updated weights for policy 1, policy_version 1490082 (0.0009) [2023-12-26 11:34:19,033][123090] Updated weights for policy 1, policy_version 1490092 (0.0011) [2023-12-26 11:34:19,089][123090] Updated weights for policy 1, policy_version 1490102 (0.0010) [2023-12-26 11:34:19,137][123090] Updated weights for policy 1, policy_version 1490112 (0.0010) [2023-12-26 11:34:19,538][123091] Updated weights for policy 0, policy_version 1499960 (0.0010) [2023-12-26 11:34:19,601][123091] Updated weights for policy 0, policy_version 1499970 (0.0011) [2023-12-26 11:34:19,665][123091] Updated weights for policy 0, policy_version 1499980 (0.0011) [2023-12-26 11:34:20,037][123090] Updated weights for policy 1, policy_version 1490122 (0.0007) [2023-12-26 11:34:20,106][123090] Updated weights for policy 1, policy_version 1490132 (0.0008) [2023-12-26 11:34:20,167][123090] Updated weights for policy 1, policy_version 1490142 (0.0009) [2023-12-26 11:34:20,472][123091] Updated weights for policy 0, policy_version 1499990 (0.0009) [2023-12-26 11:34:20,536][123091] Updated weights for policy 0, policy_version 1500000 (0.0009) [2023-12-26 11:34:20,592][123091] Updated weights for policy 0, policy_version 1500010 (0.0011) [2023-12-26 11:34:20,982][123090] Updated weights for policy 1, policy_version 1490152 (0.0009) [2023-12-26 11:34:21,053][123090] Updated weights for policy 1, policy_version 1490162 (0.0009) [2023-12-26 11:34:21,117][123090] Updated weights for policy 1, policy_version 1490172 (0.0009) [2023-12-26 11:34:21,495][123091] Updated weights for policy 0, policy_version 1500020 (0.0011) [2023-12-26 11:34:21,551][123091] Updated weights for policy 0, policy_version 1500030 (0.0009) [2023-12-26 11:34:21,606][123091] Updated weights for policy 0, policy_version 1500040 (0.0009) [2023-12-26 11:34:22,016][123090] Updated weights for policy 1, policy_version 1490182 (0.0008) [2023-12-26 11:34:22,075][123090] Updated weights for policy 1, policy_version 1490192 (0.0008) [2023-12-26 11:34:22,132][123090] Updated weights for policy 1, policy_version 1490202 (0.0005) [2023-12-26 11:34:22,456][123091] Updated weights for policy 0, policy_version 1500050 (0.0008) [2023-12-26 11:34:22,516][123091] Updated weights for policy 0, policy_version 1500060 (0.0009) [2023-12-26 11:34:22,587][123091] Updated weights for policy 0, policy_version 1500070 (0.0009) [2023-12-26 11:34:22,657][123091] Updated weights for policy 0, policy_version 1500080 (0.0010) [2023-12-26 11:34:22,896][123090] Updated weights for policy 1, policy_version 1490212 (0.0007) [2023-12-26 11:34:22,955][123090] Updated weights for policy 1, policy_version 1490222 (0.0009) [2023-12-26 11:34:23,015][123090] Updated weights for policy 1, policy_version 1490232 (0.0009) [2023-12-26 11:34:23,492][123091] Updated weights for policy 0, policy_version 1500090 (0.0006) [2023-12-26 11:34:23,545][123091] Updated weights for policy 0, policy_version 1500100 (0.0009) [2023-12-26 11:34:23,595][123091] Updated weights for policy 0, policy_version 1500110 (0.0010) [2023-12-26 11:34:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 765534208. Throughput: 0: 8689.6, 1: 8575.5. Samples: 765512604. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:23,785][121949] Avg episode reward: [(0, '6204.494'), (1, '5407.126')] [2023-12-26 11:34:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001500112_384032768.pth... [2023-12-26 11:34:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001490240_381501440.pth... [2023-12-26 11:34:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001489248_381247488.pth [2023-12-26 11:34:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001499088_383770624.pth [2023-12-26 11:34:23,828][123090] Updated weights for policy 1, policy_version 1490242 (0.0010) [2023-12-26 11:34:23,897][123090] Updated weights for policy 1, policy_version 1490252 (0.0010) [2023-12-26 11:34:23,959][123090] Updated weights for policy 1, policy_version 1490262 (0.0009) [2023-12-26 11:34:24,027][123090] Updated weights for policy 1, policy_version 1490272 (0.0005) [2023-12-26 11:34:24,292][123091] Updated weights for policy 0, policy_version 1500120 (0.0006) [2023-12-26 11:34:24,367][123091] Updated weights for policy 0, policy_version 1500130 (0.0009) [2023-12-26 11:34:24,436][123091] Updated weights for policy 0, policy_version 1500140 (0.0006) [2023-12-26 11:34:24,661][123090] Updated weights for policy 1, policy_version 1490282 (0.0005) [2023-12-26 11:34:24,710][123090] Updated weights for policy 1, policy_version 1490292 (0.0005) [2023-12-26 11:34:24,788][123090] Updated weights for policy 1, policy_version 1490302 (0.0005) [2023-12-26 11:34:25,097][123091] Updated weights for policy 0, policy_version 1500150 (0.0008) [2023-12-26 11:34:25,160][123091] Updated weights for policy 0, policy_version 1500160 (0.0011) [2023-12-26 11:34:25,219][123091] Updated weights for policy 0, policy_version 1500170 (0.0011) [2023-12-26 11:34:25,450][123090] Updated weights for policy 1, policy_version 1490312 (0.0006) [2023-12-26 11:34:25,504][123090] Updated weights for policy 1, policy_version 1490322 (0.0005) [2023-12-26 11:34:25,565][123090] Updated weights for policy 1, policy_version 1490332 (0.0006) [2023-12-26 11:34:25,974][123091] Updated weights for policy 0, policy_version 1500180 (0.0011) [2023-12-26 11:34:26,020][123091] Updated weights for policy 0, policy_version 1500190 (0.0009) [2023-12-26 11:34:26,078][123091] Updated weights for policy 0, policy_version 1500200 (0.0006) [2023-12-26 11:34:26,279][123090] Updated weights for policy 1, policy_version 1490342 (0.0009) [2023-12-26 11:34:26,339][123090] Updated weights for policy 1, policy_version 1490352 (0.0011) [2023-12-26 11:34:26,406][123090] Updated weights for policy 1, policy_version 1490362 (0.0008) [2023-12-26 11:34:26,844][123091] Updated weights for policy 0, policy_version 1500210 (0.0008) [2023-12-26 11:34:26,910][123091] Updated weights for policy 0, policy_version 1500220 (0.0011) [2023-12-26 11:34:26,984][123091] Updated weights for policy 0, policy_version 1500230 (0.0011) [2023-12-26 11:34:27,037][123091] Updated weights for policy 0, policy_version 1500240 (0.0007) [2023-12-26 11:34:27,074][123090] Updated weights for policy 1, policy_version 1490372 (0.0007) [2023-12-26 11:34:27,133][123090] Updated weights for policy 1, policy_version 1490382 (0.0005) [2023-12-26 11:34:27,195][123090] Updated weights for policy 1, policy_version 1490392 (0.0005) [2023-12-26 11:34:27,788][123091] Updated weights for policy 0, policy_version 1500250 (0.0010) [2023-12-26 11:34:27,832][123091] Updated weights for policy 0, policy_version 1500260 (0.0010) [2023-12-26 11:34:27,889][123091] Updated weights for policy 0, policy_version 1500270 (0.0010) [2023-12-26 11:34:27,939][123090] Updated weights for policy 1, policy_version 1490402 (0.0006) [2023-12-26 11:34:27,998][123090] Updated weights for policy 1, policy_version 1490412 (0.0010) [2023-12-26 11:34:28,053][123090] Updated weights for policy 1, policy_version 1490422 (0.0010) [2023-12-26 11:34:28,112][123090] Updated weights for policy 1, policy_version 1490432 (0.0010) [2023-12-26 11:34:28,631][123091] Updated weights for policy 0, policy_version 1500280 (0.0010) [2023-12-26 11:34:28,689][123091] Updated weights for policy 0, policy_version 1500290 (0.0009) [2023-12-26 11:34:28,743][123091] Updated weights for policy 0, policy_version 1500300 (0.0009) [2023-12-26 11:34:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 765632512. Throughput: 0: 8777.4, 1: 8663.3. Samples: 765624128. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:28,785][121949] Avg episode reward: [(0, '6043.123'), (1, '5326.705')] [2023-12-26 11:34:28,950][123090] Updated weights for policy 1, policy_version 1490442 (0.0010) [2023-12-26 11:34:28,997][123090] Updated weights for policy 1, policy_version 1490452 (0.0008) [2023-12-26 11:34:29,045][123090] Updated weights for policy 1, policy_version 1490462 (0.0009) [2023-12-26 11:34:29,559][123091] Updated weights for policy 0, policy_version 1500310 (0.0007) [2023-12-26 11:34:29,610][123091] Updated weights for policy 0, policy_version 1500320 (0.0008) [2023-12-26 11:34:29,671][123091] Updated weights for policy 0, policy_version 1500330 (0.0009) [2023-12-26 11:34:29,957][123090] Updated weights for policy 1, policy_version 1490472 (0.0008) [2023-12-26 11:34:30,019][123090] Updated weights for policy 1, policy_version 1490482 (0.0008) [2023-12-26 11:34:30,070][123090] Updated weights for policy 1, policy_version 1490492 (0.0008) [2023-12-26 11:34:30,505][123091] Updated weights for policy 0, policy_version 1500340 (0.0009) [2023-12-26 11:34:30,562][123091] Updated weights for policy 0, policy_version 1500350 (0.0009) [2023-12-26 11:34:30,622][123091] Updated weights for policy 0, policy_version 1500360 (0.0010) [2023-12-26 11:34:30,847][123090] Updated weights for policy 1, policy_version 1490502 (0.0007) [2023-12-26 11:34:30,901][123090] Updated weights for policy 1, policy_version 1490512 (0.0006) [2023-12-26 11:34:30,962][123090] Updated weights for policy 1, policy_version 1490522 (0.0005) [2023-12-26 11:34:31,445][123091] Updated weights for policy 0, policy_version 1500370 (0.0009) [2023-12-26 11:34:31,507][123091] Updated weights for policy 0, policy_version 1500380 (0.0009) [2023-12-26 11:34:31,574][123091] Updated weights for policy 0, policy_version 1500390 (0.0009) [2023-12-26 11:34:31,644][123091] Updated weights for policy 0, policy_version 1500400 (0.0009) [2023-12-26 11:34:31,777][123090] Updated weights for policy 1, policy_version 1490532 (0.0007) [2023-12-26 11:34:31,840][123090] Updated weights for policy 1, policy_version 1490542 (0.0010) [2023-12-26 11:34:31,903][123090] Updated weights for policy 1, policy_version 1490552 (0.0008) [2023-12-26 11:34:32,352][123091] Updated weights for policy 0, policy_version 1500410 (0.0007) [2023-12-26 11:34:32,425][123091] Updated weights for policy 0, policy_version 1500420 (0.0006) [2023-12-26 11:34:32,502][123091] Updated weights for policy 0, policy_version 1500430 (0.0006) [2023-12-26 11:34:32,617][123090] Updated weights for policy 1, policy_version 1490562 (0.0005) [2023-12-26 11:34:32,677][123090] Updated weights for policy 1, policy_version 1490572 (0.0006) [2023-12-26 11:34:32,728][123090] Updated weights for policy 1, policy_version 1490582 (0.0010) [2023-12-26 11:34:32,787][123090] Updated weights for policy 1, policy_version 1490592 (0.0010) [2023-12-26 11:34:33,150][123091] Updated weights for policy 0, policy_version 1500440 (0.0009) [2023-12-26 11:34:33,209][123091] Updated weights for policy 0, policy_version 1500450 (0.0008) [2023-12-26 11:34:33,256][123091] Updated weights for policy 0, policy_version 1500460 (0.0008) [2023-12-26 11:34:33,536][123090] Updated weights for policy 1, policy_version 1490602 (0.0005) [2023-12-26 11:34:33,592][123090] Updated weights for policy 1, policy_version 1490612 (0.0005) [2023-12-26 11:34:33,656][123090] Updated weights for policy 1, policy_version 1490622 (0.0008) [2023-12-26 11:34:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 765722624. Throughput: 0: 8820.7, 1: 8734.8. Samples: 765732336. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:33,785][121949] Avg episode reward: [(0, '5939.584'), (1, '5048.722')] [2023-12-26 11:34:34,044][123091] Updated weights for policy 0, policy_version 1500471 (0.0009) [2023-12-26 11:34:34,103][123091] Updated weights for policy 0, policy_version 1500481 (0.0008) [2023-12-26 11:34:34,166][123091] Updated weights for policy 0, policy_version 1500491 (0.0009) [2023-12-26 11:34:34,432][123090] Updated weights for policy 1, policy_version 1490632 (0.0011) [2023-12-26 11:34:34,505][123090] Updated weights for policy 1, policy_version 1490642 (0.0010) [2023-12-26 11:34:34,569][123090] Updated weights for policy 1, policy_version 1490652 (0.0011) [2023-12-26 11:34:35,096][123091] Updated weights for policy 0, policy_version 1500501 (0.0009) [2023-12-26 11:34:35,159][123091] Updated weights for policy 0, policy_version 1500511 (0.0008) [2023-12-26 11:34:35,220][123091] Updated weights for policy 0, policy_version 1500521 (0.0009) [2023-12-26 11:34:35,228][123090] Updated weights for policy 1, policy_version 1490662 (0.0006) [2023-12-26 11:34:35,289][123090] Updated weights for policy 1, policy_version 1490672 (0.0009) [2023-12-26 11:34:35,350][123090] Updated weights for policy 1, policy_version 1490682 (0.0007) [2023-12-26 11:34:36,026][123090] Updated weights for policy 1, policy_version 1490692 (0.0005) [2023-12-26 11:34:36,095][123090] Updated weights for policy 1, policy_version 1490702 (0.0006) [2023-12-26 11:34:36,120][123091] Updated weights for policy 0, policy_version 1500531 (0.0009) [2023-12-26 11:34:36,170][123090] Updated weights for policy 1, policy_version 1490712 (0.0008) [2023-12-26 11:34:36,187][123091] Updated weights for policy 0, policy_version 1500541 (0.0009) [2023-12-26 11:34:36,259][123091] Updated weights for policy 0, policy_version 1500551 (0.0006) [2023-12-26 11:34:36,959][123090] Updated weights for policy 1, policy_version 1490722 (0.0008) [2023-12-26 11:34:37,008][123090] Updated weights for policy 1, policy_version 1490732 (0.0009) [2023-12-26 11:34:37,052][123091] Updated weights for policy 0, policy_version 1500561 (0.0006) [2023-12-26 11:34:37,059][123090] Updated weights for policy 1, policy_version 1490742 (0.0009) [2023-12-26 11:34:37,101][123091] Updated weights for policy 0, policy_version 1500571 (0.0008) [2023-12-26 11:34:37,116][123090] Updated weights for policy 1, policy_version 1490752 (0.0009) [2023-12-26 11:34:37,161][123091] Updated weights for policy 0, policy_version 1500581 (0.0008) [2023-12-26 11:34:37,234][123091] Updated weights for policy 0, policy_version 1500591 (0.0009) [2023-12-26 11:34:37,899][123090] Updated weights for policy 1, policy_version 1490762 (0.0006) [2023-12-26 11:34:37,962][123090] Updated weights for policy 1, policy_version 1490772 (0.0006) [2023-12-26 11:34:38,032][123090] Updated weights for policy 1, policy_version 1490782 (0.0005) [2023-12-26 11:34:38,073][123091] Updated weights for policy 0, policy_version 1500601 (0.0009) [2023-12-26 11:34:38,127][123091] Updated weights for policy 0, policy_version 1500611 (0.0007) [2023-12-26 11:34:38,180][123091] Updated weights for policy 0, policy_version 1500621 (0.0005) [2023-12-26 11:34:38,731][123090] Updated weights for policy 1, policy_version 1490792 (0.0006) [2023-12-26 11:34:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 765804544. Throughput: 0: 8811.1, 1: 8808.6. Samples: 765785912. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:38,785][121949] Avg episode reward: [(0, '6054.988'), (1, '5164.568')] [2023-12-26 11:34:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001500624_384163840.pth... [2023-12-26 11:34:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001499600_383901696.pth [2023-12-26 11:34:38,796][123090] Updated weights for policy 1, policy_version 1490802 (0.0007) [2023-12-26 11:34:38,865][123090] Updated weights for policy 1, policy_version 1490812 (0.0006) [2023-12-26 11:34:38,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001490816_381648896.pth... [2023-12-26 11:34:38,896][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001489760_381378560.pth [2023-12-26 11:34:38,949][123091] Updated weights for policy 0, policy_version 1500631 (0.0007) [2023-12-26 11:34:39,017][123091] Updated weights for policy 0, policy_version 1500641 (0.0006) [2023-12-26 11:34:39,086][123091] Updated weights for policy 0, policy_version 1500651 (0.0008) [2023-12-26 11:34:39,595][123090] Updated weights for policy 1, policy_version 1490822 (0.0008) [2023-12-26 11:34:39,654][123090] Updated weights for policy 1, policy_version 1490832 (0.0009) [2023-12-26 11:34:39,720][123090] Updated weights for policy 1, policy_version 1490842 (0.0010) [2023-12-26 11:34:39,930][123091] Updated weights for policy 0, policy_version 1500661 (0.0010) [2023-12-26 11:34:39,988][123091] Updated weights for policy 0, policy_version 1500671 (0.0010) [2023-12-26 11:34:40,055][123091] Updated weights for policy 0, policy_version 1500681 (0.0009) [2023-12-26 11:34:40,571][123090] Updated weights for policy 1, policy_version 1490852 (0.0009) [2023-12-26 11:34:40,630][123090] Updated weights for policy 1, policy_version 1490862 (0.0010) [2023-12-26 11:34:40,693][123090] Updated weights for policy 1, policy_version 1490872 (0.0010) [2023-12-26 11:34:40,869][123091] Updated weights for policy 0, policy_version 1500691 (0.0009) [2023-12-26 11:34:40,941][123091] Updated weights for policy 0, policy_version 1500701 (0.0005) [2023-12-26 11:34:41,007][123091] Updated weights for policy 0, policy_version 1500711 (0.0006) [2023-12-26 11:34:41,532][123090] Updated weights for policy 1, policy_version 1490882 (0.0007) [2023-12-26 11:34:41,604][123090] Updated weights for policy 1, policy_version 1490892 (0.0007) [2023-12-26 11:34:41,681][123090] Updated weights for policy 1, policy_version 1490902 (0.0010) [2023-12-26 11:34:41,751][123090] Updated weights for policy 1, policy_version 1490912 (0.0008) [2023-12-26 11:34:41,816][123091] Updated weights for policy 0, policy_version 1500721 (0.0008) [2023-12-26 11:34:41,882][123091] Updated weights for policy 0, policy_version 1500731 (0.0007) [2023-12-26 11:34:41,957][123091] Updated weights for policy 0, policy_version 1500741 (0.0007) [2023-12-26 11:34:42,024][123091] Updated weights for policy 0, policy_version 1500751 (0.0009) [2023-12-26 11:34:42,553][123090] Updated weights for policy 1, policy_version 1490922 (0.0006) [2023-12-26 11:34:42,622][123090] Updated weights for policy 1, policy_version 1490932 (0.0006) [2023-12-26 11:34:42,684][123090] Updated weights for policy 1, policy_version 1490942 (0.0007) [2023-12-26 11:34:42,736][123091] Updated weights for policy 0, policy_version 1500761 (0.0009) [2023-12-26 11:34:42,788][123091] Updated weights for policy 0, policy_version 1500771 (0.0009) [2023-12-26 11:34:42,839][123091] Updated weights for policy 0, policy_version 1500781 (0.0009) [2023-12-26 11:34:43,445][123090] Updated weights for policy 1, policy_version 1490952 (0.0009) [2023-12-26 11:34:43,514][123090] Updated weights for policy 1, policy_version 1490962 (0.0006) [2023-12-26 11:34:43,575][123090] Updated weights for policy 1, policy_version 1490972 (0.0005) [2023-12-26 11:34:43,703][123091] Updated weights for policy 0, policy_version 1500791 (0.0010) [2023-12-26 11:34:43,759][123091] Updated weights for policy 0, policy_version 1500801 (0.0010) [2023-12-26 11:34:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 765894656. Throughput: 0: 8771.6, 1: 8805.7. Samples: 765891272. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:43,785][121949] Avg episode reward: [(0, '6075.934'), (1, '5478.365')] [2023-12-26 11:34:43,820][123091] Updated weights for policy 0, policy_version 1500811 (0.0010) [2023-12-26 11:34:44,245][123090] Updated weights for policy 1, policy_version 1490982 (0.0008) [2023-12-26 11:34:44,303][123090] Updated weights for policy 1, policy_version 1490992 (0.0008) [2023-12-26 11:34:44,373][123090] Updated weights for policy 1, policy_version 1491002 (0.0005) [2023-12-26 11:34:44,726][123091] Updated weights for policy 0, policy_version 1500821 (0.0009) [2023-12-26 11:34:44,795][123091] Updated weights for policy 0, policy_version 1500831 (0.0009) [2023-12-26 11:34:44,847][123091] Updated weights for policy 0, policy_version 1500841 (0.0008) [2023-12-26 11:34:45,072][123090] Updated weights for policy 1, policy_version 1491012 (0.0005) [2023-12-26 11:34:45,129][123090] Updated weights for policy 1, policy_version 1491022 (0.0005) [2023-12-26 11:34:45,207][123090] Updated weights for policy 1, policy_version 1491032 (0.0006) [2023-12-26 11:34:45,628][123091] Updated weights for policy 0, policy_version 1500851 (0.0009) [2023-12-26 11:34:45,676][123091] Updated weights for policy 0, policy_version 1500861 (0.0009) [2023-12-26 11:34:45,725][123091] Updated weights for policy 0, policy_version 1500871 (0.0009) [2023-12-26 11:34:45,838][123090] Updated weights for policy 1, policy_version 1491042 (0.0006) [2023-12-26 11:34:45,884][123090] Updated weights for policy 1, policy_version 1491052 (0.0010) [2023-12-26 11:34:45,931][123090] Updated weights for policy 1, policy_version 1491062 (0.0010) [2023-12-26 11:34:45,979][123090] Updated weights for policy 1, policy_version 1491072 (0.0010) [2023-12-26 11:34:46,587][123091] Updated weights for policy 0, policy_version 1500881 (0.0009) [2023-12-26 11:34:46,647][123091] Updated weights for policy 0, policy_version 1500891 (0.0009) [2023-12-26 11:34:46,712][123091] Updated weights for policy 0, policy_version 1500901 (0.0007) [2023-12-26 11:34:46,769][123091] Updated weights for policy 0, policy_version 1500911 (0.0008) [2023-12-26 11:34:46,838][123090] Updated weights for policy 1, policy_version 1491082 (0.0009) [2023-12-26 11:34:46,908][123090] Updated weights for policy 1, policy_version 1491092 (0.0006) [2023-12-26 11:34:46,964][123090] Updated weights for policy 1, policy_version 1491102 (0.0009) [2023-12-26 11:34:47,497][123091] Updated weights for policy 0, policy_version 1500921 (0.0011) [2023-12-26 11:34:47,548][123091] Updated weights for policy 0, policy_version 1500931 (0.0010) [2023-12-26 11:34:47,602][123091] Updated weights for policy 0, policy_version 1500941 (0.0010) [2023-12-26 11:34:47,752][123090] Updated weights for policy 1, policy_version 1491112 (0.0010) [2023-12-26 11:34:47,795][123090] Updated weights for policy 1, policy_version 1491122 (0.0010) [2023-12-26 11:34:47,858][123090] Updated weights for policy 1, policy_version 1491132 (0.0010) [2023-12-26 11:34:48,433][123091] Updated weights for policy 0, policy_version 1500951 (0.0007) [2023-12-26 11:34:48,509][123091] Updated weights for policy 0, policy_version 1500961 (0.0006) [2023-12-26 11:34:48,574][123091] Updated weights for policy 0, policy_version 1500971 (0.0011) [2023-12-26 11:34:48,712][123090] Updated weights for policy 1, policy_version 1491142 (0.0008) [2023-12-26 11:34:48,784][123090] Updated weights for policy 1, policy_version 1491152 (0.0006) [2023-12-26 11:34:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 765984768. Throughput: 0: 8751.5, 1: 8890.8. Samples: 765998080. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:48,786][121949] Avg episode reward: [(0, '6153.956'), (1, '5285.861')] [2023-12-26 11:34:48,845][123090] Updated weights for policy 1, policy_version 1491162 (0.0011) [2023-12-26 11:34:49,335][123091] Updated weights for policy 0, policy_version 1500981 (0.0010) [2023-12-26 11:34:49,405][123091] Updated weights for policy 0, policy_version 1500991 (0.0009) [2023-12-26 11:34:49,456][123091] Updated weights for policy 0, policy_version 1501001 (0.0011) [2023-12-26 11:34:49,549][123090] Updated weights for policy 1, policy_version 1491172 (0.0007) [2023-12-26 11:34:49,615][123090] Updated weights for policy 1, policy_version 1491182 (0.0005) [2023-12-26 11:34:49,681][123090] Updated weights for policy 1, policy_version 1491192 (0.0006) [2023-12-26 11:34:50,291][123091] Updated weights for policy 0, policy_version 1501011 (0.0011) [2023-12-26 11:34:50,347][123091] Updated weights for policy 0, policy_version 1501021 (0.0011) [2023-12-26 11:34:50,411][123091] Updated weights for policy 0, policy_version 1501031 (0.0011) [2023-12-26 11:34:50,437][123090] Updated weights for policy 1, policy_version 1491202 (0.0007) [2023-12-26 11:34:50,498][123090] Updated weights for policy 1, policy_version 1491212 (0.0006) [2023-12-26 11:34:50,572][123090] Updated weights for policy 1, policy_version 1491222 (0.0006) [2023-12-26 11:34:50,632][123090] Updated weights for policy 1, policy_version 1491232 (0.0008) [2023-12-26 11:34:51,267][123091] Updated weights for policy 0, policy_version 1501041 (0.0011) [2023-12-26 11:34:51,315][123091] Updated weights for policy 0, policy_version 1501051 (0.0011) [2023-12-26 11:34:51,381][123091] Updated weights for policy 0, policy_version 1501061 (0.0011) [2023-12-26 11:34:51,442][123091] Updated weights for policy 0, policy_version 1501071 (0.0008) [2023-12-26 11:34:51,461][123090] Updated weights for policy 1, policy_version 1491242 (0.0008) [2023-12-26 11:34:51,521][123090] Updated weights for policy 1, policy_version 1491252 (0.0008) [2023-12-26 11:34:51,584][123090] Updated weights for policy 1, policy_version 1491262 (0.0008) [2023-12-26 11:34:52,311][123091] Updated weights for policy 0, policy_version 1501081 (0.0008) [2023-12-26 11:34:52,331][123090] Updated weights for policy 1, policy_version 1491272 (0.0008) [2023-12-26 11:34:52,373][123091] Updated weights for policy 0, policy_version 1501091 (0.0010) [2023-12-26 11:34:52,399][123090] Updated weights for policy 1, policy_version 1491282 (0.0009) [2023-12-26 11:34:52,440][123091] Updated weights for policy 0, policy_version 1501101 (0.0010) [2023-12-26 11:34:52,473][123090] Updated weights for policy 1, policy_version 1491292 (0.0010) [2023-12-26 11:34:53,288][123091] Updated weights for policy 0, policy_version 1501111 (0.0007) [2023-12-26 11:34:53,289][123090] Updated weights for policy 1, policy_version 1491302 (0.0009) [2023-12-26 11:34:53,354][123090] Updated weights for policy 1, policy_version 1491312 (0.0009) [2023-12-26 11:34:53,361][123091] Updated weights for policy 0, policy_version 1501121 (0.0005) [2023-12-26 11:34:53,408][123090] Updated weights for policy 1, policy_version 1491322 (0.0008) [2023-12-26 11:34:53,416][123091] Updated weights for policy 0, policy_version 1501131 (0.0008) [2023-12-26 11:34:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 766074880. Throughput: 0: 8743.3, 1: 8926.9. Samples: 766050720. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:53,785][121949] Avg episode reward: [(0, '6233.569'), (1, '5445.420')] [2023-12-26 11:34:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001501136_384294912.pth... [2023-12-26 11:34:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001491328_381779968.pth... [2023-12-26 11:34:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001490240_381501440.pth [2023-12-26 11:34:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001500112_384032768.pth [2023-12-26 11:34:54,212][123091] Updated weights for policy 0, policy_version 1501141 (0.0006) [2023-12-26 11:34:54,274][123090] Updated weights for policy 1, policy_version 1491332 (0.0010) [2023-12-26 11:34:54,281][123091] Updated weights for policy 0, policy_version 1501151 (0.0007) [2023-12-26 11:34:54,338][123090] Updated weights for policy 1, policy_version 1491342 (0.0009) [2023-12-26 11:34:54,345][123091] Updated weights for policy 0, policy_version 1501161 (0.0006) [2023-12-26 11:34:54,406][123090] Updated weights for policy 1, policy_version 1491352 (0.0009) [2023-12-26 11:34:54,987][123091] Updated weights for policy 0, policy_version 1501171 (0.0006) [2023-12-26 11:34:55,057][123091] Updated weights for policy 0, policy_version 1501181 (0.0005) [2023-12-26 11:34:55,119][123091] Updated weights for policy 0, policy_version 1501191 (0.0008) [2023-12-26 11:34:55,256][123090] Updated weights for policy 1, policy_version 1491362 (0.0010) [2023-12-26 11:34:55,314][123090] Updated weights for policy 1, policy_version 1491372 (0.0008) [2023-12-26 11:34:55,374][123090] Updated weights for policy 1, policy_version 1491382 (0.0009) [2023-12-26 11:34:55,427][123090] Updated weights for policy 1, policy_version 1491392 (0.0008) [2023-12-26 11:34:55,914][123091] Updated weights for policy 0, policy_version 1501201 (0.0010) [2023-12-26 11:34:55,987][123091] Updated weights for policy 0, policy_version 1501211 (0.0011) [2023-12-26 11:34:56,042][123091] Updated weights for policy 0, policy_version 1501221 (0.0010) [2023-12-26 11:34:56,090][123091] Updated weights for policy 0, policy_version 1501231 (0.0010) [2023-12-26 11:34:56,275][123090] Updated weights for policy 1, policy_version 1491402 (0.0009) [2023-12-26 11:34:56,327][123090] Updated weights for policy 1, policy_version 1491412 (0.0008) [2023-12-26 11:34:56,377][123090] Updated weights for policy 1, policy_version 1491422 (0.0009) [2023-12-26 11:34:56,922][123091] Updated weights for policy 0, policy_version 1501241 (0.0011) [2023-12-26 11:34:56,986][123091] Updated weights for policy 0, policy_version 1501251 (0.0011) [2023-12-26 11:34:57,039][123091] Updated weights for policy 0, policy_version 1501261 (0.0010) [2023-12-26 11:34:57,237][123090] Updated weights for policy 1, policy_version 1491432 (0.0010) [2023-12-26 11:34:57,300][123090] Updated weights for policy 1, policy_version 1491442 (0.0009) [2023-12-26 11:34:57,357][123090] Updated weights for policy 1, policy_version 1491452 (0.0008) [2023-12-26 11:34:57,832][123091] Updated weights for policy 0, policy_version 1501271 (0.0007) [2023-12-26 11:34:57,878][123091] Updated weights for policy 0, policy_version 1501281 (0.0005) [2023-12-26 11:34:57,926][123091] Updated weights for policy 0, policy_version 1501291 (0.0005) [2023-12-26 11:34:58,085][123090] Updated weights for policy 1, policy_version 1491462 (0.0008) [2023-12-26 11:34:58,155][123090] Updated weights for policy 1, policy_version 1491472 (0.0007) [2023-12-26 11:34:58,222][123090] Updated weights for policy 1, policy_version 1491482 (0.0006) [2023-12-26 11:34:58,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 766156800. Throughput: 0: 8790.2, 1: 8928.4. Samples: 766154264. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:34:58,785][121949] Avg episode reward: [(0, '6192.022'), (1, '5788.643')] [2023-12-26 11:34:58,796][123091] Updated weights for policy 0, policy_version 1501301 (0.0006) [2023-12-26 11:34:58,870][123091] Updated weights for policy 0, policy_version 1501311 (0.0008) [2023-12-26 11:34:58,942][123091] Updated weights for policy 0, policy_version 1501321 (0.0010) [2023-12-26 11:34:59,097][123090] Updated weights for policy 1, policy_version 1491492 (0.0009) [2023-12-26 11:34:59,145][123090] Updated weights for policy 1, policy_version 1491502 (0.0008) [2023-12-26 11:34:59,197][123090] Updated weights for policy 1, policy_version 1491512 (0.0009) [2023-12-26 11:34:59,768][123091] Updated weights for policy 0, policy_version 1501331 (0.0009) [2023-12-26 11:34:59,828][123091] Updated weights for policy 0, policy_version 1501341 (0.0010) [2023-12-26 11:34:59,886][123091] Updated weights for policy 0, policy_version 1501351 (0.0009) [2023-12-26 11:35:00,102][123090] Updated weights for policy 1, policy_version 1491522 (0.0009) [2023-12-26 11:35:00,159][123090] Updated weights for policy 1, policy_version 1491532 (0.0009) [2023-12-26 11:35:00,232][123090] Updated weights for policy 1, policy_version 1491542 (0.0010) [2023-12-26 11:35:00,296][123090] Updated weights for policy 1, policy_version 1491552 (0.0009) [2023-12-26 11:35:00,657][123091] Updated weights for policy 0, policy_version 1501361 (0.0010) [2023-12-26 11:35:00,707][123091] Updated weights for policy 0, policy_version 1501371 (0.0009) [2023-12-26 11:35:00,761][123091] Updated weights for policy 0, policy_version 1501381 (0.0009) [2023-12-26 11:35:00,808][123091] Updated weights for policy 0, policy_version 1501391 (0.0009) [2023-12-26 11:35:01,083][123090] Updated weights for policy 1, policy_version 1491562 (0.0010) [2023-12-26 11:35:01,154][123090] Updated weights for policy 1, policy_version 1491572 (0.0009) [2023-12-26 11:35:01,207][123090] Updated weights for policy 1, policy_version 1491582 (0.0009) [2023-12-26 11:35:01,686][123091] Updated weights for policy 0, policy_version 1501401 (0.0009) [2023-12-26 11:35:01,753][123091] Updated weights for policy 0, policy_version 1501411 (0.0009) [2023-12-26 11:35:01,815][123091] Updated weights for policy 0, policy_version 1501421 (0.0009) [2023-12-26 11:35:02,040][123090] Updated weights for policy 1, policy_version 1491592 (0.0009) [2023-12-26 11:35:02,095][123090] Updated weights for policy 1, policy_version 1491602 (0.0009) [2023-12-26 11:35:02,146][123090] Updated weights for policy 1, policy_version 1491612 (0.0009) [2023-12-26 11:35:02,644][123091] Updated weights for policy 0, policy_version 1501431 (0.0007) [2023-12-26 11:35:02,718][123091] Updated weights for policy 0, policy_version 1501441 (0.0005) [2023-12-26 11:35:02,784][123091] Updated weights for policy 0, policy_version 1501451 (0.0007) [2023-12-26 11:35:02,979][123090] Updated weights for policy 1, policy_version 1491622 (0.0009) [2023-12-26 11:35:03,032][123090] Updated weights for policy 1, policy_version 1491632 (0.0005) [2023-12-26 11:35:03,082][123090] Updated weights for policy 1, policy_version 1491642 (0.0005) [2023-12-26 11:35:03,618][123091] Updated weights for policy 0, policy_version 1501461 (0.0009) [2023-12-26 11:35:03,668][123091] Updated weights for policy 0, policy_version 1501471 (0.0009) [2023-12-26 11:35:03,713][123091] Updated weights for policy 0, policy_version 1501481 (0.0010) [2023-12-26 11:35:03,771][123090] Updated weights for policy 1, policy_version 1491652 (0.0006) [2023-12-26 11:35:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 766246912. Throughput: 0: 8738.8, 1: 8923.0. Samples: 766257716. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:03,784][121949] Avg episode reward: [(0, '6280.134'), (1, '5747.562')] [2023-12-26 11:35:03,825][123090] Updated weights for policy 1, policy_version 1491662 (0.0006) [2023-12-26 11:35:03,888][123090] Updated weights for policy 1, policy_version 1491672 (0.0007) [2023-12-26 11:35:04,528][123091] Updated weights for policy 0, policy_version 1501491 (0.0010) [2023-12-26 11:35:04,587][123091] Updated weights for policy 0, policy_version 1501501 (0.0010) [2023-12-26 11:35:04,612][123090] Updated weights for policy 1, policy_version 1491682 (0.0005) [2023-12-26 11:35:04,660][123090] Updated weights for policy 1, policy_version 1491692 (0.0005) [2023-12-26 11:35:04,662][123091] Updated weights for policy 0, policy_version 1501511 (0.0006) [2023-12-26 11:35:04,715][123090] Updated weights for policy 1, policy_version 1491702 (0.0005) [2023-12-26 11:35:04,777][123090] Updated weights for policy 1, policy_version 1491712 (0.0005) [2023-12-26 11:35:05,350][123091] Updated weights for policy 0, policy_version 1501521 (0.0010) [2023-12-26 11:35:05,399][123091] Updated weights for policy 0, policy_version 1501531 (0.0005) [2023-12-26 11:35:05,458][123091] Updated weights for policy 0, policy_version 1501541 (0.0005) [2023-12-26 11:35:05,464][123090] Updated weights for policy 1, policy_version 1491722 (0.0008) [2023-12-26 11:35:05,513][123091] Updated weights for policy 0, policy_version 1501551 (0.0006) [2023-12-26 11:35:05,528][123090] Updated weights for policy 1, policy_version 1491732 (0.0007) [2023-12-26 11:35:05,588][123090] Updated weights for policy 1, policy_version 1491742 (0.0009) [2023-12-26 11:35:06,281][123091] Updated weights for policy 0, policy_version 1501561 (0.0010) [2023-12-26 11:35:06,349][123091] Updated weights for policy 0, policy_version 1501571 (0.0011) [2023-12-26 11:35:06,360][123090] Updated weights for policy 1, policy_version 1491752 (0.0008) [2023-12-26 11:35:06,414][123091] Updated weights for policy 0, policy_version 1501581 (0.0009) [2023-12-26 11:35:06,431][123090] Updated weights for policy 1, policy_version 1491762 (0.0008) [2023-12-26 11:35:06,503][123090] Updated weights for policy 1, policy_version 1491772 (0.0010) [2023-12-26 11:35:07,060][123091] Updated weights for policy 0, policy_version 1501591 (0.0009) [2023-12-26 11:35:07,115][123091] Updated weights for policy 0, policy_version 1501601 (0.0010) [2023-12-26 11:35:07,172][123091] Updated weights for policy 0, policy_version 1501611 (0.0009) [2023-12-26 11:35:07,407][123090] Updated weights for policy 1, policy_version 1491782 (0.0010) [2023-12-26 11:35:07,477][123090] Updated weights for policy 1, policy_version 1491792 (0.0009) [2023-12-26 11:35:07,541][123090] Updated weights for policy 1, policy_version 1491802 (0.0010) [2023-12-26 11:35:07,817][123091] Updated weights for policy 0, policy_version 1501621 (0.0008) [2023-12-26 11:35:07,878][123091] Updated weights for policy 0, policy_version 1501631 (0.0010) [2023-12-26 11:35:07,936][123091] Updated weights for policy 0, policy_version 1501641 (0.0010) [2023-12-26 11:35:08,391][123090] Updated weights for policy 1, policy_version 1491812 (0.0010) [2023-12-26 11:35:08,455][123090] Updated weights for policy 1, policy_version 1491822 (0.0010) [2023-12-26 11:35:08,524][123090] Updated weights for policy 1, policy_version 1491832 (0.0010) [2023-12-26 11:35:08,691][123091] Updated weights for policy 0, policy_version 1501651 (0.0011) [2023-12-26 11:35:08,754][123091] Updated weights for policy 0, policy_version 1501661 (0.0011) [2023-12-26 11:35:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 766337024. Throughput: 0: 8797.5, 1: 9006.9. Samples: 766313796. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:08,785][121949] Avg episode reward: [(0, '6214.471'), (1, '5326.686')] [2023-12-26 11:35:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001491840_381911040.pth... [2023-12-26 11:35:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001490816_381648896.pth [2023-12-26 11:35:08,812][123091] Updated weights for policy 0, policy_version 1501671 (0.0010) [2023-12-26 11:35:08,868][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001501680_384434176.pth... [2023-12-26 11:35:08,872][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001500624_384163840.pth [2023-12-26 11:35:09,390][123090] Updated weights for policy 1, policy_version 1491842 (0.0009) [2023-12-26 11:35:09,465][123090] Updated weights for policy 1, policy_version 1491852 (0.0007) [2023-12-26 11:35:09,535][123090] Updated weights for policy 1, policy_version 1491862 (0.0007) [2023-12-26 11:35:09,604][123091] Updated weights for policy 0, policy_version 1501681 (0.0010) [2023-12-26 11:35:09,610][123090] Updated weights for policy 1, policy_version 1491872 (0.0006) [2023-12-26 11:35:09,670][123091] Updated weights for policy 0, policy_version 1501691 (0.0011) [2023-12-26 11:35:09,733][123091] Updated weights for policy 0, policy_version 1501701 (0.0008) [2023-12-26 11:35:09,804][123091] Updated weights for policy 0, policy_version 1501711 (0.0005) [2023-12-26 11:35:10,462][123090] Updated weights for policy 1, policy_version 1491882 (0.0006) [2023-12-26 11:35:10,536][123090] Updated weights for policy 1, policy_version 1491892 (0.0006) [2023-12-26 11:35:10,593][123091] Updated weights for policy 0, policy_version 1501721 (0.0006) [2023-12-26 11:35:10,607][123090] Updated weights for policy 1, policy_version 1491902 (0.0006) [2023-12-26 11:35:10,652][123091] Updated weights for policy 0, policy_version 1501731 (0.0005) [2023-12-26 11:35:10,720][123091] Updated weights for policy 0, policy_version 1501741 (0.0005) [2023-12-26 11:35:11,315][123090] Updated weights for policy 1, policy_version 1491912 (0.0008) [2023-12-26 11:35:11,383][123090] Updated weights for policy 1, policy_version 1491922 (0.0008) [2023-12-26 11:35:11,396][123091] Updated weights for policy 0, policy_version 1501751 (0.0009) [2023-12-26 11:35:11,459][123090] Updated weights for policy 1, policy_version 1491932 (0.0007) [2023-12-26 11:35:11,468][123091] Updated weights for policy 0, policy_version 1501761 (0.0007) [2023-12-26 11:35:11,540][123091] Updated weights for policy 0, policy_version 1501771 (0.0008) [2023-12-26 11:35:12,280][123091] Updated weights for policy 0, policy_version 1501781 (0.0010) [2023-12-26 11:35:12,337][123091] Updated weights for policy 0, policy_version 1501791 (0.0010) [2023-12-26 11:35:12,340][123090] Updated weights for policy 1, policy_version 1491942 (0.0007) [2023-12-26 11:35:12,409][123090] Updated weights for policy 1, policy_version 1491952 (0.0007) [2023-12-26 11:35:12,415][123091] Updated weights for policy 0, policy_version 1501801 (0.0009) [2023-12-26 11:35:12,481][123090] Updated weights for policy 1, policy_version 1491962 (0.0009) [2023-12-26 11:35:13,178][123091] Updated weights for policy 0, policy_version 1501811 (0.0006) [2023-12-26 11:35:13,225][123091] Updated weights for policy 0, policy_version 1501821 (0.0005) [2023-12-26 11:35:13,250][123090] Updated weights for policy 1, policy_version 1491972 (0.0009) [2023-12-26 11:35:13,284][123091] Updated weights for policy 0, policy_version 1501831 (0.0005) [2023-12-26 11:35:13,305][123090] Updated weights for policy 1, policy_version 1491982 (0.0010) [2023-12-26 11:35:13,366][123090] Updated weights for policy 1, policy_version 1491993 (0.0010) [2023-12-26 11:35:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 766427136. Throughput: 0: 8849.5, 1: 8846.3. Samples: 766420440. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:13,785][121949] Avg episode reward: [(0, '6022.161'), (1, '5345.217')] [2023-12-26 11:35:13,969][123091] Updated weights for policy 0, policy_version 1501841 (0.0005) [2023-12-26 11:35:14,027][123091] Updated weights for policy 0, policy_version 1501851 (0.0005) [2023-12-26 11:35:14,081][123091] Updated weights for policy 0, policy_version 1501861 (0.0005) [2023-12-26 11:35:14,131][123091] Updated weights for policy 0, policy_version 1501871 (0.0005) [2023-12-26 11:35:14,338][123090] Updated weights for policy 1, policy_version 1492003 (0.0009) [2023-12-26 11:35:14,396][123090] Updated weights for policy 1, policy_version 1492013 (0.0009) [2023-12-26 11:35:14,453][123090] Updated weights for policy 1, policy_version 1492023 (0.0009) [2023-12-26 11:35:14,876][123091] Updated weights for policy 0, policy_version 1501881 (0.0010) [2023-12-26 11:35:14,935][123091] Updated weights for policy 0, policy_version 1501891 (0.0011) [2023-12-26 11:35:14,995][123091] Updated weights for policy 0, policy_version 1501901 (0.0011) [2023-12-26 11:35:15,317][123090] Updated weights for policy 1, policy_version 1492033 (0.0008) [2023-12-26 11:35:15,389][123090] Updated weights for policy 1, policy_version 1492043 (0.0008) [2023-12-26 11:35:15,450][123090] Updated weights for policy 1, policy_version 1492053 (0.0009) [2023-12-26 11:35:15,498][123090] Updated weights for policy 1, policy_version 1492063 (0.0009) [2023-12-26 11:35:15,815][123091] Updated weights for policy 0, policy_version 1501911 (0.0011) [2023-12-26 11:35:15,867][123091] Updated weights for policy 0, policy_version 1501921 (0.0007) [2023-12-26 11:35:15,915][123091] Updated weights for policy 0, policy_version 1501931 (0.0005) [2023-12-26 11:35:16,369][123090] Updated weights for policy 1, policy_version 1492073 (0.0009) [2023-12-26 11:35:16,428][123090] Updated weights for policy 1, policy_version 1492083 (0.0010) [2023-12-26 11:35:16,481][123090] Updated weights for policy 1, policy_version 1492093 (0.0009) [2023-12-26 11:35:16,537][123091] Updated weights for policy 0, policy_version 1501941 (0.0007) [2023-12-26 11:35:16,603][123091] Updated weights for policy 0, policy_version 1501951 (0.0010) [2023-12-26 11:35:16,675][123091] Updated weights for policy 0, policy_version 1501961 (0.0009) [2023-12-26 11:35:17,345][123090] Updated weights for policy 1, policy_version 1492103 (0.0010) [2023-12-26 11:35:17,394][123090] Updated weights for policy 1, policy_version 1492113 (0.0009) [2023-12-26 11:35:17,442][123090] Updated weights for policy 1, policy_version 1492123 (0.0009) [2023-12-26 11:35:17,486][123091] Updated weights for policy 0, policy_version 1501971 (0.0009) [2023-12-26 11:35:17,544][123091] Updated weights for policy 0, policy_version 1501981 (0.0009) [2023-12-26 11:35:17,615][123091] Updated weights for policy 0, policy_version 1501991 (0.0009) [2023-12-26 11:35:18,295][123090] Updated weights for policy 1, policy_version 1492133 (0.0010) [2023-12-26 11:35:18,357][123090] Updated weights for policy 1, policy_version 1492143 (0.0009) [2023-12-26 11:35:18,421][123090] Updated weights for policy 1, policy_version 1492153 (0.0009) [2023-12-26 11:35:18,442][123091] Updated weights for policy 0, policy_version 1502001 (0.0009) [2023-12-26 11:35:18,512][123091] Updated weights for policy 0, policy_version 1502011 (0.0007) [2023-12-26 11:35:18,582][123091] Updated weights for policy 0, policy_version 1502021 (0.0007) [2023-12-26 11:35:18,652][123091] Updated weights for policy 0, policy_version 1502031 (0.0007) [2023-12-26 11:35:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 766517248. Throughput: 0: 8866.2, 1: 8749.1. Samples: 766525024. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:18,785][121949] Avg episode reward: [(0, '6106.391'), (1, '5397.031')] [2023-12-26 11:35:19,285][123090] Updated weights for policy 1, policy_version 1492163 (0.0009) [2023-12-26 11:35:19,361][123090] Updated weights for policy 1, policy_version 1492173 (0.0010) [2023-12-26 11:35:19,423][123090] Updated weights for policy 1, policy_version 1492183 (0.0011) [2023-12-26 11:35:19,443][123091] Updated weights for policy 0, policy_version 1502041 (0.0006) [2023-12-26 11:35:19,508][123091] Updated weights for policy 0, policy_version 1502051 (0.0007) [2023-12-26 11:35:19,584][123091] Updated weights for policy 0, policy_version 1502061 (0.0009) [2023-12-26 11:35:20,310][123090] Updated weights for policy 1, policy_version 1492193 (0.0010) [2023-12-26 11:35:20,378][123090] Updated weights for policy 1, policy_version 1492203 (0.0009) [2023-12-26 11:35:20,397][123091] Updated weights for policy 0, policy_version 1502071 (0.0007) [2023-12-26 11:35:20,442][123090] Updated weights for policy 1, policy_version 1492213 (0.0010) [2023-12-26 11:35:20,458][123091] Updated weights for policy 0, policy_version 1502081 (0.0008) [2023-12-26 11:35:20,508][123090] Updated weights for policy 1, policy_version 1492223 (0.0010) [2023-12-26 11:35:20,515][123091] Updated weights for policy 0, policy_version 1502091 (0.0007) [2023-12-26 11:35:21,353][123091] Updated weights for policy 0, policy_version 1502101 (0.0010) [2023-12-26 11:35:21,390][123090] Updated weights for policy 1, policy_version 1492233 (0.0009) [2023-12-26 11:35:21,428][123091] Updated weights for policy 0, policy_version 1502111 (0.0009) [2023-12-26 11:35:21,456][123090] Updated weights for policy 1, policy_version 1492243 (0.0009) [2023-12-26 11:35:21,483][123091] Updated weights for policy 0, policy_version 1502121 (0.0006) [2023-12-26 11:35:21,510][123090] Updated weights for policy 1, policy_version 1492253 (0.0009) [2023-12-26 11:35:22,202][123091] Updated weights for policy 0, policy_version 1502131 (0.0007) [2023-12-26 11:35:22,268][123091] Updated weights for policy 0, policy_version 1502141 (0.0010) [2023-12-26 11:35:22,338][123091] Updated weights for policy 0, policy_version 1502151 (0.0009) [2023-12-26 11:35:22,421][123090] Updated weights for policy 1, policy_version 1492263 (0.0010) [2023-12-26 11:35:22,476][123090] Updated weights for policy 1, policy_version 1492273 (0.0010) [2023-12-26 11:35:22,536][123090] Updated weights for policy 1, policy_version 1492283 (0.0010) [2023-12-26 11:35:23,097][123091] Updated weights for policy 0, policy_version 1502161 (0.0008) [2023-12-26 11:35:23,151][123091] Updated weights for policy 0, policy_version 1502171 (0.0005) [2023-12-26 11:35:23,195][123091] Updated weights for policy 0, policy_version 1502181 (0.0005) [2023-12-26 11:35:23,242][123091] Updated weights for policy 0, policy_version 1502191 (0.0007) [2023-12-26 11:35:23,422][123090] Updated weights for policy 1, policy_version 1492293 (0.0009) [2023-12-26 11:35:23,474][123090] Updated weights for policy 1, policy_version 1492303 (0.0009) [2023-12-26 11:35:23,542][123090] Updated weights for policy 1, policy_version 1492313 (0.0010) [2023-12-26 11:35:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 766599168. Throughput: 0: 8876.1, 1: 8645.0. Samples: 766574360. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:23,784][121949] Avg episode reward: [(0, '6298.191'), (1, '5469.924')] [2023-12-26 11:35:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001502192_384565248.pth... [2023-12-26 11:35:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001492320_382033920.pth... [2023-12-26 11:35:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001491328_381779968.pth [2023-12-26 11:35:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001501136_384294912.pth [2023-12-26 11:35:23,969][123091] Updated weights for policy 0, policy_version 1502201 (0.0009) [2023-12-26 11:35:24,022][123091] Updated weights for policy 0, policy_version 1502211 (0.0009) [2023-12-26 11:35:24,079][123091] Updated weights for policy 0, policy_version 1502221 (0.0010) [2023-12-26 11:35:24,407][123090] Updated weights for policy 1, policy_version 1492323 (0.0010) [2023-12-26 11:35:24,458][123090] Updated weights for policy 1, policy_version 1492333 (0.0009) [2023-12-26 11:35:24,514][123090] Updated weights for policy 1, policy_version 1492343 (0.0008) [2023-12-26 11:35:24,892][123091] Updated weights for policy 0, policy_version 1502231 (0.0010) [2023-12-26 11:35:24,947][123091] Updated weights for policy 0, policy_version 1502241 (0.0009) [2023-12-26 11:35:24,996][123091] Updated weights for policy 0, policy_version 1502251 (0.0009) [2023-12-26 11:35:25,353][123090] Updated weights for policy 1, policy_version 1492353 (0.0009) [2023-12-26 11:35:25,402][123090] Updated weights for policy 1, policy_version 1492363 (0.0009) [2023-12-26 11:35:25,453][123090] Updated weights for policy 1, policy_version 1492374 (0.0010) [2023-12-26 11:35:25,507][123090] Updated weights for policy 1, policy_version 1492384 (0.0009) [2023-12-26 11:35:25,820][123091] Updated weights for policy 0, policy_version 1502261 (0.0007) [2023-12-26 11:35:25,878][123091] Updated weights for policy 0, policy_version 1502271 (0.0005) [2023-12-26 11:35:25,925][123091] Updated weights for policy 0, policy_version 1502281 (0.0006) [2023-12-26 11:35:26,396][123090] Updated weights for policy 1, policy_version 1492394 (0.0009) [2023-12-26 11:35:26,450][123090] Updated weights for policy 1, policy_version 1492404 (0.0009) [2023-12-26 11:35:26,513][123090] Updated weights for policy 1, policy_version 1492414 (0.0010) [2023-12-26 11:35:26,688][123091] Updated weights for policy 0, policy_version 1502291 (0.0008) [2023-12-26 11:35:26,756][123091] Updated weights for policy 0, policy_version 1502301 (0.0006) [2023-12-26 11:35:26,814][123091] Updated weights for policy 0, policy_version 1502311 (0.0010) [2023-12-26 11:35:27,445][123090] Updated weights for policy 1, policy_version 1492424 (0.0009) [2023-12-26 11:35:27,506][123090] Updated weights for policy 1, policy_version 1492435 (0.0010) [2023-12-26 11:35:27,512][123091] Updated weights for policy 0, policy_version 1502321 (0.0010) [2023-12-26 11:35:27,556][123090] Updated weights for policy 1, policy_version 1492446 (0.0009) [2023-12-26 11:35:27,572][123091] Updated weights for policy 0, policy_version 1502331 (0.0005) [2023-12-26 11:35:27,633][123091] Updated weights for policy 0, policy_version 1502341 (0.0005) [2023-12-26 11:35:27,702][123091] Updated weights for policy 0, policy_version 1502351 (0.0005) [2023-12-26 11:35:28,336][123091] Updated weights for policy 0, policy_version 1502361 (0.0006) [2023-12-26 11:35:28,400][123091] Updated weights for policy 0, policy_version 1502371 (0.0009) [2023-12-26 11:35:28,468][123091] Updated weights for policy 0, policy_version 1502381 (0.0009) [2023-12-26 11:35:28,490][123090] Updated weights for policy 1, policy_version 1492456 (0.0010) [2023-12-26 11:35:28,558][123090] Updated weights for policy 1, policy_version 1492466 (0.0009) [2023-12-26 11:35:28,619][123090] Updated weights for policy 1, policy_version 1492476 (0.0009) [2023-12-26 11:35:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 766689280. Throughput: 0: 8946.1, 1: 8543.6. Samples: 766678304. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:28,784][121949] Avg episode reward: [(0, '6339.422'), (1, '5515.424')] [2023-12-26 11:35:29,308][123091] Updated weights for policy 0, policy_version 1502391 (0.0007) [2023-12-26 11:35:29,381][123091] Updated weights for policy 0, policy_version 1502401 (0.0007) [2023-12-26 11:35:29,402][123090] Updated weights for policy 1, policy_version 1492486 (0.0010) [2023-12-26 11:35:29,441][123091] Updated weights for policy 0, policy_version 1502411 (0.0008) [2023-12-26 11:35:29,466][123090] Updated weights for policy 1, policy_version 1492496 (0.0008) [2023-12-26 11:35:29,522][123090] Updated weights for policy 1, policy_version 1492506 (0.0010) [2023-12-26 11:35:30,250][123090] Updated weights for policy 1, policy_version 1492516 (0.0008) [2023-12-26 11:35:30,254][123091] Updated weights for policy 0, policy_version 1502421 (0.0008) [2023-12-26 11:35:30,313][123091] Updated weights for policy 0, policy_version 1502431 (0.0008) [2023-12-26 11:35:30,324][123090] Updated weights for policy 1, policy_version 1492526 (0.0005) [2023-12-26 11:35:30,369][123091] Updated weights for policy 0, policy_version 1502441 (0.0008) [2023-12-26 11:35:30,376][123090] Updated weights for policy 1, policy_version 1492536 (0.0008) [2023-12-26 11:35:31,126][123091] Updated weights for policy 0, policy_version 1502451 (0.0008) [2023-12-26 11:35:31,187][123091] Updated weights for policy 0, policy_version 1502461 (0.0010) [2023-12-26 11:35:31,198][123090] Updated weights for policy 1, policy_version 1492546 (0.0009) [2023-12-26 11:35:31,238][123091] Updated weights for policy 0, policy_version 1502471 (0.0010) [2023-12-26 11:35:31,258][123090] Updated weights for policy 1, policy_version 1492556 (0.0006) [2023-12-26 11:35:31,316][123090] Updated weights for policy 1, policy_version 1492566 (0.0007) [2023-12-26 11:35:31,379][123090] Updated weights for policy 1, policy_version 1492576 (0.0009) [2023-12-26 11:35:31,991][123091] Updated weights for policy 0, policy_version 1502481 (0.0010) [2023-12-26 11:35:32,048][123091] Updated weights for policy 0, policy_version 1502491 (0.0005) [2023-12-26 11:35:32,118][123091] Updated weights for policy 0, policy_version 1502501 (0.0006) [2023-12-26 11:35:32,191][123091] Updated weights for policy 0, policy_version 1502511 (0.0006) [2023-12-26 11:35:32,354][123090] Updated weights for policy 1, policy_version 1492586 (0.0010) [2023-12-26 11:35:32,423][123090] Updated weights for policy 1, policy_version 1492596 (0.0009) [2023-12-26 11:35:32,499][123090] Updated weights for policy 1, policy_version 1492606 (0.0009) [2023-12-26 11:35:32,909][123091] Updated weights for policy 0, policy_version 1502521 (0.0009) [2023-12-26 11:35:32,966][123091] Updated weights for policy 0, policy_version 1502531 (0.0009) [2023-12-26 11:35:33,021][123091] Updated weights for policy 0, policy_version 1502541 (0.0009) [2023-12-26 11:35:33,252][123090] Updated weights for policy 1, policy_version 1492616 (0.0008) [2023-12-26 11:35:33,305][123090] Updated weights for policy 1, policy_version 1492626 (0.0010) [2023-12-26 11:35:33,359][123090] Updated weights for policy 1, policy_version 1492636 (0.0009) [2023-12-26 11:35:33,730][123091] Updated weights for policy 0, policy_version 1502551 (0.0009) [2023-12-26 11:35:33,777][123091] Updated weights for policy 0, policy_version 1502561 (0.0009) [2023-12-26 11:35:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 766771200. Throughput: 0: 9026.9, 1: 8458.4. Samples: 766784912. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:33,785][121949] Avg episode reward: [(0, '6297.976'), (1, '5247.295')] [2023-12-26 11:35:33,827][123091] Updated weights for policy 0, policy_version 1502571 (0.0009) [2023-12-26 11:35:34,237][123090] Updated weights for policy 1, policy_version 1492646 (0.0007) [2023-12-26 11:35:34,310][123090] Updated weights for policy 1, policy_version 1492656 (0.0005) [2023-12-26 11:35:34,387][123090] Updated weights for policy 1, policy_version 1492666 (0.0006) [2023-12-26 11:35:34,720][123091] Updated weights for policy 0, policy_version 1502581 (0.0008) [2023-12-26 11:35:34,786][123091] Updated weights for policy 0, policy_version 1502591 (0.0005) [2023-12-26 11:35:34,863][123091] Updated weights for policy 0, policy_version 1502601 (0.0006) [2023-12-26 11:35:35,055][123090] Updated weights for policy 1, policy_version 1492676 (0.0006) [2023-12-26 11:35:35,123][123090] Updated weights for policy 1, policy_version 1492686 (0.0010) [2023-12-26 11:35:35,221][123090] Updated weights for policy 1, policy_version 1492696 (0.0009) [2023-12-26 11:35:35,592][123091] Updated weights for policy 0, policy_version 1502611 (0.0008) [2023-12-26 11:35:35,641][123091] Updated weights for policy 0, policy_version 1502621 (0.0006) [2023-12-26 11:35:35,693][123091] Updated weights for policy 0, policy_version 1502631 (0.0005) [2023-12-26 11:35:35,884][123090] Updated weights for policy 1, policy_version 1492706 (0.0008) [2023-12-26 11:35:35,947][123090] Updated weights for policy 1, policy_version 1492716 (0.0010) [2023-12-26 11:35:36,010][123090] Updated weights for policy 1, policy_version 1492726 (0.0010) [2023-12-26 11:35:36,061][123090] Updated weights for policy 1, policy_version 1492736 (0.0010) [2023-12-26 11:35:36,506][123091] Updated weights for policy 0, policy_version 1502641 (0.0007) [2023-12-26 11:35:36,563][123091] Updated weights for policy 0, policy_version 1502651 (0.0009) [2023-12-26 11:35:36,622][123091] Updated weights for policy 0, policy_version 1502661 (0.0009) [2023-12-26 11:35:36,672][123091] Updated weights for policy 0, policy_version 1502671 (0.0009) [2023-12-26 11:35:36,832][123090] Updated weights for policy 1, policy_version 1492746 (0.0011) [2023-12-26 11:35:36,884][123090] Updated weights for policy 1, policy_version 1492756 (0.0010) [2023-12-26 11:35:36,943][123090] Updated weights for policy 1, policy_version 1492766 (0.0010) [2023-12-26 11:35:37,530][123091] Updated weights for policy 0, policy_version 1502681 (0.0009) [2023-12-26 11:35:37,583][123091] Updated weights for policy 0, policy_version 1502691 (0.0009) [2023-12-26 11:35:37,646][123091] Updated weights for policy 0, policy_version 1502701 (0.0008) [2023-12-26 11:35:37,785][123090] Updated weights for policy 1, policy_version 1492776 (0.0010) [2023-12-26 11:35:37,845][123090] Updated weights for policy 1, policy_version 1492786 (0.0011) [2023-12-26 11:35:37,902][123090] Updated weights for policy 1, policy_version 1492796 (0.0011) [2023-12-26 11:35:38,501][123091] Updated weights for policy 0, policy_version 1502711 (0.0010) [2023-12-26 11:35:38,549][123091] Updated weights for policy 0, policy_version 1502721 (0.0010) [2023-12-26 11:35:38,600][123091] Updated weights for policy 0, policy_version 1502731 (0.0010) [2023-12-26 11:35:38,654][123090] Updated weights for policy 1, policy_version 1492806 (0.0009) [2023-12-26 11:35:38,724][123090] Updated weights for policy 1, policy_version 1492816 (0.0005) [2023-12-26 11:35:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 766861312. Throughput: 0: 9040.3, 1: 8492.2. Samples: 766839684. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:38,785][121949] Avg episode reward: [(0, '6293.325'), (1, '5090.396')] [2023-12-26 11:35:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001502736_384704512.pth... [2023-12-26 11:35:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001501680_384434176.pth [2023-12-26 11:35:38,798][123090] Updated weights for policy 1, policy_version 1492826 (0.0005) [2023-12-26 11:35:38,842][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001492832_382164992.pth... [2023-12-26 11:35:38,848][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001491840_381911040.pth [2023-12-26 11:35:39,442][123091] Updated weights for policy 0, policy_version 1502741 (0.0010) [2023-12-26 11:35:39,498][123091] Updated weights for policy 0, policy_version 1502751 (0.0008) [2023-12-26 11:35:39,561][123091] Updated weights for policy 0, policy_version 1502761 (0.0006) [2023-12-26 11:35:39,630][123090] Updated weights for policy 1, policy_version 1492836 (0.0008) [2023-12-26 11:35:39,693][123090] Updated weights for policy 1, policy_version 1492846 (0.0009) [2023-12-26 11:35:39,763][123090] Updated weights for policy 1, policy_version 1492856 (0.0010) [2023-12-26 11:35:40,358][123091] Updated weights for policy 0, policy_version 1502771 (0.0007) [2023-12-26 11:35:40,408][123091] Updated weights for policy 0, policy_version 1502781 (0.0009) [2023-12-26 11:35:40,458][123091] Updated weights for policy 0, policy_version 1502791 (0.0009) [2023-12-26 11:35:40,596][123090] Updated weights for policy 1, policy_version 1492866 (0.0009) [2023-12-26 11:35:40,648][123090] Updated weights for policy 1, policy_version 1492876 (0.0005) [2023-12-26 11:35:40,700][123090] Updated weights for policy 1, policy_version 1492886 (0.0006) [2023-12-26 11:35:40,749][123090] Updated weights for policy 1, policy_version 1492896 (0.0005) [2023-12-26 11:35:41,228][123091] Updated weights for policy 0, policy_version 1502801 (0.0007) [2023-12-26 11:35:41,293][123091] Updated weights for policy 0, policy_version 1502811 (0.0010) [2023-12-26 11:35:41,360][123091] Updated weights for policy 0, policy_version 1502821 (0.0010) [2023-12-26 11:35:41,427][123091] Updated weights for policy 0, policy_version 1502831 (0.0007) [2023-12-26 11:35:41,502][123090] Updated weights for policy 1, policy_version 1492906 (0.0009) [2023-12-26 11:35:41,565][123090] Updated weights for policy 1, policy_version 1492917 (0.0010) [2023-12-26 11:35:41,628][123090] Updated weights for policy 1, policy_version 1492927 (0.0010) [2023-12-26 11:35:42,227][123091] Updated weights for policy 0, policy_version 1502841 (0.0010) [2023-12-26 11:35:42,290][123091] Updated weights for policy 0, policy_version 1502851 (0.0009) [2023-12-26 11:35:42,354][123091] Updated weights for policy 0, policy_version 1502861 (0.0010) [2023-12-26 11:35:42,482][123090] Updated weights for policy 1, policy_version 1492937 (0.0010) [2023-12-26 11:35:42,536][123090] Updated weights for policy 1, policy_version 1492947 (0.0010) [2023-12-26 11:35:42,596][123090] Updated weights for policy 1, policy_version 1492957 (0.0009) [2023-12-26 11:35:43,188][123091] Updated weights for policy 0, policy_version 1502871 (0.0010) [2023-12-26 11:35:43,245][123091] Updated weights for policy 0, policy_version 1502882 (0.0010) [2023-12-26 11:35:43,293][123091] Updated weights for policy 0, policy_version 1502892 (0.0010) [2023-12-26 11:35:43,312][123090] Updated weights for policy 1, policy_version 1492967 (0.0009) [2023-12-26 11:35:43,363][123090] Updated weights for policy 1, policy_version 1492977 (0.0009) [2023-12-26 11:35:43,416][123090] Updated weights for policy 1, policy_version 1492987 (0.0010) [2023-12-26 11:35:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 766951424. Throughput: 0: 9026.8, 1: 8510.1. Samples: 766943420. Policy #0 lag: (min: 31.0, avg: 31.2, max: 42.0) [2023-12-26 11:35:43,784][121949] Avg episode reward: [(0, '6316.010'), (1, '5232.895')] [2023-12-26 11:35:43,966][123091] Updated weights for policy 0, policy_version 1502902 (0.0008) [2023-12-26 11:35:44,035][123091] Updated weights for policy 0, policy_version 1502912 (0.0008) [2023-12-26 11:35:44,108][123091] Updated weights for policy 0, policy_version 1502922 (0.0008) [2023-12-26 11:35:44,312][123090] Updated weights for policy 1, policy_version 1492997 (0.0007) [2023-12-26 11:35:44,376][123090] Updated weights for policy 1, policy_version 1493007 (0.0007) [2023-12-26 11:35:44,443][123090] Updated weights for policy 1, policy_version 1493017 (0.0009) [2023-12-26 11:35:44,789][123091] Updated weights for policy 0, policy_version 1502932 (0.0010) [2023-12-26 11:35:44,850][123091] Updated weights for policy 0, policy_version 1502942 (0.0009) [2023-12-26 11:35:44,923][123091] Updated weights for policy 0, policy_version 1502952 (0.0010) [2023-12-26 11:35:45,353][123090] Updated weights for policy 1, policy_version 1493028 (0.0010) [2023-12-26 11:35:45,406][123090] Updated weights for policy 1, policy_version 1493038 (0.0009) [2023-12-26 11:35:45,457][123090] Updated weights for policy 1, policy_version 1493048 (0.0009) [2023-12-26 11:35:45,711][123091] Updated weights for policy 0, policy_version 1502962 (0.0010) [2023-12-26 11:35:45,784][123091] Updated weights for policy 0, policy_version 1502972 (0.0009) [2023-12-26 11:35:45,849][123091] Updated weights for policy 0, policy_version 1502982 (0.0009) [2023-12-26 11:35:45,906][123091] Updated weights for policy 0, policy_version 1502992 (0.0010) [2023-12-26 11:35:46,302][123090] Updated weights for policy 1, policy_version 1493058 (0.0009) [2023-12-26 11:35:46,357][123090] Updated weights for policy 1, policy_version 1493068 (0.0009) [2023-12-26 11:35:46,407][123090] Updated weights for policy 1, policy_version 1493078 (0.0009) [2023-12-26 11:35:46,455][123090] Updated weights for policy 1, policy_version 1493088 (0.0009) [2023-12-26 11:35:46,730][123091] Updated weights for policy 0, policy_version 1503002 (0.0010) [2023-12-26 11:35:46,795][123091] Updated weights for policy 0, policy_version 1503012 (0.0010) [2023-12-26 11:35:46,858][123091] Updated weights for policy 0, policy_version 1503022 (0.0009) [2023-12-26 11:35:47,302][123090] Updated weights for policy 1, policy_version 1493098 (0.0009) [2023-12-26 11:35:47,362][123090] Updated weights for policy 1, policy_version 1493108 (0.0009) [2023-12-26 11:35:47,419][123090] Updated weights for policy 1, policy_version 1493119 (0.0010) [2023-12-26 11:35:47,651][123091] Updated weights for policy 0, policy_version 1503032 (0.0009) [2023-12-26 11:35:47,712][123091] Updated weights for policy 0, policy_version 1503042 (0.0009) [2023-12-26 11:35:47,782][123091] Updated weights for policy 0, policy_version 1503052 (0.0010) [2023-12-26 11:35:48,246][123090] Updated weights for policy 1, policy_version 1493129 (0.0008) [2023-12-26 11:35:48,302][123090] Updated weights for policy 1, policy_version 1493139 (0.0009) [2023-12-26 11:35:48,371][123090] Updated weights for policy 1, policy_version 1493149 (0.0009) [2023-12-26 11:35:48,628][123091] Updated weights for policy 0, policy_version 1503062 (0.0009) [2023-12-26 11:35:48,688][123091] Updated weights for policy 0, policy_version 1503072 (0.0008) [2023-12-26 11:35:48,752][123091] Updated weights for policy 0, policy_version 1503082 (0.0009) [2023-12-26 11:35:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 767033344. Throughput: 0: 9084.2, 1: 8487.5. Samples: 767048440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:35:48,784][121949] Avg episode reward: [(0, '6289.298'), (1, '5373.312')] [2023-12-26 11:35:49,168][123090] Updated weights for policy 1, policy_version 1493159 (0.0007) [2023-12-26 11:35:49,228][123090] Updated weights for policy 1, policy_version 1493169 (0.0006) [2023-12-26 11:35:49,295][123090] Updated weights for policy 1, policy_version 1493179 (0.0009) [2023-12-26 11:35:49,602][123091] Updated weights for policy 0, policy_version 1503092 (0.0009) [2023-12-26 11:35:49,663][123091] Updated weights for policy 0, policy_version 1503102 (0.0009) [2023-12-26 11:35:49,731][123091] Updated weights for policy 0, policy_version 1503112 (0.0009) [2023-12-26 11:35:50,128][123090] Updated weights for policy 1, policy_version 1493189 (0.0009) [2023-12-26 11:35:50,194][123090] Updated weights for policy 1, policy_version 1493199 (0.0009) [2023-12-26 11:35:50,259][123090] Updated weights for policy 1, policy_version 1493209 (0.0009) [2023-12-26 11:35:50,605][123091] Updated weights for policy 0, policy_version 1503122 (0.0009) [2023-12-26 11:35:50,659][123091] Updated weights for policy 0, policy_version 1503132 (0.0011) [2023-12-26 11:35:50,727][123091] Updated weights for policy 0, policy_version 1503142 (0.0006) [2023-12-26 11:35:50,792][123091] Updated weights for policy 0, policy_version 1503152 (0.0006) [2023-12-26 11:35:51,167][123090] Updated weights for policy 1, policy_version 1493219 (0.0009) [2023-12-26 11:35:51,231][123090] Updated weights for policy 1, policy_version 1493229 (0.0009) [2023-12-26 11:35:51,296][123090] Updated weights for policy 1, policy_version 1493239 (0.0009) [2023-12-26 11:35:51,479][123091] Updated weights for policy 0, policy_version 1503162 (0.0011) [2023-12-26 11:35:51,535][123091] Updated weights for policy 0, policy_version 1503172 (0.0011) [2023-12-26 11:35:51,591][123091] Updated weights for policy 0, policy_version 1503182 (0.0011) [2023-12-26 11:35:52,135][123090] Updated weights for policy 1, policy_version 1493249 (0.0009) [2023-12-26 11:35:52,188][123090] Updated weights for policy 1, policy_version 1493259 (0.0008) [2023-12-26 11:35:52,250][123090] Updated weights for policy 1, policy_version 1493269 (0.0010) [2023-12-26 11:35:52,321][123090] Updated weights for policy 1, policy_version 1493279 (0.0010) [2023-12-26 11:35:52,448][123091] Updated weights for policy 0, policy_version 1503192 (0.0011) [2023-12-26 11:35:52,515][123091] Updated weights for policy 0, policy_version 1503202 (0.0011) [2023-12-26 11:35:52,574][123091] Updated weights for policy 0, policy_version 1503212 (0.0011) [2023-12-26 11:35:53,077][123090] Updated weights for policy 1, policy_version 1493289 (0.0005) [2023-12-26 11:35:53,135][123090] Updated weights for policy 1, policy_version 1493299 (0.0005) [2023-12-26 11:35:53,187][123090] Updated weights for policy 1, policy_version 1493309 (0.0005) [2023-12-26 11:35:53,419][123091] Updated weights for policy 0, policy_version 1503222 (0.0010) [2023-12-26 11:35:53,479][123091] Updated weights for policy 0, policy_version 1503233 (0.0008) [2023-12-26 11:35:53,535][123091] Updated weights for policy 0, policy_version 1503243 (0.0006) [2023-12-26 11:35:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 767123456. Throughput: 0: 9032.8, 1: 8419.5. Samples: 767099156. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:35:53,785][121949] Avg episode reward: [(0, '6217.630'), (1, '5419.753')] [2023-12-26 11:35:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001503248_384835584.pth... [2023-12-26 11:35:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001493312_382287872.pth... [2023-12-26 11:35:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001502192_384565248.pth [2023-12-26 11:35:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001492320_382033920.pth [2023-12-26 11:35:53,982][123090] Updated weights for policy 1, policy_version 1493319 (0.0009) [2023-12-26 11:35:54,040][123090] Updated weights for policy 1, policy_version 1493330 (0.0010) [2023-12-26 11:35:54,096][123090] Updated weights for policy 1, policy_version 1493340 (0.0010) [2023-12-26 11:35:54,229][123091] Updated weights for policy 0, policy_version 1503253 (0.0005) [2023-12-26 11:35:54,281][123091] Updated weights for policy 0, policy_version 1503263 (0.0005) [2023-12-26 11:35:54,334][123091] Updated weights for policy 0, policy_version 1503273 (0.0006) [2023-12-26 11:35:55,027][123090] Updated weights for policy 1, policy_version 1493350 (0.0010) [2023-12-26 11:35:55,082][123090] Updated weights for policy 1, policy_version 1493360 (0.0010) [2023-12-26 11:35:55,113][123091] Updated weights for policy 0, policy_version 1503283 (0.0008) [2023-12-26 11:35:55,133][123090] Updated weights for policy 1, policy_version 1493370 (0.0007) [2023-12-26 11:35:55,164][123091] Updated weights for policy 0, policy_version 1503293 (0.0007) [2023-12-26 11:35:55,217][123091] Updated weights for policy 0, policy_version 1503303 (0.0005) [2023-12-26 11:35:55,885][123091] Updated weights for policy 0, policy_version 1503313 (0.0006) [2023-12-26 11:35:55,944][123091] Updated weights for policy 0, policy_version 1503323 (0.0009) [2023-12-26 11:35:55,999][123091] Updated weights for policy 0, policy_version 1503333 (0.0010) [2023-12-26 11:35:56,035][123090] Updated weights for policy 1, policy_version 1493380 (0.0008) [2023-12-26 11:35:56,055][123091] Updated weights for policy 0, policy_version 1503343 (0.0008) [2023-12-26 11:35:56,094][123090] Updated weights for policy 1, policy_version 1493390 (0.0008) [2023-12-26 11:35:56,154][123090] Updated weights for policy 1, policy_version 1493400 (0.0008) [2023-12-26 11:35:56,814][123091] Updated weights for policy 0, policy_version 1503353 (0.0010) [2023-12-26 11:35:56,882][123091] Updated weights for policy 0, policy_version 1503363 (0.0010) [2023-12-26 11:35:56,950][123091] Updated weights for policy 0, policy_version 1503373 (0.0009) [2023-12-26 11:35:57,006][123090] Updated weights for policy 1, policy_version 1493410 (0.0009) [2023-12-26 11:35:57,072][123090] Updated weights for policy 1, policy_version 1493420 (0.0009) [2023-12-26 11:35:57,130][123090] Updated weights for policy 1, policy_version 1493430 (0.0009) [2023-12-26 11:35:57,189][123090] Updated weights for policy 1, policy_version 1493440 (0.0008) [2023-12-26 11:35:57,773][123091] Updated weights for policy 0, policy_version 1503383 (0.0007) [2023-12-26 11:35:57,821][123091] Updated weights for policy 0, policy_version 1503393 (0.0005) [2023-12-26 11:35:57,866][123091] Updated weights for policy 0, policy_version 1503403 (0.0005) [2023-12-26 11:35:58,015][123090] Updated weights for policy 1, policy_version 1493450 (0.0009) [2023-12-26 11:35:58,073][123090] Updated weights for policy 1, policy_version 1493460 (0.0008) [2023-12-26 11:35:58,128][123090] Updated weights for policy 1, policy_version 1493470 (0.0008) [2023-12-26 11:35:58,727][123091] Updated weights for policy 0, policy_version 1503413 (0.0007) [2023-12-26 11:35:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 767205376. Throughput: 0: 8984.9, 1: 8448.4. Samples: 767204940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:35:58,785][121949] Avg episode reward: [(0, '6231.175'), (1, '5463.711')] [2023-12-26 11:35:58,803][123091] Updated weights for policy 0, policy_version 1503423 (0.0009) [2023-12-26 11:35:58,867][123091] Updated weights for policy 0, policy_version 1503433 (0.0007) [2023-12-26 11:35:59,048][123090] Updated weights for policy 1, policy_version 1493480 (0.0010) [2023-12-26 11:35:59,112][123090] Updated weights for policy 1, policy_version 1493490 (0.0009) [2023-12-26 11:35:59,180][123090] Updated weights for policy 1, policy_version 1493500 (0.0007) [2023-12-26 11:35:59,659][123091] Updated weights for policy 0, policy_version 1503443 (0.0009) [2023-12-26 11:35:59,718][123091] Updated weights for policy 0, policy_version 1503453 (0.0008) [2023-12-26 11:35:59,774][123091] Updated weights for policy 0, policy_version 1503463 (0.0010) [2023-12-26 11:35:59,874][123090] Updated weights for policy 1, policy_version 1493510 (0.0007) [2023-12-26 11:35:59,942][123090] Updated weights for policy 1, policy_version 1493520 (0.0006) [2023-12-26 11:36:00,013][123090] Updated weights for policy 1, policy_version 1493530 (0.0008) [2023-12-26 11:36:00,557][123091] Updated weights for policy 0, policy_version 1503473 (0.0009) [2023-12-26 11:36:00,610][123091] Updated weights for policy 0, policy_version 1503483 (0.0009) [2023-12-26 11:36:00,664][123091] Updated weights for policy 0, policy_version 1503493 (0.0010) [2023-12-26 11:36:00,720][123091] Updated weights for policy 0, policy_version 1503504 (0.0010) [2023-12-26 11:36:00,802][123090] Updated weights for policy 1, policy_version 1493540 (0.0008) [2023-12-26 11:36:00,874][123090] Updated weights for policy 1, policy_version 1493550 (0.0005) [2023-12-26 11:36:00,936][123090] Updated weights for policy 1, policy_version 1493560 (0.0005) [2023-12-26 11:36:01,584][123090] Updated weights for policy 1, policy_version 1493570 (0.0006) [2023-12-26 11:36:01,655][123091] Updated weights for policy 0, policy_version 1503514 (0.0009) [2023-12-26 11:36:01,656][123090] Updated weights for policy 1, policy_version 1493580 (0.0008) [2023-12-26 11:36:01,713][123090] Updated weights for policy 1, policy_version 1493590 (0.0007) [2023-12-26 11:36:01,717][123091] Updated weights for policy 0, policy_version 1503524 (0.0008) [2023-12-26 11:36:01,784][123090] Updated weights for policy 1, policy_version 1493600 (0.0009) [2023-12-26 11:36:01,784][123091] Updated weights for policy 0, policy_version 1503534 (0.0009) [2023-12-26 11:36:02,563][123091] Updated weights for policy 0, policy_version 1503544 (0.0010) [2023-12-26 11:36:02,616][123091] Updated weights for policy 0, policy_version 1503554 (0.0009) [2023-12-26 11:36:02,640][123090] Updated weights for policy 1, policy_version 1493610 (0.0008) [2023-12-26 11:36:02,671][123091] Updated weights for policy 0, policy_version 1503564 (0.0005) [2023-12-26 11:36:02,717][123090] Updated weights for policy 1, policy_version 1493620 (0.0006) [2023-12-26 11:36:02,780][123090] Updated weights for policy 1, policy_version 1493630 (0.0006) [2023-12-26 11:36:03,388][123091] Updated weights for policy 0, policy_version 1503574 (0.0008) [2023-12-26 11:36:03,417][123090] Updated weights for policy 1, policy_version 1493640 (0.0007) [2023-12-26 11:36:03,438][123091] Updated weights for policy 0, policy_version 1503584 (0.0007) [2023-12-26 11:36:03,465][123090] Updated weights for policy 1, policy_version 1493650 (0.0009) [2023-12-26 11:36:03,498][123091] Updated weights for policy 0, policy_version 1503594 (0.0006) [2023-12-26 11:36:03,522][123090] Updated weights for policy 1, policy_version 1493661 (0.0009) [2023-12-26 11:36:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 767303680. Throughput: 0: 8937.7, 1: 8552.4. Samples: 767312072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:03,784][121949] Avg episode reward: [(0, '6247.388'), (1, '5243.243')] [2023-12-26 11:36:04,219][123091] Updated weights for policy 0, policy_version 1503604 (0.0008) [2023-12-26 11:36:04,284][123091] Updated weights for policy 0, policy_version 1503614 (0.0011) [2023-12-26 11:36:04,348][123091] Updated weights for policy 0, policy_version 1503624 (0.0011) [2023-12-26 11:36:04,428][123090] Updated weights for policy 1, policy_version 1493671 (0.0006) [2023-12-26 11:36:04,499][123090] Updated weights for policy 1, policy_version 1493681 (0.0009) [2023-12-26 11:36:04,569][123090] Updated weights for policy 1, policy_version 1493691 (0.0009) [2023-12-26 11:36:05,078][123091] Updated weights for policy 0, policy_version 1503634 (0.0010) [2023-12-26 11:36:05,135][123091] Updated weights for policy 0, policy_version 1503644 (0.0006) [2023-12-26 11:36:05,197][123091] Updated weights for policy 0, policy_version 1503654 (0.0005) [2023-12-26 11:36:05,259][123091] Updated weights for policy 0, policy_version 1503664 (0.0005) [2023-12-26 11:36:05,439][123090] Updated weights for policy 1, policy_version 1493701 (0.0009) [2023-12-26 11:36:05,497][123090] Updated weights for policy 1, policy_version 1493711 (0.0010) [2023-12-26 11:36:05,552][123090] Updated weights for policy 1, policy_version 1493721 (0.0010) [2023-12-26 11:36:05,905][123091] Updated weights for policy 0, policy_version 1503674 (0.0005) [2023-12-26 11:36:05,956][123091] Updated weights for policy 0, policy_version 1503684 (0.0005) [2023-12-26 11:36:06,013][123091] Updated weights for policy 0, policy_version 1503694 (0.0005) [2023-12-26 11:36:06,334][123090] Updated weights for policy 1, policy_version 1493731 (0.0010) [2023-12-26 11:36:06,411][123090] Updated weights for policy 1, policy_version 1493741 (0.0006) [2023-12-26 11:36:06,476][123090] Updated weights for policy 1, policy_version 1493751 (0.0011) [2023-12-26 11:36:06,705][123091] Updated weights for policy 0, policy_version 1503704 (0.0009) [2023-12-26 11:36:06,774][123091] Updated weights for policy 0, policy_version 1503714 (0.0010) [2023-12-26 11:36:06,839][123091] Updated weights for policy 0, policy_version 1503724 (0.0009) [2023-12-26 11:36:07,245][123090] Updated weights for policy 1, policy_version 1493761 (0.0010) [2023-12-26 11:36:07,320][123090] Updated weights for policy 1, policy_version 1493771 (0.0011) [2023-12-26 11:36:07,380][123090] Updated weights for policy 1, policy_version 1493781 (0.0011) [2023-12-26 11:36:07,436][123090] Updated weights for policy 1, policy_version 1493791 (0.0010) [2023-12-26 11:36:07,671][123091] Updated weights for policy 0, policy_version 1503734 (0.0007) [2023-12-26 11:36:07,732][123091] Updated weights for policy 0, policy_version 1503744 (0.0005) [2023-12-26 11:36:07,798][123091] Updated weights for policy 0, policy_version 1503754 (0.0010) [2023-12-26 11:36:08,232][123090] Updated weights for policy 1, policy_version 1493801 (0.0010) [2023-12-26 11:36:08,291][123090] Updated weights for policy 1, policy_version 1493812 (0.0010) [2023-12-26 11:36:08,357][123090] Updated weights for policy 1, policy_version 1493822 (0.0008) [2023-12-26 11:36:08,512][123091] Updated weights for policy 0, policy_version 1503764 (0.0006) [2023-12-26 11:36:08,581][123091] Updated weights for policy 0, policy_version 1503774 (0.0008) [2023-12-26 11:36:08,653][123091] Updated weights for policy 0, policy_version 1503784 (0.0006) [2023-12-26 11:36:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 767393792. Throughput: 0: 9041.2, 1: 8582.0. Samples: 767367404. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:08,784][121949] Avg episode reward: [(0, '6249.771'), (1, '5316.781')] [2023-12-26 11:36:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001503792_384974848.pth... [2023-12-26 11:36:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001493824_382418944.pth... [2023-12-26 11:36:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001492832_382164992.pth [2023-12-26 11:36:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001502736_384704512.pth [2023-12-26 11:36:09,186][123090] Updated weights for policy 1, policy_version 1493832 (0.0008) [2023-12-26 11:36:09,246][123090] Updated weights for policy 1, policy_version 1493842 (0.0009) [2023-12-26 11:36:09,261][123091] Updated weights for policy 0, policy_version 1503794 (0.0006) [2023-12-26 11:36:09,308][123090] Updated weights for policy 1, policy_version 1493852 (0.0008) [2023-12-26 11:36:09,324][123091] Updated weights for policy 0, policy_version 1503804 (0.0008) [2023-12-26 11:36:09,394][123091] Updated weights for policy 0, policy_version 1503814 (0.0008) [2023-12-26 11:36:09,453][123091] Updated weights for policy 0, policy_version 1503824 (0.0007) [2023-12-26 11:36:10,196][123090] Updated weights for policy 1, policy_version 1493862 (0.0009) [2023-12-26 11:36:10,245][123091] Updated weights for policy 0, policy_version 1503834 (0.0006) [2023-12-26 11:36:10,265][123090] Updated weights for policy 1, policy_version 1493872 (0.0009) [2023-12-26 11:36:10,295][123091] Updated weights for policy 0, policy_version 1503844 (0.0008) [2023-12-26 11:36:10,332][123090] Updated weights for policy 1, policy_version 1493882 (0.0009) [2023-12-26 11:36:10,360][123091] Updated weights for policy 0, policy_version 1503854 (0.0008) [2023-12-26 11:36:11,154][123091] Updated weights for policy 0, policy_version 1503864 (0.0009) [2023-12-26 11:36:11,201][123090] Updated weights for policy 1, policy_version 1493892 (0.0009) [2023-12-26 11:36:11,225][123091] Updated weights for policy 0, policy_version 1503874 (0.0008) [2023-12-26 11:36:11,258][123090] Updated weights for policy 1, policy_version 1493902 (0.0008) [2023-12-26 11:36:11,293][123091] Updated weights for policy 0, policy_version 1503884 (0.0008) [2023-12-26 11:36:11,323][123090] Updated weights for policy 1, policy_version 1493912 (0.0010) [2023-12-26 11:36:12,143][123091] Updated weights for policy 0, policy_version 1503894 (0.0010) [2023-12-26 11:36:12,168][123090] Updated weights for policy 1, policy_version 1493922 (0.0009) [2023-12-26 11:36:12,205][123091] Updated weights for policy 0, policy_version 1503904 (0.0008) [2023-12-26 11:36:12,234][123090] Updated weights for policy 1, policy_version 1493932 (0.0008) [2023-12-26 11:36:12,268][123091] Updated weights for policy 0, policy_version 1503914 (0.0007) [2023-12-26 11:36:12,310][123090] Updated weights for policy 1, policy_version 1493942 (0.0008) [2023-12-26 11:36:12,407][123090] Updated weights for policy 1, policy_version 1493952 (0.0008) [2023-12-26 11:36:12,977][123091] Updated weights for policy 0, policy_version 1503924 (0.0006) [2023-12-26 11:36:13,041][123091] Updated weights for policy 0, policy_version 1503934 (0.0009) [2023-12-26 11:36:13,100][123091] Updated weights for policy 0, policy_version 1503944 (0.0005) [2023-12-26 11:36:13,158][123090] Updated weights for policy 1, policy_version 1493962 (0.0010) [2023-12-26 11:36:13,212][123090] Updated weights for policy 1, policy_version 1493972 (0.0010) [2023-12-26 11:36:13,275][123090] Updated weights for policy 1, policy_version 1493982 (0.0010) [2023-12-26 11:36:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 767475712. Throughput: 0: 9002.1, 1: 8625.5. Samples: 767471548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:13,785][121949] Avg episode reward: [(0, '6298.230'), (1, '5458.783')] [2023-12-26 11:36:13,823][123091] Updated weights for policy 0, policy_version 1503954 (0.0005) [2023-12-26 11:36:13,878][123091] Updated weights for policy 0, policy_version 1503964 (0.0006) [2023-12-26 11:36:13,924][123091] Updated weights for policy 0, policy_version 1503974 (0.0005) [2023-12-26 11:36:13,976][123091] Updated weights for policy 0, policy_version 1503984 (0.0005) [2023-12-26 11:36:14,126][123090] Updated weights for policy 1, policy_version 1493992 (0.0010) [2023-12-26 11:36:14,189][123090] Updated weights for policy 1, policy_version 1494002 (0.0010) [2023-12-26 11:36:14,246][123090] Updated weights for policy 1, policy_version 1494012 (0.0010) [2023-12-26 11:36:14,653][123091] Updated weights for policy 0, policy_version 1503994 (0.0005) [2023-12-26 11:36:14,705][123091] Updated weights for policy 0, policy_version 1504004 (0.0006) [2023-12-26 11:36:14,768][123091] Updated weights for policy 0, policy_version 1504014 (0.0006) [2023-12-26 11:36:15,100][123090] Updated weights for policy 1, policy_version 1494022 (0.0010) [2023-12-26 11:36:15,165][123090] Updated weights for policy 1, policy_version 1494032 (0.0011) [2023-12-26 11:36:15,231][123090] Updated weights for policy 1, policy_version 1494042 (0.0011) [2023-12-26 11:36:15,489][123091] Updated weights for policy 0, policy_version 1504024 (0.0007) [2023-12-26 11:36:15,558][123091] Updated weights for policy 0, policy_version 1504034 (0.0007) [2023-12-26 11:36:15,620][123091] Updated weights for policy 0, policy_version 1504044 (0.0008) [2023-12-26 11:36:16,003][123090] Updated weights for policy 1, policy_version 1494052 (0.0011) [2023-12-26 11:36:16,065][123090] Updated weights for policy 1, policy_version 1494062 (0.0008) [2023-12-26 11:36:16,127][123090] Updated weights for policy 1, policy_version 1494072 (0.0006) [2023-12-26 11:36:16,424][123091] Updated weights for policy 0, policy_version 1504054 (0.0008) [2023-12-26 11:36:16,478][123091] Updated weights for policy 0, policy_version 1504064 (0.0010) [2023-12-26 11:36:16,533][123091] Updated weights for policy 0, policy_version 1504074 (0.0009) [2023-12-26 11:36:16,845][123090] Updated weights for policy 1, policy_version 1494082 (0.0005) [2023-12-26 11:36:16,894][123090] Updated weights for policy 1, policy_version 1494092 (0.0005) [2023-12-26 11:36:16,945][123090] Updated weights for policy 1, policy_version 1494102 (0.0005) [2023-12-26 11:36:16,996][123090] Updated weights for policy 1, policy_version 1494112 (0.0005) [2023-12-26 11:36:17,361][123091] Updated weights for policy 0, policy_version 1504084 (0.0011) [2023-12-26 11:36:17,408][123091] Updated weights for policy 0, policy_version 1504094 (0.0010) [2023-12-26 11:36:17,455][123091] Updated weights for policy 0, policy_version 1504104 (0.0010) [2023-12-26 11:36:17,767][123090] Updated weights for policy 1, policy_version 1494122 (0.0005) [2023-12-26 11:36:17,825][123090] Updated weights for policy 1, policy_version 1494132 (0.0005) [2023-12-26 11:36:17,883][123090] Updated weights for policy 1, policy_version 1494142 (0.0005) [2023-12-26 11:36:18,181][123091] Updated weights for policy 0, policy_version 1504114 (0.0010) [2023-12-26 11:36:18,247][123091] Updated weights for policy 0, policy_version 1504124 (0.0008) [2023-12-26 11:36:18,293][123091] Updated weights for policy 0, policy_version 1504134 (0.0005) [2023-12-26 11:36:18,362][123091] Updated weights for policy 0, policy_version 1504144 (0.0008) [2023-12-26 11:36:18,529][123090] Updated weights for policy 1, policy_version 1494152 (0.0005) [2023-12-26 11:36:18,602][123090] Updated weights for policy 1, policy_version 1494162 (0.0010) [2023-12-26 11:36:18,665][123090] Updated weights for policy 1, policy_version 1494172 (0.0010) [2023-12-26 11:36:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 767574016. Throughput: 0: 9048.8, 1: 8709.3. Samples: 767584028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:18,784][121949] Avg episode reward: [(0, '6256.978'), (1, '5177.380')] [2023-12-26 11:36:19,080][123091] Updated weights for policy 0, policy_version 1504154 (0.0006) [2023-12-26 11:36:19,146][123091] Updated weights for policy 0, policy_version 1504164 (0.0007) [2023-12-26 11:36:19,191][123091] Updated weights for policy 0, policy_version 1504174 (0.0005) [2023-12-26 11:36:19,462][123090] Updated weights for policy 1, policy_version 1494182 (0.0011) [2023-12-26 11:36:19,530][123090] Updated weights for policy 1, policy_version 1494192 (0.0011) [2023-12-26 11:36:19,593][123090] Updated weights for policy 1, policy_version 1494202 (0.0011) [2023-12-26 11:36:19,951][123091] Updated weights for policy 0, policy_version 1504184 (0.0010) [2023-12-26 11:36:20,017][123091] Updated weights for policy 0, policy_version 1504194 (0.0009) [2023-12-26 11:36:20,077][123091] Updated weights for policy 0, policy_version 1504204 (0.0011) [2023-12-26 11:36:20,420][123090] Updated weights for policy 1, policy_version 1494212 (0.0009) [2023-12-26 11:36:20,486][123090] Updated weights for policy 1, policy_version 1494222 (0.0006) [2023-12-26 11:36:20,554][123090] Updated weights for policy 1, policy_version 1494232 (0.0007) [2023-12-26 11:36:20,834][123091] Updated weights for policy 0, policy_version 1504214 (0.0011) [2023-12-26 11:36:20,898][123091] Updated weights for policy 0, policy_version 1504224 (0.0011) [2023-12-26 11:36:20,960][123091] Updated weights for policy 0, policy_version 1504234 (0.0006) [2023-12-26 11:36:21,387][123090] Updated weights for policy 1, policy_version 1494242 (0.0009) [2023-12-26 11:36:21,456][123090] Updated weights for policy 1, policy_version 1494252 (0.0009) [2023-12-26 11:36:21,527][123090] Updated weights for policy 1, policy_version 1494262 (0.0009) [2023-12-26 11:36:21,583][123090] Updated weights for policy 1, policy_version 1494272 (0.0010) [2023-12-26 11:36:21,748][123091] Updated weights for policy 0, policy_version 1504244 (0.0008) [2023-12-26 11:36:21,804][123091] Updated weights for policy 0, policy_version 1504254 (0.0011) [2023-12-26 11:36:21,866][123091] Updated weights for policy 0, policy_version 1504264 (0.0010) [2023-12-26 11:36:22,479][123090] Updated weights for policy 1, policy_version 1494282 (0.0009) [2023-12-26 11:36:22,550][123090] Updated weights for policy 1, policy_version 1494292 (0.0010) [2023-12-26 11:36:22,579][123091] Updated weights for policy 0, policy_version 1504274 (0.0006) [2023-12-26 11:36:22,614][123090] Updated weights for policy 1, policy_version 1494302 (0.0010) [2023-12-26 11:36:22,648][123091] Updated weights for policy 0, policy_version 1504284 (0.0005) [2023-12-26 11:36:22,707][123091] Updated weights for policy 0, policy_version 1504294 (0.0006) [2023-12-26 11:36:22,775][123091] Updated weights for policy 0, policy_version 1504304 (0.0010) [2023-12-26 11:36:23,492][123090] Updated weights for policy 1, policy_version 1494312 (0.0009) [2023-12-26 11:36:23,508][123091] Updated weights for policy 0, policy_version 1504314 (0.0008) [2023-12-26 11:36:23,541][123090] Updated weights for policy 1, policy_version 1494322 (0.0009) [2023-12-26 11:36:23,568][123091] Updated weights for policy 0, policy_version 1504324 (0.0007) [2023-12-26 11:36:23,600][123090] Updated weights for policy 1, policy_version 1494332 (0.0008) [2023-12-26 11:36:23,624][123091] Updated weights for policy 0, policy_version 1504334 (0.0005) [2023-12-26 11:36:23,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 767664128. Throughput: 0: 9069.1, 1: 8629.8. Samples: 767636140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:23,785][121949] Avg episode reward: [(0, '6065.846'), (1, '5256.088')] [2023-12-26 11:36:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001504336_385114112.pth... [2023-12-26 11:36:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001494336_382550016.pth... [2023-12-26 11:36:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001493312_382287872.pth [2023-12-26 11:36:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001503248_384835584.pth [2023-12-26 11:36:24,345][123091] Updated weights for policy 0, policy_version 1504344 (0.0007) [2023-12-26 11:36:24,407][123091] Updated weights for policy 0, policy_version 1504354 (0.0007) [2023-12-26 11:36:24,441][123090] Updated weights for policy 1, policy_version 1494342 (0.0009) [2023-12-26 11:36:24,475][123091] Updated weights for policy 0, policy_version 1504364 (0.0005) [2023-12-26 11:36:24,506][123090] Updated weights for policy 1, policy_version 1494352 (0.0009) [2023-12-26 11:36:24,574][123090] Updated weights for policy 1, policy_version 1494362 (0.0009) [2023-12-26 11:36:25,177][123091] Updated weights for policy 0, policy_version 1504374 (0.0005) [2023-12-26 11:36:25,230][123091] Updated weights for policy 0, policy_version 1504384 (0.0006) [2023-12-26 11:36:25,293][123091] Updated weights for policy 0, policy_version 1504394 (0.0008) [2023-12-26 11:36:25,454][123090] Updated weights for policy 1, policy_version 1494372 (0.0008) [2023-12-26 11:36:25,510][123090] Updated weights for policy 1, policy_version 1494382 (0.0007) [2023-12-26 11:36:25,559][123090] Updated weights for policy 1, policy_version 1494392 (0.0009) [2023-12-26 11:36:26,058][123091] Updated weights for policy 0, policy_version 1504404 (0.0009) [2023-12-26 11:36:26,132][123091] Updated weights for policy 0, policy_version 1504414 (0.0005) [2023-12-26 11:36:26,193][123091] Updated weights for policy 0, policy_version 1504424 (0.0005) [2023-12-26 11:36:26,389][123090] Updated weights for policy 1, policy_version 1494402 (0.0008) [2023-12-26 11:36:26,439][123090] Updated weights for policy 1, policy_version 1494412 (0.0010) [2023-12-26 11:36:26,488][123090] Updated weights for policy 1, policy_version 1494422 (0.0009) [2023-12-26 11:36:26,539][123090] Updated weights for policy 1, policy_version 1494432 (0.0009) [2023-12-26 11:36:26,836][123091] Updated weights for policy 0, policy_version 1504434 (0.0006) [2023-12-26 11:36:26,915][123091] Updated weights for policy 0, policy_version 1504444 (0.0005) [2023-12-26 11:36:26,977][123091] Updated weights for policy 0, policy_version 1504454 (0.0005) [2023-12-26 11:36:27,031][123091] Updated weights for policy 0, policy_version 1504464 (0.0005) [2023-12-26 11:36:27,401][123090] Updated weights for policy 1, policy_version 1494442 (0.0008) [2023-12-26 11:36:27,454][123090] Updated weights for policy 1, policy_version 1494452 (0.0008) [2023-12-26 11:36:27,502][123090] Updated weights for policy 1, policy_version 1494462 (0.0008) [2023-12-26 11:36:27,652][123091] Updated weights for policy 0, policy_version 1504474 (0.0006) [2023-12-26 11:36:27,720][123091] Updated weights for policy 0, policy_version 1504484 (0.0006) [2023-12-26 11:36:27,790][123091] Updated weights for policy 0, policy_version 1504494 (0.0009) [2023-12-26 11:36:28,341][123090] Updated weights for policy 1, policy_version 1494472 (0.0008) [2023-12-26 11:36:28,411][123090] Updated weights for policy 1, policy_version 1494482 (0.0009) [2023-12-26 11:36:28,475][123090] Updated weights for policy 1, policy_version 1494492 (0.0009) [2023-12-26 11:36:28,517][123091] Updated weights for policy 0, policy_version 1504504 (0.0010) [2023-12-26 11:36:28,577][123091] Updated weights for policy 0, policy_version 1504514 (0.0010) [2023-12-26 11:36:28,647][123091] Updated weights for policy 0, policy_version 1504524 (0.0011) [2023-12-26 11:36:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 767754240. Throughput: 0: 9218.1, 1: 8584.2. Samples: 767744528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:28,785][121949] Avg episode reward: [(0, '6034.631'), (1, '5457.541')] [2023-12-26 11:36:29,302][123090] Updated weights for policy 1, policy_version 1494502 (0.0009) [2023-12-26 11:36:29,371][123090] Updated weights for policy 1, policy_version 1494512 (0.0010) [2023-12-26 11:36:29,440][123090] Updated weights for policy 1, policy_version 1494522 (0.0006) [2023-12-26 11:36:29,448][123091] Updated weights for policy 0, policy_version 1504534 (0.0011) [2023-12-26 11:36:29,495][123091] Updated weights for policy 0, policy_version 1504544 (0.0010) [2023-12-26 11:36:29,539][123091] Updated weights for policy 0, policy_version 1504554 (0.0010) [2023-12-26 11:36:30,213][123090] Updated weights for policy 1, policy_version 1494532 (0.0010) [2023-12-26 11:36:30,274][123090] Updated weights for policy 1, policy_version 1494542 (0.0009) [2023-12-26 11:36:30,331][123090] Updated weights for policy 1, policy_version 1494552 (0.0009) [2023-12-26 11:36:30,341][123091] Updated weights for policy 0, policy_version 1504564 (0.0009) [2023-12-26 11:36:30,394][123091] Updated weights for policy 0, policy_version 1504574 (0.0006) [2023-12-26 11:36:30,452][123091] Updated weights for policy 0, policy_version 1504584 (0.0006) [2023-12-26 11:36:31,153][123090] Updated weights for policy 1, policy_version 1494562 (0.0009) [2023-12-26 11:36:31,201][123090] Updated weights for policy 1, policy_version 1494572 (0.0008) [2023-12-26 11:36:31,255][123090] Updated weights for policy 1, policy_version 1494582 (0.0008) [2023-12-26 11:36:31,264][123091] Updated weights for policy 0, policy_version 1504594 (0.0008) [2023-12-26 11:36:31,328][123090] Updated weights for policy 1, policy_version 1494592 (0.0006) [2023-12-26 11:36:31,335][123091] Updated weights for policy 0, policy_version 1504604 (0.0010) [2023-12-26 11:36:31,412][123091] Updated weights for policy 0, policy_version 1504614 (0.0010) [2023-12-26 11:36:31,486][123091] Updated weights for policy 0, policy_version 1504624 (0.0006) [2023-12-26 11:36:32,052][123090] Updated weights for policy 1, policy_version 1494602 (0.0009) [2023-12-26 11:36:32,123][123090] Updated weights for policy 1, policy_version 1494612 (0.0009) [2023-12-26 11:36:32,187][123090] Updated weights for policy 1, policy_version 1494622 (0.0006) [2023-12-26 11:36:32,228][123091] Updated weights for policy 0, policy_version 1504634 (0.0005) [2023-12-26 11:36:32,289][123091] Updated weights for policy 0, policy_version 1504644 (0.0007) [2023-12-26 11:36:32,352][123091] Updated weights for policy 0, policy_version 1504654 (0.0010) [2023-12-26 11:36:33,012][123090] Updated weights for policy 1, policy_version 1494632 (0.0009) [2023-12-26 11:36:33,068][123090] Updated weights for policy 1, policy_version 1494643 (0.0009) [2023-12-26 11:36:33,126][123091] Updated weights for policy 0, policy_version 1504664 (0.0006) [2023-12-26 11:36:33,129][123090] Updated weights for policy 1, policy_version 1494653 (0.0009) [2023-12-26 11:36:33,178][123091] Updated weights for policy 0, policy_version 1504674 (0.0005) [2023-12-26 11:36:33,224][123091] Updated weights for policy 0, policy_version 1504684 (0.0005) [2023-12-26 11:36:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 767836160. Throughput: 0: 9220.8, 1: 8606.3. Samples: 767850660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:33,785][121949] Avg episode reward: [(0, '6090.351'), (1, '5375.047')] [2023-12-26 11:36:33,885][123091] Updated weights for policy 0, policy_version 1504694 (0.0006) [2023-12-26 11:36:33,942][123091] Updated weights for policy 0, policy_version 1504704 (0.0005) [2023-12-26 11:36:33,942][123090] Updated weights for policy 1, policy_version 1494663 (0.0006) [2023-12-26 11:36:33,990][123090] Updated weights for policy 1, policy_version 1494673 (0.0005) [2023-12-26 11:36:34,008][123091] Updated weights for policy 0, policy_version 1504714 (0.0007) [2023-12-26 11:36:34,037][123090] Updated weights for policy 1, policy_version 1494683 (0.0005) [2023-12-26 11:36:34,768][123091] Updated weights for policy 0, policy_version 1504724 (0.0009) [2023-12-26 11:36:34,819][123091] Updated weights for policy 0, policy_version 1504734 (0.0010) [2023-12-26 11:36:34,839][123090] Updated weights for policy 1, policy_version 1494693 (0.0006) [2023-12-26 11:36:34,878][123091] Updated weights for policy 0, policy_version 1504744 (0.0010) [2023-12-26 11:36:34,906][123090] Updated weights for policy 1, policy_version 1494703 (0.0008) [2023-12-26 11:36:34,980][123090] Updated weights for policy 1, policy_version 1494713 (0.0009) [2023-12-26 11:36:35,638][123091] Updated weights for policy 0, policy_version 1504754 (0.0007) [2023-12-26 11:36:35,688][123091] Updated weights for policy 0, policy_version 1504764 (0.0009) [2023-12-26 11:36:35,740][123091] Updated weights for policy 0, policy_version 1504774 (0.0009) [2023-12-26 11:36:35,824][123090] Updated weights for policy 1, policy_version 1494723 (0.0009) [2023-12-26 11:36:35,873][123090] Updated weights for policy 1, policy_version 1494733 (0.0007) [2023-12-26 11:36:35,919][123090] Updated weights for policy 1, policy_version 1494743 (0.0005) [2023-12-26 11:36:36,644][123090] Updated weights for policy 1, policy_version 1494753 (0.0006) [2023-12-26 11:36:36,659][123091] Updated weights for policy 0, policy_version 1504785 (0.0010) [2023-12-26 11:36:36,712][123090] Updated weights for policy 1, policy_version 1494763 (0.0010) [2023-12-26 11:36:36,723][123091] Updated weights for policy 0, policy_version 1504795 (0.0006) [2023-12-26 11:36:36,776][123090] Updated weights for policy 1, policy_version 1494773 (0.0010) [2023-12-26 11:36:36,783][123091] Updated weights for policy 0, policy_version 1504805 (0.0006) [2023-12-26 11:36:36,839][123090] Updated weights for policy 1, policy_version 1494783 (0.0010) [2023-12-26 11:36:36,843][123091] Updated weights for policy 0, policy_version 1504815 (0.0007) [2023-12-26 11:36:37,663][123090] Updated weights for policy 1, policy_version 1494793 (0.0011) [2023-12-26 11:36:37,668][123091] Updated weights for policy 0, policy_version 1504825 (0.0008) [2023-12-26 11:36:37,727][123090] Updated weights for policy 1, policy_version 1494803 (0.0011) [2023-12-26 11:36:37,731][123091] Updated weights for policy 0, policy_version 1504835 (0.0007) [2023-12-26 11:36:37,790][123090] Updated weights for policy 1, policy_version 1494813 (0.0010) [2023-12-26 11:36:37,792][123091] Updated weights for policy 0, policy_version 1504845 (0.0009) [2023-12-26 11:36:38,566][123091] Updated weights for policy 0, policy_version 1504855 (0.0009) [2023-12-26 11:36:38,600][123090] Updated weights for policy 1, policy_version 1494823 (0.0007) [2023-12-26 11:36:38,619][123091] Updated weights for policy 0, policy_version 1504865 (0.0011) [2023-12-26 11:36:38,657][123090] Updated weights for policy 1, policy_version 1494833 (0.0006) [2023-12-26 11:36:38,675][123091] Updated weights for policy 0, policy_version 1504875 (0.0011) [2023-12-26 11:36:38,714][123090] Updated weights for policy 1, policy_version 1494843 (0.0008) [2023-12-26 11:36:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 767934464. Throughput: 0: 9255.2, 1: 8653.1. Samples: 767905024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:38,785][121949] Avg episode reward: [(0, '6181.071'), (1, '5050.842')] [2023-12-26 11:36:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001504880_385253376.pth... [2023-12-26 11:36:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001494848_382681088.pth... [2023-12-26 11:36:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001503792_384974848.pth [2023-12-26 11:36:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001493824_382418944.pth [2023-12-26 11:36:39,498][123091] Updated weights for policy 0, policy_version 1504885 (0.0011) [2023-12-26 11:36:39,562][123091] Updated weights for policy 0, policy_version 1504895 (0.0011) [2023-12-26 11:36:39,569][123090] Updated weights for policy 1, policy_version 1494853 (0.0009) [2023-12-26 11:36:39,627][123090] Updated weights for policy 1, policy_version 1494863 (0.0008) [2023-12-26 11:36:39,628][123091] Updated weights for policy 0, policy_version 1504905 (0.0011) [2023-12-26 11:36:39,689][123090] Updated weights for policy 1, policy_version 1494873 (0.0008) [2023-12-26 11:36:40,450][123091] Updated weights for policy 0, policy_version 1504915 (0.0010) [2023-12-26 11:36:40,508][123091] Updated weights for policy 0, policy_version 1504925 (0.0009) [2023-12-26 11:36:40,556][123090] Updated weights for policy 1, policy_version 1494883 (0.0009) [2023-12-26 11:36:40,567][123091] Updated weights for policy 0, policy_version 1504935 (0.0011) [2023-12-26 11:36:40,614][123090] Updated weights for policy 1, policy_version 1494893 (0.0009) [2023-12-26 11:36:40,678][123090] Updated weights for policy 1, policy_version 1494903 (0.0010) [2023-12-26 11:36:41,366][123091] Updated weights for policy 0, policy_version 1504945 (0.0010) [2023-12-26 11:36:41,431][123091] Updated weights for policy 0, policy_version 1504955 (0.0009) [2023-12-26 11:36:41,493][123091] Updated weights for policy 0, policy_version 1504965 (0.0009) [2023-12-26 11:36:41,507][123090] Updated weights for policy 1, policy_version 1494913 (0.0010) [2023-12-26 11:36:41,551][123091] Updated weights for policy 0, policy_version 1504975 (0.0007) [2023-12-26 11:36:41,572][123090] Updated weights for policy 1, policy_version 1494923 (0.0009) [2023-12-26 11:36:41,640][123090] Updated weights for policy 1, policy_version 1494933 (0.0008) [2023-12-26 11:36:41,711][123090] Updated weights for policy 1, policy_version 1494943 (0.0009) [2023-12-26 11:36:42,373][123091] Updated weights for policy 0, policy_version 1504985 (0.0010) [2023-12-26 11:36:42,436][123091] Updated weights for policy 0, policy_version 1504995 (0.0009) [2023-12-26 11:36:42,502][123091] Updated weights for policy 0, policy_version 1505005 (0.0010) [2023-12-26 11:36:42,578][123090] Updated weights for policy 1, policy_version 1494953 (0.0009) [2023-12-26 11:36:42,637][123090] Updated weights for policy 1, policy_version 1494963 (0.0008) [2023-12-26 11:36:42,694][123090] Updated weights for policy 1, policy_version 1494973 (0.0009) [2023-12-26 11:36:43,349][123091] Updated weights for policy 0, policy_version 1505015 (0.0010) [2023-12-26 11:36:43,415][123091] Updated weights for policy 0, policy_version 1505025 (0.0011) [2023-12-26 11:36:43,470][123091] Updated weights for policy 0, policy_version 1505035 (0.0011) [2023-12-26 11:36:43,537][123090] Updated weights for policy 1, policy_version 1494983 (0.0009) [2023-12-26 11:36:43,598][123090] Updated weights for policy 1, policy_version 1494993 (0.0010) [2023-12-26 11:36:43,656][123090] Updated weights for policy 1, policy_version 1495003 (0.0009) [2023-12-26 11:36:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 768016384. Throughput: 0: 9176.8, 1: 8636.1. Samples: 768006520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:43,784][121949] Avg episode reward: [(0, '6137.354'), (1, '4845.382')] [2023-12-26 11:36:44,180][123091] Updated weights for policy 0, policy_version 1505045 (0.0008) [2023-12-26 11:36:44,252][123091] Updated weights for policy 0, policy_version 1505055 (0.0005) [2023-12-26 11:36:44,324][123091] Updated weights for policy 0, policy_version 1505065 (0.0005) [2023-12-26 11:36:44,548][123090] Updated weights for policy 1, policy_version 1495013 (0.0010) [2023-12-26 11:36:44,610][123090] Updated weights for policy 1, policy_version 1495023 (0.0010) [2023-12-26 11:36:44,669][123090] Updated weights for policy 1, policy_version 1495033 (0.0010) [2023-12-26 11:36:44,956][123091] Updated weights for policy 0, policy_version 1505075 (0.0006) [2023-12-26 11:36:45,023][123091] Updated weights for policy 0, policy_version 1505085 (0.0008) [2023-12-26 11:36:45,088][123091] Updated weights for policy 0, policy_version 1505095 (0.0008) [2023-12-26 11:36:45,427][123090] Updated weights for policy 1, policy_version 1495043 (0.0009) [2023-12-26 11:36:45,491][123090] Updated weights for policy 1, policy_version 1495053 (0.0005) [2023-12-26 11:36:45,567][123090] Updated weights for policy 1, policy_version 1495063 (0.0006) [2023-12-26 11:36:45,844][123091] Updated weights for policy 0, policy_version 1505105 (0.0006) [2023-12-26 11:36:45,917][123091] Updated weights for policy 0, policy_version 1505115 (0.0007) [2023-12-26 11:36:45,964][123091] Updated weights for policy 0, policy_version 1505125 (0.0009) [2023-12-26 11:36:46,012][123091] Updated weights for policy 0, policy_version 1505135 (0.0009) [2023-12-26 11:36:46,322][123090] Updated weights for policy 1, policy_version 1495073 (0.0010) [2023-12-26 11:36:46,383][123090] Updated weights for policy 1, policy_version 1495083 (0.0009) [2023-12-26 11:36:46,434][123090] Updated weights for policy 1, policy_version 1495093 (0.0005) [2023-12-26 11:36:46,482][123090] Updated weights for policy 1, policy_version 1495103 (0.0005) [2023-12-26 11:36:46,842][123091] Updated weights for policy 0, policy_version 1505145 (0.0006) [2023-12-26 11:36:46,905][123091] Updated weights for policy 0, policy_version 1505155 (0.0005) [2023-12-26 11:36:46,975][123091] Updated weights for policy 0, policy_version 1505165 (0.0005) [2023-12-26 11:36:47,271][123090] Updated weights for policy 1, policy_version 1495113 (0.0008) [2023-12-26 11:36:47,326][123090] Updated weights for policy 1, policy_version 1495123 (0.0009) [2023-12-26 11:36:47,381][123090] Updated weights for policy 1, policy_version 1495133 (0.0008) [2023-12-26 11:36:47,673][123091] Updated weights for policy 0, policy_version 1505175 (0.0008) [2023-12-26 11:36:47,731][123091] Updated weights for policy 0, policy_version 1505185 (0.0010) [2023-12-26 11:36:47,779][123091] Updated weights for policy 0, policy_version 1505195 (0.0010) [2023-12-26 11:36:48,153][123090] Updated weights for policy 1, policy_version 1495143 (0.0006) [2023-12-26 11:36:48,207][123090] Updated weights for policy 1, policy_version 1495153 (0.0005) [2023-12-26 11:36:48,269][123090] Updated weights for policy 1, policy_version 1495163 (0.0005) [2023-12-26 11:36:48,498][123091] Updated weights for policy 0, policy_version 1505205 (0.0010) [2023-12-26 11:36:48,555][123091] Updated weights for policy 0, policy_version 1505215 (0.0009) [2023-12-26 11:36:48,612][123091] Updated weights for policy 0, policy_version 1505225 (0.0009) [2023-12-26 11:36:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 768106496. Throughput: 0: 9254.9, 1: 8623.1. Samples: 768116584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:48,785][121949] Avg episode reward: [(0, '6058.096'), (1, '5001.025')] [2023-12-26 11:36:49,037][123090] Updated weights for policy 1, policy_version 1495173 (0.0007) [2023-12-26 11:36:49,092][123090] Updated weights for policy 1, policy_version 1495183 (0.0009) [2023-12-26 11:36:49,165][123090] Updated weights for policy 1, policy_version 1495193 (0.0008) [2023-12-26 11:36:49,467][123091] Updated weights for policy 0, policy_version 1505235 (0.0008) [2023-12-26 11:36:49,527][123091] Updated weights for policy 0, policy_version 1505245 (0.0009) [2023-12-26 11:36:49,592][123091] Updated weights for policy 0, policy_version 1505255 (0.0009) [2023-12-26 11:36:50,019][123090] Updated weights for policy 1, policy_version 1495203 (0.0007) [2023-12-26 11:36:50,077][123090] Updated weights for policy 1, policy_version 1495213 (0.0005) [2023-12-26 11:36:50,134][123090] Updated weights for policy 1, policy_version 1495223 (0.0005) [2023-12-26 11:36:50,443][123091] Updated weights for policy 0, policy_version 1505265 (0.0009) [2023-12-26 11:36:50,498][123091] Updated weights for policy 0, policy_version 1505275 (0.0009) [2023-12-26 11:36:50,546][123091] Updated weights for policy 0, policy_version 1505285 (0.0009) [2023-12-26 11:36:50,612][123091] Updated weights for policy 0, policy_version 1505295 (0.0008) [2023-12-26 11:36:50,948][123090] Updated weights for policy 1, policy_version 1495233 (0.0006) [2023-12-26 11:36:51,013][123090] Updated weights for policy 1, policy_version 1495243 (0.0009) [2023-12-26 11:36:51,082][123090] Updated weights for policy 1, policy_version 1495253 (0.0008) [2023-12-26 11:36:51,152][123090] Updated weights for policy 1, policy_version 1495263 (0.0007) [2023-12-26 11:36:51,351][123091] Updated weights for policy 0, policy_version 1505305 (0.0009) [2023-12-26 11:36:51,423][123091] Updated weights for policy 0, policy_version 1505315 (0.0009) [2023-12-26 11:36:51,490][123091] Updated weights for policy 0, policy_version 1505325 (0.0009) [2023-12-26 11:36:51,924][123090] Updated weights for policy 1, policy_version 1495273 (0.0006) [2023-12-26 11:36:51,995][123090] Updated weights for policy 1, policy_version 1495283 (0.0006) [2023-12-26 11:36:52,066][123090] Updated weights for policy 1, policy_version 1495293 (0.0006) [2023-12-26 11:36:52,399][123091] Updated weights for policy 0, policy_version 1505335 (0.0009) [2023-12-26 11:36:52,459][123091] Updated weights for policy 0, policy_version 1505345 (0.0010) [2023-12-26 11:36:52,514][123091] Updated weights for policy 0, policy_version 1505355 (0.0010) [2023-12-26 11:36:52,676][123090] Updated weights for policy 1, policy_version 1495303 (0.0008) [2023-12-26 11:36:52,748][123090] Updated weights for policy 1, policy_version 1495313 (0.0008) [2023-12-26 11:36:52,815][123090] Updated weights for policy 1, policy_version 1495323 (0.0009) [2023-12-26 11:36:53,420][123091] Updated weights for policy 0, policy_version 1505365 (0.0009) [2023-12-26 11:36:53,481][123091] Updated weights for policy 0, policy_version 1505375 (0.0009) [2023-12-26 11:36:53,538][123091] Updated weights for policy 0, policy_version 1505385 (0.0008) [2023-12-26 11:36:53,542][123090] Updated weights for policy 1, policy_version 1495333 (0.0008) [2023-12-26 11:36:53,604][123090] Updated weights for policy 1, policy_version 1495343 (0.0011) [2023-12-26 11:36:53,661][123090] Updated weights for policy 1, policy_version 1495353 (0.0011) [2023-12-26 11:36:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 768196608. Throughput: 0: 9155.4, 1: 8635.2. Samples: 768167980. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:53,785][121949] Avg episode reward: [(0, '6076.416'), (1, '4769.968')] [2023-12-26 11:36:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001505392_385384448.pth... [2023-12-26 11:36:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001495360_382812160.pth... [2023-12-26 11:36:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001494336_382550016.pth [2023-12-26 11:36:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001504336_385114112.pth [2023-12-26 11:36:54,394][123090] Updated weights for policy 1, policy_version 1495363 (0.0010) [2023-12-26 11:36:54,413][123091] Updated weights for policy 0, policy_version 1505395 (0.0007) [2023-12-26 11:36:54,449][123090] Updated weights for policy 1, policy_version 1495373 (0.0008) [2023-12-26 11:36:54,476][123091] Updated weights for policy 0, policy_version 1505405 (0.0007) [2023-12-26 11:36:54,498][123090] Updated weights for policy 1, policy_version 1495383 (0.0010) [2023-12-26 11:36:54,536][123091] Updated weights for policy 0, policy_version 1505415 (0.0006) [2023-12-26 11:36:55,274][123090] Updated weights for policy 1, policy_version 1495393 (0.0009) [2023-12-26 11:36:55,347][123090] Updated weights for policy 1, policy_version 1495403 (0.0007) [2023-12-26 11:36:55,363][123091] Updated weights for policy 0, policy_version 1505425 (0.0009) [2023-12-26 11:36:55,404][123090] Updated weights for policy 1, policy_version 1495413 (0.0005) [2023-12-26 11:36:55,418][123091] Updated weights for policy 0, policy_version 1505435 (0.0008) [2023-12-26 11:36:55,467][123091] Updated weights for policy 0, policy_version 1505445 (0.0007) [2023-12-26 11:36:55,468][123090] Updated weights for policy 1, policy_version 1495423 (0.0010) [2023-12-26 11:36:55,516][123091] Updated weights for policy 0, policy_version 1505456 (0.0009) [2023-12-26 11:36:56,117][123090] Updated weights for policy 1, policy_version 1495433 (0.0006) [2023-12-26 11:36:56,163][123090] Updated weights for policy 1, policy_version 1495443 (0.0005) [2023-12-26 11:36:56,233][123090] Updated weights for policy 1, policy_version 1495453 (0.0006) [2023-12-26 11:36:56,464][123091] Updated weights for policy 0, policy_version 1505466 (0.0010) [2023-12-26 11:36:56,518][123091] Updated weights for policy 0, policy_version 1505476 (0.0010) [2023-12-26 11:36:56,564][123091] Updated weights for policy 0, policy_version 1505486 (0.0010) [2023-12-26 11:36:56,953][123090] Updated weights for policy 1, policy_version 1495463 (0.0009) [2023-12-26 11:36:57,015][123090] Updated weights for policy 1, policy_version 1495473 (0.0010) [2023-12-26 11:36:57,065][123090] Updated weights for policy 1, policy_version 1495483 (0.0010) [2023-12-26 11:36:57,398][123091] Updated weights for policy 0, policy_version 1505496 (0.0010) [2023-12-26 11:36:57,459][123091] Updated weights for policy 0, policy_version 1505506 (0.0010) [2023-12-26 11:36:57,525][123091] Updated weights for policy 0, policy_version 1505516 (0.0010) [2023-12-26 11:36:57,806][123090] Updated weights for policy 1, policy_version 1495493 (0.0008) [2023-12-26 11:36:57,852][123090] Updated weights for policy 1, policy_version 1495503 (0.0006) [2023-12-26 11:36:57,904][123090] Updated weights for policy 1, policy_version 1495513 (0.0005) [2023-12-26 11:36:58,352][123091] Updated weights for policy 0, policy_version 1505526 (0.0009) [2023-12-26 11:36:58,418][123091] Updated weights for policy 0, policy_version 1505536 (0.0008) [2023-12-26 11:36:58,486][123091] Updated weights for policy 0, policy_version 1505546 (0.0008) [2023-12-26 11:36:58,742][123090] Updated weights for policy 1, policy_version 1495523 (0.0006) [2023-12-26 11:36:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 768278528. Throughput: 0: 9053.0, 1: 8803.6. Samples: 768275092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:36:58,785][121949] Avg episode reward: [(0, '6047.302'), (1, '5039.630')] [2023-12-26 11:36:58,810][123090] Updated weights for policy 1, policy_version 1495533 (0.0008) [2023-12-26 11:36:58,878][123090] Updated weights for policy 1, policy_version 1495543 (0.0009) [2023-12-26 11:36:59,332][123091] Updated weights for policy 0, policy_version 1505557 (0.0009) [2023-12-26 11:36:59,403][123091] Updated weights for policy 0, policy_version 1505567 (0.0008) [2023-12-26 11:36:59,472][123091] Updated weights for policy 0, policy_version 1505577 (0.0005) [2023-12-26 11:36:59,666][123090] Updated weights for policy 1, policy_version 1495553 (0.0009) [2023-12-26 11:36:59,726][123090] Updated weights for policy 1, policy_version 1495563 (0.0011) [2023-12-26 11:36:59,804][123090] Updated weights for policy 1, policy_version 1495573 (0.0011) [2023-12-26 11:36:59,863][123090] Updated weights for policy 1, policy_version 1495583 (0.0011) [2023-12-26 11:37:00,190][123091] Updated weights for policy 0, policy_version 1505587 (0.0007) [2023-12-26 11:37:00,252][123091] Updated weights for policy 0, policy_version 1505597 (0.0008) [2023-12-26 11:37:00,318][123091] Updated weights for policy 0, policy_version 1505607 (0.0008) [2023-12-26 11:37:00,565][123090] Updated weights for policy 1, policy_version 1495593 (0.0006) [2023-12-26 11:37:00,619][123090] Updated weights for policy 1, policy_version 1495603 (0.0006) [2023-12-26 11:37:00,677][123090] Updated weights for policy 1, policy_version 1495613 (0.0005) [2023-12-26 11:37:01,099][123091] Updated weights for policy 0, policy_version 1505617 (0.0008) [2023-12-26 11:37:01,170][123091] Updated weights for policy 0, policy_version 1505627 (0.0007) [2023-12-26 11:37:01,235][123091] Updated weights for policy 0, policy_version 1505637 (0.0007) [2023-12-26 11:37:01,290][123091] Updated weights for policy 0, policy_version 1505647 (0.0009) [2023-12-26 11:37:01,468][123090] Updated weights for policy 1, policy_version 1495623 (0.0009) [2023-12-26 11:37:01,532][123090] Updated weights for policy 1, policy_version 1495633 (0.0009) [2023-12-26 11:37:01,599][123090] Updated weights for policy 1, policy_version 1495643 (0.0008) [2023-12-26 11:37:02,087][123091] Updated weights for policy 0, policy_version 1505657 (0.0010) [2023-12-26 11:37:02,149][123091] Updated weights for policy 0, policy_version 1505667 (0.0010) [2023-12-26 11:37:02,201][123091] Updated weights for policy 0, policy_version 1505677 (0.0009) [2023-12-26 11:37:02,351][123090] Updated weights for policy 1, policy_version 1495653 (0.0009) [2023-12-26 11:37:02,416][123090] Updated weights for policy 1, policy_version 1495663 (0.0010) [2023-12-26 11:37:02,484][123090] Updated weights for policy 1, policy_version 1495673 (0.0010) [2023-12-26 11:37:03,092][123091] Updated weights for policy 0, policy_version 1505688 (0.0009) [2023-12-26 11:37:03,148][123091] Updated weights for policy 0, policy_version 1505698 (0.0009) [2023-12-26 11:37:03,209][123091] Updated weights for policy 0, policy_version 1505708 (0.0010) [2023-12-26 11:37:03,272][123090] Updated weights for policy 1, policy_version 1495683 (0.0007) [2023-12-26 11:37:03,331][123090] Updated weights for policy 1, policy_version 1495693 (0.0009) [2023-12-26 11:37:03,387][123090] Updated weights for policy 1, policy_version 1495703 (0.0009) [2023-12-26 11:37:03,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 768368640. Throughput: 0: 8922.2, 1: 8775.4. Samples: 768380428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:03,786][121949] Avg episode reward: [(0, '6244.601'), (1, '5063.811')] [2023-12-26 11:37:04,077][123091] Updated weights for policy 0, policy_version 1505718 (0.0009) [2023-12-26 11:37:04,137][123091] Updated weights for policy 0, policy_version 1505728 (0.0009) [2023-12-26 11:37:04,185][123090] Updated weights for policy 1, policy_version 1495713 (0.0009) [2023-12-26 11:37:04,186][123091] Updated weights for policy 0, policy_version 1505738 (0.0008) [2023-12-26 11:37:04,252][123090] Updated weights for policy 1, policy_version 1495723 (0.0009) [2023-12-26 11:37:04,315][123090] Updated weights for policy 1, policy_version 1495733 (0.0008) [2023-12-26 11:37:04,380][123090] Updated weights for policy 1, policy_version 1495743 (0.0006) [2023-12-26 11:37:05,037][123091] Updated weights for policy 0, policy_version 1505748 (0.0009) [2023-12-26 11:37:05,092][123091] Updated weights for policy 0, policy_version 1505758 (0.0009) [2023-12-26 11:37:05,093][123090] Updated weights for policy 1, policy_version 1495753 (0.0006) [2023-12-26 11:37:05,142][123090] Updated weights for policy 1, policy_version 1495763 (0.0008) [2023-12-26 11:37:05,156][123091] Updated weights for policy 0, policy_version 1505768 (0.0009) [2023-12-26 11:37:05,194][123090] Updated weights for policy 1, policy_version 1495773 (0.0005) [2023-12-26 11:37:05,959][123090] Updated weights for policy 1, policy_version 1495783 (0.0009) [2023-12-26 11:37:06,025][123090] Updated weights for policy 1, policy_version 1495793 (0.0010) [2023-12-26 11:37:06,040][123091] Updated weights for policy 0, policy_version 1505778 (0.0008) [2023-12-26 11:37:06,087][123090] Updated weights for policy 1, policy_version 1495803 (0.0010) [2023-12-26 11:37:06,094][123091] Updated weights for policy 0, policy_version 1505788 (0.0008) [2023-12-26 11:37:06,159][123091] Updated weights for policy 0, policy_version 1505798 (0.0009) [2023-12-26 11:37:06,224][123091] Updated weights for policy 0, policy_version 1505808 (0.0010) [2023-12-26 11:37:06,806][123090] Updated weights for policy 1, policy_version 1495813 (0.0009) [2023-12-26 11:37:06,857][123090] Updated weights for policy 1, policy_version 1495823 (0.0010) [2023-12-26 11:37:06,912][123090] Updated weights for policy 1, policy_version 1495833 (0.0010) [2023-12-26 11:37:07,131][123091] Updated weights for policy 0, policy_version 1505818 (0.0009) [2023-12-26 11:37:07,185][123091] Updated weights for policy 0, policy_version 1505829 (0.0009) [2023-12-26 11:37:07,242][123091] Updated weights for policy 0, policy_version 1505839 (0.0009) [2023-12-26 11:37:07,710][123090] Updated weights for policy 1, policy_version 1495843 (0.0009) [2023-12-26 11:37:07,765][123090] Updated weights for policy 1, policy_version 1495853 (0.0005) [2023-12-26 11:37:07,826][123090] Updated weights for policy 1, policy_version 1495863 (0.0005) [2023-12-26 11:37:08,162][123091] Updated weights for policy 0, policy_version 1505849 (0.0009) [2023-12-26 11:37:08,219][123091] Updated weights for policy 0, policy_version 1505859 (0.0009) [2023-12-26 11:37:08,298][123091] Updated weights for policy 0, policy_version 1505869 (0.0010) [2023-12-26 11:37:08,462][123090] Updated weights for policy 1, policy_version 1495873 (0.0010) [2023-12-26 11:37:08,525][123090] Updated weights for policy 1, policy_version 1495883 (0.0008) [2023-12-26 11:37:08,578][123090] Updated weights for policy 1, policy_version 1495893 (0.0007) [2023-12-26 11:37:08,641][123090] Updated weights for policy 1, policy_version 1495903 (0.0007) [2023-12-26 11:37:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 768458752. Throughput: 0: 8848.9, 1: 8863.6. Samples: 768433200. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:08,785][121949] Avg episode reward: [(0, '6199.591'), (1, '4742.979')] [2023-12-26 11:37:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001505872_385507328.pth... [2023-12-26 11:37:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001495904_382951424.pth... [2023-12-26 11:37:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001504880_385253376.pth [2023-12-26 11:37:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001494848_382681088.pth [2023-12-26 11:37:09,181][123091] Updated weights for policy 0, policy_version 1505879 (0.0010) [2023-12-26 11:37:09,238][123091] Updated weights for policy 0, policy_version 1505889 (0.0009) [2023-12-26 11:37:09,289][123091] Updated weights for policy 0, policy_version 1505899 (0.0009) [2023-12-26 11:37:09,377][123090] Updated weights for policy 1, policy_version 1495913 (0.0009) [2023-12-26 11:37:09,448][123090] Updated weights for policy 1, policy_version 1495923 (0.0008) [2023-12-26 11:37:09,514][123090] Updated weights for policy 1, policy_version 1495933 (0.0007) [2023-12-26 11:37:10,223][123091] Updated weights for policy 0, policy_version 1505909 (0.0010) [2023-12-26 11:37:10,282][123091] Updated weights for policy 0, policy_version 1505919 (0.0009) [2023-12-26 11:37:10,336][123090] Updated weights for policy 1, policy_version 1495943 (0.0009) [2023-12-26 11:37:10,340][123091] Updated weights for policy 0, policy_version 1505929 (0.0008) [2023-12-26 11:37:10,396][123090] Updated weights for policy 1, policy_version 1495953 (0.0007) [2023-12-26 11:37:10,466][123090] Updated weights for policy 1, policy_version 1495963 (0.0009) [2023-12-26 11:37:11,163][123091] Updated weights for policy 0, policy_version 1505939 (0.0009) [2023-12-26 11:37:11,225][123091] Updated weights for policy 0, policy_version 1505949 (0.0007) [2023-12-26 11:37:11,289][123091] Updated weights for policy 0, policy_version 1505959 (0.0008) [2023-12-26 11:37:11,329][123090] Updated weights for policy 1, policy_version 1495973 (0.0007) [2023-12-26 11:37:11,405][123090] Updated weights for policy 1, policy_version 1495983 (0.0009) [2023-12-26 11:37:11,456][123090] Updated weights for policy 1, policy_version 1495993 (0.0009) [2023-12-26 11:37:12,112][123091] Updated weights for policy 0, policy_version 1505969 (0.0009) [2023-12-26 11:37:12,163][123091] Updated weights for policy 0, policy_version 1505979 (0.0005) [2023-12-26 11:37:12,214][123091] Updated weights for policy 0, policy_version 1505989 (0.0005) [2023-12-26 11:37:12,251][123090] Updated weights for policy 1, policy_version 1496003 (0.0008) [2023-12-26 11:37:12,284][123091] Updated weights for policy 0, policy_version 1505999 (0.0006) [2023-12-26 11:37:12,323][123090] Updated weights for policy 1, policy_version 1496013 (0.0007) [2023-12-26 11:37:12,392][123090] Updated weights for policy 1, policy_version 1496023 (0.0009) [2023-12-26 11:37:13,035][123091] Updated weights for policy 0, policy_version 1506009 (0.0009) [2023-12-26 11:37:13,091][123091] Updated weights for policy 0, policy_version 1506019 (0.0009) [2023-12-26 11:37:13,143][123091] Updated weights for policy 0, policy_version 1506029 (0.0010) [2023-12-26 11:37:13,190][123090] Updated weights for policy 1, policy_version 1496033 (0.0006) [2023-12-26 11:37:13,247][123090] Updated weights for policy 1, policy_version 1496043 (0.0005) [2023-12-26 11:37:13,295][123090] Updated weights for policy 1, policy_version 1496053 (0.0005) [2023-12-26 11:37:13,345][123090] Updated weights for policy 1, policy_version 1496063 (0.0005) [2023-12-26 11:37:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 768540672. Throughput: 0: 8637.7, 1: 8946.5. Samples: 768535816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:13,785][121949] Avg episode reward: [(0, '6205.123'), (1, '4871.850')] [2023-12-26 11:37:13,874][123091] Updated weights for policy 0, policy_version 1506039 (0.0007) [2023-12-26 11:37:13,927][123091] Updated weights for policy 0, policy_version 1506049 (0.0005) [2023-12-26 11:37:13,974][123091] Updated weights for policy 0, policy_version 1506059 (0.0006) [2023-12-26 11:37:14,113][123090] Updated weights for policy 1, policy_version 1496073 (0.0010) [2023-12-26 11:37:14,181][123090] Updated weights for policy 1, policy_version 1496083 (0.0011) [2023-12-26 11:37:14,240][123090] Updated weights for policy 1, policy_version 1496093 (0.0010) [2023-12-26 11:37:14,746][123091] Updated weights for policy 0, policy_version 1506069 (0.0007) [2023-12-26 11:37:14,816][123091] Updated weights for policy 0, policy_version 1506079 (0.0007) [2023-12-26 11:37:14,868][123091] Updated weights for policy 0, policy_version 1506089 (0.0009) [2023-12-26 11:37:15,031][123090] Updated weights for policy 1, policy_version 1496103 (0.0008) [2023-12-26 11:37:15,096][123090] Updated weights for policy 1, policy_version 1496113 (0.0009) [2023-12-26 11:37:15,160][123090] Updated weights for policy 1, policy_version 1496123 (0.0009) [2023-12-26 11:37:15,706][123091] Updated weights for policy 0, policy_version 1506099 (0.0009) [2023-12-26 11:37:15,766][123091] Updated weights for policy 0, policy_version 1506109 (0.0006) [2023-12-26 11:37:15,814][123091] Updated weights for policy 0, policy_version 1506119 (0.0005) [2023-12-26 11:37:15,888][123090] Updated weights for policy 1, policy_version 1496133 (0.0008) [2023-12-26 11:37:15,952][123090] Updated weights for policy 1, policy_version 1496143 (0.0007) [2023-12-26 11:37:16,014][123090] Updated weights for policy 1, policy_version 1496153 (0.0008) [2023-12-26 11:37:16,573][123091] Updated weights for policy 0, policy_version 1506129 (0.0006) [2023-12-26 11:37:16,626][123091] Updated weights for policy 0, policy_version 1506139 (0.0010) [2023-12-26 11:37:16,689][123091] Updated weights for policy 0, policy_version 1506149 (0.0009) [2023-12-26 11:37:16,747][123091] Updated weights for policy 0, policy_version 1506159 (0.0009) [2023-12-26 11:37:16,794][123090] Updated weights for policy 1, policy_version 1496163 (0.0008) [2023-12-26 11:37:16,850][123090] Updated weights for policy 1, policy_version 1496173 (0.0005) [2023-12-26 11:37:16,903][123090] Updated weights for policy 1, policy_version 1496183 (0.0008) [2023-12-26 11:37:17,518][123091] Updated weights for policy 0, policy_version 1506169 (0.0007) [2023-12-26 11:37:17,586][123091] Updated weights for policy 0, policy_version 1506179 (0.0007) [2023-12-26 11:37:17,633][123091] Updated weights for policy 0, policy_version 1506189 (0.0005) [2023-12-26 11:37:17,695][123090] Updated weights for policy 1, policy_version 1496193 (0.0008) [2023-12-26 11:37:17,760][123090] Updated weights for policy 1, policy_version 1496203 (0.0005) [2023-12-26 11:37:17,813][123090] Updated weights for policy 1, policy_version 1496213 (0.0005) [2023-12-26 11:37:17,868][123090] Updated weights for policy 1, policy_version 1496223 (0.0005) [2023-12-26 11:37:18,302][123091] Updated weights for policy 0, policy_version 1506199 (0.0006) [2023-12-26 11:37:18,361][123091] Updated weights for policy 0, policy_version 1506209 (0.0007) [2023-12-26 11:37:18,429][123091] Updated weights for policy 0, policy_version 1506219 (0.0008) [2023-12-26 11:37:18,618][123090] Updated weights for policy 1, policy_version 1496233 (0.0010) [2023-12-26 11:37:18,677][123090] Updated weights for policy 1, policy_version 1496243 (0.0010) [2023-12-26 11:37:18,736][123090] Updated weights for policy 1, policy_version 1496253 (0.0009) [2023-12-26 11:37:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 768638976. Throughput: 0: 8685.3, 1: 9012.6. Samples: 768647068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:18,785][121949] Avg episode reward: [(0, '6239.391'), (1, '5059.619')] [2023-12-26 11:37:19,137][123091] Updated weights for policy 0, policy_version 1506229 (0.0007) [2023-12-26 11:37:19,192][123091] Updated weights for policy 0, policy_version 1506239 (0.0005) [2023-12-26 11:37:19,262][123091] Updated weights for policy 0, policy_version 1506249 (0.0008) [2023-12-26 11:37:19,633][123090] Updated weights for policy 1, policy_version 1496263 (0.0007) [2023-12-26 11:37:19,706][123090] Updated weights for policy 1, policy_version 1496273 (0.0006) [2023-12-26 11:37:19,782][123090] Updated weights for policy 1, policy_version 1496283 (0.0006) [2023-12-26 11:37:20,072][123091] Updated weights for policy 0, policy_version 1506259 (0.0009) [2023-12-26 11:37:20,138][123091] Updated weights for policy 0, policy_version 1506269 (0.0007) [2023-12-26 11:37:20,211][123091] Updated weights for policy 0, policy_version 1506279 (0.0006) [2023-12-26 11:37:20,489][123090] Updated weights for policy 1, policy_version 1496293 (0.0006) [2023-12-26 11:37:20,538][123090] Updated weights for policy 1, policy_version 1496303 (0.0005) [2023-12-26 11:37:20,601][123090] Updated weights for policy 1, policy_version 1496313 (0.0008) [2023-12-26 11:37:20,925][123091] Updated weights for policy 0, policy_version 1506289 (0.0006) [2023-12-26 11:37:20,994][123091] Updated weights for policy 0, policy_version 1506299 (0.0006) [2023-12-26 11:37:21,067][123091] Updated weights for policy 0, policy_version 1506309 (0.0008) [2023-12-26 11:37:21,134][123091] Updated weights for policy 0, policy_version 1506319 (0.0008) [2023-12-26 11:37:21,360][123090] Updated weights for policy 1, policy_version 1496323 (0.0008) [2023-12-26 11:37:21,434][123090] Updated weights for policy 1, policy_version 1496333 (0.0011) [2023-12-26 11:37:21,497][123090] Updated weights for policy 1, policy_version 1496343 (0.0006) [2023-12-26 11:37:21,879][123091] Updated weights for policy 0, policy_version 1506329 (0.0010) [2023-12-26 11:37:21,931][123091] Updated weights for policy 0, policy_version 1506339 (0.0009) [2023-12-26 11:37:21,994][123091] Updated weights for policy 0, policy_version 1506349 (0.0011) [2023-12-26 11:37:22,283][123090] Updated weights for policy 1, policy_version 1496353 (0.0006) [2023-12-26 11:37:22,356][123090] Updated weights for policy 1, policy_version 1496363 (0.0007) [2023-12-26 11:37:22,427][123090] Updated weights for policy 1, policy_version 1496373 (0.0008) [2023-12-26 11:37:22,494][123090] Updated weights for policy 1, policy_version 1496383 (0.0008) [2023-12-26 11:37:22,795][123091] Updated weights for policy 0, policy_version 1506359 (0.0010) [2023-12-26 11:37:22,861][123091] Updated weights for policy 0, policy_version 1506369 (0.0010) [2023-12-26 11:37:22,924][123091] Updated weights for policy 0, policy_version 1506379 (0.0010) [2023-12-26 11:37:23,287][123090] Updated weights for policy 1, policy_version 1496393 (0.0009) [2023-12-26 11:37:23,345][123090] Updated weights for policy 1, policy_version 1496403 (0.0010) [2023-12-26 11:37:23,397][123090] Updated weights for policy 1, policy_version 1496413 (0.0010) [2023-12-26 11:37:23,674][123091] Updated weights for policy 0, policy_version 1506389 (0.0011) [2023-12-26 11:37:23,726][123091] Updated weights for policy 0, policy_version 1506399 (0.0010) [2023-12-26 11:37:23,775][123091] Updated weights for policy 0, policy_version 1506409 (0.0010) [2023-12-26 11:37:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 768720896. Throughput: 0: 8705.3, 1: 8985.7. Samples: 768701120. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:23,785][121949] Avg episode reward: [(0, '6274.860'), (1, '4969.469')] [2023-12-26 11:37:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001496416_383082496.pth... [2023-12-26 11:37:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001495360_382812160.pth [2023-12-26 11:37:23,818][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001506416_385646592.pth... [2023-12-26 11:37:23,821][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001505392_385384448.pth [2023-12-26 11:37:24,176][123090] Updated weights for policy 1, policy_version 1496423 (0.0010) [2023-12-26 11:37:24,227][123090] Updated weights for policy 1, policy_version 1496433 (0.0010) [2023-12-26 11:37:24,279][123090] Updated weights for policy 1, policy_version 1496443 (0.0009) [2023-12-26 11:37:24,518][123091] Updated weights for policy 0, policy_version 1506419 (0.0009) [2023-12-26 11:37:24,568][123091] Updated weights for policy 0, policy_version 1506429 (0.0005) [2023-12-26 11:37:24,621][123091] Updated weights for policy 0, policy_version 1506439 (0.0010) [2023-12-26 11:37:25,116][123090] Updated weights for policy 1, policy_version 1496453 (0.0009) [2023-12-26 11:37:25,185][123090] Updated weights for policy 1, policy_version 1496463 (0.0011) [2023-12-26 11:37:25,246][123090] Updated weights for policy 1, policy_version 1496473 (0.0009) [2023-12-26 11:37:25,339][123091] Updated weights for policy 0, policy_version 1506449 (0.0010) [2023-12-26 11:37:25,397][123091] Updated weights for policy 0, policy_version 1506459 (0.0010) [2023-12-26 11:37:25,456][123091] Updated weights for policy 0, policy_version 1506469 (0.0010) [2023-12-26 11:37:25,511][123091] Updated weights for policy 0, policy_version 1506479 (0.0010) [2023-12-26 11:37:26,071][123090] Updated weights for policy 1, policy_version 1496483 (0.0009) [2023-12-26 11:37:26,127][123090] Updated weights for policy 1, policy_version 1496493 (0.0010) [2023-12-26 11:37:26,194][123090] Updated weights for policy 1, policy_version 1496503 (0.0011) [2023-12-26 11:37:26,352][123091] Updated weights for policy 0, policy_version 1506489 (0.0009) [2023-12-26 11:37:26,421][123091] Updated weights for policy 0, policy_version 1506499 (0.0008) [2023-12-26 11:37:26,480][123091] Updated weights for policy 0, policy_version 1506509 (0.0006) [2023-12-26 11:37:26,964][123090] Updated weights for policy 1, policy_version 1496513 (0.0011) [2023-12-26 11:37:27,015][123090] Updated weights for policy 1, policy_version 1496523 (0.0010) [2023-12-26 11:37:27,066][123090] Updated weights for policy 1, policy_version 1496533 (0.0010) [2023-12-26 11:37:27,117][123090] Updated weights for policy 1, policy_version 1496543 (0.0010) [2023-12-26 11:37:27,126][123091] Updated weights for policy 0, policy_version 1506519 (0.0006) [2023-12-26 11:37:27,195][123091] Updated weights for policy 0, policy_version 1506529 (0.0005) [2023-12-26 11:37:27,245][123091] Updated weights for policy 0, policy_version 1506539 (0.0005) [2023-12-26 11:37:27,883][123090] Updated weights for policy 1, policy_version 1496553 (0.0008) [2023-12-26 11:37:27,907][123091] Updated weights for policy 0, policy_version 1506549 (0.0008) [2023-12-26 11:37:27,946][123090] Updated weights for policy 1, policy_version 1496563 (0.0010) [2023-12-26 11:37:27,955][123091] Updated weights for policy 0, policy_version 1506559 (0.0010) [2023-12-26 11:37:27,998][123090] Updated weights for policy 1, policy_version 1496573 (0.0008) [2023-12-26 11:37:28,007][123091] Updated weights for policy 0, policy_version 1506569 (0.0010) [2023-12-26 11:37:28,748][123091] Updated weights for policy 0, policy_version 1506579 (0.0009) [2023-12-26 11:37:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 768811008. Throughput: 0: 8810.8, 1: 9053.9. Samples: 768810428. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:28,784][121949] Avg episode reward: [(0, '6286.237'), (1, '4674.584')] [2023-12-26 11:37:28,788][123090] Updated weights for policy 1, policy_version 1496583 (0.0010) [2023-12-26 11:37:28,808][123091] Updated weights for policy 0, policy_version 1506589 (0.0011) [2023-12-26 11:37:28,849][123090] Updated weights for policy 1, policy_version 1496593 (0.0011) [2023-12-26 11:37:28,868][123091] Updated weights for policy 0, policy_version 1506599 (0.0011) [2023-12-26 11:37:28,905][123090] Updated weights for policy 1, policy_version 1496603 (0.0010) [2023-12-26 11:37:29,631][123090] Updated weights for policy 1, policy_version 1496613 (0.0010) [2023-12-26 11:37:29,675][123091] Updated weights for policy 0, policy_version 1506609 (0.0011) [2023-12-26 11:37:29,689][123090] Updated weights for policy 1, policy_version 1496623 (0.0010) [2023-12-26 11:37:29,733][123091] Updated weights for policy 0, policy_version 1506619 (0.0010) [2023-12-26 11:37:29,751][123090] Updated weights for policy 1, policy_version 1496633 (0.0010) [2023-12-26 11:37:29,800][123091] Updated weights for policy 0, policy_version 1506629 (0.0010) [2023-12-26 11:37:29,864][123091] Updated weights for policy 0, policy_version 1506639 (0.0008) [2023-12-26 11:37:30,548][123090] Updated weights for policy 1, policy_version 1496643 (0.0009) [2023-12-26 11:37:30,610][123090] Updated weights for policy 1, policy_version 1496653 (0.0005) [2023-12-26 11:37:30,628][123091] Updated weights for policy 0, policy_version 1506649 (0.0007) [2023-12-26 11:37:30,679][123090] Updated weights for policy 1, policy_version 1496663 (0.0005) [2023-12-26 11:37:30,690][123091] Updated weights for policy 0, policy_version 1506659 (0.0008) [2023-12-26 11:37:30,751][123091] Updated weights for policy 0, policy_version 1506669 (0.0008) [2023-12-26 11:37:31,473][123090] Updated weights for policy 1, policy_version 1496673 (0.0008) [2023-12-26 11:37:31,534][123090] Updated weights for policy 1, policy_version 1496683 (0.0009) [2023-12-26 11:37:31,554][123091] Updated weights for policy 0, policy_version 1506679 (0.0008) [2023-12-26 11:37:31,595][123090] Updated weights for policy 1, policy_version 1496693 (0.0008) [2023-12-26 11:37:31,615][123091] Updated weights for policy 0, policy_version 1506689 (0.0008) [2023-12-26 11:37:31,670][123090] Updated weights for policy 1, policy_version 1496703 (0.0008) [2023-12-26 11:37:31,687][123091] Updated weights for policy 0, policy_version 1506699 (0.0007) [2023-12-26 11:37:32,485][123091] Updated weights for policy 0, policy_version 1506709 (0.0009) [2023-12-26 11:37:32,515][123090] Updated weights for policy 1, policy_version 1496713 (0.0008) [2023-12-26 11:37:32,542][123091] Updated weights for policy 0, policy_version 1506719 (0.0010) [2023-12-26 11:37:32,576][123090] Updated weights for policy 1, policy_version 1496723 (0.0009) [2023-12-26 11:37:32,600][123091] Updated weights for policy 0, policy_version 1506729 (0.0008) [2023-12-26 11:37:32,637][123090] Updated weights for policy 1, policy_version 1496733 (0.0006) [2023-12-26 11:37:33,270][123091] Updated weights for policy 0, policy_version 1506739 (0.0010) [2023-12-26 11:37:33,325][123090] Updated weights for policy 1, policy_version 1496743 (0.0007) [2023-12-26 11:37:33,339][123091] Updated weights for policy 0, policy_version 1506749 (0.0009) [2023-12-26 11:37:33,376][123090] Updated weights for policy 1, policy_version 1496753 (0.0007) [2023-12-26 11:37:33,405][123091] Updated weights for policy 0, policy_version 1506759 (0.0006) [2023-12-26 11:37:33,436][123090] Updated weights for policy 1, policy_version 1496763 (0.0007) [2023-12-26 11:37:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 768909312. Throughput: 0: 8778.0, 1: 9066.9. Samples: 768919608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:33,785][121949] Avg episode reward: [(0, '6099.524'), (1, '4681.304')] [2023-12-26 11:37:34,120][123090] Updated weights for policy 1, policy_version 1496773 (0.0007) [2023-12-26 11:37:34,187][123090] Updated weights for policy 1, policy_version 1496783 (0.0009) [2023-12-26 11:37:34,209][123091] Updated weights for policy 0, policy_version 1506769 (0.0006) [2023-12-26 11:37:34,246][123090] Updated weights for policy 1, policy_version 1496793 (0.0008) [2023-12-26 11:37:34,270][123091] Updated weights for policy 0, policy_version 1506779 (0.0009) [2023-12-26 11:37:34,335][123091] Updated weights for policy 0, policy_version 1506789 (0.0010) [2023-12-26 11:37:34,400][123091] Updated weights for policy 0, policy_version 1506799 (0.0009) [2023-12-26 11:37:34,968][123090] Updated weights for policy 1, policy_version 1496803 (0.0007) [2023-12-26 11:37:35,017][123090] Updated weights for policy 1, policy_version 1496813 (0.0005) [2023-12-26 11:37:35,061][123090] Updated weights for policy 1, policy_version 1496823 (0.0005) [2023-12-26 11:37:35,255][123091] Updated weights for policy 0, policy_version 1506809 (0.0010) [2023-12-26 11:37:35,313][123091] Updated weights for policy 0, policy_version 1506819 (0.0010) [2023-12-26 11:37:35,372][123091] Updated weights for policy 0, policy_version 1506829 (0.0010) [2023-12-26 11:37:35,829][123090] Updated weights for policy 1, policy_version 1496833 (0.0010) [2023-12-26 11:37:35,895][123090] Updated weights for policy 1, policy_version 1496843 (0.0010) [2023-12-26 11:37:35,951][123090] Updated weights for policy 1, policy_version 1496853 (0.0009) [2023-12-26 11:37:36,001][123090] Updated weights for policy 1, policy_version 1496863 (0.0010) [2023-12-26 11:37:36,169][123091] Updated weights for policy 0, policy_version 1506839 (0.0007) [2023-12-26 11:37:36,235][123091] Updated weights for policy 0, policy_version 1506849 (0.0008) [2023-12-26 11:37:36,297][123091] Updated weights for policy 0, policy_version 1506859 (0.0010) [2023-12-26 11:37:36,803][123090] Updated weights for policy 1, policy_version 1496873 (0.0009) [2023-12-26 11:37:36,856][123090] Updated weights for policy 1, policy_version 1496883 (0.0009) [2023-12-26 11:37:36,906][123090] Updated weights for policy 1, policy_version 1496893 (0.0010) [2023-12-26 11:37:36,987][123091] Updated weights for policy 0, policy_version 1506869 (0.0008) [2023-12-26 11:37:37,047][123091] Updated weights for policy 0, policy_version 1506879 (0.0009) [2023-12-26 11:37:37,111][123091] Updated weights for policy 0, policy_version 1506889 (0.0009) [2023-12-26 11:37:37,758][123090] Updated weights for policy 1, policy_version 1496903 (0.0010) [2023-12-26 11:37:37,825][123090] Updated weights for policy 1, policy_version 1496913 (0.0011) [2023-12-26 11:37:37,895][123090] Updated weights for policy 1, policy_version 1496923 (0.0010) [2023-12-26 11:37:37,928][123091] Updated weights for policy 0, policy_version 1506899 (0.0008) [2023-12-26 11:37:37,991][123091] Updated weights for policy 0, policy_version 1506909 (0.0007) [2023-12-26 11:37:38,053][123091] Updated weights for policy 0, policy_version 1506919 (0.0009) [2023-12-26 11:37:38,710][123090] Updated weights for policy 1, policy_version 1496933 (0.0010) [2023-12-26 11:37:38,784][123090] Updated weights for policy 1, policy_version 1496943 (0.0010) [2023-12-26 11:37:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 768991232. Throughput: 0: 8785.4, 1: 9122.6. Samples: 768973840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:38,785][121949] Avg episode reward: [(0, '6074.249'), (1, '4784.369')] [2023-12-26 11:37:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001506928_385777664.pth... [2023-12-26 11:37:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001505872_385507328.pth [2023-12-26 11:37:38,817][123091] Updated weights for policy 0, policy_version 1506929 (0.0008) [2023-12-26 11:37:38,848][123090] Updated weights for policy 1, policy_version 1496953 (0.0011) [2023-12-26 11:37:38,878][123091] Updated weights for policy 0, policy_version 1506939 (0.0006) [2023-12-26 11:37:38,887][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001496960_383221760.pth... [2023-12-26 11:37:38,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001495904_382951424.pth [2023-12-26 11:37:38,936][123091] Updated weights for policy 0, policy_version 1506949 (0.0006) [2023-12-26 11:37:38,999][123091] Updated weights for policy 0, policy_version 1506959 (0.0005) [2023-12-26 11:37:39,675][123090] Updated weights for policy 1, policy_version 1496963 (0.0009) [2023-12-26 11:37:39,694][123091] Updated weights for policy 0, policy_version 1506969 (0.0010) [2023-12-26 11:37:39,740][123090] Updated weights for policy 1, policy_version 1496973 (0.0006) [2023-12-26 11:37:39,751][123091] Updated weights for policy 0, policy_version 1506979 (0.0011) [2023-12-26 11:37:39,804][123091] Updated weights for policy 0, policy_version 1506989 (0.0006) [2023-12-26 11:37:39,806][123090] Updated weights for policy 1, policy_version 1496983 (0.0008) [2023-12-26 11:37:40,645][123090] Updated weights for policy 1, policy_version 1496993 (0.0008) [2023-12-26 11:37:40,664][123091] Updated weights for policy 0, policy_version 1506999 (0.0010) [2023-12-26 11:37:40,706][123090] Updated weights for policy 1, policy_version 1497003 (0.0006) [2023-12-26 11:37:40,725][123091] Updated weights for policy 0, policy_version 1507009 (0.0011) [2023-12-26 11:37:40,769][123090] Updated weights for policy 1, policy_version 1497013 (0.0007) [2023-12-26 11:37:40,787][123091] Updated weights for policy 0, policy_version 1507019 (0.0011) [2023-12-26 11:37:40,835][123090] Updated weights for policy 1, policy_version 1497023 (0.0007) [2023-12-26 11:37:41,625][123091] Updated weights for policy 0, policy_version 1507029 (0.0010) [2023-12-26 11:37:41,645][123090] Updated weights for policy 1, policy_version 1497033 (0.0011) [2023-12-26 11:37:41,691][123091] Updated weights for policy 0, policy_version 1507039 (0.0008) [2023-12-26 11:37:41,712][123090] Updated weights for policy 1, policy_version 1497043 (0.0008) [2023-12-26 11:37:41,761][123091] Updated weights for policy 0, policy_version 1507049 (0.0008) [2023-12-26 11:37:41,776][123090] Updated weights for policy 1, policy_version 1497053 (0.0008) [2023-12-26 11:37:42,540][123091] Updated weights for policy 0, policy_version 1507059 (0.0009) [2023-12-26 11:37:42,567][123090] Updated weights for policy 1, policy_version 1497063 (0.0007) [2023-12-26 11:37:42,605][123091] Updated weights for policy 0, policy_version 1507069 (0.0011) [2023-12-26 11:37:42,628][123090] Updated weights for policy 1, policy_version 1497073 (0.0010) [2023-12-26 11:37:42,665][123091] Updated weights for policy 0, policy_version 1507079 (0.0011) [2023-12-26 11:37:42,688][123090] Updated weights for policy 1, policy_version 1497083 (0.0010) [2023-12-26 11:37:43,450][123090] Updated weights for policy 1, policy_version 1497093 (0.0008) [2023-12-26 11:37:43,498][123090] Updated weights for policy 1, policy_version 1497103 (0.0008) [2023-12-26 11:37:43,503][123091] Updated weights for policy 0, policy_version 1507089 (0.0011) [2023-12-26 11:37:43,548][123090] Updated weights for policy 1, policy_version 1497113 (0.0008) [2023-12-26 11:37:43,562][123091] Updated weights for policy 0, policy_version 1507099 (0.0011) [2023-12-26 11:37:43,617][123091] Updated weights for policy 0, policy_version 1507109 (0.0011) [2023-12-26 11:37:43,671][123091] Updated weights for policy 0, policy_version 1507119 (0.0010) [2023-12-26 11:37:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 769089536. Throughput: 0: 8887.7, 1: 8967.3. Samples: 769078568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:37:43,784][121949] Avg episode reward: [(0, '6215.103'), (1, '4838.054')] [2023-12-26 11:37:44,318][123090] Updated weights for policy 1, policy_version 1497123 (0.0009) [2023-12-26 11:37:44,366][123090] Updated weights for policy 1, policy_version 1497133 (0.0010) [2023-12-26 11:37:44,425][123090] Updated weights for policy 1, policy_version 1497143 (0.0010) [2023-12-26 11:37:44,477][123091] Updated weights for policy 0, policy_version 1507129 (0.0006) [2023-12-26 11:37:44,543][123091] Updated weights for policy 0, policy_version 1507139 (0.0005) [2023-12-26 11:37:44,608][123091] Updated weights for policy 0, policy_version 1507149 (0.0005) [2023-12-26 11:37:45,213][123091] Updated weights for policy 0, policy_version 1507159 (0.0006) [2023-12-26 11:37:45,278][123090] Updated weights for policy 1, policy_version 1497153 (0.0010) [2023-12-26 11:37:45,279][123091] Updated weights for policy 0, policy_version 1507169 (0.0006) [2023-12-26 11:37:45,342][123091] Updated weights for policy 0, policy_version 1507179 (0.0006) [2023-12-26 11:37:45,346][123090] Updated weights for policy 1, policy_version 1497163 (0.0011) [2023-12-26 11:37:45,402][123090] Updated weights for policy 1, policy_version 1497173 (0.0010) [2023-12-26 11:37:45,461][123090] Updated weights for policy 1, policy_version 1497183 (0.0010) [2023-12-26 11:37:45,945][123091] Updated weights for policy 0, policy_version 1507189 (0.0006) [2023-12-26 11:37:45,994][123091] Updated weights for policy 0, policy_version 1507199 (0.0005) [2023-12-26 11:37:46,052][123091] Updated weights for policy 0, policy_version 1507209 (0.0007) [2023-12-26 11:37:46,179][123090] Updated weights for policy 1, policy_version 1497193 (0.0006) [2023-12-26 11:37:46,233][123090] Updated weights for policy 1, policy_version 1497203 (0.0005) [2023-12-26 11:37:46,290][123090] Updated weights for policy 1, policy_version 1497213 (0.0005) [2023-12-26 11:37:46,772][123091] Updated weights for policy 0, policy_version 1507219 (0.0008) [2023-12-26 11:37:46,823][123091] Updated weights for policy 0, policy_version 1507229 (0.0010) [2023-12-26 11:37:46,878][123091] Updated weights for policy 0, policy_version 1507239 (0.0011) [2023-12-26 11:37:46,915][123090] Updated weights for policy 1, policy_version 1497223 (0.0005) [2023-12-26 11:37:46,968][123090] Updated weights for policy 1, policy_version 1497233 (0.0005) [2023-12-26 11:37:47,024][123090] Updated weights for policy 1, policy_version 1497243 (0.0005) [2023-12-26 11:37:47,585][123091] Updated weights for policy 0, policy_version 1507249 (0.0010) [2023-12-26 11:37:47,633][123091] Updated weights for policy 0, policy_version 1507259 (0.0005) [2023-12-26 11:37:47,681][123091] Updated weights for policy 0, policy_version 1507269 (0.0006) [2023-12-26 11:37:47,682][123090] Updated weights for policy 1, policy_version 1497253 (0.0005) [2023-12-26 11:37:47,734][123090] Updated weights for policy 1, policy_version 1497263 (0.0006) [2023-12-26 11:37:47,737][123091] Updated weights for policy 0, policy_version 1507279 (0.0008) [2023-12-26 11:37:47,789][123090] Updated weights for policy 1, policy_version 1497273 (0.0010) [2023-12-26 11:37:48,552][123091] Updated weights for policy 0, policy_version 1507289 (0.0009) [2023-12-26 11:37:48,605][123091] Updated weights for policy 0, policy_version 1507299 (0.0008) [2023-12-26 11:37:48,617][123090] Updated weights for policy 1, policy_version 1497283 (0.0010) [2023-12-26 11:37:48,671][123091] Updated weights for policy 0, policy_version 1507309 (0.0010) [2023-12-26 11:37:48,677][123090] Updated weights for policy 1, policy_version 1497293 (0.0010) [2023-12-26 11:37:48,732][123090] Updated weights for policy 1, policy_version 1497303 (0.0010) [2023-12-26 11:37:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 769179648. Throughput: 0: 9011.3, 1: 9028.5. Samples: 769192212. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:37:48,784][121949] Avg episode reward: [(0, '6348.973'), (1, '5152.107')] [2023-12-26 11:37:49,546][123091] Updated weights for policy 0, policy_version 1507319 (0.0007) [2023-12-26 11:37:49,550][123090] Updated weights for policy 1, policy_version 1497313 (0.0011) [2023-12-26 11:37:49,605][123091] Updated weights for policy 0, policy_version 1507329 (0.0008) [2023-12-26 11:37:49,614][123090] Updated weights for policy 1, policy_version 1497323 (0.0011) [2023-12-26 11:37:49,663][123091] Updated weights for policy 0, policy_version 1507339 (0.0009) [2023-12-26 11:37:49,681][123090] Updated weights for policy 1, policy_version 1497333 (0.0007) [2023-12-26 11:37:49,745][123090] Updated weights for policy 1, policy_version 1497343 (0.0008) [2023-12-26 11:37:50,510][123091] Updated weights for policy 0, policy_version 1507349 (0.0009) [2023-12-26 11:37:50,563][123091] Updated weights for policy 0, policy_version 1507359 (0.0007) [2023-12-26 11:37:50,581][123090] Updated weights for policy 1, policy_version 1497353 (0.0010) [2023-12-26 11:37:50,626][123091] Updated weights for policy 0, policy_version 1507369 (0.0008) [2023-12-26 11:37:50,643][123090] Updated weights for policy 1, policy_version 1497363 (0.0008) [2023-12-26 11:37:50,710][123090] Updated weights for policy 1, policy_version 1497373 (0.0009) [2023-12-26 11:37:51,531][123091] Updated weights for policy 0, policy_version 1507379 (0.0008) [2023-12-26 11:37:51,546][123090] Updated weights for policy 1, policy_version 1497383 (0.0011) [2023-12-26 11:37:51,596][123091] Updated weights for policy 0, policy_version 1507389 (0.0007) [2023-12-26 11:37:51,612][123090] Updated weights for policy 1, policy_version 1497393 (0.0008) [2023-12-26 11:37:51,667][123091] Updated weights for policy 0, policy_version 1507399 (0.0007) [2023-12-26 11:37:51,678][123090] Updated weights for policy 1, policy_version 1497403 (0.0009) [2023-12-26 11:37:52,428][123090] Updated weights for policy 1, policy_version 1497413 (0.0009) [2023-12-26 11:37:52,489][123090] Updated weights for policy 1, policy_version 1497423 (0.0010) [2023-12-26 11:37:52,544][123090] Updated weights for policy 1, policy_version 1497433 (0.0009) [2023-12-26 11:37:52,557][123091] Updated weights for policy 0, policy_version 1507409 (0.0009) [2023-12-26 11:37:52,621][123091] Updated weights for policy 0, policy_version 1507419 (0.0008) [2023-12-26 11:37:52,685][123091] Updated weights for policy 0, policy_version 1507429 (0.0009) [2023-12-26 11:37:52,742][123091] Updated weights for policy 0, policy_version 1507439 (0.0010) [2023-12-26 11:37:53,399][123090] Updated weights for policy 1, policy_version 1497443 (0.0010) [2023-12-26 11:37:53,458][123090] Updated weights for policy 1, policy_version 1497453 (0.0009) [2023-12-26 11:37:53,526][123090] Updated weights for policy 1, policy_version 1497463 (0.0009) [2023-12-26 11:37:53,565][123091] Updated weights for policy 0, policy_version 1507449 (0.0006) [2023-12-26 11:37:53,619][123091] Updated weights for policy 0, policy_version 1507459 (0.0006) [2023-12-26 11:37:53,673][123091] Updated weights for policy 0, policy_version 1507469 (0.0005) [2023-12-26 11:37:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 769269760. Throughput: 0: 9028.2, 1: 8954.8. Samples: 769242432. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:37:53,785][121949] Avg episode reward: [(0, '6227.518'), (1, '5044.942')] [2023-12-26 11:37:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001507472_385916928.pth... [2023-12-26 11:37:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001497472_383352832.pth... [2023-12-26 11:37:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001506416_385646592.pth [2023-12-26 11:37:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001496416_383082496.pth [2023-12-26 11:37:54,333][123091] Updated weights for policy 0, policy_version 1507479 (0.0005) [2023-12-26 11:37:54,401][123091] Updated weights for policy 0, policy_version 1507489 (0.0006) [2023-12-26 11:37:54,439][123090] Updated weights for policy 1, policy_version 1497473 (0.0008) [2023-12-26 11:37:54,456][123091] Updated weights for policy 0, policy_version 1507499 (0.0009) [2023-12-26 11:37:54,493][123090] Updated weights for policy 1, policy_version 1497483 (0.0005) [2023-12-26 11:37:54,571][123090] Updated weights for policy 1, policy_version 1497493 (0.0005) [2023-12-26 11:37:54,644][123090] Updated weights for policy 1, policy_version 1497503 (0.0009) [2023-12-26 11:37:55,160][123091] Updated weights for policy 0, policy_version 1507509 (0.0005) [2023-12-26 11:37:55,213][123091] Updated weights for policy 0, policy_version 1507519 (0.0005) [2023-12-26 11:37:55,260][123091] Updated weights for policy 0, policy_version 1507529 (0.0005) [2023-12-26 11:37:55,399][123090] Updated weights for policy 1, policy_version 1497513 (0.0010) [2023-12-26 11:37:55,457][123090] Updated weights for policy 1, policy_version 1497523 (0.0010) [2023-12-26 11:37:55,522][123090] Updated weights for policy 1, policy_version 1497533 (0.0010) [2023-12-26 11:37:56,010][123091] Updated weights for policy 0, policy_version 1507539 (0.0007) [2023-12-26 11:37:56,073][123091] Updated weights for policy 0, policy_version 1507549 (0.0010) [2023-12-26 11:37:56,139][123091] Updated weights for policy 0, policy_version 1507559 (0.0009) [2023-12-26 11:37:56,258][123090] Updated weights for policy 1, policy_version 1497543 (0.0010) [2023-12-26 11:37:56,310][123090] Updated weights for policy 1, policy_version 1497553 (0.0010) [2023-12-26 11:37:56,358][123090] Updated weights for policy 1, policy_version 1497563 (0.0010) [2023-12-26 11:37:56,810][123091] Updated weights for policy 0, policy_version 1507569 (0.0008) [2023-12-26 11:37:56,873][123091] Updated weights for policy 0, policy_version 1507579 (0.0005) [2023-12-26 11:37:56,932][123091] Updated weights for policy 0, policy_version 1507589 (0.0005) [2023-12-26 11:37:56,980][123091] Updated weights for policy 0, policy_version 1507599 (0.0005) [2023-12-26 11:37:57,177][123090] Updated weights for policy 1, policy_version 1497573 (0.0008) [2023-12-26 11:37:57,232][123090] Updated weights for policy 1, policy_version 1497583 (0.0005) [2023-12-26 11:37:57,277][123090] Updated weights for policy 1, policy_version 1497593 (0.0005) [2023-12-26 11:37:57,700][123091] Updated weights for policy 0, policy_version 1507609 (0.0010) [2023-12-26 11:37:57,751][123091] Updated weights for policy 0, policy_version 1507619 (0.0010) [2023-12-26 11:37:57,806][123091] Updated weights for policy 0, policy_version 1507629 (0.0010) [2023-12-26 11:37:57,980][123090] Updated weights for policy 1, policy_version 1497603 (0.0006) [2023-12-26 11:37:58,044][123090] Updated weights for policy 1, policy_version 1497613 (0.0008) [2023-12-26 11:37:58,117][123090] Updated weights for policy 1, policy_version 1497623 (0.0008) [2023-12-26 11:37:58,658][123091] Updated weights for policy 0, policy_version 1507639 (0.0008) [2023-12-26 11:37:58,726][123091] Updated weights for policy 0, policy_version 1507649 (0.0007) [2023-12-26 11:37:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 769351680. Throughput: 0: 9185.4, 1: 8952.1. Samples: 769352000. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:37:58,785][121949] Avg episode reward: [(0, '6196.435'), (1, '5057.894')] [2023-12-26 11:37:58,795][123091] Updated weights for policy 0, policy_version 1507659 (0.0008) [2023-12-26 11:37:58,982][123090] Updated weights for policy 1, policy_version 1497633 (0.0009) [2023-12-26 11:37:59,040][123090] Updated weights for policy 1, policy_version 1497643 (0.0009) [2023-12-26 11:37:59,087][123090] Updated weights for policy 1, policy_version 1497653 (0.0007) [2023-12-26 11:37:59,131][123090] Updated weights for policy 1, policy_version 1497663 (0.0005) [2023-12-26 11:37:59,518][123091] Updated weights for policy 0, policy_version 1507669 (0.0007) [2023-12-26 11:37:59,578][123091] Updated weights for policy 0, policy_version 1507679 (0.0009) [2023-12-26 11:37:59,630][123091] Updated weights for policy 0, policy_version 1507689 (0.0009) [2023-12-26 11:37:59,943][123090] Updated weights for policy 1, policy_version 1497673 (0.0009) [2023-12-26 11:38:00,011][123090] Updated weights for policy 1, policy_version 1497683 (0.0009) [2023-12-26 11:38:00,074][123090] Updated weights for policy 1, policy_version 1497694 (0.0010) [2023-12-26 11:38:00,451][123091] Updated weights for policy 0, policy_version 1507699 (0.0008) [2023-12-26 11:38:00,506][123091] Updated weights for policy 0, policy_version 1507709 (0.0005) [2023-12-26 11:38:00,566][123091] Updated weights for policy 0, policy_version 1507719 (0.0005) [2023-12-26 11:38:00,917][123090] Updated weights for policy 1, policy_version 1497704 (0.0008) [2023-12-26 11:38:00,964][123090] Updated weights for policy 1, policy_version 1497714 (0.0008) [2023-12-26 11:38:01,023][123090] Updated weights for policy 1, policy_version 1497724 (0.0009) [2023-12-26 11:38:01,328][123091] Updated weights for policy 0, policy_version 1507729 (0.0007) [2023-12-26 11:38:01,401][123091] Updated weights for policy 0, policy_version 1507739 (0.0008) [2023-12-26 11:38:01,458][123091] Updated weights for policy 0, policy_version 1507749 (0.0010) [2023-12-26 11:38:01,513][123091] Updated weights for policy 0, policy_version 1507759 (0.0009) [2023-12-26 11:38:01,908][123090] Updated weights for policy 1, policy_version 1497734 (0.0009) [2023-12-26 11:38:01,978][123090] Updated weights for policy 1, policy_version 1497744 (0.0010) [2023-12-26 11:38:02,048][123090] Updated weights for policy 1, policy_version 1497754 (0.0010) [2023-12-26 11:38:02,271][123091] Updated weights for policy 0, policy_version 1507769 (0.0009) [2023-12-26 11:38:02,332][123091] Updated weights for policy 0, policy_version 1507779 (0.0005) [2023-12-26 11:38:02,399][123091] Updated weights for policy 0, policy_version 1507789 (0.0009) [2023-12-26 11:38:02,936][123090] Updated weights for policy 1, policy_version 1497764 (0.0009) [2023-12-26 11:38:03,012][123090] Updated weights for policy 1, policy_version 1497774 (0.0006) [2023-12-26 11:38:03,083][123090] Updated weights for policy 1, policy_version 1497784 (0.0011) [2023-12-26 11:38:03,211][123091] Updated weights for policy 0, policy_version 1507799 (0.0010) [2023-12-26 11:38:03,273][123091] Updated weights for policy 0, policy_version 1507809 (0.0007) [2023-12-26 11:38:03,326][123091] Updated weights for policy 0, policy_version 1507819 (0.0005) [2023-12-26 11:38:03,734][123090] Updated weights for policy 1, policy_version 1497794 (0.0007) [2023-12-26 11:38:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 769441792. Throughput: 0: 9117.9, 1: 8856.6. Samples: 769455916. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:03,785][121949] Avg episode reward: [(0, '6148.146'), (1, '4821.062')] [2023-12-26 11:38:03,807][123090] Updated weights for policy 1, policy_version 1497804 (0.0007) [2023-12-26 11:38:03,873][123090] Updated weights for policy 1, policy_version 1497814 (0.0008) [2023-12-26 11:38:03,931][123090] Updated weights for policy 1, policy_version 1497824 (0.0006) [2023-12-26 11:38:04,172][123091] Updated weights for policy 0, policy_version 1507829 (0.0007) [2023-12-26 11:38:04,225][123091] Updated weights for policy 0, policy_version 1507839 (0.0008) [2023-12-26 11:38:04,279][123091] Updated weights for policy 0, policy_version 1507849 (0.0008) [2023-12-26 11:38:04,688][123090] Updated weights for policy 1, policy_version 1497834 (0.0007) [2023-12-26 11:38:04,753][123090] Updated weights for policy 1, policy_version 1497844 (0.0005) [2023-12-26 11:38:04,821][123090] Updated weights for policy 1, policy_version 1497854 (0.0005) [2023-12-26 11:38:05,070][123091] Updated weights for policy 0, policy_version 1507859 (0.0009) [2023-12-26 11:38:05,130][123091] Updated weights for policy 0, policy_version 1507869 (0.0009) [2023-12-26 11:38:05,178][123091] Updated weights for policy 0, policy_version 1507879 (0.0008) [2023-12-26 11:38:05,551][123090] Updated weights for policy 1, policy_version 1497864 (0.0005) [2023-12-26 11:38:05,622][123090] Updated weights for policy 1, policy_version 1497874 (0.0005) [2023-12-26 11:38:05,695][123090] Updated weights for policy 1, policy_version 1497884 (0.0005) [2023-12-26 11:38:05,809][123091] Updated weights for policy 0, policy_version 1507889 (0.0008) [2023-12-26 11:38:05,867][123091] Updated weights for policy 0, policy_version 1507899 (0.0005) [2023-12-26 11:38:05,921][123091] Updated weights for policy 0, policy_version 1507909 (0.0005) [2023-12-26 11:38:05,979][123091] Updated weights for policy 0, policy_version 1507919 (0.0005) [2023-12-26 11:38:06,336][123090] Updated weights for policy 1, policy_version 1497894 (0.0006) [2023-12-26 11:38:06,393][123090] Updated weights for policy 1, policy_version 1497904 (0.0005) [2023-12-26 11:38:06,454][123090] Updated weights for policy 1, policy_version 1497914 (0.0006) [2023-12-26 11:38:06,747][123091] Updated weights for policy 0, policy_version 1507929 (0.0005) [2023-12-26 11:38:06,796][123091] Updated weights for policy 0, policy_version 1507939 (0.0005) [2023-12-26 11:38:06,844][123091] Updated weights for policy 0, policy_version 1507949 (0.0005) [2023-12-26 11:38:07,148][123090] Updated weights for policy 1, policy_version 1497924 (0.0008) [2023-12-26 11:38:07,208][123090] Updated weights for policy 1, policy_version 1497934 (0.0011) [2023-12-26 11:38:07,261][123090] Updated weights for policy 1, policy_version 1497944 (0.0011) [2023-12-26 11:38:07,598][123091] Updated weights for policy 0, policy_version 1507959 (0.0008) [2023-12-26 11:38:07,646][123091] Updated weights for policy 0, policy_version 1507969 (0.0009) [2023-12-26 11:38:07,693][123091] Updated weights for policy 0, policy_version 1507979 (0.0008) [2023-12-26 11:38:08,104][123090] Updated weights for policy 1, policy_version 1497954 (0.0011) [2023-12-26 11:38:08,152][123090] Updated weights for policy 1, policy_version 1497964 (0.0010) [2023-12-26 11:38:08,206][123090] Updated weights for policy 1, policy_version 1497974 (0.0010) [2023-12-26 11:38:08,265][123090] Updated weights for policy 1, policy_version 1497984 (0.0010) [2023-12-26 11:38:08,521][123091] Updated weights for policy 0, policy_version 1507989 (0.0010) [2023-12-26 11:38:08,574][123091] Updated weights for policy 0, policy_version 1507999 (0.0011) [2023-12-26 11:38:08,618][123091] Updated weights for policy 0, policy_version 1508009 (0.0010) [2023-12-26 11:38:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 769540096. Throughput: 0: 9124.7, 1: 8921.1. Samples: 769513180. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:08,785][121949] Avg episode reward: [(0, '6105.838'), (1, '5003.929')] [2023-12-26 11:38:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001508016_386056192.pth... [2023-12-26 11:38:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001497984_383483904.pth... [2023-12-26 11:38:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001506928_385777664.pth [2023-12-26 11:38:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001496960_383221760.pth [2023-12-26 11:38:09,029][123090] Updated weights for policy 1, policy_version 1497994 (0.0011) [2023-12-26 11:38:09,093][123090] Updated weights for policy 1, policy_version 1498004 (0.0010) [2023-12-26 11:38:09,160][123090] Updated weights for policy 1, policy_version 1498014 (0.0011) [2023-12-26 11:38:09,475][123091] Updated weights for policy 0, policy_version 1508019 (0.0011) [2023-12-26 11:38:09,536][123091] Updated weights for policy 0, policy_version 1508029 (0.0010) [2023-12-26 11:38:09,595][123091] Updated weights for policy 0, policy_version 1508039 (0.0008) [2023-12-26 11:38:09,989][123090] Updated weights for policy 1, policy_version 1498024 (0.0010) [2023-12-26 11:38:10,057][123090] Updated weights for policy 1, policy_version 1498034 (0.0011) [2023-12-26 11:38:10,113][123090] Updated weights for policy 1, policy_version 1498044 (0.0010) [2023-12-26 11:38:10,434][123091] Updated weights for policy 0, policy_version 1508049 (0.0008) [2023-12-26 11:38:10,483][123091] Updated weights for policy 0, policy_version 1508059 (0.0009) [2023-12-26 11:38:10,539][123091] Updated weights for policy 0, policy_version 1508069 (0.0009) [2023-12-26 11:38:10,604][123091] Updated weights for policy 0, policy_version 1508079 (0.0009) [2023-12-26 11:38:10,941][123090] Updated weights for policy 1, policy_version 1498054 (0.0010) [2023-12-26 11:38:10,997][123090] Updated weights for policy 1, policy_version 1498064 (0.0010) [2023-12-26 11:38:11,059][123090] Updated weights for policy 1, policy_version 1498074 (0.0011) [2023-12-26 11:38:11,385][123091] Updated weights for policy 0, policy_version 1508089 (0.0008) [2023-12-26 11:38:11,445][123091] Updated weights for policy 0, policy_version 1508099 (0.0008) [2023-12-26 11:38:11,493][123091] Updated weights for policy 0, policy_version 1508109 (0.0008) [2023-12-26 11:38:11,985][123090] Updated weights for policy 1, policy_version 1498084 (0.0010) [2023-12-26 11:38:12,054][123090] Updated weights for policy 1, policy_version 1498094 (0.0011) [2023-12-26 11:38:12,118][123090] Updated weights for policy 1, policy_version 1498104 (0.0011) [2023-12-26 11:38:12,328][123091] Updated weights for policy 0, policy_version 1508119 (0.0008) [2023-12-26 11:38:12,397][123091] Updated weights for policy 0, policy_version 1508129 (0.0010) [2023-12-26 11:38:12,463][123091] Updated weights for policy 0, policy_version 1508139 (0.0010) [2023-12-26 11:38:12,902][123090] Updated weights for policy 1, policy_version 1498114 (0.0010) [2023-12-26 11:38:12,974][123090] Updated weights for policy 1, policy_version 1498124 (0.0010) [2023-12-26 11:38:13,046][123090] Updated weights for policy 1, policy_version 1498134 (0.0010) [2023-12-26 11:38:13,114][123090] Updated weights for policy 1, policy_version 1498144 (0.0010) [2023-12-26 11:38:13,237][123091] Updated weights for policy 0, policy_version 1508149 (0.0009) [2023-12-26 11:38:13,304][123091] Updated weights for policy 0, policy_version 1508159 (0.0010) [2023-12-26 11:38:13,372][123091] Updated weights for policy 0, policy_version 1508169 (0.0009) [2023-12-26 11:38:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 769622016. Throughput: 0: 9042.8, 1: 8877.7. Samples: 769616856. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:13,785][121949] Avg episode reward: [(0, '6227.384'), (1, '4988.526')] [2023-12-26 11:38:13,947][123090] Updated weights for policy 1, policy_version 1498154 (0.0010) [2023-12-26 11:38:14,003][123090] Updated weights for policy 1, policy_version 1498164 (0.0010) [2023-12-26 11:38:14,068][123090] Updated weights for policy 1, policy_version 1498174 (0.0010) [2023-12-26 11:38:14,189][123091] Updated weights for policy 0, policy_version 1508179 (0.0009) [2023-12-26 11:38:14,245][123091] Updated weights for policy 0, policy_version 1508189 (0.0009) [2023-12-26 11:38:14,308][123091] Updated weights for policy 0, policy_version 1508199 (0.0009) [2023-12-26 11:38:14,883][123090] Updated weights for policy 1, policy_version 1498184 (0.0010) [2023-12-26 11:38:14,948][123090] Updated weights for policy 1, policy_version 1498194 (0.0009) [2023-12-26 11:38:15,012][123090] Updated weights for policy 1, policy_version 1498204 (0.0009) [2023-12-26 11:38:15,145][123091] Updated weights for policy 0, policy_version 1508209 (0.0009) [2023-12-26 11:38:15,218][123091] Updated weights for policy 0, policy_version 1508219 (0.0009) [2023-12-26 11:38:15,285][123091] Updated weights for policy 0, policy_version 1508229 (0.0010) [2023-12-26 11:38:15,350][123091] Updated weights for policy 0, policy_version 1508239 (0.0010) [2023-12-26 11:38:15,779][123090] Updated weights for policy 1, policy_version 1498214 (0.0009) [2023-12-26 11:38:15,833][123090] Updated weights for policy 1, policy_version 1498224 (0.0009) [2023-12-26 11:38:15,885][123090] Updated weights for policy 1, policy_version 1498234 (0.0009) [2023-12-26 11:38:16,115][123091] Updated weights for policy 0, policy_version 1508249 (0.0010) [2023-12-26 11:38:16,166][123091] Updated weights for policy 0, policy_version 1508259 (0.0009) [2023-12-26 11:38:16,220][123091] Updated weights for policy 0, policy_version 1508269 (0.0009) [2023-12-26 11:38:16,659][123090] Updated weights for policy 1, policy_version 1498244 (0.0008) [2023-12-26 11:38:16,716][123090] Updated weights for policy 1, policy_version 1498254 (0.0009) [2023-12-26 11:38:16,773][123090] Updated weights for policy 1, policy_version 1498264 (0.0009) [2023-12-26 11:38:17,069][123091] Updated weights for policy 0, policy_version 1508279 (0.0009) [2023-12-26 11:38:17,125][123091] Updated weights for policy 0, policy_version 1508289 (0.0005) [2023-12-26 11:38:17,186][123091] Updated weights for policy 0, policy_version 1508300 (0.0010) [2023-12-26 11:38:17,555][123090] Updated weights for policy 1, policy_version 1498274 (0.0009) [2023-12-26 11:38:17,610][123090] Updated weights for policy 1, policy_version 1498284 (0.0009) [2023-12-26 11:38:17,677][123090] Updated weights for policy 1, policy_version 1498294 (0.0010) [2023-12-26 11:38:17,742][123090] Updated weights for policy 1, policy_version 1498304 (0.0010) [2023-12-26 11:38:17,959][123091] Updated weights for policy 0, policy_version 1508310 (0.0007) [2023-12-26 11:38:18,037][123091] Updated weights for policy 0, policy_version 1508320 (0.0007) [2023-12-26 11:38:18,102][123091] Updated weights for policy 0, policy_version 1508330 (0.0009) [2023-12-26 11:38:18,625][123090] Updated weights for policy 1, policy_version 1498314 (0.0010) [2023-12-26 11:38:18,677][123090] Updated weights for policy 1, policy_version 1498324 (0.0010) [2023-12-26 11:38:18,729][123090] Updated weights for policy 1, policy_version 1498334 (0.0010) [2023-12-26 11:38:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 769712128. Throughput: 0: 8973.8, 1: 8842.6. Samples: 769721352. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:18,786][121949] Avg episode reward: [(0, '6284.582'), (1, '4883.231')] [2023-12-26 11:38:18,841][123091] Updated weights for policy 0, policy_version 1508340 (0.0009) [2023-12-26 11:38:18,893][123091] Updated weights for policy 0, policy_version 1508350 (0.0009) [2023-12-26 11:38:18,941][123091] Updated weights for policy 0, policy_version 1508360 (0.0009) [2023-12-26 11:38:19,653][123090] Updated weights for policy 1, policy_version 1498344 (0.0011) [2023-12-26 11:38:19,706][123090] Updated weights for policy 1, policy_version 1498354 (0.0010) [2023-12-26 11:38:19,769][123090] Updated weights for policy 1, policy_version 1498364 (0.0011) [2023-12-26 11:38:19,783][123091] Updated weights for policy 0, policy_version 1508370 (0.0008) [2023-12-26 11:38:19,860][123091] Updated weights for policy 0, policy_version 1508380 (0.0008) [2023-12-26 11:38:19,921][123091] Updated weights for policy 0, policy_version 1508390 (0.0010) [2023-12-26 11:38:19,992][123091] Updated weights for policy 0, policy_version 1508400 (0.0009) [2023-12-26 11:38:20,582][123090] Updated weights for policy 1, policy_version 1498374 (0.0011) [2023-12-26 11:38:20,639][123090] Updated weights for policy 1, policy_version 1498384 (0.0010) [2023-12-26 11:38:20,703][123090] Updated weights for policy 1, policy_version 1498394 (0.0010) [2023-12-26 11:38:20,843][123091] Updated weights for policy 0, policy_version 1508410 (0.0010) [2023-12-26 11:38:20,911][123091] Updated weights for policy 0, policy_version 1508420 (0.0010) [2023-12-26 11:38:20,978][123091] Updated weights for policy 0, policy_version 1508430 (0.0010) [2023-12-26 11:38:21,571][123090] Updated weights for policy 1, policy_version 1498404 (0.0008) [2023-12-26 11:38:21,643][123090] Updated weights for policy 1, policy_version 1498414 (0.0009) [2023-12-26 11:38:21,700][123090] Updated weights for policy 1, policy_version 1498424 (0.0010) [2023-12-26 11:38:21,828][123091] Updated weights for policy 0, policy_version 1508440 (0.0009) [2023-12-26 11:38:21,889][123091] Updated weights for policy 0, policy_version 1508450 (0.0010) [2023-12-26 11:38:21,952][123091] Updated weights for policy 0, policy_version 1508460 (0.0010) [2023-12-26 11:38:22,498][123090] Updated weights for policy 1, policy_version 1498434 (0.0008) [2023-12-26 11:38:22,547][123090] Updated weights for policy 1, policy_version 1498444 (0.0009) [2023-12-26 11:38:22,595][123090] Updated weights for policy 1, policy_version 1498454 (0.0009) [2023-12-26 11:38:22,651][123090] Updated weights for policy 1, policy_version 1498464 (0.0010) [2023-12-26 11:38:22,801][123091] Updated weights for policy 0, policy_version 1508470 (0.0007) [2023-12-26 11:38:22,867][123091] Updated weights for policy 0, policy_version 1508480 (0.0009) [2023-12-26 11:38:22,918][123091] Updated weights for policy 0, policy_version 1508490 (0.0010) [2023-12-26 11:38:23,555][123090] Updated weights for policy 1, policy_version 1498474 (0.0010) [2023-12-26 11:38:23,595][123091] Updated weights for policy 0, policy_version 1508500 (0.0008) [2023-12-26 11:38:23,620][123090] Updated weights for policy 1, policy_version 1498484 (0.0009) [2023-12-26 11:38:23,644][123091] Updated weights for policy 0, policy_version 1508510 (0.0005) [2023-12-26 11:38:23,686][123090] Updated weights for policy 1, policy_version 1498494 (0.0007) [2023-12-26 11:38:23,698][123091] Updated weights for policy 0, policy_version 1508520 (0.0006) [2023-12-26 11:38:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 769802240. Throughput: 0: 8955.8, 1: 8771.1. Samples: 769771552. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:23,785][121949] Avg episode reward: [(0, '6234.966'), (1, '4853.298')] [2023-12-26 11:38:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001508528_386187264.pth... [2023-12-26 11:38:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001498496_383614976.pth... [2023-12-26 11:38:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001507472_385916928.pth [2023-12-26 11:38:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001497472_383352832.pth [2023-12-26 11:38:24,468][123091] Updated weights for policy 0, policy_version 1508530 (0.0006) [2023-12-26 11:38:24,473][123090] Updated weights for policy 1, policy_version 1498504 (0.0007) [2023-12-26 11:38:24,525][123091] Updated weights for policy 0, policy_version 1508540 (0.0008) [2023-12-26 11:38:24,540][123090] Updated weights for policy 1, policy_version 1498514 (0.0006) [2023-12-26 11:38:24,578][123091] Updated weights for policy 0, policy_version 1508550 (0.0009) [2023-12-26 11:38:24,591][123090] Updated weights for policy 1, policy_version 1498524 (0.0006) [2023-12-26 11:38:24,642][123091] Updated weights for policy 0, policy_version 1508560 (0.0009) [2023-12-26 11:38:25,341][123090] Updated weights for policy 1, policy_version 1498534 (0.0006) [2023-12-26 11:38:25,407][123090] Updated weights for policy 1, policy_version 1498544 (0.0006) [2023-12-26 11:38:25,451][123091] Updated weights for policy 0, policy_version 1508570 (0.0007) [2023-12-26 11:38:25,470][123090] Updated weights for policy 1, policy_version 1498554 (0.0005) [2023-12-26 11:38:25,509][123091] Updated weights for policy 0, policy_version 1508580 (0.0009) [2023-12-26 11:38:25,575][123091] Updated weights for policy 0, policy_version 1508590 (0.0010) [2023-12-26 11:38:26,007][123090] Updated weights for policy 1, policy_version 1498564 (0.0007) [2023-12-26 11:38:26,069][123090] Updated weights for policy 1, policy_version 1498574 (0.0008) [2023-12-26 11:38:26,128][123090] Updated weights for policy 1, policy_version 1498584 (0.0009) [2023-12-26 11:38:26,402][123091] Updated weights for policy 0, policy_version 1508600 (0.0010) [2023-12-26 11:38:26,466][123091] Updated weights for policy 0, policy_version 1508610 (0.0010) [2023-12-26 11:38:26,522][123091] Updated weights for policy 0, policy_version 1508620 (0.0010) [2023-12-26 11:38:26,945][123090] Updated weights for policy 1, policy_version 1498594 (0.0009) [2023-12-26 11:38:26,991][123090] Updated weights for policy 1, policy_version 1498604 (0.0005) [2023-12-26 11:38:27,041][123090] Updated weights for policy 1, policy_version 1498614 (0.0005) [2023-12-26 11:38:27,092][123090] Updated weights for policy 1, policy_version 1498624 (0.0008) [2023-12-26 11:38:27,372][123091] Updated weights for policy 0, policy_version 1508630 (0.0010) [2023-12-26 11:38:27,427][123091] Updated weights for policy 0, policy_version 1508640 (0.0010) [2023-12-26 11:38:27,485][123091] Updated weights for policy 0, policy_version 1508650 (0.0010) [2023-12-26 11:38:27,921][123090] Updated weights for policy 1, policy_version 1498634 (0.0010) [2023-12-26 11:38:27,982][123090] Updated weights for policy 1, policy_version 1498644 (0.0010) [2023-12-26 11:38:28,048][123090] Updated weights for policy 1, policy_version 1498654 (0.0010) [2023-12-26 11:38:28,161][123091] Updated weights for policy 0, policy_version 1508660 (0.0008) [2023-12-26 11:38:28,221][123091] Updated weights for policy 0, policy_version 1508670 (0.0005) [2023-12-26 11:38:28,295][123091] Updated weights for policy 0, policy_version 1508680 (0.0007) [2023-12-26 11:38:28,781][123090] Updated weights for policy 1, policy_version 1498664 (0.0006) [2023-12-26 11:38:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 769884160. Throughput: 0: 8943.0, 1: 8843.7. Samples: 769878972. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:28,784][121949] Avg episode reward: [(0, '6243.946'), (1, '4935.808')] [2023-12-26 11:38:28,841][123090] Updated weights for policy 1, policy_version 1498674 (0.0006) [2023-12-26 11:38:28,921][123090] Updated weights for policy 1, policy_version 1498684 (0.0007) [2023-12-26 11:38:29,101][123091] Updated weights for policy 0, policy_version 1508690 (0.0009) [2023-12-26 11:38:29,152][123091] Updated weights for policy 0, policy_version 1508700 (0.0005) [2023-12-26 11:38:29,197][123091] Updated weights for policy 0, policy_version 1508710 (0.0005) [2023-12-26 11:38:29,262][123091] Updated weights for policy 0, policy_version 1508720 (0.0009) [2023-12-26 11:38:29,684][123090] Updated weights for policy 1, policy_version 1498694 (0.0010) [2023-12-26 11:38:29,746][123090] Updated weights for policy 1, policy_version 1498704 (0.0010) [2023-12-26 11:38:29,812][123090] Updated weights for policy 1, policy_version 1498714 (0.0010) [2023-12-26 11:38:30,074][123091] Updated weights for policy 0, policy_version 1508730 (0.0010) [2023-12-26 11:38:30,132][123091] Updated weights for policy 0, policy_version 1508740 (0.0010) [2023-12-26 11:38:30,194][123091] Updated weights for policy 0, policy_version 1508750 (0.0010) [2023-12-26 11:38:30,648][123090] Updated weights for policy 1, policy_version 1498724 (0.0011) [2023-12-26 11:38:30,703][123090] Updated weights for policy 1, policy_version 1498734 (0.0010) [2023-12-26 11:38:30,757][123090] Updated weights for policy 1, policy_version 1498744 (0.0010) [2023-12-26 11:38:30,904][123091] Updated weights for policy 0, policy_version 1508760 (0.0010) [2023-12-26 11:38:30,951][123091] Updated weights for policy 0, policy_version 1508770 (0.0010) [2023-12-26 11:38:30,997][123091] Updated weights for policy 0, policy_version 1508780 (0.0010) [2023-12-26 11:38:31,600][123090] Updated weights for policy 1, policy_version 1498754 (0.0010) [2023-12-26 11:38:31,669][123090] Updated weights for policy 1, policy_version 1498764 (0.0010) [2023-12-26 11:38:31,746][123090] Updated weights for policy 1, policy_version 1498774 (0.0009) [2023-12-26 11:38:31,815][123090] Updated weights for policy 1, policy_version 1498784 (0.0008) [2023-12-26 11:38:31,860][123091] Updated weights for policy 0, policy_version 1508790 (0.0010) [2023-12-26 11:38:31,922][123091] Updated weights for policy 0, policy_version 1508800 (0.0010) [2023-12-26 11:38:31,992][123091] Updated weights for policy 0, policy_version 1508810 (0.0011) [2023-12-26 11:38:32,637][123090] Updated weights for policy 1, policy_version 1498794 (0.0010) [2023-12-26 11:38:32,691][123090] Updated weights for policy 1, policy_version 1498804 (0.0010) [2023-12-26 11:38:32,717][123091] Updated weights for policy 0, policy_version 1508820 (0.0008) [2023-12-26 11:38:32,749][123090] Updated weights for policy 1, policy_version 1498814 (0.0009) [2023-12-26 11:38:32,770][123091] Updated weights for policy 0, policy_version 1508830 (0.0005) [2023-12-26 11:38:32,820][123091] Updated weights for policy 0, policy_version 1508840 (0.0005) [2023-12-26 11:38:33,526][123091] Updated weights for policy 0, policy_version 1508850 (0.0006) [2023-12-26 11:38:33,586][123091] Updated weights for policy 0, policy_version 1508860 (0.0005) [2023-12-26 11:38:33,645][123091] Updated weights for policy 0, policy_version 1508870 (0.0011) [2023-12-26 11:38:33,683][123090] Updated weights for policy 1, policy_version 1498824 (0.0010) [2023-12-26 11:38:33,709][123091] Updated weights for policy 0, policy_version 1508880 (0.0011) [2023-12-26 11:38:33,750][123090] Updated weights for policy 1, policy_version 1498834 (0.0010) [2023-12-26 11:38:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 769974272. Throughput: 0: 8917.3, 1: 8719.7. Samples: 769985880. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:33,785][121949] Avg episode reward: [(0, '6269.446'), (1, '5106.244')] [2023-12-26 11:38:33,811][123090] Updated weights for policy 1, policy_version 1498844 (0.0009) [2023-12-26 11:38:34,516][123091] Updated weights for policy 0, policy_version 1508890 (0.0011) [2023-12-26 11:38:34,576][123091] Updated weights for policy 0, policy_version 1508900 (0.0011) [2023-12-26 11:38:34,635][123091] Updated weights for policy 0, policy_version 1508910 (0.0011) [2023-12-26 11:38:34,646][123090] Updated weights for policy 1, policy_version 1498854 (0.0009) [2023-12-26 11:38:34,706][123090] Updated weights for policy 1, policy_version 1498864 (0.0008) [2023-12-26 11:38:34,775][123090] Updated weights for policy 1, policy_version 1498874 (0.0006) [2023-12-26 11:38:35,438][123091] Updated weights for policy 0, policy_version 1508920 (0.0006) [2023-12-26 11:38:35,502][123091] Updated weights for policy 0, policy_version 1508930 (0.0006) [2023-12-26 11:38:35,516][123090] Updated weights for policy 1, policy_version 1498884 (0.0007) [2023-12-26 11:38:35,562][123091] Updated weights for policy 0, policy_version 1508940 (0.0005) [2023-12-26 11:38:35,566][123090] Updated weights for policy 1, policy_version 1498894 (0.0009) [2023-12-26 11:38:35,617][123090] Updated weights for policy 1, policy_version 1498904 (0.0009) [2023-12-26 11:38:36,227][123091] Updated weights for policy 0, policy_version 1508950 (0.0005) [2023-12-26 11:38:36,293][123091] Updated weights for policy 0, policy_version 1508960 (0.0006) [2023-12-26 11:38:36,358][123091] Updated weights for policy 0, policy_version 1508970 (0.0006) [2023-12-26 11:38:36,397][123090] Updated weights for policy 1, policy_version 1498914 (0.0006) [2023-12-26 11:38:36,462][123090] Updated weights for policy 1, policy_version 1498924 (0.0009) [2023-12-26 11:38:36,529][123090] Updated weights for policy 1, policy_version 1498934 (0.0010) [2023-12-26 11:38:36,594][123090] Updated weights for policy 1, policy_version 1498944 (0.0011) [2023-12-26 11:38:37,175][123091] Updated weights for policy 0, policy_version 1508980 (0.0008) [2023-12-26 11:38:37,226][123091] Updated weights for policy 0, policy_version 1508991 (0.0010) [2023-12-26 11:38:37,276][123091] Updated weights for policy 0, policy_version 1509002 (0.0009) [2023-12-26 11:38:37,311][123090] Updated weights for policy 1, policy_version 1498954 (0.0006) [2023-12-26 11:38:37,365][123090] Updated weights for policy 1, policy_version 1498964 (0.0005) [2023-12-26 11:38:37,417][123090] Updated weights for policy 1, policy_version 1498974 (0.0005) [2023-12-26 11:38:38,136][123090] Updated weights for policy 1, policy_version 1498984 (0.0009) [2023-12-26 11:38:38,184][123090] Updated weights for policy 1, policy_version 1498994 (0.0010) [2023-12-26 11:38:38,206][123091] Updated weights for policy 0, policy_version 1509012 (0.0009) [2023-12-26 11:38:38,240][123090] Updated weights for policy 1, policy_version 1499004 (0.0010) [2023-12-26 11:38:38,257][123091] Updated weights for policy 0, policy_version 1509022 (0.0006) [2023-12-26 11:38:38,329][123091] Updated weights for policy 0, policy_version 1509032 (0.0006) [2023-12-26 11:38:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 770064384. Throughput: 0: 8982.8, 1: 8760.4. Samples: 770040880. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:38,785][121949] Avg episode reward: [(0, '6213.850'), (1, '5249.170')] [2023-12-26 11:38:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001509040_386318336.pth... [2023-12-26 11:38:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001499008_383746048.pth... [2023-12-26 11:38:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001497984_383483904.pth [2023-12-26 11:38:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001508016_386056192.pth [2023-12-26 11:38:39,021][123091] Updated weights for policy 0, policy_version 1509042 (0.0007) [2023-12-26 11:38:39,050][123090] Updated weights for policy 1, policy_version 1499014 (0.0008) [2023-12-26 11:38:39,074][123091] Updated weights for policy 0, policy_version 1509052 (0.0009) [2023-12-26 11:38:39,119][123090] Updated weights for policy 1, policy_version 1499024 (0.0007) [2023-12-26 11:38:39,136][123091] Updated weights for policy 0, policy_version 1509062 (0.0008) [2023-12-26 11:38:39,185][123090] Updated weights for policy 1, policy_version 1499034 (0.0009) [2023-12-26 11:38:39,186][123091] Updated weights for policy 0, policy_version 1509072 (0.0007) [2023-12-26 11:38:40,006][123090] Updated weights for policy 1, policy_version 1499044 (0.0010) [2023-12-26 11:38:40,064][123090] Updated weights for policy 1, policy_version 1499054 (0.0010) [2023-12-26 11:38:40,103][123091] Updated weights for policy 0, policy_version 1509082 (0.0008) [2023-12-26 11:38:40,122][123090] Updated weights for policy 1, policy_version 1499064 (0.0007) [2023-12-26 11:38:40,164][123091] Updated weights for policy 0, policy_version 1509092 (0.0009) [2023-12-26 11:38:40,236][123091] Updated weights for policy 0, policy_version 1509102 (0.0006) [2023-12-26 11:38:40,893][123091] Updated weights for policy 0, policy_version 1509112 (0.0010) [2023-12-26 11:38:40,959][123091] Updated weights for policy 0, policy_version 1509122 (0.0011) [2023-12-26 11:38:40,986][123090] Updated weights for policy 1, policy_version 1499074 (0.0007) [2023-12-26 11:38:41,028][123091] Updated weights for policy 0, policy_version 1509132 (0.0010) [2023-12-26 11:38:41,062][123090] Updated weights for policy 1, policy_version 1499084 (0.0006) [2023-12-26 11:38:41,129][123090] Updated weights for policy 1, policy_version 1499094 (0.0007) [2023-12-26 11:38:41,205][123090] Updated weights for policy 1, policy_version 1499104 (0.0006) [2023-12-26 11:38:41,898][123091] Updated weights for policy 0, policy_version 1509142 (0.0010) [2023-12-26 11:38:41,904][123090] Updated weights for policy 1, policy_version 1499114 (0.0006) [2023-12-26 11:38:41,961][123091] Updated weights for policy 0, policy_version 1509152 (0.0007) [2023-12-26 11:38:41,963][123090] Updated weights for policy 1, policy_version 1499124 (0.0007) [2023-12-26 11:38:42,024][123091] Updated weights for policy 0, policy_version 1509162 (0.0007) [2023-12-26 11:38:42,036][123090] Updated weights for policy 1, policy_version 1499134 (0.0009) [2023-12-26 11:38:42,799][123090] Updated weights for policy 1, policy_version 1499144 (0.0007) [2023-12-26 11:38:42,859][123090] Updated weights for policy 1, policy_version 1499154 (0.0010) [2023-12-26 11:38:42,866][123091] Updated weights for policy 0, policy_version 1509172 (0.0007) [2023-12-26 11:38:42,922][123090] Updated weights for policy 1, policy_version 1499164 (0.0010) [2023-12-26 11:38:42,927][123091] Updated weights for policy 0, policy_version 1509182 (0.0009) [2023-12-26 11:38:42,987][123091] Updated weights for policy 0, policy_version 1509192 (0.0007) [2023-12-26 11:38:43,691][123090] Updated weights for policy 1, policy_version 1499174 (0.0009) [2023-12-26 11:38:43,745][123090] Updated weights for policy 1, policy_version 1499184 (0.0008) [2023-12-26 11:38:43,746][123091] Updated weights for policy 0, policy_version 1509202 (0.0006) [2023-12-26 11:38:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 770146304. Throughput: 0: 8884.0, 1: 8785.1. Samples: 770147108. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:43,785][121949] Avg episode reward: [(0, '6346.875'), (1, '5296.711')] [2023-12-26 11:38:43,802][123090] Updated weights for policy 1, policy_version 1499194 (0.0006) [2023-12-26 11:38:43,804][123091] Updated weights for policy 0, policy_version 1509212 (0.0009) [2023-12-26 11:38:43,870][123091] Updated weights for policy 0, policy_version 1509222 (0.0010) [2023-12-26 11:38:43,931][123091] Updated weights for policy 0, policy_version 1509232 (0.0010) [2023-12-26 11:38:44,607][123090] Updated weights for policy 1, policy_version 1499204 (0.0008) [2023-12-26 11:38:44,661][123090] Updated weights for policy 1, policy_version 1499214 (0.0008) [2023-12-26 11:38:44,724][123090] Updated weights for policy 1, policy_version 1499224 (0.0008) [2023-12-26 11:38:44,732][123091] Updated weights for policy 0, policy_version 1509242 (0.0006) [2023-12-26 11:38:44,789][123091] Updated weights for policy 0, policy_version 1509252 (0.0008) [2023-12-26 11:38:44,852][123091] Updated weights for policy 0, policy_version 1509262 (0.0010) [2023-12-26 11:38:45,546][123090] Updated weights for policy 1, policy_version 1499234 (0.0007) [2023-12-26 11:38:45,611][123090] Updated weights for policy 1, policy_version 1499244 (0.0006) [2023-12-26 11:38:45,646][123091] Updated weights for policy 0, policy_version 1509272 (0.0006) [2023-12-26 11:38:45,661][123090] Updated weights for policy 1, policy_version 1499254 (0.0005) [2023-12-26 11:38:45,708][123091] Updated weights for policy 0, policy_version 1509282 (0.0006) [2023-12-26 11:38:45,725][123090] Updated weights for policy 1, policy_version 1499264 (0.0006) [2023-12-26 11:38:45,765][123091] Updated weights for policy 0, policy_version 1509292 (0.0008) [2023-12-26 11:38:46,367][123090] Updated weights for policy 1, policy_version 1499274 (0.0009) [2023-12-26 11:38:46,428][123090] Updated weights for policy 1, policy_version 1499284 (0.0009) [2023-12-26 11:38:46,499][123090] Updated weights for policy 1, policy_version 1499294 (0.0006) [2023-12-26 11:38:46,535][123091] Updated weights for policy 0, policy_version 1509302 (0.0010) [2023-12-26 11:38:46,589][123091] Updated weights for policy 0, policy_version 1509312 (0.0010) [2023-12-26 11:38:46,647][123091] Updated weights for policy 0, policy_version 1509322 (0.0010) [2023-12-26 11:38:47,194][123090] Updated weights for policy 1, policy_version 1499304 (0.0008) [2023-12-26 11:38:47,258][123090] Updated weights for policy 1, policy_version 1499314 (0.0009) [2023-12-26 11:38:47,315][123090] Updated weights for policy 1, policy_version 1499324 (0.0009) [2023-12-26 11:38:47,565][123091] Updated weights for policy 0, policy_version 1509332 (0.0010) [2023-12-26 11:38:47,618][123091] Updated weights for policy 0, policy_version 1509342 (0.0009) [2023-12-26 11:38:47,672][123091] Updated weights for policy 0, policy_version 1509352 (0.0009) [2023-12-26 11:38:48,144][123090] Updated weights for policy 1, policy_version 1499334 (0.0010) [2023-12-26 11:38:48,210][123090] Updated weights for policy 1, policy_version 1499344 (0.0010) [2023-12-26 11:38:48,269][123090] Updated weights for policy 1, policy_version 1499354 (0.0010) [2023-12-26 11:38:48,411][123091] Updated weights for policy 0, policy_version 1509362 (0.0010) [2023-12-26 11:38:48,480][123091] Updated weights for policy 0, policy_version 1509372 (0.0008) [2023-12-26 11:38:48,537][123091] Updated weights for policy 0, policy_version 1509382 (0.0009) [2023-12-26 11:38:48,605][123091] Updated weights for policy 0, policy_version 1509392 (0.0009) [2023-12-26 11:38:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 770244608. Throughput: 0: 8879.3, 1: 8884.6. Samples: 770255292. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:48,785][121949] Avg episode reward: [(0, '6408.215'), (1, '5353.181')] [2023-12-26 11:38:49,078][123090] Updated weights for policy 1, policy_version 1499364 (0.0009) [2023-12-26 11:38:49,133][123090] Updated weights for policy 1, policy_version 1499374 (0.0010) [2023-12-26 11:38:49,184][123090] Updated weights for policy 1, policy_version 1499384 (0.0010) [2023-12-26 11:38:49,438][123091] Updated weights for policy 0, policy_version 1509402 (0.0010) [2023-12-26 11:38:49,494][123091] Updated weights for policy 0, policy_version 1509412 (0.0009) [2023-12-26 11:38:49,555][123091] Updated weights for policy 0, policy_version 1509422 (0.0010) [2023-12-26 11:38:49,986][123090] Updated weights for policy 1, policy_version 1499394 (0.0009) [2023-12-26 11:38:50,052][123090] Updated weights for policy 1, policy_version 1499404 (0.0009) [2023-12-26 11:38:50,121][123090] Updated weights for policy 1, policy_version 1499414 (0.0009) [2023-12-26 11:38:50,189][123090] Updated weights for policy 1, policy_version 1499424 (0.0008) [2023-12-26 11:38:50,398][123091] Updated weights for policy 0, policy_version 1509432 (0.0010) [2023-12-26 11:38:50,457][123091] Updated weights for policy 0, policy_version 1509442 (0.0010) [2023-12-26 11:38:50,516][123091] Updated weights for policy 0, policy_version 1509452 (0.0009) [2023-12-26 11:38:50,951][123090] Updated weights for policy 1, policy_version 1499434 (0.0008) [2023-12-26 11:38:51,021][123090] Updated weights for policy 1, policy_version 1499444 (0.0006) [2023-12-26 11:38:51,095][123090] Updated weights for policy 1, policy_version 1499454 (0.0008) [2023-12-26 11:38:51,405][123091] Updated weights for policy 0, policy_version 1509462 (0.0009) [2023-12-26 11:38:51,461][123091] Updated weights for policy 0, policy_version 1509472 (0.0007) [2023-12-26 11:38:51,517][123091] Updated weights for policy 0, policy_version 1509483 (0.0009) [2023-12-26 11:38:51,935][123090] Updated weights for policy 1, policy_version 1499464 (0.0010) [2023-12-26 11:38:52,008][123090] Updated weights for policy 1, policy_version 1499474 (0.0009) [2023-12-26 11:38:52,066][123090] Updated weights for policy 1, policy_version 1499484 (0.0009) [2023-12-26 11:38:52,283][123091] Updated weights for policy 0, policy_version 1509493 (0.0008) [2023-12-26 11:38:52,357][123091] Updated weights for policy 0, policy_version 1509503 (0.0006) [2023-12-26 11:38:52,423][123091] Updated weights for policy 0, policy_version 1509513 (0.0009) [2023-12-26 11:38:52,911][123090] Updated weights for policy 1, policy_version 1499494 (0.0008) [2023-12-26 11:38:52,963][123090] Updated weights for policy 1, policy_version 1499504 (0.0005) [2023-12-26 11:38:53,034][123090] Updated weights for policy 1, policy_version 1499514 (0.0005) [2023-12-26 11:38:53,187][123091] Updated weights for policy 0, policy_version 1509523 (0.0009) [2023-12-26 11:38:53,235][123091] Updated weights for policy 0, policy_version 1509533 (0.0005) [2023-12-26 11:38:53,289][123091] Updated weights for policy 0, policy_version 1509544 (0.0007) [2023-12-26 11:38:53,720][123090] Updated weights for policy 1, policy_version 1499524 (0.0006) [2023-12-26 11:38:53,777][123090] Updated weights for policy 1, policy_version 1499534 (0.0005) [2023-12-26 11:38:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 770326528. Throughput: 0: 8808.7, 1: 8817.1. Samples: 770306344. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:53,785][121949] Avg episode reward: [(0, '6362.091'), (1, '4806.159')] [2023-12-26 11:38:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001509552_386449408.pth... [2023-12-26 11:38:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001508528_386187264.pth [2023-12-26 11:38:53,832][123090] Updated weights for policy 1, policy_version 1499544 (0.0005) [2023-12-26 11:38:53,868][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001499552_383885312.pth... [2023-12-26 11:38:53,871][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001498496_383614976.pth [2023-12-26 11:38:54,028][123091] Updated weights for policy 0, policy_version 1509554 (0.0009) [2023-12-26 11:38:54,095][123091] Updated weights for policy 0, policy_version 1509564 (0.0011) [2023-12-26 11:38:54,151][123091] Updated weights for policy 0, policy_version 1509574 (0.0010) [2023-12-26 11:38:54,217][123091] Updated weights for policy 0, policy_version 1509584 (0.0011) [2023-12-26 11:38:54,627][123090] Updated weights for policy 1, policy_version 1499554 (0.0006) [2023-12-26 11:38:54,685][123090] Updated weights for policy 1, policy_version 1499564 (0.0009) [2023-12-26 11:38:54,739][123090] Updated weights for policy 1, policy_version 1499574 (0.0009) [2023-12-26 11:38:54,793][123090] Updated weights for policy 1, policy_version 1499584 (0.0009) [2023-12-26 11:38:54,892][123091] Updated weights for policy 0, policy_version 1509594 (0.0005) [2023-12-26 11:38:54,954][123091] Updated weights for policy 0, policy_version 1509604 (0.0006) [2023-12-26 11:38:55,025][123091] Updated weights for policy 0, policy_version 1509614 (0.0008) [2023-12-26 11:38:55,643][123090] Updated weights for policy 1, policy_version 1499594 (0.0007) [2023-12-26 11:38:55,720][123090] Updated weights for policy 1, policy_version 1499604 (0.0005) [2023-12-26 11:38:55,792][123090] Updated weights for policy 1, policy_version 1499614 (0.0006) [2023-12-26 11:38:55,801][123091] Updated weights for policy 0, policy_version 1509624 (0.0009) [2023-12-26 11:38:55,853][123091] Updated weights for policy 0, policy_version 1509634 (0.0010) [2023-12-26 11:38:55,905][123091] Updated weights for policy 0, policy_version 1509644 (0.0009) [2023-12-26 11:38:56,415][123090] Updated weights for policy 1, policy_version 1499624 (0.0009) [2023-12-26 11:38:56,466][123090] Updated weights for policy 1, policy_version 1499634 (0.0010) [2023-12-26 11:38:56,513][123090] Updated weights for policy 1, policy_version 1499644 (0.0010) [2023-12-26 11:38:56,651][123091] Updated weights for policy 0, policy_version 1509654 (0.0010) [2023-12-26 11:38:56,719][123091] Updated weights for policy 0, policy_version 1509664 (0.0009) [2023-12-26 11:38:56,783][123091] Updated weights for policy 0, policy_version 1509674 (0.0009) [2023-12-26 11:38:57,341][123090] Updated weights for policy 1, policy_version 1499654 (0.0007) [2023-12-26 11:38:57,389][123090] Updated weights for policy 1, policy_version 1499664 (0.0005) [2023-12-26 11:38:57,443][123090] Updated weights for policy 1, policy_version 1499674 (0.0005) [2023-12-26 11:38:57,554][123091] Updated weights for policy 0, policy_version 1509684 (0.0007) [2023-12-26 11:38:57,601][123091] Updated weights for policy 0, policy_version 1509694 (0.0005) [2023-12-26 11:38:57,658][123091] Updated weights for policy 0, policy_version 1509704 (0.0005) [2023-12-26 11:38:58,234][123090] Updated weights for policy 1, policy_version 1499684 (0.0007) [2023-12-26 11:38:58,296][123090] Updated weights for policy 1, policy_version 1499694 (0.0009) [2023-12-26 11:38:58,380][123090] Updated weights for policy 1, policy_version 1499704 (0.0010) [2023-12-26 11:38:58,418][123091] Updated weights for policy 0, policy_version 1509714 (0.0008) [2023-12-26 11:38:58,497][123091] Updated weights for policy 0, policy_version 1509725 (0.0008) [2023-12-26 11:38:58,572][123091] Updated weights for policy 0, policy_version 1509735 (0.0010) [2023-12-26 11:38:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 770424832. Throughput: 0: 8879.2, 1: 8877.4. Samples: 770415904. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:38:58,785][121949] Avg episode reward: [(0, '6304.470'), (1, '4591.917')] [2023-12-26 11:38:59,360][123090] Updated weights for policy 1, policy_version 1499714 (0.0009) [2023-12-26 11:38:59,421][123090] Updated weights for policy 1, policy_version 1499724 (0.0008) [2023-12-26 11:38:59,441][123091] Updated weights for policy 0, policy_version 1509745 (0.0008) [2023-12-26 11:38:59,480][123090] Updated weights for policy 1, policy_version 1499734 (0.0008) [2023-12-26 11:38:59,501][123091] Updated weights for policy 0, policy_version 1509755 (0.0009) [2023-12-26 11:38:59,547][123090] Updated weights for policy 1, policy_version 1499744 (0.0008) [2023-12-26 11:38:59,566][123091] Updated weights for policy 0, policy_version 1509765 (0.0010) [2023-12-26 11:38:59,625][123091] Updated weights for policy 0, policy_version 1509775 (0.0009) [2023-12-26 11:39:00,353][123090] Updated weights for policy 1, policy_version 1499754 (0.0005) [2023-12-26 11:39:00,401][123090] Updated weights for policy 1, policy_version 1499764 (0.0005) [2023-12-26 11:39:00,449][123091] Updated weights for policy 0, policy_version 1509785 (0.0006) [2023-12-26 11:39:00,462][123090] Updated weights for policy 1, policy_version 1499774 (0.0005) [2023-12-26 11:39:00,500][123091] Updated weights for policy 0, policy_version 1509795 (0.0005) [2023-12-26 11:39:00,554][123091] Updated weights for policy 0, policy_version 1509805 (0.0005) [2023-12-26 11:39:01,116][123090] Updated weights for policy 1, policy_version 1499784 (0.0006) [2023-12-26 11:39:01,189][123090] Updated weights for policy 1, policy_version 1499794 (0.0008) [2023-12-26 11:39:01,193][123091] Updated weights for policy 0, policy_version 1509815 (0.0007) [2023-12-26 11:39:01,248][123090] Updated weights for policy 1, policy_version 1499804 (0.0009) [2023-12-26 11:39:01,252][123091] Updated weights for policy 0, policy_version 1509825 (0.0006) [2023-12-26 11:39:01,317][123091] Updated weights for policy 0, policy_version 1509835 (0.0006) [2023-12-26 11:39:01,995][123090] Updated weights for policy 1, policy_version 1499814 (0.0009) [2023-12-26 11:39:02,054][123090] Updated weights for policy 1, policy_version 1499824 (0.0010) [2023-12-26 11:39:02,096][123091] Updated weights for policy 0, policy_version 1509845 (0.0007) [2023-12-26 11:39:02,112][123090] Updated weights for policy 1, policy_version 1499834 (0.0009) [2023-12-26 11:39:02,145][123091] Updated weights for policy 0, policy_version 1509855 (0.0008) [2023-12-26 11:39:02,197][123091] Updated weights for policy 0, policy_version 1509865 (0.0009) [2023-12-26 11:39:02,797][123090] Updated weights for policy 1, policy_version 1499844 (0.0006) [2023-12-26 11:39:02,858][123090] Updated weights for policy 1, policy_version 1499854 (0.0005) [2023-12-26 11:39:02,910][123090] Updated weights for policy 1, policy_version 1499864 (0.0005) [2023-12-26 11:39:03,019][123091] Updated weights for policy 0, policy_version 1509875 (0.0009) [2023-12-26 11:39:03,067][123091] Updated weights for policy 0, policy_version 1509885 (0.0009) [2023-12-26 11:39:03,122][123091] Updated weights for policy 0, policy_version 1509895 (0.0009) [2023-12-26 11:39:03,675][123090] Updated weights for policy 1, policy_version 1499874 (0.0006) [2023-12-26 11:39:03,737][123090] Updated weights for policy 1, policy_version 1499884 (0.0010) [2023-12-26 11:39:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 770506752. Throughput: 0: 8913.2, 1: 8910.6. Samples: 770523420. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:03,784][121949] Avg episode reward: [(0, '6239.777'), (1, '4788.453')] [2023-12-26 11:39:03,800][123090] Updated weights for policy 1, policy_version 1499894 (0.0010) [2023-12-26 11:39:03,863][123090] Updated weights for policy 1, policy_version 1499904 (0.0010) [2023-12-26 11:39:03,948][123091] Updated weights for policy 0, policy_version 1509905 (0.0008) [2023-12-26 11:39:04,020][123091] Updated weights for policy 0, policy_version 1509915 (0.0006) [2023-12-26 11:39:04,085][123091] Updated weights for policy 0, policy_version 1509925 (0.0006) [2023-12-26 11:39:04,155][123091] Updated weights for policy 0, policy_version 1509935 (0.0006) [2023-12-26 11:39:04,670][123090] Updated weights for policy 1, policy_version 1499914 (0.0009) [2023-12-26 11:39:04,738][123090] Updated weights for policy 1, policy_version 1499924 (0.0009) [2023-12-26 11:39:04,796][123090] Updated weights for policy 1, policy_version 1499934 (0.0010) [2023-12-26 11:39:04,870][123091] Updated weights for policy 0, policy_version 1509945 (0.0009) [2023-12-26 11:39:04,923][123091] Updated weights for policy 0, policy_version 1509955 (0.0009) [2023-12-26 11:39:04,971][123091] Updated weights for policy 0, policy_version 1509965 (0.0006) [2023-12-26 11:39:05,671][123090] Updated weights for policy 1, policy_version 1499944 (0.0006) [2023-12-26 11:39:05,695][123091] Updated weights for policy 0, policy_version 1509975 (0.0005) [2023-12-26 11:39:05,745][123090] Updated weights for policy 1, policy_version 1499954 (0.0005) [2023-12-26 11:39:05,755][123091] Updated weights for policy 0, policy_version 1509985 (0.0005) [2023-12-26 11:39:05,817][123091] Updated weights for policy 0, policy_version 1509995 (0.0005) [2023-12-26 11:39:05,821][123090] Updated weights for policy 1, policy_version 1499964 (0.0007) [2023-12-26 11:39:06,602][123091] Updated weights for policy 0, policy_version 1510005 (0.0008) [2023-12-26 11:39:06,608][123090] Updated weights for policy 1, policy_version 1499974 (0.0009) [2023-12-26 11:39:06,660][123091] Updated weights for policy 0, policy_version 1510015 (0.0007) [2023-12-26 11:39:06,662][123090] Updated weights for policy 1, policy_version 1499984 (0.0009) [2023-12-26 11:39:06,709][123091] Updated weights for policy 0, policy_version 1510025 (0.0006) [2023-12-26 11:39:06,722][123090] Updated weights for policy 1, policy_version 1499994 (0.0009) [2023-12-26 11:39:07,378][123091] Updated weights for policy 0, policy_version 1510035 (0.0007) [2023-12-26 11:39:07,437][123091] Updated weights for policy 0, policy_version 1510046 (0.0010) [2023-12-26 11:39:07,485][123091] Updated weights for policy 0, policy_version 1510056 (0.0009) [2023-12-26 11:39:07,610][123090] Updated weights for policy 1, policy_version 1500004 (0.0009) [2023-12-26 11:39:07,662][123090] Updated weights for policy 1, policy_version 1500014 (0.0010) [2023-12-26 11:39:07,720][123090] Updated weights for policy 1, policy_version 1500025 (0.0009) [2023-12-26 11:39:08,181][123091] Updated weights for policy 0, policy_version 1510066 (0.0006) [2023-12-26 11:39:08,239][123091] Updated weights for policy 0, policy_version 1510076 (0.0007) [2023-12-26 11:39:08,291][123091] Updated weights for policy 0, policy_version 1510086 (0.0010) [2023-12-26 11:39:08,625][123090] Updated weights for policy 1, policy_version 1500035 (0.0008) [2023-12-26 11:39:08,696][123090] Updated weights for policy 1, policy_version 1500045 (0.0005) [2023-12-26 11:39:08,773][123090] Updated weights for policy 1, policy_version 1500055 (0.0005) [2023-12-26 11:39:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 770596864. Throughput: 0: 8975.4, 1: 8910.4. Samples: 770576404. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:08,785][121949] Avg episode reward: [(0, '6232.042'), (1, '4945.131')] [2023-12-26 11:39:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001510096_386588672.pth... [2023-12-26 11:39:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001509040_386318336.pth [2023-12-26 11:39:08,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001500064_384016384.pth... [2023-12-26 11:39:08,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001499008_383746048.pth [2023-12-26 11:39:09,123][123091] Updated weights for policy 0, policy_version 1510097 (0.0009) [2023-12-26 11:39:09,190][123091] Updated weights for policy 0, policy_version 1510107 (0.0005) [2023-12-26 11:39:09,263][123091] Updated weights for policy 0, policy_version 1510117 (0.0008) [2023-12-26 11:39:09,324][123091] Updated weights for policy 0, policy_version 1510127 (0.0009) [2023-12-26 11:39:09,513][123090] Updated weights for policy 1, policy_version 1500065 (0.0005) [2023-12-26 11:39:09,571][123090] Updated weights for policy 1, policy_version 1500075 (0.0009) [2023-12-26 11:39:09,634][123090] Updated weights for policy 1, policy_version 1500085 (0.0010) [2023-12-26 11:39:09,689][123090] Updated weights for policy 1, policy_version 1500095 (0.0009) [2023-12-26 11:39:10,100][123091] Updated weights for policy 0, policy_version 1510137 (0.0008) [2023-12-26 11:39:10,160][123091] Updated weights for policy 0, policy_version 1510147 (0.0009) [2023-12-26 11:39:10,224][123091] Updated weights for policy 0, policy_version 1510157 (0.0009) [2023-12-26 11:39:10,578][123090] Updated weights for policy 1, policy_version 1500105 (0.0011) [2023-12-26 11:39:10,643][123090] Updated weights for policy 1, policy_version 1500115 (0.0011) [2023-12-26 11:39:10,714][123090] Updated weights for policy 1, policy_version 1500125 (0.0008) [2023-12-26 11:39:11,088][123091] Updated weights for policy 0, policy_version 1510167 (0.0009) [2023-12-26 11:39:11,162][123091] Updated weights for policy 0, policy_version 1510177 (0.0011) [2023-12-26 11:39:11,225][123091] Updated weights for policy 0, policy_version 1510187 (0.0010) [2023-12-26 11:39:11,499][123090] Updated weights for policy 1, policy_version 1500135 (0.0009) [2023-12-26 11:39:11,563][123090] Updated weights for policy 1, policy_version 1500145 (0.0010) [2023-12-26 11:39:11,631][123090] Updated weights for policy 1, policy_version 1500155 (0.0010) [2023-12-26 11:39:12,045][123091] Updated weights for policy 0, policy_version 1510197 (0.0008) [2023-12-26 11:39:12,107][123091] Updated weights for policy 0, policy_version 1510207 (0.0009) [2023-12-26 11:39:12,166][123091] Updated weights for policy 0, policy_version 1510217 (0.0010) [2023-12-26 11:39:12,416][123090] Updated weights for policy 1, policy_version 1500165 (0.0007) [2023-12-26 11:39:12,481][123090] Updated weights for policy 1, policy_version 1500175 (0.0007) [2023-12-26 11:39:12,538][123090] Updated weights for policy 1, policy_version 1500185 (0.0007) [2023-12-26 11:39:12,992][123091] Updated weights for policy 0, policy_version 1510227 (0.0008) [2023-12-26 11:39:13,051][123091] Updated weights for policy 0, policy_version 1510237 (0.0006) [2023-12-26 11:39:13,103][123091] Updated weights for policy 0, policy_version 1510248 (0.0010) [2023-12-26 11:39:13,299][123090] Updated weights for policy 1, policy_version 1500195 (0.0005) [2023-12-26 11:39:13,357][123090] Updated weights for policy 1, policy_version 1500205 (0.0007) [2023-12-26 11:39:13,412][123090] Updated weights for policy 1, policy_version 1500215 (0.0009) [2023-12-26 11:39:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 770686976. Throughput: 0: 8973.2, 1: 8833.2. Samples: 770680264. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:13,784][121949] Avg episode reward: [(0, '6184.041'), (1, '4726.181')] [2023-12-26 11:39:13,915][123091] Updated weights for policy 0, policy_version 1510259 (0.0010) [2023-12-26 11:39:13,985][123091] Updated weights for policy 0, policy_version 1510269 (0.0010) [2023-12-26 11:39:14,055][123091] Updated weights for policy 0, policy_version 1510279 (0.0009) [2023-12-26 11:39:14,190][123090] Updated weights for policy 1, policy_version 1500225 (0.0009) [2023-12-26 11:39:14,244][123090] Updated weights for policy 1, policy_version 1500235 (0.0009) [2023-12-26 11:39:14,301][123090] Updated weights for policy 1, policy_version 1500245 (0.0009) [2023-12-26 11:39:14,355][123090] Updated weights for policy 1, policy_version 1500256 (0.0010) [2023-12-26 11:39:14,790][123091] Updated weights for policy 0, policy_version 1510289 (0.0009) [2023-12-26 11:39:14,852][123091] Updated weights for policy 0, policy_version 1510299 (0.0008) [2023-12-26 11:39:14,913][123091] Updated weights for policy 0, policy_version 1510309 (0.0009) [2023-12-26 11:39:14,982][123091] Updated weights for policy 0, policy_version 1510319 (0.0010) [2023-12-26 11:39:15,109][123090] Updated weights for policy 1, policy_version 1500266 (0.0010) [2023-12-26 11:39:15,175][123090] Updated weights for policy 1, policy_version 1500276 (0.0009) [2023-12-26 11:39:15,240][123090] Updated weights for policy 1, policy_version 1500286 (0.0008) [2023-12-26 11:39:15,855][123091] Updated weights for policy 0, policy_version 1510329 (0.0010) [2023-12-26 11:39:15,908][123091] Updated weights for policy 0, policy_version 1510339 (0.0010) [2023-12-26 11:39:15,964][123091] Updated weights for policy 0, policy_version 1510350 (0.0010) [2023-12-26 11:39:15,987][123090] Updated weights for policy 1, policy_version 1500296 (0.0005) [2023-12-26 11:39:16,044][123090] Updated weights for policy 1, policy_version 1500306 (0.0005) [2023-12-26 11:39:16,105][123090] Updated weights for policy 1, policy_version 1500316 (0.0005) [2023-12-26 11:39:16,825][123090] Updated weights for policy 1, policy_version 1500326 (0.0008) [2023-12-26 11:39:16,881][123091] Updated weights for policy 0, policy_version 1510360 (0.0008) [2023-12-26 11:39:16,887][123090] Updated weights for policy 1, policy_version 1500336 (0.0009) [2023-12-26 11:39:16,944][123091] Updated weights for policy 0, policy_version 1510370 (0.0010) [2023-12-26 11:39:16,952][123090] Updated weights for policy 1, policy_version 1500346 (0.0009) [2023-12-26 11:39:17,004][123091] Updated weights for policy 0, policy_version 1510380 (0.0009) [2023-12-26 11:39:17,700][123090] Updated weights for policy 1, policy_version 1500356 (0.0010) [2023-12-26 11:39:17,754][123090] Updated weights for policy 1, policy_version 1500366 (0.0009) [2023-12-26 11:39:17,812][123090] Updated weights for policy 1, policy_version 1500376 (0.0010) [2023-12-26 11:39:17,832][123091] Updated weights for policy 0, policy_version 1510390 (0.0008) [2023-12-26 11:39:17,890][123091] Updated weights for policy 0, policy_version 1510400 (0.0009) [2023-12-26 11:39:17,945][123091] Updated weights for policy 0, policy_version 1510410 (0.0009) [2023-12-26 11:39:18,641][123090] Updated weights for policy 1, policy_version 1500386 (0.0008) [2023-12-26 11:39:18,714][123090] Updated weights for policy 1, policy_version 1500396 (0.0007) [2023-12-26 11:39:18,783][123091] Updated weights for policy 0, policy_version 1510420 (0.0008) [2023-12-26 11:39:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 770768896. Throughput: 0: 8876.5, 1: 8935.7. Samples: 770787428. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:18,784][121949] Avg episode reward: [(0, '6236.226'), (1, '5102.208')] [2023-12-26 11:39:18,790][123090] Updated weights for policy 1, policy_version 1500406 (0.0005) [2023-12-26 11:39:18,855][123090] Updated weights for policy 1, policy_version 1500416 (0.0005) [2023-12-26 11:39:18,856][123091] Updated weights for policy 0, policy_version 1510430 (0.0007) [2023-12-26 11:39:18,918][123091] Updated weights for policy 0, policy_version 1510440 (0.0009) [2023-12-26 11:39:19,567][123090] Updated weights for policy 1, policy_version 1500426 (0.0009) [2023-12-26 11:39:19,630][123090] Updated weights for policy 1, policy_version 1500436 (0.0010) [2023-12-26 11:39:19,668][123091] Updated weights for policy 0, policy_version 1510450 (0.0008) [2023-12-26 11:39:19,698][123090] Updated weights for policy 1, policy_version 1500446 (0.0009) [2023-12-26 11:39:19,730][123091] Updated weights for policy 0, policy_version 1510460 (0.0005) [2023-12-26 11:39:19,806][123091] Updated weights for policy 0, policy_version 1510470 (0.0006) [2023-12-26 11:39:19,876][123091] Updated weights for policy 0, policy_version 1510480 (0.0007) [2023-12-26 11:39:20,568][123090] Updated weights for policy 1, policy_version 1500456 (0.0008) [2023-12-26 11:39:20,584][123091] Updated weights for policy 0, policy_version 1510490 (0.0011) [2023-12-26 11:39:20,632][123090] Updated weights for policy 1, policy_version 1500466 (0.0010) [2023-12-26 11:39:20,645][123091] Updated weights for policy 0, policy_version 1510500 (0.0011) [2023-12-26 11:39:20,704][123091] Updated weights for policy 0, policy_version 1510510 (0.0006) [2023-12-26 11:39:20,706][123090] Updated weights for policy 1, policy_version 1500476 (0.0010) [2023-12-26 11:39:21,538][123091] Updated weights for policy 0, policy_version 1510521 (0.0010) [2023-12-26 11:39:21,602][123091] Updated weights for policy 0, policy_version 1510531 (0.0007) [2023-12-26 11:39:21,606][123090] Updated weights for policy 1, policy_version 1500486 (0.0009) [2023-12-26 11:39:21,669][123091] Updated weights for policy 0, policy_version 1510541 (0.0009) [2023-12-26 11:39:21,673][123090] Updated weights for policy 1, policy_version 1500496 (0.0008) [2023-12-26 11:39:21,742][123090] Updated weights for policy 1, policy_version 1500506 (0.0010) [2023-12-26 11:39:22,509][123091] Updated weights for policy 0, policy_version 1510551 (0.0008) [2023-12-26 11:39:22,567][123091] Updated weights for policy 0, policy_version 1510561 (0.0008) [2023-12-26 11:39:22,568][123090] Updated weights for policy 1, policy_version 1500516 (0.0009) [2023-12-26 11:39:22,623][123091] Updated weights for policy 0, policy_version 1510571 (0.0007) [2023-12-26 11:39:22,625][123090] Updated weights for policy 1, policy_version 1500526 (0.0010) [2023-12-26 11:39:22,686][123090] Updated weights for policy 1, policy_version 1500536 (0.0009) [2023-12-26 11:39:23,395][123090] Updated weights for policy 1, policy_version 1500546 (0.0009) [2023-12-26 11:39:23,398][123091] Updated weights for policy 0, policy_version 1510581 (0.0007) [2023-12-26 11:39:23,445][123091] Updated weights for policy 0, policy_version 1510591 (0.0005) [2023-12-26 11:39:23,450][123090] Updated weights for policy 1, policy_version 1500556 (0.0010) [2023-12-26 11:39:23,499][123091] Updated weights for policy 0, policy_version 1510601 (0.0005) [2023-12-26 11:39:23,506][123090] Updated weights for policy 1, policy_version 1500566 (0.0010) [2023-12-26 11:39:23,557][123090] Updated weights for policy 1, policy_version 1500576 (0.0010) [2023-12-26 11:39:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 770867200. Throughput: 0: 8856.4, 1: 8894.9. Samples: 770839688. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:23,785][121949] Avg episode reward: [(0, '6195.040'), (1, '5130.687')] [2023-12-26 11:39:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001510608_386719744.pth... [2023-12-26 11:39:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001500576_384147456.pth... [2023-12-26 11:39:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001509552_386449408.pth [2023-12-26 11:39:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001499552_383885312.pth [2023-12-26 11:39:24,146][123091] Updated weights for policy 0, policy_version 1510611 (0.0005) [2023-12-26 11:39:24,212][123091] Updated weights for policy 0, policy_version 1510621 (0.0007) [2023-12-26 11:39:24,270][123091] Updated weights for policy 0, policy_version 1510631 (0.0010) [2023-12-26 11:39:24,332][123090] Updated weights for policy 1, policy_version 1500586 (0.0011) [2023-12-26 11:39:24,399][123090] Updated weights for policy 1, policy_version 1500596 (0.0011) [2023-12-26 11:39:24,461][123090] Updated weights for policy 1, policy_version 1500606 (0.0010) [2023-12-26 11:39:25,126][123091] Updated weights for policy 0, policy_version 1510641 (0.0007) [2023-12-26 11:39:25,185][123091] Updated weights for policy 0, policy_version 1510651 (0.0009) [2023-12-26 11:39:25,212][123090] Updated weights for policy 1, policy_version 1500616 (0.0007) [2023-12-26 11:39:25,246][123091] Updated weights for policy 0, policy_version 1510661 (0.0009) [2023-12-26 11:39:25,278][123090] Updated weights for policy 1, policy_version 1500626 (0.0005) [2023-12-26 11:39:25,299][123091] Updated weights for policy 0, policy_version 1510671 (0.0009) [2023-12-26 11:39:25,334][123090] Updated weights for policy 1, policy_version 1500636 (0.0005) [2023-12-26 11:39:26,054][123090] Updated weights for policy 1, policy_version 1500646 (0.0007) [2023-12-26 11:39:26,099][123091] Updated weights for policy 0, policy_version 1510681 (0.0006) [2023-12-26 11:39:26,109][123090] Updated weights for policy 1, policy_version 1500656 (0.0007) [2023-12-26 11:39:26,170][123091] Updated weights for policy 0, policy_version 1510691 (0.0005) [2023-12-26 11:39:26,175][123090] Updated weights for policy 1, policy_version 1500666 (0.0009) [2023-12-26 11:39:26,228][123091] Updated weights for policy 0, policy_version 1510701 (0.0005) [2023-12-26 11:39:26,943][123091] Updated weights for policy 0, policy_version 1510711 (0.0009) [2023-12-26 11:39:27,004][123091] Updated weights for policy 0, policy_version 1510721 (0.0010) [2023-12-26 11:39:27,023][123090] Updated weights for policy 1, policy_version 1500676 (0.0009) [2023-12-26 11:39:27,059][123091] Updated weights for policy 0, policy_version 1510731 (0.0010) [2023-12-26 11:39:27,069][123090] Updated weights for policy 1, policy_version 1500686 (0.0005) [2023-12-26 11:39:27,141][123090] Updated weights for policy 1, policy_version 1500696 (0.0007) [2023-12-26 11:39:27,822][123090] Updated weights for policy 1, policy_version 1500706 (0.0008) [2023-12-26 11:39:27,875][123091] Updated weights for policy 0, policy_version 1510741 (0.0010) [2023-12-26 11:39:27,885][123090] Updated weights for policy 1, policy_version 1500716 (0.0005) [2023-12-26 11:39:27,934][123091] Updated weights for policy 0, policy_version 1510751 (0.0010) [2023-12-26 11:39:27,945][123090] Updated weights for policy 1, policy_version 1500726 (0.0006) [2023-12-26 11:39:27,995][123091] Updated weights for policy 0, policy_version 1510761 (0.0010) [2023-12-26 11:39:28,006][123090] Updated weights for policy 1, policy_version 1500736 (0.0006) [2023-12-26 11:39:28,702][123090] Updated weights for policy 1, policy_version 1500746 (0.0005) [2023-12-26 11:39:28,759][123090] Updated weights for policy 1, policy_version 1500756 (0.0005) [2023-12-26 11:39:28,776][123091] Updated weights for policy 0, policy_version 1510771 (0.0010) [2023-12-26 11:39:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 770949120. Throughput: 0: 8907.3, 1: 8899.6. Samples: 770948416. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:28,785][121949] Avg episode reward: [(0, '6244.960'), (1, '4908.082')] [2023-12-26 11:39:28,821][123090] Updated weights for policy 1, policy_version 1500766 (0.0005) [2023-12-26 11:39:28,831][123091] Updated weights for policy 0, policy_version 1510781 (0.0010) [2023-12-26 11:39:28,907][123091] Updated weights for policy 0, policy_version 1510791 (0.0010) [2023-12-26 11:39:29,569][123090] Updated weights for policy 1, policy_version 1500776 (0.0006) [2023-12-26 11:39:29,637][123090] Updated weights for policy 1, policy_version 1500786 (0.0007) [2023-12-26 11:39:29,700][123090] Updated weights for policy 1, policy_version 1500796 (0.0010) [2023-12-26 11:39:29,744][123091] Updated weights for policy 0, policy_version 1510801 (0.0010) [2023-12-26 11:39:29,803][123091] Updated weights for policy 0, policy_version 1510811 (0.0011) [2023-12-26 11:39:29,873][123091] Updated weights for policy 0, policy_version 1510821 (0.0009) [2023-12-26 11:39:29,943][123091] Updated weights for policy 0, policy_version 1510831 (0.0010) [2023-12-26 11:39:30,432][123090] Updated weights for policy 1, policy_version 1500806 (0.0010) [2023-12-26 11:39:30,494][123090] Updated weights for policy 1, policy_version 1500816 (0.0010) [2023-12-26 11:39:30,555][123090] Updated weights for policy 1, policy_version 1500826 (0.0010) [2023-12-26 11:39:30,793][123091] Updated weights for policy 0, policy_version 1510841 (0.0005) [2023-12-26 11:39:30,848][123091] Updated weights for policy 0, policy_version 1510851 (0.0005) [2023-12-26 11:39:30,918][123091] Updated weights for policy 0, policy_version 1510861 (0.0005) [2023-12-26 11:39:31,362][123090] Updated weights for policy 1, policy_version 1500836 (0.0010) [2023-12-26 11:39:31,435][123090] Updated weights for policy 1, policy_version 1500846 (0.0008) [2023-12-26 11:39:31,510][123090] Updated weights for policy 1, policy_version 1500856 (0.0009) [2023-12-26 11:39:31,661][123091] Updated weights for policy 0, policy_version 1510871 (0.0007) [2023-12-26 11:39:31,727][123091] Updated weights for policy 0, policy_version 1510881 (0.0007) [2023-12-26 11:39:31,797][123091] Updated weights for policy 0, policy_version 1510891 (0.0010) [2023-12-26 11:39:32,247][123090] Updated weights for policy 1, policy_version 1500866 (0.0009) [2023-12-26 11:39:32,319][123090] Updated weights for policy 1, policy_version 1500876 (0.0010) [2023-12-26 11:39:32,388][123090] Updated weights for policy 1, policy_version 1500886 (0.0009) [2023-12-26 11:39:32,443][123090] Updated weights for policy 1, policy_version 1500896 (0.0010) [2023-12-26 11:39:32,508][123091] Updated weights for policy 0, policy_version 1510901 (0.0008) [2023-12-26 11:39:32,567][123091] Updated weights for policy 0, policy_version 1510911 (0.0008) [2023-12-26 11:39:32,626][123091] Updated weights for policy 0, policy_version 1510921 (0.0009) [2023-12-26 11:39:33,287][123090] Updated weights for policy 1, policy_version 1500906 (0.0010) [2023-12-26 11:39:33,354][123090] Updated weights for policy 1, policy_version 1500916 (0.0011) [2023-12-26 11:39:33,412][123091] Updated weights for policy 0, policy_version 1510931 (0.0008) [2023-12-26 11:39:33,415][123090] Updated weights for policy 1, policy_version 1500926 (0.0010) [2023-12-26 11:39:33,458][123091] Updated weights for policy 0, policy_version 1510941 (0.0005) [2023-12-26 11:39:33,513][123091] Updated weights for policy 0, policy_version 1510951 (0.0005) [2023-12-26 11:39:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 771047424. Throughput: 0: 8921.1, 1: 8881.3. Samples: 771056404. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:33,785][121949] Avg episode reward: [(0, '6313.946'), (1, '4927.129')] [2023-12-26 11:39:34,075][123090] Updated weights for policy 1, policy_version 1500936 (0.0005) [2023-12-26 11:39:34,121][123090] Updated weights for policy 1, policy_version 1500946 (0.0005) [2023-12-26 11:39:34,147][123091] Updated weights for policy 0, policy_version 1510961 (0.0006) [2023-12-26 11:39:34,181][123090] Updated weights for policy 1, policy_version 1500956 (0.0009) [2023-12-26 11:39:34,210][123091] Updated weights for policy 0, policy_version 1510971 (0.0010) [2023-12-26 11:39:34,286][123091] Updated weights for policy 0, policy_version 1510981 (0.0007) [2023-12-26 11:39:34,353][123091] Updated weights for policy 0, policy_version 1510991 (0.0008) [2023-12-26 11:39:34,920][123090] Updated weights for policy 1, policy_version 1500966 (0.0006) [2023-12-26 11:39:34,975][123090] Updated weights for policy 1, policy_version 1500976 (0.0005) [2023-12-26 11:39:35,029][123090] Updated weights for policy 1, policy_version 1500986 (0.0006) [2023-12-26 11:39:35,062][123091] Updated weights for policy 0, policy_version 1511001 (0.0008) [2023-12-26 11:39:35,110][123091] Updated weights for policy 0, policy_version 1511011 (0.0009) [2023-12-26 11:39:35,167][123091] Updated weights for policy 0, policy_version 1511021 (0.0009) [2023-12-26 11:39:35,829][123090] Updated weights for policy 1, policy_version 1500996 (0.0007) [2023-12-26 11:39:35,885][123090] Updated weights for policy 1, policy_version 1501006 (0.0006) [2023-12-26 11:39:35,937][123090] Updated weights for policy 1, policy_version 1501016 (0.0005) [2023-12-26 11:39:36,044][123091] Updated weights for policy 0, policy_version 1511031 (0.0010) [2023-12-26 11:39:36,104][123091] Updated weights for policy 0, policy_version 1511041 (0.0008) [2023-12-26 11:39:36,163][123091] Updated weights for policy 0, policy_version 1511051 (0.0008) [2023-12-26 11:39:36,799][123090] Updated weights for policy 1, policy_version 1501026 (0.0006) [2023-12-26 11:39:36,868][123090] Updated weights for policy 1, policy_version 1501036 (0.0010) [2023-12-26 11:39:36,932][123090] Updated weights for policy 1, policy_version 1501046 (0.0009) [2023-12-26 11:39:36,939][123091] Updated weights for policy 0, policy_version 1511061 (0.0007) [2023-12-26 11:39:36,995][123090] Updated weights for policy 1, policy_version 1501056 (0.0011) [2023-12-26 11:39:37,008][123091] Updated weights for policy 0, policy_version 1511071 (0.0006) [2023-12-26 11:39:37,077][123091] Updated weights for policy 0, policy_version 1511081 (0.0006) [2023-12-26 11:39:37,812][123091] Updated weights for policy 0, policy_version 1511091 (0.0007) [2023-12-26 11:39:37,867][123091] Updated weights for policy 0, policy_version 1511101 (0.0009) [2023-12-26 11:39:37,881][123090] Updated weights for policy 1, policy_version 1501066 (0.0011) [2023-12-26 11:39:37,924][123091] Updated weights for policy 0, policy_version 1511111 (0.0006) [2023-12-26 11:39:37,942][123090] Updated weights for policy 1, policy_version 1501076 (0.0011) [2023-12-26 11:39:38,011][123090] Updated weights for policy 1, policy_version 1501086 (0.0011) [2023-12-26 11:39:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 771129344. Throughput: 0: 8986.4, 1: 8931.0. Samples: 771112628. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:38,785][121949] Avg episode reward: [(0, '6269.458'), (1, '5138.923')] [2023-12-26 11:39:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001501088_384278528.pth... [2023-12-26 11:39:38,792][123091] Updated weights for policy 0, policy_version 1511121 (0.0007) [2023-12-26 11:39:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001500064_384016384.pth [2023-12-26 11:39:38,847][123091] Updated weights for policy 0, policy_version 1511131 (0.0008) [2023-12-26 11:39:38,873][123090] Updated weights for policy 1, policy_version 1501096 (0.0010) [2023-12-26 11:39:38,897][123091] Updated weights for policy 0, policy_version 1511141 (0.0009) [2023-12-26 11:39:38,936][123090] Updated weights for policy 1, policy_version 1501106 (0.0011) [2023-12-26 11:39:38,952][123091] Updated weights for policy 0, policy_version 1511151 (0.0008) [2023-12-26 11:39:38,954][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001511152_386859008.pth... [2023-12-26 11:39:38,957][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001510096_386588672.pth [2023-12-26 11:39:38,994][123090] Updated weights for policy 1, policy_version 1501116 (0.0010) [2023-12-26 11:39:39,718][123091] Updated weights for policy 0, policy_version 1511161 (0.0005) [2023-12-26 11:39:39,787][123091] Updated weights for policy 0, policy_version 1511171 (0.0006) [2023-12-26 11:39:39,835][123090] Updated weights for policy 1, policy_version 1501126 (0.0009) [2023-12-26 11:39:39,856][123091] Updated weights for policy 0, policy_version 1511181 (0.0008) [2023-12-26 11:39:39,906][123090] Updated weights for policy 1, policy_version 1501136 (0.0009) [2023-12-26 11:39:39,980][123090] Updated weights for policy 1, policy_version 1501146 (0.0010) [2023-12-26 11:39:40,630][123091] Updated weights for policy 0, policy_version 1511191 (0.0007) [2023-12-26 11:39:40,695][123091] Updated weights for policy 0, policy_version 1511201 (0.0005) [2023-12-26 11:39:40,750][123091] Updated weights for policy 0, policy_version 1511211 (0.0005) [2023-12-26 11:39:40,830][123090] Updated weights for policy 1, policy_version 1501156 (0.0010) [2023-12-26 11:39:40,881][123090] Updated weights for policy 1, policy_version 1501166 (0.0009) [2023-12-26 11:39:40,946][123090] Updated weights for policy 1, policy_version 1501176 (0.0009) [2023-12-26 11:39:41,527][123091] Updated weights for policy 0, policy_version 1511221 (0.0008) [2023-12-26 11:39:41,591][123091] Updated weights for policy 0, policy_version 1511231 (0.0010) [2023-12-26 11:39:41,660][123091] Updated weights for policy 0, policy_version 1511241 (0.0009) [2023-12-26 11:39:41,812][123090] Updated weights for policy 1, policy_version 1501186 (0.0009) [2023-12-26 11:39:41,863][123090] Updated weights for policy 1, policy_version 1501196 (0.0010) [2023-12-26 11:39:41,926][123090] Updated weights for policy 1, policy_version 1501206 (0.0009) [2023-12-26 11:39:41,984][123090] Updated weights for policy 1, policy_version 1501216 (0.0009) [2023-12-26 11:39:42,514][123091] Updated weights for policy 0, policy_version 1511251 (0.0010) [2023-12-26 11:39:42,576][123091] Updated weights for policy 0, policy_version 1511261 (0.0010) [2023-12-26 11:39:42,641][123091] Updated weights for policy 0, policy_version 1511271 (0.0009) [2023-12-26 11:39:42,885][123090] Updated weights for policy 1, policy_version 1501226 (0.0005) [2023-12-26 11:39:42,951][123090] Updated weights for policy 1, policy_version 1501236 (0.0005) [2023-12-26 11:39:43,011][123090] Updated weights for policy 1, policy_version 1501246 (0.0007) [2023-12-26 11:39:43,494][123091] Updated weights for policy 0, policy_version 1511281 (0.0009) [2023-12-26 11:39:43,542][123091] Updated weights for policy 0, policy_version 1511291 (0.0007) [2023-12-26 11:39:43,593][123091] Updated weights for policy 0, policy_version 1511301 (0.0005) [2023-12-26 11:39:43,653][123091] Updated weights for policy 0, policy_version 1511311 (0.0005) [2023-12-26 11:39:43,680][123090] Updated weights for policy 1, policy_version 1501256 (0.0009) [2023-12-26 11:39:43,741][123090] Updated weights for policy 1, policy_version 1501266 (0.0009) [2023-12-26 11:39:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 771219456. Throughput: 0: 8925.2, 1: 8821.0. Samples: 771214480. Policy #0 lag: (min: 31.0, avg: 38.1, max: 63.0) [2023-12-26 11:39:43,785][121949] Avg episode reward: [(0, '6206.332'), (1, '4951.180')] [2023-12-26 11:39:43,803][123090] Updated weights for policy 1, policy_version 1501276 (0.0009) [2023-12-26 11:39:44,500][123091] Updated weights for policy 0, policy_version 1511321 (0.0008) [2023-12-26 11:39:44,566][123091] Updated weights for policy 0, policy_version 1511331 (0.0009) [2023-12-26 11:39:44,609][123090] Updated weights for policy 1, policy_version 1501286 (0.0007) [2023-12-26 11:39:44,629][123091] Updated weights for policy 0, policy_version 1511341 (0.0008) [2023-12-26 11:39:44,675][123090] Updated weights for policy 1, policy_version 1501296 (0.0008) [2023-12-26 11:39:44,741][123090] Updated weights for policy 1, policy_version 1501306 (0.0009) [2023-12-26 11:39:45,429][123091] Updated weights for policy 0, policy_version 1511351 (0.0008) [2023-12-26 11:39:45,478][123091] Updated weights for policy 0, policy_version 1511361 (0.0009) [2023-12-26 11:39:45,532][123091] Updated weights for policy 0, policy_version 1511371 (0.0010) [2023-12-26 11:39:45,562][123090] Updated weights for policy 1, policy_version 1501316 (0.0008) [2023-12-26 11:39:45,617][123090] Updated weights for policy 1, policy_version 1501326 (0.0010) [2023-12-26 11:39:45,671][123090] Updated weights for policy 1, policy_version 1501336 (0.0009) [2023-12-26 11:39:46,236][123091] Updated weights for policy 0, policy_version 1511381 (0.0008) [2023-12-26 11:39:46,298][123091] Updated weights for policy 0, policy_version 1511391 (0.0005) [2023-12-26 11:39:46,359][123091] Updated weights for policy 0, policy_version 1511401 (0.0006) [2023-12-26 11:39:46,403][123090] Updated weights for policy 1, policy_version 1501346 (0.0009) [2023-12-26 11:39:46,465][123090] Updated weights for policy 1, policy_version 1501356 (0.0009) [2023-12-26 11:39:46,514][123090] Updated weights for policy 1, policy_version 1501366 (0.0009) [2023-12-26 11:39:46,572][123090] Updated weights for policy 1, policy_version 1501376 (0.0009) [2023-12-26 11:39:47,103][123091] Updated weights for policy 0, policy_version 1511411 (0.0008) [2023-12-26 11:39:47,167][123091] Updated weights for policy 0, policy_version 1511421 (0.0008) [2023-12-26 11:39:47,219][123091] Updated weights for policy 0, policy_version 1511431 (0.0010) [2023-12-26 11:39:47,321][123090] Updated weights for policy 1, policy_version 1501386 (0.0005) [2023-12-26 11:39:47,388][123090] Updated weights for policy 1, policy_version 1501396 (0.0005) [2023-12-26 11:39:47,446][123090] Updated weights for policy 1, policy_version 1501406 (0.0007) [2023-12-26 11:39:48,050][123091] Updated weights for policy 0, policy_version 1511442 (0.0010) [2023-12-26 11:39:48,095][123090] Updated weights for policy 1, policy_version 1501416 (0.0006) [2023-12-26 11:39:48,102][123091] Updated weights for policy 0, policy_version 1511452 (0.0011) [2023-12-26 11:39:48,143][123090] Updated weights for policy 1, policy_version 1501426 (0.0005) [2023-12-26 11:39:48,168][123091] Updated weights for policy 0, policy_version 1511462 (0.0010) [2023-12-26 11:39:48,194][123090] Updated weights for policy 1, policy_version 1501436 (0.0006) [2023-12-26 11:39:48,222][123091] Updated weights for policy 0, policy_version 1511472 (0.0011) [2023-12-26 11:39:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 771309568. Throughput: 0: 8916.4, 1: 8879.0. Samples: 771324216. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:39:48,785][121949] Avg episode reward: [(0, '6209.747'), (1, '4875.171')] [2023-12-26 11:39:48,877][123090] Updated weights for policy 1, policy_version 1501446 (0.0007) [2023-12-26 11:39:48,929][123090] Updated weights for policy 1, policy_version 1501456 (0.0008) [2023-12-26 11:39:48,988][123090] Updated weights for policy 1, policy_version 1501466 (0.0008) [2023-12-26 11:39:49,048][123091] Updated weights for policy 0, policy_version 1511482 (0.0011) [2023-12-26 11:39:49,107][123091] Updated weights for policy 0, policy_version 1511492 (0.0011) [2023-12-26 11:39:49,161][123091] Updated weights for policy 0, policy_version 1511502 (0.0010) [2023-12-26 11:39:49,847][123090] Updated weights for policy 1, policy_version 1501476 (0.0009) [2023-12-26 11:39:49,919][123090] Updated weights for policy 1, policy_version 1501486 (0.0011) [2023-12-26 11:39:49,953][123091] Updated weights for policy 0, policy_version 1511512 (0.0008) [2023-12-26 11:39:49,992][123090] Updated weights for policy 1, policy_version 1501496 (0.0011) [2023-12-26 11:39:50,020][123091] Updated weights for policy 0, policy_version 1511522 (0.0007) [2023-12-26 11:39:50,069][123091] Updated weights for policy 0, policy_version 1511532 (0.0008) [2023-12-26 11:39:50,770][123090] Updated weights for policy 1, policy_version 1501506 (0.0011) [2023-12-26 11:39:50,834][123090] Updated weights for policy 1, policy_version 1501516 (0.0011) [2023-12-26 11:39:50,898][123090] Updated weights for policy 1, policy_version 1501526 (0.0010) [2023-12-26 11:39:50,909][123091] Updated weights for policy 0, policy_version 1511542 (0.0009) [2023-12-26 11:39:50,962][123090] Updated weights for policy 1, policy_version 1501536 (0.0011) [2023-12-26 11:39:50,977][123091] Updated weights for policy 0, policy_version 1511552 (0.0006) [2023-12-26 11:39:51,048][123091] Updated weights for policy 0, policy_version 1511562 (0.0010) [2023-12-26 11:39:51,733][123090] Updated weights for policy 1, policy_version 1501546 (0.0007) [2023-12-26 11:39:51,810][123090] Updated weights for policy 1, policy_version 1501556 (0.0006) [2023-12-26 11:39:51,816][123091] Updated weights for policy 0, policy_version 1511572 (0.0007) [2023-12-26 11:39:51,868][123090] Updated weights for policy 1, policy_version 1501566 (0.0005) [2023-12-26 11:39:51,889][123091] Updated weights for policy 0, policy_version 1511582 (0.0005) [2023-12-26 11:39:51,963][123091] Updated weights for policy 0, policy_version 1511592 (0.0005) [2023-12-26 11:39:52,546][123090] Updated weights for policy 1, policy_version 1501576 (0.0009) [2023-12-26 11:39:52,604][123090] Updated weights for policy 1, policy_version 1501586 (0.0007) [2023-12-26 11:39:52,659][123090] Updated weights for policy 1, policy_version 1501596 (0.0005) [2023-12-26 11:39:52,674][123091] Updated weights for policy 0, policy_version 1511602 (0.0006) [2023-12-26 11:39:52,730][123091] Updated weights for policy 0, policy_version 1511612 (0.0010) [2023-12-26 11:39:52,785][123091] Updated weights for policy 0, policy_version 1511622 (0.0009) [2023-12-26 11:39:52,848][123091] Updated weights for policy 0, policy_version 1511632 (0.0009) [2023-12-26 11:39:53,450][123090] Updated weights for policy 1, policy_version 1501606 (0.0006) [2023-12-26 11:39:53,510][123090] Updated weights for policy 1, policy_version 1501616 (0.0005) [2023-12-26 11:39:53,567][123090] Updated weights for policy 1, policy_version 1501626 (0.0008) [2023-12-26 11:39:53,569][123091] Updated weights for policy 0, policy_version 1511642 (0.0005) [2023-12-26 11:39:53,620][123091] Updated weights for policy 0, policy_version 1511652 (0.0009) [2023-12-26 11:39:53,673][123091] Updated weights for policy 0, policy_version 1511662 (0.0009) [2023-12-26 11:39:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 771407872. Throughput: 0: 8875.9, 1: 8915.6. Samples: 771377024. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:39:53,785][121949] Avg episode reward: [(0, '6376.031'), (1, '4800.260')] [2023-12-26 11:39:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001501632_384417792.pth... [2023-12-26 11:39:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001511664_386990080.pth... [2023-12-26 11:39:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001500576_384147456.pth [2023-12-26 11:39:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001510608_386719744.pth [2023-12-26 11:39:54,272][123090] Updated weights for policy 1, policy_version 1501636 (0.0008) [2023-12-26 11:39:54,331][123090] Updated weights for policy 1, policy_version 1501646 (0.0008) [2023-12-26 11:39:54,380][123090] Updated weights for policy 1, policy_version 1501656 (0.0009) [2023-12-26 11:39:54,524][123091] Updated weights for policy 0, policy_version 1511672 (0.0009) [2023-12-26 11:39:54,573][123091] Updated weights for policy 0, policy_version 1511682 (0.0010) [2023-12-26 11:39:54,626][123091] Updated weights for policy 0, policy_version 1511693 (0.0010) [2023-12-26 11:39:55,125][123090] Updated weights for policy 1, policy_version 1501666 (0.0008) [2023-12-26 11:39:55,178][123090] Updated weights for policy 1, policy_version 1501676 (0.0005) [2023-12-26 11:39:55,247][123090] Updated weights for policy 1, policy_version 1501686 (0.0005) [2023-12-26 11:39:55,329][123090] Updated weights for policy 1, policy_version 1501696 (0.0006) [2023-12-26 11:39:55,443][123091] Updated weights for policy 0, policy_version 1511703 (0.0006) [2023-12-26 11:39:55,494][123091] Updated weights for policy 0, policy_version 1511713 (0.0006) [2023-12-26 11:39:55,552][123091] Updated weights for policy 0, policy_version 1511723 (0.0006) [2023-12-26 11:39:55,979][123090] Updated weights for policy 1, policy_version 1501706 (0.0006) [2023-12-26 11:39:56,031][123090] Updated weights for policy 1, policy_version 1501716 (0.0005) [2023-12-26 11:39:56,075][123090] Updated weights for policy 1, policy_version 1501726 (0.0005) [2023-12-26 11:39:56,411][123091] Updated weights for policy 0, policy_version 1511733 (0.0008) [2023-12-26 11:39:56,470][123091] Updated weights for policy 0, policy_version 1511743 (0.0009) [2023-12-26 11:39:56,533][123091] Updated weights for policy 0, policy_version 1511753 (0.0009) [2023-12-26 11:39:56,743][123090] Updated weights for policy 1, policy_version 1501736 (0.0009) [2023-12-26 11:39:56,799][123090] Updated weights for policy 1, policy_version 1501746 (0.0005) [2023-12-26 11:39:56,869][123090] Updated weights for policy 1, policy_version 1501756 (0.0006) [2023-12-26 11:39:57,360][123091] Updated weights for policy 0, policy_version 1511763 (0.0009) [2023-12-26 11:39:57,411][123091] Updated weights for policy 0, policy_version 1511773 (0.0009) [2023-12-26 11:39:57,462][123091] Updated weights for policy 0, policy_version 1511783 (0.0009) [2023-12-26 11:39:57,587][123090] Updated weights for policy 1, policy_version 1501766 (0.0008) [2023-12-26 11:39:57,634][123090] Updated weights for policy 1, policy_version 1501776 (0.0010) [2023-12-26 11:39:57,685][123090] Updated weights for policy 1, policy_version 1501786 (0.0010) [2023-12-26 11:39:58,292][123091] Updated weights for policy 0, policy_version 1511793 (0.0008) [2023-12-26 11:39:58,369][123091] Updated weights for policy 0, policy_version 1511803 (0.0007) [2023-12-26 11:39:58,437][123091] Updated weights for policy 0, policy_version 1511813 (0.0009) [2023-12-26 11:39:58,505][123091] Updated weights for policy 0, policy_version 1511823 (0.0008) [2023-12-26 11:39:58,561][123090] Updated weights for policy 1, policy_version 1501796 (0.0010) [2023-12-26 11:39:58,625][123090] Updated weights for policy 1, policy_version 1501806 (0.0010) [2023-12-26 11:39:58,712][123090] Updated weights for policy 1, policy_version 1501817 (0.0008) [2023-12-26 11:39:58,785][121949] Fps is (10 sec: 18839.6, 60 sec: 17885.6, 300 sec: 17800.2). Total num frames: 771497984. Throughput: 0: 8867.9, 1: 9071.4. Samples: 771487552. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:39:58,786][121949] Avg episode reward: [(0, '6385.076'), (1, '4868.456')] [2023-12-26 11:39:59,366][123091] Updated weights for policy 0, policy_version 1511833 (0.0010) [2023-12-26 11:39:59,418][123091] Updated weights for policy 0, policy_version 1511843 (0.0009) [2023-12-26 11:39:59,483][123091] Updated weights for policy 0, policy_version 1511853 (0.0006) [2023-12-26 11:39:59,554][123090] Updated weights for policy 1, policy_version 1501827 (0.0007) [2023-12-26 11:39:59,618][123090] Updated weights for policy 1, policy_version 1501837 (0.0006) [2023-12-26 11:39:59,676][123090] Updated weights for policy 1, policy_version 1501847 (0.0005) [2023-12-26 11:40:00,234][123091] Updated weights for policy 0, policy_version 1511863 (0.0008) [2023-12-26 11:40:00,286][123091] Updated weights for policy 0, policy_version 1511873 (0.0008) [2023-12-26 11:40:00,340][123091] Updated weights for policy 0, policy_version 1511883 (0.0005) [2023-12-26 11:40:00,363][123090] Updated weights for policy 1, policy_version 1501857 (0.0005) [2023-12-26 11:40:00,420][123090] Updated weights for policy 1, policy_version 1501867 (0.0005) [2023-12-26 11:40:00,477][123090] Updated weights for policy 1, policy_version 1501877 (0.0008) [2023-12-26 11:40:00,531][123090] Updated weights for policy 1, policy_version 1501887 (0.0010) [2023-12-26 11:40:01,148][123091] Updated weights for policy 0, policy_version 1511893 (0.0008) [2023-12-26 11:40:01,205][123091] Updated weights for policy 0, policy_version 1511903 (0.0009) [2023-12-26 11:40:01,264][123091] Updated weights for policy 0, policy_version 1511913 (0.0009) [2023-12-26 11:40:01,414][123090] Updated weights for policy 1, policy_version 1501897 (0.0010) [2023-12-26 11:40:01,471][123090] Updated weights for policy 1, policy_version 1501907 (0.0009) [2023-12-26 11:40:01,525][123090] Updated weights for policy 1, policy_version 1501917 (0.0010) [2023-12-26 11:40:02,075][123091] Updated weights for policy 0, policy_version 1511923 (0.0010) [2023-12-26 11:40:02,136][123091] Updated weights for policy 0, policy_version 1511933 (0.0010) [2023-12-26 11:40:02,203][123091] Updated weights for policy 0, policy_version 1511943 (0.0010) [2023-12-26 11:40:02,357][123090] Updated weights for policy 1, policy_version 1501927 (0.0010) [2023-12-26 11:40:02,433][123090] Updated weights for policy 1, policy_version 1501937 (0.0009) [2023-12-26 11:40:02,496][123090] Updated weights for policy 1, policy_version 1501947 (0.0009) [2023-12-26 11:40:02,986][123091] Updated weights for policy 0, policy_version 1511953 (0.0008) [2023-12-26 11:40:03,062][123091] Updated weights for policy 0, policy_version 1511963 (0.0005) [2023-12-26 11:40:03,112][123091] Updated weights for policy 0, policy_version 1511973 (0.0005) [2023-12-26 11:40:03,177][123091] Updated weights for policy 0, policy_version 1511983 (0.0005) [2023-12-26 11:40:03,304][123090] Updated weights for policy 1, policy_version 1501957 (0.0005) [2023-12-26 11:40:03,376][123090] Updated weights for policy 1, policy_version 1501967 (0.0006) [2023-12-26 11:40:03,423][123090] Updated weights for policy 1, policy_version 1501977 (0.0005) [2023-12-26 11:40:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 771579904. Throughput: 0: 8937.8, 1: 9004.0. Samples: 771594808. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:03,785][121949] Avg episode reward: [(0, '6264.730'), (1, '5063.189')] [2023-12-26 11:40:03,804][123091] Updated weights for policy 0, policy_version 1511993 (0.0005) [2023-12-26 11:40:03,867][123091] Updated weights for policy 0, policy_version 1512003 (0.0007) [2023-12-26 11:40:03,938][123091] Updated weights for policy 0, policy_version 1512013 (0.0005) [2023-12-26 11:40:04,097][123090] Updated weights for policy 1, policy_version 1501987 (0.0007) [2023-12-26 11:40:04,160][123090] Updated weights for policy 1, policy_version 1501997 (0.0011) [2023-12-26 11:40:04,218][123090] Updated weights for policy 1, policy_version 1502007 (0.0009) [2023-12-26 11:40:04,668][123091] Updated weights for policy 0, policy_version 1512023 (0.0006) [2023-12-26 11:40:04,737][123091] Updated weights for policy 0, policy_version 1512033 (0.0005) [2023-12-26 11:40:04,789][123091] Updated weights for policy 0, policy_version 1512043 (0.0005) [2023-12-26 11:40:05,001][123090] Updated weights for policy 1, policy_version 1502017 (0.0010) [2023-12-26 11:40:05,058][123090] Updated weights for policy 1, policy_version 1502027 (0.0010) [2023-12-26 11:40:05,117][123090] Updated weights for policy 1, policy_version 1502037 (0.0009) [2023-12-26 11:40:05,184][123090] Updated weights for policy 1, policy_version 1502047 (0.0009) [2023-12-26 11:40:05,423][123091] Updated weights for policy 0, policy_version 1512053 (0.0007) [2023-12-26 11:40:05,491][123091] Updated weights for policy 0, policy_version 1512063 (0.0006) [2023-12-26 11:40:05,552][123091] Updated weights for policy 0, policy_version 1512073 (0.0009) [2023-12-26 11:40:06,055][123090] Updated weights for policy 1, policy_version 1502057 (0.0010) [2023-12-26 11:40:06,127][123090] Updated weights for policy 1, policy_version 1502067 (0.0009) [2023-12-26 11:40:06,202][123090] Updated weights for policy 1, policy_version 1502077 (0.0007) [2023-12-26 11:40:06,342][123091] Updated weights for policy 0, policy_version 1512083 (0.0008) [2023-12-26 11:40:06,403][123091] Updated weights for policy 0, policy_version 1512093 (0.0007) [2023-12-26 11:40:06,469][123091] Updated weights for policy 0, policy_version 1512103 (0.0009) [2023-12-26 11:40:07,024][123090] Updated weights for policy 1, policy_version 1502087 (0.0008) [2023-12-26 11:40:07,079][123090] Updated weights for policy 1, policy_version 1502097 (0.0009) [2023-12-26 11:40:07,128][123090] Updated weights for policy 1, policy_version 1502107 (0.0010) [2023-12-26 11:40:07,269][123091] Updated weights for policy 0, policy_version 1512113 (0.0008) [2023-12-26 11:40:07,341][123091] Updated weights for policy 0, policy_version 1512123 (0.0005) [2023-12-26 11:40:07,411][123091] Updated weights for policy 0, policy_version 1512133 (0.0006) [2023-12-26 11:40:07,482][123091] Updated weights for policy 0, policy_version 1512143 (0.0005) [2023-12-26 11:40:07,939][123090] Updated weights for policy 1, policy_version 1502117 (0.0008) [2023-12-26 11:40:08,000][123090] Updated weights for policy 1, policy_version 1502127 (0.0006) [2023-12-26 11:40:08,066][123090] Updated weights for policy 1, policy_version 1502137 (0.0010) [2023-12-26 11:40:08,078][123091] Updated weights for policy 0, policy_version 1512153 (0.0005) [2023-12-26 11:40:08,131][123091] Updated weights for policy 0, policy_version 1512163 (0.0005) [2023-12-26 11:40:08,182][123091] Updated weights for policy 0, policy_version 1512173 (0.0005) [2023-12-26 11:40:08,784][121949] Fps is (10 sec: 17204.7, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 771670016. Throughput: 0: 8966.9, 1: 9019.3. Samples: 771649068. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:08,785][121949] Avg episode reward: [(0, '6275.616'), (1, '5349.029')] [2023-12-26 11:40:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001512176_387121152.pth... [2023-12-26 11:40:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001502144_384548864.pth... [2023-12-26 11:40:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001511152_386859008.pth [2023-12-26 11:40:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001501088_384278528.pth [2023-12-26 11:40:08,859][123090] Updated weights for policy 1, policy_version 1502147 (0.0010) [2023-12-26 11:40:08,881][123091] Updated weights for policy 0, policy_version 1512183 (0.0007) [2023-12-26 11:40:08,924][123090] Updated weights for policy 1, policy_version 1502157 (0.0008) [2023-12-26 11:40:08,942][123091] Updated weights for policy 0, policy_version 1512193 (0.0009) [2023-12-26 11:40:08,975][123090] Updated weights for policy 1, policy_version 1502167 (0.0010) [2023-12-26 11:40:09,003][123091] Updated weights for policy 0, policy_version 1512203 (0.0009) [2023-12-26 11:40:09,861][123090] Updated weights for policy 1, policy_version 1502177 (0.0007) [2023-12-26 11:40:09,864][123091] Updated weights for policy 0, policy_version 1512213 (0.0010) [2023-12-26 11:40:09,930][123091] Updated weights for policy 0, policy_version 1512223 (0.0008) [2023-12-26 11:40:09,932][123090] Updated weights for policy 1, policy_version 1502187 (0.0009) [2023-12-26 11:40:10,001][123091] Updated weights for policy 0, policy_version 1512233 (0.0009) [2023-12-26 11:40:10,003][123090] Updated weights for policy 1, policy_version 1502197 (0.0008) [2023-12-26 11:40:10,071][123090] Updated weights for policy 1, policy_version 1502207 (0.0008) [2023-12-26 11:40:10,761][123091] Updated weights for policy 0, policy_version 1512243 (0.0009) [2023-12-26 11:40:10,814][123091] Updated weights for policy 0, policy_version 1512253 (0.0009) [2023-12-26 11:40:10,879][123091] Updated weights for policy 0, policy_version 1512263 (0.0009) [2023-12-26 11:40:10,906][123090] Updated weights for policy 1, policy_version 1502217 (0.0009) [2023-12-26 11:40:10,976][123090] Updated weights for policy 1, policy_version 1502227 (0.0009) [2023-12-26 11:40:11,044][123090] Updated weights for policy 1, policy_version 1502237 (0.0009) [2023-12-26 11:40:11,737][123091] Updated weights for policy 0, policy_version 1512273 (0.0009) [2023-12-26 11:40:11,802][123091] Updated weights for policy 0, policy_version 1512283 (0.0010) [2023-12-26 11:40:11,858][123091] Updated weights for policy 0, policy_version 1512293 (0.0009) [2023-12-26 11:40:11,873][123090] Updated weights for policy 1, policy_version 1502247 (0.0007) [2023-12-26 11:40:11,932][123091] Updated weights for policy 0, policy_version 1512303 (0.0009) [2023-12-26 11:40:11,936][123090] Updated weights for policy 1, policy_version 1502257 (0.0006) [2023-12-26 11:40:11,992][123090] Updated weights for policy 1, policy_version 1502267 (0.0007) [2023-12-26 11:40:12,712][123090] Updated weights for policy 1, policy_version 1502277 (0.0008) [2023-12-26 11:40:12,771][123091] Updated weights for policy 0, policy_version 1512313 (0.0007) [2023-12-26 11:40:12,773][123090] Updated weights for policy 1, policy_version 1502287 (0.0010) [2023-12-26 11:40:12,829][123090] Updated weights for policy 1, policy_version 1502297 (0.0010) [2023-12-26 11:40:12,831][123091] Updated weights for policy 0, policy_version 1512323 (0.0006) [2023-12-26 11:40:12,888][123091] Updated weights for policy 0, policy_version 1512333 (0.0008) [2023-12-26 11:40:13,534][123091] Updated weights for policy 0, policy_version 1512343 (0.0006) [2023-12-26 11:40:13,582][123091] Updated weights for policy 0, policy_version 1512353 (0.0005) [2023-12-26 11:40:13,591][123090] Updated weights for policy 1, policy_version 1502307 (0.0011) [2023-12-26 11:40:13,628][123091] Updated weights for policy 0, policy_version 1512363 (0.0005) [2023-12-26 11:40:13,654][123090] Updated weights for policy 1, policy_version 1502317 (0.0010) [2023-12-26 11:40:13,720][123090] Updated weights for policy 1, policy_version 1502327 (0.0006) [2023-12-26 11:40:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 771768320. Throughput: 0: 8959.0, 1: 8959.9. Samples: 771754768. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:13,785][121949] Avg episode reward: [(0, '6241.976'), (1, '5378.622')] [2023-12-26 11:40:14,315][123091] Updated weights for policy 0, policy_version 1512373 (0.0007) [2023-12-26 11:40:14,386][123091] Updated weights for policy 0, policy_version 1512383 (0.0006) [2023-12-26 11:40:14,446][123091] Updated weights for policy 0, policy_version 1512393 (0.0010) [2023-12-26 11:40:14,491][123090] Updated weights for policy 1, policy_version 1502337 (0.0005) [2023-12-26 11:40:14,551][123090] Updated weights for policy 1, policy_version 1502347 (0.0006) [2023-12-26 11:40:14,623][123090] Updated weights for policy 1, policy_version 1502357 (0.0005) [2023-12-26 11:40:14,685][123090] Updated weights for policy 1, policy_version 1502367 (0.0006) [2023-12-26 11:40:15,263][123091] Updated weights for policy 0, policy_version 1512403 (0.0009) [2023-12-26 11:40:15,331][123091] Updated weights for policy 0, policy_version 1512413 (0.0009) [2023-12-26 11:40:15,388][123091] Updated weights for policy 0, policy_version 1512423 (0.0009) [2023-12-26 11:40:15,463][123090] Updated weights for policy 1, policy_version 1502377 (0.0010) [2023-12-26 11:40:15,533][123090] Updated weights for policy 1, policy_version 1502387 (0.0010) [2023-12-26 11:40:15,593][123090] Updated weights for policy 1, policy_version 1502397 (0.0010) [2023-12-26 11:40:16,172][123091] Updated weights for policy 0, policy_version 1512433 (0.0008) [2023-12-26 11:40:16,236][123091] Updated weights for policy 0, policy_version 1512443 (0.0009) [2023-12-26 11:40:16,300][123091] Updated weights for policy 0, policy_version 1512453 (0.0009) [2023-12-26 11:40:16,364][123091] Updated weights for policy 0, policy_version 1512463 (0.0010) [2023-12-26 11:40:16,385][123090] Updated weights for policy 1, policy_version 1502407 (0.0007) [2023-12-26 11:40:16,435][123090] Updated weights for policy 1, policy_version 1502417 (0.0005) [2023-12-26 11:40:16,482][123090] Updated weights for policy 1, policy_version 1502427 (0.0005) [2023-12-26 11:40:17,189][123090] Updated weights for policy 1, policy_version 1502437 (0.0007) [2023-12-26 11:40:17,244][123091] Updated weights for policy 0, policy_version 1512473 (0.0010) [2023-12-26 11:40:17,251][123090] Updated weights for policy 1, policy_version 1502447 (0.0007) [2023-12-26 11:40:17,308][123091] Updated weights for policy 0, policy_version 1512483 (0.0009) [2023-12-26 11:40:17,316][123090] Updated weights for policy 1, policy_version 1502457 (0.0006) [2023-12-26 11:40:17,372][123091] Updated weights for policy 0, policy_version 1512493 (0.0008) [2023-12-26 11:40:18,110][123090] Updated weights for policy 1, policy_version 1502467 (0.0009) [2023-12-26 11:40:18,164][123090] Updated weights for policy 1, policy_version 1502477 (0.0009) [2023-12-26 11:40:18,202][123091] Updated weights for policy 0, policy_version 1512503 (0.0009) [2023-12-26 11:40:18,227][123090] Updated weights for policy 1, policy_version 1502487 (0.0009) [2023-12-26 11:40:18,258][123091] Updated weights for policy 0, policy_version 1512513 (0.0009) [2023-12-26 11:40:18,322][123091] Updated weights for policy 0, policy_version 1512523 (0.0009) [2023-12-26 11:40:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 771850240. Throughput: 0: 8969.7, 1: 8966.0. Samples: 771863508. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:18,785][121949] Avg episode reward: [(0, '6212.072'), (1, '5148.225')] [2023-12-26 11:40:19,012][123090] Updated weights for policy 1, policy_version 1502497 (0.0007) [2023-12-26 11:40:19,078][123090] Updated weights for policy 1, policy_version 1502507 (0.0009) [2023-12-26 11:40:19,130][123090] Updated weights for policy 1, policy_version 1502517 (0.0009) [2023-12-26 11:40:19,180][123090] Updated weights for policy 1, policy_version 1502527 (0.0009) [2023-12-26 11:40:19,192][123091] Updated weights for policy 0, policy_version 1512533 (0.0008) [2023-12-26 11:40:19,262][123091] Updated weights for policy 0, policy_version 1512543 (0.0009) [2023-12-26 11:40:19,322][123091] Updated weights for policy 0, policy_version 1512553 (0.0009) [2023-12-26 11:40:20,030][123090] Updated weights for policy 1, policy_version 1502537 (0.0009) [2023-12-26 11:40:20,091][123090] Updated weights for policy 1, policy_version 1502547 (0.0009) [2023-12-26 11:40:20,143][123090] Updated weights for policy 1, policy_version 1502557 (0.0010) [2023-12-26 11:40:20,190][123091] Updated weights for policy 0, policy_version 1512563 (0.0010) [2023-12-26 11:40:20,243][123091] Updated weights for policy 0, policy_version 1512573 (0.0009) [2023-12-26 11:40:20,299][123091] Updated weights for policy 0, policy_version 1512583 (0.0009) [2023-12-26 11:40:20,941][123090] Updated weights for policy 1, policy_version 1502567 (0.0010) [2023-12-26 11:40:21,011][123090] Updated weights for policy 1, policy_version 1502577 (0.0009) [2023-12-26 11:40:21,074][123090] Updated weights for policy 1, policy_version 1502587 (0.0008) [2023-12-26 11:40:21,204][123091] Updated weights for policy 0, policy_version 1512593 (0.0010) [2023-12-26 11:40:21,258][123091] Updated weights for policy 0, policy_version 1512603 (0.0009) [2023-12-26 11:40:21,312][123091] Updated weights for policy 0, policy_version 1512613 (0.0009) [2023-12-26 11:40:21,390][123091] Updated weights for policy 0, policy_version 1512623 (0.0009) [2023-12-26 11:40:21,927][123090] Updated weights for policy 1, policy_version 1502597 (0.0010) [2023-12-26 11:40:21,991][123090] Updated weights for policy 1, policy_version 1502607 (0.0008) [2023-12-26 11:40:22,058][123090] Updated weights for policy 1, policy_version 1502617 (0.0006) [2023-12-26 11:40:22,259][123091] Updated weights for policy 0, policy_version 1512633 (0.0009) [2023-12-26 11:40:22,318][123091] Updated weights for policy 0, policy_version 1512643 (0.0010) [2023-12-26 11:40:22,393][123091] Updated weights for policy 0, policy_version 1512653 (0.0010) [2023-12-26 11:40:22,858][123090] Updated weights for policy 1, policy_version 1502627 (0.0010) [2023-12-26 11:40:22,917][123090] Updated weights for policy 1, policy_version 1502637 (0.0010) [2023-12-26 11:40:22,981][123090] Updated weights for policy 1, policy_version 1502647 (0.0010) [2023-12-26 11:40:23,245][123091] Updated weights for policy 0, policy_version 1512663 (0.0009) [2023-12-26 11:40:23,299][123091] Updated weights for policy 0, policy_version 1512673 (0.0009) [2023-12-26 11:40:23,355][123091] Updated weights for policy 0, policy_version 1512683 (0.0008) [2023-12-26 11:40:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 771932160. Throughput: 0: 8887.4, 1: 8907.3. Samples: 771913388. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:23,784][121949] Avg episode reward: [(0, '6218.295'), (1, '4953.159')] [2023-12-26 11:40:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001512688_387252224.pth... [2023-12-26 11:40:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001502656_384679936.pth... [2023-12-26 11:40:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001501632_384417792.pth [2023-12-26 11:40:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001511664_386990080.pth [2023-12-26 11:40:23,819][123090] Updated weights for policy 1, policy_version 1502657 (0.0010) [2023-12-26 11:40:23,893][123090] Updated weights for policy 1, policy_version 1502667 (0.0009) [2023-12-26 11:40:23,957][123090] Updated weights for policy 1, policy_version 1502677 (0.0009) [2023-12-26 11:40:24,030][123090] Updated weights for policy 1, policy_version 1502687 (0.0008) [2023-12-26 11:40:24,040][123091] Updated weights for policy 0, policy_version 1512693 (0.0006) [2023-12-26 11:40:24,102][123091] Updated weights for policy 0, policy_version 1512703 (0.0006) [2023-12-26 11:40:24,158][123091] Updated weights for policy 0, policy_version 1512713 (0.0005) [2023-12-26 11:40:24,825][123090] Updated weights for policy 1, policy_version 1502697 (0.0005) [2023-12-26 11:40:24,882][123090] Updated weights for policy 1, policy_version 1502707 (0.0005) [2023-12-26 11:40:24,921][123091] Updated weights for policy 0, policy_version 1512723 (0.0008) [2023-12-26 11:40:24,940][123090] Updated weights for policy 1, policy_version 1502717 (0.0006) [2023-12-26 11:40:24,971][123091] Updated weights for policy 0, policy_version 1512733 (0.0008) [2023-12-26 11:40:25,027][123091] Updated weights for policy 0, policy_version 1512744 (0.0010) [2023-12-26 11:40:25,629][123090] Updated weights for policy 1, policy_version 1502727 (0.0008) [2023-12-26 11:40:25,684][123090] Updated weights for policy 1, policy_version 1502737 (0.0010) [2023-12-26 11:40:25,740][123090] Updated weights for policy 1, policy_version 1502748 (0.0010) [2023-12-26 11:40:25,896][123091] Updated weights for policy 0, policy_version 1512755 (0.0010) [2023-12-26 11:40:25,961][123091] Updated weights for policy 0, policy_version 1512765 (0.0010) [2023-12-26 11:40:26,025][123091] Updated weights for policy 0, policy_version 1512775 (0.0010) [2023-12-26 11:40:26,651][123090] Updated weights for policy 1, policy_version 1502758 (0.0009) [2023-12-26 11:40:26,665][123091] Updated weights for policy 0, policy_version 1512785 (0.0009) [2023-12-26 11:40:26,716][123090] Updated weights for policy 1, policy_version 1502768 (0.0007) [2023-12-26 11:40:26,724][123091] Updated weights for policy 0, policy_version 1512795 (0.0010) [2023-12-26 11:40:26,770][123091] Updated weights for policy 0, policy_version 1512805 (0.0009) [2023-12-26 11:40:26,772][123090] Updated weights for policy 1, policy_version 1502778 (0.0007) [2023-12-26 11:40:26,828][123091] Updated weights for policy 0, policy_version 1512815 (0.0005) [2023-12-26 11:40:27,483][123091] Updated weights for policy 0, policy_version 1512825 (0.0010) [2023-12-26 11:40:27,538][123091] Updated weights for policy 0, policy_version 1512835 (0.0010) [2023-12-26 11:40:27,566][123090] Updated weights for policy 1, policy_version 1502788 (0.0006) [2023-12-26 11:40:27,590][123091] Updated weights for policy 0, policy_version 1512845 (0.0010) [2023-12-26 11:40:27,629][123090] Updated weights for policy 1, policy_version 1502798 (0.0006) [2023-12-26 11:40:27,683][123090] Updated weights for policy 1, policy_version 1502808 (0.0006) [2023-12-26 11:40:28,310][123091] Updated weights for policy 0, policy_version 1512855 (0.0007) [2023-12-26 11:40:28,384][123091] Updated weights for policy 0, policy_version 1512865 (0.0008) [2023-12-26 11:40:28,442][123090] Updated weights for policy 1, policy_version 1502818 (0.0007) [2023-12-26 11:40:28,448][123091] Updated weights for policy 0, policy_version 1512875 (0.0005) [2023-12-26 11:40:28,498][123090] Updated weights for policy 1, policy_version 1502828 (0.0005) [2023-12-26 11:40:28,567][123090] Updated weights for policy 1, policy_version 1502838 (0.0005) [2023-12-26 11:40:28,636][123090] Updated weights for policy 1, policy_version 1502848 (0.0005) [2023-12-26 11:40:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 772030464. Throughput: 0: 8920.2, 1: 8970.6. Samples: 772019568. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:28,785][121949] Avg episode reward: [(0, '6303.929'), (1, '5311.841')] [2023-12-26 11:40:29,129][123091] Updated weights for policy 0, policy_version 1512885 (0.0009) [2023-12-26 11:40:29,188][123091] Updated weights for policy 0, policy_version 1512895 (0.0010) [2023-12-26 11:40:29,260][123091] Updated weights for policy 0, policy_version 1512905 (0.0009) [2023-12-26 11:40:29,383][123090] Updated weights for policy 1, policy_version 1502858 (0.0009) [2023-12-26 11:40:29,447][123090] Updated weights for policy 1, policy_version 1502868 (0.0009) [2023-12-26 11:40:29,507][123090] Updated weights for policy 1, policy_version 1502878 (0.0010) [2023-12-26 11:40:30,088][123091] Updated weights for policy 0, policy_version 1512915 (0.0010) [2023-12-26 11:40:30,144][123091] Updated weights for policy 0, policy_version 1512925 (0.0009) [2023-12-26 11:40:30,199][123091] Updated weights for policy 0, policy_version 1512935 (0.0009) [2023-12-26 11:40:30,343][123090] Updated weights for policy 1, policy_version 1502888 (0.0009) [2023-12-26 11:40:30,394][123090] Updated weights for policy 1, policy_version 1502898 (0.0009) [2023-12-26 11:40:30,450][123090] Updated weights for policy 1, policy_version 1502908 (0.0009) [2023-12-26 11:40:31,041][123091] Updated weights for policy 0, policy_version 1512945 (0.0009) [2023-12-26 11:40:31,103][123091] Updated weights for policy 0, policy_version 1512955 (0.0010) [2023-12-26 11:40:31,170][123091] Updated weights for policy 0, policy_version 1512965 (0.0009) [2023-12-26 11:40:31,226][123091] Updated weights for policy 0, policy_version 1512975 (0.0010) [2023-12-26 11:40:31,276][123090] Updated weights for policy 1, policy_version 1502918 (0.0008) [2023-12-26 11:40:31,327][123090] Updated weights for policy 1, policy_version 1502928 (0.0009) [2023-12-26 11:40:31,399][123090] Updated weights for policy 1, policy_version 1502938 (0.0010) [2023-12-26 11:40:32,059][123091] Updated weights for policy 0, policy_version 1512985 (0.0010) [2023-12-26 11:40:32,122][123091] Updated weights for policy 0, policy_version 1512995 (0.0009) [2023-12-26 11:40:32,189][123091] Updated weights for policy 0, policy_version 1513005 (0.0009) [2023-12-26 11:40:32,250][123090] Updated weights for policy 1, policy_version 1502948 (0.0010) [2023-12-26 11:40:32,306][123090] Updated weights for policy 1, policy_version 1502958 (0.0010) [2023-12-26 11:40:32,364][123090] Updated weights for policy 1, policy_version 1502968 (0.0010) [2023-12-26 11:40:32,973][123091] Updated weights for policy 0, policy_version 1513015 (0.0007) [2023-12-26 11:40:33,038][123091] Updated weights for policy 0, policy_version 1513025 (0.0005) [2023-12-26 11:40:33,103][123091] Updated weights for policy 0, policy_version 1513035 (0.0005) [2023-12-26 11:40:33,215][123090] Updated weights for policy 1, policy_version 1502978 (0.0009) [2023-12-26 11:40:33,274][123090] Updated weights for policy 1, policy_version 1502988 (0.0006) [2023-12-26 11:40:33,333][123090] Updated weights for policy 1, policy_version 1502998 (0.0005) [2023-12-26 11:40:33,388][123090] Updated weights for policy 1, policy_version 1503008 (0.0005) [2023-12-26 11:40:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 772112384. Throughput: 0: 8930.0, 1: 8887.0. Samples: 772125984. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:33,785][121949] Avg episode reward: [(0, '6156.938'), (1, '5233.495')] [2023-12-26 11:40:33,920][123091] Updated weights for policy 0, policy_version 1513045 (0.0008) [2023-12-26 11:40:33,967][123091] Updated weights for policy 0, policy_version 1513055 (0.0010) [2023-12-26 11:40:34,008][123090] Updated weights for policy 1, policy_version 1503018 (0.0006) [2023-12-26 11:40:34,018][123091] Updated weights for policy 0, policy_version 1513065 (0.0010) [2023-12-26 11:40:34,061][123090] Updated weights for policy 1, policy_version 1503028 (0.0005) [2023-12-26 11:40:34,116][123090] Updated weights for policy 1, policy_version 1503038 (0.0006) [2023-12-26 11:40:34,740][123091] Updated weights for policy 0, policy_version 1513075 (0.0009) [2023-12-26 11:40:34,802][123091] Updated weights for policy 0, policy_version 1513085 (0.0005) [2023-12-26 11:40:34,865][123091] Updated weights for policy 0, policy_version 1513095 (0.0005) [2023-12-26 11:40:35,007][123090] Updated weights for policy 1, policy_version 1503048 (0.0006) [2023-12-26 11:40:35,059][123090] Updated weights for policy 1, policy_version 1503058 (0.0005) [2023-12-26 11:40:35,120][123090] Updated weights for policy 1, policy_version 1503068 (0.0005) [2023-12-26 11:40:35,650][123091] Updated weights for policy 0, policy_version 1513105 (0.0008) [2023-12-26 11:40:35,736][123091] Updated weights for policy 0, policy_version 1513115 (0.0005) [2023-12-26 11:40:35,788][123091] Updated weights for policy 0, policy_version 1513125 (0.0005) [2023-12-26 11:40:35,835][123091] Updated weights for policy 0, policy_version 1513135 (0.0005) [2023-12-26 11:40:35,938][123090] Updated weights for policy 1, policy_version 1503078 (0.0008) [2023-12-26 11:40:36,002][123090] Updated weights for policy 1, policy_version 1503088 (0.0010) [2023-12-26 11:40:36,065][123090] Updated weights for policy 1, policy_version 1503098 (0.0010) [2023-12-26 11:40:36,558][123091] Updated weights for policy 0, policy_version 1513145 (0.0010) [2023-12-26 11:40:36,622][123091] Updated weights for policy 0, policy_version 1513155 (0.0009) [2023-12-26 11:40:36,685][123091] Updated weights for policy 0, policy_version 1513165 (0.0011) [2023-12-26 11:40:36,899][123090] Updated weights for policy 1, policy_version 1503108 (0.0010) [2023-12-26 11:40:36,975][123090] Updated weights for policy 1, policy_version 1503118 (0.0010) [2023-12-26 11:40:37,048][123090] Updated weights for policy 1, policy_version 1503128 (0.0010) [2023-12-26 11:40:37,427][123091] Updated weights for policy 0, policy_version 1513175 (0.0007) [2023-12-26 11:40:37,494][123091] Updated weights for policy 0, policy_version 1513185 (0.0005) [2023-12-26 11:40:37,545][123091] Updated weights for policy 0, policy_version 1513195 (0.0005) [2023-12-26 11:40:37,961][123090] Updated weights for policy 1, policy_version 1503138 (0.0010) [2023-12-26 11:40:38,029][123090] Updated weights for policy 1, policy_version 1503148 (0.0010) [2023-12-26 11:40:38,094][123090] Updated weights for policy 1, policy_version 1503158 (0.0009) [2023-12-26 11:40:38,157][123090] Updated weights for policy 1, policy_version 1503168 (0.0009) [2023-12-26 11:40:38,158][123091] Updated weights for policy 0, policy_version 1513205 (0.0005) [2023-12-26 11:40:38,210][123091] Updated weights for policy 0, policy_version 1513215 (0.0005) [2023-12-26 11:40:38,260][123091] Updated weights for policy 0, policy_version 1513225 (0.0005) [2023-12-26 11:40:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 772202496. Throughput: 0: 8974.6, 1: 8875.7. Samples: 772180288. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:38,785][121949] Avg episode reward: [(0, '6162.998'), (1, '5310.538')] [2023-12-26 11:40:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001513232_387391488.pth... [2023-12-26 11:40:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001503168_384811008.pth... [2023-12-26 11:40:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001512176_387121152.pth [2023-12-26 11:40:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001502144_384548864.pth [2023-12-26 11:40:39,041][123090] Updated weights for policy 1, policy_version 1503178 (0.0008) [2023-12-26 11:40:39,054][123091] Updated weights for policy 0, policy_version 1513235 (0.0007) [2023-12-26 11:40:39,103][123090] Updated weights for policy 1, policy_version 1503188 (0.0007) [2023-12-26 11:40:39,121][123091] Updated weights for policy 0, policy_version 1513245 (0.0011) [2023-12-26 11:40:39,162][123090] Updated weights for policy 1, policy_version 1503198 (0.0008) [2023-12-26 11:40:39,179][123091] Updated weights for policy 0, policy_version 1513255 (0.0011) [2023-12-26 11:40:39,977][123090] Updated weights for policy 1, policy_version 1503208 (0.0010) [2023-12-26 11:40:40,034][123090] Updated weights for policy 1, policy_version 1503218 (0.0009) [2023-12-26 11:40:40,056][123091] Updated weights for policy 0, policy_version 1513265 (0.0010) [2023-12-26 11:40:40,094][123090] Updated weights for policy 1, policy_version 1503228 (0.0007) [2023-12-26 11:40:40,121][123091] Updated weights for policy 0, policy_version 1513275 (0.0011) [2023-12-26 11:40:40,174][123091] Updated weights for policy 0, policy_version 1513285 (0.0011) [2023-12-26 11:40:40,239][123091] Updated weights for policy 0, policy_version 1513295 (0.0011) [2023-12-26 11:40:40,944][123090] Updated weights for policy 1, policy_version 1503238 (0.0006) [2023-12-26 11:40:41,012][123090] Updated weights for policy 1, policy_version 1503248 (0.0007) [2023-12-26 11:40:41,048][123091] Updated weights for policy 0, policy_version 1513305 (0.0010) [2023-12-26 11:40:41,076][123090] Updated weights for policy 1, policy_version 1503258 (0.0010) [2023-12-26 11:40:41,115][123091] Updated weights for policy 0, policy_version 1513315 (0.0009) [2023-12-26 11:40:41,199][123091] Updated weights for policy 0, policy_version 1513325 (0.0013) [2023-12-26 11:40:41,874][123090] Updated weights for policy 1, policy_version 1503268 (0.0011) [2023-12-26 11:40:41,922][123090] Updated weights for policy 1, policy_version 1503278 (0.0010) [2023-12-26 11:40:41,985][123090] Updated weights for policy 1, policy_version 1503288 (0.0007) [2023-12-26 11:40:42,002][123091] Updated weights for policy 0, policy_version 1513335 (0.0011) [2023-12-26 11:40:42,066][123091] Updated weights for policy 0, policy_version 1513345 (0.0009) [2023-12-26 11:40:42,118][123091] Updated weights for policy 0, policy_version 1513355 (0.0011) [2023-12-26 11:40:42,778][123090] Updated weights for policy 1, policy_version 1503298 (0.0009) [2023-12-26 11:40:42,838][123090] Updated weights for policy 1, policy_version 1503308 (0.0006) [2023-12-26 11:40:42,903][123090] Updated weights for policy 1, policy_version 1503318 (0.0007) [2023-12-26 11:40:42,934][123091] Updated weights for policy 0, policy_version 1513365 (0.0011) [2023-12-26 11:40:42,962][123090] Updated weights for policy 1, policy_version 1503328 (0.0007) [2023-12-26 11:40:42,989][123091] Updated weights for policy 0, policy_version 1513375 (0.0008) [2023-12-26 11:40:43,039][123091] Updated weights for policy 0, policy_version 1513385 (0.0010) [2023-12-26 11:40:43,656][123090] Updated weights for policy 1, policy_version 1503338 (0.0009) [2023-12-26 11:40:43,703][123090] Updated weights for policy 1, policy_version 1503348 (0.0008) [2023-12-26 11:40:43,750][123090] Updated weights for policy 1, policy_version 1503358 (0.0008) [2023-12-26 11:40:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 772292608. Throughput: 0: 8990.4, 1: 8698.7. Samples: 772283544. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:43,785][121949] Avg episode reward: [(0, '6361.025'), (1, '5137.018')] [2023-12-26 11:40:43,785][123091] Updated weights for policy 0, policy_version 1513395 (0.0009) [2023-12-26 11:40:43,839][123091] Updated weights for policy 0, policy_version 1513405 (0.0009) [2023-12-26 11:40:43,897][123091] Updated weights for policy 0, policy_version 1513415 (0.0010) [2023-12-26 11:40:44,577][123090] Updated weights for policy 1, policy_version 1503368 (0.0009) [2023-12-26 11:40:44,628][123091] Updated weights for policy 0, policy_version 1513426 (0.0009) [2023-12-26 11:40:44,653][123090] Updated weights for policy 1, policy_version 1503378 (0.0009) [2023-12-26 11:40:44,692][123091] Updated weights for policy 0, policy_version 1513436 (0.0006) [2023-12-26 11:40:44,719][123090] Updated weights for policy 1, policy_version 1503388 (0.0010) [2023-12-26 11:40:44,758][123091] Updated weights for policy 0, policy_version 1513446 (0.0007) [2023-12-26 11:40:44,833][123091] Updated weights for policy 0, policy_version 1513456 (0.0007) [2023-12-26 11:40:45,567][123091] Updated weights for policy 0, policy_version 1513466 (0.0006) [2023-12-26 11:40:45,588][123090] Updated weights for policy 1, policy_version 1503398 (0.0008) [2023-12-26 11:40:45,617][123091] Updated weights for policy 0, policy_version 1513476 (0.0009) [2023-12-26 11:40:45,637][123090] Updated weights for policy 1, policy_version 1503408 (0.0008) [2023-12-26 11:40:45,665][123091] Updated weights for policy 0, policy_version 1513486 (0.0008) [2023-12-26 11:40:45,691][123090] Updated weights for policy 1, policy_version 1503418 (0.0009) [2023-12-26 11:40:46,434][123091] Updated weights for policy 0, policy_version 1513496 (0.0010) [2023-12-26 11:40:46,486][123091] Updated weights for policy 0, policy_version 1513506 (0.0010) [2023-12-26 11:40:46,551][123090] Updated weights for policy 1, policy_version 1503428 (0.0008) [2023-12-26 11:40:46,551][123091] Updated weights for policy 0, policy_version 1513516 (0.0010) [2023-12-26 11:40:46,604][123090] Updated weights for policy 1, policy_version 1503438 (0.0009) [2023-12-26 11:40:46,653][123090] Updated weights for policy 1, policy_version 1503448 (0.0009) [2023-12-26 11:40:47,310][123091] Updated weights for policy 0, policy_version 1513526 (0.0007) [2023-12-26 11:40:47,359][123091] Updated weights for policy 0, policy_version 1513536 (0.0005) [2023-12-26 11:40:47,410][123091] Updated weights for policy 0, policy_version 1513546 (0.0010) [2023-12-26 11:40:47,543][123090] Updated weights for policy 1, policy_version 1503458 (0.0009) [2023-12-26 11:40:47,596][123090] Updated weights for policy 1, policy_version 1503468 (0.0010) [2023-12-26 11:40:47,651][123090] Updated weights for policy 1, policy_version 1503478 (0.0009) [2023-12-26 11:40:47,706][123090] Updated weights for policy 1, policy_version 1503488 (0.0010) [2023-12-26 11:40:48,190][123091] Updated weights for policy 0, policy_version 1513556 (0.0011) [2023-12-26 11:40:48,238][123091] Updated weights for policy 0, policy_version 1513566 (0.0009) [2023-12-26 11:40:48,303][123091] Updated weights for policy 0, policy_version 1513576 (0.0009) [2023-12-26 11:40:48,565][123090] Updated weights for policy 1, policy_version 1503498 (0.0009) [2023-12-26 11:40:48,617][123090] Updated weights for policy 1, policy_version 1503508 (0.0010) [2023-12-26 11:40:48,677][123090] Updated weights for policy 1, policy_version 1503518 (0.0009) [2023-12-26 11:40:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 772382720. Throughput: 0: 8994.3, 1: 8680.5. Samples: 772390172. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:48,785][121949] Avg episode reward: [(0, '6280.655'), (1, '5089.242')] [2023-12-26 11:40:49,152][123091] Updated weights for policy 0, policy_version 1513586 (0.0010) [2023-12-26 11:40:49,220][123091] Updated weights for policy 0, policy_version 1513596 (0.0009) [2023-12-26 11:40:49,289][123091] Updated weights for policy 0, policy_version 1513606 (0.0007) [2023-12-26 11:40:49,355][123091] Updated weights for policy 0, policy_version 1513616 (0.0009) [2023-12-26 11:40:49,515][123090] Updated weights for policy 1, policy_version 1503528 (0.0009) [2023-12-26 11:40:49,579][123090] Updated weights for policy 1, policy_version 1503538 (0.0010) [2023-12-26 11:40:49,642][123090] Updated weights for policy 1, policy_version 1503548 (0.0010) [2023-12-26 11:40:50,156][123091] Updated weights for policy 0, policy_version 1513626 (0.0009) [2023-12-26 11:40:50,215][123091] Updated weights for policy 0, policy_version 1513636 (0.0010) [2023-12-26 11:40:50,276][123091] Updated weights for policy 0, policy_version 1513646 (0.0009) [2023-12-26 11:40:50,526][123090] Updated weights for policy 1, policy_version 1503558 (0.0009) [2023-12-26 11:40:50,587][123090] Updated weights for policy 1, policy_version 1503568 (0.0009) [2023-12-26 11:40:50,642][123090] Updated weights for policy 1, policy_version 1503578 (0.0010) [2023-12-26 11:40:51,069][123091] Updated weights for policy 0, policy_version 1513656 (0.0009) [2023-12-26 11:40:51,125][123091] Updated weights for policy 0, policy_version 1513666 (0.0010) [2023-12-26 11:40:51,185][123091] Updated weights for policy 0, policy_version 1513676 (0.0009) [2023-12-26 11:40:51,463][123090] Updated weights for policy 1, policy_version 1503588 (0.0009) [2023-12-26 11:40:51,532][123090] Updated weights for policy 1, policy_version 1503598 (0.0009) [2023-12-26 11:40:51,596][123090] Updated weights for policy 1, policy_version 1503608 (0.0009) [2023-12-26 11:40:52,070][123091] Updated weights for policy 0, policy_version 1513686 (0.0010) [2023-12-26 11:40:52,136][123091] Updated weights for policy 0, policy_version 1513696 (0.0009) [2023-12-26 11:40:52,204][123091] Updated weights for policy 0, policy_version 1513706 (0.0006) [2023-12-26 11:40:52,411][123090] Updated weights for policy 1, policy_version 1503618 (0.0009) [2023-12-26 11:40:52,466][123090] Updated weights for policy 1, policy_version 1503628 (0.0009) [2023-12-26 11:40:52,515][123090] Updated weights for policy 1, policy_version 1503638 (0.0009) [2023-12-26 11:40:52,566][123090] Updated weights for policy 1, policy_version 1503648 (0.0008) [2023-12-26 11:40:52,977][123091] Updated weights for policy 0, policy_version 1513716 (0.0008) [2023-12-26 11:40:53,043][123091] Updated weights for policy 0, policy_version 1513726 (0.0006) [2023-12-26 11:40:53,104][123091] Updated weights for policy 0, policy_version 1513736 (0.0005) [2023-12-26 11:40:53,356][123090] Updated weights for policy 1, policy_version 1503658 (0.0010) [2023-12-26 11:40:53,418][123090] Updated weights for policy 1, policy_version 1503668 (0.0010) [2023-12-26 11:40:53,469][123090] Updated weights for policy 1, policy_version 1503678 (0.0010) [2023-12-26 11:40:53,770][123091] Updated weights for policy 0, policy_version 1513746 (0.0005) [2023-12-26 11:40:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 772464640. Throughput: 0: 8943.6, 1: 8654.3. Samples: 772440972. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:53,785][121949] Avg episode reward: [(0, '6151.749'), (1, '5167.283')] [2023-12-26 11:40:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001503680_384942080.pth... [2023-12-26 11:40:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001502656_384679936.pth [2023-12-26 11:40:53,830][123091] Updated weights for policy 0, policy_version 1513756 (0.0006) [2023-12-26 11:40:53,881][123091] Updated weights for policy 0, policy_version 1513766 (0.0005) [2023-12-26 11:40:53,926][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001513776_387530752.pth... [2023-12-26 11:40:53,926][123091] Updated weights for policy 0, policy_version 1513776 (0.0005) [2023-12-26 11:40:53,929][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001512688_387252224.pth [2023-12-26 11:40:54,265][123090] Updated weights for policy 1, policy_version 1503688 (0.0006) [2023-12-26 11:40:54,323][123090] Updated weights for policy 1, policy_version 1503698 (0.0005) [2023-12-26 11:40:54,379][123090] Updated weights for policy 1, policy_version 1503708 (0.0005) [2023-12-26 11:40:54,631][123091] Updated weights for policy 0, policy_version 1513786 (0.0005) [2023-12-26 11:40:54,681][123091] Updated weights for policy 0, policy_version 1513796 (0.0005) [2023-12-26 11:40:54,740][123091] Updated weights for policy 0, policy_version 1513806 (0.0005) [2023-12-26 11:40:55,135][123090] Updated weights for policy 1, policy_version 1503718 (0.0008) [2023-12-26 11:40:55,203][123090] Updated weights for policy 1, policy_version 1503728 (0.0009) [2023-12-26 11:40:55,269][123090] Updated weights for policy 1, policy_version 1503738 (0.0008) [2023-12-26 11:40:55,296][123091] Updated weights for policy 0, policy_version 1513816 (0.0009) [2023-12-26 11:40:55,347][123091] Updated weights for policy 0, policy_version 1513826 (0.0010) [2023-12-26 11:40:55,404][123091] Updated weights for policy 0, policy_version 1513836 (0.0010) [2023-12-26 11:40:56,089][123090] Updated weights for policy 1, policy_version 1503748 (0.0008) [2023-12-26 11:40:56,150][123090] Updated weights for policy 1, policy_version 1503758 (0.0009) [2023-12-26 11:40:56,159][123091] Updated weights for policy 0, policy_version 1513846 (0.0007) [2023-12-26 11:40:56,212][123090] Updated weights for policy 1, policy_version 1503768 (0.0009) [2023-12-26 11:40:56,218][123091] Updated weights for policy 0, policy_version 1513856 (0.0006) [2023-12-26 11:40:56,287][123091] Updated weights for policy 0, policy_version 1513866 (0.0010) [2023-12-26 11:40:57,055][123091] Updated weights for policy 0, policy_version 1513876 (0.0010) [2023-12-26 11:40:57,063][123090] Updated weights for policy 1, policy_version 1503778 (0.0011) [2023-12-26 11:40:57,110][123090] Updated weights for policy 1, policy_version 1503788 (0.0010) [2023-12-26 11:40:57,110][123091] Updated weights for policy 0, policy_version 1513886 (0.0010) [2023-12-26 11:40:57,157][123090] Updated weights for policy 1, policy_version 1503798 (0.0010) [2023-12-26 11:40:57,158][123091] Updated weights for policy 0, policy_version 1513896 (0.0009) [2023-12-26 11:40:57,212][123090] Updated weights for policy 1, policy_version 1503808 (0.0010) [2023-12-26 11:40:57,881][123091] Updated weights for policy 0, policy_version 1513906 (0.0006) [2023-12-26 11:40:57,930][123090] Updated weights for policy 1, policy_version 1503818 (0.0010) [2023-12-26 11:40:57,932][123091] Updated weights for policy 0, policy_version 1513916 (0.0010) [2023-12-26 11:40:57,974][123090] Updated weights for policy 1, policy_version 1503828 (0.0010) [2023-12-26 11:40:57,980][123091] Updated weights for policy 0, policy_version 1513926 (0.0010) [2023-12-26 11:40:58,021][123090] Updated weights for policy 1, policy_version 1503838 (0.0010) [2023-12-26 11:40:58,040][123091] Updated weights for policy 0, policy_version 1513936 (0.0009) [2023-12-26 11:40:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17613.1, 300 sec: 17800.2). Total num frames: 772554752. Throughput: 0: 9048.3, 1: 8678.7. Samples: 772552480. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:40:58,785][121949] Avg episode reward: [(0, '6231.741'), (1, '5318.650')] [2023-12-26 11:40:58,930][123090] Updated weights for policy 1, policy_version 1503848 (0.0007) [2023-12-26 11:40:59,003][123090] Updated weights for policy 1, policy_version 1503858 (0.0008) [2023-12-26 11:40:59,015][123091] Updated weights for policy 0, policy_version 1513946 (0.0008) [2023-12-26 11:40:59,068][123090] Updated weights for policy 1, policy_version 1503868 (0.0008) [2023-12-26 11:40:59,080][123091] Updated weights for policy 0, policy_version 1513956 (0.0007) [2023-12-26 11:40:59,147][123091] Updated weights for policy 0, policy_version 1513966 (0.0008) [2023-12-26 11:40:59,820][123090] Updated weights for policy 1, policy_version 1503878 (0.0008) [2023-12-26 11:40:59,881][123090] Updated weights for policy 1, policy_version 1503888 (0.0009) [2023-12-26 11:40:59,944][123090] Updated weights for policy 1, policy_version 1503898 (0.0008) [2023-12-26 11:40:59,967][123091] Updated weights for policy 0, policy_version 1513976 (0.0010) [2023-12-26 11:41:00,026][123091] Updated weights for policy 0, policy_version 1513986 (0.0011) [2023-12-26 11:41:00,085][123091] Updated weights for policy 0, policy_version 1513996 (0.0010) [2023-12-26 11:41:00,788][123090] Updated weights for policy 1, policy_version 1503908 (0.0008) [2023-12-26 11:41:00,839][123090] Updated weights for policy 1, policy_version 1503918 (0.0009) [2023-12-26 11:41:00,894][123090] Updated weights for policy 1, policy_version 1503928 (0.0009) [2023-12-26 11:41:00,901][123091] Updated weights for policy 0, policy_version 1514006 (0.0010) [2023-12-26 11:41:00,958][123091] Updated weights for policy 0, policy_version 1514016 (0.0010) [2023-12-26 11:41:01,019][123091] Updated weights for policy 0, policy_version 1514026 (0.0010) [2023-12-26 11:41:01,763][123090] Updated weights for policy 1, policy_version 1503938 (0.0007) [2023-12-26 11:41:01,827][123090] Updated weights for policy 1, policy_version 1503948 (0.0008) [2023-12-26 11:41:01,844][123091] Updated weights for policy 0, policy_version 1514036 (0.0010) [2023-12-26 11:41:01,877][123090] Updated weights for policy 1, policy_version 1503958 (0.0009) [2023-12-26 11:41:01,909][123091] Updated weights for policy 0, policy_version 1514046 (0.0009) [2023-12-26 11:41:01,930][123090] Updated weights for policy 1, policy_version 1503968 (0.0008) [2023-12-26 11:41:01,963][123091] Updated weights for policy 0, policy_version 1514056 (0.0009) [2023-12-26 11:41:02,783][123090] Updated weights for policy 1, policy_version 1503978 (0.0010) [2023-12-26 11:41:02,804][123091] Updated weights for policy 0, policy_version 1514066 (0.0008) [2023-12-26 11:41:02,834][123090] Updated weights for policy 1, policy_version 1503988 (0.0009) [2023-12-26 11:41:02,868][123091] Updated weights for policy 0, policy_version 1514076 (0.0008) [2023-12-26 11:41:02,888][123090] Updated weights for policy 1, policy_version 1503998 (0.0008) [2023-12-26 11:41:02,934][123091] Updated weights for policy 0, policy_version 1514086 (0.0010) [2023-12-26 11:41:02,985][123091] Updated weights for policy 0, policy_version 1514096 (0.0009) [2023-12-26 11:41:03,573][123090] Updated weights for policy 1, policy_version 1504008 (0.0005) [2023-12-26 11:41:03,631][123090] Updated weights for policy 1, policy_version 1504018 (0.0005) [2023-12-26 11:41:03,687][123090] Updated weights for policy 1, policy_version 1504028 (0.0005) [2023-12-26 11:41:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 772644864. Throughput: 0: 8979.0, 1: 8634.0. Samples: 772656096. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:03,785][121949] Avg episode reward: [(0, '6274.919'), (1, '5470.085')] [2023-12-26 11:41:03,811][123091] Updated weights for policy 0, policy_version 1514106 (0.0011) [2023-12-26 11:41:03,871][123091] Updated weights for policy 0, policy_version 1514116 (0.0009) [2023-12-26 11:41:03,940][123091] Updated weights for policy 0, policy_version 1514126 (0.0010) [2023-12-26 11:41:04,426][123090] Updated weights for policy 1, policy_version 1504038 (0.0008) [2023-12-26 11:41:04,489][123090] Updated weights for policy 1, policy_version 1504048 (0.0010) [2023-12-26 11:41:04,546][123090] Updated weights for policy 1, policy_version 1504058 (0.0009) [2023-12-26 11:41:04,790][123091] Updated weights for policy 0, policy_version 1514136 (0.0010) [2023-12-26 11:41:04,842][123091] Updated weights for policy 0, policy_version 1514146 (0.0010) [2023-12-26 11:41:04,896][123091] Updated weights for policy 0, policy_version 1514156 (0.0010) [2023-12-26 11:41:05,332][123090] Updated weights for policy 1, policy_version 1504068 (0.0010) [2023-12-26 11:41:05,397][123090] Updated weights for policy 1, policy_version 1504078 (0.0007) [2023-12-26 11:41:05,460][123090] Updated weights for policy 1, policy_version 1504088 (0.0006) [2023-12-26 11:41:05,792][123091] Updated weights for policy 0, policy_version 1514166 (0.0009) [2023-12-26 11:41:05,846][123091] Updated weights for policy 0, policy_version 1514176 (0.0009) [2023-12-26 11:41:05,900][123091] Updated weights for policy 0, policy_version 1514186 (0.0009) [2023-12-26 11:41:06,197][123090] Updated weights for policy 1, policy_version 1504098 (0.0008) [2023-12-26 11:41:06,268][123090] Updated weights for policy 1, policy_version 1504108 (0.0009) [2023-12-26 11:41:06,340][123090] Updated weights for policy 1, policy_version 1504118 (0.0009) [2023-12-26 11:41:06,412][123090] Updated weights for policy 1, policy_version 1504128 (0.0009) [2023-12-26 11:41:06,780][123091] Updated weights for policy 0, policy_version 1514196 (0.0009) [2023-12-26 11:41:06,836][123091] Updated weights for policy 0, policy_version 1514206 (0.0007) [2023-12-26 11:41:06,888][123091] Updated weights for policy 0, policy_version 1514216 (0.0008) [2023-12-26 11:41:07,165][123090] Updated weights for policy 1, policy_version 1504138 (0.0009) [2023-12-26 11:41:07,215][123090] Updated weights for policy 1, policy_version 1504148 (0.0009) [2023-12-26 11:41:07,273][123090] Updated weights for policy 1, policy_version 1504158 (0.0008) [2023-12-26 11:41:07,730][123091] Updated weights for policy 0, policy_version 1514226 (0.0009) [2023-12-26 11:41:07,790][123091] Updated weights for policy 0, policy_version 1514236 (0.0010) [2023-12-26 11:41:07,854][123091] Updated weights for policy 0, policy_version 1514246 (0.0010) [2023-12-26 11:41:07,917][123091] Updated weights for policy 0, policy_version 1514256 (0.0009) [2023-12-26 11:41:08,061][123090] Updated weights for policy 1, policy_version 1504168 (0.0006) [2023-12-26 11:41:08,120][123090] Updated weights for policy 1, policy_version 1504178 (0.0005) [2023-12-26 11:41:08,169][123090] Updated weights for policy 1, policy_version 1504188 (0.0005) [2023-12-26 11:41:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 772726784. Throughput: 0: 8990.5, 1: 8666.5. Samples: 772707952. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:08,785][121949] Avg episode reward: [(0, '6236.689'), (1, '5340.922')] [2023-12-26 11:41:08,801][123091] Updated weights for policy 0, policy_version 1514266 (0.0010) [2023-12-26 11:41:08,826][123090] Updated weights for policy 1, policy_version 1504198 (0.0006) [2023-12-26 11:41:08,867][123091] Updated weights for policy 0, policy_version 1514276 (0.0009) [2023-12-26 11:41:08,875][123090] Updated weights for policy 1, policy_version 1504208 (0.0008) [2023-12-26 11:41:08,931][123090] Updated weights for policy 1, policy_version 1504218 (0.0009) [2023-12-26 11:41:08,933][123091] Updated weights for policy 0, policy_version 1514286 (0.0008) [2023-12-26 11:41:08,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001514288_387661824.pth... [2023-12-26 11:41:08,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001513232_387391488.pth [2023-12-26 11:41:08,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001504224_385081344.pth... [2023-12-26 11:41:08,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001503168_384811008.pth [2023-12-26 11:41:09,767][123090] Updated weights for policy 1, policy_version 1504228 (0.0008) [2023-12-26 11:41:09,791][123091] Updated weights for policy 0, policy_version 1514296 (0.0008) [2023-12-26 11:41:09,827][123090] Updated weights for policy 1, policy_version 1504238 (0.0008) [2023-12-26 11:41:09,863][123091] Updated weights for policy 0, policy_version 1514306 (0.0008) [2023-12-26 11:41:09,896][123090] Updated weights for policy 1, policy_version 1504248 (0.0010) [2023-12-26 11:41:09,930][123091] Updated weights for policy 0, policy_version 1514316 (0.0009) [2023-12-26 11:41:10,716][123090] Updated weights for policy 1, policy_version 1504258 (0.0009) [2023-12-26 11:41:10,763][123091] Updated weights for policy 0, policy_version 1514326 (0.0008) [2023-12-26 11:41:10,779][123090] Updated weights for policy 1, policy_version 1504268 (0.0008) [2023-12-26 11:41:10,825][123091] Updated weights for policy 0, policy_version 1514336 (0.0009) [2023-12-26 11:41:10,840][123090] Updated weights for policy 1, policy_version 1504278 (0.0008) [2023-12-26 11:41:10,892][123091] Updated weights for policy 0, policy_version 1514346 (0.0009) [2023-12-26 11:41:10,900][123090] Updated weights for policy 1, policy_version 1504288 (0.0007) [2023-12-26 11:41:11,653][123091] Updated weights for policy 0, policy_version 1514356 (0.0010) [2023-12-26 11:41:11,724][123091] Updated weights for policy 0, policy_version 1514366 (0.0010) [2023-12-26 11:41:11,798][123091] Updated weights for policy 0, policy_version 1514376 (0.0010) [2023-12-26 11:41:11,815][123090] Updated weights for policy 1, policy_version 1504298 (0.0007) [2023-12-26 11:41:11,872][123090] Updated weights for policy 1, policy_version 1504308 (0.0008) [2023-12-26 11:41:11,940][123090] Updated weights for policy 1, policy_version 1504318 (0.0008) [2023-12-26 11:41:12,684][123091] Updated weights for policy 0, policy_version 1514386 (0.0010) [2023-12-26 11:41:12,738][123091] Updated weights for policy 0, policy_version 1514396 (0.0009) [2023-12-26 11:41:12,761][123090] Updated weights for policy 1, policy_version 1504328 (0.0010) [2023-12-26 11:41:12,794][123091] Updated weights for policy 0, policy_version 1514406 (0.0007) [2023-12-26 11:41:12,814][123090] Updated weights for policy 1, policy_version 1504338 (0.0010) [2023-12-26 11:41:12,846][123091] Updated weights for policy 0, policy_version 1514416 (0.0006) [2023-12-26 11:41:12,866][123090] Updated weights for policy 1, policy_version 1504348 (0.0010) [2023-12-26 11:41:13,636][123091] Updated weights for policy 0, policy_version 1514426 (0.0005) [2023-12-26 11:41:13,690][123091] Updated weights for policy 0, policy_version 1514436 (0.0005) [2023-12-26 11:41:13,697][123090] Updated weights for policy 1, policy_version 1504358 (0.0007) [2023-12-26 11:41:13,743][123091] Updated weights for policy 0, policy_version 1514446 (0.0008) [2023-12-26 11:41:13,761][123090] Updated weights for policy 1, policy_version 1504368 (0.0005) [2023-12-26 11:41:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 772816896. Throughput: 0: 8882.9, 1: 8683.1. Samples: 772810036. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:13,784][121949] Avg episode reward: [(0, '6201.477'), (1, '4804.489')] [2023-12-26 11:41:13,829][123090] Updated weights for policy 1, policy_version 1504378 (0.0008) [2023-12-26 11:41:14,533][123091] Updated weights for policy 0, policy_version 1514456 (0.0009) [2023-12-26 11:41:14,584][123091] Updated weights for policy 0, policy_version 1514466 (0.0006) [2023-12-26 11:41:14,612][123090] Updated weights for policy 1, policy_version 1504388 (0.0009) [2023-12-26 11:41:14,634][123091] Updated weights for policy 0, policy_version 1514476 (0.0005) [2023-12-26 11:41:14,669][123090] Updated weights for policy 1, policy_version 1504398 (0.0005) [2023-12-26 11:41:14,719][123090] Updated weights for policy 1, policy_version 1504408 (0.0005) [2023-12-26 11:41:15,451][123090] Updated weights for policy 1, policy_version 1504418 (0.0006) [2023-12-26 11:41:15,482][123091] Updated weights for policy 0, policy_version 1514486 (0.0008) [2023-12-26 11:41:15,521][123090] Updated weights for policy 1, policy_version 1504428 (0.0005) [2023-12-26 11:41:15,532][123091] Updated weights for policy 0, policy_version 1514496 (0.0009) [2023-12-26 11:41:15,588][123091] Updated weights for policy 0, policy_version 1514506 (0.0007) [2023-12-26 11:41:15,589][123090] Updated weights for policy 1, policy_version 1504438 (0.0005) [2023-12-26 11:41:15,659][123090] Updated weights for policy 1, policy_version 1504448 (0.0005) [2023-12-26 11:41:16,380][123090] Updated weights for policy 1, policy_version 1504458 (0.0005) [2023-12-26 11:41:16,434][123090] Updated weights for policy 1, policy_version 1504468 (0.0005) [2023-12-26 11:41:16,442][123091] Updated weights for policy 0, policy_version 1514516 (0.0008) [2023-12-26 11:41:16,485][123090] Updated weights for policy 1, policy_version 1504478 (0.0008) [2023-12-26 11:41:16,488][123091] Updated weights for policy 0, policy_version 1514526 (0.0008) [2023-12-26 11:41:16,541][123091] Updated weights for policy 0, policy_version 1514536 (0.0009) [2023-12-26 11:41:17,233][123090] Updated weights for policy 1, policy_version 1504488 (0.0006) [2023-12-26 11:41:17,274][123091] Updated weights for policy 0, policy_version 1514546 (0.0009) [2023-12-26 11:41:17,279][123090] Updated weights for policy 1, policy_version 1504498 (0.0005) [2023-12-26 11:41:17,325][123091] Updated weights for policy 0, policy_version 1514556 (0.0007) [2023-12-26 11:41:17,329][123090] Updated weights for policy 1, policy_version 1504508 (0.0007) [2023-12-26 11:41:17,371][123091] Updated weights for policy 0, policy_version 1514566 (0.0005) [2023-12-26 11:41:17,424][123091] Updated weights for policy 0, policy_version 1514576 (0.0005) [2023-12-26 11:41:18,083][123091] Updated weights for policy 0, policy_version 1514586 (0.0010) [2023-12-26 11:41:18,139][123091] Updated weights for policy 0, policy_version 1514596 (0.0007) [2023-12-26 11:41:18,190][123091] Updated weights for policy 0, policy_version 1514606 (0.0009) [2023-12-26 11:41:18,231][123090] Updated weights for policy 1, policy_version 1504518 (0.0008) [2023-12-26 11:41:18,299][123090] Updated weights for policy 1, policy_version 1504528 (0.0010) [2023-12-26 11:41:18,362][123090] Updated weights for policy 1, policy_version 1504538 (0.0008) [2023-12-26 11:41:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 772907008. Throughput: 0: 8899.8, 1: 8710.5. Samples: 772918444. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:18,785][121949] Avg episode reward: [(0, '6271.806'), (1, '4756.613')] [2023-12-26 11:41:19,052][123091] Updated weights for policy 0, policy_version 1514616 (0.0009) [2023-12-26 11:41:19,121][123091] Updated weights for policy 0, policy_version 1514626 (0.0008) [2023-12-26 11:41:19,170][123090] Updated weights for policy 1, policy_version 1504548 (0.0007) [2023-12-26 11:41:19,189][123091] Updated weights for policy 0, policy_version 1514636 (0.0008) [2023-12-26 11:41:19,238][123090] Updated weights for policy 1, policy_version 1504558 (0.0008) [2023-12-26 11:41:19,315][123090] Updated weights for policy 1, policy_version 1504568 (0.0009) [2023-12-26 11:41:19,986][123091] Updated weights for policy 0, policy_version 1514646 (0.0009) [2023-12-26 11:41:20,053][123091] Updated weights for policy 0, policy_version 1514656 (0.0009) [2023-12-26 11:41:20,077][123090] Updated weights for policy 1, policy_version 1504578 (0.0009) [2023-12-26 11:41:20,113][123091] Updated weights for policy 0, policy_version 1514666 (0.0008) [2023-12-26 11:41:20,146][123090] Updated weights for policy 1, policy_version 1504588 (0.0010) [2023-12-26 11:41:20,216][123090] Updated weights for policy 1, policy_version 1504598 (0.0009) [2023-12-26 11:41:20,287][123090] Updated weights for policy 1, policy_version 1504608 (0.0010) [2023-12-26 11:41:20,910][123091] Updated weights for policy 0, policy_version 1514676 (0.0007) [2023-12-26 11:41:20,975][123091] Updated weights for policy 0, policy_version 1514686 (0.0010) [2023-12-26 11:41:21,044][123091] Updated weights for policy 0, policy_version 1514696 (0.0011) [2023-12-26 11:41:21,132][123090] Updated weights for policy 1, policy_version 1504618 (0.0008) [2023-12-26 11:41:21,197][123090] Updated weights for policy 1, policy_version 1504628 (0.0009) [2023-12-26 11:41:21,254][123090] Updated weights for policy 1, policy_version 1504638 (0.0009) [2023-12-26 11:41:21,828][123091] Updated weights for policy 0, policy_version 1514706 (0.0010) [2023-12-26 11:41:21,897][123091] Updated weights for policy 0, policy_version 1514716 (0.0009) [2023-12-26 11:41:21,960][123091] Updated weights for policy 0, policy_version 1514726 (0.0011) [2023-12-26 11:41:22,020][123091] Updated weights for policy 0, policy_version 1514736 (0.0011) [2023-12-26 11:41:22,147][123090] Updated weights for policy 1, policy_version 1504648 (0.0008) [2023-12-26 11:41:22,203][123090] Updated weights for policy 1, policy_version 1504658 (0.0010) [2023-12-26 11:41:22,290][123090] Updated weights for policy 1, policy_version 1504668 (0.0010) [2023-12-26 11:41:22,840][123091] Updated weights for policy 0, policy_version 1514746 (0.0009) [2023-12-26 11:41:22,911][123091] Updated weights for policy 0, policy_version 1514756 (0.0009) [2023-12-26 11:41:22,971][123091] Updated weights for policy 0, policy_version 1514766 (0.0009) [2023-12-26 11:41:23,050][123090] Updated weights for policy 1, policy_version 1504678 (0.0010) [2023-12-26 11:41:23,120][123090] Updated weights for policy 1, policy_version 1504688 (0.0010) [2023-12-26 11:41:23,173][123090] Updated weights for policy 1, policy_version 1504698 (0.0009) [2023-12-26 11:41:23,749][123091] Updated weights for policy 0, policy_version 1514776 (0.0009) [2023-12-26 11:41:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 772988928. Throughput: 0: 8852.0, 1: 8696.7. Samples: 772969980. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:23,785][121949] Avg episode reward: [(0, '6357.908'), (1, '5152.553')] [2023-12-26 11:41:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001504704_385204224.pth... [2023-12-26 11:41:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001503680_384942080.pth [2023-12-26 11:41:23,816][123091] Updated weights for policy 0, policy_version 1514786 (0.0009) [2023-12-26 11:41:23,868][123091] Updated weights for policy 0, policy_version 1514796 (0.0010) [2023-12-26 11:41:23,890][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001514800_387792896.pth... [2023-12-26 11:41:23,893][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001513776_387530752.pth [2023-12-26 11:41:23,940][123090] Updated weights for policy 1, policy_version 1504708 (0.0007) [2023-12-26 11:41:23,993][123090] Updated weights for policy 1, policy_version 1504718 (0.0010) [2023-12-26 11:41:24,048][123090] Updated weights for policy 1, policy_version 1504728 (0.0008) [2023-12-26 11:41:24,649][123091] Updated weights for policy 0, policy_version 1514806 (0.0006) [2023-12-26 11:41:24,707][123091] Updated weights for policy 0, policy_version 1514816 (0.0005) [2023-12-26 11:41:24,765][123091] Updated weights for policy 0, policy_version 1514826 (0.0006) [2023-12-26 11:41:24,902][123090] Updated weights for policy 1, policy_version 1504738 (0.0010) [2023-12-26 11:41:24,964][123090] Updated weights for policy 1, policy_version 1504748 (0.0009) [2023-12-26 11:41:25,013][123090] Updated weights for policy 1, policy_version 1504758 (0.0005) [2023-12-26 11:41:25,071][123090] Updated weights for policy 1, policy_version 1504768 (0.0005) [2023-12-26 11:41:25,561][123091] Updated weights for policy 0, policy_version 1514836 (0.0008) [2023-12-26 11:41:25,611][123091] Updated weights for policy 0, policy_version 1514846 (0.0005) [2023-12-26 11:41:25,667][123091] Updated weights for policy 0, policy_version 1514856 (0.0006) [2023-12-26 11:41:25,785][123090] Updated weights for policy 1, policy_version 1504778 (0.0006) [2023-12-26 11:41:25,834][123090] Updated weights for policy 1, policy_version 1504789 (0.0006) [2023-12-26 11:41:25,893][123090] Updated weights for policy 1, policy_version 1504799 (0.0006) [2023-12-26 11:41:26,424][123091] Updated weights for policy 0, policy_version 1514866 (0.0006) [2023-12-26 11:41:26,475][123091] Updated weights for policy 0, policy_version 1514876 (0.0005) [2023-12-26 11:41:26,536][123091] Updated weights for policy 0, policy_version 1514886 (0.0005) [2023-12-26 11:41:26,592][123091] Updated weights for policy 0, policy_version 1514896 (0.0006) [2023-12-26 11:41:26,632][123090] Updated weights for policy 1, policy_version 1504809 (0.0006) [2023-12-26 11:41:26,693][123090] Updated weights for policy 1, policy_version 1504819 (0.0009) [2023-12-26 11:41:26,752][123090] Updated weights for policy 1, policy_version 1504829 (0.0009) [2023-12-26 11:41:27,203][123091] Updated weights for policy 0, policy_version 1514906 (0.0010) [2023-12-26 11:41:27,280][123091] Updated weights for policy 0, policy_version 1514916 (0.0009) [2023-12-26 11:41:27,344][123091] Updated weights for policy 0, policy_version 1514926 (0.0010) [2023-12-26 11:41:27,452][123090] Updated weights for policy 1, policy_version 1504839 (0.0009) [2023-12-26 11:41:27,517][123090] Updated weights for policy 1, policy_version 1504849 (0.0008) [2023-12-26 11:41:27,585][123090] Updated weights for policy 1, policy_version 1504859 (0.0010) [2023-12-26 11:41:28,156][123091] Updated weights for policy 0, policy_version 1514936 (0.0008) [2023-12-26 11:41:28,207][123091] Updated weights for policy 0, policy_version 1514946 (0.0006) [2023-12-26 11:41:28,273][123091] Updated weights for policy 0, policy_version 1514956 (0.0006) [2023-12-26 11:41:28,344][123090] Updated weights for policy 1, policy_version 1504869 (0.0009) [2023-12-26 11:41:28,412][123090] Updated weights for policy 1, policy_version 1504879 (0.0009) [2023-12-26 11:41:28,470][123090] Updated weights for policy 1, policy_version 1504889 (0.0009) [2023-12-26 11:41:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 773087232. Throughput: 0: 8889.0, 1: 8804.0. Samples: 773079728. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:28,785][121949] Avg episode reward: [(0, '6409.958'), (1, '5286.248')] [2023-12-26 11:41:28,899][123091] Updated weights for policy 0, policy_version 1514966 (0.0007) [2023-12-26 11:41:28,961][123091] Updated weights for policy 0, policy_version 1514976 (0.0005) [2023-12-26 11:41:29,034][123091] Updated weights for policy 0, policy_version 1514986 (0.0006) [2023-12-26 11:41:29,348][123090] Updated weights for policy 1, policy_version 1504899 (0.0010) [2023-12-26 11:41:29,424][123090] Updated weights for policy 1, policy_version 1504909 (0.0011) [2023-12-26 11:41:29,486][123090] Updated weights for policy 1, policy_version 1504919 (0.0010) [2023-12-26 11:41:29,750][123091] Updated weights for policy 0, policy_version 1514996 (0.0007) [2023-12-26 11:41:29,809][123091] Updated weights for policy 0, policy_version 1515006 (0.0009) [2023-12-26 11:41:29,875][123091] Updated weights for policy 0, policy_version 1515016 (0.0009) [2023-12-26 11:41:30,292][123090] Updated weights for policy 1, policy_version 1504929 (0.0010) [2023-12-26 11:41:30,349][123090] Updated weights for policy 1, policy_version 1504939 (0.0006) [2023-12-26 11:41:30,410][123090] Updated weights for policy 1, policy_version 1504949 (0.0008) [2023-12-26 11:41:30,470][123090] Updated weights for policy 1, policy_version 1504959 (0.0005) [2023-12-26 11:41:30,705][123091] Updated weights for policy 0, policy_version 1515026 (0.0008) [2023-12-26 11:41:30,757][123091] Updated weights for policy 0, policy_version 1515036 (0.0005) [2023-12-26 11:41:30,819][123091] Updated weights for policy 0, policy_version 1515046 (0.0006) [2023-12-26 11:41:30,884][123091] Updated weights for policy 0, policy_version 1515056 (0.0007) [2023-12-26 11:41:31,224][123090] Updated weights for policy 1, policy_version 1504969 (0.0009) [2023-12-26 11:41:31,285][123090] Updated weights for policy 1, policy_version 1504979 (0.0009) [2023-12-26 11:41:31,354][123090] Updated weights for policy 1, policy_version 1504989 (0.0009) [2023-12-26 11:41:31,609][123091] Updated weights for policy 0, policy_version 1515066 (0.0009) [2023-12-26 11:41:31,681][123091] Updated weights for policy 0, policy_version 1515076 (0.0007) [2023-12-26 11:41:31,749][123091] Updated weights for policy 0, policy_version 1515086 (0.0009) [2023-12-26 11:41:32,230][123090] Updated weights for policy 1, policy_version 1504999 (0.0010) [2023-12-26 11:41:32,286][123090] Updated weights for policy 1, policy_version 1505009 (0.0009) [2023-12-26 11:41:32,348][123090] Updated weights for policy 1, policy_version 1505019 (0.0009) [2023-12-26 11:41:32,348][123091] Updated weights for policy 0, policy_version 1515096 (0.0009) [2023-12-26 11:41:32,413][123091] Updated weights for policy 0, policy_version 1515106 (0.0008) [2023-12-26 11:41:32,474][123091] Updated weights for policy 0, policy_version 1515116 (0.0007) [2023-12-26 11:41:33,196][123091] Updated weights for policy 0, policy_version 1515126 (0.0009) [2023-12-26 11:41:33,232][123090] Updated weights for policy 1, policy_version 1505029 (0.0008) [2023-12-26 11:41:33,252][123091] Updated weights for policy 0, policy_version 1515136 (0.0008) [2023-12-26 11:41:33,297][123090] Updated weights for policy 1, policy_version 1505039 (0.0007) [2023-12-26 11:41:33,310][123091] Updated weights for policy 0, policy_version 1515146 (0.0010) [2023-12-26 11:41:33,360][123090] Updated weights for policy 1, policy_version 1505049 (0.0008) [2023-12-26 11:41:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 773177344. Throughput: 0: 8922.0, 1: 8799.6. Samples: 773187648. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:33,785][121949] Avg episode reward: [(0, '6401.236'), (1, '4950.998')] [2023-12-26 11:41:34,140][123091] Updated weights for policy 0, policy_version 1515156 (0.0010) [2023-12-26 11:41:34,174][123090] Updated weights for policy 1, policy_version 1505059 (0.0009) [2023-12-26 11:41:34,203][123091] Updated weights for policy 0, policy_version 1515166 (0.0008) [2023-12-26 11:41:34,238][123090] Updated weights for policy 1, policy_version 1505069 (0.0008) [2023-12-26 11:41:34,258][123091] Updated weights for policy 0, policy_version 1515176 (0.0009) [2023-12-26 11:41:34,302][123090] Updated weights for policy 1, policy_version 1505079 (0.0008) [2023-12-26 11:41:35,083][123090] Updated weights for policy 1, policy_version 1505089 (0.0009) [2023-12-26 11:41:35,138][123090] Updated weights for policy 1, policy_version 1505099 (0.0008) [2023-12-26 11:41:35,142][123091] Updated weights for policy 0, policy_version 1515186 (0.0008) [2023-12-26 11:41:35,195][123091] Updated weights for policy 0, policy_version 1515196 (0.0009) [2023-12-26 11:41:35,206][123090] Updated weights for policy 1, policy_version 1505109 (0.0006) [2023-12-26 11:41:35,258][123091] Updated weights for policy 0, policy_version 1515206 (0.0009) [2023-12-26 11:41:35,267][123090] Updated weights for policy 1, policy_version 1505119 (0.0009) [2023-12-26 11:41:35,317][123091] Updated weights for policy 0, policy_version 1515216 (0.0008) [2023-12-26 11:41:36,000][123090] Updated weights for policy 1, policy_version 1505129 (0.0006) [2023-12-26 11:41:36,071][123090] Updated weights for policy 1, policy_version 1505139 (0.0006) [2023-12-26 11:41:36,145][123090] Updated weights for policy 1, policy_version 1505150 (0.0007) [2023-12-26 11:41:36,188][123091] Updated weights for policy 0, policy_version 1515226 (0.0010) [2023-12-26 11:41:36,242][123091] Updated weights for policy 0, policy_version 1515236 (0.0009) [2023-12-26 11:41:36,304][123091] Updated weights for policy 0, policy_version 1515246 (0.0010) [2023-12-26 11:41:36,812][123090] Updated weights for policy 1, policy_version 1505160 (0.0007) [2023-12-26 11:41:36,867][123090] Updated weights for policy 1, policy_version 1505170 (0.0005) [2023-12-26 11:41:36,935][123090] Updated weights for policy 1, policy_version 1505180 (0.0006) [2023-12-26 11:41:37,229][123091] Updated weights for policy 0, policy_version 1515256 (0.0010) [2023-12-26 11:41:37,292][123091] Updated weights for policy 0, policy_version 1515266 (0.0010) [2023-12-26 11:41:37,362][123091] Updated weights for policy 0, policy_version 1515276 (0.0005) [2023-12-26 11:41:37,737][123090] Updated weights for policy 1, policy_version 1505190 (0.0010) [2023-12-26 11:41:37,805][123090] Updated weights for policy 1, policy_version 1505200 (0.0011) [2023-12-26 11:41:37,872][123090] Updated weights for policy 1, policy_version 1505210 (0.0011) [2023-12-26 11:41:37,992][123091] Updated weights for policy 0, policy_version 1515286 (0.0008) [2023-12-26 11:41:38,052][123091] Updated weights for policy 0, policy_version 1515296 (0.0011) [2023-12-26 11:41:38,115][123091] Updated weights for policy 0, policy_version 1515306 (0.0010) [2023-12-26 11:41:38,616][123090] Updated weights for policy 1, policy_version 1505220 (0.0008) [2023-12-26 11:41:38,679][123090] Updated weights for policy 1, policy_version 1505230 (0.0010) [2023-12-26 11:41:38,742][123090] Updated weights for policy 1, policy_version 1505240 (0.0010) [2023-12-26 11:41:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 773267456. Throughput: 0: 8888.2, 1: 8866.3. Samples: 773239924. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:38,784][121949] Avg episode reward: [(0, '6396.562'), (1, '4708.210')] [2023-12-26 11:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001515312_387923968.pth... [2023-12-26 11:41:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001505248_385343488.pth... [2023-12-26 11:41:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001514288_387661824.pth [2023-12-26 11:41:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001504224_385081344.pth [2023-12-26 11:41:38,877][123091] Updated weights for policy 0, policy_version 1515316 (0.0007) [2023-12-26 11:41:38,945][123091] Updated weights for policy 0, policy_version 1515326 (0.0009) [2023-12-26 11:41:39,014][123091] Updated weights for policy 0, policy_version 1515336 (0.0009) [2023-12-26 11:41:39,552][123090] Updated weights for policy 1, policy_version 1505250 (0.0010) [2023-12-26 11:41:39,616][123090] Updated weights for policy 1, policy_version 1505260 (0.0006) [2023-12-26 11:41:39,684][123090] Updated weights for policy 1, policy_version 1505270 (0.0006) [2023-12-26 11:41:39,754][123090] Updated weights for policy 1, policy_version 1505280 (0.0011) [2023-12-26 11:41:39,890][123091] Updated weights for policy 0, policy_version 1515346 (0.0009) [2023-12-26 11:41:39,965][123091] Updated weights for policy 0, policy_version 1515356 (0.0010) [2023-12-26 11:41:40,026][123091] Updated weights for policy 0, policy_version 1515366 (0.0008) [2023-12-26 11:41:40,089][123091] Updated weights for policy 0, policy_version 1515376 (0.0009) [2023-12-26 11:41:40,559][123090] Updated weights for policy 1, policy_version 1505290 (0.0010) [2023-12-26 11:41:40,629][123090] Updated weights for policy 1, policy_version 1505300 (0.0010) [2023-12-26 11:41:40,696][123090] Updated weights for policy 1, policy_version 1505310 (0.0010) [2023-12-26 11:41:40,927][123091] Updated weights for policy 0, policy_version 1515386 (0.0009) [2023-12-26 11:41:40,982][123091] Updated weights for policy 0, policy_version 1515396 (0.0009) [2023-12-26 11:41:41,051][123091] Updated weights for policy 0, policy_version 1515406 (0.0008) [2023-12-26 11:41:41,496][123090] Updated weights for policy 1, policy_version 1505320 (0.0010) [2023-12-26 11:41:41,561][123090] Updated weights for policy 1, policy_version 1505330 (0.0009) [2023-12-26 11:41:41,632][123090] Updated weights for policy 1, policy_version 1505340 (0.0010) [2023-12-26 11:41:41,945][123091] Updated weights for policy 0, policy_version 1515416 (0.0009) [2023-12-26 11:41:42,013][123091] Updated weights for policy 0, policy_version 1515426 (0.0009) [2023-12-26 11:41:42,081][123091] Updated weights for policy 0, policy_version 1515436 (0.0009) [2023-12-26 11:41:42,379][123090] Updated weights for policy 1, policy_version 1505350 (0.0008) [2023-12-26 11:41:42,435][123090] Updated weights for policy 1, policy_version 1505360 (0.0008) [2023-12-26 11:41:42,483][123090] Updated weights for policy 1, policy_version 1505370 (0.0008) [2023-12-26 11:41:42,979][123091] Updated weights for policy 0, policy_version 1515446 (0.0009) [2023-12-26 11:41:43,031][123091] Updated weights for policy 0, policy_version 1515456 (0.0009) [2023-12-26 11:41:43,083][123091] Updated weights for policy 0, policy_version 1515466 (0.0010) [2023-12-26 11:41:43,165][123090] Updated weights for policy 1, policy_version 1505380 (0.0007) [2023-12-26 11:41:43,228][123090] Updated weights for policy 1, policy_version 1505390 (0.0006) [2023-12-26 11:41:43,286][123090] Updated weights for policy 1, policy_version 1505400 (0.0009) [2023-12-26 11:41:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 773349376. Throughput: 0: 8732.3, 1: 8862.3. Samples: 773344240. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:43,785][121949] Avg episode reward: [(0, '6305.876'), (1, '5112.942')] [2023-12-26 11:41:43,961][123091] Updated weights for policy 0, policy_version 1515476 (0.0009) [2023-12-26 11:41:44,019][123091] Updated weights for policy 0, policy_version 1515486 (0.0010) [2023-12-26 11:41:44,040][123090] Updated weights for policy 1, policy_version 1505410 (0.0010) [2023-12-26 11:41:44,088][123091] Updated weights for policy 0, policy_version 1515496 (0.0008) [2023-12-26 11:41:44,111][123090] Updated weights for policy 1, policy_version 1505420 (0.0006) [2023-12-26 11:41:44,172][123090] Updated weights for policy 1, policy_version 1505430 (0.0006) [2023-12-26 11:41:44,228][123090] Updated weights for policy 1, policy_version 1505440 (0.0010) [2023-12-26 11:41:44,942][123091] Updated weights for policy 0, policy_version 1515506 (0.0010) [2023-12-26 11:41:45,011][123091] Updated weights for policy 0, policy_version 1515516 (0.0008) [2023-12-26 11:41:45,031][123090] Updated weights for policy 1, policy_version 1505450 (0.0010) [2023-12-26 11:41:45,082][123091] Updated weights for policy 0, policy_version 1515526 (0.0006) [2023-12-26 11:41:45,092][123090] Updated weights for policy 1, policy_version 1505460 (0.0011) [2023-12-26 11:41:45,146][123091] Updated weights for policy 0, policy_version 1515536 (0.0006) [2023-12-26 11:41:45,156][123090] Updated weights for policy 1, policy_version 1505470 (0.0011) [2023-12-26 11:41:45,958][123091] Updated weights for policy 0, policy_version 1515546 (0.0009) [2023-12-26 11:41:45,973][123090] Updated weights for policy 1, policy_version 1505480 (0.0011) [2023-12-26 11:41:46,009][123091] Updated weights for policy 0, policy_version 1515556 (0.0005) [2023-12-26 11:41:46,025][123090] Updated weights for policy 1, policy_version 1505490 (0.0010) [2023-12-26 11:41:46,057][123091] Updated weights for policy 0, policy_version 1515566 (0.0007) [2023-12-26 11:41:46,081][123090] Updated weights for policy 1, policy_version 1505500 (0.0010) [2023-12-26 11:41:46,828][123091] Updated weights for policy 0, policy_version 1515576 (0.0005) [2023-12-26 11:41:46,881][123091] Updated weights for policy 0, policy_version 1515586 (0.0005) [2023-12-26 11:41:46,935][123091] Updated weights for policy 0, policy_version 1515596 (0.0005) [2023-12-26 11:41:46,943][123090] Updated weights for policy 1, policy_version 1505510 (0.0011) [2023-12-26 11:41:46,999][123090] Updated weights for policy 1, policy_version 1505520 (0.0011) [2023-12-26 11:41:47,047][123090] Updated weights for policy 1, policy_version 1505530 (0.0010) [2023-12-26 11:41:47,655][123091] Updated weights for policy 0, policy_version 1515606 (0.0007) [2023-12-26 11:41:47,702][123091] Updated weights for policy 0, policy_version 1515616 (0.0009) [2023-12-26 11:41:47,755][123091] Updated weights for policy 0, policy_version 1515626 (0.0009) [2023-12-26 11:41:47,859][123090] Updated weights for policy 1, policy_version 1505540 (0.0010) [2023-12-26 11:41:47,911][123090] Updated weights for policy 1, policy_version 1505550 (0.0009) [2023-12-26 11:41:47,959][123090] Updated weights for policy 1, policy_version 1505560 (0.0009) [2023-12-26 11:41:48,651][123091] Updated weights for policy 0, policy_version 1515636 (0.0009) [2023-12-26 11:41:48,721][123091] Updated weights for policy 0, policy_version 1515646 (0.0009) [2023-12-26 11:41:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 773431296. Throughput: 0: 8765.7, 1: 8854.9. Samples: 773449024. Policy #0 lag: (min: 43.0, avg: 47.9, max: 48.0) [2023-12-26 11:41:48,785][121949] Avg episode reward: [(0, '6270.391'), (1, '4703.340')] [2023-12-26 11:41:48,793][123091] Updated weights for policy 0, policy_version 1515656 (0.0009) [2023-12-26 11:41:48,869][123090] Updated weights for policy 1, policy_version 1505570 (0.0009) [2023-12-26 11:41:48,935][123090] Updated weights for policy 1, policy_version 1505580 (0.0009) [2023-12-26 11:41:48,994][123090] Updated weights for policy 1, policy_version 1505590 (0.0009) [2023-12-26 11:41:49,051][123090] Updated weights for policy 1, policy_version 1505600 (0.0010) [2023-12-26 11:41:49,637][123091] Updated weights for policy 0, policy_version 1515666 (0.0009) [2023-12-26 11:41:49,693][123091] Updated weights for policy 0, policy_version 1515676 (0.0010) [2023-12-26 11:41:49,757][123091] Updated weights for policy 0, policy_version 1515686 (0.0009) [2023-12-26 11:41:49,811][123091] Updated weights for policy 0, policy_version 1515696 (0.0009) [2023-12-26 11:41:49,903][123090] Updated weights for policy 1, policy_version 1505610 (0.0009) [2023-12-26 11:41:49,970][123090] Updated weights for policy 1, policy_version 1505620 (0.0010) [2023-12-26 11:41:50,023][123090] Updated weights for policy 1, policy_version 1505630 (0.0008) [2023-12-26 11:41:50,642][123091] Updated weights for policy 0, policy_version 1515706 (0.0011) [2023-12-26 11:41:50,712][123091] Updated weights for policy 0, policy_version 1515716 (0.0011) [2023-12-26 11:41:50,780][123091] Updated weights for policy 0, policy_version 1515726 (0.0011) [2023-12-26 11:41:50,843][123090] Updated weights for policy 1, policy_version 1505640 (0.0010) [2023-12-26 11:41:50,915][123090] Updated weights for policy 1, policy_version 1505650 (0.0010) [2023-12-26 11:41:50,987][123090] Updated weights for policy 1, policy_version 1505660 (0.0010) [2023-12-26 11:41:51,490][123091] Updated weights for policy 0, policy_version 1515736 (0.0008) [2023-12-26 11:41:51,546][123091] Updated weights for policy 0, policy_version 1515746 (0.0008) [2023-12-26 11:41:51,602][123091] Updated weights for policy 0, policy_version 1515756 (0.0008) [2023-12-26 11:41:51,899][123090] Updated weights for policy 1, policy_version 1505670 (0.0009) [2023-12-26 11:41:51,966][123090] Updated weights for policy 1, policy_version 1505680 (0.0009) [2023-12-26 11:41:52,025][123090] Updated weights for policy 1, policy_version 1505690 (0.0009) [2023-12-26 11:41:52,378][123091] Updated weights for policy 0, policy_version 1515766 (0.0008) [2023-12-26 11:41:52,426][123091] Updated weights for policy 0, policy_version 1515776 (0.0008) [2023-12-26 11:41:52,474][123091] Updated weights for policy 0, policy_version 1515786 (0.0008) [2023-12-26 11:41:52,869][123090] Updated weights for policy 1, policy_version 1505700 (0.0010) [2023-12-26 11:41:52,928][123090] Updated weights for policy 1, policy_version 1505710 (0.0010) [2023-12-26 11:41:52,991][123090] Updated weights for policy 1, policy_version 1505720 (0.0010) [2023-12-26 11:41:53,279][123091] Updated weights for policy 0, policy_version 1515796 (0.0007) [2023-12-26 11:41:53,341][123091] Updated weights for policy 0, policy_version 1515806 (0.0005) [2023-12-26 11:41:53,409][123091] Updated weights for policy 0, policy_version 1515816 (0.0005) [2023-12-26 11:41:53,584][123090] Updated weights for policy 1, policy_version 1505730 (0.0006) [2023-12-26 11:41:53,643][123090] Updated weights for policy 1, policy_version 1505740 (0.0006) [2023-12-26 11:41:53,696][123090] Updated weights for policy 1, policy_version 1505750 (0.0005) [2023-12-26 11:41:53,753][123090] Updated weights for policy 1, policy_version 1505760 (0.0005) [2023-12-26 11:41:53,785][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 773529600. Throughput: 0: 8784.2, 1: 8812.6. Samples: 773499816. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:41:53,786][121949] Avg episode reward: [(0, '6332.991'), (1, '4848.854')] [2023-12-26 11:41:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001515824_388055040.pth... [2023-12-26 11:41:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001505760_385474560.pth... [2023-12-26 11:41:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001504704_385204224.pth [2023-12-26 11:41:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001514800_387792896.pth [2023-12-26 11:41:54,155][123091] Updated weights for policy 0, policy_version 1515826 (0.0006) [2023-12-26 11:41:54,213][123091] Updated weights for policy 0, policy_version 1515836 (0.0007) [2023-12-26 11:41:54,269][123091] Updated weights for policy 0, policy_version 1515846 (0.0006) [2023-12-26 11:41:54,327][123091] Updated weights for policy 0, policy_version 1515856 (0.0006) [2023-12-26 11:41:54,413][123090] Updated weights for policy 1, policy_version 1505770 (0.0006) [2023-12-26 11:41:54,464][123090] Updated weights for policy 1, policy_version 1505780 (0.0006) [2023-12-26 11:41:54,521][123090] Updated weights for policy 1, policy_version 1505790 (0.0005) [2023-12-26 11:41:55,117][123091] Updated weights for policy 0, policy_version 1515866 (0.0010) [2023-12-26 11:41:55,179][123091] Updated weights for policy 0, policy_version 1515876 (0.0009) [2023-12-26 11:41:55,228][123091] Updated weights for policy 0, policy_version 1515886 (0.0009) [2023-12-26 11:41:55,273][123090] Updated weights for policy 1, policy_version 1505800 (0.0008) [2023-12-26 11:41:55,339][123090] Updated weights for policy 1, policy_version 1505810 (0.0006) [2023-12-26 11:41:55,406][123090] Updated weights for policy 1, policy_version 1505820 (0.0005) [2023-12-26 11:41:55,967][123091] Updated weights for policy 0, policy_version 1515896 (0.0007) [2023-12-26 11:41:56,024][123091] Updated weights for policy 0, policy_version 1515906 (0.0008) [2023-12-26 11:41:56,048][123090] Updated weights for policy 1, policy_version 1505830 (0.0008) [2023-12-26 11:41:56,078][123091] Updated weights for policy 0, policy_version 1515916 (0.0007) [2023-12-26 11:41:56,109][123090] Updated weights for policy 1, policy_version 1505840 (0.0007) [2023-12-26 11:41:56,171][123090] Updated weights for policy 1, policy_version 1505850 (0.0008) [2023-12-26 11:41:56,830][123091] Updated weights for policy 0, policy_version 1515926 (0.0006) [2023-12-26 11:41:56,887][123091] Updated weights for policy 0, policy_version 1515936 (0.0005) [2023-12-26 11:41:56,904][123090] Updated weights for policy 1, policy_version 1505860 (0.0008) [2023-12-26 11:41:56,959][123091] Updated weights for policy 0, policy_version 1515946 (0.0005) [2023-12-26 11:41:56,966][123090] Updated weights for policy 1, policy_version 1505870 (0.0005) [2023-12-26 11:41:57,016][123090] Updated weights for policy 1, policy_version 1505880 (0.0005) [2023-12-26 11:41:57,612][123091] Updated weights for policy 0, policy_version 1515956 (0.0005) [2023-12-26 11:41:57,671][123091] Updated weights for policy 0, policy_version 1515966 (0.0005) [2023-12-26 11:41:57,698][123090] Updated weights for policy 1, policy_version 1505890 (0.0005) [2023-12-26 11:41:57,731][123091] Updated weights for policy 0, policy_version 1515976 (0.0005) [2023-12-26 11:41:57,749][123090] Updated weights for policy 1, policy_version 1505900 (0.0006) [2023-12-26 11:41:57,821][123090] Updated weights for policy 1, policy_version 1505910 (0.0008) [2023-12-26 11:41:57,893][123090] Updated weights for policy 1, policy_version 1505920 (0.0009) [2023-12-26 11:41:58,535][123091] Updated weights for policy 0, policy_version 1515986 (0.0007) [2023-12-26 11:41:58,592][123091] Updated weights for policy 0, policy_version 1515996 (0.0011) [2023-12-26 11:41:58,668][123090] Updated weights for policy 1, policy_version 1505930 (0.0007) [2023-12-26 11:41:58,668][123091] Updated weights for policy 0, policy_version 1516006 (0.0010) [2023-12-26 11:41:58,731][123091] Updated weights for policy 0, policy_version 1516016 (0.0007) [2023-12-26 11:41:58,734][123090] Updated weights for policy 1, policy_version 1505941 (0.0011) [2023-12-26 11:41:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 773619712. Throughput: 0: 8930.8, 1: 8941.9. Samples: 773614312. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:41:58,785][121949] Avg episode reward: [(0, '6311.756'), (1, '5438.416')] [2023-12-26 11:41:58,799][123090] Updated weights for policy 1, policy_version 1505951 (0.0008) [2023-12-26 11:41:59,625][123091] Updated weights for policy 0, policy_version 1516026 (0.0005) [2023-12-26 11:41:59,688][123091] Updated weights for policy 0, policy_version 1516036 (0.0006) [2023-12-26 11:41:59,705][123090] Updated weights for policy 1, policy_version 1505961 (0.0009) [2023-12-26 11:41:59,749][123091] Updated weights for policy 0, policy_version 1516046 (0.0006) [2023-12-26 11:41:59,774][123090] Updated weights for policy 1, policy_version 1505971 (0.0007) [2023-12-26 11:41:59,846][123090] Updated weights for policy 1, policy_version 1505981 (0.0007) [2023-12-26 11:42:00,434][123091] Updated weights for policy 0, policy_version 1516056 (0.0005) [2023-12-26 11:42:00,492][123091] Updated weights for policy 0, policy_version 1516066 (0.0006) [2023-12-26 11:42:00,556][123091] Updated weights for policy 0, policy_version 1516076 (0.0008) [2023-12-26 11:42:00,712][123090] Updated weights for policy 1, policy_version 1505991 (0.0010) [2023-12-26 11:42:00,760][123090] Updated weights for policy 1, policy_version 1506001 (0.0010) [2023-12-26 11:42:00,806][123090] Updated weights for policy 1, policy_version 1506011 (0.0010) [2023-12-26 11:42:01,369][123091] Updated weights for policy 0, policy_version 1516086 (0.0009) [2023-12-26 11:42:01,436][123091] Updated weights for policy 0, policy_version 1516096 (0.0008) [2023-12-26 11:42:01,483][123091] Updated weights for policy 0, policy_version 1516106 (0.0008) [2023-12-26 11:42:01,640][123090] Updated weights for policy 1, policy_version 1506021 (0.0009) [2023-12-26 11:42:01,709][123090] Updated weights for policy 1, policy_version 1506031 (0.0006) [2023-12-26 11:42:01,776][123090] Updated weights for policy 1, policy_version 1506041 (0.0006) [2023-12-26 11:42:02,314][123091] Updated weights for policy 0, policy_version 1516116 (0.0008) [2023-12-26 11:42:02,379][123091] Updated weights for policy 0, policy_version 1516126 (0.0009) [2023-12-26 11:42:02,432][123091] Updated weights for policy 0, policy_version 1516136 (0.0010) [2023-12-26 11:42:02,523][123090] Updated weights for policy 1, policy_version 1506051 (0.0007) [2023-12-26 11:42:02,573][123090] Updated weights for policy 1, policy_version 1506061 (0.0009) [2023-12-26 11:42:02,623][123090] Updated weights for policy 1, policy_version 1506071 (0.0008) [2023-12-26 11:42:03,221][123091] Updated weights for policy 0, policy_version 1516146 (0.0008) [2023-12-26 11:42:03,297][123091] Updated weights for policy 0, policy_version 1516156 (0.0006) [2023-12-26 11:42:03,344][123090] Updated weights for policy 1, policy_version 1506081 (0.0010) [2023-12-26 11:42:03,371][123091] Updated weights for policy 0, policy_version 1516166 (0.0005) [2023-12-26 11:42:03,407][123090] Updated weights for policy 1, policy_version 1506091 (0.0005) [2023-12-26 11:42:03,442][123091] Updated weights for policy 0, policy_version 1516176 (0.0005) [2023-12-26 11:42:03,469][123090] Updated weights for policy 1, policy_version 1506101 (0.0005) [2023-12-26 11:42:03,523][123090] Updated weights for policy 1, policy_version 1506111 (0.0006) [2023-12-26 11:42:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 773709824. Throughput: 0: 8905.3, 1: 8909.2. Samples: 773720096. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:03,785][121949] Avg episode reward: [(0, '6203.804'), (1, '5514.578')] [2023-12-26 11:42:03,994][123091] Updated weights for policy 0, policy_version 1516186 (0.0006) [2023-12-26 11:42:04,051][123091] Updated weights for policy 0, policy_version 1516196 (0.0006) [2023-12-26 11:42:04,118][123091] Updated weights for policy 0, policy_version 1516206 (0.0006) [2023-12-26 11:42:04,214][123090] Updated weights for policy 1, policy_version 1506121 (0.0006) [2023-12-26 11:42:04,280][123090] Updated weights for policy 1, policy_version 1506131 (0.0009) [2023-12-26 11:42:04,344][123090] Updated weights for policy 1, policy_version 1506141 (0.0011) [2023-12-26 11:42:04,789][123091] Updated weights for policy 0, policy_version 1516216 (0.0006) [2023-12-26 11:42:04,836][123091] Updated weights for policy 0, policy_version 1516226 (0.0005) [2023-12-26 11:42:04,892][123091] Updated weights for policy 0, policy_version 1516236 (0.0010) [2023-12-26 11:42:05,042][123090] Updated weights for policy 1, policy_version 1506151 (0.0007) [2023-12-26 11:42:05,102][123090] Updated weights for policy 1, policy_version 1506161 (0.0005) [2023-12-26 11:42:05,159][123090] Updated weights for policy 1, policy_version 1506171 (0.0005) [2023-12-26 11:42:05,657][123091] Updated weights for policy 0, policy_version 1516246 (0.0011) [2023-12-26 11:42:05,725][123091] Updated weights for policy 0, policy_version 1516256 (0.0010) [2023-12-26 11:42:05,766][123090] Updated weights for policy 1, policy_version 1506181 (0.0006) [2023-12-26 11:42:05,793][123091] Updated weights for policy 0, policy_version 1516266 (0.0011) [2023-12-26 11:42:05,822][123090] Updated weights for policy 1, policy_version 1506191 (0.0006) [2023-12-26 11:42:05,886][123090] Updated weights for policy 1, policy_version 1506201 (0.0009) [2023-12-26 11:42:06,512][123091] Updated weights for policy 0, policy_version 1516276 (0.0010) [2023-12-26 11:42:06,579][123091] Updated weights for policy 0, policy_version 1516286 (0.0008) [2023-12-26 11:42:06,643][123091] Updated weights for policy 0, policy_version 1516296 (0.0008) [2023-12-26 11:42:06,711][123090] Updated weights for policy 1, policy_version 1506211 (0.0008) [2023-12-26 11:42:06,781][123090] Updated weights for policy 1, policy_version 1506221 (0.0008) [2023-12-26 11:42:06,832][123090] Updated weights for policy 1, policy_version 1506231 (0.0010) [2023-12-26 11:42:07,412][123091] Updated weights for policy 0, policy_version 1516306 (0.0009) [2023-12-26 11:42:07,478][123091] Updated weights for policy 0, policy_version 1516316 (0.0010) [2023-12-26 11:42:07,538][123091] Updated weights for policy 0, policy_version 1516326 (0.0010) [2023-12-26 11:42:07,606][123091] Updated weights for policy 0, policy_version 1516336 (0.0009) [2023-12-26 11:42:07,673][123090] Updated weights for policy 1, policy_version 1506241 (0.0009) [2023-12-26 11:42:07,744][123090] Updated weights for policy 1, policy_version 1506251 (0.0010) [2023-12-26 11:42:07,799][123090] Updated weights for policy 1, policy_version 1506261 (0.0009) [2023-12-26 11:42:07,866][123090] Updated weights for policy 1, policy_version 1506271 (0.0009) [2023-12-26 11:42:08,403][123091] Updated weights for policy 0, policy_version 1516346 (0.0010) [2023-12-26 11:42:08,466][123091] Updated weights for policy 0, policy_version 1516356 (0.0009) [2023-12-26 11:42:08,535][123091] Updated weights for policy 0, policy_version 1516366 (0.0006) [2023-12-26 11:42:08,712][123090] Updated weights for policy 1, policy_version 1506281 (0.0009) [2023-12-26 11:42:08,768][123090] Updated weights for policy 1, policy_version 1506291 (0.0009) [2023-12-26 11:42:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 773799936. Throughput: 0: 8978.0, 1: 8980.0. Samples: 773778088. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:08,785][121949] Avg episode reward: [(0, '6286.143'), (1, '5144.701')] [2023-12-26 11:42:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001516368_388194304.pth... [2023-12-26 11:42:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001515312_387923968.pth [2023-12-26 11:42:08,824][123090] Updated weights for policy 1, policy_version 1506301 (0.0009) [2023-12-26 11:42:08,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001506304_385613824.pth... [2023-12-26 11:42:08,848][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001505248_385343488.pth [2023-12-26 11:42:09,294][123091] Updated weights for policy 0, policy_version 1516376 (0.0008) [2023-12-26 11:42:09,367][123091] Updated weights for policy 0, policy_version 1516386 (0.0008) [2023-12-26 11:42:09,434][123091] Updated weights for policy 0, policy_version 1516396 (0.0009) [2023-12-26 11:42:09,759][123090] Updated weights for policy 1, policy_version 1506311 (0.0009) [2023-12-26 11:42:09,825][123090] Updated weights for policy 1, policy_version 1506321 (0.0009) [2023-12-26 11:42:09,897][123090] Updated weights for policy 1, policy_version 1506331 (0.0007) [2023-12-26 11:42:10,247][123091] Updated weights for policy 0, policy_version 1516406 (0.0006) [2023-12-26 11:42:10,305][123091] Updated weights for policy 0, policy_version 1516416 (0.0006) [2023-12-26 11:42:10,360][123091] Updated weights for policy 0, policy_version 1516426 (0.0006) [2023-12-26 11:42:10,643][123090] Updated weights for policy 1, policy_version 1506341 (0.0008) [2023-12-26 11:42:10,718][123090] Updated weights for policy 1, policy_version 1506351 (0.0005) [2023-12-26 11:42:10,784][123090] Updated weights for policy 1, policy_version 1506361 (0.0007) [2023-12-26 11:42:11,010][123091] Updated weights for policy 0, policy_version 1516436 (0.0006) [2023-12-26 11:42:11,082][123091] Updated weights for policy 0, policy_version 1516446 (0.0007) [2023-12-26 11:42:11,137][123091] Updated weights for policy 0, policy_version 1516456 (0.0010) [2023-12-26 11:42:11,587][123090] Updated weights for policy 1, policy_version 1506371 (0.0007) [2023-12-26 11:42:11,658][123090] Updated weights for policy 1, policy_version 1506381 (0.0009) [2023-12-26 11:42:11,715][123090] Updated weights for policy 1, policy_version 1506391 (0.0008) [2023-12-26 11:42:11,907][123091] Updated weights for policy 0, policy_version 1516466 (0.0010) [2023-12-26 11:42:11,982][123091] Updated weights for policy 0, policy_version 1516476 (0.0006) [2023-12-26 11:42:12,034][123091] Updated weights for policy 0, policy_version 1516486 (0.0006) [2023-12-26 11:42:12,085][123091] Updated weights for policy 0, policy_version 1516496 (0.0006) [2023-12-26 11:42:12,527][123090] Updated weights for policy 1, policy_version 1506401 (0.0008) [2023-12-26 11:42:12,598][123090] Updated weights for policy 1, policy_version 1506411 (0.0010) [2023-12-26 11:42:12,653][123090] Updated weights for policy 1, policy_version 1506421 (0.0012) [2023-12-26 11:42:12,706][123090] Updated weights for policy 1, policy_version 1506431 (0.0010) [2023-12-26 11:42:12,776][123091] Updated weights for policy 0, policy_version 1516506 (0.0005) [2023-12-26 11:42:12,839][123091] Updated weights for policy 0, policy_version 1516516 (0.0006) [2023-12-26 11:42:12,890][123091] Updated weights for policy 0, policy_version 1516526 (0.0005) [2023-12-26 11:42:13,539][123091] Updated weights for policy 0, policy_version 1516536 (0.0005) [2023-12-26 11:42:13,557][123090] Updated weights for policy 1, policy_version 1506441 (0.0009) [2023-12-26 11:42:13,591][123091] Updated weights for policy 0, policy_version 1516546 (0.0007) [2023-12-26 11:42:13,612][123090] Updated weights for policy 1, policy_version 1506451 (0.0008) [2023-12-26 11:42:13,645][123091] Updated weights for policy 0, policy_version 1516556 (0.0006) [2023-12-26 11:42:13,662][123090] Updated weights for policy 1, policy_version 1506461 (0.0009) [2023-12-26 11:42:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 773898240. Throughput: 0: 8990.8, 1: 8895.2. Samples: 773884600. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:13,785][121949] Avg episode reward: [(0, '6253.283'), (1, '4926.588')] [2023-12-26 11:42:14,243][123091] Updated weights for policy 0, policy_version 1516566 (0.0008) [2023-12-26 11:42:14,305][123091] Updated weights for policy 0, policy_version 1516576 (0.0010) [2023-12-26 11:42:14,360][123091] Updated weights for policy 0, policy_version 1516586 (0.0010) [2023-12-26 11:42:14,511][123090] Updated weights for policy 1, policy_version 1506471 (0.0009) [2023-12-26 11:42:14,565][123090] Updated weights for policy 1, policy_version 1506482 (0.0010) [2023-12-26 11:42:14,620][123090] Updated weights for policy 1, policy_version 1506494 (0.0011) [2023-12-26 11:42:15,096][123091] Updated weights for policy 0, policy_version 1516596 (0.0010) [2023-12-26 11:42:15,161][123091] Updated weights for policy 0, policy_version 1516606 (0.0011) [2023-12-26 11:42:15,230][123091] Updated weights for policy 0, policy_version 1516616 (0.0011) [2023-12-26 11:42:15,553][123090] Updated weights for policy 1, policy_version 1506504 (0.0009) [2023-12-26 11:42:15,620][123090] Updated weights for policy 1, policy_version 1506514 (0.0009) [2023-12-26 11:42:15,683][123090] Updated weights for policy 1, policy_version 1506524 (0.0009) [2023-12-26 11:42:16,107][123091] Updated weights for policy 0, policy_version 1516626 (0.0011) [2023-12-26 11:42:16,158][123091] Updated weights for policy 0, policy_version 1516636 (0.0011) [2023-12-26 11:42:16,217][123091] Updated weights for policy 0, policy_version 1516646 (0.0010) [2023-12-26 11:42:16,269][123091] Updated weights for policy 0, policy_version 1516656 (0.0010) [2023-12-26 11:42:16,523][123090] Updated weights for policy 1, policy_version 1506534 (0.0008) [2023-12-26 11:42:16,579][123090] Updated weights for policy 1, policy_version 1506544 (0.0009) [2023-12-26 11:42:16,629][123090] Updated weights for policy 1, policy_version 1506554 (0.0009) [2023-12-26 11:42:17,125][123091] Updated weights for policy 0, policy_version 1516666 (0.0011) [2023-12-26 11:42:17,191][123091] Updated weights for policy 0, policy_version 1516676 (0.0011) [2023-12-26 11:42:17,252][123091] Updated weights for policy 0, policy_version 1516686 (0.0010) [2023-12-26 11:42:17,467][123090] Updated weights for policy 1, policy_version 1506564 (0.0009) [2023-12-26 11:42:17,514][123090] Updated weights for policy 1, policy_version 1506574 (0.0008) [2023-12-26 11:42:17,562][123090] Updated weights for policy 1, policy_version 1506584 (0.0008) [2023-12-26 11:42:18,096][123091] Updated weights for policy 0, policy_version 1516696 (0.0010) [2023-12-26 11:42:18,179][123091] Updated weights for policy 0, policy_version 1516706 (0.0010) [2023-12-26 11:42:18,234][123091] Updated weights for policy 0, policy_version 1516716 (0.0009) [2023-12-26 11:42:18,321][123090] Updated weights for policy 1, policy_version 1506594 (0.0009) [2023-12-26 11:42:18,391][123090] Updated weights for policy 1, policy_version 1506604 (0.0007) [2023-12-26 11:42:18,463][123090] Updated weights for policy 1, policy_version 1506614 (0.0009) [2023-12-26 11:42:18,529][123090] Updated weights for policy 1, policy_version 1506624 (0.0010) [2023-12-26 11:42:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 773980160. Throughput: 0: 8940.1, 1: 8891.1. Samples: 773990052. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:18,785][121949] Avg episode reward: [(0, '6271.661'), (1, '5112.968')] [2023-12-26 11:42:19,067][123091] Updated weights for policy 0, policy_version 1516726 (0.0009) [2023-12-26 11:42:19,116][123091] Updated weights for policy 0, policy_version 1516736 (0.0009) [2023-12-26 11:42:19,166][123091] Updated weights for policy 0, policy_version 1516746 (0.0009) [2023-12-26 11:42:19,321][123090] Updated weights for policy 1, policy_version 1506634 (0.0011) [2023-12-26 11:42:19,389][123090] Updated weights for policy 1, policy_version 1506644 (0.0010) [2023-12-26 11:42:19,449][123090] Updated weights for policy 1, policy_version 1506654 (0.0010) [2023-12-26 11:42:20,003][123091] Updated weights for policy 0, policy_version 1516756 (0.0009) [2023-12-26 11:42:20,062][123091] Updated weights for policy 0, policy_version 1516766 (0.0008) [2023-12-26 11:42:20,129][123091] Updated weights for policy 0, policy_version 1516776 (0.0008) [2023-12-26 11:42:20,332][123090] Updated weights for policy 1, policy_version 1506664 (0.0010) [2023-12-26 11:42:20,391][123090] Updated weights for policy 1, policy_version 1506674 (0.0010) [2023-12-26 11:42:20,452][123090] Updated weights for policy 1, policy_version 1506684 (0.0009) [2023-12-26 11:42:20,949][123091] Updated weights for policy 0, policy_version 1516786 (0.0008) [2023-12-26 11:42:21,018][123091] Updated weights for policy 0, policy_version 1516796 (0.0010) [2023-12-26 11:42:21,088][123091] Updated weights for policy 0, policy_version 1516806 (0.0009) [2023-12-26 11:42:21,159][123091] Updated weights for policy 0, policy_version 1516816 (0.0009) [2023-12-26 11:42:21,340][123090] Updated weights for policy 1, policy_version 1506694 (0.0010) [2023-12-26 11:42:21,415][123090] Updated weights for policy 1, policy_version 1506704 (0.0010) [2023-12-26 11:42:21,486][123090] Updated weights for policy 1, policy_version 1506714 (0.0011) [2023-12-26 11:42:21,957][123091] Updated weights for policy 0, policy_version 1516826 (0.0009) [2023-12-26 11:42:22,011][123091] Updated weights for policy 0, policy_version 1516836 (0.0009) [2023-12-26 11:42:22,067][123091] Updated weights for policy 0, policy_version 1516846 (0.0009) [2023-12-26 11:42:22,344][123090] Updated weights for policy 1, policy_version 1506724 (0.0011) [2023-12-26 11:42:22,423][123090] Updated weights for policy 1, policy_version 1506734 (0.0008) [2023-12-26 11:42:22,494][123090] Updated weights for policy 1, policy_version 1506744 (0.0011) [2023-12-26 11:42:22,869][123091] Updated weights for policy 0, policy_version 1516856 (0.0007) [2023-12-26 11:42:22,933][123091] Updated weights for policy 0, policy_version 1516866 (0.0007) [2023-12-26 11:42:22,990][123091] Updated weights for policy 0, policy_version 1516876 (0.0009) [2023-12-26 11:42:23,296][123090] Updated weights for policy 1, policy_version 1506754 (0.0011) [2023-12-26 11:42:23,348][123090] Updated weights for policy 1, policy_version 1506764 (0.0011) [2023-12-26 11:42:23,415][123090] Updated weights for policy 1, policy_version 1506774 (0.0011) [2023-12-26 11:42:23,471][123090] Updated weights for policy 1, policy_version 1506784 (0.0010) [2023-12-26 11:42:23,698][123091] Updated weights for policy 0, policy_version 1516886 (0.0009) [2023-12-26 11:42:23,758][123091] Updated weights for policy 0, policy_version 1516896 (0.0009) [2023-12-26 11:42:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 774062080. Throughput: 0: 8970.4, 1: 8815.9. Samples: 774040308. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:23,785][121949] Avg episode reward: [(0, '6259.844'), (1, '5419.333')] [2023-12-26 11:42:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001506784_385736704.pth... [2023-12-26 11:42:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001505760_385474560.pth [2023-12-26 11:42:23,806][123091] Updated weights for policy 0, policy_version 1516906 (0.0009) [2023-12-26 11:42:23,833][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001516912_388333568.pth... [2023-12-26 11:42:23,838][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001515824_388055040.pth [2023-12-26 11:42:24,317][123090] Updated weights for policy 1, policy_version 1506794 (0.0010) [2023-12-26 11:42:24,386][123090] Updated weights for policy 1, policy_version 1506804 (0.0009) [2023-12-26 11:42:24,451][123090] Updated weights for policy 1, policy_version 1506814 (0.0010) [2023-12-26 11:42:24,580][123091] Updated weights for policy 0, policy_version 1516916 (0.0009) [2023-12-26 11:42:24,635][123091] Updated weights for policy 0, policy_version 1516926 (0.0009) [2023-12-26 11:42:24,690][123091] Updated weights for policy 0, policy_version 1516936 (0.0010) [2023-12-26 11:42:25,240][123090] Updated weights for policy 1, policy_version 1506824 (0.0009) [2023-12-26 11:42:25,289][123090] Updated weights for policy 1, policy_version 1506834 (0.0009) [2023-12-26 11:42:25,344][123090] Updated weights for policy 1, policy_version 1506844 (0.0008) [2023-12-26 11:42:25,543][123091] Updated weights for policy 0, policy_version 1516946 (0.0009) [2023-12-26 11:42:25,590][123091] Updated weights for policy 0, policy_version 1516956 (0.0010) [2023-12-26 11:42:25,634][123091] Updated weights for policy 0, policy_version 1516966 (0.0010) [2023-12-26 11:42:25,695][123091] Updated weights for policy 0, policy_version 1516976 (0.0010) [2023-12-26 11:42:26,193][123090] Updated weights for policy 1, policy_version 1506854 (0.0009) [2023-12-26 11:42:26,246][123090] Updated weights for policy 1, policy_version 1506864 (0.0008) [2023-12-26 11:42:26,294][123090] Updated weights for policy 1, policy_version 1506874 (0.0009) [2023-12-26 11:42:26,543][123091] Updated weights for policy 0, policy_version 1516986 (0.0011) [2023-12-26 11:42:26,595][123091] Updated weights for policy 0, policy_version 1516996 (0.0010) [2023-12-26 11:42:26,651][123091] Updated weights for policy 0, policy_version 1517006 (0.0011) [2023-12-26 11:42:27,150][123090] Updated weights for policy 1, policy_version 1506885 (0.0007) [2023-12-26 11:42:27,197][123090] Updated weights for policy 1, policy_version 1506895 (0.0005) [2023-12-26 11:42:27,247][123090] Updated weights for policy 1, policy_version 1506905 (0.0005) [2023-12-26 11:42:27,503][123091] Updated weights for policy 0, policy_version 1517016 (0.0010) [2023-12-26 11:42:27,568][123091] Updated weights for policy 0, policy_version 1517026 (0.0010) [2023-12-26 11:42:27,641][123091] Updated weights for policy 0, policy_version 1517036 (0.0005) [2023-12-26 11:42:27,895][123090] Updated weights for policy 1, policy_version 1506915 (0.0005) [2023-12-26 11:42:27,946][123090] Updated weights for policy 1, policy_version 1506925 (0.0005) [2023-12-26 11:42:27,996][123090] Updated weights for policy 1, policy_version 1506935 (0.0005) [2023-12-26 11:42:28,315][123091] Updated weights for policy 0, policy_version 1517046 (0.0005) [2023-12-26 11:42:28,381][123091] Updated weights for policy 0, policy_version 1517056 (0.0008) [2023-12-26 11:42:28,445][123091] Updated weights for policy 0, policy_version 1517066 (0.0011) [2023-12-26 11:42:28,711][123090] Updated weights for policy 1, policy_version 1506945 (0.0005) [2023-12-26 11:42:28,760][123090] Updated weights for policy 1, policy_version 1506955 (0.0009) [2023-12-26 11:42:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 774152192. Throughput: 0: 9004.5, 1: 8799.1. Samples: 774145400. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:28,785][121949] Avg episode reward: [(0, '6193.893'), (1, '5083.333')] [2023-12-26 11:42:28,812][123090] Updated weights for policy 1, policy_version 1506965 (0.0009) [2023-12-26 11:42:28,868][123090] Updated weights for policy 1, policy_version 1506976 (0.0012) [2023-12-26 11:42:29,151][123091] Updated weights for policy 0, policy_version 1517076 (0.0008) [2023-12-26 11:42:29,206][123091] Updated weights for policy 0, policy_version 1517086 (0.0005) [2023-12-26 11:42:29,264][123091] Updated weights for policy 0, policy_version 1517096 (0.0008) [2023-12-26 11:42:29,689][123090] Updated weights for policy 1, policy_version 1506986 (0.0010) [2023-12-26 11:42:29,756][123090] Updated weights for policy 1, policy_version 1506996 (0.0010) [2023-12-26 11:42:29,825][123090] Updated weights for policy 1, policy_version 1507006 (0.0009) [2023-12-26 11:42:30,033][123091] Updated weights for policy 0, policy_version 1517106 (0.0007) [2023-12-26 11:42:30,096][123091] Updated weights for policy 0, policy_version 1517116 (0.0010) [2023-12-26 11:42:30,163][123091] Updated weights for policy 0, policy_version 1517126 (0.0010) [2023-12-26 11:42:30,213][123091] Updated weights for policy 0, policy_version 1517136 (0.0009) [2023-12-26 11:42:30,689][123090] Updated weights for policy 1, policy_version 1507016 (0.0009) [2023-12-26 11:42:30,743][123090] Updated weights for policy 1, policy_version 1507026 (0.0009) [2023-12-26 11:42:30,797][123090] Updated weights for policy 1, policy_version 1507036 (0.0009) [2023-12-26 11:42:31,063][123091] Updated weights for policy 0, policy_version 1517146 (0.0009) [2023-12-26 11:42:31,109][123091] Updated weights for policy 0, policy_version 1517156 (0.0009) [2023-12-26 11:42:31,171][123091] Updated weights for policy 0, policy_version 1517166 (0.0009) [2023-12-26 11:42:31,662][123090] Updated weights for policy 1, policy_version 1507046 (0.0009) [2023-12-26 11:42:31,735][123090] Updated weights for policy 1, policy_version 1507056 (0.0009) [2023-12-26 11:42:31,805][123090] Updated weights for policy 1, policy_version 1507066 (0.0010) [2023-12-26 11:42:32,017][123091] Updated weights for policy 0, policy_version 1517176 (0.0007) [2023-12-26 11:42:32,070][123091] Updated weights for policy 0, policy_version 1517186 (0.0005) [2023-12-26 11:42:32,137][123091] Updated weights for policy 0, policy_version 1517196 (0.0006) [2023-12-26 11:42:32,633][123090] Updated weights for policy 1, policy_version 1507076 (0.0010) [2023-12-26 11:42:32,706][123090] Updated weights for policy 1, policy_version 1507086 (0.0010) [2023-12-26 11:42:32,758][123091] Updated weights for policy 0, policy_version 1517206 (0.0006) [2023-12-26 11:42:32,766][123090] Updated weights for policy 1, policy_version 1507096 (0.0010) [2023-12-26 11:42:32,811][123091] Updated weights for policy 0, policy_version 1517216 (0.0007) [2023-12-26 11:42:32,866][123091] Updated weights for policy 0, policy_version 1517226 (0.0006) [2023-12-26 11:42:33,515][123091] Updated weights for policy 0, policy_version 1517236 (0.0005) [2023-12-26 11:42:33,548][123090] Updated weights for policy 1, policy_version 1507106 (0.0009) [2023-12-26 11:42:33,565][123091] Updated weights for policy 0, policy_version 1517246 (0.0005) [2023-12-26 11:42:33,620][123090] Updated weights for policy 1, policy_version 1507116 (0.0006) [2023-12-26 11:42:33,632][123091] Updated weights for policy 0, policy_version 1517256 (0.0005) [2023-12-26 11:42:33,682][123090] Updated weights for policy 1, policy_version 1507126 (0.0010) [2023-12-26 11:42:33,725][123090] Updated weights for policy 1, policy_version 1507136 (0.0010) [2023-12-26 11:42:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 774250496. Throughput: 0: 9131.2, 1: 8797.5. Samples: 774255816. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:33,785][121949] Avg episode reward: [(0, '6198.869'), (1, '5106.442')] [2023-12-26 11:42:34,354][123091] Updated weights for policy 0, policy_version 1517266 (0.0007) [2023-12-26 11:42:34,418][123091] Updated weights for policy 0, policy_version 1517276 (0.0011) [2023-12-26 11:42:34,481][123091] Updated weights for policy 0, policy_version 1517286 (0.0011) [2023-12-26 11:42:34,545][123091] Updated weights for policy 0, policy_version 1517296 (0.0011) [2023-12-26 11:42:34,546][123090] Updated weights for policy 1, policy_version 1507146 (0.0010) [2023-12-26 11:42:34,598][123090] Updated weights for policy 1, policy_version 1507156 (0.0010) [2023-12-26 11:42:34,658][123090] Updated weights for policy 1, policy_version 1507166 (0.0010) [2023-12-26 11:42:35,370][123091] Updated weights for policy 0, policy_version 1517306 (0.0009) [2023-12-26 11:42:35,422][123091] Updated weights for policy 0, policy_version 1517316 (0.0007) [2023-12-26 11:42:35,457][123090] Updated weights for policy 1, policy_version 1507176 (0.0008) [2023-12-26 11:42:35,473][123091] Updated weights for policy 0, policy_version 1517326 (0.0010) [2023-12-26 11:42:35,516][123090] Updated weights for policy 1, policy_version 1507186 (0.0007) [2023-12-26 11:42:35,573][123090] Updated weights for policy 1, policy_version 1507196 (0.0009) [2023-12-26 11:42:36,331][123091] Updated weights for policy 0, policy_version 1517336 (0.0010) [2023-12-26 11:42:36,397][123091] Updated weights for policy 0, policy_version 1517346 (0.0010) [2023-12-26 11:42:36,458][123091] Updated weights for policy 0, policy_version 1517356 (0.0009) [2023-12-26 11:42:36,469][123090] Updated weights for policy 1, policy_version 1507206 (0.0008) [2023-12-26 11:42:36,543][123090] Updated weights for policy 1, policy_version 1507216 (0.0007) [2023-12-26 11:42:36,613][123090] Updated weights for policy 1, policy_version 1507226 (0.0007) [2023-12-26 11:42:37,300][123090] Updated weights for policy 1, policy_version 1507236 (0.0007) [2023-12-26 11:42:37,330][123091] Updated weights for policy 0, policy_version 1517366 (0.0007) [2023-12-26 11:42:37,360][123090] Updated weights for policy 1, policy_version 1507246 (0.0008) [2023-12-26 11:42:37,385][123091] Updated weights for policy 0, policy_version 1517376 (0.0010) [2023-12-26 11:42:37,421][123090] Updated weights for policy 1, policy_version 1507256 (0.0009) [2023-12-26 11:42:37,449][123091] Updated weights for policy 0, policy_version 1517386 (0.0008) [2023-12-26 11:42:38,240][123090] Updated weights for policy 1, policy_version 1507266 (0.0008) [2023-12-26 11:42:38,298][123091] Updated weights for policy 0, policy_version 1517396 (0.0008) [2023-12-26 11:42:38,304][123090] Updated weights for policy 1, policy_version 1507276 (0.0009) [2023-12-26 11:42:38,359][123091] Updated weights for policy 0, policy_version 1517406 (0.0008) [2023-12-26 11:42:38,368][123090] Updated weights for policy 1, policy_version 1507287 (0.0009) [2023-12-26 11:42:38,417][123091] Updated weights for policy 0, policy_version 1517416 (0.0010) [2023-12-26 11:42:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 774332416. Throughput: 0: 9139.9, 1: 8807.5. Samples: 774307444. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:38,785][121949] Avg episode reward: [(0, '6253.879'), (1, '5398.794')] [2023-12-26 11:42:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001517424_388464640.pth... [2023-12-26 11:42:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001507296_385867776.pth... [2023-12-26 11:42:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001516368_388194304.pth [2023-12-26 11:42:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001506304_385613824.pth [2023-12-26 11:42:39,066][123090] Updated weights for policy 1, policy_version 1507297 (0.0008) [2023-12-26 11:42:39,115][123090] Updated weights for policy 1, policy_version 1507307 (0.0009) [2023-12-26 11:42:39,166][123090] Updated weights for policy 1, policy_version 1507317 (0.0008) [2023-12-26 11:42:39,226][123090] Updated weights for policy 1, policy_version 1507327 (0.0009) [2023-12-26 11:42:39,308][123091] Updated weights for policy 0, policy_version 1517427 (0.0010) [2023-12-26 11:42:39,386][123091] Updated weights for policy 0, policy_version 1517437 (0.0010) [2023-12-26 11:42:39,459][123091] Updated weights for policy 0, policy_version 1517447 (0.0009) [2023-12-26 11:42:40,040][123090] Updated weights for policy 1, policy_version 1507337 (0.0009) [2023-12-26 11:42:40,106][123090] Updated weights for policy 1, policy_version 1507347 (0.0008) [2023-12-26 11:42:40,179][123090] Updated weights for policy 1, policy_version 1507357 (0.0009) [2023-12-26 11:42:40,267][123091] Updated weights for policy 0, policy_version 1517457 (0.0010) [2023-12-26 11:42:40,334][123091] Updated weights for policy 0, policy_version 1517467 (0.0010) [2023-12-26 11:42:40,401][123091] Updated weights for policy 0, policy_version 1517477 (0.0010) [2023-12-26 11:42:40,472][123091] Updated weights for policy 0, policy_version 1517487 (0.0010) [2023-12-26 11:42:40,960][123090] Updated weights for policy 1, policy_version 1507367 (0.0009) [2023-12-26 11:42:41,029][123090] Updated weights for policy 1, policy_version 1507377 (0.0008) [2023-12-26 11:42:41,104][123090] Updated weights for policy 1, policy_version 1507387 (0.0008) [2023-12-26 11:42:41,296][123091] Updated weights for policy 0, policy_version 1517497 (0.0008) [2023-12-26 11:42:41,358][123091] Updated weights for policy 0, policy_version 1517507 (0.0009) [2023-12-26 11:42:41,429][123091] Updated weights for policy 0, policy_version 1517517 (0.0010) [2023-12-26 11:42:41,896][123090] Updated weights for policy 1, policy_version 1507397 (0.0007) [2023-12-26 11:42:41,953][123090] Updated weights for policy 1, policy_version 1507407 (0.0010) [2023-12-26 11:42:42,022][123090] Updated weights for policy 1, policy_version 1507417 (0.0009) [2023-12-26 11:42:42,213][123091] Updated weights for policy 0, policy_version 1517527 (0.0008) [2023-12-26 11:42:42,281][123091] Updated weights for policy 0, policy_version 1517537 (0.0007) [2023-12-26 11:42:42,343][123091] Updated weights for policy 0, policy_version 1517547 (0.0010) [2023-12-26 11:42:42,897][123090] Updated weights for policy 1, policy_version 1507427 (0.0010) [2023-12-26 11:42:42,954][123090] Updated weights for policy 1, policy_version 1507437 (0.0010) [2023-12-26 11:42:43,011][123090] Updated weights for policy 1, policy_version 1507447 (0.0009) [2023-12-26 11:42:43,053][123091] Updated weights for policy 0, policy_version 1517558 (0.0007) [2023-12-26 11:42:43,114][123091] Updated weights for policy 0, policy_version 1517568 (0.0005) [2023-12-26 11:42:43,160][123091] Updated weights for policy 0, policy_version 1517578 (0.0005) [2023-12-26 11:42:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 774414336. Throughput: 0: 8995.0, 1: 8709.9. Samples: 774411028. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:43,784][121949] Avg episode reward: [(0, '6286.297'), (1, '5496.483')] [2023-12-26 11:42:43,828][123091] Updated weights for policy 0, policy_version 1517588 (0.0005) [2023-12-26 11:42:43,891][123091] Updated weights for policy 0, policy_version 1517598 (0.0006) [2023-12-26 11:42:43,928][123090] Updated weights for policy 1, policy_version 1507457 (0.0009) [2023-12-26 11:42:43,947][123091] Updated weights for policy 0, policy_version 1517608 (0.0005) [2023-12-26 11:42:43,977][123090] Updated weights for policy 1, policy_version 1507467 (0.0009) [2023-12-26 11:42:44,033][123090] Updated weights for policy 1, policy_version 1507477 (0.0010) [2023-12-26 11:42:44,087][123090] Updated weights for policy 1, policy_version 1507487 (0.0010) [2023-12-26 11:42:44,666][123091] Updated weights for policy 0, policy_version 1517618 (0.0006) [2023-12-26 11:42:44,728][123091] Updated weights for policy 0, policy_version 1517628 (0.0011) [2023-12-26 11:42:44,802][123091] Updated weights for policy 0, policy_version 1517638 (0.0011) [2023-12-26 11:42:44,862][123091] Updated weights for policy 0, policy_version 1517648 (0.0011) [2023-12-26 11:42:44,958][123090] Updated weights for policy 1, policy_version 1507497 (0.0009) [2023-12-26 11:42:45,024][123090] Updated weights for policy 1, policy_version 1507507 (0.0009) [2023-12-26 11:42:45,093][123090] Updated weights for policy 1, policy_version 1507517 (0.0009) [2023-12-26 11:42:45,700][123091] Updated weights for policy 0, policy_version 1517658 (0.0011) [2023-12-26 11:42:45,749][123091] Updated weights for policy 0, policy_version 1517668 (0.0010) [2023-12-26 11:42:45,811][123091] Updated weights for policy 0, policy_version 1517678 (0.0011) [2023-12-26 11:42:45,882][123090] Updated weights for policy 1, policy_version 1507527 (0.0009) [2023-12-26 11:42:45,942][123090] Updated weights for policy 1, policy_version 1507537 (0.0008) [2023-12-26 11:42:46,002][123090] Updated weights for policy 1, policy_version 1507547 (0.0009) [2023-12-26 11:42:46,617][123091] Updated weights for policy 0, policy_version 1517688 (0.0009) [2023-12-26 11:42:46,681][123091] Updated weights for policy 0, policy_version 1517698 (0.0010) [2023-12-26 11:42:46,739][123091] Updated weights for policy 0, policy_version 1517708 (0.0006) [2023-12-26 11:42:46,795][123090] Updated weights for policy 1, policy_version 1507557 (0.0007) [2023-12-26 11:42:46,851][123090] Updated weights for policy 1, policy_version 1507567 (0.0010) [2023-12-26 11:42:46,909][123090] Updated weights for policy 1, policy_version 1507577 (0.0010) [2023-12-26 11:42:47,486][123091] Updated weights for policy 0, policy_version 1517718 (0.0008) [2023-12-26 11:42:47,544][123091] Updated weights for policy 0, policy_version 1517728 (0.0010) [2023-12-26 11:42:47,598][123091] Updated weights for policy 0, policy_version 1517738 (0.0010) [2023-12-26 11:42:47,731][123090] Updated weights for policy 1, policy_version 1507587 (0.0007) [2023-12-26 11:42:47,792][123090] Updated weights for policy 1, policy_version 1507597 (0.0009) [2023-12-26 11:42:47,858][123090] Updated weights for policy 1, policy_version 1507607 (0.0009) [2023-12-26 11:42:48,446][123091] Updated weights for policy 0, policy_version 1517748 (0.0010) [2023-12-26 11:42:48,513][123091] Updated weights for policy 0, policy_version 1517758 (0.0011) [2023-12-26 11:42:48,572][123091] Updated weights for policy 0, policy_version 1517768 (0.0011) [2023-12-26 11:42:48,722][123090] Updated weights for policy 1, policy_version 1507617 (0.0010) [2023-12-26 11:42:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 774504448. Throughput: 0: 9051.3, 1: 8663.2. Samples: 774517248. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:48,785][121949] Avg episode reward: [(0, '6300.419'), (1, '5597.795')] [2023-12-26 11:42:48,787][123090] Updated weights for policy 1, policy_version 1507627 (0.0008) [2023-12-26 11:42:48,839][123090] Updated weights for policy 1, policy_version 1507637 (0.0009) [2023-12-26 11:42:48,891][123090] Updated weights for policy 1, policy_version 1507647 (0.0009) [2023-12-26 11:42:49,361][123091] Updated weights for policy 0, policy_version 1517778 (0.0010) [2023-12-26 11:42:49,430][123091] Updated weights for policy 0, policy_version 1517788 (0.0005) [2023-12-26 11:42:49,501][123091] Updated weights for policy 0, policy_version 1517798 (0.0011) [2023-12-26 11:42:49,571][123091] Updated weights for policy 0, policy_version 1517808 (0.0011) [2023-12-26 11:42:49,786][123090] Updated weights for policy 1, policy_version 1507657 (0.0009) [2023-12-26 11:42:49,856][123090] Updated weights for policy 1, policy_version 1507667 (0.0009) [2023-12-26 11:42:49,918][123090] Updated weights for policy 1, policy_version 1507677 (0.0009) [2023-12-26 11:42:50,368][123091] Updated weights for policy 0, policy_version 1517818 (0.0009) [2023-12-26 11:42:50,423][123091] Updated weights for policy 0, policy_version 1517828 (0.0011) [2023-12-26 11:42:50,480][123091] Updated weights for policy 0, policy_version 1517838 (0.0010) [2023-12-26 11:42:50,668][123090] Updated weights for policy 1, policy_version 1507687 (0.0008) [2023-12-26 11:42:50,732][123090] Updated weights for policy 1, policy_version 1507697 (0.0007) [2023-12-26 11:42:50,800][123090] Updated weights for policy 1, policy_version 1507707 (0.0011) [2023-12-26 11:42:51,392][123091] Updated weights for policy 0, policy_version 1517848 (0.0009) [2023-12-26 11:42:51,458][123091] Updated weights for policy 0, policy_version 1517858 (0.0010) [2023-12-26 11:42:51,528][123091] Updated weights for policy 0, policy_version 1517868 (0.0010) [2023-12-26 11:42:51,585][123090] Updated weights for policy 1, policy_version 1507717 (0.0010) [2023-12-26 11:42:51,649][123090] Updated weights for policy 1, policy_version 1507727 (0.0010) [2023-12-26 11:42:51,710][123090] Updated weights for policy 1, policy_version 1507737 (0.0009) [2023-12-26 11:42:52,308][123091] Updated weights for policy 0, policy_version 1517878 (0.0007) [2023-12-26 11:42:52,380][123091] Updated weights for policy 0, policy_version 1517888 (0.0007) [2023-12-26 11:42:52,440][123091] Updated weights for policy 0, policy_version 1517898 (0.0009) [2023-12-26 11:42:52,603][123090] Updated weights for policy 1, policy_version 1507747 (0.0010) [2023-12-26 11:42:52,665][123090] Updated weights for policy 1, policy_version 1507757 (0.0009) [2023-12-26 11:42:52,727][123090] Updated weights for policy 1, policy_version 1507767 (0.0010) [2023-12-26 11:42:53,165][123091] Updated weights for policy 0, policy_version 1517908 (0.0007) [2023-12-26 11:42:53,223][123091] Updated weights for policy 0, policy_version 1517918 (0.0010) [2023-12-26 11:42:53,290][123091] Updated weights for policy 0, policy_version 1517928 (0.0009) [2023-12-26 11:42:53,590][123090] Updated weights for policy 1, policy_version 1507777 (0.0009) [2023-12-26 11:42:53,656][123090] Updated weights for policy 1, policy_version 1507787 (0.0006) [2023-12-26 11:42:53,732][123090] Updated weights for policy 1, policy_version 1507797 (0.0005) [2023-12-26 11:42:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 774586368. Throughput: 0: 8957.4, 1: 8599.7. Samples: 774568160. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:53,785][121949] Avg episode reward: [(0, '6249.563'), (1, '5548.726')] [2023-12-26 11:42:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001517936_388595712.pth... [2023-12-26 11:42:53,797][123090] Updated weights for policy 1, policy_version 1507807 (0.0005) [2023-12-26 11:42:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001516912_388333568.pth [2023-12-26 11:42:53,803][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001507808_385998848.pth... [2023-12-26 11:42:53,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001506784_385736704.pth [2023-12-26 11:42:53,976][123091] Updated weights for policy 0, policy_version 1517938 (0.0009) [2023-12-26 11:42:54,042][123091] Updated weights for policy 0, policy_version 1517948 (0.0009) [2023-12-26 11:42:54,095][123091] Updated weights for policy 0, policy_version 1517958 (0.0007) [2023-12-26 11:42:54,163][123091] Updated weights for policy 0, policy_version 1517968 (0.0008) [2023-12-26 11:42:54,552][123090] Updated weights for policy 1, policy_version 1507817 (0.0009) [2023-12-26 11:42:54,609][123090] Updated weights for policy 1, policy_version 1507827 (0.0009) [2023-12-26 11:42:54,658][123090] Updated weights for policy 1, policy_version 1507837 (0.0007) [2023-12-26 11:42:54,914][123091] Updated weights for policy 0, policy_version 1517978 (0.0005) [2023-12-26 11:42:54,972][123091] Updated weights for policy 0, policy_version 1517988 (0.0007) [2023-12-26 11:42:55,023][123091] Updated weights for policy 0, policy_version 1517998 (0.0006) [2023-12-26 11:42:55,438][123090] Updated weights for policy 1, policy_version 1507847 (0.0008) [2023-12-26 11:42:55,487][123090] Updated weights for policy 1, policy_version 1507857 (0.0009) [2023-12-26 11:42:55,536][123090] Updated weights for policy 1, policy_version 1507867 (0.0009) [2023-12-26 11:42:55,757][123091] Updated weights for policy 0, policy_version 1518008 (0.0007) [2023-12-26 11:42:55,811][123091] Updated weights for policy 0, policy_version 1518018 (0.0005) [2023-12-26 11:42:55,859][123091] Updated weights for policy 0, policy_version 1518028 (0.0006) [2023-12-26 11:42:56,344][123090] Updated weights for policy 1, policy_version 1507877 (0.0009) [2023-12-26 11:42:56,398][123090] Updated weights for policy 1, policy_version 1507887 (0.0007) [2023-12-26 11:42:56,448][123090] Updated weights for policy 1, policy_version 1507897 (0.0005) [2023-12-26 11:42:56,646][123091] Updated weights for policy 0, policy_version 1518038 (0.0007) [2023-12-26 11:42:56,693][123091] Updated weights for policy 0, policy_version 1518048 (0.0005) [2023-12-26 11:42:56,752][123091] Updated weights for policy 0, policy_version 1518058 (0.0006) [2023-12-26 11:42:57,116][123090] Updated weights for policy 1, policy_version 1507907 (0.0007) [2023-12-26 11:42:57,170][123090] Updated weights for policy 1, policy_version 1507917 (0.0010) [2023-12-26 11:42:57,220][123090] Updated weights for policy 1, policy_version 1507927 (0.0010) [2023-12-26 11:42:57,484][123091] Updated weights for policy 0, policy_version 1518068 (0.0008) [2023-12-26 11:42:57,541][123091] Updated weights for policy 0, policy_version 1518078 (0.0005) [2023-12-26 11:42:57,587][123091] Updated weights for policy 0, policy_version 1518088 (0.0005) [2023-12-26 11:42:57,882][123090] Updated weights for policy 1, policy_version 1507937 (0.0010) [2023-12-26 11:42:57,960][123090] Updated weights for policy 1, policy_version 1507947 (0.0005) [2023-12-26 11:42:58,021][123090] Updated weights for policy 1, policy_version 1507957 (0.0010) [2023-12-26 11:42:58,086][123090] Updated weights for policy 1, policy_version 1507967 (0.0011) [2023-12-26 11:42:58,287][123091] Updated weights for policy 0, policy_version 1518098 (0.0006) [2023-12-26 11:42:58,366][123091] Updated weights for policy 0, policy_version 1518108 (0.0010) [2023-12-26 11:42:58,440][123091] Updated weights for policy 0, policy_version 1518118 (0.0010) [2023-12-26 11:42:58,520][123091] Updated weights for policy 0, policy_version 1518128 (0.0010) [2023-12-26 11:42:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 774684672. Throughput: 0: 8977.3, 1: 8668.9. Samples: 774678676. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:42:58,785][121949] Avg episode reward: [(0, '6154.250'), (1, '5543.846')] [2023-12-26 11:42:58,874][123090] Updated weights for policy 1, policy_version 1507977 (0.0013) [2023-12-26 11:42:58,957][123090] Updated weights for policy 1, policy_version 1507987 (0.0007) [2023-12-26 11:42:59,028][123090] Updated weights for policy 1, policy_version 1507997 (0.0008) [2023-12-26 11:42:59,387][123091] Updated weights for policy 0, policy_version 1518138 (0.0008) [2023-12-26 11:42:59,456][123091] Updated weights for policy 0, policy_version 1518148 (0.0007) [2023-12-26 11:42:59,522][123091] Updated weights for policy 0, policy_version 1518158 (0.0006) [2023-12-26 11:42:59,899][123090] Updated weights for policy 1, policy_version 1508007 (0.0009) [2023-12-26 11:42:59,972][123090] Updated weights for policy 1, policy_version 1508017 (0.0011) [2023-12-26 11:43:00,036][123090] Updated weights for policy 1, policy_version 1508027 (0.0011) [2023-12-26 11:43:00,221][123091] Updated weights for policy 0, policy_version 1518168 (0.0007) [2023-12-26 11:43:00,271][123091] Updated weights for policy 0, policy_version 1518178 (0.0008) [2023-12-26 11:43:00,322][123091] Updated weights for policy 0, policy_version 1518188 (0.0008) [2023-12-26 11:43:00,788][123090] Updated weights for policy 1, policy_version 1508037 (0.0008) [2023-12-26 11:43:00,852][123090] Updated weights for policy 1, policy_version 1508047 (0.0005) [2023-12-26 11:43:00,912][123090] Updated weights for policy 1, policy_version 1508057 (0.0005) [2023-12-26 11:43:01,166][123091] Updated weights for policy 0, policy_version 1518198 (0.0008) [2023-12-26 11:43:01,227][123091] Updated weights for policy 0, policy_version 1518208 (0.0006) [2023-12-26 11:43:01,294][123091] Updated weights for policy 0, policy_version 1518218 (0.0010) [2023-12-26 11:43:01,690][123090] Updated weights for policy 1, policy_version 1508067 (0.0007) [2023-12-26 11:43:01,758][123090] Updated weights for policy 1, policy_version 1508077 (0.0010) [2023-12-26 11:43:01,819][123090] Updated weights for policy 1, policy_version 1508087 (0.0009) [2023-12-26 11:43:02,037][123091] Updated weights for policy 0, policy_version 1518228 (0.0010) [2023-12-26 11:43:02,093][123091] Updated weights for policy 0, policy_version 1518238 (0.0010) [2023-12-26 11:43:02,157][123091] Updated weights for policy 0, policy_version 1518248 (0.0009) [2023-12-26 11:43:02,542][123090] Updated weights for policy 1, policy_version 1508097 (0.0009) [2023-12-26 11:43:02,600][123090] Updated weights for policy 1, policy_version 1508107 (0.0006) [2023-12-26 11:43:02,655][123090] Updated weights for policy 1, policy_version 1508117 (0.0005) [2023-12-26 11:43:02,719][123090] Updated weights for policy 1, policy_version 1508127 (0.0006) [2023-12-26 11:43:03,040][123091] Updated weights for policy 0, policy_version 1518258 (0.0010) [2023-12-26 11:43:03,092][123091] Updated weights for policy 0, policy_version 1518268 (0.0009) [2023-12-26 11:43:03,139][123091] Updated weights for policy 0, policy_version 1518279 (0.0009) [2023-12-26 11:43:03,466][123090] Updated weights for policy 1, policy_version 1508137 (0.0007) [2023-12-26 11:43:03,520][123090] Updated weights for policy 1, policy_version 1508147 (0.0006) [2023-12-26 11:43:03,569][123090] Updated weights for policy 1, policy_version 1508157 (0.0005) [2023-12-26 11:43:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 774774784. Throughput: 0: 8940.4, 1: 8726.8. Samples: 774785076. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:03,785][121949] Avg episode reward: [(0, '6189.041'), (1, '5416.651')] [2023-12-26 11:43:04,026][123091] Updated weights for policy 0, policy_version 1518289 (0.0008) [2023-12-26 11:43:04,083][123091] Updated weights for policy 0, policy_version 1518299 (0.0010) [2023-12-26 11:43:04,140][123091] Updated weights for policy 0, policy_version 1518309 (0.0009) [2023-12-26 11:43:04,201][123091] Updated weights for policy 0, policy_version 1518319 (0.0008) [2023-12-26 11:43:04,298][123090] Updated weights for policy 1, policy_version 1508167 (0.0009) [2023-12-26 11:43:04,370][123090] Updated weights for policy 1, policy_version 1508177 (0.0010) [2023-12-26 11:43:04,433][123090] Updated weights for policy 1, policy_version 1508187 (0.0010) [2023-12-26 11:43:04,953][123091] Updated weights for policy 0, policy_version 1518329 (0.0005) [2023-12-26 11:43:05,004][123091] Updated weights for policy 0, policy_version 1518339 (0.0005) [2023-12-26 11:43:05,055][123091] Updated weights for policy 0, policy_version 1518349 (0.0005) [2023-12-26 11:43:05,248][123090] Updated weights for policy 1, policy_version 1508197 (0.0009) [2023-12-26 11:43:05,312][123090] Updated weights for policy 1, policy_version 1508207 (0.0009) [2023-12-26 11:43:05,376][123090] Updated weights for policy 1, policy_version 1508217 (0.0010) [2023-12-26 11:43:05,724][123091] Updated weights for policy 0, policy_version 1518359 (0.0008) [2023-12-26 11:43:05,785][123091] Updated weights for policy 0, policy_version 1518369 (0.0010) [2023-12-26 11:43:05,837][123091] Updated weights for policy 0, policy_version 1518379 (0.0010) [2023-12-26 11:43:06,053][123090] Updated weights for policy 1, policy_version 1508227 (0.0009) [2023-12-26 11:43:06,107][123090] Updated weights for policy 1, policy_version 1508237 (0.0010) [2023-12-26 11:43:06,181][123090] Updated weights for policy 1, policy_version 1508247 (0.0010) [2023-12-26 11:43:06,705][123091] Updated weights for policy 0, policy_version 1518390 (0.0007) [2023-12-26 11:43:06,776][123091] Updated weights for policy 0, policy_version 1518400 (0.0006) [2023-12-26 11:43:06,834][123091] Updated weights for policy 0, policy_version 1518410 (0.0006) [2023-12-26 11:43:07,013][123090] Updated weights for policy 1, policy_version 1508257 (0.0010) [2023-12-26 11:43:07,074][123090] Updated weights for policy 1, policy_version 1508267 (0.0011) [2023-12-26 11:43:07,134][123090] Updated weights for policy 1, policy_version 1508277 (0.0011) [2023-12-26 11:43:07,198][123090] Updated weights for policy 1, policy_version 1508287 (0.0011) [2023-12-26 11:43:07,608][123091] Updated weights for policy 0, policy_version 1518420 (0.0008) [2023-12-26 11:43:07,670][123091] Updated weights for policy 0, policy_version 1518430 (0.0010) [2023-12-26 11:43:07,733][123091] Updated weights for policy 0, policy_version 1518440 (0.0009) [2023-12-26 11:43:07,994][123090] Updated weights for policy 1, policy_version 1508297 (0.0006) [2023-12-26 11:43:08,059][123090] Updated weights for policy 1, policy_version 1508307 (0.0005) [2023-12-26 11:43:08,117][123090] Updated weights for policy 1, policy_version 1508317 (0.0006) [2023-12-26 11:43:08,591][123091] Updated weights for policy 0, policy_version 1518450 (0.0008) [2023-12-26 11:43:08,658][123091] Updated weights for policy 0, policy_version 1518460 (0.0009) [2023-12-26 11:43:08,718][123091] Updated weights for policy 0, policy_version 1518470 (0.0008) [2023-12-26 11:43:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 774864896. Throughput: 0: 8977.1, 1: 8788.7. Samples: 774839768. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:08,785][121949] Avg episode reward: [(0, '6199.502'), (1, '5471.091')] [2023-12-26 11:43:08,785][123091] Updated weights for policy 0, policy_version 1518480 (0.0010) [2023-12-26 11:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001508320_386129920.pth... [2023-12-26 11:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001518480_388734976.pth... [2023-12-26 11:43:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001517424_388464640.pth [2023-12-26 11:43:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001507296_385867776.pth [2023-12-26 11:43:08,942][123090] Updated weights for policy 1, policy_version 1508327 (0.0008) [2023-12-26 11:43:08,999][123090] Updated weights for policy 1, policy_version 1508337 (0.0010) [2023-12-26 11:43:09,053][123090] Updated weights for policy 1, policy_version 1508347 (0.0009) [2023-12-26 11:43:09,615][123091] Updated weights for policy 0, policy_version 1518490 (0.0009) [2023-12-26 11:43:09,676][123091] Updated weights for policy 0, policy_version 1518500 (0.0009) [2023-12-26 11:43:09,740][123091] Updated weights for policy 0, policy_version 1518510 (0.0010) [2023-12-26 11:43:09,957][123090] Updated weights for policy 1, policy_version 1508357 (0.0009) [2023-12-26 11:43:10,028][123090] Updated weights for policy 1, policy_version 1508367 (0.0008) [2023-12-26 11:43:10,088][123090] Updated weights for policy 1, policy_version 1508377 (0.0008) [2023-12-26 11:43:10,549][123091] Updated weights for policy 0, policy_version 1518520 (0.0007) [2023-12-26 11:43:10,611][123091] Updated weights for policy 0, policy_version 1518530 (0.0008) [2023-12-26 11:43:10,679][123091] Updated weights for policy 0, policy_version 1518540 (0.0008) [2023-12-26 11:43:10,932][123090] Updated weights for policy 1, policy_version 1508387 (0.0008) [2023-12-26 11:43:10,994][123090] Updated weights for policy 1, policy_version 1508397 (0.0009) [2023-12-26 11:43:11,062][123090] Updated weights for policy 1, policy_version 1508407 (0.0010) [2023-12-26 11:43:11,421][123091] Updated weights for policy 0, policy_version 1518550 (0.0008) [2023-12-26 11:43:11,486][123091] Updated weights for policy 0, policy_version 1518560 (0.0011) [2023-12-26 11:43:11,537][123091] Updated weights for policy 0, policy_version 1518570 (0.0010) [2023-12-26 11:43:11,914][123090] Updated weights for policy 1, policy_version 1508417 (0.0009) [2023-12-26 11:43:11,985][123090] Updated weights for policy 1, policy_version 1508427 (0.0009) [2023-12-26 11:43:12,043][123090] Updated weights for policy 1, policy_version 1508437 (0.0009) [2023-12-26 11:43:12,109][123090] Updated weights for policy 1, policy_version 1508447 (0.0009) [2023-12-26 11:43:12,396][123091] Updated weights for policy 0, policy_version 1518581 (0.0010) [2023-12-26 11:43:12,455][123091] Updated weights for policy 0, policy_version 1518591 (0.0009) [2023-12-26 11:43:12,520][123091] Updated weights for policy 0, policy_version 1518601 (0.0009) [2023-12-26 11:43:12,916][123090] Updated weights for policy 1, policy_version 1508457 (0.0010) [2023-12-26 11:43:12,986][123090] Updated weights for policy 1, policy_version 1508467 (0.0009) [2023-12-26 11:43:13,038][123090] Updated weights for policy 1, policy_version 1508477 (0.0005) [2023-12-26 11:43:13,338][123091] Updated weights for policy 0, policy_version 1518611 (0.0008) [2023-12-26 11:43:13,409][123091] Updated weights for policy 0, policy_version 1518621 (0.0008) [2023-12-26 11:43:13,460][123091] Updated weights for policy 0, policy_version 1518631 (0.0010) [2023-12-26 11:43:13,754][123090] Updated weights for policy 1, policy_version 1508487 (0.0009) [2023-12-26 11:43:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 774946816. Throughput: 0: 8948.8, 1: 8767.4. Samples: 774942632. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:13,785][121949] Avg episode reward: [(0, '6183.993'), (1, '5327.617')] [2023-12-26 11:43:13,809][123090] Updated weights for policy 1, policy_version 1508497 (0.0009) [2023-12-26 11:43:13,868][123090] Updated weights for policy 1, policy_version 1508507 (0.0010) [2023-12-26 11:43:14,301][123091] Updated weights for policy 0, policy_version 1518641 (0.0009) [2023-12-26 11:43:14,367][123091] Updated weights for policy 0, policy_version 1518651 (0.0006) [2023-12-26 11:43:14,430][123091] Updated weights for policy 0, policy_version 1518661 (0.0005) [2023-12-26 11:43:14,483][123091] Updated weights for policy 0, policy_version 1518671 (0.0005) [2023-12-26 11:43:14,678][123090] Updated weights for policy 1, policy_version 1508517 (0.0010) [2023-12-26 11:43:14,744][123090] Updated weights for policy 1, policy_version 1508527 (0.0009) [2023-12-26 11:43:14,813][123090] Updated weights for policy 1, policy_version 1508537 (0.0009) [2023-12-26 11:43:15,201][123091] Updated weights for policy 0, policy_version 1518681 (0.0006) [2023-12-26 11:43:15,259][123091] Updated weights for policy 0, policy_version 1518691 (0.0006) [2023-12-26 11:43:15,313][123091] Updated weights for policy 0, policy_version 1518701 (0.0006) [2023-12-26 11:43:15,628][123090] Updated weights for policy 1, policy_version 1508547 (0.0008) [2023-12-26 11:43:15,704][123090] Updated weights for policy 1, policy_version 1508557 (0.0005) [2023-12-26 11:43:15,778][123090] Updated weights for policy 1, policy_version 1508567 (0.0005) [2023-12-26 11:43:15,892][123091] Updated weights for policy 0, policy_version 1518711 (0.0008) [2023-12-26 11:43:15,952][123091] Updated weights for policy 0, policy_version 1518721 (0.0009) [2023-12-26 11:43:16,000][123091] Updated weights for policy 0, policy_version 1518731 (0.0009) [2023-12-26 11:43:16,457][123090] Updated weights for policy 1, policy_version 1508577 (0.0007) [2023-12-26 11:43:16,514][123090] Updated weights for policy 1, policy_version 1508587 (0.0009) [2023-12-26 11:43:16,580][123090] Updated weights for policy 1, policy_version 1508597 (0.0009) [2023-12-26 11:43:16,644][123090] Updated weights for policy 1, policy_version 1508607 (0.0009) [2023-12-26 11:43:16,907][123091] Updated weights for policy 0, policy_version 1518741 (0.0009) [2023-12-26 11:43:16,968][123091] Updated weights for policy 0, policy_version 1518751 (0.0010) [2023-12-26 11:43:17,021][123091] Updated weights for policy 0, policy_version 1518761 (0.0010) [2023-12-26 11:43:17,396][123090] Updated weights for policy 1, policy_version 1508617 (0.0009) [2023-12-26 11:43:17,456][123090] Updated weights for policy 1, policy_version 1508627 (0.0009) [2023-12-26 11:43:17,518][123090] Updated weights for policy 1, policy_version 1508637 (0.0009) [2023-12-26 11:43:17,876][123091] Updated weights for policy 0, policy_version 1518771 (0.0010) [2023-12-26 11:43:17,925][123091] Updated weights for policy 0, policy_version 1518781 (0.0009) [2023-12-26 11:43:17,980][123091] Updated weights for policy 0, policy_version 1518791 (0.0009) [2023-12-26 11:43:18,328][123090] Updated weights for policy 1, policy_version 1508647 (0.0010) [2023-12-26 11:43:18,402][123090] Updated weights for policy 1, policy_version 1508657 (0.0010) [2023-12-26 11:43:18,467][123090] Updated weights for policy 1, policy_version 1508667 (0.0009) [2023-12-26 11:43:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 775036928. Throughput: 0: 8842.6, 1: 8778.8. Samples: 775048780. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:18,785][121949] Avg episode reward: [(0, '6330.560'), (1, '5035.125')] [2023-12-26 11:43:18,840][123091] Updated weights for policy 0, policy_version 1518801 (0.0010) [2023-12-26 11:43:18,904][123091] Updated weights for policy 0, policy_version 1518811 (0.0011) [2023-12-26 11:43:18,971][123091] Updated weights for policy 0, policy_version 1518821 (0.0009) [2023-12-26 11:43:19,041][123091] Updated weights for policy 0, policy_version 1518831 (0.0009) [2023-12-26 11:43:19,291][123090] Updated weights for policy 1, policy_version 1508677 (0.0008) [2023-12-26 11:43:19,369][123090] Updated weights for policy 1, policy_version 1508687 (0.0008) [2023-12-26 11:43:19,435][123090] Updated weights for policy 1, policy_version 1508697 (0.0010) [2023-12-26 11:43:19,939][123091] Updated weights for policy 0, policy_version 1518841 (0.0011) [2023-12-26 11:43:20,009][123091] Updated weights for policy 0, policy_version 1518851 (0.0010) [2023-12-26 11:43:20,075][123091] Updated weights for policy 0, policy_version 1518861 (0.0010) [2023-12-26 11:43:20,148][123090] Updated weights for policy 1, policy_version 1508707 (0.0009) [2023-12-26 11:43:20,204][123090] Updated weights for policy 1, policy_version 1508717 (0.0009) [2023-12-26 11:43:20,264][123090] Updated weights for policy 1, policy_version 1508727 (0.0009) [2023-12-26 11:43:20,913][123091] Updated weights for policy 0, policy_version 1518871 (0.0010) [2023-12-26 11:43:20,968][123091] Updated weights for policy 0, policy_version 1518881 (0.0008) [2023-12-26 11:43:21,024][123091] Updated weights for policy 0, policy_version 1518891 (0.0008) [2023-12-26 11:43:21,148][123090] Updated weights for policy 1, policy_version 1508737 (0.0010) [2023-12-26 11:43:21,221][123090] Updated weights for policy 1, policy_version 1508747 (0.0010) [2023-12-26 11:43:21,285][123090] Updated weights for policy 1, policy_version 1508757 (0.0009) [2023-12-26 11:43:21,339][123090] Updated weights for policy 1, policy_version 1508767 (0.0009) [2023-12-26 11:43:21,862][123091] Updated weights for policy 0, policy_version 1518901 (0.0011) [2023-12-26 11:43:21,925][123091] Updated weights for policy 0, policy_version 1518911 (0.0011) [2023-12-26 11:43:21,993][123091] Updated weights for policy 0, policy_version 1518921 (0.0011) [2023-12-26 11:43:22,180][123090] Updated weights for policy 1, policy_version 1508777 (0.0009) [2023-12-26 11:43:22,242][123090] Updated weights for policy 1, policy_version 1508787 (0.0010) [2023-12-26 11:43:22,312][123090] Updated weights for policy 1, policy_version 1508797 (0.0009) [2023-12-26 11:43:22,861][123091] Updated weights for policy 0, policy_version 1518931 (0.0011) [2023-12-26 11:43:22,924][123091] Updated weights for policy 0, policy_version 1518941 (0.0011) [2023-12-26 11:43:22,973][123091] Updated weights for policy 0, policy_version 1518951 (0.0011) [2023-12-26 11:43:23,178][123090] Updated weights for policy 1, policy_version 1508807 (0.0007) [2023-12-26 11:43:23,239][123090] Updated weights for policy 1, policy_version 1508817 (0.0011) [2023-12-26 11:43:23,291][123090] Updated weights for policy 1, policy_version 1508827 (0.0011) [2023-12-26 11:43:23,687][123091] Updated weights for policy 0, policy_version 1518961 (0.0010) [2023-12-26 11:43:23,752][123091] Updated weights for policy 0, policy_version 1518971 (0.0008) [2023-12-26 11:43:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 775118848. Throughput: 0: 8815.6, 1: 8768.5. Samples: 775098732. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:23,785][121949] Avg episode reward: [(0, '6298.204'), (1, '4969.551')] [2023-12-26 11:43:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001508832_386260992.pth... [2023-12-26 11:43:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001507808_385998848.pth [2023-12-26 11:43:23,820][123091] Updated weights for policy 0, policy_version 1518981 (0.0008) [2023-12-26 11:43:23,867][123091] Updated weights for policy 0, policy_version 1518991 (0.0005) [2023-12-26 11:43:23,871][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001518992_388866048.pth... [2023-12-26 11:43:23,874][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001517936_388595712.pth [2023-12-26 11:43:24,012][123090] Updated weights for policy 1, policy_version 1508837 (0.0007) [2023-12-26 11:43:24,064][123090] Updated weights for policy 1, policy_version 1508847 (0.0005) [2023-12-26 11:43:24,120][123090] Updated weights for policy 1, policy_version 1508857 (0.0006) [2023-12-26 11:43:24,518][123091] Updated weights for policy 0, policy_version 1519001 (0.0005) [2023-12-26 11:43:24,579][123091] Updated weights for policy 0, policy_version 1519011 (0.0008) [2023-12-26 11:43:24,637][123091] Updated weights for policy 0, policy_version 1519021 (0.0010) [2023-12-26 11:43:24,855][123090] Updated weights for policy 1, policy_version 1508867 (0.0007) [2023-12-26 11:43:24,918][123090] Updated weights for policy 1, policy_version 1508877 (0.0009) [2023-12-26 11:43:24,973][123090] Updated weights for policy 1, policy_version 1508887 (0.0009) [2023-12-26 11:43:25,382][123091] Updated weights for policy 0, policy_version 1519031 (0.0010) [2023-12-26 11:43:25,444][123091] Updated weights for policy 0, policy_version 1519041 (0.0010) [2023-12-26 11:43:25,503][123091] Updated weights for policy 0, policy_version 1519051 (0.0010) [2023-12-26 11:43:25,717][123090] Updated weights for policy 1, policy_version 1508897 (0.0009) [2023-12-26 11:43:25,774][123090] Updated weights for policy 1, policy_version 1508907 (0.0005) [2023-12-26 11:43:25,821][123090] Updated weights for policy 1, policy_version 1508917 (0.0005) [2023-12-26 11:43:25,872][123090] Updated weights for policy 1, policy_version 1508927 (0.0005) [2023-12-26 11:43:26,330][123091] Updated weights for policy 0, policy_version 1519061 (0.0010) [2023-12-26 11:43:26,389][123091] Updated weights for policy 0, policy_version 1519071 (0.0010) [2023-12-26 11:43:26,455][123091] Updated weights for policy 0, policy_version 1519081 (0.0011) [2023-12-26 11:43:26,607][123090] Updated weights for policy 1, policy_version 1508937 (0.0006) [2023-12-26 11:43:26,652][123090] Updated weights for policy 1, policy_version 1508947 (0.0005) [2023-12-26 11:43:26,711][123090] Updated weights for policy 1, policy_version 1508957 (0.0005) [2023-12-26 11:43:27,230][123091] Updated weights for policy 0, policy_version 1519091 (0.0009) [2023-12-26 11:43:27,306][123091] Updated weights for policy 0, policy_version 1519101 (0.0005) [2023-12-26 11:43:27,358][123091] Updated weights for policy 0, policy_version 1519111 (0.0005) [2023-12-26 11:43:27,372][123090] Updated weights for policy 1, policy_version 1508967 (0.0008) [2023-12-26 11:43:27,428][123090] Updated weights for policy 1, policy_version 1508977 (0.0010) [2023-12-26 11:43:27,475][123090] Updated weights for policy 1, policy_version 1508987 (0.0008) [2023-12-26 11:43:28,066][123091] Updated weights for policy 0, policy_version 1519121 (0.0007) [2023-12-26 11:43:28,120][123091] Updated weights for policy 0, policy_version 1519131 (0.0010) [2023-12-26 11:43:28,169][123091] Updated weights for policy 0, policy_version 1519141 (0.0009) [2023-12-26 11:43:28,221][123091] Updated weights for policy 0, policy_version 1519151 (0.0009) [2023-12-26 11:43:28,232][123090] Updated weights for policy 1, policy_version 1508997 (0.0009) [2023-12-26 11:43:28,289][123090] Updated weights for policy 1, policy_version 1509007 (0.0006) [2023-12-26 11:43:28,344][123090] Updated weights for policy 1, policy_version 1509017 (0.0006) [2023-12-26 11:43:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 775217152. Throughput: 0: 8925.0, 1: 8815.8. Samples: 775209368. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:28,785][121949] Avg episode reward: [(0, '6289.653'), (1, '5350.429')] [2023-12-26 11:43:29,061][123090] Updated weights for policy 1, policy_version 1509027 (0.0007) [2023-12-26 11:43:29,129][123090] Updated weights for policy 1, policy_version 1509037 (0.0005) [2023-12-26 11:43:29,187][123091] Updated weights for policy 0, policy_version 1519161 (0.0009) [2023-12-26 11:43:29,196][123090] Updated weights for policy 1, policy_version 1509047 (0.0005) [2023-12-26 11:43:29,255][123091] Updated weights for policy 0, policy_version 1519171 (0.0008) [2023-12-26 11:43:29,319][123091] Updated weights for policy 0, policy_version 1519181 (0.0007) [2023-12-26 11:43:29,992][123090] Updated weights for policy 1, policy_version 1509057 (0.0010) [2023-12-26 11:43:30,059][123090] Updated weights for policy 1, policy_version 1509067 (0.0010) [2023-12-26 11:43:30,084][123091] Updated weights for policy 0, policy_version 1519191 (0.0008) [2023-12-26 11:43:30,120][123090] Updated weights for policy 1, policy_version 1509077 (0.0007) [2023-12-26 11:43:30,154][123091] Updated weights for policy 0, policy_version 1519201 (0.0009) [2023-12-26 11:43:30,185][123090] Updated weights for policy 1, policy_version 1509087 (0.0006) [2023-12-26 11:43:30,223][123091] Updated weights for policy 0, policy_version 1519211 (0.0009) [2023-12-26 11:43:30,938][123090] Updated weights for policy 1, policy_version 1509097 (0.0005) [2023-12-26 11:43:31,012][123090] Updated weights for policy 1, policy_version 1509107 (0.0007) [2023-12-26 11:43:31,079][123090] Updated weights for policy 1, policy_version 1509117 (0.0008) [2023-12-26 11:43:31,095][123091] Updated weights for policy 0, policy_version 1519221 (0.0008) [2023-12-26 11:43:31,172][123091] Updated weights for policy 0, policy_version 1519231 (0.0009) [2023-12-26 11:43:31,229][123091] Updated weights for policy 0, policy_version 1519241 (0.0010) [2023-12-26 11:43:31,785][123090] Updated weights for policy 1, policy_version 1509127 (0.0009) [2023-12-26 11:43:31,838][123090] Updated weights for policy 1, policy_version 1509137 (0.0009) [2023-12-26 11:43:31,891][123090] Updated weights for policy 1, policy_version 1509147 (0.0008) [2023-12-26 11:43:32,079][123091] Updated weights for policy 0, policy_version 1519251 (0.0009) [2023-12-26 11:43:32,149][123091] Updated weights for policy 0, policy_version 1519261 (0.0009) [2023-12-26 11:43:32,203][123091] Updated weights for policy 0, policy_version 1519271 (0.0009) [2023-12-26 11:43:32,764][123090] Updated weights for policy 1, policy_version 1509157 (0.0010) [2023-12-26 11:43:32,824][123090] Updated weights for policy 1, policy_version 1509167 (0.0010) [2023-12-26 11:43:32,872][123090] Updated weights for policy 1, policy_version 1509177 (0.0009) [2023-12-26 11:43:33,029][123091] Updated weights for policy 0, policy_version 1519281 (0.0009) [2023-12-26 11:43:33,080][123091] Updated weights for policy 0, policy_version 1519291 (0.0009) [2023-12-26 11:43:33,134][123091] Updated weights for policy 0, policy_version 1519301 (0.0010) [2023-12-26 11:43:33,192][123091] Updated weights for policy 0, policy_version 1519311 (0.0008) [2023-12-26 11:43:33,689][123090] Updated weights for policy 1, policy_version 1509187 (0.0009) [2023-12-26 11:43:33,739][123090] Updated weights for policy 1, policy_version 1509197 (0.0009) [2023-12-26 11:43:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 775299072. Throughput: 0: 8796.8, 1: 8918.4. Samples: 775314432. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:33,785][121949] Avg episode reward: [(0, '6278.621'), (1, '5713.266')] [2023-12-26 11:43:33,800][123090] Updated weights for policy 1, policy_version 1509208 (0.0009) [2023-12-26 11:43:34,000][123091] Updated weights for policy 0, policy_version 1519321 (0.0010) [2023-12-26 11:43:34,043][123091] Updated weights for policy 0, policy_version 1519331 (0.0010) [2023-12-26 11:43:34,090][123091] Updated weights for policy 0, policy_version 1519341 (0.0010) [2023-12-26 11:43:34,606][123090] Updated weights for policy 1, policy_version 1509218 (0.0009) [2023-12-26 11:43:34,670][123090] Updated weights for policy 1, policy_version 1509228 (0.0010) [2023-12-26 11:43:34,742][123090] Updated weights for policy 1, policy_version 1509238 (0.0010) [2023-12-26 11:43:34,800][123090] Updated weights for policy 1, policy_version 1509248 (0.0010) [2023-12-26 11:43:34,861][123091] Updated weights for policy 0, policy_version 1519351 (0.0009) [2023-12-26 11:43:34,909][123091] Updated weights for policy 0, policy_version 1519361 (0.0009) [2023-12-26 11:43:34,956][123091] Updated weights for policy 0, policy_version 1519371 (0.0009) [2023-12-26 11:43:35,597][123090] Updated weights for policy 1, policy_version 1509258 (0.0009) [2023-12-26 11:43:35,652][123090] Updated weights for policy 1, policy_version 1509268 (0.0010) [2023-12-26 11:43:35,713][123090] Updated weights for policy 1, policy_version 1509278 (0.0009) [2023-12-26 11:43:35,804][123091] Updated weights for policy 0, policy_version 1519381 (0.0007) [2023-12-26 11:43:35,862][123091] Updated weights for policy 0, policy_version 1519391 (0.0005) [2023-12-26 11:43:35,916][123091] Updated weights for policy 0, policy_version 1519401 (0.0005) [2023-12-26 11:43:36,492][123090] Updated weights for policy 1, policy_version 1509288 (0.0010) [2023-12-26 11:43:36,556][123090] Updated weights for policy 1, policy_version 1509298 (0.0011) [2023-12-26 11:43:36,625][123090] Updated weights for policy 1, policy_version 1509308 (0.0011) [2023-12-26 11:43:36,705][123091] Updated weights for policy 0, policy_version 1519411 (0.0007) [2023-12-26 11:43:36,758][123091] Updated weights for policy 0, policy_version 1519421 (0.0009) [2023-12-26 11:43:36,806][123091] Updated weights for policy 0, policy_version 1519431 (0.0009) [2023-12-26 11:43:37,381][123090] Updated weights for policy 1, policy_version 1509318 (0.0008) [2023-12-26 11:43:37,456][123090] Updated weights for policy 1, policy_version 1509328 (0.0005) [2023-12-26 11:43:37,532][123090] Updated weights for policy 1, policy_version 1509338 (0.0005) [2023-12-26 11:43:37,617][123091] Updated weights for policy 0, policy_version 1519441 (0.0009) [2023-12-26 11:43:37,697][123091] Updated weights for policy 0, policy_version 1519451 (0.0011) [2023-12-26 11:43:37,761][123091] Updated weights for policy 0, policy_version 1519461 (0.0011) [2023-12-26 11:43:37,825][123091] Updated weights for policy 0, policy_version 1519471 (0.0011) [2023-12-26 11:43:38,158][123090] Updated weights for policy 1, policy_version 1509348 (0.0006) [2023-12-26 11:43:38,218][123090] Updated weights for policy 1, policy_version 1509358 (0.0006) [2023-12-26 11:43:38,288][123090] Updated weights for policy 1, policy_version 1509368 (0.0005) [2023-12-26 11:43:38,599][123091] Updated weights for policy 0, policy_version 1519481 (0.0011) [2023-12-26 11:43:38,663][123091] Updated weights for policy 0, policy_version 1519491 (0.0010) [2023-12-26 11:43:38,715][123091] Updated weights for policy 0, policy_version 1519501 (0.0011) [2023-12-26 11:43:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 775397376. Throughput: 0: 8849.1, 1: 8935.7. Samples: 775368476. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:38,785][121949] Avg episode reward: [(0, '6341.551'), (1, '5514.325')] [2023-12-26 11:43:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001519504_388997120.pth... [2023-12-26 11:43:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001509376_386400256.pth... [2023-12-26 11:43:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001518480_388734976.pth [2023-12-26 11:43:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001508320_386129920.pth [2023-12-26 11:43:39,000][123090] Updated weights for policy 1, policy_version 1509378 (0.0007) [2023-12-26 11:43:39,060][123090] Updated weights for policy 1, policy_version 1509388 (0.0005) [2023-12-26 11:43:39,126][123090] Updated weights for policy 1, policy_version 1509398 (0.0005) [2023-12-26 11:43:39,195][123090] Updated weights for policy 1, policy_version 1509408 (0.0006) [2023-12-26 11:43:39,568][123091] Updated weights for policy 0, policy_version 1519511 (0.0011) [2023-12-26 11:43:39,636][123091] Updated weights for policy 0, policy_version 1519521 (0.0011) [2023-12-26 11:43:39,698][123091] Updated weights for policy 0, policy_version 1519531 (0.0011) [2023-12-26 11:43:39,976][123090] Updated weights for policy 1, policy_version 1509418 (0.0011) [2023-12-26 11:43:40,041][123090] Updated weights for policy 1, policy_version 1509428 (0.0011) [2023-12-26 11:43:40,093][123090] Updated weights for policy 1, policy_version 1509438 (0.0010) [2023-12-26 11:43:40,539][123091] Updated weights for policy 0, policy_version 1519541 (0.0011) [2023-12-26 11:43:40,599][123091] Updated weights for policy 0, policy_version 1519551 (0.0011) [2023-12-26 11:43:40,660][123091] Updated weights for policy 0, policy_version 1519561 (0.0011) [2023-12-26 11:43:40,934][123090] Updated weights for policy 1, policy_version 1509448 (0.0011) [2023-12-26 11:43:40,982][123090] Updated weights for policy 1, policy_version 1509458 (0.0010) [2023-12-26 11:43:41,034][123090] Updated weights for policy 1, policy_version 1509468 (0.0010) [2023-12-26 11:43:41,491][123091] Updated weights for policy 0, policy_version 1519571 (0.0010) [2023-12-26 11:43:41,554][123091] Updated weights for policy 0, policy_version 1519581 (0.0008) [2023-12-26 11:43:41,620][123091] Updated weights for policy 0, policy_version 1519591 (0.0008) [2023-12-26 11:43:41,902][123090] Updated weights for policy 1, policy_version 1509478 (0.0011) [2023-12-26 11:43:41,957][123090] Updated weights for policy 1, policy_version 1509488 (0.0010) [2023-12-26 11:43:42,021][123090] Updated weights for policy 1, policy_version 1509498 (0.0011) [2023-12-26 11:43:42,428][123091] Updated weights for policy 0, policy_version 1519601 (0.0008) [2023-12-26 11:43:42,494][123091] Updated weights for policy 0, policy_version 1519611 (0.0006) [2023-12-26 11:43:42,557][123091] Updated weights for policy 0, policy_version 1519621 (0.0006) [2023-12-26 11:43:42,614][123091] Updated weights for policy 0, policy_version 1519631 (0.0009) [2023-12-26 11:43:42,800][123090] Updated weights for policy 1, policy_version 1509508 (0.0010) [2023-12-26 11:43:42,862][123090] Updated weights for policy 1, policy_version 1509518 (0.0010) [2023-12-26 11:43:42,920][123090] Updated weights for policy 1, policy_version 1509528 (0.0010) [2023-12-26 11:43:43,470][123091] Updated weights for policy 0, policy_version 1519641 (0.0010) [2023-12-26 11:43:43,529][123091] Updated weights for policy 0, policy_version 1519651 (0.0010) [2023-12-26 11:43:43,581][123091] Updated weights for policy 0, policy_version 1519661 (0.0010) [2023-12-26 11:43:43,609][123090] Updated weights for policy 1, policy_version 1509538 (0.0009) [2023-12-26 11:43:43,670][123090] Updated weights for policy 1, policy_version 1509548 (0.0005) [2023-12-26 11:43:43,724][123090] Updated weights for policy 1, policy_version 1509558 (0.0005) [2023-12-26 11:43:43,771][123090] Updated weights for policy 1, policy_version 1509568 (0.0005) [2023-12-26 11:43:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 775487488. Throughput: 0: 8738.5, 1: 8949.0. Samples: 775474612. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:43,785][121949] Avg episode reward: [(0, '6279.368'), (1, '5294.806')] [2023-12-26 11:43:44,307][123091] Updated weights for policy 0, policy_version 1519671 (0.0007) [2023-12-26 11:43:44,378][123091] Updated weights for policy 0, policy_version 1519681 (0.0005) [2023-12-26 11:43:44,447][123091] Updated weights for policy 0, policy_version 1519691 (0.0009) [2023-12-26 11:43:44,545][123090] Updated weights for policy 1, policy_version 1509578 (0.0010) [2023-12-26 11:43:44,589][123090] Updated weights for policy 1, policy_version 1509588 (0.0010) [2023-12-26 11:43:44,631][123090] Updated weights for policy 1, policy_version 1509598 (0.0009) [2023-12-26 11:43:45,237][123091] Updated weights for policy 0, policy_version 1519701 (0.0007) [2023-12-26 11:43:45,303][123091] Updated weights for policy 0, policy_version 1519711 (0.0006) [2023-12-26 11:43:45,369][123091] Updated weights for policy 0, policy_version 1519721 (0.0005) [2023-12-26 11:43:45,387][123090] Updated weights for policy 1, policy_version 1509608 (0.0009) [2023-12-26 11:43:45,451][123090] Updated weights for policy 1, policy_version 1509618 (0.0010) [2023-12-26 11:43:45,523][123090] Updated weights for policy 1, policy_version 1509628 (0.0011) [2023-12-26 11:43:46,124][123091] Updated weights for policy 0, policy_version 1519731 (0.0009) [2023-12-26 11:43:46,181][123090] Updated weights for policy 1, policy_version 1509638 (0.0010) [2023-12-26 11:43:46,183][123091] Updated weights for policy 0, policy_version 1519741 (0.0007) [2023-12-26 11:43:46,237][123090] Updated weights for policy 1, policy_version 1509648 (0.0010) [2023-12-26 11:43:46,244][123091] Updated weights for policy 0, policy_version 1519751 (0.0009) [2023-12-26 11:43:46,306][123090] Updated weights for policy 1, policy_version 1509658 (0.0010) [2023-12-26 11:43:46,995][123091] Updated weights for policy 0, policy_version 1519761 (0.0007) [2023-12-26 11:43:47,058][123091] Updated weights for policy 0, policy_version 1519771 (0.0008) [2023-12-26 11:43:47,110][123090] Updated weights for policy 1, policy_version 1509668 (0.0009) [2023-12-26 11:43:47,129][123091] Updated weights for policy 0, policy_version 1519781 (0.0005) [2023-12-26 11:43:47,179][123090] Updated weights for policy 1, policy_version 1509678 (0.0005) [2023-12-26 11:43:47,190][123091] Updated weights for policy 0, policy_version 1519791 (0.0007) [2023-12-26 11:43:47,240][123090] Updated weights for policy 1, policy_version 1509688 (0.0009) [2023-12-26 11:43:47,907][123091] Updated weights for policy 0, policy_version 1519801 (0.0006) [2023-12-26 11:43:47,965][123091] Updated weights for policy 0, policy_version 1519811 (0.0006) [2023-12-26 11:43:48,005][123090] Updated weights for policy 1, policy_version 1509698 (0.0011) [2023-12-26 11:43:48,013][123091] Updated weights for policy 0, policy_version 1519821 (0.0008) [2023-12-26 11:43:48,075][123090] Updated weights for policy 1, policy_version 1509708 (0.0010) [2023-12-26 11:43:48,130][123090] Updated weights for policy 1, policy_version 1509718 (0.0010) [2023-12-26 11:43:48,181][123090] Updated weights for policy 1, policy_version 1509728 (0.0006) [2023-12-26 11:43:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 775569408. Throughput: 0: 8781.2, 1: 9007.6. Samples: 775585572. Policy #0 lag: (min: 10.0, avg: 37.2, max: 40.0) [2023-12-26 11:43:48,785][121949] Avg episode reward: [(0, '6179.922'), (1, '5528.817')] [2023-12-26 11:43:48,882][123091] Updated weights for policy 0, policy_version 1519831 (0.0008) [2023-12-26 11:43:48,934][123091] Updated weights for policy 0, policy_version 1519841 (0.0010) [2023-12-26 11:43:48,965][123090] Updated weights for policy 1, policy_version 1509738 (0.0011) [2023-12-26 11:43:48,997][123091] Updated weights for policy 0, policy_version 1519851 (0.0011) [2023-12-26 11:43:49,024][123090] Updated weights for policy 1, policy_version 1509748 (0.0011) [2023-12-26 11:43:49,090][123090] Updated weights for policy 1, policy_version 1509758 (0.0010) [2023-12-26 11:43:49,794][123091] Updated weights for policy 0, policy_version 1519861 (0.0008) [2023-12-26 11:43:49,837][123090] Updated weights for policy 1, policy_version 1509768 (0.0009) [2023-12-26 11:43:49,863][123091] Updated weights for policy 0, policy_version 1519871 (0.0008) [2023-12-26 11:43:49,902][123090] Updated weights for policy 1, policy_version 1509778 (0.0011) [2023-12-26 11:43:49,930][123091] Updated weights for policy 0, policy_version 1519881 (0.0011) [2023-12-26 11:43:49,965][123090] Updated weights for policy 1, policy_version 1509788 (0.0008) [2023-12-26 11:43:50,722][123091] Updated weights for policy 0, policy_version 1519891 (0.0011) [2023-12-26 11:43:50,782][123091] Updated weights for policy 0, policy_version 1519901 (0.0010) [2023-12-26 11:43:50,806][123090] Updated weights for policy 1, policy_version 1509798 (0.0008) [2023-12-26 11:43:50,846][123091] Updated weights for policy 0, policy_version 1519911 (0.0011) [2023-12-26 11:43:50,870][123090] Updated weights for policy 1, policy_version 1509808 (0.0006) [2023-12-26 11:43:50,934][123090] Updated weights for policy 1, policy_version 1509818 (0.0008) [2023-12-26 11:43:51,678][123091] Updated weights for policy 0, policy_version 1519921 (0.0011) [2023-12-26 11:43:51,740][123091] Updated weights for policy 0, policy_version 1519931 (0.0009) [2023-12-26 11:43:51,777][123090] Updated weights for policy 1, policy_version 1509828 (0.0010) [2023-12-26 11:43:51,798][123091] Updated weights for policy 0, policy_version 1519941 (0.0006) [2023-12-26 11:43:51,839][123090] Updated weights for policy 1, policy_version 1509838 (0.0009) [2023-12-26 11:43:51,855][123091] Updated weights for policy 0, policy_version 1519951 (0.0005) [2023-12-26 11:43:51,916][123090] Updated weights for policy 1, policy_version 1509848 (0.0007) [2023-12-26 11:43:52,588][123091] Updated weights for policy 0, policy_version 1519961 (0.0009) [2023-12-26 11:43:52,651][123091] Updated weights for policy 0, policy_version 1519971 (0.0009) [2023-12-26 11:43:52,711][123091] Updated weights for policy 0, policy_version 1519981 (0.0009) [2023-12-26 11:43:52,780][123090] Updated weights for policy 1, policy_version 1509858 (0.0008) [2023-12-26 11:43:52,828][123090] Updated weights for policy 1, policy_version 1509868 (0.0009) [2023-12-26 11:43:52,877][123090] Updated weights for policy 1, policy_version 1509878 (0.0009) [2023-12-26 11:43:53,474][123091] Updated weights for policy 0, policy_version 1519991 (0.0006) [2023-12-26 11:43:53,537][123091] Updated weights for policy 0, policy_version 1520001 (0.0005) [2023-12-26 11:43:53,591][123091] Updated weights for policy 0, policy_version 1520011 (0.0009) [2023-12-26 11:43:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 775659520. Throughput: 0: 8746.1, 1: 8970.4. Samples: 775637016. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:43:53,785][121949] Avg episode reward: [(0, '6230.689'), (1, '5716.669')] [2023-12-26 11:43:53,787][123090] Updated weights for policy 1, policy_version 1509889 (0.0009) [2023-12-26 11:43:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001520016_389128192.pth... [2023-12-26 11:43:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001518992_388866048.pth [2023-12-26 11:43:53,847][123090] Updated weights for policy 1, policy_version 1509899 (0.0010) [2023-12-26 11:43:53,919][123090] Updated weights for policy 1, policy_version 1509909 (0.0010) [2023-12-26 11:43:53,995][123090] Updated weights for policy 1, policy_version 1509919 (0.0010) [2023-12-26 11:43:54,000][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001509920_386539520.pth... [2023-12-26 11:43:54,006][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001508832_386260992.pth [2023-12-26 11:43:54,267][123091] Updated weights for policy 0, policy_version 1520021 (0.0008) [2023-12-26 11:43:54,316][123091] Updated weights for policy 0, policy_version 1520031 (0.0008) [2023-12-26 11:43:54,375][123091] Updated weights for policy 0, policy_version 1520041 (0.0010) [2023-12-26 11:43:54,862][123090] Updated weights for policy 1, policy_version 1509929 (0.0006) [2023-12-26 11:43:54,939][123090] Updated weights for policy 1, policy_version 1509939 (0.0005) [2023-12-26 11:43:55,005][123090] Updated weights for policy 1, policy_version 1509949 (0.0005) [2023-12-26 11:43:55,144][123091] Updated weights for policy 0, policy_version 1520051 (0.0010) [2023-12-26 11:43:55,196][123091] Updated weights for policy 0, policy_version 1520061 (0.0009) [2023-12-26 11:43:55,258][123091] Updated weights for policy 0, policy_version 1520071 (0.0010) [2023-12-26 11:43:55,626][123090] Updated weights for policy 1, policy_version 1509959 (0.0009) [2023-12-26 11:43:55,681][123090] Updated weights for policy 1, policy_version 1509969 (0.0010) [2023-12-26 11:43:55,729][123090] Updated weights for policy 1, policy_version 1509979 (0.0010) [2023-12-26 11:43:56,038][123091] Updated weights for policy 0, policy_version 1520082 (0.0009) [2023-12-26 11:43:56,085][123091] Updated weights for policy 0, policy_version 1520092 (0.0005) [2023-12-26 11:43:56,137][123091] Updated weights for policy 0, policy_version 1520102 (0.0005) [2023-12-26 11:43:56,197][123091] Updated weights for policy 0, policy_version 1520112 (0.0006) [2023-12-26 11:43:56,551][123090] Updated weights for policy 1, policy_version 1509989 (0.0010) [2023-12-26 11:43:56,607][123090] Updated weights for policy 1, policy_version 1509999 (0.0011) [2023-12-26 11:43:56,655][123090] Updated weights for policy 1, policy_version 1510009 (0.0010) [2023-12-26 11:43:56,979][123091] Updated weights for policy 0, policy_version 1520122 (0.0010) [2023-12-26 11:43:57,022][123091] Updated weights for policy 0, policy_version 1520132 (0.0010) [2023-12-26 11:43:57,083][123091] Updated weights for policy 0, policy_version 1520142 (0.0010) [2023-12-26 11:43:57,430][123090] Updated weights for policy 1, policy_version 1510019 (0.0009) [2023-12-26 11:43:57,479][123090] Updated weights for policy 1, policy_version 1510029 (0.0005) [2023-12-26 11:43:57,522][123090] Updated weights for policy 1, policy_version 1510039 (0.0005) [2023-12-26 11:43:57,918][123091] Updated weights for policy 0, policy_version 1520152 (0.0009) [2023-12-26 11:43:57,976][123091] Updated weights for policy 0, policy_version 1520162 (0.0010) [2023-12-26 11:43:58,031][123091] Updated weights for policy 0, policy_version 1520172 (0.0010) [2023-12-26 11:43:58,296][123090] Updated weights for policy 1, policy_version 1510049 (0.0006) [2023-12-26 11:43:58,371][123090] Updated weights for policy 1, policy_version 1510059 (0.0009) [2023-12-26 11:43:58,434][123090] Updated weights for policy 1, policy_version 1510069 (0.0010) [2023-12-26 11:43:58,501][123090] Updated weights for policy 1, policy_version 1510079 (0.0008) [2023-12-26 11:43:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 775749632. Throughput: 0: 8843.9, 1: 8990.1. Samples: 775745156. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:43:58,785][121949] Avg episode reward: [(0, '6362.624'), (1, '5546.598')] [2023-12-26 11:43:58,892][123091] Updated weights for policy 0, policy_version 1520182 (0.0008) [2023-12-26 11:43:58,964][123091] Updated weights for policy 0, policy_version 1520192 (0.0010) [2023-12-26 11:43:59,027][123091] Updated weights for policy 0, policy_version 1520202 (0.0010) [2023-12-26 11:43:59,416][123090] Updated weights for policy 1, policy_version 1510089 (0.0008) [2023-12-26 11:43:59,481][123090] Updated weights for policy 1, policy_version 1510099 (0.0009) [2023-12-26 11:43:59,540][123090] Updated weights for policy 1, policy_version 1510109 (0.0008) [2023-12-26 11:43:59,877][123091] Updated weights for policy 0, policy_version 1520212 (0.0010) [2023-12-26 11:43:59,933][123091] Updated weights for policy 0, policy_version 1520222 (0.0010) [2023-12-26 11:43:59,996][123091] Updated weights for policy 0, policy_version 1520232 (0.0010) [2023-12-26 11:44:00,365][123090] Updated weights for policy 1, policy_version 1510119 (0.0007) [2023-12-26 11:44:00,429][123090] Updated weights for policy 1, policy_version 1510129 (0.0007) [2023-12-26 11:44:00,489][123090] Updated weights for policy 1, policy_version 1510139 (0.0007) [2023-12-26 11:44:00,881][123091] Updated weights for policy 0, policy_version 1520242 (0.0010) [2023-12-26 11:44:00,951][123091] Updated weights for policy 0, policy_version 1520252 (0.0007) [2023-12-26 11:44:01,006][123091] Updated weights for policy 0, policy_version 1520262 (0.0005) [2023-12-26 11:44:01,078][123091] Updated weights for policy 0, policy_version 1520272 (0.0010) [2023-12-26 11:44:01,111][123090] Updated weights for policy 1, policy_version 1510149 (0.0008) [2023-12-26 11:44:01,172][123090] Updated weights for policy 1, policy_version 1510159 (0.0008) [2023-12-26 11:44:01,223][123090] Updated weights for policy 1, policy_version 1510169 (0.0009) [2023-12-26 11:44:01,864][123091] Updated weights for policy 0, policy_version 1520282 (0.0009) [2023-12-26 11:44:01,928][123091] Updated weights for policy 0, policy_version 1520292 (0.0010) [2023-12-26 11:44:01,982][123091] Updated weights for policy 0, policy_version 1520302 (0.0010) [2023-12-26 11:44:02,089][123090] Updated weights for policy 1, policy_version 1510179 (0.0009) [2023-12-26 11:44:02,140][123090] Updated weights for policy 1, policy_version 1510190 (0.0010) [2023-12-26 11:44:02,199][123090] Updated weights for policy 1, policy_version 1510200 (0.0009) [2023-12-26 11:44:02,682][123091] Updated weights for policy 0, policy_version 1520312 (0.0007) [2023-12-26 11:44:02,733][123091] Updated weights for policy 0, policy_version 1520322 (0.0009) [2023-12-26 11:44:02,793][123091] Updated weights for policy 0, policy_version 1520332 (0.0009) [2023-12-26 11:44:03,015][123090] Updated weights for policy 1, policy_version 1510210 (0.0005) [2023-12-26 11:44:03,065][123090] Updated weights for policy 1, policy_version 1510220 (0.0005) [2023-12-26 11:44:03,116][123090] Updated weights for policy 1, policy_version 1510230 (0.0006) [2023-12-26 11:44:03,175][123090] Updated weights for policy 1, policy_version 1510240 (0.0006) [2023-12-26 11:44:03,636][123091] Updated weights for policy 0, policy_version 1520342 (0.0008) [2023-12-26 11:44:03,692][123091] Updated weights for policy 0, policy_version 1520352 (0.0009) [2023-12-26 11:44:03,745][123091] Updated weights for policy 0, policy_version 1520364 (0.0010) [2023-12-26 11:44:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 775839744. Throughput: 0: 8799.2, 1: 8996.0. Samples: 775849564. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:03,785][121949] Avg episode reward: [(0, '6360.021'), (1, '5422.384')] [2023-12-26 11:44:03,958][123090] Updated weights for policy 1, policy_version 1510250 (0.0005) [2023-12-26 11:44:04,017][123090] Updated weights for policy 1, policy_version 1510260 (0.0005) [2023-12-26 11:44:04,070][123090] Updated weights for policy 1, policy_version 1510270 (0.0005) [2023-12-26 11:44:04,585][123091] Updated weights for policy 0, policy_version 1520374 (0.0010) [2023-12-26 11:44:04,638][123091] Updated weights for policy 0, policy_version 1520384 (0.0009) [2023-12-26 11:44:04,691][123091] Updated weights for policy 0, policy_version 1520394 (0.0010) [2023-12-26 11:44:04,751][123090] Updated weights for policy 1, policy_version 1510280 (0.0007) [2023-12-26 11:44:04,797][123090] Updated weights for policy 1, policy_version 1510290 (0.0005) [2023-12-26 11:44:04,847][123090] Updated weights for policy 1, policy_version 1510300 (0.0005) [2023-12-26 11:44:05,595][123090] Updated weights for policy 1, policy_version 1510310 (0.0005) [2023-12-26 11:44:05,613][123091] Updated weights for policy 0, policy_version 1520404 (0.0009) [2023-12-26 11:44:05,648][123090] Updated weights for policy 1, policy_version 1510320 (0.0005) [2023-12-26 11:44:05,675][123091] Updated weights for policy 0, policy_version 1520414 (0.0010) [2023-12-26 11:44:05,699][123090] Updated weights for policy 1, policy_version 1510330 (0.0005) [2023-12-26 11:44:05,736][123091] Updated weights for policy 0, policy_version 1520424 (0.0009) [2023-12-26 11:44:06,308][123090] Updated weights for policy 1, policy_version 1510340 (0.0005) [2023-12-26 11:44:06,379][123090] Updated weights for policy 1, policy_version 1510350 (0.0006) [2023-12-26 11:44:06,443][123090] Updated weights for policy 1, policy_version 1510360 (0.0008) [2023-12-26 11:44:06,638][123091] Updated weights for policy 0, policy_version 1520435 (0.0010) [2023-12-26 11:44:06,703][123091] Updated weights for policy 0, policy_version 1520445 (0.0009) [2023-12-26 11:44:06,772][123091] Updated weights for policy 0, policy_version 1520455 (0.0009) [2023-12-26 11:44:07,243][123090] Updated weights for policy 1, policy_version 1510370 (0.0010) [2023-12-26 11:44:07,306][123090] Updated weights for policy 1, policy_version 1510380 (0.0010) [2023-12-26 11:44:07,365][123090] Updated weights for policy 1, policy_version 1510390 (0.0010) [2023-12-26 11:44:07,431][123090] Updated weights for policy 1, policy_version 1510400 (0.0010) [2023-12-26 11:44:07,604][123091] Updated weights for policy 0, policy_version 1520465 (0.0008) [2023-12-26 11:44:07,670][123091] Updated weights for policy 0, policy_version 1520475 (0.0005) [2023-12-26 11:44:07,731][123091] Updated weights for policy 0, policy_version 1520485 (0.0005) [2023-12-26 11:44:07,796][123091] Updated weights for policy 0, policy_version 1520495 (0.0006) [2023-12-26 11:44:08,143][123090] Updated weights for policy 1, policy_version 1510410 (0.0005) [2023-12-26 11:44:08,203][123090] Updated weights for policy 1, policy_version 1510420 (0.0006) [2023-12-26 11:44:08,254][123090] Updated weights for policy 1, policy_version 1510430 (0.0006) [2023-12-26 11:44:08,488][123091] Updated weights for policy 0, policy_version 1520505 (0.0009) [2023-12-26 11:44:08,548][123091] Updated weights for policy 0, policy_version 1520515 (0.0009) [2023-12-26 11:44:08,605][123091] Updated weights for policy 0, policy_version 1520525 (0.0009) [2023-12-26 11:44:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 775929856. Throughput: 0: 8792.0, 1: 9099.9. Samples: 775903864. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:08,785][121949] Avg episode reward: [(0, '6285.380'), (1, '5517.004')] [2023-12-26 11:44:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001520528_389259264.pth... [2023-12-26 11:44:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001510432_386670592.pth... [2023-12-26 11:44:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001519504_388997120.pth [2023-12-26 11:44:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001509376_386400256.pth [2023-12-26 11:44:08,966][123090] Updated weights for policy 1, policy_version 1510440 (0.0006) [2023-12-26 11:44:09,036][123090] Updated weights for policy 1, policy_version 1510450 (0.0005) [2023-12-26 11:44:09,100][123090] Updated weights for policy 1, policy_version 1510460 (0.0005) [2023-12-26 11:44:09,488][123091] Updated weights for policy 0, policy_version 1520535 (0.0009) [2023-12-26 11:44:09,538][123091] Updated weights for policy 0, policy_version 1520545 (0.0009) [2023-12-26 11:44:09,591][123091] Updated weights for policy 0, policy_version 1520555 (0.0010) [2023-12-26 11:44:09,812][123090] Updated weights for policy 1, policy_version 1510470 (0.0009) [2023-12-26 11:44:09,881][123090] Updated weights for policy 1, policy_version 1510480 (0.0011) [2023-12-26 11:44:09,942][123090] Updated weights for policy 1, policy_version 1510490 (0.0011) [2023-12-26 11:44:10,480][123091] Updated weights for policy 0, policy_version 1520565 (0.0009) [2023-12-26 11:44:10,528][123091] Updated weights for policy 0, policy_version 1520575 (0.0009) [2023-12-26 11:44:10,580][123091] Updated weights for policy 0, policy_version 1520585 (0.0009) [2023-12-26 11:44:10,706][123090] Updated weights for policy 1, policy_version 1510500 (0.0008) [2023-12-26 11:44:10,768][123090] Updated weights for policy 1, policy_version 1510510 (0.0005) [2023-12-26 11:44:10,819][123090] Updated weights for policy 1, policy_version 1510520 (0.0007) [2023-12-26 11:44:11,459][123091] Updated weights for policy 0, policy_version 1520595 (0.0008) [2023-12-26 11:44:11,527][123091] Updated weights for policy 0, policy_version 1520605 (0.0005) [2023-12-26 11:44:11,583][123091] Updated weights for policy 0, policy_version 1520615 (0.0006) [2023-12-26 11:44:11,678][123090] Updated weights for policy 1, policy_version 1510530 (0.0010) [2023-12-26 11:44:11,746][123090] Updated weights for policy 1, policy_version 1510540 (0.0009) [2023-12-26 11:44:11,811][123090] Updated weights for policy 1, policy_version 1510550 (0.0009) [2023-12-26 11:44:11,872][123090] Updated weights for policy 1, policy_version 1510560 (0.0009) [2023-12-26 11:44:12,390][123091] Updated weights for policy 0, policy_version 1520625 (0.0008) [2023-12-26 11:44:12,453][123091] Updated weights for policy 0, policy_version 1520635 (0.0010) [2023-12-26 11:44:12,516][123091] Updated weights for policy 0, policy_version 1520645 (0.0009) [2023-12-26 11:44:12,575][123091] Updated weights for policy 0, policy_version 1520655 (0.0010) [2023-12-26 11:44:12,715][123090] Updated weights for policy 1, policy_version 1510570 (0.0005) [2023-12-26 11:44:12,762][123090] Updated weights for policy 1, policy_version 1510580 (0.0005) [2023-12-26 11:44:12,833][123090] Updated weights for policy 1, policy_version 1510590 (0.0008) [2023-12-26 11:44:13,453][123091] Updated weights for policy 0, policy_version 1520665 (0.0010) [2023-12-26 11:44:13,528][123091] Updated weights for policy 0, policy_version 1520675 (0.0009) [2023-12-26 11:44:13,587][123091] Updated weights for policy 0, policy_version 1520685 (0.0006) [2023-12-26 11:44:13,599][123090] Updated weights for policy 1, policy_version 1510600 (0.0007) [2023-12-26 11:44:13,672][123090] Updated weights for policy 1, policy_version 1510610 (0.0005) [2023-12-26 11:44:13,733][123090] Updated weights for policy 1, policy_version 1510620 (0.0005) [2023-12-26 11:44:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 776019968. Throughput: 0: 8705.4, 1: 9061.2. Samples: 776008860. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:13,785][121949] Avg episode reward: [(0, '6354.567'), (1, '5731.513')] [2023-12-26 11:44:14,260][123091] Updated weights for policy 0, policy_version 1520695 (0.0006) [2023-12-26 11:44:14,311][123091] Updated weights for policy 0, policy_version 1520705 (0.0005) [2023-12-26 11:44:14,363][123091] Updated weights for policy 0, policy_version 1520715 (0.0005) [2023-12-26 11:44:14,503][123090] Updated weights for policy 1, policy_version 1510630 (0.0007) [2023-12-26 11:44:14,563][123090] Updated weights for policy 1, policy_version 1510640 (0.0008) [2023-12-26 11:44:14,641][123090] Updated weights for policy 1, policy_version 1510650 (0.0009) [2023-12-26 11:44:15,147][123091] Updated weights for policy 0, policy_version 1520725 (0.0007) [2023-12-26 11:44:15,210][123091] Updated weights for policy 0, policy_version 1520735 (0.0008) [2023-12-26 11:44:15,274][123091] Updated weights for policy 0, policy_version 1520745 (0.0011) [2023-12-26 11:44:15,486][123090] Updated weights for policy 1, policy_version 1510660 (0.0007) [2023-12-26 11:44:15,554][123090] Updated weights for policy 1, policy_version 1510670 (0.0009) [2023-12-26 11:44:15,608][123090] Updated weights for policy 1, policy_version 1510681 (0.0008) [2023-12-26 11:44:16,019][123091] Updated weights for policy 0, policy_version 1520755 (0.0009) [2023-12-26 11:44:16,068][123091] Updated weights for policy 0, policy_version 1520765 (0.0005) [2023-12-26 11:44:16,115][123091] Updated weights for policy 0, policy_version 1520775 (0.0005) [2023-12-26 11:44:16,447][123090] Updated weights for policy 1, policy_version 1510691 (0.0009) [2023-12-26 11:44:16,502][123090] Updated weights for policy 1, policy_version 1510701 (0.0009) [2023-12-26 11:44:16,565][123090] Updated weights for policy 1, policy_version 1510711 (0.0008) [2023-12-26 11:44:16,873][123091] Updated weights for policy 0, policy_version 1520785 (0.0006) [2023-12-26 11:44:16,937][123091] Updated weights for policy 0, policy_version 1520795 (0.0010) [2023-12-26 11:44:17,004][123091] Updated weights for policy 0, policy_version 1520805 (0.0009) [2023-12-26 11:44:17,064][123091] Updated weights for policy 0, policy_version 1520815 (0.0010) [2023-12-26 11:44:17,409][123090] Updated weights for policy 1, policy_version 1510721 (0.0009) [2023-12-26 11:44:17,472][123090] Updated weights for policy 1, policy_version 1510731 (0.0009) [2023-12-26 11:44:17,527][123090] Updated weights for policy 1, policy_version 1510741 (0.0009) [2023-12-26 11:44:17,581][123090] Updated weights for policy 1, policy_version 1510751 (0.0010) [2023-12-26 11:44:17,819][123091] Updated weights for policy 0, policy_version 1520825 (0.0009) [2023-12-26 11:44:17,867][123091] Updated weights for policy 0, policy_version 1520835 (0.0009) [2023-12-26 11:44:17,913][123091] Updated weights for policy 0, policy_version 1520845 (0.0006) [2023-12-26 11:44:18,441][123090] Updated weights for policy 1, policy_version 1510761 (0.0006) [2023-12-26 11:44:18,495][123090] Updated weights for policy 1, policy_version 1510771 (0.0006) [2023-12-26 11:44:18,550][123090] Updated weights for policy 1, policy_version 1510781 (0.0008) [2023-12-26 11:44:18,679][123091] Updated weights for policy 0, policy_version 1520855 (0.0008) [2023-12-26 11:44:18,744][123091] Updated weights for policy 0, policy_version 1520865 (0.0009) [2023-12-26 11:44:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 776101888. Throughput: 0: 8816.8, 1: 8979.6. Samples: 776115268. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:18,784][121949] Avg episode reward: [(0, '6244.824'), (1, '5667.156')] [2023-12-26 11:44:18,802][123091] Updated weights for policy 0, policy_version 1520875 (0.0010) [2023-12-26 11:44:19,310][123090] Updated weights for policy 1, policy_version 1510791 (0.0008) [2023-12-26 11:44:19,382][123090] Updated weights for policy 1, policy_version 1510801 (0.0008) [2023-12-26 11:44:19,451][123090] Updated weights for policy 1, policy_version 1510811 (0.0010) [2023-12-26 11:44:19,678][123091] Updated weights for policy 0, policy_version 1520885 (0.0009) [2023-12-26 11:44:19,747][123091] Updated weights for policy 0, policy_version 1520895 (0.0010) [2023-12-26 11:44:19,810][123091] Updated weights for policy 0, policy_version 1520905 (0.0009) [2023-12-26 11:44:20,237][123090] Updated weights for policy 1, policy_version 1510821 (0.0009) [2023-12-26 11:44:20,307][123090] Updated weights for policy 1, policy_version 1510831 (0.0008) [2023-12-26 11:44:20,370][123090] Updated weights for policy 1, policy_version 1510841 (0.0008) [2023-12-26 11:44:20,687][123091] Updated weights for policy 0, policy_version 1520915 (0.0009) [2023-12-26 11:44:20,743][123091] Updated weights for policy 0, policy_version 1520925 (0.0010) [2023-12-26 11:44:20,801][123091] Updated weights for policy 0, policy_version 1520935 (0.0010) [2023-12-26 11:44:21,158][123090] Updated weights for policy 1, policy_version 1510851 (0.0009) [2023-12-26 11:44:21,213][123090] Updated weights for policy 1, policy_version 1510861 (0.0010) [2023-12-26 11:44:21,275][123090] Updated weights for policy 1, policy_version 1510871 (0.0009) [2023-12-26 11:44:21,676][123091] Updated weights for policy 0, policy_version 1520945 (0.0012) [2023-12-26 11:44:21,744][123091] Updated weights for policy 0, policy_version 1520955 (0.0011) [2023-12-26 11:44:21,805][123091] Updated weights for policy 0, policy_version 1520965 (0.0011) [2023-12-26 11:44:21,859][123091] Updated weights for policy 0, policy_version 1520975 (0.0008) [2023-12-26 11:44:22,091][123090] Updated weights for policy 1, policy_version 1510881 (0.0009) [2023-12-26 11:44:22,146][123090] Updated weights for policy 1, policy_version 1510891 (0.0008) [2023-12-26 11:44:22,204][123090] Updated weights for policy 1, policy_version 1510901 (0.0009) [2023-12-26 11:44:22,277][123090] Updated weights for policy 1, policy_version 1510911 (0.0009) [2023-12-26 11:44:22,715][123091] Updated weights for policy 0, policy_version 1520985 (0.0010) [2023-12-26 11:44:22,784][123091] Updated weights for policy 0, policy_version 1520995 (0.0011) [2023-12-26 11:44:22,839][123091] Updated weights for policy 0, policy_version 1521005 (0.0010) [2023-12-26 11:44:23,146][123090] Updated weights for policy 1, policy_version 1510921 (0.0009) [2023-12-26 11:44:23,211][123090] Updated weights for policy 1, policy_version 1510931 (0.0010) [2023-12-26 11:44:23,281][123090] Updated weights for policy 1, policy_version 1510941 (0.0009) [2023-12-26 11:44:23,636][123091] Updated weights for policy 0, policy_version 1521015 (0.0010) [2023-12-26 11:44:23,684][123091] Updated weights for policy 0, policy_version 1521025 (0.0010) [2023-12-26 11:44:23,738][123091] Updated weights for policy 0, policy_version 1521035 (0.0010) [2023-12-26 11:44:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 776192000. Throughput: 0: 8740.9, 1: 8973.5. Samples: 776165616. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:23,784][121949] Avg episode reward: [(0, '6281.511'), (1, '5586.911')] [2023-12-26 11:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001510944_386801664.pth... [2023-12-26 11:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001521040_389390336.pth... [2023-12-26 11:44:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001509920_386539520.pth [2023-12-26 11:44:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001520016_389128192.pth [2023-12-26 11:44:24,118][123090] Updated weights for policy 1, policy_version 1510951 (0.0009) [2023-12-26 11:44:24,172][123090] Updated weights for policy 1, policy_version 1510961 (0.0010) [2023-12-26 11:44:24,233][123090] Updated weights for policy 1, policy_version 1510971 (0.0009) [2023-12-26 11:44:24,478][123091] Updated weights for policy 0, policy_version 1521045 (0.0010) [2023-12-26 11:44:24,530][123091] Updated weights for policy 0, policy_version 1521055 (0.0010) [2023-12-26 11:44:24,582][123091] Updated weights for policy 0, policy_version 1521065 (0.0010) [2023-12-26 11:44:25,100][123090] Updated weights for policy 1, policy_version 1510981 (0.0009) [2023-12-26 11:44:25,167][123090] Updated weights for policy 1, policy_version 1510991 (0.0009) [2023-12-26 11:44:25,234][123090] Updated weights for policy 1, policy_version 1511001 (0.0009) [2023-12-26 11:44:25,423][123091] Updated weights for policy 0, policy_version 1521075 (0.0011) [2023-12-26 11:44:25,482][123091] Updated weights for policy 0, policy_version 1521085 (0.0010) [2023-12-26 11:44:25,547][123091] Updated weights for policy 0, policy_version 1521095 (0.0011) [2023-12-26 11:44:26,043][123090] Updated weights for policy 1, policy_version 1511011 (0.0008) [2023-12-26 11:44:26,108][123090] Updated weights for policy 1, policy_version 1511021 (0.0009) [2023-12-26 11:44:26,171][123090] Updated weights for policy 1, policy_version 1511031 (0.0009) [2023-12-26 11:44:26,360][123091] Updated weights for policy 0, policy_version 1521105 (0.0010) [2023-12-26 11:44:26,430][123091] Updated weights for policy 0, policy_version 1521115 (0.0011) [2023-12-26 11:44:26,489][123091] Updated weights for policy 0, policy_version 1521125 (0.0011) [2023-12-26 11:44:26,537][123091] Updated weights for policy 0, policy_version 1521135 (0.0010) [2023-12-26 11:44:26,906][123090] Updated weights for policy 1, policy_version 1511041 (0.0008) [2023-12-26 11:44:26,971][123090] Updated weights for policy 1, policy_version 1511051 (0.0009) [2023-12-26 11:44:27,018][123090] Updated weights for policy 1, policy_version 1511061 (0.0010) [2023-12-26 11:44:27,079][123090] Updated weights for policy 1, policy_version 1511071 (0.0010) [2023-12-26 11:44:27,367][123091] Updated weights for policy 0, policy_version 1521145 (0.0007) [2023-12-26 11:44:27,433][123091] Updated weights for policy 0, policy_version 1521155 (0.0005) [2023-12-26 11:44:27,496][123091] Updated weights for policy 0, policy_version 1521165 (0.0005) [2023-12-26 11:44:27,747][123090] Updated weights for policy 1, policy_version 1511081 (0.0006) [2023-12-26 11:44:27,801][123090] Updated weights for policy 1, policy_version 1511091 (0.0005) [2023-12-26 11:44:27,857][123090] Updated weights for policy 1, policy_version 1511101 (0.0005) [2023-12-26 11:44:28,136][123091] Updated weights for policy 0, policy_version 1521175 (0.0005) [2023-12-26 11:44:28,185][123091] Updated weights for policy 0, policy_version 1521185 (0.0005) [2023-12-26 11:44:28,244][123091] Updated weights for policy 0, policy_version 1521195 (0.0005) [2023-12-26 11:44:28,607][123090] Updated weights for policy 1, policy_version 1511111 (0.0009) [2023-12-26 11:44:28,678][123090] Updated weights for policy 1, policy_version 1511121 (0.0010) [2023-12-26 11:44:28,734][123090] Updated weights for policy 1, policy_version 1511131 (0.0009) [2023-12-26 11:44:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 776282112. Throughput: 0: 8771.2, 1: 8926.0. Samples: 776270984. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:28,784][121949] Avg episode reward: [(0, '6366.061'), (1, '5768.516')] [2023-12-26 11:44:28,976][123091] Updated weights for policy 0, policy_version 1521205 (0.0008) [2023-12-26 11:44:29,038][123091] Updated weights for policy 0, policy_version 1521215 (0.0010) [2023-12-26 11:44:29,099][123091] Updated weights for policy 0, policy_version 1521225 (0.0010) [2023-12-26 11:44:29,523][123090] Updated weights for policy 1, policy_version 1511141 (0.0009) [2023-12-26 11:44:29,585][123090] Updated weights for policy 1, policy_version 1511151 (0.0010) [2023-12-26 11:44:29,644][123090] Updated weights for policy 1, policy_version 1511161 (0.0010) [2023-12-26 11:44:29,928][123091] Updated weights for policy 0, policy_version 1521235 (0.0009) [2023-12-26 11:44:30,002][123091] Updated weights for policy 0, policy_version 1521245 (0.0009) [2023-12-26 11:44:30,064][123091] Updated weights for policy 0, policy_version 1521255 (0.0009) [2023-12-26 11:44:30,404][123090] Updated weights for policy 1, policy_version 1511171 (0.0010) [2023-12-26 11:44:30,469][123090] Updated weights for policy 1, policy_version 1511181 (0.0010) [2023-12-26 11:44:30,536][123090] Updated weights for policy 1, policy_version 1511191 (0.0010) [2023-12-26 11:44:30,748][123091] Updated weights for policy 0, policy_version 1521265 (0.0008) [2023-12-26 11:44:30,802][123091] Updated weights for policy 0, policy_version 1521275 (0.0005) [2023-12-26 11:44:30,870][123091] Updated weights for policy 0, policy_version 1521285 (0.0007) [2023-12-26 11:44:30,940][123091] Updated weights for policy 0, policy_version 1521295 (0.0011) [2023-12-26 11:44:31,329][123090] Updated weights for policy 1, policy_version 1511201 (0.0010) [2023-12-26 11:44:31,402][123090] Updated weights for policy 1, policy_version 1511211 (0.0009) [2023-12-26 11:44:31,451][123090] Updated weights for policy 1, policy_version 1511221 (0.0006) [2023-12-26 11:44:31,503][123090] Updated weights for policy 1, policy_version 1511231 (0.0010) [2023-12-26 11:44:31,712][123091] Updated weights for policy 0, policy_version 1521305 (0.0010) [2023-12-26 11:44:31,775][123091] Updated weights for policy 0, policy_version 1521315 (0.0008) [2023-12-26 11:44:31,831][123091] Updated weights for policy 0, policy_version 1521325 (0.0005) [2023-12-26 11:44:32,337][123090] Updated weights for policy 1, policy_version 1511241 (0.0009) [2023-12-26 11:44:32,400][123090] Updated weights for policy 1, policy_version 1511251 (0.0009) [2023-12-26 11:44:32,457][123090] Updated weights for policy 1, policy_version 1511261 (0.0009) [2023-12-26 11:44:32,589][123091] Updated weights for policy 0, policy_version 1521335 (0.0006) [2023-12-26 11:44:32,660][123091] Updated weights for policy 0, policy_version 1521345 (0.0009) [2023-12-26 11:44:32,725][123091] Updated weights for policy 0, policy_version 1521355 (0.0010) [2023-12-26 11:44:33,223][123090] Updated weights for policy 1, policy_version 1511271 (0.0006) [2023-12-26 11:44:33,276][123090] Updated weights for policy 1, policy_version 1511281 (0.0005) [2023-12-26 11:44:33,323][123090] Updated weights for policy 1, policy_version 1511291 (0.0005) [2023-12-26 11:44:33,422][123091] Updated weights for policy 0, policy_version 1521365 (0.0009) [2023-12-26 11:44:33,480][123091] Updated weights for policy 0, policy_version 1521375 (0.0006) [2023-12-26 11:44:33,528][123091] Updated weights for policy 0, policy_version 1521385 (0.0009) [2023-12-26 11:44:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 776372224. Throughput: 0: 8801.9, 1: 8867.4. Samples: 776380688. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:33,785][121949] Avg episode reward: [(0, '6318.667'), (1, '5741.558')] [2023-12-26 11:44:34,164][123090] Updated weights for policy 1, policy_version 1511301 (0.0009) [2023-12-26 11:44:34,221][123090] Updated weights for policy 1, policy_version 1511311 (0.0009) [2023-12-26 11:44:34,279][123091] Updated weights for policy 0, policy_version 1521395 (0.0009) [2023-12-26 11:44:34,286][123090] Updated weights for policy 1, policy_version 1511321 (0.0008) [2023-12-26 11:44:34,342][123091] Updated weights for policy 0, policy_version 1521405 (0.0006) [2023-12-26 11:44:34,410][123091] Updated weights for policy 0, policy_version 1521415 (0.0006) [2023-12-26 11:44:35,083][123090] Updated weights for policy 1, policy_version 1511331 (0.0008) [2023-12-26 11:44:35,136][123090] Updated weights for policy 1, policy_version 1511341 (0.0009) [2023-12-26 11:44:35,185][123090] Updated weights for policy 1, policy_version 1511351 (0.0009) [2023-12-26 11:44:35,197][123091] Updated weights for policy 0, policy_version 1521425 (0.0011) [2023-12-26 11:44:35,251][123091] Updated weights for policy 0, policy_version 1521435 (0.0009) [2023-12-26 11:44:35,313][123091] Updated weights for policy 0, policy_version 1521445 (0.0007) [2023-12-26 11:44:35,376][123091] Updated weights for policy 0, policy_version 1521455 (0.0009) [2023-12-26 11:44:36,034][123090] Updated weights for policy 1, policy_version 1511361 (0.0007) [2023-12-26 11:44:36,088][123090] Updated weights for policy 1, policy_version 1511371 (0.0009) [2023-12-26 11:44:36,155][123090] Updated weights for policy 1, policy_version 1511381 (0.0009) [2023-12-26 11:44:36,193][123091] Updated weights for policy 0, policy_version 1521465 (0.0009) [2023-12-26 11:44:36,212][123090] Updated weights for policy 1, policy_version 1511391 (0.0007) [2023-12-26 11:44:36,252][123091] Updated weights for policy 0, policy_version 1521475 (0.0008) [2023-12-26 11:44:36,309][123091] Updated weights for policy 0, policy_version 1521485 (0.0010) [2023-12-26 11:44:37,054][123090] Updated weights for policy 1, policy_version 1511401 (0.0009) [2023-12-26 11:44:37,113][123090] Updated weights for policy 1, policy_version 1511411 (0.0009) [2023-12-26 11:44:37,158][123091] Updated weights for policy 0, policy_version 1521495 (0.0011) [2023-12-26 11:44:37,178][123090] Updated weights for policy 1, policy_version 1511421 (0.0009) [2023-12-26 11:44:37,213][123091] Updated weights for policy 0, policy_version 1521505 (0.0010) [2023-12-26 11:44:37,267][123091] Updated weights for policy 0, policy_version 1521515 (0.0009) [2023-12-26 11:44:38,025][123090] Updated weights for policy 1, policy_version 1511431 (0.0008) [2023-12-26 11:44:38,081][123091] Updated weights for policy 0, policy_version 1521525 (0.0009) [2023-12-26 11:44:38,091][123090] Updated weights for policy 1, policy_version 1511441 (0.0008) [2023-12-26 11:44:38,143][123091] Updated weights for policy 0, policy_version 1521535 (0.0008) [2023-12-26 11:44:38,160][123090] Updated weights for policy 1, policy_version 1511451 (0.0005) [2023-12-26 11:44:38,204][123091] Updated weights for policy 0, policy_version 1521545 (0.0008) [2023-12-26 11:44:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 776454144. Throughput: 0: 8814.9, 1: 8867.1. Samples: 776432700. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:38,785][121949] Avg episode reward: [(0, '6345.730'), (1, '5573.387')] [2023-12-26 11:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001521552_389521408.pth... [2023-12-26 11:44:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001511456_386932736.pth... [2023-12-26 11:44:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001510432_386670592.pth [2023-12-26 11:44:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001520528_389259264.pth [2023-12-26 11:44:38,917][123090] Updated weights for policy 1, policy_version 1511461 (0.0008) [2023-12-26 11:44:38,986][123090] Updated weights for policy 1, policy_version 1511471 (0.0009) [2023-12-26 11:44:39,054][123090] Updated weights for policy 1, policy_version 1511481 (0.0010) [2023-12-26 11:44:39,061][123091] Updated weights for policy 0, policy_version 1521555 (0.0009) [2023-12-26 11:44:39,120][123091] Updated weights for policy 0, policy_version 1521565 (0.0008) [2023-12-26 11:44:39,174][123091] Updated weights for policy 0, policy_version 1521576 (0.0010) [2023-12-26 11:44:39,937][123090] Updated weights for policy 1, policy_version 1511491 (0.0008) [2023-12-26 11:44:40,001][123090] Updated weights for policy 1, policy_version 1511501 (0.0011) [2023-12-26 11:44:40,063][123091] Updated weights for policy 0, policy_version 1521586 (0.0010) [2023-12-26 11:44:40,066][123090] Updated weights for policy 1, policy_version 1511511 (0.0011) [2023-12-26 11:44:40,129][123091] Updated weights for policy 0, policy_version 1521596 (0.0007) [2023-12-26 11:44:40,199][123091] Updated weights for policy 0, policy_version 1521606 (0.0010) [2023-12-26 11:44:40,264][123091] Updated weights for policy 0, policy_version 1521616 (0.0009) [2023-12-26 11:44:40,885][123090] Updated weights for policy 1, policy_version 1511521 (0.0011) [2023-12-26 11:44:40,942][123090] Updated weights for policy 1, policy_version 1511531 (0.0006) [2023-12-26 11:44:41,010][123090] Updated weights for policy 1, policy_version 1511541 (0.0006) [2023-12-26 11:44:41,083][123090] Updated weights for policy 1, policy_version 1511551 (0.0008) [2023-12-26 11:44:41,124][123091] Updated weights for policy 0, policy_version 1521626 (0.0008) [2023-12-26 11:44:41,195][123091] Updated weights for policy 0, policy_version 1521636 (0.0009) [2023-12-26 11:44:41,259][123091] Updated weights for policy 0, policy_version 1521646 (0.0009) [2023-12-26 11:44:41,897][123090] Updated weights for policy 1, policy_version 1511561 (0.0011) [2023-12-26 11:44:41,964][123090] Updated weights for policy 1, policy_version 1511571 (0.0011) [2023-12-26 11:44:42,034][123090] Updated weights for policy 1, policy_version 1511581 (0.0011) [2023-12-26 11:44:42,136][123091] Updated weights for policy 0, policy_version 1521656 (0.0009) [2023-12-26 11:44:42,197][123091] Updated weights for policy 0, policy_version 1521666 (0.0009) [2023-12-26 11:44:42,263][123091] Updated weights for policy 0, policy_version 1521676 (0.0009) [2023-12-26 11:44:42,860][123090] Updated weights for policy 1, policy_version 1511591 (0.0010) [2023-12-26 11:44:42,926][123090] Updated weights for policy 1, policy_version 1511601 (0.0010) [2023-12-26 11:44:43,003][123090] Updated weights for policy 1, policy_version 1511611 (0.0010) [2023-12-26 11:44:43,117][123091] Updated weights for policy 0, policy_version 1521686 (0.0009) [2023-12-26 11:44:43,177][123091] Updated weights for policy 0, policy_version 1521696 (0.0009) [2023-12-26 11:44:43,231][123091] Updated weights for policy 0, policy_version 1521707 (0.0010) [2023-12-26 11:44:43,779][123090] Updated weights for policy 1, policy_version 1511621 (0.0008) [2023-12-26 11:44:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 776536064. Throughput: 0: 8666.9, 1: 8850.5. Samples: 776533440. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:43,785][121949] Avg episode reward: [(0, '6386.987'), (1, '5568.946')] [2023-12-26 11:44:43,829][123090] Updated weights for policy 1, policy_version 1511631 (0.0006) [2023-12-26 11:44:43,892][123090] Updated weights for policy 1, policy_version 1511641 (0.0010) [2023-12-26 11:44:44,051][123091] Updated weights for policy 0, policy_version 1521717 (0.0008) [2023-12-26 11:44:44,103][123091] Updated weights for policy 0, policy_version 1521727 (0.0011) [2023-12-26 11:44:44,162][123091] Updated weights for policy 0, policy_version 1521737 (0.0011) [2023-12-26 11:44:44,594][123090] Updated weights for policy 1, policy_version 1511651 (0.0009) [2023-12-26 11:44:44,659][123090] Updated weights for policy 1, policy_version 1511661 (0.0005) [2023-12-26 11:44:44,730][123090] Updated weights for policy 1, policy_version 1511671 (0.0005) [2023-12-26 11:44:44,894][123091] Updated weights for policy 0, policy_version 1521747 (0.0009) [2023-12-26 11:44:44,947][123091] Updated weights for policy 0, policy_version 1521757 (0.0010) [2023-12-26 11:44:45,007][123091] Updated weights for policy 0, policy_version 1521767 (0.0011) [2023-12-26 11:44:45,447][123090] Updated weights for policy 1, policy_version 1511681 (0.0007) [2023-12-26 11:44:45,510][123090] Updated weights for policy 1, policy_version 1511691 (0.0006) [2023-12-26 11:44:45,557][123090] Updated weights for policy 1, policy_version 1511701 (0.0006) [2023-12-26 11:44:45,608][123090] Updated weights for policy 1, policy_version 1511711 (0.0005) [2023-12-26 11:44:45,819][123091] Updated weights for policy 0, policy_version 1521777 (0.0010) [2023-12-26 11:44:45,875][123091] Updated weights for policy 0, policy_version 1521787 (0.0005) [2023-12-26 11:44:45,925][123091] Updated weights for policy 0, policy_version 1521797 (0.0005) [2023-12-26 11:44:45,971][123091] Updated weights for policy 0, policy_version 1521807 (0.0006) [2023-12-26 11:44:46,248][123090] Updated weights for policy 1, policy_version 1511721 (0.0005) [2023-12-26 11:44:46,315][123090] Updated weights for policy 1, policy_version 1511731 (0.0006) [2023-12-26 11:44:46,372][123090] Updated weights for policy 1, policy_version 1511741 (0.0010) [2023-12-26 11:44:46,621][123091] Updated weights for policy 0, policy_version 1521817 (0.0006) [2023-12-26 11:44:46,690][123091] Updated weights for policy 0, policy_version 1521827 (0.0008) [2023-12-26 11:44:46,756][123091] Updated weights for policy 0, policy_version 1521837 (0.0008) [2023-12-26 11:44:47,073][123090] Updated weights for policy 1, policy_version 1511751 (0.0007) [2023-12-26 11:44:47,124][123090] Updated weights for policy 1, policy_version 1511761 (0.0005) [2023-12-26 11:44:47,177][123090] Updated weights for policy 1, policy_version 1511771 (0.0005) [2023-12-26 11:44:47,460][123091] Updated weights for policy 0, policy_version 1521847 (0.0006) [2023-12-26 11:44:47,522][123091] Updated weights for policy 0, policy_version 1521857 (0.0006) [2023-12-26 11:44:47,580][123091] Updated weights for policy 0, policy_version 1521867 (0.0006) [2023-12-26 11:44:47,893][123090] Updated weights for policy 1, policy_version 1511781 (0.0007) [2023-12-26 11:44:47,951][123090] Updated weights for policy 1, policy_version 1511791 (0.0006) [2023-12-26 11:44:48,005][123090] Updated weights for policy 1, policy_version 1511801 (0.0005) [2023-12-26 11:44:48,367][123091] Updated weights for policy 0, policy_version 1521877 (0.0008) [2023-12-26 11:44:48,431][123091] Updated weights for policy 0, policy_version 1521887 (0.0011) [2023-12-26 11:44:48,495][123091] Updated weights for policy 0, policy_version 1521897 (0.0011) [2023-12-26 11:44:48,702][123090] Updated weights for policy 1, policy_version 1511811 (0.0006) [2023-12-26 11:44:48,767][123090] Updated weights for policy 1, policy_version 1511821 (0.0009) [2023-12-26 11:44:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 776634368. Throughput: 0: 8777.2, 1: 8957.2. Samples: 776647608. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:48,785][121949] Avg episode reward: [(0, '6295.909'), (1, '5616.438')] [2023-12-26 11:44:48,832][123090] Updated weights for policy 1, policy_version 1511831 (0.0009) [2023-12-26 11:44:49,183][123091] Updated weights for policy 0, policy_version 1521907 (0.0009) [2023-12-26 11:44:49,250][123091] Updated weights for policy 0, policy_version 1521917 (0.0007) [2023-12-26 11:44:49,310][123091] Updated weights for policy 0, policy_version 1521927 (0.0006) [2023-12-26 11:44:49,744][123090] Updated weights for policy 1, policy_version 1511841 (0.0009) [2023-12-26 11:44:49,804][123090] Updated weights for policy 1, policy_version 1511851 (0.0009) [2023-12-26 11:44:49,869][123090] Updated weights for policy 1, policy_version 1511861 (0.0009) [2023-12-26 11:44:49,938][123090] Updated weights for policy 1, policy_version 1511871 (0.0008) [2023-12-26 11:44:50,077][123091] Updated weights for policy 0, policy_version 1521937 (0.0009) [2023-12-26 11:44:50,137][123091] Updated weights for policy 0, policy_version 1521947 (0.0011) [2023-12-26 11:44:50,192][123091] Updated weights for policy 0, policy_version 1521957 (0.0011) [2023-12-26 11:44:50,245][123091] Updated weights for policy 0, policy_version 1521967 (0.0011) [2023-12-26 11:44:50,693][123090] Updated weights for policy 1, policy_version 1511881 (0.0009) [2023-12-26 11:44:50,754][123090] Updated weights for policy 1, policy_version 1511891 (0.0009) [2023-12-26 11:44:50,819][123090] Updated weights for policy 1, policy_version 1511901 (0.0007) [2023-12-26 11:44:51,074][123091] Updated weights for policy 0, policy_version 1521977 (0.0009) [2023-12-26 11:44:51,132][123091] Updated weights for policy 0, policy_version 1521987 (0.0011) [2023-12-26 11:44:51,192][123091] Updated weights for policy 0, policy_version 1521997 (0.0011) [2023-12-26 11:44:51,608][123090] Updated weights for policy 1, policy_version 1511911 (0.0005) [2023-12-26 11:44:51,674][123090] Updated weights for policy 1, policy_version 1511921 (0.0009) [2023-12-26 11:44:51,738][123090] Updated weights for policy 1, policy_version 1511931 (0.0010) [2023-12-26 11:44:52,081][123091] Updated weights for policy 0, policy_version 1522007 (0.0010) [2023-12-26 11:44:52,141][123091] Updated weights for policy 0, policy_version 1522017 (0.0007) [2023-12-26 11:44:52,216][123091] Updated weights for policy 0, policy_version 1522027 (0.0005) [2023-12-26 11:44:52,502][123090] Updated weights for policy 1, policy_version 1511941 (0.0011) [2023-12-26 11:44:52,565][123090] Updated weights for policy 1, policy_version 1511951 (0.0010) [2023-12-26 11:44:52,633][123090] Updated weights for policy 1, policy_version 1511961 (0.0009) [2023-12-26 11:44:53,014][123091] Updated weights for policy 0, policy_version 1522037 (0.0008) [2023-12-26 11:44:53,070][123091] Updated weights for policy 0, policy_version 1522047 (0.0010) [2023-12-26 11:44:53,140][123091] Updated weights for policy 0, policy_version 1522057 (0.0009) [2023-12-26 11:44:53,338][123090] Updated weights for policy 1, policy_version 1511971 (0.0009) [2023-12-26 11:44:53,396][123090] Updated weights for policy 1, policy_version 1511981 (0.0009) [2023-12-26 11:44:53,460][123090] Updated weights for policy 1, policy_version 1511991 (0.0009) [2023-12-26 11:44:53,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 776724480. Throughput: 0: 8828.1, 1: 8874.8. Samples: 776700500. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:53,785][121949] Avg episode reward: [(0, '6350.081'), (1, '5720.559')] [2023-12-26 11:44:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001512000_387072000.pth... [2023-12-26 11:44:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001522064_389652480.pth... [2023-12-26 11:44:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001510944_386801664.pth [2023-12-26 11:44:53,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001521040_389390336.pth [2023-12-26 11:44:54,012][123091] Updated weights for policy 0, policy_version 1522067 (0.0010) [2023-12-26 11:44:54,071][123091] Updated weights for policy 0, policy_version 1522077 (0.0010) [2023-12-26 11:44:54,120][123091] Updated weights for policy 0, policy_version 1522087 (0.0009) [2023-12-26 11:44:54,243][123090] Updated weights for policy 1, policy_version 1512001 (0.0009) [2023-12-26 11:44:54,293][123090] Updated weights for policy 1, policy_version 1512011 (0.0009) [2023-12-26 11:44:54,346][123090] Updated weights for policy 1, policy_version 1512021 (0.0010) [2023-12-26 11:44:54,406][123090] Updated weights for policy 1, policy_version 1512031 (0.0009) [2023-12-26 11:44:54,963][123091] Updated weights for policy 0, policy_version 1522097 (0.0009) [2023-12-26 11:44:55,019][123091] Updated weights for policy 0, policy_version 1522107 (0.0010) [2023-12-26 11:44:55,074][123091] Updated weights for policy 0, policy_version 1522117 (0.0010) [2023-12-26 11:44:55,135][123091] Updated weights for policy 0, policy_version 1522127 (0.0010) [2023-12-26 11:44:55,277][123090] Updated weights for policy 1, policy_version 1512041 (0.0009) [2023-12-26 11:44:55,345][123090] Updated weights for policy 1, policy_version 1512051 (0.0010) [2023-12-26 11:44:55,401][123090] Updated weights for policy 1, policy_version 1512061 (0.0008) [2023-12-26 11:44:55,985][123091] Updated weights for policy 0, policy_version 1522137 (0.0010) [2023-12-26 11:44:56,048][123091] Updated weights for policy 0, policy_version 1522149 (0.0010) [2023-12-26 11:44:56,108][123091] Updated weights for policy 0, policy_version 1522160 (0.0009) [2023-12-26 11:44:56,187][123090] Updated weights for policy 1, policy_version 1512071 (0.0009) [2023-12-26 11:44:56,241][123090] Updated weights for policy 1, policy_version 1512081 (0.0009) [2023-12-26 11:44:56,302][123090] Updated weights for policy 1, policy_version 1512091 (0.0009) [2023-12-26 11:44:56,944][123091] Updated weights for policy 0, policy_version 1522170 (0.0009) [2023-12-26 11:44:56,993][123091] Updated weights for policy 0, policy_version 1522181 (0.0009) [2023-12-26 11:44:57,047][123091] Updated weights for policy 0, policy_version 1522192 (0.0010) [2023-12-26 11:44:57,140][123090] Updated weights for policy 1, policy_version 1512101 (0.0009) [2023-12-26 11:44:57,202][123090] Updated weights for policy 1, policy_version 1512111 (0.0010) [2023-12-26 11:44:57,259][123090] Updated weights for policy 1, policy_version 1512121 (0.0010) [2023-12-26 11:44:57,682][123091] Updated weights for policy 0, policy_version 1522202 (0.0005) [2023-12-26 11:44:57,726][123091] Updated weights for policy 0, policy_version 1522212 (0.0006) [2023-12-26 11:44:57,772][123091] Updated weights for policy 0, policy_version 1522222 (0.0005) [2023-12-26 11:44:58,178][123090] Updated weights for policy 1, policy_version 1512131 (0.0009) [2023-12-26 11:44:58,247][123090] Updated weights for policy 1, policy_version 1512141 (0.0007) [2023-12-26 11:44:58,310][123090] Updated weights for policy 1, policy_version 1512151 (0.0008) [2023-12-26 11:44:58,512][123091] Updated weights for policy 0, policy_version 1522232 (0.0007) [2023-12-26 11:44:58,585][123091] Updated weights for policy 0, policy_version 1522242 (0.0008) [2023-12-26 11:44:58,646][123091] Updated weights for policy 0, policy_version 1522252 (0.0008) [2023-12-26 11:44:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 776814592. Throughput: 0: 8859.8, 1: 8822.8. Samples: 776804576. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:44:58,785][121949] Avg episode reward: [(0, '6366.926'), (1, '5595.246')] [2023-12-26 11:44:59,133][123090] Updated weights for policy 1, policy_version 1512161 (0.0008) [2023-12-26 11:44:59,180][123090] Updated weights for policy 1, policy_version 1512171 (0.0008) [2023-12-26 11:44:59,232][123090] Updated weights for policy 1, policy_version 1512181 (0.0008) [2023-12-26 11:44:59,304][123090] Updated weights for policy 1, policy_version 1512191 (0.0009) [2023-12-26 11:44:59,436][123091] Updated weights for policy 0, policy_version 1522262 (0.0009) [2023-12-26 11:44:59,506][123091] Updated weights for policy 0, policy_version 1522272 (0.0011) [2023-12-26 11:44:59,569][123091] Updated weights for policy 0, policy_version 1522282 (0.0010) [2023-12-26 11:45:00,165][123090] Updated weights for policy 1, policy_version 1512201 (0.0008) [2023-12-26 11:45:00,223][123090] Updated weights for policy 1, policy_version 1512211 (0.0009) [2023-12-26 11:45:00,282][123090] Updated weights for policy 1, policy_version 1512221 (0.0008) [2023-12-26 11:45:00,395][123091] Updated weights for policy 0, policy_version 1522292 (0.0010) [2023-12-26 11:45:00,445][123091] Updated weights for policy 0, policy_version 1522302 (0.0010) [2023-12-26 11:45:00,493][123091] Updated weights for policy 0, policy_version 1522312 (0.0010) [2023-12-26 11:45:01,130][123090] Updated weights for policy 1, policy_version 1512231 (0.0009) [2023-12-26 11:45:01,200][123090] Updated weights for policy 1, policy_version 1512241 (0.0009) [2023-12-26 11:45:01,265][123090] Updated weights for policy 1, policy_version 1512251 (0.0011) [2023-12-26 11:45:01,307][123091] Updated weights for policy 0, policy_version 1522322 (0.0010) [2023-12-26 11:45:01,379][123091] Updated weights for policy 0, policy_version 1522332 (0.0010) [2023-12-26 11:45:01,446][123091] Updated weights for policy 0, policy_version 1522342 (0.0006) [2023-12-26 11:45:01,506][123091] Updated weights for policy 0, policy_version 1522352 (0.0006) [2023-12-26 11:45:02,129][123090] Updated weights for policy 1, policy_version 1512261 (0.0011) [2023-12-26 11:45:02,196][123090] Updated weights for policy 1, policy_version 1512271 (0.0010) [2023-12-26 11:45:02,244][123090] Updated weights for policy 1, policy_version 1512281 (0.0010) [2023-12-26 11:45:02,274][123091] Updated weights for policy 0, policy_version 1522362 (0.0008) [2023-12-26 11:45:02,335][123091] Updated weights for policy 0, policy_version 1522372 (0.0009) [2023-12-26 11:45:02,400][123091] Updated weights for policy 0, policy_version 1522382 (0.0009) [2023-12-26 11:45:03,002][123090] Updated weights for policy 1, policy_version 1512291 (0.0009) [2023-12-26 11:45:03,066][123090] Updated weights for policy 1, policy_version 1512301 (0.0005) [2023-12-26 11:45:03,119][123090] Updated weights for policy 1, policy_version 1512311 (0.0005) [2023-12-26 11:45:03,238][123091] Updated weights for policy 0, policy_version 1522392 (0.0010) [2023-12-26 11:45:03,306][123091] Updated weights for policy 0, policy_version 1522402 (0.0010) [2023-12-26 11:45:03,374][123091] Updated weights for policy 0, policy_version 1522412 (0.0010) [2023-12-26 11:45:03,737][123090] Updated weights for policy 1, policy_version 1512321 (0.0005) [2023-12-26 11:45:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 776896512. Throughput: 0: 8809.1, 1: 8846.8. Samples: 776909784. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:03,785][121949] Avg episode reward: [(0, '6366.000'), (1, '5501.458')] [2023-12-26 11:45:03,793][123090] Updated weights for policy 1, policy_version 1512331 (0.0005) [2023-12-26 11:45:03,852][123090] Updated weights for policy 1, policy_version 1512341 (0.0006) [2023-12-26 11:45:03,917][123090] Updated weights for policy 1, policy_version 1512351 (0.0006) [2023-12-26 11:45:04,085][123091] Updated weights for policy 0, policy_version 1522422 (0.0008) [2023-12-26 11:45:04,146][123091] Updated weights for policy 0, policy_version 1522432 (0.0010) [2023-12-26 11:45:04,213][123091] Updated weights for policy 0, policy_version 1522442 (0.0010) [2023-12-26 11:45:04,711][123090] Updated weights for policy 1, policy_version 1512361 (0.0008) [2023-12-26 11:45:04,774][123090] Updated weights for policy 1, policy_version 1512371 (0.0009) [2023-12-26 11:45:04,834][123090] Updated weights for policy 1, policy_version 1512381 (0.0009) [2023-12-26 11:45:05,013][123091] Updated weights for policy 0, policy_version 1522452 (0.0011) [2023-12-26 11:45:05,065][123091] Updated weights for policy 0, policy_version 1522462 (0.0010) [2023-12-26 11:45:05,109][123091] Updated weights for policy 0, policy_version 1522472 (0.0010) [2023-12-26 11:45:05,621][123090] Updated weights for policy 1, policy_version 1512391 (0.0009) [2023-12-26 11:45:05,681][123090] Updated weights for policy 1, policy_version 1512401 (0.0009) [2023-12-26 11:45:05,734][123090] Updated weights for policy 1, policy_version 1512411 (0.0009) [2023-12-26 11:45:05,884][123091] Updated weights for policy 0, policy_version 1522482 (0.0009) [2023-12-26 11:45:05,944][123091] Updated weights for policy 0, policy_version 1522492 (0.0009) [2023-12-26 11:45:05,995][123091] Updated weights for policy 0, policy_version 1522502 (0.0010) [2023-12-26 11:45:06,039][123091] Updated weights for policy 0, policy_version 1522512 (0.0010) [2023-12-26 11:45:06,571][123090] Updated weights for policy 1, policy_version 1512421 (0.0009) [2023-12-26 11:45:06,626][123090] Updated weights for policy 1, policy_version 1512431 (0.0008) [2023-12-26 11:45:06,695][123090] Updated weights for policy 1, policy_version 1512441 (0.0009) [2023-12-26 11:45:06,887][123091] Updated weights for policy 0, policy_version 1522522 (0.0006) [2023-12-26 11:45:06,955][123091] Updated weights for policy 0, policy_version 1522532 (0.0005) [2023-12-26 11:45:07,018][123091] Updated weights for policy 0, policy_version 1522542 (0.0008) [2023-12-26 11:45:07,477][123090] Updated weights for policy 1, policy_version 1512451 (0.0009) [2023-12-26 11:45:07,530][123090] Updated weights for policy 1, policy_version 1512461 (0.0010) [2023-12-26 11:45:07,592][123090] Updated weights for policy 1, policy_version 1512471 (0.0010) [2023-12-26 11:45:07,672][123091] Updated weights for policy 0, policy_version 1522552 (0.0005) [2023-12-26 11:45:07,742][123091] Updated weights for policy 0, policy_version 1522562 (0.0006) [2023-12-26 11:45:07,808][123091] Updated weights for policy 0, policy_version 1522572 (0.0005) [2023-12-26 11:45:08,326][123090] Updated weights for policy 1, policy_version 1512481 (0.0010) [2023-12-26 11:45:08,400][123090] Updated weights for policy 1, policy_version 1512491 (0.0008) [2023-12-26 11:45:08,468][123090] Updated weights for policy 1, policy_version 1512501 (0.0009) [2023-12-26 11:45:08,496][123091] Updated weights for policy 0, policy_version 1522582 (0.0005) [2023-12-26 11:45:08,530][123090] Updated weights for policy 1, policy_version 1512511 (0.0008) [2023-12-26 11:45:08,557][123091] Updated weights for policy 0, policy_version 1522592 (0.0009) [2023-12-26 11:45:08,623][123091] Updated weights for policy 0, policy_version 1522602 (0.0011) [2023-12-26 11:45:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 776994816. Throughput: 0: 8886.0, 1: 8850.0. Samples: 776963736. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:08,784][121949] Avg episode reward: [(0, '6339.774'), (1, '5647.904')] [2023-12-26 11:45:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001522608_389791744.pth... [2023-12-26 11:45:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001512512_387203072.pth... [2023-12-26 11:45:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001521552_389521408.pth [2023-12-26 11:45:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001511456_386932736.pth [2023-12-26 11:45:09,172][123090] Updated weights for policy 1, policy_version 1512521 (0.0006) [2023-12-26 11:45:09,240][123090] Updated weights for policy 1, policy_version 1512531 (0.0007) [2023-12-26 11:45:09,303][123090] Updated weights for policy 1, policy_version 1512541 (0.0007) [2023-12-26 11:45:09,344][123091] Updated weights for policy 0, policy_version 1522612 (0.0011) [2023-12-26 11:45:09,427][123091] Updated weights for policy 0, policy_version 1522623 (0.0014) [2023-12-26 11:45:09,491][123091] Updated weights for policy 0, policy_version 1522633 (0.0008) [2023-12-26 11:45:10,078][123090] Updated weights for policy 1, policy_version 1512551 (0.0009) [2023-12-26 11:45:10,157][123090] Updated weights for policy 1, policy_version 1512561 (0.0010) [2023-12-26 11:45:10,225][123090] Updated weights for policy 1, policy_version 1512571 (0.0011) [2023-12-26 11:45:10,270][123091] Updated weights for policy 0, policy_version 1522643 (0.0009) [2023-12-26 11:45:10,336][123091] Updated weights for policy 0, policy_version 1522653 (0.0008) [2023-12-26 11:45:10,403][123091] Updated weights for policy 0, policy_version 1522663 (0.0008) [2023-12-26 11:45:10,933][123090] Updated weights for policy 1, policy_version 1512581 (0.0010) [2023-12-26 11:45:10,985][123090] Updated weights for policy 1, policy_version 1512591 (0.0010) [2023-12-26 11:45:11,060][123090] Updated weights for policy 1, policy_version 1512601 (0.0010) [2023-12-26 11:45:11,219][123091] Updated weights for policy 0, policy_version 1522673 (0.0010) [2023-12-26 11:45:11,279][123091] Updated weights for policy 0, policy_version 1522683 (0.0010) [2023-12-26 11:45:11,332][123091] Updated weights for policy 0, policy_version 1522693 (0.0010) [2023-12-26 11:45:11,405][123091] Updated weights for policy 0, policy_version 1522703 (0.0009) [2023-12-26 11:45:11,933][123090] Updated weights for policy 1, policy_version 1512611 (0.0010) [2023-12-26 11:45:11,989][123090] Updated weights for policy 1, policy_version 1512621 (0.0009) [2023-12-26 11:45:12,053][123090] Updated weights for policy 1, policy_version 1512631 (0.0010) [2023-12-26 11:45:12,271][123091] Updated weights for policy 0, policy_version 1522713 (0.0006) [2023-12-26 11:45:12,341][123091] Updated weights for policy 0, policy_version 1522723 (0.0006) [2023-12-26 11:45:12,410][123091] Updated weights for policy 0, policy_version 1522733 (0.0008) [2023-12-26 11:45:12,912][123090] Updated weights for policy 1, policy_version 1512641 (0.0010) [2023-12-26 11:45:12,980][123090] Updated weights for policy 1, policy_version 1512651 (0.0009) [2023-12-26 11:45:13,048][123090] Updated weights for policy 1, policy_version 1512661 (0.0008) [2023-12-26 11:45:13,114][123090] Updated weights for policy 1, policy_version 1512671 (0.0005) [2023-12-26 11:45:13,199][123091] Updated weights for policy 0, policy_version 1522743 (0.0009) [2023-12-26 11:45:13,253][123091] Updated weights for policy 0, policy_version 1522753 (0.0008) [2023-12-26 11:45:13,304][123091] Updated weights for policy 0, policy_version 1522763 (0.0010) [2023-12-26 11:45:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 777076736. Throughput: 0: 8934.1, 1: 8875.5. Samples: 777072412. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:13,785][121949] Avg episode reward: [(0, '6252.073'), (1, '5810.882')] [2023-12-26 11:45:13,885][123090] Updated weights for policy 1, policy_version 1512681 (0.0009) [2023-12-26 11:45:13,934][123090] Updated weights for policy 1, policy_version 1512691 (0.0009) [2023-12-26 11:45:13,981][123090] Updated weights for policy 1, policy_version 1512701 (0.0008) [2023-12-26 11:45:14,137][123091] Updated weights for policy 0, policy_version 1522773 (0.0009) [2023-12-26 11:45:14,206][123091] Updated weights for policy 0, policy_version 1522783 (0.0009) [2023-12-26 11:45:14,259][123091] Updated weights for policy 0, policy_version 1522793 (0.0009) [2023-12-26 11:45:14,799][123090] Updated weights for policy 1, policy_version 1512711 (0.0008) [2023-12-26 11:45:14,860][123090] Updated weights for policy 1, policy_version 1512721 (0.0008) [2023-12-26 11:45:14,931][123090] Updated weights for policy 1, policy_version 1512731 (0.0006) [2023-12-26 11:45:15,144][123091] Updated weights for policy 0, policy_version 1522803 (0.0010) [2023-12-26 11:45:15,211][123091] Updated weights for policy 0, policy_version 1522813 (0.0011) [2023-12-26 11:45:15,282][123091] Updated weights for policy 0, policy_version 1522823 (0.0011) [2023-12-26 11:45:15,707][123090] Updated weights for policy 1, policy_version 1512741 (0.0009) [2023-12-26 11:45:15,771][123090] Updated weights for policy 1, policy_version 1512751 (0.0008) [2023-12-26 11:45:15,840][123090] Updated weights for policy 1, policy_version 1512761 (0.0009) [2023-12-26 11:45:16,085][123091] Updated weights for policy 0, policy_version 1522833 (0.0010) [2023-12-26 11:45:16,159][123091] Updated weights for policy 0, policy_version 1522843 (0.0008) [2023-12-26 11:45:16,226][123091] Updated weights for policy 0, policy_version 1522853 (0.0009) [2023-12-26 11:45:16,290][123091] Updated weights for policy 0, policy_version 1522863 (0.0008) [2023-12-26 11:45:16,623][123090] Updated weights for policy 1, policy_version 1512771 (0.0006) [2023-12-26 11:45:16,682][123090] Updated weights for policy 1, policy_version 1512781 (0.0010) [2023-12-26 11:45:16,742][123090] Updated weights for policy 1, policy_version 1512791 (0.0010) [2023-12-26 11:45:17,094][123091] Updated weights for policy 0, policy_version 1522873 (0.0011) [2023-12-26 11:45:17,142][123091] Updated weights for policy 0, policy_version 1522883 (0.0010) [2023-12-26 11:45:17,191][123091] Updated weights for policy 0, policy_version 1522893 (0.0008) [2023-12-26 11:45:17,591][123090] Updated weights for policy 1, policy_version 1512801 (0.0008) [2023-12-26 11:45:17,670][123090] Updated weights for policy 1, policy_version 1512811 (0.0005) [2023-12-26 11:45:17,752][123090] Updated weights for policy 1, policy_version 1512821 (0.0006) [2023-12-26 11:45:17,829][123090] Updated weights for policy 1, policy_version 1512831 (0.0005) [2023-12-26 11:45:17,935][123091] Updated weights for policy 0, policy_version 1522903 (0.0007) [2023-12-26 11:45:18,015][123091] Updated weights for policy 0, policy_version 1522913 (0.0006) [2023-12-26 11:45:18,073][123091] Updated weights for policy 0, policy_version 1522923 (0.0006) [2023-12-26 11:45:18,407][123090] Updated weights for policy 1, policy_version 1512841 (0.0007) [2023-12-26 11:45:18,482][123090] Updated weights for policy 1, policy_version 1512851 (0.0010) [2023-12-26 11:45:18,549][123090] Updated weights for policy 1, policy_version 1512861 (0.0009) [2023-12-26 11:45:18,715][123091] Updated weights for policy 0, policy_version 1522933 (0.0007) [2023-12-26 11:45:18,783][123091] Updated weights for policy 0, policy_version 1522943 (0.0007) [2023-12-26 11:45:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 777166848. Throughput: 0: 8870.7, 1: 8879.4. Samples: 777179440. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:18,785][121949] Avg episode reward: [(0, '6287.271'), (1, '5827.842')] [2023-12-26 11:45:18,850][123091] Updated weights for policy 0, policy_version 1522953 (0.0006) [2023-12-26 11:45:19,294][123090] Updated weights for policy 1, policy_version 1512871 (0.0010) [2023-12-26 11:45:19,359][123090] Updated weights for policy 1, policy_version 1512881 (0.0009) [2023-12-26 11:45:19,429][123090] Updated weights for policy 1, policy_version 1512891 (0.0007) [2023-12-26 11:45:19,618][123091] Updated weights for policy 0, policy_version 1522963 (0.0008) [2023-12-26 11:45:19,674][123091] Updated weights for policy 0, policy_version 1522973 (0.0010) [2023-12-26 11:45:19,738][123091] Updated weights for policy 0, policy_version 1522983 (0.0008) [2023-12-26 11:45:20,226][123090] Updated weights for policy 1, policy_version 1512901 (0.0007) [2023-12-26 11:45:20,289][123090] Updated weights for policy 1, policy_version 1512911 (0.0007) [2023-12-26 11:45:20,353][123090] Updated weights for policy 1, policy_version 1512921 (0.0007) [2023-12-26 11:45:20,662][123091] Updated weights for policy 0, policy_version 1522993 (0.0008) [2023-12-26 11:45:20,733][123091] Updated weights for policy 0, policy_version 1523003 (0.0009) [2023-12-26 11:45:20,800][123091] Updated weights for policy 0, policy_version 1523013 (0.0008) [2023-12-26 11:45:20,865][123091] Updated weights for policy 0, policy_version 1523023 (0.0009) [2023-12-26 11:45:21,250][123090] Updated weights for policy 1, policy_version 1512931 (0.0006) [2023-12-26 11:45:21,319][123090] Updated weights for policy 1, policy_version 1512941 (0.0009) [2023-12-26 11:45:21,394][123090] Updated weights for policy 1, policy_version 1512951 (0.0009) [2023-12-26 11:45:21,799][123091] Updated weights for policy 0, policy_version 1523033 (0.0011) [2023-12-26 11:45:21,864][123091] Updated weights for policy 0, policy_version 1523043 (0.0011) [2023-12-26 11:45:21,924][123091] Updated weights for policy 0, policy_version 1523053 (0.0011) [2023-12-26 11:45:22,280][123090] Updated weights for policy 1, policy_version 1512961 (0.0009) [2023-12-26 11:45:22,349][123090] Updated weights for policy 1, policy_version 1512971 (0.0009) [2023-12-26 11:45:22,425][123090] Updated weights for policy 1, policy_version 1512981 (0.0009) [2023-12-26 11:45:22,496][123090] Updated weights for policy 1, policy_version 1512991 (0.0009) [2023-12-26 11:45:22,769][123091] Updated weights for policy 0, policy_version 1523063 (0.0007) [2023-12-26 11:45:22,842][123091] Updated weights for policy 0, policy_version 1523073 (0.0011) [2023-12-26 11:45:22,899][123091] Updated weights for policy 0, policy_version 1523083 (0.0011) [2023-12-26 11:45:23,378][123090] Updated weights for policy 1, policy_version 1513001 (0.0009) [2023-12-26 11:45:23,450][123090] Updated weights for policy 1, policy_version 1513011 (0.0008) [2023-12-26 11:45:23,518][123090] Updated weights for policy 1, policy_version 1513021 (0.0008) [2023-12-26 11:45:23,621][123091] Updated weights for policy 0, policy_version 1523093 (0.0011) [2023-12-26 11:45:23,685][123091] Updated weights for policy 0, policy_version 1523103 (0.0011) [2023-12-26 11:45:23,748][123091] Updated weights for policy 0, policy_version 1523113 (0.0010) [2023-12-26 11:45:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 777248768. Throughput: 0: 8815.0, 1: 8881.9. Samples: 777229060. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:23,785][121949] Avg episode reward: [(0, '6359.934'), (1, '5831.993')] [2023-12-26 11:45:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001513024_387334144.pth... [2023-12-26 11:45:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001523120_389922816.pth... [2023-12-26 11:45:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001512000_387072000.pth [2023-12-26 11:45:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001522064_389652480.pth [2023-12-26 11:45:24,220][123090] Updated weights for policy 1, policy_version 1513031 (0.0008) [2023-12-26 11:45:24,280][123090] Updated weights for policy 1, policy_version 1513041 (0.0009) [2023-12-26 11:45:24,352][123090] Updated weights for policy 1, policy_version 1513051 (0.0008) [2023-12-26 11:45:24,474][123091] Updated weights for policy 0, policy_version 1523123 (0.0009) [2023-12-26 11:45:24,540][123091] Updated weights for policy 0, policy_version 1523133 (0.0011) [2023-12-26 11:45:24,610][123091] Updated weights for policy 0, policy_version 1523143 (0.0008) [2023-12-26 11:45:25,147][123090] Updated weights for policy 1, policy_version 1513061 (0.0008) [2023-12-26 11:45:25,203][123090] Updated weights for policy 1, policy_version 1513071 (0.0007) [2023-12-26 11:45:25,257][123090] Updated weights for policy 1, policy_version 1513081 (0.0006) [2023-12-26 11:45:25,297][123091] Updated weights for policy 0, policy_version 1523153 (0.0005) [2023-12-26 11:45:25,349][123091] Updated weights for policy 0, policy_version 1523163 (0.0007) [2023-12-26 11:45:25,419][123091] Updated weights for policy 0, policy_version 1523173 (0.0007) [2023-12-26 11:45:25,492][123091] Updated weights for policy 0, policy_version 1523183 (0.0010) [2023-12-26 11:45:25,954][123090] Updated weights for policy 1, policy_version 1513091 (0.0006) [2023-12-26 11:45:26,006][123090] Updated weights for policy 1, policy_version 1513101 (0.0009) [2023-12-26 11:45:26,058][123090] Updated weights for policy 1, policy_version 1513111 (0.0009) [2023-12-26 11:45:26,217][123091] Updated weights for policy 0, policy_version 1523193 (0.0006) [2023-12-26 11:45:26,267][123091] Updated weights for policy 0, policy_version 1523203 (0.0005) [2023-12-26 11:45:26,328][123091] Updated weights for policy 0, policy_version 1523213 (0.0005) [2023-12-26 11:45:26,966][123090] Updated weights for policy 1, policy_version 1513121 (0.0009) [2023-12-26 11:45:27,029][123090] Updated weights for policy 1, policy_version 1513131 (0.0008) [2023-12-26 11:45:27,057][123091] Updated weights for policy 0, policy_version 1523223 (0.0006) [2023-12-26 11:45:27,090][123090] Updated weights for policy 1, policy_version 1513141 (0.0010) [2023-12-26 11:45:27,119][123091] Updated weights for policy 0, policy_version 1523233 (0.0009) [2023-12-26 11:45:27,155][123090] Updated weights for policy 1, policy_version 1513151 (0.0009) [2023-12-26 11:45:27,178][123091] Updated weights for policy 0, policy_version 1523243 (0.0010) [2023-12-26 11:45:27,824][123090] Updated weights for policy 1, policy_version 1513161 (0.0005) [2023-12-26 11:45:27,881][123090] Updated weights for policy 1, policy_version 1513171 (0.0007) [2023-12-26 11:45:27,946][123090] Updated weights for policy 1, policy_version 1513181 (0.0009) [2023-12-26 11:45:27,965][123091] Updated weights for policy 0, policy_version 1523253 (0.0008) [2023-12-26 11:45:28,022][123091] Updated weights for policy 0, policy_version 1523263 (0.0006) [2023-12-26 11:45:28,075][123091] Updated weights for policy 0, policy_version 1523273 (0.0008) [2023-12-26 11:45:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 777338880. Throughput: 0: 8957.4, 1: 8900.3. Samples: 777337036. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:28,785][121949] Avg episode reward: [(0, '6299.766'), (1, '5910.737')] [2023-12-26 11:45:28,806][123091] Updated weights for policy 0, policy_version 1523283 (0.0007) [2023-12-26 11:45:28,810][123090] Updated weights for policy 1, policy_version 1513191 (0.0009) [2023-12-26 11:45:28,865][123091] Updated weights for policy 0, policy_version 1523293 (0.0011) [2023-12-26 11:45:28,873][123090] Updated weights for policy 1, policy_version 1513201 (0.0009) [2023-12-26 11:45:28,913][123091] Updated weights for policy 0, policy_version 1523303 (0.0010) [2023-12-26 11:45:28,939][123090] Updated weights for policy 1, policy_version 1513211 (0.0008) [2023-12-26 11:45:29,601][123091] Updated weights for policy 0, policy_version 1523313 (0.0006) [2023-12-26 11:45:29,652][123091] Updated weights for policy 0, policy_version 1523323 (0.0007) [2023-12-26 11:45:29,703][123091] Updated weights for policy 0, policy_version 1523333 (0.0010) [2023-12-26 11:45:29,747][123091] Updated weights for policy 0, policy_version 1523343 (0.0010) [2023-12-26 11:45:29,845][123090] Updated weights for policy 1, policy_version 1513221 (0.0009) [2023-12-26 11:45:29,914][123090] Updated weights for policy 1, policy_version 1513231 (0.0008) [2023-12-26 11:45:29,978][123090] Updated weights for policy 1, policy_version 1513241 (0.0010) [2023-12-26 11:45:30,518][123091] Updated weights for policy 0, policy_version 1523353 (0.0010) [2023-12-26 11:45:30,565][123091] Updated weights for policy 0, policy_version 1523363 (0.0010) [2023-12-26 11:45:30,613][123091] Updated weights for policy 0, policy_version 1523373 (0.0010) [2023-12-26 11:45:30,742][123090] Updated weights for policy 1, policy_version 1513251 (0.0011) [2023-12-26 11:45:30,804][123090] Updated weights for policy 1, policy_version 1513261 (0.0010) [2023-12-26 11:45:30,855][123090] Updated weights for policy 1, policy_version 1513271 (0.0010) [2023-12-26 11:45:31,376][123091] Updated weights for policy 0, policy_version 1523383 (0.0011) [2023-12-26 11:45:31,441][123091] Updated weights for policy 0, policy_version 1523393 (0.0011) [2023-12-26 11:45:31,496][123091] Updated weights for policy 0, policy_version 1523403 (0.0010) [2023-12-26 11:45:31,651][123090] Updated weights for policy 1, policy_version 1513281 (0.0009) [2023-12-26 11:45:31,717][123090] Updated weights for policy 1, policy_version 1513291 (0.0009) [2023-12-26 11:45:31,783][123090] Updated weights for policy 1, policy_version 1513301 (0.0009) [2023-12-26 11:45:31,855][123090] Updated weights for policy 1, policy_version 1513311 (0.0008) [2023-12-26 11:45:32,331][123091] Updated weights for policy 0, policy_version 1523413 (0.0008) [2023-12-26 11:45:32,403][123091] Updated weights for policy 0, policy_version 1523423 (0.0008) [2023-12-26 11:45:32,474][123091] Updated weights for policy 0, policy_version 1523433 (0.0005) [2023-12-26 11:45:32,666][123090] Updated weights for policy 1, policy_version 1513321 (0.0007) [2023-12-26 11:45:32,726][123090] Updated weights for policy 1, policy_version 1513331 (0.0008) [2023-12-26 11:45:32,789][123090] Updated weights for policy 1, policy_version 1513341 (0.0009) [2023-12-26 11:45:33,263][123091] Updated weights for policy 0, policy_version 1523443 (0.0010) [2023-12-26 11:45:33,325][123091] Updated weights for policy 0, policy_version 1523453 (0.0010) [2023-12-26 11:45:33,379][123091] Updated weights for policy 0, policy_version 1523463 (0.0010) [2023-12-26 11:45:33,521][123090] Updated weights for policy 1, policy_version 1513351 (0.0008) [2023-12-26 11:45:33,582][123090] Updated weights for policy 1, policy_version 1513362 (0.0009) [2023-12-26 11:45:33,631][123090] Updated weights for policy 1, policy_version 1513372 (0.0009) [2023-12-26 11:45:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 777437184. Throughput: 0: 8927.7, 1: 8762.8. Samples: 777443676. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:33,784][121949] Avg episode reward: [(0, '6296.971'), (1, '5870.442')] [2023-12-26 11:45:34,187][123091] Updated weights for policy 0, policy_version 1523473 (0.0010) [2023-12-26 11:45:34,250][123091] Updated weights for policy 0, policy_version 1523483 (0.0010) [2023-12-26 11:45:34,312][123091] Updated weights for policy 0, policy_version 1523493 (0.0010) [2023-12-26 11:45:34,379][123091] Updated weights for policy 0, policy_version 1523503 (0.0011) [2023-12-26 11:45:34,400][123090] Updated weights for policy 1, policy_version 1513382 (0.0008) [2023-12-26 11:45:34,454][123090] Updated weights for policy 1, policy_version 1513392 (0.0005) [2023-12-26 11:45:34,523][123090] Updated weights for policy 1, policy_version 1513402 (0.0008) [2023-12-26 11:45:35,181][123091] Updated weights for policy 0, policy_version 1523513 (0.0008) [2023-12-26 11:45:35,239][123091] Updated weights for policy 0, policy_version 1523523 (0.0009) [2023-12-26 11:45:35,305][123091] Updated weights for policy 0, policy_version 1523533 (0.0009) [2023-12-26 11:45:35,345][123090] Updated weights for policy 1, policy_version 1513412 (0.0009) [2023-12-26 11:45:35,415][123090] Updated weights for policy 1, policy_version 1513422 (0.0009) [2023-12-26 11:45:35,483][123090] Updated weights for policy 1, policy_version 1513432 (0.0009) [2023-12-26 11:45:36,109][123091] Updated weights for policy 0, policy_version 1523543 (0.0007) [2023-12-26 11:45:36,177][123091] Updated weights for policy 0, policy_version 1523553 (0.0008) [2023-12-26 11:45:36,239][123091] Updated weights for policy 0, policy_version 1523563 (0.0008) [2023-12-26 11:45:36,325][123090] Updated weights for policy 1, policy_version 1513442 (0.0009) [2023-12-26 11:45:36,384][123090] Updated weights for policy 1, policy_version 1513452 (0.0006) [2023-12-26 11:45:36,453][123090] Updated weights for policy 1, policy_version 1513462 (0.0006) [2023-12-26 11:45:36,517][123090] Updated weights for policy 1, policy_version 1513472 (0.0010) [2023-12-26 11:45:36,843][123091] Updated weights for policy 0, policy_version 1523573 (0.0008) [2023-12-26 11:45:36,897][123091] Updated weights for policy 0, policy_version 1523583 (0.0008) [2023-12-26 11:45:36,968][123091] Updated weights for policy 0, policy_version 1523593 (0.0005) [2023-12-26 11:45:37,316][123090] Updated weights for policy 1, policy_version 1513482 (0.0010) [2023-12-26 11:45:37,374][123090] Updated weights for policy 1, policy_version 1513493 (0.0010) [2023-12-26 11:45:37,428][123090] Updated weights for policy 1, policy_version 1513503 (0.0010) [2023-12-26 11:45:37,682][123091] Updated weights for policy 0, policy_version 1523603 (0.0007) [2023-12-26 11:45:37,748][123091] Updated weights for policy 0, policy_version 1523613 (0.0010) [2023-12-26 11:45:37,808][123091] Updated weights for policy 0, policy_version 1523623 (0.0010) [2023-12-26 11:45:38,320][123090] Updated weights for policy 1, policy_version 1513513 (0.0010) [2023-12-26 11:45:38,383][123090] Updated weights for policy 1, policy_version 1513523 (0.0009) [2023-12-26 11:45:38,446][123090] Updated weights for policy 1, policy_version 1513533 (0.0009) [2023-12-26 11:45:38,660][123091] Updated weights for policy 0, policy_version 1523633 (0.0009) [2023-12-26 11:45:38,720][123091] Updated weights for policy 0, policy_version 1523643 (0.0009) [2023-12-26 11:45:38,773][123091] Updated weights for policy 0, policy_version 1523653 (0.0010) [2023-12-26 11:45:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 777519104. Throughput: 0: 8937.6, 1: 8768.3. Samples: 777497260. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:38,785][121949] Avg episode reward: [(0, '6277.341'), (1, '5768.818')] [2023-12-26 11:45:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001513536_387465216.pth... [2023-12-26 11:45:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001512512_387203072.pth [2023-12-26 11:45:38,830][123091] Updated weights for policy 0, policy_version 1523663 (0.0008) [2023-12-26 11:45:38,837][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001523664_390062080.pth... [2023-12-26 11:45:38,841][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001522608_389791744.pth [2023-12-26 11:45:39,284][123090] Updated weights for policy 1, policy_version 1513543 (0.0010) [2023-12-26 11:45:39,350][123090] Updated weights for policy 1, policy_version 1513553 (0.0010) [2023-12-26 11:45:39,420][123090] Updated weights for policy 1, policy_version 1513563 (0.0010) [2023-12-26 11:45:39,686][123091] Updated weights for policy 0, policy_version 1523673 (0.0009) [2023-12-26 11:45:39,747][123091] Updated weights for policy 0, policy_version 1523683 (0.0009) [2023-12-26 11:45:39,800][123091] Updated weights for policy 0, policy_version 1523693 (0.0009) [2023-12-26 11:45:40,245][123090] Updated weights for policy 1, policy_version 1513573 (0.0009) [2023-12-26 11:45:40,302][123090] Updated weights for policy 1, policy_version 1513583 (0.0009) [2023-12-26 11:45:40,367][123090] Updated weights for policy 1, policy_version 1513593 (0.0008) [2023-12-26 11:45:40,730][123091] Updated weights for policy 0, policy_version 1523703 (0.0010) [2023-12-26 11:45:40,800][123091] Updated weights for policy 0, policy_version 1523713 (0.0009) [2023-12-26 11:45:40,868][123091] Updated weights for policy 0, policy_version 1523723 (0.0009) [2023-12-26 11:45:41,099][123090] Updated weights for policy 1, policy_version 1513603 (0.0006) [2023-12-26 11:45:41,165][123090] Updated weights for policy 1, policy_version 1513613 (0.0008) [2023-12-26 11:45:41,232][123090] Updated weights for policy 1, policy_version 1513623 (0.0006) [2023-12-26 11:45:41,745][123091] Updated weights for policy 0, policy_version 1523733 (0.0009) [2023-12-26 11:45:41,809][123091] Updated weights for policy 0, policy_version 1523743 (0.0009) [2023-12-26 11:45:41,872][123091] Updated weights for policy 0, policy_version 1523753 (0.0009) [2023-12-26 11:45:42,050][123090] Updated weights for policy 1, policy_version 1513633 (0.0007) [2023-12-26 11:45:42,112][123090] Updated weights for policy 1, policy_version 1513643 (0.0006) [2023-12-26 11:45:42,160][123090] Updated weights for policy 1, policy_version 1513653 (0.0006) [2023-12-26 11:45:42,235][123090] Updated weights for policy 1, policy_version 1513663 (0.0006) [2023-12-26 11:45:42,824][123091] Updated weights for policy 0, policy_version 1523763 (0.0010) [2023-12-26 11:45:42,874][123091] Updated weights for policy 0, policy_version 1523773 (0.0008) [2023-12-26 11:45:42,929][123091] Updated weights for policy 0, policy_version 1523783 (0.0010) [2023-12-26 11:45:42,948][123090] Updated weights for policy 1, policy_version 1513673 (0.0010) [2023-12-26 11:45:43,006][123090] Updated weights for policy 1, policy_version 1513683 (0.0010) [2023-12-26 11:45:43,064][123090] Updated weights for policy 1, policy_version 1513693 (0.0008) [2023-12-26 11:45:43,765][123090] Updated weights for policy 1, policy_version 1513703 (0.0007) [2023-12-26 11:45:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 777601024. Throughput: 0: 8899.1, 1: 8775.8. Samples: 777599948. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:43,785][121949] Avg episode reward: [(0, '6357.246'), (1, '5924.743')] [2023-12-26 11:45:43,819][123090] Updated weights for policy 1, policy_version 1513713 (0.0007) [2023-12-26 11:45:43,855][123091] Updated weights for policy 0, policy_version 1523793 (0.0008) [2023-12-26 11:45:43,867][123090] Updated weights for policy 1, policy_version 1513723 (0.0006) [2023-12-26 11:45:43,907][123091] Updated weights for policy 0, policy_version 1523803 (0.0007) [2023-12-26 11:45:43,959][123091] Updated weights for policy 0, policy_version 1523813 (0.0009) [2023-12-26 11:45:44,009][123091] Updated weights for policy 0, policy_version 1523823 (0.0009) [2023-12-26 11:45:44,683][123090] Updated weights for policy 1, policy_version 1513733 (0.0008) [2023-12-26 11:45:44,731][123090] Updated weights for policy 1, policy_version 1513743 (0.0010) [2023-12-26 11:45:44,797][123090] Updated weights for policy 1, policy_version 1513753 (0.0010) [2023-12-26 11:45:44,866][123091] Updated weights for policy 0, policy_version 1523833 (0.0008) [2023-12-26 11:45:44,919][123091] Updated weights for policy 0, policy_version 1523843 (0.0009) [2023-12-26 11:45:44,981][123091] Updated weights for policy 0, policy_version 1523853 (0.0009) [2023-12-26 11:45:45,558][123090] Updated weights for policy 1, policy_version 1513763 (0.0010) [2023-12-26 11:45:45,626][123090] Updated weights for policy 1, policy_version 1513773 (0.0009) [2023-12-26 11:45:45,692][123090] Updated weights for policy 1, policy_version 1513783 (0.0011) [2023-12-26 11:45:45,829][123091] Updated weights for policy 0, policy_version 1523863 (0.0010) [2023-12-26 11:45:45,887][123091] Updated weights for policy 0, policy_version 1523873 (0.0010) [2023-12-26 11:45:45,953][123091] Updated weights for policy 0, policy_version 1523883 (0.0009) [2023-12-26 11:45:46,396][123090] Updated weights for policy 1, policy_version 1513793 (0.0010) [2023-12-26 11:45:46,459][123090] Updated weights for policy 1, policy_version 1513803 (0.0005) [2023-12-26 11:45:46,516][123090] Updated weights for policy 1, policy_version 1513813 (0.0005) [2023-12-26 11:45:46,581][123090] Updated weights for policy 1, policy_version 1513823 (0.0005) [2023-12-26 11:45:46,840][123091] Updated weights for policy 0, policy_version 1523893 (0.0009) [2023-12-26 11:45:46,901][123091] Updated weights for policy 0, policy_version 1523903 (0.0005) [2023-12-26 11:45:46,961][123091] Updated weights for policy 0, policy_version 1523913 (0.0005) [2023-12-26 11:45:47,261][123090] Updated weights for policy 1, policy_version 1513833 (0.0007) [2023-12-26 11:45:47,326][123090] Updated weights for policy 1, policy_version 1513843 (0.0009) [2023-12-26 11:45:47,373][123090] Updated weights for policy 1, policy_version 1513853 (0.0006) [2023-12-26 11:45:47,658][123091] Updated weights for policy 0, policy_version 1523923 (0.0006) [2023-12-26 11:45:47,723][123091] Updated weights for policy 0, policy_version 1523933 (0.0009) [2023-12-26 11:45:47,790][123091] Updated weights for policy 0, policy_version 1523943 (0.0007) [2023-12-26 11:45:48,175][123090] Updated weights for policy 1, policy_version 1513863 (0.0009) [2023-12-26 11:45:48,219][123090] Updated weights for policy 1, policy_version 1513873 (0.0010) [2023-12-26 11:45:48,265][123090] Updated weights for policy 1, policy_version 1513883 (0.0008) [2023-12-26 11:45:48,578][123091] Updated weights for policy 0, policy_version 1523953 (0.0007) [2023-12-26 11:45:48,647][123091] Updated weights for policy 0, policy_version 1523963 (0.0009) [2023-12-26 11:45:48,718][123091] Updated weights for policy 0, policy_version 1523973 (0.0010) [2023-12-26 11:45:48,781][123091] Updated weights for policy 0, policy_version 1523983 (0.0009) [2023-12-26 11:45:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 777691136. Throughput: 0: 8856.1, 1: 8879.0. Samples: 777707864. Policy #0 lag: (min: 17.0, avg: 36.3, max: 49.0) [2023-12-26 11:45:48,785][121949] Avg episode reward: [(0, '6413.461'), (1, '6006.147')] [2023-12-26 11:45:49,053][123090] Updated weights for policy 1, policy_version 1513893 (0.0007) [2023-12-26 11:45:49,116][123090] Updated weights for policy 1, policy_version 1513903 (0.0009) [2023-12-26 11:45:49,178][123090] Updated weights for policy 1, policy_version 1513913 (0.0009) [2023-12-26 11:45:49,610][123091] Updated weights for policy 0, policy_version 1523993 (0.0010) [2023-12-26 11:45:49,668][123091] Updated weights for policy 0, policy_version 1524003 (0.0008) [2023-12-26 11:45:49,722][123091] Updated weights for policy 0, policy_version 1524013 (0.0005) [2023-12-26 11:45:50,008][123090] Updated weights for policy 1, policy_version 1513923 (0.0008) [2023-12-26 11:45:50,059][123090] Updated weights for policy 1, policy_version 1513933 (0.0009) [2023-12-26 11:45:50,114][123090] Updated weights for policy 1, policy_version 1513943 (0.0009) [2023-12-26 11:45:50,467][123091] Updated weights for policy 0, policy_version 1524023 (0.0007) [2023-12-26 11:45:50,512][123091] Updated weights for policy 0, policy_version 1524033 (0.0008) [2023-12-26 11:45:50,563][123091] Updated weights for policy 0, policy_version 1524043 (0.0008) [2023-12-26 11:45:50,810][123090] Updated weights for policy 1, policy_version 1513953 (0.0007) [2023-12-26 11:45:50,876][123090] Updated weights for policy 1, policy_version 1513963 (0.0008) [2023-12-26 11:45:50,946][123090] Updated weights for policy 1, policy_version 1513973 (0.0008) [2023-12-26 11:45:51,018][123090] Updated weights for policy 1, policy_version 1513983 (0.0005) [2023-12-26 11:45:51,307][123091] Updated weights for policy 0, policy_version 1524053 (0.0007) [2023-12-26 11:45:51,384][123091] Updated weights for policy 0, policy_version 1524063 (0.0008) [2023-12-26 11:45:51,435][123091] Updated weights for policy 0, policy_version 1524073 (0.0006) [2023-12-26 11:45:51,778][123090] Updated weights for policy 1, policy_version 1513993 (0.0009) [2023-12-26 11:45:51,842][123090] Updated weights for policy 1, policy_version 1514003 (0.0009) [2023-12-26 11:45:51,901][123090] Updated weights for policy 1, policy_version 1514013 (0.0010) [2023-12-26 11:45:52,319][123091] Updated weights for policy 0, policy_version 1524083 (0.0008) [2023-12-26 11:45:52,394][123091] Updated weights for policy 0, policy_version 1524093 (0.0010) [2023-12-26 11:45:52,469][123091] Updated weights for policy 0, policy_version 1524103 (0.0009) [2023-12-26 11:45:52,578][123090] Updated weights for policy 1, policy_version 1514023 (0.0009) [2023-12-26 11:45:52,641][123090] Updated weights for policy 1, policy_version 1514033 (0.0011) [2023-12-26 11:45:52,716][123090] Updated weights for policy 1, policy_version 1514043 (0.0010) [2023-12-26 11:45:53,272][123091] Updated weights for policy 0, policy_version 1524113 (0.0010) [2023-12-26 11:45:53,338][123091] Updated weights for policy 0, policy_version 1524123 (0.0010) [2023-12-26 11:45:53,399][123091] Updated weights for policy 0, policy_version 1524133 (0.0007) [2023-12-26 11:45:53,458][123091] Updated weights for policy 0, policy_version 1524143 (0.0005) [2023-12-26 11:45:53,572][123090] Updated weights for policy 1, policy_version 1514053 (0.0010) [2023-12-26 11:45:53,619][123090] Updated weights for policy 1, policy_version 1514063 (0.0010) [2023-12-26 11:45:53,667][123090] Updated weights for policy 1, policy_version 1514073 (0.0010) [2023-12-26 11:45:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 777789440. Throughput: 0: 8847.0, 1: 8896.4. Samples: 777762188. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:45:53,784][121949] Avg episode reward: [(0, '6334.714'), (1, '5923.908')] [2023-12-26 11:45:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001524144_390184960.pth... [2023-12-26 11:45:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001514080_387604480.pth... [2023-12-26 11:45:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001523120_389922816.pth [2023-12-26 11:45:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001513024_387334144.pth [2023-12-26 11:45:54,058][123091] Updated weights for policy 0, policy_version 1524153 (0.0005) [2023-12-26 11:45:54,109][123091] Updated weights for policy 0, policy_version 1524163 (0.0005) [2023-12-26 11:45:54,165][123091] Updated weights for policy 0, policy_version 1524173 (0.0005) [2023-12-26 11:45:54,522][123090] Updated weights for policy 1, policy_version 1514083 (0.0010) [2023-12-26 11:45:54,582][123090] Updated weights for policy 1, policy_version 1514093 (0.0006) [2023-12-26 11:45:54,638][123090] Updated weights for policy 1, policy_version 1514103 (0.0007) [2023-12-26 11:45:54,862][123091] Updated weights for policy 0, policy_version 1524183 (0.0005) [2023-12-26 11:45:54,927][123091] Updated weights for policy 0, policy_version 1524193 (0.0007) [2023-12-26 11:45:54,992][123091] Updated weights for policy 0, policy_version 1524203 (0.0010) [2023-12-26 11:45:55,467][123090] Updated weights for policy 1, policy_version 1514113 (0.0006) [2023-12-26 11:45:55,521][123090] Updated weights for policy 1, policy_version 1514123 (0.0009) [2023-12-26 11:45:55,569][123090] Updated weights for policy 1, policy_version 1514133 (0.0007) [2023-12-26 11:45:55,579][123091] Updated weights for policy 0, policy_version 1524213 (0.0008) [2023-12-26 11:45:55,624][123090] Updated weights for policy 1, policy_version 1514143 (0.0006) [2023-12-26 11:45:55,643][123091] Updated weights for policy 0, policy_version 1524223 (0.0006) [2023-12-26 11:45:55,704][123091] Updated weights for policy 0, policy_version 1524233 (0.0005) [2023-12-26 11:45:56,337][123090] Updated weights for policy 1, policy_version 1514153 (0.0008) [2023-12-26 11:45:56,390][123090] Updated weights for policy 1, policy_version 1514163 (0.0009) [2023-12-26 11:45:56,445][123090] Updated weights for policy 1, policy_version 1514173 (0.0009) [2023-12-26 11:45:56,448][123091] Updated weights for policy 0, policy_version 1524243 (0.0005) [2023-12-26 11:45:56,512][123091] Updated weights for policy 0, policy_version 1524253 (0.0008) [2023-12-26 11:45:56,578][123091] Updated weights for policy 0, policy_version 1524263 (0.0011) [2023-12-26 11:45:57,267][123091] Updated weights for policy 0, policy_version 1524273 (0.0008) [2023-12-26 11:45:57,288][123090] Updated weights for policy 1, policy_version 1514183 (0.0007) [2023-12-26 11:45:57,327][123091] Updated weights for policy 0, policy_version 1524283 (0.0008) [2023-12-26 11:45:57,347][123090] Updated weights for policy 1, policy_version 1514193 (0.0006) [2023-12-26 11:45:57,375][123091] Updated weights for policy 0, policy_version 1524293 (0.0010) [2023-12-26 11:45:57,415][123090] Updated weights for policy 1, policy_version 1514203 (0.0006) [2023-12-26 11:45:57,426][123091] Updated weights for policy 0, policy_version 1524303 (0.0010) [2023-12-26 11:45:58,193][123090] Updated weights for policy 1, policy_version 1514213 (0.0006) [2023-12-26 11:45:58,200][123091] Updated weights for policy 0, policy_version 1524313 (0.0011) [2023-12-26 11:45:58,259][123090] Updated weights for policy 1, policy_version 1514223 (0.0009) [2023-12-26 11:45:58,265][123091] Updated weights for policy 0, policy_version 1524323 (0.0010) [2023-12-26 11:45:58,328][123090] Updated weights for policy 1, policy_version 1514233 (0.0009) [2023-12-26 11:45:58,340][123091] Updated weights for policy 0, policy_version 1524333 (0.0010) [2023-12-26 11:45:58,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 777879552. Throughput: 0: 8902.8, 1: 8880.6. Samples: 777872668. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:45:58,785][121949] Avg episode reward: [(0, '6249.821'), (1, '5865.535')] [2023-12-26 11:45:59,162][123090] Updated weights for policy 1, policy_version 1514243 (0.0007) [2023-12-26 11:45:59,225][123090] Updated weights for policy 1, policy_version 1514253 (0.0006) [2023-12-26 11:45:59,276][123091] Updated weights for policy 0, policy_version 1524343 (0.0010) [2023-12-26 11:45:59,300][123090] Updated weights for policy 1, policy_version 1514263 (0.0008) [2023-12-26 11:45:59,340][123091] Updated weights for policy 0, policy_version 1524353 (0.0009) [2023-12-26 11:45:59,411][123091] Updated weights for policy 0, policy_version 1524363 (0.0009) [2023-12-26 11:45:59,960][123090] Updated weights for policy 1, policy_version 1514273 (0.0008) [2023-12-26 11:46:00,025][123090] Updated weights for policy 1, policy_version 1514283 (0.0008) [2023-12-26 11:46:00,080][123090] Updated weights for policy 1, policy_version 1514293 (0.0010) [2023-12-26 11:46:00,131][123090] Updated weights for policy 1, policy_version 1514303 (0.0010) [2023-12-26 11:46:00,318][123091] Updated weights for policy 0, policy_version 1524373 (0.0009) [2023-12-26 11:46:00,386][123091] Updated weights for policy 0, policy_version 1524383 (0.0009) [2023-12-26 11:46:00,445][123091] Updated weights for policy 0, policy_version 1524393 (0.0010) [2023-12-26 11:46:00,863][123090] Updated weights for policy 1, policy_version 1514313 (0.0006) [2023-12-26 11:46:00,912][123090] Updated weights for policy 1, policy_version 1514323 (0.0005) [2023-12-26 11:46:00,969][123090] Updated weights for policy 1, policy_version 1514333 (0.0007) [2023-12-26 11:46:01,277][123091] Updated weights for policy 0, policy_version 1524403 (0.0010) [2023-12-26 11:46:01,343][123091] Updated weights for policy 0, policy_version 1524413 (0.0006) [2023-12-26 11:46:01,406][123091] Updated weights for policy 0, policy_version 1524423 (0.0011) [2023-12-26 11:46:01,813][123090] Updated weights for policy 1, policy_version 1514343 (0.0009) [2023-12-26 11:46:01,871][123090] Updated weights for policy 1, policy_version 1514353 (0.0009) [2023-12-26 11:46:01,927][123090] Updated weights for policy 1, policy_version 1514363 (0.0005) [2023-12-26 11:46:02,156][123091] Updated weights for policy 0, policy_version 1524433 (0.0006) [2023-12-26 11:46:02,222][123091] Updated weights for policy 0, policy_version 1524443 (0.0011) [2023-12-26 11:46:02,282][123091] Updated weights for policy 0, policy_version 1524453 (0.0010) [2023-12-26 11:46:02,346][123091] Updated weights for policy 0, policy_version 1524463 (0.0011) [2023-12-26 11:46:02,706][123090] Updated weights for policy 1, policy_version 1514373 (0.0008) [2023-12-26 11:46:02,771][123090] Updated weights for policy 1, policy_version 1514383 (0.0011) [2023-12-26 11:46:02,836][123090] Updated weights for policy 1, policy_version 1514393 (0.0011) [2023-12-26 11:46:03,157][123091] Updated weights for policy 0, policy_version 1524473 (0.0006) [2023-12-26 11:46:03,219][123091] Updated weights for policy 0, policy_version 1524483 (0.0005) [2023-12-26 11:46:03,271][123091] Updated weights for policy 0, policy_version 1524493 (0.0005) [2023-12-26 11:46:03,595][123090] Updated weights for policy 1, policy_version 1514403 (0.0010) [2023-12-26 11:46:03,652][123090] Updated weights for policy 1, policy_version 1514413 (0.0007) [2023-12-26 11:46:03,713][123090] Updated weights for policy 1, policy_version 1514423 (0.0009) [2023-12-26 11:46:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 777969664. Throughput: 0: 8866.3, 1: 8889.0. Samples: 777978428. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:03,785][121949] Avg episode reward: [(0, '6239.750'), (1, '5946.590')] [2023-12-26 11:46:04,048][123091] Updated weights for policy 0, policy_version 1524503 (0.0007) [2023-12-26 11:46:04,119][123091] Updated weights for policy 0, policy_version 1524513 (0.0006) [2023-12-26 11:46:04,186][123091] Updated weights for policy 0, policy_version 1524523 (0.0006) [2023-12-26 11:46:04,586][123090] Updated weights for policy 1, policy_version 1514433 (0.0008) [2023-12-26 11:46:04,659][123090] Updated weights for policy 1, policy_version 1514443 (0.0006) [2023-12-26 11:46:04,729][123090] Updated weights for policy 1, policy_version 1514453 (0.0006) [2023-12-26 11:46:04,795][123090] Updated weights for policy 1, policy_version 1514463 (0.0005) [2023-12-26 11:46:04,896][123091] Updated weights for policy 0, policy_version 1524533 (0.0008) [2023-12-26 11:46:04,943][123091] Updated weights for policy 0, policy_version 1524543 (0.0007) [2023-12-26 11:46:04,990][123091] Updated weights for policy 0, policy_version 1524553 (0.0006) [2023-12-26 11:46:05,451][123090] Updated weights for policy 1, policy_version 1514473 (0.0009) [2023-12-26 11:46:05,502][123090] Updated weights for policy 1, policy_version 1514483 (0.0009) [2023-12-26 11:46:05,563][123090] Updated weights for policy 1, policy_version 1514493 (0.0010) [2023-12-26 11:46:05,696][123091] Updated weights for policy 0, policy_version 1524563 (0.0008) [2023-12-26 11:46:05,761][123091] Updated weights for policy 0, policy_version 1524573 (0.0006) [2023-12-26 11:46:05,824][123091] Updated weights for policy 0, policy_version 1524583 (0.0007) [2023-12-26 11:46:06,444][123090] Updated weights for policy 1, policy_version 1514503 (0.0009) [2023-12-26 11:46:06,510][123090] Updated weights for policy 1, policy_version 1514513 (0.0008) [2023-12-26 11:46:06,575][123090] Updated weights for policy 1, policy_version 1514523 (0.0007) [2023-12-26 11:46:06,588][123091] Updated weights for policy 0, policy_version 1524593 (0.0008) [2023-12-26 11:46:06,650][123091] Updated weights for policy 0, policy_version 1524603 (0.0009) [2023-12-26 11:46:06,704][123091] Updated weights for policy 0, policy_version 1524613 (0.0007) [2023-12-26 11:46:06,765][123091] Updated weights for policy 0, policy_version 1524623 (0.0008) [2023-12-26 11:46:07,409][123090] Updated weights for policy 1, policy_version 1514533 (0.0010) [2023-12-26 11:46:07,473][123090] Updated weights for policy 1, policy_version 1514543 (0.0010) [2023-12-26 11:46:07,489][123091] Updated weights for policy 0, policy_version 1524633 (0.0006) [2023-12-26 11:46:07,539][123090] Updated weights for policy 1, policy_version 1514553 (0.0010) [2023-12-26 11:46:07,541][123091] Updated weights for policy 0, policy_version 1524643 (0.0007) [2023-12-26 11:46:07,606][123091] Updated weights for policy 0, policy_version 1524653 (0.0007) [2023-12-26 11:46:08,298][123090] Updated weights for policy 1, policy_version 1514563 (0.0009) [2023-12-26 11:46:08,329][123091] Updated weights for policy 0, policy_version 1524663 (0.0007) [2023-12-26 11:46:08,357][123090] Updated weights for policy 1, policy_version 1514573 (0.0010) [2023-12-26 11:46:08,394][123091] Updated weights for policy 0, policy_version 1524673 (0.0007) [2023-12-26 11:46:08,423][123090] Updated weights for policy 1, policy_version 1514583 (0.0011) [2023-12-26 11:46:08,462][123091] Updated weights for policy 0, policy_version 1524683 (0.0007) [2023-12-26 11:46:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 778059776. Throughput: 0: 8949.5, 1: 8886.7. Samples: 778031688. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:08,785][121949] Avg episode reward: [(0, '6396.716'), (1, '5875.524')] [2023-12-26 11:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001524688_390324224.pth... [2023-12-26 11:46:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001514592_387735552.pth... [2023-12-26 11:46:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001523664_390062080.pth [2023-12-26 11:46:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001513536_387465216.pth [2023-12-26 11:46:09,242][123090] Updated weights for policy 1, policy_version 1514593 (0.0010) [2023-12-26 11:46:09,261][123091] Updated weights for policy 0, policy_version 1524693 (0.0007) [2023-12-26 11:46:09,315][123090] Updated weights for policy 1, policy_version 1514603 (0.0008) [2023-12-26 11:46:09,328][123091] Updated weights for policy 0, policy_version 1524703 (0.0009) [2023-12-26 11:46:09,382][123090] Updated weights for policy 1, policy_version 1514613 (0.0009) [2023-12-26 11:46:09,399][123091] Updated weights for policy 0, policy_version 1524713 (0.0009) [2023-12-26 11:46:09,458][123090] Updated weights for policy 1, policy_version 1514623 (0.0009) [2023-12-26 11:46:10,119][123091] Updated weights for policy 0, policy_version 1524723 (0.0008) [2023-12-26 11:46:10,179][123091] Updated weights for policy 0, policy_version 1524733 (0.0005) [2023-12-26 11:46:10,234][123091] Updated weights for policy 0, policy_version 1524743 (0.0006) [2023-12-26 11:46:10,279][123090] Updated weights for policy 1, policy_version 1514633 (0.0008) [2023-12-26 11:46:10,336][123090] Updated weights for policy 1, policy_version 1514643 (0.0007) [2023-12-26 11:46:10,394][123090] Updated weights for policy 1, policy_version 1514653 (0.0005) [2023-12-26 11:46:11,045][123091] Updated weights for policy 0, policy_version 1524753 (0.0006) [2023-12-26 11:46:11,104][123091] Updated weights for policy 0, policy_version 1524763 (0.0008) [2023-12-26 11:46:11,167][123091] Updated weights for policy 0, policy_version 1524773 (0.0010) [2023-12-26 11:46:11,219][123090] Updated weights for policy 1, policy_version 1514663 (0.0008) [2023-12-26 11:46:11,231][123091] Updated weights for policy 0, policy_version 1524783 (0.0008) [2023-12-26 11:46:11,289][123090] Updated weights for policy 1, policy_version 1514673 (0.0009) [2023-12-26 11:46:11,357][123090] Updated weights for policy 1, policy_version 1514683 (0.0009) [2023-12-26 11:46:12,116][123091] Updated weights for policy 0, policy_version 1524793 (0.0010) [2023-12-26 11:46:12,172][123091] Updated weights for policy 0, policy_version 1524803 (0.0010) [2023-12-26 11:46:12,213][123090] Updated weights for policy 1, policy_version 1514693 (0.0009) [2023-12-26 11:46:12,228][123091] Updated weights for policy 0, policy_version 1524813 (0.0008) [2023-12-26 11:46:12,276][123090] Updated weights for policy 1, policy_version 1514703 (0.0009) [2023-12-26 11:46:12,342][123090] Updated weights for policy 1, policy_version 1514713 (0.0009) [2023-12-26 11:46:13,082][123091] Updated weights for policy 0, policy_version 1524823 (0.0008) [2023-12-26 11:46:13,135][123091] Updated weights for policy 0, policy_version 1524833 (0.0006) [2023-12-26 11:46:13,181][123091] Updated weights for policy 0, policy_version 1524843 (0.0005) [2023-12-26 11:46:13,194][123090] Updated weights for policy 1, policy_version 1514723 (0.0010) [2023-12-26 11:46:13,254][123090] Updated weights for policy 1, policy_version 1514733 (0.0008) [2023-12-26 11:46:13,319][123090] Updated weights for policy 1, policy_version 1514743 (0.0005) [2023-12-26 11:46:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 778141696. Throughput: 0: 8916.7, 1: 8861.6. Samples: 778137060. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:13,784][121949] Avg episode reward: [(0, '6323.917'), (1, '5806.775')] [2023-12-26 11:46:14,028][123090] Updated weights for policy 1, policy_version 1514753 (0.0005) [2023-12-26 11:46:14,035][123091] Updated weights for policy 0, policy_version 1524853 (0.0007) [2023-12-26 11:46:14,093][123090] Updated weights for policy 1, policy_version 1514763 (0.0009) [2023-12-26 11:46:14,100][123091] Updated weights for policy 0, policy_version 1524863 (0.0006) [2023-12-26 11:46:14,153][123090] Updated weights for policy 1, policy_version 1514773 (0.0008) [2023-12-26 11:46:14,161][123091] Updated weights for policy 0, policy_version 1524873 (0.0010) [2023-12-26 11:46:14,217][123090] Updated weights for policy 1, policy_version 1514783 (0.0006) [2023-12-26 11:46:14,919][123090] Updated weights for policy 1, policy_version 1514793 (0.0006) [2023-12-26 11:46:14,986][123090] Updated weights for policy 1, policy_version 1514803 (0.0009) [2023-12-26 11:46:15,022][123091] Updated weights for policy 0, policy_version 1524883 (0.0009) [2023-12-26 11:46:15,056][123090] Updated weights for policy 1, policy_version 1514813 (0.0011) [2023-12-26 11:46:15,089][123091] Updated weights for policy 0, policy_version 1524893 (0.0008) [2023-12-26 11:46:15,159][123091] Updated weights for policy 0, policy_version 1524903 (0.0006) [2023-12-26 11:46:15,801][123090] Updated weights for policy 1, policy_version 1514823 (0.0010) [2023-12-26 11:46:15,856][123090] Updated weights for policy 1, policy_version 1514833 (0.0008) [2023-12-26 11:46:15,913][123090] Updated weights for policy 1, policy_version 1514843 (0.0009) [2023-12-26 11:46:15,952][123091] Updated weights for policy 0, policy_version 1524913 (0.0008) [2023-12-26 11:46:16,004][123091] Updated weights for policy 0, policy_version 1524923 (0.0009) [2023-12-26 11:46:16,062][123091] Updated weights for policy 0, policy_version 1524933 (0.0008) [2023-12-26 11:46:16,123][123091] Updated weights for policy 0, policy_version 1524943 (0.0009) [2023-12-26 11:46:16,765][123090] Updated weights for policy 1, policy_version 1514853 (0.0010) [2023-12-26 11:46:16,828][123090] Updated weights for policy 1, policy_version 1514863 (0.0010) [2023-12-26 11:46:16,865][123091] Updated weights for policy 0, policy_version 1524953 (0.0006) [2023-12-26 11:46:16,896][123090] Updated weights for policy 1, policy_version 1514873 (0.0011) [2023-12-26 11:46:16,912][123091] Updated weights for policy 0, policy_version 1524963 (0.0005) [2023-12-26 11:46:16,962][123091] Updated weights for policy 0, policy_version 1524973 (0.0006) [2023-12-26 11:46:17,609][123091] Updated weights for policy 0, policy_version 1524983 (0.0005) [2023-12-26 11:46:17,678][123091] Updated weights for policy 0, policy_version 1524993 (0.0005) [2023-12-26 11:46:17,711][123090] Updated weights for policy 1, policy_version 1514883 (0.0011) [2023-12-26 11:46:17,744][123091] Updated weights for policy 0, policy_version 1525003 (0.0008) [2023-12-26 11:46:17,776][123090] Updated weights for policy 1, policy_version 1514893 (0.0011) [2023-12-26 11:46:17,829][123090] Updated weights for policy 1, policy_version 1514903 (0.0010) [2023-12-26 11:46:18,440][123091] Updated weights for policy 0, policy_version 1525013 (0.0008) [2023-12-26 11:46:18,496][123091] Updated weights for policy 0, policy_version 1525023 (0.0011) [2023-12-26 11:46:18,563][123091] Updated weights for policy 0, policy_version 1525033 (0.0007) [2023-12-26 11:46:18,677][123090] Updated weights for policy 1, policy_version 1514913 (0.0010) [2023-12-26 11:46:18,751][123090] Updated weights for policy 1, policy_version 1514923 (0.0009) [2023-12-26 11:46:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 778231808. Throughput: 0: 8899.8, 1: 8908.2. Samples: 778245036. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:18,785][121949] Avg episode reward: [(0, '6305.546'), (1, '5901.069')] [2023-12-26 11:46:18,817][123090] Updated weights for policy 1, policy_version 1514933 (0.0009) [2023-12-26 11:46:18,883][123090] Updated weights for policy 1, policy_version 1514943 (0.0009) [2023-12-26 11:46:19,358][123091] Updated weights for policy 0, policy_version 1525043 (0.0010) [2023-12-26 11:46:19,427][123091] Updated weights for policy 0, policy_version 1525053 (0.0010) [2023-12-26 11:46:19,497][123091] Updated weights for policy 0, policy_version 1525063 (0.0009) [2023-12-26 11:46:19,714][123090] Updated weights for policy 1, policy_version 1514953 (0.0008) [2023-12-26 11:46:19,788][123090] Updated weights for policy 1, policy_version 1514963 (0.0008) [2023-12-26 11:46:19,859][123090] Updated weights for policy 1, policy_version 1514973 (0.0009) [2023-12-26 11:46:20,363][123091] Updated weights for policy 0, policy_version 1525073 (0.0009) [2023-12-26 11:46:20,432][123091] Updated weights for policy 0, policy_version 1525083 (0.0006) [2023-12-26 11:46:20,524][123091] Updated weights for policy 0, policy_version 1525093 (0.0009) [2023-12-26 11:46:20,582][123091] Updated weights for policy 0, policy_version 1525103 (0.0010) [2023-12-26 11:46:20,700][123090] Updated weights for policy 1, policy_version 1514983 (0.0010) [2023-12-26 11:46:20,767][123090] Updated weights for policy 1, policy_version 1514993 (0.0009) [2023-12-26 11:46:20,837][123090] Updated weights for policy 1, policy_version 1515003 (0.0010) [2023-12-26 11:46:21,336][123091] Updated weights for policy 0, policy_version 1525113 (0.0008) [2023-12-26 11:46:21,410][123091] Updated weights for policy 0, policy_version 1525123 (0.0010) [2023-12-26 11:46:21,470][123091] Updated weights for policy 0, policy_version 1525133 (0.0009) [2023-12-26 11:46:21,745][123090] Updated weights for policy 1, policy_version 1515013 (0.0010) [2023-12-26 11:46:21,797][123090] Updated weights for policy 1, policy_version 1515023 (0.0008) [2023-12-26 11:46:21,853][123090] Updated weights for policy 1, policy_version 1515033 (0.0010) [2023-12-26 11:46:22,280][123091] Updated weights for policy 0, policy_version 1525143 (0.0009) [2023-12-26 11:46:22,348][123091] Updated weights for policy 0, policy_version 1525153 (0.0010) [2023-12-26 11:46:22,415][123091] Updated weights for policy 0, policy_version 1525163 (0.0009) [2023-12-26 11:46:22,734][123090] Updated weights for policy 1, policy_version 1515043 (0.0008) [2023-12-26 11:46:22,806][123090] Updated weights for policy 1, policy_version 1515053 (0.0009) [2023-12-26 11:46:22,863][123090] Updated weights for policy 1, policy_version 1515063 (0.0009) [2023-12-26 11:46:23,206][123091] Updated weights for policy 0, policy_version 1525173 (0.0009) [2023-12-26 11:46:23,260][123091] Updated weights for policy 0, policy_version 1525183 (0.0010) [2023-12-26 11:46:23,329][123091] Updated weights for policy 0, policy_version 1525193 (0.0009) [2023-12-26 11:46:23,598][123090] Updated weights for policy 1, policy_version 1515073 (0.0005) [2023-12-26 11:46:23,649][123090] Updated weights for policy 1, policy_version 1515083 (0.0005) [2023-12-26 11:46:23,701][123090] Updated weights for policy 1, policy_version 1515093 (0.0005) [2023-12-26 11:46:23,749][123090] Updated weights for policy 1, policy_version 1515103 (0.0005) [2023-12-26 11:46:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 778321920. Throughput: 0: 8862.0, 1: 8858.6. Samples: 778294688. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:23,785][121949] Avg episode reward: [(0, '6351.774'), (1, '5907.362')] [2023-12-26 11:46:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001525200_390455296.pth... [2023-12-26 11:46:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001515104_387866624.pth... [2023-12-26 11:46:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001524144_390184960.pth [2023-12-26 11:46:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001514080_387604480.pth [2023-12-26 11:46:24,221][123091] Updated weights for policy 0, policy_version 1525203 (0.0008) [2023-12-26 11:46:24,283][123091] Updated weights for policy 0, policy_version 1525213 (0.0005) [2023-12-26 11:46:24,349][123091] Updated weights for policy 0, policy_version 1525223 (0.0005) [2023-12-26 11:46:24,415][123090] Updated weights for policy 1, policy_version 1515113 (0.0008) [2023-12-26 11:46:24,476][123090] Updated weights for policy 1, policy_version 1515123 (0.0009) [2023-12-26 11:46:24,537][123090] Updated weights for policy 1, policy_version 1515133 (0.0009) [2023-12-26 11:46:25,079][123091] Updated weights for policy 0, policy_version 1525233 (0.0006) [2023-12-26 11:46:25,126][123091] Updated weights for policy 0, policy_version 1525243 (0.0010) [2023-12-26 11:46:25,173][123091] Updated weights for policy 0, policy_version 1525253 (0.0010) [2023-12-26 11:46:25,227][123091] Updated weights for policy 0, policy_version 1525263 (0.0010) [2023-12-26 11:46:25,397][123090] Updated weights for policy 1, policy_version 1515143 (0.0009) [2023-12-26 11:46:25,449][123090] Updated weights for policy 1, policy_version 1515153 (0.0008) [2023-12-26 11:46:25,500][123090] Updated weights for policy 1, policy_version 1515163 (0.0008) [2023-12-26 11:46:25,992][123091] Updated weights for policy 0, policy_version 1525273 (0.0006) [2023-12-26 11:46:26,039][123091] Updated weights for policy 0, policy_version 1525283 (0.0005) [2023-12-26 11:46:26,086][123091] Updated weights for policy 0, policy_version 1525293 (0.0005) [2023-12-26 11:46:26,228][123090] Updated weights for policy 1, policy_version 1515173 (0.0007) [2023-12-26 11:46:26,284][123090] Updated weights for policy 1, policy_version 1515183 (0.0010) [2023-12-26 11:46:26,336][123090] Updated weights for policy 1, policy_version 1515193 (0.0010) [2023-12-26 11:46:26,788][123091] Updated weights for policy 0, policy_version 1525303 (0.0009) [2023-12-26 11:46:26,847][123091] Updated weights for policy 0, policy_version 1525313 (0.0011) [2023-12-26 11:46:26,898][123091] Updated weights for policy 0, policy_version 1525323 (0.0010) [2023-12-26 11:46:27,064][123090] Updated weights for policy 1, policy_version 1515203 (0.0010) [2023-12-26 11:46:27,119][123090] Updated weights for policy 1, policy_version 1515213 (0.0010) [2023-12-26 11:46:27,162][123090] Updated weights for policy 1, policy_version 1515223 (0.0010) [2023-12-26 11:46:27,710][123091] Updated weights for policy 0, policy_version 1525333 (0.0010) [2023-12-26 11:46:27,779][123091] Updated weights for policy 0, policy_version 1525343 (0.0011) [2023-12-26 11:46:27,837][123091] Updated weights for policy 0, policy_version 1525353 (0.0010) [2023-12-26 11:46:27,881][123090] Updated weights for policy 1, policy_version 1515233 (0.0010) [2023-12-26 11:46:27,948][123090] Updated weights for policy 1, policy_version 1515243 (0.0005) [2023-12-26 11:46:28,017][123090] Updated weights for policy 1, policy_version 1515253 (0.0006) [2023-12-26 11:46:28,078][123090] Updated weights for policy 1, policy_version 1515263 (0.0008) [2023-12-26 11:46:28,572][123091] Updated weights for policy 0, policy_version 1525363 (0.0009) [2023-12-26 11:46:28,640][123091] Updated weights for policy 0, policy_version 1525373 (0.0005) [2023-12-26 11:46:28,704][123091] Updated weights for policy 0, policy_version 1525383 (0.0006) [2023-12-26 11:46:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 778412032. Throughput: 0: 8938.6, 1: 8929.8. Samples: 778404024. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:28,785][121949] Avg episode reward: [(0, '6346.993'), (1, '5745.627')] [2023-12-26 11:46:28,804][123090] Updated weights for policy 1, policy_version 1515273 (0.0008) [2023-12-26 11:46:28,867][123090] Updated weights for policy 1, policy_version 1515283 (0.0006) [2023-12-26 11:46:28,930][123090] Updated weights for policy 1, policy_version 1515293 (0.0005) [2023-12-26 11:46:29,499][123091] Updated weights for policy 0, policy_version 1525393 (0.0008) [2023-12-26 11:46:29,555][123091] Updated weights for policy 0, policy_version 1525403 (0.0011) [2023-12-26 11:46:29,607][123091] Updated weights for policy 0, policy_version 1525413 (0.0009) [2023-12-26 11:46:29,661][123091] Updated weights for policy 0, policy_version 1525423 (0.0009) [2023-12-26 11:46:29,709][123090] Updated weights for policy 1, policy_version 1515303 (0.0008) [2023-12-26 11:46:29,759][123090] Updated weights for policy 1, policy_version 1515313 (0.0009) [2023-12-26 11:46:29,814][123090] Updated weights for policy 1, policy_version 1515323 (0.0009) [2023-12-26 11:46:30,480][123091] Updated weights for policy 0, policy_version 1525433 (0.0010) [2023-12-26 11:46:30,534][123091] Updated weights for policy 0, policy_version 1525443 (0.0009) [2023-12-26 11:46:30,589][123091] Updated weights for policy 0, policy_version 1525453 (0.0009) [2023-12-26 11:46:30,671][123090] Updated weights for policy 1, policy_version 1515333 (0.0010) [2023-12-26 11:46:30,738][123090] Updated weights for policy 1, policy_version 1515343 (0.0010) [2023-12-26 11:46:30,788][123090] Updated weights for policy 1, policy_version 1515353 (0.0009) [2023-12-26 11:46:31,448][123091] Updated weights for policy 0, policy_version 1525463 (0.0010) [2023-12-26 11:46:31,509][123091] Updated weights for policy 0, policy_version 1525473 (0.0010) [2023-12-26 11:46:31,557][123091] Updated weights for policy 0, policy_version 1525484 (0.0009) [2023-12-26 11:46:31,634][123090] Updated weights for policy 1, policy_version 1515363 (0.0009) [2023-12-26 11:46:31,691][123090] Updated weights for policy 1, policy_version 1515373 (0.0009) [2023-12-26 11:46:31,756][123090] Updated weights for policy 1, policy_version 1515383 (0.0009) [2023-12-26 11:46:32,440][123091] Updated weights for policy 0, policy_version 1525494 (0.0009) [2023-12-26 11:46:32,499][123091] Updated weights for policy 0, policy_version 1525504 (0.0010) [2023-12-26 11:46:32,518][123090] Updated weights for policy 1, policy_version 1515393 (0.0009) [2023-12-26 11:46:32,560][123091] Updated weights for policy 0, policy_version 1525514 (0.0009) [2023-12-26 11:46:32,579][123090] Updated weights for policy 1, policy_version 1515403 (0.0009) [2023-12-26 11:46:32,644][123090] Updated weights for policy 1, policy_version 1515413 (0.0009) [2023-12-26 11:46:32,715][123090] Updated weights for policy 1, policy_version 1515423 (0.0009) [2023-12-26 11:46:33,406][123091] Updated weights for policy 0, policy_version 1525524 (0.0008) [2023-12-26 11:46:33,462][123091] Updated weights for policy 0, policy_version 1525534 (0.0010) [2023-12-26 11:46:33,477][123090] Updated weights for policy 1, policy_version 1515433 (0.0008) [2023-12-26 11:46:33,509][123091] Updated weights for policy 0, policy_version 1525544 (0.0009) [2023-12-26 11:46:33,529][123090] Updated weights for policy 1, policy_version 1515443 (0.0006) [2023-12-26 11:46:33,581][123090] Updated weights for policy 1, policy_version 1515453 (0.0010) [2023-12-26 11:46:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 778502144. Throughput: 0: 8954.6, 1: 8842.6. Samples: 778508736. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:33,785][121949] Avg episode reward: [(0, '6349.127'), (1, '5743.333')] [2023-12-26 11:46:34,248][123090] Updated weights for policy 1, policy_version 1515463 (0.0007) [2023-12-26 11:46:34,315][123090] Updated weights for policy 1, policy_version 1515473 (0.0007) [2023-12-26 11:46:34,378][123090] Updated weights for policy 1, policy_version 1515483 (0.0007) [2023-12-26 11:46:34,391][123091] Updated weights for policy 0, policy_version 1525554 (0.0008) [2023-12-26 11:46:34,451][123091] Updated weights for policy 0, policy_version 1525564 (0.0007) [2023-12-26 11:46:34,511][123091] Updated weights for policy 0, policy_version 1525574 (0.0009) [2023-12-26 11:46:34,572][123091] Updated weights for policy 0, policy_version 1525584 (0.0009) [2023-12-26 11:46:35,126][123090] Updated weights for policy 1, policy_version 1515493 (0.0010) [2023-12-26 11:46:35,173][123090] Updated weights for policy 1, policy_version 1515503 (0.0009) [2023-12-26 11:46:35,226][123090] Updated weights for policy 1, policy_version 1515514 (0.0009) [2023-12-26 11:46:35,408][123091] Updated weights for policy 0, policy_version 1525594 (0.0009) [2023-12-26 11:46:35,464][123091] Updated weights for policy 0, policy_version 1525604 (0.0009) [2023-12-26 11:46:35,523][123091] Updated weights for policy 0, policy_version 1525614 (0.0009) [2023-12-26 11:46:36,112][123090] Updated weights for policy 1, policy_version 1515524 (0.0008) [2023-12-26 11:46:36,177][123090] Updated weights for policy 1, policy_version 1515534 (0.0008) [2023-12-26 11:46:36,242][123090] Updated weights for policy 1, policy_version 1515544 (0.0009) [2023-12-26 11:46:36,359][123091] Updated weights for policy 0, policy_version 1525624 (0.0010) [2023-12-26 11:46:36,427][123091] Updated weights for policy 0, policy_version 1525634 (0.0011) [2023-12-26 11:46:36,495][123091] Updated weights for policy 0, policy_version 1525644 (0.0010) [2023-12-26 11:46:37,089][123090] Updated weights for policy 1, policy_version 1515554 (0.0009) [2023-12-26 11:46:37,155][123090] Updated weights for policy 1, policy_version 1515564 (0.0009) [2023-12-26 11:46:37,212][123090] Updated weights for policy 1, policy_version 1515574 (0.0009) [2023-12-26 11:46:37,236][123091] Updated weights for policy 0, policy_version 1525654 (0.0006) [2023-12-26 11:46:37,277][123090] Updated weights for policy 1, policy_version 1515584 (0.0008) [2023-12-26 11:46:37,303][123091] Updated weights for policy 0, policy_version 1525664 (0.0006) [2023-12-26 11:46:37,385][123091] Updated weights for policy 0, policy_version 1525674 (0.0005) [2023-12-26 11:46:38,067][123090] Updated weights for policy 1, policy_version 1515594 (0.0005) [2023-12-26 11:46:38,122][123091] Updated weights for policy 0, policy_version 1525684 (0.0007) [2023-12-26 11:46:38,128][123090] Updated weights for policy 1, policy_version 1515604 (0.0007) [2023-12-26 11:46:38,191][123091] Updated weights for policy 0, policy_version 1525694 (0.0007) [2023-12-26 11:46:38,194][123090] Updated weights for policy 1, policy_version 1515614 (0.0008) [2023-12-26 11:46:38,261][123091] Updated weights for policy 0, policy_version 1525704 (0.0008) [2023-12-26 11:46:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 778584064. Throughput: 0: 8919.8, 1: 8834.5. Samples: 778561136. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:38,785][121949] Avg episode reward: [(0, '6283.737'), (1, '5659.958')] [2023-12-26 11:46:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001515616_387997696.pth... [2023-12-26 11:46:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001525712_390586368.pth... [2023-12-26 11:46:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001514592_387735552.pth [2023-12-26 11:46:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001524688_390324224.pth [2023-12-26 11:46:38,947][123090] Updated weights for policy 1, policy_version 1515624 (0.0008) [2023-12-26 11:46:38,957][123091] Updated weights for policy 0, policy_version 1525714 (0.0007) [2023-12-26 11:46:39,002][123090] Updated weights for policy 1, policy_version 1515634 (0.0008) [2023-12-26 11:46:39,012][123091] Updated weights for policy 0, policy_version 1525724 (0.0007) [2023-12-26 11:46:39,060][123090] Updated weights for policy 1, policy_version 1515644 (0.0005) [2023-12-26 11:46:39,076][123091] Updated weights for policy 0, policy_version 1525734 (0.0008) [2023-12-26 11:46:39,138][123091] Updated weights for policy 0, policy_version 1525744 (0.0010) [2023-12-26 11:46:39,841][123090] Updated weights for policy 1, policy_version 1515654 (0.0008) [2023-12-26 11:46:39,900][123090] Updated weights for policy 1, policy_version 1515664 (0.0010) [2023-12-26 11:46:39,971][123090] Updated weights for policy 1, policy_version 1515674 (0.0010) [2023-12-26 11:46:40,029][123091] Updated weights for policy 0, policy_version 1525754 (0.0006) [2023-12-26 11:46:40,093][123091] Updated weights for policy 0, policy_version 1525764 (0.0010) [2023-12-26 11:46:40,159][123091] Updated weights for policy 0, policy_version 1525774 (0.0009) [2023-12-26 11:46:40,800][123090] Updated weights for policy 1, policy_version 1515684 (0.0010) [2023-12-26 11:46:40,853][123090] Updated weights for policy 1, policy_version 1515694 (0.0009) [2023-12-26 11:46:40,910][123090] Updated weights for policy 1, policy_version 1515704 (0.0009) [2023-12-26 11:46:40,976][123091] Updated weights for policy 0, policy_version 1525784 (0.0008) [2023-12-26 11:46:41,036][123091] Updated weights for policy 0, policy_version 1525794 (0.0010) [2023-12-26 11:46:41,100][123091] Updated weights for policy 0, policy_version 1525804 (0.0007) [2023-12-26 11:46:41,821][123090] Updated weights for policy 1, policy_version 1515714 (0.0009) [2023-12-26 11:46:41,870][123090] Updated weights for policy 1, policy_version 1515724 (0.0009) [2023-12-26 11:46:41,924][123090] Updated weights for policy 1, policy_version 1515734 (0.0009) [2023-12-26 11:46:41,948][123091] Updated weights for policy 0, policy_version 1525814 (0.0008) [2023-12-26 11:46:41,982][123090] Updated weights for policy 1, policy_version 1515744 (0.0009) [2023-12-26 11:46:42,010][123091] Updated weights for policy 0, policy_version 1525824 (0.0009) [2023-12-26 11:46:42,073][123091] Updated weights for policy 0, policy_version 1525834 (0.0009) [2023-12-26 11:46:42,845][123090] Updated weights for policy 1, policy_version 1515754 (0.0009) [2023-12-26 11:46:42,897][123090] Updated weights for policy 1, policy_version 1515764 (0.0008) [2023-12-26 11:46:42,924][123091] Updated weights for policy 0, policy_version 1525844 (0.0010) [2023-12-26 11:46:42,953][123090] Updated weights for policy 1, policy_version 1515774 (0.0007) [2023-12-26 11:46:42,972][123091] Updated weights for policy 0, policy_version 1525854 (0.0010) [2023-12-26 11:46:43,019][123091] Updated weights for policy 0, policy_version 1525864 (0.0010) [2023-12-26 11:46:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 778665984. Throughput: 0: 8806.7, 1: 8812.6. Samples: 778665536. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:43,785][121949] Avg episode reward: [(0, '6179.930'), (1, '5631.424')] [2023-12-26 11:46:43,788][123090] Updated weights for policy 1, policy_version 1515784 (0.0006) [2023-12-26 11:46:43,834][123090] Updated weights for policy 1, policy_version 1515794 (0.0005) [2023-12-26 11:46:43,864][123091] Updated weights for policy 0, policy_version 1525874 (0.0010) [2023-12-26 11:46:43,887][123090] Updated weights for policy 1, policy_version 1515804 (0.0005) [2023-12-26 11:46:43,917][123091] Updated weights for policy 0, policy_version 1525884 (0.0009) [2023-12-26 11:46:43,997][123091] Updated weights for policy 0, policy_version 1525894 (0.0009) [2023-12-26 11:46:44,068][123091] Updated weights for policy 0, policy_version 1525904 (0.0010) [2023-12-26 11:46:44,699][123090] Updated weights for policy 1, policy_version 1515814 (0.0008) [2023-12-26 11:46:44,761][123090] Updated weights for policy 1, policy_version 1515824 (0.0010) [2023-12-26 11:46:44,831][123090] Updated weights for policy 1, policy_version 1515834 (0.0008) [2023-12-26 11:46:44,851][123091] Updated weights for policy 0, policy_version 1525914 (0.0008) [2023-12-26 11:46:44,919][123091] Updated weights for policy 0, policy_version 1525924 (0.0009) [2023-12-26 11:46:44,990][123091] Updated weights for policy 0, policy_version 1525934 (0.0009) [2023-12-26 11:46:45,725][123090] Updated weights for policy 1, policy_version 1515844 (0.0007) [2023-12-26 11:46:45,789][123090] Updated weights for policy 1, policy_version 1515854 (0.0006) [2023-12-26 11:46:45,807][123091] Updated weights for policy 0, policy_version 1525944 (0.0010) [2023-12-26 11:46:45,851][123090] Updated weights for policy 1, policy_version 1515864 (0.0006) [2023-12-26 11:46:45,869][123091] Updated weights for policy 0, policy_version 1525954 (0.0010) [2023-12-26 11:46:45,928][123091] Updated weights for policy 0, policy_version 1525964 (0.0009) [2023-12-26 11:46:46,560][123090] Updated weights for policy 1, policy_version 1515874 (0.0005) [2023-12-26 11:46:46,625][123090] Updated weights for policy 1, policy_version 1515884 (0.0005) [2023-12-26 11:46:46,679][123090] Updated weights for policy 1, policy_version 1515894 (0.0010) [2023-12-26 11:46:46,741][123090] Updated weights for policy 1, policy_version 1515904 (0.0006) [2023-12-26 11:46:46,756][123091] Updated weights for policy 0, policy_version 1525974 (0.0009) [2023-12-26 11:46:46,815][123091] Updated weights for policy 0, policy_version 1525984 (0.0010) [2023-12-26 11:46:46,880][123091] Updated weights for policy 0, policy_version 1525994 (0.0010) [2023-12-26 11:46:47,500][123090] Updated weights for policy 1, policy_version 1515914 (0.0010) [2023-12-26 11:46:47,557][123090] Updated weights for policy 1, policy_version 1515924 (0.0009) [2023-12-26 11:46:47,590][123091] Updated weights for policy 0, policy_version 1526004 (0.0008) [2023-12-26 11:46:47,612][123090] Updated weights for policy 1, policy_version 1515934 (0.0009) [2023-12-26 11:46:47,659][123091] Updated weights for policy 0, policy_version 1526014 (0.0007) [2023-12-26 11:46:47,729][123091] Updated weights for policy 0, policy_version 1526024 (0.0008) [2023-12-26 11:46:48,476][123091] Updated weights for policy 0, policy_version 1526034 (0.0008) [2023-12-26 11:46:48,483][123090] Updated weights for policy 1, policy_version 1515944 (0.0008) [2023-12-26 11:46:48,539][123091] Updated weights for policy 0, policy_version 1526044 (0.0011) [2023-12-26 11:46:48,543][123090] Updated weights for policy 1, policy_version 1515954 (0.0008) [2023-12-26 11:46:48,602][123091] Updated weights for policy 0, policy_version 1526054 (0.0010) [2023-12-26 11:46:48,604][123090] Updated weights for policy 1, policy_version 1515964 (0.0008) [2023-12-26 11:46:48,669][123091] Updated weights for policy 0, policy_version 1526064 (0.0006) [2023-12-26 11:46:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 778764288. Throughput: 0: 8844.1, 1: 8782.5. Samples: 778771624. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:48,784][121949] Avg episode reward: [(0, '6239.389'), (1, '5678.936')] [2023-12-26 11:46:49,411][123091] Updated weights for policy 0, policy_version 1526074 (0.0008) [2023-12-26 11:46:49,470][123091] Updated weights for policy 0, policy_version 1526084 (0.0008) [2023-12-26 11:46:49,506][123090] Updated weights for policy 1, policy_version 1515974 (0.0009) [2023-12-26 11:46:49,541][123091] Updated weights for policy 0, policy_version 1526094 (0.0008) [2023-12-26 11:46:49,567][123090] Updated weights for policy 1, policy_version 1515984 (0.0009) [2023-12-26 11:46:49,630][123090] Updated weights for policy 1, policy_version 1515994 (0.0009) [2023-12-26 11:46:50,224][123091] Updated weights for policy 0, policy_version 1526104 (0.0008) [2023-12-26 11:46:50,299][123091] Updated weights for policy 0, policy_version 1526114 (0.0008) [2023-12-26 11:46:50,364][123091] Updated weights for policy 0, policy_version 1526124 (0.0008) [2023-12-26 11:46:50,527][123090] Updated weights for policy 1, policy_version 1516004 (0.0009) [2023-12-26 11:46:50,597][123090] Updated weights for policy 1, policy_version 1516014 (0.0009) [2023-12-26 11:46:50,669][123090] Updated weights for policy 1, policy_version 1516024 (0.0010) [2023-12-26 11:46:51,104][123091] Updated weights for policy 0, policy_version 1526134 (0.0006) [2023-12-26 11:46:51,167][123091] Updated weights for policy 0, policy_version 1526144 (0.0009) [2023-12-26 11:46:51,230][123091] Updated weights for policy 0, policy_version 1526154 (0.0010) [2023-12-26 11:46:51,532][123090] Updated weights for policy 1, policy_version 1516034 (0.0010) [2023-12-26 11:46:51,595][123090] Updated weights for policy 1, policy_version 1516044 (0.0010) [2023-12-26 11:46:51,660][123090] Updated weights for policy 1, policy_version 1516054 (0.0010) [2023-12-26 11:46:51,726][123090] Updated weights for policy 1, policy_version 1516064 (0.0009) [2023-12-26 11:46:52,075][123091] Updated weights for policy 0, policy_version 1526164 (0.0008) [2023-12-26 11:46:52,137][123091] Updated weights for policy 0, policy_version 1526174 (0.0006) [2023-12-26 11:46:52,202][123091] Updated weights for policy 0, policy_version 1526184 (0.0006) [2023-12-26 11:46:52,588][123090] Updated weights for policy 1, policy_version 1516074 (0.0009) [2023-12-26 11:46:52,656][123090] Updated weights for policy 1, policy_version 1516084 (0.0010) [2023-12-26 11:46:52,715][123090] Updated weights for policy 1, policy_version 1516094 (0.0009) [2023-12-26 11:46:52,980][123091] Updated weights for policy 0, policy_version 1526194 (0.0008) [2023-12-26 11:46:53,046][123091] Updated weights for policy 0, policy_version 1526204 (0.0009) [2023-12-26 11:46:53,096][123091] Updated weights for policy 0, policy_version 1526214 (0.0007) [2023-12-26 11:46:53,167][123091] Updated weights for policy 0, policy_version 1526224 (0.0006) [2023-12-26 11:46:53,507][123090] Updated weights for policy 1, policy_version 1516104 (0.0009) [2023-12-26 11:46:53,578][123090] Updated weights for policy 1, policy_version 1516114 (0.0005) [2023-12-26 11:46:53,626][123090] Updated weights for policy 1, policy_version 1516124 (0.0005) [2023-12-26 11:46:53,775][123091] Updated weights for policy 0, policy_version 1526234 (0.0009) [2023-12-26 11:46:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 778846208. Throughput: 0: 8847.2, 1: 8745.6. Samples: 778823364. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:53,785][121949] Avg episode reward: [(0, '6288.838'), (1, '5803.133')] [2023-12-26 11:46:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001516128_388128768.pth... [2023-12-26 11:46:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001515104_387866624.pth [2023-12-26 11:46:53,830][123091] Updated weights for policy 0, policy_version 1526244 (0.0009) [2023-12-26 11:46:53,892][123091] Updated weights for policy 0, policy_version 1526254 (0.0010) [2023-12-26 11:46:53,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001526256_390725632.pth... [2023-12-26 11:46:53,903][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001525200_390455296.pth [2023-12-26 11:46:54,356][123090] Updated weights for policy 1, policy_version 1516134 (0.0008) [2023-12-26 11:46:54,419][123090] Updated weights for policy 1, policy_version 1516144 (0.0009) [2023-12-26 11:46:54,477][123090] Updated weights for policy 1, policy_version 1516154 (0.0010) [2023-12-26 11:46:54,650][123091] Updated weights for policy 0, policy_version 1526264 (0.0008) [2023-12-26 11:46:54,720][123091] Updated weights for policy 0, policy_version 1526274 (0.0008) [2023-12-26 11:46:54,784][123091] Updated weights for policy 0, policy_version 1526284 (0.0008) [2023-12-26 11:46:55,377][123090] Updated weights for policy 1, policy_version 1516164 (0.0010) [2023-12-26 11:46:55,445][123090] Updated weights for policy 1, policy_version 1516174 (0.0009) [2023-12-26 11:46:55,478][123091] Updated weights for policy 0, policy_version 1526294 (0.0008) [2023-12-26 11:46:55,512][123090] Updated weights for policy 1, policy_version 1516184 (0.0007) [2023-12-26 11:46:55,529][123091] Updated weights for policy 0, policy_version 1526304 (0.0010) [2023-12-26 11:46:55,584][123091] Updated weights for policy 0, policy_version 1526314 (0.0010) [2023-12-26 11:46:56,299][123090] Updated weights for policy 1, policy_version 1516194 (0.0008) [2023-12-26 11:46:56,345][123090] Updated weights for policy 1, policy_version 1516204 (0.0005) [2023-12-26 11:46:56,412][123090] Updated weights for policy 1, policy_version 1516214 (0.0005) [2023-12-26 11:46:56,432][123091] Updated weights for policy 0, policy_version 1526324 (0.0009) [2023-12-26 11:46:56,466][123090] Updated weights for policy 1, policy_version 1516224 (0.0007) [2023-12-26 11:46:56,491][123091] Updated weights for policy 0, policy_version 1526334 (0.0009) [2023-12-26 11:46:56,551][123091] Updated weights for policy 0, policy_version 1526344 (0.0010) [2023-12-26 11:46:57,151][123090] Updated weights for policy 1, policy_version 1516234 (0.0008) [2023-12-26 11:46:57,204][123090] Updated weights for policy 1, policy_version 1516244 (0.0009) [2023-12-26 11:46:57,260][123090] Updated weights for policy 1, policy_version 1516254 (0.0009) [2023-12-26 11:46:57,455][123091] Updated weights for policy 0, policy_version 1526354 (0.0011) [2023-12-26 11:46:57,517][123091] Updated weights for policy 0, policy_version 1526364 (0.0010) [2023-12-26 11:46:57,571][123091] Updated weights for policy 0, policy_version 1526374 (0.0010) [2023-12-26 11:46:57,940][123090] Updated weights for policy 1, policy_version 1516264 (0.0006) [2023-12-26 11:46:58,006][123090] Updated weights for policy 1, policy_version 1516274 (0.0005) [2023-12-26 11:46:58,082][123090] Updated weights for policy 1, policy_version 1516284 (0.0009) [2023-12-26 11:46:58,466][123091] Updated weights for policy 0, policy_version 1526385 (0.0010) [2023-12-26 11:46:58,534][123091] Updated weights for policy 0, policy_version 1526395 (0.0008) [2023-12-26 11:46:58,603][123091] Updated weights for policy 0, policy_version 1526405 (0.0008) [2023-12-26 11:46:58,685][123091] Updated weights for policy 0, policy_version 1526415 (0.0008) [2023-12-26 11:46:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 778936320. Throughput: 0: 8839.8, 1: 8797.9. Samples: 778930756. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:46:58,785][121949] Avg episode reward: [(0, '6240.575'), (1, '5859.006')] [2023-12-26 11:46:58,900][123090] Updated weights for policy 1, policy_version 1516294 (0.0007) [2023-12-26 11:46:58,962][123090] Updated weights for policy 1, policy_version 1516304 (0.0009) [2023-12-26 11:46:59,024][123090] Updated weights for policy 1, policy_version 1516314 (0.0007) [2023-12-26 11:46:59,503][123091] Updated weights for policy 0, policy_version 1526425 (0.0009) [2023-12-26 11:46:59,568][123091] Updated weights for policy 0, policy_version 1526435 (0.0007) [2023-12-26 11:46:59,638][123091] Updated weights for policy 0, policy_version 1526445 (0.0006) [2023-12-26 11:46:59,807][123090] Updated weights for policy 1, policy_version 1516324 (0.0007) [2023-12-26 11:46:59,876][123090] Updated weights for policy 1, policy_version 1516334 (0.0010) [2023-12-26 11:46:59,946][123090] Updated weights for policy 1, policy_version 1516344 (0.0010) [2023-12-26 11:47:00,389][123091] Updated weights for policy 0, policy_version 1526455 (0.0009) [2023-12-26 11:47:00,448][123091] Updated weights for policy 0, policy_version 1526465 (0.0010) [2023-12-26 11:47:00,500][123091] Updated weights for policy 0, policy_version 1526475 (0.0009) [2023-12-26 11:47:00,772][123090] Updated weights for policy 1, policy_version 1516354 (0.0010) [2023-12-26 11:47:00,823][123090] Updated weights for policy 1, policy_version 1516364 (0.0009) [2023-12-26 11:47:00,871][123090] Updated weights for policy 1, policy_version 1516374 (0.0009) [2023-12-26 11:47:01,326][123091] Updated weights for policy 0, policy_version 1526485 (0.0009) [2023-12-26 11:47:01,397][123091] Updated weights for policy 0, policy_version 1526495 (0.0008) [2023-12-26 11:47:01,459][123091] Updated weights for policy 0, policy_version 1526505 (0.0010) [2023-12-26 11:47:01,721][123090] Updated weights for policy 1, policy_version 1516385 (0.0009) [2023-12-26 11:47:01,790][123090] Updated weights for policy 1, policy_version 1516395 (0.0008) [2023-12-26 11:47:01,855][123090] Updated weights for policy 1, policy_version 1516405 (0.0010) [2023-12-26 11:47:01,916][123090] Updated weights for policy 1, policy_version 1516415 (0.0006) [2023-12-26 11:47:02,374][123091] Updated weights for policy 0, policy_version 1526515 (0.0010) [2023-12-26 11:47:02,433][123091] Updated weights for policy 0, policy_version 1526525 (0.0009) [2023-12-26 11:47:02,502][123091] Updated weights for policy 0, policy_version 1526535 (0.0009) [2023-12-26 11:47:02,704][123090] Updated weights for policy 1, policy_version 1516425 (0.0009) [2023-12-26 11:47:02,754][123090] Updated weights for policy 1, policy_version 1516435 (0.0009) [2023-12-26 11:47:02,823][123090] Updated weights for policy 1, policy_version 1516445 (0.0009) [2023-12-26 11:47:03,405][123091] Updated weights for policy 0, policy_version 1526545 (0.0009) [2023-12-26 11:47:03,471][123090] Updated weights for policy 1, policy_version 1516455 (0.0007) [2023-12-26 11:47:03,472][123091] Updated weights for policy 0, policy_version 1526555 (0.0010) [2023-12-26 11:47:03,522][123090] Updated weights for policy 1, policy_version 1516465 (0.0006) [2023-12-26 11:47:03,526][123091] Updated weights for policy 0, policy_version 1526565 (0.0010) [2023-12-26 11:47:03,575][123090] Updated weights for policy 1, policy_version 1516475 (0.0005) [2023-12-26 11:47:03,581][123091] Updated weights for policy 0, policy_version 1526575 (0.0007) [2023-12-26 11:47:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 779026432. Throughput: 0: 8746.8, 1: 8781.7. Samples: 779033820. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:03,785][121949] Avg episode reward: [(0, '6222.277'), (1, '5821.384')] [2023-12-26 11:47:04,315][123091] Updated weights for policy 0, policy_version 1526585 (0.0009) [2023-12-26 11:47:04,384][123091] Updated weights for policy 0, policy_version 1526595 (0.0006) [2023-12-26 11:47:04,406][123090] Updated weights for policy 1, policy_version 1516485 (0.0007) [2023-12-26 11:47:04,447][123091] Updated weights for policy 0, policy_version 1526605 (0.0007) [2023-12-26 11:47:04,471][123090] Updated weights for policy 1, policy_version 1516495 (0.0009) [2023-12-26 11:47:04,545][123090] Updated weights for policy 1, policy_version 1516505 (0.0010) [2023-12-26 11:47:05,022][123091] Updated weights for policy 0, policy_version 1526615 (0.0008) [2023-12-26 11:47:05,068][123091] Updated weights for policy 0, policy_version 1526625 (0.0008) [2023-12-26 11:47:05,124][123091] Updated weights for policy 0, policy_version 1526635 (0.0005) [2023-12-26 11:47:05,350][123090] Updated weights for policy 1, policy_version 1516515 (0.0009) [2023-12-26 11:47:05,398][123090] Updated weights for policy 1, policy_version 1516525 (0.0007) [2023-12-26 11:47:05,454][123090] Updated weights for policy 1, policy_version 1516535 (0.0011) [2023-12-26 11:47:05,787][123091] Updated weights for policy 0, policy_version 1526645 (0.0005) [2023-12-26 11:47:05,834][123091] Updated weights for policy 0, policy_version 1526655 (0.0005) [2023-12-26 11:47:05,885][123091] Updated weights for policy 0, policy_version 1526665 (0.0010) [2023-12-26 11:47:06,293][123090] Updated weights for policy 1, policy_version 1516545 (0.0011) [2023-12-26 11:47:06,365][123090] Updated weights for policy 1, policy_version 1516555 (0.0011) [2023-12-26 11:47:06,433][123090] Updated weights for policy 1, policy_version 1516565 (0.0011) [2023-12-26 11:47:06,508][123090] Updated weights for policy 1, policy_version 1516575 (0.0011) [2023-12-26 11:47:06,711][123091] Updated weights for policy 0, policy_version 1526675 (0.0009) [2023-12-26 11:47:06,768][123091] Updated weights for policy 0, policy_version 1526685 (0.0005) [2023-12-26 11:47:06,817][123091] Updated weights for policy 0, policy_version 1526695 (0.0005) [2023-12-26 11:47:07,305][123090] Updated weights for policy 1, policy_version 1516585 (0.0010) [2023-12-26 11:47:07,361][123090] Updated weights for policy 1, policy_version 1516595 (0.0010) [2023-12-26 11:47:07,421][123090] Updated weights for policy 1, policy_version 1516605 (0.0010) [2023-12-26 11:47:07,559][123091] Updated weights for policy 0, policy_version 1526705 (0.0005) [2023-12-26 11:47:07,620][123091] Updated weights for policy 0, policy_version 1526715 (0.0005) [2023-12-26 11:47:07,683][123091] Updated weights for policy 0, policy_version 1526725 (0.0005) [2023-12-26 11:47:07,740][123091] Updated weights for policy 0, policy_version 1526735 (0.0006) [2023-12-26 11:47:08,165][123090] Updated weights for policy 1, policy_version 1516615 (0.0007) [2023-12-26 11:47:08,232][123090] Updated weights for policy 1, policy_version 1516625 (0.0005) [2023-12-26 11:47:08,323][123090] Updated weights for policy 1, policy_version 1516635 (0.0006) [2023-12-26 11:47:08,393][123091] Updated weights for policy 0, policy_version 1526745 (0.0006) [2023-12-26 11:47:08,462][123091] Updated weights for policy 0, policy_version 1526755 (0.0008) [2023-12-26 11:47:08,528][123091] Updated weights for policy 0, policy_version 1526765 (0.0011) [2023-12-26 11:47:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 779116544. Throughput: 0: 8838.6, 1: 8812.4. Samples: 779088980. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:08,785][121949] Avg episode reward: [(0, '6228.563'), (1, '5766.973')] [2023-12-26 11:47:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001516640_388259840.pth... [2023-12-26 11:47:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001526768_390856704.pth... [2023-12-26 11:47:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001515616_387997696.pth [2023-12-26 11:47:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001525712_390586368.pth [2023-12-26 11:47:08,933][123090] Updated weights for policy 1, policy_version 1516645 (0.0010) [2023-12-26 11:47:08,997][123090] Updated weights for policy 1, policy_version 1516655 (0.0010) [2023-12-26 11:47:09,066][123090] Updated weights for policy 1, policy_version 1516665 (0.0010) [2023-12-26 11:47:09,310][123091] Updated weights for policy 0, policy_version 1526775 (0.0009) [2023-12-26 11:47:09,375][123091] Updated weights for policy 0, policy_version 1526785 (0.0010) [2023-12-26 11:47:09,444][123091] Updated weights for policy 0, policy_version 1526795 (0.0011) [2023-12-26 11:47:09,865][123090] Updated weights for policy 1, policy_version 1516675 (0.0007) [2023-12-26 11:47:09,935][123090] Updated weights for policy 1, policy_version 1516685 (0.0010) [2023-12-26 11:47:10,005][123090] Updated weights for policy 1, policy_version 1516695 (0.0008) [2023-12-26 11:47:10,315][123091] Updated weights for policy 0, policy_version 1526805 (0.0010) [2023-12-26 11:47:10,370][123091] Updated weights for policy 0, policy_version 1526815 (0.0009) [2023-12-26 11:47:10,424][123091] Updated weights for policy 0, policy_version 1526825 (0.0010) [2023-12-26 11:47:10,688][123090] Updated weights for policy 1, policy_version 1516705 (0.0006) [2023-12-26 11:47:10,756][123090] Updated weights for policy 1, policy_version 1516715 (0.0005) [2023-12-26 11:47:10,810][123090] Updated weights for policy 1, policy_version 1516725 (0.0005) [2023-12-26 11:47:10,863][123090] Updated weights for policy 1, policy_version 1516735 (0.0005) [2023-12-26 11:47:11,385][123091] Updated weights for policy 0, policy_version 1526835 (0.0010) [2023-12-26 11:47:11,449][123091] Updated weights for policy 0, policy_version 1526845 (0.0009) [2023-12-26 11:47:11,516][123091] Updated weights for policy 0, policy_version 1526855 (0.0009) [2023-12-26 11:47:11,622][123090] Updated weights for policy 1, policy_version 1516745 (0.0009) [2023-12-26 11:47:11,694][123090] Updated weights for policy 1, policy_version 1516755 (0.0006) [2023-12-26 11:47:11,770][123090] Updated weights for policy 1, policy_version 1516765 (0.0009) [2023-12-26 11:47:12,291][123091] Updated weights for policy 0, policy_version 1526865 (0.0009) [2023-12-26 11:47:12,350][123091] Updated weights for policy 0, policy_version 1526875 (0.0009) [2023-12-26 11:47:12,426][123091] Updated weights for policy 0, policy_version 1526885 (0.0010) [2023-12-26 11:47:12,503][123091] Updated weights for policy 0, policy_version 1526895 (0.0009) [2023-12-26 11:47:12,594][123090] Updated weights for policy 1, policy_version 1516775 (0.0009) [2023-12-26 11:47:12,662][123090] Updated weights for policy 1, policy_version 1516785 (0.0008) [2023-12-26 11:47:12,727][123090] Updated weights for policy 1, policy_version 1516795 (0.0008) [2023-12-26 11:47:13,294][123091] Updated weights for policy 0, policy_version 1526905 (0.0008) [2023-12-26 11:47:13,355][123091] Updated weights for policy 0, policy_version 1526915 (0.0008) [2023-12-26 11:47:13,424][123091] Updated weights for policy 0, policy_version 1526925 (0.0009) [2023-12-26 11:47:13,468][123090] Updated weights for policy 1, policy_version 1516805 (0.0009) [2023-12-26 11:47:13,525][123090] Updated weights for policy 1, policy_version 1516815 (0.0005) [2023-12-26 11:47:13,580][123090] Updated weights for policy 1, policy_version 1516825 (0.0005) [2023-12-26 11:47:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 779206656. Throughput: 0: 8808.7, 1: 8807.2. Samples: 779196732. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:13,784][121949] Avg episode reward: [(0, '6167.371'), (1, '5778.864')] [2023-12-26 11:47:14,229][123090] Updated weights for policy 1, policy_version 1516835 (0.0007) [2023-12-26 11:47:14,275][123091] Updated weights for policy 0, policy_version 1526935 (0.0007) [2023-12-26 11:47:14,287][123090] Updated weights for policy 1, policy_version 1516845 (0.0010) [2023-12-26 11:47:14,328][123091] Updated weights for policy 0, policy_version 1526945 (0.0008) [2023-12-26 11:47:14,350][123090] Updated weights for policy 1, policy_version 1516855 (0.0010) [2023-12-26 11:47:14,373][123091] Updated weights for policy 0, policy_version 1526955 (0.0008) [2023-12-26 11:47:15,047][123090] Updated weights for policy 1, policy_version 1516865 (0.0009) [2023-12-26 11:47:15,112][123090] Updated weights for policy 1, policy_version 1516875 (0.0006) [2023-12-26 11:47:15,175][123090] Updated weights for policy 1, policy_version 1516885 (0.0011) [2023-12-26 11:47:15,193][123091] Updated weights for policy 0, policy_version 1526965 (0.0008) [2023-12-26 11:47:15,251][123090] Updated weights for policy 1, policy_version 1516895 (0.0011) [2023-12-26 11:47:15,265][123091] Updated weights for policy 0, policy_version 1526975 (0.0007) [2023-12-26 11:47:15,339][123091] Updated weights for policy 0, policy_version 1526985 (0.0005) [2023-12-26 11:47:15,990][123090] Updated weights for policy 1, policy_version 1516905 (0.0006) [2023-12-26 11:47:16,013][123091] Updated weights for policy 0, policy_version 1526995 (0.0005) [2023-12-26 11:47:16,036][123090] Updated weights for policy 1, policy_version 1516915 (0.0005) [2023-12-26 11:47:16,069][123091] Updated weights for policy 0, policy_version 1527005 (0.0005) [2023-12-26 11:47:16,084][123090] Updated weights for policy 1, policy_version 1516925 (0.0009) [2023-12-26 11:47:16,121][123091] Updated weights for policy 0, policy_version 1527015 (0.0006) [2023-12-26 11:47:16,845][123091] Updated weights for policy 0, policy_version 1527025 (0.0005) [2023-12-26 11:47:16,890][123090] Updated weights for policy 1, policy_version 1516935 (0.0010) [2023-12-26 11:47:16,898][123091] Updated weights for policy 0, policy_version 1527035 (0.0007) [2023-12-26 11:47:16,948][123091] Updated weights for policy 0, policy_version 1527045 (0.0008) [2023-12-26 11:47:16,952][123090] Updated weights for policy 1, policy_version 1516945 (0.0010) [2023-12-26 11:47:17,003][123090] Updated weights for policy 1, policy_version 1516955 (0.0010) [2023-12-26 11:47:17,010][123091] Updated weights for policy 0, policy_version 1527055 (0.0006) [2023-12-26 11:47:17,793][123090] Updated weights for policy 1, policy_version 1516965 (0.0008) [2023-12-26 11:47:17,842][123091] Updated weights for policy 0, policy_version 1527065 (0.0005) [2023-12-26 11:47:17,852][123090] Updated weights for policy 1, policy_version 1516975 (0.0010) [2023-12-26 11:47:17,919][123091] Updated weights for policy 0, policy_version 1527075 (0.0007) [2023-12-26 11:47:17,929][123090] Updated weights for policy 1, policy_version 1516985 (0.0011) [2023-12-26 11:47:17,987][123091] Updated weights for policy 0, policy_version 1527085 (0.0006) [2023-12-26 11:47:18,662][123090] Updated weights for policy 1, policy_version 1516995 (0.0009) [2023-12-26 11:47:18,730][123090] Updated weights for policy 1, policy_version 1517005 (0.0006) [2023-12-26 11:47:18,758][123091] Updated weights for policy 0, policy_version 1527095 (0.0007) [2023-12-26 11:47:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 779288576. Throughput: 0: 8860.6, 1: 8876.1. Samples: 779306884. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:18,784][121949] Avg episode reward: [(0, '6146.241'), (1, '5683.498')] [2023-12-26 11:47:18,797][123090] Updated weights for policy 1, policy_version 1517015 (0.0010) [2023-12-26 11:47:18,808][123091] Updated weights for policy 0, policy_version 1527105 (0.0008) [2023-12-26 11:47:18,865][123091] Updated weights for policy 0, policy_version 1527115 (0.0009) [2023-12-26 11:47:19,600][123090] Updated weights for policy 1, policy_version 1517025 (0.0010) [2023-12-26 11:47:19,662][123090] Updated weights for policy 1, policy_version 1517035 (0.0005) [2023-12-26 11:47:19,696][123091] Updated weights for policy 0, policy_version 1527125 (0.0008) [2023-12-26 11:47:19,726][123090] Updated weights for policy 1, policy_version 1517045 (0.0006) [2023-12-26 11:47:19,772][123091] Updated weights for policy 0, policy_version 1527135 (0.0008) [2023-12-26 11:47:19,790][123090] Updated weights for policy 1, policy_version 1517055 (0.0007) [2023-12-26 11:47:19,837][123091] Updated weights for policy 0, policy_version 1527145 (0.0008) [2023-12-26 11:47:20,602][123090] Updated weights for policy 1, policy_version 1517065 (0.0009) [2023-12-26 11:47:20,605][123091] Updated weights for policy 0, policy_version 1527155 (0.0006) [2023-12-26 11:47:20,669][123090] Updated weights for policy 1, policy_version 1517075 (0.0006) [2023-12-26 11:47:20,676][123091] Updated weights for policy 0, policy_version 1527165 (0.0010) [2023-12-26 11:47:20,735][123091] Updated weights for policy 0, policy_version 1527175 (0.0008) [2023-12-26 11:47:20,738][123090] Updated weights for policy 1, policy_version 1517085 (0.0006) [2023-12-26 11:47:21,470][123090] Updated weights for policy 1, policy_version 1517095 (0.0008) [2023-12-26 11:47:21,527][123090] Updated weights for policy 1, policy_version 1517105 (0.0007) [2023-12-26 11:47:21,570][123091] Updated weights for policy 0, policy_version 1527185 (0.0009) [2023-12-26 11:47:21,573][123090] Updated weights for policy 1, policy_version 1517115 (0.0005) [2023-12-26 11:47:21,631][123091] Updated weights for policy 0, policy_version 1527195 (0.0010) [2023-12-26 11:47:21,687][123091] Updated weights for policy 0, policy_version 1527205 (0.0010) [2023-12-26 11:47:21,755][123091] Updated weights for policy 0, policy_version 1527215 (0.0011) [2023-12-26 11:47:22,363][123090] Updated weights for policy 1, policy_version 1517125 (0.0008) [2023-12-26 11:47:22,437][123090] Updated weights for policy 1, policy_version 1517135 (0.0009) [2023-12-26 11:47:22,510][123090] Updated weights for policy 1, policy_version 1517145 (0.0010) [2023-12-26 11:47:22,600][123091] Updated weights for policy 0, policy_version 1527225 (0.0009) [2023-12-26 11:47:22,668][123091] Updated weights for policy 0, policy_version 1527235 (0.0010) [2023-12-26 11:47:22,731][123091] Updated weights for policy 0, policy_version 1527245 (0.0009) [2023-12-26 11:47:23,215][123090] Updated weights for policy 1, policy_version 1517155 (0.0009) [2023-12-26 11:47:23,266][123090] Updated weights for policy 1, policy_version 1517165 (0.0005) [2023-12-26 11:47:23,317][123090] Updated weights for policy 1, policy_version 1517175 (0.0005) [2023-12-26 11:47:23,668][123091] Updated weights for policy 0, policy_version 1527255 (0.0009) [2023-12-26 11:47:23,726][123091] Updated weights for policy 0, policy_version 1527265 (0.0009) [2023-12-26 11:47:23,780][123091] Updated weights for policy 0, policy_version 1527275 (0.0009) [2023-12-26 11:47:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 779378688. Throughput: 0: 8867.6, 1: 8866.6. Samples: 779359172. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:23,785][121949] Avg episode reward: [(0, '6250.368'), (1, '5702.895')] [2023-12-26 11:47:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001517184_388399104.pth... [2023-12-26 11:47:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001516128_388128768.pth [2023-12-26 11:47:23,803][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001527280_390987776.pth... [2023-12-26 11:47:23,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001526256_390725632.pth [2023-12-26 11:47:24,016][123090] Updated weights for policy 1, policy_version 1517185 (0.0005) [2023-12-26 11:47:24,081][123090] Updated weights for policy 1, policy_version 1517195 (0.0005) [2023-12-26 11:47:24,153][123090] Updated weights for policy 1, policy_version 1517205 (0.0005) [2023-12-26 11:47:24,225][123090] Updated weights for policy 1, policy_version 1517215 (0.0006) [2023-12-26 11:47:24,521][123091] Updated weights for policy 0, policy_version 1527285 (0.0008) [2023-12-26 11:47:24,569][123091] Updated weights for policy 0, policy_version 1527295 (0.0006) [2023-12-26 11:47:24,629][123091] Updated weights for policy 0, policy_version 1527305 (0.0011) [2023-12-26 11:47:24,903][123090] Updated weights for policy 1, policy_version 1517225 (0.0006) [2023-12-26 11:47:24,982][123090] Updated weights for policy 1, policy_version 1517235 (0.0005) [2023-12-26 11:47:25,058][123090] Updated weights for policy 1, policy_version 1517245 (0.0005) [2023-12-26 11:47:25,397][123091] Updated weights for policy 0, policy_version 1527315 (0.0011) [2023-12-26 11:47:25,444][123091] Updated weights for policy 0, policy_version 1527325 (0.0010) [2023-12-26 11:47:25,491][123091] Updated weights for policy 0, policy_version 1527335 (0.0011) [2023-12-26 11:47:25,761][123090] Updated weights for policy 1, policy_version 1517255 (0.0008) [2023-12-26 11:47:25,814][123090] Updated weights for policy 1, policy_version 1517265 (0.0010) [2023-12-26 11:47:25,880][123090] Updated weights for policy 1, policy_version 1517275 (0.0010) [2023-12-26 11:47:26,253][123091] Updated weights for policy 0, policy_version 1527345 (0.0011) [2023-12-26 11:47:26,300][123091] Updated weights for policy 0, policy_version 1527355 (0.0011) [2023-12-26 11:47:26,345][123091] Updated weights for policy 0, policy_version 1527365 (0.0011) [2023-12-26 11:47:26,404][123091] Updated weights for policy 0, policy_version 1527375 (0.0010) [2023-12-26 11:47:26,774][123090] Updated weights for policy 1, policy_version 1517285 (0.0009) [2023-12-26 11:47:26,826][123090] Updated weights for policy 1, policy_version 1517295 (0.0009) [2023-12-26 11:47:26,879][123090] Updated weights for policy 1, policy_version 1517306 (0.0010) [2023-12-26 11:47:27,199][123091] Updated weights for policy 0, policy_version 1527385 (0.0010) [2023-12-26 11:47:27,252][123091] Updated weights for policy 0, policy_version 1527395 (0.0010) [2023-12-26 11:47:27,300][123091] Updated weights for policy 0, policy_version 1527405 (0.0009) [2023-12-26 11:47:27,668][123090] Updated weights for policy 1, policy_version 1517316 (0.0008) [2023-12-26 11:47:27,720][123090] Updated weights for policy 1, policy_version 1517326 (0.0006) [2023-12-26 11:47:27,784][123090] Updated weights for policy 1, policy_version 1517336 (0.0008) [2023-12-26 11:47:28,151][123091] Updated weights for policy 0, policy_version 1527415 (0.0010) [2023-12-26 11:47:28,207][123091] Updated weights for policy 0, policy_version 1527425 (0.0009) [2023-12-26 11:47:28,255][123091] Updated weights for policy 0, policy_version 1527435 (0.0009) [2023-12-26 11:47:28,513][123090] Updated weights for policy 1, policy_version 1517346 (0.0007) [2023-12-26 11:47:28,575][123090] Updated weights for policy 1, policy_version 1517356 (0.0009) [2023-12-26 11:47:28,639][123090] Updated weights for policy 1, policy_version 1517366 (0.0010) [2023-12-26 11:47:28,706][123090] Updated weights for policy 1, policy_version 1517376 (0.0008) [2023-12-26 11:47:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 779476992. Throughput: 0: 8875.3, 1: 8951.9. Samples: 779467756. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:28,784][121949] Avg episode reward: [(0, '6398.190'), (1, '5719.875')] [2023-12-26 11:47:29,153][123091] Updated weights for policy 0, policy_version 1527445 (0.0010) [2023-12-26 11:47:29,210][123091] Updated weights for policy 0, policy_version 1527455 (0.0010) [2023-12-26 11:47:29,273][123091] Updated weights for policy 0, policy_version 1527465 (0.0010) [2023-12-26 11:47:29,529][123090] Updated weights for policy 1, policy_version 1517386 (0.0009) [2023-12-26 11:47:29,593][123090] Updated weights for policy 1, policy_version 1517396 (0.0009) [2023-12-26 11:47:29,649][123090] Updated weights for policy 1, policy_version 1517406 (0.0009) [2023-12-26 11:47:30,146][123091] Updated weights for policy 0, policy_version 1527475 (0.0009) [2023-12-26 11:47:30,206][123091] Updated weights for policy 0, policy_version 1527485 (0.0009) [2023-12-26 11:47:30,265][123091] Updated weights for policy 0, policy_version 1527495 (0.0009) [2023-12-26 11:47:30,449][123090] Updated weights for policy 1, policy_version 1517416 (0.0010) [2023-12-26 11:47:30,512][123090] Updated weights for policy 1, policy_version 1517426 (0.0010) [2023-12-26 11:47:30,575][123090] Updated weights for policy 1, policy_version 1517436 (0.0010) [2023-12-26 11:47:30,973][123091] Updated weights for policy 0, policy_version 1527505 (0.0008) [2023-12-26 11:47:31,019][123091] Updated weights for policy 0, policy_version 1527515 (0.0005) [2023-12-26 11:47:31,085][123091] Updated weights for policy 0, policy_version 1527525 (0.0009) [2023-12-26 11:47:31,157][123091] Updated weights for policy 0, policy_version 1527535 (0.0009) [2023-12-26 11:47:31,406][123090] Updated weights for policy 1, policy_version 1517446 (0.0007) [2023-12-26 11:47:31,468][123090] Updated weights for policy 1, policy_version 1517456 (0.0006) [2023-12-26 11:47:31,533][123090] Updated weights for policy 1, policy_version 1517466 (0.0006) [2023-12-26 11:47:32,057][123091] Updated weights for policy 0, policy_version 1527545 (0.0011) [2023-12-26 11:47:32,127][123091] Updated weights for policy 0, policy_version 1527555 (0.0011) [2023-12-26 11:47:32,190][123091] Updated weights for policy 0, policy_version 1527565 (0.0010) [2023-12-26 11:47:32,283][123090] Updated weights for policy 1, policy_version 1517476 (0.0008) [2023-12-26 11:47:32,353][123090] Updated weights for policy 1, policy_version 1517487 (0.0008) [2023-12-26 11:47:32,412][123090] Updated weights for policy 1, policy_version 1517497 (0.0008) [2023-12-26 11:47:33,026][123091] Updated weights for policy 0, policy_version 1527575 (0.0011) [2023-12-26 11:47:33,089][123091] Updated weights for policy 0, policy_version 1527585 (0.0011) [2023-12-26 11:47:33,144][123091] Updated weights for policy 0, policy_version 1527595 (0.0010) [2023-12-26 11:47:33,170][123090] Updated weights for policy 1, policy_version 1517507 (0.0007) [2023-12-26 11:47:33,230][123090] Updated weights for policy 1, policy_version 1517517 (0.0010) [2023-12-26 11:47:33,292][123090] Updated weights for policy 1, policy_version 1517527 (0.0010) [2023-12-26 11:47:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 779558912. Throughput: 0: 8846.5, 1: 8959.2. Samples: 779572880. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:33,785][121949] Avg episode reward: [(0, '6394.844'), (1, '5579.036')] [2023-12-26 11:47:33,822][123091] Updated weights for policy 0, policy_version 1527605 (0.0006) [2023-12-26 11:47:33,871][123091] Updated weights for policy 0, policy_version 1527615 (0.0005) [2023-12-26 11:47:33,918][123091] Updated weights for policy 0, policy_version 1527625 (0.0010) [2023-12-26 11:47:34,135][123090] Updated weights for policy 1, policy_version 1517537 (0.0011) [2023-12-26 11:47:34,196][123090] Updated weights for policy 1, policy_version 1517547 (0.0011) [2023-12-26 11:47:34,252][123090] Updated weights for policy 1, policy_version 1517557 (0.0010) [2023-12-26 11:47:34,309][123090] Updated weights for policy 1, policy_version 1517567 (0.0009) [2023-12-26 11:47:34,715][123091] Updated weights for policy 0, policy_version 1527635 (0.0010) [2023-12-26 11:47:34,776][123091] Updated weights for policy 0, policy_version 1527645 (0.0009) [2023-12-26 11:47:34,830][123091] Updated weights for policy 0, policy_version 1527655 (0.0010) [2023-12-26 11:47:35,126][123090] Updated weights for policy 1, policy_version 1517577 (0.0009) [2023-12-26 11:47:35,188][123090] Updated weights for policy 1, policy_version 1517587 (0.0010) [2023-12-26 11:47:35,252][123090] Updated weights for policy 1, policy_version 1517597 (0.0009) [2023-12-26 11:47:35,627][123091] Updated weights for policy 0, policy_version 1527665 (0.0009) [2023-12-26 11:47:35,684][123091] Updated weights for policy 0, policy_version 1527675 (0.0010) [2023-12-26 11:47:35,736][123091] Updated weights for policy 0, policy_version 1527685 (0.0010) [2023-12-26 11:47:35,795][123091] Updated weights for policy 0, policy_version 1527696 (0.0010) [2023-12-26 11:47:35,998][123090] Updated weights for policy 1, policy_version 1517607 (0.0007) [2023-12-26 11:47:36,062][123090] Updated weights for policy 1, policy_version 1517617 (0.0006) [2023-12-26 11:47:36,130][123090] Updated weights for policy 1, policy_version 1517627 (0.0008) [2023-12-26 11:47:36,735][123091] Updated weights for policy 0, policy_version 1527706 (0.0009) [2023-12-26 11:47:36,803][123091] Updated weights for policy 0, policy_version 1527716 (0.0010) [2023-12-26 11:47:36,863][123091] Updated weights for policy 0, policy_version 1527726 (0.0009) [2023-12-26 11:47:36,867][123090] Updated weights for policy 1, policy_version 1517637 (0.0007) [2023-12-26 11:47:36,925][123090] Updated weights for policy 1, policy_version 1517647 (0.0009) [2023-12-26 11:47:36,988][123090] Updated weights for policy 1, policy_version 1517657 (0.0011) [2023-12-26 11:47:37,738][123091] Updated weights for policy 0, policy_version 1527736 (0.0009) [2023-12-26 11:47:37,741][123090] Updated weights for policy 1, policy_version 1517667 (0.0011) [2023-12-26 11:47:37,796][123090] Updated weights for policy 1, policy_version 1517677 (0.0010) [2023-12-26 11:47:37,805][123091] Updated weights for policy 0, policy_version 1527746 (0.0010) [2023-12-26 11:47:37,852][123090] Updated weights for policy 1, policy_version 1517687 (0.0010) [2023-12-26 11:47:37,864][123091] Updated weights for policy 0, policy_version 1527756 (0.0008) [2023-12-26 11:47:38,606][123091] Updated weights for policy 0, policy_version 1527766 (0.0007) [2023-12-26 11:47:38,674][123091] Updated weights for policy 0, policy_version 1527776 (0.0006) [2023-12-26 11:47:38,680][123090] Updated weights for policy 1, policy_version 1517697 (0.0010) [2023-12-26 11:47:38,733][123091] Updated weights for policy 0, policy_version 1527786 (0.0007) [2023-12-26 11:47:38,755][123090] Updated weights for policy 1, policy_version 1517707 (0.0007) [2023-12-26 11:47:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 779649024. Throughput: 0: 8808.5, 1: 9027.2. Samples: 779625968. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:38,785][121949] Avg episode reward: [(0, '6319.988'), (1, '5536.786')] [2023-12-26 11:47:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001527792_391118848.pth... [2023-12-26 11:47:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001526768_390856704.pth [2023-12-26 11:47:38,821][123090] Updated weights for policy 1, policy_version 1517717 (0.0009) [2023-12-26 11:47:38,896][123090] Updated weights for policy 1, policy_version 1517727 (0.0010) [2023-12-26 11:47:38,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001517728_388538368.pth... [2023-12-26 11:47:38,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001516640_388259840.pth [2023-12-26 11:47:39,459][123091] Updated weights for policy 0, policy_version 1527796 (0.0008) [2023-12-26 11:47:39,522][123091] Updated weights for policy 0, policy_version 1527806 (0.0006) [2023-12-26 11:47:39,584][123091] Updated weights for policy 0, policy_version 1527816 (0.0006) [2023-12-26 11:47:39,708][123090] Updated weights for policy 1, policy_version 1517737 (0.0011) [2023-12-26 11:47:39,774][123090] Updated weights for policy 1, policy_version 1517747 (0.0011) [2023-12-26 11:47:39,841][123090] Updated weights for policy 1, policy_version 1517757 (0.0011) [2023-12-26 11:47:40,294][123091] Updated weights for policy 0, policy_version 1527826 (0.0007) [2023-12-26 11:47:40,358][123091] Updated weights for policy 0, policy_version 1527836 (0.0006) [2023-12-26 11:47:40,421][123091] Updated weights for policy 0, policy_version 1527846 (0.0006) [2023-12-26 11:47:40,484][123091] Updated weights for policy 0, policy_version 1527856 (0.0010) [2023-12-26 11:47:40,666][123090] Updated weights for policy 1, policy_version 1517767 (0.0006) [2023-12-26 11:47:40,717][123090] Updated weights for policy 1, policy_version 1517777 (0.0008) [2023-12-26 11:47:40,766][123090] Updated weights for policy 1, policy_version 1517787 (0.0008) [2023-12-26 11:47:41,290][123091] Updated weights for policy 0, policy_version 1527866 (0.0010) [2023-12-26 11:47:41,364][123091] Updated weights for policy 0, policy_version 1527876 (0.0010) [2023-12-26 11:47:41,432][123091] Updated weights for policy 0, policy_version 1527886 (0.0009) [2023-12-26 11:47:41,650][123090] Updated weights for policy 1, policy_version 1517797 (0.0009) [2023-12-26 11:47:41,711][123090] Updated weights for policy 1, policy_version 1517807 (0.0007) [2023-12-26 11:47:41,787][123090] Updated weights for policy 1, policy_version 1517817 (0.0006) [2023-12-26 11:47:42,273][123091] Updated weights for policy 0, policy_version 1527896 (0.0010) [2023-12-26 11:47:42,348][123091] Updated weights for policy 0, policy_version 1527906 (0.0011) [2023-12-26 11:47:42,419][123091] Updated weights for policy 0, policy_version 1527916 (0.0010) [2023-12-26 11:47:42,534][123090] Updated weights for policy 1, policy_version 1517827 (0.0006) [2023-12-26 11:47:42,598][123090] Updated weights for policy 1, policy_version 1517837 (0.0008) [2023-12-26 11:47:42,660][123090] Updated weights for policy 1, policy_version 1517847 (0.0010) [2023-12-26 11:47:43,215][123091] Updated weights for policy 0, policy_version 1527926 (0.0009) [2023-12-26 11:47:43,267][123091] Updated weights for policy 0, policy_version 1527936 (0.0009) [2023-12-26 11:47:43,317][123091] Updated weights for policy 0, policy_version 1527946 (0.0009) [2023-12-26 11:47:43,473][123090] Updated weights for policy 1, policy_version 1517857 (0.0010) [2023-12-26 11:47:43,533][123090] Updated weights for policy 1, policy_version 1517867 (0.0009) [2023-12-26 11:47:43,589][123090] Updated weights for policy 1, policy_version 1517877 (0.0009) [2023-12-26 11:47:43,639][123090] Updated weights for policy 1, policy_version 1517887 (0.0009) [2023-12-26 11:47:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 779739136. Throughput: 0: 8781.6, 1: 9002.8. Samples: 779731056. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:43,785][121949] Avg episode reward: [(0, '6293.169'), (1, '5620.479')] [2023-12-26 11:47:44,140][123091] Updated weights for policy 0, policy_version 1527956 (0.0009) [2023-12-26 11:47:44,193][123091] Updated weights for policy 0, policy_version 1527966 (0.0009) [2023-12-26 11:47:44,255][123091] Updated weights for policy 0, policy_version 1527976 (0.0010) [2023-12-26 11:47:44,474][123090] Updated weights for policy 1, policy_version 1517897 (0.0010) [2023-12-26 11:47:44,527][123090] Updated weights for policy 1, policy_version 1517907 (0.0009) [2023-12-26 11:47:44,586][123090] Updated weights for policy 1, policy_version 1517917 (0.0009) [2023-12-26 11:47:45,074][123091] Updated weights for policy 0, policy_version 1527986 (0.0009) [2023-12-26 11:47:45,138][123091] Updated weights for policy 0, policy_version 1527996 (0.0009) [2023-12-26 11:47:45,202][123091] Updated weights for policy 0, policy_version 1528006 (0.0009) [2023-12-26 11:47:45,275][123091] Updated weights for policy 0, policy_version 1528016 (0.0009) [2023-12-26 11:47:45,428][123090] Updated weights for policy 1, policy_version 1517927 (0.0007) [2023-12-26 11:47:45,497][123090] Updated weights for policy 1, policy_version 1517937 (0.0010) [2023-12-26 11:47:45,569][123090] Updated weights for policy 1, policy_version 1517947 (0.0011) [2023-12-26 11:47:46,155][123091] Updated weights for policy 0, policy_version 1528026 (0.0009) [2023-12-26 11:47:46,216][123091] Updated weights for policy 0, policy_version 1528036 (0.0010) [2023-12-26 11:47:46,249][123090] Updated weights for policy 1, policy_version 1517957 (0.0007) [2023-12-26 11:47:46,268][123091] Updated weights for policy 0, policy_version 1528047 (0.0009) [2023-12-26 11:47:46,294][123090] Updated weights for policy 1, policy_version 1517967 (0.0010) [2023-12-26 11:47:46,348][123090] Updated weights for policy 1, policy_version 1517977 (0.0010) [2023-12-26 11:47:47,107][123091] Updated weights for policy 0, policy_version 1528057 (0.0009) [2023-12-26 11:47:47,155][123091] Updated weights for policy 0, policy_version 1528067 (0.0009) [2023-12-26 11:47:47,191][123090] Updated weights for policy 1, policy_version 1517987 (0.0010) [2023-12-26 11:47:47,205][123091] Updated weights for policy 0, policy_version 1528077 (0.0009) [2023-12-26 11:47:47,246][123090] Updated weights for policy 1, policy_version 1517997 (0.0010) [2023-12-26 11:47:47,319][123090] Updated weights for policy 1, policy_version 1518007 (0.0010) [2023-12-26 11:47:48,011][123091] Updated weights for policy 0, policy_version 1528087 (0.0009) [2023-12-26 11:47:48,061][123091] Updated weights for policy 0, policy_version 1528097 (0.0010) [2023-12-26 11:47:48,117][123091] Updated weights for policy 0, policy_version 1528107 (0.0009) [2023-12-26 11:47:48,140][123090] Updated weights for policy 1, policy_version 1518017 (0.0010) [2023-12-26 11:47:48,204][123090] Updated weights for policy 1, policy_version 1518027 (0.0011) [2023-12-26 11:47:48,272][123090] Updated weights for policy 1, policy_version 1518037 (0.0011) [2023-12-26 11:47:48,337][123090] Updated weights for policy 1, policy_version 1518047 (0.0011) [2023-12-26 11:47:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 779821056. Throughput: 0: 8829.3, 1: 8988.9. Samples: 779835640. Policy #0 lag: (min: 24.0, avg: 45.6, max: 56.0) [2023-12-26 11:47:48,785][121949] Avg episode reward: [(0, '6344.886'), (1, '5634.489')] [2023-12-26 11:47:48,909][123091] Updated weights for policy 0, policy_version 1528117 (0.0008) [2023-12-26 11:47:48,961][123091] Updated weights for policy 0, policy_version 1528127 (0.0011) [2023-12-26 11:47:49,020][123091] Updated weights for policy 0, policy_version 1528137 (0.0011) [2023-12-26 11:47:49,118][123090] Updated weights for policy 1, policy_version 1518057 (0.0006) [2023-12-26 11:47:49,194][123090] Updated weights for policy 1, policy_version 1518067 (0.0008) [2023-12-26 11:47:49,271][123090] Updated weights for policy 1, policy_version 1518077 (0.0007) [2023-12-26 11:47:49,788][123091] Updated weights for policy 0, policy_version 1528147 (0.0009) [2023-12-26 11:47:49,855][123091] Updated weights for policy 0, policy_version 1528157 (0.0007) [2023-12-26 11:47:49,920][123091] Updated weights for policy 0, policy_version 1528167 (0.0006) [2023-12-26 11:47:50,025][123090] Updated weights for policy 1, policy_version 1518087 (0.0010) [2023-12-26 11:47:50,096][123090] Updated weights for policy 1, policy_version 1518097 (0.0010) [2023-12-26 11:47:50,149][123090] Updated weights for policy 1, policy_version 1518107 (0.0010) [2023-12-26 11:47:50,750][123091] Updated weights for policy 0, policy_version 1528177 (0.0009) [2023-12-26 11:47:50,817][123091] Updated weights for policy 0, policy_version 1528187 (0.0009) [2023-12-26 11:47:50,882][123091] Updated weights for policy 0, policy_version 1528197 (0.0009) [2023-12-26 11:47:50,908][123090] Updated weights for policy 1, policy_version 1518117 (0.0010) [2023-12-26 11:47:50,938][123091] Updated weights for policy 0, policy_version 1528207 (0.0010) [2023-12-26 11:47:50,979][123090] Updated weights for policy 1, policy_version 1518127 (0.0010) [2023-12-26 11:47:51,057][123090] Updated weights for policy 1, policy_version 1518137 (0.0009) [2023-12-26 11:47:51,758][123091] Updated weights for policy 0, policy_version 1528217 (0.0010) [2023-12-26 11:47:51,815][123091] Updated weights for policy 0, policy_version 1528227 (0.0011) [2023-12-26 11:47:51,872][123090] Updated weights for policy 1, policy_version 1518147 (0.0006) [2023-12-26 11:47:51,878][123091] Updated weights for policy 0, policy_version 1528237 (0.0011) [2023-12-26 11:47:51,934][123090] Updated weights for policy 1, policy_version 1518157 (0.0008) [2023-12-26 11:47:51,998][123090] Updated weights for policy 1, policy_version 1518167 (0.0009) [2023-12-26 11:47:52,697][123091] Updated weights for policy 0, policy_version 1528247 (0.0008) [2023-12-26 11:47:52,762][123091] Updated weights for policy 0, policy_version 1528257 (0.0005) [2023-12-26 11:47:52,838][123091] Updated weights for policy 0, policy_version 1528267 (0.0006) [2023-12-26 11:47:52,864][123090] Updated weights for policy 1, policy_version 1518177 (0.0009) [2023-12-26 11:47:52,921][123090] Updated weights for policy 1, policy_version 1518187 (0.0009) [2023-12-26 11:47:52,982][123090] Updated weights for policy 1, policy_version 1518197 (0.0010) [2023-12-26 11:47:53,035][123090] Updated weights for policy 1, policy_version 1518207 (0.0009) [2023-12-26 11:47:53,520][123091] Updated weights for policy 0, policy_version 1528277 (0.0006) [2023-12-26 11:47:53,595][123091] Updated weights for policy 0, policy_version 1528287 (0.0005) [2023-12-26 11:47:53,671][123091] Updated weights for policy 0, policy_version 1528297 (0.0005) [2023-12-26 11:47:53,722][123090] Updated weights for policy 1, policy_version 1518217 (0.0009) [2023-12-26 11:47:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 779911168. Throughput: 0: 8754.3, 1: 9010.1. Samples: 779888380. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:47:53,785][123090] Updated weights for policy 1, policy_version 1518227 (0.0009) [2023-12-26 11:47:53,785][121949] Avg episode reward: [(0, '6299.526'), (1, '5564.089')] [2023-12-26 11:47:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001528304_391249920.pth... [2023-12-26 11:47:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001527280_390987776.pth [2023-12-26 11:47:53,841][123090] Updated weights for policy 1, policy_version 1518237 (0.0009) [2023-12-26 11:47:53,855][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001518240_388669440.pth... [2023-12-26 11:47:53,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001517184_388399104.pth [2023-12-26 11:47:54,230][123091] Updated weights for policy 0, policy_version 1528307 (0.0006) [2023-12-26 11:47:54,294][123091] Updated weights for policy 0, policy_version 1528317 (0.0008) [2023-12-26 11:47:54,363][123091] Updated weights for policy 0, policy_version 1528327 (0.0005) [2023-12-26 11:47:54,601][123090] Updated weights for policy 1, policy_version 1518247 (0.0008) [2023-12-26 11:47:54,648][123090] Updated weights for policy 1, policy_version 1518257 (0.0008) [2023-12-26 11:47:54,710][123090] Updated weights for policy 1, policy_version 1518267 (0.0008) [2023-12-26 11:47:55,111][123091] Updated weights for policy 0, policy_version 1528337 (0.0006) [2023-12-26 11:47:55,173][123091] Updated weights for policy 0, policy_version 1528347 (0.0009) [2023-12-26 11:47:55,233][123091] Updated weights for policy 0, policy_version 1528357 (0.0010) [2023-12-26 11:47:55,299][123091] Updated weights for policy 0, policy_version 1528367 (0.0010) [2023-12-26 11:47:55,543][123090] Updated weights for policy 1, policy_version 1518277 (0.0008) [2023-12-26 11:47:55,598][123090] Updated weights for policy 1, policy_version 1518287 (0.0007) [2023-12-26 11:47:55,654][123090] Updated weights for policy 1, policy_version 1518297 (0.0005) [2023-12-26 11:47:56,131][123091] Updated weights for policy 0, policy_version 1528377 (0.0009) [2023-12-26 11:47:56,181][123091] Updated weights for policy 0, policy_version 1528387 (0.0009) [2023-12-26 11:47:56,229][123091] Updated weights for policy 0, policy_version 1528397 (0.0009) [2023-12-26 11:47:56,410][123090] Updated weights for policy 1, policy_version 1518307 (0.0006) [2023-12-26 11:47:56,457][123090] Updated weights for policy 1, policy_version 1518317 (0.0008) [2023-12-26 11:47:56,505][123090] Updated weights for policy 1, policy_version 1518327 (0.0009) [2023-12-26 11:47:56,978][123091] Updated weights for policy 0, policy_version 1528407 (0.0007) [2023-12-26 11:47:57,022][123091] Updated weights for policy 0, policy_version 1528417 (0.0005) [2023-12-26 11:47:57,075][123091] Updated weights for policy 0, policy_version 1528427 (0.0005) [2023-12-26 11:47:57,393][123090] Updated weights for policy 1, policy_version 1518337 (0.0009) [2023-12-26 11:47:57,460][123090] Updated weights for policy 1, policy_version 1518347 (0.0009) [2023-12-26 11:47:57,529][123090] Updated weights for policy 1, policy_version 1518357 (0.0010) [2023-12-26 11:47:57,592][123090] Updated weights for policy 1, policy_version 1518367 (0.0010) [2023-12-26 11:47:57,765][123091] Updated weights for policy 0, policy_version 1528437 (0.0005) [2023-12-26 11:47:57,810][123091] Updated weights for policy 0, policy_version 1528447 (0.0005) [2023-12-26 11:47:57,855][123091] Updated weights for policy 0, policy_version 1528457 (0.0005) [2023-12-26 11:47:58,401][123090] Updated weights for policy 1, policy_version 1518377 (0.0010) [2023-12-26 11:47:58,472][123090] Updated weights for policy 1, policy_version 1518387 (0.0010) [2023-12-26 11:47:58,536][123090] Updated weights for policy 1, policy_version 1518397 (0.0010) [2023-12-26 11:47:58,763][123091] Updated weights for policy 0, policy_version 1528468 (0.0006) [2023-12-26 11:47:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 780001280. Throughput: 0: 8845.4, 1: 8948.9. Samples: 779997476. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:47:58,785][121949] Avg episode reward: [(0, '6167.755'), (1, '5801.776')] [2023-12-26 11:47:58,835][123091] Updated weights for policy 0, policy_version 1528478 (0.0010) [2023-12-26 11:47:58,894][123091] Updated weights for policy 0, policy_version 1528488 (0.0009) [2023-12-26 11:47:59,474][123090] Updated weights for policy 1, policy_version 1518407 (0.0011) [2023-12-26 11:47:59,540][123090] Updated weights for policy 1, policy_version 1518417 (0.0010) [2023-12-26 11:47:59,610][123090] Updated weights for policy 1, policy_version 1518427 (0.0010) [2023-12-26 11:47:59,699][123091] Updated weights for policy 0, policy_version 1528498 (0.0007) [2023-12-26 11:47:59,754][123091] Updated weights for policy 0, policy_version 1528508 (0.0008) [2023-12-26 11:47:59,818][123091] Updated weights for policy 0, policy_version 1528518 (0.0009) [2023-12-26 11:47:59,883][123091] Updated weights for policy 0, policy_version 1528528 (0.0008) [2023-12-26 11:48:00,421][123090] Updated weights for policy 1, policy_version 1518437 (0.0008) [2023-12-26 11:48:00,477][123090] Updated weights for policy 1, policy_version 1518447 (0.0005) [2023-12-26 11:48:00,540][123090] Updated weights for policy 1, policy_version 1518457 (0.0006) [2023-12-26 11:48:00,680][123091] Updated weights for policy 0, policy_version 1528538 (0.0009) [2023-12-26 11:48:00,735][123091] Updated weights for policy 0, policy_version 1528548 (0.0005) [2023-12-26 11:48:00,789][123091] Updated weights for policy 0, policy_version 1528558 (0.0005) [2023-12-26 11:48:01,280][123090] Updated weights for policy 1, policy_version 1518467 (0.0007) [2023-12-26 11:48:01,340][123090] Updated weights for policy 1, policy_version 1518477 (0.0009) [2023-12-26 11:48:01,406][123090] Updated weights for policy 1, policy_version 1518487 (0.0008) [2023-12-26 11:48:01,415][123091] Updated weights for policy 0, policy_version 1528568 (0.0008) [2023-12-26 11:48:01,469][123091] Updated weights for policy 0, policy_version 1528578 (0.0008) [2023-12-26 11:48:01,529][123091] Updated weights for policy 0, policy_version 1528588 (0.0008) [2023-12-26 11:48:02,254][123090] Updated weights for policy 1, policy_version 1518497 (0.0008) [2023-12-26 11:48:02,283][123091] Updated weights for policy 0, policy_version 1528598 (0.0010) [2023-12-26 11:48:02,318][123090] Updated weights for policy 1, policy_version 1518507 (0.0011) [2023-12-26 11:48:02,352][123091] Updated weights for policy 0, policy_version 1528608 (0.0007) [2023-12-26 11:48:02,387][123090] Updated weights for policy 1, policy_version 1518517 (0.0010) [2023-12-26 11:48:02,415][123091] Updated weights for policy 0, policy_version 1528618 (0.0008) [2023-12-26 11:48:02,451][123090] Updated weights for policy 1, policy_version 1518527 (0.0011) [2023-12-26 11:48:03,126][123091] Updated weights for policy 0, policy_version 1528628 (0.0007) [2023-12-26 11:48:03,187][123091] Updated weights for policy 0, policy_version 1528638 (0.0006) [2023-12-26 11:48:03,206][123090] Updated weights for policy 1, policy_version 1518537 (0.0006) [2023-12-26 11:48:03,235][123091] Updated weights for policy 0, policy_version 1528648 (0.0005) [2023-12-26 11:48:03,254][123090] Updated weights for policy 1, policy_version 1518547 (0.0005) [2023-12-26 11:48:03,306][123090] Updated weights for policy 1, policy_version 1518557 (0.0005) [2023-12-26 11:48:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 780091392. Throughput: 0: 8875.1, 1: 8853.0. Samples: 780104648. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:03,784][121949] Avg episode reward: [(0, '6184.162'), (1, '5899.487')] [2023-12-26 11:48:03,955][123091] Updated weights for policy 0, policy_version 1528658 (0.0006) [2023-12-26 11:48:03,976][123090] Updated weights for policy 1, policy_version 1518567 (0.0006) [2023-12-26 11:48:04,007][123091] Updated weights for policy 0, policy_version 1528668 (0.0009) [2023-12-26 11:48:04,043][123090] Updated weights for policy 1, policy_version 1518577 (0.0007) [2023-12-26 11:48:04,070][123091] Updated weights for policy 0, policy_version 1528678 (0.0009) [2023-12-26 11:48:04,107][123090] Updated weights for policy 1, policy_version 1518587 (0.0007) [2023-12-26 11:48:04,131][123091] Updated weights for policy 0, policy_version 1528688 (0.0009) [2023-12-26 11:48:04,852][123090] Updated weights for policy 1, policy_version 1518597 (0.0006) [2023-12-26 11:48:04,901][123090] Updated weights for policy 1, policy_version 1518607 (0.0005) [2023-12-26 11:48:04,946][123091] Updated weights for policy 0, policy_version 1528698 (0.0010) [2023-12-26 11:48:04,953][123090] Updated weights for policy 1, policy_version 1518617 (0.0005) [2023-12-26 11:48:04,998][123091] Updated weights for policy 0, policy_version 1528708 (0.0010) [2023-12-26 11:48:05,065][123091] Updated weights for policy 0, policy_version 1528718 (0.0010) [2023-12-26 11:48:05,687][123090] Updated weights for policy 1, policy_version 1518627 (0.0007) [2023-12-26 11:48:05,747][123090] Updated weights for policy 1, policy_version 1518637 (0.0011) [2023-12-26 11:48:05,801][123090] Updated weights for policy 1, policy_version 1518647 (0.0010) [2023-12-26 11:48:05,838][123091] Updated weights for policy 0, policy_version 1528728 (0.0010) [2023-12-26 11:48:05,900][123091] Updated weights for policy 0, policy_version 1528738 (0.0010) [2023-12-26 11:48:05,948][123091] Updated weights for policy 0, policy_version 1528748 (0.0010) [2023-12-26 11:48:06,652][123090] Updated weights for policy 1, policy_version 1518657 (0.0011) [2023-12-26 11:48:06,724][123090] Updated weights for policy 1, policy_version 1518667 (0.0011) [2023-12-26 11:48:06,747][123091] Updated weights for policy 0, policy_version 1528758 (0.0008) [2023-12-26 11:48:06,788][123090] Updated weights for policy 1, policy_version 1518677 (0.0011) [2023-12-26 11:48:06,808][123091] Updated weights for policy 0, policy_version 1528768 (0.0006) [2023-12-26 11:48:06,852][123090] Updated weights for policy 1, policy_version 1518687 (0.0011) [2023-12-26 11:48:06,866][123091] Updated weights for policy 0, policy_version 1528778 (0.0008) [2023-12-26 11:48:07,586][123091] Updated weights for policy 0, policy_version 1528788 (0.0005) [2023-12-26 11:48:07,641][123091] Updated weights for policy 0, policy_version 1528798 (0.0005) [2023-12-26 11:48:07,681][123090] Updated weights for policy 1, policy_version 1518697 (0.0010) [2023-12-26 11:48:07,693][123091] Updated weights for policy 0, policy_version 1528808 (0.0006) [2023-12-26 11:48:07,740][123090] Updated weights for policy 1, policy_version 1518707 (0.0011) [2023-12-26 11:48:07,799][123090] Updated weights for policy 1, policy_version 1518717 (0.0010) [2023-12-26 11:48:08,384][123091] Updated weights for policy 0, policy_version 1528818 (0.0008) [2023-12-26 11:48:08,448][123091] Updated weights for policy 0, policy_version 1528828 (0.0011) [2023-12-26 11:48:08,511][123091] Updated weights for policy 0, policy_version 1528838 (0.0010) [2023-12-26 11:48:08,574][123091] Updated weights for policy 0, policy_version 1528848 (0.0011) [2023-12-26 11:48:08,595][123090] Updated weights for policy 1, policy_version 1518727 (0.0008) [2023-12-26 11:48:08,658][123090] Updated weights for policy 1, policy_version 1518737 (0.0008) [2023-12-26 11:48:08,731][123090] Updated weights for policy 1, policy_version 1518747 (0.0006) [2023-12-26 11:48:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 780189696. Throughput: 0: 8909.4, 1: 8881.8. Samples: 780159780. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:08,785][121949] Avg episode reward: [(0, '6318.419'), (1, '5578.512')] [2023-12-26 11:48:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001528848_391389184.pth... [2023-12-26 11:48:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001518752_388800512.pth... [2023-12-26 11:48:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001527792_391118848.pth [2023-12-26 11:48:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001517728_388538368.pth [2023-12-26 11:48:09,296][123091] Updated weights for policy 0, policy_version 1528858 (0.0011) [2023-12-26 11:48:09,360][123091] Updated weights for policy 0, policy_version 1528868 (0.0011) [2023-12-26 11:48:09,431][123091] Updated weights for policy 0, policy_version 1528878 (0.0008) [2023-12-26 11:48:09,497][123090] Updated weights for policy 1, policy_version 1518757 (0.0006) [2023-12-26 11:48:09,569][123090] Updated weights for policy 1, policy_version 1518767 (0.0007) [2023-12-26 11:48:09,627][123090] Updated weights for policy 1, policy_version 1518777 (0.0009) [2023-12-26 11:48:10,189][123091] Updated weights for policy 0, policy_version 1528888 (0.0007) [2023-12-26 11:48:10,259][123091] Updated weights for policy 0, policy_version 1528898 (0.0008) [2023-12-26 11:48:10,330][123091] Updated weights for policy 0, policy_version 1528908 (0.0008) [2023-12-26 11:48:10,422][123090] Updated weights for policy 1, policy_version 1518787 (0.0008) [2023-12-26 11:48:10,479][123090] Updated weights for policy 1, policy_version 1518797 (0.0009) [2023-12-26 11:48:10,538][123090] Updated weights for policy 1, policy_version 1518807 (0.0010) [2023-12-26 11:48:11,117][123091] Updated weights for policy 0, policy_version 1528918 (0.0008) [2023-12-26 11:48:11,184][123091] Updated weights for policy 0, policy_version 1528928 (0.0009) [2023-12-26 11:48:11,234][123091] Updated weights for policy 0, policy_version 1528938 (0.0009) [2023-12-26 11:48:11,398][123090] Updated weights for policy 1, policy_version 1518817 (0.0010) [2023-12-26 11:48:11,471][123090] Updated weights for policy 1, policy_version 1518827 (0.0006) [2023-12-26 11:48:11,545][123090] Updated weights for policy 1, policy_version 1518837 (0.0006) [2023-12-26 11:48:11,621][123090] Updated weights for policy 1, policy_version 1518847 (0.0011) [2023-12-26 11:48:12,083][123091] Updated weights for policy 0, policy_version 1528948 (0.0010) [2023-12-26 11:48:12,142][123091] Updated weights for policy 0, policy_version 1528958 (0.0010) [2023-12-26 11:48:12,209][123091] Updated weights for policy 0, policy_version 1528968 (0.0009) [2023-12-26 11:48:12,420][123090] Updated weights for policy 1, policy_version 1518857 (0.0008) [2023-12-26 11:48:12,495][123090] Updated weights for policy 1, policy_version 1518867 (0.0006) [2023-12-26 11:48:12,568][123090] Updated weights for policy 1, policy_version 1518877 (0.0007) [2023-12-26 11:48:12,994][123091] Updated weights for policy 0, policy_version 1528978 (0.0009) [2023-12-26 11:48:13,055][123091] Updated weights for policy 0, policy_version 1528988 (0.0010) [2023-12-26 11:48:13,108][123091] Updated weights for policy 0, policy_version 1528998 (0.0009) [2023-12-26 11:48:13,161][123091] Updated weights for policy 0, policy_version 1529008 (0.0010) [2023-12-26 11:48:13,285][123090] Updated weights for policy 1, policy_version 1518887 (0.0006) [2023-12-26 11:48:13,356][123090] Updated weights for policy 1, policy_version 1518897 (0.0006) [2023-12-26 11:48:13,420][123090] Updated weights for policy 1, policy_version 1518907 (0.0009) [2023-12-26 11:48:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 780271616. Throughput: 0: 8941.6, 1: 8793.7. Samples: 780265844. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:13,784][121949] Avg episode reward: [(0, '6366.527'), (1, '5465.030')] [2023-12-26 11:48:14,004][123091] Updated weights for policy 0, policy_version 1529018 (0.0010) [2023-12-26 11:48:14,062][123091] Updated weights for policy 0, policy_version 1529028 (0.0010) [2023-12-26 11:48:14,115][123091] Updated weights for policy 0, policy_version 1529039 (0.0008) [2023-12-26 11:48:14,124][123090] Updated weights for policy 1, policy_version 1518917 (0.0009) [2023-12-26 11:48:14,179][123090] Updated weights for policy 1, policy_version 1518927 (0.0010) [2023-12-26 11:48:14,236][123090] Updated weights for policy 1, policy_version 1518937 (0.0009) [2023-12-26 11:48:14,924][123091] Updated weights for policy 0, policy_version 1529049 (0.0009) [2023-12-26 11:48:14,993][123091] Updated weights for policy 0, policy_version 1529059 (0.0009) [2023-12-26 11:48:15,059][123091] Updated weights for policy 0, policy_version 1529069 (0.0010) [2023-12-26 11:48:15,093][123090] Updated weights for policy 1, policy_version 1518947 (0.0008) [2023-12-26 11:48:15,168][123090] Updated weights for policy 1, policy_version 1518957 (0.0007) [2023-12-26 11:48:15,236][123090] Updated weights for policy 1, policy_version 1518967 (0.0009) [2023-12-26 11:48:15,874][123090] Updated weights for policy 1, policy_version 1518977 (0.0009) [2023-12-26 11:48:15,875][123091] Updated weights for policy 0, policy_version 1529079 (0.0010) [2023-12-26 11:48:15,936][123090] Updated weights for policy 1, policy_version 1518987 (0.0008) [2023-12-26 11:48:15,940][123091] Updated weights for policy 0, policy_version 1529089 (0.0009) [2023-12-26 11:48:16,001][123090] Updated weights for policy 1, policy_version 1518997 (0.0010) [2023-12-26 11:48:16,005][123091] Updated weights for policy 0, policy_version 1529099 (0.0009) [2023-12-26 11:48:16,063][123090] Updated weights for policy 1, policy_version 1519007 (0.0007) [2023-12-26 11:48:16,843][123091] Updated weights for policy 0, policy_version 1529109 (0.0009) [2023-12-26 11:48:16,874][123090] Updated weights for policy 1, policy_version 1519017 (0.0010) [2023-12-26 11:48:16,906][123091] Updated weights for policy 0, policy_version 1529119 (0.0005) [2023-12-26 11:48:16,937][123090] Updated weights for policy 1, policy_version 1519027 (0.0010) [2023-12-26 11:48:16,969][123091] Updated weights for policy 0, policy_version 1529129 (0.0007) [2023-12-26 11:48:16,996][123090] Updated weights for policy 1, policy_version 1519037 (0.0010) [2023-12-26 11:48:17,801][123090] Updated weights for policy 1, policy_version 1519047 (0.0010) [2023-12-26 11:48:17,806][123091] Updated weights for policy 0, policy_version 1529139 (0.0007) [2023-12-26 11:48:17,852][123090] Updated weights for policy 1, policy_version 1519057 (0.0010) [2023-12-26 11:48:17,868][123091] Updated weights for policy 0, policy_version 1529149 (0.0007) [2023-12-26 11:48:17,905][123090] Updated weights for policy 1, policy_version 1519067 (0.0010) [2023-12-26 11:48:17,932][123091] Updated weights for policy 0, policy_version 1529159 (0.0006) [2023-12-26 11:48:18,714][123090] Updated weights for policy 1, policy_version 1519077 (0.0011) [2023-12-26 11:48:18,765][123090] Updated weights for policy 1, policy_version 1519087 (0.0010) [2023-12-26 11:48:18,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 780353536. Throughput: 0: 8926.7, 1: 8823.3. Samples: 780371628. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:18,785][121949] Avg episode reward: [(0, '6374.282'), (1, '5441.743')] [2023-12-26 11:48:18,800][123091] Updated weights for policy 0, policy_version 1529169 (0.0009) [2023-12-26 11:48:18,821][123090] Updated weights for policy 1, policy_version 1519097 (0.0010) [2023-12-26 11:48:18,863][123091] Updated weights for policy 0, policy_version 1529179 (0.0008) [2023-12-26 11:48:18,912][123091] Updated weights for policy 0, policy_version 1529189 (0.0009) [2023-12-26 11:48:18,965][123091] Updated weights for policy 0, policy_version 1529199 (0.0009) [2023-12-26 11:48:19,640][123090] Updated weights for policy 1, policy_version 1519107 (0.0009) [2023-12-26 11:48:19,708][123090] Updated weights for policy 1, policy_version 1519117 (0.0008) [2023-12-26 11:48:19,775][123090] Updated weights for policy 1, policy_version 1519127 (0.0008) [2023-12-26 11:48:19,901][123091] Updated weights for policy 0, policy_version 1529209 (0.0009) [2023-12-26 11:48:19,967][123091] Updated weights for policy 0, policy_version 1529219 (0.0010) [2023-12-26 11:48:20,027][123091] Updated weights for policy 0, policy_version 1529229 (0.0010) [2023-12-26 11:48:20,549][123090] Updated weights for policy 1, policy_version 1519137 (0.0008) [2023-12-26 11:48:20,617][123090] Updated weights for policy 1, policy_version 1519147 (0.0011) [2023-12-26 11:48:20,673][123090] Updated weights for policy 1, policy_version 1519157 (0.0011) [2023-12-26 11:48:20,734][123090] Updated weights for policy 1, policy_version 1519167 (0.0011) [2023-12-26 11:48:20,916][123091] Updated weights for policy 0, policy_version 1529239 (0.0009) [2023-12-26 11:48:20,981][123091] Updated weights for policy 0, policy_version 1529249 (0.0009) [2023-12-26 11:48:21,034][123091] Updated weights for policy 0, policy_version 1529259 (0.0009) [2023-12-26 11:48:21,584][123090] Updated weights for policy 1, policy_version 1519177 (0.0011) [2023-12-26 11:48:21,649][123090] Updated weights for policy 1, policy_version 1519187 (0.0011) [2023-12-26 11:48:21,713][123090] Updated weights for policy 1, policy_version 1519197 (0.0010) [2023-12-26 11:48:21,887][123091] Updated weights for policy 0, policy_version 1529269 (0.0008) [2023-12-26 11:48:21,944][123091] Updated weights for policy 0, policy_version 1529279 (0.0009) [2023-12-26 11:48:21,998][123091] Updated weights for policy 0, policy_version 1529289 (0.0009) [2023-12-26 11:48:22,573][123090] Updated weights for policy 1, policy_version 1519207 (0.0007) [2023-12-26 11:48:22,641][123090] Updated weights for policy 1, policy_version 1519217 (0.0005) [2023-12-26 11:48:22,706][123090] Updated weights for policy 1, policy_version 1519227 (0.0005) [2023-12-26 11:48:22,850][123091] Updated weights for policy 0, policy_version 1529299 (0.0009) [2023-12-26 11:48:22,909][123091] Updated weights for policy 0, policy_version 1529310 (0.0011) [2023-12-26 11:48:22,973][123091] Updated weights for policy 0, policy_version 1529320 (0.0010) [2023-12-26 11:48:23,325][123090] Updated weights for policy 1, policy_version 1519237 (0.0005) [2023-12-26 11:48:23,386][123090] Updated weights for policy 1, policy_version 1519247 (0.0005) [2023-12-26 11:48:23,431][123090] Updated weights for policy 1, policy_version 1519257 (0.0005) [2023-12-26 11:48:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 780443648. Throughput: 0: 8875.8, 1: 8797.4. Samples: 780421268. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:23,785][121949] Avg episode reward: [(0, '6251.331'), (1, '5643.216')] [2023-12-26 11:48:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001529328_391512064.pth... [2023-12-26 11:48:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001519264_388931584.pth... [2023-12-26 11:48:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001528304_391249920.pth [2023-12-26 11:48:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001518240_388669440.pth [2023-12-26 11:48:23,941][123091] Updated weights for policy 0, policy_version 1529330 (0.0010) [2023-12-26 11:48:24,006][123091] Updated weights for policy 0, policy_version 1529340 (0.0010) [2023-12-26 11:48:24,071][123091] Updated weights for policy 0, policy_version 1529350 (0.0009) [2023-12-26 11:48:24,072][123090] Updated weights for policy 1, policy_version 1519267 (0.0005) [2023-12-26 11:48:24,120][123090] Updated weights for policy 1, policy_version 1519277 (0.0006) [2023-12-26 11:48:24,124][123091] Updated weights for policy 0, policy_version 1529360 (0.0009) [2023-12-26 11:48:24,182][123090] Updated weights for policy 1, policy_version 1519287 (0.0006) [2023-12-26 11:48:24,871][123090] Updated weights for policy 1, policy_version 1519297 (0.0005) [2023-12-26 11:48:24,924][123090] Updated weights for policy 1, policy_version 1519307 (0.0005) [2023-12-26 11:48:24,986][123090] Updated weights for policy 1, policy_version 1519317 (0.0005) [2023-12-26 11:48:25,047][123090] Updated weights for policy 1, policy_version 1519327 (0.0005) [2023-12-26 11:48:25,058][123091] Updated weights for policy 0, policy_version 1529370 (0.0009) [2023-12-26 11:48:25,111][123091] Updated weights for policy 0, policy_version 1529380 (0.0009) [2023-12-26 11:48:25,170][123091] Updated weights for policy 0, policy_version 1529390 (0.0010) [2023-12-26 11:48:25,716][123090] Updated weights for policy 1, policy_version 1519337 (0.0005) [2023-12-26 11:48:25,781][123090] Updated weights for policy 1, policy_version 1519347 (0.0005) [2023-12-26 11:48:25,841][123090] Updated weights for policy 1, policy_version 1519357 (0.0006) [2023-12-26 11:48:26,109][123091] Updated weights for policy 0, policy_version 1529400 (0.0010) [2023-12-26 11:48:26,174][123091] Updated weights for policy 0, policy_version 1529410 (0.0011) [2023-12-26 11:48:26,235][123091] Updated weights for policy 0, policy_version 1529420 (0.0006) [2023-12-26 11:48:26,423][123090] Updated weights for policy 1, policy_version 1519367 (0.0005) [2023-12-26 11:48:26,480][123090] Updated weights for policy 1, policy_version 1519377 (0.0007) [2023-12-26 11:48:26,543][123090] Updated weights for policy 1, policy_version 1519387 (0.0009) [2023-12-26 11:48:26,909][123091] Updated weights for policy 0, policy_version 1529430 (0.0009) [2023-12-26 11:48:26,978][123091] Updated weights for policy 0, policy_version 1529440 (0.0011) [2023-12-26 11:48:27,036][123091] Updated weights for policy 0, policy_version 1529450 (0.0010) [2023-12-26 11:48:27,240][123090] Updated weights for policy 1, policy_version 1519397 (0.0007) [2023-12-26 11:48:27,301][123090] Updated weights for policy 1, policy_version 1519407 (0.0010) [2023-12-26 11:48:27,353][123090] Updated weights for policy 1, policy_version 1519417 (0.0010) [2023-12-26 11:48:27,740][123091] Updated weights for policy 0, policy_version 1529460 (0.0009) [2023-12-26 11:48:27,796][123091] Updated weights for policy 0, policy_version 1529470 (0.0005) [2023-12-26 11:48:27,862][123091] Updated weights for policy 0, policy_version 1529480 (0.0009) [2023-12-26 11:48:28,154][123090] Updated weights for policy 1, policy_version 1519427 (0.0010) [2023-12-26 11:48:28,205][123090] Updated weights for policy 1, policy_version 1519437 (0.0010) [2023-12-26 11:48:28,252][123090] Updated weights for policy 1, policy_version 1519447 (0.0010) [2023-12-26 11:48:28,673][123091] Updated weights for policy 0, policy_version 1529490 (0.0010) [2023-12-26 11:48:28,732][123091] Updated weights for policy 0, policy_version 1529500 (0.0009) [2023-12-26 11:48:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 780533760. Throughput: 0: 8815.7, 1: 8975.8. Samples: 780531668. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:28,784][121949] Avg episode reward: [(0, '6244.250'), (1, '5731.851')] [2023-12-26 11:48:28,787][123091] Updated weights for policy 0, policy_version 1529510 (0.0009) [2023-12-26 11:48:28,852][123091] Updated weights for policy 0, policy_version 1529520 (0.0007) [2023-12-26 11:48:29,104][123090] Updated weights for policy 1, policy_version 1519457 (0.0010) [2023-12-26 11:48:29,155][123090] Updated weights for policy 1, policy_version 1519467 (0.0010) [2023-12-26 11:48:29,203][123090] Updated weights for policy 1, policy_version 1519477 (0.0008) [2023-12-26 11:48:29,277][123090] Updated weights for policy 1, policy_version 1519487 (0.0007) [2023-12-26 11:48:29,705][123091] Updated weights for policy 0, policy_version 1529530 (0.0010) [2023-12-26 11:48:29,764][123091] Updated weights for policy 0, policy_version 1529540 (0.0010) [2023-12-26 11:48:29,817][123091] Updated weights for policy 0, policy_version 1529550 (0.0009) [2023-12-26 11:48:30,004][123090] Updated weights for policy 1, policy_version 1519497 (0.0010) [2023-12-26 11:48:30,067][123090] Updated weights for policy 1, policy_version 1519507 (0.0010) [2023-12-26 11:48:30,137][123090] Updated weights for policy 1, policy_version 1519517 (0.0010) [2023-12-26 11:48:30,729][123091] Updated weights for policy 0, policy_version 1529560 (0.0010) [2023-12-26 11:48:30,777][123091] Updated weights for policy 0, policy_version 1529570 (0.0009) [2023-12-26 11:48:30,790][123090] Updated weights for policy 1, policy_version 1519527 (0.0010) [2023-12-26 11:48:30,831][123091] Updated weights for policy 0, policy_version 1529580 (0.0008) [2023-12-26 11:48:30,833][123090] Updated weights for policy 1, policy_version 1519537 (0.0010) [2023-12-26 11:48:30,876][123090] Updated weights for policy 1, policy_version 1519547 (0.0010) [2023-12-26 11:48:31,697][123091] Updated weights for policy 0, policy_version 1529590 (0.0007) [2023-12-26 11:48:31,732][123090] Updated weights for policy 1, policy_version 1519557 (0.0010) [2023-12-26 11:48:31,763][123091] Updated weights for policy 0, policy_version 1529600 (0.0008) [2023-12-26 11:48:31,801][123090] Updated weights for policy 1, policy_version 1519567 (0.0010) [2023-12-26 11:48:31,821][123091] Updated weights for policy 0, policy_version 1529610 (0.0009) [2023-12-26 11:48:31,861][123090] Updated weights for policy 1, policy_version 1519577 (0.0011) [2023-12-26 11:48:32,607][123090] Updated weights for policy 1, policy_version 1519587 (0.0009) [2023-12-26 11:48:32,666][123090] Updated weights for policy 1, policy_version 1519597 (0.0009) [2023-12-26 11:48:32,692][123091] Updated weights for policy 0, policy_version 1529620 (0.0008) [2023-12-26 11:48:32,726][123090] Updated weights for policy 1, policy_version 1519607 (0.0010) [2023-12-26 11:48:32,737][123091] Updated weights for policy 0, policy_version 1529630 (0.0006) [2023-12-26 11:48:32,787][123091] Updated weights for policy 0, policy_version 1529640 (0.0007) [2023-12-26 11:48:33,441][123090] Updated weights for policy 1, policy_version 1519617 (0.0010) [2023-12-26 11:48:33,508][123090] Updated weights for policy 1, policy_version 1519627 (0.0006) [2023-12-26 11:48:33,576][123090] Updated weights for policy 1, policy_version 1519637 (0.0009) [2023-12-26 11:48:33,640][123090] Updated weights for policy 1, policy_version 1519647 (0.0011) [2023-12-26 11:48:33,709][123091] Updated weights for policy 0, policy_version 1529650 (0.0010) [2023-12-26 11:48:33,766][123091] Updated weights for policy 0, policy_version 1529660 (0.0009) [2023-12-26 11:48:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 780623872. Throughput: 0: 8761.1, 1: 9031.6. Samples: 780636308. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:33,785][121949] Avg episode reward: [(0, '6363.641'), (1, '5716.351')] [2023-12-26 11:48:33,818][123091] Updated weights for policy 0, policy_version 1529670 (0.0009) [2023-12-26 11:48:33,875][123091] Updated weights for policy 0, policy_version 1529680 (0.0010) [2023-12-26 11:48:34,387][123090] Updated weights for policy 1, policy_version 1519657 (0.0010) [2023-12-26 11:48:34,459][123090] Updated weights for policy 1, policy_version 1519667 (0.0009) [2023-12-26 11:48:34,525][123090] Updated weights for policy 1, policy_version 1519677 (0.0009) [2023-12-26 11:48:34,787][123091] Updated weights for policy 0, policy_version 1529690 (0.0009) [2023-12-26 11:48:34,840][123091] Updated weights for policy 0, policy_version 1529700 (0.0010) [2023-12-26 11:48:34,899][123091] Updated weights for policy 0, policy_version 1529710 (0.0010) [2023-12-26 11:48:35,310][123090] Updated weights for policy 1, policy_version 1519687 (0.0008) [2023-12-26 11:48:35,374][123090] Updated weights for policy 1, policy_version 1519697 (0.0009) [2023-12-26 11:48:35,439][123090] Updated weights for policy 1, policy_version 1519707 (0.0008) [2023-12-26 11:48:35,848][123091] Updated weights for policy 0, policy_version 1529720 (0.0010) [2023-12-26 11:48:35,919][123091] Updated weights for policy 0, policy_version 1529730 (0.0009) [2023-12-26 11:48:35,986][123091] Updated weights for policy 0, policy_version 1529740 (0.0009) [2023-12-26 11:48:36,127][123090] Updated weights for policy 1, policy_version 1519717 (0.0007) [2023-12-26 11:48:36,195][123090] Updated weights for policy 1, policy_version 1519727 (0.0010) [2023-12-26 11:48:36,268][123090] Updated weights for policy 1, policy_version 1519737 (0.0010) [2023-12-26 11:48:36,832][123091] Updated weights for policy 0, policy_version 1529750 (0.0010) [2023-12-26 11:48:36,897][123091] Updated weights for policy 0, policy_version 1529760 (0.0010) [2023-12-26 11:48:36,955][123091] Updated weights for policy 0, policy_version 1529770 (0.0010) [2023-12-26 11:48:37,125][123090] Updated weights for policy 1, policy_version 1519747 (0.0009) [2023-12-26 11:48:37,179][123090] Updated weights for policy 1, policy_version 1519757 (0.0009) [2023-12-26 11:48:37,231][123090] Updated weights for policy 1, policy_version 1519767 (0.0008) [2023-12-26 11:48:37,814][123091] Updated weights for policy 0, policy_version 1529780 (0.0010) [2023-12-26 11:48:37,877][123091] Updated weights for policy 0, policy_version 1529790 (0.0009) [2023-12-26 11:48:37,938][123091] Updated weights for policy 0, policy_version 1529800 (0.0010) [2023-12-26 11:48:38,070][123090] Updated weights for policy 1, policy_version 1519777 (0.0009) [2023-12-26 11:48:38,121][123090] Updated weights for policy 1, policy_version 1519787 (0.0007) [2023-12-26 11:48:38,171][123090] Updated weights for policy 1, policy_version 1519797 (0.0009) [2023-12-26 11:48:38,224][123090] Updated weights for policy 1, policy_version 1519807 (0.0009) [2023-12-26 11:48:38,784][123091] Updated weights for policy 0, policy_version 1529810 (0.0010) [2023-12-26 11:48:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 780705792. Throughput: 0: 8714.3, 1: 9049.4. Samples: 780687744. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:38,785][121949] Avg episode reward: [(0, '6385.980'), (1, '5709.455')] [2023-12-26 11:48:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001519808_389070848.pth... [2023-12-26 11:48:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001518752_388800512.pth [2023-12-26 11:48:38,843][123091] Updated weights for policy 0, policy_version 1529820 (0.0010) [2023-12-26 11:48:38,902][123091] Updated weights for policy 0, policy_version 1529830 (0.0010) [2023-12-26 11:48:38,950][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001529840_391643136.pth... [2023-12-26 11:48:38,952][123091] Updated weights for policy 0, policy_version 1529840 (0.0009) [2023-12-26 11:48:38,954][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001528848_391389184.pth [2023-12-26 11:48:39,061][123090] Updated weights for policy 1, policy_version 1519817 (0.0010) [2023-12-26 11:48:39,127][123090] Updated weights for policy 1, policy_version 1519827 (0.0009) [2023-12-26 11:48:39,188][123090] Updated weights for policy 1, policy_version 1519837 (0.0009) [2023-12-26 11:48:39,809][123091] Updated weights for policy 0, policy_version 1529850 (0.0009) [2023-12-26 11:48:39,877][123091] Updated weights for policy 0, policy_version 1529860 (0.0010) [2023-12-26 11:48:39,946][123091] Updated weights for policy 0, policy_version 1529870 (0.0009) [2023-12-26 11:48:40,084][123090] Updated weights for policy 1, policy_version 1519847 (0.0010) [2023-12-26 11:48:40,145][123090] Updated weights for policy 1, policy_version 1519857 (0.0010) [2023-12-26 11:48:40,206][123090] Updated weights for policy 1, policy_version 1519867 (0.0008) [2023-12-26 11:48:40,731][123091] Updated weights for policy 0, policy_version 1529880 (0.0009) [2023-12-26 11:48:40,793][123091] Updated weights for policy 0, policy_version 1529890 (0.0009) [2023-12-26 11:48:40,846][123091] Updated weights for policy 0, policy_version 1529900 (0.0010) [2023-12-26 11:48:41,019][123090] Updated weights for policy 1, policy_version 1519877 (0.0006) [2023-12-26 11:48:41,090][123090] Updated weights for policy 1, policy_version 1519887 (0.0008) [2023-12-26 11:48:41,166][123090] Updated weights for policy 1, policy_version 1519897 (0.0007) [2023-12-26 11:48:41,690][123091] Updated weights for policy 0, policy_version 1529910 (0.0008) [2023-12-26 11:48:41,759][123091] Updated weights for policy 0, policy_version 1529920 (0.0008) [2023-12-26 11:48:41,831][123091] Updated weights for policy 0, policy_version 1529930 (0.0006) [2023-12-26 11:48:42,022][123090] Updated weights for policy 1, policy_version 1519907 (0.0008) [2023-12-26 11:48:42,074][123090] Updated weights for policy 1, policy_version 1519917 (0.0010) [2023-12-26 11:48:42,134][123090] Updated weights for policy 1, policy_version 1519927 (0.0009) [2023-12-26 11:48:42,597][123091] Updated weights for policy 0, policy_version 1529940 (0.0005) [2023-12-26 11:48:42,673][123091] Updated weights for policy 0, policy_version 1529950 (0.0007) [2023-12-26 11:48:42,742][123091] Updated weights for policy 0, policy_version 1529960 (0.0011) [2023-12-26 11:48:43,018][123090] Updated weights for policy 1, policy_version 1519937 (0.0010) [2023-12-26 11:48:43,082][123090] Updated weights for policy 1, policy_version 1519947 (0.0006) [2023-12-26 11:48:43,155][123090] Updated weights for policy 1, policy_version 1519957 (0.0008) [2023-12-26 11:48:43,214][123090] Updated weights for policy 1, policy_version 1519967 (0.0010) [2023-12-26 11:48:43,406][123091] Updated weights for policy 0, policy_version 1529970 (0.0008) [2023-12-26 11:48:43,466][123091] Updated weights for policy 0, policy_version 1529980 (0.0008) [2023-12-26 11:48:43,527][123091] Updated weights for policy 0, policy_version 1529990 (0.0009) [2023-12-26 11:48:43,592][123091] Updated weights for policy 0, policy_version 1530000 (0.0005) [2023-12-26 11:48:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 780795904. Throughput: 0: 8591.8, 1: 9004.4. Samples: 780789304. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:43,784][121949] Avg episode reward: [(0, '6349.958'), (1, '5610.375')] [2023-12-26 11:48:44,127][123090] Updated weights for policy 1, policy_version 1519977 (0.0010) [2023-12-26 11:48:44,184][123090] Updated weights for policy 1, policy_version 1519987 (0.0009) [2023-12-26 11:48:44,237][123091] Updated weights for policy 0, policy_version 1530010 (0.0006) [2023-12-26 11:48:44,251][123090] Updated weights for policy 1, policy_version 1519997 (0.0009) [2023-12-26 11:48:44,301][123091] Updated weights for policy 0, policy_version 1530020 (0.0005) [2023-12-26 11:48:44,363][123091] Updated weights for policy 0, policy_version 1530030 (0.0010) [2023-12-26 11:48:45,084][123091] Updated weights for policy 0, policy_version 1530040 (0.0009) [2023-12-26 11:48:45,111][123090] Updated weights for policy 1, policy_version 1520007 (0.0006) [2023-12-26 11:48:45,145][123091] Updated weights for policy 0, policy_version 1530050 (0.0009) [2023-12-26 11:48:45,181][123090] Updated weights for policy 1, policy_version 1520017 (0.0008) [2023-12-26 11:48:45,192][123091] Updated weights for policy 0, policy_version 1530060 (0.0008) [2023-12-26 11:48:45,249][123090] Updated weights for policy 1, policy_version 1520027 (0.0009) [2023-12-26 11:48:46,043][123090] Updated weights for policy 1, policy_version 1520037 (0.0008) [2023-12-26 11:48:46,045][123091] Updated weights for policy 0, policy_version 1530070 (0.0007) [2023-12-26 11:48:46,098][123090] Updated weights for policy 1, policy_version 1520047 (0.0008) [2023-12-26 11:48:46,109][123091] Updated weights for policy 0, policy_version 1530080 (0.0007) [2023-12-26 11:48:46,152][123090] Updated weights for policy 1, policy_version 1520057 (0.0008) [2023-12-26 11:48:46,172][123091] Updated weights for policy 0, policy_version 1530090 (0.0008) [2023-12-26 11:48:46,983][123090] Updated weights for policy 1, policy_version 1520067 (0.0007) [2023-12-26 11:48:46,987][123091] Updated weights for policy 0, policy_version 1530100 (0.0010) [2023-12-26 11:48:47,044][123090] Updated weights for policy 1, policy_version 1520077 (0.0006) [2023-12-26 11:48:47,050][123091] Updated weights for policy 0, policy_version 1530110 (0.0009) [2023-12-26 11:48:47,103][123090] Updated weights for policy 1, policy_version 1520087 (0.0006) [2023-12-26 11:48:47,112][123091] Updated weights for policy 0, policy_version 1530120 (0.0009) [2023-12-26 11:48:47,878][123091] Updated weights for policy 0, policy_version 1530130 (0.0008) [2023-12-26 11:48:47,908][123090] Updated weights for policy 1, policy_version 1520097 (0.0009) [2023-12-26 11:48:47,940][123091] Updated weights for policy 0, policy_version 1530140 (0.0007) [2023-12-26 11:48:47,977][123090] Updated weights for policy 1, policy_version 1520107 (0.0008) [2023-12-26 11:48:47,998][123091] Updated weights for policy 0, policy_version 1530150 (0.0007) [2023-12-26 11:48:48,031][123090] Updated weights for policy 1, policy_version 1520117 (0.0008) [2023-12-26 11:48:48,046][123091] Updated weights for policy 0, policy_version 1530160 (0.0009) [2023-12-26 11:48:48,084][123090] Updated weights for policy 1, policy_version 1520127 (0.0008) [2023-12-26 11:48:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 780877824. Throughput: 0: 8583.4, 1: 8963.8. Samples: 780894272. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:48,785][121949] Avg episode reward: [(0, '6236.982'), (1, '5807.854')] [2023-12-26 11:48:48,887][123091] Updated weights for policy 0, policy_version 1530170 (0.0009) [2023-12-26 11:48:48,937][123090] Updated weights for policy 1, policy_version 1520137 (0.0008) [2023-12-26 11:48:48,951][123091] Updated weights for policy 0, policy_version 1530180 (0.0008) [2023-12-26 11:48:49,003][123090] Updated weights for policy 1, policy_version 1520147 (0.0010) [2023-12-26 11:48:49,017][123091] Updated weights for policy 0, policy_version 1530190 (0.0009) [2023-12-26 11:48:49,063][123090] Updated weights for policy 1, policy_version 1520157 (0.0008) [2023-12-26 11:48:49,869][123091] Updated weights for policy 0, policy_version 1530200 (0.0009) [2023-12-26 11:48:49,912][123090] Updated weights for policy 1, policy_version 1520167 (0.0008) [2023-12-26 11:48:49,938][123091] Updated weights for policy 0, policy_version 1530210 (0.0007) [2023-12-26 11:48:49,984][123090] Updated weights for policy 1, policy_version 1520177 (0.0007) [2023-12-26 11:48:50,009][123091] Updated weights for policy 0, policy_version 1530220 (0.0006) [2023-12-26 11:48:50,051][123090] Updated weights for policy 1, policy_version 1520187 (0.0008) [2023-12-26 11:48:50,760][123091] Updated weights for policy 0, policy_version 1530230 (0.0009) [2023-12-26 11:48:50,821][123091] Updated weights for policy 0, policy_version 1530240 (0.0010) [2023-12-26 11:48:50,860][123090] Updated weights for policy 1, policy_version 1520197 (0.0006) [2023-12-26 11:48:50,888][123091] Updated weights for policy 0, policy_version 1530250 (0.0010) [2023-12-26 11:48:50,925][123090] Updated weights for policy 1, policy_version 1520207 (0.0008) [2023-12-26 11:48:50,988][123090] Updated weights for policy 1, policy_version 1520217 (0.0010) [2023-12-26 11:48:51,739][123091] Updated weights for policy 0, policy_version 1530260 (0.0007) [2023-12-26 11:48:51,803][123091] Updated weights for policy 0, policy_version 1530270 (0.0007) [2023-12-26 11:48:51,803][123090] Updated weights for policy 1, policy_version 1520227 (0.0009) [2023-12-26 11:48:51,855][123091] Updated weights for policy 0, policy_version 1530280 (0.0007) [2023-12-26 11:48:51,863][123090] Updated weights for policy 1, policy_version 1520237 (0.0008) [2023-12-26 11:48:51,934][123090] Updated weights for policy 1, policy_version 1520247 (0.0008) [2023-12-26 11:48:52,532][123091] Updated weights for policy 0, policy_version 1530290 (0.0010) [2023-12-26 11:48:52,598][123091] Updated weights for policy 0, policy_version 1530300 (0.0007) [2023-12-26 11:48:52,661][123091] Updated weights for policy 0, policy_version 1530310 (0.0005) [2023-12-26 11:48:52,720][123091] Updated weights for policy 0, policy_version 1530320 (0.0005) [2023-12-26 11:48:52,832][123090] Updated weights for policy 1, policy_version 1520257 (0.0009) [2023-12-26 11:48:52,883][123090] Updated weights for policy 1, policy_version 1520267 (0.0009) [2023-12-26 11:48:52,936][123090] Updated weights for policy 1, policy_version 1520277 (0.0009) [2023-12-26 11:48:52,998][123090] Updated weights for policy 1, policy_version 1520287 (0.0009) [2023-12-26 11:48:53,513][123091] Updated weights for policy 0, policy_version 1530330 (0.0009) [2023-12-26 11:48:53,583][123091] Updated weights for policy 0, policy_version 1530340 (0.0010) [2023-12-26 11:48:53,644][123091] Updated weights for policy 0, policy_version 1530350 (0.0010) [2023-12-26 11:48:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 780967936. Throughput: 0: 8545.1, 1: 8904.6. Samples: 780945016. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:53,785][121949] Avg episode reward: [(0, '6337.189'), (1, '5632.949')] [2023-12-26 11:48:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001530352_391774208.pth... [2023-12-26 11:48:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001529328_391512064.pth [2023-12-26 11:48:53,799][123090] Updated weights for policy 1, policy_version 1520297 (0.0010) [2023-12-26 11:48:53,860][123090] Updated weights for policy 1, policy_version 1520307 (0.0009) [2023-12-26 11:48:53,913][123090] Updated weights for policy 1, policy_version 1520317 (0.0009) [2023-12-26 11:48:53,925][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001520320_389201920.pth... [2023-12-26 11:48:53,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001519264_388931584.pth [2023-12-26 11:48:54,427][123091] Updated weights for policy 0, policy_version 1530360 (0.0009) [2023-12-26 11:48:54,494][123091] Updated weights for policy 0, policy_version 1530370 (0.0008) [2023-12-26 11:48:54,560][123091] Updated weights for policy 0, policy_version 1530380 (0.0010) [2023-12-26 11:48:54,750][123090] Updated weights for policy 1, policy_version 1520327 (0.0010) [2023-12-26 11:48:54,811][123090] Updated weights for policy 1, policy_version 1520337 (0.0009) [2023-12-26 11:48:54,871][123090] Updated weights for policy 1, policy_version 1520347 (0.0008) [2023-12-26 11:48:55,324][123091] Updated weights for policy 0, policy_version 1530390 (0.0010) [2023-12-26 11:48:55,391][123091] Updated weights for policy 0, policy_version 1530400 (0.0009) [2023-12-26 11:48:55,460][123091] Updated weights for policy 0, policy_version 1530410 (0.0005) [2023-12-26 11:48:55,737][123090] Updated weights for policy 1, policy_version 1520357 (0.0009) [2023-12-26 11:48:55,798][123090] Updated weights for policy 1, policy_version 1520367 (0.0009) [2023-12-26 11:48:55,851][123090] Updated weights for policy 1, policy_version 1520377 (0.0009) [2023-12-26 11:48:56,222][123091] Updated weights for policy 0, policy_version 1530420 (0.0005) [2023-12-26 11:48:56,273][123091] Updated weights for policy 0, policy_version 1530430 (0.0005) [2023-12-26 11:48:56,333][123091] Updated weights for policy 0, policy_version 1530440 (0.0005) [2023-12-26 11:48:56,741][123090] Updated weights for policy 1, policy_version 1520387 (0.0010) [2023-12-26 11:48:56,808][123090] Updated weights for policy 1, policy_version 1520397 (0.0009) [2023-12-26 11:48:56,875][123090] Updated weights for policy 1, policy_version 1520407 (0.0010) [2023-12-26 11:48:57,050][123091] Updated weights for policy 0, policy_version 1530450 (0.0006) [2023-12-26 11:48:57,098][123091] Updated weights for policy 0, policy_version 1530460 (0.0005) [2023-12-26 11:48:57,143][123091] Updated weights for policy 0, policy_version 1530470 (0.0005) [2023-12-26 11:48:57,195][123091] Updated weights for policy 0, policy_version 1530480 (0.0005) [2023-12-26 11:48:57,711][123090] Updated weights for policy 1, policy_version 1520417 (0.0009) [2023-12-26 11:48:57,776][123090] Updated weights for policy 1, policy_version 1520427 (0.0009) [2023-12-26 11:48:57,827][123090] Updated weights for policy 1, policy_version 1520437 (0.0009) [2023-12-26 11:48:57,882][123090] Updated weights for policy 1, policy_version 1520447 (0.0009) [2023-12-26 11:48:57,944][123091] Updated weights for policy 0, policy_version 1530490 (0.0010) [2023-12-26 11:48:57,996][123091] Updated weights for policy 0, policy_version 1530500 (0.0009) [2023-12-26 11:48:58,049][123091] Updated weights for policy 0, policy_version 1530510 (0.0008) [2023-12-26 11:48:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 781049856. Throughput: 0: 8579.1, 1: 8860.6. Samples: 781050632. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:48:58,785][121949] Avg episode reward: [(0, '6366.563'), (1, '5493.897')] [2023-12-26 11:48:58,789][123090] Updated weights for policy 1, policy_version 1520457 (0.0009) [2023-12-26 11:48:58,872][123090] Updated weights for policy 1, policy_version 1520467 (0.0010) [2023-12-26 11:48:58,935][123090] Updated weights for policy 1, policy_version 1520477 (0.0009) [2023-12-26 11:48:58,936][123091] Updated weights for policy 0, policy_version 1530520 (0.0007) [2023-12-26 11:48:59,001][123091] Updated weights for policy 0, policy_version 1530530 (0.0008) [2023-12-26 11:48:59,067][123091] Updated weights for policy 0, policy_version 1530540 (0.0008) [2023-12-26 11:48:59,789][123091] Updated weights for policy 0, policy_version 1530550 (0.0006) [2023-12-26 11:48:59,832][123090] Updated weights for policy 1, policy_version 1520487 (0.0008) [2023-12-26 11:48:59,849][123091] Updated weights for policy 0, policy_version 1530560 (0.0008) [2023-12-26 11:48:59,902][123090] Updated weights for policy 1, policy_version 1520497 (0.0008) [2023-12-26 11:48:59,912][123091] Updated weights for policy 0, policy_version 1530570 (0.0006) [2023-12-26 11:48:59,968][123090] Updated weights for policy 1, policy_version 1520507 (0.0008) [2023-12-26 11:49:00,684][123091] Updated weights for policy 0, policy_version 1530580 (0.0006) [2023-12-26 11:49:00,742][123091] Updated weights for policy 0, policy_version 1530590 (0.0005) [2023-12-26 11:49:00,764][123090] Updated weights for policy 1, policy_version 1520517 (0.0009) [2023-12-26 11:49:00,788][123091] Updated weights for policy 0, policy_version 1530600 (0.0005) [2023-12-26 11:49:00,817][123090] Updated weights for policy 1, policy_version 1520527 (0.0008) [2023-12-26 11:49:00,879][123090] Updated weights for policy 1, policy_version 1520537 (0.0008) [2023-12-26 11:49:01,587][123091] Updated weights for policy 0, policy_version 1530610 (0.0009) [2023-12-26 11:49:01,646][123091] Updated weights for policy 0, policy_version 1530620 (0.0011) [2023-12-26 11:49:01,696][123090] Updated weights for policy 1, policy_version 1520547 (0.0009) [2023-12-26 11:49:01,713][123091] Updated weights for policy 0, policy_version 1530630 (0.0011) [2023-12-26 11:49:01,762][123090] Updated weights for policy 1, policy_version 1520557 (0.0009) [2023-12-26 11:49:01,783][123091] Updated weights for policy 0, policy_version 1530640 (0.0011) [2023-12-26 11:49:01,828][123090] Updated weights for policy 1, policy_version 1520567 (0.0009) [2023-12-26 11:49:02,630][123090] Updated weights for policy 1, policy_version 1520577 (0.0008) [2023-12-26 11:49:02,643][123091] Updated weights for policy 0, policy_version 1530650 (0.0009) [2023-12-26 11:49:02,693][123090] Updated weights for policy 1, policy_version 1520587 (0.0010) [2023-12-26 11:49:02,705][123091] Updated weights for policy 0, policy_version 1530660 (0.0010) [2023-12-26 11:49:02,755][123090] Updated weights for policy 1, policy_version 1520597 (0.0009) [2023-12-26 11:49:02,769][123091] Updated weights for policy 0, policy_version 1530670 (0.0009) [2023-12-26 11:49:02,822][123090] Updated weights for policy 1, policy_version 1520607 (0.0009) [2023-12-26 11:49:03,566][123091] Updated weights for policy 0, policy_version 1530680 (0.0007) [2023-12-26 11:49:03,622][123091] Updated weights for policy 0, policy_version 1530690 (0.0005) [2023-12-26 11:49:03,638][123090] Updated weights for policy 1, policy_version 1520617 (0.0010) [2023-12-26 11:49:03,671][123091] Updated weights for policy 0, policy_version 1530700 (0.0005) [2023-12-26 11:49:03,695][123090] Updated weights for policy 1, policy_version 1520627 (0.0008) [2023-12-26 11:49:03,752][123090] Updated weights for policy 1, policy_version 1520637 (0.0010) [2023-12-26 11:49:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 781148160. Throughput: 0: 8602.0, 1: 8766.7. Samples: 781153220. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:03,785][121949] Avg episode reward: [(0, '6367.248'), (1, '5578.529')] [2023-12-26 11:49:04,443][123091] Updated weights for policy 0, policy_version 1530710 (0.0006) [2023-12-26 11:49:04,498][123090] Updated weights for policy 1, policy_version 1520647 (0.0009) [2023-12-26 11:49:04,510][123091] Updated weights for policy 0, policy_version 1530720 (0.0007) [2023-12-26 11:49:04,555][123090] Updated weights for policy 1, policy_version 1520657 (0.0009) [2023-12-26 11:49:04,579][123091] Updated weights for policy 0, policy_version 1530730 (0.0006) [2023-12-26 11:49:04,622][123090] Updated weights for policy 1, policy_version 1520667 (0.0007) [2023-12-26 11:49:05,300][123091] Updated weights for policy 0, policy_version 1530740 (0.0010) [2023-12-26 11:49:05,355][123091] Updated weights for policy 0, policy_version 1530750 (0.0010) [2023-12-26 11:49:05,420][123091] Updated weights for policy 0, policy_version 1530760 (0.0010) [2023-12-26 11:49:05,477][123090] Updated weights for policy 1, policy_version 1520677 (0.0009) [2023-12-26 11:49:05,528][123090] Updated weights for policy 1, policy_version 1520687 (0.0009) [2023-12-26 11:49:05,580][123090] Updated weights for policy 1, policy_version 1520697 (0.0010) [2023-12-26 11:49:06,223][123091] Updated weights for policy 0, policy_version 1530770 (0.0008) [2023-12-26 11:49:06,278][123091] Updated weights for policy 0, policy_version 1530780 (0.0011) [2023-12-26 11:49:06,342][123091] Updated weights for policy 0, policy_version 1530790 (0.0011) [2023-12-26 11:49:06,413][123091] Updated weights for policy 0, policy_version 1530800 (0.0010) [2023-12-26 11:49:06,471][123090] Updated weights for policy 1, policy_version 1520708 (0.0010) [2023-12-26 11:49:06,545][123090] Updated weights for policy 1, policy_version 1520718 (0.0010) [2023-12-26 11:49:06,612][123090] Updated weights for policy 1, policy_version 1520728 (0.0009) [2023-12-26 11:49:07,208][123091] Updated weights for policy 0, policy_version 1530810 (0.0009) [2023-12-26 11:49:07,264][123091] Updated weights for policy 0, policy_version 1530820 (0.0009) [2023-12-26 11:49:07,328][123091] Updated weights for policy 0, policy_version 1530830 (0.0009) [2023-12-26 11:49:07,464][123090] Updated weights for policy 1, policy_version 1520738 (0.0009) [2023-12-26 11:49:07,528][123090] Updated weights for policy 1, policy_version 1520748 (0.0009) [2023-12-26 11:49:07,597][123090] Updated weights for policy 1, policy_version 1520758 (0.0009) [2023-12-26 11:49:07,655][123090] Updated weights for policy 1, policy_version 1520768 (0.0009) [2023-12-26 11:49:08,165][123091] Updated weights for policy 0, policy_version 1530840 (0.0010) [2023-12-26 11:49:08,223][123091] Updated weights for policy 0, policy_version 1530850 (0.0008) [2023-12-26 11:49:08,278][123091] Updated weights for policy 0, policy_version 1530860 (0.0005) [2023-12-26 11:49:08,486][123090] Updated weights for policy 1, policy_version 1520778 (0.0008) [2023-12-26 11:49:08,561][123090] Updated weights for policy 1, policy_version 1520788 (0.0006) [2023-12-26 11:49:08,621][123090] Updated weights for policy 1, policy_version 1520798 (0.0010) [2023-12-26 11:49:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17661.4). Total num frames: 781230080. Throughput: 0: 8697.7, 1: 8761.6. Samples: 781206928. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:08,784][121949] Avg episode reward: [(0, '6368.529'), (1, '5704.408')] [2023-12-26 11:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001520800_389324800.pth... [2023-12-26 11:49:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001530864_391905280.pth... [2023-12-26 11:49:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001519808_389070848.pth [2023-12-26 11:49:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001529840_391643136.pth [2023-12-26 11:49:09,089][123091] Updated weights for policy 0, policy_version 1530870 (0.0008) [2023-12-26 11:49:09,156][123091] Updated weights for policy 0, policy_version 1530880 (0.0009) [2023-12-26 11:49:09,219][123091] Updated weights for policy 0, policy_version 1530890 (0.0010) [2023-12-26 11:49:09,421][123090] Updated weights for policy 1, policy_version 1520808 (0.0008) [2023-12-26 11:49:09,490][123090] Updated weights for policy 1, policy_version 1520818 (0.0008) [2023-12-26 11:49:09,546][123090] Updated weights for policy 1, policy_version 1520828 (0.0009) [2023-12-26 11:49:10,051][123091] Updated weights for policy 0, policy_version 1530900 (0.0008) [2023-12-26 11:49:10,113][123091] Updated weights for policy 0, policy_version 1530910 (0.0009) [2023-12-26 11:49:10,181][123091] Updated weights for policy 0, policy_version 1530920 (0.0009) [2023-12-26 11:49:10,364][123090] Updated weights for policy 1, policy_version 1520838 (0.0008) [2023-12-26 11:49:10,429][123090] Updated weights for policy 1, policy_version 1520848 (0.0009) [2023-12-26 11:49:10,482][123090] Updated weights for policy 1, policy_version 1520858 (0.0010) [2023-12-26 11:49:11,019][123091] Updated weights for policy 0, policy_version 1530930 (0.0010) [2023-12-26 11:49:11,086][123091] Updated weights for policy 0, policy_version 1530940 (0.0011) [2023-12-26 11:49:11,155][123091] Updated weights for policy 0, policy_version 1530950 (0.0011) [2023-12-26 11:49:11,219][123091] Updated weights for policy 0, policy_version 1530960 (0.0011) [2023-12-26 11:49:11,309][123090] Updated weights for policy 1, policy_version 1520868 (0.0009) [2023-12-26 11:49:11,391][123090] Updated weights for policy 1, policy_version 1520878 (0.0009) [2023-12-26 11:49:11,458][123090] Updated weights for policy 1, policy_version 1520888 (0.0010) [2023-12-26 11:49:12,092][123091] Updated weights for policy 0, policy_version 1530970 (0.0009) [2023-12-26 11:49:12,150][123091] Updated weights for policy 0, policy_version 1530980 (0.0010) [2023-12-26 11:49:12,214][123091] Updated weights for policy 0, policy_version 1530990 (0.0005) [2023-12-26 11:49:12,256][123090] Updated weights for policy 1, policy_version 1520898 (0.0010) [2023-12-26 11:49:12,322][123090] Updated weights for policy 1, policy_version 1520908 (0.0009) [2023-12-26 11:49:12,388][123090] Updated weights for policy 1, policy_version 1520918 (0.0009) [2023-12-26 11:49:12,455][123090] Updated weights for policy 1, policy_version 1520928 (0.0009) [2023-12-26 11:49:13,025][123091] Updated weights for policy 0, policy_version 1531000 (0.0008) [2023-12-26 11:49:13,084][123091] Updated weights for policy 0, policy_version 1531010 (0.0009) [2023-12-26 11:49:13,132][123091] Updated weights for policy 0, policy_version 1531020 (0.0009) [2023-12-26 11:49:13,287][123090] Updated weights for policy 1, policy_version 1520938 (0.0010) [2023-12-26 11:49:13,352][123090] Updated weights for policy 1, policy_version 1520948 (0.0009) [2023-12-26 11:49:13,415][123090] Updated weights for policy 1, policy_version 1520958 (0.0010) [2023-12-26 11:49:13,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17339.6, 300 sec: 17661.4). Total num frames: 781312000. Throughput: 0: 8702.8, 1: 8539.9. Samples: 781307592. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:13,785][121949] Avg episode reward: [(0, '6290.439'), (1, '5639.217')] [2023-12-26 11:49:13,943][123091] Updated weights for policy 0, policy_version 1531030 (0.0010) [2023-12-26 11:49:13,991][123091] Updated weights for policy 0, policy_version 1531040 (0.0010) [2023-12-26 11:49:14,047][123091] Updated weights for policy 0, policy_version 1531050 (0.0011) [2023-12-26 11:49:14,232][123090] Updated weights for policy 1, policy_version 1520968 (0.0011) [2023-12-26 11:49:14,294][123090] Updated weights for policy 1, policy_version 1520978 (0.0010) [2023-12-26 11:49:14,352][123090] Updated weights for policy 1, policy_version 1520988 (0.0010) [2023-12-26 11:49:14,881][123091] Updated weights for policy 0, policy_version 1531060 (0.0010) [2023-12-26 11:49:14,948][123091] Updated weights for policy 0, policy_version 1531070 (0.0010) [2023-12-26 11:49:15,044][123091] Updated weights for policy 0, policy_version 1531080 (0.0009) [2023-12-26 11:49:15,114][123090] Updated weights for policy 1, policy_version 1520998 (0.0010) [2023-12-26 11:49:15,163][123090] Updated weights for policy 1, policy_version 1521008 (0.0010) [2023-12-26 11:49:15,226][123090] Updated weights for policy 1, policy_version 1521018 (0.0011) [2023-12-26 11:49:15,891][123091] Updated weights for policy 0, policy_version 1531090 (0.0009) [2023-12-26 11:49:15,956][123091] Updated weights for policy 0, policy_version 1531100 (0.0010) [2023-12-26 11:49:15,994][123090] Updated weights for policy 1, policy_version 1521028 (0.0008) [2023-12-26 11:49:16,006][123091] Updated weights for policy 0, policy_version 1531110 (0.0009) [2023-12-26 11:49:16,054][123090] Updated weights for policy 1, policy_version 1521038 (0.0005) [2023-12-26 11:49:16,056][123091] Updated weights for policy 0, policy_version 1531120 (0.0009) [2023-12-26 11:49:16,120][123090] Updated weights for policy 1, policy_version 1521048 (0.0005) [2023-12-26 11:49:16,670][123090] Updated weights for policy 1, policy_version 1521058 (0.0005) [2023-12-26 11:49:16,741][123090] Updated weights for policy 1, policy_version 1521068 (0.0005) [2023-12-26 11:49:16,802][123090] Updated weights for policy 1, policy_version 1521078 (0.0005) [2023-12-26 11:49:16,870][123090] Updated weights for policy 1, policy_version 1521088 (0.0005) [2023-12-26 11:49:16,965][123091] Updated weights for policy 0, policy_version 1531130 (0.0009) [2023-12-26 11:49:17,031][123091] Updated weights for policy 0, policy_version 1531140 (0.0009) [2023-12-26 11:49:17,084][123091] Updated weights for policy 0, policy_version 1531150 (0.0010) [2023-12-26 11:49:17,440][123090] Updated weights for policy 1, policy_version 1521098 (0.0005) [2023-12-26 11:49:17,505][123090] Updated weights for policy 1, policy_version 1521108 (0.0005) [2023-12-26 11:49:17,572][123090] Updated weights for policy 1, policy_version 1521118 (0.0005) [2023-12-26 11:49:17,978][123091] Updated weights for policy 0, policy_version 1531160 (0.0010) [2023-12-26 11:49:18,049][123091] Updated weights for policy 0, policy_version 1531170 (0.0010) [2023-12-26 11:49:18,114][123091] Updated weights for policy 0, policy_version 1531180 (0.0010) [2023-12-26 11:49:18,262][123090] Updated weights for policy 1, policy_version 1521128 (0.0009) [2023-12-26 11:49:18,328][123090] Updated weights for policy 1, policy_version 1521138 (0.0009) [2023-12-26 11:49:18,397][123090] Updated weights for policy 1, policy_version 1521148 (0.0008) [2023-12-26 11:49:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 781402112. Throughput: 0: 8711.4, 1: 8581.7. Samples: 781414496. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:18,785][121949] Avg episode reward: [(0, '6309.567'), (1, '5683.841')] [2023-12-26 11:49:18,923][123091] Updated weights for policy 0, policy_version 1531190 (0.0009) [2023-12-26 11:49:18,988][123091] Updated weights for policy 0, policy_version 1531200 (0.0010) [2023-12-26 11:49:19,055][123091] Updated weights for policy 0, policy_version 1531210 (0.0009) [2023-12-26 11:49:19,144][123090] Updated weights for policy 1, policy_version 1521158 (0.0009) [2023-12-26 11:49:19,202][123090] Updated weights for policy 1, policy_version 1521168 (0.0010) [2023-12-26 11:49:19,269][123090] Updated weights for policy 1, policy_version 1521178 (0.0010) [2023-12-26 11:49:19,905][123091] Updated weights for policy 0, policy_version 1531220 (0.0009) [2023-12-26 11:49:19,975][123091] Updated weights for policy 0, policy_version 1531230 (0.0010) [2023-12-26 11:49:20,043][123091] Updated weights for policy 0, policy_version 1531240 (0.0010) [2023-12-26 11:49:20,161][123090] Updated weights for policy 1, policy_version 1521188 (0.0010) [2023-12-26 11:49:20,223][123090] Updated weights for policy 1, policy_version 1521198 (0.0009) [2023-12-26 11:49:20,294][123090] Updated weights for policy 1, policy_version 1521208 (0.0010) [2023-12-26 11:49:20,881][123091] Updated weights for policy 0, policy_version 1531250 (0.0010) [2023-12-26 11:49:20,936][123091] Updated weights for policy 0, policy_version 1531260 (0.0010) [2023-12-26 11:49:21,000][123091] Updated weights for policy 0, policy_version 1531270 (0.0010) [2023-12-26 11:49:21,076][123091] Updated weights for policy 0, policy_version 1531280 (0.0010) [2023-12-26 11:49:21,165][123090] Updated weights for policy 1, policy_version 1521218 (0.0009) [2023-12-26 11:49:21,237][123090] Updated weights for policy 1, policy_version 1521228 (0.0009) [2023-12-26 11:49:21,302][123090] Updated weights for policy 1, policy_version 1521238 (0.0010) [2023-12-26 11:49:21,373][123090] Updated weights for policy 1, policy_version 1521248 (0.0009) [2023-12-26 11:49:21,890][123091] Updated weights for policy 0, policy_version 1531290 (0.0010) [2023-12-26 11:49:21,960][123091] Updated weights for policy 0, policy_version 1531300 (0.0009) [2023-12-26 11:49:22,023][123091] Updated weights for policy 0, policy_version 1531310 (0.0010) [2023-12-26 11:49:22,238][123090] Updated weights for policy 1, policy_version 1521258 (0.0009) [2023-12-26 11:49:22,297][123090] Updated weights for policy 1, policy_version 1521268 (0.0010) [2023-12-26 11:49:22,363][123090] Updated weights for policy 1, policy_version 1521278 (0.0008) [2023-12-26 11:49:22,904][123091] Updated weights for policy 0, policy_version 1531320 (0.0009) [2023-12-26 11:49:22,970][123091] Updated weights for policy 0, policy_version 1531330 (0.0010) [2023-12-26 11:49:23,033][123091] Updated weights for policy 0, policy_version 1531340 (0.0008) [2023-12-26 11:49:23,124][123090] Updated weights for policy 1, policy_version 1521288 (0.0009) [2023-12-26 11:49:23,178][123090] Updated weights for policy 1, policy_version 1521298 (0.0009) [2023-12-26 11:49:23,239][123090] Updated weights for policy 1, policy_version 1521308 (0.0010) [2023-12-26 11:49:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 781484032. Throughput: 0: 8730.2, 1: 8533.8. Samples: 781464624. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:23,785][121949] Avg episode reward: [(0, '6292.031'), (1, '5650.824')] [2023-12-26 11:49:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001531344_392028160.pth... [2023-12-26 11:49:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001521312_389455872.pth... [2023-12-26 11:49:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001530352_391774208.pth [2023-12-26 11:49:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001520320_389201920.pth [2023-12-26 11:49:23,856][123091] Updated weights for policy 0, policy_version 1531350 (0.0010) [2023-12-26 11:49:23,920][123091] Updated weights for policy 0, policy_version 1531360 (0.0008) [2023-12-26 11:49:23,985][123091] Updated weights for policy 0, policy_version 1531370 (0.0006) [2023-12-26 11:49:24,042][123090] Updated weights for policy 1, policy_version 1521318 (0.0007) [2023-12-26 11:49:24,114][123090] Updated weights for policy 1, policy_version 1521328 (0.0006) [2023-12-26 11:49:24,176][123090] Updated weights for policy 1, policy_version 1521338 (0.0009) [2023-12-26 11:49:24,631][123091] Updated weights for policy 0, policy_version 1531380 (0.0005) [2023-12-26 11:49:24,689][123091] Updated weights for policy 0, policy_version 1531390 (0.0010) [2023-12-26 11:49:24,752][123091] Updated weights for policy 0, policy_version 1531400 (0.0011) [2023-12-26 11:49:24,881][123090] Updated weights for policy 1, policy_version 1521348 (0.0008) [2023-12-26 11:49:24,941][123090] Updated weights for policy 1, policy_version 1521358 (0.0006) [2023-12-26 11:49:24,990][123090] Updated weights for policy 1, policy_version 1521368 (0.0008) [2023-12-26 11:49:25,544][123091] Updated weights for policy 0, policy_version 1531410 (0.0011) [2023-12-26 11:49:25,609][123091] Updated weights for policy 0, policy_version 1531420 (0.0010) [2023-12-26 11:49:25,670][123091] Updated weights for policy 0, policy_version 1531430 (0.0010) [2023-12-26 11:49:25,732][123091] Updated weights for policy 0, policy_version 1531440 (0.0010) [2023-12-26 11:49:25,810][123090] Updated weights for policy 1, policy_version 1521378 (0.0009) [2023-12-26 11:49:25,859][123090] Updated weights for policy 1, policy_version 1521388 (0.0009) [2023-12-26 11:49:25,906][123090] Updated weights for policy 1, policy_version 1521398 (0.0008) [2023-12-26 11:49:25,954][123090] Updated weights for policy 1, policy_version 1521408 (0.0009) [2023-12-26 11:49:26,517][123091] Updated weights for policy 0, policy_version 1531450 (0.0010) [2023-12-26 11:49:26,564][123091] Updated weights for policy 0, policy_version 1531460 (0.0010) [2023-12-26 11:49:26,611][123091] Updated weights for policy 0, policy_version 1531470 (0.0010) [2023-12-26 11:49:26,819][123090] Updated weights for policy 1, policy_version 1521418 (0.0009) [2023-12-26 11:49:26,866][123090] Updated weights for policy 1, policy_version 1521428 (0.0008) [2023-12-26 11:49:26,918][123090] Updated weights for policy 1, policy_version 1521438 (0.0008) [2023-12-26 11:49:27,465][123091] Updated weights for policy 0, policy_version 1531480 (0.0010) [2023-12-26 11:49:27,526][123091] Updated weights for policy 0, policy_version 1531490 (0.0010) [2023-12-26 11:49:27,587][123091] Updated weights for policy 0, policy_version 1531500 (0.0010) [2023-12-26 11:49:27,785][123090] Updated weights for policy 1, policy_version 1521448 (0.0009) [2023-12-26 11:49:27,848][123090] Updated weights for policy 1, policy_version 1521458 (0.0009) [2023-12-26 11:49:27,911][123090] Updated weights for policy 1, policy_version 1521468 (0.0008) [2023-12-26 11:49:28,391][123091] Updated weights for policy 0, policy_version 1531510 (0.0010) [2023-12-26 11:49:28,454][123091] Updated weights for policy 0, policy_version 1531520 (0.0010) [2023-12-26 11:49:28,508][123091] Updated weights for policy 0, policy_version 1531530 (0.0010) [2023-12-26 11:49:28,736][123090] Updated weights for policy 1, policy_version 1521478 (0.0009) [2023-12-26 11:49:28,784][123090] Updated weights for policy 1, policy_version 1521488 (0.0008) [2023-12-26 11:49:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 781574144. Throughput: 0: 8754.6, 1: 8595.4. Samples: 781570052. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:28,785][121949] Avg episode reward: [(0, '6338.429'), (1, '5702.310')] [2023-12-26 11:49:28,836][123090] Updated weights for policy 1, policy_version 1521498 (0.0009) [2023-12-26 11:49:29,326][123091] Updated weights for policy 0, policy_version 1531540 (0.0011) [2023-12-26 11:49:29,394][123091] Updated weights for policy 0, policy_version 1531550 (0.0011) [2023-12-26 11:49:29,448][123091] Updated weights for policy 0, policy_version 1531560 (0.0010) [2023-12-26 11:49:29,709][123090] Updated weights for policy 1, policy_version 1521508 (0.0009) [2023-12-26 11:49:29,768][123090] Updated weights for policy 1, policy_version 1521518 (0.0010) [2023-12-26 11:49:29,831][123090] Updated weights for policy 1, policy_version 1521528 (0.0010) [2023-12-26 11:49:30,258][123091] Updated weights for policy 0, policy_version 1531570 (0.0010) [2023-12-26 11:49:30,313][123091] Updated weights for policy 0, policy_version 1531580 (0.0010) [2023-12-26 11:49:30,367][123091] Updated weights for policy 0, policy_version 1531590 (0.0010) [2023-12-26 11:49:30,421][123091] Updated weights for policy 0, policy_version 1531600 (0.0010) [2023-12-26 11:49:30,668][123090] Updated weights for policy 1, policy_version 1521538 (0.0009) [2023-12-26 11:49:30,729][123090] Updated weights for policy 1, policy_version 1521548 (0.0009) [2023-12-26 11:49:30,788][123090] Updated weights for policy 1, policy_version 1521558 (0.0009) [2023-12-26 11:49:30,836][123090] Updated weights for policy 1, policy_version 1521568 (0.0009) [2023-12-26 11:49:31,266][123091] Updated weights for policy 0, policy_version 1531610 (0.0011) [2023-12-26 11:49:31,330][123091] Updated weights for policy 0, policy_version 1531620 (0.0011) [2023-12-26 11:49:31,399][123091] Updated weights for policy 0, policy_version 1531630 (0.0011) [2023-12-26 11:49:31,738][123090] Updated weights for policy 1, policy_version 1521578 (0.0009) [2023-12-26 11:49:31,796][123090] Updated weights for policy 1, policy_version 1521588 (0.0009) [2023-12-26 11:49:31,855][123090] Updated weights for policy 1, policy_version 1521598 (0.0010) [2023-12-26 11:49:32,161][123091] Updated weights for policy 0, policy_version 1531640 (0.0007) [2023-12-26 11:49:32,217][123091] Updated weights for policy 0, policy_version 1531650 (0.0007) [2023-12-26 11:49:32,287][123091] Updated weights for policy 0, policy_version 1531660 (0.0011) [2023-12-26 11:49:32,715][123090] Updated weights for policy 1, policy_version 1521608 (0.0009) [2023-12-26 11:49:32,776][123090] Updated weights for policy 1, policy_version 1521618 (0.0009) [2023-12-26 11:49:32,847][123090] Updated weights for policy 1, policy_version 1521628 (0.0009) [2023-12-26 11:49:33,092][123091] Updated weights for policy 0, policy_version 1531670 (0.0010) [2023-12-26 11:49:33,160][123091] Updated weights for policy 0, policy_version 1531680 (0.0010) [2023-12-26 11:49:33,225][123091] Updated weights for policy 0, policy_version 1531690 (0.0010) [2023-12-26 11:49:33,537][123090] Updated weights for policy 1, policy_version 1521638 (0.0007) [2023-12-26 11:49:33,587][123090] Updated weights for policy 1, policy_version 1521648 (0.0005) [2023-12-26 11:49:33,632][123090] Updated weights for policy 1, policy_version 1521658 (0.0005) [2023-12-26 11:49:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 781664256. Throughput: 0: 8701.6, 1: 8612.2. Samples: 781673396. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:33,785][121949] Avg episode reward: [(0, '6231.518'), (1, '5870.319')] [2023-12-26 11:49:34,021][123091] Updated weights for policy 0, policy_version 1531700 (0.0011) [2023-12-26 11:49:34,083][123091] Updated weights for policy 0, policy_version 1531710 (0.0011) [2023-12-26 11:49:34,142][123091] Updated weights for policy 0, policy_version 1531720 (0.0011) [2023-12-26 11:49:34,407][123090] Updated weights for policy 1, policy_version 1521668 (0.0007) [2023-12-26 11:49:34,471][123090] Updated weights for policy 1, policy_version 1521678 (0.0011) [2023-12-26 11:49:34,538][123090] Updated weights for policy 1, policy_version 1521688 (0.0011) [2023-12-26 11:49:34,941][123091] Updated weights for policy 0, policy_version 1531730 (0.0010) [2023-12-26 11:49:35,002][123091] Updated weights for policy 0, policy_version 1531740 (0.0006) [2023-12-26 11:49:35,072][123091] Updated weights for policy 0, policy_version 1531750 (0.0005) [2023-12-26 11:49:35,135][123091] Updated weights for policy 0, policy_version 1531760 (0.0006) [2023-12-26 11:49:35,293][123090] Updated weights for policy 1, policy_version 1521698 (0.0010) [2023-12-26 11:49:35,346][123090] Updated weights for policy 1, policy_version 1521708 (0.0010) [2023-12-26 11:49:35,394][123090] Updated weights for policy 1, policy_version 1521718 (0.0010) [2023-12-26 11:49:35,447][123090] Updated weights for policy 1, policy_version 1521728 (0.0010) [2023-12-26 11:49:35,874][123091] Updated weights for policy 0, policy_version 1531770 (0.0008) [2023-12-26 11:49:35,925][123091] Updated weights for policy 0, policy_version 1531780 (0.0005) [2023-12-26 11:49:35,987][123091] Updated weights for policy 0, policy_version 1531790 (0.0005) [2023-12-26 11:49:36,255][123090] Updated weights for policy 1, policy_version 1521738 (0.0008) [2023-12-26 11:49:36,314][123090] Updated weights for policy 1, policy_version 1521748 (0.0007) [2023-12-26 11:49:36,370][123090] Updated weights for policy 1, policy_version 1521758 (0.0010) [2023-12-26 11:49:36,732][123091] Updated weights for policy 0, policy_version 1531800 (0.0010) [2023-12-26 11:49:36,803][123091] Updated weights for policy 0, policy_version 1531810 (0.0011) [2023-12-26 11:49:36,866][123091] Updated weights for policy 0, policy_version 1531820 (0.0011) [2023-12-26 11:49:37,137][123090] Updated weights for policy 1, policy_version 1521768 (0.0006) [2023-12-26 11:49:37,195][123090] Updated weights for policy 1, policy_version 1521778 (0.0006) [2023-12-26 11:49:37,251][123090] Updated weights for policy 1, policy_version 1521788 (0.0006) [2023-12-26 11:49:37,696][123091] Updated weights for policy 0, policy_version 1531830 (0.0009) [2023-12-26 11:49:37,766][123091] Updated weights for policy 0, policy_version 1531840 (0.0007) [2023-12-26 11:49:37,842][123091] Updated weights for policy 0, policy_version 1531850 (0.0010) [2023-12-26 11:49:37,930][123090] Updated weights for policy 1, policy_version 1521798 (0.0009) [2023-12-26 11:49:37,999][123090] Updated weights for policy 1, policy_version 1521808 (0.0010) [2023-12-26 11:49:38,056][123090] Updated weights for policy 1, policy_version 1521818 (0.0006) [2023-12-26 11:49:38,628][123091] Updated weights for policy 0, policy_version 1531860 (0.0010) [2023-12-26 11:49:38,683][123091] Updated weights for policy 0, policy_version 1531870 (0.0011) [2023-12-26 11:49:38,751][123091] Updated weights for policy 0, policy_version 1531880 (0.0011) [2023-12-26 11:49:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 781746176. Throughput: 0: 8744.6, 1: 8670.9. Samples: 781728716. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:38,785][121949] Avg episode reward: [(0, '6174.137'), (1, '5716.533')] [2023-12-26 11:49:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001521824_389586944.pth... [2023-12-26 11:49:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001520800_389324800.pth [2023-12-26 11:49:38,799][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001531888_392167424.pth... [2023-12-26 11:49:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001530864_391905280.pth [2023-12-26 11:49:38,891][123090] Updated weights for policy 1, policy_version 1521828 (0.0009) [2023-12-26 11:49:38,964][123090] Updated weights for policy 1, policy_version 1521838 (0.0006) [2023-12-26 11:49:39,038][123090] Updated weights for policy 1, policy_version 1521848 (0.0005) [2023-12-26 11:49:39,516][123091] Updated weights for policy 0, policy_version 1531890 (0.0011) [2023-12-26 11:49:39,585][123091] Updated weights for policy 0, policy_version 1531900 (0.0009) [2023-12-26 11:49:39,653][123091] Updated weights for policy 0, policy_version 1531910 (0.0010) [2023-12-26 11:49:39,716][123091] Updated weights for policy 0, policy_version 1531920 (0.0011) [2023-12-26 11:49:39,768][123090] Updated weights for policy 1, policy_version 1521858 (0.0006) [2023-12-26 11:49:39,834][123090] Updated weights for policy 1, policy_version 1521868 (0.0010) [2023-12-26 11:49:39,893][123090] Updated weights for policy 1, policy_version 1521878 (0.0009) [2023-12-26 11:49:39,960][123090] Updated weights for policy 1, policy_version 1521888 (0.0010) [2023-12-26 11:49:40,561][123091] Updated weights for policy 0, policy_version 1531930 (0.0009) [2023-12-26 11:49:40,615][123091] Updated weights for policy 0, policy_version 1531940 (0.0010) [2023-12-26 11:49:40,675][123091] Updated weights for policy 0, policy_version 1531950 (0.0010) [2023-12-26 11:49:40,729][123090] Updated weights for policy 1, policy_version 1521898 (0.0010) [2023-12-26 11:49:40,785][123090] Updated weights for policy 1, policy_version 1521908 (0.0009) [2023-12-26 11:49:40,835][123090] Updated weights for policy 1, policy_version 1521918 (0.0010) [2023-12-26 11:49:41,560][123091] Updated weights for policy 0, policy_version 1531960 (0.0010) [2023-12-26 11:49:41,618][123091] Updated weights for policy 0, policy_version 1531970 (0.0009) [2023-12-26 11:49:41,686][123091] Updated weights for policy 0, policy_version 1531980 (0.0007) [2023-12-26 11:49:41,754][123090] Updated weights for policy 1, policy_version 1521928 (0.0010) [2023-12-26 11:49:41,824][123090] Updated weights for policy 1, policy_version 1521938 (0.0010) [2023-12-26 11:49:41,898][123090] Updated weights for policy 1, policy_version 1521948 (0.0010) [2023-12-26 11:49:42,423][123091] Updated weights for policy 0, policy_version 1531990 (0.0008) [2023-12-26 11:49:42,488][123091] Updated weights for policy 0, policy_version 1532000 (0.0009) [2023-12-26 11:49:42,551][123091] Updated weights for policy 0, policy_version 1532010 (0.0009) [2023-12-26 11:49:42,798][123090] Updated weights for policy 1, policy_version 1521958 (0.0010) [2023-12-26 11:49:42,855][123090] Updated weights for policy 1, policy_version 1521968 (0.0010) [2023-12-26 11:49:42,910][123090] Updated weights for policy 1, policy_version 1521978 (0.0009) [2023-12-26 11:49:43,399][123091] Updated weights for policy 0, policy_version 1532020 (0.0009) [2023-12-26 11:49:43,470][123091] Updated weights for policy 0, policy_version 1532030 (0.0009) [2023-12-26 11:49:43,533][123091] Updated weights for policy 0, policy_version 1532040 (0.0009) [2023-12-26 11:49:43,695][123090] Updated weights for policy 1, policy_version 1521988 (0.0008) [2023-12-26 11:49:43,759][123090] Updated weights for policy 1, policy_version 1521998 (0.0006) [2023-12-26 11:49:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 781836288. Throughput: 0: 8640.7, 1: 8721.4. Samples: 781831928. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:43,785][121949] Avg episode reward: [(0, '6259.126'), (1, '5527.235')] [2023-12-26 11:49:43,828][123090] Updated weights for policy 1, policy_version 1522008 (0.0006) [2023-12-26 11:49:44,342][123091] Updated weights for policy 0, policy_version 1532050 (0.0009) [2023-12-26 11:49:44,413][123091] Updated weights for policy 0, policy_version 1532060 (0.0007) [2023-12-26 11:49:44,483][123091] Updated weights for policy 0, policy_version 1532070 (0.0007) [2023-12-26 11:49:44,555][123091] Updated weights for policy 0, policy_version 1532080 (0.0008) [2023-12-26 11:49:44,581][123090] Updated weights for policy 1, policy_version 1522018 (0.0007) [2023-12-26 11:49:44,654][123090] Updated weights for policy 1, policy_version 1522028 (0.0011) [2023-12-26 11:49:44,720][123090] Updated weights for policy 1, policy_version 1522038 (0.0010) [2023-12-26 11:49:44,779][123090] Updated weights for policy 1, policy_version 1522048 (0.0011) [2023-12-26 11:49:45,318][123091] Updated weights for policy 0, policy_version 1532090 (0.0009) [2023-12-26 11:49:45,371][123091] Updated weights for policy 0, policy_version 1532100 (0.0009) [2023-12-26 11:49:45,436][123091] Updated weights for policy 0, policy_version 1532110 (0.0009) [2023-12-26 11:49:45,579][123090] Updated weights for policy 1, policy_version 1522058 (0.0011) [2023-12-26 11:49:45,647][123090] Updated weights for policy 1, policy_version 1522068 (0.0011) [2023-12-26 11:49:45,714][123090] Updated weights for policy 1, policy_version 1522078 (0.0011) [2023-12-26 11:49:46,279][123091] Updated weights for policy 0, policy_version 1532120 (0.0009) [2023-12-26 11:49:46,328][123091] Updated weights for policy 0, policy_version 1532130 (0.0009) [2023-12-26 11:49:46,376][123091] Updated weights for policy 0, policy_version 1532140 (0.0009) [2023-12-26 11:49:46,510][123090] Updated weights for policy 1, policy_version 1522088 (0.0006) [2023-12-26 11:49:46,575][123090] Updated weights for policy 1, policy_version 1522098 (0.0005) [2023-12-26 11:49:46,632][123090] Updated weights for policy 1, policy_version 1522108 (0.0009) [2023-12-26 11:49:47,273][123091] Updated weights for policy 0, policy_version 1532150 (0.0010) [2023-12-26 11:49:47,338][123091] Updated weights for policy 0, policy_version 1532160 (0.0009) [2023-12-26 11:49:47,383][123090] Updated weights for policy 1, policy_version 1522118 (0.0009) [2023-12-26 11:49:47,396][123091] Updated weights for policy 0, policy_version 1532170 (0.0008) [2023-12-26 11:49:47,452][123090] Updated weights for policy 1, policy_version 1522128 (0.0007) [2023-12-26 11:49:47,530][123090] Updated weights for policy 1, policy_version 1522138 (0.0006) [2023-12-26 11:49:48,080][123090] Updated weights for policy 1, policy_version 1522148 (0.0006) [2023-12-26 11:49:48,151][123090] Updated weights for policy 1, policy_version 1522158 (0.0006) [2023-12-26 11:49:48,212][123090] Updated weights for policy 1, policy_version 1522168 (0.0009) [2023-12-26 11:49:48,244][123091] Updated weights for policy 0, policy_version 1532180 (0.0010) [2023-12-26 11:49:48,303][123091] Updated weights for policy 0, policy_version 1532190 (0.0008) [2023-12-26 11:49:48,360][123091] Updated weights for policy 0, policy_version 1532200 (0.0009) [2023-12-26 11:49:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 781926400. Throughput: 0: 8603.7, 1: 8833.7. Samples: 781937900. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 11:49:48,785][121949] Avg episode reward: [(0, '6256.569'), (1, '5772.483')] [2023-12-26 11:49:48,918][123090] Updated weights for policy 1, policy_version 1522178 (0.0008) [2023-12-26 11:49:48,978][123090] Updated weights for policy 1, policy_version 1522188 (0.0005) [2023-12-26 11:49:49,032][123090] Updated weights for policy 1, policy_version 1522198 (0.0005) [2023-12-26 11:49:49,084][123090] Updated weights for policy 1, policy_version 1522208 (0.0005) [2023-12-26 11:49:49,270][123091] Updated weights for policy 0, policy_version 1532210 (0.0010) [2023-12-26 11:49:49,335][123091] Updated weights for policy 0, policy_version 1532220 (0.0008) [2023-12-26 11:49:49,403][123091] Updated weights for policy 0, policy_version 1532230 (0.0007) [2023-12-26 11:49:49,467][123091] Updated weights for policy 0, policy_version 1532240 (0.0009) [2023-12-26 11:49:49,895][123090] Updated weights for policy 1, policy_version 1522218 (0.0011) [2023-12-26 11:49:49,959][123090] Updated weights for policy 1, policy_version 1522228 (0.0009) [2023-12-26 11:49:50,031][123090] Updated weights for policy 1, policy_version 1522238 (0.0008) [2023-12-26 11:49:50,212][123091] Updated weights for policy 0, policy_version 1532250 (0.0007) [2023-12-26 11:49:50,267][123091] Updated weights for policy 0, policy_version 1532260 (0.0005) [2023-12-26 11:49:50,323][123091] Updated weights for policy 0, policy_version 1532270 (0.0009) [2023-12-26 11:49:50,840][123090] Updated weights for policy 1, policy_version 1522248 (0.0010) [2023-12-26 11:49:50,899][123090] Updated weights for policy 1, policy_version 1522258 (0.0010) [2023-12-26 11:49:50,955][123090] Updated weights for policy 1, policy_version 1522268 (0.0010) [2023-12-26 11:49:51,023][123091] Updated weights for policy 0, policy_version 1532280 (0.0006) [2023-12-26 11:49:51,094][123091] Updated weights for policy 0, policy_version 1532290 (0.0010) [2023-12-26 11:49:51,166][123091] Updated weights for policy 0, policy_version 1532300 (0.0011) [2023-12-26 11:49:51,892][123090] Updated weights for policy 1, policy_version 1522278 (0.0009) [2023-12-26 11:49:51,935][123091] Updated weights for policy 0, policy_version 1532310 (0.0008) [2023-12-26 11:49:51,942][123090] Updated weights for policy 1, policy_version 1522288 (0.0009) [2023-12-26 11:49:52,000][123090] Updated weights for policy 1, policy_version 1522298 (0.0009) [2023-12-26 11:49:52,002][123091] Updated weights for policy 0, policy_version 1532320 (0.0007) [2023-12-26 11:49:52,073][123091] Updated weights for policy 0, policy_version 1532330 (0.0008) [2023-12-26 11:49:52,863][123090] Updated weights for policy 1, policy_version 1522308 (0.0009) [2023-12-26 11:49:52,875][123091] Updated weights for policy 0, policy_version 1532340 (0.0008) [2023-12-26 11:49:52,918][123090] Updated weights for policy 1, policy_version 1522318 (0.0008) [2023-12-26 11:49:52,925][123091] Updated weights for policy 0, policy_version 1532350 (0.0008) [2023-12-26 11:49:52,972][123090] Updated weights for policy 1, policy_version 1522328 (0.0007) [2023-12-26 11:49:52,986][123091] Updated weights for policy 0, policy_version 1532360 (0.0010) [2023-12-26 11:49:53,742][123091] Updated weights for policy 0, policy_version 1532370 (0.0009) [2023-12-26 11:49:53,783][123090] Updated weights for policy 1, policy_version 1522338 (0.0007) [2023-12-26 11:49:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 782008320. Throughput: 0: 8576.8, 1: 8840.0. Samples: 781990684. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:49:53,785][121949] Avg episode reward: [(0, '6234.487'), (1, '5849.873')] [2023-12-26 11:49:53,790][123091] Updated weights for policy 0, policy_version 1532380 (0.0005) [2023-12-26 11:49:53,842][123091] Updated weights for policy 0, policy_version 1532390 (0.0005) [2023-12-26 11:49:53,843][123090] Updated weights for policy 1, policy_version 1522348 (0.0009) [2023-12-26 11:49:53,891][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001532400_392298496.pth... [2023-12-26 11:49:53,892][123091] Updated weights for policy 0, policy_version 1532400 (0.0005) [2023-12-26 11:49:53,894][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001531344_392028160.pth [2023-12-26 11:49:53,908][123090] Updated weights for policy 1, policy_version 1522358 (0.0009) [2023-12-26 11:49:53,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001522368_389726208.pth... [2023-12-26 11:49:53,965][123090] Updated weights for policy 1, policy_version 1522368 (0.0010) [2023-12-26 11:49:53,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001521312_389455872.pth [2023-12-26 11:49:54,627][123091] Updated weights for policy 0, policy_version 1532410 (0.0005) [2023-12-26 11:49:54,689][123091] Updated weights for policy 0, policy_version 1532420 (0.0010) [2023-12-26 11:49:54,757][123091] Updated weights for policy 0, policy_version 1532430 (0.0010) [2023-12-26 11:49:54,782][123090] Updated weights for policy 1, policy_version 1522378 (0.0010) [2023-12-26 11:49:54,847][123090] Updated weights for policy 1, policy_version 1522388 (0.0010) [2023-12-26 11:49:54,914][123090] Updated weights for policy 1, policy_version 1522398 (0.0010) [2023-12-26 11:49:55,589][123091] Updated weights for policy 0, policy_version 1532440 (0.0010) [2023-12-26 11:49:55,651][123091] Updated weights for policy 0, policy_version 1532450 (0.0010) [2023-12-26 11:49:55,678][123090] Updated weights for policy 1, policy_version 1522408 (0.0007) [2023-12-26 11:49:55,711][123091] Updated weights for policy 0, policy_version 1532460 (0.0008) [2023-12-26 11:49:55,738][123090] Updated weights for policy 1, policy_version 1522418 (0.0006) [2023-12-26 11:49:55,804][123090] Updated weights for policy 1, policy_version 1522428 (0.0005) [2023-12-26 11:49:56,417][123090] Updated weights for policy 1, policy_version 1522438 (0.0007) [2023-12-26 11:49:56,475][123090] Updated weights for policy 1, policy_version 1522448 (0.0007) [2023-12-26 11:49:56,515][123091] Updated weights for policy 0, policy_version 1532470 (0.0009) [2023-12-26 11:49:56,541][123090] Updated weights for policy 1, policy_version 1522458 (0.0006) [2023-12-26 11:49:56,578][123091] Updated weights for policy 0, policy_version 1532480 (0.0009) [2023-12-26 11:49:56,643][123091] Updated weights for policy 0, policy_version 1532490 (0.0010) [2023-12-26 11:49:57,303][123090] Updated weights for policy 1, policy_version 1522468 (0.0008) [2023-12-26 11:49:57,370][123090] Updated weights for policy 1, policy_version 1522478 (0.0006) [2023-12-26 11:49:57,429][123090] Updated weights for policy 1, policy_version 1522488 (0.0005) [2023-12-26 11:49:57,446][123091] Updated weights for policy 0, policy_version 1532500 (0.0008) [2023-12-26 11:49:57,502][123091] Updated weights for policy 0, policy_version 1532510 (0.0005) [2023-12-26 11:49:57,553][123091] Updated weights for policy 0, policy_version 1532520 (0.0005) [2023-12-26 11:49:58,148][123090] Updated weights for policy 1, policy_version 1522498 (0.0007) [2023-12-26 11:49:58,212][123091] Updated weights for policy 0, policy_version 1532530 (0.0006) [2023-12-26 11:49:58,219][123090] Updated weights for policy 1, policy_version 1522508 (0.0009) [2023-12-26 11:49:58,278][123091] Updated weights for policy 0, policy_version 1532540 (0.0007) [2023-12-26 11:49:58,280][123090] Updated weights for policy 1, policy_version 1522518 (0.0010) [2023-12-26 11:49:58,344][123091] Updated weights for policy 0, policy_version 1532550 (0.0008) [2023-12-26 11:49:58,346][123090] Updated weights for policy 1, policy_version 1522528 (0.0012) [2023-12-26 11:49:58,413][123091] Updated weights for policy 0, policy_version 1532560 (0.0009) [2023-12-26 11:49:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 782106624. Throughput: 0: 8647.2, 1: 8937.9. Samples: 782098916. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:49:58,784][121949] Avg episode reward: [(0, '6194.951'), (1, '5577.524')] [2023-12-26 11:49:59,087][123090] Updated weights for policy 1, policy_version 1522538 (0.0006) [2023-12-26 11:49:59,138][123090] Updated weights for policy 1, policy_version 1522548 (0.0007) [2023-12-26 11:49:59,186][123090] Updated weights for policy 1, policy_version 1522558 (0.0010) [2023-12-26 11:49:59,191][123091] Updated weights for policy 0, policy_version 1532570 (0.0006) [2023-12-26 11:49:59,253][123091] Updated weights for policy 0, policy_version 1532580 (0.0007) [2023-12-26 11:49:59,322][123091] Updated weights for policy 0, policy_version 1532590 (0.0007) [2023-12-26 11:50:00,025][123090] Updated weights for policy 1, policy_version 1522568 (0.0008) [2023-12-26 11:50:00,077][123090] Updated weights for policy 1, policy_version 1522578 (0.0010) [2023-12-26 11:50:00,079][123091] Updated weights for policy 0, policy_version 1532600 (0.0010) [2023-12-26 11:50:00,123][123091] Updated weights for policy 0, policy_version 1532610 (0.0010) [2023-12-26 11:50:00,136][123090] Updated weights for policy 1, policy_version 1522588 (0.0010) [2023-12-26 11:50:00,169][123091] Updated weights for policy 0, policy_version 1532620 (0.0005) [2023-12-26 11:50:00,885][123091] Updated weights for policy 0, policy_version 1532630 (0.0005) [2023-12-26 11:50:00,943][123091] Updated weights for policy 0, policy_version 1532640 (0.0005) [2023-12-26 11:50:00,979][123090] Updated weights for policy 1, policy_version 1522598 (0.0010) [2023-12-26 11:50:01,002][123091] Updated weights for policy 0, policy_version 1532650 (0.0005) [2023-12-26 11:50:01,046][123090] Updated weights for policy 1, policy_version 1522608 (0.0009) [2023-12-26 11:50:01,106][123090] Updated weights for policy 1, policy_version 1522618 (0.0010) [2023-12-26 11:50:01,786][123091] Updated weights for policy 0, policy_version 1532660 (0.0008) [2023-12-26 11:50:01,848][123091] Updated weights for policy 0, policy_version 1532670 (0.0008) [2023-12-26 11:50:01,907][123091] Updated weights for policy 0, policy_version 1532680 (0.0006) [2023-12-26 11:50:01,977][123090] Updated weights for policy 1, policy_version 1522628 (0.0008) [2023-12-26 11:50:02,036][123090] Updated weights for policy 1, policy_version 1522638 (0.0009) [2023-12-26 11:50:02,095][123090] Updated weights for policy 1, policy_version 1522648 (0.0010) [2023-12-26 11:50:02,755][123091] Updated weights for policy 0, policy_version 1532690 (0.0009) [2023-12-26 11:50:02,827][123091] Updated weights for policy 0, policy_version 1532700 (0.0007) [2023-12-26 11:50:02,858][123090] Updated weights for policy 1, policy_version 1522658 (0.0009) [2023-12-26 11:50:02,899][123091] Updated weights for policy 0, policy_version 1532710 (0.0005) [2023-12-26 11:50:02,912][123090] Updated weights for policy 1, policy_version 1522668 (0.0009) [2023-12-26 11:50:02,966][123091] Updated weights for policy 0, policy_version 1532720 (0.0006) [2023-12-26 11:50:02,973][123090] Updated weights for policy 1, policy_version 1522678 (0.0009) [2023-12-26 11:50:03,041][123090] Updated weights for policy 1, policy_version 1522688 (0.0010) [2023-12-26 11:50:03,688][123091] Updated weights for policy 0, policy_version 1532730 (0.0010) [2023-12-26 11:50:03,745][123091] Updated weights for policy 0, policy_version 1532740 (0.0009) [2023-12-26 11:50:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 782188544. Throughput: 0: 8789.3, 1: 8821.8. Samples: 782206992. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:03,784][121949] Avg episode reward: [(0, '6333.038'), (1, '5546.350')] [2023-12-26 11:50:03,796][123091] Updated weights for policy 0, policy_version 1532751 (0.0009) [2023-12-26 11:50:03,850][123090] Updated weights for policy 1, policy_version 1522698 (0.0008) [2023-12-26 11:50:03,915][123090] Updated weights for policy 1, policy_version 1522708 (0.0007) [2023-12-26 11:50:03,972][123090] Updated weights for policy 1, policy_version 1522718 (0.0009) [2023-12-26 11:50:04,569][123091] Updated weights for policy 0, policy_version 1532761 (0.0010) [2023-12-26 11:50:04,637][123091] Updated weights for policy 0, policy_version 1532771 (0.0009) [2023-12-26 11:50:04,691][123091] Updated weights for policy 0, policy_version 1532781 (0.0010) [2023-12-26 11:50:04,831][123090] Updated weights for policy 1, policy_version 1522728 (0.0009) [2023-12-26 11:50:04,880][123090] Updated weights for policy 1, policy_version 1522738 (0.0008) [2023-12-26 11:50:04,928][123090] Updated weights for policy 1, policy_version 1522748 (0.0009) [2023-12-26 11:50:05,426][123091] Updated weights for policy 0, policy_version 1532791 (0.0008) [2023-12-26 11:50:05,482][123091] Updated weights for policy 0, policy_version 1532801 (0.0005) [2023-12-26 11:50:05,534][123091] Updated weights for policy 0, policy_version 1532811 (0.0005) [2023-12-26 11:50:05,816][123090] Updated weights for policy 1, policy_version 1522758 (0.0006) [2023-12-26 11:50:05,873][123090] Updated weights for policy 1, policy_version 1522768 (0.0005) [2023-12-26 11:50:05,928][123090] Updated weights for policy 1, policy_version 1522778 (0.0005) [2023-12-26 11:50:06,267][123091] Updated weights for policy 0, policy_version 1532821 (0.0007) [2023-12-26 11:50:06,326][123091] Updated weights for policy 0, policy_version 1532831 (0.0009) [2023-12-26 11:50:06,389][123091] Updated weights for policy 0, policy_version 1532841 (0.0010) [2023-12-26 11:50:06,608][123090] Updated weights for policy 1, policy_version 1522788 (0.0005) [2023-12-26 11:50:06,674][123090] Updated weights for policy 1, policy_version 1522798 (0.0005) [2023-12-26 11:50:06,745][123090] Updated weights for policy 1, policy_version 1522808 (0.0008) [2023-12-26 11:50:07,278][123091] Updated weights for policy 0, policy_version 1532851 (0.0009) [2023-12-26 11:50:07,346][123091] Updated weights for policy 0, policy_version 1532861 (0.0009) [2023-12-26 11:50:07,412][123091] Updated weights for policy 0, policy_version 1532871 (0.0009) [2023-12-26 11:50:07,480][123090] Updated weights for policy 1, policy_version 1522818 (0.0009) [2023-12-26 11:50:07,541][123090] Updated weights for policy 1, policy_version 1522828 (0.0005) [2023-12-26 11:50:07,603][123090] Updated weights for policy 1, policy_version 1522838 (0.0005) [2023-12-26 11:50:07,666][123090] Updated weights for policy 1, policy_version 1522848 (0.0006) [2023-12-26 11:50:08,248][123091] Updated weights for policy 0, policy_version 1532881 (0.0010) [2023-12-26 11:50:08,317][123091] Updated weights for policy 0, policy_version 1532891 (0.0011) [2023-12-26 11:50:08,391][123091] Updated weights for policy 0, policy_version 1532901 (0.0011) [2023-12-26 11:50:08,416][123090] Updated weights for policy 1, policy_version 1522858 (0.0007) [2023-12-26 11:50:08,460][123091] Updated weights for policy 0, policy_version 1532911 (0.0011) [2023-12-26 11:50:08,484][123090] Updated weights for policy 1, policy_version 1522868 (0.0008) [2023-12-26 11:50:08,552][123090] Updated weights for policy 1, policy_version 1522878 (0.0009) [2023-12-26 11:50:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 782286848. Throughput: 0: 8834.1, 1: 8849.6. Samples: 782260392. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:08,785][121949] Avg episode reward: [(0, '6421.950'), (1, '5715.011')] [2023-12-26 11:50:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001532912_392429568.pth... [2023-12-26 11:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001522880_389857280.pth... [2023-12-26 11:50:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001531888_392167424.pth [2023-12-26 11:50:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001521824_389586944.pth [2023-12-26 11:50:09,276][123091] Updated weights for policy 0, policy_version 1532921 (0.0008) [2023-12-26 11:50:09,339][123091] Updated weights for policy 0, policy_version 1532931 (0.0008) [2023-12-26 11:50:09,354][123090] Updated weights for policy 1, policy_version 1522888 (0.0009) [2023-12-26 11:50:09,409][123091] Updated weights for policy 0, policy_version 1532941 (0.0010) [2023-12-26 11:50:09,432][123090] Updated weights for policy 1, policy_version 1522898 (0.0009) [2023-12-26 11:50:09,497][123090] Updated weights for policy 1, policy_version 1522908 (0.0009) [2023-12-26 11:50:10,250][123091] Updated weights for policy 0, policy_version 1532951 (0.0010) [2023-12-26 11:50:10,310][123091] Updated weights for policy 0, policy_version 1532961 (0.0011) [2023-12-26 11:50:10,339][123090] Updated weights for policy 1, policy_version 1522918 (0.0008) [2023-12-26 11:50:10,371][123091] Updated weights for policy 0, policy_version 1532971 (0.0011) [2023-12-26 11:50:10,391][123090] Updated weights for policy 1, policy_version 1522928 (0.0006) [2023-12-26 11:50:10,448][123090] Updated weights for policy 1, policy_version 1522938 (0.0009) [2023-12-26 11:50:11,227][123091] Updated weights for policy 0, policy_version 1532981 (0.0011) [2023-12-26 11:50:11,296][123091] Updated weights for policy 0, policy_version 1532991 (0.0011) [2023-12-26 11:50:11,307][123090] Updated weights for policy 1, policy_version 1522948 (0.0008) [2023-12-26 11:50:11,369][123091] Updated weights for policy 0, policy_version 1533001 (0.0010) [2023-12-26 11:50:11,375][123090] Updated weights for policy 1, policy_version 1522958 (0.0008) [2023-12-26 11:50:11,445][123090] Updated weights for policy 1, policy_version 1522968 (0.0009) [2023-12-26 11:50:12,158][123091] Updated weights for policy 0, policy_version 1533011 (0.0010) [2023-12-26 11:50:12,230][123091] Updated weights for policy 0, policy_version 1533021 (0.0009) [2023-12-26 11:50:12,300][123091] Updated weights for policy 0, policy_version 1533031 (0.0011) [2023-12-26 11:50:12,318][123090] Updated weights for policy 1, policy_version 1522978 (0.0010) [2023-12-26 11:50:12,394][123090] Updated weights for policy 1, policy_version 1522988 (0.0008) [2023-12-26 11:50:12,466][123090] Updated weights for policy 1, policy_version 1522998 (0.0009) [2023-12-26 11:50:12,527][123090] Updated weights for policy 1, policy_version 1523008 (0.0009) [2023-12-26 11:50:13,078][123091] Updated weights for policy 0, policy_version 1533041 (0.0011) [2023-12-26 11:50:13,126][123091] Updated weights for policy 0, policy_version 1533051 (0.0010) [2023-12-26 11:50:13,170][123091] Updated weights for policy 0, policy_version 1533061 (0.0010) [2023-12-26 11:50:13,214][123091] Updated weights for policy 0, policy_version 1533071 (0.0010) [2023-12-26 11:50:13,303][123090] Updated weights for policy 1, policy_version 1523018 (0.0005) [2023-12-26 11:50:13,377][123090] Updated weights for policy 1, policy_version 1523028 (0.0005) [2023-12-26 11:50:13,459][123090] Updated weights for policy 1, policy_version 1523038 (0.0006) [2023-12-26 11:50:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 782368768. Throughput: 0: 8794.0, 1: 8793.6. Samples: 782361492. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:13,785][121949] Avg episode reward: [(0, '6363.694'), (1, '5755.976')] [2023-12-26 11:50:13,956][123091] Updated weights for policy 0, policy_version 1533081 (0.0009) [2023-12-26 11:50:14,011][123091] Updated weights for policy 0, policy_version 1533091 (0.0011) [2023-12-26 11:50:14,057][123090] Updated weights for policy 1, policy_version 1523048 (0.0009) [2023-12-26 11:50:14,070][123091] Updated weights for policy 0, policy_version 1533101 (0.0010) [2023-12-26 11:50:14,121][123090] Updated weights for policy 1, policy_version 1523058 (0.0011) [2023-12-26 11:50:14,191][123090] Updated weights for policy 1, policy_version 1523068 (0.0010) [2023-12-26 11:50:14,906][123090] Updated weights for policy 1, policy_version 1523078 (0.0007) [2023-12-26 11:50:14,919][123091] Updated weights for policy 0, policy_version 1533111 (0.0008) [2023-12-26 11:50:14,973][123090] Updated weights for policy 1, policy_version 1523088 (0.0008) [2023-12-26 11:50:14,983][123091] Updated weights for policy 0, policy_version 1533122 (0.0008) [2023-12-26 11:50:15,037][123090] Updated weights for policy 1, policy_version 1523098 (0.0011) [2023-12-26 11:50:15,048][123091] Updated weights for policy 0, policy_version 1533132 (0.0006) [2023-12-26 11:50:15,832][123091] Updated weights for policy 0, policy_version 1533142 (0.0009) [2023-12-26 11:50:15,835][123090] Updated weights for policy 1, policy_version 1523108 (0.0011) [2023-12-26 11:50:15,891][123091] Updated weights for policy 0, policy_version 1533152 (0.0011) [2023-12-26 11:50:15,898][123090] Updated weights for policy 1, policy_version 1523118 (0.0010) [2023-12-26 11:50:15,942][123090] Updated weights for policy 1, policy_version 1523128 (0.0010) [2023-12-26 11:50:15,954][123091] Updated weights for policy 0, policy_version 1533162 (0.0011) [2023-12-26 11:50:16,741][123091] Updated weights for policy 0, policy_version 1533172 (0.0008) [2023-12-26 11:50:16,779][123090] Updated weights for policy 1, policy_version 1523138 (0.0010) [2023-12-26 11:50:16,805][123091] Updated weights for policy 0, policy_version 1533182 (0.0005) [2023-12-26 11:50:16,834][123090] Updated weights for policy 1, policy_version 1523148 (0.0010) [2023-12-26 11:50:16,859][123091] Updated weights for policy 0, policy_version 1533192 (0.0005) [2023-12-26 11:50:16,887][123090] Updated weights for policy 1, policy_version 1523158 (0.0010) [2023-12-26 11:50:16,953][123090] Updated weights for policy 1, policy_version 1523168 (0.0010) [2023-12-26 11:50:17,546][123091] Updated weights for policy 0, policy_version 1533202 (0.0006) [2023-12-26 11:50:17,598][123091] Updated weights for policy 0, policy_version 1533212 (0.0008) [2023-12-26 11:50:17,658][123091] Updated weights for policy 0, policy_version 1533222 (0.0011) [2023-12-26 11:50:17,706][123091] Updated weights for policy 0, policy_version 1533232 (0.0010) [2023-12-26 11:50:17,795][123090] Updated weights for policy 1, policy_version 1523178 (0.0010) [2023-12-26 11:50:17,861][123090] Updated weights for policy 1, policy_version 1523188 (0.0010) [2023-12-26 11:50:17,927][123090] Updated weights for policy 1, policy_version 1523198 (0.0010) [2023-12-26 11:50:18,509][123091] Updated weights for policy 0, policy_version 1533242 (0.0010) [2023-12-26 11:50:18,564][123091] Updated weights for policy 0, policy_version 1533252 (0.0011) [2023-12-26 11:50:18,625][123091] Updated weights for policy 0, policy_version 1533262 (0.0010) [2023-12-26 11:50:18,725][123090] Updated weights for policy 1, policy_version 1523208 (0.0011) [2023-12-26 11:50:18,773][123090] Updated weights for policy 1, policy_version 1523218 (0.0010) [2023-12-26 11:50:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 782458880. Throughput: 0: 8841.2, 1: 8878.8. Samples: 782470796. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:18,785][121949] Avg episode reward: [(0, '6322.960'), (1, '5691.257')] [2023-12-26 11:50:18,837][123090] Updated weights for policy 1, policy_version 1523228 (0.0009) [2023-12-26 11:50:19,416][123091] Updated weights for policy 0, policy_version 1533273 (0.0012) [2023-12-26 11:50:19,480][123091] Updated weights for policy 0, policy_version 1533283 (0.0009) [2023-12-26 11:50:19,549][123091] Updated weights for policy 0, policy_version 1533293 (0.0011) [2023-12-26 11:50:19,640][123090] Updated weights for policy 1, policy_version 1523238 (0.0009) [2023-12-26 11:50:19,709][123090] Updated weights for policy 1, policy_version 1523248 (0.0009) [2023-12-26 11:50:19,773][123090] Updated weights for policy 1, policy_version 1523258 (0.0009) [2023-12-26 11:50:20,366][123091] Updated weights for policy 0, policy_version 1533303 (0.0008) [2023-12-26 11:50:20,424][123091] Updated weights for policy 0, policy_version 1533313 (0.0006) [2023-12-26 11:50:20,487][123091] Updated weights for policy 0, policy_version 1533323 (0.0006) [2023-12-26 11:50:20,564][123090] Updated weights for policy 1, policy_version 1523268 (0.0008) [2023-12-26 11:50:20,637][123090] Updated weights for policy 1, policy_version 1523278 (0.0007) [2023-12-26 11:50:20,707][123090] Updated weights for policy 1, policy_version 1523288 (0.0007) [2023-12-26 11:50:21,220][123091] Updated weights for policy 0, policy_version 1533333 (0.0008) [2023-12-26 11:50:21,291][123091] Updated weights for policy 0, policy_version 1533343 (0.0011) [2023-12-26 11:50:21,364][123091] Updated weights for policy 0, policy_version 1533353 (0.0011) [2023-12-26 11:50:21,565][123090] Updated weights for policy 1, policy_version 1523298 (0.0008) [2023-12-26 11:50:21,636][123090] Updated weights for policy 1, policy_version 1523308 (0.0008) [2023-12-26 11:50:21,703][123090] Updated weights for policy 1, policy_version 1523318 (0.0008) [2023-12-26 11:50:21,774][123090] Updated weights for policy 1, policy_version 1523328 (0.0007) [2023-12-26 11:50:22,159][123091] Updated weights for policy 0, policy_version 1533363 (0.0009) [2023-12-26 11:50:22,231][123091] Updated weights for policy 0, policy_version 1533373 (0.0005) [2023-12-26 11:50:22,302][123091] Updated weights for policy 0, policy_version 1533383 (0.0009) [2023-12-26 11:50:22,600][123090] Updated weights for policy 1, policy_version 1523338 (0.0009) [2023-12-26 11:50:22,673][123090] Updated weights for policy 1, policy_version 1523348 (0.0009) [2023-12-26 11:50:22,739][123090] Updated weights for policy 1, policy_version 1523358 (0.0008) [2023-12-26 11:50:23,092][123091] Updated weights for policy 0, policy_version 1533393 (0.0011) [2023-12-26 11:50:23,151][123091] Updated weights for policy 0, policy_version 1533403 (0.0010) [2023-12-26 11:50:23,203][123091] Updated weights for policy 0, policy_version 1533413 (0.0010) [2023-12-26 11:50:23,259][123091] Updated weights for policy 0, policy_version 1533423 (0.0010) [2023-12-26 11:50:23,496][123090] Updated weights for policy 1, policy_version 1523368 (0.0010) [2023-12-26 11:50:23,569][123090] Updated weights for policy 1, policy_version 1523378 (0.0010) [2023-12-26 11:50:23,640][123090] Updated weights for policy 1, policy_version 1523388 (0.0010) [2023-12-26 11:50:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 782548992. Throughput: 0: 8838.5, 1: 8842.7. Samples: 782524368. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:23,785][121949] Avg episode reward: [(0, '6325.344'), (1, '5580.928')] [2023-12-26 11:50:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001533424_392560640.pth... [2023-12-26 11:50:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001523392_389988352.pth... [2023-12-26 11:50:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001522368_389726208.pth [2023-12-26 11:50:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001532400_392298496.pth [2023-12-26 11:50:24,082][123091] Updated weights for policy 0, policy_version 1533433 (0.0010) [2023-12-26 11:50:24,133][123091] Updated weights for policy 0, policy_version 1533443 (0.0010) [2023-12-26 11:50:24,196][123091] Updated weights for policy 0, policy_version 1533453 (0.0010) [2023-12-26 11:50:24,432][123090] Updated weights for policy 1, policy_version 1523398 (0.0008) [2023-12-26 11:50:24,496][123090] Updated weights for policy 1, policy_version 1523408 (0.0005) [2023-12-26 11:50:24,561][123090] Updated weights for policy 1, policy_version 1523418 (0.0009) [2023-12-26 11:50:25,030][123091] Updated weights for policy 0, policy_version 1533463 (0.0011) [2023-12-26 11:50:25,092][123091] Updated weights for policy 0, policy_version 1533473 (0.0010) [2023-12-26 11:50:25,155][123091] Updated weights for policy 0, policy_version 1533483 (0.0010) [2023-12-26 11:50:25,273][123090] Updated weights for policy 1, policy_version 1523428 (0.0008) [2023-12-26 11:50:25,339][123090] Updated weights for policy 1, policy_version 1523438 (0.0006) [2023-12-26 11:50:25,399][123090] Updated weights for policy 1, policy_version 1523448 (0.0006) [2023-12-26 11:50:25,957][123091] Updated weights for policy 0, policy_version 1533493 (0.0010) [2023-12-26 11:50:26,015][123091] Updated weights for policy 0, policy_version 1533503 (0.0010) [2023-12-26 11:50:26,062][123090] Updated weights for policy 1, policy_version 1523458 (0.0006) [2023-12-26 11:50:26,072][123091] Updated weights for policy 0, policy_version 1533513 (0.0006) [2023-12-26 11:50:26,124][123090] Updated weights for policy 1, policy_version 1523468 (0.0007) [2023-12-26 11:50:26,181][123090] Updated weights for policy 1, policy_version 1523478 (0.0010) [2023-12-26 11:50:26,240][123090] Updated weights for policy 1, policy_version 1523488 (0.0010) [2023-12-26 11:50:26,757][123091] Updated weights for policy 0, policy_version 1533523 (0.0007) [2023-12-26 11:50:26,824][123091] Updated weights for policy 0, policy_version 1533533 (0.0010) [2023-12-26 11:50:26,897][123091] Updated weights for policy 0, policy_version 1533543 (0.0010) [2023-12-26 11:50:27,011][123090] Updated weights for policy 1, policy_version 1523498 (0.0005) [2023-12-26 11:50:27,062][123090] Updated weights for policy 1, policy_version 1523508 (0.0005) [2023-12-26 11:50:27,127][123090] Updated weights for policy 1, policy_version 1523518 (0.0007) [2023-12-26 11:50:27,601][123091] Updated weights for policy 0, policy_version 1533553 (0.0008) [2023-12-26 11:50:27,654][123091] Updated weights for policy 0, policy_version 1533563 (0.0008) [2023-12-26 11:50:27,704][123091] Updated weights for policy 0, policy_version 1533574 (0.0009) [2023-12-26 11:50:27,763][123091] Updated weights for policy 0, policy_version 1533584 (0.0008) [2023-12-26 11:50:27,798][123090] Updated weights for policy 1, policy_version 1523528 (0.0006) [2023-12-26 11:50:27,858][123090] Updated weights for policy 1, policy_version 1523538 (0.0005) [2023-12-26 11:50:27,913][123090] Updated weights for policy 1, policy_version 1523548 (0.0005) [2023-12-26 11:50:28,526][123091] Updated weights for policy 0, policy_version 1533594 (0.0009) [2023-12-26 11:50:28,592][123091] Updated weights for policy 0, policy_version 1533604 (0.0010) [2023-12-26 11:50:28,594][123090] Updated weights for policy 1, policy_version 1523558 (0.0005) [2023-12-26 11:50:28,653][123090] Updated weights for policy 1, policy_version 1523568 (0.0007) [2023-12-26 11:50:28,654][123091] Updated weights for policy 0, policy_version 1533614 (0.0010) [2023-12-26 11:50:28,718][123090] Updated weights for policy 1, policy_version 1523578 (0.0010) [2023-12-26 11:50:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 782647296. Throughput: 0: 8908.7, 1: 8911.3. Samples: 782633828. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:28,785][121949] Avg episode reward: [(0, '6283.631'), (1, '5634.845')] [2023-12-26 11:50:29,486][123091] Updated weights for policy 0, policy_version 1533624 (0.0009) [2023-12-26 11:50:29,506][123090] Updated weights for policy 1, policy_version 1523588 (0.0009) [2023-12-26 11:50:29,549][123091] Updated weights for policy 0, policy_version 1533634 (0.0010) [2023-12-26 11:50:29,569][123090] Updated weights for policy 1, policy_version 1523598 (0.0007) [2023-12-26 11:50:29,610][123091] Updated weights for policy 0, policy_version 1533644 (0.0008) [2023-12-26 11:50:29,635][123090] Updated weights for policy 1, policy_version 1523608 (0.0010) [2023-12-26 11:50:30,358][123091] Updated weights for policy 0, policy_version 1533654 (0.0008) [2023-12-26 11:50:30,421][123091] Updated weights for policy 0, policy_version 1533664 (0.0010) [2023-12-26 11:50:30,454][123090] Updated weights for policy 1, policy_version 1523618 (0.0009) [2023-12-26 11:50:30,478][123091] Updated weights for policy 0, policy_version 1533674 (0.0010) [2023-12-26 11:50:30,510][123090] Updated weights for policy 1, policy_version 1523628 (0.0005) [2023-12-26 11:50:30,575][123090] Updated weights for policy 1, policy_version 1523638 (0.0005) [2023-12-26 11:50:30,640][123090] Updated weights for policy 1, policy_version 1523648 (0.0005) [2023-12-26 11:50:31,159][123091] Updated weights for policy 0, policy_version 1533684 (0.0006) [2023-12-26 11:50:31,191][123090] Updated weights for policy 1, policy_version 1523659 (0.0007) [2023-12-26 11:50:31,214][123091] Updated weights for policy 0, policy_version 1533694 (0.0008) [2023-12-26 11:50:31,253][123090] Updated weights for policy 1, policy_version 1523669 (0.0008) [2023-12-26 11:50:31,280][123091] Updated weights for policy 0, policy_version 1533704 (0.0008) [2023-12-26 11:50:31,315][123090] Updated weights for policy 1, policy_version 1523679 (0.0008) [2023-12-26 11:50:32,104][123091] Updated weights for policy 0, policy_version 1533714 (0.0008) [2023-12-26 11:50:32,158][123090] Updated weights for policy 1, policy_version 1523689 (0.0008) [2023-12-26 11:50:32,172][123091] Updated weights for policy 0, policy_version 1533724 (0.0008) [2023-12-26 11:50:32,216][123090] Updated weights for policy 1, policy_version 1523699 (0.0009) [2023-12-26 11:50:32,223][123091] Updated weights for policy 0, policy_version 1533734 (0.0008) [2023-12-26 11:50:32,285][123091] Updated weights for policy 0, policy_version 1533744 (0.0008) [2023-12-26 11:50:32,287][123090] Updated weights for policy 1, policy_version 1523709 (0.0008) [2023-12-26 11:50:33,105][123090] Updated weights for policy 1, policy_version 1523719 (0.0006) [2023-12-26 11:50:33,112][123091] Updated weights for policy 0, policy_version 1533754 (0.0005) [2023-12-26 11:50:33,156][123090] Updated weights for policy 1, policy_version 1523729 (0.0009) [2023-12-26 11:50:33,158][123091] Updated weights for policy 0, policy_version 1533764 (0.0006) [2023-12-26 11:50:33,205][123090] Updated weights for policy 1, policy_version 1523739 (0.0008) [2023-12-26 11:50:33,212][123091] Updated weights for policy 0, policy_version 1533774 (0.0005) [2023-12-26 11:50:33,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 782729216. Throughput: 0: 8997.6, 1: 8887.1. Samples: 782742712. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:33,785][121949] Avg episode reward: [(0, '6307.346'), (1, '5581.805')] [2023-12-26 11:50:33,901][123091] Updated weights for policy 0, policy_version 1533784 (0.0006) [2023-12-26 11:50:33,955][123091] Updated weights for policy 0, policy_version 1533794 (0.0006) [2023-12-26 11:50:34,006][123091] Updated weights for policy 0, policy_version 1533804 (0.0005) [2023-12-26 11:50:34,042][123090] Updated weights for policy 1, policy_version 1523749 (0.0010) [2023-12-26 11:50:34,115][123090] Updated weights for policy 1, policy_version 1523759 (0.0010) [2023-12-26 11:50:34,184][123090] Updated weights for policy 1, policy_version 1523769 (0.0011) [2023-12-26 11:50:34,744][123091] Updated weights for policy 0, policy_version 1533814 (0.0008) [2023-12-26 11:50:34,795][123091] Updated weights for policy 0, policy_version 1533824 (0.0010) [2023-12-26 11:50:34,843][123091] Updated weights for policy 0, policy_version 1533834 (0.0005) [2023-12-26 11:50:35,036][123090] Updated weights for policy 1, policy_version 1523779 (0.0009) [2023-12-26 11:50:35,093][123090] Updated weights for policy 1, policy_version 1523789 (0.0005) [2023-12-26 11:50:35,164][123090] Updated weights for policy 1, policy_version 1523799 (0.0005) [2023-12-26 11:50:35,584][123091] Updated weights for policy 0, policy_version 1533844 (0.0005) [2023-12-26 11:50:35,635][123091] Updated weights for policy 0, policy_version 1533854 (0.0007) [2023-12-26 11:50:35,693][123091] Updated weights for policy 0, policy_version 1533864 (0.0010) [2023-12-26 11:50:35,824][123090] Updated weights for policy 1, policy_version 1523809 (0.0006) [2023-12-26 11:50:35,883][123090] Updated weights for policy 1, policy_version 1523819 (0.0005) [2023-12-26 11:50:35,933][123090] Updated weights for policy 1, policy_version 1523829 (0.0009) [2023-12-26 11:50:35,981][123090] Updated weights for policy 1, policy_version 1523839 (0.0010) [2023-12-26 11:50:36,489][123091] Updated weights for policy 0, policy_version 1533874 (0.0010) [2023-12-26 11:50:36,545][123091] Updated weights for policy 0, policy_version 1533884 (0.0009) [2023-12-26 11:50:36,602][123091] Updated weights for policy 0, policy_version 1533894 (0.0009) [2023-12-26 11:50:36,656][123091] Updated weights for policy 0, policy_version 1533904 (0.0009) [2023-12-26 11:50:36,839][123090] Updated weights for policy 1, policy_version 1523849 (0.0010) [2023-12-26 11:50:36,902][123090] Updated weights for policy 1, policy_version 1523859 (0.0011) [2023-12-26 11:50:36,962][123090] Updated weights for policy 1, policy_version 1523869 (0.0010) [2023-12-26 11:50:37,513][123091] Updated weights for policy 0, policy_version 1533914 (0.0006) [2023-12-26 11:50:37,589][123091] Updated weights for policy 0, policy_version 1533924 (0.0006) [2023-12-26 11:50:37,654][123091] Updated weights for policy 0, policy_version 1533934 (0.0009) [2023-12-26 11:50:37,790][123090] Updated weights for policy 1, policy_version 1523879 (0.0010) [2023-12-26 11:50:37,847][123090] Updated weights for policy 1, policy_version 1523889 (0.0011) [2023-12-26 11:50:37,901][123090] Updated weights for policy 1, policy_version 1523899 (0.0011) [2023-12-26 11:50:38,306][123091] Updated weights for policy 0, policy_version 1533944 (0.0007) [2023-12-26 11:50:38,377][123091] Updated weights for policy 0, policy_version 1533954 (0.0007) [2023-12-26 11:50:38,450][123091] Updated weights for policy 0, policy_version 1533964 (0.0006) [2023-12-26 11:50:38,729][123090] Updated weights for policy 1, policy_version 1523909 (0.0011) [2023-12-26 11:50:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 782819328. Throughput: 0: 9018.7, 1: 8928.5. Samples: 782798304. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:38,785][121949] Avg episode reward: [(0, '6312.730'), (1, '5624.311')] [2023-12-26 11:50:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001533968_392699904.pth... [2023-12-26 11:50:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001532912_392429568.pth [2023-12-26 11:50:38,794][123090] Updated weights for policy 1, policy_version 1523919 (0.0010) [2023-12-26 11:50:38,856][123090] Updated weights for policy 1, policy_version 1523929 (0.0011) [2023-12-26 11:50:38,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001523936_390127616.pth... [2023-12-26 11:50:38,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001522880_389857280.pth [2023-12-26 11:50:39,196][123091] Updated weights for policy 0, policy_version 1533974 (0.0009) [2023-12-26 11:50:39,270][123091] Updated weights for policy 0, policy_version 1533984 (0.0011) [2023-12-26 11:50:39,340][123091] Updated weights for policy 0, policy_version 1533994 (0.0010) [2023-12-26 11:50:39,737][123090] Updated weights for policy 1, policy_version 1523939 (0.0010) [2023-12-26 11:50:39,806][123090] Updated weights for policy 1, policy_version 1523949 (0.0010) [2023-12-26 11:50:39,877][123090] Updated weights for policy 1, policy_version 1523959 (0.0010) [2023-12-26 11:50:40,150][123091] Updated weights for policy 0, policy_version 1534004 (0.0011) [2023-12-26 11:50:40,219][123091] Updated weights for policy 0, policy_version 1534014 (0.0010) [2023-12-26 11:50:40,269][123091] Updated weights for policy 0, policy_version 1534024 (0.0009) [2023-12-26 11:50:40,704][123090] Updated weights for policy 1, policy_version 1523969 (0.0010) [2023-12-26 11:50:40,768][123090] Updated weights for policy 1, policy_version 1523979 (0.0010) [2023-12-26 11:50:40,839][123090] Updated weights for policy 1, policy_version 1523989 (0.0009) [2023-12-26 11:50:40,901][123090] Updated weights for policy 1, policy_version 1523999 (0.0009) [2023-12-26 11:50:41,095][123091] Updated weights for policy 0, policy_version 1534034 (0.0010) [2023-12-26 11:50:41,163][123091] Updated weights for policy 0, policy_version 1534044 (0.0010) [2023-12-26 11:50:41,229][123091] Updated weights for policy 0, policy_version 1534054 (0.0006) [2023-12-26 11:50:41,298][123091] Updated weights for policy 0, policy_version 1534064 (0.0009) [2023-12-26 11:50:41,828][123090] Updated weights for policy 1, policy_version 1524009 (0.0010) [2023-12-26 11:50:41,895][123090] Updated weights for policy 1, policy_version 1524019 (0.0009) [2023-12-26 11:50:41,963][123090] Updated weights for policy 1, policy_version 1524029 (0.0009) [2023-12-26 11:50:42,144][123091] Updated weights for policy 0, policy_version 1534074 (0.0010) [2023-12-26 11:50:42,207][123091] Updated weights for policy 0, policy_version 1534084 (0.0009) [2023-12-26 11:50:42,271][123091] Updated weights for policy 0, policy_version 1534094 (0.0010) [2023-12-26 11:50:42,789][123090] Updated weights for policy 1, policy_version 1524039 (0.0010) [2023-12-26 11:50:42,841][123090] Updated weights for policy 1, policy_version 1524049 (0.0009) [2023-12-26 11:50:42,906][123090] Updated weights for policy 1, policy_version 1524059 (0.0009) [2023-12-26 11:50:43,112][123091] Updated weights for policy 0, policy_version 1534104 (0.0008) [2023-12-26 11:50:43,174][123091] Updated weights for policy 0, policy_version 1534114 (0.0010) [2023-12-26 11:50:43,235][123091] Updated weights for policy 0, policy_version 1534124 (0.0010) [2023-12-26 11:50:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 782901248. Throughput: 0: 8992.1, 1: 8802.5. Samples: 782899672. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:43,784][121949] Avg episode reward: [(0, '6344.771'), (1, '5788.695')] [2023-12-26 11:50:43,794][123090] Updated weights for policy 1, policy_version 1524069 (0.0009) [2023-12-26 11:50:43,849][123090] Updated weights for policy 1, policy_version 1524079 (0.0010) [2023-12-26 11:50:43,899][123091] Updated weights for policy 0, policy_version 1534134 (0.0009) [2023-12-26 11:50:43,908][123090] Updated weights for policy 1, policy_version 1524089 (0.0007) [2023-12-26 11:50:43,951][123091] Updated weights for policy 0, policy_version 1534144 (0.0009) [2023-12-26 11:50:44,002][123091] Updated weights for policy 0, policy_version 1534154 (0.0009) [2023-12-26 11:50:44,652][123090] Updated weights for policy 1, policy_version 1524099 (0.0007) [2023-12-26 11:50:44,703][123090] Updated weights for policy 1, policy_version 1524109 (0.0010) [2023-12-26 11:50:44,765][123090] Updated weights for policy 1, policy_version 1524119 (0.0011) [2023-12-26 11:50:44,895][123091] Updated weights for policy 0, policy_version 1534165 (0.0008) [2023-12-26 11:50:44,970][123091] Updated weights for policy 0, policy_version 1534175 (0.0006) [2023-12-26 11:50:45,031][123091] Updated weights for policy 0, policy_version 1534185 (0.0010) [2023-12-26 11:50:45,495][123090] Updated weights for policy 1, policy_version 1524129 (0.0010) [2023-12-26 11:50:45,561][123090] Updated weights for policy 1, policy_version 1524139 (0.0005) [2023-12-26 11:50:45,630][123090] Updated weights for policy 1, policy_version 1524149 (0.0005) [2023-12-26 11:50:45,693][123090] Updated weights for policy 1, policy_version 1524159 (0.0005) [2023-12-26 11:50:45,879][123091] Updated weights for policy 0, policy_version 1534195 (0.0010) [2023-12-26 11:50:45,941][123091] Updated weights for policy 0, policy_version 1534205 (0.0010) [2023-12-26 11:50:46,010][123091] Updated weights for policy 0, policy_version 1534215 (0.0009) [2023-12-26 11:50:46,314][123090] Updated weights for policy 1, policy_version 1524169 (0.0007) [2023-12-26 11:50:46,378][123090] Updated weights for policy 1, policy_version 1524179 (0.0008) [2023-12-26 11:50:46,430][123090] Updated weights for policy 1, policy_version 1524189 (0.0010) [2023-12-26 11:50:46,882][123091] Updated weights for policy 0, policy_version 1534225 (0.0010) [2023-12-26 11:50:46,946][123091] Updated weights for policy 0, policy_version 1534235 (0.0010) [2023-12-26 11:50:47,007][123091] Updated weights for policy 0, policy_version 1534245 (0.0009) [2023-12-26 11:50:47,062][123091] Updated weights for policy 0, policy_version 1534255 (0.0009) [2023-12-26 11:50:47,172][123090] Updated weights for policy 1, policy_version 1524199 (0.0007) [2023-12-26 11:50:47,221][123090] Updated weights for policy 1, policy_version 1524209 (0.0005) [2023-12-26 11:50:47,275][123090] Updated weights for policy 1, policy_version 1524219 (0.0005) [2023-12-26 11:50:47,952][123091] Updated weights for policy 0, policy_version 1534265 (0.0010) [2023-12-26 11:50:47,999][123090] Updated weights for policy 1, policy_version 1524229 (0.0007) [2023-12-26 11:50:48,012][123091] Updated weights for policy 0, policy_version 1534275 (0.0007) [2023-12-26 11:50:48,059][123090] Updated weights for policy 1, policy_version 1524239 (0.0009) [2023-12-26 11:50:48,080][123091] Updated weights for policy 0, policy_version 1534285 (0.0008) [2023-12-26 11:50:48,119][123090] Updated weights for policy 1, policy_version 1524249 (0.0010) [2023-12-26 11:50:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 782991360. Throughput: 0: 8881.5, 1: 8904.3. Samples: 783007352. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:48,785][121949] Avg episode reward: [(0, '6314.570'), (1, '5830.886')] [2023-12-26 11:50:48,897][123091] Updated weights for policy 0, policy_version 1534295 (0.0009) [2023-12-26 11:50:48,950][123090] Updated weights for policy 1, policy_version 1524260 (0.0008) [2023-12-26 11:50:48,957][123091] Updated weights for policy 0, policy_version 1534305 (0.0009) [2023-12-26 11:50:49,002][123091] Updated weights for policy 0, policy_version 1534315 (0.0007) [2023-12-26 11:50:49,014][123090] Updated weights for policy 1, policy_version 1524270 (0.0009) [2023-12-26 11:50:49,081][123090] Updated weights for policy 1, policy_version 1524280 (0.0010) [2023-12-26 11:50:49,880][123091] Updated weights for policy 0, policy_version 1534325 (0.0007) [2023-12-26 11:50:49,936][123090] Updated weights for policy 1, policy_version 1524290 (0.0008) [2023-12-26 11:50:49,948][123091] Updated weights for policy 0, policy_version 1534335 (0.0007) [2023-12-26 11:50:50,007][123090] Updated weights for policy 1, policy_version 1524300 (0.0009) [2023-12-26 11:50:50,017][123091] Updated weights for policy 0, policy_version 1534345 (0.0006) [2023-12-26 11:50:50,071][123090] Updated weights for policy 1, policy_version 1524310 (0.0008) [2023-12-26 11:50:50,131][123090] Updated weights for policy 1, policy_version 1524320 (0.0010) [2023-12-26 11:50:50,738][123091] Updated weights for policy 0, policy_version 1534355 (0.0008) [2023-12-26 11:50:50,801][123091] Updated weights for policy 0, policy_version 1534365 (0.0007) [2023-12-26 11:50:50,870][123091] Updated weights for policy 0, policy_version 1534375 (0.0005) [2023-12-26 11:50:50,895][123090] Updated weights for policy 1, policy_version 1524330 (0.0011) [2023-12-26 11:50:50,951][123090] Updated weights for policy 1, policy_version 1524340 (0.0007) [2023-12-26 11:50:51,007][123090] Updated weights for policy 1, policy_version 1524350 (0.0011) [2023-12-26 11:50:51,648][123091] Updated weights for policy 0, policy_version 1534385 (0.0006) [2023-12-26 11:50:51,706][123091] Updated weights for policy 0, policy_version 1534395 (0.0007) [2023-12-26 11:50:51,781][123091] Updated weights for policy 0, policy_version 1534405 (0.0009) [2023-12-26 11:50:51,837][123090] Updated weights for policy 1, policy_version 1524360 (0.0008) [2023-12-26 11:50:51,847][123091] Updated weights for policy 0, policy_version 1534415 (0.0008) [2023-12-26 11:50:51,905][123090] Updated weights for policy 1, policy_version 1524370 (0.0007) [2023-12-26 11:50:51,971][123090] Updated weights for policy 1, policy_version 1524380 (0.0009) [2023-12-26 11:50:52,634][123091] Updated weights for policy 0, policy_version 1534425 (0.0005) [2023-12-26 11:50:52,685][123090] Updated weights for policy 1, policy_version 1524390 (0.0006) [2023-12-26 11:50:52,690][123091] Updated weights for policy 0, policy_version 1534435 (0.0005) [2023-12-26 11:50:52,745][123090] Updated weights for policy 1, policy_version 1524400 (0.0005) [2023-12-26 11:50:52,750][123091] Updated weights for policy 0, policy_version 1534445 (0.0006) [2023-12-26 11:50:52,795][123090] Updated weights for policy 1, policy_version 1524410 (0.0005) [2023-12-26 11:50:53,360][123091] Updated weights for policy 0, policy_version 1534455 (0.0005) [2023-12-26 11:50:53,418][123091] Updated weights for policy 0, policy_version 1534465 (0.0007) [2023-12-26 11:50:53,477][123091] Updated weights for policy 0, policy_version 1534475 (0.0008) [2023-12-26 11:50:53,487][123090] Updated weights for policy 1, policy_version 1524420 (0.0007) [2023-12-26 11:50:53,546][123090] Updated weights for policy 1, policy_version 1524430 (0.0010) [2023-12-26 11:50:53,609][123090] Updated weights for policy 1, policy_version 1524440 (0.0010) [2023-12-26 11:50:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 783089664. Throughput: 0: 8864.6, 1: 8877.8. Samples: 783058800. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:53,785][121949] Avg episode reward: [(0, '6138.830'), (1, '5812.879')] [2023-12-26 11:50:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001524448_390258688.pth... [2023-12-26 11:50:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001534480_392830976.pth... [2023-12-26 11:50:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001523392_389988352.pth [2023-12-26 11:50:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001533424_392560640.pth [2023-12-26 11:50:54,299][123090] Updated weights for policy 1, policy_version 1524450 (0.0009) [2023-12-26 11:50:54,311][123091] Updated weights for policy 0, policy_version 1534485 (0.0008) [2023-12-26 11:50:54,349][123090] Updated weights for policy 1, policy_version 1524460 (0.0005) [2023-12-26 11:50:54,368][123091] Updated weights for policy 0, policy_version 1534495 (0.0009) [2023-12-26 11:50:54,403][123090] Updated weights for policy 1, policy_version 1524470 (0.0005) [2023-12-26 11:50:54,429][123091] Updated weights for policy 0, policy_version 1534505 (0.0009) [2023-12-26 11:50:54,466][123090] Updated weights for policy 1, policy_version 1524480 (0.0007) [2023-12-26 11:50:55,233][123090] Updated weights for policy 1, policy_version 1524490 (0.0010) [2023-12-26 11:50:55,286][123091] Updated weights for policy 0, policy_version 1534515 (0.0009) [2023-12-26 11:50:55,302][123090] Updated weights for policy 1, policy_version 1524500 (0.0006) [2023-12-26 11:50:55,355][123091] Updated weights for policy 0, policy_version 1534525 (0.0008) [2023-12-26 11:50:55,370][123090] Updated weights for policy 1, policy_version 1524510 (0.0008) [2023-12-26 11:50:55,419][123091] Updated weights for policy 0, policy_version 1534535 (0.0009) [2023-12-26 11:50:56,073][123090] Updated weights for policy 1, policy_version 1524520 (0.0006) [2023-12-26 11:50:56,122][123090] Updated weights for policy 1, policy_version 1524530 (0.0005) [2023-12-26 11:50:56,171][123090] Updated weights for policy 1, policy_version 1524540 (0.0005) [2023-12-26 11:50:56,296][123091] Updated weights for policy 0, policy_version 1534545 (0.0010) [2023-12-26 11:50:56,350][123091] Updated weights for policy 0, policy_version 1534555 (0.0009) [2023-12-26 11:50:56,406][123091] Updated weights for policy 0, policy_version 1534566 (0.0009) [2023-12-26 11:50:56,454][123091] Updated weights for policy 0, policy_version 1534576 (0.0009) [2023-12-26 11:50:56,951][123090] Updated weights for policy 1, policy_version 1524550 (0.0008) [2023-12-26 11:50:57,003][123090] Updated weights for policy 1, policy_version 1524560 (0.0009) [2023-12-26 11:50:57,055][123090] Updated weights for policy 1, policy_version 1524570 (0.0009) [2023-12-26 11:50:57,318][123091] Updated weights for policy 0, policy_version 1534586 (0.0009) [2023-12-26 11:50:57,379][123091] Updated weights for policy 0, policy_version 1534596 (0.0010) [2023-12-26 11:50:57,434][123091] Updated weights for policy 0, policy_version 1534607 (0.0010) [2023-12-26 11:50:57,745][123090] Updated weights for policy 1, policy_version 1524580 (0.0007) [2023-12-26 11:50:57,807][123090] Updated weights for policy 1, policy_version 1524590 (0.0005) [2023-12-26 11:50:57,852][123090] Updated weights for policy 1, policy_version 1524600 (0.0005) [2023-12-26 11:50:58,367][123091] Updated weights for policy 0, policy_version 1534617 (0.0007) [2023-12-26 11:50:58,438][123091] Updated weights for policy 0, policy_version 1534627 (0.0008) [2023-12-26 11:50:58,504][123091] Updated weights for policy 0, policy_version 1534637 (0.0008) [2023-12-26 11:50:58,625][123090] Updated weights for policy 1, policy_version 1524610 (0.0006) [2023-12-26 11:50:58,703][123090] Updated weights for policy 1, policy_version 1524620 (0.0010) [2023-12-26 11:50:58,771][123090] Updated weights for policy 1, policy_version 1524630 (0.0011) [2023-12-26 11:50:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 783171584. Throughput: 0: 8891.2, 1: 9039.2. Samples: 783168360. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:50:58,785][121949] Avg episode reward: [(0, '6205.302'), (1, '5843.673')] [2023-12-26 11:50:58,843][123090] Updated weights for policy 1, policy_version 1524640 (0.0011) [2023-12-26 11:50:59,256][123091] Updated weights for policy 0, policy_version 1534647 (0.0009) [2023-12-26 11:50:59,311][123091] Updated weights for policy 0, policy_version 1534657 (0.0010) [2023-12-26 11:50:59,368][123091] Updated weights for policy 0, policy_version 1534667 (0.0009) [2023-12-26 11:50:59,543][123090] Updated weights for policy 1, policy_version 1524650 (0.0007) [2023-12-26 11:50:59,593][123090] Updated weights for policy 1, policy_version 1524660 (0.0005) [2023-12-26 11:50:59,645][123090] Updated weights for policy 1, policy_version 1524670 (0.0005) [2023-12-26 11:51:00,034][123091] Updated weights for policy 0, policy_version 1534677 (0.0010) [2023-12-26 11:51:00,105][123091] Updated weights for policy 0, policy_version 1534687 (0.0011) [2023-12-26 11:51:00,172][123091] Updated weights for policy 0, policy_version 1534697 (0.0011) [2023-12-26 11:51:00,291][123090] Updated weights for policy 1, policy_version 1524680 (0.0008) [2023-12-26 11:51:00,349][123090] Updated weights for policy 1, policy_version 1524690 (0.0009) [2023-12-26 11:51:00,408][123090] Updated weights for policy 1, policy_version 1524700 (0.0010) [2023-12-26 11:51:00,869][123091] Updated weights for policy 0, policy_version 1534707 (0.0009) [2023-12-26 11:51:00,926][123091] Updated weights for policy 0, policy_version 1534717 (0.0005) [2023-12-26 11:51:00,978][123091] Updated weights for policy 0, policy_version 1534727 (0.0006) [2023-12-26 11:51:01,273][123090] Updated weights for policy 1, policy_version 1524710 (0.0009) [2023-12-26 11:51:01,324][123090] Updated weights for policy 1, policy_version 1524720 (0.0009) [2023-12-26 11:51:01,391][123090] Updated weights for policy 1, policy_version 1524730 (0.0009) [2023-12-26 11:51:01,757][123091] Updated weights for policy 0, policy_version 1534737 (0.0010) [2023-12-26 11:51:01,821][123091] Updated weights for policy 0, policy_version 1534747 (0.0009) [2023-12-26 11:51:01,883][123091] Updated weights for policy 0, policy_version 1534757 (0.0010) [2023-12-26 11:51:01,953][123091] Updated weights for policy 0, policy_version 1534767 (0.0009) [2023-12-26 11:51:02,208][123090] Updated weights for policy 1, policy_version 1524740 (0.0008) [2023-12-26 11:51:02,288][123090] Updated weights for policy 1, policy_version 1524750 (0.0006) [2023-12-26 11:51:02,365][123090] Updated weights for policy 1, policy_version 1524760 (0.0007) [2023-12-26 11:51:02,806][123091] Updated weights for policy 0, policy_version 1534777 (0.0006) [2023-12-26 11:51:02,867][123091] Updated weights for policy 0, policy_version 1534787 (0.0006) [2023-12-26 11:51:02,916][123091] Updated weights for policy 0, policy_version 1534797 (0.0006) [2023-12-26 11:51:03,134][123090] Updated weights for policy 1, policy_version 1524770 (0.0007) [2023-12-26 11:51:03,194][123090] Updated weights for policy 1, policy_version 1524780 (0.0008) [2023-12-26 11:51:03,251][123090] Updated weights for policy 1, policy_version 1524790 (0.0005) [2023-12-26 11:51:03,299][123090] Updated weights for policy 1, policy_version 1524800 (0.0005) [2023-12-26 11:51:03,583][123091] Updated weights for policy 0, policy_version 1534807 (0.0005) [2023-12-26 11:51:03,628][123091] Updated weights for policy 0, policy_version 1534817 (0.0005) [2023-12-26 11:51:03,675][123091] Updated weights for policy 0, policy_version 1534827 (0.0005) [2023-12-26 11:51:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 783269888. Throughput: 0: 8909.7, 1: 9047.0. Samples: 783278848. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:03,785][121949] Avg episode reward: [(0, '6220.373'), (1, '5811.631')] [2023-12-26 11:51:03,997][123090] Updated weights for policy 1, policy_version 1524810 (0.0010) [2023-12-26 11:51:04,053][123090] Updated weights for policy 1, policy_version 1524820 (0.0007) [2023-12-26 11:51:04,117][123090] Updated weights for policy 1, policy_version 1524830 (0.0009) [2023-12-26 11:51:04,444][123091] Updated weights for policy 0, policy_version 1534837 (0.0007) [2023-12-26 11:51:04,515][123091] Updated weights for policy 0, policy_version 1534847 (0.0009) [2023-12-26 11:51:04,579][123091] Updated weights for policy 0, policy_version 1534857 (0.0008) [2023-12-26 11:51:04,977][123090] Updated weights for policy 1, policy_version 1524840 (0.0009) [2023-12-26 11:51:05,034][123090] Updated weights for policy 1, policy_version 1524850 (0.0008) [2023-12-26 11:51:05,087][123090] Updated weights for policy 1, policy_version 1524860 (0.0008) [2023-12-26 11:51:05,349][123091] Updated weights for policy 0, policy_version 1534867 (0.0007) [2023-12-26 11:51:05,421][123091] Updated weights for policy 0, policy_version 1534877 (0.0010) [2023-12-26 11:51:05,488][123091] Updated weights for policy 0, policy_version 1534887 (0.0008) [2023-12-26 11:51:05,922][123090] Updated weights for policy 1, policy_version 1524870 (0.0009) [2023-12-26 11:51:05,970][123090] Updated weights for policy 1, policy_version 1524880 (0.0009) [2023-12-26 11:51:06,019][123090] Updated weights for policy 1, policy_version 1524890 (0.0008) [2023-12-26 11:51:06,252][123091] Updated weights for policy 0, policy_version 1534897 (0.0009) [2023-12-26 11:51:06,308][123091] Updated weights for policy 0, policy_version 1534907 (0.0010) [2023-12-26 11:51:06,367][123091] Updated weights for policy 0, policy_version 1534917 (0.0008) [2023-12-26 11:51:06,434][123091] Updated weights for policy 0, policy_version 1534927 (0.0006) [2023-12-26 11:51:06,892][123090] Updated weights for policy 1, policy_version 1524900 (0.0009) [2023-12-26 11:51:06,942][123090] Updated weights for policy 1, policy_version 1524910 (0.0009) [2023-12-26 11:51:06,992][123090] Updated weights for policy 1, policy_version 1524920 (0.0006) [2023-12-26 11:51:07,247][123091] Updated weights for policy 0, policy_version 1534937 (0.0010) [2023-12-26 11:51:07,317][123091] Updated weights for policy 0, policy_version 1534947 (0.0011) [2023-12-26 11:51:07,383][123091] Updated weights for policy 0, policy_version 1534957 (0.0007) [2023-12-26 11:51:07,865][123090] Updated weights for policy 1, policy_version 1524930 (0.0007) [2023-12-26 11:51:07,928][123090] Updated weights for policy 1, policy_version 1524940 (0.0010) [2023-12-26 11:51:07,993][123090] Updated weights for policy 1, policy_version 1524950 (0.0009) [2023-12-26 11:51:08,050][123090] Updated weights for policy 1, policy_version 1524960 (0.0009) [2023-12-26 11:51:08,051][123091] Updated weights for policy 0, policy_version 1534967 (0.0006) [2023-12-26 11:51:08,103][123091] Updated weights for policy 0, policy_version 1534977 (0.0005) [2023-12-26 11:51:08,155][123091] Updated weights for policy 0, policy_version 1534987 (0.0005) [2023-12-26 11:51:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 783351808. Throughput: 0: 8906.4, 1: 9038.6. Samples: 783331896. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:08,785][121949] Avg episode reward: [(0, '6272.247'), (1, '5895.569')] [2023-12-26 11:51:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001534992_392962048.pth... [2023-12-26 11:51:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001533968_392699904.pth [2023-12-26 11:51:08,818][123090] Updated weights for policy 1, policy_version 1524970 (0.0009) [2023-12-26 11:51:08,876][123090] Updated weights for policy 1, policy_version 1524980 (0.0008) [2023-12-26 11:51:08,881][123091] Updated weights for policy 0, policy_version 1534997 (0.0007) [2023-12-26 11:51:08,937][123091] Updated weights for policy 0, policy_version 1535007 (0.0008) [2023-12-26 11:51:08,939][123090] Updated weights for policy 1, policy_version 1524990 (0.0008) [2023-12-26 11:51:08,950][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001524992_390397952.pth... [2023-12-26 11:51:08,954][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001523936_390127616.pth [2023-12-26 11:51:08,991][123091] Updated weights for policy 0, policy_version 1535017 (0.0006) [2023-12-26 11:51:09,767][123091] Updated weights for policy 0, policy_version 1535027 (0.0006) [2023-12-26 11:51:09,770][123090] Updated weights for policy 1, policy_version 1525000 (0.0008) [2023-12-26 11:51:09,838][123091] Updated weights for policy 0, policy_version 1535037 (0.0008) [2023-12-26 11:51:09,840][123090] Updated weights for policy 1, policy_version 1525010 (0.0008) [2023-12-26 11:51:09,908][123091] Updated weights for policy 0, policy_version 1535047 (0.0008) [2023-12-26 11:51:09,913][123090] Updated weights for policy 1, policy_version 1525020 (0.0008) [2023-12-26 11:51:10,714][123090] Updated weights for policy 1, policy_version 1525030 (0.0006) [2023-12-26 11:51:10,746][123091] Updated weights for policy 0, policy_version 1535057 (0.0009) [2023-12-26 11:51:10,773][123090] Updated weights for policy 1, policy_version 1525040 (0.0006) [2023-12-26 11:51:10,798][123091] Updated weights for policy 0, policy_version 1535067 (0.0008) [2023-12-26 11:51:10,842][123090] Updated weights for policy 1, policy_version 1525050 (0.0008) [2023-12-26 11:51:10,855][123091] Updated weights for policy 0, policy_version 1535077 (0.0007) [2023-12-26 11:51:10,921][123091] Updated weights for policy 0, policy_version 1535087 (0.0006) [2023-12-26 11:51:11,641][123091] Updated weights for policy 0, policy_version 1535097 (0.0007) [2023-12-26 11:51:11,649][123090] Updated weights for policy 1, policy_version 1525060 (0.0009) [2023-12-26 11:51:11,708][123091] Updated weights for policy 0, policy_version 1535107 (0.0008) [2023-12-26 11:51:11,714][123090] Updated weights for policy 1, policy_version 1525070 (0.0008) [2023-12-26 11:51:11,781][123091] Updated weights for policy 0, policy_version 1535117 (0.0009) [2023-12-26 11:51:11,784][123090] Updated weights for policy 1, policy_version 1525080 (0.0007) [2023-12-26 11:51:12,518][123091] Updated weights for policy 0, policy_version 1535127 (0.0009) [2023-12-26 11:51:12,572][123091] Updated weights for policy 0, policy_version 1535137 (0.0009) [2023-12-26 11:51:12,604][123090] Updated weights for policy 1, policy_version 1525090 (0.0007) [2023-12-26 11:51:12,623][123091] Updated weights for policy 0, policy_version 1535147 (0.0009) [2023-12-26 11:51:12,682][123090] Updated weights for policy 1, policy_version 1525100 (0.0009) [2023-12-26 11:51:12,738][123090] Updated weights for policy 1, policy_version 1525110 (0.0010) [2023-12-26 11:51:12,797][123090] Updated weights for policy 1, policy_version 1525120 (0.0010) [2023-12-26 11:51:13,512][123091] Updated weights for policy 0, policy_version 1535157 (0.0009) [2023-12-26 11:51:13,580][123091] Updated weights for policy 0, policy_version 1535167 (0.0009) [2023-12-26 11:51:13,604][123090] Updated weights for policy 1, policy_version 1525130 (0.0009) [2023-12-26 11:51:13,640][123091] Updated weights for policy 0, policy_version 1535177 (0.0009) [2023-12-26 11:51:13,665][123090] Updated weights for policy 1, policy_version 1525140 (0.0007) [2023-12-26 11:51:13,734][123090] Updated weights for policy 1, policy_version 1525150 (0.0009) [2023-12-26 11:51:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 783450112. Throughput: 0: 8921.8, 1: 8965.3. Samples: 783438744. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:13,784][121949] Avg episode reward: [(0, '6296.011'), (1, '5925.323')] [2023-12-26 11:51:14,464][123091] Updated weights for policy 0, policy_version 1535187 (0.0010) [2023-12-26 11:51:14,519][123091] Updated weights for policy 0, policy_version 1535197 (0.0009) [2023-12-26 11:51:14,549][123090] Updated weights for policy 1, policy_version 1525160 (0.0009) [2023-12-26 11:51:14,573][123091] Updated weights for policy 0, policy_version 1535207 (0.0010) [2023-12-26 11:51:14,599][123090] Updated weights for policy 1, policy_version 1525170 (0.0007) [2023-12-26 11:51:14,653][123090] Updated weights for policy 1, policy_version 1525180 (0.0009) [2023-12-26 11:51:15,442][123091] Updated weights for policy 0, policy_version 1535217 (0.0009) [2023-12-26 11:51:15,498][123091] Updated weights for policy 0, policy_version 1535227 (0.0010) [2023-12-26 11:51:15,516][123090] Updated weights for policy 1, policy_version 1525190 (0.0007) [2023-12-26 11:51:15,554][123091] Updated weights for policy 0, policy_version 1535237 (0.0009) [2023-12-26 11:51:15,578][123090] Updated weights for policy 1, policy_version 1525200 (0.0008) [2023-12-26 11:51:15,618][123091] Updated weights for policy 0, policy_version 1535247 (0.0011) [2023-12-26 11:51:15,643][123090] Updated weights for policy 1, policy_version 1525210 (0.0008) [2023-12-26 11:51:16,359][123091] Updated weights for policy 0, policy_version 1535257 (0.0008) [2023-12-26 11:51:16,424][123091] Updated weights for policy 0, policy_version 1535267 (0.0008) [2023-12-26 11:51:16,487][123091] Updated weights for policy 0, policy_version 1535277 (0.0007) [2023-12-26 11:51:16,488][123090] Updated weights for policy 1, policy_version 1525220 (0.0009) [2023-12-26 11:51:16,539][123090] Updated weights for policy 1, policy_version 1525230 (0.0009) [2023-12-26 11:51:16,592][123090] Updated weights for policy 1, policy_version 1525240 (0.0009) [2023-12-26 11:51:17,232][123091] Updated weights for policy 0, policy_version 1535287 (0.0006) [2023-12-26 11:51:17,278][123091] Updated weights for policy 0, policy_version 1535297 (0.0006) [2023-12-26 11:51:17,329][123091] Updated weights for policy 0, policy_version 1535307 (0.0005) [2023-12-26 11:51:17,434][123090] Updated weights for policy 1, policy_version 1525250 (0.0009) [2023-12-26 11:51:17,487][123090] Updated weights for policy 1, policy_version 1525260 (0.0010) [2023-12-26 11:51:17,545][123090] Updated weights for policy 1, policy_version 1525270 (0.0010) [2023-12-26 11:51:17,599][123090] Updated weights for policy 1, policy_version 1525280 (0.0010) [2023-12-26 11:51:18,019][123091] Updated weights for policy 0, policy_version 1535317 (0.0008) [2023-12-26 11:51:18,063][123091] Updated weights for policy 0, policy_version 1535327 (0.0010) [2023-12-26 11:51:18,114][123091] Updated weights for policy 0, policy_version 1535337 (0.0006) [2023-12-26 11:51:18,204][123090] Updated weights for policy 1, policy_version 1525290 (0.0005) [2023-12-26 11:51:18,250][123090] Updated weights for policy 1, policy_version 1525300 (0.0005) [2023-12-26 11:51:18,296][123090] Updated weights for policy 1, policy_version 1525310 (0.0007) [2023-12-26 11:51:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 783532032. Throughput: 0: 8924.8, 1: 8918.3. Samples: 783545652. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:18,785][121949] Avg episode reward: [(0, '6282.547'), (1, '5849.444')] [2023-12-26 11:51:18,832][123091] Updated weights for policy 0, policy_version 1535347 (0.0005) [2023-12-26 11:51:18,888][123091] Updated weights for policy 0, policy_version 1535357 (0.0005) [2023-12-26 11:51:18,962][123091] Updated weights for policy 0, policy_version 1535367 (0.0005) [2023-12-26 11:51:19,192][123090] Updated weights for policy 1, policy_version 1525320 (0.0009) [2023-12-26 11:51:19,250][123090] Updated weights for policy 1, policy_version 1525330 (0.0009) [2023-12-26 11:51:19,315][123090] Updated weights for policy 1, policy_version 1525340 (0.0010) [2023-12-26 11:51:19,690][123091] Updated weights for policy 0, policy_version 1535377 (0.0006) [2023-12-26 11:51:19,764][123091] Updated weights for policy 0, policy_version 1535387 (0.0007) [2023-12-26 11:51:19,841][123091] Updated weights for policy 0, policy_version 1535397 (0.0007) [2023-12-26 11:51:19,913][123091] Updated weights for policy 0, policy_version 1535407 (0.0007) [2023-12-26 11:51:20,229][123090] Updated weights for policy 1, policy_version 1525350 (0.0008) [2023-12-26 11:51:20,298][123090] Updated weights for policy 1, policy_version 1525360 (0.0007) [2023-12-26 11:51:20,364][123090] Updated weights for policy 1, policy_version 1525370 (0.0009) [2023-12-26 11:51:20,751][123091] Updated weights for policy 0, policy_version 1535417 (0.0010) [2023-12-26 11:51:20,821][123091] Updated weights for policy 0, policy_version 1535427 (0.0009) [2023-12-26 11:51:20,891][123091] Updated weights for policy 0, policy_version 1535437 (0.0010) [2023-12-26 11:51:21,114][123090] Updated weights for policy 1, policy_version 1525380 (0.0007) [2023-12-26 11:51:21,183][123090] Updated weights for policy 1, policy_version 1525390 (0.0009) [2023-12-26 11:51:21,252][123090] Updated weights for policy 1, policy_version 1525400 (0.0010) [2023-12-26 11:51:21,772][123091] Updated weights for policy 0, policy_version 1535447 (0.0010) [2023-12-26 11:51:21,836][123091] Updated weights for policy 0, policy_version 1535457 (0.0011) [2023-12-26 11:51:21,900][123091] Updated weights for policy 0, policy_version 1535467 (0.0011) [2023-12-26 11:51:22,158][123090] Updated weights for policy 1, policy_version 1525410 (0.0010) [2023-12-26 11:51:22,206][123090] Updated weights for policy 1, policy_version 1525420 (0.0010) [2023-12-26 11:51:22,262][123090] Updated weights for policy 1, policy_version 1525430 (0.0007) [2023-12-26 11:51:22,334][123090] Updated weights for policy 1, policy_version 1525440 (0.0009) [2023-12-26 11:51:22,753][123091] Updated weights for policy 0, policy_version 1535477 (0.0011) [2023-12-26 11:51:22,820][123091] Updated weights for policy 0, policy_version 1535487 (0.0011) [2023-12-26 11:51:22,880][123091] Updated weights for policy 0, policy_version 1535497 (0.0011) [2023-12-26 11:51:23,048][123090] Updated weights for policy 1, policy_version 1525450 (0.0005) [2023-12-26 11:51:23,104][123090] Updated weights for policy 1, policy_version 1525460 (0.0009) [2023-12-26 11:51:23,164][123090] Updated weights for policy 1, policy_version 1525470 (0.0010) [2023-12-26 11:51:23,702][123091] Updated weights for policy 0, policy_version 1535507 (0.0010) [2023-12-26 11:51:23,756][123091] Updated weights for policy 0, policy_version 1535517 (0.0010) [2023-12-26 11:51:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 783613952. Throughput: 0: 8880.2, 1: 8857.1. Samples: 783596484. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:23,785][121949] Avg episode reward: [(0, '6260.444'), (1, '5689.173')] [2023-12-26 11:51:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001525472_390520832.pth... [2023-12-26 11:51:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001524448_390258688.pth [2023-12-26 11:51:23,825][123091] Updated weights for policy 0, policy_version 1535527 (0.0005) [2023-12-26 11:51:23,871][123090] Updated weights for policy 1, policy_version 1525480 (0.0006) [2023-12-26 11:51:23,874][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001535536_393101312.pth... [2023-12-26 11:51:23,877][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001534480_392830976.pth [2023-12-26 11:51:23,930][123090] Updated weights for policy 1, policy_version 1525490 (0.0005) [2023-12-26 11:51:23,984][123090] Updated weights for policy 1, policy_version 1525501 (0.0007) [2023-12-26 11:51:24,544][123091] Updated weights for policy 0, policy_version 1535537 (0.0005) [2023-12-26 11:51:24,609][123091] Updated weights for policy 0, policy_version 1535547 (0.0005) [2023-12-26 11:51:24,659][123090] Updated weights for policy 1, policy_version 1525511 (0.0006) [2023-12-26 11:51:24,672][123091] Updated weights for policy 0, policy_version 1535557 (0.0005) [2023-12-26 11:51:24,716][123090] Updated weights for policy 1, policy_version 1525521 (0.0005) [2023-12-26 11:51:24,733][123091] Updated weights for policy 0, policy_version 1535567 (0.0005) [2023-12-26 11:51:24,774][123090] Updated weights for policy 1, policy_version 1525531 (0.0008) [2023-12-26 11:51:25,423][123091] Updated weights for policy 0, policy_version 1535577 (0.0007) [2023-12-26 11:51:25,473][123091] Updated weights for policy 0, policy_version 1535587 (0.0006) [2023-12-26 11:51:25,518][123091] Updated weights for policy 0, policy_version 1535597 (0.0005) [2023-12-26 11:51:25,558][123090] Updated weights for policy 1, policy_version 1525541 (0.0007) [2023-12-26 11:51:25,606][123090] Updated weights for policy 1, policy_version 1525551 (0.0005) [2023-12-26 11:51:25,652][123090] Updated weights for policy 1, policy_version 1525561 (0.0005) [2023-12-26 11:51:26,152][123091] Updated weights for policy 0, policy_version 1535607 (0.0005) [2023-12-26 11:51:26,212][123091] Updated weights for policy 0, policy_version 1535617 (0.0005) [2023-12-26 11:51:26,287][123091] Updated weights for policy 0, policy_version 1535627 (0.0009) [2023-12-26 11:51:26,419][123090] Updated weights for policy 1, policy_version 1525571 (0.0006) [2023-12-26 11:51:26,481][123090] Updated weights for policy 1, policy_version 1525581 (0.0005) [2023-12-26 11:51:26,541][123090] Updated weights for policy 1, policy_version 1525591 (0.0005) [2023-12-26 11:51:27,034][123091] Updated weights for policy 0, policy_version 1535637 (0.0011) [2023-12-26 11:51:27,089][123091] Updated weights for policy 0, policy_version 1535647 (0.0010) [2023-12-26 11:51:27,151][123091] Updated weights for policy 0, policy_version 1535657 (0.0010) [2023-12-26 11:51:27,214][123090] Updated weights for policy 1, policy_version 1525601 (0.0005) [2023-12-26 11:51:27,267][123090] Updated weights for policy 1, policy_version 1525611 (0.0005) [2023-12-26 11:51:27,335][123090] Updated weights for policy 1, policy_version 1525621 (0.0007) [2023-12-26 11:51:27,394][123090] Updated weights for policy 1, policy_version 1525631 (0.0008) [2023-12-26 11:51:27,890][123091] Updated weights for policy 0, policy_version 1535667 (0.0009) [2023-12-26 11:51:27,933][123091] Updated weights for policy 0, policy_version 1535677 (0.0005) [2023-12-26 11:51:27,981][123091] Updated weights for policy 0, policy_version 1535687 (0.0005) [2023-12-26 11:51:27,983][123090] Updated weights for policy 1, policy_version 1525641 (0.0005) [2023-12-26 11:51:28,048][123090] Updated weights for policy 1, policy_version 1525651 (0.0006) [2023-12-26 11:51:28,111][123090] Updated weights for policy 1, policy_version 1525661 (0.0005) [2023-12-26 11:51:28,676][123091] Updated weights for policy 0, policy_version 1535697 (0.0005) [2023-12-26 11:51:28,730][123090] Updated weights for policy 1, policy_version 1525671 (0.0008) [2023-12-26 11:51:28,740][123091] Updated weights for policy 0, policy_version 1535707 (0.0006) [2023-12-26 11:51:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 783712256. Throughput: 0: 8954.9, 1: 9048.6. Samples: 783709832. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:28,785][121949] Avg episode reward: [(0, '6274.629'), (1, '5495.527')] [2023-12-26 11:51:28,796][123090] Updated weights for policy 1, policy_version 1525681 (0.0008) [2023-12-26 11:51:28,799][123091] Updated weights for policy 0, policy_version 1535717 (0.0010) [2023-12-26 11:51:28,858][123091] Updated weights for policy 0, policy_version 1535727 (0.0010) [2023-12-26 11:51:28,864][123090] Updated weights for policy 1, policy_version 1525691 (0.0009) [2023-12-26 11:51:29,644][123091] Updated weights for policy 0, policy_version 1535737 (0.0009) [2023-12-26 11:51:29,668][123090] Updated weights for policy 1, policy_version 1525701 (0.0008) [2023-12-26 11:51:29,714][123091] Updated weights for policy 0, policy_version 1535747 (0.0009) [2023-12-26 11:51:29,732][123090] Updated weights for policy 1, policy_version 1525711 (0.0005) [2023-12-26 11:51:29,781][123091] Updated weights for policy 0, policy_version 1535757 (0.0008) [2023-12-26 11:51:29,789][123090] Updated weights for policy 1, policy_version 1525721 (0.0007) [2023-12-26 11:51:30,409][123091] Updated weights for policy 0, policy_version 1535767 (0.0008) [2023-12-26 11:51:30,457][123090] Updated weights for policy 1, policy_version 1525731 (0.0007) [2023-12-26 11:51:30,483][123091] Updated weights for policy 0, policy_version 1535777 (0.0008) [2023-12-26 11:51:30,504][123090] Updated weights for policy 1, policy_version 1525741 (0.0005) [2023-12-26 11:51:30,555][123090] Updated weights for policy 1, policy_version 1525751 (0.0005) [2023-12-26 11:51:30,557][123091] Updated weights for policy 0, policy_version 1535787 (0.0010) [2023-12-26 11:51:31,289][123091] Updated weights for policy 0, policy_version 1535797 (0.0009) [2023-12-26 11:51:31,326][123090] Updated weights for policy 1, policy_version 1525761 (0.0006) [2023-12-26 11:51:31,358][123091] Updated weights for policy 0, policy_version 1535807 (0.0008) [2023-12-26 11:51:31,403][123090] Updated weights for policy 1, policy_version 1525771 (0.0008) [2023-12-26 11:51:31,421][123091] Updated weights for policy 0, policy_version 1535817 (0.0008) [2023-12-26 11:51:31,469][123090] Updated weights for policy 1, policy_version 1525781 (0.0007) [2023-12-26 11:51:31,538][123090] Updated weights for policy 1, policy_version 1525791 (0.0009) [2023-12-26 11:51:32,148][123091] Updated weights for policy 0, policy_version 1535827 (0.0007) [2023-12-26 11:51:32,209][123091] Updated weights for policy 0, policy_version 1535837 (0.0006) [2023-12-26 11:51:32,271][123091] Updated weights for policy 0, policy_version 1535847 (0.0005) [2023-12-26 11:51:32,293][123090] Updated weights for policy 1, policy_version 1525801 (0.0008) [2023-12-26 11:51:32,358][123090] Updated weights for policy 1, policy_version 1525811 (0.0008) [2023-12-26 11:51:32,413][123090] Updated weights for policy 1, policy_version 1525821 (0.0008) [2023-12-26 11:51:32,960][123091] Updated weights for policy 0, policy_version 1535857 (0.0009) [2023-12-26 11:51:33,026][123091] Updated weights for policy 0, policy_version 1535867 (0.0008) [2023-12-26 11:51:33,077][123091] Updated weights for policy 0, policy_version 1535877 (0.0010) [2023-12-26 11:51:33,129][123091] Updated weights for policy 0, policy_version 1535887 (0.0011) [2023-12-26 11:51:33,223][123090] Updated weights for policy 1, policy_version 1525831 (0.0008) [2023-12-26 11:51:33,292][123090] Updated weights for policy 1, policy_version 1525841 (0.0008) [2023-12-26 11:51:33,343][123090] Updated weights for policy 1, policy_version 1525851 (0.0006) [2023-12-26 11:51:33,784][121949] Fps is (10 sec: 19660.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 783810560. Throughput: 0: 9108.7, 1: 9068.5. Samples: 783825336. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:33,786][121949] Avg episode reward: [(0, '6217.283'), (1, '5582.307')] [2023-12-26 11:51:33,829][123091] Updated weights for policy 0, policy_version 1535897 (0.0006) [2023-12-26 11:51:33,877][123091] Updated weights for policy 0, policy_version 1535907 (0.0005) [2023-12-26 11:51:33,942][123091] Updated weights for policy 0, policy_version 1535917 (0.0005) [2023-12-26 11:51:34,015][123090] Updated weights for policy 1, policy_version 1525861 (0.0005) [2023-12-26 11:51:34,075][123090] Updated weights for policy 1, policy_version 1525871 (0.0005) [2023-12-26 11:51:34,122][123090] Updated weights for policy 1, policy_version 1525881 (0.0006) [2023-12-26 11:51:34,632][123091] Updated weights for policy 0, policy_version 1535927 (0.0008) [2023-12-26 11:51:34,690][123091] Updated weights for policy 0, policy_version 1535937 (0.0009) [2023-12-26 11:51:34,753][123091] Updated weights for policy 0, policy_version 1535947 (0.0010) [2023-12-26 11:51:34,879][123090] Updated weights for policy 1, policy_version 1525891 (0.0009) [2023-12-26 11:51:34,948][123090] Updated weights for policy 1, policy_version 1525901 (0.0010) [2023-12-26 11:51:35,023][123090] Updated weights for policy 1, policy_version 1525911 (0.0010) [2023-12-26 11:51:35,477][123091] Updated weights for policy 0, policy_version 1535957 (0.0010) [2023-12-26 11:51:35,538][123091] Updated weights for policy 0, policy_version 1535967 (0.0011) [2023-12-26 11:51:35,601][123091] Updated weights for policy 0, policy_version 1535977 (0.0010) [2023-12-26 11:51:35,872][123090] Updated weights for policy 1, policy_version 1525921 (0.0009) [2023-12-26 11:51:35,932][123090] Updated weights for policy 1, policy_version 1525931 (0.0010) [2023-12-26 11:51:35,989][123090] Updated weights for policy 1, policy_version 1525941 (0.0009) [2023-12-26 11:51:36,043][123090] Updated weights for policy 1, policy_version 1525951 (0.0008) [2023-12-26 11:51:36,398][123091] Updated weights for policy 0, policy_version 1535987 (0.0010) [2023-12-26 11:51:36,470][123091] Updated weights for policy 0, policy_version 1535997 (0.0011) [2023-12-26 11:51:36,531][123091] Updated weights for policy 0, policy_version 1536007 (0.0010) [2023-12-26 11:51:36,845][123090] Updated weights for policy 1, policy_version 1525961 (0.0009) [2023-12-26 11:51:36,913][123090] Updated weights for policy 1, policy_version 1525972 (0.0010) [2023-12-26 11:51:36,974][123090] Updated weights for policy 1, policy_version 1525982 (0.0009) [2023-12-26 11:51:37,277][123091] Updated weights for policy 0, policy_version 1536017 (0.0009) [2023-12-26 11:51:37,323][123091] Updated weights for policy 0, policy_version 1536027 (0.0005) [2023-12-26 11:51:37,370][123091] Updated weights for policy 0, policy_version 1536037 (0.0006) [2023-12-26 11:51:37,418][123091] Updated weights for policy 0, policy_version 1536047 (0.0006) [2023-12-26 11:51:37,863][123090] Updated weights for policy 1, policy_version 1525992 (0.0010) [2023-12-26 11:51:37,913][123090] Updated weights for policy 1, policy_version 1526002 (0.0009) [2023-12-26 11:51:37,965][123090] Updated weights for policy 1, policy_version 1526012 (0.0009) [2023-12-26 11:51:38,110][123091] Updated weights for policy 0, policy_version 1536057 (0.0006) [2023-12-26 11:51:38,176][123091] Updated weights for policy 0, policy_version 1536067 (0.0005) [2023-12-26 11:51:38,222][123091] Updated weights for policy 0, policy_version 1536077 (0.0005) [2023-12-26 11:51:38,716][123090] Updated weights for policy 1, policy_version 1526022 (0.0007) [2023-12-26 11:51:38,781][123090] Updated weights for policy 1, policy_version 1526032 (0.0005) [2023-12-26 11:51:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 783900672. Throughput: 0: 9147.3, 1: 9110.8. Samples: 783880412. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:38,785][121949] Avg episode reward: [(0, '6176.703'), (1, '5699.215')] [2023-12-26 11:51:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001536080_393240576.pth... [2023-12-26 11:51:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001534992_392962048.pth [2023-12-26 11:51:38,855][123090] Updated weights for policy 1, policy_version 1526042 (0.0005) [2023-12-26 11:51:38,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001526048_390668288.pth... [2023-12-26 11:51:38,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001524992_390397952.pth [2023-12-26 11:51:39,020][123091] Updated weights for policy 0, policy_version 1536087 (0.0008) [2023-12-26 11:51:39,074][123091] Updated weights for policy 0, policy_version 1536097 (0.0010) [2023-12-26 11:51:39,133][123091] Updated weights for policy 0, policy_version 1536107 (0.0010) [2023-12-26 11:51:39,476][123090] Updated weights for policy 1, policy_version 1526052 (0.0007) [2023-12-26 11:51:39,551][123090] Updated weights for policy 1, policy_version 1526062 (0.0008) [2023-12-26 11:51:39,622][123090] Updated weights for policy 1, policy_version 1526072 (0.0007) [2023-12-26 11:51:40,053][123091] Updated weights for policy 0, policy_version 1536117 (0.0008) [2023-12-26 11:51:40,120][123091] Updated weights for policy 0, policy_version 1536127 (0.0009) [2023-12-26 11:51:40,183][123091] Updated weights for policy 0, policy_version 1536137 (0.0010) [2023-12-26 11:51:40,343][123090] Updated weights for policy 1, policy_version 1526082 (0.0006) [2023-12-26 11:51:40,413][123090] Updated weights for policy 1, policy_version 1526092 (0.0008) [2023-12-26 11:51:40,485][123090] Updated weights for policy 1, policy_version 1526102 (0.0008) [2023-12-26 11:51:40,551][123090] Updated weights for policy 1, policy_version 1526112 (0.0008) [2023-12-26 11:51:40,971][123091] Updated weights for policy 0, policy_version 1536147 (0.0008) [2023-12-26 11:51:41,040][123091] Updated weights for policy 0, policy_version 1536157 (0.0007) [2023-12-26 11:51:41,113][123091] Updated weights for policy 0, policy_version 1536167 (0.0009) [2023-12-26 11:51:41,359][123090] Updated weights for policy 1, policy_version 1526122 (0.0009) [2023-12-26 11:51:41,435][123090] Updated weights for policy 1, policy_version 1526132 (0.0010) [2023-12-26 11:51:41,492][123090] Updated weights for policy 1, policy_version 1526142 (0.0009) [2023-12-26 11:51:41,918][123091] Updated weights for policy 0, policy_version 1536177 (0.0009) [2023-12-26 11:51:41,982][123091] Updated weights for policy 0, policy_version 1536187 (0.0010) [2023-12-26 11:51:42,048][123091] Updated weights for policy 0, policy_version 1536197 (0.0010) [2023-12-26 11:51:42,124][123091] Updated weights for policy 0, policy_version 1536207 (0.0007) [2023-12-26 11:51:42,391][123090] Updated weights for policy 1, policy_version 1526152 (0.0008) [2023-12-26 11:51:42,450][123090] Updated weights for policy 1, policy_version 1526162 (0.0006) [2023-12-26 11:51:42,509][123090] Updated weights for policy 1, policy_version 1526172 (0.0007) [2023-12-26 11:51:42,886][123091] Updated weights for policy 0, policy_version 1536217 (0.0005) [2023-12-26 11:51:42,951][123091] Updated weights for policy 0, policy_version 1536227 (0.0006) [2023-12-26 11:51:43,021][123091] Updated weights for policy 0, policy_version 1536237 (0.0006) [2023-12-26 11:51:43,191][123090] Updated weights for policy 1, policy_version 1526182 (0.0008) [2023-12-26 11:51:43,257][123090] Updated weights for policy 1, policy_version 1526192 (0.0010) [2023-12-26 11:51:43,308][123090] Updated weights for policy 1, policy_version 1526202 (0.0010) [2023-12-26 11:51:43,661][123091] Updated weights for policy 0, policy_version 1536247 (0.0006) [2023-12-26 11:51:43,715][123091] Updated weights for policy 0, policy_version 1536257 (0.0005) [2023-12-26 11:51:43,769][123091] Updated weights for policy 0, policy_version 1536267 (0.0005) [2023-12-26 11:51:43,784][121949] Fps is (10 sec: 18023.1, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 783990784. Throughput: 0: 9171.6, 1: 8997.8. Samples: 783985980. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:43,784][121949] Avg episode reward: [(0, '6082.862'), (1, '5675.455')] [2023-12-26 11:51:44,123][123090] Updated weights for policy 1, policy_version 1526212 (0.0008) [2023-12-26 11:51:44,177][123090] Updated weights for policy 1, policy_version 1526222 (0.0007) [2023-12-26 11:51:44,239][123090] Updated weights for policy 1, policy_version 1526232 (0.0008) [2023-12-26 11:51:44,476][123091] Updated weights for policy 0, policy_version 1536277 (0.0007) [2023-12-26 11:51:44,528][123091] Updated weights for policy 0, policy_version 1536287 (0.0009) [2023-12-26 11:51:44,576][123091] Updated weights for policy 0, policy_version 1536297 (0.0009) [2023-12-26 11:51:45,055][123090] Updated weights for policy 1, policy_version 1526242 (0.0008) [2023-12-26 11:51:45,123][123090] Updated weights for policy 1, policy_version 1526252 (0.0011) [2023-12-26 11:51:45,187][123090] Updated weights for policy 1, policy_version 1526262 (0.0011) [2023-12-26 11:51:45,244][123090] Updated weights for policy 1, policy_version 1526272 (0.0011) [2023-12-26 11:51:45,379][123091] Updated weights for policy 0, policy_version 1536307 (0.0009) [2023-12-26 11:51:45,453][123091] Updated weights for policy 0, policy_version 1536317 (0.0009) [2023-12-26 11:51:45,518][123091] Updated weights for policy 0, policy_version 1536327 (0.0008) [2023-12-26 11:51:45,956][123090] Updated weights for policy 1, policy_version 1526282 (0.0005) [2023-12-26 11:51:46,011][123090] Updated weights for policy 1, policy_version 1526292 (0.0007) [2023-12-26 11:51:46,076][123090] Updated weights for policy 1, policy_version 1526302 (0.0008) [2023-12-26 11:51:46,190][123091] Updated weights for policy 0, policy_version 1536337 (0.0006) [2023-12-26 11:51:46,241][123091] Updated weights for policy 0, policy_version 1536347 (0.0005) [2023-12-26 11:51:46,293][123091] Updated weights for policy 0, policy_version 1536357 (0.0005) [2023-12-26 11:51:46,357][123091] Updated weights for policy 0, policy_version 1536367 (0.0008) [2023-12-26 11:51:46,755][123090] Updated weights for policy 1, policy_version 1526312 (0.0005) [2023-12-26 11:51:46,810][123090] Updated weights for policy 1, policy_version 1526322 (0.0005) [2023-12-26 11:51:46,865][123090] Updated weights for policy 1, policy_version 1526332 (0.0005) [2023-12-26 11:51:47,018][123091] Updated weights for policy 0, policy_version 1536377 (0.0005) [2023-12-26 11:51:47,073][123091] Updated weights for policy 0, policy_version 1536387 (0.0005) [2023-12-26 11:51:47,134][123091] Updated weights for policy 0, policy_version 1536397 (0.0006) [2023-12-26 11:51:47,503][123090] Updated weights for policy 1, policy_version 1526342 (0.0005) [2023-12-26 11:51:47,562][123090] Updated weights for policy 1, policy_version 1526352 (0.0005) [2023-12-26 11:51:47,615][123090] Updated weights for policy 1, policy_version 1526362 (0.0005) [2023-12-26 11:51:47,852][123091] Updated weights for policy 0, policy_version 1536407 (0.0008) [2023-12-26 11:51:47,900][123091] Updated weights for policy 0, policy_version 1536417 (0.0009) [2023-12-26 11:51:47,948][123091] Updated weights for policy 0, policy_version 1536427 (0.0009) [2023-12-26 11:51:48,383][123090] Updated weights for policy 1, policy_version 1526372 (0.0007) [2023-12-26 11:51:48,452][123090] Updated weights for policy 1, policy_version 1526382 (0.0010) [2023-12-26 11:51:48,510][123090] Updated weights for policy 1, policy_version 1526392 (0.0005) [2023-12-26 11:51:48,754][123091] Updated weights for policy 0, policy_version 1536437 (0.0008) [2023-12-26 11:51:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18295.4, 300 sec: 17772.5). Total num frames: 784089088. Throughput: 0: 9237.4, 1: 9043.4. Samples: 784101484. Policy #0 lag: (min: 13.0, avg: 13.0, max: 13.0) [2023-12-26 11:51:48,785][121949] Avg episode reward: [(0, '6059.179'), (1, '5745.493')] [2023-12-26 11:51:48,816][123091] Updated weights for policy 0, policy_version 1536447 (0.0005) [2023-12-26 11:51:48,898][123091] Updated weights for policy 0, policy_version 1536457 (0.0006) [2023-12-26 11:51:49,227][123090] Updated weights for policy 1, policy_version 1526402 (0.0006) [2023-12-26 11:51:49,295][123090] Updated weights for policy 1, policy_version 1526412 (0.0009) [2023-12-26 11:51:49,361][123090] Updated weights for policy 1, policy_version 1526422 (0.0011) [2023-12-26 11:51:49,413][123090] Updated weights for policy 1, policy_version 1526432 (0.0010) [2023-12-26 11:51:49,649][123091] Updated weights for policy 0, policy_version 1536467 (0.0009) [2023-12-26 11:51:49,716][123091] Updated weights for policy 0, policy_version 1536477 (0.0007) [2023-12-26 11:51:49,780][123091] Updated weights for policy 0, policy_version 1536487 (0.0005) [2023-12-26 11:51:50,224][123090] Updated weights for policy 1, policy_version 1526442 (0.0010) [2023-12-26 11:51:50,284][123090] Updated weights for policy 1, policy_version 1526452 (0.0010) [2023-12-26 11:51:50,340][123090] Updated weights for policy 1, policy_version 1526462 (0.0009) [2023-12-26 11:51:50,560][123091] Updated weights for policy 0, policy_version 1536497 (0.0009) [2023-12-26 11:51:50,626][123091] Updated weights for policy 0, policy_version 1536507 (0.0009) [2023-12-26 11:51:50,693][123091] Updated weights for policy 0, policy_version 1536517 (0.0006) [2023-12-26 11:51:50,760][123091] Updated weights for policy 0, policy_version 1536527 (0.0006) [2023-12-26 11:51:51,247][123090] Updated weights for policy 1, policy_version 1526472 (0.0010) [2023-12-26 11:51:51,309][123090] Updated weights for policy 1, policy_version 1526482 (0.0010) [2023-12-26 11:51:51,377][123090] Updated weights for policy 1, policy_version 1526492 (0.0009) [2023-12-26 11:51:51,422][123091] Updated weights for policy 0, policy_version 1536537 (0.0007) [2023-12-26 11:51:51,480][123091] Updated weights for policy 0, policy_version 1536547 (0.0007) [2023-12-26 11:51:51,534][123091] Updated weights for policy 0, policy_version 1536557 (0.0010) [2023-12-26 11:51:52,228][123090] Updated weights for policy 1, policy_version 1526502 (0.0009) [2023-12-26 11:51:52,286][123090] Updated weights for policy 1, policy_version 1526512 (0.0009) [2023-12-26 11:51:52,341][123090] Updated weights for policy 1, policy_version 1526522 (0.0009) [2023-12-26 11:51:52,365][123091] Updated weights for policy 0, policy_version 1536567 (0.0009) [2023-12-26 11:51:52,433][123091] Updated weights for policy 0, policy_version 1536577 (0.0010) [2023-12-26 11:51:52,501][123091] Updated weights for policy 0, policy_version 1536587 (0.0009) [2023-12-26 11:51:53,162][123090] Updated weights for policy 1, policy_version 1526532 (0.0007) [2023-12-26 11:51:53,231][123090] Updated weights for policy 1, policy_version 1526542 (0.0009) [2023-12-26 11:51:53,297][123090] Updated weights for policy 1, policy_version 1526552 (0.0008) [2023-12-26 11:51:53,309][123091] Updated weights for policy 0, policy_version 1536597 (0.0009) [2023-12-26 11:51:53,366][123091] Updated weights for policy 0, policy_version 1536607 (0.0009) [2023-12-26 11:51:53,417][123091] Updated weights for policy 0, policy_version 1536617 (0.0008) [2023-12-26 11:51:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 784179200. Throughput: 0: 9234.2, 1: 9031.2. Samples: 784153840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:51:53,785][121949] Avg episode reward: [(0, '6284.978'), (1, '5673.295')] [2023-12-26 11:51:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001536624_393379840.pth... [2023-12-26 11:51:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001526560_390799360.pth... [2023-12-26 11:51:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001525472_390520832.pth [2023-12-26 11:51:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001535536_393101312.pth [2023-12-26 11:51:54,072][123090] Updated weights for policy 1, policy_version 1526562 (0.0007) [2023-12-26 11:51:54,131][123090] Updated weights for policy 1, policy_version 1526572 (0.0010) [2023-12-26 11:51:54,199][123090] Updated weights for policy 1, policy_version 1526582 (0.0010) [2023-12-26 11:51:54,206][123091] Updated weights for policy 0, policy_version 1536627 (0.0008) [2023-12-26 11:51:54,264][123090] Updated weights for policy 1, policy_version 1526592 (0.0010) [2023-12-26 11:51:54,272][123091] Updated weights for policy 0, policy_version 1536637 (0.0005) [2023-12-26 11:51:54,342][123091] Updated weights for policy 0, policy_version 1536647 (0.0005) [2023-12-26 11:51:54,971][123090] Updated weights for policy 1, policy_version 1526602 (0.0006) [2023-12-26 11:51:54,990][123091] Updated weights for policy 0, policy_version 1536657 (0.0005) [2023-12-26 11:51:55,045][123090] Updated weights for policy 1, policy_version 1526612 (0.0006) [2023-12-26 11:51:55,060][123091] Updated weights for policy 0, policy_version 1536667 (0.0007) [2023-12-26 11:51:55,108][123091] Updated weights for policy 0, policy_version 1536677 (0.0005) [2023-12-26 11:51:55,116][123090] Updated weights for policy 1, policy_version 1526622 (0.0005) [2023-12-26 11:51:55,161][123091] Updated weights for policy 0, policy_version 1536687 (0.0006) [2023-12-26 11:51:55,784][123090] Updated weights for policy 1, policy_version 1526632 (0.0006) [2023-12-26 11:51:55,850][123090] Updated weights for policy 1, policy_version 1526642 (0.0005) [2023-12-26 11:51:55,906][123091] Updated weights for policy 0, policy_version 1536697 (0.0005) [2023-12-26 11:51:55,918][123090] Updated weights for policy 1, policy_version 1526652 (0.0005) [2023-12-26 11:51:55,970][123091] Updated weights for policy 0, policy_version 1536707 (0.0005) [2023-12-26 11:51:56,040][123091] Updated weights for policy 0, policy_version 1536717 (0.0008) [2023-12-26 11:51:56,581][123090] Updated weights for policy 1, policy_version 1526662 (0.0005) [2023-12-26 11:51:56,636][123090] Updated weights for policy 1, policy_version 1526672 (0.0005) [2023-12-26 11:51:56,673][123091] Updated weights for policy 0, policy_version 1536727 (0.0007) [2023-12-26 11:51:56,686][123090] Updated weights for policy 1, policy_version 1526682 (0.0005) [2023-12-26 11:51:56,726][123091] Updated weights for policy 0, policy_version 1536737 (0.0005) [2023-12-26 11:51:56,780][123091] Updated weights for policy 0, policy_version 1536747 (0.0005) [2023-12-26 11:51:57,425][123090] Updated weights for policy 1, policy_version 1526692 (0.0006) [2023-12-26 11:51:57,459][123091] Updated weights for policy 0, policy_version 1536757 (0.0005) [2023-12-26 11:51:57,489][123090] Updated weights for policy 1, policy_version 1526702 (0.0010) [2023-12-26 11:51:57,519][123091] Updated weights for policy 0, policy_version 1536767 (0.0005) [2023-12-26 11:51:57,551][123090] Updated weights for policy 1, policy_version 1526712 (0.0010) [2023-12-26 11:51:57,576][123091] Updated weights for policy 0, policy_version 1536777 (0.0005) [2023-12-26 11:51:58,333][123091] Updated weights for policy 0, policy_version 1536787 (0.0006) [2023-12-26 11:51:58,346][123090] Updated weights for policy 1, policy_version 1526722 (0.0010) [2023-12-26 11:51:58,405][123091] Updated weights for policy 0, policy_version 1536797 (0.0008) [2023-12-26 11:51:58,415][123090] Updated weights for policy 1, policy_version 1526732 (0.0008) [2023-12-26 11:51:58,460][123091] Updated weights for policy 0, policy_version 1536807 (0.0006) [2023-12-26 11:51:58,482][123090] Updated weights for policy 1, policy_version 1526742 (0.0009) [2023-12-26 11:51:58,549][123090] Updated weights for policy 1, policy_version 1526752 (0.0009) [2023-12-26 11:51:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18432.0, 300 sec: 17800.2). Total num frames: 784277504. Throughput: 0: 9297.1, 1: 9139.4. Samples: 784268384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:51:58,785][121949] Avg episode reward: [(0, '6364.839'), (1, '5884.946')] [2023-12-26 11:51:59,271][123091] Updated weights for policy 0, policy_version 1536817 (0.0009) [2023-12-26 11:51:59,329][123091] Updated weights for policy 0, policy_version 1536827 (0.0005) [2023-12-26 11:51:59,396][123091] Updated weights for policy 0, policy_version 1536837 (0.0007) [2023-12-26 11:51:59,449][123091] Updated weights for policy 0, policy_version 1536847 (0.0006) [2023-12-26 11:51:59,575][123090] Updated weights for policy 1, policy_version 1526762 (0.0010) [2023-12-26 11:51:59,629][123090] Updated weights for policy 1, policy_version 1526772 (0.0010) [2023-12-26 11:51:59,689][123090] Updated weights for policy 1, policy_version 1526782 (0.0010) [2023-12-26 11:52:00,158][123091] Updated weights for policy 0, policy_version 1536857 (0.0010) [2023-12-26 11:52:00,210][123091] Updated weights for policy 0, policy_version 1536867 (0.0010) [2023-12-26 11:52:00,273][123091] Updated weights for policy 0, policy_version 1536877 (0.0009) [2023-12-26 11:52:00,523][123090] Updated weights for policy 1, policy_version 1526792 (0.0008) [2023-12-26 11:52:00,591][123090] Updated weights for policy 1, policy_version 1526802 (0.0006) [2023-12-26 11:52:00,649][123090] Updated weights for policy 1, policy_version 1526812 (0.0005) [2023-12-26 11:52:01,098][123091] Updated weights for policy 0, policy_version 1536887 (0.0011) [2023-12-26 11:52:01,167][123091] Updated weights for policy 0, policy_version 1536897 (0.0009) [2023-12-26 11:52:01,217][123091] Updated weights for policy 0, policy_version 1536907 (0.0005) [2023-12-26 11:52:01,364][123090] Updated weights for policy 1, policy_version 1526822 (0.0008) [2023-12-26 11:52:01,433][123090] Updated weights for policy 1, policy_version 1526832 (0.0009) [2023-12-26 11:52:01,503][123090] Updated weights for policy 1, policy_version 1526842 (0.0006) [2023-12-26 11:52:01,915][123091] Updated weights for policy 0, policy_version 1536917 (0.0007) [2023-12-26 11:52:01,988][123091] Updated weights for policy 0, policy_version 1536927 (0.0005) [2023-12-26 11:52:02,057][123091] Updated weights for policy 0, policy_version 1536937 (0.0005) [2023-12-26 11:52:02,133][123090] Updated weights for policy 1, policy_version 1526852 (0.0006) [2023-12-26 11:52:02,187][123090] Updated weights for policy 1, policy_version 1526862 (0.0005) [2023-12-26 11:52:02,234][123090] Updated weights for policy 1, policy_version 1526872 (0.0005) [2023-12-26 11:52:02,691][123091] Updated weights for policy 0, policy_version 1536947 (0.0006) [2023-12-26 11:52:02,752][123091] Updated weights for policy 0, policy_version 1536957 (0.0005) [2023-12-26 11:52:02,812][123091] Updated weights for policy 0, policy_version 1536967 (0.0005) [2023-12-26 11:52:02,926][123090] Updated weights for policy 1, policy_version 1526882 (0.0007) [2023-12-26 11:52:02,986][123090] Updated weights for policy 1, policy_version 1526892 (0.0010) [2023-12-26 11:52:03,044][123090] Updated weights for policy 1, policy_version 1526902 (0.0009) [2023-12-26 11:52:03,110][123090] Updated weights for policy 1, policy_version 1526912 (0.0010) [2023-12-26 11:52:03,461][123091] Updated weights for policy 0, policy_version 1536977 (0.0006) [2023-12-26 11:52:03,510][123091] Updated weights for policy 0, policy_version 1536987 (0.0009) [2023-12-26 11:52:03,558][123091] Updated weights for policy 0, policy_version 1536997 (0.0009) [2023-12-26 11:52:03,613][123091] Updated weights for policy 0, policy_version 1537007 (0.0010) [2023-12-26 11:52:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18295.5, 300 sec: 17800.2). Total num frames: 784367616. Throughput: 0: 9337.6, 1: 9148.3. Samples: 784377516. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:03,785][121949] Avg episode reward: [(0, '6249.822'), (1, '5775.509')] [2023-12-26 11:52:03,974][123090] Updated weights for policy 1, policy_version 1526922 (0.0009) [2023-12-26 11:52:04,034][123090] Updated weights for policy 1, policy_version 1526932 (0.0009) [2023-12-26 11:52:04,095][123090] Updated weights for policy 1, policy_version 1526942 (0.0009) [2023-12-26 11:52:04,386][123091] Updated weights for policy 0, policy_version 1537017 (0.0010) [2023-12-26 11:52:04,454][123091] Updated weights for policy 0, policy_version 1537027 (0.0010) [2023-12-26 11:52:04,517][123091] Updated weights for policy 0, policy_version 1537037 (0.0009) [2023-12-26 11:52:04,841][123090] Updated weights for policy 1, policy_version 1526952 (0.0009) [2023-12-26 11:52:04,906][123090] Updated weights for policy 1, policy_version 1526962 (0.0009) [2023-12-26 11:52:04,966][123090] Updated weights for policy 1, policy_version 1526972 (0.0008) [2023-12-26 11:52:05,366][123091] Updated weights for policy 0, policy_version 1537047 (0.0009) [2023-12-26 11:52:05,418][123091] Updated weights for policy 0, policy_version 1537057 (0.0011) [2023-12-26 11:52:05,513][123091] Updated weights for policy 0, policy_version 1537067 (0.0010) [2023-12-26 11:52:05,767][123090] Updated weights for policy 1, policy_version 1526982 (0.0009) [2023-12-26 11:52:05,827][123090] Updated weights for policy 1, policy_version 1526992 (0.0009) [2023-12-26 11:52:05,883][123090] Updated weights for policy 1, policy_version 1527002 (0.0009) [2023-12-26 11:52:06,224][123091] Updated weights for policy 0, policy_version 1537077 (0.0010) [2023-12-26 11:52:06,279][123091] Updated weights for policy 0, policy_version 1537087 (0.0010) [2023-12-26 11:52:06,346][123091] Updated weights for policy 0, policy_version 1537097 (0.0010) [2023-12-26 11:52:06,723][123090] Updated weights for policy 1, policy_version 1527012 (0.0008) [2023-12-26 11:52:06,776][123090] Updated weights for policy 1, policy_version 1527022 (0.0011) [2023-12-26 11:52:06,828][123090] Updated weights for policy 1, policy_version 1527032 (0.0010) [2023-12-26 11:52:07,158][123091] Updated weights for policy 0, policy_version 1537107 (0.0009) [2023-12-26 11:52:07,229][123091] Updated weights for policy 0, policy_version 1537117 (0.0008) [2023-12-26 11:52:07,293][123091] Updated weights for policy 0, policy_version 1537127 (0.0008) [2023-12-26 11:52:07,582][123090] Updated weights for policy 1, policy_version 1527042 (0.0010) [2023-12-26 11:52:07,654][123090] Updated weights for policy 1, policy_version 1527052 (0.0006) [2023-12-26 11:52:07,707][123090] Updated weights for policy 1, policy_version 1527062 (0.0010) [2023-12-26 11:52:07,757][123090] Updated weights for policy 1, policy_version 1527072 (0.0009) [2023-12-26 11:52:08,066][123091] Updated weights for policy 0, policy_version 1537137 (0.0005) [2023-12-26 11:52:08,120][123091] Updated weights for policy 0, policy_version 1537147 (0.0006) [2023-12-26 11:52:08,164][123091] Updated weights for policy 0, policy_version 1537157 (0.0005) [2023-12-26 11:52:08,220][123091] Updated weights for policy 0, policy_version 1537167 (0.0006) [2023-12-26 11:52:08,487][123090] Updated weights for policy 1, policy_version 1527082 (0.0006) [2023-12-26 11:52:08,556][123090] Updated weights for policy 1, policy_version 1527092 (0.0006) [2023-12-26 11:52:08,620][123090] Updated weights for policy 1, policy_version 1527102 (0.0010) [2023-12-26 11:52:08,785][121949] Fps is (10 sec: 18021.5, 60 sec: 18431.9, 300 sec: 17800.2). Total num frames: 784457728. Throughput: 0: 9342.7, 1: 9171.4. Samples: 784429628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:08,786][121949] Avg episode reward: [(0, '6271.831'), (1, '5599.093')] [2023-12-26 11:52:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001537168_393519104.pth... [2023-12-26 11:52:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001527104_390938624.pth... [2023-12-26 11:52:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001526048_390668288.pth [2023-12-26 11:52:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001536080_393240576.pth [2023-12-26 11:52:08,948][123091] Updated weights for policy 0, policy_version 1537177 (0.0006) [2023-12-26 11:52:09,019][123091] Updated weights for policy 0, policy_version 1537187 (0.0005) [2023-12-26 11:52:09,095][123091] Updated weights for policy 0, policy_version 1537197 (0.0005) [2023-12-26 11:52:09,401][123090] Updated weights for policy 1, policy_version 1527112 (0.0010) [2023-12-26 11:52:09,473][123090] Updated weights for policy 1, policy_version 1527122 (0.0011) [2023-12-26 11:52:09,540][123090] Updated weights for policy 1, policy_version 1527132 (0.0011) [2023-12-26 11:52:09,845][123091] Updated weights for policy 0, policy_version 1537207 (0.0009) [2023-12-26 11:52:09,914][123091] Updated weights for policy 0, policy_version 1537217 (0.0009) [2023-12-26 11:52:09,971][123091] Updated weights for policy 0, policy_version 1537227 (0.0009) [2023-12-26 11:52:10,368][123090] Updated weights for policy 1, policy_version 1527142 (0.0009) [2023-12-26 11:52:10,435][123090] Updated weights for policy 1, policy_version 1527152 (0.0006) [2023-12-26 11:52:10,507][123090] Updated weights for policy 1, policy_version 1527162 (0.0005) [2023-12-26 11:52:10,879][123091] Updated weights for policy 0, policy_version 1537237 (0.0009) [2023-12-26 11:52:10,938][123091] Updated weights for policy 0, policy_version 1537247 (0.0009) [2023-12-26 11:52:10,995][123091] Updated weights for policy 0, policy_version 1537257 (0.0010) [2023-12-26 11:52:11,267][123090] Updated weights for policy 1, policy_version 1527172 (0.0007) [2023-12-26 11:52:11,336][123090] Updated weights for policy 1, policy_version 1527182 (0.0009) [2023-12-26 11:52:11,412][123090] Updated weights for policy 1, policy_version 1527192 (0.0010) [2023-12-26 11:52:11,923][123091] Updated weights for policy 0, policy_version 1537267 (0.0010) [2023-12-26 11:52:11,989][123091] Updated weights for policy 0, policy_version 1537277 (0.0009) [2023-12-26 11:52:12,057][123091] Updated weights for policy 0, policy_version 1537287 (0.0010) [2023-12-26 11:52:12,283][123090] Updated weights for policy 1, policy_version 1527202 (0.0010) [2023-12-26 11:52:12,356][123090] Updated weights for policy 1, policy_version 1527212 (0.0007) [2023-12-26 11:52:12,431][123090] Updated weights for policy 1, policy_version 1527222 (0.0008) [2023-12-26 11:52:12,501][123090] Updated weights for policy 1, policy_version 1527232 (0.0005) [2023-12-26 11:52:12,907][123091] Updated weights for policy 0, policy_version 1537297 (0.0010) [2023-12-26 11:52:12,955][123091] Updated weights for policy 0, policy_version 1537307 (0.0011) [2023-12-26 11:52:13,003][123091] Updated weights for policy 0, policy_version 1537317 (0.0010) [2023-12-26 11:52:13,062][123091] Updated weights for policy 0, policy_version 1537327 (0.0011) [2023-12-26 11:52:13,266][123090] Updated weights for policy 1, policy_version 1527242 (0.0011) [2023-12-26 11:52:13,329][123090] Updated weights for policy 1, policy_version 1527252 (0.0011) [2023-12-26 11:52:13,394][123090] Updated weights for policy 1, policy_version 1527262 (0.0010) [2023-12-26 11:52:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 784539648. Throughput: 0: 9280.0, 1: 9085.0. Samples: 784536256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:13,785][121949] Avg episode reward: [(0, '6197.824'), (1, '5601.676')] [2023-12-26 11:52:13,920][123091] Updated weights for policy 0, policy_version 1537337 (0.0011) [2023-12-26 11:52:13,976][123091] Updated weights for policy 0, policy_version 1537347 (0.0011) [2023-12-26 11:52:14,032][123091] Updated weights for policy 0, policy_version 1537357 (0.0011) [2023-12-26 11:52:14,178][123090] Updated weights for policy 1, policy_version 1527272 (0.0009) [2023-12-26 11:52:14,234][123090] Updated weights for policy 1, policy_version 1527282 (0.0007) [2023-12-26 11:52:14,283][123090] Updated weights for policy 1, policy_version 1527292 (0.0009) [2023-12-26 11:52:14,857][123091] Updated weights for policy 0, policy_version 1537367 (0.0011) [2023-12-26 11:52:14,913][123091] Updated weights for policy 0, policy_version 1537377 (0.0011) [2023-12-26 11:52:14,985][123091] Updated weights for policy 0, policy_version 1537387 (0.0011) [2023-12-26 11:52:15,068][123090] Updated weights for policy 1, policy_version 1527302 (0.0009) [2023-12-26 11:52:15,139][123090] Updated weights for policy 1, policy_version 1527312 (0.0009) [2023-12-26 11:52:15,208][123090] Updated weights for policy 1, policy_version 1527322 (0.0008) [2023-12-26 11:52:15,791][123091] Updated weights for policy 0, policy_version 1537397 (0.0011) [2023-12-26 11:52:15,842][123091] Updated weights for policy 0, policy_version 1537407 (0.0011) [2023-12-26 11:52:15,887][123091] Updated weights for policy 0, policy_version 1537417 (0.0010) [2023-12-26 11:52:16,006][123090] Updated weights for policy 1, policy_version 1527332 (0.0008) [2023-12-26 11:52:16,064][123090] Updated weights for policy 1, policy_version 1527342 (0.0005) [2023-12-26 11:52:16,117][123090] Updated weights for policy 1, policy_version 1527352 (0.0005) [2023-12-26 11:52:16,713][123090] Updated weights for policy 1, policy_version 1527362 (0.0005) [2023-12-26 11:52:16,737][123091] Updated weights for policy 0, policy_version 1537427 (0.0009) [2023-12-26 11:52:16,781][123090] Updated weights for policy 1, policy_version 1527372 (0.0005) [2023-12-26 11:52:16,799][123091] Updated weights for policy 0, policy_version 1537437 (0.0009) [2023-12-26 11:52:16,832][123090] Updated weights for policy 1, policy_version 1527382 (0.0005) [2023-12-26 11:52:16,851][123091] Updated weights for policy 0, policy_version 1537447 (0.0009) [2023-12-26 11:52:16,882][123090] Updated weights for policy 1, policy_version 1527392 (0.0008) [2023-12-26 11:52:17,552][123090] Updated weights for policy 1, policy_version 1527402 (0.0006) [2023-12-26 11:52:17,611][123090] Updated weights for policy 1, policy_version 1527412 (0.0006) [2023-12-26 11:52:17,671][123090] Updated weights for policy 1, policy_version 1527422 (0.0006) [2023-12-26 11:52:17,716][123091] Updated weights for policy 0, policy_version 1537457 (0.0008) [2023-12-26 11:52:17,775][123091] Updated weights for policy 0, policy_version 1537467 (0.0005) [2023-12-26 11:52:17,825][123091] Updated weights for policy 0, policy_version 1537477 (0.0005) [2023-12-26 11:52:17,873][123091] Updated weights for policy 0, policy_version 1537487 (0.0005) [2023-12-26 11:52:18,314][123090] Updated weights for policy 1, policy_version 1527432 (0.0008) [2023-12-26 11:52:18,384][123090] Updated weights for policy 1, policy_version 1527442 (0.0008) [2023-12-26 11:52:18,437][123090] Updated weights for policy 1, policy_version 1527452 (0.0008) [2023-12-26 11:52:18,693][123091] Updated weights for policy 0, policy_version 1537497 (0.0008) [2023-12-26 11:52:18,762][123091] Updated weights for policy 0, policy_version 1537507 (0.0005) [2023-12-26 11:52:18,784][121949] Fps is (10 sec: 17204.1, 60 sec: 18295.5, 300 sec: 17800.2). Total num frames: 784629760. Throughput: 0: 9119.0, 1: 9066.6. Samples: 784643680. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:18,785][121949] Avg episode reward: [(0, '6176.146'), (1, '5547.500')] [2023-12-26 11:52:18,826][123091] Updated weights for policy 0, policy_version 1537517 (0.0008) [2023-12-26 11:52:19,252][123090] Updated weights for policy 1, policy_version 1527462 (0.0010) [2023-12-26 11:52:19,321][123090] Updated weights for policy 1, policy_version 1527472 (0.0010) [2023-12-26 11:52:19,392][123090] Updated weights for policy 1, policy_version 1527482 (0.0011) [2023-12-26 11:52:19,564][123091] Updated weights for policy 0, policy_version 1537527 (0.0009) [2023-12-26 11:52:19,620][123091] Updated weights for policy 0, policy_version 1537537 (0.0009) [2023-12-26 11:52:19,672][123091] Updated weights for policy 0, policy_version 1537547 (0.0009) [2023-12-26 11:52:20,164][123090] Updated weights for policy 1, policy_version 1527492 (0.0010) [2023-12-26 11:52:20,227][123090] Updated weights for policy 1, policy_version 1527503 (0.0010) [2023-12-26 11:52:20,291][123090] Updated weights for policy 1, policy_version 1527513 (0.0010) [2023-12-26 11:52:20,495][123091] Updated weights for policy 0, policy_version 1537557 (0.0007) [2023-12-26 11:52:20,555][123091] Updated weights for policy 0, policy_version 1537567 (0.0010) [2023-12-26 11:52:20,628][123091] Updated weights for policy 0, policy_version 1537577 (0.0009) [2023-12-26 11:52:21,131][123090] Updated weights for policy 1, policy_version 1527523 (0.0009) [2023-12-26 11:52:21,201][123090] Updated weights for policy 1, policy_version 1527533 (0.0008) [2023-12-26 11:52:21,267][123090] Updated weights for policy 1, policy_version 1527543 (0.0008) [2023-12-26 11:52:21,474][123091] Updated weights for policy 0, policy_version 1537587 (0.0009) [2023-12-26 11:52:21,537][123091] Updated weights for policy 0, policy_version 1537597 (0.0008) [2023-12-26 11:52:21,602][123091] Updated weights for policy 0, policy_version 1537607 (0.0007) [2023-12-26 11:52:22,059][123090] Updated weights for policy 1, policy_version 1527553 (0.0008) [2023-12-26 11:52:22,134][123090] Updated weights for policy 1, policy_version 1527563 (0.0006) [2023-12-26 11:52:22,196][123090] Updated weights for policy 1, policy_version 1527573 (0.0005) [2023-12-26 11:52:22,265][123090] Updated weights for policy 1, policy_version 1527583 (0.0008) [2023-12-26 11:52:22,325][123091] Updated weights for policy 0, policy_version 1537617 (0.0009) [2023-12-26 11:52:22,389][123091] Updated weights for policy 0, policy_version 1537627 (0.0009) [2023-12-26 11:52:22,451][123091] Updated weights for policy 0, policy_version 1537637 (0.0009) [2023-12-26 11:52:22,502][123091] Updated weights for policy 0, policy_version 1537647 (0.0009) [2023-12-26 11:52:23,035][123090] Updated weights for policy 1, policy_version 1527593 (0.0009) [2023-12-26 11:52:23,088][123090] Updated weights for policy 1, policy_version 1527603 (0.0010) [2023-12-26 11:52:23,140][123090] Updated weights for policy 1, policy_version 1527613 (0.0010) [2023-12-26 11:52:23,333][123091] Updated weights for policy 0, policy_version 1537657 (0.0009) [2023-12-26 11:52:23,391][123091] Updated weights for policy 0, policy_version 1537667 (0.0008) [2023-12-26 11:52:23,449][123091] Updated weights for policy 0, policy_version 1537677 (0.0009) [2023-12-26 11:52:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18432.0, 300 sec: 17772.5). Total num frames: 784719872. Throughput: 0: 9080.3, 1: 9033.9. Samples: 784695556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:23,785][121949] Avg episode reward: [(0, '6281.729'), (1, '5373.399')] [2023-12-26 11:52:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001537680_393650176.pth... [2023-12-26 11:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001527616_391069696.pth... [2023-12-26 11:52:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001536624_393379840.pth [2023-12-26 11:52:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001526560_390799360.pth [2023-12-26 11:52:23,888][123090] Updated weights for policy 1, policy_version 1527623 (0.0007) [2023-12-26 11:52:23,944][123090] Updated weights for policy 1, policy_version 1527633 (0.0005) [2023-12-26 11:52:23,993][123090] Updated weights for policy 1, policy_version 1527643 (0.0005) [2023-12-26 11:52:24,360][123091] Updated weights for policy 0, policy_version 1537687 (0.0009) [2023-12-26 11:52:24,423][123091] Updated weights for policy 0, policy_version 1537697 (0.0006) [2023-12-26 11:52:24,492][123091] Updated weights for policy 0, policy_version 1537707 (0.0010) [2023-12-26 11:52:24,663][123090] Updated weights for policy 1, policy_version 1527653 (0.0005) [2023-12-26 11:52:24,712][123090] Updated weights for policy 1, policy_version 1527663 (0.0005) [2023-12-26 11:52:24,764][123090] Updated weights for policy 1, policy_version 1527673 (0.0007) [2023-12-26 11:52:25,234][123091] Updated weights for policy 0, policy_version 1537717 (0.0008) [2023-12-26 11:52:25,279][123091] Updated weights for policy 0, policy_version 1537727 (0.0005) [2023-12-26 11:52:25,327][123091] Updated weights for policy 0, policy_version 1537737 (0.0005) [2023-12-26 11:52:25,569][123090] Updated weights for policy 1, policy_version 1527683 (0.0010) [2023-12-26 11:52:25,623][123090] Updated weights for policy 1, policy_version 1527693 (0.0010) [2023-12-26 11:52:25,688][123090] Updated weights for policy 1, policy_version 1527703 (0.0010) [2023-12-26 11:52:26,003][123091] Updated weights for policy 0, policy_version 1537747 (0.0005) [2023-12-26 11:52:26,064][123091] Updated weights for policy 0, policy_version 1537757 (0.0005) [2023-12-26 11:52:26,115][123091] Updated weights for policy 0, policy_version 1537767 (0.0005) [2023-12-26 11:52:26,443][123090] Updated weights for policy 1, policy_version 1527713 (0.0010) [2023-12-26 11:52:26,508][123090] Updated weights for policy 1, policy_version 1527723 (0.0010) [2023-12-26 11:52:26,574][123090] Updated weights for policy 1, policy_version 1527733 (0.0007) [2023-12-26 11:52:26,644][123090] Updated weights for policy 1, policy_version 1527743 (0.0005) [2023-12-26 11:52:26,744][123091] Updated weights for policy 0, policy_version 1537777 (0.0005) [2023-12-26 11:52:26,799][123091] Updated weights for policy 0, policy_version 1537787 (0.0005) [2023-12-26 11:52:26,873][123091] Updated weights for policy 0, policy_version 1537797 (0.0005) [2023-12-26 11:52:26,939][123091] Updated weights for policy 0, policy_version 1537807 (0.0005) [2023-12-26 11:52:27,321][123090] Updated weights for policy 1, policy_version 1527753 (0.0007) [2023-12-26 11:52:27,371][123090] Updated weights for policy 1, policy_version 1527763 (0.0010) [2023-12-26 11:52:27,430][123090] Updated weights for policy 1, policy_version 1527773 (0.0008) [2023-12-26 11:52:27,512][123091] Updated weights for policy 0, policy_version 1537817 (0.0005) [2023-12-26 11:52:27,566][123091] Updated weights for policy 0, policy_version 1537827 (0.0005) [2023-12-26 11:52:27,619][123091] Updated weights for policy 0, policy_version 1537837 (0.0005) [2023-12-26 11:52:28,079][123090] Updated weights for policy 1, policy_version 1527783 (0.0007) [2023-12-26 11:52:28,141][123090] Updated weights for policy 1, policy_version 1527793 (0.0010) [2023-12-26 11:52:28,204][123090] Updated weights for policy 1, policy_version 1527803 (0.0010) [2023-12-26 11:52:28,286][123091] Updated weights for policy 0, policy_version 1537847 (0.0005) [2023-12-26 11:52:28,345][123091] Updated weights for policy 0, policy_version 1537857 (0.0007) [2023-12-26 11:52:28,404][123091] Updated weights for policy 0, policy_version 1537867 (0.0008) [2023-12-26 11:52:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18432.0, 300 sec: 17828.0). Total num frames: 784818176. Throughput: 0: 9170.6, 1: 9120.3. Samples: 784809068. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:28,785][121949] Avg episode reward: [(0, '6380.711'), (1, '5594.467')] [2023-12-26 11:52:29,016][123090] Updated weights for policy 1, policy_version 1527813 (0.0009) [2023-12-26 11:52:29,069][123090] Updated weights for policy 1, policy_version 1527823 (0.0007) [2023-12-26 11:52:29,125][123090] Updated weights for policy 1, policy_version 1527833 (0.0005) [2023-12-26 11:52:29,198][123091] Updated weights for policy 0, policy_version 1537877 (0.0009) [2023-12-26 11:52:29,263][123091] Updated weights for policy 0, policy_version 1537887 (0.0009) [2023-12-26 11:52:29,330][123091] Updated weights for policy 0, policy_version 1537897 (0.0006) [2023-12-26 11:52:29,955][123090] Updated weights for policy 1, policy_version 1527843 (0.0007) [2023-12-26 11:52:30,005][123090] Updated weights for policy 1, policy_version 1527853 (0.0010) [2023-12-26 11:52:30,069][123091] Updated weights for policy 0, policy_version 1537907 (0.0009) [2023-12-26 11:52:30,080][123090] Updated weights for policy 1, policy_version 1527863 (0.0005) [2023-12-26 11:52:30,124][123091] Updated weights for policy 0, policy_version 1537917 (0.0008) [2023-12-26 11:52:30,189][123091] Updated weights for policy 0, policy_version 1537927 (0.0009) [2023-12-26 11:52:30,876][123090] Updated weights for policy 1, policy_version 1527873 (0.0006) [2023-12-26 11:52:30,927][123090] Updated weights for policy 1, policy_version 1527883 (0.0009) [2023-12-26 11:52:30,979][123090] Updated weights for policy 1, policy_version 1527893 (0.0010) [2023-12-26 11:52:31,017][123091] Updated weights for policy 0, policy_version 1537937 (0.0010) [2023-12-26 11:52:31,034][123090] Updated weights for policy 1, policy_version 1527904 (0.0008) [2023-12-26 11:52:31,080][123091] Updated weights for policy 0, policy_version 1537947 (0.0008) [2023-12-26 11:52:31,133][123091] Updated weights for policy 0, policy_version 1537957 (0.0010) [2023-12-26 11:52:31,194][123091] Updated weights for policy 0, policy_version 1537967 (0.0011) [2023-12-26 11:52:31,925][123090] Updated weights for policy 1, policy_version 1527914 (0.0010) [2023-12-26 11:52:31,991][123090] Updated weights for policy 1, policy_version 1527924 (0.0010) [2023-12-26 11:52:31,997][123091] Updated weights for policy 0, policy_version 1537977 (0.0009) [2023-12-26 11:52:32,058][123090] Updated weights for policy 1, policy_version 1527934 (0.0011) [2023-12-26 11:52:32,066][123091] Updated weights for policy 0, policy_version 1537987 (0.0009) [2023-12-26 11:52:32,132][123091] Updated weights for policy 0, policy_version 1537997 (0.0006) [2023-12-26 11:52:32,879][123091] Updated weights for policy 0, policy_version 1538007 (0.0008) [2023-12-26 11:52:32,894][123090] Updated weights for policy 1, policy_version 1527944 (0.0010) [2023-12-26 11:52:32,948][123091] Updated weights for policy 0, policy_version 1538017 (0.0007) [2023-12-26 11:52:32,949][123090] Updated weights for policy 1, policy_version 1527954 (0.0005) [2023-12-26 11:52:33,001][123091] Updated weights for policy 0, policy_version 1538027 (0.0009) [2023-12-26 11:52:33,005][123090] Updated weights for policy 1, policy_version 1527964 (0.0005) [2023-12-26 11:52:33,664][123090] Updated weights for policy 1, policy_version 1527974 (0.0006) [2023-12-26 11:52:33,732][123090] Updated weights for policy 1, policy_version 1527984 (0.0005) [2023-12-26 11:52:33,783][123091] Updated weights for policy 0, policy_version 1538037 (0.0008) [2023-12-26 11:52:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18159.0, 300 sec: 17800.2). Total num frames: 784900096. Throughput: 0: 9111.0, 1: 9048.1. Samples: 784918644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:33,785][121949] Avg episode reward: [(0, '6350.027'), (1, '5632.239')] [2023-12-26 11:52:33,795][123090] Updated weights for policy 1, policy_version 1527994 (0.0008) [2023-12-26 11:52:33,845][123091] Updated weights for policy 0, policy_version 1538047 (0.0009) [2023-12-26 11:52:33,911][123091] Updated weights for policy 0, policy_version 1538057 (0.0008) [2023-12-26 11:52:34,538][123090] Updated weights for policy 1, policy_version 1528004 (0.0006) [2023-12-26 11:52:34,603][123091] Updated weights for policy 0, policy_version 1538067 (0.0009) [2023-12-26 11:52:34,639][123090] Updated weights for policy 1, policy_version 1528014 (0.0006) [2023-12-26 11:52:34,669][123091] Updated weights for policy 0, policy_version 1538077 (0.0013) [2023-12-26 11:52:34,712][123090] Updated weights for policy 1, policy_version 1528024 (0.0006) [2023-12-26 11:52:34,735][123091] Updated weights for policy 0, policy_version 1538087 (0.0011) [2023-12-26 11:52:35,451][123090] Updated weights for policy 1, policy_version 1528034 (0.0006) [2023-12-26 11:52:35,521][123090] Updated weights for policy 1, policy_version 1528044 (0.0007) [2023-12-26 11:52:35,535][123091] Updated weights for policy 0, policy_version 1538097 (0.0010) [2023-12-26 11:52:35,595][123090] Updated weights for policy 1, policy_version 1528054 (0.0008) [2023-12-26 11:52:35,599][123091] Updated weights for policy 0, policy_version 1538107 (0.0009) [2023-12-26 11:52:35,654][123091] Updated weights for policy 0, policy_version 1538117 (0.0009) [2023-12-26 11:52:35,657][123090] Updated weights for policy 1, policy_version 1528064 (0.0008) [2023-12-26 11:52:35,703][123091] Updated weights for policy 0, policy_version 1538127 (0.0009) [2023-12-26 11:52:36,505][123091] Updated weights for policy 0, policy_version 1538137 (0.0009) [2023-12-26 11:52:36,532][123090] Updated weights for policy 1, policy_version 1528074 (0.0009) [2023-12-26 11:52:36,563][123091] Updated weights for policy 0, policy_version 1538147 (0.0008) [2023-12-26 11:52:36,591][123090] Updated weights for policy 1, policy_version 1528084 (0.0009) [2023-12-26 11:52:36,627][123091] Updated weights for policy 0, policy_version 1538157 (0.0011) [2023-12-26 11:52:36,652][123090] Updated weights for policy 1, policy_version 1528094 (0.0007) [2023-12-26 11:52:37,302][123091] Updated weights for policy 0, policy_version 1538167 (0.0010) [2023-12-26 11:52:37,347][123091] Updated weights for policy 0, policy_version 1538177 (0.0010) [2023-12-26 11:52:37,391][123091] Updated weights for policy 0, policy_version 1538187 (0.0010) [2023-12-26 11:52:37,484][123090] Updated weights for policy 1, policy_version 1528104 (0.0006) [2023-12-26 11:52:37,548][123090] Updated weights for policy 1, policy_version 1528114 (0.0006) [2023-12-26 11:52:37,612][123090] Updated weights for policy 1, policy_version 1528124 (0.0005) [2023-12-26 11:52:38,229][123091] Updated weights for policy 0, policy_version 1538197 (0.0010) [2023-12-26 11:52:38,238][123090] Updated weights for policy 1, policy_version 1528134 (0.0005) [2023-12-26 11:52:38,293][123091] Updated weights for policy 0, policy_version 1538207 (0.0005) [2023-12-26 11:52:38,304][123090] Updated weights for policy 1, policy_version 1528144 (0.0005) [2023-12-26 11:52:38,369][123091] Updated weights for policy 0, policy_version 1538217 (0.0018) [2023-12-26 11:52:38,376][123090] Updated weights for policy 1, policy_version 1528154 (0.0006) [2023-12-26 11:52:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18295.4, 300 sec: 17828.0). Total num frames: 784998400. Throughput: 0: 9123.7, 1: 9060.3. Samples: 784972116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:38,785][121949] Avg episode reward: [(0, '6298.347'), (1, '5620.125')] [2023-12-26 11:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001538224_393789440.pth... [2023-12-26 11:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001528160_391208960.pth... [2023-12-26 11:52:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001537168_393519104.pth [2023-12-26 11:52:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001527104_390938624.pth [2023-12-26 11:52:39,083][123090] Updated weights for policy 1, policy_version 1528164 (0.0008) [2023-12-26 11:52:39,087][123091] Updated weights for policy 0, policy_version 1538227 (0.0007) [2023-12-26 11:52:39,139][123090] Updated weights for policy 1, policy_version 1528174 (0.0010) [2023-12-26 11:52:39,148][123091] Updated weights for policy 0, policy_version 1538237 (0.0011) [2023-12-26 11:52:39,203][123090] Updated weights for policy 1, policy_version 1528184 (0.0011) [2023-12-26 11:52:39,203][123091] Updated weights for policy 0, policy_version 1538247 (0.0011) [2023-12-26 11:52:40,012][123090] Updated weights for policy 1, policy_version 1528194 (0.0011) [2023-12-26 11:52:40,036][123091] Updated weights for policy 0, policy_version 1538257 (0.0011) [2023-12-26 11:52:40,077][123090] Updated weights for policy 1, policy_version 1528204 (0.0011) [2023-12-26 11:52:40,105][123091] Updated weights for policy 0, policy_version 1538267 (0.0010) [2023-12-26 11:52:40,146][123090] Updated weights for policy 1, policy_version 1528214 (0.0011) [2023-12-26 11:52:40,169][123091] Updated weights for policy 0, policy_version 1538277 (0.0011) [2023-12-26 11:52:40,214][123090] Updated weights for policy 1, policy_version 1528224 (0.0009) [2023-12-26 11:52:40,226][123091] Updated weights for policy 0, policy_version 1538287 (0.0009) [2023-12-26 11:52:40,825][123091] Updated weights for policy 0, policy_version 1538297 (0.0005) [2023-12-26 11:52:40,890][123091] Updated weights for policy 0, policy_version 1538307 (0.0010) [2023-12-26 11:52:40,914][123090] Updated weights for policy 1, policy_version 1528234 (0.0011) [2023-12-26 11:52:40,939][123091] Updated weights for policy 0, policy_version 1538317 (0.0006) [2023-12-26 11:52:40,974][123090] Updated weights for policy 1, policy_version 1528244 (0.0010) [2023-12-26 11:52:41,037][123090] Updated weights for policy 1, policy_version 1528254 (0.0011) [2023-12-26 11:52:41,822][123091] Updated weights for policy 0, policy_version 1538327 (0.0008) [2023-12-26 11:52:41,892][123091] Updated weights for policy 0, policy_version 1538337 (0.0009) [2023-12-26 11:52:41,907][123090] Updated weights for policy 1, policy_version 1528264 (0.0009) [2023-12-26 11:52:41,957][123091] Updated weights for policy 0, policy_version 1538347 (0.0007) [2023-12-26 11:52:41,977][123090] Updated weights for policy 1, policy_version 1528274 (0.0006) [2023-12-26 11:52:42,045][123090] Updated weights for policy 1, policy_version 1528284 (0.0006) [2023-12-26 11:52:42,735][123090] Updated weights for policy 1, policy_version 1528294 (0.0008) [2023-12-26 11:52:42,796][123090] Updated weights for policy 1, policy_version 1528304 (0.0008) [2023-12-26 11:52:42,798][123091] Updated weights for policy 0, policy_version 1538357 (0.0010) [2023-12-26 11:52:42,846][123091] Updated weights for policy 0, policy_version 1538367 (0.0011) [2023-12-26 11:52:42,861][123090] Updated weights for policy 1, policy_version 1528314 (0.0007) [2023-12-26 11:52:42,897][123091] Updated weights for policy 0, policy_version 1538377 (0.0010) [2023-12-26 11:52:43,568][123090] Updated weights for policy 1, policy_version 1528324 (0.0006) [2023-12-26 11:52:43,617][123090] Updated weights for policy 1, policy_version 1528334 (0.0005) [2023-12-26 11:52:43,682][123090] Updated weights for policy 1, policy_version 1528344 (0.0005) [2023-12-26 11:52:43,744][123091] Updated weights for policy 0, policy_version 1538387 (0.0011) [2023-12-26 11:52:43,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18295.5, 300 sec: 17855.8). Total num frames: 785088512. Throughput: 0: 9031.2, 1: 9025.8. Samples: 785080948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:43,784][121949] Avg episode reward: [(0, '6248.543'), (1, '5748.763')] [2023-12-26 11:52:43,811][123091] Updated weights for policy 0, policy_version 1538397 (0.0011) [2023-12-26 11:52:43,878][123091] Updated weights for policy 0, policy_version 1538407 (0.0011) [2023-12-26 11:52:44,505][123090] Updated weights for policy 1, policy_version 1528354 (0.0006) [2023-12-26 11:52:44,557][123090] Updated weights for policy 1, policy_version 1528364 (0.0009) [2023-12-26 11:52:44,603][123091] Updated weights for policy 0, policy_version 1538417 (0.0011) [2023-12-26 11:52:44,604][123090] Updated weights for policy 1, policy_version 1528374 (0.0008) [2023-12-26 11:52:44,655][123091] Updated weights for policy 0, policy_version 1538427 (0.0011) [2023-12-26 11:52:44,661][123090] Updated weights for policy 1, policy_version 1528384 (0.0006) [2023-12-26 11:52:44,706][123091] Updated weights for policy 0, policy_version 1538437 (0.0011) [2023-12-26 11:52:44,758][123091] Updated weights for policy 0, policy_version 1538447 (0.0010) [2023-12-26 11:52:45,536][123090] Updated weights for policy 1, policy_version 1528394 (0.0005) [2023-12-26 11:52:45,570][123091] Updated weights for policy 0, policy_version 1538457 (0.0011) [2023-12-26 11:52:45,598][123090] Updated weights for policy 1, policy_version 1528404 (0.0010) [2023-12-26 11:52:45,622][123091] Updated weights for policy 0, policy_version 1538467 (0.0011) [2023-12-26 11:52:45,655][123090] Updated weights for policy 1, policy_version 1528414 (0.0007) [2023-12-26 11:52:45,678][123091] Updated weights for policy 0, policy_version 1538477 (0.0011) [2023-12-26 11:52:46,443][123090] Updated weights for policy 1, policy_version 1528424 (0.0008) [2023-12-26 11:52:46,495][123090] Updated weights for policy 1, policy_version 1528434 (0.0009) [2023-12-26 11:52:46,527][123091] Updated weights for policy 0, policy_version 1538487 (0.0011) [2023-12-26 11:52:46,568][123090] Updated weights for policy 1, policy_version 1528444 (0.0005) [2023-12-26 11:52:46,589][123091] Updated weights for policy 0, policy_version 1538497 (0.0010) [2023-12-26 11:52:46,636][123091] Updated weights for policy 0, policy_version 1538507 (0.0010) [2023-12-26 11:52:47,363][123090] Updated weights for policy 1, policy_version 1528454 (0.0008) [2023-12-26 11:52:47,422][123090] Updated weights for policy 1, policy_version 1528464 (0.0008) [2023-12-26 11:52:47,470][123091] Updated weights for policy 0, policy_version 1538517 (0.0011) [2023-12-26 11:52:47,474][123090] Updated weights for policy 1, policy_version 1528474 (0.0008) [2023-12-26 11:52:47,535][123091] Updated weights for policy 0, policy_version 1538527 (0.0009) [2023-12-26 11:52:47,586][123091] Updated weights for policy 0, policy_version 1538537 (0.0010) [2023-12-26 11:52:48,319][123090] Updated weights for policy 1, policy_version 1528484 (0.0009) [2023-12-26 11:52:48,387][123090] Updated weights for policy 1, policy_version 1528494 (0.0010) [2023-12-26 11:52:48,407][123091] Updated weights for policy 0, policy_version 1538547 (0.0009) [2023-12-26 11:52:48,448][123090] Updated weights for policy 1, policy_version 1528504 (0.0010) [2023-12-26 11:52:48,475][123091] Updated weights for policy 0, policy_version 1538557 (0.0010) [2023-12-26 11:52:48,527][123091] Updated weights for policy 0, policy_version 1538567 (0.0011) [2023-12-26 11:52:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18159.0, 300 sec: 17855.8). Total num frames: 785178624. Throughput: 0: 8938.0, 1: 9032.6. Samples: 785186192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:48,785][121949] Avg episode reward: [(0, '6100.463'), (1, '5876.195')] [2023-12-26 11:52:49,140][123090] Updated weights for policy 1, policy_version 1528514 (0.0008) [2023-12-26 11:52:49,196][123090] Updated weights for policy 1, policy_version 1528524 (0.0010) [2023-12-26 11:52:49,265][123090] Updated weights for policy 1, policy_version 1528534 (0.0011) [2023-12-26 11:52:49,333][123090] Updated weights for policy 1, policy_version 1528544 (0.0011) [2023-12-26 11:52:49,365][123091] Updated weights for policy 0, policy_version 1538577 (0.0011) [2023-12-26 11:52:49,427][123091] Updated weights for policy 0, policy_version 1538587 (0.0011) [2023-12-26 11:52:49,478][123091] Updated weights for policy 0, policy_version 1538597 (0.0010) [2023-12-26 11:52:49,529][123091] Updated weights for policy 0, policy_version 1538607 (0.0010) [2023-12-26 11:52:50,161][123090] Updated weights for policy 1, policy_version 1528554 (0.0011) [2023-12-26 11:52:50,220][123090] Updated weights for policy 1, policy_version 1528564 (0.0010) [2023-12-26 11:52:50,276][123090] Updated weights for policy 1, policy_version 1528574 (0.0010) [2023-12-26 11:52:50,388][123091] Updated weights for policy 0, policy_version 1538617 (0.0007) [2023-12-26 11:52:50,461][123091] Updated weights for policy 0, policy_version 1538627 (0.0007) [2023-12-26 11:52:50,530][123091] Updated weights for policy 0, policy_version 1538637 (0.0008) [2023-12-26 11:52:51,158][123090] Updated weights for policy 1, policy_version 1528584 (0.0011) [2023-12-26 11:52:51,221][123090] Updated weights for policy 1, policy_version 1528594 (0.0010) [2023-12-26 11:52:51,284][123091] Updated weights for policy 0, policy_version 1538647 (0.0007) [2023-12-26 11:52:51,290][123090] Updated weights for policy 1, policy_version 1528604 (0.0011) [2023-12-26 11:52:51,351][123091] Updated weights for policy 0, policy_version 1538657 (0.0008) [2023-12-26 11:52:51,421][123091] Updated weights for policy 0, policy_version 1538667 (0.0009) [2023-12-26 11:52:52,085][123090] Updated weights for policy 1, policy_version 1528614 (0.0010) [2023-12-26 11:52:52,151][123090] Updated weights for policy 1, policy_version 1528624 (0.0009) [2023-12-26 11:52:52,219][123090] Updated weights for policy 1, policy_version 1528634 (0.0009) [2023-12-26 11:52:52,265][123091] Updated weights for policy 0, policy_version 1538677 (0.0008) [2023-12-26 11:52:52,328][123091] Updated weights for policy 0, policy_version 1538687 (0.0009) [2023-12-26 11:52:52,393][123091] Updated weights for policy 0, policy_version 1538698 (0.0010) [2023-12-26 11:52:52,983][123090] Updated weights for policy 1, policy_version 1528644 (0.0010) [2023-12-26 11:52:53,037][123090] Updated weights for policy 1, policy_version 1528654 (0.0008) [2023-12-26 11:52:53,102][123090] Updated weights for policy 1, policy_version 1528664 (0.0009) [2023-12-26 11:52:53,181][123091] Updated weights for policy 0, policy_version 1538708 (0.0008) [2023-12-26 11:52:53,231][123091] Updated weights for policy 0, policy_version 1538718 (0.0007) [2023-12-26 11:52:53,288][123091] Updated weights for policy 0, policy_version 1538728 (0.0005) [2023-12-26 11:52:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 785260544. Throughput: 0: 8934.9, 1: 9023.1. Samples: 785237732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:53,785][121949] Avg episode reward: [(0, '6037.696'), (1, '5602.482')] [2023-12-26 11:52:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001538736_393920512.pth... [2023-12-26 11:52:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001528672_391340032.pth... [2023-12-26 11:52:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001537680_393650176.pth [2023-12-26 11:52:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001527616_391069696.pth [2023-12-26 11:52:53,868][123090] Updated weights for policy 1, policy_version 1528674 (0.0008) [2023-12-26 11:52:53,918][123090] Updated weights for policy 1, policy_version 1528684 (0.0005) [2023-12-26 11:52:53,968][123090] Updated weights for policy 1, policy_version 1528694 (0.0005) [2023-12-26 11:52:54,017][123090] Updated weights for policy 1, policy_version 1528704 (0.0006) [2023-12-26 11:52:54,050][123091] Updated weights for policy 0, policy_version 1538738 (0.0007) [2023-12-26 11:52:54,115][123091] Updated weights for policy 0, policy_version 1538748 (0.0005) [2023-12-26 11:52:54,172][123091] Updated weights for policy 0, policy_version 1538758 (0.0005) [2023-12-26 11:52:54,223][123091] Updated weights for policy 0, policy_version 1538768 (0.0005) [2023-12-26 11:52:54,763][123090] Updated weights for policy 1, policy_version 1528714 (0.0005) [2023-12-26 11:52:54,831][123090] Updated weights for policy 1, policy_version 1528724 (0.0005) [2023-12-26 11:52:54,895][123090] Updated weights for policy 1, policy_version 1528735 (0.0008) [2023-12-26 11:52:55,033][123091] Updated weights for policy 0, policy_version 1538778 (0.0009) [2023-12-26 11:52:55,090][123091] Updated weights for policy 0, policy_version 1538788 (0.0009) [2023-12-26 11:52:55,143][123091] Updated weights for policy 0, policy_version 1538799 (0.0010) [2023-12-26 11:52:55,646][123090] Updated weights for policy 1, policy_version 1528745 (0.0006) [2023-12-26 11:52:55,701][123090] Updated weights for policy 1, policy_version 1528755 (0.0005) [2023-12-26 11:52:55,755][123090] Updated weights for policy 1, policy_version 1528765 (0.0005) [2023-12-26 11:52:55,952][123091] Updated weights for policy 0, policy_version 1538809 (0.0009) [2023-12-26 11:52:56,001][123091] Updated weights for policy 0, policy_version 1538819 (0.0009) [2023-12-26 11:52:56,059][123091] Updated weights for policy 0, policy_version 1538829 (0.0009) [2023-12-26 11:52:56,484][123090] Updated weights for policy 1, policy_version 1528775 (0.0005) [2023-12-26 11:52:56,528][123090] Updated weights for policy 1, policy_version 1528785 (0.0005) [2023-12-26 11:52:56,577][123090] Updated weights for policy 1, policy_version 1528795 (0.0005) [2023-12-26 11:52:56,948][123091] Updated weights for policy 0, policy_version 1538839 (0.0010) [2023-12-26 11:52:56,996][123091] Updated weights for policy 0, policy_version 1538849 (0.0009) [2023-12-26 11:52:57,050][123091] Updated weights for policy 0, policy_version 1538860 (0.0009) [2023-12-26 11:52:57,314][123090] Updated weights for policy 1, policy_version 1528805 (0.0006) [2023-12-26 11:52:57,378][123090] Updated weights for policy 1, policy_version 1528815 (0.0007) [2023-12-26 11:52:57,437][123090] Updated weights for policy 1, policy_version 1528825 (0.0009) [2023-12-26 11:52:57,896][123091] Updated weights for policy 0, policy_version 1538870 (0.0007) [2023-12-26 11:52:57,944][123091] Updated weights for policy 0, policy_version 1538880 (0.0005) [2023-12-26 11:52:57,997][123091] Updated weights for policy 0, policy_version 1538890 (0.0008) [2023-12-26 11:52:58,176][123090] Updated weights for policy 1, policy_version 1528835 (0.0008) [2023-12-26 11:52:58,228][123090] Updated weights for policy 1, policy_version 1528845 (0.0006) [2023-12-26 11:52:58,287][123090] Updated weights for policy 1, policy_version 1528855 (0.0006) [2023-12-26 11:52:58,773][123091] Updated weights for policy 0, policy_version 1538900 (0.0010) [2023-12-26 11:52:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 785350656. Throughput: 0: 8928.3, 1: 9084.8. Samples: 785346844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:52:58,785][121949] Avg episode reward: [(0, '6146.996'), (1, '5482.659')] [2023-12-26 11:52:58,836][123091] Updated weights for policy 0, policy_version 1538910 (0.0011) [2023-12-26 11:52:58,895][123091] Updated weights for policy 0, policy_version 1538920 (0.0010) [2023-12-26 11:52:59,133][123090] Updated weights for policy 1, policy_version 1528865 (0.0009) [2023-12-26 11:52:59,192][123090] Updated weights for policy 1, policy_version 1528875 (0.0010) [2023-12-26 11:52:59,257][123090] Updated weights for policy 1, policy_version 1528885 (0.0010) [2023-12-26 11:52:59,326][123090] Updated weights for policy 1, policy_version 1528895 (0.0011) [2023-12-26 11:52:59,640][123091] Updated weights for policy 0, policy_version 1538930 (0.0009) [2023-12-26 11:52:59,706][123091] Updated weights for policy 0, policy_version 1538940 (0.0007) [2023-12-26 11:52:59,778][123091] Updated weights for policy 0, policy_version 1538950 (0.0005) [2023-12-26 11:52:59,850][123091] Updated weights for policy 0, policy_version 1538960 (0.0007) [2023-12-26 11:53:00,158][123090] Updated weights for policy 1, policy_version 1528905 (0.0011) [2023-12-26 11:53:00,214][123090] Updated weights for policy 1, policy_version 1528915 (0.0010) [2023-12-26 11:53:00,262][123090] Updated weights for policy 1, policy_version 1528925 (0.0010) [2023-12-26 11:53:00,549][123091] Updated weights for policy 0, policy_version 1538970 (0.0010) [2023-12-26 11:53:00,611][123091] Updated weights for policy 0, policy_version 1538980 (0.0010) [2023-12-26 11:53:00,670][123091] Updated weights for policy 0, policy_version 1538990 (0.0010) [2023-12-26 11:53:01,042][123090] Updated weights for policy 1, policy_version 1528935 (0.0010) [2023-12-26 11:53:01,109][123090] Updated weights for policy 1, policy_version 1528945 (0.0010) [2023-12-26 11:53:01,182][123090] Updated weights for policy 1, policy_version 1528955 (0.0007) [2023-12-26 11:53:01,519][123091] Updated weights for policy 0, policy_version 1539000 (0.0010) [2023-12-26 11:53:01,578][123091] Updated weights for policy 0, policy_version 1539013 (0.0011) [2023-12-26 11:53:01,641][123091] Updated weights for policy 0, policy_version 1539024 (0.0010) [2023-12-26 11:53:01,897][123090] Updated weights for policy 1, policy_version 1528965 (0.0007) [2023-12-26 11:53:01,959][123090] Updated weights for policy 1, policy_version 1528975 (0.0005) [2023-12-26 11:53:02,014][123090] Updated weights for policy 1, policy_version 1528985 (0.0006) [2023-12-26 11:53:02,439][123091] Updated weights for policy 0, policy_version 1539034 (0.0009) [2023-12-26 11:53:02,489][123091] Updated weights for policy 0, policy_version 1539044 (0.0009) [2023-12-26 11:53:02,550][123091] Updated weights for policy 0, policy_version 1539054 (0.0009) [2023-12-26 11:53:02,791][123090] Updated weights for policy 1, policy_version 1528995 (0.0010) [2023-12-26 11:53:02,841][123090] Updated weights for policy 1, policy_version 1529005 (0.0010) [2023-12-26 11:53:02,886][123090] Updated weights for policy 1, policy_version 1529015 (0.0007) [2023-12-26 11:53:03,362][123091] Updated weights for policy 0, policy_version 1539064 (0.0006) [2023-12-26 11:53:03,408][123091] Updated weights for policy 0, policy_version 1539074 (0.0005) [2023-12-26 11:53:03,453][123091] Updated weights for policy 0, policy_version 1539084 (0.0005) [2023-12-26 11:53:03,534][123090] Updated weights for policy 1, policy_version 1529025 (0.0006) [2023-12-26 11:53:03,584][123090] Updated weights for policy 1, policy_version 1529035 (0.0010) [2023-12-26 11:53:03,628][123090] Updated weights for policy 1, policy_version 1529045 (0.0005) [2023-12-26 11:53:03,674][123090] Updated weights for policy 1, policy_version 1529055 (0.0005) [2023-12-26 11:53:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 785448960. Throughput: 0: 9011.7, 1: 9058.7. Samples: 785456852. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:03,785][121949] Avg episode reward: [(0, '6220.268'), (1, '5623.458')] [2023-12-26 11:53:04,223][123091] Updated weights for policy 0, policy_version 1539094 (0.0008) [2023-12-26 11:53:04,291][123091] Updated weights for policy 0, policy_version 1539104 (0.0009) [2023-12-26 11:53:04,360][123091] Updated weights for policy 0, policy_version 1539114 (0.0009) [2023-12-26 11:53:04,460][123090] Updated weights for policy 1, policy_version 1529065 (0.0010) [2023-12-26 11:53:04,526][123090] Updated weights for policy 1, policy_version 1529075 (0.0010) [2023-12-26 11:53:04,591][123090] Updated weights for policy 1, policy_version 1529085 (0.0008) [2023-12-26 11:53:05,076][123091] Updated weights for policy 0, policy_version 1539124 (0.0008) [2023-12-26 11:53:05,151][123091] Updated weights for policy 0, policy_version 1539134 (0.0005) [2023-12-26 11:53:05,212][123091] Updated weights for policy 0, policy_version 1539144 (0.0005) [2023-12-26 11:53:05,228][123090] Updated weights for policy 1, policy_version 1529095 (0.0005) [2023-12-26 11:53:05,289][123090] Updated weights for policy 1, policy_version 1529105 (0.0005) [2023-12-26 11:53:05,344][123090] Updated weights for policy 1, policy_version 1529115 (0.0005) [2023-12-26 11:53:05,791][123091] Updated weights for policy 0, policy_version 1539154 (0.0005) [2023-12-26 11:53:05,855][123091] Updated weights for policy 0, policy_version 1539164 (0.0006) [2023-12-26 11:53:05,920][123091] Updated weights for policy 0, policy_version 1539174 (0.0007) [2023-12-26 11:53:05,979][123091] Updated weights for policy 0, policy_version 1539184 (0.0006) [2023-12-26 11:53:06,022][123090] Updated weights for policy 1, policy_version 1529125 (0.0008) [2023-12-26 11:53:06,077][123090] Updated weights for policy 1, policy_version 1529135 (0.0011) [2023-12-26 11:53:06,140][123090] Updated weights for policy 1, policy_version 1529145 (0.0009) [2023-12-26 11:53:06,769][123091] Updated weights for policy 0, policy_version 1539194 (0.0005) [2023-12-26 11:53:06,827][123091] Updated weights for policy 0, policy_version 1539204 (0.0005) [2023-12-26 11:53:06,885][123091] Updated weights for policy 0, policy_version 1539214 (0.0005) [2023-12-26 11:53:07,021][123090] Updated weights for policy 1, policy_version 1529155 (0.0010) [2023-12-26 11:53:07,078][123090] Updated weights for policy 1, policy_version 1529165 (0.0009) [2023-12-26 11:53:07,142][123090] Updated weights for policy 1, policy_version 1529175 (0.0009) [2023-12-26 11:53:07,600][123091] Updated weights for policy 0, policy_version 1539224 (0.0005) [2023-12-26 11:53:07,654][123091] Updated weights for policy 0, policy_version 1539234 (0.0005) [2023-12-26 11:53:07,708][123091] Updated weights for policy 0, policy_version 1539244 (0.0005) [2023-12-26 11:53:07,894][123090] Updated weights for policy 1, policy_version 1529185 (0.0008) [2023-12-26 11:53:07,954][123090] Updated weights for policy 1, policy_version 1529195 (0.0005) [2023-12-26 11:53:08,006][123090] Updated weights for policy 1, policy_version 1529205 (0.0005) [2023-12-26 11:53:08,062][123090] Updated weights for policy 1, policy_version 1529215 (0.0006) [2023-12-26 11:53:08,330][123091] Updated weights for policy 0, policy_version 1539254 (0.0007) [2023-12-26 11:53:08,399][123091] Updated weights for policy 0, policy_version 1539264 (0.0009) [2023-12-26 11:53:08,467][123091] Updated weights for policy 0, policy_version 1539274 (0.0009) [2023-12-26 11:53:08,763][123090] Updated weights for policy 1, policy_version 1529225 (0.0009) [2023-12-26 11:53:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 785539072. Throughput: 0: 9063.9, 1: 9139.7. Samples: 785514716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:08,785][121949] Avg episode reward: [(0, '6107.071'), (1, '5554.648')] [2023-12-26 11:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001539280_394059776.pth... [2023-12-26 11:53:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001538224_393789440.pth [2023-12-26 11:53:08,817][123090] Updated weights for policy 1, policy_version 1529235 (0.0009) [2023-12-26 11:53:08,871][123090] Updated weights for policy 1, policy_version 1529245 (0.0009) [2023-12-26 11:53:08,882][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001529248_391487488.pth... [2023-12-26 11:53:08,885][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001528160_391208960.pth [2023-12-26 11:53:09,309][123091] Updated weights for policy 0, policy_version 1539284 (0.0009) [2023-12-26 11:53:09,373][123091] Updated weights for policy 0, policy_version 1539294 (0.0010) [2023-12-26 11:53:09,441][123091] Updated weights for policy 0, policy_version 1539304 (0.0010) [2023-12-26 11:53:09,749][123090] Updated weights for policy 1, policy_version 1529256 (0.0010) [2023-12-26 11:53:09,804][123090] Updated weights for policy 1, policy_version 1529266 (0.0009) [2023-12-26 11:53:09,873][123090] Updated weights for policy 1, policy_version 1529276 (0.0009) [2023-12-26 11:53:10,279][123091] Updated weights for policy 0, policy_version 1539314 (0.0010) [2023-12-26 11:53:10,333][123091] Updated weights for policy 0, policy_version 1539324 (0.0010) [2023-12-26 11:53:10,393][123091] Updated weights for policy 0, policy_version 1539334 (0.0010) [2023-12-26 11:53:10,461][123091] Updated weights for policy 0, policy_version 1539344 (0.0009) [2023-12-26 11:53:10,710][123090] Updated weights for policy 1, policy_version 1529286 (0.0008) [2023-12-26 11:53:10,766][123090] Updated weights for policy 1, policy_version 1529296 (0.0005) [2023-12-26 11:53:10,813][123090] Updated weights for policy 1, policy_version 1529306 (0.0005) [2023-12-26 11:53:11,322][123091] Updated weights for policy 0, policy_version 1539354 (0.0009) [2023-12-26 11:53:11,390][123091] Updated weights for policy 0, policy_version 1539364 (0.0010) [2023-12-26 11:53:11,448][123091] Updated weights for policy 0, policy_version 1539374 (0.0010) [2023-12-26 11:53:11,617][123090] Updated weights for policy 1, policy_version 1529316 (0.0009) [2023-12-26 11:53:11,685][123090] Updated weights for policy 1, policy_version 1529326 (0.0010) [2023-12-26 11:53:11,762][123090] Updated weights for policy 1, policy_version 1529336 (0.0010) [2023-12-26 11:53:12,315][123091] Updated weights for policy 0, policy_version 1539384 (0.0009) [2023-12-26 11:53:12,393][123091] Updated weights for policy 0, policy_version 1539394 (0.0011) [2023-12-26 11:53:12,451][123091] Updated weights for policy 0, policy_version 1539404 (0.0007) [2023-12-26 11:53:12,665][123090] Updated weights for policy 1, policy_version 1529346 (0.0009) [2023-12-26 11:53:12,728][123090] Updated weights for policy 1, policy_version 1529356 (0.0010) [2023-12-26 11:53:12,786][123090] Updated weights for policy 1, policy_version 1529366 (0.0010) [2023-12-26 11:53:12,843][123090] Updated weights for policy 1, policy_version 1529376 (0.0009) [2023-12-26 11:53:13,126][123091] Updated weights for policy 0, policy_version 1539414 (0.0007) [2023-12-26 11:53:13,191][123091] Updated weights for policy 0, policy_version 1539424 (0.0005) [2023-12-26 11:53:13,243][123091] Updated weights for policy 0, policy_version 1539434 (0.0005) [2023-12-26 11:53:13,773][123090] Updated weights for policy 1, policy_version 1529386 (0.0009) [2023-12-26 11:53:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 785620992. Throughput: 0: 8982.6, 1: 9028.4. Samples: 785619560. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:13,784][121949] Avg episode reward: [(0, '6170.499'), (1, '5681.172')] [2023-12-26 11:53:13,824][123090] Updated weights for policy 1, policy_version 1529396 (0.0008) [2023-12-26 11:53:13,877][123090] Updated weights for policy 1, policy_version 1529406 (0.0008) [2023-12-26 11:53:13,895][123091] Updated weights for policy 0, policy_version 1539444 (0.0005) [2023-12-26 11:53:13,945][123091] Updated weights for policy 0, policy_version 1539454 (0.0005) [2023-12-26 11:53:14,006][123091] Updated weights for policy 0, policy_version 1539464 (0.0005) [2023-12-26 11:53:14,693][123091] Updated weights for policy 0, policy_version 1539474 (0.0006) [2023-12-26 11:53:14,747][123091] Updated weights for policy 0, policy_version 1539484 (0.0010) [2023-12-26 11:53:14,782][123090] Updated weights for policy 1, policy_version 1529416 (0.0008) [2023-12-26 11:53:14,807][123091] Updated weights for policy 0, policy_version 1539494 (0.0007) [2023-12-26 11:53:14,846][123090] Updated weights for policy 1, policy_version 1529426 (0.0008) [2023-12-26 11:53:14,869][123091] Updated weights for policy 0, policy_version 1539504 (0.0006) [2023-12-26 11:53:14,922][123090] Updated weights for policy 1, policy_version 1529436 (0.0006) [2023-12-26 11:53:15,634][123091] Updated weights for policy 0, policy_version 1539514 (0.0010) [2023-12-26 11:53:15,686][123090] Updated weights for policy 1, policy_version 1529446 (0.0007) [2023-12-26 11:53:15,699][123091] Updated weights for policy 0, policy_version 1539524 (0.0005) [2023-12-26 11:53:15,747][123090] Updated weights for policy 1, policy_version 1529456 (0.0009) [2023-12-26 11:53:15,770][123091] Updated weights for policy 0, policy_version 1539534 (0.0007) [2023-12-26 11:53:15,798][123090] Updated weights for policy 1, policy_version 1529466 (0.0009) [2023-12-26 11:53:16,445][123091] Updated weights for policy 0, policy_version 1539544 (0.0011) [2023-12-26 11:53:16,500][123091] Updated weights for policy 0, policy_version 1539554 (0.0011) [2023-12-26 11:53:16,556][123091] Updated weights for policy 0, policy_version 1539564 (0.0011) [2023-12-26 11:53:16,717][123090] Updated weights for policy 1, policy_version 1529476 (0.0009) [2023-12-26 11:53:16,773][123090] Updated weights for policy 1, policy_version 1529486 (0.0009) [2023-12-26 11:53:16,840][123090] Updated weights for policy 1, policy_version 1529496 (0.0008) [2023-12-26 11:53:17,376][123091] Updated weights for policy 0, policy_version 1539574 (0.0011) [2023-12-26 11:53:17,434][123091] Updated weights for policy 0, policy_version 1539584 (0.0010) [2023-12-26 11:53:17,497][123091] Updated weights for policy 0, policy_version 1539594 (0.0011) [2023-12-26 11:53:17,674][123090] Updated weights for policy 1, policy_version 1529506 (0.0009) [2023-12-26 11:53:17,745][123090] Updated weights for policy 1, policy_version 1529516 (0.0009) [2023-12-26 11:53:17,809][123090] Updated weights for policy 1, policy_version 1529526 (0.0009) [2023-12-26 11:53:17,873][123090] Updated weights for policy 1, policy_version 1529536 (0.0009) [2023-12-26 11:53:18,247][123091] Updated weights for policy 0, policy_version 1539604 (0.0009) [2023-12-26 11:53:18,300][123091] Updated weights for policy 0, policy_version 1539614 (0.0005) [2023-12-26 11:53:18,362][123091] Updated weights for policy 0, policy_version 1539624 (0.0008) [2023-12-26 11:53:18,708][123090] Updated weights for policy 1, policy_version 1529546 (0.0005) [2023-12-26 11:53:18,778][123090] Updated weights for policy 1, policy_version 1529556 (0.0006) [2023-12-26 11:53:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 785711104. Throughput: 0: 9032.0, 1: 8923.2. Samples: 785726628. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:18,785][121949] Avg episode reward: [(0, '6119.728'), (1, '5658.770')] [2023-12-26 11:53:18,830][123090] Updated weights for policy 1, policy_version 1529566 (0.0006) [2023-12-26 11:53:19,000][123091] Updated weights for policy 0, policy_version 1539634 (0.0006) [2023-12-26 11:53:19,061][123091] Updated weights for policy 0, policy_version 1539644 (0.0006) [2023-12-26 11:53:19,120][123091] Updated weights for policy 0, policy_version 1539654 (0.0009) [2023-12-26 11:53:19,189][123091] Updated weights for policy 0, policy_version 1539664 (0.0009) [2023-12-26 11:53:19,542][123090] Updated weights for policy 1, policy_version 1529576 (0.0010) [2023-12-26 11:53:19,596][123090] Updated weights for policy 1, policy_version 1529586 (0.0010) [2023-12-26 11:53:19,653][123090] Updated weights for policy 1, policy_version 1529596 (0.0009) [2023-12-26 11:53:20,030][123091] Updated weights for policy 0, policy_version 1539674 (0.0010) [2023-12-26 11:53:20,095][123091] Updated weights for policy 0, policy_version 1539684 (0.0008) [2023-12-26 11:53:20,164][123091] Updated weights for policy 0, policy_version 1539694 (0.0006) [2023-12-26 11:53:20,595][123090] Updated weights for policy 1, policy_version 1529606 (0.0009) [2023-12-26 11:53:20,667][123090] Updated weights for policy 1, policy_version 1529616 (0.0010) [2023-12-26 11:53:20,738][123090] Updated weights for policy 1, policy_version 1529626 (0.0008) [2023-12-26 11:53:20,940][123091] Updated weights for policy 0, policy_version 1539704 (0.0006) [2023-12-26 11:53:21,006][123091] Updated weights for policy 0, policy_version 1539714 (0.0010) [2023-12-26 11:53:21,078][123091] Updated weights for policy 0, policy_version 1539724 (0.0009) [2023-12-26 11:53:21,581][123090] Updated weights for policy 1, policy_version 1529636 (0.0009) [2023-12-26 11:53:21,650][123090] Updated weights for policy 1, policy_version 1529646 (0.0008) [2023-12-26 11:53:21,727][123090] Updated weights for policy 1, policy_version 1529656 (0.0010) [2023-12-26 11:53:21,942][123091] Updated weights for policy 0, policy_version 1539734 (0.0010) [2023-12-26 11:53:21,997][123091] Updated weights for policy 0, policy_version 1539744 (0.0010) [2023-12-26 11:53:22,052][123091] Updated weights for policy 0, policy_version 1539754 (0.0009) [2023-12-26 11:53:22,571][123090] Updated weights for policy 1, policy_version 1529666 (0.0010) [2023-12-26 11:53:22,636][123090] Updated weights for policy 1, policy_version 1529676 (0.0009) [2023-12-26 11:53:22,704][123090] Updated weights for policy 1, policy_version 1529686 (0.0009) [2023-12-26 11:53:22,756][123090] Updated weights for policy 1, policy_version 1529696 (0.0006) [2023-12-26 11:53:22,950][123091] Updated weights for policy 0, policy_version 1539764 (0.0010) [2023-12-26 11:53:23,012][123091] Updated weights for policy 0, policy_version 1539774 (0.0010) [2023-12-26 11:53:23,077][123091] Updated weights for policy 0, policy_version 1539784 (0.0010) [2023-12-26 11:53:23,521][123090] Updated weights for policy 1, policy_version 1529706 (0.0009) [2023-12-26 11:53:23,581][123090] Updated weights for policy 1, policy_version 1529716 (0.0009) [2023-12-26 11:53:23,638][123090] Updated weights for policy 1, policy_version 1529726 (0.0009) [2023-12-26 11:53:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 785801216. Throughput: 0: 9000.3, 1: 8912.5. Samples: 785778188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:23,785][121949] Avg episode reward: [(0, '6215.181'), (1, '5720.687')] [2023-12-26 11:53:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001539792_394190848.pth... [2023-12-26 11:53:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001529728_391610368.pth... [2023-12-26 11:53:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001538736_393920512.pth [2023-12-26 11:53:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001528672_391340032.pth [2023-12-26 11:53:23,900][123091] Updated weights for policy 0, policy_version 1539794 (0.0009) [2023-12-26 11:53:23,956][123091] Updated weights for policy 0, policy_version 1539804 (0.0010) [2023-12-26 11:53:24,010][123091] Updated weights for policy 0, policy_version 1539814 (0.0009) [2023-12-26 11:53:24,060][123091] Updated weights for policy 0, policy_version 1539824 (0.0009) [2023-12-26 11:53:24,489][123090] Updated weights for policy 1, policy_version 1529736 (0.0008) [2023-12-26 11:53:24,543][123090] Updated weights for policy 1, policy_version 1529746 (0.0010) [2023-12-26 11:53:24,608][123090] Updated weights for policy 1, policy_version 1529756 (0.0010) [2023-12-26 11:53:24,827][123091] Updated weights for policy 0, policy_version 1539834 (0.0009) [2023-12-26 11:53:24,883][123091] Updated weights for policy 0, policy_version 1539844 (0.0009) [2023-12-26 11:53:24,943][123091] Updated weights for policy 0, policy_version 1539854 (0.0009) [2023-12-26 11:53:25,504][123090] Updated weights for policy 1, policy_version 1529766 (0.0010) [2023-12-26 11:53:25,558][123090] Updated weights for policy 1, policy_version 1529776 (0.0010) [2023-12-26 11:53:25,611][123090] Updated weights for policy 1, policy_version 1529786 (0.0010) [2023-12-26 11:53:25,689][123091] Updated weights for policy 0, policy_version 1539864 (0.0007) [2023-12-26 11:53:25,738][123091] Updated weights for policy 0, policy_version 1539875 (0.0009) [2023-12-26 11:53:25,786][123091] Updated weights for policy 0, policy_version 1539885 (0.0009) [2023-12-26 11:53:26,514][123090] Updated weights for policy 1, policy_version 1529797 (0.0008) [2023-12-26 11:53:26,520][123091] Updated weights for policy 0, policy_version 1539895 (0.0009) [2023-12-26 11:53:26,576][123091] Updated weights for policy 0, policy_version 1539905 (0.0009) [2023-12-26 11:53:26,578][123090] Updated weights for policy 1, policy_version 1529807 (0.0008) [2023-12-26 11:53:26,628][123091] Updated weights for policy 0, policy_version 1539915 (0.0007) [2023-12-26 11:53:26,630][123090] Updated weights for policy 1, policy_version 1529817 (0.0008) [2023-12-26 11:53:27,446][123090] Updated weights for policy 1, policy_version 1529827 (0.0009) [2023-12-26 11:53:27,465][123091] Updated weights for policy 0, policy_version 1539925 (0.0008) [2023-12-26 11:53:27,502][123090] Updated weights for policy 1, policy_version 1529837 (0.0007) [2023-12-26 11:53:27,531][123091] Updated weights for policy 0, policy_version 1539935 (0.0006) [2023-12-26 11:53:27,563][123090] Updated weights for policy 1, policy_version 1529847 (0.0007) [2023-12-26 11:53:27,587][123091] Updated weights for policy 0, policy_version 1539945 (0.0008) [2023-12-26 11:53:28,318][123091] Updated weights for policy 0, policy_version 1539955 (0.0006) [2023-12-26 11:53:28,383][123091] Updated weights for policy 0, policy_version 1539965 (0.0007) [2023-12-26 11:53:28,439][123090] Updated weights for policy 1, policy_version 1529857 (0.0008) [2023-12-26 11:53:28,454][123091] Updated weights for policy 0, policy_version 1539975 (0.0009) [2023-12-26 11:53:28,511][123090] Updated weights for policy 1, policy_version 1529867 (0.0009) [2023-12-26 11:53:28,592][123090] Updated weights for policy 1, policy_version 1529877 (0.0009) [2023-12-26 11:53:28,658][123090] Updated weights for policy 1, policy_version 1529887 (0.0010) [2023-12-26 11:53:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 785891328. Throughput: 0: 8988.6, 1: 8800.1. Samples: 785881444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:28,785][121949] Avg episode reward: [(0, '6182.944'), (1, '5711.979')] [2023-12-26 11:53:29,177][123091] Updated weights for policy 0, policy_version 1539985 (0.0007) [2023-12-26 11:53:29,241][123091] Updated weights for policy 0, policy_version 1539995 (0.0008) [2023-12-26 11:53:29,307][123091] Updated weights for policy 0, policy_version 1540005 (0.0007) [2023-12-26 11:53:29,375][123091] Updated weights for policy 0, policy_version 1540015 (0.0008) [2023-12-26 11:53:29,513][123090] Updated weights for policy 1, policy_version 1529897 (0.0009) [2023-12-26 11:53:29,582][123090] Updated weights for policy 1, policy_version 1529907 (0.0009) [2023-12-26 11:53:29,640][123090] Updated weights for policy 1, policy_version 1529917 (0.0009) [2023-12-26 11:53:30,085][123091] Updated weights for policy 0, policy_version 1540025 (0.0010) [2023-12-26 11:53:30,141][123091] Updated weights for policy 0, policy_version 1540035 (0.0009) [2023-12-26 11:53:30,205][123091] Updated weights for policy 0, policy_version 1540045 (0.0010) [2023-12-26 11:53:30,408][123090] Updated weights for policy 1, policy_version 1529927 (0.0009) [2023-12-26 11:53:30,473][123090] Updated weights for policy 1, policy_version 1529937 (0.0009) [2023-12-26 11:53:30,530][123090] Updated weights for policy 1, policy_version 1529947 (0.0009) [2023-12-26 11:53:30,989][123091] Updated weights for policy 0, policy_version 1540055 (0.0009) [2023-12-26 11:53:31,058][123091] Updated weights for policy 0, policy_version 1540065 (0.0009) [2023-12-26 11:53:31,123][123091] Updated weights for policy 0, policy_version 1540075 (0.0009) [2023-12-26 11:53:31,368][123090] Updated weights for policy 1, policy_version 1529957 (0.0009) [2023-12-26 11:53:31,422][123090] Updated weights for policy 1, policy_version 1529967 (0.0009) [2023-12-26 11:53:31,470][123090] Updated weights for policy 1, policy_version 1529977 (0.0009) [2023-12-26 11:53:31,957][123091] Updated weights for policy 0, policy_version 1540085 (0.0009) [2023-12-26 11:53:32,015][123091] Updated weights for policy 0, policy_version 1540095 (0.0009) [2023-12-26 11:53:32,065][123091] Updated weights for policy 0, policy_version 1540105 (0.0010) [2023-12-26 11:53:32,343][123090] Updated weights for policy 1, policy_version 1529987 (0.0009) [2023-12-26 11:53:32,407][123090] Updated weights for policy 1, policy_version 1529997 (0.0010) [2023-12-26 11:53:32,474][123090] Updated weights for policy 1, policy_version 1530007 (0.0009) [2023-12-26 11:53:32,899][123091] Updated weights for policy 0, policy_version 1540115 (0.0009) [2023-12-26 11:53:32,949][123091] Updated weights for policy 0, policy_version 1540125 (0.0008) [2023-12-26 11:53:33,007][123091] Updated weights for policy 0, policy_version 1540135 (0.0009) [2023-12-26 11:53:33,323][123090] Updated weights for policy 1, policy_version 1530017 (0.0009) [2023-12-26 11:53:33,372][123090] Updated weights for policy 1, policy_version 1530027 (0.0005) [2023-12-26 11:53:33,419][123090] Updated weights for policy 1, policy_version 1530037 (0.0005) [2023-12-26 11:53:33,469][123090] Updated weights for policy 1, policy_version 1530047 (0.0005) [2023-12-26 11:53:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 785973248. Throughput: 0: 9018.9, 1: 8754.7. Samples: 785986008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:33,785][121949] Avg episode reward: [(0, '6055.806'), (1, '5554.199')] [2023-12-26 11:53:33,858][123091] Updated weights for policy 0, policy_version 1540145 (0.0006) [2023-12-26 11:53:33,911][123091] Updated weights for policy 0, policy_version 1540155 (0.0009) [2023-12-26 11:53:33,970][123091] Updated weights for policy 0, policy_version 1540165 (0.0009) [2023-12-26 11:53:34,023][123091] Updated weights for policy 0, policy_version 1540175 (0.0010) [2023-12-26 11:53:34,129][123090] Updated weights for policy 1, policy_version 1530057 (0.0005) [2023-12-26 11:53:34,205][123090] Updated weights for policy 1, policy_version 1530067 (0.0008) [2023-12-26 11:53:34,263][123090] Updated weights for policy 1, policy_version 1530077 (0.0008) [2023-12-26 11:53:34,869][123091] Updated weights for policy 0, policy_version 1540185 (0.0009) [2023-12-26 11:53:34,917][123091] Updated weights for policy 0, policy_version 1540195 (0.0009) [2023-12-26 11:53:34,974][123091] Updated weights for policy 0, policy_version 1540205 (0.0009) [2023-12-26 11:53:35,072][123090] Updated weights for policy 1, policy_version 1530087 (0.0009) [2023-12-26 11:53:35,140][123090] Updated weights for policy 1, policy_version 1530097 (0.0008) [2023-12-26 11:53:35,210][123090] Updated weights for policy 1, policy_version 1530107 (0.0009) [2023-12-26 11:53:35,825][123091] Updated weights for policy 0, policy_version 1540215 (0.0009) [2023-12-26 11:53:35,869][123091] Updated weights for policy 0, policy_version 1540225 (0.0005) [2023-12-26 11:53:35,923][123091] Updated weights for policy 0, policy_version 1540235 (0.0008) [2023-12-26 11:53:35,999][123090] Updated weights for policy 1, policy_version 1530117 (0.0009) [2023-12-26 11:53:36,059][123090] Updated weights for policy 1, policy_version 1530127 (0.0009) [2023-12-26 11:53:36,114][123090] Updated weights for policy 1, policy_version 1530137 (0.0009) [2023-12-26 11:53:36,825][123090] Updated weights for policy 1, policy_version 1530147 (0.0007) [2023-12-26 11:53:36,826][123091] Updated weights for policy 0, policy_version 1540245 (0.0010) [2023-12-26 11:53:36,882][123091] Updated weights for policy 0, policy_version 1540255 (0.0009) [2023-12-26 11:53:36,887][123090] Updated weights for policy 1, policy_version 1530157 (0.0005) [2023-12-26 11:53:36,935][123091] Updated weights for policy 0, policy_version 1540265 (0.0009) [2023-12-26 11:53:36,950][123090] Updated weights for policy 1, policy_version 1530167 (0.0005) [2023-12-26 11:53:37,735][123090] Updated weights for policy 1, policy_version 1530177 (0.0006) [2023-12-26 11:53:37,763][123091] Updated weights for policy 0, policy_version 1540275 (0.0009) [2023-12-26 11:53:37,800][123090] Updated weights for policy 1, policy_version 1530187 (0.0008) [2023-12-26 11:53:37,818][123091] Updated weights for policy 0, policy_version 1540285 (0.0006) [2023-12-26 11:53:37,861][123090] Updated weights for policy 1, policy_version 1530197 (0.0009) [2023-12-26 11:53:37,873][123091] Updated weights for policy 0, policy_version 1540295 (0.0005) [2023-12-26 11:53:37,927][123090] Updated weights for policy 1, policy_version 1530207 (0.0009) [2023-12-26 11:53:38,708][123091] Updated weights for policy 0, policy_version 1540305 (0.0005) [2023-12-26 11:53:38,737][123090] Updated weights for policy 1, policy_version 1530217 (0.0010) [2023-12-26 11:53:38,768][123091] Updated weights for policy 0, policy_version 1540315 (0.0009) [2023-12-26 11:53:38,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 786055168. Throughput: 0: 8993.1, 1: 8800.3. Samples: 786038432. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:38,785][121949] Avg episode reward: [(0, '6182.202'), (1, '5636.146')] [2023-12-26 11:53:38,801][123090] Updated weights for policy 1, policy_version 1530227 (0.0010) [2023-12-26 11:53:38,830][123091] Updated weights for policy 0, policy_version 1540325 (0.0008) [2023-12-26 11:53:38,861][123090] Updated weights for policy 1, policy_version 1530237 (0.0010) [2023-12-26 11:53:38,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001530240_391741440.pth... [2023-12-26 11:53:38,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001529248_391487488.pth [2023-12-26 11:53:38,890][123091] Updated weights for policy 0, policy_version 1540335 (0.0007) [2023-12-26 11:53:38,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001540336_394330112.pth... [2023-12-26 11:53:38,898][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001539280_394059776.pth [2023-12-26 11:53:39,692][123091] Updated weights for policy 0, policy_version 1540345 (0.0008) [2023-12-26 11:53:39,703][123090] Updated weights for policy 1, policy_version 1530247 (0.0010) [2023-12-26 11:53:39,758][123091] Updated weights for policy 0, policy_version 1540355 (0.0006) [2023-12-26 11:53:39,767][123090] Updated weights for policy 1, policy_version 1530257 (0.0011) [2023-12-26 11:53:39,828][123091] Updated weights for policy 0, policy_version 1540365 (0.0006) [2023-12-26 11:53:39,839][123090] Updated weights for policy 1, policy_version 1530267 (0.0011) [2023-12-26 11:53:40,557][123091] Updated weights for policy 0, policy_version 1540375 (0.0006) [2023-12-26 11:53:40,563][123090] Updated weights for policy 1, policy_version 1530277 (0.0008) [2023-12-26 11:53:40,613][123091] Updated weights for policy 0, policy_version 1540385 (0.0006) [2023-12-26 11:53:40,620][123090] Updated weights for policy 1, policy_version 1530287 (0.0009) [2023-12-26 11:53:40,666][123091] Updated weights for policy 0, policy_version 1540395 (0.0010) [2023-12-26 11:53:40,676][123090] Updated weights for policy 1, policy_version 1530297 (0.0007) [2023-12-26 11:53:41,478][123091] Updated weights for policy 0, policy_version 1540405 (0.0009) [2023-12-26 11:53:41,488][123090] Updated weights for policy 1, policy_version 1530307 (0.0008) [2023-12-26 11:53:41,533][123091] Updated weights for policy 0, policy_version 1540415 (0.0008) [2023-12-26 11:53:41,552][123090] Updated weights for policy 1, policy_version 1530317 (0.0009) [2023-12-26 11:53:41,587][123091] Updated weights for policy 0, policy_version 1540425 (0.0007) [2023-12-26 11:53:41,616][123090] Updated weights for policy 1, policy_version 1530327 (0.0010) [2023-12-26 11:53:42,408][123091] Updated weights for policy 0, policy_version 1540435 (0.0010) [2023-12-26 11:53:42,468][123091] Updated weights for policy 0, policy_version 1540445 (0.0011) [2023-12-26 11:53:42,517][123090] Updated weights for policy 1, policy_version 1530337 (0.0009) [2023-12-26 11:53:42,535][123091] Updated weights for policy 0, policy_version 1540455 (0.0011) [2023-12-26 11:53:42,582][123090] Updated weights for policy 1, policy_version 1530347 (0.0006) [2023-12-26 11:53:42,644][123090] Updated weights for policy 1, policy_version 1530357 (0.0009) [2023-12-26 11:53:42,709][123090] Updated weights for policy 1, policy_version 1530367 (0.0009) [2023-12-26 11:53:43,344][123091] Updated weights for policy 0, policy_version 1540465 (0.0010) [2023-12-26 11:53:43,409][123091] Updated weights for policy 0, policy_version 1540475 (0.0006) [2023-12-26 11:53:43,459][123091] Updated weights for policy 0, policy_version 1540485 (0.0005) [2023-12-26 11:53:43,516][123091] Updated weights for policy 0, policy_version 1540495 (0.0007) [2023-12-26 11:53:43,519][123090] Updated weights for policy 1, policy_version 1530377 (0.0006) [2023-12-26 11:53:43,589][123090] Updated weights for policy 1, policy_version 1530387 (0.0009) [2023-12-26 11:53:43,650][123090] Updated weights for policy 1, policy_version 1530397 (0.0010) [2023-12-26 11:53:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 786153472. Throughput: 0: 8987.4, 1: 8695.9. Samples: 786142596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:43,785][121949] Avg episode reward: [(0, '6327.571'), (1, '5737.200')] [2023-12-26 11:53:44,168][123091] Updated weights for policy 0, policy_version 1540505 (0.0006) [2023-12-26 11:53:44,226][123091] Updated weights for policy 0, policy_version 1540515 (0.0010) [2023-12-26 11:53:44,285][123091] Updated weights for policy 0, policy_version 1540525 (0.0010) [2023-12-26 11:53:44,507][123090] Updated weights for policy 1, policy_version 1530407 (0.0009) [2023-12-26 11:53:44,572][123090] Updated weights for policy 1, policy_version 1530417 (0.0008) [2023-12-26 11:53:44,620][123090] Updated weights for policy 1, policy_version 1530427 (0.0005) [2023-12-26 11:53:45,098][123091] Updated weights for policy 0, policy_version 1540535 (0.0007) [2023-12-26 11:53:45,169][123091] Updated weights for policy 0, policy_version 1540545 (0.0010) [2023-12-26 11:53:45,234][123091] Updated weights for policy 0, policy_version 1540555 (0.0011) [2023-12-26 11:53:45,456][123090] Updated weights for policy 1, policy_version 1530437 (0.0005) [2023-12-26 11:53:45,527][123090] Updated weights for policy 1, policy_version 1530447 (0.0006) [2023-12-26 11:53:45,582][123090] Updated weights for policy 1, policy_version 1530457 (0.0005) [2023-12-26 11:53:45,979][123091] Updated weights for policy 0, policy_version 1540565 (0.0008) [2023-12-26 11:53:46,034][123091] Updated weights for policy 0, policy_version 1540575 (0.0006) [2023-12-26 11:53:46,083][123091] Updated weights for policy 0, policy_version 1540585 (0.0005) [2023-12-26 11:53:46,371][123090] Updated weights for policy 1, policy_version 1530467 (0.0007) [2023-12-26 11:53:46,430][123090] Updated weights for policy 1, policy_version 1530477 (0.0010) [2023-12-26 11:53:46,489][123090] Updated weights for policy 1, policy_version 1530487 (0.0010) [2023-12-26 11:53:46,813][123091] Updated weights for policy 0, policy_version 1540595 (0.0007) [2023-12-26 11:53:46,874][123091] Updated weights for policy 0, policy_version 1540605 (0.0010) [2023-12-26 11:53:46,928][123091] Updated weights for policy 0, policy_version 1540615 (0.0008) [2023-12-26 11:53:47,375][123090] Updated weights for policy 1, policy_version 1530497 (0.0008) [2023-12-26 11:53:47,434][123090] Updated weights for policy 1, policy_version 1530507 (0.0010) [2023-12-26 11:53:47,488][123090] Updated weights for policy 1, policy_version 1530517 (0.0010) [2023-12-26 11:53:47,541][123090] Updated weights for policy 1, policy_version 1530527 (0.0010) [2023-12-26 11:53:47,628][123091] Updated weights for policy 0, policy_version 1540625 (0.0008) [2023-12-26 11:53:47,675][123091] Updated weights for policy 0, policy_version 1540635 (0.0005) [2023-12-26 11:53:47,735][123091] Updated weights for policy 0, policy_version 1540645 (0.0005) [2023-12-26 11:53:47,784][123091] Updated weights for policy 0, policy_version 1540655 (0.0005) [2023-12-26 11:53:48,449][123090] Updated weights for policy 1, policy_version 1530537 (0.0006) [2023-12-26 11:53:48,490][123091] Updated weights for policy 0, policy_version 1540665 (0.0006) [2023-12-26 11:53:48,521][123090] Updated weights for policy 1, policy_version 1530547 (0.0005) [2023-12-26 11:53:48,555][123091] Updated weights for policy 0, policy_version 1540675 (0.0008) [2023-12-26 11:53:48,588][123090] Updated weights for policy 1, policy_version 1530557 (0.0008) [2023-12-26 11:53:48,610][123091] Updated weights for policy 0, policy_version 1540685 (0.0008) [2023-12-26 11:53:48,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.2, 300 sec: 17883.5). Total num frames: 786243584. Throughput: 0: 9052.5, 1: 8586.7. Samples: 786250620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 11:53:48,786][121949] Avg episode reward: [(0, '6182.219'), (1, '5412.468')] [2023-12-26 11:53:49,316][123090] Updated weights for policy 1, policy_version 1530567 (0.0007) [2023-12-26 11:53:49,388][123090] Updated weights for policy 1, policy_version 1530577 (0.0007) [2023-12-26 11:53:49,445][123091] Updated weights for policy 0, policy_version 1540695 (0.0007) [2023-12-26 11:53:49,458][123090] Updated weights for policy 1, policy_version 1530587 (0.0005) [2023-12-26 11:53:49,502][123091] Updated weights for policy 0, policy_version 1540705 (0.0005) [2023-12-26 11:53:49,553][123091] Updated weights for policy 0, policy_version 1540715 (0.0005) [2023-12-26 11:53:50,159][123090] Updated weights for policy 1, policy_version 1530597 (0.0009) [2023-12-26 11:53:50,220][123090] Updated weights for policy 1, policy_version 1530607 (0.0009) [2023-12-26 11:53:50,279][123090] Updated weights for policy 1, policy_version 1530617 (0.0010) [2023-12-26 11:53:50,335][123091] Updated weights for policy 0, policy_version 1540725 (0.0009) [2023-12-26 11:53:50,390][123091] Updated weights for policy 0, policy_version 1540735 (0.0010) [2023-12-26 11:53:50,449][123091] Updated weights for policy 0, policy_version 1540745 (0.0010) [2023-12-26 11:53:51,001][123090] Updated weights for policy 1, policy_version 1530627 (0.0010) [2023-12-26 11:53:51,071][123090] Updated weights for policy 1, policy_version 1530637 (0.0010) [2023-12-26 11:53:51,138][123090] Updated weights for policy 1, policy_version 1530647 (0.0010) [2023-12-26 11:53:51,337][123091] Updated weights for policy 0, policy_version 1540755 (0.0013) [2023-12-26 11:53:51,406][123091] Updated weights for policy 0, policy_version 1540765 (0.0009) [2023-12-26 11:53:51,466][123091] Updated weights for policy 0, policy_version 1540775 (0.0008) [2023-12-26 11:53:51,960][123090] Updated weights for policy 1, policy_version 1530657 (0.0008) [2023-12-26 11:53:52,032][123090] Updated weights for policy 1, policy_version 1530667 (0.0006) [2023-12-26 11:53:52,105][123090] Updated weights for policy 1, policy_version 1530677 (0.0006) [2023-12-26 11:53:52,172][123090] Updated weights for policy 1, policy_version 1530687 (0.0008) [2023-12-26 11:53:52,274][123091] Updated weights for policy 0, policy_version 1540785 (0.0008) [2023-12-26 11:53:52,347][123091] Updated weights for policy 0, policy_version 1540795 (0.0009) [2023-12-26 11:53:52,420][123091] Updated weights for policy 0, policy_version 1540805 (0.0009) [2023-12-26 11:53:52,480][123091] Updated weights for policy 0, policy_version 1540815 (0.0009) [2023-12-26 11:53:52,897][123090] Updated weights for policy 1, policy_version 1530697 (0.0006) [2023-12-26 11:53:52,958][123090] Updated weights for policy 1, policy_version 1530707 (0.0008) [2023-12-26 11:53:53,033][123090] Updated weights for policy 1, policy_version 1530717 (0.0009) [2023-12-26 11:53:53,356][123091] Updated weights for policy 0, policy_version 1540825 (0.0009) [2023-12-26 11:53:53,424][123091] Updated weights for policy 0, policy_version 1540835 (0.0005) [2023-12-26 11:53:53,494][123091] Updated weights for policy 0, policy_version 1540845 (0.0008) [2023-12-26 11:53:53,756][123090] Updated weights for policy 1, policy_version 1530727 (0.0008) [2023-12-26 11:53:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17883.5). Total num frames: 786325504. Throughput: 0: 8980.6, 1: 8544.2. Samples: 786303332. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:53:53,785][121949] Avg episode reward: [(0, '6187.886'), (1, '5333.891')] [2023-12-26 11:53:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001540848_394461184.pth... [2023-12-26 11:53:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001539792_394190848.pth [2023-12-26 11:53:53,797][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001540848_394461184.pth [2023-12-26 11:53:53,816][123090] Updated weights for policy 1, policy_version 1530737 (0.0005) [2023-12-26 11:53:53,864][123090] Updated weights for policy 1, policy_version 1530747 (0.0005) [2023-12-26 11:53:53,892][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001530752_391872512.pth... [2023-12-26 11:53:53,897][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001529728_391610368.pth [2023-12-26 11:53:53,898][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001530752_391872512.pth [2023-12-26 11:53:54,329][123091] Updated weights for policy 0, policy_version 1540855 (0.0009) [2023-12-26 11:53:54,390][123091] Updated weights for policy 0, policy_version 1540865 (0.0009) [2023-12-26 11:53:54,453][123091] Updated weights for policy 0, policy_version 1540875 (0.0009) [2023-12-26 11:53:54,629][123090] Updated weights for policy 1, policy_version 1530757 (0.0007) [2023-12-26 11:53:54,685][123090] Updated weights for policy 1, policy_version 1530767 (0.0009) [2023-12-26 11:53:54,753][123090] Updated weights for policy 1, policy_version 1530777 (0.0007) [2023-12-26 11:53:55,278][123091] Updated weights for policy 0, policy_version 1540885 (0.0010) [2023-12-26 11:53:55,331][123091] Updated weights for policy 0, policy_version 1540897 (0.0010) [2023-12-26 11:53:55,394][123091] Updated weights for policy 0, policy_version 1540907 (0.0010) [2023-12-26 11:53:55,568][123090] Updated weights for policy 1, policy_version 1530787 (0.0007) [2023-12-26 11:53:55,615][123090] Updated weights for policy 1, policy_version 1530797 (0.0009) [2023-12-26 11:53:55,680][123090] Updated weights for policy 1, policy_version 1530807 (0.0008) [2023-12-26 11:53:56,237][123091] Updated weights for policy 0, policy_version 1540917 (0.0009) [2023-12-26 11:53:56,289][123091] Updated weights for policy 0, policy_version 1540927 (0.0009) [2023-12-26 11:53:56,346][123091] Updated weights for policy 0, policy_version 1540937 (0.0009) [2023-12-26 11:53:56,442][123090] Updated weights for policy 1, policy_version 1530817 (0.0005) [2023-12-26 11:53:56,490][123090] Updated weights for policy 1, policy_version 1530827 (0.0005) [2023-12-26 11:53:56,540][123090] Updated weights for policy 1, policy_version 1530837 (0.0005) [2023-12-26 11:53:56,610][123090] Updated weights for policy 1, policy_version 1530847 (0.0005) [2023-12-26 11:53:57,100][123091] Updated weights for policy 0, policy_version 1540947 (0.0010) [2023-12-26 11:53:57,155][123091] Updated weights for policy 0, policy_version 1540957 (0.0009) [2023-12-26 11:53:57,217][123091] Updated weights for policy 0, policy_version 1540967 (0.0010) [2023-12-26 11:53:57,347][123090] Updated weights for policy 1, policy_version 1530857 (0.0009) [2023-12-26 11:53:57,403][123090] Updated weights for policy 1, policy_version 1530867 (0.0009) [2023-12-26 11:53:57,464][123090] Updated weights for policy 1, policy_version 1530877 (0.0010) [2023-12-26 11:53:57,996][123091] Updated weights for policy 0, policy_version 1540977 (0.0009) [2023-12-26 11:53:58,064][123091] Updated weights for policy 0, policy_version 1540987 (0.0008) [2023-12-26 11:53:58,136][123091] Updated weights for policy 0, policy_version 1540997 (0.0008) [2023-12-26 11:53:58,196][123091] Updated weights for policy 0, policy_version 1541007 (0.0007) [2023-12-26 11:53:58,338][123090] Updated weights for policy 1, policy_version 1530887 (0.0009) [2023-12-26 11:53:58,405][123090] Updated weights for policy 1, policy_version 1530897 (0.0009) [2023-12-26 11:53:58,463][123090] Updated weights for policy 1, policy_version 1530907 (0.0009) [2023-12-26 11:53:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 786415616. Throughput: 0: 8954.6, 1: 8622.1. Samples: 786410516. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:53:58,785][121949] Avg episode reward: [(0, '6288.431'), (1, '5590.388')] [2023-12-26 11:53:58,957][123091] Updated weights for policy 0, policy_version 1541017 (0.0007) [2023-12-26 11:53:59,029][123091] Updated weights for policy 0, policy_version 1541027 (0.0006) [2023-12-26 11:53:59,095][123091] Updated weights for policy 0, policy_version 1541037 (0.0009) [2023-12-26 11:53:59,260][123090] Updated weights for policy 1, policy_version 1530917 (0.0007) [2023-12-26 11:53:59,322][123090] Updated weights for policy 1, policy_version 1530927 (0.0010) [2023-12-26 11:53:59,390][123090] Updated weights for policy 1, policy_version 1530937 (0.0008) [2023-12-26 11:53:59,876][123091] Updated weights for policy 0, policy_version 1541047 (0.0010) [2023-12-26 11:53:59,928][123091] Updated weights for policy 0, policy_version 1541057 (0.0010) [2023-12-26 11:53:59,987][123091] Updated weights for policy 0, policy_version 1541067 (0.0010) [2023-12-26 11:54:00,191][123090] Updated weights for policy 1, policy_version 1530947 (0.0010) [2023-12-26 11:54:00,242][123090] Updated weights for policy 1, policy_version 1530957 (0.0009) [2023-12-26 11:54:00,303][123090] Updated weights for policy 1, policy_version 1530967 (0.0009) [2023-12-26 11:54:00,869][123091] Updated weights for policy 0, policy_version 1541077 (0.0010) [2023-12-26 11:54:00,931][123091] Updated weights for policy 0, policy_version 1541087 (0.0008) [2023-12-26 11:54:00,998][123091] Updated weights for policy 0, policy_version 1541097 (0.0008) [2023-12-26 11:54:01,032][123090] Updated weights for policy 1, policy_version 1530977 (0.0007) [2023-12-26 11:54:01,102][123090] Updated weights for policy 1, policy_version 1530987 (0.0006) [2023-12-26 11:54:01,170][123090] Updated weights for policy 1, policy_version 1530997 (0.0008) [2023-12-26 11:54:01,229][123090] Updated weights for policy 1, policy_version 1531007 (0.0007) [2023-12-26 11:54:01,922][123091] Updated weights for policy 0, policy_version 1541107 (0.0009) [2023-12-26 11:54:01,975][123090] Updated weights for policy 1, policy_version 1531017 (0.0008) [2023-12-26 11:54:01,982][123091] Updated weights for policy 0, policy_version 1541117 (0.0010) [2023-12-26 11:54:02,031][123090] Updated weights for policy 1, policy_version 1531027 (0.0006) [2023-12-26 11:54:02,048][123091] Updated weights for policy 0, policy_version 1541127 (0.0008) [2023-12-26 11:54:02,094][123090] Updated weights for policy 1, policy_version 1531037 (0.0010) [2023-12-26 11:54:02,709][123091] Updated weights for policy 0, policy_version 1541137 (0.0005) [2023-12-26 11:54:02,768][123091] Updated weights for policy 0, policy_version 1541147 (0.0008) [2023-12-26 11:54:02,823][123091] Updated weights for policy 0, policy_version 1541157 (0.0009) [2023-12-26 11:54:02,878][123091] Updated weights for policy 0, policy_version 1541167 (0.0009) [2023-12-26 11:54:02,972][123090] Updated weights for policy 1, policy_version 1531047 (0.0006) [2023-12-26 11:54:03,042][123090] Updated weights for policy 1, policy_version 1531057 (0.0005) [2023-12-26 11:54:03,100][123090] Updated weights for policy 1, policy_version 1531067 (0.0005) [2023-12-26 11:54:03,713][123090] Updated weights for policy 1, policy_version 1531077 (0.0005) [2023-12-26 11:54:03,727][123091] Updated weights for policy 0, policy_version 1541177 (0.0006) [2023-12-26 11:54:03,767][123090] Updated weights for policy 1, policy_version 1531087 (0.0005) [2023-12-26 11:54:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17855.8). Total num frames: 786497536. Throughput: 0: 8824.0, 1: 8719.8. Samples: 786516100. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:03,785][121949] Avg episode reward: [(0, '6305.989'), (1, '5554.571')] [2023-12-26 11:54:03,800][123091] Updated weights for policy 0, policy_version 1541187 (0.0007) [2023-12-26 11:54:03,834][123090] Updated weights for policy 1, policy_version 1531097 (0.0006) [2023-12-26 11:54:03,867][123091] Updated weights for policy 0, policy_version 1541197 (0.0008) [2023-12-26 11:54:04,549][123091] Updated weights for policy 0, policy_version 1541207 (0.0006) [2023-12-26 11:54:04,606][123091] Updated weights for policy 0, policy_version 1541217 (0.0005) [2023-12-26 11:54:04,661][123091] Updated weights for policy 0, policy_version 1541227 (0.0009) [2023-12-26 11:54:04,685][123090] Updated weights for policy 1, policy_version 1531107 (0.0007) [2023-12-26 11:54:04,749][123090] Updated weights for policy 1, policy_version 1531117 (0.0005) [2023-12-26 11:54:04,809][123090] Updated weights for policy 1, policy_version 1531127 (0.0008) [2023-12-26 11:54:05,340][123091] Updated weights for policy 0, policy_version 1541237 (0.0008) [2023-12-26 11:54:05,393][123091] Updated weights for policy 0, policy_version 1541247 (0.0005) [2023-12-26 11:54:05,443][123091] Updated weights for policy 0, policy_version 1541257 (0.0005) [2023-12-26 11:54:05,597][123090] Updated weights for policy 1, policy_version 1531137 (0.0009) [2023-12-26 11:54:05,662][123090] Updated weights for policy 1, policy_version 1531147 (0.0009) [2023-12-26 11:54:05,724][123090] Updated weights for policy 1, policy_version 1531157 (0.0010) [2023-12-26 11:54:05,772][123090] Updated weights for policy 1, policy_version 1531167 (0.0009) [2023-12-26 11:54:06,129][123091] Updated weights for policy 0, policy_version 1541267 (0.0006) [2023-12-26 11:54:06,194][123091] Updated weights for policy 0, policy_version 1541277 (0.0011) [2023-12-26 11:54:06,259][123091] Updated weights for policy 0, policy_version 1541287 (0.0010) [2023-12-26 11:54:06,655][123090] Updated weights for policy 1, policy_version 1531177 (0.0010) [2023-12-26 11:54:06,725][123090] Updated weights for policy 1, policy_version 1531187 (0.0010) [2023-12-26 11:54:06,795][123090] Updated weights for policy 1, policy_version 1531197 (0.0008) [2023-12-26 11:54:07,083][123091] Updated weights for policy 0, policy_version 1541297 (0.0010) [2023-12-26 11:54:07,131][123091] Updated weights for policy 0, policy_version 1541307 (0.0008) [2023-12-26 11:54:07,187][123091] Updated weights for policy 0, policy_version 1541317 (0.0009) [2023-12-26 11:54:07,253][123091] Updated weights for policy 0, policy_version 1541327 (0.0007) [2023-12-26 11:54:07,655][123090] Updated weights for policy 1, policy_version 1531207 (0.0009) [2023-12-26 11:54:07,727][123090] Updated weights for policy 1, policy_version 1531217 (0.0009) [2023-12-26 11:54:07,787][123090] Updated weights for policy 1, policy_version 1531227 (0.0009) [2023-12-26 11:54:08,061][123091] Updated weights for policy 0, policy_version 1541337 (0.0009) [2023-12-26 11:54:08,129][123091] Updated weights for policy 0, policy_version 1541347 (0.0009) [2023-12-26 11:54:08,194][123091] Updated weights for policy 0, policy_version 1541357 (0.0008) [2023-12-26 11:54:08,631][123090] Updated weights for policy 1, policy_version 1531238 (0.0009) [2023-12-26 11:54:08,698][123090] Updated weights for policy 1, policy_version 1531248 (0.0009) [2023-12-26 11:54:08,751][123090] Updated weights for policy 1, policy_version 1531258 (0.0010) [2023-12-26 11:54:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 786595840. Throughput: 0: 8882.0, 1: 8728.6. Samples: 786570664. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:08,784][121949] Avg episode reward: [(0, '6332.819'), (1, '5326.058')] [2023-12-26 11:54:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001541360_394592256.pth... [2023-12-26 11:54:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001531264_392003584.pth... [2023-12-26 11:54:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001540336_394330112.pth [2023-12-26 11:54:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001530240_391741440.pth [2023-12-26 11:54:08,977][123091] Updated weights for policy 0, policy_version 1541367 (0.0008) [2023-12-26 11:54:09,026][123091] Updated weights for policy 0, policy_version 1541377 (0.0009) [2023-12-26 11:54:09,079][123091] Updated weights for policy 0, policy_version 1541387 (0.0009) [2023-12-26 11:54:09,657][123090] Updated weights for policy 1, policy_version 1531268 (0.0008) [2023-12-26 11:54:09,716][123090] Updated weights for policy 1, policy_version 1531278 (0.0010) [2023-12-26 11:54:09,781][123090] Updated weights for policy 1, policy_version 1531288 (0.0010) [2023-12-26 11:54:09,887][123091] Updated weights for policy 0, policy_version 1541397 (0.0010) [2023-12-26 11:54:09,948][123091] Updated weights for policy 0, policy_version 1541407 (0.0009) [2023-12-26 11:54:10,014][123091] Updated weights for policy 0, policy_version 1541417 (0.0011) [2023-12-26 11:54:10,647][123090] Updated weights for policy 1, policy_version 1531298 (0.0009) [2023-12-26 11:54:10,714][123090] Updated weights for policy 1, policy_version 1531308 (0.0009) [2023-12-26 11:54:10,784][123090] Updated weights for policy 1, policy_version 1531318 (0.0010) [2023-12-26 11:54:10,850][123090] Updated weights for policy 1, policy_version 1531328 (0.0009) [2023-12-26 11:54:10,871][123091] Updated weights for policy 0, policy_version 1541427 (0.0010) [2023-12-26 11:54:10,935][123091] Updated weights for policy 0, policy_version 1541437 (0.0010) [2023-12-26 11:54:10,998][123091] Updated weights for policy 0, policy_version 1541447 (0.0009) [2023-12-26 11:54:11,613][123090] Updated weights for policy 1, policy_version 1531338 (0.0009) [2023-12-26 11:54:11,686][123090] Updated weights for policy 1, policy_version 1531348 (0.0009) [2023-12-26 11:54:11,756][123090] Updated weights for policy 1, policy_version 1531358 (0.0009) [2023-12-26 11:54:11,897][123091] Updated weights for policy 0, policy_version 1541457 (0.0009) [2023-12-26 11:54:11,946][123091] Updated weights for policy 0, policy_version 1541467 (0.0009) [2023-12-26 11:54:12,000][123091] Updated weights for policy 0, policy_version 1541477 (0.0009) [2023-12-26 11:54:12,052][123091] Updated weights for policy 0, policy_version 1541487 (0.0010) [2023-12-26 11:54:12,570][123090] Updated weights for policy 1, policy_version 1531368 (0.0006) [2023-12-26 11:54:12,649][123090] Updated weights for policy 1, policy_version 1531378 (0.0006) [2023-12-26 11:54:12,717][123090] Updated weights for policy 1, policy_version 1531388 (0.0009) [2023-12-26 11:54:12,974][123091] Updated weights for policy 0, policy_version 1541497 (0.0010) [2023-12-26 11:54:13,047][123091] Updated weights for policy 0, policy_version 1541507 (0.0010) [2023-12-26 11:54:13,111][123091] Updated weights for policy 0, policy_version 1541517 (0.0009) [2023-12-26 11:54:13,374][123090] Updated weights for policy 1, policy_version 1531398 (0.0009) [2023-12-26 11:54:13,438][123090] Updated weights for policy 1, policy_version 1531408 (0.0010) [2023-12-26 11:54:13,495][123090] Updated weights for policy 1, policy_version 1531418 (0.0009) [2023-12-26 11:54:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17883.5). Total num frames: 786677760. Throughput: 0: 8839.5, 1: 8719.7. Samples: 786671608. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:13,785][121949] Avg episode reward: [(0, '6352.232'), (1, '5251.338')] [2023-12-26 11:54:13,969][123091] Updated weights for policy 0, policy_version 1541527 (0.0010) [2023-12-26 11:54:14,035][123091] Updated weights for policy 0, policy_version 1541537 (0.0010) [2023-12-26 11:54:14,101][123091] Updated weights for policy 0, policy_version 1541547 (0.0010) [2023-12-26 11:54:14,286][123090] Updated weights for policy 1, policy_version 1531428 (0.0008) [2023-12-26 11:54:14,346][123090] Updated weights for policy 1, policy_version 1531438 (0.0010) [2023-12-26 11:54:14,399][123090] Updated weights for policy 1, policy_version 1531448 (0.0009) [2023-12-26 11:54:14,941][123091] Updated weights for policy 0, policy_version 1541557 (0.0010) [2023-12-26 11:54:15,001][123091] Updated weights for policy 0, policy_version 1541567 (0.0009) [2023-12-26 11:54:15,064][123091] Updated weights for policy 0, policy_version 1541577 (0.0009) [2023-12-26 11:54:15,259][123090] Updated weights for policy 1, policy_version 1531458 (0.0009) [2023-12-26 11:54:15,323][123090] Updated weights for policy 1, policy_version 1531468 (0.0009) [2023-12-26 11:54:15,386][123090] Updated weights for policy 1, policy_version 1531478 (0.0010) [2023-12-26 11:54:15,447][123090] Updated weights for policy 1, policy_version 1531488 (0.0009) [2023-12-26 11:54:15,899][123091] Updated weights for policy 0, policy_version 1541587 (0.0010) [2023-12-26 11:54:15,959][123091] Updated weights for policy 0, policy_version 1541597 (0.0009) [2023-12-26 11:54:16,027][123091] Updated weights for policy 0, policy_version 1541607 (0.0009) [2023-12-26 11:54:16,278][123090] Updated weights for policy 1, policy_version 1531498 (0.0009) [2023-12-26 11:54:16,350][123090] Updated weights for policy 1, policy_version 1531508 (0.0009) [2023-12-26 11:54:16,406][123090] Updated weights for policy 1, policy_version 1531518 (0.0008) [2023-12-26 11:54:16,861][123091] Updated weights for policy 0, policy_version 1541617 (0.0009) [2023-12-26 11:54:16,921][123091] Updated weights for policy 0, policy_version 1541627 (0.0009) [2023-12-26 11:54:16,975][123091] Updated weights for policy 0, policy_version 1541637 (0.0009) [2023-12-26 11:54:17,038][123091] Updated weights for policy 0, policy_version 1541647 (0.0008) [2023-12-26 11:54:17,133][123090] Updated weights for policy 1, policy_version 1531528 (0.0010) [2023-12-26 11:54:17,200][123090] Updated weights for policy 1, policy_version 1531538 (0.0010) [2023-12-26 11:54:17,272][123090] Updated weights for policy 1, policy_version 1531548 (0.0007) [2023-12-26 11:54:17,913][123091] Updated weights for policy 0, policy_version 1541657 (0.0006) [2023-12-26 11:54:17,925][123090] Updated weights for policy 1, policy_version 1531558 (0.0007) [2023-12-26 11:54:17,977][123091] Updated weights for policy 0, policy_version 1541667 (0.0007) [2023-12-26 11:54:17,989][123090] Updated weights for policy 1, policy_version 1531568 (0.0006) [2023-12-26 11:54:18,041][123090] Updated weights for policy 1, policy_version 1531578 (0.0007) [2023-12-26 11:54:18,044][123091] Updated weights for policy 0, policy_version 1541677 (0.0008) [2023-12-26 11:54:18,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17883.6). Total num frames: 786759680. Throughput: 0: 8757.1, 1: 8806.8. Samples: 786776380. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:18,784][121949] Avg episode reward: [(0, '6347.197'), (1, '5353.969')] [2023-12-26 11:54:18,822][123091] Updated weights for policy 0, policy_version 1541687 (0.0009) [2023-12-26 11:54:18,855][123090] Updated weights for policy 1, policy_version 1531588 (0.0009) [2023-12-26 11:54:18,881][123091] Updated weights for policy 0, policy_version 1541697 (0.0007) [2023-12-26 11:54:18,911][123090] Updated weights for policy 1, policy_version 1531598 (0.0010) [2023-12-26 11:54:18,934][123091] Updated weights for policy 0, policy_version 1541707 (0.0010) [2023-12-26 11:54:18,971][123090] Updated weights for policy 1, policy_version 1531608 (0.0010) [2023-12-26 11:54:19,821][123091] Updated weights for policy 0, policy_version 1541717 (0.0008) [2023-12-26 11:54:19,836][123090] Updated weights for policy 1, policy_version 1531618 (0.0010) [2023-12-26 11:54:19,889][123091] Updated weights for policy 0, policy_version 1541727 (0.0008) [2023-12-26 11:54:19,910][123090] Updated weights for policy 1, policy_version 1531628 (0.0005) [2023-12-26 11:54:19,954][123091] Updated weights for policy 0, policy_version 1541737 (0.0009) [2023-12-26 11:54:19,981][123090] Updated weights for policy 1, policy_version 1531638 (0.0007) [2023-12-26 11:54:20,057][123090] Updated weights for policy 1, policy_version 1531648 (0.0006) [2023-12-26 11:54:20,791][123090] Updated weights for policy 1, policy_version 1531658 (0.0011) [2023-12-26 11:54:20,814][123091] Updated weights for policy 0, policy_version 1541747 (0.0008) [2023-12-26 11:54:20,859][123090] Updated weights for policy 1, policy_version 1531668 (0.0011) [2023-12-26 11:54:20,879][123091] Updated weights for policy 0, policy_version 1541757 (0.0007) [2023-12-26 11:54:20,927][123090] Updated weights for policy 1, policy_version 1531678 (0.0011) [2023-12-26 11:54:20,944][123091] Updated weights for policy 0, policy_version 1541767 (0.0007) [2023-12-26 11:54:21,690][123090] Updated weights for policy 1, policy_version 1531688 (0.0009) [2023-12-26 11:54:21,739][123091] Updated weights for policy 0, policy_version 1541777 (0.0006) [2023-12-26 11:54:21,762][123090] Updated weights for policy 1, policy_version 1531698 (0.0009) [2023-12-26 11:54:21,793][123091] Updated weights for policy 0, policy_version 1541787 (0.0006) [2023-12-26 11:54:21,829][123090] Updated weights for policy 1, policy_version 1531708 (0.0008) [2023-12-26 11:54:21,859][123091] Updated weights for policy 0, policy_version 1541797 (0.0008) [2023-12-26 11:54:21,927][123091] Updated weights for policy 0, policy_version 1541807 (0.0006) [2023-12-26 11:54:22,645][123091] Updated weights for policy 0, policy_version 1541817 (0.0008) [2023-12-26 11:54:22,675][123090] Updated weights for policy 1, policy_version 1531718 (0.0006) [2023-12-26 11:54:22,708][123091] Updated weights for policy 0, policy_version 1541827 (0.0008) [2023-12-26 11:54:22,746][123090] Updated weights for policy 1, policy_version 1531728 (0.0006) [2023-12-26 11:54:22,781][123091] Updated weights for policy 0, policy_version 1541837 (0.0008) [2023-12-26 11:54:22,819][123090] Updated weights for policy 1, policy_version 1531738 (0.0006) [2023-12-26 11:54:23,461][123090] Updated weights for policy 1, policy_version 1531748 (0.0007) [2023-12-26 11:54:23,525][123090] Updated weights for policy 1, policy_version 1531758 (0.0009) [2023-12-26 11:54:23,550][123091] Updated weights for policy 0, policy_version 1541847 (0.0006) [2023-12-26 11:54:23,589][123090] Updated weights for policy 1, policy_version 1531768 (0.0009) [2023-12-26 11:54:23,614][123091] Updated weights for policy 0, policy_version 1541857 (0.0008) [2023-12-26 11:54:23,673][123091] Updated weights for policy 0, policy_version 1541867 (0.0011) [2023-12-26 11:54:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 786857984. Throughput: 0: 8768.4, 1: 8770.4. Samples: 786827676. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:23,784][121949] Avg episode reward: [(0, '6384.549'), (1, '5666.572')] [2023-12-26 11:54:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001531776_392134656.pth... [2023-12-26 11:54:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001541872_394723328.pth... [2023-12-26 11:54:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001540848_394461184.pth [2023-12-26 11:54:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001530752_391872512.pth [2023-12-26 11:54:24,407][123090] Updated weights for policy 1, policy_version 1531778 (0.0007) [2023-12-26 11:54:24,413][123091] Updated weights for policy 0, policy_version 1541877 (0.0008) [2023-12-26 11:54:24,467][123090] Updated weights for policy 1, policy_version 1531788 (0.0009) [2023-12-26 11:54:24,477][123091] Updated weights for policy 0, policy_version 1541887 (0.0006) [2023-12-26 11:54:24,525][123090] Updated weights for policy 1, policy_version 1531798 (0.0009) [2023-12-26 11:54:24,546][123091] Updated weights for policy 0, policy_version 1541897 (0.0005) [2023-12-26 11:54:24,595][123090] Updated weights for policy 1, policy_version 1531808 (0.0007) [2023-12-26 11:54:25,223][123091] Updated weights for policy 0, policy_version 1541907 (0.0007) [2023-12-26 11:54:25,274][123091] Updated weights for policy 0, policy_version 1541917 (0.0010) [2023-12-26 11:54:25,321][123091] Updated weights for policy 0, policy_version 1541927 (0.0010) [2023-12-26 11:54:25,349][123090] Updated weights for policy 1, policy_version 1531818 (0.0007) [2023-12-26 11:54:25,419][123090] Updated weights for policy 1, policy_version 1531828 (0.0008) [2023-12-26 11:54:25,472][123090] Updated weights for policy 1, policy_version 1531838 (0.0009) [2023-12-26 11:54:26,115][123091] Updated weights for policy 0, policy_version 1541937 (0.0010) [2023-12-26 11:54:26,168][123091] Updated weights for policy 0, policy_version 1541947 (0.0009) [2023-12-26 11:54:26,215][123091] Updated weights for policy 0, policy_version 1541957 (0.0009) [2023-12-26 11:54:26,264][123091] Updated weights for policy 0, policy_version 1541968 (0.0010) [2023-12-26 11:54:26,306][123090] Updated weights for policy 1, policy_version 1531848 (0.0009) [2023-12-26 11:54:26,354][123090] Updated weights for policy 1, policy_version 1531858 (0.0008) [2023-12-26 11:54:26,402][123090] Updated weights for policy 1, policy_version 1531868 (0.0008) [2023-12-26 11:54:27,063][123091] Updated weights for policy 0, policy_version 1541978 (0.0007) [2023-12-26 11:54:27,113][123091] Updated weights for policy 0, policy_version 1541988 (0.0010) [2023-12-26 11:54:27,155][123090] Updated weights for policy 1, policy_version 1531878 (0.0010) [2023-12-26 11:54:27,157][123091] Updated weights for policy 0, policy_version 1541998 (0.0010) [2023-12-26 11:54:27,202][123090] Updated weights for policy 1, policy_version 1531888 (0.0010) [2023-12-26 11:54:27,245][123090] Updated weights for policy 1, policy_version 1531898 (0.0010) [2023-12-26 11:54:27,849][123091] Updated weights for policy 0, policy_version 1542008 (0.0006) [2023-12-26 11:54:27,895][123091] Updated weights for policy 0, policy_version 1542018 (0.0007) [2023-12-26 11:54:27,938][123091] Updated weights for policy 0, policy_version 1542028 (0.0010) [2023-12-26 11:54:28,049][123090] Updated weights for policy 1, policy_version 1531908 (0.0008) [2023-12-26 11:54:28,112][123090] Updated weights for policy 1, policy_version 1531918 (0.0005) [2023-12-26 11:54:28,185][123090] Updated weights for policy 1, policy_version 1531928 (0.0005) [2023-12-26 11:54:28,625][123091] Updated weights for policy 0, policy_version 1542038 (0.0007) [2023-12-26 11:54:28,677][123091] Updated weights for policy 0, policy_version 1542048 (0.0005) [2023-12-26 11:54:28,746][123091] Updated weights for policy 0, policy_version 1542058 (0.0005) [2023-12-26 11:54:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 786948096. Throughput: 0: 8860.4, 1: 8813.4. Samples: 786937912. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:28,785][121949] Avg episode reward: [(0, '6157.895'), (1, '5592.653')] [2023-12-26 11:54:28,913][123090] Updated weights for policy 1, policy_version 1531938 (0.0006) [2023-12-26 11:54:28,960][123090] Updated weights for policy 1, policy_version 1531948 (0.0005) [2023-12-26 11:54:29,007][123090] Updated weights for policy 1, policy_version 1531958 (0.0005) [2023-12-26 11:54:29,058][123090] Updated weights for policy 1, policy_version 1531968 (0.0005) [2023-12-26 11:54:29,494][123091] Updated weights for policy 0, policy_version 1542068 (0.0005) [2023-12-26 11:54:29,545][123091] Updated weights for policy 0, policy_version 1542078 (0.0006) [2023-12-26 11:54:29,592][123091] Updated weights for policy 0, policy_version 1542088 (0.0005) [2023-12-26 11:54:29,776][123090] Updated weights for policy 1, policy_version 1531978 (0.0010) [2023-12-26 11:54:29,825][123090] Updated weights for policy 1, policy_version 1531988 (0.0010) [2023-12-26 11:54:29,890][123090] Updated weights for policy 1, policy_version 1531998 (0.0010) [2023-12-26 11:54:30,336][123091] Updated weights for policy 0, policy_version 1542098 (0.0009) [2023-12-26 11:54:30,387][123091] Updated weights for policy 0, policy_version 1542108 (0.0005) [2023-12-26 11:54:30,447][123091] Updated weights for policy 0, policy_version 1542118 (0.0005) [2023-12-26 11:54:30,508][123091] Updated weights for policy 0, policy_version 1542128 (0.0005) [2023-12-26 11:54:30,655][123090] Updated weights for policy 1, policy_version 1532008 (0.0010) [2023-12-26 11:54:30,710][123090] Updated weights for policy 1, policy_version 1532018 (0.0010) [2023-12-26 11:54:30,766][123090] Updated weights for policy 1, policy_version 1532028 (0.0010) [2023-12-26 11:54:31,159][123091] Updated weights for policy 0, policy_version 1542138 (0.0008) [2023-12-26 11:54:31,223][123091] Updated weights for policy 0, policy_version 1542148 (0.0011) [2023-12-26 11:54:31,287][123091] Updated weights for policy 0, policy_version 1542158 (0.0011) [2023-12-26 11:54:31,584][123090] Updated weights for policy 1, policy_version 1532038 (0.0010) [2023-12-26 11:54:31,649][123090] Updated weights for policy 1, policy_version 1532048 (0.0009) [2023-12-26 11:54:31,727][123090] Updated weights for policy 1, policy_version 1532058 (0.0006) [2023-12-26 11:54:32,116][123091] Updated weights for policy 0, policy_version 1542168 (0.0010) [2023-12-26 11:54:32,190][123091] Updated weights for policy 0, policy_version 1542178 (0.0011) [2023-12-26 11:54:32,260][123091] Updated weights for policy 0, policy_version 1542188 (0.0011) [2023-12-26 11:54:32,437][123090] Updated weights for policy 1, policy_version 1532068 (0.0006) [2023-12-26 11:54:32,490][123090] Updated weights for policy 1, policy_version 1532078 (0.0008) [2023-12-26 11:54:32,553][123090] Updated weights for policy 1, policy_version 1532088 (0.0005) [2023-12-26 11:54:33,111][123091] Updated weights for policy 0, policy_version 1542198 (0.0010) [2023-12-26 11:54:33,173][123091] Updated weights for policy 0, policy_version 1542208 (0.0010) [2023-12-26 11:54:33,234][123091] Updated weights for policy 0, policy_version 1542218 (0.0009) [2023-12-26 11:54:33,242][123090] Updated weights for policy 1, policy_version 1532098 (0.0006) [2023-12-26 11:54:33,290][123090] Updated weights for policy 1, policy_version 1532108 (0.0005) [2023-12-26 11:54:33,339][123090] Updated weights for policy 1, policy_version 1532118 (0.0005) [2023-12-26 11:54:33,398][123090] Updated weights for policy 1, policy_version 1532128 (0.0005) [2023-12-26 11:54:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 787038208. Throughput: 0: 8828.0, 1: 8966.7. Samples: 787051380. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:33,785][121949] Avg episode reward: [(0, '6122.388'), (1, '5576.331')] [2023-12-26 11:54:33,934][123091] Updated weights for policy 0, policy_version 1542228 (0.0008) [2023-12-26 11:54:33,994][123091] Updated weights for policy 0, policy_version 1542238 (0.0006) [2023-12-26 11:54:34,046][123091] Updated weights for policy 0, policy_version 1542248 (0.0005) [2023-12-26 11:54:34,071][123090] Updated weights for policy 1, policy_version 1532138 (0.0005) [2023-12-26 11:54:34,136][123090] Updated weights for policy 1, policy_version 1532148 (0.0005) [2023-12-26 11:54:34,195][123090] Updated weights for policy 1, policy_version 1532158 (0.0008) [2023-12-26 11:54:34,743][123091] Updated weights for policy 0, policy_version 1542258 (0.0007) [2023-12-26 11:54:34,802][123091] Updated weights for policy 0, policy_version 1542268 (0.0005) [2023-12-26 11:54:34,821][123090] Updated weights for policy 1, policy_version 1532168 (0.0010) [2023-12-26 11:54:34,855][123091] Updated weights for policy 0, policy_version 1542278 (0.0005) [2023-12-26 11:54:34,873][123090] Updated weights for policy 1, policy_version 1532178 (0.0010) [2023-12-26 11:54:34,921][123091] Updated weights for policy 0, policy_version 1542288 (0.0005) [2023-12-26 11:54:34,936][123090] Updated weights for policy 1, policy_version 1532188 (0.0010) [2023-12-26 11:54:35,559][123091] Updated weights for policy 0, policy_version 1542298 (0.0005) [2023-12-26 11:54:35,621][123091] Updated weights for policy 0, policy_version 1542308 (0.0005) [2023-12-26 11:54:35,644][123090] Updated weights for policy 1, policy_version 1532198 (0.0009) [2023-12-26 11:54:35,685][123091] Updated weights for policy 0, policy_version 1542318 (0.0006) [2023-12-26 11:54:35,711][123090] Updated weights for policy 1, policy_version 1532208 (0.0007) [2023-12-26 11:54:35,783][123090] Updated weights for policy 1, policy_version 1532218 (0.0006) [2023-12-26 11:54:36,345][123091] Updated weights for policy 0, policy_version 1542328 (0.0006) [2023-12-26 11:54:36,407][123091] Updated weights for policy 0, policy_version 1542338 (0.0010) [2023-12-26 11:54:36,450][123090] Updated weights for policy 1, policy_version 1532228 (0.0006) [2023-12-26 11:54:36,478][123091] Updated weights for policy 0, policy_version 1542348 (0.0009) [2023-12-26 11:54:36,514][123090] Updated weights for policy 1, policy_version 1532238 (0.0009) [2023-12-26 11:54:36,589][123090] Updated weights for policy 1, policy_version 1532248 (0.0009) [2023-12-26 11:54:37,185][123091] Updated weights for policy 0, policy_version 1542358 (0.0010) [2023-12-26 11:54:37,240][123091] Updated weights for policy 0, policy_version 1542368 (0.0010) [2023-12-26 11:54:37,299][123091] Updated weights for policy 0, policy_version 1542378 (0.0007) [2023-12-26 11:54:37,462][123090] Updated weights for policy 1, policy_version 1532258 (0.0010) [2023-12-26 11:54:37,525][123090] Updated weights for policy 1, policy_version 1532268 (0.0010) [2023-12-26 11:54:37,597][123090] Updated weights for policy 1, policy_version 1532278 (0.0010) [2023-12-26 11:54:37,663][123090] Updated weights for policy 1, policy_version 1532288 (0.0010) [2023-12-26 11:54:37,940][123091] Updated weights for policy 0, policy_version 1542388 (0.0009) [2023-12-26 11:54:37,995][123091] Updated weights for policy 0, policy_version 1542398 (0.0006) [2023-12-26 11:54:38,055][123091] Updated weights for policy 0, policy_version 1542408 (0.0011) [2023-12-26 11:54:38,511][123090] Updated weights for policy 1, policy_version 1532298 (0.0009) [2023-12-26 11:54:38,575][123090] Updated weights for policy 1, policy_version 1532308 (0.0009) [2023-12-26 11:54:38,632][123090] Updated weights for policy 1, policy_version 1532318 (0.0009) [2023-12-26 11:54:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17966.9). Total num frames: 787136512. Throughput: 0: 8946.3, 1: 9010.0. Samples: 787111364. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:38,784][121949] Avg episode reward: [(0, '6365.939'), (1, '5586.541')] [2023-12-26 11:54:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001542416_394862592.pth... [2023-12-26 11:54:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001532320_392273920.pth... [2023-12-26 11:54:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001541360_394592256.pth [2023-12-26 11:54:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001531264_392003584.pth [2023-12-26 11:54:38,843][123091] Updated weights for policy 0, policy_version 1542418 (0.0009) [2023-12-26 11:54:38,912][123091] Updated weights for policy 0, policy_version 1542428 (0.0005) [2023-12-26 11:54:38,974][123091] Updated weights for policy 0, policy_version 1542438 (0.0005) [2023-12-26 11:54:39,044][123091] Updated weights for policy 0, policy_version 1542448 (0.0007) [2023-12-26 11:54:39,525][123090] Updated weights for policy 1, policy_version 1532328 (0.0010) [2023-12-26 11:54:39,589][123090] Updated weights for policy 1, policy_version 1532338 (0.0009) [2023-12-26 11:54:39,658][123090] Updated weights for policy 1, policy_version 1532348 (0.0009) [2023-12-26 11:54:39,793][123091] Updated weights for policy 0, policy_version 1542458 (0.0009) [2023-12-26 11:54:39,856][123091] Updated weights for policy 0, policy_version 1542468 (0.0009) [2023-12-26 11:54:39,925][123091] Updated weights for policy 0, policy_version 1542478 (0.0009) [2023-12-26 11:54:40,503][123090] Updated weights for policy 1, policy_version 1532358 (0.0007) [2023-12-26 11:54:40,576][123090] Updated weights for policy 1, policy_version 1532368 (0.0006) [2023-12-26 11:54:40,644][123090] Updated weights for policy 1, policy_version 1532378 (0.0006) [2023-12-26 11:54:40,771][123091] Updated weights for policy 0, policy_version 1542488 (0.0010) [2023-12-26 11:54:40,828][123091] Updated weights for policy 0, policy_version 1542498 (0.0009) [2023-12-26 11:54:40,882][123091] Updated weights for policy 0, policy_version 1542509 (0.0010) [2023-12-26 11:54:41,407][123090] Updated weights for policy 1, policy_version 1532388 (0.0005) [2023-12-26 11:54:41,479][123090] Updated weights for policy 1, policy_version 1532398 (0.0006) [2023-12-26 11:54:41,553][123090] Updated weights for policy 1, policy_version 1532408 (0.0006) [2023-12-26 11:54:41,783][123091] Updated weights for policy 0, policy_version 1542519 (0.0008) [2023-12-26 11:54:41,858][123091] Updated weights for policy 0, policy_version 1542529 (0.0008) [2023-12-26 11:54:41,928][123091] Updated weights for policy 0, policy_version 1542539 (0.0008) [2023-12-26 11:54:42,324][123090] Updated weights for policy 1, policy_version 1532418 (0.0008) [2023-12-26 11:54:42,396][123090] Updated weights for policy 1, policy_version 1532428 (0.0010) [2023-12-26 11:54:42,462][123090] Updated weights for policy 1, policy_version 1532438 (0.0010) [2023-12-26 11:54:42,514][123090] Updated weights for policy 1, policy_version 1532448 (0.0008) [2023-12-26 11:54:42,732][123091] Updated weights for policy 0, policy_version 1542549 (0.0009) [2023-12-26 11:54:42,798][123091] Updated weights for policy 0, policy_version 1542559 (0.0008) [2023-12-26 11:54:42,860][123091] Updated weights for policy 0, policy_version 1542569 (0.0010) [2023-12-26 11:54:43,350][123090] Updated weights for policy 1, policy_version 1532458 (0.0009) [2023-12-26 11:54:43,410][123090] Updated weights for policy 1, policy_version 1532468 (0.0009) [2023-12-26 11:54:43,468][123090] Updated weights for policy 1, policy_version 1532478 (0.0009) [2023-12-26 11:54:43,581][123091] Updated weights for policy 0, policy_version 1542579 (0.0008) [2023-12-26 11:54:43,628][123091] Updated weights for policy 0, policy_version 1542589 (0.0005) [2023-12-26 11:54:43,688][123091] Updated weights for policy 0, policy_version 1542599 (0.0005) [2023-12-26 11:54:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17966.9). Total num frames: 787226624. Throughput: 0: 8981.0, 1: 8897.4. Samples: 787215044. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:43,785][121949] Avg episode reward: [(0, '6405.953'), (1, '5677.862')] [2023-12-26 11:54:44,275][123090] Updated weights for policy 1, policy_version 1532488 (0.0008) [2023-12-26 11:54:44,332][123090] Updated weights for policy 1, policy_version 1532498 (0.0006) [2023-12-26 11:54:44,392][123090] Updated weights for policy 1, policy_version 1532508 (0.0007) [2023-12-26 11:54:44,408][123091] Updated weights for policy 0, policy_version 1542609 (0.0005) [2023-12-26 11:54:44,475][123091] Updated weights for policy 0, policy_version 1542619 (0.0010) [2023-12-26 11:54:44,529][123091] Updated weights for policy 0, policy_version 1542629 (0.0008) [2023-12-26 11:54:44,589][123091] Updated weights for policy 0, policy_version 1542639 (0.0006) [2023-12-26 11:54:45,224][123090] Updated weights for policy 1, policy_version 1532518 (0.0008) [2023-12-26 11:54:45,285][123090] Updated weights for policy 1, policy_version 1532528 (0.0010) [2023-12-26 11:54:45,348][123090] Updated weights for policy 1, policy_version 1532538 (0.0010) [2023-12-26 11:54:45,373][123091] Updated weights for policy 0, policy_version 1542649 (0.0010) [2023-12-26 11:54:45,438][123091] Updated weights for policy 0, policy_version 1542659 (0.0011) [2023-12-26 11:54:45,505][123091] Updated weights for policy 0, policy_version 1542669 (0.0011) [2023-12-26 11:54:46,232][123090] Updated weights for policy 1, policy_version 1532548 (0.0010) [2023-12-26 11:54:46,284][123090] Updated weights for policy 1, policy_version 1532558 (0.0009) [2023-12-26 11:54:46,299][123091] Updated weights for policy 0, policy_version 1542679 (0.0011) [2023-12-26 11:54:46,343][123090] Updated weights for policy 1, policy_version 1532568 (0.0007) [2023-12-26 11:54:46,362][123091] Updated weights for policy 0, policy_version 1542689 (0.0011) [2023-12-26 11:54:46,424][123091] Updated weights for policy 0, policy_version 1542699 (0.0010) [2023-12-26 11:54:47,077][123090] Updated weights for policy 1, policy_version 1532578 (0.0006) [2023-12-26 11:54:47,102][123091] Updated weights for policy 0, policy_version 1542709 (0.0008) [2023-12-26 11:54:47,134][123090] Updated weights for policy 1, policy_version 1532588 (0.0008) [2023-12-26 11:54:47,166][123091] Updated weights for policy 0, policy_version 1542719 (0.0008) [2023-12-26 11:54:47,192][123090] Updated weights for policy 1, policy_version 1532598 (0.0008) [2023-12-26 11:54:47,231][123091] Updated weights for policy 0, policy_version 1542729 (0.0008) [2023-12-26 11:54:47,252][123090] Updated weights for policy 1, policy_version 1532608 (0.0009) [2023-12-26 11:54:47,951][123091] Updated weights for policy 0, policy_version 1542739 (0.0007) [2023-12-26 11:54:48,007][123091] Updated weights for policy 0, policy_version 1542749 (0.0010) [2023-12-26 11:54:48,064][123091] Updated weights for policy 0, policy_version 1542759 (0.0009) [2023-12-26 11:54:48,098][123090] Updated weights for policy 1, policy_version 1532618 (0.0010) [2023-12-26 11:54:48,156][123090] Updated weights for policy 1, policy_version 1532628 (0.0010) [2023-12-26 11:54:48,212][123090] Updated weights for policy 1, policy_version 1532638 (0.0009) [2023-12-26 11:54:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17966.9). Total num frames: 787308544. Throughput: 0: 9050.3, 1: 8875.0. Samples: 787322740. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:48,784][121949] Avg episode reward: [(0, '6237.645'), (1, '5792.473')] [2023-12-26 11:54:48,966][123091] Updated weights for policy 0, policy_version 1542769 (0.0010) [2023-12-26 11:54:48,969][123090] Updated weights for policy 1, policy_version 1532648 (0.0006) [2023-12-26 11:54:49,015][123091] Updated weights for policy 0, policy_version 1542779 (0.0009) [2023-12-26 11:54:49,030][123090] Updated weights for policy 1, policy_version 1532658 (0.0005) [2023-12-26 11:54:49,089][123091] Updated weights for policy 0, policy_version 1542789 (0.0009) [2023-12-26 11:54:49,096][123090] Updated weights for policy 1, policy_version 1532668 (0.0005) [2023-12-26 11:54:49,155][123091] Updated weights for policy 0, policy_version 1542799 (0.0009) [2023-12-26 11:54:49,817][123090] Updated weights for policy 1, policy_version 1532678 (0.0007) [2023-12-26 11:54:49,890][123090] Updated weights for policy 1, policy_version 1532688 (0.0008) [2023-12-26 11:54:49,965][123090] Updated weights for policy 1, policy_version 1532698 (0.0013) [2023-12-26 11:54:50,054][123091] Updated weights for policy 0, policy_version 1542809 (0.0009) [2023-12-26 11:54:50,110][123091] Updated weights for policy 0, policy_version 1542819 (0.0009) [2023-12-26 11:54:50,179][123091] Updated weights for policy 0, policy_version 1542829 (0.0009) [2023-12-26 11:54:50,770][123090] Updated weights for policy 1, policy_version 1532708 (0.0011) [2023-12-26 11:54:50,838][123090] Updated weights for policy 1, policy_version 1532718 (0.0011) [2023-12-26 11:54:50,903][123090] Updated weights for policy 1, policy_version 1532728 (0.0011) [2023-12-26 11:54:51,004][123091] Updated weights for policy 0, policy_version 1542839 (0.0009) [2023-12-26 11:54:51,074][123091] Updated weights for policy 0, policy_version 1542849 (0.0009) [2023-12-26 11:54:51,129][123091] Updated weights for policy 0, policy_version 1542859 (0.0010) [2023-12-26 11:54:51,688][123090] Updated weights for policy 1, policy_version 1532738 (0.0010) [2023-12-26 11:54:51,760][123090] Updated weights for policy 1, policy_version 1532748 (0.0009) [2023-12-26 11:54:51,821][123090] Updated weights for policy 1, policy_version 1532758 (0.0007) [2023-12-26 11:54:51,873][123090] Updated weights for policy 1, policy_version 1532768 (0.0006) [2023-12-26 11:54:51,978][123091] Updated weights for policy 0, policy_version 1542869 (0.0009) [2023-12-26 11:54:52,044][123091] Updated weights for policy 0, policy_version 1542879 (0.0009) [2023-12-26 11:54:52,107][123091] Updated weights for policy 0, policy_version 1542889 (0.0009) [2023-12-26 11:54:52,680][123090] Updated weights for policy 1, policy_version 1532778 (0.0006) [2023-12-26 11:54:52,750][123090] Updated weights for policy 1, policy_version 1532788 (0.0008) [2023-12-26 11:54:52,817][123090] Updated weights for policy 1, policy_version 1532798 (0.0009) [2023-12-26 11:54:52,956][123091] Updated weights for policy 0, policy_version 1542899 (0.0009) [2023-12-26 11:54:53,012][123091] Updated weights for policy 0, policy_version 1542910 (0.0009) [2023-12-26 11:54:53,065][123091] Updated weights for policy 0, policy_version 1542920 (0.0009) [2023-12-26 11:54:53,523][123090] Updated weights for policy 1, policy_version 1532808 (0.0005) [2023-12-26 11:54:53,574][123090] Updated weights for policy 1, policy_version 1532818 (0.0005) [2023-12-26 11:54:53,626][123090] Updated weights for policy 1, policy_version 1532828 (0.0005) [2023-12-26 11:54:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17939.1). Total num frames: 787398656. Throughput: 0: 8957.6, 1: 8898.4. Samples: 787374192. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:53,785][121949] Avg episode reward: [(0, '6182.170'), (1, '5660.939')] [2023-12-26 11:54:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001542928_394993664.pth... [2023-12-26 11:54:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001532832_392404992.pth... [2023-12-26 11:54:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001531776_392134656.pth [2023-12-26 11:54:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001541872_394723328.pth [2023-12-26 11:54:53,982][123091] Updated weights for policy 0, policy_version 1542930 (0.0009) [2023-12-26 11:54:54,040][123091] Updated weights for policy 0, policy_version 1542940 (0.0006) [2023-12-26 11:54:54,103][123091] Updated weights for policy 0, policy_version 1542950 (0.0007) [2023-12-26 11:54:54,169][123091] Updated weights for policy 0, policy_version 1542960 (0.0010) [2023-12-26 11:54:54,293][123090] Updated weights for policy 1, policy_version 1532838 (0.0005) [2023-12-26 11:54:54,344][123090] Updated weights for policy 1, policy_version 1532848 (0.0006) [2023-12-26 11:54:54,397][123090] Updated weights for policy 1, policy_version 1532858 (0.0008) [2023-12-26 11:54:55,087][123091] Updated weights for policy 0, policy_version 1542970 (0.0007) [2023-12-26 11:54:55,103][123090] Updated weights for policy 1, policy_version 1532868 (0.0006) [2023-12-26 11:54:55,148][123091] Updated weights for policy 0, policy_version 1542980 (0.0006) [2023-12-26 11:54:55,166][123090] Updated weights for policy 1, policy_version 1532878 (0.0010) [2023-12-26 11:54:55,211][123091] Updated weights for policy 0, policy_version 1542990 (0.0008) [2023-12-26 11:54:55,225][123090] Updated weights for policy 1, policy_version 1532888 (0.0010) [2023-12-26 11:54:55,973][123090] Updated weights for policy 1, policy_version 1532898 (0.0010) [2023-12-26 11:54:56,027][123090] Updated weights for policy 1, policy_version 1532908 (0.0005) [2023-12-26 11:54:56,044][123091] Updated weights for policy 0, policy_version 1543000 (0.0009) [2023-12-26 11:54:56,089][123090] Updated weights for policy 1, policy_version 1532918 (0.0005) [2023-12-26 11:54:56,117][123091] Updated weights for policy 0, policy_version 1543011 (0.0009) [2023-12-26 11:54:56,154][123090] Updated weights for policy 1, policy_version 1532928 (0.0006) [2023-12-26 11:54:56,186][123091] Updated weights for policy 0, policy_version 1543021 (0.0009) [2023-12-26 11:54:56,838][123091] Updated weights for policy 0, policy_version 1543031 (0.0006) [2023-12-26 11:54:56,839][123090] Updated weights for policy 1, policy_version 1532938 (0.0005) [2023-12-26 11:54:56,886][123090] Updated weights for policy 1, policy_version 1532948 (0.0005) [2023-12-26 11:54:56,889][123091] Updated weights for policy 0, policy_version 1543041 (0.0005) [2023-12-26 11:54:56,929][123090] Updated weights for policy 1, policy_version 1532958 (0.0005) [2023-12-26 11:54:56,971][123091] Updated weights for policy 0, policy_version 1543051 (0.0006) [2023-12-26 11:54:57,655][123091] Updated weights for policy 0, policy_version 1543061 (0.0010) [2023-12-26 11:54:57,679][123090] Updated weights for policy 1, policy_version 1532968 (0.0009) [2023-12-26 11:54:57,712][123091] Updated weights for policy 0, policy_version 1543071 (0.0006) [2023-12-26 11:54:57,747][123090] Updated weights for policy 1, policy_version 1532978 (0.0011) [2023-12-26 11:54:57,778][123091] Updated weights for policy 0, policy_version 1543081 (0.0008) [2023-12-26 11:54:57,810][123090] Updated weights for policy 1, policy_version 1532988 (0.0010) [2023-12-26 11:54:58,538][123091] Updated weights for policy 0, policy_version 1543091 (0.0007) [2023-12-26 11:54:58,578][123090] Updated weights for policy 1, policy_version 1532998 (0.0008) [2023-12-26 11:54:58,606][123091] Updated weights for policy 0, policy_version 1543101 (0.0010) [2023-12-26 11:54:58,642][123090] Updated weights for policy 1, policy_version 1533008 (0.0009) [2023-12-26 11:54:58,673][123091] Updated weights for policy 0, policy_version 1543111 (0.0008) [2023-12-26 11:54:58,715][123090] Updated weights for policy 1, policy_version 1533018 (0.0009) [2023-12-26 11:54:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17994.6). Total num frames: 787496960. Throughput: 0: 8973.6, 1: 9084.7. Samples: 787484228. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:54:58,785][121949] Avg episode reward: [(0, '6304.829'), (1, '5726.708')] [2023-12-26 11:54:59,401][123091] Updated weights for policy 0, policy_version 1543121 (0.0008) [2023-12-26 11:54:59,443][123090] Updated weights for policy 1, policy_version 1533028 (0.0008) [2023-12-26 11:54:59,458][123091] Updated weights for policy 0, policy_version 1543131 (0.0008) [2023-12-26 11:54:59,501][123090] Updated weights for policy 1, policy_version 1533038 (0.0008) [2023-12-26 11:54:59,509][123091] Updated weights for policy 0, policy_version 1543141 (0.0008) [2023-12-26 11:54:59,567][123091] Updated weights for policy 0, policy_version 1543151 (0.0008) [2023-12-26 11:54:59,567][123090] Updated weights for policy 1, policy_version 1533048 (0.0008) [2023-12-26 11:55:00,409][123090] Updated weights for policy 1, policy_version 1533058 (0.0008) [2023-12-26 11:55:00,428][123091] Updated weights for policy 0, policy_version 1543161 (0.0010) [2023-12-26 11:55:00,465][123090] Updated weights for policy 1, policy_version 1533069 (0.0006) [2023-12-26 11:55:00,487][123091] Updated weights for policy 0, policy_version 1543171 (0.0010) [2023-12-26 11:55:00,526][123090] Updated weights for policy 1, policy_version 1533079 (0.0009) [2023-12-26 11:55:00,546][123091] Updated weights for policy 0, policy_version 1543181 (0.0010) [2023-12-26 11:55:01,350][123090] Updated weights for policy 1, policy_version 1533089 (0.0008) [2023-12-26 11:55:01,381][123091] Updated weights for policy 0, policy_version 1543191 (0.0009) [2023-12-26 11:55:01,419][123090] Updated weights for policy 1, policy_version 1533099 (0.0009) [2023-12-26 11:55:01,433][123091] Updated weights for policy 0, policy_version 1543201 (0.0009) [2023-12-26 11:55:01,484][123090] Updated weights for policy 1, policy_version 1533109 (0.0006) [2023-12-26 11:55:01,504][123091] Updated weights for policy 0, policy_version 1543211 (0.0006) [2023-12-26 11:55:01,557][123090] Updated weights for policy 1, policy_version 1533119 (0.0005) [2023-12-26 11:55:02,257][123091] Updated weights for policy 0, policy_version 1543221 (0.0007) [2023-12-26 11:55:02,326][123091] Updated weights for policy 0, policy_version 1543231 (0.0005) [2023-12-26 11:55:02,341][123090] Updated weights for policy 1, policy_version 1533129 (0.0010) [2023-12-26 11:55:02,396][123091] Updated weights for policy 0, policy_version 1543241 (0.0011) [2023-12-26 11:55:02,409][123090] Updated weights for policy 1, policy_version 1533139 (0.0009) [2023-12-26 11:55:02,471][123090] Updated weights for policy 1, policy_version 1533149 (0.0008) [2023-12-26 11:55:03,072][123091] Updated weights for policy 0, policy_version 1543251 (0.0008) [2023-12-26 11:55:03,142][123091] Updated weights for policy 0, policy_version 1543261 (0.0005) [2023-12-26 11:55:03,202][123091] Updated weights for policy 0, policy_version 1543271 (0.0009) [2023-12-26 11:55:03,304][123090] Updated weights for policy 1, policy_version 1533159 (0.0007) [2023-12-26 11:55:03,371][123090] Updated weights for policy 1, policy_version 1533169 (0.0005) [2023-12-26 11:55:03,438][123090] Updated weights for policy 1, policy_version 1533179 (0.0007) [2023-12-26 11:55:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 787578880. Throughput: 0: 9064.1, 1: 9024.8. Samples: 787590384. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:03,785][121949] Avg episode reward: [(0, '6352.699'), (1, '5899.042')] [2023-12-26 11:55:03,894][123091] Updated weights for policy 0, policy_version 1543281 (0.0010) [2023-12-26 11:55:03,957][123091] Updated weights for policy 0, policy_version 1543291 (0.0007) [2023-12-26 11:55:04,015][123091] Updated weights for policy 0, policy_version 1543301 (0.0008) [2023-12-26 11:55:04,070][123091] Updated weights for policy 0, policy_version 1543311 (0.0011) [2023-12-26 11:55:04,124][123090] Updated weights for policy 1, policy_version 1533189 (0.0010) [2023-12-26 11:55:04,182][123090] Updated weights for policy 1, policy_version 1533199 (0.0010) [2023-12-26 11:55:04,253][123090] Updated weights for policy 1, policy_version 1533209 (0.0007) [2023-12-26 11:55:04,871][123091] Updated weights for policy 0, policy_version 1543321 (0.0006) [2023-12-26 11:55:04,916][123091] Updated weights for policy 0, policy_version 1543331 (0.0006) [2023-12-26 11:55:04,972][123091] Updated weights for policy 0, policy_version 1543341 (0.0011) [2023-12-26 11:55:04,972][123090] Updated weights for policy 1, policy_version 1533219 (0.0005) [2023-12-26 11:55:05,032][123090] Updated weights for policy 1, policy_version 1533229 (0.0008) [2023-12-26 11:55:05,088][123090] Updated weights for policy 1, policy_version 1533239 (0.0010) [2023-12-26 11:55:05,748][123091] Updated weights for policy 0, policy_version 1543351 (0.0010) [2023-12-26 11:55:05,753][123090] Updated weights for policy 1, policy_version 1533249 (0.0006) [2023-12-26 11:55:05,796][123091] Updated weights for policy 0, policy_version 1543361 (0.0010) [2023-12-26 11:55:05,814][123090] Updated weights for policy 1, policy_version 1533259 (0.0005) [2023-12-26 11:55:05,848][123091] Updated weights for policy 0, policy_version 1543371 (0.0006) [2023-12-26 11:55:05,878][123090] Updated weights for policy 1, policy_version 1533269 (0.0007) [2023-12-26 11:55:05,945][123090] Updated weights for policy 1, policy_version 1533279 (0.0005) [2023-12-26 11:55:06,626][123091] Updated weights for policy 0, policy_version 1543381 (0.0007) [2023-12-26 11:55:06,629][123090] Updated weights for policy 1, policy_version 1533289 (0.0005) [2023-12-26 11:55:06,672][123091] Updated weights for policy 0, policy_version 1543391 (0.0008) [2023-12-26 11:55:06,686][123090] Updated weights for policy 1, policy_version 1533299 (0.0005) [2023-12-26 11:55:06,721][123091] Updated weights for policy 0, policy_version 1543401 (0.0009) [2023-12-26 11:55:06,751][123090] Updated weights for policy 1, policy_version 1533309 (0.0006) [2023-12-26 11:55:07,450][123090] Updated weights for policy 1, policy_version 1533319 (0.0006) [2023-12-26 11:55:07,498][123090] Updated weights for policy 1, policy_version 1533329 (0.0009) [2023-12-26 11:55:07,547][123090] Updated weights for policy 1, policy_version 1533339 (0.0009) [2023-12-26 11:55:07,604][123091] Updated weights for policy 0, policy_version 1543411 (0.0011) [2023-12-26 11:55:07,670][123091] Updated weights for policy 0, policy_version 1543421 (0.0007) [2023-12-26 11:55:07,735][123091] Updated weights for policy 0, policy_version 1543431 (0.0008) [2023-12-26 11:55:08,336][123090] Updated weights for policy 1, policy_version 1533349 (0.0008) [2023-12-26 11:55:08,392][123090] Updated weights for policy 1, policy_version 1533359 (0.0010) [2023-12-26 11:55:08,463][123090] Updated weights for policy 1, policy_version 1533369 (0.0010) [2023-12-26 11:55:08,497][123091] Updated weights for policy 0, policy_version 1543441 (0.0007) [2023-12-26 11:55:08,557][123091] Updated weights for policy 0, policy_version 1543451 (0.0007) [2023-12-26 11:55:08,617][123091] Updated weights for policy 0, policy_version 1543461 (0.0005) [2023-12-26 11:55:08,687][123091] Updated weights for policy 0, policy_version 1543471 (0.0005) [2023-12-26 11:55:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17994.6). Total num frames: 787677184. Throughput: 0: 9116.0, 1: 9123.3. Samples: 787648444. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:08,784][121949] Avg episode reward: [(0, '6242.129'), (1, '5752.417')] [2023-12-26 11:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001543472_395132928.pth... [2023-12-26 11:55:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001533376_392544256.pth... [2023-12-26 11:55:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001542416_394862592.pth [2023-12-26 11:55:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001532320_392273920.pth [2023-12-26 11:55:09,287][123090] Updated weights for policy 1, policy_version 1533379 (0.0011) [2023-12-26 11:55:09,347][123090] Updated weights for policy 1, policy_version 1533389 (0.0009) [2023-12-26 11:55:09,373][123091] Updated weights for policy 0, policy_version 1543481 (0.0009) [2023-12-26 11:55:09,421][123090] Updated weights for policy 1, policy_version 1533399 (0.0009) [2023-12-26 11:55:09,442][123091] Updated weights for policy 0, policy_version 1543491 (0.0009) [2023-12-26 11:55:09,507][123091] Updated weights for policy 0, policy_version 1543501 (0.0009) [2023-12-26 11:55:10,277][123090] Updated weights for policy 1, policy_version 1533409 (0.0010) [2023-12-26 11:55:10,344][123090] Updated weights for policy 1, policy_version 1533419 (0.0009) [2023-12-26 11:55:10,379][123091] Updated weights for policy 0, policy_version 1543511 (0.0009) [2023-12-26 11:55:10,405][123090] Updated weights for policy 1, policy_version 1533429 (0.0008) [2023-12-26 11:55:10,444][123091] Updated weights for policy 0, policy_version 1543521 (0.0009) [2023-12-26 11:55:10,458][123090] Updated weights for policy 1, policy_version 1533439 (0.0005) [2023-12-26 11:55:10,505][123091] Updated weights for policy 0, policy_version 1543531 (0.0010) [2023-12-26 11:55:11,078][123090] Updated weights for policy 1, policy_version 1533449 (0.0009) [2023-12-26 11:55:11,154][123090] Updated weights for policy 1, policy_version 1533459 (0.0010) [2023-12-26 11:55:11,218][123090] Updated weights for policy 1, policy_version 1533469 (0.0009) [2023-12-26 11:55:11,370][123091] Updated weights for policy 0, policy_version 1543541 (0.0009) [2023-12-26 11:55:11,447][123091] Updated weights for policy 0, policy_version 1543551 (0.0008) [2023-12-26 11:55:11,503][123091] Updated weights for policy 0, policy_version 1543561 (0.0010) [2023-12-26 11:55:12,077][123090] Updated weights for policy 1, policy_version 1533479 (0.0009) [2023-12-26 11:55:12,134][123090] Updated weights for policy 1, policy_version 1533489 (0.0009) [2023-12-26 11:55:12,200][123090] Updated weights for policy 1, policy_version 1533499 (0.0007) [2023-12-26 11:55:12,214][123091] Updated weights for policy 0, policy_version 1543571 (0.0009) [2023-12-26 11:55:12,282][123091] Updated weights for policy 0, policy_version 1543581 (0.0007) [2023-12-26 11:55:12,355][123091] Updated weights for policy 0, policy_version 1543591 (0.0009) [2023-12-26 11:55:13,033][123090] Updated weights for policy 1, policy_version 1533509 (0.0008) [2023-12-26 11:55:13,098][123090] Updated weights for policy 1, policy_version 1533519 (0.0010) [2023-12-26 11:55:13,157][123090] Updated weights for policy 1, policy_version 1533529 (0.0008) [2023-12-26 11:55:13,169][123091] Updated weights for policy 0, policy_version 1543601 (0.0009) [2023-12-26 11:55:13,233][123091] Updated weights for policy 0, policy_version 1543611 (0.0009) [2023-12-26 11:55:13,301][123091] Updated weights for policy 0, policy_version 1543621 (0.0010) [2023-12-26 11:55:13,372][123091] Updated weights for policy 0, policy_version 1543631 (0.0009) [2023-12-26 11:55:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17966.9). Total num frames: 787759104. Throughput: 0: 9028.3, 1: 9115.0. Samples: 787754360. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:13,785][121949] Avg episode reward: [(0, '6108.000'), (1, '5705.723')] [2023-12-26 11:55:14,035][123090] Updated weights for policy 1, policy_version 1533539 (0.0008) [2023-12-26 11:55:14,102][123090] Updated weights for policy 1, policy_version 1533549 (0.0009) [2023-12-26 11:55:14,115][123091] Updated weights for policy 0, policy_version 1543641 (0.0008) [2023-12-26 11:55:14,156][123090] Updated weights for policy 1, policy_version 1533559 (0.0007) [2023-12-26 11:55:14,168][123091] Updated weights for policy 0, policy_version 1543651 (0.0008) [2023-12-26 11:55:14,220][123091] Updated weights for policy 0, policy_version 1543661 (0.0006) [2023-12-26 11:55:14,955][123091] Updated weights for policy 0, policy_version 1543671 (0.0009) [2023-12-26 11:55:15,016][123091] Updated weights for policy 0, policy_version 1543681 (0.0007) [2023-12-26 11:55:15,045][123090] Updated weights for policy 1, policy_version 1533569 (0.0008) [2023-12-26 11:55:15,066][123091] Updated weights for policy 0, policy_version 1543691 (0.0008) [2023-12-26 11:55:15,113][123090] Updated weights for policy 1, policy_version 1533579 (0.0010) [2023-12-26 11:55:15,175][123090] Updated weights for policy 1, policy_version 1533589 (0.0009) [2023-12-26 11:55:15,242][123090] Updated weights for policy 1, policy_version 1533599 (0.0010) [2023-12-26 11:55:15,826][123091] Updated weights for policy 0, policy_version 1543701 (0.0007) [2023-12-26 11:55:15,895][123091] Updated weights for policy 0, policy_version 1543711 (0.0006) [2023-12-26 11:55:15,958][123091] Updated weights for policy 0, policy_version 1543721 (0.0006) [2023-12-26 11:55:16,138][123090] Updated weights for policy 1, policy_version 1533609 (0.0009) [2023-12-26 11:55:16,199][123090] Updated weights for policy 1, policy_version 1533619 (0.0009) [2023-12-26 11:55:16,264][123090] Updated weights for policy 1, policy_version 1533629 (0.0010) [2023-12-26 11:55:16,726][123091] Updated weights for policy 0, policy_version 1543731 (0.0007) [2023-12-26 11:55:16,781][123091] Updated weights for policy 0, policy_version 1543741 (0.0009) [2023-12-26 11:55:16,837][123091] Updated weights for policy 0, policy_version 1543751 (0.0009) [2023-12-26 11:55:17,107][123090] Updated weights for policy 1, policy_version 1533640 (0.0010) [2023-12-26 11:55:17,157][123090] Updated weights for policy 1, policy_version 1533650 (0.0009) [2023-12-26 11:55:17,206][123090] Updated weights for policy 1, policy_version 1533660 (0.0009) [2023-12-26 11:55:17,649][123091] Updated weights for policy 0, policy_version 1543761 (0.0009) [2023-12-26 11:55:17,708][123091] Updated weights for policy 0, policy_version 1543771 (0.0009) [2023-12-26 11:55:17,763][123091] Updated weights for policy 0, policy_version 1543781 (0.0010) [2023-12-26 11:55:17,817][123091] Updated weights for policy 0, policy_version 1543792 (0.0009) [2023-12-26 11:55:18,091][123090] Updated weights for policy 1, policy_version 1533670 (0.0009) [2023-12-26 11:55:18,145][123090] Updated weights for policy 1, policy_version 1533680 (0.0009) [2023-12-26 11:55:18,203][123090] Updated weights for policy 1, policy_version 1533690 (0.0009) [2023-12-26 11:55:18,589][123091] Updated weights for policy 0, policy_version 1543802 (0.0010) [2023-12-26 11:55:18,657][123091] Updated weights for policy 0, policy_version 1543812 (0.0010) [2023-12-26 11:55:18,725][123091] Updated weights for policy 0, policy_version 1543822 (0.0010) [2023-12-26 11:55:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18158.9, 300 sec: 17966.9). Total num frames: 787849216. Throughput: 0: 8999.1, 1: 8931.0. Samples: 787858232. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:18,785][121949] Avg episode reward: [(0, '6174.545'), (1, '5595.504')] [2023-12-26 11:55:19,073][123090] Updated weights for policy 1, policy_version 1533700 (0.0010) [2023-12-26 11:55:19,124][123090] Updated weights for policy 1, policy_version 1533710 (0.0009) [2023-12-26 11:55:19,179][123090] Updated weights for policy 1, policy_version 1533720 (0.0009) [2023-12-26 11:55:19,590][123091] Updated weights for policy 0, policy_version 1543832 (0.0006) [2023-12-26 11:55:19,661][123091] Updated weights for policy 0, policy_version 1543842 (0.0006) [2023-12-26 11:55:19,723][123091] Updated weights for policy 0, policy_version 1543852 (0.0006) [2023-12-26 11:55:20,040][123090] Updated weights for policy 1, policy_version 1533730 (0.0009) [2023-12-26 11:55:20,089][123090] Updated weights for policy 1, policy_version 1533740 (0.0011) [2023-12-26 11:55:20,149][123090] Updated weights for policy 1, policy_version 1533750 (0.0011) [2023-12-26 11:55:20,217][123090] Updated weights for policy 1, policy_version 1533760 (0.0011) [2023-12-26 11:55:20,415][123091] Updated weights for policy 0, policy_version 1543862 (0.0009) [2023-12-26 11:55:20,467][123091] Updated weights for policy 0, policy_version 1543872 (0.0011) [2023-12-26 11:55:20,527][123091] Updated weights for policy 0, policy_version 1543882 (0.0011) [2023-12-26 11:55:21,053][123090] Updated weights for policy 1, policy_version 1533770 (0.0009) [2023-12-26 11:55:21,122][123090] Updated weights for policy 1, policy_version 1533780 (0.0008) [2023-12-26 11:55:21,194][123090] Updated weights for policy 1, policy_version 1533790 (0.0008) [2023-12-26 11:55:21,377][123091] Updated weights for policy 0, policy_version 1543892 (0.0010) [2023-12-26 11:55:21,428][123091] Updated weights for policy 0, policy_version 1543902 (0.0008) [2023-12-26 11:55:21,477][123091] Updated weights for policy 0, policy_version 1543912 (0.0008) [2023-12-26 11:55:22,019][123090] Updated weights for policy 1, policy_version 1533800 (0.0009) [2023-12-26 11:55:22,078][123090] Updated weights for policy 1, policy_version 1533810 (0.0009) [2023-12-26 11:55:22,141][123090] Updated weights for policy 1, policy_version 1533820 (0.0010) [2023-12-26 11:55:22,282][123091] Updated weights for policy 0, policy_version 1543922 (0.0008) [2023-12-26 11:55:22,343][123091] Updated weights for policy 0, policy_version 1543932 (0.0009) [2023-12-26 11:55:22,419][123091] Updated weights for policy 0, policy_version 1543942 (0.0008) [2023-12-26 11:55:22,478][123091] Updated weights for policy 0, policy_version 1543952 (0.0009) [2023-12-26 11:55:23,030][123090] Updated weights for policy 1, policy_version 1533830 (0.0010) [2023-12-26 11:55:23,100][123090] Updated weights for policy 1, policy_version 1533840 (0.0009) [2023-12-26 11:55:23,159][123090] Updated weights for policy 1, policy_version 1533850 (0.0008) [2023-12-26 11:55:23,254][123091] Updated weights for policy 0, policy_version 1543962 (0.0005) [2023-12-26 11:55:23,321][123091] Updated weights for policy 0, policy_version 1543972 (0.0007) [2023-12-26 11:55:23,387][123091] Updated weights for policy 0, policy_version 1543982 (0.0007) [2023-12-26 11:55:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 787931136. Throughput: 0: 8894.0, 1: 8851.9. Samples: 787909932. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:23,785][121949] Avg episode reward: [(0, '6133.515'), (1, '5521.131')] [2023-12-26 11:55:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001543984_395264000.pth... [2023-12-26 11:55:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001533856_392667136.pth... [2023-12-26 11:55:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001532832_392404992.pth [2023-12-26 11:55:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001542928_394993664.pth [2023-12-26 11:55:23,892][123090] Updated weights for policy 1, policy_version 1533860 (0.0007) [2023-12-26 11:55:23,963][123090] Updated weights for policy 1, policy_version 1533870 (0.0005) [2023-12-26 11:55:24,020][123090] Updated weights for policy 1, policy_version 1533880 (0.0006) [2023-12-26 11:55:24,063][123091] Updated weights for policy 0, policy_version 1543992 (0.0005) [2023-12-26 11:55:24,128][123091] Updated weights for policy 0, policy_version 1544002 (0.0006) [2023-12-26 11:55:24,182][123091] Updated weights for policy 0, policy_version 1544012 (0.0006) [2023-12-26 11:55:24,750][123090] Updated weights for policy 1, policy_version 1533890 (0.0010) [2023-12-26 11:55:24,811][123090] Updated weights for policy 1, policy_version 1533900 (0.0010) [2023-12-26 11:55:24,877][123090] Updated weights for policy 1, policy_version 1533910 (0.0009) [2023-12-26 11:55:24,935][123090] Updated weights for policy 1, policy_version 1533920 (0.0007) [2023-12-26 11:55:24,977][123091] Updated weights for policy 0, policy_version 1544022 (0.0010) [2023-12-26 11:55:25,047][123091] Updated weights for policy 0, policy_version 1544032 (0.0011) [2023-12-26 11:55:25,113][123091] Updated weights for policy 0, policy_version 1544042 (0.0010) [2023-12-26 11:55:25,712][123090] Updated weights for policy 1, policy_version 1533930 (0.0009) [2023-12-26 11:55:25,774][123090] Updated weights for policy 1, policy_version 1533940 (0.0009) [2023-12-26 11:55:25,823][123091] Updated weights for policy 0, policy_version 1544052 (0.0008) [2023-12-26 11:55:25,835][123090] Updated weights for policy 1, policy_version 1533950 (0.0008) [2023-12-26 11:55:25,883][123091] Updated weights for policy 0, policy_version 1544062 (0.0010) [2023-12-26 11:55:25,950][123091] Updated weights for policy 0, policy_version 1544072 (0.0009) [2023-12-26 11:55:26,572][123090] Updated weights for policy 1, policy_version 1533960 (0.0009) [2023-12-26 11:55:26,631][123090] Updated weights for policy 1, policy_version 1533970 (0.0009) [2023-12-26 11:55:26,697][123090] Updated weights for policy 1, policy_version 1533980 (0.0009) [2023-12-26 11:55:26,782][123091] Updated weights for policy 0, policy_version 1544082 (0.0009) [2023-12-26 11:55:26,829][123091] Updated weights for policy 0, policy_version 1544092 (0.0008) [2023-12-26 11:55:26,881][123091] Updated weights for policy 0, policy_version 1544102 (0.0008) [2023-12-26 11:55:26,938][123091] Updated weights for policy 0, policy_version 1544112 (0.0010) [2023-12-26 11:55:27,537][123090] Updated weights for policy 1, policy_version 1533990 (0.0007) [2023-12-26 11:55:27,625][123090] Updated weights for policy 1, policy_version 1534000 (0.0006) [2023-12-26 11:55:27,683][123090] Updated weights for policy 1, policy_version 1534010 (0.0006) [2023-12-26 11:55:27,756][123091] Updated weights for policy 0, policy_version 1544123 (0.0009) [2023-12-26 11:55:27,809][123091] Updated weights for policy 0, policy_version 1544133 (0.0010) [2023-12-26 11:55:27,862][123091] Updated weights for policy 0, policy_version 1544143 (0.0009) [2023-12-26 11:55:28,220][123090] Updated weights for policy 1, policy_version 1534020 (0.0006) [2023-12-26 11:55:28,268][123090] Updated weights for policy 1, policy_version 1534030 (0.0005) [2023-12-26 11:55:28,328][123090] Updated weights for policy 1, policy_version 1534040 (0.0005) [2023-12-26 11:55:28,732][123091] Updated weights for policy 0, policy_version 1544153 (0.0010) [2023-12-26 11:55:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 788021248. Throughput: 0: 8910.2, 1: 8928.5. Samples: 788017780. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:28,785][121949] Avg episode reward: [(0, '6177.277'), (1, '5757.090')] [2023-12-26 11:55:28,785][123091] Updated weights for policy 0, policy_version 1544164 (0.0010) [2023-12-26 11:55:28,832][123091] Updated weights for policy 0, policy_version 1544174 (0.0009) [2023-12-26 11:55:29,039][123090] Updated weights for policy 1, policy_version 1534050 (0.0008) [2023-12-26 11:55:29,089][123090] Updated weights for policy 1, policy_version 1534060 (0.0009) [2023-12-26 11:55:29,136][123090] Updated weights for policy 1, policy_version 1534070 (0.0009) [2023-12-26 11:55:29,190][123090] Updated weights for policy 1, policy_version 1534080 (0.0007) [2023-12-26 11:55:29,717][123091] Updated weights for policy 0, policy_version 1544184 (0.0009) [2023-12-26 11:55:29,764][123091] Updated weights for policy 0, policy_version 1544194 (0.0009) [2023-12-26 11:55:29,826][123091] Updated weights for policy 0, policy_version 1544204 (0.0009) [2023-12-26 11:55:30,037][123090] Updated weights for policy 1, policy_version 1534090 (0.0010) [2023-12-26 11:55:30,088][123090] Updated weights for policy 1, policy_version 1534100 (0.0010) [2023-12-26 11:55:30,158][123090] Updated weights for policy 1, policy_version 1534110 (0.0010) [2023-12-26 11:55:30,603][123091] Updated weights for policy 0, policy_version 1544214 (0.0010) [2023-12-26 11:55:30,653][123091] Updated weights for policy 0, policy_version 1544224 (0.0010) [2023-12-26 11:55:30,710][123091] Updated weights for policy 0, policy_version 1544234 (0.0010) [2023-12-26 11:55:31,002][123090] Updated weights for policy 1, policy_version 1534120 (0.0009) [2023-12-26 11:55:31,067][123090] Updated weights for policy 1, policy_version 1534130 (0.0009) [2023-12-26 11:55:31,136][123090] Updated weights for policy 1, policy_version 1534140 (0.0008) [2023-12-26 11:55:31,526][123091] Updated weights for policy 0, policy_version 1544244 (0.0010) [2023-12-26 11:55:31,580][123091] Updated weights for policy 0, policy_version 1544254 (0.0009) [2023-12-26 11:55:31,645][123091] Updated weights for policy 0, policy_version 1544264 (0.0008) [2023-12-26 11:55:31,922][123090] Updated weights for policy 1, policy_version 1534150 (0.0009) [2023-12-26 11:55:31,978][123090] Updated weights for policy 1, policy_version 1534160 (0.0010) [2023-12-26 11:55:32,034][123090] Updated weights for policy 1, policy_version 1534170 (0.0008) [2023-12-26 11:55:32,369][123091] Updated weights for policy 0, policy_version 1544274 (0.0008) [2023-12-26 11:55:32,433][123091] Updated weights for policy 0, policy_version 1544284 (0.0009) [2023-12-26 11:55:32,500][123091] Updated weights for policy 0, policy_version 1544294 (0.0010) [2023-12-26 11:55:32,560][123091] Updated weights for policy 0, policy_version 1544304 (0.0009) [2023-12-26 11:55:32,875][123090] Updated weights for policy 1, policy_version 1534180 (0.0007) [2023-12-26 11:55:32,937][123090] Updated weights for policy 1, policy_version 1534190 (0.0009) [2023-12-26 11:55:32,986][123090] Updated weights for policy 1, policy_version 1534200 (0.0009) [2023-12-26 11:55:33,314][123091] Updated weights for policy 0, policy_version 1544314 (0.0007) [2023-12-26 11:55:33,372][123091] Updated weights for policy 0, policy_version 1544324 (0.0008) [2023-12-26 11:55:33,418][123091] Updated weights for policy 0, policy_version 1544334 (0.0006) [2023-12-26 11:55:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 788111360. Throughput: 0: 8877.9, 1: 8946.0. Samples: 788124816. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:33,784][121949] Avg episode reward: [(0, '6228.874'), (1, '5699.840')] [2023-12-26 11:55:33,908][123090] Updated weights for policy 1, policy_version 1534210 (0.0009) [2023-12-26 11:55:33,966][123090] Updated weights for policy 1, policy_version 1534220 (0.0009) [2023-12-26 11:55:34,006][123091] Updated weights for policy 0, policy_version 1544344 (0.0009) [2023-12-26 11:55:34,020][123090] Updated weights for policy 1, policy_version 1534230 (0.0006) [2023-12-26 11:55:34,051][123091] Updated weights for policy 0, policy_version 1544354 (0.0008) [2023-12-26 11:55:34,080][123090] Updated weights for policy 1, policy_version 1534240 (0.0007) [2023-12-26 11:55:34,102][123091] Updated weights for policy 0, policy_version 1544364 (0.0009) [2023-12-26 11:55:34,888][123090] Updated weights for policy 1, policy_version 1534250 (0.0010) [2023-12-26 11:55:34,943][123090] Updated weights for policy 1, policy_version 1534260 (0.0010) [2023-12-26 11:55:34,986][123091] Updated weights for policy 0, policy_version 1544374 (0.0009) [2023-12-26 11:55:35,000][123090] Updated weights for policy 1, policy_version 1534270 (0.0008) [2023-12-26 11:55:35,046][123091] Updated weights for policy 0, policy_version 1544384 (0.0008) [2023-12-26 11:55:35,097][123091] Updated weights for policy 0, policy_version 1544394 (0.0009) [2023-12-26 11:55:35,689][123090] Updated weights for policy 1, policy_version 1534280 (0.0009) [2023-12-26 11:55:35,737][123090] Updated weights for policy 1, policy_version 1534290 (0.0010) [2023-12-26 11:55:35,792][123090] Updated weights for policy 1, policy_version 1534300 (0.0010) [2023-12-26 11:55:35,983][123091] Updated weights for policy 0, policy_version 1544405 (0.0010) [2023-12-26 11:55:36,048][123091] Updated weights for policy 0, policy_version 1544415 (0.0010) [2023-12-26 11:55:36,118][123091] Updated weights for policy 0, policy_version 1544425 (0.0009) [2023-12-26 11:55:36,497][123090] Updated weights for policy 1, policy_version 1534310 (0.0007) [2023-12-26 11:55:36,568][123090] Updated weights for policy 1, policy_version 1534320 (0.0006) [2023-12-26 11:55:36,643][123090] Updated weights for policy 1, policy_version 1534330 (0.0006) [2023-12-26 11:55:37,006][123091] Updated weights for policy 0, policy_version 1544435 (0.0009) [2023-12-26 11:55:37,069][123091] Updated weights for policy 0, policy_version 1544445 (0.0009) [2023-12-26 11:55:37,121][123091] Updated weights for policy 0, policy_version 1544455 (0.0008) [2023-12-26 11:55:37,351][123090] Updated weights for policy 1, policy_version 1534340 (0.0006) [2023-12-26 11:55:37,411][123090] Updated weights for policy 1, policy_version 1534350 (0.0006) [2023-12-26 11:55:37,471][123090] Updated weights for policy 1, policy_version 1534360 (0.0008) [2023-12-26 11:55:38,012][123091] Updated weights for policy 0, policy_version 1544465 (0.0008) [2023-12-26 11:55:38,087][123091] Updated weights for policy 0, policy_version 1544475 (0.0010) [2023-12-26 11:55:38,159][123091] Updated weights for policy 0, policy_version 1544485 (0.0010) [2023-12-26 11:55:38,215][123090] Updated weights for policy 1, policy_version 1534370 (0.0008) [2023-12-26 11:55:38,227][123091] Updated weights for policy 0, policy_version 1544495 (0.0009) [2023-12-26 11:55:38,287][123090] Updated weights for policy 1, policy_version 1534380 (0.0005) [2023-12-26 11:55:38,356][123090] Updated weights for policy 1, policy_version 1534390 (0.0007) [2023-12-26 11:55:38,433][123090] Updated weights for policy 1, policy_version 1534400 (0.0008) [2023-12-26 11:55:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17966.9). Total num frames: 788201472. Throughput: 0: 8902.7, 1: 8956.6. Samples: 788177856. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:38,785][121949] Avg episode reward: [(0, '6237.650'), (1, '5591.065')] [2023-12-26 11:55:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001534400_392806400.pth... [2023-12-26 11:55:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001544496_395395072.pth... [2023-12-26 11:55:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001533376_392544256.pth [2023-12-26 11:55:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001543472_395132928.pth [2023-12-26 11:55:39,065][123091] Updated weights for policy 0, policy_version 1544505 (0.0009) [2023-12-26 11:55:39,117][123091] Updated weights for policy 0, policy_version 1544515 (0.0009) [2023-12-26 11:55:39,160][123090] Updated weights for policy 1, policy_version 1534410 (0.0007) [2023-12-26 11:55:39,166][123091] Updated weights for policy 0, policy_version 1544525 (0.0008) [2023-12-26 11:55:39,227][123090] Updated weights for policy 1, policy_version 1534420 (0.0008) [2023-12-26 11:55:39,288][123090] Updated weights for policy 1, policy_version 1534430 (0.0009) [2023-12-26 11:55:40,012][123091] Updated weights for policy 0, policy_version 1544535 (0.0010) [2023-12-26 11:55:40,077][123091] Updated weights for policy 0, policy_version 1544545 (0.0009) [2023-12-26 11:55:40,139][123091] Updated weights for policy 0, policy_version 1544555 (0.0007) [2023-12-26 11:55:40,146][123090] Updated weights for policy 1, policy_version 1534440 (0.0010) [2023-12-26 11:55:40,206][123090] Updated weights for policy 1, policy_version 1534450 (0.0008) [2023-12-26 11:55:40,272][123090] Updated weights for policy 1, policy_version 1534460 (0.0009) [2023-12-26 11:55:40,988][123091] Updated weights for policy 0, policy_version 1544565 (0.0010) [2023-12-26 11:55:41,050][123091] Updated weights for policy 0, policy_version 1544575 (0.0009) [2023-12-26 11:55:41,074][123090] Updated weights for policy 1, policy_version 1534470 (0.0009) [2023-12-26 11:55:41,109][123091] Updated weights for policy 0, policy_version 1544585 (0.0010) [2023-12-26 11:55:41,138][123090] Updated weights for policy 1, policy_version 1534480 (0.0008) [2023-12-26 11:55:41,211][123090] Updated weights for policy 1, policy_version 1534490 (0.0007) [2023-12-26 11:55:42,005][123091] Updated weights for policy 0, policy_version 1544595 (0.0008) [2023-12-26 11:55:42,016][123090] Updated weights for policy 1, policy_version 1534500 (0.0007) [2023-12-26 11:55:42,062][123091] Updated weights for policy 0, policy_version 1544605 (0.0006) [2023-12-26 11:55:42,078][123090] Updated weights for policy 1, policy_version 1534510 (0.0008) [2023-12-26 11:55:42,131][123091] Updated weights for policy 0, policy_version 1544615 (0.0005) [2023-12-26 11:55:42,143][123090] Updated weights for policy 1, policy_version 1534520 (0.0006) [2023-12-26 11:55:42,885][123090] Updated weights for policy 1, policy_version 1534530 (0.0007) [2023-12-26 11:55:42,941][123091] Updated weights for policy 0, policy_version 1544625 (0.0006) [2023-12-26 11:55:42,956][123090] Updated weights for policy 1, policy_version 1534540 (0.0005) [2023-12-26 11:55:43,005][123091] Updated weights for policy 0, policy_version 1544635 (0.0008) [2023-12-26 11:55:43,019][123090] Updated weights for policy 1, policy_version 1534550 (0.0006) [2023-12-26 11:55:43,063][123091] Updated weights for policy 0, policy_version 1544645 (0.0008) [2023-12-26 11:55:43,085][123090] Updated weights for policy 1, policy_version 1534560 (0.0010) [2023-12-26 11:55:43,121][123091] Updated weights for policy 0, policy_version 1544655 (0.0009) [2023-12-26 11:55:43,708][123090] Updated weights for policy 1, policy_version 1534570 (0.0005) [2023-12-26 11:55:43,765][123090] Updated weights for policy 1, policy_version 1534580 (0.0005) [2023-12-26 11:55:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17939.1). Total num frames: 788283392. Throughput: 0: 8854.2, 1: 8862.5. Samples: 788281480. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:43,785][121949] Avg episode reward: [(0, '6156.422'), (1, '5521.653')] [2023-12-26 11:55:43,817][123090] Updated weights for policy 1, policy_version 1534590 (0.0006) [2023-12-26 11:55:43,851][123091] Updated weights for policy 0, policy_version 1544665 (0.0006) [2023-12-26 11:55:43,904][123091] Updated weights for policy 0, policy_version 1544675 (0.0006) [2023-12-26 11:55:43,973][123091] Updated weights for policy 0, policy_version 1544685 (0.0006) [2023-12-26 11:55:44,631][123091] Updated weights for policy 0, policy_version 1544695 (0.0008) [2023-12-26 11:55:44,654][123090] Updated weights for policy 1, policy_version 1534600 (0.0008) [2023-12-26 11:55:44,699][123091] Updated weights for policy 0, policy_version 1544705 (0.0006) [2023-12-26 11:55:44,710][123090] Updated weights for policy 1, policy_version 1534610 (0.0009) [2023-12-26 11:55:44,751][123091] Updated weights for policy 0, policy_version 1544715 (0.0008) [2023-12-26 11:55:44,770][123090] Updated weights for policy 1, policy_version 1534620 (0.0008) [2023-12-26 11:55:45,578][123091] Updated weights for policy 0, policy_version 1544725 (0.0009) [2023-12-26 11:55:45,599][123090] Updated weights for policy 1, policy_version 1534630 (0.0006) [2023-12-26 11:55:45,641][123091] Updated weights for policy 0, policy_version 1544735 (0.0008) [2023-12-26 11:55:45,663][123090] Updated weights for policy 1, policy_version 1534640 (0.0007) [2023-12-26 11:55:45,688][123091] Updated weights for policy 0, policy_version 1544745 (0.0010) [2023-12-26 11:55:45,720][123090] Updated weights for policy 1, policy_version 1534650 (0.0005) [2023-12-26 11:55:46,493][123090] Updated weights for policy 1, policy_version 1534660 (0.0010) [2023-12-26 11:55:46,550][123090] Updated weights for policy 1, policy_version 1534670 (0.0009) [2023-12-26 11:55:46,556][123091] Updated weights for policy 0, policy_version 1544755 (0.0008) [2023-12-26 11:55:46,604][123091] Updated weights for policy 0, policy_version 1544765 (0.0009) [2023-12-26 11:55:46,614][123090] Updated weights for policy 1, policy_version 1534680 (0.0008) [2023-12-26 11:55:46,653][123091] Updated weights for policy 0, policy_version 1544775 (0.0006) [2023-12-26 11:55:47,419][123091] Updated weights for policy 0, policy_version 1544785 (0.0005) [2023-12-26 11:55:47,472][123090] Updated weights for policy 1, policy_version 1534690 (0.0009) [2023-12-26 11:55:47,479][123091] Updated weights for policy 0, policy_version 1544795 (0.0008) [2023-12-26 11:55:47,534][123090] Updated weights for policy 1, policy_version 1534700 (0.0009) [2023-12-26 11:55:47,535][123091] Updated weights for policy 0, policy_version 1544805 (0.0009) [2023-12-26 11:55:47,591][123091] Updated weights for policy 0, policy_version 1544815 (0.0009) [2023-12-26 11:55:47,596][123090] Updated weights for policy 1, policy_version 1534710 (0.0008) [2023-12-26 11:55:47,644][123090] Updated weights for policy 1, policy_version 1534720 (0.0008) [2023-12-26 11:55:48,321][123091] Updated weights for policy 0, policy_version 1544825 (0.0006) [2023-12-26 11:55:48,393][123091] Updated weights for policy 0, policy_version 1544835 (0.0009) [2023-12-26 11:55:48,453][123091] Updated weights for policy 0, policy_version 1544845 (0.0011) [2023-12-26 11:55:48,571][123090] Updated weights for policy 1, policy_version 1534730 (0.0009) [2023-12-26 11:55:48,641][123090] Updated weights for policy 1, policy_version 1534740 (0.0008) [2023-12-26 11:55:48,709][123090] Updated weights for policy 1, policy_version 1534750 (0.0009) [2023-12-26 11:55:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 788381696. Throughput: 0: 8866.9, 1: 8874.3. Samples: 788388732. Policy #0 lag: (min: 31.0, avg: 39.4, max: 63.0) [2023-12-26 11:55:48,785][121949] Avg episode reward: [(0, '6123.678'), (1, '5501.547')] [2023-12-26 11:55:49,265][123091] Updated weights for policy 0, policy_version 1544855 (0.0011) [2023-12-26 11:55:49,329][123091] Updated weights for policy 0, policy_version 1544865 (0.0010) [2023-12-26 11:55:49,393][123091] Updated weights for policy 0, policy_version 1544875 (0.0009) [2023-12-26 11:55:49,547][123090] Updated weights for policy 1, policy_version 1534760 (0.0010) [2023-12-26 11:55:49,607][123090] Updated weights for policy 1, policy_version 1534770 (0.0011) [2023-12-26 11:55:49,663][123090] Updated weights for policy 1, policy_version 1534780 (0.0011) [2023-12-26 11:55:50,181][123091] Updated weights for policy 0, policy_version 1544885 (0.0009) [2023-12-26 11:55:50,244][123091] Updated weights for policy 0, policy_version 1544895 (0.0011) [2023-12-26 11:55:50,300][123091] Updated weights for policy 0, policy_version 1544905 (0.0011) [2023-12-26 11:55:50,494][123090] Updated weights for policy 1, policy_version 1534790 (0.0011) [2023-12-26 11:55:50,558][123090] Updated weights for policy 1, policy_version 1534800 (0.0011) [2023-12-26 11:55:50,640][123090] Updated weights for policy 1, policy_version 1534810 (0.0011) [2023-12-26 11:55:51,171][123091] Updated weights for policy 0, policy_version 1544915 (0.0011) [2023-12-26 11:55:51,230][123091] Updated weights for policy 0, policy_version 1544925 (0.0011) [2023-12-26 11:55:51,299][123091] Updated weights for policy 0, policy_version 1544935 (0.0007) [2023-12-26 11:55:51,453][123090] Updated weights for policy 1, policy_version 1534820 (0.0011) [2023-12-26 11:55:51,504][123090] Updated weights for policy 1, policy_version 1534830 (0.0010) [2023-12-26 11:55:51,558][123090] Updated weights for policy 1, policy_version 1534840 (0.0010) [2023-12-26 11:55:52,056][123091] Updated weights for policy 0, policy_version 1544945 (0.0008) [2023-12-26 11:55:52,121][123091] Updated weights for policy 0, policy_version 1544955 (0.0009) [2023-12-26 11:55:52,176][123091] Updated weights for policy 0, policy_version 1544965 (0.0009) [2023-12-26 11:55:52,240][123091] Updated weights for policy 0, policy_version 1544975 (0.0009) [2023-12-26 11:55:52,478][123090] Updated weights for policy 1, policy_version 1534850 (0.0008) [2023-12-26 11:55:52,540][123090] Updated weights for policy 1, policy_version 1534860 (0.0010) [2023-12-26 11:55:52,602][123090] Updated weights for policy 1, policy_version 1534870 (0.0009) [2023-12-26 11:55:52,663][123090] Updated weights for policy 1, policy_version 1534880 (0.0009) [2023-12-26 11:55:53,026][123091] Updated weights for policy 0, policy_version 1544985 (0.0010) [2023-12-26 11:55:53,087][123091] Updated weights for policy 0, policy_version 1544995 (0.0006) [2023-12-26 11:55:53,138][123091] Updated weights for policy 0, policy_version 1545005 (0.0010) [2023-12-26 11:55:53,538][123090] Updated weights for policy 1, policy_version 1534890 (0.0009) [2023-12-26 11:55:53,602][123090] Updated weights for policy 1, policy_version 1534900 (0.0009) [2023-12-26 11:55:53,667][123090] Updated weights for policy 1, policy_version 1534910 (0.0009) [2023-12-26 11:55:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 788463616. Throughput: 0: 8824.8, 1: 8754.5. Samples: 788439520. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:55:53,785][121949] Avg episode reward: [(0, '6155.290'), (1, '5556.878')] [2023-12-26 11:55:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001534912_392937472.pth... [2023-12-26 11:55:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001545008_395526144.pth... [2023-12-26 11:55:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001533856_392667136.pth [2023-12-26 11:55:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001543984_395264000.pth [2023-12-26 11:55:53,959][123091] Updated weights for policy 0, policy_version 1545015 (0.0011) [2023-12-26 11:55:54,015][123091] Updated weights for policy 0, policy_version 1545025 (0.0011) [2023-12-26 11:55:54,067][123091] Updated weights for policy 0, policy_version 1545035 (0.0010) [2023-12-26 11:55:54,450][123090] Updated weights for policy 1, policy_version 1534920 (0.0010) [2023-12-26 11:55:54,506][123090] Updated weights for policy 1, policy_version 1534930 (0.0011) [2023-12-26 11:55:54,557][123090] Updated weights for policy 1, policy_version 1534940 (0.0010) [2023-12-26 11:55:54,909][123091] Updated weights for policy 0, policy_version 1545045 (0.0010) [2023-12-26 11:55:54,981][123091] Updated weights for policy 0, policy_version 1545055 (0.0009) [2023-12-26 11:55:55,045][123091] Updated weights for policy 0, policy_version 1545065 (0.0008) [2023-12-26 11:55:55,404][123090] Updated weights for policy 1, policy_version 1534950 (0.0010) [2023-12-26 11:55:55,473][123090] Updated weights for policy 1, policy_version 1534960 (0.0010) [2023-12-26 11:55:55,535][123090] Updated weights for policy 1, policy_version 1534970 (0.0010) [2023-12-26 11:55:55,870][123091] Updated weights for policy 0, policy_version 1545075 (0.0008) [2023-12-26 11:55:55,924][123091] Updated weights for policy 0, policy_version 1545085 (0.0005) [2023-12-26 11:55:55,977][123091] Updated weights for policy 0, policy_version 1545095 (0.0005) [2023-12-26 11:55:56,193][123090] Updated weights for policy 1, policy_version 1534980 (0.0005) [2023-12-26 11:55:56,261][123090] Updated weights for policy 1, policy_version 1534990 (0.0006) [2023-12-26 11:55:56,331][123090] Updated weights for policy 1, policy_version 1535000 (0.0010) [2023-12-26 11:55:56,675][123091] Updated weights for policy 0, policy_version 1545105 (0.0006) [2023-12-26 11:55:56,734][123091] Updated weights for policy 0, policy_version 1545115 (0.0008) [2023-12-26 11:55:56,793][123091] Updated weights for policy 0, policy_version 1545125 (0.0008) [2023-12-26 11:55:56,852][123091] Updated weights for policy 0, policy_version 1545135 (0.0008) [2023-12-26 11:55:57,092][123090] Updated weights for policy 1, policy_version 1535010 (0.0011) [2023-12-26 11:55:57,162][123090] Updated weights for policy 1, policy_version 1535020 (0.0010) [2023-12-26 11:55:57,231][123090] Updated weights for policy 1, policy_version 1535030 (0.0010) [2023-12-26 11:55:57,302][123090] Updated weights for policy 1, policy_version 1535040 (0.0010) [2023-12-26 11:55:57,623][123091] Updated weights for policy 0, policy_version 1545145 (0.0008) [2023-12-26 11:55:57,680][123091] Updated weights for policy 0, policy_version 1545155 (0.0009) [2023-12-26 11:55:57,732][123091] Updated weights for policy 0, policy_version 1545165 (0.0009) [2023-12-26 11:55:58,102][123090] Updated weights for policy 1, policy_version 1535050 (0.0011) [2023-12-26 11:55:58,166][123090] Updated weights for policy 1, policy_version 1535060 (0.0011) [2023-12-26 11:55:58,230][123090] Updated weights for policy 1, policy_version 1535070 (0.0011) [2023-12-26 11:55:58,571][123091] Updated weights for policy 0, policy_version 1545175 (0.0008) [2023-12-26 11:55:58,643][123091] Updated weights for policy 0, policy_version 1545185 (0.0008) [2023-12-26 11:55:58,709][123091] Updated weights for policy 0, policy_version 1545195 (0.0008) [2023-12-26 11:55:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 788553728. Throughput: 0: 8859.7, 1: 8729.0. Samples: 788545852. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:55:58,785][121949] Avg episode reward: [(0, '6175.357'), (1, '5717.023')] [2023-12-26 11:55:59,102][123090] Updated weights for policy 1, policy_version 1535080 (0.0006) [2023-12-26 11:55:59,165][123090] Updated weights for policy 1, policy_version 1535090 (0.0006) [2023-12-26 11:55:59,228][123090] Updated weights for policy 1, policy_version 1535100 (0.0006) [2023-12-26 11:55:59,448][123091] Updated weights for policy 0, policy_version 1545205 (0.0009) [2023-12-26 11:55:59,496][123091] Updated weights for policy 0, policy_version 1545215 (0.0009) [2023-12-26 11:55:59,546][123091] Updated weights for policy 0, policy_version 1545225 (0.0009) [2023-12-26 11:56:00,006][123090] Updated weights for policy 1, policy_version 1535110 (0.0008) [2023-12-26 11:56:00,063][123090] Updated weights for policy 1, policy_version 1535120 (0.0010) [2023-12-26 11:56:00,118][123090] Updated weights for policy 1, policy_version 1535130 (0.0010) [2023-12-26 11:56:00,433][123091] Updated weights for policy 0, policy_version 1545235 (0.0009) [2023-12-26 11:56:00,485][123091] Updated weights for policy 0, policy_version 1545245 (0.0008) [2023-12-26 11:56:00,537][123091] Updated weights for policy 0, policy_version 1545255 (0.0009) [2023-12-26 11:56:00,971][123090] Updated weights for policy 1, policy_version 1535140 (0.0010) [2023-12-26 11:56:01,038][123090] Updated weights for policy 1, policy_version 1535150 (0.0010) [2023-12-26 11:56:01,106][123090] Updated weights for policy 1, policy_version 1535160 (0.0010) [2023-12-26 11:56:01,312][123091] Updated weights for policy 0, policy_version 1545265 (0.0009) [2023-12-26 11:56:01,378][123091] Updated weights for policy 0, policy_version 1545275 (0.0011) [2023-12-26 11:56:01,431][123091] Updated weights for policy 0, policy_version 1545285 (0.0010) [2023-12-26 11:56:01,482][123091] Updated weights for policy 0, policy_version 1545295 (0.0010) [2023-12-26 11:56:01,941][123090] Updated weights for policy 1, policy_version 1535170 (0.0010) [2023-12-26 11:56:02,004][123090] Updated weights for policy 1, policy_version 1535180 (0.0010) [2023-12-26 11:56:02,071][123090] Updated weights for policy 1, policy_version 1535190 (0.0010) [2023-12-26 11:56:02,131][123090] Updated weights for policy 1, policy_version 1535200 (0.0010) [2023-12-26 11:56:02,323][123091] Updated weights for policy 0, policy_version 1545305 (0.0009) [2023-12-26 11:56:02,388][123091] Updated weights for policy 0, policy_version 1545315 (0.0009) [2023-12-26 11:56:02,442][123091] Updated weights for policy 0, policy_version 1545325 (0.0006) [2023-12-26 11:56:02,947][123090] Updated weights for policy 1, policy_version 1535210 (0.0010) [2023-12-26 11:56:03,018][123090] Updated weights for policy 1, policy_version 1535220 (0.0010) [2023-12-26 11:56:03,082][123090] Updated weights for policy 1, policy_version 1535230 (0.0011) [2023-12-26 11:56:03,199][123091] Updated weights for policy 0, policy_version 1545335 (0.0008) [2023-12-26 11:56:03,267][123091] Updated weights for policy 0, policy_version 1545345 (0.0009) [2023-12-26 11:56:03,327][123091] Updated weights for policy 0, policy_version 1545355 (0.0009) [2023-12-26 11:56:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 788635648. Throughput: 0: 8808.3, 1: 8777.0. Samples: 788649572. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:03,785][121949] Avg episode reward: [(0, '5873.881'), (1, '5792.748')] [2023-12-26 11:56:03,897][123090] Updated weights for policy 1, policy_version 1535240 (0.0010) [2023-12-26 11:56:03,959][123090] Updated weights for policy 1, policy_version 1535250 (0.0009) [2023-12-26 11:56:04,022][123090] Updated weights for policy 1, policy_version 1535260 (0.0009) [2023-12-26 11:56:04,099][123091] Updated weights for policy 0, policy_version 1545365 (0.0009) [2023-12-26 11:56:04,166][123091] Updated weights for policy 0, policy_version 1545375 (0.0009) [2023-12-26 11:56:04,228][123091] Updated weights for policy 0, policy_version 1545385 (0.0009) [2023-12-26 11:56:04,831][123090] Updated weights for policy 1, policy_version 1535270 (0.0007) [2023-12-26 11:56:04,900][123090] Updated weights for policy 1, policy_version 1535280 (0.0005) [2023-12-26 11:56:04,959][123090] Updated weights for policy 1, policy_version 1535290 (0.0010) [2023-12-26 11:56:05,094][123091] Updated weights for policy 0, policy_version 1545395 (0.0009) [2023-12-26 11:56:05,151][123091] Updated weights for policy 0, policy_version 1545405 (0.0009) [2023-12-26 11:56:05,205][123091] Updated weights for policy 0, policy_version 1545415 (0.0010) [2023-12-26 11:56:05,611][123090] Updated weights for policy 1, policy_version 1535300 (0.0008) [2023-12-26 11:56:05,680][123090] Updated weights for policy 1, policy_version 1535310 (0.0005) [2023-12-26 11:56:05,736][123090] Updated weights for policy 1, policy_version 1535320 (0.0005) [2023-12-26 11:56:06,139][123091] Updated weights for policy 0, policy_version 1545425 (0.0009) [2023-12-26 11:56:06,203][123091] Updated weights for policy 0, policy_version 1545435 (0.0010) [2023-12-26 11:56:06,272][123091] Updated weights for policy 0, policy_version 1545445 (0.0010) [2023-12-26 11:56:06,348][123091] Updated weights for policy 0, policy_version 1545455 (0.0010) [2023-12-26 11:56:06,403][123090] Updated weights for policy 1, policy_version 1535330 (0.0005) [2023-12-26 11:56:06,473][123090] Updated weights for policy 1, policy_version 1535340 (0.0009) [2023-12-26 11:56:06,547][123090] Updated weights for policy 1, policy_version 1535350 (0.0011) [2023-12-26 11:56:06,608][123090] Updated weights for policy 1, policy_version 1535360 (0.0011) [2023-12-26 11:56:07,233][123091] Updated weights for policy 0, policy_version 1545465 (0.0009) [2023-12-26 11:56:07,299][123091] Updated weights for policy 0, policy_version 1545475 (0.0009) [2023-12-26 11:56:07,320][123090] Updated weights for policy 1, policy_version 1535370 (0.0006) [2023-12-26 11:56:07,360][123091] Updated weights for policy 0, policy_version 1545485 (0.0009) [2023-12-26 11:56:07,374][123090] Updated weights for policy 1, policy_version 1535380 (0.0005) [2023-12-26 11:56:07,443][123090] Updated weights for policy 1, policy_version 1535390 (0.0008) [2023-12-26 11:56:08,169][123090] Updated weights for policy 1, policy_version 1535400 (0.0010) [2023-12-26 11:56:08,233][123090] Updated weights for policy 1, policy_version 1535410 (0.0010) [2023-12-26 11:56:08,238][123091] Updated weights for policy 0, policy_version 1545495 (0.0010) [2023-12-26 11:56:08,281][123090] Updated weights for policy 1, policy_version 1535420 (0.0010) [2023-12-26 11:56:08,291][123091] Updated weights for policy 0, policy_version 1545505 (0.0009) [2023-12-26 11:56:08,368][123091] Updated weights for policy 0, policy_version 1545515 (0.0008) [2023-12-26 11:56:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17883.5). Total num frames: 788725760. Throughput: 0: 8778.9, 1: 8832.1. Samples: 788702428. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:08,785][121949] Avg episode reward: [(0, '5876.750'), (1, '5727.321')] [2023-12-26 11:56:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001535424_393068544.pth... [2023-12-26 11:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001545520_395657216.pth... [2023-12-26 11:56:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001544496_395395072.pth [2023-12-26 11:56:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001534400_392806400.pth [2023-12-26 11:56:09,125][123090] Updated weights for policy 1, policy_version 1535430 (0.0010) [2023-12-26 11:56:09,191][123090] Updated weights for policy 1, policy_version 1535440 (0.0010) [2023-12-26 11:56:09,212][123091] Updated weights for policy 0, policy_version 1545525 (0.0008) [2023-12-26 11:56:09,258][123090] Updated weights for policy 1, policy_version 1535450 (0.0010) [2023-12-26 11:56:09,275][123091] Updated weights for policy 0, policy_version 1545535 (0.0008) [2023-12-26 11:56:09,352][123091] Updated weights for policy 0, policy_version 1545545 (0.0007) [2023-12-26 11:56:09,991][123090] Updated weights for policy 1, policy_version 1535460 (0.0007) [2023-12-26 11:56:10,057][123090] Updated weights for policy 1, policy_version 1535470 (0.0006) [2023-12-26 11:56:10,135][123090] Updated weights for policy 1, policy_version 1535480 (0.0006) [2023-12-26 11:56:10,167][123091] Updated weights for policy 0, policy_version 1545555 (0.0008) [2023-12-26 11:56:10,240][123091] Updated weights for policy 0, policy_version 1545565 (0.0009) [2023-12-26 11:56:10,299][123091] Updated weights for policy 0, policy_version 1545575 (0.0010) [2023-12-26 11:56:10,792][123090] Updated weights for policy 1, policy_version 1535490 (0.0007) [2023-12-26 11:56:10,845][123090] Updated weights for policy 1, policy_version 1535500 (0.0009) [2023-12-26 11:56:10,898][123090] Updated weights for policy 1, policy_version 1535510 (0.0009) [2023-12-26 11:56:10,945][123090] Updated weights for policy 1, policy_version 1535520 (0.0009) [2023-12-26 11:56:11,173][123091] Updated weights for policy 0, policy_version 1545585 (0.0010) [2023-12-26 11:56:11,240][123091] Updated weights for policy 0, policy_version 1545595 (0.0011) [2023-12-26 11:56:11,320][123091] Updated weights for policy 0, policy_version 1545605 (0.0011) [2023-12-26 11:56:11,396][123091] Updated weights for policy 0, policy_version 1545615 (0.0010) [2023-12-26 11:56:11,836][123090] Updated weights for policy 1, policy_version 1535530 (0.0009) [2023-12-26 11:56:11,908][123090] Updated weights for policy 1, policy_version 1535540 (0.0009) [2023-12-26 11:56:11,962][123090] Updated weights for policy 1, policy_version 1535550 (0.0010) [2023-12-26 11:56:12,147][123091] Updated weights for policy 0, policy_version 1545625 (0.0011) [2023-12-26 11:56:12,207][123091] Updated weights for policy 0, policy_version 1545635 (0.0006) [2023-12-26 11:56:12,269][123091] Updated weights for policy 0, policy_version 1545645 (0.0007) [2023-12-26 11:56:12,801][123090] Updated weights for policy 1, policy_version 1535560 (0.0007) [2023-12-26 11:56:12,875][123090] Updated weights for policy 1, policy_version 1535570 (0.0008) [2023-12-26 11:56:12,946][123090] Updated weights for policy 1, policy_version 1535580 (0.0009) [2023-12-26 11:56:13,132][123091] Updated weights for policy 0, policy_version 1545655 (0.0010) [2023-12-26 11:56:13,184][123091] Updated weights for policy 0, policy_version 1545665 (0.0010) [2023-12-26 11:56:13,242][123091] Updated weights for policy 0, policy_version 1545675 (0.0010) [2023-12-26 11:56:13,617][123090] Updated weights for policy 1, policy_version 1535590 (0.0009) [2023-12-26 11:56:13,670][123090] Updated weights for policy 1, policy_version 1535600 (0.0009) [2023-12-26 11:56:13,723][123090] Updated weights for policy 1, policy_version 1535610 (0.0009) [2023-12-26 11:56:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17911.3). Total num frames: 788815872. Throughput: 0: 8680.1, 1: 8834.0. Samples: 788805916. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:13,785][121949] Avg episode reward: [(0, '6017.246'), (1, '5239.021')] [2023-12-26 11:56:13,962][123091] Updated weights for policy 0, policy_version 1545685 (0.0007) [2023-12-26 11:56:14,010][123091] Updated weights for policy 0, policy_version 1545695 (0.0005) [2023-12-26 11:56:14,062][123091] Updated weights for policy 0, policy_version 1545705 (0.0005) [2023-12-26 11:56:14,574][123090] Updated weights for policy 1, policy_version 1535620 (0.0010) [2023-12-26 11:56:14,650][123090] Updated weights for policy 1, policy_version 1535630 (0.0005) [2023-12-26 11:56:14,705][123090] Updated weights for policy 1, policy_version 1535640 (0.0008) [2023-12-26 11:56:14,753][123091] Updated weights for policy 0, policy_version 1545715 (0.0007) [2023-12-26 11:56:14,821][123091] Updated weights for policy 0, policy_version 1545725 (0.0011) [2023-12-26 11:56:14,888][123091] Updated weights for policy 0, policy_version 1545735 (0.0011) [2023-12-26 11:56:15,536][123090] Updated weights for policy 1, policy_version 1535650 (0.0010) [2023-12-26 11:56:15,593][123090] Updated weights for policy 1, policy_version 1535660 (0.0006) [2023-12-26 11:56:15,641][123090] Updated weights for policy 1, policy_version 1535670 (0.0005) [2023-12-26 11:56:15,686][123090] Updated weights for policy 1, policy_version 1535680 (0.0005) [2023-12-26 11:56:15,703][123091] Updated weights for policy 0, policy_version 1545745 (0.0011) [2023-12-26 11:56:15,769][123091] Updated weights for policy 0, policy_version 1545755 (0.0010) [2023-12-26 11:56:15,835][123091] Updated weights for policy 0, policy_version 1545765 (0.0011) [2023-12-26 11:56:15,900][123091] Updated weights for policy 0, policy_version 1545775 (0.0010) [2023-12-26 11:56:16,453][123090] Updated weights for policy 1, policy_version 1535690 (0.0010) [2023-12-26 11:56:16,504][123090] Updated weights for policy 1, policy_version 1535700 (0.0010) [2023-12-26 11:56:16,564][123090] Updated weights for policy 1, policy_version 1535710 (0.0010) [2023-12-26 11:56:16,690][123091] Updated weights for policy 0, policy_version 1545785 (0.0011) [2023-12-26 11:56:16,751][123091] Updated weights for policy 0, policy_version 1545795 (0.0007) [2023-12-26 11:56:16,815][123091] Updated weights for policy 0, policy_version 1545805 (0.0005) [2023-12-26 11:56:17,354][123090] Updated weights for policy 1, policy_version 1535720 (0.0009) [2023-12-26 11:56:17,397][123090] Updated weights for policy 1, policy_version 1535730 (0.0010) [2023-12-26 11:56:17,441][123090] Updated weights for policy 1, policy_version 1535740 (0.0010) [2023-12-26 11:56:17,521][123091] Updated weights for policy 0, policy_version 1545815 (0.0008) [2023-12-26 11:56:17,573][123091] Updated weights for policy 0, policy_version 1545825 (0.0009) [2023-12-26 11:56:17,627][123091] Updated weights for policy 0, policy_version 1545836 (0.0009) [2023-12-26 11:56:18,202][123090] Updated weights for policy 1, policy_version 1535750 (0.0008) [2023-12-26 11:56:18,259][123090] Updated weights for policy 1, policy_version 1535760 (0.0006) [2023-12-26 11:56:18,318][123090] Updated weights for policy 1, policy_version 1535770 (0.0007) [2023-12-26 11:56:18,388][123091] Updated weights for policy 0, policy_version 1545846 (0.0009) [2023-12-26 11:56:18,443][123091] Updated weights for policy 0, policy_version 1545856 (0.0011) [2023-12-26 11:56:18,501][123091] Updated weights for policy 0, policy_version 1545866 (0.0011) [2023-12-26 11:56:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17939.1). Total num frames: 788905984. Throughput: 0: 8716.2, 1: 8860.4. Samples: 788915768. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:18,785][121949] Avg episode reward: [(0, '6170.794'), (1, '5004.637')] [2023-12-26 11:56:19,112][123090] Updated weights for policy 1, policy_version 1535780 (0.0009) [2023-12-26 11:56:19,171][123090] Updated weights for policy 1, policy_version 1535790 (0.0010) [2023-12-26 11:56:19,237][123090] Updated weights for policy 1, policy_version 1535800 (0.0010) [2023-12-26 11:56:19,330][123091] Updated weights for policy 0, policy_version 1545876 (0.0010) [2023-12-26 11:56:19,405][123091] Updated weights for policy 0, policy_version 1545886 (0.0008) [2023-12-26 11:56:19,479][123091] Updated weights for policy 0, policy_version 1545896 (0.0008) [2023-12-26 11:56:20,038][123090] Updated weights for policy 1, policy_version 1535810 (0.0010) [2023-12-26 11:56:20,099][123090] Updated weights for policy 1, policy_version 1535820 (0.0011) [2023-12-26 11:56:20,170][123090] Updated weights for policy 1, policy_version 1535830 (0.0006) [2023-12-26 11:56:20,243][123090] Updated weights for policy 1, policy_version 1535840 (0.0006) [2023-12-26 11:56:20,265][123091] Updated weights for policy 0, policy_version 1545906 (0.0009) [2023-12-26 11:56:20,332][123091] Updated weights for policy 0, policy_version 1545916 (0.0010) [2023-12-26 11:56:20,399][123091] Updated weights for policy 0, policy_version 1545926 (0.0010) [2023-12-26 11:56:20,460][123091] Updated weights for policy 0, policy_version 1545936 (0.0009) [2023-12-26 11:56:20,975][123090] Updated weights for policy 1, policy_version 1535850 (0.0011) [2023-12-26 11:56:21,046][123090] Updated weights for policy 1, policy_version 1535860 (0.0009) [2023-12-26 11:56:21,114][123090] Updated weights for policy 1, policy_version 1535870 (0.0007) [2023-12-26 11:56:21,252][123091] Updated weights for policy 0, policy_version 1545946 (0.0009) [2023-12-26 11:56:21,316][123091] Updated weights for policy 0, policy_version 1545956 (0.0009) [2023-12-26 11:56:21,388][123091] Updated weights for policy 0, policy_version 1545966 (0.0009) [2023-12-26 11:56:21,941][123090] Updated weights for policy 1, policy_version 1535880 (0.0010) [2023-12-26 11:56:22,007][123090] Updated weights for policy 1, policy_version 1535890 (0.0010) [2023-12-26 11:56:22,074][123090] Updated weights for policy 1, policy_version 1535900 (0.0010) [2023-12-26 11:56:22,291][123091] Updated weights for policy 0, policy_version 1545976 (0.0010) [2023-12-26 11:56:22,355][123091] Updated weights for policy 0, policy_version 1545986 (0.0010) [2023-12-26 11:56:22,425][123091] Updated weights for policy 0, policy_version 1545996 (0.0010) [2023-12-26 11:56:22,934][123090] Updated weights for policy 1, policy_version 1535910 (0.0009) [2023-12-26 11:56:22,999][123090] Updated weights for policy 1, policy_version 1535920 (0.0010) [2023-12-26 11:56:23,058][123090] Updated weights for policy 1, policy_version 1535930 (0.0009) [2023-12-26 11:56:23,234][123091] Updated weights for policy 0, policy_version 1546006 (0.0009) [2023-12-26 11:56:23,285][123091] Updated weights for policy 0, policy_version 1546016 (0.0009) [2023-12-26 11:56:23,347][123091] Updated weights for policy 0, policy_version 1546026 (0.0010) [2023-12-26 11:56:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17883.5). Total num frames: 788987904. Throughput: 0: 8703.3, 1: 8845.9. Samples: 788967572. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:23,785][121949] Avg episode reward: [(0, '6023.549'), (1, '5341.612')] [2023-12-26 11:56:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001546032_395788288.pth... [2023-12-26 11:56:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001535936_393199616.pth... [2023-12-26 11:56:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001534912_392937472.pth [2023-12-26 11:56:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001545008_395526144.pth [2023-12-26 11:56:23,920][123090] Updated weights for policy 1, policy_version 1535940 (0.0010) [2023-12-26 11:56:23,979][123090] Updated weights for policy 1, policy_version 1535950 (0.0010) [2023-12-26 11:56:24,031][123090] Updated weights for policy 1, policy_version 1535960 (0.0010) [2023-12-26 11:56:24,100][123091] Updated weights for policy 0, policy_version 1546036 (0.0008) [2023-12-26 11:56:24,156][123091] Updated weights for policy 0, policy_version 1546046 (0.0005) [2023-12-26 11:56:24,214][123091] Updated weights for policy 0, policy_version 1546056 (0.0005) [2023-12-26 11:56:24,823][123090] Updated weights for policy 1, policy_version 1535970 (0.0009) [2023-12-26 11:56:24,880][123090] Updated weights for policy 1, policy_version 1535980 (0.0010) [2023-12-26 11:56:24,892][123091] Updated weights for policy 0, policy_version 1546066 (0.0005) [2023-12-26 11:56:24,938][123090] Updated weights for policy 1, policy_version 1535990 (0.0009) [2023-12-26 11:56:24,948][123091] Updated weights for policy 0, policy_version 1546076 (0.0005) [2023-12-26 11:56:24,992][123090] Updated weights for policy 1, policy_version 1536000 (0.0008) [2023-12-26 11:56:25,012][123091] Updated weights for policy 0, policy_version 1546086 (0.0005) [2023-12-26 11:56:25,058][123091] Updated weights for policy 0, policy_version 1546096 (0.0005) [2023-12-26 11:56:25,686][123091] Updated weights for policy 0, policy_version 1546106 (0.0008) [2023-12-26 11:56:25,748][123091] Updated weights for policy 0, policy_version 1546116 (0.0009) [2023-12-26 11:56:25,812][123091] Updated weights for policy 0, policy_version 1546126 (0.0009) [2023-12-26 11:56:25,885][123090] Updated weights for policy 1, policy_version 1536010 (0.0009) [2023-12-26 11:56:25,937][123090] Updated weights for policy 1, policy_version 1536021 (0.0010) [2023-12-26 11:56:25,994][123090] Updated weights for policy 1, policy_version 1536031 (0.0008) [2023-12-26 11:56:26,640][123091] Updated weights for policy 0, policy_version 1546136 (0.0009) [2023-12-26 11:56:26,700][123091] Updated weights for policy 0, policy_version 1546146 (0.0009) [2023-12-26 11:56:26,768][123091] Updated weights for policy 0, policy_version 1546156 (0.0009) [2023-12-26 11:56:26,855][123090] Updated weights for policy 1, policy_version 1536041 (0.0010) [2023-12-26 11:56:26,912][123090] Updated weights for policy 1, policy_version 1536051 (0.0010) [2023-12-26 11:56:26,968][123090] Updated weights for policy 1, policy_version 1536061 (0.0010) [2023-12-26 11:56:27,529][123091] Updated weights for policy 0, policy_version 1546166 (0.0008) [2023-12-26 11:56:27,586][123091] Updated weights for policy 0, policy_version 1546176 (0.0009) [2023-12-26 11:56:27,635][123091] Updated weights for policy 0, policy_version 1546186 (0.0009) [2023-12-26 11:56:27,765][123090] Updated weights for policy 1, policy_version 1536071 (0.0007) [2023-12-26 11:56:27,834][123090] Updated weights for policy 1, policy_version 1536081 (0.0005) [2023-12-26 11:56:27,903][123090] Updated weights for policy 1, policy_version 1536091 (0.0005) [2023-12-26 11:56:28,505][123090] Updated weights for policy 1, policy_version 1536101 (0.0008) [2023-12-26 11:56:28,541][123091] Updated weights for policy 0, policy_version 1546196 (0.0008) [2023-12-26 11:56:28,564][123090] Updated weights for policy 1, policy_version 1536111 (0.0010) [2023-12-26 11:56:28,604][123091] Updated weights for policy 0, policy_version 1546206 (0.0006) [2023-12-26 11:56:28,623][123090] Updated weights for policy 1, policy_version 1536121 (0.0010) [2023-12-26 11:56:28,667][123091] Updated weights for policy 0, policy_version 1546216 (0.0006) [2023-12-26 11:56:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 789086208. Throughput: 0: 8826.4, 1: 8774.2. Samples: 789073508. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:28,784][121949] Avg episode reward: [(0, '5982.096'), (1, '5773.994')] [2023-12-26 11:56:29,465][123090] Updated weights for policy 1, policy_version 1536131 (0.0010) [2023-12-26 11:56:29,502][123091] Updated weights for policy 0, policy_version 1546226 (0.0008) [2023-12-26 11:56:29,517][123090] Updated weights for policy 1, policy_version 1536141 (0.0009) [2023-12-26 11:56:29,566][123091] Updated weights for policy 0, policy_version 1546236 (0.0011) [2023-12-26 11:56:29,568][123090] Updated weights for policy 1, policy_version 1536151 (0.0008) [2023-12-26 11:56:29,629][123091] Updated weights for policy 0, policy_version 1546246 (0.0010) [2023-12-26 11:56:29,699][123091] Updated weights for policy 0, policy_version 1546256 (0.0011) [2023-12-26 11:56:30,427][123091] Updated weights for policy 0, policy_version 1546266 (0.0005) [2023-12-26 11:56:30,474][123090] Updated weights for policy 1, policy_version 1536161 (0.0008) [2023-12-26 11:56:30,475][123091] Updated weights for policy 0, policy_version 1546276 (0.0005) [2023-12-26 11:56:30,523][123091] Updated weights for policy 0, policy_version 1546286 (0.0005) [2023-12-26 11:56:30,523][123090] Updated weights for policy 1, policy_version 1536171 (0.0009) [2023-12-26 11:56:30,581][123090] Updated weights for policy 1, policy_version 1536181 (0.0010) [2023-12-26 11:56:31,072][123091] Updated weights for policy 0, policy_version 1546296 (0.0009) [2023-12-26 11:56:31,140][123091] Updated weights for policy 0, policy_version 1546306 (0.0009) [2023-12-26 11:56:31,202][123091] Updated weights for policy 0, policy_version 1546316 (0.0009) [2023-12-26 11:56:31,501][123090] Updated weights for policy 1, policy_version 1536193 (0.0010) [2023-12-26 11:56:31,569][123090] Updated weights for policy 1, policy_version 1536203 (0.0010) [2023-12-26 11:56:31,624][123090] Updated weights for policy 1, policy_version 1536213 (0.0009) [2023-12-26 11:56:31,687][123090] Updated weights for policy 1, policy_version 1536223 (0.0009) [2023-12-26 11:56:32,006][123091] Updated weights for policy 0, policy_version 1546326 (0.0008) [2023-12-26 11:56:32,062][123091] Updated weights for policy 0, policy_version 1546336 (0.0006) [2023-12-26 11:56:32,132][123091] Updated weights for policy 0, policy_version 1546346 (0.0005) [2023-12-26 11:56:32,581][123090] Updated weights for policy 1, policy_version 1536233 (0.0010) [2023-12-26 11:56:32,639][123090] Updated weights for policy 1, policy_version 1536243 (0.0010) [2023-12-26 11:56:32,696][123090] Updated weights for policy 1, policy_version 1536253 (0.0009) [2023-12-26 11:56:32,831][123091] Updated weights for policy 0, policy_version 1546356 (0.0007) [2023-12-26 11:56:32,890][123091] Updated weights for policy 0, policy_version 1546366 (0.0009) [2023-12-26 11:56:32,952][123091] Updated weights for policy 0, policy_version 1546376 (0.0010) [2023-12-26 11:56:33,546][123090] Updated weights for policy 1, policy_version 1536263 (0.0009) [2023-12-26 11:56:33,601][123090] Updated weights for policy 1, policy_version 1536273 (0.0008) [2023-12-26 11:56:33,651][123090] Updated weights for policy 1, policy_version 1536283 (0.0008) [2023-12-26 11:56:33,755][123091] Updated weights for policy 0, policy_version 1546386 (0.0010) [2023-12-26 11:56:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 789168128. Throughput: 0: 8827.5, 1: 8732.3. Samples: 789178920. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:33,785][121949] Avg episode reward: [(0, '5991.223'), (1, '5963.038')] [2023-12-26 11:56:33,803][123091] Updated weights for policy 0, policy_version 1546396 (0.0009) [2023-12-26 11:56:33,857][123091] Updated weights for policy 0, policy_version 1546406 (0.0010) [2023-12-26 11:56:33,907][123091] Updated weights for policy 0, policy_version 1546416 (0.0009) [2023-12-26 11:56:34,447][123090] Updated weights for policy 1, policy_version 1536293 (0.0007) [2023-12-26 11:56:34,510][123090] Updated weights for policy 1, policy_version 1536303 (0.0006) [2023-12-26 11:56:34,573][123090] Updated weights for policy 1, policy_version 1536313 (0.0007) [2023-12-26 11:56:34,789][123091] Updated weights for policy 0, policy_version 1546427 (0.0010) [2023-12-26 11:56:34,851][123091] Updated weights for policy 0, policy_version 1546437 (0.0010) [2023-12-26 11:56:34,916][123091] Updated weights for policy 0, policy_version 1546447 (0.0010) [2023-12-26 11:56:35,245][123090] Updated weights for policy 1, policy_version 1536323 (0.0007) [2023-12-26 11:56:35,310][123090] Updated weights for policy 1, policy_version 1536333 (0.0008) [2023-12-26 11:56:35,369][123090] Updated weights for policy 1, policy_version 1536343 (0.0007) [2023-12-26 11:56:35,809][123091] Updated weights for policy 0, policy_version 1546457 (0.0009) [2023-12-26 11:56:35,865][123091] Updated weights for policy 0, policy_version 1546467 (0.0009) [2023-12-26 11:56:35,914][123091] Updated weights for policy 0, policy_version 1546477 (0.0009) [2023-12-26 11:56:36,046][123090] Updated weights for policy 1, policy_version 1536353 (0.0005) [2023-12-26 11:56:36,116][123090] Updated weights for policy 1, policy_version 1536363 (0.0007) [2023-12-26 11:56:36,169][123090] Updated weights for policy 1, policy_version 1536373 (0.0007) [2023-12-26 11:56:36,233][123090] Updated weights for policy 1, policy_version 1536384 (0.0008) [2023-12-26 11:56:36,818][123091] Updated weights for policy 0, policy_version 1546487 (0.0010) [2023-12-26 11:56:36,872][123091] Updated weights for policy 0, policy_version 1546497 (0.0008) [2023-12-26 11:56:36,934][123091] Updated weights for policy 0, policy_version 1546507 (0.0009) [2023-12-26 11:56:36,958][123090] Updated weights for policy 1, policy_version 1536394 (0.0007) [2023-12-26 11:56:37,018][123090] Updated weights for policy 1, policy_version 1536404 (0.0005) [2023-12-26 11:56:37,082][123090] Updated weights for policy 1, policy_version 1536414 (0.0007) [2023-12-26 11:56:37,815][123091] Updated weights for policy 0, policy_version 1546517 (0.0009) [2023-12-26 11:56:37,820][123090] Updated weights for policy 1, policy_version 1536424 (0.0008) [2023-12-26 11:56:37,868][123091] Updated weights for policy 0, policy_version 1546527 (0.0008) [2023-12-26 11:56:37,878][123090] Updated weights for policy 1, policy_version 1536434 (0.0008) [2023-12-26 11:56:37,922][123091] Updated weights for policy 0, policy_version 1546537 (0.0008) [2023-12-26 11:56:37,933][123090] Updated weights for policy 1, policy_version 1536444 (0.0008) [2023-12-26 11:56:38,778][123091] Updated weights for policy 0, policy_version 1546547 (0.0007) [2023-12-26 11:56:38,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17828.0). Total num frames: 789250048. Throughput: 0: 8791.9, 1: 8837.7. Samples: 789232848. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:38,785][121949] Avg episode reward: [(0, '6126.608'), (1, '5755.808')] [2023-12-26 11:56:38,794][123090] Updated weights for policy 1, policy_version 1536454 (0.0009) [2023-12-26 11:56:38,833][123091] Updated weights for policy 0, policy_version 1546557 (0.0005) [2023-12-26 11:56:38,845][123090] Updated weights for policy 1, policy_version 1536464 (0.0009) [2023-12-26 11:56:38,890][123091] Updated weights for policy 0, policy_version 1546567 (0.0005) [2023-12-26 11:56:38,902][123090] Updated weights for policy 1, policy_version 1536474 (0.0006) [2023-12-26 11:56:38,930][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001546576_395927552.pth... [2023-12-26 11:56:38,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001545520_395657216.pth [2023-12-26 11:56:38,935][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001536480_393338880.pth... [2023-12-26 11:56:38,938][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001535424_393068544.pth [2023-12-26 11:56:39,609][123091] Updated weights for policy 0, policy_version 1546577 (0.0005) [2023-12-26 11:56:39,686][123091] Updated weights for policy 0, policy_version 1546587 (0.0006) [2023-12-26 11:56:39,753][123091] Updated weights for policy 0, policy_version 1546597 (0.0007) [2023-12-26 11:56:39,802][123090] Updated weights for policy 1, policy_version 1536484 (0.0007) [2023-12-26 11:56:39,821][123091] Updated weights for policy 0, policy_version 1546607 (0.0009) [2023-12-26 11:56:39,870][123090] Updated weights for policy 1, policy_version 1536494 (0.0010) [2023-12-26 11:56:39,938][123090] Updated weights for policy 1, policy_version 1536504 (0.0010) [2023-12-26 11:56:40,616][123091] Updated weights for policy 0, policy_version 1546617 (0.0009) [2023-12-26 11:56:40,677][123091] Updated weights for policy 0, policy_version 1546627 (0.0010) [2023-12-26 11:56:40,729][123091] Updated weights for policy 0, policy_version 1546637 (0.0010) [2023-12-26 11:56:40,734][123090] Updated weights for policy 1, policy_version 1536514 (0.0010) [2023-12-26 11:56:40,802][123090] Updated weights for policy 1, policy_version 1536524 (0.0010) [2023-12-26 11:56:40,870][123090] Updated weights for policy 1, policy_version 1536534 (0.0010) [2023-12-26 11:56:40,950][123090] Updated weights for policy 1, policy_version 1536544 (0.0007) [2023-12-26 11:56:41,582][123091] Updated weights for policy 0, policy_version 1546647 (0.0010) [2023-12-26 11:56:41,660][123091] Updated weights for policy 0, policy_version 1546657 (0.0009) [2023-12-26 11:56:41,728][123091] Updated weights for policy 0, policy_version 1546667 (0.0009) [2023-12-26 11:56:41,735][123090] Updated weights for policy 1, policy_version 1536554 (0.0007) [2023-12-26 11:56:41,803][123090] Updated weights for policy 1, policy_version 1536564 (0.0011) [2023-12-26 11:56:41,870][123090] Updated weights for policy 1, policy_version 1536574 (0.0011) [2023-12-26 11:56:42,608][123091] Updated weights for policy 0, policy_version 1546677 (0.0008) [2023-12-26 11:56:42,665][123091] Updated weights for policy 0, policy_version 1546687 (0.0010) [2023-12-26 11:56:42,690][123090] Updated weights for policy 1, policy_version 1536584 (0.0009) [2023-12-26 11:56:42,735][123091] Updated weights for policy 0, policy_version 1546697 (0.0009) [2023-12-26 11:56:42,746][123090] Updated weights for policy 1, policy_version 1536594 (0.0010) [2023-12-26 11:56:42,796][123090] Updated weights for policy 1, policy_version 1536604 (0.0009) [2023-12-26 11:56:43,389][123091] Updated weights for policy 0, policy_version 1546707 (0.0007) [2023-12-26 11:56:43,444][123091] Updated weights for policy 0, policy_version 1546717 (0.0010) [2023-12-26 11:56:43,506][123091] Updated weights for policy 0, policy_version 1546727 (0.0009) [2023-12-26 11:56:43,668][123090] Updated weights for policy 1, policy_version 1536614 (0.0010) [2023-12-26 11:56:43,730][123090] Updated weights for policy 1, policy_version 1536624 (0.0010) [2023-12-26 11:56:43,781][123090] Updated weights for policy 1, policy_version 1536634 (0.0005) [2023-12-26 11:56:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 789340160. Throughput: 0: 8739.2, 1: 8826.0. Samples: 789336288. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:43,785][121949] Avg episode reward: [(0, '6095.812'), (1, '5875.372')] [2023-12-26 11:56:44,284][123091] Updated weights for policy 0, policy_version 1546737 (0.0009) [2023-12-26 11:56:44,357][123091] Updated weights for policy 0, policy_version 1546747 (0.0011) [2023-12-26 11:56:44,404][123091] Updated weights for policy 0, policy_version 1546757 (0.0005) [2023-12-26 11:56:44,450][123091] Updated weights for policy 0, policy_version 1546767 (0.0008) [2023-12-26 11:56:44,607][123090] Updated weights for policy 1, policy_version 1536644 (0.0010) [2023-12-26 11:56:44,665][123090] Updated weights for policy 1, policy_version 1536654 (0.0010) [2023-12-26 11:56:44,730][123090] Updated weights for policy 1, policy_version 1536664 (0.0010) [2023-12-26 11:56:45,207][123091] Updated weights for policy 0, policy_version 1546777 (0.0006) [2023-12-26 11:56:45,278][123091] Updated weights for policy 0, policy_version 1546787 (0.0007) [2023-12-26 11:56:45,339][123091] Updated weights for policy 0, policy_version 1546797 (0.0009) [2023-12-26 11:56:45,497][123090] Updated weights for policy 1, policy_version 1536674 (0.0010) [2023-12-26 11:56:45,556][123090] Updated weights for policy 1, policy_version 1536684 (0.0005) [2023-12-26 11:56:45,605][123090] Updated weights for policy 1, policy_version 1536694 (0.0006) [2023-12-26 11:56:45,656][123090] Updated weights for policy 1, policy_version 1536704 (0.0005) [2023-12-26 11:56:46,186][123091] Updated weights for policy 0, policy_version 1546807 (0.0010) [2023-12-26 11:56:46,239][123091] Updated weights for policy 0, policy_version 1546817 (0.0010) [2023-12-26 11:56:46,295][123091] Updated weights for policy 0, policy_version 1546827 (0.0009) [2023-12-26 11:56:46,336][123090] Updated weights for policy 1, policy_version 1536714 (0.0005) [2023-12-26 11:56:46,395][123090] Updated weights for policy 1, policy_version 1536724 (0.0005) [2023-12-26 11:56:46,454][123090] Updated weights for policy 1, policy_version 1536734 (0.0006) [2023-12-26 11:56:46,980][123091] Updated weights for policy 0, policy_version 1546837 (0.0009) [2023-12-26 11:56:47,037][123091] Updated weights for policy 0, policy_version 1546847 (0.0009) [2023-12-26 11:56:47,070][123090] Updated weights for policy 1, policy_version 1536744 (0.0007) [2023-12-26 11:56:47,099][123091] Updated weights for policy 0, policy_version 1546857 (0.0008) [2023-12-26 11:56:47,142][123090] Updated weights for policy 1, policy_version 1536754 (0.0006) [2023-12-26 11:56:47,208][123090] Updated weights for policy 1, policy_version 1536764 (0.0005) [2023-12-26 11:56:47,873][123090] Updated weights for policy 1, policy_version 1536774 (0.0005) [2023-12-26 11:56:47,890][123091] Updated weights for policy 0, policy_version 1546867 (0.0008) [2023-12-26 11:56:47,923][123090] Updated weights for policy 1, policy_version 1536784 (0.0006) [2023-12-26 11:56:47,942][123091] Updated weights for policy 0, policy_version 1546877 (0.0011) [2023-12-26 11:56:47,976][123090] Updated weights for policy 1, policy_version 1536794 (0.0005) [2023-12-26 11:56:48,009][123091] Updated weights for policy 0, policy_version 1546887 (0.0011) [2023-12-26 11:56:48,751][123091] Updated weights for policy 0, policy_version 1546897 (0.0010) [2023-12-26 11:56:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 789430272. Throughput: 0: 8804.0, 1: 8925.0. Samples: 789447376. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:48,784][121949] Avg episode reward: [(0, '6282.004'), (1, '6015.438')] [2023-12-26 11:56:48,812][123091] Updated weights for policy 0, policy_version 1546907 (0.0005) [2023-12-26 11:56:48,860][123090] Updated weights for policy 1, policy_version 1536804 (0.0009) [2023-12-26 11:56:48,885][123091] Updated weights for policy 0, policy_version 1546917 (0.0006) [2023-12-26 11:56:48,912][123090] Updated weights for policy 1, policy_version 1536814 (0.0010) [2023-12-26 11:56:48,948][123091] Updated weights for policy 0, policy_version 1546927 (0.0005) [2023-12-26 11:56:48,964][123090] Updated weights for policy 1, policy_version 1536824 (0.0010) [2023-12-26 11:56:49,601][123091] Updated weights for policy 0, policy_version 1546937 (0.0005) [2023-12-26 11:56:49,673][123091] Updated weights for policy 0, policy_version 1546947 (0.0005) [2023-12-26 11:56:49,738][123090] Updated weights for policy 1, policy_version 1536834 (0.0010) [2023-12-26 11:56:49,751][123091] Updated weights for policy 0, policy_version 1546957 (0.0006) [2023-12-26 11:56:49,791][123090] Updated weights for policy 1, policy_version 1536844 (0.0006) [2023-12-26 11:56:49,855][123090] Updated weights for policy 1, policy_version 1536854 (0.0008) [2023-12-26 11:56:49,923][123090] Updated weights for policy 1, policy_version 1536864 (0.0007) [2023-12-26 11:56:50,461][123091] Updated weights for policy 0, policy_version 1546967 (0.0008) [2023-12-26 11:56:50,517][123091] Updated weights for policy 0, policy_version 1546977 (0.0010) [2023-12-26 11:56:50,574][123091] Updated weights for policy 0, policy_version 1546987 (0.0010) [2023-12-26 11:56:50,707][123090] Updated weights for policy 1, policy_version 1536874 (0.0006) [2023-12-26 11:56:50,769][123090] Updated weights for policy 1, policy_version 1536884 (0.0006) [2023-12-26 11:56:50,823][123090] Updated weights for policy 1, policy_version 1536894 (0.0005) [2023-12-26 11:56:51,475][123090] Updated weights for policy 1, policy_version 1536904 (0.0008) [2023-12-26 11:56:51,510][123091] Updated weights for policy 0, policy_version 1546997 (0.0009) [2023-12-26 11:56:51,524][123090] Updated weights for policy 1, policy_version 1536914 (0.0008) [2023-12-26 11:56:51,558][123091] Updated weights for policy 0, policy_version 1547007 (0.0006) [2023-12-26 11:56:51,576][123090] Updated weights for policy 1, policy_version 1536924 (0.0008) [2023-12-26 11:56:51,624][123091] Updated weights for policy 0, policy_version 1547017 (0.0009) [2023-12-26 11:56:52,394][123090] Updated weights for policy 1, policy_version 1536934 (0.0008) [2023-12-26 11:56:52,462][123090] Updated weights for policy 1, policy_version 1536944 (0.0008) [2023-12-26 11:56:52,523][123091] Updated weights for policy 0, policy_version 1547027 (0.0009) [2023-12-26 11:56:52,526][123090] Updated weights for policy 1, policy_version 1536954 (0.0009) [2023-12-26 11:56:52,582][123091] Updated weights for policy 0, policy_version 1547037 (0.0010) [2023-12-26 11:56:52,637][123091] Updated weights for policy 0, policy_version 1547047 (0.0009) [2023-12-26 11:56:53,274][123090] Updated weights for policy 1, policy_version 1536964 (0.0007) [2023-12-26 11:56:53,342][123090] Updated weights for policy 1, policy_version 1536974 (0.0008) [2023-12-26 11:56:53,405][123090] Updated weights for policy 1, policy_version 1536984 (0.0009) [2023-12-26 11:56:53,535][123091] Updated weights for policy 0, policy_version 1547057 (0.0009) [2023-12-26 11:56:53,585][123091] Updated weights for policy 0, policy_version 1547067 (0.0006) [2023-12-26 11:56:53,631][123091] Updated weights for policy 0, policy_version 1547077 (0.0005) [2023-12-26 11:56:53,690][123091] Updated weights for policy 0, policy_version 1547087 (0.0005) [2023-12-26 11:56:53,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 789528576. Throughput: 0: 8845.4, 1: 8907.3. Samples: 789501304. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:53,785][121949] Avg episode reward: [(0, '6318.688'), (1, '5917.399')] [2023-12-26 11:56:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001547088_396058624.pth... [2023-12-26 11:56:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001536992_393469952.pth... [2023-12-26 11:56:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001535936_393199616.pth [2023-12-26 11:56:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001546032_395788288.pth [2023-12-26 11:56:54,225][123090] Updated weights for policy 1, policy_version 1536994 (0.0010) [2023-12-26 11:56:54,292][123090] Updated weights for policy 1, policy_version 1537004 (0.0007) [2023-12-26 11:56:54,347][123090] Updated weights for policy 1, policy_version 1537014 (0.0007) [2023-12-26 11:56:54,422][123090] Updated weights for policy 1, policy_version 1537024 (0.0005) [2023-12-26 11:56:54,518][123091] Updated weights for policy 0, policy_version 1547097 (0.0008) [2023-12-26 11:56:54,578][123091] Updated weights for policy 0, policy_version 1547107 (0.0006) [2023-12-26 11:56:54,640][123091] Updated weights for policy 0, policy_version 1547117 (0.0006) [2023-12-26 11:56:55,029][123090] Updated weights for policy 1, policy_version 1537034 (0.0005) [2023-12-26 11:56:55,091][123090] Updated weights for policy 1, policy_version 1537044 (0.0006) [2023-12-26 11:56:55,139][123090] Updated weights for policy 1, policy_version 1537054 (0.0008) [2023-12-26 11:56:55,336][123091] Updated weights for policy 0, policy_version 1547127 (0.0009) [2023-12-26 11:56:55,397][123091] Updated weights for policy 0, policy_version 1547137 (0.0010) [2023-12-26 11:56:55,448][123091] Updated weights for policy 0, policy_version 1547147 (0.0010) [2023-12-26 11:56:55,950][123090] Updated weights for policy 1, policy_version 1537064 (0.0010) [2023-12-26 11:56:56,008][123090] Updated weights for policy 1, policy_version 1537074 (0.0010) [2023-12-26 11:56:56,066][123090] Updated weights for policy 1, policy_version 1537084 (0.0009) [2023-12-26 11:56:56,197][123091] Updated weights for policy 0, policy_version 1547157 (0.0008) [2023-12-26 11:56:56,263][123091] Updated weights for policy 0, policy_version 1547167 (0.0005) [2023-12-26 11:56:56,329][123091] Updated weights for policy 0, policy_version 1547177 (0.0006) [2023-12-26 11:56:56,962][123090] Updated weights for policy 1, policy_version 1537094 (0.0009) [2023-12-26 11:56:57,024][123090] Updated weights for policy 1, policy_version 1537104 (0.0009) [2023-12-26 11:56:57,044][123091] Updated weights for policy 0, policy_version 1547187 (0.0009) [2023-12-26 11:56:57,086][123090] Updated weights for policy 1, policy_version 1537114 (0.0010) [2023-12-26 11:56:57,098][123091] Updated weights for policy 0, policy_version 1547197 (0.0006) [2023-12-26 11:56:57,156][123091] Updated weights for policy 0, policy_version 1547207 (0.0008) [2023-12-26 11:56:57,893][123090] Updated weights for policy 1, policy_version 1537124 (0.0008) [2023-12-26 11:56:57,942][123090] Updated weights for policy 1, policy_version 1537134 (0.0006) [2023-12-26 11:56:57,948][123091] Updated weights for policy 0, policy_version 1547217 (0.0009) [2023-12-26 11:56:57,989][123090] Updated weights for policy 1, policy_version 1537144 (0.0005) [2023-12-26 11:56:58,018][123091] Updated weights for policy 0, policy_version 1547227 (0.0007) [2023-12-26 11:56:58,089][123091] Updated weights for policy 0, policy_version 1547237 (0.0007) [2023-12-26 11:56:58,151][123091] Updated weights for policy 0, policy_version 1547247 (0.0008) [2023-12-26 11:56:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 789610496. Throughput: 0: 8930.6, 1: 8915.3. Samples: 789608980. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:56:58,785][121949] Avg episode reward: [(0, '6300.888'), (1, '5888.064')] [2023-12-26 11:56:58,813][123090] Updated weights for policy 1, policy_version 1537154 (0.0007) [2023-12-26 11:56:58,878][123090] Updated weights for policy 1, policy_version 1537164 (0.0010) [2023-12-26 11:56:58,938][123091] Updated weights for policy 0, policy_version 1547257 (0.0007) [2023-12-26 11:56:58,945][123090] Updated weights for policy 1, policy_version 1537174 (0.0008) [2023-12-26 11:56:58,998][123091] Updated weights for policy 0, policy_version 1547267 (0.0007) [2023-12-26 11:56:59,011][123090] Updated weights for policy 1, policy_version 1537184 (0.0008) [2023-12-26 11:56:59,065][123091] Updated weights for policy 0, policy_version 1547277 (0.0006) [2023-12-26 11:56:59,788][123090] Updated weights for policy 1, policy_version 1537194 (0.0005) [2023-12-26 11:56:59,866][123090] Updated weights for policy 1, policy_version 1537204 (0.0007) [2023-12-26 11:56:59,874][123091] Updated weights for policy 0, policy_version 1547287 (0.0006) [2023-12-26 11:56:59,939][123090] Updated weights for policy 1, policy_version 1537214 (0.0008) [2023-12-26 11:56:59,947][123091] Updated weights for policy 0, policy_version 1547297 (0.0007) [2023-12-26 11:56:59,997][123091] Updated weights for policy 0, policy_version 1547307 (0.0007) [2023-12-26 11:57:00,684][123090] Updated weights for policy 1, policy_version 1537224 (0.0009) [2023-12-26 11:57:00,733][123090] Updated weights for policy 1, policy_version 1537234 (0.0009) [2023-12-26 11:57:00,785][123090] Updated weights for policy 1, policy_version 1537244 (0.0009) [2023-12-26 11:57:00,792][123091] Updated weights for policy 0, policy_version 1547317 (0.0009) [2023-12-26 11:57:00,845][123091] Updated weights for policy 0, policy_version 1547327 (0.0009) [2023-12-26 11:57:00,904][123091] Updated weights for policy 0, policy_version 1547337 (0.0009) [2023-12-26 11:57:01,679][123090] Updated weights for policy 1, policy_version 1537254 (0.0009) [2023-12-26 11:57:01,749][123090] Updated weights for policy 1, policy_version 1537264 (0.0009) [2023-12-26 11:57:01,763][123091] Updated weights for policy 0, policy_version 1547347 (0.0009) [2023-12-26 11:57:01,809][123090] Updated weights for policy 1, policy_version 1537274 (0.0008) [2023-12-26 11:57:01,825][123091] Updated weights for policy 0, policy_version 1547357 (0.0009) [2023-12-26 11:57:01,889][123091] Updated weights for policy 0, policy_version 1547367 (0.0009) [2023-12-26 11:57:02,604][123091] Updated weights for policy 0, policy_version 1547377 (0.0009) [2023-12-26 11:57:02,640][123090] Updated weights for policy 1, policy_version 1537284 (0.0009) [2023-12-26 11:57:02,662][123091] Updated weights for policy 0, policy_version 1547387 (0.0007) [2023-12-26 11:57:02,700][123090] Updated weights for policy 1, policy_version 1537294 (0.0009) [2023-12-26 11:57:02,719][123091] Updated weights for policy 0, policy_version 1547397 (0.0006) [2023-12-26 11:57:02,767][123090] Updated weights for policy 1, policy_version 1537304 (0.0008) [2023-12-26 11:57:02,791][123091] Updated weights for policy 0, policy_version 1547407 (0.0005) [2023-12-26 11:57:03,457][123091] Updated weights for policy 0, policy_version 1547417 (0.0009) [2023-12-26 11:57:03,513][123091] Updated weights for policy 0, policy_version 1547427 (0.0010) [2023-12-26 11:57:03,559][123091] Updated weights for policy 0, policy_version 1547437 (0.0006) [2023-12-26 11:57:03,609][123090] Updated weights for policy 1, policy_version 1537314 (0.0009) [2023-12-26 11:57:03,670][123090] Updated weights for policy 1, policy_version 1537324 (0.0009) [2023-12-26 11:57:03,734][123090] Updated weights for policy 1, policy_version 1537334 (0.0009) [2023-12-26 11:57:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 789700608. Throughput: 0: 8890.6, 1: 8858.4. Samples: 789714472. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:03,784][121949] Avg episode reward: [(0, '6323.819'), (1, '5834.189')] [2023-12-26 11:57:03,788][123090] Updated weights for policy 1, policy_version 1537344 (0.0009) [2023-12-26 11:57:04,314][123091] Updated weights for policy 0, policy_version 1547447 (0.0008) [2023-12-26 11:57:04,386][123091] Updated weights for policy 0, policy_version 1547457 (0.0010) [2023-12-26 11:57:04,445][123091] Updated weights for policy 0, policy_version 1547467 (0.0009) [2023-12-26 11:57:04,665][123090] Updated weights for policy 1, policy_version 1537354 (0.0009) [2023-12-26 11:57:04,726][123090] Updated weights for policy 1, policy_version 1537364 (0.0010) [2023-12-26 11:57:04,787][123090] Updated weights for policy 1, policy_version 1537374 (0.0009) [2023-12-26 11:57:05,157][123091] Updated weights for policy 0, policy_version 1547477 (0.0009) [2023-12-26 11:57:05,217][123091] Updated weights for policy 0, policy_version 1547487 (0.0009) [2023-12-26 11:57:05,268][123091] Updated weights for policy 0, policy_version 1547497 (0.0009) [2023-12-26 11:57:05,617][123090] Updated weights for policy 1, policy_version 1537384 (0.0008) [2023-12-26 11:57:05,668][123090] Updated weights for policy 1, policy_version 1537394 (0.0009) [2023-12-26 11:57:05,732][123090] Updated weights for policy 1, policy_version 1537404 (0.0010) [2023-12-26 11:57:06,122][123091] Updated weights for policy 0, policy_version 1547507 (0.0009) [2023-12-26 11:57:06,177][123091] Updated weights for policy 0, policy_version 1547517 (0.0008) [2023-12-26 11:57:06,238][123091] Updated weights for policy 0, policy_version 1547527 (0.0008) [2023-12-26 11:57:06,505][123090] Updated weights for policy 1, policy_version 1537414 (0.0009) [2023-12-26 11:57:06,563][123090] Updated weights for policy 1, policy_version 1537424 (0.0009) [2023-12-26 11:57:06,626][123090] Updated weights for policy 1, policy_version 1537434 (0.0008) [2023-12-26 11:57:07,023][123091] Updated weights for policy 0, policy_version 1547537 (0.0009) [2023-12-26 11:57:07,094][123091] Updated weights for policy 0, policy_version 1547547 (0.0010) [2023-12-26 11:57:07,158][123091] Updated weights for policy 0, policy_version 1547557 (0.0010) [2023-12-26 11:57:07,211][123091] Updated weights for policy 0, policy_version 1547567 (0.0010) [2023-12-26 11:57:07,496][123090] Updated weights for policy 1, policy_version 1537444 (0.0010) [2023-12-26 11:57:07,571][123090] Updated weights for policy 1, policy_version 1537454 (0.0006) [2023-12-26 11:57:07,636][123090] Updated weights for policy 1, policy_version 1537464 (0.0006) [2023-12-26 11:57:08,042][123091] Updated weights for policy 0, policy_version 1547577 (0.0008) [2023-12-26 11:57:08,107][123091] Updated weights for policy 0, policy_version 1547587 (0.0009) [2023-12-26 11:57:08,171][123091] Updated weights for policy 0, policy_version 1547597 (0.0010) [2023-12-26 11:57:08,379][123090] Updated weights for policy 1, policy_version 1537474 (0.0006) [2023-12-26 11:57:08,436][123090] Updated weights for policy 1, policy_version 1537484 (0.0008) [2023-12-26 11:57:08,498][123090] Updated weights for policy 1, policy_version 1537494 (0.0007) [2023-12-26 11:57:08,569][123090] Updated weights for policy 1, policy_version 1537504 (0.0010) [2023-12-26 11:57:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 789790720. Throughput: 0: 8935.2, 1: 8821.6. Samples: 789766632. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:08,785][121949] Avg episode reward: [(0, '6187.815'), (1, '5946.631')] [2023-12-26 11:57:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001547600_396189696.pth... [2023-12-26 11:57:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001537504_393601024.pth... [2023-12-26 11:57:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001536480_393338880.pth [2023-12-26 11:57:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001546576_395927552.pth [2023-12-26 11:57:08,933][123091] Updated weights for policy 0, policy_version 1547607 (0.0006) [2023-12-26 11:57:08,992][123091] Updated weights for policy 0, policy_version 1547617 (0.0009) [2023-12-26 11:57:09,049][123091] Updated weights for policy 0, policy_version 1547627 (0.0006) [2023-12-26 11:57:09,478][123090] Updated weights for policy 1, policy_version 1537514 (0.0007) [2023-12-26 11:57:09,558][123090] Updated weights for policy 1, policy_version 1537524 (0.0007) [2023-12-26 11:57:09,640][123090] Updated weights for policy 1, policy_version 1537534 (0.0005) [2023-12-26 11:57:09,789][123091] Updated weights for policy 0, policy_version 1547637 (0.0008) [2023-12-26 11:57:09,858][123091] Updated weights for policy 0, policy_version 1547647 (0.0008) [2023-12-26 11:57:09,931][123091] Updated weights for policy 0, policy_version 1547657 (0.0007) [2023-12-26 11:57:10,370][123090] Updated weights for policy 1, policy_version 1537544 (0.0006) [2023-12-26 11:57:10,444][123090] Updated weights for policy 1, policy_version 1537554 (0.0005) [2023-12-26 11:57:10,519][123090] Updated weights for policy 1, policy_version 1537564 (0.0005) [2023-12-26 11:57:10,768][123091] Updated weights for policy 0, policy_version 1547667 (0.0008) [2023-12-26 11:57:10,822][123091] Updated weights for policy 0, policy_version 1547677 (0.0010) [2023-12-26 11:57:10,879][123091] Updated weights for policy 0, policy_version 1547687 (0.0007) [2023-12-26 11:57:11,241][123090] Updated weights for policy 1, policy_version 1537574 (0.0006) [2023-12-26 11:57:11,314][123090] Updated weights for policy 1, policy_version 1537584 (0.0008) [2023-12-26 11:57:11,390][123090] Updated weights for policy 1, policy_version 1537594 (0.0009) [2023-12-26 11:57:11,695][123091] Updated weights for policy 0, policy_version 1547697 (0.0006) [2023-12-26 11:57:11,773][123091] Updated weights for policy 0, policy_version 1547707 (0.0010) [2023-12-26 11:57:11,841][123091] Updated weights for policy 0, policy_version 1547717 (0.0009) [2023-12-26 11:57:11,915][123091] Updated weights for policy 0, policy_version 1547727 (0.0008) [2023-12-26 11:57:12,070][123090] Updated weights for policy 1, policy_version 1537604 (0.0007) [2023-12-26 11:57:12,137][123090] Updated weights for policy 1, policy_version 1537614 (0.0007) [2023-12-26 11:57:12,192][123090] Updated weights for policy 1, policy_version 1537624 (0.0007) [2023-12-26 11:57:12,765][123091] Updated weights for policy 0, policy_version 1547737 (0.0009) [2023-12-26 11:57:12,823][123091] Updated weights for policy 0, policy_version 1547747 (0.0009) [2023-12-26 11:57:12,879][123091] Updated weights for policy 0, policy_version 1547757 (0.0010) [2023-12-26 11:57:12,995][123090] Updated weights for policy 1, policy_version 1537634 (0.0009) [2023-12-26 11:57:13,044][123090] Updated weights for policy 1, policy_version 1537644 (0.0009) [2023-12-26 11:57:13,094][123090] Updated weights for policy 1, policy_version 1537654 (0.0009) [2023-12-26 11:57:13,701][123091] Updated weights for policy 0, policy_version 1547767 (0.0007) [2023-12-26 11:57:13,750][123091] Updated weights for policy 0, policy_version 1547777 (0.0005) [2023-12-26 11:57:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 789872640. Throughput: 0: 8892.1, 1: 8871.9. Samples: 789872888. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:13,784][121949] Avg episode reward: [(0, '6195.908'), (1, '5838.826')] [2023-12-26 11:57:13,798][123091] Updated weights for policy 0, policy_version 1547788 (0.0007) [2023-12-26 11:57:13,886][123090] Updated weights for policy 1, policy_version 1537665 (0.0009) [2023-12-26 11:57:13,936][123090] Updated weights for policy 1, policy_version 1537675 (0.0009) [2023-12-26 11:57:13,989][123090] Updated weights for policy 1, policy_version 1537685 (0.0010) [2023-12-26 11:57:14,046][123090] Updated weights for policy 1, policy_version 1537696 (0.0009) [2023-12-26 11:57:14,507][123091] Updated weights for policy 0, policy_version 1547798 (0.0007) [2023-12-26 11:57:14,572][123091] Updated weights for policy 0, policy_version 1547808 (0.0009) [2023-12-26 11:57:14,636][123091] Updated weights for policy 0, policy_version 1547818 (0.0010) [2023-12-26 11:57:14,908][123090] Updated weights for policy 1, policy_version 1537706 (0.0010) [2023-12-26 11:57:14,964][123090] Updated weights for policy 1, policy_version 1537716 (0.0009) [2023-12-26 11:57:15,027][123090] Updated weights for policy 1, policy_version 1537726 (0.0010) [2023-12-26 11:57:15,389][123091] Updated weights for policy 0, policy_version 1547828 (0.0009) [2023-12-26 11:57:15,458][123091] Updated weights for policy 0, policy_version 1547838 (0.0005) [2023-12-26 11:57:15,531][123091] Updated weights for policy 0, policy_version 1547848 (0.0005) [2023-12-26 11:57:15,959][123090] Updated weights for policy 1, policy_version 1537736 (0.0009) [2023-12-26 11:57:16,016][123090] Updated weights for policy 1, policy_version 1537746 (0.0009) [2023-12-26 11:57:16,036][123091] Updated weights for policy 0, policy_version 1547858 (0.0005) [2023-12-26 11:57:16,075][123090] Updated weights for policy 1, policy_version 1537756 (0.0009) [2023-12-26 11:57:16,099][123091] Updated weights for policy 0, policy_version 1547868 (0.0006) [2023-12-26 11:57:16,151][123091] Updated weights for policy 0, policy_version 1547878 (0.0007) [2023-12-26 11:57:16,196][123091] Updated weights for policy 0, policy_version 1547888 (0.0005) [2023-12-26 11:57:16,922][123091] Updated weights for policy 0, policy_version 1547898 (0.0010) [2023-12-26 11:57:16,955][123090] Updated weights for policy 1, policy_version 1537766 (0.0009) [2023-12-26 11:57:16,967][123091] Updated weights for policy 0, policy_version 1547908 (0.0008) [2023-12-26 11:57:17,016][123090] Updated weights for policy 1, policy_version 1537776 (0.0007) [2023-12-26 11:57:17,032][123091] Updated weights for policy 0, policy_version 1547918 (0.0010) [2023-12-26 11:57:17,072][123090] Updated weights for policy 1, policy_version 1537786 (0.0008) [2023-12-26 11:57:17,883][123091] Updated weights for policy 0, policy_version 1547928 (0.0009) [2023-12-26 11:57:17,902][123090] Updated weights for policy 1, policy_version 1537796 (0.0008) [2023-12-26 11:57:17,936][123091] Updated weights for policy 0, policy_version 1547938 (0.0007) [2023-12-26 11:57:17,964][123090] Updated weights for policy 1, policy_version 1537806 (0.0009) [2023-12-26 11:57:17,993][123091] Updated weights for policy 0, policy_version 1547948 (0.0009) [2023-12-26 11:57:18,034][123090] Updated weights for policy 1, policy_version 1537816 (0.0007) [2023-12-26 11:57:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 789962752. Throughput: 0: 8900.4, 1: 8863.6. Samples: 789978296. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:18,785][121949] Avg episode reward: [(0, '6145.409'), (1, '5771.297')] [2023-12-26 11:57:18,825][123091] Updated weights for policy 0, policy_version 1547958 (0.0009) [2023-12-26 11:57:18,875][123091] Updated weights for policy 0, policy_version 1547968 (0.0009) [2023-12-26 11:57:18,898][123090] Updated weights for policy 1, policy_version 1537826 (0.0008) [2023-12-26 11:57:18,930][123091] Updated weights for policy 0, policy_version 1547978 (0.0008) [2023-12-26 11:57:18,965][123090] Updated weights for policy 1, policy_version 1537836 (0.0010) [2023-12-26 11:57:19,034][123090] Updated weights for policy 1, policy_version 1537846 (0.0010) [2023-12-26 11:57:19,103][123090] Updated weights for policy 1, policy_version 1537856 (0.0009) [2023-12-26 11:57:19,748][123091] Updated weights for policy 0, policy_version 1547988 (0.0007) [2023-12-26 11:57:19,797][123091] Updated weights for policy 0, policy_version 1547998 (0.0009) [2023-12-26 11:57:19,859][123091] Updated weights for policy 0, policy_version 1548008 (0.0010) [2023-12-26 11:57:19,960][123090] Updated weights for policy 1, policy_version 1537866 (0.0007) [2023-12-26 11:57:20,025][123090] Updated weights for policy 1, policy_version 1537876 (0.0006) [2023-12-26 11:57:20,098][123090] Updated weights for policy 1, policy_version 1537886 (0.0008) [2023-12-26 11:57:20,726][123091] Updated weights for policy 0, policy_version 1548018 (0.0009) [2023-12-26 11:57:20,791][123091] Updated weights for policy 0, policy_version 1548028 (0.0010) [2023-12-26 11:57:20,852][123090] Updated weights for policy 1, policy_version 1537896 (0.0008) [2023-12-26 11:57:20,854][123091] Updated weights for policy 0, policy_version 1548038 (0.0009) [2023-12-26 11:57:20,913][123091] Updated weights for policy 0, policy_version 1548048 (0.0008) [2023-12-26 11:57:20,915][123090] Updated weights for policy 1, policy_version 1537906 (0.0008) [2023-12-26 11:57:20,973][123090] Updated weights for policy 1, policy_version 1537916 (0.0009) [2023-12-26 11:57:21,778][123091] Updated weights for policy 0, policy_version 1548058 (0.0009) [2023-12-26 11:57:21,835][123090] Updated weights for policy 1, policy_version 1537926 (0.0008) [2023-12-26 11:57:21,846][123091] Updated weights for policy 0, policy_version 1548068 (0.0009) [2023-12-26 11:57:21,894][123090] Updated weights for policy 1, policy_version 1537936 (0.0007) [2023-12-26 11:57:21,911][123091] Updated weights for policy 0, policy_version 1548078 (0.0009) [2023-12-26 11:57:21,961][123090] Updated weights for policy 1, policy_version 1537946 (0.0008) [2023-12-26 11:57:22,690][123091] Updated weights for policy 0, policy_version 1548088 (0.0010) [2023-12-26 11:57:22,746][123091] Updated weights for policy 0, policy_version 1548099 (0.0011) [2023-12-26 11:57:22,791][123090] Updated weights for policy 1, policy_version 1537956 (0.0008) [2023-12-26 11:57:22,811][123091] Updated weights for policy 0, policy_version 1548110 (0.0010) [2023-12-26 11:57:22,840][123090] Updated weights for policy 1, policy_version 1537966 (0.0007) [2023-12-26 11:57:22,894][123090] Updated weights for policy 1, policy_version 1537976 (0.0010) [2023-12-26 11:57:23,690][123091] Updated weights for policy 0, policy_version 1548120 (0.0008) [2023-12-26 11:57:23,757][123091] Updated weights for policy 0, policy_version 1548130 (0.0008) [2023-12-26 11:57:23,763][123090] Updated weights for policy 1, policy_version 1537986 (0.0009) [2023-12-26 11:57:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 790044672. Throughput: 0: 8940.4, 1: 8760.3. Samples: 790029376. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:23,785][121949] Avg episode reward: [(0, '6082.699'), (1, '5818.705')] [2023-12-26 11:57:23,830][123091] Updated weights for policy 0, policy_version 1548140 (0.0006) [2023-12-26 11:57:23,839][123090] Updated weights for policy 1, policy_version 1537996 (0.0010) [2023-12-26 11:57:23,848][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001548144_396328960.pth... [2023-12-26 11:57:23,851][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001547088_396058624.pth [2023-12-26 11:57:23,905][123090] Updated weights for policy 1, policy_version 1538006 (0.0009) [2023-12-26 11:57:23,975][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001538016_393732096.pth... [2023-12-26 11:57:23,976][123090] Updated weights for policy 1, policy_version 1538016 (0.0010) [2023-12-26 11:57:23,979][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001536992_393469952.pth [2023-12-26 11:57:24,532][123091] Updated weights for policy 0, policy_version 1548150 (0.0005) [2023-12-26 11:57:24,580][123091] Updated weights for policy 0, policy_version 1548160 (0.0006) [2023-12-26 11:57:24,630][123091] Updated weights for policy 0, policy_version 1548170 (0.0010) [2023-12-26 11:57:24,844][123090] Updated weights for policy 1, policy_version 1538026 (0.0008) [2023-12-26 11:57:24,902][123090] Updated weights for policy 1, policy_version 1538036 (0.0009) [2023-12-26 11:57:24,960][123090] Updated weights for policy 1, policy_version 1538046 (0.0009) [2023-12-26 11:57:25,478][123091] Updated weights for policy 0, policy_version 1548180 (0.0009) [2023-12-26 11:57:25,527][123091] Updated weights for policy 0, policy_version 1548190 (0.0009) [2023-12-26 11:57:25,580][123091] Updated weights for policy 0, policy_version 1548200 (0.0008) [2023-12-26 11:57:25,811][123090] Updated weights for policy 1, policy_version 1538056 (0.0009) [2023-12-26 11:57:25,864][123090] Updated weights for policy 1, policy_version 1538066 (0.0010) [2023-12-26 11:57:25,921][123090] Updated weights for policy 1, policy_version 1538076 (0.0009) [2023-12-26 11:57:26,259][123091] Updated weights for policy 0, policy_version 1548210 (0.0006) [2023-12-26 11:57:26,312][123091] Updated weights for policy 0, policy_version 1548220 (0.0009) [2023-12-26 11:57:26,368][123091] Updated weights for policy 0, policy_version 1548230 (0.0009) [2023-12-26 11:57:26,429][123091] Updated weights for policy 0, policy_version 1548240 (0.0009) [2023-12-26 11:57:26,818][123090] Updated weights for policy 1, policy_version 1538086 (0.0010) [2023-12-26 11:57:26,870][123090] Updated weights for policy 1, policy_version 1538096 (0.0009) [2023-12-26 11:57:26,924][123090] Updated weights for policy 1, policy_version 1538106 (0.0010) [2023-12-26 11:57:27,199][123091] Updated weights for policy 0, policy_version 1548250 (0.0005) [2023-12-26 11:57:27,253][123091] Updated weights for policy 0, policy_version 1548260 (0.0007) [2023-12-26 11:57:27,318][123091] Updated weights for policy 0, policy_version 1548270 (0.0007) [2023-12-26 11:57:27,829][123090] Updated weights for policy 1, policy_version 1538116 (0.0009) [2023-12-26 11:57:27,886][123090] Updated weights for policy 1, policy_version 1538126 (0.0009) [2023-12-26 11:57:27,941][123091] Updated weights for policy 0, policy_version 1548280 (0.0005) [2023-12-26 11:57:27,944][123090] Updated weights for policy 1, policy_version 1538137 (0.0009) [2023-12-26 11:57:27,994][123091] Updated weights for policy 0, policy_version 1548290 (0.0005) [2023-12-26 11:57:28,043][123091] Updated weights for policy 0, policy_version 1548300 (0.0005) [2023-12-26 11:57:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 790134784. Throughput: 0: 9004.4, 1: 8707.8. Samples: 790133336. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:28,784][121949] Avg episode reward: [(0, '6275.576'), (1, '5898.773')] [2023-12-26 11:57:28,810][123091] Updated weights for policy 0, policy_version 1548310 (0.0008) [2023-12-26 11:57:28,814][123090] Updated weights for policy 1, policy_version 1538147 (0.0008) [2023-12-26 11:57:28,883][123090] Updated weights for policy 1, policy_version 1538157 (0.0008) [2023-12-26 11:57:28,883][123091] Updated weights for policy 0, policy_version 1548320 (0.0007) [2023-12-26 11:57:28,937][123091] Updated weights for policy 0, policy_version 1548330 (0.0008) [2023-12-26 11:57:28,950][123090] Updated weights for policy 1, policy_version 1538167 (0.0008) [2023-12-26 11:57:29,720][123091] Updated weights for policy 0, policy_version 1548340 (0.0006) [2023-12-26 11:57:29,793][123090] Updated weights for policy 1, policy_version 1538177 (0.0008) [2023-12-26 11:57:29,793][123091] Updated weights for policy 0, policy_version 1548350 (0.0010) [2023-12-26 11:57:29,856][123090] Updated weights for policy 1, policy_version 1538187 (0.0007) [2023-12-26 11:57:29,865][123091] Updated weights for policy 0, policy_version 1548360 (0.0010) [2023-12-26 11:57:29,921][123090] Updated weights for policy 1, policy_version 1538197 (0.0009) [2023-12-26 11:57:29,992][123090] Updated weights for policy 1, policy_version 1538207 (0.0006) [2023-12-26 11:57:30,628][123091] Updated weights for policy 0, policy_version 1548370 (0.0009) [2023-12-26 11:57:30,696][123091] Updated weights for policy 0, policy_version 1548380 (0.0007) [2023-12-26 11:57:30,746][123090] Updated weights for policy 1, policy_version 1538217 (0.0005) [2023-12-26 11:57:30,755][123091] Updated weights for policy 0, policy_version 1548390 (0.0006) [2023-12-26 11:57:30,799][123090] Updated weights for policy 1, policy_version 1538227 (0.0008) [2023-12-26 11:57:30,818][123091] Updated weights for policy 0, policy_version 1548400 (0.0009) [2023-12-26 11:57:30,859][123090] Updated weights for policy 1, policy_version 1538237 (0.0009) [2023-12-26 11:57:31,589][123091] Updated weights for policy 0, policy_version 1548410 (0.0005) [2023-12-26 11:57:31,663][123091] Updated weights for policy 0, policy_version 1548420 (0.0007) [2023-12-26 11:57:31,734][123091] Updated weights for policy 0, policy_version 1548430 (0.0008) [2023-12-26 11:57:31,791][123090] Updated weights for policy 1, policy_version 1538247 (0.0009) [2023-12-26 11:57:31,844][123090] Updated weights for policy 1, policy_version 1538257 (0.0009) [2023-12-26 11:57:31,897][123090] Updated weights for policy 1, policy_version 1538267 (0.0008) [2023-12-26 11:57:32,457][123091] Updated weights for policy 0, policy_version 1548440 (0.0010) [2023-12-26 11:57:32,506][123091] Updated weights for policy 0, policy_version 1548450 (0.0008) [2023-12-26 11:57:32,572][123091] Updated weights for policy 0, policy_version 1548460 (0.0008) [2023-12-26 11:57:32,753][123090] Updated weights for policy 1, policy_version 1538277 (0.0010) [2023-12-26 11:57:32,811][123090] Updated weights for policy 1, policy_version 1538287 (0.0010) [2023-12-26 11:57:32,867][123090] Updated weights for policy 1, policy_version 1538297 (0.0005) [2023-12-26 11:57:33,328][123091] Updated weights for policy 0, policy_version 1548470 (0.0009) [2023-12-26 11:57:33,383][123091] Updated weights for policy 0, policy_version 1548480 (0.0005) [2023-12-26 11:57:33,445][123091] Updated weights for policy 0, policy_version 1548490 (0.0005) [2023-12-26 11:57:33,543][123090] Updated weights for policy 1, policy_version 1538307 (0.0006) [2023-12-26 11:57:33,603][123090] Updated weights for policy 1, policy_version 1538317 (0.0005) [2023-12-26 11:57:33,659][123090] Updated weights for policy 1, policy_version 1538327 (0.0007) [2023-12-26 11:57:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 790233088. Throughput: 0: 9018.1, 1: 8625.8. Samples: 790241352. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:33,785][121949] Avg episode reward: [(0, '6151.080'), (1, '5926.607')] [2023-12-26 11:57:34,202][123091] Updated weights for policy 0, policy_version 1548500 (0.0006) [2023-12-26 11:57:34,258][123091] Updated weights for policy 0, policy_version 1548510 (0.0008) [2023-12-26 11:57:34,310][123091] Updated weights for policy 0, policy_version 1548520 (0.0008) [2023-12-26 11:57:34,320][123090] Updated weights for policy 1, policy_version 1538337 (0.0010) [2023-12-26 11:57:34,380][123090] Updated weights for policy 1, policy_version 1538347 (0.0010) [2023-12-26 11:57:34,432][123090] Updated weights for policy 1, policy_version 1538357 (0.0010) [2023-12-26 11:57:34,487][123090] Updated weights for policy 1, policy_version 1538367 (0.0010) [2023-12-26 11:57:35,075][123091] Updated weights for policy 0, policy_version 1548530 (0.0007) [2023-12-26 11:57:35,144][123091] Updated weights for policy 0, policy_version 1548540 (0.0005) [2023-12-26 11:57:35,213][123091] Updated weights for policy 0, policy_version 1548550 (0.0005) [2023-12-26 11:57:35,285][123091] Updated weights for policy 0, policy_version 1548560 (0.0005) [2023-12-26 11:57:35,324][123090] Updated weights for policy 1, policy_version 1538377 (0.0010) [2023-12-26 11:57:35,383][123090] Updated weights for policy 1, policy_version 1538387 (0.0010) [2023-12-26 11:57:35,438][123090] Updated weights for policy 1, policy_version 1538397 (0.0010) [2023-12-26 11:57:35,870][123091] Updated weights for policy 0, policy_version 1548570 (0.0005) [2023-12-26 11:57:35,933][123091] Updated weights for policy 0, policy_version 1548580 (0.0005) [2023-12-26 11:57:36,011][123091] Updated weights for policy 0, policy_version 1548590 (0.0006) [2023-12-26 11:57:36,191][123090] Updated weights for policy 1, policy_version 1538407 (0.0007) [2023-12-26 11:57:36,258][123090] Updated weights for policy 1, policy_version 1538417 (0.0010) [2023-12-26 11:57:36,322][123090] Updated weights for policy 1, policy_version 1538427 (0.0010) [2023-12-26 11:57:36,683][123091] Updated weights for policy 0, policy_version 1548600 (0.0010) [2023-12-26 11:57:36,746][123091] Updated weights for policy 0, policy_version 1548610 (0.0010) [2023-12-26 11:57:36,797][123091] Updated weights for policy 0, policy_version 1548620 (0.0005) [2023-12-26 11:57:37,147][123090] Updated weights for policy 1, policy_version 1538437 (0.0010) [2023-12-26 11:57:37,210][123090] Updated weights for policy 1, policy_version 1538447 (0.0010) [2023-12-26 11:57:37,273][123090] Updated weights for policy 1, policy_version 1538457 (0.0010) [2023-12-26 11:57:37,593][123091] Updated weights for policy 0, policy_version 1548630 (0.0008) [2023-12-26 11:57:37,650][123091] Updated weights for policy 0, policy_version 1548640 (0.0011) [2023-12-26 11:57:37,702][123091] Updated weights for policy 0, policy_version 1548650 (0.0010) [2023-12-26 11:57:37,973][123090] Updated weights for policy 1, policy_version 1538467 (0.0009) [2023-12-26 11:57:38,030][123090] Updated weights for policy 1, policy_version 1538477 (0.0006) [2023-12-26 11:57:38,093][123090] Updated weights for policy 1, policy_version 1538487 (0.0006) [2023-12-26 11:57:38,415][123091] Updated weights for policy 0, policy_version 1548660 (0.0009) [2023-12-26 11:57:38,484][123091] Updated weights for policy 0, policy_version 1548670 (0.0006) [2023-12-26 11:57:38,547][123091] Updated weights for policy 0, policy_version 1548680 (0.0006) [2023-12-26 11:57:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 790323200. Throughput: 0: 9091.7, 1: 8620.0. Samples: 790298328. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:38,785][121949] Avg episode reward: [(0, '6129.866'), (1, '5819.085')] [2023-12-26 11:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001548688_396468224.pth... [2023-12-26 11:57:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001538496_393854976.pth... [2023-12-26 11:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001547600_396189696.pth [2023-12-26 11:57:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001537504_393601024.pth [2023-12-26 11:57:38,911][123090] Updated weights for policy 1, policy_version 1538497 (0.0006) [2023-12-26 11:57:38,960][123090] Updated weights for policy 1, policy_version 1538507 (0.0009) [2023-12-26 11:57:39,020][123090] Updated weights for policy 1, policy_version 1538517 (0.0010) [2023-12-26 11:57:39,075][123090] Updated weights for policy 1, policy_version 1538527 (0.0009) [2023-12-26 11:57:39,228][123091] Updated weights for policy 0, policy_version 1548690 (0.0005) [2023-12-26 11:57:39,295][123091] Updated weights for policy 0, policy_version 1548700 (0.0010) [2023-12-26 11:57:39,365][123091] Updated weights for policy 0, policy_version 1548710 (0.0009) [2023-12-26 11:57:39,438][123091] Updated weights for policy 0, policy_version 1548720 (0.0010) [2023-12-26 11:57:39,955][123090] Updated weights for policy 1, policy_version 1538537 (0.0009) [2023-12-26 11:57:40,023][123090] Updated weights for policy 1, policy_version 1538547 (0.0008) [2023-12-26 11:57:40,081][123090] Updated weights for policy 1, policy_version 1538557 (0.0009) [2023-12-26 11:57:40,263][123091] Updated weights for policy 0, policy_version 1548730 (0.0010) [2023-12-26 11:57:40,314][123091] Updated weights for policy 0, policy_version 1548740 (0.0010) [2023-12-26 11:57:40,363][123091] Updated weights for policy 0, policy_version 1548750 (0.0009) [2023-12-26 11:57:40,938][123090] Updated weights for policy 1, policy_version 1538567 (0.0010) [2023-12-26 11:57:40,993][123090] Updated weights for policy 1, policy_version 1538578 (0.0011) [2023-12-26 11:57:41,054][123090] Updated weights for policy 1, policy_version 1538589 (0.0009) [2023-12-26 11:57:41,151][123091] Updated weights for policy 0, policy_version 1548760 (0.0007) [2023-12-26 11:57:41,222][123091] Updated weights for policy 0, policy_version 1548770 (0.0009) [2023-12-26 11:57:41,288][123091] Updated weights for policy 0, policy_version 1548780 (0.0008) [2023-12-26 11:57:41,925][123090] Updated weights for policy 1, policy_version 1538599 (0.0006) [2023-12-26 11:57:42,006][123090] Updated weights for policy 1, policy_version 1538609 (0.0005) [2023-12-26 11:57:42,080][123090] Updated weights for policy 1, policy_version 1538619 (0.0005) [2023-12-26 11:57:42,131][123091] Updated weights for policy 0, policy_version 1548790 (0.0009) [2023-12-26 11:57:42,194][123091] Updated weights for policy 0, policy_version 1548800 (0.0008) [2023-12-26 11:57:42,253][123091] Updated weights for policy 0, policy_version 1548810 (0.0010) [2023-12-26 11:57:42,770][123090] Updated weights for policy 1, policy_version 1538629 (0.0009) [2023-12-26 11:57:42,826][123090] Updated weights for policy 1, policy_version 1538639 (0.0010) [2023-12-26 11:57:42,881][123090] Updated weights for policy 1, policy_version 1538649 (0.0010) [2023-12-26 11:57:43,084][123091] Updated weights for policy 0, policy_version 1548820 (0.0007) [2023-12-26 11:57:43,133][123091] Updated weights for policy 0, policy_version 1548830 (0.0006) [2023-12-26 11:57:43,185][123091] Updated weights for policy 0, policy_version 1548840 (0.0009) [2023-12-26 11:57:43,724][123090] Updated weights for policy 1, policy_version 1538659 (0.0010) [2023-12-26 11:57:43,783][123090] Updated weights for policy 1, policy_version 1538669 (0.0010) [2023-12-26 11:57:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 790405120. Throughput: 0: 9076.1, 1: 8586.3. Samples: 790403788. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:43,785][121949] Avg episode reward: [(0, '6330.565'), (1, '5706.207')] [2023-12-26 11:57:43,831][123090] Updated weights for policy 1, policy_version 1538679 (0.0010) [2023-12-26 11:57:44,010][123091] Updated weights for policy 0, policy_version 1548850 (0.0009) [2023-12-26 11:57:44,070][123091] Updated weights for policy 0, policy_version 1548860 (0.0008) [2023-12-26 11:57:44,122][123091] Updated weights for policy 0, policy_version 1548870 (0.0009) [2023-12-26 11:57:44,174][123091] Updated weights for policy 0, policy_version 1548880 (0.0009) [2023-12-26 11:57:44,669][123090] Updated weights for policy 1, policy_version 1538689 (0.0010) [2023-12-26 11:57:44,722][123090] Updated weights for policy 1, policy_version 1538699 (0.0010) [2023-12-26 11:57:44,794][123090] Updated weights for policy 1, policy_version 1538709 (0.0011) [2023-12-26 11:57:44,862][123090] Updated weights for policy 1, policy_version 1538719 (0.0011) [2023-12-26 11:57:44,987][123091] Updated weights for policy 0, policy_version 1548890 (0.0006) [2023-12-26 11:57:45,048][123091] Updated weights for policy 0, policy_version 1548900 (0.0009) [2023-12-26 11:57:45,108][123091] Updated weights for policy 0, policy_version 1548910 (0.0008) [2023-12-26 11:57:45,707][123090] Updated weights for policy 1, policy_version 1538729 (0.0010) [2023-12-26 11:57:45,770][123090] Updated weights for policy 1, policy_version 1538739 (0.0011) [2023-12-26 11:57:45,818][123090] Updated weights for policy 1, policy_version 1538749 (0.0010) [2023-12-26 11:57:45,907][123091] Updated weights for policy 0, policy_version 1548920 (0.0009) [2023-12-26 11:57:45,960][123091] Updated weights for policy 0, policy_version 1548930 (0.0005) [2023-12-26 11:57:46,027][123091] Updated weights for policy 0, policy_version 1548940 (0.0006) [2023-12-26 11:57:46,592][123090] Updated weights for policy 1, policy_version 1538759 (0.0010) [2023-12-26 11:57:46,649][123090] Updated weights for policy 1, policy_version 1538769 (0.0009) [2023-12-26 11:57:46,719][123090] Updated weights for policy 1, policy_version 1538779 (0.0010) [2023-12-26 11:57:46,751][123091] Updated weights for policy 0, policy_version 1548950 (0.0007) [2023-12-26 11:57:46,810][123091] Updated weights for policy 0, policy_version 1548960 (0.0008) [2023-12-26 11:57:46,864][123091] Updated weights for policy 0, policy_version 1548970 (0.0006) [2023-12-26 11:57:47,582][123090] Updated weights for policy 1, policy_version 1538789 (0.0008) [2023-12-26 11:57:47,606][123091] Updated weights for policy 0, policy_version 1548980 (0.0006) [2023-12-26 11:57:47,641][123090] Updated weights for policy 1, policy_version 1538799 (0.0008) [2023-12-26 11:57:47,657][123091] Updated weights for policy 0, policy_version 1548990 (0.0009) [2023-12-26 11:57:47,702][123090] Updated weights for policy 1, policy_version 1538809 (0.0009) [2023-12-26 11:57:47,717][123091] Updated weights for policy 0, policy_version 1549000 (0.0007) [2023-12-26 11:57:48,373][123090] Updated weights for policy 1, policy_version 1538819 (0.0007) [2023-12-26 11:57:48,439][123090] Updated weights for policy 1, policy_version 1538829 (0.0005) [2023-12-26 11:57:48,511][123090] Updated weights for policy 1, policy_version 1538839 (0.0005) [2023-12-26 11:57:48,535][123091] Updated weights for policy 0, policy_version 1549010 (0.0008) [2023-12-26 11:57:48,604][123091] Updated weights for policy 0, policy_version 1549020 (0.0011) [2023-12-26 11:57:48,667][123091] Updated weights for policy 0, policy_version 1549030 (0.0011) [2023-12-26 11:57:48,760][123091] Updated weights for policy 0, policy_version 1549040 (0.0011) [2023-12-26 11:57:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 790503424. Throughput: 0: 9098.4, 1: 8598.3. Samples: 790510824. Policy #0 lag: (min: 25.0, avg: 38.4, max: 57.0) [2023-12-26 11:57:48,784][121949] Avg episode reward: [(0, '6386.178'), (1, '5826.292')] [2023-12-26 11:57:49,299][123090] Updated weights for policy 1, policy_version 1538849 (0.0006) [2023-12-26 11:57:49,389][123090] Updated weights for policy 1, policy_version 1538859 (0.0010) [2023-12-26 11:57:49,443][123090] Updated weights for policy 1, policy_version 1538869 (0.0009) [2023-12-26 11:57:49,491][123090] Updated weights for policy 1, policy_version 1538879 (0.0009) [2023-12-26 11:57:49,548][123091] Updated weights for policy 0, policy_version 1549050 (0.0008) [2023-12-26 11:57:49,598][123091] Updated weights for policy 0, policy_version 1549060 (0.0009) [2023-12-26 11:57:49,651][123091] Updated weights for policy 0, policy_version 1549070 (0.0007) [2023-12-26 11:57:50,329][123090] Updated weights for policy 1, policy_version 1538889 (0.0009) [2023-12-26 11:57:50,394][123090] Updated weights for policy 1, policy_version 1538899 (0.0009) [2023-12-26 11:57:50,459][123090] Updated weights for policy 1, policy_version 1538909 (0.0009) [2023-12-26 11:57:50,507][123091] Updated weights for policy 0, policy_version 1549080 (0.0010) [2023-12-26 11:57:50,563][123091] Updated weights for policy 0, policy_version 1549090 (0.0011) [2023-12-26 11:57:50,624][123091] Updated weights for policy 0, policy_version 1549100 (0.0011) [2023-12-26 11:57:51,275][123090] Updated weights for policy 1, policy_version 1538919 (0.0007) [2023-12-26 11:57:51,340][123090] Updated weights for policy 1, policy_version 1538929 (0.0009) [2023-12-26 11:57:51,410][123090] Updated weights for policy 1, policy_version 1538939 (0.0009) [2023-12-26 11:57:51,493][123091] Updated weights for policy 0, policy_version 1549110 (0.0010) [2023-12-26 11:57:51,560][123091] Updated weights for policy 0, policy_version 1549120 (0.0009) [2023-12-26 11:57:51,625][123091] Updated weights for policy 0, policy_version 1549130 (0.0009) [2023-12-26 11:57:52,215][123090] Updated weights for policy 1, policy_version 1538949 (0.0010) [2023-12-26 11:57:52,280][123090] Updated weights for policy 1, policy_version 1538959 (0.0010) [2023-12-26 11:57:52,350][123090] Updated weights for policy 1, policy_version 1538969 (0.0010) [2023-12-26 11:57:52,398][123091] Updated weights for policy 0, policy_version 1549140 (0.0007) [2023-12-26 11:57:52,467][123091] Updated weights for policy 0, policy_version 1549150 (0.0007) [2023-12-26 11:57:52,532][123091] Updated weights for policy 0, policy_version 1549160 (0.0008) [2023-12-26 11:57:53,182][123090] Updated weights for policy 1, policy_version 1538979 (0.0010) [2023-12-26 11:57:53,236][123091] Updated weights for policy 0, policy_version 1549170 (0.0006) [2023-12-26 11:57:53,237][123090] Updated weights for policy 1, policy_version 1538989 (0.0009) [2023-12-26 11:57:53,290][123090] Updated weights for policy 1, policy_version 1538999 (0.0009) [2023-12-26 11:57:53,294][123091] Updated weights for policy 0, policy_version 1549180 (0.0008) [2023-12-26 11:57:53,347][123091] Updated weights for policy 0, policy_version 1549190 (0.0008) [2023-12-26 11:57:53,417][123091] Updated weights for policy 0, policy_version 1549200 (0.0007) [2023-12-26 11:57:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 790585344. Throughput: 0: 9055.7, 1: 8613.1. Samples: 790561724. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:57:53,785][121949] Avg episode reward: [(0, '6227.251'), (1, '5586.870')] [2023-12-26 11:57:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001539008_393986048.pth... [2023-12-26 11:57:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001549200_396599296.pth... [2023-12-26 11:57:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001538016_393732096.pth [2023-12-26 11:57:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001548144_396328960.pth [2023-12-26 11:57:54,116][123091] Updated weights for policy 0, policy_version 1549210 (0.0005) [2023-12-26 11:57:54,130][123090] Updated weights for policy 1, policy_version 1539009 (0.0009) [2023-12-26 11:57:54,168][123091] Updated weights for policy 0, policy_version 1549220 (0.0005) [2023-12-26 11:57:54,188][123090] Updated weights for policy 1, policy_version 1539019 (0.0010) [2023-12-26 11:57:54,217][123091] Updated weights for policy 0, policy_version 1549230 (0.0005) [2023-12-26 11:57:54,245][123090] Updated weights for policy 1, policy_version 1539029 (0.0009) [2023-12-26 11:57:54,316][123090] Updated weights for policy 1, policy_version 1539039 (0.0010) [2023-12-26 11:57:54,980][123091] Updated weights for policy 0, policy_version 1549240 (0.0008) [2023-12-26 11:57:55,057][123091] Updated weights for policy 0, policy_version 1549250 (0.0005) [2023-12-26 11:57:55,112][123091] Updated weights for policy 0, policy_version 1549260 (0.0005) [2023-12-26 11:57:55,164][123090] Updated weights for policy 1, policy_version 1539049 (0.0010) [2023-12-26 11:57:55,222][123090] Updated weights for policy 1, policy_version 1539059 (0.0010) [2023-12-26 11:57:55,289][123090] Updated weights for policy 1, policy_version 1539069 (0.0009) [2023-12-26 11:57:55,768][123091] Updated weights for policy 0, policy_version 1549270 (0.0008) [2023-12-26 11:57:55,830][123091] Updated weights for policy 0, policy_version 1549280 (0.0009) [2023-12-26 11:57:55,883][123091] Updated weights for policy 0, policy_version 1549290 (0.0009) [2023-12-26 11:57:56,117][123090] Updated weights for policy 1, policy_version 1539079 (0.0010) [2023-12-26 11:57:56,171][123090] Updated weights for policy 1, policy_version 1539090 (0.0010) [2023-12-26 11:57:56,226][123090] Updated weights for policy 1, policy_version 1539100 (0.0010) [2023-12-26 11:57:56,608][123091] Updated weights for policy 0, policy_version 1549300 (0.0008) [2023-12-26 11:57:56,668][123091] Updated weights for policy 0, policy_version 1549310 (0.0010) [2023-12-26 11:57:56,727][123091] Updated weights for policy 0, policy_version 1549320 (0.0009) [2023-12-26 11:57:57,108][123090] Updated weights for policy 1, policy_version 1539110 (0.0009) [2023-12-26 11:57:57,163][123090] Updated weights for policy 1, policy_version 1539120 (0.0009) [2023-12-26 11:57:57,221][123090] Updated weights for policy 1, policy_version 1539130 (0.0009) [2023-12-26 11:57:57,510][123091] Updated weights for policy 0, policy_version 1549330 (0.0007) [2023-12-26 11:57:57,562][123091] Updated weights for policy 0, policy_version 1549340 (0.0006) [2023-12-26 11:57:57,612][123091] Updated weights for policy 0, policy_version 1549350 (0.0009) [2023-12-26 11:57:57,662][123091] Updated weights for policy 0, policy_version 1549360 (0.0008) [2023-12-26 11:57:58,063][123090] Updated weights for policy 1, policy_version 1539140 (0.0009) [2023-12-26 11:57:58,125][123090] Updated weights for policy 1, policy_version 1539150 (0.0009) [2023-12-26 11:57:58,182][123090] Updated weights for policy 1, policy_version 1539160 (0.0010) [2023-12-26 11:57:58,519][123091] Updated weights for policy 0, policy_version 1549370 (0.0007) [2023-12-26 11:57:58,585][123091] Updated weights for policy 0, policy_version 1549380 (0.0010) [2023-12-26 11:57:58,660][123091] Updated weights for policy 0, policy_version 1549390 (0.0009) [2023-12-26 11:57:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 790675456. Throughput: 0: 9122.1, 1: 8551.9. Samples: 790668220. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:57:58,785][121949] Avg episode reward: [(0, '6188.146'), (1, '5508.935')] [2023-12-26 11:57:59,048][123090] Updated weights for policy 1, policy_version 1539170 (0.0009) [2023-12-26 11:57:59,105][123090] Updated weights for policy 1, policy_version 1539180 (0.0007) [2023-12-26 11:57:59,170][123090] Updated weights for policy 1, policy_version 1539190 (0.0007) [2023-12-26 11:57:59,245][123090] Updated weights for policy 1, policy_version 1539200 (0.0008) [2023-12-26 11:57:59,546][123091] Updated weights for policy 0, policy_version 1549400 (0.0006) [2023-12-26 11:57:59,619][123091] Updated weights for policy 0, policy_version 1549410 (0.0006) [2023-12-26 11:57:59,670][123091] Updated weights for policy 0, policy_version 1549420 (0.0010) [2023-12-26 11:58:00,111][123090] Updated weights for policy 1, policy_version 1539210 (0.0007) [2023-12-26 11:58:00,178][123090] Updated weights for policy 1, policy_version 1539220 (0.0010) [2023-12-26 11:58:00,242][123090] Updated weights for policy 1, policy_version 1539230 (0.0011) [2023-12-26 11:58:00,504][123091] Updated weights for policy 0, policy_version 1549430 (0.0010) [2023-12-26 11:58:00,570][123091] Updated weights for policy 0, policy_version 1549440 (0.0006) [2023-12-26 11:58:00,640][123091] Updated weights for policy 0, policy_version 1549450 (0.0009) [2023-12-26 11:58:00,961][123090] Updated weights for policy 1, policy_version 1539240 (0.0006) [2023-12-26 11:58:01,020][123090] Updated weights for policy 1, policy_version 1539250 (0.0005) [2023-12-26 11:58:01,084][123090] Updated weights for policy 1, policy_version 1539260 (0.0007) [2023-12-26 11:58:01,363][123091] Updated weights for policy 0, policy_version 1549460 (0.0010) [2023-12-26 11:58:01,425][123091] Updated weights for policy 0, policy_version 1549470 (0.0010) [2023-12-26 11:58:01,484][123091] Updated weights for policy 0, policy_version 1549480 (0.0009) [2023-12-26 11:58:01,793][123090] Updated weights for policy 1, policy_version 1539270 (0.0007) [2023-12-26 11:58:01,859][123090] Updated weights for policy 1, policy_version 1539280 (0.0010) [2023-12-26 11:58:01,916][123090] Updated weights for policy 1, policy_version 1539290 (0.0009) [2023-12-26 11:58:02,341][123091] Updated weights for policy 0, policy_version 1549490 (0.0009) [2023-12-26 11:58:02,411][123091] Updated weights for policy 0, policy_version 1549500 (0.0009) [2023-12-26 11:58:02,478][123091] Updated weights for policy 0, policy_version 1549510 (0.0007) [2023-12-26 11:58:02,549][123091] Updated weights for policy 0, policy_version 1549520 (0.0010) [2023-12-26 11:58:02,771][123090] Updated weights for policy 1, policy_version 1539300 (0.0009) [2023-12-26 11:58:02,821][123090] Updated weights for policy 1, policy_version 1539310 (0.0009) [2023-12-26 11:58:02,874][123090] Updated weights for policy 1, policy_version 1539320 (0.0009) [2023-12-26 11:58:03,283][123091] Updated weights for policy 0, policy_version 1549530 (0.0005) [2023-12-26 11:58:03,340][123091] Updated weights for policy 0, policy_version 1549540 (0.0005) [2023-12-26 11:58:03,408][123091] Updated weights for policy 0, policy_version 1549550 (0.0005) [2023-12-26 11:58:03,620][123090] Updated weights for policy 1, policy_version 1539330 (0.0009) [2023-12-26 11:58:03,673][123090] Updated weights for policy 1, policy_version 1539340 (0.0010) [2023-12-26 11:58:03,720][123090] Updated weights for policy 1, policy_version 1539350 (0.0010) [2023-12-26 11:58:03,765][123090] Updated weights for policy 1, policy_version 1539360 (0.0009) [2023-12-26 11:58:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 790765568. Throughput: 0: 9088.7, 1: 8595.0. Samples: 790774064. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:03,784][121949] Avg episode reward: [(0, '6270.865'), (1, '5763.825')] [2023-12-26 11:58:04,056][123091] Updated weights for policy 0, policy_version 1549560 (0.0007) [2023-12-26 11:58:04,107][123091] Updated weights for policy 0, policy_version 1549570 (0.0005) [2023-12-26 11:58:04,163][123091] Updated weights for policy 0, policy_version 1549580 (0.0005) [2023-12-26 11:58:04,614][123090] Updated weights for policy 1, policy_version 1539370 (0.0011) [2023-12-26 11:58:04,677][123090] Updated weights for policy 1, policy_version 1539380 (0.0010) [2023-12-26 11:58:04,740][123090] Updated weights for policy 1, policy_version 1539390 (0.0010) [2023-12-26 11:58:04,834][123091] Updated weights for policy 0, policy_version 1549590 (0.0005) [2023-12-26 11:58:04,901][123091] Updated weights for policy 0, policy_version 1549600 (0.0006) [2023-12-26 11:58:04,976][123091] Updated weights for policy 0, policy_version 1549610 (0.0007) [2023-12-26 11:58:05,551][123090] Updated weights for policy 1, policy_version 1539400 (0.0006) [2023-12-26 11:58:05,618][123090] Updated weights for policy 1, policy_version 1539410 (0.0005) [2023-12-26 11:58:05,673][123091] Updated weights for policy 0, policy_version 1549620 (0.0007) [2023-12-26 11:58:05,675][123090] Updated weights for policy 1, policy_version 1539420 (0.0006) [2023-12-26 11:58:05,737][123091] Updated weights for policy 0, policy_version 1549630 (0.0009) [2023-12-26 11:58:05,793][123091] Updated weights for policy 0, policy_version 1549640 (0.0008) [2023-12-26 11:58:06,491][123090] Updated weights for policy 1, policy_version 1539430 (0.0009) [2023-12-26 11:58:06,555][123090] Updated weights for policy 1, policy_version 1539440 (0.0010) [2023-12-26 11:58:06,614][123091] Updated weights for policy 0, policy_version 1549650 (0.0006) [2023-12-26 11:58:06,619][123090] Updated weights for policy 1, policy_version 1539450 (0.0009) [2023-12-26 11:58:06,671][123091] Updated weights for policy 0, policy_version 1549660 (0.0010) [2023-12-26 11:58:06,725][123091] Updated weights for policy 0, policy_version 1549670 (0.0010) [2023-12-26 11:58:06,774][123091] Updated weights for policy 0, policy_version 1549680 (0.0008) [2023-12-26 11:58:07,504][123090] Updated weights for policy 1, policy_version 1539460 (0.0009) [2023-12-26 11:58:07,523][123091] Updated weights for policy 0, policy_version 1549690 (0.0010) [2023-12-26 11:58:07,566][123090] Updated weights for policy 1, policy_version 1539470 (0.0007) [2023-12-26 11:58:07,577][123091] Updated weights for policy 0, policy_version 1549700 (0.0008) [2023-12-26 11:58:07,629][123090] Updated weights for policy 1, policy_version 1539480 (0.0010) [2023-12-26 11:58:07,638][123091] Updated weights for policy 0, policy_version 1549710 (0.0007) [2023-12-26 11:58:08,452][123090] Updated weights for policy 1, policy_version 1539490 (0.0008) [2023-12-26 11:58:08,484][123091] Updated weights for policy 0, policy_version 1549720 (0.0010) [2023-12-26 11:58:08,524][123090] Updated weights for policy 1, policy_version 1539500 (0.0007) [2023-12-26 11:58:08,556][123091] Updated weights for policy 0, policy_version 1549730 (0.0010) [2023-12-26 11:58:08,586][123090] Updated weights for policy 1, policy_version 1539510 (0.0007) [2023-12-26 11:58:08,619][123091] Updated weights for policy 0, policy_version 1549740 (0.0008) [2023-12-26 11:58:08,643][123090] Updated weights for policy 1, policy_version 1539520 (0.0006) [2023-12-26 11:58:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 790855680. Throughput: 0: 9134.3, 1: 8610.5. Samples: 790827896. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:08,785][121949] Avg episode reward: [(0, '6029.913'), (1, '5423.394')] [2023-12-26 11:58:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001539520_394117120.pth... [2023-12-26 11:58:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001549744_396738560.pth... [2023-12-26 11:58:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001538496_393854976.pth [2023-12-26 11:58:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001548688_396468224.pth [2023-12-26 11:58:09,260][123091] Updated weights for policy 0, policy_version 1549750 (0.0009) [2023-12-26 11:58:09,327][123091] Updated weights for policy 0, policy_version 1549760 (0.0009) [2023-12-26 11:58:09,385][123090] Updated weights for policy 1, policy_version 1539530 (0.0008) [2023-12-26 11:58:09,387][123091] Updated weights for policy 0, policy_version 1549770 (0.0011) [2023-12-26 11:58:09,458][123090] Updated weights for policy 1, policy_version 1539540 (0.0009) [2023-12-26 11:58:09,520][123090] Updated weights for policy 1, policy_version 1539550 (0.0009) [2023-12-26 11:58:10,214][123091] Updated weights for policy 0, policy_version 1549780 (0.0009) [2023-12-26 11:58:10,272][123091] Updated weights for policy 0, policy_version 1549790 (0.0009) [2023-12-26 11:58:10,334][123091] Updated weights for policy 0, policy_version 1549800 (0.0009) [2023-12-26 11:58:10,393][123090] Updated weights for policy 1, policy_version 1539560 (0.0009) [2023-12-26 11:58:10,461][123090] Updated weights for policy 1, policy_version 1539570 (0.0009) [2023-12-26 11:58:10,526][123090] Updated weights for policy 1, policy_version 1539580 (0.0009) [2023-12-26 11:58:11,161][123091] Updated weights for policy 0, policy_version 1549810 (0.0008) [2023-12-26 11:58:11,228][123091] Updated weights for policy 0, policy_version 1549820 (0.0009) [2023-12-26 11:58:11,297][123091] Updated weights for policy 0, policy_version 1549830 (0.0009) [2023-12-26 11:58:11,354][123090] Updated weights for policy 1, policy_version 1539590 (0.0008) [2023-12-26 11:58:11,367][123091] Updated weights for policy 0, policy_version 1549840 (0.0009) [2023-12-26 11:58:11,424][123090] Updated weights for policy 1, policy_version 1539600 (0.0008) [2023-12-26 11:58:11,487][123090] Updated weights for policy 1, policy_version 1539610 (0.0005) [2023-12-26 11:58:12,208][123091] Updated weights for policy 0, policy_version 1549850 (0.0009) [2023-12-26 11:58:12,211][123090] Updated weights for policy 1, policy_version 1539620 (0.0005) [2023-12-26 11:58:12,265][123090] Updated weights for policy 1, policy_version 1539630 (0.0006) [2023-12-26 11:58:12,272][123091] Updated weights for policy 0, policy_version 1549860 (0.0008) [2023-12-26 11:58:12,332][123090] Updated weights for policy 1, policy_version 1539640 (0.0008) [2023-12-26 11:58:12,344][123091] Updated weights for policy 0, policy_version 1549870 (0.0008) [2023-12-26 11:58:13,073][123090] Updated weights for policy 1, policy_version 1539650 (0.0008) [2023-12-26 11:58:13,122][123090] Updated weights for policy 1, policy_version 1539660 (0.0009) [2023-12-26 11:58:13,183][123090] Updated weights for policy 1, policy_version 1539670 (0.0009) [2023-12-26 11:58:13,208][123091] Updated weights for policy 0, policy_version 1549880 (0.0008) [2023-12-26 11:58:13,249][123090] Updated weights for policy 1, policy_version 1539680 (0.0008) [2023-12-26 11:58:13,272][123091] Updated weights for policy 0, policy_version 1549890 (0.0008) [2023-12-26 11:58:13,344][123091] Updated weights for policy 0, policy_version 1549900 (0.0009) [2023-12-26 11:58:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 790937600. Throughput: 0: 9080.3, 1: 8670.5. Samples: 790932120. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:13,784][121949] Avg episode reward: [(0, '5985.997'), (1, '5347.266')] [2023-12-26 11:58:13,941][123090] Updated weights for policy 1, policy_version 1539690 (0.0005) [2023-12-26 11:58:14,014][123090] Updated weights for policy 1, policy_version 1539700 (0.0007) [2023-12-26 11:58:14,082][123090] Updated weights for policy 1, policy_version 1539710 (0.0009) [2023-12-26 11:58:14,172][123091] Updated weights for policy 0, policy_version 1549910 (0.0010) [2023-12-26 11:58:14,229][123091] Updated weights for policy 0, policy_version 1549922 (0.0010) [2023-12-26 11:58:14,277][123091] Updated weights for policy 0, policy_version 1549933 (0.0006) [2023-12-26 11:58:14,921][123090] Updated weights for policy 1, policy_version 1539720 (0.0009) [2023-12-26 11:58:14,985][123090] Updated weights for policy 1, policy_version 1539730 (0.0008) [2023-12-26 11:58:15,029][123091] Updated weights for policy 0, policy_version 1549943 (0.0009) [2023-12-26 11:58:15,052][123090] Updated weights for policy 1, policy_version 1539740 (0.0007) [2023-12-26 11:58:15,078][123091] Updated weights for policy 0, policy_version 1549953 (0.0006) [2023-12-26 11:58:15,146][123091] Updated weights for policy 0, policy_version 1549963 (0.0006) [2023-12-26 11:58:15,906][123090] Updated weights for policy 1, policy_version 1539750 (0.0009) [2023-12-26 11:58:15,944][123091] Updated weights for policy 0, policy_version 1549973 (0.0008) [2023-12-26 11:58:15,960][123090] Updated weights for policy 1, policy_version 1539760 (0.0008) [2023-12-26 11:58:15,999][123091] Updated weights for policy 0, policy_version 1549983 (0.0007) [2023-12-26 11:58:16,010][123090] Updated weights for policy 1, policy_version 1539770 (0.0010) [2023-12-26 11:58:16,059][123091] Updated weights for policy 0, policy_version 1549993 (0.0007) [2023-12-26 11:58:16,881][123090] Updated weights for policy 1, policy_version 1539780 (0.0009) [2023-12-26 11:58:16,905][123091] Updated weights for policy 0, policy_version 1550003 (0.0009) [2023-12-26 11:58:16,933][123090] Updated weights for policy 1, policy_version 1539790 (0.0008) [2023-12-26 11:58:16,950][123091] Updated weights for policy 0, policy_version 1550013 (0.0005) [2023-12-26 11:58:16,984][123090] Updated weights for policy 1, policy_version 1539800 (0.0009) [2023-12-26 11:58:16,998][123091] Updated weights for policy 0, policy_version 1550023 (0.0005) [2023-12-26 11:58:17,711][123091] Updated weights for policy 0, policy_version 1550033 (0.0006) [2023-12-26 11:58:17,751][123090] Updated weights for policy 1, policy_version 1539810 (0.0009) [2023-12-26 11:58:17,770][123091] Updated weights for policy 0, policy_version 1550043 (0.0010) [2023-12-26 11:58:17,815][123090] Updated weights for policy 1, policy_version 1539820 (0.0011) [2023-12-26 11:58:17,829][123091] Updated weights for policy 0, policy_version 1550053 (0.0010) [2023-12-26 11:58:17,873][123090] Updated weights for policy 1, policy_version 1539830 (0.0010) [2023-12-26 11:58:17,891][123091] Updated weights for policy 0, policy_version 1550063 (0.0011) [2023-12-26 11:58:17,932][123090] Updated weights for policy 1, policy_version 1539840 (0.0010) [2023-12-26 11:58:18,699][123090] Updated weights for policy 1, policy_version 1539850 (0.0011) [2023-12-26 11:58:18,719][123091] Updated weights for policy 0, policy_version 1550073 (0.0011) [2023-12-26 11:58:18,763][123090] Updated weights for policy 1, policy_version 1539860 (0.0011) [2023-12-26 11:58:18,782][123091] Updated weights for policy 0, policy_version 1550083 (0.0011) [2023-12-26 11:58:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 791019520. Throughput: 0: 9016.9, 1: 8700.8. Samples: 791038648. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:18,784][121949] Avg episode reward: [(0, '6083.729'), (1, '5541.833')] [2023-12-26 11:58:18,825][123090] Updated weights for policy 1, policy_version 1539870 (0.0009) [2023-12-26 11:58:18,852][123091] Updated weights for policy 0, policy_version 1550094 (0.0011) [2023-12-26 11:58:19,685][123090] Updated weights for policy 1, policy_version 1539880 (0.0007) [2023-12-26 11:58:19,695][123091] Updated weights for policy 0, policy_version 1550104 (0.0010) [2023-12-26 11:58:19,749][123090] Updated weights for policy 1, policy_version 1539890 (0.0008) [2023-12-26 11:58:19,766][123091] Updated weights for policy 0, policy_version 1550114 (0.0009) [2023-12-26 11:58:19,814][123090] Updated weights for policy 1, policy_version 1539900 (0.0006) [2023-12-26 11:58:19,850][123091] Updated weights for policy 0, policy_version 1550124 (0.0009) [2023-12-26 11:58:20,605][123090] Updated weights for policy 1, policy_version 1539910 (0.0008) [2023-12-26 11:58:20,673][123090] Updated weights for policy 1, policy_version 1539920 (0.0006) [2023-12-26 11:58:20,689][123091] Updated weights for policy 0, policy_version 1550134 (0.0008) [2023-12-26 11:58:20,742][123090] Updated weights for policy 1, policy_version 1539930 (0.0009) [2023-12-26 11:58:20,745][123091] Updated weights for policy 0, policy_version 1550144 (0.0008) [2023-12-26 11:58:20,814][123091] Updated weights for policy 0, policy_version 1550154 (0.0010) [2023-12-26 11:58:21,456][123090] Updated weights for policy 1, policy_version 1539940 (0.0007) [2023-12-26 11:58:21,508][123090] Updated weights for policy 1, policy_version 1539950 (0.0008) [2023-12-26 11:58:21,560][123090] Updated weights for policy 1, policy_version 1539960 (0.0007) [2023-12-26 11:58:21,751][123091] Updated weights for policy 0, policy_version 1550164 (0.0009) [2023-12-26 11:58:21,811][123091] Updated weights for policy 0, policy_version 1550174 (0.0010) [2023-12-26 11:58:21,891][123091] Updated weights for policy 0, policy_version 1550184 (0.0008) [2023-12-26 11:58:22,326][123090] Updated weights for policy 1, policy_version 1539970 (0.0006) [2023-12-26 11:58:22,403][123090] Updated weights for policy 1, policy_version 1539980 (0.0008) [2023-12-26 11:58:22,470][123090] Updated weights for policy 1, policy_version 1539990 (0.0010) [2023-12-26 11:58:22,538][123090] Updated weights for policy 1, policy_version 1540000 (0.0011) [2023-12-26 11:58:22,783][123091] Updated weights for policy 0, policy_version 1550194 (0.0008) [2023-12-26 11:58:22,860][123091] Updated weights for policy 0, policy_version 1550204 (0.0009) [2023-12-26 11:58:22,926][123091] Updated weights for policy 0, policy_version 1550214 (0.0009) [2023-12-26 11:58:22,988][123091] Updated weights for policy 0, policy_version 1550224 (0.0009) [2023-12-26 11:58:23,355][123090] Updated weights for policy 1, policy_version 1540010 (0.0011) [2023-12-26 11:58:23,419][123090] Updated weights for policy 1, policy_version 1540020 (0.0008) [2023-12-26 11:58:23,484][123090] Updated weights for policy 1, policy_version 1540030 (0.0009) [2023-12-26 11:58:23,782][123091] Updated weights for policy 0, policy_version 1550234 (0.0009) [2023-12-26 11:58:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 791109632. Throughput: 0: 8891.3, 1: 8685.8. Samples: 791089296. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:23,785][121949] Avg episode reward: [(0, '6029.107'), (1, '5466.096')] [2023-12-26 11:58:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001540032_394248192.pth... [2023-12-26 11:58:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001539008_393986048.pth [2023-12-26 11:58:23,851][123091] Updated weights for policy 0, policy_version 1550244 (0.0007) [2023-12-26 11:58:23,915][123091] Updated weights for policy 0, policy_version 1550254 (0.0009) [2023-12-26 11:58:23,928][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001550256_396869632.pth... [2023-12-26 11:58:23,931][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001549200_396599296.pth [2023-12-26 11:58:24,250][123090] Updated weights for policy 1, policy_version 1540040 (0.0011) [2023-12-26 11:58:24,306][123090] Updated weights for policy 1, policy_version 1540050 (0.0010) [2023-12-26 11:58:24,373][123090] Updated weights for policy 1, policy_version 1540060 (0.0010) [2023-12-26 11:58:24,678][123091] Updated weights for policy 0, policy_version 1550264 (0.0010) [2023-12-26 11:58:24,736][123091] Updated weights for policy 0, policy_version 1550274 (0.0010) [2023-12-26 11:58:24,795][123091] Updated weights for policy 0, policy_version 1550284 (0.0010) [2023-12-26 11:58:25,188][123090] Updated weights for policy 1, policy_version 1540070 (0.0010) [2023-12-26 11:58:25,239][123090] Updated weights for policy 1, policy_version 1540080 (0.0010) [2023-12-26 11:58:25,286][123090] Updated weights for policy 1, policy_version 1540090 (0.0010) [2023-12-26 11:58:25,483][123091] Updated weights for policy 0, policy_version 1550294 (0.0010) [2023-12-26 11:58:25,534][123091] Updated weights for policy 0, policy_version 1550304 (0.0010) [2023-12-26 11:58:25,580][123091] Updated weights for policy 0, policy_version 1550314 (0.0010) [2023-12-26 11:58:26,007][123090] Updated weights for policy 1, policy_version 1540100 (0.0008) [2023-12-26 11:58:26,062][123090] Updated weights for policy 1, policy_version 1540110 (0.0006) [2023-12-26 11:58:26,130][123090] Updated weights for policy 1, policy_version 1540120 (0.0005) [2023-12-26 11:58:26,299][123091] Updated weights for policy 0, policy_version 1550324 (0.0009) [2023-12-26 11:58:26,356][123091] Updated weights for policy 0, policy_version 1550334 (0.0005) [2023-12-26 11:58:26,433][123091] Updated weights for policy 0, policy_version 1550344 (0.0005) [2023-12-26 11:58:26,855][123090] Updated weights for policy 1, policy_version 1540130 (0.0006) [2023-12-26 11:58:26,918][123090] Updated weights for policy 1, policy_version 1540140 (0.0005) [2023-12-26 11:58:26,972][123090] Updated weights for policy 1, policy_version 1540150 (0.0005) [2023-12-26 11:58:27,020][123090] Updated weights for policy 1, policy_version 1540160 (0.0005) [2023-12-26 11:58:27,036][123091] Updated weights for policy 0, policy_version 1550354 (0.0005) [2023-12-26 11:58:27,094][123091] Updated weights for policy 0, policy_version 1550364 (0.0005) [2023-12-26 11:58:27,157][123091] Updated weights for policy 0, policy_version 1550374 (0.0005) [2023-12-26 11:58:27,233][123091] Updated weights for policy 0, policy_version 1550384 (0.0006) [2023-12-26 11:58:27,715][123090] Updated weights for policy 1, policy_version 1540170 (0.0011) [2023-12-26 11:58:27,773][123090] Updated weights for policy 1, policy_version 1540180 (0.0010) [2023-12-26 11:58:27,832][123090] Updated weights for policy 1, policy_version 1540190 (0.0010) [2023-12-26 11:58:27,908][123091] Updated weights for policy 0, policy_version 1550394 (0.0010) [2023-12-26 11:58:27,969][123091] Updated weights for policy 0, policy_version 1550404 (0.0010) [2023-12-26 11:58:28,031][123091] Updated weights for policy 0, policy_version 1550414 (0.0010) [2023-12-26 11:58:28,614][123090] Updated weights for policy 1, policy_version 1540200 (0.0006) [2023-12-26 11:58:28,682][123090] Updated weights for policy 1, policy_version 1540210 (0.0006) [2023-12-26 11:58:28,737][123090] Updated weights for policy 1, policy_version 1540220 (0.0005) [2023-12-26 11:58:28,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 791207936. Throughput: 0: 8962.3, 1: 8735.2. Samples: 791200176. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:28,785][121949] Avg episode reward: [(0, '6090.322'), (1, '5409.864')] [2023-12-26 11:58:28,856][123091] Updated weights for policy 0, policy_version 1550424 (0.0010) [2023-12-26 11:58:28,926][123091] Updated weights for policy 0, policy_version 1550434 (0.0010) [2023-12-26 11:58:28,977][123091] Updated weights for policy 0, policy_version 1550444 (0.0010) [2023-12-26 11:58:29,431][123090] Updated weights for policy 1, policy_version 1540230 (0.0006) [2023-12-26 11:58:29,495][123090] Updated weights for policy 1, policy_version 1540240 (0.0006) [2023-12-26 11:58:29,554][123090] Updated weights for policy 1, policy_version 1540250 (0.0009) [2023-12-26 11:58:29,813][123091] Updated weights for policy 0, policy_version 1550454 (0.0011) [2023-12-26 11:58:29,876][123091] Updated weights for policy 0, policy_version 1550464 (0.0013) [2023-12-26 11:58:29,937][123091] Updated weights for policy 0, policy_version 1550474 (0.0009) [2023-12-26 11:58:30,239][123090] Updated weights for policy 1, policy_version 1540260 (0.0010) [2023-12-26 11:58:30,305][123090] Updated weights for policy 1, policy_version 1540270 (0.0010) [2023-12-26 11:58:30,371][123090] Updated weights for policy 1, policy_version 1540280 (0.0010) [2023-12-26 11:58:30,753][123091] Updated weights for policy 0, policy_version 1550484 (0.0009) [2023-12-26 11:58:30,802][123091] Updated weights for policy 0, policy_version 1550494 (0.0005) [2023-12-26 11:58:30,851][123091] Updated weights for policy 0, policy_version 1550504 (0.0006) [2023-12-26 11:58:31,090][123090] Updated weights for policy 1, policy_version 1540290 (0.0010) [2023-12-26 11:58:31,162][123090] Updated weights for policy 1, policy_version 1540300 (0.0008) [2023-12-26 11:58:31,228][123090] Updated weights for policy 1, policy_version 1540310 (0.0008) [2023-12-26 11:58:31,300][123090] Updated weights for policy 1, policy_version 1540320 (0.0008) [2023-12-26 11:58:31,573][123091] Updated weights for policy 0, policy_version 1550514 (0.0005) [2023-12-26 11:58:31,640][123091] Updated weights for policy 0, policy_version 1550524 (0.0007) [2023-12-26 11:58:31,704][123091] Updated weights for policy 0, policy_version 1550534 (0.0008) [2023-12-26 11:58:31,770][123091] Updated weights for policy 0, policy_version 1550544 (0.0009) [2023-12-26 11:58:32,159][123090] Updated weights for policy 1, policy_version 1540330 (0.0009) [2023-12-26 11:58:32,214][123090] Updated weights for policy 1, policy_version 1540340 (0.0009) [2023-12-26 11:58:32,278][123090] Updated weights for policy 1, policy_version 1540350 (0.0009) [2023-12-26 11:58:32,532][123091] Updated weights for policy 0, policy_version 1550554 (0.0010) [2023-12-26 11:58:32,583][123091] Updated weights for policy 0, policy_version 1550564 (0.0010) [2023-12-26 11:58:32,658][123091] Updated weights for policy 0, policy_version 1550574 (0.0009) [2023-12-26 11:58:33,119][123090] Updated weights for policy 1, policy_version 1540360 (0.0006) [2023-12-26 11:58:33,189][123090] Updated weights for policy 1, policy_version 1540370 (0.0005) [2023-12-26 11:58:33,263][123090] Updated weights for policy 1, policy_version 1540380 (0.0005) [2023-12-26 11:58:33,540][123091] Updated weights for policy 0, policy_version 1550584 (0.0009) [2023-12-26 11:58:33,600][123091] Updated weights for policy 0, policy_version 1550594 (0.0008) [2023-12-26 11:58:33,653][123091] Updated weights for policy 0, policy_version 1550604 (0.0009) [2023-12-26 11:58:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 791298048. Throughput: 0: 8919.4, 1: 8820.6. Samples: 791309128. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:33,785][121949] Avg episode reward: [(0, '6252.641'), (1, '5321.244')] [2023-12-26 11:58:33,852][123090] Updated weights for policy 1, policy_version 1540390 (0.0007) [2023-12-26 11:58:33,911][123090] Updated weights for policy 1, policy_version 1540400 (0.0009) [2023-12-26 11:58:33,975][123090] Updated weights for policy 1, policy_version 1540410 (0.0009) [2023-12-26 11:58:34,537][123091] Updated weights for policy 0, policy_version 1550614 (0.0009) [2023-12-26 11:58:34,602][123091] Updated weights for policy 0, policy_version 1550624 (0.0010) [2023-12-26 11:58:34,657][123090] Updated weights for policy 1, policy_version 1540420 (0.0007) [2023-12-26 11:58:34,660][123091] Updated weights for policy 0, policy_version 1550635 (0.0009) [2023-12-26 11:58:34,712][123090] Updated weights for policy 1, policy_version 1540430 (0.0008) [2023-12-26 11:58:34,764][123090] Updated weights for policy 1, policy_version 1540440 (0.0009) [2023-12-26 11:58:35,552][123091] Updated weights for policy 0, policy_version 1550645 (0.0009) [2023-12-26 11:58:35,572][123090] Updated weights for policy 1, policy_version 1540450 (0.0010) [2023-12-26 11:58:35,607][123091] Updated weights for policy 0, policy_version 1550655 (0.0008) [2023-12-26 11:58:35,626][123090] Updated weights for policy 1, policy_version 1540460 (0.0009) [2023-12-26 11:58:35,660][123091] Updated weights for policy 0, policy_version 1550665 (0.0007) [2023-12-26 11:58:35,687][123090] Updated weights for policy 1, policy_version 1540470 (0.0009) [2023-12-26 11:58:35,747][123090] Updated weights for policy 1, policy_version 1540480 (0.0008) [2023-12-26 11:58:36,529][123091] Updated weights for policy 0, policy_version 1550675 (0.0008) [2023-12-26 11:58:36,532][123090] Updated weights for policy 1, policy_version 1540491 (0.0010) [2023-12-26 11:58:36,594][123091] Updated weights for policy 0, policy_version 1550685 (0.0009) [2023-12-26 11:58:36,597][123090] Updated weights for policy 1, policy_version 1540501 (0.0008) [2023-12-26 11:58:36,656][123091] Updated weights for policy 0, policy_version 1550695 (0.0008) [2023-12-26 11:58:36,659][123090] Updated weights for policy 1, policy_version 1540511 (0.0009) [2023-12-26 11:58:37,496][123091] Updated weights for policy 0, policy_version 1550705 (0.0009) [2023-12-26 11:58:37,511][123090] Updated weights for policy 1, policy_version 1540521 (0.0010) [2023-12-26 11:58:37,553][123091] Updated weights for policy 0, policy_version 1550715 (0.0009) [2023-12-26 11:58:37,561][123090] Updated weights for policy 1, policy_version 1540531 (0.0005) [2023-12-26 11:58:37,612][123090] Updated weights for policy 1, policy_version 1540541 (0.0005) [2023-12-26 11:58:37,615][123091] Updated weights for policy 0, policy_version 1550725 (0.0009) [2023-12-26 11:58:37,682][123091] Updated weights for policy 0, policy_version 1550735 (0.0009) [2023-12-26 11:58:38,352][123090] Updated weights for policy 1, policy_version 1540551 (0.0008) [2023-12-26 11:58:38,409][123090] Updated weights for policy 1, policy_version 1540561 (0.0008) [2023-12-26 11:58:38,439][123091] Updated weights for policy 0, policy_version 1550745 (0.0008) [2023-12-26 11:58:38,470][123090] Updated weights for policy 1, policy_version 1540571 (0.0005) [2023-12-26 11:58:38,489][123091] Updated weights for policy 0, policy_version 1550755 (0.0009) [2023-12-26 11:58:38,555][123091] Updated weights for policy 0, policy_version 1550765 (0.0010) [2023-12-26 11:58:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 791388160. Throughput: 0: 8899.4, 1: 8860.4. Samples: 791360916. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:38,785][121949] Avg episode reward: [(0, '6271.179'), (1, '5322.252')] [2023-12-26 11:58:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001550768_397000704.pth... [2023-12-26 11:58:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001540576_394387456.pth... [2023-12-26 11:58:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001549744_396738560.pth [2023-12-26 11:58:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001539520_394117120.pth [2023-12-26 11:58:39,170][123090] Updated weights for policy 1, policy_version 1540581 (0.0006) [2023-12-26 11:58:39,229][123090] Updated weights for policy 1, policy_version 1540591 (0.0006) [2023-12-26 11:58:39,287][123090] Updated weights for policy 1, policy_version 1540601 (0.0006) [2023-12-26 11:58:39,517][123091] Updated weights for policy 0, policy_version 1550775 (0.0010) [2023-12-26 11:58:39,566][123091] Updated weights for policy 0, policy_version 1550785 (0.0009) [2023-12-26 11:58:39,631][123091] Updated weights for policy 0, policy_version 1550795 (0.0009) [2023-12-26 11:58:40,126][123090] Updated weights for policy 1, policy_version 1540612 (0.0009) [2023-12-26 11:58:40,187][123090] Updated weights for policy 1, policy_version 1540622 (0.0010) [2023-12-26 11:58:40,257][123090] Updated weights for policy 1, policy_version 1540632 (0.0010) [2023-12-26 11:58:40,467][123091] Updated weights for policy 0, policy_version 1550805 (0.0009) [2023-12-26 11:58:40,532][123091] Updated weights for policy 0, policy_version 1550815 (0.0010) [2023-12-26 11:58:40,592][123091] Updated weights for policy 0, policy_version 1550825 (0.0009) [2023-12-26 11:58:41,060][123090] Updated weights for policy 1, policy_version 1540642 (0.0009) [2023-12-26 11:58:41,117][123090] Updated weights for policy 1, policy_version 1540652 (0.0009) [2023-12-26 11:58:41,183][123090] Updated weights for policy 1, policy_version 1540662 (0.0008) [2023-12-26 11:58:41,248][123090] Updated weights for policy 1, policy_version 1540672 (0.0009) [2023-12-26 11:58:41,477][123091] Updated weights for policy 0, policy_version 1550835 (0.0010) [2023-12-26 11:58:41,530][123091] Updated weights for policy 0, policy_version 1550845 (0.0011) [2023-12-26 11:58:41,591][123091] Updated weights for policy 0, policy_version 1550855 (0.0011) [2023-12-26 11:58:42,135][123090] Updated weights for policy 1, policy_version 1540682 (0.0009) [2023-12-26 11:58:42,208][123090] Updated weights for policy 1, policy_version 1540692 (0.0009) [2023-12-26 11:58:42,277][123090] Updated weights for policy 1, policy_version 1540702 (0.0009) [2023-12-26 11:58:42,450][123091] Updated weights for policy 0, policy_version 1550865 (0.0011) [2023-12-26 11:58:42,506][123091] Updated weights for policy 0, policy_version 1550875 (0.0009) [2023-12-26 11:58:42,561][123091] Updated weights for policy 0, policy_version 1550885 (0.0008) [2023-12-26 11:58:42,611][123091] Updated weights for policy 0, policy_version 1550895 (0.0010) [2023-12-26 11:58:43,144][123090] Updated weights for policy 1, policy_version 1540712 (0.0010) [2023-12-26 11:58:43,204][123090] Updated weights for policy 1, policy_version 1540722 (0.0010) [2023-12-26 11:58:43,271][123090] Updated weights for policy 1, policy_version 1540732 (0.0009) [2023-12-26 11:58:43,383][123091] Updated weights for policy 0, policy_version 1550905 (0.0010) [2023-12-26 11:58:43,450][123091] Updated weights for policy 0, policy_version 1550915 (0.0009) [2023-12-26 11:58:43,518][123091] Updated weights for policy 0, policy_version 1550925 (0.0010) [2023-12-26 11:58:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 791470080. Throughput: 0: 8756.2, 1: 8899.4. Samples: 791462728. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:43,785][121949] Avg episode reward: [(0, '6186.998'), (1, '5269.139')] [2023-12-26 11:58:44,151][123090] Updated weights for policy 1, policy_version 1540742 (0.0010) [2023-12-26 11:58:44,222][123090] Updated weights for policy 1, policy_version 1540752 (0.0010) [2023-12-26 11:58:44,254][123091] Updated weights for policy 0, policy_version 1550935 (0.0006) [2023-12-26 11:58:44,278][123090] Updated weights for policy 1, policy_version 1540762 (0.0008) [2023-12-26 11:58:44,315][123091] Updated weights for policy 0, policy_version 1550945 (0.0008) [2023-12-26 11:58:44,371][123091] Updated weights for policy 0, policy_version 1550956 (0.0010) [2023-12-26 11:58:45,066][123090] Updated weights for policy 1, policy_version 1540772 (0.0009) [2023-12-26 11:58:45,137][123090] Updated weights for policy 1, policy_version 1540782 (0.0010) [2023-12-26 11:58:45,181][123091] Updated weights for policy 0, policy_version 1550966 (0.0008) [2023-12-26 11:58:45,204][123090] Updated weights for policy 1, policy_version 1540792 (0.0010) [2023-12-26 11:58:45,247][123091] Updated weights for policy 0, policy_version 1550976 (0.0010) [2023-12-26 11:58:45,314][123091] Updated weights for policy 0, policy_version 1550986 (0.0011) [2023-12-26 11:58:46,007][123091] Updated weights for policy 0, policy_version 1550996 (0.0008) [2023-12-26 11:58:46,072][123091] Updated weights for policy 0, policy_version 1551006 (0.0006) [2023-12-26 11:58:46,118][123090] Updated weights for policy 1, policy_version 1540802 (0.0008) [2023-12-26 11:58:46,130][123091] Updated weights for policy 0, policy_version 1551016 (0.0006) [2023-12-26 11:58:46,175][123090] Updated weights for policy 1, policy_version 1540812 (0.0008) [2023-12-26 11:58:46,238][123090] Updated weights for policy 1, policy_version 1540822 (0.0009) [2023-12-26 11:58:46,290][123090] Updated weights for policy 1, policy_version 1540832 (0.0008) [2023-12-26 11:58:46,853][123091] Updated weights for policy 0, policy_version 1551026 (0.0009) [2023-12-26 11:58:46,915][123091] Updated weights for policy 0, policy_version 1551036 (0.0005) [2023-12-26 11:58:46,974][123091] Updated weights for policy 0, policy_version 1551046 (0.0005) [2023-12-26 11:58:47,030][123091] Updated weights for policy 0, policy_version 1551056 (0.0006) [2023-12-26 11:58:47,055][123090] Updated weights for policy 1, policy_version 1540842 (0.0009) [2023-12-26 11:58:47,110][123090] Updated weights for policy 1, policy_version 1540852 (0.0010) [2023-12-26 11:58:47,163][123090] Updated weights for policy 1, policy_version 1540862 (0.0009) [2023-12-26 11:58:47,601][123091] Updated weights for policy 0, policy_version 1551066 (0.0005) [2023-12-26 11:58:47,655][123091] Updated weights for policy 0, policy_version 1551076 (0.0005) [2023-12-26 11:58:47,709][123091] Updated weights for policy 0, policy_version 1551086 (0.0005) [2023-12-26 11:58:48,097][123090] Updated weights for policy 1, policy_version 1540872 (0.0009) [2023-12-26 11:58:48,159][123090] Updated weights for policy 1, policy_version 1540882 (0.0009) [2023-12-26 11:58:48,214][123090] Updated weights for policy 1, policy_version 1540892 (0.0009) [2023-12-26 11:58:48,485][123091] Updated weights for policy 0, policy_version 1551096 (0.0009) [2023-12-26 11:58:48,548][123091] Updated weights for policy 0, policy_version 1551106 (0.0008) [2023-12-26 11:58:48,612][123091] Updated weights for policy 0, policy_version 1551116 (0.0009) [2023-12-26 11:58:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 791560192. Throughput: 0: 8831.4, 1: 8836.7. Samples: 791569128. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:48,785][121949] Avg episode reward: [(0, '6039.879'), (1, '5281.078')] [2023-12-26 11:58:49,089][123090] Updated weights for policy 1, policy_version 1540902 (0.0009) [2023-12-26 11:58:49,146][123090] Updated weights for policy 1, policy_version 1540912 (0.0009) [2023-12-26 11:58:49,195][123090] Updated weights for policy 1, policy_version 1540922 (0.0008) [2023-12-26 11:58:49,423][123091] Updated weights for policy 0, policy_version 1551126 (0.0010) [2023-12-26 11:58:49,478][123091] Updated weights for policy 0, policy_version 1551136 (0.0009) [2023-12-26 11:58:49,543][123091] Updated weights for policy 0, policy_version 1551146 (0.0010) [2023-12-26 11:58:50,084][123090] Updated weights for policy 1, policy_version 1540932 (0.0010) [2023-12-26 11:58:50,143][123090] Updated weights for policy 1, policy_version 1540942 (0.0009) [2023-12-26 11:58:50,215][123090] Updated weights for policy 1, policy_version 1540952 (0.0010) [2023-12-26 11:58:50,376][123091] Updated weights for policy 0, policy_version 1551156 (0.0008) [2023-12-26 11:58:50,445][123091] Updated weights for policy 0, policy_version 1551166 (0.0009) [2023-12-26 11:58:50,509][123091] Updated weights for policy 0, policy_version 1551176 (0.0007) [2023-12-26 11:58:51,116][123090] Updated weights for policy 1, policy_version 1540962 (0.0009) [2023-12-26 11:58:51,185][123090] Updated weights for policy 1, policy_version 1540972 (0.0007) [2023-12-26 11:58:51,261][123091] Updated weights for policy 0, policy_version 1551186 (0.0008) [2023-12-26 11:58:51,265][123090] Updated weights for policy 1, policy_version 1540982 (0.0007) [2023-12-26 11:58:51,326][123090] Updated weights for policy 1, policy_version 1540992 (0.0010) [2023-12-26 11:58:51,330][123091] Updated weights for policy 0, policy_version 1551196 (0.0006) [2023-12-26 11:58:51,403][123091] Updated weights for policy 0, policy_version 1551206 (0.0009) [2023-12-26 11:58:51,455][123091] Updated weights for policy 0, policy_version 1551216 (0.0009) [2023-12-26 11:58:52,157][123090] Updated weights for policy 1, policy_version 1541002 (0.0010) [2023-12-26 11:58:52,206][123090] Updated weights for policy 1, policy_version 1541012 (0.0009) [2023-12-26 11:58:52,239][123091] Updated weights for policy 0, policy_version 1551226 (0.0009) [2023-12-26 11:58:52,260][123090] Updated weights for policy 1, policy_version 1541022 (0.0008) [2023-12-26 11:58:52,297][123091] Updated weights for policy 0, policy_version 1551236 (0.0008) [2023-12-26 11:58:52,364][123091] Updated weights for policy 0, policy_version 1551246 (0.0009) [2023-12-26 11:58:53,013][123090] Updated weights for policy 1, policy_version 1541032 (0.0006) [2023-12-26 11:58:53,084][123090] Updated weights for policy 1, policy_version 1541042 (0.0005) [2023-12-26 11:58:53,150][123090] Updated weights for policy 1, policy_version 1541052 (0.0005) [2023-12-26 11:58:53,222][123091] Updated weights for policy 0, policy_version 1551256 (0.0006) [2023-12-26 11:58:53,281][123091] Updated weights for policy 0, policy_version 1551266 (0.0006) [2023-12-26 11:58:53,327][123091] Updated weights for policy 0, policy_version 1551276 (0.0005) [2023-12-26 11:58:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 791642112. Throughput: 0: 8790.1, 1: 8803.2. Samples: 791619588. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:53,785][121949] Avg episode reward: [(0, '6038.438'), (1, '5470.087')] [2023-12-26 11:58:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001551280_397131776.pth... [2023-12-26 11:58:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001541056_394510336.pth... [2023-12-26 11:58:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001550256_396869632.pth [2023-12-26 11:58:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001540032_394248192.pth [2023-12-26 11:58:53,873][123090] Updated weights for policy 1, policy_version 1541062 (0.0008) [2023-12-26 11:58:53,944][123090] Updated weights for policy 1, policy_version 1541072 (0.0010) [2023-12-26 11:58:54,007][123090] Updated weights for policy 1, policy_version 1541082 (0.0010) [2023-12-26 11:58:54,029][123091] Updated weights for policy 0, policy_version 1551286 (0.0009) [2023-12-26 11:58:54,088][123091] Updated weights for policy 0, policy_version 1551296 (0.0011) [2023-12-26 11:58:54,152][123091] Updated weights for policy 0, policy_version 1551306 (0.0011) [2023-12-26 11:58:54,853][123090] Updated weights for policy 1, policy_version 1541092 (0.0009) [2023-12-26 11:58:54,904][123090] Updated weights for policy 1, policy_version 1541102 (0.0007) [2023-12-26 11:58:54,924][123091] Updated weights for policy 0, policy_version 1551316 (0.0011) [2023-12-26 11:58:54,974][123090] Updated weights for policy 1, policy_version 1541112 (0.0007) [2023-12-26 11:58:54,984][123091] Updated weights for policy 0, policy_version 1551326 (0.0011) [2023-12-26 11:58:55,048][123091] Updated weights for policy 0, policy_version 1551336 (0.0011) [2023-12-26 11:58:55,795][123090] Updated weights for policy 1, policy_version 1541122 (0.0007) [2023-12-26 11:58:55,855][123090] Updated weights for policy 1, policy_version 1541132 (0.0009) [2023-12-26 11:58:55,868][123091] Updated weights for policy 0, policy_version 1551346 (0.0010) [2023-12-26 11:58:55,922][123090] Updated weights for policy 1, policy_version 1541142 (0.0008) [2023-12-26 11:58:55,925][123091] Updated weights for policy 0, policy_version 1551356 (0.0006) [2023-12-26 11:58:55,973][123091] Updated weights for policy 0, policy_version 1551366 (0.0005) [2023-12-26 11:58:55,983][123090] Updated weights for policy 1, policy_version 1541152 (0.0009) [2023-12-26 11:58:56,025][123091] Updated weights for policy 0, policy_version 1551376 (0.0005) [2023-12-26 11:58:56,666][123091] Updated weights for policy 0, policy_version 1551386 (0.0010) [2023-12-26 11:58:56,732][123091] Updated weights for policy 0, policy_version 1551396 (0.0011) [2023-12-26 11:58:56,793][123091] Updated weights for policy 0, policy_version 1551406 (0.0007) [2023-12-26 11:58:56,818][123090] Updated weights for policy 1, policy_version 1541162 (0.0009) [2023-12-26 11:58:56,879][123090] Updated weights for policy 1, policy_version 1541172 (0.0009) [2023-12-26 11:58:56,938][123090] Updated weights for policy 1, policy_version 1541182 (0.0009) [2023-12-26 11:58:57,492][123091] Updated weights for policy 0, policy_version 1551416 (0.0011) [2023-12-26 11:58:57,553][123091] Updated weights for policy 0, policy_version 1551426 (0.0010) [2023-12-26 11:58:57,608][123091] Updated weights for policy 0, policy_version 1551436 (0.0010) [2023-12-26 11:58:57,784][123090] Updated weights for policy 1, policy_version 1541192 (0.0006) [2023-12-26 11:58:57,830][123090] Updated weights for policy 1, policy_version 1541202 (0.0005) [2023-12-26 11:58:57,882][123090] Updated weights for policy 1, policy_version 1541212 (0.0006) [2023-12-26 11:58:58,446][123091] Updated weights for policy 0, policy_version 1551446 (0.0008) [2023-12-26 11:58:58,516][123091] Updated weights for policy 0, policy_version 1551456 (0.0007) [2023-12-26 11:58:58,586][123091] Updated weights for policy 0, policy_version 1551466 (0.0008) [2023-12-26 11:58:58,705][123090] Updated weights for policy 1, policy_version 1541222 (0.0008) [2023-12-26 11:58:58,769][123090] Updated weights for policy 1, policy_version 1541232 (0.0010) [2023-12-26 11:58:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 791732224. Throughput: 0: 8880.7, 1: 8805.8. Samples: 791728016. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:58:58,785][121949] Avg episode reward: [(0, '6137.396'), (1, '5294.886')] [2023-12-26 11:58:58,831][123090] Updated weights for policy 1, policy_version 1541242 (0.0010) [2023-12-26 11:58:59,322][123091] Updated weights for policy 0, policy_version 1551476 (0.0009) [2023-12-26 11:58:59,389][123091] Updated weights for policy 0, policy_version 1551486 (0.0009) [2023-12-26 11:58:59,452][123091] Updated weights for policy 0, policy_version 1551496 (0.0009) [2023-12-26 11:58:59,714][123090] Updated weights for policy 1, policy_version 1541252 (0.0009) [2023-12-26 11:58:59,771][123090] Updated weights for policy 1, policy_version 1541262 (0.0010) [2023-12-26 11:58:59,834][123090] Updated weights for policy 1, policy_version 1541272 (0.0010) [2023-12-26 11:59:00,262][123091] Updated weights for policy 0, policy_version 1551506 (0.0008) [2023-12-26 11:59:00,314][123091] Updated weights for policy 0, policy_version 1551516 (0.0010) [2023-12-26 11:59:00,361][123091] Updated weights for policy 0, policy_version 1551526 (0.0010) [2023-12-26 11:59:00,405][123091] Updated weights for policy 0, policy_version 1551536 (0.0010) [2023-12-26 11:59:00,611][123090] Updated weights for policy 1, policy_version 1541282 (0.0009) [2023-12-26 11:59:00,666][123090] Updated weights for policy 1, policy_version 1541292 (0.0009) [2023-12-26 11:59:00,725][123090] Updated weights for policy 1, policy_version 1541302 (0.0009) [2023-12-26 11:59:00,783][123090] Updated weights for policy 1, policy_version 1541312 (0.0009) [2023-12-26 11:59:01,176][123091] Updated weights for policy 0, policy_version 1551546 (0.0008) [2023-12-26 11:59:01,248][123091] Updated weights for policy 0, policy_version 1551556 (0.0006) [2023-12-26 11:59:01,322][123091] Updated weights for policy 0, policy_version 1551566 (0.0010) [2023-12-26 11:59:01,712][123090] Updated weights for policy 1, policy_version 1541322 (0.0009) [2023-12-26 11:59:01,782][123090] Updated weights for policy 1, policy_version 1541332 (0.0010) [2023-12-26 11:59:01,849][123090] Updated weights for policy 1, policy_version 1541342 (0.0009) [2023-12-26 11:59:02,050][123091] Updated weights for policy 0, policy_version 1551576 (0.0011) [2023-12-26 11:59:02,110][123091] Updated weights for policy 0, policy_version 1551586 (0.0009) [2023-12-26 11:59:02,169][123091] Updated weights for policy 0, policy_version 1551596 (0.0009) [2023-12-26 11:59:02,578][123090] Updated weights for policy 1, policy_version 1541352 (0.0006) [2023-12-26 11:59:02,638][123090] Updated weights for policy 1, policy_version 1541362 (0.0005) [2023-12-26 11:59:02,705][123090] Updated weights for policy 1, policy_version 1541372 (0.0006) [2023-12-26 11:59:03,054][123091] Updated weights for policy 0, policy_version 1551606 (0.0009) [2023-12-26 11:59:03,107][123091] Updated weights for policy 0, policy_version 1551616 (0.0010) [2023-12-26 11:59:03,158][123091] Updated weights for policy 0, policy_version 1551626 (0.0009) [2023-12-26 11:59:03,377][123090] Updated weights for policy 1, policy_version 1541382 (0.0008) [2023-12-26 11:59:03,434][123090] Updated weights for policy 1, policy_version 1541393 (0.0010) [2023-12-26 11:59:03,488][123090] Updated weights for policy 1, policy_version 1541403 (0.0010) [2023-12-26 11:59:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 791822336. Throughput: 0: 8894.3, 1: 8789.8. Samples: 791834432. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:03,785][121949] Avg episode reward: [(0, '6221.162'), (1, '5338.944')] [2023-12-26 11:59:03,854][123091] Updated weights for policy 0, policy_version 1551636 (0.0009) [2023-12-26 11:59:03,918][123091] Updated weights for policy 0, policy_version 1551646 (0.0008) [2023-12-26 11:59:03,987][123091] Updated weights for policy 0, policy_version 1551656 (0.0008) [2023-12-26 11:59:04,247][123090] Updated weights for policy 1, policy_version 1541413 (0.0008) [2023-12-26 11:59:04,305][123090] Updated weights for policy 1, policy_version 1541423 (0.0005) [2023-12-26 11:59:04,367][123090] Updated weights for policy 1, policy_version 1541433 (0.0008) [2023-12-26 11:59:04,750][123091] Updated weights for policy 0, policy_version 1551666 (0.0008) [2023-12-26 11:59:04,810][123091] Updated weights for policy 0, policy_version 1551676 (0.0009) [2023-12-26 11:59:04,870][123091] Updated weights for policy 0, policy_version 1551686 (0.0009) [2023-12-26 11:59:04,934][123091] Updated weights for policy 0, policy_version 1551696 (0.0009) [2023-12-26 11:59:05,107][123090] Updated weights for policy 1, policy_version 1541443 (0.0009) [2023-12-26 11:59:05,158][123090] Updated weights for policy 1, policy_version 1541453 (0.0009) [2023-12-26 11:59:05,211][123090] Updated weights for policy 1, policy_version 1541463 (0.0009) [2023-12-26 11:59:05,734][123091] Updated weights for policy 0, policy_version 1551706 (0.0009) [2023-12-26 11:59:05,786][123091] Updated weights for policy 0, policy_version 1551716 (0.0009) [2023-12-26 11:59:05,842][123091] Updated weights for policy 0, policy_version 1551726 (0.0009) [2023-12-26 11:59:06,051][123090] Updated weights for policy 1, policy_version 1541473 (0.0009) [2023-12-26 11:59:06,116][123090] Updated weights for policy 1, policy_version 1541483 (0.0009) [2023-12-26 11:59:06,189][123090] Updated weights for policy 1, policy_version 1541493 (0.0009) [2023-12-26 11:59:06,259][123090] Updated weights for policy 1, policy_version 1541503 (0.0007) [2023-12-26 11:59:06,674][123091] Updated weights for policy 0, policy_version 1551736 (0.0009) [2023-12-26 11:59:06,726][123091] Updated weights for policy 0, policy_version 1551746 (0.0010) [2023-12-26 11:59:06,784][123091] Updated weights for policy 0, policy_version 1551756 (0.0008) [2023-12-26 11:59:07,099][123090] Updated weights for policy 1, policy_version 1541513 (0.0010) [2023-12-26 11:59:07,160][123090] Updated weights for policy 1, policy_version 1541523 (0.0009) [2023-12-26 11:59:07,224][123090] Updated weights for policy 1, policy_version 1541533 (0.0009) [2023-12-26 11:59:07,634][123091] Updated weights for policy 0, policy_version 1551766 (0.0008) [2023-12-26 11:59:07,685][123091] Updated weights for policy 0, policy_version 1551776 (0.0005) [2023-12-26 11:59:07,744][123091] Updated weights for policy 0, policy_version 1551786 (0.0006) [2023-12-26 11:59:08,094][123090] Updated weights for policy 1, policy_version 1541543 (0.0008) [2023-12-26 11:59:08,153][123090] Updated weights for policy 1, policy_version 1541553 (0.0009) [2023-12-26 11:59:08,214][123090] Updated weights for policy 1, policy_version 1541563 (0.0009) [2023-12-26 11:59:08,399][123091] Updated weights for policy 0, policy_version 1551796 (0.0005) [2023-12-26 11:59:08,460][123091] Updated weights for policy 0, policy_version 1551806 (0.0007) [2023-12-26 11:59:08,518][123091] Updated weights for policy 0, policy_version 1551816 (0.0005) [2023-12-26 11:59:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 791912448. Throughput: 0: 8955.2, 1: 8803.8. Samples: 791888452. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:08,785][121949] Avg episode reward: [(0, '5982.755'), (1, '5417.572')] [2023-12-26 11:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001551824_397271040.pth... [2023-12-26 11:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001541568_394641408.pth... [2023-12-26 11:59:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001540576_394387456.pth [2023-12-26 11:59:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001550768_397000704.pth [2023-12-26 11:59:08,951][123090] Updated weights for policy 1, policy_version 1541573 (0.0006) [2023-12-26 11:59:09,026][123090] Updated weights for policy 1, policy_version 1541583 (0.0006) [2023-12-26 11:59:09,092][123090] Updated weights for policy 1, policy_version 1541593 (0.0008) [2023-12-26 11:59:09,173][123091] Updated weights for policy 0, policy_version 1551826 (0.0006) [2023-12-26 11:59:09,246][123091] Updated weights for policy 0, policy_version 1551836 (0.0011) [2023-12-26 11:59:09,312][123091] Updated weights for policy 0, policy_version 1551846 (0.0011) [2023-12-26 11:59:09,385][123091] Updated weights for policy 0, policy_version 1551856 (0.0012) [2023-12-26 11:59:09,861][123090] Updated weights for policy 1, policy_version 1541603 (0.0007) [2023-12-26 11:59:09,928][123090] Updated weights for policy 1, policy_version 1541613 (0.0008) [2023-12-26 11:59:10,000][123090] Updated weights for policy 1, policy_version 1541623 (0.0010) [2023-12-26 11:59:10,224][123091] Updated weights for policy 0, policy_version 1551866 (0.0009) [2023-12-26 11:59:10,289][123091] Updated weights for policy 0, policy_version 1551876 (0.0005) [2023-12-26 11:59:10,362][123091] Updated weights for policy 0, policy_version 1551886 (0.0009) [2023-12-26 11:59:10,751][123090] Updated weights for policy 1, policy_version 1541633 (0.0009) [2023-12-26 11:59:10,831][123090] Updated weights for policy 1, policy_version 1541643 (0.0006) [2023-12-26 11:59:10,900][123090] Updated weights for policy 1, policy_version 1541653 (0.0006) [2023-12-26 11:59:10,976][123090] Updated weights for policy 1, policy_version 1541663 (0.0005) [2023-12-26 11:59:11,175][123091] Updated weights for policy 0, policy_version 1551896 (0.0009) [2023-12-26 11:59:11,238][123091] Updated weights for policy 0, policy_version 1551906 (0.0008) [2023-12-26 11:59:11,300][123091] Updated weights for policy 0, policy_version 1551916 (0.0008) [2023-12-26 11:59:11,757][123090] Updated weights for policy 1, policy_version 1541673 (0.0008) [2023-12-26 11:59:11,831][123090] Updated weights for policy 1, policy_version 1541683 (0.0008) [2023-12-26 11:59:11,900][123090] Updated weights for policy 1, policy_version 1541693 (0.0010) [2023-12-26 11:59:12,066][123091] Updated weights for policy 0, policy_version 1551926 (0.0009) [2023-12-26 11:59:12,124][123091] Updated weights for policy 0, policy_version 1551936 (0.0010) [2023-12-26 11:59:12,174][123091] Updated weights for policy 0, policy_version 1551946 (0.0009) [2023-12-26 11:59:12,704][123090] Updated weights for policy 1, policy_version 1541703 (0.0008) [2023-12-26 11:59:12,776][123090] Updated weights for policy 1, policy_version 1541713 (0.0009) [2023-12-26 11:59:12,837][123090] Updated weights for policy 1, policy_version 1541723 (0.0009) [2023-12-26 11:59:13,067][123091] Updated weights for policy 0, policy_version 1551956 (0.0009) [2023-12-26 11:59:13,122][123091] Updated weights for policy 0, policy_version 1551966 (0.0009) [2023-12-26 11:59:13,175][123091] Updated weights for policy 0, policy_version 1551977 (0.0010) [2023-12-26 11:59:13,641][123090] Updated weights for policy 1, policy_version 1541733 (0.0010) [2023-12-26 11:59:13,704][123090] Updated weights for policy 1, policy_version 1541743 (0.0009) [2023-12-26 11:59:13,764][123090] Updated weights for policy 1, policy_version 1541753 (0.0009) [2023-12-26 11:59:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 791994368. Throughput: 0: 8885.7, 1: 8752.0. Samples: 791993872. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:13,785][121949] Avg episode reward: [(0, '5917.043'), (1, '5315.498')] [2023-12-26 11:59:14,003][123091] Updated weights for policy 0, policy_version 1551987 (0.0009) [2023-12-26 11:59:14,055][123091] Updated weights for policy 0, policy_version 1551997 (0.0009) [2023-12-26 11:59:14,121][123091] Updated weights for policy 0, policy_version 1552007 (0.0009) [2023-12-26 11:59:14,525][123090] Updated weights for policy 1, policy_version 1541763 (0.0010) [2023-12-26 11:59:14,589][123090] Updated weights for policy 1, policy_version 1541773 (0.0009) [2023-12-26 11:59:14,644][123090] Updated weights for policy 1, policy_version 1541783 (0.0009) [2023-12-26 11:59:14,992][123091] Updated weights for policy 0, policy_version 1552017 (0.0009) [2023-12-26 11:59:15,056][123091] Updated weights for policy 0, policy_version 1552027 (0.0010) [2023-12-26 11:59:15,122][123091] Updated weights for policy 0, policy_version 1552037 (0.0010) [2023-12-26 11:59:15,189][123091] Updated weights for policy 0, policy_version 1552047 (0.0010) [2023-12-26 11:59:15,395][123090] Updated weights for policy 1, policy_version 1541793 (0.0008) [2023-12-26 11:59:15,453][123090] Updated weights for policy 1, policy_version 1541803 (0.0006) [2023-12-26 11:59:15,519][123090] Updated weights for policy 1, policy_version 1541813 (0.0009) [2023-12-26 11:59:15,567][123090] Updated weights for policy 1, policy_version 1541823 (0.0009) [2023-12-26 11:59:16,079][123091] Updated weights for policy 0, policy_version 1552057 (0.0008) [2023-12-26 11:59:16,128][123091] Updated weights for policy 0, policy_version 1552067 (0.0008) [2023-12-26 11:59:16,185][123091] Updated weights for policy 0, policy_version 1552077 (0.0010) [2023-12-26 11:59:16,304][123090] Updated weights for policy 1, policy_version 1541833 (0.0006) [2023-12-26 11:59:16,357][123090] Updated weights for policy 1, policy_version 1541843 (0.0005) [2023-12-26 11:59:16,406][123090] Updated weights for policy 1, policy_version 1541853 (0.0005) [2023-12-26 11:59:17,062][123091] Updated weights for policy 0, policy_version 1552087 (0.0009) [2023-12-26 11:59:17,116][123090] Updated weights for policy 1, policy_version 1541863 (0.0006) [2023-12-26 11:59:17,125][123091] Updated weights for policy 0, policy_version 1552097 (0.0009) [2023-12-26 11:59:17,164][123090] Updated weights for policy 1, policy_version 1541873 (0.0006) [2023-12-26 11:59:17,187][123091] Updated weights for policy 0, policy_version 1552107 (0.0009) [2023-12-26 11:59:17,212][123090] Updated weights for policy 1, policy_version 1541883 (0.0006) [2023-12-26 11:59:17,900][123090] Updated weights for policy 1, policy_version 1541893 (0.0005) [2023-12-26 11:59:17,949][123090] Updated weights for policy 1, policy_version 1541903 (0.0005) [2023-12-26 11:59:18,009][123090] Updated weights for policy 1, policy_version 1541913 (0.0006) [2023-12-26 11:59:18,080][123091] Updated weights for policy 0, policy_version 1552117 (0.0009) [2023-12-26 11:59:18,139][123091] Updated weights for policy 0, policy_version 1552127 (0.0009) [2023-12-26 11:59:18,197][123091] Updated weights for policy 0, policy_version 1552137 (0.0010) [2023-12-26 11:59:18,752][123090] Updated weights for policy 1, policy_version 1541923 (0.0007) [2023-12-26 11:59:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 792084480. Throughput: 0: 8811.9, 1: 8764.3. Samples: 792100052. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:18,785][121949] Avg episode reward: [(0, '6131.086'), (1, '5257.842')] [2023-12-26 11:59:18,816][123090] Updated weights for policy 1, policy_version 1541933 (0.0011) [2023-12-26 11:59:18,869][123090] Updated weights for policy 1, policy_version 1541943 (0.0010) [2023-12-26 11:59:19,081][123091] Updated weights for policy 0, policy_version 1552147 (0.0009) [2023-12-26 11:59:19,140][123091] Updated weights for policy 0, policy_version 1552157 (0.0009) [2023-12-26 11:59:19,193][123091] Updated weights for policy 0, policy_version 1552167 (0.0009) [2023-12-26 11:59:19,713][123090] Updated weights for policy 1, policy_version 1541953 (0.0011) [2023-12-26 11:59:19,789][123090] Updated weights for policy 1, policy_version 1541963 (0.0011) [2023-12-26 11:59:19,860][123090] Updated weights for policy 1, policy_version 1541973 (0.0010) [2023-12-26 11:59:19,925][123091] Updated weights for policy 0, policy_version 1552177 (0.0009) [2023-12-26 11:59:19,925][123090] Updated weights for policy 1, policy_version 1541983 (0.0011) [2023-12-26 11:59:19,992][123091] Updated weights for policy 0, policy_version 1552187 (0.0009) [2023-12-26 11:59:20,065][123091] Updated weights for policy 0, policy_version 1552197 (0.0008) [2023-12-26 11:59:20,129][123091] Updated weights for policy 0, policy_version 1552207 (0.0008) [2023-12-26 11:59:20,765][123090] Updated weights for policy 1, policy_version 1541993 (0.0010) [2023-12-26 11:59:20,842][123090] Updated weights for policy 1, policy_version 1542003 (0.0010) [2023-12-26 11:59:20,889][123091] Updated weights for policy 0, policy_version 1552217 (0.0010) [2023-12-26 11:59:20,909][123090] Updated weights for policy 1, policy_version 1542013 (0.0006) [2023-12-26 11:59:20,954][123091] Updated weights for policy 0, policy_version 1552227 (0.0008) [2023-12-26 11:59:21,027][123091] Updated weights for policy 0, policy_version 1552237 (0.0007) [2023-12-26 11:59:21,795][123091] Updated weights for policy 0, policy_version 1552247 (0.0009) [2023-12-26 11:59:21,802][123090] Updated weights for policy 1, policy_version 1542023 (0.0008) [2023-12-26 11:59:21,862][123091] Updated weights for policy 0, policy_version 1552257 (0.0007) [2023-12-26 11:59:21,864][123090] Updated weights for policy 1, policy_version 1542033 (0.0010) [2023-12-26 11:59:21,927][123091] Updated weights for policy 0, policy_version 1552267 (0.0006) [2023-12-26 11:59:21,934][123090] Updated weights for policy 1, policy_version 1542043 (0.0010) [2023-12-26 11:59:22,744][123091] Updated weights for policy 0, policy_version 1552277 (0.0009) [2023-12-26 11:59:22,769][123090] Updated weights for policy 1, policy_version 1542053 (0.0010) [2023-12-26 11:59:22,807][123091] Updated weights for policy 0, policy_version 1552287 (0.0011) [2023-12-26 11:59:22,837][123090] Updated weights for policy 1, policy_version 1542063 (0.0011) [2023-12-26 11:59:22,874][123091] Updated weights for policy 0, policy_version 1552297 (0.0007) [2023-12-26 11:59:22,897][123090] Updated weights for policy 1, policy_version 1542073 (0.0011) [2023-12-26 11:59:23,640][123091] Updated weights for policy 0, policy_version 1552307 (0.0007) [2023-12-26 11:59:23,691][123091] Updated weights for policy 0, policy_version 1552317 (0.0009) [2023-12-26 11:59:23,730][123090] Updated weights for policy 1, policy_version 1542083 (0.0011) [2023-12-26 11:59:23,745][123091] Updated weights for policy 0, policy_version 1552327 (0.0010) [2023-12-26 11:59:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 792166400. Throughput: 0: 8869.3, 1: 8688.7. Samples: 792151024. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:23,785][121949] Avg episode reward: [(0, '6133.134'), (1, '5148.909')] [2023-12-26 11:59:23,789][123090] Updated weights for policy 1, policy_version 1542093 (0.0010) [2023-12-26 11:59:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001552336_397402112.pth... [2023-12-26 11:59:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001551280_397131776.pth [2023-12-26 11:59:23,847][123090] Updated weights for policy 1, policy_version 1542103 (0.0010) [2023-12-26 11:59:23,889][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001542112_394780672.pth... [2023-12-26 11:59:23,892][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001541056_394510336.pth [2023-12-26 11:59:24,469][123091] Updated weights for policy 0, policy_version 1552337 (0.0010) [2023-12-26 11:59:24,523][123091] Updated weights for policy 0, policy_version 1552347 (0.0006) [2023-12-26 11:59:24,578][123091] Updated weights for policy 0, policy_version 1552357 (0.0006) [2023-12-26 11:59:24,653][123091] Updated weights for policy 0, policy_version 1552367 (0.0006) [2023-12-26 11:59:24,660][123090] Updated weights for policy 1, policy_version 1542113 (0.0010) [2023-12-26 11:59:24,728][123090] Updated weights for policy 1, policy_version 1542123 (0.0011) [2023-12-26 11:59:24,788][123090] Updated weights for policy 1, policy_version 1542133 (0.0010) [2023-12-26 11:59:24,847][123090] Updated weights for policy 1, policy_version 1542143 (0.0010) [2023-12-26 11:59:25,333][123091] Updated weights for policy 0, policy_version 1552377 (0.0008) [2023-12-26 11:59:25,392][123091] Updated weights for policy 0, policy_version 1552387 (0.0009) [2023-12-26 11:59:25,463][123091] Updated weights for policy 0, policy_version 1552397 (0.0005) [2023-12-26 11:59:25,648][123090] Updated weights for policy 1, policy_version 1542153 (0.0010) [2023-12-26 11:59:25,696][123090] Updated weights for policy 1, policy_version 1542163 (0.0010) [2023-12-26 11:59:25,747][123090] Updated weights for policy 1, policy_version 1542173 (0.0010) [2023-12-26 11:59:26,125][123091] Updated weights for policy 0, policy_version 1552407 (0.0009) [2023-12-26 11:59:26,183][123091] Updated weights for policy 0, policy_version 1552417 (0.0010) [2023-12-26 11:59:26,241][123091] Updated weights for policy 0, policy_version 1552427 (0.0010) [2023-12-26 11:59:26,500][123090] Updated weights for policy 1, policy_version 1542183 (0.0007) [2023-12-26 11:59:26,569][123090] Updated weights for policy 1, policy_version 1542193 (0.0005) [2023-12-26 11:59:26,635][123090] Updated weights for policy 1, policy_version 1542203 (0.0005) [2023-12-26 11:59:27,154][123091] Updated weights for policy 0, policy_version 1552437 (0.0009) [2023-12-26 11:59:27,211][123091] Updated weights for policy 0, policy_version 1552447 (0.0009) [2023-12-26 11:59:27,274][123091] Updated weights for policy 0, policy_version 1552457 (0.0010) [2023-12-26 11:59:27,335][123090] Updated weights for policy 1, policy_version 1542213 (0.0007) [2023-12-26 11:59:27,399][123090] Updated weights for policy 1, policy_version 1542223 (0.0009) [2023-12-26 11:59:27,455][123090] Updated weights for policy 1, policy_version 1542233 (0.0009) [2023-12-26 11:59:28,014][123091] Updated weights for policy 0, policy_version 1552467 (0.0010) [2023-12-26 11:59:28,070][123091] Updated weights for policy 0, policy_version 1552477 (0.0009) [2023-12-26 11:59:28,136][123091] Updated weights for policy 0, policy_version 1552487 (0.0010) [2023-12-26 11:59:28,310][123090] Updated weights for policy 1, policy_version 1542243 (0.0006) [2023-12-26 11:59:28,382][123090] Updated weights for policy 1, policy_version 1542253 (0.0009) [2023-12-26 11:59:28,445][123090] Updated weights for policy 1, policy_version 1542263 (0.0009) [2023-12-26 11:59:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 792264704. Throughput: 0: 8987.5, 1: 8720.8. Samples: 792259600. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:28,785][121949] Avg episode reward: [(0, '6220.459'), (1, '4906.809')] [2023-12-26 11:59:28,974][123091] Updated weights for policy 0, policy_version 1552497 (0.0010) [2023-12-26 11:59:29,026][123091] Updated weights for policy 0, policy_version 1552507 (0.0009) [2023-12-26 11:59:29,081][123091] Updated weights for policy 0, policy_version 1552517 (0.0009) [2023-12-26 11:59:29,133][123091] Updated weights for policy 0, policy_version 1552527 (0.0009) [2023-12-26 11:59:29,271][123090] Updated weights for policy 1, policy_version 1542273 (0.0009) [2023-12-26 11:59:29,336][123090] Updated weights for policy 1, policy_version 1542283 (0.0009) [2023-12-26 11:59:29,395][123090] Updated weights for policy 1, policy_version 1542293 (0.0009) [2023-12-26 11:59:29,446][123090] Updated weights for policy 1, policy_version 1542303 (0.0009) [2023-12-26 11:59:29,926][123091] Updated weights for policy 0, policy_version 1552537 (0.0009) [2023-12-26 11:59:29,991][123091] Updated weights for policy 0, policy_version 1552547 (0.0009) [2023-12-26 11:59:30,054][123091] Updated weights for policy 0, policy_version 1552557 (0.0010) [2023-12-26 11:59:30,348][123090] Updated weights for policy 1, policy_version 1542313 (0.0009) [2023-12-26 11:59:30,407][123090] Updated weights for policy 1, policy_version 1542323 (0.0009) [2023-12-26 11:59:30,470][123090] Updated weights for policy 1, policy_version 1542333 (0.0008) [2023-12-26 11:59:30,896][123091] Updated weights for policy 0, policy_version 1552567 (0.0010) [2023-12-26 11:59:30,953][123091] Updated weights for policy 0, policy_version 1552577 (0.0010) [2023-12-26 11:59:30,999][123091] Updated weights for policy 0, policy_version 1552587 (0.0008) [2023-12-26 11:59:31,322][123090] Updated weights for policy 1, policy_version 1542343 (0.0009) [2023-12-26 11:59:31,396][123090] Updated weights for policy 1, policy_version 1542353 (0.0010) [2023-12-26 11:59:31,458][123090] Updated weights for policy 1, policy_version 1542363 (0.0010) [2023-12-26 11:59:31,754][123091] Updated weights for policy 0, policy_version 1552597 (0.0010) [2023-12-26 11:59:31,809][123091] Updated weights for policy 0, policy_version 1552607 (0.0009) [2023-12-26 11:59:31,859][123091] Updated weights for policy 0, policy_version 1552618 (0.0009) [2023-12-26 11:59:32,342][123090] Updated weights for policy 1, policy_version 1542373 (0.0010) [2023-12-26 11:59:32,401][123090] Updated weights for policy 1, policy_version 1542383 (0.0009) [2023-12-26 11:59:32,465][123090] Updated weights for policy 1, policy_version 1542393 (0.0010) [2023-12-26 11:59:32,551][123091] Updated weights for policy 0, policy_version 1552628 (0.0007) [2023-12-26 11:59:32,612][123091] Updated weights for policy 0, policy_version 1552638 (0.0009) [2023-12-26 11:59:32,666][123091] Updated weights for policy 0, policy_version 1552648 (0.0010) [2023-12-26 11:59:33,334][123091] Updated weights for policy 0, policy_version 1552658 (0.0009) [2023-12-26 11:59:33,374][123090] Updated weights for policy 1, policy_version 1542403 (0.0010) [2023-12-26 11:59:33,383][123091] Updated weights for policy 0, policy_version 1552668 (0.0005) [2023-12-26 11:59:33,429][123091] Updated weights for policy 0, policy_version 1552678 (0.0005) [2023-12-26 11:59:33,434][123090] Updated weights for policy 1, policy_version 1542413 (0.0009) [2023-12-26 11:59:33,482][123091] Updated weights for policy 0, policy_version 1552688 (0.0005) [2023-12-26 11:59:33,485][123090] Updated weights for policy 1, policy_version 1542423 (0.0010) [2023-12-26 11:59:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 792354816. Throughput: 0: 8965.5, 1: 8694.8. Samples: 792363844. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:33,785][121949] Avg episode reward: [(0, '6265.124'), (1, '4728.833')] [2023-12-26 11:59:34,091][123091] Updated weights for policy 0, policy_version 1552698 (0.0005) [2023-12-26 11:59:34,155][123091] Updated weights for policy 0, policy_version 1552708 (0.0006) [2023-12-26 11:59:34,174][123090] Updated weights for policy 1, policy_version 1542433 (0.0010) [2023-12-26 11:59:34,213][123091] Updated weights for policy 0, policy_version 1552718 (0.0008) [2023-12-26 11:59:34,239][123090] Updated weights for policy 1, policy_version 1542443 (0.0007) [2023-12-26 11:59:34,303][123090] Updated weights for policy 1, policy_version 1542453 (0.0010) [2023-12-26 11:59:34,371][123090] Updated weights for policy 1, policy_version 1542463 (0.0009) [2023-12-26 11:59:34,925][123091] Updated weights for policy 0, policy_version 1552728 (0.0006) [2023-12-26 11:59:34,978][123091] Updated weights for policy 0, policy_version 1552738 (0.0005) [2023-12-26 11:59:35,037][123091] Updated weights for policy 0, policy_version 1552748 (0.0007) [2023-12-26 11:59:35,245][123090] Updated weights for policy 1, policy_version 1542473 (0.0010) [2023-12-26 11:59:35,307][123090] Updated weights for policy 1, policy_version 1542483 (0.0010) [2023-12-26 11:59:35,370][123090] Updated weights for policy 1, policy_version 1542493 (0.0009) [2023-12-26 11:59:35,674][123091] Updated weights for policy 0, policy_version 1552758 (0.0007) [2023-12-26 11:59:35,742][123091] Updated weights for policy 0, policy_version 1552768 (0.0008) [2023-12-26 11:59:35,796][123091] Updated weights for policy 0, policy_version 1552778 (0.0008) [2023-12-26 11:59:36,199][123090] Updated weights for policy 1, policy_version 1542503 (0.0008) [2023-12-26 11:59:36,256][123090] Updated weights for policy 1, policy_version 1542513 (0.0008) [2023-12-26 11:59:36,302][123090] Updated weights for policy 1, policy_version 1542523 (0.0008) [2023-12-26 11:59:36,487][123091] Updated weights for policy 0, policy_version 1552788 (0.0007) [2023-12-26 11:59:36,551][123091] Updated weights for policy 0, policy_version 1552798 (0.0011) [2023-12-26 11:59:36,619][123091] Updated weights for policy 0, policy_version 1552808 (0.0011) [2023-12-26 11:59:37,174][123090] Updated weights for policy 1, policy_version 1542533 (0.0009) [2023-12-26 11:59:37,231][123090] Updated weights for policy 1, policy_version 1542543 (0.0010) [2023-12-26 11:59:37,287][123090] Updated weights for policy 1, policy_version 1542553 (0.0011) [2023-12-26 11:59:37,422][123091] Updated weights for policy 0, policy_version 1552818 (0.0010) [2023-12-26 11:59:37,497][123091] Updated weights for policy 0, policy_version 1552828 (0.0011) [2023-12-26 11:59:37,567][123091] Updated weights for policy 0, policy_version 1552838 (0.0011) [2023-12-26 11:59:37,645][123091] Updated weights for policy 0, policy_version 1552848 (0.0010) [2023-12-26 11:59:38,037][123090] Updated weights for policy 1, policy_version 1542563 (0.0011) [2023-12-26 11:59:38,094][123090] Updated weights for policy 1, policy_version 1542573 (0.0011) [2023-12-26 11:59:38,150][123090] Updated weights for policy 1, policy_version 1542583 (0.0011) [2023-12-26 11:59:38,464][123091] Updated weights for policy 0, policy_version 1552858 (0.0011) [2023-12-26 11:59:38,520][123091] Updated weights for policy 0, policy_version 1552868 (0.0010) [2023-12-26 11:59:38,573][123091] Updated weights for policy 0, policy_version 1552878 (0.0010) [2023-12-26 11:59:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 792444928. Throughput: 0: 9061.6, 1: 8732.3. Samples: 792420312. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:38,784][121949] Avg episode reward: [(0, '6393.174'), (1, '4754.423')] [2023-12-26 11:59:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001552880_397541376.pth... [2023-12-26 11:59:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001542592_394903552.pth... [2023-12-26 11:59:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001541568_394641408.pth [2023-12-26 11:59:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001551824_397271040.pth [2023-12-26 11:59:38,973][123090] Updated weights for policy 1, policy_version 1542593 (0.0010) [2023-12-26 11:59:39,033][123090] Updated weights for policy 1, policy_version 1542603 (0.0011) [2023-12-26 11:59:39,092][123090] Updated weights for policy 1, policy_version 1542613 (0.0009) [2023-12-26 11:59:39,151][123090] Updated weights for policy 1, policy_version 1542623 (0.0006) [2023-12-26 11:59:39,451][123091] Updated weights for policy 0, policy_version 1552888 (0.0011) [2023-12-26 11:59:39,520][123091] Updated weights for policy 0, policy_version 1552898 (0.0009) [2023-12-26 11:59:39,594][123091] Updated weights for policy 0, policy_version 1552908 (0.0009) [2023-12-26 11:59:39,951][123090] Updated weights for policy 1, policy_version 1542633 (0.0009) [2023-12-26 11:59:40,019][123090] Updated weights for policy 1, policy_version 1542643 (0.0011) [2023-12-26 11:59:40,079][123090] Updated weights for policy 1, policy_version 1542653 (0.0010) [2023-12-26 11:59:40,387][123091] Updated weights for policy 0, policy_version 1552918 (0.0009) [2023-12-26 11:59:40,436][123091] Updated weights for policy 0, policy_version 1552928 (0.0011) [2023-12-26 11:59:40,484][123091] Updated weights for policy 0, policy_version 1552938 (0.0011) [2023-12-26 11:59:40,908][123090] Updated weights for policy 1, policy_version 1542663 (0.0010) [2023-12-26 11:59:40,967][123090] Updated weights for policy 1, policy_version 1542673 (0.0010) [2023-12-26 11:59:41,037][123090] Updated weights for policy 1, policy_version 1542683 (0.0010) [2023-12-26 11:59:41,343][123091] Updated weights for policy 0, policy_version 1552948 (0.0010) [2023-12-26 11:59:41,415][123091] Updated weights for policy 0, policy_version 1552958 (0.0009) [2023-12-26 11:59:41,474][123091] Updated weights for policy 0, policy_version 1552968 (0.0009) [2023-12-26 11:59:41,860][123090] Updated weights for policy 1, policy_version 1542693 (0.0008) [2023-12-26 11:59:41,928][123090] Updated weights for policy 1, policy_version 1542703 (0.0008) [2023-12-26 11:59:42,000][123090] Updated weights for policy 1, policy_version 1542713 (0.0008) [2023-12-26 11:59:42,315][123091] Updated weights for policy 0, policy_version 1552978 (0.0009) [2023-12-26 11:59:42,384][123091] Updated weights for policy 0, policy_version 1552988 (0.0009) [2023-12-26 11:59:42,454][123091] Updated weights for policy 0, policy_version 1552998 (0.0010) [2023-12-26 11:59:42,524][123091] Updated weights for policy 0, policy_version 1553008 (0.0009) [2023-12-26 11:59:42,737][123090] Updated weights for policy 1, policy_version 1542723 (0.0009) [2023-12-26 11:59:42,804][123090] Updated weights for policy 1, policy_version 1542733 (0.0010) [2023-12-26 11:59:42,872][123090] Updated weights for policy 1, policy_version 1542743 (0.0009) [2023-12-26 11:59:43,361][123091] Updated weights for policy 0, policy_version 1553018 (0.0010) [2023-12-26 11:59:43,433][123091] Updated weights for policy 0, policy_version 1553028 (0.0009) [2023-12-26 11:59:43,502][123091] Updated weights for policy 0, policy_version 1553038 (0.0009) [2023-12-26 11:59:43,706][123090] Updated weights for policy 1, policy_version 1542753 (0.0010) [2023-12-26 11:59:43,762][123090] Updated weights for policy 1, policy_version 1542763 (0.0009) [2023-12-26 11:59:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 792526848. Throughput: 0: 8926.9, 1: 8754.8. Samples: 792523696. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:43,785][121949] Avg episode reward: [(0, '6402.268'), (1, '5098.614')] [2023-12-26 11:59:43,812][123090] Updated weights for policy 1, policy_version 1542773 (0.0009) [2023-12-26 11:59:43,863][123090] Updated weights for policy 1, policy_version 1542783 (0.0008) [2023-12-26 11:59:44,291][123091] Updated weights for policy 0, policy_version 1553048 (0.0006) [2023-12-26 11:59:44,364][123091] Updated weights for policy 0, policy_version 1553058 (0.0006) [2023-12-26 11:59:44,443][123091] Updated weights for policy 0, policy_version 1553068 (0.0010) [2023-12-26 11:59:44,713][123090] Updated weights for policy 1, policy_version 1542793 (0.0010) [2023-12-26 11:59:44,781][123090] Updated weights for policy 1, policy_version 1542803 (0.0009) [2023-12-26 11:59:44,840][123090] Updated weights for policy 1, policy_version 1542813 (0.0010) [2023-12-26 11:59:45,118][123091] Updated weights for policy 0, policy_version 1553078 (0.0007) [2023-12-26 11:59:45,170][123091] Updated weights for policy 0, policy_version 1553088 (0.0005) [2023-12-26 11:59:45,219][123091] Updated weights for policy 0, policy_version 1553098 (0.0005) [2023-12-26 11:59:45,634][123090] Updated weights for policy 1, policy_version 1542823 (0.0007) [2023-12-26 11:59:45,702][123090] Updated weights for policy 1, policy_version 1542833 (0.0005) [2023-12-26 11:59:45,753][123090] Updated weights for policy 1, policy_version 1542843 (0.0005) [2023-12-26 11:59:45,920][123091] Updated weights for policy 0, policy_version 1553108 (0.0006) [2023-12-26 11:59:45,967][123091] Updated weights for policy 0, policy_version 1553118 (0.0005) [2023-12-26 11:59:46,013][123091] Updated weights for policy 0, policy_version 1553128 (0.0005) [2023-12-26 11:59:46,380][123090] Updated weights for policy 1, policy_version 1542853 (0.0005) [2023-12-26 11:59:46,435][123090] Updated weights for policy 1, policy_version 1542863 (0.0005) [2023-12-26 11:59:46,482][123090] Updated weights for policy 1, policy_version 1542873 (0.0005) [2023-12-26 11:59:46,686][123091] Updated weights for policy 0, policy_version 1553138 (0.0005) [2023-12-26 11:59:46,735][123091] Updated weights for policy 0, policy_version 1553148 (0.0005) [2023-12-26 11:59:46,788][123091] Updated weights for policy 0, policy_version 1553158 (0.0006) [2023-12-26 11:59:46,851][123091] Updated weights for policy 0, policy_version 1553168 (0.0005) [2023-12-26 11:59:47,147][123090] Updated weights for policy 1, policy_version 1542883 (0.0005) [2023-12-26 11:59:47,213][123090] Updated weights for policy 1, policy_version 1542893 (0.0006) [2023-12-26 11:59:47,283][123090] Updated weights for policy 1, policy_version 1542903 (0.0005) [2023-12-26 11:59:47,538][123091] Updated weights for policy 0, policy_version 1553178 (0.0005) [2023-12-26 11:59:47,590][123091] Updated weights for policy 0, policy_version 1553188 (0.0005) [2023-12-26 11:59:47,650][123091] Updated weights for policy 0, policy_version 1553198 (0.0005) [2023-12-26 11:59:48,005][123090] Updated weights for policy 1, policy_version 1542913 (0.0006) [2023-12-26 11:59:48,059][123090] Updated weights for policy 1, policy_version 1542923 (0.0009) [2023-12-26 11:59:48,113][123090] Updated weights for policy 1, policy_version 1542933 (0.0009) [2023-12-26 11:59:48,173][123090] Updated weights for policy 1, policy_version 1542943 (0.0010) [2023-12-26 11:59:48,401][123091] Updated weights for policy 0, policy_version 1553208 (0.0009) [2023-12-26 11:59:48,464][123091] Updated weights for policy 0, policy_version 1553218 (0.0010) [2023-12-26 11:59:48,530][123091] Updated weights for policy 0, policy_version 1553228 (0.0009) [2023-12-26 11:59:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 792625152. Throughput: 0: 9001.4, 1: 8815.8. Samples: 792636208. Policy #0 lag: (min: 13.0, avg: 13.0, max: 15.0) [2023-12-26 11:59:48,785][121949] Avg episode reward: [(0, '6271.297'), (1, '5178.953')] [2023-12-26 11:59:49,029][123090] Updated weights for policy 1, policy_version 1542953 (0.0009) [2023-12-26 11:59:49,096][123090] Updated weights for policy 1, policy_version 1542963 (0.0009) [2023-12-26 11:59:49,149][123090] Updated weights for policy 1, policy_version 1542973 (0.0009) [2023-12-26 11:59:49,362][123091] Updated weights for policy 0, policy_version 1553238 (0.0010) [2023-12-26 11:59:49,415][123091] Updated weights for policy 0, policy_version 1553248 (0.0010) [2023-12-26 11:59:49,469][123091] Updated weights for policy 0, policy_version 1553258 (0.0010) [2023-12-26 11:59:49,790][123090] Updated weights for policy 1, policy_version 1542983 (0.0007) [2023-12-26 11:59:49,860][123090] Updated weights for policy 1, policy_version 1542993 (0.0006) [2023-12-26 11:59:49,937][123090] Updated weights for policy 1, policy_version 1543003 (0.0006) [2023-12-26 11:59:50,428][123091] Updated weights for policy 0, policy_version 1553268 (0.0009) [2023-12-26 11:59:50,488][123091] Updated weights for policy 0, policy_version 1553278 (0.0010) [2023-12-26 11:59:50,550][123091] Updated weights for policy 0, policy_version 1553288 (0.0010) [2023-12-26 11:59:50,657][123090] Updated weights for policy 1, policy_version 1543013 (0.0006) [2023-12-26 11:59:50,726][123090] Updated weights for policy 1, policy_version 1543023 (0.0007) [2023-12-26 11:59:50,791][123090] Updated weights for policy 1, policy_version 1543033 (0.0006) [2023-12-26 11:59:51,355][123091] Updated weights for policy 0, policy_version 1553298 (0.0011) [2023-12-26 11:59:51,438][123091] Updated weights for policy 0, policy_version 1553308 (0.0011) [2023-12-26 11:59:51,506][123091] Updated weights for policy 0, policy_version 1553318 (0.0011) [2023-12-26 11:59:51,576][123091] Updated weights for policy 0, policy_version 1553328 (0.0008) [2023-12-26 11:59:51,600][123090] Updated weights for policy 1, policy_version 1543043 (0.0007) [2023-12-26 11:59:51,673][123090] Updated weights for policy 1, policy_version 1543053 (0.0009) [2023-12-26 11:59:51,753][123090] Updated weights for policy 1, policy_version 1543063 (0.0010) [2023-12-26 11:59:52,356][123091] Updated weights for policy 0, policy_version 1553338 (0.0010) [2023-12-26 11:59:52,424][123091] Updated weights for policy 0, policy_version 1553348 (0.0009) [2023-12-26 11:59:52,495][123091] Updated weights for policy 0, policy_version 1553358 (0.0009) [2023-12-26 11:59:52,568][123090] Updated weights for policy 1, policy_version 1543073 (0.0009) [2023-12-26 11:59:52,616][123090] Updated weights for policy 1, policy_version 1543083 (0.0008) [2023-12-26 11:59:52,660][123090] Updated weights for policy 1, policy_version 1543093 (0.0008) [2023-12-26 11:59:52,708][123090] Updated weights for policy 1, policy_version 1543103 (0.0008) [2023-12-26 11:59:53,167][123091] Updated weights for policy 0, policy_version 1553368 (0.0009) [2023-12-26 11:59:53,222][123091] Updated weights for policy 0, policy_version 1553379 (0.0007) [2023-12-26 11:59:53,274][123091] Updated weights for policy 0, policy_version 1553389 (0.0005) [2023-12-26 11:59:53,601][123090] Updated weights for policy 1, policy_version 1543113 (0.0009) [2023-12-26 11:59:53,654][123090] Updated weights for policy 1, policy_version 1543123 (0.0009) [2023-12-26 11:59:53,705][123090] Updated weights for policy 1, policy_version 1543133 (0.0009) [2023-12-26 11:59:53,785][121949] Fps is (10 sec: 18841.0, 60 sec: 17885.7, 300 sec: 17689.1). Total num frames: 792715264. Throughput: 0: 8967.9, 1: 8805.5. Samples: 792688264. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 11:59:53,786][121949] Avg episode reward: [(0, '6209.879'), (1, '4875.398')] [2023-12-26 11:59:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001543136_395042816.pth... [2023-12-26 11:59:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001553392_397672448.pth... [2023-12-26 11:59:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001552336_397402112.pth [2023-12-26 11:59:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001542112_394780672.pth [2023-12-26 11:59:54,026][123091] Updated weights for policy 0, policy_version 1553399 (0.0008) [2023-12-26 11:59:54,083][123091] Updated weights for policy 0, policy_version 1553409 (0.0009) [2023-12-26 11:59:54,131][123091] Updated weights for policy 0, policy_version 1553419 (0.0009) [2023-12-26 11:59:54,570][123090] Updated weights for policy 1, policy_version 1543143 (0.0010) [2023-12-26 11:59:54,632][123090] Updated weights for policy 1, policy_version 1543153 (0.0011) [2023-12-26 11:59:54,702][123090] Updated weights for policy 1, policy_version 1543163 (0.0011) [2023-12-26 11:59:54,994][123091] Updated weights for policy 0, policy_version 1553429 (0.0009) [2023-12-26 11:59:55,052][123091] Updated weights for policy 0, policy_version 1553439 (0.0009) [2023-12-26 11:59:55,105][123091] Updated weights for policy 0, policy_version 1553449 (0.0009) [2023-12-26 11:59:55,531][123090] Updated weights for policy 1, policy_version 1543173 (0.0010) [2023-12-26 11:59:55,590][123090] Updated weights for policy 1, policy_version 1543183 (0.0010) [2023-12-26 11:59:55,652][123090] Updated weights for policy 1, policy_version 1543193 (0.0010) [2023-12-26 11:59:55,952][123091] Updated weights for policy 0, policy_version 1553459 (0.0009) [2023-12-26 11:59:56,020][123091] Updated weights for policy 0, policy_version 1553469 (0.0009) [2023-12-26 11:59:56,080][123091] Updated weights for policy 0, policy_version 1553479 (0.0009) [2023-12-26 11:59:56,483][123090] Updated weights for policy 1, policy_version 1543203 (0.0010) [2023-12-26 11:59:56,538][123090] Updated weights for policy 1, policy_version 1543213 (0.0010) [2023-12-26 11:59:56,594][123090] Updated weights for policy 1, policy_version 1543223 (0.0010) [2023-12-26 11:59:56,910][123091] Updated weights for policy 0, policy_version 1553489 (0.0009) [2023-12-26 11:59:56,958][123091] Updated weights for policy 0, policy_version 1553499 (0.0009) [2023-12-26 11:59:57,013][123091] Updated weights for policy 0, policy_version 1553509 (0.0009) [2023-12-26 11:59:57,073][123091] Updated weights for policy 0, policy_version 1553519 (0.0009) [2023-12-26 11:59:57,409][123090] Updated weights for policy 1, policy_version 1543233 (0.0010) [2023-12-26 11:59:57,460][123090] Updated weights for policy 1, policy_version 1543243 (0.0010) [2023-12-26 11:59:57,526][123090] Updated weights for policy 1, policy_version 1543253 (0.0010) [2023-12-26 11:59:57,578][123090] Updated weights for policy 1, policy_version 1543263 (0.0010) [2023-12-26 11:59:57,902][123091] Updated weights for policy 0, policy_version 1553529 (0.0009) [2023-12-26 11:59:57,962][123091] Updated weights for policy 0, policy_version 1553540 (0.0009) [2023-12-26 11:59:58,018][123091] Updated weights for policy 0, policy_version 1553550 (0.0009) [2023-12-26 11:59:58,423][123090] Updated weights for policy 1, policy_version 1543273 (0.0011) [2023-12-26 11:59:58,487][123090] Updated weights for policy 1, policy_version 1543283 (0.0011) [2023-12-26 11:59:58,550][123090] Updated weights for policy 1, policy_version 1543293 (0.0011) [2023-12-26 11:59:58,786][121949] Fps is (10 sec: 17200.4, 60 sec: 17748.8, 300 sec: 17689.1). Total num frames: 792797184. Throughput: 0: 8961.5, 1: 8769.5. Samples: 792791792. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 11:59:58,787][121949] Avg episode reward: [(0, '6161.069'), (1, '4945.173')] [2023-12-26 11:59:58,922][123091] Updated weights for policy 0, policy_version 1553560 (0.0009) [2023-12-26 11:59:58,985][123091] Updated weights for policy 0, policy_version 1553570 (0.0008) [2023-12-26 11:59:59,050][123091] Updated weights for policy 0, policy_version 1553580 (0.0008) [2023-12-26 11:59:59,519][123090] Updated weights for policy 1, policy_version 1543303 (0.0010) [2023-12-26 11:59:59,580][123090] Updated weights for policy 1, policy_version 1543313 (0.0010) [2023-12-26 11:59:59,646][123090] Updated weights for policy 1, policy_version 1543323 (0.0009) [2023-12-26 11:59:59,908][123091] Updated weights for policy 0, policy_version 1553590 (0.0008) [2023-12-26 11:59:59,986][123091] Updated weights for policy 0, policy_version 1553600 (0.0010) [2023-12-26 12:00:00,060][123091] Updated weights for policy 0, policy_version 1553610 (0.0009) [2023-12-26 12:00:00,395][123090] Updated weights for policy 1, policy_version 1543333 (0.0008) [2023-12-26 12:00:00,457][123090] Updated weights for policy 1, policy_version 1543343 (0.0007) [2023-12-26 12:00:00,520][123090] Updated weights for policy 1, policy_version 1543353 (0.0005) [2023-12-26 12:00:00,857][123091] Updated weights for policy 0, policy_version 1553620 (0.0008) [2023-12-26 12:00:00,916][123091] Updated weights for policy 0, policy_version 1553630 (0.0007) [2023-12-26 12:00:00,966][123091] Updated weights for policy 0, policy_version 1553640 (0.0009) [2023-12-26 12:00:01,216][123090] Updated weights for policy 1, policy_version 1543363 (0.0006) [2023-12-26 12:00:01,283][123090] Updated weights for policy 1, policy_version 1543373 (0.0007) [2023-12-26 12:00:01,353][123090] Updated weights for policy 1, policy_version 1543383 (0.0009) [2023-12-26 12:00:01,696][123091] Updated weights for policy 0, policy_version 1553650 (0.0009) [2023-12-26 12:00:01,768][123091] Updated weights for policy 0, policy_version 1553660 (0.0008) [2023-12-26 12:00:01,828][123091] Updated weights for policy 0, policy_version 1553670 (0.0005) [2023-12-26 12:00:01,898][123091] Updated weights for policy 0, policy_version 1553680 (0.0005) [2023-12-26 12:00:02,117][123090] Updated weights for policy 1, policy_version 1543393 (0.0010) [2023-12-26 12:00:02,178][123090] Updated weights for policy 1, policy_version 1543403 (0.0007) [2023-12-26 12:00:02,243][123090] Updated weights for policy 1, policy_version 1543413 (0.0005) [2023-12-26 12:00:02,320][123090] Updated weights for policy 1, policy_version 1543423 (0.0006) [2023-12-26 12:00:02,566][123091] Updated weights for policy 0, policy_version 1553690 (0.0010) [2023-12-26 12:00:02,621][123091] Updated weights for policy 0, policy_version 1553700 (0.0010) [2023-12-26 12:00:02,675][123091] Updated weights for policy 0, policy_version 1553710 (0.0010) [2023-12-26 12:00:03,037][123090] Updated weights for policy 1, policy_version 1543433 (0.0010) [2023-12-26 12:00:03,100][123090] Updated weights for policy 1, policy_version 1543443 (0.0007) [2023-12-26 12:00:03,163][123090] Updated weights for policy 1, policy_version 1543453 (0.0007) [2023-12-26 12:00:03,396][123091] Updated weights for policy 0, policy_version 1553720 (0.0007) [2023-12-26 12:00:03,442][123091] Updated weights for policy 0, policy_version 1553730 (0.0005) [2023-12-26 12:00:03,493][123091] Updated weights for policy 0, policy_version 1553740 (0.0005) [2023-12-26 12:00:03,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 792887296. Throughput: 0: 9073.9, 1: 8711.0. Samples: 792900372. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:03,784][121949] Avg episode reward: [(0, '6192.513'), (1, '4980.893')] [2023-12-26 12:00:03,905][123090] Updated weights for policy 1, policy_version 1543463 (0.0009) [2023-12-26 12:00:03,967][123090] Updated weights for policy 1, policy_version 1543473 (0.0009) [2023-12-26 12:00:04,031][123090] Updated weights for policy 1, policy_version 1543483 (0.0010) [2023-12-26 12:00:04,183][123091] Updated weights for policy 0, policy_version 1553750 (0.0008) [2023-12-26 12:00:04,249][123091] Updated weights for policy 0, policy_version 1553760 (0.0009) [2023-12-26 12:00:04,308][123091] Updated weights for policy 0, policy_version 1553770 (0.0010) [2023-12-26 12:00:04,824][123090] Updated weights for policy 1, policy_version 1543493 (0.0007) [2023-12-26 12:00:04,873][123090] Updated weights for policy 1, policy_version 1543503 (0.0005) [2023-12-26 12:00:04,921][123090] Updated weights for policy 1, policy_version 1543513 (0.0005) [2023-12-26 12:00:05,026][123091] Updated weights for policy 0, policy_version 1553780 (0.0008) [2023-12-26 12:00:05,087][123091] Updated weights for policy 0, policy_version 1553790 (0.0005) [2023-12-26 12:00:05,145][123091] Updated weights for policy 0, policy_version 1553800 (0.0008) [2023-12-26 12:00:05,586][123090] Updated weights for policy 1, policy_version 1543523 (0.0007) [2023-12-26 12:00:05,641][123090] Updated weights for policy 1, policy_version 1543533 (0.0010) [2023-12-26 12:00:05,696][123090] Updated weights for policy 1, policy_version 1543543 (0.0010) [2023-12-26 12:00:05,835][123091] Updated weights for policy 0, policy_version 1553810 (0.0009) [2023-12-26 12:00:05,882][123091] Updated weights for policy 0, policy_version 1553820 (0.0005) [2023-12-26 12:00:05,938][123091] Updated weights for policy 0, policy_version 1553830 (0.0005) [2023-12-26 12:00:06,606][123090] Updated weights for policy 1, policy_version 1543553 (0.0009) [2023-12-26 12:00:06,673][123090] Updated weights for policy 1, policy_version 1543563 (0.0010) [2023-12-26 12:00:06,725][123091] Updated weights for policy 0, policy_version 1553841 (0.0008) [2023-12-26 12:00:06,736][123090] Updated weights for policy 1, policy_version 1543573 (0.0009) [2023-12-26 12:00:06,786][123090] Updated weights for policy 1, policy_version 1543583 (0.0008) [2023-12-26 12:00:06,791][123091] Updated weights for policy 0, policy_version 1553851 (0.0009) [2023-12-26 12:00:06,840][123091] Updated weights for policy 0, policy_version 1553861 (0.0010) [2023-12-26 12:00:06,894][123091] Updated weights for policy 0, policy_version 1553871 (0.0010) [2023-12-26 12:00:07,613][123091] Updated weights for policy 0, policy_version 1553881 (0.0006) [2023-12-26 12:00:07,675][123091] Updated weights for policy 0, policy_version 1553891 (0.0006) [2023-12-26 12:00:07,698][123090] Updated weights for policy 1, policy_version 1543593 (0.0009) [2023-12-26 12:00:07,741][123091] Updated weights for policy 0, policy_version 1553901 (0.0007) [2023-12-26 12:00:07,770][123090] Updated weights for policy 1, policy_version 1543603 (0.0009) [2023-12-26 12:00:07,828][123090] Updated weights for policy 1, policy_version 1543613 (0.0010) [2023-12-26 12:00:08,357][123091] Updated weights for policy 0, policy_version 1553911 (0.0009) [2023-12-26 12:00:08,427][123091] Updated weights for policy 0, policy_version 1553921 (0.0010) [2023-12-26 12:00:08,496][123091] Updated weights for policy 0, policy_version 1553931 (0.0007) [2023-12-26 12:00:08,706][123090] Updated weights for policy 1, policy_version 1543623 (0.0007) [2023-12-26 12:00:08,777][123090] Updated weights for policy 1, policy_version 1543633 (0.0006) [2023-12-26 12:00:08,784][121949] Fps is (10 sec: 18024.9, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 792977408. Throughput: 0: 9120.8, 1: 8762.8. Samples: 792955792. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:08,786][121949] Avg episode reward: [(0, '6180.127'), (1, '4958.407')] [2023-12-26 12:00:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001553936_397811712.pth... [2023-12-26 12:00:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001552880_397541376.pth [2023-12-26 12:00:08,850][123090] Updated weights for policy 1, policy_version 1543643 (0.0006) [2023-12-26 12:00:08,887][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001543648_395173888.pth... [2023-12-26 12:00:08,892][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001542592_394903552.pth [2023-12-26 12:00:09,182][123091] Updated weights for policy 0, policy_version 1553941 (0.0008) [2023-12-26 12:00:09,246][123091] Updated weights for policy 0, policy_version 1553951 (0.0010) [2023-12-26 12:00:09,316][123091] Updated weights for policy 0, policy_version 1553961 (0.0010) [2023-12-26 12:00:09,639][123090] Updated weights for policy 1, policy_version 1543653 (0.0008) [2023-12-26 12:00:09,710][123090] Updated weights for policy 1, policy_version 1543663 (0.0010) [2023-12-26 12:00:09,784][123090] Updated weights for policy 1, policy_version 1543673 (0.0009) [2023-12-26 12:00:10,181][123091] Updated weights for policy 0, policy_version 1553971 (0.0008) [2023-12-26 12:00:10,254][123091] Updated weights for policy 0, policy_version 1553981 (0.0006) [2023-12-26 12:00:10,321][123091] Updated weights for policy 0, policy_version 1553991 (0.0008) [2023-12-26 12:00:10,592][123090] Updated weights for policy 1, policy_version 1543683 (0.0009) [2023-12-26 12:00:10,642][123090] Updated weights for policy 1, policy_version 1543693 (0.0009) [2023-12-26 12:00:10,695][123090] Updated weights for policy 1, policy_version 1543703 (0.0010) [2023-12-26 12:00:11,039][123091] Updated weights for policy 0, policy_version 1554001 (0.0009) [2023-12-26 12:00:11,111][123091] Updated weights for policy 0, policy_version 1554011 (0.0008) [2023-12-26 12:00:11,189][123091] Updated weights for policy 0, policy_version 1554021 (0.0010) [2023-12-26 12:00:11,264][123091] Updated weights for policy 0, policy_version 1554031 (0.0010) [2023-12-26 12:00:11,637][123090] Updated weights for policy 1, policy_version 1543713 (0.0010) [2023-12-26 12:00:11,704][123090] Updated weights for policy 1, policy_version 1543723 (0.0010) [2023-12-26 12:00:11,771][123090] Updated weights for policy 1, policy_version 1543733 (0.0010) [2023-12-26 12:00:11,833][123090] Updated weights for policy 1, policy_version 1543743 (0.0006) [2023-12-26 12:00:12,092][123091] Updated weights for policy 0, policy_version 1554041 (0.0011) [2023-12-26 12:00:12,148][123091] Updated weights for policy 0, policy_version 1554051 (0.0011) [2023-12-26 12:00:12,212][123091] Updated weights for policy 0, policy_version 1554061 (0.0011) [2023-12-26 12:00:12,713][123090] Updated weights for policy 1, policy_version 1543753 (0.0009) [2023-12-26 12:00:12,782][123090] Updated weights for policy 1, policy_version 1543763 (0.0009) [2023-12-26 12:00:12,837][123090] Updated weights for policy 1, policy_version 1543773 (0.0006) [2023-12-26 12:00:13,049][123091] Updated weights for policy 0, policy_version 1554071 (0.0011) [2023-12-26 12:00:13,103][123091] Updated weights for policy 0, policy_version 1554081 (0.0007) [2023-12-26 12:00:13,164][123091] Updated weights for policy 0, policy_version 1554091 (0.0007) [2023-12-26 12:00:13,677][123090] Updated weights for policy 1, policy_version 1543783 (0.0010) [2023-12-26 12:00:13,729][123090] Updated weights for policy 1, policy_version 1543793 (0.0009) [2023-12-26 12:00:13,782][123090] Updated weights for policy 1, policy_version 1543803 (0.0010) [2023-12-26 12:00:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 793059328. Throughput: 0: 9096.0, 1: 8666.1. Samples: 793058892. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:13,784][121949] Avg episode reward: [(0, '6240.954'), (1, '4833.040')] [2023-12-26 12:00:13,929][123091] Updated weights for policy 0, policy_version 1554101 (0.0007) [2023-12-26 12:00:13,987][123091] Updated weights for policy 0, policy_version 1554111 (0.0010) [2023-12-26 12:00:14,048][123091] Updated weights for policy 0, policy_version 1554121 (0.0010) [2023-12-26 12:00:14,638][123090] Updated weights for policy 1, policy_version 1543813 (0.0009) [2023-12-26 12:00:14,690][123090] Updated weights for policy 1, policy_version 1543823 (0.0010) [2023-12-26 12:00:14,750][123090] Updated weights for policy 1, policy_version 1543833 (0.0010) [2023-12-26 12:00:14,907][123091] Updated weights for policy 0, policy_version 1554131 (0.0010) [2023-12-26 12:00:14,982][123091] Updated weights for policy 0, policy_version 1554141 (0.0007) [2023-12-26 12:00:15,059][123091] Updated weights for policy 0, policy_version 1554151 (0.0007) [2023-12-26 12:00:15,544][123090] Updated weights for policy 1, policy_version 1543843 (0.0007) [2023-12-26 12:00:15,598][123090] Updated weights for policy 1, policy_version 1543853 (0.0005) [2023-12-26 12:00:15,648][123090] Updated weights for policy 1, policy_version 1543863 (0.0009) [2023-12-26 12:00:15,834][123091] Updated weights for policy 0, policy_version 1554161 (0.0011) [2023-12-26 12:00:15,887][123091] Updated weights for policy 0, policy_version 1554171 (0.0009) [2023-12-26 12:00:15,938][123091] Updated weights for policy 0, policy_version 1554181 (0.0009) [2023-12-26 12:00:16,005][123091] Updated weights for policy 0, policy_version 1554191 (0.0009) [2023-12-26 12:00:16,399][123090] Updated weights for policy 1, policy_version 1543873 (0.0009) [2023-12-26 12:00:16,453][123090] Updated weights for policy 1, policy_version 1543883 (0.0005) [2023-12-26 12:00:16,499][123090] Updated weights for policy 1, policy_version 1543893 (0.0005) [2023-12-26 12:00:16,549][123090] Updated weights for policy 1, policy_version 1543903 (0.0005) [2023-12-26 12:00:16,906][123091] Updated weights for policy 0, policy_version 1554201 (0.0009) [2023-12-26 12:00:16,973][123091] Updated weights for policy 0, policy_version 1554211 (0.0009) [2023-12-26 12:00:17,034][123091] Updated weights for policy 0, policy_version 1554221 (0.0009) [2023-12-26 12:00:17,176][123090] Updated weights for policy 1, policy_version 1543913 (0.0009) [2023-12-26 12:00:17,228][123090] Updated weights for policy 1, policy_version 1543924 (0.0010) [2023-12-26 12:00:17,282][123090] Updated weights for policy 1, policy_version 1543934 (0.0010) [2023-12-26 12:00:17,672][123091] Updated weights for policy 0, policy_version 1554231 (0.0008) [2023-12-26 12:00:17,740][123091] Updated weights for policy 0, policy_version 1554241 (0.0007) [2023-12-26 12:00:17,792][123091] Updated weights for policy 0, policy_version 1554251 (0.0007) [2023-12-26 12:00:18,211][123090] Updated weights for policy 1, policy_version 1543944 (0.0010) [2023-12-26 12:00:18,262][123090] Updated weights for policy 1, policy_version 1543954 (0.0010) [2023-12-26 12:00:18,315][123090] Updated weights for policy 1, policy_version 1543964 (0.0009) [2023-12-26 12:00:18,551][123091] Updated weights for policy 0, policy_version 1554261 (0.0007) [2023-12-26 12:00:18,615][123091] Updated weights for policy 0, policy_version 1554271 (0.0009) [2023-12-26 12:00:18,681][123091] Updated weights for policy 0, policy_version 1554281 (0.0009) [2023-12-26 12:00:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 793157632. Throughput: 0: 9035.8, 1: 8768.0. Samples: 793165016. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:18,784][121949] Avg episode reward: [(0, '6222.957'), (1, '4778.786')] [2023-12-26 12:00:19,164][123090] Updated weights for policy 1, policy_version 1543974 (0.0010) [2023-12-26 12:00:19,226][123090] Updated weights for policy 1, policy_version 1543984 (0.0010) [2023-12-26 12:00:19,298][123090] Updated weights for policy 1, policy_version 1543994 (0.0011) [2023-12-26 12:00:19,589][123091] Updated weights for policy 0, policy_version 1554291 (0.0009) [2023-12-26 12:00:19,660][123091] Updated weights for policy 0, policy_version 1554301 (0.0009) [2023-12-26 12:00:19,726][123091] Updated weights for policy 0, policy_version 1554311 (0.0009) [2023-12-26 12:00:20,158][123090] Updated weights for policy 1, policy_version 1544004 (0.0010) [2023-12-26 12:00:20,211][123090] Updated weights for policy 1, policy_version 1544014 (0.0011) [2023-12-26 12:00:20,275][123090] Updated weights for policy 1, policy_version 1544024 (0.0010) [2023-12-26 12:00:20,584][123091] Updated weights for policy 0, policy_version 1554321 (0.0009) [2023-12-26 12:00:20,645][123091] Updated weights for policy 0, policy_version 1554331 (0.0009) [2023-12-26 12:00:20,714][123091] Updated weights for policy 0, policy_version 1554341 (0.0009) [2023-12-26 12:00:20,772][123091] Updated weights for policy 0, policy_version 1554351 (0.0009) [2023-12-26 12:00:21,131][123090] Updated weights for policy 1, policy_version 1544034 (0.0010) [2023-12-26 12:00:21,203][123090] Updated weights for policy 1, policy_version 1544044 (0.0010) [2023-12-26 12:00:21,274][123090] Updated weights for policy 1, policy_version 1544054 (0.0011) [2023-12-26 12:00:21,341][123090] Updated weights for policy 1, policy_version 1544064 (0.0010) [2023-12-26 12:00:21,656][123091] Updated weights for policy 0, policy_version 1554361 (0.0010) [2023-12-26 12:00:21,725][123091] Updated weights for policy 0, policy_version 1554371 (0.0009) [2023-12-26 12:00:21,788][123091] Updated weights for policy 0, policy_version 1554381 (0.0009) [2023-12-26 12:00:22,234][123090] Updated weights for policy 1, policy_version 1544074 (0.0011) [2023-12-26 12:00:22,298][123090] Updated weights for policy 1, policy_version 1544084 (0.0011) [2023-12-26 12:00:22,368][123090] Updated weights for policy 1, policy_version 1544094 (0.0010) [2023-12-26 12:00:22,678][123091] Updated weights for policy 0, policy_version 1554391 (0.0009) [2023-12-26 12:00:22,746][123091] Updated weights for policy 0, policy_version 1554401 (0.0008) [2023-12-26 12:00:22,812][123091] Updated weights for policy 0, policy_version 1554411 (0.0009) [2023-12-26 12:00:23,178][123090] Updated weights for policy 1, policy_version 1544104 (0.0010) [2023-12-26 12:00:23,234][123090] Updated weights for policy 1, policy_version 1544114 (0.0010) [2023-12-26 12:00:23,291][123090] Updated weights for policy 1, policy_version 1544124 (0.0011) [2023-12-26 12:00:23,550][123091] Updated weights for policy 0, policy_version 1554421 (0.0010) [2023-12-26 12:00:23,619][123091] Updated weights for policy 0, policy_version 1554431 (0.0011) [2023-12-26 12:00:23,667][123091] Updated weights for policy 0, policy_version 1554441 (0.0011) [2023-12-26 12:00:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 793239552. Throughput: 0: 8899.3, 1: 8736.4. Samples: 793213924. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:23,785][121949] Avg episode reward: [(0, '6106.941'), (1, '4956.132')] [2023-12-26 12:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001554448_397942784.pth... [2023-12-26 12:00:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001544128_395296768.pth... [2023-12-26 12:00:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001553392_397672448.pth [2023-12-26 12:00:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001543136_395042816.pth [2023-12-26 12:00:24,090][123090] Updated weights for policy 1, policy_version 1544134 (0.0009) [2023-12-26 12:00:24,162][123090] Updated weights for policy 1, policy_version 1544144 (0.0009) [2023-12-26 12:00:24,230][123090] Updated weights for policy 1, policy_version 1544154 (0.0008) [2023-12-26 12:00:24,467][123091] Updated weights for policy 0, policy_version 1554451 (0.0011) [2023-12-26 12:00:24,530][123091] Updated weights for policy 0, policy_version 1554461 (0.0010) [2023-12-26 12:00:24,592][123091] Updated weights for policy 0, policy_version 1554471 (0.0009) [2023-12-26 12:00:25,049][123090] Updated weights for policy 1, policy_version 1544164 (0.0010) [2023-12-26 12:00:25,111][123090] Updated weights for policy 1, policy_version 1544174 (0.0009) [2023-12-26 12:00:25,179][123090] Updated weights for policy 1, policy_version 1544184 (0.0010) [2023-12-26 12:00:25,463][123091] Updated weights for policy 0, policy_version 1554481 (0.0010) [2023-12-26 12:00:25,526][123091] Updated weights for policy 0, policy_version 1554491 (0.0006) [2023-12-26 12:00:25,596][123091] Updated weights for policy 0, policy_version 1554501 (0.0008) [2023-12-26 12:00:25,669][123091] Updated weights for policy 0, policy_version 1554511 (0.0009) [2023-12-26 12:00:25,954][123090] Updated weights for policy 1, policy_version 1544194 (0.0008) [2023-12-26 12:00:26,030][123090] Updated weights for policy 1, policy_version 1544204 (0.0005) [2023-12-26 12:00:26,089][123090] Updated weights for policy 1, policy_version 1544214 (0.0008) [2023-12-26 12:00:26,148][123090] Updated weights for policy 1, policy_version 1544224 (0.0008) [2023-12-26 12:00:26,426][123091] Updated weights for policy 0, policy_version 1554521 (0.0006) [2023-12-26 12:00:26,494][123091] Updated weights for policy 0, policy_version 1554531 (0.0005) [2023-12-26 12:00:26,568][123091] Updated weights for policy 0, policy_version 1554541 (0.0006) [2023-12-26 12:00:26,976][123090] Updated weights for policy 1, policy_version 1544234 (0.0010) [2023-12-26 12:00:27,028][123090] Updated weights for policy 1, policy_version 1544244 (0.0010) [2023-12-26 12:00:27,076][123090] Updated weights for policy 1, policy_version 1544254 (0.0010) [2023-12-26 12:00:27,349][123091] Updated weights for policy 0, policy_version 1554551 (0.0009) [2023-12-26 12:00:27,404][123091] Updated weights for policy 0, policy_version 1554561 (0.0011) [2023-12-26 12:00:27,458][123091] Updated weights for policy 0, policy_version 1554571 (0.0011) [2023-12-26 12:00:27,935][123090] Updated weights for policy 1, policy_version 1544264 (0.0007) [2023-12-26 12:00:28,001][123090] Updated weights for policy 1, policy_version 1544274 (0.0006) [2023-12-26 12:00:28,066][123090] Updated weights for policy 1, policy_version 1544284 (0.0010) [2023-12-26 12:00:28,167][123091] Updated weights for policy 0, policy_version 1554581 (0.0008) [2023-12-26 12:00:28,237][123091] Updated weights for policy 0, policy_version 1554591 (0.0007) [2023-12-26 12:00:28,301][123091] Updated weights for policy 0, policy_version 1554601 (0.0007) [2023-12-26 12:00:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 793321472. Throughput: 0: 8935.1, 1: 8698.4. Samples: 793317200. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:28,784][121949] Avg episode reward: [(0, '6111.951'), (1, '5024.400')] [2023-12-26 12:00:28,815][123090] Updated weights for policy 1, policy_version 1544294 (0.0008) [2023-12-26 12:00:28,886][123090] Updated weights for policy 1, policy_version 1544304 (0.0005) [2023-12-26 12:00:28,956][123090] Updated weights for policy 1, policy_version 1544314 (0.0007) [2023-12-26 12:00:29,122][123091] Updated weights for policy 0, policy_version 1554611 (0.0009) [2023-12-26 12:00:29,170][123091] Updated weights for policy 0, policy_version 1554621 (0.0010) [2023-12-26 12:00:29,217][123091] Updated weights for policy 0, policy_version 1554631 (0.0010) [2023-12-26 12:00:29,763][123090] Updated weights for policy 1, policy_version 1544324 (0.0009) [2023-12-26 12:00:29,827][123090] Updated weights for policy 1, policy_version 1544334 (0.0008) [2023-12-26 12:00:29,896][123090] Updated weights for policy 1, policy_version 1544344 (0.0007) [2023-12-26 12:00:30,034][123091] Updated weights for policy 0, policy_version 1554641 (0.0011) [2023-12-26 12:00:30,098][123091] Updated weights for policy 0, policy_version 1554651 (0.0011) [2023-12-26 12:00:30,165][123091] Updated weights for policy 0, policy_version 1554661 (0.0011) [2023-12-26 12:00:30,233][123091] Updated weights for policy 0, policy_version 1554671 (0.0011) [2023-12-26 12:00:30,707][123090] Updated weights for policy 1, policy_version 1544354 (0.0008) [2023-12-26 12:00:30,776][123090] Updated weights for policy 1, policy_version 1544364 (0.0009) [2023-12-26 12:00:30,834][123090] Updated weights for policy 1, policy_version 1544374 (0.0009) [2023-12-26 12:00:30,899][123090] Updated weights for policy 1, policy_version 1544384 (0.0010) [2023-12-26 12:00:31,025][123091] Updated weights for policy 0, policy_version 1554681 (0.0006) [2023-12-26 12:00:31,087][123091] Updated weights for policy 0, policy_version 1554691 (0.0008) [2023-12-26 12:00:31,157][123091] Updated weights for policy 0, policy_version 1554701 (0.0007) [2023-12-26 12:00:31,691][123090] Updated weights for policy 1, policy_version 1544394 (0.0008) [2023-12-26 12:00:31,754][123090] Updated weights for policy 1, policy_version 1544404 (0.0007) [2023-12-26 12:00:31,814][123090] Updated weights for policy 1, policy_version 1544414 (0.0005) [2023-12-26 12:00:31,904][123091] Updated weights for policy 0, policy_version 1554711 (0.0009) [2023-12-26 12:00:31,964][123091] Updated weights for policy 0, policy_version 1554721 (0.0009) [2023-12-26 12:00:32,036][123091] Updated weights for policy 0, policy_version 1554731 (0.0008) [2023-12-26 12:00:32,506][123090] Updated weights for policy 1, policy_version 1544424 (0.0009) [2023-12-26 12:00:32,555][123090] Updated weights for policy 1, policy_version 1544434 (0.0009) [2023-12-26 12:00:32,604][123090] Updated weights for policy 1, policy_version 1544444 (0.0009) [2023-12-26 12:00:32,796][123091] Updated weights for policy 0, policy_version 1554741 (0.0008) [2023-12-26 12:00:32,852][123091] Updated weights for policy 0, policy_version 1554751 (0.0009) [2023-12-26 12:00:32,910][123091] Updated weights for policy 0, policy_version 1554761 (0.0009) [2023-12-26 12:00:33,479][123090] Updated weights for policy 1, policy_version 1544454 (0.0009) [2023-12-26 12:00:33,533][123090] Updated weights for policy 1, policy_version 1544464 (0.0009) [2023-12-26 12:00:33,585][123090] Updated weights for policy 1, policy_version 1544474 (0.0009) [2023-12-26 12:00:33,739][123091] Updated weights for policy 0, policy_version 1554771 (0.0010) [2023-12-26 12:00:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 793411584. Throughput: 0: 8874.2, 1: 8638.5. Samples: 793424280. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:33,785][121949] Avg episode reward: [(0, '6288.632'), (1, '5050.385')] [2023-12-26 12:00:33,802][123091] Updated weights for policy 0, policy_version 1554781 (0.0009) [2023-12-26 12:00:33,866][123091] Updated weights for policy 0, policy_version 1554791 (0.0009) [2023-12-26 12:00:34,376][123090] Updated weights for policy 1, policy_version 1544484 (0.0007) [2023-12-26 12:00:34,445][123090] Updated weights for policy 1, policy_version 1544494 (0.0006) [2023-12-26 12:00:34,508][123090] Updated weights for policy 1, policy_version 1544504 (0.0005) [2023-12-26 12:00:34,737][123091] Updated weights for policy 0, policy_version 1554801 (0.0008) [2023-12-26 12:00:34,794][123091] Updated weights for policy 0, policy_version 1554811 (0.0010) [2023-12-26 12:00:34,855][123091] Updated weights for policy 0, policy_version 1554821 (0.0009) [2023-12-26 12:00:34,907][123091] Updated weights for policy 0, policy_version 1554831 (0.0009) [2023-12-26 12:00:35,200][123090] Updated weights for policy 1, policy_version 1544514 (0.0005) [2023-12-26 12:00:35,248][123090] Updated weights for policy 1, policy_version 1544524 (0.0005) [2023-12-26 12:00:35,307][123090] Updated weights for policy 1, policy_version 1544534 (0.0010) [2023-12-26 12:00:35,354][123090] Updated weights for policy 1, policy_version 1544544 (0.0009) [2023-12-26 12:00:35,786][123091] Updated weights for policy 0, policy_version 1554841 (0.0009) [2023-12-26 12:00:35,839][123091] Updated weights for policy 0, policy_version 1554851 (0.0009) [2023-12-26 12:00:35,903][123091] Updated weights for policy 0, policy_version 1554861 (0.0006) [2023-12-26 12:00:36,207][123090] Updated weights for policy 1, policy_version 1544554 (0.0008) [2023-12-26 12:00:36,266][123090] Updated weights for policy 1, policy_version 1544564 (0.0006) [2023-12-26 12:00:36,339][123090] Updated weights for policy 1, policy_version 1544574 (0.0006) [2023-12-26 12:00:36,656][123091] Updated weights for policy 0, policy_version 1554871 (0.0008) [2023-12-26 12:00:36,733][123091] Updated weights for policy 0, policy_version 1554881 (0.0010) [2023-12-26 12:00:36,799][123091] Updated weights for policy 0, policy_version 1554891 (0.0010) [2023-12-26 12:00:37,056][123090] Updated weights for policy 1, policy_version 1544584 (0.0009) [2023-12-26 12:00:37,119][123090] Updated weights for policy 1, policy_version 1544594 (0.0010) [2023-12-26 12:00:37,189][123090] Updated weights for policy 1, policy_version 1544604 (0.0009) [2023-12-26 12:00:37,637][123091] Updated weights for policy 0, policy_version 1554901 (0.0009) [2023-12-26 12:00:37,699][123091] Updated weights for policy 0, policy_version 1554911 (0.0010) [2023-12-26 12:00:37,767][123091] Updated weights for policy 0, policy_version 1554921 (0.0010) [2023-12-26 12:00:37,924][123090] Updated weights for policy 1, policy_version 1544614 (0.0007) [2023-12-26 12:00:37,985][123090] Updated weights for policy 1, policy_version 1544624 (0.0005) [2023-12-26 12:00:38,057][123090] Updated weights for policy 1, policy_version 1544634 (0.0005) [2023-12-26 12:00:38,652][123091] Updated weights for policy 0, policy_version 1554931 (0.0010) [2023-12-26 12:00:38,689][123090] Updated weights for policy 1, policy_version 1544644 (0.0006) [2023-12-26 12:00:38,721][123091] Updated weights for policy 0, policy_version 1554941 (0.0008) [2023-12-26 12:00:38,742][123090] Updated weights for policy 1, policy_version 1544654 (0.0008) [2023-12-26 12:00:38,775][123091] Updated weights for policy 0, policy_version 1554951 (0.0009) [2023-12-26 12:00:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 793493504. Throughput: 0: 8875.5, 1: 8669.8. Samples: 793477800. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:38,785][121949] Avg episode reward: [(0, '6179.557'), (1, '5121.659')] [2023-12-26 12:00:38,799][123090] Updated weights for policy 1, policy_version 1544664 (0.0008) [2023-12-26 12:00:38,828][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001554960_398073856.pth... [2023-12-26 12:00:38,832][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001553936_397811712.pth [2023-12-26 12:00:38,850][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001544672_395436032.pth... [2023-12-26 12:00:38,856][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001543648_395173888.pth [2023-12-26 12:00:39,652][123091] Updated weights for policy 0, policy_version 1554961 (0.0008) [2023-12-26 12:00:39,680][123090] Updated weights for policy 1, policy_version 1544674 (0.0008) [2023-12-26 12:00:39,721][123091] Updated weights for policy 0, policy_version 1554971 (0.0009) [2023-12-26 12:00:39,746][123090] Updated weights for policy 1, policy_version 1544684 (0.0007) [2023-12-26 12:00:39,784][123091] Updated weights for policy 0, policy_version 1554981 (0.0010) [2023-12-26 12:00:39,818][123090] Updated weights for policy 1, policy_version 1544694 (0.0008) [2023-12-26 12:00:39,853][123091] Updated weights for policy 0, policy_version 1554991 (0.0008) [2023-12-26 12:00:39,883][123090] Updated weights for policy 1, policy_version 1544704 (0.0008) [2023-12-26 12:00:40,673][123090] Updated weights for policy 1, policy_version 1544714 (0.0009) [2023-12-26 12:00:40,686][123091] Updated weights for policy 0, policy_version 1555001 (0.0008) [2023-12-26 12:00:40,734][123090] Updated weights for policy 1, policy_version 1544724 (0.0006) [2023-12-26 12:00:40,738][123091] Updated weights for policy 0, policy_version 1555011 (0.0008) [2023-12-26 12:00:40,795][123091] Updated weights for policy 0, policy_version 1555021 (0.0007) [2023-12-26 12:00:40,797][123090] Updated weights for policy 1, policy_version 1544734 (0.0009) [2023-12-26 12:00:41,650][123091] Updated weights for policy 0, policy_version 1555031 (0.0008) [2023-12-26 12:00:41,676][123090] Updated weights for policy 1, policy_version 1544744 (0.0009) [2023-12-26 12:00:41,713][123091] Updated weights for policy 0, policy_version 1555041 (0.0008) [2023-12-26 12:00:41,739][123090] Updated weights for policy 1, policy_version 1544754 (0.0008) [2023-12-26 12:00:41,783][123091] Updated weights for policy 0, policy_version 1555051 (0.0009) [2023-12-26 12:00:41,808][123090] Updated weights for policy 1, policy_version 1544764 (0.0008) [2023-12-26 12:00:42,573][123090] Updated weights for policy 1, policy_version 1544774 (0.0009) [2023-12-26 12:00:42,631][123090] Updated weights for policy 1, policy_version 1544784 (0.0008) [2023-12-26 12:00:42,633][123091] Updated weights for policy 0, policy_version 1555061 (0.0008) [2023-12-26 12:00:42,688][123090] Updated weights for policy 1, policy_version 1544794 (0.0007) [2023-12-26 12:00:42,695][123091] Updated weights for policy 0, policy_version 1555071 (0.0009) [2023-12-26 12:00:42,751][123091] Updated weights for policy 0, policy_version 1555081 (0.0008) [2023-12-26 12:00:43,477][123090] Updated weights for policy 1, policy_version 1544804 (0.0008) [2023-12-26 12:00:43,529][123090] Updated weights for policy 1, policy_version 1544814 (0.0007) [2023-12-26 12:00:43,580][123090] Updated weights for policy 1, policy_version 1544824 (0.0008) [2023-12-26 12:00:43,614][123091] Updated weights for policy 0, policy_version 1555091 (0.0008) [2023-12-26 12:00:43,678][123091] Updated weights for policy 0, policy_version 1555101 (0.0005) [2023-12-26 12:00:43,751][123091] Updated weights for policy 0, policy_version 1555111 (0.0005) [2023-12-26 12:00:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 793583616. Throughput: 0: 8807.5, 1: 8722.4. Samples: 793580612. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:43,785][121949] Avg episode reward: [(0, '6038.808'), (1, '4944.957')] [2023-12-26 12:00:44,359][123090] Updated weights for policy 1, policy_version 1544834 (0.0010) [2023-12-26 12:00:44,410][123090] Updated weights for policy 1, policy_version 1544844 (0.0010) [2023-12-26 12:00:44,475][123090] Updated weights for policy 1, policy_version 1544854 (0.0010) [2023-12-26 12:00:44,514][123091] Updated weights for policy 0, policy_version 1555121 (0.0006) [2023-12-26 12:00:44,535][123090] Updated weights for policy 1, policy_version 1544864 (0.0011) [2023-12-26 12:00:44,564][123091] Updated weights for policy 0, policy_version 1555131 (0.0008) [2023-12-26 12:00:44,614][123091] Updated weights for policy 0, policy_version 1555141 (0.0009) [2023-12-26 12:00:44,665][123091] Updated weights for policy 0, policy_version 1555151 (0.0010) [2023-12-26 12:00:45,297][123090] Updated weights for policy 1, policy_version 1544874 (0.0005) [2023-12-26 12:00:45,350][123090] Updated weights for policy 1, policy_version 1544884 (0.0005) [2023-12-26 12:00:45,400][123090] Updated weights for policy 1, policy_version 1544894 (0.0008) [2023-12-26 12:00:45,591][123091] Updated weights for policy 0, policy_version 1555161 (0.0010) [2023-12-26 12:00:45,648][123091] Updated weights for policy 0, policy_version 1555171 (0.0008) [2023-12-26 12:00:45,704][123091] Updated weights for policy 0, policy_version 1555181 (0.0005) [2023-12-26 12:00:46,150][123090] Updated weights for policy 1, policy_version 1544904 (0.0006) [2023-12-26 12:00:46,222][123090] Updated weights for policy 1, policy_version 1544914 (0.0005) [2023-12-26 12:00:46,288][123090] Updated weights for policy 1, policy_version 1544924 (0.0005) [2023-12-26 12:00:46,400][123091] Updated weights for policy 0, policy_version 1555191 (0.0005) [2023-12-26 12:00:46,447][123091] Updated weights for policy 0, policy_version 1555201 (0.0005) [2023-12-26 12:00:46,499][123091] Updated weights for policy 0, policy_version 1555211 (0.0005) [2023-12-26 12:00:47,034][123090] Updated weights for policy 1, policy_version 1544934 (0.0007) [2023-12-26 12:00:47,086][123090] Updated weights for policy 1, policy_version 1544944 (0.0009) [2023-12-26 12:00:47,143][123090] Updated weights for policy 1, policy_version 1544954 (0.0009) [2023-12-26 12:00:47,183][123091] Updated weights for policy 0, policy_version 1555221 (0.0006) [2023-12-26 12:00:47,235][123091] Updated weights for policy 0, policy_version 1555231 (0.0008) [2023-12-26 12:00:47,280][123091] Updated weights for policy 0, policy_version 1555241 (0.0007) [2023-12-26 12:00:47,940][123090] Updated weights for policy 1, policy_version 1544964 (0.0009) [2023-12-26 12:00:47,990][123091] Updated weights for policy 0, policy_version 1555251 (0.0006) [2023-12-26 12:00:48,001][123090] Updated weights for policy 1, policy_version 1544974 (0.0010) [2023-12-26 12:00:48,050][123091] Updated weights for policy 0, policy_version 1555261 (0.0009) [2023-12-26 12:00:48,059][123090] Updated weights for policy 1, policy_version 1544984 (0.0006) [2023-12-26 12:00:48,106][123091] Updated weights for policy 0, policy_version 1555271 (0.0009) [2023-12-26 12:00:48,752][123090] Updated weights for policy 1, policy_version 1544994 (0.0005) [2023-12-26 12:00:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 793673728. Throughput: 0: 8799.1, 1: 8738.4. Samples: 793689560. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:48,785][121949] Avg episode reward: [(0, '6121.301'), (1, '5109.201')] [2023-12-26 12:00:48,803][123090] Updated weights for policy 1, policy_version 1545004 (0.0005) [2023-12-26 12:00:48,856][123090] Updated weights for policy 1, policy_version 1545014 (0.0005) [2023-12-26 12:00:48,911][123090] Updated weights for policy 1, policy_version 1545024 (0.0005) [2023-12-26 12:00:49,028][123091] Updated weights for policy 0, policy_version 1555281 (0.0010) [2023-12-26 12:00:49,080][123091] Updated weights for policy 0, policy_version 1555291 (0.0009) [2023-12-26 12:00:49,147][123091] Updated weights for policy 0, policy_version 1555301 (0.0009) [2023-12-26 12:00:49,207][123091] Updated weights for policy 0, policy_version 1555311 (0.0009) [2023-12-26 12:00:49,714][123090] Updated weights for policy 1, policy_version 1545034 (0.0008) [2023-12-26 12:00:49,765][123090] Updated weights for policy 1, policy_version 1545044 (0.0005) [2023-12-26 12:00:49,836][123090] Updated weights for policy 1, policy_version 1545054 (0.0006) [2023-12-26 12:00:50,102][123091] Updated weights for policy 0, policy_version 1555321 (0.0008) [2023-12-26 12:00:50,169][123091] Updated weights for policy 0, policy_version 1555331 (0.0009) [2023-12-26 12:00:50,230][123091] Updated weights for policy 0, policy_version 1555341 (0.0009) [2023-12-26 12:00:50,569][123090] Updated weights for policy 1, policy_version 1545064 (0.0006) [2023-12-26 12:00:50,622][123090] Updated weights for policy 1, policy_version 1545074 (0.0009) [2023-12-26 12:00:50,673][123090] Updated weights for policy 1, policy_version 1545084 (0.0010) [2023-12-26 12:00:51,063][123091] Updated weights for policy 0, policy_version 1555351 (0.0010) [2023-12-26 12:00:51,134][123091] Updated weights for policy 0, policy_version 1555361 (0.0011) [2023-12-26 12:00:51,199][123091] Updated weights for policy 0, policy_version 1555371 (0.0010) [2023-12-26 12:00:51,516][123090] Updated weights for policy 1, policy_version 1545094 (0.0009) [2023-12-26 12:00:51,573][123090] Updated weights for policy 1, policy_version 1545104 (0.0008) [2023-12-26 12:00:51,645][123090] Updated weights for policy 1, policy_version 1545114 (0.0008) [2023-12-26 12:00:51,927][123091] Updated weights for policy 0, policy_version 1555381 (0.0010) [2023-12-26 12:00:51,988][123091] Updated weights for policy 0, policy_version 1555391 (0.0010) [2023-12-26 12:00:52,046][123091] Updated weights for policy 0, policy_version 1555401 (0.0010) [2023-12-26 12:00:52,480][123090] Updated weights for policy 1, policy_version 1545124 (0.0008) [2023-12-26 12:00:52,547][123090] Updated weights for policy 1, policy_version 1545134 (0.0009) [2023-12-26 12:00:52,613][123090] Updated weights for policy 1, policy_version 1545144 (0.0010) [2023-12-26 12:00:52,894][123091] Updated weights for policy 0, policy_version 1555411 (0.0009) [2023-12-26 12:00:52,960][123091] Updated weights for policy 0, policy_version 1555421 (0.0006) [2023-12-26 12:00:53,028][123091] Updated weights for policy 0, policy_version 1555431 (0.0006) [2023-12-26 12:00:53,395][123090] Updated weights for policy 1, policy_version 1545154 (0.0009) [2023-12-26 12:00:53,447][123090] Updated weights for policy 1, policy_version 1545164 (0.0005) [2023-12-26 12:00:53,499][123090] Updated weights for policy 1, policy_version 1545174 (0.0005) [2023-12-26 12:00:53,560][123090] Updated weights for policy 1, policy_version 1545184 (0.0005) [2023-12-26 12:00:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.4, 300 sec: 17661.4). Total num frames: 793763840. Throughput: 0: 8705.4, 1: 8755.2. Samples: 793741516. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:53,785][121949] Avg episode reward: [(0, '6159.875'), (1, '5097.991')] [2023-12-26 12:00:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001555440_398196736.pth... [2023-12-26 12:00:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001545184_395567104.pth... [2023-12-26 12:00:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001554448_397942784.pth [2023-12-26 12:00:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001544128_395296768.pth [2023-12-26 12:00:53,869][123091] Updated weights for policy 0, policy_version 1555441 (0.0006) [2023-12-26 12:00:53,927][123091] Updated weights for policy 0, policy_version 1555451 (0.0009) [2023-12-26 12:00:53,982][123091] Updated weights for policy 0, policy_version 1555461 (0.0010) [2023-12-26 12:00:54,040][123091] Updated weights for policy 0, policy_version 1555471 (0.0009) [2023-12-26 12:00:54,235][123090] Updated weights for policy 1, policy_version 1545194 (0.0009) [2023-12-26 12:00:54,297][123090] Updated weights for policy 1, policy_version 1545204 (0.0009) [2023-12-26 12:00:54,353][123090] Updated weights for policy 1, policy_version 1545214 (0.0009) [2023-12-26 12:00:54,883][123091] Updated weights for policy 0, policy_version 1555482 (0.0011) [2023-12-26 12:00:54,942][123091] Updated weights for policy 0, policy_version 1555494 (0.0010) [2023-12-26 12:00:55,002][123091] Updated weights for policy 0, policy_version 1555504 (0.0009) [2023-12-26 12:00:55,186][123090] Updated weights for policy 1, policy_version 1545224 (0.0010) [2023-12-26 12:00:55,247][123090] Updated weights for policy 1, policy_version 1545234 (0.0009) [2023-12-26 12:00:55,307][123090] Updated weights for policy 1, policy_version 1545244 (0.0010) [2023-12-26 12:00:55,872][123091] Updated weights for policy 0, policy_version 1555514 (0.0010) [2023-12-26 12:00:55,941][123091] Updated weights for policy 0, policy_version 1555524 (0.0011) [2023-12-26 12:00:56,007][123091] Updated weights for policy 0, policy_version 1555534 (0.0011) [2023-12-26 12:00:56,142][123090] Updated weights for policy 1, policy_version 1545254 (0.0009) [2023-12-26 12:00:56,190][123090] Updated weights for policy 1, policy_version 1545264 (0.0009) [2023-12-26 12:00:56,243][123090] Updated weights for policy 1, policy_version 1545275 (0.0009) [2023-12-26 12:00:56,730][123091] Updated weights for policy 0, policy_version 1555544 (0.0006) [2023-12-26 12:00:56,778][123091] Updated weights for policy 0, policy_version 1555554 (0.0005) [2023-12-26 12:00:56,840][123091] Updated weights for policy 0, policy_version 1555564 (0.0005) [2023-12-26 12:00:57,157][123090] Updated weights for policy 1, policy_version 1545285 (0.0010) [2023-12-26 12:00:57,211][123090] Updated weights for policy 1, policy_version 1545295 (0.0010) [2023-12-26 12:00:57,268][123090] Updated weights for policy 1, policy_version 1545305 (0.0010) [2023-12-26 12:00:57,403][123091] Updated weights for policy 0, policy_version 1555574 (0.0005) [2023-12-26 12:00:57,460][123091] Updated weights for policy 0, policy_version 1555584 (0.0005) [2023-12-26 12:00:57,512][123091] Updated weights for policy 0, policy_version 1555594 (0.0005) [2023-12-26 12:00:58,150][123091] Updated weights for policy 0, policy_version 1555604 (0.0007) [2023-12-26 12:00:58,189][123090] Updated weights for policy 1, policy_version 1545315 (0.0009) [2023-12-26 12:00:58,205][123091] Updated weights for policy 0, policy_version 1555614 (0.0009) [2023-12-26 12:00:58,249][123090] Updated weights for policy 1, policy_version 1545325 (0.0010) [2023-12-26 12:00:58,267][123091] Updated weights for policy 0, policy_version 1555624 (0.0007) [2023-12-26 12:00:58,305][123090] Updated weights for policy 1, policy_version 1545335 (0.0007) [2023-12-26 12:00:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 793853952. Throughput: 0: 8681.7, 1: 8815.2. Samples: 793846284. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:00:58,787][121949] Avg episode reward: [(0, '6126.015'), (1, '5179.950')] [2023-12-26 12:00:59,141][123090] Updated weights for policy 1, policy_version 1545345 (0.0008) [2023-12-26 12:00:59,210][123090] Updated weights for policy 1, policy_version 1545355 (0.0011) [2023-12-26 12:00:59,225][123091] Updated weights for policy 0, policy_version 1555634 (0.0008) [2023-12-26 12:00:59,277][123090] Updated weights for policy 1, policy_version 1545365 (0.0008) [2023-12-26 12:00:59,294][123091] Updated weights for policy 0, policy_version 1555644 (0.0008) [2023-12-26 12:00:59,343][123090] Updated weights for policy 1, policy_version 1545375 (0.0008) [2023-12-26 12:00:59,353][123091] Updated weights for policy 0, policy_version 1555654 (0.0008) [2023-12-26 12:00:59,415][123091] Updated weights for policy 0, policy_version 1555664 (0.0008) [2023-12-26 12:01:00,110][123090] Updated weights for policy 1, policy_version 1545385 (0.0009) [2023-12-26 12:01:00,155][123091] Updated weights for policy 0, policy_version 1555674 (0.0009) [2023-12-26 12:01:00,164][123090] Updated weights for policy 1, policy_version 1545395 (0.0005) [2023-12-26 12:01:00,214][123091] Updated weights for policy 0, policy_version 1555684 (0.0009) [2023-12-26 12:01:00,224][123090] Updated weights for policy 1, policy_version 1545405 (0.0007) [2023-12-26 12:01:00,273][123091] Updated weights for policy 0, policy_version 1555694 (0.0008) [2023-12-26 12:01:00,951][123091] Updated weights for policy 0, policy_version 1555704 (0.0006) [2023-12-26 12:01:01,002][123091] Updated weights for policy 0, policy_version 1555714 (0.0005) [2023-12-26 12:01:01,044][123090] Updated weights for policy 1, policy_version 1545415 (0.0009) [2023-12-26 12:01:01,084][123091] Updated weights for policy 0, policy_version 1555724 (0.0008) [2023-12-26 12:01:01,117][123090] Updated weights for policy 1, policy_version 1545425 (0.0009) [2023-12-26 12:01:01,179][123090] Updated weights for policy 1, policy_version 1545435 (0.0009) [2023-12-26 12:01:01,913][123091] Updated weights for policy 0, policy_version 1555734 (0.0009) [2023-12-26 12:01:01,961][123091] Updated weights for policy 0, policy_version 1555744 (0.0010) [2023-12-26 12:01:01,989][123090] Updated weights for policy 1, policy_version 1545445 (0.0008) [2023-12-26 12:01:02,008][123091] Updated weights for policy 0, policy_version 1555754 (0.0010) [2023-12-26 12:01:02,054][123090] Updated weights for policy 1, policy_version 1545455 (0.0007) [2023-12-26 12:01:02,117][123090] Updated weights for policy 1, policy_version 1545465 (0.0009) [2023-12-26 12:01:02,864][123091] Updated weights for policy 0, policy_version 1555764 (0.0009) [2023-12-26 12:01:02,931][123091] Updated weights for policy 0, policy_version 1555774 (0.0006) [2023-12-26 12:01:02,938][123090] Updated weights for policy 1, policy_version 1545475 (0.0009) [2023-12-26 12:01:02,989][123091] Updated weights for policy 0, policy_version 1555784 (0.0006) [2023-12-26 12:01:02,997][123090] Updated weights for policy 1, policy_version 1545485 (0.0009) [2023-12-26 12:01:03,064][123090] Updated weights for policy 1, policy_version 1545495 (0.0009) [2023-12-26 12:01:03,726][123091] Updated weights for policy 0, policy_version 1555794 (0.0007) [2023-12-26 12:01:03,776][123091] Updated weights for policy 0, policy_version 1555804 (0.0008) [2023-12-26 12:01:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 793935872. Throughput: 0: 8698.7, 1: 8774.2. Samples: 793951296. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:03,785][121949] Avg episode reward: [(0, '6122.154'), (1, '5012.072')] [2023-12-26 12:01:03,829][123091] Updated weights for policy 0, policy_version 1555814 (0.0005) [2023-12-26 12:01:03,897][123091] Updated weights for policy 0, policy_version 1555824 (0.0009) [2023-12-26 12:01:03,948][123090] Updated weights for policy 1, policy_version 1545505 (0.0009) [2023-12-26 12:01:04,017][123090] Updated weights for policy 1, policy_version 1545515 (0.0009) [2023-12-26 12:01:04,078][123090] Updated weights for policy 1, policy_version 1545525 (0.0009) [2023-12-26 12:01:04,136][123090] Updated weights for policy 1, policy_version 1545535 (0.0009) [2023-12-26 12:01:04,758][123091] Updated weights for policy 0, policy_version 1555834 (0.0011) [2023-12-26 12:01:04,821][123091] Updated weights for policy 0, policy_version 1555844 (0.0011) [2023-12-26 12:01:04,879][123091] Updated weights for policy 0, policy_version 1555854 (0.0006) [2023-12-26 12:01:04,920][123090] Updated weights for policy 1, policy_version 1545545 (0.0009) [2023-12-26 12:01:04,969][123090] Updated weights for policy 1, policy_version 1545555 (0.0009) [2023-12-26 12:01:05,022][123090] Updated weights for policy 1, policy_version 1545565 (0.0008) [2023-12-26 12:01:05,630][123091] Updated weights for policy 0, policy_version 1555864 (0.0010) [2023-12-26 12:01:05,685][123091] Updated weights for policy 0, policy_version 1555874 (0.0009) [2023-12-26 12:01:05,733][123091] Updated weights for policy 0, policy_version 1555884 (0.0005) [2023-12-26 12:01:05,911][123090] Updated weights for policy 1, policy_version 1545575 (0.0009) [2023-12-26 12:01:05,963][123090] Updated weights for policy 1, policy_version 1545585 (0.0008) [2023-12-26 12:01:06,012][123090] Updated weights for policy 1, policy_version 1545595 (0.0009) [2023-12-26 12:01:06,515][123091] Updated weights for policy 0, policy_version 1555894 (0.0008) [2023-12-26 12:01:06,573][123091] Updated weights for policy 0, policy_version 1555904 (0.0009) [2023-12-26 12:01:06,636][123091] Updated weights for policy 0, policy_version 1555914 (0.0010) [2023-12-26 12:01:06,933][123090] Updated weights for policy 1, policy_version 1545605 (0.0010) [2023-12-26 12:01:06,989][123090] Updated weights for policy 1, policy_version 1545615 (0.0009) [2023-12-26 12:01:07,046][123090] Updated weights for policy 1, policy_version 1545625 (0.0009) [2023-12-26 12:01:07,453][123091] Updated weights for policy 0, policy_version 1555924 (0.0009) [2023-12-26 12:01:07,506][123091] Updated weights for policy 0, policy_version 1555934 (0.0007) [2023-12-26 12:01:07,560][123091] Updated weights for policy 0, policy_version 1555944 (0.0008) [2023-12-26 12:01:07,934][123090] Updated weights for policy 1, policy_version 1545635 (0.0009) [2023-12-26 12:01:07,992][123090] Updated weights for policy 1, policy_version 1545645 (0.0009) [2023-12-26 12:01:08,054][123090] Updated weights for policy 1, policy_version 1545655 (0.0008) [2023-12-26 12:01:08,418][123091] Updated weights for policy 0, policy_version 1555954 (0.0009) [2023-12-26 12:01:08,484][123091] Updated weights for policy 0, policy_version 1555964 (0.0009) [2023-12-26 12:01:08,548][123091] Updated weights for policy 0, policy_version 1555974 (0.0005) [2023-12-26 12:01:08,632][123091] Updated weights for policy 0, policy_version 1555984 (0.0005) [2023-12-26 12:01:08,784][121949] Fps is (10 sec: 17205.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 794025984. Throughput: 0: 8755.9, 1: 8784.2. Samples: 794003228. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:08,785][121949] Avg episode reward: [(0, '6207.018'), (1, '5075.100')] [2023-12-26 12:01:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001555984_398336000.pth... [2023-12-26 12:01:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001545664_395689984.pth... [2023-12-26 12:01:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001554960_398073856.pth [2023-12-26 12:01:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001544672_395436032.pth [2023-12-26 12:01:08,831][123090] Updated weights for policy 1, policy_version 1545665 (0.0008) [2023-12-26 12:01:08,897][123090] Updated weights for policy 1, policy_version 1545675 (0.0007) [2023-12-26 12:01:08,949][123090] Updated weights for policy 1, policy_version 1545685 (0.0010) [2023-12-26 12:01:09,001][123090] Updated weights for policy 1, policy_version 1545695 (0.0010) [2023-12-26 12:01:09,372][123091] Updated weights for policy 0, policy_version 1555994 (0.0007) [2023-12-26 12:01:09,442][123091] Updated weights for policy 0, policy_version 1556004 (0.0009) [2023-12-26 12:01:09,507][123091] Updated weights for policy 0, policy_version 1556014 (0.0011) [2023-12-26 12:01:09,766][123090] Updated weights for policy 1, policy_version 1545705 (0.0006) [2023-12-26 12:01:09,831][123090] Updated weights for policy 1, policy_version 1545715 (0.0007) [2023-12-26 12:01:09,896][123090] Updated weights for policy 1, policy_version 1545725 (0.0011) [2023-12-26 12:01:10,315][123091] Updated weights for policy 0, policy_version 1556024 (0.0010) [2023-12-26 12:01:10,370][123091] Updated weights for policy 0, policy_version 1556034 (0.0011) [2023-12-26 12:01:10,433][123091] Updated weights for policy 0, policy_version 1556044 (0.0010) [2023-12-26 12:01:10,668][123090] Updated weights for policy 1, policy_version 1545735 (0.0010) [2023-12-26 12:01:10,735][123090] Updated weights for policy 1, policy_version 1545745 (0.0011) [2023-12-26 12:01:10,806][123090] Updated weights for policy 1, policy_version 1545755 (0.0011) [2023-12-26 12:01:11,296][123091] Updated weights for policy 0, policy_version 1556054 (0.0008) [2023-12-26 12:01:11,365][123091] Updated weights for policy 0, policy_version 1556064 (0.0008) [2023-12-26 12:01:11,430][123091] Updated weights for policy 0, policy_version 1556074 (0.0012) [2023-12-26 12:01:11,549][123090] Updated weights for policy 1, policy_version 1545765 (0.0010) [2023-12-26 12:01:11,618][123090] Updated weights for policy 1, policy_version 1545775 (0.0010) [2023-12-26 12:01:11,685][123090] Updated weights for policy 1, policy_version 1545785 (0.0009) [2023-12-26 12:01:12,263][123091] Updated weights for policy 0, policy_version 1556084 (0.0009) [2023-12-26 12:01:12,324][123091] Updated weights for policy 0, policy_version 1556094 (0.0010) [2023-12-26 12:01:12,389][123091] Updated weights for policy 0, policy_version 1556104 (0.0010) [2023-12-26 12:01:12,571][123090] Updated weights for policy 1, policy_version 1545795 (0.0010) [2023-12-26 12:01:12,636][123090] Updated weights for policy 1, policy_version 1545805 (0.0008) [2023-12-26 12:01:12,689][123090] Updated weights for policy 1, policy_version 1545815 (0.0010) [2023-12-26 12:01:13,218][123091] Updated weights for policy 0, policy_version 1556114 (0.0009) [2023-12-26 12:01:13,268][123091] Updated weights for policy 0, policy_version 1556125 (0.0010) [2023-12-26 12:01:13,325][123091] Updated weights for policy 0, policy_version 1556135 (0.0010) [2023-12-26 12:01:13,502][123090] Updated weights for policy 1, policy_version 1545825 (0.0010) [2023-12-26 12:01:13,561][123090] Updated weights for policy 1, policy_version 1545835 (0.0010) [2023-12-26 12:01:13,627][123090] Updated weights for policy 1, policy_version 1545845 (0.0010) [2023-12-26 12:01:13,685][123090] Updated weights for policy 1, policy_version 1545855 (0.0010) [2023-12-26 12:01:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 794116096. Throughput: 0: 8750.5, 1: 8805.0. Samples: 794107196. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:13,785][121949] Avg episode reward: [(0, '6261.385'), (1, '4857.070')] [2023-12-26 12:01:14,193][123091] Updated weights for policy 0, policy_version 1556145 (0.0009) [2023-12-26 12:01:14,246][123091] Updated weights for policy 0, policy_version 1556155 (0.0009) [2023-12-26 12:01:14,303][123091] Updated weights for policy 0, policy_version 1556165 (0.0009) [2023-12-26 12:01:14,359][123091] Updated weights for policy 0, policy_version 1556175 (0.0009) [2023-12-26 12:01:14,496][123090] Updated weights for policy 1, policy_version 1545865 (0.0006) [2023-12-26 12:01:14,552][123090] Updated weights for policy 1, policy_version 1545875 (0.0005) [2023-12-26 12:01:14,608][123090] Updated weights for policy 1, policy_version 1545885 (0.0005) [2023-12-26 12:01:15,259][123091] Updated weights for policy 0, policy_version 1556185 (0.0009) [2023-12-26 12:01:15,331][123091] Updated weights for policy 0, policy_version 1556195 (0.0009) [2023-12-26 12:01:15,361][123090] Updated weights for policy 1, policy_version 1545895 (0.0009) [2023-12-26 12:01:15,395][123091] Updated weights for policy 0, policy_version 1556205 (0.0009) [2023-12-26 12:01:15,417][123090] Updated weights for policy 1, policy_version 1545905 (0.0011) [2023-12-26 12:01:15,489][123090] Updated weights for policy 1, policy_version 1545915 (0.0011) [2023-12-26 12:01:16,189][123091] Updated weights for policy 0, policy_version 1556215 (0.0007) [2023-12-26 12:01:16,242][123091] Updated weights for policy 0, policy_version 1556225 (0.0006) [2023-12-26 12:01:16,300][123091] Updated weights for policy 0, policy_version 1556235 (0.0005) [2023-12-26 12:01:16,325][123090] Updated weights for policy 1, policy_version 1545925 (0.0011) [2023-12-26 12:01:16,389][123090] Updated weights for policy 1, policy_version 1545935 (0.0010) [2023-12-26 12:01:16,452][123090] Updated weights for policy 1, policy_version 1545945 (0.0010) [2023-12-26 12:01:16,968][123091] Updated weights for policy 0, policy_version 1556245 (0.0005) [2023-12-26 12:01:17,031][123091] Updated weights for policy 0, policy_version 1556255 (0.0006) [2023-12-26 12:01:17,106][123091] Updated weights for policy 0, policy_version 1556265 (0.0006) [2023-12-26 12:01:17,244][123090] Updated weights for policy 1, policy_version 1545955 (0.0010) [2023-12-26 12:01:17,307][123090] Updated weights for policy 1, policy_version 1545965 (0.0010) [2023-12-26 12:01:17,366][123090] Updated weights for policy 1, policy_version 1545975 (0.0010) [2023-12-26 12:01:17,732][123091] Updated weights for policy 0, policy_version 1556275 (0.0005) [2023-12-26 12:01:17,800][123091] Updated weights for policy 0, policy_version 1556285 (0.0009) [2023-12-26 12:01:17,864][123091] Updated weights for policy 0, policy_version 1556295 (0.0010) [2023-12-26 12:01:18,189][123090] Updated weights for policy 1, policy_version 1545985 (0.0010) [2023-12-26 12:01:18,258][123090] Updated weights for policy 1, policy_version 1545995 (0.0010) [2023-12-26 12:01:18,338][123090] Updated weights for policy 1, policy_version 1546005 (0.0010) [2023-12-26 12:01:18,404][123090] Updated weights for policy 1, policy_version 1546015 (0.0009) [2023-12-26 12:01:18,511][123091] Updated weights for policy 0, policy_version 1556305 (0.0010) [2023-12-26 12:01:18,583][123091] Updated weights for policy 0, policy_version 1556315 (0.0011) [2023-12-26 12:01:18,657][123091] Updated weights for policy 0, policy_version 1556325 (0.0011) [2023-12-26 12:01:18,726][123091] Updated weights for policy 0, policy_version 1556335 (0.0006) [2023-12-26 12:01:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 794206208. Throughput: 0: 8762.9, 1: 8797.3. Samples: 794214492. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:18,785][121949] Avg episode reward: [(0, '6132.526'), (1, '4716.817')] [2023-12-26 12:01:19,058][123090] Updated weights for policy 1, policy_version 1546025 (0.0009) [2023-12-26 12:01:19,110][123090] Updated weights for policy 1, policy_version 1546035 (0.0009) [2023-12-26 12:01:19,162][123090] Updated weights for policy 1, policy_version 1546045 (0.0009) [2023-12-26 12:01:19,464][123091] Updated weights for policy 0, policy_version 1556345 (0.0010) [2023-12-26 12:01:19,524][123091] Updated weights for policy 0, policy_version 1556355 (0.0010) [2023-12-26 12:01:19,583][123091] Updated weights for policy 0, policy_version 1556365 (0.0011) [2023-12-26 12:01:20,000][123090] Updated weights for policy 1, policy_version 1546055 (0.0009) [2023-12-26 12:01:20,055][123090] Updated weights for policy 1, policy_version 1546065 (0.0008) [2023-12-26 12:01:20,116][123090] Updated weights for policy 1, policy_version 1546075 (0.0009) [2023-12-26 12:01:20,436][123091] Updated weights for policy 0, policy_version 1556375 (0.0011) [2023-12-26 12:01:20,511][123091] Updated weights for policy 0, policy_version 1556385 (0.0011) [2023-12-26 12:01:20,588][123091] Updated weights for policy 0, policy_version 1556395 (0.0011) [2023-12-26 12:01:20,931][123090] Updated weights for policy 1, policy_version 1546085 (0.0008) [2023-12-26 12:01:20,994][123090] Updated weights for policy 1, policy_version 1546095 (0.0008) [2023-12-26 12:01:21,062][123090] Updated weights for policy 1, policy_version 1546105 (0.0007) [2023-12-26 12:01:21,443][123091] Updated weights for policy 0, policy_version 1556405 (0.0011) [2023-12-26 12:01:21,507][123091] Updated weights for policy 0, policy_version 1556415 (0.0011) [2023-12-26 12:01:21,558][123091] Updated weights for policy 0, policy_version 1556425 (0.0010) [2023-12-26 12:01:21,926][123090] Updated weights for policy 1, policy_version 1546115 (0.0009) [2023-12-26 12:01:21,997][123090] Updated weights for policy 1, policy_version 1546125 (0.0010) [2023-12-26 12:01:22,065][123090] Updated weights for policy 1, policy_version 1546135 (0.0011) [2023-12-26 12:01:22,284][123091] Updated weights for policy 0, policy_version 1556435 (0.0007) [2023-12-26 12:01:22,356][123091] Updated weights for policy 0, policy_version 1556445 (0.0010) [2023-12-26 12:01:22,422][123091] Updated weights for policy 0, policy_version 1556455 (0.0011) [2023-12-26 12:01:22,806][123090] Updated weights for policy 1, policy_version 1546145 (0.0010) [2023-12-26 12:01:22,876][123090] Updated weights for policy 1, policy_version 1546155 (0.0009) [2023-12-26 12:01:22,945][123090] Updated weights for policy 1, policy_version 1546165 (0.0009) [2023-12-26 12:01:23,004][123090] Updated weights for policy 1, policy_version 1546175 (0.0009) [2023-12-26 12:01:23,215][123091] Updated weights for policy 0, policy_version 1556465 (0.0011) [2023-12-26 12:01:23,270][123091] Updated weights for policy 0, policy_version 1556475 (0.0011) [2023-12-26 12:01:23,318][123091] Updated weights for policy 0, policy_version 1556485 (0.0010) [2023-12-26 12:01:23,366][123091] Updated weights for policy 0, policy_version 1556495 (0.0010) [2023-12-26 12:01:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 794288128. Throughput: 0: 8777.5, 1: 8764.0. Samples: 794267168. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:23,785][121949] Avg episode reward: [(0, '6033.692'), (1, '4988.117')] [2023-12-26 12:01:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001556496_398467072.pth... [2023-12-26 12:01:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001555440_398196736.pth [2023-12-26 12:01:23,812][123090] Updated weights for policy 1, policy_version 1546185 (0.0008) [2023-12-26 12:01:23,861][123090] Updated weights for policy 1, policy_version 1546195 (0.0009) [2023-12-26 12:01:23,918][123090] Updated weights for policy 1, policy_version 1546206 (0.0008) [2023-12-26 12:01:23,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001546208_395829248.pth... [2023-12-26 12:01:23,933][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001545184_395567104.pth [2023-12-26 12:01:24,239][123091] Updated weights for policy 0, policy_version 1556505 (0.0009) [2023-12-26 12:01:24,300][123091] Updated weights for policy 0, policy_version 1556515 (0.0008) [2023-12-26 12:01:24,350][123091] Updated weights for policy 0, policy_version 1556525 (0.0009) [2023-12-26 12:01:24,678][123090] Updated weights for policy 1, policy_version 1546216 (0.0006) [2023-12-26 12:01:24,727][123090] Updated weights for policy 1, policy_version 1546226 (0.0005) [2023-12-26 12:01:24,780][123090] Updated weights for policy 1, policy_version 1546237 (0.0009) [2023-12-26 12:01:25,119][123091] Updated weights for policy 0, policy_version 1556535 (0.0007) [2023-12-26 12:01:25,186][123091] Updated weights for policy 0, policy_version 1556545 (0.0009) [2023-12-26 12:01:25,237][123091] Updated weights for policy 0, policy_version 1556555 (0.0009) [2023-12-26 12:01:25,504][123090] Updated weights for policy 1, policy_version 1546247 (0.0007) [2023-12-26 12:01:25,567][123090] Updated weights for policy 1, policy_version 1546257 (0.0005) [2023-12-26 12:01:25,634][123090] Updated weights for policy 1, policy_version 1546267 (0.0005) [2023-12-26 12:01:25,994][123091] Updated weights for policy 0, policy_version 1556565 (0.0008) [2023-12-26 12:01:26,057][123091] Updated weights for policy 0, policy_version 1556575 (0.0006) [2023-12-26 12:01:26,115][123091] Updated weights for policy 0, policy_version 1556585 (0.0006) [2023-12-26 12:01:26,306][123090] Updated weights for policy 1, policy_version 1546277 (0.0009) [2023-12-26 12:01:26,375][123090] Updated weights for policy 1, policy_version 1546287 (0.0010) [2023-12-26 12:01:26,444][123090] Updated weights for policy 1, policy_version 1546297 (0.0010) [2023-12-26 12:01:26,825][123091] Updated weights for policy 0, policy_version 1556595 (0.0009) [2023-12-26 12:01:26,873][123091] Updated weights for policy 0, policy_version 1556605 (0.0005) [2023-12-26 12:01:26,928][123091] Updated weights for policy 0, policy_version 1556615 (0.0006) [2023-12-26 12:01:27,249][123090] Updated weights for policy 1, policy_version 1546307 (0.0010) [2023-12-26 12:01:27,300][123090] Updated weights for policy 1, policy_version 1546317 (0.0010) [2023-12-26 12:01:27,351][123090] Updated weights for policy 1, policy_version 1546327 (0.0010) [2023-12-26 12:01:27,696][123091] Updated weights for policy 0, policy_version 1556625 (0.0010) [2023-12-26 12:01:27,758][123091] Updated weights for policy 0, policy_version 1556635 (0.0010) [2023-12-26 12:01:27,827][123091] Updated weights for policy 0, policy_version 1556645 (0.0010) [2023-12-26 12:01:27,885][123091] Updated weights for policy 0, policy_version 1556655 (0.0010) [2023-12-26 12:01:28,019][123090] Updated weights for policy 1, policy_version 1546337 (0.0009) [2023-12-26 12:01:28,068][123090] Updated weights for policy 1, policy_version 1546347 (0.0005) [2023-12-26 12:01:28,128][123090] Updated weights for policy 1, policy_version 1546357 (0.0007) [2023-12-26 12:01:28,184][123090] Updated weights for policy 1, policy_version 1546367 (0.0006) [2023-12-26 12:01:28,651][123091] Updated weights for policy 0, policy_version 1556665 (0.0010) [2023-12-26 12:01:28,709][123091] Updated weights for policy 0, policy_version 1556675 (0.0010) [2023-12-26 12:01:28,767][123091] Updated weights for policy 0, policy_version 1556685 (0.0011) [2023-12-26 12:01:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 794386432. Throughput: 0: 8889.8, 1: 8801.7. Samples: 794376728. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:28,784][121949] Avg episode reward: [(0, '6081.506'), (1, '5060.678')] [2023-12-26 12:01:28,855][123090] Updated weights for policy 1, policy_version 1546377 (0.0009) [2023-12-26 12:01:28,915][123090] Updated weights for policy 1, policy_version 1546387 (0.0010) [2023-12-26 12:01:28,977][123090] Updated weights for policy 1, policy_version 1546397 (0.0010) [2023-12-26 12:01:29,562][123091] Updated weights for policy 0, policy_version 1556695 (0.0009) [2023-12-26 12:01:29,623][123091] Updated weights for policy 0, policy_version 1556705 (0.0009) [2023-12-26 12:01:29,687][123091] Updated weights for policy 0, policy_version 1556715 (0.0008) [2023-12-26 12:01:29,820][123090] Updated weights for policy 1, policy_version 1546407 (0.0010) [2023-12-26 12:01:29,883][123090] Updated weights for policy 1, policy_version 1546417 (0.0010) [2023-12-26 12:01:29,956][123090] Updated weights for policy 1, policy_version 1546427 (0.0011) [2023-12-26 12:01:30,417][123091] Updated weights for policy 0, policy_version 1556725 (0.0005) [2023-12-26 12:01:30,490][123091] Updated weights for policy 0, policy_version 1556735 (0.0008) [2023-12-26 12:01:30,556][123091] Updated weights for policy 0, policy_version 1556745 (0.0009) [2023-12-26 12:01:30,728][123090] Updated weights for policy 1, policy_version 1546437 (0.0008) [2023-12-26 12:01:30,780][123090] Updated weights for policy 1, policy_version 1546447 (0.0005) [2023-12-26 12:01:30,847][123090] Updated weights for policy 1, policy_version 1546457 (0.0005) [2023-12-26 12:01:31,326][123091] Updated weights for policy 0, policy_version 1556755 (0.0010) [2023-12-26 12:01:31,400][123091] Updated weights for policy 0, policy_version 1556765 (0.0009) [2023-12-26 12:01:31,454][123091] Updated weights for policy 0, policy_version 1556775 (0.0009) [2023-12-26 12:01:31,655][123090] Updated weights for policy 1, policy_version 1546467 (0.0006) [2023-12-26 12:01:31,709][123090] Updated weights for policy 1, policy_version 1546477 (0.0007) [2023-12-26 12:01:31,770][123090] Updated weights for policy 1, policy_version 1546487 (0.0011) [2023-12-26 12:01:32,174][123091] Updated weights for policy 0, policy_version 1556785 (0.0008) [2023-12-26 12:01:32,235][123091] Updated weights for policy 0, policy_version 1556795 (0.0007) [2023-12-26 12:01:32,307][123091] Updated weights for policy 0, policy_version 1556805 (0.0008) [2023-12-26 12:01:32,381][123091] Updated weights for policy 0, policy_version 1556815 (0.0007) [2023-12-26 12:01:32,621][123090] Updated weights for policy 1, policy_version 1546497 (0.0009) [2023-12-26 12:01:32,667][123090] Updated weights for policy 1, policy_version 1546507 (0.0007) [2023-12-26 12:01:32,719][123090] Updated weights for policy 1, policy_version 1546517 (0.0005) [2023-12-26 12:01:32,767][123090] Updated weights for policy 1, policy_version 1546527 (0.0005) [2023-12-26 12:01:33,079][123091] Updated weights for policy 0, policy_version 1556825 (0.0010) [2023-12-26 12:01:33,145][123091] Updated weights for policy 0, policy_version 1556835 (0.0010) [2023-12-26 12:01:33,191][123091] Updated weights for policy 0, policy_version 1556845 (0.0010) [2023-12-26 12:01:33,567][123090] Updated weights for policy 1, policy_version 1546537 (0.0008) [2023-12-26 12:01:33,626][123090] Updated weights for policy 1, policy_version 1546547 (0.0008) [2023-12-26 12:01:33,686][123090] Updated weights for policy 1, policy_version 1546557 (0.0008) [2023-12-26 12:01:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 794476544. Throughput: 0: 8909.7, 1: 8794.4. Samples: 794486244. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:33,785][121949] Avg episode reward: [(0, '6014.265'), (1, '5154.931')] [2023-12-26 12:01:33,988][123091] Updated weights for policy 0, policy_version 1556855 (0.0009) [2023-12-26 12:01:34,052][123091] Updated weights for policy 0, policy_version 1556865 (0.0009) [2023-12-26 12:01:34,116][123091] Updated weights for policy 0, policy_version 1556875 (0.0010) [2023-12-26 12:01:34,564][123090] Updated weights for policy 1, policy_version 1546567 (0.0010) [2023-12-26 12:01:34,624][123090] Updated weights for policy 1, policy_version 1546577 (0.0010) [2023-12-26 12:01:34,679][123090] Updated weights for policy 1, policy_version 1546587 (0.0011) [2023-12-26 12:01:34,942][123091] Updated weights for policy 0, policy_version 1556885 (0.0012) [2023-12-26 12:01:34,994][123091] Updated weights for policy 0, policy_version 1556895 (0.0005) [2023-12-26 12:01:35,050][123091] Updated weights for policy 0, policy_version 1556905 (0.0006) [2023-12-26 12:01:35,411][123090] Updated weights for policy 1, policy_version 1546597 (0.0008) [2023-12-26 12:01:35,459][123090] Updated weights for policy 1, policy_version 1546607 (0.0005) [2023-12-26 12:01:35,519][123090] Updated weights for policy 1, policy_version 1546617 (0.0005) [2023-12-26 12:01:35,725][123091] Updated weights for policy 0, policy_version 1556915 (0.0005) [2023-12-26 12:01:35,775][123091] Updated weights for policy 0, policy_version 1556925 (0.0005) [2023-12-26 12:01:35,826][123091] Updated weights for policy 0, policy_version 1556935 (0.0005) [2023-12-26 12:01:36,065][123090] Updated weights for policy 1, policy_version 1546627 (0.0005) [2023-12-26 12:01:36,152][123090] Updated weights for policy 1, policy_version 1546637 (0.0007) [2023-12-26 12:01:36,218][123090] Updated weights for policy 1, policy_version 1546647 (0.0008) [2023-12-26 12:01:36,489][123091] Updated weights for policy 0, policy_version 1556945 (0.0005) [2023-12-26 12:01:36,544][123091] Updated weights for policy 0, policy_version 1556955 (0.0005) [2023-12-26 12:01:36,594][123091] Updated weights for policy 0, policy_version 1556965 (0.0010) [2023-12-26 12:01:36,650][123091] Updated weights for policy 0, policy_version 1556976 (0.0009) [2023-12-26 12:01:36,990][123090] Updated weights for policy 1, policy_version 1546657 (0.0008) [2023-12-26 12:01:37,053][123090] Updated weights for policy 1, policy_version 1546667 (0.0008) [2023-12-26 12:01:37,115][123090] Updated weights for policy 1, policy_version 1546677 (0.0006) [2023-12-26 12:01:37,163][123090] Updated weights for policy 1, policy_version 1546687 (0.0010) [2023-12-26 12:01:37,344][123091] Updated weights for policy 0, policy_version 1556986 (0.0005) [2023-12-26 12:01:37,409][123091] Updated weights for policy 0, policy_version 1556996 (0.0006) [2023-12-26 12:01:37,474][123091] Updated weights for policy 0, policy_version 1557006 (0.0005) [2023-12-26 12:01:37,888][123090] Updated weights for policy 1, policy_version 1546697 (0.0010) [2023-12-26 12:01:37,943][123090] Updated weights for policy 1, policy_version 1546709 (0.0011) [2023-12-26 12:01:37,997][123090] Updated weights for policy 1, policy_version 1546719 (0.0010) [2023-12-26 12:01:38,101][123091] Updated weights for policy 0, policy_version 1557016 (0.0010) [2023-12-26 12:01:38,149][123091] Updated weights for policy 0, policy_version 1557026 (0.0010) [2023-12-26 12:01:38,205][123091] Updated weights for policy 0, policy_version 1557036 (0.0010) [2023-12-26 12:01:38,761][123090] Updated weights for policy 1, policy_version 1546730 (0.0009) [2023-12-26 12:01:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 794566656. Throughput: 0: 9002.9, 1: 8809.5. Samples: 794543076. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:38,785][121949] Avg episode reward: [(0, '6127.324'), (1, '4889.266')] [2023-12-26 12:01:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001557040_398606336.pth... [2023-12-26 12:01:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001555984_398336000.pth [2023-12-26 12:01:38,822][123090] Updated weights for policy 1, policy_version 1546740 (0.0009) [2023-12-26 12:01:38,891][123090] Updated weights for policy 1, policy_version 1546750 (0.0009) [2023-12-26 12:01:38,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001546752_395968512.pth... [2023-12-26 12:01:38,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001545664_395689984.pth [2023-12-26 12:01:39,060][123091] Updated weights for policy 0, policy_version 1557046 (0.0008) [2023-12-26 12:01:39,122][123091] Updated weights for policy 0, policy_version 1557056 (0.0005) [2023-12-26 12:01:39,185][123091] Updated weights for policy 0, policy_version 1557066 (0.0005) [2023-12-26 12:01:39,792][123090] Updated weights for policy 1, policy_version 1546760 (0.0009) [2023-12-26 12:01:39,857][123090] Updated weights for policy 1, policy_version 1546770 (0.0008) [2023-12-26 12:01:39,914][123091] Updated weights for policy 0, policy_version 1557076 (0.0009) [2023-12-26 12:01:39,920][123090] Updated weights for policy 1, policy_version 1546780 (0.0009) [2023-12-26 12:01:39,985][123091] Updated weights for policy 0, policy_version 1557086 (0.0011) [2023-12-26 12:01:40,052][123091] Updated weights for policy 0, policy_version 1557096 (0.0011) [2023-12-26 12:01:40,732][123090] Updated weights for policy 1, policy_version 1546790 (0.0009) [2023-12-26 12:01:40,800][123090] Updated weights for policy 1, policy_version 1546800 (0.0010) [2023-12-26 12:01:40,852][123091] Updated weights for policy 0, policy_version 1557106 (0.0010) [2023-12-26 12:01:40,869][123090] Updated weights for policy 1, policy_version 1546810 (0.0009) [2023-12-26 12:01:40,911][123091] Updated weights for policy 0, policy_version 1557116 (0.0005) [2023-12-26 12:01:40,959][123091] Updated weights for policy 0, policy_version 1557126 (0.0008) [2023-12-26 12:01:41,011][123091] Updated weights for policy 0, policy_version 1557136 (0.0010) [2023-12-26 12:01:41,772][123090] Updated weights for policy 1, policy_version 1546820 (0.0009) [2023-12-26 12:01:41,832][123090] Updated weights for policy 1, policy_version 1546830 (0.0009) [2023-12-26 12:01:41,842][123091] Updated weights for policy 0, policy_version 1557146 (0.0008) [2023-12-26 12:01:41,894][123090] Updated weights for policy 1, policy_version 1546840 (0.0008) [2023-12-26 12:01:41,905][123091] Updated weights for policy 0, policy_version 1557156 (0.0008) [2023-12-26 12:01:41,971][123091] Updated weights for policy 0, policy_version 1557166 (0.0008) [2023-12-26 12:01:42,672][123090] Updated weights for policy 1, policy_version 1546850 (0.0008) [2023-12-26 12:01:42,748][123090] Updated weights for policy 1, policy_version 1546860 (0.0008) [2023-12-26 12:01:42,803][123091] Updated weights for policy 0, policy_version 1557176 (0.0007) [2023-12-26 12:01:42,814][123090] Updated weights for policy 1, policy_version 1546870 (0.0009) [2023-12-26 12:01:42,854][123091] Updated weights for policy 0, policy_version 1557186 (0.0010) [2023-12-26 12:01:42,870][123090] Updated weights for policy 1, policy_version 1546880 (0.0006) [2023-12-26 12:01:42,902][123091] Updated weights for policy 0, policy_version 1557196 (0.0010) [2023-12-26 12:01:43,668][123091] Updated weights for policy 0, policy_version 1557206 (0.0007) [2023-12-26 12:01:43,694][123090] Updated weights for policy 1, policy_version 1546890 (0.0008) [2023-12-26 12:01:43,730][123091] Updated weights for policy 0, policy_version 1557216 (0.0005) [2023-12-26 12:01:43,757][123090] Updated weights for policy 1, policy_version 1546900 (0.0009) [2023-12-26 12:01:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 794648576. Throughput: 0: 9041.1, 1: 8817.3. Samples: 794649876. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:43,785][121949] Avg episode reward: [(0, '6336.153'), (1, '4882.293')] [2023-12-26 12:01:43,791][123091] Updated weights for policy 0, policy_version 1557226 (0.0005) [2023-12-26 12:01:43,819][123090] Updated weights for policy 1, policy_version 1546910 (0.0009) [2023-12-26 12:01:44,377][123091] Updated weights for policy 0, policy_version 1557236 (0.0005) [2023-12-26 12:01:44,445][123091] Updated weights for policy 0, policy_version 1557246 (0.0006) [2023-12-26 12:01:44,505][123091] Updated weights for policy 0, policy_version 1557256 (0.0005) [2023-12-26 12:01:44,746][123090] Updated weights for policy 1, policy_version 1546920 (0.0009) [2023-12-26 12:01:44,831][123090] Updated weights for policy 1, policy_version 1546930 (0.0009) [2023-12-26 12:01:44,898][123090] Updated weights for policy 1, policy_version 1546940 (0.0009) [2023-12-26 12:01:45,239][123091] Updated weights for policy 0, policy_version 1557266 (0.0007) [2023-12-26 12:01:45,305][123091] Updated weights for policy 0, policy_version 1557276 (0.0010) [2023-12-26 12:01:45,367][123091] Updated weights for policy 0, policy_version 1557286 (0.0010) [2023-12-26 12:01:45,431][123091] Updated weights for policy 0, policy_version 1557296 (0.0010) [2023-12-26 12:01:45,758][123090] Updated weights for policy 1, policy_version 1546950 (0.0009) [2023-12-26 12:01:45,820][123090] Updated weights for policy 1, policy_version 1546960 (0.0010) [2023-12-26 12:01:45,888][123090] Updated weights for policy 1, policy_version 1546970 (0.0010) [2023-12-26 12:01:46,167][123091] Updated weights for policy 0, policy_version 1557306 (0.0006) [2023-12-26 12:01:46,232][123091] Updated weights for policy 0, policy_version 1557316 (0.0005) [2023-12-26 12:01:46,294][123091] Updated weights for policy 0, policy_version 1557326 (0.0006) [2023-12-26 12:01:46,811][123090] Updated weights for policy 1, policy_version 1546980 (0.0010) [2023-12-26 12:01:46,869][123090] Updated weights for policy 1, policy_version 1546990 (0.0009) [2023-12-26 12:01:46,920][123090] Updated weights for policy 1, policy_version 1547000 (0.0010) [2023-12-26 12:01:46,974][123091] Updated weights for policy 0, policy_version 1557336 (0.0007) [2023-12-26 12:01:47,031][123091] Updated weights for policy 0, policy_version 1557346 (0.0009) [2023-12-26 12:01:47,088][123091] Updated weights for policy 0, policy_version 1557356 (0.0008) [2023-12-26 12:01:47,737][123090] Updated weights for policy 1, policy_version 1547010 (0.0009) [2023-12-26 12:01:47,792][123090] Updated weights for policy 1, policy_version 1547020 (0.0009) [2023-12-26 12:01:47,847][123090] Updated weights for policy 1, policy_version 1547030 (0.0009) [2023-12-26 12:01:47,894][123090] Updated weights for policy 1, policy_version 1547040 (0.0009) [2023-12-26 12:01:47,919][123091] Updated weights for policy 0, policy_version 1557366 (0.0009) [2023-12-26 12:01:47,975][123091] Updated weights for policy 0, policy_version 1557376 (0.0009) [2023-12-26 12:01:48,031][123091] Updated weights for policy 0, policy_version 1557386 (0.0009) [2023-12-26 12:01:48,776][123090] Updated weights for policy 1, policy_version 1547050 (0.0010) [2023-12-26 12:01:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 794738688. Throughput: 0: 9080.9, 1: 8767.6. Samples: 794754480. Policy #0 lag: (min: 17.0, avg: 31.1, max: 32.0) [2023-12-26 12:01:48,785][121949] Avg episode reward: [(0, '6261.111'), (1, '5211.633')] [2023-12-26 12:01:48,840][123090] Updated weights for policy 1, policy_version 1547060 (0.0008) [2023-12-26 12:01:48,855][123091] Updated weights for policy 0, policy_version 1557396 (0.0009) [2023-12-26 12:01:48,897][123090] Updated weights for policy 1, policy_version 1547070 (0.0009) [2023-12-26 12:01:48,921][123091] Updated weights for policy 0, policy_version 1557406 (0.0006) [2023-12-26 12:01:48,981][123091] Updated weights for policy 0, policy_version 1557416 (0.0005) [2023-12-26 12:01:49,730][123090] Updated weights for policy 1, policy_version 1547080 (0.0010) [2023-12-26 12:01:49,746][123091] Updated weights for policy 0, policy_version 1557426 (0.0006) [2023-12-26 12:01:49,789][123090] Updated weights for policy 1, policy_version 1547090 (0.0008) [2023-12-26 12:01:49,810][123091] Updated weights for policy 0, policy_version 1557436 (0.0009) [2023-12-26 12:01:49,849][123090] Updated weights for policy 1, policy_version 1547100 (0.0010) [2023-12-26 12:01:49,879][123091] Updated weights for policy 0, policy_version 1557446 (0.0008) [2023-12-26 12:01:49,948][123091] Updated weights for policy 0, policy_version 1557456 (0.0008) [2023-12-26 12:01:50,689][123091] Updated weights for policy 0, policy_version 1557466 (0.0010) [2023-12-26 12:01:50,749][123091] Updated weights for policy 0, policy_version 1557476 (0.0009) [2023-12-26 12:01:50,805][123090] Updated weights for policy 1, policy_version 1547110 (0.0008) [2023-12-26 12:01:50,818][123091] Updated weights for policy 0, policy_version 1557486 (0.0009) [2023-12-26 12:01:50,867][123090] Updated weights for policy 1, policy_version 1547120 (0.0009) [2023-12-26 12:01:50,942][123090] Updated weights for policy 1, policy_version 1547131 (0.0010) [2023-12-26 12:01:51,647][123091] Updated weights for policy 0, policy_version 1557496 (0.0009) [2023-12-26 12:01:51,717][123090] Updated weights for policy 1, policy_version 1547141 (0.0008) [2023-12-26 12:01:51,721][123091] Updated weights for policy 0, policy_version 1557506 (0.0013) [2023-12-26 12:01:51,777][123091] Updated weights for policy 0, policy_version 1557516 (0.0010) [2023-12-26 12:01:51,782][123090] Updated weights for policy 1, policy_version 1547151 (0.0011) [2023-12-26 12:01:51,840][123090] Updated weights for policy 1, policy_version 1547161 (0.0010) [2023-12-26 12:01:52,596][123091] Updated weights for policy 0, policy_version 1557526 (0.0008) [2023-12-26 12:01:52,632][123090] Updated weights for policy 1, policy_version 1547171 (0.0009) [2023-12-26 12:01:52,658][123091] Updated weights for policy 0, policy_version 1557536 (0.0006) [2023-12-26 12:01:52,699][123090] Updated weights for policy 1, policy_version 1547181 (0.0005) [2023-12-26 12:01:52,704][123091] Updated weights for policy 0, policy_version 1557546 (0.0005) [2023-12-26 12:01:52,765][123090] Updated weights for policy 1, policy_version 1547191 (0.0008) [2023-12-26 12:01:53,463][123090] Updated weights for policy 1, policy_version 1547201 (0.0010) [2023-12-26 12:01:53,464][123091] Updated weights for policy 0, policy_version 1557556 (0.0005) [2023-12-26 12:01:53,520][123090] Updated weights for policy 1, policy_version 1547211 (0.0006) [2023-12-26 12:01:53,526][123091] Updated weights for policy 0, policy_version 1557566 (0.0005) [2023-12-26 12:01:53,581][123090] Updated weights for policy 1, policy_version 1547221 (0.0006) [2023-12-26 12:01:53,599][123091] Updated weights for policy 0, policy_version 1557576 (0.0005) [2023-12-26 12:01:53,641][123090] Updated weights for policy 1, policy_version 1547231 (0.0006) [2023-12-26 12:01:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 794836992. Throughput: 0: 9084.3, 1: 8767.0. Samples: 794806532. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:01:53,785][121949] Avg episode reward: [(0, '6204.472'), (1, '5213.281')] [2023-12-26 12:01:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001547232_396091392.pth... [2023-12-26 12:01:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001557584_398745600.pth... [2023-12-26 12:01:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001546208_395829248.pth [2023-12-26 12:01:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001556496_398467072.pth [2023-12-26 12:01:54,271][123091] Updated weights for policy 0, policy_version 1557586 (0.0006) [2023-12-26 12:01:54,309][123090] Updated weights for policy 1, policy_version 1547241 (0.0009) [2023-12-26 12:01:54,329][123091] Updated weights for policy 0, policy_version 1557596 (0.0005) [2023-12-26 12:01:54,371][123090] Updated weights for policy 1, policy_version 1547251 (0.0009) [2023-12-26 12:01:54,390][123091] Updated weights for policy 0, policy_version 1557606 (0.0006) [2023-12-26 12:01:54,430][123090] Updated weights for policy 1, policy_version 1547261 (0.0009) [2023-12-26 12:01:54,454][123091] Updated weights for policy 0, policy_version 1557616 (0.0005) [2023-12-26 12:01:55,101][123091] Updated weights for policy 0, policy_version 1557626 (0.0010) [2023-12-26 12:01:55,156][123091] Updated weights for policy 0, policy_version 1557636 (0.0011) [2023-12-26 12:01:55,226][123091] Updated weights for policy 0, policy_version 1557646 (0.0011) [2023-12-26 12:01:55,261][123090] Updated weights for policy 1, policy_version 1547271 (0.0008) [2023-12-26 12:01:55,325][123090] Updated weights for policy 1, policy_version 1547281 (0.0009) [2023-12-26 12:01:55,381][123090] Updated weights for policy 1, policy_version 1547291 (0.0008) [2023-12-26 12:01:56,072][123091] Updated weights for policy 0, policy_version 1557656 (0.0011) [2023-12-26 12:01:56,124][123090] Updated weights for policy 1, policy_version 1547301 (0.0007) [2023-12-26 12:01:56,129][123091] Updated weights for policy 0, policy_version 1557666 (0.0007) [2023-12-26 12:01:56,189][123091] Updated weights for policy 0, policy_version 1557676 (0.0005) [2023-12-26 12:01:56,194][123090] Updated weights for policy 1, policy_version 1547311 (0.0006) [2023-12-26 12:01:56,259][123090] Updated weights for policy 1, policy_version 1547321 (0.0005) [2023-12-26 12:01:56,860][123091] Updated weights for policy 0, policy_version 1557686 (0.0005) [2023-12-26 12:01:56,933][123091] Updated weights for policy 0, policy_version 1557696 (0.0005) [2023-12-26 12:01:56,991][123090] Updated weights for policy 1, policy_version 1547331 (0.0005) [2023-12-26 12:01:57,000][123091] Updated weights for policy 0, policy_version 1557706 (0.0010) [2023-12-26 12:01:57,038][123090] Updated weights for policy 1, policy_version 1547341 (0.0007) [2023-12-26 12:01:57,089][123090] Updated weights for policy 1, policy_version 1547351 (0.0008) [2023-12-26 12:01:57,748][123091] Updated weights for policy 0, policy_version 1557716 (0.0010) [2023-12-26 12:01:57,802][123091] Updated weights for policy 0, policy_version 1557726 (0.0009) [2023-12-26 12:01:57,860][123091] Updated weights for policy 0, policy_version 1557736 (0.0005) [2023-12-26 12:01:57,958][123090] Updated weights for policy 1, policy_version 1547362 (0.0009) [2023-12-26 12:01:58,011][123090] Updated weights for policy 1, policy_version 1547372 (0.0009) [2023-12-26 12:01:58,070][123090] Updated weights for policy 1, policy_version 1547382 (0.0009) [2023-12-26 12:01:58,129][123090] Updated weights for policy 1, policy_version 1547392 (0.0009) [2023-12-26 12:01:58,741][123091] Updated weights for policy 0, policy_version 1557746 (0.0006) [2023-12-26 12:01:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.9, 300 sec: 17689.2). Total num frames: 794918912. Throughput: 0: 9182.5, 1: 8826.3. Samples: 794917592. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:01:58,784][121949] Avg episode reward: [(0, '6243.916'), (1, '5078.050')] [2023-12-26 12:01:58,800][123091] Updated weights for policy 0, policy_version 1557756 (0.0011) [2023-12-26 12:01:58,864][123091] Updated weights for policy 0, policy_version 1557766 (0.0011) [2023-12-26 12:01:58,928][123091] Updated weights for policy 0, policy_version 1557776 (0.0010) [2023-12-26 12:01:59,074][123090] Updated weights for policy 1, policy_version 1547402 (0.0009) [2023-12-26 12:01:59,143][123090] Updated weights for policy 1, policy_version 1547412 (0.0009) [2023-12-26 12:01:59,211][123090] Updated weights for policy 1, policy_version 1547422 (0.0008) [2023-12-26 12:01:59,766][123091] Updated weights for policy 0, policy_version 1557786 (0.0007) [2023-12-26 12:01:59,828][123091] Updated weights for policy 0, policy_version 1557796 (0.0006) [2023-12-26 12:01:59,883][123091] Updated weights for policy 0, policy_version 1557806 (0.0007) [2023-12-26 12:02:00,075][123090] Updated weights for policy 1, policy_version 1547432 (0.0009) [2023-12-26 12:02:00,127][123090] Updated weights for policy 1, policy_version 1547442 (0.0009) [2023-12-26 12:02:00,176][123090] Updated weights for policy 1, policy_version 1547452 (0.0009) [2023-12-26 12:02:00,662][123091] Updated weights for policy 0, policy_version 1557816 (0.0010) [2023-12-26 12:02:00,719][123091] Updated weights for policy 0, policy_version 1557826 (0.0006) [2023-12-26 12:02:00,779][123091] Updated weights for policy 0, policy_version 1557836 (0.0005) [2023-12-26 12:02:01,070][123090] Updated weights for policy 1, policy_version 1547462 (0.0009) [2023-12-26 12:02:01,140][123090] Updated weights for policy 1, policy_version 1547472 (0.0010) [2023-12-26 12:02:01,199][123090] Updated weights for policy 1, policy_version 1547482 (0.0010) [2023-12-26 12:02:01,476][123091] Updated weights for policy 0, policy_version 1557846 (0.0007) [2023-12-26 12:02:01,533][123091] Updated weights for policy 0, policy_version 1557856 (0.0009) [2023-12-26 12:02:01,599][123091] Updated weights for policy 0, policy_version 1557866 (0.0009) [2023-12-26 12:02:02,051][123090] Updated weights for policy 1, policy_version 1547493 (0.0008) [2023-12-26 12:02:02,110][123090] Updated weights for policy 1, policy_version 1547503 (0.0006) [2023-12-26 12:02:02,166][123090] Updated weights for policy 1, policy_version 1547513 (0.0009) [2023-12-26 12:02:02,378][123091] Updated weights for policy 0, policy_version 1557876 (0.0011) [2023-12-26 12:02:02,444][123091] Updated weights for policy 0, policy_version 1557886 (0.0011) [2023-12-26 12:02:02,496][123091] Updated weights for policy 0, policy_version 1557896 (0.0010) [2023-12-26 12:02:02,956][123090] Updated weights for policy 1, policy_version 1547523 (0.0008) [2023-12-26 12:02:03,021][123090] Updated weights for policy 1, policy_version 1547533 (0.0005) [2023-12-26 12:02:03,090][123090] Updated weights for policy 1, policy_version 1547543 (0.0006) [2023-12-26 12:02:03,320][123091] Updated weights for policy 0, policy_version 1557906 (0.0010) [2023-12-26 12:02:03,369][123091] Updated weights for policy 0, policy_version 1557916 (0.0006) [2023-12-26 12:02:03,415][123091] Updated weights for policy 0, policy_version 1557926 (0.0005) [2023-12-26 12:02:03,466][123091] Updated weights for policy 0, policy_version 1557936 (0.0005) [2023-12-26 12:02:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 795009024. Throughput: 0: 9141.1, 1: 8775.5. Samples: 795020736. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:03,785][121949] Avg episode reward: [(0, '6157.643'), (1, '4894.872')] [2023-12-26 12:02:03,841][123090] Updated weights for policy 1, policy_version 1547553 (0.0008) [2023-12-26 12:02:03,898][123090] Updated weights for policy 1, policy_version 1547563 (0.0009) [2023-12-26 12:02:03,955][123090] Updated weights for policy 1, policy_version 1547573 (0.0008) [2023-12-26 12:02:04,025][123090] Updated weights for policy 1, policy_version 1547583 (0.0005) [2023-12-26 12:02:04,279][123091] Updated weights for policy 0, policy_version 1557946 (0.0011) [2023-12-26 12:02:04,343][123091] Updated weights for policy 0, policy_version 1557956 (0.0011) [2023-12-26 12:02:04,395][123091] Updated weights for policy 0, policy_version 1557966 (0.0010) [2023-12-26 12:02:04,836][123090] Updated weights for policy 1, policy_version 1547593 (0.0010) [2023-12-26 12:02:04,884][123090] Updated weights for policy 1, policy_version 1547603 (0.0010) [2023-12-26 12:02:04,936][123090] Updated weights for policy 1, policy_version 1547613 (0.0006) [2023-12-26 12:02:05,180][123091] Updated weights for policy 0, policy_version 1557976 (0.0006) [2023-12-26 12:02:05,230][123091] Updated weights for policy 0, policy_version 1557986 (0.0008) [2023-12-26 12:02:05,280][123091] Updated weights for policy 0, policy_version 1557996 (0.0008) [2023-12-26 12:02:05,659][123090] Updated weights for policy 1, policy_version 1547623 (0.0005) [2023-12-26 12:02:05,716][123090] Updated weights for policy 1, policy_version 1547633 (0.0006) [2023-12-26 12:02:05,775][123090] Updated weights for policy 1, policy_version 1547643 (0.0006) [2023-12-26 12:02:05,918][123091] Updated weights for policy 0, policy_version 1558006 (0.0005) [2023-12-26 12:02:05,974][123091] Updated weights for policy 0, policy_version 1558016 (0.0010) [2023-12-26 12:02:06,037][123091] Updated weights for policy 0, policy_version 1558026 (0.0005) [2023-12-26 12:02:06,580][123090] Updated weights for policy 1, policy_version 1547653 (0.0011) [2023-12-26 12:02:06,625][123090] Updated weights for policy 1, policy_version 1547663 (0.0010) [2023-12-26 12:02:06,678][123090] Updated weights for policy 1, policy_version 1547673 (0.0011) [2023-12-26 12:02:06,723][123091] Updated weights for policy 0, policy_version 1558036 (0.0007) [2023-12-26 12:02:06,781][123091] Updated weights for policy 0, policy_version 1558046 (0.0008) [2023-12-26 12:02:06,832][123091] Updated weights for policy 0, policy_version 1558056 (0.0009) [2023-12-26 12:02:07,538][123090] Updated weights for policy 1, policy_version 1547683 (0.0011) [2023-12-26 12:02:07,586][123090] Updated weights for policy 1, policy_version 1547693 (0.0010) [2023-12-26 12:02:07,638][123090] Updated weights for policy 1, policy_version 1547703 (0.0010) [2023-12-26 12:02:07,682][123091] Updated weights for policy 0, policy_version 1558066 (0.0011) [2023-12-26 12:02:07,748][123091] Updated weights for policy 0, policy_version 1558076 (0.0011) [2023-12-26 12:02:07,811][123091] Updated weights for policy 0, policy_version 1558086 (0.0011) [2023-12-26 12:02:07,871][123091] Updated weights for policy 0, policy_version 1558096 (0.0011) [2023-12-26 12:02:08,356][123090] Updated weights for policy 1, policy_version 1547713 (0.0010) [2023-12-26 12:02:08,425][123090] Updated weights for policy 1, policy_version 1547723 (0.0008) [2023-12-26 12:02:08,488][123090] Updated weights for policy 1, policy_version 1547733 (0.0009) [2023-12-26 12:02:08,557][123090] Updated weights for policy 1, policy_version 1547743 (0.0008) [2023-12-26 12:02:08,606][123091] Updated weights for policy 0, policy_version 1558106 (0.0005) [2023-12-26 12:02:08,663][123091] Updated weights for policy 0, policy_version 1558116 (0.0005) [2023-12-26 12:02:08,722][123091] Updated weights for policy 0, policy_version 1558126 (0.0006) [2023-12-26 12:02:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 795107328. Throughput: 0: 9191.7, 1: 8794.4. Samples: 795076544. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:08,784][121949] Avg episode reward: [(0, '6056.101'), (1, '5010.905')] [2023-12-26 12:02:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001558128_398884864.pth... [2023-12-26 12:02:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001547744_396222464.pth... [2023-12-26 12:02:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001557040_398606336.pth [2023-12-26 12:02:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001546752_395968512.pth [2023-12-26 12:02:09,323][123090] Updated weights for policy 1, policy_version 1547753 (0.0007) [2023-12-26 12:02:09,393][123090] Updated weights for policy 1, policy_version 1547763 (0.0010) [2023-12-26 12:02:09,464][123090] Updated weights for policy 1, policy_version 1547773 (0.0010) [2023-12-26 12:02:09,533][123091] Updated weights for policy 0, policy_version 1558136 (0.0006) [2023-12-26 12:02:09,601][123091] Updated weights for policy 0, policy_version 1558146 (0.0005) [2023-12-26 12:02:09,669][123091] Updated weights for policy 0, policy_version 1558156 (0.0009) [2023-12-26 12:02:10,287][123090] Updated weights for policy 1, policy_version 1547783 (0.0007) [2023-12-26 12:02:10,346][123090] Updated weights for policy 1, policy_version 1547793 (0.0005) [2023-12-26 12:02:10,416][123090] Updated weights for policy 1, policy_version 1547803 (0.0005) [2023-12-26 12:02:10,500][123091] Updated weights for policy 0, policy_version 1558166 (0.0009) [2023-12-26 12:02:10,553][123091] Updated weights for policy 0, policy_version 1558176 (0.0010) [2023-12-26 12:02:10,606][123091] Updated weights for policy 0, policy_version 1558186 (0.0009) [2023-12-26 12:02:11,142][123090] Updated weights for policy 1, policy_version 1547813 (0.0007) [2023-12-26 12:02:11,215][123090] Updated weights for policy 1, policy_version 1547823 (0.0009) [2023-12-26 12:02:11,287][123090] Updated weights for policy 1, policy_version 1547833 (0.0009) [2023-12-26 12:02:11,531][123091] Updated weights for policy 0, policy_version 1558197 (0.0011) [2023-12-26 12:02:11,596][123091] Updated weights for policy 0, policy_version 1558207 (0.0009) [2023-12-26 12:02:11,656][123091] Updated weights for policy 0, policy_version 1558217 (0.0010) [2023-12-26 12:02:12,084][123090] Updated weights for policy 1, policy_version 1547843 (0.0010) [2023-12-26 12:02:12,146][123090] Updated weights for policy 1, policy_version 1547853 (0.0007) [2023-12-26 12:02:12,216][123090] Updated weights for policy 1, policy_version 1547863 (0.0006) [2023-12-26 12:02:12,550][123091] Updated weights for policy 0, policy_version 1558227 (0.0009) [2023-12-26 12:02:12,599][123091] Updated weights for policy 0, policy_version 1558237 (0.0009) [2023-12-26 12:02:12,655][123091] Updated weights for policy 0, policy_version 1558248 (0.0010) [2023-12-26 12:02:12,994][123090] Updated weights for policy 1, policy_version 1547873 (0.0008) [2023-12-26 12:02:13,058][123090] Updated weights for policy 1, policy_version 1547883 (0.0010) [2023-12-26 12:02:13,135][123090] Updated weights for policy 1, policy_version 1547893 (0.0009) [2023-12-26 12:02:13,196][123090] Updated weights for policy 1, policy_version 1547903 (0.0010) [2023-12-26 12:02:13,486][123091] Updated weights for policy 0, policy_version 1558259 (0.0010) [2023-12-26 12:02:13,549][123091] Updated weights for policy 0, policy_version 1558269 (0.0009) [2023-12-26 12:02:13,599][123091] Updated weights for policy 0, policy_version 1558280 (0.0009) [2023-12-26 12:02:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 795189248. Throughput: 0: 9113.0, 1: 8766.4. Samples: 795181308. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:13,785][121949] Avg episode reward: [(0, '6140.286'), (1, '5330.855')] [2023-12-26 12:02:14,025][123090] Updated weights for policy 1, policy_version 1547913 (0.0010) [2023-12-26 12:02:14,076][123090] Updated weights for policy 1, policy_version 1547924 (0.0009) [2023-12-26 12:02:14,131][123090] Updated weights for policy 1, policy_version 1547934 (0.0009) [2023-12-26 12:02:14,408][123091] Updated weights for policy 0, policy_version 1558290 (0.0010) [2023-12-26 12:02:14,460][123091] Updated weights for policy 0, policy_version 1558300 (0.0009) [2023-12-26 12:02:14,511][123091] Updated weights for policy 0, policy_version 1558310 (0.0010) [2023-12-26 12:02:14,572][123091] Updated weights for policy 0, policy_version 1558320 (0.0008) [2023-12-26 12:02:15,027][123090] Updated weights for policy 1, policy_version 1547944 (0.0010) [2023-12-26 12:02:15,093][123090] Updated weights for policy 1, policy_version 1547954 (0.0009) [2023-12-26 12:02:15,162][123090] Updated weights for policy 1, policy_version 1547964 (0.0006) [2023-12-26 12:02:15,457][123091] Updated weights for policy 0, policy_version 1558330 (0.0010) [2023-12-26 12:02:15,509][123091] Updated weights for policy 0, policy_version 1558340 (0.0009) [2023-12-26 12:02:15,578][123091] Updated weights for policy 0, policy_version 1558350 (0.0009) [2023-12-26 12:02:15,828][123090] Updated weights for policy 1, policy_version 1547974 (0.0008) [2023-12-26 12:02:15,885][123090] Updated weights for policy 1, policy_version 1547984 (0.0009) [2023-12-26 12:02:15,938][123090] Updated weights for policy 1, policy_version 1547994 (0.0009) [2023-12-26 12:02:16,419][123091] Updated weights for policy 0, policy_version 1558360 (0.0009) [2023-12-26 12:02:16,487][123091] Updated weights for policy 0, policy_version 1558370 (0.0010) [2023-12-26 12:02:16,548][123091] Updated weights for policy 0, policy_version 1558380 (0.0010) [2023-12-26 12:02:16,791][123090] Updated weights for policy 1, policy_version 1548004 (0.0009) [2023-12-26 12:02:16,853][123090] Updated weights for policy 1, policy_version 1548014 (0.0010) [2023-12-26 12:02:16,917][123090] Updated weights for policy 1, policy_version 1548024 (0.0009) [2023-12-26 12:02:17,390][123091] Updated weights for policy 0, policy_version 1558390 (0.0009) [2023-12-26 12:02:17,444][123091] Updated weights for policy 0, policy_version 1558400 (0.0010) [2023-12-26 12:02:17,500][123091] Updated weights for policy 0, policy_version 1558410 (0.0011) [2023-12-26 12:02:17,770][123090] Updated weights for policy 1, policy_version 1548034 (0.0009) [2023-12-26 12:02:17,830][123090] Updated weights for policy 1, policy_version 1548044 (0.0009) [2023-12-26 12:02:17,897][123090] Updated weights for policy 1, policy_version 1548054 (0.0010) [2023-12-26 12:02:18,333][123091] Updated weights for policy 0, policy_version 1558420 (0.0009) [2023-12-26 12:02:18,390][123091] Updated weights for policy 0, policy_version 1558430 (0.0008) [2023-12-26 12:02:18,446][123091] Updated weights for policy 0, policy_version 1558440 (0.0008) [2023-12-26 12:02:18,765][123090] Updated weights for policy 1, policy_version 1548065 (0.0010) [2023-12-26 12:02:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 795271168. Throughput: 0: 9043.8, 1: 8684.3. Samples: 795284008. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:18,784][121949] Avg episode reward: [(0, '6111.165'), (1, '5155.598')] [2023-12-26 12:02:18,831][123090] Updated weights for policy 1, policy_version 1548075 (0.0009) [2023-12-26 12:02:18,907][123090] Updated weights for policy 1, policy_version 1548085 (0.0010) [2023-12-26 12:02:18,966][123090] Updated weights for policy 1, policy_version 1548095 (0.0010) [2023-12-26 12:02:19,194][123091] Updated weights for policy 0, policy_version 1558450 (0.0008) [2023-12-26 12:02:19,270][123091] Updated weights for policy 0, policy_version 1558460 (0.0006) [2023-12-26 12:02:19,343][123091] Updated weights for policy 0, policy_version 1558470 (0.0007) [2023-12-26 12:02:19,410][123091] Updated weights for policy 0, policy_version 1558480 (0.0008) [2023-12-26 12:02:19,877][123090] Updated weights for policy 1, policy_version 1548105 (0.0009) [2023-12-26 12:02:19,936][123090] Updated weights for policy 1, policy_version 1548115 (0.0010) [2023-12-26 12:02:20,007][123090] Updated weights for policy 1, policy_version 1548125 (0.0010) [2023-12-26 12:02:20,118][123091] Updated weights for policy 0, policy_version 1558490 (0.0006) [2023-12-26 12:02:20,182][123091] Updated weights for policy 0, policy_version 1558500 (0.0007) [2023-12-26 12:02:20,237][123091] Updated weights for policy 0, policy_version 1558510 (0.0009) [2023-12-26 12:02:20,915][123090] Updated weights for policy 1, policy_version 1548135 (0.0009) [2023-12-26 12:02:20,979][123091] Updated weights for policy 0, policy_version 1558520 (0.0011) [2023-12-26 12:02:20,981][123090] Updated weights for policy 1, policy_version 1548145 (0.0008) [2023-12-26 12:02:21,050][123090] Updated weights for policy 1, policy_version 1548155 (0.0008) [2023-12-26 12:02:21,050][123091] Updated weights for policy 0, policy_version 1558530 (0.0009) [2023-12-26 12:02:21,117][123091] Updated weights for policy 0, policy_version 1558540 (0.0009) [2023-12-26 12:02:21,925][123090] Updated weights for policy 1, policy_version 1548165 (0.0008) [2023-12-26 12:02:21,949][123091] Updated weights for policy 0, policy_version 1558550 (0.0010) [2023-12-26 12:02:21,987][123090] Updated weights for policy 1, policy_version 1548175 (0.0007) [2023-12-26 12:02:22,009][123091] Updated weights for policy 0, policy_version 1558560 (0.0009) [2023-12-26 12:02:22,053][123090] Updated weights for policy 1, policy_version 1548185 (0.0007) [2023-12-26 12:02:22,075][123091] Updated weights for policy 0, policy_version 1558570 (0.0010) [2023-12-26 12:02:22,797][123090] Updated weights for policy 1, policy_version 1548195 (0.0007) [2023-12-26 12:02:22,857][123090] Updated weights for policy 1, policy_version 1548205 (0.0007) [2023-12-26 12:02:22,930][123090] Updated weights for policy 1, policy_version 1548215 (0.0009) [2023-12-26 12:02:22,958][123091] Updated weights for policy 0, policy_version 1558580 (0.0010) [2023-12-26 12:02:23,047][123091] Updated weights for policy 0, policy_version 1558590 (0.0010) [2023-12-26 12:02:23,100][123091] Updated weights for policy 0, policy_version 1558601 (0.0010) [2023-12-26 12:02:23,717][123090] Updated weights for policy 1, policy_version 1548225 (0.0007) [2023-12-26 12:02:23,782][123090] Updated weights for policy 1, policy_version 1548235 (0.0010) [2023-12-26 12:02:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 795353088. Throughput: 0: 9013.8, 1: 8587.8. Samples: 795335148. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:23,785][121949] Avg episode reward: [(0, '6091.559'), (1, '4986.869')] [2023-12-26 12:02:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001558608_399007744.pth... [2023-12-26 12:02:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001557584_398745600.pth [2023-12-26 12:02:23,843][123090] Updated weights for policy 1, policy_version 1548245 (0.0010) [2023-12-26 12:02:23,917][123091] Updated weights for policy 0, policy_version 1558611 (0.0008) [2023-12-26 12:02:23,924][123090] Updated weights for policy 1, policy_version 1548255 (0.0006) [2023-12-26 12:02:23,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001548256_396353536.pth... [2023-12-26 12:02:23,934][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001547232_396091392.pth [2023-12-26 12:02:23,964][123091] Updated weights for policy 0, policy_version 1558621 (0.0005) [2023-12-26 12:02:24,011][123091] Updated weights for policy 0, policy_version 1558631 (0.0006) [2023-12-26 12:02:24,716][123091] Updated weights for policy 0, policy_version 1558641 (0.0006) [2023-12-26 12:02:24,743][123090] Updated weights for policy 1, policy_version 1548265 (0.0009) [2023-12-26 12:02:24,775][123091] Updated weights for policy 0, policy_version 1558651 (0.0006) [2023-12-26 12:02:24,797][123090] Updated weights for policy 1, policy_version 1548275 (0.0009) [2023-12-26 12:02:24,838][123091] Updated weights for policy 0, policy_version 1558661 (0.0006) [2023-12-26 12:02:24,860][123090] Updated weights for policy 1, policy_version 1548285 (0.0008) [2023-12-26 12:02:24,893][123091] Updated weights for policy 0, policy_version 1558671 (0.0005) [2023-12-26 12:02:25,661][123090] Updated weights for policy 1, policy_version 1548295 (0.0007) [2023-12-26 12:02:25,710][123091] Updated weights for policy 0, policy_version 1558681 (0.0009) [2023-12-26 12:02:25,714][123090] Updated weights for policy 1, policy_version 1548305 (0.0005) [2023-12-26 12:02:25,762][123090] Updated weights for policy 1, policy_version 1548315 (0.0005) [2023-12-26 12:02:25,769][123091] Updated weights for policy 0, policy_version 1558691 (0.0010) [2023-12-26 12:02:25,839][123091] Updated weights for policy 0, policy_version 1558701 (0.0007) [2023-12-26 12:02:26,500][123090] Updated weights for policy 1, policy_version 1548325 (0.0008) [2023-12-26 12:02:26,565][123091] Updated weights for policy 0, policy_version 1558711 (0.0006) [2023-12-26 12:02:26,568][123090] Updated weights for policy 1, policy_version 1548335 (0.0009) [2023-12-26 12:02:26,622][123090] Updated weights for policy 1, policy_version 1548345 (0.0007) [2023-12-26 12:02:26,628][123091] Updated weights for policy 0, policy_version 1558721 (0.0008) [2023-12-26 12:02:26,694][123091] Updated weights for policy 0, policy_version 1558731 (0.0009) [2023-12-26 12:02:27,327][123090] Updated weights for policy 1, policy_version 1548355 (0.0008) [2023-12-26 12:02:27,396][123090] Updated weights for policy 1, policy_version 1548365 (0.0008) [2023-12-26 12:02:27,459][123090] Updated weights for policy 1, policy_version 1548375 (0.0008) [2023-12-26 12:02:27,480][123091] Updated weights for policy 0, policy_version 1558741 (0.0009) [2023-12-26 12:02:27,533][123091] Updated weights for policy 0, policy_version 1558751 (0.0009) [2023-12-26 12:02:27,589][123091] Updated weights for policy 0, policy_version 1558761 (0.0009) [2023-12-26 12:02:28,186][123090] Updated weights for policy 1, policy_version 1548385 (0.0007) [2023-12-26 12:02:28,246][123090] Updated weights for policy 1, policy_version 1548395 (0.0005) [2023-12-26 12:02:28,295][123090] Updated weights for policy 1, policy_version 1548405 (0.0005) [2023-12-26 12:02:28,361][123090] Updated weights for policy 1, policy_version 1548415 (0.0006) [2023-12-26 12:02:28,431][123091] Updated weights for policy 0, policy_version 1558771 (0.0008) [2023-12-26 12:02:28,477][123091] Updated weights for policy 0, policy_version 1558781 (0.0006) [2023-12-26 12:02:28,538][123091] Updated weights for policy 0, policy_version 1558791 (0.0006) [2023-12-26 12:02:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 795451392. Throughput: 0: 8976.4, 1: 8639.8. Samples: 795442608. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:28,785][121949] Avg episode reward: [(0, '6052.216'), (1, '5351.463')] [2023-12-26 12:02:29,181][123091] Updated weights for policy 0, policy_version 1558801 (0.0006) [2023-12-26 12:02:29,183][123090] Updated weights for policy 1, policy_version 1548425 (0.0006) [2023-12-26 12:02:29,246][123090] Updated weights for policy 1, policy_version 1548435 (0.0006) [2023-12-26 12:02:29,249][123091] Updated weights for policy 0, policy_version 1558811 (0.0007) [2023-12-26 12:02:29,311][123091] Updated weights for policy 0, policy_version 1558821 (0.0008) [2023-12-26 12:02:29,315][123090] Updated weights for policy 1, policy_version 1548445 (0.0008) [2023-12-26 12:02:29,373][123091] Updated weights for policy 0, policy_version 1558831 (0.0011) [2023-12-26 12:02:29,964][123090] Updated weights for policy 1, policy_version 1548455 (0.0010) [2023-12-26 12:02:30,030][123090] Updated weights for policy 1, policy_version 1548465 (0.0010) [2023-12-26 12:02:30,090][123090] Updated weights for policy 1, policy_version 1548475 (0.0010) [2023-12-26 12:02:30,114][123091] Updated weights for policy 0, policy_version 1558841 (0.0006) [2023-12-26 12:02:30,174][123091] Updated weights for policy 0, policy_version 1558851 (0.0006) [2023-12-26 12:02:30,232][123091] Updated weights for policy 0, policy_version 1558861 (0.0006) [2023-12-26 12:02:30,881][123091] Updated weights for policy 0, policy_version 1558871 (0.0005) [2023-12-26 12:02:30,904][123090] Updated weights for policy 1, policy_version 1548485 (0.0010) [2023-12-26 12:02:30,942][123091] Updated weights for policy 0, policy_version 1558881 (0.0008) [2023-12-26 12:02:30,955][123090] Updated weights for policy 1, policy_version 1548495 (0.0010) [2023-12-26 12:02:31,005][123090] Updated weights for policy 1, policy_version 1548505 (0.0010) [2023-12-26 12:02:31,007][123091] Updated weights for policy 0, policy_version 1558891 (0.0010) [2023-12-26 12:02:31,787][123090] Updated weights for policy 1, policy_version 1548515 (0.0009) [2023-12-26 12:02:31,832][123091] Updated weights for policy 0, policy_version 1558901 (0.0009) [2023-12-26 12:02:31,850][123090] Updated weights for policy 1, policy_version 1548525 (0.0011) [2023-12-26 12:02:31,880][123091] Updated weights for policy 0, policy_version 1558911 (0.0008) [2023-12-26 12:02:31,913][123090] Updated weights for policy 1, policy_version 1548535 (0.0010) [2023-12-26 12:02:31,937][123091] Updated weights for policy 0, policy_version 1558921 (0.0007) [2023-12-26 12:02:32,650][123090] Updated weights for policy 1, policy_version 1548545 (0.0009) [2023-12-26 12:02:32,714][123090] Updated weights for policy 1, policy_version 1548555 (0.0007) [2023-12-26 12:02:32,765][123091] Updated weights for policy 0, policy_version 1558931 (0.0007) [2023-12-26 12:02:32,779][123090] Updated weights for policy 1, policy_version 1548565 (0.0008) [2023-12-26 12:02:32,831][123091] Updated weights for policy 0, policy_version 1558941 (0.0008) [2023-12-26 12:02:32,845][123090] Updated weights for policy 1, policy_version 1548575 (0.0008) [2023-12-26 12:02:32,887][123091] Updated weights for policy 0, policy_version 1558951 (0.0010) [2023-12-26 12:02:33,507][123090] Updated weights for policy 1, policy_version 1548585 (0.0007) [2023-12-26 12:02:33,570][123090] Updated weights for policy 1, policy_version 1548595 (0.0009) [2023-12-26 12:02:33,626][123090] Updated weights for policy 1, policy_version 1548606 (0.0008) [2023-12-26 12:02:33,751][123091] Updated weights for policy 0, policy_version 1558961 (0.0010) [2023-12-26 12:02:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 795541504. Throughput: 0: 8952.9, 1: 8793.0. Samples: 795553044. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:33,785][121949] Avg episode reward: [(0, '6075.462'), (1, '5525.227')] [2023-12-26 12:02:33,821][123091] Updated weights for policy 0, policy_version 1558971 (0.0010) [2023-12-26 12:02:33,887][123091] Updated weights for policy 0, policy_version 1558981 (0.0009) [2023-12-26 12:02:33,956][123091] Updated weights for policy 0, policy_version 1558991 (0.0009) [2023-12-26 12:02:34,335][123090] Updated weights for policy 1, policy_version 1548616 (0.0009) [2023-12-26 12:02:34,402][123090] Updated weights for policy 1, policy_version 1548626 (0.0010) [2023-12-26 12:02:34,471][123090] Updated weights for policy 1, policy_version 1548636 (0.0009) [2023-12-26 12:02:34,734][123091] Updated weights for policy 0, policy_version 1559001 (0.0011) [2023-12-26 12:02:34,795][123091] Updated weights for policy 0, policy_version 1559011 (0.0010) [2023-12-26 12:02:34,855][123091] Updated weights for policy 0, policy_version 1559021 (0.0011) [2023-12-26 12:02:35,357][123090] Updated weights for policy 1, policy_version 1548646 (0.0009) [2023-12-26 12:02:35,412][123090] Updated weights for policy 1, policy_version 1548656 (0.0009) [2023-12-26 12:02:35,465][123090] Updated weights for policy 1, policy_version 1548666 (0.0009) [2023-12-26 12:02:35,594][123091] Updated weights for policy 0, policy_version 1559031 (0.0011) [2023-12-26 12:02:35,645][123091] Updated weights for policy 0, policy_version 1559041 (0.0010) [2023-12-26 12:02:35,692][123091] Updated weights for policy 0, policy_version 1559051 (0.0010) [2023-12-26 12:02:36,293][123090] Updated weights for policy 1, policy_version 1548676 (0.0009) [2023-12-26 12:02:36,342][123090] Updated weights for policy 1, policy_version 1548686 (0.0008) [2023-12-26 12:02:36,395][123090] Updated weights for policy 1, policy_version 1548696 (0.0009) [2023-12-26 12:02:36,553][123091] Updated weights for policy 0, policy_version 1559061 (0.0011) [2023-12-26 12:02:36,622][123091] Updated weights for policy 0, policy_version 1559071 (0.0011) [2023-12-26 12:02:36,686][123091] Updated weights for policy 0, policy_version 1559081 (0.0011) [2023-12-26 12:02:37,246][123090] Updated weights for policy 1, policy_version 1548706 (0.0009) [2023-12-26 12:02:37,317][123090] Updated weights for policy 1, policy_version 1548716 (0.0009) [2023-12-26 12:02:37,385][123090] Updated weights for policy 1, policy_version 1548726 (0.0008) [2023-12-26 12:02:37,450][123090] Updated weights for policy 1, policy_version 1548736 (0.0009) [2023-12-26 12:02:37,488][123091] Updated weights for policy 0, policy_version 1559091 (0.0009) [2023-12-26 12:02:37,538][123091] Updated weights for policy 0, policy_version 1559101 (0.0005) [2023-12-26 12:02:37,592][123091] Updated weights for policy 0, policy_version 1559111 (0.0006) [2023-12-26 12:02:38,194][123090] Updated weights for policy 1, policy_version 1548746 (0.0005) [2023-12-26 12:02:38,252][123090] Updated weights for policy 1, policy_version 1548756 (0.0005) [2023-12-26 12:02:38,252][123091] Updated weights for policy 0, policy_version 1559121 (0.0006) [2023-12-26 12:02:38,301][123090] Updated weights for policy 1, policy_version 1548766 (0.0005) [2023-12-26 12:02:38,315][123091] Updated weights for policy 0, policy_version 1559131 (0.0006) [2023-12-26 12:02:38,385][123091] Updated weights for policy 0, policy_version 1559141 (0.0007) [2023-12-26 12:02:38,454][123091] Updated weights for policy 0, policy_version 1559151 (0.0006) [2023-12-26 12:02:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 795631616. Throughput: 0: 8941.6, 1: 8821.7. Samples: 795605888. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:38,786][121949] Avg episode reward: [(0, '6129.220'), (1, '5566.469')] [2023-12-26 12:02:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001559152_399147008.pth... [2023-12-26 12:02:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001548768_396484608.pth... [2023-12-26 12:02:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001558128_398884864.pth [2023-12-26 12:02:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001547744_396222464.pth [2023-12-26 12:02:39,108][123091] Updated weights for policy 0, policy_version 1559161 (0.0006) [2023-12-26 12:02:39,153][123090] Updated weights for policy 1, policy_version 1548776 (0.0005) [2023-12-26 12:02:39,169][123091] Updated weights for policy 0, policy_version 1559171 (0.0007) [2023-12-26 12:02:39,213][123090] Updated weights for policy 1, policy_version 1548786 (0.0006) [2023-12-26 12:02:39,231][123091] Updated weights for policy 0, policy_version 1559181 (0.0007) [2023-12-26 12:02:39,291][123090] Updated weights for policy 1, policy_version 1548796 (0.0007) [2023-12-26 12:02:40,036][123091] Updated weights for policy 0, policy_version 1559191 (0.0008) [2023-12-26 12:02:40,083][123090] Updated weights for policy 1, policy_version 1548806 (0.0009) [2023-12-26 12:02:40,098][123091] Updated weights for policy 0, policy_version 1559201 (0.0008) [2023-12-26 12:02:40,135][123090] Updated weights for policy 1, policy_version 1548816 (0.0011) [2023-12-26 12:02:40,161][123091] Updated weights for policy 0, policy_version 1559211 (0.0008) [2023-12-26 12:02:40,188][123090] Updated weights for policy 1, policy_version 1548826 (0.0011) [2023-12-26 12:02:40,955][123091] Updated weights for policy 0, policy_version 1559221 (0.0009) [2023-12-26 12:02:41,022][123091] Updated weights for policy 0, policy_version 1559231 (0.0008) [2023-12-26 12:02:41,051][123090] Updated weights for policy 1, policy_version 1548836 (0.0011) [2023-12-26 12:02:41,089][123091] Updated weights for policy 0, policy_version 1559241 (0.0011) [2023-12-26 12:02:41,122][123090] Updated weights for policy 1, policy_version 1548846 (0.0011) [2023-12-26 12:02:41,185][123090] Updated weights for policy 1, policy_version 1548856 (0.0007) [2023-12-26 12:02:41,876][123091] Updated weights for policy 0, policy_version 1559251 (0.0010) [2023-12-26 12:02:41,939][123091] Updated weights for policy 0, policy_version 1559261 (0.0008) [2023-12-26 12:02:41,980][123090] Updated weights for policy 1, policy_version 1548866 (0.0006) [2023-12-26 12:02:42,002][123091] Updated weights for policy 0, policy_version 1559271 (0.0007) [2023-12-26 12:02:42,052][123090] Updated weights for policy 1, policy_version 1548876 (0.0006) [2023-12-26 12:02:42,121][123090] Updated weights for policy 1, policy_version 1548886 (0.0010) [2023-12-26 12:02:42,190][123090] Updated weights for policy 1, policy_version 1548896 (0.0010) [2023-12-26 12:02:42,729][123091] Updated weights for policy 0, policy_version 1559281 (0.0007) [2023-12-26 12:02:42,790][123091] Updated weights for policy 0, policy_version 1559291 (0.0007) [2023-12-26 12:02:42,845][123091] Updated weights for policy 0, policy_version 1559301 (0.0010) [2023-12-26 12:02:42,908][123091] Updated weights for policy 0, policy_version 1559311 (0.0010) [2023-12-26 12:02:43,022][123090] Updated weights for policy 1, policy_version 1548906 (0.0009) [2023-12-26 12:02:43,089][123090] Updated weights for policy 1, policy_version 1548916 (0.0009) [2023-12-26 12:02:43,157][123090] Updated weights for policy 1, policy_version 1548926 (0.0007) [2023-12-26 12:02:43,569][123091] Updated weights for policy 0, policy_version 1559321 (0.0006) [2023-12-26 12:02:43,621][123091] Updated weights for policy 0, policy_version 1559331 (0.0005) [2023-12-26 12:02:43,671][123091] Updated weights for policy 0, policy_version 1559341 (0.0005) [2023-12-26 12:02:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 795721728. Throughput: 0: 8933.1, 1: 8751.5. Samples: 795713404. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:43,785][121949] Avg episode reward: [(0, '6003.020'), (1, '5773.766')] [2023-12-26 12:02:43,878][123090] Updated weights for policy 1, policy_version 1548936 (0.0009) [2023-12-26 12:02:43,927][123090] Updated weights for policy 1, policy_version 1548946 (0.0009) [2023-12-26 12:02:43,978][123090] Updated weights for policy 1, policy_version 1548956 (0.0009) [2023-12-26 12:02:44,476][123091] Updated weights for policy 0, policy_version 1559351 (0.0008) [2023-12-26 12:02:44,523][123091] Updated weights for policy 0, policy_version 1559362 (0.0009) [2023-12-26 12:02:44,580][123091] Updated weights for policy 0, policy_version 1559372 (0.0005) [2023-12-26 12:02:44,717][123090] Updated weights for policy 1, policy_version 1548966 (0.0007) [2023-12-26 12:02:44,792][123090] Updated weights for policy 1, policy_version 1548976 (0.0007) [2023-12-26 12:02:44,862][123090] Updated weights for policy 1, policy_version 1548986 (0.0008) [2023-12-26 12:02:45,322][123091] Updated weights for policy 0, policy_version 1559382 (0.0009) [2023-12-26 12:02:45,385][123091] Updated weights for policy 0, policy_version 1559392 (0.0009) [2023-12-26 12:02:45,451][123091] Updated weights for policy 0, policy_version 1559402 (0.0008) [2023-12-26 12:02:45,598][123090] Updated weights for policy 1, policy_version 1548996 (0.0008) [2023-12-26 12:02:45,654][123090] Updated weights for policy 1, policy_version 1549006 (0.0008) [2023-12-26 12:02:45,721][123090] Updated weights for policy 1, policy_version 1549016 (0.0009) [2023-12-26 12:02:46,279][123091] Updated weights for policy 0, policy_version 1559412 (0.0009) [2023-12-26 12:02:46,340][123091] Updated weights for policy 0, policy_version 1559422 (0.0008) [2023-12-26 12:02:46,398][123091] Updated weights for policy 0, policy_version 1559432 (0.0005) [2023-12-26 12:02:46,556][123090] Updated weights for policy 1, policy_version 1549026 (0.0009) [2023-12-26 12:02:46,608][123090] Updated weights for policy 1, policy_version 1549036 (0.0009) [2023-12-26 12:02:46,667][123090] Updated weights for policy 1, policy_version 1549047 (0.0010) [2023-12-26 12:02:47,084][123091] Updated weights for policy 0, policy_version 1559442 (0.0005) [2023-12-26 12:02:47,131][123091] Updated weights for policy 0, policy_version 1559452 (0.0005) [2023-12-26 12:02:47,177][123091] Updated weights for policy 0, policy_version 1559462 (0.0005) [2023-12-26 12:02:47,225][123091] Updated weights for policy 0, policy_version 1559472 (0.0005) [2023-12-26 12:02:47,467][123090] Updated weights for policy 1, policy_version 1549057 (0.0010) [2023-12-26 12:02:47,516][123090] Updated weights for policy 1, policy_version 1549067 (0.0009) [2023-12-26 12:02:47,568][123090] Updated weights for policy 1, policy_version 1549077 (0.0008) [2023-12-26 12:02:47,615][123090] Updated weights for policy 1, policy_version 1549087 (0.0008) [2023-12-26 12:02:47,935][123091] Updated weights for policy 0, policy_version 1559482 (0.0005) [2023-12-26 12:02:47,981][123091] Updated weights for policy 0, policy_version 1559492 (0.0005) [2023-12-26 12:02:48,038][123091] Updated weights for policy 0, policy_version 1559502 (0.0005) [2023-12-26 12:02:48,567][123090] Updated weights for policy 1, policy_version 1549097 (0.0009) [2023-12-26 12:02:48,618][123090] Updated weights for policy 1, policy_version 1549107 (0.0009) [2023-12-26 12:02:48,677][123090] Updated weights for policy 1, policy_version 1549117 (0.0009) [2023-12-26 12:02:48,749][123091] Updated weights for policy 0, policy_version 1559512 (0.0009) [2023-12-26 12:02:48,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 795811840. Throughput: 0: 9015.7, 1: 8817.3. Samples: 795823220. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:48,784][121949] Avg episode reward: [(0, '5984.518'), (1, '5402.518')] [2023-12-26 12:02:48,818][123091] Updated weights for policy 0, policy_version 1559522 (0.0010) [2023-12-26 12:02:48,881][123091] Updated weights for policy 0, policy_version 1559532 (0.0009) [2023-12-26 12:02:49,542][123090] Updated weights for policy 1, policy_version 1549127 (0.0008) [2023-12-26 12:02:49,602][123090] Updated weights for policy 1, policy_version 1549137 (0.0008) [2023-12-26 12:02:49,655][123090] Updated weights for policy 1, policy_version 1549147 (0.0008) [2023-12-26 12:02:49,737][123091] Updated weights for policy 0, policy_version 1559542 (0.0007) [2023-12-26 12:02:49,785][123091] Updated weights for policy 0, policy_version 1559552 (0.0005) [2023-12-26 12:02:49,850][123091] Updated weights for policy 0, policy_version 1559562 (0.0008) [2023-12-26 12:02:50,536][123091] Updated weights for policy 0, policy_version 1559572 (0.0008) [2023-12-26 12:02:50,558][123090] Updated weights for policy 1, policy_version 1549157 (0.0008) [2023-12-26 12:02:50,600][123091] Updated weights for policy 0, policy_version 1559582 (0.0010) [2023-12-26 12:02:50,632][123090] Updated weights for policy 1, policy_version 1549167 (0.0008) [2023-12-26 12:02:50,661][123091] Updated weights for policy 0, policy_version 1559592 (0.0010) [2023-12-26 12:02:50,689][123090] Updated weights for policy 1, policy_version 1549177 (0.0007) [2023-12-26 12:02:51,448][123091] Updated weights for policy 0, policy_version 1559602 (0.0009) [2023-12-26 12:02:51,502][123091] Updated weights for policy 0, policy_version 1559612 (0.0005) [2023-12-26 12:02:51,564][123091] Updated weights for policy 0, policy_version 1559622 (0.0007) [2023-12-26 12:02:51,577][123090] Updated weights for policy 1, policy_version 1549187 (0.0008) [2023-12-26 12:02:51,630][123091] Updated weights for policy 0, policy_version 1559632 (0.0009) [2023-12-26 12:02:51,647][123090] Updated weights for policy 1, policy_version 1549197 (0.0009) [2023-12-26 12:02:51,719][123090] Updated weights for policy 1, policy_version 1549207 (0.0008) [2023-12-26 12:02:52,469][123091] Updated weights for policy 0, policy_version 1559642 (0.0009) [2023-12-26 12:02:52,511][123090] Updated weights for policy 1, policy_version 1549217 (0.0006) [2023-12-26 12:02:52,531][123091] Updated weights for policy 0, policy_version 1559652 (0.0009) [2023-12-26 12:02:52,564][123090] Updated weights for policy 1, policy_version 1549227 (0.0008) [2023-12-26 12:02:52,596][123091] Updated weights for policy 0, policy_version 1559662 (0.0009) [2023-12-26 12:02:52,618][123090] Updated weights for policy 1, policy_version 1549237 (0.0007) [2023-12-26 12:02:52,667][123090] Updated weights for policy 1, policy_version 1549247 (0.0009) [2023-12-26 12:02:53,350][123091] Updated weights for policy 0, policy_version 1559672 (0.0010) [2023-12-26 12:02:53,414][123091] Updated weights for policy 0, policy_version 1559682 (0.0009) [2023-12-26 12:02:53,466][123091] Updated weights for policy 0, policy_version 1559692 (0.0010) [2023-12-26 12:02:53,544][123090] Updated weights for policy 1, policy_version 1549257 (0.0009) [2023-12-26 12:02:53,613][123090] Updated weights for policy 1, policy_version 1549267 (0.0010) [2023-12-26 12:02:53,671][123090] Updated weights for policy 1, policy_version 1549277 (0.0009) [2023-12-26 12:02:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 795901952. Throughput: 0: 8983.0, 1: 8752.4. Samples: 795874636. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:53,784][121949] Avg episode reward: [(0, '6179.482'), (1, '5289.189')] [2023-12-26 12:02:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001559696_399286272.pth... [2023-12-26 12:02:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001549280_396615680.pth... [2023-12-26 12:02:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001558608_399007744.pth [2023-12-26 12:02:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001548256_396353536.pth [2023-12-26 12:02:54,311][123091] Updated weights for policy 0, policy_version 1559702 (0.0009) [2023-12-26 12:02:54,371][123091] Updated weights for policy 0, policy_version 1559712 (0.0009) [2023-12-26 12:02:54,436][123091] Updated weights for policy 0, policy_version 1559722 (0.0009) [2023-12-26 12:02:54,527][123090] Updated weights for policy 1, policy_version 1549287 (0.0009) [2023-12-26 12:02:54,587][123090] Updated weights for policy 1, policy_version 1549297 (0.0009) [2023-12-26 12:02:54,637][123090] Updated weights for policy 1, policy_version 1549307 (0.0009) [2023-12-26 12:02:55,268][123091] Updated weights for policy 0, policy_version 1559732 (0.0010) [2023-12-26 12:02:55,323][123091] Updated weights for policy 0, policy_version 1559742 (0.0008) [2023-12-26 12:02:55,379][123091] Updated weights for policy 0, policy_version 1559752 (0.0009) [2023-12-26 12:02:55,476][123090] Updated weights for policy 1, policy_version 1549317 (0.0009) [2023-12-26 12:02:55,526][123090] Updated weights for policy 1, policy_version 1549328 (0.0009) [2023-12-26 12:02:55,575][123090] Updated weights for policy 1, policy_version 1549338 (0.0008) [2023-12-26 12:02:56,221][123091] Updated weights for policy 0, policy_version 1559762 (0.0010) [2023-12-26 12:02:56,269][123091] Updated weights for policy 0, policy_version 1559772 (0.0009) [2023-12-26 12:02:56,324][123091] Updated weights for policy 0, policy_version 1559782 (0.0009) [2023-12-26 12:02:56,381][123091] Updated weights for policy 0, policy_version 1559792 (0.0009) [2023-12-26 12:02:56,425][123090] Updated weights for policy 1, policy_version 1549348 (0.0009) [2023-12-26 12:02:56,483][123090] Updated weights for policy 1, policy_version 1549358 (0.0009) [2023-12-26 12:02:56,538][123090] Updated weights for policy 1, policy_version 1549368 (0.0009) [2023-12-26 12:02:57,241][123091] Updated weights for policy 0, policy_version 1559802 (0.0009) [2023-12-26 12:02:57,297][123091] Updated weights for policy 0, policy_version 1559812 (0.0006) [2023-12-26 12:02:57,354][123091] Updated weights for policy 0, policy_version 1559822 (0.0005) [2023-12-26 12:02:57,377][123090] Updated weights for policy 1, policy_version 1549378 (0.0009) [2023-12-26 12:02:57,431][123090] Updated weights for policy 1, policy_version 1549388 (0.0009) [2023-12-26 12:02:57,485][123090] Updated weights for policy 1, policy_version 1549398 (0.0010) [2023-12-26 12:02:57,537][123090] Updated weights for policy 1, policy_version 1549408 (0.0009) [2023-12-26 12:02:58,111][123091] Updated weights for policy 0, policy_version 1559832 (0.0007) [2023-12-26 12:02:58,181][123091] Updated weights for policy 0, policy_version 1559842 (0.0008) [2023-12-26 12:02:58,237][123091] Updated weights for policy 0, policy_version 1559852 (0.0008) [2023-12-26 12:02:58,452][123090] Updated weights for policy 1, policy_version 1549418 (0.0010) [2023-12-26 12:02:58,526][123090] Updated weights for policy 1, policy_version 1549428 (0.0010) [2023-12-26 12:02:58,591][123090] Updated weights for policy 1, policy_version 1549438 (0.0010) [2023-12-26 12:02:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 795983872. Throughput: 0: 9000.3, 1: 8674.8. Samples: 795976684. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:02:58,785][121949] Avg episode reward: [(0, '6203.584'), (1, '5564.570')] [2023-12-26 12:02:59,147][123091] Updated weights for policy 0, policy_version 1559862 (0.0009) [2023-12-26 12:02:59,211][123091] Updated weights for policy 0, policy_version 1559872 (0.0009) [2023-12-26 12:02:59,283][123091] Updated weights for policy 0, policy_version 1559882 (0.0010) [2023-12-26 12:02:59,542][123090] Updated weights for policy 1, policy_version 1549448 (0.0010) [2023-12-26 12:02:59,601][123090] Updated weights for policy 1, policy_version 1549458 (0.0008) [2023-12-26 12:02:59,662][123090] Updated weights for policy 1, policy_version 1549468 (0.0009) [2023-12-26 12:03:00,076][123091] Updated weights for policy 0, policy_version 1559892 (0.0009) [2023-12-26 12:03:00,129][123091] Updated weights for policy 0, policy_version 1559902 (0.0010) [2023-12-26 12:03:00,177][123091] Updated weights for policy 0, policy_version 1559912 (0.0009) [2023-12-26 12:03:00,467][123090] Updated weights for policy 1, policy_version 1549478 (0.0009) [2023-12-26 12:03:00,533][123090] Updated weights for policy 1, policy_version 1549488 (0.0008) [2023-12-26 12:03:00,584][123090] Updated weights for policy 1, policy_version 1549498 (0.0009) [2023-12-26 12:03:00,987][123091] Updated weights for policy 0, policy_version 1559922 (0.0009) [2023-12-26 12:03:01,049][123091] Updated weights for policy 0, policy_version 1559932 (0.0010) [2023-12-26 12:03:01,107][123091] Updated weights for policy 0, policy_version 1559942 (0.0010) [2023-12-26 12:03:01,183][123091] Updated weights for policy 0, policy_version 1559952 (0.0009) [2023-12-26 12:03:01,390][123090] Updated weights for policy 1, policy_version 1549508 (0.0009) [2023-12-26 12:03:01,455][123090] Updated weights for policy 1, policy_version 1549518 (0.0008) [2023-12-26 12:03:01,512][123090] Updated weights for policy 1, policy_version 1549528 (0.0009) [2023-12-26 12:03:02,030][123091] Updated weights for policy 0, policy_version 1559962 (0.0009) [2023-12-26 12:03:02,079][123091] Updated weights for policy 0, policy_version 1559972 (0.0009) [2023-12-26 12:03:02,134][123091] Updated weights for policy 0, policy_version 1559982 (0.0009) [2023-12-26 12:03:02,337][123090] Updated weights for policy 1, policy_version 1549538 (0.0009) [2023-12-26 12:03:02,410][123090] Updated weights for policy 1, policy_version 1549548 (0.0010) [2023-12-26 12:03:02,472][123090] Updated weights for policy 1, policy_version 1549558 (0.0010) [2023-12-26 12:03:02,522][123090] Updated weights for policy 1, policy_version 1549568 (0.0009) [2023-12-26 12:03:02,935][123091] Updated weights for policy 0, policy_version 1559992 (0.0006) [2023-12-26 12:03:02,981][123091] Updated weights for policy 0, policy_version 1560002 (0.0005) [2023-12-26 12:03:03,039][123091] Updated weights for policy 0, policy_version 1560012 (0.0005) [2023-12-26 12:03:03,403][123090] Updated weights for policy 1, policy_version 1549578 (0.0009) [2023-12-26 12:03:03,461][123090] Updated weights for policy 1, policy_version 1549589 (0.0010) [2023-12-26 12:03:03,515][123090] Updated weights for policy 1, policy_version 1549600 (0.0010) [2023-12-26 12:03:03,738][123091] Updated weights for policy 0, policy_version 1560022 (0.0008) [2023-12-26 12:03:03,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 796065792. Throughput: 0: 9016.8, 1: 8637.2. Samples: 796078444. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:03,785][121949] Avg episode reward: [(0, '6201.126'), (1, '5656.701')] [2023-12-26 12:03:03,787][123091] Updated weights for policy 0, policy_version 1560033 (0.0009) [2023-12-26 12:03:03,837][123091] Updated weights for policy 0, policy_version 1560043 (0.0009) [2023-12-26 12:03:04,400][123090] Updated weights for policy 1, policy_version 1549610 (0.0010) [2023-12-26 12:03:04,461][123090] Updated weights for policy 1, policy_version 1549620 (0.0009) [2023-12-26 12:03:04,528][123090] Updated weights for policy 1, policy_version 1549630 (0.0010) [2023-12-26 12:03:04,724][123091] Updated weights for policy 0, policy_version 1560053 (0.0009) [2023-12-26 12:03:04,783][123091] Updated weights for policy 0, policy_version 1560063 (0.0009) [2023-12-26 12:03:04,830][123091] Updated weights for policy 0, policy_version 1560073 (0.0009) [2023-12-26 12:03:05,421][123090] Updated weights for policy 1, policy_version 1549640 (0.0009) [2023-12-26 12:03:05,476][123090] Updated weights for policy 1, policy_version 1549650 (0.0009) [2023-12-26 12:03:05,547][123090] Updated weights for policy 1, policy_version 1549660 (0.0009) [2023-12-26 12:03:05,552][123091] Updated weights for policy 0, policy_version 1560083 (0.0006) [2023-12-26 12:03:05,611][123091] Updated weights for policy 0, policy_version 1560093 (0.0010) [2023-12-26 12:03:05,673][123091] Updated weights for policy 0, policy_version 1560103 (0.0010) [2023-12-26 12:03:06,276][123090] Updated weights for policy 1, policy_version 1549670 (0.0005) [2023-12-26 12:03:06,345][123090] Updated weights for policy 1, policy_version 1549680 (0.0006) [2023-12-26 12:03:06,418][123090] Updated weights for policy 1, policy_version 1549690 (0.0007) [2023-12-26 12:03:06,483][123091] Updated weights for policy 0, policy_version 1560113 (0.0011) [2023-12-26 12:03:06,554][123091] Updated weights for policy 0, policy_version 1560123 (0.0011) [2023-12-26 12:03:06,614][123091] Updated weights for policy 0, policy_version 1560133 (0.0011) [2023-12-26 12:03:06,677][123091] Updated weights for policy 0, policy_version 1560143 (0.0011) [2023-12-26 12:03:07,103][123090] Updated weights for policy 1, policy_version 1549700 (0.0007) [2023-12-26 12:03:07,153][123090] Updated weights for policy 1, policy_version 1549710 (0.0005) [2023-12-26 12:03:07,208][123090] Updated weights for policy 1, policy_version 1549720 (0.0005) [2023-12-26 12:03:07,502][123091] Updated weights for policy 0, policy_version 1560153 (0.0010) [2023-12-26 12:03:07,565][123091] Updated weights for policy 0, policy_version 1560163 (0.0011) [2023-12-26 12:03:07,630][123091] Updated weights for policy 0, policy_version 1560173 (0.0011) [2023-12-26 12:03:07,890][123090] Updated weights for policy 1, policy_version 1549730 (0.0009) [2023-12-26 12:03:07,945][123090] Updated weights for policy 1, policy_version 1549740 (0.0005) [2023-12-26 12:03:07,998][123090] Updated weights for policy 1, policy_version 1549750 (0.0005) [2023-12-26 12:03:08,063][123090] Updated weights for policy 1, policy_version 1549760 (0.0009) [2023-12-26 12:03:08,516][123091] Updated weights for policy 0, policy_version 1560183 (0.0010) [2023-12-26 12:03:08,571][123091] Updated weights for policy 0, policy_version 1560193 (0.0010) [2023-12-26 12:03:08,624][123091] Updated weights for policy 0, policy_version 1560203 (0.0009) [2023-12-26 12:03:08,671][123090] Updated weights for policy 1, policy_version 1549770 (0.0005) [2023-12-26 12:03:08,718][123090] Updated weights for policy 1, policy_version 1549780 (0.0005) [2023-12-26 12:03:08,766][123090] Updated weights for policy 1, policy_version 1549790 (0.0005) [2023-12-26 12:03:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 796164096. Throughput: 0: 8999.4, 1: 8704.9. Samples: 796131840. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:08,785][121949] Avg episode reward: [(0, '6239.603'), (1, '5727.504')] [2023-12-26 12:03:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001560208_399417344.pth... [2023-12-26 12:03:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001549792_396746752.pth... [2023-12-26 12:03:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001559152_399147008.pth [2023-12-26 12:03:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001548768_396484608.pth [2023-12-26 12:03:09,525][123091] Updated weights for policy 0, policy_version 1560213 (0.0007) [2023-12-26 12:03:09,544][123090] Updated weights for policy 1, policy_version 1549800 (0.0009) [2023-12-26 12:03:09,601][123091] Updated weights for policy 0, policy_version 1560223 (0.0008) [2023-12-26 12:03:09,617][123090] Updated weights for policy 1, policy_version 1549810 (0.0007) [2023-12-26 12:03:09,664][123091] Updated weights for policy 0, policy_version 1560233 (0.0011) [2023-12-26 12:03:09,684][123090] Updated weights for policy 1, policy_version 1549820 (0.0009) [2023-12-26 12:03:10,436][123090] Updated weights for policy 1, policy_version 1549830 (0.0005) [2023-12-26 12:03:10,477][123091] Updated weights for policy 0, policy_version 1560243 (0.0010) [2023-12-26 12:03:10,506][123090] Updated weights for policy 1, policy_version 1549840 (0.0005) [2023-12-26 12:03:10,526][123091] Updated weights for policy 0, policy_version 1560253 (0.0009) [2023-12-26 12:03:10,574][123091] Updated weights for policy 0, policy_version 1560263 (0.0009) [2023-12-26 12:03:10,579][123090] Updated weights for policy 1, policy_version 1549850 (0.0005) [2023-12-26 12:03:11,372][123090] Updated weights for policy 1, policy_version 1549860 (0.0009) [2023-12-26 12:03:11,437][123091] Updated weights for policy 0, policy_version 1560273 (0.0008) [2023-12-26 12:03:11,437][123090] Updated weights for policy 1, policy_version 1549870 (0.0009) [2023-12-26 12:03:11,496][123091] Updated weights for policy 0, policy_version 1560283 (0.0009) [2023-12-26 12:03:11,500][123090] Updated weights for policy 1, policy_version 1549880 (0.0009) [2023-12-26 12:03:11,549][123091] Updated weights for policy 0, policy_version 1560293 (0.0009) [2023-12-26 12:03:11,607][123091] Updated weights for policy 0, policy_version 1560303 (0.0009) [2023-12-26 12:03:12,397][123090] Updated weights for policy 1, policy_version 1549890 (0.0009) [2023-12-26 12:03:12,462][123090] Updated weights for policy 1, policy_version 1549900 (0.0006) [2023-12-26 12:03:12,514][123091] Updated weights for policy 0, policy_version 1560313 (0.0008) [2023-12-26 12:03:12,527][123090] Updated weights for policy 1, policy_version 1549910 (0.0009) [2023-12-26 12:03:12,563][123091] Updated weights for policy 0, policy_version 1560323 (0.0009) [2023-12-26 12:03:12,588][123090] Updated weights for policy 1, policy_version 1549920 (0.0008) [2023-12-26 12:03:12,608][123091] Updated weights for policy 0, policy_version 1560333 (0.0010) [2023-12-26 12:03:13,414][123090] Updated weights for policy 1, policy_version 1549930 (0.0009) [2023-12-26 12:03:13,463][123091] Updated weights for policy 0, policy_version 1560343 (0.0010) [2023-12-26 12:03:13,474][123090] Updated weights for policy 1, policy_version 1549940 (0.0008) [2023-12-26 12:03:13,514][123091] Updated weights for policy 0, policy_version 1560353 (0.0010) [2023-12-26 12:03:13,536][123090] Updated weights for policy 1, policy_version 1549950 (0.0007) [2023-12-26 12:03:13,560][123091] Updated weights for policy 0, policy_version 1560363 (0.0005) [2023-12-26 12:03:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 796246016. Throughput: 0: 8916.3, 1: 8726.9. Samples: 796236548. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:13,785][121949] Avg episode reward: [(0, '6239.446'), (1, '5569.938')] [2023-12-26 12:03:14,260][123091] Updated weights for policy 0, policy_version 1560373 (0.0006) [2023-12-26 12:03:14,310][123091] Updated weights for policy 0, policy_version 1560383 (0.0006) [2023-12-26 12:03:14,364][123090] Updated weights for policy 1, policy_version 1549960 (0.0009) [2023-12-26 12:03:14,382][123091] Updated weights for policy 0, policy_version 1560393 (0.0006) [2023-12-26 12:03:14,431][123090] Updated weights for policy 1, policy_version 1549970 (0.0009) [2023-12-26 12:03:14,481][123090] Updated weights for policy 1, policy_version 1549980 (0.0008) [2023-12-26 12:03:15,169][123091] Updated weights for policy 0, policy_version 1560403 (0.0009) [2023-12-26 12:03:15,221][123091] Updated weights for policy 0, policy_version 1560413 (0.0009) [2023-12-26 12:03:15,271][123090] Updated weights for policy 1, policy_version 1549990 (0.0008) [2023-12-26 12:03:15,284][123091] Updated weights for policy 0, policy_version 1560423 (0.0010) [2023-12-26 12:03:15,329][123090] Updated weights for policy 1, policy_version 1550000 (0.0010) [2023-12-26 12:03:15,391][123090] Updated weights for policy 1, policy_version 1550010 (0.0009) [2023-12-26 12:03:16,076][123091] Updated weights for policy 0, policy_version 1560433 (0.0010) [2023-12-26 12:03:16,133][123091] Updated weights for policy 0, policy_version 1560443 (0.0009) [2023-12-26 12:03:16,182][123091] Updated weights for policy 0, policy_version 1560453 (0.0009) [2023-12-26 12:03:16,254][123090] Updated weights for policy 1, policy_version 1550020 (0.0009) [2023-12-26 12:03:16,317][123090] Updated weights for policy 1, policy_version 1550030 (0.0010) [2023-12-26 12:03:16,368][123090] Updated weights for policy 1, policy_version 1550040 (0.0009) [2023-12-26 12:03:16,958][123091] Updated weights for policy 0, policy_version 1560465 (0.0009) [2023-12-26 12:03:17,021][123091] Updated weights for policy 0, policy_version 1560475 (0.0005) [2023-12-26 12:03:17,088][123091] Updated weights for policy 0, policy_version 1560485 (0.0005) [2023-12-26 12:03:17,147][123091] Updated weights for policy 0, policy_version 1560495 (0.0005) [2023-12-26 12:03:17,260][123090] Updated weights for policy 1, policy_version 1550050 (0.0009) [2023-12-26 12:03:17,317][123090] Updated weights for policy 1, policy_version 1550060 (0.0010) [2023-12-26 12:03:17,374][123090] Updated weights for policy 1, policy_version 1550070 (0.0010) [2023-12-26 12:03:17,423][123090] Updated weights for policy 1, policy_version 1550080 (0.0008) [2023-12-26 12:03:17,815][123091] Updated weights for policy 0, policy_version 1560505 (0.0009) [2023-12-26 12:03:17,868][123091] Updated weights for policy 0, policy_version 1560515 (0.0009) [2023-12-26 12:03:17,927][123091] Updated weights for policy 0, policy_version 1560525 (0.0009) [2023-12-26 12:03:18,290][123090] Updated weights for policy 1, policy_version 1550090 (0.0009) [2023-12-26 12:03:18,361][123090] Updated weights for policy 1, policy_version 1550100 (0.0008) [2023-12-26 12:03:18,425][123090] Updated weights for policy 1, policy_version 1550110 (0.0006) [2023-12-26 12:03:18,780][123091] Updated weights for policy 0, policy_version 1560535 (0.0010) [2023-12-26 12:03:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 796327936. Throughput: 0: 8930.7, 1: 8616.1. Samples: 796342652. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:18,785][121949] Avg episode reward: [(0, '6196.364'), (1, '5292.136')] [2023-12-26 12:03:18,844][123091] Updated weights for policy 0, policy_version 1560545 (0.0009) [2023-12-26 12:03:18,902][123091] Updated weights for policy 0, policy_version 1560555 (0.0010) [2023-12-26 12:03:19,199][123090] Updated weights for policy 1, policy_version 1550120 (0.0008) [2023-12-26 12:03:19,278][123090] Updated weights for policy 1, policy_version 1550130 (0.0008) [2023-12-26 12:03:19,351][123090] Updated weights for policy 1, policy_version 1550140 (0.0008) [2023-12-26 12:03:19,759][123091] Updated weights for policy 0, policy_version 1560565 (0.0009) [2023-12-26 12:03:19,829][123091] Updated weights for policy 0, policy_version 1560575 (0.0010) [2023-12-26 12:03:19,891][123091] Updated weights for policy 0, policy_version 1560585 (0.0008) [2023-12-26 12:03:20,140][123090] Updated weights for policy 1, policy_version 1550150 (0.0007) [2023-12-26 12:03:20,209][123090] Updated weights for policy 1, policy_version 1550160 (0.0009) [2023-12-26 12:03:20,283][123090] Updated weights for policy 1, policy_version 1550170 (0.0009) [2023-12-26 12:03:20,715][123091] Updated weights for policy 0, policy_version 1560595 (0.0009) [2023-12-26 12:03:20,776][123091] Updated weights for policy 0, policy_version 1560605 (0.0011) [2023-12-26 12:03:20,845][123091] Updated weights for policy 0, policy_version 1560615 (0.0010) [2023-12-26 12:03:21,062][123090] Updated weights for policy 1, policy_version 1550180 (0.0009) [2023-12-26 12:03:21,134][123090] Updated weights for policy 1, policy_version 1550190 (0.0009) [2023-12-26 12:03:21,205][123090] Updated weights for policy 1, policy_version 1550200 (0.0009) [2023-12-26 12:03:21,703][123091] Updated weights for policy 0, policy_version 1560625 (0.0010) [2023-12-26 12:03:21,776][123091] Updated weights for policy 0, policy_version 1560635 (0.0007) [2023-12-26 12:03:21,843][123091] Updated weights for policy 0, policy_version 1560645 (0.0008) [2023-12-26 12:03:21,916][123091] Updated weights for policy 0, policy_version 1560655 (0.0006) [2023-12-26 12:03:22,122][123090] Updated weights for policy 1, policy_version 1550210 (0.0009) [2023-12-26 12:03:22,192][123090] Updated weights for policy 1, policy_version 1550220 (0.0006) [2023-12-26 12:03:22,256][123090] Updated weights for policy 1, policy_version 1550230 (0.0008) [2023-12-26 12:03:22,322][123090] Updated weights for policy 1, policy_version 1550240 (0.0009) [2023-12-26 12:03:22,615][123091] Updated weights for policy 0, policy_version 1560665 (0.0006) [2023-12-26 12:03:22,670][123091] Updated weights for policy 0, policy_version 1560675 (0.0006) [2023-12-26 12:03:22,726][123091] Updated weights for policy 0, policy_version 1560685 (0.0006) [2023-12-26 12:03:23,107][123090] Updated weights for policy 1, policy_version 1550250 (0.0009) [2023-12-26 12:03:23,176][123090] Updated weights for policy 1, policy_version 1550260 (0.0009) [2023-12-26 12:03:23,251][123090] Updated weights for policy 1, policy_version 1550270 (0.0008) [2023-12-26 12:03:23,502][123091] Updated weights for policy 0, policy_version 1560695 (0.0008) [2023-12-26 12:03:23,550][123091] Updated weights for policy 0, policy_version 1560705 (0.0010) [2023-12-26 12:03:23,605][123091] Updated weights for policy 0, policy_version 1560715 (0.0010) [2023-12-26 12:03:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 796418048. Throughput: 0: 8897.2, 1: 8596.2. Samples: 796393088. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:23,785][121949] Avg episode reward: [(0, '6287.760'), (1, '5211.290')] [2023-12-26 12:03:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001550272_396869632.pth... [2023-12-26 12:03:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001560720_399548416.pth... [2023-12-26 12:03:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001549280_396615680.pth [2023-12-26 12:03:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001559696_399286272.pth [2023-12-26 12:03:24,052][123090] Updated weights for policy 1, policy_version 1550280 (0.0006) [2023-12-26 12:03:24,116][123090] Updated weights for policy 1, policy_version 1550290 (0.0005) [2023-12-26 12:03:24,177][123090] Updated weights for policy 1, policy_version 1550300 (0.0005) [2023-12-26 12:03:24,452][123091] Updated weights for policy 0, policy_version 1560725 (0.0010) [2023-12-26 12:03:24,511][123091] Updated weights for policy 0, policy_version 1560735 (0.0011) [2023-12-26 12:03:24,573][123091] Updated weights for policy 0, policy_version 1560745 (0.0010) [2023-12-26 12:03:24,789][123090] Updated weights for policy 1, policy_version 1550310 (0.0005) [2023-12-26 12:03:24,862][123090] Updated weights for policy 1, policy_version 1550320 (0.0005) [2023-12-26 12:03:24,924][123090] Updated weights for policy 1, policy_version 1550330 (0.0005) [2023-12-26 12:03:25,397][123091] Updated weights for policy 0, policy_version 1560755 (0.0011) [2023-12-26 12:03:25,460][123091] Updated weights for policy 0, policy_version 1560765 (0.0011) [2023-12-26 12:03:25,511][123091] Updated weights for policy 0, policy_version 1560775 (0.0010) [2023-12-26 12:03:25,563][123090] Updated weights for policy 1, policy_version 1550340 (0.0006) [2023-12-26 12:03:25,621][123090] Updated weights for policy 1, policy_version 1550350 (0.0006) [2023-12-26 12:03:25,674][123090] Updated weights for policy 1, policy_version 1550360 (0.0005) [2023-12-26 12:03:26,324][123091] Updated weights for policy 0, policy_version 1560785 (0.0010) [2023-12-26 12:03:26,385][123090] Updated weights for policy 1, policy_version 1550370 (0.0006) [2023-12-26 12:03:26,392][123091] Updated weights for policy 0, policy_version 1560795 (0.0009) [2023-12-26 12:03:26,448][123090] Updated weights for policy 1, policy_version 1550380 (0.0008) [2023-12-26 12:03:26,455][123091] Updated weights for policy 0, policy_version 1560805 (0.0006) [2023-12-26 12:03:26,513][123091] Updated weights for policy 0, policy_version 1560815 (0.0005) [2023-12-26 12:03:26,520][123090] Updated weights for policy 1, policy_version 1550390 (0.0008) [2023-12-26 12:03:26,603][123090] Updated weights for policy 1, policy_version 1550400 (0.0006) [2023-12-26 12:03:27,185][123091] Updated weights for policy 0, policy_version 1560825 (0.0005) [2023-12-26 12:03:27,241][123091] Updated weights for policy 0, policy_version 1560835 (0.0005) [2023-12-26 12:03:27,287][123091] Updated weights for policy 0, policy_version 1560845 (0.0009) [2023-12-26 12:03:27,375][123090] Updated weights for policy 1, policy_version 1550410 (0.0010) [2023-12-26 12:03:27,439][123090] Updated weights for policy 1, policy_version 1550420 (0.0010) [2023-12-26 12:03:27,497][123090] Updated weights for policy 1, policy_version 1550430 (0.0010) [2023-12-26 12:03:27,908][123091] Updated weights for policy 0, policy_version 1560855 (0.0009) [2023-12-26 12:03:27,967][123091] Updated weights for policy 0, policy_version 1560865 (0.0010) [2023-12-26 12:03:28,018][123091] Updated weights for policy 0, policy_version 1560875 (0.0010) [2023-12-26 12:03:28,358][123090] Updated weights for policy 1, policy_version 1550440 (0.0007) [2023-12-26 12:03:28,428][123090] Updated weights for policy 1, policy_version 1550450 (0.0007) [2023-12-26 12:03:28,498][123090] Updated weights for policy 1, policy_version 1550460 (0.0008) [2023-12-26 12:03:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 796508160. Throughput: 0: 8886.2, 1: 8662.3. Samples: 796503084. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:28,784][121949] Avg episode reward: [(0, '6214.638'), (1, '5386.500')] [2023-12-26 12:03:28,844][123091] Updated weights for policy 0, policy_version 1560885 (0.0010) [2023-12-26 12:03:28,896][123091] Updated weights for policy 0, policy_version 1560895 (0.0010) [2023-12-26 12:03:28,943][123091] Updated weights for policy 0, policy_version 1560905 (0.0010) [2023-12-26 12:03:29,278][123090] Updated weights for policy 1, policy_version 1550470 (0.0010) [2023-12-26 12:03:29,340][123090] Updated weights for policy 1, policy_version 1550480 (0.0011) [2023-12-26 12:03:29,395][123090] Updated weights for policy 1, policy_version 1550490 (0.0010) [2023-12-26 12:03:29,789][123091] Updated weights for policy 0, policy_version 1560915 (0.0010) [2023-12-26 12:03:29,856][123091] Updated weights for policy 0, policy_version 1560925 (0.0009) [2023-12-26 12:03:29,930][123091] Updated weights for policy 0, policy_version 1560935 (0.0009) [2023-12-26 12:03:30,215][123090] Updated weights for policy 1, policy_version 1550500 (0.0010) [2023-12-26 12:03:30,263][123090] Updated weights for policy 1, policy_version 1550510 (0.0010) [2023-12-26 12:03:30,313][123090] Updated weights for policy 1, policy_version 1550520 (0.0010) [2023-12-26 12:03:30,723][123091] Updated weights for policy 0, policy_version 1560945 (0.0010) [2023-12-26 12:03:30,769][123091] Updated weights for policy 0, policy_version 1560955 (0.0010) [2023-12-26 12:03:30,820][123091] Updated weights for policy 0, policy_version 1560965 (0.0010) [2023-12-26 12:03:30,867][123091] Updated weights for policy 0, policy_version 1560975 (0.0010) [2023-12-26 12:03:31,115][123090] Updated weights for policy 1, policy_version 1550530 (0.0010) [2023-12-26 12:03:31,184][123090] Updated weights for policy 1, policy_version 1550540 (0.0009) [2023-12-26 12:03:31,235][123090] Updated weights for policy 1, policy_version 1550550 (0.0008) [2023-12-26 12:03:31,294][123090] Updated weights for policy 1, policy_version 1550560 (0.0009) [2023-12-26 12:03:31,718][123091] Updated weights for policy 0, policy_version 1560985 (0.0011) [2023-12-26 12:03:31,778][123091] Updated weights for policy 0, policy_version 1560995 (0.0010) [2023-12-26 12:03:31,853][123091] Updated weights for policy 0, policy_version 1561005 (0.0009) [2023-12-26 12:03:32,127][123090] Updated weights for policy 1, policy_version 1550571 (0.0010) [2023-12-26 12:03:32,197][123090] Updated weights for policy 1, policy_version 1550581 (0.0010) [2023-12-26 12:03:32,257][123090] Updated weights for policy 1, policy_version 1550591 (0.0009) [2023-12-26 12:03:32,652][123091] Updated weights for policy 0, policy_version 1561015 (0.0007) [2023-12-26 12:03:32,712][123091] Updated weights for policy 0, policy_version 1561025 (0.0008) [2023-12-26 12:03:32,777][123091] Updated weights for policy 0, policy_version 1561035 (0.0009) [2023-12-26 12:03:33,049][123090] Updated weights for policy 1, policy_version 1550601 (0.0006) [2023-12-26 12:03:33,115][123090] Updated weights for policy 1, policy_version 1550611 (0.0005) [2023-12-26 12:03:33,163][123090] Updated weights for policy 1, policy_version 1550621 (0.0005) [2023-12-26 12:03:33,443][123091] Updated weights for policy 0, policy_version 1561045 (0.0007) [2023-12-26 12:03:33,509][123091] Updated weights for policy 0, policy_version 1561055 (0.0005) [2023-12-26 12:03:33,579][123091] Updated weights for policy 0, policy_version 1561065 (0.0005) [2023-12-26 12:03:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 796598272. Throughput: 0: 8803.0, 1: 8654.9. Samples: 796608828. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:33,785][121949] Avg episode reward: [(0, '6232.379'), (1, '5417.248')] [2023-12-26 12:03:33,900][123090] Updated weights for policy 1, policy_version 1550631 (0.0005) [2023-12-26 12:03:33,945][123090] Updated weights for policy 1, policy_version 1550641 (0.0005) [2023-12-26 12:03:33,991][123090] Updated weights for policy 1, policy_version 1550651 (0.0005) [2023-12-26 12:03:34,197][123091] Updated weights for policy 0, policy_version 1561075 (0.0006) [2023-12-26 12:03:34,262][123091] Updated weights for policy 0, policy_version 1561085 (0.0006) [2023-12-26 12:03:34,328][123091] Updated weights for policy 0, policy_version 1561095 (0.0006) [2023-12-26 12:03:34,678][123090] Updated weights for policy 1, policy_version 1550661 (0.0007) [2023-12-26 12:03:34,741][123090] Updated weights for policy 1, policy_version 1550671 (0.0009) [2023-12-26 12:03:34,796][123090] Updated weights for policy 1, policy_version 1550681 (0.0007) [2023-12-26 12:03:35,173][123091] Updated weights for policy 0, policy_version 1561105 (0.0006) [2023-12-26 12:03:35,224][123091] Updated weights for policy 0, policy_version 1561115 (0.0009) [2023-12-26 12:03:35,277][123091] Updated weights for policy 0, policy_version 1561125 (0.0009) [2023-12-26 12:03:35,333][123091] Updated weights for policy 0, policy_version 1561135 (0.0010) [2023-12-26 12:03:35,538][123090] Updated weights for policy 1, policy_version 1550691 (0.0005) [2023-12-26 12:03:35,595][123090] Updated weights for policy 1, policy_version 1550701 (0.0005) [2023-12-26 12:03:35,653][123090] Updated weights for policy 1, policy_version 1550711 (0.0005) [2023-12-26 12:03:36,255][123091] Updated weights for policy 0, policy_version 1561145 (0.0010) [2023-12-26 12:03:36,321][123091] Updated weights for policy 0, policy_version 1561155 (0.0010) [2023-12-26 12:03:36,322][123090] Updated weights for policy 1, policy_version 1550721 (0.0005) [2023-12-26 12:03:36,384][123091] Updated weights for policy 0, policy_version 1561165 (0.0010) [2023-12-26 12:03:36,416][123090] Updated weights for policy 1, policy_version 1550731 (0.0006) [2023-12-26 12:03:36,472][123090] Updated weights for policy 1, policy_version 1550741 (0.0010) [2023-12-26 12:03:36,541][123090] Updated weights for policy 1, policy_version 1550751 (0.0011) [2023-12-26 12:03:37,153][123091] Updated weights for policy 0, policy_version 1561175 (0.0008) [2023-12-26 12:03:37,221][123091] Updated weights for policy 0, policy_version 1561185 (0.0007) [2023-12-26 12:03:37,278][123091] Updated weights for policy 0, policy_version 1561195 (0.0010) [2023-12-26 12:03:37,288][123090] Updated weights for policy 1, policy_version 1550761 (0.0009) [2023-12-26 12:03:37,340][123090] Updated weights for policy 1, policy_version 1550771 (0.0005) [2023-12-26 12:03:37,387][123090] Updated weights for policy 1, policy_version 1550781 (0.0005) [2023-12-26 12:03:37,959][123091] Updated weights for policy 0, policy_version 1561205 (0.0009) [2023-12-26 12:03:38,033][123091] Updated weights for policy 0, policy_version 1561215 (0.0008) [2023-12-26 12:03:38,100][123091] Updated weights for policy 0, policy_version 1561225 (0.0006) [2023-12-26 12:03:38,186][123090] Updated weights for policy 1, policy_version 1550791 (0.0009) [2023-12-26 12:03:38,253][123090] Updated weights for policy 1, policy_version 1550801 (0.0010) [2023-12-26 12:03:38,323][123090] Updated weights for policy 1, policy_version 1550811 (0.0010) [2023-12-26 12:03:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 796688384. Throughput: 0: 8783.9, 1: 8766.1. Samples: 796664388. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:38,785][121949] Avg episode reward: [(0, '6207.438'), (1, '5379.574')] [2023-12-26 12:03:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001550816_397008896.pth... [2023-12-26 12:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001561232_399679488.pth... [2023-12-26 12:03:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001549792_396746752.pth [2023-12-26 12:03:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001560208_399417344.pth [2023-12-26 12:03:38,872][123091] Updated weights for policy 0, policy_version 1561235 (0.0008) [2023-12-26 12:03:38,928][123091] Updated weights for policy 0, policy_version 1561245 (0.0007) [2023-12-26 12:03:38,996][123091] Updated weights for policy 0, policy_version 1561255 (0.0007) [2023-12-26 12:03:39,165][123090] Updated weights for policy 1, policy_version 1550821 (0.0011) [2023-12-26 12:03:39,240][123090] Updated weights for policy 1, policy_version 1550831 (0.0011) [2023-12-26 12:03:39,309][123090] Updated weights for policy 1, policy_version 1550841 (0.0011) [2023-12-26 12:03:39,729][123091] Updated weights for policy 0, policy_version 1561265 (0.0010) [2023-12-26 12:03:39,790][123091] Updated weights for policy 0, policy_version 1561275 (0.0006) [2023-12-26 12:03:39,856][123091] Updated weights for policy 0, policy_version 1561285 (0.0009) [2023-12-26 12:03:39,917][123091] Updated weights for policy 0, policy_version 1561295 (0.0009) [2023-12-26 12:03:40,183][123090] Updated weights for policy 1, policy_version 1550851 (0.0008) [2023-12-26 12:03:40,249][123090] Updated weights for policy 1, policy_version 1550861 (0.0007) [2023-12-26 12:03:40,319][123090] Updated weights for policy 1, policy_version 1550871 (0.0010) [2023-12-26 12:03:40,631][123091] Updated weights for policy 0, policy_version 1561305 (0.0011) [2023-12-26 12:03:40,686][123091] Updated weights for policy 0, policy_version 1561315 (0.0010) [2023-12-26 12:03:40,745][123091] Updated weights for policy 0, policy_version 1561325 (0.0010) [2023-12-26 12:03:41,125][123090] Updated weights for policy 1, policy_version 1550881 (0.0010) [2023-12-26 12:03:41,199][123090] Updated weights for policy 1, policy_version 1550891 (0.0011) [2023-12-26 12:03:41,269][123090] Updated weights for policy 1, policy_version 1550901 (0.0011) [2023-12-26 12:03:41,335][123090] Updated weights for policy 1, policy_version 1550911 (0.0011) [2023-12-26 12:03:41,572][123091] Updated weights for policy 0, policy_version 1561335 (0.0009) [2023-12-26 12:03:41,640][123091] Updated weights for policy 0, policy_version 1561345 (0.0009) [2023-12-26 12:03:41,704][123091] Updated weights for policy 0, policy_version 1561355 (0.0006) [2023-12-26 12:03:42,101][123090] Updated weights for policy 1, policy_version 1550921 (0.0006) [2023-12-26 12:03:42,153][123090] Updated weights for policy 1, policy_version 1550931 (0.0005) [2023-12-26 12:03:42,204][123090] Updated weights for policy 1, policy_version 1550941 (0.0006) [2023-12-26 12:03:42,483][123091] Updated weights for policy 0, policy_version 1561365 (0.0008) [2023-12-26 12:03:42,546][123091] Updated weights for policy 0, policy_version 1561375 (0.0007) [2023-12-26 12:03:42,612][123091] Updated weights for policy 0, policy_version 1561385 (0.0007) [2023-12-26 12:03:42,949][123090] Updated weights for policy 1, policy_version 1550951 (0.0009) [2023-12-26 12:03:43,000][123090] Updated weights for policy 1, policy_version 1550961 (0.0010) [2023-12-26 12:03:43,055][123090] Updated weights for policy 1, policy_version 1550971 (0.0010) [2023-12-26 12:03:43,342][123091] Updated weights for policy 0, policy_version 1561395 (0.0007) [2023-12-26 12:03:43,405][123091] Updated weights for policy 0, policy_version 1561405 (0.0010) [2023-12-26 12:03:43,463][123091] Updated weights for policy 0, policy_version 1561415 (0.0010) [2023-12-26 12:03:43,709][123090] Updated weights for policy 1, policy_version 1550981 (0.0010) [2023-12-26 12:03:43,763][123090] Updated weights for policy 1, policy_version 1550991 (0.0010) [2023-12-26 12:03:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 796778496. Throughput: 0: 8853.3, 1: 8818.0. Samples: 796771892. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:43,785][121949] Avg episode reward: [(0, '6264.701'), (1, '5526.055')] [2023-12-26 12:03:43,824][123090] Updated weights for policy 1, policy_version 1551001 (0.0009) [2023-12-26 12:03:44,275][123091] Updated weights for policy 0, policy_version 1561425 (0.0010) [2023-12-26 12:03:44,335][123091] Updated weights for policy 0, policy_version 1561435 (0.0006) [2023-12-26 12:03:44,390][123091] Updated weights for policy 0, policy_version 1561445 (0.0006) [2023-12-26 12:03:44,439][123091] Updated weights for policy 0, policy_version 1561455 (0.0006) [2023-12-26 12:03:44,571][123090] Updated weights for policy 1, policy_version 1551011 (0.0008) [2023-12-26 12:03:44,617][123090] Updated weights for policy 1, policy_version 1551021 (0.0005) [2023-12-26 12:03:44,675][123090] Updated weights for policy 1, policy_version 1551031 (0.0005) [2023-12-26 12:03:45,122][123091] Updated weights for policy 0, policy_version 1561465 (0.0008) [2023-12-26 12:03:45,195][123091] Updated weights for policy 0, policy_version 1561475 (0.0009) [2023-12-26 12:03:45,250][123091] Updated weights for policy 0, policy_version 1561485 (0.0010) [2023-12-26 12:03:45,432][123090] Updated weights for policy 1, policy_version 1551041 (0.0006) [2023-12-26 12:03:45,484][123090] Updated weights for policy 1, policy_version 1551051 (0.0009) [2023-12-26 12:03:45,534][123090] Updated weights for policy 1, policy_version 1551061 (0.0009) [2023-12-26 12:03:45,586][123090] Updated weights for policy 1, policy_version 1551072 (0.0010) [2023-12-26 12:03:46,068][123091] Updated weights for policy 0, policy_version 1561495 (0.0009) [2023-12-26 12:03:46,129][123091] Updated weights for policy 0, policy_version 1561506 (0.0010) [2023-12-26 12:03:46,178][123091] Updated weights for policy 0, policy_version 1561516 (0.0009) [2023-12-26 12:03:46,402][123090] Updated weights for policy 1, policy_version 1551082 (0.0010) [2023-12-26 12:03:46,466][123090] Updated weights for policy 1, policy_version 1551092 (0.0010) [2023-12-26 12:03:46,520][123090] Updated weights for policy 1, policy_version 1551102 (0.0009) [2023-12-26 12:03:46,927][123091] Updated weights for policy 0, policy_version 1561527 (0.0007) [2023-12-26 12:03:46,985][123091] Updated weights for policy 0, policy_version 1561537 (0.0006) [2023-12-26 12:03:47,052][123091] Updated weights for policy 0, policy_version 1561547 (0.0006) [2023-12-26 12:03:47,461][123090] Updated weights for policy 1, policy_version 1551112 (0.0010) [2023-12-26 12:03:47,524][123090] Updated weights for policy 1, policy_version 1551122 (0.0010) [2023-12-26 12:03:47,574][123090] Updated weights for policy 1, policy_version 1551132 (0.0009) [2023-12-26 12:03:47,717][123091] Updated weights for policy 0, policy_version 1561557 (0.0008) [2023-12-26 12:03:47,776][123091] Updated weights for policy 0, policy_version 1561567 (0.0010) [2023-12-26 12:03:47,839][123091] Updated weights for policy 0, policy_version 1561577 (0.0011) [2023-12-26 12:03:48,454][123090] Updated weights for policy 1, policy_version 1551142 (0.0007) [2023-12-26 12:03:48,505][123090] Updated weights for policy 1, policy_version 1551152 (0.0007) [2023-12-26 12:03:48,564][123090] Updated weights for policy 1, policy_version 1551162 (0.0009) [2023-12-26 12:03:48,657][123091] Updated weights for policy 0, policy_version 1561587 (0.0010) [2023-12-26 12:03:48,716][123091] Updated weights for policy 0, policy_version 1561597 (0.0009) [2023-12-26 12:03:48,769][123091] Updated weights for policy 0, policy_version 1561607 (0.0009) [2023-12-26 12:03:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 796868608. Throughput: 0: 8933.5, 1: 8904.7. Samples: 796881164. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:48,785][121949] Avg episode reward: [(0, '6107.363'), (1, '5692.899')] [2023-12-26 12:03:49,394][123090] Updated weights for policy 1, policy_version 1551172 (0.0009) [2023-12-26 12:03:49,451][123090] Updated weights for policy 1, policy_version 1551182 (0.0009) [2023-12-26 12:03:49,502][123090] Updated weights for policy 1, policy_version 1551192 (0.0009) [2023-12-26 12:03:49,633][123091] Updated weights for policy 0, policy_version 1561617 (0.0008) [2023-12-26 12:03:49,695][123091] Updated weights for policy 0, policy_version 1561627 (0.0009) [2023-12-26 12:03:49,746][123091] Updated weights for policy 0, policy_version 1561637 (0.0009) [2023-12-26 12:03:49,798][123091] Updated weights for policy 0, policy_version 1561648 (0.0010) [2023-12-26 12:03:50,331][123090] Updated weights for policy 1, policy_version 1551202 (0.0010) [2023-12-26 12:03:50,382][123090] Updated weights for policy 1, policy_version 1551212 (0.0010) [2023-12-26 12:03:50,431][123090] Updated weights for policy 1, policy_version 1551222 (0.0009) [2023-12-26 12:03:50,487][123090] Updated weights for policy 1, policy_version 1551232 (0.0009) [2023-12-26 12:03:50,676][123091] Updated weights for policy 0, policy_version 1561658 (0.0009) [2023-12-26 12:03:50,743][123091] Updated weights for policy 0, policy_version 1561668 (0.0009) [2023-12-26 12:03:50,813][123091] Updated weights for policy 0, policy_version 1561678 (0.0010) [2023-12-26 12:03:51,384][123090] Updated weights for policy 1, policy_version 1551242 (0.0009) [2023-12-26 12:03:51,448][123090] Updated weights for policy 1, policy_version 1551252 (0.0008) [2023-12-26 12:03:51,517][123090] Updated weights for policy 1, policy_version 1551262 (0.0010) [2023-12-26 12:03:51,662][123091] Updated weights for policy 0, policy_version 1561688 (0.0009) [2023-12-26 12:03:51,725][123091] Updated weights for policy 0, policy_version 1561698 (0.0010) [2023-12-26 12:03:51,805][123091] Updated weights for policy 0, policy_version 1561708 (0.0009) [2023-12-26 12:03:52,332][123090] Updated weights for policy 1, policy_version 1551272 (0.0010) [2023-12-26 12:03:52,400][123090] Updated weights for policy 1, policy_version 1551282 (0.0010) [2023-12-26 12:03:52,468][123090] Updated weights for policy 1, policy_version 1551292 (0.0009) [2023-12-26 12:03:52,558][123091] Updated weights for policy 0, policy_version 1561718 (0.0009) [2023-12-26 12:03:52,622][123091] Updated weights for policy 0, policy_version 1561728 (0.0009) [2023-12-26 12:03:52,680][123091] Updated weights for policy 0, policy_version 1561738 (0.0009) [2023-12-26 12:03:53,242][123090] Updated weights for policy 1, policy_version 1551302 (0.0008) [2023-12-26 12:03:53,316][123090] Updated weights for policy 1, policy_version 1551312 (0.0011) [2023-12-26 12:03:53,393][123090] Updated weights for policy 1, policy_version 1551322 (0.0010) [2023-12-26 12:03:53,436][123091] Updated weights for policy 0, policy_version 1561748 (0.0009) [2023-12-26 12:03:53,492][123091] Updated weights for policy 0, policy_version 1561758 (0.0006) [2023-12-26 12:03:53,555][123091] Updated weights for policy 0, policy_version 1561768 (0.0006) [2023-12-26 12:03:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 796958720. Throughput: 0: 8887.3, 1: 8877.0. Samples: 796931232. Policy #0 lag: (min: 31.0, avg: 40.9, max: 63.0) [2023-12-26 12:03:53,785][121949] Avg episode reward: [(0, '6047.819'), (1, '5650.194')] [2023-12-26 12:03:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001561776_399818752.pth... [2023-12-26 12:03:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001551328_397139968.pth... [2023-12-26 12:03:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001550272_396869632.pth [2023-12-26 12:03:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001560720_399548416.pth [2023-12-26 12:03:54,119][123090] Updated weights for policy 1, policy_version 1551332 (0.0009) [2023-12-26 12:03:54,170][123090] Updated weights for policy 1, policy_version 1551342 (0.0010) [2023-12-26 12:03:54,218][123090] Updated weights for policy 1, policy_version 1551352 (0.0010) [2023-12-26 12:03:54,346][123091] Updated weights for policy 0, policy_version 1561778 (0.0008) [2023-12-26 12:03:54,407][123091] Updated weights for policy 0, policy_version 1561788 (0.0010) [2023-12-26 12:03:54,465][123091] Updated weights for policy 0, policy_version 1561798 (0.0010) [2023-12-26 12:03:54,523][123091] Updated weights for policy 0, policy_version 1561808 (0.0010) [2023-12-26 12:03:55,046][123090] Updated weights for policy 1, policy_version 1551362 (0.0010) [2023-12-26 12:03:55,101][123090] Updated weights for policy 1, policy_version 1551372 (0.0010) [2023-12-26 12:03:55,156][123090] Updated weights for policy 1, policy_version 1551382 (0.0010) [2023-12-26 12:03:55,207][123090] Updated weights for policy 1, policy_version 1551392 (0.0010) [2023-12-26 12:03:55,333][123091] Updated weights for policy 0, policy_version 1561818 (0.0006) [2023-12-26 12:03:55,394][123091] Updated weights for policy 0, policy_version 1561828 (0.0005) [2023-12-26 12:03:55,453][123091] Updated weights for policy 0, policy_version 1561838 (0.0005) [2023-12-26 12:03:56,021][123090] Updated weights for policy 1, policy_version 1551402 (0.0006) [2023-12-26 12:03:56,082][123090] Updated weights for policy 1, policy_version 1551412 (0.0006) [2023-12-26 12:03:56,150][123090] Updated weights for policy 1, policy_version 1551422 (0.0010) [2023-12-26 12:03:56,161][123091] Updated weights for policy 0, policy_version 1561848 (0.0006) [2023-12-26 12:03:56,224][123091] Updated weights for policy 0, policy_version 1561858 (0.0010) [2023-12-26 12:03:56,276][123091] Updated weights for policy 0, policy_version 1561868 (0.0008) [2023-12-26 12:03:56,856][123090] Updated weights for policy 1, policy_version 1551432 (0.0006) [2023-12-26 12:03:56,908][123090] Updated weights for policy 1, policy_version 1551442 (0.0006) [2023-12-26 12:03:56,963][123090] Updated weights for policy 1, policy_version 1551452 (0.0010) [2023-12-26 12:03:57,187][123091] Updated weights for policy 0, policy_version 1561878 (0.0009) [2023-12-26 12:03:57,240][123091] Updated weights for policy 0, policy_version 1561888 (0.0009) [2023-12-26 12:03:57,289][123091] Updated weights for policy 0, policy_version 1561898 (0.0009) [2023-12-26 12:03:57,776][123090] Updated weights for policy 1, policy_version 1551462 (0.0010) [2023-12-26 12:03:57,822][123090] Updated weights for policy 1, policy_version 1551472 (0.0010) [2023-12-26 12:03:57,873][123090] Updated weights for policy 1, policy_version 1551482 (0.0010) [2023-12-26 12:03:58,132][123091] Updated weights for policy 0, policy_version 1561908 (0.0009) [2023-12-26 12:03:58,185][123091] Updated weights for policy 0, policy_version 1561918 (0.0008) [2023-12-26 12:03:58,245][123091] Updated weights for policy 0, policy_version 1561928 (0.0009) [2023-12-26 12:03:58,756][123090] Updated weights for policy 1, policy_version 1551492 (0.0010) [2023-12-26 12:03:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 797040640. Throughput: 0: 8962.8, 1: 8854.3. Samples: 797038320. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:03:58,785][121949] Avg episode reward: [(0, '6299.125'), (1, '5842.561')] [2023-12-26 12:03:58,819][123090] Updated weights for policy 1, policy_version 1551502 (0.0011) [2023-12-26 12:03:58,882][123090] Updated weights for policy 1, policy_version 1551512 (0.0010) [2023-12-26 12:03:59,128][123091] Updated weights for policy 0, policy_version 1561938 (0.0009) [2023-12-26 12:03:59,176][123091] Updated weights for policy 0, policy_version 1561948 (0.0008) [2023-12-26 12:03:59,232][123091] Updated weights for policy 0, policy_version 1561958 (0.0009) [2023-12-26 12:03:59,293][123091] Updated weights for policy 0, policy_version 1561968 (0.0008) [2023-12-26 12:03:59,712][123090] Updated weights for policy 1, policy_version 1551522 (0.0010) [2023-12-26 12:03:59,785][123090] Updated weights for policy 1, policy_version 1551532 (0.0005) [2023-12-26 12:03:59,856][123090] Updated weights for policy 1, policy_version 1551542 (0.0007) [2023-12-26 12:03:59,923][123090] Updated weights for policy 1, policy_version 1551552 (0.0007) [2023-12-26 12:04:00,121][123091] Updated weights for policy 0, policy_version 1561978 (0.0005) [2023-12-26 12:04:00,175][123091] Updated weights for policy 0, policy_version 1561988 (0.0006) [2023-12-26 12:04:00,241][123091] Updated weights for policy 0, policy_version 1561998 (0.0005) [2023-12-26 12:04:00,622][123090] Updated weights for policy 1, policy_version 1551562 (0.0005) [2023-12-26 12:04:00,694][123090] Updated weights for policy 1, policy_version 1551572 (0.0006) [2023-12-26 12:04:00,756][123090] Updated weights for policy 1, policy_version 1551582 (0.0005) [2023-12-26 12:04:00,872][123091] Updated weights for policy 0, policy_version 1562008 (0.0006) [2023-12-26 12:04:00,919][123091] Updated weights for policy 0, policy_version 1562018 (0.0005) [2023-12-26 12:04:00,969][123091] Updated weights for policy 0, policy_version 1562028 (0.0005) [2023-12-26 12:04:01,447][123090] Updated weights for policy 1, policy_version 1551592 (0.0008) [2023-12-26 12:04:01,501][123090] Updated weights for policy 1, policy_version 1551602 (0.0008) [2023-12-26 12:04:01,558][123090] Updated weights for policy 1, policy_version 1551612 (0.0009) [2023-12-26 12:04:01,780][123091] Updated weights for policy 0, policy_version 1562038 (0.0006) [2023-12-26 12:04:01,844][123091] Updated weights for policy 0, policy_version 1562048 (0.0005) [2023-12-26 12:04:01,907][123091] Updated weights for policy 0, policy_version 1562058 (0.0009) [2023-12-26 12:04:02,366][123090] Updated weights for policy 1, policy_version 1551622 (0.0008) [2023-12-26 12:04:02,437][123090] Updated weights for policy 1, policy_version 1551632 (0.0006) [2023-12-26 12:04:02,503][123090] Updated weights for policy 1, policy_version 1551642 (0.0005) [2023-12-26 12:04:02,782][123091] Updated weights for policy 0, policy_version 1562068 (0.0009) [2023-12-26 12:04:02,841][123091] Updated weights for policy 0, policy_version 1562079 (0.0012) [2023-12-26 12:04:02,894][123091] Updated weights for policy 0, policy_version 1562090 (0.0010) [2023-12-26 12:04:03,111][123090] Updated weights for policy 1, policy_version 1551652 (0.0005) [2023-12-26 12:04:03,172][123090] Updated weights for policy 1, policy_version 1551662 (0.0005) [2023-12-26 12:04:03,235][123090] Updated weights for policy 1, policy_version 1551672 (0.0005) [2023-12-26 12:04:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 797130752. Throughput: 0: 8887.0, 1: 8973.2. Samples: 797146360. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:03,785][121949] Avg episode reward: [(0, '6196.862'), (1, '5777.273')] [2023-12-26 12:04:03,815][123090] Updated weights for policy 1, policy_version 1551682 (0.0006) [2023-12-26 12:04:03,833][123091] Updated weights for policy 0, policy_version 1562100 (0.0009) [2023-12-26 12:04:03,881][123090] Updated weights for policy 1, policy_version 1551692 (0.0009) [2023-12-26 12:04:03,896][123091] Updated weights for policy 0, policy_version 1562110 (0.0008) [2023-12-26 12:04:03,938][123090] Updated weights for policy 1, policy_version 1551702 (0.0009) [2023-12-26 12:04:03,956][123091] Updated weights for policy 0, policy_version 1562120 (0.0008) [2023-12-26 12:04:03,999][123090] Updated weights for policy 1, policy_version 1551712 (0.0008) [2023-12-26 12:04:04,775][123091] Updated weights for policy 0, policy_version 1562130 (0.0008) [2023-12-26 12:04:04,837][123091] Updated weights for policy 0, policy_version 1562140 (0.0010) [2023-12-26 12:04:04,843][123090] Updated weights for policy 1, policy_version 1551722 (0.0008) [2023-12-26 12:04:04,893][123091] Updated weights for policy 0, policy_version 1562150 (0.0007) [2023-12-26 12:04:04,900][123090] Updated weights for policy 1, policy_version 1551732 (0.0008) [2023-12-26 12:04:04,949][123091] Updated weights for policy 0, policy_version 1562160 (0.0009) [2023-12-26 12:04:04,951][123090] Updated weights for policy 1, policy_version 1551742 (0.0008) [2023-12-26 12:04:05,782][123091] Updated weights for policy 0, policy_version 1562170 (0.0007) [2023-12-26 12:04:05,784][123090] Updated weights for policy 1, policy_version 1551752 (0.0008) [2023-12-26 12:04:05,838][123090] Updated weights for policy 1, policy_version 1551762 (0.0009) [2023-12-26 12:04:05,842][123091] Updated weights for policy 0, policy_version 1562180 (0.0009) [2023-12-26 12:04:05,891][123090] Updated weights for policy 1, policy_version 1551772 (0.0009) [2023-12-26 12:04:05,898][123091] Updated weights for policy 0, policy_version 1562190 (0.0007) [2023-12-26 12:04:06,709][123090] Updated weights for policy 1, policy_version 1551782 (0.0010) [2023-12-26 12:04:06,737][123091] Updated weights for policy 0, policy_version 1562200 (0.0007) [2023-12-26 12:04:06,770][123090] Updated weights for policy 1, policy_version 1551792 (0.0011) [2023-12-26 12:04:06,795][123091] Updated weights for policy 0, policy_version 1562210 (0.0006) [2023-12-26 12:04:06,823][123090] Updated weights for policy 1, policy_version 1551802 (0.0011) [2023-12-26 12:04:06,852][123091] Updated weights for policy 0, policy_version 1562220 (0.0006) [2023-12-26 12:04:07,668][123090] Updated weights for policy 1, policy_version 1551812 (0.0011) [2023-12-26 12:04:07,700][123091] Updated weights for policy 0, policy_version 1562230 (0.0008) [2023-12-26 12:04:07,732][123090] Updated weights for policy 1, policy_version 1551822 (0.0011) [2023-12-26 12:04:07,762][123091] Updated weights for policy 0, policy_version 1562240 (0.0007) [2023-12-26 12:04:07,797][123090] Updated weights for policy 1, policy_version 1551832 (0.0011) [2023-12-26 12:04:07,813][123091] Updated weights for policy 0, policy_version 1562250 (0.0008) [2023-12-26 12:04:08,630][123090] Updated weights for policy 1, policy_version 1551842 (0.0011) [2023-12-26 12:04:08,683][123091] Updated weights for policy 0, policy_version 1562260 (0.0009) [2023-12-26 12:04:08,700][123090] Updated weights for policy 1, policy_version 1551852 (0.0010) [2023-12-26 12:04:08,744][123091] Updated weights for policy 0, policy_version 1562270 (0.0009) [2023-12-26 12:04:08,763][123090] Updated weights for policy 1, policy_version 1551862 (0.0010) [2023-12-26 12:04:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 797212672. Throughput: 0: 8897.9, 1: 8990.7. Samples: 797198072. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:08,785][121949] Avg episode reward: [(0, '6237.868'), (1, '5659.783')] [2023-12-26 12:04:08,809][123091] Updated weights for policy 0, policy_version 1562280 (0.0006) [2023-12-26 12:04:08,823][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001551872_397279232.pth... [2023-12-26 12:04:08,826][123090] Updated weights for policy 1, policy_version 1551872 (0.0010) [2023-12-26 12:04:08,827][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001550816_397008896.pth [2023-12-26 12:04:08,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001562288_399949824.pth... [2023-12-26 12:04:08,854][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001561232_399679488.pth [2023-12-26 12:04:09,644][123090] Updated weights for policy 1, policy_version 1551882 (0.0010) [2023-12-26 12:04:09,653][123091] Updated weights for policy 0, policy_version 1562290 (0.0008) [2023-12-26 12:04:09,712][123090] Updated weights for policy 1, policy_version 1551892 (0.0008) [2023-12-26 12:04:09,719][123091] Updated weights for policy 0, policy_version 1562300 (0.0009) [2023-12-26 12:04:09,778][123090] Updated weights for policy 1, policy_version 1551902 (0.0009) [2023-12-26 12:04:09,785][123091] Updated weights for policy 0, policy_version 1562310 (0.0007) [2023-12-26 12:04:09,856][123091] Updated weights for policy 0, policy_version 1562320 (0.0009) [2023-12-26 12:04:10,552][123091] Updated weights for policy 0, policy_version 1562330 (0.0005) [2023-12-26 12:04:10,596][123090] Updated weights for policy 1, policy_version 1551912 (0.0008) [2023-12-26 12:04:10,610][123091] Updated weights for policy 0, policy_version 1562340 (0.0006) [2023-12-26 12:04:10,659][123090] Updated weights for policy 1, policy_version 1551922 (0.0005) [2023-12-26 12:04:10,680][123091] Updated weights for policy 0, policy_version 1562350 (0.0010) [2023-12-26 12:04:10,729][123090] Updated weights for policy 1, policy_version 1551932 (0.0005) [2023-12-26 12:04:11,440][123090] Updated weights for policy 1, policy_version 1551942 (0.0009) [2023-12-26 12:04:11,450][123091] Updated weights for policy 0, policy_version 1562360 (0.0010) [2023-12-26 12:04:11,512][123090] Updated weights for policy 1, policy_version 1551952 (0.0008) [2023-12-26 12:04:11,518][123091] Updated weights for policy 0, policy_version 1562370 (0.0011) [2023-12-26 12:04:11,582][123090] Updated weights for policy 1, policy_version 1551962 (0.0006) [2023-12-26 12:04:11,588][123091] Updated weights for policy 0, policy_version 1562380 (0.0011) [2023-12-26 12:04:12,362][123090] Updated weights for policy 1, policy_version 1551972 (0.0007) [2023-12-26 12:04:12,420][123091] Updated weights for policy 0, policy_version 1562390 (0.0008) [2023-12-26 12:04:12,423][123090] Updated weights for policy 1, policy_version 1551982 (0.0007) [2023-12-26 12:04:12,478][123090] Updated weights for policy 1, policy_version 1551992 (0.0007) [2023-12-26 12:04:12,491][123091] Updated weights for policy 0, policy_version 1562400 (0.0005) [2023-12-26 12:04:12,564][123091] Updated weights for policy 0, policy_version 1562410 (0.0007) [2023-12-26 12:04:13,221][123090] Updated weights for policy 1, policy_version 1552002 (0.0006) [2023-12-26 12:04:13,270][123090] Updated weights for policy 1, policy_version 1552012 (0.0007) [2023-12-26 12:04:13,320][123091] Updated weights for policy 0, policy_version 1562420 (0.0010) [2023-12-26 12:04:13,321][123090] Updated weights for policy 1, policy_version 1552022 (0.0006) [2023-12-26 12:04:13,365][123090] Updated weights for policy 1, policy_version 1552032 (0.0005) [2023-12-26 12:04:13,378][123091] Updated weights for policy 0, policy_version 1562430 (0.0010) [2023-12-26 12:04:13,436][123091] Updated weights for policy 0, policy_version 1562440 (0.0010) [2023-12-26 12:04:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 797310976. Throughput: 0: 8833.5, 1: 8926.6. Samples: 797302288. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:13,785][121949] Avg episode reward: [(0, '6322.334'), (1, '5617.216')] [2023-12-26 12:04:14,053][123090] Updated weights for policy 1, policy_version 1552042 (0.0008) [2023-12-26 12:04:14,112][123090] Updated weights for policy 1, policy_version 1552052 (0.0010) [2023-12-26 12:04:14,173][123090] Updated weights for policy 1, policy_version 1552062 (0.0010) [2023-12-26 12:04:14,268][123091] Updated weights for policy 0, policy_version 1562450 (0.0010) [2023-12-26 12:04:14,323][123091] Updated weights for policy 0, policy_version 1562460 (0.0010) [2023-12-26 12:04:14,392][123091] Updated weights for policy 0, policy_version 1562470 (0.0010) [2023-12-26 12:04:14,442][123091] Updated weights for policy 0, policy_version 1562480 (0.0010) [2023-12-26 12:04:15,001][123090] Updated weights for policy 1, policy_version 1552072 (0.0009) [2023-12-26 12:04:15,065][123090] Updated weights for policy 1, policy_version 1552082 (0.0009) [2023-12-26 12:04:15,119][123090] Updated weights for policy 1, policy_version 1552092 (0.0009) [2023-12-26 12:04:15,261][123091] Updated weights for policy 0, policy_version 1562490 (0.0010) [2023-12-26 12:04:15,318][123091] Updated weights for policy 0, policy_version 1562500 (0.0010) [2023-12-26 12:04:15,378][123091] Updated weights for policy 0, policy_version 1562510 (0.0011) [2023-12-26 12:04:15,983][123090] Updated weights for policy 1, policy_version 1552102 (0.0009) [2023-12-26 12:04:16,035][123090] Updated weights for policy 1, policy_version 1552112 (0.0009) [2023-12-26 12:04:16,088][123090] Updated weights for policy 1, policy_version 1552122 (0.0009) [2023-12-26 12:04:16,208][123091] Updated weights for policy 0, policy_version 1562520 (0.0010) [2023-12-26 12:04:16,259][123091] Updated weights for policy 0, policy_version 1562530 (0.0010) [2023-12-26 12:04:16,309][123091] Updated weights for policy 0, policy_version 1562540 (0.0010) [2023-12-26 12:04:16,927][123090] Updated weights for policy 1, policy_version 1552132 (0.0008) [2023-12-26 12:04:16,977][123090] Updated weights for policy 1, policy_version 1552142 (0.0005) [2023-12-26 12:04:17,023][123090] Updated weights for policy 1, policy_version 1552152 (0.0005) [2023-12-26 12:04:17,141][123091] Updated weights for policy 0, policy_version 1562550 (0.0007) [2023-12-26 12:04:17,196][123091] Updated weights for policy 0, policy_version 1562560 (0.0008) [2023-12-26 12:04:17,258][123091] Updated weights for policy 0, policy_version 1562570 (0.0010) [2023-12-26 12:04:17,720][123090] Updated weights for policy 1, policy_version 1552162 (0.0005) [2023-12-26 12:04:17,777][123090] Updated weights for policy 1, policy_version 1552172 (0.0005) [2023-12-26 12:04:17,836][123090] Updated weights for policy 1, policy_version 1552182 (0.0005) [2023-12-26 12:04:17,883][123090] Updated weights for policy 1, policy_version 1552192 (0.0005) [2023-12-26 12:04:18,171][123091] Updated weights for policy 0, policy_version 1562581 (0.0010) [2023-12-26 12:04:18,228][123091] Updated weights for policy 0, policy_version 1562591 (0.0009) [2023-12-26 12:04:18,279][123091] Updated weights for policy 0, policy_version 1562601 (0.0007) [2023-12-26 12:04:18,649][123090] Updated weights for policy 1, policy_version 1552202 (0.0010) [2023-12-26 12:04:18,705][123090] Updated weights for policy 1, policy_version 1552212 (0.0011) [2023-12-26 12:04:18,761][123090] Updated weights for policy 1, policy_version 1552222 (0.0011) [2023-12-26 12:04:18,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 797401088. Throughput: 0: 8783.0, 1: 8993.5. Samples: 797408768. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:18,784][121949] Avg episode reward: [(0, '6148.619'), (1, '5797.136')] [2023-12-26 12:04:19,137][123091] Updated weights for policy 0, policy_version 1562611 (0.0007) [2023-12-26 12:04:19,192][123091] Updated weights for policy 0, policy_version 1562621 (0.0010) [2023-12-26 12:04:19,260][123091] Updated weights for policy 0, policy_version 1562631 (0.0008) [2023-12-26 12:04:19,575][123090] Updated weights for policy 1, policy_version 1552232 (0.0011) [2023-12-26 12:04:19,636][123090] Updated weights for policy 1, policy_version 1552242 (0.0011) [2023-12-26 12:04:19,707][123090] Updated weights for policy 1, policy_version 1552252 (0.0011) [2023-12-26 12:04:20,110][123091] Updated weights for policy 0, policy_version 1562641 (0.0009) [2023-12-26 12:04:20,175][123091] Updated weights for policy 0, policy_version 1562651 (0.0009) [2023-12-26 12:04:20,236][123091] Updated weights for policy 0, policy_version 1562661 (0.0009) [2023-12-26 12:04:20,294][123091] Updated weights for policy 0, policy_version 1562671 (0.0009) [2023-12-26 12:04:20,552][123090] Updated weights for policy 1, policy_version 1552262 (0.0011) [2023-12-26 12:04:20,642][123090] Updated weights for policy 1, policy_version 1552272 (0.0007) [2023-12-26 12:04:20,701][123090] Updated weights for policy 1, policy_version 1552282 (0.0006) [2023-12-26 12:04:21,200][123091] Updated weights for policy 0, policy_version 1562681 (0.0009) [2023-12-26 12:04:21,268][123091] Updated weights for policy 0, policy_version 1562691 (0.0009) [2023-12-26 12:04:21,333][123091] Updated weights for policy 0, policy_version 1562701 (0.0009) [2023-12-26 12:04:21,411][123090] Updated weights for policy 1, policy_version 1552292 (0.0007) [2023-12-26 12:04:21,481][123090] Updated weights for policy 1, policy_version 1552302 (0.0008) [2023-12-26 12:04:21,551][123090] Updated weights for policy 1, policy_version 1552312 (0.0008) [2023-12-26 12:04:22,216][123091] Updated weights for policy 0, policy_version 1562711 (0.0011) [2023-12-26 12:04:22,280][123091] Updated weights for policy 0, policy_version 1562721 (0.0010) [2023-12-26 12:04:22,344][123091] Updated weights for policy 0, policy_version 1562731 (0.0010) [2023-12-26 12:04:22,355][123090] Updated weights for policy 1, policy_version 1552322 (0.0008) [2023-12-26 12:04:22,422][123090] Updated weights for policy 1, policy_version 1552332 (0.0009) [2023-12-26 12:04:22,479][123090] Updated weights for policy 1, policy_version 1552342 (0.0008) [2023-12-26 12:04:22,541][123090] Updated weights for policy 1, policy_version 1552352 (0.0008) [2023-12-26 12:04:23,197][123091] Updated weights for policy 0, policy_version 1562741 (0.0008) [2023-12-26 12:04:23,266][123091] Updated weights for policy 0, policy_version 1562751 (0.0007) [2023-12-26 12:04:23,323][123090] Updated weights for policy 1, policy_version 1552362 (0.0007) [2023-12-26 12:04:23,329][123091] Updated weights for policy 0, policy_version 1562761 (0.0008) [2023-12-26 12:04:23,390][123090] Updated weights for policy 1, policy_version 1552372 (0.0008) [2023-12-26 12:04:23,457][123090] Updated weights for policy 1, policy_version 1552382 (0.0010) [2023-12-26 12:04:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 797483008. Throughput: 0: 8746.7, 1: 8911.9. Samples: 797459028. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:23,785][121949] Avg episode reward: [(0, '6168.689'), (1, '5977.587')] [2023-12-26 12:04:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001552384_397410304.pth... [2023-12-26 12:04:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001562768_400072704.pth... [2023-12-26 12:04:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001561776_399818752.pth [2023-12-26 12:04:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001551328_397139968.pth [2023-12-26 12:04:24,013][123091] Updated weights for policy 0, policy_version 1562771 (0.0007) [2023-12-26 12:04:24,066][123091] Updated weights for policy 0, policy_version 1562781 (0.0006) [2023-12-26 12:04:24,123][123091] Updated weights for policy 0, policy_version 1562791 (0.0006) [2023-12-26 12:04:24,197][123090] Updated weights for policy 1, policy_version 1552392 (0.0007) [2023-12-26 12:04:24,269][123090] Updated weights for policy 1, policy_version 1552402 (0.0005) [2023-12-26 12:04:24,339][123090] Updated weights for policy 1, policy_version 1552412 (0.0006) [2023-12-26 12:04:24,748][123091] Updated weights for policy 0, policy_version 1562801 (0.0006) [2023-12-26 12:04:24,811][123091] Updated weights for policy 0, policy_version 1562811 (0.0008) [2023-12-26 12:04:24,861][123091] Updated weights for policy 0, policy_version 1562821 (0.0009) [2023-12-26 12:04:24,912][123091] Updated weights for policy 0, policy_version 1562831 (0.0009) [2023-12-26 12:04:25,010][123090] Updated weights for policy 1, policy_version 1552422 (0.0008) [2023-12-26 12:04:25,072][123090] Updated weights for policy 1, policy_version 1552432 (0.0009) [2023-12-26 12:04:25,116][123090] Updated weights for policy 1, policy_version 1552442 (0.0010) [2023-12-26 12:04:25,674][123091] Updated weights for policy 0, policy_version 1562841 (0.0006) [2023-12-26 12:04:25,719][123091] Updated weights for policy 0, policy_version 1562851 (0.0005) [2023-12-26 12:04:25,766][123091] Updated weights for policy 0, policy_version 1562861 (0.0005) [2023-12-26 12:04:25,964][123090] Updated weights for policy 1, policy_version 1552452 (0.0010) [2023-12-26 12:04:26,024][123090] Updated weights for policy 1, policy_version 1552462 (0.0008) [2023-12-26 12:04:26,072][123090] Updated weights for policy 1, policy_version 1552472 (0.0006) [2023-12-26 12:04:26,476][123091] Updated weights for policy 0, policy_version 1562871 (0.0005) [2023-12-26 12:04:26,523][123091] Updated weights for policy 0, policy_version 1562881 (0.0005) [2023-12-26 12:04:26,569][123091] Updated weights for policy 0, policy_version 1562891 (0.0005) [2023-12-26 12:04:26,778][123090] Updated weights for policy 1, policy_version 1552482 (0.0005) [2023-12-26 12:04:26,846][123090] Updated weights for policy 1, policy_version 1552492 (0.0008) [2023-12-26 12:04:26,904][123090] Updated weights for policy 1, policy_version 1552502 (0.0008) [2023-12-26 12:04:26,965][123090] Updated weights for policy 1, policy_version 1552512 (0.0011) [2023-12-26 12:04:27,323][123091] Updated weights for policy 0, policy_version 1562901 (0.0006) [2023-12-26 12:04:27,383][123091] Updated weights for policy 0, policy_version 1562911 (0.0009) [2023-12-26 12:04:27,439][123091] Updated weights for policy 0, policy_version 1562921 (0.0011) [2023-12-26 12:04:27,775][123090] Updated weights for policy 1, policy_version 1552522 (0.0010) [2023-12-26 12:04:27,838][123090] Updated weights for policy 1, policy_version 1552532 (0.0007) [2023-12-26 12:04:27,907][123090] Updated weights for policy 1, policy_version 1552542 (0.0005) [2023-12-26 12:04:28,246][123091] Updated weights for policy 0, policy_version 1562931 (0.0010) [2023-12-26 12:04:28,300][123091] Updated weights for policy 0, policy_version 1562941 (0.0010) [2023-12-26 12:04:28,359][123091] Updated weights for policy 0, policy_version 1562951 (0.0010) [2023-12-26 12:04:28,566][123090] Updated weights for policy 1, policy_version 1552552 (0.0007) [2023-12-26 12:04:28,629][123090] Updated weights for policy 1, policy_version 1552562 (0.0007) [2023-12-26 12:04:28,701][123090] Updated weights for policy 1, policy_version 1552572 (0.0005) [2023-12-26 12:04:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 797581312. Throughput: 0: 8775.7, 1: 8957.9. Samples: 797569904. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:28,784][121949] Avg episode reward: [(0, '6184.830'), (1, '6006.417')] [2023-12-26 12:04:29,091][123091] Updated weights for policy 0, policy_version 1562961 (0.0008) [2023-12-26 12:04:29,142][123091] Updated weights for policy 0, policy_version 1562971 (0.0006) [2023-12-26 12:04:29,189][123091] Updated weights for policy 0, policy_version 1562981 (0.0005) [2023-12-26 12:04:29,248][123091] Updated weights for policy 0, policy_version 1562991 (0.0007) [2023-12-26 12:04:29,379][123090] Updated weights for policy 1, policy_version 1552582 (0.0007) [2023-12-26 12:04:29,448][123090] Updated weights for policy 1, policy_version 1552592 (0.0005) [2023-12-26 12:04:29,510][123090] Updated weights for policy 1, policy_version 1552602 (0.0006) [2023-12-26 12:04:29,998][123091] Updated weights for policy 0, policy_version 1563001 (0.0006) [2023-12-26 12:04:30,068][123091] Updated weights for policy 0, policy_version 1563011 (0.0006) [2023-12-26 12:04:30,137][123091] Updated weights for policy 0, policy_version 1563021 (0.0005) [2023-12-26 12:04:30,318][123090] Updated weights for policy 1, policy_version 1552612 (0.0009) [2023-12-26 12:04:30,380][123090] Updated weights for policy 1, policy_version 1552622 (0.0009) [2023-12-26 12:04:30,427][123090] Updated weights for policy 1, policy_version 1552632 (0.0008) [2023-12-26 12:04:30,882][123091] Updated weights for policy 0, policy_version 1563031 (0.0005) [2023-12-26 12:04:30,936][123091] Updated weights for policy 0, policy_version 1563041 (0.0008) [2023-12-26 12:04:30,983][123091] Updated weights for policy 0, policy_version 1563051 (0.0010) [2023-12-26 12:04:31,289][123090] Updated weights for policy 1, policy_version 1552642 (0.0010) [2023-12-26 12:04:31,360][123090] Updated weights for policy 1, policy_version 1552652 (0.0009) [2023-12-26 12:04:31,423][123090] Updated weights for policy 1, policy_version 1552662 (0.0010) [2023-12-26 12:04:31,483][123090] Updated weights for policy 1, policy_version 1552672 (0.0010) [2023-12-26 12:04:31,701][123091] Updated weights for policy 0, policy_version 1563061 (0.0010) [2023-12-26 12:04:31,769][123091] Updated weights for policy 0, policy_version 1563071 (0.0007) [2023-12-26 12:04:31,835][123091] Updated weights for policy 0, policy_version 1563081 (0.0005) [2023-12-26 12:04:32,392][123090] Updated weights for policy 1, policy_version 1552682 (0.0009) [2023-12-26 12:04:32,461][123090] Updated weights for policy 1, policy_version 1552692 (0.0009) [2023-12-26 12:04:32,517][123091] Updated weights for policy 0, policy_version 1563091 (0.0005) [2023-12-26 12:04:32,530][123090] Updated weights for policy 1, policy_version 1552702 (0.0009) [2023-12-26 12:04:32,582][123091] Updated weights for policy 0, policy_version 1563101 (0.0005) [2023-12-26 12:04:32,650][123091] Updated weights for policy 0, policy_version 1563111 (0.0005) [2023-12-26 12:04:33,380][123090] Updated weights for policy 1, policy_version 1552712 (0.0010) [2023-12-26 12:04:33,387][123091] Updated weights for policy 0, policy_version 1563121 (0.0006) [2023-12-26 12:04:33,430][123090] Updated weights for policy 1, policy_version 1552722 (0.0009) [2023-12-26 12:04:33,433][123091] Updated weights for policy 0, policy_version 1563131 (0.0009) [2023-12-26 12:04:33,482][123090] Updated weights for policy 1, policy_version 1552732 (0.0008) [2023-12-26 12:04:33,494][123091] Updated weights for policy 0, policy_version 1563141 (0.0009) [2023-12-26 12:04:33,554][123091] Updated weights for policy 0, policy_version 1563151 (0.0008) [2023-12-26 12:04:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 797671424. Throughput: 0: 8799.1, 1: 8938.2. Samples: 797679336. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:33,784][121949] Avg episode reward: [(0, '6078.476'), (1, '6023.420')] [2023-12-26 12:04:34,295][123091] Updated weights for policy 0, policy_version 1563161 (0.0008) [2023-12-26 12:04:34,348][123091] Updated weights for policy 0, policy_version 1563171 (0.0008) [2023-12-26 12:04:34,363][123090] Updated weights for policy 1, policy_version 1552742 (0.0008) [2023-12-26 12:04:34,409][123091] Updated weights for policy 0, policy_version 1563181 (0.0006) [2023-12-26 12:04:34,425][123090] Updated weights for policy 1, policy_version 1552752 (0.0009) [2023-12-26 12:04:34,492][123090] Updated weights for policy 1, policy_version 1552762 (0.0009) [2023-12-26 12:04:35,200][123091] Updated weights for policy 0, policy_version 1563191 (0.0008) [2023-12-26 12:04:35,251][123091] Updated weights for policy 0, policy_version 1563201 (0.0006) [2023-12-26 12:04:35,305][123091] Updated weights for policy 0, policy_version 1563211 (0.0005) [2023-12-26 12:04:35,341][123090] Updated weights for policy 1, policy_version 1552772 (0.0009) [2023-12-26 12:04:35,395][123090] Updated weights for policy 1, policy_version 1552782 (0.0009) [2023-12-26 12:04:35,448][123090] Updated weights for policy 1, policy_version 1552792 (0.0010) [2023-12-26 12:04:36,059][123091] Updated weights for policy 0, policy_version 1563221 (0.0005) [2023-12-26 12:04:36,120][123091] Updated weights for policy 0, policy_version 1563231 (0.0007) [2023-12-26 12:04:36,177][123091] Updated weights for policy 0, policy_version 1563241 (0.0009) [2023-12-26 12:04:36,266][123090] Updated weights for policy 1, policy_version 1552802 (0.0009) [2023-12-26 12:04:36,343][123090] Updated weights for policy 1, policy_version 1552812 (0.0005) [2023-12-26 12:04:36,418][123090] Updated weights for policy 1, policy_version 1552822 (0.0005) [2023-12-26 12:04:36,498][123090] Updated weights for policy 1, policy_version 1552832 (0.0005) [2023-12-26 12:04:36,975][123091] Updated weights for policy 0, policy_version 1563251 (0.0010) [2023-12-26 12:04:37,029][123091] Updated weights for policy 0, policy_version 1563261 (0.0010) [2023-12-26 12:04:37,094][123091] Updated weights for policy 0, policy_version 1563271 (0.0009) [2023-12-26 12:04:37,233][123090] Updated weights for policy 1, policy_version 1552842 (0.0010) [2023-12-26 12:04:37,295][123090] Updated weights for policy 1, policy_version 1552852 (0.0009) [2023-12-26 12:04:37,352][123090] Updated weights for policy 1, policy_version 1552862 (0.0009) [2023-12-26 12:04:37,920][123091] Updated weights for policy 0, policy_version 1563281 (0.0009) [2023-12-26 12:04:37,987][123091] Updated weights for policy 0, policy_version 1563291 (0.0010) [2023-12-26 12:04:38,050][123091] Updated weights for policy 0, policy_version 1563301 (0.0010) [2023-12-26 12:04:38,108][123091] Updated weights for policy 0, policy_version 1563311 (0.0010) [2023-12-26 12:04:38,190][123090] Updated weights for policy 1, policy_version 1552872 (0.0010) [2023-12-26 12:04:38,248][123090] Updated weights for policy 1, policy_version 1552882 (0.0009) [2023-12-26 12:04:38,311][123090] Updated weights for policy 1, policy_version 1552892 (0.0008) [2023-12-26 12:04:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 797753344. Throughput: 0: 8871.7, 1: 8948.6. Samples: 797733140. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:38,785][121949] Avg episode reward: [(0, '6145.001'), (1, '5989.253')] [2023-12-26 12:04:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001552896_397541376.pth... [2023-12-26 12:04:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001563312_400211968.pth... [2023-12-26 12:04:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001551872_397279232.pth [2023-12-26 12:04:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001562288_399949824.pth [2023-12-26 12:04:38,972][123091] Updated weights for policy 0, policy_version 1563321 (0.0006) [2023-12-26 12:04:39,046][123091] Updated weights for policy 0, policy_version 1563331 (0.0005) [2023-12-26 12:04:39,119][123091] Updated weights for policy 0, policy_version 1563341 (0.0009) [2023-12-26 12:04:39,165][123090] Updated weights for policy 1, policy_version 1552902 (0.0008) [2023-12-26 12:04:39,234][123090] Updated weights for policy 1, policy_version 1552912 (0.0009) [2023-12-26 12:04:39,300][123090] Updated weights for policy 1, policy_version 1552922 (0.0010) [2023-12-26 12:04:39,929][123091] Updated weights for policy 0, policy_version 1563351 (0.0009) [2023-12-26 12:04:39,996][123091] Updated weights for policy 0, policy_version 1563361 (0.0008) [2023-12-26 12:04:40,068][123091] Updated weights for policy 0, policy_version 1563371 (0.0010) [2023-12-26 12:04:40,129][123090] Updated weights for policy 1, policy_version 1552932 (0.0009) [2023-12-26 12:04:40,199][123090] Updated weights for policy 1, policy_version 1552942 (0.0006) [2023-12-26 12:04:40,271][123090] Updated weights for policy 1, policy_version 1552952 (0.0006) [2023-12-26 12:04:40,919][123091] Updated weights for policy 0, policy_version 1563381 (0.0009) [2023-12-26 12:04:40,931][123090] Updated weights for policy 1, policy_version 1552962 (0.0008) [2023-12-26 12:04:40,977][123091] Updated weights for policy 0, policy_version 1563391 (0.0009) [2023-12-26 12:04:40,993][123090] Updated weights for policy 1, policy_version 1552972 (0.0007) [2023-12-26 12:04:41,040][123091] Updated weights for policy 0, policy_version 1563401 (0.0010) [2023-12-26 12:04:41,057][123090] Updated weights for policy 1, policy_version 1552982 (0.0009) [2023-12-26 12:04:41,122][123090] Updated weights for policy 1, policy_version 1552992 (0.0008) [2023-12-26 12:04:41,885][123091] Updated weights for policy 0, policy_version 1563411 (0.0008) [2023-12-26 12:04:41,952][123091] Updated weights for policy 0, policy_version 1563421 (0.0008) [2023-12-26 12:04:41,968][123090] Updated weights for policy 1, policy_version 1553002 (0.0009) [2023-12-26 12:04:42,010][123091] Updated weights for policy 0, policy_version 1563431 (0.0010) [2023-12-26 12:04:42,034][123090] Updated weights for policy 1, policy_version 1553012 (0.0008) [2023-12-26 12:04:42,096][123090] Updated weights for policy 1, policy_version 1553022 (0.0009) [2023-12-26 12:04:42,778][123091] Updated weights for policy 0, policy_version 1563441 (0.0008) [2023-12-26 12:04:42,828][123091] Updated weights for policy 0, policy_version 1563451 (0.0006) [2023-12-26 12:04:42,884][123091] Updated weights for policy 0, policy_version 1563461 (0.0006) [2023-12-26 12:04:42,941][123091] Updated weights for policy 0, policy_version 1563471 (0.0006) [2023-12-26 12:04:42,957][123090] Updated weights for policy 1, policy_version 1553032 (0.0009) [2023-12-26 12:04:43,017][123090] Updated weights for policy 1, policy_version 1553042 (0.0010) [2023-12-26 12:04:43,078][123090] Updated weights for policy 1, policy_version 1553052 (0.0009) [2023-12-26 12:04:43,621][123091] Updated weights for policy 0, policy_version 1563481 (0.0009) [2023-12-26 12:04:43,686][123091] Updated weights for policy 0, policy_version 1563491 (0.0008) [2023-12-26 12:04:43,752][123091] Updated weights for policy 0, policy_version 1563501 (0.0008) [2023-12-26 12:04:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 797843456. Throughput: 0: 8827.4, 1: 8891.7. Samples: 797835676. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:43,784][121949] Avg episode reward: [(0, '6196.187'), (1, '5995.656')] [2023-12-26 12:04:43,954][123090] Updated weights for policy 1, policy_version 1553062 (0.0009) [2023-12-26 12:04:44,007][123090] Updated weights for policy 1, policy_version 1553072 (0.0009) [2023-12-26 12:04:44,063][123090] Updated weights for policy 1, policy_version 1553082 (0.0009) [2023-12-26 12:04:44,554][123091] Updated weights for policy 0, policy_version 1563511 (0.0010) [2023-12-26 12:04:44,615][123091] Updated weights for policy 0, policy_version 1563521 (0.0009) [2023-12-26 12:04:44,668][123091] Updated weights for policy 0, policy_version 1563531 (0.0009) [2023-12-26 12:04:44,919][123090] Updated weights for policy 1, policy_version 1553092 (0.0008) [2023-12-26 12:04:44,984][123090] Updated weights for policy 1, policy_version 1553102 (0.0009) [2023-12-26 12:04:45,056][123090] Updated weights for policy 1, policy_version 1553112 (0.0010) [2023-12-26 12:04:45,544][123091] Updated weights for policy 0, policy_version 1563541 (0.0009) [2023-12-26 12:04:45,595][123091] Updated weights for policy 0, policy_version 1563551 (0.0010) [2023-12-26 12:04:45,643][123091] Updated weights for policy 0, policy_version 1563561 (0.0010) [2023-12-26 12:04:45,794][123090] Updated weights for policy 1, policy_version 1553122 (0.0007) [2023-12-26 12:04:45,856][123090] Updated weights for policy 1, policy_version 1553132 (0.0009) [2023-12-26 12:04:45,920][123090] Updated weights for policy 1, policy_version 1553142 (0.0009) [2023-12-26 12:04:45,986][123090] Updated weights for policy 1, policy_version 1553152 (0.0008) [2023-12-26 12:04:46,451][123091] Updated weights for policy 0, policy_version 1563571 (0.0009) [2023-12-26 12:04:46,497][123091] Updated weights for policy 0, policy_version 1563581 (0.0005) [2023-12-26 12:04:46,557][123091] Updated weights for policy 0, policy_version 1563591 (0.0005) [2023-12-26 12:04:46,881][123090] Updated weights for policy 1, policy_version 1553162 (0.0010) [2023-12-26 12:04:46,947][123090] Updated weights for policy 1, policy_version 1553172 (0.0008) [2023-12-26 12:04:47,016][123090] Updated weights for policy 1, policy_version 1553182 (0.0006) [2023-12-26 12:04:47,225][123091] Updated weights for policy 0, policy_version 1563601 (0.0006) [2023-12-26 12:04:47,301][123091] Updated weights for policy 0, policy_version 1563611 (0.0005) [2023-12-26 12:04:47,374][123091] Updated weights for policy 0, policy_version 1563621 (0.0008) [2023-12-26 12:04:47,437][123091] Updated weights for policy 0, policy_version 1563631 (0.0011) [2023-12-26 12:04:47,688][123090] Updated weights for policy 1, policy_version 1553192 (0.0005) [2023-12-26 12:04:47,765][123090] Updated weights for policy 1, policy_version 1553202 (0.0008) [2023-12-26 12:04:47,828][123090] Updated weights for policy 1, policy_version 1553212 (0.0010) [2023-12-26 12:04:48,103][123091] Updated weights for policy 0, policy_version 1563641 (0.0011) [2023-12-26 12:04:48,172][123091] Updated weights for policy 0, policy_version 1563651 (0.0011) [2023-12-26 12:04:48,235][123091] Updated weights for policy 0, policy_version 1563661 (0.0011) [2023-12-26 12:04:48,632][123090] Updated weights for policy 1, policy_version 1553222 (0.0011) [2023-12-26 12:04:48,700][123090] Updated weights for policy 1, policy_version 1553232 (0.0011) [2023-12-26 12:04:48,766][123090] Updated weights for policy 1, policy_version 1553242 (0.0010) [2023-12-26 12:04:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 797925376. Throughput: 0: 8906.7, 1: 8804.3. Samples: 797943352. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:48,785][121949] Avg episode reward: [(0, '6115.409'), (1, '6069.861')] [2023-12-26 12:04:49,022][123091] Updated weights for policy 0, policy_version 1563671 (0.0007) [2023-12-26 12:04:49,083][123091] Updated weights for policy 0, policy_version 1563681 (0.0005) [2023-12-26 12:04:49,139][123091] Updated weights for policy 0, policy_version 1563691 (0.0006) [2023-12-26 12:04:49,599][123090] Updated weights for policy 1, policy_version 1553252 (0.0010) [2023-12-26 12:04:49,660][123090] Updated weights for policy 1, policy_version 1553262 (0.0009) [2023-12-26 12:04:49,730][123090] Updated weights for policy 1, policy_version 1553272 (0.0010) [2023-12-26 12:04:49,806][123091] Updated weights for policy 0, policy_version 1563701 (0.0010) [2023-12-26 12:04:49,878][123091] Updated weights for policy 0, policy_version 1563711 (0.0010) [2023-12-26 12:04:49,941][123091] Updated weights for policy 0, policy_version 1563721 (0.0008) [2023-12-26 12:04:50,590][123090] Updated weights for policy 1, policy_version 1553282 (0.0009) [2023-12-26 12:04:50,663][123090] Updated weights for policy 1, policy_version 1553292 (0.0008) [2023-12-26 12:04:50,740][123090] Updated weights for policy 1, policy_version 1553302 (0.0007) [2023-12-26 12:04:50,741][123091] Updated weights for policy 0, policy_version 1563731 (0.0007) [2023-12-26 12:04:50,804][123090] Updated weights for policy 1, policy_version 1553312 (0.0008) [2023-12-26 12:04:50,811][123091] Updated weights for policy 0, policy_version 1563741 (0.0007) [2023-12-26 12:04:50,878][123091] Updated weights for policy 0, policy_version 1563751 (0.0007) [2023-12-26 12:04:51,587][123090] Updated weights for policy 1, policy_version 1553322 (0.0011) [2023-12-26 12:04:51,617][123091] Updated weights for policy 0, policy_version 1563761 (0.0006) [2023-12-26 12:04:51,661][123090] Updated weights for policy 1, policy_version 1553332 (0.0010) [2023-12-26 12:04:51,690][123091] Updated weights for policy 0, policy_version 1563771 (0.0008) [2023-12-26 12:04:51,738][123090] Updated weights for policy 1, policy_version 1553342 (0.0011) [2023-12-26 12:04:51,755][123091] Updated weights for policy 0, policy_version 1563781 (0.0008) [2023-12-26 12:04:51,810][123091] Updated weights for policy 0, policy_version 1563791 (0.0008) [2023-12-26 12:04:52,561][123090] Updated weights for policy 1, policy_version 1553352 (0.0011) [2023-12-26 12:04:52,624][123090] Updated weights for policy 1, policy_version 1553362 (0.0011) [2023-12-26 12:04:52,628][123091] Updated weights for policy 0, policy_version 1563801 (0.0007) [2023-12-26 12:04:52,683][123091] Updated weights for policy 0, policy_version 1563811 (0.0009) [2023-12-26 12:04:52,687][123090] Updated weights for policy 1, policy_version 1553372 (0.0011) [2023-12-26 12:04:52,752][123091] Updated weights for policy 0, policy_version 1563821 (0.0006) [2023-12-26 12:04:53,488][123091] Updated weights for policy 0, policy_version 1563831 (0.0009) [2023-12-26 12:04:53,501][123090] Updated weights for policy 1, policy_version 1553382 (0.0011) [2023-12-26 12:04:53,547][123091] Updated weights for policy 0, policy_version 1563841 (0.0011) [2023-12-26 12:04:53,553][123090] Updated weights for policy 1, policy_version 1553392 (0.0010) [2023-12-26 12:04:53,610][123091] Updated weights for policy 0, policy_version 1563851 (0.0010) [2023-12-26 12:04:53,622][123090] Updated weights for policy 1, policy_version 1553402 (0.0011) [2023-12-26 12:04:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17717.0). Total num frames: 798023680. Throughput: 0: 8943.4, 1: 8781.9. Samples: 797995708. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:53,785][121949] Avg episode reward: [(0, '6147.636'), (1, '5984.830')] [2023-12-26 12:04:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001563856_400351232.pth... [2023-12-26 12:04:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001553408_397672448.pth... [2023-12-26 12:04:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001562768_400072704.pth [2023-12-26 12:04:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001552384_397410304.pth [2023-12-26 12:04:54,284][123091] Updated weights for policy 0, policy_version 1563861 (0.0008) [2023-12-26 12:04:54,347][123091] Updated weights for policy 0, policy_version 1563871 (0.0005) [2023-12-26 12:04:54,412][123091] Updated weights for policy 0, policy_version 1563881 (0.0005) [2023-12-26 12:04:54,441][123090] Updated weights for policy 1, policy_version 1553412 (0.0010) [2023-12-26 12:04:54,501][123090] Updated weights for policy 1, policy_version 1553422 (0.0011) [2023-12-26 12:04:54,573][123090] Updated weights for policy 1, policy_version 1553432 (0.0011) [2023-12-26 12:04:55,066][123091] Updated weights for policy 0, policy_version 1563891 (0.0008) [2023-12-26 12:04:55,133][123091] Updated weights for policy 0, policy_version 1563901 (0.0009) [2023-12-26 12:04:55,199][123091] Updated weights for policy 0, policy_version 1563911 (0.0008) [2023-12-26 12:04:55,361][123090] Updated weights for policy 1, policy_version 1553442 (0.0009) [2023-12-26 12:04:55,415][123090] Updated weights for policy 1, policy_version 1553452 (0.0005) [2023-12-26 12:04:55,475][123090] Updated weights for policy 1, policy_version 1553462 (0.0005) [2023-12-26 12:04:55,544][123090] Updated weights for policy 1, policy_version 1553472 (0.0006) [2023-12-26 12:04:55,876][123091] Updated weights for policy 0, policy_version 1563921 (0.0008) [2023-12-26 12:04:55,943][123091] Updated weights for policy 0, policy_version 1563931 (0.0009) [2023-12-26 12:04:56,009][123091] Updated weights for policy 0, policy_version 1563941 (0.0008) [2023-12-26 12:04:56,080][123091] Updated weights for policy 0, policy_version 1563951 (0.0009) [2023-12-26 12:04:56,166][123090] Updated weights for policy 1, policy_version 1553482 (0.0005) [2023-12-26 12:04:56,228][123090] Updated weights for policy 1, policy_version 1553492 (0.0006) [2023-12-26 12:04:56,280][123090] Updated weights for policy 1, policy_version 1553502 (0.0009) [2023-12-26 12:04:56,718][123091] Updated weights for policy 0, policy_version 1563961 (0.0007) [2023-12-26 12:04:56,788][123091] Updated weights for policy 0, policy_version 1563971 (0.0006) [2023-12-26 12:04:56,858][123091] Updated weights for policy 0, policy_version 1563981 (0.0006) [2023-12-26 12:04:57,077][123090] Updated weights for policy 1, policy_version 1553512 (0.0011) [2023-12-26 12:04:57,142][123090] Updated weights for policy 1, policy_version 1553522 (0.0010) [2023-12-26 12:04:57,210][123090] Updated weights for policy 1, policy_version 1553532 (0.0009) [2023-12-26 12:04:57,603][123091] Updated weights for policy 0, policy_version 1563991 (0.0009) [2023-12-26 12:04:57,658][123091] Updated weights for policy 0, policy_version 1564001 (0.0010) [2023-12-26 12:04:57,721][123091] Updated weights for policy 0, policy_version 1564011 (0.0011) [2023-12-26 12:04:58,006][123090] Updated weights for policy 1, policy_version 1553542 (0.0008) [2023-12-26 12:04:58,067][123090] Updated weights for policy 1, policy_version 1553552 (0.0008) [2023-12-26 12:04:58,134][123090] Updated weights for policy 1, policy_version 1553562 (0.0008) [2023-12-26 12:04:58,584][123091] Updated weights for policy 0, policy_version 1564021 (0.0010) [2023-12-26 12:04:58,642][123091] Updated weights for policy 0, policy_version 1564031 (0.0009) [2023-12-26 12:04:58,720][123091] Updated weights for policy 0, policy_version 1564041 (0.0009) [2023-12-26 12:04:58,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 798113792. Throughput: 0: 9071.9, 1: 8809.8. Samples: 798106964. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:04:58,785][121949] Avg episode reward: [(0, '6151.828'), (1, '5808.712')] [2023-12-26 12:04:59,012][123090] Updated weights for policy 1, policy_version 1553572 (0.0009) [2023-12-26 12:04:59,069][123090] Updated weights for policy 1, policy_version 1553582 (0.0009) [2023-12-26 12:04:59,131][123090] Updated weights for policy 1, policy_version 1553593 (0.0009) [2023-12-26 12:04:59,621][123091] Updated weights for policy 0, policy_version 1564051 (0.0010) [2023-12-26 12:04:59,680][123091] Updated weights for policy 0, policy_version 1564061 (0.0010) [2023-12-26 12:04:59,749][123091] Updated weights for policy 0, policy_version 1564071 (0.0009) [2023-12-26 12:04:59,978][123090] Updated weights for policy 1, policy_version 1553603 (0.0008) [2023-12-26 12:05:00,043][123090] Updated weights for policy 1, policy_version 1553613 (0.0009) [2023-12-26 12:05:00,100][123090] Updated weights for policy 1, policy_version 1553623 (0.0009) [2023-12-26 12:05:00,574][123091] Updated weights for policy 0, policy_version 1564081 (0.0009) [2023-12-26 12:05:00,626][123091] Updated weights for policy 0, policy_version 1564091 (0.0010) [2023-12-26 12:05:00,669][123091] Updated weights for policy 0, policy_version 1564101 (0.0008) [2023-12-26 12:05:00,717][123091] Updated weights for policy 0, policy_version 1564111 (0.0005) [2023-12-26 12:05:00,955][123090] Updated weights for policy 1, policy_version 1553633 (0.0008) [2023-12-26 12:05:01,014][123090] Updated weights for policy 1, policy_version 1553643 (0.0010) [2023-12-26 12:05:01,078][123090] Updated weights for policy 1, policy_version 1553653 (0.0009) [2023-12-26 12:05:01,145][123090] Updated weights for policy 1, policy_version 1553663 (0.0009) [2023-12-26 12:05:01,523][123091] Updated weights for policy 0, policy_version 1564121 (0.0009) [2023-12-26 12:05:01,578][123091] Updated weights for policy 0, policy_version 1564131 (0.0010) [2023-12-26 12:05:01,637][123091] Updated weights for policy 0, policy_version 1564141 (0.0010) [2023-12-26 12:05:01,990][123090] Updated weights for policy 1, policy_version 1553673 (0.0009) [2023-12-26 12:05:02,048][123090] Updated weights for policy 1, policy_version 1553683 (0.0009) [2023-12-26 12:05:02,098][123090] Updated weights for policy 1, policy_version 1553693 (0.0010) [2023-12-26 12:05:02,471][123091] Updated weights for policy 0, policy_version 1564151 (0.0009) [2023-12-26 12:05:02,534][123091] Updated weights for policy 0, policy_version 1564161 (0.0009) [2023-12-26 12:05:02,587][123091] Updated weights for policy 0, policy_version 1564171 (0.0009) [2023-12-26 12:05:02,936][123090] Updated weights for policy 1, policy_version 1553703 (0.0009) [2023-12-26 12:05:03,001][123090] Updated weights for policy 1, policy_version 1553713 (0.0008) [2023-12-26 12:05:03,048][123090] Updated weights for policy 1, policy_version 1553723 (0.0009) [2023-12-26 12:05:03,341][123091] Updated weights for policy 0, policy_version 1564181 (0.0010) [2023-12-26 12:05:03,399][123091] Updated weights for policy 0, policy_version 1564191 (0.0009) [2023-12-26 12:05:03,451][123091] Updated weights for policy 0, policy_version 1564202 (0.0010) [2023-12-26 12:05:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.2, 300 sec: 17689.2). Total num frames: 798195712. Throughput: 0: 9088.7, 1: 8695.5. Samples: 798209064. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:03,786][121949] Avg episode reward: [(0, '6219.673'), (1, '5786.176')] [2023-12-26 12:05:03,868][123090] Updated weights for policy 1, policy_version 1553733 (0.0009) [2023-12-26 12:05:03,944][123090] Updated weights for policy 1, policy_version 1553743 (0.0006) [2023-12-26 12:05:04,018][123090] Updated weights for policy 1, policy_version 1553753 (0.0006) [2023-12-26 12:05:04,245][123091] Updated weights for policy 0, policy_version 1564212 (0.0009) [2023-12-26 12:05:04,297][123091] Updated weights for policy 0, policy_version 1564222 (0.0010) [2023-12-26 12:05:04,346][123091] Updated weights for policy 0, policy_version 1564232 (0.0010) [2023-12-26 12:05:04,720][123090] Updated weights for policy 1, policy_version 1553763 (0.0005) [2023-12-26 12:05:04,794][123090] Updated weights for policy 1, policy_version 1553773 (0.0006) [2023-12-26 12:05:04,854][123090] Updated weights for policy 1, policy_version 1553783 (0.0008) [2023-12-26 12:05:05,184][123091] Updated weights for policy 0, policy_version 1564242 (0.0007) [2023-12-26 12:05:05,241][123091] Updated weights for policy 0, policy_version 1564252 (0.0010) [2023-12-26 12:05:05,295][123091] Updated weights for policy 0, policy_version 1564262 (0.0011) [2023-12-26 12:05:05,362][123091] Updated weights for policy 0, policy_version 1564272 (0.0011) [2023-12-26 12:05:05,597][123090] Updated weights for policy 1, policy_version 1553793 (0.0007) [2023-12-26 12:05:05,657][123090] Updated weights for policy 1, policy_version 1553803 (0.0008) [2023-12-26 12:05:05,718][123090] Updated weights for policy 1, policy_version 1553813 (0.0009) [2023-12-26 12:05:05,778][123090] Updated weights for policy 1, policy_version 1553823 (0.0008) [2023-12-26 12:05:06,165][123091] Updated weights for policy 0, policy_version 1564282 (0.0007) [2023-12-26 12:05:06,243][123091] Updated weights for policy 0, policy_version 1564292 (0.0006) [2023-12-26 12:05:06,321][123091] Updated weights for policy 0, policy_version 1564302 (0.0007) [2023-12-26 12:05:06,608][123090] Updated weights for policy 1, policy_version 1553833 (0.0011) [2023-12-26 12:05:06,683][123090] Updated weights for policy 1, policy_version 1553843 (0.0011) [2023-12-26 12:05:06,751][123090] Updated weights for policy 1, policy_version 1553853 (0.0011) [2023-12-26 12:05:06,939][123091] Updated weights for policy 0, policy_version 1564312 (0.0008) [2023-12-26 12:05:07,000][123091] Updated weights for policy 0, policy_version 1564322 (0.0006) [2023-12-26 12:05:07,066][123091] Updated weights for policy 0, policy_version 1564332 (0.0007) [2023-12-26 12:05:07,508][123090] Updated weights for policy 1, policy_version 1553863 (0.0007) [2023-12-26 12:05:07,558][123090] Updated weights for policy 1, policy_version 1553873 (0.0005) [2023-12-26 12:05:07,606][123090] Updated weights for policy 1, policy_version 1553883 (0.0005) [2023-12-26 12:05:07,766][123091] Updated weights for policy 0, policy_version 1564342 (0.0007) [2023-12-26 12:05:07,831][123091] Updated weights for policy 0, policy_version 1564352 (0.0008) [2023-12-26 12:05:07,903][123091] Updated weights for policy 0, policy_version 1564362 (0.0006) [2023-12-26 12:05:08,377][123090] Updated weights for policy 1, policy_version 1553893 (0.0010) [2023-12-26 12:05:08,450][123090] Updated weights for policy 1, policy_version 1553903 (0.0007) [2023-12-26 12:05:08,517][123090] Updated weights for policy 1, policy_version 1553913 (0.0011) [2023-12-26 12:05:08,716][123091] Updated weights for policy 0, policy_version 1564372 (0.0010) [2023-12-26 12:05:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 798285824. Throughput: 0: 9157.0, 1: 8726.6. Samples: 798263788. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:08,785][121949] Avg episode reward: [(0, '6220.951'), (1, '5758.637')] [2023-12-26 12:05:08,788][123091] Updated weights for policy 0, policy_version 1564382 (0.0009) [2023-12-26 12:05:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001553920_397803520.pth... [2023-12-26 12:05:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001552896_397541376.pth [2023-12-26 12:05:08,855][123091] Updated weights for policy 0, policy_version 1564392 (0.0010) [2023-12-26 12:05:08,909][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001564400_400490496.pth... [2023-12-26 12:05:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001563312_400211968.pth [2023-12-26 12:05:09,235][123090] Updated weights for policy 1, policy_version 1553923 (0.0008) [2023-12-26 12:05:09,284][123090] Updated weights for policy 1, policy_version 1553933 (0.0010) [2023-12-26 12:05:09,358][123090] Updated weights for policy 1, policy_version 1553943 (0.0009) [2023-12-26 12:05:09,668][123091] Updated weights for policy 0, policy_version 1564402 (0.0008) [2023-12-26 12:05:09,731][123091] Updated weights for policy 0, policy_version 1564412 (0.0005) [2023-12-26 12:05:09,803][123091] Updated weights for policy 0, policy_version 1564422 (0.0006) [2023-12-26 12:05:09,872][123091] Updated weights for policy 0, policy_version 1564432 (0.0009) [2023-12-26 12:05:10,258][123090] Updated weights for policy 1, policy_version 1553953 (0.0009) [2023-12-26 12:05:10,330][123090] Updated weights for policy 1, policy_version 1553963 (0.0010) [2023-12-26 12:05:10,401][123090] Updated weights for policy 1, policy_version 1553973 (0.0009) [2023-12-26 12:05:10,467][123090] Updated weights for policy 1, policy_version 1553983 (0.0009) [2023-12-26 12:05:10,637][123091] Updated weights for policy 0, policy_version 1564442 (0.0010) [2023-12-26 12:05:10,694][123091] Updated weights for policy 0, policy_version 1564452 (0.0009) [2023-12-26 12:05:10,747][123091] Updated weights for policy 0, policy_version 1564462 (0.0010) [2023-12-26 12:05:11,283][123090] Updated weights for policy 1, policy_version 1553993 (0.0009) [2023-12-26 12:05:11,336][123090] Updated weights for policy 1, policy_version 1554003 (0.0008) [2023-12-26 12:05:11,405][123090] Updated weights for policy 1, policy_version 1554013 (0.0010) [2023-12-26 12:05:11,619][123091] Updated weights for policy 0, policy_version 1564472 (0.0008) [2023-12-26 12:05:11,683][123091] Updated weights for policy 0, policy_version 1564482 (0.0011) [2023-12-26 12:05:11,749][123091] Updated weights for policy 0, policy_version 1564492 (0.0009) [2023-12-26 12:05:12,333][123090] Updated weights for policy 1, policy_version 1554023 (0.0009) [2023-12-26 12:05:12,402][123090] Updated weights for policy 1, policy_version 1554033 (0.0008) [2023-12-26 12:05:12,415][123091] Updated weights for policy 0, policy_version 1564502 (0.0008) [2023-12-26 12:05:12,462][123090] Updated weights for policy 1, policy_version 1554043 (0.0008) [2023-12-26 12:05:12,478][123091] Updated weights for policy 0, policy_version 1564512 (0.0005) [2023-12-26 12:05:12,543][123091] Updated weights for policy 0, policy_version 1564522 (0.0005) [2023-12-26 12:05:13,252][123091] Updated weights for policy 0, policy_version 1564532 (0.0009) [2023-12-26 12:05:13,271][123090] Updated weights for policy 1, policy_version 1554053 (0.0007) [2023-12-26 12:05:13,309][123091] Updated weights for policy 0, policy_version 1564542 (0.0009) [2023-12-26 12:05:13,330][123090] Updated weights for policy 1, policy_version 1554063 (0.0008) [2023-12-26 12:05:13,357][123091] Updated weights for policy 0, policy_version 1564553 (0.0007) [2023-12-26 12:05:13,381][123090] Updated weights for policy 1, policy_version 1554073 (0.0005) [2023-12-26 12:05:13,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 798375936. Throughput: 0: 9097.7, 1: 8647.0. Samples: 798368416. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:13,784][121949] Avg episode reward: [(0, '6083.201'), (1, '5613.217')] [2023-12-26 12:05:14,031][123090] Updated weights for policy 1, policy_version 1554083 (0.0006) [2023-12-26 12:05:14,053][123091] Updated weights for policy 0, policy_version 1564563 (0.0005) [2023-12-26 12:05:14,085][123090] Updated weights for policy 1, policy_version 1554093 (0.0009) [2023-12-26 12:05:14,111][123091] Updated weights for policy 0, policy_version 1564573 (0.0006) [2023-12-26 12:05:14,155][123090] Updated weights for policy 1, policy_version 1554103 (0.0006) [2023-12-26 12:05:14,169][123091] Updated weights for policy 0, policy_version 1564583 (0.0008) [2023-12-26 12:05:14,872][123091] Updated weights for policy 0, policy_version 1564593 (0.0008) [2023-12-26 12:05:14,944][123091] Updated weights for policy 0, policy_version 1564603 (0.0006) [2023-12-26 12:05:15,007][123091] Updated weights for policy 0, policy_version 1564613 (0.0010) [2023-12-26 12:05:15,047][123090] Updated weights for policy 1, policy_version 1554113 (0.0008) [2023-12-26 12:05:15,072][123091] Updated weights for policy 0, policy_version 1564623 (0.0009) [2023-12-26 12:05:15,110][123090] Updated weights for policy 1, policy_version 1554123 (0.0010) [2023-12-26 12:05:15,167][123090] Updated weights for policy 1, policy_version 1554133 (0.0009) [2023-12-26 12:05:15,230][123090] Updated weights for policy 1, policy_version 1554143 (0.0010) [2023-12-26 12:05:15,815][123091] Updated weights for policy 0, policy_version 1564633 (0.0006) [2023-12-26 12:05:15,876][123091] Updated weights for policy 0, policy_version 1564643 (0.0005) [2023-12-26 12:05:15,948][123091] Updated weights for policy 0, policy_version 1564653 (0.0005) [2023-12-26 12:05:16,086][123090] Updated weights for policy 1, policy_version 1554153 (0.0010) [2023-12-26 12:05:16,147][123090] Updated weights for policy 1, policy_version 1554163 (0.0009) [2023-12-26 12:05:16,211][123090] Updated weights for policy 1, policy_version 1554173 (0.0007) [2023-12-26 12:05:16,603][123091] Updated weights for policy 0, policy_version 1564663 (0.0005) [2023-12-26 12:05:16,670][123091] Updated weights for policy 0, policy_version 1564673 (0.0005) [2023-12-26 12:05:16,722][123091] Updated weights for policy 0, policy_version 1564683 (0.0005) [2023-12-26 12:05:17,090][123090] Updated weights for policy 1, policy_version 1554183 (0.0010) [2023-12-26 12:05:17,150][123090] Updated weights for policy 1, policy_version 1554194 (0.0009) [2023-12-26 12:05:17,219][123090] Updated weights for policy 1, policy_version 1554204 (0.0010) [2023-12-26 12:05:17,434][123091] Updated weights for policy 0, policy_version 1564693 (0.0005) [2023-12-26 12:05:17,493][123091] Updated weights for policy 0, policy_version 1564703 (0.0006) [2023-12-26 12:05:17,552][123091] Updated weights for policy 0, policy_version 1564713 (0.0006) [2023-12-26 12:05:18,128][123090] Updated weights for policy 1, policy_version 1554214 (0.0010) [2023-12-26 12:05:18,167][123091] Updated weights for policy 0, policy_version 1564723 (0.0005) [2023-12-26 12:05:18,180][123090] Updated weights for policy 1, policy_version 1554224 (0.0009) [2023-12-26 12:05:18,229][123091] Updated weights for policy 0, policy_version 1564733 (0.0009) [2023-12-26 12:05:18,240][123090] Updated weights for policy 1, policy_version 1554234 (0.0007) [2023-12-26 12:05:18,285][123091] Updated weights for policy 0, policy_version 1564743 (0.0009) [2023-12-26 12:05:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 798466048. Throughput: 0: 9143.2, 1: 8607.5. Samples: 798478116. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:18,784][121949] Avg episode reward: [(0, '6036.955'), (1, '5735.723')] [2023-12-26 12:05:19,083][123090] Updated weights for policy 1, policy_version 1554244 (0.0008) [2023-12-26 12:05:19,111][123091] Updated weights for policy 0, policy_version 1564753 (0.0009) [2023-12-26 12:05:19,140][123090] Updated weights for policy 1, policy_version 1554254 (0.0008) [2023-12-26 12:05:19,174][123091] Updated weights for policy 0, policy_version 1564763 (0.0008) [2023-12-26 12:05:19,202][123090] Updated weights for policy 1, policy_version 1554264 (0.0009) [2023-12-26 12:05:19,243][123091] Updated weights for policy 0, policy_version 1564773 (0.0009) [2023-12-26 12:05:19,314][123091] Updated weights for policy 0, policy_version 1564783 (0.0009) [2023-12-26 12:05:20,075][123090] Updated weights for policy 1, policy_version 1554274 (0.0010) [2023-12-26 12:05:20,131][123091] Updated weights for policy 0, policy_version 1564793 (0.0008) [2023-12-26 12:05:20,152][123090] Updated weights for policy 1, policy_version 1554284 (0.0008) [2023-12-26 12:05:20,193][123091] Updated weights for policy 0, policy_version 1564803 (0.0010) [2023-12-26 12:05:20,226][123090] Updated weights for policy 1, policy_version 1554294 (0.0008) [2023-12-26 12:05:20,259][123091] Updated weights for policy 0, policy_version 1564813 (0.0009) [2023-12-26 12:05:20,291][123090] Updated weights for policy 1, policy_version 1554304 (0.0008) [2023-12-26 12:05:21,115][123091] Updated weights for policy 0, policy_version 1564823 (0.0008) [2023-12-26 12:05:21,124][123090] Updated weights for policy 1, policy_version 1554314 (0.0008) [2023-12-26 12:05:21,186][123090] Updated weights for policy 1, policy_version 1554324 (0.0008) [2023-12-26 12:05:21,187][123091] Updated weights for policy 0, policy_version 1564833 (0.0009) [2023-12-26 12:05:21,244][123090] Updated weights for policy 1, policy_version 1554334 (0.0008) [2023-12-26 12:05:21,258][123091] Updated weights for policy 0, policy_version 1564843 (0.0009) [2023-12-26 12:05:22,113][123090] Updated weights for policy 1, policy_version 1554344 (0.0009) [2023-12-26 12:05:22,135][123091] Updated weights for policy 0, policy_version 1564853 (0.0010) [2023-12-26 12:05:22,176][123090] Updated weights for policy 1, policy_version 1554354 (0.0008) [2023-12-26 12:05:22,208][123091] Updated weights for policy 0, policy_version 1564863 (0.0006) [2023-12-26 12:05:22,232][123090] Updated weights for policy 1, policy_version 1554364 (0.0009) [2023-12-26 12:05:22,279][123091] Updated weights for policy 0, policy_version 1564873 (0.0008) [2023-12-26 12:05:22,992][123091] Updated weights for policy 0, policy_version 1564883 (0.0010) [2023-12-26 12:05:23,063][123091] Updated weights for policy 0, policy_version 1564893 (0.0009) [2023-12-26 12:05:23,128][123091] Updated weights for policy 0, policy_version 1564903 (0.0008) [2023-12-26 12:05:23,154][123090] Updated weights for policy 1, policy_version 1554374 (0.0009) [2023-12-26 12:05:23,222][123090] Updated weights for policy 1, policy_version 1554384 (0.0009) [2023-12-26 12:05:23,289][123090] Updated weights for policy 1, policy_version 1554394 (0.0009) [2023-12-26 12:05:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 798547968. Throughput: 0: 9076.2, 1: 8583.3. Samples: 798527816. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:23,785][121949] Avg episode reward: [(0, '6074.056'), (1, '6044.404')] [2023-12-26 12:05:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001564912_400621568.pth... [2023-12-26 12:05:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001554400_397926400.pth... [2023-12-26 12:05:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001563856_400351232.pth [2023-12-26 12:05:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001553408_397672448.pth [2023-12-26 12:05:23,909][123091] Updated weights for policy 0, policy_version 1564913 (0.0007) [2023-12-26 12:05:23,968][123091] Updated weights for policy 0, policy_version 1564923 (0.0010) [2023-12-26 12:05:24,024][123091] Updated weights for policy 0, policy_version 1564933 (0.0011) [2023-12-26 12:05:24,068][123091] Updated weights for policy 0, policy_version 1564943 (0.0010) [2023-12-26 12:05:24,116][123090] Updated weights for policy 1, policy_version 1554404 (0.0008) [2023-12-26 12:05:24,165][123090] Updated weights for policy 1, policy_version 1554414 (0.0009) [2023-12-26 12:05:24,220][123090] Updated weights for policy 1, policy_version 1554424 (0.0009) [2023-12-26 12:05:24,919][123091] Updated weights for policy 0, policy_version 1564953 (0.0010) [2023-12-26 12:05:24,977][123091] Updated weights for policy 0, policy_version 1564963 (0.0010) [2023-12-26 12:05:25,033][123091] Updated weights for policy 0, policy_version 1564973 (0.0010) [2023-12-26 12:05:25,075][123090] Updated weights for policy 1, policy_version 1554434 (0.0008) [2023-12-26 12:05:25,146][123090] Updated weights for policy 1, policy_version 1554444 (0.0009) [2023-12-26 12:05:25,206][123090] Updated weights for policy 1, policy_version 1554454 (0.0009) [2023-12-26 12:05:25,269][123090] Updated weights for policy 1, policy_version 1554464 (0.0009) [2023-12-26 12:05:25,855][123091] Updated weights for policy 0, policy_version 1564983 (0.0010) [2023-12-26 12:05:25,914][123091] Updated weights for policy 0, policy_version 1564993 (0.0010) [2023-12-26 12:05:25,977][123091] Updated weights for policy 0, policy_version 1565003 (0.0010) [2023-12-26 12:05:26,024][123090] Updated weights for policy 1, policy_version 1554474 (0.0009) [2023-12-26 12:05:26,076][123090] Updated weights for policy 1, policy_version 1554484 (0.0009) [2023-12-26 12:05:26,132][123090] Updated weights for policy 1, policy_version 1554494 (0.0009) [2023-12-26 12:05:26,804][123091] Updated weights for policy 0, policy_version 1565013 (0.0011) [2023-12-26 12:05:26,870][123091] Updated weights for policy 0, policy_version 1565023 (0.0011) [2023-12-26 12:05:26,928][123091] Updated weights for policy 0, policy_version 1565033 (0.0010) [2023-12-26 12:05:26,979][123090] Updated weights for policy 1, policy_version 1554504 (0.0008) [2023-12-26 12:05:27,031][123090] Updated weights for policy 1, policy_version 1554514 (0.0009) [2023-12-26 12:05:27,079][123090] Updated weights for policy 1, policy_version 1554524 (0.0009) [2023-12-26 12:05:27,708][123091] Updated weights for policy 0, policy_version 1565043 (0.0010) [2023-12-26 12:05:27,771][123091] Updated weights for policy 0, policy_version 1565053 (0.0011) [2023-12-26 12:05:27,840][123091] Updated weights for policy 0, policy_version 1565063 (0.0007) [2023-12-26 12:05:27,960][123090] Updated weights for policy 1, policy_version 1554534 (0.0009) [2023-12-26 12:05:28,018][123090] Updated weights for policy 1, policy_version 1554544 (0.0009) [2023-12-26 12:05:28,075][123090] Updated weights for policy 1, policy_version 1554554 (0.0009) [2023-12-26 12:05:28,467][123091] Updated weights for policy 0, policy_version 1565073 (0.0005) [2023-12-26 12:05:28,531][123091] Updated weights for policy 0, policy_version 1565083 (0.0005) [2023-12-26 12:05:28,590][123091] Updated weights for policy 0, policy_version 1565093 (0.0008) [2023-12-26 12:05:28,641][123091] Updated weights for policy 0, policy_version 1565103 (0.0010) [2023-12-26 12:05:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 798638080. Throughput: 0: 9114.7, 1: 8546.0. Samples: 798630412. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:28,785][121949] Avg episode reward: [(0, '6118.816'), (1, '6146.345')] [2023-12-26 12:05:28,787][123008] Saving new best policy, reward=6146.345! [2023-12-26 12:05:28,963][123090] Updated weights for policy 1, policy_version 1554564 (0.0009) [2023-12-26 12:05:29,036][123090] Updated weights for policy 1, policy_version 1554574 (0.0009) [2023-12-26 12:05:29,100][123090] Updated weights for policy 1, policy_version 1554584 (0.0009) [2023-12-26 12:05:29,443][123091] Updated weights for policy 0, policy_version 1565113 (0.0010) [2023-12-26 12:05:29,509][123091] Updated weights for policy 0, policy_version 1565123 (0.0010) [2023-12-26 12:05:29,571][123091] Updated weights for policy 0, policy_version 1565133 (0.0010) [2023-12-26 12:05:29,925][123090] Updated weights for policy 1, policy_version 1554594 (0.0009) [2023-12-26 12:05:29,995][123090] Updated weights for policy 1, policy_version 1554604 (0.0009) [2023-12-26 12:05:30,047][123090] Updated weights for policy 1, policy_version 1554614 (0.0009) [2023-12-26 12:05:30,104][123090] Updated weights for policy 1, policy_version 1554624 (0.0008) [2023-12-26 12:05:30,380][123091] Updated weights for policy 0, policy_version 1565143 (0.0009) [2023-12-26 12:05:30,442][123091] Updated weights for policy 0, policy_version 1565153 (0.0010) [2023-12-26 12:05:30,501][123091] Updated weights for policy 0, policy_version 1565163 (0.0010) [2023-12-26 12:05:30,889][123090] Updated weights for policy 1, policy_version 1554634 (0.0005) [2023-12-26 12:05:30,944][123090] Updated weights for policy 1, policy_version 1554644 (0.0005) [2023-12-26 12:05:30,997][123090] Updated weights for policy 1, policy_version 1554654 (0.0005) [2023-12-26 12:05:31,331][123091] Updated weights for policy 0, policy_version 1565173 (0.0010) [2023-12-26 12:05:31,397][123091] Updated weights for policy 0, policy_version 1565183 (0.0012) [2023-12-26 12:05:31,460][123091] Updated weights for policy 0, policy_version 1565193 (0.0011) [2023-12-26 12:05:31,736][123090] Updated weights for policy 1, policy_version 1554664 (0.0008) [2023-12-26 12:05:31,793][123090] Updated weights for policy 1, policy_version 1554674 (0.0008) [2023-12-26 12:05:31,840][123090] Updated weights for policy 1, policy_version 1554684 (0.0008) [2023-12-26 12:05:32,295][123091] Updated weights for policy 0, policy_version 1565203 (0.0011) [2023-12-26 12:05:32,355][123091] Updated weights for policy 0, policy_version 1565213 (0.0011) [2023-12-26 12:05:32,418][123091] Updated weights for policy 0, policy_version 1565223 (0.0011) [2023-12-26 12:05:32,674][123090] Updated weights for policy 1, policy_version 1554694 (0.0010) [2023-12-26 12:05:32,737][123090] Updated weights for policy 1, policy_version 1554704 (0.0011) [2023-12-26 12:05:32,804][123090] Updated weights for policy 1, policy_version 1554714 (0.0008) [2023-12-26 12:05:33,108][123091] Updated weights for policy 0, policy_version 1565233 (0.0010) [2023-12-26 12:05:33,171][123091] Updated weights for policy 0, policy_version 1565243 (0.0010) [2023-12-26 12:05:33,237][123091] Updated weights for policy 0, policy_version 1565253 (0.0010) [2023-12-26 12:05:33,299][123091] Updated weights for policy 0, policy_version 1565263 (0.0010) [2023-12-26 12:05:33,485][123090] Updated weights for policy 1, policy_version 1554724 (0.0005) [2023-12-26 12:05:33,545][123090] Updated weights for policy 1, policy_version 1554734 (0.0005) [2023-12-26 12:05:33,608][123090] Updated weights for policy 1, policy_version 1554744 (0.0007) [2023-12-26 12:05:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 798728192. Throughput: 0: 9074.1, 1: 8576.2. Samples: 798737616. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:33,785][121949] Avg episode reward: [(0, '6229.771'), (1, '6020.698')] [2023-12-26 12:05:34,125][123091] Updated weights for policy 0, policy_version 1565273 (0.0010) [2023-12-26 12:05:34,186][123090] Updated weights for policy 1, policy_version 1554754 (0.0007) [2023-12-26 12:05:34,190][123091] Updated weights for policy 0, policy_version 1565283 (0.0009) [2023-12-26 12:05:34,250][123090] Updated weights for policy 1, policy_version 1554764 (0.0011) [2023-12-26 12:05:34,256][123091] Updated weights for policy 0, policy_version 1565293 (0.0009) [2023-12-26 12:05:34,314][123090] Updated weights for policy 1, policy_version 1554774 (0.0010) [2023-12-26 12:05:34,376][123090] Updated weights for policy 1, policy_version 1554784 (0.0010) [2023-12-26 12:05:34,928][123091] Updated weights for policy 0, policy_version 1565303 (0.0008) [2023-12-26 12:05:34,986][123091] Updated weights for policy 0, policy_version 1565313 (0.0010) [2023-12-26 12:05:35,042][123091] Updated weights for policy 0, policy_version 1565323 (0.0010) [2023-12-26 12:05:35,203][123090] Updated weights for policy 1, policy_version 1554794 (0.0009) [2023-12-26 12:05:35,259][123090] Updated weights for policy 1, policy_version 1554804 (0.0008) [2023-12-26 12:05:35,307][123090] Updated weights for policy 1, policy_version 1554814 (0.0009) [2023-12-26 12:05:35,869][123091] Updated weights for policy 0, policy_version 1565333 (0.0011) [2023-12-26 12:05:35,917][123091] Updated weights for policy 0, policy_version 1565343 (0.0010) [2023-12-26 12:05:35,965][123091] Updated weights for policy 0, policy_version 1565353 (0.0010) [2023-12-26 12:05:36,161][123090] Updated weights for policy 1, policy_version 1554824 (0.0009) [2023-12-26 12:05:36,219][123090] Updated weights for policy 1, policy_version 1554834 (0.0009) [2023-12-26 12:05:36,279][123090] Updated weights for policy 1, policy_version 1554844 (0.0009) [2023-12-26 12:05:36,824][123091] Updated weights for policy 0, policy_version 1565363 (0.0010) [2023-12-26 12:05:36,872][123091] Updated weights for policy 0, policy_version 1565373 (0.0010) [2023-12-26 12:05:36,930][123091] Updated weights for policy 0, policy_version 1565383 (0.0011) [2023-12-26 12:05:37,096][123090] Updated weights for policy 1, policy_version 1554854 (0.0009) [2023-12-26 12:05:37,156][123090] Updated weights for policy 1, policy_version 1554864 (0.0009) [2023-12-26 12:05:37,221][123090] Updated weights for policy 1, policy_version 1554874 (0.0009) [2023-12-26 12:05:37,768][123091] Updated weights for policy 0, policy_version 1565393 (0.0010) [2023-12-26 12:05:37,841][123091] Updated weights for policy 0, policy_version 1565403 (0.0009) [2023-12-26 12:05:37,905][123091] Updated weights for policy 0, policy_version 1565413 (0.0008) [2023-12-26 12:05:37,953][123091] Updated weights for policy 0, policy_version 1565423 (0.0007) [2023-12-26 12:05:38,090][123090] Updated weights for policy 1, policy_version 1554884 (0.0009) [2023-12-26 12:05:38,138][123090] Updated weights for policy 1, policy_version 1554894 (0.0008) [2023-12-26 12:05:38,193][123090] Updated weights for policy 1, policy_version 1554904 (0.0008) [2023-12-26 12:05:38,742][123091] Updated weights for policy 0, policy_version 1565433 (0.0011) [2023-12-26 12:05:38,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 798810112. Throughput: 0: 9071.0, 1: 8607.2. Samples: 798791220. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:38,785][121949] Avg episode reward: [(0, '6154.252'), (1, '5773.332')] [2023-12-26 12:05:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001554912_398057472.pth... [2023-12-26 12:05:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001553920_397803520.pth [2023-12-26 12:05:38,806][123091] Updated weights for policy 0, policy_version 1565443 (0.0011) [2023-12-26 12:05:38,868][123091] Updated weights for policy 0, policy_version 1565453 (0.0011) [2023-12-26 12:05:38,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001565456_400760832.pth... [2023-12-26 12:05:38,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001564400_400490496.pth [2023-12-26 12:05:39,045][123090] Updated weights for policy 1, policy_version 1554914 (0.0008) [2023-12-26 12:05:39,110][123090] Updated weights for policy 1, policy_version 1554924 (0.0008) [2023-12-26 12:05:39,179][123090] Updated weights for policy 1, policy_version 1554934 (0.0009) [2023-12-26 12:05:39,251][123090] Updated weights for policy 1, policy_version 1554944 (0.0010) [2023-12-26 12:05:39,735][123091] Updated weights for policy 0, policy_version 1565463 (0.0011) [2023-12-26 12:05:39,807][123091] Updated weights for policy 0, policy_version 1565473 (0.0011) [2023-12-26 12:05:39,880][123091] Updated weights for policy 0, policy_version 1565483 (0.0011) [2023-12-26 12:05:40,121][123090] Updated weights for policy 1, policy_version 1554954 (0.0009) [2023-12-26 12:05:40,174][123090] Updated weights for policy 1, policy_version 1554964 (0.0009) [2023-12-26 12:05:40,236][123090] Updated weights for policy 1, policy_version 1554974 (0.0009) [2023-12-26 12:05:40,686][123091] Updated weights for policy 0, policy_version 1565493 (0.0008) [2023-12-26 12:05:40,740][123091] Updated weights for policy 0, policy_version 1565503 (0.0005) [2023-12-26 12:05:40,790][123091] Updated weights for policy 0, policy_version 1565513 (0.0005) [2023-12-26 12:05:41,071][123090] Updated weights for policy 1, policy_version 1554984 (0.0008) [2023-12-26 12:05:41,127][123090] Updated weights for policy 1, policy_version 1554994 (0.0005) [2023-12-26 12:05:41,197][123090] Updated weights for policy 1, policy_version 1555004 (0.0008) [2023-12-26 12:05:41,614][123091] Updated weights for policy 0, policy_version 1565523 (0.0007) [2023-12-26 12:05:41,681][123091] Updated weights for policy 0, policy_version 1565533 (0.0010) [2023-12-26 12:05:41,748][123091] Updated weights for policy 0, policy_version 1565543 (0.0011) [2023-12-26 12:05:42,056][123090] Updated weights for policy 1, policy_version 1555014 (0.0009) [2023-12-26 12:05:42,106][123090] Updated weights for policy 1, policy_version 1555024 (0.0009) [2023-12-26 12:05:42,155][123090] Updated weights for policy 1, policy_version 1555034 (0.0008) [2023-12-26 12:05:42,553][123091] Updated weights for policy 0, policy_version 1565553 (0.0010) [2023-12-26 12:05:42,622][123091] Updated weights for policy 0, policy_version 1565563 (0.0011) [2023-12-26 12:05:42,686][123091] Updated weights for policy 0, policy_version 1565573 (0.0011) [2023-12-26 12:05:42,753][123091] Updated weights for policy 0, policy_version 1565583 (0.0011) [2023-12-26 12:05:43,038][123090] Updated weights for policy 1, policy_version 1555044 (0.0008) [2023-12-26 12:05:43,106][123090] Updated weights for policy 1, policy_version 1555054 (0.0009) [2023-12-26 12:05:43,175][123090] Updated weights for policy 1, policy_version 1555064 (0.0009) [2023-12-26 12:05:43,524][123091] Updated weights for policy 0, policy_version 1565593 (0.0007) [2023-12-26 12:05:43,591][123091] Updated weights for policy 0, policy_version 1565603 (0.0008) [2023-12-26 12:05:43,660][123091] Updated weights for policy 0, policy_version 1565613 (0.0009) [2023-12-26 12:05:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 798900224. Throughput: 0: 8930.1, 1: 8529.8. Samples: 798892660. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:43,785][121949] Avg episode reward: [(0, '6283.521'), (1, '5805.717')] [2023-12-26 12:05:44,022][123090] Updated weights for policy 1, policy_version 1555074 (0.0009) [2023-12-26 12:05:44,086][123090] Updated weights for policy 1, policy_version 1555085 (0.0010) [2023-12-26 12:05:44,135][123090] Updated weights for policy 1, policy_version 1555095 (0.0009) [2023-12-26 12:05:44,452][123091] Updated weights for policy 0, policy_version 1565623 (0.0009) [2023-12-26 12:05:44,515][123091] Updated weights for policy 0, policy_version 1565633 (0.0007) [2023-12-26 12:05:44,577][123091] Updated weights for policy 0, policy_version 1565643 (0.0006) [2023-12-26 12:05:44,981][123090] Updated weights for policy 1, policy_version 1555105 (0.0009) [2023-12-26 12:05:45,048][123090] Updated weights for policy 1, policy_version 1555115 (0.0009) [2023-12-26 12:05:45,119][123090] Updated weights for policy 1, policy_version 1555125 (0.0006) [2023-12-26 12:05:45,188][123090] Updated weights for policy 1, policy_version 1555135 (0.0005) [2023-12-26 12:05:45,435][123091] Updated weights for policy 0, policy_version 1565653 (0.0009) [2023-12-26 12:05:45,490][123091] Updated weights for policy 0, policy_version 1565664 (0.0011) [2023-12-26 12:05:45,547][123091] Updated weights for policy 0, policy_version 1565674 (0.0009) [2023-12-26 12:05:45,879][123090] Updated weights for policy 1, policy_version 1555145 (0.0009) [2023-12-26 12:05:45,944][123090] Updated weights for policy 1, policy_version 1555155 (0.0005) [2023-12-26 12:05:46,007][123090] Updated weights for policy 1, policy_version 1555165 (0.0005) [2023-12-26 12:05:46,442][123091] Updated weights for policy 0, policy_version 1565684 (0.0010) [2023-12-26 12:05:46,495][123091] Updated weights for policy 0, policy_version 1565695 (0.0010) [2023-12-26 12:05:46,546][123091] Updated weights for policy 0, policy_version 1565705 (0.0009) [2023-12-26 12:05:46,638][123090] Updated weights for policy 1, policy_version 1555175 (0.0007) [2023-12-26 12:05:46,697][123090] Updated weights for policy 1, policy_version 1555185 (0.0010) [2023-12-26 12:05:46,751][123090] Updated weights for policy 1, policy_version 1555195 (0.0010) [2023-12-26 12:05:47,384][123091] Updated weights for policy 0, policy_version 1565715 (0.0008) [2023-12-26 12:05:47,436][123091] Updated weights for policy 0, policy_version 1565725 (0.0008) [2023-12-26 12:05:47,488][123091] Updated weights for policy 0, policy_version 1565735 (0.0007) [2023-12-26 12:05:47,569][123090] Updated weights for policy 1, policy_version 1555205 (0.0008) [2023-12-26 12:05:47,645][123090] Updated weights for policy 1, policy_version 1555215 (0.0006) [2023-12-26 12:05:47,713][123090] Updated weights for policy 1, policy_version 1555225 (0.0009) [2023-12-26 12:05:48,324][123091] Updated weights for policy 0, policy_version 1565745 (0.0006) [2023-12-26 12:05:48,388][123091] Updated weights for policy 0, policy_version 1565755 (0.0009) [2023-12-26 12:05:48,430][123090] Updated weights for policy 1, policy_version 1555235 (0.0009) [2023-12-26 12:05:48,440][123091] Updated weights for policy 0, policy_version 1565765 (0.0009) [2023-12-26 12:05:48,488][123090] Updated weights for policy 1, policy_version 1555245 (0.0006) [2023-12-26 12:05:48,494][123091] Updated weights for policy 0, policy_version 1565775 (0.0008) [2023-12-26 12:05:48,543][123090] Updated weights for policy 1, policy_version 1555255 (0.0008) [2023-12-26 12:05:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 798990336. Throughput: 0: 8916.2, 1: 8639.8. Samples: 798999080. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:48,785][121949] Avg episode reward: [(0, '6391.492'), (1, '5941.438')] [2023-12-26 12:05:49,146][123090] Updated weights for policy 1, policy_version 1555265 (0.0010) [2023-12-26 12:05:49,219][123090] Updated weights for policy 1, policy_version 1555275 (0.0009) [2023-12-26 12:05:49,288][123090] Updated weights for policy 1, policy_version 1555285 (0.0010) [2023-12-26 12:05:49,358][123090] Updated weights for policy 1, policy_version 1555295 (0.0010) [2023-12-26 12:05:49,380][123091] Updated weights for policy 0, policy_version 1565785 (0.0008) [2023-12-26 12:05:49,453][123091] Updated weights for policy 0, policy_version 1565795 (0.0009) [2023-12-26 12:05:49,520][123091] Updated weights for policy 0, policy_version 1565805 (0.0009) [2023-12-26 12:05:50,198][123090] Updated weights for policy 1, policy_version 1555305 (0.0009) [2023-12-26 12:05:50,258][123090] Updated weights for policy 1, policy_version 1555315 (0.0009) [2023-12-26 12:05:50,329][123090] Updated weights for policy 1, policy_version 1555325 (0.0009) [2023-12-26 12:05:50,357][123091] Updated weights for policy 0, policy_version 1565815 (0.0010) [2023-12-26 12:05:50,408][123091] Updated weights for policy 0, policy_version 1565825 (0.0010) [2023-12-26 12:05:50,463][123091] Updated weights for policy 0, policy_version 1565835 (0.0010) [2023-12-26 12:05:51,184][123090] Updated weights for policy 1, policy_version 1555335 (0.0010) [2023-12-26 12:05:51,240][123090] Updated weights for policy 1, policy_version 1555345 (0.0010) [2023-12-26 12:05:51,306][123090] Updated weights for policy 1, policy_version 1555355 (0.0010) [2023-12-26 12:05:51,308][123091] Updated weights for policy 0, policy_version 1565845 (0.0008) [2023-12-26 12:05:51,381][123091] Updated weights for policy 0, policy_version 1565855 (0.0008) [2023-12-26 12:05:51,446][123091] Updated weights for policy 0, policy_version 1565865 (0.0009) [2023-12-26 12:05:52,155][123091] Updated weights for policy 0, policy_version 1565875 (0.0008) [2023-12-26 12:05:52,190][123090] Updated weights for policy 1, policy_version 1555365 (0.0010) [2023-12-26 12:05:52,207][123091] Updated weights for policy 0, policy_version 1565885 (0.0006) [2023-12-26 12:05:52,249][123090] Updated weights for policy 1, policy_version 1555375 (0.0010) [2023-12-26 12:05:52,266][123091] Updated weights for policy 0, policy_version 1565895 (0.0006) [2023-12-26 12:05:52,312][123090] Updated weights for policy 1, policy_version 1555385 (0.0011) [2023-12-26 12:05:53,053][123091] Updated weights for policy 0, policy_version 1565905 (0.0009) [2023-12-26 12:05:53,078][123090] Updated weights for policy 1, policy_version 1555395 (0.0009) [2023-12-26 12:05:53,118][123091] Updated weights for policy 0, policy_version 1565915 (0.0009) [2023-12-26 12:05:53,146][123090] Updated weights for policy 1, policy_version 1555405 (0.0006) [2023-12-26 12:05:53,177][123091] Updated weights for policy 0, policy_version 1565925 (0.0010) [2023-12-26 12:05:53,208][123090] Updated weights for policy 1, policy_version 1555415 (0.0007) [2023-12-26 12:05:53,238][123091] Updated weights for policy 0, policy_version 1565935 (0.0006) [2023-12-26 12:05:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17689.3). Total num frames: 799072256. Throughput: 0: 8872.5, 1: 8611.4. Samples: 799050568. Policy #0 lag: (min: 31.0, avg: 33.8, max: 63.0) [2023-12-26 12:05:53,785][121949] Avg episode reward: [(0, '6205.249'), (1, '5955.980')] [2023-12-26 12:05:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001565936_400883712.pth... [2023-12-26 12:05:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001555424_398188544.pth... [2023-12-26 12:05:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001564912_400621568.pth [2023-12-26 12:05:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001554400_397926400.pth [2023-12-26 12:05:53,907][123090] Updated weights for policy 1, policy_version 1555425 (0.0008) [2023-12-26 12:05:53,960][123090] Updated weights for policy 1, policy_version 1555435 (0.0010) [2023-12-26 12:05:54,013][123090] Updated weights for policy 1, policy_version 1555445 (0.0006) [2023-12-26 12:05:54,017][123091] Updated weights for policy 0, policy_version 1565945 (0.0009) [2023-12-26 12:05:54,068][123090] Updated weights for policy 1, policy_version 1555455 (0.0005) [2023-12-26 12:05:54,069][123091] Updated weights for policy 0, policy_version 1565955 (0.0008) [2023-12-26 12:05:54,129][123091] Updated weights for policy 0, policy_version 1565965 (0.0009) [2023-12-26 12:05:54,815][123090] Updated weights for policy 1, policy_version 1555465 (0.0005) [2023-12-26 12:05:54,867][123090] Updated weights for policy 1, policy_version 1555475 (0.0007) [2023-12-26 12:05:54,874][123091] Updated weights for policy 0, policy_version 1565975 (0.0009) [2023-12-26 12:05:54,927][123091] Updated weights for policy 0, policy_version 1565985 (0.0007) [2023-12-26 12:05:54,927][123090] Updated weights for policy 1, policy_version 1555485 (0.0010) [2023-12-26 12:05:54,994][123091] Updated weights for policy 0, policy_version 1565995 (0.0010) [2023-12-26 12:05:55,604][123090] Updated weights for policy 1, policy_version 1555495 (0.0006) [2023-12-26 12:05:55,659][123090] Updated weights for policy 1, policy_version 1555505 (0.0005) [2023-12-26 12:05:55,722][123090] Updated weights for policy 1, policy_version 1555515 (0.0005) [2023-12-26 12:05:55,843][123091] Updated weights for policy 0, policy_version 1566005 (0.0009) [2023-12-26 12:05:55,913][123091] Updated weights for policy 0, policy_version 1566015 (0.0009) [2023-12-26 12:05:55,971][123091] Updated weights for policy 0, policy_version 1566025 (0.0010) [2023-12-26 12:05:56,424][123090] Updated weights for policy 1, policy_version 1555525 (0.0005) [2023-12-26 12:05:56,491][123090] Updated weights for policy 1, policy_version 1555535 (0.0009) [2023-12-26 12:05:56,547][123090] Updated weights for policy 1, policy_version 1555545 (0.0009) [2023-12-26 12:05:56,800][123091] Updated weights for policy 0, policy_version 1566035 (0.0007) [2023-12-26 12:05:56,866][123091] Updated weights for policy 0, policy_version 1566045 (0.0006) [2023-12-26 12:05:56,921][123091] Updated weights for policy 0, policy_version 1566055 (0.0009) [2023-12-26 12:05:57,292][123090] Updated weights for policy 1, policy_version 1555555 (0.0007) [2023-12-26 12:05:57,353][123090] Updated weights for policy 1, policy_version 1555565 (0.0007) [2023-12-26 12:05:57,419][123090] Updated weights for policy 1, policy_version 1555575 (0.0010) [2023-12-26 12:05:57,664][123091] Updated weights for policy 0, policy_version 1566065 (0.0010) [2023-12-26 12:05:57,716][123091] Updated weights for policy 0, policy_version 1566075 (0.0007) [2023-12-26 12:05:57,768][123091] Updated weights for policy 0, policy_version 1566085 (0.0005) [2023-12-26 12:05:57,833][123091] Updated weights for policy 0, policy_version 1566095 (0.0007) [2023-12-26 12:05:58,227][123090] Updated weights for policy 1, policy_version 1555585 (0.0010) [2023-12-26 12:05:58,295][123090] Updated weights for policy 1, policy_version 1555595 (0.0010) [2023-12-26 12:05:58,375][123090] Updated weights for policy 1, policy_version 1555605 (0.0015) [2023-12-26 12:05:58,446][123090] Updated weights for policy 1, policy_version 1555615 (0.0011) [2023-12-26 12:05:58,724][123091] Updated weights for policy 0, policy_version 1566105 (0.0008) [2023-12-26 12:05:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 799162368. Throughput: 0: 8879.9, 1: 8743.9. Samples: 799161488. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:05:58,785][121949] Avg episode reward: [(0, '6102.994'), (1, '6040.589')] [2023-12-26 12:05:58,794][123091] Updated weights for policy 0, policy_version 1566115 (0.0009) [2023-12-26 12:05:58,867][123091] Updated weights for policy 0, policy_version 1566125 (0.0009) [2023-12-26 12:05:59,337][123090] Updated weights for policy 1, policy_version 1555625 (0.0010) [2023-12-26 12:05:59,404][123090] Updated weights for policy 1, policy_version 1555635 (0.0010) [2023-12-26 12:05:59,471][123090] Updated weights for policy 1, policy_version 1555645 (0.0011) [2023-12-26 12:05:59,652][123091] Updated weights for policy 0, policy_version 1566135 (0.0009) [2023-12-26 12:05:59,704][123091] Updated weights for policy 0, policy_version 1566145 (0.0009) [2023-12-26 12:05:59,758][123091] Updated weights for policy 0, policy_version 1566155 (0.0010) [2023-12-26 12:06:00,171][123090] Updated weights for policy 1, policy_version 1555655 (0.0007) [2023-12-26 12:06:00,229][123090] Updated weights for policy 1, policy_version 1555665 (0.0006) [2023-12-26 12:06:00,289][123090] Updated weights for policy 1, policy_version 1555675 (0.0006) [2023-12-26 12:06:00,529][123091] Updated weights for policy 0, policy_version 1566165 (0.0008) [2023-12-26 12:06:00,584][123091] Updated weights for policy 0, policy_version 1566175 (0.0005) [2023-12-26 12:06:00,633][123091] Updated weights for policy 0, policy_version 1566185 (0.0005) [2023-12-26 12:06:00,981][123090] Updated weights for policy 1, policy_version 1555685 (0.0008) [2023-12-26 12:06:01,032][123090] Updated weights for policy 1, policy_version 1555695 (0.0006) [2023-12-26 12:06:01,099][123090] Updated weights for policy 1, policy_version 1555706 (0.0009) [2023-12-26 12:06:01,336][123091] Updated weights for policy 0, policy_version 1566195 (0.0006) [2023-12-26 12:06:01,407][123091] Updated weights for policy 0, policy_version 1566205 (0.0009) [2023-12-26 12:06:01,472][123091] Updated weights for policy 0, policy_version 1566215 (0.0006) [2023-12-26 12:06:01,997][123090] Updated weights for policy 1, policy_version 1555716 (0.0010) [2023-12-26 12:06:02,060][123090] Updated weights for policy 1, policy_version 1555726 (0.0009) [2023-12-26 12:06:02,124][123090] Updated weights for policy 1, policy_version 1555736 (0.0008) [2023-12-26 12:06:02,211][123091] Updated weights for policy 0, policy_version 1566225 (0.0005) [2023-12-26 12:06:02,277][123091] Updated weights for policy 0, policy_version 1566235 (0.0007) [2023-12-26 12:06:02,345][123091] Updated weights for policy 0, policy_version 1566245 (0.0007) [2023-12-26 12:06:02,410][123091] Updated weights for policy 0, policy_version 1566255 (0.0010) [2023-12-26 12:06:02,919][123090] Updated weights for policy 1, policy_version 1555746 (0.0008) [2023-12-26 12:06:02,967][123090] Updated weights for policy 1, policy_version 1555756 (0.0005) [2023-12-26 12:06:03,012][123090] Updated weights for policy 1, policy_version 1555766 (0.0005) [2023-12-26 12:06:03,063][123090] Updated weights for policy 1, policy_version 1555776 (0.0005) [2023-12-26 12:06:03,268][123091] Updated weights for policy 0, policy_version 1566265 (0.0006) [2023-12-26 12:06:03,320][123091] Updated weights for policy 0, policy_version 1566275 (0.0006) [2023-12-26 12:06:03,375][123091] Updated weights for policy 0, policy_version 1566286 (0.0010) [2023-12-26 12:06:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 799252480. Throughput: 0: 8736.4, 1: 8798.6. Samples: 799267192. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:03,785][121949] Avg episode reward: [(0, '6256.761'), (1, '5979.674')] [2023-12-26 12:06:03,789][123090] Updated weights for policy 1, policy_version 1555786 (0.0008) [2023-12-26 12:06:03,852][123090] Updated weights for policy 1, policy_version 1555796 (0.0011) [2023-12-26 12:06:03,905][123090] Updated weights for policy 1, policy_version 1555806 (0.0011) [2023-12-26 12:06:04,226][123091] Updated weights for policy 0, policy_version 1566296 (0.0009) [2023-12-26 12:06:04,290][123091] Updated weights for policy 0, policy_version 1566306 (0.0009) [2023-12-26 12:06:04,356][123091] Updated weights for policy 0, policy_version 1566316 (0.0009) [2023-12-26 12:06:04,752][123090] Updated weights for policy 1, policy_version 1555816 (0.0011) [2023-12-26 12:06:04,807][123090] Updated weights for policy 1, policy_version 1555826 (0.0010) [2023-12-26 12:06:04,866][123090] Updated weights for policy 1, policy_version 1555836 (0.0010) [2023-12-26 12:06:05,149][123091] Updated weights for policy 0, policy_version 1566326 (0.0006) [2023-12-26 12:06:05,210][123091] Updated weights for policy 0, policy_version 1566336 (0.0009) [2023-12-26 12:06:05,272][123091] Updated weights for policy 0, policy_version 1566346 (0.0010) [2023-12-26 12:06:05,680][123090] Updated weights for policy 1, policy_version 1555846 (0.0009) [2023-12-26 12:06:05,739][123090] Updated weights for policy 1, policy_version 1555856 (0.0010) [2023-12-26 12:06:05,798][123090] Updated weights for policy 1, policy_version 1555866 (0.0010) [2023-12-26 12:06:06,097][123091] Updated weights for policy 0, policy_version 1566356 (0.0008) [2023-12-26 12:06:06,165][123091] Updated weights for policy 0, policy_version 1566366 (0.0007) [2023-12-26 12:06:06,231][123091] Updated weights for policy 0, policy_version 1566376 (0.0007) [2023-12-26 12:06:06,582][123090] Updated weights for policy 1, policy_version 1555876 (0.0011) [2023-12-26 12:06:06,650][123090] Updated weights for policy 1, policy_version 1555886 (0.0011) [2023-12-26 12:06:06,715][123090] Updated weights for policy 1, policy_version 1555896 (0.0011) [2023-12-26 12:06:07,046][123091] Updated weights for policy 0, policy_version 1566386 (0.0010) [2023-12-26 12:06:07,094][123091] Updated weights for policy 0, policy_version 1566396 (0.0011) [2023-12-26 12:06:07,142][123091] Updated weights for policy 0, policy_version 1566406 (0.0011) [2023-12-26 12:06:07,194][123091] Updated weights for policy 0, policy_version 1566416 (0.0010) [2023-12-26 12:06:07,390][123090] Updated weights for policy 1, policy_version 1555906 (0.0010) [2023-12-26 12:06:07,458][123090] Updated weights for policy 1, policy_version 1555916 (0.0009) [2023-12-26 12:06:07,522][123090] Updated weights for policy 1, policy_version 1555926 (0.0008) [2023-12-26 12:06:07,583][123090] Updated weights for policy 1, policy_version 1555936 (0.0009) [2023-12-26 12:06:08,049][123091] Updated weights for policy 0, policy_version 1566426 (0.0010) [2023-12-26 12:06:08,108][123091] Updated weights for policy 0, policy_version 1566436 (0.0010) [2023-12-26 12:06:08,167][123091] Updated weights for policy 0, policy_version 1566446 (0.0011) [2023-12-26 12:06:08,309][123090] Updated weights for policy 1, policy_version 1555946 (0.0005) [2023-12-26 12:06:08,381][123090] Updated weights for policy 1, policy_version 1555956 (0.0009) [2023-12-26 12:06:08,439][123090] Updated weights for policy 1, policy_version 1555966 (0.0010) [2023-12-26 12:06:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 799342592. Throughput: 0: 8754.9, 1: 8834.8. Samples: 799319352. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:08,785][121949] Avg episode reward: [(0, '6296.509'), (1, '5935.208')] [2023-12-26 12:06:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001566448_401014784.pth... [2023-12-26 12:06:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001555968_398327808.pth... [2023-12-26 12:06:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001565456_400760832.pth [2023-12-26 12:06:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001554912_398057472.pth [2023-12-26 12:06:08,933][123091] Updated weights for policy 0, policy_version 1566456 (0.0011) [2023-12-26 12:06:09,005][123091] Updated weights for policy 0, policy_version 1566466 (0.0010) [2023-12-26 12:06:09,077][123091] Updated weights for policy 0, policy_version 1566476 (0.0009) [2023-12-26 12:06:09,219][123090] Updated weights for policy 1, policy_version 1555976 (0.0010) [2023-12-26 12:06:09,292][123090] Updated weights for policy 1, policy_version 1555986 (0.0006) [2023-12-26 12:06:09,367][123090] Updated weights for policy 1, policy_version 1555996 (0.0008) [2023-12-26 12:06:09,962][123091] Updated weights for policy 0, policy_version 1566486 (0.0010) [2023-12-26 12:06:10,025][123091] Updated weights for policy 0, policy_version 1566496 (0.0009) [2023-12-26 12:06:10,092][123091] Updated weights for policy 0, policy_version 1566506 (0.0009) [2023-12-26 12:06:10,142][123090] Updated weights for policy 1, policy_version 1556006 (0.0011) [2023-12-26 12:06:10,200][123090] Updated weights for policy 1, policy_version 1556016 (0.0009) [2023-12-26 12:06:10,251][123090] Updated weights for policy 1, policy_version 1556026 (0.0008) [2023-12-26 12:06:10,938][123091] Updated weights for policy 0, policy_version 1566516 (0.0007) [2023-12-26 12:06:11,010][123091] Updated weights for policy 0, policy_version 1566526 (0.0006) [2023-12-26 12:06:11,039][123090] Updated weights for policy 1, policy_version 1556036 (0.0008) [2023-12-26 12:06:11,082][123091] Updated weights for policy 0, policy_version 1566536 (0.0007) [2023-12-26 12:06:11,107][123090] Updated weights for policy 1, policy_version 1556046 (0.0008) [2023-12-26 12:06:11,179][123090] Updated weights for policy 1, policy_version 1556056 (0.0011) [2023-12-26 12:06:11,885][123091] Updated weights for policy 0, policy_version 1566546 (0.0009) [2023-12-26 12:06:11,942][123091] Updated weights for policy 0, policy_version 1566556 (0.0009) [2023-12-26 12:06:11,954][123090] Updated weights for policy 1, policy_version 1556066 (0.0010) [2023-12-26 12:06:11,993][123091] Updated weights for policy 0, policy_version 1566566 (0.0007) [2023-12-26 12:06:12,014][123090] Updated weights for policy 1, policy_version 1556076 (0.0010) [2023-12-26 12:06:12,047][123091] Updated weights for policy 0, policy_version 1566576 (0.0007) [2023-12-26 12:06:12,071][123090] Updated weights for policy 1, policy_version 1556086 (0.0010) [2023-12-26 12:06:12,126][123090] Updated weights for policy 1, policy_version 1556096 (0.0010) [2023-12-26 12:06:12,930][123091] Updated weights for policy 0, policy_version 1566586 (0.0010) [2023-12-26 12:06:12,988][123091] Updated weights for policy 0, policy_version 1566596 (0.0009) [2023-12-26 12:06:13,000][123090] Updated weights for policy 1, policy_version 1556106 (0.0006) [2023-12-26 12:06:13,045][123091] Updated weights for policy 0, policy_version 1566606 (0.0009) [2023-12-26 12:06:13,069][123090] Updated weights for policy 1, policy_version 1556116 (0.0008) [2023-12-26 12:06:13,130][123090] Updated weights for policy 1, policy_version 1556126 (0.0009) [2023-12-26 12:06:13,721][123091] Updated weights for policy 0, policy_version 1566616 (0.0006) [2023-12-26 12:06:13,773][123091] Updated weights for policy 0, policy_version 1566626 (0.0005) [2023-12-26 12:06:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 799424512. Throughput: 0: 8716.7, 1: 8920.3. Samples: 799424072. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:13,785][121949] Avg episode reward: [(0, '6219.452'), (1, '6033.004')] [2023-12-26 12:06:13,805][123090] Updated weights for policy 1, policy_version 1556136 (0.0005) [2023-12-26 12:06:13,821][123091] Updated weights for policy 0, policy_version 1566636 (0.0005) [2023-12-26 12:06:13,862][123090] Updated weights for policy 1, policy_version 1556146 (0.0005) [2023-12-26 12:06:13,927][123090] Updated weights for policy 1, policy_version 1556156 (0.0005) [2023-12-26 12:06:14,505][123091] Updated weights for policy 0, policy_version 1566646 (0.0005) [2023-12-26 12:06:14,552][123091] Updated weights for policy 0, policy_version 1566656 (0.0005) [2023-12-26 12:06:14,600][123091] Updated weights for policy 0, policy_version 1566666 (0.0005) [2023-12-26 12:06:14,624][123090] Updated weights for policy 1, policy_version 1556166 (0.0007) [2023-12-26 12:06:14,674][123090] Updated weights for policy 1, policy_version 1556176 (0.0005) [2023-12-26 12:06:14,728][123090] Updated weights for policy 1, policy_version 1556186 (0.0005) [2023-12-26 12:06:15,287][123091] Updated weights for policy 0, policy_version 1566676 (0.0006) [2023-12-26 12:06:15,353][123091] Updated weights for policy 0, policy_version 1566686 (0.0007) [2023-12-26 12:06:15,402][123090] Updated weights for policy 1, policy_version 1556196 (0.0006) [2023-12-26 12:06:15,424][123091] Updated weights for policy 0, policy_version 1566696 (0.0011) [2023-12-26 12:06:15,459][123090] Updated weights for policy 1, policy_version 1556206 (0.0007) [2023-12-26 12:06:15,525][123090] Updated weights for policy 1, policy_version 1556216 (0.0009) [2023-12-26 12:06:16,099][123091] Updated weights for policy 0, policy_version 1566706 (0.0010) [2023-12-26 12:06:16,162][123091] Updated weights for policy 0, policy_version 1566716 (0.0010) [2023-12-26 12:06:16,216][123091] Updated weights for policy 0, policy_version 1566726 (0.0010) [2023-12-26 12:06:16,263][123091] Updated weights for policy 0, policy_version 1566736 (0.0010) [2023-12-26 12:06:16,338][123090] Updated weights for policy 1, policy_version 1556226 (0.0009) [2023-12-26 12:06:16,389][123090] Updated weights for policy 1, policy_version 1556236 (0.0005) [2023-12-26 12:06:16,436][123090] Updated weights for policy 1, policy_version 1556246 (0.0005) [2023-12-26 12:06:16,483][123090] Updated weights for policy 1, policy_version 1556256 (0.0005) [2023-12-26 12:06:17,102][123091] Updated weights for policy 0, policy_version 1566746 (0.0010) [2023-12-26 12:06:17,164][123091] Updated weights for policy 0, policy_version 1566756 (0.0011) [2023-12-26 12:06:17,219][123091] Updated weights for policy 0, policy_version 1566766 (0.0010) [2023-12-26 12:06:17,228][123090] Updated weights for policy 1, policy_version 1556266 (0.0010) [2023-12-26 12:06:17,287][123090] Updated weights for policy 1, policy_version 1556276 (0.0007) [2023-12-26 12:06:17,339][123090] Updated weights for policy 1, policy_version 1556286 (0.0005) [2023-12-26 12:06:18,004][123091] Updated weights for policy 0, policy_version 1566776 (0.0006) [2023-12-26 12:06:18,058][123091] Updated weights for policy 0, policy_version 1566786 (0.0006) [2023-12-26 12:06:18,120][123091] Updated weights for policy 0, policy_version 1566796 (0.0006) [2023-12-26 12:06:18,133][123090] Updated weights for policy 1, policy_version 1556296 (0.0008) [2023-12-26 12:06:18,184][123090] Updated weights for policy 1, policy_version 1556306 (0.0009) [2023-12-26 12:06:18,240][123090] Updated weights for policy 1, policy_version 1556316 (0.0008) [2023-12-26 12:06:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 799522816. Throughput: 0: 8796.1, 1: 8968.0. Samples: 799536996. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:18,784][121949] Avg episode reward: [(0, '6309.641'), (1, '6003.511')] [2023-12-26 12:06:18,818][123091] Updated weights for policy 0, policy_version 1566806 (0.0008) [2023-12-26 12:06:18,880][123091] Updated weights for policy 0, policy_version 1566816 (0.0006) [2023-12-26 12:06:18,941][123091] Updated weights for policy 0, policy_version 1566826 (0.0005) [2023-12-26 12:06:19,120][123090] Updated weights for policy 1, policy_version 1556326 (0.0007) [2023-12-26 12:06:19,180][123090] Updated weights for policy 1, policy_version 1556336 (0.0005) [2023-12-26 12:06:19,241][123090] Updated weights for policy 1, policy_version 1556346 (0.0007) [2023-12-26 12:06:19,685][123091] Updated weights for policy 0, policy_version 1566836 (0.0007) [2023-12-26 12:06:19,743][123091] Updated weights for policy 0, policy_version 1566846 (0.0009) [2023-12-26 12:06:19,801][123091] Updated weights for policy 0, policy_version 1566856 (0.0009) [2023-12-26 12:06:20,024][123090] Updated weights for policy 1, policy_version 1556356 (0.0008) [2023-12-26 12:06:20,075][123090] Updated weights for policy 1, policy_version 1556366 (0.0009) [2023-12-26 12:06:20,130][123090] Updated weights for policy 1, policy_version 1556376 (0.0010) [2023-12-26 12:06:20,594][123091] Updated weights for policy 0, policy_version 1566866 (0.0009) [2023-12-26 12:06:20,665][123091] Updated weights for policy 0, policy_version 1566876 (0.0006) [2023-12-26 12:06:20,732][123091] Updated weights for policy 0, policy_version 1566886 (0.0006) [2023-12-26 12:06:20,794][123091] Updated weights for policy 0, policy_version 1566896 (0.0008) [2023-12-26 12:06:21,072][123090] Updated weights for policy 1, policy_version 1556386 (0.0009) [2023-12-26 12:06:21,141][123090] Updated weights for policy 1, policy_version 1556396 (0.0008) [2023-12-26 12:06:21,214][123090] Updated weights for policy 1, policy_version 1556406 (0.0009) [2023-12-26 12:06:21,285][123090] Updated weights for policy 1, policy_version 1556416 (0.0010) [2023-12-26 12:06:21,547][123091] Updated weights for policy 0, policy_version 1566906 (0.0008) [2023-12-26 12:06:21,610][123091] Updated weights for policy 0, policy_version 1566916 (0.0008) [2023-12-26 12:06:21,674][123091] Updated weights for policy 0, policy_version 1566926 (0.0008) [2023-12-26 12:06:22,119][123090] Updated weights for policy 1, policy_version 1556426 (0.0010) [2023-12-26 12:06:22,177][123090] Updated weights for policy 1, policy_version 1556436 (0.0008) [2023-12-26 12:06:22,236][123090] Updated weights for policy 1, policy_version 1556446 (0.0010) [2023-12-26 12:06:22,515][123091] Updated weights for policy 0, policy_version 1566936 (0.0010) [2023-12-26 12:06:22,584][123091] Updated weights for policy 0, policy_version 1566946 (0.0009) [2023-12-26 12:06:22,642][123091] Updated weights for policy 0, policy_version 1566956 (0.0009) [2023-12-26 12:06:23,056][123090] Updated weights for policy 1, policy_version 1556456 (0.0007) [2023-12-26 12:06:23,134][123090] Updated weights for policy 1, policy_version 1556466 (0.0006) [2023-12-26 12:06:23,194][123090] Updated weights for policy 1, policy_version 1556476 (0.0008) [2023-12-26 12:06:23,507][123091] Updated weights for policy 0, policy_version 1566967 (0.0010) [2023-12-26 12:06:23,560][123091] Updated weights for policy 0, policy_version 1566977 (0.0009) [2023-12-26 12:06:23,608][123091] Updated weights for policy 0, policy_version 1566987 (0.0009) [2023-12-26 12:06:23,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 799612928. Throughput: 0: 8791.6, 1: 8931.3. Samples: 799588756. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:23,785][121949] Avg episode reward: [(0, '6313.362'), (1, '5900.357')] [2023-12-26 12:06:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001566992_401154048.pth... [2023-12-26 12:06:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001556480_398458880.pth... [2023-12-26 12:06:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001565936_400883712.pth [2023-12-26 12:06:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001555424_398188544.pth [2023-12-26 12:06:23,884][123090] Updated weights for policy 1, policy_version 1556486 (0.0009) [2023-12-26 12:06:23,936][123090] Updated weights for policy 1, policy_version 1556496 (0.0009) [2023-12-26 12:06:23,990][123090] Updated weights for policy 1, policy_version 1556506 (0.0009) [2023-12-26 12:06:24,477][123091] Updated weights for policy 0, policy_version 1566997 (0.0009) [2023-12-26 12:06:24,543][123091] Updated weights for policy 0, policy_version 1567007 (0.0009) [2023-12-26 12:06:24,608][123091] Updated weights for policy 0, policy_version 1567017 (0.0009) [2023-12-26 12:06:24,793][123090] Updated weights for policy 1, policy_version 1556516 (0.0009) [2023-12-26 12:06:24,844][123090] Updated weights for policy 1, policy_version 1556526 (0.0009) [2023-12-26 12:06:24,900][123090] Updated weights for policy 1, policy_version 1556536 (0.0009) [2023-12-26 12:06:25,458][123091] Updated weights for policy 0, policy_version 1567027 (0.0010) [2023-12-26 12:06:25,521][123091] Updated weights for policy 0, policy_version 1567037 (0.0009) [2023-12-26 12:06:25,574][123091] Updated weights for policy 0, policy_version 1567047 (0.0009) [2023-12-26 12:06:25,644][123090] Updated weights for policy 1, policy_version 1556546 (0.0009) [2023-12-26 12:06:25,715][123090] Updated weights for policy 1, policy_version 1556556 (0.0008) [2023-12-26 12:06:25,779][123090] Updated weights for policy 1, policy_version 1556566 (0.0006) [2023-12-26 12:06:25,823][123090] Updated weights for policy 1, policy_version 1556576 (0.0007) [2023-12-26 12:06:26,400][123091] Updated weights for policy 0, policy_version 1567057 (0.0008) [2023-12-26 12:06:26,460][123091] Updated weights for policy 0, policy_version 1567067 (0.0007) [2023-12-26 12:06:26,512][123091] Updated weights for policy 0, policy_version 1567077 (0.0010) [2023-12-26 12:06:26,563][123091] Updated weights for policy 0, policy_version 1567088 (0.0010) [2023-12-26 12:06:26,664][123090] Updated weights for policy 1, policy_version 1556586 (0.0009) [2023-12-26 12:06:26,719][123090] Updated weights for policy 1, policy_version 1556596 (0.0009) [2023-12-26 12:06:26,780][123090] Updated weights for policy 1, policy_version 1556606 (0.0009) [2023-12-26 12:06:27,345][123091] Updated weights for policy 0, policy_version 1567098 (0.0009) [2023-12-26 12:06:27,396][123091] Updated weights for policy 0, policy_version 1567108 (0.0010) [2023-12-26 12:06:27,449][123091] Updated weights for policy 0, policy_version 1567119 (0.0009) [2023-12-26 12:06:27,596][123090] Updated weights for policy 1, policy_version 1556616 (0.0009) [2023-12-26 12:06:27,648][123090] Updated weights for policy 1, policy_version 1556626 (0.0009) [2023-12-26 12:06:27,694][123090] Updated weights for policy 1, policy_version 1556636 (0.0008) [2023-12-26 12:06:28,287][123091] Updated weights for policy 0, policy_version 1567129 (0.0010) [2023-12-26 12:06:28,342][123091] Updated weights for policy 0, policy_version 1567139 (0.0009) [2023-12-26 12:06:28,407][123091] Updated weights for policy 0, policy_version 1567149 (0.0009) [2023-12-26 12:06:28,555][123090] Updated weights for policy 1, policy_version 1556646 (0.0010) [2023-12-26 12:06:28,627][123090] Updated weights for policy 1, policy_version 1556656 (0.0010) [2023-12-26 12:06:28,696][123090] Updated weights for policy 1, policy_version 1556666 (0.0010) [2023-12-26 12:06:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 799703040. Throughput: 0: 8771.2, 1: 9024.7. Samples: 799693476. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:28,785][121949] Avg episode reward: [(0, '6405.203'), (1, '5865.141')] [2023-12-26 12:06:29,244][123091] Updated weights for policy 0, policy_version 1567159 (0.0008) [2023-12-26 12:06:29,299][123091] Updated weights for policy 0, policy_version 1567169 (0.0007) [2023-12-26 12:06:29,365][123091] Updated weights for policy 0, policy_version 1567179 (0.0008) [2023-12-26 12:06:29,514][123090] Updated weights for policy 1, policy_version 1556676 (0.0010) [2023-12-26 12:06:29,563][123090] Updated weights for policy 1, policy_version 1556686 (0.0010) [2023-12-26 12:06:29,616][123090] Updated weights for policy 1, policy_version 1556696 (0.0010) [2023-12-26 12:06:30,162][123091] Updated weights for policy 0, policy_version 1567189 (0.0008) [2023-12-26 12:06:30,228][123091] Updated weights for policy 0, policy_version 1567199 (0.0009) [2023-12-26 12:06:30,296][123091] Updated weights for policy 0, policy_version 1567209 (0.0009) [2023-12-26 12:06:30,483][123090] Updated weights for policy 1, policy_version 1556706 (0.0011) [2023-12-26 12:06:30,536][123090] Updated weights for policy 1, policy_version 1556716 (0.0010) [2023-12-26 12:06:30,596][123090] Updated weights for policy 1, policy_version 1556726 (0.0010) [2023-12-26 12:06:30,666][123090] Updated weights for policy 1, policy_version 1556736 (0.0011) [2023-12-26 12:06:31,165][123091] Updated weights for policy 0, policy_version 1567219 (0.0009) [2023-12-26 12:06:31,235][123091] Updated weights for policy 0, policy_version 1567229 (0.0010) [2023-12-26 12:06:31,307][123091] Updated weights for policy 0, policy_version 1567239 (0.0009) [2023-12-26 12:06:31,394][123090] Updated weights for policy 1, policy_version 1556746 (0.0010) [2023-12-26 12:06:31,453][123090] Updated weights for policy 1, policy_version 1556756 (0.0007) [2023-12-26 12:06:31,511][123090] Updated weights for policy 1, policy_version 1556766 (0.0009) [2023-12-26 12:06:32,154][123091] Updated weights for policy 0, policy_version 1567249 (0.0007) [2023-12-26 12:06:32,207][123091] Updated weights for policy 0, policy_version 1567259 (0.0010) [2023-12-26 12:06:32,265][123091] Updated weights for policy 0, policy_version 1567269 (0.0009) [2023-12-26 12:06:32,277][123090] Updated weights for policy 1, policy_version 1556776 (0.0007) [2023-12-26 12:06:32,324][123091] Updated weights for policy 0, policy_version 1567279 (0.0008) [2023-12-26 12:06:32,343][123090] Updated weights for policy 1, policy_version 1556786 (0.0010) [2023-12-26 12:06:32,404][123090] Updated weights for policy 1, policy_version 1556796 (0.0009) [2023-12-26 12:06:33,176][123091] Updated weights for policy 0, policy_version 1567289 (0.0009) [2023-12-26 12:06:33,187][123090] Updated weights for policy 1, policy_version 1556806 (0.0007) [2023-12-26 12:06:33,232][123091] Updated weights for policy 0, policy_version 1567299 (0.0009) [2023-12-26 12:06:33,255][123090] Updated weights for policy 1, policy_version 1556816 (0.0006) [2023-12-26 12:06:33,278][123091] Updated weights for policy 0, policy_version 1567309 (0.0008) [2023-12-26 12:06:33,308][123090] Updated weights for policy 1, policy_version 1556826 (0.0006) [2023-12-26 12:06:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 799784960. Throughput: 0: 8761.5, 1: 8959.8. Samples: 799796536. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:33,785][121949] Avg episode reward: [(0, '6395.371'), (1, '6016.469')] [2023-12-26 12:06:33,974][123090] Updated weights for policy 1, policy_version 1556836 (0.0008) [2023-12-26 12:06:34,023][123090] Updated weights for policy 1, policy_version 1556846 (0.0007) [2023-12-26 12:06:34,072][123090] Updated weights for policy 1, policy_version 1556857 (0.0007) [2023-12-26 12:06:34,164][123091] Updated weights for policy 0, policy_version 1567319 (0.0008) [2023-12-26 12:06:34,236][123091] Updated weights for policy 0, policy_version 1567329 (0.0009) [2023-12-26 12:06:34,294][123091] Updated weights for policy 0, policy_version 1567339 (0.0007) [2023-12-26 12:06:34,938][123090] Updated weights for policy 1, policy_version 1556867 (0.0006) [2023-12-26 12:06:34,986][123091] Updated weights for policy 0, policy_version 1567349 (0.0007) [2023-12-26 12:06:35,004][123090] Updated weights for policy 1, policy_version 1556877 (0.0009) [2023-12-26 12:06:35,041][123091] Updated weights for policy 0, policy_version 1567359 (0.0006) [2023-12-26 12:06:35,068][123090] Updated weights for policy 1, policy_version 1556887 (0.0008) [2023-12-26 12:06:35,092][123091] Updated weights for policy 0, policy_version 1567369 (0.0007) [2023-12-26 12:06:35,891][123090] Updated weights for policy 1, policy_version 1556897 (0.0008) [2023-12-26 12:06:35,907][123091] Updated weights for policy 0, policy_version 1567380 (0.0009) [2023-12-26 12:06:35,937][123090] Updated weights for policy 1, policy_version 1556907 (0.0008) [2023-12-26 12:06:35,962][123091] Updated weights for policy 0, policy_version 1567390 (0.0007) [2023-12-26 12:06:35,986][123090] Updated weights for policy 1, policy_version 1556917 (0.0009) [2023-12-26 12:06:36,020][123091] Updated weights for policy 0, policy_version 1567400 (0.0008) [2023-12-26 12:06:36,031][123090] Updated weights for policy 1, policy_version 1556927 (0.0007) [2023-12-26 12:06:36,843][123091] Updated weights for policy 0, policy_version 1567410 (0.0010) [2023-12-26 12:06:36,908][123091] Updated weights for policy 0, policy_version 1567420 (0.0009) [2023-12-26 12:06:36,921][123090] Updated weights for policy 1, policy_version 1556937 (0.0008) [2023-12-26 12:06:36,972][123091] Updated weights for policy 0, policy_version 1567430 (0.0010) [2023-12-26 12:06:36,983][123090] Updated weights for policy 1, policy_version 1556947 (0.0007) [2023-12-26 12:06:37,033][123091] Updated weights for policy 0, policy_version 1567440 (0.0009) [2023-12-26 12:06:37,045][123090] Updated weights for policy 1, policy_version 1556957 (0.0007) [2023-12-26 12:06:37,794][123090] Updated weights for policy 1, policy_version 1556967 (0.0010) [2023-12-26 12:06:37,851][123090] Updated weights for policy 1, policy_version 1556977 (0.0010) [2023-12-26 12:06:37,875][123091] Updated weights for policy 0, policy_version 1567450 (0.0007) [2023-12-26 12:06:37,912][123090] Updated weights for policy 1, policy_version 1556987 (0.0010) [2023-12-26 12:06:37,931][123091] Updated weights for policy 0, policy_version 1567460 (0.0008) [2023-12-26 12:06:37,993][123091] Updated weights for policy 0, policy_version 1567470 (0.0010) [2023-12-26 12:06:38,661][123090] Updated weights for policy 1, policy_version 1556997 (0.0008) [2023-12-26 12:06:38,728][123090] Updated weights for policy 1, policy_version 1557007 (0.0009) [2023-12-26 12:06:38,756][123091] Updated weights for policy 0, policy_version 1567480 (0.0011) [2023-12-26 12:06:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 799866880. Throughput: 0: 8788.2, 1: 8976.0. Samples: 799849956. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:38,784][121949] Avg episode reward: [(0, '6265.650'), (1, '6024.287')] [2023-12-26 12:06:38,791][123090] Updated weights for policy 1, policy_version 1557017 (0.0008) [2023-12-26 12:06:38,811][123091] Updated weights for policy 0, policy_version 1567490 (0.0011) [2023-12-26 12:06:38,831][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001557024_398598144.pth... [2023-12-26 12:06:38,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001555968_398327808.pth [2023-12-26 12:06:38,874][123091] Updated weights for policy 0, policy_version 1567500 (0.0011) [2023-12-26 12:06:38,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001567504_401285120.pth... [2023-12-26 12:06:38,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001566448_401014784.pth [2023-12-26 12:06:39,583][123090] Updated weights for policy 1, policy_version 1557027 (0.0008) [2023-12-26 12:06:39,647][123090] Updated weights for policy 1, policy_version 1557037 (0.0011) [2023-12-26 12:06:39,711][123090] Updated weights for policy 1, policy_version 1557047 (0.0011) [2023-12-26 12:06:39,768][123091] Updated weights for policy 0, policy_version 1567510 (0.0011) [2023-12-26 12:06:39,835][123091] Updated weights for policy 0, policy_version 1567520 (0.0010) [2023-12-26 12:06:39,900][123091] Updated weights for policy 0, policy_version 1567530 (0.0010) [2023-12-26 12:06:40,532][123090] Updated weights for policy 1, policy_version 1557057 (0.0010) [2023-12-26 12:06:40,597][123090] Updated weights for policy 1, policy_version 1557067 (0.0009) [2023-12-26 12:06:40,660][123090] Updated weights for policy 1, policy_version 1557077 (0.0009) [2023-12-26 12:06:40,729][123090] Updated weights for policy 1, policy_version 1557087 (0.0009) [2023-12-26 12:06:40,739][123091] Updated weights for policy 0, policy_version 1567540 (0.0011) [2023-12-26 12:06:40,791][123091] Updated weights for policy 0, policy_version 1567550 (0.0011) [2023-12-26 12:06:40,839][123091] Updated weights for policy 0, policy_version 1567560 (0.0010) [2023-12-26 12:06:41,562][123090] Updated weights for policy 1, policy_version 1557097 (0.0006) [2023-12-26 12:06:41,618][123090] Updated weights for policy 1, policy_version 1557107 (0.0006) [2023-12-26 12:06:41,694][123090] Updated weights for policy 1, policy_version 1557117 (0.0008) [2023-12-26 12:06:41,707][123091] Updated weights for policy 0, policy_version 1567570 (0.0010) [2023-12-26 12:06:41,771][123091] Updated weights for policy 0, policy_version 1567580 (0.0008) [2023-12-26 12:06:41,833][123091] Updated weights for policy 0, policy_version 1567590 (0.0006) [2023-12-26 12:06:41,907][123091] Updated weights for policy 0, policy_version 1567600 (0.0006) [2023-12-26 12:06:42,483][123090] Updated weights for policy 1, policy_version 1557127 (0.0006) [2023-12-26 12:06:42,551][123090] Updated weights for policy 1, policy_version 1557137 (0.0006) [2023-12-26 12:06:42,607][123090] Updated weights for policy 1, policy_version 1557147 (0.0005) [2023-12-26 12:06:42,767][123091] Updated weights for policy 0, policy_version 1567610 (0.0010) [2023-12-26 12:06:42,832][123091] Updated weights for policy 0, policy_version 1567620 (0.0010) [2023-12-26 12:06:42,889][123091] Updated weights for policy 0, policy_version 1567630 (0.0009) [2023-12-26 12:06:43,352][123090] Updated weights for policy 1, policy_version 1557157 (0.0006) [2023-12-26 12:06:43,433][123090] Updated weights for policy 1, policy_version 1557167 (0.0006) [2023-12-26 12:06:43,513][123090] Updated weights for policy 1, policy_version 1557177 (0.0006) [2023-12-26 12:06:43,608][123091] Updated weights for policy 0, policy_version 1567640 (0.0010) [2023-12-26 12:06:43,671][123091] Updated weights for policy 0, policy_version 1567650 (0.0011) [2023-12-26 12:06:43,726][123091] Updated weights for policy 0, policy_version 1567660 (0.0011) [2023-12-26 12:06:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 799965184. Throughput: 0: 8723.6, 1: 8881.9. Samples: 799953736. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:43,784][121949] Avg episode reward: [(0, '6240.936'), (1, '5966.025')] [2023-12-26 12:06:44,270][123090] Updated weights for policy 1, policy_version 1557187 (0.0009) [2023-12-26 12:06:44,318][123090] Updated weights for policy 1, policy_version 1557197 (0.0009) [2023-12-26 12:06:44,369][123090] Updated weights for policy 1, policy_version 1557207 (0.0008) [2023-12-26 12:06:44,551][123091] Updated weights for policy 0, policy_version 1567670 (0.0011) [2023-12-26 12:06:44,610][123091] Updated weights for policy 0, policy_version 1567680 (0.0010) [2023-12-26 12:06:44,653][123091] Updated weights for policy 0, policy_version 1567690 (0.0010) [2023-12-26 12:06:45,232][123090] Updated weights for policy 1, policy_version 1557217 (0.0009) [2023-12-26 12:06:45,300][123090] Updated weights for policy 1, policy_version 1557227 (0.0009) [2023-12-26 12:06:45,364][123090] Updated weights for policy 1, policy_version 1557237 (0.0009) [2023-12-26 12:06:45,424][123090] Updated weights for policy 1, policy_version 1557247 (0.0009) [2023-12-26 12:06:45,504][123091] Updated weights for policy 0, policy_version 1567700 (0.0011) [2023-12-26 12:06:45,563][123091] Updated weights for policy 0, policy_version 1567710 (0.0011) [2023-12-26 12:06:45,618][123091] Updated weights for policy 0, policy_version 1567720 (0.0011) [2023-12-26 12:06:46,267][123090] Updated weights for policy 1, policy_version 1557257 (0.0010) [2023-12-26 12:06:46,334][123090] Updated weights for policy 1, policy_version 1557267 (0.0009) [2023-12-26 12:06:46,387][123091] Updated weights for policy 0, policy_version 1567730 (0.0009) [2023-12-26 12:06:46,399][123090] Updated weights for policy 1, policy_version 1557277 (0.0010) [2023-12-26 12:06:46,455][123091] Updated weights for policy 0, policy_version 1567740 (0.0005) [2023-12-26 12:06:46,518][123091] Updated weights for policy 0, policy_version 1567750 (0.0005) [2023-12-26 12:06:46,574][123091] Updated weights for policy 0, policy_version 1567760 (0.0006) [2023-12-26 12:06:47,124][123091] Updated weights for policy 0, policy_version 1567770 (0.0005) [2023-12-26 12:06:47,185][123091] Updated weights for policy 0, policy_version 1567780 (0.0005) [2023-12-26 12:06:47,239][123091] Updated weights for policy 0, policy_version 1567790 (0.0005) [2023-12-26 12:06:47,302][123090] Updated weights for policy 1, policy_version 1557287 (0.0010) [2023-12-26 12:06:47,362][123090] Updated weights for policy 1, policy_version 1557297 (0.0008) [2023-12-26 12:06:47,425][123090] Updated weights for policy 1, policy_version 1557307 (0.0010) [2023-12-26 12:06:47,891][123091] Updated weights for policy 0, policy_version 1567800 (0.0006) [2023-12-26 12:06:47,935][123091] Updated weights for policy 0, policy_version 1567810 (0.0005) [2023-12-26 12:06:47,991][123091] Updated weights for policy 0, policy_version 1567820 (0.0005) [2023-12-26 12:06:48,183][123090] Updated weights for policy 1, policy_version 1557317 (0.0007) [2023-12-26 12:06:48,244][123090] Updated weights for policy 1, policy_version 1557327 (0.0005) [2023-12-26 12:06:48,306][123090] Updated weights for policy 1, policy_version 1557337 (0.0009) [2023-12-26 12:06:48,693][123091] Updated weights for policy 0, policy_version 1567830 (0.0005) [2023-12-26 12:06:48,757][123091] Updated weights for policy 0, policy_version 1567840 (0.0008) [2023-12-26 12:06:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 800047104. Throughput: 0: 8811.5, 1: 8858.3. Samples: 800062332. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:48,785][121949] Avg episode reward: [(0, '6234.620'), (1, '5905.748')] [2023-12-26 12:06:48,807][123091] Updated weights for policy 0, policy_version 1567850 (0.0009) [2023-12-26 12:06:49,153][123090] Updated weights for policy 1, policy_version 1557347 (0.0009) [2023-12-26 12:06:49,220][123090] Updated weights for policy 1, policy_version 1557357 (0.0009) [2023-12-26 12:06:49,277][123090] Updated weights for policy 1, policy_version 1557367 (0.0010) [2023-12-26 12:06:49,607][123091] Updated weights for policy 0, policy_version 1567860 (0.0009) [2023-12-26 12:06:49,671][123091] Updated weights for policy 0, policy_version 1567870 (0.0009) [2023-12-26 12:06:49,730][123091] Updated weights for policy 0, policy_version 1567880 (0.0010) [2023-12-26 12:06:50,116][123090] Updated weights for policy 1, policy_version 1557377 (0.0010) [2023-12-26 12:06:50,179][123090] Updated weights for policy 1, policy_version 1557387 (0.0009) [2023-12-26 12:06:50,240][123090] Updated weights for policy 1, policy_version 1557397 (0.0009) [2023-12-26 12:06:50,294][123090] Updated weights for policy 1, policy_version 1557407 (0.0010) [2023-12-26 12:06:50,562][123091] Updated weights for policy 0, policy_version 1567890 (0.0010) [2023-12-26 12:06:50,622][123091] Updated weights for policy 0, policy_version 1567900 (0.0010) [2023-12-26 12:06:50,684][123091] Updated weights for policy 0, policy_version 1567910 (0.0006) [2023-12-26 12:06:50,758][123091] Updated weights for policy 0, policy_version 1567920 (0.0008) [2023-12-26 12:06:51,149][123090] Updated weights for policy 1, policy_version 1557417 (0.0009) [2023-12-26 12:06:51,215][123090] Updated weights for policy 1, policy_version 1557427 (0.0011) [2023-12-26 12:06:51,287][123090] Updated weights for policy 1, policy_version 1557437 (0.0008) [2023-12-26 12:06:51,553][123091] Updated weights for policy 0, policy_version 1567930 (0.0011) [2023-12-26 12:06:51,622][123091] Updated weights for policy 0, policy_version 1567940 (0.0009) [2023-12-26 12:06:51,689][123091] Updated weights for policy 0, policy_version 1567950 (0.0009) [2023-12-26 12:06:52,094][123090] Updated weights for policy 1, policy_version 1557447 (0.0006) [2023-12-26 12:06:52,161][123090] Updated weights for policy 1, policy_version 1557457 (0.0006) [2023-12-26 12:06:52,234][123090] Updated weights for policy 1, policy_version 1557467 (0.0006) [2023-12-26 12:06:52,536][123091] Updated weights for policy 0, policy_version 1567960 (0.0010) [2023-12-26 12:06:52,605][123091] Updated weights for policy 0, policy_version 1567970 (0.0009) [2023-12-26 12:06:52,671][123091] Updated weights for policy 0, policy_version 1567981 (0.0010) [2023-12-26 12:06:53,014][123090] Updated weights for policy 1, policy_version 1557477 (0.0008) [2023-12-26 12:06:53,083][123090] Updated weights for policy 1, policy_version 1557487 (0.0007) [2023-12-26 12:06:53,156][123090] Updated weights for policy 1, policy_version 1557497 (0.0005) [2023-12-26 12:06:53,402][123091] Updated weights for policy 0, policy_version 1567991 (0.0010) [2023-12-26 12:06:53,464][123091] Updated weights for policy 0, policy_version 1568001 (0.0010) [2023-12-26 12:06:53,525][123091] Updated weights for policy 0, policy_version 1568011 (0.0009) [2023-12-26 12:06:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 800137216. Throughput: 0: 8808.2, 1: 8835.0. Samples: 800113300. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:53,785][121949] Avg episode reward: [(0, '6134.781'), (1, '6008.178')] [2023-12-26 12:06:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001557504_398721024.pth... [2023-12-26 12:06:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001568016_401416192.pth... [2023-12-26 12:06:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001556480_398458880.pth [2023-12-26 12:06:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001566992_401154048.pth [2023-12-26 12:06:53,886][123090] Updated weights for policy 1, policy_version 1557507 (0.0007) [2023-12-26 12:06:53,933][123090] Updated weights for policy 1, policy_version 1557517 (0.0010) [2023-12-26 12:06:53,988][123090] Updated weights for policy 1, policy_version 1557527 (0.0010) [2023-12-26 12:06:54,223][123091] Updated weights for policy 0, policy_version 1568021 (0.0008) [2023-12-26 12:06:54,279][123091] Updated weights for policy 0, policy_version 1568031 (0.0009) [2023-12-26 12:06:54,331][123091] Updated weights for policy 0, policy_version 1568041 (0.0008) [2023-12-26 12:06:54,779][123090] Updated weights for policy 1, policy_version 1557537 (0.0010) [2023-12-26 12:06:54,829][123090] Updated weights for policy 1, policy_version 1557547 (0.0005) [2023-12-26 12:06:54,881][123090] Updated weights for policy 1, policy_version 1557557 (0.0005) [2023-12-26 12:06:54,958][123090] Updated weights for policy 1, policy_version 1557567 (0.0006) [2023-12-26 12:06:55,244][123091] Updated weights for policy 0, policy_version 1568051 (0.0009) [2023-12-26 12:06:55,316][123091] Updated weights for policy 0, policy_version 1568061 (0.0009) [2023-12-26 12:06:55,380][123091] Updated weights for policy 0, policy_version 1568071 (0.0010) [2023-12-26 12:06:55,597][123090] Updated weights for policy 1, policy_version 1557577 (0.0008) [2023-12-26 12:06:55,645][123090] Updated weights for policy 1, policy_version 1557587 (0.0009) [2023-12-26 12:06:55,702][123090] Updated weights for policy 1, policy_version 1557597 (0.0009) [2023-12-26 12:06:56,263][123091] Updated weights for policy 0, policy_version 1568081 (0.0009) [2023-12-26 12:06:56,319][123091] Updated weights for policy 0, policy_version 1568091 (0.0009) [2023-12-26 12:06:56,376][123091] Updated weights for policy 0, policy_version 1568101 (0.0009) [2023-12-26 12:06:56,393][123090] Updated weights for policy 1, policy_version 1557607 (0.0008) [2023-12-26 12:06:56,431][123091] Updated weights for policy 0, policy_version 1568111 (0.0009) [2023-12-26 12:06:56,455][123090] Updated weights for policy 1, policy_version 1557617 (0.0008) [2023-12-26 12:06:56,519][123090] Updated weights for policy 1, policy_version 1557627 (0.0007) [2023-12-26 12:06:57,092][123090] Updated weights for policy 1, policy_version 1557637 (0.0008) [2023-12-26 12:06:57,155][123090] Updated weights for policy 1, policy_version 1557647 (0.0005) [2023-12-26 12:06:57,211][123090] Updated weights for policy 1, policy_version 1557657 (0.0005) [2023-12-26 12:06:57,317][123091] Updated weights for policy 0, policy_version 1568121 (0.0007) [2023-12-26 12:06:57,378][123091] Updated weights for policy 0, policy_version 1568131 (0.0009) [2023-12-26 12:06:57,437][123091] Updated weights for policy 0, policy_version 1568141 (0.0008) [2023-12-26 12:06:57,944][123090] Updated weights for policy 1, policy_version 1557667 (0.0005) [2023-12-26 12:06:57,998][123090] Updated weights for policy 1, policy_version 1557677 (0.0005) [2023-12-26 12:06:58,070][123090] Updated weights for policy 1, policy_version 1557687 (0.0008) [2023-12-26 12:06:58,311][123091] Updated weights for policy 0, policy_version 1568151 (0.0009) [2023-12-26 12:06:58,391][123091] Updated weights for policy 0, policy_version 1568161 (0.0009) [2023-12-26 12:06:58,463][123091] Updated weights for policy 0, policy_version 1568171 (0.0009) [2023-12-26 12:06:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 800227328. Throughput: 0: 8815.9, 1: 8910.4. Samples: 800221756. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:06:58,785][121949] Avg episode reward: [(0, '6214.543'), (1, '6054.411')] [2023-12-26 12:06:59,025][123090] Updated weights for policy 1, policy_version 1557697 (0.0009) [2023-12-26 12:06:59,090][123090] Updated weights for policy 1, policy_version 1557707 (0.0009) [2023-12-26 12:06:59,154][123090] Updated weights for policy 1, policy_version 1557717 (0.0009) [2023-12-26 12:06:59,219][123090] Updated weights for policy 1, policy_version 1557727 (0.0009) [2023-12-26 12:06:59,316][123091] Updated weights for policy 0, policy_version 1568181 (0.0008) [2023-12-26 12:06:59,382][123091] Updated weights for policy 0, policy_version 1568191 (0.0008) [2023-12-26 12:06:59,453][123091] Updated weights for policy 0, policy_version 1568201 (0.0009) [2023-12-26 12:07:00,044][123090] Updated weights for policy 1, policy_version 1557737 (0.0010) [2023-12-26 12:07:00,114][123090] Updated weights for policy 1, policy_version 1557747 (0.0010) [2023-12-26 12:07:00,169][123090] Updated weights for policy 1, policy_version 1557757 (0.0008) [2023-12-26 12:07:00,236][123091] Updated weights for policy 0, policy_version 1568211 (0.0008) [2023-12-26 12:07:00,298][123091] Updated weights for policy 0, policy_version 1568221 (0.0008) [2023-12-26 12:07:00,355][123091] Updated weights for policy 0, policy_version 1568231 (0.0010) [2023-12-26 12:07:00,982][123090] Updated weights for policy 1, policy_version 1557767 (0.0009) [2023-12-26 12:07:01,048][123090] Updated weights for policy 1, policy_version 1557777 (0.0010) [2023-12-26 12:07:01,115][123090] Updated weights for policy 1, policy_version 1557787 (0.0008) [2023-12-26 12:07:01,198][123091] Updated weights for policy 0, policy_version 1568241 (0.0010) [2023-12-26 12:07:01,278][123091] Updated weights for policy 0, policy_version 1568251 (0.0006) [2023-12-26 12:07:01,352][123091] Updated weights for policy 0, policy_version 1568261 (0.0006) [2023-12-26 12:07:01,425][123091] Updated weights for policy 0, policy_version 1568271 (0.0007) [2023-12-26 12:07:01,945][123090] Updated weights for policy 1, policy_version 1557797 (0.0009) [2023-12-26 12:07:02,018][123090] Updated weights for policy 1, policy_version 1557807 (0.0008) [2023-12-26 12:07:02,079][123090] Updated weights for policy 1, policy_version 1557817 (0.0008) [2023-12-26 12:07:02,090][123091] Updated weights for policy 0, policy_version 1568281 (0.0006) [2023-12-26 12:07:02,154][123091] Updated weights for policy 0, policy_version 1568291 (0.0007) [2023-12-26 12:07:02,233][123091] Updated weights for policy 0, policy_version 1568301 (0.0010) [2023-12-26 12:07:02,797][123090] Updated weights for policy 1, policy_version 1557827 (0.0009) [2023-12-26 12:07:02,856][123090] Updated weights for policy 1, policy_version 1557837 (0.0010) [2023-12-26 12:07:02,920][123090] Updated weights for policy 1, policy_version 1557847 (0.0011) [2023-12-26 12:07:02,977][123091] Updated weights for policy 0, policy_version 1568311 (0.0010) [2023-12-26 12:07:03,036][123091] Updated weights for policy 0, policy_version 1568321 (0.0011) [2023-12-26 12:07:03,095][123091] Updated weights for policy 0, policy_version 1568331 (0.0011) [2023-12-26 12:07:03,710][123090] Updated weights for policy 1, policy_version 1557857 (0.0011) [2023-12-26 12:07:03,757][123090] Updated weights for policy 1, policy_version 1557867 (0.0008) [2023-12-26 12:07:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 800309248. Throughput: 0: 8698.9, 1: 8807.8. Samples: 800324796. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:03,784][121949] Avg episode reward: [(0, '6288.968'), (1, '5968.844')] [2023-12-26 12:07:03,811][123090] Updated weights for policy 1, policy_version 1557877 (0.0009) [2023-12-26 12:07:03,879][123090] Updated weights for policy 1, policy_version 1557888 (0.0011) [2023-12-26 12:07:03,935][123091] Updated weights for policy 0, policy_version 1568341 (0.0009) [2023-12-26 12:07:03,987][123091] Updated weights for policy 0, policy_version 1568351 (0.0008) [2023-12-26 12:07:04,038][123091] Updated weights for policy 0, policy_version 1568361 (0.0007) [2023-12-26 12:07:04,740][123090] Updated weights for policy 1, policy_version 1557898 (0.0009) [2023-12-26 12:07:04,800][123091] Updated weights for policy 0, policy_version 1568371 (0.0009) [2023-12-26 12:07:04,812][123090] Updated weights for policy 1, policy_version 1557908 (0.0008) [2023-12-26 12:07:04,866][123091] Updated weights for policy 0, policy_version 1568381 (0.0011) [2023-12-26 12:07:04,878][123090] Updated weights for policy 1, policy_version 1557918 (0.0009) [2023-12-26 12:07:04,920][123091] Updated weights for policy 0, policy_version 1568391 (0.0010) [2023-12-26 12:07:05,660][123090] Updated weights for policy 1, policy_version 1557928 (0.0009) [2023-12-26 12:07:05,711][123090] Updated weights for policy 1, policy_version 1557938 (0.0009) [2023-12-26 12:07:05,740][123091] Updated weights for policy 0, policy_version 1568401 (0.0010) [2023-12-26 12:07:05,768][123090] Updated weights for policy 1, policy_version 1557948 (0.0008) [2023-12-26 12:07:05,797][123091] Updated weights for policy 0, policy_version 1568411 (0.0007) [2023-12-26 12:07:05,860][123091] Updated weights for policy 0, policy_version 1568421 (0.0009) [2023-12-26 12:07:05,917][123091] Updated weights for policy 0, policy_version 1568431 (0.0008) [2023-12-26 12:07:06,618][123090] Updated weights for policy 1, policy_version 1557958 (0.0009) [2023-12-26 12:07:06,683][123090] Updated weights for policy 1, policy_version 1557968 (0.0009) [2023-12-26 12:07:06,750][123090] Updated weights for policy 1, policy_version 1557978 (0.0009) [2023-12-26 12:07:06,767][123091] Updated weights for policy 0, policy_version 1568441 (0.0008) [2023-12-26 12:07:06,837][123091] Updated weights for policy 0, policy_version 1568451 (0.0006) [2023-12-26 12:07:06,905][123091] Updated weights for policy 0, policy_version 1568461 (0.0006) [2023-12-26 12:07:07,640][123090] Updated weights for policy 1, policy_version 1557988 (0.0009) [2023-12-26 12:07:07,669][123091] Updated weights for policy 0, policy_version 1568471 (0.0007) [2023-12-26 12:07:07,701][123090] Updated weights for policy 1, policy_version 1557998 (0.0009) [2023-12-26 12:07:07,726][123091] Updated weights for policy 0, policy_version 1568481 (0.0006) [2023-12-26 12:07:07,763][123090] Updated weights for policy 1, policy_version 1558008 (0.0007) [2023-12-26 12:07:07,797][123091] Updated weights for policy 0, policy_version 1568491 (0.0009) [2023-12-26 12:07:08,553][123090] Updated weights for policy 1, policy_version 1558018 (0.0007) [2023-12-26 12:07:08,613][123091] Updated weights for policy 0, policy_version 1568501 (0.0009) [2023-12-26 12:07:08,619][123090] Updated weights for policy 1, policy_version 1558028 (0.0006) [2023-12-26 12:07:08,679][123091] Updated weights for policy 0, policy_version 1568511 (0.0007) [2023-12-26 12:07:08,685][123090] Updated weights for policy 1, policy_version 1558038 (0.0006) [2023-12-26 12:07:08,740][123091] Updated weights for policy 0, policy_version 1568521 (0.0006) [2023-12-26 12:07:08,748][123090] Updated weights for policy 1, policy_version 1558048 (0.0009) [2023-12-26 12:07:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 800399360. Throughput: 0: 8687.3, 1: 8824.8. Samples: 800376800. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:08,785][121949] Avg episode reward: [(0, '6285.969'), (1, '6022.785')] [2023-12-26 12:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001558048_398860288.pth... [2023-12-26 12:07:08,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001568528_401547264.pth... [2023-12-26 12:07:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001557024_398598144.pth [2023-12-26 12:07:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001567504_401285120.pth [2023-12-26 12:07:09,512][123091] Updated weights for policy 0, policy_version 1568531 (0.0007) [2023-12-26 12:07:09,577][123090] Updated weights for policy 1, policy_version 1558058 (0.0007) [2023-12-26 12:07:09,579][123091] Updated weights for policy 0, policy_version 1568541 (0.0010) [2023-12-26 12:07:09,641][123090] Updated weights for policy 1, policy_version 1558068 (0.0008) [2023-12-26 12:07:09,643][123091] Updated weights for policy 0, policy_version 1568551 (0.0007) [2023-12-26 12:07:09,703][123090] Updated weights for policy 1, policy_version 1558078 (0.0008) [2023-12-26 12:07:10,429][123091] Updated weights for policy 0, policy_version 1568561 (0.0010) [2023-12-26 12:07:10,487][123091] Updated weights for policy 0, policy_version 1568571 (0.0007) [2023-12-26 12:07:10,523][123090] Updated weights for policy 1, policy_version 1558088 (0.0006) [2023-12-26 12:07:10,553][123091] Updated weights for policy 0, policy_version 1568581 (0.0007) [2023-12-26 12:07:10,596][123090] Updated weights for policy 1, policy_version 1558098 (0.0008) [2023-12-26 12:07:10,616][123091] Updated weights for policy 0, policy_version 1568591 (0.0006) [2023-12-26 12:07:10,660][123090] Updated weights for policy 1, policy_version 1558108 (0.0010) [2023-12-26 12:07:11,357][123090] Updated weights for policy 1, policy_version 1558118 (0.0007) [2023-12-26 12:07:11,383][123091] Updated weights for policy 0, policy_version 1568601 (0.0009) [2023-12-26 12:07:11,434][123090] Updated weights for policy 1, policy_version 1558128 (0.0011) [2023-12-26 12:07:11,454][123091] Updated weights for policy 0, policy_version 1568611 (0.0007) [2023-12-26 12:07:11,502][123090] Updated weights for policy 1, policy_version 1558138 (0.0011) [2023-12-26 12:07:11,524][123091] Updated weights for policy 0, policy_version 1568621 (0.0008) [2023-12-26 12:07:12,312][123091] Updated weights for policy 0, policy_version 1568631 (0.0007) [2023-12-26 12:07:12,318][123090] Updated weights for policy 1, policy_version 1558148 (0.0009) [2023-12-26 12:07:12,384][123091] Updated weights for policy 0, policy_version 1568641 (0.0008) [2023-12-26 12:07:12,392][123090] Updated weights for policy 1, policy_version 1558158 (0.0010) [2023-12-26 12:07:12,451][123091] Updated weights for policy 0, policy_version 1568651 (0.0006) [2023-12-26 12:07:12,452][123090] Updated weights for policy 1, policy_version 1558168 (0.0011) [2023-12-26 12:07:13,273][123090] Updated weights for policy 1, policy_version 1558178 (0.0011) [2023-12-26 12:07:13,297][123091] Updated weights for policy 0, policy_version 1568661 (0.0006) [2023-12-26 12:07:13,339][123090] Updated weights for policy 1, policy_version 1558188 (0.0010) [2023-12-26 12:07:13,346][123091] Updated weights for policy 0, policy_version 1568671 (0.0009) [2023-12-26 12:07:13,402][123090] Updated weights for policy 1, policy_version 1558198 (0.0010) [2023-12-26 12:07:13,403][123091] Updated weights for policy 0, policy_version 1568681 (0.0009) [2023-12-26 12:07:13,469][123090] Updated weights for policy 1, policy_version 1558208 (0.0011) [2023-12-26 12:07:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 800489472. Throughput: 0: 8741.5, 1: 8774.5. Samples: 800481696. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:13,785][121949] Avg episode reward: [(0, '6146.024'), (1, '5972.284')] [2023-12-26 12:07:14,228][123091] Updated weights for policy 0, policy_version 1568691 (0.0009) [2023-12-26 12:07:14,252][123090] Updated weights for policy 1, policy_version 1558218 (0.0010) [2023-12-26 12:07:14,279][123091] Updated weights for policy 0, policy_version 1568701 (0.0006) [2023-12-26 12:07:14,313][123090] Updated weights for policy 1, policy_version 1558228 (0.0010) [2023-12-26 12:07:14,328][123091] Updated weights for policy 0, policy_version 1568711 (0.0007) [2023-12-26 12:07:14,383][123090] Updated weights for policy 1, policy_version 1558238 (0.0010) [2023-12-26 12:07:15,079][123091] Updated weights for policy 0, policy_version 1568721 (0.0008) [2023-12-26 12:07:15,178][123091] Updated weights for policy 0, policy_version 1568731 (0.0008) [2023-12-26 12:07:15,217][123090] Updated weights for policy 1, policy_version 1558248 (0.0007) [2023-12-26 12:07:15,245][123091] Updated weights for policy 0, policy_version 1568741 (0.0009) [2023-12-26 12:07:15,280][123090] Updated weights for policy 1, policy_version 1558258 (0.0005) [2023-12-26 12:07:15,307][123091] Updated weights for policy 0, policy_version 1568751 (0.0008) [2023-12-26 12:07:15,342][123090] Updated weights for policy 1, policy_version 1558268 (0.0006) [2023-12-26 12:07:16,020][123090] Updated weights for policy 1, policy_version 1558278 (0.0005) [2023-12-26 12:07:16,088][123090] Updated weights for policy 1, policy_version 1558288 (0.0005) [2023-12-26 12:07:16,111][123091] Updated weights for policy 0, policy_version 1568761 (0.0009) [2023-12-26 12:07:16,141][123090] Updated weights for policy 1, policy_version 1558298 (0.0005) [2023-12-26 12:07:16,170][123091] Updated weights for policy 0, policy_version 1568771 (0.0009) [2023-12-26 12:07:16,235][123091] Updated weights for policy 0, policy_version 1568781 (0.0009) [2023-12-26 12:07:16,903][123090] Updated weights for policy 1, policy_version 1558308 (0.0009) [2023-12-26 12:07:16,961][123090] Updated weights for policy 1, policy_version 1558318 (0.0010) [2023-12-26 12:07:17,016][123090] Updated weights for policy 1, policy_version 1558328 (0.0010) [2023-12-26 12:07:17,022][123091] Updated weights for policy 0, policy_version 1568791 (0.0008) [2023-12-26 12:07:17,079][123091] Updated weights for policy 0, policy_version 1568801 (0.0006) [2023-12-26 12:07:17,126][123091] Updated weights for policy 0, policy_version 1568811 (0.0009) [2023-12-26 12:07:17,742][123090] Updated weights for policy 1, policy_version 1558338 (0.0010) [2023-12-26 12:07:17,800][123090] Updated weights for policy 1, policy_version 1558348 (0.0008) [2023-12-26 12:07:17,865][123090] Updated weights for policy 1, policy_version 1558358 (0.0005) [2023-12-26 12:07:17,934][123090] Updated weights for policy 1, policy_version 1558368 (0.0005) [2023-12-26 12:07:18,000][123091] Updated weights for policy 0, policy_version 1568821 (0.0009) [2023-12-26 12:07:18,054][123091] Updated weights for policy 0, policy_version 1568831 (0.0009) [2023-12-26 12:07:18,106][123091] Updated weights for policy 0, policy_version 1568841 (0.0009) [2023-12-26 12:07:18,667][123090] Updated weights for policy 1, policy_version 1558378 (0.0009) [2023-12-26 12:07:18,719][123090] Updated weights for policy 1, policy_version 1558388 (0.0005) [2023-12-26 12:07:18,773][123090] Updated weights for policy 1, policy_version 1558398 (0.0005) [2023-12-26 12:07:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 800579584. Throughput: 0: 8770.8, 1: 8838.0. Samples: 800588936. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:18,785][121949] Avg episode reward: [(0, '6082.165'), (1, '5968.718')] [2023-12-26 12:07:18,944][123091] Updated weights for policy 0, policy_version 1568851 (0.0008) [2023-12-26 12:07:19,025][123091] Updated weights for policy 0, policy_version 1568861 (0.0006) [2023-12-26 12:07:19,101][123091] Updated weights for policy 0, policy_version 1568871 (0.0008) [2023-12-26 12:07:19,493][123090] Updated weights for policy 1, policy_version 1558408 (0.0009) [2023-12-26 12:07:19,561][123090] Updated weights for policy 1, policy_version 1558418 (0.0010) [2023-12-26 12:07:19,631][123090] Updated weights for policy 1, policy_version 1558428 (0.0011) [2023-12-26 12:07:19,849][123091] Updated weights for policy 0, policy_version 1568881 (0.0006) [2023-12-26 12:07:19,914][123091] Updated weights for policy 0, policy_version 1568891 (0.0011) [2023-12-26 12:07:19,978][123091] Updated weights for policy 0, policy_version 1568901 (0.0011) [2023-12-26 12:07:20,042][123091] Updated weights for policy 0, policy_version 1568911 (0.0008) [2023-12-26 12:07:20,367][123090] Updated weights for policy 1, policy_version 1558438 (0.0009) [2023-12-26 12:07:20,441][123090] Updated weights for policy 1, policy_version 1558448 (0.0008) [2023-12-26 12:07:20,514][123090] Updated weights for policy 1, policy_version 1558458 (0.0008) [2023-12-26 12:07:20,795][123091] Updated weights for policy 0, policy_version 1568921 (0.0010) [2023-12-26 12:07:20,863][123091] Updated weights for policy 0, policy_version 1568931 (0.0011) [2023-12-26 12:07:20,934][123091] Updated weights for policy 0, policy_version 1568941 (0.0011) [2023-12-26 12:07:21,258][123090] Updated weights for policy 1, policy_version 1558468 (0.0008) [2023-12-26 12:07:21,326][123090] Updated weights for policy 1, policy_version 1558478 (0.0010) [2023-12-26 12:07:21,399][123090] Updated weights for policy 1, policy_version 1558488 (0.0009) [2023-12-26 12:07:21,735][123091] Updated weights for policy 0, policy_version 1568951 (0.0009) [2023-12-26 12:07:21,803][123091] Updated weights for policy 0, policy_version 1568961 (0.0009) [2023-12-26 12:07:21,867][123091] Updated weights for policy 0, policy_version 1568971 (0.0009) [2023-12-26 12:07:22,130][123090] Updated weights for policy 1, policy_version 1558498 (0.0007) [2023-12-26 12:07:22,183][123090] Updated weights for policy 1, policy_version 1558508 (0.0009) [2023-12-26 12:07:22,235][123090] Updated weights for policy 1, policy_version 1558518 (0.0009) [2023-12-26 12:07:22,304][123090] Updated weights for policy 1, policy_version 1558528 (0.0009) [2023-12-26 12:07:22,721][123091] Updated weights for policy 0, policy_version 1568981 (0.0010) [2023-12-26 12:07:22,771][123091] Updated weights for policy 0, policy_version 1568991 (0.0009) [2023-12-26 12:07:22,834][123091] Updated weights for policy 0, policy_version 1569001 (0.0010) [2023-12-26 12:07:23,153][123090] Updated weights for policy 1, policy_version 1558538 (0.0009) [2023-12-26 12:07:23,206][123090] Updated weights for policy 1, policy_version 1558548 (0.0009) [2023-12-26 12:07:23,270][123090] Updated weights for policy 1, policy_version 1558558 (0.0008) [2023-12-26 12:07:23,738][123091] Updated weights for policy 0, policy_version 1569011 (0.0010) [2023-12-26 12:07:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 800661504. Throughput: 0: 8783.2, 1: 8851.8. Samples: 800643532. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:23,785][121949] Avg episode reward: [(0, '6171.196'), (1, '5991.986')] [2023-12-26 12:07:23,788][123091] Updated weights for policy 0, policy_version 1569021 (0.0010) [2023-12-26 12:07:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001558560_398991360.pth... [2023-12-26 12:07:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001557504_398721024.pth [2023-12-26 12:07:23,839][123091] Updated weights for policy 0, policy_version 1569032 (0.0011) [2023-12-26 12:07:23,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001569040_401678336.pth... [2023-12-26 12:07:23,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001568016_401416192.pth [2023-12-26 12:07:24,031][123090] Updated weights for policy 1, policy_version 1558568 (0.0005) [2023-12-26 12:07:24,096][123090] Updated weights for policy 1, policy_version 1558578 (0.0005) [2023-12-26 12:07:24,169][123090] Updated weights for policy 1, policy_version 1558588 (0.0010) [2023-12-26 12:07:24,711][123091] Updated weights for policy 0, policy_version 1569042 (0.0009) [2023-12-26 12:07:24,764][123091] Updated weights for policy 0, policy_version 1569052 (0.0009) [2023-12-26 12:07:24,809][123091] Updated weights for policy 0, policy_version 1569062 (0.0009) [2023-12-26 12:07:24,857][123091] Updated weights for policy 0, policy_version 1569072 (0.0009) [2023-12-26 12:07:24,870][123090] Updated weights for policy 1, policy_version 1558598 (0.0008) [2023-12-26 12:07:24,919][123090] Updated weights for policy 1, policy_version 1558608 (0.0009) [2023-12-26 12:07:24,970][123090] Updated weights for policy 1, policy_version 1558619 (0.0011) [2023-12-26 12:07:25,660][123090] Updated weights for policy 1, policy_version 1558629 (0.0010) [2023-12-26 12:07:25,722][123090] Updated weights for policy 1, policy_version 1558639 (0.0010) [2023-12-26 12:07:25,759][123091] Updated weights for policy 0, policy_version 1569082 (0.0008) [2023-12-26 12:07:25,770][123090] Updated weights for policy 1, policy_version 1558649 (0.0010) [2023-12-26 12:07:25,819][123091] Updated weights for policy 0, policy_version 1569092 (0.0007) [2023-12-26 12:07:25,890][123091] Updated weights for policy 0, policy_version 1569102 (0.0009) [2023-12-26 12:07:26,588][123090] Updated weights for policy 1, policy_version 1558659 (0.0010) [2023-12-26 12:07:26,606][123091] Updated weights for policy 0, policy_version 1569112 (0.0006) [2023-12-26 12:07:26,647][123090] Updated weights for policy 1, policy_version 1558669 (0.0010) [2023-12-26 12:07:26,670][123091] Updated weights for policy 0, policy_version 1569122 (0.0008) [2023-12-26 12:07:26,702][123090] Updated weights for policy 1, policy_version 1558679 (0.0010) [2023-12-26 12:07:26,728][123091] Updated weights for policy 0, policy_version 1569132 (0.0010) [2023-12-26 12:07:27,288][123091] Updated weights for policy 0, policy_version 1569142 (0.0008) [2023-12-26 12:07:27,346][123091] Updated weights for policy 0, policy_version 1569152 (0.0006) [2023-12-26 12:07:27,403][123091] Updated weights for policy 0, policy_version 1569162 (0.0005) [2023-12-26 12:07:27,536][123090] Updated weights for policy 1, policy_version 1558689 (0.0010) [2023-12-26 12:07:27,599][123090] Updated weights for policy 1, policy_version 1558699 (0.0011) [2023-12-26 12:07:27,653][123090] Updated weights for policy 1, policy_version 1558709 (0.0010) [2023-12-26 12:07:27,700][123090] Updated weights for policy 1, policy_version 1558719 (0.0010) [2023-12-26 12:07:28,112][123091] Updated weights for policy 0, policy_version 1569172 (0.0007) [2023-12-26 12:07:28,171][123091] Updated weights for policy 0, policy_version 1569182 (0.0010) [2023-12-26 12:07:28,226][123091] Updated weights for policy 0, policy_version 1569192 (0.0006) [2023-12-26 12:07:28,539][123090] Updated weights for policy 1, policy_version 1558729 (0.0006) [2023-12-26 12:07:28,608][123090] Updated weights for policy 1, policy_version 1558739 (0.0007) [2023-12-26 12:07:28,674][123090] Updated weights for policy 1, policy_version 1558749 (0.0005) [2023-12-26 12:07:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 800759808. Throughput: 0: 8806.9, 1: 8894.0. Samples: 800750276. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:28,784][121949] Avg episode reward: [(0, '6242.711'), (1, '5871.953')] [2023-12-26 12:07:28,979][123091] Updated weights for policy 0, policy_version 1569202 (0.0005) [2023-12-26 12:07:29,033][123091] Updated weights for policy 0, policy_version 1569212 (0.0005) [2023-12-26 12:07:29,101][123091] Updated weights for policy 0, policy_version 1569222 (0.0005) [2023-12-26 12:07:29,174][123091] Updated weights for policy 0, policy_version 1569232 (0.0005) [2023-12-26 12:07:29,493][123090] Updated weights for policy 1, policy_version 1558759 (0.0010) [2023-12-26 12:07:29,563][123090] Updated weights for policy 1, policy_version 1558769 (0.0010) [2023-12-26 12:07:29,618][123090] Updated weights for policy 1, policy_version 1558779 (0.0010) [2023-12-26 12:07:29,869][123091] Updated weights for policy 0, policy_version 1569242 (0.0010) [2023-12-26 12:07:29,940][123091] Updated weights for policy 0, policy_version 1569252 (0.0011) [2023-12-26 12:07:30,011][123091] Updated weights for policy 0, policy_version 1569262 (0.0010) [2023-12-26 12:07:30,436][123090] Updated weights for policy 1, policy_version 1558789 (0.0009) [2023-12-26 12:07:30,499][123090] Updated weights for policy 1, policy_version 1558799 (0.0008) [2023-12-26 12:07:30,564][123090] Updated weights for policy 1, policy_version 1558809 (0.0008) [2023-12-26 12:07:30,756][123091] Updated weights for policy 0, policy_version 1569272 (0.0006) [2023-12-26 12:07:30,803][123091] Updated weights for policy 0, policy_version 1569282 (0.0005) [2023-12-26 12:07:30,852][123091] Updated weights for policy 0, policy_version 1569292 (0.0005) [2023-12-26 12:07:31,284][123090] Updated weights for policy 1, policy_version 1558819 (0.0009) [2023-12-26 12:07:31,359][123090] Updated weights for policy 1, policy_version 1558829 (0.0011) [2023-12-26 12:07:31,426][123090] Updated weights for policy 1, policy_version 1558839 (0.0011) [2023-12-26 12:07:31,640][123091] Updated weights for policy 0, policy_version 1569302 (0.0009) [2023-12-26 12:07:31,707][123091] Updated weights for policy 0, policy_version 1569312 (0.0006) [2023-12-26 12:07:31,774][123091] Updated weights for policy 0, policy_version 1569322 (0.0008) [2023-12-26 12:07:32,215][123090] Updated weights for policy 1, policy_version 1558849 (0.0010) [2023-12-26 12:07:32,283][123090] Updated weights for policy 1, policy_version 1558859 (0.0009) [2023-12-26 12:07:32,349][123090] Updated weights for policy 1, policy_version 1558869 (0.0009) [2023-12-26 12:07:32,412][123090] Updated weights for policy 1, policy_version 1558879 (0.0008) [2023-12-26 12:07:32,551][123091] Updated weights for policy 0, policy_version 1569332 (0.0009) [2023-12-26 12:07:32,614][123091] Updated weights for policy 0, policy_version 1569342 (0.0007) [2023-12-26 12:07:32,681][123091] Updated weights for policy 0, policy_version 1569352 (0.0008) [2023-12-26 12:07:33,120][123090] Updated weights for policy 1, policy_version 1558889 (0.0006) [2023-12-26 12:07:33,170][123090] Updated weights for policy 1, policy_version 1558899 (0.0005) [2023-12-26 12:07:33,232][123090] Updated weights for policy 1, policy_version 1558909 (0.0006) [2023-12-26 12:07:33,398][123091] Updated weights for policy 0, policy_version 1569362 (0.0009) [2023-12-26 12:07:33,449][123091] Updated weights for policy 0, policy_version 1569372 (0.0010) [2023-12-26 12:07:33,500][123091] Updated weights for policy 0, policy_version 1569382 (0.0010) [2023-12-26 12:07:33,543][123091] Updated weights for policy 0, policy_version 1569392 (0.0010) [2023-12-26 12:07:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 800849920. Throughput: 0: 8796.2, 1: 8927.9. Samples: 800859916. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:33,785][121949] Avg episode reward: [(0, '6072.152'), (1, '5762.604')] [2023-12-26 12:07:33,980][123090] Updated weights for policy 1, policy_version 1558919 (0.0005) [2023-12-26 12:07:34,029][123090] Updated weights for policy 1, policy_version 1558929 (0.0005) [2023-12-26 12:07:34,090][123090] Updated weights for policy 1, policy_version 1558939 (0.0006) [2023-12-26 12:07:34,395][123091] Updated weights for policy 0, policy_version 1569402 (0.0008) [2023-12-26 12:07:34,462][123091] Updated weights for policy 0, policy_version 1569412 (0.0013) [2023-12-26 12:07:34,527][123091] Updated weights for policy 0, policy_version 1569422 (0.0009) [2023-12-26 12:07:34,857][123090] Updated weights for policy 1, policy_version 1558949 (0.0008) [2023-12-26 12:07:34,921][123090] Updated weights for policy 1, policy_version 1558959 (0.0009) [2023-12-26 12:07:34,972][123090] Updated weights for policy 1, policy_version 1558969 (0.0008) [2023-12-26 12:07:35,276][123091] Updated weights for policy 0, policy_version 1569432 (0.0010) [2023-12-26 12:07:35,342][123091] Updated weights for policy 0, policy_version 1569442 (0.0008) [2023-12-26 12:07:35,405][123091] Updated weights for policy 0, policy_version 1569452 (0.0008) [2023-12-26 12:07:35,852][123090] Updated weights for policy 1, policy_version 1558979 (0.0009) [2023-12-26 12:07:35,923][123090] Updated weights for policy 1, policy_version 1558989 (0.0010) [2023-12-26 12:07:35,997][123090] Updated weights for policy 1, policy_version 1558999 (0.0009) [2023-12-26 12:07:36,086][123091] Updated weights for policy 0, policy_version 1569462 (0.0008) [2023-12-26 12:07:36,159][123091] Updated weights for policy 0, policy_version 1569472 (0.0008) [2023-12-26 12:07:36,220][123091] Updated weights for policy 0, policy_version 1569482 (0.0007) [2023-12-26 12:07:36,797][123090] Updated weights for policy 1, policy_version 1559009 (0.0007) [2023-12-26 12:07:36,873][123090] Updated weights for policy 1, policy_version 1559019 (0.0005) [2023-12-26 12:07:36,925][123091] Updated weights for policy 0, policy_version 1569492 (0.0011) [2023-12-26 12:07:36,947][123090] Updated weights for policy 1, policy_version 1559029 (0.0006) [2023-12-26 12:07:36,980][123091] Updated weights for policy 0, policy_version 1569502 (0.0010) [2023-12-26 12:07:37,017][123090] Updated weights for policy 1, policy_version 1559039 (0.0008) [2023-12-26 12:07:37,043][123091] Updated weights for policy 0, policy_version 1569512 (0.0011) [2023-12-26 12:07:37,693][123090] Updated weights for policy 1, policy_version 1559049 (0.0006) [2023-12-26 12:07:37,756][123090] Updated weights for policy 1, policy_version 1559059 (0.0005) [2023-12-26 12:07:37,814][123090] Updated weights for policy 1, policy_version 1559069 (0.0005) [2023-12-26 12:07:37,879][123091] Updated weights for policy 0, policy_version 1569522 (0.0011) [2023-12-26 12:07:37,936][123091] Updated weights for policy 0, policy_version 1569532 (0.0011) [2023-12-26 12:07:37,991][123091] Updated weights for policy 0, policy_version 1569542 (0.0010) [2023-12-26 12:07:38,050][123091] Updated weights for policy 0, policy_version 1569552 (0.0011) [2023-12-26 12:07:38,502][123090] Updated weights for policy 1, policy_version 1559079 (0.0006) [2023-12-26 12:07:38,556][123090] Updated weights for policy 1, policy_version 1559089 (0.0008) [2023-12-26 12:07:38,615][123090] Updated weights for policy 1, policy_version 1559099 (0.0007) [2023-12-26 12:07:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 800940032. Throughput: 0: 8853.5, 1: 8942.0. Samples: 800914092. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:38,785][121949] Avg episode reward: [(0, '6125.054'), (1, '5557.461')] [2023-12-26 12:07:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001559104_399130624.pth... [2023-12-26 12:07:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001569552_401809408.pth... [2023-12-26 12:07:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001558048_398860288.pth [2023-12-26 12:07:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001568528_401547264.pth [2023-12-26 12:07:38,876][123091] Updated weights for policy 0, policy_version 1569562 (0.0005) [2023-12-26 12:07:38,935][123091] Updated weights for policy 0, policy_version 1569572 (0.0005) [2023-12-26 12:07:39,008][123091] Updated weights for policy 0, policy_version 1569582 (0.0006) [2023-12-26 12:07:39,405][123090] Updated weights for policy 1, policy_version 1559109 (0.0008) [2023-12-26 12:07:39,476][123090] Updated weights for policy 1, policy_version 1559119 (0.0008) [2023-12-26 12:07:39,545][123090] Updated weights for policy 1, policy_version 1559129 (0.0008) [2023-12-26 12:07:39,669][123091] Updated weights for policy 0, policy_version 1569592 (0.0005) [2023-12-26 12:07:39,729][123091] Updated weights for policy 0, policy_version 1569602 (0.0006) [2023-12-26 12:07:39,796][123091] Updated weights for policy 0, policy_version 1569612 (0.0009) [2023-12-26 12:07:40,291][123090] Updated weights for policy 1, policy_version 1559139 (0.0007) [2023-12-26 12:07:40,353][123090] Updated weights for policy 1, policy_version 1559149 (0.0005) [2023-12-26 12:07:40,416][123090] Updated weights for policy 1, policy_version 1559159 (0.0009) [2023-12-26 12:07:40,512][123091] Updated weights for policy 0, policy_version 1569622 (0.0006) [2023-12-26 12:07:40,557][123091] Updated weights for policy 0, policy_version 1569632 (0.0005) [2023-12-26 12:07:40,613][123091] Updated weights for policy 0, policy_version 1569642 (0.0005) [2023-12-26 12:07:41,216][123090] Updated weights for policy 1, policy_version 1559169 (0.0011) [2023-12-26 12:07:41,289][123090] Updated weights for policy 1, policy_version 1559179 (0.0011) [2023-12-26 12:07:41,364][123090] Updated weights for policy 1, policy_version 1559189 (0.0011) [2023-12-26 12:07:41,437][123090] Updated weights for policy 1, policy_version 1559199 (0.0011) [2023-12-26 12:07:41,449][123091] Updated weights for policy 0, policy_version 1569652 (0.0006) [2023-12-26 12:07:41,500][123091] Updated weights for policy 0, policy_version 1569662 (0.0009) [2023-12-26 12:07:41,549][123091] Updated weights for policy 0, policy_version 1569672 (0.0009) [2023-12-26 12:07:42,290][123090] Updated weights for policy 1, policy_version 1559209 (0.0011) [2023-12-26 12:07:42,359][123090] Updated weights for policy 1, policy_version 1559219 (0.0010) [2023-12-26 12:07:42,414][123091] Updated weights for policy 0, policy_version 1569682 (0.0008) [2023-12-26 12:07:42,428][123090] Updated weights for policy 1, policy_version 1559229 (0.0011) [2023-12-26 12:07:42,467][123091] Updated weights for policy 0, policy_version 1569692 (0.0009) [2023-12-26 12:07:42,524][123091] Updated weights for policy 0, policy_version 1569702 (0.0009) [2023-12-26 12:07:42,576][123091] Updated weights for policy 0, policy_version 1569712 (0.0009) [2023-12-26 12:07:43,250][123090] Updated weights for policy 1, policy_version 1559239 (0.0011) [2023-12-26 12:07:43,313][123090] Updated weights for policy 1, policy_version 1559249 (0.0010) [2023-12-26 12:07:43,382][123090] Updated weights for policy 1, policy_version 1559259 (0.0010) [2023-12-26 12:07:43,435][123091] Updated weights for policy 0, policy_version 1569722 (0.0008) [2023-12-26 12:07:43,486][123091] Updated weights for policy 0, policy_version 1569732 (0.0008) [2023-12-26 12:07:43,538][123091] Updated weights for policy 0, policy_version 1569742 (0.0009) [2023-12-26 12:07:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 801030144. Throughput: 0: 8898.9, 1: 8878.7. Samples: 801021748. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:43,785][121949] Avg episode reward: [(0, '6200.833'), (1, '5640.540')] [2023-12-26 12:07:44,227][123090] Updated weights for policy 1, policy_version 1559269 (0.0010) [2023-12-26 12:07:44,288][123090] Updated weights for policy 1, policy_version 1559279 (0.0009) [2023-12-26 12:07:44,348][123090] Updated weights for policy 1, policy_version 1559289 (0.0008) [2023-12-26 12:07:44,392][123091] Updated weights for policy 0, policy_version 1569752 (0.0009) [2023-12-26 12:07:44,443][123091] Updated weights for policy 0, policy_version 1569762 (0.0009) [2023-12-26 12:07:44,505][123091] Updated weights for policy 0, policy_version 1569773 (0.0010) [2023-12-26 12:07:45,073][123090] Updated weights for policy 1, policy_version 1559299 (0.0008) [2023-12-26 12:07:45,122][123090] Updated weights for policy 1, policy_version 1559309 (0.0005) [2023-12-26 12:07:45,208][123090] Updated weights for policy 1, policy_version 1559319 (0.0006) [2023-12-26 12:07:45,400][123091] Updated weights for policy 0, policy_version 1569783 (0.0009) [2023-12-26 12:07:45,468][123091] Updated weights for policy 0, policy_version 1569793 (0.0010) [2023-12-26 12:07:45,530][123091] Updated weights for policy 0, policy_version 1569803 (0.0009) [2023-12-26 12:07:46,001][123090] Updated weights for policy 1, policy_version 1559329 (0.0008) [2023-12-26 12:07:46,058][123090] Updated weights for policy 1, policy_version 1559339 (0.0006) [2023-12-26 12:07:46,112][123090] Updated weights for policy 1, policy_version 1559349 (0.0006) [2023-12-26 12:07:46,168][123090] Updated weights for policy 1, policy_version 1559359 (0.0009) [2023-12-26 12:07:46,284][123091] Updated weights for policy 0, policy_version 1569813 (0.0009) [2023-12-26 12:07:46,341][123091] Updated weights for policy 0, policy_version 1569823 (0.0009) [2023-12-26 12:07:46,402][123091] Updated weights for policy 0, policy_version 1569833 (0.0010) [2023-12-26 12:07:46,910][123090] Updated weights for policy 1, policy_version 1559369 (0.0010) [2023-12-26 12:07:46,961][123090] Updated weights for policy 1, policy_version 1559379 (0.0007) [2023-12-26 12:07:47,017][123090] Updated weights for policy 1, policy_version 1559389 (0.0005) [2023-12-26 12:07:47,234][123091] Updated weights for policy 0, policy_version 1569843 (0.0008) [2023-12-26 12:07:47,293][123091] Updated weights for policy 0, policy_version 1569853 (0.0008) [2023-12-26 12:07:47,357][123091] Updated weights for policy 0, policy_version 1569863 (0.0006) [2023-12-26 12:07:47,754][123090] Updated weights for policy 1, policy_version 1559399 (0.0009) [2023-12-26 12:07:47,816][123090] Updated weights for policy 1, policy_version 1559409 (0.0010) [2023-12-26 12:07:47,883][123090] Updated weights for policy 1, policy_version 1559419 (0.0010) [2023-12-26 12:07:48,105][123091] Updated weights for policy 0, policy_version 1569873 (0.0006) [2023-12-26 12:07:48,172][123091] Updated weights for policy 0, policy_version 1569883 (0.0009) [2023-12-26 12:07:48,228][123091] Updated weights for policy 0, policy_version 1569893 (0.0009) [2023-12-26 12:07:48,280][123091] Updated weights for policy 0, policy_version 1569903 (0.0008) [2023-12-26 12:07:48,728][123090] Updated weights for policy 1, policy_version 1559429 (0.0010) [2023-12-26 12:07:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 801112064. Throughput: 0: 8897.9, 1: 8940.5. Samples: 801127524. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:48,785][121949] Avg episode reward: [(0, '6202.064'), (1, '5859.375')] [2023-12-26 12:07:48,790][123090] Updated weights for policy 1, policy_version 1559439 (0.0010) [2023-12-26 12:07:48,853][123090] Updated weights for policy 1, policy_version 1559449 (0.0010) [2023-12-26 12:07:49,131][123091] Updated weights for policy 0, policy_version 1569913 (0.0009) [2023-12-26 12:07:49,196][123091] Updated weights for policy 0, policy_version 1569923 (0.0009) [2023-12-26 12:07:49,262][123091] Updated weights for policy 0, policy_version 1569933 (0.0009) [2023-12-26 12:07:49,684][123090] Updated weights for policy 1, policy_version 1559459 (0.0010) [2023-12-26 12:07:49,736][123090] Updated weights for policy 1, policy_version 1559469 (0.0010) [2023-12-26 12:07:49,796][123090] Updated weights for policy 1, policy_version 1559479 (0.0010) [2023-12-26 12:07:50,111][123091] Updated weights for policy 0, policy_version 1569943 (0.0009) [2023-12-26 12:07:50,160][123091] Updated weights for policy 0, policy_version 1569953 (0.0009) [2023-12-26 12:07:50,217][123091] Updated weights for policy 0, policy_version 1569963 (0.0009) [2023-12-26 12:07:50,659][123090] Updated weights for policy 1, policy_version 1559489 (0.0011) [2023-12-26 12:07:50,722][123090] Updated weights for policy 1, policy_version 1559499 (0.0010) [2023-12-26 12:07:50,775][123090] Updated weights for policy 1, policy_version 1559509 (0.0010) [2023-12-26 12:07:50,838][123090] Updated weights for policy 1, policy_version 1559519 (0.0010) [2023-12-26 12:07:51,097][123091] Updated weights for policy 0, policy_version 1569973 (0.0008) [2023-12-26 12:07:51,162][123091] Updated weights for policy 0, policy_version 1569983 (0.0008) [2023-12-26 12:07:51,219][123091] Updated weights for policy 0, policy_version 1569993 (0.0006) [2023-12-26 12:07:51,758][123090] Updated weights for policy 1, policy_version 1559529 (0.0011) [2023-12-26 12:07:51,830][123090] Updated weights for policy 1, policy_version 1559539 (0.0010) [2023-12-26 12:07:51,897][123090] Updated weights for policy 1, policy_version 1559549 (0.0010) [2023-12-26 12:07:52,084][123091] Updated weights for policy 0, policy_version 1570003 (0.0007) [2023-12-26 12:07:52,148][123091] Updated weights for policy 0, policy_version 1570013 (0.0009) [2023-12-26 12:07:52,219][123091] Updated weights for policy 0, policy_version 1570023 (0.0010) [2023-12-26 12:07:52,646][123090] Updated weights for policy 1, policy_version 1559559 (0.0011) [2023-12-26 12:07:52,706][123090] Updated weights for policy 1, policy_version 1559569 (0.0008) [2023-12-26 12:07:52,765][123090] Updated weights for policy 1, policy_version 1559579 (0.0006) [2023-12-26 12:07:53,008][123091] Updated weights for policy 0, policy_version 1570033 (0.0010) [2023-12-26 12:07:53,078][123091] Updated weights for policy 0, policy_version 1570043 (0.0007) [2023-12-26 12:07:53,143][123091] Updated weights for policy 0, policy_version 1570053 (0.0006) [2023-12-26 12:07:53,206][123091] Updated weights for policy 0, policy_version 1570063 (0.0005) [2023-12-26 12:07:53,469][123090] Updated weights for policy 1, policy_version 1559589 (0.0008) [2023-12-26 12:07:53,523][123090] Updated weights for policy 1, policy_version 1559599 (0.0010) [2023-12-26 12:07:53,582][123090] Updated weights for policy 1, policy_version 1559609 (0.0010) [2023-12-26 12:07:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 801202176. Throughput: 0: 8868.9, 1: 8924.8. Samples: 801177520. Policy #0 lag: (min: 21.0, avg: 28.4, max: 53.0) [2023-12-26 12:07:53,785][121949] Avg episode reward: [(0, '6197.181'), (1, '5960.899')] [2023-12-26 12:07:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001559616_399261696.pth... [2023-12-26 12:07:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001570064_401940480.pth... [2023-12-26 12:07:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001558560_398991360.pth [2023-12-26 12:07:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001569040_401678336.pth [2023-12-26 12:07:53,904][123091] Updated weights for policy 0, policy_version 1570073 (0.0010) [2023-12-26 12:07:53,969][123091] Updated weights for policy 0, policy_version 1570083 (0.0010) [2023-12-26 12:07:54,035][123091] Updated weights for policy 0, policy_version 1570093 (0.0008) [2023-12-26 12:07:54,249][123090] Updated weights for policy 1, policy_version 1559619 (0.0010) [2023-12-26 12:07:54,304][123090] Updated weights for policy 1, policy_version 1559629 (0.0010) [2023-12-26 12:07:54,348][123090] Updated weights for policy 1, policy_version 1559639 (0.0010) [2023-12-26 12:07:54,811][123091] Updated weights for policy 0, policy_version 1570103 (0.0009) [2023-12-26 12:07:54,872][123091] Updated weights for policy 0, policy_version 1570113 (0.0010) [2023-12-26 12:07:54,929][123091] Updated weights for policy 0, policy_version 1570123 (0.0009) [2023-12-26 12:07:55,190][123090] Updated weights for policy 1, policy_version 1559649 (0.0010) [2023-12-26 12:07:55,249][123090] Updated weights for policy 1, policy_version 1559659 (0.0010) [2023-12-26 12:07:55,307][123090] Updated weights for policy 1, policy_version 1559669 (0.0010) [2023-12-26 12:07:55,358][123090] Updated weights for policy 1, policy_version 1559679 (0.0010) [2023-12-26 12:07:55,694][123091] Updated weights for policy 0, policy_version 1570133 (0.0009) [2023-12-26 12:07:55,760][123091] Updated weights for policy 0, policy_version 1570143 (0.0008) [2023-12-26 12:07:55,827][123091] Updated weights for policy 0, policy_version 1570153 (0.0008) [2023-12-26 12:07:56,213][123090] Updated weights for policy 1, policy_version 1559689 (0.0010) [2023-12-26 12:07:56,271][123090] Updated weights for policy 1, policy_version 1559699 (0.0010) [2023-12-26 12:07:56,338][123090] Updated weights for policy 1, policy_version 1559709 (0.0010) [2023-12-26 12:07:56,469][123091] Updated weights for policy 0, policy_version 1570163 (0.0007) [2023-12-26 12:07:56,524][123091] Updated weights for policy 0, policy_version 1570173 (0.0010) [2023-12-26 12:07:56,574][123091] Updated weights for policy 0, policy_version 1570183 (0.0010) [2023-12-26 12:07:57,016][123090] Updated weights for policy 1, policy_version 1559719 (0.0007) [2023-12-26 12:07:57,063][123090] Updated weights for policy 1, policy_version 1559729 (0.0005) [2023-12-26 12:07:57,116][123090] Updated weights for policy 1, policy_version 1559739 (0.0005) [2023-12-26 12:07:57,395][123091] Updated weights for policy 0, policy_version 1570193 (0.0010) [2023-12-26 12:07:57,450][123091] Updated weights for policy 0, policy_version 1570203 (0.0010) [2023-12-26 12:07:57,508][123091] Updated weights for policy 0, policy_version 1570213 (0.0010) [2023-12-26 12:07:57,569][123091] Updated weights for policy 0, policy_version 1570223 (0.0010) [2023-12-26 12:07:57,829][123090] Updated weights for policy 1, policy_version 1559749 (0.0006) [2023-12-26 12:07:57,897][123090] Updated weights for policy 1, policy_version 1559759 (0.0008) [2023-12-26 12:07:57,968][123090] Updated weights for policy 1, policy_version 1559769 (0.0008) [2023-12-26 12:07:58,401][123091] Updated weights for policy 0, policy_version 1570233 (0.0010) [2023-12-26 12:07:58,457][123091] Updated weights for policy 0, policy_version 1570243 (0.0008) [2023-12-26 12:07:58,529][123091] Updated weights for policy 0, policy_version 1570253 (0.0009) [2023-12-26 12:07:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 801292288. Throughput: 0: 8898.8, 1: 9014.0. Samples: 801287768. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:07:58,785][121949] Avg episode reward: [(0, '6190.333'), (1, '5926.880')] [2023-12-26 12:07:58,831][123090] Updated weights for policy 1, policy_version 1559779 (0.0010) [2023-12-26 12:07:58,902][123090] Updated weights for policy 1, policy_version 1559790 (0.0012) [2023-12-26 12:07:58,973][123090] Updated weights for policy 1, policy_version 1559800 (0.0011) [2023-12-26 12:07:59,454][123091] Updated weights for policy 0, policy_version 1570263 (0.0010) [2023-12-26 12:07:59,516][123091] Updated weights for policy 0, policy_version 1570273 (0.0009) [2023-12-26 12:07:59,582][123091] Updated weights for policy 0, policy_version 1570283 (0.0008) [2023-12-26 12:07:59,823][123090] Updated weights for policy 1, policy_version 1559810 (0.0010) [2023-12-26 12:07:59,887][123090] Updated weights for policy 1, policy_version 1559820 (0.0007) [2023-12-26 12:07:59,958][123090] Updated weights for policy 1, policy_version 1559830 (0.0011) [2023-12-26 12:08:00,022][123090] Updated weights for policy 1, policy_version 1559840 (0.0010) [2023-12-26 12:08:00,344][123091] Updated weights for policy 0, policy_version 1570293 (0.0007) [2023-12-26 12:08:00,400][123091] Updated weights for policy 0, policy_version 1570303 (0.0009) [2023-12-26 12:08:00,463][123091] Updated weights for policy 0, policy_version 1570313 (0.0007) [2023-12-26 12:08:00,792][123090] Updated weights for policy 1, policy_version 1559850 (0.0010) [2023-12-26 12:08:00,835][123090] Updated weights for policy 1, policy_version 1559860 (0.0010) [2023-12-26 12:08:00,894][123090] Updated weights for policy 1, policy_version 1559870 (0.0010) [2023-12-26 12:08:01,158][123091] Updated weights for policy 0, policy_version 1570323 (0.0006) [2023-12-26 12:08:01,213][123091] Updated weights for policy 0, policy_version 1570333 (0.0008) [2023-12-26 12:08:01,271][123091] Updated weights for policy 0, policy_version 1570343 (0.0009) [2023-12-26 12:08:01,752][123090] Updated weights for policy 1, policy_version 1559880 (0.0008) [2023-12-26 12:08:01,827][123090] Updated weights for policy 1, policy_version 1559890 (0.0006) [2023-12-26 12:08:01,901][123090] Updated weights for policy 1, policy_version 1559900 (0.0005) [2023-12-26 12:08:02,210][123091] Updated weights for policy 0, policy_version 1570353 (0.0010) [2023-12-26 12:08:02,271][123091] Updated weights for policy 0, policy_version 1570363 (0.0010) [2023-12-26 12:08:02,331][123091] Updated weights for policy 0, policy_version 1570373 (0.0009) [2023-12-26 12:08:02,398][123091] Updated weights for policy 0, policy_version 1570383 (0.0010) [2023-12-26 12:08:02,539][123090] Updated weights for policy 1, policy_version 1559910 (0.0007) [2023-12-26 12:08:02,594][123090] Updated weights for policy 1, policy_version 1559920 (0.0010) [2023-12-26 12:08:02,649][123090] Updated weights for policy 1, policy_version 1559930 (0.0010) [2023-12-26 12:08:03,247][123091] Updated weights for policy 0, policy_version 1570393 (0.0008) [2023-12-26 12:08:03,314][123091] Updated weights for policy 0, policy_version 1570403 (0.0006) [2023-12-26 12:08:03,359][123091] Updated weights for policy 0, policy_version 1570413 (0.0006) [2023-12-26 12:08:03,386][123090] Updated weights for policy 1, policy_version 1559940 (0.0008) [2023-12-26 12:08:03,435][123090] Updated weights for policy 1, policy_version 1559950 (0.0005) [2023-12-26 12:08:03,482][123090] Updated weights for policy 1, policy_version 1559960 (0.0005) [2023-12-26 12:08:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 801382400. Throughput: 0: 8892.8, 1: 8969.0. Samples: 801392716. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:03,785][121949] Avg episode reward: [(0, '6207.852'), (1, '5817.562')] [2023-12-26 12:08:04,042][123091] Updated weights for policy 0, policy_version 1570423 (0.0005) [2023-12-26 12:08:04,092][123091] Updated weights for policy 0, policy_version 1570433 (0.0006) [2023-12-26 12:08:04,158][123091] Updated weights for policy 0, policy_version 1570443 (0.0007) [2023-12-26 12:08:04,191][123090] Updated weights for policy 1, policy_version 1559970 (0.0006) [2023-12-26 12:08:04,258][123090] Updated weights for policy 1, policy_version 1559980 (0.0011) [2023-12-26 12:08:04,330][123090] Updated weights for policy 1, policy_version 1559990 (0.0010) [2023-12-26 12:08:04,385][123090] Updated weights for policy 1, policy_version 1560000 (0.0010) [2023-12-26 12:08:04,794][123091] Updated weights for policy 0, policy_version 1570453 (0.0007) [2023-12-26 12:08:04,840][123091] Updated weights for policy 0, policy_version 1570463 (0.0006) [2023-12-26 12:08:04,890][123091] Updated weights for policy 0, policy_version 1570473 (0.0006) [2023-12-26 12:08:05,220][123090] Updated weights for policy 1, policy_version 1560010 (0.0009) [2023-12-26 12:08:05,278][123090] Updated weights for policy 1, policy_version 1560020 (0.0009) [2023-12-26 12:08:05,331][123090] Updated weights for policy 1, policy_version 1560030 (0.0009) [2023-12-26 12:08:05,736][123091] Updated weights for policy 0, policy_version 1570483 (0.0009) [2023-12-26 12:08:05,793][123091] Updated weights for policy 0, policy_version 1570493 (0.0009) [2023-12-26 12:08:05,853][123091] Updated weights for policy 0, policy_version 1570503 (0.0009) [2023-12-26 12:08:06,202][123090] Updated weights for policy 1, policy_version 1560040 (0.0009) [2023-12-26 12:08:06,272][123090] Updated weights for policy 1, policy_version 1560050 (0.0010) [2023-12-26 12:08:06,330][123090] Updated weights for policy 1, policy_version 1560060 (0.0010) [2023-12-26 12:08:06,645][123091] Updated weights for policy 0, policy_version 1570513 (0.0009) [2023-12-26 12:08:06,709][123091] Updated weights for policy 0, policy_version 1570523 (0.0008) [2023-12-26 12:08:06,761][123091] Updated weights for policy 0, policy_version 1570533 (0.0005) [2023-12-26 12:08:06,827][123091] Updated weights for policy 0, policy_version 1570543 (0.0008) [2023-12-26 12:08:07,152][123090] Updated weights for policy 1, policy_version 1560070 (0.0007) [2023-12-26 12:08:07,200][123090] Updated weights for policy 1, policy_version 1560080 (0.0007) [2023-12-26 12:08:07,248][123090] Updated weights for policy 1, policy_version 1560090 (0.0010) [2023-12-26 12:08:07,631][123091] Updated weights for policy 0, policy_version 1570553 (0.0009) [2023-12-26 12:08:07,682][123091] Updated weights for policy 0, policy_version 1570563 (0.0009) [2023-12-26 12:08:07,741][123091] Updated weights for policy 0, policy_version 1570573 (0.0009) [2023-12-26 12:08:08,082][123090] Updated weights for policy 1, policy_version 1560100 (0.0011) [2023-12-26 12:08:08,133][123090] Updated weights for policy 1, policy_version 1560110 (0.0010) [2023-12-26 12:08:08,200][123090] Updated weights for policy 1, policy_version 1560120 (0.0011) [2023-12-26 12:08:08,570][123091] Updated weights for policy 0, policy_version 1570583 (0.0007) [2023-12-26 12:08:08,635][123091] Updated weights for policy 0, policy_version 1570593 (0.0007) [2023-12-26 12:08:08,688][123091] Updated weights for policy 0, policy_version 1570603 (0.0009) [2023-12-26 12:08:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 801472512. Throughput: 0: 8914.7, 1: 8931.7. Samples: 801446620. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:08,785][121949] Avg episode reward: [(0, '6190.368'), (1, '5767.774')] [2023-12-26 12:08:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001570608_402079744.pth... [2023-12-26 12:08:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001560128_399392768.pth... [2023-12-26 12:08:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001569552_401809408.pth [2023-12-26 12:08:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001559104_399130624.pth [2023-12-26 12:08:09,027][123090] Updated weights for policy 1, policy_version 1560130 (0.0011) [2023-12-26 12:08:09,086][123090] Updated weights for policy 1, policy_version 1560140 (0.0010) [2023-12-26 12:08:09,137][123090] Updated weights for policy 1, policy_version 1560150 (0.0010) [2023-12-26 12:08:09,214][123090] Updated weights for policy 1, policy_version 1560160 (0.0010) [2023-12-26 12:08:09,566][123091] Updated weights for policy 0, policy_version 1570613 (0.0009) [2023-12-26 12:08:09,632][123091] Updated weights for policy 0, policy_version 1570623 (0.0009) [2023-12-26 12:08:09,698][123091] Updated weights for policy 0, policy_version 1570633 (0.0010) [2023-12-26 12:08:10,002][123090] Updated weights for policy 1, policy_version 1560170 (0.0010) [2023-12-26 12:08:10,068][123090] Updated weights for policy 1, policy_version 1560180 (0.0008) [2023-12-26 12:08:10,130][123090] Updated weights for policy 1, policy_version 1560190 (0.0009) [2023-12-26 12:08:10,524][123091] Updated weights for policy 0, policy_version 1570643 (0.0009) [2023-12-26 12:08:10,572][123091] Updated weights for policy 0, policy_version 1570653 (0.0009) [2023-12-26 12:08:10,632][123091] Updated weights for policy 0, policy_version 1570663 (0.0011) [2023-12-26 12:08:10,983][123090] Updated weights for policy 1, policy_version 1560200 (0.0010) [2023-12-26 12:08:11,047][123090] Updated weights for policy 1, policy_version 1560210 (0.0010) [2023-12-26 12:08:11,122][123090] Updated weights for policy 1, policy_version 1560220 (0.0009) [2023-12-26 12:08:11,491][123091] Updated weights for policy 0, policy_version 1570673 (0.0010) [2023-12-26 12:08:11,559][123091] Updated weights for policy 0, policy_version 1570683 (0.0008) [2023-12-26 12:08:11,635][123091] Updated weights for policy 0, policy_version 1570693 (0.0007) [2023-12-26 12:08:11,696][123091] Updated weights for policy 0, policy_version 1570703 (0.0010) [2023-12-26 12:08:12,011][123090] Updated weights for policy 1, policy_version 1560230 (0.0009) [2023-12-26 12:08:12,073][123090] Updated weights for policy 1, policy_version 1560240 (0.0009) [2023-12-26 12:08:12,143][123090] Updated weights for policy 1, policy_version 1560250 (0.0009) [2023-12-26 12:08:12,475][123091] Updated weights for policy 0, policy_version 1570713 (0.0008) [2023-12-26 12:08:12,538][123091] Updated weights for policy 0, policy_version 1570723 (0.0008) [2023-12-26 12:08:12,609][123091] Updated weights for policy 0, policy_version 1570733 (0.0008) [2023-12-26 12:08:12,956][123090] Updated weights for policy 1, policy_version 1560260 (0.0009) [2023-12-26 12:08:13,009][123090] Updated weights for policy 1, policy_version 1560270 (0.0009) [2023-12-26 12:08:13,055][123090] Updated weights for policy 1, policy_version 1560280 (0.0005) [2023-12-26 12:08:13,308][123091] Updated weights for policy 0, policy_version 1570743 (0.0006) [2023-12-26 12:08:13,380][123091] Updated weights for policy 0, policy_version 1570753 (0.0006) [2023-12-26 12:08:13,454][123091] Updated weights for policy 0, policy_version 1570763 (0.0005) [2023-12-26 12:08:13,743][123090] Updated weights for policy 1, policy_version 1560290 (0.0005) [2023-12-26 12:08:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 801554432. Throughput: 0: 8896.3, 1: 8849.0. Samples: 801548820. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:13,785][121949] Avg episode reward: [(0, '6159.325'), (1, '5727.015')] [2023-12-26 12:08:13,796][123090] Updated weights for policy 1, policy_version 1560300 (0.0005) [2023-12-26 12:08:13,864][123090] Updated weights for policy 1, policy_version 1560310 (0.0005) [2023-12-26 12:08:13,935][123090] Updated weights for policy 1, policy_version 1560320 (0.0005) [2023-12-26 12:08:14,180][123091] Updated weights for policy 0, policy_version 1570773 (0.0007) [2023-12-26 12:08:14,249][123091] Updated weights for policy 0, policy_version 1570783 (0.0008) [2023-12-26 12:08:14,308][123091] Updated weights for policy 0, policy_version 1570793 (0.0008) [2023-12-26 12:08:14,663][123090] Updated weights for policy 1, policy_version 1560330 (0.0006) [2023-12-26 12:08:14,733][123090] Updated weights for policy 1, policy_version 1560340 (0.0006) [2023-12-26 12:08:14,802][123090] Updated weights for policy 1, policy_version 1560350 (0.0007) [2023-12-26 12:08:15,045][123091] Updated weights for policy 0, policy_version 1570803 (0.0009) [2023-12-26 12:08:15,115][123091] Updated weights for policy 0, policy_version 1570813 (0.0010) [2023-12-26 12:08:15,178][123091] Updated weights for policy 0, policy_version 1570823 (0.0010) [2023-12-26 12:08:15,507][123090] Updated weights for policy 1, policy_version 1560360 (0.0009) [2023-12-26 12:08:15,566][123090] Updated weights for policy 1, policy_version 1560370 (0.0010) [2023-12-26 12:08:15,631][123090] Updated weights for policy 1, policy_version 1560380 (0.0010) [2023-12-26 12:08:15,963][123091] Updated weights for policy 0, policy_version 1570833 (0.0010) [2023-12-26 12:08:16,034][123091] Updated weights for policy 0, policy_version 1570843 (0.0008) [2023-12-26 12:08:16,102][123091] Updated weights for policy 0, policy_version 1570853 (0.0005) [2023-12-26 12:08:16,167][123091] Updated weights for policy 0, policy_version 1570863 (0.0005) [2023-12-26 12:08:16,419][123090] Updated weights for policy 1, policy_version 1560390 (0.0006) [2023-12-26 12:08:16,479][123090] Updated weights for policy 1, policy_version 1560400 (0.0005) [2023-12-26 12:08:16,535][123090] Updated weights for policy 1, policy_version 1560410 (0.0005) [2023-12-26 12:08:16,824][123091] Updated weights for policy 0, policy_version 1570873 (0.0009) [2023-12-26 12:08:16,894][123091] Updated weights for policy 0, policy_version 1570883 (0.0007) [2023-12-26 12:08:16,960][123091] Updated weights for policy 0, policy_version 1570893 (0.0006) [2023-12-26 12:08:17,217][123090] Updated weights for policy 1, policy_version 1560420 (0.0005) [2023-12-26 12:08:17,264][123090] Updated weights for policy 1, policy_version 1560430 (0.0005) [2023-12-26 12:08:17,320][123090] Updated weights for policy 1, policy_version 1560440 (0.0005) [2023-12-26 12:08:17,685][123091] Updated weights for policy 0, policy_version 1570903 (0.0008) [2023-12-26 12:08:17,749][123091] Updated weights for policy 0, policy_version 1570913 (0.0007) [2023-12-26 12:08:17,821][123091] Updated weights for policy 0, policy_version 1570923 (0.0009) [2023-12-26 12:08:17,960][123090] Updated weights for policy 1, policy_version 1560450 (0.0006) [2023-12-26 12:08:18,031][123090] Updated weights for policy 1, policy_version 1560460 (0.0011) [2023-12-26 12:08:18,086][123090] Updated weights for policy 1, policy_version 1560470 (0.0010) [2023-12-26 12:08:18,149][123090] Updated weights for policy 1, policy_version 1560480 (0.0006) [2023-12-26 12:08:18,454][123091] Updated weights for policy 0, policy_version 1570933 (0.0007) [2023-12-26 12:08:18,511][123091] Updated weights for policy 0, policy_version 1570943 (0.0007) [2023-12-26 12:08:18,571][123091] Updated weights for policy 0, policy_version 1570953 (0.0006) [2023-12-26 12:08:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 801652736. Throughput: 0: 8917.5, 1: 8956.1. Samples: 801664224. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:18,785][121949] Avg episode reward: [(0, '6108.540'), (1, '5769.720')] [2023-12-26 12:08:18,866][123090] Updated weights for policy 1, policy_version 1560490 (0.0006) [2023-12-26 12:08:18,922][123090] Updated weights for policy 1, policy_version 1560500 (0.0005) [2023-12-26 12:08:18,982][123090] Updated weights for policy 1, policy_version 1560510 (0.0009) [2023-12-26 12:08:19,301][123091] Updated weights for policy 0, policy_version 1570963 (0.0007) [2023-12-26 12:08:19,366][123091] Updated weights for policy 0, policy_version 1570973 (0.0010) [2023-12-26 12:08:19,426][123091] Updated weights for policy 0, policy_version 1570983 (0.0010) [2023-12-26 12:08:19,748][123090] Updated weights for policy 1, policy_version 1560520 (0.0010) [2023-12-26 12:08:19,815][123090] Updated weights for policy 1, policy_version 1560530 (0.0008) [2023-12-26 12:08:19,889][123090] Updated weights for policy 1, policy_version 1560540 (0.0011) [2023-12-26 12:08:20,224][123091] Updated weights for policy 0, policy_version 1570993 (0.0010) [2023-12-26 12:08:20,292][123091] Updated weights for policy 0, policy_version 1571003 (0.0009) [2023-12-26 12:08:20,357][123091] Updated weights for policy 0, policy_version 1571013 (0.0009) [2023-12-26 12:08:20,418][123091] Updated weights for policy 0, policy_version 1571023 (0.0009) [2023-12-26 12:08:20,735][123090] Updated weights for policy 1, policy_version 1560550 (0.0011) [2023-12-26 12:08:20,798][123090] Updated weights for policy 1, policy_version 1560560 (0.0010) [2023-12-26 12:08:20,857][123090] Updated weights for policy 1, policy_version 1560570 (0.0009) [2023-12-26 12:08:21,233][123091] Updated weights for policy 0, policy_version 1571033 (0.0006) [2023-12-26 12:08:21,301][123091] Updated weights for policy 0, policy_version 1571043 (0.0009) [2023-12-26 12:08:21,378][123091] Updated weights for policy 0, policy_version 1571053 (0.0009) [2023-12-26 12:08:21,686][123090] Updated weights for policy 1, policy_version 1560580 (0.0010) [2023-12-26 12:08:21,750][123090] Updated weights for policy 1, policy_version 1560590 (0.0008) [2023-12-26 12:08:21,818][123090] Updated weights for policy 1, policy_version 1560600 (0.0009) [2023-12-26 12:08:22,202][123091] Updated weights for policy 0, policy_version 1571063 (0.0010) [2023-12-26 12:08:22,267][123091] Updated weights for policy 0, policy_version 1571073 (0.0011) [2023-12-26 12:08:22,325][123091] Updated weights for policy 0, policy_version 1571083 (0.0009) [2023-12-26 12:08:22,657][123090] Updated weights for policy 1, policy_version 1560610 (0.0009) [2023-12-26 12:08:22,722][123090] Updated weights for policy 1, policy_version 1560620 (0.0009) [2023-12-26 12:08:22,793][123090] Updated weights for policy 1, policy_version 1560630 (0.0009) [2023-12-26 12:08:22,863][123090] Updated weights for policy 1, policy_version 1560640 (0.0007) [2023-12-26 12:08:23,188][123091] Updated weights for policy 0, policy_version 1571093 (0.0010) [2023-12-26 12:08:23,241][123091] Updated weights for policy 0, policy_version 1571103 (0.0009) [2023-12-26 12:08:23,308][123091] Updated weights for policy 0, policy_version 1571113 (0.0005) [2023-12-26 12:08:23,684][123090] Updated weights for policy 1, policy_version 1560650 (0.0009) [2023-12-26 12:08:23,743][123090] Updated weights for policy 1, policy_version 1560661 (0.0010) [2023-12-26 12:08:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 801734656. Throughput: 0: 8875.1, 1: 8967.9. Samples: 801717028. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:23,785][121949] Avg episode reward: [(0, '6215.534'), (1, '5697.352')] [2023-12-26 12:08:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001571120_402210816.pth... [2023-12-26 12:08:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001570064_401940480.pth [2023-12-26 12:08:23,795][123090] Updated weights for policy 1, policy_version 1560671 (0.0009) [2023-12-26 12:08:23,799][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001560672_399532032.pth... [2023-12-26 12:08:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001559616_399261696.pth [2023-12-26 12:08:24,033][123091] Updated weights for policy 0, policy_version 1571123 (0.0006) [2023-12-26 12:08:24,086][123091] Updated weights for policy 0, policy_version 1571133 (0.0006) [2023-12-26 12:08:24,149][123091] Updated weights for policy 0, policy_version 1571143 (0.0009) [2023-12-26 12:08:24,610][123090] Updated weights for policy 1, policy_version 1560681 (0.0010) [2023-12-26 12:08:24,659][123090] Updated weights for policy 1, policy_version 1560692 (0.0009) [2023-12-26 12:08:24,707][123090] Updated weights for policy 1, policy_version 1560702 (0.0008) [2023-12-26 12:08:25,015][123091] Updated weights for policy 0, policy_version 1571154 (0.0010) [2023-12-26 12:08:25,077][123091] Updated weights for policy 0, policy_version 1571164 (0.0010) [2023-12-26 12:08:25,136][123091] Updated weights for policy 0, policy_version 1571174 (0.0011) [2023-12-26 12:08:25,183][123091] Updated weights for policy 0, policy_version 1571184 (0.0010) [2023-12-26 12:08:25,576][123090] Updated weights for policy 1, policy_version 1560712 (0.0009) [2023-12-26 12:08:25,623][123090] Updated weights for policy 1, policy_version 1560722 (0.0008) [2023-12-26 12:08:25,670][123090] Updated weights for policy 1, policy_version 1560732 (0.0008) [2023-12-26 12:08:25,931][123091] Updated weights for policy 0, policy_version 1571194 (0.0006) [2023-12-26 12:08:25,985][123091] Updated weights for policy 0, policy_version 1571204 (0.0005) [2023-12-26 12:08:26,034][123091] Updated weights for policy 0, policy_version 1571214 (0.0005) [2023-12-26 12:08:26,555][123090] Updated weights for policy 1, policy_version 1560742 (0.0010) [2023-12-26 12:08:26,602][123090] Updated weights for policy 1, policy_version 1560752 (0.0010) [2023-12-26 12:08:26,657][123090] Updated weights for policy 1, policy_version 1560762 (0.0005) [2023-12-26 12:08:26,744][123091] Updated weights for policy 0, policy_version 1571224 (0.0005) [2023-12-26 12:08:26,806][123091] Updated weights for policy 0, policy_version 1571234 (0.0005) [2023-12-26 12:08:26,877][123091] Updated weights for policy 0, policy_version 1571244 (0.0005) [2023-12-26 12:08:27,365][123090] Updated weights for policy 1, policy_version 1560772 (0.0005) [2023-12-26 12:08:27,413][123090] Updated weights for policy 1, policy_version 1560782 (0.0007) [2023-12-26 12:08:27,468][123090] Updated weights for policy 1, policy_version 1560792 (0.0010) [2023-12-26 12:08:27,480][123091] Updated weights for policy 0, policy_version 1571254 (0.0008) [2023-12-26 12:08:27,534][123091] Updated weights for policy 0, policy_version 1571264 (0.0010) [2023-12-26 12:08:27,585][123091] Updated weights for policy 0, policy_version 1571274 (0.0010) [2023-12-26 12:08:28,201][123090] Updated weights for policy 1, policy_version 1560802 (0.0010) [2023-12-26 12:08:28,254][123090] Updated weights for policy 1, policy_version 1560812 (0.0007) [2023-12-26 12:08:28,310][123090] Updated weights for policy 1, policy_version 1560822 (0.0005) [2023-12-26 12:08:28,378][123090] Updated weights for policy 1, policy_version 1560832 (0.0008) [2023-12-26 12:08:28,389][123091] Updated weights for policy 0, policy_version 1571284 (0.0008) [2023-12-26 12:08:28,447][123091] Updated weights for policy 0, policy_version 1571294 (0.0008) [2023-12-26 12:08:28,510][123091] Updated weights for policy 0, policy_version 1571304 (0.0010) [2023-12-26 12:08:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 801832960. Throughput: 0: 8927.3, 1: 8908.0. Samples: 801824336. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:28,785][121949] Avg episode reward: [(0, '5998.250'), (1, '5855.458')] [2023-12-26 12:08:29,175][123090] Updated weights for policy 1, policy_version 1560842 (0.0007) [2023-12-26 12:08:29,233][123090] Updated weights for policy 1, policy_version 1560852 (0.0008) [2023-12-26 12:08:29,304][123090] Updated weights for policy 1, policy_version 1560862 (0.0008) [2023-12-26 12:08:29,346][123091] Updated weights for policy 0, policy_version 1571314 (0.0010) [2023-12-26 12:08:29,393][123091] Updated weights for policy 0, policy_version 1571324 (0.0010) [2023-12-26 12:08:29,447][123091] Updated weights for policy 0, policy_version 1571334 (0.0010) [2023-12-26 12:08:29,509][123091] Updated weights for policy 0, policy_version 1571344 (0.0010) [2023-12-26 12:08:30,088][123090] Updated weights for policy 1, policy_version 1560872 (0.0009) [2023-12-26 12:08:30,151][123090] Updated weights for policy 1, policy_version 1560882 (0.0009) [2023-12-26 12:08:30,218][123090] Updated weights for policy 1, policy_version 1560892 (0.0009) [2023-12-26 12:08:30,316][123091] Updated weights for policy 0, policy_version 1571354 (0.0009) [2023-12-26 12:08:30,388][123091] Updated weights for policy 0, policy_version 1571364 (0.0009) [2023-12-26 12:08:30,445][123091] Updated weights for policy 0, policy_version 1571374 (0.0009) [2023-12-26 12:08:31,032][123090] Updated weights for policy 1, policy_version 1560902 (0.0009) [2023-12-26 12:08:31,095][123090] Updated weights for policy 1, policy_version 1560912 (0.0009) [2023-12-26 12:08:31,164][123090] Updated weights for policy 1, policy_version 1560922 (0.0010) [2023-12-26 12:08:31,261][123091] Updated weights for policy 0, policy_version 1571384 (0.0009) [2023-12-26 12:08:31,313][123091] Updated weights for policy 0, policy_version 1571394 (0.0009) [2023-12-26 12:08:31,372][123091] Updated weights for policy 0, policy_version 1571404 (0.0010) [2023-12-26 12:08:32,006][123090] Updated weights for policy 1, policy_version 1560932 (0.0009) [2023-12-26 12:08:32,077][123090] Updated weights for policy 1, policy_version 1560942 (0.0009) [2023-12-26 12:08:32,140][123090] Updated weights for policy 1, policy_version 1560952 (0.0009) [2023-12-26 12:08:32,216][123091] Updated weights for policy 0, policy_version 1571414 (0.0009) [2023-12-26 12:08:32,285][123091] Updated weights for policy 0, policy_version 1571424 (0.0009) [2023-12-26 12:08:32,351][123091] Updated weights for policy 0, policy_version 1571434 (0.0010) [2023-12-26 12:08:33,046][123091] Updated weights for policy 0, policy_version 1571444 (0.0008) [2023-12-26 12:08:33,059][123090] Updated weights for policy 1, policy_version 1560962 (0.0009) [2023-12-26 12:08:33,100][123091] Updated weights for policy 0, policy_version 1571454 (0.0005) [2023-12-26 12:08:33,109][123090] Updated weights for policy 1, policy_version 1560972 (0.0009) [2023-12-26 12:08:33,154][123091] Updated weights for policy 0, policy_version 1571464 (0.0005) [2023-12-26 12:08:33,171][123090] Updated weights for policy 1, policy_version 1560982 (0.0009) [2023-12-26 12:08:33,225][123090] Updated weights for policy 1, policy_version 1560992 (0.0009) [2023-12-26 12:08:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 801914880. Throughput: 0: 8964.5, 1: 8861.8. Samples: 801929712. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:33,785][121949] Avg episode reward: [(0, '6005.333'), (1, '5789.060')] [2023-12-26 12:08:33,882][123091] Updated weights for policy 0, policy_version 1571474 (0.0006) [2023-12-26 12:08:33,941][123091] Updated weights for policy 0, policy_version 1571484 (0.0010) [2023-12-26 12:08:33,951][123090] Updated weights for policy 1, policy_version 1561002 (0.0007) [2023-12-26 12:08:33,987][123091] Updated weights for policy 0, policy_version 1571494 (0.0007) [2023-12-26 12:08:34,019][123090] Updated weights for policy 1, policy_version 1561012 (0.0006) [2023-12-26 12:08:34,042][123091] Updated weights for policy 0, policy_version 1571504 (0.0009) [2023-12-26 12:08:34,078][123090] Updated weights for policy 1, policy_version 1561022 (0.0005) [2023-12-26 12:08:34,748][123090] Updated weights for policy 1, policy_version 1561032 (0.0009) [2023-12-26 12:08:34,822][123090] Updated weights for policy 1, policy_version 1561042 (0.0010) [2023-12-26 12:08:34,884][123090] Updated weights for policy 1, policy_version 1561052 (0.0010) [2023-12-26 12:08:34,890][123091] Updated weights for policy 0, policy_version 1571514 (0.0011) [2023-12-26 12:08:34,947][123091] Updated weights for policy 0, policy_version 1571524 (0.0011) [2023-12-26 12:08:34,995][123091] Updated weights for policy 0, policy_version 1571534 (0.0010) [2023-12-26 12:08:35,644][123090] Updated weights for policy 1, policy_version 1561062 (0.0007) [2023-12-26 12:08:35,695][123090] Updated weights for policy 1, policy_version 1561072 (0.0005) [2023-12-26 12:08:35,743][123091] Updated weights for policy 0, policy_version 1571544 (0.0006) [2023-12-26 12:08:35,746][123090] Updated weights for policy 1, policy_version 1561082 (0.0007) [2023-12-26 12:08:35,801][123091] Updated weights for policy 0, policy_version 1571554 (0.0005) [2023-12-26 12:08:35,866][123091] Updated weights for policy 0, policy_version 1571564 (0.0005) [2023-12-26 12:08:36,466][123090] Updated weights for policy 1, policy_version 1561092 (0.0008) [2023-12-26 12:08:36,536][123090] Updated weights for policy 1, policy_version 1561102 (0.0006) [2023-12-26 12:08:36,566][123091] Updated weights for policy 0, policy_version 1571574 (0.0007) [2023-12-26 12:08:36,600][123090] Updated weights for policy 1, policy_version 1561112 (0.0006) [2023-12-26 12:08:36,633][123091] Updated weights for policy 0, policy_version 1571584 (0.0010) [2023-12-26 12:08:36,698][123091] Updated weights for policy 0, policy_version 1571594 (0.0010) [2023-12-26 12:08:37,351][123090] Updated weights for policy 1, policy_version 1561122 (0.0009) [2023-12-26 12:08:37,418][123090] Updated weights for policy 1, policy_version 1561132 (0.0008) [2023-12-26 12:08:37,422][123091] Updated weights for policy 0, policy_version 1571604 (0.0007) [2023-12-26 12:08:37,475][123090] Updated weights for policy 1, policy_version 1561142 (0.0011) [2023-12-26 12:08:37,482][123091] Updated weights for policy 0, policy_version 1571614 (0.0007) [2023-12-26 12:08:37,524][123090] Updated weights for policy 1, policy_version 1561152 (0.0010) [2023-12-26 12:08:37,544][123091] Updated weights for policy 0, policy_version 1571624 (0.0007) [2023-12-26 12:08:38,243][123090] Updated weights for policy 1, policy_version 1561162 (0.0006) [2023-12-26 12:08:38,287][123091] Updated weights for policy 0, policy_version 1571634 (0.0008) [2023-12-26 12:08:38,307][123090] Updated weights for policy 1, policy_version 1561172 (0.0006) [2023-12-26 12:08:38,350][123091] Updated weights for policy 0, policy_version 1571644 (0.0007) [2023-12-26 12:08:38,374][123090] Updated weights for policy 1, policy_version 1561182 (0.0006) [2023-12-26 12:08:38,415][123091] Updated weights for policy 0, policy_version 1571654 (0.0006) [2023-12-26 12:08:38,471][123091] Updated weights for policy 0, policy_version 1571664 (0.0007) [2023-12-26 12:08:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 802013184. Throughput: 0: 9026.1, 1: 8942.9. Samples: 801986120. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:38,785][121949] Avg episode reward: [(0, '6075.922'), (1, '5657.698')] [2023-12-26 12:08:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001571664_402350080.pth... [2023-12-26 12:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001561184_399663104.pth... [2023-12-26 12:08:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001570608_402079744.pth [2023-12-26 12:08:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001560128_399392768.pth [2023-12-26 12:08:39,168][123090] Updated weights for policy 1, policy_version 1561192 (0.0006) [2023-12-26 12:08:39,229][123090] Updated weights for policy 1, policy_version 1561202 (0.0006) [2023-12-26 12:08:39,282][123091] Updated weights for policy 0, policy_version 1571674 (0.0008) [2023-12-26 12:08:39,293][123090] Updated weights for policy 1, policy_version 1561212 (0.0008) [2023-12-26 12:08:39,341][123091] Updated weights for policy 0, policy_version 1571684 (0.0009) [2023-12-26 12:08:39,418][123091] Updated weights for policy 0, policy_version 1571694 (0.0010) [2023-12-26 12:08:40,174][123091] Updated weights for policy 0, policy_version 1571704 (0.0007) [2023-12-26 12:08:40,175][123090] Updated weights for policy 1, policy_version 1561222 (0.0008) [2023-12-26 12:08:40,231][123090] Updated weights for policy 1, policy_version 1561232 (0.0009) [2023-12-26 12:08:40,239][123091] Updated weights for policy 0, policy_version 1571714 (0.0008) [2023-12-26 12:08:40,287][123090] Updated weights for policy 1, policy_version 1561242 (0.0009) [2023-12-26 12:08:40,313][123091] Updated weights for policy 0, policy_version 1571724 (0.0007) [2023-12-26 12:08:41,017][123091] Updated weights for policy 0, policy_version 1571734 (0.0009) [2023-12-26 12:08:41,085][123091] Updated weights for policy 0, policy_version 1571744 (0.0010) [2023-12-26 12:08:41,141][123091] Updated weights for policy 0, policy_version 1571754 (0.0010) [2023-12-26 12:08:41,162][123090] Updated weights for policy 1, policy_version 1561252 (0.0007) [2023-12-26 12:08:41,237][123090] Updated weights for policy 1, policy_version 1561262 (0.0008) [2023-12-26 12:08:41,297][123090] Updated weights for policy 1, policy_version 1561272 (0.0008) [2023-12-26 12:08:41,913][123091] Updated weights for policy 0, policy_version 1571764 (0.0009) [2023-12-26 12:08:41,973][123091] Updated weights for policy 0, policy_version 1571774 (0.0009) [2023-12-26 12:08:42,027][123091] Updated weights for policy 0, policy_version 1571784 (0.0010) [2023-12-26 12:08:42,060][123090] Updated weights for policy 1, policy_version 1561282 (0.0008) [2023-12-26 12:08:42,132][123090] Updated weights for policy 1, policy_version 1561292 (0.0008) [2023-12-26 12:08:42,193][123090] Updated weights for policy 1, policy_version 1561302 (0.0010) [2023-12-26 12:08:42,249][123090] Updated weights for policy 1, policy_version 1561312 (0.0010) [2023-12-26 12:08:42,889][123091] Updated weights for policy 0, policy_version 1571794 (0.0009) [2023-12-26 12:08:42,944][123091] Updated weights for policy 0, policy_version 1571804 (0.0011) [2023-12-26 12:08:42,995][123091] Updated weights for policy 0, policy_version 1571814 (0.0011) [2023-12-26 12:08:43,056][123091] Updated weights for policy 0, policy_version 1571824 (0.0009) [2023-12-26 12:08:43,066][123090] Updated weights for policy 1, policy_version 1561322 (0.0007) [2023-12-26 12:08:43,122][123090] Updated weights for policy 1, policy_version 1561333 (0.0010) [2023-12-26 12:08:43,177][123090] Updated weights for policy 1, policy_version 1561343 (0.0010) [2023-12-26 12:08:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 802095104. Throughput: 0: 9015.7, 1: 8851.3. Samples: 802091784. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:43,784][121949] Avg episode reward: [(0, '5994.789'), (1, '5578.078')] [2023-12-26 12:08:43,824][123091] Updated weights for policy 0, policy_version 1571834 (0.0011) [2023-12-26 12:08:43,890][123091] Updated weights for policy 0, policy_version 1571844 (0.0011) [2023-12-26 12:08:43,955][123091] Updated weights for policy 0, policy_version 1571854 (0.0011) [2023-12-26 12:08:44,081][123090] Updated weights for policy 1, policy_version 1561353 (0.0009) [2023-12-26 12:08:44,153][123090] Updated weights for policy 1, policy_version 1561363 (0.0010) [2023-12-26 12:08:44,212][123090] Updated weights for policy 1, policy_version 1561373 (0.0010) [2023-12-26 12:08:44,649][123091] Updated weights for policy 0, policy_version 1571864 (0.0008) [2023-12-26 12:08:44,721][123091] Updated weights for policy 0, policy_version 1571874 (0.0005) [2023-12-26 12:08:44,790][123091] Updated weights for policy 0, policy_version 1571884 (0.0006) [2023-12-26 12:08:45,071][123090] Updated weights for policy 1, policy_version 1561383 (0.0010) [2023-12-26 12:08:45,139][123090] Updated weights for policy 1, policy_version 1561393 (0.0010) [2023-12-26 12:08:45,199][123090] Updated weights for policy 1, policy_version 1561403 (0.0010) [2023-12-26 12:08:45,456][123091] Updated weights for policy 0, policy_version 1571894 (0.0008) [2023-12-26 12:08:45,522][123091] Updated weights for policy 0, policy_version 1571904 (0.0006) [2023-12-26 12:08:45,586][123091] Updated weights for policy 0, policy_version 1571914 (0.0005) [2023-12-26 12:08:46,134][123090] Updated weights for policy 1, policy_version 1561413 (0.0009) [2023-12-26 12:08:46,163][123091] Updated weights for policy 0, policy_version 1571924 (0.0006) [2023-12-26 12:08:46,187][123090] Updated weights for policy 1, policy_version 1561423 (0.0008) [2023-12-26 12:08:46,217][123091] Updated weights for policy 0, policy_version 1571934 (0.0006) [2023-12-26 12:08:46,245][123090] Updated weights for policy 1, policy_version 1561433 (0.0010) [2023-12-26 12:08:46,264][123091] Updated weights for policy 0, policy_version 1571944 (0.0007) [2023-12-26 12:08:46,949][123091] Updated weights for policy 0, policy_version 1571954 (0.0007) [2023-12-26 12:08:47,007][123091] Updated weights for policy 0, policy_version 1571964 (0.0011) [2023-12-26 12:08:47,077][123091] Updated weights for policy 0, policy_version 1571974 (0.0010) [2023-12-26 12:08:47,133][123090] Updated weights for policy 1, policy_version 1561443 (0.0010) [2023-12-26 12:08:47,136][123091] Updated weights for policy 0, policy_version 1571984 (0.0011) [2023-12-26 12:08:47,185][123090] Updated weights for policy 1, policy_version 1561453 (0.0005) [2023-12-26 12:08:47,251][123090] Updated weights for policy 1, policy_version 1561463 (0.0005) [2023-12-26 12:08:47,835][123091] Updated weights for policy 0, policy_version 1571994 (0.0005) [2023-12-26 12:08:47,893][123091] Updated weights for policy 0, policy_version 1572004 (0.0005) [2023-12-26 12:08:47,918][123090] Updated weights for policy 1, policy_version 1561473 (0.0005) [2023-12-26 12:08:47,966][123091] Updated weights for policy 0, policy_version 1572014 (0.0005) [2023-12-26 12:08:47,976][123090] Updated weights for policy 1, policy_version 1561483 (0.0005) [2023-12-26 12:08:48,025][123090] Updated weights for policy 1, policy_version 1561493 (0.0007) [2023-12-26 12:08:48,087][123090] Updated weights for policy 1, policy_version 1561503 (0.0006) [2023-12-26 12:08:48,708][123091] Updated weights for policy 0, policy_version 1572024 (0.0008) [2023-12-26 12:08:48,779][123091] Updated weights for policy 0, policy_version 1572034 (0.0011) [2023-12-26 12:08:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 802185216. Throughput: 0: 9188.3, 1: 8798.4. Samples: 802202116. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:48,785][121949] Avg episode reward: [(0, '6017.357'), (1, '5591.659')] [2023-12-26 12:08:48,847][123091] Updated weights for policy 0, policy_version 1572044 (0.0011) [2023-12-26 12:08:48,895][123090] Updated weights for policy 1, policy_version 1561513 (0.0008) [2023-12-26 12:08:48,967][123090] Updated weights for policy 1, policy_version 1561523 (0.0006) [2023-12-26 12:08:49,039][123090] Updated weights for policy 1, policy_version 1561533 (0.0009) [2023-12-26 12:08:49,660][123091] Updated weights for policy 0, policy_version 1572054 (0.0011) [2023-12-26 12:08:49,719][123091] Updated weights for policy 0, policy_version 1572064 (0.0011) [2023-12-26 12:08:49,736][123090] Updated weights for policy 1, policy_version 1561543 (0.0009) [2023-12-26 12:08:49,775][123091] Updated weights for policy 0, policy_version 1572074 (0.0011) [2023-12-26 12:08:49,796][123090] Updated weights for policy 1, policy_version 1561553 (0.0011) [2023-12-26 12:08:49,871][123090] Updated weights for policy 1, policy_version 1561563 (0.0010) [2023-12-26 12:08:50,506][123091] Updated weights for policy 0, policy_version 1572084 (0.0007) [2023-12-26 12:08:50,567][123091] Updated weights for policy 0, policy_version 1572094 (0.0010) [2023-12-26 12:08:50,629][123091] Updated weights for policy 0, policy_version 1572104 (0.0010) [2023-12-26 12:08:50,707][123090] Updated weights for policy 1, policy_version 1561573 (0.0011) [2023-12-26 12:08:50,779][123090] Updated weights for policy 1, policy_version 1561583 (0.0011) [2023-12-26 12:08:50,839][123090] Updated weights for policy 1, policy_version 1561593 (0.0011) [2023-12-26 12:08:51,425][123091] Updated weights for policy 0, policy_version 1572114 (0.0010) [2023-12-26 12:08:51,495][123091] Updated weights for policy 0, policy_version 1572124 (0.0008) [2023-12-26 12:08:51,554][123091] Updated weights for policy 0, policy_version 1572134 (0.0008) [2023-12-26 12:08:51,626][123091] Updated weights for policy 0, policy_version 1572144 (0.0008) [2023-12-26 12:08:51,640][123090] Updated weights for policy 1, policy_version 1561603 (0.0010) [2023-12-26 12:08:51,712][123090] Updated weights for policy 1, policy_version 1561613 (0.0007) [2023-12-26 12:08:51,790][123090] Updated weights for policy 1, policy_version 1561623 (0.0006) [2023-12-26 12:08:52,409][123091] Updated weights for policy 0, policy_version 1572154 (0.0011) [2023-12-26 12:08:52,474][123091] Updated weights for policy 0, policy_version 1572164 (0.0011) [2023-12-26 12:08:52,538][123091] Updated weights for policy 0, policy_version 1572174 (0.0011) [2023-12-26 12:08:52,593][123090] Updated weights for policy 1, policy_version 1561633 (0.0006) [2023-12-26 12:08:52,645][123090] Updated weights for policy 1, policy_version 1561643 (0.0011) [2023-12-26 12:08:52,697][123090] Updated weights for policy 1, policy_version 1561653 (0.0010) [2023-12-26 12:08:52,746][123090] Updated weights for policy 1, policy_version 1561663 (0.0010) [2023-12-26 12:08:53,321][123091] Updated weights for policy 0, policy_version 1572184 (0.0010) [2023-12-26 12:08:53,373][123091] Updated weights for policy 0, policy_version 1572194 (0.0009) [2023-12-26 12:08:53,422][123091] Updated weights for policy 0, policy_version 1572204 (0.0009) [2023-12-26 12:08:53,543][123090] Updated weights for policy 1, policy_version 1561673 (0.0006) [2023-12-26 12:08:53,597][123090] Updated weights for policy 1, policy_version 1561683 (0.0005) [2023-12-26 12:08:53,660][123090] Updated weights for policy 1, policy_version 1561693 (0.0005) [2023-12-26 12:08:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 802283520. Throughput: 0: 9140.6, 1: 8824.6. Samples: 802255048. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:53,785][121949] Avg episode reward: [(0, '6180.898'), (1, '5594.521')] [2023-12-26 12:08:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001572208_402489344.pth... [2023-12-26 12:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001561696_399794176.pth... [2023-12-26 12:08:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001571120_402210816.pth [2023-12-26 12:08:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001560672_399532032.pth [2023-12-26 12:08:54,260][123090] Updated weights for policy 1, policy_version 1561703 (0.0005) [2023-12-26 12:08:54,284][123091] Updated weights for policy 0, policy_version 1572214 (0.0010) [2023-12-26 12:08:54,323][123090] Updated weights for policy 1, policy_version 1561713 (0.0008) [2023-12-26 12:08:54,331][123091] Updated weights for policy 0, policy_version 1572224 (0.0010) [2023-12-26 12:08:54,387][123090] Updated weights for policy 1, policy_version 1561723 (0.0010) [2023-12-26 12:08:54,399][123091] Updated weights for policy 0, policy_version 1572234 (0.0011) [2023-12-26 12:08:55,186][123090] Updated weights for policy 1, policy_version 1561733 (0.0010) [2023-12-26 12:08:55,222][123091] Updated weights for policy 0, policy_version 1572244 (0.0010) [2023-12-26 12:08:55,249][123090] Updated weights for policy 1, policy_version 1561743 (0.0010) [2023-12-26 12:08:55,278][123091] Updated weights for policy 0, policy_version 1572254 (0.0010) [2023-12-26 12:08:55,304][123090] Updated weights for policy 1, policy_version 1561753 (0.0010) [2023-12-26 12:08:55,336][123091] Updated weights for policy 0, policy_version 1572264 (0.0010) [2023-12-26 12:08:55,959][123090] Updated weights for policy 1, policy_version 1561763 (0.0010) [2023-12-26 12:08:56,028][123090] Updated weights for policy 1, policy_version 1561773 (0.0010) [2023-12-26 12:08:56,094][123090] Updated weights for policy 1, policy_version 1561783 (0.0010) [2023-12-26 12:08:56,175][123091] Updated weights for policy 0, policy_version 1572274 (0.0010) [2023-12-26 12:08:56,246][123091] Updated weights for policy 0, policy_version 1572284 (0.0005) [2023-12-26 12:08:56,309][123091] Updated weights for policy 0, policy_version 1572294 (0.0008) [2023-12-26 12:08:56,368][123091] Updated weights for policy 0, policy_version 1572304 (0.0011) [2023-12-26 12:08:56,896][123090] Updated weights for policy 1, policy_version 1561793 (0.0010) [2023-12-26 12:08:56,953][123090] Updated weights for policy 1, policy_version 1561803 (0.0005) [2023-12-26 12:08:57,006][123090] Updated weights for policy 1, policy_version 1561813 (0.0005) [2023-12-26 12:08:57,054][123090] Updated weights for policy 1, policy_version 1561823 (0.0005) [2023-12-26 12:08:57,140][123091] Updated weights for policy 0, policy_version 1572314 (0.0010) [2023-12-26 12:08:57,190][123091] Updated weights for policy 0, policy_version 1572324 (0.0010) [2023-12-26 12:08:57,237][123091] Updated weights for policy 0, policy_version 1572334 (0.0010) [2023-12-26 12:08:57,686][123090] Updated weights for policy 1, policy_version 1561833 (0.0009) [2023-12-26 12:08:57,739][123090] Updated weights for policy 1, policy_version 1561843 (0.0009) [2023-12-26 12:08:57,793][123090] Updated weights for policy 1, policy_version 1561853 (0.0009) [2023-12-26 12:08:58,073][123091] Updated weights for policy 0, policy_version 1572344 (0.0009) [2023-12-26 12:08:58,139][123091] Updated weights for policy 0, policy_version 1572354 (0.0008) [2023-12-26 12:08:58,204][123091] Updated weights for policy 0, policy_version 1572364 (0.0009) [2023-12-26 12:08:58,665][123090] Updated weights for policy 1, policy_version 1561863 (0.0008) [2023-12-26 12:08:58,739][123090] Updated weights for policy 1, policy_version 1561873 (0.0007) [2023-12-26 12:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 802365440. Throughput: 0: 9157.8, 1: 8978.1. Samples: 802364932. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:08:58,785][121949] Avg episode reward: [(0, '6249.625'), (1, '5663.914')] [2023-12-26 12:08:58,827][123090] Updated weights for policy 1, policy_version 1561883 (0.0008) [2023-12-26 12:08:59,123][123091] Updated weights for policy 0, policy_version 1572374 (0.0008) [2023-12-26 12:08:59,187][123091] Updated weights for policy 0, policy_version 1572384 (0.0007) [2023-12-26 12:08:59,265][123091] Updated weights for policy 0, policy_version 1572395 (0.0008) [2023-12-26 12:08:59,578][123090] Updated weights for policy 1, policy_version 1561893 (0.0008) [2023-12-26 12:08:59,629][123090] Updated weights for policy 1, policy_version 1561903 (0.0008) [2023-12-26 12:08:59,672][123090] Updated weights for policy 1, policy_version 1561913 (0.0008) [2023-12-26 12:09:00,083][123091] Updated weights for policy 0, policy_version 1572405 (0.0007) [2023-12-26 12:09:00,149][123091] Updated weights for policy 0, policy_version 1572415 (0.0006) [2023-12-26 12:09:00,203][123091] Updated weights for policy 0, policy_version 1572425 (0.0006) [2023-12-26 12:09:00,550][123090] Updated weights for policy 1, policy_version 1561923 (0.0009) [2023-12-26 12:09:00,611][123090] Updated weights for policy 1, policy_version 1561933 (0.0009) [2023-12-26 12:09:00,665][123090] Updated weights for policy 1, policy_version 1561943 (0.0010) [2023-12-26 12:09:00,896][123091] Updated weights for policy 0, policy_version 1572435 (0.0007) [2023-12-26 12:09:00,956][123091] Updated weights for policy 0, policy_version 1572445 (0.0009) [2023-12-26 12:09:01,020][123091] Updated weights for policy 0, policy_version 1572455 (0.0009) [2023-12-26 12:09:01,489][123090] Updated weights for policy 1, policy_version 1561953 (0.0009) [2023-12-26 12:09:01,544][123090] Updated weights for policy 1, policy_version 1561963 (0.0009) [2023-12-26 12:09:01,595][123090] Updated weights for policy 1, policy_version 1561973 (0.0010) [2023-12-26 12:09:01,660][123090] Updated weights for policy 1, policy_version 1561983 (0.0010) [2023-12-26 12:09:01,859][123091] Updated weights for policy 0, policy_version 1572465 (0.0009) [2023-12-26 12:09:01,916][123091] Updated weights for policy 0, policy_version 1572475 (0.0009) [2023-12-26 12:09:01,966][123091] Updated weights for policy 0, policy_version 1572485 (0.0009) [2023-12-26 12:09:02,024][123091] Updated weights for policy 0, policy_version 1572495 (0.0009) [2023-12-26 12:09:02,467][123090] Updated weights for policy 1, policy_version 1561993 (0.0008) [2023-12-26 12:09:02,521][123090] Updated weights for policy 1, policy_version 1562003 (0.0008) [2023-12-26 12:09:02,588][123090] Updated weights for policy 1, policy_version 1562013 (0.0008) [2023-12-26 12:09:02,895][123091] Updated weights for policy 0, policy_version 1572505 (0.0010) [2023-12-26 12:09:02,948][123091] Updated weights for policy 0, policy_version 1572515 (0.0011) [2023-12-26 12:09:03,016][123091] Updated weights for policy 0, policy_version 1572525 (0.0011) [2023-12-26 12:09:03,403][123090] Updated weights for policy 1, policy_version 1562023 (0.0009) [2023-12-26 12:09:03,459][123090] Updated weights for policy 1, policy_version 1562033 (0.0010) [2023-12-26 12:09:03,518][123090] Updated weights for policy 1, policy_version 1562043 (0.0010) [2023-12-26 12:09:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 802455552. Throughput: 0: 9024.6, 1: 8812.6. Samples: 802466900. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:03,785][121949] Avg episode reward: [(0, '6307.098'), (1, '5793.359')] [2023-12-26 12:09:03,840][123091] Updated weights for policy 0, policy_version 1572535 (0.0007) [2023-12-26 12:09:03,904][123091] Updated weights for policy 0, policy_version 1572545 (0.0007) [2023-12-26 12:09:03,974][123091] Updated weights for policy 0, policy_version 1572555 (0.0005) [2023-12-26 12:09:04,286][123090] Updated weights for policy 1, policy_version 1562053 (0.0009) [2023-12-26 12:09:04,355][123090] Updated weights for policy 1, policy_version 1562063 (0.0009) [2023-12-26 12:09:04,422][123090] Updated weights for policy 1, policy_version 1562073 (0.0008) [2023-12-26 12:09:04,658][123091] Updated weights for policy 0, policy_version 1572565 (0.0006) [2023-12-26 12:09:04,706][123091] Updated weights for policy 0, policy_version 1572575 (0.0005) [2023-12-26 12:09:04,756][123091] Updated weights for policy 0, policy_version 1572585 (0.0007) [2023-12-26 12:09:05,259][123090] Updated weights for policy 1, policy_version 1562083 (0.0008) [2023-12-26 12:09:05,306][123090] Updated weights for policy 1, policy_version 1562093 (0.0005) [2023-12-26 12:09:05,350][123090] Updated weights for policy 1, policy_version 1562103 (0.0005) [2023-12-26 12:09:05,420][123091] Updated weights for policy 0, policy_version 1572595 (0.0008) [2023-12-26 12:09:05,468][123091] Updated weights for policy 0, policy_version 1572605 (0.0005) [2023-12-26 12:09:05,518][123091] Updated weights for policy 0, policy_version 1572615 (0.0005) [2023-12-26 12:09:06,070][123090] Updated weights for policy 1, policy_version 1562113 (0.0006) [2023-12-26 12:09:06,138][123090] Updated weights for policy 1, policy_version 1562123 (0.0010) [2023-12-26 12:09:06,210][123090] Updated weights for policy 1, policy_version 1562133 (0.0011) [2023-12-26 12:09:06,272][123090] Updated weights for policy 1, policy_version 1562143 (0.0011) [2023-12-26 12:09:06,345][123091] Updated weights for policy 0, policy_version 1572625 (0.0006) [2023-12-26 12:09:06,408][123091] Updated weights for policy 0, policy_version 1572635 (0.0011) [2023-12-26 12:09:06,473][123091] Updated weights for policy 0, policy_version 1572645 (0.0011) [2023-12-26 12:09:06,534][123091] Updated weights for policy 0, policy_version 1572655 (0.0011) [2023-12-26 12:09:07,014][123090] Updated weights for policy 1, policy_version 1562153 (0.0006) [2023-12-26 12:09:07,084][123090] Updated weights for policy 1, policy_version 1562163 (0.0010) [2023-12-26 12:09:07,135][123090] Updated weights for policy 1, policy_version 1562173 (0.0010) [2023-12-26 12:09:07,371][123091] Updated weights for policy 0, policy_version 1572665 (0.0011) [2023-12-26 12:09:07,440][123091] Updated weights for policy 0, policy_version 1572675 (0.0010) [2023-12-26 12:09:07,500][123091] Updated weights for policy 0, policy_version 1572685 (0.0010) [2023-12-26 12:09:07,930][123090] Updated weights for policy 1, policy_version 1562183 (0.0010) [2023-12-26 12:09:07,997][123090] Updated weights for policy 1, policy_version 1562193 (0.0011) [2023-12-26 12:09:08,064][123090] Updated weights for policy 1, policy_version 1562203 (0.0010) [2023-12-26 12:09:08,230][123091] Updated weights for policy 0, policy_version 1572695 (0.0009) [2023-12-26 12:09:08,285][123091] Updated weights for policy 0, policy_version 1572705 (0.0007) [2023-12-26 12:09:08,361][123091] Updated weights for policy 0, policy_version 1572715 (0.0008) [2023-12-26 12:09:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 802545664. Throughput: 0: 9073.9, 1: 8833.8. Samples: 802522876. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:08,785][121949] Avg episode reward: [(0, '6151.456'), (1, '5905.644')] [2023-12-26 12:09:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001572720_402620416.pth... [2023-12-26 12:09:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001562208_399925248.pth... [2023-12-26 12:09:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001571664_402350080.pth [2023-12-26 12:09:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001561184_399663104.pth [2023-12-26 12:09:08,854][123090] Updated weights for policy 1, policy_version 1562213 (0.0010) [2023-12-26 12:09:08,924][123090] Updated weights for policy 1, policy_version 1562223 (0.0008) [2023-12-26 12:09:08,994][123090] Updated weights for policy 1, policy_version 1562233 (0.0008) [2023-12-26 12:09:09,130][123091] Updated weights for policy 0, policy_version 1572725 (0.0008) [2023-12-26 12:09:09,184][123091] Updated weights for policy 0, policy_version 1572736 (0.0010) [2023-12-26 12:09:09,246][123091] Updated weights for policy 0, policy_version 1572747 (0.0010) [2023-12-26 12:09:09,772][123090] Updated weights for policy 1, policy_version 1562243 (0.0009) [2023-12-26 12:09:09,849][123090] Updated weights for policy 1, policy_version 1562254 (0.0008) [2023-12-26 12:09:09,918][123090] Updated weights for policy 1, policy_version 1562264 (0.0009) [2023-12-26 12:09:10,191][123091] Updated weights for policy 0, policy_version 1572757 (0.0010) [2023-12-26 12:09:10,251][123091] Updated weights for policy 0, policy_version 1572767 (0.0009) [2023-12-26 12:09:10,312][123091] Updated weights for policy 0, policy_version 1572777 (0.0009) [2023-12-26 12:09:10,694][123090] Updated weights for policy 1, policy_version 1562274 (0.0006) [2023-12-26 12:09:10,746][123090] Updated weights for policy 1, policy_version 1562284 (0.0009) [2023-12-26 12:09:10,803][123090] Updated weights for policy 1, policy_version 1562294 (0.0009) [2023-12-26 12:09:10,851][123090] Updated weights for policy 1, policy_version 1562304 (0.0009) [2023-12-26 12:09:11,197][123091] Updated weights for policy 0, policy_version 1572787 (0.0009) [2023-12-26 12:09:11,265][123091] Updated weights for policy 0, policy_version 1572797 (0.0007) [2023-12-26 12:09:11,334][123091] Updated weights for policy 0, policy_version 1572807 (0.0009) [2023-12-26 12:09:11,730][123090] Updated weights for policy 1, policy_version 1562314 (0.0009) [2023-12-26 12:09:11,800][123090] Updated weights for policy 1, policy_version 1562324 (0.0009) [2023-12-26 12:09:11,871][123090] Updated weights for policy 1, policy_version 1562334 (0.0009) [2023-12-26 12:09:12,128][123091] Updated weights for policy 0, policy_version 1572817 (0.0009) [2023-12-26 12:09:12,195][123091] Updated weights for policy 0, policy_version 1572827 (0.0009) [2023-12-26 12:09:12,267][123091] Updated weights for policy 0, policy_version 1572837 (0.0010) [2023-12-26 12:09:12,326][123091] Updated weights for policy 0, policy_version 1572847 (0.0010) [2023-12-26 12:09:12,672][123090] Updated weights for policy 1, policy_version 1562344 (0.0009) [2023-12-26 12:09:12,733][123090] Updated weights for policy 1, policy_version 1562354 (0.0009) [2023-12-26 12:09:12,783][123090] Updated weights for policy 1, policy_version 1562364 (0.0009) [2023-12-26 12:09:13,180][123091] Updated weights for policy 0, policy_version 1572857 (0.0007) [2023-12-26 12:09:13,232][123091] Updated weights for policy 0, policy_version 1572867 (0.0009) [2023-12-26 12:09:13,296][123091] Updated weights for policy 0, policy_version 1572877 (0.0008) [2023-12-26 12:09:13,616][123090] Updated weights for policy 1, policy_version 1562374 (0.0010) [2023-12-26 12:09:13,680][123090] Updated weights for policy 1, policy_version 1562384 (0.0011) [2023-12-26 12:09:13,729][123090] Updated weights for policy 1, policy_version 1562394 (0.0010) [2023-12-26 12:09:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 802635776. Throughput: 0: 8968.0, 1: 8880.2. Samples: 802627504. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:13,785][121949] Avg episode reward: [(0, '6099.433'), (1, '5827.534')] [2023-12-26 12:09:14,098][123091] Updated weights for policy 0, policy_version 1572887 (0.0009) [2023-12-26 12:09:14,152][123091] Updated weights for policy 0, policy_version 1572899 (0.0010) [2023-12-26 12:09:14,209][123091] Updated weights for policy 0, policy_version 1572910 (0.0009) [2023-12-26 12:09:14,499][123090] Updated weights for policy 1, policy_version 1562404 (0.0009) [2023-12-26 12:09:14,573][123090] Updated weights for policy 1, policy_version 1562414 (0.0007) [2023-12-26 12:09:14,644][123090] Updated weights for policy 1, policy_version 1562424 (0.0007) [2023-12-26 12:09:15,067][123091] Updated weights for policy 0, policy_version 1572920 (0.0010) [2023-12-26 12:09:15,132][123091] Updated weights for policy 0, policy_version 1572930 (0.0009) [2023-12-26 12:09:15,197][123091] Updated weights for policy 0, policy_version 1572940 (0.0009) [2023-12-26 12:09:15,331][123090] Updated weights for policy 1, policy_version 1562434 (0.0007) [2023-12-26 12:09:15,384][123090] Updated weights for policy 1, policy_version 1562444 (0.0008) [2023-12-26 12:09:15,436][123090] Updated weights for policy 1, policy_version 1562454 (0.0010) [2023-12-26 12:09:15,488][123090] Updated weights for policy 1, policy_version 1562464 (0.0010) [2023-12-26 12:09:15,999][123091] Updated weights for policy 0, policy_version 1572950 (0.0007) [2023-12-26 12:09:16,053][123091] Updated weights for policy 0, policy_version 1572960 (0.0006) [2023-12-26 12:09:16,106][123091] Updated weights for policy 0, policy_version 1572970 (0.0005) [2023-12-26 12:09:16,159][123090] Updated weights for policy 1, policy_version 1562474 (0.0010) [2023-12-26 12:09:16,203][123090] Updated weights for policy 1, policy_version 1562484 (0.0010) [2023-12-26 12:09:16,250][123090] Updated weights for policy 1, policy_version 1562494 (0.0010) [2023-12-26 12:09:16,914][123090] Updated weights for policy 1, policy_version 1562504 (0.0005) [2023-12-26 12:09:16,935][123091] Updated weights for policy 0, policy_version 1572980 (0.0007) [2023-12-26 12:09:16,978][123090] Updated weights for policy 1, policy_version 1562514 (0.0005) [2023-12-26 12:09:16,996][123091] Updated weights for policy 0, policy_version 1572990 (0.0010) [2023-12-26 12:09:17,042][123090] Updated weights for policy 1, policy_version 1562524 (0.0005) [2023-12-26 12:09:17,057][123091] Updated weights for policy 0, policy_version 1573000 (0.0009) [2023-12-26 12:09:17,716][123090] Updated weights for policy 1, policy_version 1562534 (0.0006) [2023-12-26 12:09:17,781][123090] Updated weights for policy 1, policy_version 1562544 (0.0005) [2023-12-26 12:09:17,850][123090] Updated weights for policy 1, policy_version 1562554 (0.0005) [2023-12-26 12:09:17,987][123091] Updated weights for policy 0, policy_version 1573010 (0.0008) [2023-12-26 12:09:18,053][123091] Updated weights for policy 0, policy_version 1573020 (0.0010) [2023-12-26 12:09:18,107][123091] Updated weights for policy 0, policy_version 1573030 (0.0010) [2023-12-26 12:09:18,160][123091] Updated weights for policy 0, policy_version 1573040 (0.0010) [2023-12-26 12:09:18,479][123090] Updated weights for policy 1, policy_version 1562564 (0.0007) [2023-12-26 12:09:18,534][123090] Updated weights for policy 1, policy_version 1562574 (0.0010) [2023-12-26 12:09:18,592][123090] Updated weights for policy 1, policy_version 1562584 (0.0010) [2023-12-26 12:09:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 802725888. Throughput: 0: 8896.3, 1: 9013.2. Samples: 802735636. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:18,785][121949] Avg episode reward: [(0, '5935.653'), (1, '5737.203')] [2023-12-26 12:09:19,068][123091] Updated weights for policy 0, policy_version 1573050 (0.0007) [2023-12-26 12:09:19,127][123091] Updated weights for policy 0, policy_version 1573060 (0.0005) [2023-12-26 12:09:19,185][123091] Updated weights for policy 0, policy_version 1573070 (0.0007) [2023-12-26 12:09:19,452][123090] Updated weights for policy 1, policy_version 1562594 (0.0009) [2023-12-26 12:09:19,528][123090] Updated weights for policy 1, policy_version 1562605 (0.0007) [2023-12-26 12:09:19,578][123090] Updated weights for policy 1, policy_version 1562615 (0.0007) [2023-12-26 12:09:20,019][123091] Updated weights for policy 0, policy_version 1573080 (0.0010) [2023-12-26 12:09:20,077][123091] Updated weights for policy 0, policy_version 1573090 (0.0009) [2023-12-26 12:09:20,132][123091] Updated weights for policy 0, policy_version 1573100 (0.0008) [2023-12-26 12:09:20,406][123090] Updated weights for policy 1, policy_version 1562625 (0.0010) [2023-12-26 12:09:20,469][123090] Updated weights for policy 1, policy_version 1562635 (0.0009) [2023-12-26 12:09:20,536][123090] Updated weights for policy 1, policy_version 1562645 (0.0010) [2023-12-26 12:09:20,605][123090] Updated weights for policy 1, policy_version 1562655 (0.0009) [2023-12-26 12:09:21,015][123091] Updated weights for policy 0, policy_version 1573110 (0.0009) [2023-12-26 12:09:21,084][123091] Updated weights for policy 0, policy_version 1573120 (0.0009) [2023-12-26 12:09:21,150][123091] Updated weights for policy 0, policy_version 1573130 (0.0009) [2023-12-26 12:09:21,445][123090] Updated weights for policy 1, policy_version 1562665 (0.0006) [2023-12-26 12:09:21,518][123090] Updated weights for policy 1, policy_version 1562675 (0.0006) [2023-12-26 12:09:21,589][123090] Updated weights for policy 1, policy_version 1562685 (0.0005) [2023-12-26 12:09:21,915][123091] Updated weights for policy 0, policy_version 1573140 (0.0010) [2023-12-26 12:09:21,983][123091] Updated weights for policy 0, policy_version 1573150 (0.0010) [2023-12-26 12:09:22,041][123091] Updated weights for policy 0, policy_version 1573160 (0.0009) [2023-12-26 12:09:22,425][123090] Updated weights for policy 1, policy_version 1562695 (0.0008) [2023-12-26 12:09:22,496][123090] Updated weights for policy 1, policy_version 1562705 (0.0008) [2023-12-26 12:09:22,561][123090] Updated weights for policy 1, policy_version 1562715 (0.0009) [2023-12-26 12:09:22,831][123091] Updated weights for policy 0, policy_version 1573170 (0.0010) [2023-12-26 12:09:22,889][123091] Updated weights for policy 0, policy_version 1573180 (0.0009) [2023-12-26 12:09:22,941][123091] Updated weights for policy 0, policy_version 1573190 (0.0006) [2023-12-26 12:09:22,989][123091] Updated weights for policy 0, policy_version 1573200 (0.0005) [2023-12-26 12:09:23,435][123090] Updated weights for policy 1, policy_version 1562725 (0.0009) [2023-12-26 12:09:23,488][123090] Updated weights for policy 1, policy_version 1562736 (0.0010) [2023-12-26 12:09:23,543][123090] Updated weights for policy 1, policy_version 1562747 (0.0010) [2023-12-26 12:09:23,700][123091] Updated weights for policy 0, policy_version 1573210 (0.0011) [2023-12-26 12:09:23,755][123091] Updated weights for policy 0, policy_version 1573220 (0.0011) [2023-12-26 12:09:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 802807808. Throughput: 0: 8832.8, 1: 8945.8. Samples: 802786160. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:23,785][121949] Avg episode reward: [(0, '5931.989'), (1, '5893.572')] [2023-12-26 12:09:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001562752_400064512.pth... [2023-12-26 12:09:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001561696_399794176.pth [2023-12-26 12:09:23,814][123091] Updated weights for policy 0, policy_version 1573230 (0.0010) [2023-12-26 12:09:23,821][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001573232_402751488.pth... [2023-12-26 12:09:23,826][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001572208_402489344.pth [2023-12-26 12:09:24,454][123090] Updated weights for policy 1, policy_version 1562758 (0.0010) [2023-12-26 12:09:24,505][123090] Updated weights for policy 1, policy_version 1562768 (0.0010) [2023-12-26 12:09:24,553][123090] Updated weights for policy 1, policy_version 1562778 (0.0009) [2023-12-26 12:09:24,590][123091] Updated weights for policy 0, policy_version 1573240 (0.0008) [2023-12-26 12:09:24,653][123091] Updated weights for policy 0, policy_version 1573250 (0.0008) [2023-12-26 12:09:24,719][123091] Updated weights for policy 0, policy_version 1573260 (0.0010) [2023-12-26 12:09:25,224][123090] Updated weights for policy 1, policy_version 1562788 (0.0007) [2023-12-26 12:09:25,269][123090] Updated weights for policy 1, policy_version 1562798 (0.0005) [2023-12-26 12:09:25,315][123090] Updated weights for policy 1, policy_version 1562808 (0.0005) [2023-12-26 12:09:25,529][123091] Updated weights for policy 0, policy_version 1573270 (0.0010) [2023-12-26 12:09:25,572][123091] Updated weights for policy 0, policy_version 1573280 (0.0010) [2023-12-26 12:09:25,623][123091] Updated weights for policy 0, policy_version 1573290 (0.0010) [2023-12-26 12:09:25,903][123090] Updated weights for policy 1, policy_version 1562818 (0.0006) [2023-12-26 12:09:25,968][123090] Updated weights for policy 1, policy_version 1562828 (0.0008) [2023-12-26 12:09:26,036][123090] Updated weights for policy 1, policy_version 1562838 (0.0008) [2023-12-26 12:09:26,084][123090] Updated weights for policy 1, policy_version 1562848 (0.0010) [2023-12-26 12:09:26,431][123091] Updated weights for policy 0, policy_version 1573300 (0.0008) [2023-12-26 12:09:26,478][123091] Updated weights for policy 0, policy_version 1573310 (0.0005) [2023-12-26 12:09:26,529][123091] Updated weights for policy 0, policy_version 1573320 (0.0006) [2023-12-26 12:09:26,934][123090] Updated weights for policy 1, policy_version 1562858 (0.0006) [2023-12-26 12:09:26,984][123090] Updated weights for policy 1, policy_version 1562868 (0.0005) [2023-12-26 12:09:27,030][123090] Updated weights for policy 1, policy_version 1562878 (0.0005) [2023-12-26 12:09:27,151][123091] Updated weights for policy 0, policy_version 1573330 (0.0005) [2023-12-26 12:09:27,206][123091] Updated weights for policy 0, policy_version 1573340 (0.0005) [2023-12-26 12:09:27,251][123091] Updated weights for policy 0, policy_version 1573350 (0.0005) [2023-12-26 12:09:27,305][123091] Updated weights for policy 0, policy_version 1573360 (0.0006) [2023-12-26 12:09:27,738][123090] Updated weights for policy 1, policy_version 1562888 (0.0006) [2023-12-26 12:09:27,801][123090] Updated weights for policy 1, policy_version 1562898 (0.0005) [2023-12-26 12:09:27,873][123090] Updated weights for policy 1, policy_version 1562908 (0.0005) [2023-12-26 12:09:28,050][123091] Updated weights for policy 0, policy_version 1573370 (0.0011) [2023-12-26 12:09:28,116][123091] Updated weights for policy 0, policy_version 1573380 (0.0010) [2023-12-26 12:09:28,170][123091] Updated weights for policy 0, policy_version 1573390 (0.0010) [2023-12-26 12:09:28,518][123090] Updated weights for policy 1, policy_version 1562918 (0.0005) [2023-12-26 12:09:28,577][123090] Updated weights for policy 1, policy_version 1562928 (0.0006) [2023-12-26 12:09:28,635][123090] Updated weights for policy 1, policy_version 1562938 (0.0005) [2023-12-26 12:09:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 802906112. Throughput: 0: 8899.3, 1: 9000.5. Samples: 802897276. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:28,785][121949] Avg episode reward: [(0, '6073.725'), (1, '5857.250')] [2023-12-26 12:09:28,892][123091] Updated weights for policy 0, policy_version 1573400 (0.0008) [2023-12-26 12:09:28,965][123091] Updated weights for policy 0, policy_version 1573410 (0.0009) [2023-12-26 12:09:29,040][123091] Updated weights for policy 0, policy_version 1573420 (0.0008) [2023-12-26 12:09:29,391][123090] Updated weights for policy 1, policy_version 1562948 (0.0007) [2023-12-26 12:09:29,444][123090] Updated weights for policy 1, policy_version 1562958 (0.0009) [2023-12-26 12:09:29,498][123090] Updated weights for policy 1, policy_version 1562968 (0.0009) [2023-12-26 12:09:29,709][123091] Updated weights for policy 0, policy_version 1573430 (0.0009) [2023-12-26 12:09:29,775][123091] Updated weights for policy 0, policy_version 1573440 (0.0011) [2023-12-26 12:09:29,838][123091] Updated weights for policy 0, policy_version 1573450 (0.0011) [2023-12-26 12:09:30,336][123090] Updated weights for policy 1, policy_version 1562978 (0.0008) [2023-12-26 12:09:30,388][123090] Updated weights for policy 1, policy_version 1562988 (0.0009) [2023-12-26 12:09:30,446][123090] Updated weights for policy 1, policy_version 1562998 (0.0009) [2023-12-26 12:09:30,502][123090] Updated weights for policy 1, policy_version 1563008 (0.0009) [2023-12-26 12:09:30,583][123091] Updated weights for policy 0, policy_version 1573460 (0.0009) [2023-12-26 12:09:30,632][123091] Updated weights for policy 0, policy_version 1573470 (0.0009) [2023-12-26 12:09:30,682][123091] Updated weights for policy 0, policy_version 1573480 (0.0010) [2023-12-26 12:09:31,324][123090] Updated weights for policy 1, policy_version 1563018 (0.0011) [2023-12-26 12:09:31,376][123091] Updated weights for policy 0, policy_version 1573490 (0.0010) [2023-12-26 12:09:31,399][123090] Updated weights for policy 1, policy_version 1563028 (0.0009) [2023-12-26 12:09:31,426][123091] Updated weights for policy 0, policy_version 1573500 (0.0008) [2023-12-26 12:09:31,467][123090] Updated weights for policy 1, policy_version 1563038 (0.0007) [2023-12-26 12:09:31,476][123091] Updated weights for policy 0, policy_version 1573510 (0.0008) [2023-12-26 12:09:31,533][123091] Updated weights for policy 0, policy_version 1573520 (0.0009) [2023-12-26 12:09:32,227][123090] Updated weights for policy 1, policy_version 1563048 (0.0009) [2023-12-26 12:09:32,286][123090] Updated weights for policy 1, policy_version 1563058 (0.0008) [2023-12-26 12:09:32,353][123090] Updated weights for policy 1, policy_version 1563068 (0.0007) [2023-12-26 12:09:32,417][123091] Updated weights for policy 0, policy_version 1573530 (0.0009) [2023-12-26 12:09:32,475][123091] Updated weights for policy 0, policy_version 1573540 (0.0009) [2023-12-26 12:09:32,527][123091] Updated weights for policy 0, policy_version 1573550 (0.0009) [2023-12-26 12:09:33,168][123090] Updated weights for policy 1, policy_version 1563078 (0.0009) [2023-12-26 12:09:33,237][123090] Updated weights for policy 1, policy_version 1563088 (0.0009) [2023-12-26 12:09:33,280][123091] Updated weights for policy 0, policy_version 1573560 (0.0006) [2023-12-26 12:09:33,294][123090] Updated weights for policy 1, policy_version 1563098 (0.0006) [2023-12-26 12:09:33,348][123091] Updated weights for policy 0, policy_version 1573570 (0.0009) [2023-12-26 12:09:33,417][123091] Updated weights for policy 0, policy_version 1573580 (0.0005) [2023-12-26 12:09:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 802996224. Throughput: 0: 8816.2, 1: 9086.5. Samples: 803007736. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:33,785][121949] Avg episode reward: [(0, '6114.741'), (1, '5713.241')] [2023-12-26 12:09:34,012][123091] Updated weights for policy 0, policy_version 1573590 (0.0005) [2023-12-26 12:09:34,032][123090] Updated weights for policy 1, policy_version 1563108 (0.0005) [2023-12-26 12:09:34,060][123091] Updated weights for policy 0, policy_version 1573600 (0.0005) [2023-12-26 12:09:34,093][123090] Updated weights for policy 1, policy_version 1563118 (0.0010) [2023-12-26 12:09:34,124][123091] Updated weights for policy 0, policy_version 1573610 (0.0005) [2023-12-26 12:09:34,154][123090] Updated weights for policy 1, policy_version 1563128 (0.0010) [2023-12-26 12:09:34,878][123090] Updated weights for policy 1, policy_version 1563138 (0.0010) [2023-12-26 12:09:34,928][123091] Updated weights for policy 0, policy_version 1573620 (0.0009) [2023-12-26 12:09:34,942][123090] Updated weights for policy 1, policy_version 1563148 (0.0011) [2023-12-26 12:09:34,986][123091] Updated weights for policy 0, policy_version 1573630 (0.0010) [2023-12-26 12:09:34,999][123090] Updated weights for policy 1, policy_version 1563158 (0.0011) [2023-12-26 12:09:35,042][123091] Updated weights for policy 0, policy_version 1573640 (0.0010) [2023-12-26 12:09:35,047][123090] Updated weights for policy 1, policy_version 1563168 (0.0010) [2023-12-26 12:09:35,871][123091] Updated weights for policy 0, policy_version 1573650 (0.0009) [2023-12-26 12:09:35,881][123090] Updated weights for policy 1, policy_version 1563178 (0.0010) [2023-12-26 12:09:35,938][123091] Updated weights for policy 0, policy_version 1573660 (0.0005) [2023-12-26 12:09:35,944][123090] Updated weights for policy 1, policy_version 1563188 (0.0010) [2023-12-26 12:09:35,993][123090] Updated weights for policy 1, policy_version 1563198 (0.0010) [2023-12-26 12:09:35,994][123091] Updated weights for policy 0, policy_version 1573670 (0.0006) [2023-12-26 12:09:36,054][123091] Updated weights for policy 0, policy_version 1573680 (0.0008) [2023-12-26 12:09:36,796][123091] Updated weights for policy 0, policy_version 1573690 (0.0009) [2023-12-26 12:09:36,837][123090] Updated weights for policy 1, policy_version 1563208 (0.0011) [2023-12-26 12:09:36,857][123091] Updated weights for policy 0, policy_version 1573700 (0.0006) [2023-12-26 12:09:36,897][123090] Updated weights for policy 1, policy_version 1563218 (0.0011) [2023-12-26 12:09:36,917][123091] Updated weights for policy 0, policy_version 1573710 (0.0006) [2023-12-26 12:09:36,958][123090] Updated weights for policy 1, policy_version 1563228 (0.0011) [2023-12-26 12:09:37,770][123090] Updated weights for policy 1, policy_version 1563238 (0.0008) [2023-12-26 12:09:37,774][123091] Updated weights for policy 0, policy_version 1573720 (0.0009) [2023-12-26 12:09:37,830][123090] Updated weights for policy 1, policy_version 1563248 (0.0005) [2023-12-26 12:09:37,833][123091] Updated weights for policy 0, policy_version 1573731 (0.0009) [2023-12-26 12:09:37,888][123090] Updated weights for policy 1, policy_version 1563258 (0.0006) [2023-12-26 12:09:37,903][123091] Updated weights for policy 0, policy_version 1573741 (0.0007) [2023-12-26 12:09:38,618][123090] Updated weights for policy 1, policy_version 1563268 (0.0008) [2023-12-26 12:09:38,673][123090] Updated weights for policy 1, policy_version 1563278 (0.0009) [2023-12-26 12:09:38,738][123090] Updated weights for policy 1, policy_version 1563288 (0.0008) [2023-12-26 12:09:38,765][123091] Updated weights for policy 0, policy_version 1573751 (0.0007) [2023-12-26 12:09:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 803078144. Throughput: 0: 8857.5, 1: 9066.9. Samples: 803061648. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:38,785][121949] Avg episode reward: [(0, '5926.584'), (1, '5719.987')] [2023-12-26 12:09:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001563296_400203776.pth... [2023-12-26 12:09:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001562208_399925248.pth [2023-12-26 12:09:38,821][123091] Updated weights for policy 0, policy_version 1573761 (0.0010) [2023-12-26 12:09:38,884][123091] Updated weights for policy 0, policy_version 1573771 (0.0009) [2023-12-26 12:09:38,917][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001573776_402890752.pth... [2023-12-26 12:09:38,922][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001572720_402620416.pth [2023-12-26 12:09:39,556][123090] Updated weights for policy 1, policy_version 1563298 (0.0007) [2023-12-26 12:09:39,631][123090] Updated weights for policy 1, policy_version 1563308 (0.0010) [2023-12-26 12:09:39,702][123090] Updated weights for policy 1, policy_version 1563318 (0.0010) [2023-12-26 12:09:39,766][123091] Updated weights for policy 0, policy_version 1573781 (0.0009) [2023-12-26 12:09:39,772][123090] Updated weights for policy 1, policy_version 1563328 (0.0008) [2023-12-26 12:09:39,834][123091] Updated weights for policy 0, policy_version 1573791 (0.0009) [2023-12-26 12:09:39,902][123091] Updated weights for policy 0, policy_version 1573801 (0.0010) [2023-12-26 12:09:40,581][123090] Updated weights for policy 1, policy_version 1563338 (0.0010) [2023-12-26 12:09:40,634][123090] Updated weights for policy 1, policy_version 1563348 (0.0009) [2023-12-26 12:09:40,692][123090] Updated weights for policy 1, policy_version 1563358 (0.0009) [2023-12-26 12:09:40,778][123091] Updated weights for policy 0, policy_version 1573811 (0.0010) [2023-12-26 12:09:40,842][123091] Updated weights for policy 0, policy_version 1573821 (0.0010) [2023-12-26 12:09:40,892][123091] Updated weights for policy 0, policy_version 1573831 (0.0009) [2023-12-26 12:09:41,595][123090] Updated weights for policy 1, policy_version 1563368 (0.0008) [2023-12-26 12:09:41,661][123090] Updated weights for policy 1, policy_version 1563378 (0.0008) [2023-12-26 12:09:41,728][123090] Updated weights for policy 1, policy_version 1563388 (0.0007) [2023-12-26 12:09:41,733][123091] Updated weights for policy 0, policy_version 1573841 (0.0010) [2023-12-26 12:09:41,796][123091] Updated weights for policy 0, policy_version 1573851 (0.0008) [2023-12-26 12:09:41,869][123091] Updated weights for policy 0, policy_version 1573861 (0.0008) [2023-12-26 12:09:41,931][123091] Updated weights for policy 0, policy_version 1573871 (0.0008) [2023-12-26 12:09:42,525][123090] Updated weights for policy 1, policy_version 1563398 (0.0010) [2023-12-26 12:09:42,593][123090] Updated weights for policy 1, policy_version 1563408 (0.0011) [2023-12-26 12:09:42,666][123090] Updated weights for policy 1, policy_version 1563418 (0.0011) [2023-12-26 12:09:42,737][123091] Updated weights for policy 0, policy_version 1573881 (0.0006) [2023-12-26 12:09:42,803][123091] Updated weights for policy 0, policy_version 1573891 (0.0006) [2023-12-26 12:09:42,873][123091] Updated weights for policy 0, policy_version 1573901 (0.0010) [2023-12-26 12:09:43,481][123090] Updated weights for policy 1, policy_version 1563428 (0.0011) [2023-12-26 12:09:43,535][123090] Updated weights for policy 1, policy_version 1563438 (0.0010) [2023-12-26 12:09:43,597][123090] Updated weights for policy 1, policy_version 1563448 (0.0010) [2023-12-26 12:09:43,650][123091] Updated weights for policy 0, policy_version 1573911 (0.0008) [2023-12-26 12:09:43,721][123091] Updated weights for policy 0, policy_version 1573921 (0.0006) [2023-12-26 12:09:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 803168256. Throughput: 0: 8805.9, 1: 8938.6. Samples: 803163436. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:43,785][121949] Avg episode reward: [(0, '6016.028'), (1, '5867.545')] [2023-12-26 12:09:43,799][123091] Updated weights for policy 0, policy_version 1573931 (0.0005) [2023-12-26 12:09:44,392][123090] Updated weights for policy 1, policy_version 1563458 (0.0011) [2023-12-26 12:09:44,462][123090] Updated weights for policy 1, policy_version 1563468 (0.0011) [2023-12-26 12:09:44,469][123091] Updated weights for policy 0, policy_version 1573941 (0.0006) [2023-12-26 12:09:44,525][123091] Updated weights for policy 0, policy_version 1573951 (0.0006) [2023-12-26 12:09:44,529][123090] Updated weights for policy 1, policy_version 1563478 (0.0011) [2023-12-26 12:09:44,582][123091] Updated weights for policy 0, policy_version 1573961 (0.0006) [2023-12-26 12:09:44,596][123090] Updated weights for policy 1, policy_version 1563488 (0.0010) [2023-12-26 12:09:45,337][123091] Updated weights for policy 0, policy_version 1573971 (0.0006) [2023-12-26 12:09:45,376][123090] Updated weights for policy 1, policy_version 1563498 (0.0008) [2023-12-26 12:09:45,400][123091] Updated weights for policy 0, policy_version 1573981 (0.0007) [2023-12-26 12:09:45,436][123090] Updated weights for policy 1, policy_version 1563508 (0.0011) [2023-12-26 12:09:45,461][123091] Updated weights for policy 0, policy_version 1573991 (0.0006) [2023-12-26 12:09:45,488][123090] Updated weights for policy 1, policy_version 1563518 (0.0010) [2023-12-26 12:09:46,263][123091] Updated weights for policy 0, policy_version 1574001 (0.0007) [2023-12-26 12:09:46,272][123090] Updated weights for policy 1, policy_version 1563528 (0.0010) [2023-12-26 12:09:46,319][123090] Updated weights for policy 1, policy_version 1563538 (0.0010) [2023-12-26 12:09:46,322][123091] Updated weights for policy 0, policy_version 1574011 (0.0006) [2023-12-26 12:09:46,375][123090] Updated weights for policy 1, policy_version 1563548 (0.0008) [2023-12-26 12:09:46,381][123091] Updated weights for policy 0, policy_version 1574021 (0.0008) [2023-12-26 12:09:46,446][123091] Updated weights for policy 0, policy_version 1574031 (0.0009) [2023-12-26 12:09:47,065][123090] Updated weights for policy 1, policy_version 1563558 (0.0007) [2023-12-26 12:09:47,135][123090] Updated weights for policy 1, policy_version 1563568 (0.0008) [2023-12-26 12:09:47,196][123090] Updated weights for policy 1, policy_version 1563578 (0.0008) [2023-12-26 12:09:47,270][123091] Updated weights for policy 0, policy_version 1574041 (0.0006) [2023-12-26 12:09:47,325][123091] Updated weights for policy 0, policy_version 1574051 (0.0005) [2023-12-26 12:09:47,380][123091] Updated weights for policy 0, policy_version 1574061 (0.0005) [2023-12-26 12:09:47,843][123090] Updated weights for policy 1, policy_version 1563588 (0.0007) [2023-12-26 12:09:47,890][123090] Updated weights for policy 1, policy_version 1563598 (0.0005) [2023-12-26 12:09:47,939][123090] Updated weights for policy 1, policy_version 1563608 (0.0005) [2023-12-26 12:09:48,055][123091] Updated weights for policy 0, policy_version 1574071 (0.0005) [2023-12-26 12:09:48,109][123091] Updated weights for policy 0, policy_version 1574081 (0.0006) [2023-12-26 12:09:48,180][123091] Updated weights for policy 0, policy_version 1574091 (0.0009) [2023-12-26 12:09:48,632][123090] Updated weights for policy 1, policy_version 1563618 (0.0006) [2023-12-26 12:09:48,692][123090] Updated weights for policy 1, policy_version 1563628 (0.0007) [2023-12-26 12:09:48,756][123090] Updated weights for policy 1, policy_version 1563638 (0.0009) [2023-12-26 12:09:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 803258368. Throughput: 0: 8884.4, 1: 9059.1. Samples: 803274356. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:48,785][121949] Avg episode reward: [(0, '6021.917'), (1, '5708.946')] [2023-12-26 12:09:48,827][123090] Updated weights for policy 1, policy_version 1563648 (0.0009) [2023-12-26 12:09:49,015][123091] Updated weights for policy 0, policy_version 1574101 (0.0009) [2023-12-26 12:09:49,074][123091] Updated weights for policy 0, policy_version 1574111 (0.0009) [2023-12-26 12:09:49,122][123091] Updated weights for policy 0, policy_version 1574121 (0.0009) [2023-12-26 12:09:49,617][123090] Updated weights for policy 1, policy_version 1563658 (0.0009) [2023-12-26 12:09:49,687][123090] Updated weights for policy 1, policy_version 1563668 (0.0006) [2023-12-26 12:09:49,766][123090] Updated weights for policy 1, policy_version 1563678 (0.0005) [2023-12-26 12:09:49,942][123091] Updated weights for policy 0, policy_version 1574131 (0.0009) [2023-12-26 12:09:50,008][123091] Updated weights for policy 0, policy_version 1574141 (0.0008) [2023-12-26 12:09:50,063][123091] Updated weights for policy 0, policy_version 1574151 (0.0008) [2023-12-26 12:09:50,545][123090] Updated weights for policy 1, policy_version 1563688 (0.0006) [2023-12-26 12:09:50,620][123090] Updated weights for policy 1, policy_version 1563698 (0.0011) [2023-12-26 12:09:50,681][123090] Updated weights for policy 1, policy_version 1563708 (0.0011) [2023-12-26 12:09:50,908][123091] Updated weights for policy 0, policy_version 1574161 (0.0008) [2023-12-26 12:09:50,964][123091] Updated weights for policy 0, policy_version 1574171 (0.0009) [2023-12-26 12:09:51,017][123091] Updated weights for policy 0, policy_version 1574181 (0.0009) [2023-12-26 12:09:51,081][123091] Updated weights for policy 0, policy_version 1574191 (0.0008) [2023-12-26 12:09:51,520][123090] Updated weights for policy 1, policy_version 1563718 (0.0010) [2023-12-26 12:09:51,576][123090] Updated weights for policy 1, policy_version 1563728 (0.0010) [2023-12-26 12:09:51,647][123090] Updated weights for policy 1, policy_version 1563738 (0.0009) [2023-12-26 12:09:51,988][123091] Updated weights for policy 0, policy_version 1574201 (0.0010) [2023-12-26 12:09:52,056][123091] Updated weights for policy 0, policy_version 1574211 (0.0010) [2023-12-26 12:09:52,119][123091] Updated weights for policy 0, policy_version 1574221 (0.0010) [2023-12-26 12:09:52,387][123090] Updated weights for policy 1, policy_version 1563748 (0.0010) [2023-12-26 12:09:52,439][123090] Updated weights for policy 1, policy_version 1563758 (0.0010) [2023-12-26 12:09:52,496][123090] Updated weights for policy 1, policy_version 1563768 (0.0010) [2023-12-26 12:09:53,049][123091] Updated weights for policy 0, policy_version 1574231 (0.0010) [2023-12-26 12:09:53,098][123091] Updated weights for policy 0, policy_version 1574241 (0.0008) [2023-12-26 12:09:53,153][123091] Updated weights for policy 0, policy_version 1574251 (0.0005) [2023-12-26 12:09:53,223][123090] Updated weights for policy 1, policy_version 1563778 (0.0006) [2023-12-26 12:09:53,274][123090] Updated weights for policy 1, policy_version 1563788 (0.0010) [2023-12-26 12:09:53,333][123090] Updated weights for policy 1, policy_version 1563798 (0.0006) [2023-12-26 12:09:53,405][123090] Updated weights for policy 1, policy_version 1563808 (0.0005) [2023-12-26 12:09:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 803348480. Throughput: 0: 8812.9, 1: 9029.3. Samples: 803325776. Policy #0 lag: (min: 8.0, avg: 37.1, max: 40.0) [2023-12-26 12:09:53,785][121949] Avg episode reward: [(0, '6046.993'), (1, '5534.042')] [2023-12-26 12:09:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001574256_403013632.pth... [2023-12-26 12:09:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001563808_400334848.pth... [2023-12-26 12:09:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001573232_402751488.pth [2023-12-26 12:09:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001562752_400064512.pth [2023-12-26 12:09:53,870][123091] Updated weights for policy 0, policy_version 1574261 (0.0010) [2023-12-26 12:09:53,925][123091] Updated weights for policy 0, policy_version 1574271 (0.0010) [2023-12-26 12:09:53,976][123091] Updated weights for policy 0, policy_version 1574281 (0.0006) [2023-12-26 12:09:54,062][123090] Updated weights for policy 1, policy_version 1563818 (0.0010) [2023-12-26 12:09:54,125][123090] Updated weights for policy 1, policy_version 1563828 (0.0010) [2023-12-26 12:09:54,179][123090] Updated weights for policy 1, policy_version 1563838 (0.0010) [2023-12-26 12:09:54,694][123091] Updated weights for policy 0, policy_version 1574291 (0.0005) [2023-12-26 12:09:54,764][123091] Updated weights for policy 0, policy_version 1574301 (0.0005) [2023-12-26 12:09:54,812][123091] Updated weights for policy 0, policy_version 1574311 (0.0005) [2023-12-26 12:09:54,957][123090] Updated weights for policy 1, policy_version 1563848 (0.0006) [2023-12-26 12:09:55,021][123090] Updated weights for policy 1, policy_version 1563860 (0.0008) [2023-12-26 12:09:55,069][123090] Updated weights for policy 1, policy_version 1563870 (0.0009) [2023-12-26 12:09:55,568][123091] Updated weights for policy 0, policy_version 1574321 (0.0006) [2023-12-26 12:09:55,637][123091] Updated weights for policy 0, policy_version 1574331 (0.0010) [2023-12-26 12:09:55,691][123091] Updated weights for policy 0, policy_version 1574341 (0.0010) [2023-12-26 12:09:55,751][123091] Updated weights for policy 0, policy_version 1574351 (0.0011) [2023-12-26 12:09:55,880][123090] Updated weights for policy 1, policy_version 1563880 (0.0008) [2023-12-26 12:09:55,927][123090] Updated weights for policy 1, policy_version 1563890 (0.0005) [2023-12-26 12:09:55,988][123090] Updated weights for policy 1, policy_version 1563900 (0.0005) [2023-12-26 12:09:56,478][123091] Updated weights for policy 0, policy_version 1574361 (0.0006) [2023-12-26 12:09:56,529][123091] Updated weights for policy 0, policy_version 1574371 (0.0005) [2023-12-26 12:09:56,576][123091] Updated weights for policy 0, policy_version 1574381 (0.0005) [2023-12-26 12:09:56,862][123090] Updated weights for policy 1, policy_version 1563910 (0.0007) [2023-12-26 12:09:56,909][123090] Updated weights for policy 1, policy_version 1563920 (0.0008) [2023-12-26 12:09:56,960][123090] Updated weights for policy 1, policy_version 1563930 (0.0008) [2023-12-26 12:09:57,310][123091] Updated weights for policy 0, policy_version 1574391 (0.0008) [2023-12-26 12:09:57,368][123091] Updated weights for policy 0, policy_version 1574401 (0.0007) [2023-12-26 12:09:57,414][123091] Updated weights for policy 0, policy_version 1574411 (0.0010) [2023-12-26 12:09:57,800][123090] Updated weights for policy 1, policy_version 1563940 (0.0008) [2023-12-26 12:09:57,864][123090] Updated weights for policy 1, policy_version 1563950 (0.0009) [2023-12-26 12:09:57,915][123090] Updated weights for policy 1, policy_version 1563961 (0.0009) [2023-12-26 12:09:58,088][123091] Updated weights for policy 0, policy_version 1574421 (0.0009) [2023-12-26 12:09:58,157][123091] Updated weights for policy 0, policy_version 1574431 (0.0007) [2023-12-26 12:09:58,224][123091] Updated weights for policy 0, policy_version 1574441 (0.0008) [2023-12-26 12:09:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 803438592. Throughput: 0: 8913.7, 1: 9064.9. Samples: 803436540. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:09:58,785][121949] Avg episode reward: [(0, '6022.067'), (1, '5793.572')] [2023-12-26 12:09:58,889][123090] Updated weights for policy 1, policy_version 1563971 (0.0009) [2023-12-26 12:09:58,957][123090] Updated weights for policy 1, policy_version 1563981 (0.0007) [2023-12-26 12:09:59,029][123090] Updated weights for policy 1, policy_version 1563991 (0.0010) [2023-12-26 12:09:59,101][123091] Updated weights for policy 0, policy_version 1574451 (0.0007) [2023-12-26 12:09:59,164][123091] Updated weights for policy 0, policy_version 1574461 (0.0007) [2023-12-26 12:09:59,227][123091] Updated weights for policy 0, policy_version 1574471 (0.0008) [2023-12-26 12:09:59,821][123090] Updated weights for policy 1, policy_version 1564001 (0.0009) [2023-12-26 12:09:59,889][123090] Updated weights for policy 1, policy_version 1564011 (0.0007) [2023-12-26 12:09:59,900][123091] Updated weights for policy 0, policy_version 1574481 (0.0008) [2023-12-26 12:09:59,959][123090] Updated weights for policy 1, policy_version 1564021 (0.0007) [2023-12-26 12:09:59,968][123091] Updated weights for policy 0, policy_version 1574491 (0.0009) [2023-12-26 12:10:00,025][123090] Updated weights for policy 1, policy_version 1564031 (0.0008) [2023-12-26 12:10:00,032][123091] Updated weights for policy 0, policy_version 1574501 (0.0009) [2023-12-26 12:10:00,088][123091] Updated weights for policy 0, policy_version 1574512 (0.0010) [2023-12-26 12:10:00,744][123090] Updated weights for policy 1, policy_version 1564041 (0.0007) [2023-12-26 12:10:00,801][123090] Updated weights for policy 1, policy_version 1564051 (0.0009) [2023-12-26 12:10:00,863][123090] Updated weights for policy 1, policy_version 1564061 (0.0009) [2023-12-26 12:10:00,883][123091] Updated weights for policy 0, policy_version 1574522 (0.0005) [2023-12-26 12:10:00,931][123091] Updated weights for policy 0, policy_version 1574532 (0.0005) [2023-12-26 12:10:00,978][123091] Updated weights for policy 0, policy_version 1574542 (0.0005) [2023-12-26 12:10:01,714][123090] Updated weights for policy 1, policy_version 1564071 (0.0008) [2023-12-26 12:10:01,781][123090] Updated weights for policy 1, policy_version 1564081 (0.0009) [2023-12-26 12:10:01,792][123091] Updated weights for policy 0, policy_version 1574552 (0.0007) [2023-12-26 12:10:01,840][123090] Updated weights for policy 1, policy_version 1564091 (0.0006) [2023-12-26 12:10:01,853][123091] Updated weights for policy 0, policy_version 1574562 (0.0008) [2023-12-26 12:10:01,914][123091] Updated weights for policy 0, policy_version 1574572 (0.0008) [2023-12-26 12:10:02,686][123090] Updated weights for policy 1, policy_version 1564101 (0.0009) [2023-12-26 12:10:02,721][123091] Updated weights for policy 0, policy_version 1574582 (0.0006) [2023-12-26 12:10:02,738][123090] Updated weights for policy 1, policy_version 1564111 (0.0008) [2023-12-26 12:10:02,781][123091] Updated weights for policy 0, policy_version 1574592 (0.0007) [2023-12-26 12:10:02,802][123090] Updated weights for policy 1, policy_version 1564121 (0.0007) [2023-12-26 12:10:02,843][123091] Updated weights for policy 0, policy_version 1574602 (0.0008) [2023-12-26 12:10:03,628][123090] Updated weights for policy 1, policy_version 1564131 (0.0008) [2023-12-26 12:10:03,634][123091] Updated weights for policy 0, policy_version 1574612 (0.0010) [2023-12-26 12:10:03,687][123091] Updated weights for policy 0, policy_version 1574622 (0.0006) [2023-12-26 12:10:03,697][123090] Updated weights for policy 1, policy_version 1564141 (0.0009) [2023-12-26 12:10:03,746][123091] Updated weights for policy 0, policy_version 1574632 (0.0009) [2023-12-26 12:10:03,753][123090] Updated weights for policy 1, policy_version 1564151 (0.0009) [2023-12-26 12:10:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 803528704. Throughput: 0: 9006.1, 1: 8905.4. Samples: 803541652. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:03,785][121949] Avg episode reward: [(0, '6073.306'), (1, '6002.915')] [2023-12-26 12:10:04,590][123091] Updated weights for policy 0, policy_version 1574642 (0.0008) [2023-12-26 12:10:04,602][123090] Updated weights for policy 1, policy_version 1564161 (0.0009) [2023-12-26 12:10:04,648][123091] Updated weights for policy 0, policy_version 1574652 (0.0008) [2023-12-26 12:10:04,665][123090] Updated weights for policy 1, policy_version 1564171 (0.0008) [2023-12-26 12:10:04,705][123091] Updated weights for policy 0, policy_version 1574662 (0.0009) [2023-12-26 12:10:04,726][123090] Updated weights for policy 1, policy_version 1564181 (0.0005) [2023-12-26 12:10:04,764][123091] Updated weights for policy 0, policy_version 1574672 (0.0009) [2023-12-26 12:10:04,792][123090] Updated weights for policy 1, policy_version 1564191 (0.0005) [2023-12-26 12:10:05,460][123090] Updated weights for policy 1, policy_version 1564201 (0.0005) [2023-12-26 12:10:05,520][123090] Updated weights for policy 1, policy_version 1564211 (0.0005) [2023-12-26 12:10:05,585][123090] Updated weights for policy 1, policy_version 1564221 (0.0005) [2023-12-26 12:10:05,636][123091] Updated weights for policy 0, policy_version 1574682 (0.0009) [2023-12-26 12:10:05,706][123091] Updated weights for policy 0, policy_version 1574692 (0.0006) [2023-12-26 12:10:05,781][123091] Updated weights for policy 0, policy_version 1574702 (0.0005) [2023-12-26 12:10:06,229][123090] Updated weights for policy 1, policy_version 1564231 (0.0007) [2023-12-26 12:10:06,302][123090] Updated weights for policy 1, policy_version 1564241 (0.0006) [2023-12-26 12:10:06,377][123090] Updated weights for policy 1, policy_version 1564251 (0.0008) [2023-12-26 12:10:06,517][123091] Updated weights for policy 0, policy_version 1574712 (0.0009) [2023-12-26 12:10:06,588][123091] Updated weights for policy 0, policy_version 1574722 (0.0010) [2023-12-26 12:10:06,657][123091] Updated weights for policy 0, policy_version 1574732 (0.0009) [2023-12-26 12:10:07,124][123090] Updated weights for policy 1, policy_version 1564261 (0.0010) [2023-12-26 12:10:07,179][123090] Updated weights for policy 1, policy_version 1564271 (0.0009) [2023-12-26 12:10:07,231][123090] Updated weights for policy 1, policy_version 1564281 (0.0009) [2023-12-26 12:10:07,330][123091] Updated weights for policy 0, policy_version 1574742 (0.0009) [2023-12-26 12:10:07,390][123091] Updated weights for policy 0, policy_version 1574752 (0.0010) [2023-12-26 12:10:07,452][123091] Updated weights for policy 0, policy_version 1574762 (0.0010) [2023-12-26 12:10:07,983][123090] Updated weights for policy 1, policy_version 1564291 (0.0009) [2023-12-26 12:10:08,043][123090] Updated weights for policy 1, policy_version 1564301 (0.0005) [2023-12-26 12:10:08,091][123090] Updated weights for policy 1, policy_version 1564311 (0.0007) [2023-12-26 12:10:08,197][123091] Updated weights for policy 0, policy_version 1574772 (0.0008) [2023-12-26 12:10:08,250][123091] Updated weights for policy 0, policy_version 1574782 (0.0006) [2023-12-26 12:10:08,321][123091] Updated weights for policy 0, policy_version 1574792 (0.0006) [2023-12-26 12:10:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 803618816. Throughput: 0: 9024.8, 1: 8948.8. Samples: 803594972. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:08,785][121949] Avg episode reward: [(0, '6250.287'), (1, '5665.067')] [2023-12-26 12:10:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001574800_403152896.pth... [2023-12-26 12:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001564320_400465920.pth... [2023-12-26 12:10:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001563296_400203776.pth [2023-12-26 12:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001573776_402890752.pth [2023-12-26 12:10:08,894][123090] Updated weights for policy 1, policy_version 1564321 (0.0009) [2023-12-26 12:10:08,944][123090] Updated weights for policy 1, policy_version 1564331 (0.0009) [2023-12-26 12:10:08,999][123090] Updated weights for policy 1, policy_version 1564341 (0.0010) [2023-12-26 12:10:09,060][123090] Updated weights for policy 1, policy_version 1564351 (0.0006) [2023-12-26 12:10:09,112][123091] Updated weights for policy 0, policy_version 1574802 (0.0008) [2023-12-26 12:10:09,171][123091] Updated weights for policy 0, policy_version 1574812 (0.0005) [2023-12-26 12:10:09,223][123091] Updated weights for policy 0, policy_version 1574822 (0.0007) [2023-12-26 12:10:09,284][123091] Updated weights for policy 0, policy_version 1574832 (0.0006) [2023-12-26 12:10:09,899][123090] Updated weights for policy 1, policy_version 1564361 (0.0010) [2023-12-26 12:10:09,968][123090] Updated weights for policy 1, policy_version 1564371 (0.0011) [2023-12-26 12:10:10,028][123090] Updated weights for policy 1, policy_version 1564381 (0.0010) [2023-12-26 12:10:10,108][123091] Updated weights for policy 0, policy_version 1574842 (0.0009) [2023-12-26 12:10:10,161][123091] Updated weights for policy 0, policy_version 1574852 (0.0009) [2023-12-26 12:10:10,225][123091] Updated weights for policy 0, policy_version 1574862 (0.0009) [2023-12-26 12:10:10,816][123090] Updated weights for policy 1, policy_version 1564391 (0.0007) [2023-12-26 12:10:10,870][123090] Updated weights for policy 1, policy_version 1564401 (0.0005) [2023-12-26 12:10:10,921][123090] Updated weights for policy 1, policy_version 1564411 (0.0008) [2023-12-26 12:10:11,013][123091] Updated weights for policy 0, policy_version 1574872 (0.0010) [2023-12-26 12:10:11,082][123091] Updated weights for policy 0, policy_version 1574882 (0.0011) [2023-12-26 12:10:11,156][123091] Updated weights for policy 0, policy_version 1574892 (0.0015) [2023-12-26 12:10:11,784][123090] Updated weights for policy 1, policy_version 1564421 (0.0009) [2023-12-26 12:10:11,848][123090] Updated weights for policy 1, policy_version 1564431 (0.0011) [2023-12-26 12:10:11,902][123090] Updated weights for policy 1, policy_version 1564441 (0.0011) [2023-12-26 12:10:12,113][123091] Updated weights for policy 0, policy_version 1574902 (0.0009) [2023-12-26 12:10:12,186][123091] Updated weights for policy 0, policy_version 1574912 (0.0009) [2023-12-26 12:10:12,257][123091] Updated weights for policy 0, policy_version 1574922 (0.0009) [2023-12-26 12:10:12,768][123090] Updated weights for policy 1, policy_version 1564451 (0.0010) [2023-12-26 12:10:12,836][123090] Updated weights for policy 1, policy_version 1564461 (0.0010) [2023-12-26 12:10:12,896][123090] Updated weights for policy 1, policy_version 1564471 (0.0008) [2023-12-26 12:10:13,088][123091] Updated weights for policy 0, policy_version 1574932 (0.0009) [2023-12-26 12:10:13,142][123091] Updated weights for policy 0, policy_version 1574942 (0.0010) [2023-12-26 12:10:13,200][123091] Updated weights for policy 0, policy_version 1574952 (0.0010) [2023-12-26 12:10:13,577][123090] Updated weights for policy 1, policy_version 1564481 (0.0005) [2023-12-26 12:10:13,632][123090] Updated weights for policy 1, policy_version 1564491 (0.0005) [2023-12-26 12:10:13,686][123090] Updated weights for policy 1, policy_version 1564501 (0.0008) [2023-12-26 12:10:13,741][123090] Updated weights for policy 1, policy_version 1564511 (0.0010) [2023-12-26 12:10:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 803708928. Throughput: 0: 8916.7, 1: 8917.5. Samples: 803699812. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:13,784][121949] Avg episode reward: [(0, '6225.242'), (1, '5463.690')] [2023-12-26 12:10:14,124][123091] Updated weights for policy 0, policy_version 1574962 (0.0010) [2023-12-26 12:10:14,182][123091] Updated weights for policy 0, policy_version 1574972 (0.0010) [2023-12-26 12:10:14,241][123091] Updated weights for policy 0, policy_version 1574982 (0.0010) [2023-12-26 12:10:14,303][123091] Updated weights for policy 0, policy_version 1574992 (0.0010) [2023-12-26 12:10:14,448][123090] Updated weights for policy 1, policy_version 1564521 (0.0006) [2023-12-26 12:10:14,506][123090] Updated weights for policy 1, policy_version 1564531 (0.0007) [2023-12-26 12:10:14,572][123090] Updated weights for policy 1, policy_version 1564541 (0.0010) [2023-12-26 12:10:15,110][123091] Updated weights for policy 0, policy_version 1575002 (0.0010) [2023-12-26 12:10:15,170][123091] Updated weights for policy 0, policy_version 1575012 (0.0010) [2023-12-26 12:10:15,233][123091] Updated weights for policy 0, policy_version 1575022 (0.0010) [2023-12-26 12:10:15,376][123090] Updated weights for policy 1, policy_version 1564551 (0.0007) [2023-12-26 12:10:15,457][123090] Updated weights for policy 1, policy_version 1564561 (0.0006) [2023-12-26 12:10:15,521][123090] Updated weights for policy 1, policy_version 1564571 (0.0006) [2023-12-26 12:10:16,087][123090] Updated weights for policy 1, policy_version 1564581 (0.0006) [2023-12-26 12:10:16,122][123091] Updated weights for policy 0, policy_version 1575032 (0.0006) [2023-12-26 12:10:16,138][123090] Updated weights for policy 1, policy_version 1564591 (0.0005) [2023-12-26 12:10:16,172][123091] Updated weights for policy 0, policy_version 1575042 (0.0005) [2023-12-26 12:10:16,190][123090] Updated weights for policy 1, policy_version 1564601 (0.0005) [2023-12-26 12:10:16,226][123091] Updated weights for policy 0, policy_version 1575052 (0.0005) [2023-12-26 12:10:16,797][123090] Updated weights for policy 1, policy_version 1564611 (0.0005) [2023-12-26 12:10:16,857][123090] Updated weights for policy 1, policy_version 1564621 (0.0005) [2023-12-26 12:10:16,917][123090] Updated weights for policy 1, policy_version 1564631 (0.0005) [2023-12-26 12:10:16,987][123091] Updated weights for policy 0, policy_version 1575062 (0.0008) [2023-12-26 12:10:17,041][123091] Updated weights for policy 0, policy_version 1575072 (0.0010) [2023-12-26 12:10:17,104][123091] Updated weights for policy 0, policy_version 1575082 (0.0010) [2023-12-26 12:10:17,588][123090] Updated weights for policy 1, policy_version 1564641 (0.0005) [2023-12-26 12:10:17,658][123090] Updated weights for policy 1, policy_version 1564651 (0.0005) [2023-12-26 12:10:17,727][123090] Updated weights for policy 1, policy_version 1564661 (0.0007) [2023-12-26 12:10:17,776][123090] Updated weights for policy 1, policy_version 1564671 (0.0009) [2023-12-26 12:10:17,981][123091] Updated weights for policy 0, policy_version 1575092 (0.0009) [2023-12-26 12:10:18,046][123091] Updated weights for policy 0, policy_version 1575102 (0.0008) [2023-12-26 12:10:18,105][123091] Updated weights for policy 0, policy_version 1575112 (0.0009) [2023-12-26 12:10:18,512][123090] Updated weights for policy 1, policy_version 1564681 (0.0010) [2023-12-26 12:10:18,563][123090] Updated weights for policy 1, policy_version 1564691 (0.0010) [2023-12-26 12:10:18,612][123090] Updated weights for policy 1, policy_version 1564701 (0.0009) [2023-12-26 12:10:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 803799040. Throughput: 0: 8789.1, 1: 9013.3. Samples: 803808848. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:18,785][121949] Avg episode reward: [(0, '6078.571'), (1, '5373.332')] [2023-12-26 12:10:19,005][123091] Updated weights for policy 0, policy_version 1575122 (0.0010) [2023-12-26 12:10:19,067][123091] Updated weights for policy 0, policy_version 1575132 (0.0009) [2023-12-26 12:10:19,124][123091] Updated weights for policy 0, policy_version 1575142 (0.0010) [2023-12-26 12:10:19,184][123091] Updated weights for policy 0, policy_version 1575152 (0.0009) [2023-12-26 12:10:19,421][123090] Updated weights for policy 1, policy_version 1564711 (0.0010) [2023-12-26 12:10:19,487][123090] Updated weights for policy 1, policy_version 1564721 (0.0009) [2023-12-26 12:10:19,549][123090] Updated weights for policy 1, policy_version 1564731 (0.0010) [2023-12-26 12:10:19,998][123091] Updated weights for policy 0, policy_version 1575162 (0.0010) [2023-12-26 12:10:20,060][123091] Updated weights for policy 0, policy_version 1575172 (0.0010) [2023-12-26 12:10:20,128][123091] Updated weights for policy 0, policy_version 1575182 (0.0009) [2023-12-26 12:10:20,435][123090] Updated weights for policy 1, policy_version 1564741 (0.0007) [2023-12-26 12:10:20,496][123090] Updated weights for policy 1, policy_version 1564751 (0.0008) [2023-12-26 12:10:20,560][123090] Updated weights for policy 1, policy_version 1564761 (0.0009) [2023-12-26 12:10:20,957][123091] Updated weights for policy 0, policy_version 1575192 (0.0010) [2023-12-26 12:10:21,038][123091] Updated weights for policy 0, policy_version 1575202 (0.0010) [2023-12-26 12:10:21,109][123091] Updated weights for policy 0, policy_version 1575212 (0.0007) [2023-12-26 12:10:21,409][123090] Updated weights for policy 1, policy_version 1564771 (0.0009) [2023-12-26 12:10:21,477][123090] Updated weights for policy 1, policy_version 1564781 (0.0011) [2023-12-26 12:10:21,544][123090] Updated weights for policy 1, policy_version 1564791 (0.0011) [2023-12-26 12:10:21,943][123091] Updated weights for policy 0, policy_version 1575222 (0.0008) [2023-12-26 12:10:22,008][123091] Updated weights for policy 0, policy_version 1575232 (0.0009) [2023-12-26 12:10:22,065][123091] Updated weights for policy 0, policy_version 1575242 (0.0009) [2023-12-26 12:10:22,399][123090] Updated weights for policy 1, policy_version 1564801 (0.0011) [2023-12-26 12:10:22,463][123090] Updated weights for policy 1, policy_version 1564811 (0.0011) [2023-12-26 12:10:22,516][123090] Updated weights for policy 1, policy_version 1564821 (0.0011) [2023-12-26 12:10:22,571][123090] Updated weights for policy 1, policy_version 1564831 (0.0011) [2023-12-26 12:10:22,878][123091] Updated weights for policy 0, policy_version 1575252 (0.0008) [2023-12-26 12:10:22,946][123091] Updated weights for policy 0, policy_version 1575262 (0.0006) [2023-12-26 12:10:23,018][123091] Updated weights for policy 0, policy_version 1575272 (0.0006) [2023-12-26 12:10:23,410][123090] Updated weights for policy 1, policy_version 1564841 (0.0011) [2023-12-26 12:10:23,474][123090] Updated weights for policy 1, policy_version 1564851 (0.0010) [2023-12-26 12:10:23,539][123090] Updated weights for policy 1, policy_version 1564861 (0.0010) [2023-12-26 12:10:23,658][123091] Updated weights for policy 0, policy_version 1575282 (0.0006) [2023-12-26 12:10:23,723][123091] Updated weights for policy 0, policy_version 1575292 (0.0006) [2023-12-26 12:10:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 803880960. Throughput: 0: 8724.1, 1: 9010.1. Samples: 803859688. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:23,784][121949] Avg episode reward: [(0, '5925.315'), (1, '5529.156')] [2023-12-26 12:10:23,788][123091] Updated weights for policy 0, policy_version 1575302 (0.0005) [2023-12-26 12:10:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001564864_400605184.pth... [2023-12-26 12:10:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001563808_400334848.pth [2023-12-26 12:10:23,848][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001575312_403283968.pth... [2023-12-26 12:10:23,849][123091] Updated weights for policy 0, policy_version 1575312 (0.0009) [2023-12-26 12:10:23,853][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001574256_403013632.pth [2023-12-26 12:10:24,332][123090] Updated weights for policy 1, policy_version 1564871 (0.0009) [2023-12-26 12:10:24,382][123090] Updated weights for policy 1, policy_version 1564881 (0.0009) [2023-12-26 12:10:24,439][123090] Updated weights for policy 1, policy_version 1564891 (0.0009) [2023-12-26 12:10:24,607][123091] Updated weights for policy 0, policy_version 1575322 (0.0011) [2023-12-26 12:10:24,669][123091] Updated weights for policy 0, policy_version 1575332 (0.0011) [2023-12-26 12:10:24,738][123091] Updated weights for policy 0, policy_version 1575342 (0.0009) [2023-12-26 12:10:25,099][123090] Updated weights for policy 1, policy_version 1564901 (0.0007) [2023-12-26 12:10:25,165][123090] Updated weights for policy 1, policy_version 1564911 (0.0009) [2023-12-26 12:10:25,231][123090] Updated weights for policy 1, policy_version 1564921 (0.0009) [2023-12-26 12:10:25,419][123091] Updated weights for policy 0, policy_version 1575352 (0.0006) [2023-12-26 12:10:25,466][123091] Updated weights for policy 0, policy_version 1575362 (0.0005) [2023-12-26 12:10:25,519][123091] Updated weights for policy 0, policy_version 1575372 (0.0005) [2023-12-26 12:10:26,090][123090] Updated weights for policy 1, policy_version 1564931 (0.0008) [2023-12-26 12:10:26,140][123090] Updated weights for policy 1, policy_version 1564941 (0.0009) [2023-12-26 12:10:26,205][123090] Updated weights for policy 1, policy_version 1564951 (0.0009) [2023-12-26 12:10:26,254][123091] Updated weights for policy 0, policy_version 1575382 (0.0008) [2023-12-26 12:10:26,316][123091] Updated weights for policy 0, policy_version 1575392 (0.0011) [2023-12-26 12:10:26,382][123091] Updated weights for policy 0, policy_version 1575402 (0.0011) [2023-12-26 12:10:27,073][123090] Updated weights for policy 1, policy_version 1564961 (0.0007) [2023-12-26 12:10:27,094][123091] Updated weights for policy 0, policy_version 1575412 (0.0009) [2023-12-26 12:10:27,123][123090] Updated weights for policy 1, policy_version 1564971 (0.0008) [2023-12-26 12:10:27,162][123091] Updated weights for policy 0, policy_version 1575422 (0.0009) [2023-12-26 12:10:27,176][123090] Updated weights for policy 1, policy_version 1564981 (0.0008) [2023-12-26 12:10:27,223][123090] Updated weights for policy 1, policy_version 1564991 (0.0009) [2023-12-26 12:10:27,225][123091] Updated weights for policy 0, policy_version 1575432 (0.0007) [2023-12-26 12:10:27,928][123091] Updated weights for policy 0, policy_version 1575442 (0.0008) [2023-12-26 12:10:28,002][123091] Updated weights for policy 0, policy_version 1575452 (0.0007) [2023-12-26 12:10:28,051][123091] Updated weights for policy 0, policy_version 1575462 (0.0008) [2023-12-26 12:10:28,083][123090] Updated weights for policy 1, policy_version 1565001 (0.0008) [2023-12-26 12:10:28,103][123091] Updated weights for policy 0, policy_version 1575472 (0.0006) [2023-12-26 12:10:28,133][123090] Updated weights for policy 1, policy_version 1565011 (0.0009) [2023-12-26 12:10:28,190][123090] Updated weights for policy 1, policy_version 1565021 (0.0009) [2023-12-26 12:10:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 803971072. Throughput: 0: 8880.7, 1: 9005.0. Samples: 803968292. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:28,785][121949] Avg episode reward: [(0, '6134.499'), (1, '5813.478')] [2023-12-26 12:10:28,844][123091] Updated weights for policy 0, policy_version 1575482 (0.0009) [2023-12-26 12:10:28,904][123091] Updated weights for policy 0, policy_version 1575492 (0.0011) [2023-12-26 12:10:28,967][123091] Updated weights for policy 0, policy_version 1575502 (0.0011) [2023-12-26 12:10:29,018][123090] Updated weights for policy 1, policy_version 1565031 (0.0009) [2023-12-26 12:10:29,069][123090] Updated weights for policy 1, policy_version 1565041 (0.0008) [2023-12-26 12:10:29,125][123090] Updated weights for policy 1, policy_version 1565051 (0.0009) [2023-12-26 12:10:29,825][123091] Updated weights for policy 0, policy_version 1575512 (0.0011) [2023-12-26 12:10:29,893][123091] Updated weights for policy 0, policy_version 1575522 (0.0011) [2023-12-26 12:10:29,893][123090] Updated weights for policy 1, policy_version 1565061 (0.0009) [2023-12-26 12:10:29,955][123091] Updated weights for policy 0, policy_version 1575532 (0.0011) [2023-12-26 12:10:29,960][123090] Updated weights for policy 1, policy_version 1565071 (0.0008) [2023-12-26 12:10:30,027][123090] Updated weights for policy 1, policy_version 1565081 (0.0006) [2023-12-26 12:10:30,706][123091] Updated weights for policy 0, policy_version 1575542 (0.0007) [2023-12-26 12:10:30,761][123091] Updated weights for policy 0, policy_version 1575552 (0.0005) [2023-12-26 12:10:30,821][123091] Updated weights for policy 0, policy_version 1575562 (0.0005) [2023-12-26 12:10:30,839][123090] Updated weights for policy 1, policy_version 1565091 (0.0005) [2023-12-26 12:10:30,896][123090] Updated weights for policy 1, policy_version 1565101 (0.0005) [2023-12-26 12:10:30,956][123090] Updated weights for policy 1, policy_version 1565111 (0.0009) [2023-12-26 12:10:31,537][123091] Updated weights for policy 0, policy_version 1575572 (0.0007) [2023-12-26 12:10:31,600][123091] Updated weights for policy 0, policy_version 1575582 (0.0011) [2023-12-26 12:10:31,670][123091] Updated weights for policy 0, policy_version 1575592 (0.0011) [2023-12-26 12:10:31,695][123090] Updated weights for policy 1, policy_version 1565121 (0.0009) [2023-12-26 12:10:31,763][123090] Updated weights for policy 1, policy_version 1565131 (0.0010) [2023-12-26 12:10:31,826][123090] Updated weights for policy 1, policy_version 1565141 (0.0010) [2023-12-26 12:10:31,892][123090] Updated weights for policy 1, policy_version 1565151 (0.0010) [2023-12-26 12:10:32,404][123091] Updated weights for policy 0, policy_version 1575602 (0.0011) [2023-12-26 12:10:32,466][123091] Updated weights for policy 0, policy_version 1575612 (0.0010) [2023-12-26 12:10:32,527][123091] Updated weights for policy 0, policy_version 1575622 (0.0010) [2023-12-26 12:10:32,590][123091] Updated weights for policy 0, policy_version 1575632 (0.0011) [2023-12-26 12:10:32,703][123090] Updated weights for policy 1, policy_version 1565161 (0.0006) [2023-12-26 12:10:32,778][123090] Updated weights for policy 1, policy_version 1565171 (0.0005) [2023-12-26 12:10:32,842][123090] Updated weights for policy 1, policy_version 1565181 (0.0005) [2023-12-26 12:10:33,319][123091] Updated weights for policy 0, policy_version 1575642 (0.0005) [2023-12-26 12:10:33,388][123091] Updated weights for policy 0, policy_version 1575652 (0.0006) [2023-12-26 12:10:33,438][123091] Updated weights for policy 0, policy_version 1575662 (0.0010) [2023-12-26 12:10:33,611][123090] Updated weights for policy 1, policy_version 1565191 (0.0005) [2023-12-26 12:10:33,662][123090] Updated weights for policy 1, policy_version 1565201 (0.0005) [2023-12-26 12:10:33,707][123090] Updated weights for policy 1, policy_version 1565211 (0.0005) [2023-12-26 12:10:33,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 804069376. Throughput: 0: 8889.7, 1: 8936.3. Samples: 804076532. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:33,786][121949] Avg episode reward: [(0, '6317.429'), (1, '5800.131')] [2023-12-26 12:10:34,130][123091] Updated weights for policy 0, policy_version 1575672 (0.0006) [2023-12-26 12:10:34,200][123091] Updated weights for policy 0, policy_version 1575682 (0.0008) [2023-12-26 12:10:34,264][123091] Updated weights for policy 0, policy_version 1575692 (0.0010) [2023-12-26 12:10:34,586][123090] Updated weights for policy 1, policy_version 1565221 (0.0007) [2023-12-26 12:10:34,658][123090] Updated weights for policy 1, policy_version 1565231 (0.0009) [2023-12-26 12:10:34,727][123090] Updated weights for policy 1, policy_version 1565241 (0.0011) [2023-12-26 12:10:35,039][123091] Updated weights for policy 0, policy_version 1575702 (0.0008) [2023-12-26 12:10:35,106][123091] Updated weights for policy 0, policy_version 1575712 (0.0005) [2023-12-26 12:10:35,174][123091] Updated weights for policy 0, policy_version 1575722 (0.0005) [2023-12-26 12:10:35,429][123090] Updated weights for policy 1, policy_version 1565251 (0.0009) [2023-12-26 12:10:35,497][123090] Updated weights for policy 1, policy_version 1565261 (0.0006) [2023-12-26 12:10:35,572][123090] Updated weights for policy 1, policy_version 1565271 (0.0005) [2023-12-26 12:10:35,800][123091] Updated weights for policy 0, policy_version 1575732 (0.0006) [2023-12-26 12:10:35,861][123091] Updated weights for policy 0, policy_version 1575742 (0.0009) [2023-12-26 12:10:35,934][123091] Updated weights for policy 0, policy_version 1575752 (0.0005) [2023-12-26 12:10:36,310][123090] Updated weights for policy 1, policy_version 1565281 (0.0006) [2023-12-26 12:10:36,366][123090] Updated weights for policy 1, policy_version 1565291 (0.0010) [2023-12-26 12:10:36,423][123090] Updated weights for policy 1, policy_version 1565301 (0.0010) [2023-12-26 12:10:36,512][123090] Updated weights for policy 1, policy_version 1565311 (0.0011) [2023-12-26 12:10:36,656][123091] Updated weights for policy 0, policy_version 1575762 (0.0007) [2023-12-26 12:10:36,702][123091] Updated weights for policy 0, policy_version 1575772 (0.0010) [2023-12-26 12:10:36,759][123091] Updated weights for policy 0, policy_version 1575782 (0.0007) [2023-12-26 12:10:36,820][123091] Updated weights for policy 0, policy_version 1575792 (0.0005) [2023-12-26 12:10:37,333][123090] Updated weights for policy 1, policy_version 1565321 (0.0010) [2023-12-26 12:10:37,392][123090] Updated weights for policy 1, policy_version 1565331 (0.0010) [2023-12-26 12:10:37,440][123090] Updated weights for policy 1, policy_version 1565341 (0.0010) [2023-12-26 12:10:37,574][123091] Updated weights for policy 0, policy_version 1575802 (0.0006) [2023-12-26 12:10:37,634][123091] Updated weights for policy 0, policy_version 1575812 (0.0005) [2023-12-26 12:10:37,692][123091] Updated weights for policy 0, policy_version 1575822 (0.0007) [2023-12-26 12:10:38,237][123090] Updated weights for policy 1, policy_version 1565351 (0.0011) [2023-12-26 12:10:38,301][123090] Updated weights for policy 1, policy_version 1565361 (0.0011) [2023-12-26 12:10:38,373][123090] Updated weights for policy 1, policy_version 1565371 (0.0011) [2023-12-26 12:10:38,423][123091] Updated weights for policy 0, policy_version 1575832 (0.0009) [2023-12-26 12:10:38,485][123091] Updated weights for policy 0, policy_version 1575842 (0.0010) [2023-12-26 12:10:38,547][123091] Updated weights for policy 0, policy_version 1575852 (0.0007) [2023-12-26 12:10:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 804159488. Throughput: 0: 8975.0, 1: 8955.0. Samples: 804132628. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:38,785][121949] Avg episode reward: [(0, '6143.283'), (1, '5540.549')] [2023-12-26 12:10:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001575856_403423232.pth... [2023-12-26 12:10:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001565376_400736256.pth... [2023-12-26 12:10:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001574800_403152896.pth [2023-12-26 12:10:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001564320_400465920.pth [2023-12-26 12:10:39,197][123090] Updated weights for policy 1, policy_version 1565381 (0.0011) [2023-12-26 12:10:39,265][123090] Updated weights for policy 1, policy_version 1565391 (0.0009) [2023-12-26 12:10:39,279][123091] Updated weights for policy 0, policy_version 1575862 (0.0008) [2023-12-26 12:10:39,330][123090] Updated weights for policy 1, policy_version 1565401 (0.0011) [2023-12-26 12:10:39,350][123091] Updated weights for policy 0, policy_version 1575872 (0.0010) [2023-12-26 12:10:39,420][123091] Updated weights for policy 0, policy_version 1575882 (0.0008) [2023-12-26 12:10:40,092][123091] Updated weights for policy 0, policy_version 1575892 (0.0008) [2023-12-26 12:10:40,161][123091] Updated weights for policy 0, policy_version 1575902 (0.0006) [2023-12-26 12:10:40,174][123090] Updated weights for policy 1, policy_version 1565411 (0.0010) [2023-12-26 12:10:40,230][123091] Updated weights for policy 0, policy_version 1575912 (0.0006) [2023-12-26 12:10:40,238][123090] Updated weights for policy 1, policy_version 1565421 (0.0011) [2023-12-26 12:10:40,309][123090] Updated weights for policy 1, policy_version 1565431 (0.0011) [2023-12-26 12:10:40,885][123091] Updated weights for policy 0, policy_version 1575922 (0.0005) [2023-12-26 12:10:40,957][123091] Updated weights for policy 0, policy_version 1575932 (0.0008) [2023-12-26 12:10:41,022][123091] Updated weights for policy 0, policy_version 1575942 (0.0009) [2023-12-26 12:10:41,094][123091] Updated weights for policy 0, policy_version 1575952 (0.0007) [2023-12-26 12:10:41,143][123090] Updated weights for policy 1, policy_version 1565441 (0.0011) [2023-12-26 12:10:41,200][123090] Updated weights for policy 1, policy_version 1565451 (0.0010) [2023-12-26 12:10:41,263][123090] Updated weights for policy 1, policy_version 1565461 (0.0011) [2023-12-26 12:10:41,331][123090] Updated weights for policy 1, policy_version 1565471 (0.0011) [2023-12-26 12:10:41,860][123091] Updated weights for policy 0, policy_version 1575962 (0.0006) [2023-12-26 12:10:41,918][123091] Updated weights for policy 0, policy_version 1575972 (0.0006) [2023-12-26 12:10:41,983][123091] Updated weights for policy 0, policy_version 1575982 (0.0008) [2023-12-26 12:10:42,192][123090] Updated weights for policy 1, policy_version 1565481 (0.0011) [2023-12-26 12:10:42,252][123090] Updated weights for policy 1, policy_version 1565491 (0.0012) [2023-12-26 12:10:42,321][123090] Updated weights for policy 1, policy_version 1565501 (0.0011) [2023-12-26 12:10:42,747][123091] Updated weights for policy 0, policy_version 1575992 (0.0008) [2023-12-26 12:10:42,814][123091] Updated weights for policy 0, policy_version 1576002 (0.0007) [2023-12-26 12:10:42,875][123091] Updated weights for policy 0, policy_version 1576012 (0.0009) [2023-12-26 12:10:43,166][123090] Updated weights for policy 1, policy_version 1565511 (0.0010) [2023-12-26 12:10:43,222][123090] Updated weights for policy 1, policy_version 1565521 (0.0008) [2023-12-26 12:10:43,286][123090] Updated weights for policy 1, policy_version 1565531 (0.0007) [2023-12-26 12:10:43,678][123091] Updated weights for policy 0, policy_version 1576022 (0.0009) [2023-12-26 12:10:43,730][123091] Updated weights for policy 0, policy_version 1576032 (0.0009) [2023-12-26 12:10:43,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 804241408. Throughput: 0: 9006.9, 1: 8843.6. Samples: 804239812. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:43,784][121949] Avg episode reward: [(0, '6029.130'), (1, '5484.029')] [2023-12-26 12:10:43,787][123091] Updated weights for policy 0, policy_version 1576042 (0.0009) [2023-12-26 12:10:44,150][123090] Updated weights for policy 1, policy_version 1565541 (0.0009) [2023-12-26 12:10:44,205][123090] Updated weights for policy 1, policy_version 1565552 (0.0010) [2023-12-26 12:10:44,271][123090] Updated weights for policy 1, policy_version 1565562 (0.0010) [2023-12-26 12:10:44,559][123091] Updated weights for policy 0, policy_version 1576052 (0.0008) [2023-12-26 12:10:44,621][123091] Updated weights for policy 0, policy_version 1576062 (0.0005) [2023-12-26 12:10:44,682][123091] Updated weights for policy 0, policy_version 1576072 (0.0005) [2023-12-26 12:10:45,195][123090] Updated weights for policy 1, policy_version 1565572 (0.0009) [2023-12-26 12:10:45,262][123090] Updated weights for policy 1, policy_version 1565582 (0.0009) [2023-12-26 12:10:45,333][123090] Updated weights for policy 1, policy_version 1565592 (0.0010) [2023-12-26 12:10:45,396][123091] Updated weights for policy 0, policy_version 1576082 (0.0006) [2023-12-26 12:10:45,462][123091] Updated weights for policy 0, policy_version 1576092 (0.0009) [2023-12-26 12:10:45,535][123091] Updated weights for policy 0, policy_version 1576102 (0.0010) [2023-12-26 12:10:45,604][123091] Updated weights for policy 0, policy_version 1576112 (0.0008) [2023-12-26 12:10:46,201][123090] Updated weights for policy 1, policy_version 1565602 (0.0010) [2023-12-26 12:10:46,262][123090] Updated weights for policy 1, policy_version 1565612 (0.0008) [2023-12-26 12:10:46,322][123090] Updated weights for policy 1, policy_version 1565622 (0.0008) [2023-12-26 12:10:46,329][123091] Updated weights for policy 0, policy_version 1576122 (0.0008) [2023-12-26 12:10:46,374][123090] Updated weights for policy 1, policy_version 1565632 (0.0010) [2023-12-26 12:10:46,385][123091] Updated weights for policy 0, policy_version 1576132 (0.0006) [2023-12-26 12:10:46,437][123091] Updated weights for policy 0, policy_version 1576142 (0.0009) [2023-12-26 12:10:47,078][123090] Updated weights for policy 1, policy_version 1565642 (0.0006) [2023-12-26 12:10:47,137][123090] Updated weights for policy 1, policy_version 1565652 (0.0005) [2023-12-26 12:10:47,199][123090] Updated weights for policy 1, policy_version 1565662 (0.0005) [2023-12-26 12:10:47,272][123091] Updated weights for policy 0, policy_version 1576152 (0.0010) [2023-12-26 12:10:47,323][123091] Updated weights for policy 0, policy_version 1576162 (0.0010) [2023-12-26 12:10:47,371][123091] Updated weights for policy 0, policy_version 1576172 (0.0009) [2023-12-26 12:10:47,822][123090] Updated weights for policy 1, policy_version 1565672 (0.0005) [2023-12-26 12:10:47,886][123090] Updated weights for policy 1, policy_version 1565682 (0.0005) [2023-12-26 12:10:47,943][123090] Updated weights for policy 1, policy_version 1565692 (0.0005) [2023-12-26 12:10:48,178][123091] Updated weights for policy 0, policy_version 1576182 (0.0008) [2023-12-26 12:10:48,235][123091] Updated weights for policy 0, policy_version 1576192 (0.0005) [2023-12-26 12:10:48,297][123091] Updated weights for policy 0, policy_version 1576202 (0.0005) [2023-12-26 12:10:48,654][123090] Updated weights for policy 1, policy_version 1565702 (0.0005) [2023-12-26 12:10:48,720][123090] Updated weights for policy 1, policy_version 1565712 (0.0009) [2023-12-26 12:10:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 804331520. Throughput: 0: 8993.2, 1: 8893.2. Samples: 804346540. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:48,785][121949] Avg episode reward: [(0, '6157.129'), (1, '5677.945')] [2023-12-26 12:10:48,786][123090] Updated weights for policy 1, policy_version 1565722 (0.0010) [2023-12-26 12:10:49,047][123091] Updated weights for policy 0, policy_version 1576212 (0.0009) [2023-12-26 12:10:49,105][123091] Updated weights for policy 0, policy_version 1576222 (0.0010) [2023-12-26 12:10:49,154][123091] Updated weights for policy 0, policy_version 1576232 (0.0009) [2023-12-26 12:10:49,640][123090] Updated weights for policy 1, policy_version 1565732 (0.0011) [2023-12-26 12:10:49,699][123090] Updated weights for policy 1, policy_version 1565742 (0.0010) [2023-12-26 12:10:49,763][123090] Updated weights for policy 1, policy_version 1565752 (0.0011) [2023-12-26 12:10:49,991][123091] Updated weights for policy 0, policy_version 1576242 (0.0010) [2023-12-26 12:10:50,054][123091] Updated weights for policy 0, policy_version 1576252 (0.0011) [2023-12-26 12:10:50,129][123091] Updated weights for policy 0, policy_version 1576262 (0.0006) [2023-12-26 12:10:50,191][123091] Updated weights for policy 0, policy_version 1576272 (0.0006) [2023-12-26 12:10:50,564][123090] Updated weights for policy 1, policy_version 1565762 (0.0010) [2023-12-26 12:10:50,641][123090] Updated weights for policy 1, policy_version 1565772 (0.0007) [2023-12-26 12:10:50,698][123090] Updated weights for policy 1, policy_version 1565782 (0.0005) [2023-12-26 12:10:50,764][123090] Updated weights for policy 1, policy_version 1565792 (0.0009) [2023-12-26 12:10:50,841][123091] Updated weights for policy 0, policy_version 1576282 (0.0010) [2023-12-26 12:10:50,898][123091] Updated weights for policy 0, policy_version 1576292 (0.0009) [2023-12-26 12:10:50,958][123091] Updated weights for policy 0, policy_version 1576302 (0.0009) [2023-12-26 12:10:51,513][123090] Updated weights for policy 1, policy_version 1565802 (0.0009) [2023-12-26 12:10:51,570][123090] Updated weights for policy 1, policy_version 1565812 (0.0009) [2023-12-26 12:10:51,628][123090] Updated weights for policy 1, policy_version 1565822 (0.0009) [2023-12-26 12:10:51,846][123091] Updated weights for policy 0, policy_version 1576312 (0.0010) [2023-12-26 12:10:51,909][123091] Updated weights for policy 0, policy_version 1576322 (0.0009) [2023-12-26 12:10:51,977][123091] Updated weights for policy 0, policy_version 1576332 (0.0010) [2023-12-26 12:10:52,528][123090] Updated weights for policy 1, policy_version 1565832 (0.0010) [2023-12-26 12:10:52,587][123090] Updated weights for policy 1, policy_version 1565842 (0.0008) [2023-12-26 12:10:52,648][123090] Updated weights for policy 1, policy_version 1565852 (0.0009) [2023-12-26 12:10:52,793][123091] Updated weights for policy 0, policy_version 1576342 (0.0010) [2023-12-26 12:10:52,857][123091] Updated weights for policy 0, policy_version 1576352 (0.0009) [2023-12-26 12:10:52,920][123091] Updated weights for policy 0, policy_version 1576362 (0.0009) [2023-12-26 12:10:53,524][123090] Updated weights for policy 1, policy_version 1565862 (0.0010) [2023-12-26 12:10:53,597][123090] Updated weights for policy 1, policy_version 1565872 (0.0007) [2023-12-26 12:10:53,656][123090] Updated weights for policy 1, policy_version 1565882 (0.0006) [2023-12-26 12:10:53,694][123091] Updated weights for policy 0, policy_version 1576372 (0.0008) [2023-12-26 12:10:53,774][123091] Updated weights for policy 0, policy_version 1576382 (0.0005) [2023-12-26 12:10:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 804421632. Throughput: 0: 9029.0, 1: 8860.7. Samples: 804400016. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:53,785][121949] Avg episode reward: [(0, '6273.818'), (1, '5596.928')] [2023-12-26 12:10:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001565888_400867328.pth... [2023-12-26 12:10:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001564864_400605184.pth [2023-12-26 12:10:53,840][123091] Updated weights for policy 0, policy_version 1576392 (0.0009) [2023-12-26 12:10:53,880][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001576400_403562496.pth... [2023-12-26 12:10:53,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001575312_403283968.pth [2023-12-26 12:10:54,380][123090] Updated weights for policy 1, policy_version 1565892 (0.0009) [2023-12-26 12:10:54,431][123090] Updated weights for policy 1, policy_version 1565902 (0.0007) [2023-12-26 12:10:54,491][123090] Updated weights for policy 1, policy_version 1565912 (0.0011) [2023-12-26 12:10:54,530][123091] Updated weights for policy 0, policy_version 1576402 (0.0006) [2023-12-26 12:10:54,577][123091] Updated weights for policy 0, policy_version 1576412 (0.0005) [2023-12-26 12:10:54,635][123091] Updated weights for policy 0, policy_version 1576422 (0.0005) [2023-12-26 12:10:54,703][123091] Updated weights for policy 0, policy_version 1576432 (0.0005) [2023-12-26 12:10:55,188][123090] Updated weights for policy 1, policy_version 1565922 (0.0009) [2023-12-26 12:10:55,247][123090] Updated weights for policy 1, policy_version 1565932 (0.0005) [2023-12-26 12:10:55,294][123090] Updated weights for policy 1, policy_version 1565942 (0.0005) [2023-12-26 12:10:55,356][123090] Updated weights for policy 1, policy_version 1565952 (0.0005) [2023-12-26 12:10:55,405][123091] Updated weights for policy 0, policy_version 1576442 (0.0005) [2023-12-26 12:10:55,457][123091] Updated weights for policy 0, policy_version 1576452 (0.0005) [2023-12-26 12:10:55,508][123091] Updated weights for policy 0, policy_version 1576462 (0.0006) [2023-12-26 12:10:55,969][123090] Updated weights for policy 1, policy_version 1565962 (0.0005) [2023-12-26 12:10:56,035][123090] Updated weights for policy 1, policy_version 1565972 (0.0005) [2023-12-26 12:10:56,089][123090] Updated weights for policy 1, policy_version 1565982 (0.0005) [2023-12-26 12:10:56,206][123091] Updated weights for policy 0, policy_version 1576472 (0.0009) [2023-12-26 12:10:56,252][123091] Updated weights for policy 0, policy_version 1576482 (0.0012) [2023-12-26 12:10:56,311][123091] Updated weights for policy 0, policy_version 1576492 (0.0011) [2023-12-26 12:10:56,765][123090] Updated weights for policy 1, policy_version 1565992 (0.0005) [2023-12-26 12:10:56,820][123090] Updated weights for policy 1, policy_version 1566002 (0.0005) [2023-12-26 12:10:56,876][123090] Updated weights for policy 1, policy_version 1566012 (0.0005) [2023-12-26 12:10:57,171][123091] Updated weights for policy 0, policy_version 1576502 (0.0011) [2023-12-26 12:10:57,215][123091] Updated weights for policy 0, policy_version 1576512 (0.0010) [2023-12-26 12:10:57,261][123091] Updated weights for policy 0, policy_version 1576522 (0.0010) [2023-12-26 12:10:57,562][123090] Updated weights for policy 1, policy_version 1566022 (0.0005) [2023-12-26 12:10:57,616][123090] Updated weights for policy 1, policy_version 1566032 (0.0005) [2023-12-26 12:10:57,661][123090] Updated weights for policy 1, policy_version 1566042 (0.0005) [2023-12-26 12:10:57,971][123091] Updated weights for policy 0, policy_version 1576532 (0.0008) [2023-12-26 12:10:58,052][123091] Updated weights for policy 0, policy_version 1576542 (0.0007) [2023-12-26 12:10:58,108][123091] Updated weights for policy 0, policy_version 1576552 (0.0010) [2023-12-26 12:10:58,305][123090] Updated weights for policy 1, policy_version 1566052 (0.0006) [2023-12-26 12:10:58,372][123090] Updated weights for policy 1, policy_version 1566062 (0.0009) [2023-12-26 12:10:58,444][123090] Updated weights for policy 1, policy_version 1566072 (0.0009) [2023-12-26 12:10:58,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 804519936. Throughput: 0: 9107.8, 1: 8965.7. Samples: 804513124. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:10:58,785][121949] Avg episode reward: [(0, '6099.898'), (1, '5604.205')] [2023-12-26 12:10:59,013][123091] Updated weights for policy 0, policy_version 1576562 (0.0009) [2023-12-26 12:10:59,079][123091] Updated weights for policy 0, policy_version 1576572 (0.0008) [2023-12-26 12:10:59,152][123091] Updated weights for policy 0, policy_version 1576582 (0.0007) [2023-12-26 12:10:59,226][123091] Updated weights for policy 0, policy_version 1576592 (0.0008) [2023-12-26 12:10:59,275][123090] Updated weights for policy 1, policy_version 1566082 (0.0010) [2023-12-26 12:10:59,341][123090] Updated weights for policy 1, policy_version 1566092 (0.0006) [2023-12-26 12:10:59,411][123090] Updated weights for policy 1, policy_version 1566102 (0.0010) [2023-12-26 12:10:59,471][123090] Updated weights for policy 1, policy_version 1566112 (0.0011) [2023-12-26 12:10:59,938][123091] Updated weights for policy 0, policy_version 1576602 (0.0008) [2023-12-26 12:11:00,007][123091] Updated weights for policy 0, policy_version 1576612 (0.0009) [2023-12-26 12:11:00,072][123091] Updated weights for policy 0, policy_version 1576622 (0.0010) [2023-12-26 12:11:00,266][123090] Updated weights for policy 1, policy_version 1566122 (0.0009) [2023-12-26 12:11:00,315][123090] Updated weights for policy 1, policy_version 1566132 (0.0009) [2023-12-26 12:11:00,373][123090] Updated weights for policy 1, policy_version 1566142 (0.0010) [2023-12-26 12:11:00,927][123091] Updated weights for policy 0, policy_version 1576632 (0.0009) [2023-12-26 12:11:00,980][123091] Updated weights for policy 0, policy_version 1576642 (0.0008) [2023-12-26 12:11:01,032][123091] Updated weights for policy 0, policy_version 1576652 (0.0009) [2023-12-26 12:11:01,257][123090] Updated weights for policy 1, policy_version 1566152 (0.0009) [2023-12-26 12:11:01,322][123090] Updated weights for policy 1, policy_version 1566162 (0.0009) [2023-12-26 12:11:01,388][123090] Updated weights for policy 1, policy_version 1566172 (0.0009) [2023-12-26 12:11:01,944][123091] Updated weights for policy 0, policy_version 1576662 (0.0010) [2023-12-26 12:11:01,999][123091] Updated weights for policy 0, policy_version 1576672 (0.0010) [2023-12-26 12:11:02,051][123091] Updated weights for policy 0, policy_version 1576682 (0.0009) [2023-12-26 12:11:02,154][123090] Updated weights for policy 1, policy_version 1566182 (0.0009) [2023-12-26 12:11:02,206][123090] Updated weights for policy 1, policy_version 1566192 (0.0008) [2023-12-26 12:11:02,266][123090] Updated weights for policy 1, policy_version 1566202 (0.0009) [2023-12-26 12:11:02,827][123091] Updated weights for policy 0, policy_version 1576692 (0.0008) [2023-12-26 12:11:02,884][123091] Updated weights for policy 0, policy_version 1576702 (0.0006) [2023-12-26 12:11:02,941][123091] Updated weights for policy 0, policy_version 1576712 (0.0009) [2023-12-26 12:11:03,202][123090] Updated weights for policy 1, policy_version 1566212 (0.0009) [2023-12-26 12:11:03,263][123090] Updated weights for policy 1, policy_version 1566222 (0.0008) [2023-12-26 12:11:03,327][123090] Updated weights for policy 1, policy_version 1566232 (0.0009) [2023-12-26 12:11:03,707][123091] Updated weights for policy 0, policy_version 1576722 (0.0010) [2023-12-26 12:11:03,753][123091] Updated weights for policy 0, policy_version 1576732 (0.0010) [2023-12-26 12:11:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 804601856. Throughput: 0: 9156.6, 1: 8819.0. Samples: 804617752. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:03,785][121949] Avg episode reward: [(0, '6044.625'), (1, '5667.348')] [2023-12-26 12:11:03,797][123091] Updated weights for policy 0, policy_version 1576742 (0.0010) [2023-12-26 12:11:03,851][123091] Updated weights for policy 0, policy_version 1576752 (0.0010) [2023-12-26 12:11:04,158][123090] Updated weights for policy 1, policy_version 1566243 (0.0009) [2023-12-26 12:11:04,219][123090] Updated weights for policy 1, policy_version 1566253 (0.0009) [2023-12-26 12:11:04,285][123090] Updated weights for policy 1, policy_version 1566263 (0.0009) [2023-12-26 12:11:04,740][123091] Updated weights for policy 0, policy_version 1576762 (0.0011) [2023-12-26 12:11:04,807][123091] Updated weights for policy 0, policy_version 1576772 (0.0011) [2023-12-26 12:11:04,878][123091] Updated weights for policy 0, policy_version 1576782 (0.0011) [2023-12-26 12:11:05,135][123090] Updated weights for policy 1, policy_version 1566273 (0.0010) [2023-12-26 12:11:05,191][123090] Updated weights for policy 1, policy_version 1566283 (0.0010) [2023-12-26 12:11:05,252][123090] Updated weights for policy 1, policy_version 1566293 (0.0009) [2023-12-26 12:11:05,311][123090] Updated weights for policy 1, policy_version 1566303 (0.0008) [2023-12-26 12:11:05,627][123091] Updated weights for policy 0, policy_version 1576792 (0.0010) [2023-12-26 12:11:05,678][123091] Updated weights for policy 0, policy_version 1576802 (0.0009) [2023-12-26 12:11:05,741][123091] Updated weights for policy 0, policy_version 1576812 (0.0009) [2023-12-26 12:11:06,095][123090] Updated weights for policy 1, policy_version 1566313 (0.0007) [2023-12-26 12:11:06,171][123090] Updated weights for policy 1, policy_version 1566323 (0.0007) [2023-12-26 12:11:06,248][123090] Updated weights for policy 1, policy_version 1566333 (0.0006) [2023-12-26 12:11:06,605][123091] Updated weights for policy 0, policy_version 1576822 (0.0010) [2023-12-26 12:11:06,668][123091] Updated weights for policy 0, policy_version 1576832 (0.0011) [2023-12-26 12:11:06,727][123091] Updated weights for policy 0, policy_version 1576842 (0.0010) [2023-12-26 12:11:06,861][123090] Updated weights for policy 1, policy_version 1566343 (0.0008) [2023-12-26 12:11:06,919][123090] Updated weights for policy 1, policy_version 1566353 (0.0010) [2023-12-26 12:11:06,973][123090] Updated weights for policy 1, policy_version 1566363 (0.0010) [2023-12-26 12:11:07,489][123091] Updated weights for policy 0, policy_version 1576852 (0.0008) [2023-12-26 12:11:07,548][123091] Updated weights for policy 0, policy_version 1576862 (0.0005) [2023-12-26 12:11:07,610][123091] Updated weights for policy 0, policy_version 1576872 (0.0005) [2023-12-26 12:11:07,772][123090] Updated weights for policy 1, policy_version 1566373 (0.0007) [2023-12-26 12:11:07,820][123090] Updated weights for policy 1, policy_version 1566383 (0.0005) [2023-12-26 12:11:07,877][123090] Updated weights for policy 1, policy_version 1566393 (0.0005) [2023-12-26 12:11:08,264][123091] Updated weights for policy 0, policy_version 1576882 (0.0005) [2023-12-26 12:11:08,350][123091] Updated weights for policy 0, policy_version 1576892 (0.0006) [2023-12-26 12:11:08,416][123091] Updated weights for policy 0, policy_version 1576902 (0.0007) [2023-12-26 12:11:08,471][123091] Updated weights for policy 0, policy_version 1576912 (0.0006) [2023-12-26 12:11:08,599][123090] Updated weights for policy 1, policy_version 1566403 (0.0007) [2023-12-26 12:11:08,671][123090] Updated weights for policy 1, policy_version 1566413 (0.0011) [2023-12-26 12:11:08,735][123090] Updated weights for policy 1, policy_version 1566423 (0.0011) [2023-12-26 12:11:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 804691968. Throughput: 0: 9167.1, 1: 8838.2. Samples: 804669932. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:08,785][121949] Avg episode reward: [(0, '6019.162'), (1, '5575.212')] [2023-12-26 12:11:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001576912_403693568.pth... [2023-12-26 12:11:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001566432_401006592.pth... [2023-12-26 12:11:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001575856_403423232.pth [2023-12-26 12:11:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001565376_400736256.pth [2023-12-26 12:11:09,223][123091] Updated weights for policy 0, policy_version 1576922 (0.0010) [2023-12-26 12:11:09,282][123091] Updated weights for policy 0, policy_version 1576932 (0.0008) [2023-12-26 12:11:09,348][123091] Updated weights for policy 0, policy_version 1576942 (0.0008) [2023-12-26 12:11:09,572][123090] Updated weights for policy 1, policy_version 1566433 (0.0010) [2023-12-26 12:11:09,646][123090] Updated weights for policy 1, policy_version 1566443 (0.0009) [2023-12-26 12:11:09,712][123090] Updated weights for policy 1, policy_version 1566453 (0.0006) [2023-12-26 12:11:09,773][123090] Updated weights for policy 1, policy_version 1566463 (0.0006) [2023-12-26 12:11:10,158][123091] Updated weights for policy 0, policy_version 1576952 (0.0007) [2023-12-26 12:11:10,228][123091] Updated weights for policy 0, policy_version 1576962 (0.0009) [2023-12-26 12:11:10,289][123091] Updated weights for policy 0, policy_version 1576972 (0.0009) [2023-12-26 12:11:10,577][123090] Updated weights for policy 1, policy_version 1566473 (0.0009) [2023-12-26 12:11:10,644][123090] Updated weights for policy 1, policy_version 1566483 (0.0009) [2023-12-26 12:11:10,713][123090] Updated weights for policy 1, policy_version 1566493 (0.0006) [2023-12-26 12:11:11,069][123091] Updated weights for policy 0, policy_version 1576982 (0.0009) [2023-12-26 12:11:11,138][123091] Updated weights for policy 0, policy_version 1576992 (0.0009) [2023-12-26 12:11:11,200][123091] Updated weights for policy 0, policy_version 1577002 (0.0009) [2023-12-26 12:11:11,469][123090] Updated weights for policy 1, policy_version 1566503 (0.0008) [2023-12-26 12:11:11,535][123090] Updated weights for policy 1, policy_version 1566513 (0.0009) [2023-12-26 12:11:11,591][123090] Updated weights for policy 1, policy_version 1566523 (0.0009) [2023-12-26 12:11:12,038][123091] Updated weights for policy 0, policy_version 1577012 (0.0009) [2023-12-26 12:11:12,095][123091] Updated weights for policy 0, policy_version 1577022 (0.0009) [2023-12-26 12:11:12,151][123091] Updated weights for policy 0, policy_version 1577032 (0.0009) [2023-12-26 12:11:12,370][123090] Updated weights for policy 1, policy_version 1566533 (0.0010) [2023-12-26 12:11:12,440][123090] Updated weights for policy 1, policy_version 1566543 (0.0009) [2023-12-26 12:11:12,501][123090] Updated weights for policy 1, policy_version 1566553 (0.0006) [2023-12-26 12:11:13,025][123091] Updated weights for policy 0, policy_version 1577042 (0.0009) [2023-12-26 12:11:13,088][123091] Updated weights for policy 0, policy_version 1577052 (0.0006) [2023-12-26 12:11:13,146][123091] Updated weights for policy 0, policy_version 1577062 (0.0009) [2023-12-26 12:11:13,205][123091] Updated weights for policy 0, policy_version 1577072 (0.0010) [2023-12-26 12:11:13,207][123090] Updated weights for policy 1, policy_version 1566563 (0.0006) [2023-12-26 12:11:13,268][123090] Updated weights for policy 1, policy_version 1566573 (0.0010) [2023-12-26 12:11:13,328][123090] Updated weights for policy 1, policy_version 1566583 (0.0009) [2023-12-26 12:11:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 804782080. Throughput: 0: 9097.6, 1: 8873.7. Samples: 804777000. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:13,784][121949] Avg episode reward: [(0, '5995.505'), (1, '5633.623')] [2023-12-26 12:11:14,002][123091] Updated weights for policy 0, policy_version 1577082 (0.0006) [2023-12-26 12:11:14,058][123091] Updated weights for policy 0, policy_version 1577092 (0.0006) [2023-12-26 12:11:14,107][123091] Updated weights for policy 0, policy_version 1577102 (0.0006) [2023-12-26 12:11:14,162][123090] Updated weights for policy 1, policy_version 1566593 (0.0009) [2023-12-26 12:11:14,230][123090] Updated weights for policy 1, policy_version 1566603 (0.0010) [2023-12-26 12:11:14,290][123090] Updated weights for policy 1, policy_version 1566613 (0.0010) [2023-12-26 12:11:14,340][123090] Updated weights for policy 1, policy_version 1566623 (0.0009) [2023-12-26 12:11:14,880][123091] Updated weights for policy 0, policy_version 1577112 (0.0006) [2023-12-26 12:11:14,955][123091] Updated weights for policy 0, policy_version 1577122 (0.0006) [2023-12-26 12:11:15,029][123091] Updated weights for policy 0, policy_version 1577132 (0.0007) [2023-12-26 12:11:15,219][123090] Updated weights for policy 1, policy_version 1566633 (0.0009) [2023-12-26 12:11:15,284][123090] Updated weights for policy 1, policy_version 1566643 (0.0009) [2023-12-26 12:11:15,349][123090] Updated weights for policy 1, policy_version 1566653 (0.0009) [2023-12-26 12:11:15,800][123091] Updated weights for policy 0, policy_version 1577142 (0.0010) [2023-12-26 12:11:15,863][123091] Updated weights for policy 0, policy_version 1577152 (0.0010) [2023-12-26 12:11:15,915][123091] Updated weights for policy 0, policy_version 1577162 (0.0010) [2023-12-26 12:11:16,111][123090] Updated weights for policy 1, policy_version 1566663 (0.0007) [2023-12-26 12:11:16,167][123090] Updated weights for policy 1, policy_version 1566673 (0.0005) [2023-12-26 12:11:16,223][123090] Updated weights for policy 1, policy_version 1566683 (0.0005) [2023-12-26 12:11:16,789][123091] Updated weights for policy 0, policy_version 1577172 (0.0010) [2023-12-26 12:11:16,839][123091] Updated weights for policy 0, policy_version 1577182 (0.0009) [2023-12-26 12:11:16,900][123091] Updated weights for policy 0, policy_version 1577192 (0.0009) [2023-12-26 12:11:16,980][123090] Updated weights for policy 1, policy_version 1566693 (0.0008) [2023-12-26 12:11:17,035][123090] Updated weights for policy 1, policy_version 1566705 (0.0011) [2023-12-26 12:11:17,089][123090] Updated weights for policy 1, policy_version 1566715 (0.0010) [2023-12-26 12:11:17,702][123091] Updated weights for policy 0, policy_version 1577202 (0.0010) [2023-12-26 12:11:17,762][123091] Updated weights for policy 0, policy_version 1577212 (0.0009) [2023-12-26 12:11:17,813][123091] Updated weights for policy 0, policy_version 1577222 (0.0010) [2023-12-26 12:11:17,866][123091] Updated weights for policy 0, policy_version 1577232 (0.0009) [2023-12-26 12:11:17,966][123090] Updated weights for policy 1, policy_version 1566726 (0.0010) [2023-12-26 12:11:18,024][123090] Updated weights for policy 1, policy_version 1566736 (0.0009) [2023-12-26 12:11:18,072][123090] Updated weights for policy 1, policy_version 1566746 (0.0008) [2023-12-26 12:11:18,706][123091] Updated weights for policy 0, policy_version 1577242 (0.0010) [2023-12-26 12:11:18,770][123091] Updated weights for policy 0, policy_version 1577252 (0.0009) [2023-12-26 12:11:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 804864000. Throughput: 0: 9040.2, 1: 8850.4. Samples: 804881604. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:18,785][121949] Avg episode reward: [(0, '5910.445'), (1, '5588.881')] [2023-12-26 12:11:18,824][123091] Updated weights for policy 0, policy_version 1577262 (0.0009) [2023-12-26 12:11:18,934][123090] Updated weights for policy 1, policy_version 1566756 (0.0009) [2023-12-26 12:11:18,998][123090] Updated weights for policy 1, policy_version 1566766 (0.0006) [2023-12-26 12:11:19,068][123090] Updated weights for policy 1, policy_version 1566776 (0.0005) [2023-12-26 12:11:19,683][123091] Updated weights for policy 0, policy_version 1577272 (0.0010) [2023-12-26 12:11:19,747][123091] Updated weights for policy 0, policy_version 1577282 (0.0010) [2023-12-26 12:11:19,773][123090] Updated weights for policy 1, policy_version 1566786 (0.0005) [2023-12-26 12:11:19,804][123091] Updated weights for policy 0, policy_version 1577292 (0.0008) [2023-12-26 12:11:19,852][123090] Updated weights for policy 1, policy_version 1566796 (0.0009) [2023-12-26 12:11:19,910][123090] Updated weights for policy 1, policy_version 1566806 (0.0010) [2023-12-26 12:11:19,983][123090] Updated weights for policy 1, policy_version 1566816 (0.0010) [2023-12-26 12:11:20,674][123091] Updated weights for policy 0, policy_version 1577302 (0.0009) [2023-12-26 12:11:20,733][123091] Updated weights for policy 0, policy_version 1577312 (0.0010) [2023-12-26 12:11:20,794][123091] Updated weights for policy 0, policy_version 1577322 (0.0009) [2023-12-26 12:11:20,805][123090] Updated weights for policy 1, policy_version 1566826 (0.0009) [2023-12-26 12:11:20,872][123090] Updated weights for policy 1, policy_version 1566836 (0.0007) [2023-12-26 12:11:20,939][123090] Updated weights for policy 1, policy_version 1566846 (0.0010) [2023-12-26 12:11:21,669][123091] Updated weights for policy 0, policy_version 1577332 (0.0009) [2023-12-26 12:11:21,742][123091] Updated weights for policy 0, policy_version 1577342 (0.0010) [2023-12-26 12:11:21,801][123090] Updated weights for policy 1, policy_version 1566856 (0.0008) [2023-12-26 12:11:21,817][123091] Updated weights for policy 0, policy_version 1577352 (0.0006) [2023-12-26 12:11:21,861][123090] Updated weights for policy 1, policy_version 1566866 (0.0008) [2023-12-26 12:11:21,913][123090] Updated weights for policy 1, policy_version 1566876 (0.0008) [2023-12-26 12:11:22,667][123091] Updated weights for policy 0, policy_version 1577362 (0.0008) [2023-12-26 12:11:22,732][123091] Updated weights for policy 0, policy_version 1577372 (0.0009) [2023-12-26 12:11:22,745][123090] Updated weights for policy 1, policy_version 1566886 (0.0008) [2023-12-26 12:11:22,793][123091] Updated weights for policy 0, policy_version 1577382 (0.0006) [2023-12-26 12:11:22,802][123090] Updated weights for policy 1, policy_version 1566896 (0.0009) [2023-12-26 12:11:22,856][123091] Updated weights for policy 0, policy_version 1577392 (0.0009) [2023-12-26 12:11:22,871][123090] Updated weights for policy 1, policy_version 1566906 (0.0009) [2023-12-26 12:11:23,671][123091] Updated weights for policy 0, policy_version 1577402 (0.0010) [2023-12-26 12:11:23,693][123090] Updated weights for policy 1, policy_version 1566916 (0.0009) [2023-12-26 12:11:23,735][123091] Updated weights for policy 0, policy_version 1577412 (0.0007) [2023-12-26 12:11:23,754][123090] Updated weights for policy 1, policy_version 1566926 (0.0009) [2023-12-26 12:11:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 804945920. Throughput: 0: 8933.2, 1: 8831.9. Samples: 804932056. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:23,785][121949] Avg episode reward: [(0, '6040.178'), (1, '5595.779')] [2023-12-26 12:11:23,797][123091] Updated weights for policy 0, policy_version 1577422 (0.0009) [2023-12-26 12:11:23,808][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001577424_403824640.pth... [2023-12-26 12:11:23,813][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001576400_403562496.pth [2023-12-26 12:11:23,818][123090] Updated weights for policy 1, policy_version 1566936 (0.0006) [2023-12-26 12:11:23,854][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001566944_401137664.pth... [2023-12-26 12:11:23,857][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001565888_400867328.pth [2023-12-26 12:11:24,578][123090] Updated weights for policy 1, policy_version 1566946 (0.0009) [2023-12-26 12:11:24,641][123090] Updated weights for policy 1, policy_version 1566956 (0.0010) [2023-12-26 12:11:24,645][123091] Updated weights for policy 0, policy_version 1577432 (0.0007) [2023-12-26 12:11:24,697][123091] Updated weights for policy 0, policy_version 1577442 (0.0006) [2023-12-26 12:11:24,704][123090] Updated weights for policy 1, policy_version 1566966 (0.0010) [2023-12-26 12:11:24,753][123091] Updated weights for policy 0, policy_version 1577452 (0.0007) [2023-12-26 12:11:24,770][123090] Updated weights for policy 1, policy_version 1566976 (0.0006) [2023-12-26 12:11:25,402][123090] Updated weights for policy 1, policy_version 1566986 (0.0005) [2023-12-26 12:11:25,445][123091] Updated weights for policy 0, policy_version 1577462 (0.0008) [2023-12-26 12:11:25,451][123090] Updated weights for policy 1, policy_version 1566996 (0.0005) [2023-12-26 12:11:25,501][123091] Updated weights for policy 0, policy_version 1577472 (0.0010) [2023-12-26 12:11:25,505][123090] Updated weights for policy 1, policy_version 1567006 (0.0008) [2023-12-26 12:11:25,568][123091] Updated weights for policy 0, policy_version 1577482 (0.0009) [2023-12-26 12:11:26,259][123091] Updated weights for policy 0, policy_version 1577492 (0.0007) [2023-12-26 12:11:26,315][123091] Updated weights for policy 0, policy_version 1577502 (0.0005) [2023-12-26 12:11:26,366][123090] Updated weights for policy 1, policy_version 1567016 (0.0008) [2023-12-26 12:11:26,369][123091] Updated weights for policy 0, policy_version 1577512 (0.0007) [2023-12-26 12:11:26,422][123090] Updated weights for policy 1, policy_version 1567026 (0.0010) [2023-12-26 12:11:26,471][123090] Updated weights for policy 1, policy_version 1567036 (0.0008) [2023-12-26 12:11:27,122][123091] Updated weights for policy 0, policy_version 1577522 (0.0007) [2023-12-26 12:11:27,191][123091] Updated weights for policy 0, policy_version 1577532 (0.0009) [2023-12-26 12:11:27,257][123091] Updated weights for policy 0, policy_version 1577542 (0.0009) [2023-12-26 12:11:27,280][123090] Updated weights for policy 1, policy_version 1567046 (0.0008) [2023-12-26 12:11:27,311][123091] Updated weights for policy 0, policy_version 1577552 (0.0008) [2023-12-26 12:11:27,334][123090] Updated weights for policy 1, policy_version 1567056 (0.0008) [2023-12-26 12:11:27,400][123090] Updated weights for policy 1, policy_version 1567066 (0.0009) [2023-12-26 12:11:28,129][123091] Updated weights for policy 0, policy_version 1577562 (0.0009) [2023-12-26 12:11:28,159][123090] Updated weights for policy 1, policy_version 1567076 (0.0008) [2023-12-26 12:11:28,189][123091] Updated weights for policy 0, policy_version 1577572 (0.0009) [2023-12-26 12:11:28,217][123090] Updated weights for policy 1, policy_version 1567086 (0.0008) [2023-12-26 12:11:28,237][123091] Updated weights for policy 0, policy_version 1577582 (0.0009) [2023-12-26 12:11:28,274][123090] Updated weights for policy 1, policy_version 1567096 (0.0008) [2023-12-26 12:11:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 805044224. Throughput: 0: 8843.7, 1: 8887.8. Samples: 805037728. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:28,785][121949] Avg episode reward: [(0, '6110.503'), (1, '5676.737')] [2023-12-26 12:11:29,023][123090] Updated weights for policy 1, policy_version 1567106 (0.0008) [2023-12-26 12:11:29,097][123090] Updated weights for policy 1, policy_version 1567116 (0.0009) [2023-12-26 12:11:29,132][123091] Updated weights for policy 0, policy_version 1577592 (0.0008) [2023-12-26 12:11:29,156][123090] Updated weights for policy 1, policy_version 1567126 (0.0008) [2023-12-26 12:11:29,194][123091] Updated weights for policy 0, policy_version 1577602 (0.0010) [2023-12-26 12:11:29,221][123090] Updated weights for policy 1, policy_version 1567136 (0.0008) [2023-12-26 12:11:29,265][123091] Updated weights for policy 0, policy_version 1577612 (0.0009) [2023-12-26 12:11:30,057][123090] Updated weights for policy 1, policy_version 1567146 (0.0009) [2023-12-26 12:11:30,082][123091] Updated weights for policy 0, policy_version 1577622 (0.0007) [2023-12-26 12:11:30,121][123090] Updated weights for policy 1, policy_version 1567156 (0.0007) [2023-12-26 12:11:30,144][123091] Updated weights for policy 0, policy_version 1577632 (0.0006) [2023-12-26 12:11:30,185][123090] Updated weights for policy 1, policy_version 1567166 (0.0009) [2023-12-26 12:11:30,204][123091] Updated weights for policy 0, policy_version 1577642 (0.0006) [2023-12-26 12:11:30,979][123091] Updated weights for policy 0, policy_version 1577652 (0.0010) [2023-12-26 12:11:31,023][123090] Updated weights for policy 1, policy_version 1567176 (0.0008) [2023-12-26 12:11:31,046][123091] Updated weights for policy 0, policy_version 1577662 (0.0009) [2023-12-26 12:11:31,093][123090] Updated weights for policy 1, policy_version 1567186 (0.0008) [2023-12-26 12:11:31,109][123091] Updated weights for policy 0, policy_version 1577672 (0.0009) [2023-12-26 12:11:31,158][123090] Updated weights for policy 1, policy_version 1567196 (0.0008) [2023-12-26 12:11:31,943][123091] Updated weights for policy 0, policy_version 1577682 (0.0008) [2023-12-26 12:11:31,995][123090] Updated weights for policy 1, policy_version 1567206 (0.0006) [2023-12-26 12:11:32,002][123091] Updated weights for policy 0, policy_version 1577692 (0.0009) [2023-12-26 12:11:32,052][123090] Updated weights for policy 1, policy_version 1567216 (0.0007) [2023-12-26 12:11:32,068][123091] Updated weights for policy 0, policy_version 1577702 (0.0008) [2023-12-26 12:11:32,110][123090] Updated weights for policy 1, policy_version 1567226 (0.0009) [2023-12-26 12:11:32,130][123091] Updated weights for policy 0, policy_version 1577712 (0.0007) [2023-12-26 12:11:32,941][123091] Updated weights for policy 0, policy_version 1577722 (0.0010) [2023-12-26 12:11:32,943][123090] Updated weights for policy 1, policy_version 1567236 (0.0008) [2023-12-26 12:11:33,000][123090] Updated weights for policy 1, policy_version 1567246 (0.0006) [2023-12-26 12:11:33,009][123091] Updated weights for policy 0, policy_version 1577732 (0.0007) [2023-12-26 12:11:33,047][123090] Updated weights for policy 1, policy_version 1567256 (0.0005) [2023-12-26 12:11:33,084][123091] Updated weights for policy 0, policy_version 1577742 (0.0008) [2023-12-26 12:11:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 805126144. Throughput: 0: 8776.4, 1: 8900.2. Samples: 805141988. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:33,785][121949] Avg episode reward: [(0, '6043.843'), (1, '5873.181')] [2023-12-26 12:11:33,852][123090] Updated weights for policy 1, policy_version 1567266 (0.0006) [2023-12-26 12:11:33,903][123091] Updated weights for policy 0, policy_version 1577752 (0.0009) [2023-12-26 12:11:33,905][123090] Updated weights for policy 1, policy_version 1567276 (0.0007) [2023-12-26 12:11:33,954][123091] Updated weights for policy 0, policy_version 1577762 (0.0010) [2023-12-26 12:11:33,957][123090] Updated weights for policy 1, policy_version 1567286 (0.0008) [2023-12-26 12:11:34,009][123091] Updated weights for policy 0, policy_version 1577772 (0.0006) [2023-12-26 12:11:34,014][123090] Updated weights for policy 1, policy_version 1567296 (0.0010) [2023-12-26 12:11:34,782][123091] Updated weights for policy 0, policy_version 1577782 (0.0007) [2023-12-26 12:11:34,841][123091] Updated weights for policy 0, policy_version 1577792 (0.0006) [2023-12-26 12:11:34,856][123090] Updated weights for policy 1, policy_version 1567306 (0.0009) [2023-12-26 12:11:34,901][123091] Updated weights for policy 0, policy_version 1577802 (0.0007) [2023-12-26 12:11:34,914][123090] Updated weights for policy 1, policy_version 1567316 (0.0007) [2023-12-26 12:11:34,970][123090] Updated weights for policy 1, policy_version 1567326 (0.0005) [2023-12-26 12:11:35,524][123091] Updated weights for policy 0, policy_version 1577812 (0.0008) [2023-12-26 12:11:35,576][123091] Updated weights for policy 0, policy_version 1577822 (0.0010) [2023-12-26 12:11:35,625][123091] Updated weights for policy 0, policy_version 1577832 (0.0010) [2023-12-26 12:11:35,651][123090] Updated weights for policy 1, policy_version 1567336 (0.0005) [2023-12-26 12:11:35,717][123090] Updated weights for policy 1, policy_version 1567346 (0.0005) [2023-12-26 12:11:35,789][123090] Updated weights for policy 1, policy_version 1567356 (0.0006) [2023-12-26 12:11:36,417][123091] Updated weights for policy 0, policy_version 1577842 (0.0010) [2023-12-26 12:11:36,474][123090] Updated weights for policy 1, policy_version 1567366 (0.0008) [2023-12-26 12:11:36,482][123091] Updated weights for policy 0, policy_version 1577852 (0.0011) [2023-12-26 12:11:36,539][123090] Updated weights for policy 1, policy_version 1567376 (0.0011) [2023-12-26 12:11:36,543][123091] Updated weights for policy 0, policy_version 1577862 (0.0011) [2023-12-26 12:11:36,604][123090] Updated weights for policy 1, policy_version 1567386 (0.0009) [2023-12-26 12:11:36,608][123091] Updated weights for policy 0, policy_version 1577872 (0.0011) [2023-12-26 12:11:37,265][123090] Updated weights for policy 1, policy_version 1567396 (0.0007) [2023-12-26 12:11:37,317][123090] Updated weights for policy 1, policy_version 1567406 (0.0010) [2023-12-26 12:11:37,369][123090] Updated weights for policy 1, policy_version 1567416 (0.0010) [2023-12-26 12:11:37,376][123091] Updated weights for policy 0, policy_version 1577882 (0.0011) [2023-12-26 12:11:37,423][123091] Updated weights for policy 0, policy_version 1577892 (0.0010) [2023-12-26 12:11:37,472][123091] Updated weights for policy 0, policy_version 1577902 (0.0010) [2023-12-26 12:11:38,019][123090] Updated weights for policy 1, policy_version 1567426 (0.0010) [2023-12-26 12:11:38,083][123090] Updated weights for policy 1, policy_version 1567436 (0.0010) [2023-12-26 12:11:38,147][123090] Updated weights for policy 1, policy_version 1567446 (0.0010) [2023-12-26 12:11:38,199][123090] Updated weights for policy 1, policy_version 1567456 (0.0010) [2023-12-26 12:11:38,321][123091] Updated weights for policy 0, policy_version 1577912 (0.0009) [2023-12-26 12:11:38,390][123091] Updated weights for policy 0, policy_version 1577922 (0.0007) [2023-12-26 12:11:38,444][123091] Updated weights for policy 0, policy_version 1577932 (0.0009) [2023-12-26 12:11:38,785][121949] Fps is (10 sec: 18021.2, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 805224448. Throughput: 0: 8783.6, 1: 8932.2. Samples: 805197232. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:38,786][121949] Avg episode reward: [(0, '6105.808'), (1, '5775.413')] [2023-12-26 12:11:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001577936_403955712.pth... [2023-12-26 12:11:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001567456_401268736.pth... [2023-12-26 12:11:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001576912_403693568.pth [2023-12-26 12:11:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001566432_401006592.pth [2023-12-26 12:11:38,960][123090] Updated weights for policy 1, policy_version 1567466 (0.0005) [2023-12-26 12:11:39,003][123090] Updated weights for policy 1, policy_version 1567476 (0.0005) [2023-12-26 12:11:39,063][123090] Updated weights for policy 1, policy_version 1567486 (0.0005) [2023-12-26 12:11:39,267][123091] Updated weights for policy 0, policy_version 1577942 (0.0007) [2023-12-26 12:11:39,334][123091] Updated weights for policy 0, policy_version 1577952 (0.0007) [2023-12-26 12:11:39,406][123091] Updated weights for policy 0, policy_version 1577962 (0.0008) [2023-12-26 12:11:39,865][123090] Updated weights for policy 1, policy_version 1567496 (0.0008) [2023-12-26 12:11:39,935][123090] Updated weights for policy 1, policy_version 1567506 (0.0009) [2023-12-26 12:11:40,001][123090] Updated weights for policy 1, policy_version 1567516 (0.0009) [2023-12-26 12:11:40,235][123091] Updated weights for policy 0, policy_version 1577972 (0.0010) [2023-12-26 12:11:40,302][123091] Updated weights for policy 0, policy_version 1577982 (0.0011) [2023-12-26 12:11:40,369][123091] Updated weights for policy 0, policy_version 1577992 (0.0010) [2023-12-26 12:11:40,823][123090] Updated weights for policy 1, policy_version 1567526 (0.0009) [2023-12-26 12:11:40,876][123090] Updated weights for policy 1, policy_version 1567536 (0.0010) [2023-12-26 12:11:40,946][123090] Updated weights for policy 1, policy_version 1567546 (0.0010) [2023-12-26 12:11:41,117][123091] Updated weights for policy 0, policy_version 1578002 (0.0010) [2023-12-26 12:11:41,188][123091] Updated weights for policy 0, policy_version 1578012 (0.0008) [2023-12-26 12:11:41,237][123091] Updated weights for policy 0, policy_version 1578022 (0.0009) [2023-12-26 12:11:41,306][123091] Updated weights for policy 0, policy_version 1578032 (0.0009) [2023-12-26 12:11:41,871][123090] Updated weights for policy 1, policy_version 1567556 (0.0010) [2023-12-26 12:11:41,937][123090] Updated weights for policy 1, policy_version 1567566 (0.0009) [2023-12-26 12:11:42,003][123090] Updated weights for policy 1, policy_version 1567576 (0.0009) [2023-12-26 12:11:42,208][123091] Updated weights for policy 0, policy_version 1578042 (0.0010) [2023-12-26 12:11:42,265][123091] Updated weights for policy 0, policy_version 1578052 (0.0010) [2023-12-26 12:11:42,327][123091] Updated weights for policy 0, policy_version 1578062 (0.0010) [2023-12-26 12:11:42,885][123090] Updated weights for policy 1, policy_version 1567586 (0.0006) [2023-12-26 12:11:42,953][123090] Updated weights for policy 1, policy_version 1567596 (0.0009) [2023-12-26 12:11:43,024][123090] Updated weights for policy 1, policy_version 1567606 (0.0009) [2023-12-26 12:11:43,052][123091] Updated weights for policy 0, policy_version 1578072 (0.0010) [2023-12-26 12:11:43,089][123090] Updated weights for policy 1, policy_version 1567616 (0.0007) [2023-12-26 12:11:43,110][123091] Updated weights for policy 0, policy_version 1578082 (0.0011) [2023-12-26 12:11:43,158][123091] Updated weights for policy 0, policy_version 1578092 (0.0010) [2023-12-26 12:11:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 805306368. Throughput: 0: 8700.2, 1: 8841.4. Samples: 805302492. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:43,785][121949] Avg episode reward: [(0, '5950.857'), (1, '5466.729')] [2023-12-26 12:11:43,898][123090] Updated weights for policy 1, policy_version 1567626 (0.0007) [2023-12-26 12:11:43,966][123090] Updated weights for policy 1, policy_version 1567636 (0.0005) [2023-12-26 12:11:43,990][123091] Updated weights for policy 0, policy_version 1578102 (0.0011) [2023-12-26 12:11:44,016][123090] Updated weights for policy 1, policy_version 1567646 (0.0005) [2023-12-26 12:11:44,045][123091] Updated weights for policy 0, policy_version 1578112 (0.0010) [2023-12-26 12:11:44,108][123091] Updated weights for policy 0, policy_version 1578122 (0.0011) [2023-12-26 12:11:44,714][123090] Updated weights for policy 1, policy_version 1567656 (0.0008) [2023-12-26 12:11:44,784][123090] Updated weights for policy 1, policy_version 1567666 (0.0008) [2023-12-26 12:11:44,846][123090] Updated weights for policy 1, policy_version 1567676 (0.0009) [2023-12-26 12:11:44,937][123091] Updated weights for policy 0, policy_version 1578132 (0.0008) [2023-12-26 12:11:45,003][123091] Updated weights for policy 0, policy_version 1578142 (0.0010) [2023-12-26 12:11:45,055][123091] Updated weights for policy 0, policy_version 1578152 (0.0007) [2023-12-26 12:11:45,679][123090] Updated weights for policy 1, policy_version 1567686 (0.0008) [2023-12-26 12:11:45,728][123090] Updated weights for policy 1, policy_version 1567696 (0.0009) [2023-12-26 12:11:45,784][123090] Updated weights for policy 1, policy_version 1567706 (0.0009) [2023-12-26 12:11:45,846][123091] Updated weights for policy 0, policy_version 1578162 (0.0006) [2023-12-26 12:11:45,912][123091] Updated weights for policy 0, policy_version 1578172 (0.0011) [2023-12-26 12:11:45,976][123091] Updated weights for policy 0, policy_version 1578182 (0.0011) [2023-12-26 12:11:46,040][123091] Updated weights for policy 0, policy_version 1578192 (0.0011) [2023-12-26 12:11:46,655][123090] Updated weights for policy 1, policy_version 1567716 (0.0009) [2023-12-26 12:11:46,709][123090] Updated weights for policy 1, policy_version 1567726 (0.0009) [2023-12-26 12:11:46,777][123090] Updated weights for policy 1, policy_version 1567736 (0.0008) [2023-12-26 12:11:46,806][123091] Updated weights for policy 0, policy_version 1578202 (0.0008) [2023-12-26 12:11:46,862][123091] Updated weights for policy 0, policy_version 1578213 (0.0010) [2023-12-26 12:11:46,921][123091] Updated weights for policy 0, policy_version 1578223 (0.0009) [2023-12-26 12:11:47,600][123090] Updated weights for policy 1, policy_version 1567746 (0.0006) [2023-12-26 12:11:47,667][123090] Updated weights for policy 1, policy_version 1567756 (0.0009) [2023-12-26 12:11:47,734][123090] Updated weights for policy 1, policy_version 1567766 (0.0008) [2023-12-26 12:11:47,771][123091] Updated weights for policy 0, policy_version 1578233 (0.0008) [2023-12-26 12:11:47,789][123090] Updated weights for policy 1, policy_version 1567776 (0.0009) [2023-12-26 12:11:47,822][123091] Updated weights for policy 0, policy_version 1578243 (0.0009) [2023-12-26 12:11:47,876][123091] Updated weights for policy 0, policy_version 1578254 (0.0009) [2023-12-26 12:11:48,629][123090] Updated weights for policy 1, policy_version 1567786 (0.0008) [2023-12-26 12:11:48,697][123091] Updated weights for policy 0, policy_version 1578264 (0.0006) [2023-12-26 12:11:48,702][123090] Updated weights for policy 1, policy_version 1567796 (0.0006) [2023-12-26 12:11:48,770][123091] Updated weights for policy 0, policy_version 1578274 (0.0008) [2023-12-26 12:11:48,777][123090] Updated weights for policy 1, policy_version 1567806 (0.0006) [2023-12-26 12:11:48,784][121949] Fps is (10 sec: 16384.9, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 805388288. Throughput: 0: 8714.7, 1: 8825.5. Samples: 805407060. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:48,785][121949] Avg episode reward: [(0, '5884.603'), (1, '5283.326')] [2023-12-26 12:11:48,838][123091] Updated weights for policy 0, policy_version 1578284 (0.0010) [2023-12-26 12:11:49,514][123090] Updated weights for policy 1, policy_version 1567816 (0.0008) [2023-12-26 12:11:49,580][123090] Updated weights for policy 1, policy_version 1567826 (0.0007) [2023-12-26 12:11:49,648][123090] Updated weights for policy 1, policy_version 1567836 (0.0005) [2023-12-26 12:11:49,657][123091] Updated weights for policy 0, policy_version 1578294 (0.0008) [2023-12-26 12:11:49,724][123091] Updated weights for policy 0, policy_version 1578304 (0.0010) [2023-12-26 12:11:49,776][123091] Updated weights for policy 0, policy_version 1578314 (0.0010) [2023-12-26 12:11:50,431][123090] Updated weights for policy 1, policy_version 1567846 (0.0008) [2023-12-26 12:11:50,495][123090] Updated weights for policy 1, policy_version 1567856 (0.0009) [2023-12-26 12:11:50,560][123091] Updated weights for policy 0, policy_version 1578324 (0.0008) [2023-12-26 12:11:50,570][123090] Updated weights for policy 1, policy_version 1567866 (0.0008) [2023-12-26 12:11:50,639][123091] Updated weights for policy 0, policy_version 1578334 (0.0007) [2023-12-26 12:11:50,695][123091] Updated weights for policy 0, policy_version 1578344 (0.0005) [2023-12-26 12:11:51,456][123090] Updated weights for policy 1, policy_version 1567876 (0.0009) [2023-12-26 12:11:51,457][123091] Updated weights for policy 0, policy_version 1578354 (0.0006) [2023-12-26 12:11:51,520][123090] Updated weights for policy 1, policy_version 1567886 (0.0006) [2023-12-26 12:11:51,524][123091] Updated weights for policy 0, policy_version 1578364 (0.0009) [2023-12-26 12:11:51,592][123090] Updated weights for policy 1, policy_version 1567896 (0.0007) [2023-12-26 12:11:51,596][123091] Updated weights for policy 0, policy_version 1578374 (0.0007) [2023-12-26 12:11:51,667][123091] Updated weights for policy 0, policy_version 1578384 (0.0008) [2023-12-26 12:11:52,351][123090] Updated weights for policy 1, policy_version 1567906 (0.0008) [2023-12-26 12:11:52,417][123090] Updated weights for policy 1, policy_version 1567916 (0.0010) [2023-12-26 12:11:52,471][123090] Updated weights for policy 1, policy_version 1567926 (0.0009) [2023-12-26 12:11:52,508][123091] Updated weights for policy 0, policy_version 1578394 (0.0009) [2023-12-26 12:11:52,528][123090] Updated weights for policy 1, policy_version 1567936 (0.0007) [2023-12-26 12:11:52,577][123091] Updated weights for policy 0, policy_version 1578404 (0.0009) [2023-12-26 12:11:52,651][123091] Updated weights for policy 0, policy_version 1578414 (0.0010) [2023-12-26 12:11:53,292][123090] Updated weights for policy 1, policy_version 1567946 (0.0009) [2023-12-26 12:11:53,344][123090] Updated weights for policy 1, policy_version 1567956 (0.0010) [2023-12-26 12:11:53,401][123090] Updated weights for policy 1, policy_version 1567966 (0.0010) [2023-12-26 12:11:53,482][123091] Updated weights for policy 0, policy_version 1578424 (0.0010) [2023-12-26 12:11:53,556][123091] Updated weights for policy 0, policy_version 1578434 (0.0011) [2023-12-26 12:11:53,615][123091] Updated weights for policy 0, policy_version 1578444 (0.0010) [2023-12-26 12:11:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 805486592. Throughput: 0: 8729.9, 1: 8802.0. Samples: 805458872. Policy #0 lag: (min: 31.0, avg: 36.6, max: 63.0) [2023-12-26 12:11:53,786][121949] Avg episode reward: [(0, '5973.351'), (1, '5370.659')] [2023-12-26 12:11:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001578448_404086784.pth... [2023-12-26 12:11:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001567968_401399808.pth... [2023-12-26 12:11:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001577424_403824640.pth [2023-12-26 12:11:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001566944_401137664.pth [2023-12-26 12:11:54,156][123090] Updated weights for policy 1, policy_version 1567976 (0.0007) [2023-12-26 12:11:54,225][123090] Updated weights for policy 1, policy_version 1567986 (0.0007) [2023-12-26 12:11:54,292][123090] Updated weights for policy 1, policy_version 1567996 (0.0006) [2023-12-26 12:11:54,300][123091] Updated weights for policy 0, policy_version 1578454 (0.0007) [2023-12-26 12:11:54,350][123091] Updated weights for policy 0, policy_version 1578464 (0.0005) [2023-12-26 12:11:54,400][123091] Updated weights for policy 0, policy_version 1578474 (0.0005) [2023-12-26 12:11:55,050][123090] Updated weights for policy 1, policy_version 1568006 (0.0005) [2023-12-26 12:11:55,112][123090] Updated weights for policy 1, policy_version 1568016 (0.0008) [2023-12-26 12:11:55,114][123091] Updated weights for policy 0, policy_version 1578484 (0.0008) [2023-12-26 12:11:55,168][123091] Updated weights for policy 0, policy_version 1578494 (0.0010) [2023-12-26 12:11:55,174][123090] Updated weights for policy 1, policy_version 1568026 (0.0009) [2023-12-26 12:11:55,221][123091] Updated weights for policy 0, policy_version 1578504 (0.0007) [2023-12-26 12:11:55,918][123090] Updated weights for policy 1, policy_version 1568036 (0.0008) [2023-12-26 12:11:55,973][123090] Updated weights for policy 1, policy_version 1568046 (0.0005) [2023-12-26 12:11:55,989][123091] Updated weights for policy 0, policy_version 1578514 (0.0009) [2023-12-26 12:11:56,033][123090] Updated weights for policy 1, policy_version 1568056 (0.0006) [2023-12-26 12:11:56,039][123091] Updated weights for policy 0, policy_version 1578524 (0.0005) [2023-12-26 12:11:56,104][123091] Updated weights for policy 0, policy_version 1578534 (0.0008) [2023-12-26 12:11:56,164][123091] Updated weights for policy 0, policy_version 1578544 (0.0009) [2023-12-26 12:11:56,603][123090] Updated weights for policy 1, policy_version 1568066 (0.0006) [2023-12-26 12:11:56,652][123090] Updated weights for policy 1, policy_version 1568076 (0.0005) [2023-12-26 12:11:56,698][123090] Updated weights for policy 1, policy_version 1568086 (0.0005) [2023-12-26 12:11:56,756][123090] Updated weights for policy 1, policy_version 1568096 (0.0005) [2023-12-26 12:11:56,933][123091] Updated weights for policy 0, policy_version 1578554 (0.0005) [2023-12-26 12:11:56,988][123091] Updated weights for policy 0, policy_version 1578564 (0.0005) [2023-12-26 12:11:57,037][123091] Updated weights for policy 0, policy_version 1578574 (0.0005) [2023-12-26 12:11:57,404][123090] Updated weights for policy 1, policy_version 1568106 (0.0005) [2023-12-26 12:11:57,474][123090] Updated weights for policy 1, policy_version 1568116 (0.0005) [2023-12-26 12:11:57,537][123090] Updated weights for policy 1, policy_version 1568126 (0.0005) [2023-12-26 12:11:57,782][123091] Updated weights for policy 0, policy_version 1578584 (0.0009) [2023-12-26 12:11:57,834][123091] Updated weights for policy 0, policy_version 1578594 (0.0010) [2023-12-26 12:11:57,887][123091] Updated weights for policy 0, policy_version 1578605 (0.0010) [2023-12-26 12:11:58,201][123090] Updated weights for policy 1, policy_version 1568136 (0.0008) [2023-12-26 12:11:58,267][123090] Updated weights for policy 1, policy_version 1568146 (0.0009) [2023-12-26 12:11:58,327][123090] Updated weights for policy 1, policy_version 1568156 (0.0010) [2023-12-26 12:11:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 805576704. Throughput: 0: 8769.7, 1: 8924.5. Samples: 805573240. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:11:58,785][121949] Avg episode reward: [(0, '6083.054'), (1, '5557.938')] [2023-12-26 12:11:58,812][123091] Updated weights for policy 0, policy_version 1578615 (0.0010) [2023-12-26 12:11:58,869][123091] Updated weights for policy 0, policy_version 1578625 (0.0010) [2023-12-26 12:11:58,939][123091] Updated weights for policy 0, policy_version 1578635 (0.0009) [2023-12-26 12:11:59,214][123090] Updated weights for policy 1, policy_version 1568166 (0.0010) [2023-12-26 12:11:59,270][123090] Updated weights for policy 1, policy_version 1568176 (0.0010) [2023-12-26 12:11:59,332][123090] Updated weights for policy 1, policy_version 1568186 (0.0009) [2023-12-26 12:11:59,745][123091] Updated weights for policy 0, policy_version 1578645 (0.0008) [2023-12-26 12:11:59,793][123091] Updated weights for policy 0, policy_version 1578655 (0.0005) [2023-12-26 12:11:59,855][123091] Updated weights for policy 0, policy_version 1578665 (0.0007) [2023-12-26 12:12:00,239][123090] Updated weights for policy 1, policy_version 1568196 (0.0009) [2023-12-26 12:12:00,291][123090] Updated weights for policy 1, policy_version 1568206 (0.0009) [2023-12-26 12:12:00,358][123090] Updated weights for policy 1, policy_version 1568216 (0.0007) [2023-12-26 12:12:00,631][123091] Updated weights for policy 0, policy_version 1578675 (0.0006) [2023-12-26 12:12:00,696][123091] Updated weights for policy 0, policy_version 1578685 (0.0005) [2023-12-26 12:12:00,762][123091] Updated weights for policy 0, policy_version 1578695 (0.0005) [2023-12-26 12:12:01,177][123090] Updated weights for policy 1, policy_version 1568226 (0.0006) [2023-12-26 12:12:01,234][123090] Updated weights for policy 1, policy_version 1568236 (0.0010) [2023-12-26 12:12:01,300][123090] Updated weights for policy 1, policy_version 1568246 (0.0009) [2023-12-26 12:12:01,372][123090] Updated weights for policy 1, policy_version 1568256 (0.0010) [2023-12-26 12:12:01,461][123091] Updated weights for policy 0, policy_version 1578705 (0.0005) [2023-12-26 12:12:01,524][123091] Updated weights for policy 0, policy_version 1578715 (0.0007) [2023-12-26 12:12:01,570][123091] Updated weights for policy 0, policy_version 1578725 (0.0006) [2023-12-26 12:12:01,640][123091] Updated weights for policy 0, policy_version 1578735 (0.0010) [2023-12-26 12:12:02,171][123090] Updated weights for policy 1, policy_version 1568266 (0.0007) [2023-12-26 12:12:02,223][123090] Updated weights for policy 1, policy_version 1568276 (0.0010) [2023-12-26 12:12:02,285][123090] Updated weights for policy 1, policy_version 1568286 (0.0010) [2023-12-26 12:12:02,437][123091] Updated weights for policy 0, policy_version 1578745 (0.0009) [2023-12-26 12:12:02,497][123091] Updated weights for policy 0, policy_version 1578755 (0.0008) [2023-12-26 12:12:02,557][123091] Updated weights for policy 0, policy_version 1578765 (0.0009) [2023-12-26 12:12:03,078][123090] Updated weights for policy 1, policy_version 1568296 (0.0010) [2023-12-26 12:12:03,132][123090] Updated weights for policy 1, policy_version 1568306 (0.0009) [2023-12-26 12:12:03,192][123090] Updated weights for policy 1, policy_version 1568316 (0.0009) [2023-12-26 12:12:03,416][123091] Updated weights for policy 0, policy_version 1578775 (0.0009) [2023-12-26 12:12:03,479][123091] Updated weights for policy 0, policy_version 1578786 (0.0010) [2023-12-26 12:12:03,548][123091] Updated weights for policy 0, policy_version 1578796 (0.0009) [2023-12-26 12:12:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 805666816. Throughput: 0: 8761.3, 1: 8937.1. Samples: 805678028. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:03,784][121949] Avg episode reward: [(0, '6210.477'), (1, '5718.208')] [2023-12-26 12:12:03,949][123090] Updated weights for policy 1, policy_version 1568326 (0.0008) [2023-12-26 12:12:04,015][123090] Updated weights for policy 1, policy_version 1568336 (0.0006) [2023-12-26 12:12:04,082][123090] Updated weights for policy 1, policy_version 1568346 (0.0006) [2023-12-26 12:12:04,382][123091] Updated weights for policy 0, policy_version 1578806 (0.0009) [2023-12-26 12:12:04,447][123091] Updated weights for policy 0, policy_version 1578816 (0.0008) [2023-12-26 12:12:04,512][123091] Updated weights for policy 0, policy_version 1578826 (0.0008) [2023-12-26 12:12:04,889][123090] Updated weights for policy 1, policy_version 1568356 (0.0008) [2023-12-26 12:12:04,955][123090] Updated weights for policy 1, policy_version 1568366 (0.0011) [2023-12-26 12:12:05,026][123090] Updated weights for policy 1, policy_version 1568376 (0.0011) [2023-12-26 12:12:05,212][123091] Updated weights for policy 0, policy_version 1578836 (0.0008) [2023-12-26 12:12:05,268][123091] Updated weights for policy 0, policy_version 1578846 (0.0008) [2023-12-26 12:12:05,323][123091] Updated weights for policy 0, policy_version 1578856 (0.0009) [2023-12-26 12:12:05,812][123090] Updated weights for policy 1, policy_version 1568386 (0.0009) [2023-12-26 12:12:05,880][123090] Updated weights for policy 1, policy_version 1568396 (0.0005) [2023-12-26 12:12:05,938][123090] Updated weights for policy 1, policy_version 1568406 (0.0005) [2023-12-26 12:12:05,994][123090] Updated weights for policy 1, policy_version 1568416 (0.0005) [2023-12-26 12:12:06,043][123091] Updated weights for policy 0, policy_version 1578866 (0.0008) [2023-12-26 12:12:06,089][123091] Updated weights for policy 0, policy_version 1578876 (0.0005) [2023-12-26 12:12:06,150][123091] Updated weights for policy 0, policy_version 1578886 (0.0008) [2023-12-26 12:12:06,217][123091] Updated weights for policy 0, policy_version 1578896 (0.0008) [2023-12-26 12:12:06,696][123090] Updated weights for policy 1, policy_version 1568426 (0.0008) [2023-12-26 12:12:06,756][123090] Updated weights for policy 1, policy_version 1568436 (0.0010) [2023-12-26 12:12:06,806][123090] Updated weights for policy 1, policy_version 1568446 (0.0010) [2023-12-26 12:12:07,083][123091] Updated weights for policy 0, policy_version 1578906 (0.0007) [2023-12-26 12:12:07,157][123091] Updated weights for policy 0, policy_version 1578916 (0.0010) [2023-12-26 12:12:07,220][123091] Updated weights for policy 0, policy_version 1578926 (0.0008) [2023-12-26 12:12:07,548][123090] Updated weights for policy 1, policy_version 1568456 (0.0008) [2023-12-26 12:12:07,619][123090] Updated weights for policy 1, policy_version 1568466 (0.0011) [2023-12-26 12:12:07,690][123090] Updated weights for policy 1, policy_version 1568476 (0.0010) [2023-12-26 12:12:08,052][123091] Updated weights for policy 0, policy_version 1578936 (0.0009) [2023-12-26 12:12:08,113][123091] Updated weights for policy 0, policy_version 1578946 (0.0008) [2023-12-26 12:12:08,182][123091] Updated weights for policy 0, policy_version 1578956 (0.0009) [2023-12-26 12:12:08,372][123090] Updated weights for policy 1, policy_version 1568491 (0.0009) [2023-12-26 12:12:08,439][123090] Updated weights for policy 1, policy_version 1568501 (0.0008) [2023-12-26 12:12:08,507][123090] Updated weights for policy 1, policy_version 1568511 (0.0009) [2023-12-26 12:12:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 805756928. Throughput: 0: 8834.6, 1: 8966.6. Samples: 805733112. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:08,785][121949] Avg episode reward: [(0, '6256.194'), (1, '5806.797')] [2023-12-26 12:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001568512_401539072.pth... [2023-12-26 12:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001578960_404217856.pth... [2023-12-26 12:12:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001567456_401268736.pth [2023-12-26 12:12:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001577936_403955712.pth [2023-12-26 12:12:09,035][123091] Updated weights for policy 0, policy_version 1578966 (0.0008) [2023-12-26 12:12:09,094][123091] Updated weights for policy 0, policy_version 1578976 (0.0009) [2023-12-26 12:12:09,150][123091] Updated weights for policy 0, policy_version 1578986 (0.0010) [2023-12-26 12:12:09,328][123090] Updated weights for policy 1, policy_version 1568521 (0.0010) [2023-12-26 12:12:09,396][123090] Updated weights for policy 1, policy_version 1568531 (0.0010) [2023-12-26 12:12:09,462][123090] Updated weights for policy 1, policy_version 1568541 (0.0009) [2023-12-26 12:12:09,955][123091] Updated weights for policy 0, policy_version 1578996 (0.0009) [2023-12-26 12:12:10,018][123091] Updated weights for policy 0, policy_version 1579006 (0.0009) [2023-12-26 12:12:10,081][123091] Updated weights for policy 0, policy_version 1579016 (0.0009) [2023-12-26 12:12:10,301][123090] Updated weights for policy 1, policy_version 1568551 (0.0008) [2023-12-26 12:12:10,363][123090] Updated weights for policy 1, policy_version 1568561 (0.0008) [2023-12-26 12:12:10,437][123090] Updated weights for policy 1, policy_version 1568571 (0.0008) [2023-12-26 12:12:10,912][123091] Updated weights for policy 0, policy_version 1579026 (0.0009) [2023-12-26 12:12:10,971][123091] Updated weights for policy 0, policy_version 1579036 (0.0010) [2023-12-26 12:12:11,027][123091] Updated weights for policy 0, policy_version 1579046 (0.0009) [2023-12-26 12:12:11,095][123091] Updated weights for policy 0, policy_version 1579056 (0.0010) [2023-12-26 12:12:11,261][123090] Updated weights for policy 1, policy_version 1568581 (0.0008) [2023-12-26 12:12:11,329][123090] Updated weights for policy 1, policy_version 1568591 (0.0006) [2023-12-26 12:12:11,407][123090] Updated weights for policy 1, policy_version 1568601 (0.0008) [2023-12-26 12:12:12,023][123091] Updated weights for policy 0, policy_version 1579066 (0.0009) [2023-12-26 12:12:12,082][123091] Updated weights for policy 0, policy_version 1579076 (0.0010) [2023-12-26 12:12:12,142][123091] Updated weights for policy 0, policy_version 1579086 (0.0010) [2023-12-26 12:12:12,142][123090] Updated weights for policy 1, policy_version 1568611 (0.0008) [2023-12-26 12:12:12,197][123090] Updated weights for policy 1, policy_version 1568621 (0.0009) [2023-12-26 12:12:12,260][123090] Updated weights for policy 1, policy_version 1568631 (0.0009) [2023-12-26 12:12:12,952][123091] Updated weights for policy 0, policy_version 1579096 (0.0008) [2023-12-26 12:12:13,015][123091] Updated weights for policy 0, policy_version 1579106 (0.0009) [2023-12-26 12:12:13,079][123091] Updated weights for policy 0, policy_version 1579116 (0.0009) [2023-12-26 12:12:13,129][123090] Updated weights for policy 1, policy_version 1568641 (0.0009) [2023-12-26 12:12:13,195][123090] Updated weights for policy 1, policy_version 1568651 (0.0010) [2023-12-26 12:12:13,257][123090] Updated weights for policy 1, policy_version 1568661 (0.0010) [2023-12-26 12:12:13,319][123090] Updated weights for policy 1, policy_version 1568671 (0.0010) [2023-12-26 12:12:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 805838848. Throughput: 0: 8775.1, 1: 8960.1. Samples: 805835816. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:13,785][121949] Avg episode reward: [(0, '6244.128'), (1, '5603.696')] [2023-12-26 12:12:13,916][123091] Updated weights for policy 0, policy_version 1579126 (0.0009) [2023-12-26 12:12:13,980][123091] Updated weights for policy 0, policy_version 1579136 (0.0010) [2023-12-26 12:12:14,033][123091] Updated weights for policy 0, policy_version 1579146 (0.0010) [2023-12-26 12:12:14,104][123090] Updated weights for policy 1, policy_version 1568681 (0.0006) [2023-12-26 12:12:14,174][123090] Updated weights for policy 1, policy_version 1568691 (0.0010) [2023-12-26 12:12:14,235][123090] Updated weights for policy 1, policy_version 1568701 (0.0008) [2023-12-26 12:12:14,825][123090] Updated weights for policy 1, policy_version 1568711 (0.0007) [2023-12-26 12:12:14,880][123091] Updated weights for policy 0, policy_version 1579156 (0.0007) [2023-12-26 12:12:14,889][123090] Updated weights for policy 1, policy_version 1568721 (0.0010) [2023-12-26 12:12:14,940][123091] Updated weights for policy 0, policy_version 1579166 (0.0008) [2023-12-26 12:12:14,953][123090] Updated weights for policy 1, policy_version 1568731 (0.0011) [2023-12-26 12:12:15,001][123091] Updated weights for policy 0, policy_version 1579176 (0.0010) [2023-12-26 12:12:15,784][123090] Updated weights for policy 1, policy_version 1568741 (0.0010) [2023-12-26 12:12:15,838][123090] Updated weights for policy 1, policy_version 1568751 (0.0008) [2023-12-26 12:12:15,839][123091] Updated weights for policy 0, policy_version 1579186 (0.0009) [2023-12-26 12:12:15,888][123090] Updated weights for policy 1, policy_version 1568761 (0.0006) [2023-12-26 12:12:15,901][123091] Updated weights for policy 0, policy_version 1579196 (0.0008) [2023-12-26 12:12:15,965][123091] Updated weights for policy 0, policy_version 1579206 (0.0009) [2023-12-26 12:12:16,034][123091] Updated weights for policy 0, policy_version 1579216 (0.0010) [2023-12-26 12:12:16,672][123090] Updated weights for policy 1, policy_version 1568771 (0.0005) [2023-12-26 12:12:16,733][123090] Updated weights for policy 1, policy_version 1568781 (0.0005) [2023-12-26 12:12:16,804][123091] Updated weights for policy 0, policy_version 1579226 (0.0005) [2023-12-26 12:12:16,805][123090] Updated weights for policy 1, policy_version 1568791 (0.0006) [2023-12-26 12:12:16,865][123091] Updated weights for policy 0, policy_version 1579236 (0.0005) [2023-12-26 12:12:16,940][123091] Updated weights for policy 0, policy_version 1579246 (0.0005) [2023-12-26 12:12:17,458][123090] Updated weights for policy 1, policy_version 1568801 (0.0006) [2023-12-26 12:12:17,528][123090] Updated weights for policy 1, policy_version 1568811 (0.0010) [2023-12-26 12:12:17,580][123090] Updated weights for policy 1, policy_version 1568821 (0.0010) [2023-12-26 12:12:17,640][123090] Updated weights for policy 1, policy_version 1568831 (0.0010) [2023-12-26 12:12:17,679][123091] Updated weights for policy 0, policy_version 1579256 (0.0007) [2023-12-26 12:12:17,736][123091] Updated weights for policy 0, policy_version 1579266 (0.0009) [2023-12-26 12:12:17,789][123091] Updated weights for policy 0, policy_version 1579276 (0.0009) [2023-12-26 12:12:18,497][123090] Updated weights for policy 1, policy_version 1568841 (0.0009) [2023-12-26 12:12:18,555][123090] Updated weights for policy 1, policy_version 1568851 (0.0006) [2023-12-26 12:12:18,561][123091] Updated weights for policy 0, policy_version 1579286 (0.0008) [2023-12-26 12:12:18,615][123090] Updated weights for policy 1, policy_version 1568861 (0.0009) [2023-12-26 12:12:18,623][123091] Updated weights for policy 0, policy_version 1579296 (0.0009) [2023-12-26 12:12:18,692][123091] Updated weights for policy 0, policy_version 1579306 (0.0008) [2023-12-26 12:12:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 805937152. Throughput: 0: 8811.2, 1: 8991.4. Samples: 805943108. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:18,785][121949] Avg episode reward: [(0, '6133.039'), (1, '5566.092')] [2023-12-26 12:12:19,447][123090] Updated weights for policy 1, policy_version 1568871 (0.0009) [2023-12-26 12:12:19,500][123091] Updated weights for policy 0, policy_version 1579316 (0.0008) [2023-12-26 12:12:19,515][123090] Updated weights for policy 1, policy_version 1568881 (0.0009) [2023-12-26 12:12:19,566][123091] Updated weights for policy 0, policy_version 1579326 (0.0009) [2023-12-26 12:12:19,582][123090] Updated weights for policy 1, policy_version 1568891 (0.0008) [2023-12-26 12:12:19,628][123091] Updated weights for policy 0, policy_version 1579336 (0.0009) [2023-12-26 12:12:20,351][123090] Updated weights for policy 1, policy_version 1568901 (0.0009) [2023-12-26 12:12:20,407][123090] Updated weights for policy 1, policy_version 1568911 (0.0005) [2023-12-26 12:12:20,462][123090] Updated weights for policy 1, policy_version 1568921 (0.0007) [2023-12-26 12:12:20,466][123091] Updated weights for policy 0, policy_version 1579346 (0.0010) [2023-12-26 12:12:20,532][123091] Updated weights for policy 0, policy_version 1579356 (0.0011) [2023-12-26 12:12:20,602][123091] Updated weights for policy 0, policy_version 1579366 (0.0010) [2023-12-26 12:12:20,654][123091] Updated weights for policy 0, policy_version 1579376 (0.0010) [2023-12-26 12:12:21,241][123090] Updated weights for policy 1, policy_version 1568931 (0.0008) [2023-12-26 12:12:21,300][123090] Updated weights for policy 1, policy_version 1568941 (0.0008) [2023-12-26 12:12:21,362][123090] Updated weights for policy 1, policy_version 1568951 (0.0008) [2023-12-26 12:12:21,486][123091] Updated weights for policy 0, policy_version 1579386 (0.0009) [2023-12-26 12:12:21,547][123091] Updated weights for policy 0, policy_version 1579396 (0.0009) [2023-12-26 12:12:21,606][123091] Updated weights for policy 0, policy_version 1579406 (0.0008) [2023-12-26 12:12:22,170][123090] Updated weights for policy 1, policy_version 1568961 (0.0008) [2023-12-26 12:12:22,228][123090] Updated weights for policy 1, policy_version 1568971 (0.0010) [2023-12-26 12:12:22,294][123090] Updated weights for policy 1, policy_version 1568981 (0.0009) [2023-12-26 12:12:22,349][123090] Updated weights for policy 1, policy_version 1568991 (0.0009) [2023-12-26 12:12:22,407][123091] Updated weights for policy 0, policy_version 1579416 (0.0007) [2023-12-26 12:12:22,473][123091] Updated weights for policy 0, policy_version 1579426 (0.0005) [2023-12-26 12:12:22,540][123091] Updated weights for policy 0, policy_version 1579436 (0.0009) [2023-12-26 12:12:23,214][123090] Updated weights for policy 1, policy_version 1569001 (0.0006) [2023-12-26 12:12:23,285][123090] Updated weights for policy 1, policy_version 1569011 (0.0005) [2023-12-26 12:12:23,355][123090] Updated weights for policy 1, policy_version 1569021 (0.0006) [2023-12-26 12:12:23,368][123091] Updated weights for policy 0, policy_version 1579446 (0.0008) [2023-12-26 12:12:23,425][123091] Updated weights for policy 0, policy_version 1579456 (0.0009) [2023-12-26 12:12:23,482][123091] Updated weights for policy 0, policy_version 1579466 (0.0010) [2023-12-26 12:12:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 806019072. Throughput: 0: 8748.7, 1: 8961.1. Samples: 805994164. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:23,785][121949] Avg episode reward: [(0, '6073.107'), (1, '5475.457')] [2023-12-26 12:12:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001569024_401670144.pth... [2023-12-26 12:12:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001579472_404348928.pth... [2023-12-26 12:12:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001567968_401399808.pth [2023-12-26 12:12:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001578448_404086784.pth [2023-12-26 12:12:23,979][123090] Updated weights for policy 1, policy_version 1569031 (0.0007) [2023-12-26 12:12:24,050][123090] Updated weights for policy 1, policy_version 1569041 (0.0005) [2023-12-26 12:12:24,120][123090] Updated weights for policy 1, policy_version 1569051 (0.0006) [2023-12-26 12:12:24,253][123091] Updated weights for policy 0, policy_version 1579476 (0.0009) [2023-12-26 12:12:24,313][123091] Updated weights for policy 0, policy_version 1579486 (0.0009) [2023-12-26 12:12:24,366][123091] Updated weights for policy 0, policy_version 1579496 (0.0009) [2023-12-26 12:12:24,813][123090] Updated weights for policy 1, policy_version 1569061 (0.0008) [2023-12-26 12:12:24,880][123090] Updated weights for policy 1, policy_version 1569071 (0.0005) [2023-12-26 12:12:24,945][123090] Updated weights for policy 1, policy_version 1569081 (0.0005) [2023-12-26 12:12:25,297][123091] Updated weights for policy 0, policy_version 1579506 (0.0009) [2023-12-26 12:12:25,345][123091] Updated weights for policy 0, policy_version 1579516 (0.0008) [2023-12-26 12:12:25,401][123091] Updated weights for policy 0, policy_version 1579526 (0.0009) [2023-12-26 12:12:25,454][123091] Updated weights for policy 0, policy_version 1579536 (0.0009) [2023-12-26 12:12:25,659][123090] Updated weights for policy 1, policy_version 1569091 (0.0007) [2023-12-26 12:12:25,704][123090] Updated weights for policy 1, policy_version 1569101 (0.0007) [2023-12-26 12:12:25,758][123090] Updated weights for policy 1, policy_version 1569111 (0.0005) [2023-12-26 12:12:26,363][123091] Updated weights for policy 0, policy_version 1579546 (0.0009) [2023-12-26 12:12:26,412][123091] Updated weights for policy 0, policy_version 1579556 (0.0009) [2023-12-26 12:12:26,464][123091] Updated weights for policy 0, policy_version 1579566 (0.0009) [2023-12-26 12:12:26,487][123090] Updated weights for policy 1, policy_version 1569121 (0.0006) [2023-12-26 12:12:26,542][123090] Updated weights for policy 1, policy_version 1569131 (0.0010) [2023-12-26 12:12:26,590][123090] Updated weights for policy 1, policy_version 1569141 (0.0009) [2023-12-26 12:12:26,638][123090] Updated weights for policy 1, policy_version 1569151 (0.0007) [2023-12-26 12:12:27,199][123091] Updated weights for policy 0, policy_version 1579576 (0.0007) [2023-12-26 12:12:27,257][123091] Updated weights for policy 0, policy_version 1579586 (0.0009) [2023-12-26 12:12:27,317][123091] Updated weights for policy 0, policy_version 1579596 (0.0010) [2023-12-26 12:12:27,483][123090] Updated weights for policy 1, policy_version 1569161 (0.0007) [2023-12-26 12:12:27,529][123090] Updated weights for policy 1, policy_version 1569171 (0.0005) [2023-12-26 12:12:27,579][123090] Updated weights for policy 1, policy_version 1569181 (0.0005) [2023-12-26 12:12:28,113][123091] Updated weights for policy 0, policy_version 1579606 (0.0008) [2023-12-26 12:12:28,171][123091] Updated weights for policy 0, policy_version 1579616 (0.0008) [2023-12-26 12:12:28,231][123091] Updated weights for policy 0, policy_version 1579626 (0.0009) [2023-12-26 12:12:28,315][123090] Updated weights for policy 1, policy_version 1569191 (0.0008) [2023-12-26 12:12:28,382][123090] Updated weights for policy 1, policy_version 1569201 (0.0008) [2023-12-26 12:12:28,454][123090] Updated weights for policy 1, policy_version 1569211 (0.0007) [2023-12-26 12:12:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 806109184. Throughput: 0: 8764.3, 1: 9023.6. Samples: 806102952. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:28,785][121949] Avg episode reward: [(0, '6106.962'), (1, '5319.390')] [2023-12-26 12:12:29,081][123091] Updated weights for policy 0, policy_version 1579636 (0.0009) [2023-12-26 12:12:29,129][123091] Updated weights for policy 0, policy_version 1579646 (0.0009) [2023-12-26 12:12:29,178][123091] Updated weights for policy 0, policy_version 1579656 (0.0009) [2023-12-26 12:12:29,239][123090] Updated weights for policy 1, policy_version 1569221 (0.0009) [2023-12-26 12:12:29,299][123090] Updated weights for policy 1, policy_version 1569231 (0.0010) [2023-12-26 12:12:29,366][123090] Updated weights for policy 1, policy_version 1569241 (0.0009) [2023-12-26 12:12:30,024][123091] Updated weights for policy 0, policy_version 1579666 (0.0009) [2023-12-26 12:12:30,084][123091] Updated weights for policy 0, policy_version 1579676 (0.0006) [2023-12-26 12:12:30,139][123091] Updated weights for policy 0, policy_version 1579686 (0.0009) [2023-12-26 12:12:30,238][123090] Updated weights for policy 1, policy_version 1569251 (0.0009) [2023-12-26 12:12:30,293][123090] Updated weights for policy 1, policy_version 1569261 (0.0009) [2023-12-26 12:12:30,351][123090] Updated weights for policy 1, policy_version 1569271 (0.0009) [2023-12-26 12:12:30,976][123091] Updated weights for policy 0, policy_version 1579697 (0.0008) [2023-12-26 12:12:31,040][123091] Updated weights for policy 0, policy_version 1579707 (0.0007) [2023-12-26 12:12:31,107][123091] Updated weights for policy 0, policy_version 1579717 (0.0010) [2023-12-26 12:12:31,122][123090] Updated weights for policy 1, policy_version 1569281 (0.0010) [2023-12-26 12:12:31,174][123091] Updated weights for policy 0, policy_version 1579727 (0.0009) [2023-12-26 12:12:31,193][123090] Updated weights for policy 1, policy_version 1569291 (0.0009) [2023-12-26 12:12:31,250][123090] Updated weights for policy 1, policy_version 1569302 (0.0007) [2023-12-26 12:12:31,314][123090] Updated weights for policy 1, policy_version 1569312 (0.0010) [2023-12-26 12:12:32,021][123091] Updated weights for policy 0, policy_version 1579737 (0.0009) [2023-12-26 12:12:32,077][123091] Updated weights for policy 0, policy_version 1579747 (0.0010) [2023-12-26 12:12:32,121][123090] Updated weights for policy 1, policy_version 1569322 (0.0007) [2023-12-26 12:12:32,138][123091] Updated weights for policy 0, policy_version 1579757 (0.0009) [2023-12-26 12:12:32,187][123090] Updated weights for policy 1, policy_version 1569332 (0.0005) [2023-12-26 12:12:32,253][123090] Updated weights for policy 1, policy_version 1569342 (0.0006) [2023-12-26 12:12:32,995][123091] Updated weights for policy 0, policy_version 1579767 (0.0008) [2023-12-26 12:12:33,023][123090] Updated weights for policy 1, policy_version 1569352 (0.0008) [2023-12-26 12:12:33,057][123091] Updated weights for policy 0, policy_version 1579777 (0.0008) [2023-12-26 12:12:33,072][123090] Updated weights for policy 1, policy_version 1569362 (0.0008) [2023-12-26 12:12:33,118][123091] Updated weights for policy 0, policy_version 1579787 (0.0009) [2023-12-26 12:12:33,129][123090] Updated weights for policy 1, policy_version 1569372 (0.0006) [2023-12-26 12:12:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 806191104. Throughput: 0: 8712.3, 1: 9055.9. Samples: 806206632. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:33,785][121949] Avg episode reward: [(0, '6171.115'), (1, '5515.216')] [2023-12-26 12:12:33,936][123090] Updated weights for policy 1, policy_version 1569382 (0.0008) [2023-12-26 12:12:33,945][123091] Updated weights for policy 0, policy_version 1579797 (0.0009) [2023-12-26 12:12:33,985][123090] Updated weights for policy 1, policy_version 1569392 (0.0008) [2023-12-26 12:12:34,000][123091] Updated weights for policy 0, policy_version 1579807 (0.0009) [2023-12-26 12:12:34,029][123090] Updated weights for policy 1, policy_version 1569402 (0.0006) [2023-12-26 12:12:34,053][123091] Updated weights for policy 0, policy_version 1579817 (0.0009) [2023-12-26 12:12:34,884][123091] Updated weights for policy 0, policy_version 1579827 (0.0009) [2023-12-26 12:12:34,916][123090] Updated weights for policy 1, policy_version 1569412 (0.0008) [2023-12-26 12:12:34,942][123091] Updated weights for policy 0, policy_version 1579837 (0.0007) [2023-12-26 12:12:34,976][123090] Updated weights for policy 1, policy_version 1569422 (0.0009) [2023-12-26 12:12:34,992][123091] Updated weights for policy 0, policy_version 1579847 (0.0008) [2023-12-26 12:12:35,046][123090] Updated weights for policy 1, policy_version 1569432 (0.0009) [2023-12-26 12:12:35,686][123090] Updated weights for policy 1, policy_version 1569442 (0.0008) [2023-12-26 12:12:35,735][123090] Updated weights for policy 1, policy_version 1569452 (0.0005) [2023-12-26 12:12:35,797][123090] Updated weights for policy 1, policy_version 1569462 (0.0005) [2023-12-26 12:12:35,851][123090] Updated weights for policy 1, policy_version 1569472 (0.0005) [2023-12-26 12:12:35,885][123091] Updated weights for policy 0, policy_version 1579857 (0.0008) [2023-12-26 12:12:35,938][123091] Updated weights for policy 0, policy_version 1579867 (0.0010) [2023-12-26 12:12:35,992][123091] Updated weights for policy 0, policy_version 1579878 (0.0010) [2023-12-26 12:12:36,532][123090] Updated weights for policy 1, policy_version 1569482 (0.0010) [2023-12-26 12:12:36,605][123090] Updated weights for policy 1, policy_version 1569492 (0.0005) [2023-12-26 12:12:36,676][123090] Updated weights for policy 1, policy_version 1569502 (0.0006) [2023-12-26 12:12:36,927][123091] Updated weights for policy 0, policy_version 1579889 (0.0010) [2023-12-26 12:12:36,989][123091] Updated weights for policy 0, policy_version 1579899 (0.0010) [2023-12-26 12:12:37,053][123091] Updated weights for policy 0, policy_version 1579909 (0.0010) [2023-12-26 12:12:37,125][123091] Updated weights for policy 0, policy_version 1579919 (0.0010) [2023-12-26 12:12:37,377][123090] Updated weights for policy 1, policy_version 1569512 (0.0006) [2023-12-26 12:12:37,432][123090] Updated weights for policy 1, policy_version 1569522 (0.0009) [2023-12-26 12:12:37,498][123090] Updated weights for policy 1, policy_version 1569532 (0.0009) [2023-12-26 12:12:37,982][123091] Updated weights for policy 0, policy_version 1579929 (0.0009) [2023-12-26 12:12:38,035][123091] Updated weights for policy 0, policy_version 1579939 (0.0009) [2023-12-26 12:12:38,092][123091] Updated weights for policy 0, policy_version 1579949 (0.0009) [2023-12-26 12:12:38,329][123090] Updated weights for policy 1, policy_version 1569542 (0.0009) [2023-12-26 12:12:38,401][123090] Updated weights for policy 1, policy_version 1569552 (0.0008) [2023-12-26 12:12:38,466][123090] Updated weights for policy 1, policy_version 1569562 (0.0008) [2023-12-26 12:12:38,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17613.0, 300 sec: 17800.2). Total num frames: 806281216. Throughput: 0: 8681.5, 1: 9106.5. Samples: 806259324. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:38,784][121949] Avg episode reward: [(0, '6002.173'), (1, '5584.242')] [2023-12-26 12:12:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001569568_401809408.pth... [2023-12-26 12:12:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001579952_404471808.pth... [2023-12-26 12:12:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001568512_401539072.pth [2023-12-26 12:12:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001578960_404217856.pth [2023-12-26 12:12:38,966][123091] Updated weights for policy 0, policy_version 1579959 (0.0010) [2023-12-26 12:12:39,028][123091] Updated weights for policy 0, policy_version 1579969 (0.0009) [2023-12-26 12:12:39,089][123091] Updated weights for policy 0, policy_version 1579979 (0.0009) [2023-12-26 12:12:39,256][123090] Updated weights for policy 1, policy_version 1569572 (0.0008) [2023-12-26 12:12:39,318][123090] Updated weights for policy 1, policy_version 1569582 (0.0006) [2023-12-26 12:12:39,397][123090] Updated weights for policy 1, policy_version 1569592 (0.0007) [2023-12-26 12:12:39,999][123091] Updated weights for policy 0, policy_version 1579989 (0.0010) [2023-12-26 12:12:40,063][123091] Updated weights for policy 0, policy_version 1579999 (0.0009) [2023-12-26 12:12:40,105][123090] Updated weights for policy 1, policy_version 1569602 (0.0008) [2023-12-26 12:12:40,134][123091] Updated weights for policy 0, policy_version 1580009 (0.0007) [2023-12-26 12:12:40,163][123090] Updated weights for policy 1, policy_version 1569612 (0.0009) [2023-12-26 12:12:40,225][123090] Updated weights for policy 1, policy_version 1569622 (0.0010) [2023-12-26 12:12:40,287][123090] Updated weights for policy 1, policy_version 1569632 (0.0009) [2023-12-26 12:12:40,969][123091] Updated weights for policy 0, policy_version 1580019 (0.0008) [2023-12-26 12:12:41,035][123091] Updated weights for policy 0, policy_version 1580029 (0.0011) [2023-12-26 12:12:41,102][123091] Updated weights for policy 0, policy_version 1580039 (0.0011) [2023-12-26 12:12:41,127][123090] Updated weights for policy 1, policy_version 1569642 (0.0007) [2023-12-26 12:12:41,200][123090] Updated weights for policy 1, policy_version 1569652 (0.0008) [2023-12-26 12:12:41,275][123090] Updated weights for policy 1, policy_version 1569662 (0.0007) [2023-12-26 12:12:41,902][123091] Updated weights for policy 0, policy_version 1580049 (0.0010) [2023-12-26 12:12:41,972][123091] Updated weights for policy 0, policy_version 1580059 (0.0006) [2023-12-26 12:12:42,040][123091] Updated weights for policy 0, policy_version 1580069 (0.0006) [2023-12-26 12:12:42,089][123090] Updated weights for policy 1, policy_version 1569672 (0.0008) [2023-12-26 12:12:42,104][123091] Updated weights for policy 0, policy_version 1580079 (0.0006) [2023-12-26 12:12:42,159][123090] Updated weights for policy 1, policy_version 1569682 (0.0008) [2023-12-26 12:12:42,228][123090] Updated weights for policy 1, policy_version 1569692 (0.0008) [2023-12-26 12:12:42,808][123091] Updated weights for policy 0, policy_version 1580089 (0.0010) [2023-12-26 12:12:42,860][123091] Updated weights for policy 0, policy_version 1580099 (0.0010) [2023-12-26 12:12:42,918][123091] Updated weights for policy 0, policy_version 1580109 (0.0010) [2023-12-26 12:12:43,006][123090] Updated weights for policy 1, policy_version 1569702 (0.0009) [2023-12-26 12:12:43,058][123090] Updated weights for policy 1, policy_version 1569712 (0.0010) [2023-12-26 12:12:43,110][123090] Updated weights for policy 1, policy_version 1569722 (0.0010) [2023-12-26 12:12:43,648][123091] Updated weights for policy 0, policy_version 1580119 (0.0008) [2023-12-26 12:12:43,721][123091] Updated weights for policy 0, policy_version 1580129 (0.0005) [2023-12-26 12:12:43,782][123091] Updated weights for policy 0, policy_version 1580139 (0.0006) [2023-12-26 12:12:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 806363136. Throughput: 0: 8554.0, 1: 8982.2. Samples: 806362372. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:43,786][121949] Avg episode reward: [(0, '5947.853'), (1, '5561.879')] [2023-12-26 12:12:43,853][123090] Updated weights for policy 1, policy_version 1569732 (0.0008) [2023-12-26 12:12:43,913][123090] Updated weights for policy 1, policy_version 1569742 (0.0005) [2023-12-26 12:12:43,962][123090] Updated weights for policy 1, policy_version 1569752 (0.0005) [2023-12-26 12:12:44,417][123091] Updated weights for policy 0, policy_version 1580149 (0.0005) [2023-12-26 12:12:44,466][123091] Updated weights for policy 0, policy_version 1580159 (0.0005) [2023-12-26 12:12:44,515][123091] Updated weights for policy 0, policy_version 1580169 (0.0005) [2023-12-26 12:12:44,572][123090] Updated weights for policy 1, policy_version 1569762 (0.0005) [2023-12-26 12:12:44,628][123090] Updated weights for policy 1, policy_version 1569772 (0.0008) [2023-12-26 12:12:44,686][123090] Updated weights for policy 1, policy_version 1569782 (0.0006) [2023-12-26 12:12:44,742][123090] Updated weights for policy 1, policy_version 1569792 (0.0005) [2023-12-26 12:12:45,234][123091] Updated weights for policy 0, policy_version 1580179 (0.0007) [2023-12-26 12:12:45,298][123091] Updated weights for policy 0, policy_version 1580189 (0.0011) [2023-12-26 12:12:45,354][123091] Updated weights for policy 0, policy_version 1580199 (0.0011) [2023-12-26 12:12:45,544][123090] Updated weights for policy 1, policy_version 1569802 (0.0009) [2023-12-26 12:12:45,602][123090] Updated weights for policy 1, policy_version 1569812 (0.0009) [2023-12-26 12:12:45,665][123090] Updated weights for policy 1, policy_version 1569822 (0.0009) [2023-12-26 12:12:46,093][123091] Updated weights for policy 0, policy_version 1580209 (0.0010) [2023-12-26 12:12:46,148][123091] Updated weights for policy 0, policy_version 1580219 (0.0006) [2023-12-26 12:12:46,216][123091] Updated weights for policy 0, policy_version 1580229 (0.0006) [2023-12-26 12:12:46,283][123091] Updated weights for policy 0, policy_version 1580239 (0.0008) [2023-12-26 12:12:46,591][123090] Updated weights for policy 1, policy_version 1569832 (0.0009) [2023-12-26 12:12:46,655][123090] Updated weights for policy 1, policy_version 1569842 (0.0010) [2023-12-26 12:12:46,718][123090] Updated weights for policy 1, policy_version 1569852 (0.0010) [2023-12-26 12:12:46,936][123091] Updated weights for policy 0, policy_version 1580249 (0.0005) [2023-12-26 12:12:46,984][123091] Updated weights for policy 0, policy_version 1580259 (0.0005) [2023-12-26 12:12:47,029][123091] Updated weights for policy 0, policy_version 1580269 (0.0005) [2023-12-26 12:12:47,596][123090] Updated weights for policy 1, policy_version 1569862 (0.0009) [2023-12-26 12:12:47,651][123090] Updated weights for policy 1, policy_version 1569872 (0.0008) [2023-12-26 12:12:47,700][123090] Updated weights for policy 1, policy_version 1569882 (0.0009) [2023-12-26 12:12:47,827][123091] Updated weights for policy 0, policy_version 1580279 (0.0007) [2023-12-26 12:12:47,881][123091] Updated weights for policy 0, policy_version 1580289 (0.0006) [2023-12-26 12:12:47,934][123091] Updated weights for policy 0, policy_version 1580299 (0.0005) [2023-12-26 12:12:48,628][123090] Updated weights for policy 1, policy_version 1569892 (0.0009) [2023-12-26 12:12:48,677][123090] Updated weights for policy 1, policy_version 1569902 (0.0008) [2023-12-26 12:12:48,683][123091] Updated weights for policy 0, policy_version 1580309 (0.0008) [2023-12-26 12:12:48,736][123090] Updated weights for policy 1, policy_version 1569912 (0.0009) [2023-12-26 12:12:48,741][123091] Updated weights for policy 0, policy_version 1580319 (0.0006) [2023-12-26 12:12:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 806461440. Throughput: 0: 8696.3, 1: 8973.9. Samples: 806473184. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:48,785][121949] Avg episode reward: [(0, '6060.475'), (1, '5566.765')] [2023-12-26 12:12:48,813][123091] Updated weights for policy 0, policy_version 1580329 (0.0005) [2023-12-26 12:12:49,578][123090] Updated weights for policy 1, policy_version 1569922 (0.0008) [2023-12-26 12:12:49,598][123091] Updated weights for policy 0, policy_version 1580339 (0.0007) [2023-12-26 12:12:49,629][123090] Updated weights for policy 1, policy_version 1569932 (0.0008) [2023-12-26 12:12:49,658][123091] Updated weights for policy 0, policy_version 1580349 (0.0011) [2023-12-26 12:12:49,677][123090] Updated weights for policy 1, policy_version 1569942 (0.0009) [2023-12-26 12:12:49,718][123091] Updated weights for policy 0, policy_version 1580359 (0.0011) [2023-12-26 12:12:49,731][123090] Updated weights for policy 1, policy_version 1569952 (0.0010) [2023-12-26 12:12:50,479][123091] Updated weights for policy 0, policy_version 1580369 (0.0011) [2023-12-26 12:12:50,542][123091] Updated weights for policy 0, policy_version 1580379 (0.0008) [2023-12-26 12:12:50,611][123091] Updated weights for policy 0, policy_version 1580389 (0.0007) [2023-12-26 12:12:50,643][123090] Updated weights for policy 1, policy_version 1569962 (0.0008) [2023-12-26 12:12:50,680][123091] Updated weights for policy 0, policy_version 1580399 (0.0009) [2023-12-26 12:12:50,703][123090] Updated weights for policy 1, policy_version 1569972 (0.0007) [2023-12-26 12:12:50,757][123090] Updated weights for policy 1, policy_version 1569982 (0.0006) [2023-12-26 12:12:51,429][123091] Updated weights for policy 0, policy_version 1580409 (0.0010) [2023-12-26 12:12:51,492][123091] Updated weights for policy 0, policy_version 1580419 (0.0009) [2023-12-26 12:12:51,512][123090] Updated weights for policy 1, policy_version 1569992 (0.0009) [2023-12-26 12:12:51,555][123091] Updated weights for policy 0, policy_version 1580429 (0.0009) [2023-12-26 12:12:51,567][123090] Updated weights for policy 1, policy_version 1570002 (0.0008) [2023-12-26 12:12:51,628][123090] Updated weights for policy 1, policy_version 1570012 (0.0009) [2023-12-26 12:12:52,336][123091] Updated weights for policy 0, policy_version 1580439 (0.0007) [2023-12-26 12:12:52,407][123091] Updated weights for policy 0, policy_version 1580449 (0.0007) [2023-12-26 12:12:52,480][123091] Updated weights for policy 0, policy_version 1580459 (0.0008) [2023-12-26 12:12:52,525][123090] Updated weights for policy 1, policy_version 1570022 (0.0009) [2023-12-26 12:12:52,581][123090] Updated weights for policy 1, policy_version 1570032 (0.0009) [2023-12-26 12:12:52,645][123090] Updated weights for policy 1, policy_version 1570042 (0.0009) [2023-12-26 12:12:53,217][123091] Updated weights for policy 0, policy_version 1580469 (0.0010) [2023-12-26 12:12:53,270][123091] Updated weights for policy 0, policy_version 1580479 (0.0009) [2023-12-26 12:12:53,323][123091] Updated weights for policy 0, policy_version 1580489 (0.0009) [2023-12-26 12:12:53,522][123090] Updated weights for policy 1, policy_version 1570052 (0.0009) [2023-12-26 12:12:53,575][123090] Updated weights for policy 1, policy_version 1570064 (0.0010) [2023-12-26 12:12:53,630][123090] Updated weights for policy 1, policy_version 1570076 (0.0010) [2023-12-26 12:12:53,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 806551552. Throughput: 0: 8676.2, 1: 8928.2. Samples: 806525308. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:53,784][121949] Avg episode reward: [(0, '5964.817'), (1, '5547.603')] [2023-12-26 12:12:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001580496_404611072.pth... [2023-12-26 12:12:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001570080_401940480.pth... [2023-12-26 12:12:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001579472_404348928.pth [2023-12-26 12:12:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001569024_401670144.pth [2023-12-26 12:12:54,057][123091] Updated weights for policy 0, policy_version 1580499 (0.0009) [2023-12-26 12:12:54,113][123091] Updated weights for policy 0, policy_version 1580509 (0.0010) [2023-12-26 12:12:54,175][123091] Updated weights for policy 0, policy_version 1580519 (0.0010) [2023-12-26 12:12:54,525][123090] Updated weights for policy 1, policy_version 1570086 (0.0009) [2023-12-26 12:12:54,583][123090] Updated weights for policy 1, policy_version 1570096 (0.0008) [2023-12-26 12:12:54,641][123090] Updated weights for policy 1, policy_version 1570106 (0.0009) [2023-12-26 12:12:54,982][123091] Updated weights for policy 0, policy_version 1580529 (0.0009) [2023-12-26 12:12:55,040][123091] Updated weights for policy 0, policy_version 1580539 (0.0009) [2023-12-26 12:12:55,088][123091] Updated weights for policy 0, policy_version 1580549 (0.0010) [2023-12-26 12:12:55,136][123091] Updated weights for policy 0, policy_version 1580559 (0.0010) [2023-12-26 12:12:55,434][123090] Updated weights for policy 1, policy_version 1570116 (0.0008) [2023-12-26 12:12:55,491][123090] Updated weights for policy 1, policy_version 1570126 (0.0006) [2023-12-26 12:12:55,548][123090] Updated weights for policy 1, policy_version 1570136 (0.0006) [2023-12-26 12:12:55,843][123091] Updated weights for policy 0, policy_version 1580569 (0.0010) [2023-12-26 12:12:55,894][123091] Updated weights for policy 0, policy_version 1580579 (0.0010) [2023-12-26 12:12:55,948][123091] Updated weights for policy 0, policy_version 1580589 (0.0010) [2023-12-26 12:12:56,214][123090] Updated weights for policy 1, policy_version 1570146 (0.0007) [2023-12-26 12:12:56,277][123090] Updated weights for policy 1, policy_version 1570156 (0.0010) [2023-12-26 12:12:56,346][123090] Updated weights for policy 1, policy_version 1570166 (0.0010) [2023-12-26 12:12:56,412][123090] Updated weights for policy 1, policy_version 1570176 (0.0010) [2023-12-26 12:12:56,779][123091] Updated weights for policy 0, policy_version 1580599 (0.0007) [2023-12-26 12:12:56,824][123091] Updated weights for policy 0, policy_version 1580609 (0.0005) [2023-12-26 12:12:56,870][123091] Updated weights for policy 0, policy_version 1580619 (0.0005) [2023-12-26 12:12:57,207][123090] Updated weights for policy 1, policy_version 1570186 (0.0005) [2023-12-26 12:12:57,274][123090] Updated weights for policy 1, policy_version 1570196 (0.0005) [2023-12-26 12:12:57,344][123090] Updated weights for policy 1, policy_version 1570206 (0.0005) [2023-12-26 12:12:57,607][123091] Updated weights for policy 0, policy_version 1580629 (0.0008) [2023-12-26 12:12:57,663][123091] Updated weights for policy 0, policy_version 1580640 (0.0008) [2023-12-26 12:12:57,721][123091] Updated weights for policy 0, policy_version 1580650 (0.0006) [2023-12-26 12:12:58,000][123090] Updated weights for policy 1, policy_version 1570216 (0.0005) [2023-12-26 12:12:58,074][123090] Updated weights for policy 1, policy_version 1570226 (0.0007) [2023-12-26 12:12:58,140][123090] Updated weights for policy 1, policy_version 1570236 (0.0008) [2023-12-26 12:12:58,474][123091] Updated weights for policy 0, policy_version 1580660 (0.0009) [2023-12-26 12:12:58,543][123091] Updated weights for policy 0, policy_version 1580670 (0.0007) [2023-12-26 12:12:58,611][123091] Updated weights for policy 0, policy_version 1580680 (0.0010) [2023-12-26 12:12:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 806641664. Throughput: 0: 8804.7, 1: 8932.0. Samples: 806633960. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:12:58,785][121949] Avg episode reward: [(0, '5969.520'), (1, '5505.836')] [2023-12-26 12:12:58,970][123090] Updated weights for policy 1, policy_version 1570246 (0.0008) [2023-12-26 12:12:59,039][123090] Updated weights for policy 1, policy_version 1570256 (0.0007) [2023-12-26 12:12:59,113][123090] Updated weights for policy 1, policy_version 1570266 (0.0010) [2023-12-26 12:12:59,512][123091] Updated weights for policy 0, policy_version 1580690 (0.0011) [2023-12-26 12:12:59,591][123091] Updated weights for policy 0, policy_version 1580700 (0.0009) [2023-12-26 12:12:59,652][123091] Updated weights for policy 0, policy_version 1580710 (0.0009) [2023-12-26 12:12:59,705][123091] Updated weights for policy 0, policy_version 1580720 (0.0009) [2023-12-26 12:12:59,944][123090] Updated weights for policy 1, policy_version 1570276 (0.0009) [2023-12-26 12:13:00,015][123090] Updated weights for policy 1, policy_version 1570286 (0.0007) [2023-12-26 12:13:00,072][123090] Updated weights for policy 1, policy_version 1570296 (0.0009) [2023-12-26 12:13:00,539][123091] Updated weights for policy 0, policy_version 1580730 (0.0009) [2023-12-26 12:13:00,598][123091] Updated weights for policy 0, policy_version 1580740 (0.0009) [2023-12-26 12:13:00,659][123091] Updated weights for policy 0, policy_version 1580750 (0.0009) [2023-12-26 12:13:00,903][123090] Updated weights for policy 1, policy_version 1570306 (0.0009) [2023-12-26 12:13:00,955][123090] Updated weights for policy 1, policy_version 1570316 (0.0009) [2023-12-26 12:13:01,017][123090] Updated weights for policy 1, policy_version 1570326 (0.0010) [2023-12-26 12:13:01,085][123090] Updated weights for policy 1, policy_version 1570336 (0.0010) [2023-12-26 12:13:01,478][123091] Updated weights for policy 0, policy_version 1580760 (0.0007) [2023-12-26 12:13:01,534][123091] Updated weights for policy 0, policy_version 1580770 (0.0006) [2023-12-26 12:13:01,591][123091] Updated weights for policy 0, policy_version 1580780 (0.0006) [2023-12-26 12:13:01,934][123090] Updated weights for policy 1, policy_version 1570346 (0.0006) [2023-12-26 12:13:01,998][123090] Updated weights for policy 1, policy_version 1570356 (0.0007) [2023-12-26 12:13:02,058][123090] Updated weights for policy 1, policy_version 1570366 (0.0007) [2023-12-26 12:13:02,297][123091] Updated weights for policy 0, policy_version 1580790 (0.0007) [2023-12-26 12:13:02,365][123091] Updated weights for policy 0, policy_version 1580800 (0.0008) [2023-12-26 12:13:02,440][123091] Updated weights for policy 0, policy_version 1580810 (0.0006) [2023-12-26 12:13:02,818][123090] Updated weights for policy 1, policy_version 1570376 (0.0009) [2023-12-26 12:13:02,869][123090] Updated weights for policy 1, policy_version 1570386 (0.0009) [2023-12-26 12:13:02,924][123090] Updated weights for policy 1, policy_version 1570396 (0.0009) [2023-12-26 12:13:03,122][123091] Updated weights for policy 0, policy_version 1580820 (0.0008) [2023-12-26 12:13:03,168][123091] Updated weights for policy 0, policy_version 1580830 (0.0009) [2023-12-26 12:13:03,221][123091] Updated weights for policy 0, policy_version 1580840 (0.0009) [2023-12-26 12:13:03,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 806723584. Throughput: 0: 8834.8, 1: 8860.6. Samples: 806739404. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:03,785][121949] Avg episode reward: [(0, '6086.229'), (1, '5583.750')] [2023-12-26 12:13:03,818][123090] Updated weights for policy 1, policy_version 1570406 (0.0010) [2023-12-26 12:13:03,879][123090] Updated weights for policy 1, policy_version 1570416 (0.0008) [2023-12-26 12:13:03,940][123090] Updated weights for policy 1, policy_version 1570426 (0.0007) [2023-12-26 12:13:03,985][123091] Updated weights for policy 0, policy_version 1580850 (0.0009) [2023-12-26 12:13:04,058][123091] Updated weights for policy 0, policy_version 1580860 (0.0006) [2023-12-26 12:13:04,132][123091] Updated weights for policy 0, policy_version 1580870 (0.0007) [2023-12-26 12:13:04,189][123091] Updated weights for policy 0, policy_version 1580880 (0.0009) [2023-12-26 12:13:04,755][123090] Updated weights for policy 1, policy_version 1570436 (0.0008) [2023-12-26 12:13:04,805][123090] Updated weights for policy 1, policy_version 1570446 (0.0010) [2023-12-26 12:13:04,858][123090] Updated weights for policy 1, policy_version 1570456 (0.0008) [2023-12-26 12:13:04,928][123091] Updated weights for policy 0, policy_version 1580890 (0.0009) [2023-12-26 12:13:04,986][123091] Updated weights for policy 0, policy_version 1580900 (0.0010) [2023-12-26 12:13:05,043][123091] Updated weights for policy 0, policy_version 1580910 (0.0009) [2023-12-26 12:13:05,679][123090] Updated weights for policy 1, policy_version 1570466 (0.0008) [2023-12-26 12:13:05,738][123090] Updated weights for policy 1, policy_version 1570476 (0.0009) [2023-12-26 12:13:05,797][123090] Updated weights for policy 1, policy_version 1570486 (0.0010) [2023-12-26 12:13:05,808][123091] Updated weights for policy 0, policy_version 1580920 (0.0008) [2023-12-26 12:13:05,856][123090] Updated weights for policy 1, policy_version 1570496 (0.0009) [2023-12-26 12:13:05,871][123091] Updated weights for policy 0, policy_version 1580930 (0.0007) [2023-12-26 12:13:05,922][123091] Updated weights for policy 0, policy_version 1580940 (0.0009) [2023-12-26 12:13:06,608][123090] Updated weights for policy 1, policy_version 1570506 (0.0005) [2023-12-26 12:13:06,664][123090] Updated weights for policy 1, policy_version 1570516 (0.0006) [2023-12-26 12:13:06,726][123090] Updated weights for policy 1, policy_version 1570526 (0.0007) [2023-12-26 12:13:06,797][123091] Updated weights for policy 0, policy_version 1580951 (0.0009) [2023-12-26 12:13:06,869][123091] Updated weights for policy 0, policy_version 1580961 (0.0009) [2023-12-26 12:13:06,949][123091] Updated weights for policy 0, policy_version 1580971 (0.0010) [2023-12-26 12:13:07,410][123090] Updated weights for policy 1, policy_version 1570536 (0.0009) [2023-12-26 12:13:07,477][123090] Updated weights for policy 1, policy_version 1570546 (0.0009) [2023-12-26 12:13:07,526][123090] Updated weights for policy 1, policy_version 1570556 (0.0009) [2023-12-26 12:13:07,792][123091] Updated weights for policy 0, policy_version 1580981 (0.0010) [2023-12-26 12:13:07,861][123091] Updated weights for policy 0, policy_version 1580991 (0.0010) [2023-12-26 12:13:07,927][123091] Updated weights for policy 0, policy_version 1581001 (0.0010) [2023-12-26 12:13:08,406][123090] Updated weights for policy 1, policy_version 1570566 (0.0008) [2023-12-26 12:13:08,470][123090] Updated weights for policy 1, policy_version 1570576 (0.0009) [2023-12-26 12:13:08,531][123090] Updated weights for policy 1, policy_version 1570586 (0.0010) [2023-12-26 12:13:08,741][123091] Updated weights for policy 0, policy_version 1581011 (0.0009) [2023-12-26 12:13:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 806813696. Throughput: 0: 8880.6, 1: 8868.2. Samples: 806792860. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:08,785][121949] Avg episode reward: [(0, '6046.490'), (1, '5834.859')] [2023-12-26 12:13:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001570592_402071552.pth... [2023-12-26 12:13:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001569568_401809408.pth [2023-12-26 12:13:08,794][123091] Updated weights for policy 0, policy_version 1581021 (0.0009) [2023-12-26 12:13:08,859][123091] Updated weights for policy 0, policy_version 1581031 (0.0009) [2023-12-26 12:13:08,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001581040_404750336.pth... [2023-12-26 12:13:08,904][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001579952_404471808.pth [2023-12-26 12:13:09,356][123090] Updated weights for policy 1, policy_version 1570596 (0.0010) [2023-12-26 12:13:09,426][123090] Updated weights for policy 1, policy_version 1570606 (0.0009) [2023-12-26 12:13:09,495][123090] Updated weights for policy 1, policy_version 1570616 (0.0008) [2023-12-26 12:13:09,709][123091] Updated weights for policy 0, policy_version 1581041 (0.0009) [2023-12-26 12:13:09,763][123091] Updated weights for policy 0, policy_version 1581051 (0.0010) [2023-12-26 12:13:09,828][123091] Updated weights for policy 0, policy_version 1581061 (0.0010) [2023-12-26 12:13:09,895][123091] Updated weights for policy 0, policy_version 1581071 (0.0010) [2023-12-26 12:13:10,321][123090] Updated weights for policy 1, policy_version 1570626 (0.0009) [2023-12-26 12:13:10,390][123090] Updated weights for policy 1, policy_version 1570636 (0.0011) [2023-12-26 12:13:10,458][123090] Updated weights for policy 1, policy_version 1570646 (0.0011) [2023-12-26 12:13:10,507][123090] Updated weights for policy 1, policy_version 1570656 (0.0011) [2023-12-26 12:13:10,764][123091] Updated weights for policy 0, policy_version 1581081 (0.0009) [2023-12-26 12:13:10,816][123091] Updated weights for policy 0, policy_version 1581091 (0.0009) [2023-12-26 12:13:10,867][123091] Updated weights for policy 0, policy_version 1581101 (0.0008) [2023-12-26 12:13:11,345][123090] Updated weights for policy 1, policy_version 1570666 (0.0010) [2023-12-26 12:13:11,419][123090] Updated weights for policy 1, policy_version 1570676 (0.0009) [2023-12-26 12:13:11,484][123090] Updated weights for policy 1, policy_version 1570686 (0.0009) [2023-12-26 12:13:11,746][123091] Updated weights for policy 0, policy_version 1581111 (0.0009) [2023-12-26 12:13:11,813][123091] Updated weights for policy 0, policy_version 1581121 (0.0009) [2023-12-26 12:13:11,864][123091] Updated weights for policy 0, policy_version 1581131 (0.0009) [2023-12-26 12:13:12,268][123090] Updated weights for policy 1, policy_version 1570696 (0.0008) [2023-12-26 12:13:12,336][123090] Updated weights for policy 1, policy_version 1570706 (0.0010) [2023-12-26 12:13:12,399][123090] Updated weights for policy 1, policy_version 1570716 (0.0010) [2023-12-26 12:13:12,769][123091] Updated weights for policy 0, policy_version 1581141 (0.0009) [2023-12-26 12:13:12,827][123091] Updated weights for policy 0, policy_version 1581151 (0.0010) [2023-12-26 12:13:12,889][123091] Updated weights for policy 0, policy_version 1581161 (0.0010) [2023-12-26 12:13:13,203][123090] Updated weights for policy 1, policy_version 1570726 (0.0007) [2023-12-26 12:13:13,274][123090] Updated weights for policy 1, policy_version 1570736 (0.0005) [2023-12-26 12:13:13,344][123090] Updated weights for policy 1, policy_version 1570746 (0.0005) [2023-12-26 12:13:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 806895616. Throughput: 0: 8808.2, 1: 8768.0. Samples: 806893880. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:13,784][121949] Avg episode reward: [(0, '5979.596'), (1, '5889.395')] [2023-12-26 12:13:13,829][123091] Updated weights for policy 0, policy_version 1581171 (0.0009) [2023-12-26 12:13:13,880][123091] Updated weights for policy 0, policy_version 1581181 (0.0010) [2023-12-26 12:13:13,891][123090] Updated weights for policy 1, policy_version 1570756 (0.0005) [2023-12-26 12:13:13,930][123091] Updated weights for policy 0, policy_version 1581191 (0.0009) [2023-12-26 12:13:13,948][123090] Updated weights for policy 1, policy_version 1570766 (0.0007) [2023-12-26 12:13:14,002][123090] Updated weights for policy 1, policy_version 1570776 (0.0007) [2023-12-26 12:13:14,785][123091] Updated weights for policy 0, policy_version 1581201 (0.0009) [2023-12-26 12:13:14,808][123090] Updated weights for policy 1, policy_version 1570787 (0.0010) [2023-12-26 12:13:14,848][123091] Updated weights for policy 0, policy_version 1581211 (0.0007) [2023-12-26 12:13:14,877][123090] Updated weights for policy 1, policy_version 1570797 (0.0008) [2023-12-26 12:13:14,917][123091] Updated weights for policy 0, policy_version 1581221 (0.0009) [2023-12-26 12:13:14,945][123090] Updated weights for policy 1, policy_version 1570807 (0.0009) [2023-12-26 12:13:14,970][123091] Updated weights for policy 0, policy_version 1581231 (0.0008) [2023-12-26 12:13:15,750][123090] Updated weights for policy 1, policy_version 1570817 (0.0008) [2023-12-26 12:13:15,812][123090] Updated weights for policy 1, policy_version 1570827 (0.0009) [2023-12-26 12:13:15,819][123091] Updated weights for policy 0, policy_version 1581241 (0.0008) [2023-12-26 12:13:15,874][123090] Updated weights for policy 1, policy_version 1570837 (0.0007) [2023-12-26 12:13:15,882][123091] Updated weights for policy 0, policy_version 1581251 (0.0008) [2023-12-26 12:13:15,940][123091] Updated weights for policy 0, policy_version 1581261 (0.0007) [2023-12-26 12:13:15,941][123090] Updated weights for policy 1, policy_version 1570847 (0.0009) [2023-12-26 12:13:16,635][123090] Updated weights for policy 1, policy_version 1570857 (0.0008) [2023-12-26 12:13:16,670][123091] Updated weights for policy 0, policy_version 1581271 (0.0006) [2023-12-26 12:13:16,697][123090] Updated weights for policy 1, policy_version 1570867 (0.0009) [2023-12-26 12:13:16,738][123091] Updated weights for policy 0, policy_version 1581281 (0.0006) [2023-12-26 12:13:16,770][123090] Updated weights for policy 1, policy_version 1570877 (0.0010) [2023-12-26 12:13:16,807][123091] Updated weights for policy 0, policy_version 1581291 (0.0006) [2023-12-26 12:13:17,422][123091] Updated weights for policy 0, policy_version 1581301 (0.0006) [2023-12-26 12:13:17,468][123091] Updated weights for policy 0, policy_version 1581311 (0.0005) [2023-12-26 12:13:17,521][123091] Updated weights for policy 0, policy_version 1581321 (0.0005) [2023-12-26 12:13:17,606][123090] Updated weights for policy 1, policy_version 1570887 (0.0007) [2023-12-26 12:13:17,661][123090] Updated weights for policy 1, policy_version 1570897 (0.0005) [2023-12-26 12:13:17,710][123090] Updated weights for policy 1, policy_version 1570907 (0.0006) [2023-12-26 12:13:18,289][123091] Updated weights for policy 0, policy_version 1581331 (0.0007) [2023-12-26 12:13:18,353][123091] Updated weights for policy 0, policy_version 1581341 (0.0008) [2023-12-26 12:13:18,407][123091] Updated weights for policy 0, policy_version 1581351 (0.0006) [2023-12-26 12:13:18,509][123090] Updated weights for policy 1, policy_version 1570917 (0.0010) [2023-12-26 12:13:18,564][123090] Updated weights for policy 1, policy_version 1570927 (0.0009) [2023-12-26 12:13:18,624][123090] Updated weights for policy 1, policy_version 1570937 (0.0008) [2023-12-26 12:13:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 806993920. Throughput: 0: 8859.1, 1: 8801.8. Samples: 807001372. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:18,784][121949] Avg episode reward: [(0, '5909.872'), (1, '5851.037')] [2023-12-26 12:13:19,183][123091] Updated weights for policy 0, policy_version 1581361 (0.0006) [2023-12-26 12:13:19,244][123091] Updated weights for policy 0, policy_version 1581371 (0.0009) [2023-12-26 12:13:19,311][123091] Updated weights for policy 0, policy_version 1581381 (0.0009) [2023-12-26 12:13:19,382][123091] Updated weights for policy 0, policy_version 1581391 (0.0009) [2023-12-26 12:13:19,416][123090] Updated weights for policy 1, policy_version 1570947 (0.0007) [2023-12-26 12:13:19,482][123090] Updated weights for policy 1, policy_version 1570957 (0.0008) [2023-12-26 12:13:19,548][123090] Updated weights for policy 1, policy_version 1570967 (0.0008) [2023-12-26 12:13:20,253][123091] Updated weights for policy 0, policy_version 1581401 (0.0006) [2023-12-26 12:13:20,306][123090] Updated weights for policy 1, policy_version 1570977 (0.0006) [2023-12-26 12:13:20,308][123091] Updated weights for policy 0, policy_version 1581411 (0.0009) [2023-12-26 12:13:20,372][123091] Updated weights for policy 0, policy_version 1581421 (0.0008) [2023-12-26 12:13:20,378][123090] Updated weights for policy 1, policy_version 1570987 (0.0006) [2023-12-26 12:13:20,453][123090] Updated weights for policy 1, policy_version 1570997 (0.0006) [2023-12-26 12:13:20,527][123090] Updated weights for policy 1, policy_version 1571007 (0.0008) [2023-12-26 12:13:21,179][123091] Updated weights for policy 0, policy_version 1581431 (0.0010) [2023-12-26 12:13:21,237][123091] Updated weights for policy 0, policy_version 1581441 (0.0010) [2023-12-26 12:13:21,301][123091] Updated weights for policy 0, policy_version 1581451 (0.0010) [2023-12-26 12:13:21,329][123090] Updated weights for policy 1, policy_version 1571017 (0.0009) [2023-12-26 12:13:21,403][123090] Updated weights for policy 1, policy_version 1571027 (0.0010) [2023-12-26 12:13:21,475][123090] Updated weights for policy 1, policy_version 1571037 (0.0011) [2023-12-26 12:13:22,224][123091] Updated weights for policy 0, policy_version 1581461 (0.0009) [2023-12-26 12:13:22,271][123090] Updated weights for policy 1, policy_version 1571047 (0.0009) [2023-12-26 12:13:22,294][123091] Updated weights for policy 0, policy_version 1581471 (0.0011) [2023-12-26 12:13:22,334][123090] Updated weights for policy 1, policy_version 1571057 (0.0009) [2023-12-26 12:13:22,364][123091] Updated weights for policy 0, policy_version 1581481 (0.0010) [2023-12-26 12:13:22,405][123090] Updated weights for policy 1, policy_version 1571067 (0.0008) [2023-12-26 12:13:23,159][123091] Updated weights for policy 0, policy_version 1581491 (0.0010) [2023-12-26 12:13:23,204][123090] Updated weights for policy 1, policy_version 1571077 (0.0008) [2023-12-26 12:13:23,222][123091] Updated weights for policy 0, policy_version 1581501 (0.0011) [2023-12-26 12:13:23,271][123090] Updated weights for policy 1, policy_version 1571087 (0.0006) [2023-12-26 12:13:23,290][123091] Updated weights for policy 0, policy_version 1581511 (0.0011) [2023-12-26 12:13:23,320][123090] Updated weights for policy 1, policy_version 1571097 (0.0008) [2023-12-26 12:13:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 807075840. Throughput: 0: 8851.9, 1: 8774.1. Samples: 807052500. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:23,785][121949] Avg episode reward: [(0, '5904.875'), (1, '5900.033')] [2023-12-26 12:13:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001571104_402202624.pth... [2023-12-26 12:13:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001581520_404873216.pth... [2023-12-26 12:13:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001570080_401940480.pth [2023-12-26 12:13:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001580496_404611072.pth [2023-12-26 12:13:24,105][123091] Updated weights for policy 0, policy_version 1581521 (0.0011) [2023-12-26 12:13:24,154][123090] Updated weights for policy 1, policy_version 1571107 (0.0006) [2023-12-26 12:13:24,157][123091] Updated weights for policy 0, policy_version 1581531 (0.0011) [2023-12-26 12:13:24,207][123090] Updated weights for policy 1, policy_version 1571117 (0.0006) [2023-12-26 12:13:24,216][123091] Updated weights for policy 0, policy_version 1581541 (0.0011) [2023-12-26 12:13:24,262][123090] Updated weights for policy 1, policy_version 1571127 (0.0009) [2023-12-26 12:13:24,275][123091] Updated weights for policy 0, policy_version 1581551 (0.0011) [2023-12-26 12:13:25,014][123091] Updated weights for policy 0, policy_version 1581561 (0.0011) [2023-12-26 12:13:25,026][123090] Updated weights for policy 1, policy_version 1571137 (0.0009) [2023-12-26 12:13:25,066][123091] Updated weights for policy 0, policy_version 1581571 (0.0010) [2023-12-26 12:13:25,077][123090] Updated weights for policy 1, policy_version 1571147 (0.0006) [2023-12-26 12:13:25,128][123091] Updated weights for policy 0, policy_version 1581581 (0.0010) [2023-12-26 12:13:25,129][123090] Updated weights for policy 1, policy_version 1571157 (0.0007) [2023-12-26 12:13:25,183][123090] Updated weights for policy 1, policy_version 1571167 (0.0009) [2023-12-26 12:13:25,933][123091] Updated weights for policy 0, policy_version 1581591 (0.0010) [2023-12-26 12:13:25,936][123090] Updated weights for policy 1, policy_version 1571177 (0.0006) [2023-12-26 12:13:25,977][123091] Updated weights for policy 0, policy_version 1581601 (0.0010) [2023-12-26 12:13:26,001][123090] Updated weights for policy 1, policy_version 1571187 (0.0007) [2023-12-26 12:13:26,043][123091] Updated weights for policy 0, policy_version 1581611 (0.0011) [2023-12-26 12:13:26,064][123090] Updated weights for policy 1, policy_version 1571197 (0.0007) [2023-12-26 12:13:26,801][123090] Updated weights for policy 1, policy_version 1571207 (0.0006) [2023-12-26 12:13:26,865][123090] Updated weights for policy 1, policy_version 1571217 (0.0005) [2023-12-26 12:13:26,869][123091] Updated weights for policy 0, policy_version 1581621 (0.0009) [2023-12-26 12:13:26,918][123090] Updated weights for policy 1, policy_version 1571227 (0.0006) [2023-12-26 12:13:26,927][123091] Updated weights for policy 0, policy_version 1581631 (0.0005) [2023-12-26 12:13:26,985][123091] Updated weights for policy 0, policy_version 1581641 (0.0005) [2023-12-26 12:13:27,518][123090] Updated weights for policy 1, policy_version 1571237 (0.0005) [2023-12-26 12:13:27,567][123090] Updated weights for policy 1, policy_version 1571247 (0.0005) [2023-12-26 12:13:27,628][123090] Updated weights for policy 1, policy_version 1571257 (0.0005) [2023-12-26 12:13:27,727][123091] Updated weights for policy 0, policy_version 1581651 (0.0007) [2023-12-26 12:13:27,778][123091] Updated weights for policy 0, policy_version 1581661 (0.0010) [2023-12-26 12:13:27,829][123091] Updated weights for policy 0, policy_version 1581671 (0.0010) [2023-12-26 12:13:28,312][123090] Updated weights for policy 1, policy_version 1571267 (0.0005) [2023-12-26 12:13:28,377][123090] Updated weights for policy 1, policy_version 1571277 (0.0007) [2023-12-26 12:13:28,450][123090] Updated weights for policy 1, policy_version 1571287 (0.0008) [2023-12-26 12:13:28,619][123091] Updated weights for policy 0, policy_version 1581681 (0.0010) [2023-12-26 12:13:28,686][123091] Updated weights for policy 0, policy_version 1581691 (0.0008) [2023-12-26 12:13:28,746][123091] Updated weights for policy 0, policy_version 1581701 (0.0007) [2023-12-26 12:13:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17800.3). Total num frames: 807165952. Throughput: 0: 8930.3, 1: 8832.4. Samples: 807161688. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:28,784][121949] Avg episode reward: [(0, '6105.357'), (1, '5833.663')] [2023-12-26 12:13:28,810][123091] Updated weights for policy 0, policy_version 1581711 (0.0007) [2023-12-26 12:13:29,265][123090] Updated weights for policy 1, policy_version 1571297 (0.0010) [2023-12-26 12:13:29,336][123090] Updated weights for policy 1, policy_version 1571307 (0.0009) [2023-12-26 12:13:29,405][123090] Updated weights for policy 1, policy_version 1571317 (0.0010) [2023-12-26 12:13:29,467][123090] Updated weights for policy 1, policy_version 1571327 (0.0009) [2023-12-26 12:13:29,603][123091] Updated weights for policy 0, policy_version 1581721 (0.0009) [2023-12-26 12:13:29,657][123091] Updated weights for policy 0, policy_version 1581731 (0.0009) [2023-12-26 12:13:29,713][123091] Updated weights for policy 0, policy_version 1581741 (0.0009) [2023-12-26 12:13:30,228][123090] Updated weights for policy 1, policy_version 1571337 (0.0006) [2023-12-26 12:13:30,292][123090] Updated weights for policy 1, policy_version 1571347 (0.0006) [2023-12-26 12:13:30,348][123090] Updated weights for policy 1, policy_version 1571357 (0.0006) [2023-12-26 12:13:30,576][123091] Updated weights for policy 0, policy_version 1581751 (0.0008) [2023-12-26 12:13:30,626][123091] Updated weights for policy 0, policy_version 1581761 (0.0009) [2023-12-26 12:13:30,683][123091] Updated weights for policy 0, policy_version 1581771 (0.0007) [2023-12-26 12:13:31,072][123090] Updated weights for policy 1, policy_version 1571367 (0.0007) [2023-12-26 12:13:31,141][123090] Updated weights for policy 1, policy_version 1571377 (0.0008) [2023-12-26 12:13:31,208][123090] Updated weights for policy 1, policy_version 1571387 (0.0008) [2023-12-26 12:13:31,364][123091] Updated weights for policy 0, policy_version 1581781 (0.0006) [2023-12-26 12:13:31,428][123091] Updated weights for policy 0, policy_version 1581791 (0.0010) [2023-12-26 12:13:31,492][123091] Updated weights for policy 0, policy_version 1581801 (0.0010) [2023-12-26 12:13:31,964][123090] Updated weights for policy 1, policy_version 1571397 (0.0008) [2023-12-26 12:13:32,019][123090] Updated weights for policy 1, policy_version 1571407 (0.0008) [2023-12-26 12:13:32,083][123090] Updated weights for policy 1, policy_version 1571417 (0.0008) [2023-12-26 12:13:32,337][123091] Updated weights for policy 0, policy_version 1581811 (0.0009) [2023-12-26 12:13:32,405][123091] Updated weights for policy 0, policy_version 1581821 (0.0009) [2023-12-26 12:13:32,452][123091] Updated weights for policy 0, policy_version 1581831 (0.0008) [2023-12-26 12:13:32,891][123090] Updated weights for policy 1, policy_version 1571427 (0.0008) [2023-12-26 12:13:32,958][123090] Updated weights for policy 1, policy_version 1571437 (0.0009) [2023-12-26 12:13:33,009][123090] Updated weights for policy 1, policy_version 1571447 (0.0009) [2023-12-26 12:13:33,272][123091] Updated weights for policy 0, policy_version 1581841 (0.0008) [2023-12-26 12:13:33,323][123091] Updated weights for policy 0, policy_version 1581851 (0.0010) [2023-12-26 12:13:33,367][123091] Updated weights for policy 0, policy_version 1581861 (0.0010) [2023-12-26 12:13:33,422][123091] Updated weights for policy 0, policy_version 1581871 (0.0009) [2023-12-26 12:13:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 807256064. Throughput: 0: 8818.2, 1: 8876.4. Samples: 807269444. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:33,785][121949] Avg episode reward: [(0, '6161.435'), (1, '5817.763')] [2023-12-26 12:13:33,873][123090] Updated weights for policy 1, policy_version 1571457 (0.0008) [2023-12-26 12:13:33,924][123090] Updated weights for policy 1, policy_version 1571467 (0.0005) [2023-12-26 12:13:33,981][123090] Updated weights for policy 1, policy_version 1571477 (0.0006) [2023-12-26 12:13:34,047][123090] Updated weights for policy 1, policy_version 1571487 (0.0005) [2023-12-26 12:13:34,088][123091] Updated weights for policy 0, policy_version 1581881 (0.0009) [2023-12-26 12:13:34,144][123091] Updated weights for policy 0, policy_version 1581891 (0.0010) [2023-12-26 12:13:34,206][123091] Updated weights for policy 0, policy_version 1581901 (0.0009) [2023-12-26 12:13:34,787][123090] Updated weights for policy 1, policy_version 1571497 (0.0008) [2023-12-26 12:13:34,847][123090] Updated weights for policy 1, policy_version 1571507 (0.0009) [2023-12-26 12:13:34,897][123090] Updated weights for policy 1, policy_version 1571517 (0.0006) [2023-12-26 12:13:35,022][123091] Updated weights for policy 0, policy_version 1581911 (0.0006) [2023-12-26 12:13:35,082][123091] Updated weights for policy 0, policy_version 1581921 (0.0006) [2023-12-26 12:13:35,153][123091] Updated weights for policy 0, policy_version 1581931 (0.0005) [2023-12-26 12:13:35,636][123090] Updated weights for policy 1, policy_version 1571527 (0.0005) [2023-12-26 12:13:35,691][123090] Updated weights for policy 1, policy_version 1571537 (0.0005) [2023-12-26 12:13:35,747][123090] Updated weights for policy 1, policy_version 1571547 (0.0009) [2023-12-26 12:13:35,784][123091] Updated weights for policy 0, policy_version 1581941 (0.0005) [2023-12-26 12:13:35,851][123091] Updated weights for policy 0, policy_version 1581951 (0.0005) [2023-12-26 12:13:35,913][123091] Updated weights for policy 0, policy_version 1581961 (0.0006) [2023-12-26 12:13:36,489][123090] Updated weights for policy 1, policy_version 1571557 (0.0009) [2023-12-26 12:13:36,548][123090] Updated weights for policy 1, policy_version 1571567 (0.0009) [2023-12-26 12:13:36,572][123091] Updated weights for policy 0, policy_version 1581971 (0.0006) [2023-12-26 12:13:36,612][123090] Updated weights for policy 1, policy_version 1571577 (0.0009) [2023-12-26 12:13:36,641][123091] Updated weights for policy 0, policy_version 1581981 (0.0008) [2023-12-26 12:13:36,710][123091] Updated weights for policy 0, policy_version 1581991 (0.0006) [2023-12-26 12:13:37,344][123091] Updated weights for policy 0, policy_version 1582001 (0.0006) [2023-12-26 12:13:37,407][123091] Updated weights for policy 0, policy_version 1582011 (0.0009) [2023-12-26 12:13:37,470][123091] Updated weights for policy 0, policy_version 1582021 (0.0010) [2023-12-26 12:13:37,493][123090] Updated weights for policy 1, policy_version 1571587 (0.0008) [2023-12-26 12:13:37,540][123091] Updated weights for policy 0, policy_version 1582031 (0.0008) [2023-12-26 12:13:37,546][123090] Updated weights for policy 1, policy_version 1571597 (0.0007) [2023-12-26 12:13:37,596][123090] Updated weights for policy 1, policy_version 1571607 (0.0009) [2023-12-26 12:13:38,369][123091] Updated weights for policy 0, policy_version 1582041 (0.0009) [2023-12-26 12:13:38,439][123091] Updated weights for policy 0, policy_version 1582051 (0.0010) [2023-12-26 12:13:38,446][123090] Updated weights for policy 1, policy_version 1571617 (0.0009) [2023-12-26 12:13:38,500][123091] Updated weights for policy 0, policy_version 1582061 (0.0010) [2023-12-26 12:13:38,507][123090] Updated weights for policy 1, policy_version 1571627 (0.0009) [2023-12-26 12:13:38,574][123090] Updated weights for policy 1, policy_version 1571637 (0.0010) [2023-12-26 12:13:38,641][123090] Updated weights for policy 1, policy_version 1571647 (0.0009) [2023-12-26 12:13:38,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 807354368. Throughput: 0: 8892.7, 1: 8929.5. Samples: 807327308. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:38,785][121949] Avg episode reward: [(0, '6079.134'), (1, '5695.368')] [2023-12-26 12:13:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001582064_405012480.pth... [2023-12-26 12:13:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001571648_402341888.pth... [2023-12-26 12:13:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001570592_402071552.pth [2023-12-26 12:13:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001581040_404750336.pth [2023-12-26 12:13:39,339][123091] Updated weights for policy 0, policy_version 1582071 (0.0010) [2023-12-26 12:13:39,410][123091] Updated weights for policy 0, policy_version 1582081 (0.0009) [2023-12-26 12:13:39,477][123091] Updated weights for policy 0, policy_version 1582091 (0.0008) [2023-12-26 12:13:39,483][123090] Updated weights for policy 1, policy_version 1571657 (0.0010) [2023-12-26 12:13:39,549][123090] Updated weights for policy 1, policy_version 1571667 (0.0009) [2023-12-26 12:13:39,618][123090] Updated weights for policy 1, policy_version 1571677 (0.0009) [2023-12-26 12:13:40,323][123091] Updated weights for policy 0, policy_version 1582101 (0.0008) [2023-12-26 12:13:40,389][123091] Updated weights for policy 0, policy_version 1582111 (0.0010) [2023-12-26 12:13:40,449][123091] Updated weights for policy 0, policy_version 1582121 (0.0008) [2023-12-26 12:13:40,464][123090] Updated weights for policy 1, policy_version 1571687 (0.0009) [2023-12-26 12:13:40,531][123090] Updated weights for policy 1, policy_version 1571697 (0.0009) [2023-12-26 12:13:40,586][123090] Updated weights for policy 1, policy_version 1571707 (0.0009) [2023-12-26 12:13:41,238][123091] Updated weights for policy 0, policy_version 1582131 (0.0007) [2023-12-26 12:13:41,310][123091] Updated weights for policy 0, policy_version 1582141 (0.0010) [2023-12-26 12:13:41,383][123091] Updated weights for policy 0, policy_version 1582151 (0.0009) [2023-12-26 12:13:41,497][123090] Updated weights for policy 1, policy_version 1571717 (0.0009) [2023-12-26 12:13:41,561][123090] Updated weights for policy 1, policy_version 1571727 (0.0010) [2023-12-26 12:13:41,635][123090] Updated weights for policy 1, policy_version 1571737 (0.0008) [2023-12-26 12:13:42,256][123091] Updated weights for policy 0, policy_version 1582161 (0.0011) [2023-12-26 12:13:42,322][123091] Updated weights for policy 0, policy_version 1582171 (0.0009) [2023-12-26 12:13:42,396][123091] Updated weights for policy 0, policy_version 1582181 (0.0008) [2023-12-26 12:13:42,427][123090] Updated weights for policy 1, policy_version 1571747 (0.0007) [2023-12-26 12:13:42,460][123091] Updated weights for policy 0, policy_version 1582191 (0.0010) [2023-12-26 12:13:42,477][123090] Updated weights for policy 1, policy_version 1571757 (0.0007) [2023-12-26 12:13:42,533][123090] Updated weights for policy 1, policy_version 1571767 (0.0009) [2023-12-26 12:13:43,300][123091] Updated weights for policy 0, policy_version 1582201 (0.0009) [2023-12-26 12:13:43,350][123091] Updated weights for policy 0, policy_version 1582211 (0.0009) [2023-12-26 12:13:43,396][123090] Updated weights for policy 1, policy_version 1571777 (0.0009) [2023-12-26 12:13:43,406][123091] Updated weights for policy 0, policy_version 1582221 (0.0008) [2023-12-26 12:13:43,447][123090] Updated weights for policy 1, policy_version 1571787 (0.0010) [2023-12-26 12:13:43,501][123090] Updated weights for policy 1, policy_version 1571798 (0.0010) [2023-12-26 12:13:43,567][123090] Updated weights for policy 1, policy_version 1571808 (0.0010) [2023-12-26 12:13:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17800.2). Total num frames: 807436288. Throughput: 0: 8794.2, 1: 8858.6. Samples: 807428336. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:43,785][121949] Avg episode reward: [(0, '6177.649'), (1, '5623.899')] [2023-12-26 12:13:44,198][123091] Updated weights for policy 0, policy_version 1582231 (0.0009) [2023-12-26 12:13:44,261][123091] Updated weights for policy 0, policy_version 1582241 (0.0006) [2023-12-26 12:13:44,333][123091] Updated weights for policy 0, policy_version 1582251 (0.0005) [2023-12-26 12:13:44,427][123090] Updated weights for policy 1, policy_version 1571818 (0.0009) [2023-12-26 12:13:44,480][123090] Updated weights for policy 1, policy_version 1571828 (0.0010) [2023-12-26 12:13:44,559][123090] Updated weights for policy 1, policy_version 1571838 (0.0009) [2023-12-26 12:13:45,013][123091] Updated weights for policy 0, policy_version 1582261 (0.0007) [2023-12-26 12:13:45,081][123091] Updated weights for policy 0, policy_version 1582271 (0.0010) [2023-12-26 12:13:45,140][123091] Updated weights for policy 0, policy_version 1582281 (0.0008) [2023-12-26 12:13:45,404][123090] Updated weights for policy 1, policy_version 1571848 (0.0010) [2023-12-26 12:13:45,470][123090] Updated weights for policy 1, policy_version 1571858 (0.0006) [2023-12-26 12:13:45,517][123090] Updated weights for policy 1, policy_version 1571868 (0.0005) [2023-12-26 12:13:45,982][123091] Updated weights for policy 0, policy_version 1582291 (0.0010) [2023-12-26 12:13:46,037][123091] Updated weights for policy 0, policy_version 1582301 (0.0010) [2023-12-26 12:13:46,098][123091] Updated weights for policy 0, policy_version 1582311 (0.0010) [2023-12-26 12:13:46,197][123090] Updated weights for policy 1, policy_version 1571878 (0.0006) [2023-12-26 12:13:46,265][123090] Updated weights for policy 1, policy_version 1571888 (0.0005) [2023-12-26 12:13:46,339][123090] Updated weights for policy 1, policy_version 1571898 (0.0010) [2023-12-26 12:13:46,754][123091] Updated weights for policy 0, policy_version 1582321 (0.0007) [2023-12-26 12:13:46,819][123091] Updated weights for policy 0, policy_version 1582331 (0.0008) [2023-12-26 12:13:46,873][123091] Updated weights for policy 0, policy_version 1582341 (0.0006) [2023-12-26 12:13:46,926][123091] Updated weights for policy 0, policy_version 1582351 (0.0005) [2023-12-26 12:13:47,141][123090] Updated weights for policy 1, policy_version 1571908 (0.0011) [2023-12-26 12:13:47,205][123090] Updated weights for policy 1, policy_version 1571918 (0.0011) [2023-12-26 12:13:47,275][123090] Updated weights for policy 1, policy_version 1571928 (0.0011) [2023-12-26 12:13:47,700][123091] Updated weights for policy 0, policy_version 1582361 (0.0010) [2023-12-26 12:13:47,774][123091] Updated weights for policy 0, policy_version 1582371 (0.0010) [2023-12-26 12:13:47,841][123091] Updated weights for policy 0, policy_version 1582381 (0.0011) [2023-12-26 12:13:47,861][123090] Updated weights for policy 1, policy_version 1571938 (0.0010) [2023-12-26 12:13:47,931][123090] Updated weights for policy 1, policy_version 1571948 (0.0011) [2023-12-26 12:13:47,992][123090] Updated weights for policy 1, policy_version 1571958 (0.0010) [2023-12-26 12:13:48,055][123090] Updated weights for policy 1, policy_version 1571968 (0.0010) [2023-12-26 12:13:48,647][123091] Updated weights for policy 0, policy_version 1582391 (0.0008) [2023-12-26 12:13:48,708][123091] Updated weights for policy 0, policy_version 1582401 (0.0007) [2023-12-26 12:13:48,778][123091] Updated weights for policy 0, policy_version 1582411 (0.0005) [2023-12-26 12:13:48,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 807518208. Throughput: 0: 8810.1, 1: 8900.7. Samples: 807536392. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:48,785][121949] Avg episode reward: [(0, '6174.920'), (1, '5644.100')] [2023-12-26 12:13:48,877][123090] Updated weights for policy 1, policy_version 1571978 (0.0010) [2023-12-26 12:13:48,941][123090] Updated weights for policy 1, policy_version 1571988 (0.0011) [2023-12-26 12:13:49,004][123090] Updated weights for policy 1, policy_version 1571998 (0.0011) [2023-12-26 12:13:49,513][123091] Updated weights for policy 0, policy_version 1582421 (0.0007) [2023-12-26 12:13:49,575][123091] Updated weights for policy 0, policy_version 1582431 (0.0010) [2023-12-26 12:13:49,648][123091] Updated weights for policy 0, policy_version 1582441 (0.0009) [2023-12-26 12:13:49,801][123090] Updated weights for policy 1, policy_version 1572008 (0.0009) [2023-12-26 12:13:49,887][123090] Updated weights for policy 1, policy_version 1572021 (0.0009) [2023-12-26 12:13:49,962][123090] Updated weights for policy 1, policy_version 1572031 (0.0009) [2023-12-26 12:13:50,421][123091] Updated weights for policy 0, policy_version 1582451 (0.0008) [2023-12-26 12:13:50,474][123091] Updated weights for policy 0, policy_version 1582461 (0.0010) [2023-12-26 12:13:50,529][123091] Updated weights for policy 0, policy_version 1582471 (0.0010) [2023-12-26 12:13:50,797][123090] Updated weights for policy 1, policy_version 1572041 (0.0010) [2023-12-26 12:13:50,866][123090] Updated weights for policy 1, policy_version 1572051 (0.0011) [2023-12-26 12:13:50,939][123090] Updated weights for policy 1, policy_version 1572061 (0.0010) [2023-12-26 12:13:51,297][123091] Updated weights for policy 0, policy_version 1582481 (0.0010) [2023-12-26 12:13:51,369][123091] Updated weights for policy 0, policy_version 1582491 (0.0011) [2023-12-26 12:13:51,441][123091] Updated weights for policy 0, policy_version 1582501 (0.0011) [2023-12-26 12:13:51,500][123091] Updated weights for policy 0, policy_version 1582511 (0.0011) [2023-12-26 12:13:51,779][123090] Updated weights for policy 1, policy_version 1572071 (0.0009) [2023-12-26 12:13:51,840][123090] Updated weights for policy 1, policy_version 1572081 (0.0009) [2023-12-26 12:13:51,909][123090] Updated weights for policy 1, policy_version 1572091 (0.0009) [2023-12-26 12:13:52,317][123091] Updated weights for policy 0, policy_version 1582521 (0.0008) [2023-12-26 12:13:52,387][123091] Updated weights for policy 0, policy_version 1582531 (0.0009) [2023-12-26 12:13:52,456][123091] Updated weights for policy 0, policy_version 1582541 (0.0005) [2023-12-26 12:13:52,769][123090] Updated weights for policy 1, policy_version 1572101 (0.0010) [2023-12-26 12:13:52,828][123090] Updated weights for policy 1, policy_version 1572111 (0.0008) [2023-12-26 12:13:52,896][123090] Updated weights for policy 1, policy_version 1572121 (0.0009) [2023-12-26 12:13:53,092][123091] Updated weights for policy 0, policy_version 1582551 (0.0009) [2023-12-26 12:13:53,156][123091] Updated weights for policy 0, policy_version 1582561 (0.0009) [2023-12-26 12:13:53,220][123091] Updated weights for policy 0, policy_version 1582571 (0.0009) [2023-12-26 12:13:53,732][123090] Updated weights for policy 1, policy_version 1572131 (0.0008) [2023-12-26 12:13:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 807608320. Throughput: 0: 8820.4, 1: 8881.1. Samples: 807589432. Policy #0 lag: (min: 17.0, avg: 29.7, max: 49.0) [2023-12-26 12:13:53,785][121949] Avg episode reward: [(0, '6029.098'), (1, '5535.941')] [2023-12-26 12:13:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001582576_405143552.pth... [2023-12-26 12:13:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001581520_404873216.pth [2023-12-26 12:13:53,794][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001582576_405143552.pth [2023-12-26 12:13:53,799][123090] Updated weights for policy 1, policy_version 1572141 (0.0010) [2023-12-26 12:13:53,863][123090] Updated weights for policy 1, policy_version 1572151 (0.0010) [2023-12-26 12:13:53,917][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001572160_402472960.pth... [2023-12-26 12:13:53,921][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001571104_402202624.pth [2023-12-26 12:13:53,922][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001572160_402472960.pth [2023-12-26 12:13:54,081][123091] Updated weights for policy 0, policy_version 1582581 (0.0010) [2023-12-26 12:13:54,145][123091] Updated weights for policy 0, policy_version 1582591 (0.0009) [2023-12-26 12:13:54,209][123091] Updated weights for policy 0, policy_version 1582601 (0.0009) [2023-12-26 12:13:54,689][123090] Updated weights for policy 1, policy_version 1572161 (0.0011) [2023-12-26 12:13:54,737][123090] Updated weights for policy 1, policy_version 1572171 (0.0009) [2023-12-26 12:13:54,784][123090] Updated weights for policy 1, policy_version 1572181 (0.0005) [2023-12-26 12:13:54,833][123090] Updated weights for policy 1, policy_version 1572191 (0.0005) [2023-12-26 12:13:54,980][123091] Updated weights for policy 0, policy_version 1582611 (0.0009) [2023-12-26 12:13:55,033][123091] Updated weights for policy 0, policy_version 1582621 (0.0007) [2023-12-26 12:13:55,097][123091] Updated weights for policy 0, policy_version 1582631 (0.0007) [2023-12-26 12:13:55,630][123090] Updated weights for policy 1, policy_version 1572201 (0.0010) [2023-12-26 12:13:55,687][123090] Updated weights for policy 1, policy_version 1572211 (0.0010) [2023-12-26 12:13:55,738][123090] Updated weights for policy 1, policy_version 1572221 (0.0010) [2023-12-26 12:13:55,899][123091] Updated weights for policy 0, policy_version 1582641 (0.0009) [2023-12-26 12:13:55,952][123091] Updated weights for policy 0, policy_version 1582651 (0.0010) [2023-12-26 12:13:56,003][123091] Updated weights for policy 0, policy_version 1582661 (0.0009) [2023-12-26 12:13:56,051][123091] Updated weights for policy 0, policy_version 1582671 (0.0008) [2023-12-26 12:13:56,376][123090] Updated weights for policy 1, policy_version 1572231 (0.0007) [2023-12-26 12:13:56,429][123090] Updated weights for policy 1, policy_version 1572241 (0.0005) [2023-12-26 12:13:56,476][123090] Updated weights for policy 1, policy_version 1572251 (0.0005) [2023-12-26 12:13:57,028][123091] Updated weights for policy 0, policy_version 1582681 (0.0008) [2023-12-26 12:13:57,097][123091] Updated weights for policy 0, policy_version 1582691 (0.0009) [2023-12-26 12:13:57,116][123090] Updated weights for policy 1, policy_version 1572261 (0.0008) [2023-12-26 12:13:57,149][123091] Updated weights for policy 0, policy_version 1582701 (0.0006) [2023-12-26 12:13:57,160][123090] Updated weights for policy 1, policy_version 1572271 (0.0010) [2023-12-26 12:13:57,234][123090] Updated weights for policy 1, policy_version 1572281 (0.0011) [2023-12-26 12:13:57,768][123091] Updated weights for policy 0, policy_version 1582711 (0.0005) [2023-12-26 12:13:57,813][123091] Updated weights for policy 0, policy_version 1582721 (0.0005) [2023-12-26 12:13:57,876][123091] Updated weights for policy 0, policy_version 1582731 (0.0005) [2023-12-26 12:13:57,910][123090] Updated weights for policy 1, policy_version 1572291 (0.0009) [2023-12-26 12:13:57,957][123090] Updated weights for policy 1, policy_version 1572301 (0.0005) [2023-12-26 12:13:58,006][123090] Updated weights for policy 1, policy_version 1572311 (0.0005) [2023-12-26 12:13:58,613][123091] Updated weights for policy 0, policy_version 1582741 (0.0007) [2023-12-26 12:13:58,687][123091] Updated weights for policy 0, policy_version 1582751 (0.0008) [2023-12-26 12:13:58,755][123091] Updated weights for policy 0, policy_version 1582761 (0.0012) [2023-12-26 12:13:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 807698432. Throughput: 0: 8903.5, 1: 8949.5. Samples: 807697264. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:13:58,785][121949] Avg episode reward: [(0, '5897.228'), (1, '5376.986')] [2023-12-26 12:13:58,859][123090] Updated weights for policy 1, policy_version 1572321 (0.0006) [2023-12-26 12:13:58,930][123090] Updated weights for policy 1, policy_version 1572331 (0.0007) [2023-12-26 12:13:59,000][123090] Updated weights for policy 1, policy_version 1572341 (0.0008) [2023-12-26 12:13:59,069][123090] Updated weights for policy 1, policy_version 1572351 (0.0008) [2023-12-26 12:13:59,665][123091] Updated weights for policy 0, policy_version 1582771 (0.0008) [2023-12-26 12:13:59,735][123091] Updated weights for policy 0, policy_version 1582781 (0.0009) [2023-12-26 12:13:59,790][123091] Updated weights for policy 0, policy_version 1582791 (0.0009) [2023-12-26 12:13:59,850][123090] Updated weights for policy 1, policy_version 1572361 (0.0009) [2023-12-26 12:13:59,921][123090] Updated weights for policy 1, policy_version 1572371 (0.0007) [2023-12-26 12:13:59,976][123090] Updated weights for policy 1, policy_version 1572381 (0.0008) [2023-12-26 12:14:00,610][123091] Updated weights for policy 0, policy_version 1582801 (0.0008) [2023-12-26 12:14:00,667][123091] Updated weights for policy 0, policy_version 1582811 (0.0008) [2023-12-26 12:14:00,726][123091] Updated weights for policy 0, policy_version 1582821 (0.0008) [2023-12-26 12:14:00,731][123090] Updated weights for policy 1, policy_version 1572391 (0.0008) [2023-12-26 12:14:00,782][123091] Updated weights for policy 0, policy_version 1582831 (0.0009) [2023-12-26 12:14:00,790][123090] Updated weights for policy 1, policy_version 1572401 (0.0010) [2023-12-26 12:14:00,857][123090] Updated weights for policy 1, policy_version 1572411 (0.0009) [2023-12-26 12:14:01,596][123091] Updated weights for policy 0, policy_version 1582841 (0.0009) [2023-12-26 12:14:01,638][123090] Updated weights for policy 1, policy_version 1572421 (0.0009) [2023-12-26 12:14:01,660][123091] Updated weights for policy 0, policy_version 1582851 (0.0008) [2023-12-26 12:14:01,694][123090] Updated weights for policy 1, policy_version 1572431 (0.0007) [2023-12-26 12:14:01,724][123091] Updated weights for policy 0, policy_version 1582861 (0.0008) [2023-12-26 12:14:01,764][123090] Updated weights for policy 1, policy_version 1572441 (0.0008) [2023-12-26 12:14:02,550][123091] Updated weights for policy 0, policy_version 1582871 (0.0010) [2023-12-26 12:14:02,581][123090] Updated weights for policy 1, policy_version 1572451 (0.0010) [2023-12-26 12:14:02,602][123091] Updated weights for policy 0, policy_version 1582881 (0.0010) [2023-12-26 12:14:02,638][123090] Updated weights for policy 1, policy_version 1572461 (0.0006) [2023-12-26 12:14:02,665][123091] Updated weights for policy 0, policy_version 1582891 (0.0011) [2023-12-26 12:14:02,697][123090] Updated weights for policy 1, policy_version 1572471 (0.0005) [2023-12-26 12:14:03,487][123091] Updated weights for policy 0, policy_version 1582901 (0.0008) [2023-12-26 12:14:03,510][123090] Updated weights for policy 1, policy_version 1572481 (0.0008) [2023-12-26 12:14:03,544][123091] Updated weights for policy 0, policy_version 1582911 (0.0005) [2023-12-26 12:14:03,560][123090] Updated weights for policy 1, policy_version 1572491 (0.0005) [2023-12-26 12:14:03,594][123091] Updated weights for policy 0, policy_version 1582921 (0.0005) [2023-12-26 12:14:03,612][123090] Updated weights for policy 1, policy_version 1572501 (0.0005) [2023-12-26 12:14:03,671][123090] Updated weights for policy 1, policy_version 1572511 (0.0005) [2023-12-26 12:14:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 807796736. Throughput: 0: 8883.7, 1: 8918.7. Samples: 807802484. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:03,785][121949] Avg episode reward: [(0, '5920.147'), (1, '5359.951')] [2023-12-26 12:14:04,408][123090] Updated weights for policy 1, policy_version 1572521 (0.0010) [2023-12-26 12:14:04,468][123090] Updated weights for policy 1, policy_version 1572531 (0.0011) [2023-12-26 12:14:04,484][123091] Updated weights for policy 0, policy_version 1582931 (0.0007) [2023-12-26 12:14:04,534][123091] Updated weights for policy 0, policy_version 1582941 (0.0010) [2023-12-26 12:14:04,539][123090] Updated weights for policy 1, policy_version 1572541 (0.0007) [2023-12-26 12:14:04,590][123091] Updated weights for policy 0, policy_version 1582951 (0.0006) [2023-12-26 12:14:05,192][123090] Updated weights for policy 1, policy_version 1572551 (0.0007) [2023-12-26 12:14:05,257][123090] Updated weights for policy 1, policy_version 1572561 (0.0010) [2023-12-26 12:14:05,279][123091] Updated weights for policy 0, policy_version 1582961 (0.0006) [2023-12-26 12:14:05,320][123090] Updated weights for policy 1, policy_version 1572571 (0.0010) [2023-12-26 12:14:05,339][123091] Updated weights for policy 0, policy_version 1582971 (0.0005) [2023-12-26 12:14:05,387][123091] Updated weights for policy 0, policy_version 1582981 (0.0007) [2023-12-26 12:14:05,440][123091] Updated weights for policy 0, policy_version 1582991 (0.0005) [2023-12-26 12:14:06,051][123090] Updated weights for policy 1, policy_version 1572581 (0.0008) [2023-12-26 12:14:06,107][123091] Updated weights for policy 0, policy_version 1583001 (0.0009) [2023-12-26 12:14:06,120][123090] Updated weights for policy 1, policy_version 1572591 (0.0008) [2023-12-26 12:14:06,175][123091] Updated weights for policy 0, policy_version 1583011 (0.0007) [2023-12-26 12:14:06,193][123090] Updated weights for policy 1, policy_version 1572601 (0.0007) [2023-12-26 12:14:06,240][123091] Updated weights for policy 0, policy_version 1583021 (0.0010) [2023-12-26 12:14:06,926][123091] Updated weights for policy 0, policy_version 1583031 (0.0008) [2023-12-26 12:14:06,953][123090] Updated weights for policy 1, policy_version 1572611 (0.0007) [2023-12-26 12:14:06,986][123091] Updated weights for policy 0, policy_version 1583041 (0.0010) [2023-12-26 12:14:07,013][123090] Updated weights for policy 1, policy_version 1572621 (0.0011) [2023-12-26 12:14:07,045][123091] Updated weights for policy 0, policy_version 1583051 (0.0011) [2023-12-26 12:14:07,076][123090] Updated weights for policy 1, policy_version 1572631 (0.0011) [2023-12-26 12:14:07,776][123091] Updated weights for policy 0, policy_version 1583061 (0.0008) [2023-12-26 12:14:07,827][123091] Updated weights for policy 0, policy_version 1583071 (0.0005) [2023-12-26 12:14:07,829][123090] Updated weights for policy 1, policy_version 1572641 (0.0010) [2023-12-26 12:14:07,885][123090] Updated weights for policy 1, policy_version 1572651 (0.0010) [2023-12-26 12:14:07,892][123091] Updated weights for policy 0, policy_version 1583081 (0.0005) [2023-12-26 12:14:07,931][123090] Updated weights for policy 1, policy_version 1572661 (0.0006) [2023-12-26 12:14:07,981][123090] Updated weights for policy 1, policy_version 1572671 (0.0005) [2023-12-26 12:14:08,690][123091] Updated weights for policy 0, policy_version 1583091 (0.0006) [2023-12-26 12:14:08,723][123090] Updated weights for policy 1, policy_version 1572681 (0.0005) [2023-12-26 12:14:08,757][123091] Updated weights for policy 0, policy_version 1583101 (0.0009) [2023-12-26 12:14:08,778][123090] Updated weights for policy 1, policy_version 1572691 (0.0005) [2023-12-26 12:14:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 807878656. Throughput: 0: 8980.3, 1: 8976.7. Samples: 807860564. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:08,785][121949] Avg episode reward: [(0, '6105.459'), (1, '5529.041')] [2023-12-26 12:14:08,809][123091] Updated weights for policy 0, policy_version 1583111 (0.0008) [2023-12-26 12:14:08,833][123090] Updated weights for policy 1, policy_version 1572702 (0.0007) [2023-12-26 12:14:08,841][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001572704_402612224.pth... [2023-12-26 12:14:08,846][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001571648_402341888.pth [2023-12-26 12:14:08,861][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001583120_405282816.pth... [2023-12-26 12:14:08,866][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001582064_405012480.pth [2023-12-26 12:14:09,571][123090] Updated weights for policy 1, policy_version 1572712 (0.0009) [2023-12-26 12:14:09,637][123090] Updated weights for policy 1, policy_version 1572722 (0.0009) [2023-12-26 12:14:09,703][123090] Updated weights for policy 1, policy_version 1572732 (0.0009) [2023-12-26 12:14:09,717][123091] Updated weights for policy 0, policy_version 1583122 (0.0008) [2023-12-26 12:14:09,784][123091] Updated weights for policy 0, policy_version 1583132 (0.0010) [2023-12-26 12:14:09,855][123091] Updated weights for policy 0, policy_version 1583142 (0.0010) [2023-12-26 12:14:09,922][123091] Updated weights for policy 0, policy_version 1583152 (0.0010) [2023-12-26 12:14:10,538][123090] Updated weights for policy 1, policy_version 1572742 (0.0009) [2023-12-26 12:14:10,592][123090] Updated weights for policy 1, policy_version 1572752 (0.0009) [2023-12-26 12:14:10,648][123090] Updated weights for policy 1, policy_version 1572762 (0.0009) [2023-12-26 12:14:10,756][123091] Updated weights for policy 0, policy_version 1583162 (0.0010) [2023-12-26 12:14:10,817][123091] Updated weights for policy 0, policy_version 1583172 (0.0009) [2023-12-26 12:14:10,871][123091] Updated weights for policy 0, policy_version 1583182 (0.0009) [2023-12-26 12:14:11,547][123090] Updated weights for policy 1, policy_version 1572772 (0.0009) [2023-12-26 12:14:11,612][123090] Updated weights for policy 1, policy_version 1572782 (0.0010) [2023-12-26 12:14:11,685][123090] Updated weights for policy 1, policy_version 1572792 (0.0008) [2023-12-26 12:14:11,704][123091] Updated weights for policy 0, policy_version 1583192 (0.0007) [2023-12-26 12:14:11,769][123091] Updated weights for policy 0, policy_version 1583202 (0.0007) [2023-12-26 12:14:11,827][123091] Updated weights for policy 0, policy_version 1583212 (0.0005) [2023-12-26 12:14:12,556][123090] Updated weights for policy 1, policy_version 1572802 (0.0008) [2023-12-26 12:14:12,609][123091] Updated weights for policy 0, policy_version 1583222 (0.0006) [2023-12-26 12:14:12,617][123090] Updated weights for policy 1, policy_version 1572812 (0.0009) [2023-12-26 12:14:12,670][123091] Updated weights for policy 0, policy_version 1583232 (0.0008) [2023-12-26 12:14:12,686][123090] Updated weights for policy 1, policy_version 1572822 (0.0009) [2023-12-26 12:14:12,728][123091] Updated weights for policy 0, policy_version 1583242 (0.0010) [2023-12-26 12:14:12,749][123090] Updated weights for policy 1, policy_version 1572832 (0.0008) [2023-12-26 12:14:13,555][123091] Updated weights for policy 0, policy_version 1583252 (0.0008) [2023-12-26 12:14:13,562][123090] Updated weights for policy 1, policy_version 1572842 (0.0005) [2023-12-26 12:14:13,609][123091] Updated weights for policy 0, policy_version 1583262 (0.0008) [2023-12-26 12:14:13,621][123090] Updated weights for policy 1, policy_version 1572852 (0.0007) [2023-12-26 12:14:13,669][123091] Updated weights for policy 0, policy_version 1583272 (0.0009) [2023-12-26 12:14:13,680][123090] Updated weights for policy 1, policy_version 1572862 (0.0008) [2023-12-26 12:14:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 807976960. Throughput: 0: 8959.1, 1: 8900.8. Samples: 807965388. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:13,785][121949] Avg episode reward: [(0, '5935.656'), (1, '5668.078')] [2023-12-26 12:14:14,466][123091] Updated weights for policy 0, policy_version 1583282 (0.0009) [2023-12-26 12:14:14,505][123090] Updated weights for policy 1, policy_version 1572872 (0.0008) [2023-12-26 12:14:14,524][123091] Updated weights for policy 0, policy_version 1583292 (0.0006) [2023-12-26 12:14:14,558][123090] Updated weights for policy 1, policy_version 1572882 (0.0008) [2023-12-26 12:14:14,577][123091] Updated weights for policy 0, policy_version 1583302 (0.0005) [2023-12-26 12:14:14,608][123090] Updated weights for policy 1, policy_version 1572892 (0.0009) [2023-12-26 12:14:14,635][123091] Updated weights for policy 0, policy_version 1583312 (0.0006) [2023-12-26 12:14:15,408][123091] Updated weights for policy 0, policy_version 1583322 (0.0010) [2023-12-26 12:14:15,454][123090] Updated weights for policy 1, policy_version 1572902 (0.0008) [2023-12-26 12:14:15,460][123091] Updated weights for policy 0, policy_version 1583332 (0.0010) [2023-12-26 12:14:15,510][123090] Updated weights for policy 1, policy_version 1572912 (0.0006) [2023-12-26 12:14:15,512][123091] Updated weights for policy 0, policy_version 1583342 (0.0010) [2023-12-26 12:14:15,573][123090] Updated weights for policy 1, policy_version 1572922 (0.0008) [2023-12-26 12:14:16,312][123091] Updated weights for policy 0, policy_version 1583352 (0.0010) [2023-12-26 12:14:16,374][123091] Updated weights for policy 0, policy_version 1583362 (0.0010) [2023-12-26 12:14:16,420][123090] Updated weights for policy 1, policy_version 1572932 (0.0009) [2023-12-26 12:14:16,434][123091] Updated weights for policy 0, policy_version 1583372 (0.0011) [2023-12-26 12:14:16,480][123090] Updated weights for policy 1, policy_version 1572942 (0.0007) [2023-12-26 12:14:16,542][123090] Updated weights for policy 1, policy_version 1572952 (0.0009) [2023-12-26 12:14:17,213][123091] Updated weights for policy 0, policy_version 1583382 (0.0007) [2023-12-26 12:14:17,263][123091] Updated weights for policy 0, policy_version 1583392 (0.0005) [2023-12-26 12:14:17,317][123091] Updated weights for policy 0, policy_version 1583402 (0.0005) [2023-12-26 12:14:17,329][123090] Updated weights for policy 1, policy_version 1572962 (0.0008) [2023-12-26 12:14:17,406][123090] Updated weights for policy 1, policy_version 1572972 (0.0009) [2023-12-26 12:14:17,468][123090] Updated weights for policy 1, policy_version 1572982 (0.0009) [2023-12-26 12:14:18,023][123091] Updated weights for policy 0, policy_version 1583412 (0.0005) [2023-12-26 12:14:18,078][123091] Updated weights for policy 0, policy_version 1583422 (0.0005) [2023-12-26 12:14:18,138][123091] Updated weights for policy 0, policy_version 1583432 (0.0008) [2023-12-26 12:14:18,251][123090] Updated weights for policy 1, policy_version 1572993 (0.0010) [2023-12-26 12:14:18,310][123090] Updated weights for policy 1, policy_version 1573003 (0.0005) [2023-12-26 12:14:18,395][123090] Updated weights for policy 1, policy_version 1573013 (0.0007) [2023-12-26 12:14:18,455][123090] Updated weights for policy 1, policy_version 1573023 (0.0008) [2023-12-26 12:14:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 808058880. Throughput: 0: 8981.6, 1: 8844.4. Samples: 808071612. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:18,785][121949] Avg episode reward: [(0, '5932.938'), (1, '5646.341')] [2023-12-26 12:14:18,939][123091] Updated weights for policy 0, policy_version 1583442 (0.0010) [2023-12-26 12:14:18,999][123091] Updated weights for policy 0, policy_version 1583452 (0.0011) [2023-12-26 12:14:19,061][123091] Updated weights for policy 0, policy_version 1583462 (0.0010) [2023-12-26 12:14:19,120][123091] Updated weights for policy 0, policy_version 1583472 (0.0010) [2023-12-26 12:14:19,265][123090] Updated weights for policy 1, policy_version 1573033 (0.0009) [2023-12-26 12:14:19,326][123090] Updated weights for policy 1, policy_version 1573043 (0.0009) [2023-12-26 12:14:19,397][123090] Updated weights for policy 1, policy_version 1573053 (0.0008) [2023-12-26 12:14:19,977][123091] Updated weights for policy 0, policy_version 1583482 (0.0010) [2023-12-26 12:14:20,037][123091] Updated weights for policy 0, policy_version 1583492 (0.0010) [2023-12-26 12:14:20,101][123091] Updated weights for policy 0, policy_version 1583502 (0.0010) [2023-12-26 12:14:20,230][123090] Updated weights for policy 1, policy_version 1573063 (0.0009) [2023-12-26 12:14:20,300][123090] Updated weights for policy 1, policy_version 1573073 (0.0008) [2023-12-26 12:14:20,374][123090] Updated weights for policy 1, policy_version 1573083 (0.0007) [2023-12-26 12:14:20,956][123091] Updated weights for policy 0, policy_version 1583512 (0.0010) [2023-12-26 12:14:21,004][123091] Updated weights for policy 0, policy_version 1583522 (0.0010) [2023-12-26 12:14:21,069][123091] Updated weights for policy 0, policy_version 1583532 (0.0010) [2023-12-26 12:14:21,193][123090] Updated weights for policy 1, policy_version 1573093 (0.0009) [2023-12-26 12:14:21,250][123090] Updated weights for policy 1, policy_version 1573103 (0.0009) [2023-12-26 12:14:21,305][123090] Updated weights for policy 1, policy_version 1573113 (0.0009) [2023-12-26 12:14:21,932][123091] Updated weights for policy 0, policy_version 1583542 (0.0008) [2023-12-26 12:14:21,984][123091] Updated weights for policy 0, policy_version 1583552 (0.0007) [2023-12-26 12:14:22,037][123091] Updated weights for policy 0, policy_version 1583562 (0.0009) [2023-12-26 12:14:22,191][123090] Updated weights for policy 1, policy_version 1573123 (0.0009) [2023-12-26 12:14:22,254][123090] Updated weights for policy 1, policy_version 1573133 (0.0009) [2023-12-26 12:14:22,328][123090] Updated weights for policy 1, policy_version 1573143 (0.0010) [2023-12-26 12:14:22,803][123091] Updated weights for policy 0, policy_version 1583572 (0.0009) [2023-12-26 12:14:22,860][123091] Updated weights for policy 0, policy_version 1583582 (0.0006) [2023-12-26 12:14:22,917][123091] Updated weights for policy 0, policy_version 1583592 (0.0007) [2023-12-26 12:14:23,257][123090] Updated weights for policy 1, policy_version 1573153 (0.0010) [2023-12-26 12:14:23,309][123090] Updated weights for policy 1, policy_version 1573163 (0.0010) [2023-12-26 12:14:23,374][123090] Updated weights for policy 1, policy_version 1573173 (0.0010) [2023-12-26 12:14:23,423][123090] Updated weights for policy 1, policy_version 1573183 (0.0010) [2023-12-26 12:14:23,670][123091] Updated weights for policy 0, policy_version 1583602 (0.0008) [2023-12-26 12:14:23,724][123091] Updated weights for policy 0, policy_version 1583612 (0.0010) [2023-12-26 12:14:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 808140800. Throughput: 0: 8865.5, 1: 8784.5. Samples: 808121560. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:23,785][121949] Avg episode reward: [(0, '6150.116'), (1, '5543.748')] [2023-12-26 12:14:23,790][123091] Updated weights for policy 0, policy_version 1583622 (0.0010) [2023-12-26 12:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001573184_402735104.pth... [2023-12-26 12:14:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001572160_402472960.pth [2023-12-26 12:14:23,854][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001583632_405413888.pth... [2023-12-26 12:14:23,855][123091] Updated weights for policy 0, policy_version 1583632 (0.0009) [2023-12-26 12:14:23,859][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001582576_405143552.pth [2023-12-26 12:14:24,281][123090] Updated weights for policy 1, policy_version 1573193 (0.0009) [2023-12-26 12:14:24,347][123090] Updated weights for policy 1, policy_version 1573203 (0.0009) [2023-12-26 12:14:24,419][123090] Updated weights for policy 1, policy_version 1573213 (0.0009) [2023-12-26 12:14:24,672][123091] Updated weights for policy 0, policy_version 1583642 (0.0010) [2023-12-26 12:14:24,735][123091] Updated weights for policy 0, policy_version 1583652 (0.0010) [2023-12-26 12:14:24,781][123091] Updated weights for policy 0, policy_version 1583662 (0.0009) [2023-12-26 12:14:25,244][123090] Updated weights for policy 1, policy_version 1573223 (0.0007) [2023-12-26 12:14:25,305][123090] Updated weights for policy 1, policy_version 1573233 (0.0006) [2023-12-26 12:14:25,373][123090] Updated weights for policy 1, policy_version 1573243 (0.0009) [2023-12-26 12:14:25,632][123091] Updated weights for policy 0, policy_version 1583672 (0.0010) [2023-12-26 12:14:25,698][123091] Updated weights for policy 0, policy_version 1583682 (0.0010) [2023-12-26 12:14:25,751][123091] Updated weights for policy 0, policy_version 1583692 (0.0009) [2023-12-26 12:14:26,180][123090] Updated weights for policy 1, policy_version 1573253 (0.0010) [2023-12-26 12:14:26,232][123090] Updated weights for policy 1, policy_version 1573263 (0.0009) [2023-12-26 12:14:26,293][123090] Updated weights for policy 1, policy_version 1573273 (0.0009) [2023-12-26 12:14:26,540][123091] Updated weights for policy 0, policy_version 1583702 (0.0010) [2023-12-26 12:14:26,587][123091] Updated weights for policy 0, policy_version 1583712 (0.0009) [2023-12-26 12:14:26,634][123091] Updated weights for policy 0, policy_version 1583722 (0.0009) [2023-12-26 12:14:27,103][123090] Updated weights for policy 1, policy_version 1573283 (0.0010) [2023-12-26 12:14:27,167][123090] Updated weights for policy 1, policy_version 1573293 (0.0008) [2023-12-26 12:14:27,224][123090] Updated weights for policy 1, policy_version 1573303 (0.0009) [2023-12-26 12:14:27,487][123091] Updated weights for policy 0, policy_version 1583732 (0.0009) [2023-12-26 12:14:27,537][123091] Updated weights for policy 0, policy_version 1583742 (0.0009) [2023-12-26 12:14:27,597][123091] Updated weights for policy 0, policy_version 1583752 (0.0008) [2023-12-26 12:14:27,982][123090] Updated weights for policy 1, policy_version 1573313 (0.0009) [2023-12-26 12:14:28,035][123090] Updated weights for policy 1, policy_version 1573323 (0.0009) [2023-12-26 12:14:28,093][123090] Updated weights for policy 1, policy_version 1573333 (0.0006) [2023-12-26 12:14:28,145][123090] Updated weights for policy 1, policy_version 1573343 (0.0005) [2023-12-26 12:14:28,449][123091] Updated weights for policy 0, policy_version 1583762 (0.0009) [2023-12-26 12:14:28,496][123091] Updated weights for policy 0, policy_version 1583772 (0.0005) [2023-12-26 12:14:28,568][123091] Updated weights for policy 0, policy_version 1583782 (0.0005) [2023-12-26 12:14:28,622][123091] Updated weights for policy 0, policy_version 1583792 (0.0008) [2023-12-26 12:14:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 808230912. Throughput: 0: 8901.8, 1: 8804.2. Samples: 808225112. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:28,785][121949] Avg episode reward: [(0, '6118.433'), (1, '5542.000')] [2023-12-26 12:14:28,948][123090] Updated weights for policy 1, policy_version 1573353 (0.0009) [2023-12-26 12:14:28,995][123090] Updated weights for policy 1, policy_version 1573363 (0.0009) [2023-12-26 12:14:29,047][123090] Updated weights for policy 1, policy_version 1573373 (0.0009) [2023-12-26 12:14:29,429][123091] Updated weights for policy 0, policy_version 1583802 (0.0009) [2023-12-26 12:14:29,483][123091] Updated weights for policy 0, policy_version 1583812 (0.0008) [2023-12-26 12:14:29,533][123091] Updated weights for policy 0, policy_version 1583822 (0.0009) [2023-12-26 12:14:29,902][123090] Updated weights for policy 1, policy_version 1573383 (0.0009) [2023-12-26 12:14:29,964][123090] Updated weights for policy 1, policy_version 1573393 (0.0008) [2023-12-26 12:14:30,021][123090] Updated weights for policy 1, policy_version 1573403 (0.0006) [2023-12-26 12:14:30,431][123091] Updated weights for policy 0, policy_version 1583832 (0.0010) [2023-12-26 12:14:30,490][123091] Updated weights for policy 0, policy_version 1583842 (0.0009) [2023-12-26 12:14:30,547][123091] Updated weights for policy 0, policy_version 1583853 (0.0010) [2023-12-26 12:14:30,816][123090] Updated weights for policy 1, policy_version 1573413 (0.0008) [2023-12-26 12:14:30,868][123090] Updated weights for policy 1, policy_version 1573423 (0.0009) [2023-12-26 12:14:30,923][123090] Updated weights for policy 1, policy_version 1573433 (0.0005) [2023-12-26 12:14:31,306][123091] Updated weights for policy 0, policy_version 1583863 (0.0008) [2023-12-26 12:14:31,380][123091] Updated weights for policy 0, policy_version 1583873 (0.0008) [2023-12-26 12:14:31,428][123091] Updated weights for policy 0, policy_version 1583883 (0.0008) [2023-12-26 12:14:31,791][123090] Updated weights for policy 1, policy_version 1573443 (0.0008) [2023-12-26 12:14:31,850][123090] Updated weights for policy 1, policy_version 1573453 (0.0010) [2023-12-26 12:14:31,917][123090] Updated weights for policy 1, policy_version 1573463 (0.0009) [2023-12-26 12:14:32,229][123091] Updated weights for policy 0, policy_version 1583893 (0.0009) [2023-12-26 12:14:32,291][123091] Updated weights for policy 0, policy_version 1583903 (0.0009) [2023-12-26 12:14:32,349][123091] Updated weights for policy 0, policy_version 1583913 (0.0009) [2023-12-26 12:14:32,751][123090] Updated weights for policy 1, policy_version 1573473 (0.0009) [2023-12-26 12:14:32,818][123090] Updated weights for policy 1, policy_version 1573483 (0.0010) [2023-12-26 12:14:32,867][123090] Updated weights for policy 1, policy_version 1573493 (0.0009) [2023-12-26 12:14:32,915][123090] Updated weights for policy 1, policy_version 1573503 (0.0009) [2023-12-26 12:14:33,163][123091] Updated weights for policy 0, policy_version 1583923 (0.0010) [2023-12-26 12:14:33,217][123091] Updated weights for policy 0, policy_version 1583933 (0.0009) [2023-12-26 12:14:33,268][123091] Updated weights for policy 0, policy_version 1583943 (0.0009) [2023-12-26 12:14:33,752][123090] Updated weights for policy 1, policy_version 1573513 (0.0005) [2023-12-26 12:14:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 808312832. Throughput: 0: 8842.6, 1: 8772.1. Samples: 808329052. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:33,785][121949] Avg episode reward: [(0, '6125.396'), (1, '5399.775')] [2023-12-26 12:14:33,821][123090] Updated weights for policy 1, policy_version 1573523 (0.0006) [2023-12-26 12:14:33,884][123090] Updated weights for policy 1, policy_version 1573533 (0.0005) [2023-12-26 12:14:34,108][123091] Updated weights for policy 0, policy_version 1583953 (0.0009) [2023-12-26 12:14:34,173][123091] Updated weights for policy 0, policy_version 1583963 (0.0008) [2023-12-26 12:14:34,219][123091] Updated weights for policy 0, policy_version 1583973 (0.0006) [2023-12-26 12:14:34,266][123091] Updated weights for policy 0, policy_version 1583983 (0.0006) [2023-12-26 12:14:34,597][123090] Updated weights for policy 1, policy_version 1573543 (0.0007) [2023-12-26 12:14:34,662][123090] Updated weights for policy 1, policy_version 1573553 (0.0005) [2023-12-26 12:14:34,734][123090] Updated weights for policy 1, policy_version 1573563 (0.0006) [2023-12-26 12:14:35,066][123091] Updated weights for policy 0, policy_version 1583993 (0.0006) [2023-12-26 12:14:35,126][123091] Updated weights for policy 0, policy_version 1584003 (0.0009) [2023-12-26 12:14:35,184][123091] Updated weights for policy 0, policy_version 1584013 (0.0010) [2023-12-26 12:14:35,329][123090] Updated weights for policy 1, policy_version 1573573 (0.0005) [2023-12-26 12:14:35,394][123090] Updated weights for policy 1, policy_version 1573583 (0.0005) [2023-12-26 12:14:35,444][123090] Updated weights for policy 1, policy_version 1573593 (0.0005) [2023-12-26 12:14:35,932][123091] Updated weights for policy 0, policy_version 1584023 (0.0010) [2023-12-26 12:14:35,994][123091] Updated weights for policy 0, policy_version 1584033 (0.0010) [2023-12-26 12:14:36,060][123091] Updated weights for policy 0, policy_version 1584043 (0.0009) [2023-12-26 12:14:36,193][123090] Updated weights for policy 1, policy_version 1573603 (0.0006) [2023-12-26 12:14:36,267][123090] Updated weights for policy 1, policy_version 1573613 (0.0006) [2023-12-26 12:14:36,347][123090] Updated weights for policy 1, policy_version 1573623 (0.0006) [2023-12-26 12:14:36,782][123091] Updated weights for policy 0, policy_version 1584053 (0.0007) [2023-12-26 12:14:36,843][123091] Updated weights for policy 0, policy_version 1584063 (0.0006) [2023-12-26 12:14:36,913][123091] Updated weights for policy 0, policy_version 1584073 (0.0011) [2023-12-26 12:14:37,037][123090] Updated weights for policy 1, policy_version 1573633 (0.0006) [2023-12-26 12:14:37,090][123090] Updated weights for policy 1, policy_version 1573643 (0.0008) [2023-12-26 12:14:37,152][123090] Updated weights for policy 1, policy_version 1573653 (0.0005) [2023-12-26 12:14:37,202][123090] Updated weights for policy 1, policy_version 1573663 (0.0005) [2023-12-26 12:14:37,619][123091] Updated weights for policy 0, policy_version 1584083 (0.0009) [2023-12-26 12:14:37,671][123091] Updated weights for policy 0, policy_version 1584093 (0.0006) [2023-12-26 12:14:37,739][123091] Updated weights for policy 0, policy_version 1584103 (0.0006) [2023-12-26 12:14:37,886][123090] Updated weights for policy 1, policy_version 1573673 (0.0010) [2023-12-26 12:14:37,948][123090] Updated weights for policy 1, policy_version 1573683 (0.0010) [2023-12-26 12:14:38,003][123090] Updated weights for policy 1, policy_version 1573693 (0.0010) [2023-12-26 12:14:38,465][123091] Updated weights for policy 0, policy_version 1584113 (0.0006) [2023-12-26 12:14:38,517][123091] Updated weights for policy 0, policy_version 1584123 (0.0011) [2023-12-26 12:14:38,583][123091] Updated weights for policy 0, policy_version 1584133 (0.0010) [2023-12-26 12:14:38,642][123091] Updated weights for policy 0, policy_version 1584143 (0.0011) [2023-12-26 12:14:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 808411136. Throughput: 0: 8840.6, 1: 8854.9. Samples: 808385728. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:38,785][121949] Avg episode reward: [(0, '6084.404'), (1, '5503.929')] [2023-12-26 12:14:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001584144_405544960.pth... [2023-12-26 12:14:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001583120_405282816.pth [2023-12-26 12:14:38,805][123090] Updated weights for policy 1, policy_version 1573703 (0.0011) [2023-12-26 12:14:38,868][123090] Updated weights for policy 1, policy_version 1573713 (0.0011) [2023-12-26 12:14:38,932][123090] Updated weights for policy 1, policy_version 1573723 (0.0011) [2023-12-26 12:14:38,963][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001573728_402874368.pth... [2023-12-26 12:14:38,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001572704_402612224.pth [2023-12-26 12:14:39,466][123091] Updated weights for policy 0, policy_version 1584153 (0.0008) [2023-12-26 12:14:39,518][123091] Updated weights for policy 0, policy_version 1584163 (0.0008) [2023-12-26 12:14:39,577][123091] Updated weights for policy 0, policy_version 1584173 (0.0008) [2023-12-26 12:14:39,743][123090] Updated weights for policy 1, policy_version 1573733 (0.0008) [2023-12-26 12:14:39,812][123090] Updated weights for policy 1, policy_version 1573743 (0.0006) [2023-12-26 12:14:39,881][123090] Updated weights for policy 1, policy_version 1573753 (0.0011) [2023-12-26 12:14:40,427][123091] Updated weights for policy 0, policy_version 1584183 (0.0010) [2023-12-26 12:14:40,476][123091] Updated weights for policy 0, policy_version 1584193 (0.0010) [2023-12-26 12:14:40,536][123091] Updated weights for policy 0, policy_version 1584203 (0.0011) [2023-12-26 12:14:40,737][123090] Updated weights for policy 1, policy_version 1573763 (0.0010) [2023-12-26 12:14:40,790][123090] Updated weights for policy 1, policy_version 1573773 (0.0009) [2023-12-26 12:14:40,843][123090] Updated weights for policy 1, policy_version 1573783 (0.0009) [2023-12-26 12:14:41,401][123091] Updated weights for policy 0, policy_version 1584213 (0.0010) [2023-12-26 12:14:41,477][123091] Updated weights for policy 0, policy_version 1584223 (0.0011) [2023-12-26 12:14:41,552][123091] Updated weights for policy 0, policy_version 1584233 (0.0011) [2023-12-26 12:14:41,675][123090] Updated weights for policy 1, policy_version 1573793 (0.0009) [2023-12-26 12:14:41,740][123090] Updated weights for policy 1, policy_version 1573803 (0.0010) [2023-12-26 12:14:41,813][123090] Updated weights for policy 1, policy_version 1573813 (0.0008) [2023-12-26 12:14:41,870][123090] Updated weights for policy 1, policy_version 1573823 (0.0008) [2023-12-26 12:14:42,357][123091] Updated weights for policy 0, policy_version 1584243 (0.0011) [2023-12-26 12:14:42,431][123091] Updated weights for policy 0, policy_version 1584253 (0.0008) [2023-12-26 12:14:42,495][123091] Updated weights for policy 0, policy_version 1584263 (0.0010) [2023-12-26 12:14:42,644][123090] Updated weights for policy 1, policy_version 1573833 (0.0010) [2023-12-26 12:14:42,710][123090] Updated weights for policy 1, policy_version 1573843 (0.0009) [2023-12-26 12:14:42,779][123090] Updated weights for policy 1, policy_version 1573853 (0.0009) [2023-12-26 12:14:43,193][123091] Updated weights for policy 0, policy_version 1584273 (0.0008) [2023-12-26 12:14:43,259][123091] Updated weights for policy 0, policy_version 1584283 (0.0005) [2023-12-26 12:14:43,330][123091] Updated weights for policy 0, policy_version 1584293 (0.0006) [2023-12-26 12:14:43,394][123091] Updated weights for policy 0, policy_version 1584303 (0.0007) [2023-12-26 12:14:43,580][123090] Updated weights for policy 1, policy_version 1573863 (0.0006) [2023-12-26 12:14:43,637][123090] Updated weights for policy 1, policy_version 1573873 (0.0005) [2023-12-26 12:14:43,687][123090] Updated weights for policy 1, policy_version 1573883 (0.0006) [2023-12-26 12:14:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 808501248. Throughput: 0: 8825.1, 1: 8824.3. Samples: 808491492. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:43,785][121949] Avg episode reward: [(0, '6066.675'), (1, '5722.049')] [2023-12-26 12:14:44,010][123091] Updated weights for policy 0, policy_version 1584313 (0.0005) [2023-12-26 12:14:44,061][123091] Updated weights for policy 0, policy_version 1584323 (0.0005) [2023-12-26 12:14:44,117][123091] Updated weights for policy 0, policy_version 1584333 (0.0005) [2023-12-26 12:14:44,404][123090] Updated weights for policy 1, policy_version 1573893 (0.0008) [2023-12-26 12:14:44,466][123090] Updated weights for policy 1, policy_version 1573903 (0.0010) [2023-12-26 12:14:44,523][123090] Updated weights for policy 1, policy_version 1573913 (0.0010) [2023-12-26 12:14:44,856][123091] Updated weights for policy 0, policy_version 1584343 (0.0008) [2023-12-26 12:14:44,920][123091] Updated weights for policy 0, policy_version 1584353 (0.0009) [2023-12-26 12:14:44,984][123091] Updated weights for policy 0, policy_version 1584363 (0.0010) [2023-12-26 12:14:45,311][123090] Updated weights for policy 1, policy_version 1573923 (0.0009) [2023-12-26 12:14:45,374][123090] Updated weights for policy 1, policy_version 1573933 (0.0005) [2023-12-26 12:14:45,436][123090] Updated weights for policy 1, policy_version 1573943 (0.0006) [2023-12-26 12:14:45,747][123091] Updated weights for policy 0, policy_version 1584373 (0.0008) [2023-12-26 12:14:45,803][123091] Updated weights for policy 0, policy_version 1584383 (0.0005) [2023-12-26 12:14:45,862][123091] Updated weights for policy 0, policy_version 1584393 (0.0007) [2023-12-26 12:14:46,139][123090] Updated weights for policy 1, policy_version 1573953 (0.0006) [2023-12-26 12:14:46,200][123090] Updated weights for policy 1, policy_version 1573963 (0.0009) [2023-12-26 12:14:46,269][123090] Updated weights for policy 1, policy_version 1573973 (0.0010) [2023-12-26 12:14:46,331][123090] Updated weights for policy 1, policy_version 1573983 (0.0010) [2023-12-26 12:14:46,577][123091] Updated weights for policy 0, policy_version 1584403 (0.0010) [2023-12-26 12:14:46,634][123091] Updated weights for policy 0, policy_version 1584413 (0.0009) [2023-12-26 12:14:46,694][123091] Updated weights for policy 0, policy_version 1584423 (0.0008) [2023-12-26 12:14:47,109][123090] Updated weights for policy 1, policy_version 1573993 (0.0006) [2023-12-26 12:14:47,166][123090] Updated weights for policy 1, policy_version 1574003 (0.0005) [2023-12-26 12:14:47,221][123090] Updated weights for policy 1, policy_version 1574013 (0.0005) [2023-12-26 12:14:47,477][123091] Updated weights for policy 0, policy_version 1584433 (0.0006) [2023-12-26 12:14:47,549][123091] Updated weights for policy 0, policy_version 1584443 (0.0008) [2023-12-26 12:14:47,612][123091] Updated weights for policy 0, policy_version 1584453 (0.0009) [2023-12-26 12:14:47,672][123091] Updated weights for policy 0, policy_version 1584463 (0.0008) [2023-12-26 12:14:48,064][123090] Updated weights for policy 1, policy_version 1574023 (0.0008) [2023-12-26 12:14:48,124][123090] Updated weights for policy 1, policy_version 1574033 (0.0009) [2023-12-26 12:14:48,178][123090] Updated weights for policy 1, policy_version 1574043 (0.0009) [2023-12-26 12:14:48,414][123091] Updated weights for policy 0, policy_version 1584473 (0.0009) [2023-12-26 12:14:48,462][123091] Updated weights for policy 0, policy_version 1584483 (0.0008) [2023-12-26 12:14:48,515][123091] Updated weights for policy 0, policy_version 1584493 (0.0010) [2023-12-26 12:14:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 808591360. Throughput: 0: 8927.3, 1: 8837.0. Samples: 808601876. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:48,785][121949] Avg episode reward: [(0, '6234.780'), (1, '5565.458')] [2023-12-26 12:14:49,022][123090] Updated weights for policy 1, policy_version 1574054 (0.0010) [2023-12-26 12:14:49,087][123090] Updated weights for policy 1, policy_version 1574064 (0.0009) [2023-12-26 12:14:49,144][123090] Updated weights for policy 1, policy_version 1574074 (0.0009) [2023-12-26 12:14:49,378][123091] Updated weights for policy 0, policy_version 1584503 (0.0009) [2023-12-26 12:14:49,450][123091] Updated weights for policy 0, policy_version 1584513 (0.0005) [2023-12-26 12:14:49,505][123091] Updated weights for policy 0, policy_version 1584523 (0.0005) [2023-12-26 12:14:50,062][123090] Updated weights for policy 1, policy_version 1574084 (0.0010) [2023-12-26 12:14:50,126][123090] Updated weights for policy 1, policy_version 1574094 (0.0009) [2023-12-26 12:14:50,181][123091] Updated weights for policy 0, policy_version 1584533 (0.0007) [2023-12-26 12:14:50,183][123090] Updated weights for policy 1, policy_version 1574104 (0.0009) [2023-12-26 12:14:50,242][123091] Updated weights for policy 0, policy_version 1584543 (0.0006) [2023-12-26 12:14:50,308][123091] Updated weights for policy 0, policy_version 1584554 (0.0010) [2023-12-26 12:14:50,987][123090] Updated weights for policy 1, policy_version 1574114 (0.0010) [2023-12-26 12:14:51,049][123090] Updated weights for policy 1, policy_version 1574124 (0.0009) [2023-12-26 12:14:51,115][123090] Updated weights for policy 1, policy_version 1574134 (0.0007) [2023-12-26 12:14:51,183][123090] Updated weights for policy 1, policy_version 1574144 (0.0006) [2023-12-26 12:14:51,185][123091] Updated weights for policy 0, policy_version 1584564 (0.0009) [2023-12-26 12:14:51,250][123091] Updated weights for policy 0, policy_version 1584574 (0.0007) [2023-12-26 12:14:51,321][123091] Updated weights for policy 0, policy_version 1584584 (0.0006) [2023-12-26 12:14:51,891][123090] Updated weights for policy 1, policy_version 1574154 (0.0009) [2023-12-26 12:14:51,954][123090] Updated weights for policy 1, policy_version 1574164 (0.0009) [2023-12-26 12:14:52,024][123090] Updated weights for policy 1, policy_version 1574174 (0.0009) [2023-12-26 12:14:52,075][123091] Updated weights for policy 0, policy_version 1584594 (0.0008) [2023-12-26 12:14:52,144][123091] Updated weights for policy 0, policy_version 1584604 (0.0010) [2023-12-26 12:14:52,205][123091] Updated weights for policy 0, policy_version 1584614 (0.0010) [2023-12-26 12:14:52,261][123091] Updated weights for policy 0, policy_version 1584624 (0.0009) [2023-12-26 12:14:52,880][123090] Updated weights for policy 1, policy_version 1574184 (0.0009) [2023-12-26 12:14:52,941][123090] Updated weights for policy 1, policy_version 1574194 (0.0008) [2023-12-26 12:14:53,005][123090] Updated weights for policy 1, policy_version 1574204 (0.0005) [2023-12-26 12:14:53,072][123091] Updated weights for policy 0, policy_version 1584634 (0.0009) [2023-12-26 12:14:53,136][123091] Updated weights for policy 0, policy_version 1584644 (0.0010) [2023-12-26 12:14:53,196][123091] Updated weights for policy 0, policy_version 1584654 (0.0009) [2023-12-26 12:14:53,681][123090] Updated weights for policy 1, policy_version 1574214 (0.0006) [2023-12-26 12:14:53,734][123090] Updated weights for policy 1, policy_version 1574224 (0.0005) [2023-12-26 12:14:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 808673280. Throughput: 0: 8895.5, 1: 8759.3. Samples: 808655028. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:53,785][121949] Avg episode reward: [(0, '6218.252'), (1, '5389.112')] [2023-12-26 12:14:53,789][123090] Updated weights for policy 1, policy_version 1574234 (0.0008) [2023-12-26 12:14:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001584656_405676032.pth... [2023-12-26 12:14:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001583632_405413888.pth [2023-12-26 12:14:53,825][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001574240_403005440.pth... [2023-12-26 12:14:53,832][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001573184_402735104.pth [2023-12-26 12:14:53,884][123091] Updated weights for policy 0, policy_version 1584664 (0.0010) [2023-12-26 12:14:53,942][123091] Updated weights for policy 0, policy_version 1584674 (0.0010) [2023-12-26 12:14:53,993][123091] Updated weights for policy 0, policy_version 1584684 (0.0010) [2023-12-26 12:14:54,651][123090] Updated weights for policy 1, policy_version 1574244 (0.0009) [2023-12-26 12:14:54,704][123090] Updated weights for policy 1, policy_version 1574254 (0.0010) [2023-12-26 12:14:54,730][123091] Updated weights for policy 0, policy_version 1584694 (0.0007) [2023-12-26 12:14:54,753][123090] Updated weights for policy 1, policy_version 1574264 (0.0009) [2023-12-26 12:14:54,792][123091] Updated weights for policy 0, policy_version 1584704 (0.0005) [2023-12-26 12:14:54,858][123091] Updated weights for policy 0, policy_version 1584714 (0.0005) [2023-12-26 12:14:55,557][123090] Updated weights for policy 1, policy_version 1574275 (0.0008) [2023-12-26 12:14:55,567][123091] Updated weights for policy 0, policy_version 1584724 (0.0005) [2023-12-26 12:14:55,605][123090] Updated weights for policy 1, policy_version 1574285 (0.0005) [2023-12-26 12:14:55,617][123091] Updated weights for policy 0, policy_version 1584734 (0.0005) [2023-12-26 12:14:55,663][123090] Updated weights for policy 1, policy_version 1574295 (0.0006) [2023-12-26 12:14:55,672][123091] Updated weights for policy 0, policy_version 1584744 (0.0005) [2023-12-26 12:14:56,297][123091] Updated weights for policy 0, policy_version 1584754 (0.0009) [2023-12-26 12:14:56,352][123091] Updated weights for policy 0, policy_version 1584764 (0.0010) [2023-12-26 12:14:56,389][123090] Updated weights for policy 1, policy_version 1574305 (0.0006) [2023-12-26 12:14:56,403][123091] Updated weights for policy 0, policy_version 1584774 (0.0010) [2023-12-26 12:14:56,452][123090] Updated weights for policy 1, policy_version 1574315 (0.0005) [2023-12-26 12:14:56,456][123091] Updated weights for policy 0, policy_version 1584784 (0.0011) [2023-12-26 12:14:56,517][123090] Updated weights for policy 1, policy_version 1574325 (0.0005) [2023-12-26 12:14:56,575][123090] Updated weights for policy 1, policy_version 1574335 (0.0008) [2023-12-26 12:14:57,269][123090] Updated weights for policy 1, policy_version 1574345 (0.0010) [2023-12-26 12:14:57,299][123091] Updated weights for policy 0, policy_version 1584794 (0.0006) [2023-12-26 12:14:57,325][123090] Updated weights for policy 1, policy_version 1574355 (0.0007) [2023-12-26 12:14:57,367][123091] Updated weights for policy 0, policy_version 1584804 (0.0010) [2023-12-26 12:14:57,375][123090] Updated weights for policy 1, policy_version 1574365 (0.0006) [2023-12-26 12:14:57,429][123091] Updated weights for policy 0, policy_version 1584814 (0.0010) [2023-12-26 12:14:58,134][123091] Updated weights for policy 0, policy_version 1584824 (0.0010) [2023-12-26 12:14:58,198][123091] Updated weights for policy 0, policy_version 1584834 (0.0010) [2023-12-26 12:14:58,255][123090] Updated weights for policy 1, policy_version 1574375 (0.0008) [2023-12-26 12:14:58,257][123091] Updated weights for policy 0, policy_version 1584844 (0.0010) [2023-12-26 12:14:58,315][123090] Updated weights for policy 1, policy_version 1574385 (0.0008) [2023-12-26 12:14:58,400][123090] Updated weights for policy 1, policy_version 1574395 (0.0010) [2023-12-26 12:14:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 808771584. Throughput: 0: 8976.2, 1: 8810.1. Samples: 808765768. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:14:58,785][121949] Avg episode reward: [(0, '6115.869'), (1, '5364.578')] [2023-12-26 12:14:59,174][123091] Updated weights for policy 0, policy_version 1584854 (0.0008) [2023-12-26 12:14:59,223][123090] Updated weights for policy 1, policy_version 1574405 (0.0009) [2023-12-26 12:14:59,245][123091] Updated weights for policy 0, policy_version 1584864 (0.0008) [2023-12-26 12:14:59,292][123090] Updated weights for policy 1, policy_version 1574415 (0.0009) [2023-12-26 12:14:59,308][123091] Updated weights for policy 0, policy_version 1584874 (0.0010) [2023-12-26 12:14:59,368][123090] Updated weights for policy 1, policy_version 1574425 (0.0008) [2023-12-26 12:15:00,043][123091] Updated weights for policy 0, policy_version 1584884 (0.0009) [2023-12-26 12:15:00,104][123091] Updated weights for policy 0, policy_version 1584894 (0.0005) [2023-12-26 12:15:00,166][123091] Updated weights for policy 0, policy_version 1584904 (0.0006) [2023-12-26 12:15:00,186][123090] Updated weights for policy 1, policy_version 1574435 (0.0008) [2023-12-26 12:15:00,245][123090] Updated weights for policy 1, policy_version 1574445 (0.0006) [2023-12-26 12:15:00,300][123090] Updated weights for policy 1, policy_version 1574455 (0.0005) [2023-12-26 12:15:00,930][123091] Updated weights for policy 0, policy_version 1584914 (0.0008) [2023-12-26 12:15:00,961][123090] Updated weights for policy 1, policy_version 1574465 (0.0006) [2023-12-26 12:15:00,987][123091] Updated weights for policy 0, policy_version 1584924 (0.0008) [2023-12-26 12:15:01,019][123090] Updated weights for policy 1, policy_version 1574475 (0.0008) [2023-12-26 12:15:01,050][123091] Updated weights for policy 0, policy_version 1584934 (0.0007) [2023-12-26 12:15:01,087][123090] Updated weights for policy 1, policy_version 1574485 (0.0007) [2023-12-26 12:15:01,116][123091] Updated weights for policy 0, policy_version 1584944 (0.0006) [2023-12-26 12:15:01,155][123090] Updated weights for policy 1, policy_version 1574495 (0.0008) [2023-12-26 12:15:01,912][123091] Updated weights for policy 0, policy_version 1584954 (0.0009) [2023-12-26 12:15:01,970][123091] Updated weights for policy 0, policy_version 1584965 (0.0008) [2023-12-26 12:15:02,035][123090] Updated weights for policy 1, policy_version 1574505 (0.0008) [2023-12-26 12:15:02,036][123091] Updated weights for policy 0, policy_version 1584975 (0.0005) [2023-12-26 12:15:02,108][123090] Updated weights for policy 1, policy_version 1574515 (0.0009) [2023-12-26 12:15:02,169][123090] Updated weights for policy 1, policy_version 1574525 (0.0009) [2023-12-26 12:15:02,768][123091] Updated weights for policy 0, policy_version 1584985 (0.0006) [2023-12-26 12:15:02,819][123091] Updated weights for policy 0, policy_version 1584995 (0.0006) [2023-12-26 12:15:02,880][123091] Updated weights for policy 0, policy_version 1585005 (0.0006) [2023-12-26 12:15:03,035][123090] Updated weights for policy 1, policy_version 1574535 (0.0010) [2023-12-26 12:15:03,086][123090] Updated weights for policy 1, policy_version 1574545 (0.0009) [2023-12-26 12:15:03,138][123090] Updated weights for policy 1, policy_version 1574556 (0.0010) [2023-12-26 12:15:03,558][123091] Updated weights for policy 0, policy_version 1585015 (0.0008) [2023-12-26 12:15:03,631][123091] Updated weights for policy 0, policy_version 1585025 (0.0008) [2023-12-26 12:15:03,690][123091] Updated weights for policy 0, policy_version 1585035 (0.0007) [2023-12-26 12:15:03,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 808861696. Throughput: 0: 8986.8, 1: 8792.3. Samples: 808871668. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:03,784][121949] Avg episode reward: [(0, '6072.979'), (1, '5672.605')] [2023-12-26 12:15:03,891][123090] Updated weights for policy 1, policy_version 1574566 (0.0009) [2023-12-26 12:15:03,947][123090] Updated weights for policy 1, policy_version 1574576 (0.0007) [2023-12-26 12:15:04,010][123090] Updated weights for policy 1, policy_version 1574586 (0.0005) [2023-12-26 12:15:04,452][123091] Updated weights for policy 0, policy_version 1585045 (0.0009) [2023-12-26 12:15:04,512][123091] Updated weights for policy 0, policy_version 1585055 (0.0011) [2023-12-26 12:15:04,564][123091] Updated weights for policy 0, policy_version 1585065 (0.0011) [2023-12-26 12:15:04,802][123090] Updated weights for policy 1, policy_version 1574596 (0.0007) [2023-12-26 12:15:04,861][123090] Updated weights for policy 1, policy_version 1574606 (0.0010) [2023-12-26 12:15:04,923][123090] Updated weights for policy 1, policy_version 1574616 (0.0010) [2023-12-26 12:15:05,409][123091] Updated weights for policy 0, policy_version 1585075 (0.0011) [2023-12-26 12:15:05,472][123091] Updated weights for policy 0, policy_version 1585085 (0.0011) [2023-12-26 12:15:05,530][123091] Updated weights for policy 0, policy_version 1585095 (0.0011) [2023-12-26 12:15:05,674][123090] Updated weights for policy 1, policy_version 1574626 (0.0010) [2023-12-26 12:15:05,728][123090] Updated weights for policy 1, policy_version 1574636 (0.0010) [2023-12-26 12:15:05,772][123090] Updated weights for policy 1, policy_version 1574646 (0.0010) [2023-12-26 12:15:05,832][123090] Updated weights for policy 1, policy_version 1574656 (0.0007) [2023-12-26 12:15:06,320][123091] Updated weights for policy 0, policy_version 1585105 (0.0011) [2023-12-26 12:15:06,388][123091] Updated weights for policy 0, policy_version 1585115 (0.0011) [2023-12-26 12:15:06,455][123091] Updated weights for policy 0, policy_version 1585125 (0.0011) [2023-12-26 12:15:06,519][123091] Updated weights for policy 0, policy_version 1585135 (0.0011) [2023-12-26 12:15:06,606][123090] Updated weights for policy 1, policy_version 1574666 (0.0010) [2023-12-26 12:15:06,667][123090] Updated weights for policy 1, policy_version 1574676 (0.0009) [2023-12-26 12:15:06,725][123090] Updated weights for policy 1, policy_version 1574686 (0.0009) [2023-12-26 12:15:07,322][123091] Updated weights for policy 0, policy_version 1585145 (0.0010) [2023-12-26 12:15:07,374][123091] Updated weights for policy 0, policy_version 1585155 (0.0010) [2023-12-26 12:15:07,425][123091] Updated weights for policy 0, policy_version 1585165 (0.0010) [2023-12-26 12:15:07,566][123090] Updated weights for policy 1, policy_version 1574696 (0.0009) [2023-12-26 12:15:07,614][123090] Updated weights for policy 1, policy_version 1574706 (0.0008) [2023-12-26 12:15:07,662][123090] Updated weights for policy 1, policy_version 1574716 (0.0009) [2023-12-26 12:15:08,250][123091] Updated weights for policy 0, policy_version 1585175 (0.0010) [2023-12-26 12:15:08,301][123091] Updated weights for policy 0, policy_version 1585185 (0.0010) [2023-12-26 12:15:08,369][123091] Updated weights for policy 0, policy_version 1585195 (0.0011) [2023-12-26 12:15:08,488][123090] Updated weights for policy 1, policy_version 1574726 (0.0009) [2023-12-26 12:15:08,541][123090] Updated weights for policy 1, policy_version 1574736 (0.0009) [2023-12-26 12:15:08,607][123090] Updated weights for policy 1, policy_version 1574746 (0.0008) [2023-12-26 12:15:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 808951808. Throughput: 0: 9008.1, 1: 8864.3. Samples: 808925820. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:08,785][121949] Avg episode reward: [(0, '6098.808'), (1, '5689.513')] [2023-12-26 12:15:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001585200_405815296.pth... [2023-12-26 12:15:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001574752_403136512.pth... [2023-12-26 12:15:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001584144_405544960.pth [2023-12-26 12:15:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001573728_402874368.pth [2023-12-26 12:15:09,163][123091] Updated weights for policy 0, policy_version 1585205 (0.0010) [2023-12-26 12:15:09,215][123091] Updated weights for policy 0, policy_version 1585215 (0.0011) [2023-12-26 12:15:09,280][123091] Updated weights for policy 0, policy_version 1585225 (0.0008) [2023-12-26 12:15:09,322][123090] Updated weights for policy 1, policy_version 1574756 (0.0009) [2023-12-26 12:15:09,396][123090] Updated weights for policy 1, policy_version 1574766 (0.0008) [2023-12-26 12:15:09,457][123090] Updated weights for policy 1, policy_version 1574776 (0.0008) [2023-12-26 12:15:10,165][123091] Updated weights for policy 0, policy_version 1585235 (0.0009) [2023-12-26 12:15:10,219][123091] Updated weights for policy 0, policy_version 1585245 (0.0010) [2023-12-26 12:15:10,240][123090] Updated weights for policy 1, policy_version 1574786 (0.0009) [2023-12-26 12:15:10,286][123091] Updated weights for policy 0, policy_version 1585255 (0.0009) [2023-12-26 12:15:10,302][123090] Updated weights for policy 1, policy_version 1574796 (0.0008) [2023-12-26 12:15:10,362][123090] Updated weights for policy 1, policy_version 1574806 (0.0008) [2023-12-26 12:15:10,429][123090] Updated weights for policy 1, policy_version 1574816 (0.0009) [2023-12-26 12:15:11,140][123091] Updated weights for policy 0, policy_version 1585265 (0.0007) [2023-12-26 12:15:11,202][123091] Updated weights for policy 0, policy_version 1585275 (0.0010) [2023-12-26 12:15:11,264][123091] Updated weights for policy 0, policy_version 1585285 (0.0007) [2023-12-26 12:15:11,273][123090] Updated weights for policy 1, policy_version 1574826 (0.0010) [2023-12-26 12:15:11,326][123091] Updated weights for policy 0, policy_version 1585295 (0.0008) [2023-12-26 12:15:11,335][123090] Updated weights for policy 1, policy_version 1574836 (0.0006) [2023-12-26 12:15:11,409][123090] Updated weights for policy 1, policy_version 1574846 (0.0008) [2023-12-26 12:15:12,126][123091] Updated weights for policy 0, policy_version 1585305 (0.0009) [2023-12-26 12:15:12,168][123090] Updated weights for policy 1, policy_version 1574856 (0.0007) [2023-12-26 12:15:12,191][123091] Updated weights for policy 0, policy_version 1585315 (0.0009) [2023-12-26 12:15:12,231][123090] Updated weights for policy 1, policy_version 1574866 (0.0007) [2023-12-26 12:15:12,256][123091] Updated weights for policy 0, policy_version 1585325 (0.0009) [2023-12-26 12:15:12,302][123090] Updated weights for policy 1, policy_version 1574876 (0.0007) [2023-12-26 12:15:13,040][123091] Updated weights for policy 0, policy_version 1585335 (0.0009) [2023-12-26 12:15:13,095][123091] Updated weights for policy 0, policy_version 1585345 (0.0009) [2023-12-26 12:15:13,147][123090] Updated weights for policy 1, policy_version 1574886 (0.0007) [2023-12-26 12:15:13,152][123091] Updated weights for policy 0, policy_version 1585355 (0.0009) [2023-12-26 12:15:13,213][123090] Updated weights for policy 1, policy_version 1574896 (0.0007) [2023-12-26 12:15:13,264][123090] Updated weights for policy 1, policy_version 1574906 (0.0008) [2023-12-26 12:15:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 809033728. Throughput: 0: 8971.4, 1: 8900.5. Samples: 809029348. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:13,785][121949] Avg episode reward: [(0, '5961.793'), (1, '5418.345')] [2023-12-26 12:15:13,918][123091] Updated weights for policy 0, policy_version 1585365 (0.0006) [2023-12-26 12:15:13,986][123091] Updated weights for policy 0, policy_version 1585375 (0.0005) [2023-12-26 12:15:14,051][123091] Updated weights for policy 0, policy_version 1585385 (0.0006) [2023-12-26 12:15:14,074][123090] Updated weights for policy 1, policy_version 1574916 (0.0010) [2023-12-26 12:15:14,141][123090] Updated weights for policy 1, policy_version 1574926 (0.0008) [2023-12-26 12:15:14,213][123090] Updated weights for policy 1, policy_version 1574936 (0.0008) [2023-12-26 12:15:14,698][123091] Updated weights for policy 0, policy_version 1585395 (0.0005) [2023-12-26 12:15:14,752][123091] Updated weights for policy 0, policy_version 1585405 (0.0010) [2023-12-26 12:15:14,809][123091] Updated weights for policy 0, policy_version 1585415 (0.0010) [2023-12-26 12:15:14,989][123090] Updated weights for policy 1, policy_version 1574946 (0.0008) [2023-12-26 12:15:15,060][123090] Updated weights for policy 1, policy_version 1574956 (0.0011) [2023-12-26 12:15:15,124][123090] Updated weights for policy 1, policy_version 1574966 (0.0011) [2023-12-26 12:15:15,184][123090] Updated weights for policy 1, policy_version 1574976 (0.0010) [2023-12-26 12:15:15,547][123091] Updated weights for policy 0, policy_version 1585425 (0.0010) [2023-12-26 12:15:15,606][123091] Updated weights for policy 0, policy_version 1585435 (0.0005) [2023-12-26 12:15:15,664][123091] Updated weights for policy 0, policy_version 1585445 (0.0008) [2023-12-26 12:15:15,726][123091] Updated weights for policy 0, policy_version 1585455 (0.0009) [2023-12-26 12:15:16,004][123090] Updated weights for policy 1, policy_version 1574986 (0.0010) [2023-12-26 12:15:16,052][123090] Updated weights for policy 1, policy_version 1574996 (0.0010) [2023-12-26 12:15:16,103][123090] Updated weights for policy 1, policy_version 1575006 (0.0010) [2023-12-26 12:15:16,440][123091] Updated weights for policy 0, policy_version 1585465 (0.0006) [2023-12-26 12:15:16,506][123091] Updated weights for policy 0, policy_version 1585475 (0.0007) [2023-12-26 12:15:16,558][123091] Updated weights for policy 0, policy_version 1585485 (0.0009) [2023-12-26 12:15:16,961][123090] Updated weights for policy 1, policy_version 1575016 (0.0010) [2023-12-26 12:15:17,032][123090] Updated weights for policy 1, policy_version 1575026 (0.0011) [2023-12-26 12:15:17,099][123090] Updated weights for policy 1, policy_version 1575036 (0.0011) [2023-12-26 12:15:17,260][123091] Updated weights for policy 0, policy_version 1585495 (0.0009) [2023-12-26 12:15:17,316][123091] Updated weights for policy 0, policy_version 1585505 (0.0009) [2023-12-26 12:15:17,372][123091] Updated weights for policy 0, policy_version 1585515 (0.0009) [2023-12-26 12:15:17,935][123090] Updated weights for policy 1, policy_version 1575046 (0.0009) [2023-12-26 12:15:17,991][123090] Updated weights for policy 1, policy_version 1575056 (0.0005) [2023-12-26 12:15:18,047][123090] Updated weights for policy 1, policy_version 1575066 (0.0006) [2023-12-26 12:15:18,203][123091] Updated weights for policy 0, policy_version 1585525 (0.0009) [2023-12-26 12:15:18,258][123091] Updated weights for policy 0, policy_version 1585535 (0.0006) [2023-12-26 12:15:18,316][123091] Updated weights for policy 0, policy_version 1585545 (0.0005) [2023-12-26 12:15:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 809123840. Throughput: 0: 9084.1, 1: 8903.8. Samples: 809138508. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:18,785][121949] Avg episode reward: [(0, '5895.833'), (1, '5396.586')] [2023-12-26 12:15:18,819][123090] Updated weights for policy 1, policy_version 1575076 (0.0005) [2023-12-26 12:15:18,884][123090] Updated weights for policy 1, policy_version 1575086 (0.0007) [2023-12-26 12:15:18,956][123090] Updated weights for policy 1, policy_version 1575096 (0.0011) [2023-12-26 12:15:19,124][123091] Updated weights for policy 0, policy_version 1585555 (0.0009) [2023-12-26 12:15:19,177][123091] Updated weights for policy 0, policy_version 1585565 (0.0011) [2023-12-26 12:15:19,259][123091] Updated weights for policy 0, policy_version 1585575 (0.0010) [2023-12-26 12:15:19,750][123090] Updated weights for policy 1, policy_version 1575106 (0.0011) [2023-12-26 12:15:19,821][123090] Updated weights for policy 1, policy_version 1575116 (0.0010) [2023-12-26 12:15:19,886][123090] Updated weights for policy 1, policy_version 1575126 (0.0011) [2023-12-26 12:15:19,959][123090] Updated weights for policy 1, policy_version 1575136 (0.0011) [2023-12-26 12:15:20,062][123091] Updated weights for policy 0, policy_version 1585585 (0.0011) [2023-12-26 12:15:20,133][123091] Updated weights for policy 0, policy_version 1585595 (0.0011) [2023-12-26 12:15:20,203][123091] Updated weights for policy 0, policy_version 1585605 (0.0009) [2023-12-26 12:15:20,267][123091] Updated weights for policy 0, policy_version 1585615 (0.0010) [2023-12-26 12:15:20,784][123090] Updated weights for policy 1, policy_version 1575146 (0.0010) [2023-12-26 12:15:20,848][123090] Updated weights for policy 1, policy_version 1575156 (0.0011) [2023-12-26 12:15:20,913][123090] Updated weights for policy 1, policy_version 1575166 (0.0011) [2023-12-26 12:15:20,998][123091] Updated weights for policy 0, policy_version 1585625 (0.0008) [2023-12-26 12:15:21,076][123091] Updated weights for policy 0, policy_version 1585635 (0.0009) [2023-12-26 12:15:21,146][123091] Updated weights for policy 0, policy_version 1585645 (0.0010) [2023-12-26 12:15:21,792][123090] Updated weights for policy 1, policy_version 1575176 (0.0010) [2023-12-26 12:15:21,856][123090] Updated weights for policy 1, policy_version 1575186 (0.0009) [2023-12-26 12:15:21,913][123090] Updated weights for policy 1, policy_version 1575196 (0.0009) [2023-12-26 12:15:22,001][123091] Updated weights for policy 0, policy_version 1585655 (0.0011) [2023-12-26 12:15:22,082][123091] Updated weights for policy 0, policy_version 1585665 (0.0011) [2023-12-26 12:15:22,143][123091] Updated weights for policy 0, policy_version 1585675 (0.0011) [2023-12-26 12:15:22,751][123090] Updated weights for policy 1, policy_version 1575206 (0.0009) [2023-12-26 12:15:22,810][123090] Updated weights for policy 1, policy_version 1575216 (0.0009) [2023-12-26 12:15:22,864][123090] Updated weights for policy 1, policy_version 1575226 (0.0009) [2023-12-26 12:15:22,959][123091] Updated weights for policy 0, policy_version 1585685 (0.0011) [2023-12-26 12:15:23,018][123091] Updated weights for policy 0, policy_version 1585695 (0.0011) [2023-12-26 12:15:23,073][123091] Updated weights for policy 0, policy_version 1585705 (0.0011) [2023-12-26 12:15:23,705][123090] Updated weights for policy 1, policy_version 1575236 (0.0009) [2023-12-26 12:15:23,766][123090] Updated weights for policy 1, policy_version 1575246 (0.0009) [2023-12-26 12:15:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 809205760. Throughput: 0: 9056.0, 1: 8808.4. Samples: 809189624. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:23,785][121949] Avg episode reward: [(0, '6053.493'), (1, '5536.598')] [2023-12-26 12:15:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001585712_405946368.pth... [2023-12-26 12:15:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001584656_405676032.pth [2023-12-26 12:15:23,830][123090] Updated weights for policy 1, policy_version 1575256 (0.0009) [2023-12-26 12:15:23,876][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001575264_403267584.pth... [2023-12-26 12:15:23,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001574240_403005440.pth [2023-12-26 12:15:23,944][123091] Updated weights for policy 0, policy_version 1585715 (0.0011) [2023-12-26 12:15:23,993][123091] Updated weights for policy 0, policy_version 1585725 (0.0009) [2023-12-26 12:15:24,051][123091] Updated weights for policy 0, policy_version 1585735 (0.0010) [2023-12-26 12:15:24,700][123090] Updated weights for policy 1, policy_version 1575266 (0.0009) [2023-12-26 12:15:24,761][123090] Updated weights for policy 1, policy_version 1575276 (0.0009) [2023-12-26 12:15:24,807][123091] Updated weights for policy 0, policy_version 1585745 (0.0010) [2023-12-26 12:15:24,831][123090] Updated weights for policy 1, policy_version 1575286 (0.0008) [2023-12-26 12:15:24,877][123091] Updated weights for policy 0, policy_version 1585755 (0.0010) [2023-12-26 12:15:24,896][123090] Updated weights for policy 1, policy_version 1575296 (0.0009) [2023-12-26 12:15:24,944][123091] Updated weights for policy 0, policy_version 1585765 (0.0011) [2023-12-26 12:15:25,006][123091] Updated weights for policy 0, policy_version 1585775 (0.0007) [2023-12-26 12:15:25,703][123091] Updated weights for policy 0, policy_version 1585785 (0.0010) [2023-12-26 12:15:25,747][123091] Updated weights for policy 0, policy_version 1585795 (0.0010) [2023-12-26 12:15:25,776][123090] Updated weights for policy 1, policy_version 1575306 (0.0007) [2023-12-26 12:15:25,808][123091] Updated weights for policy 0, policy_version 1585805 (0.0008) [2023-12-26 12:15:25,835][123090] Updated weights for policy 1, policy_version 1575316 (0.0007) [2023-12-26 12:15:25,892][123090] Updated weights for policy 1, policy_version 1575326 (0.0006) [2023-12-26 12:15:26,535][123091] Updated weights for policy 0, policy_version 1585815 (0.0007) [2023-12-26 12:15:26,587][123091] Updated weights for policy 0, policy_version 1585825 (0.0007) [2023-12-26 12:15:26,642][123091] Updated weights for policy 0, policy_version 1585835 (0.0006) [2023-12-26 12:15:26,693][123090] Updated weights for policy 1, policy_version 1575336 (0.0008) [2023-12-26 12:15:26,758][123090] Updated weights for policy 1, policy_version 1575346 (0.0010) [2023-12-26 12:15:26,825][123090] Updated weights for policy 1, policy_version 1575356 (0.0010) [2023-12-26 12:15:27,357][123091] Updated weights for policy 0, policy_version 1585845 (0.0008) [2023-12-26 12:15:27,412][123091] Updated weights for policy 0, policy_version 1585855 (0.0008) [2023-12-26 12:15:27,471][123091] Updated weights for policy 0, policy_version 1585865 (0.0009) [2023-12-26 12:15:27,663][123090] Updated weights for policy 1, policy_version 1575366 (0.0009) [2023-12-26 12:15:27,723][123090] Updated weights for policy 1, policy_version 1575376 (0.0009) [2023-12-26 12:15:27,783][123090] Updated weights for policy 1, policy_version 1575386 (0.0009) [2023-12-26 12:15:28,263][123091] Updated weights for policy 0, policy_version 1585875 (0.0009) [2023-12-26 12:15:28,307][123091] Updated weights for policy 0, policy_version 1585885 (0.0010) [2023-12-26 12:15:28,371][123091] Updated weights for policy 0, policy_version 1585895 (0.0011) [2023-12-26 12:15:28,620][123090] Updated weights for policy 1, policy_version 1575396 (0.0008) [2023-12-26 12:15:28,668][123090] Updated weights for policy 1, policy_version 1575406 (0.0008) [2023-12-26 12:15:28,744][123090] Updated weights for policy 1, policy_version 1575416 (0.0006) [2023-12-26 12:15:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 809295872. Throughput: 0: 9082.7, 1: 8729.6. Samples: 809293040. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:28,785][121949] Avg episode reward: [(0, '6260.980'), (1, '5430.073')] [2023-12-26 12:15:29,233][123091] Updated weights for policy 0, policy_version 1585905 (0.0011) [2023-12-26 12:15:29,290][123091] Updated weights for policy 0, policy_version 1585915 (0.0010) [2023-12-26 12:15:29,361][123091] Updated weights for policy 0, policy_version 1585925 (0.0009) [2023-12-26 12:15:29,430][123091] Updated weights for policy 0, policy_version 1585935 (0.0007) [2023-12-26 12:15:29,504][123090] Updated weights for policy 1, policy_version 1575426 (0.0009) [2023-12-26 12:15:29,572][123090] Updated weights for policy 1, policy_version 1575436 (0.0009) [2023-12-26 12:15:29,629][123090] Updated weights for policy 1, policy_version 1575446 (0.0009) [2023-12-26 12:15:29,681][123090] Updated weights for policy 1, policy_version 1575456 (0.0008) [2023-12-26 12:15:30,177][123091] Updated weights for policy 0, policy_version 1585945 (0.0006) [2023-12-26 12:15:30,242][123091] Updated weights for policy 0, policy_version 1585955 (0.0009) [2023-12-26 12:15:30,299][123091] Updated weights for policy 0, policy_version 1585965 (0.0010) [2023-12-26 12:15:30,464][123090] Updated weights for policy 1, policy_version 1575466 (0.0009) [2023-12-26 12:15:30,535][123090] Updated weights for policy 1, policy_version 1575476 (0.0010) [2023-12-26 12:15:30,594][123090] Updated weights for policy 1, policy_version 1575486 (0.0009) [2023-12-26 12:15:31,115][123091] Updated weights for policy 0, policy_version 1585975 (0.0010) [2023-12-26 12:15:31,181][123091] Updated weights for policy 0, policy_version 1585985 (0.0010) [2023-12-26 12:15:31,241][123091] Updated weights for policy 0, policy_version 1585995 (0.0010) [2023-12-26 12:15:31,389][123090] Updated weights for policy 1, policy_version 1575496 (0.0009) [2023-12-26 12:15:31,442][123090] Updated weights for policy 1, policy_version 1575506 (0.0009) [2023-12-26 12:15:31,502][123090] Updated weights for policy 1, policy_version 1575516 (0.0009) [2023-12-26 12:15:32,067][123091] Updated weights for policy 0, policy_version 1586005 (0.0010) [2023-12-26 12:15:32,129][123091] Updated weights for policy 0, policy_version 1586015 (0.0010) [2023-12-26 12:15:32,188][123091] Updated weights for policy 0, policy_version 1586025 (0.0011) [2023-12-26 12:15:32,338][123090] Updated weights for policy 1, policy_version 1575526 (0.0009) [2023-12-26 12:15:32,406][123090] Updated weights for policy 1, policy_version 1575536 (0.0009) [2023-12-26 12:15:32,471][123090] Updated weights for policy 1, policy_version 1575546 (0.0009) [2023-12-26 12:15:33,045][123091] Updated weights for policy 0, policy_version 1586035 (0.0010) [2023-12-26 12:15:33,092][123091] Updated weights for policy 0, policy_version 1586045 (0.0010) [2023-12-26 12:15:33,146][123091] Updated weights for policy 0, policy_version 1586055 (0.0010) [2023-12-26 12:15:33,322][123090] Updated weights for policy 1, policy_version 1575556 (0.0009) [2023-12-26 12:15:33,380][123090] Updated weights for policy 1, policy_version 1575566 (0.0008) [2023-12-26 12:15:33,432][123090] Updated weights for policy 1, policy_version 1575576 (0.0009) [2023-12-26 12:15:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 809385984. Throughput: 0: 8991.6, 1: 8681.8. Samples: 809397184. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:33,785][121949] Avg episode reward: [(0, '6346.578'), (1, '5436.487')] [2023-12-26 12:15:33,980][123091] Updated weights for policy 0, policy_version 1586065 (0.0010) [2023-12-26 12:15:34,044][123091] Updated weights for policy 0, policy_version 1586075 (0.0010) [2023-12-26 12:15:34,110][123091] Updated weights for policy 0, policy_version 1586085 (0.0011) [2023-12-26 12:15:34,179][123091] Updated weights for policy 0, policy_version 1586095 (0.0011) [2023-12-26 12:15:34,277][123090] Updated weights for policy 1, policy_version 1575586 (0.0009) [2023-12-26 12:15:34,330][123090] Updated weights for policy 1, policy_version 1575596 (0.0009) [2023-12-26 12:15:34,399][123090] Updated weights for policy 1, policy_version 1575606 (0.0009) [2023-12-26 12:15:34,459][123090] Updated weights for policy 1, policy_version 1575616 (0.0009) [2023-12-26 12:15:34,977][123091] Updated weights for policy 0, policy_version 1586105 (0.0010) [2023-12-26 12:15:35,036][123091] Updated weights for policy 0, policy_version 1586115 (0.0010) [2023-12-26 12:15:35,083][123091] Updated weights for policy 0, policy_version 1586125 (0.0010) [2023-12-26 12:15:35,292][123090] Updated weights for policy 1, policy_version 1575626 (0.0009) [2023-12-26 12:15:35,344][123090] Updated weights for policy 1, policy_version 1575636 (0.0009) [2023-12-26 12:15:35,392][123090] Updated weights for policy 1, policy_version 1575646 (0.0008) [2023-12-26 12:15:35,915][123091] Updated weights for policy 0, policy_version 1586135 (0.0010) [2023-12-26 12:15:35,966][123091] Updated weights for policy 0, policy_version 1586145 (0.0010) [2023-12-26 12:15:36,014][123091] Updated weights for policy 0, policy_version 1586155 (0.0010) [2023-12-26 12:15:36,254][123090] Updated weights for policy 1, policy_version 1575656 (0.0009) [2023-12-26 12:15:36,318][123090] Updated weights for policy 1, policy_version 1575666 (0.0009) [2023-12-26 12:15:36,384][123090] Updated weights for policy 1, policy_version 1575676 (0.0009) [2023-12-26 12:15:36,841][123091] Updated weights for policy 0, policy_version 1586165 (0.0008) [2023-12-26 12:15:36,903][123091] Updated weights for policy 0, policy_version 1586175 (0.0010) [2023-12-26 12:15:36,969][123091] Updated weights for policy 0, policy_version 1586185 (0.0010) [2023-12-26 12:15:37,245][123090] Updated weights for policy 1, policy_version 1575686 (0.0009) [2023-12-26 12:15:37,293][123090] Updated weights for policy 1, policy_version 1575696 (0.0008) [2023-12-26 12:15:37,341][123090] Updated weights for policy 1, policy_version 1575706 (0.0007) [2023-12-26 12:15:37,680][123091] Updated weights for policy 0, policy_version 1586195 (0.0009) [2023-12-26 12:15:37,736][123091] Updated weights for policy 0, policy_version 1586205 (0.0005) [2023-12-26 12:15:37,789][123091] Updated weights for policy 0, policy_version 1586215 (0.0005) [2023-12-26 12:15:38,183][123090] Updated weights for policy 1, policy_version 1575716 (0.0007) [2023-12-26 12:15:38,238][123090] Updated weights for policy 1, policy_version 1575726 (0.0010) [2023-12-26 12:15:38,303][123090] Updated weights for policy 1, policy_version 1575736 (0.0009) [2023-12-26 12:15:38,547][123091] Updated weights for policy 0, policy_version 1586225 (0.0006) [2023-12-26 12:15:38,614][123091] Updated weights for policy 0, policy_version 1586235 (0.0010) [2023-12-26 12:15:38,673][123091] Updated weights for policy 0, policy_version 1586245 (0.0010) [2023-12-26 12:15:38,735][123091] Updated weights for policy 0, policy_version 1586255 (0.0010) [2023-12-26 12:15:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 809476096. Throughput: 0: 8956.3, 1: 8667.6. Samples: 809448104. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:38,785][121949] Avg episode reward: [(0, '6221.241'), (1, '5171.108')] [2023-12-26 12:15:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001586256_406085632.pth... [2023-12-26 12:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001575744_403390464.pth... [2023-12-26 12:15:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001574752_403136512.pth [2023-12-26 12:15:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001585200_405815296.pth [2023-12-26 12:15:39,158][123090] Updated weights for policy 1, policy_version 1575746 (0.0010) [2023-12-26 12:15:39,230][123090] Updated weights for policy 1, policy_version 1575756 (0.0010) [2023-12-26 12:15:39,288][123090] Updated weights for policy 1, policy_version 1575766 (0.0007) [2023-12-26 12:15:39,349][123090] Updated weights for policy 1, policy_version 1575776 (0.0009) [2023-12-26 12:15:39,551][123091] Updated weights for policy 0, policy_version 1586265 (0.0007) [2023-12-26 12:15:39,615][123091] Updated weights for policy 0, policy_version 1586275 (0.0007) [2023-12-26 12:15:39,687][123091] Updated weights for policy 0, policy_version 1586285 (0.0005) [2023-12-26 12:15:40,240][123090] Updated weights for policy 1, policy_version 1575786 (0.0010) [2023-12-26 12:15:40,311][123090] Updated weights for policy 1, policy_version 1575796 (0.0010) [2023-12-26 12:15:40,379][123090] Updated weights for policy 1, policy_version 1575806 (0.0010) [2023-12-26 12:15:40,402][123091] Updated weights for policy 0, policy_version 1586295 (0.0007) [2023-12-26 12:15:40,467][123091] Updated weights for policy 0, policy_version 1586305 (0.0008) [2023-12-26 12:15:40,548][123091] Updated weights for policy 0, policy_version 1586315 (0.0005) [2023-12-26 12:15:41,236][123091] Updated weights for policy 0, policy_version 1586325 (0.0008) [2023-12-26 12:15:41,301][123091] Updated weights for policy 0, policy_version 1586335 (0.0009) [2023-12-26 12:15:41,329][123090] Updated weights for policy 1, policy_version 1575816 (0.0009) [2023-12-26 12:15:41,377][123091] Updated weights for policy 0, policy_version 1586345 (0.0008) [2023-12-26 12:15:41,403][123090] Updated weights for policy 1, policy_version 1575826 (0.0009) [2023-12-26 12:15:41,469][123090] Updated weights for policy 1, policy_version 1575836 (0.0009) [2023-12-26 12:15:42,227][123091] Updated weights for policy 0, policy_version 1586355 (0.0010) [2023-12-26 12:15:42,288][123091] Updated weights for policy 0, policy_version 1586365 (0.0011) [2023-12-26 12:15:42,356][123091] Updated weights for policy 0, policy_version 1586375 (0.0011) [2023-12-26 12:15:42,364][123090] Updated weights for policy 1, policy_version 1575846 (0.0009) [2023-12-26 12:15:42,433][123090] Updated weights for policy 1, policy_version 1575856 (0.0008) [2023-12-26 12:15:42,494][123090] Updated weights for policy 1, policy_version 1575866 (0.0010) [2023-12-26 12:15:43,116][123091] Updated weights for policy 0, policy_version 1586385 (0.0010) [2023-12-26 12:15:43,167][123091] Updated weights for policy 0, policy_version 1586395 (0.0005) [2023-12-26 12:15:43,227][123091] Updated weights for policy 0, policy_version 1586405 (0.0005) [2023-12-26 12:15:43,287][123091] Updated weights for policy 0, policy_version 1586415 (0.0008) [2023-12-26 12:15:43,302][123090] Updated weights for policy 1, policy_version 1575876 (0.0008) [2023-12-26 12:15:43,354][123090] Updated weights for policy 1, policy_version 1575886 (0.0009) [2023-12-26 12:15:43,406][123090] Updated weights for policy 1, policy_version 1575898 (0.0009) [2023-12-26 12:15:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 809558016. Throughput: 0: 8923.8, 1: 8521.1. Samples: 809550788. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:43,784][121949] Avg episode reward: [(0, '6140.489'), (1, '4815.775')] [2023-12-26 12:15:43,952][123091] Updated weights for policy 0, policy_version 1586425 (0.0006) [2023-12-26 12:15:44,008][123091] Updated weights for policy 0, policy_version 1586435 (0.0005) [2023-12-26 12:15:44,070][123091] Updated weights for policy 0, policy_version 1586445 (0.0006) [2023-12-26 12:15:44,302][123090] Updated weights for policy 1, policy_version 1575908 (0.0009) [2023-12-26 12:15:44,357][123090] Updated weights for policy 1, policy_version 1575918 (0.0010) [2023-12-26 12:15:44,405][123090] Updated weights for policy 1, policy_version 1575928 (0.0010) [2023-12-26 12:15:44,713][123091] Updated weights for policy 0, policy_version 1586455 (0.0007) [2023-12-26 12:15:44,785][123091] Updated weights for policy 0, policy_version 1586465 (0.0006) [2023-12-26 12:15:44,855][123091] Updated weights for policy 0, policy_version 1586475 (0.0007) [2023-12-26 12:15:45,272][123090] Updated weights for policy 1, policy_version 1575938 (0.0010) [2023-12-26 12:15:45,337][123090] Updated weights for policy 1, policy_version 1575948 (0.0010) [2023-12-26 12:15:45,404][123090] Updated weights for policy 1, policy_version 1575958 (0.0010) [2023-12-26 12:15:45,472][123090] Updated weights for policy 1, policy_version 1575968 (0.0011) [2023-12-26 12:15:45,562][123091] Updated weights for policy 0, policy_version 1586485 (0.0007) [2023-12-26 12:15:45,619][123091] Updated weights for policy 0, policy_version 1586495 (0.0006) [2023-12-26 12:15:45,691][123091] Updated weights for policy 0, policy_version 1586505 (0.0010) [2023-12-26 12:15:46,296][123090] Updated weights for policy 1, policy_version 1575978 (0.0006) [2023-12-26 12:15:46,365][123090] Updated weights for policy 1, policy_version 1575988 (0.0006) [2023-12-26 12:15:46,436][123090] Updated weights for policy 1, policy_version 1575998 (0.0006) [2023-12-26 12:15:46,474][123091] Updated weights for policy 0, policy_version 1586515 (0.0011) [2023-12-26 12:15:46,521][123091] Updated weights for policy 0, policy_version 1586525 (0.0010) [2023-12-26 12:15:46,568][123091] Updated weights for policy 0, policy_version 1586535 (0.0010) [2023-12-26 12:15:47,100][123090] Updated weights for policy 1, policy_version 1576008 (0.0006) [2023-12-26 12:15:47,151][123090] Updated weights for policy 1, policy_version 1576018 (0.0010) [2023-12-26 12:15:47,198][123090] Updated weights for policy 1, policy_version 1576028 (0.0010) [2023-12-26 12:15:47,409][123091] Updated weights for policy 0, policy_version 1586545 (0.0010) [2023-12-26 12:15:47,474][123091] Updated weights for policy 0, policy_version 1586555 (0.0011) [2023-12-26 12:15:47,533][123091] Updated weights for policy 0, policy_version 1586565 (0.0010) [2023-12-26 12:15:47,591][123091] Updated weights for policy 0, policy_version 1586575 (0.0010) [2023-12-26 12:15:47,913][123090] Updated weights for policy 1, policy_version 1576038 (0.0009) [2023-12-26 12:15:47,968][123090] Updated weights for policy 1, policy_version 1576048 (0.0010) [2023-12-26 12:15:48,029][123090] Updated weights for policy 1, policy_version 1576058 (0.0011) [2023-12-26 12:15:48,427][123091] Updated weights for policy 0, policy_version 1586585 (0.0009) [2023-12-26 12:15:48,502][123091] Updated weights for policy 0, policy_version 1586595 (0.0006) [2023-12-26 12:15:48,569][123091] Updated weights for policy 0, policy_version 1586605 (0.0010) [2023-12-26 12:15:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 809648128. Throughput: 0: 8941.2, 1: 8568.7. Samples: 809659616. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:48,785][121949] Avg episode reward: [(0, '6034.354'), (1, '4682.847')] [2023-12-26 12:15:48,854][123090] Updated weights for policy 1, policy_version 1576068 (0.0010) [2023-12-26 12:15:48,918][123090] Updated weights for policy 1, policy_version 1576078 (0.0009) [2023-12-26 12:15:48,979][123090] Updated weights for policy 1, policy_version 1576088 (0.0006) [2023-12-26 12:15:49,324][123091] Updated weights for policy 0, policy_version 1586615 (0.0009) [2023-12-26 12:15:49,396][123091] Updated weights for policy 0, policy_version 1586625 (0.0009) [2023-12-26 12:15:49,467][123091] Updated weights for policy 0, policy_version 1586635 (0.0010) [2023-12-26 12:15:49,672][123090] Updated weights for policy 1, policy_version 1576098 (0.0005) [2023-12-26 12:15:49,731][123090] Updated weights for policy 1, policy_version 1576108 (0.0006) [2023-12-26 12:15:49,793][123090] Updated weights for policy 1, policy_version 1576118 (0.0005) [2023-12-26 12:15:49,857][123090] Updated weights for policy 1, policy_version 1576128 (0.0009) [2023-12-26 12:15:50,289][123091] Updated weights for policy 0, policy_version 1586645 (0.0010) [2023-12-26 12:15:50,353][123091] Updated weights for policy 0, policy_version 1586655 (0.0011) [2023-12-26 12:15:50,413][123091] Updated weights for policy 0, policy_version 1586665 (0.0011) [2023-12-26 12:15:50,635][123090] Updated weights for policy 1, policy_version 1576138 (0.0010) [2023-12-26 12:15:50,712][123090] Updated weights for policy 1, policy_version 1576148 (0.0009) [2023-12-26 12:15:50,777][123090] Updated weights for policy 1, policy_version 1576158 (0.0009) [2023-12-26 12:15:51,237][123091] Updated weights for policy 0, policy_version 1586675 (0.0009) [2023-12-26 12:15:51,332][123091] Updated weights for policy 0, policy_version 1586685 (0.0009) [2023-12-26 12:15:51,411][123091] Updated weights for policy 0, policy_version 1586695 (0.0009) [2023-12-26 12:15:51,618][123090] Updated weights for policy 1, policy_version 1576168 (0.0009) [2023-12-26 12:15:51,685][123090] Updated weights for policy 1, policy_version 1576178 (0.0010) [2023-12-26 12:15:51,756][123090] Updated weights for policy 1, policy_version 1576188 (0.0010) [2023-12-26 12:15:52,106][123091] Updated weights for policy 0, policy_version 1586705 (0.0008) [2023-12-26 12:15:52,178][123091] Updated weights for policy 0, policy_version 1586715 (0.0006) [2023-12-26 12:15:52,249][123091] Updated weights for policy 0, policy_version 1586725 (0.0008) [2023-12-26 12:15:52,324][123091] Updated weights for policy 0, policy_version 1586735 (0.0008) [2023-12-26 12:15:52,597][123090] Updated weights for policy 1, policy_version 1576198 (0.0009) [2023-12-26 12:15:52,647][123090] Updated weights for policy 1, policy_version 1576208 (0.0008) [2023-12-26 12:15:52,702][123090] Updated weights for policy 1, policy_version 1576218 (0.0008) [2023-12-26 12:15:53,056][123091] Updated weights for policy 0, policy_version 1586745 (0.0006) [2023-12-26 12:15:53,125][123091] Updated weights for policy 0, policy_version 1586755 (0.0005) [2023-12-26 12:15:53,189][123091] Updated weights for policy 0, policy_version 1586765 (0.0006) [2023-12-26 12:15:53,516][123090] Updated weights for policy 1, policy_version 1576228 (0.0007) [2023-12-26 12:15:53,580][123090] Updated weights for policy 1, policy_version 1576238 (0.0005) [2023-12-26 12:15:53,641][123090] Updated weights for policy 1, policy_version 1576248 (0.0005) [2023-12-26 12:15:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 809738240. Throughput: 0: 8932.8, 1: 8540.3. Samples: 809712108. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:53,785][121949] Avg episode reward: [(0, '5940.015'), (1, '4963.837')] [2023-12-26 12:15:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001576256_403521536.pth... [2023-12-26 12:15:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001586768_406216704.pth... [2023-12-26 12:15:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001575264_403267584.pth [2023-12-26 12:15:53,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001585712_405946368.pth [2023-12-26 12:15:53,865][123091] Updated weights for policy 0, policy_version 1586775 (0.0006) [2023-12-26 12:15:53,919][123091] Updated weights for policy 0, policy_version 1586785 (0.0005) [2023-12-26 12:15:53,965][123091] Updated weights for policy 0, policy_version 1586795 (0.0005) [2023-12-26 12:15:54,347][123090] Updated weights for policy 1, policy_version 1576258 (0.0006) [2023-12-26 12:15:54,398][123090] Updated weights for policy 1, policy_version 1576268 (0.0009) [2023-12-26 12:15:54,458][123090] Updated weights for policy 1, policy_version 1576278 (0.0008) [2023-12-26 12:15:54,531][123090] Updated weights for policy 1, policy_version 1576288 (0.0009) [2023-12-26 12:15:54,664][123091] Updated weights for policy 0, policy_version 1586805 (0.0005) [2023-12-26 12:15:54,715][123091] Updated weights for policy 0, policy_version 1586815 (0.0005) [2023-12-26 12:15:54,769][123091] Updated weights for policy 0, policy_version 1586825 (0.0005) [2023-12-26 12:15:55,416][123091] Updated weights for policy 0, policy_version 1586835 (0.0005) [2023-12-26 12:15:55,431][123090] Updated weights for policy 1, policy_version 1576298 (0.0009) [2023-12-26 12:15:55,466][123091] Updated weights for policy 0, policy_version 1586845 (0.0006) [2023-12-26 12:15:55,483][123090] Updated weights for policy 1, policy_version 1576308 (0.0008) [2023-12-26 12:15:55,510][123091] Updated weights for policy 0, policy_version 1586855 (0.0005) [2023-12-26 12:15:55,540][123090] Updated weights for policy 1, policy_version 1576318 (0.0009) [2023-12-26 12:15:56,147][123091] Updated weights for policy 0, policy_version 1586865 (0.0006) [2023-12-26 12:15:56,205][123091] Updated weights for policy 0, policy_version 1586875 (0.0011) [2023-12-26 12:15:56,273][123091] Updated weights for policy 0, policy_version 1586885 (0.0011) [2023-12-26 12:15:56,337][123091] Updated weights for policy 0, policy_version 1586895 (0.0007) [2023-12-26 12:15:56,491][123090] Updated weights for policy 1, policy_version 1576328 (0.0010) [2023-12-26 12:15:56,547][123090] Updated weights for policy 1, policy_version 1576338 (0.0010) [2023-12-26 12:15:56,600][123090] Updated weights for policy 1, policy_version 1576348 (0.0010) [2023-12-26 12:15:56,975][123091] Updated weights for policy 0, policy_version 1586905 (0.0005) [2023-12-26 12:15:57,038][123091] Updated weights for policy 0, policy_version 1586915 (0.0007) [2023-12-26 12:15:57,110][123091] Updated weights for policy 0, policy_version 1586925 (0.0008) [2023-12-26 12:15:57,412][123090] Updated weights for policy 1, policy_version 1576358 (0.0009) [2023-12-26 12:15:57,460][123090] Updated weights for policy 1, policy_version 1576368 (0.0008) [2023-12-26 12:15:57,519][123090] Updated weights for policy 1, policy_version 1576378 (0.0008) [2023-12-26 12:15:57,781][123091] Updated weights for policy 0, policy_version 1586935 (0.0008) [2023-12-26 12:15:57,829][123091] Updated weights for policy 0, policy_version 1586945 (0.0009) [2023-12-26 12:15:57,879][123091] Updated weights for policy 0, policy_version 1586955 (0.0009) [2023-12-26 12:15:58,335][123090] Updated weights for policy 1, policy_version 1576388 (0.0010) [2023-12-26 12:15:58,417][123090] Updated weights for policy 1, policy_version 1576398 (0.0009) [2023-12-26 12:15:58,485][123090] Updated weights for policy 1, policy_version 1576408 (0.0009) [2023-12-26 12:15:58,711][123091] Updated weights for policy 0, policy_version 1586965 (0.0008) [2023-12-26 12:15:58,780][123091] Updated weights for policy 0, policy_version 1586975 (0.0008) [2023-12-26 12:15:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 809828352. Throughput: 0: 9151.6, 1: 8503.9. Samples: 809823844. Policy #0 lag: (min: 25.0, avg: 34.1, max: 57.0) [2023-12-26 12:15:58,785][121949] Avg episode reward: [(0, '6046.420'), (1, '5501.936')] [2023-12-26 12:15:58,844][123091] Updated weights for policy 0, policy_version 1586985 (0.0010) [2023-12-26 12:15:59,334][123090] Updated weights for policy 1, policy_version 1576418 (0.0009) [2023-12-26 12:15:59,401][123090] Updated weights for policy 1, policy_version 1576428 (0.0009) [2023-12-26 12:15:59,455][123090] Updated weights for policy 1, policy_version 1576438 (0.0009) [2023-12-26 12:15:59,510][123090] Updated weights for policy 1, policy_version 1576448 (0.0006) [2023-12-26 12:15:59,625][123091] Updated weights for policy 0, policy_version 1586995 (0.0010) [2023-12-26 12:15:59,682][123091] Updated weights for policy 0, policy_version 1587006 (0.0009) [2023-12-26 12:15:59,735][123091] Updated weights for policy 0, policy_version 1587016 (0.0010) [2023-12-26 12:16:00,334][123090] Updated weights for policy 1, policy_version 1576458 (0.0009) [2023-12-26 12:16:00,399][123090] Updated weights for policy 1, policy_version 1576468 (0.0007) [2023-12-26 12:16:00,476][123090] Updated weights for policy 1, policy_version 1576478 (0.0006) [2023-12-26 12:16:00,549][123091] Updated weights for policy 0, policy_version 1587026 (0.0006) [2023-12-26 12:16:00,616][123091] Updated weights for policy 0, policy_version 1587036 (0.0006) [2023-12-26 12:16:00,684][123091] Updated weights for policy 0, policy_version 1587046 (0.0006) [2023-12-26 12:16:00,751][123091] Updated weights for policy 0, policy_version 1587056 (0.0009) [2023-12-26 12:16:01,275][123090] Updated weights for policy 1, policy_version 1576488 (0.0008) [2023-12-26 12:16:01,349][123090] Updated weights for policy 1, policy_version 1576498 (0.0009) [2023-12-26 12:16:01,417][123090] Updated weights for policy 1, policy_version 1576508 (0.0007) [2023-12-26 12:16:01,553][123091] Updated weights for policy 0, policy_version 1587066 (0.0009) [2023-12-26 12:16:01,610][123091] Updated weights for policy 0, policy_version 1587076 (0.0010) [2023-12-26 12:16:01,678][123091] Updated weights for policy 0, policy_version 1587086 (0.0009) [2023-12-26 12:16:02,222][123090] Updated weights for policy 1, policy_version 1576518 (0.0008) [2023-12-26 12:16:02,288][123090] Updated weights for policy 1, policy_version 1576528 (0.0009) [2023-12-26 12:16:02,356][123090] Updated weights for policy 1, policy_version 1576538 (0.0009) [2023-12-26 12:16:02,489][123091] Updated weights for policy 0, policy_version 1587096 (0.0006) [2023-12-26 12:16:02,552][123091] Updated weights for policy 0, policy_version 1587106 (0.0006) [2023-12-26 12:16:02,607][123091] Updated weights for policy 0, policy_version 1587116 (0.0005) [2023-12-26 12:16:03,223][123090] Updated weights for policy 1, policy_version 1576548 (0.0010) [2023-12-26 12:16:03,281][123090] Updated weights for policy 1, policy_version 1576558 (0.0010) [2023-12-26 12:16:03,338][123090] Updated weights for policy 1, policy_version 1576568 (0.0009) [2023-12-26 12:16:03,360][123091] Updated weights for policy 0, policy_version 1587126 (0.0007) [2023-12-26 12:16:03,427][123091] Updated weights for policy 0, policy_version 1587136 (0.0005) [2023-12-26 12:16:03,490][123091] Updated weights for policy 0, policy_version 1587146 (0.0005) [2023-12-26 12:16:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 809918464. Throughput: 0: 9081.2, 1: 8479.8. Samples: 809928756. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:03,785][121949] Avg episode reward: [(0, '6031.662'), (1, '5509.409')] [2023-12-26 12:16:04,079][123090] Updated weights for policy 1, policy_version 1576578 (0.0007) [2023-12-26 12:16:04,137][123090] Updated weights for policy 1, policy_version 1576588 (0.0007) [2023-12-26 12:16:04,194][123090] Updated weights for policy 1, policy_version 1576598 (0.0009) [2023-12-26 12:16:04,240][123091] Updated weights for policy 0, policy_version 1587156 (0.0008) [2023-12-26 12:16:04,261][123090] Updated weights for policy 1, policy_version 1576608 (0.0008) [2023-12-26 12:16:04,303][123091] Updated weights for policy 0, policy_version 1587166 (0.0008) [2023-12-26 12:16:04,364][123091] Updated weights for policy 0, policy_version 1587176 (0.0009) [2023-12-26 12:16:05,096][123090] Updated weights for policy 1, policy_version 1576618 (0.0009) [2023-12-26 12:16:05,147][123090] Updated weights for policy 1, policy_version 1576628 (0.0008) [2023-12-26 12:16:05,185][123091] Updated weights for policy 0, policy_version 1587186 (0.0010) [2023-12-26 12:16:05,209][123090] Updated weights for policy 1, policy_version 1576638 (0.0008) [2023-12-26 12:16:05,244][123091] Updated weights for policy 0, policy_version 1587196 (0.0010) [2023-12-26 12:16:05,298][123091] Updated weights for policy 0, policy_version 1587206 (0.0010) [2023-12-26 12:16:05,349][123091] Updated weights for policy 0, policy_version 1587216 (0.0010) [2023-12-26 12:16:06,045][123090] Updated weights for policy 1, policy_version 1576648 (0.0009) [2023-12-26 12:16:06,111][123090] Updated weights for policy 1, policy_version 1576658 (0.0010) [2023-12-26 12:16:06,180][123090] Updated weights for policy 1, policy_version 1576668 (0.0010) [2023-12-26 12:16:06,182][123091] Updated weights for policy 0, policy_version 1587226 (0.0007) [2023-12-26 12:16:06,253][123091] Updated weights for policy 0, policy_version 1587236 (0.0008) [2023-12-26 12:16:06,326][123091] Updated weights for policy 0, policy_version 1587246 (0.0010) [2023-12-26 12:16:07,016][123090] Updated weights for policy 1, policy_version 1576678 (0.0009) [2023-12-26 12:16:07,068][123090] Updated weights for policy 1, policy_version 1576688 (0.0009) [2023-12-26 12:16:07,118][123091] Updated weights for policy 0, policy_version 1587256 (0.0006) [2023-12-26 12:16:07,136][123090] Updated weights for policy 1, policy_version 1576698 (0.0009) [2023-12-26 12:16:07,177][123091] Updated weights for policy 0, policy_version 1587266 (0.0005) [2023-12-26 12:16:07,227][123091] Updated weights for policy 0, policy_version 1587276 (0.0005) [2023-12-26 12:16:07,834][123091] Updated weights for policy 0, policy_version 1587286 (0.0005) [2023-12-26 12:16:07,886][123091] Updated weights for policy 0, policy_version 1587296 (0.0005) [2023-12-26 12:16:07,938][123091] Updated weights for policy 0, policy_version 1587306 (0.0005) [2023-12-26 12:16:08,036][123090] Updated weights for policy 1, policy_version 1576708 (0.0007) [2023-12-26 12:16:08,098][123090] Updated weights for policy 1, policy_version 1576718 (0.0005) [2023-12-26 12:16:08,180][123090] Updated weights for policy 1, policy_version 1576728 (0.0005) [2023-12-26 12:16:08,656][123091] Updated weights for policy 0, policy_version 1587316 (0.0007) [2023-12-26 12:16:08,711][123091] Updated weights for policy 0, policy_version 1587326 (0.0010) [2023-12-26 12:16:08,776][123091] Updated weights for policy 0, policy_version 1587336 (0.0009) [2023-12-26 12:16:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 810000384. Throughput: 0: 9082.6, 1: 8507.6. Samples: 809981184. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:08,785][121949] Avg episode reward: [(0, '6039.301'), (1, '5375.298')] [2023-12-26 12:16:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001576736_403644416.pth... [2023-12-26 12:16:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001575744_403390464.pth [2023-12-26 12:16:08,817][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001587344_406364160.pth... [2023-12-26 12:16:08,822][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001586256_406085632.pth [2023-12-26 12:16:08,859][123090] Updated weights for policy 1, policy_version 1576738 (0.0005) [2023-12-26 12:16:08,907][123090] Updated weights for policy 1, policy_version 1576748 (0.0005) [2023-12-26 12:16:08,954][123090] Updated weights for policy 1, policy_version 1576758 (0.0005) [2023-12-26 12:16:08,999][123090] Updated weights for policy 1, policy_version 1576768 (0.0005) [2023-12-26 12:16:09,636][123091] Updated weights for policy 0, policy_version 1587346 (0.0014) [2023-12-26 12:16:09,695][123091] Updated weights for policy 0, policy_version 1587356 (0.0011) [2023-12-26 12:16:09,716][123090] Updated weights for policy 1, policy_version 1576778 (0.0006) [2023-12-26 12:16:09,748][123091] Updated weights for policy 0, policy_version 1587366 (0.0011) [2023-12-26 12:16:09,773][123090] Updated weights for policy 1, policy_version 1576788 (0.0006) [2023-12-26 12:16:09,805][123091] Updated weights for policy 0, policy_version 1587376 (0.0011) [2023-12-26 12:16:09,840][123090] Updated weights for policy 1, policy_version 1576798 (0.0008) [2023-12-26 12:16:10,670][123091] Updated weights for policy 0, policy_version 1587386 (0.0009) [2023-12-26 12:16:10,684][123090] Updated weights for policy 1, policy_version 1576808 (0.0006) [2023-12-26 12:16:10,721][123091] Updated weights for policy 0, policy_version 1587396 (0.0009) [2023-12-26 12:16:10,752][123090] Updated weights for policy 1, policy_version 1576818 (0.0006) [2023-12-26 12:16:10,774][123091] Updated weights for policy 0, policy_version 1587406 (0.0009) [2023-12-26 12:16:10,818][123090] Updated weights for policy 1, policy_version 1576828 (0.0008) [2023-12-26 12:16:11,622][123090] Updated weights for policy 1, policy_version 1576838 (0.0009) [2023-12-26 12:16:11,641][123091] Updated weights for policy 0, policy_version 1587416 (0.0008) [2023-12-26 12:16:11,692][123090] Updated weights for policy 1, policy_version 1576848 (0.0008) [2023-12-26 12:16:11,709][123091] Updated weights for policy 0, policy_version 1587426 (0.0009) [2023-12-26 12:16:11,768][123090] Updated weights for policy 1, policy_version 1576858 (0.0009) [2023-12-26 12:16:11,781][123091] Updated weights for policy 0, policy_version 1587436 (0.0009) [2023-12-26 12:16:12,552][123090] Updated weights for policy 1, policy_version 1576868 (0.0009) [2023-12-26 12:16:12,612][123090] Updated weights for policy 1, policy_version 1576878 (0.0006) [2023-12-26 12:16:12,668][123091] Updated weights for policy 0, policy_version 1587446 (0.0009) [2023-12-26 12:16:12,674][123090] Updated weights for policy 1, policy_version 1576888 (0.0008) [2023-12-26 12:16:12,734][123091] Updated weights for policy 0, policy_version 1587456 (0.0009) [2023-12-26 12:16:12,793][123091] Updated weights for policy 0, policy_version 1587466 (0.0009) [2023-12-26 12:16:13,431][123090] Updated weights for policy 1, policy_version 1576898 (0.0009) [2023-12-26 12:16:13,480][123090] Updated weights for policy 1, policy_version 1576908 (0.0005) [2023-12-26 12:16:13,528][123090] Updated weights for policy 1, policy_version 1576918 (0.0005) [2023-12-26 12:16:13,561][123091] Updated weights for policy 0, policy_version 1587476 (0.0009) [2023-12-26 12:16:13,579][123090] Updated weights for policy 1, policy_version 1576928 (0.0005) [2023-12-26 12:16:13,616][123091] Updated weights for policy 0, policy_version 1587486 (0.0009) [2023-12-26 12:16:13,667][123091] Updated weights for policy 0, policy_version 1587496 (0.0009) [2023-12-26 12:16:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 810098688. Throughput: 0: 9061.3, 1: 8571.2. Samples: 810086504. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:13,785][121949] Avg episode reward: [(0, '6123.544'), (1, '5410.450')] [2023-12-26 12:16:14,364][123090] Updated weights for policy 1, policy_version 1576939 (0.0009) [2023-12-26 12:16:14,419][123090] Updated weights for policy 1, policy_version 1576949 (0.0009) [2023-12-26 12:16:14,477][123090] Updated weights for policy 1, policy_version 1576959 (0.0010) [2023-12-26 12:16:14,531][123091] Updated weights for policy 0, policy_version 1587507 (0.0010) [2023-12-26 12:16:14,601][123091] Updated weights for policy 0, policy_version 1587517 (0.0010) [2023-12-26 12:16:14,672][123091] Updated weights for policy 0, policy_version 1587527 (0.0009) [2023-12-26 12:16:15,215][123090] Updated weights for policy 1, policy_version 1576969 (0.0010) [2023-12-26 12:16:15,272][123090] Updated weights for policy 1, policy_version 1576979 (0.0010) [2023-12-26 12:16:15,324][123090] Updated weights for policy 1, policy_version 1576989 (0.0009) [2023-12-26 12:16:15,512][123091] Updated weights for policy 0, policy_version 1587537 (0.0010) [2023-12-26 12:16:15,568][123091] Updated weights for policy 0, policy_version 1587547 (0.0010) [2023-12-26 12:16:15,622][123091] Updated weights for policy 0, policy_version 1587557 (0.0009) [2023-12-26 12:16:15,675][123091] Updated weights for policy 0, policy_version 1587567 (0.0010) [2023-12-26 12:16:16,076][123090] Updated weights for policy 1, policy_version 1576999 (0.0007) [2023-12-26 12:16:16,135][123090] Updated weights for policy 1, policy_version 1577009 (0.0005) [2023-12-26 12:16:16,190][123090] Updated weights for policy 1, policy_version 1577019 (0.0005) [2023-12-26 12:16:16,611][123091] Updated weights for policy 0, policy_version 1587577 (0.0010) [2023-12-26 12:16:16,674][123091] Updated weights for policy 0, policy_version 1587587 (0.0010) [2023-12-26 12:16:16,744][123091] Updated weights for policy 0, policy_version 1587597 (0.0010) [2023-12-26 12:16:16,856][123090] Updated weights for policy 1, policy_version 1577029 (0.0005) [2023-12-26 12:16:16,904][123090] Updated weights for policy 1, policy_version 1577039 (0.0005) [2023-12-26 12:16:16,953][123090] Updated weights for policy 1, policy_version 1577049 (0.0005) [2023-12-26 12:16:17,500][123091] Updated weights for policy 0, policy_version 1587607 (0.0007) [2023-12-26 12:16:17,560][123091] Updated weights for policy 0, policy_version 1587617 (0.0006) [2023-12-26 12:16:17,612][123091] Updated weights for policy 0, policy_version 1587627 (0.0009) [2023-12-26 12:16:17,635][123090] Updated weights for policy 1, policy_version 1577059 (0.0005) [2023-12-26 12:16:17,691][123090] Updated weights for policy 1, policy_version 1577069 (0.0005) [2023-12-26 12:16:17,748][123090] Updated weights for policy 1, policy_version 1577079 (0.0005) [2023-12-26 12:16:18,424][123091] Updated weights for policy 0, policy_version 1587637 (0.0009) [2023-12-26 12:16:18,464][123090] Updated weights for policy 1, policy_version 1577089 (0.0005) [2023-12-26 12:16:18,486][123091] Updated weights for policy 0, policy_version 1587647 (0.0008) [2023-12-26 12:16:18,526][123090] Updated weights for policy 1, policy_version 1577099 (0.0006) [2023-12-26 12:16:18,547][123091] Updated weights for policy 0, policy_version 1587657 (0.0008) [2023-12-26 12:16:18,587][123090] Updated weights for policy 1, policy_version 1577109 (0.0009) [2023-12-26 12:16:18,651][123090] Updated weights for policy 1, policy_version 1577119 (0.0010) [2023-12-26 12:16:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 810188800. Throughput: 0: 9030.6, 1: 8712.7. Samples: 810195628. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:18,785][121949] Avg episode reward: [(0, '6175.229'), (1, '5231.530')] [2023-12-26 12:16:19,230][123091] Updated weights for policy 0, policy_version 1587667 (0.0007) [2023-12-26 12:16:19,300][123091] Updated weights for policy 0, policy_version 1587677 (0.0009) [2023-12-26 12:16:19,362][123091] Updated weights for policy 0, policy_version 1587687 (0.0008) [2023-12-26 12:16:19,485][123090] Updated weights for policy 1, policy_version 1577129 (0.0010) [2023-12-26 12:16:19,549][123090] Updated weights for policy 1, policy_version 1577139 (0.0009) [2023-12-26 12:16:19,599][123090] Updated weights for policy 1, policy_version 1577149 (0.0009) [2023-12-26 12:16:20,174][123091] Updated weights for policy 0, policy_version 1587697 (0.0009) [2023-12-26 12:16:20,232][123091] Updated weights for policy 0, policy_version 1587707 (0.0010) [2023-12-26 12:16:20,295][123091] Updated weights for policy 0, policy_version 1587717 (0.0010) [2023-12-26 12:16:20,366][123091] Updated weights for policy 0, policy_version 1587727 (0.0009) [2023-12-26 12:16:20,376][123090] Updated weights for policy 1, policy_version 1577159 (0.0009) [2023-12-26 12:16:20,452][123090] Updated weights for policy 1, policy_version 1577169 (0.0010) [2023-12-26 12:16:20,520][123090] Updated weights for policy 1, policy_version 1577179 (0.0009) [2023-12-26 12:16:21,177][123091] Updated weights for policy 0, policy_version 1587737 (0.0008) [2023-12-26 12:16:21,243][123091] Updated weights for policy 0, policy_version 1587747 (0.0008) [2023-12-26 12:16:21,320][123091] Updated weights for policy 0, policy_version 1587757 (0.0008) [2023-12-26 12:16:21,420][123090] Updated weights for policy 1, policy_version 1577189 (0.0009) [2023-12-26 12:16:21,477][123090] Updated weights for policy 1, policy_version 1577199 (0.0010) [2023-12-26 12:16:21,527][123090] Updated weights for policy 1, policy_version 1577209 (0.0009) [2023-12-26 12:16:22,124][123091] Updated weights for policy 0, policy_version 1587767 (0.0010) [2023-12-26 12:16:22,179][123091] Updated weights for policy 0, policy_version 1587777 (0.0010) [2023-12-26 12:16:22,232][123091] Updated weights for policy 0, policy_version 1587787 (0.0007) [2023-12-26 12:16:22,419][123090] Updated weights for policy 1, policy_version 1577219 (0.0010) [2023-12-26 12:16:22,474][123090] Updated weights for policy 1, policy_version 1577229 (0.0009) [2023-12-26 12:16:22,537][123090] Updated weights for policy 1, policy_version 1577239 (0.0010) [2023-12-26 12:16:23,076][123091] Updated weights for policy 0, policy_version 1587797 (0.0009) [2023-12-26 12:16:23,134][123091] Updated weights for policy 0, policy_version 1587807 (0.0006) [2023-12-26 12:16:23,191][123091] Updated weights for policy 0, policy_version 1587817 (0.0009) [2023-12-26 12:16:23,423][123090] Updated weights for policy 1, policy_version 1577249 (0.0009) [2023-12-26 12:16:23,495][123090] Updated weights for policy 1, policy_version 1577259 (0.0011) [2023-12-26 12:16:23,546][123090] Updated weights for policy 1, policy_version 1577269 (0.0010) [2023-12-26 12:16:23,631][123090] Updated weights for policy 1, policy_version 1577279 (0.0010) [2023-12-26 12:16:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 810270720. Throughput: 0: 9057.7, 1: 8706.5. Samples: 810247492. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:23,784][121949] Avg episode reward: [(0, '6241.732'), (1, '5091.333')] [2023-12-26 12:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001587824_406487040.pth... [2023-12-26 12:16:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001577280_403783680.pth... [2023-12-26 12:16:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001586768_406216704.pth [2023-12-26 12:16:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001576256_403521536.pth [2023-12-26 12:16:24,031][123091] Updated weights for policy 0, policy_version 1587827 (0.0010) [2023-12-26 12:16:24,085][123091] Updated weights for policy 0, policy_version 1587838 (0.0010) [2023-12-26 12:16:24,143][123091] Updated weights for policy 0, policy_version 1587849 (0.0010) [2023-12-26 12:16:24,314][123090] Updated weights for policy 1, policy_version 1577289 (0.0006) [2023-12-26 12:16:24,371][123090] Updated weights for policy 1, policy_version 1577299 (0.0007) [2023-12-26 12:16:24,433][123090] Updated weights for policy 1, policy_version 1577309 (0.0010) [2023-12-26 12:16:25,036][123090] Updated weights for policy 1, policy_version 1577319 (0.0010) [2023-12-26 12:16:25,066][123091] Updated weights for policy 0, policy_version 1587859 (0.0010) [2023-12-26 12:16:25,097][123090] Updated weights for policy 1, policy_version 1577329 (0.0006) [2023-12-26 12:16:25,141][123091] Updated weights for policy 0, policy_version 1587869 (0.0008) [2023-12-26 12:16:25,148][123090] Updated weights for policy 1, policy_version 1577339 (0.0005) [2023-12-26 12:16:25,213][123091] Updated weights for policy 0, policy_version 1587879 (0.0009) [2023-12-26 12:16:25,754][123090] Updated weights for policy 1, policy_version 1577349 (0.0007) [2023-12-26 12:16:25,815][123090] Updated weights for policy 1, policy_version 1577359 (0.0006) [2023-12-26 12:16:25,873][123090] Updated weights for policy 1, policy_version 1577369 (0.0005) [2023-12-26 12:16:26,076][123091] Updated weights for policy 0, policy_version 1587889 (0.0010) [2023-12-26 12:16:26,128][123091] Updated weights for policy 0, policy_version 1587899 (0.0008) [2023-12-26 12:16:26,186][123091] Updated weights for policy 0, policy_version 1587909 (0.0010) [2023-12-26 12:16:26,257][123091] Updated weights for policy 0, policy_version 1587919 (0.0010) [2023-12-26 12:16:26,569][123090] Updated weights for policy 1, policy_version 1577379 (0.0005) [2023-12-26 12:16:26,618][123090] Updated weights for policy 1, policy_version 1577389 (0.0005) [2023-12-26 12:16:26,663][123090] Updated weights for policy 1, policy_version 1577399 (0.0005) [2023-12-26 12:16:27,171][123091] Updated weights for policy 0, policy_version 1587929 (0.0009) [2023-12-26 12:16:27,224][123091] Updated weights for policy 0, policy_version 1587939 (0.0009) [2023-12-26 12:16:27,275][123091] Updated weights for policy 0, policy_version 1587949 (0.0009) [2023-12-26 12:16:27,313][123090] Updated weights for policy 1, policy_version 1577409 (0.0005) [2023-12-26 12:16:27,374][123090] Updated weights for policy 1, policy_version 1577419 (0.0006) [2023-12-26 12:16:27,439][123090] Updated weights for policy 1, policy_version 1577429 (0.0005) [2023-12-26 12:16:27,499][123090] Updated weights for policy 1, policy_version 1577439 (0.0005) [2023-12-26 12:16:28,125][123090] Updated weights for policy 1, policy_version 1577449 (0.0007) [2023-12-26 12:16:28,168][123090] Updated weights for policy 1, policy_version 1577459 (0.0010) [2023-12-26 12:16:28,199][123091] Updated weights for policy 0, policy_version 1587959 (0.0009) [2023-12-26 12:16:28,221][123090] Updated weights for policy 1, policy_version 1577469 (0.0010) [2023-12-26 12:16:28,255][123091] Updated weights for policy 0, policy_version 1587969 (0.0007) [2023-12-26 12:16:28,309][123091] Updated weights for policy 0, policy_version 1587979 (0.0009) [2023-12-26 12:16:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 810360832. Throughput: 0: 8935.4, 1: 8926.4. Samples: 810354568. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:28,785][121949] Avg episode reward: [(0, '6219.341'), (1, '5234.754')] [2023-12-26 12:16:29,090][123090] Updated weights for policy 1, policy_version 1577479 (0.0010) [2023-12-26 12:16:29,137][123091] Updated weights for policy 0, policy_version 1587989 (0.0007) [2023-12-26 12:16:29,152][123090] Updated weights for policy 1, policy_version 1577489 (0.0009) [2023-12-26 12:16:29,197][123091] Updated weights for policy 0, policy_version 1587999 (0.0005) [2023-12-26 12:16:29,212][123090] Updated weights for policy 1, policy_version 1577499 (0.0009) [2023-12-26 12:16:29,265][123091] Updated weights for policy 0, policy_version 1588009 (0.0009) [2023-12-26 12:16:30,035][123091] Updated weights for policy 0, policy_version 1588019 (0.0010) [2023-12-26 12:16:30,040][123090] Updated weights for policy 1, policy_version 1577509 (0.0008) [2023-12-26 12:16:30,090][123090] Updated weights for policy 1, policy_version 1577519 (0.0008) [2023-12-26 12:16:30,091][123091] Updated weights for policy 0, policy_version 1588029 (0.0010) [2023-12-26 12:16:30,152][123090] Updated weights for policy 1, policy_version 1577529 (0.0007) [2023-12-26 12:16:30,153][123091] Updated weights for policy 0, policy_version 1588039 (0.0010) [2023-12-26 12:16:30,890][123090] Updated weights for policy 1, policy_version 1577539 (0.0006) [2023-12-26 12:16:30,944][123090] Updated weights for policy 1, policy_version 1577549 (0.0005) [2023-12-26 12:16:30,977][123091] Updated weights for policy 0, policy_version 1588049 (0.0010) [2023-12-26 12:16:31,009][123090] Updated weights for policy 1, policy_version 1577559 (0.0007) [2023-12-26 12:16:31,032][123091] Updated weights for policy 0, policy_version 1588059 (0.0011) [2023-12-26 12:16:31,089][123091] Updated weights for policy 0, policy_version 1588069 (0.0011) [2023-12-26 12:16:31,157][123091] Updated weights for policy 0, policy_version 1588079 (0.0010) [2023-12-26 12:16:31,852][123090] Updated weights for policy 1, policy_version 1577569 (0.0009) [2023-12-26 12:16:31,903][123090] Updated weights for policy 1, policy_version 1577579 (0.0008) [2023-12-26 12:16:31,961][123090] Updated weights for policy 1, policy_version 1577589 (0.0010) [2023-12-26 12:16:31,976][123091] Updated weights for policy 0, policy_version 1588089 (0.0007) [2023-12-26 12:16:32,020][123090] Updated weights for policy 1, policy_version 1577599 (0.0008) [2023-12-26 12:16:32,036][123091] Updated weights for policy 0, policy_version 1588099 (0.0007) [2023-12-26 12:16:32,097][123091] Updated weights for policy 0, policy_version 1588109 (0.0010) [2023-12-26 12:16:32,883][123090] Updated weights for policy 1, policy_version 1577609 (0.0010) [2023-12-26 12:16:32,930][123090] Updated weights for policy 1, policy_version 1577619 (0.0008) [2023-12-26 12:16:32,934][123091] Updated weights for policy 0, policy_version 1588119 (0.0008) [2023-12-26 12:16:32,978][123090] Updated weights for policy 1, policy_version 1577629 (0.0009) [2023-12-26 12:16:32,986][123091] Updated weights for policy 0, policy_version 1588129 (0.0007) [2023-12-26 12:16:33,053][123091] Updated weights for policy 0, policy_version 1588139 (0.0009) [2023-12-26 12:16:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 810442752. Throughput: 0: 8837.9, 1: 8916.8. Samples: 810458576. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:33,785][121949] Avg episode reward: [(0, '6255.382'), (1, '5254.798')] [2023-12-26 12:16:33,842][123090] Updated weights for policy 1, policy_version 1577639 (0.0010) [2023-12-26 12:16:33,861][123091] Updated weights for policy 0, policy_version 1588149 (0.0008) [2023-12-26 12:16:33,887][123090] Updated weights for policy 1, policy_version 1577649 (0.0008) [2023-12-26 12:16:33,917][123091] Updated weights for policy 0, policy_version 1588159 (0.0008) [2023-12-26 12:16:33,933][123090] Updated weights for policy 1, policy_version 1577659 (0.0008) [2023-12-26 12:16:33,979][123091] Updated weights for policy 0, policy_version 1588169 (0.0008) [2023-12-26 12:16:34,790][123091] Updated weights for policy 0, policy_version 1588179 (0.0009) [2023-12-26 12:16:34,801][123090] Updated weights for policy 1, policy_version 1577669 (0.0008) [2023-12-26 12:16:34,847][123091] Updated weights for policy 0, policy_version 1588189 (0.0009) [2023-12-26 12:16:34,859][123090] Updated weights for policy 1, policy_version 1577679 (0.0007) [2023-12-26 12:16:34,905][123091] Updated weights for policy 0, policy_version 1588199 (0.0009) [2023-12-26 12:16:34,925][123090] Updated weights for policy 1, policy_version 1577689 (0.0007) [2023-12-26 12:16:35,713][123090] Updated weights for policy 1, policy_version 1577699 (0.0007) [2023-12-26 12:16:35,756][123091] Updated weights for policy 0, policy_version 1588209 (0.0009) [2023-12-26 12:16:35,771][123090] Updated weights for policy 1, policy_version 1577709 (0.0006) [2023-12-26 12:16:35,819][123090] Updated weights for policy 1, policy_version 1577719 (0.0005) [2023-12-26 12:16:35,823][123091] Updated weights for policy 0, policy_version 1588219 (0.0009) [2023-12-26 12:16:35,880][123091] Updated weights for policy 0, policy_version 1588229 (0.0009) [2023-12-26 12:16:35,936][123091] Updated weights for policy 0, policy_version 1588239 (0.0009) [2023-12-26 12:16:36,550][123090] Updated weights for policy 1, policy_version 1577729 (0.0006) [2023-12-26 12:16:36,622][123090] Updated weights for policy 1, policy_version 1577739 (0.0009) [2023-12-26 12:16:36,684][123090] Updated weights for policy 1, policy_version 1577749 (0.0010) [2023-12-26 12:16:36,761][123090] Updated weights for policy 1, policy_version 1577759 (0.0005) [2023-12-26 12:16:36,805][123091] Updated weights for policy 0, policy_version 1588249 (0.0010) [2023-12-26 12:16:36,859][123091] Updated weights for policy 0, policy_version 1588259 (0.0010) [2023-12-26 12:16:36,913][123091] Updated weights for policy 0, policy_version 1588269 (0.0010) [2023-12-26 12:16:37,500][123090] Updated weights for policy 1, policy_version 1577769 (0.0009) [2023-12-26 12:16:37,568][123090] Updated weights for policy 1, policy_version 1577779 (0.0009) [2023-12-26 12:16:37,633][123090] Updated weights for policy 1, policy_version 1577789 (0.0010) [2023-12-26 12:16:37,765][123091] Updated weights for policy 0, policy_version 1588279 (0.0009) [2023-12-26 12:16:37,823][123091] Updated weights for policy 0, policy_version 1588289 (0.0009) [2023-12-26 12:16:37,886][123091] Updated weights for policy 0, policy_version 1588299 (0.0010) [2023-12-26 12:16:38,435][123090] Updated weights for policy 1, policy_version 1577799 (0.0010) [2023-12-26 12:16:38,498][123090] Updated weights for policy 1, policy_version 1577809 (0.0011) [2023-12-26 12:16:38,566][123090] Updated weights for policy 1, policy_version 1577819 (0.0011) [2023-12-26 12:16:38,735][123091] Updated weights for policy 0, policy_version 1588309 (0.0010) [2023-12-26 12:16:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 810532864. Throughput: 0: 8830.4, 1: 8915.7. Samples: 810510676. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:38,785][121949] Avg episode reward: [(0, '6243.424'), (1, '5390.854')] [2023-12-26 12:16:38,789][123091] Updated weights for policy 0, policy_version 1588320 (0.0010) [2023-12-26 12:16:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001577824_403922944.pth... [2023-12-26 12:16:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001576736_403644416.pth [2023-12-26 12:16:38,847][123091] Updated weights for policy 0, policy_version 1588330 (0.0010) [2023-12-26 12:16:38,876][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001588336_406618112.pth... [2023-12-26 12:16:38,879][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001587344_406364160.pth [2023-12-26 12:16:39,289][123090] Updated weights for policy 1, policy_version 1577829 (0.0011) [2023-12-26 12:16:39,368][123090] Updated weights for policy 1, policy_version 1577839 (0.0011) [2023-12-26 12:16:39,438][123090] Updated weights for policy 1, policy_version 1577849 (0.0010) [2023-12-26 12:16:39,793][123091] Updated weights for policy 0, policy_version 1588340 (0.0010) [2023-12-26 12:16:39,867][123091] Updated weights for policy 0, policy_version 1588350 (0.0007) [2023-12-26 12:16:39,942][123091] Updated weights for policy 0, policy_version 1588360 (0.0009) [2023-12-26 12:16:40,228][123090] Updated weights for policy 1, policy_version 1577859 (0.0006) [2023-12-26 12:16:40,301][123090] Updated weights for policy 1, policy_version 1577869 (0.0006) [2023-12-26 12:16:40,369][123090] Updated weights for policy 1, policy_version 1577879 (0.0007) [2023-12-26 12:16:40,746][123091] Updated weights for policy 0, policy_version 1588370 (0.0011) [2023-12-26 12:16:40,797][123091] Updated weights for policy 0, policy_version 1588380 (0.0010) [2023-12-26 12:16:40,841][123091] Updated weights for policy 0, policy_version 1588390 (0.0010) [2023-12-26 12:16:40,907][123091] Updated weights for policy 0, policy_version 1588400 (0.0011) [2023-12-26 12:16:41,034][123090] Updated weights for policy 1, policy_version 1577889 (0.0006) [2023-12-26 12:16:41,105][123090] Updated weights for policy 1, policy_version 1577899 (0.0009) [2023-12-26 12:16:41,174][123090] Updated weights for policy 1, policy_version 1577909 (0.0008) [2023-12-26 12:16:41,242][123090] Updated weights for policy 1, policy_version 1577919 (0.0006) [2023-12-26 12:16:41,746][123091] Updated weights for policy 0, policy_version 1588410 (0.0010) [2023-12-26 12:16:41,818][123091] Updated weights for policy 0, policy_version 1588420 (0.0009) [2023-12-26 12:16:41,892][123091] Updated weights for policy 0, policy_version 1588430 (0.0010) [2023-12-26 12:16:42,067][123090] Updated weights for policy 1, policy_version 1577929 (0.0009) [2023-12-26 12:16:42,139][123090] Updated weights for policy 1, policy_version 1577939 (0.0009) [2023-12-26 12:16:42,209][123090] Updated weights for policy 1, policy_version 1577949 (0.0010) [2023-12-26 12:16:42,752][123091] Updated weights for policy 0, policy_version 1588440 (0.0009) [2023-12-26 12:16:42,816][123091] Updated weights for policy 0, policy_version 1588450 (0.0009) [2023-12-26 12:16:42,886][123091] Updated weights for policy 0, policy_version 1588460 (0.0010) [2023-12-26 12:16:43,020][123090] Updated weights for policy 1, policy_version 1577959 (0.0009) [2023-12-26 12:16:43,088][123090] Updated weights for policy 1, policy_version 1577969 (0.0009) [2023-12-26 12:16:43,159][123090] Updated weights for policy 1, policy_version 1577979 (0.0009) [2023-12-26 12:16:43,729][123091] Updated weights for policy 0, policy_version 1588470 (0.0009) [2023-12-26 12:16:43,778][123091] Updated weights for policy 0, policy_version 1588480 (0.0009) [2023-12-26 12:16:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 810614784. Throughput: 0: 8580.6, 1: 8997.4. Samples: 810614856. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:43,784][121949] Avg episode reward: [(0, '6200.244'), (1, '5176.275')] [2023-12-26 12:16:43,827][123091] Updated weights for policy 0, policy_version 1588490 (0.0010) [2023-12-26 12:16:43,967][123090] Updated weights for policy 1, policy_version 1577989 (0.0010) [2023-12-26 12:16:44,025][123090] Updated weights for policy 1, policy_version 1577999 (0.0009) [2023-12-26 12:16:44,077][123090] Updated weights for policy 1, policy_version 1578009 (0.0009) [2023-12-26 12:16:44,679][123091] Updated weights for policy 0, policy_version 1588500 (0.0010) [2023-12-26 12:16:44,737][123091] Updated weights for policy 0, policy_version 1588510 (0.0010) [2023-12-26 12:16:44,795][123091] Updated weights for policy 0, policy_version 1588520 (0.0010) [2023-12-26 12:16:44,905][123090] Updated weights for policy 1, policy_version 1578019 (0.0009) [2023-12-26 12:16:44,976][123090] Updated weights for policy 1, policy_version 1578029 (0.0010) [2023-12-26 12:16:45,050][123090] Updated weights for policy 1, policy_version 1578039 (0.0010) [2023-12-26 12:16:45,664][123091] Updated weights for policy 0, policy_version 1588530 (0.0010) [2023-12-26 12:16:45,722][123091] Updated weights for policy 0, policy_version 1588540 (0.0010) [2023-12-26 12:16:45,777][123091] Updated weights for policy 0, policy_version 1588550 (0.0010) [2023-12-26 12:16:45,829][123091] Updated weights for policy 0, policy_version 1588560 (0.0010) [2023-12-26 12:16:45,839][123090] Updated weights for policy 1, policy_version 1578049 (0.0010) [2023-12-26 12:16:45,891][123090] Updated weights for policy 1, policy_version 1578059 (0.0006) [2023-12-26 12:16:45,946][123090] Updated weights for policy 1, policy_version 1578069 (0.0009) [2023-12-26 12:16:45,996][123090] Updated weights for policy 1, policy_version 1578079 (0.0009) [2023-12-26 12:16:46,691][123091] Updated weights for policy 0, policy_version 1588570 (0.0010) [2023-12-26 12:16:46,744][123091] Updated weights for policy 0, policy_version 1588580 (0.0009) [2023-12-26 12:16:46,801][123091] Updated weights for policy 0, policy_version 1588590 (0.0009) [2023-12-26 12:16:46,853][123090] Updated weights for policy 1, policy_version 1578089 (0.0010) [2023-12-26 12:16:46,923][123090] Updated weights for policy 1, policy_version 1578099 (0.0009) [2023-12-26 12:16:46,989][123090] Updated weights for policy 1, policy_version 1578109 (0.0009) [2023-12-26 12:16:47,618][123091] Updated weights for policy 0, policy_version 1588600 (0.0009) [2023-12-26 12:16:47,683][123091] Updated weights for policy 0, policy_version 1588610 (0.0009) [2023-12-26 12:16:47,740][123091] Updated weights for policy 0, policy_version 1588621 (0.0009) [2023-12-26 12:16:47,805][123090] Updated weights for policy 1, policy_version 1578119 (0.0009) [2023-12-26 12:16:47,857][123090] Updated weights for policy 1, policy_version 1578129 (0.0009) [2023-12-26 12:16:47,908][123090] Updated weights for policy 1, policy_version 1578139 (0.0009) [2023-12-26 12:16:48,564][123091] Updated weights for policy 0, policy_version 1588631 (0.0006) [2023-12-26 12:16:48,616][123091] Updated weights for policy 0, policy_version 1588641 (0.0006) [2023-12-26 12:16:48,683][123091] Updated weights for policy 0, policy_version 1588651 (0.0005) [2023-12-26 12:16:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 810704896. Throughput: 0: 8517.8, 1: 8993.4. Samples: 810716760. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:48,785][121949] Avg episode reward: [(0, '6019.564'), (1, '5041.460')] [2023-12-26 12:16:48,811][123090] Updated weights for policy 1, policy_version 1578149 (0.0010) [2023-12-26 12:16:48,861][123090] Updated weights for policy 1, policy_version 1578159 (0.0009) [2023-12-26 12:16:48,910][123090] Updated weights for policy 1, policy_version 1578169 (0.0009) [2023-12-26 12:16:49,348][123091] Updated weights for policy 0, policy_version 1588661 (0.0008) [2023-12-26 12:16:49,410][123091] Updated weights for policy 0, policy_version 1588671 (0.0007) [2023-12-26 12:16:49,472][123091] Updated weights for policy 0, policy_version 1588681 (0.0007) [2023-12-26 12:16:49,810][123090] Updated weights for policy 1, policy_version 1578179 (0.0010) [2023-12-26 12:16:49,881][123090] Updated weights for policy 1, policy_version 1578189 (0.0009) [2023-12-26 12:16:49,942][123090] Updated weights for policy 1, policy_version 1578199 (0.0009) [2023-12-26 12:16:50,177][123091] Updated weights for policy 0, policy_version 1588691 (0.0007) [2023-12-26 12:16:50,241][123091] Updated weights for policy 0, policy_version 1588701 (0.0011) [2023-12-26 12:16:50,311][123091] Updated weights for policy 0, policy_version 1588711 (0.0011) [2023-12-26 12:16:50,837][123090] Updated weights for policy 1, policy_version 1578209 (0.0009) [2023-12-26 12:16:50,899][123090] Updated weights for policy 1, policy_version 1578219 (0.0009) [2023-12-26 12:16:50,959][123090] Updated weights for policy 1, policy_version 1578229 (0.0009) [2023-12-26 12:16:51,035][123090] Updated weights for policy 1, policy_version 1578239 (0.0011) [2023-12-26 12:16:51,069][123091] Updated weights for policy 0, policy_version 1588721 (0.0009) [2023-12-26 12:16:51,139][123091] Updated weights for policy 0, policy_version 1588731 (0.0011) [2023-12-26 12:16:51,206][123091] Updated weights for policy 0, policy_version 1588741 (0.0011) [2023-12-26 12:16:51,276][123091] Updated weights for policy 0, policy_version 1588751 (0.0011) [2023-12-26 12:16:51,863][123090] Updated weights for policy 1, policy_version 1578249 (0.0008) [2023-12-26 12:16:51,928][123090] Updated weights for policy 1, policy_version 1578259 (0.0009) [2023-12-26 12:16:51,998][123090] Updated weights for policy 1, policy_version 1578269 (0.0009) [2023-12-26 12:16:52,050][123091] Updated weights for policy 0, policy_version 1588761 (0.0010) [2023-12-26 12:16:52,099][123091] Updated weights for policy 0, policy_version 1588771 (0.0010) [2023-12-26 12:16:52,160][123091] Updated weights for policy 0, policy_version 1588781 (0.0010) [2023-12-26 12:16:52,798][123090] Updated weights for policy 1, policy_version 1578279 (0.0010) [2023-12-26 12:16:52,852][123090] Updated weights for policy 1, policy_version 1578289 (0.0010) [2023-12-26 12:16:52,913][123090] Updated weights for policy 1, policy_version 1578299 (0.0009) [2023-12-26 12:16:52,953][123091] Updated weights for policy 0, policy_version 1588791 (0.0008) [2023-12-26 12:16:53,012][123091] Updated weights for policy 0, policy_version 1588801 (0.0010) [2023-12-26 12:16:53,080][123091] Updated weights for policy 0, policy_version 1588811 (0.0010) [2023-12-26 12:16:53,758][123090] Updated weights for policy 1, policy_version 1578309 (0.0007) [2023-12-26 12:16:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 810786816. Throughput: 0: 8554.5, 1: 8945.9. Samples: 810768704. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:53,785][121949] Avg episode reward: [(0, '6066.102'), (1, '5422.317')] [2023-12-26 12:16:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001588816_406740992.pth... [2023-12-26 12:16:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001587824_406487040.pth [2023-12-26 12:16:53,823][123090] Updated weights for policy 1, policy_version 1578319 (0.0009) [2023-12-26 12:16:53,884][123090] Updated weights for policy 1, policy_version 1578329 (0.0008) [2023-12-26 12:16:53,902][123091] Updated weights for policy 0, policy_version 1588821 (0.0011) [2023-12-26 12:16:53,932][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001578336_404054016.pth... [2023-12-26 12:16:53,935][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001577280_403783680.pth [2023-12-26 12:16:53,959][123091] Updated weights for policy 0, policy_version 1588831 (0.0009) [2023-12-26 12:16:54,010][123091] Updated weights for policy 0, policy_version 1588841 (0.0010) [2023-12-26 12:16:54,692][123090] Updated weights for policy 1, policy_version 1578339 (0.0008) [2023-12-26 12:16:54,743][123090] Updated weights for policy 1, policy_version 1578349 (0.0010) [2023-12-26 12:16:54,806][123090] Updated weights for policy 1, policy_version 1578359 (0.0009) [2023-12-26 12:16:54,849][123091] Updated weights for policy 0, policy_version 1588852 (0.0010) [2023-12-26 12:16:54,907][123091] Updated weights for policy 0, policy_version 1588862 (0.0008) [2023-12-26 12:16:54,985][123091] Updated weights for policy 0, policy_version 1588872 (0.0009) [2023-12-26 12:16:55,566][123090] Updated weights for policy 1, policy_version 1578369 (0.0008) [2023-12-26 12:16:55,633][123090] Updated weights for policy 1, policy_version 1578379 (0.0009) [2023-12-26 12:16:55,687][123090] Updated weights for policy 1, policy_version 1578389 (0.0009) [2023-12-26 12:16:55,736][123090] Updated weights for policy 1, policy_version 1578399 (0.0009) [2023-12-26 12:16:55,754][123091] Updated weights for policy 0, policy_version 1588882 (0.0007) [2023-12-26 12:16:55,800][123091] Updated weights for policy 0, policy_version 1588892 (0.0009) [2023-12-26 12:16:55,849][123091] Updated weights for policy 0, policy_version 1588902 (0.0010) [2023-12-26 12:16:55,901][123091] Updated weights for policy 0, policy_version 1588912 (0.0010) [2023-12-26 12:16:56,562][123090] Updated weights for policy 1, policy_version 1578409 (0.0009) [2023-12-26 12:16:56,621][123090] Updated weights for policy 1, policy_version 1578419 (0.0009) [2023-12-26 12:16:56,680][123090] Updated weights for policy 1, policy_version 1578429 (0.0009) [2023-12-26 12:16:56,765][123091] Updated weights for policy 0, policy_version 1588922 (0.0010) [2023-12-26 12:16:56,826][123091] Updated weights for policy 0, policy_version 1588932 (0.0010) [2023-12-26 12:16:56,878][123091] Updated weights for policy 0, policy_version 1588942 (0.0009) [2023-12-26 12:16:57,510][123090] Updated weights for policy 1, policy_version 1578439 (0.0010) [2023-12-26 12:16:57,557][123090] Updated weights for policy 1, policy_version 1578449 (0.0008) [2023-12-26 12:16:57,610][123090] Updated weights for policy 1, policy_version 1578459 (0.0009) [2023-12-26 12:16:57,687][123091] Updated weights for policy 0, policy_version 1588952 (0.0009) [2023-12-26 12:16:57,745][123091] Updated weights for policy 0, policy_version 1588962 (0.0009) [2023-12-26 12:16:57,800][123091] Updated weights for policy 0, policy_version 1588972 (0.0009) [2023-12-26 12:16:58,427][123090] Updated weights for policy 1, policy_version 1578469 (0.0010) [2023-12-26 12:16:58,498][123090] Updated weights for policy 1, policy_version 1578479 (0.0007) [2023-12-26 12:16:58,570][123090] Updated weights for policy 1, policy_version 1578489 (0.0008) [2023-12-26 12:16:58,707][123091] Updated weights for policy 0, policy_version 1588982 (0.0009) [2023-12-26 12:16:58,776][123091] Updated weights for policy 0, policy_version 1588992 (0.0010) [2023-12-26 12:16:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 810876928. Throughput: 0: 8556.6, 1: 8932.1. Samples: 810873496. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:16:58,785][121949] Avg episode reward: [(0, '6131.469'), (1, '5560.801')] [2023-12-26 12:16:58,845][123091] Updated weights for policy 0, policy_version 1589002 (0.0010) [2023-12-26 12:16:59,340][123090] Updated weights for policy 1, policy_version 1578499 (0.0008) [2023-12-26 12:16:59,410][123090] Updated weights for policy 1, policy_version 1578509 (0.0010) [2023-12-26 12:16:59,479][123090] Updated weights for policy 1, policy_version 1578519 (0.0008) [2023-12-26 12:16:59,690][123091] Updated weights for policy 0, policy_version 1589012 (0.0009) [2023-12-26 12:16:59,756][123091] Updated weights for policy 0, policy_version 1589023 (0.0009) [2023-12-26 12:16:59,807][123091] Updated weights for policy 0, policy_version 1589033 (0.0009) [2023-12-26 12:17:00,233][123090] Updated weights for policy 1, policy_version 1578529 (0.0006) [2023-12-26 12:17:00,284][123090] Updated weights for policy 1, policy_version 1578539 (0.0009) [2023-12-26 12:17:00,337][123090] Updated weights for policy 1, policy_version 1578549 (0.0009) [2023-12-26 12:17:00,398][123090] Updated weights for policy 1, policy_version 1578559 (0.0007) [2023-12-26 12:17:00,621][123091] Updated weights for policy 0, policy_version 1589043 (0.0007) [2023-12-26 12:17:00,681][123091] Updated weights for policy 0, policy_version 1589053 (0.0005) [2023-12-26 12:17:00,743][123091] Updated weights for policy 0, policy_version 1589063 (0.0006) [2023-12-26 12:17:01,172][123090] Updated weights for policy 1, policy_version 1578569 (0.0009) [2023-12-26 12:17:01,240][123090] Updated weights for policy 1, policy_version 1578579 (0.0006) [2023-12-26 12:17:01,309][123090] Updated weights for policy 1, policy_version 1578589 (0.0006) [2023-12-26 12:17:01,427][123091] Updated weights for policy 0, policy_version 1589073 (0.0005) [2023-12-26 12:17:01,493][123091] Updated weights for policy 0, policy_version 1589083 (0.0009) [2023-12-26 12:17:01,562][123091] Updated weights for policy 0, policy_version 1589093 (0.0009) [2023-12-26 12:17:01,628][123091] Updated weights for policy 0, policy_version 1589103 (0.0009) [2023-12-26 12:17:02,030][123090] Updated weights for policy 1, policy_version 1578599 (0.0007) [2023-12-26 12:17:02,082][123090] Updated weights for policy 1, policy_version 1578609 (0.0009) [2023-12-26 12:17:02,135][123090] Updated weights for policy 1, policy_version 1578619 (0.0008) [2023-12-26 12:17:02,497][123091] Updated weights for policy 0, policy_version 1589113 (0.0010) [2023-12-26 12:17:02,565][123091] Updated weights for policy 0, policy_version 1589123 (0.0010) [2023-12-26 12:17:02,630][123091] Updated weights for policy 0, policy_version 1589133 (0.0009) [2023-12-26 12:17:03,004][123090] Updated weights for policy 1, policy_version 1578629 (0.0010) [2023-12-26 12:17:03,058][123090] Updated weights for policy 1, policy_version 1578639 (0.0010) [2023-12-26 12:17:03,117][123090] Updated weights for policy 1, policy_version 1578649 (0.0009) [2023-12-26 12:17:03,480][123091] Updated weights for policy 0, policy_version 1589143 (0.0010) [2023-12-26 12:17:03,539][123091] Updated weights for policy 0, policy_version 1589153 (0.0009) [2023-12-26 12:17:03,594][123091] Updated weights for policy 0, policy_version 1589163 (0.0009) [2023-12-26 12:17:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 810967040. Throughput: 0: 8544.6, 1: 8848.5. Samples: 810978320. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:03,784][121949] Avg episode reward: [(0, '6026.034'), (1, '5399.724')] [2023-12-26 12:17:03,889][123090] Updated weights for policy 1, policy_version 1578659 (0.0010) [2023-12-26 12:17:03,953][123090] Updated weights for policy 1, policy_version 1578669 (0.0009) [2023-12-26 12:17:04,013][123090] Updated weights for policy 1, policy_version 1578679 (0.0009) [2023-12-26 12:17:04,434][123091] Updated weights for policy 0, policy_version 1589173 (0.0010) [2023-12-26 12:17:04,496][123091] Updated weights for policy 0, policy_version 1589183 (0.0009) [2023-12-26 12:17:04,561][123091] Updated weights for policy 0, policy_version 1589193 (0.0009) [2023-12-26 12:17:04,847][123090] Updated weights for policy 1, policy_version 1578689 (0.0010) [2023-12-26 12:17:04,907][123090] Updated weights for policy 1, policy_version 1578699 (0.0009) [2023-12-26 12:17:04,955][123090] Updated weights for policy 1, policy_version 1578709 (0.0008) [2023-12-26 12:17:05,015][123090] Updated weights for policy 1, policy_version 1578719 (0.0009) [2023-12-26 12:17:05,374][123091] Updated weights for policy 0, policy_version 1589203 (0.0010) [2023-12-26 12:17:05,432][123091] Updated weights for policy 0, policy_version 1589213 (0.0010) [2023-12-26 12:17:05,479][123091] Updated weights for policy 0, policy_version 1589223 (0.0010) [2023-12-26 12:17:05,877][123090] Updated weights for policy 1, policy_version 1578729 (0.0009) [2023-12-26 12:17:05,942][123090] Updated weights for policy 1, policy_version 1578739 (0.0009) [2023-12-26 12:17:06,014][123090] Updated weights for policy 1, policy_version 1578749 (0.0009) [2023-12-26 12:17:06,337][123091] Updated weights for policy 0, policy_version 1589233 (0.0010) [2023-12-26 12:17:06,408][123091] Updated weights for policy 0, policy_version 1589243 (0.0011) [2023-12-26 12:17:06,471][123091] Updated weights for policy 0, policy_version 1589253 (0.0011) [2023-12-26 12:17:06,537][123091] Updated weights for policy 0, policy_version 1589263 (0.0011) [2023-12-26 12:17:06,855][123090] Updated weights for policy 1, policy_version 1578759 (0.0010) [2023-12-26 12:17:06,903][123090] Updated weights for policy 1, policy_version 1578769 (0.0010) [2023-12-26 12:17:06,958][123090] Updated weights for policy 1, policy_version 1578779 (0.0010) [2023-12-26 12:17:07,271][123091] Updated weights for policy 0, policy_version 1589273 (0.0006) [2023-12-26 12:17:07,329][123091] Updated weights for policy 0, policy_version 1589283 (0.0008) [2023-12-26 12:17:07,392][123091] Updated weights for policy 0, policy_version 1589293 (0.0011) [2023-12-26 12:17:07,782][123090] Updated weights for policy 1, policy_version 1578789 (0.0008) [2023-12-26 12:17:07,842][123090] Updated weights for policy 1, policy_version 1578799 (0.0007) [2023-12-26 12:17:07,894][123090] Updated weights for policy 1, policy_version 1578809 (0.0009) [2023-12-26 12:17:08,153][123091] Updated weights for policy 0, policy_version 1589303 (0.0010) [2023-12-26 12:17:08,209][123091] Updated weights for policy 0, policy_version 1589313 (0.0010) [2023-12-26 12:17:08,256][123091] Updated weights for policy 0, policy_version 1589323 (0.0010) [2023-12-26 12:17:08,736][123090] Updated weights for policy 1, policy_version 1578819 (0.0008) [2023-12-26 12:17:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 811048960. Throughput: 0: 8515.2, 1: 8855.3. Samples: 811029164. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:08,785][121949] Avg episode reward: [(0, '6102.326'), (1, '5573.108')] [2023-12-26 12:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001589328_406872064.pth... [2023-12-26 12:17:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001588336_406618112.pth [2023-12-26 12:17:08,804][123090] Updated weights for policy 1, policy_version 1578829 (0.0009) [2023-12-26 12:17:08,861][123090] Updated weights for policy 1, policy_version 1578839 (0.0009) [2023-12-26 12:17:08,918][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001578848_404185088.pth... [2023-12-26 12:17:08,922][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001577824_403922944.pth [2023-12-26 12:17:09,093][123091] Updated weights for policy 0, policy_version 1589333 (0.0011) [2023-12-26 12:17:09,144][123091] Updated weights for policy 0, policy_version 1589343 (0.0010) [2023-12-26 12:17:09,203][123091] Updated weights for policy 0, policy_version 1589353 (0.0011) [2023-12-26 12:17:09,662][123090] Updated weights for policy 1, policy_version 1578849 (0.0009) [2023-12-26 12:17:09,722][123090] Updated weights for policy 1, policy_version 1578859 (0.0006) [2023-12-26 12:17:09,788][123090] Updated weights for policy 1, policy_version 1578869 (0.0009) [2023-12-26 12:17:09,856][123090] Updated weights for policy 1, policy_version 1578879 (0.0009) [2023-12-26 12:17:10,046][123091] Updated weights for policy 0, policy_version 1589363 (0.0010) [2023-12-26 12:17:10,109][123091] Updated weights for policy 0, policy_version 1589373 (0.0011) [2023-12-26 12:17:10,165][123091] Updated weights for policy 0, policy_version 1589383 (0.0010) [2023-12-26 12:17:10,686][123090] Updated weights for policy 1, policy_version 1578889 (0.0006) [2023-12-26 12:17:10,752][123090] Updated weights for policy 1, policy_version 1578899 (0.0008) [2023-12-26 12:17:10,802][123090] Updated weights for policy 1, policy_version 1578909 (0.0007) [2023-12-26 12:17:10,993][123091] Updated weights for policy 0, policy_version 1589393 (0.0010) [2023-12-26 12:17:11,063][123091] Updated weights for policy 0, policy_version 1589403 (0.0011) [2023-12-26 12:17:11,132][123091] Updated weights for policy 0, policy_version 1589413 (0.0010) [2023-12-26 12:17:11,202][123091] Updated weights for policy 0, policy_version 1589423 (0.0010) [2023-12-26 12:17:11,596][123090] Updated weights for policy 1, policy_version 1578919 (0.0009) [2023-12-26 12:17:11,665][123090] Updated weights for policy 1, policy_version 1578929 (0.0011) [2023-12-26 12:17:11,734][123090] Updated weights for policy 1, policy_version 1578939 (0.0011) [2023-12-26 12:17:12,022][123091] Updated weights for policy 0, policy_version 1589433 (0.0010) [2023-12-26 12:17:12,086][123091] Updated weights for policy 0, policy_version 1589443 (0.0011) [2023-12-26 12:17:12,146][123091] Updated weights for policy 0, policy_version 1589453 (0.0011) [2023-12-26 12:17:12,575][123090] Updated weights for policy 1, policy_version 1578949 (0.0011) [2023-12-26 12:17:12,644][123090] Updated weights for policy 1, policy_version 1578959 (0.0011) [2023-12-26 12:17:12,706][123090] Updated weights for policy 1, policy_version 1578969 (0.0011) [2023-12-26 12:17:12,964][123091] Updated weights for policy 0, policy_version 1589463 (0.0007) [2023-12-26 12:17:13,017][123091] Updated weights for policy 0, policy_version 1589473 (0.0005) [2023-12-26 12:17:13,068][123091] Updated weights for policy 0, policy_version 1589483 (0.0005) [2023-12-26 12:17:13,412][123090] Updated weights for policy 1, policy_version 1578979 (0.0009) [2023-12-26 12:17:13,478][123090] Updated weights for policy 1, policy_version 1578989 (0.0005) [2023-12-26 12:17:13,541][123090] Updated weights for policy 1, policy_version 1578999 (0.0005) [2023-12-26 12:17:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 811139072. Throughput: 0: 8596.0, 1: 8722.1. Samples: 811133880. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:13,784][121949] Avg episode reward: [(0, '6114.507'), (1, '5642.303')] [2023-12-26 12:17:13,820][123091] Updated weights for policy 0, policy_version 1589493 (0.0006) [2023-12-26 12:17:13,873][123091] Updated weights for policy 0, policy_version 1589503 (0.0005) [2023-12-26 12:17:13,930][123091] Updated weights for policy 0, policy_version 1589513 (0.0005) [2023-12-26 12:17:14,110][123090] Updated weights for policy 1, policy_version 1579009 (0.0005) [2023-12-26 12:17:14,165][123090] Updated weights for policy 1, policy_version 1579019 (0.0005) [2023-12-26 12:17:14,238][123090] Updated weights for policy 1, policy_version 1579029 (0.0006) [2023-12-26 12:17:14,313][123090] Updated weights for policy 1, policy_version 1579039 (0.0005) [2023-12-26 12:17:14,648][123091] Updated weights for policy 0, policy_version 1589523 (0.0007) [2023-12-26 12:17:14,713][123091] Updated weights for policy 0, policy_version 1589533 (0.0009) [2023-12-26 12:17:14,783][123091] Updated weights for policy 0, policy_version 1589543 (0.0010) [2023-12-26 12:17:15,050][123090] Updated weights for policy 1, policy_version 1579049 (0.0006) [2023-12-26 12:17:15,120][123090] Updated weights for policy 1, policy_version 1579059 (0.0009) [2023-12-26 12:17:15,190][123090] Updated weights for policy 1, policy_version 1579069 (0.0009) [2023-12-26 12:17:15,548][123091] Updated weights for policy 0, policy_version 1589553 (0.0008) [2023-12-26 12:17:15,601][123091] Updated weights for policy 0, policy_version 1589563 (0.0009) [2023-12-26 12:17:15,650][123091] Updated weights for policy 0, policy_version 1589573 (0.0009) [2023-12-26 12:17:15,701][123091] Updated weights for policy 0, policy_version 1589583 (0.0009) [2023-12-26 12:17:15,893][123090] Updated weights for policy 1, policy_version 1579079 (0.0006) [2023-12-26 12:17:15,950][123090] Updated weights for policy 1, policy_version 1579089 (0.0005) [2023-12-26 12:17:16,008][123090] Updated weights for policy 1, policy_version 1579099 (0.0007) [2023-12-26 12:17:16,532][123091] Updated weights for policy 0, policy_version 1589593 (0.0006) [2023-12-26 12:17:16,579][123091] Updated weights for policy 0, policy_version 1589603 (0.0005) [2023-12-26 12:17:16,626][123091] Updated weights for policy 0, policy_version 1589613 (0.0005) [2023-12-26 12:17:16,804][123090] Updated weights for policy 1, policy_version 1579109 (0.0007) [2023-12-26 12:17:16,877][123090] Updated weights for policy 1, policy_version 1579119 (0.0005) [2023-12-26 12:17:16,949][123090] Updated weights for policy 1, policy_version 1579129 (0.0007) [2023-12-26 12:17:17,418][123091] Updated weights for policy 0, policy_version 1589623 (0.0009) [2023-12-26 12:17:17,490][123091] Updated weights for policy 0, policy_version 1589633 (0.0010) [2023-12-26 12:17:17,556][123091] Updated weights for policy 0, policy_version 1589643 (0.0010) [2023-12-26 12:17:17,620][123090] Updated weights for policy 1, policy_version 1579139 (0.0008) [2023-12-26 12:17:17,666][123090] Updated weights for policy 1, policy_version 1579149 (0.0005) [2023-12-26 12:17:17,720][123090] Updated weights for policy 1, policy_version 1579159 (0.0005) [2023-12-26 12:17:18,302][123091] Updated weights for policy 0, policy_version 1589653 (0.0008) [2023-12-26 12:17:18,375][123091] Updated weights for policy 0, policy_version 1589666 (0.0006) [2023-12-26 12:17:18,409][123090] Updated weights for policy 1, policy_version 1579169 (0.0006) [2023-12-26 12:17:18,447][123091] Updated weights for policy 0, policy_version 1589676 (0.0007) [2023-12-26 12:17:18,479][123090] Updated weights for policy 1, policy_version 1579179 (0.0008) [2023-12-26 12:17:18,550][123090] Updated weights for policy 1, policy_version 1579189 (0.0008) [2023-12-26 12:17:18,614][123090] Updated weights for policy 1, policy_version 1579199 (0.0008) [2023-12-26 12:17:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 811237376. Throughput: 0: 8681.0, 1: 8821.3. Samples: 811246180. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:18,785][121949] Avg episode reward: [(0, '6116.174'), (1, '5630.869')] [2023-12-26 12:17:19,195][123091] Updated weights for policy 0, policy_version 1589686 (0.0007) [2023-12-26 12:17:19,271][123091] Updated weights for policy 0, policy_version 1589696 (0.0009) [2023-12-26 12:17:19,328][123091] Updated weights for policy 0, policy_version 1589706 (0.0009) [2023-12-26 12:17:19,380][123090] Updated weights for policy 1, policy_version 1579209 (0.0009) [2023-12-26 12:17:19,445][123090] Updated weights for policy 1, policy_version 1579219 (0.0010) [2023-12-26 12:17:19,516][123090] Updated weights for policy 1, policy_version 1579229 (0.0008) [2023-12-26 12:17:20,147][123091] Updated weights for policy 0, policy_version 1589716 (0.0010) [2023-12-26 12:17:20,218][123091] Updated weights for policy 0, policy_version 1589726 (0.0009) [2023-12-26 12:17:20,290][123091] Updated weights for policy 0, policy_version 1589736 (0.0009) [2023-12-26 12:17:20,296][123090] Updated weights for policy 1, policy_version 1579239 (0.0009) [2023-12-26 12:17:20,359][123090] Updated weights for policy 1, policy_version 1579249 (0.0009) [2023-12-26 12:17:20,419][123090] Updated weights for policy 1, policy_version 1579259 (0.0009) [2023-12-26 12:17:21,161][123091] Updated weights for policy 0, policy_version 1589746 (0.0006) [2023-12-26 12:17:21,215][123090] Updated weights for policy 1, policy_version 1579269 (0.0008) [2023-12-26 12:17:21,227][123091] Updated weights for policy 0, policy_version 1589756 (0.0009) [2023-12-26 12:17:21,283][123090] Updated weights for policy 1, policy_version 1579279 (0.0007) [2023-12-26 12:17:21,303][123091] Updated weights for policy 0, policy_version 1589766 (0.0007) [2023-12-26 12:17:21,343][123090] Updated weights for policy 1, policy_version 1579289 (0.0008) [2023-12-26 12:17:21,379][123091] Updated weights for policy 0, policy_version 1589776 (0.0008) [2023-12-26 12:17:22,087][123090] Updated weights for policy 1, policy_version 1579299 (0.0007) [2023-12-26 12:17:22,157][123090] Updated weights for policy 1, policy_version 1579309 (0.0007) [2023-12-26 12:17:22,218][123091] Updated weights for policy 0, policy_version 1589786 (0.0009) [2023-12-26 12:17:22,227][123090] Updated weights for policy 1, policy_version 1579319 (0.0007) [2023-12-26 12:17:22,288][123091] Updated weights for policy 0, policy_version 1589796 (0.0009) [2023-12-26 12:17:22,359][123091] Updated weights for policy 0, policy_version 1589806 (0.0009) [2023-12-26 12:17:22,993][123090] Updated weights for policy 1, policy_version 1579329 (0.0006) [2023-12-26 12:17:23,059][123090] Updated weights for policy 1, policy_version 1579339 (0.0010) [2023-12-26 12:17:23,118][123090] Updated weights for policy 1, policy_version 1579349 (0.0010) [2023-12-26 12:17:23,170][123091] Updated weights for policy 0, policy_version 1589816 (0.0008) [2023-12-26 12:17:23,181][123090] Updated weights for policy 1, policy_version 1579359 (0.0008) [2023-12-26 12:17:23,230][123091] Updated weights for policy 0, policy_version 1589826 (0.0008) [2023-12-26 12:17:23,287][123091] Updated weights for policy 0, policy_version 1589836 (0.0009) [2023-12-26 12:17:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 811319296. Throughput: 0: 8675.5, 1: 8808.9. Samples: 811297480. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:23,785][121949] Avg episode reward: [(0, '5941.959'), (1, '5508.374')] [2023-12-26 12:17:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001579360_404316160.pth... [2023-12-26 12:17:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001589840_407003136.pth... [2023-12-26 12:17:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001588816_406740992.pth [2023-12-26 12:17:23,807][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001578336_404054016.pth [2023-12-26 12:17:24,006][123090] Updated weights for policy 1, policy_version 1579369 (0.0010) [2023-12-26 12:17:24,068][123090] Updated weights for policy 1, policy_version 1579379 (0.0010) [2023-12-26 12:17:24,080][123091] Updated weights for policy 0, policy_version 1589846 (0.0007) [2023-12-26 12:17:24,135][123090] Updated weights for policy 1, policy_version 1579389 (0.0011) [2023-12-26 12:17:24,145][123091] Updated weights for policy 0, policy_version 1589856 (0.0005) [2023-12-26 12:17:24,213][123091] Updated weights for policy 0, policy_version 1589866 (0.0006) [2023-12-26 12:17:24,900][123091] Updated weights for policy 0, policy_version 1589876 (0.0007) [2023-12-26 12:17:24,965][123090] Updated weights for policy 1, policy_version 1579399 (0.0010) [2023-12-26 12:17:24,971][123091] Updated weights for policy 0, policy_version 1589886 (0.0006) [2023-12-26 12:17:25,029][123090] Updated weights for policy 1, policy_version 1579409 (0.0007) [2023-12-26 12:17:25,034][123091] Updated weights for policy 0, policy_version 1589896 (0.0008) [2023-12-26 12:17:25,091][123090] Updated weights for policy 1, policy_version 1579419 (0.0006) [2023-12-26 12:17:25,778][123090] Updated weights for policy 1, policy_version 1579429 (0.0005) [2023-12-26 12:17:25,829][123091] Updated weights for policy 0, policy_version 1589906 (0.0007) [2023-12-26 12:17:25,844][123090] Updated weights for policy 1, policy_version 1579439 (0.0009) [2023-12-26 12:17:25,899][123091] Updated weights for policy 0, policy_version 1589916 (0.0008) [2023-12-26 12:17:25,908][123090] Updated weights for policy 1, policy_version 1579449 (0.0007) [2023-12-26 12:17:25,957][123091] Updated weights for policy 0, policy_version 1589926 (0.0008) [2023-12-26 12:17:26,024][123091] Updated weights for policy 0, policy_version 1589936 (0.0009) [2023-12-26 12:17:26,624][123090] Updated weights for policy 1, policy_version 1579459 (0.0007) [2023-12-26 12:17:26,685][123090] Updated weights for policy 1, policy_version 1579469 (0.0006) [2023-12-26 12:17:26,687][123091] Updated weights for policy 0, policy_version 1589946 (0.0006) [2023-12-26 12:17:26,744][123091] Updated weights for policy 0, policy_version 1589956 (0.0005) [2023-12-26 12:17:26,747][123090] Updated weights for policy 1, policy_version 1579479 (0.0005) [2023-12-26 12:17:26,807][123091] Updated weights for policy 0, policy_version 1589966 (0.0005) [2023-12-26 12:17:27,403][123090] Updated weights for policy 1, policy_version 1579489 (0.0005) [2023-12-26 12:17:27,452][123090] Updated weights for policy 1, policy_version 1579499 (0.0005) [2023-12-26 12:17:27,502][123090] Updated weights for policy 1, policy_version 1579509 (0.0005) [2023-12-26 12:17:27,550][123090] Updated weights for policy 1, policy_version 1579519 (0.0005) [2023-12-26 12:17:27,673][123091] Updated weights for policy 0, policy_version 1589976 (0.0010) [2023-12-26 12:17:27,730][123091] Updated weights for policy 0, policy_version 1589986 (0.0013) [2023-12-26 12:17:27,793][123091] Updated weights for policy 0, policy_version 1589996 (0.0009) [2023-12-26 12:17:28,228][123090] Updated weights for policy 1, policy_version 1579529 (0.0005) [2023-12-26 12:17:28,294][123090] Updated weights for policy 1, policy_version 1579539 (0.0005) [2023-12-26 12:17:28,363][123090] Updated weights for policy 1, policy_version 1579549 (0.0007) [2023-12-26 12:17:28,675][123091] Updated weights for policy 0, policy_version 1590006 (0.0009) [2023-12-26 12:17:28,740][123091] Updated weights for policy 0, policy_version 1590016 (0.0009) [2023-12-26 12:17:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 811409408. Throughput: 0: 8762.8, 1: 8853.1. Samples: 811407572. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:28,785][121949] Avg episode reward: [(0, '5850.955'), (1, '5572.805')] [2023-12-26 12:17:28,791][123091] Updated weights for policy 0, policy_version 1590026 (0.0009) [2023-12-26 12:17:29,165][123090] Updated weights for policy 1, policy_version 1579559 (0.0006) [2023-12-26 12:17:29,233][123090] Updated weights for policy 1, policy_version 1579569 (0.0009) [2023-12-26 12:17:29,303][123090] Updated weights for policy 1, policy_version 1579579 (0.0009) [2023-12-26 12:17:29,654][123091] Updated weights for policy 0, policy_version 1590036 (0.0009) [2023-12-26 12:17:29,709][123091] Updated weights for policy 0, policy_version 1590046 (0.0010) [2023-12-26 12:17:29,764][123091] Updated weights for policy 0, policy_version 1590057 (0.0010) [2023-12-26 12:17:30,010][123090] Updated weights for policy 1, policy_version 1579589 (0.0010) [2023-12-26 12:17:30,066][123090] Updated weights for policy 1, policy_version 1579599 (0.0009) [2023-12-26 12:17:30,130][123090] Updated weights for policy 1, policy_version 1579609 (0.0009) [2023-12-26 12:17:30,631][123091] Updated weights for policy 0, policy_version 1590067 (0.0010) [2023-12-26 12:17:30,681][123091] Updated weights for policy 0, policy_version 1590077 (0.0009) [2023-12-26 12:17:30,735][123091] Updated weights for policy 0, policy_version 1590087 (0.0009) [2023-12-26 12:17:30,928][123090] Updated weights for policy 1, policy_version 1579619 (0.0008) [2023-12-26 12:17:30,986][123090] Updated weights for policy 1, policy_version 1579629 (0.0007) [2023-12-26 12:17:31,050][123090] Updated weights for policy 1, policy_version 1579639 (0.0007) [2023-12-26 12:17:31,546][123091] Updated weights for policy 0, policy_version 1590097 (0.0008) [2023-12-26 12:17:31,604][123091] Updated weights for policy 0, policy_version 1590107 (0.0007) [2023-12-26 12:17:31,671][123091] Updated weights for policy 0, policy_version 1590117 (0.0008) [2023-12-26 12:17:31,732][123091] Updated weights for policy 0, policy_version 1590127 (0.0009) [2023-12-26 12:17:31,908][123090] Updated weights for policy 1, policy_version 1579649 (0.0008) [2023-12-26 12:17:31,968][123090] Updated weights for policy 1, policy_version 1579659 (0.0005) [2023-12-26 12:17:32,024][123090] Updated weights for policy 1, policy_version 1579669 (0.0005) [2023-12-26 12:17:32,094][123090] Updated weights for policy 1, policy_version 1579679 (0.0006) [2023-12-26 12:17:32,514][123091] Updated weights for policy 0, policy_version 1590137 (0.0006) [2023-12-26 12:17:32,584][123091] Updated weights for policy 0, policy_version 1590147 (0.0007) [2023-12-26 12:17:32,644][123091] Updated weights for policy 0, policy_version 1590157 (0.0010) [2023-12-26 12:17:32,738][123090] Updated weights for policy 1, policy_version 1579689 (0.0006) [2023-12-26 12:17:32,791][123090] Updated weights for policy 1, policy_version 1579699 (0.0005) [2023-12-26 12:17:32,840][123090] Updated weights for policy 1, policy_version 1579709 (0.0006) [2023-12-26 12:17:33,439][123091] Updated weights for policy 0, policy_version 1590167 (0.0009) [2023-12-26 12:17:33,487][123091] Updated weights for policy 0, policy_version 1590177 (0.0009) [2023-12-26 12:17:33,534][123091] Updated weights for policy 0, policy_version 1590188 (0.0010) [2023-12-26 12:17:33,640][123090] Updated weights for policy 1, policy_version 1579719 (0.0008) [2023-12-26 12:17:33,700][123090] Updated weights for policy 1, policy_version 1579729 (0.0009) [2023-12-26 12:17:33,760][123090] Updated weights for policy 1, policy_version 1579739 (0.0009) [2023-12-26 12:17:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 811507712. Throughput: 0: 8752.9, 1: 8950.5. Samples: 811513412. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:33,784][121949] Avg episode reward: [(0, '6102.607'), (1, '5629.819')] [2023-12-26 12:17:34,412][123091] Updated weights for policy 0, policy_version 1590198 (0.0010) [2023-12-26 12:17:34,476][123091] Updated weights for policy 0, policy_version 1590208 (0.0011) [2023-12-26 12:17:34,536][123091] Updated weights for policy 0, policy_version 1590218 (0.0009) [2023-12-26 12:17:34,662][123090] Updated weights for policy 1, policy_version 1579749 (0.0009) [2023-12-26 12:17:34,725][123090] Updated weights for policy 1, policy_version 1579759 (0.0009) [2023-12-26 12:17:34,781][123090] Updated weights for policy 1, policy_version 1579769 (0.0009) [2023-12-26 12:17:35,168][123091] Updated weights for policy 0, policy_version 1590228 (0.0006) [2023-12-26 12:17:35,237][123091] Updated weights for policy 0, policy_version 1590238 (0.0007) [2023-12-26 12:17:35,302][123091] Updated weights for policy 0, policy_version 1590248 (0.0009) [2023-12-26 12:17:35,623][123090] Updated weights for policy 1, policy_version 1579779 (0.0009) [2023-12-26 12:17:35,687][123090] Updated weights for policy 1, policy_version 1579789 (0.0005) [2023-12-26 12:17:35,755][123090] Updated weights for policy 1, policy_version 1579799 (0.0007) [2023-12-26 12:17:36,120][123091] Updated weights for policy 0, policy_version 1590258 (0.0009) [2023-12-26 12:17:36,174][123091] Updated weights for policy 0, policy_version 1590268 (0.0008) [2023-12-26 12:17:36,229][123091] Updated weights for policy 0, policy_version 1590278 (0.0006) [2023-12-26 12:17:36,285][123091] Updated weights for policy 0, policy_version 1590288 (0.0010) [2023-12-26 12:17:36,548][123090] Updated weights for policy 1, policy_version 1579809 (0.0010) [2023-12-26 12:17:36,606][123090] Updated weights for policy 1, policy_version 1579820 (0.0010) [2023-12-26 12:17:36,666][123090] Updated weights for policy 1, policy_version 1579830 (0.0010) [2023-12-26 12:17:36,738][123090] Updated weights for policy 1, policy_version 1579840 (0.0008) [2023-12-26 12:17:37,131][123091] Updated weights for policy 0, policy_version 1590298 (0.0010) [2023-12-26 12:17:37,197][123091] Updated weights for policy 0, policy_version 1590308 (0.0007) [2023-12-26 12:17:37,254][123091] Updated weights for policy 0, policy_version 1590318 (0.0008) [2023-12-26 12:17:37,511][123090] Updated weights for policy 1, policy_version 1579850 (0.0008) [2023-12-26 12:17:37,564][123090] Updated weights for policy 1, policy_version 1579860 (0.0010) [2023-12-26 12:17:37,622][123090] Updated weights for policy 1, policy_version 1579870 (0.0009) [2023-12-26 12:17:38,063][123091] Updated weights for policy 0, policy_version 1590328 (0.0009) [2023-12-26 12:17:38,121][123091] Updated weights for policy 0, policy_version 1590338 (0.0010) [2023-12-26 12:17:38,177][123091] Updated weights for policy 0, policy_version 1590349 (0.0011) [2023-12-26 12:17:38,497][123090] Updated weights for policy 1, policy_version 1579880 (0.0007) [2023-12-26 12:17:38,569][123090] Updated weights for policy 1, policy_version 1579890 (0.0006) [2023-12-26 12:17:38,631][123090] Updated weights for policy 1, policy_version 1579900 (0.0005) [2023-12-26 12:17:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 811589632. Throughput: 0: 8735.3, 1: 8975.0. Samples: 811565668. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:38,785][121949] Avg episode reward: [(0, '6086.214'), (1, '5435.156')] [2023-12-26 12:17:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001590352_407134208.pth... [2023-12-26 12:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001579904_404455424.pth... [2023-12-26 12:17:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001589328_406872064.pth [2023-12-26 12:17:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001578848_404185088.pth [2023-12-26 12:17:39,029][123091] Updated weights for policy 0, policy_version 1590359 (0.0010) [2023-12-26 12:17:39,078][123091] Updated weights for policy 0, policy_version 1590370 (0.0009) [2023-12-26 12:17:39,128][123091] Updated weights for policy 0, policy_version 1590380 (0.0009) [2023-12-26 12:17:39,383][123090] Updated weights for policy 1, policy_version 1579910 (0.0008) [2023-12-26 12:17:39,455][123090] Updated weights for policy 1, policy_version 1579920 (0.0010) [2023-12-26 12:17:39,526][123090] Updated weights for policy 1, policy_version 1579930 (0.0009) [2023-12-26 12:17:40,012][123091] Updated weights for policy 0, policy_version 1590390 (0.0010) [2023-12-26 12:17:40,081][123091] Updated weights for policy 0, policy_version 1590400 (0.0010) [2023-12-26 12:17:40,159][123091] Updated weights for policy 0, policy_version 1590410 (0.0010) [2023-12-26 12:17:40,330][123090] Updated weights for policy 1, policy_version 1579940 (0.0009) [2023-12-26 12:17:40,383][123090] Updated weights for policy 1, policy_version 1579950 (0.0009) [2023-12-26 12:17:40,447][123090] Updated weights for policy 1, policy_version 1579960 (0.0010) [2023-12-26 12:17:40,929][123091] Updated weights for policy 0, policy_version 1590420 (0.0008) [2023-12-26 12:17:40,987][123091] Updated weights for policy 0, policy_version 1590430 (0.0006) [2023-12-26 12:17:41,053][123091] Updated weights for policy 0, policy_version 1590440 (0.0010) [2023-12-26 12:17:41,382][123090] Updated weights for policy 1, policy_version 1579970 (0.0010) [2023-12-26 12:17:41,453][123090] Updated weights for policy 1, policy_version 1579980 (0.0010) [2023-12-26 12:17:41,520][123090] Updated weights for policy 1, policy_version 1579990 (0.0008) [2023-12-26 12:17:41,578][123090] Updated weights for policy 1, policy_version 1580000 (0.0009) [2023-12-26 12:17:41,919][123091] Updated weights for policy 0, policy_version 1590450 (0.0008) [2023-12-26 12:17:41,995][123091] Updated weights for policy 0, policy_version 1590460 (0.0006) [2023-12-26 12:17:42,068][123091] Updated weights for policy 0, policy_version 1590470 (0.0006) [2023-12-26 12:17:42,138][123091] Updated weights for policy 0, policy_version 1590480 (0.0008) [2023-12-26 12:17:42,420][123090] Updated weights for policy 1, policy_version 1580010 (0.0009) [2023-12-26 12:17:42,491][123090] Updated weights for policy 1, policy_version 1580020 (0.0009) [2023-12-26 12:17:42,565][123090] Updated weights for policy 1, policy_version 1580030 (0.0007) [2023-12-26 12:17:42,850][123091] Updated weights for policy 0, policy_version 1590490 (0.0011) [2023-12-26 12:17:42,915][123091] Updated weights for policy 0, policy_version 1590500 (0.0010) [2023-12-26 12:17:42,970][123091] Updated weights for policy 0, policy_version 1590510 (0.0011) [2023-12-26 12:17:43,270][123090] Updated weights for policy 1, policy_version 1580040 (0.0005) [2023-12-26 12:17:43,332][123090] Updated weights for policy 1, policy_version 1580050 (0.0005) [2023-12-26 12:17:43,411][123090] Updated weights for policy 1, policy_version 1580060 (0.0006) [2023-12-26 12:17:43,696][123091] Updated weights for policy 0, policy_version 1590520 (0.0006) [2023-12-26 12:17:43,757][123091] Updated weights for policy 0, policy_version 1590530 (0.0007) [2023-12-26 12:17:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 811671552. Throughput: 0: 8705.1, 1: 8948.4. Samples: 811667900. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:43,784][121949] Avg episode reward: [(0, '5974.102'), (1, '5322.214')] [2023-12-26 12:17:43,818][123091] Updated weights for policy 0, policy_version 1590540 (0.0009) [2023-12-26 12:17:44,035][123090] Updated weights for policy 1, policy_version 1580070 (0.0005) [2023-12-26 12:17:44,102][123090] Updated weights for policy 1, policy_version 1580080 (0.0006) [2023-12-26 12:17:44,169][123090] Updated weights for policy 1, policy_version 1580090 (0.0009) [2023-12-26 12:17:44,539][123091] Updated weights for policy 0, policy_version 1590550 (0.0007) [2023-12-26 12:17:44,603][123091] Updated weights for policy 0, policy_version 1590560 (0.0005) [2023-12-26 12:17:44,667][123091] Updated weights for policy 0, policy_version 1590570 (0.0010) [2023-12-26 12:17:45,009][123090] Updated weights for policy 1, policy_version 1580100 (0.0010) [2023-12-26 12:17:45,083][123090] Updated weights for policy 1, policy_version 1580110 (0.0009) [2023-12-26 12:17:45,164][123090] Updated weights for policy 1, policy_version 1580120 (0.0010) [2023-12-26 12:17:45,425][123091] Updated weights for policy 0, policy_version 1590580 (0.0008) [2023-12-26 12:17:45,486][123091] Updated weights for policy 0, policy_version 1590590 (0.0006) [2023-12-26 12:17:45,539][123091] Updated weights for policy 0, policy_version 1590600 (0.0006) [2023-12-26 12:17:46,004][123090] Updated weights for policy 1, policy_version 1580130 (0.0009) [2023-12-26 12:17:46,074][123090] Updated weights for policy 1, policy_version 1580140 (0.0006) [2023-12-26 12:17:46,132][123090] Updated weights for policy 1, policy_version 1580150 (0.0005) [2023-12-26 12:17:46,185][123090] Updated weights for policy 1, policy_version 1580160 (0.0005) [2023-12-26 12:17:46,314][123091] Updated weights for policy 0, policy_version 1590610 (0.0006) [2023-12-26 12:17:46,373][123091] Updated weights for policy 0, policy_version 1590620 (0.0009) [2023-12-26 12:17:46,434][123091] Updated weights for policy 0, policy_version 1590630 (0.0010) [2023-12-26 12:17:46,505][123091] Updated weights for policy 0, policy_version 1590640 (0.0009) [2023-12-26 12:17:46,783][123090] Updated weights for policy 1, policy_version 1580170 (0.0006) [2023-12-26 12:17:46,836][123090] Updated weights for policy 1, policy_version 1580180 (0.0006) [2023-12-26 12:17:46,899][123090] Updated weights for policy 1, policy_version 1580190 (0.0006) [2023-12-26 12:17:47,214][123091] Updated weights for policy 0, policy_version 1590650 (0.0005) [2023-12-26 12:17:47,268][123091] Updated weights for policy 0, policy_version 1590660 (0.0006) [2023-12-26 12:17:47,324][123091] Updated weights for policy 0, policy_version 1590670 (0.0005) [2023-12-26 12:17:47,665][123090] Updated weights for policy 1, policy_version 1580200 (0.0009) [2023-12-26 12:17:47,733][123090] Updated weights for policy 1, policy_version 1580210 (0.0008) [2023-12-26 12:17:47,803][123090] Updated weights for policy 1, policy_version 1580220 (0.0005) [2023-12-26 12:17:48,109][123091] Updated weights for policy 0, policy_version 1590680 (0.0008) [2023-12-26 12:17:48,161][123091] Updated weights for policy 0, policy_version 1590690 (0.0009) [2023-12-26 12:17:48,214][123091] Updated weights for policy 0, policy_version 1590700 (0.0009) [2023-12-26 12:17:48,540][123090] Updated weights for policy 1, policy_version 1580230 (0.0008) [2023-12-26 12:17:48,605][123090] Updated weights for policy 1, policy_version 1580240 (0.0010) [2023-12-26 12:17:48,667][123090] Updated weights for policy 1, policy_version 1580250 (0.0010) [2023-12-26 12:17:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 811769856. Throughput: 0: 8828.2, 1: 8977.6. Samples: 811779584. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:48,785][121949] Avg episode reward: [(0, '6000.186'), (1, '5517.797')] [2023-12-26 12:17:49,010][123091] Updated weights for policy 0, policy_version 1590710 (0.0008) [2023-12-26 12:17:49,073][123091] Updated weights for policy 0, policy_version 1590720 (0.0009) [2023-12-26 12:17:49,136][123091] Updated weights for policy 0, policy_version 1590730 (0.0009) [2023-12-26 12:17:49,515][123090] Updated weights for policy 1, policy_version 1580260 (0.0011) [2023-12-26 12:17:49,559][123090] Updated weights for policy 1, policy_version 1580270 (0.0010) [2023-12-26 12:17:49,607][123090] Updated weights for policy 1, policy_version 1580280 (0.0010) [2023-12-26 12:17:49,978][123091] Updated weights for policy 0, policy_version 1590740 (0.0009) [2023-12-26 12:17:50,044][123091] Updated weights for policy 0, policy_version 1590750 (0.0008) [2023-12-26 12:17:50,118][123091] Updated weights for policy 0, policy_version 1590760 (0.0006) [2023-12-26 12:17:50,520][123090] Updated weights for policy 1, policy_version 1580290 (0.0010) [2023-12-26 12:17:50,581][123090] Updated weights for policy 1, policy_version 1580300 (0.0010) [2023-12-26 12:17:50,640][123090] Updated weights for policy 1, policy_version 1580310 (0.0008) [2023-12-26 12:17:50,700][123090] Updated weights for policy 1, policy_version 1580320 (0.0009) [2023-12-26 12:17:50,918][123091] Updated weights for policy 0, policy_version 1590770 (0.0008) [2023-12-26 12:17:50,977][123091] Updated weights for policy 0, policy_version 1590780 (0.0010) [2023-12-26 12:17:51,039][123091] Updated weights for policy 0, policy_version 1590790 (0.0009) [2023-12-26 12:17:51,106][123091] Updated weights for policy 0, policy_version 1590800 (0.0008) [2023-12-26 12:17:51,613][123090] Updated weights for policy 1, policy_version 1580330 (0.0010) [2023-12-26 12:17:51,683][123090] Updated weights for policy 1, policy_version 1580340 (0.0008) [2023-12-26 12:17:51,760][123090] Updated weights for policy 1, policy_version 1580350 (0.0010) [2023-12-26 12:17:51,973][123091] Updated weights for policy 0, policy_version 1590810 (0.0010) [2023-12-26 12:17:52,033][123091] Updated weights for policy 0, policy_version 1590820 (0.0007) [2023-12-26 12:17:52,094][123091] Updated weights for policy 0, policy_version 1590830 (0.0008) [2023-12-26 12:17:52,533][123090] Updated weights for policy 1, policy_version 1580360 (0.0009) [2023-12-26 12:17:52,586][123090] Updated weights for policy 1, policy_version 1580370 (0.0009) [2023-12-26 12:17:52,646][123090] Updated weights for policy 1, policy_version 1580380 (0.0010) [2023-12-26 12:17:52,823][123091] Updated weights for policy 0, policy_version 1590840 (0.0008) [2023-12-26 12:17:52,894][123091] Updated weights for policy 0, policy_version 1590850 (0.0006) [2023-12-26 12:17:52,968][123091] Updated weights for policy 0, policy_version 1590860 (0.0006) [2023-12-26 12:17:53,578][123090] Updated weights for policy 1, policy_version 1580390 (0.0009) [2023-12-26 12:17:53,602][123091] Updated weights for policy 0, policy_version 1590870 (0.0005) [2023-12-26 12:17:53,636][123090] Updated weights for policy 1, policy_version 1580400 (0.0009) [2023-12-26 12:17:53,668][123091] Updated weights for policy 0, policy_version 1590880 (0.0006) [2023-12-26 12:17:53,689][123090] Updated weights for policy 1, policy_version 1580410 (0.0009) [2023-12-26 12:17:53,730][123091] Updated weights for policy 0, policy_version 1590890 (0.0005) [2023-12-26 12:17:53,784][121949] Fps is (10 sec: 18840.9, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 811859968. Throughput: 0: 8828.2, 1: 8959.9. Samples: 811829636. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:53,786][121949] Avg episode reward: [(0, '6113.757'), (1, '5534.176')] [2023-12-26 12:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001590896_407273472.pth... [2023-12-26 12:17:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001580416_404586496.pth... [2023-12-26 12:17:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001579360_404316160.pth [2023-12-26 12:17:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001589840_407003136.pth [2023-12-26 12:17:54,407][123091] Updated weights for policy 0, policy_version 1590900 (0.0006) [2023-12-26 12:17:54,473][123091] Updated weights for policy 0, policy_version 1590910 (0.0010) [2023-12-26 12:17:54,532][123091] Updated weights for policy 0, policy_version 1590920 (0.0011) [2023-12-26 12:17:54,601][123090] Updated weights for policy 1, policy_version 1580420 (0.0009) [2023-12-26 12:17:54,649][123090] Updated weights for policy 1, policy_version 1580430 (0.0008) [2023-12-26 12:17:54,698][123090] Updated weights for policy 1, policy_version 1580440 (0.0009) [2023-12-26 12:17:55,349][123091] Updated weights for policy 0, policy_version 1590930 (0.0010) [2023-12-26 12:17:55,397][123091] Updated weights for policy 0, policy_version 1590940 (0.0009) [2023-12-26 12:17:55,446][123091] Updated weights for policy 0, policy_version 1590950 (0.0009) [2023-12-26 12:17:55,512][123091] Updated weights for policy 0, policy_version 1590960 (0.0010) [2023-12-26 12:17:55,569][123090] Updated weights for policy 1, policy_version 1580450 (0.0008) [2023-12-26 12:17:55,619][123090] Updated weights for policy 1, policy_version 1580460 (0.0005) [2023-12-26 12:17:55,679][123090] Updated weights for policy 1, policy_version 1580470 (0.0007) [2023-12-26 12:17:55,732][123090] Updated weights for policy 1, policy_version 1580480 (0.0010) [2023-12-26 12:17:56,224][123091] Updated weights for policy 0, policy_version 1590970 (0.0005) [2023-12-26 12:17:56,275][123091] Updated weights for policy 0, policy_version 1590980 (0.0005) [2023-12-26 12:17:56,343][123091] Updated weights for policy 0, policy_version 1590990 (0.0005) [2023-12-26 12:17:56,515][123090] Updated weights for policy 1, policy_version 1580490 (0.0005) [2023-12-26 12:17:56,593][123090] Updated weights for policy 1, policy_version 1580500 (0.0005) [2023-12-26 12:17:56,671][123090] Updated weights for policy 1, policy_version 1580510 (0.0005) [2023-12-26 12:17:57,010][123091] Updated weights for policy 0, policy_version 1591000 (0.0005) [2023-12-26 12:17:57,059][123091] Updated weights for policy 0, policy_version 1591010 (0.0007) [2023-12-26 12:17:57,107][123091] Updated weights for policy 0, policy_version 1591020 (0.0010) [2023-12-26 12:17:57,335][123090] Updated weights for policy 1, policy_version 1580520 (0.0006) [2023-12-26 12:17:57,388][123090] Updated weights for policy 1, policy_version 1580530 (0.0005) [2023-12-26 12:17:57,435][123090] Updated weights for policy 1, policy_version 1580540 (0.0005) [2023-12-26 12:17:57,867][123091] Updated weights for policy 0, policy_version 1591030 (0.0010) [2023-12-26 12:17:57,922][123091] Updated weights for policy 0, policy_version 1591040 (0.0010) [2023-12-26 12:17:57,984][123091] Updated weights for policy 0, policy_version 1591050 (0.0010) [2023-12-26 12:17:58,097][123090] Updated weights for policy 1, policy_version 1580550 (0.0008) [2023-12-26 12:17:58,164][123090] Updated weights for policy 1, policy_version 1580560 (0.0010) [2023-12-26 12:17:58,228][123090] Updated weights for policy 1, policy_version 1580570 (0.0011) [2023-12-26 12:17:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 811941888. Throughput: 0: 8944.3, 1: 8961.7. Samples: 811939652. Policy #0 lag: (min: 31.0, avg: 32.8, max: 63.0) [2023-12-26 12:17:58,784][121949] Avg episode reward: [(0, '5966.054'), (1, '5506.887')] [2023-12-26 12:17:58,861][123091] Updated weights for policy 0, policy_version 1591060 (0.0010) [2023-12-26 12:17:58,920][123091] Updated weights for policy 0, policy_version 1591070 (0.0009) [2023-12-26 12:17:58,993][123091] Updated weights for policy 0, policy_version 1591080 (0.0006) [2023-12-26 12:17:59,084][123090] Updated weights for policy 1, policy_version 1580580 (0.0010) [2023-12-26 12:17:59,132][123090] Updated weights for policy 1, policy_version 1580590 (0.0010) [2023-12-26 12:17:59,179][123090] Updated weights for policy 1, policy_version 1580600 (0.0010) [2023-12-26 12:17:59,652][123091] Updated weights for policy 0, policy_version 1591090 (0.0006) [2023-12-26 12:17:59,701][123091] Updated weights for policy 0, policy_version 1591100 (0.0007) [2023-12-26 12:17:59,756][123091] Updated weights for policy 0, policy_version 1591110 (0.0005) [2023-12-26 12:17:59,809][123091] Updated weights for policy 0, policy_version 1591120 (0.0005) [2023-12-26 12:18:00,047][123090] Updated weights for policy 1, policy_version 1580610 (0.0011) [2023-12-26 12:18:00,117][123090] Updated weights for policy 1, policy_version 1580620 (0.0010) [2023-12-26 12:18:00,188][123090] Updated weights for policy 1, policy_version 1580630 (0.0011) [2023-12-26 12:18:00,255][123090] Updated weights for policy 1, policy_version 1580640 (0.0010) [2023-12-26 12:18:00,616][123091] Updated weights for policy 0, policy_version 1591130 (0.0005) [2023-12-26 12:18:00,677][123091] Updated weights for policy 0, policy_version 1591140 (0.0005) [2023-12-26 12:18:00,742][123091] Updated weights for policy 0, policy_version 1591150 (0.0005) [2023-12-26 12:18:00,951][123090] Updated weights for policy 1, policy_version 1580650 (0.0005) [2023-12-26 12:18:01,012][123090] Updated weights for policy 1, policy_version 1580660 (0.0005) [2023-12-26 12:18:01,080][123090] Updated weights for policy 1, policy_version 1580670 (0.0007) [2023-12-26 12:18:01,523][123091] Updated weights for policy 0, policy_version 1591160 (0.0009) [2023-12-26 12:18:01,595][123091] Updated weights for policy 0, policy_version 1591170 (0.0009) [2023-12-26 12:18:01,665][123091] Updated weights for policy 0, policy_version 1591180 (0.0009) [2023-12-26 12:18:01,801][123090] Updated weights for policy 1, policy_version 1580680 (0.0006) [2023-12-26 12:18:01,880][123090] Updated weights for policy 1, policy_version 1580690 (0.0005) [2023-12-26 12:18:01,945][123090] Updated weights for policy 1, policy_version 1580700 (0.0005) [2023-12-26 12:18:02,293][123091] Updated weights for policy 0, policy_version 1591190 (0.0010) [2023-12-26 12:18:02,355][123091] Updated weights for policy 0, policy_version 1591200 (0.0010) [2023-12-26 12:18:02,409][123091] Updated weights for policy 0, policy_version 1591210 (0.0009) [2023-12-26 12:18:02,764][123090] Updated weights for policy 1, policy_version 1580710 (0.0006) [2023-12-26 12:18:02,834][123090] Updated weights for policy 1, policy_version 1580720 (0.0006) [2023-12-26 12:18:02,909][123090] Updated weights for policy 1, policy_version 1580730 (0.0005) [2023-12-26 12:18:03,226][123091] Updated weights for policy 0, policy_version 1591220 (0.0009) [2023-12-26 12:18:03,292][123091] Updated weights for policy 0, policy_version 1591230 (0.0010) [2023-12-26 12:18:03,353][123091] Updated weights for policy 0, policy_version 1591240 (0.0009) [2023-12-26 12:18:03,553][123090] Updated weights for policy 1, policy_version 1580740 (0.0007) [2023-12-26 12:18:03,603][123090] Updated weights for policy 1, policy_version 1580751 (0.0009) [2023-12-26 12:18:03,657][123090] Updated weights for policy 1, policy_version 1580761 (0.0009) [2023-12-26 12:18:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 812040192. Throughput: 0: 8923.0, 1: 8899.8. Samples: 812048208. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:03,785][121949] Avg episode reward: [(0, '5983.317'), (1, '5197.573')] [2023-12-26 12:18:04,151][123091] Updated weights for policy 0, policy_version 1591250 (0.0009) [2023-12-26 12:18:04,211][123091] Updated weights for policy 0, policy_version 1591260 (0.0011) [2023-12-26 12:18:04,271][123091] Updated weights for policy 0, policy_version 1591270 (0.0011) [2023-12-26 12:18:04,339][123091] Updated weights for policy 0, policy_version 1591280 (0.0010) [2023-12-26 12:18:04,480][123090] Updated weights for policy 1, policy_version 1580771 (0.0008) [2023-12-26 12:18:04,550][123090] Updated weights for policy 1, policy_version 1580781 (0.0005) [2023-12-26 12:18:04,608][123090] Updated weights for policy 1, policy_version 1580791 (0.0006) [2023-12-26 12:18:05,095][123091] Updated weights for policy 0, policy_version 1591290 (0.0010) [2023-12-26 12:18:05,143][123091] Updated weights for policy 0, policy_version 1591300 (0.0010) [2023-12-26 12:18:05,194][123091] Updated weights for policy 0, policy_version 1591310 (0.0010) [2023-12-26 12:18:05,279][123090] Updated weights for policy 1, policy_version 1580801 (0.0006) [2023-12-26 12:18:05,341][123090] Updated weights for policy 1, policy_version 1580811 (0.0010) [2023-12-26 12:18:05,405][123090] Updated weights for policy 1, policy_version 1580821 (0.0011) [2023-12-26 12:18:05,469][123090] Updated weights for policy 1, policy_version 1580831 (0.0011) [2023-12-26 12:18:05,901][123091] Updated weights for policy 0, policy_version 1591320 (0.0006) [2023-12-26 12:18:05,954][123091] Updated weights for policy 0, policy_version 1591330 (0.0005) [2023-12-26 12:18:06,007][123091] Updated weights for policy 0, policy_version 1591340 (0.0007) [2023-12-26 12:18:06,254][123090] Updated weights for policy 1, policy_version 1580841 (0.0008) [2023-12-26 12:18:06,314][123090] Updated weights for policy 1, policy_version 1580851 (0.0008) [2023-12-26 12:18:06,385][123090] Updated weights for policy 1, policy_version 1580861 (0.0008) [2023-12-26 12:18:06,785][123091] Updated weights for policy 0, policy_version 1591350 (0.0011) [2023-12-26 12:18:06,840][123091] Updated weights for policy 0, policy_version 1591360 (0.0011) [2023-12-26 12:18:06,904][123091] Updated weights for policy 0, policy_version 1591370 (0.0011) [2023-12-26 12:18:07,211][123090] Updated weights for policy 1, policy_version 1580871 (0.0010) [2023-12-26 12:18:07,267][123090] Updated weights for policy 1, policy_version 1580881 (0.0011) [2023-12-26 12:18:07,326][123090] Updated weights for policy 1, policy_version 1580891 (0.0011) [2023-12-26 12:18:07,670][123091] Updated weights for policy 0, policy_version 1591380 (0.0009) [2023-12-26 12:18:07,740][123091] Updated weights for policy 0, policy_version 1591390 (0.0006) [2023-12-26 12:18:07,801][123091] Updated weights for policy 0, policy_version 1591400 (0.0006) [2023-12-26 12:18:08,136][123090] Updated weights for policy 1, policy_version 1580901 (0.0010) [2023-12-26 12:18:08,192][123090] Updated weights for policy 1, policy_version 1580911 (0.0009) [2023-12-26 12:18:08,240][123090] Updated weights for policy 1, policy_version 1580921 (0.0010) [2023-12-26 12:18:08,464][123091] Updated weights for policy 0, policy_version 1591410 (0.0006) [2023-12-26 12:18:08,512][123091] Updated weights for policy 0, policy_version 1591420 (0.0008) [2023-12-26 12:18:08,570][123091] Updated weights for policy 0, policy_version 1591430 (0.0008) [2023-12-26 12:18:08,646][123091] Updated weights for policy 0, policy_version 1591440 (0.0008) [2023-12-26 12:18:08,784][121949] Fps is (10 sec: 18841.0, 60 sec: 18022.3, 300 sec: 17744.7). Total num frames: 812130304. Throughput: 0: 8990.8, 1: 8927.8. Samples: 812103816. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:08,785][121949] Avg episode reward: [(0, '5991.791'), (1, '5232.946')] [2023-12-26 12:18:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001591440_407412736.pth... [2023-12-26 12:18:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001580928_404717568.pth... [2023-12-26 12:18:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001590352_407134208.pth [2023-12-26 12:18:08,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001579904_404455424.pth [2023-12-26 12:18:09,021][123090] Updated weights for policy 1, policy_version 1580931 (0.0009) [2023-12-26 12:18:09,088][123090] Updated weights for policy 1, policy_version 1580941 (0.0005) [2023-12-26 12:18:09,145][123090] Updated weights for policy 1, policy_version 1580951 (0.0005) [2023-12-26 12:18:09,491][123091] Updated weights for policy 0, policy_version 1591450 (0.0010) [2023-12-26 12:18:09,547][123091] Updated weights for policy 0, policy_version 1591460 (0.0006) [2023-12-26 12:18:09,606][123091] Updated weights for policy 0, policy_version 1591470 (0.0006) [2023-12-26 12:18:09,862][123090] Updated weights for policy 1, policy_version 1580961 (0.0006) [2023-12-26 12:18:09,944][123090] Updated weights for policy 1, policy_version 1580971 (0.0007) [2023-12-26 12:18:10,012][123090] Updated weights for policy 1, policy_version 1580981 (0.0008) [2023-12-26 12:18:10,086][123090] Updated weights for policy 1, policy_version 1580991 (0.0009) [2023-12-26 12:18:10,440][123091] Updated weights for policy 0, policy_version 1591480 (0.0010) [2023-12-26 12:18:10,501][123091] Updated weights for policy 0, policy_version 1591490 (0.0009) [2023-12-26 12:18:10,553][123091] Updated weights for policy 0, policy_version 1591500 (0.0008) [2023-12-26 12:18:10,876][123090] Updated weights for policy 1, policy_version 1581001 (0.0008) [2023-12-26 12:18:10,949][123090] Updated weights for policy 1, policy_version 1581011 (0.0008) [2023-12-26 12:18:11,020][123090] Updated weights for policy 1, policy_version 1581021 (0.0006) [2023-12-26 12:18:11,307][123091] Updated weights for policy 0, policy_version 1591510 (0.0007) [2023-12-26 12:18:11,378][123091] Updated weights for policy 0, policy_version 1591520 (0.0009) [2023-12-26 12:18:11,440][123091] Updated weights for policy 0, policy_version 1591530 (0.0010) [2023-12-26 12:18:11,817][123090] Updated weights for policy 1, policy_version 1581031 (0.0009) [2023-12-26 12:18:11,878][123090] Updated weights for policy 1, policy_version 1581041 (0.0009) [2023-12-26 12:18:11,929][123090] Updated weights for policy 1, policy_version 1581051 (0.0009) [2023-12-26 12:18:12,285][123091] Updated weights for policy 0, policy_version 1591540 (0.0011) [2023-12-26 12:18:12,342][123091] Updated weights for policy 0, policy_version 1591550 (0.0011) [2023-12-26 12:18:12,414][123091] Updated weights for policy 0, policy_version 1591560 (0.0011) [2023-12-26 12:18:12,824][123090] Updated weights for policy 1, policy_version 1581061 (0.0009) [2023-12-26 12:18:12,888][123090] Updated weights for policy 1, policy_version 1581071 (0.0008) [2023-12-26 12:18:12,949][123090] Updated weights for policy 1, policy_version 1581081 (0.0009) [2023-12-26 12:18:13,165][123091] Updated weights for policy 0, policy_version 1591570 (0.0011) [2023-12-26 12:18:13,224][123091] Updated weights for policy 0, policy_version 1591580 (0.0005) [2023-12-26 12:18:13,300][123091] Updated weights for policy 0, policy_version 1591590 (0.0005) [2023-12-26 12:18:13,366][123091] Updated weights for policy 0, policy_version 1591600 (0.0011) [2023-12-26 12:18:13,674][123090] Updated weights for policy 1, policy_version 1581091 (0.0009) [2023-12-26 12:18:13,732][123090] Updated weights for policy 1, policy_version 1581101 (0.0010) [2023-12-26 12:18:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 812212224. Throughput: 0: 8974.4, 1: 8843.8. Samples: 812209392. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:13,785][121949] Avg episode reward: [(0, '6161.144'), (1, '5503.871')] [2023-12-26 12:18:13,786][123090] Updated weights for policy 1, policy_version 1581111 (0.0010) [2023-12-26 12:18:14,154][123091] Updated weights for policy 0, policy_version 1591610 (0.0009) [2023-12-26 12:18:14,206][123091] Updated weights for policy 0, policy_version 1591620 (0.0009) [2023-12-26 12:18:14,262][123091] Updated weights for policy 0, policy_version 1591630 (0.0009) [2023-12-26 12:18:14,614][123090] Updated weights for policy 1, policy_version 1581121 (0.0010) [2023-12-26 12:18:14,671][123090] Updated weights for policy 1, policy_version 1581131 (0.0010) [2023-12-26 12:18:14,732][123090] Updated weights for policy 1, policy_version 1581141 (0.0010) [2023-12-26 12:18:14,792][123090] Updated weights for policy 1, policy_version 1581151 (0.0010) [2023-12-26 12:18:15,127][123091] Updated weights for policy 0, policy_version 1591640 (0.0007) [2023-12-26 12:18:15,177][123091] Updated weights for policy 0, policy_version 1591650 (0.0005) [2023-12-26 12:18:15,228][123091] Updated weights for policy 0, policy_version 1591660 (0.0007) [2023-12-26 12:18:15,621][123090] Updated weights for policy 1, policy_version 1581161 (0.0007) [2023-12-26 12:18:15,683][123090] Updated weights for policy 1, policy_version 1581171 (0.0006) [2023-12-26 12:18:15,755][123090] Updated weights for policy 1, policy_version 1581181 (0.0006) [2023-12-26 12:18:16,114][123091] Updated weights for policy 0, policy_version 1591670 (0.0009) [2023-12-26 12:18:16,175][123091] Updated weights for policy 0, policy_version 1591680 (0.0009) [2023-12-26 12:18:16,224][123091] Updated weights for policy 0, policy_version 1591690 (0.0009) [2023-12-26 12:18:16,486][123090] Updated weights for policy 1, policy_version 1581191 (0.0005) [2023-12-26 12:18:16,554][123090] Updated weights for policy 1, policy_version 1581201 (0.0006) [2023-12-26 12:18:16,617][123090] Updated weights for policy 1, policy_version 1581211 (0.0006) [2023-12-26 12:18:17,013][123091] Updated weights for policy 0, policy_version 1591700 (0.0008) [2023-12-26 12:18:17,064][123091] Updated weights for policy 0, policy_version 1591710 (0.0005) [2023-12-26 12:18:17,128][123091] Updated weights for policy 0, policy_version 1591720 (0.0006) [2023-12-26 12:18:17,396][123090] Updated weights for policy 1, policy_version 1581221 (0.0008) [2023-12-26 12:18:17,444][123090] Updated weights for policy 1, policy_version 1581231 (0.0009) [2023-12-26 12:18:17,503][123090] Updated weights for policy 1, policy_version 1581241 (0.0009) [2023-12-26 12:18:17,794][123091] Updated weights for policy 0, policy_version 1591730 (0.0007) [2023-12-26 12:18:17,846][123091] Updated weights for policy 0, policy_version 1591740 (0.0010) [2023-12-26 12:18:17,901][123091] Updated weights for policy 0, policy_version 1591750 (0.0010) [2023-12-26 12:18:17,956][123091] Updated weights for policy 0, policy_version 1591760 (0.0010) [2023-12-26 12:18:18,419][123090] Updated weights for policy 1, policy_version 1581251 (0.0009) [2023-12-26 12:18:18,472][123090] Updated weights for policy 1, policy_version 1581261 (0.0008) [2023-12-26 12:18:18,532][123090] Updated weights for policy 1, policy_version 1581271 (0.0009) [2023-12-26 12:18:18,775][123091] Updated weights for policy 0, policy_version 1591770 (0.0011) [2023-12-26 12:18:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 812302336. Throughput: 0: 9046.8, 1: 8782.7. Samples: 812315744. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:18,786][121949] Avg episode reward: [(0, '6115.456'), (1, '5362.208')] [2023-12-26 12:18:18,846][123091] Updated weights for policy 0, policy_version 1591780 (0.0011) [2023-12-26 12:18:18,910][123091] Updated weights for policy 0, policy_version 1591790 (0.0010) [2023-12-26 12:18:19,329][123090] Updated weights for policy 1, policy_version 1581281 (0.0008) [2023-12-26 12:18:19,405][123090] Updated weights for policy 1, policy_version 1581291 (0.0008) [2023-12-26 12:18:19,473][123090] Updated weights for policy 1, policy_version 1581301 (0.0009) [2023-12-26 12:18:19,538][123090] Updated weights for policy 1, policy_version 1581311 (0.0008) [2023-12-26 12:18:19,778][123091] Updated weights for policy 0, policy_version 1591800 (0.0007) [2023-12-26 12:18:19,850][123091] Updated weights for policy 0, policy_version 1591810 (0.0009) [2023-12-26 12:18:19,928][123091] Updated weights for policy 0, policy_version 1591820 (0.0007) [2023-12-26 12:18:20,340][123090] Updated weights for policy 1, policy_version 1581321 (0.0009) [2023-12-26 12:18:20,397][123090] Updated weights for policy 1, policy_version 1581331 (0.0010) [2023-12-26 12:18:20,453][123090] Updated weights for policy 1, policy_version 1581341 (0.0008) [2023-12-26 12:18:20,715][123091] Updated weights for policy 0, policy_version 1591830 (0.0007) [2023-12-26 12:18:20,788][123091] Updated weights for policy 0, policy_version 1591840 (0.0009) [2023-12-26 12:18:20,859][123091] Updated weights for policy 0, policy_version 1591850 (0.0009) [2023-12-26 12:18:21,253][123090] Updated weights for policy 1, policy_version 1581351 (0.0007) [2023-12-26 12:18:21,331][123090] Updated weights for policy 1, policy_version 1581361 (0.0008) [2023-12-26 12:18:21,413][123090] Updated weights for policy 1, policy_version 1581371 (0.0009) [2023-12-26 12:18:21,642][123091] Updated weights for policy 0, policy_version 1591860 (0.0009) [2023-12-26 12:18:21,715][123091] Updated weights for policy 0, policy_version 1591870 (0.0010) [2023-12-26 12:18:21,783][123091] Updated weights for policy 0, policy_version 1591880 (0.0008) [2023-12-26 12:18:22,255][123090] Updated weights for policy 1, policy_version 1581381 (0.0008) [2023-12-26 12:18:22,323][123090] Updated weights for policy 1, policy_version 1581391 (0.0009) [2023-12-26 12:18:22,400][123090] Updated weights for policy 1, policy_version 1581401 (0.0010) [2023-12-26 12:18:22,606][123091] Updated weights for policy 0, policy_version 1591890 (0.0008) [2023-12-26 12:18:22,674][123091] Updated weights for policy 0, policy_version 1591900 (0.0010) [2023-12-26 12:18:22,740][123091] Updated weights for policy 0, policy_version 1591910 (0.0010) [2023-12-26 12:18:22,801][123091] Updated weights for policy 0, policy_version 1591920 (0.0009) [2023-12-26 12:18:23,160][123090] Updated weights for policy 1, policy_version 1581411 (0.0008) [2023-12-26 12:18:23,225][123090] Updated weights for policy 1, policy_version 1581421 (0.0006) [2023-12-26 12:18:23,285][123090] Updated weights for policy 1, policy_version 1581431 (0.0009) [2023-12-26 12:18:23,654][123091] Updated weights for policy 0, policy_version 1591931 (0.0010) [2023-12-26 12:18:23,706][123091] Updated weights for policy 0, policy_version 1591941 (0.0010) [2023-12-26 12:18:23,771][123091] Updated weights for policy 0, policy_version 1591951 (0.0009) [2023-12-26 12:18:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 812392448. Throughput: 0: 9014.2, 1: 8799.1. Samples: 812367268. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:23,785][121949] Avg episode reward: [(0, '6019.363'), (1, '5119.372')] [2023-12-26 12:18:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001591952_407543808.pth... [2023-12-26 12:18:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001581440_404848640.pth... [2023-12-26 12:18:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001590896_407273472.pth [2023-12-26 12:18:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001580416_404586496.pth [2023-12-26 12:18:24,083][123090] Updated weights for policy 1, policy_version 1581441 (0.0010) [2023-12-26 12:18:24,137][123090] Updated weights for policy 1, policy_version 1581451 (0.0010) [2023-12-26 12:18:24,203][123090] Updated weights for policy 1, policy_version 1581461 (0.0010) [2023-12-26 12:18:24,273][123090] Updated weights for policy 1, policy_version 1581471 (0.0009) [2023-12-26 12:18:24,633][123091] Updated weights for policy 0, policy_version 1591962 (0.0010) [2023-12-26 12:18:24,685][123091] Updated weights for policy 0, policy_version 1591972 (0.0009) [2023-12-26 12:18:24,738][123091] Updated weights for policy 0, policy_version 1591983 (0.0010) [2023-12-26 12:18:25,075][123090] Updated weights for policy 1, policy_version 1581481 (0.0009) [2023-12-26 12:18:25,138][123090] Updated weights for policy 1, policy_version 1581491 (0.0009) [2023-12-26 12:18:25,190][123090] Updated weights for policy 1, policy_version 1581501 (0.0009) [2023-12-26 12:18:25,591][123091] Updated weights for policy 0, policy_version 1591993 (0.0009) [2023-12-26 12:18:25,639][123091] Updated weights for policy 0, policy_version 1592003 (0.0009) [2023-12-26 12:18:25,697][123091] Updated weights for policy 0, policy_version 1592013 (0.0009) [2023-12-26 12:18:26,010][123090] Updated weights for policy 1, policy_version 1581511 (0.0009) [2023-12-26 12:18:26,069][123090] Updated weights for policy 1, policy_version 1581521 (0.0008) [2023-12-26 12:18:26,131][123090] Updated weights for policy 1, policy_version 1581531 (0.0009) [2023-12-26 12:18:26,562][123091] Updated weights for policy 0, policy_version 1592023 (0.0010) [2023-12-26 12:18:26,615][123091] Updated weights for policy 0, policy_version 1592033 (0.0009) [2023-12-26 12:18:26,679][123091] Updated weights for policy 0, policy_version 1592043 (0.0010) [2023-12-26 12:18:26,941][123090] Updated weights for policy 1, policy_version 1581541 (0.0009) [2023-12-26 12:18:26,994][123090] Updated weights for policy 1, policy_version 1581551 (0.0008) [2023-12-26 12:18:27,063][123090] Updated weights for policy 1, policy_version 1581561 (0.0009) [2023-12-26 12:18:27,487][123091] Updated weights for policy 0, policy_version 1592053 (0.0009) [2023-12-26 12:18:27,539][123091] Updated weights for policy 0, policy_version 1592063 (0.0010) [2023-12-26 12:18:27,599][123091] Updated weights for policy 0, policy_version 1592073 (0.0010) [2023-12-26 12:18:27,802][123090] Updated weights for policy 1, policy_version 1581571 (0.0008) [2023-12-26 12:18:27,861][123090] Updated weights for policy 1, policy_version 1581581 (0.0008) [2023-12-26 12:18:27,916][123090] Updated weights for policy 1, policy_version 1581591 (0.0008) [2023-12-26 12:18:28,456][123091] Updated weights for policy 0, policy_version 1592083 (0.0010) [2023-12-26 12:18:28,516][123091] Updated weights for policy 0, policy_version 1592093 (0.0011) [2023-12-26 12:18:28,575][123091] Updated weights for policy 0, policy_version 1592103 (0.0010) [2023-12-26 12:18:28,733][123090] Updated weights for policy 1, policy_version 1581601 (0.0008) [2023-12-26 12:18:28,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 812474368. Throughput: 0: 8989.8, 1: 8830.0. Samples: 812469792. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:28,785][121949] Avg episode reward: [(0, '5871.111'), (1, '5437.665')] [2023-12-26 12:18:28,790][123090] Updated weights for policy 1, policy_version 1581611 (0.0006) [2023-12-26 12:18:28,846][123090] Updated weights for policy 1, policy_version 1581621 (0.0010) [2023-12-26 12:18:28,901][123090] Updated weights for policy 1, policy_version 1581631 (0.0010) [2023-12-26 12:18:29,405][123091] Updated weights for policy 0, policy_version 1592113 (0.0010) [2023-12-26 12:18:29,461][123091] Updated weights for policy 0, policy_version 1592123 (0.0007) [2023-12-26 12:18:29,528][123091] Updated weights for policy 0, policy_version 1592133 (0.0008) [2023-12-26 12:18:29,597][123091] Updated weights for policy 0, policy_version 1592143 (0.0008) [2023-12-26 12:18:29,729][123090] Updated weights for policy 1, policy_version 1581641 (0.0006) [2023-12-26 12:18:29,786][123090] Updated weights for policy 1, policy_version 1581651 (0.0005) [2023-12-26 12:18:29,853][123090] Updated weights for policy 1, policy_version 1581661 (0.0008) [2023-12-26 12:18:30,277][123091] Updated weights for policy 0, policy_version 1592153 (0.0006) [2023-12-26 12:18:30,326][123091] Updated weights for policy 0, policy_version 1592163 (0.0005) [2023-12-26 12:18:30,373][123091] Updated weights for policy 0, policy_version 1592173 (0.0005) [2023-12-26 12:18:30,539][123090] Updated weights for policy 1, policy_version 1581671 (0.0009) [2023-12-26 12:18:30,605][123090] Updated weights for policy 1, policy_version 1581682 (0.0009) [2023-12-26 12:18:30,675][123090] Updated weights for policy 1, policy_version 1581692 (0.0009) [2023-12-26 12:18:31,102][123091] Updated weights for policy 0, policy_version 1592183 (0.0009) [2023-12-26 12:18:31,158][123091] Updated weights for policy 0, policy_version 1592193 (0.0011) [2023-12-26 12:18:31,217][123091] Updated weights for policy 0, policy_version 1592203 (0.0010) [2023-12-26 12:18:31,462][123090] Updated weights for policy 1, policy_version 1581702 (0.0007) [2023-12-26 12:18:31,509][123090] Updated weights for policy 1, policy_version 1581712 (0.0005) [2023-12-26 12:18:31,558][123090] Updated weights for policy 1, policy_version 1581722 (0.0005) [2023-12-26 12:18:32,076][123091] Updated weights for policy 0, policy_version 1592213 (0.0011) [2023-12-26 12:18:32,127][123091] Updated weights for policy 0, policy_version 1592223 (0.0010) [2023-12-26 12:18:32,178][123091] Updated weights for policy 0, policy_version 1592233 (0.0010) [2023-12-26 12:18:32,304][123090] Updated weights for policy 1, policy_version 1581732 (0.0008) [2023-12-26 12:18:32,360][123090] Updated weights for policy 1, policy_version 1581742 (0.0010) [2023-12-26 12:18:32,428][123090] Updated weights for policy 1, policy_version 1581752 (0.0009) [2023-12-26 12:18:32,804][123091] Updated weights for policy 0, policy_version 1592243 (0.0009) [2023-12-26 12:18:32,856][123091] Updated weights for policy 0, policy_version 1592253 (0.0009) [2023-12-26 12:18:32,914][123091] Updated weights for policy 0, policy_version 1592263 (0.0010) [2023-12-26 12:18:33,313][123090] Updated weights for policy 1, policy_version 1581762 (0.0010) [2023-12-26 12:18:33,381][123090] Updated weights for policy 1, policy_version 1581772 (0.0010) [2023-12-26 12:18:33,440][123090] Updated weights for policy 1, policy_version 1581782 (0.0010) [2023-12-26 12:18:33,494][123090] Updated weights for policy 1, policy_version 1581792 (0.0010) [2023-12-26 12:18:33,590][123091] Updated weights for policy 0, policy_version 1592273 (0.0007) [2023-12-26 12:18:33,645][123091] Updated weights for policy 0, policy_version 1592283 (0.0005) [2023-12-26 12:18:33,695][123091] Updated weights for policy 0, policy_version 1592293 (0.0005) [2023-12-26 12:18:33,754][123091] Updated weights for policy 0, policy_version 1592303 (0.0005) [2023-12-26 12:18:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 812572672. Throughput: 0: 8996.8, 1: 8775.1. Samples: 812579320. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:33,785][121949] Avg episode reward: [(0, '5869.795'), (1, '5658.506')] [2023-12-26 12:18:34,318][123090] Updated weights for policy 1, policy_version 1581802 (0.0008) [2023-12-26 12:18:34,367][123090] Updated weights for policy 1, policy_version 1581812 (0.0009) [2023-12-26 12:18:34,418][123090] Updated weights for policy 1, policy_version 1581822 (0.0007) [2023-12-26 12:18:34,473][123091] Updated weights for policy 0, policy_version 1592313 (0.0009) [2023-12-26 12:18:34,533][123091] Updated weights for policy 0, policy_version 1592323 (0.0009) [2023-12-26 12:18:34,585][123091] Updated weights for policy 0, policy_version 1592333 (0.0009) [2023-12-26 12:18:35,294][123090] Updated weights for policy 1, policy_version 1581832 (0.0009) [2023-12-26 12:18:35,343][123090] Updated weights for policy 1, policy_version 1581842 (0.0009) [2023-12-26 12:18:35,353][123091] Updated weights for policy 0, policy_version 1592343 (0.0006) [2023-12-26 12:18:35,400][123090] Updated weights for policy 1, policy_version 1581852 (0.0009) [2023-12-26 12:18:35,401][123091] Updated weights for policy 0, policy_version 1592353 (0.0006) [2023-12-26 12:18:35,448][123091] Updated weights for policy 0, policy_version 1592363 (0.0010) [2023-12-26 12:18:36,189][123091] Updated weights for policy 0, policy_version 1592373 (0.0008) [2023-12-26 12:18:36,255][123091] Updated weights for policy 0, policy_version 1592383 (0.0010) [2023-12-26 12:18:36,278][123090] Updated weights for policy 1, policy_version 1581862 (0.0010) [2023-12-26 12:18:36,319][123091] Updated weights for policy 0, policy_version 1592393 (0.0011) [2023-12-26 12:18:36,343][123090] Updated weights for policy 1, policy_version 1581872 (0.0006) [2023-12-26 12:18:36,412][123090] Updated weights for policy 1, policy_version 1581882 (0.0009) [2023-12-26 12:18:37,130][123091] Updated weights for policy 0, policy_version 1592403 (0.0009) [2023-12-26 12:18:37,183][123091] Updated weights for policy 0, policy_version 1592413 (0.0005) [2023-12-26 12:18:37,244][123091] Updated weights for policy 0, policy_version 1592423 (0.0006) [2023-12-26 12:18:37,270][123090] Updated weights for policy 1, policy_version 1581892 (0.0009) [2023-12-26 12:18:37,344][123090] Updated weights for policy 1, policy_version 1581902 (0.0009) [2023-12-26 12:18:37,413][123090] Updated weights for policy 1, policy_version 1581912 (0.0006) [2023-12-26 12:18:37,970][123091] Updated weights for policy 0, policy_version 1592433 (0.0008) [2023-12-26 12:18:38,024][123091] Updated weights for policy 0, policy_version 1592443 (0.0008) [2023-12-26 12:18:38,077][123091] Updated weights for policy 0, policy_version 1592453 (0.0010) [2023-12-26 12:18:38,130][123091] Updated weights for policy 0, policy_version 1592463 (0.0010) [2023-12-26 12:18:38,145][123090] Updated weights for policy 1, policy_version 1581922 (0.0006) [2023-12-26 12:18:38,202][123090] Updated weights for policy 1, policy_version 1581932 (0.0009) [2023-12-26 12:18:38,251][123090] Updated weights for policy 1, policy_version 1581942 (0.0009) [2023-12-26 12:18:38,303][123090] Updated weights for policy 1, policy_version 1581952 (0.0006) [2023-12-26 12:18:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 812654592. Throughput: 0: 9045.2, 1: 8795.8. Samples: 812632480. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:38,785][121949] Avg episode reward: [(0, '6059.914'), (1, '5541.363')] [2023-12-26 12:18:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001581952_404979712.pth... [2023-12-26 12:18:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001592464_407674880.pth... [2023-12-26 12:18:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001580928_404717568.pth [2023-12-26 12:18:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001591440_407412736.pth [2023-12-26 12:18:38,869][123091] Updated weights for policy 0, policy_version 1592473 (0.0005) [2023-12-26 12:18:38,926][123091] Updated weights for policy 0, policy_version 1592483 (0.0006) [2023-12-26 12:18:38,990][123091] Updated weights for policy 0, policy_version 1592494 (0.0006) [2023-12-26 12:18:39,257][123090] Updated weights for policy 1, policy_version 1581962 (0.0009) [2023-12-26 12:18:39,315][123090] Updated weights for policy 1, policy_version 1581972 (0.0010) [2023-12-26 12:18:39,394][123090] Updated weights for policy 1, policy_version 1581982 (0.0010) [2023-12-26 12:18:39,779][123091] Updated weights for policy 0, policy_version 1592504 (0.0010) [2023-12-26 12:18:39,838][123091] Updated weights for policy 0, policy_version 1592514 (0.0010) [2023-12-26 12:18:39,904][123091] Updated weights for policy 0, policy_version 1592524 (0.0009) [2023-12-26 12:18:40,179][123090] Updated weights for policy 1, policy_version 1581992 (0.0006) [2023-12-26 12:18:40,246][123090] Updated weights for policy 1, policy_version 1582002 (0.0007) [2023-12-26 12:18:40,313][123090] Updated weights for policy 1, policy_version 1582012 (0.0010) [2023-12-26 12:18:40,722][123091] Updated weights for policy 0, policy_version 1592534 (0.0009) [2023-12-26 12:18:40,775][123091] Updated weights for policy 0, policy_version 1592544 (0.0010) [2023-12-26 12:18:40,829][123091] Updated weights for policy 0, policy_version 1592554 (0.0009) [2023-12-26 12:18:41,120][123090] Updated weights for policy 1, policy_version 1582022 (0.0009) [2023-12-26 12:18:41,191][123090] Updated weights for policy 1, policy_version 1582032 (0.0008) [2023-12-26 12:18:41,255][123090] Updated weights for policy 1, policy_version 1582042 (0.0006) [2023-12-26 12:18:41,606][123091] Updated weights for policy 0, policy_version 1592564 (0.0006) [2023-12-26 12:18:41,677][123091] Updated weights for policy 0, policy_version 1592574 (0.0008) [2023-12-26 12:18:41,756][123091] Updated weights for policy 0, policy_version 1592584 (0.0008) [2023-12-26 12:18:42,073][123090] Updated weights for policy 1, policy_version 1582052 (0.0008) [2023-12-26 12:18:42,132][123090] Updated weights for policy 1, policy_version 1582062 (0.0010) [2023-12-26 12:18:42,193][123090] Updated weights for policy 1, policy_version 1582073 (0.0010) [2023-12-26 12:18:42,460][123091] Updated weights for policy 0, policy_version 1592594 (0.0010) [2023-12-26 12:18:42,513][123091] Updated weights for policy 0, policy_version 1592604 (0.0006) [2023-12-26 12:18:42,571][123091] Updated weights for policy 0, policy_version 1592614 (0.0006) [2023-12-26 12:18:42,627][123091] Updated weights for policy 0, policy_version 1592624 (0.0006) [2023-12-26 12:18:43,122][123090] Updated weights for policy 1, policy_version 1582084 (0.0011) [2023-12-26 12:18:43,177][123090] Updated weights for policy 1, policy_version 1582094 (0.0010) [2023-12-26 12:18:43,231][123090] Updated weights for policy 1, policy_version 1582104 (0.0010) [2023-12-26 12:18:43,359][123091] Updated weights for policy 0, policy_version 1592634 (0.0005) [2023-12-26 12:18:43,427][123091] Updated weights for policy 0, policy_version 1592644 (0.0008) [2023-12-26 12:18:43,500][123091] Updated weights for policy 0, policy_version 1592654 (0.0010) [2023-12-26 12:18:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 812744704. Throughput: 0: 8975.6, 1: 8744.3. Samples: 812737044. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:43,784][121949] Avg episode reward: [(0, '6223.462'), (1, '5401.947')] [2023-12-26 12:18:44,158][123091] Updated weights for policy 0, policy_version 1592664 (0.0007) [2023-12-26 12:18:44,170][123090] Updated weights for policy 1, policy_version 1582114 (0.0010) [2023-12-26 12:18:44,221][123090] Updated weights for policy 1, policy_version 1582124 (0.0009) [2023-12-26 12:18:44,227][123091] Updated weights for policy 0, policy_version 1592674 (0.0005) [2023-12-26 12:18:44,272][123091] Updated weights for policy 0, policy_version 1592684 (0.0005) [2023-12-26 12:18:44,275][123090] Updated weights for policy 1, policy_version 1582135 (0.0009) [2023-12-26 12:18:44,959][123091] Updated weights for policy 0, policy_version 1592694 (0.0006) [2023-12-26 12:18:45,023][123091] Updated weights for policy 0, policy_version 1592704 (0.0010) [2023-12-26 12:18:45,087][123091] Updated weights for policy 0, policy_version 1592714 (0.0011) [2023-12-26 12:18:45,233][123090] Updated weights for policy 1, policy_version 1582145 (0.0009) [2023-12-26 12:18:45,296][123090] Updated weights for policy 1, policy_version 1582155 (0.0010) [2023-12-26 12:18:45,349][123090] Updated weights for policy 1, policy_version 1582165 (0.0010) [2023-12-26 12:18:45,407][123090] Updated weights for policy 1, policy_version 1582175 (0.0009) [2023-12-26 12:18:45,729][123091] Updated weights for policy 0, policy_version 1592724 (0.0009) [2023-12-26 12:18:45,783][123091] Updated weights for policy 0, policy_version 1592734 (0.0005) [2023-12-26 12:18:45,841][123091] Updated weights for policy 0, policy_version 1592744 (0.0005) [2023-12-26 12:18:46,349][123090] Updated weights for policy 1, policy_version 1582185 (0.0010) [2023-12-26 12:18:46,404][123090] Updated weights for policy 1, policy_version 1582195 (0.0010) [2023-12-26 12:18:46,448][123091] Updated weights for policy 0, policy_version 1592754 (0.0005) [2023-12-26 12:18:46,471][123090] Updated weights for policy 1, policy_version 1582205 (0.0009) [2023-12-26 12:18:46,508][123091] Updated weights for policy 0, policy_version 1592764 (0.0005) [2023-12-26 12:18:46,558][123091] Updated weights for policy 0, policy_version 1592774 (0.0005) [2023-12-26 12:18:46,622][123091] Updated weights for policy 0, policy_version 1592784 (0.0009) [2023-12-26 12:18:47,331][123090] Updated weights for policy 1, policy_version 1582215 (0.0009) [2023-12-26 12:18:47,336][123091] Updated weights for policy 0, policy_version 1592794 (0.0005) [2023-12-26 12:18:47,382][123090] Updated weights for policy 1, policy_version 1582225 (0.0007) [2023-12-26 12:18:47,395][123091] Updated weights for policy 0, policy_version 1592804 (0.0007) [2023-12-26 12:18:47,449][123090] Updated weights for policy 1, policy_version 1582235 (0.0005) [2023-12-26 12:18:47,452][123091] Updated weights for policy 0, policy_version 1592814 (0.0007) [2023-12-26 12:18:48,211][123091] Updated weights for policy 0, policy_version 1592824 (0.0006) [2023-12-26 12:18:48,218][123090] Updated weights for policy 1, policy_version 1582245 (0.0007) [2023-12-26 12:18:48,262][123091] Updated weights for policy 0, policy_version 1592834 (0.0005) [2023-12-26 12:18:48,275][123090] Updated weights for policy 1, policy_version 1582255 (0.0009) [2023-12-26 12:18:48,313][123091] Updated weights for policy 0, policy_version 1592844 (0.0006) [2023-12-26 12:18:48,348][123090] Updated weights for policy 1, policy_version 1582265 (0.0009) [2023-12-26 12:18:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 812834816. Throughput: 0: 9112.4, 1: 8604.8. Samples: 812845480. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:48,784][121949] Avg episode reward: [(0, '5751.950'), (1, '5148.147')] [2023-12-26 12:18:49,106][123091] Updated weights for policy 0, policy_version 1592854 (0.0007) [2023-12-26 12:18:49,167][123091] Updated weights for policy 0, policy_version 1592864 (0.0005) [2023-12-26 12:18:49,233][123091] Updated weights for policy 0, policy_version 1592874 (0.0006) [2023-12-26 12:18:49,249][123090] Updated weights for policy 1, policy_version 1582275 (0.0009) [2023-12-26 12:18:49,326][123090] Updated weights for policy 1, policy_version 1582285 (0.0010) [2023-12-26 12:18:49,391][123090] Updated weights for policy 1, policy_version 1582295 (0.0010) [2023-12-26 12:18:49,996][123091] Updated weights for policy 0, policy_version 1592884 (0.0007) [2023-12-26 12:18:50,063][123091] Updated weights for policy 0, policy_version 1592894 (0.0011) [2023-12-26 12:18:50,130][123091] Updated weights for policy 0, policy_version 1592904 (0.0011) [2023-12-26 12:18:50,208][123090] Updated weights for policy 1, policy_version 1582305 (0.0008) [2023-12-26 12:18:50,281][123090] Updated weights for policy 1, policy_version 1582315 (0.0007) [2023-12-26 12:18:50,352][123090] Updated weights for policy 1, policy_version 1582325 (0.0008) [2023-12-26 12:18:50,419][123090] Updated weights for policy 1, policy_version 1582335 (0.0011) [2023-12-26 12:18:50,891][123091] Updated weights for policy 0, policy_version 1592914 (0.0009) [2023-12-26 12:18:50,970][123091] Updated weights for policy 0, policy_version 1592924 (0.0005) [2023-12-26 12:18:51,037][123091] Updated weights for policy 0, policy_version 1592934 (0.0007) [2023-12-26 12:18:51,106][123091] Updated weights for policy 0, policy_version 1592944 (0.0010) [2023-12-26 12:18:51,198][123090] Updated weights for policy 1, policy_version 1582345 (0.0007) [2023-12-26 12:18:51,267][123090] Updated weights for policy 1, policy_version 1582355 (0.0010) [2023-12-26 12:18:51,320][123090] Updated weights for policy 1, policy_version 1582365 (0.0006) [2023-12-26 12:18:51,783][123091] Updated weights for policy 0, policy_version 1592954 (0.0008) [2023-12-26 12:18:51,835][123091] Updated weights for policy 0, policy_version 1592964 (0.0008) [2023-12-26 12:18:51,883][123091] Updated weights for policy 0, policy_version 1592974 (0.0008) [2023-12-26 12:18:52,039][123090] Updated weights for policy 1, policy_version 1582375 (0.0009) [2023-12-26 12:18:52,108][123090] Updated weights for policy 1, policy_version 1582385 (0.0011) [2023-12-26 12:18:52,172][123090] Updated weights for policy 1, policy_version 1582395 (0.0011) [2023-12-26 12:18:52,807][123091] Updated weights for policy 0, policy_version 1592984 (0.0009) [2023-12-26 12:18:52,874][123091] Updated weights for policy 0, policy_version 1592994 (0.0008) [2023-12-26 12:18:52,940][123090] Updated weights for policy 1, policy_version 1582405 (0.0008) [2023-12-26 12:18:52,941][123091] Updated weights for policy 0, policy_version 1593004 (0.0009) [2023-12-26 12:18:53,008][123090] Updated weights for policy 1, policy_version 1582415 (0.0007) [2023-12-26 12:18:53,064][123090] Updated weights for policy 1, policy_version 1582425 (0.0010) [2023-12-26 12:18:53,740][123091] Updated weights for policy 0, policy_version 1593014 (0.0009) [2023-12-26 12:18:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 812916736. Throughput: 0: 9091.4, 1: 8576.6. Samples: 812898872. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:53,785][121949] Avg episode reward: [(0, '5825.041'), (1, '5177.852')] [2023-12-26 12:18:53,794][123091] Updated weights for policy 0, policy_version 1593024 (0.0009) [2023-12-26 12:18:53,801][123090] Updated weights for policy 1, policy_version 1582435 (0.0009) [2023-12-26 12:18:53,853][123091] Updated weights for policy 0, policy_version 1593034 (0.0008) [2023-12-26 12:18:53,854][123090] Updated weights for policy 1, policy_version 1582445 (0.0005) [2023-12-26 12:18:53,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001593040_407822336.pth... [2023-12-26 12:18:53,892][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001591952_407543808.pth [2023-12-26 12:18:53,916][123090] Updated weights for policy 1, policy_version 1582455 (0.0005) [2023-12-26 12:18:53,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001582464_405110784.pth... [2023-12-26 12:18:53,970][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001581440_404848640.pth [2023-12-26 12:18:54,584][123090] Updated weights for policy 1, policy_version 1582465 (0.0006) [2023-12-26 12:18:54,653][123090] Updated weights for policy 1, policy_version 1582475 (0.0010) [2023-12-26 12:18:54,714][123090] Updated weights for policy 1, policy_version 1582485 (0.0010) [2023-12-26 12:18:54,727][123091] Updated weights for policy 0, policy_version 1593044 (0.0007) [2023-12-26 12:18:54,776][123090] Updated weights for policy 1, policy_version 1582495 (0.0009) [2023-12-26 12:18:54,791][123091] Updated weights for policy 0, policy_version 1593054 (0.0008) [2023-12-26 12:18:54,851][123091] Updated weights for policy 0, policy_version 1593064 (0.0009) [2023-12-26 12:18:55,469][123090] Updated weights for policy 1, policy_version 1582505 (0.0005) [2023-12-26 12:18:55,516][123090] Updated weights for policy 1, policy_version 1582515 (0.0005) [2023-12-26 12:18:55,563][123090] Updated weights for policy 1, policy_version 1582525 (0.0005) [2023-12-26 12:18:55,742][123091] Updated weights for policy 0, policy_version 1593075 (0.0011) [2023-12-26 12:18:55,793][123091] Updated weights for policy 0, policy_version 1593085 (0.0009) [2023-12-26 12:18:55,841][123091] Updated weights for policy 0, policy_version 1593095 (0.0009) [2023-12-26 12:18:56,267][123090] Updated weights for policy 1, policy_version 1582535 (0.0005) [2023-12-26 12:18:56,336][123090] Updated weights for policy 1, policy_version 1582545 (0.0005) [2023-12-26 12:18:56,399][123090] Updated weights for policy 1, policy_version 1582555 (0.0005) [2023-12-26 12:18:56,699][123091] Updated weights for policy 0, policy_version 1593105 (0.0009) [2023-12-26 12:18:56,758][123091] Updated weights for policy 0, policy_version 1593115 (0.0009) [2023-12-26 12:18:56,806][123091] Updated weights for policy 0, policy_version 1593125 (0.0008) [2023-12-26 12:18:56,861][123091] Updated weights for policy 0, policy_version 1593135 (0.0005) [2023-12-26 12:18:57,063][123090] Updated weights for policy 1, policy_version 1582565 (0.0005) [2023-12-26 12:18:57,111][123090] Updated weights for policy 1, policy_version 1582575 (0.0005) [2023-12-26 12:18:57,155][123090] Updated weights for policy 1, policy_version 1582585 (0.0005) [2023-12-26 12:18:57,586][123091] Updated weights for policy 0, policy_version 1593145 (0.0010) [2023-12-26 12:18:57,638][123091] Updated weights for policy 0, policy_version 1593155 (0.0010) [2023-12-26 12:18:57,692][123091] Updated weights for policy 0, policy_version 1593165 (0.0010) [2023-12-26 12:18:57,825][123090] Updated weights for policy 1, policy_version 1582595 (0.0006) [2023-12-26 12:18:57,888][123090] Updated weights for policy 1, policy_version 1582605 (0.0008) [2023-12-26 12:18:57,955][123090] Updated weights for policy 1, policy_version 1582615 (0.0009) [2023-12-26 12:18:58,548][123091] Updated weights for policy 0, policy_version 1593175 (0.0011) [2023-12-26 12:18:58,615][123091] Updated weights for policy 0, policy_version 1593185 (0.0011) [2023-12-26 12:18:58,683][123091] Updated weights for policy 0, policy_version 1593195 (0.0011) [2023-12-26 12:18:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 813015040. Throughput: 0: 9047.6, 1: 8716.6. Samples: 813008784. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:18:58,785][121949] Avg episode reward: [(0, '6052.834'), (1, '5442.500')] [2023-12-26 12:18:58,792][123090] Updated weights for policy 1, policy_version 1582625 (0.0010) [2023-12-26 12:18:58,855][123090] Updated weights for policy 1, policy_version 1582635 (0.0010) [2023-12-26 12:18:58,917][123090] Updated weights for policy 1, policy_version 1582645 (0.0010) [2023-12-26 12:18:58,991][123090] Updated weights for policy 1, policy_version 1582655 (0.0009) [2023-12-26 12:18:59,523][123091] Updated weights for policy 0, policy_version 1593205 (0.0011) [2023-12-26 12:18:59,595][123091] Updated weights for policy 0, policy_version 1593215 (0.0006) [2023-12-26 12:18:59,637][123090] Updated weights for policy 1, policy_version 1582665 (0.0005) [2023-12-26 12:18:59,655][123091] Updated weights for policy 0, policy_version 1593225 (0.0005) [2023-12-26 12:18:59,690][123090] Updated weights for policy 1, policy_version 1582675 (0.0005) [2023-12-26 12:18:59,746][123090] Updated weights for policy 1, policy_version 1582685 (0.0006) [2023-12-26 12:19:00,389][123091] Updated weights for policy 0, policy_version 1593235 (0.0008) [2023-12-26 12:19:00,446][123091] Updated weights for policy 0, policy_version 1593245 (0.0008) [2023-12-26 12:19:00,503][123090] Updated weights for policy 1, policy_version 1582695 (0.0009) [2023-12-26 12:19:00,505][123091] Updated weights for policy 0, policy_version 1593255 (0.0008) [2023-12-26 12:19:00,556][123090] Updated weights for policy 1, policy_version 1582705 (0.0008) [2023-12-26 12:19:00,612][123090] Updated weights for policy 1, policy_version 1582715 (0.0009) [2023-12-26 12:19:01,315][123091] Updated weights for policy 0, policy_version 1593265 (0.0009) [2023-12-26 12:19:01,386][123091] Updated weights for policy 0, policy_version 1593275 (0.0008) [2023-12-26 12:19:01,436][123090] Updated weights for policy 1, policy_version 1582725 (0.0007) [2023-12-26 12:19:01,457][123091] Updated weights for policy 0, policy_version 1593285 (0.0007) [2023-12-26 12:19:01,491][123090] Updated weights for policy 1, policy_version 1582735 (0.0005) [2023-12-26 12:19:01,536][123091] Updated weights for policy 0, policy_version 1593295 (0.0006) [2023-12-26 12:19:01,559][123090] Updated weights for policy 1, policy_version 1582745 (0.0006) [2023-12-26 12:19:02,286][123090] Updated weights for policy 1, policy_version 1582755 (0.0007) [2023-12-26 12:19:02,318][123091] Updated weights for policy 0, policy_version 1593305 (0.0009) [2023-12-26 12:19:02,353][123090] Updated weights for policy 1, policy_version 1582765 (0.0010) [2023-12-26 12:19:02,385][123091] Updated weights for policy 0, policy_version 1593315 (0.0009) [2023-12-26 12:19:02,412][123090] Updated weights for policy 1, policy_version 1582775 (0.0010) [2023-12-26 12:19:02,441][123091] Updated weights for policy 0, policy_version 1593325 (0.0007) [2023-12-26 12:19:03,185][123091] Updated weights for policy 0, policy_version 1593335 (0.0007) [2023-12-26 12:19:03,235][123091] Updated weights for policy 0, policy_version 1593345 (0.0005) [2023-12-26 12:19:03,245][123090] Updated weights for policy 1, policy_version 1582785 (0.0010) [2023-12-26 12:19:03,280][123091] Updated weights for policy 0, policy_version 1593355 (0.0005) [2023-12-26 12:19:03,299][123090] Updated weights for policy 1, policy_version 1582795 (0.0010) [2023-12-26 12:19:03,357][123090] Updated weights for policy 1, policy_version 1582805 (0.0010) [2023-12-26 12:19:03,415][123090] Updated weights for policy 1, policy_version 1582815 (0.0010) [2023-12-26 12:19:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 813105152. Throughput: 0: 9027.9, 1: 8764.3. Samples: 813116392. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:03,785][121949] Avg episode reward: [(0, '6141.880'), (1, '5205.413')] [2023-12-26 12:19:04,022][123091] Updated weights for policy 0, policy_version 1593365 (0.0007) [2023-12-26 12:19:04,081][123091] Updated weights for policy 0, policy_version 1593375 (0.0008) [2023-12-26 12:19:04,143][123091] Updated weights for policy 0, policy_version 1593385 (0.0009) [2023-12-26 12:19:04,233][123090] Updated weights for policy 1, policy_version 1582825 (0.0010) [2023-12-26 12:19:04,288][123090] Updated weights for policy 1, policy_version 1582835 (0.0010) [2023-12-26 12:19:04,336][123090] Updated weights for policy 1, policy_version 1582845 (0.0010) [2023-12-26 12:19:04,977][123091] Updated weights for policy 0, policy_version 1593395 (0.0009) [2023-12-26 12:19:05,028][123091] Updated weights for policy 0, policy_version 1593405 (0.0011) [2023-12-26 12:19:05,072][123091] Updated weights for policy 0, policy_version 1593415 (0.0010) [2023-12-26 12:19:05,193][123090] Updated weights for policy 1, policy_version 1582855 (0.0011) [2023-12-26 12:19:05,262][123090] Updated weights for policy 1, policy_version 1582865 (0.0010) [2023-12-26 12:19:05,323][123090] Updated weights for policy 1, policy_version 1582875 (0.0010) [2023-12-26 12:19:05,875][123091] Updated weights for policy 0, policy_version 1593425 (0.0010) [2023-12-26 12:19:05,931][123091] Updated weights for policy 0, policy_version 1593435 (0.0010) [2023-12-26 12:19:05,987][123091] Updated weights for policy 0, policy_version 1593446 (0.0011) [2023-12-26 12:19:06,045][123091] Updated weights for policy 0, policy_version 1593456 (0.0010) [2023-12-26 12:19:06,101][123090] Updated weights for policy 1, policy_version 1582885 (0.0008) [2023-12-26 12:19:06,172][123090] Updated weights for policy 1, policy_version 1582895 (0.0007) [2023-12-26 12:19:06,232][123090] Updated weights for policy 1, policy_version 1582905 (0.0006) [2023-12-26 12:19:06,926][123091] Updated weights for policy 0, policy_version 1593466 (0.0005) [2023-12-26 12:19:06,964][123090] Updated weights for policy 1, policy_version 1582915 (0.0007) [2023-12-26 12:19:07,000][123091] Updated weights for policy 0, policy_version 1593476 (0.0005) [2023-12-26 12:19:07,038][123090] Updated weights for policy 1, policy_version 1582925 (0.0011) [2023-12-26 12:19:07,069][123091] Updated weights for policy 0, policy_version 1593486 (0.0007) [2023-12-26 12:19:07,105][123090] Updated weights for policy 1, policy_version 1582935 (0.0010) [2023-12-26 12:19:07,768][123091] Updated weights for policy 0, policy_version 1593496 (0.0006) [2023-12-26 12:19:07,808][123090] Updated weights for policy 1, policy_version 1582945 (0.0010) [2023-12-26 12:19:07,830][123091] Updated weights for policy 0, policy_version 1593506 (0.0006) [2023-12-26 12:19:07,874][123090] Updated weights for policy 1, policy_version 1582955 (0.0007) [2023-12-26 12:19:07,896][123091] Updated weights for policy 0, policy_version 1593516 (0.0008) [2023-12-26 12:19:07,940][123090] Updated weights for policy 1, policy_version 1582965 (0.0006) [2023-12-26 12:19:07,996][123090] Updated weights for policy 1, policy_version 1582975 (0.0005) [2023-12-26 12:19:08,626][123091] Updated weights for policy 0, policy_version 1593526 (0.0009) [2023-12-26 12:19:08,686][123091] Updated weights for policy 0, policy_version 1593536 (0.0009) [2023-12-26 12:19:08,753][123091] Updated weights for policy 0, policy_version 1593546 (0.0008) [2023-12-26 12:19:08,785][121949] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 813187072. Throughput: 0: 9035.2, 1: 8771.7. Samples: 813168584. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:08,786][121949] Avg episode reward: [(0, '6058.797'), (1, '5004.932')] [2023-12-26 12:19:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001593552_407953408.pth... [2023-12-26 12:19:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001592464_407674880.pth [2023-12-26 12:19:08,805][123090] Updated weights for policy 1, policy_version 1582985 (0.0010) [2023-12-26 12:19:08,876][123090] Updated weights for policy 1, policy_version 1582995 (0.0011) [2023-12-26 12:19:08,947][123090] Updated weights for policy 1, policy_version 1583005 (0.0011) [2023-12-26 12:19:08,966][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001583008_405250048.pth... [2023-12-26 12:19:08,971][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001581952_404979712.pth [2023-12-26 12:19:09,596][123091] Updated weights for policy 0, policy_version 1593556 (0.0008) [2023-12-26 12:19:09,663][123091] Updated weights for policy 0, policy_version 1593566 (0.0010) [2023-12-26 12:19:09,732][123091] Updated weights for policy 0, policy_version 1593576 (0.0008) [2023-12-26 12:19:09,747][123090] Updated weights for policy 1, policy_version 1583015 (0.0009) [2023-12-26 12:19:09,815][123090] Updated weights for policy 1, policy_version 1583025 (0.0009) [2023-12-26 12:19:09,891][123090] Updated weights for policy 1, policy_version 1583035 (0.0009) [2023-12-26 12:19:10,555][123091] Updated weights for policy 0, policy_version 1593586 (0.0010) [2023-12-26 12:19:10,603][123091] Updated weights for policy 0, policy_version 1593596 (0.0009) [2023-12-26 12:19:10,658][123091] Updated weights for policy 0, policy_version 1593606 (0.0009) [2023-12-26 12:19:10,699][123090] Updated weights for policy 1, policy_version 1583045 (0.0007) [2023-12-26 12:19:10,718][123091] Updated weights for policy 0, policy_version 1593616 (0.0008) [2023-12-26 12:19:10,769][123090] Updated weights for policy 1, policy_version 1583055 (0.0006) [2023-12-26 12:19:10,837][123090] Updated weights for policy 1, policy_version 1583065 (0.0007) [2023-12-26 12:19:11,571][123091] Updated weights for policy 0, policy_version 1593626 (0.0009) [2023-12-26 12:19:11,626][123090] Updated weights for policy 1, policy_version 1583075 (0.0007) [2023-12-26 12:19:11,642][123091] Updated weights for policy 0, policy_version 1593636 (0.0010) [2023-12-26 12:19:11,692][123090] Updated weights for policy 1, policy_version 1583085 (0.0008) [2023-12-26 12:19:11,699][123091] Updated weights for policy 0, policy_version 1593646 (0.0009) [2023-12-26 12:19:11,762][123090] Updated weights for policy 1, policy_version 1583095 (0.0010) [2023-12-26 12:19:12,538][123091] Updated weights for policy 0, policy_version 1593656 (0.0010) [2023-12-26 12:19:12,596][123091] Updated weights for policy 0, policy_version 1593666 (0.0010) [2023-12-26 12:19:12,621][123090] Updated weights for policy 1, policy_version 1583105 (0.0009) [2023-12-26 12:19:12,647][123091] Updated weights for policy 0, policy_version 1593676 (0.0010) [2023-12-26 12:19:12,685][123090] Updated weights for policy 1, policy_version 1583115 (0.0008) [2023-12-26 12:19:12,736][123090] Updated weights for policy 1, policy_version 1583125 (0.0010) [2023-12-26 12:19:12,797][123090] Updated weights for policy 1, policy_version 1583135 (0.0009) [2023-12-26 12:19:13,412][123091] Updated weights for policy 0, policy_version 1593686 (0.0009) [2023-12-26 12:19:13,473][123091] Updated weights for policy 0, policy_version 1593696 (0.0010) [2023-12-26 12:19:13,532][123091] Updated weights for policy 0, policy_version 1593706 (0.0010) [2023-12-26 12:19:13,662][123090] Updated weights for policy 1, policy_version 1583145 (0.0008) [2023-12-26 12:19:13,710][123090] Updated weights for policy 1, policy_version 1583155 (0.0009) [2023-12-26 12:19:13,762][123090] Updated weights for policy 1, policy_version 1583165 (0.0008) [2023-12-26 12:19:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 813285376. Throughput: 0: 9089.3, 1: 8767.8. Samples: 813273356. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:13,784][121949] Avg episode reward: [(0, '6062.103'), (1, '4977.893')] [2023-12-26 12:19:14,318][123091] Updated weights for policy 0, policy_version 1593716 (0.0010) [2023-12-26 12:19:14,367][123091] Updated weights for policy 0, policy_version 1593726 (0.0009) [2023-12-26 12:19:14,416][123091] Updated weights for policy 0, policy_version 1593736 (0.0009) [2023-12-26 12:19:14,617][123090] Updated weights for policy 1, policy_version 1583175 (0.0009) [2023-12-26 12:19:14,667][123090] Updated weights for policy 1, policy_version 1583185 (0.0009) [2023-12-26 12:19:14,721][123090] Updated weights for policy 1, policy_version 1583195 (0.0009) [2023-12-26 12:19:15,144][123091] Updated weights for policy 0, policy_version 1593746 (0.0008) [2023-12-26 12:19:15,202][123091] Updated weights for policy 0, policy_version 1593756 (0.0007) [2023-12-26 12:19:15,257][123091] Updated weights for policy 0, policy_version 1593766 (0.0010) [2023-12-26 12:19:15,313][123091] Updated weights for policy 0, policy_version 1593776 (0.0010) [2023-12-26 12:19:15,598][123090] Updated weights for policy 1, policy_version 1583205 (0.0009) [2023-12-26 12:19:15,664][123090] Updated weights for policy 1, policy_version 1583215 (0.0010) [2023-12-26 12:19:15,727][123090] Updated weights for policy 1, policy_version 1583225 (0.0009) [2023-12-26 12:19:16,086][123091] Updated weights for policy 0, policy_version 1593786 (0.0009) [2023-12-26 12:19:16,136][123091] Updated weights for policy 0, policy_version 1593796 (0.0009) [2023-12-26 12:19:16,184][123091] Updated weights for policy 0, policy_version 1593806 (0.0009) [2023-12-26 12:19:16,604][123090] Updated weights for policy 1, policy_version 1583235 (0.0010) [2023-12-26 12:19:16,670][123090] Updated weights for policy 1, policy_version 1583245 (0.0009) [2023-12-26 12:19:16,722][123090] Updated weights for policy 1, policy_version 1583255 (0.0009) [2023-12-26 12:19:16,951][123091] Updated weights for policy 0, policy_version 1593816 (0.0009) [2023-12-26 12:19:17,005][123091] Updated weights for policy 0, policy_version 1593826 (0.0009) [2023-12-26 12:19:17,053][123091] Updated weights for policy 0, policy_version 1593836 (0.0009) [2023-12-26 12:19:17,563][123090] Updated weights for policy 1, policy_version 1583265 (0.0010) [2023-12-26 12:19:17,633][123090] Updated weights for policy 1, policy_version 1583275 (0.0007) [2023-12-26 12:19:17,684][123090] Updated weights for policy 1, policy_version 1583285 (0.0005) [2023-12-26 12:19:17,757][123090] Updated weights for policy 1, policy_version 1583295 (0.0005) [2023-12-26 12:19:17,880][123091] Updated weights for policy 0, policy_version 1593846 (0.0009) [2023-12-26 12:19:17,939][123091] Updated weights for policy 0, policy_version 1593856 (0.0009) [2023-12-26 12:19:17,991][123091] Updated weights for policy 0, policy_version 1593866 (0.0009) [2023-12-26 12:19:18,507][123090] Updated weights for policy 1, policy_version 1583305 (0.0008) [2023-12-26 12:19:18,563][123090] Updated weights for policy 1, policy_version 1583315 (0.0008) [2023-12-26 12:19:18,613][123090] Updated weights for policy 1, policy_version 1583325 (0.0008) [2023-12-26 12:19:18,769][123091] Updated weights for policy 0, policy_version 1593876 (0.0009) [2023-12-26 12:19:18,784][121949] Fps is (10 sec: 18023.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 813367296. Throughput: 0: 9068.9, 1: 8695.4. Samples: 813378712. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:18,785][121949] Avg episode reward: [(0, '6154.297'), (1, '4842.065')] [2023-12-26 12:19:18,833][123091] Updated weights for policy 0, policy_version 1593886 (0.0009) [2023-12-26 12:19:18,902][123091] Updated weights for policy 0, policy_version 1593896 (0.0009) [2023-12-26 12:19:19,438][123090] Updated weights for policy 1, policy_version 1583335 (0.0009) [2023-12-26 12:19:19,510][123090] Updated weights for policy 1, policy_version 1583345 (0.0009) [2023-12-26 12:19:19,577][123090] Updated weights for policy 1, policy_version 1583355 (0.0008) [2023-12-26 12:19:19,722][123091] Updated weights for policy 0, policy_version 1593906 (0.0010) [2023-12-26 12:19:19,773][123091] Updated weights for policy 0, policy_version 1593916 (0.0010) [2023-12-26 12:19:19,834][123091] Updated weights for policy 0, policy_version 1593926 (0.0010) [2023-12-26 12:19:19,903][123091] Updated weights for policy 0, policy_version 1593936 (0.0009) [2023-12-26 12:19:20,391][123090] Updated weights for policy 1, policy_version 1583365 (0.0010) [2023-12-26 12:19:20,448][123090] Updated weights for policy 1, policy_version 1583375 (0.0005) [2023-12-26 12:19:20,506][123090] Updated weights for policy 1, policy_version 1583385 (0.0006) [2023-12-26 12:19:20,794][123091] Updated weights for policy 0, policy_version 1593946 (0.0009) [2023-12-26 12:19:20,851][123091] Updated weights for policy 0, policy_version 1593956 (0.0009) [2023-12-26 12:19:20,913][123091] Updated weights for policy 0, policy_version 1593966 (0.0009) [2023-12-26 12:19:21,220][123090] Updated weights for policy 1, policy_version 1583395 (0.0006) [2023-12-26 12:19:21,276][123090] Updated weights for policy 1, policy_version 1583405 (0.0008) [2023-12-26 12:19:21,344][123090] Updated weights for policy 1, policy_version 1583415 (0.0008) [2023-12-26 12:19:21,857][123091] Updated weights for policy 0, policy_version 1593976 (0.0009) [2023-12-26 12:19:21,927][123091] Updated weights for policy 0, policy_version 1593986 (0.0010) [2023-12-26 12:19:21,989][123091] Updated weights for policy 0, policy_version 1593996 (0.0010) [2023-12-26 12:19:22,216][123090] Updated weights for policy 1, policy_version 1583425 (0.0009) [2023-12-26 12:19:22,285][123090] Updated weights for policy 1, policy_version 1583435 (0.0010) [2023-12-26 12:19:22,343][123090] Updated weights for policy 1, policy_version 1583445 (0.0009) [2023-12-26 12:19:22,408][123090] Updated weights for policy 1, policy_version 1583455 (0.0010) [2023-12-26 12:19:22,824][123091] Updated weights for policy 0, policy_version 1594006 (0.0009) [2023-12-26 12:19:22,877][123091] Updated weights for policy 0, policy_version 1594016 (0.0009) [2023-12-26 12:19:22,924][123091] Updated weights for policy 0, policy_version 1594026 (0.0009) [2023-12-26 12:19:23,244][123090] Updated weights for policy 1, policy_version 1583465 (0.0010) [2023-12-26 12:19:23,300][123090] Updated weights for policy 1, policy_version 1583475 (0.0011) [2023-12-26 12:19:23,345][123090] Updated weights for policy 1, policy_version 1583485 (0.0010) [2023-12-26 12:19:23,758][123091] Updated weights for policy 0, policy_version 1594036 (0.0007) [2023-12-26 12:19:23,784][121949] Fps is (10 sec: 16383.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 813449216. Throughput: 0: 8988.1, 1: 8724.7. Samples: 813429556. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:23,785][121949] Avg episode reward: [(0, '6001.574'), (1, '4819.498')] [2023-12-26 12:19:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001583488_405372928.pth... [2023-12-26 12:19:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001582464_405110784.pth [2023-12-26 12:19:23,819][123091] Updated weights for policy 0, policy_version 1594046 (0.0007) [2023-12-26 12:19:23,870][123091] Updated weights for policy 0, policy_version 1594056 (0.0008) [2023-12-26 12:19:23,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001594064_408084480.pth... [2023-12-26 12:19:23,923][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001593040_407822336.pth [2023-12-26 12:19:24,226][123090] Updated weights for policy 1, policy_version 1583495 (0.0011) [2023-12-26 12:19:24,280][123090] Updated weights for policy 1, policy_version 1583505 (0.0009) [2023-12-26 12:19:24,328][123090] Updated weights for policy 1, policy_version 1583515 (0.0009) [2023-12-26 12:19:24,517][123091] Updated weights for policy 0, policy_version 1594066 (0.0005) [2023-12-26 12:19:24,579][123091] Updated weights for policy 0, policy_version 1594076 (0.0005) [2023-12-26 12:19:24,638][123091] Updated weights for policy 0, policy_version 1594086 (0.0005) [2023-12-26 12:19:24,692][123091] Updated weights for policy 0, policy_version 1594096 (0.0005) [2023-12-26 12:19:25,059][123090] Updated weights for policy 1, policy_version 1583525 (0.0007) [2023-12-26 12:19:25,119][123090] Updated weights for policy 1, policy_version 1583535 (0.0009) [2023-12-26 12:19:25,167][123090] Updated weights for policy 1, policy_version 1583545 (0.0010) [2023-12-26 12:19:25,351][123091] Updated weights for policy 0, policy_version 1594106 (0.0005) [2023-12-26 12:19:25,405][123091] Updated weights for policy 0, policy_version 1594116 (0.0005) [2023-12-26 12:19:25,460][123091] Updated weights for policy 0, policy_version 1594126 (0.0005) [2023-12-26 12:19:25,839][123090] Updated weights for policy 1, policy_version 1583555 (0.0009) [2023-12-26 12:19:25,907][123090] Updated weights for policy 1, policy_version 1583565 (0.0006) [2023-12-26 12:19:25,964][123090] Updated weights for policy 1, policy_version 1583575 (0.0006) [2023-12-26 12:19:26,236][123091] Updated weights for policy 0, policy_version 1594136 (0.0010) [2023-12-26 12:19:26,298][123091] Updated weights for policy 0, policy_version 1594146 (0.0010) [2023-12-26 12:19:26,357][123091] Updated weights for policy 0, policy_version 1594156 (0.0011) [2023-12-26 12:19:26,615][123090] Updated weights for policy 1, policy_version 1583585 (0.0006) [2023-12-26 12:19:26,663][123090] Updated weights for policy 1, policy_version 1583595 (0.0010) [2023-12-26 12:19:26,714][123090] Updated weights for policy 1, policy_version 1583605 (0.0010) [2023-12-26 12:19:26,761][123090] Updated weights for policy 1, policy_version 1583615 (0.0010) [2023-12-26 12:19:27,091][123091] Updated weights for policy 0, policy_version 1594166 (0.0010) [2023-12-26 12:19:27,143][123091] Updated weights for policy 0, policy_version 1594176 (0.0009) [2023-12-26 12:19:27,202][123091] Updated weights for policy 0, policy_version 1594186 (0.0009) [2023-12-26 12:19:27,616][123090] Updated weights for policy 1, policy_version 1583625 (0.0010) [2023-12-26 12:19:27,681][123090] Updated weights for policy 1, policy_version 1583635 (0.0010) [2023-12-26 12:19:27,735][123090] Updated weights for policy 1, policy_version 1583645 (0.0010) [2023-12-26 12:19:27,934][123091] Updated weights for policy 0, policy_version 1594196 (0.0007) [2023-12-26 12:19:27,982][123091] Updated weights for policy 0, policy_version 1594206 (0.0005) [2023-12-26 12:19:28,045][123091] Updated weights for policy 0, policy_version 1594216 (0.0005) [2023-12-26 12:19:28,572][123090] Updated weights for policy 1, policy_version 1583655 (0.0007) [2023-12-26 12:19:28,639][123090] Updated weights for policy 1, policy_version 1583665 (0.0005) [2023-12-26 12:19:28,692][123090] Updated weights for policy 1, policy_version 1583675 (0.0005) [2023-12-26 12:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 813547520. Throughput: 0: 8999.2, 1: 8830.1. Samples: 813539368. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:28,785][121949] Avg episode reward: [(0, '5961.200'), (1, '4741.843')] [2023-12-26 12:19:28,837][123091] Updated weights for policy 0, policy_version 1594226 (0.0006) [2023-12-26 12:19:28,893][123091] Updated weights for policy 0, policy_version 1594236 (0.0009) [2023-12-26 12:19:28,949][123091] Updated weights for policy 0, policy_version 1594246 (0.0010) [2023-12-26 12:19:29,008][123091] Updated weights for policy 0, policy_version 1594256 (0.0010) [2023-12-26 12:19:29,401][123090] Updated weights for policy 1, policy_version 1583685 (0.0008) [2023-12-26 12:19:29,456][123090] Updated weights for policy 1, policy_version 1583695 (0.0010) [2023-12-26 12:19:29,515][123090] Updated weights for policy 1, policy_version 1583705 (0.0011) [2023-12-26 12:19:29,913][123091] Updated weights for policy 0, policy_version 1594266 (0.0010) [2023-12-26 12:19:29,980][123091] Updated weights for policy 0, policy_version 1594276 (0.0010) [2023-12-26 12:19:30,051][123091] Updated weights for policy 0, policy_version 1594286 (0.0010) [2023-12-26 12:19:30,301][123090] Updated weights for policy 1, policy_version 1583715 (0.0009) [2023-12-26 12:19:30,366][123090] Updated weights for policy 1, policy_version 1583725 (0.0005) [2023-12-26 12:19:30,425][123090] Updated weights for policy 1, policy_version 1583735 (0.0005) [2023-12-26 12:19:30,963][123091] Updated weights for policy 0, policy_version 1594296 (0.0010) [2023-12-26 12:19:31,017][123091] Updated weights for policy 0, policy_version 1594306 (0.0010) [2023-12-26 12:19:31,048][123090] Updated weights for policy 1, policy_version 1583745 (0.0006) [2023-12-26 12:19:31,081][123091] Updated weights for policy 0, policy_version 1594316 (0.0008) [2023-12-26 12:19:31,112][123090] Updated weights for policy 1, policy_version 1583755 (0.0010) [2023-12-26 12:19:31,183][123090] Updated weights for policy 1, policy_version 1583766 (0.0009) [2023-12-26 12:19:31,250][123090] Updated weights for policy 1, policy_version 1583776 (0.0009) [2023-12-26 12:19:31,930][123091] Updated weights for policy 0, policy_version 1594326 (0.0009) [2023-12-26 12:19:31,975][123091] Updated weights for policy 0, policy_version 1594336 (0.0007) [2023-12-26 12:19:32,014][123090] Updated weights for policy 1, policy_version 1583786 (0.0009) [2023-12-26 12:19:32,028][123091] Updated weights for policy 0, policy_version 1594346 (0.0007) [2023-12-26 12:19:32,073][123090] Updated weights for policy 1, policy_version 1583796 (0.0006) [2023-12-26 12:19:32,129][123090] Updated weights for policy 1, policy_version 1583806 (0.0008) [2023-12-26 12:19:32,828][123091] Updated weights for policy 0, policy_version 1594356 (0.0010) [2023-12-26 12:19:32,892][123091] Updated weights for policy 0, policy_version 1594366 (0.0009) [2023-12-26 12:19:32,950][123091] Updated weights for policy 0, policy_version 1594376 (0.0010) [2023-12-26 12:19:32,974][123090] Updated weights for policy 1, policy_version 1583816 (0.0008) [2023-12-26 12:19:33,026][123090] Updated weights for policy 1, policy_version 1583826 (0.0009) [2023-12-26 12:19:33,069][123090] Updated weights for policy 1, policy_version 1583836 (0.0005) [2023-12-26 12:19:33,782][123090] Updated weights for policy 1, policy_version 1583846 (0.0005) [2023-12-26 12:19:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 813629440. Throughput: 0: 8788.9, 1: 9012.2. Samples: 813646528. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:33,784][121949] Avg episode reward: [(0, '5941.104'), (1, '4849.431')] [2023-12-26 12:19:33,808][123091] Updated weights for policy 0, policy_version 1594386 (0.0006) [2023-12-26 12:19:33,839][123090] Updated weights for policy 1, policy_version 1583856 (0.0007) [2023-12-26 12:19:33,861][123091] Updated weights for policy 0, policy_version 1594396 (0.0008) [2023-12-26 12:19:33,892][123090] Updated weights for policy 1, policy_version 1583866 (0.0005) [2023-12-26 12:19:33,910][123091] Updated weights for policy 0, policy_version 1594406 (0.0008) [2023-12-26 12:19:33,960][123091] Updated weights for policy 0, policy_version 1594416 (0.0009) [2023-12-26 12:19:34,574][123090] Updated weights for policy 1, policy_version 1583876 (0.0005) [2023-12-26 12:19:34,648][123090] Updated weights for policy 1, policy_version 1583886 (0.0006) [2023-12-26 12:19:34,711][123090] Updated weights for policy 1, policy_version 1583896 (0.0008) [2023-12-26 12:19:34,888][123091] Updated weights for policy 0, policy_version 1594426 (0.0008) [2023-12-26 12:19:34,948][123091] Updated weights for policy 0, policy_version 1594436 (0.0006) [2023-12-26 12:19:35,006][123091] Updated weights for policy 0, policy_version 1594446 (0.0007) [2023-12-26 12:19:35,398][123090] Updated weights for policy 1, policy_version 1583906 (0.0008) [2023-12-26 12:19:35,468][123090] Updated weights for policy 1, policy_version 1583916 (0.0008) [2023-12-26 12:19:35,535][123090] Updated weights for policy 1, policy_version 1583926 (0.0010) [2023-12-26 12:19:35,599][123090] Updated weights for policy 1, policy_version 1583936 (0.0011) [2023-12-26 12:19:35,685][123091] Updated weights for policy 0, policy_version 1594456 (0.0008) [2023-12-26 12:19:35,754][123091] Updated weights for policy 0, policy_version 1594466 (0.0007) [2023-12-26 12:19:35,823][123091] Updated weights for policy 0, policy_version 1594476 (0.0005) [2023-12-26 12:19:36,363][123090] Updated weights for policy 1, policy_version 1583946 (0.0009) [2023-12-26 12:19:36,429][123090] Updated weights for policy 1, policy_version 1583956 (0.0009) [2023-12-26 12:19:36,480][123090] Updated weights for policy 1, policy_version 1583966 (0.0009) [2023-12-26 12:19:36,519][123091] Updated weights for policy 0, policy_version 1594486 (0.0009) [2023-12-26 12:19:36,567][123091] Updated weights for policy 0, policy_version 1594496 (0.0010) [2023-12-26 12:19:36,616][123091] Updated weights for policy 0, policy_version 1594506 (0.0011) [2023-12-26 12:19:37,334][123090] Updated weights for policy 1, policy_version 1583976 (0.0010) [2023-12-26 12:19:37,395][123091] Updated weights for policy 0, policy_version 1594516 (0.0011) [2023-12-26 12:19:37,406][123090] Updated weights for policy 1, policy_version 1583986 (0.0008) [2023-12-26 12:19:37,447][123091] Updated weights for policy 0, policy_version 1594527 (0.0012) [2023-12-26 12:19:37,465][123090] Updated weights for policy 1, policy_version 1583996 (0.0007) [2023-12-26 12:19:37,506][123091] Updated weights for policy 0, policy_version 1594537 (0.0005) [2023-12-26 12:19:38,207][123091] Updated weights for policy 0, policy_version 1594547 (0.0007) [2023-12-26 12:19:38,255][123090] Updated weights for policy 1, policy_version 1584006 (0.0007) [2023-12-26 12:19:38,260][123091] Updated weights for policy 0, policy_version 1594557 (0.0007) [2023-12-26 12:19:38,311][123091] Updated weights for policy 0, policy_version 1594567 (0.0009) [2023-12-26 12:19:38,321][123090] Updated weights for policy 1, policy_version 1584016 (0.0009) [2023-12-26 12:19:38,390][123090] Updated weights for policy 1, policy_version 1584026 (0.0011) [2023-12-26 12:19:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 813727744. Throughput: 0: 8785.0, 1: 9053.8. Samples: 813701616. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:38,785][121949] Avg episode reward: [(0, '6010.837'), (1, '5014.361')] [2023-12-26 12:19:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001594576_408215552.pth... [2023-12-26 12:19:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001584032_405512192.pth... [2023-12-26 12:19:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001593552_407953408.pth [2023-12-26 12:19:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001583008_405250048.pth [2023-12-26 12:19:39,133][123091] Updated weights for policy 0, policy_version 1594577 (0.0008) [2023-12-26 12:19:39,182][123091] Updated weights for policy 0, policy_version 1594587 (0.0009) [2023-12-26 12:19:39,206][123090] Updated weights for policy 1, policy_version 1584036 (0.0011) [2023-12-26 12:19:39,249][123091] Updated weights for policy 0, policy_version 1594597 (0.0007) [2023-12-26 12:19:39,276][123090] Updated weights for policy 1, policy_version 1584046 (0.0011) [2023-12-26 12:19:39,314][123091] Updated weights for policy 0, policy_version 1594607 (0.0007) [2023-12-26 12:19:39,342][123090] Updated weights for policy 1, policy_version 1584056 (0.0011) [2023-12-26 12:19:40,138][123090] Updated weights for policy 1, policy_version 1584066 (0.0011) [2023-12-26 12:19:40,206][123090] Updated weights for policy 1, policy_version 1584076 (0.0011) [2023-12-26 12:19:40,239][123091] Updated weights for policy 0, policy_version 1594617 (0.0007) [2023-12-26 12:19:40,273][123090] Updated weights for policy 1, policy_version 1584086 (0.0011) [2023-12-26 12:19:40,301][123091] Updated weights for policy 0, policy_version 1594627 (0.0010) [2023-12-26 12:19:40,345][123090] Updated weights for policy 1, policy_version 1584096 (0.0011) [2023-12-26 12:19:40,375][123091] Updated weights for policy 0, policy_version 1594637 (0.0008) [2023-12-26 12:19:41,160][123090] Updated weights for policy 1, policy_version 1584106 (0.0010) [2023-12-26 12:19:41,160][123091] Updated weights for policy 0, policy_version 1594647 (0.0009) [2023-12-26 12:19:41,219][123091] Updated weights for policy 0, policy_version 1594657 (0.0008) [2023-12-26 12:19:41,225][123090] Updated weights for policy 1, policy_version 1584116 (0.0011) [2023-12-26 12:19:41,288][123091] Updated weights for policy 0, policy_version 1594667 (0.0009) [2023-12-26 12:19:41,295][123090] Updated weights for policy 1, policy_version 1584126 (0.0011) [2023-12-26 12:19:42,113][123091] Updated weights for policy 0, policy_version 1594677 (0.0008) [2023-12-26 12:19:42,137][123090] Updated weights for policy 1, policy_version 1584136 (0.0011) [2023-12-26 12:19:42,166][123091] Updated weights for policy 0, policy_version 1594687 (0.0006) [2023-12-26 12:19:42,197][123090] Updated weights for policy 1, policy_version 1584146 (0.0010) [2023-12-26 12:19:42,218][123091] Updated weights for policy 0, policy_version 1594697 (0.0009) [2023-12-26 12:19:42,265][123090] Updated weights for policy 1, policy_version 1584156 (0.0011) [2023-12-26 12:19:43,050][123090] Updated weights for policy 1, policy_version 1584166 (0.0010) [2023-12-26 12:19:43,100][123090] Updated weights for policy 1, policy_version 1584176 (0.0010) [2023-12-26 12:19:43,103][123091] Updated weights for policy 0, policy_version 1594707 (0.0007) [2023-12-26 12:19:43,156][123090] Updated weights for policy 1, policy_version 1584186 (0.0008) [2023-12-26 12:19:43,166][123091] Updated weights for policy 0, policy_version 1594717 (0.0009) [2023-12-26 12:19:43,228][123091] Updated weights for policy 0, policy_version 1594727 (0.0009) [2023-12-26 12:19:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 813809664. Throughput: 0: 8797.9, 1: 8886.9. Samples: 813804604. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:43,785][121949] Avg episode reward: [(0, '6150.018'), (1, '5205.612')] [2023-12-26 12:19:43,850][123090] Updated weights for policy 1, policy_version 1584196 (0.0008) [2023-12-26 12:19:43,905][123090] Updated weights for policy 1, policy_version 1584206 (0.0009) [2023-12-26 12:19:43,954][123090] Updated weights for policy 1, policy_version 1584216 (0.0009) [2023-12-26 12:19:44,079][123091] Updated weights for policy 0, policy_version 1594737 (0.0010) [2023-12-26 12:19:44,137][123091] Updated weights for policy 0, policy_version 1594748 (0.0009) [2023-12-26 12:19:44,184][123091] Updated weights for policy 0, policy_version 1594758 (0.0009) [2023-12-26 12:19:44,238][123091] Updated weights for policy 0, policy_version 1594768 (0.0010) [2023-12-26 12:19:44,812][123090] Updated weights for policy 1, policy_version 1584226 (0.0009) [2023-12-26 12:19:44,874][123090] Updated weights for policy 1, policy_version 1584236 (0.0010) [2023-12-26 12:19:44,932][123090] Updated weights for policy 1, policy_version 1584246 (0.0009) [2023-12-26 12:19:44,998][123090] Updated weights for policy 1, policy_version 1584256 (0.0009) [2023-12-26 12:19:45,099][123091] Updated weights for policy 0, policy_version 1594778 (0.0009) [2023-12-26 12:19:45,158][123091] Updated weights for policy 0, policy_version 1594788 (0.0009) [2023-12-26 12:19:45,206][123091] Updated weights for policy 0, policy_version 1594798 (0.0009) [2023-12-26 12:19:45,841][123090] Updated weights for policy 1, policy_version 1584266 (0.0010) [2023-12-26 12:19:45,907][123090] Updated weights for policy 1, policy_version 1584276 (0.0009) [2023-12-26 12:19:45,976][123090] Updated weights for policy 1, policy_version 1584286 (0.0010) [2023-12-26 12:19:46,035][123091] Updated weights for policy 0, policy_version 1594808 (0.0009) [2023-12-26 12:19:46,097][123091] Updated weights for policy 0, policy_version 1594819 (0.0009) [2023-12-26 12:19:46,153][123091] Updated weights for policy 0, policy_version 1594829 (0.0009) [2023-12-26 12:19:46,791][123090] Updated weights for policy 1, policy_version 1584296 (0.0007) [2023-12-26 12:19:46,843][123090] Updated weights for policy 1, policy_version 1584306 (0.0010) [2023-12-26 12:19:46,890][123090] Updated weights for policy 1, policy_version 1584316 (0.0008) [2023-12-26 12:19:47,001][123091] Updated weights for policy 0, policy_version 1594839 (0.0009) [2023-12-26 12:19:47,054][123091] Updated weights for policy 0, policy_version 1594849 (0.0009) [2023-12-26 12:19:47,106][123091] Updated weights for policy 0, policy_version 1594859 (0.0010) [2023-12-26 12:19:47,741][123090] Updated weights for policy 1, policy_version 1584326 (0.0007) [2023-12-26 12:19:47,810][123090] Updated weights for policy 1, policy_version 1584336 (0.0005) [2023-12-26 12:19:47,881][123090] Updated weights for policy 1, policy_version 1584346 (0.0005) [2023-12-26 12:19:47,964][123091] Updated weights for policy 0, policy_version 1594869 (0.0009) [2023-12-26 12:19:48,027][123091] Updated weights for policy 0, policy_version 1594879 (0.0010) [2023-12-26 12:19:48,093][123091] Updated weights for policy 0, policy_version 1594889 (0.0010) [2023-12-26 12:19:48,570][123090] Updated weights for policy 1, policy_version 1584356 (0.0007) [2023-12-26 12:19:48,623][123090] Updated weights for policy 1, policy_version 1584366 (0.0009) [2023-12-26 12:19:48,687][123090] Updated weights for policy 1, policy_version 1584376 (0.0010) [2023-12-26 12:19:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 813899776. Throughput: 0: 8739.3, 1: 8857.7. Samples: 813908256. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:48,784][121949] Avg episode reward: [(0, '6132.341'), (1, '5569.803')] [2023-12-26 12:19:48,968][123091] Updated weights for policy 0, policy_version 1594899 (0.0010) [2023-12-26 12:19:49,038][123091] Updated weights for policy 0, policy_version 1594909 (0.0009) [2023-12-26 12:19:49,103][123091] Updated weights for policy 0, policy_version 1594919 (0.0010) [2023-12-26 12:19:49,516][123090] Updated weights for policy 1, policy_version 1584386 (0.0008) [2023-12-26 12:19:49,571][123090] Updated weights for policy 1, policy_version 1584396 (0.0005) [2023-12-26 12:19:49,637][123090] Updated weights for policy 1, policy_version 1584406 (0.0005) [2023-12-26 12:19:49,695][123090] Updated weights for policy 1, policy_version 1584416 (0.0005) [2023-12-26 12:19:50,039][123091] Updated weights for policy 0, policy_version 1594929 (0.0010) [2023-12-26 12:19:50,118][123091] Updated weights for policy 0, policy_version 1594939 (0.0009) [2023-12-26 12:19:50,178][123091] Updated weights for policy 0, policy_version 1594949 (0.0009) [2023-12-26 12:19:50,247][123091] Updated weights for policy 0, policy_version 1594959 (0.0009) [2023-12-26 12:19:50,427][123090] Updated weights for policy 1, policy_version 1584426 (0.0008) [2023-12-26 12:19:50,483][123090] Updated weights for policy 1, policy_version 1584436 (0.0008) [2023-12-26 12:19:50,528][123090] Updated weights for policy 1, policy_version 1584446 (0.0008) [2023-12-26 12:19:51,111][123091] Updated weights for policy 0, policy_version 1594969 (0.0010) [2023-12-26 12:19:51,180][123091] Updated weights for policy 0, policy_version 1594979 (0.0009) [2023-12-26 12:19:51,245][123091] Updated weights for policy 0, policy_version 1594989 (0.0010) [2023-12-26 12:19:51,371][123090] Updated weights for policy 1, policy_version 1584456 (0.0008) [2023-12-26 12:19:51,441][123090] Updated weights for policy 1, policy_version 1584466 (0.0008) [2023-12-26 12:19:51,509][123090] Updated weights for policy 1, policy_version 1584476 (0.0009) [2023-12-26 12:19:52,078][123091] Updated weights for policy 0, policy_version 1594999 (0.0007) [2023-12-26 12:19:52,133][123091] Updated weights for policy 0, policy_version 1595009 (0.0010) [2023-12-26 12:19:52,200][123091] Updated weights for policy 0, policy_version 1595019 (0.0010) [2023-12-26 12:19:52,311][123090] Updated weights for policy 1, policy_version 1584486 (0.0007) [2023-12-26 12:19:52,385][123090] Updated weights for policy 1, policy_version 1584496 (0.0006) [2023-12-26 12:19:52,450][123090] Updated weights for policy 1, policy_version 1584506 (0.0006) [2023-12-26 12:19:52,913][123091] Updated weights for policy 0, policy_version 1595029 (0.0010) [2023-12-26 12:19:52,965][123091] Updated weights for policy 0, policy_version 1595039 (0.0006) [2023-12-26 12:19:53,021][123091] Updated weights for policy 0, policy_version 1595049 (0.0006) [2023-12-26 12:19:53,134][123090] Updated weights for policy 1, policy_version 1584516 (0.0007) [2023-12-26 12:19:53,212][123090] Updated weights for policy 1, policy_version 1584526 (0.0005) [2023-12-26 12:19:53,274][123090] Updated weights for policy 1, policy_version 1584536 (0.0005) [2023-12-26 12:19:53,715][123091] Updated weights for policy 0, policy_version 1595059 (0.0006) [2023-12-26 12:19:53,764][123091] Updated weights for policy 0, policy_version 1595069 (0.0009) [2023-12-26 12:19:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 813981696. Throughput: 0: 8705.7, 1: 8853.3. Samples: 813958736. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:53,785][121949] Avg episode reward: [(0, '6104.581'), (1, '5421.896')] [2023-12-26 12:19:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001584544_405643264.pth... [2023-12-26 12:19:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001583488_405372928.pth [2023-12-26 12:19:53,817][123091] Updated weights for policy 0, policy_version 1595080 (0.0009) [2023-12-26 12:19:53,853][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001595088_408346624.pth... [2023-12-26 12:19:53,856][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001594064_408084480.pth [2023-12-26 12:19:53,998][123090] Updated weights for policy 1, policy_version 1584546 (0.0006) [2023-12-26 12:19:54,062][123090] Updated weights for policy 1, policy_version 1584556 (0.0009) [2023-12-26 12:19:54,117][123090] Updated weights for policy 1, policy_version 1584566 (0.0008) [2023-12-26 12:19:54,177][123090] Updated weights for policy 1, policy_version 1584576 (0.0009) [2023-12-26 12:19:54,655][123091] Updated weights for policy 0, policy_version 1595090 (0.0009) [2023-12-26 12:19:54,721][123091] Updated weights for policy 0, policy_version 1595100 (0.0009) [2023-12-26 12:19:54,774][123091] Updated weights for policy 0, policy_version 1595110 (0.0009) [2023-12-26 12:19:54,826][123091] Updated weights for policy 0, policy_version 1595120 (0.0008) [2023-12-26 12:19:54,952][123090] Updated weights for policy 1, policy_version 1584586 (0.0011) [2023-12-26 12:19:55,009][123090] Updated weights for policy 1, policy_version 1584596 (0.0011) [2023-12-26 12:19:55,075][123090] Updated weights for policy 1, policy_version 1584606 (0.0011) [2023-12-26 12:19:55,647][123091] Updated weights for policy 0, policy_version 1595130 (0.0005) [2023-12-26 12:19:55,720][123091] Updated weights for policy 0, policy_version 1595140 (0.0005) [2023-12-26 12:19:55,785][123091] Updated weights for policy 0, policy_version 1595150 (0.0005) [2023-12-26 12:19:55,901][123090] Updated weights for policy 1, policy_version 1584616 (0.0010) [2023-12-26 12:19:55,956][123090] Updated weights for policy 1, policy_version 1584626 (0.0010) [2023-12-26 12:19:56,012][123090] Updated weights for policy 1, policy_version 1584636 (0.0010) [2023-12-26 12:19:56,395][123091] Updated weights for policy 0, policy_version 1595160 (0.0005) [2023-12-26 12:19:56,447][123091] Updated weights for policy 0, policy_version 1595170 (0.0005) [2023-12-26 12:19:56,495][123091] Updated weights for policy 0, policy_version 1595180 (0.0007) [2023-12-26 12:19:56,775][123090] Updated weights for policy 1, policy_version 1584646 (0.0008) [2023-12-26 12:19:56,834][123090] Updated weights for policy 1, policy_version 1584656 (0.0005) [2023-12-26 12:19:56,883][123090] Updated weights for policy 1, policy_version 1584666 (0.0005) [2023-12-26 12:19:57,370][123091] Updated weights for policy 0, policy_version 1595190 (0.0008) [2023-12-26 12:19:57,419][123091] Updated weights for policy 0, policy_version 1595200 (0.0009) [2023-12-26 12:19:57,479][123091] Updated weights for policy 0, policy_version 1595210 (0.0010) [2023-12-26 12:19:57,571][123090] Updated weights for policy 1, policy_version 1584676 (0.0006) [2023-12-26 12:19:57,632][123090] Updated weights for policy 1, policy_version 1584686 (0.0006) [2023-12-26 12:19:57,692][123090] Updated weights for policy 1, policy_version 1584696 (0.0007) [2023-12-26 12:19:58,328][123091] Updated weights for policy 0, policy_version 1595220 (0.0009) [2023-12-26 12:19:58,342][123090] Updated weights for policy 1, policy_version 1584706 (0.0009) [2023-12-26 12:19:58,402][123091] Updated weights for policy 0, policy_version 1595230 (0.0009) [2023-12-26 12:19:58,415][123090] Updated weights for policy 1, policy_version 1584716 (0.0007) [2023-12-26 12:19:58,466][123091] Updated weights for policy 0, policy_version 1595240 (0.0009) [2023-12-26 12:19:58,476][123090] Updated weights for policy 1, policy_version 1584726 (0.0009) [2023-12-26 12:19:58,550][123090] Updated weights for policy 1, policy_version 1584736 (0.0007) [2023-12-26 12:19:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 814080000. Throughput: 0: 8766.3, 1: 8936.7. Samples: 814069992. Policy #0 lag: (min: 30.0, avg: 30.2, max: 35.0) [2023-12-26 12:19:58,785][121949] Avg episode reward: [(0, '6080.269'), (1, '5476.134')] [2023-12-26 12:19:59,349][123091] Updated weights for policy 0, policy_version 1595250 (0.0008) [2023-12-26 12:19:59,416][123091] Updated weights for policy 0, policy_version 1595260 (0.0010) [2023-12-26 12:19:59,441][123090] Updated weights for policy 1, policy_version 1584746 (0.0008) [2023-12-26 12:19:59,481][123091] Updated weights for policy 0, policy_version 1595270 (0.0008) [2023-12-26 12:19:59,510][123090] Updated weights for policy 1, policy_version 1584756 (0.0009) [2023-12-26 12:19:59,543][123091] Updated weights for policy 0, policy_version 1595280 (0.0007) [2023-12-26 12:19:59,580][123090] Updated weights for policy 1, policy_version 1584766 (0.0010) [2023-12-26 12:20:00,261][123091] Updated weights for policy 0, policy_version 1595290 (0.0009) [2023-12-26 12:20:00,318][123091] Updated weights for policy 0, policy_version 1595300 (0.0009) [2023-12-26 12:20:00,374][123091] Updated weights for policy 0, policy_version 1595310 (0.0010) [2023-12-26 12:20:00,447][123090] Updated weights for policy 1, policy_version 1584776 (0.0010) [2023-12-26 12:20:00,500][123090] Updated weights for policy 1, policy_version 1584786 (0.0009) [2023-12-26 12:20:00,553][123090] Updated weights for policy 1, policy_version 1584796 (0.0008) [2023-12-26 12:20:01,131][123091] Updated weights for policy 0, policy_version 1595320 (0.0008) [2023-12-26 12:20:01,191][123090] Updated weights for policy 1, policy_version 1584806 (0.0007) [2023-12-26 12:20:01,192][123091] Updated weights for policy 0, policy_version 1595330 (0.0007) [2023-12-26 12:20:01,252][123091] Updated weights for policy 0, policy_version 1595340 (0.0007) [2023-12-26 12:20:01,264][123090] Updated weights for policy 1, policy_version 1584816 (0.0007) [2023-12-26 12:20:01,329][123090] Updated weights for policy 1, policy_version 1584826 (0.0009) [2023-12-26 12:20:02,026][123091] Updated weights for policy 0, policy_version 1595350 (0.0008) [2023-12-26 12:20:02,087][123091] Updated weights for policy 0, policy_version 1595360 (0.0009) [2023-12-26 12:20:02,150][123090] Updated weights for policy 1, policy_version 1584836 (0.0008) [2023-12-26 12:20:02,152][123091] Updated weights for policy 0, policy_version 1595370 (0.0009) [2023-12-26 12:20:02,197][123090] Updated weights for policy 1, policy_version 1584846 (0.0007) [2023-12-26 12:20:02,250][123090] Updated weights for policy 1, policy_version 1584856 (0.0009) [2023-12-26 12:20:02,978][123091] Updated weights for policy 0, policy_version 1595380 (0.0008) [2023-12-26 12:20:03,028][123091] Updated weights for policy 0, policy_version 1595390 (0.0009) [2023-12-26 12:20:03,083][123091] Updated weights for policy 0, policy_version 1595400 (0.0010) [2023-12-26 12:20:03,107][123090] Updated weights for policy 1, policy_version 1584866 (0.0009) [2023-12-26 12:20:03,164][123090] Updated weights for policy 1, policy_version 1584876 (0.0009) [2023-12-26 12:20:03,213][123090] Updated weights for policy 1, policy_version 1584887 (0.0009) [2023-12-26 12:20:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 814161920. Throughput: 0: 8698.0, 1: 8990.0. Samples: 814174676. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:03,785][121949] Avg episode reward: [(0, '6198.723'), (1, '5532.520')] [2023-12-26 12:20:03,917][123091] Updated weights for policy 0, policy_version 1595410 (0.0007) [2023-12-26 12:20:03,969][123091] Updated weights for policy 0, policy_version 1595420 (0.0010) [2023-12-26 12:20:04,030][123091] Updated weights for policy 0, policy_version 1595430 (0.0010) [2023-12-26 12:20:04,059][123090] Updated weights for policy 1, policy_version 1584897 (0.0008) [2023-12-26 12:20:04,097][123091] Updated weights for policy 0, policy_version 1595440 (0.0008) [2023-12-26 12:20:04,127][123090] Updated weights for policy 1, policy_version 1584907 (0.0009) [2023-12-26 12:20:04,194][123090] Updated weights for policy 1, policy_version 1584917 (0.0009) [2023-12-26 12:20:04,245][123090] Updated weights for policy 1, policy_version 1584927 (0.0009) [2023-12-26 12:20:04,940][123091] Updated weights for policy 0, policy_version 1595450 (0.0009) [2023-12-26 12:20:04,994][123091] Updated weights for policy 0, policy_version 1595460 (0.0009) [2023-12-26 12:20:05,050][123091] Updated weights for policy 0, policy_version 1595470 (0.0009) [2023-12-26 12:20:05,088][123090] Updated weights for policy 1, policy_version 1584937 (0.0008) [2023-12-26 12:20:05,143][123090] Updated weights for policy 1, policy_version 1584947 (0.0008) [2023-12-26 12:20:05,195][123090] Updated weights for policy 1, policy_version 1584957 (0.0009) [2023-12-26 12:20:05,846][123091] Updated weights for policy 0, policy_version 1595480 (0.0006) [2023-12-26 12:20:05,901][123091] Updated weights for policy 0, policy_version 1595490 (0.0005) [2023-12-26 12:20:05,962][123091] Updated weights for policy 0, policy_version 1595500 (0.0006) [2023-12-26 12:20:06,107][123090] Updated weights for policy 1, policy_version 1584967 (0.0008) [2023-12-26 12:20:06,167][123090] Updated weights for policy 1, policy_version 1584977 (0.0006) [2023-12-26 12:20:06,235][123090] Updated weights for policy 1, policy_version 1584987 (0.0005) [2023-12-26 12:20:06,787][123091] Updated weights for policy 0, policy_version 1595510 (0.0010) [2023-12-26 12:20:06,842][123091] Updated weights for policy 0, policy_version 1595520 (0.0011) [2023-12-26 12:20:06,912][123091] Updated weights for policy 0, policy_version 1595530 (0.0011) [2023-12-26 12:20:07,013][123090] Updated weights for policy 1, policy_version 1584997 (0.0007) [2023-12-26 12:20:07,077][123090] Updated weights for policy 1, policy_version 1585007 (0.0009) [2023-12-26 12:20:07,149][123090] Updated weights for policy 1, policy_version 1585017 (0.0009) [2023-12-26 12:20:07,728][123091] Updated weights for policy 0, policy_version 1595540 (0.0009) [2023-12-26 12:20:07,789][123091] Updated weights for policy 0, policy_version 1595550 (0.0006) [2023-12-26 12:20:07,841][123091] Updated weights for policy 0, policy_version 1595560 (0.0005) [2023-12-26 12:20:07,915][123090] Updated weights for policy 1, policy_version 1585027 (0.0009) [2023-12-26 12:20:07,978][123090] Updated weights for policy 1, policy_version 1585037 (0.0010) [2023-12-26 12:20:08,042][123090] Updated weights for policy 1, policy_version 1585047 (0.0010) [2023-12-26 12:20:08,628][123091] Updated weights for policy 0, policy_version 1595570 (0.0007) [2023-12-26 12:20:08,684][123091] Updated weights for policy 0, policy_version 1595580 (0.0011) [2023-12-26 12:20:08,744][123091] Updated weights for policy 0, policy_version 1595590 (0.0010) [2023-12-26 12:20:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17613.0, 300 sec: 17661.4). Total num frames: 814243840. Throughput: 0: 8740.4, 1: 8965.2. Samples: 814226304. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:08,785][121949] Avg episode reward: [(0, '6328.024'), (1, '5690.137')] [2023-12-26 12:20:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001585056_405774336.pth... [2023-12-26 12:20:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001584032_405512192.pth [2023-12-26 12:20:08,812][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001595600_408477696.pth... [2023-12-26 12:20:08,814][123091] Updated weights for policy 0, policy_version 1595600 (0.0011) [2023-12-26 12:20:08,817][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001594576_408215552.pth [2023-12-26 12:20:08,896][123090] Updated weights for policy 1, policy_version 1585057 (0.0009) [2023-12-26 12:20:08,961][123090] Updated weights for policy 1, policy_version 1585067 (0.0009) [2023-12-26 12:20:09,024][123090] Updated weights for policy 1, policy_version 1585077 (0.0009) [2023-12-26 12:20:09,081][123090] Updated weights for policy 1, policy_version 1585087 (0.0009) [2023-12-26 12:20:09,641][123091] Updated weights for policy 0, policy_version 1595610 (0.0010) [2023-12-26 12:20:09,696][123091] Updated weights for policy 0, policy_version 1595620 (0.0010) [2023-12-26 12:20:09,763][123091] Updated weights for policy 0, policy_version 1595630 (0.0010) [2023-12-26 12:20:09,978][123090] Updated weights for policy 1, policy_version 1585097 (0.0010) [2023-12-26 12:20:10,046][123090] Updated weights for policy 1, policy_version 1585107 (0.0010) [2023-12-26 12:20:10,110][123090] Updated weights for policy 1, policy_version 1585117 (0.0008) [2023-12-26 12:20:10,637][123091] Updated weights for policy 0, policy_version 1595640 (0.0009) [2023-12-26 12:20:10,685][123091] Updated weights for policy 0, policy_version 1595650 (0.0009) [2023-12-26 12:20:10,733][123091] Updated weights for policy 0, policy_version 1595660 (0.0009) [2023-12-26 12:20:10,863][123090] Updated weights for policy 1, policy_version 1585127 (0.0005) [2023-12-26 12:20:10,938][123090] Updated weights for policy 1, policy_version 1585137 (0.0005) [2023-12-26 12:20:11,018][123090] Updated weights for policy 1, policy_version 1585147 (0.0006) [2023-12-26 12:20:11,581][123091] Updated weights for policy 0, policy_version 1595670 (0.0010) [2023-12-26 12:20:11,640][123091] Updated weights for policy 0, policy_version 1595680 (0.0009) [2023-12-26 12:20:11,701][123091] Updated weights for policy 0, policy_version 1595690 (0.0010) [2023-12-26 12:20:11,806][123090] Updated weights for policy 1, policy_version 1585157 (0.0008) [2023-12-26 12:20:11,886][123090] Updated weights for policy 1, policy_version 1585167 (0.0007) [2023-12-26 12:20:11,950][123090] Updated weights for policy 1, policy_version 1585177 (0.0009) [2023-12-26 12:20:12,548][123091] Updated weights for policy 0, policy_version 1595700 (0.0008) [2023-12-26 12:20:12,616][123091] Updated weights for policy 0, policy_version 1595710 (0.0009) [2023-12-26 12:20:12,670][123091] Updated weights for policy 0, policy_version 1595720 (0.0010) [2023-12-26 12:20:12,757][123090] Updated weights for policy 1, policy_version 1585187 (0.0010) [2023-12-26 12:20:12,824][123090] Updated weights for policy 1, policy_version 1585197 (0.0010) [2023-12-26 12:20:12,897][123090] Updated weights for policy 1, policy_version 1585207 (0.0009) [2023-12-26 12:20:13,290][123091] Updated weights for policy 0, policy_version 1595730 (0.0008) [2023-12-26 12:20:13,351][123091] Updated weights for policy 0, policy_version 1595740 (0.0009) [2023-12-26 12:20:13,408][123091] Updated weights for policy 0, policy_version 1595750 (0.0009) [2023-12-26 12:20:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 814333952. Throughput: 0: 8662.6, 1: 8895.3. Samples: 814329472. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:13,785][121949] Avg episode reward: [(0, '6307.055'), (1, '5414.718')] [2023-12-26 12:20:13,804][123090] Updated weights for policy 1, policy_version 1585217 (0.0010) [2023-12-26 12:20:13,859][123090] Updated weights for policy 1, policy_version 1585227 (0.0010) [2023-12-26 12:20:13,912][123090] Updated weights for policy 1, policy_version 1585237 (0.0010) [2023-12-26 12:20:13,966][123090] Updated weights for policy 1, policy_version 1585247 (0.0010) [2023-12-26 12:20:14,120][123091] Updated weights for policy 0, policy_version 1595761 (0.0009) [2023-12-26 12:20:14,187][123091] Updated weights for policy 0, policy_version 1595771 (0.0007) [2023-12-26 12:20:14,250][123091] Updated weights for policy 0, policy_version 1595781 (0.0009) [2023-12-26 12:20:14,298][123091] Updated weights for policy 0, policy_version 1595791 (0.0009) [2023-12-26 12:20:14,852][123090] Updated weights for policy 1, policy_version 1585257 (0.0009) [2023-12-26 12:20:14,915][123090] Updated weights for policy 1, policy_version 1585267 (0.0010) [2023-12-26 12:20:14,981][123090] Updated weights for policy 1, policy_version 1585277 (0.0009) [2023-12-26 12:20:15,082][123091] Updated weights for policy 0, policy_version 1595801 (0.0006) [2023-12-26 12:20:15,157][123091] Updated weights for policy 0, policy_version 1595811 (0.0006) [2023-12-26 12:20:15,229][123091] Updated weights for policy 0, policy_version 1595821 (0.0006) [2023-12-26 12:20:15,890][123090] Updated weights for policy 1, policy_version 1585287 (0.0009) [2023-12-26 12:20:15,933][123091] Updated weights for policy 0, policy_version 1595831 (0.0005) [2023-12-26 12:20:15,952][123090] Updated weights for policy 1, policy_version 1585297 (0.0010) [2023-12-26 12:20:16,003][123091] Updated weights for policy 0, policy_version 1595841 (0.0005) [2023-12-26 12:20:16,013][123090] Updated weights for policy 1, policy_version 1585307 (0.0009) [2023-12-26 12:20:16,075][123091] Updated weights for policy 0, policy_version 1595851 (0.0005) [2023-12-26 12:20:16,724][123091] Updated weights for policy 0, policy_version 1595861 (0.0007) [2023-12-26 12:20:16,786][123091] Updated weights for policy 0, policy_version 1595871 (0.0009) [2023-12-26 12:20:16,854][123091] Updated weights for policy 0, policy_version 1595881 (0.0009) [2023-12-26 12:20:16,901][123090] Updated weights for policy 1, policy_version 1585317 (0.0009) [2023-12-26 12:20:16,967][123090] Updated weights for policy 1, policy_version 1585327 (0.0010) [2023-12-26 12:20:17,031][123090] Updated weights for policy 1, policy_version 1585337 (0.0009) [2023-12-26 12:20:17,578][123091] Updated weights for policy 0, policy_version 1595891 (0.0006) [2023-12-26 12:20:17,642][123091] Updated weights for policy 0, policy_version 1595901 (0.0005) [2023-12-26 12:20:17,697][123091] Updated weights for policy 0, policy_version 1595911 (0.0005) [2023-12-26 12:20:17,788][123090] Updated weights for policy 1, policy_version 1585347 (0.0007) [2023-12-26 12:20:17,838][123090] Updated weights for policy 1, policy_version 1585357 (0.0005) [2023-12-26 12:20:17,892][123090] Updated weights for policy 1, policy_version 1585367 (0.0005) [2023-12-26 12:20:18,460][123091] Updated weights for policy 0, policy_version 1595921 (0.0005) [2023-12-26 12:20:18,514][123091] Updated weights for policy 0, policy_version 1595931 (0.0005) [2023-12-26 12:20:18,571][123091] Updated weights for policy 0, policy_version 1595941 (0.0005) [2023-12-26 12:20:18,576][123090] Updated weights for policy 1, policy_version 1585377 (0.0005) [2023-12-26 12:20:18,625][123091] Updated weights for policy 0, policy_version 1595951 (0.0005) [2023-12-26 12:20:18,632][123090] Updated weights for policy 1, policy_version 1585387 (0.0009) [2023-12-26 12:20:18,691][123090] Updated weights for policy 1, policy_version 1585397 (0.0009) [2023-12-26 12:20:18,757][123090] Updated weights for policy 1, policy_version 1585407 (0.0009) [2023-12-26 12:20:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 814432256. Throughput: 0: 8813.8, 1: 8770.3. Samples: 814437812. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:18,785][121949] Avg episode reward: [(0, '6327.000'), (1, '5224.681')] [2023-12-26 12:20:19,435][123091] Updated weights for policy 0, policy_version 1595961 (0.0006) [2023-12-26 12:20:19,499][123091] Updated weights for policy 0, policy_version 1595971 (0.0006) [2023-12-26 12:20:19,559][123091] Updated weights for policy 0, policy_version 1595981 (0.0009) [2023-12-26 12:20:19,622][123090] Updated weights for policy 1, policy_version 1585417 (0.0008) [2023-12-26 12:20:19,670][123090] Updated weights for policy 1, policy_version 1585427 (0.0008) [2023-12-26 12:20:19,728][123090] Updated weights for policy 1, policy_version 1585437 (0.0006) [2023-12-26 12:20:20,347][123091] Updated weights for policy 0, policy_version 1595991 (0.0007) [2023-12-26 12:20:20,419][123091] Updated weights for policy 0, policy_version 1596001 (0.0010) [2023-12-26 12:20:20,486][123091] Updated weights for policy 0, policy_version 1596011 (0.0009) [2023-12-26 12:20:20,506][123090] Updated weights for policy 1, policy_version 1585447 (0.0007) [2023-12-26 12:20:20,572][123090] Updated weights for policy 1, policy_version 1585457 (0.0007) [2023-12-26 12:20:20,638][123090] Updated weights for policy 1, policy_version 1585467 (0.0008) [2023-12-26 12:20:21,346][123091] Updated weights for policy 0, policy_version 1596021 (0.0010) [2023-12-26 12:20:21,414][123091] Updated weights for policy 0, policy_version 1596031 (0.0011) [2023-12-26 12:20:21,432][123090] Updated weights for policy 1, policy_version 1585477 (0.0010) [2023-12-26 12:20:21,484][123091] Updated weights for policy 0, policy_version 1596041 (0.0006) [2023-12-26 12:20:21,489][123090] Updated weights for policy 1, policy_version 1585487 (0.0011) [2023-12-26 12:20:21,551][123090] Updated weights for policy 1, policy_version 1585497 (0.0007) [2023-12-26 12:20:22,251][123091] Updated weights for policy 0, policy_version 1596051 (0.0007) [2023-12-26 12:20:22,302][123091] Updated weights for policy 0, policy_version 1596061 (0.0010) [2023-12-26 12:20:22,367][123091] Updated weights for policy 0, policy_version 1596071 (0.0011) [2023-12-26 12:20:22,387][123090] Updated weights for policy 1, policy_version 1585507 (0.0006) [2023-12-26 12:20:22,457][123090] Updated weights for policy 1, policy_version 1585517 (0.0007) [2023-12-26 12:20:22,520][123090] Updated weights for policy 1, policy_version 1585527 (0.0009) [2023-12-26 12:20:23,204][123091] Updated weights for policy 0, policy_version 1596081 (0.0011) [2023-12-26 12:20:23,270][123091] Updated weights for policy 0, policy_version 1596091 (0.0010) [2023-12-26 12:20:23,336][123091] Updated weights for policy 0, policy_version 1596101 (0.0010) [2023-12-26 12:20:23,346][123090] Updated weights for policy 1, policy_version 1585537 (0.0009) [2023-12-26 12:20:23,402][123090] Updated weights for policy 1, policy_version 1585547 (0.0006) [2023-12-26 12:20:23,402][123091] Updated weights for policy 0, policy_version 1596111 (0.0010) [2023-12-26 12:20:23,462][123090] Updated weights for policy 1, policy_version 1585557 (0.0009) [2023-12-26 12:20:23,515][123090] Updated weights for policy 1, policy_version 1585567 (0.0009) [2023-12-26 12:20:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 814514176. Throughput: 0: 8788.7, 1: 8708.6. Samples: 814488996. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:23,784][121949] Avg episode reward: [(0, '6182.144'), (1, '5489.098')] [2023-12-26 12:20:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001596112_408608768.pth... [2023-12-26 12:20:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001585568_405905408.pth... [2023-12-26 12:20:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001595088_408346624.pth [2023-12-26 12:20:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001584544_405643264.pth [2023-12-26 12:20:24,190][123091] Updated weights for policy 0, policy_version 1596121 (0.0010) [2023-12-26 12:20:24,253][123091] Updated weights for policy 0, policy_version 1596131 (0.0010) [2023-12-26 12:20:24,308][123091] Updated weights for policy 0, policy_version 1596141 (0.0010) [2023-12-26 12:20:24,315][123090] Updated weights for policy 1, policy_version 1585577 (0.0006) [2023-12-26 12:20:24,363][123090] Updated weights for policy 1, policy_version 1585587 (0.0005) [2023-12-26 12:20:24,417][123090] Updated weights for policy 1, policy_version 1585597 (0.0007) [2023-12-26 12:20:25,109][123090] Updated weights for policy 1, policy_version 1585607 (0.0007) [2023-12-26 12:20:25,125][123091] Updated weights for policy 0, policy_version 1596151 (0.0007) [2023-12-26 12:20:25,159][123090] Updated weights for policy 1, policy_version 1585617 (0.0005) [2023-12-26 12:20:25,187][123091] Updated weights for policy 0, policy_version 1596161 (0.0005) [2023-12-26 12:20:25,218][123090] Updated weights for policy 1, policy_version 1585627 (0.0006) [2023-12-26 12:20:25,250][123091] Updated weights for policy 0, policy_version 1596171 (0.0008) [2023-12-26 12:20:25,955][123090] Updated weights for policy 1, policy_version 1585637 (0.0009) [2023-12-26 12:20:26,027][123090] Updated weights for policy 1, policy_version 1585647 (0.0009) [2023-12-26 12:20:26,044][123091] Updated weights for policy 0, policy_version 1596181 (0.0009) [2023-12-26 12:20:26,079][123090] Updated weights for policy 1, policy_version 1585657 (0.0009) [2023-12-26 12:20:26,094][123091] Updated weights for policy 0, policy_version 1596191 (0.0007) [2023-12-26 12:20:26,159][123091] Updated weights for policy 0, policy_version 1596201 (0.0005) [2023-12-26 12:20:26,801][123090] Updated weights for policy 1, policy_version 1585667 (0.0009) [2023-12-26 12:20:26,850][123090] Updated weights for policy 1, policy_version 1585677 (0.0009) [2023-12-26 12:20:26,917][123090] Updated weights for policy 1, policy_version 1585687 (0.0008) [2023-12-26 12:20:26,994][123091] Updated weights for policy 0, policy_version 1596211 (0.0010) [2023-12-26 12:20:27,063][123091] Updated weights for policy 0, policy_version 1596221 (0.0009) [2023-12-26 12:20:27,123][123091] Updated weights for policy 0, policy_version 1596231 (0.0009) [2023-12-26 12:20:27,694][123090] Updated weights for policy 1, policy_version 1585697 (0.0006) [2023-12-26 12:20:27,756][123090] Updated weights for policy 1, policy_version 1585707 (0.0010) [2023-12-26 12:20:27,821][123090] Updated weights for policy 1, policy_version 1585717 (0.0008) [2023-12-26 12:20:27,830][123091] Updated weights for policy 0, policy_version 1596241 (0.0009) [2023-12-26 12:20:27,868][123090] Updated weights for policy 1, policy_version 1585727 (0.0005) [2023-12-26 12:20:27,888][123091] Updated weights for policy 0, policy_version 1596251 (0.0009) [2023-12-26 12:20:27,951][123091] Updated weights for policy 0, policy_version 1596261 (0.0010) [2023-12-26 12:20:28,005][123091] Updated weights for policy 0, policy_version 1596271 (0.0010) [2023-12-26 12:20:28,699][123090] Updated weights for policy 1, policy_version 1585737 (0.0009) [2023-12-26 12:20:28,751][123090] Updated weights for policy 1, policy_version 1585747 (0.0009) [2023-12-26 12:20:28,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 814596096. Throughput: 0: 8806.7, 1: 8791.4. Samples: 814596516. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:28,784][121949] Avg episode reward: [(0, '6117.266'), (1, '5387.745')] [2023-12-26 12:20:28,791][123091] Updated weights for policy 0, policy_version 1596281 (0.0006) [2023-12-26 12:20:28,804][123090] Updated weights for policy 1, policy_version 1585757 (0.0009) [2023-12-26 12:20:28,851][123091] Updated weights for policy 0, policy_version 1596291 (0.0005) [2023-12-26 12:20:28,914][123091] Updated weights for policy 0, policy_version 1596301 (0.0008) [2023-12-26 12:20:29,568][123091] Updated weights for policy 0, policy_version 1596311 (0.0009) [2023-12-26 12:20:29,631][123091] Updated weights for policy 0, policy_version 1596321 (0.0011) [2023-12-26 12:20:29,693][123091] Updated weights for policy 0, policy_version 1596331 (0.0010) [2023-12-26 12:20:29,700][123090] Updated weights for policy 1, policy_version 1585767 (0.0008) [2023-12-26 12:20:29,762][123090] Updated weights for policy 1, policy_version 1585777 (0.0008) [2023-12-26 12:20:29,825][123090] Updated weights for policy 1, policy_version 1585787 (0.0009) [2023-12-26 12:20:30,426][123091] Updated weights for policy 0, policy_version 1596341 (0.0011) [2023-12-26 12:20:30,491][123091] Updated weights for policy 0, policy_version 1596351 (0.0010) [2023-12-26 12:20:30,545][123091] Updated weights for policy 0, policy_version 1596361 (0.0009) [2023-12-26 12:20:30,683][123090] Updated weights for policy 1, policy_version 1585797 (0.0008) [2023-12-26 12:20:30,733][123090] Updated weights for policy 1, policy_version 1585807 (0.0009) [2023-12-26 12:20:30,776][123090] Updated weights for policy 1, policy_version 1585817 (0.0010) [2023-12-26 12:20:31,376][123091] Updated weights for policy 0, policy_version 1596371 (0.0009) [2023-12-26 12:20:31,438][123091] Updated weights for policy 0, policy_version 1596381 (0.0008) [2023-12-26 12:20:31,499][123091] Updated weights for policy 0, policy_version 1596391 (0.0006) [2023-12-26 12:20:31,602][123090] Updated weights for policy 1, policy_version 1585827 (0.0010) [2023-12-26 12:20:31,676][123090] Updated weights for policy 1, policy_version 1585837 (0.0010) [2023-12-26 12:20:31,752][123090] Updated weights for policy 1, policy_version 1585847 (0.0011) [2023-12-26 12:20:32,312][123091] Updated weights for policy 0, policy_version 1596401 (0.0006) [2023-12-26 12:20:32,377][123091] Updated weights for policy 0, policy_version 1596411 (0.0009) [2023-12-26 12:20:32,438][123091] Updated weights for policy 0, policy_version 1596421 (0.0010) [2023-12-26 12:20:32,473][123090] Updated weights for policy 1, policy_version 1585857 (0.0010) [2023-12-26 12:20:32,498][123091] Updated weights for policy 0, policy_version 1596431 (0.0007) [2023-12-26 12:20:32,532][123090] Updated weights for policy 1, policy_version 1585867 (0.0008) [2023-12-26 12:20:32,593][123090] Updated weights for policy 1, policy_version 1585877 (0.0006) [2023-12-26 12:20:32,662][123090] Updated weights for policy 1, policy_version 1585887 (0.0005) [2023-12-26 12:20:33,365][123091] Updated weights for policy 0, policy_version 1596441 (0.0009) [2023-12-26 12:20:33,365][123090] Updated weights for policy 1, policy_version 1585897 (0.0007) [2023-12-26 12:20:33,420][123091] Updated weights for policy 0, policy_version 1596451 (0.0009) [2023-12-26 12:20:33,426][123090] Updated weights for policy 1, policy_version 1585907 (0.0009) [2023-12-26 12:20:33,472][123091] Updated weights for policy 0, policy_version 1596461 (0.0006) [2023-12-26 12:20:33,486][123090] Updated weights for policy 1, policy_version 1585917 (0.0010) [2023-12-26 12:20:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 814694400. Throughput: 0: 8878.4, 1: 8770.1. Samples: 814702440. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:33,785][121949] Avg episode reward: [(0, '6170.599'), (1, '5399.327')] [2023-12-26 12:20:34,321][123090] Updated weights for policy 1, policy_version 1585927 (0.0010) [2023-12-26 12:20:34,343][123091] Updated weights for policy 0, policy_version 1596471 (0.0010) [2023-12-26 12:20:34,388][123090] Updated weights for policy 1, policy_version 1585937 (0.0010) [2023-12-26 12:20:34,404][123091] Updated weights for policy 0, policy_version 1596481 (0.0008) [2023-12-26 12:20:34,451][123090] Updated weights for policy 1, policy_version 1585947 (0.0010) [2023-12-26 12:20:34,469][123091] Updated weights for policy 0, policy_version 1596491 (0.0006) [2023-12-26 12:20:35,197][123091] Updated weights for policy 0, policy_version 1596501 (0.0008) [2023-12-26 12:20:35,267][123091] Updated weights for policy 0, policy_version 1596511 (0.0010) [2023-12-26 12:20:35,280][123090] Updated weights for policy 1, policy_version 1585957 (0.0010) [2023-12-26 12:20:35,331][123091] Updated weights for policy 0, policy_version 1596521 (0.0011) [2023-12-26 12:20:35,343][123090] Updated weights for policy 1, policy_version 1585967 (0.0010) [2023-12-26 12:20:35,413][123090] Updated weights for policy 1, policy_version 1585977 (0.0010) [2023-12-26 12:20:36,069][123091] Updated weights for policy 0, policy_version 1596531 (0.0011) [2023-12-26 12:20:36,145][123091] Updated weights for policy 0, policy_version 1596541 (0.0007) [2023-12-26 12:20:36,204][123091] Updated weights for policy 0, policy_version 1596551 (0.0007) [2023-12-26 12:20:36,221][123090] Updated weights for policy 1, policy_version 1585987 (0.0010) [2023-12-26 12:20:36,297][123090] Updated weights for policy 1, policy_version 1585997 (0.0010) [2023-12-26 12:20:36,364][123090] Updated weights for policy 1, policy_version 1586007 (0.0010) [2023-12-26 12:20:36,874][123091] Updated weights for policy 0, policy_version 1596561 (0.0006) [2023-12-26 12:20:36,934][123091] Updated weights for policy 0, policy_version 1596571 (0.0005) [2023-12-26 12:20:36,993][123091] Updated weights for policy 0, policy_version 1596581 (0.0005) [2023-12-26 12:20:37,054][123091] Updated weights for policy 0, policy_version 1596591 (0.0005) [2023-12-26 12:20:37,202][123090] Updated weights for policy 1, policy_version 1586017 (0.0011) [2023-12-26 12:20:37,267][123090] Updated weights for policy 1, policy_version 1586027 (0.0009) [2023-12-26 12:20:37,319][123090] Updated weights for policy 1, policy_version 1586037 (0.0009) [2023-12-26 12:20:37,367][123090] Updated weights for policy 1, policy_version 1586047 (0.0008) [2023-12-26 12:20:37,744][123091] Updated weights for policy 0, policy_version 1596601 (0.0009) [2023-12-26 12:20:37,795][123091] Updated weights for policy 0, policy_version 1596611 (0.0009) [2023-12-26 12:20:37,846][123091] Updated weights for policy 0, policy_version 1596621 (0.0010) [2023-12-26 12:20:38,137][123090] Updated weights for policy 1, policy_version 1586057 (0.0006) [2023-12-26 12:20:38,182][123090] Updated weights for policy 1, policy_version 1586067 (0.0006) [2023-12-26 12:20:38,230][123090] Updated weights for policy 1, policy_version 1586077 (0.0005) [2023-12-26 12:20:38,751][123091] Updated weights for policy 0, policy_version 1596631 (0.0010) [2023-12-26 12:20:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17689.1). Total num frames: 814776320. Throughput: 0: 8957.8, 1: 8759.5. Samples: 814756012. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:38,785][121949] Avg episode reward: [(0, '6061.125'), (1, '5722.449')] [2023-12-26 12:20:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001586080_406036480.pth... [2023-12-26 12:20:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001585056_405774336.pth [2023-12-26 12:20:38,815][123091] Updated weights for policy 0, policy_version 1596641 (0.0009) [2023-12-26 12:20:38,874][123091] Updated weights for policy 0, policy_version 1596651 (0.0009) [2023-12-26 12:20:38,903][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001596656_408748032.pth... [2023-12-26 12:20:38,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001595600_408477696.pth [2023-12-26 12:20:39,050][123090] Updated weights for policy 1, policy_version 1586087 (0.0010) [2023-12-26 12:20:39,102][123090] Updated weights for policy 1, policy_version 1586097 (0.0010) [2023-12-26 12:20:39,151][123090] Updated weights for policy 1, policy_version 1586107 (0.0008) [2023-12-26 12:20:39,687][123091] Updated weights for policy 0, policy_version 1596661 (0.0008) [2023-12-26 12:20:39,756][123091] Updated weights for policy 0, policy_version 1596671 (0.0006) [2023-12-26 12:20:39,826][123091] Updated weights for policy 0, policy_version 1596681 (0.0009) [2023-12-26 12:20:40,009][123090] Updated weights for policy 1, policy_version 1586117 (0.0009) [2023-12-26 12:20:40,069][123090] Updated weights for policy 1, policy_version 1586127 (0.0010) [2023-12-26 12:20:40,124][123090] Updated weights for policy 1, policy_version 1586137 (0.0009) [2023-12-26 12:20:40,648][123091] Updated weights for policy 0, policy_version 1596691 (0.0008) [2023-12-26 12:20:40,713][123091] Updated weights for policy 0, policy_version 1596701 (0.0005) [2023-12-26 12:20:40,776][123091] Updated weights for policy 0, policy_version 1596711 (0.0010) [2023-12-26 12:20:40,891][123090] Updated weights for policy 1, policy_version 1586147 (0.0009) [2023-12-26 12:20:40,965][123090] Updated weights for policy 1, policy_version 1586157 (0.0006) [2023-12-26 12:20:41,036][123090] Updated weights for policy 1, policy_version 1586167 (0.0007) [2023-12-26 12:20:41,597][123091] Updated weights for policy 0, policy_version 1596721 (0.0010) [2023-12-26 12:20:41,665][123091] Updated weights for policy 0, policy_version 1596731 (0.0009) [2023-12-26 12:20:41,732][123091] Updated weights for policy 0, policy_version 1596741 (0.0009) [2023-12-26 12:20:41,802][123090] Updated weights for policy 1, policy_version 1586177 (0.0007) [2023-12-26 12:20:41,807][123091] Updated weights for policy 0, policy_version 1596751 (0.0009) [2023-12-26 12:20:41,880][123090] Updated weights for policy 1, policy_version 1586187 (0.0006) [2023-12-26 12:20:41,935][123090] Updated weights for policy 1, policy_version 1586197 (0.0006) [2023-12-26 12:20:41,996][123090] Updated weights for policy 1, policy_version 1586207 (0.0007) [2023-12-26 12:20:42,721][123091] Updated weights for policy 0, policy_version 1596761 (0.0007) [2023-12-26 12:20:42,722][123090] Updated weights for policy 1, policy_version 1586217 (0.0010) [2023-12-26 12:20:42,778][123090] Updated weights for policy 1, policy_version 1586227 (0.0011) [2023-12-26 12:20:42,781][123091] Updated weights for policy 0, policy_version 1596771 (0.0006) [2023-12-26 12:20:42,841][123090] Updated weights for policy 1, policy_version 1586237 (0.0010) [2023-12-26 12:20:42,849][123091] Updated weights for policy 0, policy_version 1596781 (0.0008) [2023-12-26 12:20:43,570][123091] Updated weights for policy 0, policy_version 1596791 (0.0007) [2023-12-26 12:20:43,603][123090] Updated weights for policy 1, policy_version 1586247 (0.0010) [2023-12-26 12:20:43,637][123091] Updated weights for policy 0, policy_version 1596801 (0.0009) [2023-12-26 12:20:43,651][123090] Updated weights for policy 1, policy_version 1586257 (0.0010) [2023-12-26 12:20:43,708][123091] Updated weights for policy 0, policy_version 1596811 (0.0008) [2023-12-26 12:20:43,711][123090] Updated weights for policy 1, policy_version 1586267 (0.0010) [2023-12-26 12:20:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 814874624. Throughput: 0: 8874.1, 1: 8706.3. Samples: 814861112. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:43,784][121949] Avg episode reward: [(0, '6162.555'), (1, '5971.582')] [2023-12-26 12:20:44,408][123091] Updated weights for policy 0, policy_version 1596821 (0.0009) [2023-12-26 12:20:44,482][123091] Updated weights for policy 0, policy_version 1596831 (0.0011) [2023-12-26 12:20:44,493][123090] Updated weights for policy 1, policy_version 1586277 (0.0010) [2023-12-26 12:20:44,538][123091] Updated weights for policy 0, policy_version 1596841 (0.0010) [2023-12-26 12:20:44,559][123090] Updated weights for policy 1, policy_version 1586287 (0.0009) [2023-12-26 12:20:44,620][123090] Updated weights for policy 1, policy_version 1586297 (0.0008) [2023-12-26 12:20:45,364][123090] Updated weights for policy 1, policy_version 1586307 (0.0007) [2023-12-26 12:20:45,383][123091] Updated weights for policy 0, policy_version 1596851 (0.0010) [2023-12-26 12:20:45,420][123090] Updated weights for policy 1, policy_version 1586317 (0.0008) [2023-12-26 12:20:45,443][123091] Updated weights for policy 0, policy_version 1596861 (0.0011) [2023-12-26 12:20:45,466][123090] Updated weights for policy 1, policy_version 1586327 (0.0008) [2023-12-26 12:20:45,506][123091] Updated weights for policy 0, policy_version 1596871 (0.0011) [2023-12-26 12:20:46,309][123090] Updated weights for policy 1, policy_version 1586337 (0.0008) [2023-12-26 12:20:46,350][123091] Updated weights for policy 0, policy_version 1596881 (0.0010) [2023-12-26 12:20:46,370][123090] Updated weights for policy 1, policy_version 1586347 (0.0005) [2023-12-26 12:20:46,412][123091] Updated weights for policy 0, policy_version 1596891 (0.0009) [2023-12-26 12:20:46,428][123090] Updated weights for policy 1, policy_version 1586357 (0.0005) [2023-12-26 12:20:46,476][123091] Updated weights for policy 0, policy_version 1596901 (0.0008) [2023-12-26 12:20:46,487][123090] Updated weights for policy 1, policy_version 1586367 (0.0009) [2023-12-26 12:20:46,538][123091] Updated weights for policy 0, policy_version 1596911 (0.0006) [2023-12-26 12:20:47,171][123090] Updated weights for policy 1, policy_version 1586377 (0.0008) [2023-12-26 12:20:47,225][123090] Updated weights for policy 1, policy_version 1586387 (0.0009) [2023-12-26 12:20:47,282][123090] Updated weights for policy 1, policy_version 1586397 (0.0008) [2023-12-26 12:20:47,297][123091] Updated weights for policy 0, policy_version 1596921 (0.0009) [2023-12-26 12:20:47,349][123091] Updated weights for policy 0, policy_version 1596931 (0.0009) [2023-12-26 12:20:47,400][123091] Updated weights for policy 0, policy_version 1596941 (0.0008) [2023-12-26 12:20:48,128][123090] Updated weights for policy 1, policy_version 1586407 (0.0009) [2023-12-26 12:20:48,182][123090] Updated weights for policy 1, policy_version 1586417 (0.0010) [2023-12-26 12:20:48,237][123091] Updated weights for policy 0, policy_version 1596951 (0.0009) [2023-12-26 12:20:48,249][123090] Updated weights for policy 1, policy_version 1586427 (0.0010) [2023-12-26 12:20:48,288][123091] Updated weights for policy 0, policy_version 1596961 (0.0006) [2023-12-26 12:20:48,351][123091] Updated weights for policy 0, policy_version 1596971 (0.0007) [2023-12-26 12:20:48,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 814956544. Throughput: 0: 8896.0, 1: 8744.7. Samples: 814968500. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:48,785][121949] Avg episode reward: [(0, '6283.085'), (1, '5828.446')] [2023-12-26 12:20:49,091][123091] Updated weights for policy 0, policy_version 1596981 (0.0006) [2023-12-26 12:20:49,096][123090] Updated weights for policy 1, policy_version 1586437 (0.0008) [2023-12-26 12:20:49,152][123091] Updated weights for policy 0, policy_version 1596991 (0.0005) [2023-12-26 12:20:49,158][123090] Updated weights for policy 1, policy_version 1586447 (0.0009) [2023-12-26 12:20:49,212][123091] Updated weights for policy 0, policy_version 1597001 (0.0008) [2023-12-26 12:20:49,218][123090] Updated weights for policy 1, policy_version 1586457 (0.0009) [2023-12-26 12:20:49,971][123091] Updated weights for policy 0, policy_version 1597011 (0.0008) [2023-12-26 12:20:50,036][123091] Updated weights for policy 0, policy_version 1597021 (0.0009) [2023-12-26 12:20:50,043][123090] Updated weights for policy 1, policy_version 1586467 (0.0009) [2023-12-26 12:20:50,097][123090] Updated weights for policy 1, policy_version 1586477 (0.0008) [2023-12-26 12:20:50,103][123091] Updated weights for policy 0, policy_version 1597031 (0.0009) [2023-12-26 12:20:50,158][123090] Updated weights for policy 1, policy_version 1586487 (0.0007) [2023-12-26 12:20:50,919][123091] Updated weights for policy 0, policy_version 1597041 (0.0009) [2023-12-26 12:20:50,971][123091] Updated weights for policy 0, policy_version 1597051 (0.0010) [2023-12-26 12:20:51,004][123090] Updated weights for policy 1, policy_version 1586497 (0.0009) [2023-12-26 12:20:51,027][123091] Updated weights for policy 0, policy_version 1597062 (0.0009) [2023-12-26 12:20:51,067][123090] Updated weights for policy 1, policy_version 1586507 (0.0006) [2023-12-26 12:20:51,087][123091] Updated weights for policy 0, policy_version 1597072 (0.0008) [2023-12-26 12:20:51,135][123090] Updated weights for policy 1, policy_version 1586517 (0.0008) [2023-12-26 12:20:51,206][123090] Updated weights for policy 1, policy_version 1586527 (0.0010) [2023-12-26 12:20:51,995][123091] Updated weights for policy 0, policy_version 1597082 (0.0006) [2023-12-26 12:20:52,029][123090] Updated weights for policy 1, policy_version 1586537 (0.0009) [2023-12-26 12:20:52,054][123091] Updated weights for policy 0, policy_version 1597092 (0.0007) [2023-12-26 12:20:52,097][123090] Updated weights for policy 1, policy_version 1586547 (0.0008) [2023-12-26 12:20:52,106][123091] Updated weights for policy 0, policy_version 1597102 (0.0009) [2023-12-26 12:20:52,152][123090] Updated weights for policy 1, policy_version 1586557 (0.0010) [2023-12-26 12:20:52,937][123091] Updated weights for policy 0, policy_version 1597112 (0.0005) [2023-12-26 12:20:52,991][123090] Updated weights for policy 1, policy_version 1586567 (0.0009) [2023-12-26 12:20:52,996][123091] Updated weights for policy 0, policy_version 1597122 (0.0007) [2023-12-26 12:20:53,044][123090] Updated weights for policy 1, policy_version 1586577 (0.0008) [2023-12-26 12:20:53,054][123091] Updated weights for policy 0, policy_version 1597132 (0.0008) [2023-12-26 12:20:53,107][123090] Updated weights for policy 1, policy_version 1586587 (0.0009) [2023-12-26 12:20:53,784][121949] Fps is (10 sec: 16383.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 815038464. Throughput: 0: 8894.9, 1: 8742.8. Samples: 815020004. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:53,786][121949] Avg episode reward: [(0, '6307.536'), (1, '5654.304')] [2023-12-26 12:20:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001597136_408870912.pth... [2023-12-26 12:20:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001586592_406167552.pth... [2023-12-26 12:20:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001596112_408608768.pth [2023-12-26 12:20:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001585568_405905408.pth [2023-12-26 12:20:53,866][123091] Updated weights for policy 0, policy_version 1597142 (0.0010) [2023-12-26 12:20:53,909][123090] Updated weights for policy 1, policy_version 1586597 (0.0009) [2023-12-26 12:20:53,928][123091] Updated weights for policy 0, policy_version 1597152 (0.0006) [2023-12-26 12:20:53,967][123090] Updated weights for policy 1, policy_version 1586607 (0.0008) [2023-12-26 12:20:53,978][123091] Updated weights for policy 0, policy_version 1597162 (0.0007) [2023-12-26 12:20:54,028][123090] Updated weights for policy 1, policy_version 1586617 (0.0008) [2023-12-26 12:20:54,798][123091] Updated weights for policy 0, policy_version 1597172 (0.0010) [2023-12-26 12:20:54,851][123091] Updated weights for policy 0, policy_version 1597182 (0.0009) [2023-12-26 12:20:54,867][123090] Updated weights for policy 1, policy_version 1586627 (0.0008) [2023-12-26 12:20:54,913][123091] Updated weights for policy 0, policy_version 1597192 (0.0008) [2023-12-26 12:20:54,922][123090] Updated weights for policy 1, policy_version 1586637 (0.0008) [2023-12-26 12:20:54,986][123090] Updated weights for policy 1, policy_version 1586647 (0.0008) [2023-12-26 12:20:55,711][123091] Updated weights for policy 0, policy_version 1597202 (0.0010) [2023-12-26 12:20:55,771][123091] Updated weights for policy 0, policy_version 1597212 (0.0009) [2023-12-26 12:20:55,823][123091] Updated weights for policy 0, policy_version 1597222 (0.0009) [2023-12-26 12:20:55,845][123090] Updated weights for policy 1, policy_version 1586657 (0.0009) [2023-12-26 12:20:55,884][123091] Updated weights for policy 0, policy_version 1597232 (0.0007) [2023-12-26 12:20:55,910][123090] Updated weights for policy 1, policy_version 1586667 (0.0011) [2023-12-26 12:20:55,972][123090] Updated weights for policy 1, policy_version 1586677 (0.0010) [2023-12-26 12:20:56,042][123090] Updated weights for policy 1, policy_version 1586687 (0.0010) [2023-12-26 12:20:56,748][123091] Updated weights for policy 0, policy_version 1597242 (0.0009) [2023-12-26 12:20:56,757][123090] Updated weights for policy 1, policy_version 1586697 (0.0006) [2023-12-26 12:20:56,802][123091] Updated weights for policy 0, policy_version 1597253 (0.0009) [2023-12-26 12:20:56,805][123090] Updated weights for policy 1, policy_version 1586707 (0.0005) [2023-12-26 12:20:56,860][123091] Updated weights for policy 0, policy_version 1597263 (0.0009) [2023-12-26 12:20:56,861][123090] Updated weights for policy 1, policy_version 1586717 (0.0007) [2023-12-26 12:20:57,497][123090] Updated weights for policy 1, policy_version 1586727 (0.0007) [2023-12-26 12:20:57,568][123090] Updated weights for policy 1, policy_version 1586737 (0.0008) [2023-12-26 12:20:57,573][123091] Updated weights for policy 0, policy_version 1597273 (0.0009) [2023-12-26 12:20:57,628][123091] Updated weights for policy 0, policy_version 1597283 (0.0010) [2023-12-26 12:20:57,631][123090] Updated weights for policy 1, policy_version 1586747 (0.0010) [2023-12-26 12:20:57,686][123091] Updated weights for policy 0, policy_version 1597293 (0.0010) [2023-12-26 12:20:58,407][123090] Updated weights for policy 1, policy_version 1586757 (0.0009) [2023-12-26 12:20:58,463][123090] Updated weights for policy 1, policy_version 1586767 (0.0008) [2023-12-26 12:20:58,529][123090] Updated weights for policy 1, policy_version 1586777 (0.0008) [2023-12-26 12:20:58,533][123091] Updated weights for policy 0, policy_version 1597303 (0.0009) [2023-12-26 12:20:58,601][123091] Updated weights for policy 0, policy_version 1597313 (0.0007) [2023-12-26 12:20:58,669][123091] Updated weights for policy 0, policy_version 1597323 (0.0008) [2023-12-26 12:20:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 815136768. Throughput: 0: 8922.0, 1: 8788.8. Samples: 815126460. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:20:58,785][121949] Avg episode reward: [(0, '6324.068'), (1, '5664.170')] [2023-12-26 12:20:59,441][123090] Updated weights for policy 1, policy_version 1586787 (0.0009) [2023-12-26 12:20:59,501][123091] Updated weights for policy 0, policy_version 1597333 (0.0009) [2023-12-26 12:20:59,504][123090] Updated weights for policy 1, policy_version 1586797 (0.0007) [2023-12-26 12:20:59,567][123091] Updated weights for policy 0, policy_version 1597343 (0.0010) [2023-12-26 12:20:59,567][123090] Updated weights for policy 1, policy_version 1586807 (0.0006) [2023-12-26 12:20:59,635][123091] Updated weights for policy 0, policy_version 1597353 (0.0006) [2023-12-26 12:21:00,332][123091] Updated weights for policy 0, policy_version 1597363 (0.0007) [2023-12-26 12:21:00,348][123090] Updated weights for policy 1, policy_version 1586817 (0.0008) [2023-12-26 12:21:00,386][123091] Updated weights for policy 0, policy_version 1597373 (0.0009) [2023-12-26 12:21:00,410][123090] Updated weights for policy 1, policy_version 1586827 (0.0010) [2023-12-26 12:21:00,436][123091] Updated weights for policy 0, policy_version 1597383 (0.0008) [2023-12-26 12:21:00,466][123090] Updated weights for policy 1, policy_version 1586837 (0.0010) [2023-12-26 12:21:00,530][123090] Updated weights for policy 1, policy_version 1586847 (0.0010) [2023-12-26 12:21:01,032][123091] Updated weights for policy 0, policy_version 1597393 (0.0006) [2023-12-26 12:21:01,096][123091] Updated weights for policy 0, policy_version 1597403 (0.0010) [2023-12-26 12:21:01,168][123091] Updated weights for policy 0, policy_version 1597413 (0.0011) [2023-12-26 12:21:01,226][123091] Updated weights for policy 0, policy_version 1597423 (0.0010) [2023-12-26 12:21:01,367][123090] Updated weights for policy 1, policy_version 1586857 (0.0011) [2023-12-26 12:21:01,422][123090] Updated weights for policy 1, policy_version 1586867 (0.0009) [2023-12-26 12:21:01,477][123090] Updated weights for policy 1, policy_version 1586877 (0.0008) [2023-12-26 12:21:01,979][123091] Updated weights for policy 0, policy_version 1597433 (0.0009) [2023-12-26 12:21:02,032][123091] Updated weights for policy 0, policy_version 1597443 (0.0008) [2023-12-26 12:21:02,094][123091] Updated weights for policy 0, policy_version 1597453 (0.0009) [2023-12-26 12:21:02,297][123090] Updated weights for policy 1, policy_version 1586887 (0.0008) [2023-12-26 12:21:02,365][123090] Updated weights for policy 1, policy_version 1586897 (0.0008) [2023-12-26 12:21:02,429][123090] Updated weights for policy 1, policy_version 1586907 (0.0005) [2023-12-26 12:21:02,922][123091] Updated weights for policy 0, policy_version 1597463 (0.0010) [2023-12-26 12:21:02,971][123091] Updated weights for policy 0, policy_version 1597473 (0.0009) [2023-12-26 12:21:03,026][123091] Updated weights for policy 0, policy_version 1597484 (0.0010) [2023-12-26 12:21:03,145][123090] Updated weights for policy 1, policy_version 1586917 (0.0007) [2023-12-26 12:21:03,201][123090] Updated weights for policy 1, policy_version 1586927 (0.0008) [2023-12-26 12:21:03,249][123090] Updated weights for policy 1, policy_version 1586937 (0.0009) [2023-12-26 12:21:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 815218688. Throughput: 0: 8823.6, 1: 8823.0. Samples: 815231912. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:03,784][121949] Avg episode reward: [(0, '6209.845'), (1, '5660.909')] [2023-12-26 12:21:03,897][123091] Updated weights for policy 0, policy_version 1597494 (0.0010) [2023-12-26 12:21:03,952][123091] Updated weights for policy 0, policy_version 1597504 (0.0010) [2023-12-26 12:21:04,015][123091] Updated weights for policy 0, policy_version 1597514 (0.0011) [2023-12-26 12:21:04,055][123090] Updated weights for policy 1, policy_version 1586947 (0.0009) [2023-12-26 12:21:04,116][123090] Updated weights for policy 1, policy_version 1586957 (0.0009) [2023-12-26 12:21:04,176][123090] Updated weights for policy 1, policy_version 1586967 (0.0009) [2023-12-26 12:21:04,888][123091] Updated weights for policy 0, policy_version 1597524 (0.0009) [2023-12-26 12:21:04,946][123091] Updated weights for policy 0, policy_version 1597534 (0.0010) [2023-12-26 12:21:04,968][123090] Updated weights for policy 1, policy_version 1586977 (0.0008) [2023-12-26 12:21:05,009][123091] Updated weights for policy 0, policy_version 1597544 (0.0010) [2023-12-26 12:21:05,024][123090] Updated weights for policy 1, policy_version 1586987 (0.0006) [2023-12-26 12:21:05,086][123090] Updated weights for policy 1, policy_version 1586997 (0.0008) [2023-12-26 12:21:05,139][123090] Updated weights for policy 1, policy_version 1587007 (0.0009) [2023-12-26 12:21:05,889][123091] Updated weights for policy 0, policy_version 1597554 (0.0009) [2023-12-26 12:21:05,916][123090] Updated weights for policy 1, policy_version 1587017 (0.0009) [2023-12-26 12:21:05,948][123091] Updated weights for policy 0, policy_version 1597564 (0.0008) [2023-12-26 12:21:05,973][123090] Updated weights for policy 1, policy_version 1587027 (0.0006) [2023-12-26 12:21:06,009][123091] Updated weights for policy 0, policy_version 1597574 (0.0009) [2023-12-26 12:21:06,025][123090] Updated weights for policy 1, policy_version 1587037 (0.0006) [2023-12-26 12:21:06,075][123091] Updated weights for policy 0, policy_version 1597584 (0.0009) [2023-12-26 12:21:06,837][123090] Updated weights for policy 1, policy_version 1587047 (0.0010) [2023-12-26 12:21:06,900][123090] Updated weights for policy 1, policy_version 1587057 (0.0009) [2023-12-26 12:21:06,924][123091] Updated weights for policy 0, policy_version 1597594 (0.0007) [2023-12-26 12:21:06,956][123090] Updated weights for policy 1, policy_version 1587067 (0.0009) [2023-12-26 12:21:06,983][123091] Updated weights for policy 0, policy_version 1597604 (0.0008) [2023-12-26 12:21:07,035][123091] Updated weights for policy 0, policy_version 1597614 (0.0007) [2023-12-26 12:21:07,759][123091] Updated weights for policy 0, policy_version 1597624 (0.0005) [2023-12-26 12:21:07,822][123091] Updated weights for policy 0, policy_version 1597634 (0.0008) [2023-12-26 12:21:07,874][123090] Updated weights for policy 1, policy_version 1587077 (0.0009) [2023-12-26 12:21:07,889][123091] Updated weights for policy 0, policy_version 1597644 (0.0008) [2023-12-26 12:21:07,936][123090] Updated weights for policy 1, policy_version 1587087 (0.0007) [2023-12-26 12:21:08,017][123090] Updated weights for policy 1, policy_version 1587097 (0.0010) [2023-12-26 12:21:08,533][123091] Updated weights for policy 0, policy_version 1597654 (0.0010) [2023-12-26 12:21:08,589][123091] Updated weights for policy 0, policy_version 1597664 (0.0010) [2023-12-26 12:21:08,638][123091] Updated weights for policy 0, policy_version 1597674 (0.0009) [2023-12-26 12:21:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 815308800. Throughput: 0: 8797.0, 1: 8861.3. Samples: 815283624. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:08,785][121949] Avg episode reward: [(0, '6113.230'), (1, '5506.001')] [2023-12-26 12:21:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001597680_409010176.pth... [2023-12-26 12:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001587104_406298624.pth... [2023-12-26 12:21:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001586080_406036480.pth [2023-12-26 12:21:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001596656_408748032.pth [2023-12-26 12:21:08,868][123090] Updated weights for policy 1, policy_version 1587107 (0.0010) [2023-12-26 12:21:08,918][123090] Updated weights for policy 1, policy_version 1587117 (0.0009) [2023-12-26 12:21:08,972][123090] Updated weights for policy 1, policy_version 1587127 (0.0010) [2023-12-26 12:21:09,420][123091] Updated weights for policy 0, policy_version 1597684 (0.0010) [2023-12-26 12:21:09,488][123091] Updated weights for policy 0, policy_version 1597694 (0.0009) [2023-12-26 12:21:09,545][123091] Updated weights for policy 0, policy_version 1597704 (0.0009) [2023-12-26 12:21:09,887][123090] Updated weights for policy 1, policy_version 1587137 (0.0009) [2023-12-26 12:21:09,961][123090] Updated weights for policy 1, policy_version 1587147 (0.0010) [2023-12-26 12:21:10,014][123090] Updated weights for policy 1, policy_version 1587157 (0.0010) [2023-12-26 12:21:10,074][123090] Updated weights for policy 1, policy_version 1587167 (0.0010) [2023-12-26 12:21:10,400][123091] Updated weights for policy 0, policy_version 1597714 (0.0009) [2023-12-26 12:21:10,456][123091] Updated weights for policy 0, policy_version 1597724 (0.0009) [2023-12-26 12:21:10,524][123091] Updated weights for policy 0, policy_version 1597734 (0.0009) [2023-12-26 12:21:10,584][123091] Updated weights for policy 0, policy_version 1597744 (0.0009) [2023-12-26 12:21:10,916][123090] Updated weights for policy 1, policy_version 1587177 (0.0010) [2023-12-26 12:21:10,981][123090] Updated weights for policy 1, policy_version 1587187 (0.0009) [2023-12-26 12:21:11,057][123090] Updated weights for policy 1, policy_version 1587197 (0.0008) [2023-12-26 12:21:11,415][123091] Updated weights for policy 0, policy_version 1597754 (0.0008) [2023-12-26 12:21:11,491][123091] Updated weights for policy 0, policy_version 1597764 (0.0006) [2023-12-26 12:21:11,553][123091] Updated weights for policy 0, policy_version 1597774 (0.0007) [2023-12-26 12:21:11,912][123090] Updated weights for policy 1, policy_version 1587207 (0.0010) [2023-12-26 12:21:11,980][123090] Updated weights for policy 1, policy_version 1587217 (0.0009) [2023-12-26 12:21:12,049][123090] Updated weights for policy 1, policy_version 1587227 (0.0009) [2023-12-26 12:21:12,332][123091] Updated weights for policy 0, policy_version 1597784 (0.0010) [2023-12-26 12:21:12,405][123091] Updated weights for policy 0, policy_version 1597794 (0.0008) [2023-12-26 12:21:12,460][123091] Updated weights for policy 0, policy_version 1597804 (0.0006) [2023-12-26 12:21:12,930][123090] Updated weights for policy 1, policy_version 1587237 (0.0010) [2023-12-26 12:21:12,983][123090] Updated weights for policy 1, policy_version 1587247 (0.0008) [2023-12-26 12:21:13,043][123090] Updated weights for policy 1, policy_version 1587257 (0.0009) [2023-12-26 12:21:13,223][123091] Updated weights for policy 0, policy_version 1597814 (0.0008) [2023-12-26 12:21:13,272][123091] Updated weights for policy 0, policy_version 1597824 (0.0009) [2023-12-26 12:21:13,329][123091] Updated weights for policy 0, policy_version 1597834 (0.0009) [2023-12-26 12:21:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 815390720. Throughput: 0: 8841.1, 1: 8719.1. Samples: 815386728. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:13,785][121949] Avg episode reward: [(0, '6227.932'), (1, '5137.479')] [2023-12-26 12:21:13,851][123090] Updated weights for policy 1, policy_version 1587267 (0.0009) [2023-12-26 12:21:13,914][123090] Updated weights for policy 1, policy_version 1587277 (0.0009) [2023-12-26 12:21:13,971][123090] Updated weights for policy 1, policy_version 1587287 (0.0008) [2023-12-26 12:21:14,193][123091] Updated weights for policy 0, policy_version 1597845 (0.0009) [2023-12-26 12:21:14,249][123091] Updated weights for policy 0, policy_version 1597855 (0.0005) [2023-12-26 12:21:14,310][123091] Updated weights for policy 0, policy_version 1597865 (0.0007) [2023-12-26 12:21:14,697][123090] Updated weights for policy 1, policy_version 1587297 (0.0008) [2023-12-26 12:21:14,760][123090] Updated weights for policy 1, policy_version 1587307 (0.0007) [2023-12-26 12:21:14,831][123090] Updated weights for policy 1, policy_version 1587317 (0.0009) [2023-12-26 12:21:14,895][123090] Updated weights for policy 1, policy_version 1587327 (0.0010) [2023-12-26 12:21:15,139][123091] Updated weights for policy 0, policy_version 1597875 (0.0010) [2023-12-26 12:21:15,202][123091] Updated weights for policy 0, policy_version 1597885 (0.0010) [2023-12-26 12:21:15,270][123091] Updated weights for policy 0, policy_version 1597895 (0.0010) [2023-12-26 12:21:15,643][123090] Updated weights for policy 1, policy_version 1587337 (0.0005) [2023-12-26 12:21:15,694][123090] Updated weights for policy 1, policy_version 1587347 (0.0005) [2023-12-26 12:21:15,745][123090] Updated weights for policy 1, policy_version 1587357 (0.0009) [2023-12-26 12:21:16,123][123091] Updated weights for policy 0, policy_version 1597905 (0.0010) [2023-12-26 12:21:16,189][123091] Updated weights for policy 0, policy_version 1597915 (0.0009) [2023-12-26 12:21:16,258][123091] Updated weights for policy 0, policy_version 1597925 (0.0009) [2023-12-26 12:21:16,320][123091] Updated weights for policy 0, policy_version 1597935 (0.0010) [2023-12-26 12:21:16,574][123090] Updated weights for policy 1, policy_version 1587367 (0.0008) [2023-12-26 12:21:16,624][123090] Updated weights for policy 1, policy_version 1587377 (0.0009) [2023-12-26 12:21:16,675][123090] Updated weights for policy 1, policy_version 1587387 (0.0009) [2023-12-26 12:21:17,139][123091] Updated weights for policy 0, policy_version 1597945 (0.0010) [2023-12-26 12:21:17,199][123091] Updated weights for policy 0, policy_version 1597955 (0.0009) [2023-12-26 12:21:17,256][123091] Updated weights for policy 0, policy_version 1597965 (0.0010) [2023-12-26 12:21:17,420][123090] Updated weights for policy 1, policy_version 1587397 (0.0007) [2023-12-26 12:21:17,474][123090] Updated weights for policy 1, policy_version 1587407 (0.0006) [2023-12-26 12:21:17,530][123090] Updated weights for policy 1, policy_version 1587417 (0.0009) [2023-12-26 12:21:18,101][123091] Updated weights for policy 0, policy_version 1597975 (0.0010) [2023-12-26 12:21:18,153][123091] Updated weights for policy 0, policy_version 1597985 (0.0009) [2023-12-26 12:21:18,227][123091] Updated weights for policy 0, policy_version 1597995 (0.0009) [2023-12-26 12:21:18,364][123090] Updated weights for policy 1, policy_version 1587427 (0.0010) [2023-12-26 12:21:18,423][123090] Updated weights for policy 1, policy_version 1587437 (0.0009) [2023-12-26 12:21:18,486][123090] Updated weights for policy 1, policy_version 1587447 (0.0009) [2023-12-26 12:21:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 815480832. Throughput: 0: 8780.4, 1: 8744.8. Samples: 815491076. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:18,786][121949] Avg episode reward: [(0, '6217.156'), (1, '5327.902')] [2023-12-26 12:21:19,062][123091] Updated weights for policy 0, policy_version 1598005 (0.0009) [2023-12-26 12:21:19,119][123091] Updated weights for policy 0, policy_version 1598015 (0.0010) [2023-12-26 12:21:19,180][123091] Updated weights for policy 0, policy_version 1598025 (0.0009) [2023-12-26 12:21:19,293][123090] Updated weights for policy 1, policy_version 1587457 (0.0009) [2023-12-26 12:21:19,372][123090] Updated weights for policy 1, policy_version 1587467 (0.0009) [2023-12-26 12:21:19,436][123090] Updated weights for policy 1, policy_version 1587477 (0.0009) [2023-12-26 12:21:19,505][123090] Updated weights for policy 1, policy_version 1587487 (0.0008) [2023-12-26 12:21:20,041][123091] Updated weights for policy 0, policy_version 1598035 (0.0010) [2023-12-26 12:21:20,098][123091] Updated weights for policy 0, policy_version 1598045 (0.0009) [2023-12-26 12:21:20,160][123091] Updated weights for policy 0, policy_version 1598055 (0.0009) [2023-12-26 12:21:20,363][123090] Updated weights for policy 1, policy_version 1587497 (0.0010) [2023-12-26 12:21:20,416][123090] Updated weights for policy 1, policy_version 1587507 (0.0006) [2023-12-26 12:21:20,475][123090] Updated weights for policy 1, policy_version 1587517 (0.0006) [2023-12-26 12:21:21,060][123091] Updated weights for policy 0, policy_version 1598065 (0.0009) [2023-12-26 12:21:21,124][123091] Updated weights for policy 0, policy_version 1598075 (0.0010) [2023-12-26 12:21:21,198][123091] Updated weights for policy 0, policy_version 1598085 (0.0009) [2023-12-26 12:21:21,223][123090] Updated weights for policy 1, policy_version 1587527 (0.0005) [2023-12-26 12:21:21,264][123091] Updated weights for policy 0, policy_version 1598095 (0.0009) [2023-12-26 12:21:21,290][123090] Updated weights for policy 1, policy_version 1587537 (0.0008) [2023-12-26 12:21:21,357][123090] Updated weights for policy 1, policy_version 1587547 (0.0009) [2023-12-26 12:21:22,094][123091] Updated weights for policy 0, policy_version 1598105 (0.0009) [2023-12-26 12:21:22,160][123091] Updated weights for policy 0, policy_version 1598115 (0.0009) [2023-12-26 12:21:22,214][123090] Updated weights for policy 1, policy_version 1587557 (0.0009) [2023-12-26 12:21:22,216][123091] Updated weights for policy 0, policy_version 1598125 (0.0008) [2023-12-26 12:21:22,278][123090] Updated weights for policy 1, policy_version 1587567 (0.0008) [2023-12-26 12:21:22,345][123090] Updated weights for policy 1, policy_version 1587577 (0.0010) [2023-12-26 12:21:22,860][123091] Updated weights for policy 0, policy_version 1598135 (0.0010) [2023-12-26 12:21:22,914][123091] Updated weights for policy 0, policy_version 1598145 (0.0009) [2023-12-26 12:21:22,975][123091] Updated weights for policy 0, policy_version 1598155 (0.0010) [2023-12-26 12:21:23,248][123090] Updated weights for policy 1, policy_version 1587587 (0.0009) [2023-12-26 12:21:23,316][123090] Updated weights for policy 1, policy_version 1587597 (0.0010) [2023-12-26 12:21:23,384][123090] Updated weights for policy 1, policy_version 1587607 (0.0010) [2023-12-26 12:21:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 815562752. Throughput: 0: 8701.6, 1: 8756.0. Samples: 815541596. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:23,785][121949] Avg episode reward: [(0, '6167.938'), (1, '5635.476')] [2023-12-26 12:21:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001587616_406429696.pth... [2023-12-26 12:21:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001586592_406167552.pth [2023-12-26 12:21:23,808][123091] Updated weights for policy 0, policy_version 1598165 (0.0007) [2023-12-26 12:21:23,862][123091] Updated weights for policy 0, policy_version 1598175 (0.0005) [2023-12-26 12:21:23,916][123091] Updated weights for policy 0, policy_version 1598185 (0.0005) [2023-12-26 12:21:23,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001598192_409141248.pth... [2023-12-26 12:21:23,962][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001597136_408870912.pth [2023-12-26 12:21:24,222][123090] Updated weights for policy 1, policy_version 1587617 (0.0009) [2023-12-26 12:21:24,274][123090] Updated weights for policy 1, policy_version 1587627 (0.0009) [2023-12-26 12:21:24,342][123090] Updated weights for policy 1, policy_version 1587637 (0.0009) [2023-12-26 12:21:24,407][123090] Updated weights for policy 1, policy_version 1587647 (0.0010) [2023-12-26 12:21:24,607][123091] Updated weights for policy 0, policy_version 1598195 (0.0009) [2023-12-26 12:21:24,656][123091] Updated weights for policy 0, policy_version 1598205 (0.0009) [2023-12-26 12:21:24,718][123091] Updated weights for policy 0, policy_version 1598215 (0.0009) [2023-12-26 12:21:25,242][123090] Updated weights for policy 1, policy_version 1587657 (0.0010) [2023-12-26 12:21:25,305][123090] Updated weights for policy 1, policy_version 1587667 (0.0009) [2023-12-26 12:21:25,369][123090] Updated weights for policy 1, policy_version 1587677 (0.0010) [2023-12-26 12:21:25,510][123091] Updated weights for policy 0, policy_version 1598225 (0.0008) [2023-12-26 12:21:25,567][123091] Updated weights for policy 0, policy_version 1598235 (0.0005) [2023-12-26 12:21:25,612][123091] Updated weights for policy 0, policy_version 1598245 (0.0005) [2023-12-26 12:21:25,657][123091] Updated weights for policy 0, policy_version 1598255 (0.0005) [2023-12-26 12:21:26,244][123090] Updated weights for policy 1, policy_version 1587687 (0.0009) [2023-12-26 12:21:26,294][123090] Updated weights for policy 1, policy_version 1587697 (0.0009) [2023-12-26 12:21:26,354][123090] Updated weights for policy 1, policy_version 1587707 (0.0010) [2023-12-26 12:21:26,410][123091] Updated weights for policy 0, policy_version 1598265 (0.0005) [2023-12-26 12:21:26,459][123091] Updated weights for policy 0, policy_version 1598275 (0.0005) [2023-12-26 12:21:26,514][123091] Updated weights for policy 0, policy_version 1598285 (0.0006) [2023-12-26 12:21:27,216][123091] Updated weights for policy 0, policy_version 1598295 (0.0006) [2023-12-26 12:21:27,261][123091] Updated weights for policy 0, policy_version 1598305 (0.0005) [2023-12-26 12:21:27,269][123090] Updated weights for policy 1, policy_version 1587717 (0.0008) [2023-12-26 12:21:27,316][123091] Updated weights for policy 0, policy_version 1598315 (0.0007) [2023-12-26 12:21:27,327][123090] Updated weights for policy 1, policy_version 1587727 (0.0008) [2023-12-26 12:21:27,383][123090] Updated weights for policy 1, policy_version 1587737 (0.0009) [2023-12-26 12:21:27,982][123091] Updated weights for policy 0, policy_version 1598325 (0.0007) [2023-12-26 12:21:28,040][123091] Updated weights for policy 0, policy_version 1598335 (0.0006) [2023-12-26 12:21:28,099][123091] Updated weights for policy 0, policy_version 1598345 (0.0009) [2023-12-26 12:21:28,263][123090] Updated weights for policy 1, policy_version 1587747 (0.0009) [2023-12-26 12:21:28,314][123090] Updated weights for policy 1, policy_version 1587757 (0.0009) [2023-12-26 12:21:28,373][123090] Updated weights for policy 1, policy_version 1587767 (0.0009) [2023-12-26 12:21:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 815652864. Throughput: 0: 8823.9, 1: 8645.5. Samples: 815647236. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:28,785][121949] Avg episode reward: [(0, '6214.264'), (1, '5496.123')] [2023-12-26 12:21:28,930][123091] Updated weights for policy 0, policy_version 1598355 (0.0009) [2023-12-26 12:21:28,989][123091] Updated weights for policy 0, policy_version 1598365 (0.0009) [2023-12-26 12:21:29,053][123091] Updated weights for policy 0, policy_version 1598375 (0.0009) [2023-12-26 12:21:29,224][123090] Updated weights for policy 1, policy_version 1587777 (0.0008) [2023-12-26 12:21:29,294][123090] Updated weights for policy 1, policy_version 1587787 (0.0010) [2023-12-26 12:21:29,352][123090] Updated weights for policy 1, policy_version 1587797 (0.0009) [2023-12-26 12:21:29,405][123090] Updated weights for policy 1, policy_version 1587807 (0.0007) [2023-12-26 12:21:29,797][123091] Updated weights for policy 0, policy_version 1598385 (0.0009) [2023-12-26 12:21:29,862][123091] Updated weights for policy 0, policy_version 1598395 (0.0010) [2023-12-26 12:21:29,919][123091] Updated weights for policy 0, policy_version 1598405 (0.0010) [2023-12-26 12:21:29,987][123091] Updated weights for policy 0, policy_version 1598415 (0.0009) [2023-12-26 12:21:30,284][123090] Updated weights for policy 1, policy_version 1587817 (0.0009) [2023-12-26 12:21:30,340][123090] Updated weights for policy 1, policy_version 1587827 (0.0010) [2023-12-26 12:21:30,394][123090] Updated weights for policy 1, policy_version 1587837 (0.0009) [2023-12-26 12:21:30,795][123091] Updated weights for policy 0, policy_version 1598425 (0.0009) [2023-12-26 12:21:30,857][123091] Updated weights for policy 0, policy_version 1598435 (0.0010) [2023-12-26 12:21:30,916][123091] Updated weights for policy 0, policy_version 1598445 (0.0016) [2023-12-26 12:21:31,207][123090] Updated weights for policy 1, policy_version 1587847 (0.0011) [2023-12-26 12:21:31,267][123090] Updated weights for policy 1, policy_version 1587857 (0.0010) [2023-12-26 12:21:31,322][123090] Updated weights for policy 1, policy_version 1587867 (0.0010) [2023-12-26 12:21:31,783][123091] Updated weights for policy 0, policy_version 1598455 (0.0010) [2023-12-26 12:21:31,838][123091] Updated weights for policy 0, policy_version 1598465 (0.0010) [2023-12-26 12:21:31,886][123091] Updated weights for policy 0, policy_version 1598475 (0.0008) [2023-12-26 12:21:32,131][123090] Updated weights for policy 1, policy_version 1587877 (0.0008) [2023-12-26 12:21:32,193][123090] Updated weights for policy 1, policy_version 1587887 (0.0005) [2023-12-26 12:21:32,252][123090] Updated weights for policy 1, policy_version 1587897 (0.0006) [2023-12-26 12:21:32,827][123091] Updated weights for policy 0, policy_version 1598485 (0.0009) [2023-12-26 12:21:32,852][123090] Updated weights for policy 1, policy_version 1587907 (0.0007) [2023-12-26 12:21:32,880][123091] Updated weights for policy 0, policy_version 1598495 (0.0007) [2023-12-26 12:21:32,899][123090] Updated weights for policy 1, policy_version 1587917 (0.0010) [2023-12-26 12:21:32,936][123091] Updated weights for policy 0, policy_version 1598505 (0.0006) [2023-12-26 12:21:32,950][123090] Updated weights for policy 1, policy_version 1587927 (0.0010) [2023-12-26 12:21:33,671][123091] Updated weights for policy 0, policy_version 1598515 (0.0006) [2023-12-26 12:21:33,733][123090] Updated weights for policy 1, policy_version 1587937 (0.0010) [2023-12-26 12:21:33,746][123091] Updated weights for policy 0, policy_version 1598525 (0.0006) [2023-12-26 12:21:33,783][123090] Updated weights for policy 1, policy_version 1587947 (0.0005) [2023-12-26 12:21:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 815734784. Throughput: 0: 8813.2, 1: 8613.1. Samples: 815752688. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:33,785][121949] Avg episode reward: [(0, '6224.411'), (1, '5533.812')] [2023-12-26 12:21:33,807][123091] Updated weights for policy 0, policy_version 1598535 (0.0008) [2023-12-26 12:21:33,842][123090] Updated weights for policy 1, policy_version 1587957 (0.0005) [2023-12-26 12:21:33,897][123090] Updated weights for policy 1, policy_version 1587967 (0.0005) [2023-12-26 12:21:34,615][123091] Updated weights for policy 0, policy_version 1598545 (0.0009) [2023-12-26 12:21:34,640][123090] Updated weights for policy 1, policy_version 1587977 (0.0010) [2023-12-26 12:21:34,681][123091] Updated weights for policy 0, policy_version 1598555 (0.0006) [2023-12-26 12:21:34,708][123090] Updated weights for policy 1, policy_version 1587987 (0.0011) [2023-12-26 12:21:34,742][123091] Updated weights for policy 0, policy_version 1598565 (0.0007) [2023-12-26 12:21:34,773][123090] Updated weights for policy 1, policy_version 1587997 (0.0011) [2023-12-26 12:21:34,795][123091] Updated weights for policy 0, policy_version 1598575 (0.0005) [2023-12-26 12:21:35,492][123090] Updated weights for policy 1, policy_version 1588007 (0.0007) [2023-12-26 12:21:35,549][123090] Updated weights for policy 1, policy_version 1588017 (0.0005) [2023-12-26 12:21:35,606][123090] Updated weights for policy 1, policy_version 1588027 (0.0005) [2023-12-26 12:21:35,634][123091] Updated weights for policy 0, policy_version 1598585 (0.0010) [2023-12-26 12:21:35,678][123091] Updated weights for policy 0, policy_version 1598595 (0.0010) [2023-12-26 12:21:35,742][123091] Updated weights for policy 0, policy_version 1598605 (0.0011) [2023-12-26 12:21:36,337][123090] Updated weights for policy 1, policy_version 1588037 (0.0008) [2023-12-26 12:21:36,400][123090] Updated weights for policy 1, policy_version 1588047 (0.0011) [2023-12-26 12:21:36,460][123090] Updated weights for policy 1, policy_version 1588057 (0.0010) [2023-12-26 12:21:36,575][123091] Updated weights for policy 0, policy_version 1598615 (0.0010) [2023-12-26 12:21:36,643][123091] Updated weights for policy 0, policy_version 1598625 (0.0011) [2023-12-26 12:21:36,694][123091] Updated weights for policy 0, policy_version 1598635 (0.0011) [2023-12-26 12:21:37,152][123090] Updated weights for policy 1, policy_version 1588067 (0.0009) [2023-12-26 12:21:37,204][123090] Updated weights for policy 1, policy_version 1588077 (0.0005) [2023-12-26 12:21:37,254][123090] Updated weights for policy 1, policy_version 1588087 (0.0005) [2023-12-26 12:21:37,360][123091] Updated weights for policy 0, policy_version 1598645 (0.0010) [2023-12-26 12:21:37,423][123091] Updated weights for policy 0, policy_version 1598655 (0.0011) [2023-12-26 12:21:37,505][123091] Updated weights for policy 0, policy_version 1598665 (0.0008) [2023-12-26 12:21:37,921][123090] Updated weights for policy 1, policy_version 1588097 (0.0006) [2023-12-26 12:21:37,985][123090] Updated weights for policy 1, policy_version 1588107 (0.0010) [2023-12-26 12:21:38,060][123090] Updated weights for policy 1, policy_version 1588117 (0.0005) [2023-12-26 12:21:38,133][123090] Updated weights for policy 1, policy_version 1588127 (0.0005) [2023-12-26 12:21:38,224][123091] Updated weights for policy 0, policy_version 1598675 (0.0009) [2023-12-26 12:21:38,273][123091] Updated weights for policy 0, policy_version 1598685 (0.0005) [2023-12-26 12:21:38,333][123091] Updated weights for policy 0, policy_version 1598695 (0.0008) [2023-12-26 12:21:38,779][123090] Updated weights for policy 1, policy_version 1588137 (0.0009) [2023-12-26 12:21:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 815833088. Throughput: 0: 8806.9, 1: 8695.7. Samples: 815807616. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:38,785][121949] Avg episode reward: [(0, '6252.261'), (1, '5548.236')] [2023-12-26 12:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001598704_409272320.pth... [2023-12-26 12:21:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001597680_409010176.pth [2023-12-26 12:21:38,830][123090] Updated weights for policy 1, policy_version 1588147 (0.0006) [2023-12-26 12:21:38,886][123090] Updated weights for policy 1, policy_version 1588157 (0.0007) [2023-12-26 12:21:38,902][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001588160_406568960.pth... [2023-12-26 12:21:38,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001587104_406298624.pth [2023-12-26 12:21:39,150][123091] Updated weights for policy 0, policy_version 1598705 (0.0011) [2023-12-26 12:21:39,210][123091] Updated weights for policy 0, policy_version 1598715 (0.0011) [2023-12-26 12:21:39,278][123091] Updated weights for policy 0, policy_version 1598725 (0.0011) [2023-12-26 12:21:39,692][123090] Updated weights for policy 1, policy_version 1588167 (0.0010) [2023-12-26 12:21:39,761][123090] Updated weights for policy 1, policy_version 1588177 (0.0011) [2023-12-26 12:21:39,828][123090] Updated weights for policy 1, policy_version 1588187 (0.0010) [2023-12-26 12:21:40,133][123091] Updated weights for policy 0, policy_version 1598737 (0.0011) [2023-12-26 12:21:40,187][123091] Updated weights for policy 0, policy_version 1598747 (0.0009) [2023-12-26 12:21:40,244][123091] Updated weights for policy 0, policy_version 1598757 (0.0009) [2023-12-26 12:21:40,297][123091] Updated weights for policy 0, policy_version 1598767 (0.0009) [2023-12-26 12:21:40,659][123090] Updated weights for policy 1, policy_version 1588197 (0.0010) [2023-12-26 12:21:40,721][123090] Updated weights for policy 1, policy_version 1588207 (0.0009) [2023-12-26 12:21:40,787][123090] Updated weights for policy 1, policy_version 1588217 (0.0009) [2023-12-26 12:21:41,118][123091] Updated weights for policy 0, policy_version 1598777 (0.0009) [2023-12-26 12:21:41,192][123091] Updated weights for policy 0, policy_version 1598787 (0.0009) [2023-12-26 12:21:41,255][123091] Updated weights for policy 0, policy_version 1598797 (0.0010) [2023-12-26 12:21:41,649][123090] Updated weights for policy 1, policy_version 1588227 (0.0010) [2023-12-26 12:21:41,710][123090] Updated weights for policy 1, policy_version 1588237 (0.0010) [2023-12-26 12:21:41,783][123090] Updated weights for policy 1, policy_version 1588247 (0.0009) [2023-12-26 12:21:42,124][123091] Updated weights for policy 0, policy_version 1598807 (0.0009) [2023-12-26 12:21:42,177][123091] Updated weights for policy 0, policy_version 1598818 (0.0009) [2023-12-26 12:21:42,231][123091] Updated weights for policy 0, policy_version 1598828 (0.0009) [2023-12-26 12:21:42,557][123090] Updated weights for policy 1, policy_version 1588257 (0.0007) [2023-12-26 12:21:42,628][123090] Updated weights for policy 1, policy_version 1588267 (0.0010) [2023-12-26 12:21:42,694][123090] Updated weights for policy 1, policy_version 1588277 (0.0010) [2023-12-26 12:21:42,757][123090] Updated weights for policy 1, policy_version 1588287 (0.0009) [2023-12-26 12:21:43,102][123091] Updated weights for policy 0, policy_version 1598838 (0.0009) [2023-12-26 12:21:43,152][123091] Updated weights for policy 0, policy_version 1598849 (0.0009) [2023-12-26 12:21:43,204][123091] Updated weights for policy 0, policy_version 1598859 (0.0009) [2023-12-26 12:21:43,587][123090] Updated weights for policy 1, policy_version 1588297 (0.0009) [2023-12-26 12:21:43,657][123090] Updated weights for policy 1, policy_version 1588307 (0.0009) [2023-12-26 12:21:43,717][123090] Updated weights for policy 1, policy_version 1588318 (0.0010) [2023-12-26 12:21:43,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 815923200. Throughput: 0: 8783.6, 1: 8727.3. Samples: 815914448. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:43,784][121949] Avg episode reward: [(0, '6277.866'), (1, '5569.913')] [2023-12-26 12:21:44,010][123091] Updated weights for policy 0, policy_version 1598869 (0.0007) [2023-12-26 12:21:44,070][123091] Updated weights for policy 0, policy_version 1598879 (0.0005) [2023-12-26 12:21:44,134][123091] Updated weights for policy 0, policy_version 1598889 (0.0006) [2023-12-26 12:21:44,618][123090] Updated weights for policy 1, policy_version 1588328 (0.0008) [2023-12-26 12:21:44,684][123090] Updated weights for policy 1, policy_version 1588338 (0.0010) [2023-12-26 12:21:44,739][123090] Updated weights for policy 1, policy_version 1588348 (0.0009) [2023-12-26 12:21:44,875][123091] Updated weights for policy 0, policy_version 1598899 (0.0009) [2023-12-26 12:21:44,950][123091] Updated weights for policy 0, policy_version 1598909 (0.0006) [2023-12-26 12:21:45,012][123091] Updated weights for policy 0, policy_version 1598919 (0.0006) [2023-12-26 12:21:45,601][123090] Updated weights for policy 1, policy_version 1588358 (0.0010) [2023-12-26 12:21:45,659][123090] Updated weights for policy 1, policy_version 1588369 (0.0010) [2023-12-26 12:21:45,668][123091] Updated weights for policy 0, policy_version 1598929 (0.0006) [2023-12-26 12:21:45,723][123091] Updated weights for policy 0, policy_version 1598939 (0.0008) [2023-12-26 12:21:45,730][123090] Updated weights for policy 1, policy_version 1588379 (0.0009) [2023-12-26 12:21:45,783][123091] Updated weights for policy 0, policy_version 1598949 (0.0006) [2023-12-26 12:21:45,844][123091] Updated weights for policy 0, policy_version 1598959 (0.0006) [2023-12-26 12:21:46,603][123090] Updated weights for policy 1, policy_version 1588389 (0.0009) [2023-12-26 12:21:46,645][123091] Updated weights for policy 0, policy_version 1598969 (0.0007) [2023-12-26 12:21:46,665][123090] Updated weights for policy 1, policy_version 1588399 (0.0010) [2023-12-26 12:21:46,698][123091] Updated weights for policy 0, policy_version 1598979 (0.0008) [2023-12-26 12:21:46,732][123090] Updated weights for policy 1, policy_version 1588409 (0.0007) [2023-12-26 12:21:46,755][123091] Updated weights for policy 0, policy_version 1598989 (0.0009) [2023-12-26 12:21:47,471][123091] Updated weights for policy 0, policy_version 1598999 (0.0009) [2023-12-26 12:21:47,535][123091] Updated weights for policy 0, policy_version 1599009 (0.0009) [2023-12-26 12:21:47,575][123090] Updated weights for policy 1, policy_version 1588419 (0.0007) [2023-12-26 12:21:47,601][123091] Updated weights for policy 0, policy_version 1599019 (0.0010) [2023-12-26 12:21:47,641][123090] Updated weights for policy 1, policy_version 1588429 (0.0010) [2023-12-26 12:21:47,698][123090] Updated weights for policy 1, policy_version 1588439 (0.0009) [2023-12-26 12:21:48,415][123091] Updated weights for policy 0, policy_version 1599029 (0.0010) [2023-12-26 12:21:48,478][123091] Updated weights for policy 0, policy_version 1599039 (0.0009) [2023-12-26 12:21:48,539][123091] Updated weights for policy 0, policy_version 1599049 (0.0009) [2023-12-26 12:21:48,562][123090] Updated weights for policy 1, policy_version 1588449 (0.0009) [2023-12-26 12:21:48,630][123090] Updated weights for policy 1, policy_version 1588459 (0.0009) [2023-12-26 12:21:48,699][123090] Updated weights for policy 1, policy_version 1588469 (0.0010) [2023-12-26 12:21:48,762][123090] Updated weights for policy 1, policy_version 1588479 (0.0010) [2023-12-26 12:21:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 816013312. Throughput: 0: 8841.5, 1: 8664.0. Samples: 816019660. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:48,784][121949] Avg episode reward: [(0, '6102.361'), (1, '5664.236')] [2023-12-26 12:21:49,409][123091] Updated weights for policy 0, policy_version 1599059 (0.0009) [2023-12-26 12:21:49,479][123091] Updated weights for policy 0, policy_version 1599069 (0.0010) [2023-12-26 12:21:49,535][123091] Updated weights for policy 0, policy_version 1599079 (0.0009) [2023-12-26 12:21:49,592][123090] Updated weights for policy 1, policy_version 1588489 (0.0007) [2023-12-26 12:21:49,658][123090] Updated weights for policy 1, policy_version 1588499 (0.0007) [2023-12-26 12:21:49,725][123090] Updated weights for policy 1, policy_version 1588509 (0.0009) [2023-12-26 12:21:50,403][123091] Updated weights for policy 0, policy_version 1599089 (0.0008) [2023-12-26 12:21:50,468][123091] Updated weights for policy 0, policy_version 1599100 (0.0009) [2023-12-26 12:21:50,525][123091] Updated weights for policy 0, policy_version 1599110 (0.0010) [2023-12-26 12:21:50,531][123090] Updated weights for policy 1, policy_version 1588519 (0.0006) [2023-12-26 12:21:50,586][123091] Updated weights for policy 0, policy_version 1599120 (0.0009) [2023-12-26 12:21:50,599][123090] Updated weights for policy 1, policy_version 1588529 (0.0009) [2023-12-26 12:21:50,661][123090] Updated weights for policy 1, policy_version 1588539 (0.0010) [2023-12-26 12:21:51,443][123090] Updated weights for policy 1, policy_version 1588549 (0.0011) [2023-12-26 12:21:51,455][123091] Updated weights for policy 0, policy_version 1599130 (0.0007) [2023-12-26 12:21:51,508][123090] Updated weights for policy 1, policy_version 1588559 (0.0011) [2023-12-26 12:21:51,519][123091] Updated weights for policy 0, policy_version 1599140 (0.0006) [2023-12-26 12:21:51,565][123090] Updated weights for policy 1, policy_version 1588569 (0.0011) [2023-12-26 12:21:51,576][123091] Updated weights for policy 0, policy_version 1599150 (0.0006) [2023-12-26 12:21:52,410][123090] Updated weights for policy 1, policy_version 1588579 (0.0009) [2023-12-26 12:21:52,428][123091] Updated weights for policy 0, policy_version 1599160 (0.0008) [2023-12-26 12:21:52,473][123090] Updated weights for policy 1, policy_version 1588589 (0.0005) [2023-12-26 12:21:52,486][123091] Updated weights for policy 0, policy_version 1599170 (0.0009) [2023-12-26 12:21:52,538][123091] Updated weights for policy 0, policy_version 1599180 (0.0009) [2023-12-26 12:21:52,540][123090] Updated weights for policy 1, policy_version 1588599 (0.0006) [2023-12-26 12:21:53,259][123090] Updated weights for policy 1, policy_version 1588609 (0.0006) [2023-12-26 12:21:53,321][123090] Updated weights for policy 1, policy_version 1588619 (0.0010) [2023-12-26 12:21:53,394][123090] Updated weights for policy 1, policy_version 1588629 (0.0010) [2023-12-26 12:21:53,435][123091] Updated weights for policy 0, policy_version 1599190 (0.0007) [2023-12-26 12:21:53,450][123090] Updated weights for policy 1, policy_version 1588639 (0.0010) [2023-12-26 12:21:53,489][123091] Updated weights for policy 0, policy_version 1599200 (0.0007) [2023-12-26 12:21:53,535][123091] Updated weights for policy 0, policy_version 1599210 (0.0007) [2023-12-26 12:21:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17612.8, 300 sec: 17689.1). Total num frames: 816095232. Throughput: 0: 8839.8, 1: 8630.7. Samples: 816069800. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:53,786][121949] Avg episode reward: [(0, '6062.328'), (1, '5661.701')] [2023-12-26 12:21:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001588640_406691840.pth... [2023-12-26 12:21:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001599216_409403392.pth... [2023-12-26 12:21:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001587616_406429696.pth [2023-12-26 12:21:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001598192_409141248.pth [2023-12-26 12:21:54,265][123090] Updated weights for policy 1, policy_version 1588649 (0.0010) [2023-12-26 12:21:54,324][123090] Updated weights for policy 1, policy_version 1588659 (0.0010) [2023-12-26 12:21:54,327][123091] Updated weights for policy 0, policy_version 1599220 (0.0005) [2023-12-26 12:21:54,384][123090] Updated weights for policy 1, policy_version 1588669 (0.0010) [2023-12-26 12:21:54,386][123091] Updated weights for policy 0, policy_version 1599230 (0.0006) [2023-12-26 12:21:54,456][123091] Updated weights for policy 0, policy_version 1599240 (0.0008) [2023-12-26 12:21:55,173][123090] Updated weights for policy 1, policy_version 1588679 (0.0010) [2023-12-26 12:21:55,225][123090] Updated weights for policy 1, policy_version 1588689 (0.0010) [2023-12-26 12:21:55,276][123090] Updated weights for policy 1, policy_version 1588699 (0.0010) [2023-12-26 12:21:55,287][123091] Updated weights for policy 0, policy_version 1599250 (0.0008) [2023-12-26 12:21:55,338][123091] Updated weights for policy 0, policy_version 1599260 (0.0009) [2023-12-26 12:21:55,388][123091] Updated weights for policy 0, policy_version 1599270 (0.0010) [2023-12-26 12:21:55,446][123091] Updated weights for policy 0, policy_version 1599280 (0.0008) [2023-12-26 12:21:56,114][123090] Updated weights for policy 1, policy_version 1588709 (0.0011) [2023-12-26 12:21:56,137][123091] Updated weights for policy 0, policy_version 1599290 (0.0006) [2023-12-26 12:21:56,176][123090] Updated weights for policy 1, policy_version 1588719 (0.0010) [2023-12-26 12:21:56,195][123091] Updated weights for policy 0, policy_version 1599300 (0.0005) [2023-12-26 12:21:56,231][123090] Updated weights for policy 1, policy_version 1588729 (0.0010) [2023-12-26 12:21:56,242][123091] Updated weights for policy 0, policy_version 1599310 (0.0006) [2023-12-26 12:21:56,828][123091] Updated weights for policy 0, policy_version 1599320 (0.0006) [2023-12-26 12:21:56,894][123091] Updated weights for policy 0, policy_version 1599330 (0.0006) [2023-12-26 12:21:56,965][123091] Updated weights for policy 0, policy_version 1599340 (0.0008) [2023-12-26 12:21:57,070][123090] Updated weights for policy 1, policy_version 1588739 (0.0010) [2023-12-26 12:21:57,127][123090] Updated weights for policy 1, policy_version 1588751 (0.0011) [2023-12-26 12:21:57,185][123090] Updated weights for policy 1, policy_version 1588761 (0.0010) [2023-12-26 12:21:57,652][123091] Updated weights for policy 0, policy_version 1599350 (0.0008) [2023-12-26 12:21:57,699][123091] Updated weights for policy 0, policy_version 1599360 (0.0010) [2023-12-26 12:21:57,753][123091] Updated weights for policy 0, policy_version 1599370 (0.0010) [2023-12-26 12:21:58,020][123090] Updated weights for policy 1, policy_version 1588771 (0.0009) [2023-12-26 12:21:58,085][123090] Updated weights for policy 1, policy_version 1588781 (0.0009) [2023-12-26 12:21:58,150][123090] Updated weights for policy 1, policy_version 1588791 (0.0010) [2023-12-26 12:21:58,563][123091] Updated weights for policy 0, policy_version 1599380 (0.0009) [2023-12-26 12:21:58,626][123091] Updated weights for policy 0, policy_version 1599390 (0.0008) [2023-12-26 12:21:58,714][123091] Updated weights for policy 0, policy_version 1599400 (0.0008) [2023-12-26 12:21:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 816185344. Throughput: 0: 8862.5, 1: 8715.8. Samples: 816177752. Policy #0 lag: (min: 10.0, avg: 24.7, max: 42.0) [2023-12-26 12:21:58,785][121949] Avg episode reward: [(0, '6037.856'), (1, '5608.419')] [2023-12-26 12:21:59,135][123090] Updated weights for policy 1, policy_version 1588801 (0.0010) [2023-12-26 12:21:59,195][123090] Updated weights for policy 1, policy_version 1588811 (0.0011) [2023-12-26 12:21:59,264][123090] Updated weights for policy 1, policy_version 1588821 (0.0010) [2023-12-26 12:21:59,326][123090] Updated weights for policy 1, policy_version 1588831 (0.0008) [2023-12-26 12:21:59,623][123091] Updated weights for policy 0, policy_version 1599410 (0.0008) [2023-12-26 12:21:59,687][123091] Updated weights for policy 0, policy_version 1599420 (0.0010) [2023-12-26 12:21:59,746][123091] Updated weights for policy 0, policy_version 1599430 (0.0010) [2023-12-26 12:21:59,809][123091] Updated weights for policy 0, policy_version 1599440 (0.0011) [2023-12-26 12:22:00,151][123090] Updated weights for policy 1, policy_version 1588841 (0.0010) [2023-12-26 12:22:00,201][123090] Updated weights for policy 1, policy_version 1588851 (0.0010) [2023-12-26 12:22:00,262][123090] Updated weights for policy 1, policy_version 1588861 (0.0011) [2023-12-26 12:22:00,542][123091] Updated weights for policy 0, policy_version 1599450 (0.0006) [2023-12-26 12:22:00,613][123091] Updated weights for policy 0, policy_version 1599460 (0.0006) [2023-12-26 12:22:00,681][123091] Updated weights for policy 0, policy_version 1599470 (0.0005) [2023-12-26 12:22:00,981][123090] Updated weights for policy 1, policy_version 1588871 (0.0007) [2023-12-26 12:22:01,049][123090] Updated weights for policy 1, policy_version 1588881 (0.0006) [2023-12-26 12:22:01,126][123090] Updated weights for policy 1, policy_version 1588891 (0.0006) [2023-12-26 12:22:01,442][123091] Updated weights for policy 0, policy_version 1599480 (0.0009) [2023-12-26 12:22:01,491][123091] Updated weights for policy 0, policy_version 1599490 (0.0009) [2023-12-26 12:22:01,539][123091] Updated weights for policy 0, policy_version 1599500 (0.0009) [2023-12-26 12:22:01,888][123090] Updated weights for policy 1, policy_version 1588901 (0.0007) [2023-12-26 12:22:01,935][123090] Updated weights for policy 1, policy_version 1588911 (0.0005) [2023-12-26 12:22:01,992][123090] Updated weights for policy 1, policy_version 1588921 (0.0010) [2023-12-26 12:22:02,294][123091] Updated weights for policy 0, policy_version 1599510 (0.0010) [2023-12-26 12:22:02,348][123091] Updated weights for policy 0, policy_version 1599520 (0.0010) [2023-12-26 12:22:02,415][123091] Updated weights for policy 0, policy_version 1599530 (0.0011) [2023-12-26 12:22:02,802][123090] Updated weights for policy 1, policy_version 1588931 (0.0010) [2023-12-26 12:22:02,853][123090] Updated weights for policy 1, policy_version 1588941 (0.0010) [2023-12-26 12:22:02,901][123090] Updated weights for policy 1, policy_version 1588951 (0.0010) [2023-12-26 12:22:03,177][123091] Updated weights for policy 0, policy_version 1599540 (0.0009) [2023-12-26 12:22:03,242][123091] Updated weights for policy 0, policy_version 1599550 (0.0011) [2023-12-26 12:22:03,311][123091] Updated weights for policy 0, policy_version 1599560 (0.0010) [2023-12-26 12:22:03,599][123090] Updated weights for policy 1, policy_version 1588961 (0.0010) [2023-12-26 12:22:03,663][123090] Updated weights for policy 1, policy_version 1588971 (0.0006) [2023-12-26 12:22:03,721][123090] Updated weights for policy 1, policy_version 1588981 (0.0006) [2023-12-26 12:22:03,770][123090] Updated weights for policy 1, policy_version 1588991 (0.0009) [2023-12-26 12:22:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 816275456. Throughput: 0: 8921.5, 1: 8697.2. Samples: 816283920. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:03,786][121949] Avg episode reward: [(0, '5913.567'), (1, '5639.127')] [2023-12-26 12:22:03,910][123091] Updated weights for policy 0, policy_version 1599570 (0.0009) [2023-12-26 12:22:03,966][123091] Updated weights for policy 0, policy_version 1599580 (0.0011) [2023-12-26 12:22:04,037][123091] Updated weights for policy 0, policy_version 1599590 (0.0011) [2023-12-26 12:22:04,102][123091] Updated weights for policy 0, policy_version 1599600 (0.0010) [2023-12-26 12:22:04,556][123090] Updated weights for policy 1, policy_version 1589001 (0.0010) [2023-12-26 12:22:04,610][123090] Updated weights for policy 1, policy_version 1589011 (0.0010) [2023-12-26 12:22:04,662][123090] Updated weights for policy 1, policy_version 1589021 (0.0010) [2023-12-26 12:22:04,886][123091] Updated weights for policy 0, policy_version 1599610 (0.0005) [2023-12-26 12:22:04,945][123091] Updated weights for policy 0, policy_version 1599620 (0.0005) [2023-12-26 12:22:04,998][123091] Updated weights for policy 0, policy_version 1599630 (0.0007) [2023-12-26 12:22:05,409][123090] Updated weights for policy 1, policy_version 1589031 (0.0010) [2023-12-26 12:22:05,472][123090] Updated weights for policy 1, policy_version 1589041 (0.0010) [2023-12-26 12:22:05,527][123090] Updated weights for policy 1, policy_version 1589051 (0.0010) [2023-12-26 12:22:05,684][123091] Updated weights for policy 0, policy_version 1599640 (0.0006) [2023-12-26 12:22:05,743][123091] Updated weights for policy 0, policy_version 1599650 (0.0005) [2023-12-26 12:22:05,802][123091] Updated weights for policy 0, policy_version 1599661 (0.0007) [2023-12-26 12:22:06,364][123090] Updated weights for policy 1, policy_version 1589061 (0.0011) [2023-12-26 12:22:06,427][123090] Updated weights for policy 1, policy_version 1589071 (0.0011) [2023-12-26 12:22:06,487][123090] Updated weights for policy 1, policy_version 1589081 (0.0011) [2023-12-26 12:22:06,516][123091] Updated weights for policy 0, policy_version 1599671 (0.0009) [2023-12-26 12:22:06,569][123091] Updated weights for policy 0, policy_version 1599681 (0.0011) [2023-12-26 12:22:06,626][123091] Updated weights for policy 0, policy_version 1599691 (0.0011) [2023-12-26 12:22:07,310][123090] Updated weights for policy 1, policy_version 1589091 (0.0011) [2023-12-26 12:22:07,377][123090] Updated weights for policy 1, policy_version 1589101 (0.0010) [2023-12-26 12:22:07,439][123090] Updated weights for policy 1, policy_version 1589111 (0.0011) [2023-12-26 12:22:07,455][123091] Updated weights for policy 0, policy_version 1599701 (0.0009) [2023-12-26 12:22:07,520][123091] Updated weights for policy 0, policy_version 1599711 (0.0008) [2023-12-26 12:22:07,581][123091] Updated weights for policy 0, policy_version 1599721 (0.0010) [2023-12-26 12:22:08,222][123090] Updated weights for policy 1, policy_version 1589121 (0.0010) [2023-12-26 12:22:08,277][123090] Updated weights for policy 1, policy_version 1589131 (0.0008) [2023-12-26 12:22:08,286][123091] Updated weights for policy 0, policy_version 1599731 (0.0010) [2023-12-26 12:22:08,333][123090] Updated weights for policy 1, policy_version 1589141 (0.0010) [2023-12-26 12:22:08,348][123091] Updated weights for policy 0, policy_version 1599741 (0.0010) [2023-12-26 12:22:08,390][123090] Updated weights for policy 1, policy_version 1589151 (0.0011) [2023-12-26 12:22:08,410][123091] Updated weights for policy 0, policy_version 1599751 (0.0008) [2023-12-26 12:22:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 816365568. Throughput: 0: 9022.8, 1: 8704.1. Samples: 816339312. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:08,786][121949] Avg episode reward: [(0, '6185.260'), (1, '5497.812')] [2023-12-26 12:22:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001599760_409542656.pth... [2023-12-26 12:22:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001589152_406822912.pth... [2023-12-26 12:22:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001598704_409272320.pth [2023-12-26 12:22:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001588160_406568960.pth [2023-12-26 12:22:09,229][123090] Updated weights for policy 1, policy_version 1589161 (0.0010) [2023-12-26 12:22:09,263][123091] Updated weights for policy 0, policy_version 1599761 (0.0009) [2023-12-26 12:22:09,288][123090] Updated weights for policy 1, policy_version 1589171 (0.0010) [2023-12-26 12:22:09,331][123091] Updated weights for policy 0, policy_version 1599771 (0.0010) [2023-12-26 12:22:09,354][123090] Updated weights for policy 1, policy_version 1589181 (0.0010) [2023-12-26 12:22:09,391][123091] Updated weights for policy 0, policy_version 1599781 (0.0009) [2023-12-26 12:22:09,456][123091] Updated weights for policy 0, policy_version 1599791 (0.0009) [2023-12-26 12:22:10,213][123090] Updated weights for policy 1, policy_version 1589191 (0.0011) [2023-12-26 12:22:10,276][123090] Updated weights for policy 1, policy_version 1589201 (0.0008) [2023-12-26 12:22:10,317][123091] Updated weights for policy 0, policy_version 1599801 (0.0007) [2023-12-26 12:22:10,347][123090] Updated weights for policy 1, policy_version 1589211 (0.0011) [2023-12-26 12:22:10,388][123091] Updated weights for policy 0, policy_version 1599811 (0.0010) [2023-12-26 12:22:10,458][123091] Updated weights for policy 0, policy_version 1599821 (0.0009) [2023-12-26 12:22:11,195][123090] Updated weights for policy 1, policy_version 1589221 (0.0009) [2023-12-26 12:22:11,253][123090] Updated weights for policy 1, policy_version 1589231 (0.0008) [2023-12-26 12:22:11,319][123090] Updated weights for policy 1, policy_version 1589241 (0.0008) [2023-12-26 12:22:11,356][123091] Updated weights for policy 0, policy_version 1599831 (0.0010) [2023-12-26 12:22:11,427][123091] Updated weights for policy 0, policy_version 1599841 (0.0010) [2023-12-26 12:22:11,494][123091] Updated weights for policy 0, policy_version 1599851 (0.0008) [2023-12-26 12:22:12,103][123090] Updated weights for policy 1, policy_version 1589251 (0.0009) [2023-12-26 12:22:12,163][123090] Updated weights for policy 1, policy_version 1589261 (0.0010) [2023-12-26 12:22:12,223][123090] Updated weights for policy 1, policy_version 1589271 (0.0010) [2023-12-26 12:22:12,301][123091] Updated weights for policy 0, policy_version 1599861 (0.0007) [2023-12-26 12:22:12,368][123091] Updated weights for policy 0, policy_version 1599871 (0.0007) [2023-12-26 12:22:12,436][123091] Updated weights for policy 0, policy_version 1599881 (0.0007) [2023-12-26 12:22:13,009][123090] Updated weights for policy 1, policy_version 1589281 (0.0010) [2023-12-26 12:22:13,063][123090] Updated weights for policy 1, policy_version 1589291 (0.0005) [2023-12-26 12:22:13,111][123090] Updated weights for policy 1, policy_version 1589301 (0.0005) [2023-12-26 12:22:13,169][123090] Updated weights for policy 1, policy_version 1589311 (0.0005) [2023-12-26 12:22:13,286][123091] Updated weights for policy 0, policy_version 1599891 (0.0009) [2023-12-26 12:22:13,339][123091] Updated weights for policy 0, policy_version 1599901 (0.0006) [2023-12-26 12:22:13,407][123091] Updated weights for policy 0, policy_version 1599911 (0.0006) [2023-12-26 12:22:13,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 816447488. Throughput: 0: 8891.9, 1: 8758.8. Samples: 816441520. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:13,784][121949] Avg episode reward: [(0, '6254.692'), (1, '5227.383')] [2023-12-26 12:22:13,978][123090] Updated weights for policy 1, policy_version 1589321 (0.0010) [2023-12-26 12:22:14,033][123090] Updated weights for policy 1, policy_version 1589331 (0.0010) [2023-12-26 12:22:14,038][123091] Updated weights for policy 0, policy_version 1599921 (0.0005) [2023-12-26 12:22:14,094][123091] Updated weights for policy 0, policy_version 1599931 (0.0006) [2023-12-26 12:22:14,097][123090] Updated weights for policy 1, policy_version 1589341 (0.0010) [2023-12-26 12:22:14,157][123091] Updated weights for policy 0, policy_version 1599941 (0.0006) [2023-12-26 12:22:14,221][123091] Updated weights for policy 0, policy_version 1599951 (0.0005) [2023-12-26 12:22:14,856][123091] Updated weights for policy 0, policy_version 1599961 (0.0010) [2023-12-26 12:22:14,917][123091] Updated weights for policy 0, policy_version 1599971 (0.0010) [2023-12-26 12:22:14,921][123090] Updated weights for policy 1, policy_version 1589351 (0.0009) [2023-12-26 12:22:14,974][123090] Updated weights for policy 1, policy_version 1589361 (0.0007) [2023-12-26 12:22:14,984][123091] Updated weights for policy 0, policy_version 1599981 (0.0011) [2023-12-26 12:22:15,044][123090] Updated weights for policy 1, policy_version 1589371 (0.0006) [2023-12-26 12:22:15,713][123090] Updated weights for policy 1, policy_version 1589381 (0.0006) [2023-12-26 12:22:15,728][123091] Updated weights for policy 0, policy_version 1599991 (0.0007) [2023-12-26 12:22:15,778][123090] Updated weights for policy 1, policy_version 1589391 (0.0005) [2023-12-26 12:22:15,803][123091] Updated weights for policy 0, policy_version 1600001 (0.0005) [2023-12-26 12:22:15,835][123090] Updated weights for policy 1, policy_version 1589401 (0.0005) [2023-12-26 12:22:15,864][123091] Updated weights for policy 0, policy_version 1600011 (0.0006) [2023-12-26 12:22:16,509][123090] Updated weights for policy 1, policy_version 1589411 (0.0005) [2023-12-26 12:22:16,568][123090] Updated weights for policy 1, policy_version 1589421 (0.0006) [2023-12-26 12:22:16,572][123091] Updated weights for policy 0, policy_version 1600021 (0.0007) [2023-12-26 12:22:16,623][123091] Updated weights for policy 0, policy_version 1600031 (0.0006) [2023-12-26 12:22:16,632][123090] Updated weights for policy 1, policy_version 1589431 (0.0010) [2023-12-26 12:22:16,686][123091] Updated weights for policy 0, policy_version 1600041 (0.0006) [2023-12-26 12:22:17,341][123091] Updated weights for policy 0, policy_version 1600051 (0.0007) [2023-12-26 12:22:17,411][123091] Updated weights for policy 0, policy_version 1600061 (0.0006) [2023-12-26 12:22:17,451][123090] Updated weights for policy 1, policy_version 1589441 (0.0011) [2023-12-26 12:22:17,480][123091] Updated weights for policy 0, policy_version 1600071 (0.0005) [2023-12-26 12:22:17,517][123090] Updated weights for policy 1, policy_version 1589451 (0.0010) [2023-12-26 12:22:17,584][123090] Updated weights for policy 1, policy_version 1589461 (0.0006) [2023-12-26 12:22:17,642][123090] Updated weights for policy 1, policy_version 1589471 (0.0005) [2023-12-26 12:22:18,165][123091] Updated weights for policy 0, policy_version 1600081 (0.0006) [2023-12-26 12:22:18,217][123091] Updated weights for policy 0, policy_version 1600091 (0.0009) [2023-12-26 12:22:18,276][123091] Updated weights for policy 0, policy_version 1600101 (0.0009) [2023-12-26 12:22:18,280][123090] Updated weights for policy 1, policy_version 1589481 (0.0005) [2023-12-26 12:22:18,334][123091] Updated weights for policy 0, policy_version 1600111 (0.0008) [2023-12-26 12:22:18,344][123090] Updated weights for policy 1, policy_version 1589491 (0.0006) [2023-12-26 12:22:18,417][123090] Updated weights for policy 1, policy_version 1589501 (0.0007) [2023-12-26 12:22:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 816545792. Throughput: 0: 8991.6, 1: 8854.1. Samples: 816555740. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:18,784][121949] Avg episode reward: [(0, '6285.565'), (1, '5426.826')] [2023-12-26 12:22:19,109][123090] Updated weights for policy 1, policy_version 1589511 (0.0006) [2023-12-26 12:22:19,178][123090] Updated weights for policy 1, policy_version 1589521 (0.0006) [2023-12-26 12:22:19,252][123090] Updated weights for policy 1, policy_version 1589531 (0.0011) [2023-12-26 12:22:19,265][123091] Updated weights for policy 0, policy_version 1600121 (0.0009) [2023-12-26 12:22:19,332][123091] Updated weights for policy 0, policy_version 1600131 (0.0008) [2023-12-26 12:22:19,404][123091] Updated weights for policy 0, policy_version 1600141 (0.0009) [2023-12-26 12:22:20,122][123090] Updated weights for policy 1, policy_version 1589541 (0.0010) [2023-12-26 12:22:20,169][123091] Updated weights for policy 0, policy_version 1600151 (0.0007) [2023-12-26 12:22:20,181][123090] Updated weights for policy 1, policy_version 1589551 (0.0008) [2023-12-26 12:22:20,229][123091] Updated weights for policy 0, policy_version 1600161 (0.0008) [2023-12-26 12:22:20,245][123090] Updated weights for policy 1, policy_version 1589561 (0.0008) [2023-12-26 12:22:20,291][123091] Updated weights for policy 0, policy_version 1600171 (0.0010) [2023-12-26 12:22:21,102][123091] Updated weights for policy 0, policy_version 1600181 (0.0008) [2023-12-26 12:22:21,153][123090] Updated weights for policy 1, policy_version 1589571 (0.0007) [2023-12-26 12:22:21,177][123091] Updated weights for policy 0, policy_version 1600191 (0.0010) [2023-12-26 12:22:21,210][123090] Updated weights for policy 1, policy_version 1589581 (0.0006) [2023-12-26 12:22:21,240][123091] Updated weights for policy 0, policy_version 1600201 (0.0010) [2023-12-26 12:22:21,266][123090] Updated weights for policy 1, policy_version 1589591 (0.0009) [2023-12-26 12:22:22,045][123091] Updated weights for policy 0, policy_version 1600211 (0.0010) [2023-12-26 12:22:22,118][123091] Updated weights for policy 0, policy_version 1600221 (0.0011) [2023-12-26 12:22:22,190][123091] Updated weights for policy 0, policy_version 1600231 (0.0011) [2023-12-26 12:22:22,198][123090] Updated weights for policy 1, policy_version 1589601 (0.0009) [2023-12-26 12:22:22,262][123090] Updated weights for policy 1, policy_version 1589611 (0.0007) [2023-12-26 12:22:22,325][123090] Updated weights for policy 1, policy_version 1589621 (0.0006) [2023-12-26 12:22:22,397][123090] Updated weights for policy 1, policy_version 1589631 (0.0007) [2023-12-26 12:22:22,952][123091] Updated weights for policy 0, policy_version 1600241 (0.0010) [2023-12-26 12:22:23,016][123091] Updated weights for policy 0, policy_version 1600251 (0.0006) [2023-12-26 12:22:23,072][123091] Updated weights for policy 0, policy_version 1600261 (0.0006) [2023-12-26 12:22:23,135][123091] Updated weights for policy 0, policy_version 1600271 (0.0008) [2023-12-26 12:22:23,190][123090] Updated weights for policy 1, policy_version 1589641 (0.0006) [2023-12-26 12:22:23,249][123090] Updated weights for policy 1, policy_version 1589651 (0.0009) [2023-12-26 12:22:23,325][123090] Updated weights for policy 1, policy_version 1589661 (0.0010) [2023-12-26 12:22:23,760][123091] Updated weights for policy 0, policy_version 1600281 (0.0008) [2023-12-26 12:22:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 816627712. Throughput: 0: 8989.9, 1: 8757.1. Samples: 816606232. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:23,785][121949] Avg episode reward: [(0, '6214.355'), (1, '5603.393')] [2023-12-26 12:22:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001589664_406953984.pth... [2023-12-26 12:22:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001588640_406691840.pth [2023-12-26 12:22:23,819][123091] Updated weights for policy 0, policy_version 1600291 (0.0006) [2023-12-26 12:22:23,871][123091] Updated weights for policy 0, policy_version 1600301 (0.0005) [2023-12-26 12:22:23,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001600304_409681920.pth... [2023-12-26 12:22:23,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001599216_409403392.pth [2023-12-26 12:22:24,190][123090] Updated weights for policy 1, policy_version 1589671 (0.0010) [2023-12-26 12:22:24,248][123090] Updated weights for policy 1, policy_version 1589681 (0.0010) [2023-12-26 12:22:24,302][123090] Updated weights for policy 1, policy_version 1589691 (0.0010) [2023-12-26 12:22:24,567][123091] Updated weights for policy 0, policy_version 1600311 (0.0005) [2023-12-26 12:22:24,618][123091] Updated weights for policy 0, policy_version 1600321 (0.0005) [2023-12-26 12:22:24,675][123091] Updated weights for policy 0, policy_version 1600331 (0.0005) [2023-12-26 12:22:25,223][123090] Updated weights for policy 1, policy_version 1589701 (0.0010) [2023-12-26 12:22:25,283][123090] Updated weights for policy 1, policy_version 1589711 (0.0009) [2023-12-26 12:22:25,348][123090] Updated weights for policy 1, policy_version 1589721 (0.0009) [2023-12-26 12:22:25,399][123091] Updated weights for policy 0, policy_version 1600341 (0.0007) [2023-12-26 12:22:25,453][123091] Updated weights for policy 0, policy_version 1600351 (0.0010) [2023-12-26 12:22:25,514][123091] Updated weights for policy 0, policy_version 1600361 (0.0010) [2023-12-26 12:22:26,170][123090] Updated weights for policy 1, policy_version 1589731 (0.0009) [2023-12-26 12:22:26,239][123090] Updated weights for policy 1, policy_version 1589741 (0.0009) [2023-12-26 12:22:26,250][123091] Updated weights for policy 0, policy_version 1600371 (0.0009) [2023-12-26 12:22:26,296][123091] Updated weights for policy 0, policy_version 1600381 (0.0005) [2023-12-26 12:22:26,302][123090] Updated weights for policy 1, policy_version 1589751 (0.0009) [2023-12-26 12:22:26,354][123091] Updated weights for policy 0, policy_version 1600391 (0.0005) [2023-12-26 12:22:27,002][123091] Updated weights for policy 0, policy_version 1600401 (0.0006) [2023-12-26 12:22:27,052][123091] Updated weights for policy 0, policy_version 1600411 (0.0009) [2023-12-26 12:22:27,114][123091] Updated weights for policy 0, policy_version 1600421 (0.0010) [2023-12-26 12:22:27,176][123091] Updated weights for policy 0, policy_version 1600431 (0.0010) [2023-12-26 12:22:27,177][123090] Updated weights for policy 1, policy_version 1589761 (0.0009) [2023-12-26 12:22:27,236][123090] Updated weights for policy 1, policy_version 1589771 (0.0009) [2023-12-26 12:22:27,286][123090] Updated weights for policy 1, policy_version 1589781 (0.0008) [2023-12-26 12:22:27,336][123090] Updated weights for policy 1, policy_version 1589791 (0.0008) [2023-12-26 12:22:27,984][123091] Updated weights for policy 0, policy_version 1600441 (0.0006) [2023-12-26 12:22:28,032][123091] Updated weights for policy 0, policy_version 1600451 (0.0005) [2023-12-26 12:22:28,082][123091] Updated weights for policy 0, policy_version 1600461 (0.0005) [2023-12-26 12:22:28,207][123090] Updated weights for policy 1, policy_version 1589801 (0.0010) [2023-12-26 12:22:28,258][123090] Updated weights for policy 1, policy_version 1589811 (0.0008) [2023-12-26 12:22:28,315][123090] Updated weights for policy 1, policy_version 1589821 (0.0008) [2023-12-26 12:22:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 816717824. Throughput: 0: 9141.6, 1: 8638.1. Samples: 816714540. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:28,785][121949] Avg episode reward: [(0, '6165.776'), (1, '5646.817')] [2023-12-26 12:22:28,834][123091] Updated weights for policy 0, policy_version 1600471 (0.0008) [2023-12-26 12:22:28,891][123091] Updated weights for policy 0, policy_version 1600481 (0.0009) [2023-12-26 12:22:28,949][123091] Updated weights for policy 0, policy_version 1600491 (0.0009) [2023-12-26 12:22:29,200][123090] Updated weights for policy 1, policy_version 1589831 (0.0009) [2023-12-26 12:22:29,262][123090] Updated weights for policy 1, policy_version 1589841 (0.0010) [2023-12-26 12:22:29,319][123090] Updated weights for policy 1, policy_version 1589851 (0.0009) [2023-12-26 12:22:29,680][123091] Updated weights for policy 0, policy_version 1600501 (0.0005) [2023-12-26 12:22:29,748][123091] Updated weights for policy 0, policy_version 1600511 (0.0005) [2023-12-26 12:22:29,809][123091] Updated weights for policy 0, policy_version 1600521 (0.0005) [2023-12-26 12:22:30,254][123090] Updated weights for policy 1, policy_version 1589861 (0.0009) [2023-12-26 12:22:30,319][123090] Updated weights for policy 1, policy_version 1589871 (0.0010) [2023-12-26 12:22:30,374][123090] Updated weights for policy 1, policy_version 1589881 (0.0008) [2023-12-26 12:22:30,503][123091] Updated weights for policy 0, policy_version 1600531 (0.0009) [2023-12-26 12:22:30,554][123091] Updated weights for policy 0, policy_version 1600541 (0.0008) [2023-12-26 12:22:30,619][123091] Updated weights for policy 0, policy_version 1600551 (0.0006) [2023-12-26 12:22:31,228][123090] Updated weights for policy 1, policy_version 1589891 (0.0010) [2023-12-26 12:22:31,293][123090] Updated weights for policy 1, policy_version 1589901 (0.0010) [2023-12-26 12:22:31,300][123091] Updated weights for policy 0, policy_version 1600561 (0.0005) [2023-12-26 12:22:31,359][123090] Updated weights for policy 1, policy_version 1589911 (0.0010) [2023-12-26 12:22:31,370][123091] Updated weights for policy 0, policy_version 1600571 (0.0006) [2023-12-26 12:22:31,430][123091] Updated weights for policy 0, policy_version 1600581 (0.0007) [2023-12-26 12:22:31,485][123091] Updated weights for policy 0, policy_version 1600591 (0.0007) [2023-12-26 12:22:32,220][123091] Updated weights for policy 0, policy_version 1600601 (0.0005) [2023-12-26 12:22:32,260][123090] Updated weights for policy 1, policy_version 1589921 (0.0009) [2023-12-26 12:22:32,282][123091] Updated weights for policy 0, policy_version 1600611 (0.0008) [2023-12-26 12:22:32,326][123090] Updated weights for policy 1, policy_version 1589931 (0.0008) [2023-12-26 12:22:32,352][123091] Updated weights for policy 0, policy_version 1600621 (0.0007) [2023-12-26 12:22:32,391][123090] Updated weights for policy 1, policy_version 1589941 (0.0010) [2023-12-26 12:22:32,449][123090] Updated weights for policy 1, policy_version 1589951 (0.0009) [2023-12-26 12:22:33,164][123091] Updated weights for policy 0, policy_version 1600631 (0.0010) [2023-12-26 12:22:33,203][123090] Updated weights for policy 1, policy_version 1589961 (0.0009) [2023-12-26 12:22:33,223][123091] Updated weights for policy 0, policy_version 1600641 (0.0006) [2023-12-26 12:22:33,259][123090] Updated weights for policy 1, policy_version 1589971 (0.0008) [2023-12-26 12:22:33,282][123091] Updated weights for policy 0, policy_version 1600651 (0.0007) [2023-12-26 12:22:33,316][123090] Updated weights for policy 1, policy_version 1589981 (0.0009) [2023-12-26 12:22:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 816807936. Throughput: 0: 9173.9, 1: 8636.1. Samples: 816821112. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:33,785][121949] Avg episode reward: [(0, '6187.911'), (1, '5656.115')] [2023-12-26 12:22:33,939][123091] Updated weights for policy 0, policy_version 1600661 (0.0005) [2023-12-26 12:22:33,997][123091] Updated weights for policy 0, policy_version 1600671 (0.0005) [2023-12-26 12:22:34,054][123091] Updated weights for policy 0, policy_version 1600681 (0.0005) [2023-12-26 12:22:34,205][123090] Updated weights for policy 1, policy_version 1589991 (0.0010) [2023-12-26 12:22:34,274][123090] Updated weights for policy 1, policy_version 1590001 (0.0006) [2023-12-26 12:22:34,339][123090] Updated weights for policy 1, policy_version 1590011 (0.0007) [2023-12-26 12:22:34,747][123091] Updated weights for policy 0, policy_version 1600691 (0.0006) [2023-12-26 12:22:34,807][123091] Updated weights for policy 0, policy_version 1600701 (0.0006) [2023-12-26 12:22:34,872][123091] Updated weights for policy 0, policy_version 1600711 (0.0009) [2023-12-26 12:22:35,149][123090] Updated weights for policy 1, policy_version 1590021 (0.0009) [2023-12-26 12:22:35,208][123090] Updated weights for policy 1, policy_version 1590031 (0.0010) [2023-12-26 12:22:35,261][123090] Updated weights for policy 1, policy_version 1590041 (0.0009) [2023-12-26 12:22:35,648][123091] Updated weights for policy 0, policy_version 1600721 (0.0010) [2023-12-26 12:22:35,701][123091] Updated weights for policy 0, policy_version 1600731 (0.0010) [2023-12-26 12:22:35,753][123091] Updated weights for policy 0, policy_version 1600741 (0.0010) [2023-12-26 12:22:35,804][123091] Updated weights for policy 0, policy_version 1600751 (0.0009) [2023-12-26 12:22:35,971][123090] Updated weights for policy 1, policy_version 1590051 (0.0010) [2023-12-26 12:22:36,019][123090] Updated weights for policy 1, policy_version 1590061 (0.0010) [2023-12-26 12:22:36,067][123090] Updated weights for policy 1, policy_version 1590071 (0.0010) [2023-12-26 12:22:36,696][123091] Updated weights for policy 0, policy_version 1600761 (0.0007) [2023-12-26 12:22:36,774][123091] Updated weights for policy 0, policy_version 1600771 (0.0009) [2023-12-26 12:22:36,844][123091] Updated weights for policy 0, policy_version 1600781 (0.0009) [2023-12-26 12:22:36,880][123090] Updated weights for policy 1, policy_version 1590081 (0.0009) [2023-12-26 12:22:36,940][123090] Updated weights for policy 1, policy_version 1590091 (0.0009) [2023-12-26 12:22:37,004][123090] Updated weights for policy 1, policy_version 1590101 (0.0009) [2023-12-26 12:22:37,067][123090] Updated weights for policy 1, policy_version 1590111 (0.0009) [2023-12-26 12:22:37,648][123091] Updated weights for policy 0, policy_version 1600791 (0.0010) [2023-12-26 12:22:37,701][123091] Updated weights for policy 0, policy_version 1600801 (0.0010) [2023-12-26 12:22:37,759][123091] Updated weights for policy 0, policy_version 1600811 (0.0009) [2023-12-26 12:22:37,913][123090] Updated weights for policy 1, policy_version 1590121 (0.0010) [2023-12-26 12:22:37,961][123090] Updated weights for policy 1, policy_version 1590131 (0.0010) [2023-12-26 12:22:38,017][123090] Updated weights for policy 1, policy_version 1590141 (0.0005) [2023-12-26 12:22:38,593][123091] Updated weights for policy 0, policy_version 1600821 (0.0007) [2023-12-26 12:22:38,667][123091] Updated weights for policy 0, policy_version 1600831 (0.0006) [2023-12-26 12:22:38,716][123090] Updated weights for policy 1, policy_version 1590151 (0.0006) [2023-12-26 12:22:38,740][123091] Updated weights for policy 0, policy_version 1600841 (0.0006) [2023-12-26 12:22:38,782][123090] Updated weights for policy 1, policy_version 1590161 (0.0005) [2023-12-26 12:22:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 816898048. Throughput: 0: 9240.1, 1: 8656.9. Samples: 816875156. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:38,785][121949] Avg episode reward: [(0, '6227.689'), (1, '5528.755')] [2023-12-26 12:22:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001600848_409821184.pth... [2023-12-26 12:22:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001599760_409542656.pth [2023-12-26 12:22:38,860][123090] Updated weights for policy 1, policy_version 1590171 (0.0005) [2023-12-26 12:22:38,898][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001590176_407085056.pth... [2023-12-26 12:22:38,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001589152_406822912.pth [2023-12-26 12:22:39,452][123090] Updated weights for policy 1, policy_version 1590181 (0.0007) [2023-12-26 12:22:39,470][123091] Updated weights for policy 0, policy_version 1600851 (0.0006) [2023-12-26 12:22:39,512][123090] Updated weights for policy 1, policy_version 1590191 (0.0008) [2023-12-26 12:22:39,532][123091] Updated weights for policy 0, policy_version 1600861 (0.0009) [2023-12-26 12:22:39,575][123090] Updated weights for policy 1, policy_version 1590201 (0.0008) [2023-12-26 12:22:39,586][123091] Updated weights for policy 0, policy_version 1600871 (0.0007) [2023-12-26 12:22:40,378][123090] Updated weights for policy 1, policy_version 1590211 (0.0009) [2023-12-26 12:22:40,442][123090] Updated weights for policy 1, policy_version 1590221 (0.0009) [2023-12-26 12:22:40,457][123091] Updated weights for policy 0, policy_version 1600881 (0.0007) [2023-12-26 12:22:40,507][123090] Updated weights for policy 1, policy_version 1590231 (0.0009) [2023-12-26 12:22:40,511][123091] Updated weights for policy 0, policy_version 1600891 (0.0009) [2023-12-26 12:22:40,565][123091] Updated weights for policy 0, policy_version 1600901 (0.0010) [2023-12-26 12:22:40,617][123091] Updated weights for policy 0, policy_version 1600911 (0.0010) [2023-12-26 12:22:41,322][123090] Updated weights for policy 1, policy_version 1590241 (0.0008) [2023-12-26 12:22:41,394][123090] Updated weights for policy 1, policy_version 1590251 (0.0009) [2023-12-26 12:22:41,449][123090] Updated weights for policy 1, policy_version 1590261 (0.0009) [2023-12-26 12:22:41,496][123091] Updated weights for policy 0, policy_version 1600921 (0.0008) [2023-12-26 12:22:41,508][123090] Updated weights for policy 1, policy_version 1590271 (0.0007) [2023-12-26 12:22:41,563][123091] Updated weights for policy 0, policy_version 1600931 (0.0008) [2023-12-26 12:22:41,637][123091] Updated weights for policy 0, policy_version 1600941 (0.0008) [2023-12-26 12:22:42,335][123090] Updated weights for policy 1, policy_version 1590281 (0.0010) [2023-12-26 12:22:42,407][123090] Updated weights for policy 1, policy_version 1590291 (0.0010) [2023-12-26 12:22:42,450][123091] Updated weights for policy 0, policy_version 1600951 (0.0009) [2023-12-26 12:22:42,465][123090] Updated weights for policy 1, policy_version 1590301 (0.0008) [2023-12-26 12:22:42,510][123091] Updated weights for policy 0, policy_version 1600961 (0.0008) [2023-12-26 12:22:42,578][123091] Updated weights for policy 0, policy_version 1600971 (0.0009) [2023-12-26 12:22:43,246][123090] Updated weights for policy 1, policy_version 1590311 (0.0009) [2023-12-26 12:22:43,299][123090] Updated weights for policy 1, policy_version 1590321 (0.0009) [2023-12-26 12:22:43,346][123090] Updated weights for policy 1, policy_version 1590331 (0.0008) [2023-12-26 12:22:43,439][123091] Updated weights for policy 0, policy_version 1600981 (0.0009) [2023-12-26 12:22:43,496][123091] Updated weights for policy 0, policy_version 1600992 (0.0010) [2023-12-26 12:22:43,550][123091] Updated weights for policy 0, policy_version 1601002 (0.0010) [2023-12-26 12:22:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 816988160. Throughput: 0: 9142.3, 1: 8673.4. Samples: 816979460. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:43,785][121949] Avg episode reward: [(0, '6318.244'), (1, '5397.858')] [2023-12-26 12:22:44,084][123090] Updated weights for policy 1, policy_version 1590341 (0.0005) [2023-12-26 12:22:44,134][123090] Updated weights for policy 1, policy_version 1590351 (0.0008) [2023-12-26 12:22:44,183][123090] Updated weights for policy 1, policy_version 1590361 (0.0008) [2023-12-26 12:22:44,266][123091] Updated weights for policy 0, policy_version 1601012 (0.0007) [2023-12-26 12:22:44,315][123091] Updated weights for policy 0, policy_version 1601022 (0.0009) [2023-12-26 12:22:44,364][123091] Updated weights for policy 0, policy_version 1601032 (0.0009) [2023-12-26 12:22:44,881][123090] Updated weights for policy 1, policy_version 1590371 (0.0008) [2023-12-26 12:22:44,960][123090] Updated weights for policy 1, policy_version 1590381 (0.0006) [2023-12-26 12:22:45,038][123090] Updated weights for policy 1, policy_version 1590391 (0.0006) [2023-12-26 12:22:45,101][123091] Updated weights for policy 0, policy_version 1601042 (0.0009) [2023-12-26 12:22:45,172][123091] Updated weights for policy 0, policy_version 1601052 (0.0011) [2023-12-26 12:22:45,248][123091] Updated weights for policy 0, policy_version 1601062 (0.0011) [2023-12-26 12:22:45,320][123091] Updated weights for policy 0, policy_version 1601072 (0.0011) [2023-12-26 12:22:45,723][123090] Updated weights for policy 1, policy_version 1590401 (0.0006) [2023-12-26 12:22:45,783][123090] Updated weights for policy 1, policy_version 1590411 (0.0007) [2023-12-26 12:22:45,862][123090] Updated weights for policy 1, policy_version 1590421 (0.0008) [2023-12-26 12:22:45,931][123090] Updated weights for policy 1, policy_version 1590431 (0.0010) [2023-12-26 12:22:46,129][123091] Updated weights for policy 0, policy_version 1601082 (0.0011) [2023-12-26 12:22:46,184][123091] Updated weights for policy 0, policy_version 1601092 (0.0010) [2023-12-26 12:22:46,236][123091] Updated weights for policy 0, policy_version 1601102 (0.0011) [2023-12-26 12:22:46,692][123090] Updated weights for policy 1, policy_version 1590441 (0.0009) [2023-12-26 12:22:46,739][123090] Updated weights for policy 1, policy_version 1590451 (0.0010) [2023-12-26 12:22:46,794][123090] Updated weights for policy 1, policy_version 1590461 (0.0010) [2023-12-26 12:22:47,072][123091] Updated weights for policy 0, policy_version 1601112 (0.0008) [2023-12-26 12:22:47,144][123091] Updated weights for policy 0, policy_version 1601122 (0.0005) [2023-12-26 12:22:47,219][123091] Updated weights for policy 0, policy_version 1601132 (0.0005) [2023-12-26 12:22:47,654][123090] Updated weights for policy 1, policy_version 1590471 (0.0009) [2023-12-26 12:22:47,702][123090] Updated weights for policy 1, policy_version 1590481 (0.0009) [2023-12-26 12:22:47,772][123090] Updated weights for policy 1, policy_version 1590491 (0.0010) [2023-12-26 12:22:47,913][123091] Updated weights for policy 0, policy_version 1601142 (0.0010) [2023-12-26 12:22:47,976][123091] Updated weights for policy 0, policy_version 1601152 (0.0009) [2023-12-26 12:22:48,029][123091] Updated weights for policy 0, policy_version 1601162 (0.0009) [2023-12-26 12:22:48,598][123090] Updated weights for policy 1, policy_version 1590501 (0.0009) [2023-12-26 12:22:48,654][123090] Updated weights for policy 1, policy_version 1590511 (0.0009) [2023-12-26 12:22:48,721][123090] Updated weights for policy 1, policy_version 1590521 (0.0009) [2023-12-26 12:22:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 817078272. Throughput: 0: 9142.5, 1: 8739.4. Samples: 817088600. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:48,785][121949] Avg episode reward: [(0, '6224.162'), (1, '5155.816')] [2023-12-26 12:22:48,866][123091] Updated weights for policy 0, policy_version 1601172 (0.0009) [2023-12-26 12:22:48,927][123091] Updated weights for policy 0, policy_version 1601182 (0.0009) [2023-12-26 12:22:48,998][123091] Updated weights for policy 0, policy_version 1601192 (0.0010) [2023-12-26 12:22:49,564][123090] Updated weights for policy 1, policy_version 1590531 (0.0009) [2023-12-26 12:22:49,632][123090] Updated weights for policy 1, policy_version 1590541 (0.0010) [2023-12-26 12:22:49,692][123090] Updated weights for policy 1, policy_version 1590551 (0.0010) [2023-12-26 12:22:49,855][123091] Updated weights for policy 0, policy_version 1601202 (0.0009) [2023-12-26 12:22:49,920][123091] Updated weights for policy 0, policy_version 1601212 (0.0008) [2023-12-26 12:22:49,990][123091] Updated weights for policy 0, policy_version 1601222 (0.0008) [2023-12-26 12:22:50,050][123091] Updated weights for policy 0, policy_version 1601232 (0.0010) [2023-12-26 12:22:50,415][123090] Updated weights for policy 1, policy_version 1590561 (0.0009) [2023-12-26 12:22:50,466][123090] Updated weights for policy 1, policy_version 1590571 (0.0009) [2023-12-26 12:22:50,530][123090] Updated weights for policy 1, policy_version 1590581 (0.0005) [2023-12-26 12:22:50,595][123090] Updated weights for policy 1, policy_version 1590591 (0.0008) [2023-12-26 12:22:50,930][123091] Updated weights for policy 0, policy_version 1601242 (0.0009) [2023-12-26 12:22:50,991][123091] Updated weights for policy 0, policy_version 1601252 (0.0009) [2023-12-26 12:22:51,063][123091] Updated weights for policy 0, policy_version 1601262 (0.0010) [2023-12-26 12:22:51,423][123090] Updated weights for policy 1, policy_version 1590601 (0.0009) [2023-12-26 12:22:51,479][123090] Updated weights for policy 1, policy_version 1590611 (0.0010) [2023-12-26 12:22:51,549][123090] Updated weights for policy 1, policy_version 1590621 (0.0009) [2023-12-26 12:22:51,900][123091] Updated weights for policy 0, policy_version 1601272 (0.0009) [2023-12-26 12:22:51,965][123091] Updated weights for policy 0, policy_version 1601282 (0.0006) [2023-12-26 12:22:52,022][123091] Updated weights for policy 0, policy_version 1601292 (0.0006) [2023-12-26 12:22:52,324][123090] Updated weights for policy 1, policy_version 1590631 (0.0010) [2023-12-26 12:22:52,386][123090] Updated weights for policy 1, policy_version 1590641 (0.0011) [2023-12-26 12:22:52,446][123090] Updated weights for policy 1, policy_version 1590651 (0.0009) [2023-12-26 12:22:52,797][123091] Updated weights for policy 0, policy_version 1601302 (0.0008) [2023-12-26 12:22:52,854][123091] Updated weights for policy 0, policy_version 1601312 (0.0010) [2023-12-26 12:22:52,906][123091] Updated weights for policy 0, policy_version 1601323 (0.0010) [2023-12-26 12:22:53,266][123090] Updated weights for policy 1, policy_version 1590661 (0.0008) [2023-12-26 12:22:53,313][123090] Updated weights for policy 1, policy_version 1590671 (0.0010) [2023-12-26 12:22:53,368][123090] Updated weights for policy 1, policy_version 1590681 (0.0010) [2023-12-26 12:22:53,780][123091] Updated weights for policy 0, policy_version 1601333 (0.0010) [2023-12-26 12:22:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 817160192. Throughput: 0: 9044.6, 1: 8717.6. Samples: 817138608. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:53,785][121949] Avg episode reward: [(0, '6264.181'), (1, '5262.129')] [2023-12-26 12:22:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001590688_407216128.pth... [2023-12-26 12:22:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001589664_406953984.pth [2023-12-26 12:22:53,842][123091] Updated weights for policy 0, policy_version 1601343 (0.0010) [2023-12-26 12:22:53,900][123091] Updated weights for policy 0, policy_version 1601353 (0.0010) [2023-12-26 12:22:53,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001601360_409952256.pth... [2023-12-26 12:22:53,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001600304_409681920.pth [2023-12-26 12:22:54,066][123090] Updated weights for policy 1, policy_version 1590691 (0.0009) [2023-12-26 12:22:54,136][123090] Updated weights for policy 1, policy_version 1590701 (0.0006) [2023-12-26 12:22:54,206][123090] Updated weights for policy 1, policy_version 1590711 (0.0006) [2023-12-26 12:22:54,698][123091] Updated weights for policy 0, policy_version 1601363 (0.0009) [2023-12-26 12:22:54,766][123091] Updated weights for policy 0, policy_version 1601373 (0.0005) [2023-12-26 12:22:54,821][123091] Updated weights for policy 0, policy_version 1601383 (0.0005) [2023-12-26 12:22:55,044][123090] Updated weights for policy 1, policy_version 1590721 (0.0007) [2023-12-26 12:22:55,101][123090] Updated weights for policy 1, policy_version 1590731 (0.0009) [2023-12-26 12:22:55,154][123090] Updated weights for policy 1, policy_version 1590741 (0.0010) [2023-12-26 12:22:55,211][123090] Updated weights for policy 1, policy_version 1590751 (0.0009) [2023-12-26 12:22:55,441][123091] Updated weights for policy 0, policy_version 1601393 (0.0005) [2023-12-26 12:22:55,505][123091] Updated weights for policy 0, policy_version 1601403 (0.0006) [2023-12-26 12:22:55,568][123091] Updated weights for policy 0, policy_version 1601413 (0.0005) [2023-12-26 12:22:55,635][123091] Updated weights for policy 0, policy_version 1601423 (0.0005) [2023-12-26 12:22:56,052][123090] Updated weights for policy 1, policy_version 1590761 (0.0010) [2023-12-26 12:22:56,107][123090] Updated weights for policy 1, policy_version 1590772 (0.0010) [2023-12-26 12:22:56,162][123090] Updated weights for policy 1, policy_version 1590784 (0.0010) [2023-12-26 12:22:56,314][123091] Updated weights for policy 0, policy_version 1601433 (0.0005) [2023-12-26 12:22:56,376][123091] Updated weights for policy 0, policy_version 1601443 (0.0005) [2023-12-26 12:22:56,437][123091] Updated weights for policy 0, policy_version 1601453 (0.0005) [2023-12-26 12:22:57,080][123091] Updated weights for policy 0, policy_version 1601463 (0.0007) [2023-12-26 12:22:57,111][123090] Updated weights for policy 1, policy_version 1590794 (0.0005) [2023-12-26 12:22:57,144][123091] Updated weights for policy 0, policy_version 1601473 (0.0005) [2023-12-26 12:22:57,164][123090] Updated weights for policy 1, policy_version 1590804 (0.0005) [2023-12-26 12:22:57,196][123091] Updated weights for policy 0, policy_version 1601483 (0.0006) [2023-12-26 12:22:57,216][123090] Updated weights for policy 1, policy_version 1590814 (0.0005) [2023-12-26 12:22:57,775][123091] Updated weights for policy 0, policy_version 1601493 (0.0006) [2023-12-26 12:22:57,831][123091] Updated weights for policy 0, policy_version 1601503 (0.0006) [2023-12-26 12:22:57,895][123091] Updated weights for policy 0, policy_version 1601513 (0.0006) [2023-12-26 12:22:58,080][123090] Updated weights for policy 1, policy_version 1590824 (0.0009) [2023-12-26 12:22:58,145][123090] Updated weights for policy 1, policy_version 1590834 (0.0010) [2023-12-26 12:22:58,202][123090] Updated weights for policy 1, policy_version 1590844 (0.0009) [2023-12-26 12:22:58,615][123091] Updated weights for policy 0, policy_version 1601523 (0.0007) [2023-12-26 12:22:58,692][123091] Updated weights for policy 0, policy_version 1601533 (0.0008) [2023-12-26 12:22:58,765][123091] Updated weights for policy 0, policy_version 1601543 (0.0011) [2023-12-26 12:22:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 817250304. Throughput: 0: 9197.8, 1: 8744.2. Samples: 817248908. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:22:58,785][121949] Avg episode reward: [(0, '6178.822'), (1, '5582.027')] [2023-12-26 12:22:59,135][123090] Updated weights for policy 1, policy_version 1590854 (0.0010) [2023-12-26 12:22:59,195][123090] Updated weights for policy 1, policy_version 1590864 (0.0009) [2023-12-26 12:22:59,261][123090] Updated weights for policy 1, policy_version 1590874 (0.0009) [2023-12-26 12:22:59,654][123091] Updated weights for policy 0, policy_version 1601553 (0.0010) [2023-12-26 12:22:59,706][123091] Updated weights for policy 0, policy_version 1601563 (0.0010) [2023-12-26 12:22:59,767][123091] Updated weights for policy 0, policy_version 1601573 (0.0009) [2023-12-26 12:22:59,829][123091] Updated weights for policy 0, policy_version 1601583 (0.0009) [2023-12-26 12:23:00,048][123090] Updated weights for policy 1, policy_version 1590884 (0.0010) [2023-12-26 12:23:00,115][123090] Updated weights for policy 1, policy_version 1590894 (0.0009) [2023-12-26 12:23:00,190][123090] Updated weights for policy 1, policy_version 1590904 (0.0010) [2023-12-26 12:23:00,599][123091] Updated weights for policy 0, policy_version 1601593 (0.0007) [2023-12-26 12:23:00,662][123091] Updated weights for policy 0, policy_version 1601604 (0.0009) [2023-12-26 12:23:00,712][123091] Updated weights for policy 0, policy_version 1601614 (0.0008) [2023-12-26 12:23:00,933][123090] Updated weights for policy 1, policy_version 1590914 (0.0009) [2023-12-26 12:23:00,989][123090] Updated weights for policy 1, policy_version 1590924 (0.0006) [2023-12-26 12:23:01,049][123090] Updated weights for policy 1, policy_version 1590934 (0.0007) [2023-12-26 12:23:01,121][123090] Updated weights for policy 1, policy_version 1590944 (0.0010) [2023-12-26 12:23:01,616][123091] Updated weights for policy 0, policy_version 1601624 (0.0007) [2023-12-26 12:23:01,684][123091] Updated weights for policy 0, policy_version 1601634 (0.0006) [2023-12-26 12:23:01,749][123091] Updated weights for policy 0, policy_version 1601644 (0.0009) [2023-12-26 12:23:01,952][123090] Updated weights for policy 1, policy_version 1590954 (0.0010) [2023-12-26 12:23:02,011][123090] Updated weights for policy 1, policy_version 1590964 (0.0007) [2023-12-26 12:23:02,082][123090] Updated weights for policy 1, policy_version 1590974 (0.0006) [2023-12-26 12:23:02,516][123091] Updated weights for policy 0, policy_version 1601654 (0.0009) [2023-12-26 12:23:02,586][123091] Updated weights for policy 0, policy_version 1601664 (0.0011) [2023-12-26 12:23:02,656][123091] Updated weights for policy 0, policy_version 1601674 (0.0011) [2023-12-26 12:23:02,781][123090] Updated weights for policy 1, policy_version 1590984 (0.0007) [2023-12-26 12:23:02,847][123090] Updated weights for policy 1, policy_version 1590994 (0.0009) [2023-12-26 12:23:02,907][123090] Updated weights for policy 1, policy_version 1591004 (0.0009) [2023-12-26 12:23:03,405][123091] Updated weights for policy 0, policy_version 1601684 (0.0008) [2023-12-26 12:23:03,471][123091] Updated weights for policy 0, policy_version 1601694 (0.0006) [2023-12-26 12:23:03,534][123091] Updated weights for policy 0, policy_version 1601704 (0.0011) [2023-12-26 12:23:03,614][123090] Updated weights for policy 1, policy_version 1591014 (0.0009) [2023-12-26 12:23:03,677][123090] Updated weights for policy 1, policy_version 1591024 (0.0007) [2023-12-26 12:23:03,734][123090] Updated weights for policy 1, policy_version 1591034 (0.0007) [2023-12-26 12:23:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 817348608. Throughput: 0: 9090.0, 1: 8664.7. Samples: 817354700. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:03,785][121949] Avg episode reward: [(0, '6184.350'), (1, '5610.960')] [2023-12-26 12:23:04,195][123091] Updated weights for policy 0, policy_version 1601714 (0.0010) [2023-12-26 12:23:04,266][123091] Updated weights for policy 0, policy_version 1601724 (0.0011) [2023-12-26 12:23:04,334][123091] Updated weights for policy 0, policy_version 1601734 (0.0011) [2023-12-26 12:23:04,409][123091] Updated weights for policy 0, policy_version 1601744 (0.0011) [2023-12-26 12:23:04,472][123090] Updated weights for policy 1, policy_version 1591044 (0.0006) [2023-12-26 12:23:04,525][123090] Updated weights for policy 1, policy_version 1591054 (0.0008) [2023-12-26 12:23:04,590][123090] Updated weights for policy 1, policy_version 1591064 (0.0008) [2023-12-26 12:23:05,204][123091] Updated weights for policy 0, policy_version 1601754 (0.0009) [2023-12-26 12:23:05,251][123091] Updated weights for policy 0, policy_version 1601764 (0.0010) [2023-12-26 12:23:05,299][123091] Updated weights for policy 0, policy_version 1601774 (0.0010) [2023-12-26 12:23:05,374][123090] Updated weights for policy 1, policy_version 1591074 (0.0008) [2023-12-26 12:23:05,446][123090] Updated weights for policy 1, policy_version 1591084 (0.0005) [2023-12-26 12:23:05,523][123090] Updated weights for policy 1, policy_version 1591094 (0.0006) [2023-12-26 12:23:05,569][123090] Updated weights for policy 1, policy_version 1591104 (0.0006) [2023-12-26 12:23:06,052][123091] Updated weights for policy 0, policy_version 1601784 (0.0007) [2023-12-26 12:23:06,109][123091] Updated weights for policy 0, policy_version 1601794 (0.0007) [2023-12-26 12:23:06,171][123091] Updated weights for policy 0, policy_version 1601804 (0.0007) [2023-12-26 12:23:06,196][123090] Updated weights for policy 1, policy_version 1591114 (0.0008) [2023-12-26 12:23:06,263][123090] Updated weights for policy 1, policy_version 1591124 (0.0008) [2023-12-26 12:23:06,330][123090] Updated weights for policy 1, policy_version 1591134 (0.0008) [2023-12-26 12:23:06,942][123091] Updated weights for policy 0, policy_version 1601814 (0.0006) [2023-12-26 12:23:07,000][123091] Updated weights for policy 0, policy_version 1601824 (0.0005) [2023-12-26 12:23:07,061][123091] Updated weights for policy 0, policy_version 1601834 (0.0006) [2023-12-26 12:23:07,104][123090] Updated weights for policy 1, policy_version 1591144 (0.0006) [2023-12-26 12:23:07,151][123090] Updated weights for policy 1, policy_version 1591154 (0.0005) [2023-12-26 12:23:07,199][123090] Updated weights for policy 1, policy_version 1591164 (0.0005) [2023-12-26 12:23:07,754][123091] Updated weights for policy 0, policy_version 1601844 (0.0008) [2023-12-26 12:23:07,806][123091] Updated weights for policy 0, policy_version 1601854 (0.0008) [2023-12-26 12:23:07,862][123091] Updated weights for policy 0, policy_version 1601864 (0.0009) [2023-12-26 12:23:07,999][123090] Updated weights for policy 1, policy_version 1591174 (0.0008) [2023-12-26 12:23:08,049][123090] Updated weights for policy 1, policy_version 1591184 (0.0006) [2023-12-26 12:23:08,097][123090] Updated weights for policy 1, policy_version 1591194 (0.0005) [2023-12-26 12:23:08,590][123091] Updated weights for policy 0, policy_version 1601874 (0.0006) [2023-12-26 12:23:08,644][123091] Updated weights for policy 0, policy_version 1601884 (0.0005) [2023-12-26 12:23:08,696][123091] Updated weights for policy 0, policy_version 1601894 (0.0005) [2023-12-26 12:23:08,755][123091] Updated weights for policy 0, policy_version 1601904 (0.0006) [2023-12-26 12:23:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 817438720. Throughput: 0: 9141.2, 1: 8740.2. Samples: 817410896. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:08,785][121949] Avg episode reward: [(0, '6334.078'), (1, '5731.564')] [2023-12-26 12:23:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001601904_410091520.pth... [2023-12-26 12:23:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001591200_407347200.pth... [2023-12-26 12:23:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001600848_409821184.pth [2023-12-26 12:23:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001590176_407085056.pth [2023-12-26 12:23:08,836][123090] Updated weights for policy 1, policy_version 1591204 (0.0005) [2023-12-26 12:23:08,896][123090] Updated weights for policy 1, policy_version 1591214 (0.0008) [2023-12-26 12:23:08,945][123090] Updated weights for policy 1, policy_version 1591224 (0.0008) [2023-12-26 12:23:09,522][123091] Updated weights for policy 0, policy_version 1601914 (0.0011) [2023-12-26 12:23:09,597][123091] Updated weights for policy 0, policy_version 1601924 (0.0011) [2023-12-26 12:23:09,671][123091] Updated weights for policy 0, policy_version 1601934 (0.0011) [2023-12-26 12:23:09,799][123090] Updated weights for policy 1, policy_version 1591234 (0.0009) [2023-12-26 12:23:09,866][123090] Updated weights for policy 1, policy_version 1591244 (0.0010) [2023-12-26 12:23:09,920][123090] Updated weights for policy 1, policy_version 1591254 (0.0007) [2023-12-26 12:23:09,984][123090] Updated weights for policy 1, policy_version 1591264 (0.0008) [2023-12-26 12:23:10,476][123091] Updated weights for policy 0, policy_version 1601944 (0.0010) [2023-12-26 12:23:10,544][123091] Updated weights for policy 0, policy_version 1601954 (0.0009) [2023-12-26 12:23:10,598][123091] Updated weights for policy 0, policy_version 1601964 (0.0010) [2023-12-26 12:23:10,830][123090] Updated weights for policy 1, policy_version 1591274 (0.0009) [2023-12-26 12:23:10,892][123090] Updated weights for policy 1, policy_version 1591284 (0.0010) [2023-12-26 12:23:10,949][123090] Updated weights for policy 1, policy_version 1591294 (0.0009) [2023-12-26 12:23:11,467][123091] Updated weights for policy 0, policy_version 1601974 (0.0009) [2023-12-26 12:23:11,521][123091] Updated weights for policy 0, policy_version 1601984 (0.0010) [2023-12-26 12:23:11,572][123091] Updated weights for policy 0, policy_version 1601994 (0.0009) [2023-12-26 12:23:11,825][123090] Updated weights for policy 1, policy_version 1591304 (0.0009) [2023-12-26 12:23:11,877][123090] Updated weights for policy 1, policy_version 1591314 (0.0009) [2023-12-26 12:23:11,929][123090] Updated weights for policy 1, policy_version 1591324 (0.0009) [2023-12-26 12:23:12,432][123091] Updated weights for policy 0, policy_version 1602004 (0.0009) [2023-12-26 12:23:12,487][123091] Updated weights for policy 0, policy_version 1602014 (0.0009) [2023-12-26 12:23:12,539][123091] Updated weights for policy 0, policy_version 1602024 (0.0009) [2023-12-26 12:23:12,779][123090] Updated weights for policy 1, policy_version 1591334 (0.0009) [2023-12-26 12:23:12,853][123090] Updated weights for policy 1, policy_version 1591344 (0.0010) [2023-12-26 12:23:12,921][123090] Updated weights for policy 1, policy_version 1591354 (0.0010) [2023-12-26 12:23:13,412][123091] Updated weights for policy 0, policy_version 1602034 (0.0009) [2023-12-26 12:23:13,463][123091] Updated weights for policy 0, policy_version 1602044 (0.0010) [2023-12-26 12:23:13,514][123091] Updated weights for policy 0, policy_version 1602054 (0.0010) [2023-12-26 12:23:13,563][123091] Updated weights for policy 0, policy_version 1602064 (0.0009) [2023-12-26 12:23:13,718][123090] Updated weights for policy 1, policy_version 1591364 (0.0010) [2023-12-26 12:23:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 817520640. Throughput: 0: 9029.0, 1: 8812.6. Samples: 817517408. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:13,785][121949] Avg episode reward: [(0, '6277.506'), (1, '5616.354')] [2023-12-26 12:23:13,791][123090] Updated weights for policy 1, policy_version 1591374 (0.0010) [2023-12-26 12:23:13,846][123090] Updated weights for policy 1, policy_version 1591384 (0.0010) [2023-12-26 12:23:14,421][123091] Updated weights for policy 0, policy_version 1602074 (0.0010) [2023-12-26 12:23:14,483][123091] Updated weights for policy 0, policy_version 1602084 (0.0010) [2023-12-26 12:23:14,540][123091] Updated weights for policy 0, policy_version 1602094 (0.0010) [2023-12-26 12:23:14,602][123090] Updated weights for policy 1, policy_version 1591394 (0.0009) [2023-12-26 12:23:14,649][123090] Updated weights for policy 1, policy_version 1591404 (0.0005) [2023-12-26 12:23:14,695][123090] Updated weights for policy 1, policy_version 1591414 (0.0005) [2023-12-26 12:23:14,749][123090] Updated weights for policy 1, policy_version 1591424 (0.0005) [2023-12-26 12:23:15,441][123091] Updated weights for policy 0, policy_version 1602104 (0.0010) [2023-12-26 12:23:15,449][123090] Updated weights for policy 1, policy_version 1591434 (0.0005) [2023-12-26 12:23:15,489][123091] Updated weights for policy 0, policy_version 1602114 (0.0010) [2023-12-26 12:23:15,496][123090] Updated weights for policy 1, policy_version 1591444 (0.0005) [2023-12-26 12:23:15,545][123090] Updated weights for policy 1, policy_version 1591454 (0.0006) [2023-12-26 12:23:15,552][123091] Updated weights for policy 0, policy_version 1602124 (0.0010) [2023-12-26 12:23:16,220][123090] Updated weights for policy 1, policy_version 1591464 (0.0009) [2023-12-26 12:23:16,272][123090] Updated weights for policy 1, policy_version 1591474 (0.0010) [2023-12-26 12:23:16,295][123091] Updated weights for policy 0, policy_version 1602134 (0.0008) [2023-12-26 12:23:16,334][123090] Updated weights for policy 1, policy_version 1591484 (0.0010) [2023-12-26 12:23:16,350][123091] Updated weights for policy 0, policy_version 1602144 (0.0009) [2023-12-26 12:23:16,409][123091] Updated weights for policy 0, policy_version 1602154 (0.0010) [2023-12-26 12:23:16,966][123090] Updated weights for policy 1, policy_version 1591494 (0.0010) [2023-12-26 12:23:17,025][123090] Updated weights for policy 1, policy_version 1591504 (0.0010) [2023-12-26 12:23:17,076][123090] Updated weights for policy 1, policy_version 1591514 (0.0010) [2023-12-26 12:23:17,212][123091] Updated weights for policy 0, policy_version 1602164 (0.0008) [2023-12-26 12:23:17,282][123091] Updated weights for policy 0, policy_version 1602174 (0.0005) [2023-12-26 12:23:17,351][123091] Updated weights for policy 0, policy_version 1602184 (0.0005) [2023-12-26 12:23:17,909][123090] Updated weights for policy 1, policy_version 1591524 (0.0010) [2023-12-26 12:23:17,923][123091] Updated weights for policy 0, policy_version 1602194 (0.0007) [2023-12-26 12:23:17,968][123090] Updated weights for policy 1, policy_version 1591534 (0.0010) [2023-12-26 12:23:17,983][123091] Updated weights for policy 0, policy_version 1602204 (0.0007) [2023-12-26 12:23:18,023][123090] Updated weights for policy 1, policy_version 1591544 (0.0010) [2023-12-26 12:23:18,047][123091] Updated weights for policy 0, policy_version 1602214 (0.0006) [2023-12-26 12:23:18,110][123091] Updated weights for policy 0, policy_version 1602224 (0.0008) [2023-12-26 12:23:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 817610752. Throughput: 0: 8937.3, 1: 8945.2. Samples: 817625824. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:18,785][121949] Avg episode reward: [(0, '6238.021'), (1, '5351.986')] [2023-12-26 12:23:18,860][123090] Updated weights for policy 1, policy_version 1591554 (0.0010) [2023-12-26 12:23:18,883][123091] Updated weights for policy 0, policy_version 1602234 (0.0006) [2023-12-26 12:23:18,928][123090] Updated weights for policy 1, policy_version 1591564 (0.0011) [2023-12-26 12:23:18,946][123091] Updated weights for policy 0, policy_version 1602244 (0.0009) [2023-12-26 12:23:18,991][123090] Updated weights for policy 1, policy_version 1591574 (0.0010) [2023-12-26 12:23:19,013][123091] Updated weights for policy 0, policy_version 1602254 (0.0011) [2023-12-26 12:23:19,050][123090] Updated weights for policy 1, policy_version 1591584 (0.0010) [2023-12-26 12:23:19,801][123091] Updated weights for policy 0, policy_version 1602264 (0.0007) [2023-12-26 12:23:19,872][123091] Updated weights for policy 0, policy_version 1602274 (0.0007) [2023-12-26 12:23:19,903][123090] Updated weights for policy 1, policy_version 1591594 (0.0010) [2023-12-26 12:23:19,932][123091] Updated weights for policy 0, policy_version 1602284 (0.0011) [2023-12-26 12:23:19,971][123090] Updated weights for policy 1, policy_version 1591604 (0.0008) [2023-12-26 12:23:20,039][123090] Updated weights for policy 1, policy_version 1591614 (0.0008) [2023-12-26 12:23:20,705][123091] Updated weights for policy 0, policy_version 1602294 (0.0011) [2023-12-26 12:23:20,758][123091] Updated weights for policy 0, policy_version 1602304 (0.0010) [2023-12-26 12:23:20,794][123090] Updated weights for policy 1, policy_version 1591624 (0.0006) [2023-12-26 12:23:20,820][123091] Updated weights for policy 0, policy_version 1602314 (0.0009) [2023-12-26 12:23:20,853][123090] Updated weights for policy 1, policy_version 1591634 (0.0005) [2023-12-26 12:23:20,920][123090] Updated weights for policy 1, policy_version 1591644 (0.0009) [2023-12-26 12:23:21,795][123090] Updated weights for policy 1, policy_version 1591654 (0.0007) [2023-12-26 12:23:21,813][123091] Updated weights for policy 0, policy_version 1602324 (0.0009) [2023-12-26 12:23:21,857][123090] Updated weights for policy 1, policy_version 1591664 (0.0006) [2023-12-26 12:23:21,877][123091] Updated weights for policy 0, policy_version 1602334 (0.0010) [2023-12-26 12:23:21,927][123090] Updated weights for policy 1, policy_version 1591674 (0.0006) [2023-12-26 12:23:21,937][123091] Updated weights for policy 0, policy_version 1602344 (0.0008) [2023-12-26 12:23:22,691][123090] Updated weights for policy 1, policy_version 1591684 (0.0006) [2023-12-26 12:23:22,757][123090] Updated weights for policy 1, policy_version 1591694 (0.0006) [2023-12-26 12:23:22,812][123091] Updated weights for policy 0, policy_version 1602354 (0.0009) [2023-12-26 12:23:22,824][123090] Updated weights for policy 1, policy_version 1591704 (0.0006) [2023-12-26 12:23:22,870][123091] Updated weights for policy 0, policy_version 1602364 (0.0009) [2023-12-26 12:23:22,930][123091] Updated weights for policy 0, policy_version 1602374 (0.0010) [2023-12-26 12:23:22,994][123091] Updated weights for policy 0, policy_version 1602384 (0.0009) [2023-12-26 12:23:23,560][123090] Updated weights for policy 1, policy_version 1591714 (0.0005) [2023-12-26 12:23:23,612][123090] Updated weights for policy 1, policy_version 1591724 (0.0008) [2023-12-26 12:23:23,666][123090] Updated weights for policy 1, policy_version 1591734 (0.0009) [2023-12-26 12:23:23,728][123090] Updated weights for policy 1, policy_version 1591744 (0.0009) [2023-12-26 12:23:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 817700864. Throughput: 0: 8898.9, 1: 8930.5. Samples: 817677480. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:23,785][121949] Avg episode reward: [(0, '6347.718'), (1, '5694.621')] [2023-12-26 12:23:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001602384_410214400.pth... [2023-12-26 12:23:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001591744_407486464.pth... [2023-12-26 12:23:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001590688_407216128.pth [2023-12-26 12:23:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001601360_409952256.pth [2023-12-26 12:23:23,885][123091] Updated weights for policy 0, policy_version 1602394 (0.0009) [2023-12-26 12:23:23,936][123091] Updated weights for policy 0, policy_version 1602404 (0.0010) [2023-12-26 12:23:23,992][123091] Updated weights for policy 0, policy_version 1602414 (0.0010) [2023-12-26 12:23:24,559][123090] Updated weights for policy 1, policy_version 1591754 (0.0010) [2023-12-26 12:23:24,615][123090] Updated weights for policy 1, policy_version 1591764 (0.0010) [2023-12-26 12:23:24,663][123090] Updated weights for policy 1, policy_version 1591774 (0.0010) [2023-12-26 12:23:24,887][123091] Updated weights for policy 0, policy_version 1602424 (0.0009) [2023-12-26 12:23:24,951][123091] Updated weights for policy 0, policy_version 1602434 (0.0006) [2023-12-26 12:23:25,015][123091] Updated weights for policy 0, policy_version 1602444 (0.0005) [2023-12-26 12:23:25,508][123090] Updated weights for policy 1, policy_version 1591784 (0.0006) [2023-12-26 12:23:25,557][123090] Updated weights for policy 1, policy_version 1591794 (0.0006) [2023-12-26 12:23:25,608][123090] Updated weights for policy 1, policy_version 1591805 (0.0010) [2023-12-26 12:23:25,625][123091] Updated weights for policy 0, policy_version 1602454 (0.0006) [2023-12-26 12:23:25,679][123091] Updated weights for policy 0, policy_version 1602464 (0.0005) [2023-12-26 12:23:25,735][123091] Updated weights for policy 0, policy_version 1602474 (0.0005) [2023-12-26 12:23:26,361][123091] Updated weights for policy 0, policy_version 1602484 (0.0007) [2023-12-26 12:23:26,436][123091] Updated weights for policy 0, policy_version 1602494 (0.0005) [2023-12-26 12:23:26,488][123090] Updated weights for policy 1, policy_version 1591815 (0.0006) [2023-12-26 12:23:26,502][123091] Updated weights for policy 0, policy_version 1602504 (0.0005) [2023-12-26 12:23:26,556][123090] Updated weights for policy 1, policy_version 1591825 (0.0005) [2023-12-26 12:23:26,608][123090] Updated weights for policy 1, policy_version 1591835 (0.0005) [2023-12-26 12:23:27,171][123091] Updated weights for policy 0, policy_version 1602514 (0.0009) [2023-12-26 12:23:27,222][123091] Updated weights for policy 0, policy_version 1602524 (0.0009) [2023-12-26 12:23:27,268][123091] Updated weights for policy 0, policy_version 1602534 (0.0008) [2023-12-26 12:23:27,321][123091] Updated weights for policy 0, policy_version 1602544 (0.0009) [2023-12-26 12:23:27,373][123090] Updated weights for policy 1, policy_version 1591845 (0.0008) [2023-12-26 12:23:27,420][123090] Updated weights for policy 1, policy_version 1591855 (0.0010) [2023-12-26 12:23:27,468][123090] Updated weights for policy 1, policy_version 1591865 (0.0010) [2023-12-26 12:23:28,172][123091] Updated weights for policy 0, policy_version 1602554 (0.0008) [2023-12-26 12:23:28,231][123091] Updated weights for policy 0, policy_version 1602564 (0.0009) [2023-12-26 12:23:28,277][123091] Updated weights for policy 0, policy_version 1602574 (0.0008) [2023-12-26 12:23:28,297][123090] Updated weights for policy 1, policy_version 1591875 (0.0010) [2023-12-26 12:23:28,363][123090] Updated weights for policy 1, policy_version 1591885 (0.0009) [2023-12-26 12:23:28,433][123090] Updated weights for policy 1, policy_version 1591895 (0.0009) [2023-12-26 12:23:28,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 817790976. Throughput: 0: 8957.0, 1: 8935.3. Samples: 817784612. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:28,784][121949] Avg episode reward: [(0, '6401.870'), (1, '5869.688')] [2023-12-26 12:23:29,129][123091] Updated weights for policy 0, policy_version 1602584 (0.0009) [2023-12-26 12:23:29,184][123091] Updated weights for policy 0, policy_version 1602594 (0.0009) [2023-12-26 12:23:29,234][123090] Updated weights for policy 1, policy_version 1591905 (0.0011) [2023-12-26 12:23:29,238][123091] Updated weights for policy 0, policy_version 1602604 (0.0008) [2023-12-26 12:23:29,294][123090] Updated weights for policy 1, policy_version 1591915 (0.0010) [2023-12-26 12:23:29,361][123090] Updated weights for policy 1, policy_version 1591925 (0.0011) [2023-12-26 12:23:29,428][123090] Updated weights for policy 1, policy_version 1591935 (0.0011) [2023-12-26 12:23:30,093][123091] Updated weights for policy 0, policy_version 1602614 (0.0008) [2023-12-26 12:23:30,156][123091] Updated weights for policy 0, policy_version 1602624 (0.0009) [2023-12-26 12:23:30,218][123091] Updated weights for policy 0, policy_version 1602634 (0.0008) [2023-12-26 12:23:30,236][123090] Updated weights for policy 1, policy_version 1591945 (0.0010) [2023-12-26 12:23:30,299][123090] Updated weights for policy 1, policy_version 1591955 (0.0011) [2023-12-26 12:23:30,360][123090] Updated weights for policy 1, policy_version 1591965 (0.0010) [2023-12-26 12:23:31,050][123091] Updated weights for policy 0, policy_version 1602644 (0.0008) [2023-12-26 12:23:31,119][123091] Updated weights for policy 0, policy_version 1602654 (0.0009) [2023-12-26 12:23:31,181][123091] Updated weights for policy 0, policy_version 1602664 (0.0007) [2023-12-26 12:23:31,187][123090] Updated weights for policy 1, policy_version 1591975 (0.0010) [2023-12-26 12:23:31,253][123090] Updated weights for policy 1, policy_version 1591985 (0.0010) [2023-12-26 12:23:31,319][123090] Updated weights for policy 1, policy_version 1591995 (0.0010) [2023-12-26 12:23:32,017][123091] Updated weights for policy 0, policy_version 1602674 (0.0006) [2023-12-26 12:23:32,079][123091] Updated weights for policy 0, policy_version 1602684 (0.0009) [2023-12-26 12:23:32,136][123091] Updated weights for policy 0, policy_version 1602694 (0.0008) [2023-12-26 12:23:32,145][123090] Updated weights for policy 1, policy_version 1592005 (0.0010) [2023-12-26 12:23:32,198][123091] Updated weights for policy 0, policy_version 1602704 (0.0009) [2023-12-26 12:23:32,208][123090] Updated weights for policy 1, policy_version 1592015 (0.0010) [2023-12-26 12:23:32,274][123090] Updated weights for policy 1, policy_version 1592025 (0.0010) [2023-12-26 12:23:33,027][123091] Updated weights for policy 0, policy_version 1602714 (0.0009) [2023-12-26 12:23:33,078][123091] Updated weights for policy 0, policy_version 1602724 (0.0009) [2023-12-26 12:23:33,089][123090] Updated weights for policy 1, policy_version 1592035 (0.0010) [2023-12-26 12:23:33,126][123091] Updated weights for policy 0, policy_version 1602734 (0.0006) [2023-12-26 12:23:33,140][123090] Updated weights for policy 1, policy_version 1592045 (0.0010) [2023-12-26 12:23:33,195][123090] Updated weights for policy 1, policy_version 1592055 (0.0010) [2023-12-26 12:23:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 817872896. Throughput: 0: 8898.5, 1: 8838.1. Samples: 817886752. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:33,785][121949] Avg episode reward: [(0, '6255.315'), (1, '5689.091')] [2023-12-26 12:23:33,956][123091] Updated weights for policy 0, policy_version 1602744 (0.0009) [2023-12-26 12:23:34,010][123091] Updated weights for policy 0, policy_version 1602754 (0.0009) [2023-12-26 12:23:34,021][123090] Updated weights for policy 1, policy_version 1592065 (0.0010) [2023-12-26 12:23:34,069][123091] Updated weights for policy 0, policy_version 1602764 (0.0006) [2023-12-26 12:23:34,079][123090] Updated weights for policy 1, policy_version 1592075 (0.0010) [2023-12-26 12:23:34,134][123090] Updated weights for policy 1, policy_version 1592085 (0.0010) [2023-12-26 12:23:34,204][123090] Updated weights for policy 1, policy_version 1592095 (0.0012) [2023-12-26 12:23:34,766][123091] Updated weights for policy 0, policy_version 1602774 (0.0005) [2023-12-26 12:23:34,826][123091] Updated weights for policy 0, policy_version 1602784 (0.0005) [2023-12-26 12:23:34,880][123091] Updated weights for policy 0, policy_version 1602794 (0.0006) [2023-12-26 12:23:35,033][123090] Updated weights for policy 1, policy_version 1592105 (0.0006) [2023-12-26 12:23:35,089][123090] Updated weights for policy 1, policy_version 1592115 (0.0010) [2023-12-26 12:23:35,148][123090] Updated weights for policy 1, policy_version 1592125 (0.0010) [2023-12-26 12:23:35,657][123091] Updated weights for policy 0, policy_version 1602804 (0.0007) [2023-12-26 12:23:35,722][123091] Updated weights for policy 0, policy_version 1602814 (0.0009) [2023-12-26 12:23:35,776][123091] Updated weights for policy 0, policy_version 1602826 (0.0011) [2023-12-26 12:23:35,911][123090] Updated weights for policy 1, policy_version 1592135 (0.0007) [2023-12-26 12:23:35,968][123090] Updated weights for policy 1, policy_version 1592145 (0.0005) [2023-12-26 12:23:36,021][123090] Updated weights for policy 1, policy_version 1592155 (0.0006) [2023-12-26 12:23:36,622][123090] Updated weights for policy 1, policy_version 1592165 (0.0008) [2023-12-26 12:23:36,691][123090] Updated weights for policy 1, policy_version 1592175 (0.0011) [2023-12-26 12:23:36,706][123091] Updated weights for policy 0, policy_version 1602836 (0.0008) [2023-12-26 12:23:36,752][123090] Updated weights for policy 1, policy_version 1592185 (0.0011) [2023-12-26 12:23:36,775][123091] Updated weights for policy 0, policy_version 1602846 (0.0007) [2023-12-26 12:23:36,838][123091] Updated weights for policy 0, policy_version 1602856 (0.0009) [2023-12-26 12:23:37,600][123090] Updated weights for policy 1, policy_version 1592195 (0.0010) [2023-12-26 12:23:37,663][123090] Updated weights for policy 1, policy_version 1592205 (0.0011) [2023-12-26 12:23:37,676][123091] Updated weights for policy 0, policy_version 1602866 (0.0009) [2023-12-26 12:23:37,720][123090] Updated weights for policy 1, policy_version 1592215 (0.0011) [2023-12-26 12:23:37,734][123091] Updated weights for policy 0, policy_version 1602876 (0.0006) [2023-12-26 12:23:37,792][123091] Updated weights for policy 0, policy_version 1602886 (0.0007) [2023-12-26 12:23:37,844][123091] Updated weights for policy 0, policy_version 1602896 (0.0008) [2023-12-26 12:23:38,546][123090] Updated weights for policy 1, policy_version 1592225 (0.0011) [2023-12-26 12:23:38,598][123090] Updated weights for policy 1, policy_version 1592235 (0.0009) [2023-12-26 12:23:38,650][123090] Updated weights for policy 1, policy_version 1592245 (0.0008) [2023-12-26 12:23:38,695][123091] Updated weights for policy 0, policy_version 1602906 (0.0009) [2023-12-26 12:23:38,711][123090] Updated weights for policy 1, policy_version 1592255 (0.0009) [2023-12-26 12:23:38,766][123091] Updated weights for policy 0, policy_version 1602916 (0.0007) [2023-12-26 12:23:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 817963008. Throughput: 0: 8936.7, 1: 8893.5. Samples: 817940960. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:38,784][121949] Avg episode reward: [(0, '6118.136'), (1, '5672.505')] [2023-12-26 12:23:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001592256_407617536.pth... [2023-12-26 12:23:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001591200_407347200.pth [2023-12-26 12:23:38,826][123091] Updated weights for policy 0, policy_version 1602926 (0.0009) [2023-12-26 12:23:38,833][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001602928_410353664.pth... [2023-12-26 12:23:38,835][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001601904_410091520.pth [2023-12-26 12:23:39,571][123091] Updated weights for policy 0, policy_version 1602936 (0.0007) [2023-12-26 12:23:39,625][123090] Updated weights for policy 1, policy_version 1592265 (0.0009) [2023-12-26 12:23:39,636][123091] Updated weights for policy 0, policy_version 1602946 (0.0006) [2023-12-26 12:23:39,689][123090] Updated weights for policy 1, policy_version 1592275 (0.0009) [2023-12-26 12:23:39,696][123091] Updated weights for policy 0, policy_version 1602956 (0.0006) [2023-12-26 12:23:39,747][123090] Updated weights for policy 1, policy_version 1592285 (0.0009) [2023-12-26 12:23:40,531][123091] Updated weights for policy 0, policy_version 1602966 (0.0007) [2023-12-26 12:23:40,554][123090] Updated weights for policy 1, policy_version 1592295 (0.0009) [2023-12-26 12:23:40,593][123091] Updated weights for policy 0, policy_version 1602976 (0.0008) [2023-12-26 12:23:40,625][123090] Updated weights for policy 1, policy_version 1592305 (0.0008) [2023-12-26 12:23:40,655][123091] Updated weights for policy 0, policy_version 1602986 (0.0008) [2023-12-26 12:23:40,695][123090] Updated weights for policy 1, policy_version 1592315 (0.0008) [2023-12-26 12:23:41,488][123091] Updated weights for policy 0, policy_version 1602996 (0.0009) [2023-12-26 12:23:41,504][123090] Updated weights for policy 1, policy_version 1592325 (0.0008) [2023-12-26 12:23:41,552][123091] Updated weights for policy 0, policy_version 1603006 (0.0008) [2023-12-26 12:23:41,554][123090] Updated weights for policy 1, policy_version 1592335 (0.0008) [2023-12-26 12:23:41,609][123090] Updated weights for policy 1, policy_version 1592345 (0.0008) [2023-12-26 12:23:41,618][123091] Updated weights for policy 0, policy_version 1603016 (0.0009) [2023-12-26 12:23:42,447][123091] Updated weights for policy 0, policy_version 1603026 (0.0009) [2023-12-26 12:23:42,498][123090] Updated weights for policy 1, policy_version 1592355 (0.0009) [2023-12-26 12:23:42,507][123091] Updated weights for policy 0, policy_version 1603036 (0.0009) [2023-12-26 12:23:42,565][123091] Updated weights for policy 0, policy_version 1603046 (0.0009) [2023-12-26 12:23:42,566][123090] Updated weights for policy 1, policy_version 1592365 (0.0006) [2023-12-26 12:23:42,627][123091] Updated weights for policy 0, policy_version 1603056 (0.0009) [2023-12-26 12:23:42,632][123090] Updated weights for policy 1, policy_version 1592375 (0.0006) [2023-12-26 12:23:43,356][123090] Updated weights for policy 1, policy_version 1592385 (0.0005) [2023-12-26 12:23:43,408][123090] Updated weights for policy 1, policy_version 1592395 (0.0008) [2023-12-26 12:23:43,468][123090] Updated weights for policy 1, policy_version 1592405 (0.0008) [2023-12-26 12:23:43,496][123091] Updated weights for policy 0, policy_version 1603066 (0.0009) [2023-12-26 12:23:43,529][123090] Updated weights for policy 1, policy_version 1592415 (0.0009) [2023-12-26 12:23:43,553][123091] Updated weights for policy 0, policy_version 1603076 (0.0008) [2023-12-26 12:23:43,608][123091] Updated weights for policy 0, policy_version 1603086 (0.0010) [2023-12-26 12:23:43,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 818053120. Throughput: 0: 8770.7, 1: 8853.0. Samples: 818041972. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:43,784][121949] Avg episode reward: [(0, '6175.190'), (1, '5881.712')] [2023-12-26 12:23:44,328][123090] Updated weights for policy 1, policy_version 1592425 (0.0009) [2023-12-26 12:23:44,381][123090] Updated weights for policy 1, policy_version 1592435 (0.0009) [2023-12-26 12:23:44,437][123090] Updated weights for policy 1, policy_version 1592445 (0.0008) [2023-12-26 12:23:44,478][123091] Updated weights for policy 0, policy_version 1603096 (0.0010) [2023-12-26 12:23:44,526][123091] Updated weights for policy 0, policy_version 1603106 (0.0009) [2023-12-26 12:23:44,578][123091] Updated weights for policy 0, policy_version 1603116 (0.0010) [2023-12-26 12:23:45,160][123090] Updated weights for policy 1, policy_version 1592455 (0.0006) [2023-12-26 12:23:45,232][123090] Updated weights for policy 1, policy_version 1592465 (0.0007) [2023-12-26 12:23:45,300][123090] Updated weights for policy 1, policy_version 1592475 (0.0008) [2023-12-26 12:23:45,472][123091] Updated weights for policy 0, policy_version 1603127 (0.0010) [2023-12-26 12:23:45,534][123091] Updated weights for policy 0, policy_version 1603137 (0.0010) [2023-12-26 12:23:45,602][123091] Updated weights for policy 0, policy_version 1603148 (0.0009) [2023-12-26 12:23:45,973][123090] Updated weights for policy 1, policy_version 1592485 (0.0007) [2023-12-26 12:23:46,054][123090] Updated weights for policy 1, policy_version 1592495 (0.0005) [2023-12-26 12:23:46,126][123090] Updated weights for policy 1, policy_version 1592505 (0.0005) [2023-12-26 12:23:46,478][123091] Updated weights for policy 0, policy_version 1603158 (0.0006) [2023-12-26 12:23:46,534][123091] Updated weights for policy 0, policy_version 1603168 (0.0005) [2023-12-26 12:23:46,599][123091] Updated weights for policy 0, policy_version 1603178 (0.0005) [2023-12-26 12:23:46,729][123090] Updated weights for policy 1, policy_version 1592515 (0.0005) [2023-12-26 12:23:46,781][123090] Updated weights for policy 1, policy_version 1592525 (0.0005) [2023-12-26 12:23:46,842][123090] Updated weights for policy 1, policy_version 1592535 (0.0005) [2023-12-26 12:23:47,248][123091] Updated weights for policy 0, policy_version 1603188 (0.0005) [2023-12-26 12:23:47,300][123091] Updated weights for policy 0, policy_version 1603198 (0.0005) [2023-12-26 12:23:47,353][123091] Updated weights for policy 0, policy_version 1603208 (0.0005) [2023-12-26 12:23:47,502][123090] Updated weights for policy 1, policy_version 1592545 (0.0005) [2023-12-26 12:23:47,563][123090] Updated weights for policy 1, policy_version 1592555 (0.0005) [2023-12-26 12:23:47,614][123090] Updated weights for policy 1, policy_version 1592565 (0.0005) [2023-12-26 12:23:47,668][123090] Updated weights for policy 1, policy_version 1592575 (0.0008) [2023-12-26 12:23:48,084][123091] Updated weights for policy 0, policy_version 1603218 (0.0008) [2023-12-26 12:23:48,137][123091] Updated weights for policy 0, policy_version 1603228 (0.0005) [2023-12-26 12:23:48,191][123091] Updated weights for policy 0, policy_version 1603238 (0.0005) [2023-12-26 12:23:48,245][123091] Updated weights for policy 0, policy_version 1603248 (0.0005) [2023-12-26 12:23:48,380][123090] Updated weights for policy 1, policy_version 1592585 (0.0009) [2023-12-26 12:23:48,437][123090] Updated weights for policy 1, policy_version 1592595 (0.0009) [2023-12-26 12:23:48,502][123090] Updated weights for policy 1, policy_version 1592605 (0.0010) [2023-12-26 12:23:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 818143232. Throughput: 0: 8787.0, 1: 8946.5. Samples: 818152708. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:48,785][121949] Avg episode reward: [(0, '6141.531'), (1, '5956.275')] [2023-12-26 12:23:49,057][123091] Updated weights for policy 0, policy_version 1603258 (0.0010) [2023-12-26 12:23:49,120][123091] Updated weights for policy 0, policy_version 1603268 (0.0010) [2023-12-26 12:23:49,178][123091] Updated weights for policy 0, policy_version 1603278 (0.0010) [2023-12-26 12:23:49,359][123090] Updated weights for policy 1, policy_version 1592615 (0.0010) [2023-12-26 12:23:49,423][123090] Updated weights for policy 1, policy_version 1592625 (0.0010) [2023-12-26 12:23:49,475][123090] Updated weights for policy 1, policy_version 1592635 (0.0009) [2023-12-26 12:23:49,986][123091] Updated weights for policy 0, policy_version 1603288 (0.0010) [2023-12-26 12:23:50,048][123091] Updated weights for policy 0, policy_version 1603298 (0.0008) [2023-12-26 12:23:50,117][123091] Updated weights for policy 0, policy_version 1603308 (0.0006) [2023-12-26 12:23:50,336][123090] Updated weights for policy 1, policy_version 1592645 (0.0007) [2023-12-26 12:23:50,387][123090] Updated weights for policy 1, policy_version 1592655 (0.0008) [2023-12-26 12:23:50,440][123090] Updated weights for policy 1, policy_version 1592665 (0.0008) [2023-12-26 12:23:50,911][123091] Updated weights for policy 0, policy_version 1603318 (0.0010) [2023-12-26 12:23:50,973][123091] Updated weights for policy 0, policy_version 1603328 (0.0006) [2023-12-26 12:23:51,050][123091] Updated weights for policy 0, policy_version 1603339 (0.0009) [2023-12-26 12:23:51,317][123090] Updated weights for policy 1, policy_version 1592675 (0.0009) [2023-12-26 12:23:51,390][123090] Updated weights for policy 1, policy_version 1592685 (0.0007) [2023-12-26 12:23:51,462][123090] Updated weights for policy 1, policy_version 1592695 (0.0008) [2023-12-26 12:23:51,894][123091] Updated weights for policy 0, policy_version 1603349 (0.0009) [2023-12-26 12:23:51,955][123091] Updated weights for policy 0, policy_version 1603359 (0.0009) [2023-12-26 12:23:52,012][123091] Updated weights for policy 0, policy_version 1603369 (0.0009) [2023-12-26 12:23:52,159][123090] Updated weights for policy 1, policy_version 1592705 (0.0005) [2023-12-26 12:23:52,223][123090] Updated weights for policy 1, policy_version 1592715 (0.0009) [2023-12-26 12:23:52,288][123090] Updated weights for policy 1, policy_version 1592725 (0.0010) [2023-12-26 12:23:52,355][123090] Updated weights for policy 1, policy_version 1592735 (0.0009) [2023-12-26 12:23:52,898][123091] Updated weights for policy 0, policy_version 1603379 (0.0009) [2023-12-26 12:23:52,951][123091] Updated weights for policy 0, policy_version 1603389 (0.0010) [2023-12-26 12:23:53,004][123091] Updated weights for policy 0, policy_version 1603399 (0.0010) [2023-12-26 12:23:53,184][123090] Updated weights for policy 1, policy_version 1592745 (0.0007) [2023-12-26 12:23:53,242][123090] Updated weights for policy 1, policy_version 1592755 (0.0005) [2023-12-26 12:23:53,304][123090] Updated weights for policy 1, policy_version 1592765 (0.0009) [2023-12-26 12:23:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 818225152. Throughput: 0: 8734.3, 1: 8886.7. Samples: 818203844. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:53,785][121949] Avg episode reward: [(0, '6139.044'), (1, '5682.890')] [2023-12-26 12:23:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001603408_410476544.pth... [2023-12-26 12:23:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001592768_407748608.pth... [2023-12-26 12:23:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001602384_410214400.pth [2023-12-26 12:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001591744_407486464.pth [2023-12-26 12:23:53,845][123091] Updated weights for policy 0, policy_version 1603409 (0.0010) [2023-12-26 12:23:53,904][123091] Updated weights for policy 0, policy_version 1603419 (0.0005) [2023-12-26 12:23:53,966][123091] Updated weights for policy 0, policy_version 1603429 (0.0006) [2023-12-26 12:23:53,998][123090] Updated weights for policy 1, policy_version 1592775 (0.0009) [2023-12-26 12:23:54,017][123091] Updated weights for policy 0, policy_version 1603439 (0.0009) [2023-12-26 12:23:54,070][123090] Updated weights for policy 1, policy_version 1592785 (0.0007) [2023-12-26 12:23:54,143][123090] Updated weights for policy 1, policy_version 1592795 (0.0007) [2023-12-26 12:23:54,818][123090] Updated weights for policy 1, policy_version 1592805 (0.0007) [2023-12-26 12:23:54,863][123091] Updated weights for policy 0, policy_version 1603449 (0.0009) [2023-12-26 12:23:54,866][123090] Updated weights for policy 1, policy_version 1592815 (0.0005) [2023-12-26 12:23:54,922][123090] Updated weights for policy 1, policy_version 1592825 (0.0005) [2023-12-26 12:23:54,930][123091] Updated weights for policy 0, policy_version 1603459 (0.0009) [2023-12-26 12:23:54,986][123091] Updated weights for policy 0, policy_version 1603469 (0.0008) [2023-12-26 12:23:55,659][123090] Updated weights for policy 1, policy_version 1592835 (0.0009) [2023-12-26 12:23:55,720][123090] Updated weights for policy 1, policy_version 1592845 (0.0005) [2023-12-26 12:23:55,788][123090] Updated weights for policy 1, policy_version 1592855 (0.0006) [2023-12-26 12:23:55,876][123091] Updated weights for policy 0, policy_version 1603479 (0.0010) [2023-12-26 12:23:55,923][123091] Updated weights for policy 0, policy_version 1603489 (0.0010) [2023-12-26 12:23:55,978][123091] Updated weights for policy 0, policy_version 1603499 (0.0010) [2023-12-26 12:23:56,441][123090] Updated weights for policy 1, policy_version 1592865 (0.0006) [2023-12-26 12:23:56,511][123090] Updated weights for policy 1, policy_version 1592875 (0.0007) [2023-12-26 12:23:56,575][123090] Updated weights for policy 1, policy_version 1592885 (0.0009) [2023-12-26 12:23:56,627][123090] Updated weights for policy 1, policy_version 1592895 (0.0009) [2023-12-26 12:23:56,807][123091] Updated weights for policy 0, policy_version 1603509 (0.0008) [2023-12-26 12:23:56,863][123091] Updated weights for policy 0, policy_version 1603519 (0.0005) [2023-12-26 12:23:56,919][123091] Updated weights for policy 0, policy_version 1603529 (0.0005) [2023-12-26 12:23:57,485][123090] Updated weights for policy 1, policy_version 1592905 (0.0008) [2023-12-26 12:23:57,537][123090] Updated weights for policy 1, policy_version 1592915 (0.0008) [2023-12-26 12:23:57,591][123090] Updated weights for policy 1, policy_version 1592925 (0.0009) [2023-12-26 12:23:57,643][123091] Updated weights for policy 0, policy_version 1603539 (0.0007) [2023-12-26 12:23:57,708][123091] Updated weights for policy 0, policy_version 1603549 (0.0011) [2023-12-26 12:23:57,766][123091] Updated weights for policy 0, policy_version 1603559 (0.0010) [2023-12-26 12:23:58,450][123090] Updated weights for policy 1, policy_version 1592935 (0.0009) [2023-12-26 12:23:58,519][123090] Updated weights for policy 1, policy_version 1592945 (0.0009) [2023-12-26 12:23:58,588][123090] Updated weights for policy 1, policy_version 1592955 (0.0008) [2023-12-26 12:23:58,590][123091] Updated weights for policy 0, policy_version 1603569 (0.0011) [2023-12-26 12:23:58,661][123091] Updated weights for policy 0, policy_version 1603579 (0.0011) [2023-12-26 12:23:58,732][123091] Updated weights for policy 0, policy_version 1603589 (0.0010) [2023-12-26 12:23:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 818315264. Throughput: 0: 8694.3, 1: 8952.6. Samples: 818311516. Policy #0 lag: (min: 5.0, avg: 18.0, max: 37.0) [2023-12-26 12:23:58,785][121949] Avg episode reward: [(0, '6217.526'), (1, '5514.908')] [2023-12-26 12:23:58,799][123091] Updated weights for policy 0, policy_version 1603599 (0.0009) [2023-12-26 12:23:59,515][123090] Updated weights for policy 1, policy_version 1592965 (0.0009) [2023-12-26 12:23:59,572][123090] Updated weights for policy 1, policy_version 1592975 (0.0009) [2023-12-26 12:23:59,602][123091] Updated weights for policy 0, policy_version 1603609 (0.0008) [2023-12-26 12:23:59,634][123090] Updated weights for policy 1, policy_version 1592985 (0.0008) [2023-12-26 12:23:59,663][123091] Updated weights for policy 0, policy_version 1603619 (0.0008) [2023-12-26 12:23:59,730][123091] Updated weights for policy 0, policy_version 1603629 (0.0009) [2023-12-26 12:24:00,419][123090] Updated weights for policy 1, policy_version 1592995 (0.0007) [2023-12-26 12:24:00,472][123090] Updated weights for policy 1, policy_version 1593005 (0.0005) [2023-12-26 12:24:00,530][123090] Updated weights for policy 1, policy_version 1593015 (0.0005) [2023-12-26 12:24:00,567][123091] Updated weights for policy 0, policy_version 1603639 (0.0009) [2023-12-26 12:24:00,616][123091] Updated weights for policy 0, policy_version 1603649 (0.0008) [2023-12-26 12:24:00,668][123091] Updated weights for policy 0, policy_version 1603660 (0.0009) [2023-12-26 12:24:01,354][123090] Updated weights for policy 1, policy_version 1593025 (0.0005) [2023-12-26 12:24:01,426][123090] Updated weights for policy 1, policy_version 1593035 (0.0010) [2023-12-26 12:24:01,490][123090] Updated weights for policy 1, policy_version 1593045 (0.0009) [2023-12-26 12:24:01,497][123091] Updated weights for policy 0, policy_version 1603670 (0.0009) [2023-12-26 12:24:01,550][123090] Updated weights for policy 1, policy_version 1593055 (0.0007) [2023-12-26 12:24:01,556][123091] Updated weights for policy 0, policy_version 1603680 (0.0009) [2023-12-26 12:24:01,610][123091] Updated weights for policy 0, policy_version 1603690 (0.0009) [2023-12-26 12:24:02,350][123090] Updated weights for policy 1, policy_version 1593065 (0.0010) [2023-12-26 12:24:02,421][123090] Updated weights for policy 1, policy_version 1593075 (0.0009) [2023-12-26 12:24:02,476][123091] Updated weights for policy 0, policy_version 1603700 (0.0009) [2023-12-26 12:24:02,485][123090] Updated weights for policy 1, policy_version 1593085 (0.0008) [2023-12-26 12:24:02,537][123091] Updated weights for policy 0, policy_version 1603710 (0.0008) [2023-12-26 12:24:02,602][123091] Updated weights for policy 0, policy_version 1603720 (0.0009) [2023-12-26 12:24:03,252][123090] Updated weights for policy 1, policy_version 1593095 (0.0010) [2023-12-26 12:24:03,319][123090] Updated weights for policy 1, policy_version 1593105 (0.0009) [2023-12-26 12:24:03,379][123090] Updated weights for policy 1, policy_version 1593115 (0.0009) [2023-12-26 12:24:03,427][123091] Updated weights for policy 0, policy_version 1603730 (0.0008) [2023-12-26 12:24:03,482][123091] Updated weights for policy 0, policy_version 1603740 (0.0009) [2023-12-26 12:24:03,528][123091] Updated weights for policy 0, policy_version 1603750 (0.0006) [2023-12-26 12:24:03,575][123091] Updated weights for policy 0, policy_version 1603760 (0.0005) [2023-12-26 12:24:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 818405376. Throughput: 0: 8637.8, 1: 8878.1. Samples: 818414040. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:03,785][121949] Avg episode reward: [(0, '6156.719'), (1, '5685.255')] [2023-12-26 12:24:04,198][123090] Updated weights for policy 1, policy_version 1593125 (0.0010) [2023-12-26 12:24:04,261][123090] Updated weights for policy 1, policy_version 1593135 (0.0009) [2023-12-26 12:24:04,326][123090] Updated weights for policy 1, policy_version 1593145 (0.0009) [2023-12-26 12:24:04,416][123091] Updated weights for policy 0, policy_version 1603770 (0.0010) [2023-12-26 12:24:04,464][123091] Updated weights for policy 0, policy_version 1603780 (0.0010) [2023-12-26 12:24:04,511][123091] Updated weights for policy 0, policy_version 1603790 (0.0010) [2023-12-26 12:24:05,108][123090] Updated weights for policy 1, policy_version 1593155 (0.0009) [2023-12-26 12:24:05,160][123090] Updated weights for policy 1, policy_version 1593165 (0.0009) [2023-12-26 12:24:05,221][123090] Updated weights for policy 1, policy_version 1593175 (0.0008) [2023-12-26 12:24:05,238][123091] Updated weights for policy 0, policy_version 1603800 (0.0007) [2023-12-26 12:24:05,281][123091] Updated weights for policy 0, policy_version 1603810 (0.0005) [2023-12-26 12:24:05,337][123091] Updated weights for policy 0, policy_version 1603820 (0.0005) [2023-12-26 12:24:06,039][123091] Updated weights for policy 0, policy_version 1603830 (0.0008) [2023-12-26 12:24:06,108][123090] Updated weights for policy 1, policy_version 1593185 (0.0010) [2023-12-26 12:24:06,114][123091] Updated weights for policy 0, policy_version 1603840 (0.0007) [2023-12-26 12:24:06,169][123090] Updated weights for policy 1, policy_version 1593195 (0.0009) [2023-12-26 12:24:06,178][123091] Updated weights for policy 0, policy_version 1603850 (0.0008) [2023-12-26 12:24:06,228][123090] Updated weights for policy 1, policy_version 1593205 (0.0010) [2023-12-26 12:24:06,287][123090] Updated weights for policy 1, policy_version 1593215 (0.0010) [2023-12-26 12:24:06,874][123091] Updated weights for policy 0, policy_version 1603860 (0.0008) [2023-12-26 12:24:06,948][123091] Updated weights for policy 0, policy_version 1603870 (0.0007) [2023-12-26 12:24:07,009][123091] Updated weights for policy 0, policy_version 1603880 (0.0008) [2023-12-26 12:24:07,080][123090] Updated weights for policy 1, policy_version 1593225 (0.0007) [2023-12-26 12:24:07,155][123090] Updated weights for policy 1, policy_version 1593235 (0.0009) [2023-12-26 12:24:07,211][123090] Updated weights for policy 1, policy_version 1593245 (0.0007) [2023-12-26 12:24:07,790][123091] Updated weights for policy 0, policy_version 1603890 (0.0009) [2023-12-26 12:24:07,841][123091] Updated weights for policy 0, policy_version 1603900 (0.0010) [2023-12-26 12:24:07,891][123091] Updated weights for policy 0, policy_version 1603910 (0.0010) [2023-12-26 12:24:07,937][123090] Updated weights for policy 1, policy_version 1593255 (0.0009) [2023-12-26 12:24:07,950][123091] Updated weights for policy 0, policy_version 1603920 (0.0011) [2023-12-26 12:24:08,001][123090] Updated weights for policy 1, policy_version 1593265 (0.0009) [2023-12-26 12:24:08,058][123090] Updated weights for policy 1, policy_version 1593275 (0.0009) [2023-12-26 12:24:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 818487296. Throughput: 0: 8698.1, 1: 8856.5. Samples: 818467432. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:08,785][121949] Avg episode reward: [(0, '6105.350'), (1, '5644.591')] [2023-12-26 12:24:08,805][123091] Updated weights for policy 0, policy_version 1603930 (0.0011) [2023-12-26 12:24:08,830][123090] Updated weights for policy 1, policy_version 1593285 (0.0008) [2023-12-26 12:24:08,875][123091] Updated weights for policy 0, policy_version 1603940 (0.0011) [2023-12-26 12:24:08,901][123090] Updated weights for policy 1, policy_version 1593295 (0.0008) [2023-12-26 12:24:08,941][123091] Updated weights for policy 0, policy_version 1603950 (0.0010) [2023-12-26 12:24:08,949][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001603952_410615808.pth... [2023-12-26 12:24:08,953][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001602928_410353664.pth [2023-12-26 12:24:08,953][123090] Updated weights for policy 1, policy_version 1593305 (0.0010) [2023-12-26 12:24:08,989][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001593312_407887872.pth... [2023-12-26 12:24:08,993][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001592256_407617536.pth [2023-12-26 12:24:09,697][123090] Updated weights for policy 1, policy_version 1593315 (0.0010) [2023-12-26 12:24:09,744][123091] Updated weights for policy 0, policy_version 1603960 (0.0011) [2023-12-26 12:24:09,759][123090] Updated weights for policy 1, policy_version 1593325 (0.0007) [2023-12-26 12:24:09,811][123091] Updated weights for policy 0, policy_version 1603970 (0.0011) [2023-12-26 12:24:09,814][123090] Updated weights for policy 1, policy_version 1593335 (0.0008) [2023-12-26 12:24:09,883][123091] Updated weights for policy 0, policy_version 1603980 (0.0009) [2023-12-26 12:24:10,603][123090] Updated weights for policy 1, policy_version 1593345 (0.0008) [2023-12-26 12:24:10,628][123091] Updated weights for policy 0, policy_version 1603990 (0.0009) [2023-12-26 12:24:10,671][123090] Updated weights for policy 1, policy_version 1593355 (0.0005) [2023-12-26 12:24:10,688][123091] Updated weights for policy 0, policy_version 1604000 (0.0011) [2023-12-26 12:24:10,723][123090] Updated weights for policy 1, policy_version 1593365 (0.0006) [2023-12-26 12:24:10,740][123091] Updated weights for policy 0, policy_version 1604010 (0.0011) [2023-12-26 12:24:10,787][123090] Updated weights for policy 1, policy_version 1593375 (0.0007) [2023-12-26 12:24:11,582][123091] Updated weights for policy 0, policy_version 1604020 (0.0010) [2023-12-26 12:24:11,612][123090] Updated weights for policy 1, policy_version 1593385 (0.0009) [2023-12-26 12:24:11,649][123091] Updated weights for policy 0, policy_version 1604030 (0.0008) [2023-12-26 12:24:11,678][123090] Updated weights for policy 1, policy_version 1593395 (0.0010) [2023-12-26 12:24:11,722][123091] Updated weights for policy 0, policy_version 1604040 (0.0010) [2023-12-26 12:24:11,748][123090] Updated weights for policy 1, policy_version 1593405 (0.0008) [2023-12-26 12:24:12,502][123091] Updated weights for policy 0, policy_version 1604050 (0.0008) [2023-12-26 12:24:12,567][123091] Updated weights for policy 0, policy_version 1604060 (0.0009) [2023-12-26 12:24:12,624][123090] Updated weights for policy 1, policy_version 1593415 (0.0009) [2023-12-26 12:24:12,632][123091] Updated weights for policy 0, policy_version 1604070 (0.0008) [2023-12-26 12:24:12,690][123090] Updated weights for policy 1, policy_version 1593425 (0.0009) [2023-12-26 12:24:12,695][123091] Updated weights for policy 0, policy_version 1604080 (0.0006) [2023-12-26 12:24:12,757][123090] Updated weights for policy 1, policy_version 1593435 (0.0010) [2023-12-26 12:24:13,423][123091] Updated weights for policy 0, policy_version 1604090 (0.0007) [2023-12-26 12:24:13,473][123090] Updated weights for policy 1, policy_version 1593445 (0.0008) [2023-12-26 12:24:13,496][123091] Updated weights for policy 0, policy_version 1604100 (0.0006) [2023-12-26 12:24:13,527][123090] Updated weights for policy 1, policy_version 1593455 (0.0005) [2023-12-26 12:24:13,553][123091] Updated weights for policy 0, policy_version 1604110 (0.0006) [2023-12-26 12:24:13,575][123090] Updated weights for policy 1, policy_version 1593465 (0.0006) [2023-12-26 12:24:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 818585600. Throughput: 0: 8665.3, 1: 8862.2. Samples: 818573352. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:13,785][121949] Avg episode reward: [(0, '6190.775'), (1, '5494.948')] [2023-12-26 12:24:14,279][123091] Updated weights for policy 0, policy_version 1604120 (0.0006) [2023-12-26 12:24:14,331][123091] Updated weights for policy 0, policy_version 1604131 (0.0007) [2023-12-26 12:24:14,391][123090] Updated weights for policy 1, policy_version 1593475 (0.0010) [2023-12-26 12:24:14,392][123091] Updated weights for policy 0, policy_version 1604141 (0.0006) [2023-12-26 12:24:14,446][123090] Updated weights for policy 1, policy_version 1593485 (0.0010) [2023-12-26 12:24:14,497][123090] Updated weights for policy 1, policy_version 1593495 (0.0010) [2023-12-26 12:24:15,118][123091] Updated weights for policy 0, policy_version 1604151 (0.0008) [2023-12-26 12:24:15,172][123091] Updated weights for policy 0, policy_version 1604161 (0.0009) [2023-12-26 12:24:15,240][123091] Updated weights for policy 0, policy_version 1604171 (0.0011) [2023-12-26 12:24:15,298][123090] Updated weights for policy 1, policy_version 1593505 (0.0008) [2023-12-26 12:24:15,347][123090] Updated weights for policy 1, policy_version 1593515 (0.0006) [2023-12-26 12:24:15,402][123090] Updated weights for policy 1, policy_version 1593525 (0.0006) [2023-12-26 12:24:15,453][123090] Updated weights for policy 1, policy_version 1593535 (0.0005) [2023-12-26 12:24:16,021][123091] Updated weights for policy 0, policy_version 1604181 (0.0011) [2023-12-26 12:24:16,072][123091] Updated weights for policy 0, policy_version 1604191 (0.0011) [2023-12-26 12:24:16,124][123091] Updated weights for policy 0, policy_version 1604201 (0.0010) [2023-12-26 12:24:16,163][123090] Updated weights for policy 1, policy_version 1593545 (0.0005) [2023-12-26 12:24:16,227][123090] Updated weights for policy 1, policy_version 1593555 (0.0005) [2023-12-26 12:24:16,280][123090] Updated weights for policy 1, policy_version 1593565 (0.0008) [2023-12-26 12:24:16,816][123091] Updated weights for policy 0, policy_version 1604211 (0.0009) [2023-12-26 12:24:16,880][123091] Updated weights for policy 0, policy_version 1604221 (0.0008) [2023-12-26 12:24:16,940][123091] Updated weights for policy 0, policy_version 1604231 (0.0008) [2023-12-26 12:24:17,007][123090] Updated weights for policy 1, policy_version 1593575 (0.0006) [2023-12-26 12:24:17,065][123090] Updated weights for policy 1, policy_version 1593585 (0.0005) [2023-12-26 12:24:17,122][123090] Updated weights for policy 1, policy_version 1593595 (0.0006) [2023-12-26 12:24:17,619][123091] Updated weights for policy 0, policy_version 1604241 (0.0006) [2023-12-26 12:24:17,682][123091] Updated weights for policy 0, policy_version 1604251 (0.0005) [2023-12-26 12:24:17,739][123091] Updated weights for policy 0, policy_version 1604261 (0.0005) [2023-12-26 12:24:17,782][123090] Updated weights for policy 1, policy_version 1593605 (0.0008) [2023-12-26 12:24:17,795][123091] Updated weights for policy 0, policy_version 1604271 (0.0005) [2023-12-26 12:24:17,840][123090] Updated weights for policy 1, policy_version 1593615 (0.0010) [2023-12-26 12:24:17,903][123090] Updated weights for policy 1, policy_version 1593625 (0.0007) [2023-12-26 12:24:18,494][123091] Updated weights for policy 0, policy_version 1604281 (0.0010) [2023-12-26 12:24:18,557][123091] Updated weights for policy 0, policy_version 1604291 (0.0011) [2023-12-26 12:24:18,614][123091] Updated weights for policy 0, policy_version 1604301 (0.0010) [2023-12-26 12:24:18,652][123090] Updated weights for policy 1, policy_version 1593635 (0.0008) [2023-12-26 12:24:18,702][123090] Updated weights for policy 1, policy_version 1593645 (0.0005) [2023-12-26 12:24:18,759][123090] Updated weights for policy 1, policy_version 1593655 (0.0005) [2023-12-26 12:24:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 818675712. Throughput: 0: 8827.9, 1: 8987.3. Samples: 818688428. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:18,784][121949] Avg episode reward: [(0, '6177.709'), (1, '5534.891')] [2023-12-26 12:24:19,458][123091] Updated weights for policy 0, policy_version 1604311 (0.0007) [2023-12-26 12:24:19,509][123090] Updated weights for policy 1, policy_version 1593665 (0.0006) [2023-12-26 12:24:19,530][123091] Updated weights for policy 0, policy_version 1604321 (0.0008) [2023-12-26 12:24:19,577][123090] Updated weights for policy 1, policy_version 1593675 (0.0011) [2023-12-26 12:24:19,588][123091] Updated weights for policy 0, policy_version 1604331 (0.0008) [2023-12-26 12:24:19,641][123090] Updated weights for policy 1, policy_version 1593685 (0.0011) [2023-12-26 12:24:19,709][123090] Updated weights for policy 1, policy_version 1593695 (0.0010) [2023-12-26 12:24:20,397][123091] Updated weights for policy 0, policy_version 1604341 (0.0007) [2023-12-26 12:24:20,473][123091] Updated weights for policy 0, policy_version 1604351 (0.0008) [2023-12-26 12:24:20,536][123091] Updated weights for policy 0, policy_version 1604361 (0.0010) [2023-12-26 12:24:20,544][123090] Updated weights for policy 1, policy_version 1593705 (0.0010) [2023-12-26 12:24:20,613][123090] Updated weights for policy 1, policy_version 1593715 (0.0011) [2023-12-26 12:24:20,685][123090] Updated weights for policy 1, policy_version 1593725 (0.0007) [2023-12-26 12:24:21,341][123091] Updated weights for policy 0, policy_version 1604371 (0.0010) [2023-12-26 12:24:21,414][123091] Updated weights for policy 0, policy_version 1604381 (0.0009) [2023-12-26 12:24:21,436][123090] Updated weights for policy 1, policy_version 1593735 (0.0007) [2023-12-26 12:24:21,474][123091] Updated weights for policy 0, policy_version 1604391 (0.0006) [2023-12-26 12:24:21,492][123090] Updated weights for policy 1, policy_version 1593745 (0.0008) [2023-12-26 12:24:21,556][123090] Updated weights for policy 1, policy_version 1593755 (0.0008) [2023-12-26 12:24:22,274][123091] Updated weights for policy 0, policy_version 1604401 (0.0006) [2023-12-26 12:24:22,334][123091] Updated weights for policy 0, policy_version 1604411 (0.0009) [2023-12-26 12:24:22,404][123091] Updated weights for policy 0, policy_version 1604421 (0.0009) [2023-12-26 12:24:22,474][123091] Updated weights for policy 0, policy_version 1604431 (0.0007) [2023-12-26 12:24:22,489][123090] Updated weights for policy 1, policy_version 1593765 (0.0008) [2023-12-26 12:24:22,550][123090] Updated weights for policy 1, policy_version 1593775 (0.0009) [2023-12-26 12:24:22,608][123090] Updated weights for policy 1, policy_version 1593785 (0.0009) [2023-12-26 12:24:23,348][123091] Updated weights for policy 0, policy_version 1604441 (0.0009) [2023-12-26 12:24:23,386][123090] Updated weights for policy 1, policy_version 1593795 (0.0008) [2023-12-26 12:24:23,401][123091] Updated weights for policy 0, policy_version 1604451 (0.0009) [2023-12-26 12:24:23,437][123090] Updated weights for policy 1, policy_version 1593805 (0.0005) [2023-12-26 12:24:23,445][123091] Updated weights for policy 0, policy_version 1604461 (0.0005) [2023-12-26 12:24:23,490][123090] Updated weights for policy 1, policy_version 1593815 (0.0005) [2023-12-26 12:24:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 818765824. Throughput: 0: 8806.1, 1: 8954.5. Samples: 818740192. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:23,785][121949] Avg episode reward: [(0, '6190.886'), (1, '5651.470')] [2023-12-26 12:24:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001604464_410746880.pth... [2023-12-26 12:24:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001593824_408018944.pth... [2023-12-26 12:24:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001603408_410476544.pth [2023-12-26 12:24:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001592768_407748608.pth [2023-12-26 12:24:24,136][123090] Updated weights for policy 1, policy_version 1593825 (0.0005) [2023-12-26 12:24:24,149][123091] Updated weights for policy 0, policy_version 1604471 (0.0007) [2023-12-26 12:24:24,188][123090] Updated weights for policy 1, policy_version 1593835 (0.0005) [2023-12-26 12:24:24,205][123091] Updated weights for policy 0, policy_version 1604481 (0.0008) [2023-12-26 12:24:24,234][123090] Updated weights for policy 1, policy_version 1593845 (0.0005) [2023-12-26 12:24:24,263][123091] Updated weights for policy 0, policy_version 1604491 (0.0009) [2023-12-26 12:24:24,287][123090] Updated weights for policy 1, policy_version 1593855 (0.0007) [2023-12-26 12:24:24,967][123090] Updated weights for policy 1, policy_version 1593865 (0.0006) [2023-12-26 12:24:25,030][123090] Updated weights for policy 1, policy_version 1593875 (0.0005) [2023-12-26 12:24:25,100][123090] Updated weights for policy 1, policy_version 1593885 (0.0005) [2023-12-26 12:24:25,150][123091] Updated weights for policy 0, policy_version 1604501 (0.0009) [2023-12-26 12:24:25,204][123091] Updated weights for policy 0, policy_version 1604512 (0.0010) [2023-12-26 12:24:25,262][123091] Updated weights for policy 0, policy_version 1604522 (0.0010) [2023-12-26 12:24:25,804][123090] Updated weights for policy 1, policy_version 1593895 (0.0008) [2023-12-26 12:24:25,855][123090] Updated weights for policy 1, policy_version 1593905 (0.0005) [2023-12-26 12:24:25,909][123090] Updated weights for policy 1, policy_version 1593915 (0.0008) [2023-12-26 12:24:26,072][123091] Updated weights for policy 0, policy_version 1604532 (0.0009) [2023-12-26 12:24:26,121][123091] Updated weights for policy 0, policy_version 1604542 (0.0008) [2023-12-26 12:24:26,169][123091] Updated weights for policy 0, policy_version 1604552 (0.0009) [2023-12-26 12:24:26,654][123090] Updated weights for policy 1, policy_version 1593925 (0.0008) [2023-12-26 12:24:26,704][123090] Updated weights for policy 1, policy_version 1593935 (0.0005) [2023-12-26 12:24:26,752][123090] Updated weights for policy 1, policy_version 1593945 (0.0005) [2023-12-26 12:24:26,930][123091] Updated weights for policy 0, policy_version 1604562 (0.0008) [2023-12-26 12:24:26,981][123091] Updated weights for policy 0, policy_version 1604572 (0.0008) [2023-12-26 12:24:27,041][123091] Updated weights for policy 0, policy_version 1604582 (0.0010) [2023-12-26 12:24:27,094][123091] Updated weights for policy 0, policy_version 1604592 (0.0010) [2023-12-26 12:24:27,411][123090] Updated weights for policy 1, policy_version 1593955 (0.0007) [2023-12-26 12:24:27,457][123090] Updated weights for policy 1, policy_version 1593965 (0.0010) [2023-12-26 12:24:27,505][123090] Updated weights for policy 1, policy_version 1593975 (0.0010) [2023-12-26 12:24:27,849][123091] Updated weights for policy 0, policy_version 1604602 (0.0005) [2023-12-26 12:24:27,895][123091] Updated weights for policy 0, policy_version 1604612 (0.0006) [2023-12-26 12:24:27,951][123091] Updated weights for policy 0, policy_version 1604622 (0.0010) [2023-12-26 12:24:28,317][123090] Updated weights for policy 1, policy_version 1593985 (0.0010) [2023-12-26 12:24:28,387][123090] Updated weights for policy 1, policy_version 1593995 (0.0010) [2023-12-26 12:24:28,446][123090] Updated weights for policy 1, policy_version 1594005 (0.0010) [2023-12-26 12:24:28,504][123090] Updated weights for policy 1, policy_version 1594015 (0.0010) [2023-12-26 12:24:28,759][123091] Updated weights for policy 0, policy_version 1604633 (0.0006) [2023-12-26 12:24:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 818855936. Throughput: 0: 8869.0, 1: 9122.9. Samples: 818851612. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:28,785][121949] Avg episode reward: [(0, '6229.585'), (1, '5616.532')] [2023-12-26 12:24:28,819][123091] Updated weights for policy 0, policy_version 1604643 (0.0005) [2023-12-26 12:24:28,900][123091] Updated weights for policy 0, policy_version 1604653 (0.0005) [2023-12-26 12:24:29,322][123090] Updated weights for policy 1, policy_version 1594025 (0.0010) [2023-12-26 12:24:29,390][123090] Updated weights for policy 1, policy_version 1594035 (0.0009) [2023-12-26 12:24:29,443][123090] Updated weights for policy 1, policy_version 1594045 (0.0009) [2023-12-26 12:24:29,514][123091] Updated weights for policy 0, policy_version 1604663 (0.0006) [2023-12-26 12:24:29,569][123091] Updated weights for policy 0, policy_version 1604673 (0.0005) [2023-12-26 12:24:29,624][123091] Updated weights for policy 0, policy_version 1604683 (0.0005) [2023-12-26 12:24:30,217][123090] Updated weights for policy 1, policy_version 1594055 (0.0008) [2023-12-26 12:24:30,282][123090] Updated weights for policy 1, policy_version 1594065 (0.0008) [2023-12-26 12:24:30,339][123090] Updated weights for policy 1, policy_version 1594075 (0.0008) [2023-12-26 12:24:30,374][123091] Updated weights for policy 0, policy_version 1604693 (0.0007) [2023-12-26 12:24:30,445][123091] Updated weights for policy 0, policy_version 1604703 (0.0010) [2023-12-26 12:24:30,500][123091] Updated weights for policy 0, policy_version 1604713 (0.0006) [2023-12-26 12:24:31,130][123090] Updated weights for policy 1, policy_version 1594085 (0.0006) [2023-12-26 12:24:31,195][123090] Updated weights for policy 1, policy_version 1594095 (0.0005) [2023-12-26 12:24:31,265][123090] Updated weights for policy 1, policy_version 1594105 (0.0006) [2023-12-26 12:24:31,299][123091] Updated weights for policy 0, policy_version 1604723 (0.0008) [2023-12-26 12:24:31,374][123091] Updated weights for policy 0, policy_version 1604733 (0.0010) [2023-12-26 12:24:31,437][123091] Updated weights for policy 0, policy_version 1604743 (0.0010) [2023-12-26 12:24:32,058][123090] Updated weights for policy 1, policy_version 1594115 (0.0006) [2023-12-26 12:24:32,110][123090] Updated weights for policy 1, policy_version 1594125 (0.0009) [2023-12-26 12:24:32,159][123090] Updated weights for policy 1, policy_version 1594135 (0.0008) [2023-12-26 12:24:32,269][123091] Updated weights for policy 0, policy_version 1604753 (0.0011) [2023-12-26 12:24:32,335][123091] Updated weights for policy 0, policy_version 1604763 (0.0010) [2023-12-26 12:24:32,403][123091] Updated weights for policy 0, policy_version 1604773 (0.0008) [2023-12-26 12:24:32,468][123091] Updated weights for policy 0, policy_version 1604783 (0.0005) [2023-12-26 12:24:32,991][123090] Updated weights for policy 1, policy_version 1594145 (0.0009) [2023-12-26 12:24:33,042][123090] Updated weights for policy 1, policy_version 1594155 (0.0008) [2023-12-26 12:24:33,095][123090] Updated weights for policy 1, policy_version 1594165 (0.0008) [2023-12-26 12:24:33,119][123091] Updated weights for policy 0, policy_version 1604793 (0.0008) [2023-12-26 12:24:33,144][123090] Updated weights for policy 1, policy_version 1594175 (0.0009) [2023-12-26 12:24:33,174][123091] Updated weights for policy 0, policy_version 1604803 (0.0007) [2023-12-26 12:24:33,221][123091] Updated weights for policy 0, policy_version 1604813 (0.0010) [2023-12-26 12:24:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17886.0, 300 sec: 17689.2). Total num frames: 818946048. Throughput: 0: 8922.2, 1: 9011.0. Samples: 818959700. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:33,785][121949] Avg episode reward: [(0, '6171.941'), (1, '5743.697')] [2023-12-26 12:24:33,974][123090] Updated weights for policy 1, policy_version 1594185 (0.0008) [2023-12-26 12:24:33,982][123091] Updated weights for policy 0, policy_version 1604823 (0.0007) [2023-12-26 12:24:34,023][123090] Updated weights for policy 1, policy_version 1594195 (0.0008) [2023-12-26 12:24:34,032][123091] Updated weights for policy 0, policy_version 1604833 (0.0005) [2023-12-26 12:24:34,071][123090] Updated weights for policy 1, policy_version 1594205 (0.0008) [2023-12-26 12:24:34,089][123091] Updated weights for policy 0, policy_version 1604843 (0.0005) [2023-12-26 12:24:34,800][123091] Updated weights for policy 0, policy_version 1604853 (0.0006) [2023-12-26 12:24:34,863][123091] Updated weights for policy 0, policy_version 1604863 (0.0006) [2023-12-26 12:24:34,937][123091] Updated weights for policy 0, policy_version 1604873 (0.0005) [2023-12-26 12:24:34,965][123090] Updated weights for policy 1, policy_version 1594215 (0.0008) [2023-12-26 12:24:35,020][123090] Updated weights for policy 1, policy_version 1594225 (0.0010) [2023-12-26 12:24:35,069][123090] Updated weights for policy 1, policy_version 1594235 (0.0009) [2023-12-26 12:24:35,655][123091] Updated weights for policy 0, policy_version 1604883 (0.0006) [2023-12-26 12:24:35,714][123091] Updated weights for policy 0, policy_version 1604893 (0.0005) [2023-12-26 12:24:35,769][123091] Updated weights for policy 0, policy_version 1604903 (0.0005) [2023-12-26 12:24:35,970][123090] Updated weights for policy 1, policy_version 1594245 (0.0007) [2023-12-26 12:24:36,035][123090] Updated weights for policy 1, policy_version 1594255 (0.0006) [2023-12-26 12:24:36,097][123090] Updated weights for policy 1, policy_version 1594265 (0.0009) [2023-12-26 12:24:36,593][123091] Updated weights for policy 0, policy_version 1604913 (0.0007) [2023-12-26 12:24:36,663][123091] Updated weights for policy 0, policy_version 1604923 (0.0008) [2023-12-26 12:24:36,728][123091] Updated weights for policy 0, policy_version 1604933 (0.0009) [2023-12-26 12:24:36,792][123091] Updated weights for policy 0, policy_version 1604943 (0.0009) [2023-12-26 12:24:36,900][123090] Updated weights for policy 1, policy_version 1594275 (0.0009) [2023-12-26 12:24:36,958][123090] Updated weights for policy 1, policy_version 1594285 (0.0005) [2023-12-26 12:24:37,026][123090] Updated weights for policy 1, policy_version 1594295 (0.0011) [2023-12-26 12:24:37,651][123091] Updated weights for policy 0, policy_version 1604953 (0.0009) [2023-12-26 12:24:37,722][123091] Updated weights for policy 0, policy_version 1604963 (0.0009) [2023-12-26 12:24:37,766][123090] Updated weights for policy 1, policy_version 1594305 (0.0007) [2023-12-26 12:24:37,777][123091] Updated weights for policy 0, policy_version 1604973 (0.0009) [2023-12-26 12:24:37,839][123090] Updated weights for policy 1, policy_version 1594315 (0.0006) [2023-12-26 12:24:37,917][123090] Updated weights for policy 1, policy_version 1594325 (0.0006) [2023-12-26 12:24:37,988][123090] Updated weights for policy 1, policy_version 1594335 (0.0006) [2023-12-26 12:24:38,607][123091] Updated weights for policy 0, policy_version 1604983 (0.0007) [2023-12-26 12:24:38,667][123091] Updated weights for policy 0, policy_version 1604993 (0.0008) [2023-12-26 12:24:38,690][123090] Updated weights for policy 1, policy_version 1594345 (0.0008) [2023-12-26 12:24:38,733][123091] Updated weights for policy 0, policy_version 1605003 (0.0008) [2023-12-26 12:24:38,756][123090] Updated weights for policy 1, policy_version 1594355 (0.0008) [2023-12-26 12:24:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 819036160. Throughput: 0: 8989.7, 1: 9002.8. Samples: 819013508. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:38,785][121949] Avg episode reward: [(0, '6276.578'), (1, '5795.681')] [2023-12-26 12:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001605008_410886144.pth... [2023-12-26 12:24:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001603952_410615808.pth [2023-12-26 12:24:38,827][123090] Updated weights for policy 1, policy_version 1594365 (0.0009) [2023-12-26 12:24:38,847][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001594368_408158208.pth... [2023-12-26 12:24:38,853][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001593312_407887872.pth [2023-12-26 12:24:39,541][123090] Updated weights for policy 1, policy_version 1594375 (0.0009) [2023-12-26 12:24:39,565][123091] Updated weights for policy 0, policy_version 1605013 (0.0008) [2023-12-26 12:24:39,607][123090] Updated weights for policy 1, policy_version 1594385 (0.0008) [2023-12-26 12:24:39,631][123091] Updated weights for policy 0, policy_version 1605023 (0.0005) [2023-12-26 12:24:39,665][123090] Updated weights for policy 1, policy_version 1594395 (0.0009) [2023-12-26 12:24:39,705][123091] Updated weights for policy 0, policy_version 1605033 (0.0006) [2023-12-26 12:24:40,357][123091] Updated weights for policy 0, policy_version 1605043 (0.0007) [2023-12-26 12:24:40,412][123091] Updated weights for policy 0, policy_version 1605053 (0.0007) [2023-12-26 12:24:40,469][123091] Updated weights for policy 0, policy_version 1605063 (0.0007) [2023-12-26 12:24:40,554][123090] Updated weights for policy 1, policy_version 1594405 (0.0009) [2023-12-26 12:24:40,610][123090] Updated weights for policy 1, policy_version 1594415 (0.0010) [2023-12-26 12:24:40,669][123090] Updated weights for policy 1, policy_version 1594425 (0.0010) [2023-12-26 12:24:41,221][123091] Updated weights for policy 0, policy_version 1605073 (0.0009) [2023-12-26 12:24:41,287][123091] Updated weights for policy 0, policy_version 1605083 (0.0009) [2023-12-26 12:24:41,357][123091] Updated weights for policy 0, policy_version 1605093 (0.0010) [2023-12-26 12:24:41,425][123091] Updated weights for policy 0, policy_version 1605103 (0.0009) [2023-12-26 12:24:41,587][123090] Updated weights for policy 1, policy_version 1594435 (0.0009) [2023-12-26 12:24:41,661][123090] Updated weights for policy 1, policy_version 1594445 (0.0008) [2023-12-26 12:24:41,734][123090] Updated weights for policy 1, policy_version 1594455 (0.0007) [2023-12-26 12:24:42,305][123091] Updated weights for policy 0, policy_version 1605113 (0.0008) [2023-12-26 12:24:42,373][123091] Updated weights for policy 0, policy_version 1605123 (0.0008) [2023-12-26 12:24:42,440][123090] Updated weights for policy 1, policy_version 1594465 (0.0006) [2023-12-26 12:24:42,443][123091] Updated weights for policy 0, policy_version 1605133 (0.0006) [2023-12-26 12:24:42,498][123090] Updated weights for policy 1, policy_version 1594475 (0.0009) [2023-12-26 12:24:42,553][123090] Updated weights for policy 1, policy_version 1594485 (0.0010) [2023-12-26 12:24:42,607][123090] Updated weights for policy 1, policy_version 1594495 (0.0009) [2023-12-26 12:24:43,216][123091] Updated weights for policy 0, policy_version 1605143 (0.0008) [2023-12-26 12:24:43,267][123091] Updated weights for policy 0, policy_version 1605153 (0.0010) [2023-12-26 12:24:43,326][123091] Updated weights for policy 0, policy_version 1605164 (0.0007) [2023-12-26 12:24:43,456][123090] Updated weights for policy 1, policy_version 1594505 (0.0006) [2023-12-26 12:24:43,508][123090] Updated weights for policy 1, policy_version 1594515 (0.0005) [2023-12-26 12:24:43,554][123090] Updated weights for policy 1, policy_version 1594525 (0.0009) [2023-12-26 12:24:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 819126272. Throughput: 0: 8995.3, 1: 8925.1. Samples: 819117936. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:43,785][121949] Avg episode reward: [(0, '6366.750'), (1, '5981.556')] [2023-12-26 12:24:44,089][123091] Updated weights for policy 0, policy_version 1605174 (0.0008) [2023-12-26 12:24:44,146][123091] Updated weights for policy 0, policy_version 1605184 (0.0009) [2023-12-26 12:24:44,201][123091] Updated weights for policy 0, policy_version 1605195 (0.0009) [2023-12-26 12:24:44,302][123090] Updated weights for policy 1, policy_version 1594535 (0.0006) [2023-12-26 12:24:44,368][123090] Updated weights for policy 1, policy_version 1594545 (0.0005) [2023-12-26 12:24:44,422][123090] Updated weights for policy 1, policy_version 1594555 (0.0005) [2023-12-26 12:24:45,136][123091] Updated weights for policy 0, policy_version 1605205 (0.0009) [2023-12-26 12:24:45,143][123090] Updated weights for policy 1, policy_version 1594565 (0.0008) [2023-12-26 12:24:45,191][123091] Updated weights for policy 0, policy_version 1605215 (0.0006) [2023-12-26 12:24:45,200][123090] Updated weights for policy 1, policy_version 1594575 (0.0008) [2023-12-26 12:24:45,249][123091] Updated weights for policy 0, policy_version 1605225 (0.0009) [2023-12-26 12:24:45,262][123090] Updated weights for policy 1, policy_version 1594585 (0.0006) [2023-12-26 12:24:45,958][123090] Updated weights for policy 1, policy_version 1594595 (0.0008) [2023-12-26 12:24:46,032][123090] Updated weights for policy 1, policy_version 1594605 (0.0010) [2023-12-26 12:24:46,075][123090] Updated weights for policy 1, policy_version 1594615 (0.0010) [2023-12-26 12:24:46,132][123091] Updated weights for policy 0, policy_version 1605235 (0.0009) [2023-12-26 12:24:46,184][123091] Updated weights for policy 0, policy_version 1605245 (0.0008) [2023-12-26 12:24:46,233][123091] Updated weights for policy 0, policy_version 1605255 (0.0009) [2023-12-26 12:24:46,840][123090] Updated weights for policy 1, policy_version 1594625 (0.0010) [2023-12-26 12:24:46,909][123090] Updated weights for policy 1, policy_version 1594635 (0.0006) [2023-12-26 12:24:46,966][123090] Updated weights for policy 1, policy_version 1594645 (0.0005) [2023-12-26 12:24:47,030][123090] Updated weights for policy 1, policy_version 1594655 (0.0005) [2023-12-26 12:24:47,100][123091] Updated weights for policy 0, policy_version 1605265 (0.0008) [2023-12-26 12:24:47,173][123091] Updated weights for policy 0, policy_version 1605275 (0.0008) [2023-12-26 12:24:47,234][123091] Updated weights for policy 0, policy_version 1605285 (0.0008) [2023-12-26 12:24:47,300][123091] Updated weights for policy 0, policy_version 1605295 (0.0009) [2023-12-26 12:24:47,617][123090] Updated weights for policy 1, policy_version 1594665 (0.0009) [2023-12-26 12:24:47,682][123090] Updated weights for policy 1, policy_version 1594675 (0.0009) [2023-12-26 12:24:47,752][123090] Updated weights for policy 1, policy_version 1594685 (0.0005) [2023-12-26 12:24:48,135][123091] Updated weights for policy 0, policy_version 1605305 (0.0006) [2023-12-26 12:24:48,198][123091] Updated weights for policy 0, policy_version 1605315 (0.0005) [2023-12-26 12:24:48,244][123091] Updated weights for policy 0, policy_version 1605325 (0.0005) [2023-12-26 12:24:48,373][123090] Updated weights for policy 1, policy_version 1594695 (0.0007) [2023-12-26 12:24:48,438][123090] Updated weights for policy 1, policy_version 1594705 (0.0007) [2023-12-26 12:24:48,502][123090] Updated weights for policy 1, policy_version 1594715 (0.0010) [2023-12-26 12:24:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 819216384. Throughput: 0: 9004.2, 1: 9067.8. Samples: 819227280. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:48,785][121949] Avg episode reward: [(0, '6330.966'), (1, '5847.129')] [2023-12-26 12:24:49,008][123091] Updated weights for policy 0, policy_version 1605335 (0.0008) [2023-12-26 12:24:49,066][123091] Updated weights for policy 0, policy_version 1605345 (0.0007) [2023-12-26 12:24:49,131][123091] Updated weights for policy 0, policy_version 1605355 (0.0007) [2023-12-26 12:24:49,372][123090] Updated weights for policy 1, policy_version 1594725 (0.0009) [2023-12-26 12:24:49,446][123090] Updated weights for policy 1, policy_version 1594735 (0.0006) [2023-12-26 12:24:49,510][123090] Updated weights for policy 1, policy_version 1594745 (0.0006) [2023-12-26 12:24:49,967][123091] Updated weights for policy 0, policy_version 1605365 (0.0009) [2023-12-26 12:24:50,024][123091] Updated weights for policy 0, policy_version 1605375 (0.0010) [2023-12-26 12:24:50,081][123091] Updated weights for policy 0, policy_version 1605385 (0.0010) [2023-12-26 12:24:50,235][123090] Updated weights for policy 1, policy_version 1594755 (0.0006) [2023-12-26 12:24:50,299][123090] Updated weights for policy 1, policy_version 1594765 (0.0010) [2023-12-26 12:24:50,353][123090] Updated weights for policy 1, policy_version 1594775 (0.0009) [2023-12-26 12:24:50,972][123091] Updated weights for policy 0, policy_version 1605395 (0.0010) [2023-12-26 12:24:51,030][123091] Updated weights for policy 0, policy_version 1605405 (0.0008) [2023-12-26 12:24:51,097][123091] Updated weights for policy 0, policy_version 1605415 (0.0009) [2023-12-26 12:24:51,149][123090] Updated weights for policy 1, policy_version 1594785 (0.0008) [2023-12-26 12:24:51,214][123090] Updated weights for policy 1, policy_version 1594795 (0.0010) [2023-12-26 12:24:51,288][123090] Updated weights for policy 1, policy_version 1594805 (0.0009) [2023-12-26 12:24:51,349][123090] Updated weights for policy 1, policy_version 1594815 (0.0009) [2023-12-26 12:24:51,914][123091] Updated weights for policy 0, policy_version 1605425 (0.0009) [2023-12-26 12:24:51,967][123091] Updated weights for policy 0, policy_version 1605435 (0.0009) [2023-12-26 12:24:52,016][123091] Updated weights for policy 0, policy_version 1605445 (0.0009) [2023-12-26 12:24:52,065][123091] Updated weights for policy 0, policy_version 1605455 (0.0009) [2023-12-26 12:24:52,277][123090] Updated weights for policy 1, policy_version 1594825 (0.0009) [2023-12-26 12:24:52,338][123090] Updated weights for policy 1, policy_version 1594835 (0.0009) [2023-12-26 12:24:52,412][123090] Updated weights for policy 1, policy_version 1594845 (0.0009) [2023-12-26 12:24:52,937][123091] Updated weights for policy 0, policy_version 1605465 (0.0010) [2023-12-26 12:24:52,984][123091] Updated weights for policy 0, policy_version 1605475 (0.0010) [2023-12-26 12:24:53,034][123091] Updated weights for policy 0, policy_version 1605485 (0.0010) [2023-12-26 12:24:53,173][123090] Updated weights for policy 1, policy_version 1594855 (0.0007) [2023-12-26 12:24:53,246][123090] Updated weights for policy 1, policy_version 1594865 (0.0005) [2023-12-26 12:24:53,309][123090] Updated weights for policy 1, policy_version 1594875 (0.0007) [2023-12-26 12:24:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 819298304. Throughput: 0: 8929.6, 1: 9099.1. Samples: 819278724. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:53,785][121949] Avg episode reward: [(0, '6239.526'), (1, '5566.219')] [2023-12-26 12:24:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001605488_411009024.pth... [2023-12-26 12:24:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001594880_408289280.pth... [2023-12-26 12:24:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001604464_410746880.pth [2023-12-26 12:24:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001593824_408018944.pth [2023-12-26 12:24:53,865][123091] Updated weights for policy 0, policy_version 1605495 (0.0010) [2023-12-26 12:24:53,921][123091] Updated weights for policy 0, policy_version 1605505 (0.0009) [2023-12-26 12:24:53,968][123090] Updated weights for policy 1, policy_version 1594885 (0.0009) [2023-12-26 12:24:53,975][123091] Updated weights for policy 0, policy_version 1605515 (0.0007) [2023-12-26 12:24:54,029][123090] Updated weights for policy 1, policy_version 1594895 (0.0008) [2023-12-26 12:24:54,094][123090] Updated weights for policy 1, policy_version 1594905 (0.0009) [2023-12-26 12:24:54,836][123091] Updated weights for policy 0, policy_version 1605525 (0.0010) [2023-12-26 12:24:54,902][123091] Updated weights for policy 0, policy_version 1605535 (0.0009) [2023-12-26 12:24:54,908][123090] Updated weights for policy 1, policy_version 1594915 (0.0008) [2023-12-26 12:24:54,969][123091] Updated weights for policy 0, policy_version 1605545 (0.0006) [2023-12-26 12:24:54,970][123090] Updated weights for policy 1, policy_version 1594925 (0.0006) [2023-12-26 12:24:55,046][123090] Updated weights for policy 1, policy_version 1594935 (0.0006) [2023-12-26 12:24:55,664][123091] Updated weights for policy 0, policy_version 1605555 (0.0006) [2023-12-26 12:24:55,721][123090] Updated weights for policy 1, policy_version 1594945 (0.0005) [2023-12-26 12:24:55,736][123091] Updated weights for policy 0, policy_version 1605565 (0.0006) [2023-12-26 12:24:55,781][123090] Updated weights for policy 1, policy_version 1594955 (0.0008) [2023-12-26 12:24:55,797][123091] Updated weights for policy 0, policy_version 1605575 (0.0006) [2023-12-26 12:24:55,845][123090] Updated weights for policy 1, policy_version 1594965 (0.0009) [2023-12-26 12:24:55,914][123090] Updated weights for policy 1, policy_version 1594975 (0.0009) [2023-12-26 12:24:56,516][123091] Updated weights for policy 0, policy_version 1605585 (0.0009) [2023-12-26 12:24:56,580][123091] Updated weights for policy 0, policy_version 1605595 (0.0005) [2023-12-26 12:24:56,653][123091] Updated weights for policy 0, policy_version 1605605 (0.0005) [2023-12-26 12:24:56,713][123091] Updated weights for policy 0, policy_version 1605615 (0.0007) [2023-12-26 12:24:56,750][123090] Updated weights for policy 1, policy_version 1594985 (0.0008) [2023-12-26 12:24:56,797][123090] Updated weights for policy 1, policy_version 1594995 (0.0008) [2023-12-26 12:24:56,846][123090] Updated weights for policy 1, policy_version 1595005 (0.0006) [2023-12-26 12:24:57,439][123091] Updated weights for policy 0, policy_version 1605625 (0.0010) [2023-12-26 12:24:57,508][123091] Updated weights for policy 0, policy_version 1605635 (0.0010) [2023-12-26 12:24:57,577][123091] Updated weights for policy 0, policy_version 1605645 (0.0010) [2023-12-26 12:24:57,617][123090] Updated weights for policy 1, policy_version 1595015 (0.0008) [2023-12-26 12:24:57,671][123090] Updated weights for policy 1, policy_version 1595026 (0.0009) [2023-12-26 12:24:57,719][123090] Updated weights for policy 1, policy_version 1595036 (0.0008) [2023-12-26 12:24:58,354][123091] Updated weights for policy 0, policy_version 1605655 (0.0009) [2023-12-26 12:24:58,428][123091] Updated weights for policy 0, policy_version 1605665 (0.0006) [2023-12-26 12:24:58,496][123091] Updated weights for policy 0, policy_version 1605675 (0.0007) [2023-12-26 12:24:58,588][123090] Updated weights for policy 1, policy_version 1595046 (0.0008) [2023-12-26 12:24:58,646][123090] Updated weights for policy 1, policy_version 1595056 (0.0009) [2023-12-26 12:24:58,713][123090] Updated weights for policy 1, policy_version 1595066 (0.0009) [2023-12-26 12:24:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 819396608. Throughput: 0: 8956.5, 1: 9111.8. Samples: 819386424. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:24:58,785][121949] Avg episode reward: [(0, '6180.150'), (1, '5714.844')] [2023-12-26 12:24:59,250][123091] Updated weights for policy 0, policy_version 1605685 (0.0008) [2023-12-26 12:24:59,311][123091] Updated weights for policy 0, policy_version 1605695 (0.0008) [2023-12-26 12:24:59,377][123091] Updated weights for policy 0, policy_version 1605705 (0.0008) [2023-12-26 12:24:59,533][123090] Updated weights for policy 1, policy_version 1595076 (0.0009) [2023-12-26 12:24:59,591][123090] Updated weights for policy 1, policy_version 1595086 (0.0009) [2023-12-26 12:24:59,647][123090] Updated weights for policy 1, policy_version 1595096 (0.0008) [2023-12-26 12:25:00,154][123091] Updated weights for policy 0, policy_version 1605715 (0.0006) [2023-12-26 12:25:00,214][123091] Updated weights for policy 0, policy_version 1605725 (0.0005) [2023-12-26 12:25:00,278][123091] Updated weights for policy 0, policy_version 1605735 (0.0008) [2023-12-26 12:25:00,495][123090] Updated weights for policy 1, policy_version 1595106 (0.0008) [2023-12-26 12:25:00,575][123090] Updated weights for policy 1, policy_version 1595116 (0.0005) [2023-12-26 12:25:00,633][123090] Updated weights for policy 1, policy_version 1595126 (0.0005) [2023-12-26 12:25:00,692][123090] Updated weights for policy 1, policy_version 1595136 (0.0005) [2023-12-26 12:25:00,984][123091] Updated weights for policy 0, policy_version 1605745 (0.0008) [2023-12-26 12:25:01,055][123091] Updated weights for policy 0, policy_version 1605755 (0.0009) [2023-12-26 12:25:01,119][123091] Updated weights for policy 0, policy_version 1605765 (0.0010) [2023-12-26 12:25:01,183][123091] Updated weights for policy 0, policy_version 1605775 (0.0009) [2023-12-26 12:25:01,366][123090] Updated weights for policy 1, policy_version 1595146 (0.0008) [2023-12-26 12:25:01,428][123090] Updated weights for policy 1, policy_version 1595156 (0.0007) [2023-12-26 12:25:01,482][123090] Updated weights for policy 1, policy_version 1595166 (0.0005) [2023-12-26 12:25:02,057][123091] Updated weights for policy 0, policy_version 1605785 (0.0007) [2023-12-26 12:25:02,114][123091] Updated weights for policy 0, policy_version 1605795 (0.0010) [2023-12-26 12:25:02,170][123091] Updated weights for policy 0, policy_version 1605806 (0.0010) [2023-12-26 12:25:02,270][123090] Updated weights for policy 1, policy_version 1595176 (0.0008) [2023-12-26 12:25:02,334][123090] Updated weights for policy 1, policy_version 1595186 (0.0009) [2023-12-26 12:25:02,401][123090] Updated weights for policy 1, policy_version 1595196 (0.0009) [2023-12-26 12:25:02,887][123091] Updated weights for policy 0, policy_version 1605816 (0.0010) [2023-12-26 12:25:02,948][123091] Updated weights for policy 0, policy_version 1605826 (0.0009) [2023-12-26 12:25:02,996][123091] Updated weights for policy 0, policy_version 1605836 (0.0009) [2023-12-26 12:25:03,216][123090] Updated weights for policy 1, policy_version 1595206 (0.0010) [2023-12-26 12:25:03,281][123090] Updated weights for policy 1, policy_version 1595216 (0.0009) [2023-12-26 12:25:03,345][123090] Updated weights for policy 1, policy_version 1595226 (0.0009) [2023-12-26 12:25:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 819478528. Throughput: 0: 8867.6, 1: 9014.7. Samples: 819493132. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:03,784][121949] Avg episode reward: [(0, '6223.591'), (1, '5693.854')] [2023-12-26 12:25:03,833][123091] Updated weights for policy 0, policy_version 1605846 (0.0010) [2023-12-26 12:25:03,905][123091] Updated weights for policy 0, policy_version 1605856 (0.0009) [2023-12-26 12:25:03,965][123091] Updated weights for policy 0, policy_version 1605866 (0.0009) [2023-12-26 12:25:04,148][123090] Updated weights for policy 1, policy_version 1595236 (0.0010) [2023-12-26 12:25:04,217][123090] Updated weights for policy 1, policy_version 1595246 (0.0009) [2023-12-26 12:25:04,279][123090] Updated weights for policy 1, policy_version 1595256 (0.0009) [2023-12-26 12:25:04,793][123091] Updated weights for policy 0, policy_version 1605876 (0.0009) [2023-12-26 12:25:04,849][123091] Updated weights for policy 0, policy_version 1605886 (0.0009) [2023-12-26 12:25:04,910][123091] Updated weights for policy 0, policy_version 1605896 (0.0009) [2023-12-26 12:25:05,098][123090] Updated weights for policy 1, policy_version 1595266 (0.0010) [2023-12-26 12:25:05,152][123090] Updated weights for policy 1, policy_version 1595276 (0.0009) [2023-12-26 12:25:05,202][123090] Updated weights for policy 1, policy_version 1595286 (0.0009) [2023-12-26 12:25:05,264][123090] Updated weights for policy 1, policy_version 1595296 (0.0010) [2023-12-26 12:25:05,747][123091] Updated weights for policy 0, policy_version 1605906 (0.0009) [2023-12-26 12:25:05,806][123091] Updated weights for policy 0, policy_version 1605916 (0.0010) [2023-12-26 12:25:05,878][123091] Updated weights for policy 0, policy_version 1605926 (0.0010) [2023-12-26 12:25:05,937][123091] Updated weights for policy 0, policy_version 1605936 (0.0009) [2023-12-26 12:25:06,013][123090] Updated weights for policy 1, policy_version 1595306 (0.0005) [2023-12-26 12:25:06,088][123090] Updated weights for policy 1, policy_version 1595316 (0.0008) [2023-12-26 12:25:06,159][123090] Updated weights for policy 1, policy_version 1595326 (0.0009) [2023-12-26 12:25:06,819][123091] Updated weights for policy 0, policy_version 1605946 (0.0009) [2023-12-26 12:25:06,875][123091] Updated weights for policy 0, policy_version 1605956 (0.0010) [2023-12-26 12:25:06,878][123090] Updated weights for policy 1, policy_version 1595336 (0.0006) [2023-12-26 12:25:06,936][123090] Updated weights for policy 1, policy_version 1595346 (0.0005) [2023-12-26 12:25:06,938][123091] Updated weights for policy 0, policy_version 1605966 (0.0009) [2023-12-26 12:25:07,006][123090] Updated weights for policy 1, policy_version 1595356 (0.0007) [2023-12-26 12:25:07,787][123090] Updated weights for policy 1, policy_version 1595366 (0.0010) [2023-12-26 12:25:07,798][123091] Updated weights for policy 0, policy_version 1605976 (0.0007) [2023-12-26 12:25:07,854][123090] Updated weights for policy 1, policy_version 1595376 (0.0009) [2023-12-26 12:25:07,860][123091] Updated weights for policy 0, policy_version 1605986 (0.0007) [2023-12-26 12:25:07,914][123090] Updated weights for policy 1, policy_version 1595386 (0.0008) [2023-12-26 12:25:07,923][123091] Updated weights for policy 0, policy_version 1605996 (0.0008) [2023-12-26 12:25:08,752][123090] Updated weights for policy 1, policy_version 1595396 (0.0009) [2023-12-26 12:25:08,763][123091] Updated weights for policy 0, policy_version 1606006 (0.0007) [2023-12-26 12:25:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 819560448. Throughput: 0: 8858.9, 1: 9019.1. Samples: 819544696. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:08,785][121949] Avg episode reward: [(0, '6201.480'), (1, '5644.213')] [2023-12-26 12:25:08,812][123090] Updated weights for policy 1, policy_version 1595406 (0.0010) [2023-12-26 12:25:08,819][123091] Updated weights for policy 0, policy_version 1606016 (0.0006) [2023-12-26 12:25:08,871][123090] Updated weights for policy 1, policy_version 1595416 (0.0010) [2023-12-26 12:25:08,878][123091] Updated weights for policy 0, policy_version 1606026 (0.0006) [2023-12-26 12:25:08,909][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001606032_411148288.pth... [2023-12-26 12:25:08,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001605008_410886144.pth [2023-12-26 12:25:08,919][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001595424_408428544.pth... [2023-12-26 12:25:08,923][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001594368_408158208.pth [2023-12-26 12:25:09,649][123090] Updated weights for policy 1, policy_version 1595426 (0.0010) [2023-12-26 12:25:09,703][123090] Updated weights for policy 1, policy_version 1595436 (0.0006) [2023-12-26 12:25:09,755][123091] Updated weights for policy 0, policy_version 1606036 (0.0009) [2023-12-26 12:25:09,759][123090] Updated weights for policy 1, policy_version 1595446 (0.0009) [2023-12-26 12:25:09,807][123091] Updated weights for policy 0, policy_version 1606046 (0.0009) [2023-12-26 12:25:09,813][123090] Updated weights for policy 1, policy_version 1595456 (0.0010) [2023-12-26 12:25:09,867][123091] Updated weights for policy 0, policy_version 1606056 (0.0009) [2023-12-26 12:25:10,632][123090] Updated weights for policy 1, policy_version 1595466 (0.0005) [2023-12-26 12:25:10,689][123090] Updated weights for policy 1, policy_version 1595476 (0.0005) [2023-12-26 12:25:10,741][123090] Updated weights for policy 1, policy_version 1595486 (0.0005) [2023-12-26 12:25:10,769][123091] Updated weights for policy 0, policy_version 1606066 (0.0010) [2023-12-26 12:25:10,827][123091] Updated weights for policy 0, policy_version 1606076 (0.0010) [2023-12-26 12:25:10,896][123091] Updated weights for policy 0, policy_version 1606086 (0.0009) [2023-12-26 12:25:10,958][123091] Updated weights for policy 0, policy_version 1606096 (0.0010) [2023-12-26 12:25:11,528][123090] Updated weights for policy 1, policy_version 1595496 (0.0009) [2023-12-26 12:25:11,578][123090] Updated weights for policy 1, policy_version 1595506 (0.0009) [2023-12-26 12:25:11,632][123090] Updated weights for policy 1, policy_version 1595516 (0.0009) [2023-12-26 12:25:11,867][123091] Updated weights for policy 0, policy_version 1606106 (0.0006) [2023-12-26 12:25:11,921][123091] Updated weights for policy 0, policy_version 1606116 (0.0007) [2023-12-26 12:25:11,988][123091] Updated weights for policy 0, policy_version 1606126 (0.0009) [2023-12-26 12:25:12,535][123090] Updated weights for policy 1, policy_version 1595526 (0.0009) [2023-12-26 12:25:12,593][123090] Updated weights for policy 1, policy_version 1595536 (0.0009) [2023-12-26 12:25:12,654][123090] Updated weights for policy 1, policy_version 1595546 (0.0010) [2023-12-26 12:25:12,717][123091] Updated weights for policy 0, policy_version 1606136 (0.0008) [2023-12-26 12:25:12,774][123091] Updated weights for policy 0, policy_version 1606146 (0.0006) [2023-12-26 12:25:12,835][123091] Updated weights for policy 0, policy_version 1606156 (0.0009) [2023-12-26 12:25:13,493][123090] Updated weights for policy 1, policy_version 1595556 (0.0010) [2023-12-26 12:25:13,562][123090] Updated weights for policy 1, policy_version 1595566 (0.0009) [2023-12-26 12:25:13,621][123090] Updated weights for policy 1, policy_version 1595576 (0.0009) [2023-12-26 12:25:13,641][123091] Updated weights for policy 0, policy_version 1606166 (0.0009) [2023-12-26 12:25:13,698][123091] Updated weights for policy 0, policy_version 1606176 (0.0007) [2023-12-26 12:25:13,762][123091] Updated weights for policy 0, policy_version 1606186 (0.0005) [2023-12-26 12:25:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 819650560. Throughput: 0: 8775.4, 1: 8910.4. Samples: 819647468. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:13,784][121949] Avg episode reward: [(0, '6207.756'), (1, '5982.183')] [2023-12-26 12:25:14,330][123090] Updated weights for policy 1, policy_version 1595586 (0.0007) [2023-12-26 12:25:14,401][123091] Updated weights for policy 0, policy_version 1606196 (0.0007) [2023-12-26 12:25:14,402][123090] Updated weights for policy 1, policy_version 1595596 (0.0005) [2023-12-26 12:25:14,468][123090] Updated weights for policy 1, policy_version 1595606 (0.0006) [2023-12-26 12:25:14,468][123091] Updated weights for policy 0, policy_version 1606206 (0.0009) [2023-12-26 12:25:14,526][123091] Updated weights for policy 0, policy_version 1606216 (0.0010) [2023-12-26 12:25:14,534][123090] Updated weights for policy 1, policy_version 1595616 (0.0006) [2023-12-26 12:25:15,211][123090] Updated weights for policy 1, policy_version 1595626 (0.0006) [2023-12-26 12:25:15,280][123090] Updated weights for policy 1, policy_version 1595636 (0.0006) [2023-12-26 12:25:15,350][123090] Updated weights for policy 1, policy_version 1595646 (0.0006) [2023-12-26 12:25:15,378][123091] Updated weights for policy 0, policy_version 1606226 (0.0009) [2023-12-26 12:25:15,430][123091] Updated weights for policy 0, policy_version 1606236 (0.0009) [2023-12-26 12:25:15,485][123091] Updated weights for policy 0, policy_version 1606246 (0.0010) [2023-12-26 12:25:15,537][123091] Updated weights for policy 0, policy_version 1606256 (0.0009) [2023-12-26 12:25:16,032][123090] Updated weights for policy 1, policy_version 1595656 (0.0009) [2023-12-26 12:25:16,085][123090] Updated weights for policy 1, policy_version 1595666 (0.0009) [2023-12-26 12:25:16,144][123090] Updated weights for policy 1, policy_version 1595676 (0.0009) [2023-12-26 12:25:16,409][123091] Updated weights for policy 0, policy_version 1606266 (0.0009) [2023-12-26 12:25:16,468][123091] Updated weights for policy 0, policy_version 1606276 (0.0009) [2023-12-26 12:25:16,523][123091] Updated weights for policy 0, policy_version 1606286 (0.0008) [2023-12-26 12:25:16,995][123090] Updated weights for policy 1, policy_version 1595686 (0.0010) [2023-12-26 12:25:17,050][123090] Updated weights for policy 1, policy_version 1595696 (0.0010) [2023-12-26 12:25:17,105][123090] Updated weights for policy 1, policy_version 1595706 (0.0010) [2023-12-26 12:25:17,343][123091] Updated weights for policy 0, policy_version 1606296 (0.0008) [2023-12-26 12:25:17,395][123091] Updated weights for policy 0, policy_version 1606306 (0.0009) [2023-12-26 12:25:17,447][123091] Updated weights for policy 0, policy_version 1606316 (0.0009) [2023-12-26 12:25:17,757][123090] Updated weights for policy 1, policy_version 1595716 (0.0010) [2023-12-26 12:25:17,808][123090] Updated weights for policy 1, policy_version 1595726 (0.0010) [2023-12-26 12:25:17,872][123090] Updated weights for policy 1, policy_version 1595736 (0.0010) [2023-12-26 12:25:18,358][123091] Updated weights for policy 0, policy_version 1606326 (0.0010) [2023-12-26 12:25:18,422][123091] Updated weights for policy 0, policy_version 1606336 (0.0009) [2023-12-26 12:25:18,490][123091] Updated weights for policy 0, policy_version 1606346 (0.0009) [2023-12-26 12:25:18,636][123090] Updated weights for policy 1, policy_version 1595746 (0.0006) [2023-12-26 12:25:18,692][123090] Updated weights for policy 1, policy_version 1595756 (0.0006) [2023-12-26 12:25:18,754][123090] Updated weights for policy 1, policy_version 1595766 (0.0005) [2023-12-26 12:25:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 819740672. Throughput: 0: 8693.7, 1: 8974.5. Samples: 819754768. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:18,785][121949] Avg episode reward: [(0, '6204.848'), (1, '5942.190')] [2023-12-26 12:25:18,822][123090] Updated weights for policy 1, policy_version 1595776 (0.0006) [2023-12-26 12:25:19,350][123091] Updated weights for policy 0, policy_version 1606356 (0.0009) [2023-12-26 12:25:19,420][123091] Updated weights for policy 0, policy_version 1606366 (0.0009) [2023-12-26 12:25:19,490][123091] Updated weights for policy 0, policy_version 1606377 (0.0010) [2023-12-26 12:25:19,603][123090] Updated weights for policy 1, policy_version 1595786 (0.0010) [2023-12-26 12:25:19,668][123090] Updated weights for policy 1, policy_version 1595796 (0.0010) [2023-12-26 12:25:19,737][123090] Updated weights for policy 1, policy_version 1595806 (0.0008) [2023-12-26 12:25:20,290][123091] Updated weights for policy 0, policy_version 1606387 (0.0009) [2023-12-26 12:25:20,356][123091] Updated weights for policy 0, policy_version 1606397 (0.0009) [2023-12-26 12:25:20,424][123091] Updated weights for policy 0, policy_version 1606407 (0.0010) [2023-12-26 12:25:20,612][123090] Updated weights for policy 1, policy_version 1595816 (0.0009) [2023-12-26 12:25:20,679][123090] Updated weights for policy 1, policy_version 1595826 (0.0010) [2023-12-26 12:25:20,745][123090] Updated weights for policy 1, policy_version 1595836 (0.0010) [2023-12-26 12:25:21,251][123091] Updated weights for policy 0, policy_version 1606417 (0.0010) [2023-12-26 12:25:21,317][123091] Updated weights for policy 0, policy_version 1606427 (0.0010) [2023-12-26 12:25:21,396][123091] Updated weights for policy 0, policy_version 1606437 (0.0010) [2023-12-26 12:25:21,464][123091] Updated weights for policy 0, policy_version 1606447 (0.0009) [2023-12-26 12:25:21,626][123090] Updated weights for policy 1, policy_version 1595846 (0.0008) [2023-12-26 12:25:21,700][123090] Updated weights for policy 1, policy_version 1595856 (0.0008) [2023-12-26 12:25:21,773][123090] Updated weights for policy 1, policy_version 1595866 (0.0009) [2023-12-26 12:25:22,329][123091] Updated weights for policy 0, policy_version 1606457 (0.0010) [2023-12-26 12:25:22,400][123091] Updated weights for policy 0, policy_version 1606467 (0.0010) [2023-12-26 12:25:22,462][123091] Updated weights for policy 0, policy_version 1606477 (0.0010) [2023-12-26 12:25:22,583][123090] Updated weights for policy 1, policy_version 1595876 (0.0009) [2023-12-26 12:25:22,637][123090] Updated weights for policy 1, policy_version 1595886 (0.0010) [2023-12-26 12:25:22,689][123090] Updated weights for policy 1, policy_version 1595896 (0.0009) [2023-12-26 12:25:23,253][123091] Updated weights for policy 0, policy_version 1606487 (0.0007) [2023-12-26 12:25:23,323][123091] Updated weights for policy 0, policy_version 1606497 (0.0006) [2023-12-26 12:25:23,387][123091] Updated weights for policy 0, policy_version 1606507 (0.0006) [2023-12-26 12:25:23,472][123090] Updated weights for policy 1, policy_version 1595906 (0.0008) [2023-12-26 12:25:23,530][123090] Updated weights for policy 1, policy_version 1595916 (0.0010) [2023-12-26 12:25:23,581][123090] Updated weights for policy 1, policy_version 1595926 (0.0009) [2023-12-26 12:25:23,784][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 819830784. Throughput: 0: 8614.2, 1: 8975.9. Samples: 819805064. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:23,786][121949] Avg episode reward: [(0, '6132.278'), (1, '5804.905')] [2023-12-26 12:25:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001606512_411271168.pth... [2023-12-26 12:25:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001595936_408559616.pth... [2023-12-26 12:25:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001605488_411009024.pth [2023-12-26 12:25:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001594880_408289280.pth [2023-12-26 12:25:24,061][123091] Updated weights for policy 0, policy_version 1606517 (0.0010) [2023-12-26 12:25:24,119][123091] Updated weights for policy 0, policy_version 1606527 (0.0010) [2023-12-26 12:25:24,177][123091] Updated weights for policy 0, policy_version 1606537 (0.0010) [2023-12-26 12:25:24,342][123090] Updated weights for policy 1, policy_version 1595937 (0.0010) [2023-12-26 12:25:24,412][123090] Updated weights for policy 1, policy_version 1595947 (0.0009) [2023-12-26 12:25:24,471][123090] Updated weights for policy 1, policy_version 1595957 (0.0009) [2023-12-26 12:25:24,534][123090] Updated weights for policy 1, policy_version 1595967 (0.0009) [2023-12-26 12:25:25,021][123091] Updated weights for policy 0, policy_version 1606547 (0.0010) [2023-12-26 12:25:25,074][123091] Updated weights for policy 0, policy_version 1606557 (0.0011) [2023-12-26 12:25:25,122][123091] Updated weights for policy 0, policy_version 1606567 (0.0010) [2023-12-26 12:25:25,349][123090] Updated weights for policy 1, policy_version 1595977 (0.0009) [2023-12-26 12:25:25,420][123090] Updated weights for policy 1, policy_version 1595987 (0.0009) [2023-12-26 12:25:25,474][123090] Updated weights for policy 1, policy_version 1595997 (0.0008) [2023-12-26 12:25:25,917][123091] Updated weights for policy 0, policy_version 1606577 (0.0010) [2023-12-26 12:25:25,979][123091] Updated weights for policy 0, policy_version 1606587 (0.0010) [2023-12-26 12:25:26,044][123091] Updated weights for policy 0, policy_version 1606597 (0.0010) [2023-12-26 12:25:26,114][123091] Updated weights for policy 0, policy_version 1606607 (0.0011) [2023-12-26 12:25:26,294][123090] Updated weights for policy 1, policy_version 1596007 (0.0009) [2023-12-26 12:25:26,347][123090] Updated weights for policy 1, policy_version 1596017 (0.0009) [2023-12-26 12:25:26,404][123090] Updated weights for policy 1, policy_version 1596027 (0.0008) [2023-12-26 12:25:26,914][123091] Updated weights for policy 0, policy_version 1606617 (0.0010) [2023-12-26 12:25:26,970][123091] Updated weights for policy 0, policy_version 1606627 (0.0009) [2023-12-26 12:25:27,021][123091] Updated weights for policy 0, policy_version 1606637 (0.0009) [2023-12-26 12:25:27,239][123090] Updated weights for policy 1, policy_version 1596037 (0.0009) [2023-12-26 12:25:27,288][123090] Updated weights for policy 1, policy_version 1596047 (0.0009) [2023-12-26 12:25:27,337][123090] Updated weights for policy 1, policy_version 1596057 (0.0009) [2023-12-26 12:25:27,788][123091] Updated weights for policy 0, policy_version 1606647 (0.0007) [2023-12-26 12:25:27,841][123091] Updated weights for policy 0, policy_version 1606657 (0.0006) [2023-12-26 12:25:27,905][123091] Updated weights for policy 0, policy_version 1606667 (0.0006) [2023-12-26 12:25:28,231][123090] Updated weights for policy 1, policy_version 1596067 (0.0009) [2023-12-26 12:25:28,300][123090] Updated weights for policy 1, policy_version 1596077 (0.0009) [2023-12-26 12:25:28,366][123090] Updated weights for policy 1, policy_version 1596087 (0.0008) [2023-12-26 12:25:28,655][123091] Updated weights for policy 0, policy_version 1606677 (0.0009) [2023-12-26 12:25:28,707][123091] Updated weights for policy 0, policy_version 1606687 (0.0009) [2023-12-26 12:25:28,768][123091] Updated weights for policy 0, policy_version 1606697 (0.0010) [2023-12-26 12:25:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 819912704. Throughput: 0: 8634.7, 1: 8987.7. Samples: 819910940. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:28,785][121949] Avg episode reward: [(0, '6205.101'), (1, '5849.938')] [2023-12-26 12:25:29,193][123090] Updated weights for policy 1, policy_version 1596097 (0.0008) [2023-12-26 12:25:29,261][123090] Updated weights for policy 1, policy_version 1596107 (0.0009) [2023-12-26 12:25:29,327][123090] Updated weights for policy 1, policy_version 1596117 (0.0008) [2023-12-26 12:25:29,393][123090] Updated weights for policy 1, policy_version 1596127 (0.0012) [2023-12-26 12:25:29,583][123091] Updated weights for policy 0, policy_version 1606707 (0.0009) [2023-12-26 12:25:29,655][123091] Updated weights for policy 0, policy_version 1606717 (0.0006) [2023-12-26 12:25:29,721][123091] Updated weights for policy 0, policy_version 1606727 (0.0007) [2023-12-26 12:25:30,280][123090] Updated weights for policy 1, policy_version 1596137 (0.0007) [2023-12-26 12:25:30,339][123090] Updated weights for policy 1, policy_version 1596147 (0.0006) [2023-12-26 12:25:30,395][123090] Updated weights for policy 1, policy_version 1596157 (0.0005) [2023-12-26 12:25:30,505][123091] Updated weights for policy 0, policy_version 1606737 (0.0008) [2023-12-26 12:25:30,557][123091] Updated weights for policy 0, policy_version 1606747 (0.0005) [2023-12-26 12:25:30,607][123091] Updated weights for policy 0, policy_version 1606757 (0.0005) [2023-12-26 12:25:30,655][123091] Updated weights for policy 0, policy_version 1606767 (0.0006) [2023-12-26 12:25:31,080][123090] Updated weights for policy 1, policy_version 1596167 (0.0009) [2023-12-26 12:25:31,148][123090] Updated weights for policy 1, policy_version 1596177 (0.0011) [2023-12-26 12:25:31,214][123090] Updated weights for policy 1, policy_version 1596187 (0.0010) [2023-12-26 12:25:31,346][123091] Updated weights for policy 0, policy_version 1606777 (0.0008) [2023-12-26 12:25:31,416][123091] Updated weights for policy 0, policy_version 1606787 (0.0008) [2023-12-26 12:25:31,475][123091] Updated weights for policy 0, policy_version 1606797 (0.0008) [2023-12-26 12:25:32,004][123090] Updated weights for policy 1, policy_version 1596197 (0.0008) [2023-12-26 12:25:32,063][123090] Updated weights for policy 1, policy_version 1596207 (0.0010) [2023-12-26 12:25:32,126][123090] Updated weights for policy 1, policy_version 1596217 (0.0010) [2023-12-26 12:25:32,290][123091] Updated weights for policy 0, policy_version 1606807 (0.0010) [2023-12-26 12:25:32,338][123091] Updated weights for policy 0, policy_version 1606817 (0.0010) [2023-12-26 12:25:32,405][123091] Updated weights for policy 0, policy_version 1606827 (0.0013) [2023-12-26 12:25:32,946][123090] Updated weights for policy 1, policy_version 1596227 (0.0009) [2023-12-26 12:25:33,013][123090] Updated weights for policy 1, policy_version 1596237 (0.0005) [2023-12-26 12:25:33,086][123090] Updated weights for policy 1, policy_version 1596247 (0.0005) [2023-12-26 12:25:33,156][123091] Updated weights for policy 0, policy_version 1606837 (0.0010) [2023-12-26 12:25:33,225][123091] Updated weights for policy 0, policy_version 1606847 (0.0009) [2023-12-26 12:25:33,295][123091] Updated weights for policy 0, policy_version 1606857 (0.0008) [2023-12-26 12:25:33,682][123090] Updated weights for policy 1, policy_version 1596257 (0.0005) [2023-12-26 12:25:33,741][123090] Updated weights for policy 1, policy_version 1596267 (0.0005) [2023-12-26 12:25:33,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 820002816. Throughput: 0: 8740.1, 1: 8881.4. Samples: 820020248. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:33,785][121949] Avg episode reward: [(0, '6226.723'), (1, '5951.580')] [2023-12-26 12:25:33,806][123090] Updated weights for policy 1, policy_version 1596277 (0.0006) [2023-12-26 12:25:33,865][123090] Updated weights for policy 1, policy_version 1596287 (0.0010) [2023-12-26 12:25:33,906][123091] Updated weights for policy 0, policy_version 1606867 (0.0005) [2023-12-26 12:25:33,966][123091] Updated weights for policy 0, policy_version 1606877 (0.0007) [2023-12-26 12:25:34,013][123091] Updated weights for policy 0, policy_version 1606887 (0.0008) [2023-12-26 12:25:34,617][123090] Updated weights for policy 1, policy_version 1596297 (0.0006) [2023-12-26 12:25:34,693][123090] Updated weights for policy 1, policy_version 1596307 (0.0005) [2023-12-26 12:25:34,767][123090] Updated weights for policy 1, policy_version 1596317 (0.0005) [2023-12-26 12:25:34,780][123091] Updated weights for policy 0, policy_version 1606897 (0.0009) [2023-12-26 12:25:34,836][123091] Updated weights for policy 0, policy_version 1606907 (0.0008) [2023-12-26 12:25:34,897][123091] Updated weights for policy 0, policy_version 1606917 (0.0009) [2023-12-26 12:25:34,945][123091] Updated weights for policy 0, policy_version 1606927 (0.0009) [2023-12-26 12:25:35,461][123090] Updated weights for policy 1, policy_version 1596327 (0.0007) [2023-12-26 12:25:35,527][123090] Updated weights for policy 1, policy_version 1596337 (0.0005) [2023-12-26 12:25:35,597][123090] Updated weights for policy 1, policy_version 1596347 (0.0005) [2023-12-26 12:25:35,816][123091] Updated weights for policy 0, policy_version 1606937 (0.0006) [2023-12-26 12:25:35,877][123091] Updated weights for policy 0, policy_version 1606947 (0.0005) [2023-12-26 12:25:35,939][123091] Updated weights for policy 0, policy_version 1606957 (0.0005) [2023-12-26 12:25:36,304][123090] Updated weights for policy 1, policy_version 1596357 (0.0008) [2023-12-26 12:25:36,371][123090] Updated weights for policy 1, policy_version 1596367 (0.0009) [2023-12-26 12:25:36,445][123090] Updated weights for policy 1, policy_version 1596377 (0.0007) [2023-12-26 12:25:36,602][123091] Updated weights for policy 0, policy_version 1606967 (0.0009) [2023-12-26 12:25:36,651][123091] Updated weights for policy 0, policy_version 1606977 (0.0011) [2023-12-26 12:25:36,699][123091] Updated weights for policy 0, policy_version 1606987 (0.0011) [2023-12-26 12:25:37,234][123090] Updated weights for policy 1, policy_version 1596387 (0.0007) [2023-12-26 12:25:37,283][123090] Updated weights for policy 1, policy_version 1596397 (0.0009) [2023-12-26 12:25:37,339][123090] Updated weights for policy 1, policy_version 1596407 (0.0008) [2023-12-26 12:25:37,535][123091] Updated weights for policy 0, policy_version 1606997 (0.0008) [2023-12-26 12:25:37,609][123091] Updated weights for policy 0, policy_version 1607007 (0.0006) [2023-12-26 12:25:37,673][123091] Updated weights for policy 0, policy_version 1607017 (0.0010) [2023-12-26 12:25:38,226][123090] Updated weights for policy 1, policy_version 1596417 (0.0010) [2023-12-26 12:25:38,282][123090] Updated weights for policy 1, policy_version 1596427 (0.0008) [2023-12-26 12:25:38,346][123090] Updated weights for policy 1, policy_version 1596437 (0.0010) [2023-12-26 12:25:38,412][123090] Updated weights for policy 1, policy_version 1596447 (0.0009) [2023-12-26 12:25:38,471][123091] Updated weights for policy 0, policy_version 1607027 (0.0008) [2023-12-26 12:25:38,542][123091] Updated weights for policy 0, policy_version 1607037 (0.0007) [2023-12-26 12:25:38,615][123091] Updated weights for policy 0, policy_version 1607047 (0.0006) [2023-12-26 12:25:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 820101120. Throughput: 0: 8797.9, 1: 8915.5. Samples: 820075824. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:38,785][121949] Avg episode reward: [(0, '6293.229'), (1, '5928.786')] [2023-12-26 12:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001607056_411410432.pth... [2023-12-26 12:25:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001596448_408690688.pth... [2023-12-26 12:25:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001595424_408428544.pth [2023-12-26 12:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001606032_411148288.pth [2023-12-26 12:25:39,279][123090] Updated weights for policy 1, policy_version 1596457 (0.0009) [2023-12-26 12:25:39,341][123090] Updated weights for policy 1, policy_version 1596467 (0.0009) [2023-12-26 12:25:39,410][123090] Updated weights for policy 1, policy_version 1596477 (0.0013) [2023-12-26 12:25:39,418][123091] Updated weights for policy 0, policy_version 1607057 (0.0008) [2023-12-26 12:25:39,484][123091] Updated weights for policy 0, policy_version 1607067 (0.0010) [2023-12-26 12:25:39,552][123091] Updated weights for policy 0, policy_version 1607077 (0.0011) [2023-12-26 12:25:39,615][123091] Updated weights for policy 0, policy_version 1607087 (0.0011) [2023-12-26 12:25:40,244][123090] Updated weights for policy 1, policy_version 1596487 (0.0008) [2023-12-26 12:25:40,297][123090] Updated weights for policy 1, policy_version 1596497 (0.0008) [2023-12-26 12:25:40,350][123090] Updated weights for policy 1, policy_version 1596507 (0.0008) [2023-12-26 12:25:40,377][123091] Updated weights for policy 0, policy_version 1607097 (0.0006) [2023-12-26 12:25:40,434][123091] Updated weights for policy 0, policy_version 1607107 (0.0006) [2023-12-26 12:25:40,496][123091] Updated weights for policy 0, policy_version 1607117 (0.0006) [2023-12-26 12:25:41,012][123090] Updated weights for policy 1, policy_version 1596517 (0.0007) [2023-12-26 12:25:41,079][123090] Updated weights for policy 1, policy_version 1596527 (0.0007) [2023-12-26 12:25:41,148][123090] Updated weights for policy 1, policy_version 1596537 (0.0009) [2023-12-26 12:25:41,227][123091] Updated weights for policy 0, policy_version 1607127 (0.0008) [2023-12-26 12:25:41,294][123091] Updated weights for policy 0, policy_version 1607137 (0.0009) [2023-12-26 12:25:41,354][123091] Updated weights for policy 0, policy_version 1607147 (0.0008) [2023-12-26 12:25:41,934][123090] Updated weights for policy 1, policy_version 1596547 (0.0010) [2023-12-26 12:25:41,993][123090] Updated weights for policy 1, policy_version 1596557 (0.0010) [2023-12-26 12:25:42,058][123090] Updated weights for policy 1, policy_version 1596567 (0.0011) [2023-12-26 12:25:42,217][123091] Updated weights for policy 0, policy_version 1607157 (0.0009) [2023-12-26 12:25:42,284][123091] Updated weights for policy 0, policy_version 1607167 (0.0010) [2023-12-26 12:25:42,356][123091] Updated weights for policy 0, policy_version 1607177 (0.0010) [2023-12-26 12:25:42,881][123090] Updated weights for policy 1, policy_version 1596577 (0.0010) [2023-12-26 12:25:42,938][123090] Updated weights for policy 1, policy_version 1596587 (0.0005) [2023-12-26 12:25:43,002][123090] Updated weights for policy 1, policy_version 1596597 (0.0005) [2023-12-26 12:25:43,074][123090] Updated weights for policy 1, policy_version 1596607 (0.0005) [2023-12-26 12:25:43,189][123091] Updated weights for policy 0, policy_version 1607187 (0.0009) [2023-12-26 12:25:43,251][123091] Updated weights for policy 0, policy_version 1607197 (0.0010) [2023-12-26 12:25:43,317][123091] Updated weights for policy 0, policy_version 1607207 (0.0009) [2023-12-26 12:25:43,743][123090] Updated weights for policy 1, policy_version 1596617 (0.0008) [2023-12-26 12:25:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 820183040. Throughput: 0: 8769.7, 1: 8847.0. Samples: 820179176. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:43,785][121949] Avg episode reward: [(0, '6233.522'), (1, '5936.525')] [2023-12-26 12:25:43,789][123090] Updated weights for policy 1, policy_version 1596627 (0.0009) [2023-12-26 12:25:43,837][123090] Updated weights for policy 1, policy_version 1596637 (0.0005) [2023-12-26 12:25:44,197][123091] Updated weights for policy 0, policy_version 1607217 (0.0009) [2023-12-26 12:25:44,255][123091] Updated weights for policy 0, policy_version 1607227 (0.0010) [2023-12-26 12:25:44,308][123091] Updated weights for policy 0, policy_version 1607237 (0.0010) [2023-12-26 12:25:44,362][123091] Updated weights for policy 0, policy_version 1607248 (0.0010) [2023-12-26 12:25:44,517][123090] Updated weights for policy 1, policy_version 1596647 (0.0005) [2023-12-26 12:25:44,576][123090] Updated weights for policy 1, policy_version 1596657 (0.0005) [2023-12-26 12:25:44,644][123090] Updated weights for policy 1, policy_version 1596667 (0.0010) [2023-12-26 12:25:45,166][123091] Updated weights for policy 0, policy_version 1607258 (0.0007) [2023-12-26 12:25:45,234][123091] Updated weights for policy 0, policy_version 1607268 (0.0009) [2023-12-26 12:25:45,306][123091] Updated weights for policy 0, policy_version 1607278 (0.0010) [2023-12-26 12:25:45,438][123090] Updated weights for policy 1, policy_version 1596677 (0.0008) [2023-12-26 12:25:45,504][123090] Updated weights for policy 1, policy_version 1596687 (0.0006) [2023-12-26 12:25:45,552][123090] Updated weights for policy 1, policy_version 1596697 (0.0005) [2023-12-26 12:25:45,981][123091] Updated weights for policy 0, policy_version 1607288 (0.0009) [2023-12-26 12:25:46,041][123091] Updated weights for policy 0, policy_version 1607298 (0.0009) [2023-12-26 12:25:46,104][123091] Updated weights for policy 0, policy_version 1607308 (0.0008) [2023-12-26 12:25:46,370][123090] Updated weights for policy 1, policy_version 1596707 (0.0007) [2023-12-26 12:25:46,439][123090] Updated weights for policy 1, policy_version 1596717 (0.0010) [2023-12-26 12:25:46,494][123090] Updated weights for policy 1, policy_version 1596727 (0.0010) [2023-12-26 12:25:46,749][123091] Updated weights for policy 0, policy_version 1607318 (0.0005) [2023-12-26 12:25:46,801][123091] Updated weights for policy 0, policy_version 1607328 (0.0005) [2023-12-26 12:25:46,851][123091] Updated weights for policy 0, policy_version 1607338 (0.0009) [2023-12-26 12:25:47,370][123090] Updated weights for policy 1, policy_version 1596737 (0.0010) [2023-12-26 12:25:47,427][123090] Updated weights for policy 1, policy_version 1596747 (0.0010) [2023-12-26 12:25:47,485][123090] Updated weights for policy 1, policy_version 1596757 (0.0010) [2023-12-26 12:25:47,548][123090] Updated weights for policy 1, policy_version 1596767 (0.0010) [2023-12-26 12:25:47,600][123091] Updated weights for policy 0, policy_version 1607348 (0.0010) [2023-12-26 12:25:47,662][123091] Updated weights for policy 0, policy_version 1607358 (0.0010) [2023-12-26 12:25:47,727][123091] Updated weights for policy 0, policy_version 1607368 (0.0009) [2023-12-26 12:25:48,427][123090] Updated weights for policy 1, policy_version 1596777 (0.0007) [2023-12-26 12:25:48,489][123090] Updated weights for policy 1, policy_version 1596787 (0.0009) [2023-12-26 12:25:48,513][123091] Updated weights for policy 0, policy_version 1607378 (0.0009) [2023-12-26 12:25:48,548][123090] Updated weights for policy 1, policy_version 1596797 (0.0009) [2023-12-26 12:25:48,574][123091] Updated weights for policy 0, policy_version 1607388 (0.0010) [2023-12-26 12:25:48,629][123091] Updated weights for policy 0, policy_version 1607398 (0.0009) [2023-12-26 12:25:48,680][123091] Updated weights for policy 0, policy_version 1607408 (0.0009) [2023-12-26 12:25:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 820281344. Throughput: 0: 8788.1, 1: 8873.8. Samples: 820287916. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:48,784][121949] Avg episode reward: [(0, '6193.197'), (1, '5903.715')] [2023-12-26 12:25:49,387][123090] Updated weights for policy 1, policy_version 1596807 (0.0009) [2023-12-26 12:25:49,453][123090] Updated weights for policy 1, policy_version 1596817 (0.0008) [2023-12-26 12:25:49,494][123091] Updated weights for policy 0, policy_version 1607418 (0.0009) [2023-12-26 12:25:49,518][123090] Updated weights for policy 1, policy_version 1596827 (0.0008) [2023-12-26 12:25:49,556][123091] Updated weights for policy 0, policy_version 1607428 (0.0008) [2023-12-26 12:25:49,620][123091] Updated weights for policy 0, policy_version 1607438 (0.0009) [2023-12-26 12:25:50,386][123090] Updated weights for policy 1, policy_version 1596837 (0.0008) [2023-12-26 12:25:50,419][123091] Updated weights for policy 0, policy_version 1607448 (0.0007) [2023-12-26 12:25:50,451][123090] Updated weights for policy 1, policy_version 1596847 (0.0009) [2023-12-26 12:25:50,485][123091] Updated weights for policy 0, policy_version 1607458 (0.0008) [2023-12-26 12:25:50,514][123090] Updated weights for policy 1, policy_version 1596857 (0.0009) [2023-12-26 12:25:50,547][123091] Updated weights for policy 0, policy_version 1607468 (0.0007) [2023-12-26 12:25:51,349][123090] Updated weights for policy 1, policy_version 1596867 (0.0010) [2023-12-26 12:25:51,400][123091] Updated weights for policy 0, policy_version 1607478 (0.0009) [2023-12-26 12:25:51,418][123090] Updated weights for policy 1, policy_version 1596877 (0.0008) [2023-12-26 12:25:51,464][123091] Updated weights for policy 0, policy_version 1607488 (0.0007) [2023-12-26 12:25:51,482][123090] Updated weights for policy 1, policy_version 1596887 (0.0010) [2023-12-26 12:25:51,524][123091] Updated weights for policy 0, policy_version 1607498 (0.0009) [2023-12-26 12:25:52,289][123090] Updated weights for policy 1, policy_version 1596897 (0.0008) [2023-12-26 12:25:52,350][123090] Updated weights for policy 1, policy_version 1596907 (0.0009) [2023-12-26 12:25:52,353][123091] Updated weights for policy 0, policy_version 1607508 (0.0009) [2023-12-26 12:25:52,410][123090] Updated weights for policy 1, policy_version 1596917 (0.0008) [2023-12-26 12:25:52,420][123091] Updated weights for policy 0, policy_version 1607518 (0.0009) [2023-12-26 12:25:52,463][123090] Updated weights for policy 1, policy_version 1596927 (0.0008) [2023-12-26 12:25:52,478][123091] Updated weights for policy 0, policy_version 1607528 (0.0009) [2023-12-26 12:25:53,270][123090] Updated weights for policy 1, policy_version 1596937 (0.0005) [2023-12-26 12:25:53,285][123091] Updated weights for policy 0, policy_version 1607538 (0.0009) [2023-12-26 12:25:53,333][123090] Updated weights for policy 1, policy_version 1596947 (0.0006) [2023-12-26 12:25:53,340][123091] Updated weights for policy 0, policy_version 1607548 (0.0008) [2023-12-26 12:25:53,393][123091] Updated weights for policy 0, policy_version 1607558 (0.0008) [2023-12-26 12:25:53,394][123090] Updated weights for policy 1, policy_version 1596957 (0.0007) [2023-12-26 12:25:53,450][123091] Updated weights for policy 0, policy_version 1607568 (0.0008) [2023-12-26 12:25:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 820363264. Throughput: 0: 8804.2, 1: 8837.3. Samples: 820338564. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:53,784][121949] Avg episode reward: [(0, '6298.357'), (1, '5831.509')] [2023-12-26 12:25:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001596960_408821760.pth... [2023-12-26 12:25:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001607568_411541504.pth... [2023-12-26 12:25:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001595936_408559616.pth [2023-12-26 12:25:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001606512_411271168.pth [2023-12-26 12:25:54,146][123090] Updated weights for policy 1, policy_version 1596967 (0.0007) [2023-12-26 12:25:54,212][123090] Updated weights for policy 1, policy_version 1596977 (0.0009) [2023-12-26 12:25:54,286][123090] Updated weights for policy 1, policy_version 1596987 (0.0010) [2023-12-26 12:25:54,286][123091] Updated weights for policy 0, policy_version 1607578 (0.0007) [2023-12-26 12:25:54,336][123091] Updated weights for policy 0, policy_version 1607588 (0.0009) [2023-12-26 12:25:54,386][123091] Updated weights for policy 0, policy_version 1607598 (0.0009) [2023-12-26 12:25:54,986][123090] Updated weights for policy 1, policy_version 1596997 (0.0009) [2023-12-26 12:25:55,046][123090] Updated weights for policy 1, policy_version 1597007 (0.0011) [2023-12-26 12:25:55,105][123090] Updated weights for policy 1, policy_version 1597017 (0.0010) [2023-12-26 12:25:55,278][123091] Updated weights for policy 0, policy_version 1607608 (0.0009) [2023-12-26 12:25:55,326][123091] Updated weights for policy 0, policy_version 1607618 (0.0008) [2023-12-26 12:25:55,385][123091] Updated weights for policy 0, policy_version 1607628 (0.0009) [2023-12-26 12:25:55,914][123090] Updated weights for policy 1, policy_version 1597027 (0.0011) [2023-12-26 12:25:55,972][123090] Updated weights for policy 1, policy_version 1597037 (0.0010) [2023-12-26 12:25:56,027][123090] Updated weights for policy 1, policy_version 1597047 (0.0010) [2023-12-26 12:25:56,181][123091] Updated weights for policy 0, policy_version 1607638 (0.0009) [2023-12-26 12:25:56,236][123091] Updated weights for policy 0, policy_version 1607648 (0.0010) [2023-12-26 12:25:56,294][123091] Updated weights for policy 0, policy_version 1607658 (0.0009) [2023-12-26 12:25:56,686][123090] Updated weights for policy 1, policy_version 1597057 (0.0010) [2023-12-26 12:25:56,738][123090] Updated weights for policy 1, policy_version 1597067 (0.0006) [2023-12-26 12:25:56,786][123090] Updated weights for policy 1, policy_version 1597077 (0.0008) [2023-12-26 12:25:56,837][123090] Updated weights for policy 1, policy_version 1597087 (0.0010) [2023-12-26 12:25:57,132][123091] Updated weights for policy 0, policy_version 1607668 (0.0010) [2023-12-26 12:25:57,190][123091] Updated weights for policy 0, policy_version 1607678 (0.0007) [2023-12-26 12:25:57,245][123091] Updated weights for policy 0, policy_version 1607688 (0.0009) [2023-12-26 12:25:57,664][123090] Updated weights for policy 1, policy_version 1597097 (0.0010) [2023-12-26 12:25:57,719][123090] Updated weights for policy 1, policy_version 1597107 (0.0010) [2023-12-26 12:25:57,770][123090] Updated weights for policy 1, policy_version 1597117 (0.0010) [2023-12-26 12:25:57,921][123091] Updated weights for policy 0, policy_version 1607698 (0.0010) [2023-12-26 12:25:57,969][123091] Updated weights for policy 0, policy_version 1607708 (0.0006) [2023-12-26 12:25:58,022][123091] Updated weights for policy 0, policy_version 1607718 (0.0005) [2023-12-26 12:25:58,095][123091] Updated weights for policy 0, policy_version 1607728 (0.0008) [2023-12-26 12:25:58,626][123090] Updated weights for policy 1, policy_version 1597127 (0.0009) [2023-12-26 12:25:58,707][123090] Updated weights for policy 1, policy_version 1597137 (0.0008) [2023-12-26 12:25:58,781][123090] Updated weights for policy 1, policy_version 1597147 (0.0007) [2023-12-26 12:25:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 820445184. Throughput: 0: 8868.9, 1: 8880.4. Samples: 820446188. Policy #0 lag: (min: 31.0, avg: 37.9, max: 63.0) [2023-12-26 12:25:58,785][121949] Avg episode reward: [(0, '6304.081'), (1, '5729.314')] [2023-12-26 12:25:58,890][123091] Updated weights for policy 0, policy_version 1607738 (0.0007) [2023-12-26 12:25:58,959][123091] Updated weights for policy 0, policy_version 1607748 (0.0010) [2023-12-26 12:25:59,031][123091] Updated weights for policy 0, policy_version 1607758 (0.0011) [2023-12-26 12:25:59,588][123090] Updated weights for policy 1, policy_version 1597157 (0.0008) [2023-12-26 12:25:59,648][123090] Updated weights for policy 1, policy_version 1597167 (0.0009) [2023-12-26 12:25:59,704][123090] Updated weights for policy 1, policy_version 1597177 (0.0008) [2023-12-26 12:25:59,895][123091] Updated weights for policy 0, policy_version 1607768 (0.0011) [2023-12-26 12:25:59,959][123091] Updated weights for policy 0, policy_version 1607778 (0.0010) [2023-12-26 12:26:00,021][123091] Updated weights for policy 0, policy_version 1607788 (0.0011) [2023-12-26 12:26:00,594][123090] Updated weights for policy 1, policy_version 1597187 (0.0009) [2023-12-26 12:26:00,645][123090] Updated weights for policy 1, policy_version 1597197 (0.0008) [2023-12-26 12:26:00,707][123090] Updated weights for policy 1, policy_version 1597207 (0.0009) [2023-12-26 12:26:00,887][123091] Updated weights for policy 0, policy_version 1607798 (0.0010) [2023-12-26 12:26:00,948][123091] Updated weights for policy 0, policy_version 1607808 (0.0009) [2023-12-26 12:26:01,004][123091] Updated weights for policy 0, policy_version 1607818 (0.0010) [2023-12-26 12:26:01,522][123090] Updated weights for policy 1, policy_version 1597217 (0.0008) [2023-12-26 12:26:01,582][123090] Updated weights for policy 1, policy_version 1597227 (0.0009) [2023-12-26 12:26:01,656][123090] Updated weights for policy 1, policy_version 1597237 (0.0009) [2023-12-26 12:26:01,728][123090] Updated weights for policy 1, policy_version 1597247 (0.0009) [2023-12-26 12:26:01,790][123091] Updated weights for policy 0, policy_version 1607828 (0.0009) [2023-12-26 12:26:01,851][123091] Updated weights for policy 0, policy_version 1607838 (0.0006) [2023-12-26 12:26:01,915][123091] Updated weights for policy 0, policy_version 1607848 (0.0005) [2023-12-26 12:26:02,558][123090] Updated weights for policy 1, policy_version 1597257 (0.0008) [2023-12-26 12:26:02,606][123090] Updated weights for policy 1, policy_version 1597267 (0.0008) [2023-12-26 12:26:02,637][123091] Updated weights for policy 0, policy_version 1607858 (0.0006) [2023-12-26 12:26:02,672][123090] Updated weights for policy 1, policy_version 1597277 (0.0008) [2023-12-26 12:26:02,694][123091] Updated weights for policy 0, policy_version 1607868 (0.0008) [2023-12-26 12:26:02,757][123091] Updated weights for policy 0, policy_version 1607878 (0.0010) [2023-12-26 12:26:02,820][123091] Updated weights for policy 0, policy_version 1607888 (0.0010) [2023-12-26 12:26:03,386][123090] Updated weights for policy 1, policy_version 1597287 (0.0006) [2023-12-26 12:26:03,444][123090] Updated weights for policy 1, policy_version 1597297 (0.0006) [2023-12-26 12:26:03,498][123090] Updated weights for policy 1, policy_version 1597307 (0.0006) [2023-12-26 12:26:03,515][123091] Updated weights for policy 0, policy_version 1607898 (0.0005) [2023-12-26 12:26:03,565][123091] Updated weights for policy 0, policy_version 1607908 (0.0005) [2023-12-26 12:26:03,617][123091] Updated weights for policy 0, policy_version 1607918 (0.0005) [2023-12-26 12:26:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 820543488. Throughput: 0: 8900.8, 1: 8791.9. Samples: 820550940. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:03,785][121949] Avg episode reward: [(0, '6252.011'), (1, '5790.146')] [2023-12-26 12:26:04,220][123090] Updated weights for policy 1, policy_version 1597317 (0.0008) [2023-12-26 12:26:04,287][123090] Updated weights for policy 1, policy_version 1597327 (0.0009) [2023-12-26 12:26:04,321][123091] Updated weights for policy 0, policy_version 1607928 (0.0009) [2023-12-26 12:26:04,359][123090] Updated weights for policy 1, policy_version 1597337 (0.0009) [2023-12-26 12:26:04,387][123091] Updated weights for policy 0, policy_version 1607938 (0.0007) [2023-12-26 12:26:04,440][123091] Updated weights for policy 0, policy_version 1607948 (0.0006) [2023-12-26 12:26:05,173][123090] Updated weights for policy 1, policy_version 1597347 (0.0009) [2023-12-26 12:26:05,224][123090] Updated weights for policy 1, policy_version 1597357 (0.0008) [2023-12-26 12:26:05,234][123091] Updated weights for policy 0, policy_version 1607958 (0.0009) [2023-12-26 12:26:05,277][123090] Updated weights for policy 1, policy_version 1597367 (0.0010) [2023-12-26 12:26:05,291][123091] Updated weights for policy 0, policy_version 1607968 (0.0007) [2023-12-26 12:26:05,348][123091] Updated weights for policy 0, policy_version 1607978 (0.0008) [2023-12-26 12:26:06,117][123090] Updated weights for policy 1, policy_version 1597377 (0.0007) [2023-12-26 12:26:06,165][123091] Updated weights for policy 0, policy_version 1607988 (0.0009) [2023-12-26 12:26:06,178][123090] Updated weights for policy 1, policy_version 1597387 (0.0009) [2023-12-26 12:26:06,229][123091] Updated weights for policy 0, policy_version 1607998 (0.0007) [2023-12-26 12:26:06,247][123090] Updated weights for policy 1, policy_version 1597397 (0.0010) [2023-12-26 12:26:06,291][123091] Updated weights for policy 0, policy_version 1608008 (0.0009) [2023-12-26 12:26:06,311][123090] Updated weights for policy 1, policy_version 1597407 (0.0008) [2023-12-26 12:26:07,115][123091] Updated weights for policy 0, policy_version 1608018 (0.0009) [2023-12-26 12:26:07,155][123090] Updated weights for policy 1, policy_version 1597417 (0.0009) [2023-12-26 12:26:07,181][123091] Updated weights for policy 0, policy_version 1608028 (0.0008) [2023-12-26 12:26:07,215][123090] Updated weights for policy 1, policy_version 1597427 (0.0008) [2023-12-26 12:26:07,242][123091] Updated weights for policy 0, policy_version 1608038 (0.0009) [2023-12-26 12:26:07,265][123090] Updated weights for policy 1, policy_version 1597437 (0.0009) [2023-12-26 12:26:07,304][123091] Updated weights for policy 0, policy_version 1608048 (0.0009) [2023-12-26 12:26:08,129][123090] Updated weights for policy 1, policy_version 1597447 (0.0007) [2023-12-26 12:26:08,134][123091] Updated weights for policy 0, policy_version 1608058 (0.0009) [2023-12-26 12:26:08,191][123090] Updated weights for policy 1, policy_version 1597457 (0.0007) [2023-12-26 12:26:08,192][123091] Updated weights for policy 0, policy_version 1608068 (0.0010) [2023-12-26 12:26:08,254][123091] Updated weights for policy 0, policy_version 1608078 (0.0008) [2023-12-26 12:26:08,256][123090] Updated weights for policy 1, policy_version 1597467 (0.0008) [2023-12-26 12:26:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 820625408. Throughput: 0: 8933.1, 1: 8808.1. Samples: 820603412. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:08,785][121949] Avg episode reward: [(0, '6318.987'), (1, '5697.178')] [2023-12-26 12:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001608080_411672576.pth... [2023-12-26 12:26:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001597472_408952832.pth... [2023-12-26 12:26:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001607056_411410432.pth [2023-12-26 12:26:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001596448_408690688.pth [2023-12-26 12:26:09,073][123090] Updated weights for policy 1, policy_version 1597477 (0.0009) [2023-12-26 12:26:09,117][123091] Updated weights for policy 0, policy_version 1608088 (0.0006) [2023-12-26 12:26:09,131][123090] Updated weights for policy 1, policy_version 1597487 (0.0010) [2023-12-26 12:26:09,169][123091] Updated weights for policy 0, policy_version 1608098 (0.0008) [2023-12-26 12:26:09,179][123090] Updated weights for policy 1, policy_version 1597497 (0.0008) [2023-12-26 12:26:09,233][123091] Updated weights for policy 0, policy_version 1608108 (0.0009) [2023-12-26 12:26:10,046][123090] Updated weights for policy 1, policy_version 1597507 (0.0010) [2023-12-26 12:26:10,111][123090] Updated weights for policy 1, policy_version 1597517 (0.0008) [2023-12-26 12:26:10,117][123091] Updated weights for policy 0, policy_version 1608118 (0.0009) [2023-12-26 12:26:10,179][123091] Updated weights for policy 0, policy_version 1608128 (0.0007) [2023-12-26 12:26:10,181][123090] Updated weights for policy 1, policy_version 1597527 (0.0009) [2023-12-26 12:26:10,234][123091] Updated weights for policy 0, policy_version 1608138 (0.0007) [2023-12-26 12:26:10,942][123090] Updated weights for policy 1, policy_version 1597537 (0.0009) [2023-12-26 12:26:11,009][123090] Updated weights for policy 1, policy_version 1597547 (0.0009) [2023-12-26 12:26:11,072][123090] Updated weights for policy 1, policy_version 1597557 (0.0009) [2023-12-26 12:26:11,114][123091] Updated weights for policy 0, policy_version 1608148 (0.0009) [2023-12-26 12:26:11,136][123090] Updated weights for policy 1, policy_version 1597567 (0.0009) [2023-12-26 12:26:11,178][123091] Updated weights for policy 0, policy_version 1608158 (0.0010) [2023-12-26 12:26:11,242][123091] Updated weights for policy 0, policy_version 1608168 (0.0009) [2023-12-26 12:26:11,976][123090] Updated weights for policy 1, policy_version 1597577 (0.0006) [2023-12-26 12:26:12,031][123091] Updated weights for policy 0, policy_version 1608178 (0.0009) [2023-12-26 12:26:12,037][123090] Updated weights for policy 1, policy_version 1597587 (0.0008) [2023-12-26 12:26:12,087][123091] Updated weights for policy 0, policy_version 1608188 (0.0006) [2023-12-26 12:26:12,088][123090] Updated weights for policy 1, policy_version 1597597 (0.0010) [2023-12-26 12:26:12,145][123091] Updated weights for policy 0, policy_version 1608198 (0.0006) [2023-12-26 12:26:12,201][123091] Updated weights for policy 0, policy_version 1608208 (0.0006) [2023-12-26 12:26:12,882][123090] Updated weights for policy 1, policy_version 1597607 (0.0011) [2023-12-26 12:26:12,922][123091] Updated weights for policy 0, policy_version 1608218 (0.0006) [2023-12-26 12:26:12,937][123090] Updated weights for policy 1, policy_version 1597617 (0.0010) [2023-12-26 12:26:12,978][123091] Updated weights for policy 0, policy_version 1608228 (0.0006) [2023-12-26 12:26:13,000][123090] Updated weights for policy 1, policy_version 1597627 (0.0010) [2023-12-26 12:26:13,033][123091] Updated weights for policy 0, policy_version 1608238 (0.0008) [2023-12-26 12:26:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 820707328. Throughput: 0: 8888.1, 1: 8780.0. Samples: 820706004. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:13,784][121949] Avg episode reward: [(0, '6306.806'), (1, '5549.591')] [2023-12-26 12:26:13,827][123090] Updated weights for policy 1, policy_version 1597637 (0.0011) [2023-12-26 12:26:13,865][123091] Updated weights for policy 0, policy_version 1608248 (0.0008) [2023-12-26 12:26:13,879][123090] Updated weights for policy 1, policy_version 1597647 (0.0011) [2023-12-26 12:26:13,921][123091] Updated weights for policy 0, policy_version 1608258 (0.0006) [2023-12-26 12:26:13,936][123090] Updated weights for policy 1, policy_version 1597657 (0.0011) [2023-12-26 12:26:13,970][123091] Updated weights for policy 0, policy_version 1608268 (0.0007) [2023-12-26 12:26:14,712][123090] Updated weights for policy 1, policy_version 1597667 (0.0009) [2023-12-26 12:26:14,732][123091] Updated weights for policy 0, policy_version 1608278 (0.0007) [2023-12-26 12:26:14,778][123090] Updated weights for policy 1, policy_version 1597677 (0.0006) [2023-12-26 12:26:14,797][123091] Updated weights for policy 0, policy_version 1608288 (0.0006) [2023-12-26 12:26:14,852][123090] Updated weights for policy 1, policy_version 1597687 (0.0006) [2023-12-26 12:26:14,865][123091] Updated weights for policy 0, policy_version 1608298 (0.0006) [2023-12-26 12:26:15,526][123091] Updated weights for policy 0, policy_version 1608308 (0.0006) [2023-12-26 12:26:15,596][123091] Updated weights for policy 0, policy_version 1608318 (0.0005) [2023-12-26 12:26:15,668][123091] Updated weights for policy 0, policy_version 1608328 (0.0005) [2023-12-26 12:26:15,702][123090] Updated weights for policy 1, policy_version 1597697 (0.0008) [2023-12-26 12:26:15,762][123090] Updated weights for policy 1, policy_version 1597707 (0.0009) [2023-12-26 12:26:15,823][123090] Updated weights for policy 1, policy_version 1597717 (0.0009) [2023-12-26 12:26:15,874][123090] Updated weights for policy 1, policy_version 1597727 (0.0009) [2023-12-26 12:26:16,347][123091] Updated weights for policy 0, policy_version 1608338 (0.0006) [2023-12-26 12:26:16,405][123091] Updated weights for policy 0, policy_version 1608348 (0.0009) [2023-12-26 12:26:16,453][123091] Updated weights for policy 0, policy_version 1608358 (0.0009) [2023-12-26 12:26:16,512][123091] Updated weights for policy 0, policy_version 1608368 (0.0010) [2023-12-26 12:26:16,714][123090] Updated weights for policy 1, policy_version 1597737 (0.0008) [2023-12-26 12:26:16,771][123090] Updated weights for policy 1, policy_version 1597747 (0.0010) [2023-12-26 12:26:16,835][123090] Updated weights for policy 1, policy_version 1597757 (0.0010) [2023-12-26 12:26:17,279][123091] Updated weights for policy 0, policy_version 1608378 (0.0005) [2023-12-26 12:26:17,325][123091] Updated weights for policy 0, policy_version 1608388 (0.0005) [2023-12-26 12:26:17,377][123091] Updated weights for policy 0, policy_version 1608398 (0.0005) [2023-12-26 12:26:17,667][123090] Updated weights for policy 1, policy_version 1597767 (0.0010) [2023-12-26 12:26:17,726][123090] Updated weights for policy 1, policy_version 1597777 (0.0009) [2023-12-26 12:26:17,779][123090] Updated weights for policy 1, policy_version 1597787 (0.0009) [2023-12-26 12:26:18,155][123091] Updated weights for policy 0, policy_version 1608408 (0.0009) [2023-12-26 12:26:18,216][123091] Updated weights for policy 0, policy_version 1608418 (0.0008) [2023-12-26 12:26:18,272][123091] Updated weights for policy 0, policy_version 1608428 (0.0008) [2023-12-26 12:26:18,625][123090] Updated weights for policy 1, policy_version 1597797 (0.0009) [2023-12-26 12:26:18,683][123090] Updated weights for policy 1, policy_version 1597807 (0.0009) [2023-12-26 12:26:18,738][123090] Updated weights for policy 1, policy_version 1597817 (0.0009) [2023-12-26 12:26:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 820805632. Throughput: 0: 8891.3, 1: 8723.6. Samples: 820812916. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:18,784][121949] Avg episode reward: [(0, '6186.933'), (1, '5425.810')] [2023-12-26 12:26:19,056][123091] Updated weights for policy 0, policy_version 1608438 (0.0007) [2023-12-26 12:26:19,117][123091] Updated weights for policy 0, policy_version 1608448 (0.0006) [2023-12-26 12:26:19,166][123091] Updated weights for policy 0, policy_version 1608458 (0.0005) [2023-12-26 12:26:19,621][123090] Updated weights for policy 1, policy_version 1597827 (0.0010) [2023-12-26 12:26:19,681][123090] Updated weights for policy 1, policy_version 1597837 (0.0010) [2023-12-26 12:26:19,747][123090] Updated weights for policy 1, policy_version 1597847 (0.0009) [2023-12-26 12:26:19,959][123091] Updated weights for policy 0, policy_version 1608468 (0.0007) [2023-12-26 12:26:20,029][123091] Updated weights for policy 0, policy_version 1608478 (0.0009) [2023-12-26 12:26:20,093][123091] Updated weights for policy 0, policy_version 1608488 (0.0009) [2023-12-26 12:26:20,659][123090] Updated weights for policy 1, policy_version 1597857 (0.0010) [2023-12-26 12:26:20,735][123090] Updated weights for policy 1, policy_version 1597867 (0.0011) [2023-12-26 12:26:20,795][123090] Updated weights for policy 1, policy_version 1597877 (0.0010) [2023-12-26 12:26:20,847][123090] Updated weights for policy 1, policy_version 1597887 (0.0010) [2023-12-26 12:26:20,869][123091] Updated weights for policy 0, policy_version 1608498 (0.0009) [2023-12-26 12:26:20,934][123091] Updated weights for policy 0, policy_version 1608508 (0.0009) [2023-12-26 12:26:20,988][123091] Updated weights for policy 0, policy_version 1608518 (0.0009) [2023-12-26 12:26:21,051][123091] Updated weights for policy 0, policy_version 1608528 (0.0009) [2023-12-26 12:26:21,739][123090] Updated weights for policy 1, policy_version 1597897 (0.0010) [2023-12-26 12:26:21,810][123090] Updated weights for policy 1, policy_version 1597907 (0.0009) [2023-12-26 12:26:21,884][123090] Updated weights for policy 1, policy_version 1597917 (0.0007) [2023-12-26 12:26:21,904][123091] Updated weights for policy 0, policy_version 1608538 (0.0006) [2023-12-26 12:26:21,976][123091] Updated weights for policy 0, policy_version 1608548 (0.0006) [2023-12-26 12:26:22,038][123091] Updated weights for policy 0, policy_version 1608558 (0.0006) [2023-12-26 12:26:22,668][123090] Updated weights for policy 1, policy_version 1597927 (0.0009) [2023-12-26 12:26:22,738][123090] Updated weights for policy 1, policy_version 1597937 (0.0010) [2023-12-26 12:26:22,785][123091] Updated weights for policy 0, policy_version 1608568 (0.0007) [2023-12-26 12:26:22,811][123090] Updated weights for policy 1, policy_version 1597947 (0.0010) [2023-12-26 12:26:22,847][123091] Updated weights for policy 0, policy_version 1608578 (0.0006) [2023-12-26 12:26:22,916][123091] Updated weights for policy 0, policy_version 1608588 (0.0005) [2023-12-26 12:26:23,659][123091] Updated weights for policy 0, policy_version 1608598 (0.0009) [2023-12-26 12:26:23,691][123090] Updated weights for policy 1, policy_version 1597957 (0.0007) [2023-12-26 12:26:23,727][123091] Updated weights for policy 0, policy_version 1608608 (0.0011) [2023-12-26 12:26:23,749][123090] Updated weights for policy 1, policy_version 1597967 (0.0008) [2023-12-26 12:26:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17716.9). Total num frames: 820879360. Throughput: 0: 8867.9, 1: 8641.6. Samples: 820863748. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:23,784][121949] Avg episode reward: [(0, '6154.617'), (1, '5475.451')] [2023-12-26 12:26:23,795][123091] Updated weights for policy 0, policy_version 1608618 (0.0011) [2023-12-26 12:26:23,799][123090] Updated weights for policy 1, policy_version 1597977 (0.0008) [2023-12-26 12:26:23,826][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001608624_411811840.pth... [2023-12-26 12:26:23,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001607568_411541504.pth [2023-12-26 12:26:23,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001597984_409083904.pth... [2023-12-26 12:26:23,840][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001596960_408821760.pth [2023-12-26 12:26:24,600][123091] Updated weights for policy 0, policy_version 1608628 (0.0008) [2023-12-26 12:26:24,602][123090] Updated weights for policy 1, policy_version 1597987 (0.0008) [2023-12-26 12:26:24,660][123091] Updated weights for policy 0, policy_version 1608638 (0.0006) [2023-12-26 12:26:24,669][123090] Updated weights for policy 1, policy_version 1597997 (0.0008) [2023-12-26 12:26:24,715][123091] Updated weights for policy 0, policy_version 1608648 (0.0005) [2023-12-26 12:26:24,739][123090] Updated weights for policy 1, policy_version 1598007 (0.0009) [2023-12-26 12:26:25,354][123091] Updated weights for policy 0, policy_version 1608658 (0.0006) [2023-12-26 12:26:25,404][123091] Updated weights for policy 0, policy_version 1608668 (0.0006) [2023-12-26 12:26:25,478][123091] Updated weights for policy 0, policy_version 1608678 (0.0006) [2023-12-26 12:26:25,497][123090] Updated weights for policy 1, policy_version 1598017 (0.0009) [2023-12-26 12:26:25,548][123091] Updated weights for policy 0, policy_version 1608688 (0.0005) [2023-12-26 12:26:25,573][123090] Updated weights for policy 1, policy_version 1598027 (0.0006) [2023-12-26 12:26:25,643][123090] Updated weights for policy 1, policy_version 1598037 (0.0005) [2023-12-26 12:26:25,719][123090] Updated weights for policy 1, policy_version 1598047 (0.0005) [2023-12-26 12:26:26,189][123091] Updated weights for policy 0, policy_version 1608698 (0.0005) [2023-12-26 12:26:26,240][123091] Updated weights for policy 0, policy_version 1608708 (0.0005) [2023-12-26 12:26:26,303][123091] Updated weights for policy 0, policy_version 1608718 (0.0005) [2023-12-26 12:26:26,311][123090] Updated weights for policy 1, policy_version 1598057 (0.0005) [2023-12-26 12:26:26,365][123090] Updated weights for policy 1, policy_version 1598067 (0.0005) [2023-12-26 12:26:26,416][123090] Updated weights for policy 1, policy_version 1598077 (0.0006) [2023-12-26 12:26:27,076][123090] Updated weights for policy 1, policy_version 1598087 (0.0009) [2023-12-26 12:26:27,088][123091] Updated weights for policy 0, policy_version 1608728 (0.0009) [2023-12-26 12:26:27,137][123090] Updated weights for policy 1, policy_version 1598097 (0.0008) [2023-12-26 12:26:27,153][123091] Updated weights for policy 0, policy_version 1608738 (0.0010) [2023-12-26 12:26:27,200][123091] Updated weights for policy 0, policy_version 1608748 (0.0010) [2023-12-26 12:26:27,201][123090] Updated weights for policy 1, policy_version 1598107 (0.0008) [2023-12-26 12:26:27,857][123090] Updated weights for policy 1, policy_version 1598117 (0.0008) [2023-12-26 12:26:27,911][123090] Updated weights for policy 1, policy_version 1598127 (0.0008) [2023-12-26 12:26:27,971][123090] Updated weights for policy 1, policy_version 1598137 (0.0009) [2023-12-26 12:26:28,011][123091] Updated weights for policy 0, policy_version 1608758 (0.0010) [2023-12-26 12:26:28,062][123091] Updated weights for policy 0, policy_version 1608768 (0.0010) [2023-12-26 12:26:28,113][123091] Updated weights for policy 0, policy_version 1608778 (0.0010) [2023-12-26 12:26:28,783][123090] Updated weights for policy 1, policy_version 1598147 (0.0008) [2023-12-26 12:26:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 820977664. Throughput: 0: 8953.5, 1: 8740.6. Samples: 820975412. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:28,784][121949] Avg episode reward: [(0, '6246.121'), (1, '5695.259')] [2023-12-26 12:26:28,851][123090] Updated weights for policy 1, policy_version 1598157 (0.0009) [2023-12-26 12:26:28,899][123090] Updated weights for policy 1, policy_version 1598167 (0.0008) [2023-12-26 12:26:28,928][123091] Updated weights for policy 0, policy_version 1608788 (0.0010) [2023-12-26 12:26:28,989][123091] Updated weights for policy 0, policy_version 1608798 (0.0007) [2023-12-26 12:26:29,066][123091] Updated weights for policy 0, policy_version 1608808 (0.0006) [2023-12-26 12:26:29,611][123090] Updated weights for policy 1, policy_version 1598177 (0.0006) [2023-12-26 12:26:29,683][123090] Updated weights for policy 1, policy_version 1598187 (0.0006) [2023-12-26 12:26:29,752][123090] Updated weights for policy 1, policy_version 1598197 (0.0005) [2023-12-26 12:26:29,822][123090] Updated weights for policy 1, policy_version 1598207 (0.0007) [2023-12-26 12:26:29,821][123091] Updated weights for policy 0, policy_version 1608818 (0.0008) [2023-12-26 12:26:29,885][123091] Updated weights for policy 0, policy_version 1608828 (0.0010) [2023-12-26 12:26:29,944][123091] Updated weights for policy 0, policy_version 1608838 (0.0010) [2023-12-26 12:26:30,013][123091] Updated weights for policy 0, policy_version 1608848 (0.0010) [2023-12-26 12:26:30,547][123090] Updated weights for policy 1, policy_version 1598217 (0.0005) [2023-12-26 12:26:30,612][123090] Updated weights for policy 1, policy_version 1598227 (0.0005) [2023-12-26 12:26:30,674][123090] Updated weights for policy 1, policy_version 1598237 (0.0006) [2023-12-26 12:26:30,803][123091] Updated weights for policy 0, policy_version 1608858 (0.0010) [2023-12-26 12:26:30,847][123091] Updated weights for policy 0, policy_version 1608868 (0.0010) [2023-12-26 12:26:30,902][123091] Updated weights for policy 0, policy_version 1608878 (0.0010) [2023-12-26 12:26:31,393][123090] Updated weights for policy 1, policy_version 1598247 (0.0007) [2023-12-26 12:26:31,445][123090] Updated weights for policy 1, policy_version 1598257 (0.0008) [2023-12-26 12:26:31,504][123090] Updated weights for policy 1, policy_version 1598267 (0.0008) [2023-12-26 12:26:31,787][123091] Updated weights for policy 0, policy_version 1608888 (0.0009) [2023-12-26 12:26:31,845][123091] Updated weights for policy 0, policy_version 1608898 (0.0009) [2023-12-26 12:26:31,896][123091] Updated weights for policy 0, policy_version 1608908 (0.0008) [2023-12-26 12:26:32,318][123090] Updated weights for policy 1, policy_version 1598277 (0.0007) [2023-12-26 12:26:32,385][123090] Updated weights for policy 1, policy_version 1598287 (0.0006) [2023-12-26 12:26:32,445][123090] Updated weights for policy 1, policy_version 1598297 (0.0005) [2023-12-26 12:26:32,722][123091] Updated weights for policy 0, policy_version 1608918 (0.0007) [2023-12-26 12:26:32,781][123091] Updated weights for policy 0, policy_version 1608928 (0.0007) [2023-12-26 12:26:32,829][123091] Updated weights for policy 0, policy_version 1608938 (0.0006) [2023-12-26 12:26:33,141][123090] Updated weights for policy 1, policy_version 1598307 (0.0005) [2023-12-26 12:26:33,193][123090] Updated weights for policy 1, policy_version 1598317 (0.0005) [2023-12-26 12:26:33,245][123090] Updated weights for policy 1, policy_version 1598327 (0.0005) [2023-12-26 12:26:33,628][123091] Updated weights for policy 0, policy_version 1608948 (0.0006) [2023-12-26 12:26:33,693][123091] Updated weights for policy 0, policy_version 1608958 (0.0005) [2023-12-26 12:26:33,742][123091] Updated weights for policy 0, policy_version 1608968 (0.0005) [2023-12-26 12:26:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 821075968. Throughput: 0: 8904.0, 1: 8800.6. Samples: 821084624. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:33,785][121949] Avg episode reward: [(0, '6193.368'), (1, '5785.654')] [2023-12-26 12:26:33,995][123090] Updated weights for policy 1, policy_version 1598337 (0.0006) [2023-12-26 12:26:34,047][123090] Updated weights for policy 1, policy_version 1598347 (0.0010) [2023-12-26 12:26:34,098][123090] Updated weights for policy 1, policy_version 1598357 (0.0010) [2023-12-26 12:26:34,153][123090] Updated weights for policy 1, policy_version 1598367 (0.0010) [2023-12-26 12:26:34,489][123091] Updated weights for policy 0, policy_version 1608978 (0.0006) [2023-12-26 12:26:34,554][123091] Updated weights for policy 0, policy_version 1608988 (0.0009) [2023-12-26 12:26:34,614][123091] Updated weights for policy 0, policy_version 1608998 (0.0009) [2023-12-26 12:26:34,668][123091] Updated weights for policy 0, policy_version 1609008 (0.0009) [2023-12-26 12:26:35,006][123090] Updated weights for policy 1, policy_version 1598377 (0.0009) [2023-12-26 12:26:35,070][123090] Updated weights for policy 1, policy_version 1598387 (0.0010) [2023-12-26 12:26:35,136][123090] Updated weights for policy 1, policy_version 1598397 (0.0010) [2023-12-26 12:26:35,412][123091] Updated weights for policy 0, policy_version 1609018 (0.0005) [2023-12-26 12:26:35,477][123091] Updated weights for policy 0, policy_version 1609028 (0.0005) [2023-12-26 12:26:35,528][123091] Updated weights for policy 0, policy_version 1609038 (0.0005) [2023-12-26 12:26:35,860][123090] Updated weights for policy 1, policy_version 1598407 (0.0009) [2023-12-26 12:26:35,909][123090] Updated weights for policy 1, policy_version 1598417 (0.0010) [2023-12-26 12:26:35,962][123090] Updated weights for policy 1, policy_version 1598427 (0.0010) [2023-12-26 12:26:36,193][123091] Updated weights for policy 0, policy_version 1609048 (0.0009) [2023-12-26 12:26:36,252][123091] Updated weights for policy 0, policy_version 1609058 (0.0006) [2023-12-26 12:26:36,316][123091] Updated weights for policy 0, policy_version 1609068 (0.0006) [2023-12-26 12:26:36,841][123090] Updated weights for policy 1, policy_version 1598437 (0.0008) [2023-12-26 12:26:36,911][123090] Updated weights for policy 1, policy_version 1598447 (0.0009) [2023-12-26 12:26:36,917][123091] Updated weights for policy 0, policy_version 1609078 (0.0006) [2023-12-26 12:26:36,966][123091] Updated weights for policy 0, policy_version 1609088 (0.0007) [2023-12-26 12:26:36,983][123090] Updated weights for policy 1, policy_version 1598457 (0.0008) [2023-12-26 12:26:37,032][123091] Updated weights for policy 0, policy_version 1609098 (0.0005) [2023-12-26 12:26:37,701][123091] Updated weights for policy 0, policy_version 1609108 (0.0006) [2023-12-26 12:26:37,707][123090] Updated weights for policy 1, policy_version 1598467 (0.0007) [2023-12-26 12:26:37,757][123091] Updated weights for policy 0, policy_version 1609118 (0.0010) [2023-12-26 12:26:37,771][123090] Updated weights for policy 1, policy_version 1598477 (0.0005) [2023-12-26 12:26:37,809][123091] Updated weights for policy 0, policy_version 1609128 (0.0010) [2023-12-26 12:26:37,844][123090] Updated weights for policy 1, policy_version 1598487 (0.0008) [2023-12-26 12:26:38,574][123091] Updated weights for policy 0, policy_version 1609138 (0.0007) [2023-12-26 12:26:38,634][123091] Updated weights for policy 0, policy_version 1609148 (0.0005) [2023-12-26 12:26:38,696][123091] Updated weights for policy 0, policy_version 1609158 (0.0006) [2023-12-26 12:26:38,699][123090] Updated weights for policy 1, policy_version 1598497 (0.0008) [2023-12-26 12:26:38,747][123091] Updated weights for policy 0, policy_version 1609168 (0.0005) [2023-12-26 12:26:38,770][123090] Updated weights for policy 1, policy_version 1598507 (0.0010) [2023-12-26 12:26:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 821166080. Throughput: 0: 8984.6, 1: 8826.6. Samples: 821140072. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:38,785][121949] Avg episode reward: [(0, '6159.475'), (1, '5820.202')] [2023-12-26 12:26:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001609168_411951104.pth... [2023-12-26 12:26:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001608080_411672576.pth [2023-12-26 12:26:38,845][123090] Updated weights for policy 1, policy_version 1598517 (0.0010) [2023-12-26 12:26:38,908][123090] Updated weights for policy 1, policy_version 1598527 (0.0010) [2023-12-26 12:26:38,914][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001598528_409223168.pth... [2023-12-26 12:26:38,919][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001597472_408952832.pth [2023-12-26 12:26:39,490][123091] Updated weights for policy 0, policy_version 1609178 (0.0006) [2023-12-26 12:26:39,554][123091] Updated weights for policy 0, policy_version 1609188 (0.0010) [2023-12-26 12:26:39,628][123091] Updated weights for policy 0, policy_version 1609198 (0.0008) [2023-12-26 12:26:39,725][123090] Updated weights for policy 1, policy_version 1598537 (0.0006) [2023-12-26 12:26:39,794][123090] Updated weights for policy 1, policy_version 1598547 (0.0005) [2023-12-26 12:26:39,862][123090] Updated weights for policy 1, policy_version 1598557 (0.0008) [2023-12-26 12:26:40,498][123091] Updated weights for policy 0, policy_version 1609208 (0.0010) [2023-12-26 12:26:40,550][123090] Updated weights for policy 1, policy_version 1598567 (0.0007) [2023-12-26 12:26:40,552][123091] Updated weights for policy 0, policy_version 1609219 (0.0010) [2023-12-26 12:26:40,620][123090] Updated weights for policy 1, policy_version 1598577 (0.0005) [2023-12-26 12:26:40,621][123091] Updated weights for policy 0, policy_version 1609229 (0.0009) [2023-12-26 12:26:40,691][123090] Updated weights for policy 1, policy_version 1598587 (0.0005) [2023-12-26 12:26:41,371][123090] Updated weights for policy 1, policy_version 1598597 (0.0007) [2023-12-26 12:26:41,435][123090] Updated weights for policy 1, policy_version 1598607 (0.0010) [2023-12-26 12:26:41,493][123090] Updated weights for policy 1, policy_version 1598617 (0.0011) [2023-12-26 12:26:41,498][123091] Updated weights for policy 0, policy_version 1609239 (0.0009) [2023-12-26 12:26:41,556][123091] Updated weights for policy 0, policy_version 1609249 (0.0009) [2023-12-26 12:26:41,618][123091] Updated weights for policy 0, policy_version 1609259 (0.0006) [2023-12-26 12:26:42,367][123090] Updated weights for policy 1, policy_version 1598627 (0.0010) [2023-12-26 12:26:42,434][123090] Updated weights for policy 1, policy_version 1598637 (0.0011) [2023-12-26 12:26:42,497][123091] Updated weights for policy 0, policy_version 1609269 (0.0008) [2023-12-26 12:26:42,498][123090] Updated weights for policy 1, policy_version 1598647 (0.0010) [2023-12-26 12:26:42,547][123091] Updated weights for policy 0, policy_version 1609279 (0.0010) [2023-12-26 12:26:42,603][123091] Updated weights for policy 0, policy_version 1609289 (0.0008) [2023-12-26 12:26:43,319][123090] Updated weights for policy 1, policy_version 1598657 (0.0010) [2023-12-26 12:26:43,370][123090] Updated weights for policy 1, policy_version 1598667 (0.0010) [2023-12-26 12:26:43,433][123090] Updated weights for policy 1, policy_version 1598677 (0.0010) [2023-12-26 12:26:43,453][123091] Updated weights for policy 0, policy_version 1609299 (0.0008) [2023-12-26 12:26:43,496][123090] Updated weights for policy 1, policy_version 1598687 (0.0011) [2023-12-26 12:26:43,508][123091] Updated weights for policy 0, policy_version 1609309 (0.0008) [2023-12-26 12:26:43,555][123091] Updated weights for policy 0, policy_version 1609319 (0.0005) [2023-12-26 12:26:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 821256192. Throughput: 0: 8995.2, 1: 8773.3. Samples: 821245768. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:43,784][121949] Avg episode reward: [(0, '6249.861'), (1, '5660.410')] [2023-12-26 12:26:44,235][123091] Updated weights for policy 0, policy_version 1609329 (0.0005) [2023-12-26 12:26:44,286][123091] Updated weights for policy 0, policy_version 1609339 (0.0005) [2023-12-26 12:26:44,328][123090] Updated weights for policy 1, policy_version 1598697 (0.0011) [2023-12-26 12:26:44,350][123091] Updated weights for policy 0, policy_version 1609349 (0.0009) [2023-12-26 12:26:44,379][123090] Updated weights for policy 1, policy_version 1598707 (0.0010) [2023-12-26 12:26:44,402][123091] Updated weights for policy 0, policy_version 1609359 (0.0010) [2023-12-26 12:26:44,430][123090] Updated weights for policy 1, policy_version 1598717 (0.0010) [2023-12-26 12:26:45,108][123091] Updated weights for policy 0, policy_version 1609369 (0.0006) [2023-12-26 12:26:45,180][123091] Updated weights for policy 0, policy_version 1609379 (0.0006) [2023-12-26 12:26:45,249][123091] Updated weights for policy 0, policy_version 1609389 (0.0009) [2023-12-26 12:26:45,281][123090] Updated weights for policy 1, policy_version 1598727 (0.0007) [2023-12-26 12:26:45,341][123090] Updated weights for policy 1, policy_version 1598737 (0.0005) [2023-12-26 12:26:45,411][123090] Updated weights for policy 1, policy_version 1598747 (0.0006) [2023-12-26 12:26:45,980][123091] Updated weights for policy 0, policy_version 1609399 (0.0007) [2023-12-26 12:26:46,056][123091] Updated weights for policy 0, policy_version 1609409 (0.0005) [2023-12-26 12:26:46,132][123091] Updated weights for policy 0, policy_version 1609419 (0.0005) [2023-12-26 12:26:46,156][123090] Updated weights for policy 1, policy_version 1598757 (0.0006) [2023-12-26 12:26:46,215][123090] Updated weights for policy 1, policy_version 1598767 (0.0005) [2023-12-26 12:26:46,269][123090] Updated weights for policy 1, policy_version 1598777 (0.0005) [2023-12-26 12:26:46,743][123091] Updated weights for policy 0, policy_version 1609429 (0.0005) [2023-12-26 12:26:46,791][123091] Updated weights for policy 0, policy_version 1609439 (0.0005) [2023-12-26 12:26:46,849][123091] Updated weights for policy 0, policy_version 1609449 (0.0005) [2023-12-26 12:26:46,973][123090] Updated weights for policy 1, policy_version 1598787 (0.0006) [2023-12-26 12:26:47,035][123090] Updated weights for policy 1, policy_version 1598797 (0.0010) [2023-12-26 12:26:47,097][123090] Updated weights for policy 1, policy_version 1598807 (0.0010) [2023-12-26 12:26:47,488][123091] Updated weights for policy 0, policy_version 1609459 (0.0007) [2023-12-26 12:26:47,534][123091] Updated weights for policy 0, policy_version 1609469 (0.0009) [2023-12-26 12:26:47,579][123091] Updated weights for policy 0, policy_version 1609479 (0.0005) [2023-12-26 12:26:47,878][123090] Updated weights for policy 1, policy_version 1598817 (0.0010) [2023-12-26 12:26:47,942][123090] Updated weights for policy 1, policy_version 1598827 (0.0005) [2023-12-26 12:26:48,006][123090] Updated weights for policy 1, policy_version 1598837 (0.0005) [2023-12-26 12:26:48,067][123090] Updated weights for policy 1, policy_version 1598847 (0.0005) [2023-12-26 12:26:48,243][123091] Updated weights for policy 0, policy_version 1609489 (0.0005) [2023-12-26 12:26:48,303][123091] Updated weights for policy 0, policy_version 1609499 (0.0008) [2023-12-26 12:26:48,380][123091] Updated weights for policy 0, policy_version 1609509 (0.0009) [2023-12-26 12:26:48,448][123091] Updated weights for policy 0, policy_version 1609519 (0.0007) [2023-12-26 12:26:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 821346304. Throughput: 0: 9160.0, 1: 8856.7. Samples: 821361692. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:48,784][121949] Avg episode reward: [(0, '6234.355'), (1, '5704.364')] [2023-12-26 12:26:48,803][123090] Updated weights for policy 1, policy_version 1598857 (0.0010) [2023-12-26 12:26:48,863][123090] Updated weights for policy 1, policy_version 1598867 (0.0010) [2023-12-26 12:26:48,925][123090] Updated weights for policy 1, policy_version 1598877 (0.0010) [2023-12-26 12:26:49,068][123091] Updated weights for policy 0, policy_version 1609529 (0.0006) [2023-12-26 12:26:49,131][123091] Updated weights for policy 0, policy_version 1609539 (0.0006) [2023-12-26 12:26:49,196][123091] Updated weights for policy 0, policy_version 1609549 (0.0006) [2023-12-26 12:26:49,746][123090] Updated weights for policy 1, policy_version 1598887 (0.0007) [2023-12-26 12:26:49,802][123090] Updated weights for policy 1, policy_version 1598897 (0.0009) [2023-12-26 12:26:49,870][123090] Updated weights for policy 1, policy_version 1598907 (0.0010) [2023-12-26 12:26:49,925][123091] Updated weights for policy 0, policy_version 1609559 (0.0009) [2023-12-26 12:26:49,994][123091] Updated weights for policy 0, policy_version 1609569 (0.0009) [2023-12-26 12:26:50,060][123091] Updated weights for policy 0, policy_version 1609579 (0.0009) [2023-12-26 12:26:50,701][123090] Updated weights for policy 1, policy_version 1598917 (0.0010) [2023-12-26 12:26:50,761][123090] Updated weights for policy 1, policy_version 1598927 (0.0010) [2023-12-26 12:26:50,831][123090] Updated weights for policy 1, policy_version 1598937 (0.0010) [2023-12-26 12:26:50,861][123091] Updated weights for policy 0, policy_version 1609589 (0.0008) [2023-12-26 12:26:50,923][123091] Updated weights for policy 0, policy_version 1609599 (0.0008) [2023-12-26 12:26:50,989][123091] Updated weights for policy 0, policy_version 1609609 (0.0009) [2023-12-26 12:26:51,700][123090] Updated weights for policy 1, policy_version 1598947 (0.0010) [2023-12-26 12:26:51,767][123090] Updated weights for policy 1, policy_version 1598957 (0.0009) [2023-12-26 12:26:51,803][123091] Updated weights for policy 0, policy_version 1609619 (0.0009) [2023-12-26 12:26:51,818][123090] Updated weights for policy 1, policy_version 1598967 (0.0010) [2023-12-26 12:26:51,852][123091] Updated weights for policy 0, policy_version 1609629 (0.0007) [2023-12-26 12:26:51,905][123091] Updated weights for policy 0, policy_version 1609639 (0.0007) [2023-12-26 12:26:52,679][123090] Updated weights for policy 1, policy_version 1598977 (0.0008) [2023-12-26 12:26:52,704][123091] Updated weights for policy 0, policy_version 1609649 (0.0006) [2023-12-26 12:26:52,744][123090] Updated weights for policy 1, policy_version 1598987 (0.0010) [2023-12-26 12:26:52,761][123091] Updated weights for policy 0, policy_version 1609659 (0.0006) [2023-12-26 12:26:52,800][123090] Updated weights for policy 1, policy_version 1598997 (0.0010) [2023-12-26 12:26:52,816][123091] Updated weights for policy 0, policy_version 1609669 (0.0006) [2023-12-26 12:26:52,852][123090] Updated weights for policy 1, policy_version 1599007 (0.0010) [2023-12-26 12:26:52,878][123091] Updated weights for policy 0, policy_version 1609679 (0.0008) [2023-12-26 12:26:53,678][123090] Updated weights for policy 1, policy_version 1599017 (0.0010) [2023-12-26 12:26:53,738][123090] Updated weights for policy 1, policy_version 1599027 (0.0010) [2023-12-26 12:26:53,741][123091] Updated weights for policy 0, policy_version 1609689 (0.0007) [2023-12-26 12:26:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 821428224. Throughput: 0: 9169.4, 1: 8844.1. Samples: 821414020. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:53,785][121949] Avg episode reward: [(0, '5997.007'), (1, '5932.353')] [2023-12-26 12:26:53,793][123090] Updated weights for policy 1, policy_version 1599037 (0.0010) [2023-12-26 12:26:53,796][123091] Updated weights for policy 0, policy_version 1609699 (0.0005) [2023-12-26 12:26:53,808][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001599040_409354240.pth... [2023-12-26 12:26:53,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001597984_409083904.pth [2023-12-26 12:26:53,847][123091] Updated weights for policy 0, policy_version 1609709 (0.0008) [2023-12-26 12:26:53,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001609712_412090368.pth... [2023-12-26 12:26:53,865][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001608624_411811840.pth [2023-12-26 12:26:54,632][123090] Updated weights for policy 1, policy_version 1599047 (0.0010) [2023-12-26 12:26:54,695][123090] Updated weights for policy 1, policy_version 1599057 (0.0010) [2023-12-26 12:26:54,698][123091] Updated weights for policy 0, policy_version 1609719 (0.0007) [2023-12-26 12:26:54,757][123091] Updated weights for policy 0, policy_version 1609729 (0.0007) [2023-12-26 12:26:54,758][123090] Updated weights for policy 1, policy_version 1599067 (0.0010) [2023-12-26 12:26:54,820][123091] Updated weights for policy 0, policy_version 1609739 (0.0008) [2023-12-26 12:26:55,564][123090] Updated weights for policy 1, policy_version 1599077 (0.0010) [2023-12-26 12:26:55,611][123090] Updated weights for policy 1, policy_version 1599087 (0.0010) [2023-12-26 12:26:55,632][123091] Updated weights for policy 0, policy_version 1609749 (0.0007) [2023-12-26 12:26:55,659][123090] Updated weights for policy 1, policy_version 1599097 (0.0010) [2023-12-26 12:26:55,680][123091] Updated weights for policy 0, policy_version 1609759 (0.0006) [2023-12-26 12:26:55,734][123091] Updated weights for policy 0, policy_version 1609769 (0.0008) [2023-12-26 12:26:56,502][123090] Updated weights for policy 1, policy_version 1599107 (0.0010) [2023-12-26 12:26:56,552][123090] Updated weights for policy 1, policy_version 1599117 (0.0010) [2023-12-26 12:26:56,585][123091] Updated weights for policy 0, policy_version 1609779 (0.0008) [2023-12-26 12:26:56,607][123090] Updated weights for policy 1, policy_version 1599127 (0.0010) [2023-12-26 12:26:56,635][123091] Updated weights for policy 0, policy_version 1609789 (0.0006) [2023-12-26 12:26:56,695][123091] Updated weights for policy 0, policy_version 1609799 (0.0007) [2023-12-26 12:26:57,438][123090] Updated weights for policy 1, policy_version 1599137 (0.0010) [2023-12-26 12:26:57,493][123090] Updated weights for policy 1, policy_version 1599147 (0.0010) [2023-12-26 12:26:57,526][123091] Updated weights for policy 0, policy_version 1609809 (0.0008) [2023-12-26 12:26:57,548][123090] Updated weights for policy 1, policy_version 1599157 (0.0010) [2023-12-26 12:26:57,582][123091] Updated weights for policy 0, policy_version 1609819 (0.0006) [2023-12-26 12:26:57,605][123090] Updated weights for policy 1, policy_version 1599167 (0.0010) [2023-12-26 12:26:57,630][123091] Updated weights for policy 0, policy_version 1609829 (0.0009) [2023-12-26 12:26:57,687][123091] Updated weights for policy 0, policy_version 1609839 (0.0009) [2023-12-26 12:26:58,437][123090] Updated weights for policy 1, policy_version 1599177 (0.0010) [2023-12-26 12:26:58,507][123090] Updated weights for policy 1, policy_version 1599187 (0.0010) [2023-12-26 12:26:58,570][123091] Updated weights for policy 0, policy_version 1609849 (0.0009) [2023-12-26 12:26:58,583][123090] Updated weights for policy 1, policy_version 1599197 (0.0009) [2023-12-26 12:26:58,636][123091] Updated weights for policy 0, policy_version 1609859 (0.0009) [2023-12-26 12:26:58,716][123091] Updated weights for policy 0, policy_version 1609869 (0.0012) [2023-12-26 12:26:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 821526528. Throughput: 0: 9176.2, 1: 8832.6. Samples: 821516400. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:26:58,785][121949] Avg episode reward: [(0, '5994.774'), (1, '5878.545')] [2023-12-26 12:26:59,445][123090] Updated weights for policy 1, policy_version 1599207 (0.0010) [2023-12-26 12:26:59,496][123090] Updated weights for policy 1, policy_version 1599217 (0.0010) [2023-12-26 12:26:59,553][123090] Updated weights for policy 1, policy_version 1599227 (0.0012) [2023-12-26 12:26:59,637][123091] Updated weights for policy 0, policy_version 1609879 (0.0008) [2023-12-26 12:26:59,699][123091] Updated weights for policy 0, policy_version 1609889 (0.0008) [2023-12-26 12:26:59,753][123091] Updated weights for policy 0, policy_version 1609899 (0.0008) [2023-12-26 12:27:00,329][123090] Updated weights for policy 1, policy_version 1599237 (0.0010) [2023-12-26 12:27:00,384][123090] Updated weights for policy 1, policy_version 1599247 (0.0010) [2023-12-26 12:27:00,449][123090] Updated weights for policy 1, policy_version 1599257 (0.0010) [2023-12-26 12:27:00,547][123091] Updated weights for policy 0, policy_version 1609909 (0.0007) [2023-12-26 12:27:00,614][123091] Updated weights for policy 0, policy_version 1609919 (0.0007) [2023-12-26 12:27:00,673][123091] Updated weights for policy 0, policy_version 1609929 (0.0009) [2023-12-26 12:27:01,197][123090] Updated weights for policy 1, policy_version 1599267 (0.0009) [2023-12-26 12:27:01,255][123090] Updated weights for policy 1, policy_version 1599277 (0.0006) [2023-12-26 12:27:01,312][123090] Updated weights for policy 1, policy_version 1599287 (0.0010) [2023-12-26 12:27:01,483][123091] Updated weights for policy 0, policy_version 1609939 (0.0010) [2023-12-26 12:27:01,552][123091] Updated weights for policy 0, policy_version 1609949 (0.0010) [2023-12-26 12:27:01,606][123091] Updated weights for policy 0, policy_version 1609960 (0.0010) [2023-12-26 12:27:02,145][123090] Updated weights for policy 1, policy_version 1599297 (0.0008) [2023-12-26 12:27:02,193][123090] Updated weights for policy 1, policy_version 1599307 (0.0009) [2023-12-26 12:27:02,263][123090] Updated weights for policy 1, policy_version 1599317 (0.0007) [2023-12-26 12:27:02,325][123090] Updated weights for policy 1, policy_version 1599327 (0.0010) [2023-12-26 12:27:02,477][123091] Updated weights for policy 0, policy_version 1609970 (0.0009) [2023-12-26 12:27:02,539][123091] Updated weights for policy 0, policy_version 1609980 (0.0008) [2023-12-26 12:27:02,609][123091] Updated weights for policy 0, policy_version 1609990 (0.0007) [2023-12-26 12:27:02,674][123091] Updated weights for policy 0, policy_version 1610000 (0.0006) [2023-12-26 12:27:03,064][123090] Updated weights for policy 1, policy_version 1599337 (0.0009) [2023-12-26 12:27:03,121][123090] Updated weights for policy 1, policy_version 1599347 (0.0009) [2023-12-26 12:27:03,199][123090] Updated weights for policy 1, policy_version 1599357 (0.0010) [2023-12-26 12:27:03,443][123091] Updated weights for policy 0, policy_version 1610010 (0.0010) [2023-12-26 12:27:03,499][123091] Updated weights for policy 0, policy_version 1610021 (0.0009) [2023-12-26 12:27:03,552][123091] Updated weights for policy 0, policy_version 1610032 (0.0009) [2023-12-26 12:27:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 821608448. Throughput: 0: 9048.5, 1: 8867.2. Samples: 821619124. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:03,785][121949] Avg episode reward: [(0, '6127.203'), (1, '5697.409')] [2023-12-26 12:27:04,033][123090] Updated weights for policy 1, policy_version 1599367 (0.0010) [2023-12-26 12:27:04,104][123090] Updated weights for policy 1, policy_version 1599377 (0.0006) [2023-12-26 12:27:04,179][123090] Updated weights for policy 1, policy_version 1599387 (0.0006) [2023-12-26 12:27:04,429][123091] Updated weights for policy 0, policy_version 1610042 (0.0008) [2023-12-26 12:27:04,486][123091] Updated weights for policy 0, policy_version 1610052 (0.0010) [2023-12-26 12:27:04,548][123091] Updated weights for policy 0, policy_version 1610062 (0.0009) [2023-12-26 12:27:04,774][123090] Updated weights for policy 1, policy_version 1599397 (0.0005) [2023-12-26 12:27:04,843][123090] Updated weights for policy 1, policy_version 1599407 (0.0006) [2023-12-26 12:27:04,909][123090] Updated weights for policy 1, policy_version 1599417 (0.0005) [2023-12-26 12:27:05,433][123091] Updated weights for policy 0, policy_version 1610072 (0.0010) [2023-12-26 12:27:05,482][123091] Updated weights for policy 0, policy_version 1610082 (0.0009) [2023-12-26 12:27:05,531][123091] Updated weights for policy 0, policy_version 1610092 (0.0009) [2023-12-26 12:27:05,589][123090] Updated weights for policy 1, policy_version 1599427 (0.0007) [2023-12-26 12:27:05,646][123090] Updated weights for policy 1, policy_version 1599437 (0.0009) [2023-12-26 12:27:05,703][123090] Updated weights for policy 1, policy_version 1599447 (0.0009) [2023-12-26 12:27:06,396][123091] Updated weights for policy 0, policy_version 1610102 (0.0008) [2023-12-26 12:27:06,448][123091] Updated weights for policy 0, policy_version 1610112 (0.0009) [2023-12-26 12:27:06,500][123091] Updated weights for policy 0, policy_version 1610122 (0.0010) [2023-12-26 12:27:06,548][123090] Updated weights for policy 1, policy_version 1599457 (0.0009) [2023-12-26 12:27:06,609][123090] Updated weights for policy 1, policy_version 1599467 (0.0010) [2023-12-26 12:27:06,664][123090] Updated weights for policy 1, policy_version 1599477 (0.0010) [2023-12-26 12:27:06,719][123090] Updated weights for policy 1, policy_version 1599488 (0.0010) [2023-12-26 12:27:07,332][123091] Updated weights for policy 0, policy_version 1610132 (0.0008) [2023-12-26 12:27:07,378][123091] Updated weights for policy 0, policy_version 1610142 (0.0005) [2023-12-26 12:27:07,432][123091] Updated weights for policy 0, policy_version 1610152 (0.0006) [2023-12-26 12:27:07,507][123090] Updated weights for policy 1, policy_version 1599498 (0.0005) [2023-12-26 12:27:07,576][123090] Updated weights for policy 1, policy_version 1599508 (0.0008) [2023-12-26 12:27:07,637][123090] Updated weights for policy 1, policy_version 1599518 (0.0009) [2023-12-26 12:27:08,175][123091] Updated weights for policy 0, policy_version 1610162 (0.0006) [2023-12-26 12:27:08,224][123091] Updated weights for policy 0, policy_version 1610173 (0.0009) [2023-12-26 12:27:08,276][123090] Updated weights for policy 1, policy_version 1599528 (0.0009) [2023-12-26 12:27:08,276][123091] Updated weights for policy 0, policy_version 1610183 (0.0008) [2023-12-26 12:27:08,332][123090] Updated weights for policy 1, policy_version 1599538 (0.0010) [2023-12-26 12:27:08,403][123090] Updated weights for policy 1, policy_version 1599548 (0.0011) [2023-12-26 12:27:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 821698560. Throughput: 0: 9008.8, 1: 8949.3. Samples: 821671864. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:08,785][121949] Avg episode reward: [(0, '6190.328'), (1, '5793.304')] [2023-12-26 12:27:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001610192_412213248.pth... [2023-12-26 12:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001599552_409485312.pth... [2023-12-26 12:27:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001609168_411951104.pth [2023-12-26 12:27:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001598528_409223168.pth [2023-12-26 12:27:08,997][123091] Updated weights for policy 0, policy_version 1610193 (0.0006) [2023-12-26 12:27:09,057][123091] Updated weights for policy 0, policy_version 1610203 (0.0008) [2023-12-26 12:27:09,113][123091] Updated weights for policy 0, policy_version 1610213 (0.0009) [2023-12-26 12:27:09,161][123091] Updated weights for policy 0, policy_version 1610223 (0.0008) [2023-12-26 12:27:09,242][123090] Updated weights for policy 1, policy_version 1599558 (0.0011) [2023-12-26 12:27:09,298][123090] Updated weights for policy 1, policy_version 1599568 (0.0010) [2023-12-26 12:27:09,367][123090] Updated weights for policy 1, policy_version 1599578 (0.0010) [2023-12-26 12:27:10,014][123091] Updated weights for policy 0, policy_version 1610233 (0.0008) [2023-12-26 12:27:10,066][123091] Updated weights for policy 0, policy_version 1610243 (0.0008) [2023-12-26 12:27:10,125][123091] Updated weights for policy 0, policy_version 1610253 (0.0008) [2023-12-26 12:27:10,238][123090] Updated weights for policy 1, policy_version 1599588 (0.0009) [2023-12-26 12:27:10,293][123090] Updated weights for policy 1, policy_version 1599598 (0.0009) [2023-12-26 12:27:10,348][123090] Updated weights for policy 1, policy_version 1599608 (0.0009) [2023-12-26 12:27:10,962][123091] Updated weights for policy 0, policy_version 1610263 (0.0006) [2023-12-26 12:27:11,036][123091] Updated weights for policy 0, policy_version 1610273 (0.0006) [2023-12-26 12:27:11,097][123091] Updated weights for policy 0, policy_version 1610283 (0.0008) [2023-12-26 12:27:11,196][123090] Updated weights for policy 1, policy_version 1599618 (0.0010) [2023-12-26 12:27:11,254][123090] Updated weights for policy 1, policy_version 1599628 (0.0010) [2023-12-26 12:27:11,320][123090] Updated weights for policy 1, policy_version 1599638 (0.0010) [2023-12-26 12:27:11,395][123090] Updated weights for policy 1, policy_version 1599648 (0.0009) [2023-12-26 12:27:11,943][123091] Updated weights for policy 0, policy_version 1610293 (0.0010) [2023-12-26 12:27:12,014][123091] Updated weights for policy 0, policy_version 1610303 (0.0010) [2023-12-26 12:27:12,077][123091] Updated weights for policy 0, policy_version 1610313 (0.0009) [2023-12-26 12:27:12,252][123090] Updated weights for policy 1, policy_version 1599658 (0.0010) [2023-12-26 12:27:12,328][123090] Updated weights for policy 1, policy_version 1599668 (0.0009) [2023-12-26 12:27:12,400][123090] Updated weights for policy 1, policy_version 1599678 (0.0009) [2023-12-26 12:27:12,898][123091] Updated weights for policy 0, policy_version 1610323 (0.0010) [2023-12-26 12:27:12,949][123091] Updated weights for policy 0, policy_version 1610333 (0.0010) [2023-12-26 12:27:13,001][123091] Updated weights for policy 0, policy_version 1610344 (0.0010) [2023-12-26 12:27:13,220][123090] Updated weights for policy 1, policy_version 1599688 (0.0010) [2023-12-26 12:27:13,269][123090] Updated weights for policy 1, policy_version 1599698 (0.0009) [2023-12-26 12:27:13,318][123090] Updated weights for policy 1, policy_version 1599708 (0.0009) [2023-12-26 12:27:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 821780480. Throughput: 0: 8936.7, 1: 8858.0. Samples: 821776176. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:13,785][121949] Avg episode reward: [(0, '6212.599'), (1, '5908.121')] [2023-12-26 12:27:13,811][123091] Updated weights for policy 0, policy_version 1610354 (0.0010) [2023-12-26 12:27:13,865][123091] Updated weights for policy 0, policy_version 1610364 (0.0009) [2023-12-26 12:27:13,935][123091] Updated weights for policy 0, policy_version 1610374 (0.0010) [2023-12-26 12:27:14,003][123091] Updated weights for policy 0, policy_version 1610384 (0.0008) [2023-12-26 12:27:14,212][123090] Updated weights for policy 1, policy_version 1599718 (0.0007) [2023-12-26 12:27:14,263][123090] Updated weights for policy 1, policy_version 1599728 (0.0005) [2023-12-26 12:27:14,317][123090] Updated weights for policy 1, policy_version 1599738 (0.0006) [2023-12-26 12:27:14,838][123091] Updated weights for policy 0, policy_version 1610394 (0.0009) [2023-12-26 12:27:14,891][123091] Updated weights for policy 0, policy_version 1610404 (0.0010) [2023-12-26 12:27:14,951][123091] Updated weights for policy 0, policy_version 1610414 (0.0009) [2023-12-26 12:27:15,040][123090] Updated weights for policy 1, policy_version 1599748 (0.0007) [2023-12-26 12:27:15,104][123090] Updated weights for policy 1, policy_version 1599758 (0.0009) [2023-12-26 12:27:15,169][123090] Updated weights for policy 1, policy_version 1599768 (0.0009) [2023-12-26 12:27:15,829][123091] Updated weights for policy 0, policy_version 1610424 (0.0009) [2023-12-26 12:27:15,877][123091] Updated weights for policy 0, policy_version 1610434 (0.0011) [2023-12-26 12:27:15,925][123091] Updated weights for policy 0, policy_version 1610444 (0.0010) [2023-12-26 12:27:15,960][123090] Updated weights for policy 1, policy_version 1599778 (0.0008) [2023-12-26 12:27:16,027][123090] Updated weights for policy 1, policy_version 1599788 (0.0009) [2023-12-26 12:27:16,096][123090] Updated weights for policy 1, policy_version 1599798 (0.0009) [2023-12-26 12:27:16,160][123090] Updated weights for policy 1, policy_version 1599808 (0.0008) [2023-12-26 12:27:16,747][123091] Updated weights for policy 0, policy_version 1610454 (0.0010) [2023-12-26 12:27:16,817][123091] Updated weights for policy 0, policy_version 1610464 (0.0009) [2023-12-26 12:27:16,881][123091] Updated weights for policy 0, policy_version 1610474 (0.0010) [2023-12-26 12:27:16,981][123090] Updated weights for policy 1, policy_version 1599818 (0.0009) [2023-12-26 12:27:17,037][123090] Updated weights for policy 1, policy_version 1599828 (0.0009) [2023-12-26 12:27:17,087][123090] Updated weights for policy 1, policy_version 1599838 (0.0010) [2023-12-26 12:27:17,621][123091] Updated weights for policy 0, policy_version 1610484 (0.0009) [2023-12-26 12:27:17,687][123091] Updated weights for policy 0, policy_version 1610494 (0.0005) [2023-12-26 12:27:17,748][123091] Updated weights for policy 0, policy_version 1610504 (0.0005) [2023-12-26 12:27:17,971][123090] Updated weights for policy 1, policy_version 1599848 (0.0009) [2023-12-26 12:27:18,027][123090] Updated weights for policy 1, policy_version 1599858 (0.0009) [2023-12-26 12:27:18,090][123090] Updated weights for policy 1, policy_version 1599868 (0.0009) [2023-12-26 12:27:18,459][123091] Updated weights for policy 0, policy_version 1610514 (0.0005) [2023-12-26 12:27:18,527][123091] Updated weights for policy 0, policy_version 1610524 (0.0005) [2023-12-26 12:27:18,595][123091] Updated weights for policy 0, policy_version 1610534 (0.0006) [2023-12-26 12:27:18,666][123091] Updated weights for policy 0, policy_version 1610544 (0.0010) [2023-12-26 12:27:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 821870592. Throughput: 0: 8955.8, 1: 8749.2. Samples: 821881348. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:18,785][121949] Avg episode reward: [(0, '6275.209'), (1, '5990.045')] [2023-12-26 12:27:18,988][123090] Updated weights for policy 1, policy_version 1599878 (0.0009) [2023-12-26 12:27:19,041][123090] Updated weights for policy 1, policy_version 1599888 (0.0009) [2023-12-26 12:27:19,107][123090] Updated weights for policy 1, policy_version 1599898 (0.0010) [2023-12-26 12:27:19,347][123091] Updated weights for policy 0, policy_version 1610554 (0.0006) [2023-12-26 12:27:19,421][123091] Updated weights for policy 0, policy_version 1610564 (0.0010) [2023-12-26 12:27:19,476][123091] Updated weights for policy 0, policy_version 1610574 (0.0010) [2023-12-26 12:27:20,023][123090] Updated weights for policy 1, policy_version 1599908 (0.0009) [2023-12-26 12:27:20,094][123090] Updated weights for policy 1, policy_version 1599918 (0.0008) [2023-12-26 12:27:20,165][123090] Updated weights for policy 1, policy_version 1599928 (0.0008) [2023-12-26 12:27:20,267][123091] Updated weights for policy 0, policy_version 1610584 (0.0009) [2023-12-26 12:27:20,327][123091] Updated weights for policy 0, policy_version 1610594 (0.0010) [2023-12-26 12:27:20,379][123091] Updated weights for policy 0, policy_version 1610604 (0.0008) [2023-12-26 12:27:20,904][123090] Updated weights for policy 1, policy_version 1599938 (0.0008) [2023-12-26 12:27:20,975][123090] Updated weights for policy 1, policy_version 1599948 (0.0006) [2023-12-26 12:27:21,045][123090] Updated weights for policy 1, policy_version 1599958 (0.0007) [2023-12-26 12:27:21,104][123090] Updated weights for policy 1, policy_version 1599968 (0.0006) [2023-12-26 12:27:21,299][123091] Updated weights for policy 0, policy_version 1610614 (0.0009) [2023-12-26 12:27:21,361][123091] Updated weights for policy 0, policy_version 1610624 (0.0009) [2023-12-26 12:27:21,430][123091] Updated weights for policy 0, policy_version 1610634 (0.0009) [2023-12-26 12:27:21,891][123090] Updated weights for policy 1, policy_version 1599978 (0.0006) [2023-12-26 12:27:21,953][123090] Updated weights for policy 1, policy_version 1599988 (0.0006) [2023-12-26 12:27:22,021][123090] Updated weights for policy 1, policy_version 1599998 (0.0007) [2023-12-26 12:27:22,192][123091] Updated weights for policy 0, policy_version 1610644 (0.0007) [2023-12-26 12:27:22,245][123091] Updated weights for policy 0, policy_version 1610654 (0.0010) [2023-12-26 12:27:22,317][123091] Updated weights for policy 0, policy_version 1610664 (0.0010) [2023-12-26 12:27:22,643][123090] Updated weights for policy 1, policy_version 1600008 (0.0008) [2023-12-26 12:27:22,712][123090] Updated weights for policy 1, policy_version 1600018 (0.0006) [2023-12-26 12:27:22,777][123090] Updated weights for policy 1, policy_version 1600028 (0.0011) [2023-12-26 12:27:23,129][123091] Updated weights for policy 0, policy_version 1610674 (0.0010) [2023-12-26 12:27:23,188][123091] Updated weights for policy 0, policy_version 1610684 (0.0008) [2023-12-26 12:27:23,250][123091] Updated weights for policy 0, policy_version 1610694 (0.0010) [2023-12-26 12:27:23,319][123091] Updated weights for policy 0, policy_version 1610704 (0.0009) [2023-12-26 12:27:23,517][123090] Updated weights for policy 1, policy_version 1600038 (0.0008) [2023-12-26 12:27:23,568][123090] Updated weights for policy 1, policy_version 1600048 (0.0010) [2023-12-26 12:27:23,619][123090] Updated weights for policy 1, policy_version 1600058 (0.0010) [2023-12-26 12:27:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 821960704. Throughput: 0: 8886.9, 1: 8741.4. Samples: 821933348. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:23,785][121949] Avg episode reward: [(0, '6296.548'), (1, '5957.921')] [2023-12-26 12:27:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001600064_409616384.pth... [2023-12-26 12:27:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001610704_412344320.pth... [2023-12-26 12:27:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001609712_412090368.pth [2023-12-26 12:27:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001599040_409354240.pth [2023-12-26 12:27:24,193][123091] Updated weights for policy 0, policy_version 1610714 (0.0008) [2023-12-26 12:27:24,244][123091] Updated weights for policy 0, policy_version 1610724 (0.0009) [2023-12-26 12:27:24,309][123091] Updated weights for policy 0, policy_version 1610734 (0.0010) [2023-12-26 12:27:24,380][123090] Updated weights for policy 1, policy_version 1600068 (0.0009) [2023-12-26 12:27:24,450][123090] Updated weights for policy 1, policy_version 1600078 (0.0006) [2023-12-26 12:27:24,523][123090] Updated weights for policy 1, policy_version 1600088 (0.0008) [2023-12-26 12:27:25,165][123091] Updated weights for policy 0, policy_version 1610744 (0.0009) [2023-12-26 12:27:25,219][123091] Updated weights for policy 0, policy_version 1610754 (0.0009) [2023-12-26 12:27:25,274][123091] Updated weights for policy 0, policy_version 1610766 (0.0011) [2023-12-26 12:27:25,279][123090] Updated weights for policy 1, policy_version 1600098 (0.0008) [2023-12-26 12:27:25,348][123090] Updated weights for policy 1, policy_version 1600108 (0.0005) [2023-12-26 12:27:25,413][123090] Updated weights for policy 1, policy_version 1600118 (0.0005) [2023-12-26 12:27:25,477][123090] Updated weights for policy 1, policy_version 1600128 (0.0005) [2023-12-26 12:27:26,059][123090] Updated weights for policy 1, policy_version 1600138 (0.0005) [2023-12-26 12:27:26,105][123090] Updated weights for policy 1, policy_version 1600148 (0.0005) [2023-12-26 12:27:26,157][123090] Updated weights for policy 1, policy_version 1600158 (0.0005) [2023-12-26 12:27:26,201][123091] Updated weights for policy 0, policy_version 1610776 (0.0009) [2023-12-26 12:27:26,256][123091] Updated weights for policy 0, policy_version 1610786 (0.0010) [2023-12-26 12:27:26,314][123091] Updated weights for policy 0, policy_version 1610796 (0.0009) [2023-12-26 12:27:26,885][123090] Updated weights for policy 1, policy_version 1600168 (0.0009) [2023-12-26 12:27:26,943][123090] Updated weights for policy 1, policy_version 1600178 (0.0010) [2023-12-26 12:27:27,005][123090] Updated weights for policy 1, policy_version 1600188 (0.0010) [2023-12-26 12:27:27,218][123091] Updated weights for policy 0, policy_version 1610806 (0.0010) [2023-12-26 12:27:27,271][123091] Updated weights for policy 0, policy_version 1610817 (0.0009) [2023-12-26 12:27:27,324][123091] Updated weights for policy 0, policy_version 1610827 (0.0009) [2023-12-26 12:27:27,596][123090] Updated weights for policy 1, policy_version 1600198 (0.0009) [2023-12-26 12:27:27,658][123090] Updated weights for policy 1, policy_version 1600208 (0.0010) [2023-12-26 12:27:27,728][123090] Updated weights for policy 1, policy_version 1600218 (0.0010) [2023-12-26 12:27:28,113][123091] Updated weights for policy 0, policy_version 1610837 (0.0007) [2023-12-26 12:27:28,171][123091] Updated weights for policy 0, policy_version 1610847 (0.0005) [2023-12-26 12:27:28,233][123091] Updated weights for policy 0, policy_version 1610857 (0.0005) [2023-12-26 12:27:28,452][123090] Updated weights for policy 1, policy_version 1600228 (0.0010) [2023-12-26 12:27:28,503][123090] Updated weights for policy 1, policy_version 1600238 (0.0010) [2023-12-26 12:27:28,561][123090] Updated weights for policy 1, policy_version 1600248 (0.0010) [2023-12-26 12:27:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 822050816. Throughput: 0: 8789.0, 1: 8878.7. Samples: 822040820. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:28,785][121949] Avg episode reward: [(0, '6129.111'), (1, '5865.208')] [2023-12-26 12:27:29,007][123091] Updated weights for policy 0, policy_version 1610867 (0.0007) [2023-12-26 12:27:29,058][123091] Updated weights for policy 0, policy_version 1610877 (0.0006) [2023-12-26 12:27:29,109][123091] Updated weights for policy 0, policy_version 1610887 (0.0007) [2023-12-26 12:27:29,418][123090] Updated weights for policy 1, policy_version 1600258 (0.0010) [2023-12-26 12:27:29,488][123090] Updated weights for policy 1, policy_version 1600268 (0.0010) [2023-12-26 12:27:29,560][123090] Updated weights for policy 1, policy_version 1600278 (0.0009) [2023-12-26 12:27:29,617][123090] Updated weights for policy 1, policy_version 1600288 (0.0009) [2023-12-26 12:27:29,855][123091] Updated weights for policy 0, policy_version 1610897 (0.0008) [2023-12-26 12:27:29,927][123091] Updated weights for policy 0, policy_version 1610907 (0.0009) [2023-12-26 12:27:29,995][123091] Updated weights for policy 0, policy_version 1610917 (0.0011) [2023-12-26 12:27:30,062][123091] Updated weights for policy 0, policy_version 1610927 (0.0011) [2023-12-26 12:27:30,427][123090] Updated weights for policy 1, policy_version 1600298 (0.0007) [2023-12-26 12:27:30,491][123090] Updated weights for policy 1, policy_version 1600308 (0.0005) [2023-12-26 12:27:30,563][123090] Updated weights for policy 1, policy_version 1600318 (0.0007) [2023-12-26 12:27:30,825][123091] Updated weights for policy 0, policy_version 1610937 (0.0007) [2023-12-26 12:27:30,871][123091] Updated weights for policy 0, policy_version 1610947 (0.0009) [2023-12-26 12:27:30,919][123091] Updated weights for policy 0, policy_version 1610957 (0.0005) [2023-12-26 12:27:31,218][123090] Updated weights for policy 1, policy_version 1600329 (0.0006) [2023-12-26 12:27:31,297][123090] Updated weights for policy 1, policy_version 1600339 (0.0010) [2023-12-26 12:27:31,373][123090] Updated weights for policy 1, policy_version 1600349 (0.0009) [2023-12-26 12:27:31,752][123091] Updated weights for policy 0, policy_version 1610967 (0.0009) [2023-12-26 12:27:31,818][123091] Updated weights for policy 0, policy_version 1610977 (0.0011) [2023-12-26 12:27:31,884][123091] Updated weights for policy 0, policy_version 1610987 (0.0010) [2023-12-26 12:27:32,156][123090] Updated weights for policy 1, policy_version 1600359 (0.0009) [2023-12-26 12:27:32,211][123090] Updated weights for policy 1, policy_version 1600369 (0.0010) [2023-12-26 12:27:32,283][123090] Updated weights for policy 1, policy_version 1600379 (0.0011) [2023-12-26 12:27:32,536][123091] Updated weights for policy 0, policy_version 1610997 (0.0008) [2023-12-26 12:27:32,587][123091] Updated weights for policy 0, policy_version 1611007 (0.0008) [2023-12-26 12:27:32,638][123091] Updated weights for policy 0, policy_version 1611017 (0.0005) [2023-12-26 12:27:33,071][123090] Updated weights for policy 1, policy_version 1600389 (0.0008) [2023-12-26 12:27:33,143][123090] Updated weights for policy 1, policy_version 1600399 (0.0010) [2023-12-26 12:27:33,210][123090] Updated weights for policy 1, policy_version 1600409 (0.0010) [2023-12-26 12:27:33,435][123091] Updated weights for policy 0, policy_version 1611027 (0.0006) [2023-12-26 12:27:33,503][123091] Updated weights for policy 0, policy_version 1611037 (0.0008) [2023-12-26 12:27:33,554][123091] Updated weights for policy 0, policy_version 1611047 (0.0009) [2023-12-26 12:27:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 822140928. Throughput: 0: 8673.8, 1: 8854.2. Samples: 822150456. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:33,785][121949] Avg episode reward: [(0, '6199.659'), (1, '5704.016')] [2023-12-26 12:27:33,990][123090] Updated weights for policy 1, policy_version 1600419 (0.0010) [2023-12-26 12:27:34,066][123090] Updated weights for policy 1, policy_version 1600429 (0.0005) [2023-12-26 12:27:34,121][123091] Updated weights for policy 0, policy_version 1611057 (0.0006) [2023-12-26 12:27:34,148][123090] Updated weights for policy 1, policy_version 1600439 (0.0006) [2023-12-26 12:27:34,201][123091] Updated weights for policy 0, policy_version 1611067 (0.0007) [2023-12-26 12:27:34,271][123091] Updated weights for policy 0, policy_version 1611077 (0.0009) [2023-12-26 12:27:34,334][123091] Updated weights for policy 0, policy_version 1611087 (0.0010) [2023-12-26 12:27:34,921][123090] Updated weights for policy 1, policy_version 1600449 (0.0008) [2023-12-26 12:27:34,984][123090] Updated weights for policy 1, policy_version 1600459 (0.0010) [2023-12-26 12:27:35,044][123090] Updated weights for policy 1, policy_version 1600469 (0.0011) [2023-12-26 12:27:35,110][123090] Updated weights for policy 1, policy_version 1600479 (0.0010) [2023-12-26 12:27:35,140][123091] Updated weights for policy 0, policy_version 1611097 (0.0008) [2023-12-26 12:27:35,191][123091] Updated weights for policy 0, policy_version 1611107 (0.0009) [2023-12-26 12:27:35,246][123091] Updated weights for policy 0, policy_version 1611117 (0.0008) [2023-12-26 12:27:35,934][123090] Updated weights for policy 1, policy_version 1600489 (0.0006) [2023-12-26 12:27:35,989][123090] Updated weights for policy 1, policy_version 1600499 (0.0005) [2023-12-26 12:27:36,069][123090] Updated weights for policy 1, policy_version 1600510 (0.0008) [2023-12-26 12:27:36,093][123091] Updated weights for policy 0, policy_version 1611127 (0.0007) [2023-12-26 12:27:36,166][123091] Updated weights for policy 0, policy_version 1611137 (0.0007) [2023-12-26 12:27:36,228][123091] Updated weights for policy 0, policy_version 1611147 (0.0007) [2023-12-26 12:27:36,935][123090] Updated weights for policy 1, policy_version 1600520 (0.0007) [2023-12-26 12:27:36,960][123091] Updated weights for policy 0, policy_version 1611157 (0.0007) [2023-12-26 12:27:36,988][123090] Updated weights for policy 1, policy_version 1600530 (0.0007) [2023-12-26 12:27:37,015][123091] Updated weights for policy 0, policy_version 1611167 (0.0009) [2023-12-26 12:27:37,047][123090] Updated weights for policy 1, policy_version 1600540 (0.0006) [2023-12-26 12:27:37,072][123091] Updated weights for policy 0, policy_version 1611177 (0.0006) [2023-12-26 12:27:37,727][123091] Updated weights for policy 0, policy_version 1611187 (0.0005) [2023-12-26 12:27:37,777][123091] Updated weights for policy 0, policy_version 1611197 (0.0006) [2023-12-26 12:27:37,806][123090] Updated weights for policy 1, policy_version 1600550 (0.0006) [2023-12-26 12:27:37,837][123091] Updated weights for policy 0, policy_version 1611207 (0.0008) [2023-12-26 12:27:37,866][123090] Updated weights for policy 1, policy_version 1600560 (0.0007) [2023-12-26 12:27:37,939][123090] Updated weights for policy 1, policy_version 1600570 (0.0006) [2023-12-26 12:27:38,667][123090] Updated weights for policy 1, policy_version 1600580 (0.0007) [2023-12-26 12:27:38,685][123091] Updated weights for policy 0, policy_version 1611217 (0.0009) [2023-12-26 12:27:38,731][123090] Updated weights for policy 1, policy_version 1600590 (0.0009) [2023-12-26 12:27:38,734][123091] Updated weights for policy 0, policy_version 1611227 (0.0007) [2023-12-26 12:27:38,783][123091] Updated weights for policy 0, policy_version 1611237 (0.0008) [2023-12-26 12:27:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 822222848. Throughput: 0: 8685.8, 1: 8872.8. Samples: 822204156. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:38,785][121949] Avg episode reward: [(0, '6209.805'), (1, '5707.006')] [2023-12-26 12:27:38,791][123090] Updated weights for policy 1, policy_version 1600600 (0.0008) [2023-12-26 12:27:38,845][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001600608_409755648.pth... [2023-12-26 12:27:38,848][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001599552_409485312.pth [2023-12-26 12:27:38,852][123091] Updated weights for policy 0, policy_version 1611247 (0.0009) [2023-12-26 12:27:38,855][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001611248_412483584.pth... [2023-12-26 12:27:38,861][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001610192_412213248.pth [2023-12-26 12:27:39,597][123090] Updated weights for policy 1, policy_version 1600610 (0.0009) [2023-12-26 12:27:39,644][123090] Updated weights for policy 1, policy_version 1600620 (0.0009) [2023-12-26 12:27:39,709][123090] Updated weights for policy 1, policy_version 1600630 (0.0008) [2023-12-26 12:27:39,775][123091] Updated weights for policy 0, policy_version 1611257 (0.0009) [2023-12-26 12:27:39,775][123090] Updated weights for policy 1, policy_version 1600640 (0.0008) [2023-12-26 12:27:39,826][123091] Updated weights for policy 0, policy_version 1611267 (0.0010) [2023-12-26 12:27:39,887][123091] Updated weights for policy 0, policy_version 1611277 (0.0010) [2023-12-26 12:27:40,573][123090] Updated weights for policy 1, policy_version 1600650 (0.0010) [2023-12-26 12:27:40,622][123090] Updated weights for policy 1, policy_version 1600660 (0.0008) [2023-12-26 12:27:40,651][123091] Updated weights for policy 0, policy_version 1611287 (0.0009) [2023-12-26 12:27:40,683][123090] Updated weights for policy 1, policy_version 1600670 (0.0006) [2023-12-26 12:27:40,712][123091] Updated weights for policy 0, policy_version 1611297 (0.0009) [2023-12-26 12:27:40,770][123091] Updated weights for policy 0, policy_version 1611307 (0.0010) [2023-12-26 12:27:41,456][123090] Updated weights for policy 1, policy_version 1600680 (0.0008) [2023-12-26 12:27:41,520][123090] Updated weights for policy 1, policy_version 1600690 (0.0009) [2023-12-26 12:27:41,580][123090] Updated weights for policy 1, policy_version 1600700 (0.0009) [2023-12-26 12:27:41,663][123091] Updated weights for policy 0, policy_version 1611317 (0.0009) [2023-12-26 12:27:41,747][123091] Updated weights for policy 0, policy_version 1611327 (0.0007) [2023-12-26 12:27:41,813][123091] Updated weights for policy 0, policy_version 1611337 (0.0009) [2023-12-26 12:27:42,407][123090] Updated weights for policy 1, policy_version 1600710 (0.0008) [2023-12-26 12:27:42,485][123090] Updated weights for policy 1, policy_version 1600720 (0.0007) [2023-12-26 12:27:42,526][123091] Updated weights for policy 0, policy_version 1611347 (0.0010) [2023-12-26 12:27:42,555][123090] Updated weights for policy 1, policy_version 1600730 (0.0007) [2023-12-26 12:27:42,592][123091] Updated weights for policy 0, policy_version 1611357 (0.0008) [2023-12-26 12:27:42,659][123091] Updated weights for policy 0, policy_version 1611367 (0.0009) [2023-12-26 12:27:43,248][123090] Updated weights for policy 1, policy_version 1600740 (0.0008) [2023-12-26 12:27:43,306][123090] Updated weights for policy 1, policy_version 1600750 (0.0005) [2023-12-26 12:27:43,362][123090] Updated weights for policy 1, policy_version 1600760 (0.0006) [2023-12-26 12:27:43,503][123091] Updated weights for policy 0, policy_version 1611377 (0.0009) [2023-12-26 12:27:43,569][123091] Updated weights for policy 0, policy_version 1611387 (0.0009) [2023-12-26 12:27:43,635][123091] Updated weights for policy 0, policy_version 1611397 (0.0010) [2023-12-26 12:27:43,696][123091] Updated weights for policy 0, policy_version 1611407 (0.0009) [2023-12-26 12:27:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 822321152. Throughput: 0: 8737.4, 1: 8923.1. Samples: 822311116. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:43,784][121949] Avg episode reward: [(0, '6123.261'), (1, '5726.920')] [2023-12-26 12:27:44,170][123090] Updated weights for policy 1, policy_version 1600770 (0.0007) [2023-12-26 12:27:44,232][123090] Updated weights for policy 1, policy_version 1600780 (0.0010) [2023-12-26 12:27:44,297][123090] Updated weights for policy 1, policy_version 1600790 (0.0009) [2023-12-26 12:27:44,350][123090] Updated weights for policy 1, policy_version 1600800 (0.0010) [2023-12-26 12:27:44,382][123091] Updated weights for policy 0, policy_version 1611417 (0.0008) [2023-12-26 12:27:44,434][123091] Updated weights for policy 0, policy_version 1611427 (0.0009) [2023-12-26 12:27:44,488][123091] Updated weights for policy 0, policy_version 1611437 (0.0009) [2023-12-26 12:27:45,195][123090] Updated weights for policy 1, policy_version 1600810 (0.0010) [2023-12-26 12:27:45,259][123090] Updated weights for policy 1, policy_version 1600820 (0.0009) [2023-12-26 12:27:45,318][123090] Updated weights for policy 1, policy_version 1600830 (0.0009) [2023-12-26 12:27:45,320][123091] Updated weights for policy 0, policy_version 1611447 (0.0008) [2023-12-26 12:27:45,374][123091] Updated weights for policy 0, policy_version 1611457 (0.0009) [2023-12-26 12:27:45,429][123091] Updated weights for policy 0, policy_version 1611467 (0.0009) [2023-12-26 12:27:46,077][123090] Updated weights for policy 1, policy_version 1600840 (0.0006) [2023-12-26 12:27:46,145][123090] Updated weights for policy 1, policy_version 1600850 (0.0006) [2023-12-26 12:27:46,218][123090] Updated weights for policy 1, policy_version 1600860 (0.0007) [2023-12-26 12:27:46,350][123091] Updated weights for policy 0, policy_version 1611477 (0.0009) [2023-12-26 12:27:46,398][123091] Updated weights for policy 0, policy_version 1611487 (0.0009) [2023-12-26 12:27:46,454][123091] Updated weights for policy 0, policy_version 1611499 (0.0011) [2023-12-26 12:27:46,904][123090] Updated weights for policy 1, policy_version 1600870 (0.0007) [2023-12-26 12:27:46,954][123090] Updated weights for policy 1, policy_version 1600880 (0.0006) [2023-12-26 12:27:47,014][123090] Updated weights for policy 1, policy_version 1600890 (0.0005) [2023-12-26 12:27:47,407][123091] Updated weights for policy 0, policy_version 1611510 (0.0009) [2023-12-26 12:27:47,461][123091] Updated weights for policy 0, policy_version 1611522 (0.0010) [2023-12-26 12:27:47,510][123091] Updated weights for policy 0, policy_version 1611532 (0.0005) [2023-12-26 12:27:47,594][123090] Updated weights for policy 1, policy_version 1600900 (0.0006) [2023-12-26 12:27:47,646][123090] Updated weights for policy 1, policy_version 1600910 (0.0005) [2023-12-26 12:27:47,702][123090] Updated weights for policy 1, policy_version 1600920 (0.0006) [2023-12-26 12:27:48,255][123091] Updated weights for policy 0, policy_version 1611542 (0.0008) [2023-12-26 12:27:48,318][123091] Updated weights for policy 0, policy_version 1611552 (0.0009) [2023-12-26 12:27:48,326][123090] Updated weights for policy 1, policy_version 1600930 (0.0007) [2023-12-26 12:27:48,388][123091] Updated weights for policy 0, policy_version 1611562 (0.0008) [2023-12-26 12:27:48,391][123090] Updated weights for policy 1, policy_version 1600940 (0.0008) [2023-12-26 12:27:48,451][123090] Updated weights for policy 1, policy_version 1600950 (0.0008) [2023-12-26 12:27:48,518][123090] Updated weights for policy 1, policy_version 1600960 (0.0010) [2023-12-26 12:27:48,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 822411264. Throughput: 0: 8770.6, 1: 9021.1. Samples: 822419748. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:48,784][121949] Avg episode reward: [(0, '6042.922'), (1, '5915.846')] [2023-12-26 12:27:49,243][123091] Updated weights for policy 0, policy_version 1611572 (0.0009) [2023-12-26 12:27:49,295][123090] Updated weights for policy 1, policy_version 1600970 (0.0010) [2023-12-26 12:27:49,307][123091] Updated weights for policy 0, policy_version 1611582 (0.0007) [2023-12-26 12:27:49,360][123090] Updated weights for policy 1, policy_version 1600980 (0.0009) [2023-12-26 12:27:49,380][123091] Updated weights for policy 0, policy_version 1611592 (0.0009) [2023-12-26 12:27:49,421][123090] Updated weights for policy 1, policy_version 1600990 (0.0008) [2023-12-26 12:27:50,134][123091] Updated weights for policy 0, policy_version 1611602 (0.0009) [2023-12-26 12:27:50,194][123091] Updated weights for policy 0, policy_version 1611612 (0.0009) [2023-12-26 12:27:50,250][123091] Updated weights for policy 0, policy_version 1611622 (0.0009) [2023-12-26 12:27:50,259][123090] Updated weights for policy 1, policy_version 1601000 (0.0007) [2023-12-26 12:27:50,312][123091] Updated weights for policy 0, policy_version 1611632 (0.0010) [2023-12-26 12:27:50,328][123090] Updated weights for policy 1, policy_version 1601010 (0.0008) [2023-12-26 12:27:50,389][123090] Updated weights for policy 1, policy_version 1601021 (0.0010) [2023-12-26 12:27:51,125][123091] Updated weights for policy 0, policy_version 1611642 (0.0010) [2023-12-26 12:27:51,189][123091] Updated weights for policy 0, policy_version 1611652 (0.0011) [2023-12-26 12:27:51,249][123091] Updated weights for policy 0, policy_version 1611662 (0.0011) [2023-12-26 12:27:51,272][123090] Updated weights for policy 1, policy_version 1601031 (0.0008) [2023-12-26 12:27:51,342][123090] Updated weights for policy 1, policy_version 1601041 (0.0008) [2023-12-26 12:27:51,412][123090] Updated weights for policy 1, policy_version 1601051 (0.0008) [2023-12-26 12:27:52,065][123091] Updated weights for policy 0, policy_version 1611672 (0.0007) [2023-12-26 12:27:52,121][123091] Updated weights for policy 0, policy_version 1611682 (0.0006) [2023-12-26 12:27:52,194][123091] Updated weights for policy 0, policy_version 1611692 (0.0006) [2023-12-26 12:27:52,243][123090] Updated weights for policy 1, policy_version 1601061 (0.0010) [2023-12-26 12:27:52,304][123090] Updated weights for policy 1, policy_version 1601071 (0.0009) [2023-12-26 12:27:52,382][123090] Updated weights for policy 1, policy_version 1601081 (0.0009) [2023-12-26 12:27:52,928][123091] Updated weights for policy 0, policy_version 1611702 (0.0009) [2023-12-26 12:27:52,985][123091] Updated weights for policy 0, policy_version 1611712 (0.0008) [2023-12-26 12:27:53,043][123091] Updated weights for policy 0, policy_version 1611722 (0.0010) [2023-12-26 12:27:53,199][123090] Updated weights for policy 1, policy_version 1601091 (0.0009) [2023-12-26 12:27:53,254][123090] Updated weights for policy 1, policy_version 1601101 (0.0010) [2023-12-26 12:27:53,311][123090] Updated weights for policy 1, policy_version 1601111 (0.0009) [2023-12-26 12:27:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 822493184. Throughput: 0: 8800.4, 1: 8972.7. Samples: 822471656. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:53,785][121949] Avg episode reward: [(0, '6166.382'), (1, '5988.426')] [2023-12-26 12:27:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001611728_412606464.pth... [2023-12-26 12:27:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001601120_409886720.pth... [2023-12-26 12:27:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001610704_412344320.pth [2023-12-26 12:27:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001600064_409616384.pth [2023-12-26 12:27:53,887][123091] Updated weights for policy 0, policy_version 1611732 (0.0010) [2023-12-26 12:27:53,941][123091] Updated weights for policy 0, policy_version 1611742 (0.0008) [2023-12-26 12:27:54,003][123091] Updated weights for policy 0, policy_version 1611752 (0.0009) [2023-12-26 12:27:54,152][123090] Updated weights for policy 1, policy_version 1601121 (0.0008) [2023-12-26 12:27:54,217][123090] Updated weights for policy 1, policy_version 1601131 (0.0010) [2023-12-26 12:27:54,284][123090] Updated weights for policy 1, policy_version 1601141 (0.0010) [2023-12-26 12:27:54,348][123090] Updated weights for policy 1, policy_version 1601151 (0.0009) [2023-12-26 12:27:54,813][123091] Updated weights for policy 0, policy_version 1611762 (0.0009) [2023-12-26 12:27:54,875][123091] Updated weights for policy 0, policy_version 1611772 (0.0010) [2023-12-26 12:27:54,945][123091] Updated weights for policy 0, policy_version 1611782 (0.0011) [2023-12-26 12:27:55,012][123091] Updated weights for policy 0, policy_version 1611792 (0.0011) [2023-12-26 12:27:55,198][123090] Updated weights for policy 1, policy_version 1601161 (0.0008) [2023-12-26 12:27:55,257][123090] Updated weights for policy 1, policy_version 1601171 (0.0008) [2023-12-26 12:27:55,314][123090] Updated weights for policy 1, policy_version 1601181 (0.0009) [2023-12-26 12:27:55,804][123091] Updated weights for policy 0, policy_version 1611802 (0.0009) [2023-12-26 12:27:55,857][123091] Updated weights for policy 0, policy_version 1611812 (0.0009) [2023-12-26 12:27:55,904][123091] Updated weights for policy 0, policy_version 1611822 (0.0009) [2023-12-26 12:27:56,134][123090] Updated weights for policy 1, policy_version 1601191 (0.0009) [2023-12-26 12:27:56,181][123090] Updated weights for policy 1, policy_version 1601201 (0.0006) [2023-12-26 12:27:56,243][123090] Updated weights for policy 1, policy_version 1601211 (0.0006) [2023-12-26 12:27:56,659][123091] Updated weights for policy 0, policy_version 1611832 (0.0007) [2023-12-26 12:27:56,712][123091] Updated weights for policy 0, policy_version 1611842 (0.0005) [2023-12-26 12:27:56,765][123091] Updated weights for policy 0, policy_version 1611852 (0.0005) [2023-12-26 12:27:56,924][123090] Updated weights for policy 1, policy_version 1601221 (0.0005) [2023-12-26 12:27:56,984][123090] Updated weights for policy 1, policy_version 1601231 (0.0005) [2023-12-26 12:27:57,043][123090] Updated weights for policy 1, policy_version 1601241 (0.0009) [2023-12-26 12:27:57,460][123091] Updated weights for policy 0, policy_version 1611862 (0.0005) [2023-12-26 12:27:57,514][123091] Updated weights for policy 0, policy_version 1611872 (0.0005) [2023-12-26 12:27:57,569][123091] Updated weights for policy 0, policy_version 1611882 (0.0005) [2023-12-26 12:27:57,885][123090] Updated weights for policy 1, policy_version 1601251 (0.0010) [2023-12-26 12:27:57,931][123090] Updated weights for policy 1, policy_version 1601261 (0.0008) [2023-12-26 12:27:57,986][123090] Updated weights for policy 1, policy_version 1601271 (0.0008) [2023-12-26 12:27:58,198][123091] Updated weights for policy 0, policy_version 1611892 (0.0007) [2023-12-26 12:27:58,256][123091] Updated weights for policy 0, policy_version 1611902 (0.0010) [2023-12-26 12:27:58,322][123091] Updated weights for policy 0, policy_version 1611912 (0.0010) [2023-12-26 12:27:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 822583296. Throughput: 0: 8840.7, 1: 8989.0. Samples: 822578512. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 12:27:58,785][121949] Avg episode reward: [(0, '6281.865'), (1, '5894.319')] [2023-12-26 12:27:58,860][123090] Updated weights for policy 1, policy_version 1601281 (0.0005) [2023-12-26 12:27:58,929][123090] Updated weights for policy 1, policy_version 1601291 (0.0010) [2023-12-26 12:27:59,002][123090] Updated weights for policy 1, policy_version 1601301 (0.0007) [2023-12-26 12:27:59,070][123090] Updated weights for policy 1, policy_version 1601311 (0.0011) [2023-12-26 12:27:59,197][123091] Updated weights for policy 0, policy_version 1611922 (0.0009) [2023-12-26 12:27:59,269][123091] Updated weights for policy 0, policy_version 1611932 (0.0009) [2023-12-26 12:27:59,334][123091] Updated weights for policy 0, policy_version 1611942 (0.0009) [2023-12-26 12:27:59,404][123091] Updated weights for policy 0, policy_version 1611952 (0.0009) [2023-12-26 12:27:59,907][123090] Updated weights for policy 1, policy_version 1601321 (0.0009) [2023-12-26 12:27:59,983][123090] Updated weights for policy 1, policy_version 1601331 (0.0010) [2023-12-26 12:28:00,050][123090] Updated weights for policy 1, policy_version 1601341 (0.0010) [2023-12-26 12:28:00,142][123091] Updated weights for policy 0, policy_version 1611962 (0.0009) [2023-12-26 12:28:00,204][123091] Updated weights for policy 0, policy_version 1611972 (0.0009) [2023-12-26 12:28:00,255][123091] Updated weights for policy 0, policy_version 1611982 (0.0006) [2023-12-26 12:28:00,865][123090] Updated weights for policy 1, policy_version 1601351 (0.0010) [2023-12-26 12:28:00,908][123090] Updated weights for policy 1, policy_version 1601361 (0.0010) [2023-12-26 12:28:00,955][123090] Updated weights for policy 1, policy_version 1601371 (0.0010) [2023-12-26 12:28:01,044][123091] Updated weights for policy 0, policy_version 1611992 (0.0006) [2023-12-26 12:28:01,106][123091] Updated weights for policy 0, policy_version 1612002 (0.0006) [2023-12-26 12:28:01,162][123091] Updated weights for policy 0, policy_version 1612012 (0.0010) [2023-12-26 12:28:01,804][123090] Updated weights for policy 1, policy_version 1601381 (0.0010) [2023-12-26 12:28:01,862][123090] Updated weights for policy 1, policy_version 1601391 (0.0010) [2023-12-26 12:28:01,931][123090] Updated weights for policy 1, policy_version 1601401 (0.0010) [2023-12-26 12:28:02,058][123091] Updated weights for policy 0, policy_version 1612022 (0.0007) [2023-12-26 12:28:02,115][123091] Updated weights for policy 0, policy_version 1612032 (0.0005) [2023-12-26 12:28:02,174][123091] Updated weights for policy 0, policy_version 1612042 (0.0007) [2023-12-26 12:28:02,748][123090] Updated weights for policy 1, policy_version 1601411 (0.0010) [2023-12-26 12:28:02,808][123090] Updated weights for policy 1, policy_version 1601421 (0.0010) [2023-12-26 12:28:02,816][123091] Updated weights for policy 0, policy_version 1612052 (0.0007) [2023-12-26 12:28:02,862][123090] Updated weights for policy 1, policy_version 1601431 (0.0005) [2023-12-26 12:28:02,872][123091] Updated weights for policy 0, policy_version 1612062 (0.0006) [2023-12-26 12:28:02,932][123091] Updated weights for policy 0, policy_version 1612072 (0.0006) [2023-12-26 12:28:03,527][123090] Updated weights for policy 1, policy_version 1601441 (0.0006) [2023-12-26 12:28:03,574][123091] Updated weights for policy 0, policy_version 1612082 (0.0006) [2023-12-26 12:28:03,583][123090] Updated weights for policy 1, policy_version 1601451 (0.0009) [2023-12-26 12:28:03,638][123091] Updated weights for policy 0, policy_version 1612092 (0.0005) [2023-12-26 12:28:03,646][123090] Updated weights for policy 1, policy_version 1601461 (0.0010) [2023-12-26 12:28:03,692][123091] Updated weights for policy 0, policy_version 1612102 (0.0006) [2023-12-26 12:28:03,708][123090] Updated weights for policy 1, policy_version 1601471 (0.0010) [2023-12-26 12:28:03,748][123091] Updated weights for policy 0, policy_version 1612112 (0.0006) [2023-12-26 12:28:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 822681600. Throughput: 0: 8900.5, 1: 9008.4. Samples: 822687252. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:03,785][121949] Avg episode reward: [(0, '6245.726'), (1, '5780.634')] [2023-12-26 12:28:04,451][123091] Updated weights for policy 0, policy_version 1612122 (0.0006) [2023-12-26 12:28:04,493][123090] Updated weights for policy 1, policy_version 1601481 (0.0006) [2023-12-26 12:28:04,519][123091] Updated weights for policy 0, policy_version 1612132 (0.0006) [2023-12-26 12:28:04,566][123090] Updated weights for policy 1, policy_version 1601491 (0.0006) [2023-12-26 12:28:04,577][123091] Updated weights for policy 0, policy_version 1612142 (0.0009) [2023-12-26 12:28:04,620][123090] Updated weights for policy 1, policy_version 1601501 (0.0006) [2023-12-26 12:28:05,334][123091] Updated weights for policy 0, policy_version 1612152 (0.0011) [2023-12-26 12:28:05,373][123090] Updated weights for policy 1, policy_version 1601511 (0.0009) [2023-12-26 12:28:05,399][123091] Updated weights for policy 0, policy_version 1612162 (0.0010) [2023-12-26 12:28:05,435][123090] Updated weights for policy 1, policy_version 1601521 (0.0010) [2023-12-26 12:28:05,454][123091] Updated weights for policy 0, policy_version 1612172 (0.0010) [2023-12-26 12:28:05,504][123090] Updated weights for policy 1, policy_version 1601531 (0.0010) [2023-12-26 12:28:06,210][123091] Updated weights for policy 0, policy_version 1612182 (0.0008) [2023-12-26 12:28:06,261][123090] Updated weights for policy 1, policy_version 1601541 (0.0008) [2023-12-26 12:28:06,286][123091] Updated weights for policy 0, policy_version 1612192 (0.0006) [2023-12-26 12:28:06,330][123090] Updated weights for policy 1, policy_version 1601551 (0.0010) [2023-12-26 12:28:06,356][123091] Updated weights for policy 0, policy_version 1612202 (0.0011) [2023-12-26 12:28:06,395][123090] Updated weights for policy 1, policy_version 1601561 (0.0011) [2023-12-26 12:28:07,084][123091] Updated weights for policy 0, policy_version 1612212 (0.0009) [2023-12-26 12:28:07,156][123091] Updated weights for policy 0, policy_version 1612222 (0.0005) [2023-12-26 12:28:07,207][123091] Updated weights for policy 0, policy_version 1612232 (0.0005) [2023-12-26 12:28:07,227][123090] Updated weights for policy 1, policy_version 1601571 (0.0011) [2023-12-26 12:28:07,283][123090] Updated weights for policy 1, policy_version 1601581 (0.0010) [2023-12-26 12:28:07,335][123090] Updated weights for policy 1, policy_version 1601591 (0.0010) [2023-12-26 12:28:07,965][123091] Updated weights for policy 0, policy_version 1612242 (0.0007) [2023-12-26 12:28:08,013][123091] Updated weights for policy 0, policy_version 1612252 (0.0010) [2023-12-26 12:28:08,075][123091] Updated weights for policy 0, policy_version 1612262 (0.0011) [2023-12-26 12:28:08,081][123090] Updated weights for policy 1, policy_version 1601601 (0.0010) [2023-12-26 12:28:08,131][123091] Updated weights for policy 0, policy_version 1612272 (0.0011) [2023-12-26 12:28:08,137][123090] Updated weights for policy 1, policy_version 1601611 (0.0006) [2023-12-26 12:28:08,192][123090] Updated weights for policy 1, policy_version 1601621 (0.0007) [2023-12-26 12:28:08,240][123090] Updated weights for policy 1, policy_version 1601631 (0.0008) [2023-12-26 12:28:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 822763520. Throughput: 0: 8936.2, 1: 9023.3. Samples: 822741528. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:08,785][121949] Avg episode reward: [(0, '6233.388'), (1, '5828.449')] [2023-12-26 12:28:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001612272_412745728.pth... [2023-12-26 12:28:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001601632_410017792.pth... [2023-12-26 12:28:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001600608_409755648.pth [2023-12-26 12:28:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001611248_412483584.pth [2023-12-26 12:28:08,994][123091] Updated weights for policy 0, policy_version 1612282 (0.0010) [2023-12-26 12:28:09,064][123090] Updated weights for policy 1, policy_version 1601641 (0.0008) [2023-12-26 12:28:09,065][123091] Updated weights for policy 0, policy_version 1612292 (0.0011) [2023-12-26 12:28:09,128][123091] Updated weights for policy 0, policy_version 1612302 (0.0011) [2023-12-26 12:28:09,132][123090] Updated weights for policy 1, policy_version 1601651 (0.0008) [2023-12-26 12:28:09,195][123090] Updated weights for policy 1, policy_version 1601661 (0.0008) [2023-12-26 12:28:09,949][123090] Updated weights for policy 1, policy_version 1601671 (0.0010) [2023-12-26 12:28:10,010][123091] Updated weights for policy 0, policy_version 1612312 (0.0007) [2023-12-26 12:28:10,024][123090] Updated weights for policy 1, policy_version 1601681 (0.0011) [2023-12-26 12:28:10,079][123091] Updated weights for policy 0, policy_version 1612322 (0.0008) [2023-12-26 12:28:10,088][123090] Updated weights for policy 1, policy_version 1601691 (0.0010) [2023-12-26 12:28:10,145][123091] Updated weights for policy 0, policy_version 1612332 (0.0009) [2023-12-26 12:28:10,780][123090] Updated weights for policy 1, policy_version 1601701 (0.0010) [2023-12-26 12:28:10,836][123090] Updated weights for policy 1, policy_version 1601711 (0.0010) [2023-12-26 12:28:10,847][123091] Updated weights for policy 0, policy_version 1612342 (0.0008) [2023-12-26 12:28:10,901][123091] Updated weights for policy 0, policy_version 1612352 (0.0006) [2023-12-26 12:28:10,902][123090] Updated weights for policy 1, policy_version 1601721 (0.0010) [2023-12-26 12:28:10,959][123091] Updated weights for policy 0, policy_version 1612362 (0.0007) [2023-12-26 12:28:11,781][123090] Updated weights for policy 1, policy_version 1601731 (0.0008) [2023-12-26 12:28:11,789][123091] Updated weights for policy 0, policy_version 1612372 (0.0011) [2023-12-26 12:28:11,840][123090] Updated weights for policy 1, policy_version 1601741 (0.0007) [2023-12-26 12:28:11,850][123091] Updated weights for policy 0, policy_version 1612382 (0.0011) [2023-12-26 12:28:11,892][123090] Updated weights for policy 1, policy_version 1601751 (0.0008) [2023-12-26 12:28:11,907][123091] Updated weights for policy 0, policy_version 1612392 (0.0011) [2023-12-26 12:28:12,748][123091] Updated weights for policy 0, policy_version 1612402 (0.0009) [2023-12-26 12:28:12,789][123090] Updated weights for policy 1, policy_version 1601761 (0.0007) [2023-12-26 12:28:12,804][123091] Updated weights for policy 0, policy_version 1612412 (0.0008) [2023-12-26 12:28:12,840][123090] Updated weights for policy 1, policy_version 1601771 (0.0006) [2023-12-26 12:28:12,866][123091] Updated weights for policy 0, policy_version 1612422 (0.0008) [2023-12-26 12:28:12,896][123090] Updated weights for policy 1, policy_version 1601781 (0.0006) [2023-12-26 12:28:12,927][123091] Updated weights for policy 0, policy_version 1612432 (0.0007) [2023-12-26 12:28:12,950][123090] Updated weights for policy 1, policy_version 1601791 (0.0006) [2023-12-26 12:28:13,717][123090] Updated weights for policy 1, policy_version 1601801 (0.0010) [2023-12-26 12:28:13,765][123090] Updated weights for policy 1, policy_version 1601811 (0.0010) [2023-12-26 12:28:13,774][123091] Updated weights for policy 0, policy_version 1612442 (0.0006) [2023-12-26 12:28:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 822845440. Throughput: 0: 9007.2, 1: 8885.7. Samples: 822846000. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:13,785][121949] Avg episode reward: [(0, '6198.147'), (1, '5735.764')] [2023-12-26 12:28:13,817][123090] Updated weights for policy 1, policy_version 1601821 (0.0010) [2023-12-26 12:28:13,836][123091] Updated weights for policy 0, policy_version 1612452 (0.0008) [2023-12-26 12:28:13,897][123091] Updated weights for policy 0, policy_version 1612462 (0.0010) [2023-12-26 12:28:14,514][123090] Updated weights for policy 1, policy_version 1601831 (0.0007) [2023-12-26 12:28:14,578][123090] Updated weights for policy 1, policy_version 1601841 (0.0007) [2023-12-26 12:28:14,641][123090] Updated weights for policy 1, policy_version 1601851 (0.0010) [2023-12-26 12:28:14,750][123091] Updated weights for policy 0, policy_version 1612472 (0.0009) [2023-12-26 12:28:14,822][123091] Updated weights for policy 0, policy_version 1612482 (0.0009) [2023-12-26 12:28:14,882][123091] Updated weights for policy 0, policy_version 1612492 (0.0009) [2023-12-26 12:28:15,448][123090] Updated weights for policy 1, policy_version 1601861 (0.0011) [2023-12-26 12:28:15,504][123090] Updated weights for policy 1, policy_version 1601871 (0.0011) [2023-12-26 12:28:15,554][123090] Updated weights for policy 1, policy_version 1601881 (0.0010) [2023-12-26 12:28:15,697][123091] Updated weights for policy 0, policy_version 1612502 (0.0009) [2023-12-26 12:28:15,756][123091] Updated weights for policy 0, policy_version 1612512 (0.0010) [2023-12-26 12:28:15,825][123091] Updated weights for policy 0, policy_version 1612522 (0.0010) [2023-12-26 12:28:16,264][123090] Updated weights for policy 1, policy_version 1601891 (0.0007) [2023-12-26 12:28:16,338][123090] Updated weights for policy 1, policy_version 1601901 (0.0005) [2023-12-26 12:28:16,399][123090] Updated weights for policy 1, policy_version 1601911 (0.0005) [2023-12-26 12:28:16,715][123091] Updated weights for policy 0, policy_version 1612532 (0.0010) [2023-12-26 12:28:16,774][123091] Updated weights for policy 0, policy_version 1612544 (0.0010) [2023-12-26 12:28:16,832][123091] Updated weights for policy 0, policy_version 1612554 (0.0010) [2023-12-26 12:28:17,034][123090] Updated weights for policy 1, policy_version 1601921 (0.0005) [2023-12-26 12:28:17,107][123090] Updated weights for policy 1, policy_version 1601931 (0.0006) [2023-12-26 12:28:17,176][123090] Updated weights for policy 1, policy_version 1601941 (0.0009) [2023-12-26 12:28:17,236][123090] Updated weights for policy 1, policy_version 1601951 (0.0010) [2023-12-26 12:28:17,754][123091] Updated weights for policy 0, policy_version 1612564 (0.0010) [2023-12-26 12:28:17,813][123091] Updated weights for policy 0, policy_version 1612574 (0.0010) [2023-12-26 12:28:17,866][123091] Updated weights for policy 0, policy_version 1612584 (0.0009) [2023-12-26 12:28:17,891][123090] Updated weights for policy 1, policy_version 1601961 (0.0008) [2023-12-26 12:28:17,947][123090] Updated weights for policy 1, policy_version 1601971 (0.0008) [2023-12-26 12:28:18,002][123090] Updated weights for policy 1, policy_version 1601981 (0.0008) [2023-12-26 12:28:18,679][123091] Updated weights for policy 0, policy_version 1612594 (0.0009) [2023-12-26 12:28:18,737][123091] Updated weights for policy 0, policy_version 1612604 (0.0009) [2023-12-26 12:28:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 822935552. Throughput: 0: 8873.0, 1: 8960.5. Samples: 822952960. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:18,785][121949] Avg episode reward: [(0, '6224.875'), (1, '5648.603')] [2023-12-26 12:28:18,788][123091] Updated weights for policy 0, policy_version 1612614 (0.0010) [2023-12-26 12:28:18,818][123090] Updated weights for policy 1, policy_version 1601991 (0.0008) [2023-12-26 12:28:18,850][123091] Updated weights for policy 0, policy_version 1612624 (0.0008) [2023-12-26 12:28:18,882][123090] Updated weights for policy 1, policy_version 1602001 (0.0007) [2023-12-26 12:28:18,942][123090] Updated weights for policy 1, policy_version 1602011 (0.0008) [2023-12-26 12:28:19,727][123090] Updated weights for policy 1, policy_version 1602021 (0.0006) [2023-12-26 12:28:19,756][123091] Updated weights for policy 0, policy_version 1612634 (0.0009) [2023-12-26 12:28:19,796][123090] Updated weights for policy 1, policy_version 1602031 (0.0008) [2023-12-26 12:28:19,826][123091] Updated weights for policy 0, policy_version 1612644 (0.0009) [2023-12-26 12:28:19,868][123090] Updated weights for policy 1, policy_version 1602041 (0.0008) [2023-12-26 12:28:19,887][123091] Updated weights for policy 0, policy_version 1612654 (0.0011) [2023-12-26 12:28:20,640][123090] Updated weights for policy 1, policy_version 1602051 (0.0009) [2023-12-26 12:28:20,710][123090] Updated weights for policy 1, policy_version 1602061 (0.0011) [2023-12-26 12:28:20,727][123091] Updated weights for policy 0, policy_version 1612664 (0.0008) [2023-12-26 12:28:20,780][123090] Updated weights for policy 1, policy_version 1602071 (0.0011) [2023-12-26 12:28:20,797][123091] Updated weights for policy 0, policy_version 1612674 (0.0011) [2023-12-26 12:28:20,858][123091] Updated weights for policy 0, policy_version 1612684 (0.0010) [2023-12-26 12:28:21,565][123090] Updated weights for policy 1, policy_version 1602081 (0.0011) [2023-12-26 12:28:21,627][123090] Updated weights for policy 1, policy_version 1602091 (0.0007) [2023-12-26 12:28:21,690][123090] Updated weights for policy 1, policy_version 1602101 (0.0008) [2023-12-26 12:28:21,746][123091] Updated weights for policy 0, policy_version 1612694 (0.0009) [2023-12-26 12:28:21,753][123090] Updated weights for policy 1, policy_version 1602111 (0.0009) [2023-12-26 12:28:21,816][123091] Updated weights for policy 0, policy_version 1612704 (0.0010) [2023-12-26 12:28:21,880][123091] Updated weights for policy 0, policy_version 1612714 (0.0009) [2023-12-26 12:28:22,549][123090] Updated weights for policy 1, policy_version 1602121 (0.0005) [2023-12-26 12:28:22,612][123090] Updated weights for policy 1, policy_version 1602131 (0.0005) [2023-12-26 12:28:22,670][123090] Updated weights for policy 1, policy_version 1602141 (0.0005) [2023-12-26 12:28:22,757][123091] Updated weights for policy 0, policy_version 1612724 (0.0008) [2023-12-26 12:28:22,830][123091] Updated weights for policy 0, policy_version 1612734 (0.0010) [2023-12-26 12:28:22,898][123091] Updated weights for policy 0, policy_version 1612744 (0.0010) [2023-12-26 12:28:23,390][123090] Updated weights for policy 1, policy_version 1602151 (0.0008) [2023-12-26 12:28:23,442][123090] Updated weights for policy 1, policy_version 1602161 (0.0009) [2023-12-26 12:28:23,500][123090] Updated weights for policy 1, policy_version 1602171 (0.0009) [2023-12-26 12:28:23,718][123091] Updated weights for policy 0, policy_version 1612754 (0.0010) [2023-12-26 12:28:23,782][123091] Updated weights for policy 0, policy_version 1612764 (0.0009) [2023-12-26 12:28:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 823025664. Throughput: 0: 8799.4, 1: 8976.5. Samples: 823004076. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:23,785][121949] Avg episode reward: [(0, '6293.914'), (1, '5708.001')] [2023-12-26 12:28:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001602176_410157056.pth... [2023-12-26 12:28:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001601120_409886720.pth [2023-12-26 12:28:23,838][123091] Updated weights for policy 0, policy_version 1612774 (0.0006) [2023-12-26 12:28:23,904][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001612784_412876800.pth... [2023-12-26 12:28:23,904][123091] Updated weights for policy 0, policy_version 1612784 (0.0005) [2023-12-26 12:28:23,909][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001611728_412606464.pth [2023-12-26 12:28:24,399][123090] Updated weights for policy 1, policy_version 1602181 (0.0009) [2023-12-26 12:28:24,453][123090] Updated weights for policy 1, policy_version 1602191 (0.0009) [2023-12-26 12:28:24,507][123090] Updated weights for policy 1, policy_version 1602201 (0.0009) [2023-12-26 12:28:24,648][123091] Updated weights for policy 0, policy_version 1612794 (0.0008) [2023-12-26 12:28:24,708][123091] Updated weights for policy 0, policy_version 1612804 (0.0010) [2023-12-26 12:28:24,770][123091] Updated weights for policy 0, policy_version 1612814 (0.0009) [2023-12-26 12:28:25,367][123090] Updated weights for policy 1, policy_version 1602211 (0.0009) [2023-12-26 12:28:25,422][123090] Updated weights for policy 1, policy_version 1602221 (0.0008) [2023-12-26 12:28:25,482][123090] Updated weights for policy 1, policy_version 1602231 (0.0007) [2023-12-26 12:28:25,500][123091] Updated weights for policy 0, policy_version 1612824 (0.0010) [2023-12-26 12:28:25,544][123091] Updated weights for policy 0, policy_version 1612834 (0.0010) [2023-12-26 12:28:25,591][123091] Updated weights for policy 0, policy_version 1612844 (0.0010) [2023-12-26 12:28:26,343][123090] Updated weights for policy 1, policy_version 1602241 (0.0008) [2023-12-26 12:28:26,387][123091] Updated weights for policy 0, policy_version 1612854 (0.0007) [2023-12-26 12:28:26,409][123090] Updated weights for policy 1, policy_version 1602251 (0.0009) [2023-12-26 12:28:26,440][123091] Updated weights for policy 0, policy_version 1612864 (0.0008) [2023-12-26 12:28:26,475][123090] Updated weights for policy 1, policy_version 1602261 (0.0006) [2023-12-26 12:28:26,492][123091] Updated weights for policy 0, policy_version 1612874 (0.0010) [2023-12-26 12:28:26,538][123090] Updated weights for policy 1, policy_version 1602271 (0.0006) [2023-12-26 12:28:27,218][123091] Updated weights for policy 0, policy_version 1612884 (0.0008) [2023-12-26 12:28:27,264][123091] Updated weights for policy 0, policy_version 1612894 (0.0005) [2023-12-26 12:28:27,318][123091] Updated weights for policy 0, policy_version 1612904 (0.0005) [2023-12-26 12:28:27,427][123090] Updated weights for policy 1, policy_version 1602281 (0.0009) [2023-12-26 12:28:27,477][123090] Updated weights for policy 1, policy_version 1602291 (0.0008) [2023-12-26 12:28:27,524][123090] Updated weights for policy 1, policy_version 1602301 (0.0008) [2023-12-26 12:28:28,091][123091] Updated weights for policy 0, policy_version 1612914 (0.0010) [2023-12-26 12:28:28,142][123091] Updated weights for policy 0, policy_version 1612924 (0.0010) [2023-12-26 12:28:28,202][123091] Updated weights for policy 0, policy_version 1612934 (0.0010) [2023-12-26 12:28:28,266][123091] Updated weights for policy 0, policy_version 1612944 (0.0009) [2023-12-26 12:28:28,348][123090] Updated weights for policy 1, policy_version 1602311 (0.0008) [2023-12-26 12:28:28,414][123090] Updated weights for policy 1, policy_version 1602321 (0.0010) [2023-12-26 12:28:28,482][123090] Updated weights for policy 1, policy_version 1602331 (0.0009) [2023-12-26 12:28:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 823115776. Throughput: 0: 8816.3, 1: 8920.3. Samples: 823109260. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:28,785][121949] Avg episode reward: [(0, '6221.330'), (1, '5802.152')] [2023-12-26 12:28:29,078][123091] Updated weights for policy 0, policy_version 1612954 (0.0009) [2023-12-26 12:28:29,127][123091] Updated weights for policy 0, policy_version 1612964 (0.0009) [2023-12-26 12:28:29,186][123091] Updated weights for policy 0, policy_version 1612975 (0.0009) [2023-12-26 12:28:29,331][123090] Updated weights for policy 1, policy_version 1602341 (0.0010) [2023-12-26 12:28:29,400][123090] Updated weights for policy 1, policy_version 1602351 (0.0009) [2023-12-26 12:28:29,456][123090] Updated weights for policy 1, policy_version 1602361 (0.0009) [2023-12-26 12:28:30,077][123091] Updated weights for policy 0, policy_version 1612985 (0.0006) [2023-12-26 12:28:30,147][123091] Updated weights for policy 0, policy_version 1612995 (0.0006) [2023-12-26 12:28:30,217][123091] Updated weights for policy 0, policy_version 1613005 (0.0007) [2023-12-26 12:28:30,314][123090] Updated weights for policy 1, policy_version 1602371 (0.0009) [2023-12-26 12:28:30,365][123090] Updated weights for policy 1, policy_version 1602381 (0.0008) [2023-12-26 12:28:30,419][123090] Updated weights for policy 1, policy_version 1602391 (0.0008) [2023-12-26 12:28:30,928][123091] Updated weights for policy 0, policy_version 1613015 (0.0006) [2023-12-26 12:28:30,977][123091] Updated weights for policy 0, policy_version 1613025 (0.0005) [2023-12-26 12:28:31,037][123091] Updated weights for policy 0, policy_version 1613035 (0.0006) [2023-12-26 12:28:31,314][123090] Updated weights for policy 1, policy_version 1602401 (0.0009) [2023-12-26 12:28:31,379][123090] Updated weights for policy 1, policy_version 1602411 (0.0009) [2023-12-26 12:28:31,448][123090] Updated weights for policy 1, policy_version 1602421 (0.0008) [2023-12-26 12:28:31,495][123090] Updated weights for policy 1, policy_version 1602431 (0.0008) [2023-12-26 12:28:31,796][123091] Updated weights for policy 0, policy_version 1613045 (0.0009) [2023-12-26 12:28:31,852][123091] Updated weights for policy 0, policy_version 1613055 (0.0009) [2023-12-26 12:28:31,915][123091] Updated weights for policy 0, policy_version 1613065 (0.0009) [2023-12-26 12:28:32,312][123090] Updated weights for policy 1, policy_version 1602441 (0.0009) [2023-12-26 12:28:32,379][123090] Updated weights for policy 1, policy_version 1602451 (0.0010) [2023-12-26 12:28:32,431][123090] Updated weights for policy 1, policy_version 1602461 (0.0010) [2023-12-26 12:28:32,755][123091] Updated weights for policy 0, policy_version 1613075 (0.0009) [2023-12-26 12:28:32,817][123091] Updated weights for policy 0, policy_version 1613085 (0.0010) [2023-12-26 12:28:32,881][123091] Updated weights for policy 0, policy_version 1613095 (0.0010) [2023-12-26 12:28:33,264][123090] Updated weights for policy 1, policy_version 1602471 (0.0007) [2023-12-26 12:28:33,319][123090] Updated weights for policy 1, policy_version 1602481 (0.0009) [2023-12-26 12:28:33,375][123090] Updated weights for policy 1, policy_version 1602491 (0.0008) [2023-12-26 12:28:33,550][123091] Updated weights for policy 0, policy_version 1613105 (0.0010) [2023-12-26 12:28:33,614][123091] Updated weights for policy 0, policy_version 1613115 (0.0005) [2023-12-26 12:28:33,665][123091] Updated weights for policy 0, policy_version 1613125 (0.0005) [2023-12-26 12:28:33,721][123091] Updated weights for policy 0, policy_version 1613135 (0.0007) [2023-12-26 12:28:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 823205888. Throughput: 0: 8870.2, 1: 8778.8. Samples: 823213956. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:33,784][121949] Avg episode reward: [(0, '6111.194'), (1, '5671.686')] [2023-12-26 12:28:34,093][123090] Updated weights for policy 1, policy_version 1602501 (0.0008) [2023-12-26 12:28:34,154][123090] Updated weights for policy 1, policy_version 1602511 (0.0007) [2023-12-26 12:28:34,230][123090] Updated weights for policy 1, policy_version 1602521 (0.0007) [2023-12-26 12:28:34,489][123091] Updated weights for policy 0, policy_version 1613145 (0.0011) [2023-12-26 12:28:34,544][123091] Updated weights for policy 0, policy_version 1613155 (0.0010) [2023-12-26 12:28:34,597][123091] Updated weights for policy 0, policy_version 1613165 (0.0011) [2023-12-26 12:28:35,030][123090] Updated weights for policy 1, policy_version 1602532 (0.0011) [2023-12-26 12:28:35,087][123090] Updated weights for policy 1, policy_version 1602542 (0.0009) [2023-12-26 12:28:35,141][123090] Updated weights for policy 1, policy_version 1602553 (0.0010) [2023-12-26 12:28:35,376][123091] Updated weights for policy 0, policy_version 1613175 (0.0010) [2023-12-26 12:28:35,447][123091] Updated weights for policy 0, policy_version 1613185 (0.0009) [2023-12-26 12:28:35,507][123091] Updated weights for policy 0, policy_version 1613195 (0.0010) [2023-12-26 12:28:35,981][123090] Updated weights for policy 1, policy_version 1602564 (0.0010) [2023-12-26 12:28:36,034][123090] Updated weights for policy 1, policy_version 1602574 (0.0009) [2023-12-26 12:28:36,094][123090] Updated weights for policy 1, policy_version 1602584 (0.0009) [2023-12-26 12:28:36,310][123091] Updated weights for policy 0, policy_version 1613205 (0.0010) [2023-12-26 12:28:36,377][123091] Updated weights for policy 0, policy_version 1613215 (0.0009) [2023-12-26 12:28:36,446][123091] Updated weights for policy 0, policy_version 1613225 (0.0009) [2023-12-26 12:28:36,958][123090] Updated weights for policy 1, policy_version 1602594 (0.0008) [2023-12-26 12:28:37,006][123090] Updated weights for policy 1, policy_version 1602604 (0.0005) [2023-12-26 12:28:37,059][123090] Updated weights for policy 1, policy_version 1602614 (0.0005) [2023-12-26 12:28:37,117][123090] Updated weights for policy 1, policy_version 1602624 (0.0005) [2023-12-26 12:28:37,311][123091] Updated weights for policy 0, policy_version 1613235 (0.0009) [2023-12-26 12:28:37,357][123091] Updated weights for policy 0, policy_version 1613245 (0.0005) [2023-12-26 12:28:37,414][123091] Updated weights for policy 0, policy_version 1613255 (0.0010) [2023-12-26 12:28:37,843][123090] Updated weights for policy 1, policy_version 1602634 (0.0010) [2023-12-26 12:28:37,899][123090] Updated weights for policy 1, policy_version 1602644 (0.0010) [2023-12-26 12:28:37,962][123090] Updated weights for policy 1, policy_version 1602654 (0.0010) [2023-12-26 12:28:38,213][123091] Updated weights for policy 0, policy_version 1613265 (0.0009) [2023-12-26 12:28:38,270][123091] Updated weights for policy 0, policy_version 1613275 (0.0005) [2023-12-26 12:28:38,331][123091] Updated weights for policy 0, policy_version 1613285 (0.0008) [2023-12-26 12:28:38,402][123091] Updated weights for policy 0, policy_version 1613295 (0.0010) [2023-12-26 12:28:38,766][123090] Updated weights for policy 1, policy_version 1602664 (0.0011) [2023-12-26 12:28:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 823287808. Throughput: 0: 8867.0, 1: 8800.7. Samples: 823266704. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:38,785][121949] Avg episode reward: [(0, '6198.339'), (1, '5643.376')] [2023-12-26 12:28:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001613296_413007872.pth... [2023-12-26 12:28:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001612272_412745728.pth [2023-12-26 12:28:38,830][123090] Updated weights for policy 1, policy_version 1602674 (0.0011) [2023-12-26 12:28:38,898][123090] Updated weights for policy 1, policy_version 1602684 (0.0011) [2023-12-26 12:28:38,925][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001602688_410288128.pth... [2023-12-26 12:28:38,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001601632_410017792.pth [2023-12-26 12:28:39,087][123091] Updated weights for policy 0, policy_version 1613305 (0.0006) [2023-12-26 12:28:39,159][123091] Updated weights for policy 0, policy_version 1613315 (0.0006) [2023-12-26 12:28:39,217][123091] Updated weights for policy 0, policy_version 1613325 (0.0009) [2023-12-26 12:28:39,730][123090] Updated weights for policy 1, policy_version 1602694 (0.0011) [2023-12-26 12:28:39,798][123090] Updated weights for policy 1, policy_version 1602704 (0.0011) [2023-12-26 12:28:39,865][123090] Updated weights for policy 1, policy_version 1602714 (0.0011) [2023-12-26 12:28:40,014][123091] Updated weights for policy 0, policy_version 1613335 (0.0009) [2023-12-26 12:28:40,068][123091] Updated weights for policy 0, policy_version 1613345 (0.0008) [2023-12-26 12:28:40,135][123091] Updated weights for policy 0, policy_version 1613355 (0.0009) [2023-12-26 12:28:40,686][123090] Updated weights for policy 1, policy_version 1602724 (0.0011) [2023-12-26 12:28:40,749][123090] Updated weights for policy 1, policy_version 1602734 (0.0005) [2023-12-26 12:28:40,824][123090] Updated weights for policy 1, policy_version 1602744 (0.0006) [2023-12-26 12:28:40,939][123091] Updated weights for policy 0, policy_version 1613365 (0.0008) [2023-12-26 12:28:40,997][123091] Updated weights for policy 0, policy_version 1613375 (0.0005) [2023-12-26 12:28:41,067][123091] Updated weights for policy 0, policy_version 1613385 (0.0009) [2023-12-26 12:28:41,573][123090] Updated weights for policy 1, policy_version 1602754 (0.0009) [2023-12-26 12:28:41,646][123090] Updated weights for policy 1, policy_version 1602764 (0.0009) [2023-12-26 12:28:41,714][123090] Updated weights for policy 1, policy_version 1602774 (0.0009) [2023-12-26 12:28:41,784][123090] Updated weights for policy 1, policy_version 1602784 (0.0008) [2023-12-26 12:28:41,908][123091] Updated weights for policy 0, policy_version 1613395 (0.0008) [2023-12-26 12:28:41,959][123091] Updated weights for policy 0, policy_version 1613405 (0.0008) [2023-12-26 12:28:42,023][123091] Updated weights for policy 0, policy_version 1613415 (0.0011) [2023-12-26 12:28:42,559][123090] Updated weights for policy 1, policy_version 1602794 (0.0007) [2023-12-26 12:28:42,611][123090] Updated weights for policy 1, policy_version 1602804 (0.0005) [2023-12-26 12:28:42,671][123090] Updated weights for policy 1, policy_version 1602814 (0.0006) [2023-12-26 12:28:42,869][123091] Updated weights for policy 0, policy_version 1613425 (0.0010) [2023-12-26 12:28:42,933][123091] Updated weights for policy 0, policy_version 1613435 (0.0009) [2023-12-26 12:28:42,986][123091] Updated weights for policy 0, policy_version 1613445 (0.0009) [2023-12-26 12:28:43,042][123091] Updated weights for policy 0, policy_version 1613455 (0.0009) [2023-12-26 12:28:43,513][123090] Updated weights for policy 1, policy_version 1602824 (0.0010) [2023-12-26 12:28:43,579][123090] Updated weights for policy 1, policy_version 1602834 (0.0010) [2023-12-26 12:28:43,645][123090] Updated weights for policy 1, policy_version 1602844 (0.0010) [2023-12-26 12:28:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 823377920. Throughput: 0: 8820.8, 1: 8802.8. Samples: 823371576. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:43,785][121949] Avg episode reward: [(0, '6226.203'), (1, '5768.156')] [2023-12-26 12:28:43,875][123091] Updated weights for policy 0, policy_version 1613465 (0.0010) [2023-12-26 12:28:43,940][123091] Updated weights for policy 0, policy_version 1613475 (0.0009) [2023-12-26 12:28:44,000][123091] Updated weights for policy 0, policy_version 1613485 (0.0006) [2023-12-26 12:28:44,475][123090] Updated weights for policy 1, policy_version 1602854 (0.0009) [2023-12-26 12:28:44,535][123090] Updated weights for policy 1, policy_version 1602864 (0.0009) [2023-12-26 12:28:44,600][123090] Updated weights for policy 1, policy_version 1602874 (0.0009) [2023-12-26 12:28:44,830][123091] Updated weights for policy 0, policy_version 1613495 (0.0007) [2023-12-26 12:28:44,893][123091] Updated weights for policy 0, policy_version 1613505 (0.0009) [2023-12-26 12:28:44,949][123091] Updated weights for policy 0, policy_version 1613515 (0.0010) [2023-12-26 12:28:45,335][123090] Updated weights for policy 1, policy_version 1602884 (0.0010) [2023-12-26 12:28:45,392][123090] Updated weights for policy 1, policy_version 1602894 (0.0011) [2023-12-26 12:28:45,441][123090] Updated weights for policy 1, policy_version 1602904 (0.0011) [2023-12-26 12:28:45,766][123091] Updated weights for policy 0, policy_version 1613525 (0.0008) [2023-12-26 12:28:45,833][123091] Updated weights for policy 0, policy_version 1613535 (0.0005) [2023-12-26 12:28:45,885][123091] Updated weights for policy 0, policy_version 1613545 (0.0005) [2023-12-26 12:28:46,094][123090] Updated weights for policy 1, policy_version 1602914 (0.0006) [2023-12-26 12:28:46,153][123090] Updated weights for policy 1, policy_version 1602924 (0.0010) [2023-12-26 12:28:46,216][123090] Updated weights for policy 1, policy_version 1602934 (0.0011) [2023-12-26 12:28:46,267][123090] Updated weights for policy 1, policy_version 1602944 (0.0010) [2023-12-26 12:28:46,538][123091] Updated weights for policy 0, policy_version 1613555 (0.0007) [2023-12-26 12:28:46,596][123091] Updated weights for policy 0, policy_version 1613565 (0.0010) [2023-12-26 12:28:46,652][123091] Updated weights for policy 0, policy_version 1613575 (0.0011) [2023-12-26 12:28:46,999][123090] Updated weights for policy 1, policy_version 1602954 (0.0005) [2023-12-26 12:28:47,073][123090] Updated weights for policy 1, policy_version 1602964 (0.0007) [2023-12-26 12:28:47,144][123090] Updated weights for policy 1, policy_version 1602974 (0.0009) [2023-12-26 12:28:47,360][123091] Updated weights for policy 0, policy_version 1613585 (0.0009) [2023-12-26 12:28:47,411][123091] Updated weights for policy 0, policy_version 1613595 (0.0010) [2023-12-26 12:28:47,473][123091] Updated weights for policy 0, policy_version 1613605 (0.0010) [2023-12-26 12:28:47,539][123091] Updated weights for policy 0, policy_version 1613615 (0.0010) [2023-12-26 12:28:47,844][123090] Updated weights for policy 1, policy_version 1602984 (0.0010) [2023-12-26 12:28:47,899][123090] Updated weights for policy 1, policy_version 1602994 (0.0010) [2023-12-26 12:28:47,947][123090] Updated weights for policy 1, policy_version 1603004 (0.0010) [2023-12-26 12:28:48,366][123091] Updated weights for policy 0, policy_version 1613625 (0.0010) [2023-12-26 12:28:48,426][123091] Updated weights for policy 0, policy_version 1613635 (0.0011) [2023-12-26 12:28:48,478][123091] Updated weights for policy 0, policy_version 1613645 (0.0010) [2023-12-26 12:28:48,741][123090] Updated weights for policy 1, policy_version 1603014 (0.0009) [2023-12-26 12:28:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 823468032. Throughput: 0: 8763.9, 1: 8865.8. Samples: 823480588. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:48,784][121949] Avg episode reward: [(0, '6125.589'), (1, '5876.795')] [2023-12-26 12:28:48,806][123090] Updated weights for policy 1, policy_version 1603024 (0.0005) [2023-12-26 12:28:48,885][123090] Updated weights for policy 1, policy_version 1603034 (0.0005) [2023-12-26 12:28:49,337][123091] Updated weights for policy 0, policy_version 1613655 (0.0011) [2023-12-26 12:28:49,411][123091] Updated weights for policy 0, policy_version 1613665 (0.0010) [2023-12-26 12:28:49,480][123091] Updated weights for policy 0, policy_version 1613675 (0.0009) [2023-12-26 12:28:49,654][123090] Updated weights for policy 1, policy_version 1603044 (0.0007) [2023-12-26 12:28:49,716][123090] Updated weights for policy 1, policy_version 1603054 (0.0010) [2023-12-26 12:28:49,782][123090] Updated weights for policy 1, policy_version 1603064 (0.0010) [2023-12-26 12:28:50,293][123091] Updated weights for policy 0, policy_version 1613685 (0.0010) [2023-12-26 12:28:50,346][123091] Updated weights for policy 0, policy_version 1613695 (0.0009) [2023-12-26 12:28:50,410][123091] Updated weights for policy 0, policy_version 1613705 (0.0009) [2023-12-26 12:28:50,643][123090] Updated weights for policy 1, policy_version 1603074 (0.0009) [2023-12-26 12:28:50,705][123090] Updated weights for policy 1, policy_version 1603084 (0.0007) [2023-12-26 12:28:50,770][123090] Updated weights for policy 1, policy_version 1603094 (0.0005) [2023-12-26 12:28:50,835][123090] Updated weights for policy 1, policy_version 1603104 (0.0005) [2023-12-26 12:28:51,252][123091] Updated weights for policy 0, policy_version 1613715 (0.0010) [2023-12-26 12:28:51,309][123091] Updated weights for policy 0, policy_version 1613725 (0.0010) [2023-12-26 12:28:51,379][123091] Updated weights for policy 0, policy_version 1613735 (0.0009) [2023-12-26 12:28:51,627][123090] Updated weights for policy 1, policy_version 1603114 (0.0009) [2023-12-26 12:28:51,684][123090] Updated weights for policy 1, policy_version 1603124 (0.0010) [2023-12-26 12:28:51,757][123090] Updated weights for policy 1, policy_version 1603134 (0.0008) [2023-12-26 12:28:52,232][123091] Updated weights for policy 0, policy_version 1613745 (0.0010) [2023-12-26 12:28:52,295][123091] Updated weights for policy 0, policy_version 1613755 (0.0010) [2023-12-26 12:28:52,349][123091] Updated weights for policy 0, policy_version 1613765 (0.0009) [2023-12-26 12:28:52,415][123091] Updated weights for policy 0, policy_version 1613775 (0.0009) [2023-12-26 12:28:52,568][123090] Updated weights for policy 1, policy_version 1603144 (0.0010) [2023-12-26 12:28:52,628][123090] Updated weights for policy 1, policy_version 1603154 (0.0012) [2023-12-26 12:28:52,687][123090] Updated weights for policy 1, policy_version 1603164 (0.0010) [2023-12-26 12:28:53,167][123091] Updated weights for policy 0, policy_version 1613785 (0.0007) [2023-12-26 12:28:53,229][123091] Updated weights for policy 0, policy_version 1613795 (0.0010) [2023-12-26 12:28:53,284][123091] Updated weights for policy 0, policy_version 1613805 (0.0010) [2023-12-26 12:28:53,611][123090] Updated weights for policy 1, policy_version 1603174 (0.0009) [2023-12-26 12:28:53,663][123090] Updated weights for policy 1, policy_version 1603184 (0.0010) [2023-12-26 12:28:53,717][123090] Updated weights for policy 1, policy_version 1603194 (0.0009) [2023-12-26 12:28:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17772.5). Total num frames: 823558144. Throughput: 0: 8701.8, 1: 8860.5. Samples: 823531836. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:53,786][121949] Avg episode reward: [(0, '6118.741'), (1, '5898.661')] [2023-12-26 12:28:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001613808_413138944.pth... [2023-12-26 12:28:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001603200_410419200.pth... [2023-12-26 12:28:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001612784_412876800.pth [2023-12-26 12:28:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001602176_410157056.pth [2023-12-26 12:28:53,994][123091] Updated weights for policy 0, policy_version 1613815 (0.0010) [2023-12-26 12:28:54,042][123091] Updated weights for policy 0, policy_version 1613825 (0.0009) [2023-12-26 12:28:54,096][123091] Updated weights for policy 0, policy_version 1613835 (0.0010) [2023-12-26 12:28:54,525][123090] Updated weights for policy 1, policy_version 1603204 (0.0008) [2023-12-26 12:28:54,594][123090] Updated weights for policy 1, policy_version 1603214 (0.0006) [2023-12-26 12:28:54,662][123090] Updated weights for policy 1, policy_version 1603224 (0.0007) [2023-12-26 12:28:54,931][123091] Updated weights for policy 0, policy_version 1613845 (0.0008) [2023-12-26 12:28:55,006][123091] Updated weights for policy 0, policy_version 1613855 (0.0006) [2023-12-26 12:28:55,069][123091] Updated weights for policy 0, policy_version 1613865 (0.0005) [2023-12-26 12:28:55,371][123090] Updated weights for policy 1, policy_version 1603234 (0.0007) [2023-12-26 12:28:55,441][123090] Updated weights for policy 1, policy_version 1603244 (0.0005) [2023-12-26 12:28:55,519][123090] Updated weights for policy 1, policy_version 1603254 (0.0005) [2023-12-26 12:28:55,595][123090] Updated weights for policy 1, policy_version 1603264 (0.0005) [2023-12-26 12:28:55,854][123091] Updated weights for policy 0, policy_version 1613875 (0.0008) [2023-12-26 12:28:55,914][123091] Updated weights for policy 0, policy_version 1613885 (0.0010) [2023-12-26 12:28:55,971][123091] Updated weights for policy 0, policy_version 1613895 (0.0009) [2023-12-26 12:28:56,294][123090] Updated weights for policy 1, policy_version 1603274 (0.0010) [2023-12-26 12:28:56,356][123090] Updated weights for policy 1, policy_version 1603284 (0.0010) [2023-12-26 12:28:56,410][123090] Updated weights for policy 1, policy_version 1603294 (0.0010) [2023-12-26 12:28:56,730][123091] Updated weights for policy 0, policy_version 1613905 (0.0008) [2023-12-26 12:28:56,788][123091] Updated weights for policy 0, policy_version 1613915 (0.0007) [2023-12-26 12:28:56,838][123091] Updated weights for policy 0, policy_version 1613925 (0.0008) [2023-12-26 12:28:56,895][123091] Updated weights for policy 0, policy_version 1613935 (0.0005) [2023-12-26 12:28:57,202][123090] Updated weights for policy 1, policy_version 1603304 (0.0010) [2023-12-26 12:28:57,258][123090] Updated weights for policy 1, policy_version 1603314 (0.0009) [2023-12-26 12:28:57,314][123090] Updated weights for policy 1, policy_version 1603324 (0.0009) [2023-12-26 12:28:57,634][123091] Updated weights for policy 0, policy_version 1613945 (0.0005) [2023-12-26 12:28:57,682][123091] Updated weights for policy 0, policy_version 1613955 (0.0005) [2023-12-26 12:28:57,727][123091] Updated weights for policy 0, policy_version 1613965 (0.0006) [2023-12-26 12:28:58,146][123090] Updated weights for policy 1, policy_version 1603334 (0.0006) [2023-12-26 12:28:58,204][123090] Updated weights for policy 1, policy_version 1603344 (0.0006) [2023-12-26 12:28:58,260][123090] Updated weights for policy 1, policy_version 1603354 (0.0010) [2023-12-26 12:28:58,551][123091] Updated weights for policy 0, policy_version 1613975 (0.0009) [2023-12-26 12:28:58,615][123091] Updated weights for policy 0, policy_version 1613985 (0.0008) [2023-12-26 12:28:58,689][123091] Updated weights for policy 0, policy_version 1613995 (0.0010) [2023-12-26 12:28:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 823648256. Throughput: 0: 8765.1, 1: 8871.8. Samples: 823639660. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:28:58,784][121949] Avg episode reward: [(0, '6108.572'), (1, '5781.919')] [2023-12-26 12:28:59,138][123090] Updated weights for policy 1, policy_version 1603364 (0.0010) [2023-12-26 12:28:59,204][123090] Updated weights for policy 1, policy_version 1603374 (0.0009) [2023-12-26 12:28:59,278][123090] Updated weights for policy 1, policy_version 1603384 (0.0009) [2023-12-26 12:28:59,480][123091] Updated weights for policy 0, policy_version 1614005 (0.0008) [2023-12-26 12:28:59,541][123091] Updated weights for policy 0, policy_version 1614015 (0.0006) [2023-12-26 12:28:59,595][123091] Updated weights for policy 0, policy_version 1614025 (0.0005) [2023-12-26 12:29:00,058][123090] Updated weights for policy 1, policy_version 1603394 (0.0007) [2023-12-26 12:29:00,116][123090] Updated weights for policy 1, policy_version 1603404 (0.0010) [2023-12-26 12:29:00,178][123090] Updated weights for policy 1, policy_version 1603414 (0.0010) [2023-12-26 12:29:00,245][123090] Updated weights for policy 1, policy_version 1603424 (0.0009) [2023-12-26 12:29:00,264][123091] Updated weights for policy 0, policy_version 1614035 (0.0006) [2023-12-26 12:29:00,323][123091] Updated weights for policy 0, policy_version 1614045 (0.0010) [2023-12-26 12:29:00,386][123091] Updated weights for policy 0, policy_version 1614055 (0.0011) [2023-12-26 12:29:01,044][123090] Updated weights for policy 1, policy_version 1603434 (0.0009) [2023-12-26 12:29:01,102][123090] Updated weights for policy 1, policy_version 1603444 (0.0008) [2023-12-26 12:29:01,173][123090] Updated weights for policy 1, policy_version 1603454 (0.0007) [2023-12-26 12:29:01,271][123091] Updated weights for policy 0, policy_version 1614065 (0.0009) [2023-12-26 12:29:01,336][123091] Updated weights for policy 0, policy_version 1614075 (0.0009) [2023-12-26 12:29:01,408][123091] Updated weights for policy 0, policy_version 1614085 (0.0009) [2023-12-26 12:29:01,468][123091] Updated weights for policy 0, policy_version 1614095 (0.0009) [2023-12-26 12:29:02,009][123090] Updated weights for policy 1, policy_version 1603464 (0.0009) [2023-12-26 12:29:02,068][123090] Updated weights for policy 1, policy_version 1603474 (0.0009) [2023-12-26 12:29:02,121][123090] Updated weights for policy 1, policy_version 1603484 (0.0009) [2023-12-26 12:29:02,335][123091] Updated weights for policy 0, policy_version 1614105 (0.0010) [2023-12-26 12:29:02,406][123091] Updated weights for policy 0, policy_version 1614115 (0.0011) [2023-12-26 12:29:02,458][123091] Updated weights for policy 0, policy_version 1614125 (0.0010) [2023-12-26 12:29:02,894][123090] Updated weights for policy 1, policy_version 1603494 (0.0010) [2023-12-26 12:29:02,967][123090] Updated weights for policy 1, policy_version 1603504 (0.0010) [2023-12-26 12:29:03,030][123090] Updated weights for policy 1, policy_version 1603514 (0.0009) [2023-12-26 12:29:03,237][123091] Updated weights for policy 0, policy_version 1614135 (0.0010) [2023-12-26 12:29:03,288][123091] Updated weights for policy 0, policy_version 1614145 (0.0009) [2023-12-26 12:29:03,349][123091] Updated weights for policy 0, policy_version 1614155 (0.0010) [2023-12-26 12:29:03,682][123090] Updated weights for policy 1, policy_version 1603524 (0.0008) [2023-12-26 12:29:03,751][123090] Updated weights for policy 1, policy_version 1603534 (0.0005) [2023-12-26 12:29:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 823730176. Throughput: 0: 8827.2, 1: 8751.8. Samples: 823744016. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:03,785][121949] Avg episode reward: [(0, '6234.803'), (1, '5776.310')] [2023-12-26 12:29:03,821][123090] Updated weights for policy 1, policy_version 1603544 (0.0006) [2023-12-26 12:29:04,144][123091] Updated weights for policy 0, policy_version 1614165 (0.0008) [2023-12-26 12:29:04,202][123091] Updated weights for policy 0, policy_version 1614175 (0.0005) [2023-12-26 12:29:04,252][123091] Updated weights for policy 0, policy_version 1614185 (0.0005) [2023-12-26 12:29:04,645][123090] Updated weights for policy 1, policy_version 1603554 (0.0007) [2023-12-26 12:29:04,715][123090] Updated weights for policy 1, policy_version 1603564 (0.0010) [2023-12-26 12:29:04,769][123090] Updated weights for policy 1, policy_version 1603574 (0.0010) [2023-12-26 12:29:04,823][123090] Updated weights for policy 1, policy_version 1603584 (0.0010) [2023-12-26 12:29:04,908][123091] Updated weights for policy 0, policy_version 1614195 (0.0005) [2023-12-26 12:29:04,971][123091] Updated weights for policy 0, policy_version 1614205 (0.0005) [2023-12-26 12:29:05,030][123091] Updated weights for policy 0, policy_version 1614215 (0.0005) [2023-12-26 12:29:05,739][123090] Updated weights for policy 1, policy_version 1603594 (0.0009) [2023-12-26 12:29:05,745][123091] Updated weights for policy 0, policy_version 1614225 (0.0006) [2023-12-26 12:29:05,792][123091] Updated weights for policy 0, policy_version 1614235 (0.0010) [2023-12-26 12:29:05,794][123090] Updated weights for policy 1, policy_version 1603604 (0.0006) [2023-12-26 12:29:05,843][123091] Updated weights for policy 0, policy_version 1614245 (0.0006) [2023-12-26 12:29:05,855][123090] Updated weights for policy 1, policy_version 1603614 (0.0009) [2023-12-26 12:29:05,903][123091] Updated weights for policy 0, policy_version 1614255 (0.0009) [2023-12-26 12:29:06,689][123091] Updated weights for policy 0, policy_version 1614266 (0.0010) [2023-12-26 12:29:06,735][123090] Updated weights for policy 1, policy_version 1603624 (0.0008) [2023-12-26 12:29:06,748][123091] Updated weights for policy 0, policy_version 1614276 (0.0010) [2023-12-26 12:29:06,789][123090] Updated weights for policy 1, policy_version 1603634 (0.0008) [2023-12-26 12:29:06,803][123091] Updated weights for policy 0, policy_version 1614286 (0.0010) [2023-12-26 12:29:06,839][123090] Updated weights for policy 1, policy_version 1603644 (0.0008) [2023-12-26 12:29:07,513][123091] Updated weights for policy 0, policy_version 1614297 (0.0010) [2023-12-26 12:29:07,559][123091] Updated weights for policy 0, policy_version 1614307 (0.0008) [2023-12-26 12:29:07,609][123091] Updated weights for policy 0, policy_version 1614317 (0.0010) [2023-12-26 12:29:07,714][123090] Updated weights for policy 1, policy_version 1603654 (0.0010) [2023-12-26 12:29:07,769][123090] Updated weights for policy 1, policy_version 1603664 (0.0008) [2023-12-26 12:29:07,825][123090] Updated weights for policy 1, policy_version 1603674 (0.0009) [2023-12-26 12:29:08,464][123091] Updated weights for policy 0, policy_version 1614327 (0.0008) [2023-12-26 12:29:08,522][123091] Updated weights for policy 0, policy_version 1614337 (0.0007) [2023-12-26 12:29:08,582][123091] Updated weights for policy 0, policy_version 1614347 (0.0009) [2023-12-26 12:29:08,688][123090] Updated weights for policy 1, policy_version 1603684 (0.0009) [2023-12-26 12:29:08,756][123090] Updated weights for policy 1, policy_version 1603694 (0.0010) [2023-12-26 12:29:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 823820288. Throughput: 0: 8954.7, 1: 8705.6. Samples: 823798784. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:08,785][121949] Avg episode reward: [(0, '6353.586'), (1, '5710.736')] [2023-12-26 12:29:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001614352_413278208.pth... [2023-12-26 12:29:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001613296_413007872.pth [2023-12-26 12:29:08,829][123090] Updated weights for policy 1, policy_version 1603704 (0.0009) [2023-12-26 12:29:08,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001603712_410550272.pth... [2023-12-26 12:29:08,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001602688_410288128.pth [2023-12-26 12:29:09,375][123091] Updated weights for policy 0, policy_version 1614357 (0.0009) [2023-12-26 12:29:09,446][123091] Updated weights for policy 0, policy_version 1614367 (0.0009) [2023-12-26 12:29:09,509][123091] Updated weights for policy 0, policy_version 1614377 (0.0010) [2023-12-26 12:29:09,618][123090] Updated weights for policy 1, policy_version 1603714 (0.0009) [2023-12-26 12:29:09,674][123090] Updated weights for policy 1, policy_version 1603724 (0.0008) [2023-12-26 12:29:09,730][123090] Updated weights for policy 1, policy_version 1603734 (0.0008) [2023-12-26 12:29:09,789][123090] Updated weights for policy 1, policy_version 1603744 (0.0006) [2023-12-26 12:29:10,279][123091] Updated weights for policy 0, policy_version 1614387 (0.0009) [2023-12-26 12:29:10,346][123091] Updated weights for policy 0, policy_version 1614397 (0.0011) [2023-12-26 12:29:10,398][123091] Updated weights for policy 0, policy_version 1614407 (0.0010) [2023-12-26 12:29:10,566][123090] Updated weights for policy 1, policy_version 1603754 (0.0009) [2023-12-26 12:29:10,633][123090] Updated weights for policy 1, policy_version 1603764 (0.0010) [2023-12-26 12:29:10,689][123090] Updated weights for policy 1, policy_version 1603774 (0.0010) [2023-12-26 12:29:11,241][123091] Updated weights for policy 0, policy_version 1614417 (0.0010) [2023-12-26 12:29:11,307][123091] Updated weights for policy 0, policy_version 1614427 (0.0009) [2023-12-26 12:29:11,379][123091] Updated weights for policy 0, policy_version 1614437 (0.0008) [2023-12-26 12:29:11,451][123091] Updated weights for policy 0, policy_version 1614447 (0.0010) [2023-12-26 12:29:11,519][123090] Updated weights for policy 1, policy_version 1603784 (0.0010) [2023-12-26 12:29:11,581][123090] Updated weights for policy 1, policy_version 1603794 (0.0009) [2023-12-26 12:29:11,643][123090] Updated weights for policy 1, policy_version 1603804 (0.0008) [2023-12-26 12:29:12,291][123091] Updated weights for policy 0, policy_version 1614457 (0.0010) [2023-12-26 12:29:12,354][123091] Updated weights for policy 0, policy_version 1614467 (0.0010) [2023-12-26 12:29:12,422][123091] Updated weights for policy 0, policy_version 1614477 (0.0009) [2023-12-26 12:29:12,499][123090] Updated weights for policy 1, policy_version 1603814 (0.0010) [2023-12-26 12:29:12,567][123090] Updated weights for policy 1, policy_version 1603824 (0.0009) [2023-12-26 12:29:12,620][123090] Updated weights for policy 1, policy_version 1603834 (0.0009) [2023-12-26 12:29:13,156][123091] Updated weights for policy 0, policy_version 1614487 (0.0007) [2023-12-26 12:29:13,211][123091] Updated weights for policy 0, policy_version 1614497 (0.0006) [2023-12-26 12:29:13,268][123091] Updated weights for policy 0, policy_version 1614507 (0.0008) [2023-12-26 12:29:13,507][123090] Updated weights for policy 1, policy_version 1603844 (0.0010) [2023-12-26 12:29:13,559][123090] Updated weights for policy 1, policy_version 1603854 (0.0009) [2023-12-26 12:29:13,608][123090] Updated weights for policy 1, policy_version 1603864 (0.0009) [2023-12-26 12:29:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 823910400. Throughput: 0: 8896.2, 1: 8723.2. Samples: 823902136. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:13,785][121949] Avg episode reward: [(0, '6396.622'), (1, '5748.982')] [2023-12-26 12:29:14,012][123091] Updated weights for policy 0, policy_version 1614517 (0.0005) [2023-12-26 12:29:14,062][123091] Updated weights for policy 0, policy_version 1614527 (0.0005) [2023-12-26 12:29:14,123][123091] Updated weights for policy 0, policy_version 1614537 (0.0008) [2023-12-26 12:29:14,401][123090] Updated weights for policy 1, policy_version 1603874 (0.0009) [2023-12-26 12:29:14,472][123090] Updated weights for policy 1, policy_version 1603884 (0.0005) [2023-12-26 12:29:14,537][123090] Updated weights for policy 1, policy_version 1603894 (0.0005) [2023-12-26 12:29:14,602][123090] Updated weights for policy 1, policy_version 1603904 (0.0005) [2023-12-26 12:29:14,882][123091] Updated weights for policy 0, policy_version 1614547 (0.0006) [2023-12-26 12:29:14,958][123091] Updated weights for policy 0, policy_version 1614557 (0.0006) [2023-12-26 12:29:15,031][123091] Updated weights for policy 0, policy_version 1614567 (0.0006) [2023-12-26 12:29:15,339][123090] Updated weights for policy 1, policy_version 1603914 (0.0009) [2023-12-26 12:29:15,388][123090] Updated weights for policy 1, policy_version 1603924 (0.0010) [2023-12-26 12:29:15,440][123090] Updated weights for policy 1, policy_version 1603935 (0.0009) [2023-12-26 12:29:15,775][123091] Updated weights for policy 0, policy_version 1614577 (0.0006) [2023-12-26 12:29:15,828][123091] Updated weights for policy 0, policy_version 1614587 (0.0005) [2023-12-26 12:29:15,896][123091] Updated weights for policy 0, policy_version 1614597 (0.0005) [2023-12-26 12:29:15,959][123091] Updated weights for policy 0, policy_version 1614607 (0.0009) [2023-12-26 12:29:16,341][123090] Updated weights for policy 1, policy_version 1603945 (0.0009) [2023-12-26 12:29:16,404][123090] Updated weights for policy 1, policy_version 1603955 (0.0010) [2023-12-26 12:29:16,459][123090] Updated weights for policy 1, policy_version 1603965 (0.0010) [2023-12-26 12:29:16,554][123091] Updated weights for policy 0, policy_version 1614617 (0.0007) [2023-12-26 12:29:16,614][123091] Updated weights for policy 0, policy_version 1614627 (0.0009) [2023-12-26 12:29:16,681][123091] Updated weights for policy 0, policy_version 1614637 (0.0010) [2023-12-26 12:29:17,298][123090] Updated weights for policy 1, policy_version 1603975 (0.0010) [2023-12-26 12:29:17,345][123090] Updated weights for policy 1, policy_version 1603985 (0.0009) [2023-12-26 12:29:17,395][123090] Updated weights for policy 1, policy_version 1603995 (0.0009) [2023-12-26 12:29:17,489][123091] Updated weights for policy 0, policy_version 1614647 (0.0010) [2023-12-26 12:29:17,543][123091] Updated weights for policy 0, policy_version 1614657 (0.0010) [2023-12-26 12:29:17,603][123091] Updated weights for policy 0, policy_version 1614667 (0.0010) [2023-12-26 12:29:18,250][123090] Updated weights for policy 1, policy_version 1604005 (0.0010) [2023-12-26 12:29:18,303][123090] Updated weights for policy 1, policy_version 1604015 (0.0009) [2023-12-26 12:29:18,372][123090] Updated weights for policy 1, policy_version 1604025 (0.0009) [2023-12-26 12:29:18,449][123091] Updated weights for policy 0, policy_version 1614677 (0.0009) [2023-12-26 12:29:18,517][123091] Updated weights for policy 0, policy_version 1614687 (0.0009) [2023-12-26 12:29:18,578][123091] Updated weights for policy 0, policy_version 1614697 (0.0009) [2023-12-26 12:29:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 824000512. Throughput: 0: 8936.5, 1: 8732.3. Samples: 824009052. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:18,784][121949] Avg episode reward: [(0, '6438.841'), (1, '5571.763')] [2023-12-26 12:29:19,220][123090] Updated weights for policy 1, policy_version 1604035 (0.0009) [2023-12-26 12:29:19,289][123090] Updated weights for policy 1, policy_version 1604045 (0.0010) [2023-12-26 12:29:19,351][123090] Updated weights for policy 1, policy_version 1604055 (0.0009) [2023-12-26 12:29:19,426][123091] Updated weights for policy 0, policy_version 1614707 (0.0009) [2023-12-26 12:29:19,489][123091] Updated weights for policy 0, policy_version 1614717 (0.0009) [2023-12-26 12:29:19,554][123091] Updated weights for policy 0, policy_version 1614727 (0.0010) [2023-12-26 12:29:20,200][123090] Updated weights for policy 1, policy_version 1604065 (0.0009) [2023-12-26 12:29:20,274][123090] Updated weights for policy 1, policy_version 1604075 (0.0010) [2023-12-26 12:29:20,339][123090] Updated weights for policy 1, policy_version 1604085 (0.0009) [2023-12-26 12:29:20,352][123091] Updated weights for policy 0, policy_version 1614737 (0.0006) [2023-12-26 12:29:20,404][123090] Updated weights for policy 1, policy_version 1604095 (0.0009) [2023-12-26 12:29:20,415][123091] Updated weights for policy 0, policy_version 1614747 (0.0009) [2023-12-26 12:29:20,478][123091] Updated weights for policy 0, policy_version 1614757 (0.0010) [2023-12-26 12:29:20,541][123091] Updated weights for policy 0, policy_version 1614767 (0.0009) [2023-12-26 12:29:21,264][123090] Updated weights for policy 1, policy_version 1604105 (0.0009) [2023-12-26 12:29:21,322][123090] Updated weights for policy 1, policy_version 1604115 (0.0010) [2023-12-26 12:29:21,380][123091] Updated weights for policy 0, policy_version 1614777 (0.0008) [2023-12-26 12:29:21,394][123090] Updated weights for policy 1, policy_version 1604125 (0.0009) [2023-12-26 12:29:21,445][123091] Updated weights for policy 0, policy_version 1614787 (0.0010) [2023-12-26 12:29:21,513][123091] Updated weights for policy 0, policy_version 1614797 (0.0010) [2023-12-26 12:29:22,256][123090] Updated weights for policy 1, policy_version 1604135 (0.0010) [2023-12-26 12:29:22,324][123090] Updated weights for policy 1, policy_version 1604145 (0.0009) [2023-12-26 12:29:22,388][123091] Updated weights for policy 0, policy_version 1614807 (0.0008) [2023-12-26 12:29:22,394][123090] Updated weights for policy 1, policy_version 1604155 (0.0008) [2023-12-26 12:29:22,451][123091] Updated weights for policy 0, policy_version 1614817 (0.0008) [2023-12-26 12:29:22,514][123091] Updated weights for policy 0, policy_version 1614827 (0.0009) [2023-12-26 12:29:23,204][123090] Updated weights for policy 1, policy_version 1604165 (0.0007) [2023-12-26 12:29:23,254][123090] Updated weights for policy 1, policy_version 1604175 (0.0005) [2023-12-26 12:29:23,309][123090] Updated weights for policy 1, policy_version 1604185 (0.0005) [2023-12-26 12:29:23,370][123091] Updated weights for policy 0, policy_version 1614837 (0.0009) [2023-12-26 12:29:23,424][123091] Updated weights for policy 0, policy_version 1614848 (0.0010) [2023-12-26 12:29:23,478][123091] Updated weights for policy 0, policy_version 1614858 (0.0010) [2023-12-26 12:29:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 824082432. Throughput: 0: 8924.1, 1: 8687.1. Samples: 824059208. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:23,785][121949] Avg episode reward: [(0, '6411.696'), (1, '5501.198')] [2023-12-26 12:29:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001614864_413409280.pth... [2023-12-26 12:29:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001604192_410673152.pth... [2023-12-26 12:29:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001603200_410419200.pth [2023-12-26 12:29:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001613808_413138944.pth [2023-12-26 12:29:23,934][123090] Updated weights for policy 1, policy_version 1604195 (0.0007) [2023-12-26 12:29:23,997][123090] Updated weights for policy 1, policy_version 1604205 (0.0009) [2023-12-26 12:29:24,068][123090] Updated weights for policy 1, policy_version 1604215 (0.0009) [2023-12-26 12:29:24,345][123091] Updated weights for policy 0, policy_version 1614868 (0.0010) [2023-12-26 12:29:24,414][123091] Updated weights for policy 0, policy_version 1614878 (0.0009) [2023-12-26 12:29:24,478][123091] Updated weights for policy 0, policy_version 1614888 (0.0009) [2023-12-26 12:29:24,884][123090] Updated weights for policy 1, policy_version 1604225 (0.0009) [2023-12-26 12:29:24,949][123090] Updated weights for policy 1, policy_version 1604235 (0.0010) [2023-12-26 12:29:25,008][123090] Updated weights for policy 1, policy_version 1604245 (0.0009) [2023-12-26 12:29:25,077][123090] Updated weights for policy 1, policy_version 1604255 (0.0010) [2023-12-26 12:29:25,301][123091] Updated weights for policy 0, policy_version 1614898 (0.0009) [2023-12-26 12:29:25,354][123091] Updated weights for policy 0, policy_version 1614909 (0.0010) [2023-12-26 12:29:25,407][123091] Updated weights for policy 0, policy_version 1614919 (0.0009) [2023-12-26 12:29:25,908][123090] Updated weights for policy 1, policy_version 1604265 (0.0009) [2023-12-26 12:29:25,968][123090] Updated weights for policy 1, policy_version 1604275 (0.0009) [2023-12-26 12:29:26,030][123090] Updated weights for policy 1, policy_version 1604285 (0.0009) [2023-12-26 12:29:26,248][123091] Updated weights for policy 0, policy_version 1614929 (0.0009) [2023-12-26 12:29:26,297][123091] Updated weights for policy 0, policy_version 1614939 (0.0009) [2023-12-26 12:29:26,353][123091] Updated weights for policy 0, policy_version 1614949 (0.0009) [2023-12-26 12:29:26,403][123091] Updated weights for policy 0, policy_version 1614960 (0.0010) [2023-12-26 12:29:26,855][123090] Updated weights for policy 1, policy_version 1604295 (0.0010) [2023-12-26 12:29:26,918][123090] Updated weights for policy 1, policy_version 1604305 (0.0010) [2023-12-26 12:29:26,984][123090] Updated weights for policy 1, policy_version 1604315 (0.0010) [2023-12-26 12:29:27,221][123091] Updated weights for policy 0, policy_version 1614970 (0.0005) [2023-12-26 12:29:27,266][123091] Updated weights for policy 0, policy_version 1614980 (0.0005) [2023-12-26 12:29:27,321][123091] Updated weights for policy 0, policy_version 1614990 (0.0005) [2023-12-26 12:29:27,661][123090] Updated weights for policy 1, policy_version 1604325 (0.0006) [2023-12-26 12:29:27,722][123090] Updated weights for policy 1, policy_version 1604335 (0.0006) [2023-12-26 12:29:27,784][123090] Updated weights for policy 1, policy_version 1604345 (0.0009) [2023-12-26 12:29:28,115][123091] Updated weights for policy 0, policy_version 1615000 (0.0006) [2023-12-26 12:29:28,160][123091] Updated weights for policy 0, policy_version 1615010 (0.0005) [2023-12-26 12:29:28,218][123091] Updated weights for policy 0, policy_version 1615020 (0.0005) [2023-12-26 12:29:28,515][123090] Updated weights for policy 1, policy_version 1604355 (0.0006) [2023-12-26 12:29:28,579][123090] Updated weights for policy 1, policy_version 1604365 (0.0005) [2023-12-26 12:29:28,628][123090] Updated weights for policy 1, policy_version 1604375 (0.0005) [2023-12-26 12:29:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 824172544. Throughput: 0: 8886.9, 1: 8705.6. Samples: 824163240. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:28,785][121949] Avg episode reward: [(0, '6413.682'), (1, '5602.044')] [2023-12-26 12:29:28,852][123091] Updated weights for policy 0, policy_version 1615030 (0.0005) [2023-12-26 12:29:28,899][123091] Updated weights for policy 0, policy_version 1615040 (0.0005) [2023-12-26 12:29:28,950][123091] Updated weights for policy 0, policy_version 1615050 (0.0008) [2023-12-26 12:29:29,328][123090] Updated weights for policy 1, policy_version 1604385 (0.0005) [2023-12-26 12:29:29,395][123090] Updated weights for policy 1, policy_version 1604395 (0.0009) [2023-12-26 12:29:29,466][123090] Updated weights for policy 1, policy_version 1604405 (0.0008) [2023-12-26 12:29:29,542][123090] Updated weights for policy 1, policy_version 1604415 (0.0005) [2023-12-26 12:29:29,756][123091] Updated weights for policy 0, policy_version 1615060 (0.0007) [2023-12-26 12:29:29,830][123091] Updated weights for policy 0, policy_version 1615070 (0.0006) [2023-12-26 12:29:29,908][123091] Updated weights for policy 0, policy_version 1615080 (0.0007) [2023-12-26 12:29:30,261][123090] Updated weights for policy 1, policy_version 1604425 (0.0010) [2023-12-26 12:29:30,326][123090] Updated weights for policy 1, policy_version 1604435 (0.0010) [2023-12-26 12:29:30,388][123090] Updated weights for policy 1, policy_version 1604445 (0.0010) [2023-12-26 12:29:30,616][123091] Updated weights for policy 0, policy_version 1615090 (0.0008) [2023-12-26 12:29:30,686][123091] Updated weights for policy 0, policy_version 1615100 (0.0009) [2023-12-26 12:29:30,747][123091] Updated weights for policy 0, policy_version 1615110 (0.0010) [2023-12-26 12:29:30,813][123091] Updated weights for policy 0, policy_version 1615120 (0.0010) [2023-12-26 12:29:31,141][123090] Updated weights for policy 1, policy_version 1604455 (0.0013) [2023-12-26 12:29:31,203][123090] Updated weights for policy 1, policy_version 1604465 (0.0011) [2023-12-26 12:29:31,271][123090] Updated weights for policy 1, policy_version 1604475 (0.0011) [2023-12-26 12:29:31,623][123091] Updated weights for policy 0, policy_version 1615130 (0.0006) [2023-12-26 12:29:31,685][123091] Updated weights for policy 0, policy_version 1615140 (0.0010) [2023-12-26 12:29:31,752][123091] Updated weights for policy 0, policy_version 1615150 (0.0009) [2023-12-26 12:29:32,020][123090] Updated weights for policy 1, policy_version 1604485 (0.0006) [2023-12-26 12:29:32,089][123090] Updated weights for policy 1, policy_version 1604495 (0.0006) [2023-12-26 12:29:32,155][123090] Updated weights for policy 1, policy_version 1604505 (0.0005) [2023-12-26 12:29:32,611][123091] Updated weights for policy 0, policy_version 1615160 (0.0009) [2023-12-26 12:29:32,676][123091] Updated weights for policy 0, policy_version 1615170 (0.0010) [2023-12-26 12:29:32,730][123091] Updated weights for policy 0, policy_version 1615180 (0.0010) [2023-12-26 12:29:32,816][123090] Updated weights for policy 1, policy_version 1604515 (0.0007) [2023-12-26 12:29:32,871][123090] Updated weights for policy 1, policy_version 1604525 (0.0005) [2023-12-26 12:29:32,927][123090] Updated weights for policy 1, policy_version 1604535 (0.0005) [2023-12-26 12:29:33,446][123091] Updated weights for policy 0, policy_version 1615190 (0.0009) [2023-12-26 12:29:33,456][123090] Updated weights for policy 1, policy_version 1604545 (0.0005) [2023-12-26 12:29:33,502][123091] Updated weights for policy 0, policy_version 1615200 (0.0008) [2023-12-26 12:29:33,513][123090] Updated weights for policy 1, policy_version 1604555 (0.0005) [2023-12-26 12:29:33,550][123091] Updated weights for policy 0, policy_version 1615210 (0.0008) [2023-12-26 12:29:33,561][123090] Updated weights for policy 1, policy_version 1604565 (0.0005) [2023-12-26 12:29:33,612][123090] Updated weights for policy 1, policy_version 1604575 (0.0005) [2023-12-26 12:29:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 824270848. Throughput: 0: 8903.1, 1: 8781.6. Samples: 824276400. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:33,785][121949] Avg episode reward: [(0, '6357.713'), (1, '5704.640')] [2023-12-26 12:29:34,337][123090] Updated weights for policy 1, policy_version 1604585 (0.0009) [2023-12-26 12:29:34,408][123090] Updated weights for policy 1, policy_version 1604595 (0.0009) [2023-12-26 12:29:34,463][123091] Updated weights for policy 0, policy_version 1615220 (0.0009) [2023-12-26 12:29:34,468][123090] Updated weights for policy 1, policy_version 1604605 (0.0010) [2023-12-26 12:29:34,517][123091] Updated weights for policy 0, policy_version 1615230 (0.0006) [2023-12-26 12:29:34,576][123091] Updated weights for policy 0, policy_version 1615240 (0.0007) [2023-12-26 12:29:35,337][123091] Updated weights for policy 0, policy_version 1615250 (0.0009) [2023-12-26 12:29:35,353][123090] Updated weights for policy 1, policy_version 1604615 (0.0007) [2023-12-26 12:29:35,395][123091] Updated weights for policy 0, policy_version 1615260 (0.0005) [2023-12-26 12:29:35,414][123090] Updated weights for policy 1, policy_version 1604625 (0.0005) [2023-12-26 12:29:35,458][123091] Updated weights for policy 0, policy_version 1615270 (0.0007) [2023-12-26 12:29:35,475][123090] Updated weights for policy 1, policy_version 1604635 (0.0005) [2023-12-26 12:29:35,506][123091] Updated weights for policy 0, policy_version 1615280 (0.0010) [2023-12-26 12:29:36,254][123090] Updated weights for policy 1, policy_version 1604645 (0.0007) [2023-12-26 12:29:36,315][123090] Updated weights for policy 1, policy_version 1604655 (0.0009) [2023-12-26 12:29:36,323][123091] Updated weights for policy 0, policy_version 1615290 (0.0011) [2023-12-26 12:29:36,377][123090] Updated weights for policy 1, policy_version 1604665 (0.0007) [2023-12-26 12:29:36,379][123091] Updated weights for policy 0, policy_version 1615300 (0.0010) [2023-12-26 12:29:36,441][123091] Updated weights for policy 0, policy_version 1615310 (0.0010) [2023-12-26 12:29:37,180][123090] Updated weights for policy 1, policy_version 1604675 (0.0006) [2023-12-26 12:29:37,246][123090] Updated weights for policy 1, policy_version 1604685 (0.0007) [2023-12-26 12:29:37,262][123091] Updated weights for policy 0, policy_version 1615320 (0.0008) [2023-12-26 12:29:37,310][123090] Updated weights for policy 1, policy_version 1604695 (0.0006) [2023-12-26 12:29:37,330][123091] Updated weights for policy 0, policy_version 1615330 (0.0011) [2023-12-26 12:29:37,388][123091] Updated weights for policy 0, policy_version 1615340 (0.0006) [2023-12-26 12:29:38,027][123091] Updated weights for policy 0, policy_version 1615350 (0.0007) [2023-12-26 12:29:38,074][123091] Updated weights for policy 0, policy_version 1615360 (0.0008) [2023-12-26 12:29:38,075][123090] Updated weights for policy 1, policy_version 1604705 (0.0006) [2023-12-26 12:29:38,125][123091] Updated weights for policy 0, policy_version 1615370 (0.0008) [2023-12-26 12:29:38,137][123090] Updated weights for policy 1, policy_version 1604715 (0.0005) [2023-12-26 12:29:38,190][123090] Updated weights for policy 1, policy_version 1604725 (0.0009) [2023-12-26 12:29:38,238][123090] Updated weights for policy 1, policy_version 1604735 (0.0008) [2023-12-26 12:29:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 824352768. Throughput: 0: 8931.7, 1: 8793.9. Samples: 824329484. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:38,785][121949] Avg episode reward: [(0, '6249.254'), (1, '5629.319')] [2023-12-26 12:29:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001615376_413540352.pth... [2023-12-26 12:29:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001604736_410812416.pth... [2023-12-26 12:29:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001614352_413278208.pth [2023-12-26 12:29:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001603712_410550272.pth [2023-12-26 12:29:38,978][123091] Updated weights for policy 0, policy_version 1615380 (0.0009) [2023-12-26 12:29:39,050][123091] Updated weights for policy 0, policy_version 1615390 (0.0005) [2023-12-26 12:29:39,097][123090] Updated weights for policy 1, policy_version 1604745 (0.0008) [2023-12-26 12:29:39,098][123091] Updated weights for policy 0, policy_version 1615400 (0.0006) [2023-12-26 12:29:39,155][123090] Updated weights for policy 1, policy_version 1604756 (0.0010) [2023-12-26 12:29:39,208][123090] Updated weights for policy 1, policy_version 1604766 (0.0010) [2023-12-26 12:29:39,869][123091] Updated weights for policy 0, policy_version 1615410 (0.0006) [2023-12-26 12:29:39,940][123091] Updated weights for policy 0, policy_version 1615420 (0.0008) [2023-12-26 12:29:40,003][123091] Updated weights for policy 0, policy_version 1615430 (0.0008) [2023-12-26 12:29:40,062][123091] Updated weights for policy 0, policy_version 1615440 (0.0010) [2023-12-26 12:29:40,147][123090] Updated weights for policy 1, policy_version 1604776 (0.0006) [2023-12-26 12:29:40,215][123090] Updated weights for policy 1, policy_version 1604786 (0.0007) [2023-12-26 12:29:40,277][123090] Updated weights for policy 1, policy_version 1604796 (0.0010) [2023-12-26 12:29:40,874][123091] Updated weights for policy 0, policy_version 1615450 (0.0010) [2023-12-26 12:29:40,927][123091] Updated weights for policy 0, policy_version 1615460 (0.0009) [2023-12-26 12:29:40,988][123091] Updated weights for policy 0, policy_version 1615470 (0.0008) [2023-12-26 12:29:41,110][123090] Updated weights for policy 1, policy_version 1604806 (0.0007) [2023-12-26 12:29:41,174][123090] Updated weights for policy 1, policy_version 1604816 (0.0007) [2023-12-26 12:29:41,240][123090] Updated weights for policy 1, policy_version 1604826 (0.0009) [2023-12-26 12:29:41,901][123091] Updated weights for policy 0, policy_version 1615480 (0.0009) [2023-12-26 12:29:41,974][123091] Updated weights for policy 0, policy_version 1615490 (0.0007) [2023-12-26 12:29:42,052][123091] Updated weights for policy 0, policy_version 1615500 (0.0007) [2023-12-26 12:29:42,133][123090] Updated weights for policy 1, policy_version 1604836 (0.0009) [2023-12-26 12:29:42,191][123090] Updated weights for policy 1, policy_version 1604846 (0.0010) [2023-12-26 12:29:42,244][123090] Updated weights for policy 1, policy_version 1604856 (0.0009) [2023-12-26 12:29:42,764][123091] Updated weights for policy 0, policy_version 1615510 (0.0009) [2023-12-26 12:29:42,812][123091] Updated weights for policy 0, policy_version 1615520 (0.0008) [2023-12-26 12:29:42,869][123091] Updated weights for policy 0, policy_version 1615530 (0.0007) [2023-12-26 12:29:43,159][123090] Updated weights for policy 1, policy_version 1604866 (0.0008) [2023-12-26 12:29:43,217][123090] Updated weights for policy 1, policy_version 1604876 (0.0009) [2023-12-26 12:29:43,276][123090] Updated weights for policy 1, policy_version 1604886 (0.0010) [2023-12-26 12:29:43,338][123090] Updated weights for policy 1, policy_version 1604896 (0.0009) [2023-12-26 12:29:43,639][123091] Updated weights for policy 0, policy_version 1615540 (0.0007) [2023-12-26 12:29:43,703][123091] Updated weights for policy 0, policy_version 1615550 (0.0005) [2023-12-26 12:29:43,766][123091] Updated weights for policy 0, policy_version 1615560 (0.0005) [2023-12-26 12:29:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 824434688. Throughput: 0: 8894.6, 1: 8730.4. Samples: 824432784. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:43,785][121949] Avg episode reward: [(0, '6202.962'), (1, '5627.703')] [2023-12-26 12:29:44,245][123090] Updated weights for policy 1, policy_version 1604906 (0.0006) [2023-12-26 12:29:44,313][123090] Updated weights for policy 1, policy_version 1604916 (0.0009) [2023-12-26 12:29:44,376][123090] Updated weights for policy 1, policy_version 1604926 (0.0009) [2023-12-26 12:29:44,442][123091] Updated weights for policy 0, policy_version 1615570 (0.0006) [2023-12-26 12:29:44,490][123091] Updated weights for policy 0, policy_version 1615580 (0.0010) [2023-12-26 12:29:44,534][123091] Updated weights for policy 0, policy_version 1615590 (0.0010) [2023-12-26 12:29:44,592][123091] Updated weights for policy 0, policy_version 1615600 (0.0010) [2023-12-26 12:29:45,118][123090] Updated weights for policy 1, policy_version 1604936 (0.0009) [2023-12-26 12:29:45,186][123090] Updated weights for policy 1, policy_version 1604946 (0.0010) [2023-12-26 12:29:45,252][123090] Updated weights for policy 1, policy_version 1604956 (0.0008) [2023-12-26 12:29:45,368][123091] Updated weights for policy 0, policy_version 1615610 (0.0011) [2023-12-26 12:29:45,432][123091] Updated weights for policy 0, policy_version 1615620 (0.0011) [2023-12-26 12:29:45,502][123091] Updated weights for policy 0, policy_version 1615630 (0.0011) [2023-12-26 12:29:46,085][123090] Updated weights for policy 1, policy_version 1604966 (0.0007) [2023-12-26 12:29:46,116][123091] Updated weights for policy 0, policy_version 1615640 (0.0006) [2023-12-26 12:29:46,133][123090] Updated weights for policy 1, policy_version 1604976 (0.0007) [2023-12-26 12:29:46,181][123090] Updated weights for policy 1, policy_version 1604986 (0.0007) [2023-12-26 12:29:46,187][123091] Updated weights for policy 0, policy_version 1615650 (0.0006) [2023-12-26 12:29:46,247][123091] Updated weights for policy 0, policy_version 1615660 (0.0005) [2023-12-26 12:29:46,836][123090] Updated weights for policy 1, policy_version 1604996 (0.0006) [2023-12-26 12:29:46,893][123090] Updated weights for policy 1, policy_version 1605006 (0.0005) [2023-12-26 12:29:46,960][123090] Updated weights for policy 1, policy_version 1605016 (0.0007) [2023-12-26 12:29:46,969][123091] Updated weights for policy 0, policy_version 1615670 (0.0005) [2023-12-26 12:29:47,023][123091] Updated weights for policy 0, policy_version 1615680 (0.0005) [2023-12-26 12:29:47,070][123091] Updated weights for policy 0, policy_version 1615690 (0.0005) [2023-12-26 12:29:47,681][123090] Updated weights for policy 1, policy_version 1605026 (0.0008) [2023-12-26 12:29:47,747][123090] Updated weights for policy 1, policy_version 1605036 (0.0006) [2023-12-26 12:29:47,795][123090] Updated weights for policy 1, policy_version 1605046 (0.0006) [2023-12-26 12:29:47,850][123090] Updated weights for policy 1, policy_version 1605056 (0.0009) [2023-12-26 12:29:47,853][123091] Updated weights for policy 0, policy_version 1615700 (0.0007) [2023-12-26 12:29:47,904][123091] Updated weights for policy 0, policy_version 1615710 (0.0010) [2023-12-26 12:29:47,959][123091] Updated weights for policy 0, policy_version 1615720 (0.0010) [2023-12-26 12:29:48,603][123090] Updated weights for policy 1, policy_version 1605066 (0.0005) [2023-12-26 12:29:48,667][123090] Updated weights for policy 1, policy_version 1605076 (0.0006) [2023-12-26 12:29:48,716][123090] Updated weights for policy 1, policy_version 1605086 (0.0006) [2023-12-26 12:29:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 824532992. Throughput: 0: 8981.8, 1: 8793.4. Samples: 824543896. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:48,785][121949] Avg episode reward: [(0, '6244.136'), (1, '5700.033')] [2023-12-26 12:29:48,810][123091] Updated weights for policy 0, policy_version 1615730 (0.0010) [2023-12-26 12:29:48,862][123091] Updated weights for policy 0, policy_version 1615740 (0.0010) [2023-12-26 12:29:48,921][123091] Updated weights for policy 0, policy_version 1615750 (0.0010) [2023-12-26 12:29:48,979][123091] Updated weights for policy 0, policy_version 1615760 (0.0010) [2023-12-26 12:29:49,378][123090] Updated weights for policy 1, policy_version 1605096 (0.0007) [2023-12-26 12:29:49,445][123090] Updated weights for policy 1, policy_version 1605106 (0.0009) [2023-12-26 12:29:49,508][123090] Updated weights for policy 1, policy_version 1605116 (0.0009) [2023-12-26 12:29:49,829][123091] Updated weights for policy 0, policy_version 1615770 (0.0008) [2023-12-26 12:29:49,886][123091] Updated weights for policy 0, policy_version 1615780 (0.0010) [2023-12-26 12:29:49,950][123091] Updated weights for policy 0, policy_version 1615790 (0.0009) [2023-12-26 12:29:50,279][123090] Updated weights for policy 1, policy_version 1605126 (0.0008) [2023-12-26 12:29:50,336][123090] Updated weights for policy 1, policy_version 1605136 (0.0007) [2023-12-26 12:29:50,388][123090] Updated weights for policy 1, policy_version 1605146 (0.0009) [2023-12-26 12:29:50,836][123091] Updated weights for policy 0, policy_version 1615800 (0.0006) [2023-12-26 12:29:50,902][123091] Updated weights for policy 0, policy_version 1615810 (0.0006) [2023-12-26 12:29:50,970][123091] Updated weights for policy 0, policy_version 1615820 (0.0008) [2023-12-26 12:29:51,200][123090] Updated weights for policy 1, policy_version 1605157 (0.0010) [2023-12-26 12:29:51,268][123090] Updated weights for policy 1, policy_version 1605167 (0.0011) [2023-12-26 12:29:51,331][123090] Updated weights for policy 1, policy_version 1605177 (0.0010) [2023-12-26 12:29:51,756][123091] Updated weights for policy 0, policy_version 1615830 (0.0010) [2023-12-26 12:29:51,810][123091] Updated weights for policy 0, policy_version 1615840 (0.0009) [2023-12-26 12:29:51,872][123091] Updated weights for policy 0, policy_version 1615850 (0.0010) [2023-12-26 12:29:52,145][123090] Updated weights for policy 1, policy_version 1605188 (0.0010) [2023-12-26 12:29:52,197][123090] Updated weights for policy 1, policy_version 1605198 (0.0009) [2023-12-26 12:29:52,246][123090] Updated weights for policy 1, policy_version 1605208 (0.0009) [2023-12-26 12:29:52,717][123091] Updated weights for policy 0, policy_version 1615860 (0.0008) [2023-12-26 12:29:52,769][123091] Updated weights for policy 0, policy_version 1615870 (0.0006) [2023-12-26 12:29:52,830][123091] Updated weights for policy 0, policy_version 1615880 (0.0006) [2023-12-26 12:29:53,103][123090] Updated weights for policy 1, policy_version 1605218 (0.0010) [2023-12-26 12:29:53,163][123090] Updated weights for policy 1, policy_version 1605228 (0.0009) [2023-12-26 12:29:53,218][123090] Updated weights for policy 1, policy_version 1605239 (0.0010) [2023-12-26 12:29:53,519][123091] Updated weights for policy 0, policy_version 1615890 (0.0006) [2023-12-26 12:29:53,586][123091] Updated weights for policy 0, policy_version 1615900 (0.0005) [2023-12-26 12:29:53,657][123091] Updated weights for policy 0, policy_version 1615910 (0.0005) [2023-12-26 12:29:53,735][123091] Updated weights for policy 0, policy_version 1615920 (0.0005) [2023-12-26 12:29:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 824623104. Throughput: 0: 8870.7, 1: 8836.7. Samples: 824595620. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:53,785][121949] Avg episode reward: [(0, '6257.218'), (1, '5650.232')] [2023-12-26 12:29:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001605248_410943488.pth... [2023-12-26 12:29:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001615920_413679616.pth... [2023-12-26 12:29:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001604192_410673152.pth [2023-12-26 12:29:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001614864_413409280.pth [2023-12-26 12:29:53,998][123090] Updated weights for policy 1, policy_version 1605249 (0.0010) [2023-12-26 12:29:54,065][123090] Updated weights for policy 1, policy_version 1605259 (0.0010) [2023-12-26 12:29:54,143][123090] Updated weights for policy 1, policy_version 1605269 (0.0010) [2023-12-26 12:29:54,216][123090] Updated weights for policy 1, policy_version 1605279 (0.0010) [2023-12-26 12:29:54,327][123091] Updated weights for policy 0, policy_version 1615930 (0.0006) [2023-12-26 12:29:54,389][123091] Updated weights for policy 0, policy_version 1615940 (0.0005) [2023-12-26 12:29:54,456][123091] Updated weights for policy 0, policy_version 1615950 (0.0005) [2023-12-26 12:29:55,030][123090] Updated weights for policy 1, policy_version 1605289 (0.0010) [2023-12-26 12:29:55,095][123090] Updated weights for policy 1, policy_version 1605299 (0.0011) [2023-12-26 12:29:55,142][123091] Updated weights for policy 0, policy_version 1615960 (0.0010) [2023-12-26 12:29:55,156][123090] Updated weights for policy 1, policy_version 1605309 (0.0010) [2023-12-26 12:29:55,204][123091] Updated weights for policy 0, policy_version 1615970 (0.0010) [2023-12-26 12:29:55,272][123091] Updated weights for policy 0, policy_version 1615980 (0.0011) [2023-12-26 12:29:55,946][123090] Updated weights for policy 1, policy_version 1605319 (0.0008) [2023-12-26 12:29:55,982][123091] Updated weights for policy 0, policy_version 1615990 (0.0007) [2023-12-26 12:29:55,998][123090] Updated weights for policy 1, policy_version 1605329 (0.0010) [2023-12-26 12:29:56,032][123091] Updated weights for policy 0, policy_version 1616000 (0.0005) [2023-12-26 12:29:56,051][123090] Updated weights for policy 1, policy_version 1605339 (0.0010) [2023-12-26 12:29:56,079][123091] Updated weights for policy 0, policy_version 1616010 (0.0005) [2023-12-26 12:29:56,730][123091] Updated weights for policy 0, policy_version 1616020 (0.0006) [2023-12-26 12:29:56,748][123090] Updated weights for policy 1, policy_version 1605349 (0.0008) [2023-12-26 12:29:56,787][123091] Updated weights for policy 0, policy_version 1616030 (0.0005) [2023-12-26 12:29:56,815][123090] Updated weights for policy 1, policy_version 1605359 (0.0010) [2023-12-26 12:29:56,848][123091] Updated weights for policy 0, policy_version 1616040 (0.0005) [2023-12-26 12:29:56,865][123090] Updated weights for policy 1, policy_version 1605369 (0.0010) [2023-12-26 12:29:57,550][123091] Updated weights for policy 0, policy_version 1616050 (0.0006) [2023-12-26 12:29:57,625][123091] Updated weights for policy 0, policy_version 1616060 (0.0010) [2023-12-26 12:29:57,637][123090] Updated weights for policy 1, policy_version 1605379 (0.0009) [2023-12-26 12:29:57,673][123091] Updated weights for policy 0, policy_version 1616070 (0.0009) [2023-12-26 12:29:57,697][123090] Updated weights for policy 1, policy_version 1605389 (0.0005) [2023-12-26 12:29:57,734][123091] Updated weights for policy 0, policy_version 1616080 (0.0008) [2023-12-26 12:29:57,754][123090] Updated weights for policy 1, policy_version 1605399 (0.0005) [2023-12-26 12:29:58,389][123090] Updated weights for policy 1, policy_version 1605409 (0.0005) [2023-12-26 12:29:58,461][123090] Updated weights for policy 1, policy_version 1605419 (0.0008) [2023-12-26 12:29:58,522][123090] Updated weights for policy 1, policy_version 1605429 (0.0009) [2023-12-26 12:29:58,528][123091] Updated weights for policy 0, policy_version 1616090 (0.0008) [2023-12-26 12:29:58,578][123090] Updated weights for policy 1, policy_version 1605439 (0.0008) [2023-12-26 12:29:58,588][123091] Updated weights for policy 0, policy_version 1616100 (0.0009) [2023-12-26 12:29:58,654][123091] Updated weights for policy 0, policy_version 1616110 (0.0009) [2023-12-26 12:29:58,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 824721408. Throughput: 0: 9035.4, 1: 8895.2. Samples: 824709012. Policy #0 lag: (min: 28.0, avg: 37.9, max: 60.0) [2023-12-26 12:29:58,785][121949] Avg episode reward: [(0, '6233.690'), (1, '5672.091')] [2023-12-26 12:29:59,464][123090] Updated weights for policy 1, policy_version 1605449 (0.0009) [2023-12-26 12:29:59,522][123090] Updated weights for policy 1, policy_version 1605459 (0.0009) [2023-12-26 12:29:59,588][123090] Updated weights for policy 1, policy_version 1605469 (0.0009) [2023-12-26 12:29:59,599][123091] Updated weights for policy 0, policy_version 1616120 (0.0007) [2023-12-26 12:29:59,663][123091] Updated weights for policy 0, policy_version 1616130 (0.0009) [2023-12-26 12:29:59,724][123091] Updated weights for policy 0, policy_version 1616140 (0.0009) [2023-12-26 12:30:00,402][123090] Updated weights for policy 1, policy_version 1605479 (0.0009) [2023-12-26 12:30:00,463][123090] Updated weights for policy 1, policy_version 1605489 (0.0009) [2023-12-26 12:30:00,523][123090] Updated weights for policy 1, policy_version 1605499 (0.0007) [2023-12-26 12:30:00,551][123091] Updated weights for policy 0, policy_version 1616150 (0.0009) [2023-12-26 12:30:00,611][123091] Updated weights for policy 0, policy_version 1616161 (0.0011) [2023-12-26 12:30:00,666][123091] Updated weights for policy 0, policy_version 1616171 (0.0009) [2023-12-26 12:30:01,276][123090] Updated weights for policy 1, policy_version 1605509 (0.0007) [2023-12-26 12:30:01,335][123090] Updated weights for policy 1, policy_version 1605519 (0.0009) [2023-12-26 12:30:01,411][123090] Updated weights for policy 1, policy_version 1605529 (0.0009) [2023-12-26 12:30:01,566][123091] Updated weights for policy 0, policy_version 1616181 (0.0009) [2023-12-26 12:30:01,623][123091] Updated weights for policy 0, policy_version 1616191 (0.0010) [2023-12-26 12:30:01,688][123091] Updated weights for policy 0, policy_version 1616201 (0.0009) [2023-12-26 12:30:02,277][123090] Updated weights for policy 1, policy_version 1605539 (0.0010) [2023-12-26 12:30:02,341][123090] Updated weights for policy 1, policy_version 1605549 (0.0010) [2023-12-26 12:30:02,407][123090] Updated weights for policy 1, policy_version 1605559 (0.0009) [2023-12-26 12:30:02,546][123091] Updated weights for policy 0, policy_version 1616211 (0.0010) [2023-12-26 12:30:02,600][123091] Updated weights for policy 0, policy_version 1616221 (0.0010) [2023-12-26 12:30:02,654][123091] Updated weights for policy 0, policy_version 1616233 (0.0011) [2023-12-26 12:30:03,092][123090] Updated weights for policy 1, policy_version 1605569 (0.0008) [2023-12-26 12:30:03,153][123090] Updated weights for policy 1, policy_version 1605579 (0.0009) [2023-12-26 12:30:03,203][123090] Updated weights for policy 1, policy_version 1605589 (0.0009) [2023-12-26 12:30:03,263][123090] Updated weights for policy 1, policy_version 1605599 (0.0008) [2023-12-26 12:30:03,559][123091] Updated weights for policy 0, policy_version 1616245 (0.0011) [2023-12-26 12:30:03,615][123091] Updated weights for policy 0, policy_version 1616256 (0.0009) [2023-12-26 12:30:03,672][123091] Updated weights for policy 0, policy_version 1616266 (0.0010) [2023-12-26 12:30:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 824803328. Throughput: 0: 8884.6, 1: 8959.1. Samples: 824812020. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:03,784][121949] Avg episode reward: [(0, '6191.659'), (1, '5677.647')] [2023-12-26 12:30:04,044][123090] Updated weights for policy 1, policy_version 1605609 (0.0009) [2023-12-26 12:30:04,100][123090] Updated weights for policy 1, policy_version 1605619 (0.0009) [2023-12-26 12:30:04,160][123090] Updated weights for policy 1, policy_version 1605629 (0.0009) [2023-12-26 12:30:04,546][123091] Updated weights for policy 0, policy_version 1616277 (0.0009) [2023-12-26 12:30:04,608][123091] Updated weights for policy 0, policy_version 1616287 (0.0010) [2023-12-26 12:30:04,656][123091] Updated weights for policy 0, policy_version 1616297 (0.0009) [2023-12-26 12:30:05,006][123090] Updated weights for policy 1, policy_version 1605639 (0.0009) [2023-12-26 12:30:05,070][123090] Updated weights for policy 1, policy_version 1605649 (0.0009) [2023-12-26 12:30:05,134][123090] Updated weights for policy 1, policy_version 1605659 (0.0009) [2023-12-26 12:30:05,501][123091] Updated weights for policy 0, policy_version 1616307 (0.0008) [2023-12-26 12:30:05,546][123091] Updated weights for policy 0, policy_version 1616317 (0.0005) [2023-12-26 12:30:05,591][123091] Updated weights for policy 0, policy_version 1616327 (0.0005) [2023-12-26 12:30:05,959][123090] Updated weights for policy 1, policy_version 1605669 (0.0009) [2023-12-26 12:30:06,007][123090] Updated weights for policy 1, policy_version 1605679 (0.0008) [2023-12-26 12:30:06,058][123090] Updated weights for policy 1, policy_version 1605689 (0.0009) [2023-12-26 12:30:06,345][123091] Updated weights for policy 0, policy_version 1616337 (0.0006) [2023-12-26 12:30:06,411][123091] Updated weights for policy 0, policy_version 1616347 (0.0010) [2023-12-26 12:30:06,480][123091] Updated weights for policy 0, policy_version 1616357 (0.0009) [2023-12-26 12:30:06,542][123091] Updated weights for policy 0, policy_version 1616367 (0.0010) [2023-12-26 12:30:06,921][123090] Updated weights for policy 1, policy_version 1605699 (0.0010) [2023-12-26 12:30:06,990][123090] Updated weights for policy 1, policy_version 1605709 (0.0010) [2023-12-26 12:30:07,056][123090] Updated weights for policy 1, policy_version 1605719 (0.0009) [2023-12-26 12:30:07,371][123091] Updated weights for policy 0, policy_version 1616377 (0.0011) [2023-12-26 12:30:07,438][123091] Updated weights for policy 0, policy_version 1616387 (0.0010) [2023-12-26 12:30:07,497][123091] Updated weights for policy 0, policy_version 1616397 (0.0010) [2023-12-26 12:30:07,911][123090] Updated weights for policy 1, policy_version 1605729 (0.0009) [2023-12-26 12:30:07,964][123090] Updated weights for policy 1, policy_version 1605739 (0.0010) [2023-12-26 12:30:08,020][123090] Updated weights for policy 1, policy_version 1605749 (0.0010) [2023-12-26 12:30:08,074][123090] Updated weights for policy 1, policy_version 1605759 (0.0009) [2023-12-26 12:30:08,092][123091] Updated weights for policy 0, policy_version 1616407 (0.0007) [2023-12-26 12:30:08,158][123091] Updated weights for policy 0, policy_version 1616417 (0.0005) [2023-12-26 12:30:08,215][123091] Updated weights for policy 0, policy_version 1616427 (0.0005) [2023-12-26 12:30:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 824885248. Throughput: 0: 8904.2, 1: 8979.8. Samples: 824863984. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:08,785][121949] Avg episode reward: [(0, '6231.274'), (1, '5641.363')] [2023-12-26 12:30:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001616432_413810688.pth... [2023-12-26 12:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001605760_411074560.pth... [2023-12-26 12:30:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001604736_410812416.pth [2023-12-26 12:30:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001615376_413540352.pth [2023-12-26 12:30:08,932][123091] Updated weights for policy 0, policy_version 1616437 (0.0008) [2023-12-26 12:30:08,970][123090] Updated weights for policy 1, policy_version 1605769 (0.0009) [2023-12-26 12:30:08,993][123091] Updated weights for policy 0, policy_version 1616447 (0.0009) [2023-12-26 12:30:09,032][123090] Updated weights for policy 1, policy_version 1605779 (0.0007) [2023-12-26 12:30:09,060][123091] Updated weights for policy 0, policy_version 1616457 (0.0008) [2023-12-26 12:30:09,093][123090] Updated weights for policy 1, policy_version 1605789 (0.0008) [2023-12-26 12:30:09,862][123091] Updated weights for policy 0, policy_version 1616467 (0.0008) [2023-12-26 12:30:09,912][123090] Updated weights for policy 1, policy_version 1605799 (0.0007) [2023-12-26 12:30:09,931][123091] Updated weights for policy 0, policy_version 1616477 (0.0009) [2023-12-26 12:30:09,982][123090] Updated weights for policy 1, policy_version 1605809 (0.0007) [2023-12-26 12:30:09,994][123091] Updated weights for policy 0, policy_version 1616487 (0.0008) [2023-12-26 12:30:10,042][123090] Updated weights for policy 1, policy_version 1605819 (0.0008) [2023-12-26 12:30:10,809][123090] Updated weights for policy 1, policy_version 1605829 (0.0007) [2023-12-26 12:30:10,831][123091] Updated weights for policy 0, policy_version 1616497 (0.0009) [2023-12-26 12:30:10,872][123090] Updated weights for policy 1, policy_version 1605839 (0.0007) [2023-12-26 12:30:10,895][123091] Updated weights for policy 0, policy_version 1616507 (0.0009) [2023-12-26 12:30:10,937][123090] Updated weights for policy 1, policy_version 1605849 (0.0007) [2023-12-26 12:30:10,948][123091] Updated weights for policy 0, policy_version 1616517 (0.0008) [2023-12-26 12:30:11,003][123091] Updated weights for policy 0, policy_version 1616527 (0.0009) [2023-12-26 12:30:11,684][123090] Updated weights for policy 1, policy_version 1605859 (0.0009) [2023-12-26 12:30:11,752][123090] Updated weights for policy 1, policy_version 1605869 (0.0010) [2023-12-26 12:30:11,822][123090] Updated weights for policy 1, policy_version 1605879 (0.0010) [2023-12-26 12:30:11,901][123091] Updated weights for policy 0, policy_version 1616537 (0.0010) [2023-12-26 12:30:11,964][123091] Updated weights for policy 0, policy_version 1616547 (0.0009) [2023-12-26 12:30:12,012][123091] Updated weights for policy 0, policy_version 1616557 (0.0009) [2023-12-26 12:30:12,659][123090] Updated weights for policy 1, policy_version 1605889 (0.0009) [2023-12-26 12:30:12,723][123090] Updated weights for policy 1, policy_version 1605899 (0.0011) [2023-12-26 12:30:12,786][123090] Updated weights for policy 1, policy_version 1605909 (0.0011) [2023-12-26 12:30:12,845][123090] Updated weights for policy 1, policy_version 1605919 (0.0010) [2023-12-26 12:30:12,902][123091] Updated weights for policy 0, policy_version 1616567 (0.0010) [2023-12-26 12:30:12,960][123091] Updated weights for policy 0, policy_version 1616577 (0.0009) [2023-12-26 12:30:13,018][123091] Updated weights for policy 0, policy_version 1616587 (0.0009) [2023-12-26 12:30:13,672][123090] Updated weights for policy 1, policy_version 1605929 (0.0006) [2023-12-26 12:30:13,730][123090] Updated weights for policy 1, policy_version 1605939 (0.0005) [2023-12-26 12:30:13,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 824967168. Throughput: 0: 8943.6, 1: 8938.7. Samples: 824967940. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:13,785][123090] Updated weights for policy 1, policy_version 1605949 (0.0005) [2023-12-26 12:30:13,785][121949] Avg episode reward: [(0, '6200.739'), (1, '5596.758')] [2023-12-26 12:30:13,835][123091] Updated weights for policy 0, policy_version 1616597 (0.0009) [2023-12-26 12:30:13,889][123091] Updated weights for policy 0, policy_version 1616607 (0.0010) [2023-12-26 12:30:13,948][123091] Updated weights for policy 0, policy_version 1616617 (0.0010) [2023-12-26 12:30:14,402][123090] Updated weights for policy 1, policy_version 1605959 (0.0006) [2023-12-26 12:30:14,463][123090] Updated weights for policy 1, policy_version 1605969 (0.0005) [2023-12-26 12:30:14,522][123090] Updated weights for policy 1, policy_version 1605979 (0.0005) [2023-12-26 12:30:14,896][123091] Updated weights for policy 0, policy_version 1616627 (0.0009) [2023-12-26 12:30:14,961][123091] Updated weights for policy 0, policy_version 1616637 (0.0009) [2023-12-26 12:30:15,028][123091] Updated weights for policy 0, policy_version 1616647 (0.0010) [2023-12-26 12:30:15,182][123090] Updated weights for policy 1, policy_version 1605989 (0.0008) [2023-12-26 12:30:15,241][123090] Updated weights for policy 1, policy_version 1605999 (0.0011) [2023-12-26 12:30:15,309][123090] Updated weights for policy 1, policy_version 1606009 (0.0010) [2023-12-26 12:30:15,929][123091] Updated weights for policy 0, policy_version 1616657 (0.0009) [2023-12-26 12:30:15,988][123091] Updated weights for policy 0, policy_version 1616668 (0.0010) [2023-12-26 12:30:16,039][123091] Updated weights for policy 0, policy_version 1616678 (0.0009) [2023-12-26 12:30:16,048][123090] Updated weights for policy 1, policy_version 1606019 (0.0009) [2023-12-26 12:30:16,088][123091] Updated weights for policy 0, policy_version 1616688 (0.0009) [2023-12-26 12:30:16,099][123090] Updated weights for policy 1, policy_version 1606029 (0.0005) [2023-12-26 12:30:16,153][123090] Updated weights for policy 1, policy_version 1606039 (0.0005) [2023-12-26 12:30:16,962][123091] Updated weights for policy 0, policy_version 1616698 (0.0009) [2023-12-26 12:30:16,963][123090] Updated weights for policy 1, policy_version 1606049 (0.0010) [2023-12-26 12:30:17,014][123091] Updated weights for policy 0, policy_version 1616708 (0.0007) [2023-12-26 12:30:17,020][123090] Updated weights for policy 1, policy_version 1606059 (0.0010) [2023-12-26 12:30:17,074][123091] Updated weights for policy 0, policy_version 1616718 (0.0007) [2023-12-26 12:30:17,083][123090] Updated weights for policy 1, policy_version 1606069 (0.0011) [2023-12-26 12:30:17,147][123090] Updated weights for policy 1, policy_version 1606079 (0.0010) [2023-12-26 12:30:17,918][123091] Updated weights for policy 0, policy_version 1616729 (0.0008) [2023-12-26 12:30:17,952][123090] Updated weights for policy 1, policy_version 1606089 (0.0006) [2023-12-26 12:30:17,978][123091] Updated weights for policy 0, policy_version 1616739 (0.0009) [2023-12-26 12:30:18,022][123090] Updated weights for policy 1, policy_version 1606099 (0.0005) [2023-12-26 12:30:18,028][123091] Updated weights for policy 0, policy_version 1616749 (0.0009) [2023-12-26 12:30:18,096][123090] Updated weights for policy 1, policy_version 1606109 (0.0006) [2023-12-26 12:30:18,683][123090] Updated weights for policy 1, policy_version 1606119 (0.0005) [2023-12-26 12:30:18,742][123090] Updated weights for policy 1, policy_version 1606129 (0.0005) [2023-12-26 12:30:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 825057280. Throughput: 0: 8814.3, 1: 8899.8. Samples: 825073532. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:18,785][121949] Avg episode reward: [(0, '6251.374'), (1, '5680.266')] [2023-12-26 12:30:18,813][123090] Updated weights for policy 1, policy_version 1606139 (0.0008) [2023-12-26 12:30:18,969][123091] Updated weights for policy 0, policy_version 1616759 (0.0009) [2023-12-26 12:30:19,018][123091] Updated weights for policy 0, policy_version 1616769 (0.0009) [2023-12-26 12:30:19,071][123091] Updated weights for policy 0, policy_version 1616779 (0.0009) [2023-12-26 12:30:19,529][123090] Updated weights for policy 1, policy_version 1606149 (0.0009) [2023-12-26 12:30:19,587][123090] Updated weights for policy 1, policy_version 1606159 (0.0006) [2023-12-26 12:30:19,646][123090] Updated weights for policy 1, policy_version 1606169 (0.0009) [2023-12-26 12:30:19,945][123091] Updated weights for policy 0, policy_version 1616789 (0.0009) [2023-12-26 12:30:20,005][123091] Updated weights for policy 0, policy_version 1616799 (0.0008) [2023-12-26 12:30:20,061][123091] Updated weights for policy 0, policy_version 1616809 (0.0007) [2023-12-26 12:30:20,460][123090] Updated weights for policy 1, policy_version 1606179 (0.0007) [2023-12-26 12:30:20,528][123090] Updated weights for policy 1, policy_version 1606189 (0.0009) [2023-12-26 12:30:20,601][123090] Updated weights for policy 1, policy_version 1606199 (0.0009) [2023-12-26 12:30:20,889][123091] Updated weights for policy 0, policy_version 1616819 (0.0007) [2023-12-26 12:30:20,952][123091] Updated weights for policy 0, policy_version 1616829 (0.0010) [2023-12-26 12:30:21,017][123091] Updated weights for policy 0, policy_version 1616839 (0.0010) [2023-12-26 12:30:21,482][123090] Updated weights for policy 1, policy_version 1606209 (0.0010) [2023-12-26 12:30:21,545][123090] Updated weights for policy 1, policy_version 1606219 (0.0010) [2023-12-26 12:30:21,607][123090] Updated weights for policy 1, policy_version 1606229 (0.0010) [2023-12-26 12:30:21,681][123090] Updated weights for policy 1, policy_version 1606239 (0.0008) [2023-12-26 12:30:21,980][123091] Updated weights for policy 0, policy_version 1616849 (0.0009) [2023-12-26 12:30:22,051][123091] Updated weights for policy 0, policy_version 1616859 (0.0009) [2023-12-26 12:30:22,117][123091] Updated weights for policy 0, policy_version 1616869 (0.0010) [2023-12-26 12:30:22,185][123091] Updated weights for policy 0, policy_version 1616879 (0.0010) [2023-12-26 12:30:22,511][123090] Updated weights for policy 1, policy_version 1606249 (0.0007) [2023-12-26 12:30:22,577][123090] Updated weights for policy 1, policy_version 1606259 (0.0006) [2023-12-26 12:30:22,644][123090] Updated weights for policy 1, policy_version 1606269 (0.0006) [2023-12-26 12:30:23,024][123091] Updated weights for policy 0, policy_version 1616889 (0.0011) [2023-12-26 12:30:23,081][123091] Updated weights for policy 0, policy_version 1616899 (0.0011) [2023-12-26 12:30:23,138][123091] Updated weights for policy 0, policy_version 1616909 (0.0010) [2023-12-26 12:30:23,363][123090] Updated weights for policy 1, policy_version 1606279 (0.0006) [2023-12-26 12:30:23,427][123090] Updated weights for policy 1, policy_version 1606289 (0.0006) [2023-12-26 12:30:23,494][123090] Updated weights for policy 1, policy_version 1606299 (0.0005) [2023-12-26 12:30:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 825147392. Throughput: 0: 8781.1, 1: 8879.7. Samples: 825124216. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:23,784][121949] Avg episode reward: [(0, '6252.120'), (1, '5782.257')] [2023-12-26 12:30:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001616912_413933568.pth... [2023-12-26 12:30:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001606304_411213824.pth... [2023-12-26 12:30:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001615920_413679616.pth [2023-12-26 12:30:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001605248_410943488.pth [2023-12-26 12:30:23,927][123091] Updated weights for policy 0, policy_version 1616919 (0.0010) [2023-12-26 12:30:23,994][123091] Updated weights for policy 0, policy_version 1616929 (0.0011) [2023-12-26 12:30:24,049][123091] Updated weights for policy 0, policy_version 1616939 (0.0011) [2023-12-26 12:30:24,220][123090] Updated weights for policy 1, policy_version 1606309 (0.0007) [2023-12-26 12:30:24,268][123090] Updated weights for policy 1, policy_version 1606319 (0.0006) [2023-12-26 12:30:24,329][123090] Updated weights for policy 1, policy_version 1606329 (0.0008) [2023-12-26 12:30:24,793][123091] Updated weights for policy 0, policy_version 1616949 (0.0008) [2023-12-26 12:30:24,853][123091] Updated weights for policy 0, policy_version 1616959 (0.0009) [2023-12-26 12:30:24,918][123091] Updated weights for policy 0, policy_version 1616969 (0.0010) [2023-12-26 12:30:25,104][123090] Updated weights for policy 1, policy_version 1606339 (0.0008) [2023-12-26 12:30:25,173][123090] Updated weights for policy 1, policy_version 1606349 (0.0010) [2023-12-26 12:30:25,255][123090] Updated weights for policy 1, policy_version 1606359 (0.0009) [2023-12-26 12:30:25,670][123091] Updated weights for policy 0, policy_version 1616979 (0.0010) [2023-12-26 12:30:25,723][123091] Updated weights for policy 0, policy_version 1616989 (0.0009) [2023-12-26 12:30:25,780][123091] Updated weights for policy 0, policy_version 1616999 (0.0007) [2023-12-26 12:30:26,129][123090] Updated weights for policy 1, policy_version 1606369 (0.0008) [2023-12-26 12:30:26,195][123090] Updated weights for policy 1, policy_version 1606379 (0.0009) [2023-12-26 12:30:26,254][123090] Updated weights for policy 1, policy_version 1606389 (0.0010) [2023-12-26 12:30:26,312][123090] Updated weights for policy 1, policy_version 1606399 (0.0009) [2023-12-26 12:30:26,597][123091] Updated weights for policy 0, policy_version 1617009 (0.0009) [2023-12-26 12:30:26,667][123091] Updated weights for policy 0, policy_version 1617019 (0.0006) [2023-12-26 12:30:26,737][123091] Updated weights for policy 0, policy_version 1617029 (0.0007) [2023-12-26 12:30:26,807][123091] Updated weights for policy 0, policy_version 1617039 (0.0007) [2023-12-26 12:30:27,242][123090] Updated weights for policy 1, policy_version 1606409 (0.0009) [2023-12-26 12:30:27,310][123090] Updated weights for policy 1, policy_version 1606419 (0.0009) [2023-12-26 12:30:27,374][123090] Updated weights for policy 1, policy_version 1606429 (0.0009) [2023-12-26 12:30:27,514][123091] Updated weights for policy 0, policy_version 1617049 (0.0006) [2023-12-26 12:30:27,574][123091] Updated weights for policy 0, policy_version 1617059 (0.0005) [2023-12-26 12:30:27,627][123091] Updated weights for policy 0, policy_version 1617069 (0.0005) [2023-12-26 12:30:28,258][123090] Updated weights for policy 1, policy_version 1606439 (0.0009) [2023-12-26 12:30:28,322][123090] Updated weights for policy 1, policy_version 1606449 (0.0008) [2023-12-26 12:30:28,353][123091] Updated weights for policy 0, policy_version 1617079 (0.0010) [2023-12-26 12:30:28,384][123090] Updated weights for policy 1, policy_version 1606459 (0.0007) [2023-12-26 12:30:28,415][123091] Updated weights for policy 0, policy_version 1617089 (0.0011) [2023-12-26 12:30:28,470][123091] Updated weights for policy 0, policy_version 1617099 (0.0010) [2023-12-26 12:30:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 825237504. Throughput: 0: 8814.2, 1: 8920.9. Samples: 825230864. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:28,785][121949] Avg episode reward: [(0, '6383.021'), (1, '5941.638')] [2023-12-26 12:30:29,185][123091] Updated weights for policy 0, policy_version 1617109 (0.0008) [2023-12-26 12:30:29,259][123091] Updated weights for policy 0, policy_version 1617119 (0.0007) [2023-12-26 12:30:29,319][123091] Updated weights for policy 0, policy_version 1617129 (0.0009) [2023-12-26 12:30:29,323][123090] Updated weights for policy 1, policy_version 1606469 (0.0007) [2023-12-26 12:30:29,396][123090] Updated weights for policy 1, policy_version 1606479 (0.0009) [2023-12-26 12:30:29,459][123090] Updated weights for policy 1, policy_version 1606489 (0.0010) [2023-12-26 12:30:30,146][123091] Updated weights for policy 0, policy_version 1617139 (0.0010) [2023-12-26 12:30:30,215][123091] Updated weights for policy 0, policy_version 1617149 (0.0008) [2023-12-26 12:30:30,278][123091] Updated weights for policy 0, policy_version 1617159 (0.0009) [2023-12-26 12:30:30,305][123090] Updated weights for policy 1, policy_version 1606499 (0.0009) [2023-12-26 12:30:30,351][123090] Updated weights for policy 1, policy_version 1606509 (0.0007) [2023-12-26 12:30:30,414][123090] Updated weights for policy 1, policy_version 1606519 (0.0010) [2023-12-26 12:30:31,092][123091] Updated weights for policy 0, policy_version 1617169 (0.0010) [2023-12-26 12:30:31,154][123091] Updated weights for policy 0, policy_version 1617179 (0.0009) [2023-12-26 12:30:31,208][123091] Updated weights for policy 0, policy_version 1617189 (0.0008) [2023-12-26 12:30:31,245][123090] Updated weights for policy 1, policy_version 1606529 (0.0009) [2023-12-26 12:30:31,267][123091] Updated weights for policy 0, policy_version 1617199 (0.0008) [2023-12-26 12:30:31,307][123090] Updated weights for policy 1, policy_version 1606539 (0.0008) [2023-12-26 12:30:31,383][123090] Updated weights for policy 1, policy_version 1606549 (0.0008) [2023-12-26 12:30:31,441][123090] Updated weights for policy 1, policy_version 1606559 (0.0009) [2023-12-26 12:30:32,100][123091] Updated weights for policy 0, policy_version 1617209 (0.0007) [2023-12-26 12:30:32,158][123091] Updated weights for policy 0, policy_version 1617219 (0.0009) [2023-12-26 12:30:32,220][123091] Updated weights for policy 0, policy_version 1617229 (0.0009) [2023-12-26 12:30:32,327][123090] Updated weights for policy 1, policy_version 1606569 (0.0009) [2023-12-26 12:30:32,393][123090] Updated weights for policy 1, policy_version 1606579 (0.0010) [2023-12-26 12:30:32,457][123090] Updated weights for policy 1, policy_version 1606589 (0.0009) [2023-12-26 12:30:33,022][123091] Updated weights for policy 0, policy_version 1617239 (0.0010) [2023-12-26 12:30:33,083][123091] Updated weights for policy 0, policy_version 1617249 (0.0009) [2023-12-26 12:30:33,129][123091] Updated weights for policy 0, policy_version 1617259 (0.0008) [2023-12-26 12:30:33,311][123090] Updated weights for policy 1, policy_version 1606599 (0.0009) [2023-12-26 12:30:33,367][123090] Updated weights for policy 1, policy_version 1606609 (0.0009) [2023-12-26 12:30:33,420][123090] Updated weights for policy 1, policy_version 1606619 (0.0009) [2023-12-26 12:30:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 825319424. Throughput: 0: 8750.7, 1: 8776.8. Samples: 825332636. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:33,785][121949] Avg episode reward: [(0, '6339.994'), (1, '5769.386')] [2023-12-26 12:30:33,831][123091] Updated weights for policy 0, policy_version 1617269 (0.0007) [2023-12-26 12:30:33,879][123091] Updated weights for policy 0, policy_version 1617279 (0.0009) [2023-12-26 12:30:33,925][123091] Updated weights for policy 0, policy_version 1617289 (0.0009) [2023-12-26 12:30:34,294][123090] Updated weights for policy 1, policy_version 1606629 (0.0010) [2023-12-26 12:30:34,361][123090] Updated weights for policy 1, policy_version 1606639 (0.0010) [2023-12-26 12:30:34,429][123090] Updated weights for policy 1, policy_version 1606649 (0.0009) [2023-12-26 12:30:34,741][123091] Updated weights for policy 0, policy_version 1617299 (0.0008) [2023-12-26 12:30:34,809][123091] Updated weights for policy 0, policy_version 1617309 (0.0006) [2023-12-26 12:30:34,864][123091] Updated weights for policy 0, policy_version 1617319 (0.0005) [2023-12-26 12:30:35,327][123090] Updated weights for policy 1, policy_version 1606659 (0.0008) [2023-12-26 12:30:35,379][123090] Updated weights for policy 1, policy_version 1606669 (0.0006) [2023-12-26 12:30:35,432][123090] Updated weights for policy 1, policy_version 1606679 (0.0010) [2023-12-26 12:30:35,512][123091] Updated weights for policy 0, policy_version 1617329 (0.0005) [2023-12-26 12:30:35,564][123091] Updated weights for policy 0, policy_version 1617339 (0.0005) [2023-12-26 12:30:35,614][123091] Updated weights for policy 0, policy_version 1617349 (0.0007) [2023-12-26 12:30:35,667][123091] Updated weights for policy 0, policy_version 1617359 (0.0009) [2023-12-26 12:30:36,222][123090] Updated weights for policy 1, policy_version 1606689 (0.0008) [2023-12-26 12:30:36,282][123090] Updated weights for policy 1, policy_version 1606699 (0.0008) [2023-12-26 12:30:36,346][123090] Updated weights for policy 1, policy_version 1606709 (0.0008) [2023-12-26 12:30:36,411][123090] Updated weights for policy 1, policy_version 1606719 (0.0007) [2023-12-26 12:30:36,518][123091] Updated weights for policy 0, policy_version 1617369 (0.0009) [2023-12-26 12:30:36,566][123091] Updated weights for policy 0, policy_version 1617379 (0.0009) [2023-12-26 12:30:36,634][123091] Updated weights for policy 0, policy_version 1617389 (0.0009) [2023-12-26 12:30:37,177][123090] Updated weights for policy 1, policy_version 1606729 (0.0009) [2023-12-26 12:30:37,246][123090] Updated weights for policy 1, policy_version 1606739 (0.0009) [2023-12-26 12:30:37,302][123090] Updated weights for policy 1, policy_version 1606749 (0.0010) [2023-12-26 12:30:37,501][123091] Updated weights for policy 0, policy_version 1617399 (0.0009) [2023-12-26 12:30:37,556][123091] Updated weights for policy 0, policy_version 1617409 (0.0009) [2023-12-26 12:30:37,622][123091] Updated weights for policy 0, policy_version 1617419 (0.0008) [2023-12-26 12:30:38,113][123090] Updated weights for policy 1, policy_version 1606759 (0.0010) [2023-12-26 12:30:38,163][123090] Updated weights for policy 1, policy_version 1606769 (0.0009) [2023-12-26 12:30:38,213][123090] Updated weights for policy 1, policy_version 1606779 (0.0009) [2023-12-26 12:30:38,500][123091] Updated weights for policy 0, policy_version 1617429 (0.0009) [2023-12-26 12:30:38,569][123091] Updated weights for policy 0, policy_version 1617439 (0.0008) [2023-12-26 12:30:38,635][123091] Updated weights for policy 0, policy_version 1617449 (0.0010) [2023-12-26 12:30:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 825409536. Throughput: 0: 8818.0, 1: 8748.5. Samples: 825386108. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:38,785][121949] Avg episode reward: [(0, '6314.306'), (1, '5584.178')] [2023-12-26 12:30:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001617456_414072832.pth... [2023-12-26 12:30:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001606784_411336704.pth... [2023-12-26 12:30:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001605760_411074560.pth [2023-12-26 12:30:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001616432_413810688.pth [2023-12-26 12:30:39,044][123090] Updated weights for policy 1, policy_version 1606789 (0.0008) [2023-12-26 12:30:39,107][123090] Updated weights for policy 1, policy_version 1606800 (0.0010) [2023-12-26 12:30:39,164][123090] Updated weights for policy 1, policy_version 1606810 (0.0009) [2023-12-26 12:30:39,485][123091] Updated weights for policy 0, policy_version 1617459 (0.0010) [2023-12-26 12:30:39,550][123091] Updated weights for policy 0, policy_version 1617469 (0.0009) [2023-12-26 12:30:39,616][123091] Updated weights for policy 0, policy_version 1617479 (0.0009) [2023-12-26 12:30:39,996][123090] Updated weights for policy 1, policy_version 1606820 (0.0009) [2023-12-26 12:30:40,055][123090] Updated weights for policy 1, policy_version 1606830 (0.0009) [2023-12-26 12:30:40,112][123090] Updated weights for policy 1, policy_version 1606841 (0.0010) [2023-12-26 12:30:40,485][123091] Updated weights for policy 0, policy_version 1617489 (0.0010) [2023-12-26 12:30:40,550][123091] Updated weights for policy 0, policy_version 1617499 (0.0010) [2023-12-26 12:30:40,616][123091] Updated weights for policy 0, policy_version 1617509 (0.0010) [2023-12-26 12:30:40,682][123091] Updated weights for policy 0, policy_version 1617519 (0.0009) [2023-12-26 12:30:40,971][123090] Updated weights for policy 1, policy_version 1606851 (0.0009) [2023-12-26 12:30:41,026][123090] Updated weights for policy 1, policy_version 1606861 (0.0010) [2023-12-26 12:30:41,096][123090] Updated weights for policy 1, policy_version 1606871 (0.0011) [2023-12-26 12:30:41,530][123091] Updated weights for policy 0, policy_version 1617529 (0.0008) [2023-12-26 12:30:41,595][123091] Updated weights for policy 0, policy_version 1617539 (0.0009) [2023-12-26 12:30:41,660][123091] Updated weights for policy 0, policy_version 1617549 (0.0009) [2023-12-26 12:30:41,931][123090] Updated weights for policy 1, policy_version 1606881 (0.0011) [2023-12-26 12:30:42,000][123090] Updated weights for policy 1, policy_version 1606891 (0.0009) [2023-12-26 12:30:42,066][123090] Updated weights for policy 1, policy_version 1606901 (0.0009) [2023-12-26 12:30:42,133][123090] Updated weights for policy 1, policy_version 1606911 (0.0007) [2023-12-26 12:30:42,542][123091] Updated weights for policy 0, policy_version 1617559 (0.0009) [2023-12-26 12:30:42,610][123091] Updated weights for policy 0, policy_version 1617569 (0.0009) [2023-12-26 12:30:42,670][123091] Updated weights for policy 0, policy_version 1617579 (0.0008) [2023-12-26 12:30:42,899][123090] Updated weights for policy 1, policy_version 1606921 (0.0009) [2023-12-26 12:30:42,962][123090] Updated weights for policy 1, policy_version 1606931 (0.0010) [2023-12-26 12:30:43,024][123090] Updated weights for policy 1, policy_version 1606941 (0.0010) [2023-12-26 12:30:43,315][123091] Updated weights for policy 0, policy_version 1617589 (0.0008) [2023-12-26 12:30:43,378][123091] Updated weights for policy 0, policy_version 1617599 (0.0005) [2023-12-26 12:30:43,442][123091] Updated weights for policy 0, policy_version 1617609 (0.0005) [2023-12-26 12:30:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 825491456. Throughput: 0: 8587.5, 1: 8699.6. Samples: 825486928. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:43,785][121949] Avg episode reward: [(0, '6097.467'), (1, '5456.654')] [2023-12-26 12:30:43,898][123090] Updated weights for policy 1, policy_version 1606951 (0.0010) [2023-12-26 12:30:43,953][123090] Updated weights for policy 1, policy_version 1606961 (0.0010) [2023-12-26 12:30:44,004][123090] Updated weights for policy 1, policy_version 1606971 (0.0010) [2023-12-26 12:30:44,133][123091] Updated weights for policy 0, policy_version 1617619 (0.0008) [2023-12-26 12:30:44,182][123091] Updated weights for policy 0, policy_version 1617629 (0.0005) [2023-12-26 12:30:44,238][123091] Updated weights for policy 0, policy_version 1617639 (0.0006) [2023-12-26 12:30:44,676][123090] Updated weights for policy 1, policy_version 1606981 (0.0010) [2023-12-26 12:30:44,740][123090] Updated weights for policy 1, policy_version 1606991 (0.0009) [2023-12-26 12:30:44,814][123090] Updated weights for policy 1, policy_version 1607001 (0.0009) [2023-12-26 12:30:45,095][123091] Updated weights for policy 0, policy_version 1617649 (0.0010) [2023-12-26 12:30:45,155][123091] Updated weights for policy 0, policy_version 1617659 (0.0010) [2023-12-26 12:30:45,215][123091] Updated weights for policy 0, policy_version 1617669 (0.0010) [2023-12-26 12:30:45,282][123091] Updated weights for policy 0, policy_version 1617679 (0.0010) [2023-12-26 12:30:45,614][123090] Updated weights for policy 1, policy_version 1607011 (0.0008) [2023-12-26 12:30:45,664][123090] Updated weights for policy 1, policy_version 1607021 (0.0005) [2023-12-26 12:30:45,714][123090] Updated weights for policy 1, policy_version 1607031 (0.0005) [2023-12-26 12:30:46,103][123091] Updated weights for policy 0, policy_version 1617689 (0.0009) [2023-12-26 12:30:46,159][123091] Updated weights for policy 0, policy_version 1617699 (0.0010) [2023-12-26 12:30:46,221][123091] Updated weights for policy 0, policy_version 1617709 (0.0009) [2023-12-26 12:30:46,560][123090] Updated weights for policy 1, policy_version 1607041 (0.0006) [2023-12-26 12:30:46,621][123090] Updated weights for policy 1, policy_version 1607051 (0.0009) [2023-12-26 12:30:46,686][123090] Updated weights for policy 1, policy_version 1607061 (0.0010) [2023-12-26 12:30:46,757][123090] Updated weights for policy 1, policy_version 1607071 (0.0009) [2023-12-26 12:30:47,033][123091] Updated weights for policy 0, policy_version 1617719 (0.0009) [2023-12-26 12:30:47,083][123091] Updated weights for policy 0, policy_version 1617729 (0.0009) [2023-12-26 12:30:47,136][123091] Updated weights for policy 0, policy_version 1617739 (0.0009) [2023-12-26 12:30:47,560][123090] Updated weights for policy 1, policy_version 1607081 (0.0006) [2023-12-26 12:30:47,627][123090] Updated weights for policy 1, policy_version 1607091 (0.0007) [2023-12-26 12:30:47,692][123090] Updated weights for policy 1, policy_version 1607101 (0.0009) [2023-12-26 12:30:47,991][123091] Updated weights for policy 0, policy_version 1617749 (0.0009) [2023-12-26 12:30:48,045][123091] Updated weights for policy 0, policy_version 1617759 (0.0010) [2023-12-26 12:30:48,098][123091] Updated weights for policy 0, policy_version 1617769 (0.0009) [2023-12-26 12:30:48,494][123090] Updated weights for policy 1, policy_version 1607111 (0.0010) [2023-12-26 12:30:48,550][123090] Updated weights for policy 1, policy_version 1607121 (0.0010) [2023-12-26 12:30:48,603][123090] Updated weights for policy 1, policy_version 1607131 (0.0009) [2023-12-26 12:30:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 825581568. Throughput: 0: 8671.4, 1: 8666.6. Samples: 825592232. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:48,785][121949] Avg episode reward: [(0, '6174.915'), (1, '5724.498')] [2023-12-26 12:30:48,981][123091] Updated weights for policy 0, policy_version 1617779 (0.0010) [2023-12-26 12:30:49,036][123091] Updated weights for policy 0, policy_version 1617789 (0.0009) [2023-12-26 12:30:49,085][123091] Updated weights for policy 0, policy_version 1617799 (0.0009) [2023-12-26 12:30:49,449][123090] Updated weights for policy 1, policy_version 1607141 (0.0010) [2023-12-26 12:30:49,501][123090] Updated weights for policy 1, policy_version 1607151 (0.0009) [2023-12-26 12:30:49,552][123090] Updated weights for policy 1, policy_version 1607161 (0.0009) [2023-12-26 12:30:49,966][123091] Updated weights for policy 0, policy_version 1617809 (0.0009) [2023-12-26 12:30:50,029][123091] Updated weights for policy 0, policy_version 1617819 (0.0009) [2023-12-26 12:30:50,081][123091] Updated weights for policy 0, policy_version 1617829 (0.0009) [2023-12-26 12:30:50,134][123091] Updated weights for policy 0, policy_version 1617839 (0.0010) [2023-12-26 12:30:50,413][123090] Updated weights for policy 1, policy_version 1607171 (0.0009) [2023-12-26 12:30:50,461][123090] Updated weights for policy 1, policy_version 1607181 (0.0009) [2023-12-26 12:30:50,513][123090] Updated weights for policy 1, policy_version 1607191 (0.0009) [2023-12-26 12:30:50,983][123091] Updated weights for policy 0, policy_version 1617849 (0.0009) [2023-12-26 12:30:51,053][123091] Updated weights for policy 0, policy_version 1617859 (0.0009) [2023-12-26 12:30:51,110][123091] Updated weights for policy 0, policy_version 1617869 (0.0010) [2023-12-26 12:30:51,367][123090] Updated weights for policy 1, policy_version 1607201 (0.0009) [2023-12-26 12:30:51,437][123090] Updated weights for policy 1, policy_version 1607211 (0.0009) [2023-12-26 12:30:51,500][123090] Updated weights for policy 1, policy_version 1607221 (0.0006) [2023-12-26 12:30:51,568][123090] Updated weights for policy 1, policy_version 1607231 (0.0007) [2023-12-26 12:30:51,962][123091] Updated weights for policy 0, policy_version 1617879 (0.0007) [2023-12-26 12:30:52,044][123091] Updated weights for policy 0, policy_version 1617889 (0.0006) [2023-12-26 12:30:52,118][123091] Updated weights for policy 0, policy_version 1617899 (0.0006) [2023-12-26 12:30:52,295][123090] Updated weights for policy 1, policy_version 1607241 (0.0008) [2023-12-26 12:30:52,370][123090] Updated weights for policy 1, policy_version 1607251 (0.0008) [2023-12-26 12:30:52,432][123090] Updated weights for policy 1, policy_version 1607261 (0.0010) [2023-12-26 12:30:52,753][123091] Updated weights for policy 0, policy_version 1617909 (0.0010) [2023-12-26 12:30:52,809][123091] Updated weights for policy 0, policy_version 1617919 (0.0009) [2023-12-26 12:30:52,869][123091] Updated weights for policy 0, policy_version 1617929 (0.0006) [2023-12-26 12:30:53,211][123090] Updated weights for policy 1, policy_version 1607272 (0.0010) [2023-12-26 12:30:53,270][123090] Updated weights for policy 1, policy_version 1607282 (0.0010) [2023-12-26 12:30:53,328][123090] Updated weights for policy 1, policy_version 1607292 (0.0009) [2023-12-26 12:30:53,620][123091] Updated weights for policy 0, policy_version 1617939 (0.0006) [2023-12-26 12:30:53,668][123091] Updated weights for policy 0, policy_version 1617949 (0.0009) [2023-12-26 12:30:53,723][123091] Updated weights for policy 0, policy_version 1617959 (0.0009) [2023-12-26 12:30:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 825671680. Throughput: 0: 8638.8, 1: 8661.1. Samples: 825642484. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:53,785][121949] Avg episode reward: [(0, '6185.686'), (1, '5825.221')] [2023-12-26 12:30:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001617968_414203904.pth... [2023-12-26 12:30:53,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001607296_411467776.pth... [2023-12-26 12:30:53,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001616912_413933568.pth [2023-12-26 12:30:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001606304_411213824.pth [2023-12-26 12:30:54,187][123090] Updated weights for policy 1, policy_version 1607302 (0.0010) [2023-12-26 12:30:54,232][123090] Updated weights for policy 1, policy_version 1607312 (0.0010) [2023-12-26 12:30:54,281][123090] Updated weights for policy 1, policy_version 1607322 (0.0010) [2023-12-26 12:30:54,570][123091] Updated weights for policy 0, policy_version 1617969 (0.0009) [2023-12-26 12:30:54,629][123091] Updated weights for policy 0, policy_version 1617979 (0.0010) [2023-12-26 12:30:54,690][123091] Updated weights for policy 0, policy_version 1617990 (0.0010) [2023-12-26 12:30:54,749][123091] Updated weights for policy 0, policy_version 1618000 (0.0010) [2023-12-26 12:30:55,080][123090] Updated weights for policy 1, policy_version 1607332 (0.0010) [2023-12-26 12:30:55,135][123090] Updated weights for policy 1, policy_version 1607342 (0.0010) [2023-12-26 12:30:55,193][123090] Updated weights for policy 1, policy_version 1607352 (0.0009) [2023-12-26 12:30:55,467][123091] Updated weights for policy 0, policy_version 1618010 (0.0005) [2023-12-26 12:30:55,525][123091] Updated weights for policy 0, policy_version 1618020 (0.0009) [2023-12-26 12:30:55,584][123091] Updated weights for policy 0, policy_version 1618030 (0.0010) [2023-12-26 12:30:55,954][123090] Updated weights for policy 1, policy_version 1607362 (0.0009) [2023-12-26 12:30:56,002][123090] Updated weights for policy 1, policy_version 1607372 (0.0010) [2023-12-26 12:30:56,054][123090] Updated weights for policy 1, policy_version 1607382 (0.0010) [2023-12-26 12:30:56,110][123090] Updated weights for policy 1, policy_version 1607392 (0.0010) [2023-12-26 12:30:56,443][123091] Updated weights for policy 0, policy_version 1618040 (0.0011) [2023-12-26 12:30:56,499][123091] Updated weights for policy 0, policy_version 1618050 (0.0006) [2023-12-26 12:30:56,564][123091] Updated weights for policy 0, policy_version 1618060 (0.0008) [2023-12-26 12:30:56,902][123090] Updated weights for policy 1, policy_version 1607402 (0.0006) [2023-12-26 12:30:56,967][123090] Updated weights for policy 1, policy_version 1607412 (0.0010) [2023-12-26 12:30:57,014][123090] Updated weights for policy 1, policy_version 1607422 (0.0010) [2023-12-26 12:30:57,248][123091] Updated weights for policy 0, policy_version 1618070 (0.0006) [2023-12-26 12:30:57,297][123091] Updated weights for policy 0, policy_version 1618080 (0.0005) [2023-12-26 12:30:57,365][123091] Updated weights for policy 0, policy_version 1618090 (0.0008) [2023-12-26 12:30:57,801][123090] Updated weights for policy 1, policy_version 1607432 (0.0010) [2023-12-26 12:30:57,870][123090] Updated weights for policy 1, policy_version 1607442 (0.0010) [2023-12-26 12:30:57,924][123090] Updated weights for policy 1, policy_version 1607452 (0.0010) [2023-12-26 12:30:58,069][123091] Updated weights for policy 0, policy_version 1618100 (0.0010) [2023-12-26 12:30:58,124][123091] Updated weights for policy 0, policy_version 1618110 (0.0007) [2023-12-26 12:30:58,192][123091] Updated weights for policy 0, policy_version 1618120 (0.0008) [2023-12-26 12:30:58,740][123090] Updated weights for policy 1, policy_version 1607463 (0.0009) [2023-12-26 12:30:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 825753600. Throughput: 0: 8709.3, 1: 8728.1. Samples: 825752624. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:30:58,785][121949] Avg episode reward: [(0, '6157.601'), (1, '5755.040')] [2023-12-26 12:30:58,816][123090] Updated weights for policy 1, policy_version 1607473 (0.0009) [2023-12-26 12:30:58,887][123090] Updated weights for policy 1, policy_version 1607483 (0.0008) [2023-12-26 12:30:59,107][123091] Updated weights for policy 0, policy_version 1618130 (0.0011) [2023-12-26 12:30:59,162][123091] Updated weights for policy 0, policy_version 1618140 (0.0009) [2023-12-26 12:30:59,232][123091] Updated weights for policy 0, policy_version 1618150 (0.0010) [2023-12-26 12:30:59,304][123091] Updated weights for policy 0, policy_version 1618160 (0.0010) [2023-12-26 12:30:59,696][123090] Updated weights for policy 1, policy_version 1607493 (0.0009) [2023-12-26 12:30:59,757][123090] Updated weights for policy 1, policy_version 1607503 (0.0010) [2023-12-26 12:30:59,811][123090] Updated weights for policy 1, policy_version 1607513 (0.0010) [2023-12-26 12:31:00,063][123091] Updated weights for policy 0, policy_version 1618170 (0.0008) [2023-12-26 12:31:00,122][123091] Updated weights for policy 0, policy_version 1618180 (0.0006) [2023-12-26 12:31:00,185][123091] Updated weights for policy 0, policy_version 1618190 (0.0005) [2023-12-26 12:31:00,671][123090] Updated weights for policy 1, policy_version 1607523 (0.0008) [2023-12-26 12:31:00,724][123090] Updated weights for policy 1, policy_version 1607533 (0.0005) [2023-12-26 12:31:00,777][123090] Updated weights for policy 1, policy_version 1607543 (0.0005) [2023-12-26 12:31:00,873][123091] Updated weights for policy 0, policy_version 1618200 (0.0005) [2023-12-26 12:31:00,927][123091] Updated weights for policy 0, policy_version 1618210 (0.0005) [2023-12-26 12:31:00,975][123091] Updated weights for policy 0, policy_version 1618220 (0.0006) [2023-12-26 12:31:01,617][123090] Updated weights for policy 1, policy_version 1607553 (0.0007) [2023-12-26 12:31:01,687][123090] Updated weights for policy 1, policy_version 1607563 (0.0010) [2023-12-26 12:31:01,759][123090] Updated weights for policy 1, policy_version 1607573 (0.0010) [2023-12-26 12:31:01,770][123091] Updated weights for policy 0, policy_version 1618230 (0.0008) [2023-12-26 12:31:01,809][123090] Updated weights for policy 1, policy_version 1607583 (0.0007) [2023-12-26 12:31:01,825][123091] Updated weights for policy 0, policy_version 1618240 (0.0010) [2023-12-26 12:31:01,868][123091] Updated weights for policy 0, policy_version 1618250 (0.0010) [2023-12-26 12:31:02,574][123091] Updated weights for policy 0, policy_version 1618260 (0.0011) [2023-12-26 12:31:02,643][123091] Updated weights for policy 0, policy_version 1618270 (0.0006) [2023-12-26 12:31:02,701][123090] Updated weights for policy 1, policy_version 1607593 (0.0008) [2023-12-26 12:31:02,702][123091] Updated weights for policy 0, policy_version 1618280 (0.0009) [2023-12-26 12:31:02,771][123090] Updated weights for policy 1, policy_version 1607603 (0.0009) [2023-12-26 12:31:02,839][123090] Updated weights for policy 1, policy_version 1607613 (0.0009) [2023-12-26 12:31:03,371][123091] Updated weights for policy 0, policy_version 1618290 (0.0006) [2023-12-26 12:31:03,419][123091] Updated weights for policy 0, policy_version 1618300 (0.0005) [2023-12-26 12:31:03,467][123091] Updated weights for policy 0, policy_version 1618310 (0.0005) [2023-12-26 12:31:03,515][123091] Updated weights for policy 0, policy_version 1618320 (0.0005) [2023-12-26 12:31:03,639][123090] Updated weights for policy 1, policy_version 1607623 (0.0010) [2023-12-26 12:31:03,703][123090] Updated weights for policy 1, policy_version 1607633 (0.0007) [2023-12-26 12:31:03,755][123090] Updated weights for policy 1, policy_version 1607643 (0.0007) [2023-12-26 12:31:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 825851904. Throughput: 0: 8866.9, 1: 8580.4. Samples: 825858656. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:03,785][121949] Avg episode reward: [(0, '6191.810'), (1, '5829.058')] [2023-12-26 12:31:04,356][123091] Updated weights for policy 0, policy_version 1618330 (0.0011) [2023-12-26 12:31:04,416][123091] Updated weights for policy 0, policy_version 1618340 (0.0011) [2023-12-26 12:31:04,477][123091] Updated weights for policy 0, policy_version 1618350 (0.0011) [2023-12-26 12:31:04,513][123090] Updated weights for policy 1, policy_version 1607653 (0.0008) [2023-12-26 12:31:04,584][123090] Updated weights for policy 1, policy_version 1607663 (0.0011) [2023-12-26 12:31:04,650][123090] Updated weights for policy 1, policy_version 1607673 (0.0011) [2023-12-26 12:31:05,230][123091] Updated weights for policy 0, policy_version 1618360 (0.0010) [2023-12-26 12:31:05,289][123091] Updated weights for policy 0, policy_version 1618370 (0.0010) [2023-12-26 12:31:05,349][123091] Updated weights for policy 0, policy_version 1618380 (0.0010) [2023-12-26 12:31:05,404][123090] Updated weights for policy 1, policy_version 1607683 (0.0008) [2023-12-26 12:31:05,454][123090] Updated weights for policy 1, policy_version 1607693 (0.0005) [2023-12-26 12:31:05,509][123090] Updated weights for policy 1, policy_version 1607703 (0.0005) [2023-12-26 12:31:06,150][123090] Updated weights for policy 1, policy_version 1607713 (0.0006) [2023-12-26 12:31:06,151][123091] Updated weights for policy 0, policy_version 1618390 (0.0011) [2023-12-26 12:31:06,202][123091] Updated weights for policy 0, policy_version 1618400 (0.0011) [2023-12-26 12:31:06,217][123090] Updated weights for policy 1, policy_version 1607723 (0.0011) [2023-12-26 12:31:06,262][123091] Updated weights for policy 0, policy_version 1618410 (0.0011) [2023-12-26 12:31:06,282][123090] Updated weights for policy 1, policy_version 1607733 (0.0011) [2023-12-26 12:31:06,326][123090] Updated weights for policy 1, policy_version 1607743 (0.0010) [2023-12-26 12:31:07,106][123091] Updated weights for policy 0, policy_version 1618420 (0.0011) [2023-12-26 12:31:07,169][123091] Updated weights for policy 0, policy_version 1618430 (0.0010) [2023-12-26 12:31:07,173][123090] Updated weights for policy 1, policy_version 1607753 (0.0010) [2023-12-26 12:31:07,228][123091] Updated weights for policy 0, policy_version 1618440 (0.0010) [2023-12-26 12:31:07,229][123090] Updated weights for policy 1, policy_version 1607763 (0.0010) [2023-12-26 12:31:07,277][123090] Updated weights for policy 1, policy_version 1607773 (0.0010) [2023-12-26 12:31:07,995][123091] Updated weights for policy 0, policy_version 1618450 (0.0010) [2023-12-26 12:31:08,052][123090] Updated weights for policy 1, policy_version 1607783 (0.0006) [2023-12-26 12:31:08,062][123091] Updated weights for policy 0, policy_version 1618460 (0.0010) [2023-12-26 12:31:08,112][123090] Updated weights for policy 1, policy_version 1607793 (0.0006) [2023-12-26 12:31:08,125][123091] Updated weights for policy 0, policy_version 1618470 (0.0010) [2023-12-26 12:31:08,172][123090] Updated weights for policy 1, policy_version 1607803 (0.0009) [2023-12-26 12:31:08,187][123091] Updated weights for policy 0, policy_version 1618480 (0.0010) [2023-12-26 12:31:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 825933824. Throughput: 0: 8904.0, 1: 8619.6. Samples: 825912780. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:08,785][121949] Avg episode reward: [(0, '6214.152'), (1, '5878.140')] [2023-12-26 12:31:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001618480_414334976.pth... [2023-12-26 12:31:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001607808_411598848.pth... [2023-12-26 12:31:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001617456_414072832.pth [2023-12-26 12:31:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001606784_411336704.pth [2023-12-26 12:31:08,837][123090] Updated weights for policy 1, policy_version 1607813 (0.0009) [2023-12-26 12:31:08,893][123090] Updated weights for policy 1, policy_version 1607823 (0.0010) [2023-12-26 12:31:08,944][123091] Updated weights for policy 0, policy_version 1618490 (0.0005) [2023-12-26 12:31:08,953][123090] Updated weights for policy 1, policy_version 1607833 (0.0011) [2023-12-26 12:31:08,998][123091] Updated weights for policy 0, policy_version 1618500 (0.0005) [2023-12-26 12:31:09,061][123091] Updated weights for policy 0, policy_version 1618510 (0.0007) [2023-12-26 12:31:09,814][123090] Updated weights for policy 1, policy_version 1607843 (0.0011) [2023-12-26 12:31:09,880][123091] Updated weights for policy 0, policy_version 1618520 (0.0009) [2023-12-26 12:31:09,887][123090] Updated weights for policy 1, policy_version 1607853 (0.0012) [2023-12-26 12:31:09,945][123091] Updated weights for policy 0, policy_version 1618530 (0.0007) [2023-12-26 12:31:09,960][123090] Updated weights for policy 1, policy_version 1607863 (0.0009) [2023-12-26 12:31:10,013][123091] Updated weights for policy 0, policy_version 1618540 (0.0008) [2023-12-26 12:31:10,779][123090] Updated weights for policy 1, policy_version 1607873 (0.0008) [2023-12-26 12:31:10,849][123090] Updated weights for policy 1, policy_version 1607883 (0.0008) [2023-12-26 12:31:10,856][123091] Updated weights for policy 0, policy_version 1618550 (0.0008) [2023-12-26 12:31:10,909][123090] Updated weights for policy 1, policy_version 1607893 (0.0009) [2023-12-26 12:31:10,911][123091] Updated weights for policy 0, policy_version 1618560 (0.0007) [2023-12-26 12:31:10,969][123091] Updated weights for policy 0, policy_version 1618570 (0.0006) [2023-12-26 12:31:10,973][123090] Updated weights for policy 1, policy_version 1607903 (0.0009) [2023-12-26 12:31:11,804][123090] Updated weights for policy 1, policy_version 1607913 (0.0010) [2023-12-26 12:31:11,861][123091] Updated weights for policy 0, policy_version 1618580 (0.0007) [2023-12-26 12:31:11,864][123090] Updated weights for policy 1, policy_version 1607923 (0.0009) [2023-12-26 12:31:11,918][123091] Updated weights for policy 0, policy_version 1618590 (0.0008) [2023-12-26 12:31:11,919][123090] Updated weights for policy 1, policy_version 1607933 (0.0010) [2023-12-26 12:31:11,979][123091] Updated weights for policy 0, policy_version 1618600 (0.0006) [2023-12-26 12:31:12,784][123091] Updated weights for policy 0, policy_version 1618610 (0.0008) [2023-12-26 12:31:12,813][123090] Updated weights for policy 1, policy_version 1607943 (0.0008) [2023-12-26 12:31:12,837][123091] Updated weights for policy 0, policy_version 1618620 (0.0008) [2023-12-26 12:31:12,881][123090] Updated weights for policy 1, policy_version 1607953 (0.0010) [2023-12-26 12:31:12,897][123091] Updated weights for policy 0, policy_version 1618630 (0.0007) [2023-12-26 12:31:12,934][123090] Updated weights for policy 1, policy_version 1607963 (0.0007) [2023-12-26 12:31:12,952][123091] Updated weights for policy 0, policy_version 1618640 (0.0008) [2023-12-26 12:31:13,656][123090] Updated weights for policy 1, policy_version 1607973 (0.0005) [2023-12-26 12:31:13,725][123090] Updated weights for policy 1, policy_version 1607983 (0.0005) [2023-12-26 12:31:13,780][123091] Updated weights for policy 0, policy_version 1618650 (0.0011) [2023-12-26 12:31:13,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 826015744. Throughput: 0: 8843.6, 1: 8630.4. Samples: 826017196. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:13,785][121949] Avg episode reward: [(0, '6402.107'), (1, '5427.839')] [2023-12-26 12:31:13,792][123090] Updated weights for policy 1, policy_version 1607993 (0.0007) [2023-12-26 12:31:13,837][123091] Updated weights for policy 0, policy_version 1618660 (0.0011) [2023-12-26 12:31:13,896][123091] Updated weights for policy 0, policy_version 1618670 (0.0010) [2023-12-26 12:31:14,539][123090] Updated weights for policy 1, policy_version 1608003 (0.0007) [2023-12-26 12:31:14,601][123090] Updated weights for policy 1, policy_version 1608013 (0.0009) [2023-12-26 12:31:14,664][123090] Updated weights for policy 1, policy_version 1608023 (0.0009) [2023-12-26 12:31:14,713][123091] Updated weights for policy 0, policy_version 1618680 (0.0006) [2023-12-26 12:31:14,772][123091] Updated weights for policy 0, policy_version 1618690 (0.0006) [2023-12-26 12:31:14,835][123091] Updated weights for policy 0, policy_version 1618700 (0.0011) [2023-12-26 12:31:15,546][123091] Updated weights for policy 0, policy_version 1618710 (0.0008) [2023-12-26 12:31:15,565][123090] Updated weights for policy 1, policy_version 1608033 (0.0009) [2023-12-26 12:31:15,603][123091] Updated weights for policy 0, policy_version 1618720 (0.0009) [2023-12-26 12:31:15,631][123090] Updated weights for policy 1, policy_version 1608043 (0.0007) [2023-12-26 12:31:15,658][123091] Updated weights for policy 0, policy_version 1618730 (0.0010) [2023-12-26 12:31:15,691][123090] Updated weights for policy 1, policy_version 1608053 (0.0008) [2023-12-26 12:31:15,755][123090] Updated weights for policy 1, policy_version 1608063 (0.0009) [2023-12-26 12:31:16,354][123091] Updated weights for policy 0, policy_version 1618740 (0.0008) [2023-12-26 12:31:16,411][123091] Updated weights for policy 0, policy_version 1618750 (0.0005) [2023-12-26 12:31:16,466][123091] Updated weights for policy 0, policy_version 1618760 (0.0005) [2023-12-26 12:31:16,497][123090] Updated weights for policy 1, policy_version 1608073 (0.0005) [2023-12-26 12:31:16,552][123090] Updated weights for policy 1, policy_version 1608083 (0.0005) [2023-12-26 12:31:16,615][123090] Updated weights for policy 1, policy_version 1608093 (0.0005) [2023-12-26 12:31:17,163][123091] Updated weights for policy 0, policy_version 1618770 (0.0006) [2023-12-26 12:31:17,229][123091] Updated weights for policy 0, policy_version 1618780 (0.0010) [2023-12-26 12:31:17,298][123091] Updated weights for policy 0, policy_version 1618790 (0.0010) [2023-12-26 12:31:17,304][123090] Updated weights for policy 1, policy_version 1608103 (0.0006) [2023-12-26 12:31:17,349][123091] Updated weights for policy 0, policy_version 1618800 (0.0010) [2023-12-26 12:31:17,356][123090] Updated weights for policy 1, policy_version 1608113 (0.0006) [2023-12-26 12:31:17,412][123090] Updated weights for policy 1, policy_version 1608123 (0.0009) [2023-12-26 12:31:18,050][123091] Updated weights for policy 0, policy_version 1618810 (0.0010) [2023-12-26 12:31:18,097][123091] Updated weights for policy 0, policy_version 1618820 (0.0010) [2023-12-26 12:31:18,141][123091] Updated weights for policy 0, policy_version 1618830 (0.0010) [2023-12-26 12:31:18,285][123090] Updated weights for policy 1, policy_version 1608133 (0.0008) [2023-12-26 12:31:18,337][123090] Updated weights for policy 1, policy_version 1608143 (0.0010) [2023-12-26 12:31:18,398][123090] Updated weights for policy 1, policy_version 1608153 (0.0008) [2023-12-26 12:31:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 826114048. Throughput: 0: 8881.5, 1: 8739.8. Samples: 826125596. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:18,785][121949] Avg episode reward: [(0, '6418.551'), (1, '5386.225')] [2023-12-26 12:31:19,019][123091] Updated weights for policy 0, policy_version 1618840 (0.0009) [2023-12-26 12:31:19,079][123091] Updated weights for policy 0, policy_version 1618850 (0.0009) [2023-12-26 12:31:19,135][123091] Updated weights for policy 0, policy_version 1618860 (0.0009) [2023-12-26 12:31:19,256][123090] Updated weights for policy 1, policy_version 1608163 (0.0009) [2023-12-26 12:31:19,324][123090] Updated weights for policy 1, policy_version 1608173 (0.0011) [2023-12-26 12:31:19,397][123090] Updated weights for policy 1, policy_version 1608183 (0.0010) [2023-12-26 12:31:19,991][123091] Updated weights for policy 0, policy_version 1618870 (0.0010) [2023-12-26 12:31:20,043][123091] Updated weights for policy 0, policy_version 1618880 (0.0009) [2023-12-26 12:31:20,090][123091] Updated weights for policy 0, policy_version 1618890 (0.0006) [2023-12-26 12:31:20,233][123090] Updated weights for policy 1, policy_version 1608193 (0.0010) [2023-12-26 12:31:20,290][123090] Updated weights for policy 1, policy_version 1608203 (0.0009) [2023-12-26 12:31:20,352][123090] Updated weights for policy 1, policy_version 1608213 (0.0009) [2023-12-26 12:31:20,408][123090] Updated weights for policy 1, policy_version 1608223 (0.0009) [2023-12-26 12:31:20,919][123091] Updated weights for policy 0, policy_version 1618900 (0.0007) [2023-12-26 12:31:20,990][123091] Updated weights for policy 0, policy_version 1618910 (0.0010) [2023-12-26 12:31:21,063][123091] Updated weights for policy 0, policy_version 1618920 (0.0009) [2023-12-26 12:31:21,321][123090] Updated weights for policy 1, policy_version 1608233 (0.0009) [2023-12-26 12:31:21,398][123090] Updated weights for policy 1, policy_version 1608243 (0.0009) [2023-12-26 12:31:21,471][123090] Updated weights for policy 1, policy_version 1608253 (0.0009) [2023-12-26 12:31:21,842][123091] Updated weights for policy 0, policy_version 1618930 (0.0009) [2023-12-26 12:31:21,905][123091] Updated weights for policy 0, policy_version 1618940 (0.0008) [2023-12-26 12:31:21,957][123091] Updated weights for policy 0, policy_version 1618950 (0.0008) [2023-12-26 12:31:22,014][123091] Updated weights for policy 0, policy_version 1618960 (0.0006) [2023-12-26 12:31:22,373][123090] Updated weights for policy 1, policy_version 1608263 (0.0009) [2023-12-26 12:31:22,429][123090] Updated weights for policy 1, policy_version 1608273 (0.0010) [2023-12-26 12:31:22,490][123090] Updated weights for policy 1, policy_version 1608283 (0.0009) [2023-12-26 12:31:22,779][123091] Updated weights for policy 0, policy_version 1618970 (0.0006) [2023-12-26 12:31:22,835][123091] Updated weights for policy 0, policy_version 1618980 (0.0006) [2023-12-26 12:31:22,899][123091] Updated weights for policy 0, policy_version 1618990 (0.0011) [2023-12-26 12:31:23,398][123090] Updated weights for policy 1, policy_version 1608293 (0.0010) [2023-12-26 12:31:23,467][123090] Updated weights for policy 1, policy_version 1608303 (0.0010) [2023-12-26 12:31:23,525][123090] Updated weights for policy 1, policy_version 1608313 (0.0010) [2023-12-26 12:31:23,596][123091] Updated weights for policy 0, policy_version 1619000 (0.0008) [2023-12-26 12:31:23,643][123091] Updated weights for policy 0, policy_version 1619010 (0.0010) [2023-12-26 12:31:23,695][123091] Updated weights for policy 0, policy_version 1619020 (0.0009) [2023-12-26 12:31:23,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 826204160. Throughput: 0: 8833.2, 1: 8706.9. Samples: 826175416. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:23,785][121949] Avg episode reward: [(0, '6344.601'), (1, '5647.750')] [2023-12-26 12:31:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001619024_414474240.pth... [2023-12-26 12:31:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001608320_411729920.pth... [2023-12-26 12:31:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001607296_411467776.pth [2023-12-26 12:31:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001617968_414203904.pth [2023-12-26 12:31:24,411][123090] Updated weights for policy 1, policy_version 1608323 (0.0008) [2023-12-26 12:31:24,479][123090] Updated weights for policy 1, policy_version 1608333 (0.0006) [2023-12-26 12:31:24,486][123091] Updated weights for policy 0, policy_version 1619030 (0.0008) [2023-12-26 12:31:24,544][123090] Updated weights for policy 1, policy_version 1608343 (0.0008) [2023-12-26 12:31:24,546][123091] Updated weights for policy 0, policy_version 1619040 (0.0008) [2023-12-26 12:31:24,617][123091] Updated weights for policy 0, policy_version 1619050 (0.0009) [2023-12-26 12:31:25,299][123091] Updated weights for policy 0, policy_version 1619060 (0.0008) [2023-12-26 12:31:25,309][123090] Updated weights for policy 1, policy_version 1608353 (0.0006) [2023-12-26 12:31:25,350][123091] Updated weights for policy 0, policy_version 1619070 (0.0005) [2023-12-26 12:31:25,363][123090] Updated weights for policy 1, policy_version 1608363 (0.0005) [2023-12-26 12:31:25,416][123091] Updated weights for policy 0, policy_version 1619080 (0.0005) [2023-12-26 12:31:25,424][123090] Updated weights for policy 1, policy_version 1608373 (0.0005) [2023-12-26 12:31:25,483][123090] Updated weights for policy 1, policy_version 1608383 (0.0005) [2023-12-26 12:31:26,138][123091] Updated weights for policy 0, policy_version 1619090 (0.0007) [2023-12-26 12:31:26,163][123090] Updated weights for policy 1, policy_version 1608393 (0.0007) [2023-12-26 12:31:26,196][123091] Updated weights for policy 0, policy_version 1619100 (0.0009) [2023-12-26 12:31:26,222][123090] Updated weights for policy 1, policy_version 1608403 (0.0008) [2023-12-26 12:31:26,245][123091] Updated weights for policy 0, policy_version 1619110 (0.0009) [2023-12-26 12:31:26,278][123090] Updated weights for policy 1, policy_version 1608413 (0.0009) [2023-12-26 12:31:26,294][123091] Updated weights for policy 0, policy_version 1619120 (0.0007) [2023-12-26 12:31:27,028][123090] Updated weights for policy 1, policy_version 1608423 (0.0009) [2023-12-26 12:31:27,085][123090] Updated weights for policy 1, policy_version 1608434 (0.0009) [2023-12-26 12:31:27,147][123090] Updated weights for policy 1, policy_version 1608444 (0.0008) [2023-12-26 12:31:27,163][123091] Updated weights for policy 0, policy_version 1619130 (0.0009) [2023-12-26 12:31:27,216][123091] Updated weights for policy 0, policy_version 1619140 (0.0009) [2023-12-26 12:31:27,270][123091] Updated weights for policy 0, policy_version 1619150 (0.0010) [2023-12-26 12:31:27,991][123090] Updated weights for policy 1, policy_version 1608454 (0.0008) [2023-12-26 12:31:28,014][123091] Updated weights for policy 0, policy_version 1619160 (0.0008) [2023-12-26 12:31:28,047][123090] Updated weights for policy 1, policy_version 1608464 (0.0008) [2023-12-26 12:31:28,066][123091] Updated weights for policy 0, policy_version 1619170 (0.0008) [2023-12-26 12:31:28,107][123090] Updated weights for policy 1, policy_version 1608474 (0.0009) [2023-12-26 12:31:28,113][123091] Updated weights for policy 0, policy_version 1619180 (0.0007) [2023-12-26 12:31:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 826286080. Throughput: 0: 8975.5, 1: 8703.3. Samples: 826282476. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:28,785][121949] Avg episode reward: [(0, '6219.728'), (1, '5697.062')] [2023-12-26 12:31:28,825][123091] Updated weights for policy 0, policy_version 1619190 (0.0008) [2023-12-26 12:31:28,879][123091] Updated weights for policy 0, policy_version 1619200 (0.0010) [2023-12-26 12:31:28,945][123091] Updated weights for policy 0, policy_version 1619210 (0.0009) [2023-12-26 12:31:28,967][123090] Updated weights for policy 1, policy_version 1608484 (0.0009) [2023-12-26 12:31:29,026][123090] Updated weights for policy 1, policy_version 1608494 (0.0009) [2023-12-26 12:31:29,083][123090] Updated weights for policy 1, policy_version 1608504 (0.0009) [2023-12-26 12:31:29,767][123091] Updated weights for policy 0, policy_version 1619220 (0.0008) [2023-12-26 12:31:29,824][123091] Updated weights for policy 0, policy_version 1619230 (0.0009) [2023-12-26 12:31:29,898][123091] Updated weights for policy 0, policy_version 1619240 (0.0009) [2023-12-26 12:31:29,921][123090] Updated weights for policy 1, policy_version 1608514 (0.0009) [2023-12-26 12:31:29,986][123090] Updated weights for policy 1, policy_version 1608524 (0.0007) [2023-12-26 12:31:30,050][123090] Updated weights for policy 1, policy_version 1608534 (0.0005) [2023-12-26 12:31:30,109][123090] Updated weights for policy 1, policy_version 1608544 (0.0007) [2023-12-26 12:31:30,735][123091] Updated weights for policy 0, policy_version 1619250 (0.0007) [2023-12-26 12:31:30,799][123091] Updated weights for policy 0, policy_version 1619260 (0.0008) [2023-12-26 12:31:30,835][123090] Updated weights for policy 1, policy_version 1608554 (0.0008) [2023-12-26 12:31:30,847][123091] Updated weights for policy 0, policy_version 1619270 (0.0008) [2023-12-26 12:31:30,902][123090] Updated weights for policy 1, policy_version 1608564 (0.0009) [2023-12-26 12:31:30,903][123091] Updated weights for policy 0, policy_version 1619280 (0.0008) [2023-12-26 12:31:30,966][123090] Updated weights for policy 1, policy_version 1608574 (0.0008) [2023-12-26 12:31:31,720][123091] Updated weights for policy 0, policy_version 1619290 (0.0009) [2023-12-26 12:31:31,785][123091] Updated weights for policy 0, policy_version 1619300 (0.0007) [2023-12-26 12:31:31,796][123090] Updated weights for policy 1, policy_version 1608584 (0.0008) [2023-12-26 12:31:31,848][123091] Updated weights for policy 0, policy_version 1619310 (0.0009) [2023-12-26 12:31:31,849][123090] Updated weights for policy 1, policy_version 1608594 (0.0007) [2023-12-26 12:31:31,909][123090] Updated weights for policy 1, policy_version 1608604 (0.0010) [2023-12-26 12:31:32,677][123090] Updated weights for policy 1, policy_version 1608614 (0.0007) [2023-12-26 12:31:32,712][123091] Updated weights for policy 0, policy_version 1619320 (0.0008) [2023-12-26 12:31:32,734][123090] Updated weights for policy 1, policy_version 1608624 (0.0007) [2023-12-26 12:31:32,771][123091] Updated weights for policy 0, policy_version 1619330 (0.0006) [2023-12-26 12:31:32,781][123090] Updated weights for policy 1, policy_version 1608634 (0.0010) [2023-12-26 12:31:32,827][123091] Updated weights for policy 0, policy_version 1619340 (0.0008) [2023-12-26 12:31:33,569][123090] Updated weights for policy 1, policy_version 1608644 (0.0010) [2023-12-26 12:31:33,614][123090] Updated weights for policy 1, policy_version 1608654 (0.0008) [2023-12-26 12:31:33,664][123090] Updated weights for policy 1, policy_version 1608664 (0.0005) [2023-12-26 12:31:33,681][123091] Updated weights for policy 0, policy_version 1619350 (0.0008) [2023-12-26 12:31:33,747][123091] Updated weights for policy 0, policy_version 1619360 (0.0010) [2023-12-26 12:31:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 826376192. Throughput: 0: 8978.3, 1: 8701.1. Samples: 826387804. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:33,785][121949] Avg episode reward: [(0, '6240.138'), (1, '5539.073')] [2023-12-26 12:31:33,806][123091] Updated weights for policy 0, policy_version 1619371 (0.0011) [2023-12-26 12:31:34,378][123090] Updated weights for policy 1, policy_version 1608674 (0.0006) [2023-12-26 12:31:34,448][123090] Updated weights for policy 1, policy_version 1608684 (0.0008) [2023-12-26 12:31:34,520][123090] Updated weights for policy 1, policy_version 1608694 (0.0009) [2023-12-26 12:31:34,591][123090] Updated weights for policy 1, policy_version 1608704 (0.0011) [2023-12-26 12:31:34,696][123091] Updated weights for policy 0, policy_version 1619381 (0.0009) [2023-12-26 12:31:34,762][123091] Updated weights for policy 0, policy_version 1619391 (0.0010) [2023-12-26 12:31:34,820][123091] Updated weights for policy 0, policy_version 1619401 (0.0009) [2023-12-26 12:31:35,358][123090] Updated weights for policy 1, policy_version 1608714 (0.0010) [2023-12-26 12:31:35,420][123090] Updated weights for policy 1, policy_version 1608724 (0.0010) [2023-12-26 12:31:35,482][123090] Updated weights for policy 1, policy_version 1608734 (0.0010) [2023-12-26 12:31:35,661][123091] Updated weights for policy 0, policy_version 1619411 (0.0010) [2023-12-26 12:31:35,717][123091] Updated weights for policy 0, policy_version 1619421 (0.0009) [2023-12-26 12:31:35,785][123091] Updated weights for policy 0, policy_version 1619431 (0.0009) [2023-12-26 12:31:36,242][123090] Updated weights for policy 1, policy_version 1608744 (0.0006) [2023-12-26 12:31:36,305][123090] Updated weights for policy 1, policy_version 1608754 (0.0006) [2023-12-26 12:31:36,375][123090] Updated weights for policy 1, policy_version 1608764 (0.0010) [2023-12-26 12:31:36,643][123091] Updated weights for policy 0, policy_version 1619441 (0.0009) [2023-12-26 12:31:36,708][123091] Updated weights for policy 0, policy_version 1619451 (0.0009) [2023-12-26 12:31:36,774][123091] Updated weights for policy 0, policy_version 1619461 (0.0009) [2023-12-26 12:31:36,843][123091] Updated weights for policy 0, policy_version 1619471 (0.0007) [2023-12-26 12:31:37,168][123090] Updated weights for policy 1, policy_version 1608774 (0.0011) [2023-12-26 12:31:37,224][123090] Updated weights for policy 1, policy_version 1608784 (0.0010) [2023-12-26 12:31:37,277][123090] Updated weights for policy 1, policy_version 1608794 (0.0005) [2023-12-26 12:31:37,514][123091] Updated weights for policy 0, policy_version 1619481 (0.0005) [2023-12-26 12:31:37,569][123091] Updated weights for policy 0, policy_version 1619491 (0.0005) [2023-12-26 12:31:37,624][123091] Updated weights for policy 0, policy_version 1619501 (0.0005) [2023-12-26 12:31:37,971][123090] Updated weights for policy 1, policy_version 1608804 (0.0005) [2023-12-26 12:31:38,022][123090] Updated weights for policy 1, policy_version 1608814 (0.0007) [2023-12-26 12:31:38,078][123090] Updated weights for policy 1, policy_version 1608824 (0.0011) [2023-12-26 12:31:38,387][123091] Updated weights for policy 0, policy_version 1619511 (0.0008) [2023-12-26 12:31:38,435][123091] Updated weights for policy 0, policy_version 1619521 (0.0009) [2023-12-26 12:31:38,491][123091] Updated weights for policy 0, policy_version 1619531 (0.0009) [2023-12-26 12:31:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 826466304. Throughput: 0: 8969.9, 1: 8761.3. Samples: 826440384. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:38,785][121949] Avg episode reward: [(0, '6293.109'), (1, '5497.660')] [2023-12-26 12:31:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001619536_414605312.pth... [2023-12-26 12:31:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001608832_411860992.pth... [2023-12-26 12:31:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001607808_411598848.pth [2023-12-26 12:31:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001618480_414334976.pth [2023-12-26 12:31:38,920][123090] Updated weights for policy 1, policy_version 1608834 (0.0011) [2023-12-26 12:31:38,992][123090] Updated weights for policy 1, policy_version 1608844 (0.0011) [2023-12-26 12:31:39,059][123090] Updated weights for policy 1, policy_version 1608854 (0.0011) [2023-12-26 12:31:39,124][123090] Updated weights for policy 1, policy_version 1608864 (0.0010) [2023-12-26 12:31:39,364][123091] Updated weights for policy 0, policy_version 1619541 (0.0009) [2023-12-26 12:31:39,436][123091] Updated weights for policy 0, policy_version 1619551 (0.0008) [2023-12-26 12:31:39,510][123091] Updated weights for policy 0, policy_version 1619561 (0.0009) [2023-12-26 12:31:39,970][123090] Updated weights for policy 1, policy_version 1608874 (0.0010) [2023-12-26 12:31:40,034][123090] Updated weights for policy 1, policy_version 1608884 (0.0011) [2023-12-26 12:31:40,098][123090] Updated weights for policy 1, policy_version 1608894 (0.0011) [2023-12-26 12:31:40,308][123091] Updated weights for policy 0, policy_version 1619571 (0.0008) [2023-12-26 12:31:40,371][123091] Updated weights for policy 0, policy_version 1619581 (0.0005) [2023-12-26 12:31:40,424][123091] Updated weights for policy 0, policy_version 1619591 (0.0006) [2023-12-26 12:31:40,929][123090] Updated weights for policy 1, policy_version 1608904 (0.0010) [2023-12-26 12:31:40,993][123090] Updated weights for policy 1, policy_version 1608914 (0.0010) [2023-12-26 12:31:41,058][123090] Updated weights for policy 1, policy_version 1608924 (0.0008) [2023-12-26 12:31:41,205][123091] Updated weights for policy 0, policy_version 1619601 (0.0009) [2023-12-26 12:31:41,278][123091] Updated weights for policy 0, policy_version 1619611 (0.0009) [2023-12-26 12:31:41,335][123091] Updated weights for policy 0, policy_version 1619621 (0.0009) [2023-12-26 12:31:41,406][123091] Updated weights for policy 0, policy_version 1619631 (0.0010) [2023-12-26 12:31:41,881][123090] Updated weights for policy 1, policy_version 1608934 (0.0008) [2023-12-26 12:31:41,947][123090] Updated weights for policy 1, policy_version 1608944 (0.0008) [2023-12-26 12:31:42,011][123090] Updated weights for policy 1, policy_version 1608954 (0.0010) [2023-12-26 12:31:42,271][123091] Updated weights for policy 0, policy_version 1619641 (0.0010) [2023-12-26 12:31:42,333][123091] Updated weights for policy 0, policy_version 1619651 (0.0009) [2023-12-26 12:31:42,397][123091] Updated weights for policy 0, policy_version 1619661 (0.0009) [2023-12-26 12:31:42,812][123090] Updated weights for policy 1, policy_version 1608964 (0.0009) [2023-12-26 12:31:42,876][123090] Updated weights for policy 1, policy_version 1608974 (0.0007) [2023-12-26 12:31:42,942][123090] Updated weights for policy 1, policy_version 1608984 (0.0005) [2023-12-26 12:31:43,251][123091] Updated weights for policy 0, policy_version 1619671 (0.0008) [2023-12-26 12:31:43,306][123091] Updated weights for policy 0, policy_version 1619681 (0.0009) [2023-12-26 12:31:43,372][123091] Updated weights for policy 0, policy_version 1619691 (0.0009) [2023-12-26 12:31:43,730][123090] Updated weights for policy 1, policy_version 1608994 (0.0006) [2023-12-26 12:31:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 826548224. Throughput: 0: 8890.5, 1: 8715.3. Samples: 826544888. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:43,785][121949] Avg episode reward: [(0, '6228.069'), (1, '5395.219')] [2023-12-26 12:31:43,794][123090] Updated weights for policy 1, policy_version 1609004 (0.0009) [2023-12-26 12:31:43,860][123090] Updated weights for policy 1, policy_version 1609014 (0.0009) [2023-12-26 12:31:43,926][123090] Updated weights for policy 1, policy_version 1609024 (0.0009) [2023-12-26 12:31:44,097][123091] Updated weights for policy 0, policy_version 1619701 (0.0008) [2023-12-26 12:31:44,147][123091] Updated weights for policy 0, policy_version 1619711 (0.0008) [2023-12-26 12:31:44,204][123091] Updated weights for policy 0, policy_version 1619721 (0.0009) [2023-12-26 12:31:44,760][123090] Updated weights for policy 1, policy_version 1609034 (0.0006) [2023-12-26 12:31:44,826][123090] Updated weights for policy 1, policy_version 1609044 (0.0007) [2023-12-26 12:31:44,887][123090] Updated weights for policy 1, policy_version 1609054 (0.0006) [2023-12-26 12:31:45,053][123091] Updated weights for policy 0, policy_version 1619731 (0.0009) [2023-12-26 12:31:45,118][123091] Updated weights for policy 0, policy_version 1619741 (0.0010) [2023-12-26 12:31:45,186][123091] Updated weights for policy 0, policy_version 1619751 (0.0010) [2023-12-26 12:31:45,630][123090] Updated weights for policy 1, policy_version 1609064 (0.0006) [2023-12-26 12:31:45,701][123090] Updated weights for policy 1, policy_version 1609074 (0.0005) [2023-12-26 12:31:45,765][123090] Updated weights for policy 1, policy_version 1609084 (0.0008) [2023-12-26 12:31:46,072][123091] Updated weights for policy 0, policy_version 1619761 (0.0009) [2023-12-26 12:31:46,124][123091] Updated weights for policy 0, policy_version 1619771 (0.0010) [2023-12-26 12:31:46,177][123091] Updated weights for policy 0, policy_version 1619781 (0.0005) [2023-12-26 12:31:46,228][123091] Updated weights for policy 0, policy_version 1619791 (0.0005) [2023-12-26 12:31:46,459][123090] Updated weights for policy 1, policy_version 1609094 (0.0011) [2023-12-26 12:31:46,514][123090] Updated weights for policy 1, policy_version 1609104 (0.0010) [2023-12-26 12:31:46,565][123090] Updated weights for policy 1, policy_version 1609114 (0.0010) [2023-12-26 12:31:47,005][123091] Updated weights for policy 0, policy_version 1619801 (0.0010) [2023-12-26 12:31:47,057][123091] Updated weights for policy 0, policy_version 1619811 (0.0010) [2023-12-26 12:31:47,115][123091] Updated weights for policy 0, policy_version 1619821 (0.0007) [2023-12-26 12:31:47,397][123090] Updated weights for policy 1, policy_version 1609124 (0.0010) [2023-12-26 12:31:47,456][123090] Updated weights for policy 1, policy_version 1609134 (0.0010) [2023-12-26 12:31:47,511][123090] Updated weights for policy 1, policy_version 1609144 (0.0010) [2023-12-26 12:31:47,938][123091] Updated weights for policy 0, policy_version 1619831 (0.0010) [2023-12-26 12:31:48,004][123091] Updated weights for policy 0, policy_version 1619841 (0.0011) [2023-12-26 12:31:48,063][123091] Updated weights for policy 0, policy_version 1619851 (0.0010) [2023-12-26 12:31:48,301][123090] Updated weights for policy 1, policy_version 1609154 (0.0010) [2023-12-26 12:31:48,368][123090] Updated weights for policy 1, policy_version 1609164 (0.0011) [2023-12-26 12:31:48,435][123090] Updated weights for policy 1, policy_version 1609174 (0.0011) [2023-12-26 12:31:48,505][123090] Updated weights for policy 1, policy_version 1609184 (0.0011) [2023-12-26 12:31:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 826638336. Throughput: 0: 8812.3, 1: 8789.5. Samples: 826650740. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:48,785][121949] Avg episode reward: [(0, '6233.074'), (1, '5451.244')] [2023-12-26 12:31:48,895][123091] Updated weights for policy 0, policy_version 1619861 (0.0011) [2023-12-26 12:31:48,965][123091] Updated weights for policy 0, policy_version 1619871 (0.0011) [2023-12-26 12:31:49,028][123091] Updated weights for policy 0, policy_version 1619881 (0.0011) [2023-12-26 12:31:49,290][123090] Updated weights for policy 1, policy_version 1609194 (0.0008) [2023-12-26 12:31:49,360][123090] Updated weights for policy 1, policy_version 1609204 (0.0007) [2023-12-26 12:31:49,426][123090] Updated weights for policy 1, policy_version 1609214 (0.0006) [2023-12-26 12:31:49,891][123091] Updated weights for policy 0, policy_version 1619891 (0.0010) [2023-12-26 12:31:49,968][123091] Updated weights for policy 0, policy_version 1619901 (0.0009) [2023-12-26 12:31:50,030][123091] Updated weights for policy 0, policy_version 1619911 (0.0007) [2023-12-26 12:31:50,138][123090] Updated weights for policy 1, policy_version 1609224 (0.0006) [2023-12-26 12:31:50,208][123090] Updated weights for policy 1, policy_version 1609234 (0.0008) [2023-12-26 12:31:50,274][123090] Updated weights for policy 1, policy_version 1609244 (0.0009) [2023-12-26 12:31:50,857][123091] Updated weights for policy 0, policy_version 1619921 (0.0009) [2023-12-26 12:31:50,919][123091] Updated weights for policy 0, policy_version 1619931 (0.0008) [2023-12-26 12:31:50,930][123090] Updated weights for policy 1, policy_version 1609254 (0.0009) [2023-12-26 12:31:50,972][123091] Updated weights for policy 0, policy_version 1619941 (0.0007) [2023-12-26 12:31:50,995][123090] Updated weights for policy 1, policy_version 1609264 (0.0008) [2023-12-26 12:31:51,032][123091] Updated weights for policy 0, policy_version 1619951 (0.0008) [2023-12-26 12:31:51,070][123090] Updated weights for policy 1, policy_version 1609274 (0.0007) [2023-12-26 12:31:51,725][123090] Updated weights for policy 1, policy_version 1609284 (0.0006) [2023-12-26 12:31:51,794][123090] Updated weights for policy 1, policy_version 1609294 (0.0010) [2023-12-26 12:31:51,847][123091] Updated weights for policy 0, policy_version 1619961 (0.0009) [2023-12-26 12:31:51,860][123090] Updated weights for policy 1, policy_version 1609304 (0.0008) [2023-12-26 12:31:51,920][123091] Updated weights for policy 0, policy_version 1619971 (0.0008) [2023-12-26 12:31:51,998][123091] Updated weights for policy 0, policy_version 1619981 (0.0010) [2023-12-26 12:31:52,637][123090] Updated weights for policy 1, policy_version 1609314 (0.0007) [2023-12-26 12:31:52,698][123090] Updated weights for policy 1, policy_version 1609324 (0.0009) [2023-12-26 12:31:52,762][123090] Updated weights for policy 1, policy_version 1609334 (0.0010) [2023-12-26 12:31:52,814][123090] Updated weights for policy 1, policy_version 1609344 (0.0006) [2023-12-26 12:31:52,820][123091] Updated weights for policy 0, policy_version 1619991 (0.0009) [2023-12-26 12:31:52,874][123091] Updated weights for policy 0, policy_version 1620001 (0.0010) [2023-12-26 12:31:52,925][123091] Updated weights for policy 0, policy_version 1620011 (0.0009) [2023-12-26 12:31:53,506][123090] Updated weights for policy 1, policy_version 1609354 (0.0006) [2023-12-26 12:31:53,560][123090] Updated weights for policy 1, policy_version 1609364 (0.0006) [2023-12-26 12:31:53,620][123090] Updated weights for policy 1, policy_version 1609374 (0.0006) [2023-12-26 12:31:53,760][123091] Updated weights for policy 0, policy_version 1620021 (0.0007) [2023-12-26 12:31:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 826728448. Throughput: 0: 8787.1, 1: 8805.4. Samples: 826704440. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:53,785][121949] Avg episode reward: [(0, '6207.273'), (1, '5719.386')] [2023-12-26 12:31:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001609376_412000256.pth... [2023-12-26 12:31:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001608320_411729920.pth [2023-12-26 12:31:53,809][123091] Updated weights for policy 0, policy_version 1620031 (0.0006) [2023-12-26 12:31:53,855][123091] Updated weights for policy 0, policy_version 1620041 (0.0005) [2023-12-26 12:31:53,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001620048_414736384.pth... [2023-12-26 12:31:53,891][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001619024_414474240.pth [2023-12-26 12:31:54,268][123090] Updated weights for policy 1, policy_version 1609384 (0.0009) [2023-12-26 12:31:54,334][123090] Updated weights for policy 1, policy_version 1609394 (0.0010) [2023-12-26 12:31:54,389][123090] Updated weights for policy 1, policy_version 1609404 (0.0010) [2023-12-26 12:31:54,613][123091] Updated weights for policy 0, policy_version 1620051 (0.0006) [2023-12-26 12:31:54,678][123091] Updated weights for policy 0, policy_version 1620061 (0.0005) [2023-12-26 12:31:54,744][123091] Updated weights for policy 0, policy_version 1620071 (0.0005) [2023-12-26 12:31:55,190][123090] Updated weights for policy 1, policy_version 1609414 (0.0010) [2023-12-26 12:31:55,244][123090] Updated weights for policy 1, policy_version 1609424 (0.0010) [2023-12-26 12:31:55,314][123090] Updated weights for policy 1, policy_version 1609434 (0.0010) [2023-12-26 12:31:55,404][123091] Updated weights for policy 0, policy_version 1620081 (0.0006) [2023-12-26 12:31:55,473][123091] Updated weights for policy 0, policy_version 1620091 (0.0005) [2023-12-26 12:31:55,543][123091] Updated weights for policy 0, policy_version 1620101 (0.0008) [2023-12-26 12:31:55,605][123091] Updated weights for policy 0, policy_version 1620111 (0.0010) [2023-12-26 12:31:55,997][123090] Updated weights for policy 1, policy_version 1609444 (0.0008) [2023-12-26 12:31:56,065][123090] Updated weights for policy 1, policy_version 1609454 (0.0007) [2023-12-26 12:31:56,138][123090] Updated weights for policy 1, policy_version 1609464 (0.0007) [2023-12-26 12:31:56,327][123091] Updated weights for policy 0, policy_version 1620121 (0.0010) [2023-12-26 12:31:56,395][123091] Updated weights for policy 0, policy_version 1620131 (0.0009) [2023-12-26 12:31:56,470][123091] Updated weights for policy 0, policy_version 1620141 (0.0009) [2023-12-26 12:31:56,919][123090] Updated weights for policy 1, policy_version 1609474 (0.0006) [2023-12-26 12:31:56,981][123090] Updated weights for policy 1, policy_version 1609484 (0.0009) [2023-12-26 12:31:57,056][123090] Updated weights for policy 1, policy_version 1609494 (0.0006) [2023-12-26 12:31:57,107][123090] Updated weights for policy 1, policy_version 1609504 (0.0005) [2023-12-26 12:31:57,198][123091] Updated weights for policy 0, policy_version 1620151 (0.0007) [2023-12-26 12:31:57,245][123091] Updated weights for policy 0, policy_version 1620161 (0.0005) [2023-12-26 12:31:57,315][123091] Updated weights for policy 0, policy_version 1620171 (0.0009) [2023-12-26 12:31:57,748][123090] Updated weights for policy 1, policy_version 1609514 (0.0005) [2023-12-26 12:31:57,798][123090] Updated weights for policy 1, policy_version 1609524 (0.0005) [2023-12-26 12:31:57,861][123090] Updated weights for policy 1, policy_version 1609534 (0.0006) [2023-12-26 12:31:57,959][123091] Updated weights for policy 0, policy_version 1620181 (0.0007) [2023-12-26 12:31:58,006][123091] Updated weights for policy 0, policy_version 1620191 (0.0005) [2023-12-26 12:31:58,057][123091] Updated weights for policy 0, policy_version 1620201 (0.0006) [2023-12-26 12:31:58,757][123090] Updated weights for policy 1, policy_version 1609544 (0.0009) [2023-12-26 12:31:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 826818560. Throughput: 0: 8865.8, 1: 8908.4. Samples: 826817032. Policy #0 lag: (min: 31.0, avg: 34.5, max: 63.0) [2023-12-26 12:31:58,785][121949] Avg episode reward: [(0, '6180.240'), (1, '5659.087')] [2023-12-26 12:31:58,835][123090] Updated weights for policy 1, policy_version 1609554 (0.0010) [2023-12-26 12:31:58,900][123090] Updated weights for policy 1, policy_version 1609564 (0.0010) [2023-12-26 12:31:58,977][123091] Updated weights for policy 0, policy_version 1620211 (0.0010) [2023-12-26 12:31:59,048][123091] Updated weights for policy 0, policy_version 1620221 (0.0008) [2023-12-26 12:31:59,121][123091] Updated weights for policy 0, policy_version 1620231 (0.0008) [2023-12-26 12:31:59,714][123090] Updated weights for policy 1, policy_version 1609574 (0.0010) [2023-12-26 12:31:59,767][123090] Updated weights for policy 1, policy_version 1609584 (0.0009) [2023-12-26 12:31:59,830][123090] Updated weights for policy 1, policy_version 1609594 (0.0009) [2023-12-26 12:31:59,878][123091] Updated weights for policy 0, policy_version 1620241 (0.0008) [2023-12-26 12:31:59,947][123091] Updated weights for policy 0, policy_version 1620251 (0.0010) [2023-12-26 12:32:00,009][123091] Updated weights for policy 0, policy_version 1620261 (0.0009) [2023-12-26 12:32:00,060][123091] Updated weights for policy 0, policy_version 1620271 (0.0010) [2023-12-26 12:32:00,622][123090] Updated weights for policy 1, policy_version 1609604 (0.0007) [2023-12-26 12:32:00,676][123090] Updated weights for policy 1, policy_version 1609614 (0.0005) [2023-12-26 12:32:00,731][123090] Updated weights for policy 1, policy_version 1609624 (0.0005) [2023-12-26 12:32:00,901][123091] Updated weights for policy 0, policy_version 1620281 (0.0006) [2023-12-26 12:32:00,959][123091] Updated weights for policy 0, policy_version 1620291 (0.0007) [2023-12-26 12:32:01,024][123091] Updated weights for policy 0, policy_version 1620301 (0.0009) [2023-12-26 12:32:01,453][123090] Updated weights for policy 1, policy_version 1609634 (0.0006) [2023-12-26 12:32:01,506][123090] Updated weights for policy 1, policy_version 1609644 (0.0009) [2023-12-26 12:32:01,555][123090] Updated weights for policy 1, policy_version 1609654 (0.0009) [2023-12-26 12:32:01,614][123090] Updated weights for policy 1, policy_version 1609664 (0.0010) [2023-12-26 12:32:01,765][123091] Updated weights for policy 0, policy_version 1620311 (0.0010) [2023-12-26 12:32:01,824][123091] Updated weights for policy 0, policy_version 1620321 (0.0009) [2023-12-26 12:32:01,893][123091] Updated weights for policy 0, policy_version 1620331 (0.0009) [2023-12-26 12:32:02,507][123090] Updated weights for policy 1, policy_version 1609674 (0.0009) [2023-12-26 12:32:02,579][123090] Updated weights for policy 1, policy_version 1609684 (0.0008) [2023-12-26 12:32:02,633][123091] Updated weights for policy 0, policy_version 1620341 (0.0008) [2023-12-26 12:32:02,636][123090] Updated weights for policy 1, policy_version 1609694 (0.0010) [2023-12-26 12:32:02,688][123091] Updated weights for policy 0, policy_version 1620351 (0.0006) [2023-12-26 12:32:02,745][123091] Updated weights for policy 0, policy_version 1620361 (0.0005) [2023-12-26 12:32:03,489][123090] Updated weights for policy 1, policy_version 1609704 (0.0009) [2023-12-26 12:32:03,501][123091] Updated weights for policy 0, policy_version 1620371 (0.0007) [2023-12-26 12:32:03,548][123090] Updated weights for policy 1, policy_version 1609714 (0.0009) [2023-12-26 12:32:03,564][123091] Updated weights for policy 0, policy_version 1620381 (0.0011) [2023-12-26 12:32:03,604][123090] Updated weights for policy 1, policy_version 1609724 (0.0008) [2023-12-26 12:32:03,618][123091] Updated weights for policy 0, policy_version 1620391 (0.0006) [2023-12-26 12:32:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 826916864. Throughput: 0: 8832.1, 1: 8876.1. Samples: 826922464. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:03,785][121949] Avg episode reward: [(0, '6159.686'), (1, '5605.166')] [2023-12-26 12:32:04,293][123091] Updated weights for policy 0, policy_version 1620401 (0.0006) [2023-12-26 12:32:04,361][123091] Updated weights for policy 0, policy_version 1620411 (0.0009) [2023-12-26 12:32:04,418][123091] Updated weights for policy 0, policy_version 1620421 (0.0011) [2023-12-26 12:32:04,478][123091] Updated weights for policy 0, policy_version 1620431 (0.0011) [2023-12-26 12:32:04,478][123090] Updated weights for policy 1, policy_version 1609734 (0.0008) [2023-12-26 12:32:04,534][123090] Updated weights for policy 1, policy_version 1609744 (0.0005) [2023-12-26 12:32:04,601][123090] Updated weights for policy 1, policy_version 1609754 (0.0006) [2023-12-26 12:32:05,267][123091] Updated weights for policy 0, policy_version 1620441 (0.0010) [2023-12-26 12:32:05,330][123091] Updated weights for policy 0, policy_version 1620451 (0.0011) [2023-12-26 12:32:05,354][123090] Updated weights for policy 1, policy_version 1609764 (0.0008) [2023-12-26 12:32:05,389][123091] Updated weights for policy 0, policy_version 1620461 (0.0011) [2023-12-26 12:32:05,418][123090] Updated weights for policy 1, policy_version 1609774 (0.0006) [2023-12-26 12:32:05,484][123090] Updated weights for policy 1, policy_version 1609784 (0.0009) [2023-12-26 12:32:06,219][123091] Updated weights for policy 0, policy_version 1620471 (0.0011) [2023-12-26 12:32:06,290][123091] Updated weights for policy 0, policy_version 1620481 (0.0011) [2023-12-26 12:32:06,325][123090] Updated weights for policy 1, policy_version 1609794 (0.0009) [2023-12-26 12:32:06,353][123091] Updated weights for policy 0, policy_version 1620491 (0.0011) [2023-12-26 12:32:06,382][123090] Updated weights for policy 1, policy_version 1609804 (0.0006) [2023-12-26 12:32:06,450][123090] Updated weights for policy 1, policy_version 1609814 (0.0009) [2023-12-26 12:32:06,515][123090] Updated weights for policy 1, policy_version 1609824 (0.0009) [2023-12-26 12:32:07,170][123091] Updated weights for policy 0, policy_version 1620501 (0.0011) [2023-12-26 12:32:07,236][123091] Updated weights for policy 0, policy_version 1620511 (0.0011) [2023-12-26 12:32:07,292][123091] Updated weights for policy 0, policy_version 1620521 (0.0011) [2023-12-26 12:32:07,360][123090] Updated weights for policy 1, policy_version 1609834 (0.0007) [2023-12-26 12:32:07,421][123090] Updated weights for policy 1, policy_version 1609844 (0.0009) [2023-12-26 12:32:07,483][123090] Updated weights for policy 1, policy_version 1609854 (0.0009) [2023-12-26 12:32:08,112][123091] Updated weights for policy 0, policy_version 1620531 (0.0011) [2023-12-26 12:32:08,158][123091] Updated weights for policy 0, policy_version 1620541 (0.0010) [2023-12-26 12:32:08,210][123091] Updated weights for policy 0, policy_version 1620551 (0.0010) [2023-12-26 12:32:08,305][123090] Updated weights for policy 1, policy_version 1609864 (0.0008) [2023-12-26 12:32:08,382][123090] Updated weights for policy 1, policy_version 1609874 (0.0009) [2023-12-26 12:32:08,436][123090] Updated weights for policy 1, policy_version 1609884 (0.0009) [2023-12-26 12:32:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 826998784. Throughput: 0: 8861.6, 1: 8914.8. Samples: 826975352. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:08,785][121949] Avg episode reward: [(0, '6219.644'), (1, '5692.100')] [2023-12-26 12:32:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001620560_414867456.pth... [2023-12-26 12:32:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001609888_412131328.pth... [2023-12-26 12:32:08,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001619536_414605312.pth [2023-12-26 12:32:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001608832_411860992.pth [2023-12-26 12:32:09,075][123091] Updated weights for policy 0, policy_version 1620561 (0.0011) [2023-12-26 12:32:09,123][123091] Updated weights for policy 0, policy_version 1620571 (0.0010) [2023-12-26 12:32:09,175][123091] Updated weights for policy 0, policy_version 1620581 (0.0010) [2023-12-26 12:32:09,227][123091] Updated weights for policy 0, policy_version 1620591 (0.0011) [2023-12-26 12:32:09,282][123090] Updated weights for policy 1, policy_version 1609894 (0.0009) [2023-12-26 12:32:09,338][123090] Updated weights for policy 1, policy_version 1609904 (0.0008) [2023-12-26 12:32:09,413][123090] Updated weights for policy 1, policy_version 1609914 (0.0008) [2023-12-26 12:32:10,080][123091] Updated weights for policy 0, policy_version 1620601 (0.0008) [2023-12-26 12:32:10,148][123091] Updated weights for policy 0, policy_version 1620611 (0.0009) [2023-12-26 12:32:10,216][123091] Updated weights for policy 0, policy_version 1620621 (0.0010) [2023-12-26 12:32:10,281][123090] Updated weights for policy 1, policy_version 1609924 (0.0007) [2023-12-26 12:32:10,357][123090] Updated weights for policy 1, policy_version 1609934 (0.0006) [2023-12-26 12:32:10,428][123090] Updated weights for policy 1, policy_version 1609944 (0.0008) [2023-12-26 12:32:10,973][123091] Updated weights for policy 0, policy_version 1620631 (0.0006) [2023-12-26 12:32:11,036][123091] Updated weights for policy 0, policy_version 1620641 (0.0006) [2023-12-26 12:32:11,054][123090] Updated weights for policy 1, policy_version 1609954 (0.0007) [2023-12-26 12:32:11,103][123091] Updated weights for policy 0, policy_version 1620651 (0.0007) [2023-12-26 12:32:11,127][123090] Updated weights for policy 1, policy_version 1609964 (0.0009) [2023-12-26 12:32:11,200][123090] Updated weights for policy 1, policy_version 1609974 (0.0007) [2023-12-26 12:32:11,264][123090] Updated weights for policy 1, policy_version 1609984 (0.0008) [2023-12-26 12:32:11,872][123091] Updated weights for policy 0, policy_version 1620661 (0.0008) [2023-12-26 12:32:11,934][123091] Updated weights for policy 0, policy_version 1620671 (0.0006) [2023-12-26 12:32:12,004][123091] Updated weights for policy 0, policy_version 1620681 (0.0006) [2023-12-26 12:32:12,096][123090] Updated weights for policy 1, policy_version 1609994 (0.0010) [2023-12-26 12:32:12,155][123090] Updated weights for policy 1, policy_version 1610004 (0.0009) [2023-12-26 12:32:12,221][123090] Updated weights for policy 1, policy_version 1610014 (0.0005) [2023-12-26 12:32:12,756][123091] Updated weights for policy 0, policy_version 1620691 (0.0007) [2023-12-26 12:32:12,820][123091] Updated weights for policy 0, policy_version 1620701 (0.0010) [2023-12-26 12:32:12,881][123091] Updated weights for policy 0, policy_version 1620711 (0.0010) [2023-12-26 12:32:12,973][123090] Updated weights for policy 1, policy_version 1610024 (0.0006) [2023-12-26 12:32:13,025][123090] Updated weights for policy 1, policy_version 1610034 (0.0005) [2023-12-26 12:32:13,081][123090] Updated weights for policy 1, policy_version 1610044 (0.0005) [2023-12-26 12:32:13,778][123091] Updated weights for policy 0, policy_version 1620721 (0.0009) [2023-12-26 12:32:13,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 827080704. Throughput: 0: 8808.4, 1: 8912.0. Samples: 827079896. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:13,785][121949] Avg episode reward: [(0, '6306.839'), (1, '5687.145')] [2023-12-26 12:32:13,815][123090] Updated weights for policy 1, policy_version 1610054 (0.0008) [2023-12-26 12:32:13,835][123091] Updated weights for policy 0, policy_version 1620731 (0.0006) [2023-12-26 12:32:13,875][123090] Updated weights for policy 1, policy_version 1610064 (0.0010) [2023-12-26 12:32:13,895][123091] Updated weights for policy 0, policy_version 1620741 (0.0006) [2023-12-26 12:32:13,930][123090] Updated weights for policy 1, policy_version 1610074 (0.0010) [2023-12-26 12:32:13,954][123091] Updated weights for policy 0, policy_version 1620751 (0.0005) [2023-12-26 12:32:14,780][123090] Updated weights for policy 1, policy_version 1610084 (0.0010) [2023-12-26 12:32:14,805][123091] Updated weights for policy 0, policy_version 1620761 (0.0009) [2023-12-26 12:32:14,847][123090] Updated weights for policy 1, policy_version 1610094 (0.0008) [2023-12-26 12:32:14,863][123091] Updated weights for policy 0, policy_version 1620771 (0.0008) [2023-12-26 12:32:14,915][123090] Updated weights for policy 1, policy_version 1610104 (0.0011) [2023-12-26 12:32:14,921][123091] Updated weights for policy 0, policy_version 1620781 (0.0007) [2023-12-26 12:32:15,682][123090] Updated weights for policy 1, policy_version 1610114 (0.0010) [2023-12-26 12:32:15,748][123090] Updated weights for policy 1, policy_version 1610124 (0.0009) [2023-12-26 12:32:15,769][123091] Updated weights for policy 0, policy_version 1620791 (0.0007) [2023-12-26 12:32:15,801][123090] Updated weights for policy 1, policy_version 1610134 (0.0009) [2023-12-26 12:32:15,821][123091] Updated weights for policy 0, policy_version 1620801 (0.0008) [2023-12-26 12:32:15,858][123090] Updated weights for policy 1, policy_version 1610144 (0.0009) [2023-12-26 12:32:15,879][123091] Updated weights for policy 0, policy_version 1620811 (0.0007) [2023-12-26 12:32:16,579][123090] Updated weights for policy 1, policy_version 1610154 (0.0005) [2023-12-26 12:32:16,632][123090] Updated weights for policy 1, policy_version 1610164 (0.0007) [2023-12-26 12:32:16,681][123090] Updated weights for policy 1, policy_version 1610174 (0.0009) [2023-12-26 12:32:16,721][123091] Updated weights for policy 0, policy_version 1620821 (0.0010) [2023-12-26 12:32:16,776][123091] Updated weights for policy 0, policy_version 1620831 (0.0010) [2023-12-26 12:32:16,826][123091] Updated weights for policy 0, policy_version 1620841 (0.0009) [2023-12-26 12:32:17,300][123090] Updated weights for policy 1, policy_version 1610184 (0.0009) [2023-12-26 12:32:17,352][123090] Updated weights for policy 1, policy_version 1610194 (0.0009) [2023-12-26 12:32:17,400][123090] Updated weights for policy 1, policy_version 1610204 (0.0007) [2023-12-26 12:32:17,748][123091] Updated weights for policy 0, policy_version 1620852 (0.0010) [2023-12-26 12:32:17,801][123091] Updated weights for policy 0, policy_version 1620864 (0.0010) [2023-12-26 12:32:17,854][123091] Updated weights for policy 0, policy_version 1620875 (0.0010) [2023-12-26 12:32:18,098][123090] Updated weights for policy 1, policy_version 1610214 (0.0005) [2023-12-26 12:32:18,170][123090] Updated weights for policy 1, policy_version 1610224 (0.0008) [2023-12-26 12:32:18,225][123090] Updated weights for policy 1, policy_version 1610234 (0.0010) [2023-12-26 12:32:18,708][123091] Updated weights for policy 0, policy_version 1620885 (0.0009) [2023-12-26 12:32:18,770][123091] Updated weights for policy 0, policy_version 1620895 (0.0009) [2023-12-26 12:32:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 827170816. Throughput: 0: 8727.8, 1: 9011.0. Samples: 827186048. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:18,785][121949] Avg episode reward: [(0, '6196.342'), (1, '5611.139')] [2023-12-26 12:32:18,840][123091] Updated weights for policy 0, policy_version 1620905 (0.0009) [2023-12-26 12:32:19,028][123090] Updated weights for policy 1, policy_version 1610244 (0.0010) [2023-12-26 12:32:19,076][123090] Updated weights for policy 1, policy_version 1610254 (0.0010) [2023-12-26 12:32:19,137][123090] Updated weights for policy 1, policy_version 1610264 (0.0010) [2023-12-26 12:32:19,732][123091] Updated weights for policy 0, policy_version 1620915 (0.0009) [2023-12-26 12:32:19,797][123091] Updated weights for policy 0, policy_version 1620925 (0.0009) [2023-12-26 12:32:19,870][123091] Updated weights for policy 0, policy_version 1620935 (0.0010) [2023-12-26 12:32:19,897][123090] Updated weights for policy 1, policy_version 1610274 (0.0010) [2023-12-26 12:32:19,968][123090] Updated weights for policy 1, policy_version 1610284 (0.0010) [2023-12-26 12:32:20,021][123090] Updated weights for policy 1, policy_version 1610294 (0.0011) [2023-12-26 12:32:20,077][123090] Updated weights for policy 1, policy_version 1610304 (0.0010) [2023-12-26 12:32:20,754][123091] Updated weights for policy 0, policy_version 1620945 (0.0009) [2023-12-26 12:32:20,812][123091] Updated weights for policy 0, policy_version 1620955 (0.0009) [2023-12-26 12:32:20,885][123091] Updated weights for policy 0, policy_version 1620965 (0.0009) [2023-12-26 12:32:20,921][123090] Updated weights for policy 1, policy_version 1610314 (0.0008) [2023-12-26 12:32:20,948][123091] Updated weights for policy 0, policy_version 1620975 (0.0009) [2023-12-26 12:32:20,978][123090] Updated weights for policy 1, policy_version 1610324 (0.0011) [2023-12-26 12:32:21,055][123090] Updated weights for policy 1, policy_version 1610334 (0.0009) [2023-12-26 12:32:21,793][123091] Updated weights for policy 0, policy_version 1620985 (0.0009) [2023-12-26 12:32:21,857][123091] Updated weights for policy 0, policy_version 1620995 (0.0009) [2023-12-26 12:32:21,920][123091] Updated weights for policy 0, policy_version 1621005 (0.0007) [2023-12-26 12:32:21,926][123090] Updated weights for policy 1, policy_version 1610344 (0.0011) [2023-12-26 12:32:21,975][123090] Updated weights for policy 1, policy_version 1610354 (0.0010) [2023-12-26 12:32:22,031][123090] Updated weights for policy 1, policy_version 1610364 (0.0010) [2023-12-26 12:32:22,765][123091] Updated weights for policy 0, policy_version 1621015 (0.0008) [2023-12-26 12:32:22,822][123091] Updated weights for policy 0, policy_version 1621025 (0.0009) [2023-12-26 12:32:22,883][123091] Updated weights for policy 0, policy_version 1621035 (0.0009) [2023-12-26 12:32:22,896][123090] Updated weights for policy 1, policy_version 1610374 (0.0010) [2023-12-26 12:32:22,957][123090] Updated weights for policy 1, policy_version 1610384 (0.0011) [2023-12-26 12:32:23,017][123090] Updated weights for policy 1, policy_version 1610394 (0.0011) [2023-12-26 12:32:23,735][123091] Updated weights for policy 0, policy_version 1621045 (0.0010) [2023-12-26 12:32:23,782][123091] Updated weights for policy 0, policy_version 1621055 (0.0009) [2023-12-26 12:32:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 827252736. Throughput: 0: 8717.8, 1: 8956.3. Samples: 827235720. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:23,785][121949] Avg episode reward: [(0, '6167.067'), (1, '5785.710')] [2023-12-26 12:32:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001610400_412262400.pth... [2023-12-26 12:32:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001609376_412000256.pth [2023-12-26 12:32:23,830][123091] Updated weights for policy 0, policy_version 1621065 (0.0009) [2023-12-26 12:32:23,838][123090] Updated weights for policy 1, policy_version 1610404 (0.0011) [2023-12-26 12:32:23,860][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001621072_414998528.pth... [2023-12-26 12:32:23,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001620048_414736384.pth [2023-12-26 12:32:23,900][123090] Updated weights for policy 1, policy_version 1610414 (0.0010) [2023-12-26 12:32:23,955][123090] Updated weights for policy 1, policy_version 1610424 (0.0010) [2023-12-26 12:32:24,676][123091] Updated weights for policy 0, policy_version 1621075 (0.0008) [2023-12-26 12:32:24,735][123091] Updated weights for policy 0, policy_version 1621085 (0.0009) [2023-12-26 12:32:24,784][123091] Updated weights for policy 0, policy_version 1621095 (0.0009) [2023-12-26 12:32:24,798][123090] Updated weights for policy 1, policy_version 1610434 (0.0010) [2023-12-26 12:32:24,842][123090] Updated weights for policy 1, policy_version 1610444 (0.0010) [2023-12-26 12:32:24,894][123090] Updated weights for policy 1, policy_version 1610454 (0.0010) [2023-12-26 12:32:24,956][123090] Updated weights for policy 1, policy_version 1610464 (0.0010) [2023-12-26 12:32:25,609][123091] Updated weights for policy 0, policy_version 1621105 (0.0006) [2023-12-26 12:32:25,659][123091] Updated weights for policy 0, policy_version 1621115 (0.0005) [2023-12-26 12:32:25,721][123091] Updated weights for policy 0, policy_version 1621125 (0.0005) [2023-12-26 12:32:25,750][123090] Updated weights for policy 1, policy_version 1610474 (0.0006) [2023-12-26 12:32:25,769][123091] Updated weights for policy 0, policy_version 1621135 (0.0006) [2023-12-26 12:32:25,803][123090] Updated weights for policy 1, policy_version 1610484 (0.0010) [2023-12-26 12:32:25,850][123090] Updated weights for policy 1, policy_version 1610494 (0.0010) [2023-12-26 12:32:26,572][123091] Updated weights for policy 0, policy_version 1621145 (0.0011) [2023-12-26 12:32:26,643][123091] Updated weights for policy 0, policy_version 1621155 (0.0011) [2023-12-26 12:32:26,698][123091] Updated weights for policy 0, policy_version 1621165 (0.0010) [2023-12-26 12:32:26,703][123090] Updated weights for policy 1, policy_version 1610504 (0.0010) [2023-12-26 12:32:26,763][123090] Updated weights for policy 1, policy_version 1610514 (0.0010) [2023-12-26 12:32:26,823][123090] Updated weights for policy 1, policy_version 1610524 (0.0009) [2023-12-26 12:32:27,397][123091] Updated weights for policy 0, policy_version 1621175 (0.0007) [2023-12-26 12:32:27,453][123091] Updated weights for policy 0, policy_version 1621185 (0.0005) [2023-12-26 12:32:27,515][123091] Updated weights for policy 0, policy_version 1621195 (0.0005) [2023-12-26 12:32:27,674][123090] Updated weights for policy 1, policy_version 1610534 (0.0007) [2023-12-26 12:32:27,721][123090] Updated weights for policy 1, policy_version 1610544 (0.0005) [2023-12-26 12:32:27,768][123090] Updated weights for policy 1, policy_version 1610554 (0.0005) [2023-12-26 12:32:28,181][123091] Updated weights for policy 0, policy_version 1621205 (0.0005) [2023-12-26 12:32:28,231][123091] Updated weights for policy 0, policy_version 1621215 (0.0005) [2023-12-26 12:32:28,285][123091] Updated weights for policy 0, policy_version 1621225 (0.0005) [2023-12-26 12:32:28,457][123090] Updated weights for policy 1, policy_version 1610564 (0.0005) [2023-12-26 12:32:28,528][123090] Updated weights for policy 1, policy_version 1610574 (0.0005) [2023-12-26 12:32:28,592][123090] Updated weights for policy 1, policy_version 1610584 (0.0005) [2023-12-26 12:32:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 827351040. Throughput: 0: 8726.2, 1: 8932.6. Samples: 827339528. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:28,785][121949] Avg episode reward: [(0, '6301.019'), (1, '5555.037')] [2023-12-26 12:32:28,959][123091] Updated weights for policy 0, policy_version 1621235 (0.0006) [2023-12-26 12:32:29,016][123091] Updated weights for policy 0, policy_version 1621245 (0.0006) [2023-12-26 12:32:29,079][123091] Updated weights for policy 0, policy_version 1621255 (0.0007) [2023-12-26 12:32:29,370][123090] Updated weights for policy 1, policy_version 1610594 (0.0010) [2023-12-26 12:32:29,431][123090] Updated weights for policy 1, policy_version 1610604 (0.0008) [2023-12-26 12:32:29,480][123090] Updated weights for policy 1, policy_version 1610614 (0.0009) [2023-12-26 12:32:29,536][123090] Updated weights for policy 1, policy_version 1610624 (0.0009) [2023-12-26 12:32:29,834][123091] Updated weights for policy 0, policy_version 1621265 (0.0010) [2023-12-26 12:32:29,892][123091] Updated weights for policy 0, policy_version 1621275 (0.0011) [2023-12-26 12:32:29,955][123091] Updated weights for policy 0, policy_version 1621285 (0.0011) [2023-12-26 12:32:30,030][123091] Updated weights for policy 0, policy_version 1621295 (0.0011) [2023-12-26 12:32:30,403][123090] Updated weights for policy 1, policy_version 1610634 (0.0010) [2023-12-26 12:32:30,460][123090] Updated weights for policy 1, policy_version 1610644 (0.0010) [2023-12-26 12:32:30,512][123090] Updated weights for policy 1, policy_version 1610654 (0.0010) [2023-12-26 12:32:30,728][123091] Updated weights for policy 0, policy_version 1621305 (0.0006) [2023-12-26 12:32:30,790][123091] Updated weights for policy 0, policy_version 1621315 (0.0005) [2023-12-26 12:32:30,842][123091] Updated weights for policy 0, policy_version 1621325 (0.0005) [2023-12-26 12:32:31,366][123090] Updated weights for policy 1, policy_version 1610664 (0.0009) [2023-12-26 12:32:31,429][123090] Updated weights for policy 1, policy_version 1610674 (0.0007) [2023-12-26 12:32:31,483][123090] Updated weights for policy 1, policy_version 1610684 (0.0009) [2023-12-26 12:32:31,524][123091] Updated weights for policy 0, policy_version 1621335 (0.0005) [2023-12-26 12:32:31,579][123091] Updated weights for policy 0, policy_version 1621345 (0.0009) [2023-12-26 12:32:31,643][123091] Updated weights for policy 0, policy_version 1621355 (0.0008) [2023-12-26 12:32:32,344][123090] Updated weights for policy 1, policy_version 1610694 (0.0010) [2023-12-26 12:32:32,409][123090] Updated weights for policy 1, policy_version 1610704 (0.0007) [2023-12-26 12:32:32,422][123091] Updated weights for policy 0, policy_version 1621365 (0.0006) [2023-12-26 12:32:32,480][123090] Updated weights for policy 1, policy_version 1610714 (0.0006) [2023-12-26 12:32:32,481][123091] Updated weights for policy 0, policy_version 1621375 (0.0009) [2023-12-26 12:32:32,534][123091] Updated weights for policy 0, policy_version 1621385 (0.0009) [2023-12-26 12:32:33,225][123090] Updated weights for policy 1, policy_version 1610724 (0.0007) [2023-12-26 12:32:33,288][123090] Updated weights for policy 1, policy_version 1610734 (0.0009) [2023-12-26 12:32:33,340][123090] Updated weights for policy 1, policy_version 1610744 (0.0009) [2023-12-26 12:32:33,366][123091] Updated weights for policy 0, policy_version 1621395 (0.0008) [2023-12-26 12:32:33,427][123091] Updated weights for policy 0, policy_version 1621405 (0.0009) [2023-12-26 12:32:33,491][123091] Updated weights for policy 0, policy_version 1621415 (0.0005) [2023-12-26 12:32:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 827441152. Throughput: 0: 8837.4, 1: 8919.7. Samples: 827449808. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:33,784][121949] Avg episode reward: [(0, '6184.544'), (1, '5663.900')] [2023-12-26 12:32:34,160][123090] Updated weights for policy 1, policy_version 1610754 (0.0009) [2023-12-26 12:32:34,221][123090] Updated weights for policy 1, policy_version 1610764 (0.0008) [2023-12-26 12:32:34,223][123091] Updated weights for policy 0, policy_version 1621425 (0.0006) [2023-12-26 12:32:34,284][123091] Updated weights for policy 0, policy_version 1621435 (0.0007) [2023-12-26 12:32:34,285][123090] Updated weights for policy 1, policy_version 1610774 (0.0008) [2023-12-26 12:32:34,344][123091] Updated weights for policy 0, policy_version 1621445 (0.0008) [2023-12-26 12:32:34,352][123090] Updated weights for policy 1, policy_version 1610784 (0.0008) [2023-12-26 12:32:34,412][123091] Updated weights for policy 0, policy_version 1621455 (0.0009) [2023-12-26 12:32:35,136][123090] Updated weights for policy 1, policy_version 1610794 (0.0006) [2023-12-26 12:32:35,202][123090] Updated weights for policy 1, policy_version 1610804 (0.0005) [2023-12-26 12:32:35,248][123091] Updated weights for policy 0, policy_version 1621465 (0.0011) [2023-12-26 12:32:35,259][123090] Updated weights for policy 1, policy_version 1610814 (0.0005) [2023-12-26 12:32:35,302][123091] Updated weights for policy 0, policy_version 1621475 (0.0010) [2023-12-26 12:32:35,349][123091] Updated weights for policy 0, policy_version 1621485 (0.0010) [2023-12-26 12:32:35,980][123090] Updated weights for policy 1, policy_version 1610824 (0.0009) [2023-12-26 12:32:36,040][123090] Updated weights for policy 1, policy_version 1610834 (0.0011) [2023-12-26 12:32:36,104][123090] Updated weights for policy 1, policy_version 1610844 (0.0011) [2023-12-26 12:32:36,156][123091] Updated weights for policy 0, policy_version 1621496 (0.0009) [2023-12-26 12:32:36,220][123091] Updated weights for policy 0, policy_version 1621506 (0.0009) [2023-12-26 12:32:36,278][123091] Updated weights for policy 0, policy_version 1621516 (0.0009) [2023-12-26 12:32:36,790][123090] Updated weights for policy 1, policy_version 1610854 (0.0009) [2023-12-26 12:32:36,858][123090] Updated weights for policy 1, policy_version 1610864 (0.0008) [2023-12-26 12:32:36,922][123090] Updated weights for policy 1, policy_version 1610874 (0.0005) [2023-12-26 12:32:37,146][123091] Updated weights for policy 0, policy_version 1621526 (0.0008) [2023-12-26 12:32:37,210][123091] Updated weights for policy 0, policy_version 1621536 (0.0006) [2023-12-26 12:32:37,273][123091] Updated weights for policy 0, policy_version 1621546 (0.0005) [2023-12-26 12:32:37,586][123090] Updated weights for policy 1, policy_version 1610884 (0.0007) [2023-12-26 12:32:37,655][123090] Updated weights for policy 1, policy_version 1610894 (0.0008) [2023-12-26 12:32:37,728][123090] Updated weights for policy 1, policy_version 1610904 (0.0007) [2023-12-26 12:32:37,816][123091] Updated weights for policy 0, policy_version 1621556 (0.0007) [2023-12-26 12:32:37,891][123091] Updated weights for policy 0, policy_version 1621566 (0.0011) [2023-12-26 12:32:37,954][123091] Updated weights for policy 0, policy_version 1621576 (0.0011) [2023-12-26 12:32:38,460][123090] Updated weights for policy 1, policy_version 1610914 (0.0008) [2023-12-26 12:32:38,518][123090] Updated weights for policy 1, policy_version 1610924 (0.0006) [2023-12-26 12:32:38,587][123090] Updated weights for policy 1, policy_version 1610934 (0.0009) [2023-12-26 12:32:38,654][123090] Updated weights for policy 1, policy_version 1610944 (0.0011) [2023-12-26 12:32:38,763][123091] Updated weights for policy 0, policy_version 1621586 (0.0011) [2023-12-26 12:32:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 827531264. Throughput: 0: 8873.2, 1: 8914.7. Samples: 827504900. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:38,785][121949] Avg episode reward: [(0, '6208.515'), (1, '5792.578')] [2023-12-26 12:32:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001610944_412401664.pth... [2023-12-26 12:32:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001609888_412131328.pth [2023-12-26 12:32:38,818][123091] Updated weights for policy 0, policy_version 1621596 (0.0010) [2023-12-26 12:32:38,878][123091] Updated weights for policy 0, policy_version 1621606 (0.0011) [2023-12-26 12:32:38,932][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001621616_415137792.pth... [2023-12-26 12:32:38,934][123091] Updated weights for policy 0, policy_version 1621616 (0.0011) [2023-12-26 12:32:38,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001620560_414867456.pth [2023-12-26 12:32:39,397][123090] Updated weights for policy 1, policy_version 1610954 (0.0010) [2023-12-26 12:32:39,466][123090] Updated weights for policy 1, policy_version 1610964 (0.0010) [2023-12-26 12:32:39,533][123090] Updated weights for policy 1, policy_version 1610974 (0.0011) [2023-12-26 12:32:39,818][123091] Updated weights for policy 0, policy_version 1621626 (0.0009) [2023-12-26 12:32:39,887][123091] Updated weights for policy 0, policy_version 1621636 (0.0008) [2023-12-26 12:32:39,958][123091] Updated weights for policy 0, policy_version 1621646 (0.0009) [2023-12-26 12:32:40,443][123090] Updated weights for policy 1, policy_version 1610984 (0.0011) [2023-12-26 12:32:40,510][123090] Updated weights for policy 1, policy_version 1610994 (0.0010) [2023-12-26 12:32:40,558][123090] Updated weights for policy 1, policy_version 1611004 (0.0010) [2023-12-26 12:32:40,728][123091] Updated weights for policy 0, policy_version 1621656 (0.0009) [2023-12-26 12:32:40,788][123091] Updated weights for policy 0, policy_version 1621666 (0.0008) [2023-12-26 12:32:40,840][123091] Updated weights for policy 0, policy_version 1621676 (0.0009) [2023-12-26 12:32:41,442][123090] Updated weights for policy 1, policy_version 1611014 (0.0009) [2023-12-26 12:32:41,515][123090] Updated weights for policy 1, policy_version 1611024 (0.0007) [2023-12-26 12:32:41,586][123090] Updated weights for policy 1, policy_version 1611034 (0.0010) [2023-12-26 12:32:41,693][123091] Updated weights for policy 0, policy_version 1621686 (0.0008) [2023-12-26 12:32:41,755][123091] Updated weights for policy 0, policy_version 1621696 (0.0008) [2023-12-26 12:32:41,825][123091] Updated weights for policy 0, policy_version 1621706 (0.0009) [2023-12-26 12:32:42,446][123090] Updated weights for policy 1, policy_version 1611044 (0.0010) [2023-12-26 12:32:42,515][123090] Updated weights for policy 1, policy_version 1611054 (0.0009) [2023-12-26 12:32:42,547][123091] Updated weights for policy 0, policy_version 1621716 (0.0008) [2023-12-26 12:32:42,578][123090] Updated weights for policy 1, policy_version 1611064 (0.0009) [2023-12-26 12:32:42,594][123091] Updated weights for policy 0, policy_version 1621726 (0.0009) [2023-12-26 12:32:42,648][123091] Updated weights for policy 0, policy_version 1621736 (0.0008) [2023-12-26 12:32:43,402][123091] Updated weights for policy 0, policy_version 1621746 (0.0009) [2023-12-26 12:32:43,470][123091] Updated weights for policy 0, policy_version 1621756 (0.0007) [2023-12-26 12:32:43,480][123090] Updated weights for policy 1, policy_version 1611074 (0.0009) [2023-12-26 12:32:43,529][123091] Updated weights for policy 0, policy_version 1621766 (0.0010) [2023-12-26 12:32:43,537][123090] Updated weights for policy 1, policy_version 1611084 (0.0007) [2023-12-26 12:32:43,581][123091] Updated weights for policy 0, policy_version 1621776 (0.0010) [2023-12-26 12:32:43,593][123090] Updated weights for policy 1, policy_version 1611094 (0.0009) [2023-12-26 12:32:43,652][123090] Updated weights for policy 1, policy_version 1611104 (0.0008) [2023-12-26 12:32:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.0, 300 sec: 17661.4). Total num frames: 827621376. Throughput: 0: 8827.8, 1: 8806.2. Samples: 827610556. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:43,784][121949] Avg episode reward: [(0, '6361.041'), (1, '5571.031')] [2023-12-26 12:32:44,313][123091] Updated weights for policy 0, policy_version 1621786 (0.0009) [2023-12-26 12:32:44,369][123091] Updated weights for policy 0, policy_version 1621796 (0.0009) [2023-12-26 12:32:44,425][123091] Updated weights for policy 0, policy_version 1621806 (0.0009) [2023-12-26 12:32:44,510][123090] Updated weights for policy 1, policy_version 1611114 (0.0010) [2023-12-26 12:32:44,557][123090] Updated weights for policy 1, policy_version 1611124 (0.0010) [2023-12-26 12:32:44,616][123090] Updated weights for policy 1, policy_version 1611134 (0.0010) [2023-12-26 12:32:45,282][123091] Updated weights for policy 0, policy_version 1621816 (0.0009) [2023-12-26 12:32:45,349][123091] Updated weights for policy 0, policy_version 1621826 (0.0009) [2023-12-26 12:32:45,409][123091] Updated weights for policy 0, policy_version 1621836 (0.0008) [2023-12-26 12:32:45,457][123090] Updated weights for policy 1, policy_version 1611144 (0.0010) [2023-12-26 12:32:45,519][123090] Updated weights for policy 1, policy_version 1611154 (0.0010) [2023-12-26 12:32:45,587][123090] Updated weights for policy 1, policy_version 1611164 (0.0010) [2023-12-26 12:32:46,229][123091] Updated weights for policy 0, policy_version 1621846 (0.0009) [2023-12-26 12:32:46,282][123091] Updated weights for policy 0, policy_version 1621856 (0.0009) [2023-12-26 12:32:46,330][123091] Updated weights for policy 0, policy_version 1621866 (0.0008) [2023-12-26 12:32:46,407][123090] Updated weights for policy 1, policy_version 1611174 (0.0010) [2023-12-26 12:32:46,454][123090] Updated weights for policy 1, policy_version 1611184 (0.0010) [2023-12-26 12:32:46,513][123090] Updated weights for policy 1, policy_version 1611194 (0.0010) [2023-12-26 12:32:47,189][123091] Updated weights for policy 0, policy_version 1621876 (0.0008) [2023-12-26 12:32:47,237][123091] Updated weights for policy 0, policy_version 1621886 (0.0008) [2023-12-26 12:32:47,284][123091] Updated weights for policy 0, policy_version 1621896 (0.0008) [2023-12-26 12:32:47,346][123090] Updated weights for policy 1, policy_version 1611204 (0.0010) [2023-12-26 12:32:47,411][123090] Updated weights for policy 1, policy_version 1611214 (0.0010) [2023-12-26 12:32:47,473][123090] Updated weights for policy 1, policy_version 1611224 (0.0010) [2023-12-26 12:32:47,994][123091] Updated weights for policy 0, policy_version 1621906 (0.0008) [2023-12-26 12:32:48,061][123091] Updated weights for policy 0, policy_version 1621916 (0.0006) [2023-12-26 12:32:48,110][123091] Updated weights for policy 0, policy_version 1621926 (0.0005) [2023-12-26 12:32:48,164][123091] Updated weights for policy 0, policy_version 1621936 (0.0005) [2023-12-26 12:32:48,286][123090] Updated weights for policy 1, policy_version 1611234 (0.0010) [2023-12-26 12:32:48,346][123090] Updated weights for policy 1, policy_version 1611244 (0.0010) [2023-12-26 12:32:48,417][123090] Updated weights for policy 1, policy_version 1611254 (0.0011) [2023-12-26 12:32:48,483][123090] Updated weights for policy 1, policy_version 1611264 (0.0010) [2023-12-26 12:32:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 827703296. Throughput: 0: 8859.3, 1: 8779.6. Samples: 827716220. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:48,785][121949] Avg episode reward: [(0, '6291.521'), (1, '5490.898')] [2023-12-26 12:32:48,884][123091] Updated weights for policy 0, policy_version 1621946 (0.0010) [2023-12-26 12:32:48,927][123091] Updated weights for policy 0, policy_version 1621956 (0.0010) [2023-12-26 12:32:48,975][123091] Updated weights for policy 0, policy_version 1621966 (0.0010) [2023-12-26 12:32:49,285][123090] Updated weights for policy 1, policy_version 1611274 (0.0010) [2023-12-26 12:32:49,352][123090] Updated weights for policy 1, policy_version 1611284 (0.0010) [2023-12-26 12:32:49,425][123090] Updated weights for policy 1, policy_version 1611294 (0.0010) [2023-12-26 12:32:49,840][123091] Updated weights for policy 0, policy_version 1621976 (0.0009) [2023-12-26 12:32:49,897][123091] Updated weights for policy 0, policy_version 1621986 (0.0008) [2023-12-26 12:32:49,960][123091] Updated weights for policy 0, policy_version 1621996 (0.0010) [2023-12-26 12:32:50,221][123090] Updated weights for policy 1, policy_version 1611304 (0.0007) [2023-12-26 12:32:50,299][123090] Updated weights for policy 1, policy_version 1611314 (0.0005) [2023-12-26 12:32:50,373][123090] Updated weights for policy 1, policy_version 1611324 (0.0008) [2023-12-26 12:32:50,859][123091] Updated weights for policy 0, policy_version 1622006 (0.0010) [2023-12-26 12:32:50,918][123091] Updated weights for policy 0, policy_version 1622016 (0.0009) [2023-12-26 12:32:50,973][123091] Updated weights for policy 0, policy_version 1622026 (0.0009) [2023-12-26 12:32:51,104][123090] Updated weights for policy 1, policy_version 1611334 (0.0008) [2023-12-26 12:32:51,181][123090] Updated weights for policy 1, policy_version 1611344 (0.0007) [2023-12-26 12:32:51,251][123090] Updated weights for policy 1, policy_version 1611354 (0.0007) [2023-12-26 12:32:51,873][123091] Updated weights for policy 0, policy_version 1622036 (0.0010) [2023-12-26 12:32:51,945][123091] Updated weights for policy 0, policy_version 1622046 (0.0011) [2023-12-26 12:32:51,994][123090] Updated weights for policy 1, policy_version 1611364 (0.0010) [2023-12-26 12:32:52,007][123091] Updated weights for policy 0, policy_version 1622056 (0.0007) [2023-12-26 12:32:52,065][123090] Updated weights for policy 1, policy_version 1611374 (0.0009) [2023-12-26 12:32:52,130][123090] Updated weights for policy 1, policy_version 1611384 (0.0009) [2023-12-26 12:32:52,702][123091] Updated weights for policy 0, policy_version 1622066 (0.0007) [2023-12-26 12:32:52,767][123091] Updated weights for policy 0, policy_version 1622076 (0.0010) [2023-12-26 12:32:52,833][123091] Updated weights for policy 0, policy_version 1622086 (0.0008) [2023-12-26 12:32:52,903][123091] Updated weights for policy 0, policy_version 1622096 (0.0010) [2023-12-26 12:32:53,002][123090] Updated weights for policy 1, policy_version 1611394 (0.0010) [2023-12-26 12:32:53,061][123090] Updated weights for policy 1, policy_version 1611404 (0.0007) [2023-12-26 12:32:53,127][123090] Updated weights for policy 1, policy_version 1611414 (0.0005) [2023-12-26 12:32:53,196][123090] Updated weights for policy 1, policy_version 1611424 (0.0005) [2023-12-26 12:32:53,595][123091] Updated weights for policy 0, policy_version 1622106 (0.0005) [2023-12-26 12:32:53,657][123091] Updated weights for policy 0, policy_version 1622117 (0.0009) [2023-12-26 12:32:53,711][123091] Updated weights for policy 0, policy_version 1622128 (0.0010) [2023-12-26 12:32:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17661.4). Total num frames: 827793408. Throughput: 0: 8799.5, 1: 8809.1. Samples: 827767736. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:53,785][121949] Avg episode reward: [(0, '6242.561'), (1, '5713.613')] [2023-12-26 12:32:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001622128_415268864.pth... [2023-12-26 12:32:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001611424_412524544.pth... [2023-12-26 12:32:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001621072_414998528.pth [2023-12-26 12:32:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001610400_412262400.pth [2023-12-26 12:32:53,897][123090] Updated weights for policy 1, policy_version 1611434 (0.0009) [2023-12-26 12:32:53,950][123090] Updated weights for policy 1, policy_version 1611444 (0.0009) [2023-12-26 12:32:54,007][123090] Updated weights for policy 1, policy_version 1611454 (0.0009) [2023-12-26 12:32:54,487][123091] Updated weights for policy 0, policy_version 1622138 (0.0005) [2023-12-26 12:32:54,540][123091] Updated weights for policy 0, policy_version 1622148 (0.0008) [2023-12-26 12:32:54,593][123091] Updated weights for policy 0, policy_version 1622158 (0.0009) [2023-12-26 12:32:54,877][123090] Updated weights for policy 1, policy_version 1611464 (0.0010) [2023-12-26 12:32:54,932][123090] Updated weights for policy 1, policy_version 1611474 (0.0008) [2023-12-26 12:32:54,998][123090] Updated weights for policy 1, policy_version 1611484 (0.0009) [2023-12-26 12:32:55,278][123091] Updated weights for policy 0, policy_version 1622168 (0.0010) [2023-12-26 12:32:55,329][123091] Updated weights for policy 0, policy_version 1622178 (0.0009) [2023-12-26 12:32:55,381][123091] Updated weights for policy 0, policy_version 1622188 (0.0009) [2023-12-26 12:32:55,698][123090] Updated weights for policy 1, policy_version 1611494 (0.0010) [2023-12-26 12:32:55,754][123090] Updated weights for policy 1, policy_version 1611504 (0.0010) [2023-12-26 12:32:55,810][123090] Updated weights for policy 1, policy_version 1611514 (0.0005) [2023-12-26 12:32:56,302][123091] Updated weights for policy 0, policy_version 1622198 (0.0009) [2023-12-26 12:32:56,364][123091] Updated weights for policy 0, policy_version 1622208 (0.0010) [2023-12-26 12:32:56,417][123091] Updated weights for policy 0, policy_version 1622219 (0.0010) [2023-12-26 12:32:56,466][123090] Updated weights for policy 1, policy_version 1611524 (0.0007) [2023-12-26 12:32:56,540][123090] Updated weights for policy 1, policy_version 1611534 (0.0007) [2023-12-26 12:32:56,595][123090] Updated weights for policy 1, policy_version 1611544 (0.0008) [2023-12-26 12:32:57,276][123091] Updated weights for policy 0, policy_version 1622229 (0.0010) [2023-12-26 12:32:57,337][123091] Updated weights for policy 0, policy_version 1622239 (0.0008) [2023-12-26 12:32:57,370][123090] Updated weights for policy 1, policy_version 1611554 (0.0008) [2023-12-26 12:32:57,398][123091] Updated weights for policy 0, policy_version 1622249 (0.0009) [2023-12-26 12:32:57,425][123090] Updated weights for policy 1, policy_version 1611564 (0.0005) [2023-12-26 12:32:57,490][123090] Updated weights for policy 1, policy_version 1611574 (0.0005) [2023-12-26 12:32:57,552][123090] Updated weights for policy 1, policy_version 1611584 (0.0005) [2023-12-26 12:32:58,166][123090] Updated weights for policy 1, policy_version 1611594 (0.0008) [2023-12-26 12:32:58,233][123090] Updated weights for policy 1, policy_version 1611604 (0.0010) [2023-12-26 12:32:58,287][123091] Updated weights for policy 0, policy_version 1622259 (0.0009) [2023-12-26 12:32:58,297][123090] Updated weights for policy 1, policy_version 1611614 (0.0010) [2023-12-26 12:32:58,351][123091] Updated weights for policy 0, policy_version 1622269 (0.0007) [2023-12-26 12:32:58,422][123091] Updated weights for policy 0, policy_version 1622279 (0.0009) [2023-12-26 12:32:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 827883520. Throughput: 0: 8818.3, 1: 8874.3. Samples: 827876056. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:32:58,785][121949] Avg episode reward: [(0, '6217.730'), (1, '5725.737')] [2023-12-26 12:32:59,189][123090] Updated weights for policy 1, policy_version 1611624 (0.0010) [2023-12-26 12:32:59,261][123090] Updated weights for policy 1, policy_version 1611634 (0.0010) [2023-12-26 12:32:59,313][123090] Updated weights for policy 1, policy_version 1611644 (0.0008) [2023-12-26 12:32:59,319][123091] Updated weights for policy 0, policy_version 1622289 (0.0011) [2023-12-26 12:32:59,388][123091] Updated weights for policy 0, policy_version 1622299 (0.0009) [2023-12-26 12:32:59,452][123091] Updated weights for policy 0, policy_version 1622309 (0.0008) [2023-12-26 12:32:59,521][123091] Updated weights for policy 0, policy_version 1622319 (0.0008) [2023-12-26 12:33:00,190][123090] Updated weights for policy 1, policy_version 1611654 (0.0009) [2023-12-26 12:33:00,243][123090] Updated weights for policy 1, policy_version 1611664 (0.0006) [2023-12-26 12:33:00,245][123091] Updated weights for policy 0, policy_version 1622329 (0.0010) [2023-12-26 12:33:00,298][123090] Updated weights for policy 1, policy_version 1611674 (0.0007) [2023-12-26 12:33:00,311][123091] Updated weights for policy 0, policy_version 1622339 (0.0011) [2023-12-26 12:33:00,373][123091] Updated weights for policy 0, policy_version 1622349 (0.0010) [2023-12-26 12:33:01,003][123090] Updated weights for policy 1, policy_version 1611684 (0.0007) [2023-12-26 12:33:01,074][123090] Updated weights for policy 1, policy_version 1611694 (0.0009) [2023-12-26 12:33:01,110][123091] Updated weights for policy 0, policy_version 1622359 (0.0010) [2023-12-26 12:33:01,132][123090] Updated weights for policy 1, policy_version 1611704 (0.0007) [2023-12-26 12:33:01,177][123091] Updated weights for policy 0, policy_version 1622369 (0.0008) [2023-12-26 12:33:01,234][123091] Updated weights for policy 0, policy_version 1622379 (0.0009) [2023-12-26 12:33:02,002][123090] Updated weights for policy 1, policy_version 1611714 (0.0009) [2023-12-26 12:33:02,026][123091] Updated weights for policy 0, policy_version 1622389 (0.0008) [2023-12-26 12:33:02,061][123090] Updated weights for policy 1, policy_version 1611724 (0.0008) [2023-12-26 12:33:02,084][123091] Updated weights for policy 0, policy_version 1622399 (0.0009) [2023-12-26 12:33:02,130][123090] Updated weights for policy 1, policy_version 1611734 (0.0008) [2023-12-26 12:33:02,142][123091] Updated weights for policy 0, policy_version 1622409 (0.0006) [2023-12-26 12:33:02,196][123090] Updated weights for policy 1, policy_version 1611744 (0.0010) [2023-12-26 12:33:02,931][123091] Updated weights for policy 0, policy_version 1622419 (0.0007) [2023-12-26 12:33:02,984][123091] Updated weights for policy 0, policy_version 1622429 (0.0010) [2023-12-26 12:33:03,021][123090] Updated weights for policy 1, policy_version 1611754 (0.0008) [2023-12-26 12:33:03,036][123091] Updated weights for policy 0, policy_version 1622439 (0.0007) [2023-12-26 12:33:03,078][123090] Updated weights for policy 1, policy_version 1611764 (0.0007) [2023-12-26 12:33:03,135][123090] Updated weights for policy 1, policy_version 1611774 (0.0005) [2023-12-26 12:33:03,776][123090] Updated weights for policy 1, policy_version 1611784 (0.0005) [2023-12-26 12:33:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 827965440. Throughput: 0: 8893.3, 1: 8808.1. Samples: 827982616. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:03,785][121949] Avg episode reward: [(0, '6188.891'), (1, '5573.740')] [2023-12-26 12:33:03,832][123090] Updated weights for policy 1, policy_version 1611794 (0.0005) [2023-12-26 12:33:03,912][123090] Updated weights for policy 1, policy_version 1611804 (0.0008) [2023-12-26 12:33:03,922][123091] Updated weights for policy 0, policy_version 1622449 (0.0008) [2023-12-26 12:33:03,984][123091] Updated weights for policy 0, policy_version 1622459 (0.0010) [2023-12-26 12:33:04,044][123091] Updated weights for policy 0, policy_version 1622469 (0.0010) [2023-12-26 12:33:04,109][123091] Updated weights for policy 0, policy_version 1622479 (0.0009) [2023-12-26 12:33:04,681][123090] Updated weights for policy 1, policy_version 1611814 (0.0009) [2023-12-26 12:33:04,742][123090] Updated weights for policy 1, policy_version 1611824 (0.0009) [2023-12-26 12:33:04,803][123090] Updated weights for policy 1, policy_version 1611834 (0.0010) [2023-12-26 12:33:04,925][123091] Updated weights for policy 0, policy_version 1622489 (0.0007) [2023-12-26 12:33:04,985][123091] Updated weights for policy 0, policy_version 1622499 (0.0009) [2023-12-26 12:33:05,051][123091] Updated weights for policy 0, policy_version 1622509 (0.0009) [2023-12-26 12:33:05,698][123091] Updated weights for policy 0, policy_version 1622519 (0.0010) [2023-12-26 12:33:05,719][123090] Updated weights for policy 1, policy_version 1611844 (0.0009) [2023-12-26 12:33:05,750][123091] Updated weights for policy 0, policy_version 1622529 (0.0007) [2023-12-26 12:33:05,776][123090] Updated weights for policy 1, policy_version 1611854 (0.0009) [2023-12-26 12:33:05,800][123091] Updated weights for policy 0, policy_version 1622539 (0.0008) [2023-12-26 12:33:05,840][123090] Updated weights for policy 1, policy_version 1611864 (0.0007) [2023-12-26 12:33:06,603][123091] Updated weights for policy 0, policy_version 1622549 (0.0009) [2023-12-26 12:33:06,608][123090] Updated weights for policy 1, policy_version 1611874 (0.0006) [2023-12-26 12:33:06,666][123091] Updated weights for policy 0, policy_version 1622559 (0.0009) [2023-12-26 12:33:06,681][123090] Updated weights for policy 1, policy_version 1611884 (0.0008) [2023-12-26 12:33:06,733][123091] Updated weights for policy 0, policy_version 1622569 (0.0008) [2023-12-26 12:33:06,749][123090] Updated weights for policy 1, policy_version 1611894 (0.0007) [2023-12-26 12:33:06,804][123090] Updated weights for policy 1, policy_version 1611904 (0.0007) [2023-12-26 12:33:07,559][123091] Updated weights for policy 0, policy_version 1622579 (0.0009) [2023-12-26 12:33:07,621][123091] Updated weights for policy 0, policy_version 1622589 (0.0009) [2023-12-26 12:33:07,641][123090] Updated weights for policy 1, policy_version 1611914 (0.0008) [2023-12-26 12:33:07,672][123091] Updated weights for policy 0, policy_version 1622599 (0.0006) [2023-12-26 12:33:07,692][123090] Updated weights for policy 1, policy_version 1611924 (0.0009) [2023-12-26 12:33:07,744][123090] Updated weights for policy 1, policy_version 1611934 (0.0010) [2023-12-26 12:33:08,497][123091] Updated weights for policy 0, policy_version 1622609 (0.0008) [2023-12-26 12:33:08,557][123091] Updated weights for policy 0, policy_version 1622619 (0.0009) [2023-12-26 12:33:08,590][123090] Updated weights for policy 1, policy_version 1611944 (0.0009) [2023-12-26 12:33:08,619][123091] Updated weights for policy 0, policy_version 1622629 (0.0010) [2023-12-26 12:33:08,656][123090] Updated weights for policy 1, policy_version 1611954 (0.0006) [2023-12-26 12:33:08,684][123091] Updated weights for policy 0, policy_version 1622639 (0.0008) [2023-12-26 12:33:08,722][123090] Updated weights for policy 1, policy_version 1611964 (0.0008) [2023-12-26 12:33:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 828063744. Throughput: 0: 8968.4, 1: 8829.2. Samples: 828036616. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:08,785][121949] Avg episode reward: [(0, '6314.504'), (1, '5438.982')] [2023-12-26 12:33:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001622640_415399936.pth... [2023-12-26 12:33:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001611968_412663808.pth... [2023-12-26 12:33:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001621616_415137792.pth [2023-12-26 12:33:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001610944_412401664.pth [2023-12-26 12:33:09,478][123091] Updated weights for policy 0, policy_version 1622649 (0.0008) [2023-12-26 12:33:09,534][123091] Updated weights for policy 0, policy_version 1622659 (0.0008) [2023-12-26 12:33:09,542][123090] Updated weights for policy 1, policy_version 1611974 (0.0007) [2023-12-26 12:33:09,594][123091] Updated weights for policy 0, policy_version 1622669 (0.0008) [2023-12-26 12:33:09,613][123090] Updated weights for policy 1, policy_version 1611984 (0.0006) [2023-12-26 12:33:09,685][123090] Updated weights for policy 1, policy_version 1611994 (0.0006) [2023-12-26 12:33:10,352][123091] Updated weights for policy 0, policy_version 1622679 (0.0007) [2023-12-26 12:33:10,392][123090] Updated weights for policy 1, policy_version 1612004 (0.0006) [2023-12-26 12:33:10,420][123091] Updated weights for policy 0, policy_version 1622689 (0.0006) [2023-12-26 12:33:10,459][123090] Updated weights for policy 1, policy_version 1612014 (0.0006) [2023-12-26 12:33:10,495][123091] Updated weights for policy 0, policy_version 1622699 (0.0005) [2023-12-26 12:33:10,518][123090] Updated weights for policy 1, policy_version 1612024 (0.0005) [2023-12-26 12:33:11,099][123090] Updated weights for policy 1, policy_version 1612034 (0.0006) [2023-12-26 12:33:11,170][123090] Updated weights for policy 1, policy_version 1612044 (0.0009) [2023-12-26 12:33:11,186][123091] Updated weights for policy 0, policy_version 1622709 (0.0008) [2023-12-26 12:33:11,243][123090] Updated weights for policy 1, policy_version 1612054 (0.0011) [2023-12-26 12:33:11,256][123091] Updated weights for policy 0, policy_version 1622719 (0.0008) [2023-12-26 12:33:11,307][123090] Updated weights for policy 1, policy_version 1612064 (0.0010) [2023-12-26 12:33:11,318][123091] Updated weights for policy 0, policy_version 1622729 (0.0008) [2023-12-26 12:33:12,048][123091] Updated weights for policy 0, policy_version 1622739 (0.0009) [2023-12-26 12:33:12,119][123091] Updated weights for policy 0, policy_version 1622749 (0.0006) [2023-12-26 12:33:12,190][123090] Updated weights for policy 1, policy_version 1612074 (0.0009) [2023-12-26 12:33:12,196][123091] Updated weights for policy 0, policy_version 1622759 (0.0005) [2023-12-26 12:33:12,247][123090] Updated weights for policy 1, policy_version 1612084 (0.0009) [2023-12-26 12:33:12,309][123090] Updated weights for policy 1, policy_version 1612094 (0.0007) [2023-12-26 12:33:12,941][123091] Updated weights for policy 0, policy_version 1622769 (0.0008) [2023-12-26 12:33:12,999][123091] Updated weights for policy 0, policy_version 1622779 (0.0009) [2023-12-26 12:33:13,061][123091] Updated weights for policy 0, policy_version 1622789 (0.0009) [2023-12-26 12:33:13,116][123091] Updated weights for policy 0, policy_version 1622799 (0.0010) [2023-12-26 12:33:13,149][123090] Updated weights for policy 1, policy_version 1612104 (0.0009) [2023-12-26 12:33:13,197][123090] Updated weights for policy 1, policy_version 1612114 (0.0009) [2023-12-26 12:33:13,245][123090] Updated weights for policy 1, policy_version 1612124 (0.0009) [2023-12-26 12:33:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 828145664. Throughput: 0: 8981.8, 1: 8859.3. Samples: 828142376. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:13,784][121949] Avg episode reward: [(0, '6327.976'), (1, '5491.590')] [2023-12-26 12:33:13,917][123091] Updated weights for policy 0, policy_version 1622809 (0.0006) [2023-12-26 12:33:13,963][123091] Updated weights for policy 0, policy_version 1622819 (0.0005) [2023-12-26 12:33:14,014][123091] Updated weights for policy 0, policy_version 1622829 (0.0007) [2023-12-26 12:33:14,048][123090] Updated weights for policy 1, policy_version 1612134 (0.0009) [2023-12-26 12:33:14,099][123090] Updated weights for policy 1, policy_version 1612144 (0.0009) [2023-12-26 12:33:14,160][123090] Updated weights for policy 1, policy_version 1612154 (0.0009) [2023-12-26 12:33:14,796][123091] Updated weights for policy 0, policy_version 1622839 (0.0010) [2023-12-26 12:33:14,852][123091] Updated weights for policy 0, policy_version 1622849 (0.0010) [2023-12-26 12:33:14,907][123091] Updated weights for policy 0, policy_version 1622859 (0.0009) [2023-12-26 12:33:14,987][123090] Updated weights for policy 1, policy_version 1612164 (0.0010) [2023-12-26 12:33:15,045][123090] Updated weights for policy 1, policy_version 1612174 (0.0009) [2023-12-26 12:33:15,106][123090] Updated weights for policy 1, policy_version 1612184 (0.0009) [2023-12-26 12:33:15,732][123091] Updated weights for policy 0, policy_version 1622869 (0.0009) [2023-12-26 12:33:15,783][123091] Updated weights for policy 0, policy_version 1622879 (0.0009) [2023-12-26 12:33:15,833][123091] Updated weights for policy 0, policy_version 1622889 (0.0009) [2023-12-26 12:33:15,958][123090] Updated weights for policy 1, policy_version 1612194 (0.0009) [2023-12-26 12:33:16,015][123090] Updated weights for policy 1, policy_version 1612204 (0.0009) [2023-12-26 12:33:16,063][123090] Updated weights for policy 1, policy_version 1612214 (0.0009) [2023-12-26 12:33:16,116][123090] Updated weights for policy 1, policy_version 1612224 (0.0008) [2023-12-26 12:33:16,656][123091] Updated weights for policy 0, policy_version 1622899 (0.0010) [2023-12-26 12:33:16,706][123091] Updated weights for policy 0, policy_version 1622909 (0.0010) [2023-12-26 12:33:16,754][123091] Updated weights for policy 0, policy_version 1622919 (0.0010) [2023-12-26 12:33:16,911][123090] Updated weights for policy 1, policy_version 1612234 (0.0010) [2023-12-26 12:33:16,964][123090] Updated weights for policy 1, policy_version 1612244 (0.0009) [2023-12-26 12:33:17,021][123090] Updated weights for policy 1, policy_version 1612254 (0.0009) [2023-12-26 12:33:17,497][123091] Updated weights for policy 0, policy_version 1622929 (0.0010) [2023-12-26 12:33:17,544][123091] Updated weights for policy 0, policy_version 1622939 (0.0010) [2023-12-26 12:33:17,592][123091] Updated weights for policy 0, policy_version 1622949 (0.0010) [2023-12-26 12:33:17,643][123091] Updated weights for policy 0, policy_version 1622959 (0.0010) [2023-12-26 12:33:17,839][123090] Updated weights for policy 1, policy_version 1612264 (0.0008) [2023-12-26 12:33:17,894][123090] Updated weights for policy 1, policy_version 1612274 (0.0009) [2023-12-26 12:33:17,942][123090] Updated weights for policy 1, policy_version 1612284 (0.0009) [2023-12-26 12:33:18,501][123091] Updated weights for policy 0, policy_version 1622969 (0.0010) [2023-12-26 12:33:18,557][123091] Updated weights for policy 0, policy_version 1622979 (0.0010) [2023-12-26 12:33:18,619][123091] Updated weights for policy 0, policy_version 1622989 (0.0010) [2023-12-26 12:33:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 828235776. Throughput: 0: 8906.9, 1: 8833.2. Samples: 828248116. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:18,784][121949] Avg episode reward: [(0, '6240.908'), (1, '5535.993')] [2023-12-26 12:33:18,808][123090] Updated weights for policy 1, policy_version 1612294 (0.0010) [2023-12-26 12:33:18,865][123090] Updated weights for policy 1, policy_version 1612304 (0.0010) [2023-12-26 12:33:18,921][123090] Updated weights for policy 1, policy_version 1612314 (0.0009) [2023-12-26 12:33:19,430][123091] Updated weights for policy 0, policy_version 1622999 (0.0010) [2023-12-26 12:33:19,493][123091] Updated weights for policy 0, policy_version 1623009 (0.0010) [2023-12-26 12:33:19,560][123091] Updated weights for policy 0, policy_version 1623019 (0.0009) [2023-12-26 12:33:19,821][123090] Updated weights for policy 1, policy_version 1612324 (0.0009) [2023-12-26 12:33:19,892][123090] Updated weights for policy 1, policy_version 1612334 (0.0007) [2023-12-26 12:33:19,965][123090] Updated weights for policy 1, policy_version 1612344 (0.0007) [2023-12-26 12:33:20,366][123091] Updated weights for policy 0, policy_version 1623029 (0.0009) [2023-12-26 12:33:20,435][123091] Updated weights for policy 0, policy_version 1623039 (0.0009) [2023-12-26 12:33:20,501][123091] Updated weights for policy 0, policy_version 1623049 (0.0009) [2023-12-26 12:33:20,698][123090] Updated weights for policy 1, policy_version 1612354 (0.0006) [2023-12-26 12:33:20,756][123090] Updated weights for policy 1, policy_version 1612364 (0.0009) [2023-12-26 12:33:20,814][123090] Updated weights for policy 1, policy_version 1612374 (0.0010) [2023-12-26 12:33:20,887][123090] Updated weights for policy 1, policy_version 1612384 (0.0009) [2023-12-26 12:33:21,327][123091] Updated weights for policy 0, policy_version 1623059 (0.0008) [2023-12-26 12:33:21,401][123091] Updated weights for policy 0, policy_version 1623069 (0.0009) [2023-12-26 12:33:21,469][123091] Updated weights for policy 0, policy_version 1623079 (0.0009) [2023-12-26 12:33:21,645][123090] Updated weights for policy 1, policy_version 1612394 (0.0007) [2023-12-26 12:33:21,711][123090] Updated weights for policy 1, policy_version 1612404 (0.0008) [2023-12-26 12:33:21,782][123090] Updated weights for policy 1, policy_version 1612414 (0.0007) [2023-12-26 12:33:22,341][123091] Updated weights for policy 0, policy_version 1623089 (0.0010) [2023-12-26 12:33:22,409][123091] Updated weights for policy 0, policy_version 1623099 (0.0009) [2023-12-26 12:33:22,466][123091] Updated weights for policy 0, policy_version 1623109 (0.0009) [2023-12-26 12:33:22,530][123091] Updated weights for policy 0, policy_version 1623119 (0.0006) [2023-12-26 12:33:22,589][123090] Updated weights for policy 1, policy_version 1612424 (0.0008) [2023-12-26 12:33:22,655][123090] Updated weights for policy 1, policy_version 1612434 (0.0009) [2023-12-26 12:33:22,724][123090] Updated weights for policy 1, policy_version 1612444 (0.0010) [2023-12-26 12:33:23,251][123091] Updated weights for policy 0, policy_version 1623129 (0.0010) [2023-12-26 12:33:23,312][123091] Updated weights for policy 0, policy_version 1623139 (0.0010) [2023-12-26 12:33:23,379][123091] Updated weights for policy 0, policy_version 1623149 (0.0009) [2023-12-26 12:33:23,584][123090] Updated weights for policy 1, policy_version 1612454 (0.0009) [2023-12-26 12:33:23,640][123090] Updated weights for policy 1, policy_version 1612464 (0.0009) [2023-12-26 12:33:23,695][123090] Updated weights for policy 1, policy_version 1612474 (0.0009) [2023-12-26 12:33:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 828325888. Throughput: 0: 8875.7, 1: 8778.1. Samples: 828299324. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:23,785][121949] Avg episode reward: [(0, '6202.797'), (1, '5609.449')] [2023-12-26 12:33:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001623152_415531008.pth... [2023-12-26 12:33:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001612480_412794880.pth... [2023-12-26 12:33:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001611424_412524544.pth [2023-12-26 12:33:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001622128_415268864.pth [2023-12-26 12:33:24,161][123091] Updated weights for policy 0, policy_version 1623159 (0.0007) [2023-12-26 12:33:24,240][123091] Updated weights for policy 0, policy_version 1623169 (0.0005) [2023-12-26 12:33:24,311][123091] Updated weights for policy 0, policy_version 1623179 (0.0007) [2023-12-26 12:33:24,447][123090] Updated weights for policy 1, policy_version 1612484 (0.0007) [2023-12-26 12:33:24,495][123090] Updated weights for policy 1, policy_version 1612494 (0.0005) [2023-12-26 12:33:24,552][123090] Updated weights for policy 1, policy_version 1612504 (0.0005) [2023-12-26 12:33:24,947][123091] Updated weights for policy 0, policy_version 1623189 (0.0007) [2023-12-26 12:33:25,000][123091] Updated weights for policy 0, policy_version 1623199 (0.0005) [2023-12-26 12:33:25,062][123091] Updated weights for policy 0, policy_version 1623209 (0.0005) [2023-12-26 12:33:25,322][123090] Updated weights for policy 1, policy_version 1612514 (0.0006) [2023-12-26 12:33:25,374][123090] Updated weights for policy 1, policy_version 1612524 (0.0010) [2023-12-26 12:33:25,428][123090] Updated weights for policy 1, policy_version 1612534 (0.0009) [2023-12-26 12:33:25,489][123090] Updated weights for policy 1, policy_version 1612544 (0.0009) [2023-12-26 12:33:25,840][123091] Updated weights for policy 0, policy_version 1623219 (0.0010) [2023-12-26 12:33:25,891][123091] Updated weights for policy 0, policy_version 1623229 (0.0009) [2023-12-26 12:33:25,945][123091] Updated weights for policy 0, policy_version 1623239 (0.0010) [2023-12-26 12:33:26,326][123090] Updated weights for policy 1, policy_version 1612554 (0.0009) [2023-12-26 12:33:26,379][123090] Updated weights for policy 1, policy_version 1612565 (0.0009) [2023-12-26 12:33:26,435][123090] Updated weights for policy 1, policy_version 1612575 (0.0009) [2023-12-26 12:33:26,808][123091] Updated weights for policy 0, policy_version 1623249 (0.0009) [2023-12-26 12:33:26,869][123091] Updated weights for policy 0, policy_version 1623259 (0.0010) [2023-12-26 12:33:26,924][123091] Updated weights for policy 0, policy_version 1623269 (0.0010) [2023-12-26 12:33:26,972][123091] Updated weights for policy 0, policy_version 1623279 (0.0010) [2023-12-26 12:33:27,191][123090] Updated weights for policy 1, policy_version 1612585 (0.0009) [2023-12-26 12:33:27,250][123090] Updated weights for policy 1, policy_version 1612595 (0.0009) [2023-12-26 12:33:27,302][123090] Updated weights for policy 1, policy_version 1612605 (0.0008) [2023-12-26 12:33:27,811][123091] Updated weights for policy 0, policy_version 1623289 (0.0009) [2023-12-26 12:33:27,860][123091] Updated weights for policy 0, policy_version 1623299 (0.0009) [2023-12-26 12:33:27,907][123091] Updated weights for policy 0, policy_version 1623309 (0.0009) [2023-12-26 12:33:28,131][123090] Updated weights for policy 1, policy_version 1612616 (0.0007) [2023-12-26 12:33:28,184][123090] Updated weights for policy 1, policy_version 1612626 (0.0010) [2023-12-26 12:33:28,243][123090] Updated weights for policy 1, policy_version 1612636 (0.0008) [2023-12-26 12:33:28,656][123091] Updated weights for policy 0, policy_version 1623319 (0.0009) [2023-12-26 12:33:28,724][123091] Updated weights for policy 0, policy_version 1623329 (0.0010) [2023-12-26 12:33:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 828407808. Throughput: 0: 8873.9, 1: 8796.4. Samples: 828405724. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:28,785][121949] Avg episode reward: [(0, '6271.980'), (1, '5393.194')] [2023-12-26 12:33:28,791][123091] Updated weights for policy 0, policy_version 1623339 (0.0010) [2023-12-26 12:33:29,024][123090] Updated weights for policy 1, policy_version 1612646 (0.0008) [2023-12-26 12:33:29,090][123090] Updated weights for policy 1, policy_version 1612656 (0.0010) [2023-12-26 12:33:29,142][123090] Updated weights for policy 1, policy_version 1612666 (0.0010) [2023-12-26 12:33:29,590][123091] Updated weights for policy 0, policy_version 1623349 (0.0008) [2023-12-26 12:33:29,643][123091] Updated weights for policy 0, policy_version 1623359 (0.0007) [2023-12-26 12:33:29,703][123091] Updated weights for policy 0, policy_version 1623369 (0.0009) [2023-12-26 12:33:29,946][123090] Updated weights for policy 1, policy_version 1612676 (0.0010) [2023-12-26 12:33:30,018][123090] Updated weights for policy 1, policy_version 1612686 (0.0008) [2023-12-26 12:33:30,088][123090] Updated weights for policy 1, policy_version 1612696 (0.0007) [2023-12-26 12:33:30,540][123091] Updated weights for policy 0, policy_version 1623379 (0.0007) [2023-12-26 12:33:30,594][123091] Updated weights for policy 0, policy_version 1623389 (0.0009) [2023-12-26 12:33:30,650][123091] Updated weights for policy 0, policy_version 1623400 (0.0010) [2023-12-26 12:33:30,789][123090] Updated weights for policy 1, policy_version 1612706 (0.0009) [2023-12-26 12:33:30,860][123090] Updated weights for policy 1, policy_version 1612716 (0.0005) [2023-12-26 12:33:30,929][123090] Updated weights for policy 1, policy_version 1612726 (0.0005) [2023-12-26 12:33:30,999][123090] Updated weights for policy 1, policy_version 1612736 (0.0005) [2023-12-26 12:33:31,550][123091] Updated weights for policy 0, policy_version 1623410 (0.0009) [2023-12-26 12:33:31,602][123091] Updated weights for policy 0, policy_version 1623420 (0.0008) [2023-12-26 12:33:31,661][123091] Updated weights for policy 0, policy_version 1623430 (0.0006) [2023-12-26 12:33:31,682][123090] Updated weights for policy 1, policy_version 1612746 (0.0009) [2023-12-26 12:33:31,721][123091] Updated weights for policy 0, policy_version 1623440 (0.0007) [2023-12-26 12:33:31,749][123090] Updated weights for policy 1, policy_version 1612756 (0.0008) [2023-12-26 12:33:31,805][123090] Updated weights for policy 1, policy_version 1612766 (0.0010) [2023-12-26 12:33:32,601][123091] Updated weights for policy 0, policy_version 1623450 (0.0009) [2023-12-26 12:33:32,634][123090] Updated weights for policy 1, policy_version 1612776 (0.0011) [2023-12-26 12:33:32,663][123091] Updated weights for policy 0, policy_version 1623460 (0.0008) [2023-12-26 12:33:32,701][123090] Updated weights for policy 1, policy_version 1612786 (0.0010) [2023-12-26 12:33:32,722][123091] Updated weights for policy 0, policy_version 1623470 (0.0008) [2023-12-26 12:33:32,767][123090] Updated weights for policy 1, policy_version 1612796 (0.0011) [2023-12-26 12:33:33,548][123091] Updated weights for policy 0, policy_version 1623480 (0.0006) [2023-12-26 12:33:33,578][123090] Updated weights for policy 1, policy_version 1612806 (0.0009) [2023-12-26 12:33:33,604][123091] Updated weights for policy 0, policy_version 1623490 (0.0005) [2023-12-26 12:33:33,637][123090] Updated weights for policy 1, policy_version 1612816 (0.0010) [2023-12-26 12:33:33,656][123091] Updated weights for policy 0, policy_version 1623500 (0.0005) [2023-12-26 12:33:33,691][123090] Updated weights for policy 1, policy_version 1612826 (0.0008) [2023-12-26 12:33:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 828506112. Throughput: 0: 8807.7, 1: 8870.6. Samples: 828511740. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:33,785][121949] Avg episode reward: [(0, '6388.562'), (1, '5236.911')] [2023-12-26 12:33:34,420][123090] Updated weights for policy 1, policy_version 1612836 (0.0009) [2023-12-26 12:33:34,429][123091] Updated weights for policy 0, policy_version 1623510 (0.0006) [2023-12-26 12:33:34,482][123090] Updated weights for policy 1, policy_version 1612846 (0.0006) [2023-12-26 12:33:34,487][123091] Updated weights for policy 0, policy_version 1623520 (0.0009) [2023-12-26 12:33:34,542][123091] Updated weights for policy 0, policy_version 1623530 (0.0009) [2023-12-26 12:33:34,548][123090] Updated weights for policy 1, policy_version 1612856 (0.0006) [2023-12-26 12:33:35,297][123090] Updated weights for policy 1, policy_version 1612866 (0.0007) [2023-12-26 12:33:35,364][123090] Updated weights for policy 1, policy_version 1612876 (0.0011) [2023-12-26 12:33:35,413][123091] Updated weights for policy 0, policy_version 1623540 (0.0008) [2023-12-26 12:33:35,427][123090] Updated weights for policy 1, policy_version 1612886 (0.0011) [2023-12-26 12:33:35,467][123091] Updated weights for policy 0, policy_version 1623550 (0.0009) [2023-12-26 12:33:35,487][123090] Updated weights for policy 1, policy_version 1612896 (0.0011) [2023-12-26 12:33:35,517][123091] Updated weights for policy 0, policy_version 1623560 (0.0007) [2023-12-26 12:33:36,321][123090] Updated weights for policy 1, policy_version 1612906 (0.0011) [2023-12-26 12:33:36,349][123091] Updated weights for policy 0, policy_version 1623570 (0.0008) [2023-12-26 12:33:36,385][123090] Updated weights for policy 1, policy_version 1612916 (0.0009) [2023-12-26 12:33:36,408][123091] Updated weights for policy 0, policy_version 1623580 (0.0009) [2023-12-26 12:33:36,447][123090] Updated weights for policy 1, policy_version 1612926 (0.0006) [2023-12-26 12:33:36,474][123091] Updated weights for policy 0, policy_version 1623590 (0.0010) [2023-12-26 12:33:36,535][123091] Updated weights for policy 0, policy_version 1623600 (0.0009) [2023-12-26 12:33:37,178][123090] Updated weights for policy 1, policy_version 1612936 (0.0005) [2023-12-26 12:33:37,247][123090] Updated weights for policy 1, policy_version 1612946 (0.0008) [2023-12-26 12:33:37,316][123090] Updated weights for policy 1, policy_version 1612956 (0.0011) [2023-12-26 12:33:37,390][123091] Updated weights for policy 0, policy_version 1623610 (0.0008) [2023-12-26 12:33:37,459][123091] Updated weights for policy 0, policy_version 1623620 (0.0009) [2023-12-26 12:33:37,520][123091] Updated weights for policy 0, policy_version 1623630 (0.0009) [2023-12-26 12:33:38,120][123090] Updated weights for policy 1, policy_version 1612966 (0.0007) [2023-12-26 12:33:38,172][123090] Updated weights for policy 1, policy_version 1612976 (0.0005) [2023-12-26 12:33:38,239][123090] Updated weights for policy 1, policy_version 1612986 (0.0007) [2023-12-26 12:33:38,281][123091] Updated weights for policy 0, policy_version 1623640 (0.0009) [2023-12-26 12:33:38,335][123091] Updated weights for policy 0, policy_version 1623650 (0.0010) [2023-12-26 12:33:38,398][123091] Updated weights for policy 0, policy_version 1623660 (0.0010) [2023-12-26 12:33:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 828588032. Throughput: 0: 8825.0, 1: 8878.7. Samples: 828564400. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:38,785][121949] Avg episode reward: [(0, '6336.896'), (1, '5259.833')] [2023-12-26 12:33:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001623664_415662080.pth... [2023-12-26 12:33:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001612992_412925952.pth... [2023-12-26 12:33:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001622640_415399936.pth [2023-12-26 12:33:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001611968_412663808.pth [2023-12-26 12:33:38,940][123090] Updated weights for policy 1, policy_version 1612996 (0.0008) [2023-12-26 12:33:39,006][123090] Updated weights for policy 1, policy_version 1613006 (0.0008) [2023-12-26 12:33:39,072][123090] Updated weights for policy 1, policy_version 1613016 (0.0009) [2023-12-26 12:33:39,252][123091] Updated weights for policy 0, policy_version 1623670 (0.0009) [2023-12-26 12:33:39,316][123091] Updated weights for policy 0, policy_version 1623680 (0.0009) [2023-12-26 12:33:39,405][123091] Updated weights for policy 0, policy_version 1623690 (0.0008) [2023-12-26 12:33:39,936][123090] Updated weights for policy 1, policy_version 1613026 (0.0010) [2023-12-26 12:33:40,008][123090] Updated weights for policy 1, policy_version 1613036 (0.0009) [2023-12-26 12:33:40,080][123090] Updated weights for policy 1, policy_version 1613046 (0.0010) [2023-12-26 12:33:40,143][123090] Updated weights for policy 1, policy_version 1613056 (0.0010) [2023-12-26 12:33:40,257][123091] Updated weights for policy 0, policy_version 1623700 (0.0009) [2023-12-26 12:33:40,325][123091] Updated weights for policy 0, policy_version 1623710 (0.0009) [2023-12-26 12:33:40,385][123091] Updated weights for policy 0, policy_version 1623720 (0.0009) [2023-12-26 12:33:40,995][123090] Updated weights for policy 1, policy_version 1613066 (0.0010) [2023-12-26 12:33:41,068][123090] Updated weights for policy 1, policy_version 1613076 (0.0009) [2023-12-26 12:33:41,138][123090] Updated weights for policy 1, policy_version 1613086 (0.0009) [2023-12-26 12:33:41,188][123091] Updated weights for policy 0, policy_version 1623730 (0.0009) [2023-12-26 12:33:41,251][123091] Updated weights for policy 0, policy_version 1623740 (0.0009) [2023-12-26 12:33:41,316][123091] Updated weights for policy 0, policy_version 1623750 (0.0010) [2023-12-26 12:33:41,386][123091] Updated weights for policy 0, policy_version 1623760 (0.0008) [2023-12-26 12:33:41,994][123090] Updated weights for policy 1, policy_version 1613096 (0.0009) [2023-12-26 12:33:42,068][123090] Updated weights for policy 1, policy_version 1613106 (0.0008) [2023-12-26 12:33:42,138][123090] Updated weights for policy 1, policy_version 1613116 (0.0008) [2023-12-26 12:33:42,216][123091] Updated weights for policy 0, policy_version 1623770 (0.0009) [2023-12-26 12:33:42,284][123091] Updated weights for policy 0, policy_version 1623780 (0.0010) [2023-12-26 12:33:42,354][123091] Updated weights for policy 0, policy_version 1623790 (0.0009) [2023-12-26 12:33:42,918][123090] Updated weights for policy 1, policy_version 1613126 (0.0007) [2023-12-26 12:33:42,983][123090] Updated weights for policy 1, policy_version 1613136 (0.0005) [2023-12-26 12:33:43,043][123090] Updated weights for policy 1, policy_version 1613146 (0.0006) [2023-12-26 12:33:43,167][123091] Updated weights for policy 0, policy_version 1623800 (0.0007) [2023-12-26 12:33:43,217][123091] Updated weights for policy 0, policy_version 1623810 (0.0005) [2023-12-26 12:33:43,261][123091] Updated weights for policy 0, policy_version 1623820 (0.0005) [2023-12-26 12:33:43,706][123090] Updated weights for policy 1, policy_version 1613156 (0.0008) [2023-12-26 12:33:43,755][123090] Updated weights for policy 1, policy_version 1613166 (0.0010) [2023-12-26 12:33:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 828669952. Throughput: 0: 8758.7, 1: 8802.8. Samples: 828666324. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:43,784][121949] Avg episode reward: [(0, '6338.076'), (1, '5477.286')] [2023-12-26 12:33:43,803][123090] Updated weights for policy 1, policy_version 1613176 (0.0010) [2023-12-26 12:33:43,961][123091] Updated weights for policy 0, policy_version 1623830 (0.0008) [2023-12-26 12:33:44,024][123091] Updated weights for policy 0, policy_version 1623840 (0.0009) [2023-12-26 12:33:44,090][123091] Updated weights for policy 0, policy_version 1623850 (0.0007) [2023-12-26 12:33:44,671][123090] Updated weights for policy 1, policy_version 1613186 (0.0010) [2023-12-26 12:33:44,727][123090] Updated weights for policy 1, policy_version 1613196 (0.0010) [2023-12-26 12:33:44,748][123091] Updated weights for policy 0, policy_version 1623860 (0.0006) [2023-12-26 12:33:44,789][123090] Updated weights for policy 1, policy_version 1613206 (0.0009) [2023-12-26 12:33:44,815][123091] Updated weights for policy 0, policy_version 1623870 (0.0010) [2023-12-26 12:33:44,856][123090] Updated weights for policy 1, policy_version 1613216 (0.0007) [2023-12-26 12:33:44,877][123091] Updated weights for policy 0, policy_version 1623880 (0.0009) [2023-12-26 12:33:45,582][123091] Updated weights for policy 0, policy_version 1623890 (0.0008) [2023-12-26 12:33:45,635][123090] Updated weights for policy 1, policy_version 1613226 (0.0008) [2023-12-26 12:33:45,645][123091] Updated weights for policy 0, policy_version 1623900 (0.0010) [2023-12-26 12:33:45,683][123090] Updated weights for policy 1, policy_version 1613236 (0.0010) [2023-12-26 12:33:45,695][123091] Updated weights for policy 0, policy_version 1623910 (0.0010) [2023-12-26 12:33:45,735][123090] Updated weights for policy 1, policy_version 1613246 (0.0010) [2023-12-26 12:33:45,753][123091] Updated weights for policy 0, policy_version 1623920 (0.0010) [2023-12-26 12:33:46,449][123090] Updated weights for policy 1, policy_version 1613256 (0.0006) [2023-12-26 12:33:46,513][123090] Updated weights for policy 1, policy_version 1613266 (0.0006) [2023-12-26 12:33:46,580][123090] Updated weights for policy 1, policy_version 1613276 (0.0008) [2023-12-26 12:33:46,580][123091] Updated weights for policy 0, policy_version 1623930 (0.0010) [2023-12-26 12:33:46,631][123091] Updated weights for policy 0, policy_version 1623940 (0.0010) [2023-12-26 12:33:46,678][123091] Updated weights for policy 0, policy_version 1623950 (0.0010) [2023-12-26 12:33:47,357][123090] Updated weights for policy 1, policy_version 1613286 (0.0010) [2023-12-26 12:33:47,424][123090] Updated weights for policy 1, policy_version 1613296 (0.0010) [2023-12-26 12:33:47,473][123090] Updated weights for policy 1, policy_version 1613306 (0.0010) [2023-12-26 12:33:47,537][123091] Updated weights for policy 0, policy_version 1623960 (0.0010) [2023-12-26 12:33:47,588][123091] Updated weights for policy 0, policy_version 1623970 (0.0010) [2023-12-26 12:33:47,646][123091] Updated weights for policy 0, policy_version 1623980 (0.0010) [2023-12-26 12:33:48,304][123090] Updated weights for policy 1, policy_version 1613316 (0.0008) [2023-12-26 12:33:48,381][123090] Updated weights for policy 1, policy_version 1613326 (0.0009) [2023-12-26 12:33:48,445][123090] Updated weights for policy 1, policy_version 1613336 (0.0010) [2023-12-26 12:33:48,467][123091] Updated weights for policy 0, policy_version 1623990 (0.0010) [2023-12-26 12:33:48,526][123091] Updated weights for policy 0, policy_version 1624000 (0.0010) [2023-12-26 12:33:48,585][123091] Updated weights for policy 0, policy_version 1624010 (0.0010) [2023-12-26 12:33:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 828768256. Throughput: 0: 8814.0, 1: 8825.6. Samples: 828776392. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:48,784][121949] Avg episode reward: [(0, '6335.274'), (1, '5736.853')] [2023-12-26 12:33:49,253][123090] Updated weights for policy 1, policy_version 1613346 (0.0010) [2023-12-26 12:33:49,323][123090] Updated weights for policy 1, policy_version 1613356 (0.0010) [2023-12-26 12:33:49,395][123090] Updated weights for policy 1, policy_version 1613366 (0.0010) [2023-12-26 12:33:49,448][123090] Updated weights for policy 1, policy_version 1613376 (0.0009) [2023-12-26 12:33:49,466][123091] Updated weights for policy 0, policy_version 1624020 (0.0010) [2023-12-26 12:33:49,526][123091] Updated weights for policy 0, policy_version 1624030 (0.0009) [2023-12-26 12:33:49,592][123091] Updated weights for policy 0, policy_version 1624040 (0.0009) [2023-12-26 12:33:50,238][123090] Updated weights for policy 1, policy_version 1613386 (0.0005) [2023-12-26 12:33:50,304][123090] Updated weights for policy 1, policy_version 1613396 (0.0008) [2023-12-26 12:33:50,364][123090] Updated weights for policy 1, policy_version 1613406 (0.0009) [2023-12-26 12:33:50,457][123091] Updated weights for policy 0, policy_version 1624050 (0.0006) [2023-12-26 12:33:50,516][123091] Updated weights for policy 0, policy_version 1624060 (0.0010) [2023-12-26 12:33:50,568][123091] Updated weights for policy 0, policy_version 1624070 (0.0009) [2023-12-26 12:33:50,633][123091] Updated weights for policy 0, policy_version 1624080 (0.0009) [2023-12-26 12:33:51,013][123090] Updated weights for policy 1, policy_version 1613416 (0.0006) [2023-12-26 12:33:51,082][123090] Updated weights for policy 1, policy_version 1613426 (0.0007) [2023-12-26 12:33:51,156][123090] Updated weights for policy 1, policy_version 1613436 (0.0007) [2023-12-26 12:33:51,521][123091] Updated weights for policy 0, policy_version 1624090 (0.0005) [2023-12-26 12:33:51,576][123091] Updated weights for policy 0, policy_version 1624100 (0.0007) [2023-12-26 12:33:51,643][123091] Updated weights for policy 0, policy_version 1624110 (0.0008) [2023-12-26 12:33:52,001][123090] Updated weights for policy 1, policy_version 1613446 (0.0009) [2023-12-26 12:33:52,065][123090] Updated weights for policy 1, policy_version 1613456 (0.0009) [2023-12-26 12:33:52,121][123090] Updated weights for policy 1, policy_version 1613466 (0.0008) [2023-12-26 12:33:52,461][123091] Updated weights for policy 0, policy_version 1624120 (0.0011) [2023-12-26 12:33:52,528][123091] Updated weights for policy 0, policy_version 1624130 (0.0011) [2023-12-26 12:33:52,591][123091] Updated weights for policy 0, policy_version 1624140 (0.0011) [2023-12-26 12:33:52,959][123090] Updated weights for policy 1, policy_version 1613476 (0.0009) [2023-12-26 12:33:53,008][123090] Updated weights for policy 1, policy_version 1613486 (0.0008) [2023-12-26 12:33:53,063][123090] Updated weights for policy 1, policy_version 1613496 (0.0008) [2023-12-26 12:33:53,411][123091] Updated weights for policy 0, policy_version 1624150 (0.0011) [2023-12-26 12:33:53,476][123091] Updated weights for policy 0, policy_version 1624160 (0.0010) [2023-12-26 12:33:53,528][123091] Updated weights for policy 0, policy_version 1624170 (0.0010) [2023-12-26 12:33:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 828850176. Throughput: 0: 8752.9, 1: 8838.1. Samples: 828828212. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:53,785][121949] Avg episode reward: [(0, '6307.300'), (1, '5767.411')] [2023-12-26 12:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001624176_415793152.pth... [2023-12-26 12:33:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001613504_413057024.pth... [2023-12-26 12:33:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001623152_415531008.pth [2023-12-26 12:33:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001612480_412794880.pth [2023-12-26 12:33:53,801][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001624176_415793152.pth [2023-12-26 12:33:53,802][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001613504_413057024.pth [2023-12-26 12:33:53,846][123090] Updated weights for policy 1, policy_version 1613506 (0.0008) [2023-12-26 12:33:53,917][123090] Updated weights for policy 1, policy_version 1613516 (0.0009) [2023-12-26 12:33:53,980][123090] Updated weights for policy 1, policy_version 1613526 (0.0008) [2023-12-26 12:33:54,041][123090] Updated weights for policy 1, policy_version 1613536 (0.0009) [2023-12-26 12:33:54,353][123091] Updated weights for policy 0, policy_version 1624180 (0.0011) [2023-12-26 12:33:54,425][123091] Updated weights for policy 0, policy_version 1624190 (0.0011) [2023-12-26 12:33:54,491][123091] Updated weights for policy 0, policy_version 1624200 (0.0011) [2023-12-26 12:33:54,828][123090] Updated weights for policy 1, policy_version 1613546 (0.0009) [2023-12-26 12:33:54,881][123090] Updated weights for policy 1, policy_version 1613556 (0.0009) [2023-12-26 12:33:54,948][123090] Updated weights for policy 1, policy_version 1613566 (0.0009) [2023-12-26 12:33:55,254][123091] Updated weights for policy 0, policy_version 1624210 (0.0010) [2023-12-26 12:33:55,307][123091] Updated weights for policy 0, policy_version 1624220 (0.0005) [2023-12-26 12:33:55,360][123091] Updated weights for policy 0, policy_version 1624230 (0.0005) [2023-12-26 12:33:55,411][123091] Updated weights for policy 0, policy_version 1624240 (0.0005) [2023-12-26 12:33:55,794][123090] Updated weights for policy 1, policy_version 1613576 (0.0009) [2023-12-26 12:33:55,847][123090] Updated weights for policy 1, policy_version 1613586 (0.0009) [2023-12-26 12:33:55,909][123090] Updated weights for policy 1, policy_version 1613596 (0.0010) [2023-12-26 12:33:56,150][123091] Updated weights for policy 0, policy_version 1624250 (0.0010) [2023-12-26 12:33:56,222][123091] Updated weights for policy 0, policy_version 1624260 (0.0005) [2023-12-26 12:33:56,282][123091] Updated weights for policy 0, policy_version 1624270 (0.0005) [2023-12-26 12:33:56,817][123090] Updated weights for policy 1, policy_version 1613606 (0.0009) [2023-12-26 12:33:56,867][123090] Updated weights for policy 1, policy_version 1613616 (0.0009) [2023-12-26 12:33:56,915][123090] Updated weights for policy 1, policy_version 1613626 (0.0008) [2023-12-26 12:33:57,029][123091] Updated weights for policy 0, policy_version 1624280 (0.0009) [2023-12-26 12:33:57,080][123091] Updated weights for policy 0, policy_version 1624290 (0.0005) [2023-12-26 12:33:57,133][123091] Updated weights for policy 0, policy_version 1624300 (0.0006) [2023-12-26 12:33:57,706][123090] Updated weights for policy 1, policy_version 1613636 (0.0009) [2023-12-26 12:33:57,756][123090] Updated weights for policy 1, policy_version 1613646 (0.0008) [2023-12-26 12:33:57,804][123090] Updated weights for policy 1, policy_version 1613656 (0.0008) [2023-12-26 12:33:57,927][123091] Updated weights for policy 0, policy_version 1624310 (0.0008) [2023-12-26 12:33:57,985][123091] Updated weights for policy 0, policy_version 1624320 (0.0010) [2023-12-26 12:33:58,047][123091] Updated weights for policy 0, policy_version 1624330 (0.0010) [2023-12-26 12:33:58,605][123090] Updated weights for policy 1, policy_version 1613666 (0.0008) [2023-12-26 12:33:58,675][123090] Updated weights for policy 1, policy_version 1613676 (0.0008) [2023-12-26 12:33:58,752][123090] Updated weights for policy 1, policy_version 1613686 (0.0007) [2023-12-26 12:33:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 828932096. Throughput: 0: 8764.6, 1: 8809.7. Samples: 828933220. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:33:58,785][121949] Avg episode reward: [(0, '6292.955'), (1, '5836.255')] [2023-12-26 12:33:58,831][123090] Updated weights for policy 1, policy_version 1613696 (0.0007) [2023-12-26 12:33:58,853][123091] Updated weights for policy 0, policy_version 1624340 (0.0011) [2023-12-26 12:33:58,917][123091] Updated weights for policy 0, policy_version 1624350 (0.0011) [2023-12-26 12:33:58,973][123091] Updated weights for policy 0, policy_version 1624360 (0.0011) [2023-12-26 12:33:59,671][123090] Updated weights for policy 1, policy_version 1613706 (0.0009) [2023-12-26 12:33:59,727][123090] Updated weights for policy 1, policy_version 1613716 (0.0009) [2023-12-26 12:33:59,783][123090] Updated weights for policy 1, policy_version 1613726 (0.0009) [2023-12-26 12:33:59,853][123091] Updated weights for policy 0, policy_version 1624370 (0.0011) [2023-12-26 12:33:59,921][123091] Updated weights for policy 0, policy_version 1624380 (0.0011) [2023-12-26 12:33:59,991][123091] Updated weights for policy 0, policy_version 1624390 (0.0011) [2023-12-26 12:34:00,063][123091] Updated weights for policy 0, policy_version 1624400 (0.0008) [2023-12-26 12:34:00,645][123090] Updated weights for policy 1, policy_version 1613736 (0.0006) [2023-12-26 12:34:00,692][123090] Updated weights for policy 1, policy_version 1613746 (0.0005) [2023-12-26 12:34:00,720][123091] Updated weights for policy 0, policy_version 1624410 (0.0010) [2023-12-26 12:34:00,743][123090] Updated weights for policy 1, policy_version 1613756 (0.0007) [2023-12-26 12:34:00,764][123091] Updated weights for policy 0, policy_version 1624420 (0.0010) [2023-12-26 12:34:00,810][123091] Updated weights for policy 0, policy_version 1624430 (0.0010) [2023-12-26 12:34:01,511][123090] Updated weights for policy 1, policy_version 1613766 (0.0009) [2023-12-26 12:34:01,569][123090] Updated weights for policy 1, policy_version 1613776 (0.0008) [2023-12-26 12:34:01,618][123091] Updated weights for policy 0, policy_version 1624440 (0.0008) [2023-12-26 12:34:01,630][123090] Updated weights for policy 1, policy_version 1613786 (0.0009) [2023-12-26 12:34:01,675][123091] Updated weights for policy 0, policy_version 1624450 (0.0008) [2023-12-26 12:34:01,745][123091] Updated weights for policy 0, policy_version 1624460 (0.0010) [2023-12-26 12:34:02,392][123090] Updated weights for policy 1, policy_version 1613796 (0.0008) [2023-12-26 12:34:02,449][123090] Updated weights for policy 1, policy_version 1613806 (0.0009) [2023-12-26 12:34:02,511][123090] Updated weights for policy 1, policy_version 1613816 (0.0008) [2023-12-26 12:34:02,518][123091] Updated weights for policy 0, policy_version 1624470 (0.0007) [2023-12-26 12:34:02,570][123091] Updated weights for policy 0, policy_version 1624480 (0.0005) [2023-12-26 12:34:02,629][123091] Updated weights for policy 0, policy_version 1624490 (0.0005) [2023-12-26 12:34:03,284][123091] Updated weights for policy 0, policy_version 1624500 (0.0008) [2023-12-26 12:34:03,327][123091] Updated weights for policy 0, policy_version 1624510 (0.0010) [2023-12-26 12:34:03,384][123091] Updated weights for policy 0, policy_version 1624520 (0.0010) [2023-12-26 12:34:03,420][123090] Updated weights for policy 1, policy_version 1613826 (0.0008) [2023-12-26 12:34:03,474][123090] Updated weights for policy 1, policy_version 1613836 (0.0008) [2023-12-26 12:34:03,522][123090] Updated weights for policy 1, policy_version 1613846 (0.0008) [2023-12-26 12:34:03,578][123090] Updated weights for policy 1, policy_version 1613856 (0.0009) [2023-12-26 12:34:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 829030400. Throughput: 0: 8772.6, 1: 8799.6. Samples: 829038868. Policy #0 lag: (min: 7.0, avg: 14.7, max: 39.0) [2023-12-26 12:34:03,785][121949] Avg episode reward: [(0, '6220.160'), (1, '5948.121')] [2023-12-26 12:34:04,229][123091] Updated weights for policy 0, policy_version 1624530 (0.0010) [2023-12-26 12:34:04,284][123091] Updated weights for policy 0, policy_version 1624540 (0.0011) [2023-12-26 12:34:04,351][123091] Updated weights for policy 0, policy_version 1624550 (0.0011) [2023-12-26 12:34:04,418][123091] Updated weights for policy 0, policy_version 1624560 (0.0011) [2023-12-26 12:34:04,443][123090] Updated weights for policy 1, policy_version 1613866 (0.0007) [2023-12-26 12:34:04,516][123090] Updated weights for policy 1, policy_version 1613876 (0.0009) [2023-12-26 12:34:04,585][123090] Updated weights for policy 1, policy_version 1613886 (0.0009) [2023-12-26 12:34:05,150][123091] Updated weights for policy 0, policy_version 1624570 (0.0006) [2023-12-26 12:34:05,209][123091] Updated weights for policy 0, policy_version 1624580 (0.0005) [2023-12-26 12:34:05,233][123090] Updated weights for policy 1, policy_version 1613896 (0.0007) [2023-12-26 12:34:05,255][123091] Updated weights for policy 0, policy_version 1624590 (0.0007) [2023-12-26 12:34:05,288][123090] Updated weights for policy 1, policy_version 1613906 (0.0010) [2023-12-26 12:34:05,336][123090] Updated weights for policy 1, policy_version 1613916 (0.0009) [2023-12-26 12:34:05,950][123091] Updated weights for policy 0, policy_version 1624600 (0.0010) [2023-12-26 12:34:06,007][123091] Updated weights for policy 0, policy_version 1624612 (0.0011) [2023-12-26 12:34:06,065][123091] Updated weights for policy 0, policy_version 1624622 (0.0011) [2023-12-26 12:34:06,100][123090] Updated weights for policy 1, policy_version 1613926 (0.0009) [2023-12-26 12:34:06,175][123090] Updated weights for policy 1, policy_version 1613936 (0.0009) [2023-12-26 12:34:06,244][123090] Updated weights for policy 1, policy_version 1613946 (0.0011) [2023-12-26 12:34:06,947][123091] Updated weights for policy 0, policy_version 1624632 (0.0006) [2023-12-26 12:34:06,957][123090] Updated weights for policy 1, policy_version 1613956 (0.0011) [2023-12-26 12:34:07,009][123090] Updated weights for policy 1, policy_version 1613966 (0.0010) [2023-12-26 12:34:07,023][123091] Updated weights for policy 0, policy_version 1624642 (0.0005) [2023-12-26 12:34:07,065][123090] Updated weights for policy 1, policy_version 1613976 (0.0010) [2023-12-26 12:34:07,090][123091] Updated weights for policy 0, policy_version 1624652 (0.0007) [2023-12-26 12:34:07,822][123091] Updated weights for policy 0, policy_version 1624662 (0.0008) [2023-12-26 12:34:07,827][123090] Updated weights for policy 1, policy_version 1613986 (0.0008) [2023-12-26 12:34:07,883][123091] Updated weights for policy 0, policy_version 1624672 (0.0007) [2023-12-26 12:34:07,896][123090] Updated weights for policy 1, policy_version 1613996 (0.0009) [2023-12-26 12:34:07,949][123091] Updated weights for policy 0, policy_version 1624682 (0.0006) [2023-12-26 12:34:07,966][123090] Updated weights for policy 1, policy_version 1614006 (0.0006) [2023-12-26 12:34:08,036][123090] Updated weights for policy 1, policy_version 1614016 (0.0005) [2023-12-26 12:34:08,573][123091] Updated weights for policy 0, policy_version 1624692 (0.0007) [2023-12-26 12:34:08,641][123091] Updated weights for policy 0, policy_version 1624702 (0.0006) [2023-12-26 12:34:08,715][123091] Updated weights for policy 0, policy_version 1624712 (0.0006) [2023-12-26 12:34:08,761][123090] Updated weights for policy 1, policy_version 1614026 (0.0005) [2023-12-26 12:34:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 829120512. Throughput: 0: 8821.4, 1: 8837.1. Samples: 829093960. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:08,785][121949] Avg episode reward: [(0, '6192.265'), (1, '5879.368')] [2023-12-26 12:34:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001624720_415932416.pth... [2023-12-26 12:34:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001623664_415662080.pth [2023-12-26 12:34:08,826][123090] Updated weights for policy 1, policy_version 1614036 (0.0009) [2023-12-26 12:34:08,889][123090] Updated weights for policy 1, policy_version 1614046 (0.0011) [2023-12-26 12:34:08,901][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001614048_413196288.pth... [2023-12-26 12:34:08,905][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001612992_412925952.pth [2023-12-26 12:34:09,409][123091] Updated weights for policy 0, policy_version 1624722 (0.0007) [2023-12-26 12:34:09,466][123091] Updated weights for policy 0, policy_version 1624732 (0.0009) [2023-12-26 12:34:09,532][123091] Updated weights for policy 0, policy_version 1624742 (0.0009) [2023-12-26 12:34:09,598][123091] Updated weights for policy 0, policy_version 1624752 (0.0009) [2023-12-26 12:34:09,733][123090] Updated weights for policy 1, policy_version 1614056 (0.0011) [2023-12-26 12:34:09,805][123090] Updated weights for policy 1, policy_version 1614066 (0.0011) [2023-12-26 12:34:09,873][123090] Updated weights for policy 1, policy_version 1614076 (0.0009) [2023-12-26 12:34:10,438][123091] Updated weights for policy 0, policy_version 1624762 (0.0006) [2023-12-26 12:34:10,499][123091] Updated weights for policy 0, policy_version 1624772 (0.0009) [2023-12-26 12:34:10,548][123091] Updated weights for policy 0, policy_version 1624782 (0.0009) [2023-12-26 12:34:10,726][123090] Updated weights for policy 1, policy_version 1614086 (0.0009) [2023-12-26 12:34:10,773][123090] Updated weights for policy 1, policy_version 1614096 (0.0010) [2023-12-26 12:34:10,821][123090] Updated weights for policy 1, policy_version 1614106 (0.0010) [2023-12-26 12:34:11,384][123091] Updated weights for policy 0, policy_version 1624792 (0.0009) [2023-12-26 12:34:11,450][123091] Updated weights for policy 0, policy_version 1624802 (0.0009) [2023-12-26 12:34:11,509][123091] Updated weights for policy 0, policy_version 1624812 (0.0010) [2023-12-26 12:34:11,627][123090] Updated weights for policy 1, policy_version 1614116 (0.0009) [2023-12-26 12:34:11,694][123090] Updated weights for policy 1, policy_version 1614126 (0.0010) [2023-12-26 12:34:11,768][123090] Updated weights for policy 1, policy_version 1614136 (0.0008) [2023-12-26 12:34:12,399][123091] Updated weights for policy 0, policy_version 1624822 (0.0010) [2023-12-26 12:34:12,466][123091] Updated weights for policy 0, policy_version 1624832 (0.0011) [2023-12-26 12:34:12,511][123090] Updated weights for policy 1, policy_version 1614146 (0.0006) [2023-12-26 12:34:12,525][123091] Updated weights for policy 0, policy_version 1624842 (0.0011) [2023-12-26 12:34:12,570][123090] Updated weights for policy 1, policy_version 1614156 (0.0008) [2023-12-26 12:34:12,632][123090] Updated weights for policy 1, policy_version 1614166 (0.0009) [2023-12-26 12:34:12,694][123090] Updated weights for policy 1, policy_version 1614176 (0.0009) [2023-12-26 12:34:13,290][123091] Updated weights for policy 0, policy_version 1624852 (0.0009) [2023-12-26 12:34:13,356][123091] Updated weights for policy 0, policy_version 1624862 (0.0008) [2023-12-26 12:34:13,370][123090] Updated weights for policy 1, policy_version 1614186 (0.0005) [2023-12-26 12:34:13,424][123091] Updated weights for policy 0, policy_version 1624872 (0.0010) [2023-12-26 12:34:13,443][123090] Updated weights for policy 1, policy_version 1614196 (0.0005) [2023-12-26 12:34:13,519][123090] Updated weights for policy 1, policy_version 1614206 (0.0005) [2023-12-26 12:34:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 829210624. Throughput: 0: 8839.9, 1: 8847.1. Samples: 829201632. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:13,784][121949] Avg episode reward: [(0, '6164.673'), (1, '5893.699')] [2023-12-26 12:34:14,073][123091] Updated weights for policy 0, policy_version 1624882 (0.0008) [2023-12-26 12:34:14,140][123091] Updated weights for policy 0, policy_version 1624892 (0.0005) [2023-12-26 12:34:14,206][123090] Updated weights for policy 1, policy_version 1614216 (0.0005) [2023-12-26 12:34:14,208][123091] Updated weights for policy 0, policy_version 1624902 (0.0005) [2023-12-26 12:34:14,267][123091] Updated weights for policy 0, policy_version 1624912 (0.0005) [2023-12-26 12:34:14,270][123090] Updated weights for policy 1, policy_version 1614226 (0.0008) [2023-12-26 12:34:14,333][123090] Updated weights for policy 1, policy_version 1614236 (0.0010) [2023-12-26 12:34:14,940][123091] Updated weights for policy 0, policy_version 1624922 (0.0007) [2023-12-26 12:34:15,021][123091] Updated weights for policy 0, policy_version 1624932 (0.0006) [2023-12-26 12:34:15,081][123091] Updated weights for policy 0, policy_version 1624942 (0.0011) [2023-12-26 12:34:15,099][123090] Updated weights for policy 1, policy_version 1614246 (0.0009) [2023-12-26 12:34:15,163][123090] Updated weights for policy 1, policy_version 1614256 (0.0009) [2023-12-26 12:34:15,232][123090] Updated weights for policy 1, policy_version 1614266 (0.0011) [2023-12-26 12:34:15,847][123091] Updated weights for policy 0, policy_version 1624952 (0.0011) [2023-12-26 12:34:15,898][123091] Updated weights for policy 0, policy_version 1624962 (0.0010) [2023-12-26 12:34:15,956][123091] Updated weights for policy 0, policy_version 1624972 (0.0010) [2023-12-26 12:34:16,049][123090] Updated weights for policy 1, policy_version 1614276 (0.0010) [2023-12-26 12:34:16,109][123090] Updated weights for policy 1, policy_version 1614286 (0.0008) [2023-12-26 12:34:16,162][123090] Updated weights for policy 1, policy_version 1614296 (0.0010) [2023-12-26 12:34:16,586][123091] Updated weights for policy 0, policy_version 1624982 (0.0011) [2023-12-26 12:34:16,630][123091] Updated weights for policy 0, policy_version 1624992 (0.0010) [2023-12-26 12:34:16,677][123091] Updated weights for policy 0, policy_version 1625002 (0.0010) [2023-12-26 12:34:16,996][123090] Updated weights for policy 1, policy_version 1614306 (0.0009) [2023-12-26 12:34:17,052][123090] Updated weights for policy 1, policy_version 1614316 (0.0008) [2023-12-26 12:34:17,113][123090] Updated weights for policy 1, policy_version 1614326 (0.0009) [2023-12-26 12:34:17,173][123090] Updated weights for policy 1, policy_version 1614336 (0.0008) [2023-12-26 12:34:17,475][123091] Updated weights for policy 0, policy_version 1625012 (0.0010) [2023-12-26 12:34:17,526][123091] Updated weights for policy 0, policy_version 1625022 (0.0010) [2023-12-26 12:34:17,585][123091] Updated weights for policy 0, policy_version 1625032 (0.0007) [2023-12-26 12:34:18,042][123090] Updated weights for policy 1, policy_version 1614346 (0.0010) [2023-12-26 12:34:18,102][123090] Updated weights for policy 1, policy_version 1614356 (0.0009) [2023-12-26 12:34:18,154][123090] Updated weights for policy 1, policy_version 1614366 (0.0009) [2023-12-26 12:34:18,381][123091] Updated weights for policy 0, policy_version 1625042 (0.0008) [2023-12-26 12:34:18,443][123091] Updated weights for policy 0, policy_version 1625052 (0.0008) [2023-12-26 12:34:18,501][123091] Updated weights for policy 0, policy_version 1625062 (0.0010) [2023-12-26 12:34:18,560][123091] Updated weights for policy 0, policy_version 1625072 (0.0009) [2023-12-26 12:34:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 829300736. Throughput: 0: 8927.9, 1: 8836.4. Samples: 829311132. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:18,785][121949] Avg episode reward: [(0, '6241.273'), (1, '5870.771')] [2023-12-26 12:34:18,991][123090] Updated weights for policy 1, policy_version 1614376 (0.0006) [2023-12-26 12:34:19,052][123090] Updated weights for policy 1, policy_version 1614386 (0.0010) [2023-12-26 12:34:19,104][123090] Updated weights for policy 1, policy_version 1614396 (0.0010) [2023-12-26 12:34:19,197][123091] Updated weights for policy 0, policy_version 1625082 (0.0008) [2023-12-26 12:34:19,254][123091] Updated weights for policy 0, policy_version 1625092 (0.0008) [2023-12-26 12:34:19,315][123091] Updated weights for policy 0, policy_version 1625102 (0.0008) [2023-12-26 12:34:19,990][123090] Updated weights for policy 1, policy_version 1614406 (0.0008) [2023-12-26 12:34:20,062][123090] Updated weights for policy 1, policy_version 1614416 (0.0011) [2023-12-26 12:34:20,129][123090] Updated weights for policy 1, policy_version 1614426 (0.0011) [2023-12-26 12:34:20,140][123091] Updated weights for policy 0, policy_version 1625112 (0.0007) [2023-12-26 12:34:20,207][123091] Updated weights for policy 0, policy_version 1625122 (0.0008) [2023-12-26 12:34:20,276][123091] Updated weights for policy 0, policy_version 1625132 (0.0008) [2023-12-26 12:34:20,949][123090] Updated weights for policy 1, policy_version 1614436 (0.0011) [2023-12-26 12:34:21,016][123090] Updated weights for policy 1, policy_version 1614446 (0.0011) [2023-12-26 12:34:21,085][123090] Updated weights for policy 1, policy_version 1614456 (0.0011) [2023-12-26 12:34:21,097][123091] Updated weights for policy 0, policy_version 1625142 (0.0007) [2023-12-26 12:34:21,161][123091] Updated weights for policy 0, policy_version 1625152 (0.0008) [2023-12-26 12:34:21,228][123091] Updated weights for policy 0, policy_version 1625162 (0.0008) [2023-12-26 12:34:21,951][123090] Updated weights for policy 1, policy_version 1614466 (0.0009) [2023-12-26 12:34:22,020][123091] Updated weights for policy 0, policy_version 1625172 (0.0008) [2023-12-26 12:34:22,025][123090] Updated weights for policy 1, policy_version 1614476 (0.0009) [2023-12-26 12:34:22,084][123091] Updated weights for policy 0, policy_version 1625182 (0.0008) [2023-12-26 12:34:22,099][123090] Updated weights for policy 1, policy_version 1614486 (0.0007) [2023-12-26 12:34:22,142][123091] Updated weights for policy 0, policy_version 1625193 (0.0009) [2023-12-26 12:34:22,179][123090] Updated weights for policy 1, policy_version 1614496 (0.0006) [2023-12-26 12:34:22,871][123090] Updated weights for policy 1, policy_version 1614506 (0.0010) [2023-12-26 12:34:22,920][123090] Updated weights for policy 1, policy_version 1614516 (0.0009) [2023-12-26 12:34:22,970][123090] Updated weights for policy 1, policy_version 1614526 (0.0009) [2023-12-26 12:34:23,036][123091] Updated weights for policy 0, policy_version 1625203 (0.0009) [2023-12-26 12:34:23,096][123091] Updated weights for policy 0, policy_version 1625213 (0.0009) [2023-12-26 12:34:23,165][123091] Updated weights for policy 0, policy_version 1625223 (0.0010) [2023-12-26 12:34:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 829382656. Throughput: 0: 8966.8, 1: 8788.2. Samples: 829363376. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:23,785][121949] Avg episode reward: [(0, '6285.500'), (1, '5494.188')] [2023-12-26 12:34:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001625232_416063488.pth... [2023-12-26 12:34:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001624176_415793152.pth [2023-12-26 12:34:23,823][123090] Updated weights for policy 1, policy_version 1614536 (0.0008) [2023-12-26 12:34:23,892][123090] Updated weights for policy 1, policy_version 1614546 (0.0011) [2023-12-26 12:34:23,943][123090] Updated weights for policy 1, policy_version 1614556 (0.0007) [2023-12-26 12:34:23,964][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001614560_413327360.pth... [2023-12-26 12:34:23,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001613504_413057024.pth [2023-12-26 12:34:23,995][123091] Updated weights for policy 0, policy_version 1625233 (0.0009) [2023-12-26 12:34:24,050][123091] Updated weights for policy 0, policy_version 1625243 (0.0009) [2023-12-26 12:34:24,117][123091] Updated weights for policy 0, policy_version 1625253 (0.0005) [2023-12-26 12:34:24,171][123091] Updated weights for policy 0, policy_version 1625263 (0.0007) [2023-12-26 12:34:24,693][123090] Updated weights for policy 1, policy_version 1614566 (0.0005) [2023-12-26 12:34:24,745][123090] Updated weights for policy 1, policy_version 1614576 (0.0005) [2023-12-26 12:34:24,788][123090] Updated weights for policy 1, policy_version 1614586 (0.0005) [2023-12-26 12:34:25,048][123091] Updated weights for policy 0, policy_version 1625273 (0.0006) [2023-12-26 12:34:25,121][123091] Updated weights for policy 0, policy_version 1625283 (0.0006) [2023-12-26 12:34:25,171][123091] Updated weights for policy 0, policy_version 1625293 (0.0008) [2023-12-26 12:34:25,516][123090] Updated weights for policy 1, policy_version 1614596 (0.0008) [2023-12-26 12:34:25,577][123090] Updated weights for policy 1, policy_version 1614606 (0.0011) [2023-12-26 12:34:25,638][123090] Updated weights for policy 1, policy_version 1614616 (0.0011) [2023-12-26 12:34:25,817][123091] Updated weights for policy 0, policy_version 1625303 (0.0009) [2023-12-26 12:34:25,874][123091] Updated weights for policy 0, policy_version 1625313 (0.0011) [2023-12-26 12:34:25,931][123091] Updated weights for policy 0, policy_version 1625323 (0.0011) [2023-12-26 12:34:26,456][123090] Updated weights for policy 1, policy_version 1614626 (0.0009) [2023-12-26 12:34:26,527][123090] Updated weights for policy 1, policy_version 1614636 (0.0008) [2023-12-26 12:34:26,596][123090] Updated weights for policy 1, policy_version 1614646 (0.0009) [2023-12-26 12:34:26,665][123090] Updated weights for policy 1, policy_version 1614656 (0.0008) [2023-12-26 12:34:26,766][123091] Updated weights for policy 0, policy_version 1625333 (0.0011) [2023-12-26 12:34:26,815][123091] Updated weights for policy 0, policy_version 1625343 (0.0010) [2023-12-26 12:34:26,863][123091] Updated weights for policy 0, policy_version 1625353 (0.0010) [2023-12-26 12:34:27,403][123090] Updated weights for policy 1, policy_version 1614666 (0.0008) [2023-12-26 12:34:27,455][123090] Updated weights for policy 1, policy_version 1614676 (0.0008) [2023-12-26 12:34:27,516][123090] Updated weights for policy 1, policy_version 1614686 (0.0008) [2023-12-26 12:34:27,735][123091] Updated weights for policy 0, policy_version 1625363 (0.0010) [2023-12-26 12:34:27,806][123091] Updated weights for policy 0, policy_version 1625373 (0.0011) [2023-12-26 12:34:27,865][123091] Updated weights for policy 0, policy_version 1625383 (0.0010) [2023-12-26 12:34:28,201][123090] Updated weights for policy 1, policy_version 1614696 (0.0006) [2023-12-26 12:34:28,260][123090] Updated weights for policy 1, policy_version 1614706 (0.0006) [2023-12-26 12:34:28,333][123090] Updated weights for policy 1, policy_version 1614716 (0.0009) [2023-12-26 12:34:28,673][123091] Updated weights for policy 0, policy_version 1625393 (0.0011) [2023-12-26 12:34:28,735][123091] Updated weights for policy 0, policy_version 1625403 (0.0010) [2023-12-26 12:34:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 829472768. Throughput: 0: 8995.3, 1: 8857.1. Samples: 829469680. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:28,785][121949] Avg episode reward: [(0, '6167.670'), (1, '5515.507')] [2023-12-26 12:34:28,799][123091] Updated weights for policy 0, policy_version 1625413 (0.0006) [2023-12-26 12:34:28,859][123091] Updated weights for policy 0, policy_version 1625423 (0.0005) [2023-12-26 12:34:29,103][123090] Updated weights for policy 1, policy_version 1614726 (0.0010) [2023-12-26 12:34:29,154][123090] Updated weights for policy 1, policy_version 1614736 (0.0010) [2023-12-26 12:34:29,212][123090] Updated weights for policy 1, policy_version 1614746 (0.0009) [2023-12-26 12:34:29,570][123091] Updated weights for policy 0, policy_version 1625433 (0.0006) [2023-12-26 12:34:29,638][123091] Updated weights for policy 0, policy_version 1625443 (0.0008) [2023-12-26 12:34:29,709][123091] Updated weights for policy 0, policy_version 1625453 (0.0010) [2023-12-26 12:34:30,006][123090] Updated weights for policy 1, policy_version 1614756 (0.0009) [2023-12-26 12:34:30,080][123090] Updated weights for policy 1, policy_version 1614766 (0.0005) [2023-12-26 12:34:30,150][123090] Updated weights for policy 1, policy_version 1614776 (0.0006) [2023-12-26 12:34:30,534][123091] Updated weights for policy 0, policy_version 1625463 (0.0009) [2023-12-26 12:34:30,586][123091] Updated weights for policy 0, policy_version 1625473 (0.0009) [2023-12-26 12:34:30,642][123091] Updated weights for policy 0, policy_version 1625483 (0.0009) [2023-12-26 12:34:30,867][123090] Updated weights for policy 1, policy_version 1614786 (0.0006) [2023-12-26 12:34:30,922][123090] Updated weights for policy 1, policy_version 1614796 (0.0005) [2023-12-26 12:34:30,973][123090] Updated weights for policy 1, policy_version 1614806 (0.0005) [2023-12-26 12:34:31,034][123090] Updated weights for policy 1, policy_version 1614816 (0.0007) [2023-12-26 12:34:31,545][123091] Updated weights for policy 0, policy_version 1625493 (0.0009) [2023-12-26 12:34:31,605][123091] Updated weights for policy 0, policy_version 1625503 (0.0009) [2023-12-26 12:34:31,665][123091] Updated weights for policy 0, policy_version 1625513 (0.0009) [2023-12-26 12:34:31,784][123090] Updated weights for policy 1, policy_version 1614826 (0.0007) [2023-12-26 12:34:31,848][123090] Updated weights for policy 1, policy_version 1614836 (0.0006) [2023-12-26 12:34:31,916][123090] Updated weights for policy 1, policy_version 1614846 (0.0006) [2023-12-26 12:34:32,534][123090] Updated weights for policy 1, policy_version 1614856 (0.0006) [2023-12-26 12:34:32,575][123091] Updated weights for policy 0, policy_version 1625523 (0.0009) [2023-12-26 12:34:32,597][123090] Updated weights for policy 1, policy_version 1614866 (0.0009) [2023-12-26 12:34:32,638][123091] Updated weights for policy 0, policy_version 1625533 (0.0005) [2023-12-26 12:34:32,657][123090] Updated weights for policy 1, policy_version 1614876 (0.0011) [2023-12-26 12:34:32,688][123091] Updated weights for policy 0, policy_version 1625543 (0.0005) [2023-12-26 12:34:33,398][123091] Updated weights for policy 0, policy_version 1625553 (0.0005) [2023-12-26 12:34:33,402][123090] Updated weights for policy 1, policy_version 1614886 (0.0007) [2023-12-26 12:34:33,453][123090] Updated weights for policy 1, policy_version 1614896 (0.0005) [2023-12-26 12:34:33,455][123091] Updated weights for policy 0, policy_version 1625563 (0.0005) [2023-12-26 12:34:33,511][123091] Updated weights for policy 0, policy_version 1625573 (0.0005) [2023-12-26 12:34:33,512][123090] Updated weights for policy 1, policy_version 1614906 (0.0008) [2023-12-26 12:34:33,582][123091] Updated weights for policy 0, policy_version 1625583 (0.0006) [2023-12-26 12:34:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 829571072. Throughput: 0: 8949.3, 1: 8905.8. Samples: 829579872. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:33,784][121949] Avg episode reward: [(0, '6196.625'), (1, '5699.963')] [2023-12-26 12:34:34,218][123090] Updated weights for policy 1, policy_version 1614916 (0.0008) [2023-12-26 12:34:34,279][123090] Updated weights for policy 1, policy_version 1614926 (0.0006) [2023-12-26 12:34:34,341][123091] Updated weights for policy 0, policy_version 1625593 (0.0008) [2023-12-26 12:34:34,350][123090] Updated weights for policy 1, policy_version 1614936 (0.0009) [2023-12-26 12:34:34,399][123091] Updated weights for policy 0, policy_version 1625603 (0.0006) [2023-12-26 12:34:34,453][123091] Updated weights for policy 0, policy_version 1625613 (0.0009) [2023-12-26 12:34:35,126][123090] Updated weights for policy 1, policy_version 1614946 (0.0011) [2023-12-26 12:34:35,192][123090] Updated weights for policy 1, policy_version 1614956 (0.0011) [2023-12-26 12:34:35,247][123090] Updated weights for policy 1, policy_version 1614966 (0.0010) [2023-12-26 12:34:35,250][123091] Updated weights for policy 0, policy_version 1625623 (0.0007) [2023-12-26 12:34:35,298][123091] Updated weights for policy 0, policy_version 1625633 (0.0006) [2023-12-26 12:34:35,298][123090] Updated weights for policy 1, policy_version 1614976 (0.0010) [2023-12-26 12:34:35,346][123091] Updated weights for policy 0, policy_version 1625643 (0.0009) [2023-12-26 12:34:36,087][123090] Updated weights for policy 1, policy_version 1614986 (0.0011) [2023-12-26 12:34:36,137][123091] Updated weights for policy 0, policy_version 1625653 (0.0008) [2023-12-26 12:34:36,160][123090] Updated weights for policy 1, policy_version 1614996 (0.0008) [2023-12-26 12:34:36,195][123091] Updated weights for policy 0, policy_version 1625663 (0.0009) [2023-12-26 12:34:36,235][123090] Updated weights for policy 1, policy_version 1615006 (0.0006) [2023-12-26 12:34:36,259][123091] Updated weights for policy 0, policy_version 1625673 (0.0009) [2023-12-26 12:34:36,985][123090] Updated weights for policy 1, policy_version 1615016 (0.0009) [2023-12-26 12:34:37,046][123090] Updated weights for policy 1, policy_version 1615026 (0.0009) [2023-12-26 12:34:37,057][123091] Updated weights for policy 0, policy_version 1625683 (0.0008) [2023-12-26 12:34:37,104][123090] Updated weights for policy 1, policy_version 1615036 (0.0009) [2023-12-26 12:34:37,119][123091] Updated weights for policy 0, policy_version 1625693 (0.0008) [2023-12-26 12:34:37,186][123091] Updated weights for policy 0, policy_version 1625703 (0.0010) [2023-12-26 12:34:37,930][123090] Updated weights for policy 1, policy_version 1615046 (0.0009) [2023-12-26 12:34:37,995][123091] Updated weights for policy 0, policy_version 1625713 (0.0010) [2023-12-26 12:34:37,998][123090] Updated weights for policy 1, policy_version 1615056 (0.0009) [2023-12-26 12:34:38,061][123091] Updated weights for policy 0, policy_version 1625723 (0.0010) [2023-12-26 12:34:38,064][123090] Updated weights for policy 1, policy_version 1615066 (0.0007) [2023-12-26 12:34:38,131][123091] Updated weights for policy 0, policy_version 1625733 (0.0011) [2023-12-26 12:34:38,196][123091] Updated weights for policy 0, policy_version 1625743 (0.0009) [2023-12-26 12:34:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 829652992. Throughput: 0: 8998.1, 1: 8914.2. Samples: 829634268. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:38,785][121949] Avg episode reward: [(0, '6294.612'), (1, '5459.787')] [2023-12-26 12:34:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001625744_416194560.pth... [2023-12-26 12:34:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001615072_413458432.pth... [2023-12-26 12:34:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001624720_415932416.pth [2023-12-26 12:34:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001614048_413196288.pth [2023-12-26 12:34:38,833][123090] Updated weights for policy 1, policy_version 1615076 (0.0007) [2023-12-26 12:34:38,901][123090] Updated weights for policy 1, policy_version 1615086 (0.0009) [2023-12-26 12:34:38,966][123090] Updated weights for policy 1, policy_version 1615096 (0.0009) [2023-12-26 12:34:39,025][123091] Updated weights for policy 0, policy_version 1625753 (0.0006) [2023-12-26 12:34:39,087][123091] Updated weights for policy 0, policy_version 1625763 (0.0005) [2023-12-26 12:34:39,143][123091] Updated weights for policy 0, policy_version 1625773 (0.0005) [2023-12-26 12:34:39,775][123091] Updated weights for policy 0, policy_version 1625783 (0.0009) [2023-12-26 12:34:39,798][123090] Updated weights for policy 1, policy_version 1615106 (0.0009) [2023-12-26 12:34:39,837][123091] Updated weights for policy 0, policy_version 1625793 (0.0010) [2023-12-26 12:34:39,863][123090] Updated weights for policy 1, policy_version 1615116 (0.0008) [2023-12-26 12:34:39,902][123091] Updated weights for policy 0, policy_version 1625803 (0.0007) [2023-12-26 12:34:39,938][123090] Updated weights for policy 1, policy_version 1615126 (0.0009) [2023-12-26 12:34:40,002][123090] Updated weights for policy 1, policy_version 1615136 (0.0009) [2023-12-26 12:34:40,668][123091] Updated weights for policy 0, policy_version 1625813 (0.0009) [2023-12-26 12:34:40,721][123091] Updated weights for policy 0, policy_version 1625823 (0.0009) [2023-12-26 12:34:40,777][123091] Updated weights for policy 0, policy_version 1625833 (0.0009) [2023-12-26 12:34:40,840][123090] Updated weights for policy 1, policy_version 1615146 (0.0010) [2023-12-26 12:34:40,892][123090] Updated weights for policy 1, policy_version 1615156 (0.0010) [2023-12-26 12:34:40,948][123090] Updated weights for policy 1, policy_version 1615166 (0.0010) [2023-12-26 12:34:41,633][123091] Updated weights for policy 0, policy_version 1625843 (0.0007) [2023-12-26 12:34:41,704][123091] Updated weights for policy 0, policy_version 1625853 (0.0008) [2023-12-26 12:34:41,781][123091] Updated weights for policy 0, policy_version 1625863 (0.0007) [2023-12-26 12:34:41,822][123090] Updated weights for policy 1, policy_version 1615176 (0.0010) [2023-12-26 12:34:41,889][123090] Updated weights for policy 1, policy_version 1615186 (0.0009) [2023-12-26 12:34:41,961][123090] Updated weights for policy 1, policy_version 1615196 (0.0010) [2023-12-26 12:34:42,519][123091] Updated weights for policy 0, policy_version 1625873 (0.0007) [2023-12-26 12:34:42,577][123091] Updated weights for policy 0, policy_version 1625883 (0.0009) [2023-12-26 12:34:42,632][123091] Updated weights for policy 0, policy_version 1625893 (0.0009) [2023-12-26 12:34:42,696][123091] Updated weights for policy 0, policy_version 1625903 (0.0009) [2023-12-26 12:34:42,853][123090] Updated weights for policy 1, policy_version 1615206 (0.0008) [2023-12-26 12:34:42,914][123090] Updated weights for policy 1, policy_version 1615216 (0.0010) [2023-12-26 12:34:42,973][123090] Updated weights for policy 1, policy_version 1615226 (0.0009) [2023-12-26 12:34:43,519][123091] Updated weights for policy 0, policy_version 1625913 (0.0010) [2023-12-26 12:34:43,581][123091] Updated weights for policy 0, policy_version 1625923 (0.0009) [2023-12-26 12:34:43,639][123091] Updated weights for policy 0, policy_version 1625933 (0.0009) [2023-12-26 12:34:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 829743104. Throughput: 0: 8976.1, 1: 8899.2. Samples: 829737612. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:43,785][121949] Avg episode reward: [(0, '6257.395'), (1, '5633.579')] [2023-12-26 12:34:43,797][123090] Updated weights for policy 1, policy_version 1615236 (0.0010) [2023-12-26 12:34:43,865][123090] Updated weights for policy 1, policy_version 1615246 (0.0009) [2023-12-26 12:34:43,926][123090] Updated weights for policy 1, policy_version 1615256 (0.0009) [2023-12-26 12:34:44,480][123091] Updated weights for policy 0, policy_version 1625943 (0.0006) [2023-12-26 12:34:44,534][123091] Updated weights for policy 0, policy_version 1625953 (0.0009) [2023-12-26 12:34:44,587][123091] Updated weights for policy 0, policy_version 1625963 (0.0009) [2023-12-26 12:34:44,702][123090] Updated weights for policy 1, policy_version 1615266 (0.0008) [2023-12-26 12:34:44,766][123090] Updated weights for policy 1, policy_version 1615276 (0.0006) [2023-12-26 12:34:44,828][123090] Updated weights for policy 1, policy_version 1615286 (0.0008) [2023-12-26 12:34:44,886][123090] Updated weights for policy 1, policy_version 1615296 (0.0010) [2023-12-26 12:34:45,365][123091] Updated weights for policy 0, policy_version 1625974 (0.0010) [2023-12-26 12:34:45,430][123091] Updated weights for policy 0, policy_version 1625984 (0.0008) [2023-12-26 12:34:45,502][123091] Updated weights for policy 0, policy_version 1625994 (0.0006) [2023-12-26 12:34:45,770][123090] Updated weights for policy 1, policy_version 1615306 (0.0010) [2023-12-26 12:34:45,831][123090] Updated weights for policy 1, policy_version 1615316 (0.0010) [2023-12-26 12:34:45,895][123090] Updated weights for policy 1, policy_version 1615326 (0.0009) [2023-12-26 12:34:46,192][123091] Updated weights for policy 0, policy_version 1626004 (0.0010) [2023-12-26 12:34:46,243][123091] Updated weights for policy 0, policy_version 1626014 (0.0010) [2023-12-26 12:34:46,302][123091] Updated weights for policy 0, policy_version 1626024 (0.0008) [2023-12-26 12:34:46,775][123090] Updated weights for policy 1, policy_version 1615336 (0.0010) [2023-12-26 12:34:46,845][123090] Updated weights for policy 1, policy_version 1615346 (0.0010) [2023-12-26 12:34:46,921][123090] Updated weights for policy 1, policy_version 1615356 (0.0010) [2023-12-26 12:34:47,019][123091] Updated weights for policy 0, policy_version 1626034 (0.0005) [2023-12-26 12:34:47,079][123091] Updated weights for policy 0, policy_version 1626044 (0.0010) [2023-12-26 12:34:47,134][123091] Updated weights for policy 0, policy_version 1626054 (0.0010) [2023-12-26 12:34:47,182][123091] Updated weights for policy 0, policy_version 1626064 (0.0010) [2023-12-26 12:34:47,710][123090] Updated weights for policy 1, policy_version 1615366 (0.0010) [2023-12-26 12:34:47,760][123090] Updated weights for policy 1, policy_version 1615376 (0.0009) [2023-12-26 12:34:47,822][123090] Updated weights for policy 1, policy_version 1615386 (0.0009) [2023-12-26 12:34:48,021][123091] Updated weights for policy 0, policy_version 1626074 (0.0011) [2023-12-26 12:34:48,091][123091] Updated weights for policy 0, policy_version 1626084 (0.0011) [2023-12-26 12:34:48,157][123091] Updated weights for policy 0, policy_version 1626094 (0.0010) [2023-12-26 12:34:48,575][123090] Updated weights for policy 1, policy_version 1615396 (0.0010) [2023-12-26 12:34:48,639][123090] Updated weights for policy 1, policy_version 1615406 (0.0010) [2023-12-26 12:34:48,702][123090] Updated weights for policy 1, policy_version 1615416 (0.0010) [2023-12-26 12:34:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 829833216. Throughput: 0: 8975.4, 1: 8900.1. Samples: 829843264. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:48,785][121949] Avg episode reward: [(0, '6303.219'), (1, '5810.326')] [2023-12-26 12:34:48,954][123091] Updated weights for policy 0, policy_version 1626104 (0.0011) [2023-12-26 12:34:49,012][123091] Updated weights for policy 0, policy_version 1626114 (0.0010) [2023-12-26 12:34:49,066][123091] Updated weights for policy 0, policy_version 1626124 (0.0010) [2023-12-26 12:34:49,539][123090] Updated weights for policy 1, policy_version 1615426 (0.0009) [2023-12-26 12:34:49,605][123090] Updated weights for policy 1, policy_version 1615436 (0.0008) [2023-12-26 12:34:49,664][123090] Updated weights for policy 1, policy_version 1615446 (0.0008) [2023-12-26 12:34:49,726][123090] Updated weights for policy 1, policy_version 1615456 (0.0008) [2023-12-26 12:34:49,845][123091] Updated weights for policy 0, policy_version 1626134 (0.0009) [2023-12-26 12:34:49,918][123091] Updated weights for policy 0, policy_version 1626144 (0.0007) [2023-12-26 12:34:49,988][123091] Updated weights for policy 0, policy_version 1626154 (0.0007) [2023-12-26 12:34:50,515][123090] Updated weights for policy 1, policy_version 1615466 (0.0005) [2023-12-26 12:34:50,562][123090] Updated weights for policy 1, policy_version 1615476 (0.0006) [2023-12-26 12:34:50,628][123090] Updated weights for policy 1, policy_version 1615486 (0.0008) [2023-12-26 12:34:50,653][123091] Updated weights for policy 0, policy_version 1626164 (0.0006) [2023-12-26 12:34:50,720][123091] Updated weights for policy 0, policy_version 1626174 (0.0005) [2023-12-26 12:34:50,784][123091] Updated weights for policy 0, policy_version 1626184 (0.0006) [2023-12-26 12:34:51,429][123090] Updated weights for policy 1, policy_version 1615496 (0.0010) [2023-12-26 12:34:51,487][123090] Updated weights for policy 1, policy_version 1615506 (0.0009) [2023-12-26 12:34:51,524][123091] Updated weights for policy 0, policy_version 1626194 (0.0006) [2023-12-26 12:34:51,546][123090] Updated weights for policy 1, policy_version 1615516 (0.0010) [2023-12-26 12:34:51,578][123091] Updated weights for policy 0, policy_version 1626204 (0.0005) [2023-12-26 12:34:51,634][123091] Updated weights for policy 0, policy_version 1626214 (0.0010) [2023-12-26 12:34:51,690][123091] Updated weights for policy 0, policy_version 1626224 (0.0011) [2023-12-26 12:34:52,358][123090] Updated weights for policy 1, policy_version 1615526 (0.0009) [2023-12-26 12:34:52,421][123090] Updated weights for policy 1, policy_version 1615536 (0.0008) [2023-12-26 12:34:52,483][123090] Updated weights for policy 1, policy_version 1615546 (0.0011) [2023-12-26 12:34:52,534][123091] Updated weights for policy 0, policy_version 1626234 (0.0008) [2023-12-26 12:34:52,596][123091] Updated weights for policy 0, policy_version 1626244 (0.0008) [2023-12-26 12:34:52,659][123091] Updated weights for policy 0, policy_version 1626254 (0.0008) [2023-12-26 12:34:53,239][123090] Updated weights for policy 1, policy_version 1615556 (0.0010) [2023-12-26 12:34:53,305][123090] Updated weights for policy 1, policy_version 1615566 (0.0010) [2023-12-26 12:34:53,371][123090] Updated weights for policy 1, policy_version 1615576 (0.0010) [2023-12-26 12:34:53,482][123091] Updated weights for policy 0, policy_version 1626264 (0.0008) [2023-12-26 12:34:53,537][123091] Updated weights for policy 0, policy_version 1626274 (0.0009) [2023-12-26 12:34:53,596][123091] Updated weights for policy 0, policy_version 1626284 (0.0009) [2023-12-26 12:34:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 829923328. Throughput: 0: 8987.4, 1: 8867.3. Samples: 829897428. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:53,785][121949] Avg episode reward: [(0, '6349.248'), (1, '5399.445')] [2023-12-26 12:34:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001615584_413589504.pth... [2023-12-26 12:34:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001626288_416333824.pth... [2023-12-26 12:34:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001614560_413327360.pth [2023-12-26 12:34:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001625232_416063488.pth [2023-12-26 12:34:54,172][123090] Updated weights for policy 1, policy_version 1615586 (0.0009) [2023-12-26 12:34:54,248][123090] Updated weights for policy 1, policy_version 1615596 (0.0005) [2023-12-26 12:34:54,322][123090] Updated weights for policy 1, policy_version 1615606 (0.0007) [2023-12-26 12:34:54,389][123090] Updated weights for policy 1, policy_version 1615616 (0.0008) [2023-12-26 12:34:54,441][123091] Updated weights for policy 0, policy_version 1626294 (0.0008) [2023-12-26 12:34:54,492][123091] Updated weights for policy 0, policy_version 1626304 (0.0009) [2023-12-26 12:34:54,554][123091] Updated weights for policy 0, policy_version 1626314 (0.0009) [2023-12-26 12:34:55,003][123090] Updated weights for policy 1, policy_version 1615626 (0.0009) [2023-12-26 12:34:55,063][123090] Updated weights for policy 1, policy_version 1615636 (0.0009) [2023-12-26 12:34:55,131][123090] Updated weights for policy 1, policy_version 1615646 (0.0010) [2023-12-26 12:34:55,367][123091] Updated weights for policy 0, policy_version 1626324 (0.0009) [2023-12-26 12:34:55,418][123091] Updated weights for policy 0, policy_version 1626334 (0.0010) [2023-12-26 12:34:55,466][123091] Updated weights for policy 0, policy_version 1626344 (0.0009) [2023-12-26 12:34:55,866][123090] Updated weights for policy 1, policy_version 1615656 (0.0006) [2023-12-26 12:34:55,932][123090] Updated weights for policy 1, policy_version 1615666 (0.0005) [2023-12-26 12:34:55,991][123090] Updated weights for policy 1, policy_version 1615676 (0.0005) [2023-12-26 12:34:56,346][123091] Updated weights for policy 0, policy_version 1626354 (0.0009) [2023-12-26 12:34:56,399][123091] Updated weights for policy 0, policy_version 1626364 (0.0010) [2023-12-26 12:34:56,452][123091] Updated weights for policy 0, policy_version 1626374 (0.0010) [2023-12-26 12:34:56,506][123091] Updated weights for policy 0, policy_version 1626384 (0.0009) [2023-12-26 12:34:56,667][123090] Updated weights for policy 1, policy_version 1615686 (0.0005) [2023-12-26 12:34:56,724][123090] Updated weights for policy 1, policy_version 1615696 (0.0005) [2023-12-26 12:34:56,780][123090] Updated weights for policy 1, policy_version 1615706 (0.0005) [2023-12-26 12:34:57,418][123090] Updated weights for policy 1, policy_version 1615716 (0.0006) [2023-12-26 12:34:57,422][123091] Updated weights for policy 0, policy_version 1626394 (0.0005) [2023-12-26 12:34:57,471][123090] Updated weights for policy 1, policy_version 1615726 (0.0005) [2023-12-26 12:34:57,486][123091] Updated weights for policy 0, policy_version 1626404 (0.0007) [2023-12-26 12:34:57,540][123090] Updated weights for policy 1, policy_version 1615736 (0.0008) [2023-12-26 12:34:57,554][123091] Updated weights for policy 0, policy_version 1626414 (0.0008) [2023-12-26 12:34:58,343][123090] Updated weights for policy 1, policy_version 1615746 (0.0007) [2023-12-26 12:34:58,409][123091] Updated weights for policy 0, policy_version 1626424 (0.0009) [2023-12-26 12:34:58,422][123090] Updated weights for policy 1, policy_version 1615756 (0.0008) [2023-12-26 12:34:58,483][123091] Updated weights for policy 0, policy_version 1626434 (0.0009) [2023-12-26 12:34:58,497][123090] Updated weights for policy 1, policy_version 1615766 (0.0009) [2023-12-26 12:34:58,552][123091] Updated weights for policy 0, policy_version 1626444 (0.0009) [2023-12-26 12:34:58,567][123090] Updated weights for policy 1, policy_version 1615776 (0.0009) [2023-12-26 12:34:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 830013440. Throughput: 0: 8905.5, 1: 8955.0. Samples: 830005356. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:34:58,785][121949] Avg episode reward: [(0, '6315.872'), (1, '5346.284')] [2023-12-26 12:34:59,394][123091] Updated weights for policy 0, policy_version 1626454 (0.0007) [2023-12-26 12:34:59,433][123090] Updated weights for policy 1, policy_version 1615786 (0.0009) [2023-12-26 12:34:59,461][123091] Updated weights for policy 0, policy_version 1626464 (0.0007) [2023-12-26 12:34:59,495][123090] Updated weights for policy 1, policy_version 1615796 (0.0006) [2023-12-26 12:34:59,521][123091] Updated weights for policy 0, policy_version 1626474 (0.0008) [2023-12-26 12:34:59,557][123090] Updated weights for policy 1, policy_version 1615806 (0.0006) [2023-12-26 12:35:00,284][123090] Updated weights for policy 1, policy_version 1615816 (0.0009) [2023-12-26 12:35:00,336][123091] Updated weights for policy 0, policy_version 1626484 (0.0008) [2023-12-26 12:35:00,346][123090] Updated weights for policy 1, policy_version 1615826 (0.0009) [2023-12-26 12:35:00,398][123090] Updated weights for policy 1, policy_version 1615836 (0.0009) [2023-12-26 12:35:00,401][123091] Updated weights for policy 0, policy_version 1626494 (0.0007) [2023-12-26 12:35:00,460][123091] Updated weights for policy 0, policy_version 1626504 (0.0008) [2023-12-26 12:35:01,142][123091] Updated weights for policy 0, policy_version 1626514 (0.0010) [2023-12-26 12:35:01,213][123091] Updated weights for policy 0, policy_version 1626524 (0.0011) [2023-12-26 12:35:01,267][123090] Updated weights for policy 1, policy_version 1615846 (0.0009) [2023-12-26 12:35:01,278][123091] Updated weights for policy 0, policy_version 1626534 (0.0011) [2023-12-26 12:35:01,334][123090] Updated weights for policy 1, policy_version 1615856 (0.0008) [2023-12-26 12:35:01,337][123091] Updated weights for policy 0, policy_version 1626544 (0.0008) [2023-12-26 12:35:01,407][123090] Updated weights for policy 1, policy_version 1615866 (0.0009) [2023-12-26 12:35:02,126][123091] Updated weights for policy 0, policy_version 1626554 (0.0010) [2023-12-26 12:35:02,164][123090] Updated weights for policy 1, policy_version 1615876 (0.0007) [2023-12-26 12:35:02,185][123091] Updated weights for policy 0, policy_version 1626564 (0.0010) [2023-12-26 12:35:02,216][123090] Updated weights for policy 1, policy_version 1615886 (0.0010) [2023-12-26 12:35:02,240][123091] Updated weights for policy 0, policy_version 1626574 (0.0010) [2023-12-26 12:35:02,283][123090] Updated weights for policy 1, policy_version 1615896 (0.0009) [2023-12-26 12:35:03,007][123090] Updated weights for policy 1, policy_version 1615906 (0.0006) [2023-12-26 12:35:03,020][123091] Updated weights for policy 0, policy_version 1626584 (0.0007) [2023-12-26 12:35:03,063][123090] Updated weights for policy 1, policy_version 1615916 (0.0008) [2023-12-26 12:35:03,085][123091] Updated weights for policy 0, policy_version 1626594 (0.0006) [2023-12-26 12:35:03,120][123090] Updated weights for policy 1, policy_version 1615926 (0.0007) [2023-12-26 12:35:03,146][123091] Updated weights for policy 0, policy_version 1626604 (0.0005) [2023-12-26 12:35:03,174][123090] Updated weights for policy 1, policy_version 1615936 (0.0006) [2023-12-26 12:35:03,762][123091] Updated weights for policy 0, policy_version 1626614 (0.0006) [2023-12-26 12:35:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 830095360. Throughput: 0: 8859.9, 1: 8961.0. Samples: 830113072. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:03,785][121949] Avg episode reward: [(0, '6225.034'), (1, '5446.786')] [2023-12-26 12:35:03,816][123091] Updated weights for policy 0, policy_version 1626624 (0.0005) [2023-12-26 12:35:03,840][123090] Updated weights for policy 1, policy_version 1615946 (0.0009) [2023-12-26 12:35:03,883][123091] Updated weights for policy 0, policy_version 1626634 (0.0006) [2023-12-26 12:35:03,909][123090] Updated weights for policy 1, policy_version 1615956 (0.0007) [2023-12-26 12:35:03,976][123090] Updated weights for policy 1, policy_version 1615966 (0.0006) [2023-12-26 12:35:04,638][123091] Updated weights for policy 0, policy_version 1626644 (0.0007) [2023-12-26 12:35:04,696][123090] Updated weights for policy 1, policy_version 1615976 (0.0007) [2023-12-26 12:35:04,705][123091] Updated weights for policy 0, policy_version 1626654 (0.0011) [2023-12-26 12:35:04,757][123090] Updated weights for policy 1, policy_version 1615986 (0.0007) [2023-12-26 12:35:04,764][123091] Updated weights for policy 0, policy_version 1626664 (0.0011) [2023-12-26 12:35:04,817][123090] Updated weights for policy 1, policy_version 1615996 (0.0007) [2023-12-26 12:35:05,528][123090] Updated weights for policy 1, policy_version 1616006 (0.0008) [2023-12-26 12:35:05,553][123091] Updated weights for policy 0, policy_version 1626674 (0.0011) [2023-12-26 12:35:05,587][123090] Updated weights for policy 1, policy_version 1616016 (0.0010) [2023-12-26 12:35:05,601][123091] Updated weights for policy 0, policy_version 1626684 (0.0010) [2023-12-26 12:35:05,638][123090] Updated weights for policy 1, policy_version 1616026 (0.0010) [2023-12-26 12:35:05,649][123091] Updated weights for policy 0, policy_version 1626694 (0.0010) [2023-12-26 12:35:05,696][123091] Updated weights for policy 0, policy_version 1626704 (0.0010) [2023-12-26 12:35:06,308][123090] Updated weights for policy 1, policy_version 1616036 (0.0010) [2023-12-26 12:35:06,380][123090] Updated weights for policy 1, policy_version 1616046 (0.0011) [2023-12-26 12:35:06,447][123090] Updated weights for policy 1, policy_version 1616056 (0.0011) [2023-12-26 12:35:06,536][123091] Updated weights for policy 0, policy_version 1626714 (0.0007) [2023-12-26 12:35:06,597][123091] Updated weights for policy 0, policy_version 1626724 (0.0009) [2023-12-26 12:35:06,662][123091] Updated weights for policy 0, policy_version 1626734 (0.0008) [2023-12-26 12:35:07,172][123090] Updated weights for policy 1, policy_version 1616066 (0.0010) [2023-12-26 12:35:07,224][123090] Updated weights for policy 1, policy_version 1616076 (0.0008) [2023-12-26 12:35:07,272][123090] Updated weights for policy 1, policy_version 1616086 (0.0010) [2023-12-26 12:35:07,321][123090] Updated weights for policy 1, policy_version 1616096 (0.0010) [2023-12-26 12:35:07,529][123091] Updated weights for policy 0, policy_version 1626744 (0.0010) [2023-12-26 12:35:07,586][123091] Updated weights for policy 0, policy_version 1626754 (0.0006) [2023-12-26 12:35:07,646][123091] Updated weights for policy 0, policy_version 1626764 (0.0005) [2023-12-26 12:35:08,165][123090] Updated weights for policy 1, policy_version 1616106 (0.0010) [2023-12-26 12:35:08,217][123090] Updated weights for policy 1, policy_version 1616116 (0.0011) [2023-12-26 12:35:08,274][123090] Updated weights for policy 1, policy_version 1616126 (0.0011) [2023-12-26 12:35:08,455][123091] Updated weights for policy 0, policy_version 1626774 (0.0008) [2023-12-26 12:35:08,506][123091] Updated weights for policy 0, policy_version 1626784 (0.0010) [2023-12-26 12:35:08,564][123091] Updated weights for policy 0, policy_version 1626794 (0.0009) [2023-12-26 12:35:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 830193664. Throughput: 0: 8854.2, 1: 9034.3. Samples: 830168360. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:08,785][121949] Avg episode reward: [(0, '6303.571'), (1, '5433.106')] [2023-12-26 12:35:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001626800_416464896.pth... [2023-12-26 12:35:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001616128_413728768.pth... [2023-12-26 12:35:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001625744_416194560.pth [2023-12-26 12:35:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001615072_413458432.pth [2023-12-26 12:35:09,133][123090] Updated weights for policy 1, policy_version 1616136 (0.0009) [2023-12-26 12:35:09,190][123090] Updated weights for policy 1, policy_version 1616146 (0.0009) [2023-12-26 12:35:09,256][123090] Updated weights for policy 1, policy_version 1616156 (0.0010) [2023-12-26 12:35:09,409][123091] Updated weights for policy 0, policy_version 1626804 (0.0010) [2023-12-26 12:35:09,476][123091] Updated weights for policy 0, policy_version 1626814 (0.0008) [2023-12-26 12:35:09,546][123091] Updated weights for policy 0, policy_version 1626824 (0.0010) [2023-12-26 12:35:10,119][123090] Updated weights for policy 1, policy_version 1616166 (0.0009) [2023-12-26 12:35:10,177][123090] Updated weights for policy 1, policy_version 1616176 (0.0009) [2023-12-26 12:35:10,231][123090] Updated weights for policy 1, policy_version 1616186 (0.0009) [2023-12-26 12:35:10,372][123091] Updated weights for policy 0, policy_version 1626834 (0.0011) [2023-12-26 12:35:10,443][123091] Updated weights for policy 0, policy_version 1626844 (0.0011) [2023-12-26 12:35:10,507][123091] Updated weights for policy 0, policy_version 1626854 (0.0011) [2023-12-26 12:35:10,575][123091] Updated weights for policy 0, policy_version 1626864 (0.0011) [2023-12-26 12:35:10,951][123090] Updated weights for policy 1, policy_version 1616196 (0.0007) [2023-12-26 12:35:11,021][123090] Updated weights for policy 1, policy_version 1616206 (0.0006) [2023-12-26 12:35:11,097][123090] Updated weights for policy 1, policy_version 1616216 (0.0010) [2023-12-26 12:35:11,446][123091] Updated weights for policy 0, policy_version 1626874 (0.0011) [2023-12-26 12:35:11,502][123091] Updated weights for policy 0, policy_version 1626884 (0.0005) [2023-12-26 12:35:11,556][123091] Updated weights for policy 0, policy_version 1626894 (0.0006) [2023-12-26 12:35:11,916][123090] Updated weights for policy 1, policy_version 1616226 (0.0008) [2023-12-26 12:35:11,975][123090] Updated weights for policy 1, policy_version 1616236 (0.0005) [2023-12-26 12:35:12,032][123090] Updated weights for policy 1, policy_version 1616246 (0.0006) [2023-12-26 12:35:12,085][123090] Updated weights for policy 1, policy_version 1616256 (0.0006) [2023-12-26 12:35:12,408][123091] Updated weights for policy 0, policy_version 1626904 (0.0009) [2023-12-26 12:35:12,474][123091] Updated weights for policy 0, policy_version 1626914 (0.0008) [2023-12-26 12:35:12,533][123091] Updated weights for policy 0, policy_version 1626924 (0.0007) [2023-12-26 12:35:12,862][123090] Updated weights for policy 1, policy_version 1616266 (0.0009) [2023-12-26 12:35:12,921][123090] Updated weights for policy 1, policy_version 1616276 (0.0009) [2023-12-26 12:35:12,982][123090] Updated weights for policy 1, policy_version 1616286 (0.0009) [2023-12-26 12:35:13,270][123091] Updated weights for policy 0, policy_version 1626934 (0.0007) [2023-12-26 12:35:13,329][123091] Updated weights for policy 0, policy_version 1626944 (0.0005) [2023-12-26 12:35:13,384][123091] Updated weights for policy 0, policy_version 1626954 (0.0009) [2023-12-26 12:35:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 830275584. Throughput: 0: 8823.2, 1: 9006.1. Samples: 830271996. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:13,785][121949] Avg episode reward: [(0, '6207.122'), (1, '5513.647')] [2023-12-26 12:35:13,853][123090] Updated weights for policy 1, policy_version 1616296 (0.0010) [2023-12-26 12:35:13,900][123090] Updated weights for policy 1, policy_version 1616306 (0.0010) [2023-12-26 12:35:13,951][123090] Updated weights for policy 1, policy_version 1616316 (0.0010) [2023-12-26 12:35:14,119][123091] Updated weights for policy 0, policy_version 1626964 (0.0009) [2023-12-26 12:35:14,183][123091] Updated weights for policy 0, policy_version 1626974 (0.0009) [2023-12-26 12:35:14,246][123091] Updated weights for policy 0, policy_version 1626984 (0.0009) [2023-12-26 12:35:14,809][123090] Updated weights for policy 1, policy_version 1616326 (0.0010) [2023-12-26 12:35:14,874][123090] Updated weights for policy 1, policy_version 1616336 (0.0011) [2023-12-26 12:35:14,944][123090] Updated weights for policy 1, policy_version 1616346 (0.0008) [2023-12-26 12:35:15,087][123091] Updated weights for policy 0, policy_version 1626994 (0.0008) [2023-12-26 12:35:15,165][123091] Updated weights for policy 0, policy_version 1627004 (0.0006) [2023-12-26 12:35:15,242][123091] Updated weights for policy 0, policy_version 1627014 (0.0006) [2023-12-26 12:35:15,318][123091] Updated weights for policy 0, policy_version 1627024 (0.0008) [2023-12-26 12:35:15,657][123090] Updated weights for policy 1, policy_version 1616356 (0.0007) [2023-12-26 12:35:15,735][123090] Updated weights for policy 1, policy_version 1616366 (0.0006) [2023-12-26 12:35:15,804][123090] Updated weights for policy 1, policy_version 1616376 (0.0008) [2023-12-26 12:35:16,094][123091] Updated weights for policy 0, policy_version 1627034 (0.0009) [2023-12-26 12:35:16,163][123091] Updated weights for policy 0, policy_version 1627044 (0.0009) [2023-12-26 12:35:16,236][123091] Updated weights for policy 0, policy_version 1627054 (0.0010) [2023-12-26 12:35:16,392][123090] Updated weights for policy 1, policy_version 1616386 (0.0005) [2023-12-26 12:35:16,464][123090] Updated weights for policy 1, policy_version 1616396 (0.0006) [2023-12-26 12:35:16,535][123090] Updated weights for policy 1, policy_version 1616406 (0.0006) [2023-12-26 12:35:16,602][123090] Updated weights for policy 1, policy_version 1616416 (0.0008) [2023-12-26 12:35:17,082][123091] Updated weights for policy 0, policy_version 1627064 (0.0009) [2023-12-26 12:35:17,153][123091] Updated weights for policy 0, policy_version 1627074 (0.0009) [2023-12-26 12:35:17,210][123091] Updated weights for policy 0, policy_version 1627084 (0.0010) [2023-12-26 12:35:17,303][123090] Updated weights for policy 1, policy_version 1616426 (0.0005) [2023-12-26 12:35:17,356][123090] Updated weights for policy 1, policy_version 1616436 (0.0005) [2023-12-26 12:35:17,412][123090] Updated weights for policy 1, policy_version 1616446 (0.0007) [2023-12-26 12:35:18,080][123091] Updated weights for policy 0, policy_version 1627094 (0.0009) [2023-12-26 12:35:18,146][123091] Updated weights for policy 0, policy_version 1627104 (0.0010) [2023-12-26 12:35:18,162][123090] Updated weights for policy 1, policy_version 1616456 (0.0010) [2023-12-26 12:35:18,207][123091] Updated weights for policy 0, policy_version 1627114 (0.0007) [2023-12-26 12:35:18,225][123090] Updated weights for policy 1, policy_version 1616466 (0.0011) [2023-12-26 12:35:18,281][123090] Updated weights for policy 1, policy_version 1616476 (0.0011) [2023-12-26 12:35:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 830365696. Throughput: 0: 8788.7, 1: 8955.7. Samples: 830378372. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:18,785][121949] Avg episode reward: [(0, '6015.054'), (1, '5460.299')] [2023-12-26 12:35:18,966][123091] Updated weights for policy 0, policy_version 1627124 (0.0008) [2023-12-26 12:35:19,027][123091] Updated weights for policy 0, policy_version 1627134 (0.0009) [2023-12-26 12:35:19,084][123091] Updated weights for policy 0, policy_version 1627144 (0.0010) [2023-12-26 12:35:19,108][123090] Updated weights for policy 1, policy_version 1616486 (0.0007) [2023-12-26 12:35:19,161][123090] Updated weights for policy 1, policy_version 1616496 (0.0005) [2023-12-26 12:35:19,236][123090] Updated weights for policy 1, policy_version 1616506 (0.0007) [2023-12-26 12:35:19,990][123090] Updated weights for policy 1, policy_version 1616516 (0.0008) [2023-12-26 12:35:20,010][123091] Updated weights for policy 0, policy_version 1627154 (0.0007) [2023-12-26 12:35:20,053][123090] Updated weights for policy 1, policy_version 1616526 (0.0008) [2023-12-26 12:35:20,069][123091] Updated weights for policy 0, policy_version 1627164 (0.0007) [2023-12-26 12:35:20,117][123090] Updated weights for policy 1, policy_version 1616536 (0.0008) [2023-12-26 12:35:20,124][123091] Updated weights for policy 0, policy_version 1627174 (0.0009) [2023-12-26 12:35:20,191][123091] Updated weights for policy 0, policy_version 1627184 (0.0009) [2023-12-26 12:35:20,903][123090] Updated weights for policy 1, policy_version 1616546 (0.0009) [2023-12-26 12:35:20,964][123090] Updated weights for policy 1, policy_version 1616556 (0.0009) [2023-12-26 12:35:20,999][123091] Updated weights for policy 0, policy_version 1627194 (0.0007) [2023-12-26 12:35:21,033][123090] Updated weights for policy 1, policy_version 1616566 (0.0008) [2023-12-26 12:35:21,067][123091] Updated weights for policy 0, policy_version 1627204 (0.0010) [2023-12-26 12:35:21,101][123090] Updated weights for policy 1, policy_version 1616576 (0.0009) [2023-12-26 12:35:21,138][123091] Updated weights for policy 0, policy_version 1627214 (0.0009) [2023-12-26 12:35:21,972][123090] Updated weights for policy 1, policy_version 1616586 (0.0009) [2023-12-26 12:35:21,989][123091] Updated weights for policy 0, policy_version 1627224 (0.0009) [2023-12-26 12:35:22,037][123090] Updated weights for policy 1, policy_version 1616596 (0.0010) [2023-12-26 12:35:22,048][123091] Updated weights for policy 0, policy_version 1627234 (0.0008) [2023-12-26 12:35:22,098][123090] Updated weights for policy 1, policy_version 1616606 (0.0007) [2023-12-26 12:35:22,114][123091] Updated weights for policy 0, policy_version 1627244 (0.0007) [2023-12-26 12:35:22,869][123091] Updated weights for policy 0, policy_version 1627254 (0.0008) [2023-12-26 12:35:22,932][123091] Updated weights for policy 0, policy_version 1627264 (0.0008) [2023-12-26 12:35:22,979][123090] Updated weights for policy 1, policy_version 1616616 (0.0008) [2023-12-26 12:35:22,985][123091] Updated weights for policy 0, policy_version 1627274 (0.0009) [2023-12-26 12:35:23,034][123090] Updated weights for policy 1, policy_version 1616626 (0.0007) [2023-12-26 12:35:23,086][123090] Updated weights for policy 1, policy_version 1616636 (0.0009) [2023-12-26 12:35:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 830447616. Throughput: 0: 8752.6, 1: 8926.0. Samples: 830429804. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:23,784][121949] Avg episode reward: [(0, '5997.485'), (1, '5419.577')] [2023-12-26 12:35:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001616640_413859840.pth... [2023-12-26 12:35:23,792][123091] Updated weights for policy 0, policy_version 1627284 (0.0009) [2023-12-26 12:35:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001615584_413589504.pth [2023-12-26 12:35:23,842][123091] Updated weights for policy 0, policy_version 1627294 (0.0009) [2023-12-26 12:35:23,897][123091] Updated weights for policy 0, policy_version 1627304 (0.0009) [2023-12-26 12:35:23,930][123090] Updated weights for policy 1, policy_version 1616646 (0.0009) [2023-12-26 12:35:23,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001627312_416595968.pth... [2023-12-26 12:35:23,946][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001626288_416333824.pth [2023-12-26 12:35:23,984][123090] Updated weights for policy 1, policy_version 1616656 (0.0009) [2023-12-26 12:35:24,039][123090] Updated weights for policy 1, policy_version 1616666 (0.0009) [2023-12-26 12:35:24,716][123091] Updated weights for policy 0, policy_version 1627314 (0.0007) [2023-12-26 12:35:24,771][123091] Updated weights for policy 0, policy_version 1627324 (0.0010) [2023-12-26 12:35:24,822][123091] Updated weights for policy 0, policy_version 1627334 (0.0009) [2023-12-26 12:35:24,869][123090] Updated weights for policy 1, policy_version 1616676 (0.0009) [2023-12-26 12:35:24,872][123091] Updated weights for policy 0, policy_version 1627344 (0.0009) [2023-12-26 12:35:24,923][123090] Updated weights for policy 1, policy_version 1616686 (0.0009) [2023-12-26 12:35:24,982][123090] Updated weights for policy 1, policy_version 1616696 (0.0009) [2023-12-26 12:35:25,699][123091] Updated weights for policy 0, policy_version 1627354 (0.0009) [2023-12-26 12:35:25,747][123091] Updated weights for policy 0, policy_version 1627364 (0.0009) [2023-12-26 12:35:25,773][123090] Updated weights for policy 1, policy_version 1616706 (0.0008) [2023-12-26 12:35:25,804][123091] Updated weights for policy 0, policy_version 1627374 (0.0008) [2023-12-26 12:35:25,829][123090] Updated weights for policy 1, policy_version 1616716 (0.0010) [2023-12-26 12:35:25,878][123090] Updated weights for policy 1, policy_version 1616726 (0.0009) [2023-12-26 12:35:26,509][123091] Updated weights for policy 0, policy_version 1627384 (0.0009) [2023-12-26 12:35:26,570][123091] Updated weights for policy 0, policy_version 1627394 (0.0009) [2023-12-26 12:35:26,633][123091] Updated weights for policy 0, policy_version 1627404 (0.0008) [2023-12-26 12:35:26,770][123090] Updated weights for policy 1, policy_version 1616737 (0.0011) [2023-12-26 12:35:26,827][123090] Updated weights for policy 1, policy_version 1616747 (0.0010) [2023-12-26 12:35:26,884][123090] Updated weights for policy 1, policy_version 1616757 (0.0009) [2023-12-26 12:35:26,937][123090] Updated weights for policy 1, policy_version 1616767 (0.0010) [2023-12-26 12:35:27,233][123091] Updated weights for policy 0, policy_version 1627414 (0.0005) [2023-12-26 12:35:27,291][123091] Updated weights for policy 0, policy_version 1627424 (0.0005) [2023-12-26 12:35:27,342][123091] Updated weights for policy 0, policy_version 1627434 (0.0006) [2023-12-26 12:35:27,869][123090] Updated weights for policy 1, policy_version 1616777 (0.0007) [2023-12-26 12:35:27,936][123090] Updated weights for policy 1, policy_version 1616787 (0.0006) [2023-12-26 12:35:28,006][123090] Updated weights for policy 1, policy_version 1616797 (0.0006) [2023-12-26 12:35:28,029][123091] Updated weights for policy 0, policy_version 1627444 (0.0006) [2023-12-26 12:35:28,092][123091] Updated weights for policy 0, policy_version 1627454 (0.0005) [2023-12-26 12:35:28,154][123091] Updated weights for policy 0, policy_version 1627464 (0.0006) [2023-12-26 12:35:28,685][123090] Updated weights for policy 1, policy_version 1616807 (0.0006) [2023-12-26 12:35:28,753][123090] Updated weights for policy 1, policy_version 1616817 (0.0005) [2023-12-26 12:35:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 830537728. Throughput: 0: 8816.2, 1: 8907.1. Samples: 830535156. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:28,784][121949] Avg episode reward: [(0, '6067.993'), (1, '5490.620')] [2023-12-26 12:35:28,820][123090] Updated weights for policy 1, policy_version 1616827 (0.0005) [2023-12-26 12:35:28,928][123091] Updated weights for policy 0, policy_version 1627474 (0.0005) [2023-12-26 12:35:28,981][123091] Updated weights for policy 0, policy_version 1627484 (0.0005) [2023-12-26 12:35:29,028][123091] Updated weights for policy 0, policy_version 1627494 (0.0005) [2023-12-26 12:35:29,082][123091] Updated weights for policy 0, policy_version 1627504 (0.0006) [2023-12-26 12:35:29,551][123090] Updated weights for policy 1, policy_version 1616837 (0.0007) [2023-12-26 12:35:29,620][123090] Updated weights for policy 1, policy_version 1616847 (0.0008) [2023-12-26 12:35:29,687][123090] Updated weights for policy 1, policy_version 1616857 (0.0008) [2023-12-26 12:35:29,863][123091] Updated weights for policy 0, policy_version 1627514 (0.0009) [2023-12-26 12:35:29,932][123091] Updated weights for policy 0, policy_version 1627524 (0.0008) [2023-12-26 12:35:29,998][123091] Updated weights for policy 0, policy_version 1627534 (0.0009) [2023-12-26 12:35:30,524][123090] Updated weights for policy 1, policy_version 1616867 (0.0007) [2023-12-26 12:35:30,579][123090] Updated weights for policy 1, policy_version 1616877 (0.0005) [2023-12-26 12:35:30,626][123090] Updated weights for policy 1, policy_version 1616887 (0.0005) [2023-12-26 12:35:30,746][123091] Updated weights for policy 0, policy_version 1627544 (0.0009) [2023-12-26 12:35:30,807][123091] Updated weights for policy 0, policy_version 1627554 (0.0009) [2023-12-26 12:35:30,860][123091] Updated weights for policy 0, policy_version 1627564 (0.0010) [2023-12-26 12:35:31,340][123090] Updated weights for policy 1, policy_version 1616897 (0.0005) [2023-12-26 12:35:31,413][123090] Updated weights for policy 1, policy_version 1616907 (0.0009) [2023-12-26 12:35:31,472][123090] Updated weights for policy 1, policy_version 1616917 (0.0010) [2023-12-26 12:35:31,534][123090] Updated weights for policy 1, policy_version 1616927 (0.0010) [2023-12-26 12:35:31,681][123091] Updated weights for policy 0, policy_version 1627575 (0.0007) [2023-12-26 12:35:31,750][123091] Updated weights for policy 0, policy_version 1627585 (0.0008) [2023-12-26 12:35:31,812][123091] Updated weights for policy 0, policy_version 1627595 (0.0005) [2023-12-26 12:35:32,446][123090] Updated weights for policy 1, policy_version 1616937 (0.0010) [2023-12-26 12:35:32,501][123090] Updated weights for policy 1, policy_version 1616947 (0.0009) [2023-12-26 12:35:32,505][123091] Updated weights for policy 0, policy_version 1627605 (0.0005) [2023-12-26 12:35:32,552][123090] Updated weights for policy 1, policy_version 1616957 (0.0009) [2023-12-26 12:35:32,574][123091] Updated weights for policy 0, policy_version 1627615 (0.0006) [2023-12-26 12:35:32,639][123091] Updated weights for policy 0, policy_version 1627625 (0.0009) [2023-12-26 12:35:33,215][123091] Updated weights for policy 0, policy_version 1627635 (0.0009) [2023-12-26 12:35:33,259][123091] Updated weights for policy 0, policy_version 1627645 (0.0005) [2023-12-26 12:35:33,312][123091] Updated weights for policy 0, policy_version 1627655 (0.0005) [2023-12-26 12:35:33,445][123090] Updated weights for policy 1, policy_version 1616967 (0.0007) [2023-12-26 12:35:33,505][123090] Updated weights for policy 1, policy_version 1616977 (0.0005) [2023-12-26 12:35:33,564][123090] Updated weights for policy 1, policy_version 1616987 (0.0005) [2023-12-26 12:35:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 830636032. Throughput: 0: 8891.5, 1: 8941.2. Samples: 830645732. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:33,785][121949] Avg episode reward: [(0, '6094.728'), (1, '5619.475')] [2023-12-26 12:35:33,949][123091] Updated weights for policy 0, policy_version 1627665 (0.0005) [2023-12-26 12:35:34,020][123091] Updated weights for policy 0, policy_version 1627675 (0.0005) [2023-12-26 12:35:34,083][123091] Updated weights for policy 0, policy_version 1627685 (0.0005) [2023-12-26 12:35:34,145][123091] Updated weights for policy 0, policy_version 1627695 (0.0006) [2023-12-26 12:35:34,266][123090] Updated weights for policy 1, policy_version 1616997 (0.0007) [2023-12-26 12:35:34,331][123090] Updated weights for policy 1, policy_version 1617007 (0.0008) [2023-12-26 12:35:34,392][123090] Updated weights for policy 1, policy_version 1617017 (0.0009) [2023-12-26 12:35:34,925][123091] Updated weights for policy 0, policy_version 1627705 (0.0010) [2023-12-26 12:35:34,969][123091] Updated weights for policy 0, policy_version 1627715 (0.0010) [2023-12-26 12:35:35,025][123091] Updated weights for policy 0, policy_version 1627725 (0.0010) [2023-12-26 12:35:35,206][123090] Updated weights for policy 1, policy_version 1617027 (0.0009) [2023-12-26 12:35:35,261][123090] Updated weights for policy 1, policy_version 1617037 (0.0010) [2023-12-26 12:35:35,335][123090] Updated weights for policy 1, policy_version 1617047 (0.0005) [2023-12-26 12:35:35,789][123091] Updated weights for policy 0, policy_version 1627735 (0.0010) [2023-12-26 12:35:35,844][123091] Updated weights for policy 0, policy_version 1627745 (0.0010) [2023-12-26 12:35:35,898][123091] Updated weights for policy 0, policy_version 1627755 (0.0010) [2023-12-26 12:35:35,975][123090] Updated weights for policy 1, policy_version 1617057 (0.0005) [2023-12-26 12:35:36,030][123090] Updated weights for policy 1, policy_version 1617067 (0.0005) [2023-12-26 12:35:36,086][123090] Updated weights for policy 1, policy_version 1617077 (0.0005) [2023-12-26 12:35:36,156][123090] Updated weights for policy 1, policy_version 1617087 (0.0011) [2023-12-26 12:35:36,764][123091] Updated weights for policy 0, policy_version 1627765 (0.0008) [2023-12-26 12:35:36,828][123091] Updated weights for policy 0, policy_version 1627775 (0.0005) [2023-12-26 12:35:36,888][123091] Updated weights for policy 0, policy_version 1627785 (0.0005) [2023-12-26 12:35:36,957][123090] Updated weights for policy 1, policy_version 1617097 (0.0006) [2023-12-26 12:35:37,027][123090] Updated weights for policy 1, policy_version 1617107 (0.0006) [2023-12-26 12:35:37,096][123090] Updated weights for policy 1, policy_version 1617117 (0.0006) [2023-12-26 12:35:37,652][123091] Updated weights for policy 0, policy_version 1627795 (0.0010) [2023-12-26 12:35:37,716][123091] Updated weights for policy 0, policy_version 1627805 (0.0011) [2023-12-26 12:35:37,786][123091] Updated weights for policy 0, policy_version 1627815 (0.0011) [2023-12-26 12:35:37,845][123090] Updated weights for policy 1, policy_version 1617127 (0.0009) [2023-12-26 12:35:37,909][123090] Updated weights for policy 1, policy_version 1617137 (0.0010) [2023-12-26 12:35:37,957][123090] Updated weights for policy 1, policy_version 1617147 (0.0010) [2023-12-26 12:35:38,595][123091] Updated weights for policy 0, policy_version 1627825 (0.0011) [2023-12-26 12:35:38,665][123091] Updated weights for policy 0, policy_version 1627835 (0.0011) [2023-12-26 12:35:38,739][123091] Updated weights for policy 0, policy_version 1627845 (0.0011) [2023-12-26 12:35:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 830717952. Throughput: 0: 8869.6, 1: 8990.2. Samples: 830701112. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:38,785][121949] Avg episode reward: [(0, '6245.748'), (1, '5604.967')] [2023-12-26 12:35:38,798][123091] Updated weights for policy 0, policy_version 1627855 (0.0011) [2023-12-26 12:35:38,801][123090] Updated weights for policy 1, policy_version 1617157 (0.0011) [2023-12-26 12:35:38,802][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001627856_416735232.pth... [2023-12-26 12:35:38,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001626800_416464896.pth [2023-12-26 12:35:38,864][123090] Updated weights for policy 1, policy_version 1617167 (0.0010) [2023-12-26 12:35:38,927][123090] Updated weights for policy 1, policy_version 1617177 (0.0011) [2023-12-26 12:35:38,967][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001617184_413999104.pth... [2023-12-26 12:35:38,971][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001616128_413728768.pth [2023-12-26 12:35:39,640][123091] Updated weights for policy 0, policy_version 1627865 (0.0011) [2023-12-26 12:35:39,711][123091] Updated weights for policy 0, policy_version 1627875 (0.0011) [2023-12-26 12:35:39,763][123091] Updated weights for policy 0, policy_version 1627885 (0.0011) [2023-12-26 12:35:39,790][123090] Updated weights for policy 1, policy_version 1617187 (0.0009) [2023-12-26 12:35:39,876][123090] Updated weights for policy 1, policy_version 1617197 (0.0007) [2023-12-26 12:35:39,929][123090] Updated weights for policy 1, policy_version 1617207 (0.0009) [2023-12-26 12:35:40,540][123091] Updated weights for policy 0, policy_version 1627895 (0.0007) [2023-12-26 12:35:40,596][123091] Updated weights for policy 0, policy_version 1627905 (0.0005) [2023-12-26 12:35:40,606][123090] Updated weights for policy 1, policy_version 1617217 (0.0008) [2023-12-26 12:35:40,649][123091] Updated weights for policy 0, policy_version 1627915 (0.0005) [2023-12-26 12:35:40,676][123090] Updated weights for policy 1, policy_version 1617227 (0.0009) [2023-12-26 12:35:40,734][123090] Updated weights for policy 1, policy_version 1617237 (0.0010) [2023-12-26 12:35:40,791][123090] Updated weights for policy 1, policy_version 1617247 (0.0009) [2023-12-26 12:35:41,448][123091] Updated weights for policy 0, policy_version 1627925 (0.0008) [2023-12-26 12:35:41,511][123091] Updated weights for policy 0, policy_version 1627935 (0.0011) [2023-12-26 12:35:41,583][123091] Updated weights for policy 0, policy_version 1627945 (0.0006) [2023-12-26 12:35:41,683][123090] Updated weights for policy 1, policy_version 1617257 (0.0008) [2023-12-26 12:35:41,756][123090] Updated weights for policy 1, policy_version 1617267 (0.0008) [2023-12-26 12:35:41,829][123090] Updated weights for policy 1, policy_version 1617277 (0.0008) [2023-12-26 12:35:42,406][123091] Updated weights for policy 0, policy_version 1627955 (0.0008) [2023-12-26 12:35:42,458][123091] Updated weights for policy 0, policy_version 1627965 (0.0011) [2023-12-26 12:35:42,512][123091] Updated weights for policy 0, policy_version 1627975 (0.0011) [2023-12-26 12:35:42,613][123090] Updated weights for policy 1, policy_version 1617288 (0.0010) [2023-12-26 12:35:42,667][123090] Updated weights for policy 1, policy_version 1617298 (0.0010) [2023-12-26 12:35:42,720][123090] Updated weights for policy 1, policy_version 1617308 (0.0010) [2023-12-26 12:35:43,331][123091] Updated weights for policy 0, policy_version 1627985 (0.0011) [2023-12-26 12:35:43,391][123091] Updated weights for policy 0, policy_version 1627995 (0.0009) [2023-12-26 12:35:43,466][123091] Updated weights for policy 0, policy_version 1628005 (0.0007) [2023-12-26 12:35:43,492][123090] Updated weights for policy 1, policy_version 1617318 (0.0010) [2023-12-26 12:35:43,527][123091] Updated weights for policy 0, policy_version 1628015 (0.0005) [2023-12-26 12:35:43,541][123090] Updated weights for policy 1, policy_version 1617328 (0.0010) [2023-12-26 12:35:43,608][123090] Updated weights for policy 1, policy_version 1617338 (0.0010) [2023-12-26 12:35:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 830816256. Throughput: 0: 8895.9, 1: 8870.7. Samples: 830804852. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:43,784][121949] Avg episode reward: [(0, '6338.152'), (1, '5878.480')] [2023-12-26 12:35:44,200][123091] Updated weights for policy 0, policy_version 1628025 (0.0009) [2023-12-26 12:35:44,244][123091] Updated weights for policy 0, policy_version 1628035 (0.0010) [2023-12-26 12:35:44,266][123090] Updated weights for policy 1, policy_version 1617348 (0.0008) [2023-12-26 12:35:44,302][123091] Updated weights for policy 0, policy_version 1628045 (0.0010) [2023-12-26 12:35:44,322][123090] Updated weights for policy 1, policy_version 1617358 (0.0005) [2023-12-26 12:35:44,376][123090] Updated weights for policy 1, policy_version 1617368 (0.0005) [2023-12-26 12:35:45,012][123090] Updated weights for policy 1, policy_version 1617378 (0.0006) [2023-12-26 12:35:45,069][123090] Updated weights for policy 1, policy_version 1617388 (0.0006) [2023-12-26 12:35:45,094][123091] Updated weights for policy 0, policy_version 1628055 (0.0009) [2023-12-26 12:35:45,136][123090] Updated weights for policy 1, policy_version 1617398 (0.0007) [2023-12-26 12:35:45,163][123091] Updated weights for policy 0, policy_version 1628065 (0.0011) [2023-12-26 12:35:45,198][123090] Updated weights for policy 1, policy_version 1617408 (0.0008) [2023-12-26 12:35:45,235][123091] Updated weights for policy 0, policy_version 1628075 (0.0010) [2023-12-26 12:35:45,901][123090] Updated weights for policy 1, policy_version 1617418 (0.0008) [2023-12-26 12:35:45,940][123091] Updated weights for policy 0, policy_version 1628085 (0.0008) [2023-12-26 12:35:45,973][123090] Updated weights for policy 1, policy_version 1617428 (0.0006) [2023-12-26 12:35:46,008][123091] Updated weights for policy 0, policy_version 1628095 (0.0006) [2023-12-26 12:35:46,036][123090] Updated weights for policy 1, policy_version 1617438 (0.0011) [2023-12-26 12:35:46,070][123091] Updated weights for policy 0, policy_version 1628105 (0.0005) [2023-12-26 12:35:46,668][123091] Updated weights for policy 0, policy_version 1628115 (0.0006) [2023-12-26 12:35:46,729][123091] Updated weights for policy 0, policy_version 1628125 (0.0006) [2023-12-26 12:35:46,798][123091] Updated weights for policy 0, policy_version 1628135 (0.0006) [2023-12-26 12:35:46,810][123090] Updated weights for policy 1, policy_version 1617448 (0.0009) [2023-12-26 12:35:46,875][123090] Updated weights for policy 1, policy_version 1617458 (0.0009) [2023-12-26 12:35:46,928][123090] Updated weights for policy 1, policy_version 1617468 (0.0010) [2023-12-26 12:35:47,450][123091] Updated weights for policy 0, policy_version 1628145 (0.0006) [2023-12-26 12:35:47,497][123091] Updated weights for policy 0, policy_version 1628155 (0.0005) [2023-12-26 12:35:47,547][123091] Updated weights for policy 0, policy_version 1628165 (0.0005) [2023-12-26 12:35:47,602][123091] Updated weights for policy 0, policy_version 1628175 (0.0005) [2023-12-26 12:35:47,710][123090] Updated weights for policy 1, policy_version 1617478 (0.0008) [2023-12-26 12:35:47,758][123090] Updated weights for policy 1, policy_version 1617488 (0.0005) [2023-12-26 12:35:47,814][123090] Updated weights for policy 1, policy_version 1617498 (0.0006) [2023-12-26 12:35:48,373][123091] Updated weights for policy 0, policy_version 1628185 (0.0009) [2023-12-26 12:35:48,439][123091] Updated weights for policy 0, policy_version 1628195 (0.0009) [2023-12-26 12:35:48,503][123091] Updated weights for policy 0, policy_version 1628205 (0.0009) [2023-12-26 12:35:48,630][123090] Updated weights for policy 1, policy_version 1617508 (0.0008) [2023-12-26 12:35:48,694][123090] Updated weights for policy 1, policy_version 1617518 (0.0010) [2023-12-26 12:35:48,760][123090] Updated weights for policy 1, policy_version 1617528 (0.0010) [2023-12-26 12:35:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 830906368. Throughput: 0: 8995.9, 1: 8941.4. Samples: 830920252. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:48,784][121949] Avg episode reward: [(0, '6333.882'), (1, '5721.983')] [2023-12-26 12:35:49,251][123091] Updated weights for policy 0, policy_version 1628215 (0.0010) [2023-12-26 12:35:49,308][123091] Updated weights for policy 0, policy_version 1628225 (0.0010) [2023-12-26 12:35:49,365][123091] Updated weights for policy 0, policy_version 1628235 (0.0011) [2023-12-26 12:35:49,569][123090] Updated weights for policy 1, policy_version 1617538 (0.0009) [2023-12-26 12:35:49,645][123090] Updated weights for policy 1, policy_version 1617548 (0.0005) [2023-12-26 12:35:49,715][123090] Updated weights for policy 1, policy_version 1617558 (0.0009) [2023-12-26 12:35:49,779][123090] Updated weights for policy 1, policy_version 1617568 (0.0008) [2023-12-26 12:35:50,136][123091] Updated weights for policy 0, policy_version 1628245 (0.0008) [2023-12-26 12:35:50,192][123091] Updated weights for policy 0, policy_version 1628255 (0.0010) [2023-12-26 12:35:50,255][123091] Updated weights for policy 0, policy_version 1628265 (0.0011) [2023-12-26 12:35:50,557][123090] Updated weights for policy 1, policy_version 1617578 (0.0009) [2023-12-26 12:35:50,629][123090] Updated weights for policy 1, policy_version 1617588 (0.0009) [2023-12-26 12:35:50,694][123090] Updated weights for policy 1, policy_version 1617598 (0.0008) [2023-12-26 12:35:51,100][123091] Updated weights for policy 0, policy_version 1628275 (0.0010) [2023-12-26 12:35:51,169][123091] Updated weights for policy 0, policy_version 1628285 (0.0011) [2023-12-26 12:35:51,240][123091] Updated weights for policy 0, policy_version 1628295 (0.0011) [2023-12-26 12:35:51,550][123090] Updated weights for policy 1, policy_version 1617608 (0.0006) [2023-12-26 12:35:51,612][123090] Updated weights for policy 1, policy_version 1617618 (0.0005) [2023-12-26 12:35:51,684][123090] Updated weights for policy 1, policy_version 1617628 (0.0008) [2023-12-26 12:35:52,009][123091] Updated weights for policy 0, policy_version 1628305 (0.0011) [2023-12-26 12:35:52,074][123091] Updated weights for policy 0, policy_version 1628315 (0.0010) [2023-12-26 12:35:52,139][123091] Updated weights for policy 0, policy_version 1628325 (0.0010) [2023-12-26 12:35:52,187][123091] Updated weights for policy 0, policy_version 1628335 (0.0010) [2023-12-26 12:35:52,530][123090] Updated weights for policy 1, policy_version 1617638 (0.0007) [2023-12-26 12:35:52,586][123090] Updated weights for policy 1, policy_version 1617648 (0.0005) [2023-12-26 12:35:52,645][123090] Updated weights for policy 1, policy_version 1617658 (0.0005) [2023-12-26 12:35:52,995][123091] Updated weights for policy 0, policy_version 1628345 (0.0010) [2023-12-26 12:35:53,039][123091] Updated weights for policy 0, policy_version 1628355 (0.0010) [2023-12-26 12:35:53,090][123091] Updated weights for policy 0, policy_version 1628365 (0.0010) [2023-12-26 12:35:53,322][123090] Updated weights for policy 1, policy_version 1617668 (0.0005) [2023-12-26 12:35:53,392][123090] Updated weights for policy 1, policy_version 1617678 (0.0006) [2023-12-26 12:35:53,460][123090] Updated weights for policy 1, policy_version 1617688 (0.0005) [2023-12-26 12:35:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 830996480. Throughput: 0: 8995.5, 1: 8866.5. Samples: 830972148. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:53,785][121949] Avg episode reward: [(0, '6358.431'), (1, '5536.580')] [2023-12-26 12:35:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001628368_416866304.pth... [2023-12-26 12:35:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001617696_414130176.pth... [2023-12-26 12:35:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001627312_416595968.pth [2023-12-26 12:35:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001616640_413859840.pth [2023-12-26 12:35:53,971][123091] Updated weights for policy 0, policy_version 1628375 (0.0008) [2023-12-26 12:35:54,026][123091] Updated weights for policy 0, policy_version 1628385 (0.0007) [2023-12-26 12:35:54,088][123091] Updated weights for policy 0, policy_version 1628395 (0.0007) [2023-12-26 12:35:54,206][123090] Updated weights for policy 1, policy_version 1617698 (0.0005) [2023-12-26 12:35:54,260][123090] Updated weights for policy 1, policy_version 1617708 (0.0005) [2023-12-26 12:35:54,315][123090] Updated weights for policy 1, policy_version 1617718 (0.0005) [2023-12-26 12:35:54,393][123090] Updated weights for policy 1, policy_version 1617728 (0.0006) [2023-12-26 12:35:54,908][123091] Updated weights for policy 0, policy_version 1628405 (0.0010) [2023-12-26 12:35:54,970][123091] Updated weights for policy 0, policy_version 1628415 (0.0010) [2023-12-26 12:35:55,025][123091] Updated weights for policy 0, policy_version 1628425 (0.0009) [2023-12-26 12:35:55,060][123090] Updated weights for policy 1, policy_version 1617738 (0.0008) [2023-12-26 12:35:55,127][123090] Updated weights for policy 1, policy_version 1617748 (0.0009) [2023-12-26 12:35:55,188][123090] Updated weights for policy 1, policy_version 1617758 (0.0009) [2023-12-26 12:35:55,849][123091] Updated weights for policy 0, policy_version 1628435 (0.0007) [2023-12-26 12:35:55,916][123091] Updated weights for policy 0, policy_version 1628445 (0.0009) [2023-12-26 12:35:55,968][123090] Updated weights for policy 1, policy_version 1617768 (0.0007) [2023-12-26 12:35:55,969][123091] Updated weights for policy 0, policy_version 1628455 (0.0009) [2023-12-26 12:35:56,035][123090] Updated weights for policy 1, policy_version 1617778 (0.0008) [2023-12-26 12:35:56,098][123090] Updated weights for policy 1, policy_version 1617788 (0.0009) [2023-12-26 12:35:56,765][123091] Updated weights for policy 0, policy_version 1628465 (0.0009) [2023-12-26 12:35:56,771][123090] Updated weights for policy 1, policy_version 1617798 (0.0007) [2023-12-26 12:35:56,831][123091] Updated weights for policy 0, policy_version 1628475 (0.0008) [2023-12-26 12:35:56,834][123090] Updated weights for policy 1, policy_version 1617808 (0.0005) [2023-12-26 12:35:56,880][123090] Updated weights for policy 1, policy_version 1617818 (0.0006) [2023-12-26 12:35:56,892][123091] Updated weights for policy 0, policy_version 1628485 (0.0008) [2023-12-26 12:35:56,955][123091] Updated weights for policy 0, policy_version 1628495 (0.0008) [2023-12-26 12:35:57,523][123090] Updated weights for policy 1, policy_version 1617828 (0.0006) [2023-12-26 12:35:57,594][123090] Updated weights for policy 1, policy_version 1617838 (0.0005) [2023-12-26 12:35:57,655][123090] Updated weights for policy 1, policy_version 1617848 (0.0005) [2023-12-26 12:35:57,756][123091] Updated weights for policy 0, policy_version 1628505 (0.0010) [2023-12-26 12:35:57,821][123091] Updated weights for policy 0, policy_version 1628515 (0.0010) [2023-12-26 12:35:57,889][123091] Updated weights for policy 0, policy_version 1628525 (0.0010) [2023-12-26 12:35:58,339][123090] Updated weights for policy 1, policy_version 1617858 (0.0006) [2023-12-26 12:35:58,411][123090] Updated weights for policy 1, policy_version 1617868 (0.0009) [2023-12-26 12:35:58,480][123090] Updated weights for policy 1, policy_version 1617878 (0.0009) [2023-12-26 12:35:58,548][123090] Updated weights for policy 1, policy_version 1617888 (0.0009) [2023-12-26 12:35:58,719][123091] Updated weights for policy 0, policy_version 1628535 (0.0011) [2023-12-26 12:35:58,781][123091] Updated weights for policy 0, policy_version 1628545 (0.0013) [2023-12-26 12:35:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 831086592. Throughput: 0: 9034.7, 1: 8968.9. Samples: 831082156. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:35:58,785][121949] Avg episode reward: [(0, '6335.234'), (1, '5831.810')] [2023-12-26 12:35:58,845][123091] Updated weights for policy 0, policy_version 1628555 (0.0009) [2023-12-26 12:35:59,427][123090] Updated weights for policy 1, policy_version 1617898 (0.0008) [2023-12-26 12:35:59,480][123090] Updated weights for policy 1, policy_version 1617908 (0.0006) [2023-12-26 12:35:59,541][123090] Updated weights for policy 1, policy_version 1617918 (0.0010) [2023-12-26 12:35:59,631][123091] Updated weights for policy 0, policy_version 1628565 (0.0010) [2023-12-26 12:35:59,689][123091] Updated weights for policy 0, policy_version 1628575 (0.0009) [2023-12-26 12:35:59,747][123091] Updated weights for policy 0, policy_version 1628585 (0.0009) [2023-12-26 12:36:00,328][123090] Updated weights for policy 1, policy_version 1617928 (0.0010) [2023-12-26 12:36:00,390][123090] Updated weights for policy 1, policy_version 1617938 (0.0008) [2023-12-26 12:36:00,460][123090] Updated weights for policy 1, policy_version 1617948 (0.0007) [2023-12-26 12:36:00,536][123091] Updated weights for policy 0, policy_version 1628595 (0.0009) [2023-12-26 12:36:00,602][123091] Updated weights for policy 0, policy_version 1628605 (0.0006) [2023-12-26 12:36:00,661][123091] Updated weights for policy 0, policy_version 1628615 (0.0005) [2023-12-26 12:36:01,367][123090] Updated weights for policy 1, policy_version 1617958 (0.0009) [2023-12-26 12:36:01,432][123090] Updated weights for policy 1, policy_version 1617968 (0.0010) [2023-12-26 12:36:01,482][123091] Updated weights for policy 0, policy_version 1628625 (0.0007) [2023-12-26 12:36:01,493][123090] Updated weights for policy 1, policy_version 1617978 (0.0009) [2023-12-26 12:36:01,539][123091] Updated weights for policy 0, policy_version 1628635 (0.0009) [2023-12-26 12:36:01,593][123091] Updated weights for policy 0, policy_version 1628645 (0.0010) [2023-12-26 12:36:01,649][123091] Updated weights for policy 0, policy_version 1628655 (0.0010) [2023-12-26 12:36:02,312][123090] Updated weights for policy 1, policy_version 1617988 (0.0009) [2023-12-26 12:36:02,373][123090] Updated weights for policy 1, policy_version 1617998 (0.0010) [2023-12-26 12:36:02,428][123090] Updated weights for policy 1, policy_version 1618008 (0.0009) [2023-12-26 12:36:02,515][123091] Updated weights for policy 0, policy_version 1628665 (0.0006) [2023-12-26 12:36:02,570][123091] Updated weights for policy 0, policy_version 1628675 (0.0006) [2023-12-26 12:36:02,636][123091] Updated weights for policy 0, policy_version 1628685 (0.0006) [2023-12-26 12:36:03,309][123090] Updated weights for policy 1, policy_version 1618018 (0.0008) [2023-12-26 12:36:03,329][123091] Updated weights for policy 0, policy_version 1628695 (0.0008) [2023-12-26 12:36:03,357][123090] Updated weights for policy 1, policy_version 1618028 (0.0007) [2023-12-26 12:36:03,385][123091] Updated weights for policy 0, policy_version 1628705 (0.0010) [2023-12-26 12:36:03,405][123090] Updated weights for policy 1, policy_version 1618038 (0.0007) [2023-12-26 12:36:03,437][123091] Updated weights for policy 0, policy_version 1628715 (0.0010) [2023-12-26 12:36:03,453][123090] Updated weights for policy 1, policy_version 1618048 (0.0006) [2023-12-26 12:36:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 831176704. Throughput: 0: 9051.4, 1: 8885.7. Samples: 831185548. Policy #0 lag: (min: 30.0, avg: 31.6, max: 62.0) [2023-12-26 12:36:03,785][121949] Avg episode reward: [(0, '6352.074'), (1, '5895.650')] [2023-12-26 12:36:04,221][123091] Updated weights for policy 0, policy_version 1628725 (0.0009) [2023-12-26 12:36:04,275][123091] Updated weights for policy 0, policy_version 1628735 (0.0009) [2023-12-26 12:36:04,340][123091] Updated weights for policy 0, policy_version 1628745 (0.0006) [2023-12-26 12:36:04,346][123090] Updated weights for policy 1, policy_version 1618058 (0.0011) [2023-12-26 12:36:04,412][123090] Updated weights for policy 1, policy_version 1618068 (0.0011) [2023-12-26 12:36:04,469][123090] Updated weights for policy 1, policy_version 1618078 (0.0011) [2023-12-26 12:36:05,106][123091] Updated weights for policy 0, policy_version 1628755 (0.0007) [2023-12-26 12:36:05,170][123091] Updated weights for policy 0, policy_version 1628765 (0.0009) [2023-12-26 12:36:05,222][123091] Updated weights for policy 0, policy_version 1628775 (0.0009) [2023-12-26 12:36:05,302][123090] Updated weights for policy 1, policy_version 1618088 (0.0010) [2023-12-26 12:36:05,365][123090] Updated weights for policy 1, policy_version 1618098 (0.0010) [2023-12-26 12:36:05,423][123090] Updated weights for policy 1, policy_version 1618108 (0.0010) [2023-12-26 12:36:06,074][123091] Updated weights for policy 0, policy_version 1628785 (0.0009) [2023-12-26 12:36:06,148][123091] Updated weights for policy 0, policy_version 1628797 (0.0008) [2023-12-26 12:36:06,154][123090] Updated weights for policy 1, policy_version 1618118 (0.0008) [2023-12-26 12:36:06,206][123091] Updated weights for policy 0, policy_version 1628807 (0.0009) [2023-12-26 12:36:06,222][123090] Updated weights for policy 1, policy_version 1618128 (0.0007) [2023-12-26 12:36:06,282][123090] Updated weights for policy 1, policy_version 1618138 (0.0009) [2023-12-26 12:36:07,037][123091] Updated weights for policy 0, policy_version 1628817 (0.0011) [2023-12-26 12:36:07,084][123091] Updated weights for policy 0, policy_version 1628827 (0.0010) [2023-12-26 12:36:07,136][123091] Updated weights for policy 0, policy_version 1628837 (0.0010) [2023-12-26 12:36:07,172][123090] Updated weights for policy 1, policy_version 1618148 (0.0010) [2023-12-26 12:36:07,188][123091] Updated weights for policy 0, policy_version 1628847 (0.0010) [2023-12-26 12:36:07,228][123090] Updated weights for policy 1, policy_version 1618158 (0.0010) [2023-12-26 12:36:07,295][123090] Updated weights for policy 1, policy_version 1618168 (0.0010) [2023-12-26 12:36:07,990][123091] Updated weights for policy 0, policy_version 1628857 (0.0006) [2023-12-26 12:36:08,037][123090] Updated weights for policy 1, policy_version 1618178 (0.0011) [2023-12-26 12:36:08,052][123091] Updated weights for policy 0, policy_version 1628867 (0.0005) [2023-12-26 12:36:08,085][123090] Updated weights for policy 1, policy_version 1618188 (0.0010) [2023-12-26 12:36:08,118][123091] Updated weights for policy 0, policy_version 1628877 (0.0006) [2023-12-26 12:36:08,138][123090] Updated weights for policy 1, policy_version 1618198 (0.0011) [2023-12-26 12:36:08,186][123090] Updated weights for policy 1, policy_version 1618208 (0.0010) [2023-12-26 12:36:08,731][123091] Updated weights for policy 0, policy_version 1628887 (0.0006) [2023-12-26 12:36:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 831258624. Throughput: 0: 9072.4, 1: 8871.4. Samples: 831237280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:08,785][121949] Avg episode reward: [(0, '6320.307'), (1, '5703.301')] [2023-12-26 12:36:08,788][123091] Updated weights for policy 0, policy_version 1628897 (0.0006) [2023-12-26 12:36:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001618208_414261248.pth... [2023-12-26 12:36:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001617184_413999104.pth [2023-12-26 12:36:08,855][123091] Updated weights for policy 0, policy_version 1628907 (0.0011) [2023-12-26 12:36:08,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001628912_417005568.pth... [2023-12-26 12:36:08,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001627856_416735232.pth [2023-12-26 12:36:09,066][123090] Updated weights for policy 1, policy_version 1618218 (0.0011) [2023-12-26 12:36:09,137][123090] Updated weights for policy 1, policy_version 1618228 (0.0011) [2023-12-26 12:36:09,185][123090] Updated weights for policy 1, policy_version 1618238 (0.0010) [2023-12-26 12:36:09,683][123091] Updated weights for policy 0, policy_version 1628917 (0.0011) [2023-12-26 12:36:09,735][123091] Updated weights for policy 0, policy_version 1628927 (0.0011) [2023-12-26 12:36:09,787][123091] Updated weights for policy 0, policy_version 1628937 (0.0011) [2023-12-26 12:36:10,074][123090] Updated weights for policy 1, policy_version 1618248 (0.0011) [2023-12-26 12:36:10,140][123090] Updated weights for policy 1, policy_version 1618258 (0.0011) [2023-12-26 12:36:10,198][123090] Updated weights for policy 1, policy_version 1618268 (0.0011) [2023-12-26 12:36:10,646][123091] Updated weights for policy 0, policy_version 1628947 (0.0011) [2023-12-26 12:36:10,703][123091] Updated weights for policy 0, policy_version 1628957 (0.0010) [2023-12-26 12:36:10,765][123091] Updated weights for policy 0, policy_version 1628967 (0.0006) [2023-12-26 12:36:11,032][123090] Updated weights for policy 1, policy_version 1618278 (0.0011) [2023-12-26 12:36:11,099][123090] Updated weights for policy 1, policy_version 1618288 (0.0010) [2023-12-26 12:36:11,171][123090] Updated weights for policy 1, policy_version 1618298 (0.0010) [2023-12-26 12:36:11,589][123091] Updated weights for policy 0, policy_version 1628977 (0.0010) [2023-12-26 12:36:11,658][123091] Updated weights for policy 0, policy_version 1628987 (0.0009) [2023-12-26 12:36:11,725][123091] Updated weights for policy 0, policy_version 1628997 (0.0009) [2023-12-26 12:36:11,785][123091] Updated weights for policy 0, policy_version 1629007 (0.0009) [2023-12-26 12:36:12,061][123090] Updated weights for policy 1, policy_version 1618308 (0.0010) [2023-12-26 12:36:12,128][123090] Updated weights for policy 1, policy_version 1618318 (0.0011) [2023-12-26 12:36:12,198][123090] Updated weights for policy 1, policy_version 1618328 (0.0010) [2023-12-26 12:36:12,671][123091] Updated weights for policy 0, policy_version 1629017 (0.0009) [2023-12-26 12:36:12,721][123091] Updated weights for policy 0, policy_version 1629027 (0.0009) [2023-12-26 12:36:12,769][123091] Updated weights for policy 0, policy_version 1629037 (0.0005) [2023-12-26 12:36:12,945][123090] Updated weights for policy 1, policy_version 1618338 (0.0010) [2023-12-26 12:36:13,006][123090] Updated weights for policy 1, policy_version 1618348 (0.0005) [2023-12-26 12:36:13,068][123090] Updated weights for policy 1, policy_version 1618358 (0.0008) [2023-12-26 12:36:13,129][123090] Updated weights for policy 1, policy_version 1618368 (0.0005) [2023-12-26 12:36:13,519][123091] Updated weights for policy 0, policy_version 1629047 (0.0005) [2023-12-26 12:36:13,596][123091] Updated weights for policy 0, policy_version 1629057 (0.0005) [2023-12-26 12:36:13,668][123091] Updated weights for policy 0, policy_version 1629067 (0.0005) [2023-12-26 12:36:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 831348736. Throughput: 0: 9010.3, 1: 8889.3. Samples: 831340640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:13,785][121949] Avg episode reward: [(0, '6114.374'), (1, '5742.835')] [2023-12-26 12:36:13,935][123090] Updated weights for policy 1, policy_version 1618378 (0.0010) [2023-12-26 12:36:13,983][123090] Updated weights for policy 1, policy_version 1618388 (0.0010) [2023-12-26 12:36:14,031][123090] Updated weights for policy 1, policy_version 1618398 (0.0010) [2023-12-26 12:36:14,419][123091] Updated weights for policy 0, policy_version 1629077 (0.0007) [2023-12-26 12:36:14,478][123091] Updated weights for policy 0, policy_version 1629087 (0.0009) [2023-12-26 12:36:14,533][123091] Updated weights for policy 0, policy_version 1629097 (0.0009) [2023-12-26 12:36:14,898][123090] Updated weights for policy 1, policy_version 1618408 (0.0011) [2023-12-26 12:36:14,966][123090] Updated weights for policy 1, policy_version 1618418 (0.0011) [2023-12-26 12:36:15,039][123090] Updated weights for policy 1, policy_version 1618428 (0.0011) [2023-12-26 12:36:15,394][123091] Updated weights for policy 0, policy_version 1629107 (0.0009) [2023-12-26 12:36:15,460][123091] Updated weights for policy 0, policy_version 1629117 (0.0009) [2023-12-26 12:36:15,520][123091] Updated weights for policy 0, policy_version 1629127 (0.0009) [2023-12-26 12:36:15,857][123090] Updated weights for policy 1, policy_version 1618438 (0.0011) [2023-12-26 12:36:15,904][123090] Updated weights for policy 1, policy_version 1618448 (0.0010) [2023-12-26 12:36:15,970][123090] Updated weights for policy 1, policy_version 1618458 (0.0006) [2023-12-26 12:36:16,273][123091] Updated weights for policy 0, policy_version 1629137 (0.0008) [2023-12-26 12:36:16,318][123091] Updated weights for policy 0, policy_version 1629147 (0.0005) [2023-12-26 12:36:16,370][123091] Updated weights for policy 0, policy_version 1629157 (0.0005) [2023-12-26 12:36:16,431][123091] Updated weights for policy 0, policy_version 1629167 (0.0005) [2023-12-26 12:36:16,618][123090] Updated weights for policy 1, policy_version 1618468 (0.0005) [2023-12-26 12:36:16,689][123090] Updated weights for policy 1, policy_version 1618478 (0.0005) [2023-12-26 12:36:16,752][123090] Updated weights for policy 1, policy_version 1618488 (0.0005) [2023-12-26 12:36:17,083][123091] Updated weights for policy 0, policy_version 1629177 (0.0008) [2023-12-26 12:36:17,147][123091] Updated weights for policy 0, policy_version 1629187 (0.0008) [2023-12-26 12:36:17,200][123091] Updated weights for policy 0, policy_version 1629197 (0.0011) [2023-12-26 12:36:17,436][123090] Updated weights for policy 1, policy_version 1618498 (0.0005) [2023-12-26 12:36:17,493][123090] Updated weights for policy 1, policy_version 1618508 (0.0006) [2023-12-26 12:36:17,545][123090] Updated weights for policy 1, policy_version 1618518 (0.0008) [2023-12-26 12:36:17,598][123090] Updated weights for policy 1, policy_version 1618528 (0.0009) [2023-12-26 12:36:17,993][123091] Updated weights for policy 0, policy_version 1629207 (0.0010) [2023-12-26 12:36:18,044][123091] Updated weights for policy 0, policy_version 1629217 (0.0011) [2023-12-26 12:36:18,095][123091] Updated weights for policy 0, policy_version 1629227 (0.0010) [2023-12-26 12:36:18,379][123090] Updated weights for policy 1, policy_version 1618538 (0.0007) [2023-12-26 12:36:18,449][123090] Updated weights for policy 1, policy_version 1618548 (0.0009) [2023-12-26 12:36:18,517][123090] Updated weights for policy 1, policy_version 1618558 (0.0009) [2023-12-26 12:36:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 831438848. Throughput: 0: 8947.3, 1: 8922.4. Samples: 831449872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:18,786][121949] Avg episode reward: [(0, '6170.960'), (1, '5945.021')] [2023-12-26 12:36:18,939][123091] Updated weights for policy 0, policy_version 1629237 (0.0008) [2023-12-26 12:36:18,994][123091] Updated weights for policy 0, policy_version 1629247 (0.0005) [2023-12-26 12:36:19,048][123091] Updated weights for policy 0, policy_version 1629257 (0.0005) [2023-12-26 12:36:19,343][123090] Updated weights for policy 1, policy_version 1618568 (0.0009) [2023-12-26 12:36:19,417][123090] Updated weights for policy 1, policy_version 1618578 (0.0007) [2023-12-26 12:36:19,488][123090] Updated weights for policy 1, policy_version 1618588 (0.0007) [2023-12-26 12:36:19,880][123091] Updated weights for policy 0, policy_version 1629267 (0.0006) [2023-12-26 12:36:19,944][123091] Updated weights for policy 0, policy_version 1629277 (0.0009) [2023-12-26 12:36:20,011][123091] Updated weights for policy 0, policy_version 1629287 (0.0009) [2023-12-26 12:36:20,313][123090] Updated weights for policy 1, policy_version 1618598 (0.0009) [2023-12-26 12:36:20,370][123090] Updated weights for policy 1, policy_version 1618608 (0.0009) [2023-12-26 12:36:20,419][123090] Updated weights for policy 1, policy_version 1618618 (0.0009) [2023-12-26 12:36:20,895][123091] Updated weights for policy 0, policy_version 1629297 (0.0009) [2023-12-26 12:36:20,964][123091] Updated weights for policy 0, policy_version 1629307 (0.0010) [2023-12-26 12:36:21,033][123091] Updated weights for policy 0, policy_version 1629317 (0.0010) [2023-12-26 12:36:21,103][123091] Updated weights for policy 0, policy_version 1629327 (0.0010) [2023-12-26 12:36:21,248][123090] Updated weights for policy 1, policy_version 1618628 (0.0009) [2023-12-26 12:36:21,319][123090] Updated weights for policy 1, policy_version 1618638 (0.0010) [2023-12-26 12:36:21,393][123090] Updated weights for policy 1, policy_version 1618648 (0.0009) [2023-12-26 12:36:21,964][123091] Updated weights for policy 0, policy_version 1629337 (0.0009) [2023-12-26 12:36:22,030][123091] Updated weights for policy 0, policy_version 1629347 (0.0009) [2023-12-26 12:36:22,096][123091] Updated weights for policy 0, policy_version 1629357 (0.0010) [2023-12-26 12:36:22,183][123090] Updated weights for policy 1, policy_version 1618658 (0.0008) [2023-12-26 12:36:22,247][123090] Updated weights for policy 1, policy_version 1618668 (0.0010) [2023-12-26 12:36:22,307][123090] Updated weights for policy 1, policy_version 1618678 (0.0010) [2023-12-26 12:36:22,356][123090] Updated weights for policy 1, policy_version 1618688 (0.0010) [2023-12-26 12:36:22,924][123091] Updated weights for policy 0, policy_version 1629367 (0.0008) [2023-12-26 12:36:22,989][123091] Updated weights for policy 0, policy_version 1629377 (0.0009) [2023-12-26 12:36:23,038][123091] Updated weights for policy 0, policy_version 1629387 (0.0009) [2023-12-26 12:36:23,210][123090] Updated weights for policy 1, policy_version 1618698 (0.0010) [2023-12-26 12:36:23,273][123090] Updated weights for policy 1, policy_version 1618708 (0.0010) [2023-12-26 12:36:23,336][123090] Updated weights for policy 1, policy_version 1618718 (0.0010) [2023-12-26 12:36:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 831520768. Throughput: 0: 8894.6, 1: 8864.8. Samples: 831500292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:23,785][121949] Avg episode reward: [(0, '6313.108'), (1, '5855.185')] [2023-12-26 12:36:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001629392_417128448.pth... [2023-12-26 12:36:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001618720_414392320.pth... [2023-12-26 12:36:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001617696_414130176.pth [2023-12-26 12:36:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001628368_416866304.pth [2023-12-26 12:36:23,886][123091] Updated weights for policy 0, policy_version 1629397 (0.0009) [2023-12-26 12:36:23,934][123091] Updated weights for policy 0, policy_version 1629407 (0.0009) [2023-12-26 12:36:23,987][123091] Updated weights for policy 0, policy_version 1629417 (0.0009) [2023-12-26 12:36:24,155][123090] Updated weights for policy 1, policy_version 1618728 (0.0010) [2023-12-26 12:36:24,218][123090] Updated weights for policy 1, policy_version 1618738 (0.0010) [2023-12-26 12:36:24,289][123090] Updated weights for policy 1, policy_version 1618748 (0.0010) [2023-12-26 12:36:24,879][123091] Updated weights for policy 0, policy_version 1629427 (0.0009) [2023-12-26 12:36:24,924][123091] Updated weights for policy 0, policy_version 1629437 (0.0006) [2023-12-26 12:36:24,971][123091] Updated weights for policy 0, policy_version 1629447 (0.0005) [2023-12-26 12:36:25,034][123090] Updated weights for policy 1, policy_version 1618758 (0.0009) [2023-12-26 12:36:25,100][123090] Updated weights for policy 1, policy_version 1618768 (0.0010) [2023-12-26 12:36:25,165][123090] Updated weights for policy 1, policy_version 1618778 (0.0009) [2023-12-26 12:36:25,658][123091] Updated weights for policy 0, policy_version 1629457 (0.0005) [2023-12-26 12:36:25,729][123091] Updated weights for policy 0, policy_version 1629467 (0.0005) [2023-12-26 12:36:25,805][123091] Updated weights for policy 0, policy_version 1629477 (0.0005) [2023-12-26 12:36:25,879][123091] Updated weights for policy 0, policy_version 1629487 (0.0005) [2023-12-26 12:36:25,990][123090] Updated weights for policy 1, policy_version 1618788 (0.0009) [2023-12-26 12:36:26,038][123090] Updated weights for policy 1, policy_version 1618798 (0.0010) [2023-12-26 12:36:26,094][123090] Updated weights for policy 1, policy_version 1618808 (0.0010) [2023-12-26 12:36:26,472][123091] Updated weights for policy 0, policy_version 1629497 (0.0005) [2023-12-26 12:36:26,516][123091] Updated weights for policy 0, policy_version 1629507 (0.0005) [2023-12-26 12:36:26,561][123091] Updated weights for policy 0, policy_version 1629517 (0.0005) [2023-12-26 12:36:26,813][123090] Updated weights for policy 1, policy_version 1618818 (0.0009) [2023-12-26 12:36:26,864][123090] Updated weights for policy 1, policy_version 1618828 (0.0006) [2023-12-26 12:36:26,923][123090] Updated weights for policy 1, policy_version 1618838 (0.0005) [2023-12-26 12:36:26,973][123090] Updated weights for policy 1, policy_version 1618848 (0.0005) [2023-12-26 12:36:27,299][123091] Updated weights for policy 0, policy_version 1629527 (0.0005) [2023-12-26 12:36:27,353][123091] Updated weights for policy 0, policy_version 1629537 (0.0008) [2023-12-26 12:36:27,405][123091] Updated weights for policy 0, policy_version 1629547 (0.0010) [2023-12-26 12:36:27,645][123090] Updated weights for policy 1, policy_version 1618858 (0.0010) [2023-12-26 12:36:27,697][123090] Updated weights for policy 1, policy_version 1618868 (0.0010) [2023-12-26 12:36:27,748][123090] Updated weights for policy 1, policy_version 1618878 (0.0010) [2023-12-26 12:36:28,253][123091] Updated weights for policy 0, policy_version 1629558 (0.0010) [2023-12-26 12:36:28,317][123091] Updated weights for policy 0, policy_version 1629569 (0.0010) [2023-12-26 12:36:28,385][123091] Updated weights for policy 0, policy_version 1629579 (0.0009) [2023-12-26 12:36:28,569][123090] Updated weights for policy 1, policy_version 1618888 (0.0008) [2023-12-26 12:36:28,636][123090] Updated weights for policy 1, policy_version 1618898 (0.0005) [2023-12-26 12:36:28,683][123090] Updated weights for policy 1, policy_version 1618908 (0.0005) [2023-12-26 12:36:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 831619072. Throughput: 0: 8955.1, 1: 8923.0. Samples: 831609368. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:28,784][121949] Avg episode reward: [(0, '6179.014'), (1, '5845.622')] [2023-12-26 12:36:29,166][123091] Updated weights for policy 0, policy_version 1629589 (0.0009) [2023-12-26 12:36:29,235][123091] Updated weights for policy 0, policy_version 1629599 (0.0009) [2023-12-26 12:36:29,299][123091] Updated weights for policy 0, policy_version 1629609 (0.0011) [2023-12-26 12:36:29,395][123090] Updated weights for policy 1, policy_version 1618918 (0.0007) [2023-12-26 12:36:29,456][123090] Updated weights for policy 1, policy_version 1618928 (0.0010) [2023-12-26 12:36:29,521][123090] Updated weights for policy 1, policy_version 1618938 (0.0010) [2023-12-26 12:36:30,099][123091] Updated weights for policy 0, policy_version 1629619 (0.0007) [2023-12-26 12:36:30,160][123091] Updated weights for policy 0, policy_version 1629629 (0.0006) [2023-12-26 12:36:30,221][123091] Updated weights for policy 0, policy_version 1629639 (0.0006) [2023-12-26 12:36:30,369][123090] Updated weights for policy 1, policy_version 1618948 (0.0009) [2023-12-26 12:36:30,426][123090] Updated weights for policy 1, policy_version 1618958 (0.0010) [2023-12-26 12:36:30,480][123090] Updated weights for policy 1, policy_version 1618968 (0.0009) [2023-12-26 12:36:30,918][123091] Updated weights for policy 0, policy_version 1629649 (0.0005) [2023-12-26 12:36:30,976][123091] Updated weights for policy 0, policy_version 1629659 (0.0005) [2023-12-26 12:36:31,031][123091] Updated weights for policy 0, policy_version 1629669 (0.0006) [2023-12-26 12:36:31,093][123091] Updated weights for policy 0, policy_version 1629679 (0.0007) [2023-12-26 12:36:31,353][123090] Updated weights for policy 1, policy_version 1618978 (0.0008) [2023-12-26 12:36:31,430][123090] Updated weights for policy 1, policy_version 1618988 (0.0010) [2023-12-26 12:36:31,479][123090] Updated weights for policy 1, policy_version 1618998 (0.0009) [2023-12-26 12:36:31,540][123090] Updated weights for policy 1, policy_version 1619008 (0.0009) [2023-12-26 12:36:31,880][123091] Updated weights for policy 0, policy_version 1629689 (0.0009) [2023-12-26 12:36:31,945][123091] Updated weights for policy 0, policy_version 1629699 (0.0009) [2023-12-26 12:36:32,015][123091] Updated weights for policy 0, policy_version 1629709 (0.0010) [2023-12-26 12:36:32,412][123090] Updated weights for policy 1, policy_version 1619018 (0.0010) [2023-12-26 12:36:32,479][123090] Updated weights for policy 1, policy_version 1619028 (0.0007) [2023-12-26 12:36:32,550][123090] Updated weights for policy 1, policy_version 1619038 (0.0007) [2023-12-26 12:36:32,902][123091] Updated weights for policy 0, policy_version 1629719 (0.0010) [2023-12-26 12:36:32,954][123091] Updated weights for policy 0, policy_version 1629729 (0.0010) [2023-12-26 12:36:33,015][123091] Updated weights for policy 0, policy_version 1629739 (0.0009) [2023-12-26 12:36:33,320][123090] Updated weights for policy 1, policy_version 1619048 (0.0006) [2023-12-26 12:36:33,388][123090] Updated weights for policy 1, policy_version 1619058 (0.0008) [2023-12-26 12:36:33,460][123090] Updated weights for policy 1, policy_version 1619068 (0.0006) [2023-12-26 12:36:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 831700992. Throughput: 0: 8832.2, 1: 8822.9. Samples: 831714736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:33,785][121949] Avg episode reward: [(0, '6173.640'), (1, '5876.288')] [2023-12-26 12:36:33,881][123091] Updated weights for policy 0, policy_version 1629749 (0.0009) [2023-12-26 12:36:33,935][123091] Updated weights for policy 0, policy_version 1629759 (0.0010) [2023-12-26 12:36:33,992][123091] Updated weights for policy 0, policy_version 1629770 (0.0007) [2023-12-26 12:36:34,043][123090] Updated weights for policy 1, policy_version 1619078 (0.0009) [2023-12-26 12:36:34,104][123090] Updated weights for policy 1, policy_version 1619088 (0.0008) [2023-12-26 12:36:34,166][123090] Updated weights for policy 1, policy_version 1619098 (0.0009) [2023-12-26 12:36:34,890][123091] Updated weights for policy 0, policy_version 1629780 (0.0007) [2023-12-26 12:36:34,904][123090] Updated weights for policy 1, policy_version 1619108 (0.0008) [2023-12-26 12:36:34,940][123091] Updated weights for policy 0, policy_version 1629790 (0.0009) [2023-12-26 12:36:34,958][123090] Updated weights for policy 1, policy_version 1619118 (0.0005) [2023-12-26 12:36:34,989][123091] Updated weights for policy 0, policy_version 1629800 (0.0009) [2023-12-26 12:36:35,014][123090] Updated weights for policy 1, policy_version 1619128 (0.0005) [2023-12-26 12:36:35,670][123090] Updated weights for policy 1, policy_version 1619138 (0.0005) [2023-12-26 12:36:35,719][123090] Updated weights for policy 1, policy_version 1619148 (0.0005) [2023-12-26 12:36:35,786][123090] Updated weights for policy 1, policy_version 1619158 (0.0005) [2023-12-26 12:36:35,842][123090] Updated weights for policy 1, policy_version 1619168 (0.0005) [2023-12-26 12:36:35,922][123091] Updated weights for policy 0, policy_version 1629810 (0.0009) [2023-12-26 12:36:35,975][123091] Updated weights for policy 0, policy_version 1629820 (0.0010) [2023-12-26 12:36:36,034][123091] Updated weights for policy 0, policy_version 1629831 (0.0010) [2023-12-26 12:36:36,574][123090] Updated weights for policy 1, policy_version 1619178 (0.0010) [2023-12-26 12:36:36,635][123090] Updated weights for policy 1, policy_version 1619188 (0.0009) [2023-12-26 12:36:36,690][123090] Updated weights for policy 1, policy_version 1619198 (0.0009) [2023-12-26 12:36:36,832][123091] Updated weights for policy 0, policy_version 1629842 (0.0009) [2023-12-26 12:36:36,906][123091] Updated weights for policy 0, policy_version 1629852 (0.0006) [2023-12-26 12:36:36,977][123091] Updated weights for policy 0, policy_version 1629862 (0.0006) [2023-12-26 12:36:37,048][123091] Updated weights for policy 0, policy_version 1629872 (0.0006) [2023-12-26 12:36:37,569][123090] Updated weights for policy 1, policy_version 1619208 (0.0007) [2023-12-26 12:36:37,618][123090] Updated weights for policy 1, policy_version 1619218 (0.0005) [2023-12-26 12:36:37,626][123091] Updated weights for policy 0, policy_version 1629882 (0.0006) [2023-12-26 12:36:37,668][123090] Updated weights for policy 1, policy_version 1619228 (0.0006) [2023-12-26 12:36:37,678][123091] Updated weights for policy 0, policy_version 1629892 (0.0008) [2023-12-26 12:36:37,731][123091] Updated weights for policy 0, policy_version 1629902 (0.0007) [2023-12-26 12:36:38,368][123091] Updated weights for policy 0, policy_version 1629912 (0.0008) [2023-12-26 12:36:38,435][123091] Updated weights for policy 0, policy_version 1629922 (0.0011) [2023-12-26 12:36:38,464][123090] Updated weights for policy 1, policy_version 1619238 (0.0009) [2023-12-26 12:36:38,503][123091] Updated weights for policy 0, policy_version 1629932 (0.0011) [2023-12-26 12:36:38,517][123090] Updated weights for policy 1, policy_version 1619248 (0.0010) [2023-12-26 12:36:38,576][123090] Updated weights for policy 1, policy_version 1619258 (0.0010) [2023-12-26 12:36:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 831799296. Throughput: 0: 8778.3, 1: 8926.9. Samples: 831768880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:38,785][121949] Avg episode reward: [(0, '6243.358'), (1, '5846.951')] [2023-12-26 12:36:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001629936_417267712.pth... [2023-12-26 12:36:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001619264_414531584.pth... [2023-12-26 12:36:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001628912_417005568.pth [2023-12-26 12:36:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001618208_414261248.pth [2023-12-26 12:36:39,315][123091] Updated weights for policy 0, policy_version 1629942 (0.0010) [2023-12-26 12:36:39,359][123090] Updated weights for policy 1, policy_version 1619268 (0.0010) [2023-12-26 12:36:39,385][123091] Updated weights for policy 0, policy_version 1629952 (0.0008) [2023-12-26 12:36:39,428][123090] Updated weights for policy 1, policy_version 1619278 (0.0010) [2023-12-26 12:36:39,454][123091] Updated weights for policy 0, policy_version 1629962 (0.0008) [2023-12-26 12:36:39,499][123090] Updated weights for policy 1, policy_version 1619288 (0.0009) [2023-12-26 12:36:40,174][123091] Updated weights for policy 0, policy_version 1629972 (0.0008) [2023-12-26 12:36:40,234][123091] Updated weights for policy 0, policy_version 1629982 (0.0010) [2023-12-26 12:36:40,295][123090] Updated weights for policy 1, policy_version 1619298 (0.0010) [2023-12-26 12:36:40,296][123091] Updated weights for policy 0, policy_version 1629992 (0.0011) [2023-12-26 12:36:40,356][123090] Updated weights for policy 1, policy_version 1619308 (0.0008) [2023-12-26 12:36:40,418][123090] Updated weights for policy 1, policy_version 1619318 (0.0008) [2023-12-26 12:36:40,489][123090] Updated weights for policy 1, policy_version 1619328 (0.0008) [2023-12-26 12:36:41,153][123091] Updated weights for policy 0, policy_version 1630002 (0.0010) [2023-12-26 12:36:41,188][123090] Updated weights for policy 1, policy_version 1619338 (0.0008) [2023-12-26 12:36:41,222][123091] Updated weights for policy 0, policy_version 1630012 (0.0006) [2023-12-26 12:36:41,261][123090] Updated weights for policy 1, policy_version 1619348 (0.0008) [2023-12-26 12:36:41,288][123091] Updated weights for policy 0, policy_version 1630022 (0.0007) [2023-12-26 12:36:41,326][123090] Updated weights for policy 1, policy_version 1619358 (0.0009) [2023-12-26 12:36:41,358][123091] Updated weights for policy 0, policy_version 1630032 (0.0006) [2023-12-26 12:36:42,143][123090] Updated weights for policy 1, policy_version 1619368 (0.0010) [2023-12-26 12:36:42,148][123091] Updated weights for policy 0, policy_version 1630042 (0.0011) [2023-12-26 12:36:42,203][123090] Updated weights for policy 1, policy_version 1619378 (0.0007) [2023-12-26 12:36:42,204][123091] Updated weights for policy 0, policy_version 1630052 (0.0010) [2023-12-26 12:36:42,265][123091] Updated weights for policy 0, policy_version 1630062 (0.0011) [2023-12-26 12:36:42,271][123090] Updated weights for policy 1, policy_version 1619388 (0.0007) [2023-12-26 12:36:42,935][123091] Updated weights for policy 0, policy_version 1630072 (0.0007) [2023-12-26 12:36:42,996][123091] Updated weights for policy 0, policy_version 1630082 (0.0006) [2023-12-26 12:36:43,044][123091] Updated weights for policy 0, policy_version 1630092 (0.0005) [2023-12-26 12:36:43,168][123090] Updated weights for policy 1, policy_version 1619398 (0.0009) [2023-12-26 12:36:43,221][123090] Updated weights for policy 1, policy_version 1619408 (0.0009) [2023-12-26 12:36:43,274][123090] Updated weights for policy 1, policy_version 1619419 (0.0010) [2023-12-26 12:36:43,748][123091] Updated weights for policy 0, policy_version 1630102 (0.0008) [2023-12-26 12:36:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 831881216. Throughput: 0: 8850.6, 1: 8804.2. Samples: 831876620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:43,785][121949] Avg episode reward: [(0, '6149.634'), (1, '5942.765')] [2023-12-26 12:36:43,807][123091] Updated weights for policy 0, policy_version 1630112 (0.0011) [2023-12-26 12:36:43,870][123091] Updated weights for policy 0, policy_version 1630122 (0.0011) [2023-12-26 12:36:44,219][123090] Updated weights for policy 1, policy_version 1619429 (0.0009) [2023-12-26 12:36:44,271][123090] Updated weights for policy 1, policy_version 1619439 (0.0009) [2023-12-26 12:36:44,326][123090] Updated weights for policy 1, policy_version 1619449 (0.0009) [2023-12-26 12:36:44,634][123091] Updated weights for policy 0, policy_version 1630132 (0.0008) [2023-12-26 12:36:44,690][123091] Updated weights for policy 0, policy_version 1630142 (0.0005) [2023-12-26 12:36:44,736][123091] Updated weights for policy 0, policy_version 1630152 (0.0005) [2023-12-26 12:36:45,225][123090] Updated weights for policy 1, policy_version 1619459 (0.0009) [2023-12-26 12:36:45,289][123090] Updated weights for policy 1, policy_version 1619469 (0.0008) [2023-12-26 12:36:45,354][123090] Updated weights for policy 1, policy_version 1619479 (0.0010) [2023-12-26 12:36:45,514][123091] Updated weights for policy 0, policy_version 1630162 (0.0010) [2023-12-26 12:36:45,570][123091] Updated weights for policy 0, policy_version 1630172 (0.0005) [2023-12-26 12:36:45,634][123091] Updated weights for policy 0, policy_version 1630182 (0.0005) [2023-12-26 12:36:45,695][123091] Updated weights for policy 0, policy_version 1630192 (0.0009) [2023-12-26 12:36:46,236][123090] Updated weights for policy 1, policy_version 1619489 (0.0010) [2023-12-26 12:36:46,296][123090] Updated weights for policy 1, policy_version 1619499 (0.0005) [2023-12-26 12:36:46,360][123090] Updated weights for policy 1, policy_version 1619509 (0.0010) [2023-12-26 12:36:46,418][123090] Updated weights for policy 1, policy_version 1619519 (0.0010) [2023-12-26 12:36:46,448][123091] Updated weights for policy 0, policy_version 1630202 (0.0007) [2023-12-26 12:36:46,505][123091] Updated weights for policy 0, policy_version 1630212 (0.0009) [2023-12-26 12:36:46,558][123091] Updated weights for policy 0, policy_version 1630223 (0.0010) [2023-12-26 12:36:47,127][123090] Updated weights for policy 1, policy_version 1619529 (0.0010) [2023-12-26 12:36:47,184][123090] Updated weights for policy 1, policy_version 1619539 (0.0010) [2023-12-26 12:36:47,234][123090] Updated weights for policy 1, policy_version 1619549 (0.0009) [2023-12-26 12:36:47,432][123091] Updated weights for policy 0, policy_version 1630233 (0.0010) [2023-12-26 12:36:47,481][123091] Updated weights for policy 0, policy_version 1630243 (0.0009) [2023-12-26 12:36:47,536][123091] Updated weights for policy 0, policy_version 1630253 (0.0009) [2023-12-26 12:36:48,056][123090] Updated weights for policy 1, policy_version 1619560 (0.0009) [2023-12-26 12:36:48,118][123090] Updated weights for policy 1, policy_version 1619570 (0.0010) [2023-12-26 12:36:48,180][123090] Updated weights for policy 1, policy_version 1619580 (0.0009) [2023-12-26 12:36:48,394][123091] Updated weights for policy 0, policy_version 1630263 (0.0009) [2023-12-26 12:36:48,444][123091] Updated weights for policy 0, policy_version 1630273 (0.0009) [2023-12-26 12:36:48,503][123091] Updated weights for policy 0, policy_version 1630283 (0.0010) [2023-12-26 12:36:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 831971328. Throughput: 0: 8899.8, 1: 8791.6. Samples: 831981660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:48,785][121949] Avg episode reward: [(0, '6057.216'), (1, '5813.415')] [2023-12-26 12:36:48,961][123090] Updated weights for policy 1, policy_version 1619590 (0.0007) [2023-12-26 12:36:49,034][123090] Updated weights for policy 1, policy_version 1619600 (0.0009) [2023-12-26 12:36:49,108][123090] Updated weights for policy 1, policy_version 1619610 (0.0008) [2023-12-26 12:36:49,259][123091] Updated weights for policy 0, policy_version 1630293 (0.0008) [2023-12-26 12:36:49,322][123091] Updated weights for policy 0, policy_version 1630303 (0.0009) [2023-12-26 12:36:49,388][123091] Updated weights for policy 0, policy_version 1630313 (0.0008) [2023-12-26 12:36:49,783][123090] Updated weights for policy 1, policy_version 1619620 (0.0008) [2023-12-26 12:36:49,862][123090] Updated weights for policy 1, policy_version 1619630 (0.0010) [2023-12-26 12:36:49,934][123090] Updated weights for policy 1, policy_version 1619640 (0.0007) [2023-12-26 12:36:50,095][123091] Updated weights for policy 0, policy_version 1630323 (0.0007) [2023-12-26 12:36:50,162][123091] Updated weights for policy 0, policy_version 1630333 (0.0009) [2023-12-26 12:36:50,222][123091] Updated weights for policy 0, policy_version 1630343 (0.0011) [2023-12-26 12:36:50,751][123090] Updated weights for policy 1, policy_version 1619650 (0.0008) [2023-12-26 12:36:50,819][123090] Updated weights for policy 1, policy_version 1619660 (0.0008) [2023-12-26 12:36:50,887][123090] Updated weights for policy 1, policy_version 1619670 (0.0009) [2023-12-26 12:36:50,955][123090] Updated weights for policy 1, policy_version 1619680 (0.0010) [2023-12-26 12:36:50,974][123091] Updated weights for policy 0, policy_version 1630353 (0.0009) [2023-12-26 12:36:51,038][123091] Updated weights for policy 0, policy_version 1630363 (0.0009) [2023-12-26 12:36:51,107][123091] Updated weights for policy 0, policy_version 1630373 (0.0009) [2023-12-26 12:36:51,175][123091] Updated weights for policy 0, policy_version 1630383 (0.0010) [2023-12-26 12:36:51,782][123090] Updated weights for policy 1, policy_version 1619690 (0.0011) [2023-12-26 12:36:51,849][123090] Updated weights for policy 1, policy_version 1619700 (0.0010) [2023-12-26 12:36:51,920][123090] Updated weights for policy 1, policy_version 1619710 (0.0011) [2023-12-26 12:36:52,037][123091] Updated weights for policy 0, policy_version 1630393 (0.0006) [2023-12-26 12:36:52,098][123091] Updated weights for policy 0, policy_version 1630403 (0.0006) [2023-12-26 12:36:52,162][123091] Updated weights for policy 0, policy_version 1630413 (0.0005) [2023-12-26 12:36:52,733][123090] Updated weights for policy 1, policy_version 1619720 (0.0011) [2023-12-26 12:36:52,797][123090] Updated weights for policy 1, policy_version 1619730 (0.0010) [2023-12-26 12:36:52,841][123090] Updated weights for policy 1, policy_version 1619740 (0.0010) [2023-12-26 12:36:52,902][123091] Updated weights for policy 0, policy_version 1630423 (0.0008) [2023-12-26 12:36:52,954][123091] Updated weights for policy 0, policy_version 1630433 (0.0009) [2023-12-26 12:36:53,006][123091] Updated weights for policy 0, policy_version 1630443 (0.0009) [2023-12-26 12:36:53,691][123090] Updated weights for policy 1, policy_version 1619750 (0.0010) [2023-12-26 12:36:53,743][123091] Updated weights for policy 0, policy_version 1630453 (0.0009) [2023-12-26 12:36:53,755][123090] Updated weights for policy 1, policy_version 1619760 (0.0011) [2023-12-26 12:36:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 832053248. Throughput: 0: 8926.9, 1: 8821.5. Samples: 832035956. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:53,785][121949] Avg episode reward: [(0, '6128.978'), (1, '5750.411')] [2023-12-26 12:36:53,799][123091] Updated weights for policy 0, policy_version 1630463 (0.0008) [2023-12-26 12:36:53,818][123090] Updated weights for policy 1, policy_version 1619770 (0.0010) [2023-12-26 12:36:53,853][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001619776_414662656.pth... [2023-12-26 12:36:53,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001618720_414392320.pth [2023-12-26 12:36:53,859][123091] Updated weights for policy 0, policy_version 1630473 (0.0007) [2023-12-26 12:36:53,908][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001630480_417406976.pth... [2023-12-26 12:36:53,913][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001629392_417128448.pth [2023-12-26 12:36:54,607][123090] Updated weights for policy 1, policy_version 1619780 (0.0010) [2023-12-26 12:36:54,634][123091] Updated weights for policy 0, policy_version 1630483 (0.0005) [2023-12-26 12:36:54,675][123090] Updated weights for policy 1, policy_version 1619790 (0.0007) [2023-12-26 12:36:54,702][123091] Updated weights for policy 0, policy_version 1630493 (0.0006) [2023-12-26 12:36:54,742][123090] Updated weights for policy 1, policy_version 1619800 (0.0008) [2023-12-26 12:36:54,759][123091] Updated weights for policy 0, policy_version 1630503 (0.0007) [2023-12-26 12:36:55,521][123090] Updated weights for policy 1, policy_version 1619810 (0.0008) [2023-12-26 12:36:55,562][123091] Updated weights for policy 0, policy_version 1630513 (0.0008) [2023-12-26 12:36:55,589][123090] Updated weights for policy 1, policy_version 1619820 (0.0009) [2023-12-26 12:36:55,623][123091] Updated weights for policy 0, policy_version 1630523 (0.0009) [2023-12-26 12:36:55,644][123090] Updated weights for policy 1, policy_version 1619830 (0.0009) [2023-12-26 12:36:55,686][123091] Updated weights for policy 0, policy_version 1630533 (0.0009) [2023-12-26 12:36:55,706][123090] Updated weights for policy 1, policy_version 1619840 (0.0006) [2023-12-26 12:36:55,746][123091] Updated weights for policy 0, policy_version 1630543 (0.0009) [2023-12-26 12:36:56,357][123090] Updated weights for policy 1, policy_version 1619850 (0.0008) [2023-12-26 12:36:56,408][123090] Updated weights for policy 1, policy_version 1619861 (0.0010) [2023-12-26 12:36:56,455][123090] Updated weights for policy 1, policy_version 1619871 (0.0008) [2023-12-26 12:36:56,600][123091] Updated weights for policy 0, policy_version 1630553 (0.0009) [2023-12-26 12:36:56,657][123091] Updated weights for policy 0, policy_version 1630563 (0.0009) [2023-12-26 12:36:56,708][123091] Updated weights for policy 0, policy_version 1630573 (0.0009) [2023-12-26 12:36:57,335][123090] Updated weights for policy 1, policy_version 1619881 (0.0009) [2023-12-26 12:36:57,383][123090] Updated weights for policy 1, policy_version 1619891 (0.0008) [2023-12-26 12:36:57,446][123090] Updated weights for policy 1, policy_version 1619901 (0.0009) [2023-12-26 12:36:57,471][123091] Updated weights for policy 0, policy_version 1630583 (0.0007) [2023-12-26 12:36:57,518][123091] Updated weights for policy 0, policy_version 1630593 (0.0005) [2023-12-26 12:36:57,572][123091] Updated weights for policy 0, policy_version 1630603 (0.0009) [2023-12-26 12:36:58,268][123091] Updated weights for policy 0, policy_version 1630613 (0.0009) [2023-12-26 12:36:58,309][123090] Updated weights for policy 1, policy_version 1619911 (0.0008) [2023-12-26 12:36:58,323][123091] Updated weights for policy 0, policy_version 1630623 (0.0011) [2023-12-26 12:36:58,378][123090] Updated weights for policy 1, policy_version 1619921 (0.0008) [2023-12-26 12:36:58,390][123091] Updated weights for policy 0, policy_version 1630633 (0.0011) [2023-12-26 12:36:58,449][123090] Updated weights for policy 1, policy_version 1619931 (0.0007) [2023-12-26 12:36:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 832151552. Throughput: 0: 8953.3, 1: 8867.9. Samples: 832142596. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:36:58,785][121949] Avg episode reward: [(0, '6162.869'), (1, '5712.025')] [2023-12-26 12:36:59,249][123090] Updated weights for policy 1, policy_version 1619941 (0.0007) [2023-12-26 12:36:59,269][123091] Updated weights for policy 0, policy_version 1630643 (0.0009) [2023-12-26 12:36:59,316][123090] Updated weights for policy 1, policy_version 1619951 (0.0008) [2023-12-26 12:36:59,329][123091] Updated weights for policy 0, policy_version 1630653 (0.0009) [2023-12-26 12:36:59,386][123090] Updated weights for policy 1, policy_version 1619961 (0.0008) [2023-12-26 12:36:59,400][123091] Updated weights for policy 0, policy_version 1630663 (0.0008) [2023-12-26 12:37:00,203][123090] Updated weights for policy 1, policy_version 1619971 (0.0009) [2023-12-26 12:37:00,250][123091] Updated weights for policy 0, policy_version 1630673 (0.0009) [2023-12-26 12:37:00,265][123090] Updated weights for policy 1, policy_version 1619981 (0.0009) [2023-12-26 12:37:00,303][123091] Updated weights for policy 0, policy_version 1630683 (0.0005) [2023-12-26 12:37:00,325][123090] Updated weights for policy 1, policy_version 1619991 (0.0008) [2023-12-26 12:37:00,366][123091] Updated weights for policy 0, policy_version 1630693 (0.0008) [2023-12-26 12:37:00,427][123091] Updated weights for policy 0, policy_version 1630703 (0.0006) [2023-12-26 12:37:01,123][123090] Updated weights for policy 1, policy_version 1620001 (0.0009) [2023-12-26 12:37:01,184][123090] Updated weights for policy 1, policy_version 1620011 (0.0008) [2023-12-26 12:37:01,216][123091] Updated weights for policy 0, policy_version 1630713 (0.0006) [2023-12-26 12:37:01,251][123090] Updated weights for policy 1, policy_version 1620021 (0.0009) [2023-12-26 12:37:01,279][123091] Updated weights for policy 0, policy_version 1630723 (0.0007) [2023-12-26 12:37:01,315][123090] Updated weights for policy 1, policy_version 1620031 (0.0010) [2023-12-26 12:37:01,344][123091] Updated weights for policy 0, policy_version 1630733 (0.0007) [2023-12-26 12:37:02,070][123091] Updated weights for policy 0, policy_version 1630743 (0.0009) [2023-12-26 12:37:02,135][123091] Updated weights for policy 0, policy_version 1630754 (0.0009) [2023-12-26 12:37:02,176][123090] Updated weights for policy 1, policy_version 1620041 (0.0008) [2023-12-26 12:37:02,198][123091] Updated weights for policy 0, policy_version 1630764 (0.0009) [2023-12-26 12:37:02,232][123090] Updated weights for policy 1, policy_version 1620051 (0.0008) [2023-12-26 12:37:02,287][123090] Updated weights for policy 1, policy_version 1620061 (0.0009) [2023-12-26 12:37:03,069][123091] Updated weights for policy 0, policy_version 1630774 (0.0010) [2023-12-26 12:37:03,119][123090] Updated weights for policy 1, policy_version 1620071 (0.0008) [2023-12-26 12:37:03,132][123091] Updated weights for policy 0, policy_version 1630784 (0.0011) [2023-12-26 12:37:03,182][123090] Updated weights for policy 1, policy_version 1620081 (0.0007) [2023-12-26 12:37:03,184][123091] Updated weights for policy 0, policy_version 1630794 (0.0010) [2023-12-26 12:37:03,248][123090] Updated weights for policy 1, policy_version 1620091 (0.0008) [2023-12-26 12:37:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 832233472. Throughput: 0: 8911.5, 1: 8803.2. Samples: 832247032. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:03,785][121949] Avg episode reward: [(0, '6179.371'), (1, '5824.896')] [2023-12-26 12:37:03,998][123091] Updated weights for policy 0, policy_version 1630804 (0.0011) [2023-12-26 12:37:04,070][123090] Updated weights for policy 1, policy_version 1620101 (0.0009) [2023-12-26 12:37:04,097][123091] Updated weights for policy 0, policy_version 1630814 (0.0011) [2023-12-26 12:37:04,135][123090] Updated weights for policy 1, policy_version 1620111 (0.0007) [2023-12-26 12:37:04,162][123091] Updated weights for policy 0, policy_version 1630824 (0.0011) [2023-12-26 12:37:04,201][123090] Updated weights for policy 1, policy_version 1620121 (0.0009) [2023-12-26 12:37:04,973][123091] Updated weights for policy 0, policy_version 1630834 (0.0011) [2023-12-26 12:37:05,025][123091] Updated weights for policy 0, policy_version 1630844 (0.0010) [2023-12-26 12:37:05,044][123090] Updated weights for policy 1, policy_version 1620131 (0.0008) [2023-12-26 12:37:05,087][123091] Updated weights for policy 0, policy_version 1630854 (0.0010) [2023-12-26 12:37:05,107][123090] Updated weights for policy 1, policy_version 1620141 (0.0007) [2023-12-26 12:37:05,145][123091] Updated weights for policy 0, policy_version 1630864 (0.0010) [2023-12-26 12:37:05,162][123090] Updated weights for policy 1, policy_version 1620151 (0.0008) [2023-12-26 12:37:05,971][123091] Updated weights for policy 0, policy_version 1630874 (0.0011) [2023-12-26 12:37:05,990][123090] Updated weights for policy 1, policy_version 1620161 (0.0008) [2023-12-26 12:37:06,026][123091] Updated weights for policy 0, policy_version 1630884 (0.0010) [2023-12-26 12:37:06,046][123090] Updated weights for policy 1, policy_version 1620171 (0.0005) [2023-12-26 12:37:06,070][123091] Updated weights for policy 0, policy_version 1630894 (0.0010) [2023-12-26 12:37:06,116][123090] Updated weights for policy 1, policy_version 1620181 (0.0006) [2023-12-26 12:37:06,191][123090] Updated weights for policy 1, policy_version 1620191 (0.0009) [2023-12-26 12:37:06,908][123091] Updated weights for policy 0, policy_version 1630904 (0.0010) [2023-12-26 12:37:06,967][123091] Updated weights for policy 0, policy_version 1630914 (0.0011) [2023-12-26 12:37:07,019][123091] Updated weights for policy 0, policy_version 1630924 (0.0010) [2023-12-26 12:37:07,021][123090] Updated weights for policy 1, policy_version 1620201 (0.0006) [2023-12-26 12:37:07,086][123090] Updated weights for policy 1, policy_version 1620211 (0.0008) [2023-12-26 12:37:07,146][123090] Updated weights for policy 1, policy_version 1620221 (0.0009) [2023-12-26 12:37:07,802][123091] Updated weights for policy 0, policy_version 1630934 (0.0007) [2023-12-26 12:37:07,863][123091] Updated weights for policy 0, policy_version 1630944 (0.0010) [2023-12-26 12:37:07,900][123090] Updated weights for policy 1, policy_version 1620231 (0.0007) [2023-12-26 12:37:07,918][123091] Updated weights for policy 0, policy_version 1630954 (0.0010) [2023-12-26 12:37:07,962][123090] Updated weights for policy 1, policy_version 1620241 (0.0010) [2023-12-26 12:37:08,021][123090] Updated weights for policy 1, policy_version 1620251 (0.0010) [2023-12-26 12:37:08,646][123091] Updated weights for policy 0, policy_version 1630964 (0.0008) [2023-12-26 12:37:08,693][123091] Updated weights for policy 0, policy_version 1630974 (0.0010) [2023-12-26 12:37:08,749][123091] Updated weights for policy 0, policy_version 1630984 (0.0010) [2023-12-26 12:37:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 832315392. Throughput: 0: 8928.7, 1: 8792.0. Samples: 832297720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:08,785][121949] Avg episode reward: [(0, '6142.648'), (1, '5778.621')] [2023-12-26 12:37:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001620256_414785536.pth... [2023-12-26 12:37:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001619264_414531584.pth [2023-12-26 12:37:08,798][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001630992_417538048.pth... [2023-12-26 12:37:08,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001629936_417267712.pth [2023-12-26 12:37:08,880][123090] Updated weights for policy 1, policy_version 1620261 (0.0007) [2023-12-26 12:37:08,938][123090] Updated weights for policy 1, policy_version 1620271 (0.0005) [2023-12-26 12:37:08,999][123090] Updated weights for policy 1, policy_version 1620281 (0.0005) [2023-12-26 12:37:09,510][123091] Updated weights for policy 0, policy_version 1630994 (0.0009) [2023-12-26 12:37:09,565][123091] Updated weights for policy 0, policy_version 1631004 (0.0008) [2023-12-26 12:37:09,622][123091] Updated weights for policy 0, policy_version 1631014 (0.0008) [2023-12-26 12:37:09,684][123091] Updated weights for policy 0, policy_version 1631024 (0.0009) [2023-12-26 12:37:09,713][123090] Updated weights for policy 1, policy_version 1620291 (0.0007) [2023-12-26 12:37:09,775][123090] Updated weights for policy 1, policy_version 1620301 (0.0009) [2023-12-26 12:37:09,837][123090] Updated weights for policy 1, policy_version 1620311 (0.0009) [2023-12-26 12:37:10,494][123091] Updated weights for policy 0, policy_version 1631034 (0.0007) [2023-12-26 12:37:10,549][123091] Updated weights for policy 0, policy_version 1631044 (0.0010) [2023-12-26 12:37:10,602][123091] Updated weights for policy 0, policy_version 1631054 (0.0011) [2023-12-26 12:37:10,701][123090] Updated weights for policy 1, policy_version 1620321 (0.0009) [2023-12-26 12:37:10,761][123090] Updated weights for policy 1, policy_version 1620331 (0.0008) [2023-12-26 12:37:10,828][123090] Updated weights for policy 1, policy_version 1620341 (0.0009) [2023-12-26 12:37:10,896][123090] Updated weights for policy 1, policy_version 1620351 (0.0010) [2023-12-26 12:37:11,457][123091] Updated weights for policy 0, policy_version 1631064 (0.0010) [2023-12-26 12:37:11,509][123091] Updated weights for policy 0, policy_version 1631074 (0.0009) [2023-12-26 12:37:11,559][123091] Updated weights for policy 0, policy_version 1631084 (0.0008) [2023-12-26 12:37:11,783][123090] Updated weights for policy 1, policy_version 1620361 (0.0010) [2023-12-26 12:37:11,841][123090] Updated weights for policy 1, policy_version 1620371 (0.0009) [2023-12-26 12:37:11,907][123090] Updated weights for policy 1, policy_version 1620381 (0.0009) [2023-12-26 12:37:12,459][123091] Updated weights for policy 0, policy_version 1631094 (0.0008) [2023-12-26 12:37:12,522][123091] Updated weights for policy 0, policy_version 1631104 (0.0009) [2023-12-26 12:37:12,583][123091] Updated weights for policy 0, policy_version 1631114 (0.0010) [2023-12-26 12:37:12,743][123090] Updated weights for policy 1, policy_version 1620391 (0.0009) [2023-12-26 12:37:12,803][123090] Updated weights for policy 1, policy_version 1620401 (0.0009) [2023-12-26 12:37:12,861][123090] Updated weights for policy 1, policy_version 1620411 (0.0009) [2023-12-26 12:37:13,366][123091] Updated weights for policy 0, policy_version 1631124 (0.0008) [2023-12-26 12:37:13,410][123091] Updated weights for policy 0, policy_version 1631134 (0.0005) [2023-12-26 12:37:13,465][123091] Updated weights for policy 0, policy_version 1631144 (0.0008) [2023-12-26 12:37:13,671][123090] Updated weights for policy 1, policy_version 1620421 (0.0010) [2023-12-26 12:37:13,725][123090] Updated weights for policy 1, policy_version 1620432 (0.0010) [2023-12-26 12:37:13,781][123090] Updated weights for policy 1, policy_version 1620442 (0.0010) [2023-12-26 12:37:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 832405504. Throughput: 0: 8894.9, 1: 8725.8. Samples: 832402300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:13,785][121949] Avg episode reward: [(0, '6050.748'), (1, '5689.373')] [2023-12-26 12:37:14,182][123091] Updated weights for policy 0, policy_version 1631154 (0.0010) [2023-12-26 12:37:14,234][123091] Updated weights for policy 0, policy_version 1631164 (0.0008) [2023-12-26 12:37:14,288][123091] Updated weights for policy 0, policy_version 1631174 (0.0008) [2023-12-26 12:37:14,336][123091] Updated weights for policy 0, policy_version 1631184 (0.0008) [2023-12-26 12:37:14,678][123090] Updated weights for policy 1, policy_version 1620452 (0.0009) [2023-12-26 12:37:14,734][123090] Updated weights for policy 1, policy_version 1620462 (0.0008) [2023-12-26 12:37:14,800][123090] Updated weights for policy 1, policy_version 1620472 (0.0008) [2023-12-26 12:37:15,152][123091] Updated weights for policy 0, policy_version 1631194 (0.0006) [2023-12-26 12:37:15,222][123091] Updated weights for policy 0, policy_version 1631204 (0.0010) [2023-12-26 12:37:15,282][123091] Updated weights for policy 0, policy_version 1631214 (0.0011) [2023-12-26 12:37:15,610][123090] Updated weights for policy 1, policy_version 1620482 (0.0006) [2023-12-26 12:37:15,684][123090] Updated weights for policy 1, policy_version 1620492 (0.0008) [2023-12-26 12:37:15,739][123090] Updated weights for policy 1, policy_version 1620502 (0.0010) [2023-12-26 12:37:15,799][123090] Updated weights for policy 1, policy_version 1620512 (0.0009) [2023-12-26 12:37:16,084][123091] Updated weights for policy 0, policy_version 1631224 (0.0010) [2023-12-26 12:37:16,152][123091] Updated weights for policy 0, policy_version 1631234 (0.0006) [2023-12-26 12:37:16,223][123091] Updated weights for policy 0, policy_version 1631244 (0.0005) [2023-12-26 12:37:16,579][123090] Updated weights for policy 1, policy_version 1620522 (0.0010) [2023-12-26 12:37:16,642][123090] Updated weights for policy 1, policy_version 1620532 (0.0010) [2023-12-26 12:37:16,700][123090] Updated weights for policy 1, policy_version 1620542 (0.0009) [2023-12-26 12:37:16,860][123091] Updated weights for policy 0, policy_version 1631254 (0.0005) [2023-12-26 12:37:16,922][123091] Updated weights for policy 0, policy_version 1631264 (0.0005) [2023-12-26 12:37:16,985][123091] Updated weights for policy 0, policy_version 1631274 (0.0005) [2023-12-26 12:37:17,588][123091] Updated weights for policy 0, policy_version 1631284 (0.0005) [2023-12-26 12:37:17,634][123090] Updated weights for policy 1, policy_version 1620552 (0.0010) [2023-12-26 12:37:17,635][123091] Updated weights for policy 0, policy_version 1631294 (0.0008) [2023-12-26 12:37:17,684][123091] Updated weights for policy 0, policy_version 1631304 (0.0008) [2023-12-26 12:37:17,687][123090] Updated weights for policy 1, policy_version 1620562 (0.0007) [2023-12-26 12:37:17,744][123090] Updated weights for policy 1, policy_version 1620572 (0.0009) [2023-12-26 12:37:18,354][123091] Updated weights for policy 0, policy_version 1631314 (0.0006) [2023-12-26 12:37:18,419][123091] Updated weights for policy 0, policy_version 1631324 (0.0007) [2023-12-26 12:37:18,489][123091] Updated weights for policy 0, policy_version 1631334 (0.0006) [2023-12-26 12:37:18,557][123091] Updated weights for policy 0, policy_version 1631344 (0.0009) [2023-12-26 12:37:18,648][123090] Updated weights for policy 1, policy_version 1620582 (0.0010) [2023-12-26 12:37:18,717][123090] Updated weights for policy 1, policy_version 1620592 (0.0009) [2023-12-26 12:37:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 832495616. Throughput: 0: 9010.9, 1: 8670.4. Samples: 832510392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:18,785][121949] Avg episode reward: [(0, '5949.792'), (1, '5625.429')] [2023-12-26 12:37:18,789][123090] Updated weights for policy 1, policy_version 1620602 (0.0010) [2023-12-26 12:37:19,291][123091] Updated weights for policy 0, policy_version 1631354 (0.0010) [2023-12-26 12:37:19,355][123091] Updated weights for policy 0, policy_version 1631364 (0.0007) [2023-12-26 12:37:19,421][123091] Updated weights for policy 0, policy_version 1631374 (0.0009) [2023-12-26 12:37:19,649][123090] Updated weights for policy 1, policy_version 1620612 (0.0010) [2023-12-26 12:37:19,708][123090] Updated weights for policy 1, policy_version 1620622 (0.0009) [2023-12-26 12:37:19,776][123090] Updated weights for policy 1, policy_version 1620632 (0.0009) [2023-12-26 12:37:20,240][123091] Updated weights for policy 0, policy_version 1631384 (0.0007) [2023-12-26 12:37:20,304][123091] Updated weights for policy 0, policy_version 1631394 (0.0005) [2023-12-26 12:37:20,364][123091] Updated weights for policy 0, policy_version 1631404 (0.0007) [2023-12-26 12:37:20,666][123090] Updated weights for policy 1, policy_version 1620642 (0.0009) [2023-12-26 12:37:20,726][123090] Updated weights for policy 1, policy_version 1620652 (0.0009) [2023-12-26 12:37:20,787][123090] Updated weights for policy 1, policy_version 1620662 (0.0009) [2023-12-26 12:37:20,842][123090] Updated weights for policy 1, policy_version 1620672 (0.0009) [2023-12-26 12:37:21,169][123091] Updated weights for policy 0, policy_version 1631414 (0.0008) [2023-12-26 12:37:21,226][123091] Updated weights for policy 0, policy_version 1631424 (0.0009) [2023-12-26 12:37:21,292][123091] Updated weights for policy 0, policy_version 1631434 (0.0009) [2023-12-26 12:37:21,714][123090] Updated weights for policy 1, policy_version 1620682 (0.0011) [2023-12-26 12:37:21,783][123090] Updated weights for policy 1, policy_version 1620692 (0.0010) [2023-12-26 12:37:21,840][123090] Updated weights for policy 1, policy_version 1620702 (0.0010) [2023-12-26 12:37:22,132][123091] Updated weights for policy 0, policy_version 1631444 (0.0008) [2023-12-26 12:37:22,201][123091] Updated weights for policy 0, policy_version 1631454 (0.0006) [2023-12-26 12:37:22,270][123091] Updated weights for policy 0, policy_version 1631464 (0.0006) [2023-12-26 12:37:22,661][123090] Updated weights for policy 1, policy_version 1620712 (0.0009) [2023-12-26 12:37:22,736][123090] Updated weights for policy 1, policy_version 1620722 (0.0006) [2023-12-26 12:37:22,786][123090] Updated weights for policy 1, policy_version 1620732 (0.0005) [2023-12-26 12:37:23,010][123091] Updated weights for policy 0, policy_version 1631474 (0.0008) [2023-12-26 12:37:23,079][123091] Updated weights for policy 0, policy_version 1631484 (0.0006) [2023-12-26 12:37:23,137][123091] Updated weights for policy 0, policy_version 1631494 (0.0006) [2023-12-26 12:37:23,188][123091] Updated weights for policy 0, policy_version 1631504 (0.0006) [2023-12-26 12:37:23,508][123090] Updated weights for policy 1, policy_version 1620742 (0.0007) [2023-12-26 12:37:23,580][123090] Updated weights for policy 1, policy_version 1620752 (0.0010) [2023-12-26 12:37:23,649][123090] Updated weights for policy 1, policy_version 1620762 (0.0008) [2023-12-26 12:37:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 832585728. Throughput: 0: 9047.0, 1: 8541.9. Samples: 832560384. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:23,785][121949] Avg episode reward: [(0, '5980.279'), (1, '5780.479')] [2023-12-26 12:37:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001631504_417669120.pth... [2023-12-26 12:37:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001620768_414916608.pth... [2023-12-26 12:37:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001630480_417406976.pth [2023-12-26 12:37:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001619776_414662656.pth [2023-12-26 12:37:23,885][123091] Updated weights for policy 0, policy_version 1631514 (0.0009) [2023-12-26 12:37:23,946][123091] Updated weights for policy 0, policy_version 1631524 (0.0009) [2023-12-26 12:37:24,005][123091] Updated weights for policy 0, policy_version 1631534 (0.0009) [2023-12-26 12:37:24,313][123090] Updated weights for policy 1, policy_version 1620772 (0.0007) [2023-12-26 12:37:24,375][123090] Updated weights for policy 1, policy_version 1620782 (0.0009) [2023-12-26 12:37:24,436][123090] Updated weights for policy 1, policy_version 1620792 (0.0007) [2023-12-26 12:37:24,875][123091] Updated weights for policy 0, policy_version 1631544 (0.0010) [2023-12-26 12:37:24,923][123091] Updated weights for policy 0, policy_version 1631554 (0.0009) [2023-12-26 12:37:24,981][123091] Updated weights for policy 0, policy_version 1631564 (0.0009) [2023-12-26 12:37:25,171][123090] Updated weights for policy 1, policy_version 1620802 (0.0005) [2023-12-26 12:37:25,230][123090] Updated weights for policy 1, policy_version 1620812 (0.0006) [2023-12-26 12:37:25,295][123090] Updated weights for policy 1, policy_version 1620822 (0.0010) [2023-12-26 12:37:25,349][123090] Updated weights for policy 1, policy_version 1620832 (0.0008) [2023-12-26 12:37:25,620][123091] Updated weights for policy 0, policy_version 1631574 (0.0010) [2023-12-26 12:37:25,670][123091] Updated weights for policy 0, policy_version 1631584 (0.0010) [2023-12-26 12:37:25,735][123091] Updated weights for policy 0, policy_version 1631594 (0.0011) [2023-12-26 12:37:26,158][123090] Updated weights for policy 1, policy_version 1620842 (0.0009) [2023-12-26 12:37:26,213][123090] Updated weights for policy 1, policy_version 1620852 (0.0010) [2023-12-26 12:37:26,270][123090] Updated weights for policy 1, policy_version 1620862 (0.0008) [2023-12-26 12:37:26,399][123091] Updated weights for policy 0, policy_version 1631604 (0.0010) [2023-12-26 12:37:26,468][123091] Updated weights for policy 0, policy_version 1631614 (0.0005) [2023-12-26 12:37:26,534][123091] Updated weights for policy 0, policy_version 1631624 (0.0005) [2023-12-26 12:37:26,961][123090] Updated weights for policy 1, policy_version 1620872 (0.0006) [2023-12-26 12:37:27,009][123090] Updated weights for policy 1, policy_version 1620882 (0.0005) [2023-12-26 12:37:27,061][123090] Updated weights for policy 1, policy_version 1620892 (0.0005) [2023-12-26 12:37:27,184][123091] Updated weights for policy 0, policy_version 1631634 (0.0006) [2023-12-26 12:37:27,240][123091] Updated weights for policy 0, policy_version 1631644 (0.0009) [2023-12-26 12:37:27,300][123091] Updated weights for policy 0, policy_version 1631654 (0.0009) [2023-12-26 12:37:27,358][123091] Updated weights for policy 0, policy_version 1631664 (0.0008) [2023-12-26 12:37:27,779][123090] Updated weights for policy 1, policy_version 1620902 (0.0005) [2023-12-26 12:37:27,839][123090] Updated weights for policy 1, policy_version 1620912 (0.0006) [2023-12-26 12:37:27,897][123090] Updated weights for policy 1, policy_version 1620922 (0.0005) [2023-12-26 12:37:28,102][123091] Updated weights for policy 0, policy_version 1631675 (0.0010) [2023-12-26 12:37:28,157][123091] Updated weights for policy 0, policy_version 1631685 (0.0009) [2023-12-26 12:37:28,210][123091] Updated weights for policy 0, policy_version 1631695 (0.0009) [2023-12-26 12:37:28,527][123090] Updated weights for policy 1, policy_version 1620932 (0.0005) [2023-12-26 12:37:28,595][123090] Updated weights for policy 1, policy_version 1620942 (0.0006) [2023-12-26 12:37:28,667][123090] Updated weights for policy 1, policy_version 1620952 (0.0005) [2023-12-26 12:37:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 832684032. Throughput: 0: 9105.5, 1: 8640.3. Samples: 832675184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:28,785][121949] Avg episode reward: [(0, '6158.348'), (1, '5651.991')] [2023-12-26 12:37:29,157][123091] Updated weights for policy 0, policy_version 1631705 (0.0009) [2023-12-26 12:37:29,236][123091] Updated weights for policy 0, policy_version 1631715 (0.0009) [2023-12-26 12:37:29,289][123091] Updated weights for policy 0, policy_version 1631725 (0.0010) [2023-12-26 12:37:29,348][123090] Updated weights for policy 1, policy_version 1620962 (0.0006) [2023-12-26 12:37:29,411][123090] Updated weights for policy 1, policy_version 1620972 (0.0009) [2023-12-26 12:37:29,470][123090] Updated weights for policy 1, policy_version 1620982 (0.0009) [2023-12-26 12:37:29,528][123090] Updated weights for policy 1, policy_version 1620992 (0.0010) [2023-12-26 12:37:30,036][123091] Updated weights for policy 0, policy_version 1631735 (0.0007) [2023-12-26 12:37:30,104][123091] Updated weights for policy 0, policy_version 1631745 (0.0007) [2023-12-26 12:37:30,172][123091] Updated weights for policy 0, policy_version 1631755 (0.0008) [2023-12-26 12:37:30,420][123090] Updated weights for policy 1, policy_version 1621002 (0.0010) [2023-12-26 12:37:30,482][123090] Updated weights for policy 1, policy_version 1621012 (0.0009) [2023-12-26 12:37:30,531][123090] Updated weights for policy 1, policy_version 1621022 (0.0009) [2023-12-26 12:37:30,919][123091] Updated weights for policy 0, policy_version 1631765 (0.0005) [2023-12-26 12:37:30,990][123091] Updated weights for policy 0, policy_version 1631775 (0.0005) [2023-12-26 12:37:31,057][123091] Updated weights for policy 0, policy_version 1631785 (0.0009) [2023-12-26 12:37:31,395][123090] Updated weights for policy 1, policy_version 1621033 (0.0011) [2023-12-26 12:37:31,459][123090] Updated weights for policy 1, policy_version 1621043 (0.0009) [2023-12-26 12:37:31,526][123090] Updated weights for policy 1, policy_version 1621053 (0.0009) [2023-12-26 12:37:31,745][123091] Updated weights for policy 0, policy_version 1631795 (0.0011) [2023-12-26 12:37:31,811][123091] Updated weights for policy 0, policy_version 1631805 (0.0009) [2023-12-26 12:37:31,865][123091] Updated weights for policy 0, policy_version 1631815 (0.0009) [2023-12-26 12:37:32,354][123090] Updated weights for policy 1, policy_version 1621063 (0.0007) [2023-12-26 12:37:32,422][123090] Updated weights for policy 1, policy_version 1621073 (0.0008) [2023-12-26 12:37:32,482][123090] Updated weights for policy 1, policy_version 1621083 (0.0005) [2023-12-26 12:37:32,674][123091] Updated weights for policy 0, policy_version 1631825 (0.0009) [2023-12-26 12:37:32,741][123091] Updated weights for policy 0, policy_version 1631835 (0.0010) [2023-12-26 12:37:32,796][123091] Updated weights for policy 0, policy_version 1631845 (0.0010) [2023-12-26 12:37:32,851][123091] Updated weights for policy 0, policy_version 1631855 (0.0010) [2023-12-26 12:37:33,208][123090] Updated weights for policy 1, policy_version 1621093 (0.0008) [2023-12-26 12:37:33,262][123090] Updated weights for policy 1, policy_version 1621103 (0.0009) [2023-12-26 12:37:33,316][123090] Updated weights for policy 1, policy_version 1621113 (0.0009) [2023-12-26 12:37:33,616][123091] Updated weights for policy 0, policy_version 1631865 (0.0010) [2023-12-26 12:37:33,672][123091] Updated weights for policy 0, policy_version 1631875 (0.0007) [2023-12-26 12:37:33,730][123091] Updated weights for policy 0, policy_version 1631885 (0.0005) [2023-12-26 12:37:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 832774144. Throughput: 0: 9077.0, 1: 8719.2. Samples: 832782488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:33,785][121949] Avg episode reward: [(0, '6070.395'), (1, '5669.989')] [2023-12-26 12:37:34,211][123090] Updated weights for policy 1, policy_version 1621123 (0.0010) [2023-12-26 12:37:34,290][123090] Updated weights for policy 1, policy_version 1621133 (0.0011) [2023-12-26 12:37:34,361][123090] Updated weights for policy 1, policy_version 1621143 (0.0011) [2023-12-26 12:37:34,380][123091] Updated weights for policy 0, policy_version 1631895 (0.0006) [2023-12-26 12:37:34,444][123091] Updated weights for policy 0, policy_version 1631905 (0.0005) [2023-12-26 12:37:34,507][123091] Updated weights for policy 0, policy_version 1631915 (0.0007) [2023-12-26 12:37:35,085][123090] Updated weights for policy 1, policy_version 1621153 (0.0010) [2023-12-26 12:37:35,158][123090] Updated weights for policy 1, policy_version 1621163 (0.0005) [2023-12-26 12:37:35,159][123091] Updated weights for policy 0, policy_version 1631925 (0.0007) [2023-12-26 12:37:35,221][123090] Updated weights for policy 1, policy_version 1621173 (0.0005) [2023-12-26 12:37:35,224][123091] Updated weights for policy 0, policy_version 1631935 (0.0006) [2023-12-26 12:37:35,286][123091] Updated weights for policy 0, policy_version 1631945 (0.0005) [2023-12-26 12:37:35,291][123090] Updated weights for policy 1, policy_version 1621183 (0.0006) [2023-12-26 12:37:35,913][123090] Updated weights for policy 1, policy_version 1621193 (0.0005) [2023-12-26 12:37:35,968][123091] Updated weights for policy 0, policy_version 1631955 (0.0006) [2023-12-26 12:37:35,980][123090] Updated weights for policy 1, policy_version 1621203 (0.0005) [2023-12-26 12:37:36,024][123091] Updated weights for policy 0, policy_version 1631965 (0.0006) [2023-12-26 12:37:36,033][123090] Updated weights for policy 1, policy_version 1621213 (0.0007) [2023-12-26 12:37:36,092][123091] Updated weights for policy 0, policy_version 1631975 (0.0007) [2023-12-26 12:37:36,809][123090] Updated weights for policy 1, policy_version 1621223 (0.0011) [2023-12-26 12:37:36,877][123090] Updated weights for policy 1, policy_version 1621233 (0.0011) [2023-12-26 12:37:36,929][123091] Updated weights for policy 0, policy_version 1631985 (0.0010) [2023-12-26 12:37:36,938][123090] Updated weights for policy 1, policy_version 1621243 (0.0007) [2023-12-26 12:37:36,993][123091] Updated weights for policy 0, policy_version 1631995 (0.0009) [2023-12-26 12:37:37,048][123091] Updated weights for policy 0, policy_version 1632005 (0.0010) [2023-12-26 12:37:37,107][123091] Updated weights for policy 0, policy_version 1632015 (0.0011) [2023-12-26 12:37:37,549][123090] Updated weights for policy 1, policy_version 1621253 (0.0005) [2023-12-26 12:37:37,622][123090] Updated weights for policy 1, policy_version 1621263 (0.0005) [2023-12-26 12:37:37,690][123090] Updated weights for policy 1, policy_version 1621273 (0.0005) [2023-12-26 12:37:37,973][123091] Updated weights for policy 0, policy_version 1632025 (0.0009) [2023-12-26 12:37:38,030][123091] Updated weights for policy 0, policy_version 1632035 (0.0009) [2023-12-26 12:37:38,081][123091] Updated weights for policy 0, policy_version 1632045 (0.0009) [2023-12-26 12:37:38,435][123090] Updated weights for policy 1, policy_version 1621283 (0.0007) [2023-12-26 12:37:38,502][123090] Updated weights for policy 1, policy_version 1621293 (0.0011) [2023-12-26 12:37:38,559][123090] Updated weights for policy 1, policy_version 1621303 (0.0010) [2023-12-26 12:37:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 832864256. Throughput: 0: 9118.8, 1: 8743.3. Samples: 832839752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:38,785][121949] Avg episode reward: [(0, '6054.044'), (1, '5705.740')] [2023-12-26 12:37:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001632048_417808384.pth... [2023-12-26 12:37:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001621312_415055872.pth... [2023-12-26 12:37:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001630992_417538048.pth [2023-12-26 12:37:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001620256_414785536.pth [2023-12-26 12:37:38,899][123091] Updated weights for policy 0, policy_version 1632055 (0.0006) [2023-12-26 12:37:38,963][123091] Updated weights for policy 0, policy_version 1632065 (0.0006) [2023-12-26 12:37:39,028][123091] Updated weights for policy 0, policy_version 1632075 (0.0005) [2023-12-26 12:37:39,299][123090] Updated weights for policy 1, policy_version 1621313 (0.0009) [2023-12-26 12:37:39,380][123090] Updated weights for policy 1, policy_version 1621323 (0.0009) [2023-12-26 12:37:39,451][123090] Updated weights for policy 1, policy_version 1621333 (0.0008) [2023-12-26 12:37:39,518][123090] Updated weights for policy 1, policy_version 1621343 (0.0007) [2023-12-26 12:37:39,717][123091] Updated weights for policy 0, policy_version 1632085 (0.0007) [2023-12-26 12:37:39,768][123091] Updated weights for policy 0, policy_version 1632095 (0.0009) [2023-12-26 12:37:39,828][123091] Updated weights for policy 0, policy_version 1632106 (0.0009) [2023-12-26 12:37:40,273][123090] Updated weights for policy 1, policy_version 1621353 (0.0009) [2023-12-26 12:37:40,331][123090] Updated weights for policy 1, policy_version 1621363 (0.0010) [2023-12-26 12:37:40,402][123090] Updated weights for policy 1, policy_version 1621373 (0.0010) [2023-12-26 12:37:40,723][123091] Updated weights for policy 0, policy_version 1632116 (0.0010) [2023-12-26 12:37:40,787][123091] Updated weights for policy 0, policy_version 1632126 (0.0009) [2023-12-26 12:37:40,852][123091] Updated weights for policy 0, policy_version 1632136 (0.0008) [2023-12-26 12:37:41,260][123090] Updated weights for policy 1, policy_version 1621383 (0.0010) [2023-12-26 12:37:41,326][123090] Updated weights for policy 1, policy_version 1621393 (0.0011) [2023-12-26 12:37:41,398][123090] Updated weights for policy 1, policy_version 1621403 (0.0009) [2023-12-26 12:37:41,756][123091] Updated weights for policy 0, policy_version 1632146 (0.0009) [2023-12-26 12:37:41,825][123091] Updated weights for policy 0, policy_version 1632156 (0.0009) [2023-12-26 12:37:41,889][123091] Updated weights for policy 0, policy_version 1632166 (0.0009) [2023-12-26 12:37:41,958][123091] Updated weights for policy 0, policy_version 1632176 (0.0009) [2023-12-26 12:37:42,238][123090] Updated weights for policy 1, policy_version 1621413 (0.0008) [2023-12-26 12:37:42,309][123090] Updated weights for policy 1, policy_version 1621423 (0.0007) [2023-12-26 12:37:42,374][123090] Updated weights for policy 1, policy_version 1621433 (0.0011) [2023-12-26 12:37:42,802][123091] Updated weights for policy 0, policy_version 1632186 (0.0010) [2023-12-26 12:37:42,857][123091] Updated weights for policy 0, policy_version 1632196 (0.0010) [2023-12-26 12:37:42,911][123091] Updated weights for policy 0, policy_version 1632208 (0.0010) [2023-12-26 12:37:43,073][123090] Updated weights for policy 1, policy_version 1621443 (0.0009) [2023-12-26 12:37:43,129][123090] Updated weights for policy 1, policy_version 1621453 (0.0005) [2023-12-26 12:37:43,178][123090] Updated weights for policy 1, policy_version 1621463 (0.0006) [2023-12-26 12:37:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 832946176. Throughput: 0: 9047.5, 1: 8767.9. Samples: 832944288. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:43,785][121949] Avg episode reward: [(0, '6214.410'), (1, '5626.561')] [2023-12-26 12:37:43,845][123090] Updated weights for policy 1, policy_version 1621473 (0.0006) [2023-12-26 12:37:43,884][123091] Updated weights for policy 0, policy_version 1632218 (0.0009) [2023-12-26 12:37:43,910][123090] Updated weights for policy 1, policy_version 1621483 (0.0005) [2023-12-26 12:37:43,940][123091] Updated weights for policy 0, policy_version 1632228 (0.0009) [2023-12-26 12:37:43,970][123090] Updated weights for policy 1, policy_version 1621493 (0.0005) [2023-12-26 12:37:43,989][123091] Updated weights for policy 0, policy_version 1632238 (0.0009) [2023-12-26 12:37:44,025][123090] Updated weights for policy 1, policy_version 1621503 (0.0005) [2023-12-26 12:37:44,712][123090] Updated weights for policy 1, policy_version 1621513 (0.0005) [2023-12-26 12:37:44,779][123090] Updated weights for policy 1, policy_version 1621523 (0.0008) [2023-12-26 12:37:44,852][123090] Updated weights for policy 1, policy_version 1621533 (0.0008) [2023-12-26 12:37:44,887][123091] Updated weights for policy 0, policy_version 1632248 (0.0010) [2023-12-26 12:37:44,955][123091] Updated weights for policy 0, policy_version 1632258 (0.0010) [2023-12-26 12:37:45,019][123091] Updated weights for policy 0, policy_version 1632268 (0.0009) [2023-12-26 12:37:45,576][123090] Updated weights for policy 1, policy_version 1621543 (0.0009) [2023-12-26 12:37:45,633][123090] Updated weights for policy 1, policy_version 1621553 (0.0010) [2023-12-26 12:37:45,701][123090] Updated weights for policy 1, policy_version 1621563 (0.0010) [2023-12-26 12:37:45,830][123091] Updated weights for policy 0, policy_version 1632278 (0.0007) [2023-12-26 12:37:45,879][123091] Updated weights for policy 0, policy_version 1632288 (0.0005) [2023-12-26 12:37:45,930][123091] Updated weights for policy 0, policy_version 1632298 (0.0005) [2023-12-26 12:37:46,510][123090] Updated weights for policy 1, policy_version 1621573 (0.0007) [2023-12-26 12:37:46,543][123091] Updated weights for policy 0, policy_version 1632308 (0.0005) [2023-12-26 12:37:46,578][123090] Updated weights for policy 1, policy_version 1621583 (0.0006) [2023-12-26 12:37:46,610][123091] Updated weights for policy 0, policy_version 1632318 (0.0005) [2023-12-26 12:37:46,637][123090] Updated weights for policy 1, policy_version 1621593 (0.0008) [2023-12-26 12:37:46,678][123091] Updated weights for policy 0, policy_version 1632328 (0.0006) [2023-12-26 12:37:47,345][123091] Updated weights for policy 0, policy_version 1632338 (0.0009) [2023-12-26 12:37:47,413][123091] Updated weights for policy 0, policy_version 1632348 (0.0008) [2023-12-26 12:37:47,469][123091] Updated weights for policy 0, policy_version 1632358 (0.0009) [2023-12-26 12:37:47,473][123090] Updated weights for policy 1, policy_version 1621603 (0.0008) [2023-12-26 12:37:47,522][123091] Updated weights for policy 0, policy_version 1632368 (0.0007) [2023-12-26 12:37:47,534][123090] Updated weights for policy 1, policy_version 1621613 (0.0009) [2023-12-26 12:37:47,594][123090] Updated weights for policy 1, policy_version 1621623 (0.0010) [2023-12-26 12:37:48,254][123091] Updated weights for policy 0, policy_version 1632378 (0.0009) [2023-12-26 12:37:48,309][123091] Updated weights for policy 0, policy_version 1632388 (0.0010) [2023-12-26 12:37:48,374][123091] Updated weights for policy 0, policy_version 1632398 (0.0011) [2023-12-26 12:37:48,462][123090] Updated weights for policy 1, policy_version 1621633 (0.0010) [2023-12-26 12:37:48,518][123090] Updated weights for policy 1, policy_version 1621643 (0.0009) [2023-12-26 12:37:48,583][123090] Updated weights for policy 1, policy_version 1621653 (0.0009) [2023-12-26 12:37:48,663][123090] Updated weights for policy 1, policy_version 1621663 (0.0009) [2023-12-26 12:37:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 833044480. Throughput: 0: 9050.1, 1: 8839.1. Samples: 833052048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:48,785][121949] Avg episode reward: [(0, '6256.779'), (1, '5667.714')] [2023-12-26 12:37:49,130][123091] Updated weights for policy 0, policy_version 1632408 (0.0006) [2023-12-26 12:37:49,200][123091] Updated weights for policy 0, policy_version 1632418 (0.0007) [2023-12-26 12:37:49,266][123091] Updated weights for policy 0, policy_version 1632428 (0.0009) [2023-12-26 12:37:49,516][123090] Updated weights for policy 1, policy_version 1621673 (0.0009) [2023-12-26 12:37:49,564][123090] Updated weights for policy 1, policy_version 1621683 (0.0008) [2023-12-26 12:37:49,616][123090] Updated weights for policy 1, policy_version 1621693 (0.0009) [2023-12-26 12:37:50,067][123091] Updated weights for policy 0, policy_version 1632438 (0.0009) [2023-12-26 12:37:50,123][123091] Updated weights for policy 0, policy_version 1632448 (0.0009) [2023-12-26 12:37:50,187][123091] Updated weights for policy 0, policy_version 1632458 (0.0011) [2023-12-26 12:37:50,530][123090] Updated weights for policy 1, policy_version 1621703 (0.0009) [2023-12-26 12:37:50,596][123090] Updated weights for policy 1, policy_version 1621714 (0.0010) [2023-12-26 12:37:50,657][123090] Updated weights for policy 1, policy_version 1621724 (0.0009) [2023-12-26 12:37:51,008][123091] Updated weights for policy 0, policy_version 1632468 (0.0009) [2023-12-26 12:37:51,075][123091] Updated weights for policy 0, policy_version 1632478 (0.0008) [2023-12-26 12:37:51,143][123091] Updated weights for policy 0, policy_version 1632488 (0.0008) [2023-12-26 12:37:51,547][123090] Updated weights for policy 1, policy_version 1621734 (0.0009) [2023-12-26 12:37:51,615][123090] Updated weights for policy 1, policy_version 1621744 (0.0011) [2023-12-26 12:37:51,683][123090] Updated weights for policy 1, policy_version 1621754 (0.0009) [2023-12-26 12:37:51,959][123091] Updated weights for policy 0, policy_version 1632498 (0.0006) [2023-12-26 12:37:52,021][123091] Updated weights for policy 0, policy_version 1632508 (0.0009) [2023-12-26 12:37:52,089][123091] Updated weights for policy 0, policy_version 1632518 (0.0010) [2023-12-26 12:37:52,152][123091] Updated weights for policy 0, policy_version 1632528 (0.0009) [2023-12-26 12:37:52,538][123090] Updated weights for policy 1, policy_version 1621764 (0.0010) [2023-12-26 12:37:52,603][123090] Updated weights for policy 1, policy_version 1621774 (0.0009) [2023-12-26 12:37:52,671][123090] Updated weights for policy 1, policy_version 1621784 (0.0009) [2023-12-26 12:37:52,972][123091] Updated weights for policy 0, policy_version 1632538 (0.0005) [2023-12-26 12:37:53,040][123091] Updated weights for policy 0, policy_version 1632548 (0.0005) [2023-12-26 12:37:53,111][123091] Updated weights for policy 0, policy_version 1632558 (0.0005) [2023-12-26 12:37:53,531][123090] Updated weights for policy 1, policy_version 1621794 (0.0009) [2023-12-26 12:37:53,580][123090] Updated weights for policy 1, policy_version 1621804 (0.0009) [2023-12-26 12:37:53,631][123090] Updated weights for policy 1, policy_version 1621814 (0.0009) [2023-12-26 12:37:53,681][123090] Updated weights for policy 1, policy_version 1621824 (0.0008) [2023-12-26 12:37:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17772.4). Total num frames: 833126400. Throughput: 0: 9082.9, 1: 8817.7. Samples: 833103256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:53,785][121949] Avg episode reward: [(0, '6107.069'), (1, '5889.661')] [2023-12-26 12:37:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001621824_415186944.pth... [2023-12-26 12:37:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001620768_414916608.pth [2023-12-26 12:37:53,850][123091] Updated weights for policy 0, policy_version 1632568 (0.0009) [2023-12-26 12:37:53,915][123091] Updated weights for policy 0, policy_version 1632578 (0.0010) [2023-12-26 12:37:53,988][123091] Updated weights for policy 0, policy_version 1632588 (0.0010) [2023-12-26 12:37:54,012][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001632592_417947648.pth... [2023-12-26 12:37:54,016][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001631504_417669120.pth [2023-12-26 12:37:54,594][123090] Updated weights for policy 1, policy_version 1621834 (0.0009) [2023-12-26 12:37:54,659][123090] Updated weights for policy 1, policy_version 1621844 (0.0008) [2023-12-26 12:37:54,717][123090] Updated weights for policy 1, policy_version 1621854 (0.0009) [2023-12-26 12:37:54,741][123091] Updated weights for policy 0, policy_version 1632598 (0.0008) [2023-12-26 12:37:54,790][123091] Updated weights for policy 0, policy_version 1632608 (0.0009) [2023-12-26 12:37:54,839][123091] Updated weights for policy 0, policy_version 1632618 (0.0009) [2023-12-26 12:37:55,543][123090] Updated weights for policy 1, policy_version 1621864 (0.0009) [2023-12-26 12:37:55,593][123090] Updated weights for policy 1, policy_version 1621874 (0.0009) [2023-12-26 12:37:55,596][123091] Updated weights for policy 0, policy_version 1632628 (0.0008) [2023-12-26 12:37:55,654][123090] Updated weights for policy 1, policy_version 1621884 (0.0009) [2023-12-26 12:37:55,658][123091] Updated weights for policy 0, policy_version 1632638 (0.0009) [2023-12-26 12:37:55,716][123091] Updated weights for policy 0, policy_version 1632648 (0.0009) [2023-12-26 12:37:56,432][123091] Updated weights for policy 0, policy_version 1632658 (0.0005) [2023-12-26 12:37:56,485][123091] Updated weights for policy 0, policy_version 1632668 (0.0005) [2023-12-26 12:37:56,550][123090] Updated weights for policy 1, policy_version 1621894 (0.0009) [2023-12-26 12:37:56,555][123091] Updated weights for policy 0, policy_version 1632678 (0.0005) [2023-12-26 12:37:56,613][123090] Updated weights for policy 1, policy_version 1621904 (0.0009) [2023-12-26 12:37:56,619][123091] Updated weights for policy 0, policy_version 1632688 (0.0006) [2023-12-26 12:37:56,673][123090] Updated weights for policy 1, policy_version 1621915 (0.0010) [2023-12-26 12:37:57,309][123091] Updated weights for policy 0, policy_version 1632698 (0.0006) [2023-12-26 12:37:57,368][123091] Updated weights for policy 0, policy_version 1632708 (0.0005) [2023-12-26 12:37:57,417][123091] Updated weights for policy 0, policy_version 1632718 (0.0005) [2023-12-26 12:37:57,466][123090] Updated weights for policy 1, policy_version 1621925 (0.0010) [2023-12-26 12:37:57,528][123090] Updated weights for policy 1, policy_version 1621936 (0.0010) [2023-12-26 12:37:57,585][123090] Updated weights for policy 1, policy_version 1621946 (0.0009) [2023-12-26 12:37:58,151][123091] Updated weights for policy 0, policy_version 1632728 (0.0009) [2023-12-26 12:37:58,215][123091] Updated weights for policy 0, policy_version 1632738 (0.0009) [2023-12-26 12:37:58,289][123091] Updated weights for policy 0, policy_version 1632748 (0.0009) [2023-12-26 12:37:58,485][123090] Updated weights for policy 1, policy_version 1621956 (0.0010) [2023-12-26 12:37:58,557][123090] Updated weights for policy 1, policy_version 1621966 (0.0010) [2023-12-26 12:37:58,632][123090] Updated weights for policy 1, policy_version 1621976 (0.0009) [2023-12-26 12:37:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 833216512. Throughput: 0: 9134.1, 1: 8768.0. Samples: 833207896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:37:58,785][121949] Avg episode reward: [(0, '6047.846'), (1, '5950.174')] [2023-12-26 12:37:59,170][123091] Updated weights for policy 0, policy_version 1632758 (0.0010) [2023-12-26 12:37:59,238][123091] Updated weights for policy 0, policy_version 1632768 (0.0010) [2023-12-26 12:37:59,302][123091] Updated weights for policy 0, policy_version 1632778 (0.0010) [2023-12-26 12:37:59,489][123090] Updated weights for policy 1, policy_version 1621986 (0.0008) [2023-12-26 12:37:59,546][123090] Updated weights for policy 1, policy_version 1621996 (0.0009) [2023-12-26 12:37:59,606][123090] Updated weights for policy 1, policy_version 1622006 (0.0008) [2023-12-26 12:37:59,670][123090] Updated weights for policy 1, policy_version 1622016 (0.0009) [2023-12-26 12:38:00,142][123091] Updated weights for policy 0, policy_version 1632788 (0.0011) [2023-12-26 12:38:00,208][123091] Updated weights for policy 0, policy_version 1632798 (0.0010) [2023-12-26 12:38:00,271][123091] Updated weights for policy 0, policy_version 1632808 (0.0011) [2023-12-26 12:38:00,523][123090] Updated weights for policy 1, policy_version 1622026 (0.0010) [2023-12-26 12:38:00,581][123090] Updated weights for policy 1, policy_version 1622036 (0.0010) [2023-12-26 12:38:00,635][123090] Updated weights for policy 1, policy_version 1622047 (0.0010) [2023-12-26 12:38:01,035][123091] Updated weights for policy 0, policy_version 1632818 (0.0011) [2023-12-26 12:38:01,100][123091] Updated weights for policy 0, policy_version 1632828 (0.0008) [2023-12-26 12:38:01,166][123091] Updated weights for policy 0, policy_version 1632838 (0.0007) [2023-12-26 12:38:01,225][123091] Updated weights for policy 0, policy_version 1632848 (0.0007) [2023-12-26 12:38:01,520][123090] Updated weights for policy 1, policy_version 1622057 (0.0008) [2023-12-26 12:38:01,587][123090] Updated weights for policy 1, policy_version 1622067 (0.0005) [2023-12-26 12:38:01,656][123090] Updated weights for policy 1, policy_version 1622077 (0.0008) [2023-12-26 12:38:01,966][123091] Updated weights for policy 0, policy_version 1632858 (0.0009) [2023-12-26 12:38:02,035][123091] Updated weights for policy 0, policy_version 1632868 (0.0005) [2023-12-26 12:38:02,107][123091] Updated weights for policy 0, policy_version 1632878 (0.0005) [2023-12-26 12:38:02,424][123090] Updated weights for policy 1, policy_version 1622087 (0.0008) [2023-12-26 12:38:02,484][123090] Updated weights for policy 1, policy_version 1622097 (0.0005) [2023-12-26 12:38:02,540][123090] Updated weights for policy 1, policy_version 1622107 (0.0005) [2023-12-26 12:38:02,814][123091] Updated weights for policy 0, policy_version 1632888 (0.0009) [2023-12-26 12:38:02,865][123091] Updated weights for policy 0, policy_version 1632898 (0.0010) [2023-12-26 12:38:02,913][123091] Updated weights for policy 0, policy_version 1632908 (0.0010) [2023-12-26 12:38:03,307][123090] Updated weights for policy 1, policy_version 1622117 (0.0008) [2023-12-26 12:38:03,361][123090] Updated weights for policy 1, policy_version 1622127 (0.0010) [2023-12-26 12:38:03,407][123090] Updated weights for policy 1, policy_version 1622137 (0.0009) [2023-12-26 12:38:03,750][123091] Updated weights for policy 0, policy_version 1632918 (0.0010) [2023-12-26 12:38:03,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 833298432. Throughput: 0: 9021.9, 1: 8794.1. Samples: 833312108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:38:03,785][121949] Avg episode reward: [(0, '6016.513'), (1, '6001.145')] [2023-12-26 12:38:03,809][123091] Updated weights for policy 0, policy_version 1632928 (0.0010) [2023-12-26 12:38:03,880][123091] Updated weights for policy 0, policy_version 1632938 (0.0011) [2023-12-26 12:38:04,131][123090] Updated weights for policy 1, policy_version 1622147 (0.0005) [2023-12-26 12:38:04,202][123090] Updated weights for policy 1, policy_version 1622157 (0.0007) [2023-12-26 12:38:04,265][123090] Updated weights for policy 1, policy_version 1622167 (0.0010) [2023-12-26 12:38:04,708][123091] Updated weights for policy 0, policy_version 1632948 (0.0008) [2023-12-26 12:38:04,758][123091] Updated weights for policy 0, policy_version 1632958 (0.0005) [2023-12-26 12:38:04,814][123091] Updated weights for policy 0, policy_version 1632968 (0.0005) [2023-12-26 12:38:05,064][123090] Updated weights for policy 1, policy_version 1622177 (0.0011) [2023-12-26 12:38:05,124][123090] Updated weights for policy 1, policy_version 1622187 (0.0010) [2023-12-26 12:38:05,180][123090] Updated weights for policy 1, policy_version 1622197 (0.0010) [2023-12-26 12:38:05,243][123090] Updated weights for policy 1, policy_version 1622207 (0.0010) [2023-12-26 12:38:05,510][123091] Updated weights for policy 0, policy_version 1632978 (0.0005) [2023-12-26 12:38:05,573][123091] Updated weights for policy 0, policy_version 1632988 (0.0005) [2023-12-26 12:38:05,636][123091] Updated weights for policy 0, policy_version 1632998 (0.0010) [2023-12-26 12:38:05,694][123091] Updated weights for policy 0, policy_version 1633008 (0.0010) [2023-12-26 12:38:06,023][123090] Updated weights for policy 1, policy_version 1622217 (0.0009) [2023-12-26 12:38:06,079][123090] Updated weights for policy 1, policy_version 1622227 (0.0009) [2023-12-26 12:38:06,148][123090] Updated weights for policy 1, policy_version 1622237 (0.0009) [2023-12-26 12:38:06,461][123091] Updated weights for policy 0, policy_version 1633018 (0.0005) [2023-12-26 12:38:06,522][123091] Updated weights for policy 0, policy_version 1633028 (0.0006) [2023-12-26 12:38:06,593][123091] Updated weights for policy 0, policy_version 1633038 (0.0011) [2023-12-26 12:38:07,026][123090] Updated weights for policy 1, policy_version 1622247 (0.0010) [2023-12-26 12:38:07,079][123090] Updated weights for policy 1, policy_version 1622257 (0.0010) [2023-12-26 12:38:07,131][123090] Updated weights for policy 1, policy_version 1622267 (0.0010) [2023-12-26 12:38:07,293][123091] Updated weights for policy 0, policy_version 1633048 (0.0007) [2023-12-26 12:38:07,363][123091] Updated weights for policy 0, policy_version 1633058 (0.0006) [2023-12-26 12:38:07,427][123091] Updated weights for policy 0, policy_version 1633068 (0.0007) [2023-12-26 12:38:07,884][123090] Updated weights for policy 1, policy_version 1622277 (0.0008) [2023-12-26 12:38:07,947][123090] Updated weights for policy 1, policy_version 1622287 (0.0005) [2023-12-26 12:38:08,011][123090] Updated weights for policy 1, policy_version 1622297 (0.0005) [2023-12-26 12:38:08,074][123091] Updated weights for policy 0, policy_version 1633078 (0.0009) [2023-12-26 12:38:08,139][123091] Updated weights for policy 0, policy_version 1633088 (0.0010) [2023-12-26 12:38:08,204][123091] Updated weights for policy 0, policy_version 1633098 (0.0010) [2023-12-26 12:38:08,708][123090] Updated weights for policy 1, policy_version 1622307 (0.0006) [2023-12-26 12:38:08,780][123090] Updated weights for policy 1, policy_version 1622317 (0.0005) [2023-12-26 12:38:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 833388544. Throughput: 0: 9065.3, 1: 8848.5. Samples: 833366500. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:08,785][121949] Avg episode reward: [(0, '5882.757'), (1, '5891.174')] [2023-12-26 12:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001633104_418078720.pth... [2023-12-26 12:38:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001632048_417808384.pth [2023-12-26 12:38:08,837][123090] Updated weights for policy 1, policy_version 1622327 (0.0006) [2023-12-26 12:38:08,881][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001622336_415318016.pth... [2023-12-26 12:38:08,885][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001621312_415055872.pth [2023-12-26 12:38:08,933][123091] Updated weights for policy 0, policy_version 1633108 (0.0005) [2023-12-26 12:38:08,998][123091] Updated weights for policy 0, policy_version 1633118 (0.0007) [2023-12-26 12:38:09,065][123091] Updated weights for policy 0, policy_version 1633128 (0.0007) [2023-12-26 12:38:09,542][123090] Updated weights for policy 1, policy_version 1622337 (0.0006) [2023-12-26 12:38:09,610][123090] Updated weights for policy 1, policy_version 1622347 (0.0006) [2023-12-26 12:38:09,679][123090] Updated weights for policy 1, policy_version 1622357 (0.0005) [2023-12-26 12:38:09,738][123090] Updated weights for policy 1, policy_version 1622367 (0.0006) [2023-12-26 12:38:09,814][123091] Updated weights for policy 0, policy_version 1633138 (0.0007) [2023-12-26 12:38:09,881][123091] Updated weights for policy 0, policy_version 1633148 (0.0010) [2023-12-26 12:38:09,955][123091] Updated weights for policy 0, policy_version 1633158 (0.0009) [2023-12-26 12:38:10,018][123091] Updated weights for policy 0, policy_version 1633168 (0.0010) [2023-12-26 12:38:10,521][123090] Updated weights for policy 1, policy_version 1622377 (0.0008) [2023-12-26 12:38:10,570][123090] Updated weights for policy 1, policy_version 1622387 (0.0009) [2023-12-26 12:38:10,626][123090] Updated weights for policy 1, policy_version 1622397 (0.0009) [2023-12-26 12:38:10,825][123091] Updated weights for policy 0, policy_version 1633178 (0.0011) [2023-12-26 12:38:10,889][123091] Updated weights for policy 0, policy_version 1633188 (0.0011) [2023-12-26 12:38:10,957][123091] Updated weights for policy 0, policy_version 1633198 (0.0008) [2023-12-26 12:38:11,500][123090] Updated weights for policy 1, policy_version 1622407 (0.0009) [2023-12-26 12:38:11,558][123090] Updated weights for policy 1, policy_version 1622417 (0.0009) [2023-12-26 12:38:11,628][123090] Updated weights for policy 1, policy_version 1622427 (0.0010) [2023-12-26 12:38:11,792][123091] Updated weights for policy 0, policy_version 1633208 (0.0008) [2023-12-26 12:38:11,859][123091] Updated weights for policy 0, policy_version 1633218 (0.0010) [2023-12-26 12:38:11,922][123091] Updated weights for policy 0, policy_version 1633228 (0.0010) [2023-12-26 12:38:12,487][123090] Updated weights for policy 1, policy_version 1622437 (0.0009) [2023-12-26 12:38:12,540][123090] Updated weights for policy 1, policy_version 1622447 (0.0009) [2023-12-26 12:38:12,613][123090] Updated weights for policy 1, policy_version 1622457 (0.0009) [2023-12-26 12:38:12,775][123091] Updated weights for policy 0, policy_version 1633238 (0.0010) [2023-12-26 12:38:12,832][123091] Updated weights for policy 0, policy_version 1633248 (0.0009) [2023-12-26 12:38:12,880][123091] Updated weights for policy 0, policy_version 1633258 (0.0009) [2023-12-26 12:38:13,453][123090] Updated weights for policy 1, policy_version 1622467 (0.0009) [2023-12-26 12:38:13,514][123090] Updated weights for policy 1, policy_version 1622477 (0.0010) [2023-12-26 12:38:13,583][123090] Updated weights for policy 1, policy_version 1622487 (0.0009) [2023-12-26 12:38:13,726][123091] Updated weights for policy 0, policy_version 1633268 (0.0009) [2023-12-26 12:38:13,779][123091] Updated weights for policy 0, policy_version 1633278 (0.0009) [2023-12-26 12:38:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 833478656. Throughput: 0: 8963.2, 1: 8771.0. Samples: 833473224. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:13,785][121949] Avg episode reward: [(0, '5876.335'), (1, '5756.856')] [2023-12-26 12:38:13,832][123091] Updated weights for policy 0, policy_version 1633288 (0.0010) [2023-12-26 12:38:14,420][123090] Updated weights for policy 1, policy_version 1622497 (0.0010) [2023-12-26 12:38:14,488][123090] Updated weights for policy 1, policy_version 1622507 (0.0008) [2023-12-26 12:38:14,550][123090] Updated weights for policy 1, policy_version 1622517 (0.0005) [2023-12-26 12:38:14,617][123090] Updated weights for policy 1, policy_version 1622527 (0.0008) [2023-12-26 12:38:14,628][123091] Updated weights for policy 0, policy_version 1633298 (0.0008) [2023-12-26 12:38:14,691][123091] Updated weights for policy 0, policy_version 1633308 (0.0008) [2023-12-26 12:38:14,754][123091] Updated weights for policy 0, policy_version 1633318 (0.0006) [2023-12-26 12:38:14,822][123091] Updated weights for policy 0, policy_version 1633328 (0.0007) [2023-12-26 12:38:15,393][123090] Updated weights for policy 1, policy_version 1622537 (0.0006) [2023-12-26 12:38:15,452][123090] Updated weights for policy 1, policy_version 1622547 (0.0005) [2023-12-26 12:38:15,515][123090] Updated weights for policy 1, policy_version 1622557 (0.0006) [2023-12-26 12:38:15,618][123091] Updated weights for policy 0, policy_version 1633338 (0.0010) [2023-12-26 12:38:15,672][123091] Updated weights for policy 0, policy_version 1633348 (0.0010) [2023-12-26 12:38:15,728][123091] Updated weights for policy 0, policy_version 1633358 (0.0009) [2023-12-26 12:38:16,263][123090] Updated weights for policy 1, policy_version 1622567 (0.0010) [2023-12-26 12:38:16,314][123090] Updated weights for policy 1, policy_version 1622577 (0.0010) [2023-12-26 12:38:16,372][123090] Updated weights for policy 1, policy_version 1622587 (0.0010) [2023-12-26 12:38:16,593][123091] Updated weights for policy 0, policy_version 1633368 (0.0009) [2023-12-26 12:38:16,655][123091] Updated weights for policy 0, policy_version 1633378 (0.0010) [2023-12-26 12:38:16,712][123091] Updated weights for policy 0, policy_version 1633388 (0.0009) [2023-12-26 12:38:17,129][123090] Updated weights for policy 1, policy_version 1622597 (0.0010) [2023-12-26 12:38:17,182][123090] Updated weights for policy 1, policy_version 1622607 (0.0008) [2023-12-26 12:38:17,229][123090] Updated weights for policy 1, policy_version 1622617 (0.0008) [2023-12-26 12:38:17,449][123091] Updated weights for policy 0, policy_version 1633398 (0.0010) [2023-12-26 12:38:17,503][123091] Updated weights for policy 0, policy_version 1633409 (0.0010) [2023-12-26 12:38:17,553][123091] Updated weights for policy 0, policy_version 1633419 (0.0010) [2023-12-26 12:38:18,032][123090] Updated weights for policy 1, policy_version 1622627 (0.0008) [2023-12-26 12:38:18,086][123090] Updated weights for policy 1, policy_version 1622637 (0.0008) [2023-12-26 12:38:18,136][123090] Updated weights for policy 1, policy_version 1622647 (0.0008) [2023-12-26 12:38:18,471][123091] Updated weights for policy 0, policy_version 1633429 (0.0009) [2023-12-26 12:38:18,521][123091] Updated weights for policy 0, policy_version 1633439 (0.0009) [2023-12-26 12:38:18,573][123091] Updated weights for policy 0, policy_version 1633449 (0.0009) [2023-12-26 12:38:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 833568768. Throughput: 0: 8933.2, 1: 8770.2. Samples: 833579140. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:18,785][121949] Avg episode reward: [(0, '6098.282'), (1, '5645.043')] [2023-12-26 12:38:18,879][123090] Updated weights for policy 1, policy_version 1622657 (0.0010) [2023-12-26 12:38:18,949][123090] Updated weights for policy 1, policy_version 1622667 (0.0007) [2023-12-26 12:38:19,023][123090] Updated weights for policy 1, policy_version 1622677 (0.0006) [2023-12-26 12:38:19,096][123090] Updated weights for policy 1, policy_version 1622687 (0.0008) [2023-12-26 12:38:19,507][123091] Updated weights for policy 0, policy_version 1633460 (0.0010) [2023-12-26 12:38:19,565][123091] Updated weights for policy 0, policy_version 1633470 (0.0008) [2023-12-26 12:38:19,619][123091] Updated weights for policy 0, policy_version 1633480 (0.0010) [2023-12-26 12:38:19,836][123090] Updated weights for policy 1, policy_version 1622697 (0.0008) [2023-12-26 12:38:19,902][123090] Updated weights for policy 1, policy_version 1622707 (0.0009) [2023-12-26 12:38:19,978][123090] Updated weights for policy 1, policy_version 1622717 (0.0009) [2023-12-26 12:38:20,485][123091] Updated weights for policy 0, policy_version 1633490 (0.0009) [2023-12-26 12:38:20,557][123091] Updated weights for policy 0, policy_version 1633500 (0.0010) [2023-12-26 12:38:20,629][123091] Updated weights for policy 0, policy_version 1633510 (0.0009) [2023-12-26 12:38:20,686][123091] Updated weights for policy 0, policy_version 1633520 (0.0010) [2023-12-26 12:38:20,821][123090] Updated weights for policy 1, policy_version 1622727 (0.0009) [2023-12-26 12:38:20,873][123090] Updated weights for policy 1, policy_version 1622737 (0.0009) [2023-12-26 12:38:20,929][123090] Updated weights for policy 1, policy_version 1622747 (0.0009) [2023-12-26 12:38:21,502][123091] Updated weights for policy 0, policy_version 1633530 (0.0010) [2023-12-26 12:38:21,556][123091] Updated weights for policy 0, policy_version 1633540 (0.0009) [2023-12-26 12:38:21,619][123091] Updated weights for policy 0, policy_version 1633550 (0.0009) [2023-12-26 12:38:21,845][123090] Updated weights for policy 1, policy_version 1622757 (0.0009) [2023-12-26 12:38:21,901][123090] Updated weights for policy 1, policy_version 1622767 (0.0009) [2023-12-26 12:38:21,964][123090] Updated weights for policy 1, policy_version 1622777 (0.0009) [2023-12-26 12:38:22,475][123091] Updated weights for policy 0, policy_version 1633560 (0.0010) [2023-12-26 12:38:22,527][123091] Updated weights for policy 0, policy_version 1633570 (0.0009) [2023-12-26 12:38:22,588][123091] Updated weights for policy 0, policy_version 1633580 (0.0009) [2023-12-26 12:38:22,805][123090] Updated weights for policy 1, policy_version 1622787 (0.0009) [2023-12-26 12:38:22,870][123090] Updated weights for policy 1, policy_version 1622797 (0.0008) [2023-12-26 12:38:22,936][123090] Updated weights for policy 1, policy_version 1622807 (0.0008) [2023-12-26 12:38:23,499][123091] Updated weights for policy 0, policy_version 1633590 (0.0010) [2023-12-26 12:38:23,554][123090] Updated weights for policy 1, policy_version 1622817 (0.0007) [2023-12-26 12:38:23,557][123091] Updated weights for policy 0, policy_version 1633600 (0.0010) [2023-12-26 12:38:23,604][123090] Updated weights for policy 1, policy_version 1622827 (0.0006) [2023-12-26 12:38:23,616][123091] Updated weights for policy 0, policy_version 1633610 (0.0008) [2023-12-26 12:38:23,657][123090] Updated weights for policy 1, policy_version 1622837 (0.0006) [2023-12-26 12:38:23,711][123090] Updated weights for policy 1, policy_version 1622847 (0.0005) [2023-12-26 12:38:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 833658880. Throughput: 0: 8822.3, 1: 8729.5. Samples: 833629584. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:23,785][121949] Avg episode reward: [(0, '6222.197'), (1, '5636.086')] [2023-12-26 12:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001633616_418209792.pth... [2023-12-26 12:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001622848_415449088.pth... [2023-12-26 12:38:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001621824_415186944.pth [2023-12-26 12:38:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001632592_417947648.pth [2023-12-26 12:38:24,381][123090] Updated weights for policy 1, policy_version 1622857 (0.0006) [2023-12-26 12:38:24,434][123090] Updated weights for policy 1, policy_version 1622867 (0.0005) [2023-12-26 12:38:24,482][123091] Updated weights for policy 0, policy_version 1633620 (0.0009) [2023-12-26 12:38:24,499][123090] Updated weights for policy 1, policy_version 1622877 (0.0006) [2023-12-26 12:38:24,550][123091] Updated weights for policy 0, policy_version 1633630 (0.0009) [2023-12-26 12:38:24,621][123091] Updated weights for policy 0, policy_version 1633640 (0.0009) [2023-12-26 12:38:25,199][123090] Updated weights for policy 1, policy_version 1622887 (0.0009) [2023-12-26 12:38:25,267][123090] Updated weights for policy 1, policy_version 1622897 (0.0006) [2023-12-26 12:38:25,320][123090] Updated weights for policy 1, policy_version 1622907 (0.0005) [2023-12-26 12:38:25,435][123091] Updated weights for policy 0, policy_version 1633650 (0.0009) [2023-12-26 12:38:25,497][123091] Updated weights for policy 0, policy_version 1633660 (0.0005) [2023-12-26 12:38:25,554][123091] Updated weights for policy 0, policy_version 1633670 (0.0005) [2023-12-26 12:38:25,622][123091] Updated weights for policy 0, policy_version 1633680 (0.0005) [2023-12-26 12:38:26,029][123090] Updated weights for policy 1, policy_version 1622917 (0.0005) [2023-12-26 12:38:26,107][123090] Updated weights for policy 1, policy_version 1622927 (0.0007) [2023-12-26 12:38:26,158][123090] Updated weights for policy 1, policy_version 1622937 (0.0011) [2023-12-26 12:38:26,268][123091] Updated weights for policy 0, policy_version 1633690 (0.0009) [2023-12-26 12:38:26,322][123091] Updated weights for policy 0, policy_version 1633700 (0.0009) [2023-12-26 12:38:26,375][123091] Updated weights for policy 0, policy_version 1633710 (0.0009) [2023-12-26 12:38:26,987][123090] Updated weights for policy 1, policy_version 1622947 (0.0010) [2023-12-26 12:38:27,065][123090] Updated weights for policy 1, policy_version 1622957 (0.0009) [2023-12-26 12:38:27,110][123091] Updated weights for policy 0, policy_version 1633720 (0.0008) [2023-12-26 12:38:27,128][123090] Updated weights for policy 1, policy_version 1622967 (0.0009) [2023-12-26 12:38:27,173][123091] Updated weights for policy 0, policy_version 1633730 (0.0009) [2023-12-26 12:38:27,231][123091] Updated weights for policy 0, policy_version 1633740 (0.0009) [2023-12-26 12:38:27,886][123091] Updated weights for policy 0, policy_version 1633750 (0.0007) [2023-12-26 12:38:27,890][123090] Updated weights for policy 1, policy_version 1622977 (0.0005) [2023-12-26 12:38:27,932][123091] Updated weights for policy 0, policy_version 1633760 (0.0006) [2023-12-26 12:38:27,945][123090] Updated weights for policy 1, policy_version 1622987 (0.0005) [2023-12-26 12:38:27,980][123091] Updated weights for policy 0, policy_version 1633770 (0.0006) [2023-12-26 12:38:28,012][123090] Updated weights for policy 1, policy_version 1622997 (0.0005) [2023-12-26 12:38:28,068][123090] Updated weights for policy 1, policy_version 1623007 (0.0005) [2023-12-26 12:38:28,706][123091] Updated weights for policy 0, policy_version 1633780 (0.0008) [2023-12-26 12:38:28,756][123091] Updated weights for policy 0, policy_version 1633790 (0.0009) [2023-12-26 12:38:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 833740800. Throughput: 0: 8897.4, 1: 8778.4. Samples: 833739700. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:28,785][121949] Avg episode reward: [(0, '6104.962'), (1, '5640.301')] [2023-12-26 12:38:28,789][123090] Updated weights for policy 1, policy_version 1623017 (0.0005) [2023-12-26 12:38:28,808][123091] Updated weights for policy 0, policy_version 1633800 (0.0008) [2023-12-26 12:38:28,856][123090] Updated weights for policy 1, policy_version 1623027 (0.0005) [2023-12-26 12:38:28,922][123090] Updated weights for policy 1, policy_version 1623037 (0.0005) [2023-12-26 12:38:29,686][123090] Updated weights for policy 1, policy_version 1623047 (0.0008) [2023-12-26 12:38:29,700][123091] Updated weights for policy 0, policy_version 1633810 (0.0009) [2023-12-26 12:38:29,747][123090] Updated weights for policy 1, policy_version 1623057 (0.0010) [2023-12-26 12:38:29,762][123091] Updated weights for policy 0, policy_version 1633820 (0.0008) [2023-12-26 12:38:29,796][123090] Updated weights for policy 1, policy_version 1623067 (0.0009) [2023-12-26 12:38:29,822][123091] Updated weights for policy 0, policy_version 1633830 (0.0008) [2023-12-26 12:38:29,886][123091] Updated weights for policy 0, policy_version 1633840 (0.0008) [2023-12-26 12:38:30,644][123090] Updated weights for policy 1, policy_version 1623077 (0.0010) [2023-12-26 12:38:30,696][123091] Updated weights for policy 0, policy_version 1633850 (0.0005) [2023-12-26 12:38:30,702][123090] Updated weights for policy 1, policy_version 1623087 (0.0009) [2023-12-26 12:38:30,756][123090] Updated weights for policy 1, policy_version 1623097 (0.0009) [2023-12-26 12:38:30,759][123091] Updated weights for policy 0, policy_version 1633860 (0.0005) [2023-12-26 12:38:30,811][123091] Updated weights for policy 0, policy_version 1633870 (0.0005) [2023-12-26 12:38:31,564][123091] Updated weights for policy 0, policy_version 1633880 (0.0009) [2023-12-26 12:38:31,621][123091] Updated weights for policy 0, policy_version 1633890 (0.0009) [2023-12-26 12:38:31,638][123090] Updated weights for policy 1, policy_version 1623107 (0.0008) [2023-12-26 12:38:31,682][123091] Updated weights for policy 0, policy_version 1633900 (0.0009) [2023-12-26 12:38:31,703][123090] Updated weights for policy 1, policy_version 1623117 (0.0008) [2023-12-26 12:38:31,773][123090] Updated weights for policy 1, policy_version 1623127 (0.0009) [2023-12-26 12:38:32,528][123091] Updated weights for policy 0, policy_version 1633910 (0.0009) [2023-12-26 12:38:32,593][123090] Updated weights for policy 1, policy_version 1623137 (0.0009) [2023-12-26 12:38:32,596][123091] Updated weights for policy 0, policy_version 1633920 (0.0009) [2023-12-26 12:38:32,645][123090] Updated weights for policy 1, policy_version 1623147 (0.0009) [2023-12-26 12:38:32,654][123091] Updated weights for policy 0, policy_version 1633930 (0.0008) [2023-12-26 12:38:32,701][123090] Updated weights for policy 1, policy_version 1623157 (0.0010) [2023-12-26 12:38:32,760][123090] Updated weights for policy 1, policy_version 1623167 (0.0009) [2023-12-26 12:38:33,454][123091] Updated weights for policy 0, policy_version 1633940 (0.0008) [2023-12-26 12:38:33,517][123091] Updated weights for policy 0, policy_version 1633950 (0.0008) [2023-12-26 12:38:33,543][123090] Updated weights for policy 1, policy_version 1623177 (0.0006) [2023-12-26 12:38:33,578][123091] Updated weights for policy 0, policy_version 1633960 (0.0007) [2023-12-26 12:38:33,605][123090] Updated weights for policy 1, policy_version 1623187 (0.0005) [2023-12-26 12:38:33,666][123090] Updated weights for policy 1, policy_version 1623197 (0.0005) [2023-12-26 12:38:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 833839104. Throughput: 0: 8897.6, 1: 8759.3. Samples: 833846608. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:33,785][121949] Avg episode reward: [(0, '6085.502'), (1, '5609.805')] [2023-12-26 12:38:34,324][123090] Updated weights for policy 1, policy_version 1623207 (0.0008) [2023-12-26 12:38:34,377][123091] Updated weights for policy 0, policy_version 1633970 (0.0008) [2023-12-26 12:38:34,393][123090] Updated weights for policy 1, policy_version 1623217 (0.0008) [2023-12-26 12:38:34,444][123091] Updated weights for policy 0, policy_version 1633980 (0.0008) [2023-12-26 12:38:34,452][123090] Updated weights for policy 1, policy_version 1623227 (0.0008) [2023-12-26 12:38:34,507][123091] Updated weights for policy 0, policy_version 1633990 (0.0008) [2023-12-26 12:38:34,578][123091] Updated weights for policy 0, policy_version 1634000 (0.0008) [2023-12-26 12:38:35,271][123091] Updated weights for policy 0, policy_version 1634010 (0.0005) [2023-12-26 12:38:35,319][123091] Updated weights for policy 0, policy_version 1634020 (0.0005) [2023-12-26 12:38:35,355][123090] Updated weights for policy 1, policy_version 1623237 (0.0009) [2023-12-26 12:38:35,369][123091] Updated weights for policy 0, policy_version 1634030 (0.0005) [2023-12-26 12:38:35,410][123090] Updated weights for policy 1, policy_version 1623247 (0.0009) [2023-12-26 12:38:35,464][123090] Updated weights for policy 1, policy_version 1623257 (0.0009) [2023-12-26 12:38:35,976][123091] Updated weights for policy 0, policy_version 1634040 (0.0005) [2023-12-26 12:38:36,031][123091] Updated weights for policy 0, policy_version 1634050 (0.0006) [2023-12-26 12:38:36,081][123091] Updated weights for policy 0, policy_version 1634060 (0.0009) [2023-12-26 12:38:36,366][123090] Updated weights for policy 1, policy_version 1623267 (0.0010) [2023-12-26 12:38:36,419][123090] Updated weights for policy 1, policy_version 1623277 (0.0009) [2023-12-26 12:38:36,486][123090] Updated weights for policy 1, policy_version 1623287 (0.0010) [2023-12-26 12:38:36,907][123091] Updated weights for policy 0, policy_version 1634070 (0.0009) [2023-12-26 12:38:36,964][123091] Updated weights for policy 0, policy_version 1634080 (0.0006) [2023-12-26 12:38:37,023][123091] Updated weights for policy 0, policy_version 1634090 (0.0005) [2023-12-26 12:38:37,336][123090] Updated weights for policy 1, policy_version 1623297 (0.0010) [2023-12-26 12:38:37,406][123090] Updated weights for policy 1, policy_version 1623307 (0.0009) [2023-12-26 12:38:37,475][123090] Updated weights for policy 1, policy_version 1623317 (0.0010) [2023-12-26 12:38:37,544][123090] Updated weights for policy 1, policy_version 1623327 (0.0010) [2023-12-26 12:38:37,807][123091] Updated weights for policy 0, policy_version 1634100 (0.0007) [2023-12-26 12:38:37,882][123091] Updated weights for policy 0, policy_version 1634111 (0.0010) [2023-12-26 12:38:37,944][123091] Updated weights for policy 0, policy_version 1634121 (0.0009) [2023-12-26 12:38:38,401][123090] Updated weights for policy 1, policy_version 1623337 (0.0009) [2023-12-26 12:38:38,469][123090] Updated weights for policy 1, policy_version 1623347 (0.0010) [2023-12-26 12:38:38,537][123090] Updated weights for policy 1, policy_version 1623357 (0.0010) [2023-12-26 12:38:38,690][123091] Updated weights for policy 0, policy_version 1634131 (0.0008) [2023-12-26 12:38:38,758][123091] Updated weights for policy 0, policy_version 1634141 (0.0007) [2023-12-26 12:38:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 833921024. Throughput: 0: 8937.7, 1: 8773.1. Samples: 833900240. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:38,785][121949] Avg episode reward: [(0, '6000.682'), (1, '5683.371')] [2023-12-26 12:38:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001623360_415580160.pth... [2023-12-26 12:38:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001622336_415318016.pth [2023-12-26 12:38:38,826][123091] Updated weights for policy 0, policy_version 1634151 (0.0008) [2023-12-26 12:38:38,880][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001634160_418349056.pth... [2023-12-26 12:38:38,885][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001633104_418078720.pth [2023-12-26 12:38:39,414][123090] Updated weights for policy 1, policy_version 1623367 (0.0009) [2023-12-26 12:38:39,480][123090] Updated weights for policy 1, policy_version 1623377 (0.0007) [2023-12-26 12:38:39,550][123090] Updated weights for policy 1, policy_version 1623387 (0.0010) [2023-12-26 12:38:39,635][123091] Updated weights for policy 0, policy_version 1634161 (0.0009) [2023-12-26 12:38:39,701][123091] Updated weights for policy 0, policy_version 1634171 (0.0006) [2023-12-26 12:38:39,776][123091] Updated weights for policy 0, policy_version 1634181 (0.0006) [2023-12-26 12:38:39,854][123091] Updated weights for policy 0, policy_version 1634191 (0.0007) [2023-12-26 12:38:40,371][123090] Updated weights for policy 1, policy_version 1623397 (0.0009) [2023-12-26 12:38:40,437][123090] Updated weights for policy 1, policy_version 1623407 (0.0009) [2023-12-26 12:38:40,501][123090] Updated weights for policy 1, policy_version 1623417 (0.0009) [2023-12-26 12:38:40,577][123091] Updated weights for policy 0, policy_version 1634201 (0.0011) [2023-12-26 12:38:40,644][123091] Updated weights for policy 0, policy_version 1634211 (0.0011) [2023-12-26 12:38:40,711][123091] Updated weights for policy 0, policy_version 1634221 (0.0011) [2023-12-26 12:38:41,270][123090] Updated weights for policy 1, policy_version 1623427 (0.0008) [2023-12-26 12:38:41,331][123090] Updated weights for policy 1, policy_version 1623437 (0.0009) [2023-12-26 12:38:41,402][123090] Updated weights for policy 1, policy_version 1623447 (0.0010) [2023-12-26 12:38:41,502][123091] Updated weights for policy 0, policy_version 1634231 (0.0011) [2023-12-26 12:38:41,565][123091] Updated weights for policy 0, policy_version 1634241 (0.0011) [2023-12-26 12:38:41,637][123091] Updated weights for policy 0, policy_version 1634251 (0.0010) [2023-12-26 12:38:42,288][123090] Updated weights for policy 1, policy_version 1623457 (0.0009) [2023-12-26 12:38:42,363][123090] Updated weights for policy 1, policy_version 1623467 (0.0009) [2023-12-26 12:38:42,437][123090] Updated weights for policy 1, policy_version 1623477 (0.0009) [2023-12-26 12:38:42,497][123091] Updated weights for policy 0, policy_version 1634261 (0.0008) [2023-12-26 12:38:42,504][123090] Updated weights for policy 1, policy_version 1623487 (0.0009) [2023-12-26 12:38:42,561][123091] Updated weights for policy 0, policy_version 1634271 (0.0009) [2023-12-26 12:38:42,628][123091] Updated weights for policy 0, policy_version 1634281 (0.0010) [2023-12-26 12:38:43,304][123090] Updated weights for policy 1, policy_version 1623497 (0.0009) [2023-12-26 12:38:43,371][123090] Updated weights for policy 1, policy_version 1623507 (0.0008) [2023-12-26 12:38:43,436][123090] Updated weights for policy 1, policy_version 1623517 (0.0011) [2023-12-26 12:38:43,478][123091] Updated weights for policy 0, policy_version 1634291 (0.0009) [2023-12-26 12:38:43,549][123091] Updated weights for policy 0, policy_version 1634301 (0.0009) [2023-12-26 12:38:43,601][123091] Updated weights for policy 0, policy_version 1634311 (0.0009) [2023-12-26 12:38:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 834011136. Throughput: 0: 8870.9, 1: 8786.2. Samples: 834002464. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:43,785][121949] Avg episode reward: [(0, '5814.053'), (1, '5807.255')] [2023-12-26 12:38:44,100][123090] Updated weights for policy 1, policy_version 1623527 (0.0008) [2023-12-26 12:38:44,150][123090] Updated weights for policy 1, policy_version 1623537 (0.0008) [2023-12-26 12:38:44,194][123090] Updated weights for policy 1, policy_version 1623547 (0.0008) [2023-12-26 12:38:44,442][123091] Updated weights for policy 0, policy_version 1634321 (0.0009) [2023-12-26 12:38:44,490][123091] Updated weights for policy 0, policy_version 1634331 (0.0010) [2023-12-26 12:38:44,544][123091] Updated weights for policy 0, policy_version 1634341 (0.0010) [2023-12-26 12:38:44,601][123091] Updated weights for policy 0, policy_version 1634351 (0.0010) [2023-12-26 12:38:45,029][123090] Updated weights for policy 1, policy_version 1623557 (0.0008) [2023-12-26 12:38:45,095][123090] Updated weights for policy 1, policy_version 1623567 (0.0009) [2023-12-26 12:38:45,147][123090] Updated weights for policy 1, policy_version 1623577 (0.0009) [2023-12-26 12:38:45,472][123091] Updated weights for policy 0, policy_version 1634361 (0.0010) [2023-12-26 12:38:45,535][123091] Updated weights for policy 0, policy_version 1634371 (0.0009) [2023-12-26 12:38:45,596][123091] Updated weights for policy 0, policy_version 1634381 (0.0009) [2023-12-26 12:38:45,983][123090] Updated weights for policy 1, policy_version 1623587 (0.0008) [2023-12-26 12:38:46,032][123090] Updated weights for policy 1, policy_version 1623597 (0.0005) [2023-12-26 12:38:46,096][123090] Updated weights for policy 1, policy_version 1623607 (0.0006) [2023-12-26 12:38:46,249][123091] Updated weights for policy 0, policy_version 1634391 (0.0007) [2023-12-26 12:38:46,304][123091] Updated weights for policy 0, policy_version 1634401 (0.0005) [2023-12-26 12:38:46,381][123091] Updated weights for policy 0, policy_version 1634411 (0.0007) [2023-12-26 12:38:46,906][123090] Updated weights for policy 1, policy_version 1623617 (0.0008) [2023-12-26 12:38:46,956][123090] Updated weights for policy 1, policy_version 1623627 (0.0009) [2023-12-26 12:38:47,009][123090] Updated weights for policy 1, policy_version 1623637 (0.0009) [2023-12-26 12:38:47,059][123090] Updated weights for policy 1, policy_version 1623647 (0.0009) [2023-12-26 12:38:47,174][123091] Updated weights for policy 0, policy_version 1634421 (0.0009) [2023-12-26 12:38:47,230][123091] Updated weights for policy 0, policy_version 1634431 (0.0009) [2023-12-26 12:38:47,287][123091] Updated weights for policy 0, policy_version 1634441 (0.0009) [2023-12-26 12:38:47,935][123090] Updated weights for policy 1, policy_version 1623657 (0.0010) [2023-12-26 12:38:47,985][123090] Updated weights for policy 1, policy_version 1623668 (0.0009) [2023-12-26 12:38:48,047][123090] Updated weights for policy 1, policy_version 1623678 (0.0008) [2023-12-26 12:38:48,105][123091] Updated weights for policy 0, policy_version 1634451 (0.0009) [2023-12-26 12:38:48,155][123091] Updated weights for policy 0, policy_version 1634461 (0.0009) [2023-12-26 12:38:48,214][123091] Updated weights for policy 0, policy_version 1634471 (0.0010) [2023-12-26 12:38:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 834093056. Throughput: 0: 8881.5, 1: 8810.7. Samples: 834108260. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:48,785][121949] Avg episode reward: [(0, '5852.266'), (1, '5694.319')] [2023-12-26 12:38:48,871][123091] Updated weights for policy 0, policy_version 1634481 (0.0006) [2023-12-26 12:38:48,900][123090] Updated weights for policy 1, policy_version 1623688 (0.0009) [2023-12-26 12:38:48,931][123091] Updated weights for policy 0, policy_version 1634491 (0.0005) [2023-12-26 12:38:48,956][123090] Updated weights for policy 1, policy_version 1623698 (0.0008) [2023-12-26 12:38:48,987][123091] Updated weights for policy 0, policy_version 1634501 (0.0010) [2023-12-26 12:38:49,020][123090] Updated weights for policy 1, policy_version 1623708 (0.0008) [2023-12-26 12:38:49,040][123091] Updated weights for policy 0, policy_version 1634511 (0.0010) [2023-12-26 12:38:49,862][123091] Updated weights for policy 0, policy_version 1634521 (0.0007) [2023-12-26 12:38:49,913][123090] Updated weights for policy 1, policy_version 1623718 (0.0007) [2023-12-26 12:38:49,927][123091] Updated weights for policy 0, policy_version 1634531 (0.0008) [2023-12-26 12:38:49,981][123090] Updated weights for policy 1, policy_version 1623728 (0.0008) [2023-12-26 12:38:49,992][123091] Updated weights for policy 0, policy_version 1634541 (0.0009) [2023-12-26 12:38:50,052][123090] Updated weights for policy 1, policy_version 1623738 (0.0008) [2023-12-26 12:38:50,821][123091] Updated weights for policy 0, policy_version 1634551 (0.0009) [2023-12-26 12:38:50,842][123090] Updated weights for policy 1, policy_version 1623748 (0.0008) [2023-12-26 12:38:50,876][123091] Updated weights for policy 0, policy_version 1634561 (0.0007) [2023-12-26 12:38:50,908][123090] Updated weights for policy 1, policy_version 1623758 (0.0010) [2023-12-26 12:38:50,942][123091] Updated weights for policy 0, policy_version 1634571 (0.0007) [2023-12-26 12:38:50,972][123090] Updated weights for policy 1, policy_version 1623768 (0.0010) [2023-12-26 12:38:51,807][123091] Updated weights for policy 0, policy_version 1634581 (0.0010) [2023-12-26 12:38:51,835][123090] Updated weights for policy 1, policy_version 1623778 (0.0009) [2023-12-26 12:38:51,856][123091] Updated weights for policy 0, policy_version 1634591 (0.0009) [2023-12-26 12:38:51,892][123090] Updated weights for policy 1, policy_version 1623788 (0.0009) [2023-12-26 12:38:51,905][123091] Updated weights for policy 0, policy_version 1634601 (0.0009) [2023-12-26 12:38:51,953][123090] Updated weights for policy 1, policy_version 1623798 (0.0008) [2023-12-26 12:38:52,021][123090] Updated weights for policy 1, policy_version 1623808 (0.0006) [2023-12-26 12:38:52,789][123091] Updated weights for policy 0, policy_version 1634611 (0.0009) [2023-12-26 12:38:52,854][123090] Updated weights for policy 1, policy_version 1623818 (0.0007) [2023-12-26 12:38:52,855][123091] Updated weights for policy 0, policy_version 1634621 (0.0010) [2023-12-26 12:38:52,909][123090] Updated weights for policy 1, policy_version 1623828 (0.0009) [2023-12-26 12:38:52,917][123091] Updated weights for policy 0, policy_version 1634631 (0.0008) [2023-12-26 12:38:52,967][123090] Updated weights for policy 1, policy_version 1623838 (0.0010) [2023-12-26 12:38:53,737][123091] Updated weights for policy 0, policy_version 1634641 (0.0007) [2023-12-26 12:38:53,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.4, 300 sec: 17772.5). Total num frames: 834174976. Throughput: 0: 8842.8, 1: 8762.8. Samples: 834158748. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:53,785][121949] Avg episode reward: [(0, '5979.536'), (1, '5656.354')] [2023-12-26 12:38:53,788][123091] Updated weights for policy 0, policy_version 1634651 (0.0009) [2023-12-26 12:38:53,802][123090] Updated weights for policy 1, policy_version 1623848 (0.0008) [2023-12-26 12:38:53,835][123091] Updated weights for policy 0, policy_version 1634661 (0.0008) [2023-12-26 12:38:53,851][123090] Updated weights for policy 1, policy_version 1623858 (0.0009) [2023-12-26 12:38:53,881][123091] Updated weights for policy 0, policy_version 1634671 (0.0007) [2023-12-26 12:38:53,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001634672_418480128.pth... [2023-12-26 12:38:53,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001633616_418209792.pth [2023-12-26 12:38:53,908][123090] Updated weights for policy 1, policy_version 1623868 (0.0008) [2023-12-26 12:38:53,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001623872_415711232.pth... [2023-12-26 12:38:53,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001622848_415449088.pth [2023-12-26 12:38:54,714][123091] Updated weights for policy 0, policy_version 1634681 (0.0010) [2023-12-26 12:38:54,755][123090] Updated weights for policy 1, policy_version 1623878 (0.0007) [2023-12-26 12:38:54,781][123091] Updated weights for policy 0, policy_version 1634691 (0.0009) [2023-12-26 12:38:54,811][123090] Updated weights for policy 1, policy_version 1623888 (0.0005) [2023-12-26 12:38:54,830][123091] Updated weights for policy 0, policy_version 1634701 (0.0009) [2023-12-26 12:38:54,860][123090] Updated weights for policy 1, policy_version 1623898 (0.0005) [2023-12-26 12:38:55,543][123090] Updated weights for policy 1, policy_version 1623908 (0.0005) [2023-12-26 12:38:55,595][123090] Updated weights for policy 1, policy_version 1623918 (0.0005) [2023-12-26 12:38:55,656][123090] Updated weights for policy 1, policy_version 1623928 (0.0007) [2023-12-26 12:38:55,691][123091] Updated weights for policy 0, policy_version 1634711 (0.0008) [2023-12-26 12:38:55,744][123091] Updated weights for policy 0, policy_version 1634721 (0.0006) [2023-12-26 12:38:55,797][123091] Updated weights for policy 0, policy_version 1634731 (0.0005) [2023-12-26 12:38:56,430][123090] Updated weights for policy 1, policy_version 1623938 (0.0007) [2023-12-26 12:38:56,490][123090] Updated weights for policy 1, policy_version 1623948 (0.0005) [2023-12-26 12:38:56,537][123090] Updated weights for policy 1, policy_version 1623958 (0.0005) [2023-12-26 12:38:56,539][123091] Updated weights for policy 0, policy_version 1634741 (0.0008) [2023-12-26 12:38:56,597][123091] Updated weights for policy 0, policy_version 1634751 (0.0010) [2023-12-26 12:38:56,600][123090] Updated weights for policy 1, policy_version 1623968 (0.0005) [2023-12-26 12:38:56,658][123091] Updated weights for policy 0, policy_version 1634761 (0.0010) [2023-12-26 12:38:57,246][123090] Updated weights for policy 1, policy_version 1623978 (0.0005) [2023-12-26 12:38:57,301][123090] Updated weights for policy 1, policy_version 1623988 (0.0007) [2023-12-26 12:38:57,360][123091] Updated weights for policy 0, policy_version 1634771 (0.0008) [2023-12-26 12:38:57,361][123090] Updated weights for policy 1, policy_version 1623998 (0.0010) [2023-12-26 12:38:57,421][123091] Updated weights for policy 0, policy_version 1634781 (0.0010) [2023-12-26 12:38:57,479][123091] Updated weights for policy 0, policy_version 1634791 (0.0010) [2023-12-26 12:38:58,030][123090] Updated weights for policy 1, policy_version 1624008 (0.0006) [2023-12-26 12:38:58,092][123090] Updated weights for policy 1, policy_version 1624018 (0.0009) [2023-12-26 12:38:58,158][123090] Updated weights for policy 1, policy_version 1624028 (0.0010) [2023-12-26 12:38:58,298][123091] Updated weights for policy 0, policy_version 1634801 (0.0010) [2023-12-26 12:38:58,367][123091] Updated weights for policy 0, policy_version 1634811 (0.0011) [2023-12-26 12:38:58,429][123091] Updated weights for policy 0, policy_version 1634821 (0.0011) [2023-12-26 12:38:58,496][123091] Updated weights for policy 0, policy_version 1634831 (0.0007) [2023-12-26 12:38:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 834273280. Throughput: 0: 8814.5, 1: 8814.1. Samples: 834266508. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:38:58,784][121949] Avg episode reward: [(0, '6110.908'), (1, '5728.317')] [2023-12-26 12:38:58,947][123090] Updated weights for policy 1, policy_version 1624038 (0.0008) [2023-12-26 12:38:59,021][123090] Updated weights for policy 1, policy_version 1624048 (0.0007) [2023-12-26 12:38:59,090][123090] Updated weights for policy 1, policy_version 1624058 (0.0008) [2023-12-26 12:38:59,294][123091] Updated weights for policy 0, policy_version 1634841 (0.0009) [2023-12-26 12:38:59,363][123091] Updated weights for policy 0, policy_version 1634851 (0.0011) [2023-12-26 12:38:59,415][123091] Updated weights for policy 0, policy_version 1634861 (0.0010) [2023-12-26 12:38:59,781][123090] Updated weights for policy 1, policy_version 1624068 (0.0007) [2023-12-26 12:38:59,853][123090] Updated weights for policy 1, policy_version 1624078 (0.0011) [2023-12-26 12:38:59,916][123090] Updated weights for policy 1, policy_version 1624088 (0.0009) [2023-12-26 12:39:00,280][123091] Updated weights for policy 0, policy_version 1634871 (0.0007) [2023-12-26 12:39:00,330][123091] Updated weights for policy 0, policy_version 1634881 (0.0006) [2023-12-26 12:39:00,396][123091] Updated weights for policy 0, policy_version 1634891 (0.0008) [2023-12-26 12:39:00,640][123090] Updated weights for policy 1, policy_version 1624098 (0.0009) [2023-12-26 12:39:00,692][123090] Updated weights for policy 1, policy_version 1624108 (0.0008) [2023-12-26 12:39:00,750][123090] Updated weights for policy 1, policy_version 1624118 (0.0010) [2023-12-26 12:39:00,811][123090] Updated weights for policy 1, policy_version 1624128 (0.0010) [2023-12-26 12:39:01,089][123091] Updated weights for policy 0, policy_version 1634901 (0.0009) [2023-12-26 12:39:01,148][123091] Updated weights for policy 0, policy_version 1634911 (0.0010) [2023-12-26 12:39:01,220][123091] Updated weights for policy 0, policy_version 1634921 (0.0010) [2023-12-26 12:39:01,620][123090] Updated weights for policy 1, policy_version 1624138 (0.0006) [2023-12-26 12:39:01,697][123090] Updated weights for policy 1, policy_version 1624148 (0.0007) [2023-12-26 12:39:01,769][123090] Updated weights for policy 1, policy_version 1624158 (0.0009) [2023-12-26 12:39:02,008][123091] Updated weights for policy 0, policy_version 1634931 (0.0009) [2023-12-26 12:39:02,061][123091] Updated weights for policy 0, policy_version 1634941 (0.0005) [2023-12-26 12:39:02,118][123091] Updated weights for policy 0, policy_version 1634951 (0.0005) [2023-12-26 12:39:02,583][123090] Updated weights for policy 1, policy_version 1624168 (0.0006) [2023-12-26 12:39:02,641][123090] Updated weights for policy 1, policy_version 1624178 (0.0005) [2023-12-26 12:39:02,715][123090] Updated weights for policy 1, policy_version 1624188 (0.0005) [2023-12-26 12:39:02,842][123091] Updated weights for policy 0, policy_version 1634961 (0.0006) [2023-12-26 12:39:02,898][123091] Updated weights for policy 0, policy_version 1634971 (0.0009) [2023-12-26 12:39:02,949][123091] Updated weights for policy 0, policy_version 1634981 (0.0010) [2023-12-26 12:39:03,013][123091] Updated weights for policy 0, policy_version 1634991 (0.0011) [2023-12-26 12:39:03,372][123090] Updated weights for policy 1, policy_version 1624198 (0.0006) [2023-12-26 12:39:03,434][123090] Updated weights for policy 1, policy_version 1624208 (0.0005) [2023-12-26 12:39:03,497][123090] Updated weights for policy 1, policy_version 1624218 (0.0005) [2023-12-26 12:39:03,713][123091] Updated weights for policy 0, policy_version 1635001 (0.0006) [2023-12-26 12:39:03,767][123091] Updated weights for policy 0, policy_version 1635011 (0.0005) [2023-12-26 12:39:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 834363392. Throughput: 0: 8870.5, 1: 8853.4. Samples: 834376716. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:03,785][121949] Avg episode reward: [(0, '6103.561'), (1, '5827.421')] [2023-12-26 12:39:03,815][123091] Updated weights for policy 0, policy_version 1635021 (0.0005) [2023-12-26 12:39:04,192][123090] Updated weights for policy 1, policy_version 1624228 (0.0007) [2023-12-26 12:39:04,254][123090] Updated weights for policy 1, policy_version 1624238 (0.0009) [2023-12-26 12:39:04,309][123090] Updated weights for policy 1, policy_version 1624248 (0.0008) [2023-12-26 12:39:04,475][123091] Updated weights for policy 0, policy_version 1635031 (0.0006) [2023-12-26 12:39:04,524][123091] Updated weights for policy 0, policy_version 1635041 (0.0008) [2023-12-26 12:39:04,574][123091] Updated weights for policy 0, policy_version 1635051 (0.0008) [2023-12-26 12:39:05,104][123090] Updated weights for policy 1, policy_version 1624258 (0.0007) [2023-12-26 12:39:05,159][123090] Updated weights for policy 1, policy_version 1624268 (0.0009) [2023-12-26 12:39:05,222][123090] Updated weights for policy 1, policy_version 1624278 (0.0009) [2023-12-26 12:39:05,286][123090] Updated weights for policy 1, policy_version 1624288 (0.0008) [2023-12-26 12:39:05,338][123091] Updated weights for policy 0, policy_version 1635061 (0.0008) [2023-12-26 12:39:05,400][123091] Updated weights for policy 0, policy_version 1635071 (0.0010) [2023-12-26 12:39:05,465][123091] Updated weights for policy 0, policy_version 1635081 (0.0008) [2023-12-26 12:39:06,169][123090] Updated weights for policy 1, policy_version 1624298 (0.0008) [2023-12-26 12:39:06,190][123091] Updated weights for policy 0, policy_version 1635091 (0.0007) [2023-12-26 12:39:06,217][123090] Updated weights for policy 1, policy_version 1624308 (0.0007) [2023-12-26 12:39:06,253][123091] Updated weights for policy 0, policy_version 1635101 (0.0011) [2023-12-26 12:39:06,273][123090] Updated weights for policy 1, policy_version 1624318 (0.0006) [2023-12-26 12:39:06,316][123091] Updated weights for policy 0, policy_version 1635111 (0.0011) [2023-12-26 12:39:07,141][123090] Updated weights for policy 1, policy_version 1624328 (0.0009) [2023-12-26 12:39:07,159][123091] Updated weights for policy 0, policy_version 1635121 (0.0011) [2023-12-26 12:39:07,205][123090] Updated weights for policy 1, policy_version 1624338 (0.0008) [2023-12-26 12:39:07,215][123091] Updated weights for policy 0, policy_version 1635131 (0.0011) [2023-12-26 12:39:07,266][123090] Updated weights for policy 1, policy_version 1624348 (0.0006) [2023-12-26 12:39:07,267][123091] Updated weights for policy 0, policy_version 1635141 (0.0011) [2023-12-26 12:39:07,319][123091] Updated weights for policy 0, policy_version 1635151 (0.0011) [2023-12-26 12:39:07,993][123091] Updated weights for policy 0, policy_version 1635161 (0.0006) [2023-12-26 12:39:08,057][123091] Updated weights for policy 0, policy_version 1635171 (0.0005) [2023-12-26 12:39:08,127][123091] Updated weights for policy 0, policy_version 1635181 (0.0007) [2023-12-26 12:39:08,148][123090] Updated weights for policy 1, policy_version 1624358 (0.0007) [2023-12-26 12:39:08,206][123090] Updated weights for policy 1, policy_version 1624368 (0.0010) [2023-12-26 12:39:08,263][123090] Updated weights for policy 1, policy_version 1624378 (0.0009) [2023-12-26 12:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 834453504. Throughput: 0: 8975.3, 1: 8852.6. Samples: 834431840. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:08,785][121949] Avg episode reward: [(0, '6147.319'), (1, '5644.420')] [2023-12-26 12:39:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001624384_415842304.pth... [2023-12-26 12:39:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001623360_415580160.pth [2023-12-26 12:39:08,802][123091] Updated weights for policy 0, policy_version 1635191 (0.0009) [2023-12-26 12:39:08,854][123091] Updated weights for policy 0, policy_version 1635201 (0.0011) [2023-12-26 12:39:08,899][123091] Updated weights for policy 0, policy_version 1635211 (0.0010) [2023-12-26 12:39:08,919][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001635216_418619392.pth... [2023-12-26 12:39:08,922][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001634160_418349056.pth [2023-12-26 12:39:09,128][123090] Updated weights for policy 1, policy_version 1624388 (0.0009) [2023-12-26 12:39:09,184][123090] Updated weights for policy 1, policy_version 1624398 (0.0008) [2023-12-26 12:39:09,255][123090] Updated weights for policy 1, policy_version 1624408 (0.0007) [2023-12-26 12:39:09,739][123091] Updated weights for policy 0, policy_version 1635221 (0.0008) [2023-12-26 12:39:09,799][123091] Updated weights for policy 0, policy_version 1635231 (0.0009) [2023-12-26 12:39:09,870][123091] Updated weights for policy 0, policy_version 1635241 (0.0009) [2023-12-26 12:39:10,081][123090] Updated weights for policy 1, policy_version 1624418 (0.0007) [2023-12-26 12:39:10,143][123090] Updated weights for policy 1, policy_version 1624428 (0.0009) [2023-12-26 12:39:10,196][123090] Updated weights for policy 1, policy_version 1624438 (0.0009) [2023-12-26 12:39:10,252][123090] Updated weights for policy 1, policy_version 1624448 (0.0010) [2023-12-26 12:39:10,698][123091] Updated weights for policy 0, policy_version 1635251 (0.0010) [2023-12-26 12:39:10,765][123091] Updated weights for policy 0, policy_version 1635261 (0.0011) [2023-12-26 12:39:10,824][123091] Updated weights for policy 0, policy_version 1635271 (0.0011) [2023-12-26 12:39:11,073][123090] Updated weights for policy 1, policy_version 1624458 (0.0007) [2023-12-26 12:39:11,130][123090] Updated weights for policy 1, policy_version 1624468 (0.0005) [2023-12-26 12:39:11,208][123090] Updated weights for policy 1, policy_version 1624478 (0.0009) [2023-12-26 12:39:11,655][123091] Updated weights for policy 0, policy_version 1635281 (0.0011) [2023-12-26 12:39:11,723][123091] Updated weights for policy 0, policy_version 1635291 (0.0011) [2023-12-26 12:39:11,787][123091] Updated weights for policy 0, policy_version 1635301 (0.0011) [2023-12-26 12:39:11,851][123091] Updated weights for policy 0, policy_version 1635311 (0.0010) [2023-12-26 12:39:11,996][123090] Updated weights for policy 1, policy_version 1624488 (0.0010) [2023-12-26 12:39:12,061][123090] Updated weights for policy 1, policy_version 1624498 (0.0011) [2023-12-26 12:39:12,128][123090] Updated weights for policy 1, policy_version 1624508 (0.0011) [2023-12-26 12:39:12,715][123091] Updated weights for policy 0, policy_version 1635321 (0.0010) [2023-12-26 12:39:12,775][123091] Updated weights for policy 0, policy_version 1635331 (0.0007) [2023-12-26 12:39:12,833][123091] Updated weights for policy 0, policy_version 1635341 (0.0005) [2023-12-26 12:39:12,921][123090] Updated weights for policy 1, policy_version 1624518 (0.0010) [2023-12-26 12:39:12,980][123090] Updated weights for policy 1, policy_version 1624528 (0.0010) [2023-12-26 12:39:13,039][123090] Updated weights for policy 1, policy_version 1624538 (0.0010) [2023-12-26 12:39:13,554][123091] Updated weights for policy 0, policy_version 1635351 (0.0005) [2023-12-26 12:39:13,603][123091] Updated weights for policy 0, policy_version 1635361 (0.0005) [2023-12-26 12:39:13,656][123091] Updated weights for policy 0, policy_version 1635371 (0.0005) [2023-12-26 12:39:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 834543616. Throughput: 0: 8958.6, 1: 8733.3. Samples: 834535832. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:13,784][121949] Avg episode reward: [(0, '6156.014'), (1, '5584.982')] [2023-12-26 12:39:13,837][123090] Updated weights for policy 1, policy_version 1624548 (0.0008) [2023-12-26 12:39:13,908][123090] Updated weights for policy 1, policy_version 1624558 (0.0005) [2023-12-26 12:39:13,961][123090] Updated weights for policy 1, policy_version 1624568 (0.0005) [2023-12-26 12:39:14,386][123091] Updated weights for policy 0, policy_version 1635381 (0.0008) [2023-12-26 12:39:14,438][123091] Updated weights for policy 0, policy_version 1635391 (0.0010) [2023-12-26 12:39:14,503][123091] Updated weights for policy 0, policy_version 1635401 (0.0008) [2023-12-26 12:39:14,619][123090] Updated weights for policy 1, policy_version 1624578 (0.0005) [2023-12-26 12:39:14,674][123090] Updated weights for policy 1, policy_version 1624588 (0.0005) [2023-12-26 12:39:14,721][123090] Updated weights for policy 1, policy_version 1624598 (0.0005) [2023-12-26 12:39:14,774][123090] Updated weights for policy 1, policy_version 1624608 (0.0006) [2023-12-26 12:39:15,254][123091] Updated weights for policy 0, policy_version 1635411 (0.0008) [2023-12-26 12:39:15,321][123091] Updated weights for policy 0, policy_version 1635421 (0.0008) [2023-12-26 12:39:15,386][123091] Updated weights for policy 0, policy_version 1635431 (0.0008) [2023-12-26 12:39:15,499][123090] Updated weights for policy 1, policy_version 1624618 (0.0006) [2023-12-26 12:39:15,562][123090] Updated weights for policy 1, policy_version 1624628 (0.0010) [2023-12-26 12:39:15,622][123090] Updated weights for policy 1, policy_version 1624638 (0.0010) [2023-12-26 12:39:16,128][123091] Updated weights for policy 0, policy_version 1635441 (0.0010) [2023-12-26 12:39:16,192][123091] Updated weights for policy 0, policy_version 1635451 (0.0007) [2023-12-26 12:39:16,256][123091] Updated weights for policy 0, policy_version 1635461 (0.0005) [2023-12-26 12:39:16,322][123091] Updated weights for policy 0, policy_version 1635471 (0.0009) [2023-12-26 12:39:16,402][123090] Updated weights for policy 1, policy_version 1624648 (0.0010) [2023-12-26 12:39:16,464][123090] Updated weights for policy 1, policy_version 1624658 (0.0010) [2023-12-26 12:39:16,526][123090] Updated weights for policy 1, policy_version 1624668 (0.0010) [2023-12-26 12:39:17,067][123091] Updated weights for policy 0, policy_version 1635481 (0.0011) [2023-12-26 12:39:17,134][123091] Updated weights for policy 0, policy_version 1635491 (0.0011) [2023-12-26 12:39:17,196][123091] Updated weights for policy 0, policy_version 1635501 (0.0010) [2023-12-26 12:39:17,333][123090] Updated weights for policy 1, policy_version 1624678 (0.0007) [2023-12-26 12:39:17,380][123090] Updated weights for policy 1, policy_version 1624688 (0.0005) [2023-12-26 12:39:17,424][123090] Updated weights for policy 1, policy_version 1624698 (0.0005) [2023-12-26 12:39:18,004][123091] Updated weights for policy 0, policy_version 1635511 (0.0010) [2023-12-26 12:39:18,035][123090] Updated weights for policy 1, policy_version 1624708 (0.0005) [2023-12-26 12:39:18,069][123091] Updated weights for policy 0, policy_version 1635521 (0.0011) [2023-12-26 12:39:18,092][123090] Updated weights for policy 1, policy_version 1624718 (0.0006) [2023-12-26 12:39:18,131][123091] Updated weights for policy 0, policy_version 1635531 (0.0011) [2023-12-26 12:39:18,143][123090] Updated weights for policy 1, policy_version 1624728 (0.0010) [2023-12-26 12:39:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 834633728. Throughput: 0: 9024.0, 1: 8816.7. Samples: 834649436. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:18,785][121949] Avg episode reward: [(0, '5939.085'), (1, '5804.958')] [2023-12-26 12:39:18,839][123091] Updated weights for policy 0, policy_version 1635541 (0.0006) [2023-12-26 12:39:18,856][123090] Updated weights for policy 1, policy_version 1624738 (0.0009) [2023-12-26 12:39:18,905][123091] Updated weights for policy 0, policy_version 1635551 (0.0011) [2023-12-26 12:39:18,914][123090] Updated weights for policy 1, policy_version 1624748 (0.0005) [2023-12-26 12:39:18,965][123091] Updated weights for policy 0, policy_version 1635561 (0.0011) [2023-12-26 12:39:18,978][123090] Updated weights for policy 1, policy_version 1624758 (0.0005) [2023-12-26 12:39:19,034][123090] Updated weights for policy 1, policy_version 1624768 (0.0005) [2023-12-26 12:39:19,783][123090] Updated weights for policy 1, policy_version 1624778 (0.0005) [2023-12-26 12:39:19,840][123091] Updated weights for policy 0, policy_version 1635571 (0.0010) [2023-12-26 12:39:19,845][123090] Updated weights for policy 1, policy_version 1624788 (0.0006) [2023-12-26 12:39:19,906][123091] Updated weights for policy 0, policy_version 1635581 (0.0009) [2023-12-26 12:39:19,917][123090] Updated weights for policy 1, policy_version 1624798 (0.0006) [2023-12-26 12:39:19,979][123091] Updated weights for policy 0, policy_version 1635591 (0.0007) [2023-12-26 12:39:20,669][123090] Updated weights for policy 1, policy_version 1624808 (0.0007) [2023-12-26 12:39:20,727][123090] Updated weights for policy 1, policy_version 1624818 (0.0005) [2023-12-26 12:39:20,762][123091] Updated weights for policy 0, policy_version 1635601 (0.0006) [2023-12-26 12:39:20,783][123090] Updated weights for policy 1, policy_version 1624828 (0.0006) [2023-12-26 12:39:20,830][123091] Updated weights for policy 0, policy_version 1635611 (0.0009) [2023-12-26 12:39:20,897][123091] Updated weights for policy 0, policy_version 1635621 (0.0010) [2023-12-26 12:39:20,961][123091] Updated weights for policy 0, policy_version 1635631 (0.0010) [2023-12-26 12:39:21,579][123090] Updated weights for policy 1, policy_version 1624838 (0.0011) [2023-12-26 12:39:21,648][123090] Updated weights for policy 1, policy_version 1624848 (0.0011) [2023-12-26 12:39:21,709][123090] Updated weights for policy 1, policy_version 1624858 (0.0011) [2023-12-26 12:39:21,805][123091] Updated weights for policy 0, policy_version 1635641 (0.0010) [2023-12-26 12:39:21,860][123091] Updated weights for policy 0, policy_version 1635651 (0.0010) [2023-12-26 12:39:21,924][123091] Updated weights for policy 0, policy_version 1635661 (0.0011) [2023-12-26 12:39:22,398][123090] Updated weights for policy 1, policy_version 1624868 (0.0008) [2023-12-26 12:39:22,466][123090] Updated weights for policy 1, policy_version 1624878 (0.0008) [2023-12-26 12:39:22,532][123090] Updated weights for policy 1, policy_version 1624888 (0.0009) [2023-12-26 12:39:22,845][123091] Updated weights for policy 0, policy_version 1635671 (0.0008) [2023-12-26 12:39:22,920][123091] Updated weights for policy 0, policy_version 1635681 (0.0006) [2023-12-26 12:39:22,983][123091] Updated weights for policy 0, policy_version 1635691 (0.0006) [2023-12-26 12:39:23,396][123090] Updated weights for policy 1, policy_version 1624898 (0.0011) [2023-12-26 12:39:23,459][123090] Updated weights for policy 1, policy_version 1624908 (0.0010) [2023-12-26 12:39:23,524][123090] Updated weights for policy 1, policy_version 1624918 (0.0010) [2023-12-26 12:39:23,585][123090] Updated weights for policy 1, policy_version 1624928 (0.0010) [2023-12-26 12:39:23,665][123091] Updated weights for policy 0, policy_version 1635701 (0.0007) [2023-12-26 12:39:23,731][123091] Updated weights for policy 0, policy_version 1635711 (0.0010) [2023-12-26 12:39:23,781][123091] Updated weights for policy 0, policy_version 1635722 (0.0009) [2023-12-26 12:39:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 834723840. Throughput: 0: 8949.1, 1: 8881.3. Samples: 834702608. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:23,785][121949] Avg episode reward: [(0, '5913.434'), (1, '5807.151')] [2023-12-26 12:39:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001624928_415981568.pth... [2023-12-26 12:39:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001623872_415711232.pth [2023-12-26 12:39:23,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001635728_418750464.pth... [2023-12-26 12:39:23,817][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001634672_418480128.pth [2023-12-26 12:39:24,434][123091] Updated weights for policy 0, policy_version 1635732 (0.0008) [2023-12-26 12:39:24,437][123090] Updated weights for policy 1, policy_version 1624938 (0.0010) [2023-12-26 12:39:24,487][123091] Updated weights for policy 0, policy_version 1635742 (0.0006) [2023-12-26 12:39:24,501][123090] Updated weights for policy 1, policy_version 1624948 (0.0009) [2023-12-26 12:39:24,546][123091] Updated weights for policy 0, policy_version 1635752 (0.0007) [2023-12-26 12:39:24,558][123090] Updated weights for policy 1, policy_version 1624958 (0.0009) [2023-12-26 12:39:25,357][123091] Updated weights for policy 0, policy_version 1635762 (0.0009) [2023-12-26 12:39:25,388][123090] Updated weights for policy 1, policy_version 1624968 (0.0008) [2023-12-26 12:39:25,411][123091] Updated weights for policy 0, policy_version 1635772 (0.0008) [2023-12-26 12:39:25,441][123090] Updated weights for policy 1, policy_version 1624978 (0.0007) [2023-12-26 12:39:25,477][123091] Updated weights for policy 0, policy_version 1635782 (0.0005) [2023-12-26 12:39:25,496][123090] Updated weights for policy 1, policy_version 1624988 (0.0008) [2023-12-26 12:39:25,553][123091] Updated weights for policy 0, policy_version 1635792 (0.0005) [2023-12-26 12:39:26,111][123091] Updated weights for policy 0, policy_version 1635802 (0.0005) [2023-12-26 12:39:26,180][123091] Updated weights for policy 0, policy_version 1635812 (0.0005) [2023-12-26 12:39:26,238][123091] Updated weights for policy 0, policy_version 1635822 (0.0006) [2023-12-26 12:39:26,377][123090] Updated weights for policy 1, policy_version 1624998 (0.0009) [2023-12-26 12:39:26,429][123090] Updated weights for policy 1, policy_version 1625008 (0.0009) [2023-12-26 12:39:26,481][123090] Updated weights for policy 1, policy_version 1625018 (0.0008) [2023-12-26 12:39:26,891][123091] Updated weights for policy 0, policy_version 1635832 (0.0007) [2023-12-26 12:39:26,946][123091] Updated weights for policy 0, policy_version 1635842 (0.0006) [2023-12-26 12:39:27,001][123091] Updated weights for policy 0, policy_version 1635852 (0.0008) [2023-12-26 12:39:27,380][123090] Updated weights for policy 1, policy_version 1625028 (0.0009) [2023-12-26 12:39:27,445][123090] Updated weights for policy 1, policy_version 1625038 (0.0009) [2023-12-26 12:39:27,509][123090] Updated weights for policy 1, policy_version 1625048 (0.0008) [2023-12-26 12:39:27,757][123091] Updated weights for policy 0, policy_version 1635863 (0.0007) [2023-12-26 12:39:27,813][123091] Updated weights for policy 0, policy_version 1635873 (0.0006) [2023-12-26 12:39:27,875][123091] Updated weights for policy 0, policy_version 1635883 (0.0005) [2023-12-26 12:39:28,397][123090] Updated weights for policy 1, policy_version 1625058 (0.0009) [2023-12-26 12:39:28,454][123090] Updated weights for policy 1, policy_version 1625068 (0.0010) [2023-12-26 12:39:28,524][123090] Updated weights for policy 1, policy_version 1625078 (0.0009) [2023-12-26 12:39:28,567][123091] Updated weights for policy 0, policy_version 1635893 (0.0009) [2023-12-26 12:39:28,586][123090] Updated weights for policy 1, policy_version 1625088 (0.0009) [2023-12-26 12:39:28,618][123091] Updated weights for policy 0, policy_version 1635903 (0.0010) [2023-12-26 12:39:28,662][123091] Updated weights for policy 0, policy_version 1635913 (0.0010) [2023-12-26 12:39:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 834822144. Throughput: 0: 9053.5, 1: 8882.6. Samples: 834809588. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:28,785][121949] Avg episode reward: [(0, '6086.213'), (1, '5763.710')] [2023-12-26 12:39:29,333][123091] Updated weights for policy 0, policy_version 1635923 (0.0009) [2023-12-26 12:39:29,399][123091] Updated weights for policy 0, policy_version 1635933 (0.0007) [2023-12-26 12:39:29,461][123091] Updated weights for policy 0, policy_version 1635943 (0.0005) [2023-12-26 12:39:29,475][123090] Updated weights for policy 1, policy_version 1625098 (0.0009) [2023-12-26 12:39:29,535][123090] Updated weights for policy 1, policy_version 1625108 (0.0009) [2023-12-26 12:39:29,589][123090] Updated weights for policy 1, policy_version 1625118 (0.0010) [2023-12-26 12:39:30,171][123091] Updated weights for policy 0, policy_version 1635953 (0.0005) [2023-12-26 12:39:30,239][123091] Updated weights for policy 0, policy_version 1635963 (0.0005) [2023-12-26 12:39:30,294][123091] Updated weights for policy 0, policy_version 1635973 (0.0005) [2023-12-26 12:39:30,353][123091] Updated weights for policy 0, policy_version 1635983 (0.0009) [2023-12-26 12:39:30,507][123090] Updated weights for policy 1, policy_version 1625128 (0.0010) [2023-12-26 12:39:30,574][123090] Updated weights for policy 1, policy_version 1625139 (0.0011) [2023-12-26 12:39:30,625][123090] Updated weights for policy 1, policy_version 1625150 (0.0008) [2023-12-26 12:39:31,076][123091] Updated weights for policy 0, policy_version 1635993 (0.0010) [2023-12-26 12:39:31,123][123091] Updated weights for policy 0, policy_version 1636003 (0.0010) [2023-12-26 12:39:31,191][123091] Updated weights for policy 0, policy_version 1636013 (0.0011) [2023-12-26 12:39:31,534][123090] Updated weights for policy 1, policy_version 1625160 (0.0009) [2023-12-26 12:39:31,605][123090] Updated weights for policy 1, policy_version 1625170 (0.0010) [2023-12-26 12:39:31,672][123090] Updated weights for policy 1, policy_version 1625180 (0.0009) [2023-12-26 12:39:31,891][123091] Updated weights for policy 0, policy_version 1636023 (0.0011) [2023-12-26 12:39:31,952][123091] Updated weights for policy 0, policy_version 1636033 (0.0010) [2023-12-26 12:39:32,007][123091] Updated weights for policy 0, policy_version 1636043 (0.0010) [2023-12-26 12:39:32,523][123090] Updated weights for policy 1, policy_version 1625190 (0.0009) [2023-12-26 12:39:32,571][123090] Updated weights for policy 1, policy_version 1625200 (0.0008) [2023-12-26 12:39:32,623][123090] Updated weights for policy 1, policy_version 1625210 (0.0008) [2023-12-26 12:39:32,755][123091] Updated weights for policy 0, policy_version 1636053 (0.0007) [2023-12-26 12:39:32,811][123091] Updated weights for policy 0, policy_version 1636063 (0.0006) [2023-12-26 12:39:32,876][123091] Updated weights for policy 0, policy_version 1636073 (0.0009) [2023-12-26 12:39:33,467][123090] Updated weights for policy 1, policy_version 1625220 (0.0010) [2023-12-26 12:39:33,517][123090] Updated weights for policy 1, policy_version 1625230 (0.0009) [2023-12-26 12:39:33,562][123090] Updated weights for policy 1, policy_version 1625240 (0.0008) [2023-12-26 12:39:33,620][123091] Updated weights for policy 0, policy_version 1636083 (0.0010) [2023-12-26 12:39:33,666][123091] Updated weights for policy 0, policy_version 1636093 (0.0006) [2023-12-26 12:39:33,717][123091] Updated weights for policy 0, policy_version 1636103 (0.0006) [2023-12-26 12:39:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 834912256. Throughput: 0: 9162.0, 1: 8806.8. Samples: 834916860. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:33,785][121949] Avg episode reward: [(0, '6121.009'), (1, '5790.388')] [2023-12-26 12:39:34,435][123090] Updated weights for policy 1, policy_version 1625250 (0.0008) [2023-12-26 12:39:34,510][123090] Updated weights for policy 1, policy_version 1625260 (0.0006) [2023-12-26 12:39:34,515][123091] Updated weights for policy 0, policy_version 1636113 (0.0009) [2023-12-26 12:39:34,569][123090] Updated weights for policy 1, policy_version 1625270 (0.0008) [2023-12-26 12:39:34,570][123091] Updated weights for policy 0, policy_version 1636123 (0.0011) [2023-12-26 12:39:34,624][123090] Updated weights for policy 1, policy_version 1625280 (0.0008) [2023-12-26 12:39:34,628][123091] Updated weights for policy 0, policy_version 1636133 (0.0009) [2023-12-26 12:39:34,687][123091] Updated weights for policy 0, policy_version 1636143 (0.0009) [2023-12-26 12:39:35,290][123090] Updated weights for policy 1, policy_version 1625290 (0.0008) [2023-12-26 12:39:35,342][123090] Updated weights for policy 1, policy_version 1625300 (0.0009) [2023-12-26 12:39:35,409][123090] Updated weights for policy 1, policy_version 1625310 (0.0009) [2023-12-26 12:39:35,608][123091] Updated weights for policy 0, policy_version 1636153 (0.0009) [2023-12-26 12:39:35,680][123091] Updated weights for policy 0, policy_version 1636163 (0.0009) [2023-12-26 12:39:35,739][123091] Updated weights for policy 0, policy_version 1636173 (0.0007) [2023-12-26 12:39:36,154][123090] Updated weights for policy 1, policy_version 1625320 (0.0009) [2023-12-26 12:39:36,215][123090] Updated weights for policy 1, policy_version 1625330 (0.0009) [2023-12-26 12:39:36,280][123090] Updated weights for policy 1, policy_version 1625340 (0.0009) [2023-12-26 12:39:36,560][123091] Updated weights for policy 0, policy_version 1636183 (0.0009) [2023-12-26 12:39:36,616][123091] Updated weights for policy 0, policy_version 1636193 (0.0011) [2023-12-26 12:39:36,662][123091] Updated weights for policy 0, policy_version 1636203 (0.0009) [2023-12-26 12:39:37,120][123090] Updated weights for policy 1, policy_version 1625350 (0.0009) [2023-12-26 12:39:37,180][123090] Updated weights for policy 1, policy_version 1625360 (0.0008) [2023-12-26 12:39:37,245][123090] Updated weights for policy 1, policy_version 1625370 (0.0009) [2023-12-26 12:39:37,509][123091] Updated weights for policy 0, policy_version 1636213 (0.0010) [2023-12-26 12:39:37,579][123091] Updated weights for policy 0, policy_version 1636223 (0.0010) [2023-12-26 12:39:37,645][123091] Updated weights for policy 0, policy_version 1636233 (0.0011) [2023-12-26 12:39:38,072][123090] Updated weights for policy 1, policy_version 1625380 (0.0009) [2023-12-26 12:39:38,123][123090] Updated weights for policy 1, policy_version 1625390 (0.0006) [2023-12-26 12:39:38,177][123090] Updated weights for policy 1, policy_version 1625400 (0.0006) [2023-12-26 12:39:38,462][123091] Updated weights for policy 0, policy_version 1636243 (0.0011) [2023-12-26 12:39:38,529][123091] Updated weights for policy 0, policy_version 1636253 (0.0010) [2023-12-26 12:39:38,596][123091] Updated weights for policy 0, policy_version 1636263 (0.0010) [2023-12-26 12:39:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 834994176. Throughput: 0: 9149.8, 1: 8871.8. Samples: 834969720. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:38,785][121949] Avg episode reward: [(0, '6042.334'), (1, '5739.054')] [2023-12-26 12:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001636272_418889728.pth... [2023-12-26 12:39:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001625408_416104448.pth... [2023-12-26 12:39:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001635216_418619392.pth [2023-12-26 12:39:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001624384_415842304.pth [2023-12-26 12:39:38,997][123090] Updated weights for policy 1, policy_version 1625410 (0.0007) [2023-12-26 12:39:39,057][123090] Updated weights for policy 1, policy_version 1625420 (0.0006) [2023-12-26 12:39:39,114][123090] Updated weights for policy 1, policy_version 1625430 (0.0006) [2023-12-26 12:39:39,175][123090] Updated weights for policy 1, policy_version 1625440 (0.0007) [2023-12-26 12:39:39,481][123091] Updated weights for policy 0, policy_version 1636273 (0.0011) [2023-12-26 12:39:39,552][123091] Updated weights for policy 0, policy_version 1636283 (0.0008) [2023-12-26 12:39:39,629][123091] Updated weights for policy 0, policy_version 1636293 (0.0008) [2023-12-26 12:39:39,701][123091] Updated weights for policy 0, policy_version 1636303 (0.0009) [2023-12-26 12:39:39,931][123090] Updated weights for policy 1, policy_version 1625450 (0.0006) [2023-12-26 12:39:39,992][123090] Updated weights for policy 1, policy_version 1625460 (0.0006) [2023-12-26 12:39:40,057][123090] Updated weights for policy 1, policy_version 1625470 (0.0009) [2023-12-26 12:39:40,451][123091] Updated weights for policy 0, policy_version 1636313 (0.0011) [2023-12-26 12:39:40,514][123091] Updated weights for policy 0, policy_version 1636323 (0.0011) [2023-12-26 12:39:40,577][123091] Updated weights for policy 0, policy_version 1636333 (0.0010) [2023-12-26 12:39:40,867][123090] Updated weights for policy 1, policy_version 1625480 (0.0007) [2023-12-26 12:39:40,928][123090] Updated weights for policy 1, policy_version 1625490 (0.0007) [2023-12-26 12:39:40,976][123090] Updated weights for policy 1, policy_version 1625500 (0.0005) [2023-12-26 12:39:41,426][123091] Updated weights for policy 0, policy_version 1636343 (0.0009) [2023-12-26 12:39:41,494][123091] Updated weights for policy 0, policy_version 1636353 (0.0009) [2023-12-26 12:39:41,555][123091] Updated weights for policy 0, policy_version 1636363 (0.0007) [2023-12-26 12:39:41,832][123090] Updated weights for policy 1, policy_version 1625510 (0.0008) [2023-12-26 12:39:41,888][123090] Updated weights for policy 1, policy_version 1625520 (0.0009) [2023-12-26 12:39:41,953][123090] Updated weights for policy 1, policy_version 1625530 (0.0010) [2023-12-26 12:39:42,301][123091] Updated weights for policy 0, policy_version 1636373 (0.0009) [2023-12-26 12:39:42,371][123091] Updated weights for policy 0, policy_version 1636383 (0.0007) [2023-12-26 12:39:42,448][123091] Updated weights for policy 0, policy_version 1636393 (0.0008) [2023-12-26 12:39:42,878][123090] Updated weights for policy 1, policy_version 1625540 (0.0009) [2023-12-26 12:39:42,939][123090] Updated weights for policy 1, policy_version 1625550 (0.0010) [2023-12-26 12:39:42,999][123090] Updated weights for policy 1, policy_version 1625560 (0.0010) [2023-12-26 12:39:43,165][123091] Updated weights for policy 0, policy_version 1636403 (0.0007) [2023-12-26 12:39:43,228][123091] Updated weights for policy 0, policy_version 1636413 (0.0010) [2023-12-26 12:39:43,277][123091] Updated weights for policy 0, policy_version 1636423 (0.0007) [2023-12-26 12:39:43,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 835076096. Throughput: 0: 9129.0, 1: 8781.0. Samples: 835072460. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:43,785][121949] Avg episode reward: [(0, '6050.637'), (1, '5884.654')] [2023-12-26 12:39:43,883][123090] Updated weights for policy 1, policy_version 1625570 (0.0009) [2023-12-26 12:39:43,940][123090] Updated weights for policy 1, policy_version 1625580 (0.0005) [2023-12-26 12:39:43,995][123090] Updated weights for policy 1, policy_version 1625590 (0.0005) [2023-12-26 12:39:44,048][123090] Updated weights for policy 1, policy_version 1625600 (0.0006) [2023-12-26 12:39:44,084][123091] Updated weights for policy 0, policy_version 1636433 (0.0010) [2023-12-26 12:39:44,149][123091] Updated weights for policy 0, policy_version 1636443 (0.0008) [2023-12-26 12:39:44,222][123091] Updated weights for policy 0, policy_version 1636453 (0.0009) [2023-12-26 12:39:44,289][123091] Updated weights for policy 0, policy_version 1636463 (0.0009) [2023-12-26 12:39:44,875][123090] Updated weights for policy 1, policy_version 1625610 (0.0011) [2023-12-26 12:39:44,947][123090] Updated weights for policy 1, policy_version 1625620 (0.0011) [2023-12-26 12:39:44,990][123091] Updated weights for policy 0, policy_version 1636473 (0.0006) [2023-12-26 12:39:45,015][123090] Updated weights for policy 1, policy_version 1625630 (0.0011) [2023-12-26 12:39:45,042][123091] Updated weights for policy 0, policy_version 1636483 (0.0006) [2023-12-26 12:39:45,098][123091] Updated weights for policy 0, policy_version 1636493 (0.0005) [2023-12-26 12:39:45,817][123091] Updated weights for policy 0, policy_version 1636503 (0.0008) [2023-12-26 12:39:45,838][123090] Updated weights for policy 1, policy_version 1625640 (0.0011) [2023-12-26 12:39:45,876][123091] Updated weights for policy 0, policy_version 1636513 (0.0009) [2023-12-26 12:39:45,891][123090] Updated weights for policy 1, policy_version 1625650 (0.0010) [2023-12-26 12:39:45,931][123091] Updated weights for policy 0, policy_version 1636523 (0.0005) [2023-12-26 12:39:45,942][123090] Updated weights for policy 1, policy_version 1625660 (0.0010) [2023-12-26 12:39:46,611][123091] Updated weights for policy 0, policy_version 1636533 (0.0006) [2023-12-26 12:39:46,669][123091] Updated weights for policy 0, policy_version 1636543 (0.0005) [2023-12-26 12:39:46,723][123091] Updated weights for policy 0, policy_version 1636553 (0.0006) [2023-12-26 12:39:46,747][123090] Updated weights for policy 1, policy_version 1625670 (0.0007) [2023-12-26 12:39:46,803][123090] Updated weights for policy 1, policy_version 1625680 (0.0005) [2023-12-26 12:39:46,873][123090] Updated weights for policy 1, policy_version 1625690 (0.0005) [2023-12-26 12:39:47,521][123091] Updated weights for policy 0, policy_version 1636563 (0.0007) [2023-12-26 12:39:47,575][123091] Updated weights for policy 0, policy_version 1636573 (0.0009) [2023-12-26 12:39:47,628][123090] Updated weights for policy 1, policy_version 1625700 (0.0005) [2023-12-26 12:39:47,636][123091] Updated weights for policy 0, policy_version 1636583 (0.0009) [2023-12-26 12:39:47,691][123090] Updated weights for policy 1, policy_version 1625710 (0.0005) [2023-12-26 12:39:47,757][123090] Updated weights for policy 1, policy_version 1625720 (0.0005) [2023-12-26 12:39:48,302][123090] Updated weights for policy 1, policy_version 1625730 (0.0006) [2023-12-26 12:39:48,365][123090] Updated weights for policy 1, policy_version 1625740 (0.0010) [2023-12-26 12:39:48,437][123090] Updated weights for policy 1, policy_version 1625750 (0.0010) [2023-12-26 12:39:48,497][123090] Updated weights for policy 1, policy_version 1625760 (0.0009) [2023-12-26 12:39:48,510][123091] Updated weights for policy 0, policy_version 1636593 (0.0010) [2023-12-26 12:39:48,583][123091] Updated weights for policy 0, policy_version 1636603 (0.0009) [2023-12-26 12:39:48,640][123091] Updated weights for policy 0, policy_version 1636613 (0.0009) [2023-12-26 12:39:48,693][123091] Updated weights for policy 0, policy_version 1636623 (0.0009) [2023-12-26 12:39:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 835174400. Throughput: 0: 9129.8, 1: 8722.6. Samples: 835180072. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:48,785][121949] Avg episode reward: [(0, '6110.205'), (1, '5876.581')] [2023-12-26 12:39:49,327][123090] Updated weights for policy 1, policy_version 1625770 (0.0007) [2023-12-26 12:39:49,392][123090] Updated weights for policy 1, policy_version 1625780 (0.0009) [2023-12-26 12:39:49,450][123090] Updated weights for policy 1, policy_version 1625790 (0.0009) [2023-12-26 12:39:49,531][123091] Updated weights for policy 0, policy_version 1636633 (0.0006) [2023-12-26 12:39:49,588][123091] Updated weights for policy 0, policy_version 1636643 (0.0007) [2023-12-26 12:39:49,644][123091] Updated weights for policy 0, policy_version 1636653 (0.0009) [2023-12-26 12:39:50,267][123090] Updated weights for policy 1, policy_version 1625800 (0.0010) [2023-12-26 12:39:50,328][123090] Updated weights for policy 1, policy_version 1625810 (0.0010) [2023-12-26 12:39:50,391][123090] Updated weights for policy 1, policy_version 1625820 (0.0010) [2023-12-26 12:39:50,504][123091] Updated weights for policy 0, policy_version 1636663 (0.0010) [2023-12-26 12:39:50,568][123091] Updated weights for policy 0, policy_version 1636673 (0.0008) [2023-12-26 12:39:50,634][123091] Updated weights for policy 0, policy_version 1636683 (0.0010) [2023-12-26 12:39:51,228][123090] Updated weights for policy 1, policy_version 1625830 (0.0007) [2023-12-26 12:39:51,296][123090] Updated weights for policy 1, policy_version 1625840 (0.0007) [2023-12-26 12:39:51,360][123090] Updated weights for policy 1, policy_version 1625850 (0.0010) [2023-12-26 12:39:51,496][123091] Updated weights for policy 0, policy_version 1636693 (0.0010) [2023-12-26 12:39:51,552][123091] Updated weights for policy 0, policy_version 1636703 (0.0010) [2023-12-26 12:39:51,610][123091] Updated weights for policy 0, policy_version 1636713 (0.0009) [2023-12-26 12:39:52,188][123090] Updated weights for policy 1, policy_version 1625860 (0.0010) [2023-12-26 12:39:52,237][123090] Updated weights for policy 1, policy_version 1625870 (0.0009) [2023-12-26 12:39:52,296][123090] Updated weights for policy 1, policy_version 1625880 (0.0009) [2023-12-26 12:39:52,489][123091] Updated weights for policy 0, policy_version 1636723 (0.0009) [2023-12-26 12:39:52,560][123091] Updated weights for policy 0, policy_version 1636733 (0.0011) [2023-12-26 12:39:52,624][123091] Updated weights for policy 0, policy_version 1636743 (0.0011) [2023-12-26 12:39:53,152][123090] Updated weights for policy 1, policy_version 1625890 (0.0009) [2023-12-26 12:39:53,213][123090] Updated weights for policy 1, policy_version 1625900 (0.0008) [2023-12-26 12:39:53,279][123090] Updated weights for policy 1, policy_version 1625910 (0.0005) [2023-12-26 12:39:53,345][123090] Updated weights for policy 1, policy_version 1625920 (0.0009) [2023-12-26 12:39:53,433][123091] Updated weights for policy 0, policy_version 1636753 (0.0011) [2023-12-26 12:39:53,494][123091] Updated weights for policy 0, policy_version 1636763 (0.0010) [2023-12-26 12:39:53,556][123091] Updated weights for policy 0, policy_version 1636773 (0.0010) [2023-12-26 12:39:53,614][123091] Updated weights for policy 0, policy_version 1636783 (0.0010) [2023-12-26 12:39:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 835256320. Throughput: 0: 9039.1, 1: 8716.6. Samples: 835230848. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:53,785][121949] Avg episode reward: [(0, '6082.833'), (1, '5745.713')] [2023-12-26 12:39:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001636784_419020800.pth... [2023-12-26 12:39:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001625920_416235520.pth... [2023-12-26 12:39:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001635728_418750464.pth [2023-12-26 12:39:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001624928_415981568.pth [2023-12-26 12:39:54,126][123090] Updated weights for policy 1, policy_version 1625930 (0.0006) [2023-12-26 12:39:54,190][123090] Updated weights for policy 1, policy_version 1625940 (0.0007) [2023-12-26 12:39:54,254][123090] Updated weights for policy 1, policy_version 1625950 (0.0011) [2023-12-26 12:39:54,381][123091] Updated weights for policy 0, policy_version 1636793 (0.0009) [2023-12-26 12:39:54,475][123091] Updated weights for policy 0, policy_version 1636803 (0.0010) [2023-12-26 12:39:54,539][123091] Updated weights for policy 0, policy_version 1636813 (0.0009) [2023-12-26 12:39:55,047][123090] Updated weights for policy 1, policy_version 1625960 (0.0010) [2023-12-26 12:39:55,121][123090] Updated weights for policy 1, policy_version 1625970 (0.0009) [2023-12-26 12:39:55,187][123090] Updated weights for policy 1, policy_version 1625980 (0.0011) [2023-12-26 12:39:55,232][123091] Updated weights for policy 0, policy_version 1636823 (0.0007) [2023-12-26 12:39:55,288][123091] Updated weights for policy 0, policy_version 1636833 (0.0010) [2023-12-26 12:39:55,347][123091] Updated weights for policy 0, policy_version 1636843 (0.0009) [2023-12-26 12:39:55,841][123090] Updated weights for policy 1, policy_version 1625990 (0.0007) [2023-12-26 12:39:55,895][123090] Updated weights for policy 1, policy_version 1626000 (0.0005) [2023-12-26 12:39:55,948][123090] Updated weights for policy 1, policy_version 1626010 (0.0005) [2023-12-26 12:39:56,280][123091] Updated weights for policy 0, policy_version 1636853 (0.0010) [2023-12-26 12:39:56,335][123091] Updated weights for policy 0, policy_version 1636863 (0.0008) [2023-12-26 12:39:56,390][123091] Updated weights for policy 0, policy_version 1636873 (0.0009) [2023-12-26 12:39:56,701][123090] Updated weights for policy 1, policy_version 1626020 (0.0007) [2023-12-26 12:39:56,745][123090] Updated weights for policy 1, policy_version 1626030 (0.0010) [2023-12-26 12:39:56,796][123090] Updated weights for policy 1, policy_version 1626040 (0.0010) [2023-12-26 12:39:57,259][123091] Updated weights for policy 0, policy_version 1636883 (0.0009) [2023-12-26 12:39:57,325][123091] Updated weights for policy 0, policy_version 1636893 (0.0010) [2023-12-26 12:39:57,379][123091] Updated weights for policy 0, policy_version 1636903 (0.0010) [2023-12-26 12:39:57,537][123090] Updated weights for policy 1, policy_version 1626050 (0.0009) [2023-12-26 12:39:57,589][123090] Updated weights for policy 1, policy_version 1626060 (0.0005) [2023-12-26 12:39:57,650][123090] Updated weights for policy 1, policy_version 1626070 (0.0005) [2023-12-26 12:39:57,708][123090] Updated weights for policy 1, policy_version 1626080 (0.0005) [2023-12-26 12:39:58,069][123091] Updated weights for policy 0, policy_version 1636913 (0.0009) [2023-12-26 12:39:58,130][123091] Updated weights for policy 0, policy_version 1636923 (0.0007) [2023-12-26 12:39:58,202][123091] Updated weights for policy 0, policy_version 1636933 (0.0009) [2023-12-26 12:39:58,273][123091] Updated weights for policy 0, policy_version 1636943 (0.0008) [2023-12-26 12:39:58,417][123090] Updated weights for policy 1, policy_version 1626090 (0.0009) [2023-12-26 12:39:58,484][123090] Updated weights for policy 1, policy_version 1626100 (0.0011) [2023-12-26 12:39:58,545][123090] Updated weights for policy 1, policy_version 1626110 (0.0010) [2023-12-26 12:39:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 835346432. Throughput: 0: 8986.5, 1: 8819.1. Samples: 835337084. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:39:58,785][121949] Avg episode reward: [(0, '6181.699'), (1, '5868.060')] [2023-12-26 12:39:59,052][123091] Updated weights for policy 0, policy_version 1636953 (0.0009) [2023-12-26 12:39:59,116][123091] Updated weights for policy 0, policy_version 1636963 (0.0009) [2023-12-26 12:39:59,186][123091] Updated weights for policy 0, policy_version 1636973 (0.0009) [2023-12-26 12:39:59,462][123090] Updated weights for policy 1, policy_version 1626120 (0.0009) [2023-12-26 12:39:59,535][123090] Updated weights for policy 1, policy_version 1626130 (0.0010) [2023-12-26 12:39:59,603][123090] Updated weights for policy 1, policy_version 1626141 (0.0009) [2023-12-26 12:40:00,018][123091] Updated weights for policy 0, policy_version 1636983 (0.0010) [2023-12-26 12:40:00,064][123091] Updated weights for policy 0, policy_version 1636993 (0.0009) [2023-12-26 12:40:00,124][123091] Updated weights for policy 0, policy_version 1637003 (0.0006) [2023-12-26 12:40:00,474][123090] Updated weights for policy 1, policy_version 1626151 (0.0009) [2023-12-26 12:40:00,539][123090] Updated weights for policy 1, policy_version 1626161 (0.0010) [2023-12-26 12:40:00,603][123090] Updated weights for policy 1, policy_version 1626171 (0.0009) [2023-12-26 12:40:00,894][123091] Updated weights for policy 0, policy_version 1637013 (0.0007) [2023-12-26 12:40:00,948][123091] Updated weights for policy 0, policy_version 1637023 (0.0010) [2023-12-26 12:40:01,015][123091] Updated weights for policy 0, policy_version 1637033 (0.0009) [2023-12-26 12:40:01,452][123090] Updated weights for policy 1, policy_version 1626181 (0.0009) [2023-12-26 12:40:01,501][123090] Updated weights for policy 1, policy_version 1626191 (0.0009) [2023-12-26 12:40:01,552][123090] Updated weights for policy 1, policy_version 1626201 (0.0008) [2023-12-26 12:40:01,863][123091] Updated weights for policy 0, policy_version 1637043 (0.0008) [2023-12-26 12:40:01,916][123091] Updated weights for policy 0, policy_version 1637053 (0.0010) [2023-12-26 12:40:01,971][123091] Updated weights for policy 0, policy_version 1637063 (0.0009) [2023-12-26 12:40:02,346][123090] Updated weights for policy 1, policy_version 1626211 (0.0009) [2023-12-26 12:40:02,410][123090] Updated weights for policy 1, policy_version 1626221 (0.0009) [2023-12-26 12:40:02,480][123090] Updated weights for policy 1, policy_version 1626231 (0.0009) [2023-12-26 12:40:02,805][123091] Updated weights for policy 0, policy_version 1637074 (0.0010) [2023-12-26 12:40:02,852][123091] Updated weights for policy 0, policy_version 1637084 (0.0009) [2023-12-26 12:40:02,908][123091] Updated weights for policy 0, policy_version 1637095 (0.0009) [2023-12-26 12:40:03,307][123090] Updated weights for policy 1, policy_version 1626241 (0.0010) [2023-12-26 12:40:03,360][123090] Updated weights for policy 1, policy_version 1626251 (0.0007) [2023-12-26 12:40:03,422][123090] Updated weights for policy 1, policy_version 1626261 (0.0006) [2023-12-26 12:40:03,477][123090] Updated weights for policy 1, policy_version 1626271 (0.0006) [2023-12-26 12:40:03,744][123091] Updated weights for policy 0, policy_version 1637105 (0.0008) [2023-12-26 12:40:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 835428352. Throughput: 0: 8922.2, 1: 8679.3. Samples: 835441508. Policy #0 lag: (min: 26.0, avg: 36.5, max: 58.0) [2023-12-26 12:40:03,785][121949] Avg episode reward: [(0, '6168.170'), (1, '5777.717')] [2023-12-26 12:40:03,797][123091] Updated weights for policy 0, policy_version 1637115 (0.0005) [2023-12-26 12:40:03,858][123091] Updated weights for policy 0, policy_version 1637125 (0.0006) [2023-12-26 12:40:03,922][123091] Updated weights for policy 0, policy_version 1637135 (0.0006) [2023-12-26 12:40:04,241][123090] Updated weights for policy 1, policy_version 1626281 (0.0010) [2023-12-26 12:40:04,310][123090] Updated weights for policy 1, policy_version 1626291 (0.0010) [2023-12-26 12:40:04,379][123090] Updated weights for policy 1, policy_version 1626301 (0.0011) [2023-12-26 12:40:04,656][123091] Updated weights for policy 0, policy_version 1637145 (0.0006) [2023-12-26 12:40:04,724][123091] Updated weights for policy 0, policy_version 1637155 (0.0007) [2023-12-26 12:40:04,789][123091] Updated weights for policy 0, policy_version 1637165 (0.0010) [2023-12-26 12:40:05,277][123090] Updated weights for policy 1, policy_version 1626311 (0.0009) [2023-12-26 12:40:05,324][123090] Updated weights for policy 1, policy_version 1626321 (0.0008) [2023-12-26 12:40:05,378][123090] Updated weights for policy 1, policy_version 1626331 (0.0009) [2023-12-26 12:40:05,537][123091] Updated weights for policy 0, policy_version 1637175 (0.0006) [2023-12-26 12:40:05,606][123091] Updated weights for policy 0, policy_version 1637185 (0.0005) [2023-12-26 12:40:05,667][123091] Updated weights for policy 0, policy_version 1637195 (0.0006) [2023-12-26 12:40:06,261][123090] Updated weights for policy 1, policy_version 1626341 (0.0009) [2023-12-26 12:40:06,325][123090] Updated weights for policy 1, policy_version 1626351 (0.0009) [2023-12-26 12:40:06,390][123090] Updated weights for policy 1, policy_version 1626361 (0.0009) [2023-12-26 12:40:06,443][123091] Updated weights for policy 0, policy_version 1637205 (0.0009) [2023-12-26 12:40:06,498][123091] Updated weights for policy 0, policy_version 1637215 (0.0010) [2023-12-26 12:40:06,561][123091] Updated weights for policy 0, policy_version 1637225 (0.0010) [2023-12-26 12:40:07,233][123090] Updated weights for policy 1, policy_version 1626371 (0.0008) [2023-12-26 12:40:07,282][123090] Updated weights for policy 1, policy_version 1626381 (0.0008) [2023-12-26 12:40:07,335][123090] Updated weights for policy 1, policy_version 1626391 (0.0009) [2023-12-26 12:40:07,391][123091] Updated weights for policy 0, policy_version 1637235 (0.0010) [2023-12-26 12:40:07,439][123091] Updated weights for policy 0, policy_version 1637245 (0.0010) [2023-12-26 12:40:07,490][123091] Updated weights for policy 0, policy_version 1637255 (0.0010) [2023-12-26 12:40:08,164][123091] Updated weights for policy 0, policy_version 1637265 (0.0010) [2023-12-26 12:40:08,179][123090] Updated weights for policy 1, policy_version 1626401 (0.0009) [2023-12-26 12:40:08,225][123091] Updated weights for policy 0, policy_version 1637275 (0.0005) [2023-12-26 12:40:08,238][123090] Updated weights for policy 1, policy_version 1626411 (0.0008) [2023-12-26 12:40:08,279][123091] Updated weights for policy 0, policy_version 1637285 (0.0005) [2023-12-26 12:40:08,288][123090] Updated weights for policy 1, policy_version 1626421 (0.0009) [2023-12-26 12:40:08,342][123091] Updated weights for policy 0, policy_version 1637295 (0.0007) [2023-12-26 12:40:08,356][123090] Updated weights for policy 1, policy_version 1626431 (0.0008) [2023-12-26 12:40:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 835518464. Throughput: 0: 8975.2, 1: 8619.1. Samples: 835494352. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:08,785][121949] Avg episode reward: [(0, '6074.928'), (1, '5619.197')] [2023-12-26 12:40:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001637296_419151872.pth... [2023-12-26 12:40:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001626432_416366592.pth... [2023-12-26 12:40:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001636272_418889728.pth [2023-12-26 12:40:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001625408_416104448.pth [2023-12-26 12:40:09,145][123091] Updated weights for policy 0, policy_version 1637305 (0.0010) [2023-12-26 12:40:09,207][123091] Updated weights for policy 0, policy_version 1637315 (0.0010) [2023-12-26 12:40:09,227][123090] Updated weights for policy 1, policy_version 1626441 (0.0007) [2023-12-26 12:40:09,277][123091] Updated weights for policy 0, policy_version 1637325 (0.0010) [2023-12-26 12:40:09,292][123090] Updated weights for policy 1, policy_version 1626451 (0.0009) [2023-12-26 12:40:09,357][123090] Updated weights for policy 1, policy_version 1626461 (0.0007) [2023-12-26 12:40:10,097][123091] Updated weights for policy 0, policy_version 1637335 (0.0011) [2023-12-26 12:40:10,160][123091] Updated weights for policy 0, policy_version 1637345 (0.0006) [2023-12-26 12:40:10,222][123091] Updated weights for policy 0, policy_version 1637355 (0.0006) [2023-12-26 12:40:10,242][123090] Updated weights for policy 1, policy_version 1626471 (0.0009) [2023-12-26 12:40:10,297][123090] Updated weights for policy 1, policy_version 1626481 (0.0008) [2023-12-26 12:40:10,356][123090] Updated weights for policy 1, policy_version 1626491 (0.0009) [2023-12-26 12:40:10,986][123091] Updated weights for policy 0, policy_version 1637365 (0.0011) [2023-12-26 12:40:11,047][123091] Updated weights for policy 0, policy_version 1637375 (0.0009) [2023-12-26 12:40:11,115][123091] Updated weights for policy 0, policy_version 1637385 (0.0007) [2023-12-26 12:40:11,230][123090] Updated weights for policy 1, policy_version 1626501 (0.0009) [2023-12-26 12:40:11,300][123090] Updated weights for policy 1, policy_version 1626511 (0.0009) [2023-12-26 12:40:11,369][123090] Updated weights for policy 1, policy_version 1626521 (0.0009) [2023-12-26 12:40:11,917][123091] Updated weights for policy 0, policy_version 1637395 (0.0007) [2023-12-26 12:40:11,969][123091] Updated weights for policy 0, policy_version 1637405 (0.0006) [2023-12-26 12:40:12,021][123091] Updated weights for policy 0, policy_version 1637415 (0.0006) [2023-12-26 12:40:12,245][123090] Updated weights for policy 1, policy_version 1626531 (0.0009) [2023-12-26 12:40:12,306][123090] Updated weights for policy 1, policy_version 1626541 (0.0009) [2023-12-26 12:40:12,370][123090] Updated weights for policy 1, policy_version 1626551 (0.0008) [2023-12-26 12:40:12,842][123091] Updated weights for policy 0, policy_version 1637425 (0.0006) [2023-12-26 12:40:12,913][123091] Updated weights for policy 0, policy_version 1637435 (0.0011) [2023-12-26 12:40:12,975][123091] Updated weights for policy 0, policy_version 1637445 (0.0011) [2023-12-26 12:40:13,041][123091] Updated weights for policy 0, policy_version 1637455 (0.0011) [2023-12-26 12:40:13,217][123090] Updated weights for policy 1, policy_version 1626561 (0.0009) [2023-12-26 12:40:13,271][123090] Updated weights for policy 1, policy_version 1626571 (0.0009) [2023-12-26 12:40:13,329][123090] Updated weights for policy 1, policy_version 1626581 (0.0009) [2023-12-26 12:40:13,390][123090] Updated weights for policy 1, policy_version 1626591 (0.0009) [2023-12-26 12:40:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 835600384. Throughput: 0: 8913.9, 1: 8590.3. Samples: 835597276. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:13,785][121949] Avg episode reward: [(0, '6007.938'), (1, '5708.830')] [2023-12-26 12:40:13,791][123091] Updated weights for policy 0, policy_version 1637465 (0.0010) [2023-12-26 12:40:13,850][123091] Updated weights for policy 0, policy_version 1637475 (0.0011) [2023-12-26 12:40:13,913][123091] Updated weights for policy 0, policy_version 1637485 (0.0011) [2023-12-26 12:40:14,302][123090] Updated weights for policy 1, policy_version 1626601 (0.0009) [2023-12-26 12:40:14,362][123090] Updated weights for policy 1, policy_version 1626611 (0.0008) [2023-12-26 12:40:14,430][123090] Updated weights for policy 1, policy_version 1626621 (0.0009) [2023-12-26 12:40:14,718][123091] Updated weights for policy 0, policy_version 1637495 (0.0010) [2023-12-26 12:40:14,787][123091] Updated weights for policy 0, policy_version 1637505 (0.0010) [2023-12-26 12:40:14,851][123091] Updated weights for policy 0, policy_version 1637515 (0.0010) [2023-12-26 12:40:15,257][123090] Updated weights for policy 1, policy_version 1626631 (0.0009) [2023-12-26 12:40:15,323][123090] Updated weights for policy 1, policy_version 1626641 (0.0010) [2023-12-26 12:40:15,387][123090] Updated weights for policy 1, policy_version 1626651 (0.0010) [2023-12-26 12:40:15,521][123091] Updated weights for policy 0, policy_version 1637525 (0.0007) [2023-12-26 12:40:15,592][123091] Updated weights for policy 0, policy_version 1637535 (0.0009) [2023-12-26 12:40:15,656][123091] Updated weights for policy 0, policy_version 1637545 (0.0011) [2023-12-26 12:40:16,237][123090] Updated weights for policy 1, policy_version 1626661 (0.0008) [2023-12-26 12:40:16,305][123090] Updated weights for policy 1, policy_version 1626671 (0.0005) [2023-12-26 12:40:16,364][123090] Updated weights for policy 1, policy_version 1626681 (0.0009) [2023-12-26 12:40:16,407][123091] Updated weights for policy 0, policy_version 1637555 (0.0011) [2023-12-26 12:40:16,466][123091] Updated weights for policy 0, policy_version 1637565 (0.0011) [2023-12-26 12:40:16,536][123091] Updated weights for policy 0, policy_version 1637575 (0.0007) [2023-12-26 12:40:17,212][123091] Updated weights for policy 0, policy_version 1637585 (0.0005) [2023-12-26 12:40:17,240][123090] Updated weights for policy 1, policy_version 1626691 (0.0009) [2023-12-26 12:40:17,271][123091] Updated weights for policy 0, policy_version 1637595 (0.0005) [2023-12-26 12:40:17,292][123090] Updated weights for policy 1, policy_version 1626701 (0.0009) [2023-12-26 12:40:17,322][123091] Updated weights for policy 0, policy_version 1637605 (0.0005) [2023-12-26 12:40:17,346][123090] Updated weights for policy 1, policy_version 1626711 (0.0009) [2023-12-26 12:40:17,374][123091] Updated weights for policy 0, policy_version 1637615 (0.0006) [2023-12-26 12:40:18,033][123091] Updated weights for policy 0, policy_version 1637625 (0.0006) [2023-12-26 12:40:18,078][123091] Updated weights for policy 0, policy_version 1637635 (0.0005) [2023-12-26 12:40:18,130][123091] Updated weights for policy 0, policy_version 1637645 (0.0005) [2023-12-26 12:40:18,293][123090] Updated weights for policy 1, policy_version 1626721 (0.0009) [2023-12-26 12:40:18,358][123090] Updated weights for policy 1, policy_version 1626731 (0.0009) [2023-12-26 12:40:18,424][123090] Updated weights for policy 1, policy_version 1626741 (0.0010) [2023-12-26 12:40:18,494][123090] Updated weights for policy 1, policy_version 1626751 (0.0009) [2023-12-26 12:40:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 835690496. Throughput: 0: 8896.3, 1: 8583.2. Samples: 835703432. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:18,785][121949] Avg episode reward: [(0, '6004.721'), (1, '5701.842')] [2023-12-26 12:40:18,789][123091] Updated weights for policy 0, policy_version 1637655 (0.0007) [2023-12-26 12:40:18,846][123091] Updated weights for policy 0, policy_version 1637665 (0.0007) [2023-12-26 12:40:18,895][123091] Updated weights for policy 0, policy_version 1637675 (0.0009) [2023-12-26 12:40:19,360][123090] Updated weights for policy 1, policy_version 1626761 (0.0008) [2023-12-26 12:40:19,415][123090] Updated weights for policy 1, policy_version 1626771 (0.0008) [2023-12-26 12:40:19,478][123090] Updated weights for policy 1, policy_version 1626781 (0.0010) [2023-12-26 12:40:19,743][123091] Updated weights for policy 0, policy_version 1637685 (0.0010) [2023-12-26 12:40:19,798][123091] Updated weights for policy 0, policy_version 1637695 (0.0009) [2023-12-26 12:40:19,869][123091] Updated weights for policy 0, policy_version 1637705 (0.0010) [2023-12-26 12:40:20,288][123090] Updated weights for policy 1, policy_version 1626791 (0.0006) [2023-12-26 12:40:20,358][123090] Updated weights for policy 1, policy_version 1626801 (0.0006) [2023-12-26 12:40:20,421][123090] Updated weights for policy 1, policy_version 1626811 (0.0006) [2023-12-26 12:40:20,716][123091] Updated weights for policy 0, policy_version 1637715 (0.0008) [2023-12-26 12:40:20,787][123091] Updated weights for policy 0, policy_version 1637725 (0.0008) [2023-12-26 12:40:20,852][123091] Updated weights for policy 0, policy_version 1637735 (0.0009) [2023-12-26 12:40:21,197][123090] Updated weights for policy 1, policy_version 1626821 (0.0008) [2023-12-26 12:40:21,256][123090] Updated weights for policy 1, policy_version 1626831 (0.0010) [2023-12-26 12:40:21,332][123090] Updated weights for policy 1, policy_version 1626841 (0.0011) [2023-12-26 12:40:21,701][123091] Updated weights for policy 0, policy_version 1637745 (0.0009) [2023-12-26 12:40:21,766][123091] Updated weights for policy 0, policy_version 1637755 (0.0009) [2023-12-26 12:40:21,830][123091] Updated weights for policy 0, policy_version 1637765 (0.0008) [2023-12-26 12:40:21,896][123091] Updated weights for policy 0, policy_version 1637775 (0.0006) [2023-12-26 12:40:22,192][123090] Updated weights for policy 1, policy_version 1626851 (0.0009) [2023-12-26 12:40:22,263][123090] Updated weights for policy 1, policy_version 1626861 (0.0010) [2023-12-26 12:40:22,332][123090] Updated weights for policy 1, policy_version 1626871 (0.0010) [2023-12-26 12:40:22,713][123091] Updated weights for policy 0, policy_version 1637785 (0.0009) [2023-12-26 12:40:22,771][123091] Updated weights for policy 0, policy_version 1637795 (0.0006) [2023-12-26 12:40:22,841][123091] Updated weights for policy 0, policy_version 1637805 (0.0005) [2023-12-26 12:40:23,180][123090] Updated weights for policy 1, policy_version 1626881 (0.0010) [2023-12-26 12:40:23,237][123090] Updated weights for policy 1, policy_version 1626891 (0.0009) [2023-12-26 12:40:23,303][123090] Updated weights for policy 1, policy_version 1626901 (0.0010) [2023-12-26 12:40:23,356][123090] Updated weights for policy 1, policy_version 1626912 (0.0009) [2023-12-26 12:40:23,651][123091] Updated weights for policy 0, policy_version 1637815 (0.0006) [2023-12-26 12:40:23,716][123091] Updated weights for policy 0, policy_version 1637825 (0.0005) [2023-12-26 12:40:23,764][123091] Updated weights for policy 0, policy_version 1637835 (0.0005) [2023-12-26 12:40:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 835772416. Throughput: 0: 8889.8, 1: 8546.9. Samples: 835754372. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:23,785][121949] Avg episode reward: [(0, '6135.033'), (1, '5503.183')] [2023-12-26 12:40:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001626912_416489472.pth... [2023-12-26 12:40:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001637840_419291136.pth... [2023-12-26 12:40:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001625920_416235520.pth [2023-12-26 12:40:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001636784_419020800.pth [2023-12-26 12:40:24,227][123090] Updated weights for policy 1, policy_version 1626922 (0.0009) [2023-12-26 12:40:24,280][123090] Updated weights for policy 1, policy_version 1626932 (0.0009) [2023-12-26 12:40:24,332][123090] Updated weights for policy 1, policy_version 1626942 (0.0009) [2023-12-26 12:40:24,569][123091] Updated weights for policy 0, policy_version 1637845 (0.0009) [2023-12-26 12:40:24,633][123091] Updated weights for policy 0, policy_version 1637855 (0.0007) [2023-12-26 12:40:24,697][123091] Updated weights for policy 0, policy_version 1637865 (0.0005) [2023-12-26 12:40:25,267][123090] Updated weights for policy 1, policy_version 1626952 (0.0009) [2023-12-26 12:40:25,324][123090] Updated weights for policy 1, policy_version 1626962 (0.0009) [2023-12-26 12:40:25,375][123091] Updated weights for policy 0, policy_version 1637875 (0.0007) [2023-12-26 12:40:25,377][123090] Updated weights for policy 1, policy_version 1626972 (0.0009) [2023-12-26 12:40:25,425][123091] Updated weights for policy 0, policy_version 1637885 (0.0008) [2023-12-26 12:40:25,482][123091] Updated weights for policy 0, policy_version 1637895 (0.0008) [2023-12-26 12:40:26,225][123091] Updated weights for policy 0, policy_version 1637905 (0.0009) [2023-12-26 12:40:26,237][123090] Updated weights for policy 1, policy_version 1626982 (0.0010) [2023-12-26 12:40:26,288][123091] Updated weights for policy 0, policy_version 1637915 (0.0009) [2023-12-26 12:40:26,302][123090] Updated weights for policy 1, policy_version 1626992 (0.0008) [2023-12-26 12:40:26,344][123091] Updated weights for policy 0, policy_version 1637925 (0.0008) [2023-12-26 12:40:26,356][123090] Updated weights for policy 1, policy_version 1627002 (0.0007) [2023-12-26 12:40:26,400][123091] Updated weights for policy 0, policy_version 1637935 (0.0010) [2023-12-26 12:40:27,183][123090] Updated weights for policy 1, policy_version 1627012 (0.0008) [2023-12-26 12:40:27,215][123091] Updated weights for policy 0, policy_version 1637945 (0.0009) [2023-12-26 12:40:27,235][123090] Updated weights for policy 1, policy_version 1627022 (0.0007) [2023-12-26 12:40:27,264][123091] Updated weights for policy 0, policy_version 1637955 (0.0007) [2023-12-26 12:40:27,298][123090] Updated weights for policy 1, policy_version 1627032 (0.0008) [2023-12-26 12:40:27,317][123091] Updated weights for policy 0, policy_version 1637965 (0.0009) [2023-12-26 12:40:28,111][123090] Updated weights for policy 1, policy_version 1627042 (0.0007) [2023-12-26 12:40:28,175][123090] Updated weights for policy 1, policy_version 1627052 (0.0009) [2023-12-26 12:40:28,175][123091] Updated weights for policy 0, policy_version 1637975 (0.0009) [2023-12-26 12:40:28,228][123090] Updated weights for policy 1, policy_version 1627062 (0.0009) [2023-12-26 12:40:28,236][123091] Updated weights for policy 0, policy_version 1637985 (0.0009) [2023-12-26 12:40:28,282][123090] Updated weights for policy 1, policy_version 1627072 (0.0010) [2023-12-26 12:40:28,285][123091] Updated weights for policy 0, policy_version 1637995 (0.0008) [2023-12-26 12:40:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17339.7, 300 sec: 17716.9). Total num frames: 835862528. Throughput: 0: 8935.9, 1: 8509.7. Samples: 835857512. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:28,785][121949] Avg episode reward: [(0, '6235.035'), (1, '5502.458')] [2023-12-26 12:40:29,084][123090] Updated weights for policy 1, policy_version 1627082 (0.0009) [2023-12-26 12:40:29,141][123091] Updated weights for policy 0, policy_version 1638005 (0.0007) [2023-12-26 12:40:29,142][123090] Updated weights for policy 1, policy_version 1627092 (0.0009) [2023-12-26 12:40:29,190][123091] Updated weights for policy 0, policy_version 1638016 (0.0008) [2023-12-26 12:40:29,202][123090] Updated weights for policy 1, policy_version 1627102 (0.0009) [2023-12-26 12:40:29,250][123091] Updated weights for policy 0, policy_version 1638026 (0.0008) [2023-12-26 12:40:30,037][123090] Updated weights for policy 1, policy_version 1627112 (0.0008) [2023-12-26 12:40:30,101][123090] Updated weights for policy 1, policy_version 1627122 (0.0009) [2023-12-26 12:40:30,126][123091] Updated weights for policy 0, policy_version 1638036 (0.0009) [2023-12-26 12:40:30,163][123090] Updated weights for policy 1, policy_version 1627132 (0.0005) [2023-12-26 12:40:30,178][123091] Updated weights for policy 0, policy_version 1638046 (0.0008) [2023-12-26 12:40:30,229][123091] Updated weights for policy 0, policy_version 1638056 (0.0007) [2023-12-26 12:40:30,999][123091] Updated weights for policy 0, policy_version 1638066 (0.0009) [2023-12-26 12:40:31,011][123090] Updated weights for policy 1, policy_version 1627142 (0.0009) [2023-12-26 12:40:31,062][123091] Updated weights for policy 0, policy_version 1638076 (0.0008) [2023-12-26 12:40:31,082][123090] Updated weights for policy 1, policy_version 1627152 (0.0008) [2023-12-26 12:40:31,126][123091] Updated weights for policy 0, policy_version 1638086 (0.0009) [2023-12-26 12:40:31,148][123090] Updated weights for policy 1, policy_version 1627162 (0.0008) [2023-12-26 12:40:31,179][123091] Updated weights for policy 0, policy_version 1638096 (0.0009) [2023-12-26 12:40:31,948][123091] Updated weights for policy 0, policy_version 1638106 (0.0006) [2023-12-26 12:40:32,009][123091] Updated weights for policy 0, policy_version 1638116 (0.0010) [2023-12-26 12:40:32,035][123090] Updated weights for policy 1, policy_version 1627172 (0.0008) [2023-12-26 12:40:32,068][123091] Updated weights for policy 0, policy_version 1638126 (0.0007) [2023-12-26 12:40:32,097][123090] Updated weights for policy 1, policy_version 1627182 (0.0009) [2023-12-26 12:40:32,156][123090] Updated weights for policy 1, policy_version 1627192 (0.0009) [2023-12-26 12:40:32,883][123091] Updated weights for policy 0, policy_version 1638136 (0.0009) [2023-12-26 12:40:32,949][123091] Updated weights for policy 0, policy_version 1638146 (0.0007) [2023-12-26 12:40:32,993][123090] Updated weights for policy 1, policy_version 1627202 (0.0009) [2023-12-26 12:40:33,013][123091] Updated weights for policy 0, policy_version 1638156 (0.0008) [2023-12-26 12:40:33,054][123090] Updated weights for policy 1, policy_version 1627212 (0.0008) [2023-12-26 12:40:33,115][123090] Updated weights for policy 1, policy_version 1627222 (0.0009) [2023-12-26 12:40:33,175][123090] Updated weights for policy 1, policy_version 1627232 (0.0009) [2023-12-26 12:40:33,720][123091] Updated weights for policy 0, policy_version 1638166 (0.0009) [2023-12-26 12:40:33,776][123091] Updated weights for policy 0, policy_version 1638176 (0.0009) [2023-12-26 12:40:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17203.3, 300 sec: 17716.9). Total num frames: 835944448. Throughput: 0: 8904.8, 1: 8467.1. Samples: 835961808. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:33,784][121949] Avg episode reward: [(0, '6094.666'), (1, '5413.075')] [2023-12-26 12:40:33,838][123091] Updated weights for policy 0, policy_version 1638186 (0.0009) [2023-12-26 12:40:33,878][123090] Updated weights for policy 1, policy_version 1627242 (0.0009) [2023-12-26 12:40:33,947][123090] Updated weights for policy 1, policy_version 1627252 (0.0009) [2023-12-26 12:40:34,015][123090] Updated weights for policy 1, policy_version 1627262 (0.0010) [2023-12-26 12:40:34,725][123091] Updated weights for policy 0, policy_version 1638196 (0.0008) [2023-12-26 12:40:34,773][123091] Updated weights for policy 0, policy_version 1638206 (0.0009) [2023-12-26 12:40:34,797][123090] Updated weights for policy 1, policy_version 1627272 (0.0009) [2023-12-26 12:40:34,824][123091] Updated weights for policy 0, policy_version 1638216 (0.0009) [2023-12-26 12:40:34,858][123090] Updated weights for policy 1, policy_version 1627282 (0.0009) [2023-12-26 12:40:34,912][123090] Updated weights for policy 1, policy_version 1627292 (0.0007) [2023-12-26 12:40:35,595][123090] Updated weights for policy 1, policy_version 1627302 (0.0005) [2023-12-26 12:40:35,664][123090] Updated weights for policy 1, policy_version 1627312 (0.0006) [2023-12-26 12:40:35,704][123091] Updated weights for policy 0, policy_version 1638226 (0.0008) [2023-12-26 12:40:35,735][123090] Updated weights for policy 1, policy_version 1627322 (0.0005) [2023-12-26 12:40:35,766][123091] Updated weights for policy 0, policy_version 1638236 (0.0009) [2023-12-26 12:40:35,834][123091] Updated weights for policy 0, policy_version 1638246 (0.0010) [2023-12-26 12:40:35,892][123091] Updated weights for policy 0, policy_version 1638256 (0.0012) [2023-12-26 12:40:36,318][123090] Updated weights for policy 1, policy_version 1627332 (0.0007) [2023-12-26 12:40:36,390][123090] Updated weights for policy 1, policy_version 1627342 (0.0009) [2023-12-26 12:40:36,453][123090] Updated weights for policy 1, policy_version 1627352 (0.0006) [2023-12-26 12:40:36,710][123091] Updated weights for policy 0, policy_version 1638266 (0.0009) [2023-12-26 12:40:36,763][123091] Updated weights for policy 0, policy_version 1638276 (0.0009) [2023-12-26 12:40:36,821][123091] Updated weights for policy 0, policy_version 1638286 (0.0006) [2023-12-26 12:40:37,193][123090] Updated weights for policy 1, policy_version 1627362 (0.0006) [2023-12-26 12:40:37,260][123090] Updated weights for policy 1, policy_version 1627372 (0.0007) [2023-12-26 12:40:37,322][123090] Updated weights for policy 1, policy_version 1627382 (0.0007) [2023-12-26 12:40:37,384][123090] Updated weights for policy 1, policy_version 1627392 (0.0008) [2023-12-26 12:40:37,598][123091] Updated weights for policy 0, policy_version 1638296 (0.0009) [2023-12-26 12:40:37,656][123091] Updated weights for policy 0, policy_version 1638306 (0.0010) [2023-12-26 12:40:37,714][123091] Updated weights for policy 0, policy_version 1638316 (0.0009) [2023-12-26 12:40:38,116][123090] Updated weights for policy 1, policy_version 1627402 (0.0008) [2023-12-26 12:40:38,180][123090] Updated weights for policy 1, policy_version 1627412 (0.0006) [2023-12-26 12:40:38,234][123090] Updated weights for policy 1, policy_version 1627422 (0.0006) [2023-12-26 12:40:38,534][123091] Updated weights for policy 0, policy_version 1638326 (0.0007) [2023-12-26 12:40:38,592][123091] Updated weights for policy 0, policy_version 1638336 (0.0005) [2023-12-26 12:40:38,651][123091] Updated weights for policy 0, policy_version 1638346 (0.0010) [2023-12-26 12:40:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 836042752. Throughput: 0: 8905.0, 1: 8544.4. Samples: 836016076. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:38,785][121949] Avg episode reward: [(0, '5908.838'), (1, '5528.949')] [2023-12-26 12:40:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001638352_419422208.pth... [2023-12-26 12:40:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001627424_416620544.pth... [2023-12-26 12:40:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001637296_419151872.pth [2023-12-26 12:40:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001626432_416366592.pth [2023-12-26 12:40:38,914][123090] Updated weights for policy 1, policy_version 1627432 (0.0009) [2023-12-26 12:40:38,979][123090] Updated weights for policy 1, policy_version 1627442 (0.0010) [2023-12-26 12:40:39,051][123090] Updated weights for policy 1, policy_version 1627452 (0.0008) [2023-12-26 12:40:39,406][123091] Updated weights for policy 0, policy_version 1638356 (0.0009) [2023-12-26 12:40:39,479][123091] Updated weights for policy 0, policy_version 1638366 (0.0011) [2023-12-26 12:40:39,543][123091] Updated weights for policy 0, policy_version 1638376 (0.0011) [2023-12-26 12:40:39,758][123090] Updated weights for policy 1, policy_version 1627462 (0.0005) [2023-12-26 12:40:39,816][123090] Updated weights for policy 1, policy_version 1627472 (0.0006) [2023-12-26 12:40:39,884][123090] Updated weights for policy 1, policy_version 1627482 (0.0006) [2023-12-26 12:40:40,363][123091] Updated weights for policy 0, policy_version 1638386 (0.0011) [2023-12-26 12:40:40,427][123091] Updated weights for policy 0, policy_version 1638396 (0.0011) [2023-12-26 12:40:40,480][123091] Updated weights for policy 0, policy_version 1638406 (0.0010) [2023-12-26 12:40:40,531][123091] Updated weights for policy 0, policy_version 1638416 (0.0010) [2023-12-26 12:40:40,705][123090] Updated weights for policy 1, policy_version 1627492 (0.0008) [2023-12-26 12:40:40,757][123090] Updated weights for policy 1, policy_version 1627502 (0.0008) [2023-12-26 12:40:40,809][123090] Updated weights for policy 1, policy_version 1627512 (0.0009) [2023-12-26 12:40:41,381][123091] Updated weights for policy 0, policy_version 1638426 (0.0008) [2023-12-26 12:40:41,449][123091] Updated weights for policy 0, policy_version 1638436 (0.0007) [2023-12-26 12:40:41,514][123091] Updated weights for policy 0, policy_version 1638446 (0.0010) [2023-12-26 12:40:41,647][123090] Updated weights for policy 1, policy_version 1627522 (0.0009) [2023-12-26 12:40:41,716][123090] Updated weights for policy 1, policy_version 1627532 (0.0009) [2023-12-26 12:40:41,792][123090] Updated weights for policy 1, policy_version 1627542 (0.0008) [2023-12-26 12:40:41,858][123090] Updated weights for policy 1, policy_version 1627552 (0.0008) [2023-12-26 12:40:42,401][123091] Updated weights for policy 0, policy_version 1638456 (0.0010) [2023-12-26 12:40:42,452][123091] Updated weights for policy 0, policy_version 1638466 (0.0010) [2023-12-26 12:40:42,505][123091] Updated weights for policy 0, policy_version 1638476 (0.0009) [2023-12-26 12:40:42,677][123090] Updated weights for policy 1, policy_version 1627562 (0.0009) [2023-12-26 12:40:42,738][123090] Updated weights for policy 1, policy_version 1627572 (0.0010) [2023-12-26 12:40:42,790][123090] Updated weights for policy 1, policy_version 1627582 (0.0008) [2023-12-26 12:40:43,344][123091] Updated weights for policy 0, policy_version 1638486 (0.0007) [2023-12-26 12:40:43,396][123091] Updated weights for policy 0, policy_version 1638496 (0.0005) [2023-12-26 12:40:43,455][123091] Updated weights for policy 0, policy_version 1638506 (0.0005) [2023-12-26 12:40:43,635][123090] Updated weights for policy 1, policy_version 1627592 (0.0009) [2023-12-26 12:40:43,686][123090] Updated weights for policy 1, policy_version 1627602 (0.0009) [2023-12-26 12:40:43,746][123090] Updated weights for policy 1, policy_version 1627612 (0.0009) [2023-12-26 12:40:43,784][121949] Fps is (10 sec: 18841.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 836132864. Throughput: 0: 8906.3, 1: 8543.4. Samples: 836122320. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:43,785][121949] Avg episode reward: [(0, '5983.538'), (1, '5693.082')] [2023-12-26 12:40:44,047][123091] Updated weights for policy 0, policy_version 1638516 (0.0006) [2023-12-26 12:40:44,100][123091] Updated weights for policy 0, policy_version 1638526 (0.0007) [2023-12-26 12:40:44,170][123091] Updated weights for policy 0, policy_version 1638536 (0.0007) [2023-12-26 12:40:44,605][123090] Updated weights for policy 1, policy_version 1627622 (0.0010) [2023-12-26 12:40:44,667][123090] Updated weights for policy 1, policy_version 1627632 (0.0009) [2023-12-26 12:40:44,718][123090] Updated weights for policy 1, policy_version 1627643 (0.0010) [2023-12-26 12:40:44,998][123091] Updated weights for policy 0, policy_version 1638546 (0.0009) [2023-12-26 12:40:45,057][123091] Updated weights for policy 0, policy_version 1638556 (0.0006) [2023-12-26 12:40:45,120][123091] Updated weights for policy 0, policy_version 1638566 (0.0006) [2023-12-26 12:40:45,183][123091] Updated weights for policy 0, policy_version 1638576 (0.0008) [2023-12-26 12:40:45,605][123090] Updated weights for policy 1, policy_version 1627653 (0.0009) [2023-12-26 12:40:45,675][123090] Updated weights for policy 1, policy_version 1627663 (0.0009) [2023-12-26 12:40:45,736][123090] Updated weights for policy 1, policy_version 1627673 (0.0008) [2023-12-26 12:40:46,009][123091] Updated weights for policy 0, policy_version 1638586 (0.0006) [2023-12-26 12:40:46,078][123091] Updated weights for policy 0, policy_version 1638596 (0.0005) [2023-12-26 12:40:46,148][123091] Updated weights for policy 0, policy_version 1638606 (0.0008) [2023-12-26 12:40:46,568][123090] Updated weights for policy 1, policy_version 1627683 (0.0010) [2023-12-26 12:40:46,622][123090] Updated weights for policy 1, policy_version 1627693 (0.0008) [2023-12-26 12:40:46,678][123090] Updated weights for policy 1, policy_version 1627703 (0.0008) [2023-12-26 12:40:46,891][123091] Updated weights for policy 0, policy_version 1638616 (0.0009) [2023-12-26 12:40:46,951][123091] Updated weights for policy 0, policy_version 1638626 (0.0009) [2023-12-26 12:40:47,005][123091] Updated weights for policy 0, policy_version 1638636 (0.0009) [2023-12-26 12:40:47,368][123090] Updated weights for policy 1, policy_version 1627713 (0.0010) [2023-12-26 12:40:47,429][123090] Updated weights for policy 1, policy_version 1627723 (0.0007) [2023-12-26 12:40:47,499][123090] Updated weights for policy 1, policy_version 1627733 (0.0005) [2023-12-26 12:40:47,571][123090] Updated weights for policy 1, policy_version 1627743 (0.0005) [2023-12-26 12:40:47,857][123091] Updated weights for policy 0, policy_version 1638646 (0.0010) [2023-12-26 12:40:47,904][123091] Updated weights for policy 0, policy_version 1638656 (0.0010) [2023-12-26 12:40:47,955][123091] Updated weights for policy 0, policy_version 1638666 (0.0010) [2023-12-26 12:40:48,261][123090] Updated weights for policy 1, policy_version 1627753 (0.0005) [2023-12-26 12:40:48,324][123090] Updated weights for policy 1, policy_version 1627763 (0.0006) [2023-12-26 12:40:48,395][123090] Updated weights for policy 1, policy_version 1627773 (0.0010) [2023-12-26 12:40:48,709][123091] Updated weights for policy 0, policy_version 1638676 (0.0008) [2023-12-26 12:40:48,761][123091] Updated weights for policy 0, policy_version 1638686 (0.0006) [2023-12-26 12:40:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 836214784. Throughput: 0: 8934.5, 1: 8560.1. Samples: 836228764. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:48,785][121949] Avg episode reward: [(0, '6156.273'), (1, '5700.912')] [2023-12-26 12:40:48,807][123091] Updated weights for policy 0, policy_version 1638696 (0.0005) [2023-12-26 12:40:49,150][123090] Updated weights for policy 1, policy_version 1627783 (0.0009) [2023-12-26 12:40:49,221][123090] Updated weights for policy 1, policy_version 1627793 (0.0007) [2023-12-26 12:40:49,287][123090] Updated weights for policy 1, policy_version 1627803 (0.0010) [2023-12-26 12:40:49,547][123091] Updated weights for policy 0, policy_version 1638706 (0.0007) [2023-12-26 12:40:49,613][123091] Updated weights for policy 0, policy_version 1638716 (0.0009) [2023-12-26 12:40:49,676][123091] Updated weights for policy 0, policy_version 1638726 (0.0011) [2023-12-26 12:40:49,743][123091] Updated weights for policy 0, policy_version 1638736 (0.0011) [2023-12-26 12:40:50,011][123090] Updated weights for policy 1, policy_version 1627813 (0.0009) [2023-12-26 12:40:50,083][123090] Updated weights for policy 1, policy_version 1627823 (0.0008) [2023-12-26 12:40:50,157][123090] Updated weights for policy 1, policy_version 1627833 (0.0006) [2023-12-26 12:40:50,492][123091] Updated weights for policy 0, policy_version 1638746 (0.0010) [2023-12-26 12:40:50,565][123091] Updated weights for policy 0, policy_version 1638756 (0.0011) [2023-12-26 12:40:50,639][123091] Updated weights for policy 0, policy_version 1638766 (0.0011) [2023-12-26 12:40:50,883][123090] Updated weights for policy 1, policy_version 1627843 (0.0006) [2023-12-26 12:40:50,954][123090] Updated weights for policy 1, policy_version 1627853 (0.0006) [2023-12-26 12:40:51,025][123090] Updated weights for policy 1, policy_version 1627863 (0.0006) [2023-12-26 12:40:51,475][123091] Updated weights for policy 0, policy_version 1638776 (0.0011) [2023-12-26 12:40:51,545][123091] Updated weights for policy 0, policy_version 1638786 (0.0011) [2023-12-26 12:40:51,613][123091] Updated weights for policy 0, policy_version 1638796 (0.0011) [2023-12-26 12:40:51,807][123090] Updated weights for policy 1, policy_version 1627873 (0.0007) [2023-12-26 12:40:51,872][123090] Updated weights for policy 1, policy_version 1627883 (0.0008) [2023-12-26 12:40:51,934][123090] Updated weights for policy 1, policy_version 1627893 (0.0008) [2023-12-26 12:40:52,007][123090] Updated weights for policy 1, policy_version 1627903 (0.0008) [2023-12-26 12:40:52,413][123091] Updated weights for policy 0, policy_version 1638806 (0.0010) [2023-12-26 12:40:52,481][123091] Updated weights for policy 0, policy_version 1638816 (0.0009) [2023-12-26 12:40:52,546][123091] Updated weights for policy 0, policy_version 1638826 (0.0010) [2023-12-26 12:40:52,769][123090] Updated weights for policy 1, policy_version 1627913 (0.0008) [2023-12-26 12:40:52,838][123090] Updated weights for policy 1, policy_version 1627923 (0.0008) [2023-12-26 12:40:52,903][123090] Updated weights for policy 1, policy_version 1627933 (0.0008) [2023-12-26 12:40:53,401][123091] Updated weights for policy 0, policy_version 1638836 (0.0009) [2023-12-26 12:40:53,457][123091] Updated weights for policy 0, policy_version 1638846 (0.0010) [2023-12-26 12:40:53,511][123091] Updated weights for policy 0, policy_version 1638856 (0.0010) [2023-12-26 12:40:53,576][123090] Updated weights for policy 1, policy_version 1627943 (0.0009) [2023-12-26 12:40:53,631][123090] Updated weights for policy 1, policy_version 1627953 (0.0008) [2023-12-26 12:40:53,678][123090] Updated weights for policy 1, policy_version 1627963 (0.0009) [2023-12-26 12:40:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 836313088. Throughput: 0: 8911.6, 1: 8619.5. Samples: 836283256. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:53,785][121949] Avg episode reward: [(0, '5996.295'), (1, '5806.286')] [2023-12-26 12:40:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001638864_419553280.pth... [2023-12-26 12:40:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001627968_416759808.pth... [2023-12-26 12:40:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001626912_416489472.pth [2023-12-26 12:40:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001637840_419291136.pth [2023-12-26 12:40:54,232][123091] Updated weights for policy 0, policy_version 1638866 (0.0008) [2023-12-26 12:40:54,288][123091] Updated weights for policy 0, policy_version 1638876 (0.0009) [2023-12-26 12:40:54,353][123091] Updated weights for policy 0, policy_version 1638886 (0.0005) [2023-12-26 12:40:54,410][123091] Updated weights for policy 0, policy_version 1638896 (0.0005) [2023-12-26 12:40:54,542][123090] Updated weights for policy 1, policy_version 1627973 (0.0007) [2023-12-26 12:40:54,613][123090] Updated weights for policy 1, policy_version 1627983 (0.0009) [2023-12-26 12:40:54,683][123090] Updated weights for policy 1, policy_version 1627993 (0.0010) [2023-12-26 12:40:55,027][123091] Updated weights for policy 0, policy_version 1638906 (0.0006) [2023-12-26 12:40:55,072][123091] Updated weights for policy 0, policy_version 1638916 (0.0005) [2023-12-26 12:40:55,128][123091] Updated weights for policy 0, policy_version 1638926 (0.0005) [2023-12-26 12:40:55,453][123090] Updated weights for policy 1, policy_version 1628003 (0.0010) [2023-12-26 12:40:55,521][123090] Updated weights for policy 1, policy_version 1628013 (0.0009) [2023-12-26 12:40:55,585][123090] Updated weights for policy 1, policy_version 1628023 (0.0009) [2023-12-26 12:40:55,923][123091] Updated weights for policy 0, policy_version 1638936 (0.0005) [2023-12-26 12:40:55,988][123091] Updated weights for policy 0, policy_version 1638947 (0.0009) [2023-12-26 12:40:56,045][123091] Updated weights for policy 0, policy_version 1638957 (0.0009) [2023-12-26 12:40:56,423][123090] Updated weights for policy 1, policy_version 1628033 (0.0009) [2023-12-26 12:40:56,493][123090] Updated weights for policy 1, policy_version 1628043 (0.0009) [2023-12-26 12:40:56,563][123090] Updated weights for policy 1, policy_version 1628053 (0.0009) [2023-12-26 12:40:56,628][123090] Updated weights for policy 1, policy_version 1628063 (0.0010) [2023-12-26 12:40:56,877][123091] Updated weights for policy 0, policy_version 1638967 (0.0009) [2023-12-26 12:40:56,942][123091] Updated weights for policy 0, policy_version 1638977 (0.0005) [2023-12-26 12:40:56,987][123091] Updated weights for policy 0, policy_version 1638987 (0.0005) [2023-12-26 12:40:57,455][123090] Updated weights for policy 1, policy_version 1628073 (0.0006) [2023-12-26 12:40:57,505][123090] Updated weights for policy 1, policy_version 1628083 (0.0005) [2023-12-26 12:40:57,562][123090] Updated weights for policy 1, policy_version 1628093 (0.0005) [2023-12-26 12:40:57,692][123091] Updated weights for policy 0, policy_version 1638997 (0.0007) [2023-12-26 12:40:57,745][123091] Updated weights for policy 0, policy_version 1639007 (0.0011) [2023-12-26 12:40:57,801][123091] Updated weights for policy 0, policy_version 1639017 (0.0007) [2023-12-26 12:40:58,347][123090] Updated weights for policy 1, policy_version 1628103 (0.0008) [2023-12-26 12:40:58,411][123090] Updated weights for policy 1, policy_version 1628113 (0.0009) [2023-12-26 12:40:58,473][123090] Updated weights for policy 1, policy_version 1628123 (0.0010) [2023-12-26 12:40:58,640][123091] Updated weights for policy 0, policy_version 1639027 (0.0007) [2023-12-26 12:40:58,716][123091] Updated weights for policy 0, policy_version 1639037 (0.0010) [2023-12-26 12:40:58,776][123091] Updated weights for policy 0, policy_version 1639047 (0.0010) [2023-12-26 12:40:58,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17476.1, 300 sec: 17689.1). Total num frames: 836395008. Throughput: 0: 8946.6, 1: 8700.7. Samples: 836391416. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:40:58,785][121949] Avg episode reward: [(0, '5857.643'), (1, '5854.891')] [2023-12-26 12:40:59,379][123090] Updated weights for policy 1, policy_version 1628133 (0.0009) [2023-12-26 12:40:59,436][123090] Updated weights for policy 1, policy_version 1628143 (0.0009) [2023-12-26 12:40:59,496][123090] Updated weights for policy 1, policy_version 1628153 (0.0009) [2023-12-26 12:40:59,660][123091] Updated weights for policy 0, policy_version 1639057 (0.0009) [2023-12-26 12:40:59,717][123091] Updated weights for policy 0, policy_version 1639067 (0.0010) [2023-12-26 12:40:59,790][123091] Updated weights for policy 0, policy_version 1639077 (0.0011) [2023-12-26 12:40:59,859][123091] Updated weights for policy 0, policy_version 1639087 (0.0010) [2023-12-26 12:41:00,312][123090] Updated weights for policy 1, policy_version 1628163 (0.0009) [2023-12-26 12:41:00,371][123090] Updated weights for policy 1, policy_version 1628173 (0.0011) [2023-12-26 12:41:00,429][123090] Updated weights for policy 1, policy_version 1628183 (0.0010) [2023-12-26 12:41:00,681][123091] Updated weights for policy 0, policy_version 1639097 (0.0009) [2023-12-26 12:41:00,733][123091] Updated weights for policy 0, policy_version 1639107 (0.0009) [2023-12-26 12:41:00,786][123091] Updated weights for policy 0, policy_version 1639117 (0.0009) [2023-12-26 12:41:01,288][123090] Updated weights for policy 1, policy_version 1628193 (0.0010) [2023-12-26 12:41:01,343][123090] Updated weights for policy 1, policy_version 1628203 (0.0011) [2023-12-26 12:41:01,412][123090] Updated weights for policy 1, policy_version 1628213 (0.0010) [2023-12-26 12:41:01,478][123090] Updated weights for policy 1, policy_version 1628223 (0.0011) [2023-12-26 12:41:01,672][123091] Updated weights for policy 0, policy_version 1639127 (0.0009) [2023-12-26 12:41:01,744][123091] Updated weights for policy 0, policy_version 1639137 (0.0007) [2023-12-26 12:41:01,799][123091] Updated weights for policy 0, policy_version 1639147 (0.0008) [2023-12-26 12:41:02,276][123090] Updated weights for policy 1, policy_version 1628233 (0.0007) [2023-12-26 12:41:02,353][123090] Updated weights for policy 1, policy_version 1628243 (0.0008) [2023-12-26 12:41:02,423][123090] Updated weights for policy 1, policy_version 1628253 (0.0006) [2023-12-26 12:41:02,603][123091] Updated weights for policy 0, policy_version 1639157 (0.0009) [2023-12-26 12:41:02,661][123091] Updated weights for policy 0, policy_version 1639167 (0.0006) [2023-12-26 12:41:02,723][123091] Updated weights for policy 0, policy_version 1639177 (0.0007) [2023-12-26 12:41:03,177][123090] Updated weights for policy 1, policy_version 1628263 (0.0008) [2023-12-26 12:41:03,227][123090] Updated weights for policy 1, policy_version 1628273 (0.0010) [2023-12-26 12:41:03,281][123090] Updated weights for policy 1, policy_version 1628284 (0.0010) [2023-12-26 12:41:03,412][123091] Updated weights for policy 0, policy_version 1639187 (0.0010) [2023-12-26 12:41:03,465][123091] Updated weights for policy 0, policy_version 1639197 (0.0009) [2023-12-26 12:41:03,514][123091] Updated weights for policy 0, policy_version 1639207 (0.0009) [2023-12-26 12:41:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 836485120. Throughput: 0: 8795.7, 1: 8765.5. Samples: 836493688. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:03,785][121949] Avg episode reward: [(0, '5920.953'), (1, '5767.140')] [2023-12-26 12:41:04,206][123090] Updated weights for policy 1, policy_version 1628294 (0.0010) [2023-12-26 12:41:04,278][123090] Updated weights for policy 1, policy_version 1628304 (0.0009) [2023-12-26 12:41:04,311][123091] Updated weights for policy 0, policy_version 1639217 (0.0009) [2023-12-26 12:41:04,344][123090] Updated weights for policy 1, policy_version 1628314 (0.0008) [2023-12-26 12:41:04,375][123091] Updated weights for policy 0, policy_version 1639227 (0.0010) [2023-12-26 12:41:04,437][123091] Updated weights for policy 0, policy_version 1639237 (0.0009) [2023-12-26 12:41:04,491][123091] Updated weights for policy 0, policy_version 1639247 (0.0010) [2023-12-26 12:41:05,171][123090] Updated weights for policy 1, policy_version 1628324 (0.0008) [2023-12-26 12:41:05,228][123090] Updated weights for policy 1, policy_version 1628334 (0.0008) [2023-12-26 12:41:05,276][123090] Updated weights for policy 1, policy_version 1628344 (0.0009) [2023-12-26 12:41:05,287][123091] Updated weights for policy 0, policy_version 1639257 (0.0008) [2023-12-26 12:41:05,340][123091] Updated weights for policy 0, policy_version 1639267 (0.0008) [2023-12-26 12:41:05,395][123091] Updated weights for policy 0, policy_version 1639277 (0.0009) [2023-12-26 12:41:06,089][123090] Updated weights for policy 1, policy_version 1628354 (0.0009) [2023-12-26 12:41:06,160][123090] Updated weights for policy 1, policy_version 1628364 (0.0010) [2023-12-26 12:41:06,213][123090] Updated weights for policy 1, policy_version 1628374 (0.0011) [2023-12-26 12:41:06,259][123091] Updated weights for policy 0, policy_version 1639287 (0.0007) [2023-12-26 12:41:06,277][123090] Updated weights for policy 1, policy_version 1628384 (0.0011) [2023-12-26 12:41:06,314][123091] Updated weights for policy 0, policy_version 1639297 (0.0008) [2023-12-26 12:41:06,379][123091] Updated weights for policy 0, policy_version 1639307 (0.0009) [2023-12-26 12:41:07,123][123091] Updated weights for policy 0, policy_version 1639317 (0.0008) [2023-12-26 12:41:07,138][123090] Updated weights for policy 1, policy_version 1628394 (0.0011) [2023-12-26 12:41:07,176][123091] Updated weights for policy 0, policy_version 1639327 (0.0007) [2023-12-26 12:41:07,198][123090] Updated weights for policy 1, policy_version 1628404 (0.0011) [2023-12-26 12:41:07,228][123091] Updated weights for policy 0, policy_version 1639337 (0.0007) [2023-12-26 12:41:07,254][123090] Updated weights for policy 1, policy_version 1628414 (0.0010) [2023-12-26 12:41:08,067][123091] Updated weights for policy 0, policy_version 1639347 (0.0008) [2023-12-26 12:41:08,097][123090] Updated weights for policy 1, policy_version 1628424 (0.0009) [2023-12-26 12:41:08,113][123091] Updated weights for policy 0, policy_version 1639357 (0.0007) [2023-12-26 12:41:08,163][123090] Updated weights for policy 1, policy_version 1628434 (0.0010) [2023-12-26 12:41:08,166][123091] Updated weights for policy 0, policy_version 1639367 (0.0008) [2023-12-26 12:41:08,227][123090] Updated weights for policy 1, policy_version 1628444 (0.0009) [2023-12-26 12:41:08,784][121949] Fps is (10 sec: 17204.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 836567040. Throughput: 0: 8817.0, 1: 8757.7. Samples: 836545232. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:08,785][121949] Avg episode reward: [(0, '5847.274'), (1, '5930.342')] [2023-12-26 12:41:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001639376_419684352.pth... [2023-12-26 12:41:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001628448_416882688.pth... [2023-12-26 12:41:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001638352_419422208.pth [2023-12-26 12:41:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001627424_416620544.pth [2023-12-26 12:41:08,985][123091] Updated weights for policy 0, policy_version 1639377 (0.0009) [2023-12-26 12:41:09,032][123090] Updated weights for policy 1, policy_version 1628454 (0.0010) [2023-12-26 12:41:09,047][123091] Updated weights for policy 0, policy_version 1639387 (0.0009) [2023-12-26 12:41:09,092][123090] Updated weights for policy 1, policy_version 1628464 (0.0010) [2023-12-26 12:41:09,111][123091] Updated weights for policy 0, policy_version 1639397 (0.0007) [2023-12-26 12:41:09,151][123090] Updated weights for policy 1, policy_version 1628474 (0.0010) [2023-12-26 12:41:09,178][123091] Updated weights for policy 0, policy_version 1639407 (0.0006) [2023-12-26 12:41:09,986][123090] Updated weights for policy 1, policy_version 1628484 (0.0010) [2023-12-26 12:41:09,988][123091] Updated weights for policy 0, policy_version 1639417 (0.0008) [2023-12-26 12:41:10,047][123091] Updated weights for policy 0, policy_version 1639427 (0.0006) [2023-12-26 12:41:10,049][123090] Updated weights for policy 1, policy_version 1628494 (0.0010) [2023-12-26 12:41:10,105][123090] Updated weights for policy 1, policy_version 1628504 (0.0008) [2023-12-26 12:41:10,107][123091] Updated weights for policy 0, policy_version 1639437 (0.0008) [2023-12-26 12:41:10,945][123090] Updated weights for policy 1, policy_version 1628514 (0.0010) [2023-12-26 12:41:10,987][123091] Updated weights for policy 0, policy_version 1639447 (0.0008) [2023-12-26 12:41:11,003][123090] Updated weights for policy 1, policy_version 1628524 (0.0008) [2023-12-26 12:41:11,051][123091] Updated weights for policy 0, policy_version 1639457 (0.0007) [2023-12-26 12:41:11,065][123090] Updated weights for policy 1, policy_version 1628534 (0.0010) [2023-12-26 12:41:11,131][123091] Updated weights for policy 0, policy_version 1639467 (0.0008) [2023-12-26 12:41:11,133][123090] Updated weights for policy 1, policy_version 1628544 (0.0010) [2023-12-26 12:41:11,933][123090] Updated weights for policy 1, policy_version 1628554 (0.0010) [2023-12-26 12:41:11,988][123091] Updated weights for policy 0, policy_version 1639477 (0.0009) [2023-12-26 12:41:11,996][123090] Updated weights for policy 1, policy_version 1628564 (0.0009) [2023-12-26 12:41:12,043][123091] Updated weights for policy 0, policy_version 1639487 (0.0008) [2023-12-26 12:41:12,048][123090] Updated weights for policy 1, policy_version 1628574 (0.0006) [2023-12-26 12:41:12,095][123091] Updated weights for policy 0, policy_version 1639497 (0.0010) [2023-12-26 12:41:12,769][123090] Updated weights for policy 1, policy_version 1628584 (0.0009) [2023-12-26 12:41:12,833][123090] Updated weights for policy 1, policy_version 1628594 (0.0011) [2023-12-26 12:41:12,900][123090] Updated weights for policy 1, policy_version 1628604 (0.0010) [2023-12-26 12:41:12,993][123091] Updated weights for policy 0, policy_version 1639508 (0.0010) [2023-12-26 12:41:13,049][123091] Updated weights for policy 0, policy_version 1639518 (0.0009) [2023-12-26 12:41:13,108][123091] Updated weights for policy 0, policy_version 1639528 (0.0009) [2023-12-26 12:41:13,703][123090] Updated weights for policy 1, policy_version 1628614 (0.0007) [2023-12-26 12:41:13,770][123090] Updated weights for policy 1, policy_version 1628624 (0.0007) [2023-12-26 12:41:13,773][123091] Updated weights for policy 0, policy_version 1639538 (0.0010) [2023-12-26 12:41:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 836648960. Throughput: 0: 8766.9, 1: 8797.2. Samples: 836647892. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:13,784][121949] Avg episode reward: [(0, '5850.216'), (1, '5735.365')] [2023-12-26 12:41:13,821][123090] Updated weights for policy 1, policy_version 1628634 (0.0007) [2023-12-26 12:41:13,836][123091] Updated weights for policy 0, policy_version 1639548 (0.0011) [2023-12-26 12:41:13,909][123091] Updated weights for policy 0, policy_version 1639558 (0.0011) [2023-12-26 12:41:13,986][123091] Updated weights for policy 0, policy_version 1639568 (0.0010) [2023-12-26 12:41:14,430][123090] Updated weights for policy 1, policy_version 1628644 (0.0005) [2023-12-26 12:41:14,487][123090] Updated weights for policy 1, policy_version 1628654 (0.0005) [2023-12-26 12:41:14,549][123090] Updated weights for policy 1, policy_version 1628664 (0.0006) [2023-12-26 12:41:14,678][123091] Updated weights for policy 0, policy_version 1639578 (0.0010) [2023-12-26 12:41:14,735][123091] Updated weights for policy 0, policy_version 1639588 (0.0008) [2023-12-26 12:41:14,793][123091] Updated weights for policy 0, policy_version 1639598 (0.0009) [2023-12-26 12:41:15,316][123090] Updated weights for policy 1, policy_version 1628674 (0.0006) [2023-12-26 12:41:15,378][123090] Updated weights for policy 1, policy_version 1628684 (0.0008) [2023-12-26 12:41:15,443][123090] Updated weights for policy 1, policy_version 1628694 (0.0008) [2023-12-26 12:41:15,506][123090] Updated weights for policy 1, policy_version 1628704 (0.0010) [2023-12-26 12:41:15,646][123091] Updated weights for policy 0, policy_version 1639608 (0.0006) [2023-12-26 12:41:15,719][123091] Updated weights for policy 0, policy_version 1639618 (0.0006) [2023-12-26 12:41:15,790][123091] Updated weights for policy 0, policy_version 1639628 (0.0006) [2023-12-26 12:41:16,270][123090] Updated weights for policy 1, policy_version 1628714 (0.0005) [2023-12-26 12:41:16,337][123090] Updated weights for policy 1, policy_version 1628724 (0.0005) [2023-12-26 12:41:16,406][123090] Updated weights for policy 1, policy_version 1628734 (0.0007) [2023-12-26 12:41:16,488][123091] Updated weights for policy 0, policy_version 1639638 (0.0006) [2023-12-26 12:41:16,561][123091] Updated weights for policy 0, policy_version 1639648 (0.0006) [2023-12-26 12:41:16,636][123091] Updated weights for policy 0, policy_version 1639658 (0.0006) [2023-12-26 12:41:17,175][123090] Updated weights for policy 1, policy_version 1628744 (0.0006) [2023-12-26 12:41:17,245][123090] Updated weights for policy 1, policy_version 1628754 (0.0005) [2023-12-26 12:41:17,306][123090] Updated weights for policy 1, policy_version 1628764 (0.0006) [2023-12-26 12:41:17,357][123091] Updated weights for policy 0, policy_version 1639668 (0.0008) [2023-12-26 12:41:17,420][123091] Updated weights for policy 0, policy_version 1639678 (0.0011) [2023-12-26 12:41:17,475][123091] Updated weights for policy 0, policy_version 1639688 (0.0011) [2023-12-26 12:41:18,000][123090] Updated weights for policy 1, policy_version 1628774 (0.0006) [2023-12-26 12:41:18,052][123090] Updated weights for policy 1, policy_version 1628784 (0.0005) [2023-12-26 12:41:18,098][123090] Updated weights for policy 1, policy_version 1628794 (0.0008) [2023-12-26 12:41:18,295][123091] Updated weights for policy 0, policy_version 1639698 (0.0011) [2023-12-26 12:41:18,360][123091] Updated weights for policy 0, policy_version 1639708 (0.0010) [2023-12-26 12:41:18,422][123091] Updated weights for policy 0, policy_version 1639718 (0.0007) [2023-12-26 12:41:18,495][123091] Updated weights for policy 0, policy_version 1639728 (0.0011) [2023-12-26 12:41:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 836747264. Throughput: 0: 8797.1, 1: 8912.2. Samples: 836758732. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:18,785][121949] Avg episode reward: [(0, '6021.326'), (1, '5712.106')] [2023-12-26 12:41:18,943][123090] Updated weights for policy 1, policy_version 1628804 (0.0010) [2023-12-26 12:41:18,995][123090] Updated weights for policy 1, policy_version 1628814 (0.0010) [2023-12-26 12:41:19,042][123090] Updated weights for policy 1, policy_version 1628824 (0.0006) [2023-12-26 12:41:19,335][123091] Updated weights for policy 0, policy_version 1639738 (0.0011) [2023-12-26 12:41:19,401][123091] Updated weights for policy 0, policy_version 1639748 (0.0009) [2023-12-26 12:41:19,468][123091] Updated weights for policy 0, policy_version 1639758 (0.0007) [2023-12-26 12:41:19,872][123090] Updated weights for policy 1, policy_version 1628834 (0.0006) [2023-12-26 12:41:19,926][123090] Updated weights for policy 1, policy_version 1628844 (0.0009) [2023-12-26 12:41:20,000][123090] Updated weights for policy 1, policy_version 1628854 (0.0009) [2023-12-26 12:41:20,066][123090] Updated weights for policy 1, policy_version 1628864 (0.0009) [2023-12-26 12:41:20,303][123091] Updated weights for policy 0, policy_version 1639768 (0.0007) [2023-12-26 12:41:20,374][123091] Updated weights for policy 0, policy_version 1639778 (0.0006) [2023-12-26 12:41:20,442][123091] Updated weights for policy 0, policy_version 1639788 (0.0008) [2023-12-26 12:41:20,955][123090] Updated weights for policy 1, policy_version 1628874 (0.0009) [2023-12-26 12:41:21,026][123090] Updated weights for policy 1, policy_version 1628884 (0.0009) [2023-12-26 12:41:21,099][123090] Updated weights for policy 1, policy_version 1628894 (0.0009) [2023-12-26 12:41:21,146][123091] Updated weights for policy 0, policy_version 1639798 (0.0010) [2023-12-26 12:41:21,200][123091] Updated weights for policy 0, policy_version 1639808 (0.0010) [2023-12-26 12:41:21,260][123091] Updated weights for policy 0, policy_version 1639819 (0.0010) [2023-12-26 12:41:21,934][123090] Updated weights for policy 1, policy_version 1628904 (0.0008) [2023-12-26 12:41:22,003][123090] Updated weights for policy 1, policy_version 1628914 (0.0008) [2023-12-26 12:41:22,052][123090] Updated weights for policy 1, policy_version 1628924 (0.0009) [2023-12-26 12:41:22,124][123091] Updated weights for policy 0, policy_version 1639829 (0.0009) [2023-12-26 12:41:22,185][123091] Updated weights for policy 0, policy_version 1639839 (0.0009) [2023-12-26 12:41:22,249][123091] Updated weights for policy 0, policy_version 1639849 (0.0009) [2023-12-26 12:41:22,806][123090] Updated weights for policy 1, policy_version 1628934 (0.0011) [2023-12-26 12:41:22,870][123090] Updated weights for policy 1, policy_version 1628944 (0.0010) [2023-12-26 12:41:22,931][123090] Updated weights for policy 1, policy_version 1628954 (0.0010) [2023-12-26 12:41:23,113][123091] Updated weights for policy 0, policy_version 1639859 (0.0009) [2023-12-26 12:41:23,170][123091] Updated weights for policy 0, policy_version 1639869 (0.0009) [2023-12-26 12:41:23,235][123091] Updated weights for policy 0, policy_version 1639879 (0.0010) [2023-12-26 12:41:23,711][123090] Updated weights for policy 1, policy_version 1628964 (0.0009) [2023-12-26 12:41:23,782][123090] Updated weights for policy 1, policy_version 1628974 (0.0011) [2023-12-26 12:41:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 836829184. Throughput: 0: 8812.0, 1: 8823.6. Samples: 836809676. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:23,784][121949] Avg episode reward: [(0, '6096.072'), (1, '5897.597')] [2023-12-26 12:41:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001639888_419815424.pth... [2023-12-26 12:41:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001638864_419553280.pth [2023-12-26 12:41:23,853][123090] Updated weights for policy 1, policy_version 1628984 (0.0010) [2023-12-26 12:41:23,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001628992_417021952.pth... [2023-12-26 12:41:23,900][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001627968_416759808.pth [2023-12-26 12:41:23,992][123091] Updated weights for policy 0, policy_version 1639889 (0.0011) [2023-12-26 12:41:24,055][123091] Updated weights for policy 0, policy_version 1639899 (0.0009) [2023-12-26 12:41:24,108][123091] Updated weights for policy 0, policy_version 1639909 (0.0009) [2023-12-26 12:41:24,164][123091] Updated weights for policy 0, policy_version 1639919 (0.0010) [2023-12-26 12:41:24,561][123090] Updated weights for policy 1, policy_version 1628994 (0.0010) [2023-12-26 12:41:24,618][123090] Updated weights for policy 1, policy_version 1629004 (0.0009) [2023-12-26 12:41:24,669][123090] Updated weights for policy 1, policy_version 1629014 (0.0010) [2023-12-26 12:41:24,724][123090] Updated weights for policy 1, policy_version 1629024 (0.0010) [2023-12-26 12:41:24,944][123091] Updated weights for policy 0, policy_version 1639929 (0.0009) [2023-12-26 12:41:24,991][123091] Updated weights for policy 0, policy_version 1639939 (0.0009) [2023-12-26 12:41:25,048][123091] Updated weights for policy 0, policy_version 1639949 (0.0008) [2023-12-26 12:41:25,481][123090] Updated weights for policy 1, policy_version 1629034 (0.0005) [2023-12-26 12:41:25,542][123090] Updated weights for policy 1, policy_version 1629044 (0.0007) [2023-12-26 12:41:25,603][123090] Updated weights for policy 1, policy_version 1629054 (0.0010) [2023-12-26 12:41:25,938][123091] Updated weights for policy 0, policy_version 1639959 (0.0009) [2023-12-26 12:41:26,009][123091] Updated weights for policy 0, policy_version 1639969 (0.0009) [2023-12-26 12:41:26,070][123091] Updated weights for policy 0, policy_version 1639979 (0.0009) [2023-12-26 12:41:26,320][123090] Updated weights for policy 1, policy_version 1629064 (0.0010) [2023-12-26 12:41:26,371][123090] Updated weights for policy 1, policy_version 1629074 (0.0010) [2023-12-26 12:41:26,422][123090] Updated weights for policy 1, policy_version 1629084 (0.0010) [2023-12-26 12:41:26,870][123091] Updated weights for policy 0, policy_version 1639989 (0.0008) [2023-12-26 12:41:26,931][123091] Updated weights for policy 0, policy_version 1639999 (0.0009) [2023-12-26 12:41:26,983][123091] Updated weights for policy 0, policy_version 1640009 (0.0009) [2023-12-26 12:41:27,241][123090] Updated weights for policy 1, policy_version 1629094 (0.0008) [2023-12-26 12:41:27,298][123090] Updated weights for policy 1, policy_version 1629104 (0.0007) [2023-12-26 12:41:27,365][123090] Updated weights for policy 1, policy_version 1629114 (0.0005) [2023-12-26 12:41:27,904][123091] Updated weights for policy 0, policy_version 1640019 (0.0009) [2023-12-26 12:41:27,973][123091] Updated weights for policy 0, policy_version 1640030 (0.0010) [2023-12-26 12:41:27,982][123090] Updated weights for policy 1, policy_version 1629124 (0.0005) [2023-12-26 12:41:28,022][123091] Updated weights for policy 0, policy_version 1640040 (0.0009) [2023-12-26 12:41:28,037][123090] Updated weights for policy 1, policy_version 1629134 (0.0005) [2023-12-26 12:41:28,119][123090] Updated weights for policy 1, policy_version 1629144 (0.0006) [2023-12-26 12:41:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 836919296. Throughput: 0: 8817.1, 1: 8824.7. Samples: 836916196. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:28,785][121949] Avg episode reward: [(0, '5975.816'), (1, '6023.706')] [2023-12-26 12:41:28,803][123090] Updated weights for policy 1, policy_version 1629154 (0.0007) [2023-12-26 12:41:28,858][123090] Updated weights for policy 1, policy_version 1629164 (0.0010) [2023-12-26 12:41:28,911][123091] Updated weights for policy 0, policy_version 1640051 (0.0009) [2023-12-26 12:41:28,912][123090] Updated weights for policy 1, policy_version 1629174 (0.0010) [2023-12-26 12:41:28,970][123090] Updated weights for policy 1, policy_version 1629184 (0.0010) [2023-12-26 12:41:28,974][123091] Updated weights for policy 0, policy_version 1640061 (0.0007) [2023-12-26 12:41:29,023][123091] Updated weights for policy 0, policy_version 1640071 (0.0009) [2023-12-26 12:41:29,822][123090] Updated weights for policy 1, policy_version 1629194 (0.0008) [2023-12-26 12:41:29,892][123090] Updated weights for policy 1, policy_version 1629204 (0.0008) [2023-12-26 12:41:29,907][123091] Updated weights for policy 0, policy_version 1640081 (0.0009) [2023-12-26 12:41:29,963][123090] Updated weights for policy 1, policy_version 1629214 (0.0008) [2023-12-26 12:41:29,976][123091] Updated weights for policy 0, policy_version 1640091 (0.0008) [2023-12-26 12:41:30,032][123091] Updated weights for policy 0, policy_version 1640102 (0.0009) [2023-12-26 12:41:30,084][123091] Updated weights for policy 0, policy_version 1640112 (0.0009) [2023-12-26 12:41:30,735][123090] Updated weights for policy 1, policy_version 1629224 (0.0010) [2023-12-26 12:41:30,791][123090] Updated weights for policy 1, policy_version 1629234 (0.0009) [2023-12-26 12:41:30,842][123090] Updated weights for policy 1, policy_version 1629244 (0.0010) [2023-12-26 12:41:30,870][123091] Updated weights for policy 0, policy_version 1640122 (0.0009) [2023-12-26 12:41:30,918][123091] Updated weights for policy 0, policy_version 1640132 (0.0009) [2023-12-26 12:41:30,965][123091] Updated weights for policy 0, policy_version 1640142 (0.0008) [2023-12-26 12:41:31,632][123090] Updated weights for policy 1, policy_version 1629254 (0.0009) [2023-12-26 12:41:31,696][123090] Updated weights for policy 1, policy_version 1629264 (0.0006) [2023-12-26 12:41:31,761][123090] Updated weights for policy 1, policy_version 1629274 (0.0008) [2023-12-26 12:41:31,803][123091] Updated weights for policy 0, policy_version 1640152 (0.0007) [2023-12-26 12:41:31,871][123091] Updated weights for policy 0, policy_version 1640162 (0.0010) [2023-12-26 12:41:31,930][123091] Updated weights for policy 0, policy_version 1640172 (0.0009) [2023-12-26 12:41:32,442][123090] Updated weights for policy 1, policy_version 1629284 (0.0007) [2023-12-26 12:41:32,509][123090] Updated weights for policy 1, policy_version 1629294 (0.0005) [2023-12-26 12:41:32,569][123090] Updated weights for policy 1, policy_version 1629304 (0.0005) [2023-12-26 12:41:32,711][123091] Updated weights for policy 0, policy_version 1640182 (0.0007) [2023-12-26 12:41:32,768][123091] Updated weights for policy 0, policy_version 1640192 (0.0010) [2023-12-26 12:41:32,828][123091] Updated weights for policy 0, policy_version 1640202 (0.0009) [2023-12-26 12:41:33,263][123090] Updated weights for policy 1, policy_version 1629314 (0.0005) [2023-12-26 12:41:33,316][123090] Updated weights for policy 1, policy_version 1629324 (0.0005) [2023-12-26 12:41:33,376][123090] Updated weights for policy 1, policy_version 1629334 (0.0005) [2023-12-26 12:41:33,422][123090] Updated weights for policy 1, policy_version 1629344 (0.0005) [2023-12-26 12:41:33,527][123091] Updated weights for policy 0, policy_version 1640212 (0.0008) [2023-12-26 12:41:33,573][123091] Updated weights for policy 0, policy_version 1640222 (0.0005) [2023-12-26 12:41:33,618][123091] Updated weights for policy 0, policy_version 1640232 (0.0005) [2023-12-26 12:41:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 837017600. Throughput: 0: 8775.6, 1: 8943.4. Samples: 837026116. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:33,785][121949] Avg episode reward: [(0, '5771.062'), (1, '5814.179')] [2023-12-26 12:41:34,024][123090] Updated weights for policy 1, policy_version 1629354 (0.0005) [2023-12-26 12:41:34,074][123090] Updated weights for policy 1, policy_version 1629364 (0.0005) [2023-12-26 12:41:34,124][123090] Updated weights for policy 1, policy_version 1629374 (0.0005) [2023-12-26 12:41:34,314][123091] Updated weights for policy 0, policy_version 1640242 (0.0006) [2023-12-26 12:41:34,383][123091] Updated weights for policy 0, policy_version 1640252 (0.0011) [2023-12-26 12:41:34,456][123091] Updated weights for policy 0, policy_version 1640262 (0.0011) [2023-12-26 12:41:34,520][123091] Updated weights for policy 0, policy_version 1640272 (0.0011) [2023-12-26 12:41:34,883][123090] Updated weights for policy 1, policy_version 1629384 (0.0010) [2023-12-26 12:41:34,946][123090] Updated weights for policy 1, policy_version 1629394 (0.0010) [2023-12-26 12:41:35,009][123090] Updated weights for policy 1, policy_version 1629404 (0.0010) [2023-12-26 12:41:35,255][123091] Updated weights for policy 0, policy_version 1640282 (0.0006) [2023-12-26 12:41:35,310][123091] Updated weights for policy 0, policy_version 1640292 (0.0008) [2023-12-26 12:41:35,369][123091] Updated weights for policy 0, policy_version 1640302 (0.0010) [2023-12-26 12:41:35,759][123090] Updated weights for policy 1, policy_version 1629414 (0.0008) [2023-12-26 12:41:35,830][123090] Updated weights for policy 1, policy_version 1629424 (0.0006) [2023-12-26 12:41:35,900][123090] Updated weights for policy 1, policy_version 1629434 (0.0006) [2023-12-26 12:41:36,199][123091] Updated weights for policy 0, policy_version 1640312 (0.0010) [2023-12-26 12:41:36,267][123091] Updated weights for policy 0, policy_version 1640322 (0.0011) [2023-12-26 12:41:36,331][123091] Updated weights for policy 0, policy_version 1640332 (0.0011) [2023-12-26 12:41:36,636][123090] Updated weights for policy 1, policy_version 1629444 (0.0007) [2023-12-26 12:41:36,701][123090] Updated weights for policy 1, policy_version 1629454 (0.0009) [2023-12-26 12:41:36,772][123090] Updated weights for policy 1, policy_version 1629464 (0.0008) [2023-12-26 12:41:37,156][123091] Updated weights for policy 0, policy_version 1640342 (0.0010) [2023-12-26 12:41:37,212][123091] Updated weights for policy 0, policy_version 1640352 (0.0011) [2023-12-26 12:41:37,279][123091] Updated weights for policy 0, policy_version 1640362 (0.0011) [2023-12-26 12:41:37,565][123090] Updated weights for policy 1, policy_version 1629474 (0.0008) [2023-12-26 12:41:37,620][123090] Updated weights for policy 1, policy_version 1629484 (0.0005) [2023-12-26 12:41:37,677][123090] Updated weights for policy 1, policy_version 1629494 (0.0005) [2023-12-26 12:41:37,736][123090] Updated weights for policy 1, policy_version 1629504 (0.0005) [2023-12-26 12:41:38,118][123091] Updated weights for policy 0, policy_version 1640372 (0.0010) [2023-12-26 12:41:38,174][123091] Updated weights for policy 0, policy_version 1640382 (0.0010) [2023-12-26 12:41:38,230][123091] Updated weights for policy 0, policy_version 1640392 (0.0010) [2023-12-26 12:41:38,455][123090] Updated weights for policy 1, policy_version 1629514 (0.0009) [2023-12-26 12:41:38,518][123090] Updated weights for policy 1, policy_version 1629524 (0.0008) [2023-12-26 12:41:38,582][123090] Updated weights for policy 1, policy_version 1629534 (0.0009) [2023-12-26 12:41:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 837107712. Throughput: 0: 8797.5, 1: 8965.8. Samples: 837082600. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:38,785][121949] Avg episode reward: [(0, '5797.775'), (1, '5723.732')] [2023-12-26 12:41:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001640400_419946496.pth... [2023-12-26 12:41:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001629536_417161216.pth... [2023-12-26 12:41:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001639376_419684352.pth [2023-12-26 12:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001628448_416882688.pth [2023-12-26 12:41:39,067][123091] Updated weights for policy 0, policy_version 1640402 (0.0010) [2023-12-26 12:41:39,131][123091] Updated weights for policy 0, policy_version 1640412 (0.0010) [2023-12-26 12:41:39,195][123091] Updated weights for policy 0, policy_version 1640422 (0.0009) [2023-12-26 12:41:39,260][123091] Updated weights for policy 0, policy_version 1640432 (0.0009) [2023-12-26 12:41:39,438][123090] Updated weights for policy 1, policy_version 1629544 (0.0009) [2023-12-26 12:41:39,501][123090] Updated weights for policy 1, policy_version 1629554 (0.0010) [2023-12-26 12:41:39,567][123090] Updated weights for policy 1, policy_version 1629564 (0.0009) [2023-12-26 12:41:40,125][123091] Updated weights for policy 0, policy_version 1640442 (0.0009) [2023-12-26 12:41:40,197][123091] Updated weights for policy 0, policy_version 1640452 (0.0009) [2023-12-26 12:41:40,258][123091] Updated weights for policy 0, policy_version 1640462 (0.0010) [2023-12-26 12:41:40,430][123090] Updated weights for policy 1, policy_version 1629574 (0.0009) [2023-12-26 12:41:40,482][123090] Updated weights for policy 1, policy_version 1629584 (0.0009) [2023-12-26 12:41:40,545][123090] Updated weights for policy 1, policy_version 1629594 (0.0010) [2023-12-26 12:41:41,068][123091] Updated weights for policy 0, policy_version 1640472 (0.0010) [2023-12-26 12:41:41,131][123091] Updated weights for policy 0, policy_version 1640482 (0.0010) [2023-12-26 12:41:41,198][123091] Updated weights for policy 0, policy_version 1640492 (0.0009) [2023-12-26 12:41:41,404][123090] Updated weights for policy 1, policy_version 1629604 (0.0009) [2023-12-26 12:41:41,470][123090] Updated weights for policy 1, policy_version 1629614 (0.0009) [2023-12-26 12:41:41,539][123090] Updated weights for policy 1, policy_version 1629624 (0.0010) [2023-12-26 12:41:42,062][123091] Updated weights for policy 0, policy_version 1640502 (0.0007) [2023-12-26 12:41:42,129][123091] Updated weights for policy 0, policy_version 1640512 (0.0009) [2023-12-26 12:41:42,185][123091] Updated weights for policy 0, policy_version 1640523 (0.0010) [2023-12-26 12:41:42,375][123090] Updated weights for policy 1, policy_version 1629634 (0.0009) [2023-12-26 12:41:42,434][123090] Updated weights for policy 1, policy_version 1629644 (0.0009) [2023-12-26 12:41:42,491][123090] Updated weights for policy 1, policy_version 1629654 (0.0010) [2023-12-26 12:41:42,564][123090] Updated weights for policy 1, policy_version 1629664 (0.0009) [2023-12-26 12:41:43,069][123091] Updated weights for policy 0, policy_version 1640533 (0.0010) [2023-12-26 12:41:43,130][123091] Updated weights for policy 0, policy_version 1640543 (0.0009) [2023-12-26 12:41:43,184][123091] Updated weights for policy 0, policy_version 1640553 (0.0010) [2023-12-26 12:41:43,364][123090] Updated weights for policy 1, policy_version 1629674 (0.0005) [2023-12-26 12:41:43,419][123090] Updated weights for policy 1, policy_version 1629684 (0.0005) [2023-12-26 12:41:43,476][123090] Updated weights for policy 1, policy_version 1629694 (0.0008) [2023-12-26 12:41:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 837189632. Throughput: 0: 8677.6, 1: 8936.2. Samples: 837184028. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:43,785][121949] Avg episode reward: [(0, '5966.278'), (1, '5803.339')] [2023-12-26 12:41:44,062][123091] Updated weights for policy 0, policy_version 1640563 (0.0010) [2023-12-26 12:41:44,127][123091] Updated weights for policy 0, policy_version 1640573 (0.0009) [2023-12-26 12:41:44,191][123091] Updated weights for policy 0, policy_version 1640583 (0.0009) [2023-12-26 12:41:44,202][123090] Updated weights for policy 1, policy_version 1629704 (0.0008) [2023-12-26 12:41:44,264][123090] Updated weights for policy 1, policy_version 1629714 (0.0007) [2023-12-26 12:41:44,316][123090] Updated weights for policy 1, policy_version 1629724 (0.0008) [2023-12-26 12:41:44,991][123091] Updated weights for policy 0, policy_version 1640593 (0.0009) [2023-12-26 12:41:45,058][123091] Updated weights for policy 0, policy_version 1640603 (0.0008) [2023-12-26 12:41:45,122][123091] Updated weights for policy 0, policy_version 1640613 (0.0008) [2023-12-26 12:41:45,190][123090] Updated weights for policy 1, policy_version 1629734 (0.0009) [2023-12-26 12:41:45,190][123091] Updated weights for policy 0, policy_version 1640623 (0.0006) [2023-12-26 12:41:45,252][123090] Updated weights for policy 1, policy_version 1629744 (0.0009) [2023-12-26 12:41:45,314][123090] Updated weights for policy 1, policy_version 1629754 (0.0010) [2023-12-26 12:41:45,919][123091] Updated weights for policy 0, policy_version 1640633 (0.0005) [2023-12-26 12:41:45,972][123091] Updated weights for policy 0, policy_version 1640643 (0.0006) [2023-12-26 12:41:46,025][123091] Updated weights for policy 0, policy_version 1640653 (0.0010) [2023-12-26 12:41:46,171][123090] Updated weights for policy 1, policy_version 1629764 (0.0010) [2023-12-26 12:41:46,244][123090] Updated weights for policy 1, policy_version 1629774 (0.0009) [2023-12-26 12:41:46,315][123090] Updated weights for policy 1, policy_version 1629784 (0.0010) [2023-12-26 12:41:46,780][123091] Updated weights for policy 0, policy_version 1640663 (0.0009) [2023-12-26 12:41:46,837][123091] Updated weights for policy 0, policy_version 1640673 (0.0010) [2023-12-26 12:41:46,892][123091] Updated weights for policy 0, policy_version 1640683 (0.0010) [2023-12-26 12:41:47,060][123090] Updated weights for policy 1, policy_version 1629794 (0.0010) [2023-12-26 12:41:47,132][123090] Updated weights for policy 1, policy_version 1629804 (0.0007) [2023-12-26 12:41:47,202][123090] Updated weights for policy 1, policy_version 1629814 (0.0009) [2023-12-26 12:41:47,278][123090] Updated weights for policy 1, policy_version 1629824 (0.0006) [2023-12-26 12:41:47,631][123091] Updated weights for policy 0, policy_version 1640693 (0.0008) [2023-12-26 12:41:47,685][123091] Updated weights for policy 0, policy_version 1640703 (0.0010) [2023-12-26 12:41:47,747][123091] Updated weights for policy 0, policy_version 1640713 (0.0013) [2023-12-26 12:41:48,041][123090] Updated weights for policy 1, policy_version 1629834 (0.0010) [2023-12-26 12:41:48,110][123090] Updated weights for policy 1, policy_version 1629844 (0.0009) [2023-12-26 12:41:48,168][123090] Updated weights for policy 1, policy_version 1629854 (0.0009) [2023-12-26 12:41:48,417][123091] Updated weights for policy 0, policy_version 1640723 (0.0010) [2023-12-26 12:41:48,468][123091] Updated weights for policy 0, policy_version 1640733 (0.0010) [2023-12-26 12:41:48,516][123091] Updated weights for policy 0, policy_version 1640743 (0.0010) [2023-12-26 12:41:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 837279744. Throughput: 0: 8746.2, 1: 8957.6. Samples: 837290360. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:48,785][121949] Avg episode reward: [(0, '6022.139'), (1, '5691.721')] [2023-12-26 12:41:49,043][123090] Updated weights for policy 1, policy_version 1629864 (0.0008) [2023-12-26 12:41:49,103][123090] Updated weights for policy 1, policy_version 1629874 (0.0009) [2023-12-26 12:41:49,156][123090] Updated weights for policy 1, policy_version 1629884 (0.0009) [2023-12-26 12:41:49,373][123091] Updated weights for policy 0, policy_version 1640753 (0.0010) [2023-12-26 12:41:49,441][123091] Updated weights for policy 0, policy_version 1640763 (0.0010) [2023-12-26 12:41:49,506][123091] Updated weights for policy 0, policy_version 1640773 (0.0010) [2023-12-26 12:41:49,572][123091] Updated weights for policy 0, policy_version 1640783 (0.0011) [2023-12-26 12:41:49,997][123090] Updated weights for policy 1, policy_version 1629894 (0.0007) [2023-12-26 12:41:50,059][123090] Updated weights for policy 1, policy_version 1629904 (0.0007) [2023-12-26 12:41:50,129][123090] Updated weights for policy 1, policy_version 1629914 (0.0008) [2023-12-26 12:41:50,375][123091] Updated weights for policy 0, policy_version 1640793 (0.0011) [2023-12-26 12:41:50,437][123091] Updated weights for policy 0, policy_version 1640803 (0.0010) [2023-12-26 12:41:50,501][123091] Updated weights for policy 0, policy_version 1640813 (0.0011) [2023-12-26 12:41:50,972][123090] Updated weights for policy 1, policy_version 1629924 (0.0009) [2023-12-26 12:41:51,030][123090] Updated weights for policy 1, policy_version 1629934 (0.0009) [2023-12-26 12:41:51,094][123090] Updated weights for policy 1, policy_version 1629944 (0.0009) [2023-12-26 12:41:51,263][123091] Updated weights for policy 0, policy_version 1640823 (0.0008) [2023-12-26 12:41:51,328][123091] Updated weights for policy 0, policy_version 1640833 (0.0009) [2023-12-26 12:41:51,395][123091] Updated weights for policy 0, policy_version 1640843 (0.0010) [2023-12-26 12:41:51,947][123090] Updated weights for policy 1, policy_version 1629954 (0.0009) [2023-12-26 12:41:52,017][123090] Updated weights for policy 1, policy_version 1629964 (0.0007) [2023-12-26 12:41:52,085][123090] Updated weights for policy 1, policy_version 1629974 (0.0008) [2023-12-26 12:41:52,151][123090] Updated weights for policy 1, policy_version 1629984 (0.0005) [2023-12-26 12:41:52,203][123091] Updated weights for policy 0, policy_version 1640853 (0.0010) [2023-12-26 12:41:52,268][123091] Updated weights for policy 0, policy_version 1640863 (0.0011) [2023-12-26 12:41:52,331][123091] Updated weights for policy 0, policy_version 1640873 (0.0011) [2023-12-26 12:41:52,886][123090] Updated weights for policy 1, policy_version 1629994 (0.0010) [2023-12-26 12:41:52,942][123090] Updated weights for policy 1, policy_version 1630004 (0.0007) [2023-12-26 12:41:53,001][123090] Updated weights for policy 1, policy_version 1630014 (0.0005) [2023-12-26 12:41:53,089][123091] Updated weights for policy 0, policy_version 1640883 (0.0010) [2023-12-26 12:41:53,141][123091] Updated weights for policy 0, policy_version 1640895 (0.0010) [2023-12-26 12:41:53,190][123091] Updated weights for policy 0, policy_version 1640905 (0.0009) [2023-12-26 12:41:53,744][123090] Updated weights for policy 1, policy_version 1630024 (0.0006) [2023-12-26 12:41:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 837361664. Throughput: 0: 8746.8, 1: 8944.1. Samples: 837341324. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:53,785][121949] Avg episode reward: [(0, '5998.284'), (1, '5740.228')] [2023-12-26 12:41:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001640912_420077568.pth... [2023-12-26 12:41:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001639888_419815424.pth [2023-12-26 12:41:53,814][123090] Updated weights for policy 1, policy_version 1630034 (0.0005) [2023-12-26 12:41:53,880][123090] Updated weights for policy 1, policy_version 1630044 (0.0005) [2023-12-26 12:41:53,903][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001630048_417292288.pth... [2023-12-26 12:41:53,906][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001628992_417021952.pth [2023-12-26 12:41:53,913][123091] Updated weights for policy 0, policy_version 1640915 (0.0010) [2023-12-26 12:41:53,967][123091] Updated weights for policy 0, policy_version 1640926 (0.0010) [2023-12-26 12:41:54,023][123091] Updated weights for policy 0, policy_version 1640936 (0.0010) [2023-12-26 12:41:54,554][123090] Updated weights for policy 1, policy_version 1630054 (0.0006) [2023-12-26 12:41:54,603][123090] Updated weights for policy 1, policy_version 1630064 (0.0005) [2023-12-26 12:41:54,665][123090] Updated weights for policy 1, policy_version 1630074 (0.0005) [2023-12-26 12:41:54,808][123091] Updated weights for policy 0, policy_version 1640946 (0.0009) [2023-12-26 12:41:54,871][123091] Updated weights for policy 0, policy_version 1640956 (0.0006) [2023-12-26 12:41:54,923][123091] Updated weights for policy 0, policy_version 1640966 (0.0005) [2023-12-26 12:41:54,984][123091] Updated weights for policy 0, policy_version 1640976 (0.0006) [2023-12-26 12:41:55,336][123090] Updated weights for policy 1, policy_version 1630084 (0.0007) [2023-12-26 12:41:55,400][123090] Updated weights for policy 1, policy_version 1630094 (0.0010) [2023-12-26 12:41:55,464][123090] Updated weights for policy 1, policy_version 1630104 (0.0008) [2023-12-26 12:41:55,685][123091] Updated weights for policy 0, policy_version 1640986 (0.0005) [2023-12-26 12:41:55,732][123091] Updated weights for policy 0, policy_version 1640996 (0.0005) [2023-12-26 12:41:55,783][123091] Updated weights for policy 0, policy_version 1641006 (0.0007) [2023-12-26 12:41:56,173][123090] Updated weights for policy 1, policy_version 1630114 (0.0005) [2023-12-26 12:41:56,228][123090] Updated weights for policy 1, policy_version 1630124 (0.0005) [2023-12-26 12:41:56,291][123090] Updated weights for policy 1, policy_version 1630134 (0.0006) [2023-12-26 12:41:56,338][123090] Updated weights for policy 1, policy_version 1630144 (0.0010) [2023-12-26 12:41:56,609][123091] Updated weights for policy 0, policy_version 1641016 (0.0006) [2023-12-26 12:41:56,680][123091] Updated weights for policy 0, policy_version 1641026 (0.0005) [2023-12-26 12:41:56,757][123091] Updated weights for policy 0, policy_version 1641036 (0.0005) [2023-12-26 12:41:57,065][123090] Updated weights for policy 1, policy_version 1630154 (0.0009) [2023-12-26 12:41:57,137][123090] Updated weights for policy 1, policy_version 1630164 (0.0009) [2023-12-26 12:41:57,211][123090] Updated weights for policy 1, policy_version 1630174 (0.0009) [2023-12-26 12:41:57,346][123091] Updated weights for policy 0, policy_version 1641046 (0.0007) [2023-12-26 12:41:57,417][123091] Updated weights for policy 0, policy_version 1641056 (0.0007) [2023-12-26 12:41:57,475][123091] Updated weights for policy 0, policy_version 1641066 (0.0006) [2023-12-26 12:41:57,819][123090] Updated weights for policy 1, policy_version 1630184 (0.0008) [2023-12-26 12:41:57,875][123090] Updated weights for policy 1, policy_version 1630194 (0.0008) [2023-12-26 12:41:57,923][123090] Updated weights for policy 1, policy_version 1630204 (0.0008) [2023-12-26 12:41:58,217][123091] Updated weights for policy 0, policy_version 1641076 (0.0008) [2023-12-26 12:41:58,280][123091] Updated weights for policy 0, policy_version 1641086 (0.0010) [2023-12-26 12:41:58,349][123091] Updated weights for policy 0, policy_version 1641096 (0.0010) [2023-12-26 12:41:58,701][123090] Updated weights for policy 1, policy_version 1630214 (0.0008) [2023-12-26 12:41:58,767][123090] Updated weights for policy 1, policy_version 1630224 (0.0007) [2023-12-26 12:41:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.5, 300 sec: 17716.9). Total num frames: 837459968. Throughput: 0: 8866.7, 1: 9100.3. Samples: 837456408. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:41:58,785][121949] Avg episode reward: [(0, '6149.353'), (1, '5621.756')] [2023-12-26 12:41:58,839][123090] Updated weights for policy 1, policy_version 1630234 (0.0008) [2023-12-26 12:41:59,277][123091] Updated weights for policy 0, policy_version 1641106 (0.0010) [2023-12-26 12:41:59,342][123091] Updated weights for policy 0, policy_version 1641116 (0.0010) [2023-12-26 12:41:59,408][123091] Updated weights for policy 0, policy_version 1641126 (0.0007) [2023-12-26 12:41:59,471][123091] Updated weights for policy 0, policy_version 1641136 (0.0010) [2023-12-26 12:41:59,562][123090] Updated weights for policy 1, policy_version 1630244 (0.0006) [2023-12-26 12:41:59,610][123090] Updated weights for policy 1, policy_version 1630254 (0.0005) [2023-12-26 12:41:59,663][123090] Updated weights for policy 1, policy_version 1630264 (0.0005) [2023-12-26 12:42:00,324][123091] Updated weights for policy 0, policy_version 1641146 (0.0005) [2023-12-26 12:42:00,389][123091] Updated weights for policy 0, policy_version 1641156 (0.0007) [2023-12-26 12:42:00,457][123091] Updated weights for policy 0, policy_version 1641166 (0.0009) [2023-12-26 12:42:00,477][123090] Updated weights for policy 1, policy_version 1630274 (0.0006) [2023-12-26 12:42:00,532][123090] Updated weights for policy 1, policy_version 1630284 (0.0006) [2023-12-26 12:42:00,599][123090] Updated weights for policy 1, policy_version 1630294 (0.0010) [2023-12-26 12:42:00,661][123090] Updated weights for policy 1, policy_version 1630304 (0.0008) [2023-12-26 12:42:01,248][123091] Updated weights for policy 0, policy_version 1641176 (0.0007) [2023-12-26 12:42:01,304][123091] Updated weights for policy 0, policy_version 1641186 (0.0006) [2023-12-26 12:42:01,366][123091] Updated weights for policy 0, policy_version 1641196 (0.0008) [2023-12-26 12:42:01,515][123090] Updated weights for policy 1, policy_version 1630314 (0.0009) [2023-12-26 12:42:01,578][123090] Updated weights for policy 1, policy_version 1630324 (0.0010) [2023-12-26 12:42:01,643][123090] Updated weights for policy 1, policy_version 1630334 (0.0010) [2023-12-26 12:42:02,156][123091] Updated weights for policy 0, policy_version 1641206 (0.0009) [2023-12-26 12:42:02,218][123091] Updated weights for policy 0, policy_version 1641216 (0.0007) [2023-12-26 12:42:02,281][123091] Updated weights for policy 0, policy_version 1641226 (0.0006) [2023-12-26 12:42:02,423][123090] Updated weights for policy 1, policy_version 1630344 (0.0006) [2023-12-26 12:42:02,498][123090] Updated weights for policy 1, policy_version 1630354 (0.0006) [2023-12-26 12:42:02,574][123090] Updated weights for policy 1, policy_version 1630364 (0.0008) [2023-12-26 12:42:03,028][123091] Updated weights for policy 0, policy_version 1641236 (0.0007) [2023-12-26 12:42:03,089][123091] Updated weights for policy 0, policy_version 1641246 (0.0010) [2023-12-26 12:42:03,142][123091] Updated weights for policy 0, policy_version 1641256 (0.0010) [2023-12-26 12:42:03,229][123090] Updated weights for policy 1, policy_version 1630374 (0.0007) [2023-12-26 12:42:03,297][123090] Updated weights for policy 1, policy_version 1630384 (0.0005) [2023-12-26 12:42:03,364][123090] Updated weights for policy 1, policy_version 1630394 (0.0005) [2023-12-26 12:42:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 837550080. Throughput: 0: 8802.6, 1: 9078.4. Samples: 837563376. Policy #0 lag: (min: 31.0, avg: 32.4, max: 54.0) [2023-12-26 12:42:03,785][121949] Avg episode reward: [(0, '6156.020'), (1, '5425.038')] [2023-12-26 12:42:03,986][123091] Updated weights for policy 0, policy_version 1641266 (0.0009) [2023-12-26 12:42:04,046][123091] Updated weights for policy 0, policy_version 1641276 (0.0009) [2023-12-26 12:42:04,090][123090] Updated weights for policy 1, policy_version 1630404 (0.0007) [2023-12-26 12:42:04,110][123091] Updated weights for policy 0, policy_version 1641286 (0.0009) [2023-12-26 12:42:04,146][123090] Updated weights for policy 1, policy_version 1630414 (0.0010) [2023-12-26 12:42:04,174][123091] Updated weights for policy 0, policy_version 1641296 (0.0007) [2023-12-26 12:42:04,202][123090] Updated weights for policy 1, policy_version 1630424 (0.0010) [2023-12-26 12:42:04,929][123091] Updated weights for policy 0, policy_version 1641306 (0.0006) [2023-12-26 12:42:04,983][123091] Updated weights for policy 0, policy_version 1641316 (0.0008) [2023-12-26 12:42:05,029][123090] Updated weights for policy 1, policy_version 1630434 (0.0011) [2023-12-26 12:42:05,031][123091] Updated weights for policy 0, policy_version 1641326 (0.0008) [2023-12-26 12:42:05,084][123090] Updated weights for policy 1, policy_version 1630444 (0.0010) [2023-12-26 12:42:05,153][123090] Updated weights for policy 1, policy_version 1630454 (0.0010) [2023-12-26 12:42:05,204][123090] Updated weights for policy 1, policy_version 1630464 (0.0010) [2023-12-26 12:42:05,741][123091] Updated weights for policy 0, policy_version 1641336 (0.0008) [2023-12-26 12:42:05,797][123091] Updated weights for policy 0, policy_version 1641346 (0.0009) [2023-12-26 12:42:05,845][123091] Updated weights for policy 0, policy_version 1641356 (0.0009) [2023-12-26 12:42:06,032][123090] Updated weights for policy 1, policy_version 1630474 (0.0011) [2023-12-26 12:42:06,086][123090] Updated weights for policy 1, policy_version 1630484 (0.0010) [2023-12-26 12:42:06,157][123090] Updated weights for policy 1, policy_version 1630494 (0.0007) [2023-12-26 12:42:06,761][123091] Updated weights for policy 0, policy_version 1641366 (0.0009) [2023-12-26 12:42:06,817][123091] Updated weights for policy 0, policy_version 1641376 (0.0009) [2023-12-26 12:42:06,865][123091] Updated weights for policy 0, policy_version 1641386 (0.0008) [2023-12-26 12:42:06,894][123090] Updated weights for policy 1, policy_version 1630504 (0.0010) [2023-12-26 12:42:06,963][123090] Updated weights for policy 1, policy_version 1630514 (0.0007) [2023-12-26 12:42:07,029][123090] Updated weights for policy 1, policy_version 1630524 (0.0005) [2023-12-26 12:42:07,709][123091] Updated weights for policy 0, policy_version 1641396 (0.0009) [2023-12-26 12:42:07,771][123091] Updated weights for policy 0, policy_version 1641406 (0.0010) [2023-12-26 12:42:07,803][123090] Updated weights for policy 1, policy_version 1630534 (0.0009) [2023-12-26 12:42:07,829][123091] Updated weights for policy 0, policy_version 1641416 (0.0010) [2023-12-26 12:42:07,850][123090] Updated weights for policy 1, policy_version 1630544 (0.0010) [2023-12-26 12:42:07,905][123090] Updated weights for policy 1, policy_version 1630554 (0.0010) [2023-12-26 12:42:08,654][123091] Updated weights for policy 0, policy_version 1641426 (0.0010) [2023-12-26 12:42:08,657][123090] Updated weights for policy 1, policy_version 1630564 (0.0009) [2023-12-26 12:42:08,702][123091] Updated weights for policy 0, policy_version 1641436 (0.0010) [2023-12-26 12:42:08,725][123090] Updated weights for policy 1, policy_version 1630574 (0.0008) [2023-12-26 12:42:08,750][123091] Updated weights for policy 0, policy_version 1641446 (0.0010) [2023-12-26 12:42:08,783][123090] Updated weights for policy 1, policy_version 1630584 (0.0006) [2023-12-26 12:42:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 837632000. Throughput: 0: 8825.6, 1: 9112.9. Samples: 837616908. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:08,784][121949] Avg episode reward: [(0, '6058.147'), (1, '5524.968')] [2023-12-26 12:42:08,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001641456_420216832.pth... [2023-12-26 12:42:08,802][123091] Updated weights for policy 0, policy_version 1641456 (0.0010) [2023-12-26 12:42:08,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001640400_419946496.pth [2023-12-26 12:42:08,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001630592_417431552.pth... [2023-12-26 12:42:08,840][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001629536_417161216.pth [2023-12-26 12:42:09,424][123090] Updated weights for policy 1, policy_version 1630594 (0.0007) [2023-12-26 12:42:09,478][123090] Updated weights for policy 1, policy_version 1630604 (0.0009) [2023-12-26 12:42:09,534][123090] Updated weights for policy 1, policy_version 1630614 (0.0009) [2023-12-26 12:42:09,596][123090] Updated weights for policy 1, policy_version 1630624 (0.0009) [2023-12-26 12:42:09,647][123091] Updated weights for policy 0, policy_version 1641466 (0.0010) [2023-12-26 12:42:09,712][123091] Updated weights for policy 0, policy_version 1641476 (0.0007) [2023-12-26 12:42:09,778][123091] Updated weights for policy 0, policy_version 1641486 (0.0007) [2023-12-26 12:42:10,425][123090] Updated weights for policy 1, policy_version 1630634 (0.0010) [2023-12-26 12:42:10,487][123090] Updated weights for policy 1, policy_version 1630644 (0.0010) [2023-12-26 12:42:10,559][123090] Updated weights for policy 1, policy_version 1630654 (0.0008) [2023-12-26 12:42:10,588][123091] Updated weights for policy 0, policy_version 1641496 (0.0006) [2023-12-26 12:42:10,647][123091] Updated weights for policy 0, policy_version 1641506 (0.0005) [2023-12-26 12:42:10,715][123091] Updated weights for policy 0, policy_version 1641516 (0.0005) [2023-12-26 12:42:11,299][123090] Updated weights for policy 1, policy_version 1630664 (0.0009) [2023-12-26 12:42:11,379][123090] Updated weights for policy 1, policy_version 1630674 (0.0009) [2023-12-26 12:42:11,399][123091] Updated weights for policy 0, policy_version 1641526 (0.0007) [2023-12-26 12:42:11,451][123090] Updated weights for policy 1, policy_version 1630684 (0.0010) [2023-12-26 12:42:11,454][123091] Updated weights for policy 0, policy_version 1641536 (0.0008) [2023-12-26 12:42:11,517][123091] Updated weights for policy 0, policy_version 1641546 (0.0009) [2023-12-26 12:42:12,237][123090] Updated weights for policy 1, policy_version 1630694 (0.0010) [2023-12-26 12:42:12,303][123090] Updated weights for policy 1, policy_version 1630704 (0.0009) [2023-12-26 12:42:12,333][123091] Updated weights for policy 0, policy_version 1641556 (0.0008) [2023-12-26 12:42:12,378][123090] Updated weights for policy 1, policy_version 1630714 (0.0008) [2023-12-26 12:42:12,409][123091] Updated weights for policy 0, policy_version 1641566 (0.0009) [2023-12-26 12:42:12,472][123091] Updated weights for policy 0, policy_version 1641576 (0.0010) [2023-12-26 12:42:13,204][123090] Updated weights for policy 1, policy_version 1630724 (0.0009) [2023-12-26 12:42:13,248][123090] Updated weights for policy 1, policy_version 1630734 (0.0010) [2023-12-26 12:42:13,297][123090] Updated weights for policy 1, policy_version 1630744 (0.0010) [2023-12-26 12:42:13,313][123091] Updated weights for policy 0, policy_version 1641586 (0.0009) [2023-12-26 12:42:13,371][123091] Updated weights for policy 0, policy_version 1641596 (0.0008) [2023-12-26 12:42:13,426][123091] Updated weights for policy 0, policy_version 1641606 (0.0009) [2023-12-26 12:42:13,473][123091] Updated weights for policy 0, policy_version 1641616 (0.0009) [2023-12-26 12:42:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 837730304. Throughput: 0: 8851.4, 1: 9082.5. Samples: 837723220. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:13,784][121949] Avg episode reward: [(0, '6044.729'), (1, '5738.728')] [2023-12-26 12:42:14,151][123090] Updated weights for policy 1, policy_version 1630754 (0.0010) [2023-12-26 12:42:14,172][123091] Updated weights for policy 0, policy_version 1641626 (0.0005) [2023-12-26 12:42:14,202][123090] Updated weights for policy 1, policy_version 1630764 (0.0010) [2023-12-26 12:42:14,236][123091] Updated weights for policy 0, policy_version 1641636 (0.0005) [2023-12-26 12:42:14,254][123090] Updated weights for policy 1, policy_version 1630774 (0.0008) [2023-12-26 12:42:14,295][123091] Updated weights for policy 0, policy_version 1641646 (0.0006) [2023-12-26 12:42:14,313][123090] Updated weights for policy 1, policy_version 1630784 (0.0006) [2023-12-26 12:42:14,925][123091] Updated weights for policy 0, policy_version 1641656 (0.0006) [2023-12-26 12:42:14,994][123091] Updated weights for policy 0, policy_version 1641666 (0.0006) [2023-12-26 12:42:15,062][123091] Updated weights for policy 0, policy_version 1641676 (0.0011) [2023-12-26 12:42:15,073][123090] Updated weights for policy 1, policy_version 1630794 (0.0007) [2023-12-26 12:42:15,145][123090] Updated weights for policy 1, policy_version 1630804 (0.0006) [2023-12-26 12:42:15,218][123090] Updated weights for policy 1, policy_version 1630814 (0.0005) [2023-12-26 12:42:15,802][123090] Updated weights for policy 1, policy_version 1630824 (0.0009) [2023-12-26 12:42:15,854][123091] Updated weights for policy 0, policy_version 1641686 (0.0009) [2023-12-26 12:42:15,857][123090] Updated weights for policy 1, policy_version 1630834 (0.0010) [2023-12-26 12:42:15,912][123091] Updated weights for policy 0, policy_version 1641696 (0.0009) [2023-12-26 12:42:15,919][123090] Updated weights for policy 1, policy_version 1630844 (0.0008) [2023-12-26 12:42:15,976][123091] Updated weights for policy 0, policy_version 1641706 (0.0010) [2023-12-26 12:42:16,689][123090] Updated weights for policy 1, policy_version 1630854 (0.0009) [2023-12-26 12:42:16,748][123091] Updated weights for policy 0, policy_version 1641716 (0.0009) [2023-12-26 12:42:16,754][123090] Updated weights for policy 1, policy_version 1630864 (0.0011) [2023-12-26 12:42:16,812][123091] Updated weights for policy 0, policy_version 1641726 (0.0006) [2023-12-26 12:42:16,823][123090] Updated weights for policy 1, policy_version 1630874 (0.0011) [2023-12-26 12:42:16,876][123091] Updated weights for policy 0, policy_version 1641736 (0.0010) [2023-12-26 12:42:17,627][123090] Updated weights for policy 1, policy_version 1630884 (0.0008) [2023-12-26 12:42:17,677][123090] Updated weights for policy 1, policy_version 1630894 (0.0005) [2023-12-26 12:42:17,707][123091] Updated weights for policy 0, policy_version 1641746 (0.0009) [2023-12-26 12:42:17,736][123090] Updated weights for policy 1, policy_version 1630904 (0.0006) [2023-12-26 12:42:17,762][123091] Updated weights for policy 0, policy_version 1641756 (0.0011) [2023-12-26 12:42:17,810][123091] Updated weights for policy 0, policy_version 1641766 (0.0010) [2023-12-26 12:42:17,871][123091] Updated weights for policy 0, policy_version 1641776 (0.0005) [2023-12-26 12:42:18,546][123090] Updated weights for policy 1, policy_version 1630914 (0.0008) [2023-12-26 12:42:18,601][123090] Updated weights for policy 1, policy_version 1630924 (0.0005) [2023-12-26 12:42:18,676][123090] Updated weights for policy 1, policy_version 1630934 (0.0009) [2023-12-26 12:42:18,723][123091] Updated weights for policy 0, policy_version 1641786 (0.0007) [2023-12-26 12:42:18,744][123090] Updated weights for policy 1, policy_version 1630944 (0.0009) [2023-12-26 12:42:18,783][123091] Updated weights for policy 0, policy_version 1641796 (0.0010) [2023-12-26 12:42:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 837820416. Throughput: 0: 8898.7, 1: 9030.4. Samples: 837832924. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:18,784][121949] Avg episode reward: [(0, '6051.455'), (1, '5501.554')] [2023-12-26 12:42:18,843][123091] Updated weights for policy 0, policy_version 1641806 (0.0010) [2023-12-26 12:42:19,469][123090] Updated weights for policy 1, policy_version 1630954 (0.0010) [2023-12-26 12:42:19,543][123090] Updated weights for policy 1, policy_version 1630964 (0.0009) [2023-12-26 12:42:19,605][123090] Updated weights for policy 1, policy_version 1630974 (0.0009) [2023-12-26 12:42:19,766][123091] Updated weights for policy 0, policy_version 1641816 (0.0011) [2023-12-26 12:42:19,832][123091] Updated weights for policy 0, policy_version 1641826 (0.0009) [2023-12-26 12:42:19,901][123091] Updated weights for policy 0, policy_version 1641836 (0.0009) [2023-12-26 12:42:20,435][123090] Updated weights for policy 1, policy_version 1630984 (0.0010) [2023-12-26 12:42:20,501][123090] Updated weights for policy 1, policy_version 1630994 (0.0009) [2023-12-26 12:42:20,556][123090] Updated weights for policy 1, policy_version 1631004 (0.0009) [2023-12-26 12:42:20,731][123091] Updated weights for policy 0, policy_version 1641846 (0.0008) [2023-12-26 12:42:20,797][123091] Updated weights for policy 0, policy_version 1641856 (0.0010) [2023-12-26 12:42:20,863][123091] Updated weights for policy 0, policy_version 1641866 (0.0009) [2023-12-26 12:42:21,420][123090] Updated weights for policy 1, policy_version 1631014 (0.0010) [2023-12-26 12:42:21,480][123090] Updated weights for policy 1, policy_version 1631024 (0.0009) [2023-12-26 12:42:21,545][123090] Updated weights for policy 1, policy_version 1631034 (0.0009) [2023-12-26 12:42:21,688][123091] Updated weights for policy 0, policy_version 1641876 (0.0009) [2023-12-26 12:42:21,748][123091] Updated weights for policy 0, policy_version 1641886 (0.0009) [2023-12-26 12:42:21,807][123091] Updated weights for policy 0, policy_version 1641896 (0.0010) [2023-12-26 12:42:22,419][123090] Updated weights for policy 1, policy_version 1631044 (0.0010) [2023-12-26 12:42:22,491][123090] Updated weights for policy 1, policy_version 1631054 (0.0009) [2023-12-26 12:42:22,560][123090] Updated weights for policy 1, policy_version 1631064 (0.0009) [2023-12-26 12:42:22,667][123091] Updated weights for policy 0, policy_version 1641906 (0.0009) [2023-12-26 12:42:22,720][123091] Updated weights for policy 0, policy_version 1641916 (0.0009) [2023-12-26 12:42:22,773][123091] Updated weights for policy 0, policy_version 1641926 (0.0010) [2023-12-26 12:42:22,832][123091] Updated weights for policy 0, policy_version 1641936 (0.0010) [2023-12-26 12:42:23,366][123090] Updated weights for policy 1, policy_version 1631074 (0.0010) [2023-12-26 12:42:23,415][123090] Updated weights for policy 1, policy_version 1631084 (0.0009) [2023-12-26 12:42:23,484][123090] Updated weights for policy 1, policy_version 1631094 (0.0009) [2023-12-26 12:42:23,553][123090] Updated weights for policy 1, policy_version 1631104 (0.0010) [2023-12-26 12:42:23,680][123091] Updated weights for policy 0, policy_version 1641946 (0.0005) [2023-12-26 12:42:23,744][123091] Updated weights for policy 0, policy_version 1641956 (0.0006) [2023-12-26 12:42:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 837902336. Throughput: 0: 8820.8, 1: 8960.4. Samples: 837882756. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:23,784][121949] Avg episode reward: [(0, '5994.468'), (1, '5544.153')] [2023-12-26 12:42:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001631104_417562624.pth... [2023-12-26 12:42:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001630048_417292288.pth [2023-12-26 12:42:23,796][123091] Updated weights for policy 0, policy_version 1641966 (0.0010) [2023-12-26 12:42:23,803][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001641968_420347904.pth... [2023-12-26 12:42:23,806][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001640912_420077568.pth [2023-12-26 12:42:24,329][123090] Updated weights for policy 1, policy_version 1631114 (0.0006) [2023-12-26 12:42:24,387][123090] Updated weights for policy 1, policy_version 1631124 (0.0005) [2023-12-26 12:42:24,447][123090] Updated weights for policy 1, policy_version 1631134 (0.0005) [2023-12-26 12:42:24,631][123091] Updated weights for policy 0, policy_version 1641976 (0.0010) [2023-12-26 12:42:24,705][123091] Updated weights for policy 0, policy_version 1641986 (0.0010) [2023-12-26 12:42:24,762][123091] Updated weights for policy 0, policy_version 1641996 (0.0009) [2023-12-26 12:42:25,119][123090] Updated weights for policy 1, policy_version 1631144 (0.0009) [2023-12-26 12:42:25,175][123090] Updated weights for policy 1, policy_version 1631154 (0.0009) [2023-12-26 12:42:25,229][123090] Updated weights for policy 1, policy_version 1631164 (0.0009) [2023-12-26 12:42:25,626][123091] Updated weights for policy 0, policy_version 1642006 (0.0009) [2023-12-26 12:42:25,692][123091] Updated weights for policy 0, policy_version 1642016 (0.0009) [2023-12-26 12:42:25,756][123091] Updated weights for policy 0, policy_version 1642026 (0.0009) [2023-12-26 12:42:26,054][123090] Updated weights for policy 1, policy_version 1631174 (0.0010) [2023-12-26 12:42:26,126][123090] Updated weights for policy 1, policy_version 1631184 (0.0010) [2023-12-26 12:42:26,192][123090] Updated weights for policy 1, policy_version 1631194 (0.0008) [2023-12-26 12:42:26,573][123091] Updated weights for policy 0, policy_version 1642036 (0.0010) [2023-12-26 12:42:26,622][123091] Updated weights for policy 0, policy_version 1642046 (0.0009) [2023-12-26 12:42:26,674][123091] Updated weights for policy 0, policy_version 1642056 (0.0009) [2023-12-26 12:42:27,034][123090] Updated weights for policy 1, policy_version 1631204 (0.0010) [2023-12-26 12:42:27,090][123090] Updated weights for policy 1, policy_version 1631214 (0.0010) [2023-12-26 12:42:27,154][123090] Updated weights for policy 1, policy_version 1631224 (0.0010) [2023-12-26 12:42:27,537][123091] Updated weights for policy 0, policy_version 1642066 (0.0010) [2023-12-26 12:42:27,586][123091] Updated weights for policy 0, policy_version 1642077 (0.0009) [2023-12-26 12:42:27,634][123091] Updated weights for policy 0, policy_version 1642088 (0.0010) [2023-12-26 12:42:27,989][123090] Updated weights for policy 1, policy_version 1631234 (0.0009) [2023-12-26 12:42:28,051][123090] Updated weights for policy 1, policy_version 1631244 (0.0009) [2023-12-26 12:42:28,116][123090] Updated weights for policy 1, policy_version 1631254 (0.0009) [2023-12-26 12:42:28,183][123090] Updated weights for policy 1, policy_version 1631264 (0.0010) [2023-12-26 12:42:28,528][123091] Updated weights for policy 0, policy_version 1642098 (0.0009) [2023-12-26 12:42:28,596][123091] Updated weights for policy 0, policy_version 1642108 (0.0010) [2023-12-26 12:42:28,648][123091] Updated weights for policy 0, policy_version 1642118 (0.0009) [2023-12-26 12:42:28,701][123091] Updated weights for policy 0, policy_version 1642128 (0.0009) [2023-12-26 12:42:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 837992448. Throughput: 0: 8830.7, 1: 8982.5. Samples: 837985620. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:28,784][121949] Avg episode reward: [(0, '6108.016'), (1, '5650.255')] [2023-12-26 12:42:28,992][123090] Updated weights for policy 1, policy_version 1631274 (0.0009) [2023-12-26 12:42:29,058][123090] Updated weights for policy 1, policy_version 1631284 (0.0009) [2023-12-26 12:42:29,127][123090] Updated weights for policy 1, policy_version 1631294 (0.0009) [2023-12-26 12:42:29,571][123091] Updated weights for policy 0, policy_version 1642138 (0.0009) [2023-12-26 12:42:29,633][123091] Updated weights for policy 0, policy_version 1642148 (0.0009) [2023-12-26 12:42:29,694][123091] Updated weights for policy 0, policy_version 1642158 (0.0009) [2023-12-26 12:42:29,967][123090] Updated weights for policy 1, policy_version 1631304 (0.0010) [2023-12-26 12:42:30,031][123090] Updated weights for policy 1, policy_version 1631314 (0.0009) [2023-12-26 12:42:30,086][123090] Updated weights for policy 1, policy_version 1631324 (0.0008) [2023-12-26 12:42:30,544][123091] Updated weights for policy 0, policy_version 1642168 (0.0009) [2023-12-26 12:42:30,603][123091] Updated weights for policy 0, policy_version 1642178 (0.0009) [2023-12-26 12:42:30,659][123091] Updated weights for policy 0, policy_version 1642188 (0.0009) [2023-12-26 12:42:30,884][123090] Updated weights for policy 1, policy_version 1631334 (0.0008) [2023-12-26 12:42:30,938][123090] Updated weights for policy 1, policy_version 1631345 (0.0010) [2023-12-26 12:42:30,985][123090] Updated weights for policy 1, policy_version 1631355 (0.0009) [2023-12-26 12:42:31,497][123091] Updated weights for policy 0, policy_version 1642198 (0.0009) [2023-12-26 12:42:31,551][123091] Updated weights for policy 0, policy_version 1642208 (0.0009) [2023-12-26 12:42:31,614][123091] Updated weights for policy 0, policy_version 1642218 (0.0009) [2023-12-26 12:42:31,876][123090] Updated weights for policy 1, policy_version 1631365 (0.0008) [2023-12-26 12:42:31,945][123090] Updated weights for policy 1, policy_version 1631375 (0.0005) [2023-12-26 12:42:31,991][123090] Updated weights for policy 1, policy_version 1631385 (0.0005) [2023-12-26 12:42:32,514][123091] Updated weights for policy 0, policy_version 1642228 (0.0010) [2023-12-26 12:42:32,577][123091] Updated weights for policy 0, policy_version 1642238 (0.0008) [2023-12-26 12:42:32,639][123091] Updated weights for policy 0, policy_version 1642248 (0.0010) [2023-12-26 12:42:32,719][123090] Updated weights for policy 1, policy_version 1631395 (0.0007) [2023-12-26 12:42:32,780][123090] Updated weights for policy 1, policy_version 1631405 (0.0009) [2023-12-26 12:42:32,843][123090] Updated weights for policy 1, policy_version 1631415 (0.0009) [2023-12-26 12:42:33,452][123091] Updated weights for policy 0, policy_version 1642258 (0.0010) [2023-12-26 12:42:33,504][123091] Updated weights for policy 0, policy_version 1642269 (0.0010) [2023-12-26 12:42:33,556][123091] Updated weights for policy 0, policy_version 1642281 (0.0010) [2023-12-26 12:42:33,652][123090] Updated weights for policy 1, policy_version 1631425 (0.0009) [2023-12-26 12:42:33,699][123090] Updated weights for policy 1, policy_version 1631435 (0.0005) [2023-12-26 12:42:33,753][123090] Updated weights for policy 1, policy_version 1631445 (0.0006) [2023-12-26 12:42:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 838074368. Throughput: 0: 8736.3, 1: 8982.2. Samples: 838087696. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:33,785][121949] Avg episode reward: [(0, '5966.599'), (1, '5571.835')] [2023-12-26 12:42:33,814][123090] Updated weights for policy 1, policy_version 1631455 (0.0009) [2023-12-26 12:42:34,387][123091] Updated weights for policy 0, policy_version 1642292 (0.0009) [2023-12-26 12:42:34,453][123091] Updated weights for policy 0, policy_version 1642302 (0.0007) [2023-12-26 12:42:34,516][123091] Updated weights for policy 0, policy_version 1642312 (0.0009) [2023-12-26 12:42:34,641][123090] Updated weights for policy 1, policy_version 1631465 (0.0008) [2023-12-26 12:42:34,704][123090] Updated weights for policy 1, policy_version 1631475 (0.0009) [2023-12-26 12:42:34,768][123090] Updated weights for policy 1, policy_version 1631485 (0.0010) [2023-12-26 12:42:35,274][123091] Updated weights for policy 0, policy_version 1642322 (0.0009) [2023-12-26 12:42:35,328][123091] Updated weights for policy 0, policy_version 1642332 (0.0009) [2023-12-26 12:42:35,387][123091] Updated weights for policy 0, policy_version 1642342 (0.0009) [2023-12-26 12:42:35,442][123091] Updated weights for policy 0, policy_version 1642352 (0.0009) [2023-12-26 12:42:35,620][123090] Updated weights for policy 1, policy_version 1631495 (0.0010) [2023-12-26 12:42:35,676][123090] Updated weights for policy 1, policy_version 1631505 (0.0010) [2023-12-26 12:42:35,736][123090] Updated weights for policy 1, policy_version 1631515 (0.0009) [2023-12-26 12:42:36,275][123091] Updated weights for policy 0, policy_version 1642362 (0.0010) [2023-12-26 12:42:36,327][123091] Updated weights for policy 0, policy_version 1642372 (0.0009) [2023-12-26 12:42:36,380][123091] Updated weights for policy 0, policy_version 1642382 (0.0009) [2023-12-26 12:42:36,577][123090] Updated weights for policy 1, policy_version 1631525 (0.0009) [2023-12-26 12:42:36,644][123090] Updated weights for policy 1, policy_version 1631535 (0.0009) [2023-12-26 12:42:36,714][123090] Updated weights for policy 1, policy_version 1631545 (0.0010) [2023-12-26 12:42:37,285][123091] Updated weights for policy 0, policy_version 1642392 (0.0010) [2023-12-26 12:42:37,339][123091] Updated weights for policy 0, policy_version 1642403 (0.0010) [2023-12-26 12:42:37,396][123091] Updated weights for policy 0, policy_version 1642413 (0.0009) [2023-12-26 12:42:37,421][123090] Updated weights for policy 1, policy_version 1631555 (0.0006) [2023-12-26 12:42:37,489][123090] Updated weights for policy 1, policy_version 1631565 (0.0009) [2023-12-26 12:42:37,551][123090] Updated weights for policy 1, policy_version 1631575 (0.0009) [2023-12-26 12:42:38,214][123091] Updated weights for policy 0, policy_version 1642423 (0.0009) [2023-12-26 12:42:38,263][123091] Updated weights for policy 0, policy_version 1642434 (0.0009) [2023-12-26 12:42:38,320][123091] Updated weights for policy 0, policy_version 1642444 (0.0009) [2023-12-26 12:42:38,360][123090] Updated weights for policy 1, policy_version 1631585 (0.0009) [2023-12-26 12:42:38,416][123090] Updated weights for policy 1, policy_version 1631595 (0.0009) [2023-12-26 12:42:38,479][123090] Updated weights for policy 1, policy_version 1631605 (0.0009) [2023-12-26 12:42:38,543][123090] Updated weights for policy 1, policy_version 1631615 (0.0009) [2023-12-26 12:42:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 838164480. Throughput: 0: 8732.7, 1: 8992.2. Samples: 838138944. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:38,784][121949] Avg episode reward: [(0, '6049.379'), (1, '5672.132')] [2023-12-26 12:42:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001631616_417693696.pth... [2023-12-26 12:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001642448_420470784.pth... [2023-12-26 12:42:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001630592_417431552.pth [2023-12-26 12:42:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001641456_420216832.pth [2023-12-26 12:42:39,192][123091] Updated weights for policy 0, policy_version 1642454 (0.0009) [2023-12-26 12:42:39,259][123091] Updated weights for policy 0, policy_version 1642464 (0.0009) [2023-12-26 12:42:39,324][123091] Updated weights for policy 0, policy_version 1642474 (0.0009) [2023-12-26 12:42:39,388][123090] Updated weights for policy 1, policy_version 1631625 (0.0010) [2023-12-26 12:42:39,460][123090] Updated weights for policy 1, policy_version 1631635 (0.0009) [2023-12-26 12:42:39,529][123090] Updated weights for policy 1, policy_version 1631645 (0.0005) [2023-12-26 12:42:40,156][123091] Updated weights for policy 0, policy_version 1642484 (0.0009) [2023-12-26 12:42:40,213][123091] Updated weights for policy 0, policy_version 1642494 (0.0010) [2023-12-26 12:42:40,269][123091] Updated weights for policy 0, policy_version 1642504 (0.0010) [2023-12-26 12:42:40,308][123090] Updated weights for policy 1, policy_version 1631655 (0.0008) [2023-12-26 12:42:40,379][123090] Updated weights for policy 1, policy_version 1631665 (0.0006) [2023-12-26 12:42:40,441][123090] Updated weights for policy 1, policy_version 1631675 (0.0006) [2023-12-26 12:42:41,145][123091] Updated weights for policy 0, policy_version 1642514 (0.0008) [2023-12-26 12:42:41,162][123090] Updated weights for policy 1, policy_version 1631685 (0.0007) [2023-12-26 12:42:41,214][123091] Updated weights for policy 0, policy_version 1642524 (0.0008) [2023-12-26 12:42:41,230][123090] Updated weights for policy 1, policy_version 1631695 (0.0009) [2023-12-26 12:42:41,281][123091] Updated weights for policy 0, policy_version 1642534 (0.0010) [2023-12-26 12:42:41,298][123090] Updated weights for policy 1, policy_version 1631705 (0.0008) [2023-12-26 12:42:41,344][123091] Updated weights for policy 0, policy_version 1642544 (0.0009) [2023-12-26 12:42:42,084][123090] Updated weights for policy 1, policy_version 1631715 (0.0008) [2023-12-26 12:42:42,151][123090] Updated weights for policy 1, policy_version 1631725 (0.0008) [2023-12-26 12:42:42,157][123091] Updated weights for policy 0, policy_version 1642554 (0.0009) [2023-12-26 12:42:42,209][123091] Updated weights for policy 0, policy_version 1642564 (0.0009) [2023-12-26 12:42:42,212][123090] Updated weights for policy 1, policy_version 1631735 (0.0008) [2023-12-26 12:42:42,273][123091] Updated weights for policy 0, policy_version 1642574 (0.0010) [2023-12-26 12:42:42,962][123090] Updated weights for policy 1, policy_version 1631745 (0.0008) [2023-12-26 12:42:43,024][123090] Updated weights for policy 1, policy_version 1631755 (0.0010) [2023-12-26 12:42:43,090][123090] Updated weights for policy 1, policy_version 1631765 (0.0010) [2023-12-26 12:42:43,155][123090] Updated weights for policy 1, policy_version 1631775 (0.0011) [2023-12-26 12:42:43,186][123091] Updated weights for policy 0, policy_version 1642584 (0.0007) [2023-12-26 12:42:43,235][123091] Updated weights for policy 0, policy_version 1642594 (0.0009) [2023-12-26 12:42:43,286][123091] Updated weights for policy 0, policy_version 1642604 (0.0010) [2023-12-26 12:42:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 838246400. Throughput: 0: 8581.1, 1: 8890.9. Samples: 838242652. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:43,785][121949] Avg episode reward: [(0, '6195.572'), (1, '5859.351')] [2023-12-26 12:42:43,837][123090] Updated weights for policy 1, policy_version 1631785 (0.0010) [2023-12-26 12:42:43,904][123090] Updated weights for policy 1, policy_version 1631795 (0.0008) [2023-12-26 12:42:43,968][123090] Updated weights for policy 1, policy_version 1631805 (0.0009) [2023-12-26 12:42:44,204][123091] Updated weights for policy 0, policy_version 1642614 (0.0009) [2023-12-26 12:42:44,252][123091] Updated weights for policy 0, policy_version 1642624 (0.0008) [2023-12-26 12:42:44,309][123091] Updated weights for policy 0, policy_version 1642634 (0.0009) [2023-12-26 12:42:44,733][123090] Updated weights for policy 1, policy_version 1631815 (0.0007) [2023-12-26 12:42:44,801][123090] Updated weights for policy 1, policy_version 1631825 (0.0007) [2023-12-26 12:42:44,868][123090] Updated weights for policy 1, policy_version 1631835 (0.0011) [2023-12-26 12:42:45,078][123091] Updated weights for policy 0, policy_version 1642644 (0.0009) [2023-12-26 12:42:45,148][123091] Updated weights for policy 0, policy_version 1642654 (0.0009) [2023-12-26 12:42:45,215][123091] Updated weights for policy 0, policy_version 1642664 (0.0009) [2023-12-26 12:42:45,586][123090] Updated weights for policy 1, policy_version 1631845 (0.0010) [2023-12-26 12:42:45,647][123090] Updated weights for policy 1, policy_version 1631855 (0.0005) [2023-12-26 12:42:45,704][123090] Updated weights for policy 1, policy_version 1631865 (0.0009) [2023-12-26 12:42:46,069][123091] Updated weights for policy 0, policy_version 1642674 (0.0009) [2023-12-26 12:42:46,125][123091] Updated weights for policy 0, policy_version 1642684 (0.0010) [2023-12-26 12:42:46,183][123091] Updated weights for policy 0, policy_version 1642694 (0.0010) [2023-12-26 12:42:46,241][123091] Updated weights for policy 0, policy_version 1642704 (0.0010) [2023-12-26 12:42:46,407][123090] Updated weights for policy 1, policy_version 1631875 (0.0007) [2023-12-26 12:42:46,467][123090] Updated weights for policy 1, policy_version 1631885 (0.0007) [2023-12-26 12:42:46,537][123090] Updated weights for policy 1, policy_version 1631895 (0.0005) [2023-12-26 12:42:47,183][123091] Updated weights for policy 0, policy_version 1642714 (0.0009) [2023-12-26 12:42:47,235][123090] Updated weights for policy 1, policy_version 1631905 (0.0006) [2023-12-26 12:42:47,251][123091] Updated weights for policy 0, policy_version 1642724 (0.0009) [2023-12-26 12:42:47,303][123090] Updated weights for policy 1, policy_version 1631915 (0.0010) [2023-12-26 12:42:47,315][123091] Updated weights for policy 0, policy_version 1642734 (0.0008) [2023-12-26 12:42:47,361][123090] Updated weights for policy 1, policy_version 1631925 (0.0009) [2023-12-26 12:42:47,424][123090] Updated weights for policy 1, policy_version 1631935 (0.0009) [2023-12-26 12:42:48,124][123091] Updated weights for policy 0, policy_version 1642744 (0.0009) [2023-12-26 12:42:48,194][123091] Updated weights for policy 0, policy_version 1642754 (0.0009) [2023-12-26 12:42:48,211][123090] Updated weights for policy 1, policy_version 1631945 (0.0007) [2023-12-26 12:42:48,254][123091] Updated weights for policy 0, policy_version 1642764 (0.0007) [2023-12-26 12:42:48,272][123090] Updated weights for policy 1, policy_version 1631955 (0.0010) [2023-12-26 12:42:48,331][123090] Updated weights for policy 1, policy_version 1631965 (0.0011) [2023-12-26 12:42:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 838336512. Throughput: 0: 8544.0, 1: 8922.3. Samples: 838349352. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:48,785][121949] Avg episode reward: [(0, '6202.748'), (1, '5901.601')] [2023-12-26 12:42:49,087][123090] Updated weights for policy 1, policy_version 1631976 (0.0009) [2023-12-26 12:42:49,107][123091] Updated weights for policy 0, policy_version 1642774 (0.0008) [2023-12-26 12:42:49,152][123090] Updated weights for policy 1, policy_version 1631986 (0.0009) [2023-12-26 12:42:49,198][123091] Updated weights for policy 0, policy_version 1642784 (0.0008) [2023-12-26 12:42:49,218][123090] Updated weights for policy 1, policy_version 1631996 (0.0010) [2023-12-26 12:42:49,272][123091] Updated weights for policy 0, policy_version 1642794 (0.0009) [2023-12-26 12:42:50,036][123090] Updated weights for policy 1, policy_version 1632006 (0.0010) [2023-12-26 12:42:50,046][123091] Updated weights for policy 0, policy_version 1642804 (0.0008) [2023-12-26 12:42:50,102][123091] Updated weights for policy 0, policy_version 1642814 (0.0006) [2023-12-26 12:42:50,107][123090] Updated weights for policy 1, policy_version 1632016 (0.0011) [2023-12-26 12:42:50,168][123091] Updated weights for policy 0, policy_version 1642824 (0.0005) [2023-12-26 12:42:50,175][123090] Updated weights for policy 1, policy_version 1632026 (0.0006) [2023-12-26 12:42:50,855][123090] Updated weights for policy 1, policy_version 1632036 (0.0007) [2023-12-26 12:42:50,919][123090] Updated weights for policy 1, policy_version 1632046 (0.0006) [2023-12-26 12:42:50,982][123091] Updated weights for policy 0, policy_version 1642834 (0.0008) [2023-12-26 12:42:50,986][123090] Updated weights for policy 1, policy_version 1632056 (0.0010) [2023-12-26 12:42:51,051][123091] Updated weights for policy 0, policy_version 1642844 (0.0008) [2023-12-26 12:42:51,124][123091] Updated weights for policy 0, policy_version 1642854 (0.0006) [2023-12-26 12:42:51,195][123091] Updated weights for policy 0, policy_version 1642864 (0.0008) [2023-12-26 12:42:51,787][123090] Updated weights for policy 1, policy_version 1632066 (0.0012) [2023-12-26 12:42:51,852][123090] Updated weights for policy 1, policy_version 1632076 (0.0010) [2023-12-26 12:42:51,909][123091] Updated weights for policy 0, policy_version 1642874 (0.0007) [2023-12-26 12:42:51,922][123090] Updated weights for policy 1, policy_version 1632086 (0.0010) [2023-12-26 12:42:51,968][123091] Updated weights for policy 0, policy_version 1642884 (0.0007) [2023-12-26 12:42:51,989][123090] Updated weights for policy 1, policy_version 1632096 (0.0007) [2023-12-26 12:42:52,033][123091] Updated weights for policy 0, policy_version 1642894 (0.0009) [2023-12-26 12:42:52,827][123090] Updated weights for policy 1, policy_version 1632106 (0.0007) [2023-12-26 12:42:52,860][123091] Updated weights for policy 0, policy_version 1642904 (0.0008) [2023-12-26 12:42:52,900][123090] Updated weights for policy 1, policy_version 1632116 (0.0005) [2023-12-26 12:42:52,910][123091] Updated weights for policy 0, policy_version 1642914 (0.0009) [2023-12-26 12:42:52,959][123091] Updated weights for policy 0, policy_version 1642924 (0.0008) [2023-12-26 12:42:52,963][123090] Updated weights for policy 1, policy_version 1632126 (0.0005) [2023-12-26 12:42:53,540][123090] Updated weights for policy 1, policy_version 1632136 (0.0005) [2023-12-26 12:42:53,603][123090] Updated weights for policy 1, policy_version 1632146 (0.0006) [2023-12-26 12:42:53,666][123090] Updated weights for policy 1, policy_version 1632156 (0.0006) [2023-12-26 12:42:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 838426624. Throughput: 0: 8525.5, 1: 8921.3. Samples: 838402016. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:53,785][121949] Avg episode reward: [(0, '6125.248'), (1, '5898.307')] [2023-12-26 12:42:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001632160_417832960.pth... [2023-12-26 12:42:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001631104_417562624.pth [2023-12-26 12:42:53,814][123091] Updated weights for policy 0, policy_version 1642934 (0.0007) [2023-12-26 12:42:53,868][123091] Updated weights for policy 0, policy_version 1642944 (0.0009) [2023-12-26 12:42:53,925][123091] Updated weights for policy 0, policy_version 1642954 (0.0009) [2023-12-26 12:42:53,957][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001642960_420601856.pth... [2023-12-26 12:42:53,960][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001641968_420347904.pth [2023-12-26 12:42:54,426][123090] Updated weights for policy 1, policy_version 1632166 (0.0008) [2023-12-26 12:42:54,498][123090] Updated weights for policy 1, policy_version 1632176 (0.0010) [2023-12-26 12:42:54,550][123090] Updated weights for policy 1, policy_version 1632186 (0.0010) [2023-12-26 12:42:54,737][123091] Updated weights for policy 0, policy_version 1642964 (0.0009) [2023-12-26 12:42:54,796][123091] Updated weights for policy 0, policy_version 1642974 (0.0010) [2023-12-26 12:42:54,855][123091] Updated weights for policy 0, policy_version 1642984 (0.0011) [2023-12-26 12:42:55,237][123090] Updated weights for policy 1, policy_version 1632196 (0.0007) [2023-12-26 12:42:55,298][123090] Updated weights for policy 1, policy_version 1632206 (0.0009) [2023-12-26 12:42:55,363][123090] Updated weights for policy 1, policy_version 1632216 (0.0008) [2023-12-26 12:42:55,654][123091] Updated weights for policy 0, policy_version 1642994 (0.0010) [2023-12-26 12:42:55,725][123091] Updated weights for policy 0, policy_version 1643004 (0.0005) [2023-12-26 12:42:55,788][123091] Updated weights for policy 0, policy_version 1643014 (0.0006) [2023-12-26 12:42:55,861][123091] Updated weights for policy 0, policy_version 1643024 (0.0008) [2023-12-26 12:42:56,075][123090] Updated weights for policy 1, policy_version 1632226 (0.0006) [2023-12-26 12:42:56,139][123090] Updated weights for policy 1, policy_version 1632236 (0.0010) [2023-12-26 12:42:56,197][123090] Updated weights for policy 1, policy_version 1632246 (0.0009) [2023-12-26 12:42:56,257][123090] Updated weights for policy 1, policy_version 1632256 (0.0009) [2023-12-26 12:42:56,464][123091] Updated weights for policy 0, policy_version 1643034 (0.0008) [2023-12-26 12:42:56,529][123091] Updated weights for policy 0, policy_version 1643044 (0.0008) [2023-12-26 12:42:56,592][123091] Updated weights for policy 0, policy_version 1643054 (0.0010) [2023-12-26 12:42:56,911][123090] Updated weights for policy 1, policy_version 1632266 (0.0005) [2023-12-26 12:42:56,970][123090] Updated weights for policy 1, policy_version 1632276 (0.0005) [2023-12-26 12:42:57,024][123090] Updated weights for policy 1, policy_version 1632286 (0.0005) [2023-12-26 12:42:57,329][123091] Updated weights for policy 0, policy_version 1643064 (0.0006) [2023-12-26 12:42:57,390][123091] Updated weights for policy 0, policy_version 1643074 (0.0010) [2023-12-26 12:42:57,448][123091] Updated weights for policy 0, policy_version 1643084 (0.0010) [2023-12-26 12:42:57,726][123090] Updated weights for policy 1, policy_version 1632296 (0.0007) [2023-12-26 12:42:57,800][123090] Updated weights for policy 1, policy_version 1632306 (0.0009) [2023-12-26 12:42:57,859][123090] Updated weights for policy 1, policy_version 1632316 (0.0010) [2023-12-26 12:42:58,212][123091] Updated weights for policy 0, policy_version 1643094 (0.0010) [2023-12-26 12:42:58,277][123091] Updated weights for policy 0, policy_version 1643104 (0.0009) [2023-12-26 12:42:58,361][123091] Updated weights for policy 0, policy_version 1643114 (0.0009) [2023-12-26 12:42:58,644][123090] Updated weights for policy 1, policy_version 1632326 (0.0008) [2023-12-26 12:42:58,715][123090] Updated weights for policy 1, policy_version 1632336 (0.0008) [2023-12-26 12:42:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 838516736. Throughput: 0: 8556.1, 1: 9012.3. Samples: 838513796. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:42:58,785][123090] Updated weights for policy 1, policy_version 1632346 (0.0008) [2023-12-26 12:42:58,785][121949] Avg episode reward: [(0, '5959.859'), (1, '5942.167')] [2023-12-26 12:42:59,244][123091] Updated weights for policy 0, policy_version 1643124 (0.0010) [2023-12-26 12:42:59,308][123091] Updated weights for policy 0, policy_version 1643134 (0.0011) [2023-12-26 12:42:59,372][123091] Updated weights for policy 0, policy_version 1643144 (0.0009) [2023-12-26 12:42:59,607][123090] Updated weights for policy 1, policy_version 1632356 (0.0008) [2023-12-26 12:42:59,667][123090] Updated weights for policy 1, policy_version 1632366 (0.0009) [2023-12-26 12:42:59,719][123090] Updated weights for policy 1, policy_version 1632376 (0.0009) [2023-12-26 12:43:00,216][123091] Updated weights for policy 0, policy_version 1643154 (0.0010) [2023-12-26 12:43:00,283][123091] Updated weights for policy 0, policy_version 1643164 (0.0011) [2023-12-26 12:43:00,343][123091] Updated weights for policy 0, policy_version 1643174 (0.0008) [2023-12-26 12:43:00,411][123091] Updated weights for policy 0, policy_version 1643184 (0.0010) [2023-12-26 12:43:00,534][123090] Updated weights for policy 1, policy_version 1632386 (0.0009) [2023-12-26 12:43:00,607][123090] Updated weights for policy 1, policy_version 1632396 (0.0009) [2023-12-26 12:43:00,655][123090] Updated weights for policy 1, policy_version 1632406 (0.0009) [2023-12-26 12:43:00,709][123090] Updated weights for policy 1, policy_version 1632416 (0.0009) [2023-12-26 12:43:01,168][123091] Updated weights for policy 0, policy_version 1643194 (0.0011) [2023-12-26 12:43:01,233][123091] Updated weights for policy 0, policy_version 1643204 (0.0006) [2023-12-26 12:43:01,297][123091] Updated weights for policy 0, policy_version 1643214 (0.0010) [2023-12-26 12:43:01,522][123090] Updated weights for policy 1, policy_version 1632426 (0.0008) [2023-12-26 12:43:01,573][123090] Updated weights for policy 1, policy_version 1632436 (0.0005) [2023-12-26 12:43:01,631][123090] Updated weights for policy 1, policy_version 1632446 (0.0007) [2023-12-26 12:43:02,063][123091] Updated weights for policy 0, policy_version 1643224 (0.0010) [2023-12-26 12:43:02,118][123091] Updated weights for policy 0, policy_version 1643234 (0.0010) [2023-12-26 12:43:02,165][123091] Updated weights for policy 0, policy_version 1643244 (0.0008) [2023-12-26 12:43:02,454][123090] Updated weights for policy 1, policy_version 1632456 (0.0009) [2023-12-26 12:43:02,516][123090] Updated weights for policy 1, policy_version 1632466 (0.0008) [2023-12-26 12:43:02,585][123090] Updated weights for policy 1, policy_version 1632476 (0.0008) [2023-12-26 12:43:02,921][123091] Updated weights for policy 0, policy_version 1643254 (0.0008) [2023-12-26 12:43:02,976][123091] Updated weights for policy 0, policy_version 1643264 (0.0010) [2023-12-26 12:43:03,034][123091] Updated weights for policy 0, policy_version 1643274 (0.0010) [2023-12-26 12:43:03,407][123090] Updated weights for policy 1, policy_version 1632486 (0.0007) [2023-12-26 12:43:03,458][123090] Updated weights for policy 1, policy_version 1632496 (0.0005) [2023-12-26 12:43:03,506][123090] Updated weights for policy 1, policy_version 1632506 (0.0005) [2023-12-26 12:43:03,665][123091] Updated weights for policy 0, policy_version 1643284 (0.0008) [2023-12-26 12:43:03,720][123091] Updated weights for policy 0, policy_version 1643294 (0.0005) [2023-12-26 12:43:03,768][123091] Updated weights for policy 0, policy_version 1643304 (0.0005) [2023-12-26 12:43:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 838606848. Throughput: 0: 8553.5, 1: 8931.5. Samples: 838619752. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:03,785][121949] Avg episode reward: [(0, '6038.013'), (1, '5834.698')] [2023-12-26 12:43:04,278][123090] Updated weights for policy 1, policy_version 1632516 (0.0007) [2023-12-26 12:43:04,341][123090] Updated weights for policy 1, policy_version 1632526 (0.0010) [2023-12-26 12:43:04,401][123090] Updated weights for policy 1, policy_version 1632536 (0.0010) [2023-12-26 12:43:04,555][123091] Updated weights for policy 0, policy_version 1643314 (0.0006) [2023-12-26 12:43:04,602][123091] Updated weights for policy 0, policy_version 1643324 (0.0010) [2023-12-26 12:43:04,651][123091] Updated weights for policy 0, policy_version 1643334 (0.0010) [2023-12-26 12:43:04,695][123091] Updated weights for policy 0, policy_version 1643344 (0.0010) [2023-12-26 12:43:05,227][123090] Updated weights for policy 1, policy_version 1632546 (0.0011) [2023-12-26 12:43:05,286][123090] Updated weights for policy 1, policy_version 1632556 (0.0010) [2023-12-26 12:43:05,335][123090] Updated weights for policy 1, policy_version 1632566 (0.0009) [2023-12-26 12:43:05,385][123090] Updated weights for policy 1, policy_version 1632576 (0.0010) [2023-12-26 12:43:05,555][123091] Updated weights for policy 0, policy_version 1643354 (0.0011) [2023-12-26 12:43:05,621][123091] Updated weights for policy 0, policy_version 1643364 (0.0011) [2023-12-26 12:43:05,679][123091] Updated weights for policy 0, policy_version 1643374 (0.0011) [2023-12-26 12:43:06,165][123090] Updated weights for policy 1, policy_version 1632586 (0.0007) [2023-12-26 12:43:06,223][123090] Updated weights for policy 1, policy_version 1632597 (0.0009) [2023-12-26 12:43:06,291][123090] Updated weights for policy 1, policy_version 1632607 (0.0011) [2023-12-26 12:43:06,394][123091] Updated weights for policy 0, policy_version 1643384 (0.0011) [2023-12-26 12:43:06,464][123091] Updated weights for policy 0, policy_version 1643394 (0.0011) [2023-12-26 12:43:06,530][123091] Updated weights for policy 0, policy_version 1643404 (0.0011) [2023-12-26 12:43:07,079][123090] Updated weights for policy 1, policy_version 1632617 (0.0006) [2023-12-26 12:43:07,141][123090] Updated weights for policy 1, policy_version 1632627 (0.0005) [2023-12-26 12:43:07,196][123090] Updated weights for policy 1, policy_version 1632637 (0.0005) [2023-12-26 12:43:07,390][123091] Updated weights for policy 0, policy_version 1643414 (0.0009) [2023-12-26 12:43:07,443][123091] Updated weights for policy 0, policy_version 1643424 (0.0009) [2023-12-26 12:43:07,504][123091] Updated weights for policy 0, policy_version 1643434 (0.0009) [2023-12-26 12:43:07,922][123090] Updated weights for policy 1, policy_version 1632647 (0.0008) [2023-12-26 12:43:07,988][123090] Updated weights for policy 1, policy_version 1632657 (0.0009) [2023-12-26 12:43:08,053][123090] Updated weights for policy 1, policy_version 1632667 (0.0009) [2023-12-26 12:43:08,307][123091] Updated weights for policy 0, policy_version 1643444 (0.0008) [2023-12-26 12:43:08,383][123091] Updated weights for policy 0, policy_version 1643454 (0.0007) [2023-12-26 12:43:08,441][123091] Updated weights for policy 0, policy_version 1643464 (0.0006) [2023-12-26 12:43:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 838696960. Throughput: 0: 8608.9, 1: 8966.8. Samples: 838673664. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:08,785][121949] Avg episode reward: [(0, '5989.741'), (1, '5824.958')] [2023-12-26 12:43:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001643472_420732928.pth... [2023-12-26 12:43:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001632672_417964032.pth... [2023-12-26 12:43:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001642448_420470784.pth [2023-12-26 12:43:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001631616_417693696.pth [2023-12-26 12:43:08,948][123090] Updated weights for policy 1, policy_version 1632677 (0.0009) [2023-12-26 12:43:09,002][123090] Updated weights for policy 1, policy_version 1632687 (0.0010) [2023-12-26 12:43:09,057][123090] Updated weights for policy 1, policy_version 1632697 (0.0010) [2023-12-26 12:43:09,146][123091] Updated weights for policy 0, policy_version 1643474 (0.0006) [2023-12-26 12:43:09,214][123091] Updated weights for policy 0, policy_version 1643484 (0.0010) [2023-12-26 12:43:09,283][123091] Updated weights for policy 0, policy_version 1643494 (0.0010) [2023-12-26 12:43:09,351][123091] Updated weights for policy 0, policy_version 1643504 (0.0009) [2023-12-26 12:43:09,937][123090] Updated weights for policy 1, policy_version 1632707 (0.0009) [2023-12-26 12:43:09,988][123090] Updated weights for policy 1, policy_version 1632717 (0.0010) [2023-12-26 12:43:10,047][123090] Updated weights for policy 1, policy_version 1632727 (0.0008) [2023-12-26 12:43:10,227][123091] Updated weights for policy 0, policy_version 1643514 (0.0010) [2023-12-26 12:43:10,295][123091] Updated weights for policy 0, policy_version 1643524 (0.0009) [2023-12-26 12:43:10,360][123091] Updated weights for policy 0, policy_version 1643534 (0.0009) [2023-12-26 12:43:10,830][123090] Updated weights for policy 1, policy_version 1632737 (0.0009) [2023-12-26 12:43:10,891][123090] Updated weights for policy 1, policy_version 1632747 (0.0008) [2023-12-26 12:43:10,954][123090] Updated weights for policy 1, policy_version 1632757 (0.0010) [2023-12-26 12:43:11,024][123090] Updated weights for policy 1, policy_version 1632767 (0.0009) [2023-12-26 12:43:11,224][123091] Updated weights for policy 0, policy_version 1643544 (0.0009) [2023-12-26 12:43:11,290][123091] Updated weights for policy 0, policy_version 1643554 (0.0010) [2023-12-26 12:43:11,358][123091] Updated weights for policy 0, policy_version 1643564 (0.0010) [2023-12-26 12:43:11,852][123090] Updated weights for policy 1, policy_version 1632777 (0.0010) [2023-12-26 12:43:11,919][123090] Updated weights for policy 1, policy_version 1632787 (0.0006) [2023-12-26 12:43:11,993][123090] Updated weights for policy 1, policy_version 1632797 (0.0006) [2023-12-26 12:43:12,226][123091] Updated weights for policy 0, policy_version 1643574 (0.0008) [2023-12-26 12:43:12,285][123091] Updated weights for policy 0, policy_version 1643584 (0.0007) [2023-12-26 12:43:12,342][123091] Updated weights for policy 0, policy_version 1643594 (0.0009) [2023-12-26 12:43:12,689][123090] Updated weights for policy 1, policy_version 1632807 (0.0009) [2023-12-26 12:43:12,753][123090] Updated weights for policy 1, policy_version 1632817 (0.0011) [2023-12-26 12:43:12,821][123090] Updated weights for policy 1, policy_version 1632827 (0.0011) [2023-12-26 12:43:13,135][123091] Updated weights for policy 0, policy_version 1643604 (0.0008) [2023-12-26 12:43:13,194][123091] Updated weights for policy 0, policy_version 1643614 (0.0009) [2023-12-26 12:43:13,255][123091] Updated weights for policy 0, policy_version 1643624 (0.0009) [2023-12-26 12:43:13,639][123090] Updated weights for policy 1, policy_version 1632837 (0.0010) [2023-12-26 12:43:13,697][123090] Updated weights for policy 1, policy_version 1632847 (0.0010) [2023-12-26 12:43:13,760][123090] Updated weights for policy 1, policy_version 1632857 (0.0010) [2023-12-26 12:43:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 838778880. Throughput: 0: 8611.6, 1: 8980.7. Samples: 838777276. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:13,785][121949] Avg episode reward: [(0, '6070.632'), (1, '5767.943')] [2023-12-26 12:43:14,072][123091] Updated weights for policy 0, policy_version 1643634 (0.0009) [2023-12-26 12:43:14,124][123091] Updated weights for policy 0, policy_version 1643644 (0.0009) [2023-12-26 12:43:14,173][123091] Updated weights for policy 0, policy_version 1643654 (0.0008) [2023-12-26 12:43:14,225][123091] Updated weights for policy 0, policy_version 1643664 (0.0009) [2023-12-26 12:43:14,585][123090] Updated weights for policy 1, policy_version 1632867 (0.0010) [2023-12-26 12:43:14,648][123090] Updated weights for policy 1, policy_version 1632877 (0.0009) [2023-12-26 12:43:14,703][123090] Updated weights for policy 1, policy_version 1632887 (0.0009) [2023-12-26 12:43:15,113][123091] Updated weights for policy 0, policy_version 1643674 (0.0006) [2023-12-26 12:43:15,184][123091] Updated weights for policy 0, policy_version 1643684 (0.0006) [2023-12-26 12:43:15,252][123091] Updated weights for policy 0, policy_version 1643694 (0.0008) [2023-12-26 12:43:15,572][123090] Updated weights for policy 1, policy_version 1632897 (0.0009) [2023-12-26 12:43:15,632][123090] Updated weights for policy 1, policy_version 1632907 (0.0009) [2023-12-26 12:43:15,692][123090] Updated weights for policy 1, policy_version 1632917 (0.0009) [2023-12-26 12:43:15,753][123090] Updated weights for policy 1, policy_version 1632927 (0.0009) [2023-12-26 12:43:15,997][123091] Updated weights for policy 0, policy_version 1643704 (0.0010) [2023-12-26 12:43:16,055][123091] Updated weights for policy 0, policy_version 1643714 (0.0010) [2023-12-26 12:43:16,124][123091] Updated weights for policy 0, policy_version 1643724 (0.0010) [2023-12-26 12:43:16,546][123090] Updated weights for policy 1, policy_version 1632937 (0.0007) [2023-12-26 12:43:16,594][123090] Updated weights for policy 1, policy_version 1632948 (0.0009) [2023-12-26 12:43:16,642][123090] Updated weights for policy 1, policy_version 1632958 (0.0009) [2023-12-26 12:43:16,990][123091] Updated weights for policy 0, policy_version 1643734 (0.0009) [2023-12-26 12:43:17,044][123091] Updated weights for policy 0, policy_version 1643744 (0.0010) [2023-12-26 12:43:17,100][123091] Updated weights for policy 0, policy_version 1643754 (0.0010) [2023-12-26 12:43:17,501][123090] Updated weights for policy 1, policy_version 1632968 (0.0010) [2023-12-26 12:43:17,565][123090] Updated weights for policy 1, policy_version 1632978 (0.0011) [2023-12-26 12:43:17,633][123090] Updated weights for policy 1, policy_version 1632988 (0.0011) [2023-12-26 12:43:17,953][123091] Updated weights for policy 0, policy_version 1643764 (0.0010) [2023-12-26 12:43:18,012][123091] Updated weights for policy 0, policy_version 1643774 (0.0005) [2023-12-26 12:43:18,064][123091] Updated weights for policy 0, policy_version 1643784 (0.0005) [2023-12-26 12:43:18,446][123090] Updated weights for policy 1, policy_version 1632998 (0.0010) [2023-12-26 12:43:18,517][123090] Updated weights for policy 1, policy_version 1633008 (0.0006) [2023-12-26 12:43:18,589][123090] Updated weights for policy 1, policy_version 1633018 (0.0005) [2023-12-26 12:43:18,746][123091] Updated weights for policy 0, policy_version 1643794 (0.0005) [2023-12-26 12:43:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 838868992. Throughput: 0: 8689.0, 1: 8955.5. Samples: 838881696. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:18,785][121949] Avg episode reward: [(0, '6081.429'), (1, '5782.363')] [2023-12-26 12:43:18,825][123091] Updated weights for policy 0, policy_version 1643804 (0.0005) [2023-12-26 12:43:18,895][123091] Updated weights for policy 0, policy_version 1643814 (0.0009) [2023-12-26 12:43:18,959][123091] Updated weights for policy 0, policy_version 1643824 (0.0011) [2023-12-26 12:43:19,325][123090] Updated weights for policy 1, policy_version 1633028 (0.0006) [2023-12-26 12:43:19,397][123090] Updated weights for policy 1, policy_version 1633038 (0.0010) [2023-12-26 12:43:19,468][123090] Updated weights for policy 1, policy_version 1633048 (0.0010) [2023-12-26 12:43:19,765][123091] Updated weights for policy 0, policy_version 1643834 (0.0009) [2023-12-26 12:43:19,842][123091] Updated weights for policy 0, policy_version 1643844 (0.0009) [2023-12-26 12:43:19,903][123091] Updated weights for policy 0, policy_version 1643854 (0.0009) [2023-12-26 12:43:20,251][123090] Updated weights for policy 1, policy_version 1633058 (0.0009) [2023-12-26 12:43:20,312][123090] Updated weights for policy 1, policy_version 1633068 (0.0006) [2023-12-26 12:43:20,373][123090] Updated weights for policy 1, policy_version 1633078 (0.0008) [2023-12-26 12:43:20,435][123090] Updated weights for policy 1, policy_version 1633088 (0.0010) [2023-12-26 12:43:20,714][123091] Updated weights for policy 0, policy_version 1643864 (0.0010) [2023-12-26 12:43:20,779][123091] Updated weights for policy 0, policy_version 1643874 (0.0011) [2023-12-26 12:43:20,834][123091] Updated weights for policy 0, policy_version 1643884 (0.0006) [2023-12-26 12:43:21,259][123090] Updated weights for policy 1, policy_version 1633098 (0.0011) [2023-12-26 12:43:21,327][123090] Updated weights for policy 1, policy_version 1633108 (0.0010) [2023-12-26 12:43:21,405][123090] Updated weights for policy 1, policy_version 1633118 (0.0010) [2023-12-26 12:43:21,552][123091] Updated weights for policy 0, policy_version 1643894 (0.0008) [2023-12-26 12:43:21,613][123091] Updated weights for policy 0, policy_version 1643904 (0.0009) [2023-12-26 12:43:21,688][123091] Updated weights for policy 0, policy_version 1643914 (0.0008) [2023-12-26 12:43:22,185][123090] Updated weights for policy 1, policy_version 1633128 (0.0006) [2023-12-26 12:43:22,253][123090] Updated weights for policy 1, policy_version 1633138 (0.0006) [2023-12-26 12:43:22,319][123090] Updated weights for policy 1, policy_version 1633148 (0.0006) [2023-12-26 12:43:22,461][123091] Updated weights for policy 0, policy_version 1643924 (0.0008) [2023-12-26 12:43:22,529][123091] Updated weights for policy 0, policy_version 1643934 (0.0009) [2023-12-26 12:43:22,585][123091] Updated weights for policy 0, policy_version 1643944 (0.0009) [2023-12-26 12:43:23,107][123090] Updated weights for policy 1, policy_version 1633158 (0.0009) [2023-12-26 12:43:23,165][123090] Updated weights for policy 1, policy_version 1633168 (0.0010) [2023-12-26 12:43:23,233][123090] Updated weights for policy 1, policy_version 1633178 (0.0009) [2023-12-26 12:43:23,395][123091] Updated weights for policy 0, policy_version 1643954 (0.0008) [2023-12-26 12:43:23,444][123091] Updated weights for policy 0, policy_version 1643964 (0.0006) [2023-12-26 12:43:23,492][123091] Updated weights for policy 0, policy_version 1643974 (0.0009) [2023-12-26 12:43:23,546][123091] Updated weights for policy 0, policy_version 1643984 (0.0009) [2023-12-26 12:43:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 838959104. Throughput: 0: 8687.0, 1: 8980.5. Samples: 838933984. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:23,785][121949] Avg episode reward: [(0, '6024.989'), (1, '5855.614')] [2023-12-26 12:43:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001643984_420864000.pth... [2023-12-26 12:43:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001633184_418095104.pth... [2023-12-26 12:43:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001632160_417832960.pth [2023-12-26 12:43:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001642960_420601856.pth [2023-12-26 12:43:24,124][123090] Updated weights for policy 1, policy_version 1633188 (0.0009) [2023-12-26 12:43:24,184][123090] Updated weights for policy 1, policy_version 1633198 (0.0010) [2023-12-26 12:43:24,215][123091] Updated weights for policy 0, policy_version 1643994 (0.0005) [2023-12-26 12:43:24,234][123090] Updated weights for policy 1, policy_version 1633208 (0.0009) [2023-12-26 12:43:24,272][123091] Updated weights for policy 0, policy_version 1644004 (0.0007) [2023-12-26 12:43:24,335][123091] Updated weights for policy 0, policy_version 1644014 (0.0005) [2023-12-26 12:43:24,944][123090] Updated weights for policy 1, policy_version 1633218 (0.0009) [2023-12-26 12:43:25,008][123090] Updated weights for policy 1, policy_version 1633228 (0.0005) [2023-12-26 12:43:25,061][123090] Updated weights for policy 1, policy_version 1633238 (0.0005) [2023-12-26 12:43:25,094][123091] Updated weights for policy 0, policy_version 1644024 (0.0005) [2023-12-26 12:43:25,109][123090] Updated weights for policy 1, policy_version 1633248 (0.0005) [2023-12-26 12:43:25,139][123091] Updated weights for policy 0, policy_version 1644034 (0.0005) [2023-12-26 12:43:25,192][123091] Updated weights for policy 0, policy_version 1644044 (0.0005) [2023-12-26 12:43:25,848][123090] Updated weights for policy 1, policy_version 1633258 (0.0008) [2023-12-26 12:43:25,855][123091] Updated weights for policy 0, policy_version 1644054 (0.0007) [2023-12-26 12:43:25,902][123091] Updated weights for policy 0, policy_version 1644064 (0.0009) [2023-12-26 12:43:25,912][123090] Updated weights for policy 1, policy_version 1633268 (0.0009) [2023-12-26 12:43:25,948][123091] Updated weights for policy 0, policy_version 1644074 (0.0008) [2023-12-26 12:43:25,964][123090] Updated weights for policy 1, policy_version 1633278 (0.0008) [2023-12-26 12:43:26,695][123091] Updated weights for policy 0, policy_version 1644084 (0.0007) [2023-12-26 12:43:26,756][123091] Updated weights for policy 0, policy_version 1644094 (0.0007) [2023-12-26 12:43:26,810][123091] Updated weights for policy 0, policy_version 1644104 (0.0010) [2023-12-26 12:43:26,882][123090] Updated weights for policy 1, policy_version 1633288 (0.0009) [2023-12-26 12:43:26,928][123090] Updated weights for policy 1, policy_version 1633298 (0.0009) [2023-12-26 12:43:26,977][123090] Updated weights for policy 1, policy_version 1633308 (0.0009) [2023-12-26 12:43:27,625][123091] Updated weights for policy 0, policy_version 1644114 (0.0010) [2023-12-26 12:43:27,684][123091] Updated weights for policy 0, policy_version 1644124 (0.0009) [2023-12-26 12:43:27,744][123091] Updated weights for policy 0, policy_version 1644134 (0.0009) [2023-12-26 12:43:27,799][123091] Updated weights for policy 0, policy_version 1644144 (0.0008) [2023-12-26 12:43:27,811][123090] Updated weights for policy 1, policy_version 1633318 (0.0010) [2023-12-26 12:43:27,858][123090] Updated weights for policy 1, policy_version 1633328 (0.0009) [2023-12-26 12:43:27,916][123090] Updated weights for policy 1, policy_version 1633338 (0.0009) [2023-12-26 12:43:28,598][123091] Updated weights for policy 0, policy_version 1644154 (0.0005) [2023-12-26 12:43:28,666][123091] Updated weights for policy 0, policy_version 1644164 (0.0005) [2023-12-26 12:43:28,732][123091] Updated weights for policy 0, policy_version 1644174 (0.0006) [2023-12-26 12:43:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 839049216. Throughput: 0: 8849.4, 1: 8939.0. Samples: 839043128. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:28,784][121949] Avg episode reward: [(0, '6077.298'), (1, '5664.928')] [2023-12-26 12:43:28,806][123090] Updated weights for policy 1, policy_version 1633348 (0.0009) [2023-12-26 12:43:28,867][123090] Updated weights for policy 1, policy_version 1633358 (0.0009) [2023-12-26 12:43:28,929][123090] Updated weights for policy 1, policy_version 1633368 (0.0010) [2023-12-26 12:43:29,442][123091] Updated weights for policy 0, policy_version 1644184 (0.0006) [2023-12-26 12:43:29,499][123091] Updated weights for policy 0, policy_version 1644194 (0.0005) [2023-12-26 12:43:29,569][123091] Updated weights for policy 0, policy_version 1644204 (0.0005) [2023-12-26 12:43:29,810][123090] Updated weights for policy 1, policy_version 1633378 (0.0010) [2023-12-26 12:43:29,876][123090] Updated weights for policy 1, policy_version 1633388 (0.0009) [2023-12-26 12:43:29,929][123090] Updated weights for policy 1, policy_version 1633398 (0.0009) [2023-12-26 12:43:29,995][123090] Updated weights for policy 1, policy_version 1633408 (0.0010) [2023-12-26 12:43:30,262][123091] Updated weights for policy 0, policy_version 1644214 (0.0005) [2023-12-26 12:43:30,335][123091] Updated weights for policy 0, policy_version 1644224 (0.0005) [2023-12-26 12:43:30,407][123091] Updated weights for policy 0, policy_version 1644234 (0.0006) [2023-12-26 12:43:30,901][123090] Updated weights for policy 1, policy_version 1633418 (0.0008) [2023-12-26 12:43:30,950][123090] Updated weights for policy 1, policy_version 1633428 (0.0009) [2023-12-26 12:43:31,003][123090] Updated weights for policy 1, policy_version 1633440 (0.0010) [2023-12-26 12:43:31,099][123091] Updated weights for policy 0, policy_version 1644244 (0.0008) [2023-12-26 12:43:31,169][123091] Updated weights for policy 0, policy_version 1644254 (0.0008) [2023-12-26 12:43:31,233][123091] Updated weights for policy 0, policy_version 1644264 (0.0010) [2023-12-26 12:43:31,922][123090] Updated weights for policy 1, policy_version 1633450 (0.0009) [2023-12-26 12:43:31,983][123090] Updated weights for policy 1, policy_version 1633460 (0.0009) [2023-12-26 12:43:32,037][123090] Updated weights for policy 1, policy_version 1633470 (0.0010) [2023-12-26 12:43:32,056][123091] Updated weights for policy 0, policy_version 1644274 (0.0009) [2023-12-26 12:43:32,119][123091] Updated weights for policy 0, policy_version 1644284 (0.0008) [2023-12-26 12:43:32,188][123091] Updated weights for policy 0, policy_version 1644294 (0.0009) [2023-12-26 12:43:32,241][123091] Updated weights for policy 0, policy_version 1644304 (0.0010) [2023-12-26 12:43:32,857][123090] Updated weights for policy 1, policy_version 1633480 (0.0009) [2023-12-26 12:43:32,910][123090] Updated weights for policy 1, policy_version 1633490 (0.0008) [2023-12-26 12:43:32,980][123090] Updated weights for policy 1, policy_version 1633500 (0.0005) [2023-12-26 12:43:33,077][123091] Updated weights for policy 0, policy_version 1644314 (0.0010) [2023-12-26 12:43:33,125][123091] Updated weights for policy 0, policy_version 1644324 (0.0009) [2023-12-26 12:43:33,173][123091] Updated weights for policy 0, policy_version 1644335 (0.0010) [2023-12-26 12:43:33,649][123090] Updated weights for policy 1, policy_version 1633510 (0.0005) [2023-12-26 12:43:33,714][123090] Updated weights for policy 1, policy_version 1633520 (0.0006) [2023-12-26 12:43:33,781][123090] Updated weights for policy 1, policy_version 1633530 (0.0005) [2023-12-26 12:43:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 839131136. Throughput: 0: 8929.0, 1: 8810.1. Samples: 839147612. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:33,785][121949] Avg episode reward: [(0, '5980.870'), (1, '5774.116')] [2023-12-26 12:43:34,064][123091] Updated weights for policy 0, policy_version 1644345 (0.0006) [2023-12-26 12:43:34,126][123091] Updated weights for policy 0, policy_version 1644355 (0.0005) [2023-12-26 12:43:34,183][123091] Updated weights for policy 0, policy_version 1644365 (0.0007) [2023-12-26 12:43:34,482][123090] Updated weights for policy 1, policy_version 1633540 (0.0007) [2023-12-26 12:43:34,551][123090] Updated weights for policy 1, policy_version 1633550 (0.0009) [2023-12-26 12:43:34,609][123090] Updated weights for policy 1, policy_version 1633560 (0.0009) [2023-12-26 12:43:34,966][123091] Updated weights for policy 0, policy_version 1644375 (0.0008) [2023-12-26 12:43:35,029][123091] Updated weights for policy 0, policy_version 1644385 (0.0010) [2023-12-26 12:43:35,102][123091] Updated weights for policy 0, policy_version 1644396 (0.0010) [2023-12-26 12:43:35,476][123090] Updated weights for policy 1, policy_version 1633570 (0.0009) [2023-12-26 12:43:35,544][123090] Updated weights for policy 1, policy_version 1633580 (0.0010) [2023-12-26 12:43:35,617][123090] Updated weights for policy 1, policy_version 1633590 (0.0009) [2023-12-26 12:43:35,687][123090] Updated weights for policy 1, policy_version 1633600 (0.0009) [2023-12-26 12:43:35,807][123091] Updated weights for policy 0, policy_version 1644406 (0.0008) [2023-12-26 12:43:35,867][123091] Updated weights for policy 0, policy_version 1644416 (0.0010) [2023-12-26 12:43:35,919][123091] Updated weights for policy 0, policy_version 1644426 (0.0010) [2023-12-26 12:43:36,601][123090] Updated weights for policy 1, policy_version 1633610 (0.0010) [2023-12-26 12:43:36,615][123091] Updated weights for policy 0, policy_version 1644436 (0.0010) [2023-12-26 12:43:36,665][123090] Updated weights for policy 1, policy_version 1633620 (0.0008) [2023-12-26 12:43:36,675][123091] Updated weights for policy 0, policy_version 1644446 (0.0007) [2023-12-26 12:43:36,721][123090] Updated weights for policy 1, policy_version 1633630 (0.0007) [2023-12-26 12:43:36,731][123091] Updated weights for policy 0, policy_version 1644456 (0.0009) [2023-12-26 12:43:37,507][123091] Updated weights for policy 0, policy_version 1644466 (0.0008) [2023-12-26 12:43:37,569][123091] Updated weights for policy 0, policy_version 1644476 (0.0008) [2023-12-26 12:43:37,598][123090] Updated weights for policy 1, policy_version 1633640 (0.0009) [2023-12-26 12:43:37,630][123091] Updated weights for policy 0, policy_version 1644486 (0.0005) [2023-12-26 12:43:37,652][123090] Updated weights for policy 1, policy_version 1633650 (0.0009) [2023-12-26 12:43:37,694][123091] Updated weights for policy 0, policy_version 1644496 (0.0008) [2023-12-26 12:43:37,703][123090] Updated weights for policy 1, policy_version 1633660 (0.0010) [2023-12-26 12:43:38,485][123091] Updated weights for policy 0, policy_version 1644506 (0.0005) [2023-12-26 12:43:38,538][123091] Updated weights for policy 0, policy_version 1644516 (0.0005) [2023-12-26 12:43:38,602][123090] Updated weights for policy 1, policy_version 1633670 (0.0009) [2023-12-26 12:43:38,604][123091] Updated weights for policy 0, policy_version 1644526 (0.0008) [2023-12-26 12:43:38,665][123090] Updated weights for policy 1, policy_version 1633680 (0.0008) [2023-12-26 12:43:38,730][123090] Updated weights for policy 1, policy_version 1633690 (0.0009) [2023-12-26 12:43:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 839229440. Throughput: 0: 8987.4, 1: 8777.0. Samples: 839201412. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:38,785][121949] Avg episode reward: [(0, '5963.210'), (1, '5806.531')] [2023-12-26 12:43:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001644528_421003264.pth... [2023-12-26 12:43:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001633696_418226176.pth... [2023-12-26 12:43:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001643472_420732928.pth [2023-12-26 12:43:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001632672_417964032.pth [2023-12-26 12:43:39,416][123091] Updated weights for policy 0, policy_version 1644536 (0.0009) [2023-12-26 12:43:39,480][123091] Updated weights for policy 0, policy_version 1644546 (0.0007) [2023-12-26 12:43:39,542][123091] Updated weights for policy 0, policy_version 1644556 (0.0008) [2023-12-26 12:43:39,599][123090] Updated weights for policy 1, policy_version 1633700 (0.0009) [2023-12-26 12:43:39,663][123090] Updated weights for policy 1, policy_version 1633710 (0.0010) [2023-12-26 12:43:39,726][123090] Updated weights for policy 1, policy_version 1633720 (0.0010) [2023-12-26 12:43:40,361][123091] Updated weights for policy 0, policy_version 1644566 (0.0009) [2023-12-26 12:43:40,432][123091] Updated weights for policy 0, policy_version 1644576 (0.0010) [2023-12-26 12:43:40,498][123091] Updated weights for policy 0, policy_version 1644586 (0.0010) [2023-12-26 12:43:40,580][123090] Updated weights for policy 1, policy_version 1633730 (0.0009) [2023-12-26 12:43:40,650][123090] Updated weights for policy 1, policy_version 1633740 (0.0010) [2023-12-26 12:43:40,721][123090] Updated weights for policy 1, policy_version 1633750 (0.0006) [2023-12-26 12:43:40,786][123090] Updated weights for policy 1, policy_version 1633760 (0.0005) [2023-12-26 12:43:41,236][123091] Updated weights for policy 0, policy_version 1644596 (0.0009) [2023-12-26 12:43:41,308][123091] Updated weights for policy 0, policy_version 1644606 (0.0006) [2023-12-26 12:43:41,385][123091] Updated weights for policy 0, policy_version 1644616 (0.0007) [2023-12-26 12:43:41,553][123090] Updated weights for policy 1, policy_version 1633770 (0.0007) [2023-12-26 12:43:41,623][123090] Updated weights for policy 1, policy_version 1633780 (0.0008) [2023-12-26 12:43:41,698][123090] Updated weights for policy 1, policy_version 1633790 (0.0009) [2023-12-26 12:43:42,219][123091] Updated weights for policy 0, policy_version 1644626 (0.0010) [2023-12-26 12:43:42,278][123091] Updated weights for policy 0, policy_version 1644636 (0.0009) [2023-12-26 12:43:42,338][123091] Updated weights for policy 0, policy_version 1644646 (0.0008) [2023-12-26 12:43:42,402][123091] Updated weights for policy 0, policy_version 1644656 (0.0009) [2023-12-26 12:43:42,456][123090] Updated weights for policy 1, policy_version 1633800 (0.0007) [2023-12-26 12:43:42,527][123090] Updated weights for policy 1, policy_version 1633810 (0.0005) [2023-12-26 12:43:42,593][123090] Updated weights for policy 1, policy_version 1633820 (0.0008) [2023-12-26 12:43:43,263][123090] Updated weights for policy 1, policy_version 1633831 (0.0008) [2023-12-26 12:43:43,265][123091] Updated weights for policy 0, policy_version 1644666 (0.0008) [2023-12-26 12:43:43,315][123090] Updated weights for policy 1, policy_version 1633841 (0.0007) [2023-12-26 12:43:43,318][123091] Updated weights for policy 0, policy_version 1644676 (0.0008) [2023-12-26 12:43:43,370][123091] Updated weights for policy 0, policy_version 1644686 (0.0008) [2023-12-26 12:43:43,370][123090] Updated weights for policy 1, policy_version 1633851 (0.0010) [2023-12-26 12:43:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 839311360. Throughput: 0: 8946.2, 1: 8622.9. Samples: 839304408. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:43,785][121949] Avg episode reward: [(0, '6029.053'), (1, '5824.136')] [2023-12-26 12:43:44,072][123090] Updated weights for policy 1, policy_version 1633861 (0.0010) [2023-12-26 12:43:44,120][123090] Updated weights for policy 1, policy_version 1633871 (0.0007) [2023-12-26 12:43:44,168][123090] Updated weights for policy 1, policy_version 1633881 (0.0009) [2023-12-26 12:43:44,232][123091] Updated weights for policy 0, policy_version 1644696 (0.0009) [2023-12-26 12:43:44,293][123091] Updated weights for policy 0, policy_version 1644707 (0.0010) [2023-12-26 12:43:44,367][123091] Updated weights for policy 0, policy_version 1644717 (0.0009) [2023-12-26 12:43:44,817][123090] Updated weights for policy 1, policy_version 1633891 (0.0008) [2023-12-26 12:43:44,871][123090] Updated weights for policy 1, policy_version 1633901 (0.0009) [2023-12-26 12:43:44,926][123090] Updated weights for policy 1, policy_version 1633911 (0.0009) [2023-12-26 12:43:45,222][123091] Updated weights for policy 0, policy_version 1644727 (0.0010) [2023-12-26 12:43:45,284][123091] Updated weights for policy 0, policy_version 1644737 (0.0008) [2023-12-26 12:43:45,342][123091] Updated weights for policy 0, policy_version 1644747 (0.0010) [2023-12-26 12:43:45,770][123090] Updated weights for policy 1, policy_version 1633921 (0.0009) [2023-12-26 12:43:45,834][123090] Updated weights for policy 1, policy_version 1633931 (0.0009) [2023-12-26 12:43:45,892][123090] Updated weights for policy 1, policy_version 1633941 (0.0009) [2023-12-26 12:43:45,953][123090] Updated weights for policy 1, policy_version 1633951 (0.0009) [2023-12-26 12:43:46,192][123091] Updated weights for policy 0, policy_version 1644757 (0.0010) [2023-12-26 12:43:46,264][123091] Updated weights for policy 0, policy_version 1644767 (0.0009) [2023-12-26 12:43:46,344][123091] Updated weights for policy 0, policy_version 1644777 (0.0009) [2023-12-26 12:43:46,671][123090] Updated weights for policy 1, policy_version 1633961 (0.0005) [2023-12-26 12:43:46,729][123090] Updated weights for policy 1, policy_version 1633971 (0.0006) [2023-12-26 12:43:46,790][123090] Updated weights for policy 1, policy_version 1633981 (0.0005) [2023-12-26 12:43:47,084][123091] Updated weights for policy 0, policy_version 1644787 (0.0009) [2023-12-26 12:43:47,156][123091] Updated weights for policy 0, policy_version 1644797 (0.0005) [2023-12-26 12:43:47,230][123091] Updated weights for policy 0, policy_version 1644807 (0.0006) [2023-12-26 12:43:47,603][123090] Updated weights for policy 1, policy_version 1633991 (0.0008) [2023-12-26 12:43:47,670][123090] Updated weights for policy 1, policy_version 1634001 (0.0010) [2023-12-26 12:43:47,732][123090] Updated weights for policy 1, policy_version 1634011 (0.0010) [2023-12-26 12:43:47,834][123091] Updated weights for policy 0, policy_version 1644817 (0.0008) [2023-12-26 12:43:47,899][123091] Updated weights for policy 0, policy_version 1644827 (0.0008) [2023-12-26 12:43:47,950][123091] Updated weights for policy 0, policy_version 1644837 (0.0005) [2023-12-26 12:43:48,006][123091] Updated weights for policy 0, policy_version 1644847 (0.0005) [2023-12-26 12:43:48,597][123090] Updated weights for policy 1, policy_version 1634021 (0.0009) [2023-12-26 12:43:48,655][123090] Updated weights for policy 1, policy_version 1634031 (0.0009) [2023-12-26 12:43:48,706][123090] Updated weights for policy 1, policy_version 1634041 (0.0009) [2023-12-26 12:43:48,719][123091] Updated weights for policy 0, policy_version 1644857 (0.0008) [2023-12-26 12:43:48,783][123091] Updated weights for policy 0, policy_version 1644867 (0.0005) [2023-12-26 12:43:48,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 839401472. Throughput: 0: 8927.1, 1: 8709.8. Samples: 839413412. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:48,785][121949] Avg episode reward: [(0, '6093.311'), (1, '5751.115')] [2023-12-26 12:43:48,859][123091] Updated weights for policy 0, policy_version 1644877 (0.0005) [2023-12-26 12:43:49,542][123091] Updated weights for policy 0, policy_version 1644887 (0.0007) [2023-12-26 12:43:49,587][123090] Updated weights for policy 1, policy_version 1634051 (0.0008) [2023-12-26 12:43:49,600][123091] Updated weights for policy 0, policy_version 1644897 (0.0008) [2023-12-26 12:43:49,651][123090] Updated weights for policy 1, policy_version 1634061 (0.0007) [2023-12-26 12:43:49,658][123091] Updated weights for policy 0, policy_version 1644907 (0.0008) [2023-12-26 12:43:49,706][123090] Updated weights for policy 1, policy_version 1634071 (0.0007) [2023-12-26 12:43:50,411][123091] Updated weights for policy 0, policy_version 1644917 (0.0009) [2023-12-26 12:43:50,481][123091] Updated weights for policy 0, policy_version 1644927 (0.0008) [2023-12-26 12:43:50,535][123090] Updated weights for policy 1, policy_version 1634081 (0.0009) [2023-12-26 12:43:50,555][123091] Updated weights for policy 0, policy_version 1644937 (0.0006) [2023-12-26 12:43:50,612][123090] Updated weights for policy 1, policy_version 1634091 (0.0009) [2023-12-26 12:43:50,684][123090] Updated weights for policy 1, policy_version 1634101 (0.0008) [2023-12-26 12:43:50,757][123090] Updated weights for policy 1, policy_version 1634111 (0.0008) [2023-12-26 12:43:51,381][123091] Updated weights for policy 0, policy_version 1644947 (0.0010) [2023-12-26 12:43:51,438][123091] Updated weights for policy 0, policy_version 1644957 (0.0011) [2023-12-26 12:43:51,489][123091] Updated weights for policy 0, policy_version 1644967 (0.0009) [2023-12-26 12:43:51,496][123090] Updated weights for policy 1, policy_version 1634121 (0.0007) [2023-12-26 12:43:51,563][123090] Updated weights for policy 1, policy_version 1634131 (0.0005) [2023-12-26 12:43:51,634][123090] Updated weights for policy 1, policy_version 1634141 (0.0008) [2023-12-26 12:43:52,318][123091] Updated weights for policy 0, policy_version 1644977 (0.0009) [2023-12-26 12:43:52,377][123091] Updated weights for policy 0, policy_version 1644987 (0.0010) [2023-12-26 12:43:52,435][123091] Updated weights for policy 0, policy_version 1644997 (0.0009) [2023-12-26 12:43:52,479][123090] Updated weights for policy 1, policy_version 1634151 (0.0009) [2023-12-26 12:43:52,495][123091] Updated weights for policy 0, policy_version 1645007 (0.0010) [2023-12-26 12:43:52,543][123090] Updated weights for policy 1, policy_version 1634161 (0.0008) [2023-12-26 12:43:52,616][123090] Updated weights for policy 1, policy_version 1634171 (0.0005) [2023-12-26 12:43:53,285][123091] Updated weights for policy 0, policy_version 1645017 (0.0010) [2023-12-26 12:43:53,337][123091] Updated weights for policy 0, policy_version 1645027 (0.0008) [2023-12-26 12:43:53,385][123091] Updated weights for policy 0, policy_version 1645037 (0.0009) [2023-12-26 12:43:53,424][123090] Updated weights for policy 1, policy_version 1634181 (0.0006) [2023-12-26 12:43:53,494][123090] Updated weights for policy 1, policy_version 1634191 (0.0009) [2023-12-26 12:43:53,553][123090] Updated weights for policy 1, policy_version 1634201 (0.0009) [2023-12-26 12:43:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.1). Total num frames: 839491584. Throughput: 0: 8939.5, 1: 8683.6. Samples: 839466708. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:53,785][121949] Avg episode reward: [(0, '5963.585'), (1, '5762.600')] [2023-12-26 12:43:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001645040_421134336.pth... [2023-12-26 12:43:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001634208_418357248.pth... [2023-12-26 12:43:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001633184_418095104.pth [2023-12-26 12:43:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001643984_420864000.pth [2023-12-26 12:43:54,196][123091] Updated weights for policy 0, policy_version 1645047 (0.0007) [2023-12-26 12:43:54,267][123091] Updated weights for policy 0, policy_version 1645057 (0.0006) [2023-12-26 12:43:54,329][123091] Updated weights for policy 0, policy_version 1645067 (0.0005) [2023-12-26 12:43:54,385][123090] Updated weights for policy 1, policy_version 1634211 (0.0009) [2023-12-26 12:43:54,438][123090] Updated weights for policy 1, policy_version 1634221 (0.0009) [2023-12-26 12:43:54,491][123090] Updated weights for policy 1, policy_version 1634231 (0.0009) [2023-12-26 12:43:54,864][123091] Updated weights for policy 0, policy_version 1645077 (0.0006) [2023-12-26 12:43:54,915][123091] Updated weights for policy 0, policy_version 1645087 (0.0010) [2023-12-26 12:43:54,971][123091] Updated weights for policy 0, policy_version 1645097 (0.0007) [2023-12-26 12:43:55,269][123090] Updated weights for policy 1, policy_version 1634241 (0.0009) [2023-12-26 12:43:55,322][123090] Updated weights for policy 1, policy_version 1634251 (0.0006) [2023-12-26 12:43:55,380][123090] Updated weights for policy 1, policy_version 1634261 (0.0005) [2023-12-26 12:43:55,445][123090] Updated weights for policy 1, policy_version 1634271 (0.0005) [2023-12-26 12:43:55,718][123091] Updated weights for policy 0, policy_version 1645107 (0.0005) [2023-12-26 12:43:55,773][123091] Updated weights for policy 0, policy_version 1645117 (0.0005) [2023-12-26 12:43:55,827][123091] Updated weights for policy 0, policy_version 1645127 (0.0005) [2023-12-26 12:43:56,145][123090] Updated weights for policy 1, policy_version 1634281 (0.0005) [2023-12-26 12:43:56,211][123090] Updated weights for policy 1, policy_version 1634291 (0.0005) [2023-12-26 12:43:56,265][123090] Updated weights for policy 1, policy_version 1634301 (0.0005) [2023-12-26 12:43:56,585][123091] Updated weights for policy 0, policy_version 1645137 (0.0007) [2023-12-26 12:43:56,640][123091] Updated weights for policy 0, policy_version 1645147 (0.0005) [2023-12-26 12:43:56,694][123091] Updated weights for policy 0, policy_version 1645157 (0.0005) [2023-12-26 12:43:56,762][123091] Updated weights for policy 0, policy_version 1645167 (0.0005) [2023-12-26 12:43:56,930][123090] Updated weights for policy 1, policy_version 1634311 (0.0008) [2023-12-26 12:43:56,985][123090] Updated weights for policy 1, policy_version 1634321 (0.0009) [2023-12-26 12:43:57,040][123090] Updated weights for policy 1, policy_version 1634331 (0.0008) [2023-12-26 12:43:57,407][123091] Updated weights for policy 0, policy_version 1645178 (0.0009) [2023-12-26 12:43:57,459][123091] Updated weights for policy 0, policy_version 1645189 (0.0010) [2023-12-26 12:43:57,509][123091] Updated weights for policy 0, policy_version 1645199 (0.0009) [2023-12-26 12:43:57,867][123090] Updated weights for policy 1, policy_version 1634341 (0.0009) [2023-12-26 12:43:57,918][123090] Updated weights for policy 1, policy_version 1634351 (0.0010) [2023-12-26 12:43:57,977][123090] Updated weights for policy 1, policy_version 1634361 (0.0010) [2023-12-26 12:43:58,387][123091] Updated weights for policy 0, policy_version 1645209 (0.0009) [2023-12-26 12:43:58,455][123091] Updated weights for policy 0, policy_version 1645219 (0.0010) [2023-12-26 12:43:58,522][123091] Updated weights for policy 0, policy_version 1645229 (0.0010) [2023-12-26 12:43:58,771][123090] Updated weights for policy 1, policy_version 1634371 (0.0006) [2023-12-26 12:43:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 839581696. Throughput: 0: 9063.8, 1: 8714.0. Samples: 839577276. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:43:58,785][121949] Avg episode reward: [(0, '5993.213'), (1, '5921.187')] [2023-12-26 12:43:58,845][123090] Updated weights for policy 1, policy_version 1634381 (0.0008) [2023-12-26 12:43:58,926][123090] Updated weights for policy 1, policy_version 1634391 (0.0007) [2023-12-26 12:43:59,407][123091] Updated weights for policy 0, policy_version 1645239 (0.0009) [2023-12-26 12:43:59,453][123091] Updated weights for policy 0, policy_version 1645249 (0.0006) [2023-12-26 12:43:59,499][123091] Updated weights for policy 0, policy_version 1645259 (0.0005) [2023-12-26 12:43:59,768][123090] Updated weights for policy 1, policy_version 1634401 (0.0008) [2023-12-26 12:43:59,833][123090] Updated weights for policy 1, policy_version 1634411 (0.0006) [2023-12-26 12:43:59,897][123090] Updated weights for policy 1, policy_version 1634421 (0.0006) [2023-12-26 12:43:59,963][123090] Updated weights for policy 1, policy_version 1634431 (0.0007) [2023-12-26 12:44:00,260][123091] Updated weights for policy 0, policy_version 1645269 (0.0008) [2023-12-26 12:44:00,328][123091] Updated weights for policy 0, policy_version 1645279 (0.0011) [2023-12-26 12:44:00,386][123091] Updated weights for policy 0, policy_version 1645289 (0.0006) [2023-12-26 12:44:00,660][123090] Updated weights for policy 1, policy_version 1634441 (0.0006) [2023-12-26 12:44:00,718][123090] Updated weights for policy 1, policy_version 1634451 (0.0005) [2023-12-26 12:44:00,780][123090] Updated weights for policy 1, policy_version 1634461 (0.0006) [2023-12-26 12:44:01,078][123091] Updated weights for policy 0, policy_version 1645299 (0.0010) [2023-12-26 12:44:01,148][123091] Updated weights for policy 0, policy_version 1645309 (0.0009) [2023-12-26 12:44:01,219][123091] Updated weights for policy 0, policy_version 1645319 (0.0006) [2023-12-26 12:44:01,546][123090] Updated weights for policy 1, policy_version 1634471 (0.0008) [2023-12-26 12:44:01,600][123090] Updated weights for policy 1, policy_version 1634482 (0.0010) [2023-12-26 12:44:01,674][123090] Updated weights for policy 1, policy_version 1634492 (0.0010) [2023-12-26 12:44:01,908][123091] Updated weights for policy 0, policy_version 1645329 (0.0006) [2023-12-26 12:44:01,961][123091] Updated weights for policy 0, policy_version 1645339 (0.0007) [2023-12-26 12:44:02,026][123091] Updated weights for policy 0, policy_version 1645349 (0.0008) [2023-12-26 12:44:02,090][123091] Updated weights for policy 0, policy_version 1645359 (0.0007) [2023-12-26 12:44:02,616][123090] Updated weights for policy 1, policy_version 1634502 (0.0009) [2023-12-26 12:44:02,669][123090] Updated weights for policy 1, policy_version 1634512 (0.0009) [2023-12-26 12:44:02,722][123090] Updated weights for policy 1, policy_version 1634522 (0.0009) [2023-12-26 12:44:02,851][123091] Updated weights for policy 0, policy_version 1645369 (0.0007) [2023-12-26 12:44:02,916][123091] Updated weights for policy 0, policy_version 1645379 (0.0011) [2023-12-26 12:44:02,979][123091] Updated weights for policy 0, policy_version 1645389 (0.0010) [2023-12-26 12:44:03,597][123090] Updated weights for policy 1, policy_version 1634532 (0.0009) [2023-12-26 12:44:03,645][123090] Updated weights for policy 1, policy_version 1634542 (0.0008) [2023-12-26 12:44:03,692][123090] Updated weights for policy 1, policy_version 1634552 (0.0007) [2023-12-26 12:44:03,709][123091] Updated weights for policy 0, policy_version 1645399 (0.0010) [2023-12-26 12:44:03,779][123091] Updated weights for policy 0, policy_version 1645409 (0.0005) [2023-12-26 12:44:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 839671808. Throughput: 0: 9104.1, 1: 8712.3. Samples: 839683436. Policy #0 lag: (min: 31.0, avg: 31.7, max: 55.0) [2023-12-26 12:44:03,785][121949] Avg episode reward: [(0, '6166.209'), (1, '5837.852')] [2023-12-26 12:44:03,847][123091] Updated weights for policy 0, policy_version 1645419 (0.0006) [2023-12-26 12:44:04,522][123091] Updated weights for policy 0, policy_version 1645429 (0.0006) [2023-12-26 12:44:04,576][123091] Updated weights for policy 0, policy_version 1645439 (0.0009) [2023-12-26 12:44:04,627][123090] Updated weights for policy 1, policy_version 1634562 (0.0008) [2023-12-26 12:44:04,628][123091] Updated weights for policy 0, policy_version 1645450 (0.0010) [2023-12-26 12:44:04,693][123090] Updated weights for policy 1, policy_version 1634572 (0.0007) [2023-12-26 12:44:04,745][123090] Updated weights for policy 1, policy_version 1634582 (0.0008) [2023-12-26 12:44:04,793][123090] Updated weights for policy 1, policy_version 1634592 (0.0009) [2023-12-26 12:44:05,300][123091] Updated weights for policy 0, policy_version 1645460 (0.0009) [2023-12-26 12:44:05,360][123091] Updated weights for policy 0, policy_version 1645470 (0.0007) [2023-12-26 12:44:05,417][123091] Updated weights for policy 0, policy_version 1645481 (0.0010) [2023-12-26 12:44:05,575][123090] Updated weights for policy 1, policy_version 1634602 (0.0008) [2023-12-26 12:44:05,642][123090] Updated weights for policy 1, policy_version 1634612 (0.0006) [2023-12-26 12:44:05,705][123090] Updated weights for policy 1, policy_version 1634622 (0.0005) [2023-12-26 12:44:06,209][123091] Updated weights for policy 0, policy_version 1645491 (0.0009) [2023-12-26 12:44:06,276][123091] Updated weights for policy 0, policy_version 1645501 (0.0008) [2023-12-26 12:44:06,339][123091] Updated weights for policy 0, policy_version 1645511 (0.0008) [2023-12-26 12:44:06,460][123090] Updated weights for policy 1, policy_version 1634632 (0.0008) [2023-12-26 12:44:06,523][123090] Updated weights for policy 1, policy_version 1634642 (0.0009) [2023-12-26 12:44:06,587][123090] Updated weights for policy 1, policy_version 1634652 (0.0010) [2023-12-26 12:44:07,187][123091] Updated weights for policy 0, policy_version 1645521 (0.0010) [2023-12-26 12:44:07,250][123091] Updated weights for policy 0, policy_version 1645531 (0.0009) [2023-12-26 12:44:07,311][123091] Updated weights for policy 0, policy_version 1645541 (0.0010) [2023-12-26 12:44:07,337][123090] Updated weights for policy 1, policy_version 1634662 (0.0008) [2023-12-26 12:44:07,381][123091] Updated weights for policy 0, policy_version 1645551 (0.0009) [2023-12-26 12:44:07,400][123090] Updated weights for policy 1, policy_version 1634672 (0.0005) [2023-12-26 12:44:07,461][123090] Updated weights for policy 1, policy_version 1634682 (0.0006) [2023-12-26 12:44:08,174][123091] Updated weights for policy 0, policy_version 1645561 (0.0006) [2023-12-26 12:44:08,238][123091] Updated weights for policy 0, policy_version 1645571 (0.0005) [2023-12-26 12:44:08,244][123090] Updated weights for policy 1, policy_version 1634692 (0.0008) [2023-12-26 12:44:08,292][123091] Updated weights for policy 0, policy_version 1645581 (0.0005) [2023-12-26 12:44:08,308][123090] Updated weights for policy 1, policy_version 1634702 (0.0011) [2023-12-26 12:44:08,384][123090] Updated weights for policy 1, policy_version 1634712 (0.0011) [2023-12-26 12:44:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 839761920. Throughput: 0: 9163.6, 1: 8705.1. Samples: 839738080. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:08,785][121949] Avg episode reward: [(0, '6194.926'), (1, '5846.242')] [2023-12-26 12:44:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001645584_421273600.pth... [2023-12-26 12:44:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001634720_418488320.pth... [2023-12-26 12:44:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001644528_421003264.pth [2023-12-26 12:44:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001633696_418226176.pth [2023-12-26 12:44:09,061][123091] Updated weights for policy 0, policy_version 1645591 (0.0008) [2023-12-26 12:44:09,120][123091] Updated weights for policy 0, policy_version 1645601 (0.0008) [2023-12-26 12:44:09,180][123091] Updated weights for policy 0, policy_version 1645611 (0.0009) [2023-12-26 12:44:09,214][123090] Updated weights for policy 1, policy_version 1634722 (0.0011) [2023-12-26 12:44:09,287][123090] Updated weights for policy 1, policy_version 1634732 (0.0010) [2023-12-26 12:44:09,347][123090] Updated weights for policy 1, policy_version 1634742 (0.0010) [2023-12-26 12:44:09,419][123090] Updated weights for policy 1, policy_version 1634752 (0.0008) [2023-12-26 12:44:09,979][123091] Updated weights for policy 0, policy_version 1645621 (0.0009) [2023-12-26 12:44:10,054][123091] Updated weights for policy 0, policy_version 1645631 (0.0006) [2023-12-26 12:44:10,126][123091] Updated weights for policy 0, policy_version 1645641 (0.0008) [2023-12-26 12:44:10,165][123090] Updated weights for policy 1, policy_version 1634762 (0.0011) [2023-12-26 12:44:10,238][123090] Updated weights for policy 1, policy_version 1634772 (0.0009) [2023-12-26 12:44:10,306][123090] Updated weights for policy 1, policy_version 1634782 (0.0011) [2023-12-26 12:44:10,831][123091] Updated weights for policy 0, policy_version 1645651 (0.0006) [2023-12-26 12:44:10,890][123091] Updated weights for policy 0, policy_version 1645661 (0.0005) [2023-12-26 12:44:10,954][123091] Updated weights for policy 0, policy_version 1645671 (0.0005) [2023-12-26 12:44:11,121][123090] Updated weights for policy 1, policy_version 1634792 (0.0008) [2023-12-26 12:44:11,195][123090] Updated weights for policy 1, policy_version 1634802 (0.0008) [2023-12-26 12:44:11,257][123090] Updated weights for policy 1, policy_version 1634812 (0.0009) [2023-12-26 12:44:11,749][123091] Updated weights for policy 0, policy_version 1645681 (0.0010) [2023-12-26 12:44:11,813][123091] Updated weights for policy 0, policy_version 1645691 (0.0009) [2023-12-26 12:44:11,865][123091] Updated weights for policy 0, policy_version 1645701 (0.0009) [2023-12-26 12:44:11,931][123091] Updated weights for policy 0, policy_version 1645711 (0.0009) [2023-12-26 12:44:12,111][123090] Updated weights for policy 1, policy_version 1634822 (0.0009) [2023-12-26 12:44:12,172][123090] Updated weights for policy 1, policy_version 1634832 (0.0009) [2023-12-26 12:44:12,236][123090] Updated weights for policy 1, policy_version 1634842 (0.0010) [2023-12-26 12:44:12,737][123091] Updated weights for policy 0, policy_version 1645721 (0.0006) [2023-12-26 12:44:12,807][123091] Updated weights for policy 0, policy_version 1645731 (0.0011) [2023-12-26 12:44:12,875][123091] Updated weights for policy 0, policy_version 1645741 (0.0011) [2023-12-26 12:44:13,131][123090] Updated weights for policy 1, policy_version 1634852 (0.0009) [2023-12-26 12:44:13,193][123090] Updated weights for policy 1, policy_version 1634862 (0.0009) [2023-12-26 12:44:13,252][123090] Updated weights for policy 1, policy_version 1634873 (0.0010) [2023-12-26 12:44:13,566][123091] Updated weights for policy 0, policy_version 1645751 (0.0007) [2023-12-26 12:44:13,626][123091] Updated weights for policy 0, policy_version 1645761 (0.0005) [2023-12-26 12:44:13,673][123091] Updated weights for policy 0, policy_version 1645771 (0.0005) [2023-12-26 12:44:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 839852032. Throughput: 0: 9082.0, 1: 8697.5. Samples: 839843208. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:13,785][121949] Avg episode reward: [(0, '6083.094'), (1, '5952.203')] [2023-12-26 12:44:14,191][123090] Updated weights for policy 1, policy_version 1634883 (0.0010) [2023-12-26 12:44:14,249][123090] Updated weights for policy 1, policy_version 1634893 (0.0010) [2023-12-26 12:44:14,299][123091] Updated weights for policy 0, policy_version 1645781 (0.0005) [2023-12-26 12:44:14,307][123090] Updated weights for policy 1, policy_version 1634903 (0.0009) [2023-12-26 12:44:14,350][123091] Updated weights for policy 0, policy_version 1645791 (0.0005) [2023-12-26 12:44:14,404][123091] Updated weights for policy 0, policy_version 1645801 (0.0007) [2023-12-26 12:44:15,151][123090] Updated weights for policy 1, policy_version 1634913 (0.0010) [2023-12-26 12:44:15,183][123091] Updated weights for policy 0, policy_version 1645811 (0.0010) [2023-12-26 12:44:15,212][123090] Updated weights for policy 1, policy_version 1634923 (0.0007) [2023-12-26 12:44:15,251][123091] Updated weights for policy 0, policy_version 1645821 (0.0011) [2023-12-26 12:44:15,277][123090] Updated weights for policy 1, policy_version 1634933 (0.0010) [2023-12-26 12:44:15,314][123091] Updated weights for policy 0, policy_version 1645831 (0.0011) [2023-12-26 12:44:15,339][123090] Updated weights for policy 1, policy_version 1634943 (0.0009) [2023-12-26 12:44:16,143][123091] Updated weights for policy 0, policy_version 1645841 (0.0011) [2023-12-26 12:44:16,155][123090] Updated weights for policy 1, policy_version 1634953 (0.0008) [2023-12-26 12:44:16,191][123091] Updated weights for policy 0, policy_version 1645851 (0.0010) [2023-12-26 12:44:16,207][123090] Updated weights for policy 1, policy_version 1634963 (0.0005) [2023-12-26 12:44:16,243][123091] Updated weights for policy 0, policy_version 1645861 (0.0010) [2023-12-26 12:44:16,258][123090] Updated weights for policy 1, policy_version 1634973 (0.0006) [2023-12-26 12:44:16,294][123091] Updated weights for policy 0, policy_version 1645871 (0.0010) [2023-12-26 12:44:17,002][123091] Updated weights for policy 0, policy_version 1645881 (0.0006) [2023-12-26 12:44:17,062][123091] Updated weights for policy 0, policy_version 1645891 (0.0006) [2023-12-26 12:44:17,126][123091] Updated weights for policy 0, policy_version 1645901 (0.0005) [2023-12-26 12:44:17,186][123090] Updated weights for policy 1, policy_version 1634983 (0.0009) [2023-12-26 12:44:17,239][123090] Updated weights for policy 1, policy_version 1634993 (0.0010) [2023-12-26 12:44:17,292][123090] Updated weights for policy 1, policy_version 1635003 (0.0010) [2023-12-26 12:44:17,799][123091] Updated weights for policy 0, policy_version 1645911 (0.0005) [2023-12-26 12:44:17,867][123091] Updated weights for policy 0, policy_version 1645921 (0.0006) [2023-12-26 12:44:17,939][123091] Updated weights for policy 0, policy_version 1645931 (0.0006) [2023-12-26 12:44:18,233][123090] Updated weights for policy 1, policy_version 1635013 (0.0009) [2023-12-26 12:44:18,287][123090] Updated weights for policy 1, policy_version 1635023 (0.0009) [2023-12-26 12:44:18,373][123090] Updated weights for policy 1, policy_version 1635033 (0.0009) [2023-12-26 12:44:18,706][123091] Updated weights for policy 0, policy_version 1645941 (0.0008) [2023-12-26 12:44:18,761][123091] Updated weights for policy 0, policy_version 1645951 (0.0010) [2023-12-26 12:44:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 839933952. Throughput: 0: 9167.9, 1: 8640.0. Samples: 839948968. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:18,785][121949] Avg episode reward: [(0, '5775.335'), (1, '6004.742')] [2023-12-26 12:44:18,830][123091] Updated weights for policy 0, policy_version 1645961 (0.0011) [2023-12-26 12:44:19,205][123090] Updated weights for policy 1, policy_version 1635043 (0.0009) [2023-12-26 12:44:19,271][123090] Updated weights for policy 1, policy_version 1635053 (0.0008) [2023-12-26 12:44:19,333][123090] Updated weights for policy 1, policy_version 1635063 (0.0008) [2023-12-26 12:44:19,657][123091] Updated weights for policy 0, policy_version 1645971 (0.0011) [2023-12-26 12:44:19,724][123091] Updated weights for policy 0, policy_version 1645981 (0.0009) [2023-12-26 12:44:19,782][123091] Updated weights for policy 0, policy_version 1645991 (0.0010) [2023-12-26 12:44:20,178][123090] Updated weights for policy 1, policy_version 1635073 (0.0009) [2023-12-26 12:44:20,248][123090] Updated weights for policy 1, policy_version 1635083 (0.0010) [2023-12-26 12:44:20,322][123090] Updated weights for policy 1, policy_version 1635093 (0.0009) [2023-12-26 12:44:20,380][123090] Updated weights for policy 1, policy_version 1635103 (0.0010) [2023-12-26 12:44:20,530][123091] Updated weights for policy 0, policy_version 1646001 (0.0010) [2023-12-26 12:44:20,609][123091] Updated weights for policy 0, policy_version 1646011 (0.0007) [2023-12-26 12:44:20,683][123091] Updated weights for policy 0, policy_version 1646021 (0.0010) [2023-12-26 12:44:20,750][123091] Updated weights for policy 0, policy_version 1646031 (0.0010) [2023-12-26 12:44:21,264][123090] Updated weights for policy 1, policy_version 1635113 (0.0009) [2023-12-26 12:44:21,334][123090] Updated weights for policy 1, policy_version 1635123 (0.0010) [2023-12-26 12:44:21,414][123090] Updated weights for policy 1, policy_version 1635133 (0.0010) [2023-12-26 12:44:21,549][123091] Updated weights for policy 0, policy_version 1646041 (0.0011) [2023-12-26 12:44:21,610][123091] Updated weights for policy 0, policy_version 1646051 (0.0011) [2023-12-26 12:44:21,675][123091] Updated weights for policy 0, policy_version 1646061 (0.0008) [2023-12-26 12:44:22,252][123090] Updated weights for policy 1, policy_version 1635143 (0.0008) [2023-12-26 12:44:22,318][123090] Updated weights for policy 1, policy_version 1635153 (0.0009) [2023-12-26 12:44:22,382][123090] Updated weights for policy 1, policy_version 1635163 (0.0009) [2023-12-26 12:44:22,489][123091] Updated weights for policy 0, policy_version 1646071 (0.0010) [2023-12-26 12:44:22,549][123091] Updated weights for policy 0, policy_version 1646081 (0.0011) [2023-12-26 12:44:22,609][123091] Updated weights for policy 0, policy_version 1646091 (0.0011) [2023-12-26 12:44:23,259][123090] Updated weights for policy 1, policy_version 1635173 (0.0009) [2023-12-26 12:44:23,324][123090] Updated weights for policy 1, policy_version 1635183 (0.0008) [2023-12-26 12:44:23,357][123091] Updated weights for policy 0, policy_version 1646101 (0.0009) [2023-12-26 12:44:23,389][123090] Updated weights for policy 1, policy_version 1635193 (0.0007) [2023-12-26 12:44:23,416][123091] Updated weights for policy 0, policy_version 1646111 (0.0010) [2023-12-26 12:44:23,477][123091] Updated weights for policy 0, policy_version 1646121 (0.0009) [2023-12-26 12:44:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 840024064. Throughput: 0: 9102.6, 1: 8617.3. Samples: 839998812. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:23,785][121949] Avg episode reward: [(0, '5788.848'), (1, '5856.857')] [2023-12-26 12:44:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001646128_421412864.pth... [2023-12-26 12:44:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001635200_418611200.pth... [2023-12-26 12:44:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001645040_421134336.pth [2023-12-26 12:44:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001634208_418357248.pth [2023-12-26 12:44:24,235][123090] Updated weights for policy 1, policy_version 1635203 (0.0006) [2023-12-26 12:44:24,284][123090] Updated weights for policy 1, policy_version 1635213 (0.0008) [2023-12-26 12:44:24,295][123091] Updated weights for policy 0, policy_version 1646131 (0.0011) [2023-12-26 12:44:24,332][123090] Updated weights for policy 1, policy_version 1635223 (0.0005) [2023-12-26 12:44:24,349][123091] Updated weights for policy 0, policy_version 1646141 (0.0010) [2023-12-26 12:44:24,405][123091] Updated weights for policy 0, policy_version 1646151 (0.0010) [2023-12-26 12:44:25,177][123090] Updated weights for policy 1, policy_version 1635233 (0.0009) [2023-12-26 12:44:25,242][123090] Updated weights for policy 1, policy_version 1635243 (0.0006) [2023-12-26 12:44:25,243][123091] Updated weights for policy 0, policy_version 1646161 (0.0010) [2023-12-26 12:44:25,291][123091] Updated weights for policy 0, policy_version 1646171 (0.0010) [2023-12-26 12:44:25,303][123090] Updated weights for policy 1, policy_version 1635253 (0.0006) [2023-12-26 12:44:25,338][123091] Updated weights for policy 0, policy_version 1646181 (0.0010) [2023-12-26 12:44:25,364][123090] Updated weights for policy 1, policy_version 1635263 (0.0006) [2023-12-26 12:44:25,389][123091] Updated weights for policy 0, policy_version 1646191 (0.0010) [2023-12-26 12:44:26,131][123090] Updated weights for policy 1, policy_version 1635273 (0.0009) [2023-12-26 12:44:26,163][123091] Updated weights for policy 0, policy_version 1646201 (0.0006) [2023-12-26 12:44:26,184][123090] Updated weights for policy 1, policy_version 1635284 (0.0010) [2023-12-26 12:44:26,227][123091] Updated weights for policy 0, policy_version 1646211 (0.0006) [2023-12-26 12:44:26,250][123090] Updated weights for policy 1, policy_version 1635294 (0.0009) [2023-12-26 12:44:26,282][123091] Updated weights for policy 0, policy_version 1646221 (0.0009) [2023-12-26 12:44:27,069][123091] Updated weights for policy 0, policy_version 1646231 (0.0007) [2023-12-26 12:44:27,077][123090] Updated weights for policy 1, policy_version 1635304 (0.0008) [2023-12-26 12:44:27,120][123091] Updated weights for policy 0, policy_version 1646241 (0.0008) [2023-12-26 12:44:27,123][123090] Updated weights for policy 1, policy_version 1635314 (0.0006) [2023-12-26 12:44:27,163][123091] Updated weights for policy 0, policy_version 1646251 (0.0010) [2023-12-26 12:44:27,182][123090] Updated weights for policy 1, policy_version 1635324 (0.0007) [2023-12-26 12:44:27,947][123091] Updated weights for policy 0, policy_version 1646261 (0.0010) [2023-12-26 12:44:28,005][123091] Updated weights for policy 0, policy_version 1646271 (0.0010) [2023-12-26 12:44:28,045][123090] Updated weights for policy 1, policy_version 1635334 (0.0006) [2023-12-26 12:44:28,068][123091] Updated weights for policy 0, policy_version 1646281 (0.0009) [2023-12-26 12:44:28,097][123090] Updated weights for policy 1, policy_version 1635344 (0.0009) [2023-12-26 12:44:28,155][123090] Updated weights for policy 1, policy_version 1635354 (0.0007) [2023-12-26 12:44:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 840105984. Throughput: 0: 9143.3, 1: 8616.6. Samples: 840103604. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:28,785][121949] Avg episode reward: [(0, '5926.381'), (1, '5892.249')] [2023-12-26 12:44:28,887][123091] Updated weights for policy 0, policy_version 1646291 (0.0008) [2023-12-26 12:44:28,952][123091] Updated weights for policy 0, policy_version 1646301 (0.0007) [2023-12-26 12:44:29,019][123091] Updated weights for policy 0, policy_version 1646311 (0.0006) [2023-12-26 12:44:29,021][123090] Updated weights for policy 1, policy_version 1635364 (0.0009) [2023-12-26 12:44:29,081][123090] Updated weights for policy 1, policy_version 1635374 (0.0009) [2023-12-26 12:44:29,135][123090] Updated weights for policy 1, policy_version 1635385 (0.0009) [2023-12-26 12:44:29,772][123091] Updated weights for policy 0, policy_version 1646321 (0.0006) [2023-12-26 12:44:29,833][123091] Updated weights for policy 0, policy_version 1646331 (0.0009) [2023-12-26 12:44:29,902][123091] Updated weights for policy 0, policy_version 1646341 (0.0009) [2023-12-26 12:44:29,972][123091] Updated weights for policy 0, policy_version 1646351 (0.0010) [2023-12-26 12:44:29,985][123090] Updated weights for policy 1, policy_version 1635395 (0.0009) [2023-12-26 12:44:30,036][123090] Updated weights for policy 1, policy_version 1635405 (0.0009) [2023-12-26 12:44:30,089][123090] Updated weights for policy 1, policy_version 1635415 (0.0009) [2023-12-26 12:44:30,717][123091] Updated weights for policy 0, policy_version 1646361 (0.0010) [2023-12-26 12:44:30,768][123091] Updated weights for policy 0, policy_version 1646371 (0.0010) [2023-12-26 12:44:30,827][123091] Updated weights for policy 0, policy_version 1646381 (0.0009) [2023-12-26 12:44:30,962][123090] Updated weights for policy 1, policy_version 1635425 (0.0009) [2023-12-26 12:44:31,010][123090] Updated weights for policy 1, policy_version 1635435 (0.0009) [2023-12-26 12:44:31,072][123090] Updated weights for policy 1, policy_version 1635445 (0.0009) [2023-12-26 12:44:31,141][123090] Updated weights for policy 1, policy_version 1635455 (0.0008) [2023-12-26 12:44:31,641][123091] Updated weights for policy 0, policy_version 1646391 (0.0010) [2023-12-26 12:44:31,701][123091] Updated weights for policy 0, policy_version 1646401 (0.0011) [2023-12-26 12:44:31,765][123091] Updated weights for policy 0, policy_version 1646411 (0.0010) [2023-12-26 12:44:32,007][123090] Updated weights for policy 1, policy_version 1635465 (0.0009) [2023-12-26 12:44:32,068][123090] Updated weights for policy 1, policy_version 1635475 (0.0009) [2023-12-26 12:44:32,117][123090] Updated weights for policy 1, policy_version 1635485 (0.0009) [2023-12-26 12:44:32,601][123091] Updated weights for policy 0, policy_version 1646421 (0.0011) [2023-12-26 12:44:32,657][123091] Updated weights for policy 0, policy_version 1646431 (0.0011) [2023-12-26 12:44:32,723][123091] Updated weights for policy 0, policy_version 1646441 (0.0010) [2023-12-26 12:44:32,965][123090] Updated weights for policy 1, policy_version 1635495 (0.0009) [2023-12-26 12:44:33,013][123090] Updated weights for policy 1, policy_version 1635505 (0.0008) [2023-12-26 12:44:33,061][123090] Updated weights for policy 1, policy_version 1635515 (0.0009) [2023-12-26 12:44:33,506][123091] Updated weights for policy 0, policy_version 1646451 (0.0009) [2023-12-26 12:44:33,568][123091] Updated weights for policy 0, policy_version 1646461 (0.0005) [2023-12-26 12:44:33,643][123091] Updated weights for policy 0, policy_version 1646471 (0.0006) [2023-12-26 12:44:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 840196096. Throughput: 0: 9140.2, 1: 8491.3. Samples: 840206828. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:33,785][121949] Avg episode reward: [(0, '6037.607'), (1, '6157.298')] [2023-12-26 12:44:33,787][123008] Saving new best policy, reward=6157.298! [2023-12-26 12:44:33,930][123090] Updated weights for policy 1, policy_version 1635525 (0.0007) [2023-12-26 12:44:33,993][123090] Updated weights for policy 1, policy_version 1635535 (0.0005) [2023-12-26 12:44:34,051][123090] Updated weights for policy 1, policy_version 1635545 (0.0005) [2023-12-26 12:44:34,388][123091] Updated weights for policy 0, policy_version 1646481 (0.0009) [2023-12-26 12:44:34,445][123091] Updated weights for policy 0, policy_version 1646491 (0.0009) [2023-12-26 12:44:34,493][123091] Updated weights for policy 0, policy_version 1646501 (0.0009) [2023-12-26 12:44:34,541][123091] Updated weights for policy 0, policy_version 1646511 (0.0009) [2023-12-26 12:44:34,849][123090] Updated weights for policy 1, policy_version 1635555 (0.0007) [2023-12-26 12:44:34,916][123090] Updated weights for policy 1, policy_version 1635565 (0.0010) [2023-12-26 12:44:34,975][123090] Updated weights for policy 1, policy_version 1635575 (0.0010) [2023-12-26 12:44:35,330][123091] Updated weights for policy 0, policy_version 1646521 (0.0005) [2023-12-26 12:44:35,392][123091] Updated weights for policy 0, policy_version 1646531 (0.0008) [2023-12-26 12:44:35,456][123091] Updated weights for policy 0, policy_version 1646541 (0.0008) [2023-12-26 12:44:35,776][123090] Updated weights for policy 1, policy_version 1635585 (0.0010) [2023-12-26 12:44:35,843][123090] Updated weights for policy 1, policy_version 1635595 (0.0005) [2023-12-26 12:44:35,910][123090] Updated weights for policy 1, policy_version 1635605 (0.0009) [2023-12-26 12:44:35,961][123090] Updated weights for policy 1, policy_version 1635615 (0.0008) [2023-12-26 12:44:36,230][123091] Updated weights for policy 0, policy_version 1646551 (0.0009) [2023-12-26 12:44:36,297][123091] Updated weights for policy 0, policy_version 1646561 (0.0011) [2023-12-26 12:44:36,364][123091] Updated weights for policy 0, policy_version 1646571 (0.0011) [2023-12-26 12:44:36,729][123090] Updated weights for policy 1, policy_version 1635625 (0.0008) [2023-12-26 12:44:36,789][123090] Updated weights for policy 1, policy_version 1635635 (0.0010) [2023-12-26 12:44:36,856][123090] Updated weights for policy 1, policy_version 1635645 (0.0010) [2023-12-26 12:44:37,198][123091] Updated weights for policy 0, policy_version 1646581 (0.0011) [2023-12-26 12:44:37,268][123091] Updated weights for policy 0, policy_version 1646591 (0.0011) [2023-12-26 12:44:37,338][123091] Updated weights for policy 0, policy_version 1646601 (0.0011) [2023-12-26 12:44:37,469][123090] Updated weights for policy 1, policy_version 1635655 (0.0007) [2023-12-26 12:44:37,524][123090] Updated weights for policy 1, policy_version 1635665 (0.0005) [2023-12-26 12:44:37,589][123090] Updated weights for policy 1, policy_version 1635675 (0.0005) [2023-12-26 12:44:38,140][123091] Updated weights for policy 0, policy_version 1646611 (0.0010) [2023-12-26 12:44:38,196][123091] Updated weights for policy 0, policy_version 1646621 (0.0009) [2023-12-26 12:44:38,244][123091] Updated weights for policy 0, policy_version 1646631 (0.0010) [2023-12-26 12:44:38,387][123090] Updated weights for policy 1, policy_version 1635685 (0.0007) [2023-12-26 12:44:38,451][123090] Updated weights for policy 1, policy_version 1635695 (0.0008) [2023-12-26 12:44:38,514][123090] Updated weights for policy 1, policy_version 1635705 (0.0008) [2023-12-26 12:44:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 840286208. Throughput: 0: 9131.4, 1: 8520.0. Samples: 840261012. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:38,785][121949] Avg episode reward: [(0, '5814.083'), (1, '6025.033')] [2023-12-26 12:44:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001646640_421543936.pth... [2023-12-26 12:44:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001635712_418742272.pth... [2023-12-26 12:44:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001645584_421273600.pth [2023-12-26 12:44:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001634720_418488320.pth [2023-12-26 12:44:39,111][123091] Updated weights for policy 0, policy_version 1646641 (0.0010) [2023-12-26 12:44:39,181][123091] Updated weights for policy 0, policy_version 1646651 (0.0009) [2023-12-26 12:44:39,235][123090] Updated weights for policy 1, policy_version 1635715 (0.0009) [2023-12-26 12:44:39,251][123091] Updated weights for policy 0, policy_version 1646661 (0.0009) [2023-12-26 12:44:39,299][123090] Updated weights for policy 1, policy_version 1635725 (0.0011) [2023-12-26 12:44:39,320][123091] Updated weights for policy 0, policy_version 1646671 (0.0007) [2023-12-26 12:44:39,376][123090] Updated weights for policy 1, policy_version 1635735 (0.0010) [2023-12-26 12:44:40,167][123090] Updated weights for policy 1, policy_version 1635745 (0.0007) [2023-12-26 12:44:40,192][123091] Updated weights for policy 0, policy_version 1646681 (0.0010) [2023-12-26 12:44:40,236][123090] Updated weights for policy 1, policy_version 1635755 (0.0006) [2023-12-26 12:44:40,256][123091] Updated weights for policy 0, policy_version 1646691 (0.0009) [2023-12-26 12:44:40,302][123090] Updated weights for policy 1, policy_version 1635765 (0.0006) [2023-12-26 12:44:40,325][123091] Updated weights for policy 0, policy_version 1646701 (0.0009) [2023-12-26 12:44:40,372][123090] Updated weights for policy 1, policy_version 1635775 (0.0008) [2023-12-26 12:44:40,982][123090] Updated weights for policy 1, policy_version 1635785 (0.0005) [2023-12-26 12:44:41,061][123090] Updated weights for policy 1, policy_version 1635795 (0.0007) [2023-12-26 12:44:41,073][123091] Updated weights for policy 0, policy_version 1646711 (0.0008) [2023-12-26 12:44:41,131][123090] Updated weights for policy 1, policy_version 1635805 (0.0008) [2023-12-26 12:44:41,139][123091] Updated weights for policy 0, policy_version 1646721 (0.0007) [2023-12-26 12:44:41,217][123091] Updated weights for policy 0, policy_version 1646731 (0.0006) [2023-12-26 12:44:41,932][123090] Updated weights for policy 1, policy_version 1635815 (0.0009) [2023-12-26 12:44:41,986][123091] Updated weights for policy 0, policy_version 1646741 (0.0006) [2023-12-26 12:44:41,988][123090] Updated weights for policy 1, policy_version 1635825 (0.0011) [2023-12-26 12:44:42,051][123090] Updated weights for policy 1, policy_version 1635835 (0.0013) [2023-12-26 12:44:42,052][123091] Updated weights for policy 0, policy_version 1646751 (0.0008) [2023-12-26 12:44:42,117][123091] Updated weights for policy 0, policy_version 1646761 (0.0008) [2023-12-26 12:44:42,904][123090] Updated weights for policy 1, policy_version 1635845 (0.0011) [2023-12-26 12:44:42,925][123091] Updated weights for policy 0, policy_version 1646771 (0.0009) [2023-12-26 12:44:42,965][123090] Updated weights for policy 1, policy_version 1635855 (0.0011) [2023-12-26 12:44:42,992][123091] Updated weights for policy 0, policy_version 1646781 (0.0011) [2023-12-26 12:44:43,026][123090] Updated weights for policy 1, policy_version 1635865 (0.0011) [2023-12-26 12:44:43,048][123091] Updated weights for policy 0, policy_version 1646791 (0.0010) [2023-12-26 12:44:43,753][123091] Updated weights for policy 0, policy_version 1646801 (0.0010) [2023-12-26 12:44:43,758][123090] Updated weights for policy 1, policy_version 1635875 (0.0011) [2023-12-26 12:44:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 840368128. Throughput: 0: 9008.6, 1: 8541.4. Samples: 840367024. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:43,785][121949] Avg episode reward: [(0, '5556.863'), (1, '6017.501')] [2023-12-26 12:44:43,815][123091] Updated weights for policy 0, policy_version 1646811 (0.0005) [2023-12-26 12:44:43,821][123090] Updated weights for policy 1, policy_version 1635885 (0.0011) [2023-12-26 12:44:43,873][123091] Updated weights for policy 0, policy_version 1646821 (0.0009) [2023-12-26 12:44:43,873][123090] Updated weights for policy 1, policy_version 1635895 (0.0010) [2023-12-26 12:44:43,920][123091] Updated weights for policy 0, policy_version 1646831 (0.0010) [2023-12-26 12:44:44,707][123090] Updated weights for policy 1, policy_version 1635905 (0.0011) [2023-12-26 12:44:44,722][123091] Updated weights for policy 0, policy_version 1646841 (0.0009) [2023-12-26 12:44:44,763][123090] Updated weights for policy 1, policy_version 1635915 (0.0011) [2023-12-26 12:44:44,790][123091] Updated weights for policy 0, policy_version 1646851 (0.0007) [2023-12-26 12:44:44,827][123090] Updated weights for policy 1, policy_version 1635925 (0.0010) [2023-12-26 12:44:44,857][123091] Updated weights for policy 0, policy_version 1646861 (0.0008) [2023-12-26 12:44:44,892][123090] Updated weights for policy 1, policy_version 1635935 (0.0009) [2023-12-26 12:44:45,582][123090] Updated weights for policy 1, policy_version 1635945 (0.0005) [2023-12-26 12:44:45,614][123091] Updated weights for policy 0, policy_version 1646871 (0.0008) [2023-12-26 12:44:45,639][123090] Updated weights for policy 1, policy_version 1635955 (0.0005) [2023-12-26 12:44:45,677][123091] Updated weights for policy 0, policy_version 1646881 (0.0007) [2023-12-26 12:44:45,692][123090] Updated weights for policy 1, policy_version 1635965 (0.0009) [2023-12-26 12:44:45,734][123091] Updated weights for policy 0, policy_version 1646891 (0.0007) [2023-12-26 12:44:46,483][123090] Updated weights for policy 1, policy_version 1635975 (0.0011) [2023-12-26 12:44:46,550][123090] Updated weights for policy 1, policy_version 1635985 (0.0011) [2023-12-26 12:44:46,574][123091] Updated weights for policy 0, policy_version 1646901 (0.0008) [2023-12-26 12:44:46,612][123090] Updated weights for policy 1, policy_version 1635995 (0.0010) [2023-12-26 12:44:46,638][123091] Updated weights for policy 0, policy_version 1646911 (0.0010) [2023-12-26 12:44:46,691][123091] Updated weights for policy 0, policy_version 1646921 (0.0008) [2023-12-26 12:44:47,353][123091] Updated weights for policy 0, policy_version 1646931 (0.0006) [2023-12-26 12:44:47,400][123091] Updated weights for policy 0, policy_version 1646941 (0.0006) [2023-12-26 12:44:47,432][123090] Updated weights for policy 1, policy_version 1636005 (0.0010) [2023-12-26 12:44:47,458][123091] Updated weights for policy 0, policy_version 1646951 (0.0005) [2023-12-26 12:44:47,484][123090] Updated weights for policy 1, policy_version 1636015 (0.0010) [2023-12-26 12:44:47,531][123090] Updated weights for policy 1, policy_version 1636025 (0.0010) [2023-12-26 12:44:48,226][123091] Updated weights for policy 0, policy_version 1646961 (0.0007) [2023-12-26 12:44:48,287][123091] Updated weights for policy 0, policy_version 1646971 (0.0005) [2023-12-26 12:44:48,355][123091] Updated weights for policy 0, policy_version 1646981 (0.0008) [2023-12-26 12:44:48,375][123090] Updated weights for policy 1, policy_version 1636035 (0.0010) [2023-12-26 12:44:48,416][123091] Updated weights for policy 0, policy_version 1646991 (0.0007) [2023-12-26 12:44:48,431][123090] Updated weights for policy 1, policy_version 1636045 (0.0011) [2023-12-26 12:44:48,479][123090] Updated weights for policy 1, policy_version 1636055 (0.0010) [2023-12-26 12:44:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 840466432. Throughput: 0: 9016.0, 1: 8587.5. Samples: 840475588. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:48,784][121949] Avg episode reward: [(0, '5729.115'), (1, '6111.605')] [2023-12-26 12:44:49,182][123091] Updated weights for policy 0, policy_version 1647001 (0.0009) [2023-12-26 12:44:49,245][123091] Updated weights for policy 0, policy_version 1647011 (0.0009) [2023-12-26 12:44:49,313][123091] Updated weights for policy 0, policy_version 1647021 (0.0009) [2023-12-26 12:44:49,342][123090] Updated weights for policy 1, policy_version 1636065 (0.0010) [2023-12-26 12:44:49,408][123090] Updated weights for policy 1, policy_version 1636075 (0.0008) [2023-12-26 12:44:49,467][123090] Updated weights for policy 1, policy_version 1636085 (0.0006) [2023-12-26 12:44:49,535][123090] Updated weights for policy 1, policy_version 1636095 (0.0005) [2023-12-26 12:44:50,232][123091] Updated weights for policy 0, policy_version 1647031 (0.0009) [2023-12-26 12:44:50,286][123090] Updated weights for policy 1, policy_version 1636105 (0.0008) [2023-12-26 12:44:50,292][123091] Updated weights for policy 0, policy_version 1647041 (0.0009) [2023-12-26 12:44:50,336][123090] Updated weights for policy 1, policy_version 1636115 (0.0008) [2023-12-26 12:44:50,341][123091] Updated weights for policy 0, policy_version 1647051 (0.0008) [2023-12-26 12:44:50,398][123090] Updated weights for policy 1, policy_version 1636125 (0.0007) [2023-12-26 12:44:51,117][123091] Updated weights for policy 0, policy_version 1647061 (0.0008) [2023-12-26 12:44:51,189][123091] Updated weights for policy 0, policy_version 1647071 (0.0008) [2023-12-26 12:44:51,259][123091] Updated weights for policy 0, policy_version 1647081 (0.0009) [2023-12-26 12:44:51,303][123090] Updated weights for policy 1, policy_version 1636135 (0.0009) [2023-12-26 12:44:51,376][123090] Updated weights for policy 1, policy_version 1636145 (0.0010) [2023-12-26 12:44:51,451][123090] Updated weights for policy 1, policy_version 1636155 (0.0009) [2023-12-26 12:44:52,044][123091] Updated weights for policy 0, policy_version 1647091 (0.0007) [2023-12-26 12:44:52,106][123091] Updated weights for policy 0, policy_version 1647101 (0.0005) [2023-12-26 12:44:52,164][123091] Updated weights for policy 0, policy_version 1647111 (0.0005) [2023-12-26 12:44:52,346][123090] Updated weights for policy 1, policy_version 1636165 (0.0009) [2023-12-26 12:44:52,410][123090] Updated weights for policy 1, policy_version 1636175 (0.0006) [2023-12-26 12:44:52,471][123090] Updated weights for policy 1, policy_version 1636185 (0.0006) [2023-12-26 12:44:52,986][123091] Updated weights for policy 0, policy_version 1647121 (0.0008) [2023-12-26 12:44:53,051][123091] Updated weights for policy 0, policy_version 1647131 (0.0010) [2023-12-26 12:44:53,106][123091] Updated weights for policy 0, policy_version 1647141 (0.0010) [2023-12-26 12:44:53,157][123091] Updated weights for policy 0, policy_version 1647151 (0.0010) [2023-12-26 12:44:53,193][123090] Updated weights for policy 1, policy_version 1636195 (0.0010) [2023-12-26 12:44:53,246][123090] Updated weights for policy 1, policy_version 1636205 (0.0009) [2023-12-26 12:44:53,295][123090] Updated weights for policy 1, policy_version 1636215 (0.0005) [2023-12-26 12:44:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 840548352. Throughput: 0: 8935.6, 1: 8568.9. Samples: 840525784. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:53,785][121949] Avg episode reward: [(0, '5867.101'), (1, '5901.400')] [2023-12-26 12:44:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001636224_418873344.pth... [2023-12-26 12:44:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001647152_421675008.pth... [2023-12-26 12:44:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001635200_418611200.pth [2023-12-26 12:44:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001646128_421412864.pth [2023-12-26 12:44:53,921][123090] Updated weights for policy 1, policy_version 1636225 (0.0005) [2023-12-26 12:44:53,979][123090] Updated weights for policy 1, policy_version 1636235 (0.0007) [2023-12-26 12:44:53,996][123091] Updated weights for policy 0, policy_version 1647161 (0.0010) [2023-12-26 12:44:54,034][123090] Updated weights for policy 1, policy_version 1636245 (0.0008) [2023-12-26 12:44:54,046][123091] Updated weights for policy 0, policy_version 1647171 (0.0008) [2023-12-26 12:44:54,094][123090] Updated weights for policy 1, policy_version 1636255 (0.0008) [2023-12-26 12:44:54,107][123091] Updated weights for policy 0, policy_version 1647181 (0.0009) [2023-12-26 12:44:54,886][123091] Updated weights for policy 0, policy_version 1647191 (0.0007) [2023-12-26 12:44:54,895][123090] Updated weights for policy 1, policy_version 1636265 (0.0009) [2023-12-26 12:44:54,943][123091] Updated weights for policy 0, policy_version 1647201 (0.0008) [2023-12-26 12:44:54,955][123090] Updated weights for policy 1, policy_version 1636275 (0.0008) [2023-12-26 12:44:55,005][123091] Updated weights for policy 0, policy_version 1647211 (0.0009) [2023-12-26 12:44:55,018][123090] Updated weights for policy 1, policy_version 1636285 (0.0008) [2023-12-26 12:44:55,789][123090] Updated weights for policy 1, policy_version 1636295 (0.0007) [2023-12-26 12:44:55,843][123090] Updated weights for policy 1, policy_version 1636305 (0.0008) [2023-12-26 12:44:55,853][123091] Updated weights for policy 0, policy_version 1647221 (0.0009) [2023-12-26 12:44:55,903][123090] Updated weights for policy 1, policy_version 1636315 (0.0008) [2023-12-26 12:44:55,913][123091] Updated weights for policy 0, policy_version 1647231 (0.0008) [2023-12-26 12:44:55,968][123091] Updated weights for policy 0, policy_version 1647241 (0.0008) [2023-12-26 12:44:56,575][123090] Updated weights for policy 1, policy_version 1636325 (0.0007) [2023-12-26 12:44:56,624][123090] Updated weights for policy 1, policy_version 1636335 (0.0009) [2023-12-26 12:44:56,675][123090] Updated weights for policy 1, policy_version 1636345 (0.0009) [2023-12-26 12:44:56,759][123091] Updated weights for policy 0, policy_version 1647251 (0.0008) [2023-12-26 12:44:56,808][123091] Updated weights for policy 0, policy_version 1647261 (0.0009) [2023-12-26 12:44:56,858][123091] Updated weights for policy 0, policy_version 1647271 (0.0009) [2023-12-26 12:44:57,520][123090] Updated weights for policy 1, policy_version 1636355 (0.0007) [2023-12-26 12:44:57,581][123090] Updated weights for policy 1, policy_version 1636365 (0.0009) [2023-12-26 12:44:57,644][123090] Updated weights for policy 1, policy_version 1636375 (0.0008) [2023-12-26 12:44:57,681][123091] Updated weights for policy 0, policy_version 1647281 (0.0008) [2023-12-26 12:44:57,739][123091] Updated weights for policy 0, policy_version 1647291 (0.0009) [2023-12-26 12:44:57,800][123091] Updated weights for policy 0, policy_version 1647301 (0.0010) [2023-12-26 12:44:57,864][123091] Updated weights for policy 0, policy_version 1647311 (0.0009) [2023-12-26 12:44:58,453][123090] Updated weights for policy 1, policy_version 1636385 (0.0009) [2023-12-26 12:44:58,517][123090] Updated weights for policy 1, policy_version 1636395 (0.0010) [2023-12-26 12:44:58,585][123090] Updated weights for policy 1, policy_version 1636405 (0.0011) [2023-12-26 12:44:58,656][123090] Updated weights for policy 1, policy_version 1636415 (0.0010) [2023-12-26 12:44:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 840638464. Throughput: 0: 8910.7, 1: 8652.5. Samples: 840633552. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:44:58,785][121949] Avg episode reward: [(0, '5808.826'), (1, '5789.705')] [2023-12-26 12:44:58,785][123091] Updated weights for policy 0, policy_version 1647321 (0.0008) [2023-12-26 12:44:58,853][123091] Updated weights for policy 0, policy_version 1647331 (0.0011) [2023-12-26 12:44:58,911][123091] Updated weights for policy 0, policy_version 1647341 (0.0010) [2023-12-26 12:44:59,487][123090] Updated weights for policy 1, policy_version 1636425 (0.0008) [2023-12-26 12:44:59,552][123090] Updated weights for policy 1, policy_version 1636435 (0.0010) [2023-12-26 12:44:59,611][123090] Updated weights for policy 1, policy_version 1636445 (0.0010) [2023-12-26 12:44:59,646][123091] Updated weights for policy 0, policy_version 1647351 (0.0007) [2023-12-26 12:44:59,717][123091] Updated weights for policy 0, policy_version 1647361 (0.0005) [2023-12-26 12:44:59,787][123091] Updated weights for policy 0, policy_version 1647371 (0.0010) [2023-12-26 12:45:00,318][123090] Updated weights for policy 1, policy_version 1636455 (0.0006) [2023-12-26 12:45:00,386][123090] Updated weights for policy 1, policy_version 1636465 (0.0009) [2023-12-26 12:45:00,452][123090] Updated weights for policy 1, policy_version 1636475 (0.0009) [2023-12-26 12:45:00,553][123091] Updated weights for policy 0, policy_version 1647381 (0.0007) [2023-12-26 12:45:00,620][123091] Updated weights for policy 0, policy_version 1647391 (0.0006) [2023-12-26 12:45:00,683][123091] Updated weights for policy 0, policy_version 1647401 (0.0009) [2023-12-26 12:45:01,107][123090] Updated weights for policy 1, policy_version 1636485 (0.0009) [2023-12-26 12:45:01,162][123090] Updated weights for policy 1, policy_version 1636495 (0.0008) [2023-12-26 12:45:01,229][123090] Updated weights for policy 1, policy_version 1636505 (0.0008) [2023-12-26 12:45:01,489][123091] Updated weights for policy 0, policy_version 1647411 (0.0009) [2023-12-26 12:45:01,555][123091] Updated weights for policy 0, policy_version 1647421 (0.0010) [2023-12-26 12:45:01,621][123091] Updated weights for policy 0, policy_version 1647431 (0.0009) [2023-12-26 12:45:02,016][123090] Updated weights for policy 1, policy_version 1636515 (0.0011) [2023-12-26 12:45:02,072][123090] Updated weights for policy 1, policy_version 1636525 (0.0010) [2023-12-26 12:45:02,127][123090] Updated weights for policy 1, policy_version 1636535 (0.0009) [2023-12-26 12:45:02,352][123091] Updated weights for policy 0, policy_version 1647441 (0.0006) [2023-12-26 12:45:02,410][123091] Updated weights for policy 0, policy_version 1647451 (0.0009) [2023-12-26 12:45:02,471][123091] Updated weights for policy 0, policy_version 1647461 (0.0009) [2023-12-26 12:45:02,550][123091] Updated weights for policy 0, policy_version 1647471 (0.0009) [2023-12-26 12:45:02,876][123090] Updated weights for policy 1, policy_version 1636545 (0.0009) [2023-12-26 12:45:02,947][123090] Updated weights for policy 1, policy_version 1636555 (0.0008) [2023-12-26 12:45:03,014][123090] Updated weights for policy 1, policy_version 1636565 (0.0008) [2023-12-26 12:45:03,083][123090] Updated weights for policy 1, policy_version 1636575 (0.0009) [2023-12-26 12:45:03,408][123091] Updated weights for policy 0, policy_version 1647481 (0.0011) [2023-12-26 12:45:03,471][123091] Updated weights for policy 0, policy_version 1647491 (0.0010) [2023-12-26 12:45:03,536][123091] Updated weights for policy 0, policy_version 1647501 (0.0005) [2023-12-26 12:45:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 840728576. Throughput: 0: 8793.0, 1: 8798.1. Samples: 840740568. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:03,785][121949] Avg episode reward: [(0, '5680.205'), (1, '5955.771')] [2023-12-26 12:45:03,852][123090] Updated weights for policy 1, policy_version 1636585 (0.0007) [2023-12-26 12:45:03,914][123090] Updated weights for policy 1, policy_version 1636595 (0.0006) [2023-12-26 12:45:03,975][123090] Updated weights for policy 1, policy_version 1636605 (0.0005) [2023-12-26 12:45:04,271][123091] Updated weights for policy 0, policy_version 1647511 (0.0006) [2023-12-26 12:45:04,339][123091] Updated weights for policy 0, policy_version 1647521 (0.0006) [2023-12-26 12:45:04,400][123091] Updated weights for policy 0, policy_version 1647531 (0.0006) [2023-12-26 12:45:04,725][123090] Updated weights for policy 1, policy_version 1636615 (0.0005) [2023-12-26 12:45:04,786][123090] Updated weights for policy 1, policy_version 1636625 (0.0006) [2023-12-26 12:45:04,840][123090] Updated weights for policy 1, policy_version 1636635 (0.0005) [2023-12-26 12:45:05,075][123091] Updated weights for policy 0, policy_version 1647541 (0.0005) [2023-12-26 12:45:05,142][123091] Updated weights for policy 0, policy_version 1647551 (0.0005) [2023-12-26 12:45:05,207][123091] Updated weights for policy 0, policy_version 1647561 (0.0010) [2023-12-26 12:45:05,512][123090] Updated weights for policy 1, policy_version 1636645 (0.0007) [2023-12-26 12:45:05,564][123090] Updated weights for policy 1, policy_version 1636655 (0.0009) [2023-12-26 12:45:05,617][123090] Updated weights for policy 1, policy_version 1636665 (0.0009) [2023-12-26 12:45:05,931][123091] Updated weights for policy 0, policy_version 1647571 (0.0008) [2023-12-26 12:45:05,981][123091] Updated weights for policy 0, policy_version 1647581 (0.0006) [2023-12-26 12:45:06,031][123091] Updated weights for policy 0, policy_version 1647591 (0.0005) [2023-12-26 12:45:06,556][123090] Updated weights for policy 1, policy_version 1636676 (0.0010) [2023-12-26 12:45:06,629][123090] Updated weights for policy 1, policy_version 1636686 (0.0010) [2023-12-26 12:45:06,701][123090] Updated weights for policy 1, policy_version 1636696 (0.0010) [2023-12-26 12:45:06,722][123091] Updated weights for policy 0, policy_version 1647601 (0.0005) [2023-12-26 12:45:06,769][123091] Updated weights for policy 0, policy_version 1647611 (0.0005) [2023-12-26 12:45:06,831][123091] Updated weights for policy 0, policy_version 1647621 (0.0007) [2023-12-26 12:45:06,889][123091] Updated weights for policy 0, policy_version 1647631 (0.0005) [2023-12-26 12:45:07,529][123091] Updated weights for policy 0, policy_version 1647641 (0.0009) [2023-12-26 12:45:07,574][123090] Updated weights for policy 1, policy_version 1636706 (0.0008) [2023-12-26 12:45:07,593][123091] Updated weights for policy 0, policy_version 1647651 (0.0010) [2023-12-26 12:45:07,641][123090] Updated weights for policy 1, policy_version 1636716 (0.0009) [2023-12-26 12:45:07,653][123091] Updated weights for policy 0, policy_version 1647661 (0.0007) [2023-12-26 12:45:07,705][123090] Updated weights for policy 1, policy_version 1636726 (0.0010) [2023-12-26 12:45:07,771][123090] Updated weights for policy 1, policy_version 1636736 (0.0010) [2023-12-26 12:45:08,391][123091] Updated weights for policy 0, policy_version 1647671 (0.0007) [2023-12-26 12:45:08,452][123091] Updated weights for policy 0, policy_version 1647681 (0.0006) [2023-12-26 12:45:08,519][123091] Updated weights for policy 0, policy_version 1647691 (0.0005) [2023-12-26 12:45:08,610][123090] Updated weights for policy 1, policy_version 1636746 (0.0009) [2023-12-26 12:45:08,665][123090] Updated weights for policy 1, policy_version 1636756 (0.0010) [2023-12-26 12:45:08,724][123090] Updated weights for policy 1, policy_version 1636766 (0.0010) [2023-12-26 12:45:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 840826880. Throughput: 0: 8877.5, 1: 8871.3. Samples: 840797508. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:08,784][121949] Avg episode reward: [(0, '5649.217'), (1, '5891.310')] [2023-12-26 12:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001647696_421814272.pth... [2023-12-26 12:45:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001636768_419012608.pth... [2023-12-26 12:45:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001646640_421543936.pth [2023-12-26 12:45:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001635712_418742272.pth [2023-12-26 12:45:09,192][123091] Updated weights for policy 0, policy_version 1647701 (0.0007) [2023-12-26 12:45:09,265][123091] Updated weights for policy 0, policy_version 1647711 (0.0010) [2023-12-26 12:45:09,322][123091] Updated weights for policy 0, policy_version 1647721 (0.0010) [2023-12-26 12:45:09,678][123090] Updated weights for policy 1, policy_version 1636776 (0.0010) [2023-12-26 12:45:09,751][123090] Updated weights for policy 1, policy_version 1636786 (0.0010) [2023-12-26 12:45:09,824][123090] Updated weights for policy 1, policy_version 1636796 (0.0010) [2023-12-26 12:45:10,215][123091] Updated weights for policy 0, policy_version 1647731 (0.0010) [2023-12-26 12:45:10,285][123091] Updated weights for policy 0, policy_version 1647741 (0.0010) [2023-12-26 12:45:10,354][123091] Updated weights for policy 0, policy_version 1647751 (0.0009) [2023-12-26 12:45:10,642][123090] Updated weights for policy 1, policy_version 1636806 (0.0007) [2023-12-26 12:45:10,702][123090] Updated weights for policy 1, policy_version 1636816 (0.0008) [2023-12-26 12:45:10,761][123090] Updated weights for policy 1, policy_version 1636826 (0.0010) [2023-12-26 12:45:11,087][123091] Updated weights for policy 0, policy_version 1647761 (0.0009) [2023-12-26 12:45:11,158][123091] Updated weights for policy 0, policy_version 1647771 (0.0008) [2023-12-26 12:45:11,233][123091] Updated weights for policy 0, policy_version 1647781 (0.0008) [2023-12-26 12:45:11,295][123091] Updated weights for policy 0, policy_version 1647791 (0.0007) [2023-12-26 12:45:11,546][123090] Updated weights for policy 1, policy_version 1636836 (0.0009) [2023-12-26 12:45:11,598][123090] Updated weights for policy 1, policy_version 1636846 (0.0008) [2023-12-26 12:45:11,671][123090] Updated weights for policy 1, policy_version 1636856 (0.0009) [2023-12-26 12:45:12,062][123091] Updated weights for policy 0, policy_version 1647801 (0.0006) [2023-12-26 12:45:12,129][123091] Updated weights for policy 0, policy_version 1647811 (0.0006) [2023-12-26 12:45:12,194][123091] Updated weights for policy 0, policy_version 1647821 (0.0006) [2023-12-26 12:45:12,553][123090] Updated weights for policy 1, policy_version 1636866 (0.0010) [2023-12-26 12:45:12,620][123090] Updated weights for policy 1, policy_version 1636876 (0.0008) [2023-12-26 12:45:12,695][123090] Updated weights for policy 1, policy_version 1636886 (0.0007) [2023-12-26 12:45:12,764][123090] Updated weights for policy 1, policy_version 1636896 (0.0007) [2023-12-26 12:45:12,950][123091] Updated weights for policy 0, policy_version 1647831 (0.0009) [2023-12-26 12:45:13,001][123091] Updated weights for policy 0, policy_version 1647841 (0.0007) [2023-12-26 12:45:13,049][123091] Updated weights for policy 0, policy_version 1647851 (0.0005) [2023-12-26 12:45:13,387][123090] Updated weights for policy 1, policy_version 1636906 (0.0010) [2023-12-26 12:45:13,436][123090] Updated weights for policy 1, policy_version 1636916 (0.0010) [2023-12-26 12:45:13,491][123090] Updated weights for policy 1, policy_version 1636926 (0.0010) [2023-12-26 12:45:13,716][123091] Updated weights for policy 0, policy_version 1647861 (0.0005) [2023-12-26 12:45:13,762][123091] Updated weights for policy 0, policy_version 1647871 (0.0005) [2023-12-26 12:45:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 840908800. Throughput: 0: 8919.6, 1: 8836.2. Samples: 840902612. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:13,785][121949] Avg episode reward: [(0, '5814.324'), (1, '5847.041')] [2023-12-26 12:45:13,812][123091] Updated weights for policy 0, policy_version 1647881 (0.0005) [2023-12-26 12:45:14,221][123090] Updated weights for policy 1, policy_version 1636936 (0.0010) [2023-12-26 12:45:14,286][123090] Updated weights for policy 1, policy_version 1636946 (0.0009) [2023-12-26 12:45:14,339][123090] Updated weights for policy 1, policy_version 1636956 (0.0006) [2023-12-26 12:45:14,474][123091] Updated weights for policy 0, policy_version 1647891 (0.0006) [2023-12-26 12:45:14,541][123091] Updated weights for policy 0, policy_version 1647901 (0.0008) [2023-12-26 12:45:14,596][123091] Updated weights for policy 0, policy_version 1647911 (0.0006) [2023-12-26 12:45:15,008][123090] Updated weights for policy 1, policy_version 1636966 (0.0006) [2023-12-26 12:45:15,075][123090] Updated weights for policy 1, policy_version 1636976 (0.0005) [2023-12-26 12:45:15,152][123090] Updated weights for policy 1, policy_version 1636986 (0.0006) [2023-12-26 12:45:15,381][123091] Updated weights for policy 0, policy_version 1647921 (0.0006) [2023-12-26 12:45:15,444][123091] Updated weights for policy 0, policy_version 1647931 (0.0011) [2023-12-26 12:45:15,504][123091] Updated weights for policy 0, policy_version 1647941 (0.0011) [2023-12-26 12:45:15,556][123091] Updated weights for policy 0, policy_version 1647951 (0.0011) [2023-12-26 12:45:15,870][123090] Updated weights for policy 1, policy_version 1636996 (0.0010) [2023-12-26 12:45:15,940][123090] Updated weights for policy 1, policy_version 1637006 (0.0010) [2023-12-26 12:45:16,010][123090] Updated weights for policy 1, policy_version 1637016 (0.0011) [2023-12-26 12:45:16,292][123091] Updated weights for policy 0, policy_version 1647961 (0.0006) [2023-12-26 12:45:16,352][123091] Updated weights for policy 0, policy_version 1647971 (0.0005) [2023-12-26 12:45:16,418][123091] Updated weights for policy 0, policy_version 1647981 (0.0006) [2023-12-26 12:45:16,799][123090] Updated weights for policy 1, policy_version 1637026 (0.0007) [2023-12-26 12:45:16,863][123090] Updated weights for policy 1, policy_version 1637036 (0.0009) [2023-12-26 12:45:16,915][123090] Updated weights for policy 1, policy_version 1637046 (0.0008) [2023-12-26 12:45:16,975][123090] Updated weights for policy 1, policy_version 1637056 (0.0010) [2023-12-26 12:45:17,095][123091] Updated weights for policy 0, policy_version 1647991 (0.0008) [2023-12-26 12:45:17,156][123091] Updated weights for policy 0, policy_version 1648001 (0.0008) [2023-12-26 12:45:17,216][123091] Updated weights for policy 0, policy_version 1648012 (0.0010) [2023-12-26 12:45:17,850][123090] Updated weights for policy 1, policy_version 1637066 (0.0009) [2023-12-26 12:45:17,913][123090] Updated weights for policy 1, policy_version 1637076 (0.0006) [2023-12-26 12:45:17,971][123091] Updated weights for policy 0, policy_version 1648022 (0.0008) [2023-12-26 12:45:17,973][123090] Updated weights for policy 1, policy_version 1637086 (0.0008) [2023-12-26 12:45:18,033][123091] Updated weights for policy 0, policy_version 1648032 (0.0006) [2023-12-26 12:45:18,103][123091] Updated weights for policy 0, policy_version 1648042 (0.0007) [2023-12-26 12:45:18,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 840998912. Throughput: 0: 9014.8, 1: 8955.3. Samples: 841015480. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:18,785][121949] Avg episode reward: [(0, '6010.643'), (1, '5801.408')] [2023-12-26 12:45:18,792][123090] Updated weights for policy 1, policy_version 1637096 (0.0010) [2023-12-26 12:45:18,815][123091] Updated weights for policy 0, policy_version 1648052 (0.0009) [2023-12-26 12:45:18,849][123090] Updated weights for policy 1, policy_version 1637106 (0.0010) [2023-12-26 12:45:18,875][123091] Updated weights for policy 0, policy_version 1648062 (0.0005) [2023-12-26 12:45:18,909][123090] Updated weights for policy 1, policy_version 1637116 (0.0011) [2023-12-26 12:45:18,937][123091] Updated weights for policy 0, policy_version 1648072 (0.0005) [2023-12-26 12:45:19,658][123090] Updated weights for policy 1, policy_version 1637126 (0.0011) [2023-12-26 12:45:19,711][123091] Updated weights for policy 0, policy_version 1648082 (0.0006) [2023-12-26 12:45:19,726][123090] Updated weights for policy 1, policy_version 1637136 (0.0011) [2023-12-26 12:45:19,774][123091] Updated weights for policy 0, policy_version 1648092 (0.0010) [2023-12-26 12:45:19,799][123090] Updated weights for policy 1, policy_version 1637146 (0.0011) [2023-12-26 12:45:19,839][123091] Updated weights for policy 0, policy_version 1648102 (0.0007) [2023-12-26 12:45:19,901][123091] Updated weights for policy 0, policy_version 1648112 (0.0008) [2023-12-26 12:45:20,701][123090] Updated weights for policy 1, policy_version 1637156 (0.0012) [2023-12-26 12:45:20,750][123091] Updated weights for policy 0, policy_version 1648122 (0.0009) [2023-12-26 12:45:20,751][123090] Updated weights for policy 1, policy_version 1637166 (0.0008) [2023-12-26 12:45:20,812][123090] Updated weights for policy 1, policy_version 1637176 (0.0007) [2023-12-26 12:45:20,813][123091] Updated weights for policy 0, policy_version 1648132 (0.0009) [2023-12-26 12:45:20,877][123091] Updated weights for policy 0, policy_version 1648142 (0.0009) [2023-12-26 12:45:21,692][123090] Updated weights for policy 1, policy_version 1637186 (0.0009) [2023-12-26 12:45:21,723][123091] Updated weights for policy 0, policy_version 1648152 (0.0009) [2023-12-26 12:45:21,766][123090] Updated weights for policy 1, policy_version 1637196 (0.0010) [2023-12-26 12:45:21,792][123091] Updated weights for policy 0, policy_version 1648162 (0.0009) [2023-12-26 12:45:21,824][123090] Updated weights for policy 1, policy_version 1637206 (0.0010) [2023-12-26 12:45:21,854][123091] Updated weights for policy 0, policy_version 1648172 (0.0008) [2023-12-26 12:45:21,894][123090] Updated weights for policy 1, policy_version 1637216 (0.0008) [2023-12-26 12:45:22,684][123091] Updated weights for policy 0, policy_version 1648182 (0.0010) [2023-12-26 12:45:22,749][123091] Updated weights for policy 0, policy_version 1648192 (0.0011) [2023-12-26 12:45:22,773][123090] Updated weights for policy 1, policy_version 1637226 (0.0007) [2023-12-26 12:45:22,816][123091] Updated weights for policy 0, policy_version 1648202 (0.0011) [2023-12-26 12:45:22,842][123090] Updated weights for policy 1, policy_version 1637236 (0.0009) [2023-12-26 12:45:22,907][123090] Updated weights for policy 1, policy_version 1637246 (0.0011) [2023-12-26 12:45:23,661][123091] Updated weights for policy 0, policy_version 1648212 (0.0009) [2023-12-26 12:45:23,712][123091] Updated weights for policy 0, policy_version 1648222 (0.0010) [2023-12-26 12:45:23,727][123090] Updated weights for policy 1, policy_version 1637256 (0.0010) [2023-12-26 12:45:23,760][123091] Updated weights for policy 0, policy_version 1648232 (0.0010) [2023-12-26 12:45:23,771][123090] Updated weights for policy 1, policy_version 1637266 (0.0010) [2023-12-26 12:45:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 841080832. Throughput: 0: 8995.8, 1: 8913.6. Samples: 841066936. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:23,784][121949] Avg episode reward: [(0, '6118.799'), (1, '5756.263')] [2023-12-26 12:45:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001648240_421953536.pth... [2023-12-26 12:45:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001647152_421675008.pth [2023-12-26 12:45:23,823][123090] Updated weights for policy 1, policy_version 1637276 (0.0010) [2023-12-26 12:45:23,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001637280_419143680.pth... [2023-12-26 12:45:23,846][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001636224_418873344.pth [2023-12-26 12:45:24,608][123091] Updated weights for policy 0, policy_version 1648242 (0.0010) [2023-12-26 12:45:24,661][123091] Updated weights for policy 0, policy_version 1648252 (0.0011) [2023-12-26 12:45:24,672][123090] Updated weights for policy 1, policy_version 1637286 (0.0007) [2023-12-26 12:45:24,721][123091] Updated weights for policy 0, policy_version 1648262 (0.0011) [2023-12-26 12:45:24,728][123090] Updated weights for policy 1, policy_version 1637296 (0.0005) [2023-12-26 12:45:24,777][123091] Updated weights for policy 0, policy_version 1648272 (0.0011) [2023-12-26 12:45:24,782][123090] Updated weights for policy 1, policy_version 1637306 (0.0007) [2023-12-26 12:45:25,560][123090] Updated weights for policy 1, policy_version 1637316 (0.0007) [2023-12-26 12:45:25,614][123091] Updated weights for policy 0, policy_version 1648282 (0.0011) [2023-12-26 12:45:25,619][123090] Updated weights for policy 1, policy_version 1637326 (0.0005) [2023-12-26 12:45:25,675][123090] Updated weights for policy 1, policy_version 1637336 (0.0006) [2023-12-26 12:45:25,679][123091] Updated weights for policy 0, policy_version 1648292 (0.0011) [2023-12-26 12:45:25,739][123091] Updated weights for policy 0, policy_version 1648302 (0.0011) [2023-12-26 12:45:26,400][123090] Updated weights for policy 1, policy_version 1637346 (0.0006) [2023-12-26 12:45:26,459][123090] Updated weights for policy 1, policy_version 1637356 (0.0007) [2023-12-26 12:45:26,522][123090] Updated weights for policy 1, policy_version 1637366 (0.0010) [2023-12-26 12:45:26,574][123090] Updated weights for policy 1, policy_version 1637376 (0.0010) [2023-12-26 12:45:26,577][123091] Updated weights for policy 0, policy_version 1648312 (0.0011) [2023-12-26 12:45:26,630][123091] Updated weights for policy 0, policy_version 1648322 (0.0011) [2023-12-26 12:45:26,697][123091] Updated weights for policy 0, policy_version 1648332 (0.0011) [2023-12-26 12:45:27,386][123090] Updated weights for policy 1, policy_version 1637386 (0.0011) [2023-12-26 12:45:27,452][123090] Updated weights for policy 1, policy_version 1637396 (0.0010) [2023-12-26 12:45:27,520][123090] Updated weights for policy 1, policy_version 1637406 (0.0010) [2023-12-26 12:45:27,539][123091] Updated weights for policy 0, policy_version 1648342 (0.0011) [2023-12-26 12:45:27,600][123091] Updated weights for policy 0, policy_version 1648352 (0.0006) [2023-12-26 12:45:27,665][123091] Updated weights for policy 0, policy_version 1648362 (0.0006) [2023-12-26 12:45:28,236][123090] Updated weights for policy 1, policy_version 1637416 (0.0007) [2023-12-26 12:45:28,302][123090] Updated weights for policy 1, policy_version 1637426 (0.0010) [2023-12-26 12:45:28,374][123090] Updated weights for policy 1, policy_version 1637436 (0.0011) [2023-12-26 12:45:28,394][123091] Updated weights for policy 0, policy_version 1648372 (0.0010) [2023-12-26 12:45:28,445][123091] Updated weights for policy 0, policy_version 1648382 (0.0010) [2023-12-26 12:45:28,502][123091] Updated weights for policy 0, policy_version 1648392 (0.0011) [2023-12-26 12:45:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 841179136. Throughput: 0: 8987.5, 1: 8842.0. Samples: 841169352. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:28,785][121949] Avg episode reward: [(0, '6103.909'), (1, '5675.750')] [2023-12-26 12:45:29,213][123090] Updated weights for policy 1, policy_version 1637446 (0.0010) [2023-12-26 12:45:29,290][123090] Updated weights for policy 1, policy_version 1637456 (0.0010) [2023-12-26 12:45:29,363][123090] Updated weights for policy 1, policy_version 1637466 (0.0011) [2023-12-26 12:45:29,365][123091] Updated weights for policy 0, policy_version 1648402 (0.0010) [2023-12-26 12:45:29,431][123091] Updated weights for policy 0, policy_version 1648412 (0.0010) [2023-12-26 12:45:29,495][123091] Updated weights for policy 0, policy_version 1648422 (0.0009) [2023-12-26 12:45:29,561][123091] Updated weights for policy 0, policy_version 1648432 (0.0010) [2023-12-26 12:45:30,184][123090] Updated weights for policy 1, policy_version 1637476 (0.0011) [2023-12-26 12:45:30,244][123090] Updated weights for policy 1, policy_version 1637486 (0.0010) [2023-12-26 12:45:30,312][123090] Updated weights for policy 1, policy_version 1637496 (0.0009) [2023-12-26 12:45:30,437][123091] Updated weights for policy 0, policy_version 1648442 (0.0009) [2023-12-26 12:45:30,488][123091] Updated weights for policy 0, policy_version 1648452 (0.0009) [2023-12-26 12:45:30,537][123091] Updated weights for policy 0, policy_version 1648462 (0.0009) [2023-12-26 12:45:31,166][123090] Updated weights for policy 1, policy_version 1637506 (0.0009) [2023-12-26 12:45:31,231][123090] Updated weights for policy 1, policy_version 1637516 (0.0009) [2023-12-26 12:45:31,299][123090] Updated weights for policy 1, policy_version 1637526 (0.0009) [2023-12-26 12:45:31,328][123091] Updated weights for policy 0, policy_version 1648472 (0.0009) [2023-12-26 12:45:31,378][123090] Updated weights for policy 1, policy_version 1637536 (0.0009) [2023-12-26 12:45:31,397][123091] Updated weights for policy 0, policy_version 1648482 (0.0009) [2023-12-26 12:45:31,468][123091] Updated weights for policy 0, policy_version 1648492 (0.0009) [2023-12-26 12:45:32,218][123090] Updated weights for policy 1, policy_version 1637546 (0.0010) [2023-12-26 12:45:32,285][123090] Updated weights for policy 1, policy_version 1637556 (0.0011) [2023-12-26 12:45:32,300][123091] Updated weights for policy 0, policy_version 1648502 (0.0008) [2023-12-26 12:45:32,346][123090] Updated weights for policy 1, policy_version 1637566 (0.0011) [2023-12-26 12:45:32,371][123091] Updated weights for policy 0, policy_version 1648512 (0.0007) [2023-12-26 12:45:32,436][123091] Updated weights for policy 0, policy_version 1648522 (0.0009) [2023-12-26 12:45:33,177][123090] Updated weights for policy 1, policy_version 1637576 (0.0010) [2023-12-26 12:45:33,195][123091] Updated weights for policy 0, policy_version 1648532 (0.0010) [2023-12-26 12:45:33,229][123090] Updated weights for policy 1, policy_version 1637586 (0.0010) [2023-12-26 12:45:33,254][123091] Updated weights for policy 0, policy_version 1648542 (0.0007) [2023-12-26 12:45:33,296][123090] Updated weights for policy 1, policy_version 1637596 (0.0011) [2023-12-26 12:45:33,312][123091] Updated weights for policy 0, policy_version 1648552 (0.0008) [2023-12-26 12:45:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 841261056. Throughput: 0: 8913.7, 1: 8794.0. Samples: 841272432. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:33,784][121949] Avg episode reward: [(0, '5925.020'), (1, '5731.885')] [2023-12-26 12:45:34,035][123090] Updated weights for policy 1, policy_version 1637606 (0.0010) [2023-12-26 12:45:34,083][123090] Updated weights for policy 1, policy_version 1637616 (0.0010) [2023-12-26 12:45:34,128][123091] Updated weights for policy 0, policy_version 1648562 (0.0009) [2023-12-26 12:45:34,135][123090] Updated weights for policy 1, policy_version 1637626 (0.0010) [2023-12-26 12:45:34,194][123091] Updated weights for policy 0, policy_version 1648572 (0.0010) [2023-12-26 12:45:34,257][123091] Updated weights for policy 0, policy_version 1648582 (0.0011) [2023-12-26 12:45:34,328][123091] Updated weights for policy 0, policy_version 1648592 (0.0011) [2023-12-26 12:45:34,863][123090] Updated weights for policy 1, policy_version 1637636 (0.0009) [2023-12-26 12:45:34,915][123090] Updated weights for policy 1, policy_version 1637646 (0.0010) [2023-12-26 12:45:34,962][123090] Updated weights for policy 1, policy_version 1637656 (0.0010) [2023-12-26 12:45:35,118][123091] Updated weights for policy 0, policy_version 1648602 (0.0006) [2023-12-26 12:45:35,171][123091] Updated weights for policy 0, policy_version 1648612 (0.0007) [2023-12-26 12:45:35,222][123091] Updated weights for policy 0, policy_version 1648622 (0.0009) [2023-12-26 12:45:35,764][123090] Updated weights for policy 1, policy_version 1637666 (0.0008) [2023-12-26 12:45:35,824][123090] Updated weights for policy 1, policy_version 1637676 (0.0011) [2023-12-26 12:45:35,884][123090] Updated weights for policy 1, policy_version 1637686 (0.0010) [2023-12-26 12:45:35,940][123090] Updated weights for policy 1, policy_version 1637696 (0.0010) [2023-12-26 12:45:35,966][123091] Updated weights for policy 0, policy_version 1648632 (0.0006) [2023-12-26 12:45:36,026][123091] Updated weights for policy 0, policy_version 1648642 (0.0005) [2023-12-26 12:45:36,085][123091] Updated weights for policy 0, policy_version 1648652 (0.0007) [2023-12-26 12:45:36,793][123090] Updated weights for policy 1, policy_version 1637706 (0.0011) [2023-12-26 12:45:36,834][123091] Updated weights for policy 0, policy_version 1648662 (0.0009) [2023-12-26 12:45:36,854][123090] Updated weights for policy 1, policy_version 1637716 (0.0011) [2023-12-26 12:45:36,889][123091] Updated weights for policy 0, policy_version 1648672 (0.0010) [2023-12-26 12:45:36,918][123090] Updated weights for policy 1, policy_version 1637726 (0.0010) [2023-12-26 12:45:36,941][123091] Updated weights for policy 0, policy_version 1648682 (0.0010) [2023-12-26 12:45:37,687][123090] Updated weights for policy 1, policy_version 1637736 (0.0011) [2023-12-26 12:45:37,743][123090] Updated weights for policy 1, policy_version 1637746 (0.0010) [2023-12-26 12:45:37,779][123091] Updated weights for policy 0, policy_version 1648692 (0.0011) [2023-12-26 12:45:37,798][123090] Updated weights for policy 1, policy_version 1637756 (0.0010) [2023-12-26 12:45:37,838][123091] Updated weights for policy 0, policy_version 1648702 (0.0010) [2023-12-26 12:45:37,896][123091] Updated weights for policy 0, policy_version 1648712 (0.0010) [2023-12-26 12:45:38,648][123090] Updated weights for policy 1, policy_version 1637766 (0.0010) [2023-12-26 12:45:38,706][123090] Updated weights for policy 1, policy_version 1637776 (0.0009) [2023-12-26 12:45:38,768][123091] Updated weights for policy 0, policy_version 1648722 (0.0011) [2023-12-26 12:45:38,772][123090] Updated weights for policy 1, policy_version 1637786 (0.0006) [2023-12-26 12:45:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 841342976. Throughput: 0: 8962.1, 1: 8837.5. Samples: 841326768. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:38,785][121949] Avg episode reward: [(0, '5897.924'), (1, '5796.536')] [2023-12-26 12:45:38,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001637792_419274752.pth... [2023-12-26 12:45:38,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001636768_419012608.pth [2023-12-26 12:45:38,831][123091] Updated weights for policy 0, policy_version 1648732 (0.0011) [2023-12-26 12:45:38,894][123091] Updated weights for policy 0, policy_version 1648742 (0.0011) [2023-12-26 12:45:38,959][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001648752_422084608.pth... [2023-12-26 12:45:38,961][123091] Updated weights for policy 0, policy_version 1648752 (0.0010) [2023-12-26 12:45:38,963][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001647696_421814272.pth [2023-12-26 12:45:39,699][123090] Updated weights for policy 1, policy_version 1637796 (0.0010) [2023-12-26 12:45:39,729][123091] Updated weights for policy 0, policy_version 1648762 (0.0011) [2023-12-26 12:45:39,763][123090] Updated weights for policy 1, policy_version 1637806 (0.0009) [2023-12-26 12:45:39,816][123091] Updated weights for policy 0, policy_version 1648772 (0.0011) [2023-12-26 12:45:39,834][123090] Updated weights for policy 1, policy_version 1637816 (0.0009) [2023-12-26 12:45:39,880][123091] Updated weights for policy 0, policy_version 1648782 (0.0009) [2023-12-26 12:45:40,617][123091] Updated weights for policy 0, policy_version 1648792 (0.0007) [2023-12-26 12:45:40,659][123090] Updated weights for policy 1, policy_version 1637826 (0.0008) [2023-12-26 12:45:40,672][123091] Updated weights for policy 0, policy_version 1648802 (0.0006) [2023-12-26 12:45:40,723][123090] Updated weights for policy 1, policy_version 1637836 (0.0005) [2023-12-26 12:45:40,735][123091] Updated weights for policy 0, policy_version 1648812 (0.0007) [2023-12-26 12:45:40,776][123090] Updated weights for policy 1, policy_version 1637846 (0.0005) [2023-12-26 12:45:40,846][123090] Updated weights for policy 1, policy_version 1637856 (0.0005) [2023-12-26 12:45:41,546][123091] Updated weights for policy 0, policy_version 1648822 (0.0009) [2023-12-26 12:45:41,561][123090] Updated weights for policy 1, policy_version 1637866 (0.0009) [2023-12-26 12:45:41,616][123091] Updated weights for policy 0, policy_version 1648832 (0.0007) [2023-12-26 12:45:41,629][123090] Updated weights for policy 1, policy_version 1637876 (0.0009) [2023-12-26 12:45:41,677][123091] Updated weights for policy 0, policy_version 1648842 (0.0007) [2023-12-26 12:45:41,698][123090] Updated weights for policy 1, policy_version 1637886 (0.0008) [2023-12-26 12:45:42,493][123091] Updated weights for policy 0, policy_version 1648852 (0.0010) [2023-12-26 12:45:42,562][123091] Updated weights for policy 0, policy_version 1648862 (0.0009) [2023-12-26 12:45:42,562][123090] Updated weights for policy 1, policy_version 1637896 (0.0009) [2023-12-26 12:45:42,628][123090] Updated weights for policy 1, policy_version 1637906 (0.0009) [2023-12-26 12:45:42,628][123091] Updated weights for policy 0, policy_version 1648872 (0.0009) [2023-12-26 12:45:42,691][123090] Updated weights for policy 1, policy_version 1637916 (0.0009) [2023-12-26 12:45:43,458][123091] Updated weights for policy 0, policy_version 1648882 (0.0009) [2023-12-26 12:45:43,484][123090] Updated weights for policy 1, policy_version 1637926 (0.0007) [2023-12-26 12:45:43,506][123091] Updated weights for policy 0, policy_version 1648892 (0.0009) [2023-12-26 12:45:43,545][123090] Updated weights for policy 1, policy_version 1637936 (0.0006) [2023-12-26 12:45:43,559][123091] Updated weights for policy 0, policy_version 1648902 (0.0009) [2023-12-26 12:45:43,604][123090] Updated weights for policy 1, policy_version 1637946 (0.0005) [2023-12-26 12:45:43,617][123091] Updated weights for policy 0, policy_version 1648912 (0.0008) [2023-12-26 12:45:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 841441280. Throughput: 0: 8956.0, 1: 8749.1. Samples: 841430280. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:43,785][121949] Avg episode reward: [(0, '5824.953'), (1, '5940.440')] [2023-12-26 12:45:44,165][123090] Updated weights for policy 1, policy_version 1637956 (0.0007) [2023-12-26 12:45:44,231][123090] Updated weights for policy 1, policy_version 1637966 (0.0009) [2023-12-26 12:45:44,297][123090] Updated weights for policy 1, policy_version 1637976 (0.0010) [2023-12-26 12:45:44,455][123091] Updated weights for policy 0, policy_version 1648922 (0.0009) [2023-12-26 12:45:44,513][123091] Updated weights for policy 0, policy_version 1648932 (0.0010) [2023-12-26 12:45:44,561][123091] Updated weights for policy 0, policy_version 1648942 (0.0009) [2023-12-26 12:45:45,098][123090] Updated weights for policy 1, policy_version 1637986 (0.0009) [2023-12-26 12:45:45,163][123090] Updated weights for policy 1, policy_version 1637996 (0.0008) [2023-12-26 12:45:45,228][123090] Updated weights for policy 1, policy_version 1638006 (0.0010) [2023-12-26 12:45:45,290][123090] Updated weights for policy 1, policy_version 1638016 (0.0009) [2023-12-26 12:45:45,395][123091] Updated weights for policy 0, policy_version 1648952 (0.0006) [2023-12-26 12:45:45,464][123091] Updated weights for policy 0, policy_version 1648962 (0.0007) [2023-12-26 12:45:45,526][123091] Updated weights for policy 0, policy_version 1648972 (0.0010) [2023-12-26 12:45:46,118][123090] Updated weights for policy 1, policy_version 1638026 (0.0006) [2023-12-26 12:45:46,181][123090] Updated weights for policy 1, policy_version 1638036 (0.0005) [2023-12-26 12:45:46,236][123090] Updated weights for policy 1, policy_version 1638046 (0.0006) [2023-12-26 12:45:46,289][123091] Updated weights for policy 0, policy_version 1648982 (0.0007) [2023-12-26 12:45:46,358][123091] Updated weights for policy 0, policy_version 1648992 (0.0005) [2023-12-26 12:45:46,421][123091] Updated weights for policy 0, policy_version 1649002 (0.0007) [2023-12-26 12:45:47,005][123090] Updated weights for policy 1, policy_version 1638056 (0.0006) [2023-12-26 12:45:47,021][123091] Updated weights for policy 0, policy_version 1649012 (0.0006) [2023-12-26 12:45:47,073][123090] Updated weights for policy 1, policy_version 1638066 (0.0006) [2023-12-26 12:45:47,091][123091] Updated weights for policy 0, policy_version 1649022 (0.0007) [2023-12-26 12:45:47,132][123090] Updated weights for policy 1, policy_version 1638076 (0.0007) [2023-12-26 12:45:47,158][123091] Updated weights for policy 0, policy_version 1649032 (0.0007) [2023-12-26 12:45:47,746][123090] Updated weights for policy 1, policy_version 1638086 (0.0007) [2023-12-26 12:45:47,821][123090] Updated weights for policy 1, policy_version 1638096 (0.0005) [2023-12-26 12:45:47,894][123090] Updated weights for policy 1, policy_version 1638106 (0.0005) [2023-12-26 12:45:48,005][123091] Updated weights for policy 0, policy_version 1649042 (0.0009) [2023-12-26 12:45:48,071][123091] Updated weights for policy 0, policy_version 1649052 (0.0010) [2023-12-26 12:45:48,129][123091] Updated weights for policy 0, policy_version 1649062 (0.0009) [2023-12-26 12:45:48,183][123091] Updated weights for policy 0, policy_version 1649072 (0.0010) [2023-12-26 12:45:48,602][123090] Updated weights for policy 1, policy_version 1638116 (0.0007) [2023-12-26 12:45:48,668][123090] Updated weights for policy 1, policy_version 1638126 (0.0010) [2023-12-26 12:45:48,736][123090] Updated weights for policy 1, policy_version 1638136 (0.0011) [2023-12-26 12:45:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 841531392. Throughput: 0: 8978.5, 1: 8780.4. Samples: 841539716. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:48,785][121949] Avg episode reward: [(0, '5993.423'), (1, '6053.959')] [2023-12-26 12:45:49,053][123091] Updated weights for policy 0, policy_version 1649082 (0.0009) [2023-12-26 12:45:49,121][123091] Updated weights for policy 0, policy_version 1649092 (0.0009) [2023-12-26 12:45:49,194][123091] Updated weights for policy 0, policy_version 1649102 (0.0008) [2023-12-26 12:45:49,550][123090] Updated weights for policy 1, policy_version 1638146 (0.0009) [2023-12-26 12:45:49,614][123090] Updated weights for policy 1, policy_version 1638156 (0.0007) [2023-12-26 12:45:49,684][123090] Updated weights for policy 1, policy_version 1638166 (0.0009) [2023-12-26 12:45:49,752][123090] Updated weights for policy 1, policy_version 1638176 (0.0009) [2023-12-26 12:45:49,957][123091] Updated weights for policy 0, policy_version 1649112 (0.0009) [2023-12-26 12:45:50,013][123091] Updated weights for policy 0, policy_version 1649122 (0.0011) [2023-12-26 12:45:50,076][123091] Updated weights for policy 0, policy_version 1649132 (0.0011) [2023-12-26 12:45:50,483][123090] Updated weights for policy 1, policy_version 1638186 (0.0005) [2023-12-26 12:45:50,548][123090] Updated weights for policy 1, policy_version 1638196 (0.0006) [2023-12-26 12:45:50,626][123090] Updated weights for policy 1, policy_version 1638206 (0.0007) [2023-12-26 12:45:50,886][123091] Updated weights for policy 0, policy_version 1649142 (0.0008) [2023-12-26 12:45:50,965][123091] Updated weights for policy 0, policy_version 1649152 (0.0006) [2023-12-26 12:45:51,036][123091] Updated weights for policy 0, policy_version 1649162 (0.0009) [2023-12-26 12:45:51,358][123090] Updated weights for policy 1, policy_version 1638216 (0.0008) [2023-12-26 12:45:51,418][123090] Updated weights for policy 1, policy_version 1638226 (0.0009) [2023-12-26 12:45:51,471][123090] Updated weights for policy 1, policy_version 1638236 (0.0009) [2023-12-26 12:45:51,812][123091] Updated weights for policy 0, policy_version 1649172 (0.0010) [2023-12-26 12:45:51,870][123091] Updated weights for policy 0, policy_version 1649182 (0.0009) [2023-12-26 12:45:51,925][123091] Updated weights for policy 0, policy_version 1649192 (0.0010) [2023-12-26 12:45:52,413][123090] Updated weights for policy 1, policy_version 1638246 (0.0009) [2023-12-26 12:45:52,485][123090] Updated weights for policy 1, policy_version 1638256 (0.0010) [2023-12-26 12:45:52,549][123090] Updated weights for policy 1, policy_version 1638266 (0.0010) [2023-12-26 12:45:52,719][123091] Updated weights for policy 0, policy_version 1649202 (0.0010) [2023-12-26 12:45:52,787][123091] Updated weights for policy 0, policy_version 1649213 (0.0009) [2023-12-26 12:45:52,848][123091] Updated weights for policy 0, policy_version 1649223 (0.0010) [2023-12-26 12:45:53,383][123090] Updated weights for policy 1, policy_version 1638276 (0.0008) [2023-12-26 12:45:53,459][123090] Updated weights for policy 1, policy_version 1638286 (0.0005) [2023-12-26 12:45:53,529][123090] Updated weights for policy 1, policy_version 1638296 (0.0005) [2023-12-26 12:45:53,713][123091] Updated weights for policy 0, policy_version 1649233 (0.0009) [2023-12-26 12:45:53,769][123091] Updated weights for policy 0, policy_version 1649243 (0.0012) [2023-12-26 12:45:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 841613312. Throughput: 0: 8907.5, 1: 8760.4. Samples: 841592564. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:53,785][121949] Avg episode reward: [(0, '5942.839'), (1, '6023.430')] [2023-12-26 12:45:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001638304_419405824.pth... [2023-12-26 12:45:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001637280_419143680.pth [2023-12-26 12:45:53,825][123091] Updated weights for policy 0, policy_version 1649253 (0.0007) [2023-12-26 12:45:53,877][123091] Updated weights for policy 0, policy_version 1649263 (0.0007) [2023-12-26 12:45:53,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001649264_422215680.pth... [2023-12-26 12:45:53,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001648240_421953536.pth [2023-12-26 12:45:54,252][123090] Updated weights for policy 1, policy_version 1638306 (0.0006) [2023-12-26 12:45:54,316][123090] Updated weights for policy 1, policy_version 1638316 (0.0009) [2023-12-26 12:45:54,377][123090] Updated weights for policy 1, policy_version 1638326 (0.0010) [2023-12-26 12:45:54,437][123090] Updated weights for policy 1, policy_version 1638336 (0.0009) [2023-12-26 12:45:54,641][123091] Updated weights for policy 0, policy_version 1649273 (0.0009) [2023-12-26 12:45:54,692][123091] Updated weights for policy 0, policy_version 1649283 (0.0009) [2023-12-26 12:45:54,749][123091] Updated weights for policy 0, policy_version 1649293 (0.0009) [2023-12-26 12:45:55,222][123090] Updated weights for policy 1, policy_version 1638346 (0.0009) [2023-12-26 12:45:55,286][123090] Updated weights for policy 1, policy_version 1638356 (0.0009) [2023-12-26 12:45:55,338][123090] Updated weights for policy 1, policy_version 1638366 (0.0009) [2023-12-26 12:45:55,626][123091] Updated weights for policy 0, policy_version 1649303 (0.0009) [2023-12-26 12:45:55,692][123091] Updated weights for policy 0, policy_version 1649313 (0.0009) [2023-12-26 12:45:55,741][123091] Updated weights for policy 0, policy_version 1649323 (0.0009) [2023-12-26 12:45:56,196][123090] Updated weights for policy 1, policy_version 1638376 (0.0009) [2023-12-26 12:45:56,260][123090] Updated weights for policy 1, policy_version 1638386 (0.0009) [2023-12-26 12:45:56,312][123090] Updated weights for policy 1, policy_version 1638396 (0.0009) [2023-12-26 12:45:56,519][123091] Updated weights for policy 0, policy_version 1649333 (0.0010) [2023-12-26 12:45:56,583][123091] Updated weights for policy 0, policy_version 1649343 (0.0010) [2023-12-26 12:45:56,641][123091] Updated weights for policy 0, policy_version 1649353 (0.0008) [2023-12-26 12:45:57,191][123090] Updated weights for policy 1, policy_version 1638406 (0.0010) [2023-12-26 12:45:57,248][123090] Updated weights for policy 1, policy_version 1638416 (0.0009) [2023-12-26 12:45:57,287][123091] Updated weights for policy 0, policy_version 1649363 (0.0005) [2023-12-26 12:45:57,301][123090] Updated weights for policy 1, policy_version 1638426 (0.0009) [2023-12-26 12:45:57,343][123091] Updated weights for policy 0, policy_version 1649373 (0.0006) [2023-12-26 12:45:57,408][123091] Updated weights for policy 0, policy_version 1649383 (0.0005) [2023-12-26 12:45:58,000][123091] Updated weights for policy 0, policy_version 1649393 (0.0006) [2023-12-26 12:45:58,047][123091] Updated weights for policy 0, policy_version 1649403 (0.0010) [2023-12-26 12:45:58,112][123091] Updated weights for policy 0, policy_version 1649413 (0.0011) [2023-12-26 12:45:58,172][123091] Updated weights for policy 0, policy_version 1649423 (0.0011) [2023-12-26 12:45:58,208][123090] Updated weights for policy 1, policy_version 1638436 (0.0009) [2023-12-26 12:45:58,262][123090] Updated weights for policy 1, policy_version 1638446 (0.0006) [2023-12-26 12:45:58,325][123090] Updated weights for policy 1, policy_version 1638456 (0.0006) [2023-12-26 12:45:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 841703424. Throughput: 0: 8886.3, 1: 8796.6. Samples: 841698340. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:45:58,785][121949] Avg episode reward: [(0, '5761.031'), (1, '5807.732')] [2023-12-26 12:45:59,069][123091] Updated weights for policy 0, policy_version 1649433 (0.0010) [2023-12-26 12:45:59,127][123091] Updated weights for policy 0, policy_version 1649443 (0.0010) [2023-12-26 12:45:59,194][123091] Updated weights for policy 0, policy_version 1649453 (0.0008) [2023-12-26 12:45:59,250][123090] Updated weights for policy 1, policy_version 1638466 (0.0008) [2023-12-26 12:45:59,316][123090] Updated weights for policy 1, policy_version 1638476 (0.0010) [2023-12-26 12:45:59,380][123090] Updated weights for policy 1, policy_version 1638486 (0.0010) [2023-12-26 12:45:59,445][123090] Updated weights for policy 1, policy_version 1638496 (0.0010) [2023-12-26 12:46:00,014][123091] Updated weights for policy 0, policy_version 1649463 (0.0009) [2023-12-26 12:46:00,069][123091] Updated weights for policy 0, policy_version 1649473 (0.0009) [2023-12-26 12:46:00,139][123091] Updated weights for policy 0, policy_version 1649483 (0.0010) [2023-12-26 12:46:00,318][123090] Updated weights for policy 1, policy_version 1638506 (0.0007) [2023-12-26 12:46:00,377][123090] Updated weights for policy 1, policy_version 1638516 (0.0006) [2023-12-26 12:46:00,442][123090] Updated weights for policy 1, policy_version 1638526 (0.0008) [2023-12-26 12:46:01,048][123091] Updated weights for policy 0, policy_version 1649493 (0.0008) [2023-12-26 12:46:01,116][123091] Updated weights for policy 0, policy_version 1649503 (0.0010) [2023-12-26 12:46:01,159][123090] Updated weights for policy 1, policy_version 1638536 (0.0008) [2023-12-26 12:46:01,191][123091] Updated weights for policy 0, policy_version 1649513 (0.0010) [2023-12-26 12:46:01,228][123090] Updated weights for policy 1, policy_version 1638546 (0.0007) [2023-12-26 12:46:01,295][123090] Updated weights for policy 1, policy_version 1638556 (0.0009) [2023-12-26 12:46:02,075][123091] Updated weights for policy 0, policy_version 1649523 (0.0009) [2023-12-26 12:46:02,119][123090] Updated weights for policy 1, policy_version 1638566 (0.0007) [2023-12-26 12:46:02,138][123091] Updated weights for policy 0, policy_version 1649533 (0.0009) [2023-12-26 12:46:02,179][123090] Updated weights for policy 1, policy_version 1638576 (0.0006) [2023-12-26 12:46:02,198][123091] Updated weights for policy 0, policy_version 1649543 (0.0009) [2023-12-26 12:46:02,240][123090] Updated weights for policy 1, policy_version 1638586 (0.0007) [2023-12-26 12:46:03,028][123090] Updated weights for policy 1, policy_version 1638596 (0.0009) [2023-12-26 12:46:03,044][123091] Updated weights for policy 0, policy_version 1649553 (0.0008) [2023-12-26 12:46:03,100][123090] Updated weights for policy 1, policy_version 1638606 (0.0007) [2023-12-26 12:46:03,105][123091] Updated weights for policy 0, policy_version 1649563 (0.0010) [2023-12-26 12:46:03,154][123090] Updated weights for policy 1, policy_version 1638616 (0.0007) [2023-12-26 12:46:03,165][123091] Updated weights for policy 0, policy_version 1649573 (0.0010) [2023-12-26 12:46:03,230][123091] Updated weights for policy 0, policy_version 1649583 (0.0010) [2023-12-26 12:46:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 841785344. Throughput: 0: 8729.9, 1: 8719.3. Samples: 841800692. Policy #0 lag: (min: 31.0, avg: 39.7, max: 63.0) [2023-12-26 12:46:03,784][121949] Avg episode reward: [(0, '5884.879'), (1, '5904.455')] [2023-12-26 12:46:03,966][123090] Updated weights for policy 1, policy_version 1638626 (0.0009) [2023-12-26 12:46:04,033][123090] Updated weights for policy 1, policy_version 1638636 (0.0009) [2023-12-26 12:46:04,071][123091] Updated weights for policy 0, policy_version 1649593 (0.0009) [2023-12-26 12:46:04,106][123090] Updated weights for policy 1, policy_version 1638646 (0.0007) [2023-12-26 12:46:04,137][123091] Updated weights for policy 0, policy_version 1649603 (0.0011) [2023-12-26 12:46:04,167][123090] Updated weights for policy 1, policy_version 1638656 (0.0007) [2023-12-26 12:46:04,196][123091] Updated weights for policy 0, policy_version 1649613 (0.0010) [2023-12-26 12:46:04,975][123090] Updated weights for policy 1, policy_version 1638666 (0.0007) [2023-12-26 12:46:05,026][123091] Updated weights for policy 0, policy_version 1649623 (0.0009) [2023-12-26 12:46:05,031][123090] Updated weights for policy 1, policy_version 1638676 (0.0010) [2023-12-26 12:46:05,080][123090] Updated weights for policy 1, policy_version 1638686 (0.0008) [2023-12-26 12:46:05,081][123091] Updated weights for policy 0, policy_version 1649633 (0.0008) [2023-12-26 12:46:05,140][123091] Updated weights for policy 0, policy_version 1649643 (0.0009) [2023-12-26 12:46:05,912][123091] Updated weights for policy 0, policy_version 1649653 (0.0008) [2023-12-26 12:46:05,927][123090] Updated weights for policy 1, policy_version 1638696 (0.0009) [2023-12-26 12:46:05,964][123091] Updated weights for policy 0, policy_version 1649663 (0.0005) [2023-12-26 12:46:05,990][123090] Updated weights for policy 1, policy_version 1638706 (0.0009) [2023-12-26 12:46:06,019][123091] Updated weights for policy 0, policy_version 1649673 (0.0006) [2023-12-26 12:46:06,058][123090] Updated weights for policy 1, policy_version 1638716 (0.0008) [2023-12-26 12:46:06,759][123091] Updated weights for policy 0, policy_version 1649683 (0.0008) [2023-12-26 12:46:06,825][123091] Updated weights for policy 0, policy_version 1649693 (0.0006) [2023-12-26 12:46:06,889][123091] Updated weights for policy 0, policy_version 1649703 (0.0010) [2023-12-26 12:46:06,938][123090] Updated weights for policy 1, policy_version 1638726 (0.0010) [2023-12-26 12:46:06,991][123090] Updated weights for policy 1, policy_version 1638736 (0.0009) [2023-12-26 12:46:07,066][123090] Updated weights for policy 1, policy_version 1638746 (0.0010) [2023-12-26 12:46:07,561][123091] Updated weights for policy 0, policy_version 1649713 (0.0009) [2023-12-26 12:46:07,613][123091] Updated weights for policy 0, policy_version 1649723 (0.0005) [2023-12-26 12:46:07,660][123091] Updated weights for policy 0, policy_version 1649733 (0.0005) [2023-12-26 12:46:07,713][123091] Updated weights for policy 0, policy_version 1649743 (0.0005) [2023-12-26 12:46:07,764][123090] Updated weights for policy 1, policy_version 1638756 (0.0008) [2023-12-26 12:46:07,825][123090] Updated weights for policy 1, policy_version 1638766 (0.0005) [2023-12-26 12:46:07,892][123090] Updated weights for policy 1, policy_version 1638776 (0.0006) [2023-12-26 12:46:08,407][123091] Updated weights for policy 0, policy_version 1649753 (0.0007) [2023-12-26 12:46:08,479][123091] Updated weights for policy 0, policy_version 1649763 (0.0006) [2023-12-26 12:46:08,552][123091] Updated weights for policy 0, policy_version 1649773 (0.0005) [2023-12-26 12:46:08,597][123090] Updated weights for policy 1, policy_version 1638786 (0.0006) [2023-12-26 12:46:08,654][123090] Updated weights for policy 1, policy_version 1638796 (0.0010) [2023-12-26 12:46:08,716][123090] Updated weights for policy 1, policy_version 1638806 (0.0009) [2023-12-26 12:46:08,778][123090] Updated weights for policy 1, policy_version 1638816 (0.0008) [2023-12-26 12:46:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 841883648. Throughput: 0: 8736.3, 1: 8715.4. Samples: 841852260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:08,784][121949] Avg episode reward: [(0, '5671.868'), (1, '5795.549')] [2023-12-26 12:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001649776_422346752.pth... [2023-12-26 12:46:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001638816_419536896.pth... [2023-12-26 12:46:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001648752_422084608.pth [2023-12-26 12:46:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001637792_419274752.pth [2023-12-26 12:46:09,321][123091] Updated weights for policy 0, policy_version 1649783 (0.0008) [2023-12-26 12:46:09,392][123091] Updated weights for policy 0, policy_version 1649793 (0.0009) [2023-12-26 12:46:09,457][123091] Updated weights for policy 0, policy_version 1649803 (0.0009) [2023-12-26 12:46:09,581][123090] Updated weights for policy 1, policy_version 1638826 (0.0008) [2023-12-26 12:46:09,656][123090] Updated weights for policy 1, policy_version 1638836 (0.0008) [2023-12-26 12:46:09,722][123090] Updated weights for policy 1, policy_version 1638846 (0.0008) [2023-12-26 12:46:10,250][123091] Updated weights for policy 0, policy_version 1649813 (0.0009) [2023-12-26 12:46:10,314][123091] Updated weights for policy 0, policy_version 1649823 (0.0010) [2023-12-26 12:46:10,381][123091] Updated weights for policy 0, policy_version 1649833 (0.0010) [2023-12-26 12:46:10,527][123090] Updated weights for policy 1, policy_version 1638856 (0.0009) [2023-12-26 12:46:10,582][123090] Updated weights for policy 1, policy_version 1638867 (0.0010) [2023-12-26 12:46:10,631][123090] Updated weights for policy 1, policy_version 1638877 (0.0009) [2023-12-26 12:46:11,239][123091] Updated weights for policy 0, policy_version 1649843 (0.0010) [2023-12-26 12:46:11,307][123091] Updated weights for policy 0, policy_version 1649853 (0.0010) [2023-12-26 12:46:11,370][123091] Updated weights for policy 0, policy_version 1649863 (0.0010) [2023-12-26 12:46:11,424][123090] Updated weights for policy 1, policy_version 1638887 (0.0008) [2023-12-26 12:46:11,500][123090] Updated weights for policy 1, policy_version 1638897 (0.0006) [2023-12-26 12:46:11,578][123090] Updated weights for policy 1, policy_version 1638907 (0.0006) [2023-12-26 12:46:12,207][123091] Updated weights for policy 0, policy_version 1649873 (0.0009) [2023-12-26 12:46:12,261][123091] Updated weights for policy 0, policy_version 1649883 (0.0009) [2023-12-26 12:46:12,327][123091] Updated weights for policy 0, policy_version 1649893 (0.0009) [2023-12-26 12:46:12,357][123090] Updated weights for policy 1, policy_version 1638917 (0.0008) [2023-12-26 12:46:12,412][123091] Updated weights for policy 0, policy_version 1649903 (0.0010) [2023-12-26 12:46:12,419][123090] Updated weights for policy 1, policy_version 1638927 (0.0009) [2023-12-26 12:46:12,467][123090] Updated weights for policy 1, policy_version 1638937 (0.0005) [2023-12-26 12:46:13,235][123091] Updated weights for policy 0, policy_version 1649913 (0.0011) [2023-12-26 12:46:13,242][123090] Updated weights for policy 1, policy_version 1638947 (0.0006) [2023-12-26 12:46:13,298][123091] Updated weights for policy 0, policy_version 1649923 (0.0011) [2023-12-26 12:46:13,310][123090] Updated weights for policy 1, policy_version 1638957 (0.0005) [2023-12-26 12:46:13,363][123091] Updated weights for policy 0, policy_version 1649933 (0.0010) [2023-12-26 12:46:13,372][123090] Updated weights for policy 1, policy_version 1638967 (0.0006) [2023-12-26 12:46:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 841965568. Throughput: 0: 8791.6, 1: 8742.6. Samples: 841958388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:13,784][121949] Avg episode reward: [(0, '5432.615'), (1, '5778.831')] [2023-12-26 12:46:14,066][123091] Updated weights for policy 0, policy_version 1649943 (0.0007) [2023-12-26 12:46:14,085][123090] Updated weights for policy 1, policy_version 1638977 (0.0008) [2023-12-26 12:46:14,126][123091] Updated weights for policy 0, policy_version 1649953 (0.0010) [2023-12-26 12:46:14,137][123090] Updated weights for policy 1, policy_version 1638987 (0.0010) [2023-12-26 12:46:14,177][123091] Updated weights for policy 0, policy_version 1649963 (0.0010) [2023-12-26 12:46:14,189][123090] Updated weights for policy 1, policy_version 1638997 (0.0010) [2023-12-26 12:46:14,248][123090] Updated weights for policy 1, policy_version 1639007 (0.0010) [2023-12-26 12:46:14,949][123091] Updated weights for policy 0, policy_version 1649973 (0.0011) [2023-12-26 12:46:15,017][123091] Updated weights for policy 0, policy_version 1649983 (0.0011) [2023-12-26 12:46:15,026][123090] Updated weights for policy 1, policy_version 1639017 (0.0009) [2023-12-26 12:46:15,081][123091] Updated weights for policy 0, policy_version 1649993 (0.0011) [2023-12-26 12:46:15,094][123090] Updated weights for policy 1, policy_version 1639027 (0.0008) [2023-12-26 12:46:15,162][123090] Updated weights for policy 1, policy_version 1639037 (0.0005) [2023-12-26 12:46:15,842][123091] Updated weights for policy 0, policy_version 1650003 (0.0009) [2023-12-26 12:46:15,908][123091] Updated weights for policy 0, policy_version 1650013 (0.0005) [2023-12-26 12:46:15,976][123091] Updated weights for policy 0, policy_version 1650023 (0.0005) [2023-12-26 12:46:15,979][123090] Updated weights for policy 1, policy_version 1639047 (0.0008) [2023-12-26 12:46:16,033][123090] Updated weights for policy 1, policy_version 1639057 (0.0009) [2023-12-26 12:46:16,080][123090] Updated weights for policy 1, policy_version 1639067 (0.0005) [2023-12-26 12:46:16,727][123091] Updated weights for policy 0, policy_version 1650033 (0.0006) [2023-12-26 12:46:16,796][123091] Updated weights for policy 0, policy_version 1650043 (0.0010) [2023-12-26 12:46:16,829][123090] Updated weights for policy 1, policy_version 1639077 (0.0006) [2023-12-26 12:46:16,858][123091] Updated weights for policy 0, policy_version 1650053 (0.0010) [2023-12-26 12:46:16,880][123090] Updated weights for policy 1, policy_version 1639087 (0.0010) [2023-12-26 12:46:16,917][123091] Updated weights for policy 0, policy_version 1650063 (0.0010) [2023-12-26 12:46:16,931][123090] Updated weights for policy 1, policy_version 1639097 (0.0010) [2023-12-26 12:46:17,715][123090] Updated weights for policy 1, policy_version 1639107 (0.0009) [2023-12-26 12:46:17,726][123091] Updated weights for policy 0, policy_version 1650073 (0.0011) [2023-12-26 12:46:17,772][123090] Updated weights for policy 1, policy_version 1639117 (0.0010) [2023-12-26 12:46:17,789][123091] Updated weights for policy 0, policy_version 1650083 (0.0010) [2023-12-26 12:46:17,839][123090] Updated weights for policy 1, policy_version 1639127 (0.0010) [2023-12-26 12:46:17,847][123091] Updated weights for policy 0, policy_version 1650093 (0.0010) [2023-12-26 12:46:18,645][123091] Updated weights for policy 0, policy_version 1650103 (0.0008) [2023-12-26 12:46:18,691][123090] Updated weights for policy 1, policy_version 1639137 (0.0010) [2023-12-26 12:46:18,705][123091] Updated weights for policy 0, policy_version 1650113 (0.0006) [2023-12-26 12:46:18,754][123090] Updated weights for policy 1, policy_version 1639147 (0.0009) [2023-12-26 12:46:18,767][123091] Updated weights for policy 0, policy_version 1650123 (0.0006) [2023-12-26 12:46:18,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 842047488. Throughput: 0: 8854.4, 1: 8832.0. Samples: 842068320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:18,785][121949] Avg episode reward: [(0, '5697.528'), (1, '5831.299')] [2023-12-26 12:46:18,817][123090] Updated weights for policy 1, policy_version 1639157 (0.0010) [2023-12-26 12:46:18,884][123090] Updated weights for policy 1, policy_version 1639167 (0.0010) [2023-12-26 12:46:19,442][123091] Updated weights for policy 0, policy_version 1650133 (0.0007) [2023-12-26 12:46:19,511][123091] Updated weights for policy 0, policy_version 1650143 (0.0008) [2023-12-26 12:46:19,578][123091] Updated weights for policy 0, policy_version 1650153 (0.0009) [2023-12-26 12:46:19,715][123090] Updated weights for policy 1, policy_version 1639177 (0.0010) [2023-12-26 12:46:19,764][123090] Updated weights for policy 1, policy_version 1639187 (0.0009) [2023-12-26 12:46:19,820][123090] Updated weights for policy 1, policy_version 1639197 (0.0010) [2023-12-26 12:46:20,253][123091] Updated weights for policy 0, policy_version 1650163 (0.0007) [2023-12-26 12:46:20,320][123091] Updated weights for policy 0, policy_version 1650173 (0.0005) [2023-12-26 12:46:20,380][123091] Updated weights for policy 0, policy_version 1650183 (0.0006) [2023-12-26 12:46:20,788][123090] Updated weights for policy 1, policy_version 1639207 (0.0009) [2023-12-26 12:46:20,854][123090] Updated weights for policy 1, policy_version 1639217 (0.0009) [2023-12-26 12:46:20,908][123090] Updated weights for policy 1, policy_version 1639227 (0.0009) [2023-12-26 12:46:21,114][123091] Updated weights for policy 0, policy_version 1650193 (0.0007) [2023-12-26 12:46:21,181][123091] Updated weights for policy 0, policy_version 1650203 (0.0009) [2023-12-26 12:46:21,244][123091] Updated weights for policy 0, policy_version 1650213 (0.0010) [2023-12-26 12:46:21,307][123091] Updated weights for policy 0, policy_version 1650223 (0.0009) [2023-12-26 12:46:21,799][123090] Updated weights for policy 1, policy_version 1639237 (0.0009) [2023-12-26 12:46:21,876][123090] Updated weights for policy 1, policy_version 1639247 (0.0008) [2023-12-26 12:46:21,949][123090] Updated weights for policy 1, policy_version 1639257 (0.0008) [2023-12-26 12:46:22,128][123091] Updated weights for policy 0, policy_version 1650233 (0.0006) [2023-12-26 12:46:22,184][123091] Updated weights for policy 0, policy_version 1650243 (0.0005) [2023-12-26 12:46:22,247][123091] Updated weights for policy 0, policy_version 1650253 (0.0006) [2023-12-26 12:46:22,777][123090] Updated weights for policy 1, policy_version 1639267 (0.0009) [2023-12-26 12:46:22,835][123090] Updated weights for policy 1, policy_version 1639277 (0.0010) [2023-12-26 12:46:22,889][123090] Updated weights for policy 1, policy_version 1639287 (0.0009) [2023-12-26 12:46:23,084][123091] Updated weights for policy 0, policy_version 1650263 (0.0006) [2023-12-26 12:46:23,135][123091] Updated weights for policy 0, policy_version 1650273 (0.0008) [2023-12-26 12:46:23,198][123091] Updated weights for policy 0, policy_version 1650283 (0.0009) [2023-12-26 12:46:23,721][123090] Updated weights for policy 1, policy_version 1639297 (0.0008) [2023-12-26 12:46:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 842137600. Throughput: 0: 8863.4, 1: 8767.2. Samples: 842120144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:23,785][121949] Avg episode reward: [(0, '5846.963'), (1, '5802.535')] [2023-12-26 12:46:23,789][123090] Updated weights for policy 1, policy_version 1639307 (0.0008) [2023-12-26 12:46:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001650288_422477824.pth... [2023-12-26 12:46:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001649264_422215680.pth [2023-12-26 12:46:23,852][123090] Updated weights for policy 1, policy_version 1639317 (0.0005) [2023-12-26 12:46:23,915][123090] Updated weights for policy 1, policy_version 1639327 (0.0009) [2023-12-26 12:46:23,919][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001639328_419667968.pth... [2023-12-26 12:46:23,924][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001638304_419405824.pth [2023-12-26 12:46:24,017][123091] Updated weights for policy 0, policy_version 1650293 (0.0009) [2023-12-26 12:46:24,068][123091] Updated weights for policy 0, policy_version 1650303 (0.0009) [2023-12-26 12:46:24,130][123091] Updated weights for policy 0, policy_version 1650313 (0.0008) [2023-12-26 12:46:24,644][123090] Updated weights for policy 1, policy_version 1639337 (0.0010) [2023-12-26 12:46:24,695][123090] Updated weights for policy 1, policy_version 1639347 (0.0009) [2023-12-26 12:46:24,744][123090] Updated weights for policy 1, policy_version 1639358 (0.0009) [2023-12-26 12:46:24,932][123091] Updated weights for policy 0, policy_version 1650323 (0.0010) [2023-12-26 12:46:24,989][123091] Updated weights for policy 0, policy_version 1650333 (0.0010) [2023-12-26 12:46:25,043][123091] Updated weights for policy 0, policy_version 1650344 (0.0010) [2023-12-26 12:46:25,527][123090] Updated weights for policy 1, policy_version 1639368 (0.0010) [2023-12-26 12:46:25,586][123090] Updated weights for policy 1, policy_version 1639378 (0.0010) [2023-12-26 12:46:25,640][123090] Updated weights for policy 1, policy_version 1639388 (0.0010) [2023-12-26 12:46:25,802][123091] Updated weights for policy 0, policy_version 1650354 (0.0010) [2023-12-26 12:46:25,856][123091] Updated weights for policy 0, policy_version 1650364 (0.0009) [2023-12-26 12:46:25,906][123091] Updated weights for policy 0, policy_version 1650374 (0.0009) [2023-12-26 12:46:25,966][123091] Updated weights for policy 0, policy_version 1650384 (0.0009) [2023-12-26 12:46:26,514][123090] Updated weights for policy 1, policy_version 1639398 (0.0009) [2023-12-26 12:46:26,582][123090] Updated weights for policy 1, policy_version 1639408 (0.0009) [2023-12-26 12:46:26,641][123090] Updated weights for policy 1, policy_version 1639418 (0.0009) [2023-12-26 12:46:26,700][123091] Updated weights for policy 0, policy_version 1650394 (0.0008) [2023-12-26 12:46:26,742][123091] Updated weights for policy 0, policy_version 1650404 (0.0005) [2023-12-26 12:46:26,791][123091] Updated weights for policy 0, policy_version 1650414 (0.0005) [2023-12-26 12:46:27,448][123090] Updated weights for policy 1, policy_version 1639428 (0.0008) [2023-12-26 12:46:27,461][123091] Updated weights for policy 0, policy_version 1650424 (0.0005) [2023-12-26 12:46:27,492][123090] Updated weights for policy 1, policy_version 1639438 (0.0010) [2023-12-26 12:46:27,513][123091] Updated weights for policy 0, policy_version 1650434 (0.0009) [2023-12-26 12:46:27,546][123090] Updated weights for policy 1, policy_version 1639448 (0.0010) [2023-12-26 12:46:27,563][123091] Updated weights for policy 0, policy_version 1650444 (0.0010) [2023-12-26 12:46:28,301][123091] Updated weights for policy 0, policy_version 1650454 (0.0009) [2023-12-26 12:46:28,363][123091] Updated weights for policy 0, policy_version 1650464 (0.0010) [2023-12-26 12:46:28,392][123090] Updated weights for policy 1, policy_version 1639458 (0.0010) [2023-12-26 12:46:28,418][123091] Updated weights for policy 0, policy_version 1650474 (0.0011) [2023-12-26 12:46:28,450][123090] Updated weights for policy 1, policy_version 1639468 (0.0008) [2023-12-26 12:46:28,504][123090] Updated weights for policy 1, policy_version 1639478 (0.0010) [2023-12-26 12:46:28,565][123090] Updated weights for policy 1, policy_version 1639488 (0.0010) [2023-12-26 12:46:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 842235904. Throughput: 0: 8935.4, 1: 8754.9. Samples: 842226348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:28,785][121949] Avg episode reward: [(0, '5907.545'), (1, '5907.501')] [2023-12-26 12:46:29,124][123091] Updated weights for policy 0, policy_version 1650484 (0.0008) [2023-12-26 12:46:29,178][123091] Updated weights for policy 0, policy_version 1650494 (0.0010) [2023-12-26 12:46:29,252][123091] Updated weights for policy 0, policy_version 1650504 (0.0011) [2023-12-26 12:46:29,325][123090] Updated weights for policy 1, policy_version 1639498 (0.0007) [2023-12-26 12:46:29,383][123090] Updated weights for policy 1, policy_version 1639508 (0.0008) [2023-12-26 12:46:29,450][123090] Updated weights for policy 1, policy_version 1639518 (0.0007) [2023-12-26 12:46:29,990][123091] Updated weights for policy 0, policy_version 1650514 (0.0010) [2023-12-26 12:46:30,053][123091] Updated weights for policy 0, policy_version 1650524 (0.0005) [2023-12-26 12:46:30,118][123091] Updated weights for policy 0, policy_version 1650534 (0.0005) [2023-12-26 12:46:30,185][123091] Updated weights for policy 0, policy_version 1650544 (0.0009) [2023-12-26 12:46:30,276][123090] Updated weights for policy 1, policy_version 1639528 (0.0008) [2023-12-26 12:46:30,339][123090] Updated weights for policy 1, policy_version 1639538 (0.0008) [2023-12-26 12:46:30,400][123090] Updated weights for policy 1, policy_version 1639548 (0.0008) [2023-12-26 12:46:30,860][123091] Updated weights for policy 0, policy_version 1650554 (0.0006) [2023-12-26 12:46:30,922][123091] Updated weights for policy 0, policy_version 1650564 (0.0010) [2023-12-26 12:46:30,976][123091] Updated weights for policy 0, policy_version 1650574 (0.0010) [2023-12-26 12:46:31,125][123090] Updated weights for policy 1, policy_version 1639558 (0.0009) [2023-12-26 12:46:31,198][123090] Updated weights for policy 1, policy_version 1639568 (0.0006) [2023-12-26 12:46:31,267][123090] Updated weights for policy 1, policy_version 1639578 (0.0006) [2023-12-26 12:46:31,805][123091] Updated weights for policy 0, policy_version 1650584 (0.0010) [2023-12-26 12:46:31,863][123091] Updated weights for policy 0, policy_version 1650594 (0.0009) [2023-12-26 12:46:31,929][123091] Updated weights for policy 0, policy_version 1650604 (0.0010) [2023-12-26 12:46:31,969][123090] Updated weights for policy 1, policy_version 1639588 (0.0007) [2023-12-26 12:46:32,028][123090] Updated weights for policy 1, policy_version 1639598 (0.0009) [2023-12-26 12:46:32,090][123090] Updated weights for policy 1, policy_version 1639608 (0.0010) [2023-12-26 12:46:32,747][123091] Updated weights for policy 0, policy_version 1650614 (0.0007) [2023-12-26 12:46:32,826][123091] Updated weights for policy 0, policy_version 1650624 (0.0005) [2023-12-26 12:46:32,885][123091] Updated weights for policy 0, policy_version 1650634 (0.0005) [2023-12-26 12:46:32,930][123090] Updated weights for policy 1, policy_version 1639618 (0.0008) [2023-12-26 12:46:32,986][123090] Updated weights for policy 1, policy_version 1639628 (0.0005) [2023-12-26 12:46:33,035][123090] Updated weights for policy 1, policy_version 1639638 (0.0005) [2023-12-26 12:46:33,082][123090] Updated weights for policy 1, policy_version 1639648 (0.0005) [2023-12-26 12:46:33,583][123091] Updated weights for policy 0, policy_version 1650644 (0.0008) [2023-12-26 12:46:33,634][123091] Updated weights for policy 0, policy_version 1650655 (0.0009) [2023-12-26 12:46:33,681][123091] Updated weights for policy 0, policy_version 1650665 (0.0010) [2023-12-26 12:46:33,721][123090] Updated weights for policy 1, policy_version 1639658 (0.0006) [2023-12-26 12:46:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 842326016. Throughput: 0: 9003.3, 1: 8732.8. Samples: 842337840. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:33,785][121949] Avg episode reward: [(0, '5724.616'), (1, '6078.881')] [2023-12-26 12:46:33,788][123090] Updated weights for policy 1, policy_version 1639668 (0.0009) [2023-12-26 12:46:33,852][123090] Updated weights for policy 1, policy_version 1639678 (0.0009) [2023-12-26 12:46:34,542][123091] Updated weights for policy 0, policy_version 1650675 (0.0010) [2023-12-26 12:46:34,611][123091] Updated weights for policy 0, policy_version 1650685 (0.0008) [2023-12-26 12:46:34,658][123090] Updated weights for policy 1, policy_version 1639688 (0.0008) [2023-12-26 12:46:34,669][123091] Updated weights for policy 0, policy_version 1650695 (0.0009) [2023-12-26 12:46:34,719][123090] Updated weights for policy 1, policy_version 1639698 (0.0009) [2023-12-26 12:46:34,773][123090] Updated weights for policy 1, policy_version 1639708 (0.0010) [2023-12-26 12:46:35,468][123091] Updated weights for policy 0, policy_version 1650705 (0.0007) [2023-12-26 12:46:35,537][123091] Updated weights for policy 0, policy_version 1650715 (0.0009) [2023-12-26 12:46:35,592][123091] Updated weights for policy 0, policy_version 1650725 (0.0009) [2023-12-26 12:46:35,634][123090] Updated weights for policy 1, policy_version 1639718 (0.0009) [2023-12-26 12:46:35,646][123091] Updated weights for policy 0, policy_version 1650735 (0.0008) [2023-12-26 12:46:35,697][123090] Updated weights for policy 1, policy_version 1639728 (0.0009) [2023-12-26 12:46:35,748][123090] Updated weights for policy 1, policy_version 1639738 (0.0009) [2023-12-26 12:46:36,529][123090] Updated weights for policy 1, policy_version 1639748 (0.0009) [2023-12-26 12:46:36,565][123091] Updated weights for policy 0, policy_version 1650745 (0.0008) [2023-12-26 12:46:36,599][123090] Updated weights for policy 1, policy_version 1639758 (0.0010) [2023-12-26 12:46:36,629][123091] Updated weights for policy 0, policy_version 1650755 (0.0008) [2023-12-26 12:46:36,664][123090] Updated weights for policy 1, policy_version 1639768 (0.0009) [2023-12-26 12:46:36,698][123091] Updated weights for policy 0, policy_version 1650765 (0.0010) [2023-12-26 12:46:37,480][123090] Updated weights for policy 1, policy_version 1639778 (0.0011) [2023-12-26 12:46:37,525][123091] Updated weights for policy 0, policy_version 1650775 (0.0009) [2023-12-26 12:46:37,540][123090] Updated weights for policy 1, policy_version 1639788 (0.0006) [2023-12-26 12:46:37,590][123091] Updated weights for policy 0, policy_version 1650785 (0.0009) [2023-12-26 12:46:37,597][123090] Updated weights for policy 1, policy_version 1639798 (0.0005) [2023-12-26 12:46:37,640][123091] Updated weights for policy 0, policy_version 1650795 (0.0009) [2023-12-26 12:46:37,649][123090] Updated weights for policy 1, policy_version 1639808 (0.0005) [2023-12-26 12:46:38,439][123090] Updated weights for policy 1, policy_version 1639818 (0.0010) [2023-12-26 12:46:38,487][123091] Updated weights for policy 0, policy_version 1650805 (0.0009) [2023-12-26 12:46:38,498][123090] Updated weights for policy 1, policy_version 1639828 (0.0008) [2023-12-26 12:46:38,550][123090] Updated weights for policy 1, policy_version 1639838 (0.0006) [2023-12-26 12:46:38,554][123091] Updated weights for policy 0, policy_version 1650815 (0.0009) [2023-12-26 12:46:38,620][123091] Updated weights for policy 0, policy_version 1650825 (0.0009) [2023-12-26 12:46:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 842416128. Throughput: 0: 8981.9, 1: 8718.6. Samples: 842389088. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:38,785][121949] Avg episode reward: [(0, '5529.123'), (1, '5960.072')] [2023-12-26 12:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001650832_422617088.pth... [2023-12-26 12:46:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001639840_419799040.pth... [2023-12-26 12:46:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001649776_422346752.pth [2023-12-26 12:46:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001638816_419536896.pth [2023-12-26 12:46:39,420][123090] Updated weights for policy 1, policy_version 1639848 (0.0009) [2023-12-26 12:46:39,452][123091] Updated weights for policy 0, policy_version 1650835 (0.0009) [2023-12-26 12:46:39,487][123090] Updated weights for policy 1, policy_version 1639858 (0.0010) [2023-12-26 12:46:39,516][123091] Updated weights for policy 0, policy_version 1650845 (0.0009) [2023-12-26 12:46:39,545][123090] Updated weights for policy 1, policy_version 1639868 (0.0008) [2023-12-26 12:46:39,581][123091] Updated weights for policy 0, policy_version 1650855 (0.0009) [2023-12-26 12:46:40,385][123090] Updated weights for policy 1, policy_version 1639878 (0.0007) [2023-12-26 12:46:40,457][123090] Updated weights for policy 1, policy_version 1639888 (0.0006) [2023-12-26 12:46:40,457][123091] Updated weights for policy 0, policy_version 1650865 (0.0009) [2023-12-26 12:46:40,510][123091] Updated weights for policy 0, policy_version 1650875 (0.0009) [2023-12-26 12:46:40,520][123090] Updated weights for policy 1, policy_version 1639898 (0.0010) [2023-12-26 12:46:40,575][123091] Updated weights for policy 0, policy_version 1650885 (0.0007) [2023-12-26 12:46:40,640][123091] Updated weights for policy 0, policy_version 1650895 (0.0009) [2023-12-26 12:46:41,283][123090] Updated weights for policy 1, policy_version 1639908 (0.0010) [2023-12-26 12:46:41,357][123090] Updated weights for policy 1, policy_version 1639918 (0.0009) [2023-12-26 12:46:41,423][123090] Updated weights for policy 1, policy_version 1639928 (0.0008) [2023-12-26 12:46:41,515][123091] Updated weights for policy 0, policy_version 1650905 (0.0006) [2023-12-26 12:46:41,587][123091] Updated weights for policy 0, policy_version 1650915 (0.0006) [2023-12-26 12:46:41,652][123091] Updated weights for policy 0, policy_version 1650925 (0.0007) [2023-12-26 12:46:42,242][123090] Updated weights for policy 1, policy_version 1639938 (0.0007) [2023-12-26 12:46:42,313][123090] Updated weights for policy 1, policy_version 1639948 (0.0009) [2023-12-26 12:46:42,387][123090] Updated weights for policy 1, policy_version 1639958 (0.0010) [2023-12-26 12:46:42,445][123091] Updated weights for policy 0, policy_version 1650935 (0.0008) [2023-12-26 12:46:42,455][123090] Updated weights for policy 1, policy_version 1639968 (0.0008) [2023-12-26 12:46:42,509][123091] Updated weights for policy 0, policy_version 1650945 (0.0009) [2023-12-26 12:46:42,570][123091] Updated weights for policy 0, policy_version 1650955 (0.0009) [2023-12-26 12:46:43,266][123090] Updated weights for policy 1, policy_version 1639978 (0.0010) [2023-12-26 12:46:43,317][123090] Updated weights for policy 1, policy_version 1639988 (0.0010) [2023-12-26 12:46:43,369][123090] Updated weights for policy 1, policy_version 1639998 (0.0010) [2023-12-26 12:46:43,407][123091] Updated weights for policy 0, policy_version 1650965 (0.0010) [2023-12-26 12:46:43,465][123091] Updated weights for policy 0, policy_version 1650975 (0.0010) [2023-12-26 12:46:43,512][123091] Updated weights for policy 0, policy_version 1650985 (0.0010) [2023-12-26 12:46:43,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 842498048. Throughput: 0: 8870.3, 1: 8728.6. Samples: 842490300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:43,785][121949] Avg episode reward: [(0, '5813.915'), (1, '5932.274')] [2023-12-26 12:46:44,126][123090] Updated weights for policy 1, policy_version 1640008 (0.0007) [2023-12-26 12:46:44,191][123090] Updated weights for policy 1, policy_version 1640018 (0.0008) [2023-12-26 12:46:44,238][123091] Updated weights for policy 0, policy_version 1650995 (0.0010) [2023-12-26 12:46:44,251][123090] Updated weights for policy 1, policy_version 1640028 (0.0010) [2023-12-26 12:46:44,304][123091] Updated weights for policy 0, policy_version 1651005 (0.0010) [2023-12-26 12:46:44,372][123091] Updated weights for policy 0, policy_version 1651015 (0.0010) [2023-12-26 12:46:45,087][123090] Updated weights for policy 1, policy_version 1640038 (0.0010) [2023-12-26 12:46:45,153][123090] Updated weights for policy 1, policy_version 1640048 (0.0010) [2023-12-26 12:46:45,156][123091] Updated weights for policy 0, policy_version 1651025 (0.0010) [2023-12-26 12:46:45,218][123090] Updated weights for policy 1, policy_version 1640058 (0.0008) [2023-12-26 12:46:45,223][123091] Updated weights for policy 0, policy_version 1651035 (0.0011) [2023-12-26 12:46:45,279][123091] Updated weights for policy 0, policy_version 1651045 (0.0006) [2023-12-26 12:46:45,351][123091] Updated weights for policy 0, policy_version 1651055 (0.0007) [2023-12-26 12:46:45,919][123090] Updated weights for policy 1, policy_version 1640068 (0.0006) [2023-12-26 12:46:45,970][123090] Updated weights for policy 1, policy_version 1640078 (0.0008) [2023-12-26 12:46:46,000][123091] Updated weights for policy 0, policy_version 1651065 (0.0010) [2023-12-26 12:46:46,023][123090] Updated weights for policy 1, policy_version 1640088 (0.0009) [2023-12-26 12:46:46,058][123091] Updated weights for policy 0, policy_version 1651075 (0.0010) [2023-12-26 12:46:46,113][123091] Updated weights for policy 0, policy_version 1651085 (0.0010) [2023-12-26 12:46:46,849][123091] Updated weights for policy 0, policy_version 1651095 (0.0010) [2023-12-26 12:46:46,890][123090] Updated weights for policy 1, policy_version 1640098 (0.0007) [2023-12-26 12:46:46,905][123091] Updated weights for policy 0, policy_version 1651105 (0.0010) [2023-12-26 12:46:46,945][123090] Updated weights for policy 1, policy_version 1640108 (0.0006) [2023-12-26 12:46:46,960][123091] Updated weights for policy 0, policy_version 1651115 (0.0010) [2023-12-26 12:46:47,003][123090] Updated weights for policy 1, policy_version 1640118 (0.0005) [2023-12-26 12:46:47,067][123090] Updated weights for policy 1, policy_version 1640128 (0.0005) [2023-12-26 12:46:47,720][123090] Updated weights for policy 1, policy_version 1640138 (0.0005) [2023-12-26 12:46:47,749][123091] Updated weights for policy 0, policy_version 1651125 (0.0010) [2023-12-26 12:46:47,782][123090] Updated weights for policy 1, policy_version 1640148 (0.0005) [2023-12-26 12:46:47,802][123091] Updated weights for policy 0, policy_version 1651135 (0.0007) [2023-12-26 12:46:47,831][123090] Updated weights for policy 1, policy_version 1640158 (0.0005) [2023-12-26 12:46:47,857][123091] Updated weights for policy 0, policy_version 1651145 (0.0005) [2023-12-26 12:46:48,552][123090] Updated weights for policy 1, policy_version 1640168 (0.0010) [2023-12-26 12:46:48,604][123091] Updated weights for policy 0, policy_version 1651155 (0.0005) [2023-12-26 12:46:48,606][123090] Updated weights for policy 1, policy_version 1640178 (0.0010) [2023-12-26 12:46:48,654][123090] Updated weights for policy 1, policy_version 1640188 (0.0010) [2023-12-26 12:46:48,657][123091] Updated weights for policy 0, policy_version 1651165 (0.0006) [2023-12-26 12:46:48,711][123091] Updated weights for policy 0, policy_version 1651175 (0.0008) [2023-12-26 12:46:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 842596352. Throughput: 0: 8996.2, 1: 8811.1. Samples: 842602024. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:48,785][121949] Avg episode reward: [(0, '5981.667'), (1, '5814.771')] [2023-12-26 12:46:49,457][123090] Updated weights for policy 1, policy_version 1640198 (0.0010) [2023-12-26 12:46:49,517][123091] Updated weights for policy 0, policy_version 1651185 (0.0008) [2023-12-26 12:46:49,526][123090] Updated weights for policy 1, policy_version 1640208 (0.0010) [2023-12-26 12:46:49,572][123091] Updated weights for policy 0, policy_version 1651195 (0.0005) [2023-12-26 12:46:49,594][123090] Updated weights for policy 1, policy_version 1640218 (0.0010) [2023-12-26 12:46:49,632][123091] Updated weights for policy 0, policy_version 1651205 (0.0006) [2023-12-26 12:46:49,694][123091] Updated weights for policy 0, policy_version 1651215 (0.0008) [2023-12-26 12:46:50,381][123090] Updated weights for policy 1, policy_version 1640228 (0.0009) [2023-12-26 12:46:50,445][123090] Updated weights for policy 1, policy_version 1640238 (0.0009) [2023-12-26 12:46:50,476][123091] Updated weights for policy 0, policy_version 1651225 (0.0005) [2023-12-26 12:46:50,512][123090] Updated weights for policy 1, policy_version 1640248 (0.0008) [2023-12-26 12:46:50,537][123091] Updated weights for policy 0, policy_version 1651235 (0.0006) [2023-12-26 12:46:50,600][123091] Updated weights for policy 0, policy_version 1651245 (0.0008) [2023-12-26 12:46:51,298][123091] Updated weights for policy 0, policy_version 1651255 (0.0006) [2023-12-26 12:46:51,358][123091] Updated weights for policy 0, policy_version 1651265 (0.0006) [2023-12-26 12:46:51,374][123090] Updated weights for policy 1, policy_version 1640258 (0.0009) [2023-12-26 12:46:51,434][123091] Updated weights for policy 0, policy_version 1651275 (0.0010) [2023-12-26 12:46:51,450][123090] Updated weights for policy 1, policy_version 1640268 (0.0009) [2023-12-26 12:46:51,513][123090] Updated weights for policy 1, policy_version 1640278 (0.0009) [2023-12-26 12:46:51,578][123090] Updated weights for policy 1, policy_version 1640288 (0.0009) [2023-12-26 12:46:52,239][123091] Updated weights for policy 0, policy_version 1651285 (0.0008) [2023-12-26 12:46:52,307][123091] Updated weights for policy 0, policy_version 1651295 (0.0009) [2023-12-26 12:46:52,379][123091] Updated weights for policy 0, policy_version 1651305 (0.0010) [2023-12-26 12:46:52,403][123090] Updated weights for policy 1, policy_version 1640298 (0.0008) [2023-12-26 12:46:52,478][123090] Updated weights for policy 1, policy_version 1640308 (0.0008) [2023-12-26 12:46:52,537][123090] Updated weights for policy 1, policy_version 1640318 (0.0009) [2023-12-26 12:46:53,047][123091] Updated weights for policy 0, policy_version 1651315 (0.0006) [2023-12-26 12:46:53,100][123091] Updated weights for policy 0, policy_version 1651325 (0.0008) [2023-12-26 12:46:53,149][123091] Updated weights for policy 0, policy_version 1651335 (0.0008) [2023-12-26 12:46:53,362][123090] Updated weights for policy 1, policy_version 1640328 (0.0006) [2023-12-26 12:46:53,413][123090] Updated weights for policy 1, policy_version 1640338 (0.0006) [2023-12-26 12:46:53,476][123090] Updated weights for policy 1, policy_version 1640348 (0.0010) [2023-12-26 12:46:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 842678272. Throughput: 0: 9009.5, 1: 8810.4. Samples: 842654164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:53,785][121949] Avg episode reward: [(0, '6096.332'), (1, '5663.913')] [2023-12-26 12:46:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001651344_422748160.pth... [2023-12-26 12:46:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001640352_419930112.pth... [2023-12-26 12:46:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001650288_422477824.pth [2023-12-26 12:46:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001639328_419667968.pth [2023-12-26 12:46:53,875][123091] Updated weights for policy 0, policy_version 1651345 (0.0007) [2023-12-26 12:46:53,930][123091] Updated weights for policy 0, policy_version 1651355 (0.0010) [2023-12-26 12:46:53,981][123091] Updated weights for policy 0, policy_version 1651365 (0.0009) [2023-12-26 12:46:54,036][123091] Updated weights for policy 0, policy_version 1651375 (0.0010) [2023-12-26 12:46:54,307][123090] Updated weights for policy 1, policy_version 1640358 (0.0010) [2023-12-26 12:46:54,371][123090] Updated weights for policy 1, policy_version 1640368 (0.0010) [2023-12-26 12:46:54,421][123090] Updated weights for policy 1, policy_version 1640378 (0.0009) [2023-12-26 12:46:54,899][123091] Updated weights for policy 0, policy_version 1651385 (0.0010) [2023-12-26 12:46:54,972][123091] Updated weights for policy 0, policy_version 1651395 (0.0009) [2023-12-26 12:46:55,038][123091] Updated weights for policy 0, policy_version 1651405 (0.0009) [2023-12-26 12:46:55,128][123090] Updated weights for policy 1, policy_version 1640388 (0.0009) [2023-12-26 12:46:55,174][123090] Updated weights for policy 1, policy_version 1640398 (0.0009) [2023-12-26 12:46:55,232][123090] Updated weights for policy 1, policy_version 1640408 (0.0010) [2023-12-26 12:46:55,682][123091] Updated weights for policy 0, policy_version 1651415 (0.0009) [2023-12-26 12:46:55,736][123091] Updated weights for policy 0, policy_version 1651425 (0.0010) [2023-12-26 12:46:55,801][123091] Updated weights for policy 0, policy_version 1651435 (0.0010) [2023-12-26 12:46:56,088][123090] Updated weights for policy 1, policy_version 1640418 (0.0009) [2023-12-26 12:46:56,148][123090] Updated weights for policy 1, policy_version 1640428 (0.0005) [2023-12-26 12:46:56,204][123090] Updated weights for policy 1, policy_version 1640438 (0.0006) [2023-12-26 12:46:56,261][123090] Updated weights for policy 1, policy_version 1640448 (0.0006) [2023-12-26 12:46:56,519][123091] Updated weights for policy 0, policy_version 1651445 (0.0009) [2023-12-26 12:46:56,565][123091] Updated weights for policy 0, policy_version 1651455 (0.0005) [2023-12-26 12:46:56,624][123091] Updated weights for policy 0, policy_version 1651465 (0.0005) [2023-12-26 12:46:56,928][123090] Updated weights for policy 1, policy_version 1640458 (0.0005) [2023-12-26 12:46:56,977][123090] Updated weights for policy 1, policy_version 1640468 (0.0006) [2023-12-26 12:46:57,041][123090] Updated weights for policy 1, policy_version 1640478 (0.0006) [2023-12-26 12:46:57,291][123091] Updated weights for policy 0, policy_version 1651475 (0.0007) [2023-12-26 12:46:57,354][123091] Updated weights for policy 0, policy_version 1651485 (0.0011) [2023-12-26 12:46:57,412][123091] Updated weights for policy 0, policy_version 1651495 (0.0010) [2023-12-26 12:46:57,711][123090] Updated weights for policy 1, policy_version 1640488 (0.0009) [2023-12-26 12:46:57,765][123090] Updated weights for policy 1, policy_version 1640498 (0.0010) [2023-12-26 12:46:57,815][123090] Updated weights for policy 1, policy_version 1640508 (0.0010) [2023-12-26 12:46:58,072][123091] Updated weights for policy 0, policy_version 1651505 (0.0010) [2023-12-26 12:46:58,138][123091] Updated weights for policy 0, policy_version 1651515 (0.0010) [2023-12-26 12:46:58,208][123091] Updated weights for policy 0, policy_version 1651525 (0.0011) [2023-12-26 12:46:58,277][123091] Updated weights for policy 0, policy_version 1651535 (0.0009) [2023-12-26 12:46:58,667][123090] Updated weights for policy 1, policy_version 1640518 (0.0010) [2023-12-26 12:46:58,740][123090] Updated weights for policy 1, policy_version 1640528 (0.0010) [2023-12-26 12:46:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 842768384. Throughput: 0: 9096.3, 1: 8839.7. Samples: 842765512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:46:58,785][121949] Avg episode reward: [(0, '6148.110'), (1, '5765.756')] [2023-12-26 12:46:58,814][123090] Updated weights for policy 1, policy_version 1640538 (0.0009) [2023-12-26 12:46:59,131][123091] Updated weights for policy 0, policy_version 1651545 (0.0006) [2023-12-26 12:46:59,188][123091] Updated weights for policy 0, policy_version 1651555 (0.0006) [2023-12-26 12:46:59,263][123091] Updated weights for policy 0, policy_version 1651565 (0.0008) [2023-12-26 12:46:59,631][123090] Updated weights for policy 1, policy_version 1640548 (0.0007) [2023-12-26 12:46:59,684][123090] Updated weights for policy 1, policy_version 1640558 (0.0005) [2023-12-26 12:46:59,738][123090] Updated weights for policy 1, policy_version 1640568 (0.0005) [2023-12-26 12:47:00,066][123091] Updated weights for policy 0, policy_version 1651575 (0.0010) [2023-12-26 12:47:00,119][123091] Updated weights for policy 0, policy_version 1651585 (0.0010) [2023-12-26 12:47:00,171][123091] Updated weights for policy 0, policy_version 1651597 (0.0010) [2023-12-26 12:47:00,453][123090] Updated weights for policy 1, policy_version 1640578 (0.0006) [2023-12-26 12:47:00,513][123090] Updated weights for policy 1, policy_version 1640588 (0.0009) [2023-12-26 12:47:00,562][123090] Updated weights for policy 1, policy_version 1640598 (0.0009) [2023-12-26 12:47:00,619][123090] Updated weights for policy 1, policy_version 1640608 (0.0010) [2023-12-26 12:47:01,060][123091] Updated weights for policy 0, policy_version 1651607 (0.0008) [2023-12-26 12:47:01,127][123091] Updated weights for policy 0, policy_version 1651617 (0.0008) [2023-12-26 12:47:01,193][123091] Updated weights for policy 0, policy_version 1651627 (0.0008) [2023-12-26 12:47:01,482][123090] Updated weights for policy 1, policy_version 1640618 (0.0010) [2023-12-26 12:47:01,547][123090] Updated weights for policy 1, policy_version 1640628 (0.0007) [2023-12-26 12:47:01,626][123090] Updated weights for policy 1, policy_version 1640638 (0.0011) [2023-12-26 12:47:01,999][123091] Updated weights for policy 0, policy_version 1651637 (0.0008) [2023-12-26 12:47:02,052][123091] Updated weights for policy 0, policy_version 1651647 (0.0009) [2023-12-26 12:47:02,104][123091] Updated weights for policy 0, policy_version 1651657 (0.0010) [2023-12-26 12:47:02,408][123090] Updated weights for policy 1, policy_version 1640648 (0.0009) [2023-12-26 12:47:02,456][123090] Updated weights for policy 1, policy_version 1640658 (0.0008) [2023-12-26 12:47:02,514][123090] Updated weights for policy 1, policy_version 1640668 (0.0008) [2023-12-26 12:47:03,023][123091] Updated weights for policy 0, policy_version 1651667 (0.0010) [2023-12-26 12:47:03,075][123091] Updated weights for policy 0, policy_version 1651677 (0.0009) [2023-12-26 12:47:03,130][123091] Updated weights for policy 0, policy_version 1651687 (0.0008) [2023-12-26 12:47:03,267][123090] Updated weights for policy 1, policy_version 1640678 (0.0008) [2023-12-26 12:47:03,332][123090] Updated weights for policy 1, policy_version 1640688 (0.0008) [2023-12-26 12:47:03,406][123090] Updated weights for policy 1, policy_version 1640698 (0.0006) [2023-12-26 12:47:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 842858496. Throughput: 0: 9041.4, 1: 8802.9. Samples: 842871316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:03,785][121949] Avg episode reward: [(0, '6098.607'), (1, '5867.214')] [2023-12-26 12:47:03,813][123091] Updated weights for policy 0, policy_version 1651697 (0.0009) [2023-12-26 12:47:03,890][123091] Updated weights for policy 0, policy_version 1651707 (0.0010) [2023-12-26 12:47:03,957][123091] Updated weights for policy 0, policy_version 1651717 (0.0011) [2023-12-26 12:47:04,032][123091] Updated weights for policy 0, policy_version 1651727 (0.0011) [2023-12-26 12:47:04,209][123090] Updated weights for policy 1, policy_version 1640708 (0.0009) [2023-12-26 12:47:04,270][123090] Updated weights for policy 1, policy_version 1640718 (0.0010) [2023-12-26 12:47:04,343][123090] Updated weights for policy 1, policy_version 1640728 (0.0009) [2023-12-26 12:47:04,740][123091] Updated weights for policy 0, policy_version 1651737 (0.0010) [2023-12-26 12:47:04,788][123091] Updated weights for policy 0, policy_version 1651747 (0.0011) [2023-12-26 12:47:04,836][123091] Updated weights for policy 0, policy_version 1651757 (0.0009) [2023-12-26 12:47:05,237][123090] Updated weights for policy 1, policy_version 1640738 (0.0009) [2023-12-26 12:47:05,310][123090] Updated weights for policy 1, policy_version 1640748 (0.0010) [2023-12-26 12:47:05,367][123090] Updated weights for policy 1, policy_version 1640759 (0.0010) [2023-12-26 12:47:05,550][123091] Updated weights for policy 0, policy_version 1651767 (0.0006) [2023-12-26 12:47:05,614][123091] Updated weights for policy 0, policy_version 1651777 (0.0005) [2023-12-26 12:47:05,679][123091] Updated weights for policy 0, policy_version 1651787 (0.0005) [2023-12-26 12:47:06,235][123091] Updated weights for policy 0, policy_version 1651797 (0.0005) [2023-12-26 12:47:06,280][123090] Updated weights for policy 1, policy_version 1640769 (0.0009) [2023-12-26 12:47:06,298][123091] Updated weights for policy 0, policy_version 1651807 (0.0009) [2023-12-26 12:47:06,344][123090] Updated weights for policy 1, policy_version 1640779 (0.0009) [2023-12-26 12:47:06,360][123091] Updated weights for policy 0, policy_version 1651817 (0.0008) [2023-12-26 12:47:06,398][123090] Updated weights for policy 1, policy_version 1640789 (0.0010) [2023-12-26 12:47:06,465][123090] Updated weights for policy 1, policy_version 1640799 (0.0010) [2023-12-26 12:47:07,044][123091] Updated weights for policy 0, policy_version 1651827 (0.0006) [2023-12-26 12:47:07,112][123091] Updated weights for policy 0, policy_version 1651837 (0.0006) [2023-12-26 12:47:07,183][123091] Updated weights for policy 0, policy_version 1651847 (0.0006) [2023-12-26 12:47:07,307][123090] Updated weights for policy 1, policy_version 1640809 (0.0006) [2023-12-26 12:47:07,371][123090] Updated weights for policy 1, policy_version 1640819 (0.0008) [2023-12-26 12:47:07,442][123090] Updated weights for policy 1, policy_version 1640829 (0.0005) [2023-12-26 12:47:07,926][123091] Updated weights for policy 0, policy_version 1651857 (0.0009) [2023-12-26 12:47:07,983][123091] Updated weights for policy 0, policy_version 1651867 (0.0009) [2023-12-26 12:47:08,051][123091] Updated weights for policy 0, policy_version 1651877 (0.0008) [2023-12-26 12:47:08,123][123091] Updated weights for policy 0, policy_version 1651887 (0.0005) [2023-12-26 12:47:08,220][123090] Updated weights for policy 1, policy_version 1640839 (0.0006) [2023-12-26 12:47:08,276][123090] Updated weights for policy 1, policy_version 1640849 (0.0006) [2023-12-26 12:47:08,327][123090] Updated weights for policy 1, policy_version 1640859 (0.0009) [2023-12-26 12:47:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 842948608. Throughput: 0: 9094.8, 1: 8795.4. Samples: 842925208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:08,786][121949] Avg episode reward: [(0, '6032.203'), (1, '6076.609')] [2023-12-26 12:47:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001651888_422887424.pth... [2023-12-26 12:47:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001640864_420061184.pth... [2023-12-26 12:47:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001650832_422617088.pth [2023-12-26 12:47:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001639840_419799040.pth [2023-12-26 12:47:08,888][123091] Updated weights for policy 0, policy_version 1651897 (0.0010) [2023-12-26 12:47:08,948][123091] Updated weights for policy 0, policy_version 1651907 (0.0009) [2023-12-26 12:47:08,974][123090] Updated weights for policy 1, policy_version 1640869 (0.0008) [2023-12-26 12:47:09,003][123091] Updated weights for policy 0, policy_version 1651917 (0.0007) [2023-12-26 12:47:09,038][123090] Updated weights for policy 1, policy_version 1640879 (0.0009) [2023-12-26 12:47:09,113][123090] Updated weights for policy 1, policy_version 1640889 (0.0010) [2023-12-26 12:47:09,762][123091] Updated weights for policy 0, policy_version 1651927 (0.0006) [2023-12-26 12:47:09,837][123091] Updated weights for policy 0, policy_version 1651937 (0.0007) [2023-12-26 12:47:09,893][123091] Updated weights for policy 0, policy_version 1651947 (0.0007) [2023-12-26 12:47:09,963][123090] Updated weights for policy 1, policy_version 1640899 (0.0010) [2023-12-26 12:47:10,034][123090] Updated weights for policy 1, policy_version 1640909 (0.0008) [2023-12-26 12:47:10,102][123090] Updated weights for policy 1, policy_version 1640919 (0.0007) [2023-12-26 12:47:10,576][123091] Updated weights for policy 0, policy_version 1651957 (0.0008) [2023-12-26 12:47:10,637][123091] Updated weights for policy 0, policy_version 1651967 (0.0006) [2023-12-26 12:47:10,687][123091] Updated weights for policy 0, policy_version 1651977 (0.0005) [2023-12-26 12:47:10,861][123090] Updated weights for policy 1, policy_version 1640929 (0.0007) [2023-12-26 12:47:10,930][123090] Updated weights for policy 1, policy_version 1640939 (0.0006) [2023-12-26 12:47:10,988][123090] Updated weights for policy 1, policy_version 1640949 (0.0006) [2023-12-26 12:47:11,058][123090] Updated weights for policy 1, policy_version 1640959 (0.0008) [2023-12-26 12:47:11,478][123091] Updated weights for policy 0, policy_version 1651987 (0.0006) [2023-12-26 12:47:11,527][123091] Updated weights for policy 0, policy_version 1651997 (0.0009) [2023-12-26 12:47:11,584][123091] Updated weights for policy 0, policy_version 1652007 (0.0009) [2023-12-26 12:47:11,835][123090] Updated weights for policy 1, policy_version 1640969 (0.0010) [2023-12-26 12:47:11,898][123090] Updated weights for policy 1, policy_version 1640979 (0.0010) [2023-12-26 12:47:11,958][123090] Updated weights for policy 1, policy_version 1640989 (0.0010) [2023-12-26 12:47:12,474][123091] Updated weights for policy 0, policy_version 1652017 (0.0009) [2023-12-26 12:47:12,536][123091] Updated weights for policy 0, policy_version 1652027 (0.0009) [2023-12-26 12:47:12,597][123091] Updated weights for policy 0, policy_version 1652037 (0.0008) [2023-12-26 12:47:12,662][123091] Updated weights for policy 0, policy_version 1652047 (0.0008) [2023-12-26 12:47:12,803][123090] Updated weights for policy 1, policy_version 1640999 (0.0011) [2023-12-26 12:47:12,883][123090] Updated weights for policy 1, policy_version 1641009 (0.0008) [2023-12-26 12:47:12,946][123090] Updated weights for policy 1, policy_version 1641019 (0.0011) [2023-12-26 12:47:13,411][123091] Updated weights for policy 0, policy_version 1652057 (0.0010) [2023-12-26 12:47:13,458][123091] Updated weights for policy 0, policy_version 1652067 (0.0010) [2023-12-26 12:47:13,502][123091] Updated weights for policy 0, policy_version 1652077 (0.0010) [2023-12-26 12:47:13,675][123090] Updated weights for policy 1, policy_version 1641029 (0.0008) [2023-12-26 12:47:13,741][123090] Updated weights for policy 1, policy_version 1641039 (0.0006) [2023-12-26 12:47:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 843038720. Throughput: 0: 9087.2, 1: 8852.8. Samples: 843033648. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:13,785][121949] Avg episode reward: [(0, '5824.283'), (1, '5742.224')] [2023-12-26 12:47:13,805][123090] Updated weights for policy 1, policy_version 1641049 (0.0006) [2023-12-26 12:47:14,227][123091] Updated weights for policy 0, policy_version 1652087 (0.0007) [2023-12-26 12:47:14,274][123091] Updated weights for policy 0, policy_version 1652097 (0.0005) [2023-12-26 12:47:14,320][123091] Updated weights for policy 0, policy_version 1652107 (0.0005) [2023-12-26 12:47:14,536][123090] Updated weights for policy 1, policy_version 1641059 (0.0006) [2023-12-26 12:47:14,607][123090] Updated weights for policy 1, policy_version 1641069 (0.0005) [2023-12-26 12:47:14,668][123090] Updated weights for policy 1, policy_version 1641079 (0.0005) [2023-12-26 12:47:15,097][123091] Updated weights for policy 0, policy_version 1652117 (0.0006) [2023-12-26 12:47:15,162][123091] Updated weights for policy 0, policy_version 1652127 (0.0006) [2023-12-26 12:47:15,229][123091] Updated weights for policy 0, policy_version 1652137 (0.0006) [2023-12-26 12:47:15,423][123090] Updated weights for policy 1, policy_version 1641089 (0.0006) [2023-12-26 12:47:15,484][123090] Updated weights for policy 1, policy_version 1641099 (0.0008) [2023-12-26 12:47:15,547][123090] Updated weights for policy 1, policy_version 1641109 (0.0010) [2023-12-26 12:47:15,611][123090] Updated weights for policy 1, policy_version 1641119 (0.0010) [2023-12-26 12:47:15,916][123091] Updated weights for policy 0, policy_version 1652147 (0.0006) [2023-12-26 12:47:15,964][123091] Updated weights for policy 0, policy_version 1652157 (0.0008) [2023-12-26 12:47:16,024][123091] Updated weights for policy 0, policy_version 1652167 (0.0009) [2023-12-26 12:47:16,414][123090] Updated weights for policy 1, policy_version 1641129 (0.0010) [2023-12-26 12:47:16,463][123090] Updated weights for policy 1, policy_version 1641139 (0.0010) [2023-12-26 12:47:16,526][123090] Updated weights for policy 1, policy_version 1641149 (0.0010) [2023-12-26 12:47:16,796][123091] Updated weights for policy 0, policy_version 1652177 (0.0009) [2023-12-26 12:47:16,851][123091] Updated weights for policy 0, policy_version 1652187 (0.0009) [2023-12-26 12:47:16,907][123091] Updated weights for policy 0, policy_version 1652197 (0.0010) [2023-12-26 12:47:16,960][123091] Updated weights for policy 0, policy_version 1652207 (0.0009) [2023-12-26 12:47:17,337][123090] Updated weights for policy 1, policy_version 1641159 (0.0010) [2023-12-26 12:47:17,393][123090] Updated weights for policy 1, policy_version 1641169 (0.0010) [2023-12-26 12:47:17,451][123090] Updated weights for policy 1, policy_version 1641179 (0.0010) [2023-12-26 12:47:17,747][123091] Updated weights for policy 0, policy_version 1652217 (0.0010) [2023-12-26 12:47:17,808][123091] Updated weights for policy 0, policy_version 1652227 (0.0010) [2023-12-26 12:47:17,863][123091] Updated weights for policy 0, policy_version 1652237 (0.0010) [2023-12-26 12:47:18,284][123090] Updated weights for policy 1, policy_version 1641189 (0.0010) [2023-12-26 12:47:18,341][123090] Updated weights for policy 1, policy_version 1641199 (0.0009) [2023-12-26 12:47:18,399][123090] Updated weights for policy 1, policy_version 1641209 (0.0007) [2023-12-26 12:47:18,686][123091] Updated weights for policy 0, policy_version 1652247 (0.0010) [2023-12-26 12:47:18,739][123091] Updated weights for policy 0, policy_version 1652257 (0.0006) [2023-12-26 12:47:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 843128832. Throughput: 0: 9079.6, 1: 8819.3. Samples: 843143292. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:18,785][121949] Avg episode reward: [(0, '5746.735'), (1, '5658.115')] [2023-12-26 12:47:18,794][123091] Updated weights for policy 0, policy_version 1652267 (0.0005) [2023-12-26 12:47:19,244][123090] Updated weights for policy 1, policy_version 1641219 (0.0007) [2023-12-26 12:47:19,317][123090] Updated weights for policy 1, policy_version 1641229 (0.0009) [2023-12-26 12:47:19,384][123090] Updated weights for policy 1, policy_version 1641239 (0.0009) [2023-12-26 12:47:19,529][123091] Updated weights for policy 0, policy_version 1652277 (0.0007) [2023-12-26 12:47:19,585][123091] Updated weights for policy 0, policy_version 1652287 (0.0006) [2023-12-26 12:47:19,643][123091] Updated weights for policy 0, policy_version 1652297 (0.0006) [2023-12-26 12:47:20,189][123090] Updated weights for policy 1, policy_version 1641249 (0.0008) [2023-12-26 12:47:20,253][123090] Updated weights for policy 1, policy_version 1641259 (0.0008) [2023-12-26 12:47:20,316][123090] Updated weights for policy 1, policy_version 1641269 (0.0009) [2023-12-26 12:47:20,383][123090] Updated weights for policy 1, policy_version 1641279 (0.0010) [2023-12-26 12:47:20,518][123091] Updated weights for policy 0, policy_version 1652307 (0.0007) [2023-12-26 12:47:20,573][123091] Updated weights for policy 0, policy_version 1652317 (0.0009) [2023-12-26 12:47:20,646][123091] Updated weights for policy 0, policy_version 1652327 (0.0008) [2023-12-26 12:47:21,223][123090] Updated weights for policy 1, policy_version 1641289 (0.0010) [2023-12-26 12:47:21,291][123090] Updated weights for policy 1, policy_version 1641299 (0.0011) [2023-12-26 12:47:21,359][123090] Updated weights for policy 1, policy_version 1641309 (0.0011) [2023-12-26 12:47:21,490][123091] Updated weights for policy 0, policy_version 1652337 (0.0008) [2023-12-26 12:47:21,542][123091] Updated weights for policy 0, policy_version 1652347 (0.0005) [2023-12-26 12:47:21,612][123091] Updated weights for policy 0, policy_version 1652357 (0.0006) [2023-12-26 12:47:21,675][123091] Updated weights for policy 0, policy_version 1652367 (0.0007) [2023-12-26 12:47:22,185][123090] Updated weights for policy 1, policy_version 1641319 (0.0010) [2023-12-26 12:47:22,245][123090] Updated weights for policy 1, policy_version 1641329 (0.0009) [2023-12-26 12:47:22,315][123090] Updated weights for policy 1, policy_version 1641339 (0.0009) [2023-12-26 12:47:22,492][123091] Updated weights for policy 0, policy_version 1652377 (0.0006) [2023-12-26 12:47:22,556][123091] Updated weights for policy 0, policy_version 1652387 (0.0006) [2023-12-26 12:47:22,623][123091] Updated weights for policy 0, policy_version 1652397 (0.0009) [2023-12-26 12:47:23,152][123090] Updated weights for policy 1, policy_version 1641349 (0.0010) [2023-12-26 12:47:23,206][123090] Updated weights for policy 1, policy_version 1641359 (0.0007) [2023-12-26 12:47:23,275][123090] Updated weights for policy 1, policy_version 1641369 (0.0006) [2023-12-26 12:47:23,461][123091] Updated weights for policy 0, policy_version 1652407 (0.0009) [2023-12-26 12:47:23,527][123091] Updated weights for policy 0, policy_version 1652417 (0.0010) [2023-12-26 12:47:23,589][123091] Updated weights for policy 0, policy_version 1652427 (0.0010) [2023-12-26 12:47:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 843218944. Throughput: 0: 9107.2, 1: 8801.8. Samples: 843194992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:23,785][121949] Avg episode reward: [(0, '5744.786'), (1, '5788.830')] [2023-12-26 12:47:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001652432_423026688.pth... [2023-12-26 12:47:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001641376_420192256.pth... [2023-12-26 12:47:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001651344_422748160.pth [2023-12-26 12:47:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001640352_419930112.pth [2023-12-26 12:47:23,937][123090] Updated weights for policy 1, policy_version 1641379 (0.0006) [2023-12-26 12:47:24,004][123090] Updated weights for policy 1, policy_version 1641389 (0.0005) [2023-12-26 12:47:24,073][123090] Updated weights for policy 1, policy_version 1641399 (0.0005) [2023-12-26 12:47:24,499][123091] Updated weights for policy 0, policy_version 1652437 (0.0010) [2023-12-26 12:47:24,555][123091] Updated weights for policy 0, policy_version 1652447 (0.0009) [2023-12-26 12:47:24,620][123091] Updated weights for policy 0, policy_version 1652457 (0.0010) [2023-12-26 12:47:24,778][123090] Updated weights for policy 1, policy_version 1641409 (0.0005) [2023-12-26 12:47:24,845][123090] Updated weights for policy 1, policy_version 1641419 (0.0010) [2023-12-26 12:47:24,906][123090] Updated weights for policy 1, policy_version 1641429 (0.0011) [2023-12-26 12:47:24,975][123090] Updated weights for policy 1, policy_version 1641439 (0.0011) [2023-12-26 12:47:25,415][123091] Updated weights for policy 0, policy_version 1652467 (0.0010) [2023-12-26 12:47:25,470][123091] Updated weights for policy 0, policy_version 1652477 (0.0010) [2023-12-26 12:47:25,529][123091] Updated weights for policy 0, policy_version 1652487 (0.0009) [2023-12-26 12:47:25,681][123090] Updated weights for policy 1, policy_version 1641449 (0.0006) [2023-12-26 12:47:25,731][123090] Updated weights for policy 1, policy_version 1641459 (0.0005) [2023-12-26 12:47:25,796][123090] Updated weights for policy 1, policy_version 1641469 (0.0010) [2023-12-26 12:47:26,338][123091] Updated weights for policy 0, policy_version 1652497 (0.0007) [2023-12-26 12:47:26,390][123091] Updated weights for policy 0, policy_version 1652507 (0.0009) [2023-12-26 12:47:26,452][123091] Updated weights for policy 0, policy_version 1652517 (0.0008) [2023-12-26 12:47:26,511][123091] Updated weights for policy 0, policy_version 1652527 (0.0009) [2023-12-26 12:47:26,555][123090] Updated weights for policy 1, policy_version 1641479 (0.0011) [2023-12-26 12:47:26,622][123090] Updated weights for policy 1, policy_version 1641489 (0.0011) [2023-12-26 12:47:26,692][123090] Updated weights for policy 1, policy_version 1641499 (0.0009) [2023-12-26 12:47:27,308][123091] Updated weights for policy 0, policy_version 1652537 (0.0009) [2023-12-26 12:47:27,366][123091] Updated weights for policy 0, policy_version 1652547 (0.0008) [2023-12-26 12:47:27,422][123091] Updated weights for policy 0, policy_version 1652557 (0.0005) [2023-12-26 12:47:27,466][123090] Updated weights for policy 1, policy_version 1641509 (0.0007) [2023-12-26 12:47:27,524][123090] Updated weights for policy 1, policy_version 1641519 (0.0006) [2023-12-26 12:47:27,575][123090] Updated weights for policy 1, policy_version 1641529 (0.0008) [2023-12-26 12:47:28,226][123091] Updated weights for policy 0, policy_version 1652567 (0.0009) [2023-12-26 12:47:28,276][123091] Updated weights for policy 0, policy_version 1652577 (0.0010) [2023-12-26 12:47:28,327][123091] Updated weights for policy 0, policy_version 1652587 (0.0010) [2023-12-26 12:47:28,351][123090] Updated weights for policy 1, policy_version 1641539 (0.0010) [2023-12-26 12:47:28,410][123090] Updated weights for policy 1, policy_version 1641549 (0.0009) [2023-12-26 12:47:28,481][123090] Updated weights for policy 1, policy_version 1641559 (0.0008) [2023-12-26 12:47:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 843309056. Throughput: 0: 9135.5, 1: 8890.6. Samples: 843301472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:28,785][121949] Avg episode reward: [(0, '5779.409'), (1, '5924.151')] [2023-12-26 12:47:29,120][123091] Updated weights for policy 0, policy_version 1652597 (0.0010) [2023-12-26 12:47:29,164][123091] Updated weights for policy 0, policy_version 1652607 (0.0010) [2023-12-26 12:47:29,224][123091] Updated weights for policy 0, policy_version 1652617 (0.0010) [2023-12-26 12:47:29,237][123090] Updated weights for policy 1, policy_version 1641569 (0.0007) [2023-12-26 12:47:29,329][123090] Updated weights for policy 1, policy_version 1641579 (0.0006) [2023-12-26 12:47:29,391][123090] Updated weights for policy 1, policy_version 1641589 (0.0007) [2023-12-26 12:47:29,456][123090] Updated weights for policy 1, policy_version 1641599 (0.0006) [2023-12-26 12:47:30,094][123091] Updated weights for policy 0, policy_version 1652627 (0.0009) [2023-12-26 12:47:30,149][123090] Updated weights for policy 1, policy_version 1641609 (0.0007) [2023-12-26 12:47:30,159][123091] Updated weights for policy 0, policy_version 1652637 (0.0010) [2023-12-26 12:47:30,213][123091] Updated weights for policy 0, policy_version 1652647 (0.0009) [2023-12-26 12:47:30,215][123090] Updated weights for policy 1, policy_version 1641619 (0.0007) [2023-12-26 12:47:30,275][123090] Updated weights for policy 1, policy_version 1641629 (0.0008) [2023-12-26 12:47:30,956][123091] Updated weights for policy 0, policy_version 1652657 (0.0009) [2023-12-26 12:47:31,005][123091] Updated weights for policy 0, policy_version 1652668 (0.0009) [2023-12-26 12:47:31,072][123090] Updated weights for policy 1, policy_version 1641639 (0.0009) [2023-12-26 12:47:31,073][123091] Updated weights for policy 0, policy_version 1652678 (0.0008) [2023-12-26 12:47:31,137][123090] Updated weights for policy 1, policy_version 1641649 (0.0007) [2023-12-26 12:47:31,138][123091] Updated weights for policy 0, policy_version 1652688 (0.0008) [2023-12-26 12:47:31,200][123090] Updated weights for policy 1, policy_version 1641659 (0.0006) [2023-12-26 12:47:31,908][123090] Updated weights for policy 1, policy_version 1641669 (0.0007) [2023-12-26 12:47:31,965][123091] Updated weights for policy 0, policy_version 1652698 (0.0008) [2023-12-26 12:47:31,970][123090] Updated weights for policy 1, policy_version 1641679 (0.0008) [2023-12-26 12:47:32,031][123091] Updated weights for policy 0, policy_version 1652708 (0.0009) [2023-12-26 12:47:32,038][123090] Updated weights for policy 1, policy_version 1641689 (0.0008) [2023-12-26 12:47:32,092][123091] Updated weights for policy 0, policy_version 1652718 (0.0009) [2023-12-26 12:47:32,767][123090] Updated weights for policy 1, policy_version 1641699 (0.0007) [2023-12-26 12:47:32,819][123090] Updated weights for policy 1, policy_version 1641709 (0.0005) [2023-12-26 12:47:32,886][123090] Updated weights for policy 1, policy_version 1641719 (0.0007) [2023-12-26 12:47:32,896][123091] Updated weights for policy 0, policy_version 1652728 (0.0007) [2023-12-26 12:47:32,952][123091] Updated weights for policy 0, policy_version 1652738 (0.0007) [2023-12-26 12:47:33,007][123091] Updated weights for policy 0, policy_version 1652748 (0.0005) [2023-12-26 12:47:33,643][123090] Updated weights for policy 1, policy_version 1641729 (0.0008) [2023-12-26 12:47:33,677][123091] Updated weights for policy 0, policy_version 1652758 (0.0008) [2023-12-26 12:47:33,697][123090] Updated weights for policy 1, policy_version 1641739 (0.0010) [2023-12-26 12:47:33,724][123091] Updated weights for policy 0, policy_version 1652768 (0.0010) [2023-12-26 12:47:33,744][123090] Updated weights for policy 1, policy_version 1641749 (0.0010) [2023-12-26 12:47:33,772][123091] Updated weights for policy 0, policy_version 1652778 (0.0007) [2023-12-26 12:47:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 843390976. Throughput: 0: 9095.6, 1: 8889.4. Samples: 843411348. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:33,785][121949] Avg episode reward: [(0, '5911.272'), (1, '5923.577')] [2023-12-26 12:47:33,798][123090] Updated weights for policy 1, policy_version 1641759 (0.0010) [2023-12-26 12:47:34,584][123091] Updated weights for policy 0, policy_version 1652788 (0.0008) [2023-12-26 12:47:34,629][123090] Updated weights for policy 1, policy_version 1641769 (0.0010) [2023-12-26 12:47:34,642][123091] Updated weights for policy 0, policy_version 1652798 (0.0007) [2023-12-26 12:47:34,683][123090] Updated weights for policy 1, policy_version 1641779 (0.0008) [2023-12-26 12:47:34,702][123091] Updated weights for policy 0, policy_version 1652808 (0.0006) [2023-12-26 12:47:34,744][123090] Updated weights for policy 1, policy_version 1641789 (0.0007) [2023-12-26 12:47:35,355][123091] Updated weights for policy 0, policy_version 1652818 (0.0006) [2023-12-26 12:47:35,411][123091] Updated weights for policy 0, policy_version 1652828 (0.0010) [2023-12-26 12:47:35,462][123091] Updated weights for policy 0, policy_version 1652838 (0.0010) [2023-12-26 12:47:35,512][123091] Updated weights for policy 0, policy_version 1652848 (0.0009) [2023-12-26 12:47:35,574][123090] Updated weights for policy 1, policy_version 1641799 (0.0009) [2023-12-26 12:47:35,627][123090] Updated weights for policy 1, policy_version 1641809 (0.0009) [2023-12-26 12:47:35,675][123090] Updated weights for policy 1, policy_version 1641819 (0.0009) [2023-12-26 12:47:36,384][123091] Updated weights for policy 0, policy_version 1652858 (0.0010) [2023-12-26 12:47:36,449][123091] Updated weights for policy 0, policy_version 1652868 (0.0010) [2023-12-26 12:47:36,511][123091] Updated weights for policy 0, policy_version 1652878 (0.0010) [2023-12-26 12:47:36,514][123090] Updated weights for policy 1, policy_version 1641829 (0.0007) [2023-12-26 12:47:36,585][123090] Updated weights for policy 1, policy_version 1641839 (0.0009) [2023-12-26 12:47:36,649][123090] Updated weights for policy 1, policy_version 1641849 (0.0010) [2023-12-26 12:47:37,403][123091] Updated weights for policy 0, policy_version 1652888 (0.0009) [2023-12-26 12:47:37,431][123090] Updated weights for policy 1, policy_version 1641859 (0.0011) [2023-12-26 12:47:37,451][123091] Updated weights for policy 0, policy_version 1652898 (0.0008) [2023-12-26 12:47:37,494][123090] Updated weights for policy 1, policy_version 1641869 (0.0010) [2023-12-26 12:47:37,512][123091] Updated weights for policy 0, policy_version 1652908 (0.0009) [2023-12-26 12:47:37,566][123090] Updated weights for policy 1, policy_version 1641879 (0.0008) [2023-12-26 12:47:38,257][123090] Updated weights for policy 1, policy_version 1641889 (0.0009) [2023-12-26 12:47:38,328][123090] Updated weights for policy 1, policy_version 1641899 (0.0008) [2023-12-26 12:47:38,398][123090] Updated weights for policy 1, policy_version 1641909 (0.0010) [2023-12-26 12:47:38,406][123091] Updated weights for policy 0, policy_version 1652918 (0.0010) [2023-12-26 12:47:38,467][123090] Updated weights for policy 1, policy_version 1641919 (0.0006) [2023-12-26 12:47:38,471][123091] Updated weights for policy 0, policy_version 1652928 (0.0011) [2023-12-26 12:47:38,536][123091] Updated weights for policy 0, policy_version 1652939 (0.0011) [2023-12-26 12:47:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 843489280. Throughput: 0: 9083.1, 1: 8914.8. Samples: 843464064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:38,784][121949] Avg episode reward: [(0, '6099.245'), (1, '5749.600')] [2023-12-26 12:47:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001652944_423157760.pth... [2023-12-26 12:47:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001641920_420331520.pth... [2023-12-26 12:47:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001651888_422887424.pth [2023-12-26 12:47:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001640864_420061184.pth [2023-12-26 12:47:39,151][123090] Updated weights for policy 1, policy_version 1641929 (0.0010) [2023-12-26 12:47:39,218][123090] Updated weights for policy 1, policy_version 1641939 (0.0007) [2023-12-26 12:47:39,282][123090] Updated weights for policy 1, policy_version 1641949 (0.0010) [2023-12-26 12:47:39,379][123091] Updated weights for policy 0, policy_version 1652949 (0.0009) [2023-12-26 12:47:39,447][123091] Updated weights for policy 0, policy_version 1652959 (0.0010) [2023-12-26 12:47:39,507][123091] Updated weights for policy 0, policy_version 1652969 (0.0009) [2023-12-26 12:47:40,000][123090] Updated weights for policy 1, policy_version 1641959 (0.0007) [2023-12-26 12:47:40,069][123090] Updated weights for policy 1, policy_version 1641969 (0.0010) [2023-12-26 12:47:40,130][123090] Updated weights for policy 1, policy_version 1641979 (0.0011) [2023-12-26 12:47:40,345][123091] Updated weights for policy 0, policy_version 1652979 (0.0006) [2023-12-26 12:47:40,410][123091] Updated weights for policy 0, policy_version 1652989 (0.0009) [2023-12-26 12:47:40,484][123091] Updated weights for policy 0, policy_version 1652999 (0.0009) [2023-12-26 12:47:40,913][123090] Updated weights for policy 1, policy_version 1641989 (0.0008) [2023-12-26 12:47:40,965][123090] Updated weights for policy 1, policy_version 1641999 (0.0005) [2023-12-26 12:47:41,016][123090] Updated weights for policy 1, policy_version 1642009 (0.0006) [2023-12-26 12:47:41,356][123091] Updated weights for policy 0, policy_version 1653009 (0.0009) [2023-12-26 12:47:41,426][123091] Updated weights for policy 0, policy_version 1653019 (0.0007) [2023-12-26 12:47:41,483][123091] Updated weights for policy 0, policy_version 1653030 (0.0008) [2023-12-26 12:47:41,534][123091] Updated weights for policy 0, policy_version 1653040 (0.0010) [2023-12-26 12:47:41,821][123090] Updated weights for policy 1, policy_version 1642019 (0.0009) [2023-12-26 12:47:41,881][123090] Updated weights for policy 1, policy_version 1642029 (0.0009) [2023-12-26 12:47:41,934][123090] Updated weights for policy 1, policy_version 1642039 (0.0007) [2023-12-26 12:47:42,383][123091] Updated weights for policy 0, policy_version 1653050 (0.0009) [2023-12-26 12:47:42,443][123091] Updated weights for policy 0, policy_version 1653060 (0.0009) [2023-12-26 12:47:42,503][123091] Updated weights for policy 0, policy_version 1653070 (0.0009) [2023-12-26 12:47:42,802][123090] Updated weights for policy 1, policy_version 1642049 (0.0009) [2023-12-26 12:47:42,877][123090] Updated weights for policy 1, policy_version 1642059 (0.0007) [2023-12-26 12:47:42,950][123090] Updated weights for policy 1, policy_version 1642069 (0.0005) [2023-12-26 12:47:43,024][123090] Updated weights for policy 1, policy_version 1642079 (0.0006) [2023-12-26 12:47:43,278][123091] Updated weights for policy 0, policy_version 1653080 (0.0006) [2023-12-26 12:47:43,337][123091] Updated weights for policy 0, policy_version 1653090 (0.0005) [2023-12-26 12:47:43,387][123091] Updated weights for policy 0, policy_version 1653100 (0.0005) [2023-12-26 12:47:43,752][123090] Updated weights for policy 1, policy_version 1642089 (0.0010) [2023-12-26 12:47:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 843571200. Throughput: 0: 8896.9, 1: 8906.6. Samples: 843566668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:43,785][121949] Avg episode reward: [(0, '6038.350'), (1, '5656.267')] [2023-12-26 12:47:43,800][123090] Updated weights for policy 1, policy_version 1642099 (0.0010) [2023-12-26 12:47:43,856][123090] Updated weights for policy 1, policy_version 1642109 (0.0010) [2023-12-26 12:47:44,128][123091] Updated weights for policy 0, policy_version 1653110 (0.0007) [2023-12-26 12:47:44,187][123091] Updated weights for policy 0, policy_version 1653120 (0.0009) [2023-12-26 12:47:44,241][123091] Updated weights for policy 0, policy_version 1653130 (0.0009) [2023-12-26 12:47:44,686][123090] Updated weights for policy 1, policy_version 1642119 (0.0011) [2023-12-26 12:47:44,763][123090] Updated weights for policy 1, policy_version 1642129 (0.0006) [2023-12-26 12:47:44,825][123090] Updated weights for policy 1, policy_version 1642139 (0.0008) [2023-12-26 12:47:45,055][123091] Updated weights for policy 0, policy_version 1653140 (0.0007) [2023-12-26 12:47:45,115][123091] Updated weights for policy 0, policy_version 1653150 (0.0009) [2023-12-26 12:47:45,186][123091] Updated weights for policy 0, policy_version 1653160 (0.0009) [2023-12-26 12:47:45,567][123090] Updated weights for policy 1, policy_version 1642149 (0.0008) [2023-12-26 12:47:45,619][123090] Updated weights for policy 1, policy_version 1642159 (0.0006) [2023-12-26 12:47:45,674][123090] Updated weights for policy 1, policy_version 1642169 (0.0006) [2023-12-26 12:47:45,936][123091] Updated weights for policy 0, policy_version 1653170 (0.0010) [2023-12-26 12:47:45,999][123091] Updated weights for policy 0, policy_version 1653180 (0.0009) [2023-12-26 12:47:46,061][123091] Updated weights for policy 0, policy_version 1653190 (0.0010) [2023-12-26 12:47:46,124][123091] Updated weights for policy 0, policy_version 1653200 (0.0010) [2023-12-26 12:47:46,300][123090] Updated weights for policy 1, policy_version 1642179 (0.0007) [2023-12-26 12:47:46,355][123090] Updated weights for policy 1, policy_version 1642189 (0.0007) [2023-12-26 12:47:46,405][123090] Updated weights for policy 1, policy_version 1642199 (0.0005) [2023-12-26 12:47:47,015][123091] Updated weights for policy 0, policy_version 1653210 (0.0011) [2023-12-26 12:47:47,066][123091] Updated weights for policy 0, policy_version 1653220 (0.0010) [2023-12-26 12:47:47,114][123091] Updated weights for policy 0, policy_version 1653230 (0.0011) [2023-12-26 12:47:47,155][123090] Updated weights for policy 1, policy_version 1642209 (0.0005) [2023-12-26 12:47:47,210][123090] Updated weights for policy 1, policy_version 1642219 (0.0009) [2023-12-26 12:47:47,266][123090] Updated weights for policy 1, policy_version 1642229 (0.0009) [2023-12-26 12:47:47,321][123090] Updated weights for policy 1, policy_version 1642240 (0.0010) [2023-12-26 12:47:47,867][123091] Updated weights for policy 0, policy_version 1653240 (0.0011) [2023-12-26 12:47:47,922][123091] Updated weights for policy 0, policy_version 1653250 (0.0010) [2023-12-26 12:47:47,975][123091] Updated weights for policy 0, policy_version 1653260 (0.0010) [2023-12-26 12:47:48,178][123090] Updated weights for policy 1, policy_version 1642250 (0.0005) [2023-12-26 12:47:48,227][123090] Updated weights for policy 1, policy_version 1642260 (0.0005) [2023-12-26 12:47:48,286][123090] Updated weights for policy 1, policy_version 1642270 (0.0005) [2023-12-26 12:47:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 843661312. Throughput: 0: 8927.3, 1: 8946.2. Samples: 843675624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:48,784][121949] Avg episode reward: [(0, '5931.502'), (1, '5590.037')] [2023-12-26 12:47:48,834][123091] Updated weights for policy 0, policy_version 1653270 (0.0008) [2023-12-26 12:47:48,900][123091] Updated weights for policy 0, policy_version 1653280 (0.0006) [2023-12-26 12:47:48,959][123091] Updated weights for policy 0, policy_version 1653290 (0.0010) [2023-12-26 12:47:49,055][123090] Updated weights for policy 1, policy_version 1642280 (0.0008) [2023-12-26 12:47:49,112][123090] Updated weights for policy 1, policy_version 1642290 (0.0009) [2023-12-26 12:47:49,160][123090] Updated weights for policy 1, policy_version 1642300 (0.0008) [2023-12-26 12:47:49,789][123091] Updated weights for policy 0, policy_version 1653300 (0.0008) [2023-12-26 12:47:49,856][123091] Updated weights for policy 0, policy_version 1653310 (0.0007) [2023-12-26 12:47:49,911][123091] Updated weights for policy 0, policy_version 1653320 (0.0009) [2023-12-26 12:47:50,019][123090] Updated weights for policy 1, policy_version 1642310 (0.0009) [2023-12-26 12:47:50,085][123090] Updated weights for policy 1, policy_version 1642320 (0.0008) [2023-12-26 12:47:50,144][123090] Updated weights for policy 1, policy_version 1642330 (0.0008) [2023-12-26 12:47:50,661][123091] Updated weights for policy 0, policy_version 1653330 (0.0008) [2023-12-26 12:47:50,720][123091] Updated weights for policy 0, policy_version 1653340 (0.0010) [2023-12-26 12:47:50,786][123091] Updated weights for policy 0, policy_version 1653350 (0.0010) [2023-12-26 12:47:50,850][123091] Updated weights for policy 0, policy_version 1653360 (0.0010) [2023-12-26 12:47:50,921][123090] Updated weights for policy 1, policy_version 1642340 (0.0008) [2023-12-26 12:47:50,997][123090] Updated weights for policy 1, policy_version 1642350 (0.0009) [2023-12-26 12:47:51,065][123090] Updated weights for policy 1, policy_version 1642360 (0.0010) [2023-12-26 12:47:51,703][123091] Updated weights for policy 0, policy_version 1653370 (0.0010) [2023-12-26 12:47:51,775][123091] Updated weights for policy 0, policy_version 1653380 (0.0009) [2023-12-26 12:47:51,842][123091] Updated weights for policy 0, policy_version 1653390 (0.0008) [2023-12-26 12:47:51,892][123090] Updated weights for policy 1, policy_version 1642370 (0.0009) [2023-12-26 12:47:51,951][123090] Updated weights for policy 1, policy_version 1642380 (0.0009) [2023-12-26 12:47:52,005][123090] Updated weights for policy 1, policy_version 1642390 (0.0009) [2023-12-26 12:47:52,072][123090] Updated weights for policy 1, policy_version 1642400 (0.0010) [2023-12-26 12:47:52,599][123091] Updated weights for policy 0, policy_version 1653400 (0.0009) [2023-12-26 12:47:52,655][123091] Updated weights for policy 0, policy_version 1653410 (0.0009) [2023-12-26 12:47:52,722][123091] Updated weights for policy 0, policy_version 1653420 (0.0009) [2023-12-26 12:47:52,938][123090] Updated weights for policy 1, policy_version 1642410 (0.0009) [2023-12-26 12:47:52,992][123090] Updated weights for policy 1, policy_version 1642420 (0.0008) [2023-12-26 12:47:53,040][123090] Updated weights for policy 1, policy_version 1642430 (0.0009) [2023-12-26 12:47:53,524][123091] Updated weights for policy 0, policy_version 1653430 (0.0006) [2023-12-26 12:47:53,576][123091] Updated weights for policy 0, policy_version 1653440 (0.0005) [2023-12-26 12:47:53,652][123091] Updated weights for policy 0, policy_version 1653450 (0.0005) [2023-12-26 12:47:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 843751424. Throughput: 0: 8831.4, 1: 8986.6. Samples: 843727016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:53,785][121949] Avg episode reward: [(0, '5925.920'), (1, '5824.981')] [2023-12-26 12:47:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001653456_423288832.pth... [2023-12-26 12:47:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001642432_420462592.pth... [2023-12-26 12:47:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001652432_423026688.pth [2023-12-26 12:47:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001641376_420192256.pth [2023-12-26 12:47:53,920][123090] Updated weights for policy 1, policy_version 1642440 (0.0010) [2023-12-26 12:47:53,999][123090] Updated weights for policy 1, policy_version 1642450 (0.0010) [2023-12-26 12:47:54,067][123090] Updated weights for policy 1, policy_version 1642460 (0.0009) [2023-12-26 12:47:54,314][123091] Updated weights for policy 0, policy_version 1653460 (0.0005) [2023-12-26 12:47:54,372][123091] Updated weights for policy 0, policy_version 1653470 (0.0005) [2023-12-26 12:47:54,438][123091] Updated weights for policy 0, policy_version 1653480 (0.0006) [2023-12-26 12:47:54,939][123090] Updated weights for policy 1, policy_version 1642470 (0.0010) [2023-12-26 12:47:55,011][123090] Updated weights for policy 1, policy_version 1642480 (0.0009) [2023-12-26 12:47:55,079][123090] Updated weights for policy 1, policy_version 1642490 (0.0010) [2023-12-26 12:47:55,137][123091] Updated weights for policy 0, policy_version 1653490 (0.0008) [2023-12-26 12:47:55,190][123091] Updated weights for policy 0, policy_version 1653500 (0.0005) [2023-12-26 12:47:55,250][123091] Updated weights for policy 0, policy_version 1653510 (0.0007) [2023-12-26 12:47:55,305][123091] Updated weights for policy 0, policy_version 1653520 (0.0009) [2023-12-26 12:47:55,910][123090] Updated weights for policy 1, policy_version 1642501 (0.0010) [2023-12-26 12:47:55,965][123090] Updated weights for policy 1, policy_version 1642511 (0.0009) [2023-12-26 12:47:56,014][123090] Updated weights for policy 1, policy_version 1642521 (0.0009) [2023-12-26 12:47:56,120][123091] Updated weights for policy 0, policy_version 1653530 (0.0010) [2023-12-26 12:47:56,171][123091] Updated weights for policy 0, policy_version 1653540 (0.0010) [2023-12-26 12:47:56,214][123091] Updated weights for policy 0, policy_version 1653550 (0.0010) [2023-12-26 12:47:56,914][123090] Updated weights for policy 1, policy_version 1642531 (0.0009) [2023-12-26 12:47:56,915][123091] Updated weights for policy 0, policy_version 1653560 (0.0006) [2023-12-26 12:47:56,965][123090] Updated weights for policy 1, policy_version 1642541 (0.0009) [2023-12-26 12:47:56,974][123091] Updated weights for policy 0, policy_version 1653570 (0.0008) [2023-12-26 12:47:57,023][123090] Updated weights for policy 1, policy_version 1642551 (0.0008) [2023-12-26 12:47:57,025][123091] Updated weights for policy 0, policy_version 1653580 (0.0010) [2023-12-26 12:47:57,777][123091] Updated weights for policy 0, policy_version 1653590 (0.0010) [2023-12-26 12:47:57,791][123090] Updated weights for policy 1, policy_version 1642561 (0.0007) [2023-12-26 12:47:57,824][123091] Updated weights for policy 0, policy_version 1653600 (0.0010) [2023-12-26 12:47:57,852][123090] Updated weights for policy 1, policy_version 1642571 (0.0005) [2023-12-26 12:47:57,875][123091] Updated weights for policy 0, policy_version 1653610 (0.0010) [2023-12-26 12:47:57,917][123090] Updated weights for policy 1, policy_version 1642581 (0.0006) [2023-12-26 12:47:57,976][123090] Updated weights for policy 1, policy_version 1642591 (0.0008) [2023-12-26 12:47:58,686][123091] Updated weights for policy 0, policy_version 1653620 (0.0009) [2023-12-26 12:47:58,751][123091] Updated weights for policy 0, policy_version 1653630 (0.0008) [2023-12-26 12:47:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 843833344. Throughput: 0: 8872.6, 1: 8915.4. Samples: 843834104. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:47:58,785][121949] Avg episode reward: [(0, '5843.346'), (1, '5913.999')] [2023-12-26 12:47:58,813][123091] Updated weights for policy 0, policy_version 1653640 (0.0008) [2023-12-26 12:47:58,868][123090] Updated weights for policy 1, policy_version 1642601 (0.0007) [2023-12-26 12:47:58,935][123090] Updated weights for policy 1, policy_version 1642611 (0.0005) [2023-12-26 12:47:59,002][123090] Updated weights for policy 1, policy_version 1642621 (0.0008) [2023-12-26 12:47:59,624][123091] Updated weights for policy 0, policy_version 1653650 (0.0009) [2023-12-26 12:47:59,677][123091] Updated weights for policy 0, policy_version 1653660 (0.0010) [2023-12-26 12:47:59,733][123090] Updated weights for policy 1, policy_version 1642631 (0.0009) [2023-12-26 12:47:59,735][123091] Updated weights for policy 0, policy_version 1653671 (0.0008) [2023-12-26 12:47:59,798][123090] Updated weights for policy 1, policy_version 1642641 (0.0008) [2023-12-26 12:47:59,862][123090] Updated weights for policy 1, policy_version 1642651 (0.0007) [2023-12-26 12:48:00,605][123091] Updated weights for policy 0, policy_version 1653681 (0.0007) [2023-12-26 12:48:00,633][123090] Updated weights for policy 1, policy_version 1642661 (0.0006) [2023-12-26 12:48:00,657][123091] Updated weights for policy 0, policy_version 1653691 (0.0009) [2023-12-26 12:48:00,700][123090] Updated weights for policy 1, policy_version 1642671 (0.0007) [2023-12-26 12:48:00,719][123091] Updated weights for policy 0, policy_version 1653701 (0.0010) [2023-12-26 12:48:00,756][123090] Updated weights for policy 1, policy_version 1642681 (0.0006) [2023-12-26 12:48:00,784][123091] Updated weights for policy 0, policy_version 1653711 (0.0008) [2023-12-26 12:48:01,568][123091] Updated weights for policy 0, policy_version 1653721 (0.0010) [2023-12-26 12:48:01,611][123090] Updated weights for policy 1, policy_version 1642691 (0.0008) [2023-12-26 12:48:01,619][123091] Updated weights for policy 0, policy_version 1653731 (0.0009) [2023-12-26 12:48:01,676][123090] Updated weights for policy 1, policy_version 1642701 (0.0007) [2023-12-26 12:48:01,683][123091] Updated weights for policy 0, policy_version 1653741 (0.0010) [2023-12-26 12:48:01,745][123090] Updated weights for policy 1, policy_version 1642711 (0.0010) [2023-12-26 12:48:02,558][123090] Updated weights for policy 1, policy_version 1642721 (0.0008) [2023-12-26 12:48:02,581][123091] Updated weights for policy 0, policy_version 1653751 (0.0009) [2023-12-26 12:48:02,614][123090] Updated weights for policy 1, policy_version 1642731 (0.0007) [2023-12-26 12:48:02,638][123091] Updated weights for policy 0, policy_version 1653761 (0.0008) [2023-12-26 12:48:02,674][123090] Updated weights for policy 1, policy_version 1642741 (0.0009) [2023-12-26 12:48:02,697][123091] Updated weights for policy 0, policy_version 1653771 (0.0009) [2023-12-26 12:48:02,739][123090] Updated weights for policy 1, policy_version 1642751 (0.0008) [2023-12-26 12:48:03,478][123091] Updated weights for policy 0, policy_version 1653781 (0.0007) [2023-12-26 12:48:03,524][123091] Updated weights for policy 0, policy_version 1653791 (0.0005) [2023-12-26 12:48:03,571][123091] Updated weights for policy 0, policy_version 1653801 (0.0005) [2023-12-26 12:48:03,594][123090] Updated weights for policy 1, policy_version 1642761 (0.0009) [2023-12-26 12:48:03,650][123090] Updated weights for policy 1, policy_version 1642771 (0.0009) [2023-12-26 12:48:03,707][123090] Updated weights for policy 1, policy_version 1642781 (0.0009) [2023-12-26 12:48:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 843931648. Throughput: 0: 8790.0, 1: 8856.6. Samples: 843937392. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 12:48:03,785][121949] Avg episode reward: [(0, '5698.485'), (1, '5739.426')] [2023-12-26 12:48:04,354][123091] Updated weights for policy 0, policy_version 1653811 (0.0007) [2023-12-26 12:48:04,406][123091] Updated weights for policy 0, policy_version 1653821 (0.0011) [2023-12-26 12:48:04,458][123091] Updated weights for policy 0, policy_version 1653831 (0.0010) [2023-12-26 12:48:04,560][123090] Updated weights for policy 1, policy_version 1642791 (0.0007) [2023-12-26 12:48:04,619][123090] Updated weights for policy 1, policy_version 1642801 (0.0005) [2023-12-26 12:48:04,689][123090] Updated weights for policy 1, policy_version 1642811 (0.0007) [2023-12-26 12:48:05,287][123091] Updated weights for policy 0, policy_version 1653841 (0.0011) [2023-12-26 12:48:05,347][123091] Updated weights for policy 0, policy_version 1653851 (0.0007) [2023-12-26 12:48:05,409][123091] Updated weights for policy 0, policy_version 1653861 (0.0005) [2023-12-26 12:48:05,412][123090] Updated weights for policy 1, policy_version 1642821 (0.0006) [2023-12-26 12:48:05,458][123090] Updated weights for policy 1, policy_version 1642831 (0.0007) [2023-12-26 12:48:05,464][123091] Updated weights for policy 0, policy_version 1653871 (0.0005) [2023-12-26 12:48:05,505][123090] Updated weights for policy 1, policy_version 1642841 (0.0005) [2023-12-26 12:48:06,169][123091] Updated weights for policy 0, policy_version 1653881 (0.0009) [2023-12-26 12:48:06,231][123091] Updated weights for policy 0, policy_version 1653891 (0.0009) [2023-12-26 12:48:06,292][123091] Updated weights for policy 0, policy_version 1653901 (0.0009) [2023-12-26 12:48:06,320][123090] Updated weights for policy 1, policy_version 1642851 (0.0007) [2023-12-26 12:48:06,372][123090] Updated weights for policy 1, policy_version 1642861 (0.0010) [2023-12-26 12:48:06,440][123090] Updated weights for policy 1, policy_version 1642871 (0.0011) [2023-12-26 12:48:07,151][123091] Updated weights for policy 0, policy_version 1653911 (0.0009) [2023-12-26 12:48:07,208][123091] Updated weights for policy 0, policy_version 1653921 (0.0009) [2023-12-26 12:48:07,277][123091] Updated weights for policy 0, policy_version 1653931 (0.0009) [2023-12-26 12:48:07,285][123090] Updated weights for policy 1, policy_version 1642881 (0.0011) [2023-12-26 12:48:07,349][123090] Updated weights for policy 1, policy_version 1642891 (0.0011) [2023-12-26 12:48:07,413][123090] Updated weights for policy 1, policy_version 1642901 (0.0011) [2023-12-26 12:48:07,470][123090] Updated weights for policy 1, policy_version 1642911 (0.0011) [2023-12-26 12:48:08,140][123091] Updated weights for policy 0, policy_version 1653941 (0.0008) [2023-12-26 12:48:08,210][123091] Updated weights for policy 0, policy_version 1653951 (0.0010) [2023-12-26 12:48:08,271][123091] Updated weights for policy 0, policy_version 1653961 (0.0008) [2023-12-26 12:48:08,284][123090] Updated weights for policy 1, policy_version 1642921 (0.0010) [2023-12-26 12:48:08,344][123090] Updated weights for policy 1, policy_version 1642931 (0.0010) [2023-12-26 12:48:08,404][123090] Updated weights for policy 1, policy_version 1642941 (0.0010) [2023-12-26 12:48:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 844013568. Throughput: 0: 8798.1, 1: 8885.1. Samples: 843990736. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:08,785][121949] Avg episode reward: [(0, '5830.978'), (1, '5651.426')] [2023-12-26 12:48:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001642944_420593664.pth... [2023-12-26 12:48:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001653968_423419904.pth... [2023-12-26 12:48:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001641920_420331520.pth [2023-12-26 12:48:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001652944_423157760.pth [2023-12-26 12:48:09,083][123091] Updated weights for policy 0, policy_version 1653971 (0.0008) [2023-12-26 12:48:09,141][123091] Updated weights for policy 0, policy_version 1653981 (0.0006) [2023-12-26 12:48:09,151][123090] Updated weights for policy 1, policy_version 1642951 (0.0007) [2023-12-26 12:48:09,206][123091] Updated weights for policy 0, policy_version 1653991 (0.0009) [2023-12-26 12:48:09,224][123090] Updated weights for policy 1, policy_version 1642961 (0.0006) [2023-12-26 12:48:09,293][123090] Updated weights for policy 1, policy_version 1642971 (0.0008) [2023-12-26 12:48:10,012][123091] Updated weights for policy 0, policy_version 1654001 (0.0008) [2023-12-26 12:48:10,081][123091] Updated weights for policy 0, policy_version 1654011 (0.0009) [2023-12-26 12:48:10,102][123090] Updated weights for policy 1, policy_version 1642981 (0.0010) [2023-12-26 12:48:10,145][123091] Updated weights for policy 0, policy_version 1654021 (0.0007) [2023-12-26 12:48:10,164][123090] Updated weights for policy 1, policy_version 1642991 (0.0009) [2023-12-26 12:48:10,206][123091] Updated weights for policy 0, policy_version 1654031 (0.0009) [2023-12-26 12:48:10,228][123090] Updated weights for policy 1, policy_version 1643001 (0.0007) [2023-12-26 12:48:10,986][123091] Updated weights for policy 0, policy_version 1654041 (0.0006) [2023-12-26 12:48:11,005][123090] Updated weights for policy 1, policy_version 1643011 (0.0008) [2023-12-26 12:48:11,058][123091] Updated weights for policy 0, policy_version 1654051 (0.0007) [2023-12-26 12:48:11,079][123090] Updated weights for policy 1, policy_version 1643021 (0.0009) [2023-12-26 12:48:11,131][123091] Updated weights for policy 0, policy_version 1654061 (0.0009) [2023-12-26 12:48:11,150][123090] Updated weights for policy 1, policy_version 1643031 (0.0010) [2023-12-26 12:48:11,966][123090] Updated weights for policy 1, policy_version 1643041 (0.0009) [2023-12-26 12:48:11,969][123091] Updated weights for policy 0, policy_version 1654071 (0.0011) [2023-12-26 12:48:12,021][123091] Updated weights for policy 0, policy_version 1654081 (0.0011) [2023-12-26 12:48:12,026][123090] Updated weights for policy 1, policy_version 1643051 (0.0010) [2023-12-26 12:48:12,084][123091] Updated weights for policy 0, policy_version 1654091 (0.0011) [2023-12-26 12:48:12,090][123090] Updated weights for policy 1, policy_version 1643061 (0.0011) [2023-12-26 12:48:12,154][123090] Updated weights for policy 1, policy_version 1643071 (0.0011) [2023-12-26 12:48:12,890][123091] Updated weights for policy 0, policy_version 1654101 (0.0008) [2023-12-26 12:48:12,948][123091] Updated weights for policy 0, policy_version 1654111 (0.0007) [2023-12-26 12:48:12,987][123090] Updated weights for policy 1, policy_version 1643081 (0.0011) [2023-12-26 12:48:13,000][123091] Updated weights for policy 0, policy_version 1654121 (0.0007) [2023-12-26 12:48:13,053][123090] Updated weights for policy 1, policy_version 1643091 (0.0010) [2023-12-26 12:48:13,128][123090] Updated weights for policy 1, policy_version 1643101 (0.0006) [2023-12-26 12:48:13,680][123091] Updated weights for policy 0, policy_version 1654131 (0.0007) [2023-12-26 12:48:13,746][123091] Updated weights for policy 0, policy_version 1654141 (0.0005) [2023-12-26 12:48:13,784][121949] Fps is (10 sec: 16383.5, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 844095488. Throughput: 0: 8798.1, 1: 8804.8. Samples: 844093608. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:13,786][121949] Avg episode reward: [(0, '6161.530'), (1, '5781.531')] [2023-12-26 12:48:13,797][123091] Updated weights for policy 0, policy_version 1654151 (0.0005) [2023-12-26 12:48:13,943][123090] Updated weights for policy 1, policy_version 1643111 (0.0009) [2023-12-26 12:48:14,002][123090] Updated weights for policy 1, policy_version 1643121 (0.0010) [2023-12-26 12:48:14,049][123090] Updated weights for policy 1, policy_version 1643131 (0.0010) [2023-12-26 12:48:14,449][123091] Updated weights for policy 0, policy_version 1654161 (0.0005) [2023-12-26 12:48:14,504][123091] Updated weights for policy 0, policy_version 1654171 (0.0005) [2023-12-26 12:48:14,557][123091] Updated weights for policy 0, policy_version 1654181 (0.0006) [2023-12-26 12:48:14,603][123091] Updated weights for policy 0, policy_version 1654191 (0.0005) [2023-12-26 12:48:14,822][123090] Updated weights for policy 1, policy_version 1643141 (0.0010) [2023-12-26 12:48:14,890][123090] Updated weights for policy 1, policy_version 1643151 (0.0011) [2023-12-26 12:48:14,950][123090] Updated weights for policy 1, policy_version 1643161 (0.0011) [2023-12-26 12:48:15,362][123091] Updated weights for policy 0, policy_version 1654201 (0.0009) [2023-12-26 12:48:15,421][123091] Updated weights for policy 0, policy_version 1654211 (0.0009) [2023-12-26 12:48:15,480][123091] Updated weights for policy 0, policy_version 1654221 (0.0009) [2023-12-26 12:48:15,751][123090] Updated weights for policy 1, policy_version 1643171 (0.0011) [2023-12-26 12:48:15,810][123090] Updated weights for policy 1, policy_version 1643181 (0.0011) [2023-12-26 12:48:15,861][123090] Updated weights for policy 1, policy_version 1643191 (0.0010) [2023-12-26 12:48:16,272][123091] Updated weights for policy 0, policy_version 1654231 (0.0008) [2023-12-26 12:48:16,328][123091] Updated weights for policy 0, policy_version 1654242 (0.0010) [2023-12-26 12:48:16,381][123091] Updated weights for policy 0, policy_version 1654253 (0.0010) [2023-12-26 12:48:16,643][123090] Updated weights for policy 1, policy_version 1643201 (0.0010) [2023-12-26 12:48:16,705][123090] Updated weights for policy 1, policy_version 1643211 (0.0008) [2023-12-26 12:48:16,773][123090] Updated weights for policy 1, policy_version 1643221 (0.0007) [2023-12-26 12:48:16,847][123090] Updated weights for policy 1, policy_version 1643231 (0.0005) [2023-12-26 12:48:17,258][123091] Updated weights for policy 0, policy_version 1654263 (0.0010) [2023-12-26 12:48:17,309][123091] Updated weights for policy 0, policy_version 1654273 (0.0009) [2023-12-26 12:48:17,366][123091] Updated weights for policy 0, policy_version 1654283 (0.0010) [2023-12-26 12:48:17,588][123090] Updated weights for policy 1, policy_version 1643241 (0.0005) [2023-12-26 12:48:17,660][123090] Updated weights for policy 1, policy_version 1643251 (0.0005) [2023-12-26 12:48:17,726][123090] Updated weights for policy 1, policy_version 1643261 (0.0005) [2023-12-26 12:48:18,260][123091] Updated weights for policy 0, policy_version 1654293 (0.0009) [2023-12-26 12:48:18,322][123091] Updated weights for policy 0, policy_version 1654303 (0.0008) [2023-12-26 12:48:18,342][123090] Updated weights for policy 1, policy_version 1643271 (0.0006) [2023-12-26 12:48:18,383][123091] Updated weights for policy 0, policy_version 1654313 (0.0008) [2023-12-26 12:48:18,403][123090] Updated weights for policy 1, policy_version 1643281 (0.0009) [2023-12-26 12:48:18,469][123090] Updated weights for policy 1, policy_version 1643291 (0.0009) [2023-12-26 12:48:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 844193792. Throughput: 0: 8799.2, 1: 8795.9. Samples: 844203128. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:18,785][121949] Avg episode reward: [(0, '6005.165'), (1, '5687.612')] [2023-12-26 12:48:19,214][123091] Updated weights for policy 0, policy_version 1654323 (0.0008) [2023-12-26 12:48:19,281][123091] Updated weights for policy 0, policy_version 1654333 (0.0010) [2023-12-26 12:48:19,319][123090] Updated weights for policy 1, policy_version 1643301 (0.0009) [2023-12-26 12:48:19,352][123091] Updated weights for policy 0, policy_version 1654343 (0.0009) [2023-12-26 12:48:19,388][123090] Updated weights for policy 1, policy_version 1643311 (0.0008) [2023-12-26 12:48:19,443][123090] Updated weights for policy 1, policy_version 1643321 (0.0008) [2023-12-26 12:48:20,245][123090] Updated weights for policy 1, policy_version 1643331 (0.0007) [2023-12-26 12:48:20,247][123091] Updated weights for policy 0, policy_version 1654353 (0.0009) [2023-12-26 12:48:20,315][123090] Updated weights for policy 1, policy_version 1643341 (0.0006) [2023-12-26 12:48:20,316][123091] Updated weights for policy 0, policy_version 1654363 (0.0009) [2023-12-26 12:48:20,380][123091] Updated weights for policy 0, policy_version 1654373 (0.0010) [2023-12-26 12:48:20,380][123090] Updated weights for policy 1, policy_version 1643351 (0.0010) [2023-12-26 12:48:20,439][123091] Updated weights for policy 0, policy_version 1654383 (0.0009) [2023-12-26 12:48:21,206][123090] Updated weights for policy 1, policy_version 1643361 (0.0008) [2023-12-26 12:48:21,278][123090] Updated weights for policy 1, policy_version 1643371 (0.0009) [2023-12-26 12:48:21,289][123091] Updated weights for policy 0, policy_version 1654393 (0.0009) [2023-12-26 12:48:21,344][123090] Updated weights for policy 1, policy_version 1643381 (0.0008) [2023-12-26 12:48:21,352][123091] Updated weights for policy 0, policy_version 1654403 (0.0009) [2023-12-26 12:48:21,418][123090] Updated weights for policy 1, policy_version 1643391 (0.0008) [2023-12-26 12:48:21,421][123091] Updated weights for policy 0, policy_version 1654413 (0.0008) [2023-12-26 12:48:22,234][123091] Updated weights for policy 0, policy_version 1654423 (0.0008) [2023-12-26 12:48:22,238][123090] Updated weights for policy 1, policy_version 1643401 (0.0008) [2023-12-26 12:48:22,301][123091] Updated weights for policy 0, policy_version 1654433 (0.0008) [2023-12-26 12:48:22,308][123090] Updated weights for policy 1, policy_version 1643411 (0.0008) [2023-12-26 12:48:22,365][123091] Updated weights for policy 0, policy_version 1654443 (0.0008) [2023-12-26 12:48:22,372][123090] Updated weights for policy 1, policy_version 1643421 (0.0008) [2023-12-26 12:48:23,207][123090] Updated weights for policy 1, policy_version 1643431 (0.0010) [2023-12-26 12:48:23,209][123091] Updated weights for policy 0, policy_version 1654453 (0.0008) [2023-12-26 12:48:23,272][123090] Updated weights for policy 1, policy_version 1643441 (0.0009) [2023-12-26 12:48:23,273][123091] Updated weights for policy 0, policy_version 1654463 (0.0010) [2023-12-26 12:48:23,337][123091] Updated weights for policy 0, policy_version 1654473 (0.0010) [2023-12-26 12:48:23,337][123090] Updated weights for policy 1, policy_version 1643451 (0.0008) [2023-12-26 12:48:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 844275712. Throughput: 0: 8756.5, 1: 8778.9. Samples: 844253160. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:23,785][121949] Avg episode reward: [(0, '5934.095'), (1, '5720.659')] [2023-12-26 12:48:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001654480_423550976.pth... [2023-12-26 12:48:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001643456_420724736.pth... [2023-12-26 12:48:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001653456_423288832.pth [2023-12-26 12:48:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001642432_420462592.pth [2023-12-26 12:48:24,154][123091] Updated weights for policy 0, policy_version 1654483 (0.0010) [2023-12-26 12:48:24,162][123090] Updated weights for policy 1, policy_version 1643461 (0.0008) [2023-12-26 12:48:24,203][123091] Updated weights for policy 0, policy_version 1654493 (0.0010) [2023-12-26 12:48:24,216][123090] Updated weights for policy 1, policy_version 1643471 (0.0005) [2023-12-26 12:48:24,254][123091] Updated weights for policy 0, policy_version 1654503 (0.0010) [2023-12-26 12:48:24,272][123090] Updated weights for policy 1, policy_version 1643481 (0.0008) [2023-12-26 12:48:24,967][123091] Updated weights for policy 0, policy_version 1654513 (0.0005) [2023-12-26 12:48:25,031][123091] Updated weights for policy 0, policy_version 1654523 (0.0006) [2023-12-26 12:48:25,067][123090] Updated weights for policy 1, policy_version 1643491 (0.0008) [2023-12-26 12:48:25,094][123091] Updated weights for policy 0, policy_version 1654533 (0.0006) [2023-12-26 12:48:25,132][123090] Updated weights for policy 1, policy_version 1643501 (0.0006) [2023-12-26 12:48:25,155][123091] Updated weights for policy 0, policy_version 1654543 (0.0007) [2023-12-26 12:48:25,186][123090] Updated weights for policy 1, policy_version 1643511 (0.0005) [2023-12-26 12:48:25,899][123090] Updated weights for policy 1, policy_version 1643521 (0.0005) [2023-12-26 12:48:25,932][123091] Updated weights for policy 0, policy_version 1654553 (0.0007) [2023-12-26 12:48:25,966][123090] Updated weights for policy 1, policy_version 1643531 (0.0008) [2023-12-26 12:48:25,994][123091] Updated weights for policy 0, policy_version 1654563 (0.0010) [2023-12-26 12:48:26,023][123090] Updated weights for policy 1, policy_version 1643541 (0.0008) [2023-12-26 12:48:26,051][123091] Updated weights for policy 0, policy_version 1654573 (0.0008) [2023-12-26 12:48:26,090][123090] Updated weights for policy 1, policy_version 1643551 (0.0009) [2023-12-26 12:48:26,802][123091] Updated weights for policy 0, policy_version 1654583 (0.0008) [2023-12-26 12:48:26,859][123091] Updated weights for policy 0, policy_version 1654593 (0.0008) [2023-12-26 12:48:26,866][123090] Updated weights for policy 1, policy_version 1643561 (0.0006) [2023-12-26 12:48:26,924][123091] Updated weights for policy 0, policy_version 1654603 (0.0009) [2023-12-26 12:48:26,935][123090] Updated weights for policy 1, policy_version 1643571 (0.0005) [2023-12-26 12:48:27,012][123090] Updated weights for policy 1, policy_version 1643581 (0.0005) [2023-12-26 12:48:27,687][123090] Updated weights for policy 1, policy_version 1643591 (0.0009) [2023-12-26 12:48:27,723][123091] Updated weights for policy 0, policy_version 1654613 (0.0008) [2023-12-26 12:48:27,746][123090] Updated weights for policy 1, policy_version 1643601 (0.0011) [2023-12-26 12:48:27,775][123091] Updated weights for policy 0, policy_version 1654623 (0.0007) [2023-12-26 12:48:27,808][123090] Updated weights for policy 1, policy_version 1643611 (0.0010) [2023-12-26 12:48:27,820][123091] Updated weights for policy 0, policy_version 1654633 (0.0008) [2023-12-26 12:48:28,502][123090] Updated weights for policy 1, policy_version 1643621 (0.0008) [2023-12-26 12:48:28,556][123090] Updated weights for policy 1, policy_version 1643631 (0.0005) [2023-12-26 12:48:28,624][123090] Updated weights for policy 1, policy_version 1643641 (0.0006) [2023-12-26 12:48:28,673][123091] Updated weights for policy 0, policy_version 1654643 (0.0006) [2023-12-26 12:48:28,727][123091] Updated weights for policy 0, policy_version 1654653 (0.0009) [2023-12-26 12:48:28,781][123091] Updated weights for policy 0, policy_version 1654663 (0.0010) [2023-12-26 12:48:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 844365824. Throughput: 0: 8871.2, 1: 8763.5. Samples: 844360228. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:28,784][121949] Avg episode reward: [(0, '6066.198'), (1, '5636.883')] [2023-12-26 12:48:29,309][123090] Updated weights for policy 1, policy_version 1643651 (0.0007) [2023-12-26 12:48:29,372][123090] Updated weights for policy 1, policy_version 1643661 (0.0008) [2023-12-26 12:48:29,439][123090] Updated weights for policy 1, policy_version 1643671 (0.0010) [2023-12-26 12:48:29,646][123091] Updated weights for policy 0, policy_version 1654673 (0.0010) [2023-12-26 12:48:29,701][123091] Updated weights for policy 0, policy_version 1654685 (0.0011) [2023-12-26 12:48:29,757][123091] Updated weights for policy 0, policy_version 1654695 (0.0009) [2023-12-26 12:48:30,130][123090] Updated weights for policy 1, policy_version 1643681 (0.0009) [2023-12-26 12:48:30,196][123090] Updated weights for policy 1, policy_version 1643691 (0.0005) [2023-12-26 12:48:30,253][123090] Updated weights for policy 1, policy_version 1643701 (0.0006) [2023-12-26 12:48:30,310][123090] Updated weights for policy 1, policy_version 1643711 (0.0005) [2023-12-26 12:48:30,644][123091] Updated weights for policy 0, policy_version 1654705 (0.0010) [2023-12-26 12:48:30,696][123091] Updated weights for policy 0, policy_version 1654715 (0.0009) [2023-12-26 12:48:30,743][123091] Updated weights for policy 0, policy_version 1654725 (0.0009) [2023-12-26 12:48:30,794][123091] Updated weights for policy 0, policy_version 1654735 (0.0008) [2023-12-26 12:48:31,058][123090] Updated weights for policy 1, policy_version 1643721 (0.0007) [2023-12-26 12:48:31,125][123090] Updated weights for policy 1, policy_version 1643731 (0.0006) [2023-12-26 12:48:31,189][123090] Updated weights for policy 1, policy_version 1643741 (0.0008) [2023-12-26 12:48:31,661][123091] Updated weights for policy 0, policy_version 1654745 (0.0008) [2023-12-26 12:48:31,727][123091] Updated weights for policy 0, policy_version 1654755 (0.0008) [2023-12-26 12:48:31,812][123091] Updated weights for policy 0, policy_version 1654765 (0.0008) [2023-12-26 12:48:31,972][123090] Updated weights for policy 1, policy_version 1643751 (0.0010) [2023-12-26 12:48:32,046][123090] Updated weights for policy 1, policy_version 1643761 (0.0010) [2023-12-26 12:48:32,125][123090] Updated weights for policy 1, policy_version 1643771 (0.0011) [2023-12-26 12:48:32,517][123091] Updated weights for policy 0, policy_version 1654775 (0.0008) [2023-12-26 12:48:32,566][123091] Updated weights for policy 0, policy_version 1654785 (0.0009) [2023-12-26 12:48:32,621][123091] Updated weights for policy 0, policy_version 1654795 (0.0009) [2023-12-26 12:48:32,994][123090] Updated weights for policy 1, policy_version 1643781 (0.0010) [2023-12-26 12:48:33,052][123090] Updated weights for policy 1, policy_version 1643791 (0.0010) [2023-12-26 12:48:33,106][123090] Updated weights for policy 1, policy_version 1643801 (0.0010) [2023-12-26 12:48:33,384][123091] Updated weights for policy 0, policy_version 1654805 (0.0007) [2023-12-26 12:48:33,435][123091] Updated weights for policy 0, policy_version 1654815 (0.0005) [2023-12-26 12:48:33,483][123091] Updated weights for policy 0, policy_version 1654825 (0.0005) [2023-12-26 12:48:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 844455936. Throughput: 0: 8846.7, 1: 8772.0. Samples: 844468464. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:33,785][121949] Avg episode reward: [(0, '5975.211'), (1, '5552.316')] [2023-12-26 12:48:33,811][123090] Updated weights for policy 1, policy_version 1643811 (0.0010) [2023-12-26 12:48:33,888][123090] Updated weights for policy 1, policy_version 1643821 (0.0007) [2023-12-26 12:48:33,934][123090] Updated weights for policy 1, policy_version 1643831 (0.0005) [2023-12-26 12:48:34,109][123091] Updated weights for policy 0, policy_version 1654835 (0.0005) [2023-12-26 12:48:34,182][123091] Updated weights for policy 0, policy_version 1654845 (0.0006) [2023-12-26 12:48:34,253][123091] Updated weights for policy 0, policy_version 1654855 (0.0008) [2023-12-26 12:48:34,676][123090] Updated weights for policy 1, policy_version 1643841 (0.0005) [2023-12-26 12:48:34,744][123090] Updated weights for policy 1, policy_version 1643851 (0.0010) [2023-12-26 12:48:34,813][123090] Updated weights for policy 1, policy_version 1643861 (0.0009) [2023-12-26 12:48:34,876][123090] Updated weights for policy 1, policy_version 1643871 (0.0010) [2023-12-26 12:48:35,019][123091] Updated weights for policy 0, policy_version 1654865 (0.0008) [2023-12-26 12:48:35,075][123091] Updated weights for policy 0, policy_version 1654875 (0.0011) [2023-12-26 12:48:35,127][123091] Updated weights for policy 0, policy_version 1654885 (0.0010) [2023-12-26 12:48:35,186][123091] Updated weights for policy 0, policy_version 1654895 (0.0011) [2023-12-26 12:48:35,677][123090] Updated weights for policy 1, policy_version 1643881 (0.0010) [2023-12-26 12:48:35,732][123090] Updated weights for policy 1, policy_version 1643891 (0.0010) [2023-12-26 12:48:35,780][123090] Updated weights for policy 1, policy_version 1643901 (0.0010) [2023-12-26 12:48:36,025][123091] Updated weights for policy 0, policy_version 1654905 (0.0010) [2023-12-26 12:48:36,088][123091] Updated weights for policy 0, policy_version 1654915 (0.0010) [2023-12-26 12:48:36,157][123091] Updated weights for policy 0, policy_version 1654925 (0.0007) [2023-12-26 12:48:36,536][123090] Updated weights for policy 1, policy_version 1643911 (0.0009) [2023-12-26 12:48:36,600][123090] Updated weights for policy 1, policy_version 1643921 (0.0008) [2023-12-26 12:48:36,664][123090] Updated weights for policy 1, policy_version 1643931 (0.0010) [2023-12-26 12:48:36,941][123091] Updated weights for policy 0, policy_version 1654935 (0.0006) [2023-12-26 12:48:36,999][123091] Updated weights for policy 0, policy_version 1654945 (0.0005) [2023-12-26 12:48:37,051][123091] Updated weights for policy 0, policy_version 1654955 (0.0005) [2023-12-26 12:48:37,440][123090] Updated weights for policy 1, policy_version 1643941 (0.0006) [2023-12-26 12:48:37,498][123090] Updated weights for policy 1, policy_version 1643951 (0.0006) [2023-12-26 12:48:37,555][123090] Updated weights for policy 1, policy_version 1643961 (0.0005) [2023-12-26 12:48:37,857][123091] Updated weights for policy 0, policy_version 1654965 (0.0008) [2023-12-26 12:48:37,918][123091] Updated weights for policy 0, policy_version 1654975 (0.0009) [2023-12-26 12:48:37,980][123091] Updated weights for policy 0, policy_version 1654985 (0.0009) [2023-12-26 12:48:38,282][123090] Updated weights for policy 1, policy_version 1643971 (0.0007) [2023-12-26 12:48:38,351][123090] Updated weights for policy 1, policy_version 1643981 (0.0010) [2023-12-26 12:48:38,411][123090] Updated weights for policy 1, policy_version 1643991 (0.0010) [2023-12-26 12:48:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 844546048. Throughput: 0: 8887.7, 1: 8814.3. Samples: 844523608. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:38,785][121949] Avg episode reward: [(0, '5961.531'), (1, '5801.509')] [2023-12-26 12:48:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001654992_423682048.pth... [2023-12-26 12:48:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001644000_420864000.pth... [2023-12-26 12:48:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001653968_423419904.pth [2023-12-26 12:48:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001642944_420593664.pth [2023-12-26 12:48:38,831][123091] Updated weights for policy 0, policy_version 1654995 (0.0009) [2023-12-26 12:48:38,895][123091] Updated weights for policy 0, policy_version 1655005 (0.0009) [2023-12-26 12:48:38,961][123091] Updated weights for policy 0, policy_version 1655015 (0.0010) [2023-12-26 12:48:39,240][123090] Updated weights for policy 1, policy_version 1644001 (0.0013) [2023-12-26 12:48:39,302][123090] Updated weights for policy 1, policy_version 1644011 (0.0012) [2023-12-26 12:48:39,383][123090] Updated weights for policy 1, policy_version 1644021 (0.0009) [2023-12-26 12:48:39,466][123090] Updated weights for policy 1, policy_version 1644031 (0.0010) [2023-12-26 12:48:39,824][123091] Updated weights for policy 0, policy_version 1655025 (0.0009) [2023-12-26 12:48:39,892][123091] Updated weights for policy 0, policy_version 1655035 (0.0007) [2023-12-26 12:48:39,957][123091] Updated weights for policy 0, policy_version 1655045 (0.0007) [2023-12-26 12:48:40,012][123091] Updated weights for policy 0, policy_version 1655055 (0.0010) [2023-12-26 12:48:40,261][123090] Updated weights for policy 1, policy_version 1644041 (0.0011) [2023-12-26 12:48:40,324][123090] Updated weights for policy 1, policy_version 1644051 (0.0010) [2023-12-26 12:48:40,378][123090] Updated weights for policy 1, policy_version 1644061 (0.0008) [2023-12-26 12:48:40,901][123091] Updated weights for policy 0, policy_version 1655065 (0.0010) [2023-12-26 12:48:40,973][123091] Updated weights for policy 0, policy_version 1655075 (0.0009) [2023-12-26 12:48:41,040][123091] Updated weights for policy 0, policy_version 1655085 (0.0009) [2023-12-26 12:48:41,176][123090] Updated weights for policy 1, policy_version 1644071 (0.0008) [2023-12-26 12:48:41,257][123090] Updated weights for policy 1, policy_version 1644081 (0.0008) [2023-12-26 12:48:41,331][123090] Updated weights for policy 1, policy_version 1644091 (0.0008) [2023-12-26 12:48:41,895][123091] Updated weights for policy 0, policy_version 1655095 (0.0009) [2023-12-26 12:48:41,958][123091] Updated weights for policy 0, policy_version 1655105 (0.0010) [2023-12-26 12:48:42,018][123091] Updated weights for policy 0, policy_version 1655115 (0.0010) [2023-12-26 12:48:42,157][123090] Updated weights for policy 1, policy_version 1644101 (0.0009) [2023-12-26 12:48:42,226][123090] Updated weights for policy 1, policy_version 1644111 (0.0010) [2023-12-26 12:48:42,294][123090] Updated weights for policy 1, policy_version 1644121 (0.0010) [2023-12-26 12:48:42,905][123091] Updated weights for policy 0, policy_version 1655125 (0.0010) [2023-12-26 12:48:42,961][123091] Updated weights for policy 0, policy_version 1655135 (0.0010) [2023-12-26 12:48:43,014][123091] Updated weights for policy 0, policy_version 1655145 (0.0010) [2023-12-26 12:48:43,094][123090] Updated weights for policy 1, policy_version 1644131 (0.0009) [2023-12-26 12:48:43,155][123090] Updated weights for policy 1, policy_version 1644141 (0.0007) [2023-12-26 12:48:43,219][123090] Updated weights for policy 1, policy_version 1644151 (0.0009) [2023-12-26 12:48:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 844627968. Throughput: 0: 8731.5, 1: 8846.0. Samples: 844625096. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:43,785][121949] Avg episode reward: [(0, '5937.783'), (1, '5927.140')] [2023-12-26 12:48:43,879][123091] Updated weights for policy 0, policy_version 1655155 (0.0010) [2023-12-26 12:48:43,937][123091] Updated weights for policy 0, policy_version 1655165 (0.0009) [2023-12-26 12:48:44,004][123091] Updated weights for policy 0, policy_version 1655175 (0.0010) [2023-12-26 12:48:44,024][123090] Updated weights for policy 1, policy_version 1644161 (0.0009) [2023-12-26 12:48:44,087][123090] Updated weights for policy 1, policy_version 1644171 (0.0010) [2023-12-26 12:48:44,155][123090] Updated weights for policy 1, policy_version 1644181 (0.0007) [2023-12-26 12:48:44,211][123090] Updated weights for policy 1, policy_version 1644191 (0.0005) [2023-12-26 12:48:44,859][123091] Updated weights for policy 0, policy_version 1655185 (0.0008) [2023-12-26 12:48:44,913][123091] Updated weights for policy 0, policy_version 1655195 (0.0010) [2023-12-26 12:48:44,970][123091] Updated weights for policy 0, policy_version 1655205 (0.0011) [2023-12-26 12:48:45,015][123090] Updated weights for policy 1, policy_version 1644201 (0.0008) [2023-12-26 12:48:45,018][123091] Updated weights for policy 0, policy_version 1655215 (0.0009) [2023-12-26 12:48:45,072][123090] Updated weights for policy 1, policy_version 1644211 (0.0009) [2023-12-26 12:48:45,131][123090] Updated weights for policy 1, policy_version 1644221 (0.0010) [2023-12-26 12:48:45,885][123091] Updated weights for policy 0, policy_version 1655225 (0.0006) [2023-12-26 12:48:45,950][123091] Updated weights for policy 0, policy_version 1655235 (0.0005) [2023-12-26 12:48:45,991][123090] Updated weights for policy 1, policy_version 1644231 (0.0006) [2023-12-26 12:48:46,015][123091] Updated weights for policy 0, policy_version 1655245 (0.0006) [2023-12-26 12:48:46,045][123090] Updated weights for policy 1, policy_version 1644241 (0.0005) [2023-12-26 12:48:46,101][123090] Updated weights for policy 1, policy_version 1644251 (0.0005) [2023-12-26 12:48:46,787][123091] Updated weights for policy 0, policy_version 1655255 (0.0007) [2023-12-26 12:48:46,847][123091] Updated weights for policy 0, policy_version 1655265 (0.0008) [2023-12-26 12:48:46,872][123090] Updated weights for policy 1, policy_version 1644261 (0.0008) [2023-12-26 12:48:46,909][123091] Updated weights for policy 0, policy_version 1655275 (0.0007) [2023-12-26 12:48:46,938][123090] Updated weights for policy 1, policy_version 1644271 (0.0010) [2023-12-26 12:48:46,997][123090] Updated weights for policy 1, policy_version 1644281 (0.0010) [2023-12-26 12:48:47,726][123090] Updated weights for policy 1, policy_version 1644291 (0.0009) [2023-12-26 12:48:47,762][123091] Updated weights for policy 0, policy_version 1655285 (0.0010) [2023-12-26 12:48:47,782][123090] Updated weights for policy 1, policy_version 1644301 (0.0009) [2023-12-26 12:48:47,819][123091] Updated weights for policy 0, policy_version 1655295 (0.0009) [2023-12-26 12:48:47,838][123090] Updated weights for policy 1, policy_version 1644311 (0.0007) [2023-12-26 12:48:47,873][123091] Updated weights for policy 0, policy_version 1655305 (0.0009) [2023-12-26 12:48:48,597][123090] Updated weights for policy 1, policy_version 1644321 (0.0005) [2023-12-26 12:48:48,655][123090] Updated weights for policy 1, policy_version 1644331 (0.0007) [2023-12-26 12:48:48,721][123090] Updated weights for policy 1, policy_version 1644341 (0.0009) [2023-12-26 12:48:48,766][123091] Updated weights for policy 0, policy_version 1655315 (0.0010) [2023-12-26 12:48:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 844709888. Throughput: 0: 8685.3, 1: 8917.2. Samples: 844729508. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:48,785][121949] Avg episode reward: [(0, '5753.879'), (1, '5914.328')] [2023-12-26 12:48:48,786][123090] Updated weights for policy 1, policy_version 1644351 (0.0007) [2023-12-26 12:48:48,826][123091] Updated weights for policy 0, policy_version 1655325 (0.0009) [2023-12-26 12:48:48,875][123091] Updated weights for policy 0, policy_version 1655335 (0.0009) [2023-12-26 12:48:49,600][123090] Updated weights for policy 1, policy_version 1644361 (0.0006) [2023-12-26 12:48:49,668][123090] Updated weights for policy 1, policy_version 1644371 (0.0005) [2023-12-26 12:48:49,729][123090] Updated weights for policy 1, policy_version 1644381 (0.0005) [2023-12-26 12:48:49,773][123091] Updated weights for policy 0, policy_version 1655345 (0.0009) [2023-12-26 12:48:49,839][123091] Updated weights for policy 0, policy_version 1655355 (0.0010) [2023-12-26 12:48:49,909][123091] Updated weights for policy 0, policy_version 1655365 (0.0009) [2023-12-26 12:48:49,980][123091] Updated weights for policy 0, policy_version 1655375 (0.0007) [2023-12-26 12:48:50,505][123090] Updated weights for policy 1, policy_version 1644391 (0.0009) [2023-12-26 12:48:50,564][123090] Updated weights for policy 1, policy_version 1644401 (0.0009) [2023-12-26 12:48:50,638][123090] Updated weights for policy 1, policy_version 1644411 (0.0007) [2023-12-26 12:48:50,731][123091] Updated weights for policy 0, policy_version 1655385 (0.0006) [2023-12-26 12:48:50,797][123091] Updated weights for policy 0, policy_version 1655395 (0.0006) [2023-12-26 12:48:50,866][123091] Updated weights for policy 0, policy_version 1655405 (0.0006) [2023-12-26 12:48:51,431][123090] Updated weights for policy 1, policy_version 1644421 (0.0008) [2023-12-26 12:48:51,494][123090] Updated weights for policy 1, policy_version 1644431 (0.0011) [2023-12-26 12:48:51,549][123090] Updated weights for policy 1, policy_version 1644441 (0.0011) [2023-12-26 12:48:51,635][123091] Updated weights for policy 0, policy_version 1655415 (0.0008) [2023-12-26 12:48:51,713][123091] Updated weights for policy 0, policy_version 1655425 (0.0008) [2023-12-26 12:48:51,768][123091] Updated weights for policy 0, policy_version 1655435 (0.0009) [2023-12-26 12:48:52,307][123090] Updated weights for policy 1, policy_version 1644451 (0.0010) [2023-12-26 12:48:52,374][123090] Updated weights for policy 1, policy_version 1644461 (0.0008) [2023-12-26 12:48:52,433][123090] Updated weights for policy 1, policy_version 1644471 (0.0008) [2023-12-26 12:48:52,629][123091] Updated weights for policy 0, policy_version 1655445 (0.0009) [2023-12-26 12:48:52,677][123091] Updated weights for policy 0, policy_version 1655455 (0.0011) [2023-12-26 12:48:52,729][123091] Updated weights for policy 0, policy_version 1655465 (0.0010) [2023-12-26 12:48:53,174][123090] Updated weights for policy 1, policy_version 1644481 (0.0008) [2023-12-26 12:48:53,229][123090] Updated weights for policy 1, policy_version 1644491 (0.0005) [2023-12-26 12:48:53,286][123090] Updated weights for policy 1, policy_version 1644501 (0.0006) [2023-12-26 12:48:53,344][123090] Updated weights for policy 1, policy_version 1644511 (0.0005) [2023-12-26 12:48:53,554][123091] Updated weights for policy 0, policy_version 1655475 (0.0011) [2023-12-26 12:48:53,624][123091] Updated weights for policy 0, policy_version 1655485 (0.0011) [2023-12-26 12:48:53,694][123091] Updated weights for policy 0, policy_version 1655495 (0.0010) [2023-12-26 12:48:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 844808192. Throughput: 0: 8661.9, 1: 8903.9. Samples: 844781196. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:53,784][121949] Avg episode reward: [(0, '5801.216'), (1, '5849.271')] [2023-12-26 12:48:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001655504_423813120.pth... [2023-12-26 12:48:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001644512_420995072.pth... [2023-12-26 12:48:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001654480_423550976.pth [2023-12-26 12:48:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001643456_420724736.pth [2023-12-26 12:48:54,078][123090] Updated weights for policy 1, policy_version 1644521 (0.0008) [2023-12-26 12:48:54,143][123090] Updated weights for policy 1, policy_version 1644531 (0.0009) [2023-12-26 12:48:54,207][123090] Updated weights for policy 1, policy_version 1644541 (0.0009) [2023-12-26 12:48:54,402][123091] Updated weights for policy 0, policy_version 1655505 (0.0005) [2023-12-26 12:48:54,457][123091] Updated weights for policy 0, policy_version 1655515 (0.0006) [2023-12-26 12:48:54,514][123091] Updated weights for policy 0, policy_version 1655525 (0.0009) [2023-12-26 12:48:54,563][123091] Updated weights for policy 0, policy_version 1655535 (0.0009) [2023-12-26 12:48:55,026][123090] Updated weights for policy 1, policy_version 1644551 (0.0009) [2023-12-26 12:48:55,088][123090] Updated weights for policy 1, policy_version 1644561 (0.0009) [2023-12-26 12:48:55,150][123090] Updated weights for policy 1, policy_version 1644571 (0.0009) [2023-12-26 12:48:55,349][123091] Updated weights for policy 0, policy_version 1655545 (0.0009) [2023-12-26 12:48:55,400][123091] Updated weights for policy 0, policy_version 1655555 (0.0009) [2023-12-26 12:48:55,458][123091] Updated weights for policy 0, policy_version 1655565 (0.0009) [2023-12-26 12:48:55,858][123090] Updated weights for policy 1, policy_version 1644581 (0.0009) [2023-12-26 12:48:55,913][123090] Updated weights for policy 1, policy_version 1644591 (0.0008) [2023-12-26 12:48:55,961][123090] Updated weights for policy 1, policy_version 1644601 (0.0009) [2023-12-26 12:48:56,291][123091] Updated weights for policy 0, policy_version 1655575 (0.0010) [2023-12-26 12:48:56,356][123091] Updated weights for policy 0, policy_version 1655585 (0.0010) [2023-12-26 12:48:56,414][123091] Updated weights for policy 0, policy_version 1655595 (0.0010) [2023-12-26 12:48:56,752][123090] Updated weights for policy 1, policy_version 1644611 (0.0008) [2023-12-26 12:48:56,804][123090] Updated weights for policy 1, policy_version 1644621 (0.0005) [2023-12-26 12:48:56,863][123090] Updated weights for policy 1, policy_version 1644631 (0.0007) [2023-12-26 12:48:57,222][123091] Updated weights for policy 0, policy_version 1655605 (0.0010) [2023-12-26 12:48:57,278][123091] Updated weights for policy 0, policy_version 1655615 (0.0009) [2023-12-26 12:48:57,333][123091] Updated weights for policy 0, policy_version 1655625 (0.0009) [2023-12-26 12:48:57,640][123090] Updated weights for policy 1, policy_version 1644641 (0.0011) [2023-12-26 12:48:57,698][123090] Updated weights for policy 1, policy_version 1644651 (0.0010) [2023-12-26 12:48:57,745][123090] Updated weights for policy 1, policy_version 1644661 (0.0010) [2023-12-26 12:48:57,792][123090] Updated weights for policy 1, policy_version 1644671 (0.0010) [2023-12-26 12:48:58,033][123091] Updated weights for policy 0, policy_version 1655635 (0.0008) [2023-12-26 12:48:58,109][123091] Updated weights for policy 0, policy_version 1655645 (0.0011) [2023-12-26 12:48:58,168][123091] Updated weights for policy 0, policy_version 1655655 (0.0010) [2023-12-26 12:48:58,626][123090] Updated weights for policy 1, policy_version 1644681 (0.0009) [2023-12-26 12:48:58,687][123090] Updated weights for policy 1, policy_version 1644691 (0.0007) [2023-12-26 12:48:58,763][123090] Updated weights for policy 1, policy_version 1644701 (0.0012) [2023-12-26 12:48:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 844890112. Throughput: 0: 8694.4, 1: 8992.9. Samples: 844889532. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:48:58,785][121949] Avg episode reward: [(0, '5886.899'), (1, '5764.358')] [2023-12-26 12:48:59,073][123091] Updated weights for policy 0, policy_version 1655665 (0.0010) [2023-12-26 12:48:59,139][123091] Updated weights for policy 0, policy_version 1655675 (0.0008) [2023-12-26 12:48:59,210][123091] Updated weights for policy 0, policy_version 1655685 (0.0010) [2023-12-26 12:48:59,268][123091] Updated weights for policy 0, policy_version 1655695 (0.0008) [2023-12-26 12:48:59,711][123090] Updated weights for policy 1, policy_version 1644711 (0.0009) [2023-12-26 12:48:59,777][123090] Updated weights for policy 1, policy_version 1644721 (0.0008) [2023-12-26 12:48:59,845][123090] Updated weights for policy 1, policy_version 1644731 (0.0010) [2023-12-26 12:49:00,038][123091] Updated weights for policy 0, policy_version 1655705 (0.0009) [2023-12-26 12:49:00,090][123091] Updated weights for policy 0, policy_version 1655716 (0.0010) [2023-12-26 12:49:00,143][123091] Updated weights for policy 0, policy_version 1655726 (0.0010) [2023-12-26 12:49:00,519][123090] Updated weights for policy 1, policy_version 1644741 (0.0008) [2023-12-26 12:49:00,591][123090] Updated weights for policy 1, policy_version 1644751 (0.0005) [2023-12-26 12:49:00,649][123090] Updated weights for policy 1, policy_version 1644761 (0.0005) [2023-12-26 12:49:01,060][123091] Updated weights for policy 0, policy_version 1655736 (0.0010) [2023-12-26 12:49:01,126][123091] Updated weights for policy 0, policy_version 1655746 (0.0009) [2023-12-26 12:49:01,188][123091] Updated weights for policy 0, policy_version 1655756 (0.0009) [2023-12-26 12:49:01,360][123090] Updated weights for policy 1, policy_version 1644771 (0.0008) [2023-12-26 12:49:01,419][123090] Updated weights for policy 1, policy_version 1644781 (0.0010) [2023-12-26 12:49:01,489][123090] Updated weights for policy 1, policy_version 1644791 (0.0005) [2023-12-26 12:49:02,017][123091] Updated weights for policy 0, policy_version 1655766 (0.0008) [2023-12-26 12:49:02,074][123091] Updated weights for policy 0, policy_version 1655776 (0.0006) [2023-12-26 12:49:02,128][123091] Updated weights for policy 0, policy_version 1655786 (0.0005) [2023-12-26 12:49:02,217][123090] Updated weights for policy 1, policy_version 1644801 (0.0006) [2023-12-26 12:49:02,284][123090] Updated weights for policy 1, policy_version 1644811 (0.0010) [2023-12-26 12:49:02,356][123090] Updated weights for policy 1, policy_version 1644821 (0.0010) [2023-12-26 12:49:02,412][123090] Updated weights for policy 1, policy_version 1644831 (0.0008) [2023-12-26 12:49:02,856][123091] Updated weights for policy 0, policy_version 1655796 (0.0005) [2023-12-26 12:49:02,918][123091] Updated weights for policy 0, policy_version 1655806 (0.0005) [2023-12-26 12:49:02,969][123091] Updated weights for policy 0, policy_version 1655816 (0.0005) [2023-12-26 12:49:03,200][123090] Updated weights for policy 1, policy_version 1644841 (0.0010) [2023-12-26 12:49:03,243][123090] Updated weights for policy 1, policy_version 1644851 (0.0010) [2023-12-26 12:49:03,290][123090] Updated weights for policy 1, policy_version 1644861 (0.0010) [2023-12-26 12:49:03,607][123091] Updated weights for policy 0, policy_version 1655826 (0.0005) [2023-12-26 12:49:03,661][123091] Updated weights for policy 0, policy_version 1655836 (0.0005) [2023-12-26 12:49:03,707][123091] Updated weights for policy 0, policy_version 1655846 (0.0005) [2023-12-26 12:49:03,753][123091] Updated weights for policy 0, policy_version 1655856 (0.0005) [2023-12-26 12:49:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 844988416. Throughput: 0: 8671.8, 1: 8959.4. Samples: 844996532. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:03,785][121949] Avg episode reward: [(0, '5982.954'), (1, '5644.366')] [2023-12-26 12:49:04,003][123090] Updated weights for policy 1, policy_version 1644871 (0.0007) [2023-12-26 12:49:04,071][123090] Updated weights for policy 1, policy_version 1644881 (0.0007) [2023-12-26 12:49:04,128][123090] Updated weights for policy 1, policy_version 1644892 (0.0011) [2023-12-26 12:49:04,507][123091] Updated weights for policy 0, policy_version 1655866 (0.0010) [2023-12-26 12:49:04,565][123091] Updated weights for policy 0, policy_version 1655876 (0.0009) [2023-12-26 12:49:04,624][123091] Updated weights for policy 0, policy_version 1655886 (0.0010) [2023-12-26 12:49:04,882][123090] Updated weights for policy 1, policy_version 1644902 (0.0011) [2023-12-26 12:49:04,933][123090] Updated weights for policy 1, policy_version 1644912 (0.0010) [2023-12-26 12:49:04,982][123090] Updated weights for policy 1, policy_version 1644922 (0.0007) [2023-12-26 12:49:05,431][123091] Updated weights for policy 0, policy_version 1655896 (0.0009) [2023-12-26 12:49:05,504][123091] Updated weights for policy 0, policy_version 1655906 (0.0009) [2023-12-26 12:49:05,572][123091] Updated weights for policy 0, policy_version 1655916 (0.0009) [2023-12-26 12:49:05,720][123090] Updated weights for policy 1, policy_version 1644932 (0.0008) [2023-12-26 12:49:05,776][123090] Updated weights for policy 1, policy_version 1644942 (0.0010) [2023-12-26 12:49:05,830][123090] Updated weights for policy 1, policy_version 1644952 (0.0006) [2023-12-26 12:49:06,363][123091] Updated weights for policy 0, policy_version 1655926 (0.0009) [2023-12-26 12:49:06,429][123091] Updated weights for policy 0, policy_version 1655936 (0.0010) [2023-12-26 12:49:06,504][123091] Updated weights for policy 0, policy_version 1655946 (0.0010) [2023-12-26 12:49:06,533][123090] Updated weights for policy 1, policy_version 1644962 (0.0006) [2023-12-26 12:49:06,589][123090] Updated weights for policy 1, policy_version 1644972 (0.0006) [2023-12-26 12:49:06,645][123090] Updated weights for policy 1, policy_version 1644982 (0.0005) [2023-12-26 12:49:06,712][123090] Updated weights for policy 1, policy_version 1644992 (0.0006) [2023-12-26 12:49:07,331][123091] Updated weights for policy 0, policy_version 1655956 (0.0008) [2023-12-26 12:49:07,394][123091] Updated weights for policy 0, policy_version 1655966 (0.0009) [2023-12-26 12:49:07,449][123091] Updated weights for policy 0, policy_version 1655976 (0.0010) [2023-12-26 12:49:07,508][123090] Updated weights for policy 1, policy_version 1645002 (0.0005) [2023-12-26 12:49:07,556][123090] Updated weights for policy 1, policy_version 1645012 (0.0005) [2023-12-26 12:49:07,601][123090] Updated weights for policy 1, policy_version 1645022 (0.0005) [2023-12-26 12:49:08,223][123091] Updated weights for policy 0, policy_version 1655986 (0.0009) [2023-12-26 12:49:08,276][123091] Updated weights for policy 0, policy_version 1655996 (0.0005) [2023-12-26 12:49:08,300][123090] Updated weights for policy 1, policy_version 1645032 (0.0008) [2023-12-26 12:49:08,344][123091] Updated weights for policy 0, policy_version 1656006 (0.0008) [2023-12-26 12:49:08,367][123090] Updated weights for policy 1, policy_version 1645042 (0.0012) [2023-12-26 12:49:08,410][123091] Updated weights for policy 0, policy_version 1656016 (0.0010) [2023-12-26 12:49:08,430][123090] Updated weights for policy 1, policy_version 1645052 (0.0008) [2023-12-26 12:49:08,785][121949] Fps is (10 sec: 18840.8, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 845078528. Throughput: 0: 8706.6, 1: 9038.8. Samples: 845051708. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:08,786][121949] Avg episode reward: [(0, '5818.254'), (1, '5448.869')] [2023-12-26 12:49:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001656016_423944192.pth... [2023-12-26 12:49:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001645056_421134336.pth... [2023-12-26 12:49:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001654992_423682048.pth [2023-12-26 12:49:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001644000_420864000.pth [2023-12-26 12:49:09,188][123091] Updated weights for policy 0, policy_version 1656026 (0.0011) [2023-12-26 12:49:09,198][123090] Updated weights for policy 1, policy_version 1645062 (0.0010) [2023-12-26 12:49:09,259][123091] Updated weights for policy 0, policy_version 1656036 (0.0010) [2023-12-26 12:49:09,264][123090] Updated weights for policy 1, policy_version 1645072 (0.0011) [2023-12-26 12:49:09,325][123090] Updated weights for policy 1, policy_version 1645082 (0.0010) [2023-12-26 12:49:09,327][123091] Updated weights for policy 0, policy_version 1656046 (0.0010) [2023-12-26 12:49:10,173][123091] Updated weights for policy 0, policy_version 1656056 (0.0010) [2023-12-26 12:49:10,228][123090] Updated weights for policy 1, policy_version 1645092 (0.0008) [2023-12-26 12:49:10,233][123091] Updated weights for policy 0, policy_version 1656066 (0.0011) [2023-12-26 12:49:10,280][123090] Updated weights for policy 1, policy_version 1645102 (0.0008) [2023-12-26 12:49:10,294][123091] Updated weights for policy 0, policy_version 1656076 (0.0011) [2023-12-26 12:49:10,350][123090] Updated weights for policy 1, policy_version 1645112 (0.0007) [2023-12-26 12:49:11,135][123091] Updated weights for policy 0, policy_version 1656086 (0.0011) [2023-12-26 12:49:11,202][123090] Updated weights for policy 1, policy_version 1645122 (0.0008) [2023-12-26 12:49:11,208][123091] Updated weights for policy 0, policy_version 1656096 (0.0011) [2023-12-26 12:49:11,274][123090] Updated weights for policy 1, policy_version 1645132 (0.0007) [2023-12-26 12:49:11,277][123091] Updated weights for policy 0, policy_version 1656106 (0.0013) [2023-12-26 12:49:11,344][123090] Updated weights for policy 1, policy_version 1645142 (0.0008) [2023-12-26 12:49:11,415][123090] Updated weights for policy 1, policy_version 1645152 (0.0009) [2023-12-26 12:49:12,124][123091] Updated weights for policy 0, policy_version 1656116 (0.0011) [2023-12-26 12:49:12,188][123091] Updated weights for policy 0, policy_version 1656126 (0.0008) [2023-12-26 12:49:12,191][123090] Updated weights for policy 1, policy_version 1645162 (0.0008) [2023-12-26 12:49:12,247][123091] Updated weights for policy 0, policy_version 1656136 (0.0009) [2023-12-26 12:49:12,249][123090] Updated weights for policy 1, policy_version 1645172 (0.0007) [2023-12-26 12:49:12,317][123090] Updated weights for policy 1, policy_version 1645182 (0.0010) [2023-12-26 12:49:13,014][123091] Updated weights for policy 0, policy_version 1656146 (0.0008) [2023-12-26 12:49:13,068][123091] Updated weights for policy 0, policy_version 1656156 (0.0007) [2023-12-26 12:49:13,120][123091] Updated weights for policy 0, policy_version 1656166 (0.0009) [2023-12-26 12:49:13,168][123091] Updated weights for policy 0, policy_version 1656176 (0.0009) [2023-12-26 12:49:13,246][123090] Updated weights for policy 1, policy_version 1645192 (0.0010) [2023-12-26 12:49:13,297][123090] Updated weights for policy 1, policy_version 1645202 (0.0009) [2023-12-26 12:49:13,348][123090] Updated weights for policy 1, policy_version 1645212 (0.0009) [2023-12-26 12:49:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 845160448. Throughput: 0: 8654.9, 1: 9004.4. Samples: 845154900. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:13,785][121949] Avg episode reward: [(0, '5841.547'), (1, '5448.973')] [2023-12-26 12:49:13,999][123091] Updated weights for policy 0, policy_version 1656186 (0.0005) [2023-12-26 12:49:14,051][123091] Updated weights for policy 0, policy_version 1656196 (0.0005) [2023-12-26 12:49:14,108][123091] Updated weights for policy 0, policy_version 1656206 (0.0005) [2023-12-26 12:49:14,229][123090] Updated weights for policy 1, policy_version 1645222 (0.0009) [2023-12-26 12:49:14,277][123090] Updated weights for policy 1, policy_version 1645232 (0.0009) [2023-12-26 12:49:14,329][123090] Updated weights for policy 1, policy_version 1645242 (0.0009) [2023-12-26 12:49:14,828][123091] Updated weights for policy 0, policy_version 1656216 (0.0008) [2023-12-26 12:49:14,895][123091] Updated weights for policy 0, policy_version 1656226 (0.0008) [2023-12-26 12:49:14,953][123091] Updated weights for policy 0, policy_version 1656236 (0.0009) [2023-12-26 12:49:15,229][123090] Updated weights for policy 1, policy_version 1645252 (0.0009) [2023-12-26 12:49:15,286][123090] Updated weights for policy 1, policy_version 1645262 (0.0010) [2023-12-26 12:49:15,343][123090] Updated weights for policy 1, policy_version 1645272 (0.0009) [2023-12-26 12:49:15,675][123091] Updated weights for policy 0, policy_version 1656246 (0.0008) [2023-12-26 12:49:15,727][123091] Updated weights for policy 0, policy_version 1656256 (0.0009) [2023-12-26 12:49:15,780][123091] Updated weights for policy 0, policy_version 1656266 (0.0008) [2023-12-26 12:49:16,241][123090] Updated weights for policy 1, policy_version 1645282 (0.0010) [2023-12-26 12:49:16,308][123090] Updated weights for policy 1, policy_version 1645292 (0.0010) [2023-12-26 12:49:16,376][123090] Updated weights for policy 1, policy_version 1645302 (0.0010) [2023-12-26 12:49:16,441][123090] Updated weights for policy 1, policy_version 1645312 (0.0009) [2023-12-26 12:49:16,458][123091] Updated weights for policy 0, policy_version 1656276 (0.0006) [2023-12-26 12:49:16,524][123091] Updated weights for policy 0, policy_version 1656286 (0.0010) [2023-12-26 12:49:16,586][123091] Updated weights for policy 0, policy_version 1656296 (0.0011) [2023-12-26 12:49:17,284][123091] Updated weights for policy 0, policy_version 1656306 (0.0010) [2023-12-26 12:49:17,334][123091] Updated weights for policy 0, policy_version 1656316 (0.0005) [2023-12-26 12:49:17,339][123090] Updated weights for policy 1, policy_version 1645322 (0.0009) [2023-12-26 12:49:17,387][123091] Updated weights for policy 0, policy_version 1656326 (0.0005) [2023-12-26 12:49:17,401][123090] Updated weights for policy 1, policy_version 1645332 (0.0009) [2023-12-26 12:49:17,433][123091] Updated weights for policy 0, policy_version 1656336 (0.0005) [2023-12-26 12:49:17,464][123090] Updated weights for policy 1, policy_version 1645342 (0.0009) [2023-12-26 12:49:18,128][123091] Updated weights for policy 0, policy_version 1656346 (0.0005) [2023-12-26 12:49:18,184][123091] Updated weights for policy 0, policy_version 1656356 (0.0005) [2023-12-26 12:49:18,239][123091] Updated weights for policy 0, policy_version 1656366 (0.0005) [2023-12-26 12:49:18,394][123090] Updated weights for policy 1, policy_version 1645352 (0.0009) [2023-12-26 12:49:18,459][123090] Updated weights for policy 1, policy_version 1645362 (0.0010) [2023-12-26 12:49:18,530][123090] Updated weights for policy 1, policy_version 1645372 (0.0009) [2023-12-26 12:49:18,784][121949] Fps is (10 sec: 17204.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 845250560. Throughput: 0: 8808.4, 1: 8821.6. Samples: 845261816. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:18,785][121949] Avg episode reward: [(0, '5952.565'), (1, '5493.657')] [2023-12-26 12:49:18,888][123091] Updated weights for policy 0, policy_version 1656376 (0.0009) [2023-12-26 12:49:18,940][123091] Updated weights for policy 0, policy_version 1656386 (0.0010) [2023-12-26 12:49:18,991][123091] Updated weights for policy 0, policy_version 1656396 (0.0010) [2023-12-26 12:49:19,405][123090] Updated weights for policy 1, policy_version 1645382 (0.0009) [2023-12-26 12:49:19,459][123090] Updated weights for policy 1, policy_version 1645392 (0.0010) [2023-12-26 12:49:19,527][123090] Updated weights for policy 1, policy_version 1645402 (0.0007) [2023-12-26 12:49:19,777][123091] Updated weights for policy 0, policy_version 1656406 (0.0011) [2023-12-26 12:49:19,848][123091] Updated weights for policy 0, policy_version 1656416 (0.0011) [2023-12-26 12:49:19,908][123091] Updated weights for policy 0, policy_version 1656426 (0.0011) [2023-12-26 12:49:20,367][123090] Updated weights for policy 1, policy_version 1645412 (0.0009) [2023-12-26 12:49:20,428][123090] Updated weights for policy 1, policy_version 1645422 (0.0009) [2023-12-26 12:49:20,490][123090] Updated weights for policy 1, policy_version 1645432 (0.0009) [2023-12-26 12:49:20,747][123091] Updated weights for policy 0, policy_version 1656436 (0.0010) [2023-12-26 12:49:20,807][123091] Updated weights for policy 0, policy_version 1656446 (0.0011) [2023-12-26 12:49:20,871][123091] Updated weights for policy 0, policy_version 1656456 (0.0011) [2023-12-26 12:49:21,353][123090] Updated weights for policy 1, policy_version 1645442 (0.0009) [2023-12-26 12:49:21,426][123090] Updated weights for policy 1, policy_version 1645452 (0.0007) [2023-12-26 12:49:21,501][123090] Updated weights for policy 1, policy_version 1645462 (0.0006) [2023-12-26 12:49:21,557][123090] Updated weights for policy 1, policy_version 1645472 (0.0006) [2023-12-26 12:49:21,742][123091] Updated weights for policy 0, policy_version 1656466 (0.0010) [2023-12-26 12:49:21,798][123091] Updated weights for policy 0, policy_version 1656476 (0.0009) [2023-12-26 12:49:21,849][123091] Updated weights for policy 0, policy_version 1656486 (0.0009) [2023-12-26 12:49:21,909][123091] Updated weights for policy 0, policy_version 1656496 (0.0008) [2023-12-26 12:49:22,318][123090] Updated weights for policy 1, policy_version 1645482 (0.0008) [2023-12-26 12:49:22,393][123090] Updated weights for policy 1, policy_version 1645492 (0.0008) [2023-12-26 12:49:22,453][123090] Updated weights for policy 1, policy_version 1645502 (0.0009) [2023-12-26 12:49:22,738][123091] Updated weights for policy 0, policy_version 1656506 (0.0009) [2023-12-26 12:49:22,800][123091] Updated weights for policy 0, policy_version 1656516 (0.0008) [2023-12-26 12:49:22,858][123091] Updated weights for policy 0, policy_version 1656526 (0.0005) [2023-12-26 12:49:23,292][123090] Updated weights for policy 1, policy_version 1645512 (0.0010) [2023-12-26 12:49:23,352][123090] Updated weights for policy 1, policy_version 1645522 (0.0011) [2023-12-26 12:49:23,419][123090] Updated weights for policy 1, policy_version 1645532 (0.0011) [2023-12-26 12:49:23,531][123091] Updated weights for policy 0, policy_version 1656536 (0.0005) [2023-12-26 12:49:23,589][123091] Updated weights for policy 0, policy_version 1656546 (0.0009) [2023-12-26 12:49:23,644][123091] Updated weights for policy 0, policy_version 1656556 (0.0010) [2023-12-26 12:49:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 845340672. Throughput: 0: 8774.2, 1: 8774.6. Samples: 845313304. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:23,785][121949] Avg episode reward: [(0, '5985.924'), (1, '5724.270')] [2023-12-26 12:49:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001656560_424083456.pth... [2023-12-26 12:49:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001645536_421257216.pth... [2023-12-26 12:49:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001655504_423813120.pth [2023-12-26 12:49:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001644512_420995072.pth [2023-12-26 12:49:24,244][123090] Updated weights for policy 1, policy_version 1645542 (0.0010) [2023-12-26 12:49:24,292][123090] Updated weights for policy 1, policy_version 1645552 (0.0010) [2023-12-26 12:49:24,344][123090] Updated weights for policy 1, policy_version 1645562 (0.0010) [2023-12-26 12:49:24,413][123091] Updated weights for policy 0, policy_version 1656566 (0.0007) [2023-12-26 12:49:24,469][123091] Updated weights for policy 0, policy_version 1656576 (0.0009) [2023-12-26 12:49:24,532][123091] Updated weights for policy 0, policy_version 1656586 (0.0008) [2023-12-26 12:49:25,196][123090] Updated weights for policy 1, policy_version 1645572 (0.0010) [2023-12-26 12:49:25,260][123090] Updated weights for policy 1, policy_version 1645582 (0.0011) [2023-12-26 12:49:25,324][123090] Updated weights for policy 1, policy_version 1645592 (0.0011) [2023-12-26 12:49:25,366][123091] Updated weights for policy 0, policy_version 1656596 (0.0007) [2023-12-26 12:49:25,431][123091] Updated weights for policy 0, policy_version 1656606 (0.0006) [2023-12-26 12:49:25,503][123091] Updated weights for policy 0, policy_version 1656616 (0.0005) [2023-12-26 12:49:26,017][123090] Updated weights for policy 1, policy_version 1645602 (0.0011) [2023-12-26 12:49:26,085][123090] Updated weights for policy 1, policy_version 1645612 (0.0006) [2023-12-26 12:49:26,148][123090] Updated weights for policy 1, policy_version 1645622 (0.0005) [2023-12-26 12:49:26,212][123090] Updated weights for policy 1, policy_version 1645632 (0.0005) [2023-12-26 12:49:26,272][123091] Updated weights for policy 0, policy_version 1656626 (0.0006) [2023-12-26 12:49:26,335][123091] Updated weights for policy 0, policy_version 1656636 (0.0009) [2023-12-26 12:49:26,404][123091] Updated weights for policy 0, policy_version 1656646 (0.0009) [2023-12-26 12:49:26,456][123091] Updated weights for policy 0, policy_version 1656656 (0.0009) [2023-12-26 12:49:26,990][123090] Updated weights for policy 1, policy_version 1645642 (0.0005) [2023-12-26 12:49:27,045][123090] Updated weights for policy 1, policy_version 1645652 (0.0005) [2023-12-26 12:49:27,099][123090] Updated weights for policy 1, policy_version 1645662 (0.0005) [2023-12-26 12:49:27,155][123091] Updated weights for policy 0, policy_version 1656666 (0.0008) [2023-12-26 12:49:27,211][123091] Updated weights for policy 0, policy_version 1656676 (0.0009) [2023-12-26 12:49:27,262][123091] Updated weights for policy 0, policy_version 1656686 (0.0009) [2023-12-26 12:49:27,815][123090] Updated weights for policy 1, policy_version 1645672 (0.0008) [2023-12-26 12:49:27,882][123090] Updated weights for policy 1, policy_version 1645682 (0.0009) [2023-12-26 12:49:27,936][123090] Updated weights for policy 1, policy_version 1645692 (0.0010) [2023-12-26 12:49:28,038][123091] Updated weights for policy 0, policy_version 1656696 (0.0010) [2023-12-26 12:49:28,093][123091] Updated weights for policy 0, policy_version 1656706 (0.0010) [2023-12-26 12:49:28,147][123091] Updated weights for policy 0, policy_version 1656716 (0.0010) [2023-12-26 12:49:28,692][123090] Updated weights for policy 1, policy_version 1645702 (0.0007) [2023-12-26 12:49:28,766][123090] Updated weights for policy 1, policy_version 1645712 (0.0005) [2023-12-26 12:49:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 845422592. Throughput: 0: 8873.5, 1: 8820.6. Samples: 845421332. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:28,784][121949] Avg episode reward: [(0, '5929.426'), (1, '5495.378')] [2023-12-26 12:49:28,829][123090] Updated weights for policy 1, policy_version 1645722 (0.0005) [2023-12-26 12:49:28,835][123091] Updated weights for policy 0, policy_version 1656726 (0.0007) [2023-12-26 12:49:28,889][123091] Updated weights for policy 0, policy_version 1656736 (0.0005) [2023-12-26 12:49:28,935][123091] Updated weights for policy 0, policy_version 1656746 (0.0005) [2023-12-26 12:49:29,500][123090] Updated weights for policy 1, policy_version 1645732 (0.0007) [2023-12-26 12:49:29,574][123090] Updated weights for policy 1, policy_version 1645742 (0.0008) [2023-12-26 12:49:29,629][123091] Updated weights for policy 0, policy_version 1656756 (0.0006) [2023-12-26 12:49:29,646][123090] Updated weights for policy 1, policy_version 1645752 (0.0009) [2023-12-26 12:49:29,697][123091] Updated weights for policy 0, policy_version 1656766 (0.0007) [2023-12-26 12:49:29,758][123091] Updated weights for policy 0, policy_version 1656776 (0.0005) [2023-12-26 12:49:30,326][123090] Updated weights for policy 1, policy_version 1645762 (0.0006) [2023-12-26 12:49:30,382][123090] Updated weights for policy 1, policy_version 1645772 (0.0005) [2023-12-26 12:49:30,435][123090] Updated weights for policy 1, policy_version 1645782 (0.0007) [2023-12-26 12:49:30,436][123091] Updated weights for policy 0, policy_version 1656786 (0.0006) [2023-12-26 12:49:30,492][123091] Updated weights for policy 0, policy_version 1656796 (0.0011) [2023-12-26 12:49:30,494][123090] Updated weights for policy 1, policy_version 1645792 (0.0006) [2023-12-26 12:49:30,549][123091] Updated weights for policy 0, policy_version 1656806 (0.0010) [2023-12-26 12:49:30,604][123091] Updated weights for policy 0, policy_version 1656816 (0.0010) [2023-12-26 12:49:31,215][123090] Updated weights for policy 1, policy_version 1645802 (0.0010) [2023-12-26 12:49:31,275][123090] Updated weights for policy 1, policy_version 1645813 (0.0010) [2023-12-26 12:49:31,327][123090] Updated weights for policy 1, policy_version 1645823 (0.0008) [2023-12-26 12:49:31,348][123091] Updated weights for policy 0, policy_version 1656826 (0.0009) [2023-12-26 12:49:31,412][123091] Updated weights for policy 0, policy_version 1656836 (0.0011) [2023-12-26 12:49:31,476][123091] Updated weights for policy 0, policy_version 1656846 (0.0011) [2023-12-26 12:49:32,192][123090] Updated weights for policy 1, policy_version 1645833 (0.0009) [2023-12-26 12:49:32,250][123090] Updated weights for policy 1, policy_version 1645843 (0.0009) [2023-12-26 12:49:32,291][123091] Updated weights for policy 0, policy_version 1656856 (0.0007) [2023-12-26 12:49:32,308][123090] Updated weights for policy 1, policy_version 1645853 (0.0007) [2023-12-26 12:49:32,353][123091] Updated weights for policy 0, policy_version 1656866 (0.0009) [2023-12-26 12:49:32,411][123091] Updated weights for policy 0, policy_version 1656876 (0.0007) [2023-12-26 12:49:33,142][123091] Updated weights for policy 0, policy_version 1656886 (0.0008) [2023-12-26 12:49:33,167][123090] Updated weights for policy 1, policy_version 1645863 (0.0007) [2023-12-26 12:49:33,189][123091] Updated weights for policy 0, policy_version 1656896 (0.0010) [2023-12-26 12:49:33,218][123090] Updated weights for policy 1, policy_version 1645873 (0.0005) [2023-12-26 12:49:33,239][123091] Updated weights for policy 0, policy_version 1656906 (0.0010) [2023-12-26 12:49:33,280][123090] Updated weights for policy 1, policy_version 1645883 (0.0007) [2023-12-26 12:49:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 845520896. Throughput: 0: 9039.4, 1: 8802.8. Samples: 845532408. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:33,785][121949] Avg episode reward: [(0, '6051.694'), (1, '5582.277')] [2023-12-26 12:49:33,903][123091] Updated weights for policy 0, policy_version 1656916 (0.0005) [2023-12-26 12:49:33,954][123091] Updated weights for policy 0, policy_version 1656926 (0.0005) [2023-12-26 12:49:34,017][123091] Updated weights for policy 0, policy_version 1656936 (0.0005) [2023-12-26 12:49:34,204][123090] Updated weights for policy 1, policy_version 1645893 (0.0009) [2023-12-26 12:49:34,266][123090] Updated weights for policy 1, policy_version 1645903 (0.0009) [2023-12-26 12:49:34,335][123090] Updated weights for policy 1, policy_version 1645913 (0.0009) [2023-12-26 12:49:34,813][123091] Updated weights for policy 0, policy_version 1656946 (0.0006) [2023-12-26 12:49:34,864][123091] Updated weights for policy 0, policy_version 1656956 (0.0010) [2023-12-26 12:49:34,912][123091] Updated weights for policy 0, policy_version 1656966 (0.0008) [2023-12-26 12:49:34,961][123091] Updated weights for policy 0, policy_version 1656976 (0.0009) [2023-12-26 12:49:35,124][123090] Updated weights for policy 1, policy_version 1645923 (0.0009) [2023-12-26 12:49:35,192][123090] Updated weights for policy 1, policy_version 1645933 (0.0009) [2023-12-26 12:49:35,257][123090] Updated weights for policy 1, policy_version 1645943 (0.0009) [2023-12-26 12:49:35,784][123091] Updated weights for policy 0, policy_version 1656986 (0.0011) [2023-12-26 12:49:35,844][123091] Updated weights for policy 0, policy_version 1656996 (0.0011) [2023-12-26 12:49:35,908][123091] Updated weights for policy 0, policy_version 1657006 (0.0011) [2023-12-26 12:49:36,122][123090] Updated weights for policy 1, policy_version 1645953 (0.0009) [2023-12-26 12:49:36,187][123090] Updated weights for policy 1, policy_version 1645963 (0.0009) [2023-12-26 12:49:36,254][123090] Updated weights for policy 1, policy_version 1645973 (0.0009) [2023-12-26 12:49:36,312][123090] Updated weights for policy 1, policy_version 1645983 (0.0009) [2023-12-26 12:49:36,745][123091] Updated weights for policy 0, policy_version 1657016 (0.0011) [2023-12-26 12:49:36,804][123091] Updated weights for policy 0, policy_version 1657026 (0.0010) [2023-12-26 12:49:36,870][123091] Updated weights for policy 0, policy_version 1657036 (0.0011) [2023-12-26 12:49:37,132][123090] Updated weights for policy 1, policy_version 1645993 (0.0008) [2023-12-26 12:49:37,195][123090] Updated weights for policy 1, policy_version 1646003 (0.0009) [2023-12-26 12:49:37,269][123090] Updated weights for policy 1, policy_version 1646013 (0.0010) [2023-12-26 12:49:37,694][123091] Updated weights for policy 0, policy_version 1657046 (0.0011) [2023-12-26 12:49:37,754][123091] Updated weights for policy 0, policy_version 1657056 (0.0011) [2023-12-26 12:49:37,814][123091] Updated weights for policy 0, policy_version 1657066 (0.0011) [2023-12-26 12:49:38,058][123090] Updated weights for policy 1, policy_version 1646023 (0.0010) [2023-12-26 12:49:38,123][123090] Updated weights for policy 1, policy_version 1646033 (0.0009) [2023-12-26 12:49:38,192][123090] Updated weights for policy 1, policy_version 1646043 (0.0008) [2023-12-26 12:49:38,655][123091] Updated weights for policy 0, policy_version 1657076 (0.0011) [2023-12-26 12:49:38,718][123091] Updated weights for policy 0, policy_version 1657086 (0.0011) [2023-12-26 12:49:38,777][123091] Updated weights for policy 0, policy_version 1657096 (0.0011) [2023-12-26 12:49:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 845602816. Throughput: 0: 9064.9, 1: 8775.8. Samples: 845584028. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:38,785][121949] Avg episode reward: [(0, '6007.111'), (1, '5769.587')] [2023-12-26 12:49:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001646048_421388288.pth... [2023-12-26 12:49:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001645056_421134336.pth [2023-12-26 12:49:38,829][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001657104_424222720.pth... [2023-12-26 12:49:38,834][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001656016_423944192.pth [2023-12-26 12:49:38,989][123090] Updated weights for policy 1, policy_version 1646053 (0.0008) [2023-12-26 12:49:39,040][123090] Updated weights for policy 1, policy_version 1646063 (0.0006) [2023-12-26 12:49:39,098][123090] Updated weights for policy 1, policy_version 1646073 (0.0005) [2023-12-26 12:49:39,607][123091] Updated weights for policy 0, policy_version 1657106 (0.0011) [2023-12-26 12:49:39,671][123091] Updated weights for policy 0, policy_version 1657116 (0.0011) [2023-12-26 12:49:39,719][123091] Updated weights for policy 0, policy_version 1657126 (0.0011) [2023-12-26 12:49:39,779][123091] Updated weights for policy 0, policy_version 1657136 (0.0011) [2023-12-26 12:49:39,887][123090] Updated weights for policy 1, policy_version 1646083 (0.0006) [2023-12-26 12:49:39,959][123090] Updated weights for policy 1, policy_version 1646093 (0.0008) [2023-12-26 12:49:40,026][123090] Updated weights for policy 1, policy_version 1646103 (0.0009) [2023-12-26 12:49:40,618][123091] Updated weights for policy 0, policy_version 1657146 (0.0006) [2023-12-26 12:49:40,681][123090] Updated weights for policy 1, policy_version 1646113 (0.0008) [2023-12-26 12:49:40,691][123091] Updated weights for policy 0, policy_version 1657156 (0.0006) [2023-12-26 12:49:40,748][123090] Updated weights for policy 1, policy_version 1646123 (0.0007) [2023-12-26 12:49:40,756][123091] Updated weights for policy 0, policy_version 1657166 (0.0006) [2023-12-26 12:49:40,809][123090] Updated weights for policy 1, policy_version 1646133 (0.0005) [2023-12-26 12:49:40,870][123090] Updated weights for policy 1, policy_version 1646143 (0.0006) [2023-12-26 12:49:41,459][123091] Updated weights for policy 0, policy_version 1657176 (0.0006) [2023-12-26 12:49:41,529][123091] Updated weights for policy 0, policy_version 1657186 (0.0006) [2023-12-26 12:49:41,596][123091] Updated weights for policy 0, policy_version 1657196 (0.0009) [2023-12-26 12:49:41,704][123090] Updated weights for policy 1, policy_version 1646153 (0.0010) [2023-12-26 12:49:41,777][123090] Updated weights for policy 1, policy_version 1646163 (0.0011) [2023-12-26 12:49:41,833][123090] Updated weights for policy 1, policy_version 1646173 (0.0009) [2023-12-26 12:49:42,410][123091] Updated weights for policy 0, policy_version 1657207 (0.0009) [2023-12-26 12:49:42,469][123091] Updated weights for policy 0, policy_version 1657217 (0.0011) [2023-12-26 12:49:42,529][123091] Updated weights for policy 0, policy_version 1657227 (0.0011) [2023-12-26 12:49:42,728][123090] Updated weights for policy 1, policy_version 1646183 (0.0009) [2023-12-26 12:49:42,796][123090] Updated weights for policy 1, policy_version 1646193 (0.0009) [2023-12-26 12:49:42,861][123090] Updated weights for policy 1, policy_version 1646203 (0.0008) [2023-12-26 12:49:43,325][123091] Updated weights for policy 0, policy_version 1657237 (0.0011) [2023-12-26 12:49:43,377][123091] Updated weights for policy 0, policy_version 1657247 (0.0011) [2023-12-26 12:49:43,439][123091] Updated weights for policy 0, policy_version 1657257 (0.0008) [2023-12-26 12:49:43,632][123090] Updated weights for policy 1, policy_version 1646213 (0.0009) [2023-12-26 12:49:43,691][123090] Updated weights for policy 1, policy_version 1646223 (0.0007) [2023-12-26 12:49:43,759][123090] Updated weights for policy 1, policy_version 1646233 (0.0005) [2023-12-26 12:49:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 845692928. Throughput: 0: 9060.5, 1: 8706.8. Samples: 845689064. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:43,785][121949] Avg episode reward: [(0, '6078.068'), (1, '5350.339')] [2023-12-26 12:49:44,131][123091] Updated weights for policy 0, policy_version 1657267 (0.0011) [2023-12-26 12:49:44,196][123091] Updated weights for policy 0, policy_version 1657277 (0.0007) [2023-12-26 12:49:44,256][123091] Updated weights for policy 0, policy_version 1657287 (0.0008) [2023-12-26 12:49:44,514][123090] Updated weights for policy 1, policy_version 1646243 (0.0007) [2023-12-26 12:49:44,582][123090] Updated weights for policy 1, policy_version 1646253 (0.0011) [2023-12-26 12:49:44,642][123090] Updated weights for policy 1, policy_version 1646263 (0.0010) [2023-12-26 12:49:44,939][123091] Updated weights for policy 0, policy_version 1657297 (0.0005) [2023-12-26 12:49:44,995][123091] Updated weights for policy 0, policy_version 1657307 (0.0005) [2023-12-26 12:49:45,046][123091] Updated weights for policy 0, policy_version 1657317 (0.0005) [2023-12-26 12:49:45,094][123091] Updated weights for policy 0, policy_version 1657327 (0.0006) [2023-12-26 12:49:45,364][123090] Updated weights for policy 1, policy_version 1646273 (0.0011) [2023-12-26 12:49:45,424][123090] Updated weights for policy 1, policy_version 1646283 (0.0011) [2023-12-26 12:49:45,480][123090] Updated weights for policy 1, policy_version 1646293 (0.0011) [2023-12-26 12:49:45,544][123090] Updated weights for policy 1, policy_version 1646303 (0.0011) [2023-12-26 12:49:45,763][123091] Updated weights for policy 0, policy_version 1657337 (0.0005) [2023-12-26 12:49:45,812][123091] Updated weights for policy 0, policy_version 1657347 (0.0005) [2023-12-26 12:49:45,864][123091] Updated weights for policy 0, policy_version 1657357 (0.0005) [2023-12-26 12:49:46,373][123090] Updated weights for policy 1, policy_version 1646313 (0.0010) [2023-12-26 12:49:46,439][123090] Updated weights for policy 1, policy_version 1646323 (0.0010) [2023-12-26 12:49:46,503][123090] Updated weights for policy 1, policy_version 1646333 (0.0011) [2023-12-26 12:49:46,636][123091] Updated weights for policy 0, policy_version 1657367 (0.0009) [2023-12-26 12:49:46,699][123091] Updated weights for policy 0, policy_version 1657377 (0.0010) [2023-12-26 12:49:46,760][123091] Updated weights for policy 0, policy_version 1657387 (0.0009) [2023-12-26 12:49:47,300][123090] Updated weights for policy 1, policy_version 1646343 (0.0009) [2023-12-26 12:49:47,352][123090] Updated weights for policy 1, policy_version 1646353 (0.0005) [2023-12-26 12:49:47,394][123091] Updated weights for policy 0, policy_version 1657397 (0.0007) [2023-12-26 12:49:47,402][123090] Updated weights for policy 1, policy_version 1646363 (0.0005) [2023-12-26 12:49:47,446][123091] Updated weights for policy 0, policy_version 1657407 (0.0008) [2023-12-26 12:49:47,506][123091] Updated weights for policy 0, policy_version 1657417 (0.0006) [2023-12-26 12:49:48,172][123090] Updated weights for policy 1, policy_version 1646373 (0.0008) [2023-12-26 12:49:48,190][123091] Updated weights for policy 0, policy_version 1657427 (0.0006) [2023-12-26 12:49:48,227][123090] Updated weights for policy 1, policy_version 1646383 (0.0010) [2023-12-26 12:49:48,240][123091] Updated weights for policy 0, policy_version 1657437 (0.0010) [2023-12-26 12:49:48,276][123090] Updated weights for policy 1, policy_version 1646393 (0.0010) [2023-12-26 12:49:48,288][123091] Updated weights for policy 0, policy_version 1657447 (0.0010) [2023-12-26 12:49:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 845791232. Throughput: 0: 9185.5, 1: 8723.2. Samples: 845802424. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:48,785][121949] Avg episode reward: [(0, '6032.452'), (1, '5384.501')] [2023-12-26 12:49:49,001][123091] Updated weights for policy 0, policy_version 1657457 (0.0010) [2023-12-26 12:49:49,063][123091] Updated weights for policy 0, policy_version 1657467 (0.0006) [2023-12-26 12:49:49,117][123091] Updated weights for policy 0, policy_version 1657477 (0.0006) [2023-12-26 12:49:49,129][123090] Updated weights for policy 1, policy_version 1646403 (0.0010) [2023-12-26 12:49:49,176][123091] Updated weights for policy 0, policy_version 1657487 (0.0007) [2023-12-26 12:49:49,192][123090] Updated weights for policy 1, policy_version 1646413 (0.0010) [2023-12-26 12:49:49,261][123090] Updated weights for policy 1, policy_version 1646423 (0.0011) [2023-12-26 12:49:49,984][123091] Updated weights for policy 0, policy_version 1657497 (0.0009) [2023-12-26 12:49:50,062][123091] Updated weights for policy 0, policy_version 1657507 (0.0009) [2023-12-26 12:49:50,077][123090] Updated weights for policy 1, policy_version 1646433 (0.0011) [2023-12-26 12:49:50,133][123091] Updated weights for policy 0, policy_version 1657517 (0.0007) [2023-12-26 12:49:50,144][123090] Updated weights for policy 1, policy_version 1646443 (0.0007) [2023-12-26 12:49:50,204][123090] Updated weights for policy 1, policy_version 1646453 (0.0008) [2023-12-26 12:49:50,262][123090] Updated weights for policy 1, policy_version 1646463 (0.0006) [2023-12-26 12:49:50,963][123091] Updated weights for policy 0, policy_version 1657527 (0.0008) [2023-12-26 12:49:51,033][123091] Updated weights for policy 0, policy_version 1657537 (0.0009) [2023-12-26 12:49:51,082][123090] Updated weights for policy 1, policy_version 1646473 (0.0008) [2023-12-26 12:49:51,092][123091] Updated weights for policy 0, policy_version 1657547 (0.0008) [2023-12-26 12:49:51,152][123090] Updated weights for policy 1, policy_version 1646483 (0.0006) [2023-12-26 12:49:51,217][123090] Updated weights for policy 1, policy_version 1646493 (0.0005) [2023-12-26 12:49:51,889][123091] Updated weights for policy 0, policy_version 1657557 (0.0007) [2023-12-26 12:49:51,954][123090] Updated weights for policy 1, policy_version 1646503 (0.0008) [2023-12-26 12:49:51,957][123091] Updated weights for policy 0, policy_version 1657567 (0.0006) [2023-12-26 12:49:52,025][123090] Updated weights for policy 1, policy_version 1646513 (0.0008) [2023-12-26 12:49:52,031][123091] Updated weights for policy 0, policy_version 1657577 (0.0007) [2023-12-26 12:49:52,092][123090] Updated weights for policy 1, policy_version 1646523 (0.0007) [2023-12-26 12:49:52,761][123091] Updated weights for policy 0, policy_version 1657587 (0.0007) [2023-12-26 12:49:52,820][123091] Updated weights for policy 0, policy_version 1657597 (0.0006) [2023-12-26 12:49:52,883][123090] Updated weights for policy 1, policy_version 1646533 (0.0008) [2023-12-26 12:49:52,885][123091] Updated weights for policy 0, policy_version 1657607 (0.0010) [2023-12-26 12:49:52,943][123090] Updated weights for policy 1, policy_version 1646543 (0.0007) [2023-12-26 12:49:53,007][123090] Updated weights for policy 1, policy_version 1646553 (0.0009) [2023-12-26 12:49:53,682][123091] Updated weights for policy 0, policy_version 1657617 (0.0008) [2023-12-26 12:49:53,751][123091] Updated weights for policy 0, policy_version 1657627 (0.0009) [2023-12-26 12:49:53,767][123090] Updated weights for policy 1, policy_version 1646563 (0.0010) [2023-12-26 12:49:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 845873152. Throughput: 0: 9202.3, 1: 8659.8. Samples: 845855496. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:53,785][121949] Avg episode reward: [(0, '5853.462'), (1, '5303.081')] [2023-12-26 12:49:53,809][123091] Updated weights for policy 0, policy_version 1657637 (0.0009) [2023-12-26 12:49:53,815][123090] Updated weights for policy 1, policy_version 1646573 (0.0010) [2023-12-26 12:49:53,867][123091] Updated weights for policy 0, policy_version 1657647 (0.0006) [2023-12-26 12:49:53,872][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001657648_424361984.pth... [2023-12-26 12:49:53,878][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001656560_424083456.pth [2023-12-26 12:49:53,879][123090] Updated weights for policy 1, policy_version 1646583 (0.0011) [2023-12-26 12:49:53,931][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001646592_421527552.pth... [2023-12-26 12:49:53,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001645536_421257216.pth [2023-12-26 12:49:54,587][123091] Updated weights for policy 0, policy_version 1657657 (0.0005) [2023-12-26 12:49:54,650][123091] Updated weights for policy 0, policy_version 1657667 (0.0005) [2023-12-26 12:49:54,720][123091] Updated weights for policy 0, policy_version 1657677 (0.0008) [2023-12-26 12:49:54,728][123090] Updated weights for policy 1, policy_version 1646593 (0.0010) [2023-12-26 12:49:54,790][123090] Updated weights for policy 1, policy_version 1646603 (0.0010) [2023-12-26 12:49:54,841][123090] Updated weights for policy 1, policy_version 1646613 (0.0010) [2023-12-26 12:49:54,901][123090] Updated weights for policy 1, policy_version 1646623 (0.0010) [2023-12-26 12:49:55,387][123091] Updated weights for policy 0, policy_version 1657687 (0.0009) [2023-12-26 12:49:55,438][123091] Updated weights for policy 0, policy_version 1657697 (0.0009) [2023-12-26 12:49:55,486][123091] Updated weights for policy 0, policy_version 1657707 (0.0008) [2023-12-26 12:49:55,732][123090] Updated weights for policy 1, policy_version 1646633 (0.0011) [2023-12-26 12:49:55,789][123090] Updated weights for policy 1, policy_version 1646643 (0.0008) [2023-12-26 12:49:55,848][123090] Updated weights for policy 1, policy_version 1646653 (0.0005) [2023-12-26 12:49:56,362][123091] Updated weights for policy 0, policy_version 1657717 (0.0009) [2023-12-26 12:49:56,413][123091] Updated weights for policy 0, policy_version 1657727 (0.0009) [2023-12-26 12:49:56,465][123091] Updated weights for policy 0, policy_version 1657737 (0.0009) [2023-12-26 12:49:56,545][123090] Updated weights for policy 1, policy_version 1646663 (0.0009) [2023-12-26 12:49:56,608][123090] Updated weights for policy 1, policy_version 1646673 (0.0010) [2023-12-26 12:49:56,655][123090] Updated weights for policy 1, policy_version 1646683 (0.0010) [2023-12-26 12:49:57,337][123091] Updated weights for policy 0, policy_version 1657748 (0.0008) [2023-12-26 12:49:57,403][123091] Updated weights for policy 0, policy_version 1657758 (0.0005) [2023-12-26 12:49:57,466][123090] Updated weights for policy 1, policy_version 1646693 (0.0010) [2023-12-26 12:49:57,475][123091] Updated weights for policy 0, policy_version 1657768 (0.0005) [2023-12-26 12:49:57,513][123090] Updated weights for policy 1, policy_version 1646703 (0.0010) [2023-12-26 12:49:57,561][123090] Updated weights for policy 1, policy_version 1646713 (0.0010) [2023-12-26 12:49:58,123][123091] Updated weights for policy 0, policy_version 1657778 (0.0006) [2023-12-26 12:49:58,192][123091] Updated weights for policy 0, policy_version 1657788 (0.0009) [2023-12-26 12:49:58,257][123091] Updated weights for policy 0, policy_version 1657798 (0.0009) [2023-12-26 12:49:58,333][123091] Updated weights for policy 0, policy_version 1657808 (0.0009) [2023-12-26 12:49:58,436][123090] Updated weights for policy 1, policy_version 1646723 (0.0010) [2023-12-26 12:49:58,516][123090] Updated weights for policy 1, policy_version 1646733 (0.0008) [2023-12-26 12:49:58,579][123090] Updated weights for policy 1, policy_version 1646743 (0.0010) [2023-12-26 12:49:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 845971456. Throughput: 0: 9261.9, 1: 8693.0. Samples: 845962872. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:49:58,785][121949] Avg episode reward: [(0, '5952.922'), (1, '5283.887')] [2023-12-26 12:49:59,189][123091] Updated weights for policy 0, policy_version 1657818 (0.0009) [2023-12-26 12:49:59,246][123091] Updated weights for policy 0, policy_version 1657828 (0.0006) [2023-12-26 12:49:59,307][123091] Updated weights for policy 0, policy_version 1657838 (0.0006) [2023-12-26 12:49:59,412][123090] Updated weights for policy 1, policy_version 1646753 (0.0009) [2023-12-26 12:49:59,464][123090] Updated weights for policy 1, policy_version 1646763 (0.0008) [2023-12-26 12:49:59,512][123090] Updated weights for policy 1, policy_version 1646773 (0.0009) [2023-12-26 12:49:59,562][123090] Updated weights for policy 1, policy_version 1646783 (0.0009) [2023-12-26 12:50:00,060][123091] Updated weights for policy 0, policy_version 1657848 (0.0010) [2023-12-26 12:50:00,112][123091] Updated weights for policy 0, policy_version 1657858 (0.0009) [2023-12-26 12:50:00,161][123091] Updated weights for policy 0, policy_version 1657868 (0.0009) [2023-12-26 12:50:00,427][123090] Updated weights for policy 1, policy_version 1646793 (0.0009) [2023-12-26 12:50:00,480][123090] Updated weights for policy 1, policy_version 1646803 (0.0007) [2023-12-26 12:50:00,537][123090] Updated weights for policy 1, policy_version 1646813 (0.0005) [2023-12-26 12:50:01,072][123091] Updated weights for policy 0, policy_version 1657878 (0.0010) [2023-12-26 12:50:01,132][123091] Updated weights for policy 0, policy_version 1657888 (0.0009) [2023-12-26 12:50:01,187][123091] Updated weights for policy 0, policy_version 1657898 (0.0009) [2023-12-26 12:50:01,277][123090] Updated weights for policy 1, policy_version 1646823 (0.0009) [2023-12-26 12:50:01,322][123090] Updated weights for policy 1, policy_version 1646833 (0.0010) [2023-12-26 12:50:01,387][123090] Updated weights for policy 1, policy_version 1646843 (0.0010) [2023-12-26 12:50:02,127][123091] Updated weights for policy 0, policy_version 1657909 (0.0010) [2023-12-26 12:50:02,142][123090] Updated weights for policy 1, policy_version 1646853 (0.0010) [2023-12-26 12:50:02,175][123091] Updated weights for policy 0, policy_version 1657919 (0.0006) [2023-12-26 12:50:02,206][123090] Updated weights for policy 1, policy_version 1646863 (0.0010) [2023-12-26 12:50:02,221][123091] Updated weights for policy 0, policy_version 1657929 (0.0009) [2023-12-26 12:50:02,274][123090] Updated weights for policy 1, policy_version 1646873 (0.0011) [2023-12-26 12:50:03,004][123091] Updated weights for policy 0, policy_version 1657939 (0.0006) [2023-12-26 12:50:03,050][123090] Updated weights for policy 1, policy_version 1646883 (0.0009) [2023-12-26 12:50:03,075][123091] Updated weights for policy 0, policy_version 1657949 (0.0007) [2023-12-26 12:50:03,119][123090] Updated weights for policy 1, policy_version 1646893 (0.0006) [2023-12-26 12:50:03,123][123091] Updated weights for policy 0, policy_version 1657959 (0.0009) [2023-12-26 12:50:03,175][123090] Updated weights for policy 1, policy_version 1646903 (0.0005) [2023-12-26 12:50:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 846053376. Throughput: 0: 9093.6, 1: 8829.2. Samples: 846068344. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:50:03,784][121949] Avg episode reward: [(0, '6153.188'), (1, '5375.774')] [2023-12-26 12:50:03,847][123091] Updated weights for policy 0, policy_version 1657969 (0.0008) [2023-12-26 12:50:03,852][123090] Updated weights for policy 1, policy_version 1646913 (0.0006) [2023-12-26 12:50:03,903][123091] Updated weights for policy 0, policy_version 1657979 (0.0007) [2023-12-26 12:50:03,920][123090] Updated weights for policy 1, policy_version 1646923 (0.0009) [2023-12-26 12:50:03,952][123091] Updated weights for policy 0, policy_version 1657989 (0.0008) [2023-12-26 12:50:03,981][123090] Updated weights for policy 1, policy_version 1646933 (0.0009) [2023-12-26 12:50:04,001][123091] Updated weights for policy 0, policy_version 1657999 (0.0007) [2023-12-26 12:50:04,044][123090] Updated weights for policy 1, policy_version 1646943 (0.0009) [2023-12-26 12:50:04,751][123090] Updated weights for policy 1, policy_version 1646953 (0.0005) [2023-12-26 12:50:04,804][123090] Updated weights for policy 1, policy_version 1646963 (0.0005) [2023-12-26 12:50:04,880][123090] Updated weights for policy 1, policy_version 1646973 (0.0006) [2023-12-26 12:50:04,905][123091] Updated weights for policy 0, policy_version 1658009 (0.0007) [2023-12-26 12:50:04,953][123091] Updated weights for policy 0, policy_version 1658019 (0.0009) [2023-12-26 12:50:05,004][123091] Updated weights for policy 0, policy_version 1658029 (0.0009) [2023-12-26 12:50:05,542][123090] Updated weights for policy 1, policy_version 1646983 (0.0007) [2023-12-26 12:50:05,606][123090] Updated weights for policy 1, policy_version 1646993 (0.0005) [2023-12-26 12:50:05,689][123090] Updated weights for policy 1, policy_version 1647003 (0.0006) [2023-12-26 12:50:05,719][123091] Updated weights for policy 0, policy_version 1658039 (0.0007) [2023-12-26 12:50:05,786][123091] Updated weights for policy 0, policy_version 1658049 (0.0006) [2023-12-26 12:50:05,856][123091] Updated weights for policy 0, policy_version 1658059 (0.0007) [2023-12-26 12:50:06,442][123090] Updated weights for policy 1, policy_version 1647013 (0.0009) [2023-12-26 12:50:06,509][123090] Updated weights for policy 1, policy_version 1647023 (0.0011) [2023-12-26 12:50:06,565][123090] Updated weights for policy 1, policy_version 1647033 (0.0011) [2023-12-26 12:50:06,571][123091] Updated weights for policy 0, policy_version 1658069 (0.0009) [2023-12-26 12:50:06,624][123091] Updated weights for policy 0, policy_version 1658079 (0.0010) [2023-12-26 12:50:06,680][123091] Updated weights for policy 0, policy_version 1658089 (0.0011) [2023-12-26 12:50:07,307][123090] Updated weights for policy 1, policy_version 1647043 (0.0008) [2023-12-26 12:50:07,363][123090] Updated weights for policy 1, policy_version 1647053 (0.0006) [2023-12-26 12:50:07,413][123090] Updated weights for policy 1, policy_version 1647063 (0.0008) [2023-12-26 12:50:07,415][123091] Updated weights for policy 0, policy_version 1658099 (0.0009) [2023-12-26 12:50:07,482][123091] Updated weights for policy 0, policy_version 1658109 (0.0005) [2023-12-26 12:50:07,562][123091] Updated weights for policy 0, policy_version 1658119 (0.0005) [2023-12-26 12:50:08,184][123091] Updated weights for policy 0, policy_version 1658129 (0.0006) [2023-12-26 12:50:08,210][123090] Updated weights for policy 1, policy_version 1647073 (0.0006) [2023-12-26 12:50:08,236][123091] Updated weights for policy 0, policy_version 1658139 (0.0009) [2023-12-26 12:50:08,261][123090] Updated weights for policy 1, policy_version 1647083 (0.0010) [2023-12-26 12:50:08,295][123091] Updated weights for policy 0, policy_version 1658149 (0.0010) [2023-12-26 12:50:08,312][123090] Updated weights for policy 1, policy_version 1647093 (0.0010) [2023-12-26 12:50:08,363][123091] Updated weights for policy 0, policy_version 1658159 (0.0011) [2023-12-26 12:50:08,383][123090] Updated weights for policy 1, policy_version 1647103 (0.0006) [2023-12-26 12:50:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.0, 300 sec: 17772.5). Total num frames: 846151680. Throughput: 0: 9119.7, 1: 8895.4. Samples: 846123980. Policy #0 lag: (min: 25.0, avg: 49.7, max: 57.0) [2023-12-26 12:50:08,785][121949] Avg episode reward: [(0, '6000.105'), (1, '5463.990')] [2023-12-26 12:50:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001658160_424493056.pth... [2023-12-26 12:50:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001647104_421658624.pth... [2023-12-26 12:50:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001646048_421388288.pth [2023-12-26 12:50:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001657104_424222720.pth [2023-12-26 12:50:09,169][123090] Updated weights for policy 1, policy_version 1647113 (0.0007) [2023-12-26 12:50:09,180][123091] Updated weights for policy 0, policy_version 1658169 (0.0010) [2023-12-26 12:50:09,232][123090] Updated weights for policy 1, policy_version 1647123 (0.0007) [2023-12-26 12:50:09,253][123091] Updated weights for policy 0, policy_version 1658179 (0.0009) [2023-12-26 12:50:09,298][123090] Updated weights for policy 1, policy_version 1647133 (0.0008) [2023-12-26 12:50:09,307][123091] Updated weights for policy 0, policy_version 1658189 (0.0006) [2023-12-26 12:50:10,120][123091] Updated weights for policy 0, policy_version 1658199 (0.0010) [2023-12-26 12:50:10,122][123090] Updated weights for policy 1, policy_version 1647143 (0.0009) [2023-12-26 12:50:10,181][123091] Updated weights for policy 0, policy_version 1658209 (0.0008) [2023-12-26 12:50:10,182][123090] Updated weights for policy 1, policy_version 1647153 (0.0007) [2023-12-26 12:50:10,242][123090] Updated weights for policy 1, policy_version 1647163 (0.0008) [2023-12-26 12:50:10,246][123091] Updated weights for policy 0, policy_version 1658219 (0.0010) [2023-12-26 12:50:11,025][123090] Updated weights for policy 1, policy_version 1647173 (0.0008) [2023-12-26 12:50:11,059][123091] Updated weights for policy 0, policy_version 1658229 (0.0010) [2023-12-26 12:50:11,096][123090] Updated weights for policy 1, policy_version 1647183 (0.0008) [2023-12-26 12:50:11,132][123091] Updated weights for policy 0, policy_version 1658239 (0.0008) [2023-12-26 12:50:11,166][123090] Updated weights for policy 1, policy_version 1647193 (0.0008) [2023-12-26 12:50:11,198][123091] Updated weights for policy 0, policy_version 1658249 (0.0007) [2023-12-26 12:50:11,945][123091] Updated weights for policy 0, policy_version 1658259 (0.0006) [2023-12-26 12:50:12,013][123091] Updated weights for policy 0, policy_version 1658269 (0.0008) [2023-12-26 12:50:12,075][123090] Updated weights for policy 1, policy_version 1647203 (0.0008) [2023-12-26 12:50:12,077][123091] Updated weights for policy 0, policy_version 1658279 (0.0010) [2023-12-26 12:50:12,136][123090] Updated weights for policy 1, policy_version 1647213 (0.0006) [2023-12-26 12:50:12,200][123090] Updated weights for policy 1, policy_version 1647223 (0.0009) [2023-12-26 12:50:12,894][123091] Updated weights for policy 0, policy_version 1658289 (0.0011) [2023-12-26 12:50:12,960][123091] Updated weights for policy 0, policy_version 1658299 (0.0009) [2023-12-26 12:50:13,018][123090] Updated weights for policy 1, policy_version 1647233 (0.0008) [2023-12-26 12:50:13,021][123091] Updated weights for policy 0, policy_version 1658309 (0.0010) [2023-12-26 12:50:13,080][123090] Updated weights for policy 1, policy_version 1647243 (0.0006) [2023-12-26 12:50:13,085][123091] Updated weights for policy 0, policy_version 1658319 (0.0009) [2023-12-26 12:50:13,153][123090] Updated weights for policy 1, policy_version 1647253 (0.0006) [2023-12-26 12:50:13,207][123090] Updated weights for policy 1, policy_version 1647263 (0.0010) [2023-12-26 12:50:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 846233600. Throughput: 0: 9140.8, 1: 8862.7. Samples: 846231492. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:13,785][121949] Avg episode reward: [(0, '5882.847'), (1, '5531.452')] [2023-12-26 12:50:13,904][123091] Updated weights for policy 0, policy_version 1658329 (0.0009) [2023-12-26 12:50:13,966][123091] Updated weights for policy 0, policy_version 1658339 (0.0009) [2023-12-26 12:50:13,987][123090] Updated weights for policy 1, policy_version 1647273 (0.0010) [2023-12-26 12:50:14,027][123091] Updated weights for policy 0, policy_version 1658349 (0.0007) [2023-12-26 12:50:14,049][123090] Updated weights for policy 1, policy_version 1647283 (0.0010) [2023-12-26 12:50:14,113][123090] Updated weights for policy 1, policy_version 1647293 (0.0010) [2023-12-26 12:50:14,885][123091] Updated weights for policy 0, policy_version 1658359 (0.0009) [2023-12-26 12:50:14,925][123090] Updated weights for policy 1, policy_version 1647303 (0.0008) [2023-12-26 12:50:14,949][123091] Updated weights for policy 0, policy_version 1658369 (0.0009) [2023-12-26 12:50:14,987][123090] Updated weights for policy 1, policy_version 1647313 (0.0008) [2023-12-26 12:50:15,006][123091] Updated weights for policy 0, policy_version 1658379 (0.0010) [2023-12-26 12:50:15,053][123090] Updated weights for policy 1, policy_version 1647323 (0.0010) [2023-12-26 12:50:15,782][123091] Updated weights for policy 0, policy_version 1658389 (0.0008) [2023-12-26 12:50:15,833][123090] Updated weights for policy 1, policy_version 1647333 (0.0006) [2023-12-26 12:50:15,852][123091] Updated weights for policy 0, policy_version 1658399 (0.0009) [2023-12-26 12:50:15,893][123090] Updated weights for policy 1, policy_version 1647343 (0.0006) [2023-12-26 12:50:15,905][123091] Updated weights for policy 0, policy_version 1658409 (0.0009) [2023-12-26 12:50:15,951][123090] Updated weights for policy 1, policy_version 1647353 (0.0006) [2023-12-26 12:50:16,680][123090] Updated weights for policy 1, policy_version 1647363 (0.0006) [2023-12-26 12:50:16,748][123090] Updated weights for policy 1, policy_version 1647373 (0.0010) [2023-12-26 12:50:16,767][123091] Updated weights for policy 0, policy_version 1658419 (0.0009) [2023-12-26 12:50:16,803][123090] Updated weights for policy 1, policy_version 1647383 (0.0010) [2023-12-26 12:50:16,820][123091] Updated weights for policy 0, policy_version 1658429 (0.0006) [2023-12-26 12:50:16,878][123091] Updated weights for policy 0, policy_version 1658439 (0.0009) [2023-12-26 12:50:17,566][123090] Updated weights for policy 1, policy_version 1647393 (0.0010) [2023-12-26 12:50:17,627][123090] Updated weights for policy 1, policy_version 1647403 (0.0005) [2023-12-26 12:50:17,691][123090] Updated weights for policy 1, policy_version 1647413 (0.0005) [2023-12-26 12:50:17,714][123091] Updated weights for policy 0, policy_version 1658449 (0.0009) [2023-12-26 12:50:17,753][123090] Updated weights for policy 1, policy_version 1647423 (0.0005) [2023-12-26 12:50:17,780][123091] Updated weights for policy 0, policy_version 1658459 (0.0009) [2023-12-26 12:50:17,844][123091] Updated weights for policy 0, policy_version 1658469 (0.0009) [2023-12-26 12:50:17,910][123091] Updated weights for policy 0, policy_version 1658479 (0.0010) [2023-12-26 12:50:18,370][123090] Updated weights for policy 1, policy_version 1647433 (0.0008) [2023-12-26 12:50:18,427][123090] Updated weights for policy 1, policy_version 1647443 (0.0006) [2023-12-26 12:50:18,491][123090] Updated weights for policy 1, policy_version 1647453 (0.0010) [2023-12-26 12:50:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 846323712. Throughput: 0: 8973.8, 1: 8895.7. Samples: 846336532. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:18,785][121949] Avg episode reward: [(0, '5900.817'), (1, '5586.968')] [2023-12-26 12:50:18,791][123091] Updated weights for policy 0, policy_version 1658489 (0.0009) [2023-12-26 12:50:18,853][123091] Updated weights for policy 0, policy_version 1658499 (0.0009) [2023-12-26 12:50:18,921][123091] Updated weights for policy 0, policy_version 1658509 (0.0009) [2023-12-26 12:50:19,319][123090] Updated weights for policy 1, policy_version 1647463 (0.0009) [2023-12-26 12:50:19,390][123090] Updated weights for policy 1, policy_version 1647473 (0.0008) [2023-12-26 12:50:19,453][123090] Updated weights for policy 1, policy_version 1647483 (0.0006) [2023-12-26 12:50:19,794][123091] Updated weights for policy 0, policy_version 1658519 (0.0009) [2023-12-26 12:50:19,863][123091] Updated weights for policy 0, policy_version 1658529 (0.0009) [2023-12-26 12:50:19,923][123091] Updated weights for policy 0, policy_version 1658539 (0.0009) [2023-12-26 12:50:20,303][123090] Updated weights for policy 1, policy_version 1647493 (0.0006) [2023-12-26 12:50:20,380][123090] Updated weights for policy 1, policy_version 1647503 (0.0008) [2023-12-26 12:50:20,445][123090] Updated weights for policy 1, policy_version 1647513 (0.0008) [2023-12-26 12:50:20,763][123091] Updated weights for policy 0, policy_version 1658549 (0.0007) [2023-12-26 12:50:20,834][123091] Updated weights for policy 0, policy_version 1658559 (0.0010) [2023-12-26 12:50:20,898][123091] Updated weights for policy 0, policy_version 1658569 (0.0008) [2023-12-26 12:50:21,286][123090] Updated weights for policy 1, policy_version 1647523 (0.0006) [2023-12-26 12:50:21,359][123090] Updated weights for policy 1, policy_version 1647533 (0.0007) [2023-12-26 12:50:21,429][123090] Updated weights for policy 1, policy_version 1647543 (0.0010) [2023-12-26 12:50:21,696][123091] Updated weights for policy 0, policy_version 1658579 (0.0008) [2023-12-26 12:50:21,766][123091] Updated weights for policy 0, policy_version 1658589 (0.0010) [2023-12-26 12:50:21,835][123091] Updated weights for policy 0, policy_version 1658599 (0.0008) [2023-12-26 12:50:22,313][123090] Updated weights for policy 1, policy_version 1647553 (0.0009) [2023-12-26 12:50:22,398][123090] Updated weights for policy 1, policy_version 1647563 (0.0008) [2023-12-26 12:50:22,457][123090] Updated weights for policy 1, policy_version 1647573 (0.0005) [2023-12-26 12:50:22,533][123090] Updated weights for policy 1, policy_version 1647583 (0.0008) [2023-12-26 12:50:22,644][123091] Updated weights for policy 0, policy_version 1658609 (0.0008) [2023-12-26 12:50:22,719][123091] Updated weights for policy 0, policy_version 1658619 (0.0011) [2023-12-26 12:50:22,789][123091] Updated weights for policy 0, policy_version 1658629 (0.0011) [2023-12-26 12:50:22,852][123091] Updated weights for policy 0, policy_version 1658639 (0.0011) [2023-12-26 12:50:23,244][123090] Updated weights for policy 1, policy_version 1647593 (0.0008) [2023-12-26 12:50:23,293][123090] Updated weights for policy 1, policy_version 1647603 (0.0005) [2023-12-26 12:50:23,341][123090] Updated weights for policy 1, policy_version 1647613 (0.0005) [2023-12-26 12:50:23,521][123091] Updated weights for policy 0, policy_version 1658649 (0.0011) [2023-12-26 12:50:23,569][123091] Updated weights for policy 0, policy_version 1658659 (0.0010) [2023-12-26 12:50:23,617][123091] Updated weights for policy 0, policy_version 1658670 (0.0010) [2023-12-26 12:50:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 846413824. Throughput: 0: 8942.6, 1: 8911.9. Samples: 846387480. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:23,785][121949] Avg episode reward: [(0, '6011.676'), (1, '5632.200')] [2023-12-26 12:50:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001658672_424624128.pth... [2023-12-26 12:50:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001647616_421789696.pth... [2023-12-26 12:50:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001646592_421527552.pth [2023-12-26 12:50:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001657648_424361984.pth [2023-12-26 12:50:24,181][123090] Updated weights for policy 1, policy_version 1647623 (0.0005) [2023-12-26 12:50:24,231][123090] Updated weights for policy 1, policy_version 1647633 (0.0009) [2023-12-26 12:50:24,262][123091] Updated weights for policy 0, policy_version 1658680 (0.0005) [2023-12-26 12:50:24,280][123090] Updated weights for policy 1, policy_version 1647643 (0.0009) [2023-12-26 12:50:24,324][123091] Updated weights for policy 0, policy_version 1658690 (0.0007) [2023-12-26 12:50:24,381][123091] Updated weights for policy 0, policy_version 1658700 (0.0006) [2023-12-26 12:50:25,046][123091] Updated weights for policy 0, policy_version 1658710 (0.0005) [2023-12-26 12:50:25,102][123091] Updated weights for policy 0, policy_version 1658720 (0.0006) [2023-12-26 12:50:25,111][123090] Updated weights for policy 1, policy_version 1647653 (0.0007) [2023-12-26 12:50:25,162][123091] Updated weights for policy 0, policy_version 1658730 (0.0006) [2023-12-26 12:50:25,175][123090] Updated weights for policy 1, policy_version 1647663 (0.0005) [2023-12-26 12:50:25,241][123090] Updated weights for policy 1, policy_version 1647673 (0.0005) [2023-12-26 12:50:25,785][123091] Updated weights for policy 0, policy_version 1658740 (0.0006) [2023-12-26 12:50:25,844][123091] Updated weights for policy 0, policy_version 1658750 (0.0005) [2023-12-26 12:50:25,891][123091] Updated weights for policy 0, policy_version 1658760 (0.0005) [2023-12-26 12:50:26,016][123090] Updated weights for policy 1, policy_version 1647683 (0.0007) [2023-12-26 12:50:26,068][123090] Updated weights for policy 1, policy_version 1647693 (0.0009) [2023-12-26 12:50:26,129][123090] Updated weights for policy 1, policy_version 1647703 (0.0009) [2023-12-26 12:50:26,640][123091] Updated weights for policy 0, policy_version 1658770 (0.0006) [2023-12-26 12:50:26,696][123091] Updated weights for policy 0, policy_version 1658780 (0.0010) [2023-12-26 12:50:26,747][123091] Updated weights for policy 0, policy_version 1658791 (0.0010) [2023-12-26 12:50:26,955][123090] Updated weights for policy 1, policy_version 1647713 (0.0009) [2023-12-26 12:50:27,007][123090] Updated weights for policy 1, policy_version 1647723 (0.0009) [2023-12-26 12:50:27,060][123090] Updated weights for policy 1, policy_version 1647733 (0.0010) [2023-12-26 12:50:27,110][123090] Updated weights for policy 1, policy_version 1647743 (0.0008) [2023-12-26 12:50:27,610][123091] Updated weights for policy 0, policy_version 1658802 (0.0009) [2023-12-26 12:50:27,655][123091] Updated weights for policy 0, policy_version 1658812 (0.0008) [2023-12-26 12:50:27,720][123091] Updated weights for policy 0, policy_version 1658822 (0.0005) [2023-12-26 12:50:27,781][123091] Updated weights for policy 0, policy_version 1658832 (0.0005) [2023-12-26 12:50:27,965][123090] Updated weights for policy 1, policy_version 1647753 (0.0010) [2023-12-26 12:50:28,020][123090] Updated weights for policy 1, policy_version 1647763 (0.0009) [2023-12-26 12:50:28,076][123090] Updated weights for policy 1, policy_version 1647773 (0.0009) [2023-12-26 12:50:28,378][123091] Updated weights for policy 0, policy_version 1658842 (0.0008) [2023-12-26 12:50:28,435][123091] Updated weights for policy 0, policy_version 1658852 (0.0009) [2023-12-26 12:50:28,487][123091] Updated weights for policy 0, policy_version 1658862 (0.0006) [2023-12-26 12:50:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 846503936. Throughput: 0: 9064.2, 1: 8895.8. Samples: 846497264. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:28,785][121949] Avg episode reward: [(0, '6005.370'), (1, '5572.185')] [2023-12-26 12:50:28,992][123090] Updated weights for policy 1, policy_version 1647784 (0.0010) [2023-12-26 12:50:29,049][123090] Updated weights for policy 1, policy_version 1647794 (0.0010) [2023-12-26 12:50:29,097][123090] Updated weights for policy 1, policy_version 1647804 (0.0009) [2023-12-26 12:50:29,336][123091] Updated weights for policy 0, policy_version 1658872 (0.0009) [2023-12-26 12:50:29,397][123091] Updated weights for policy 0, policy_version 1658882 (0.0009) [2023-12-26 12:50:29,453][123091] Updated weights for policy 0, policy_version 1658892 (0.0009) [2023-12-26 12:50:29,988][123090] Updated weights for policy 1, policy_version 1647814 (0.0007) [2023-12-26 12:50:30,053][123090] Updated weights for policy 1, policy_version 1647824 (0.0008) [2023-12-26 12:50:30,128][123090] Updated weights for policy 1, policy_version 1647834 (0.0005) [2023-12-26 12:50:30,300][123091] Updated weights for policy 0, policy_version 1658902 (0.0009) [2023-12-26 12:50:30,365][123091] Updated weights for policy 0, policy_version 1658912 (0.0009) [2023-12-26 12:50:30,423][123091] Updated weights for policy 0, policy_version 1658922 (0.0009) [2023-12-26 12:50:30,862][123090] Updated weights for policy 1, policy_version 1647844 (0.0008) [2023-12-26 12:50:30,930][123090] Updated weights for policy 1, policy_version 1647854 (0.0009) [2023-12-26 12:50:30,995][123090] Updated weights for policy 1, policy_version 1647864 (0.0005) [2023-12-26 12:50:31,281][123091] Updated weights for policy 0, policy_version 1658932 (0.0009) [2023-12-26 12:50:31,348][123091] Updated weights for policy 0, policy_version 1658942 (0.0010) [2023-12-26 12:50:31,413][123091] Updated weights for policy 0, policy_version 1658952 (0.0008) [2023-12-26 12:50:31,809][123090] Updated weights for policy 1, policy_version 1647874 (0.0008) [2023-12-26 12:50:31,865][123090] Updated weights for policy 1, policy_version 1647884 (0.0009) [2023-12-26 12:50:31,916][123090] Updated weights for policy 1, policy_version 1647894 (0.0008) [2023-12-26 12:50:31,969][123090] Updated weights for policy 1, policy_version 1647904 (0.0009) [2023-12-26 12:50:32,249][123091] Updated weights for policy 0, policy_version 1658962 (0.0007) [2023-12-26 12:50:32,309][123091] Updated weights for policy 0, policy_version 1658972 (0.0006) [2023-12-26 12:50:32,383][123091] Updated weights for policy 0, policy_version 1658982 (0.0009) [2023-12-26 12:50:32,436][123091] Updated weights for policy 0, policy_version 1658992 (0.0010) [2023-12-26 12:50:32,819][123090] Updated weights for policy 1, policy_version 1647914 (0.0010) [2023-12-26 12:50:32,873][123090] Updated weights for policy 1, policy_version 1647924 (0.0008) [2023-12-26 12:50:32,932][123090] Updated weights for policy 1, policy_version 1647934 (0.0008) [2023-12-26 12:50:33,265][123091] Updated weights for policy 0, policy_version 1659002 (0.0005) [2023-12-26 12:50:33,313][123091] Updated weights for policy 0, policy_version 1659012 (0.0005) [2023-12-26 12:50:33,357][123091] Updated weights for policy 0, policy_version 1659022 (0.0005) [2023-12-26 12:50:33,649][123090] Updated weights for policy 1, policy_version 1647944 (0.0006) [2023-12-26 12:50:33,695][123090] Updated weights for policy 1, policy_version 1647954 (0.0005) [2023-12-26 12:50:33,738][123090] Updated weights for policy 1, policy_version 1647964 (0.0005) [2023-12-26 12:50:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 846594048. Throughput: 0: 8921.3, 1: 8855.8. Samples: 846602396. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:33,785][121949] Avg episode reward: [(0, '5803.111'), (1, '5870.383')] [2023-12-26 12:50:34,150][123091] Updated weights for policy 0, policy_version 1659032 (0.0008) [2023-12-26 12:50:34,222][123091] Updated weights for policy 0, policy_version 1659042 (0.0007) [2023-12-26 12:50:34,295][123091] Updated weights for policy 0, policy_version 1659052 (0.0006) [2023-12-26 12:50:34,424][123090] Updated weights for policy 1, policy_version 1647974 (0.0005) [2023-12-26 12:50:34,497][123090] Updated weights for policy 1, policy_version 1647984 (0.0007) [2023-12-26 12:50:34,564][123090] Updated weights for policy 1, policy_version 1647994 (0.0006) [2023-12-26 12:50:34,938][123091] Updated weights for policy 0, policy_version 1659062 (0.0005) [2023-12-26 12:50:35,012][123091] Updated weights for policy 0, policy_version 1659072 (0.0005) [2023-12-26 12:50:35,072][123091] Updated weights for policy 0, policy_version 1659082 (0.0009) [2023-12-26 12:50:35,226][123090] Updated weights for policy 1, policy_version 1648004 (0.0008) [2023-12-26 12:50:35,279][123090] Updated weights for policy 1, policy_version 1648014 (0.0009) [2023-12-26 12:50:35,329][123090] Updated weights for policy 1, policy_version 1648024 (0.0010) [2023-12-26 12:50:35,730][123091] Updated weights for policy 0, policy_version 1659092 (0.0007) [2023-12-26 12:50:35,774][123091] Updated weights for policy 0, policy_version 1659102 (0.0010) [2023-12-26 12:50:35,821][123091] Updated weights for policy 0, policy_version 1659112 (0.0010) [2023-12-26 12:50:36,183][123090] Updated weights for policy 1, policy_version 1648034 (0.0010) [2023-12-26 12:50:36,259][123090] Updated weights for policy 1, policy_version 1648044 (0.0011) [2023-12-26 12:50:36,331][123090] Updated weights for policy 1, policy_version 1648054 (0.0011) [2023-12-26 12:50:36,401][123090] Updated weights for policy 1, policy_version 1648064 (0.0011) [2023-12-26 12:50:36,600][123091] Updated weights for policy 0, policy_version 1659122 (0.0009) [2023-12-26 12:50:36,675][123091] Updated weights for policy 0, policy_version 1659132 (0.0006) [2023-12-26 12:50:36,746][123091] Updated weights for policy 0, policy_version 1659142 (0.0005) [2023-12-26 12:50:36,817][123091] Updated weights for policy 0, policy_version 1659152 (0.0005) [2023-12-26 12:50:37,254][123090] Updated weights for policy 1, policy_version 1648074 (0.0010) [2023-12-26 12:50:37,322][123090] Updated weights for policy 1, policy_version 1648084 (0.0009) [2023-12-26 12:50:37,393][123090] Updated weights for policy 1, policy_version 1648094 (0.0008) [2023-12-26 12:50:37,413][123091] Updated weights for policy 0, policy_version 1659162 (0.0005) [2023-12-26 12:50:37,477][123091] Updated weights for policy 0, policy_version 1659172 (0.0005) [2023-12-26 12:50:37,530][123091] Updated weights for policy 0, policy_version 1659182 (0.0005) [2023-12-26 12:50:38,191][123091] Updated weights for policy 0, policy_version 1659192 (0.0009) [2023-12-26 12:50:38,246][123091] Updated weights for policy 0, policy_version 1659202 (0.0007) [2023-12-26 12:50:38,266][123090] Updated weights for policy 1, policy_version 1648104 (0.0010) [2023-12-26 12:50:38,297][123091] Updated weights for policy 0, policy_version 1659212 (0.0007) [2023-12-26 12:50:38,328][123090] Updated weights for policy 1, policy_version 1648114 (0.0010) [2023-12-26 12:50:38,398][123090] Updated weights for policy 1, policy_version 1648124 (0.0010) [2023-12-26 12:50:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 846684160. Throughput: 0: 8971.4, 1: 8892.7. Samples: 846659380. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:38,785][121949] Avg episode reward: [(0, '5918.192'), (1, '5848.415')] [2023-12-26 12:50:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001648128_421920768.pth... [2023-12-26 12:50:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001659216_424763392.pth... [2023-12-26 12:50:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001647104_421658624.pth [2023-12-26 12:50:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001658160_424493056.pth [2023-12-26 12:50:39,102][123091] Updated weights for policy 0, policy_version 1659222 (0.0010) [2023-12-26 12:50:39,149][123091] Updated weights for policy 0, policy_version 1659232 (0.0010) [2023-12-26 12:50:39,200][123091] Updated weights for policy 0, policy_version 1659242 (0.0010) [2023-12-26 12:50:39,209][123090] Updated weights for policy 1, policy_version 1648134 (0.0007) [2023-12-26 12:50:39,276][123090] Updated weights for policy 1, policy_version 1648144 (0.0007) [2023-12-26 12:50:39,348][123090] Updated weights for policy 1, policy_version 1648154 (0.0010) [2023-12-26 12:50:40,054][123091] Updated weights for policy 0, policy_version 1659252 (0.0008) [2023-12-26 12:50:40,117][123091] Updated weights for policy 0, policy_version 1659262 (0.0006) [2023-12-26 12:50:40,131][123090] Updated weights for policy 1, policy_version 1648164 (0.0009) [2023-12-26 12:50:40,165][123091] Updated weights for policy 0, policy_version 1659272 (0.0006) [2023-12-26 12:50:40,209][123090] Updated weights for policy 1, policy_version 1648174 (0.0009) [2023-12-26 12:50:40,276][123090] Updated weights for policy 1, policy_version 1648184 (0.0011) [2023-12-26 12:50:40,975][123091] Updated weights for policy 0, policy_version 1659282 (0.0007) [2023-12-26 12:50:41,038][123091] Updated weights for policy 0, policy_version 1659292 (0.0010) [2023-12-26 12:50:41,083][123090] Updated weights for policy 1, policy_version 1648194 (0.0010) [2023-12-26 12:50:41,100][123091] Updated weights for policy 0, policy_version 1659302 (0.0009) [2023-12-26 12:50:41,149][123090] Updated weights for policy 1, policy_version 1648204 (0.0008) [2023-12-26 12:50:41,176][123091] Updated weights for policy 0, policy_version 1659312 (0.0010) [2023-12-26 12:50:41,223][123090] Updated weights for policy 1, policy_version 1648214 (0.0009) [2023-12-26 12:50:41,291][123090] Updated weights for policy 1, policy_version 1648224 (0.0009) [2023-12-26 12:50:42,013][123091] Updated weights for policy 0, policy_version 1659322 (0.0010) [2023-12-26 12:50:42,063][123091] Updated weights for policy 0, policy_version 1659332 (0.0010) [2023-12-26 12:50:42,131][123091] Updated weights for policy 0, policy_version 1659342 (0.0010) [2023-12-26 12:50:42,175][123090] Updated weights for policy 1, policy_version 1648234 (0.0008) [2023-12-26 12:50:42,240][123090] Updated weights for policy 1, policy_version 1648244 (0.0009) [2023-12-26 12:50:42,314][123090] Updated weights for policy 1, policy_version 1648254 (0.0007) [2023-12-26 12:50:42,953][123091] Updated weights for policy 0, policy_version 1659352 (0.0010) [2023-12-26 12:50:43,018][123091] Updated weights for policy 0, policy_version 1659362 (0.0009) [2023-12-26 12:50:43,073][123091] Updated weights for policy 0, policy_version 1659373 (0.0010) [2023-12-26 12:50:43,136][123090] Updated weights for policy 1, policy_version 1648264 (0.0009) [2023-12-26 12:50:43,200][123090] Updated weights for policy 1, policy_version 1648274 (0.0009) [2023-12-26 12:50:43,270][123090] Updated weights for policy 1, policy_version 1648284 (0.0009) [2023-12-26 12:50:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 846766080. Throughput: 0: 8964.4, 1: 8817.8. Samples: 846763072. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:43,785][121949] Avg episode reward: [(0, '6163.069'), (1, '5826.150')] [2023-12-26 12:50:43,862][123091] Updated weights for policy 0, policy_version 1659383 (0.0009) [2023-12-26 12:50:43,926][123091] Updated weights for policy 0, policy_version 1659393 (0.0010) [2023-12-26 12:50:43,988][123091] Updated weights for policy 0, policy_version 1659403 (0.0009) [2023-12-26 12:50:44,096][123090] Updated weights for policy 1, policy_version 1648294 (0.0010) [2023-12-26 12:50:44,146][123090] Updated weights for policy 1, policy_version 1648304 (0.0008) [2023-12-26 12:50:44,208][123090] Updated weights for policy 1, policy_version 1648314 (0.0010) [2023-12-26 12:50:44,760][123091] Updated weights for policy 0, policy_version 1659413 (0.0008) [2023-12-26 12:50:44,846][123091] Updated weights for policy 0, policy_version 1659423 (0.0010) [2023-12-26 12:50:44,903][123091] Updated weights for policy 0, policy_version 1659433 (0.0009) [2023-12-26 12:50:45,093][123090] Updated weights for policy 1, policy_version 1648324 (0.0009) [2023-12-26 12:50:45,163][123090] Updated weights for policy 1, policy_version 1648334 (0.0010) [2023-12-26 12:50:45,229][123090] Updated weights for policy 1, policy_version 1648344 (0.0010) [2023-12-26 12:50:45,710][123091] Updated weights for policy 0, policy_version 1659443 (0.0010) [2023-12-26 12:50:45,765][123091] Updated weights for policy 0, policy_version 1659453 (0.0010) [2023-12-26 12:50:45,815][123091] Updated weights for policy 0, policy_version 1659463 (0.0009) [2023-12-26 12:50:46,072][123090] Updated weights for policy 1, policy_version 1648354 (0.0010) [2023-12-26 12:50:46,135][123090] Updated weights for policy 1, policy_version 1648364 (0.0010) [2023-12-26 12:50:46,200][123090] Updated weights for policy 1, policy_version 1648374 (0.0010) [2023-12-26 12:50:46,266][123090] Updated weights for policy 1, policy_version 1648384 (0.0009) [2023-12-26 12:50:46,562][123091] Updated weights for policy 0, policy_version 1659473 (0.0009) [2023-12-26 12:50:46,632][123091] Updated weights for policy 0, policy_version 1659483 (0.0005) [2023-12-26 12:50:46,695][123091] Updated weights for policy 0, policy_version 1659493 (0.0009) [2023-12-26 12:50:46,758][123091] Updated weights for policy 0, policy_version 1659503 (0.0010) [2023-12-26 12:50:47,149][123090] Updated weights for policy 1, policy_version 1648394 (0.0010) [2023-12-26 12:50:47,205][123090] Updated weights for policy 1, policy_version 1648404 (0.0009) [2023-12-26 12:50:47,262][123090] Updated weights for policy 1, policy_version 1648414 (0.0010) [2023-12-26 12:50:47,555][123091] Updated weights for policy 0, policy_version 1659513 (0.0010) [2023-12-26 12:50:47,622][123091] Updated weights for policy 0, policy_version 1659523 (0.0009) [2023-12-26 12:50:47,683][123091] Updated weights for policy 0, policy_version 1659533 (0.0009) [2023-12-26 12:50:48,156][123090] Updated weights for policy 1, policy_version 1648424 (0.0010) [2023-12-26 12:50:48,216][123090] Updated weights for policy 1, policy_version 1648434 (0.0009) [2023-12-26 12:50:48,278][123090] Updated weights for policy 1, policy_version 1648444 (0.0010) [2023-12-26 12:50:48,402][123091] Updated weights for policy 0, policy_version 1659543 (0.0008) [2023-12-26 12:50:48,467][123091] Updated weights for policy 0, policy_version 1659553 (0.0009) [2023-12-26 12:50:48,538][123091] Updated weights for policy 0, policy_version 1659563 (0.0010) [2023-12-26 12:50:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 846856192. Throughput: 0: 9007.2, 1: 8725.3. Samples: 846866308. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:48,784][121949] Avg episode reward: [(0, '5987.640'), (1, '5643.712')] [2023-12-26 12:50:49,137][123090] Updated weights for policy 1, policy_version 1648454 (0.0009) [2023-12-26 12:50:49,199][123090] Updated weights for policy 1, policy_version 1648464 (0.0009) [2023-12-26 12:50:49,270][123090] Updated weights for policy 1, policy_version 1648474 (0.0007) [2023-12-26 12:50:49,342][123091] Updated weights for policy 0, policy_version 1659573 (0.0010) [2023-12-26 12:50:49,413][123091] Updated weights for policy 0, policy_version 1659583 (0.0010) [2023-12-26 12:50:49,466][123091] Updated weights for policy 0, policy_version 1659594 (0.0009) [2023-12-26 12:50:50,085][123090] Updated weights for policy 1, policy_version 1648484 (0.0007) [2023-12-26 12:50:50,140][123090] Updated weights for policy 1, policy_version 1648494 (0.0009) [2023-12-26 12:50:50,199][123090] Updated weights for policy 1, policy_version 1648504 (0.0009) [2023-12-26 12:50:50,309][123091] Updated weights for policy 0, policy_version 1659604 (0.0010) [2023-12-26 12:50:50,374][123091] Updated weights for policy 0, policy_version 1659614 (0.0009) [2023-12-26 12:50:50,431][123091] Updated weights for policy 0, policy_version 1659624 (0.0006) [2023-12-26 12:50:51,109][123090] Updated weights for policy 1, policy_version 1648514 (0.0009) [2023-12-26 12:50:51,159][123091] Updated weights for policy 0, policy_version 1659634 (0.0006) [2023-12-26 12:50:51,175][123090] Updated weights for policy 1, policy_version 1648524 (0.0008) [2023-12-26 12:50:51,211][123091] Updated weights for policy 0, policy_version 1659644 (0.0010) [2023-12-26 12:50:51,238][123090] Updated weights for policy 1, policy_version 1648534 (0.0008) [2023-12-26 12:50:51,279][123091] Updated weights for policy 0, policy_version 1659654 (0.0006) [2023-12-26 12:50:51,302][123090] Updated weights for policy 1, policy_version 1648544 (0.0010) [2023-12-26 12:50:51,349][123091] Updated weights for policy 0, policy_version 1659664 (0.0010) [2023-12-26 12:50:52,109][123090] Updated weights for policy 1, policy_version 1648554 (0.0008) [2023-12-26 12:50:52,146][123091] Updated weights for policy 0, policy_version 1659674 (0.0009) [2023-12-26 12:50:52,157][123090] Updated weights for policy 1, policy_version 1648564 (0.0006) [2023-12-26 12:50:52,202][123091] Updated weights for policy 0, policy_version 1659684 (0.0007) [2023-12-26 12:50:52,223][123090] Updated weights for policy 1, policy_version 1648574 (0.0009) [2023-12-26 12:50:52,263][123091] Updated weights for policy 0, policy_version 1659694 (0.0009) [2023-12-26 12:50:53,060][123090] Updated weights for policy 1, policy_version 1648584 (0.0005) [2023-12-26 12:50:53,095][123091] Updated weights for policy 0, policy_version 1659704 (0.0010) [2023-12-26 12:50:53,121][123090] Updated weights for policy 1, policy_version 1648594 (0.0006) [2023-12-26 12:50:53,146][123091] Updated weights for policy 0, policy_version 1659714 (0.0011) [2023-12-26 12:50:53,181][123090] Updated weights for policy 1, policy_version 1648604 (0.0006) [2023-12-26 12:50:53,206][123091] Updated weights for policy 0, policy_version 1659724 (0.0009) [2023-12-26 12:50:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 846938112. Throughput: 0: 8992.2, 1: 8646.7. Samples: 846917736. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:53,785][121949] Avg episode reward: [(0, '5780.417'), (1, '5718.886')] [2023-12-26 12:50:53,786][123090] Updated weights for policy 1, policy_version 1648614 (0.0005) [2023-12-26 12:50:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001659728_424894464.pth... [2023-12-26 12:50:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001658672_424624128.pth [2023-12-26 12:50:53,848][123090] Updated weights for policy 1, policy_version 1648624 (0.0005) [2023-12-26 12:50:53,909][123090] Updated weights for policy 1, policy_version 1648634 (0.0005) [2023-12-26 12:50:53,942][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001648640_422051840.pth... [2023-12-26 12:50:53,943][123091] Updated weights for policy 0, policy_version 1659734 (0.0008) [2023-12-26 12:50:53,945][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001647616_421789696.pth [2023-12-26 12:50:54,018][123091] Updated weights for policy 0, policy_version 1659744 (0.0005) [2023-12-26 12:50:54,086][123091] Updated weights for policy 0, policy_version 1659754 (0.0005) [2023-12-26 12:50:54,554][123090] Updated weights for policy 1, policy_version 1648644 (0.0005) [2023-12-26 12:50:54,621][123090] Updated weights for policy 1, policy_version 1648654 (0.0006) [2023-12-26 12:50:54,680][123090] Updated weights for policy 1, policy_version 1648664 (0.0005) [2023-12-26 12:50:54,768][123091] Updated weights for policy 0, policy_version 1659764 (0.0006) [2023-12-26 12:50:54,835][123091] Updated weights for policy 0, policy_version 1659774 (0.0005) [2023-12-26 12:50:54,899][123091] Updated weights for policy 0, policy_version 1659784 (0.0006) [2023-12-26 12:50:55,378][123090] Updated weights for policy 1, policy_version 1648674 (0.0006) [2023-12-26 12:50:55,433][123090] Updated weights for policy 1, policy_version 1648684 (0.0010) [2023-12-26 12:50:55,487][123090] Updated weights for policy 1, policy_version 1648694 (0.0010) [2023-12-26 12:50:55,549][123090] Updated weights for policy 1, policy_version 1648704 (0.0010) [2023-12-26 12:50:55,568][123091] Updated weights for policy 0, policy_version 1659794 (0.0009) [2023-12-26 12:50:55,641][123091] Updated weights for policy 0, policy_version 1659804 (0.0005) [2023-12-26 12:50:55,719][123091] Updated weights for policy 0, policy_version 1659814 (0.0005) [2023-12-26 12:50:55,773][123091] Updated weights for policy 0, policy_version 1659824 (0.0005) [2023-12-26 12:50:56,172][123090] Updated weights for policy 1, policy_version 1648714 (0.0005) [2023-12-26 12:50:56,220][123090] Updated weights for policy 1, policy_version 1648724 (0.0005) [2023-12-26 12:50:56,269][123090] Updated weights for policy 1, policy_version 1648734 (0.0007) [2023-12-26 12:50:56,366][123091] Updated weights for policy 0, policy_version 1659834 (0.0005) [2023-12-26 12:50:56,421][123091] Updated weights for policy 0, policy_version 1659844 (0.0005) [2023-12-26 12:50:56,469][123091] Updated weights for policy 0, policy_version 1659854 (0.0007) [2023-12-26 12:50:57,060][123090] Updated weights for policy 1, policy_version 1648744 (0.0008) [2023-12-26 12:50:57,128][123090] Updated weights for policy 1, policy_version 1648754 (0.0008) [2023-12-26 12:50:57,180][123091] Updated weights for policy 0, policy_version 1659864 (0.0007) [2023-12-26 12:50:57,195][123090] Updated weights for policy 1, policy_version 1648764 (0.0008) [2023-12-26 12:50:57,250][123091] Updated weights for policy 0, policy_version 1659874 (0.0005) [2023-12-26 12:50:57,321][123091] Updated weights for policy 0, policy_version 1659884 (0.0005) [2023-12-26 12:50:57,815][123090] Updated weights for policy 1, policy_version 1648774 (0.0006) [2023-12-26 12:50:57,865][123090] Updated weights for policy 1, policy_version 1648784 (0.0005) [2023-12-26 12:50:57,921][123090] Updated weights for policy 1, policy_version 1648794 (0.0005) [2023-12-26 12:50:57,928][123091] Updated weights for policy 0, policy_version 1659894 (0.0006) [2023-12-26 12:50:57,971][123091] Updated weights for policy 0, policy_version 1659904 (0.0005) [2023-12-26 12:50:58,017][123091] Updated weights for policy 0, policy_version 1659914 (0.0005) [2023-12-26 12:50:58,639][123090] Updated weights for policy 1, policy_version 1648804 (0.0007) [2023-12-26 12:50:58,720][123090] Updated weights for policy 1, policy_version 1648814 (0.0007) [2023-12-26 12:50:58,777][123091] Updated weights for policy 0, policy_version 1659924 (0.0006) [2023-12-26 12:50:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 847036416. Throughput: 0: 9081.9, 1: 8782.0. Samples: 847035364. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:50:58,785][121949] Avg episode reward: [(0, '5914.743'), (1, '5861.991')] [2023-12-26 12:50:58,788][123090] Updated weights for policy 1, policy_version 1648824 (0.0008) [2023-12-26 12:50:58,842][123091] Updated weights for policy 0, policy_version 1659934 (0.0010) [2023-12-26 12:50:58,914][123091] Updated weights for policy 0, policy_version 1659944 (0.0009) [2023-12-26 12:50:59,611][123090] Updated weights for policy 1, policy_version 1648834 (0.0008) [2023-12-26 12:50:59,677][123090] Updated weights for policy 1, policy_version 1648844 (0.0010) [2023-12-26 12:50:59,736][123090] Updated weights for policy 1, policy_version 1648854 (0.0010) [2023-12-26 12:50:59,790][123090] Updated weights for policy 1, policy_version 1648864 (0.0010) [2023-12-26 12:50:59,820][123091] Updated weights for policy 0, policy_version 1659954 (0.0010) [2023-12-26 12:50:59,888][123091] Updated weights for policy 0, policy_version 1659964 (0.0009) [2023-12-26 12:50:59,958][123091] Updated weights for policy 0, policy_version 1659974 (0.0010) [2023-12-26 12:51:00,010][123091] Updated weights for policy 0, policy_version 1659984 (0.0010) [2023-12-26 12:51:00,610][123090] Updated weights for policy 1, policy_version 1648874 (0.0009) [2023-12-26 12:51:00,665][123090] Updated weights for policy 1, policy_version 1648884 (0.0010) [2023-12-26 12:51:00,717][123090] Updated weights for policy 1, policy_version 1648894 (0.0009) [2023-12-26 12:51:00,762][123091] Updated weights for policy 0, policy_version 1659994 (0.0007) [2023-12-26 12:51:00,809][123091] Updated weights for policy 0, policy_version 1660004 (0.0008) [2023-12-26 12:51:00,854][123091] Updated weights for policy 0, policy_version 1660014 (0.0008) [2023-12-26 12:51:01,573][123090] Updated weights for policy 1, policy_version 1648904 (0.0006) [2023-12-26 12:51:01,648][123090] Updated weights for policy 1, policy_version 1648914 (0.0006) [2023-12-26 12:51:01,713][123090] Updated weights for policy 1, policy_version 1648924 (0.0006) [2023-12-26 12:51:01,728][123091] Updated weights for policy 0, policy_version 1660024 (0.0007) [2023-12-26 12:51:01,797][123091] Updated weights for policy 0, policy_version 1660034 (0.0006) [2023-12-26 12:51:01,867][123091] Updated weights for policy 0, policy_version 1660044 (0.0005) [2023-12-26 12:51:02,461][123090] Updated weights for policy 1, policy_version 1648934 (0.0009) [2023-12-26 12:51:02,527][123090] Updated weights for policy 1, policy_version 1648944 (0.0010) [2023-12-26 12:51:02,598][123090] Updated weights for policy 1, policy_version 1648954 (0.0010) [2023-12-26 12:51:02,619][123091] Updated weights for policy 0, policy_version 1660054 (0.0006) [2023-12-26 12:51:02,676][123091] Updated weights for policy 0, policy_version 1660064 (0.0009) [2023-12-26 12:51:02,727][123091] Updated weights for policy 0, policy_version 1660074 (0.0009) [2023-12-26 12:51:03,422][123090] Updated weights for policy 1, policy_version 1648964 (0.0009) [2023-12-26 12:51:03,481][123090] Updated weights for policy 1, policy_version 1648974 (0.0006) [2023-12-26 12:51:03,535][123090] Updated weights for policy 1, policy_version 1648984 (0.0005) [2023-12-26 12:51:03,572][123091] Updated weights for policy 0, policy_version 1660084 (0.0009) [2023-12-26 12:51:03,621][123091] Updated weights for policy 0, policy_version 1660094 (0.0009) [2023-12-26 12:51:03,681][123091] Updated weights for policy 0, policy_version 1660104 (0.0006) [2023-12-26 12:51:03,784][121949] Fps is (10 sec: 19661.1, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 847134720. Throughput: 0: 9133.2, 1: 8737.9. Samples: 847140728. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:03,785][121949] Avg episode reward: [(0, '6079.022'), (1, '5739.465')] [2023-12-26 12:51:04,297][123090] Updated weights for policy 1, policy_version 1648994 (0.0006) [2023-12-26 12:51:04,364][123090] Updated weights for policy 1, policy_version 1649004 (0.0008) [2023-12-26 12:51:04,427][123090] Updated weights for policy 1, policy_version 1649014 (0.0007) [2023-12-26 12:51:04,459][123091] Updated weights for policy 0, policy_version 1660114 (0.0010) [2023-12-26 12:51:04,490][123090] Updated weights for policy 1, policy_version 1649024 (0.0007) [2023-12-26 12:51:04,521][123091] Updated weights for policy 0, policy_version 1660124 (0.0010) [2023-12-26 12:51:04,582][123091] Updated weights for policy 0, policy_version 1660134 (0.0009) [2023-12-26 12:51:04,641][123091] Updated weights for policy 0, policy_version 1660144 (0.0009) [2023-12-26 12:51:05,176][123090] Updated weights for policy 1, policy_version 1649034 (0.0008) [2023-12-26 12:51:05,235][123090] Updated weights for policy 1, policy_version 1649044 (0.0010) [2023-12-26 12:51:05,286][123090] Updated weights for policy 1, policy_version 1649054 (0.0010) [2023-12-26 12:51:05,442][123091] Updated weights for policy 0, policy_version 1660154 (0.0009) [2023-12-26 12:51:05,500][123091] Updated weights for policy 0, policy_version 1660164 (0.0009) [2023-12-26 12:51:05,559][123091] Updated weights for policy 0, policy_version 1660174 (0.0009) [2023-12-26 12:51:05,981][123090] Updated weights for policy 1, policy_version 1649064 (0.0007) [2023-12-26 12:51:06,028][123090] Updated weights for policy 1, policy_version 1649074 (0.0005) [2023-12-26 12:51:06,079][123090] Updated weights for policy 1, policy_version 1649084 (0.0005) [2023-12-26 12:51:06,312][123091] Updated weights for policy 0, policy_version 1660184 (0.0011) [2023-12-26 12:51:06,373][123091] Updated weights for policy 0, policy_version 1660194 (0.0011) [2023-12-26 12:51:06,436][123091] Updated weights for policy 0, policy_version 1660204 (0.0011) [2023-12-26 12:51:06,828][123090] Updated weights for policy 1, policy_version 1649094 (0.0006) [2023-12-26 12:51:06,900][123090] Updated weights for policy 1, policy_version 1649104 (0.0005) [2023-12-26 12:51:06,972][123090] Updated weights for policy 1, policy_version 1649114 (0.0006) [2023-12-26 12:51:07,170][123091] Updated weights for policy 0, policy_version 1660214 (0.0009) [2023-12-26 12:51:07,218][123091] Updated weights for policy 0, policy_version 1660224 (0.0009) [2023-12-26 12:51:07,274][123091] Updated weights for policy 0, policy_version 1660234 (0.0010) [2023-12-26 12:51:07,588][123090] Updated weights for policy 1, policy_version 1649124 (0.0006) [2023-12-26 12:51:07,637][123090] Updated weights for policy 1, policy_version 1649134 (0.0005) [2023-12-26 12:51:07,687][123090] Updated weights for policy 1, policy_version 1649144 (0.0009) [2023-12-26 12:51:08,098][123091] Updated weights for policy 0, policy_version 1660244 (0.0009) [2023-12-26 12:51:08,162][123091] Updated weights for policy 0, policy_version 1660254 (0.0010) [2023-12-26 12:51:08,218][123091] Updated weights for policy 0, policy_version 1660264 (0.0009) [2023-12-26 12:51:08,541][123090] Updated weights for policy 1, policy_version 1649154 (0.0008) [2023-12-26 12:51:08,589][123090] Updated weights for policy 1, policy_version 1649164 (0.0010) [2023-12-26 12:51:08,641][123090] Updated weights for policy 1, policy_version 1649174 (0.0010) [2023-12-26 12:51:08,692][123090] Updated weights for policy 1, policy_version 1649184 (0.0010) [2023-12-26 12:51:08,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 847224832. Throughput: 0: 9172.6, 1: 8813.5. Samples: 847196856. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:08,786][121949] Avg episode reward: [(0, '5899.951'), (1, '5748.299')] [2023-12-26 12:51:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001660272_425033728.pth... [2023-12-26 12:51:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001649184_422191104.pth... [2023-12-26 12:51:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001659216_424763392.pth [2023-12-26 12:51:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001648128_421920768.pth [2023-12-26 12:51:09,055][123091] Updated weights for policy 0, policy_version 1660274 (0.0010) [2023-12-26 12:51:09,107][123091] Updated weights for policy 0, policy_version 1660284 (0.0009) [2023-12-26 12:51:09,154][123091] Updated weights for policy 0, policy_version 1660294 (0.0008) [2023-12-26 12:51:09,202][123091] Updated weights for policy 0, policy_version 1660304 (0.0009) [2023-12-26 12:51:09,556][123090] Updated weights for policy 1, policy_version 1649194 (0.0011) [2023-12-26 12:51:09,610][123090] Updated weights for policy 1, policy_version 1649204 (0.0010) [2023-12-26 12:51:09,666][123090] Updated weights for policy 1, policy_version 1649214 (0.0010) [2023-12-26 12:51:10,076][123091] Updated weights for policy 0, policy_version 1660314 (0.0009) [2023-12-26 12:51:10,125][123091] Updated weights for policy 0, policy_version 1660324 (0.0009) [2023-12-26 12:51:10,174][123091] Updated weights for policy 0, policy_version 1660334 (0.0009) [2023-12-26 12:51:10,518][123090] Updated weights for policy 1, policy_version 1649224 (0.0010) [2023-12-26 12:51:10,581][123090] Updated weights for policy 1, policy_version 1649234 (0.0010) [2023-12-26 12:51:10,641][123090] Updated weights for policy 1, policy_version 1649244 (0.0010) [2023-12-26 12:51:11,076][123091] Updated weights for policy 0, policy_version 1660344 (0.0010) [2023-12-26 12:51:11,144][123091] Updated weights for policy 0, policy_version 1660354 (0.0009) [2023-12-26 12:51:11,208][123091] Updated weights for policy 0, policy_version 1660364 (0.0009) [2023-12-26 12:51:11,523][123090] Updated weights for policy 1, policy_version 1649254 (0.0010) [2023-12-26 12:51:11,583][123090] Updated weights for policy 1, policy_version 1649264 (0.0011) [2023-12-26 12:51:11,653][123090] Updated weights for policy 1, policy_version 1649274 (0.0010) [2023-12-26 12:51:12,028][123091] Updated weights for policy 0, policy_version 1660374 (0.0010) [2023-12-26 12:51:12,088][123091] Updated weights for policy 0, policy_version 1660384 (0.0011) [2023-12-26 12:51:12,151][123091] Updated weights for policy 0, policy_version 1660394 (0.0011) [2023-12-26 12:51:12,505][123090] Updated weights for policy 1, policy_version 1649284 (0.0010) [2023-12-26 12:51:12,572][123090] Updated weights for policy 1, policy_version 1649294 (0.0011) [2023-12-26 12:51:12,644][123090] Updated weights for policy 1, policy_version 1649304 (0.0011) [2023-12-26 12:51:12,949][123091] Updated weights for policy 0, policy_version 1660404 (0.0011) [2023-12-26 12:51:13,019][123091] Updated weights for policy 0, policy_version 1660414 (0.0011) [2023-12-26 12:51:13,083][123091] Updated weights for policy 0, policy_version 1660424 (0.0011) [2023-12-26 12:51:13,322][123090] Updated weights for policy 1, policy_version 1649314 (0.0006) [2023-12-26 12:51:13,387][123090] Updated weights for policy 1, policy_version 1649324 (0.0005) [2023-12-26 12:51:13,443][123090] Updated weights for policy 1, policy_version 1649334 (0.0005) [2023-12-26 12:51:13,501][123090] Updated weights for policy 1, policy_version 1649344 (0.0005) [2023-12-26 12:51:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 847306752. Throughput: 0: 9031.8, 1: 8808.9. Samples: 847300096. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:13,785][121949] Avg episode reward: [(0, '5913.478'), (1, '5786.298')] [2023-12-26 12:51:13,886][123091] Updated weights for policy 0, policy_version 1660434 (0.0011) [2023-12-26 12:51:13,948][123091] Updated weights for policy 0, policy_version 1660444 (0.0010) [2023-12-26 12:51:14,010][123091] Updated weights for policy 0, policy_version 1660454 (0.0011) [2023-12-26 12:51:14,067][123091] Updated weights for policy 0, policy_version 1660464 (0.0008) [2023-12-26 12:51:14,256][123090] Updated weights for policy 1, policy_version 1649354 (0.0010) [2023-12-26 12:51:14,328][123090] Updated weights for policy 1, policy_version 1649364 (0.0008) [2023-12-26 12:51:14,385][123090] Updated weights for policy 1, policy_version 1649374 (0.0009) [2023-12-26 12:51:14,708][123091] Updated weights for policy 0, policy_version 1660474 (0.0005) [2023-12-26 12:51:14,764][123091] Updated weights for policy 0, policy_version 1660484 (0.0005) [2023-12-26 12:51:14,837][123091] Updated weights for policy 0, policy_version 1660494 (0.0008) [2023-12-26 12:51:15,259][123090] Updated weights for policy 1, policy_version 1649384 (0.0008) [2023-12-26 12:51:15,326][123090] Updated weights for policy 1, policy_version 1649394 (0.0009) [2023-12-26 12:51:15,390][123090] Updated weights for policy 1, policy_version 1649404 (0.0009) [2023-12-26 12:51:15,549][123091] Updated weights for policy 0, policy_version 1660504 (0.0010) [2023-12-26 12:51:15,612][123091] Updated weights for policy 0, policy_version 1660514 (0.0011) [2023-12-26 12:51:15,675][123091] Updated weights for policy 0, policy_version 1660524 (0.0010) [2023-12-26 12:51:16,266][123090] Updated weights for policy 1, policy_version 1649414 (0.0009) [2023-12-26 12:51:16,328][123090] Updated weights for policy 1, policy_version 1649424 (0.0009) [2023-12-26 12:51:16,396][123090] Updated weights for policy 1, policy_version 1649434 (0.0010) [2023-12-26 12:51:16,420][123091] Updated weights for policy 0, policy_version 1660534 (0.0009) [2023-12-26 12:51:16,487][123091] Updated weights for policy 0, policy_version 1660544 (0.0006) [2023-12-26 12:51:16,543][123091] Updated weights for policy 0, policy_version 1660554 (0.0006) [2023-12-26 12:51:17,225][123091] Updated weights for policy 0, policy_version 1660564 (0.0006) [2023-12-26 12:51:17,267][123090] Updated weights for policy 1, policy_version 1649444 (0.0008) [2023-12-26 12:51:17,289][123091] Updated weights for policy 0, policy_version 1660574 (0.0008) [2023-12-26 12:51:17,334][123090] Updated weights for policy 1, policy_version 1649454 (0.0009) [2023-12-26 12:51:17,343][123091] Updated weights for policy 0, policy_version 1660584 (0.0008) [2023-12-26 12:51:17,399][123090] Updated weights for policy 1, policy_version 1649464 (0.0008) [2023-12-26 12:51:18,018][123091] Updated weights for policy 0, policy_version 1660594 (0.0009) [2023-12-26 12:51:18,072][123091] Updated weights for policy 0, policy_version 1660604 (0.0009) [2023-12-26 12:51:18,129][123091] Updated weights for policy 0, policy_version 1660614 (0.0010) [2023-12-26 12:51:18,190][123091] Updated weights for policy 0, policy_version 1660624 (0.0009) [2023-12-26 12:51:18,236][123090] Updated weights for policy 1, policy_version 1649474 (0.0009) [2023-12-26 12:51:18,300][123090] Updated weights for policy 1, policy_version 1649484 (0.0009) [2023-12-26 12:51:18,373][123090] Updated weights for policy 1, policy_version 1649494 (0.0009) [2023-12-26 12:51:18,434][123090] Updated weights for policy 1, policy_version 1649504 (0.0009) [2023-12-26 12:51:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 847396864. Throughput: 0: 9117.6, 1: 8773.6. Samples: 847407500. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:18,785][121949] Avg episode reward: [(0, '5846.143'), (1, '5519.217')] [2023-12-26 12:51:19,035][123091] Updated weights for policy 0, policy_version 1660634 (0.0006) [2023-12-26 12:51:19,095][123091] Updated weights for policy 0, policy_version 1660644 (0.0006) [2023-12-26 12:51:19,156][123091] Updated weights for policy 0, policy_version 1660654 (0.0006) [2023-12-26 12:51:19,279][123090] Updated weights for policy 1, policy_version 1649514 (0.0009) [2023-12-26 12:51:19,344][123090] Updated weights for policy 1, policy_version 1649524 (0.0009) [2023-12-26 12:51:19,408][123090] Updated weights for policy 1, policy_version 1649534 (0.0010) [2023-12-26 12:51:19,889][123091] Updated weights for policy 0, policy_version 1660664 (0.0008) [2023-12-26 12:51:19,959][123091] Updated weights for policy 0, policy_version 1660674 (0.0010) [2023-12-26 12:51:20,011][123091] Updated weights for policy 0, policy_version 1660684 (0.0011) [2023-12-26 12:51:20,323][123090] Updated weights for policy 1, policy_version 1649544 (0.0009) [2023-12-26 12:51:20,384][123090] Updated weights for policy 1, policy_version 1649554 (0.0008) [2023-12-26 12:51:20,444][123090] Updated weights for policy 1, policy_version 1649564 (0.0008) [2023-12-26 12:51:20,832][123091] Updated weights for policy 0, policy_version 1660694 (0.0011) [2023-12-26 12:51:20,900][123091] Updated weights for policy 0, policy_version 1660704 (0.0011) [2023-12-26 12:51:20,964][123091] Updated weights for policy 0, policy_version 1660714 (0.0011) [2023-12-26 12:51:21,334][123090] Updated weights for policy 1, policy_version 1649574 (0.0009) [2023-12-26 12:51:21,411][123090] Updated weights for policy 1, policy_version 1649584 (0.0009) [2023-12-26 12:51:21,486][123090] Updated weights for policy 1, policy_version 1649594 (0.0006) [2023-12-26 12:51:21,785][123091] Updated weights for policy 0, policy_version 1660724 (0.0011) [2023-12-26 12:51:21,846][123091] Updated weights for policy 0, policy_version 1660734 (0.0011) [2023-12-26 12:51:21,914][123091] Updated weights for policy 0, policy_version 1660744 (0.0011) [2023-12-26 12:51:22,286][123090] Updated weights for policy 1, policy_version 1649604 (0.0008) [2023-12-26 12:51:22,352][123090] Updated weights for policy 1, policy_version 1649614 (0.0008) [2023-12-26 12:51:22,419][123090] Updated weights for policy 1, policy_version 1649624 (0.0008) [2023-12-26 12:51:22,777][123091] Updated weights for policy 0, policy_version 1660754 (0.0010) [2023-12-26 12:51:22,831][123091] Updated weights for policy 0, policy_version 1660764 (0.0010) [2023-12-26 12:51:22,886][123091] Updated weights for policy 0, policy_version 1660774 (0.0010) [2023-12-26 12:51:22,938][123091] Updated weights for policy 0, policy_version 1660784 (0.0009) [2023-12-26 12:51:23,191][123090] Updated weights for policy 1, policy_version 1649634 (0.0008) [2023-12-26 12:51:23,252][123090] Updated weights for policy 1, policy_version 1649644 (0.0005) [2023-12-26 12:51:23,325][123090] Updated weights for policy 1, policy_version 1649654 (0.0005) [2023-12-26 12:51:23,391][123090] Updated weights for policy 1, policy_version 1649664 (0.0009) [2023-12-26 12:51:23,731][123091] Updated weights for policy 0, policy_version 1660794 (0.0005) [2023-12-26 12:51:23,777][123091] Updated weights for policy 0, policy_version 1660804 (0.0005) [2023-12-26 12:51:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 847478784. Throughput: 0: 9058.2, 1: 8699.3. Samples: 847458468. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:23,785][121949] Avg episode reward: [(0, '5984.196'), (1, '5493.926')] [2023-12-26 12:51:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001649664_422313984.pth... [2023-12-26 12:51:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001648640_422051840.pth [2023-12-26 12:51:23,838][123091] Updated weights for policy 0, policy_version 1660814 (0.0009) [2023-12-26 12:51:23,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001660816_425172992.pth... [2023-12-26 12:51:23,855][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001659728_424894464.pth [2023-12-26 12:51:24,170][123090] Updated weights for policy 1, policy_version 1649674 (0.0010) [2023-12-26 12:51:24,237][123090] Updated weights for policy 1, policy_version 1649684 (0.0010) [2023-12-26 12:51:24,300][123090] Updated weights for policy 1, policy_version 1649694 (0.0010) [2023-12-26 12:51:24,541][123091] Updated weights for policy 0, policy_version 1660824 (0.0005) [2023-12-26 12:51:24,587][123091] Updated weights for policy 0, policy_version 1660834 (0.0005) [2023-12-26 12:51:24,647][123091] Updated weights for policy 0, policy_version 1660844 (0.0005) [2023-12-26 12:51:25,112][123090] Updated weights for policy 1, policy_version 1649704 (0.0010) [2023-12-26 12:51:25,160][123090] Updated weights for policy 1, policy_version 1649714 (0.0010) [2023-12-26 12:51:25,208][123090] Updated weights for policy 1, policy_version 1649724 (0.0010) [2023-12-26 12:51:25,316][123091] Updated weights for policy 0, policy_version 1660854 (0.0008) [2023-12-26 12:51:25,360][123091] Updated weights for policy 0, policy_version 1660864 (0.0010) [2023-12-26 12:51:25,407][123091] Updated weights for policy 0, policy_version 1660874 (0.0010) [2023-12-26 12:51:26,048][123090] Updated weights for policy 1, policy_version 1649734 (0.0010) [2023-12-26 12:51:26,121][123090] Updated weights for policy 1, policy_version 1649744 (0.0010) [2023-12-26 12:51:26,188][123090] Updated weights for policy 1, policy_version 1649754 (0.0010) [2023-12-26 12:51:26,263][123091] Updated weights for policy 0, policy_version 1660884 (0.0008) [2023-12-26 12:51:26,320][123091] Updated weights for policy 0, policy_version 1660894 (0.0005) [2023-12-26 12:51:26,377][123091] Updated weights for policy 0, policy_version 1660904 (0.0005) [2023-12-26 12:51:26,980][123090] Updated weights for policy 1, policy_version 1649764 (0.0010) [2023-12-26 12:51:27,026][123091] Updated weights for policy 0, policy_version 1660914 (0.0005) [2023-12-26 12:51:27,043][123090] Updated weights for policy 1, policy_version 1649774 (0.0010) [2023-12-26 12:51:27,088][123091] Updated weights for policy 0, policy_version 1660924 (0.0008) [2023-12-26 12:51:27,103][123090] Updated weights for policy 1, policy_version 1649784 (0.0010) [2023-12-26 12:51:27,147][123091] Updated weights for policy 0, policy_version 1660934 (0.0011) [2023-12-26 12:51:27,208][123091] Updated weights for policy 0, policy_version 1660944 (0.0009) [2023-12-26 12:51:27,871][123090] Updated weights for policy 1, policy_version 1649794 (0.0009) [2023-12-26 12:51:27,882][123091] Updated weights for policy 0, policy_version 1660954 (0.0005) [2023-12-26 12:51:27,932][123090] Updated weights for policy 1, policy_version 1649804 (0.0005) [2023-12-26 12:51:27,936][123091] Updated weights for policy 0, policy_version 1660964 (0.0005) [2023-12-26 12:51:27,988][123090] Updated weights for policy 1, policy_version 1649814 (0.0005) [2023-12-26 12:51:27,992][123091] Updated weights for policy 0, policy_version 1660974 (0.0005) [2023-12-26 12:51:28,039][123090] Updated weights for policy 1, policy_version 1649824 (0.0007) [2023-12-26 12:51:28,732][123091] Updated weights for policy 0, policy_version 1660984 (0.0009) [2023-12-26 12:51:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 847568896. Throughput: 0: 9118.9, 1: 8751.1. Samples: 847567216. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:28,785][121949] Avg episode reward: [(0, '6187.188'), (1, '5505.386')] [2023-12-26 12:51:28,787][123091] Updated weights for policy 0, policy_version 1660994 (0.0010) [2023-12-26 12:51:28,832][123090] Updated weights for policy 1, policy_version 1649834 (0.0010) [2023-12-26 12:51:28,835][123091] Updated weights for policy 0, policy_version 1661004 (0.0010) [2023-12-26 12:51:28,883][123090] Updated weights for policy 1, policy_version 1649844 (0.0010) [2023-12-26 12:51:28,942][123090] Updated weights for policy 1, policy_version 1649854 (0.0010) [2023-12-26 12:51:29,681][123091] Updated weights for policy 0, policy_version 1661014 (0.0010) [2023-12-26 12:51:29,735][123090] Updated weights for policy 1, policy_version 1649864 (0.0010) [2023-12-26 12:51:29,742][123091] Updated weights for policy 0, policy_version 1661024 (0.0007) [2023-12-26 12:51:29,787][123090] Updated weights for policy 1, policy_version 1649874 (0.0010) [2023-12-26 12:51:29,799][123091] Updated weights for policy 0, policy_version 1661034 (0.0006) [2023-12-26 12:51:29,855][123090] Updated weights for policy 1, policy_version 1649884 (0.0010) [2023-12-26 12:51:30,654][123091] Updated weights for policy 0, policy_version 1661044 (0.0009) [2023-12-26 12:51:30,684][123090] Updated weights for policy 1, policy_version 1649894 (0.0010) [2023-12-26 12:51:30,705][123091] Updated weights for policy 0, policy_version 1661054 (0.0008) [2023-12-26 12:51:30,731][123090] Updated weights for policy 1, policy_version 1649904 (0.0010) [2023-12-26 12:51:30,759][123091] Updated weights for policy 0, policy_version 1661064 (0.0006) [2023-12-26 12:51:30,782][123090] Updated weights for policy 1, policy_version 1649914 (0.0010) [2023-12-26 12:51:31,575][123091] Updated weights for policy 0, policy_version 1661074 (0.0006) [2023-12-26 12:51:31,595][123090] Updated weights for policy 1, policy_version 1649924 (0.0008) [2023-12-26 12:51:31,643][123091] Updated weights for policy 0, policy_version 1661084 (0.0007) [2023-12-26 12:51:31,662][123090] Updated weights for policy 1, policy_version 1649934 (0.0010) [2023-12-26 12:51:31,701][123091] Updated weights for policy 0, policy_version 1661094 (0.0005) [2023-12-26 12:51:31,726][123090] Updated weights for policy 1, policy_version 1649944 (0.0011) [2023-12-26 12:51:31,763][123091] Updated weights for policy 0, policy_version 1661104 (0.0007) [2023-12-26 12:51:32,435][123091] Updated weights for policy 0, policy_version 1661114 (0.0008) [2023-12-26 12:51:32,488][123091] Updated weights for policy 0, policy_version 1661124 (0.0008) [2023-12-26 12:51:32,536][123090] Updated weights for policy 1, policy_version 1649954 (0.0010) [2023-12-26 12:51:32,550][123091] Updated weights for policy 0, policy_version 1661134 (0.0008) [2023-12-26 12:51:32,601][123090] Updated weights for policy 1, policy_version 1649964 (0.0005) [2023-12-26 12:51:32,674][123090] Updated weights for policy 1, policy_version 1649974 (0.0005) [2023-12-26 12:51:32,730][123090] Updated weights for policy 1, policy_version 1649984 (0.0005) [2023-12-26 12:51:33,342][123091] Updated weights for policy 0, policy_version 1661144 (0.0007) [2023-12-26 12:51:33,392][123091] Updated weights for policy 0, policy_version 1661154 (0.0006) [2023-12-26 12:51:33,397][123090] Updated weights for policy 1, policy_version 1649994 (0.0010) [2023-12-26 12:51:33,446][123091] Updated weights for policy 0, policy_version 1661164 (0.0006) [2023-12-26 12:51:33,460][123090] Updated weights for policy 1, policy_version 1650004 (0.0010) [2023-12-26 12:51:33,534][123090] Updated weights for policy 1, policy_version 1650014 (0.0011) [2023-12-26 12:51:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 847667200. Throughput: 0: 9134.7, 1: 8859.6. Samples: 847676052. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:33,784][121949] Avg episode reward: [(0, '6050.710'), (1, '5449.219')] [2023-12-26 12:51:34,253][123090] Updated weights for policy 1, policy_version 1650024 (0.0010) [2023-12-26 12:51:34,265][123091] Updated weights for policy 0, policy_version 1661174 (0.0008) [2023-12-26 12:51:34,322][123090] Updated weights for policy 1, policy_version 1650034 (0.0008) [2023-12-26 12:51:34,327][123091] Updated weights for policy 0, policy_version 1661184 (0.0011) [2023-12-26 12:51:34,389][123090] Updated weights for policy 1, policy_version 1650044 (0.0006) [2023-12-26 12:51:34,390][123091] Updated weights for policy 0, policy_version 1661194 (0.0011) [2023-12-26 12:51:35,208][123091] Updated weights for policy 0, policy_version 1661204 (0.0010) [2023-12-26 12:51:35,210][123090] Updated weights for policy 1, policy_version 1650054 (0.0007) [2023-12-26 12:51:35,259][123091] Updated weights for policy 0, policy_version 1661214 (0.0010) [2023-12-26 12:51:35,278][123090] Updated weights for policy 1, policy_version 1650064 (0.0006) [2023-12-26 12:51:35,321][123091] Updated weights for policy 0, policy_version 1661224 (0.0010) [2023-12-26 12:51:35,333][123090] Updated weights for policy 1, policy_version 1650074 (0.0007) [2023-12-26 12:51:36,109][123091] Updated weights for policy 0, policy_version 1661234 (0.0010) [2023-12-26 12:51:36,179][123090] Updated weights for policy 1, policy_version 1650084 (0.0008) [2023-12-26 12:51:36,182][123091] Updated weights for policy 0, policy_version 1661244 (0.0009) [2023-12-26 12:51:36,233][123090] Updated weights for policy 1, policy_version 1650094 (0.0009) [2023-12-26 12:51:36,249][123091] Updated weights for policy 0, policy_version 1661254 (0.0010) [2023-12-26 12:51:36,290][123090] Updated weights for policy 1, policy_version 1650104 (0.0006) [2023-12-26 12:51:36,313][123091] Updated weights for policy 0, policy_version 1661264 (0.0011) [2023-12-26 12:51:37,034][123091] Updated weights for policy 0, policy_version 1661274 (0.0005) [2023-12-26 12:51:37,087][123091] Updated weights for policy 0, policy_version 1661284 (0.0007) [2023-12-26 12:51:37,127][123090] Updated weights for policy 1, policy_version 1650114 (0.0008) [2023-12-26 12:51:37,142][123091] Updated weights for policy 0, policy_version 1661294 (0.0011) [2023-12-26 12:51:37,197][123090] Updated weights for policy 1, policy_version 1650124 (0.0008) [2023-12-26 12:51:37,250][123090] Updated weights for policy 1, policy_version 1650134 (0.0008) [2023-12-26 12:51:37,299][123090] Updated weights for policy 1, policy_version 1650144 (0.0009) [2023-12-26 12:51:37,940][123091] Updated weights for policy 0, policy_version 1661304 (0.0010) [2023-12-26 12:51:38,010][123091] Updated weights for policy 0, policy_version 1661314 (0.0011) [2023-12-26 12:51:38,072][123091] Updated weights for policy 0, policy_version 1661324 (0.0010) [2023-12-26 12:51:38,131][123090] Updated weights for policy 1, policy_version 1650154 (0.0008) [2023-12-26 12:51:38,179][123090] Updated weights for policy 1, policy_version 1650164 (0.0008) [2023-12-26 12:51:38,237][123090] Updated weights for policy 1, policy_version 1650174 (0.0009) [2023-12-26 12:51:38,752][123091] Updated weights for policy 0, policy_version 1661334 (0.0011) [2023-12-26 12:51:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 847749120. Throughput: 0: 9133.5, 1: 8886.7. Samples: 847728644. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:38,785][121949] Avg episode reward: [(0, '5951.843'), (1, '5544.428')] [2023-12-26 12:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001650176_422445056.pth... [2023-12-26 12:51:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001649184_422191104.pth [2023-12-26 12:51:38,818][123091] Updated weights for policy 0, policy_version 1661344 (0.0011) [2023-12-26 12:51:38,885][123091] Updated weights for policy 0, policy_version 1661354 (0.0011) [2023-12-26 12:51:38,913][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001661360_425312256.pth... [2023-12-26 12:51:38,916][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001660272_425033728.pth [2023-12-26 12:51:39,020][123090] Updated weights for policy 1, policy_version 1650184 (0.0008) [2023-12-26 12:51:39,085][123090] Updated weights for policy 1, policy_version 1650194 (0.0009) [2023-12-26 12:51:39,148][123090] Updated weights for policy 1, policy_version 1650204 (0.0009) [2023-12-26 12:51:39,682][123091] Updated weights for policy 0, policy_version 1661364 (0.0010) [2023-12-26 12:51:39,748][123091] Updated weights for policy 0, policy_version 1661374 (0.0007) [2023-12-26 12:51:39,806][123091] Updated weights for policy 0, policy_version 1661384 (0.0008) [2023-12-26 12:51:39,871][123090] Updated weights for policy 1, policy_version 1650214 (0.0009) [2023-12-26 12:51:39,943][123090] Updated weights for policy 1, policy_version 1650224 (0.0009) [2023-12-26 12:51:40,012][123090] Updated weights for policy 1, policy_version 1650234 (0.0008) [2023-12-26 12:51:40,619][123091] Updated weights for policy 0, policy_version 1661394 (0.0009) [2023-12-26 12:51:40,690][123091] Updated weights for policy 0, policy_version 1661404 (0.0009) [2023-12-26 12:51:40,759][123091] Updated weights for policy 0, policy_version 1661414 (0.0009) [2023-12-26 12:51:40,817][123091] Updated weights for policy 0, policy_version 1661424 (0.0009) [2023-12-26 12:51:40,822][123090] Updated weights for policy 1, policy_version 1650244 (0.0007) [2023-12-26 12:51:40,871][123090] Updated weights for policy 1, policy_version 1650254 (0.0005) [2023-12-26 12:51:40,940][123090] Updated weights for policy 1, policy_version 1650264 (0.0005) [2023-12-26 12:51:41,690][123090] Updated weights for policy 1, policy_version 1650274 (0.0006) [2023-12-26 12:51:41,757][123091] Updated weights for policy 0, policy_version 1661434 (0.0008) [2023-12-26 12:51:41,763][123090] Updated weights for policy 1, policy_version 1650284 (0.0010) [2023-12-26 12:51:41,825][123091] Updated weights for policy 0, policy_version 1661444 (0.0007) [2023-12-26 12:51:41,828][123090] Updated weights for policy 1, policy_version 1650294 (0.0010) [2023-12-26 12:51:41,887][123090] Updated weights for policy 1, policy_version 1650304 (0.0006) [2023-12-26 12:51:41,889][123091] Updated weights for policy 0, policy_version 1661454 (0.0010) [2023-12-26 12:51:42,718][123090] Updated weights for policy 1, policy_version 1650314 (0.0009) [2023-12-26 12:51:42,721][123091] Updated weights for policy 0, policy_version 1661464 (0.0008) [2023-12-26 12:51:42,771][123090] Updated weights for policy 1, policy_version 1650324 (0.0006) [2023-12-26 12:51:42,782][123091] Updated weights for policy 0, policy_version 1661474 (0.0009) [2023-12-26 12:51:42,835][123090] Updated weights for policy 1, policy_version 1650334 (0.0009) [2023-12-26 12:51:42,839][123091] Updated weights for policy 0, policy_version 1661484 (0.0008) [2023-12-26 12:51:43,667][123090] Updated weights for policy 1, policy_version 1650344 (0.0009) [2023-12-26 12:51:43,669][123091] Updated weights for policy 0, policy_version 1661494 (0.0007) [2023-12-26 12:51:43,725][123091] Updated weights for policy 0, policy_version 1661504 (0.0006) [2023-12-26 12:51:43,731][123090] Updated weights for policy 1, policy_version 1650354 (0.0009) [2023-12-26 12:51:43,777][123091] Updated weights for policy 0, policy_version 1661514 (0.0007) [2023-12-26 12:51:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 847831040. Throughput: 0: 8980.1, 1: 8765.7. Samples: 847833924. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:43,785][121949] Avg episode reward: [(0, '6110.631'), (1, '5442.556')] [2023-12-26 12:51:43,797][123090] Updated weights for policy 1, policy_version 1650364 (0.0008) [2023-12-26 12:51:44,583][123091] Updated weights for policy 0, policy_version 1661524 (0.0010) [2023-12-26 12:51:44,603][123090] Updated weights for policy 1, policy_version 1650374 (0.0006) [2023-12-26 12:51:44,632][123091] Updated weights for policy 0, policy_version 1661534 (0.0009) [2023-12-26 12:51:44,658][123090] Updated weights for policy 1, policy_version 1650384 (0.0008) [2023-12-26 12:51:44,682][123091] Updated weights for policy 0, policy_version 1661544 (0.0009) [2023-12-26 12:51:44,711][123090] Updated weights for policy 1, policy_version 1650394 (0.0008) [2023-12-26 12:51:45,503][123090] Updated weights for policy 1, policy_version 1650404 (0.0008) [2023-12-26 12:51:45,570][123090] Updated weights for policy 1, policy_version 1650414 (0.0009) [2023-12-26 12:51:45,572][123091] Updated weights for policy 0, policy_version 1661554 (0.0008) [2023-12-26 12:51:45,633][123091] Updated weights for policy 0, policy_version 1661564 (0.0009) [2023-12-26 12:51:45,635][123090] Updated weights for policy 1, policy_version 1650424 (0.0007) [2023-12-26 12:51:45,690][123091] Updated weights for policy 0, policy_version 1661574 (0.0008) [2023-12-26 12:51:45,751][123091] Updated weights for policy 0, policy_version 1661584 (0.0009) [2023-12-26 12:51:46,413][123090] Updated weights for policy 1, policy_version 1650434 (0.0009) [2023-12-26 12:51:46,467][123090] Updated weights for policy 1, policy_version 1650444 (0.0009) [2023-12-26 12:51:46,529][123090] Updated weights for policy 1, policy_version 1650454 (0.0009) [2023-12-26 12:51:46,577][123090] Updated weights for policy 1, policy_version 1650464 (0.0009) [2023-12-26 12:51:46,584][123091] Updated weights for policy 0, policy_version 1661594 (0.0008) [2023-12-26 12:51:46,646][123091] Updated weights for policy 0, policy_version 1661604 (0.0009) [2023-12-26 12:51:46,708][123091] Updated weights for policy 0, policy_version 1661614 (0.0010) [2023-12-26 12:51:47,365][123090] Updated weights for policy 1, policy_version 1650474 (0.0005) [2023-12-26 12:51:47,418][123090] Updated weights for policy 1, policy_version 1650484 (0.0005) [2023-12-26 12:51:47,471][123090] Updated weights for policy 1, policy_version 1650494 (0.0005) [2023-12-26 12:51:47,597][123091] Updated weights for policy 0, policy_version 1661624 (0.0007) [2023-12-26 12:51:47,663][123091] Updated weights for policy 0, policy_version 1661634 (0.0005) [2023-12-26 12:51:47,724][123091] Updated weights for policy 0, policy_version 1661644 (0.0009) [2023-12-26 12:51:48,139][123090] Updated weights for policy 1, policy_version 1650504 (0.0008) [2023-12-26 12:51:48,205][123090] Updated weights for policy 1, policy_version 1650514 (0.0009) [2023-12-26 12:51:48,258][123090] Updated weights for policy 1, policy_version 1650524 (0.0009) [2023-12-26 12:51:48,523][123091] Updated weights for policy 0, policy_version 1661654 (0.0010) [2023-12-26 12:51:48,586][123091] Updated weights for policy 0, policy_version 1661664 (0.0011) [2023-12-26 12:51:48,651][123091] Updated weights for policy 0, policy_version 1661674 (0.0011) [2023-12-26 12:51:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 847929344. Throughput: 0: 8945.9, 1: 8776.2. Samples: 847938224. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:48,785][121949] Avg episode reward: [(0, '6178.027'), (1, '5343.865')] [2023-12-26 12:51:49,137][123090] Updated weights for policy 1, policy_version 1650534 (0.0007) [2023-12-26 12:51:49,211][123090] Updated weights for policy 1, policy_version 1650544 (0.0007) [2023-12-26 12:51:49,293][123090] Updated weights for policy 1, policy_version 1650554 (0.0007) [2023-12-26 12:51:49,402][123091] Updated weights for policy 0, policy_version 1661684 (0.0010) [2023-12-26 12:51:49,461][123091] Updated weights for policy 0, policy_version 1661694 (0.0008) [2023-12-26 12:51:49,533][123091] Updated weights for policy 0, policy_version 1661704 (0.0008) [2023-12-26 12:51:50,019][123090] Updated weights for policy 1, policy_version 1650564 (0.0008) [2023-12-26 12:51:50,068][123090] Updated weights for policy 1, policy_version 1650574 (0.0009) [2023-12-26 12:51:50,117][123090] Updated weights for policy 1, policy_version 1650584 (0.0009) [2023-12-26 12:51:50,352][123091] Updated weights for policy 0, policy_version 1661714 (0.0009) [2023-12-26 12:51:50,412][123091] Updated weights for policy 0, policy_version 1661724 (0.0009) [2023-12-26 12:51:50,473][123091] Updated weights for policy 0, policy_version 1661734 (0.0009) [2023-12-26 12:51:50,539][123091] Updated weights for policy 0, policy_version 1661744 (0.0009) [2023-12-26 12:51:50,933][123090] Updated weights for policy 1, policy_version 1650594 (0.0010) [2023-12-26 12:51:50,999][123090] Updated weights for policy 1, policy_version 1650604 (0.0009) [2023-12-26 12:51:51,062][123090] Updated weights for policy 1, policy_version 1650614 (0.0009) [2023-12-26 12:51:51,127][123090] Updated weights for policy 1, policy_version 1650624 (0.0010) [2023-12-26 12:51:51,389][123091] Updated weights for policy 0, policy_version 1661754 (0.0010) [2023-12-26 12:51:51,458][123091] Updated weights for policy 0, policy_version 1661764 (0.0009) [2023-12-26 12:51:51,527][123091] Updated weights for policy 0, policy_version 1661774 (0.0009) [2023-12-26 12:51:51,938][123090] Updated weights for policy 1, policy_version 1650634 (0.0006) [2023-12-26 12:51:51,983][123090] Updated weights for policy 1, policy_version 1650644 (0.0005) [2023-12-26 12:51:52,032][123090] Updated weights for policy 1, policy_version 1650654 (0.0005) [2023-12-26 12:51:52,433][123091] Updated weights for policy 0, policy_version 1661784 (0.0007) [2023-12-26 12:51:52,500][123091] Updated weights for policy 0, policy_version 1661794 (0.0006) [2023-12-26 12:51:52,568][123091] Updated weights for policy 0, policy_version 1661804 (0.0006) [2023-12-26 12:51:52,794][123090] Updated weights for policy 1, policy_version 1650664 (0.0010) [2023-12-26 12:51:52,867][123090] Updated weights for policy 1, policy_version 1650674 (0.0006) [2023-12-26 12:51:52,939][123090] Updated weights for policy 1, policy_version 1650684 (0.0006) [2023-12-26 12:51:53,313][123091] Updated weights for policy 0, policy_version 1661814 (0.0008) [2023-12-26 12:51:53,366][123091] Updated weights for policy 0, policy_version 1661824 (0.0009) [2023-12-26 12:51:53,419][123091] Updated weights for policy 0, policy_version 1661835 (0.0010) [2023-12-26 12:51:53,609][123090] Updated weights for policy 1, policy_version 1650694 (0.0007) [2023-12-26 12:51:53,672][123090] Updated weights for policy 1, policy_version 1650704 (0.0008) [2023-12-26 12:51:53,726][123090] Updated weights for policy 1, policy_version 1650714 (0.0008) [2023-12-26 12:51:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 848019456. Throughput: 0: 8906.4, 1: 8717.5. Samples: 847989924. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:53,785][121949] Avg episode reward: [(0, '6155.092'), (1, '5212.224')] [2023-12-26 12:51:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001661840_425435136.pth... [2023-12-26 12:51:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001650720_422584320.pth... [2023-12-26 12:51:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001649664_422313984.pth [2023-12-26 12:51:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001660816_425172992.pth [2023-12-26 12:51:54,300][123091] Updated weights for policy 0, policy_version 1661845 (0.0009) [2023-12-26 12:51:54,348][123091] Updated weights for policy 0, policy_version 1661855 (0.0009) [2023-12-26 12:51:54,400][123091] Updated weights for policy 0, policy_version 1661865 (0.0009) [2023-12-26 12:51:54,514][123090] Updated weights for policy 1, policy_version 1650724 (0.0010) [2023-12-26 12:51:54,565][123090] Updated weights for policy 1, policy_version 1650734 (0.0010) [2023-12-26 12:51:54,628][123090] Updated weights for policy 1, policy_version 1650744 (0.0010) [2023-12-26 12:51:55,269][123091] Updated weights for policy 0, policy_version 1661875 (0.0009) [2023-12-26 12:51:55,316][123091] Updated weights for policy 0, policy_version 1661885 (0.0009) [2023-12-26 12:51:55,364][123091] Updated weights for policy 0, policy_version 1661895 (0.0008) [2023-12-26 12:51:55,447][123090] Updated weights for policy 1, policy_version 1650754 (0.0010) [2023-12-26 12:51:55,506][123090] Updated weights for policy 1, policy_version 1650764 (0.0010) [2023-12-26 12:51:55,571][123090] Updated weights for policy 1, policy_version 1650774 (0.0010) [2023-12-26 12:51:55,633][123090] Updated weights for policy 1, policy_version 1650784 (0.0010) [2023-12-26 12:51:56,159][123091] Updated weights for policy 0, policy_version 1661905 (0.0008) [2023-12-26 12:51:56,225][123091] Updated weights for policy 0, policy_version 1661915 (0.0009) [2023-12-26 12:51:56,295][123091] Updated weights for policy 0, policy_version 1661925 (0.0010) [2023-12-26 12:51:56,348][123091] Updated weights for policy 0, policy_version 1661936 (0.0010) [2023-12-26 12:51:56,413][123090] Updated weights for policy 1, policy_version 1650794 (0.0010) [2023-12-26 12:51:56,464][123090] Updated weights for policy 1, policy_version 1650804 (0.0010) [2023-12-26 12:51:56,514][123090] Updated weights for policy 1, policy_version 1650814 (0.0010) [2023-12-26 12:51:57,175][123091] Updated weights for policy 0, policy_version 1661946 (0.0008) [2023-12-26 12:51:57,226][123091] Updated weights for policy 0, policy_version 1661956 (0.0008) [2023-12-26 12:51:57,280][123091] Updated weights for policy 0, policy_version 1661966 (0.0008) [2023-12-26 12:51:57,343][123090] Updated weights for policy 1, policy_version 1650824 (0.0010) [2023-12-26 12:51:57,401][123090] Updated weights for policy 1, policy_version 1650834 (0.0010) [2023-12-26 12:51:57,448][123090] Updated weights for policy 1, policy_version 1650844 (0.0010) [2023-12-26 12:51:58,081][123091] Updated weights for policy 0, policy_version 1661976 (0.0007) [2023-12-26 12:51:58,148][123091] Updated weights for policy 0, policy_version 1661986 (0.0008) [2023-12-26 12:51:58,214][123091] Updated weights for policy 0, policy_version 1661996 (0.0009) [2023-12-26 12:51:58,319][123090] Updated weights for policy 1, policy_version 1650854 (0.0009) [2023-12-26 12:51:58,387][123090] Updated weights for policy 1, policy_version 1650864 (0.0010) [2023-12-26 12:51:58,454][123090] Updated weights for policy 1, policy_version 1650874 (0.0008) [2023-12-26 12:51:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 848101376. Throughput: 0: 8906.3, 1: 8776.1. Samples: 848095804. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:51:58,785][121949] Avg episode reward: [(0, '5853.125'), (1, '5102.084')] [2023-12-26 12:51:59,046][123091] Updated weights for policy 0, policy_version 1662006 (0.0008) [2023-12-26 12:51:59,116][123091] Updated weights for policy 0, policy_version 1662016 (0.0007) [2023-12-26 12:51:59,165][123091] Updated weights for policy 0, policy_version 1662026 (0.0009) [2023-12-26 12:51:59,353][123090] Updated weights for policy 1, policy_version 1650884 (0.0009) [2023-12-26 12:51:59,420][123090] Updated weights for policy 1, policy_version 1650894 (0.0011) [2023-12-26 12:51:59,477][123090] Updated weights for policy 1, policy_version 1650904 (0.0009) [2023-12-26 12:51:59,931][123091] Updated weights for policy 0, policy_version 1662036 (0.0010) [2023-12-26 12:51:59,999][123091] Updated weights for policy 0, policy_version 1662046 (0.0006) [2023-12-26 12:52:00,059][123091] Updated weights for policy 0, policy_version 1662056 (0.0005) [2023-12-26 12:52:00,256][123090] Updated weights for policy 1, policy_version 1650914 (0.0009) [2023-12-26 12:52:00,317][123090] Updated weights for policy 1, policy_version 1650924 (0.0009) [2023-12-26 12:52:00,384][123090] Updated weights for policy 1, policy_version 1650934 (0.0011) [2023-12-26 12:52:00,455][123090] Updated weights for policy 1, policy_version 1650944 (0.0011) [2023-12-26 12:52:00,708][123091] Updated weights for policy 0, policy_version 1662066 (0.0006) [2023-12-26 12:52:00,775][123091] Updated weights for policy 0, policy_version 1662076 (0.0007) [2023-12-26 12:52:00,847][123091] Updated weights for policy 0, policy_version 1662086 (0.0008) [2023-12-26 12:52:00,915][123091] Updated weights for policy 0, policy_version 1662096 (0.0008) [2023-12-26 12:52:01,258][123090] Updated weights for policy 1, policy_version 1650954 (0.0009) [2023-12-26 12:52:01,312][123090] Updated weights for policy 1, policy_version 1650964 (0.0006) [2023-12-26 12:52:01,384][123090] Updated weights for policy 1, policy_version 1650974 (0.0008) [2023-12-26 12:52:01,670][123091] Updated weights for policy 0, policy_version 1662106 (0.0010) [2023-12-26 12:52:01,731][123091] Updated weights for policy 0, policy_version 1662116 (0.0010) [2023-12-26 12:52:01,782][123091] Updated weights for policy 0, policy_version 1662126 (0.0009) [2023-12-26 12:52:02,178][123090] Updated weights for policy 1, policy_version 1650984 (0.0007) [2023-12-26 12:52:02,227][123090] Updated weights for policy 1, policy_version 1650994 (0.0005) [2023-12-26 12:52:02,283][123090] Updated weights for policy 1, policy_version 1651004 (0.0007) [2023-12-26 12:52:02,660][123091] Updated weights for policy 0, policy_version 1662136 (0.0009) [2023-12-26 12:52:02,723][123091] Updated weights for policy 0, policy_version 1662146 (0.0008) [2023-12-26 12:52:02,789][123091] Updated weights for policy 0, policy_version 1662156 (0.0006) [2023-12-26 12:52:03,013][123090] Updated weights for policy 1, policy_version 1651014 (0.0006) [2023-12-26 12:52:03,060][123090] Updated weights for policy 1, policy_version 1651024 (0.0005) [2023-12-26 12:52:03,108][123090] Updated weights for policy 1, policy_version 1651034 (0.0005) [2023-12-26 12:52:03,451][123091] Updated weights for policy 0, policy_version 1662166 (0.0008) [2023-12-26 12:52:03,512][123091] Updated weights for policy 0, policy_version 1662177 (0.0010) [2023-12-26 12:52:03,565][123091] Updated weights for policy 0, policy_version 1662187 (0.0009) [2023-12-26 12:52:03,765][123090] Updated weights for policy 1, policy_version 1651044 (0.0007) [2023-12-26 12:52:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 848191488. Throughput: 0: 8861.7, 1: 8836.3. Samples: 848203908. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:52:03,785][121949] Avg episode reward: [(0, '5915.956'), (1, '5302.804')] [2023-12-26 12:52:03,813][123090] Updated weights for policy 1, policy_version 1651054 (0.0009) [2023-12-26 12:52:03,880][123090] Updated weights for policy 1, policy_version 1651064 (0.0009) [2023-12-26 12:52:04,492][123091] Updated weights for policy 0, policy_version 1662198 (0.0010) [2023-12-26 12:52:04,561][123091] Updated weights for policy 0, policy_version 1662208 (0.0006) [2023-12-26 12:52:04,591][123090] Updated weights for policy 1, policy_version 1651074 (0.0006) [2023-12-26 12:52:04,628][123091] Updated weights for policy 0, policy_version 1662218 (0.0009) [2023-12-26 12:52:04,656][123090] Updated weights for policy 1, policy_version 1651084 (0.0008) [2023-12-26 12:52:04,714][123090] Updated weights for policy 1, policy_version 1651094 (0.0010) [2023-12-26 12:52:04,770][123090] Updated weights for policy 1, policy_version 1651104 (0.0008) [2023-12-26 12:52:05,333][123091] Updated weights for policy 0, policy_version 1662228 (0.0008) [2023-12-26 12:52:05,401][123091] Updated weights for policy 0, policy_version 1662238 (0.0009) [2023-12-26 12:52:05,456][123091] Updated weights for policy 0, policy_version 1662248 (0.0009) [2023-12-26 12:52:05,626][123090] Updated weights for policy 1, policy_version 1651114 (0.0010) [2023-12-26 12:52:05,681][123090] Updated weights for policy 1, policy_version 1651124 (0.0011) [2023-12-26 12:52:05,730][123090] Updated weights for policy 1, policy_version 1651135 (0.0009) [2023-12-26 12:52:06,280][123091] Updated weights for policy 0, policy_version 1662258 (0.0009) [2023-12-26 12:52:06,344][123091] Updated weights for policy 0, policy_version 1662268 (0.0009) [2023-12-26 12:52:06,404][123091] Updated weights for policy 0, policy_version 1662278 (0.0009) [2023-12-26 12:52:06,458][123091] Updated weights for policy 0, policy_version 1662288 (0.0009) [2023-12-26 12:52:06,609][123090] Updated weights for policy 1, policy_version 1651145 (0.0009) [2023-12-26 12:52:06,677][123090] Updated weights for policy 1, policy_version 1651155 (0.0009) [2023-12-26 12:52:06,739][123090] Updated weights for policy 1, policy_version 1651165 (0.0009) [2023-12-26 12:52:07,306][123091] Updated weights for policy 0, policy_version 1662298 (0.0010) [2023-12-26 12:52:07,369][123091] Updated weights for policy 0, policy_version 1662309 (0.0009) [2023-12-26 12:52:07,420][123091] Updated weights for policy 0, policy_version 1662319 (0.0009) [2023-12-26 12:52:07,563][123090] Updated weights for policy 1, policy_version 1651175 (0.0009) [2023-12-26 12:52:07,625][123090] Updated weights for policy 1, policy_version 1651185 (0.0011) [2023-12-26 12:52:07,689][123090] Updated weights for policy 1, policy_version 1651195 (0.0010) [2023-12-26 12:52:08,289][123091] Updated weights for policy 0, policy_version 1662329 (0.0008) [2023-12-26 12:52:08,349][123091] Updated weights for policy 0, policy_version 1662339 (0.0009) [2023-12-26 12:52:08,415][123091] Updated weights for policy 0, policy_version 1662350 (0.0011) [2023-12-26 12:52:08,491][123090] Updated weights for policy 1, policy_version 1651205 (0.0008) [2023-12-26 12:52:08,553][123090] Updated weights for policy 1, policy_version 1651215 (0.0005) [2023-12-26 12:52:08,601][123090] Updated weights for policy 1, policy_version 1651225 (0.0005) [2023-12-26 12:52:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 848281600. Throughput: 0: 8846.6, 1: 8873.8. Samples: 848255892. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 12:52:08,785][121949] Avg episode reward: [(0, '6218.620'), (1, '5496.757')] [2023-12-26 12:52:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001662352_425566208.pth... [2023-12-26 12:52:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001651232_422715392.pth... [2023-12-26 12:52:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001661360_425312256.pth [2023-12-26 12:52:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001650176_422445056.pth [2023-12-26 12:52:09,293][123090] Updated weights for policy 1, policy_version 1651235 (0.0006) [2023-12-26 12:52:09,310][123091] Updated weights for policy 0, policy_version 1662360 (0.0009) [2023-12-26 12:52:09,364][123090] Updated weights for policy 1, policy_version 1651245 (0.0009) [2023-12-26 12:52:09,379][123091] Updated weights for policy 0, policy_version 1662370 (0.0008) [2023-12-26 12:52:09,442][123090] Updated weights for policy 1, policy_version 1651255 (0.0009) [2023-12-26 12:52:09,449][123091] Updated weights for policy 0, policy_version 1662380 (0.0008) [2023-12-26 12:52:10,217][123091] Updated weights for policy 0, policy_version 1662390 (0.0008) [2023-12-26 12:52:10,220][123090] Updated weights for policy 1, policy_version 1651265 (0.0008) [2023-12-26 12:52:10,280][123091] Updated weights for policy 0, policy_version 1662400 (0.0009) [2023-12-26 12:52:10,287][123090] Updated weights for policy 1, policy_version 1651275 (0.0006) [2023-12-26 12:52:10,338][123091] Updated weights for policy 0, policy_version 1662410 (0.0009) [2023-12-26 12:52:10,359][123090] Updated weights for policy 1, policy_version 1651285 (0.0007) [2023-12-26 12:52:10,418][123090] Updated weights for policy 1, policy_version 1651295 (0.0009) [2023-12-26 12:52:11,112][123091] Updated weights for policy 0, policy_version 1662420 (0.0008) [2023-12-26 12:52:11,182][123091] Updated weights for policy 0, policy_version 1662430 (0.0007) [2023-12-26 12:52:11,258][123091] Updated weights for policy 0, policy_version 1662440 (0.0007) [2023-12-26 12:52:11,322][123090] Updated weights for policy 1, policy_version 1651305 (0.0009) [2023-12-26 12:52:11,396][123090] Updated weights for policy 1, policy_version 1651315 (0.0008) [2023-12-26 12:52:11,459][123090] Updated weights for policy 1, policy_version 1651325 (0.0008) [2023-12-26 12:52:12,154][123091] Updated weights for policy 0, policy_version 1662450 (0.0010) [2023-12-26 12:52:12,190][123090] Updated weights for policy 1, policy_version 1651335 (0.0009) [2023-12-26 12:52:12,214][123091] Updated weights for policy 0, policy_version 1662460 (0.0006) [2023-12-26 12:52:12,235][123090] Updated weights for policy 1, policy_version 1651345 (0.0010) [2023-12-26 12:52:12,272][123091] Updated weights for policy 0, policy_version 1662470 (0.0008) [2023-12-26 12:52:12,299][123090] Updated weights for policy 1, policy_version 1651355 (0.0010) [2023-12-26 12:52:12,339][123091] Updated weights for policy 0, policy_version 1662480 (0.0007) [2023-12-26 12:52:13,172][123090] Updated weights for policy 1, policy_version 1651365 (0.0011) [2023-12-26 12:52:13,188][123091] Updated weights for policy 0, policy_version 1662490 (0.0007) [2023-12-26 12:52:13,242][123090] Updated weights for policy 1, policy_version 1651375 (0.0010) [2023-12-26 12:52:13,253][123091] Updated weights for policy 0, policy_version 1662500 (0.0007) [2023-12-26 12:52:13,309][123090] Updated weights for policy 1, policy_version 1651385 (0.0010) [2023-12-26 12:52:13,311][123091] Updated weights for policy 0, policy_version 1662510 (0.0008) [2023-12-26 12:52:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 848363520. Throughput: 0: 8701.2, 1: 8882.9. Samples: 848358504. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:13,785][121949] Avg episode reward: [(0, '6108.486'), (1, '5220.360')] [2023-12-26 12:52:14,027][123090] Updated weights for policy 1, policy_version 1651395 (0.0010) [2023-12-26 12:52:14,082][123090] Updated weights for policy 1, policy_version 1651405 (0.0009) [2023-12-26 12:52:14,100][123091] Updated weights for policy 0, policy_version 1662520 (0.0006) [2023-12-26 12:52:14,141][123090] Updated weights for policy 1, policy_version 1651415 (0.0009) [2023-12-26 12:52:14,157][123091] Updated weights for policy 0, policy_version 1662530 (0.0009) [2023-12-26 12:52:14,216][123091] Updated weights for policy 0, policy_version 1662540 (0.0010) [2023-12-26 12:52:14,934][123090] Updated weights for policy 1, policy_version 1651425 (0.0005) [2023-12-26 12:52:15,004][123090] Updated weights for policy 1, policy_version 1651435 (0.0008) [2023-12-26 12:52:15,034][123091] Updated weights for policy 0, policy_version 1662550 (0.0008) [2023-12-26 12:52:15,068][123090] Updated weights for policy 1, policy_version 1651445 (0.0008) [2023-12-26 12:52:15,096][123091] Updated weights for policy 0, policy_version 1662560 (0.0009) [2023-12-26 12:52:15,132][123090] Updated weights for policy 1, policy_version 1651455 (0.0008) [2023-12-26 12:52:15,150][123091] Updated weights for policy 0, policy_version 1662570 (0.0008) [2023-12-26 12:52:15,844][123090] Updated weights for policy 1, policy_version 1651465 (0.0009) [2023-12-26 12:52:15,898][123090] Updated weights for policy 1, policy_version 1651476 (0.0009) [2023-12-26 12:52:15,954][123090] Updated weights for policy 1, policy_version 1651486 (0.0007) [2023-12-26 12:52:15,996][123091] Updated weights for policy 0, policy_version 1662580 (0.0010) [2023-12-26 12:52:16,045][123091] Updated weights for policy 0, policy_version 1662590 (0.0009) [2023-12-26 12:52:16,101][123091] Updated weights for policy 0, policy_version 1662600 (0.0010) [2023-12-26 12:52:16,706][123090] Updated weights for policy 1, policy_version 1651496 (0.0005) [2023-12-26 12:52:16,753][123090] Updated weights for policy 1, policy_version 1651506 (0.0005) [2023-12-26 12:52:16,803][123090] Updated weights for policy 1, policy_version 1651516 (0.0008) [2023-12-26 12:52:17,005][123091] Updated weights for policy 0, policy_version 1662610 (0.0010) [2023-12-26 12:52:17,064][123091] Updated weights for policy 0, policy_version 1662620 (0.0009) [2023-12-26 12:52:17,119][123091] Updated weights for policy 0, policy_version 1662630 (0.0009) [2023-12-26 12:52:17,185][123091] Updated weights for policy 0, policy_version 1662640 (0.0009) [2023-12-26 12:52:17,620][123090] Updated weights for policy 1, policy_version 1651526 (0.0009) [2023-12-26 12:52:17,684][123090] Updated weights for policy 1, policy_version 1651536 (0.0009) [2023-12-26 12:52:17,741][123090] Updated weights for policy 1, policy_version 1651546 (0.0008) [2023-12-26 12:52:18,002][123091] Updated weights for policy 0, policy_version 1662650 (0.0009) [2023-12-26 12:52:18,061][123091] Updated weights for policy 0, policy_version 1662660 (0.0010) [2023-12-26 12:52:18,113][123091] Updated weights for policy 0, policy_version 1662670 (0.0009) [2023-12-26 12:52:18,595][123090] Updated weights for policy 1, policy_version 1651556 (0.0009) [2023-12-26 12:52:18,663][123090] Updated weights for policy 1, policy_version 1651566 (0.0009) [2023-12-26 12:52:18,716][123090] Updated weights for policy 1, policy_version 1651576 (0.0009) [2023-12-26 12:52:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 848453632. Throughput: 0: 8636.4, 1: 8871.4. Samples: 848463904. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:18,785][121949] Avg episode reward: [(0, '5938.086'), (1, '4965.473')] [2023-12-26 12:52:18,917][123091] Updated weights for policy 0, policy_version 1662680 (0.0010) [2023-12-26 12:52:18,985][123091] Updated weights for policy 0, policy_version 1662690 (0.0006) [2023-12-26 12:52:19,057][123091] Updated weights for policy 0, policy_version 1662700 (0.0005) [2023-12-26 12:52:19,632][123090] Updated weights for policy 1, policy_version 1651586 (0.0009) [2023-12-26 12:52:19,704][123090] Updated weights for policy 1, policy_version 1651596 (0.0009) [2023-12-26 12:52:19,754][123091] Updated weights for policy 0, policy_version 1662710 (0.0006) [2023-12-26 12:52:19,766][123090] Updated weights for policy 1, policy_version 1651606 (0.0009) [2023-12-26 12:52:19,819][123091] Updated weights for policy 0, policy_version 1662720 (0.0009) [2023-12-26 12:52:19,836][123090] Updated weights for policy 1, policy_version 1651616 (0.0010) [2023-12-26 12:52:19,895][123091] Updated weights for policy 0, policy_version 1662730 (0.0006) [2023-12-26 12:52:20,701][123090] Updated weights for policy 1, policy_version 1651626 (0.0006) [2023-12-26 12:52:20,732][123091] Updated weights for policy 0, policy_version 1662740 (0.0008) [2023-12-26 12:52:20,760][123090] Updated weights for policy 1, policy_version 1651636 (0.0010) [2023-12-26 12:52:20,789][123091] Updated weights for policy 0, policy_version 1662750 (0.0007) [2023-12-26 12:52:20,827][123090] Updated weights for policy 1, policy_version 1651646 (0.0011) [2023-12-26 12:52:20,850][123091] Updated weights for policy 0, policy_version 1662760 (0.0007) [2023-12-26 12:52:21,641][123090] Updated weights for policy 1, policy_version 1651656 (0.0009) [2023-12-26 12:52:21,710][123090] Updated weights for policy 1, policy_version 1651666 (0.0009) [2023-12-26 12:52:21,721][123091] Updated weights for policy 0, policy_version 1662770 (0.0008) [2023-12-26 12:52:21,786][123090] Updated weights for policy 1, policy_version 1651676 (0.0007) [2023-12-26 12:52:21,792][123091] Updated weights for policy 0, policy_version 1662780 (0.0008) [2023-12-26 12:52:21,858][123091] Updated weights for policy 0, policy_version 1662790 (0.0008) [2023-12-26 12:52:21,914][123091] Updated weights for policy 0, policy_version 1662800 (0.0008) [2023-12-26 12:52:22,632][123090] Updated weights for policy 1, policy_version 1651686 (0.0008) [2023-12-26 12:52:22,693][123090] Updated weights for policy 1, policy_version 1651696 (0.0009) [2023-12-26 12:52:22,744][123091] Updated weights for policy 0, policy_version 1662810 (0.0011) [2023-12-26 12:52:22,755][123090] Updated weights for policy 1, policy_version 1651706 (0.0007) [2023-12-26 12:52:22,791][123091] Updated weights for policy 0, policy_version 1662820 (0.0010) [2023-12-26 12:52:22,850][123091] Updated weights for policy 0, policy_version 1662830 (0.0010) [2023-12-26 12:52:23,610][123090] Updated weights for policy 1, policy_version 1651716 (0.0006) [2023-12-26 12:52:23,646][123091] Updated weights for policy 0, policy_version 1662840 (0.0008) [2023-12-26 12:52:23,663][123090] Updated weights for policy 1, policy_version 1651726 (0.0008) [2023-12-26 12:52:23,705][123091] Updated weights for policy 0, policy_version 1662850 (0.0008) [2023-12-26 12:52:23,710][123090] Updated weights for policy 1, policy_version 1651736 (0.0008) [2023-12-26 12:52:23,768][123091] Updated weights for policy 0, policy_version 1662860 (0.0008) [2023-12-26 12:52:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 848535552. Throughput: 0: 8621.0, 1: 8837.2. Samples: 848514260. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:23,785][121949] Avg episode reward: [(0, '5897.807'), (1, '5037.069')] [2023-12-26 12:52:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001651744_422846464.pth... [2023-12-26 12:52:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001650720_422584320.pth [2023-12-26 12:52:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001662864_425697280.pth... [2023-12-26 12:52:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001661840_425435136.pth [2023-12-26 12:52:24,401][123091] Updated weights for policy 0, policy_version 1662870 (0.0006) [2023-12-26 12:52:24,452][123091] Updated weights for policy 0, policy_version 1662880 (0.0005) [2023-12-26 12:52:24,509][123091] Updated weights for policy 0, policy_version 1662890 (0.0005) [2023-12-26 12:52:24,639][123090] Updated weights for policy 1, policy_version 1651746 (0.0009) [2023-12-26 12:52:24,698][123090] Updated weights for policy 1, policy_version 1651756 (0.0010) [2023-12-26 12:52:24,753][123090] Updated weights for policy 1, policy_version 1651766 (0.0010) [2023-12-26 12:52:24,807][123090] Updated weights for policy 1, policy_version 1651776 (0.0010) [2023-12-26 12:52:25,162][123091] Updated weights for policy 0, policy_version 1662900 (0.0005) [2023-12-26 12:52:25,236][123091] Updated weights for policy 0, policy_version 1662910 (0.0006) [2023-12-26 12:52:25,304][123091] Updated weights for policy 0, policy_version 1662920 (0.0010) [2023-12-26 12:52:25,718][123090] Updated weights for policy 1, policy_version 1651786 (0.0009) [2023-12-26 12:52:25,779][123090] Updated weights for policy 1, policy_version 1651796 (0.0008) [2023-12-26 12:52:25,842][123090] Updated weights for policy 1, policy_version 1651806 (0.0009) [2023-12-26 12:52:26,062][123091] Updated weights for policy 0, policy_version 1662930 (0.0009) [2023-12-26 12:52:26,129][123091] Updated weights for policy 0, policy_version 1662940 (0.0005) [2023-12-26 12:52:26,199][123091] Updated weights for policy 0, policy_version 1662950 (0.0006) [2023-12-26 12:52:26,260][123091] Updated weights for policy 0, policy_version 1662960 (0.0005) [2023-12-26 12:52:26,692][123090] Updated weights for policy 1, policy_version 1651816 (0.0008) [2023-12-26 12:52:26,742][123090] Updated weights for policy 1, policy_version 1651826 (0.0008) [2023-12-26 12:52:26,797][123090] Updated weights for policy 1, policy_version 1651836 (0.0009) [2023-12-26 12:52:26,870][123091] Updated weights for policy 0, policy_version 1662970 (0.0008) [2023-12-26 12:52:26,921][123091] Updated weights for policy 0, policy_version 1662980 (0.0008) [2023-12-26 12:52:26,984][123091] Updated weights for policy 0, policy_version 1662990 (0.0009) [2023-12-26 12:52:27,499][123090] Updated weights for policy 1, policy_version 1651846 (0.0009) [2023-12-26 12:52:27,563][123090] Updated weights for policy 1, policy_version 1651856 (0.0009) [2023-12-26 12:52:27,626][123090] Updated weights for policy 1, policy_version 1651866 (0.0009) [2023-12-26 12:52:27,760][123091] Updated weights for policy 0, policy_version 1663000 (0.0009) [2023-12-26 12:52:27,830][123091] Updated weights for policy 0, policy_version 1663010 (0.0009) [2023-12-26 12:52:27,883][123091] Updated weights for policy 0, policy_version 1663020 (0.0009) [2023-12-26 12:52:28,440][123090] Updated weights for policy 1, policy_version 1651876 (0.0010) [2023-12-26 12:52:28,495][123090] Updated weights for policy 1, policy_version 1651886 (0.0009) [2023-12-26 12:52:28,566][123090] Updated weights for policy 1, policy_version 1651896 (0.0009) [2023-12-26 12:52:28,680][123091] Updated weights for policy 0, policy_version 1663030 (0.0009) [2023-12-26 12:52:28,745][123091] Updated weights for policy 0, policy_version 1663040 (0.0010) [2023-12-26 12:52:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 848625664. Throughput: 0: 8736.4, 1: 8764.7. Samples: 848621472. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:28,785][121949] Avg episode reward: [(0, '6099.831'), (1, '5531.362')] [2023-12-26 12:52:28,809][123091] Updated weights for policy 0, policy_version 1663050 (0.0009) [2023-12-26 12:52:29,401][123090] Updated weights for policy 1, policy_version 1651906 (0.0009) [2023-12-26 12:52:29,466][123090] Updated weights for policy 1, policy_version 1651916 (0.0009) [2023-12-26 12:52:29,528][123090] Updated weights for policy 1, policy_version 1651926 (0.0009) [2023-12-26 12:52:29,576][123090] Updated weights for policy 1, policy_version 1651936 (0.0009) [2023-12-26 12:52:29,672][123091] Updated weights for policy 0, policy_version 1663060 (0.0010) [2023-12-26 12:52:29,722][123091] Updated weights for policy 0, policy_version 1663070 (0.0009) [2023-12-26 12:52:29,775][123091] Updated weights for policy 0, policy_version 1663080 (0.0009) [2023-12-26 12:52:30,372][123090] Updated weights for policy 1, policy_version 1651946 (0.0007) [2023-12-26 12:52:30,424][123090] Updated weights for policy 1, policy_version 1651956 (0.0009) [2023-12-26 12:52:30,475][123090] Updated weights for policy 1, policy_version 1651966 (0.0008) [2023-12-26 12:52:30,595][123091] Updated weights for policy 0, policy_version 1663090 (0.0009) [2023-12-26 12:52:30,650][123091] Updated weights for policy 0, policy_version 1663100 (0.0009) [2023-12-26 12:52:30,700][123091] Updated weights for policy 0, policy_version 1663110 (0.0009) [2023-12-26 12:52:30,754][123091] Updated weights for policy 0, policy_version 1663120 (0.0009) [2023-12-26 12:52:31,240][123090] Updated weights for policy 1, policy_version 1651976 (0.0006) [2023-12-26 12:52:31,311][123090] Updated weights for policy 1, policy_version 1651986 (0.0008) [2023-12-26 12:52:31,389][123090] Updated weights for policy 1, policy_version 1651996 (0.0007) [2023-12-26 12:52:31,634][123091] Updated weights for policy 0, policy_version 1663130 (0.0007) [2023-12-26 12:52:31,693][123091] Updated weights for policy 0, policy_version 1663140 (0.0006) [2023-12-26 12:52:31,759][123091] Updated weights for policy 0, policy_version 1663150 (0.0007) [2023-12-26 12:52:32,197][123090] Updated weights for policy 1, policy_version 1652006 (0.0009) [2023-12-26 12:52:32,250][123090] Updated weights for policy 1, policy_version 1652016 (0.0009) [2023-12-26 12:52:32,311][123090] Updated weights for policy 1, policy_version 1652026 (0.0009) [2023-12-26 12:52:32,477][123091] Updated weights for policy 0, policy_version 1663160 (0.0009) [2023-12-26 12:52:32,526][123091] Updated weights for policy 0, policy_version 1663170 (0.0009) [2023-12-26 12:52:32,574][123091] Updated weights for policy 0, policy_version 1663180 (0.0007) [2023-12-26 12:52:33,151][123090] Updated weights for policy 1, policy_version 1652036 (0.0008) [2023-12-26 12:52:33,201][123090] Updated weights for policy 1, policy_version 1652046 (0.0005) [2023-12-26 12:52:33,252][123090] Updated weights for policy 1, policy_version 1652056 (0.0005) [2023-12-26 12:52:33,337][123091] Updated weights for policy 0, policy_version 1663190 (0.0005) [2023-12-26 12:52:33,393][123091] Updated weights for policy 0, policy_version 1663200 (0.0007) [2023-12-26 12:52:33,441][123091] Updated weights for policy 0, policy_version 1663210 (0.0008) [2023-12-26 12:52:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 848715776. Throughput: 0: 8783.5, 1: 8750.8. Samples: 848727268. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:33,785][121949] Avg episode reward: [(0, '6056.167'), (1, '5799.375')] [2023-12-26 12:52:34,009][123090] Updated weights for policy 1, policy_version 1652066 (0.0006) [2023-12-26 12:52:34,056][123090] Updated weights for policy 1, policy_version 1652076 (0.0005) [2023-12-26 12:52:34,123][123091] Updated weights for policy 0, policy_version 1663220 (0.0006) [2023-12-26 12:52:34,125][123090] Updated weights for policy 1, policy_version 1652086 (0.0007) [2023-12-26 12:52:34,188][123091] Updated weights for policy 0, policy_version 1663230 (0.0007) [2023-12-26 12:52:34,190][123090] Updated weights for policy 1, policy_version 1652096 (0.0009) [2023-12-26 12:52:34,251][123091] Updated weights for policy 0, policy_version 1663240 (0.0009) [2023-12-26 12:52:34,969][123090] Updated weights for policy 1, policy_version 1652106 (0.0009) [2023-12-26 12:52:35,022][123090] Updated weights for policy 1, policy_version 1652116 (0.0009) [2023-12-26 12:52:35,067][123091] Updated weights for policy 0, policy_version 1663250 (0.0010) [2023-12-26 12:52:35,078][123090] Updated weights for policy 1, policy_version 1652126 (0.0007) [2023-12-26 12:52:35,134][123091] Updated weights for policy 0, policy_version 1663260 (0.0011) [2023-12-26 12:52:35,199][123091] Updated weights for policy 0, policy_version 1663270 (0.0010) [2023-12-26 12:52:35,269][123091] Updated weights for policy 0, policy_version 1663280 (0.0006) [2023-12-26 12:52:35,843][123090] Updated weights for policy 1, policy_version 1652136 (0.0006) [2023-12-26 12:52:35,866][123091] Updated weights for policy 0, policy_version 1663290 (0.0009) [2023-12-26 12:52:35,903][123090] Updated weights for policy 1, policy_version 1652146 (0.0006) [2023-12-26 12:52:35,934][123091] Updated weights for policy 0, policy_version 1663300 (0.0010) [2023-12-26 12:52:35,962][123090] Updated weights for policy 1, policy_version 1652156 (0.0006) [2023-12-26 12:52:35,994][123091] Updated weights for policy 0, policy_version 1663310 (0.0011) [2023-12-26 12:52:36,743][123090] Updated weights for policy 1, policy_version 1652166 (0.0006) [2023-12-26 12:52:36,790][123091] Updated weights for policy 0, policy_version 1663320 (0.0011) [2023-12-26 12:52:36,805][123090] Updated weights for policy 1, policy_version 1652176 (0.0006) [2023-12-26 12:52:36,859][123091] Updated weights for policy 0, policy_version 1663330 (0.0011) [2023-12-26 12:52:36,866][123090] Updated weights for policy 1, policy_version 1652186 (0.0006) [2023-12-26 12:52:36,927][123091] Updated weights for policy 0, policy_version 1663340 (0.0010) [2023-12-26 12:52:37,611][123091] Updated weights for policy 0, policy_version 1663350 (0.0008) [2023-12-26 12:52:37,689][123091] Updated weights for policy 0, policy_version 1663360 (0.0006) [2023-12-26 12:52:37,745][123091] Updated weights for policy 0, policy_version 1663370 (0.0007) [2023-12-26 12:52:37,758][123090] Updated weights for policy 1, policy_version 1652196 (0.0009) [2023-12-26 12:52:37,824][123090] Updated weights for policy 1, policy_version 1652206 (0.0010) [2023-12-26 12:52:37,883][123090] Updated weights for policy 1, policy_version 1652216 (0.0010) [2023-12-26 12:52:38,444][123091] Updated weights for policy 0, policy_version 1663380 (0.0006) [2023-12-26 12:52:38,504][123091] Updated weights for policy 0, policy_version 1663390 (0.0006) [2023-12-26 12:52:38,561][123091] Updated weights for policy 0, policy_version 1663400 (0.0007) [2023-12-26 12:52:38,691][123090] Updated weights for policy 1, policy_version 1652226 (0.0010) [2023-12-26 12:52:38,760][123090] Updated weights for policy 1, policy_version 1652236 (0.0009) [2023-12-26 12:52:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 848805888. Throughput: 0: 8848.7, 1: 8769.8. Samples: 848782760. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:38,785][121949] Avg episode reward: [(0, '5874.707'), (1, '5680.782')] [2023-12-26 12:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001663408_425836544.pth... [2023-12-26 12:52:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001662352_425566208.pth [2023-12-26 12:52:38,813][123090] Updated weights for policy 1, policy_version 1652246 (0.0010) [2023-12-26 12:52:38,882][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001652256_422977536.pth... [2023-12-26 12:52:38,882][123090] Updated weights for policy 1, policy_version 1652256 (0.0010) [2023-12-26 12:52:38,886][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001651232_422715392.pth [2023-12-26 12:52:39,260][123091] Updated weights for policy 0, policy_version 1663410 (0.0006) [2023-12-26 12:52:39,331][123091] Updated weights for policy 0, policy_version 1663420 (0.0008) [2023-12-26 12:52:39,404][123091] Updated weights for policy 0, policy_version 1663430 (0.0009) [2023-12-26 12:52:39,464][123091] Updated weights for policy 0, policy_version 1663440 (0.0009) [2023-12-26 12:52:39,738][123090] Updated weights for policy 1, policy_version 1652266 (0.0010) [2023-12-26 12:52:39,798][123090] Updated weights for policy 1, policy_version 1652276 (0.0010) [2023-12-26 12:52:39,869][123090] Updated weights for policy 1, policy_version 1652286 (0.0011) [2023-12-26 12:52:40,266][123091] Updated weights for policy 0, policy_version 1663450 (0.0008) [2023-12-26 12:52:40,315][123091] Updated weights for policy 0, policy_version 1663460 (0.0009) [2023-12-26 12:52:40,378][123091] Updated weights for policy 0, policy_version 1663470 (0.0007) [2023-12-26 12:52:40,686][123090] Updated weights for policy 1, policy_version 1652296 (0.0011) [2023-12-26 12:52:40,747][123090] Updated weights for policy 1, policy_version 1652306 (0.0010) [2023-12-26 12:52:40,816][123090] Updated weights for policy 1, policy_version 1652316 (0.0007) [2023-12-26 12:52:41,208][123091] Updated weights for policy 0, policy_version 1663480 (0.0009) [2023-12-26 12:52:41,277][123091] Updated weights for policy 0, policy_version 1663490 (0.0009) [2023-12-26 12:52:41,341][123091] Updated weights for policy 0, policy_version 1663500 (0.0010) [2023-12-26 12:52:41,594][123090] Updated weights for policy 1, policy_version 1652326 (0.0005) [2023-12-26 12:52:41,658][123090] Updated weights for policy 1, policy_version 1652336 (0.0008) [2023-12-26 12:52:41,732][123090] Updated weights for policy 1, policy_version 1652346 (0.0006) [2023-12-26 12:52:42,149][123091] Updated weights for policy 0, policy_version 1663510 (0.0007) [2023-12-26 12:52:42,207][123091] Updated weights for policy 0, policy_version 1663520 (0.0008) [2023-12-26 12:52:42,279][123091] Updated weights for policy 0, policy_version 1663530 (0.0008) [2023-12-26 12:52:42,389][123090] Updated weights for policy 1, policy_version 1652356 (0.0008) [2023-12-26 12:52:42,452][123090] Updated weights for policy 1, policy_version 1652366 (0.0010) [2023-12-26 12:52:42,509][123090] Updated weights for policy 1, policy_version 1652376 (0.0010) [2023-12-26 12:52:43,121][123091] Updated weights for policy 0, policy_version 1663540 (0.0008) [2023-12-26 12:52:43,184][123091] Updated weights for policy 0, policy_version 1663550 (0.0010) [2023-12-26 12:52:43,226][123090] Updated weights for policy 1, policy_version 1652386 (0.0009) [2023-12-26 12:52:43,240][123091] Updated weights for policy 0, policy_version 1663560 (0.0009) [2023-12-26 12:52:43,289][123090] Updated weights for policy 1, policy_version 1652396 (0.0008) [2023-12-26 12:52:43,345][123090] Updated weights for policy 1, policy_version 1652406 (0.0010) [2023-12-26 12:52:43,405][123090] Updated weights for policy 1, policy_version 1652416 (0.0009) [2023-12-26 12:52:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 848896000. Throughput: 0: 8933.4, 1: 8717.2. Samples: 848890084. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:43,785][121949] Avg episode reward: [(0, '5860.991'), (1, '5482.274')] [2023-12-26 12:52:43,998][123091] Updated weights for policy 0, policy_version 1663570 (0.0008) [2023-12-26 12:52:44,060][123091] Updated weights for policy 0, policy_version 1663580 (0.0005) [2023-12-26 12:52:44,112][123091] Updated weights for policy 0, policy_version 1663590 (0.0009) [2023-12-26 12:52:44,131][123090] Updated weights for policy 1, policy_version 1652426 (0.0005) [2023-12-26 12:52:44,161][123091] Updated weights for policy 0, policy_version 1663600 (0.0009) [2023-12-26 12:52:44,196][123090] Updated weights for policy 1, policy_version 1652436 (0.0008) [2023-12-26 12:52:44,262][123090] Updated weights for policy 1, policy_version 1652446 (0.0010) [2023-12-26 12:52:44,944][123091] Updated weights for policy 0, policy_version 1663610 (0.0010) [2023-12-26 12:52:44,969][123090] Updated weights for policy 1, policy_version 1652456 (0.0007) [2023-12-26 12:52:45,000][123091] Updated weights for policy 0, policy_version 1663620 (0.0009) [2023-12-26 12:52:45,034][123090] Updated weights for policy 1, policy_version 1652466 (0.0006) [2023-12-26 12:52:45,058][123091] Updated weights for policy 0, policy_version 1663630 (0.0009) [2023-12-26 12:52:45,094][123090] Updated weights for policy 1, policy_version 1652476 (0.0005) [2023-12-26 12:52:45,792][123090] Updated weights for policy 1, policy_version 1652486 (0.0006) [2023-12-26 12:52:45,840][123091] Updated weights for policy 0, policy_version 1663641 (0.0006) [2023-12-26 12:52:45,866][123090] Updated weights for policy 1, policy_version 1652496 (0.0007) [2023-12-26 12:52:45,915][123091] Updated weights for policy 0, policy_version 1663651 (0.0006) [2023-12-26 12:52:45,942][123090] Updated weights for policy 1, policy_version 1652506 (0.0005) [2023-12-26 12:52:45,976][123091] Updated weights for policy 0, policy_version 1663661 (0.0005) [2023-12-26 12:52:46,665][123090] Updated weights for policy 1, policy_version 1652516 (0.0006) [2023-12-26 12:52:46,691][123091] Updated weights for policy 0, policy_version 1663671 (0.0006) [2023-12-26 12:52:46,731][123090] Updated weights for policy 1, policy_version 1652526 (0.0006) [2023-12-26 12:52:46,743][123091] Updated weights for policy 0, policy_version 1663681 (0.0009) [2023-12-26 12:52:46,793][123090] Updated weights for policy 1, policy_version 1652536 (0.0008) [2023-12-26 12:52:46,796][123091] Updated weights for policy 0, policy_version 1663691 (0.0007) [2023-12-26 12:52:47,558][123090] Updated weights for policy 1, policy_version 1652546 (0.0010) [2023-12-26 12:52:47,635][123090] Updated weights for policy 1, policy_version 1652556 (0.0006) [2023-12-26 12:52:47,649][123091] Updated weights for policy 0, policy_version 1663701 (0.0009) [2023-12-26 12:52:47,699][123090] Updated weights for policy 1, policy_version 1652566 (0.0011) [2023-12-26 12:52:47,716][123091] Updated weights for policy 0, policy_version 1663711 (0.0011) [2023-12-26 12:52:47,763][123090] Updated weights for policy 1, policy_version 1652576 (0.0010) [2023-12-26 12:52:47,771][123091] Updated weights for policy 0, policy_version 1663721 (0.0010) [2023-12-26 12:52:48,513][123090] Updated weights for policy 1, policy_version 1652586 (0.0010) [2023-12-26 12:52:48,569][123090] Updated weights for policy 1, policy_version 1652596 (0.0010) [2023-12-26 12:52:48,622][123090] Updated weights for policy 1, policy_version 1652606 (0.0011) [2023-12-26 12:52:48,628][123091] Updated weights for policy 0, policy_version 1663731 (0.0010) [2023-12-26 12:52:48,692][123091] Updated weights for policy 0, policy_version 1663741 (0.0009) [2023-12-26 12:52:48,756][123091] Updated weights for policy 0, policy_version 1663751 (0.0009) [2023-12-26 12:52:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 848986112. Throughput: 0: 8883.5, 1: 8807.0. Samples: 848999980. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:48,785][121949] Avg episode reward: [(0, '6039.221'), (1, '5557.814')] [2023-12-26 12:52:49,456][123090] Updated weights for policy 1, policy_version 1652616 (0.0007) [2023-12-26 12:52:49,526][123090] Updated weights for policy 1, policy_version 1652626 (0.0006) [2023-12-26 12:52:49,530][123091] Updated weights for policy 0, policy_version 1663761 (0.0009) [2023-12-26 12:52:49,590][123091] Updated weights for policy 0, policy_version 1663771 (0.0011) [2023-12-26 12:52:49,591][123090] Updated weights for policy 1, policy_version 1652636 (0.0009) [2023-12-26 12:52:49,654][123091] Updated weights for policy 0, policy_version 1663781 (0.0011) [2023-12-26 12:52:49,722][123091] Updated weights for policy 0, policy_version 1663791 (0.0011) [2023-12-26 12:52:50,384][123090] Updated weights for policy 1, policy_version 1652646 (0.0011) [2023-12-26 12:52:50,443][123090] Updated weights for policy 1, policy_version 1652656 (0.0010) [2023-12-26 12:52:50,484][123091] Updated weights for policy 0, policy_version 1663801 (0.0006) [2023-12-26 12:52:50,514][123090] Updated weights for policy 1, policy_version 1652666 (0.0011) [2023-12-26 12:52:50,541][123091] Updated weights for policy 0, policy_version 1663811 (0.0005) [2023-12-26 12:52:50,604][123091] Updated weights for policy 0, policy_version 1663821 (0.0009) [2023-12-26 12:52:51,225][123090] Updated weights for policy 1, policy_version 1652676 (0.0011) [2023-12-26 12:52:51,294][123090] Updated weights for policy 1, policy_version 1652686 (0.0008) [2023-12-26 12:52:51,340][123091] Updated weights for policy 0, policy_version 1663831 (0.0009) [2023-12-26 12:52:51,363][123090] Updated weights for policy 1, policy_version 1652696 (0.0008) [2023-12-26 12:52:51,415][123091] Updated weights for policy 0, policy_version 1663841 (0.0009) [2023-12-26 12:52:51,480][123091] Updated weights for policy 0, policy_version 1663851 (0.0011) [2023-12-26 12:52:52,258][123091] Updated weights for policy 0, policy_version 1663861 (0.0010) [2023-12-26 12:52:52,261][123090] Updated weights for policy 1, policy_version 1652706 (0.0009) [2023-12-26 12:52:52,323][123091] Updated weights for policy 0, policy_version 1663871 (0.0011) [2023-12-26 12:52:52,323][123090] Updated weights for policy 1, policy_version 1652716 (0.0009) [2023-12-26 12:52:52,391][123091] Updated weights for policy 0, policy_version 1663881 (0.0011) [2023-12-26 12:52:52,396][123090] Updated weights for policy 1, policy_version 1652726 (0.0008) [2023-12-26 12:52:52,462][123090] Updated weights for policy 1, policy_version 1652736 (0.0008) [2023-12-26 12:52:53,177][123091] Updated weights for policy 0, policy_version 1663891 (0.0009) [2023-12-26 12:52:53,241][123091] Updated weights for policy 0, policy_version 1663901 (0.0005) [2023-12-26 12:52:53,300][123091] Updated weights for policy 0, policy_version 1663911 (0.0005) [2023-12-26 12:52:53,310][123090] Updated weights for policy 1, policy_version 1652746 (0.0008) [2023-12-26 12:52:53,366][123090] Updated weights for policy 1, policy_version 1652756 (0.0009) [2023-12-26 12:52:53,429][123090] Updated weights for policy 1, policy_version 1652766 (0.0009) [2023-12-26 12:52:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 849076224. Throughput: 0: 8898.8, 1: 8805.8. Samples: 849052596. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:53,785][121949] Avg episode reward: [(0, '5901.540'), (1, '5561.189')] [2023-12-26 12:52:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001663920_425967616.pth... [2023-12-26 12:52:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001652768_423108608.pth... [2023-12-26 12:52:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001662864_425697280.pth [2023-12-26 12:52:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001651744_422846464.pth [2023-12-26 12:52:54,033][123091] Updated weights for policy 0, policy_version 1663921 (0.0005) [2023-12-26 12:52:54,096][123091] Updated weights for policy 0, policy_version 1663931 (0.0005) [2023-12-26 12:52:54,156][123091] Updated weights for policy 0, policy_version 1663941 (0.0010) [2023-12-26 12:52:54,168][123090] Updated weights for policy 1, policy_version 1652776 (0.0010) [2023-12-26 12:52:54,218][123091] Updated weights for policy 0, policy_version 1663951 (0.0010) [2023-12-26 12:52:54,219][123090] Updated weights for policy 1, policy_version 1652786 (0.0010) [2023-12-26 12:52:54,268][123090] Updated weights for policy 1, policy_version 1652796 (0.0011) [2023-12-26 12:52:54,918][123091] Updated weights for policy 0, policy_version 1663961 (0.0010) [2023-12-26 12:52:54,969][123091] Updated weights for policy 0, policy_version 1663971 (0.0009) [2023-12-26 12:52:55,027][123091] Updated weights for policy 0, policy_version 1663981 (0.0008) [2023-12-26 12:52:55,134][123090] Updated weights for policy 1, policy_version 1652806 (0.0009) [2023-12-26 12:52:55,184][123090] Updated weights for policy 1, policy_version 1652817 (0.0009) [2023-12-26 12:52:55,252][123090] Updated weights for policy 1, policy_version 1652827 (0.0009) [2023-12-26 12:52:55,828][123091] Updated weights for policy 0, policy_version 1663991 (0.0009) [2023-12-26 12:52:55,889][123091] Updated weights for policy 0, policy_version 1664001 (0.0010) [2023-12-26 12:52:55,951][123091] Updated weights for policy 0, policy_version 1664011 (0.0010) [2023-12-26 12:52:56,059][123090] Updated weights for policy 1, policy_version 1652837 (0.0007) [2023-12-26 12:52:56,108][123090] Updated weights for policy 1, policy_version 1652847 (0.0005) [2023-12-26 12:52:56,164][123090] Updated weights for policy 1, policy_version 1652857 (0.0005) [2023-12-26 12:52:56,646][123091] Updated weights for policy 0, policy_version 1664021 (0.0008) [2023-12-26 12:52:56,700][123091] Updated weights for policy 0, policy_version 1664031 (0.0005) [2023-12-26 12:52:56,756][123091] Updated weights for policy 0, policy_version 1664041 (0.0005) [2023-12-26 12:52:56,843][123090] Updated weights for policy 1, policy_version 1652867 (0.0006) [2023-12-26 12:52:56,897][123090] Updated weights for policy 1, policy_version 1652877 (0.0008) [2023-12-26 12:52:56,956][123090] Updated weights for policy 1, policy_version 1652887 (0.0008) [2023-12-26 12:52:57,415][123091] Updated weights for policy 0, policy_version 1664051 (0.0007) [2023-12-26 12:52:57,474][123091] Updated weights for policy 0, policy_version 1664061 (0.0005) [2023-12-26 12:52:57,528][123091] Updated weights for policy 0, policy_version 1664071 (0.0005) [2023-12-26 12:52:57,762][123090] Updated weights for policy 1, policy_version 1652897 (0.0010) [2023-12-26 12:52:57,812][123090] Updated weights for policy 1, policy_version 1652907 (0.0005) [2023-12-26 12:52:57,875][123090] Updated weights for policy 1, policy_version 1652917 (0.0005) [2023-12-26 12:52:57,940][123090] Updated weights for policy 1, policy_version 1652927 (0.0005) [2023-12-26 12:52:58,149][123091] Updated weights for policy 0, policy_version 1664081 (0.0006) [2023-12-26 12:52:58,211][123091] Updated weights for policy 0, policy_version 1664091 (0.0011) [2023-12-26 12:52:58,269][123091] Updated weights for policy 0, policy_version 1664101 (0.0009) [2023-12-26 12:52:58,337][123091] Updated weights for policy 0, policy_version 1664111 (0.0009) [2023-12-26 12:52:58,756][123090] Updated weights for policy 1, policy_version 1652937 (0.0008) [2023-12-26 12:52:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 849166336. Throughput: 0: 9054.9, 1: 8810.3. Samples: 849162440. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:52:58,785][121949] Avg episode reward: [(0, '5923.540'), (1, '5582.502')] [2023-12-26 12:52:58,819][123090] Updated weights for policy 1, policy_version 1652947 (0.0009) [2023-12-26 12:52:58,897][123090] Updated weights for policy 1, policy_version 1652958 (0.0009) [2023-12-26 12:52:59,288][123091] Updated weights for policy 0, policy_version 1664121 (0.0009) [2023-12-26 12:52:59,357][123091] Updated weights for policy 0, policy_version 1664131 (0.0008) [2023-12-26 12:52:59,416][123091] Updated weights for policy 0, policy_version 1664141 (0.0008) [2023-12-26 12:52:59,787][123090] Updated weights for policy 1, policy_version 1652968 (0.0009) [2023-12-26 12:52:59,849][123090] Updated weights for policy 1, policy_version 1652978 (0.0010) [2023-12-26 12:52:59,897][123090] Updated weights for policy 1, policy_version 1652988 (0.0009) [2023-12-26 12:53:00,174][123091] Updated weights for policy 0, policy_version 1664151 (0.0008) [2023-12-26 12:53:00,222][123091] Updated weights for policy 0, policy_version 1664161 (0.0010) [2023-12-26 12:53:00,270][123091] Updated weights for policy 0, policy_version 1664171 (0.0010) [2023-12-26 12:53:00,759][123090] Updated weights for policy 1, policy_version 1652998 (0.0008) [2023-12-26 12:53:00,808][123090] Updated weights for policy 1, policy_version 1653008 (0.0008) [2023-12-26 12:53:00,876][123090] Updated weights for policy 1, policy_version 1653018 (0.0005) [2023-12-26 12:53:01,077][123091] Updated weights for policy 0, policy_version 1664181 (0.0009) [2023-12-26 12:53:01,148][123091] Updated weights for policy 0, policy_version 1664191 (0.0010) [2023-12-26 12:53:01,203][123091] Updated weights for policy 0, policy_version 1664201 (0.0010) [2023-12-26 12:53:01,604][123090] Updated weights for policy 1, policy_version 1653028 (0.0007) [2023-12-26 12:53:01,673][123090] Updated weights for policy 1, policy_version 1653038 (0.0008) [2023-12-26 12:53:01,739][123090] Updated weights for policy 1, policy_version 1653048 (0.0010) [2023-12-26 12:53:02,030][123091] Updated weights for policy 0, policy_version 1664211 (0.0010) [2023-12-26 12:53:02,099][123091] Updated weights for policy 0, policy_version 1664221 (0.0007) [2023-12-26 12:53:02,164][123091] Updated weights for policy 0, policy_version 1664231 (0.0005) [2023-12-26 12:53:02,563][123090] Updated weights for policy 1, policy_version 1653058 (0.0009) [2023-12-26 12:53:02,643][123090] Updated weights for policy 1, policy_version 1653068 (0.0005) [2023-12-26 12:53:02,720][123090] Updated weights for policy 1, policy_version 1653078 (0.0006) [2023-12-26 12:53:02,780][123090] Updated weights for policy 1, policy_version 1653088 (0.0006) [2023-12-26 12:53:02,935][123091] Updated weights for policy 0, policy_version 1664241 (0.0006) [2023-12-26 12:53:02,990][123091] Updated weights for policy 0, policy_version 1664251 (0.0009) [2023-12-26 12:53:03,046][123091] Updated weights for policy 0, policy_version 1664261 (0.0008) [2023-12-26 12:53:03,103][123091] Updated weights for policy 0, policy_version 1664271 (0.0009) [2023-12-26 12:53:03,432][123090] Updated weights for policy 1, policy_version 1653098 (0.0009) [2023-12-26 12:53:03,480][123090] Updated weights for policy 1, policy_version 1653108 (0.0009) [2023-12-26 12:53:03,536][123090] Updated weights for policy 1, policy_version 1653118 (0.0009) [2023-12-26 12:53:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 849256448. Throughput: 0: 9080.0, 1: 8787.1. Samples: 849267924. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:03,784][121949] Avg episode reward: [(0, '6019.191'), (1, '5700.837')] [2023-12-26 12:53:03,943][123091] Updated weights for policy 0, policy_version 1664281 (0.0010) [2023-12-26 12:53:03,995][123091] Updated weights for policy 0, policy_version 1664291 (0.0007) [2023-12-26 12:53:04,051][123091] Updated weights for policy 0, policy_version 1664301 (0.0005) [2023-12-26 12:53:04,331][123090] Updated weights for policy 1, policy_version 1653128 (0.0009) [2023-12-26 12:53:04,390][123090] Updated weights for policy 1, policy_version 1653138 (0.0010) [2023-12-26 12:53:04,444][123090] Updated weights for policy 1, policy_version 1653148 (0.0010) [2023-12-26 12:53:04,725][123091] Updated weights for policy 0, policy_version 1664311 (0.0005) [2023-12-26 12:53:04,793][123091] Updated weights for policy 0, policy_version 1664321 (0.0010) [2023-12-26 12:53:04,852][123091] Updated weights for policy 0, policy_version 1664331 (0.0010) [2023-12-26 12:53:05,232][123090] Updated weights for policy 1, policy_version 1653158 (0.0010) [2023-12-26 12:53:05,298][123090] Updated weights for policy 1, policy_version 1653168 (0.0009) [2023-12-26 12:53:05,370][123090] Updated weights for policy 1, policy_version 1653178 (0.0010) [2023-12-26 12:53:05,512][123091] Updated weights for policy 0, policy_version 1664341 (0.0005) [2023-12-26 12:53:05,557][123091] Updated weights for policy 0, policy_version 1664351 (0.0005) [2023-12-26 12:53:05,609][123091] Updated weights for policy 0, policy_version 1664361 (0.0005) [2023-12-26 12:53:06,273][123090] Updated weights for policy 1, policy_version 1653188 (0.0009) [2023-12-26 12:53:06,304][123091] Updated weights for policy 0, policy_version 1664371 (0.0005) [2023-12-26 12:53:06,335][123090] Updated weights for policy 1, policy_version 1653198 (0.0009) [2023-12-26 12:53:06,375][123091] Updated weights for policy 0, policy_version 1664381 (0.0005) [2023-12-26 12:53:06,391][123090] Updated weights for policy 1, policy_version 1653208 (0.0009) [2023-12-26 12:53:06,439][123091] Updated weights for policy 0, policy_version 1664391 (0.0011) [2023-12-26 12:53:07,204][123091] Updated weights for policy 0, policy_version 1664401 (0.0011) [2023-12-26 12:53:07,267][123090] Updated weights for policy 1, policy_version 1653218 (0.0009) [2023-12-26 12:53:07,269][123091] Updated weights for policy 0, policy_version 1664411 (0.0008) [2023-12-26 12:53:07,335][123090] Updated weights for policy 1, policy_version 1653228 (0.0006) [2023-12-26 12:53:07,336][123091] Updated weights for policy 0, policy_version 1664421 (0.0008) [2023-12-26 12:53:07,402][123091] Updated weights for policy 0, policy_version 1664431 (0.0008) [2023-12-26 12:53:07,402][123090] Updated weights for policy 1, policy_version 1653238 (0.0007) [2023-12-26 12:53:07,470][123090] Updated weights for policy 1, policy_version 1653248 (0.0006) [2023-12-26 12:53:08,163][123091] Updated weights for policy 0, policy_version 1664441 (0.0006) [2023-12-26 12:53:08,228][123091] Updated weights for policy 0, policy_version 1664451 (0.0006) [2023-12-26 12:53:08,257][123090] Updated weights for policy 1, policy_version 1653258 (0.0009) [2023-12-26 12:53:08,291][123091] Updated weights for policy 0, policy_version 1664461 (0.0008) [2023-12-26 12:53:08,319][123090] Updated weights for policy 1, policy_version 1653268 (0.0009) [2023-12-26 12:53:08,385][123090] Updated weights for policy 1, policy_version 1653278 (0.0007) [2023-12-26 12:53:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 849346560. Throughput: 0: 9175.5, 1: 8803.4. Samples: 849323316. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:08,786][121949] Avg episode reward: [(0, '5847.636'), (1, '5758.879')] [2023-12-26 12:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001653280_423239680.pth... [2023-12-26 12:53:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001664464_426106880.pth... [2023-12-26 12:53:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001652256_422977536.pth [2023-12-26 12:53:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001663408_425836544.pth [2023-12-26 12:53:09,021][123091] Updated weights for policy 0, policy_version 1664471 (0.0006) [2023-12-26 12:53:09,090][123091] Updated weights for policy 0, policy_version 1664481 (0.0007) [2023-12-26 12:53:09,129][123090] Updated weights for policy 1, policy_version 1653288 (0.0007) [2023-12-26 12:53:09,149][123091] Updated weights for policy 0, policy_version 1664491 (0.0006) [2023-12-26 12:53:09,189][123090] Updated weights for policy 1, policy_version 1653298 (0.0007) [2023-12-26 12:53:09,259][123090] Updated weights for policy 1, policy_version 1653308 (0.0008) [2023-12-26 12:53:09,925][123091] Updated weights for policy 0, policy_version 1664501 (0.0008) [2023-12-26 12:53:09,982][123091] Updated weights for policy 0, policy_version 1664511 (0.0010) [2023-12-26 12:53:10,039][123091] Updated weights for policy 0, policy_version 1664521 (0.0011) [2023-12-26 12:53:10,075][123090] Updated weights for policy 1, policy_version 1653318 (0.0007) [2023-12-26 12:53:10,135][123090] Updated weights for policy 1, policy_version 1653328 (0.0008) [2023-12-26 12:53:10,201][123090] Updated weights for policy 1, policy_version 1653338 (0.0008) [2023-12-26 12:53:10,833][123091] Updated weights for policy 0, policy_version 1664531 (0.0011) [2023-12-26 12:53:10,889][123091] Updated weights for policy 0, policy_version 1664541 (0.0007) [2023-12-26 12:53:10,949][123091] Updated weights for policy 0, policy_version 1664551 (0.0006) [2023-12-26 12:53:11,037][123090] Updated weights for policy 1, policy_version 1653348 (0.0009) [2023-12-26 12:53:11,103][123090] Updated weights for policy 1, policy_version 1653358 (0.0009) [2023-12-26 12:53:11,175][123090] Updated weights for policy 1, policy_version 1653368 (0.0007) [2023-12-26 12:53:11,835][123091] Updated weights for policy 0, policy_version 1664561 (0.0005) [2023-12-26 12:53:11,891][123091] Updated weights for policy 0, policy_version 1664571 (0.0008) [2023-12-26 12:53:11,954][123091] Updated weights for policy 0, policy_version 1664581 (0.0010) [2023-12-26 12:53:11,990][123090] Updated weights for policy 1, policy_version 1653378 (0.0009) [2023-12-26 12:53:12,016][123091] Updated weights for policy 0, policy_version 1664591 (0.0010) [2023-12-26 12:53:12,051][123090] Updated weights for policy 1, policy_version 1653388 (0.0010) [2023-12-26 12:53:12,112][123090] Updated weights for policy 1, policy_version 1653398 (0.0009) [2023-12-26 12:53:12,182][123090] Updated weights for policy 1, policy_version 1653408 (0.0008) [2023-12-26 12:53:12,816][123091] Updated weights for policy 0, policy_version 1664601 (0.0009) [2023-12-26 12:53:12,884][123091] Updated weights for policy 0, policy_version 1664611 (0.0011) [2023-12-26 12:53:12,948][123091] Updated weights for policy 0, policy_version 1664621 (0.0011) [2023-12-26 12:53:13,063][123090] Updated weights for policy 1, policy_version 1653418 (0.0009) [2023-12-26 12:53:13,120][123090] Updated weights for policy 1, policy_version 1653428 (0.0009) [2023-12-26 12:53:13,169][123090] Updated weights for policy 1, policy_version 1653438 (0.0009) [2023-12-26 12:53:13,655][123091] Updated weights for policy 0, policy_version 1664631 (0.0007) [2023-12-26 12:53:13,725][123091] Updated weights for policy 0, policy_version 1664641 (0.0005) [2023-12-26 12:53:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 849428480. Throughput: 0: 9063.6, 1: 8839.8. Samples: 849427124. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:13,785][121949] Avg episode reward: [(0, '5848.426'), (1, '5917.489')] [2023-12-26 12:53:13,793][123091] Updated weights for policy 0, policy_version 1664651 (0.0006) [2023-12-26 12:53:14,074][123090] Updated weights for policy 1, policy_version 1653448 (0.0006) [2023-12-26 12:53:14,138][123090] Updated weights for policy 1, policy_version 1653458 (0.0006) [2023-12-26 12:53:14,197][123090] Updated weights for policy 1, policy_version 1653468 (0.0006) [2023-12-26 12:53:14,564][123091] Updated weights for policy 0, policy_version 1664661 (0.0008) [2023-12-26 12:53:14,615][123091] Updated weights for policy 0, policy_version 1664671 (0.0011) [2023-12-26 12:53:14,666][123091] Updated weights for policy 0, policy_version 1664681 (0.0010) [2023-12-26 12:53:14,966][123090] Updated weights for policy 1, policy_version 1653478 (0.0009) [2023-12-26 12:53:15,034][123090] Updated weights for policy 1, policy_version 1653488 (0.0011) [2023-12-26 12:53:15,098][123090] Updated weights for policy 1, policy_version 1653498 (0.0011) [2023-12-26 12:53:15,522][123091] Updated weights for policy 0, policy_version 1664691 (0.0011) [2023-12-26 12:53:15,578][123091] Updated weights for policy 0, policy_version 1664701 (0.0011) [2023-12-26 12:53:15,635][123091] Updated weights for policy 0, policy_version 1664711 (0.0009) [2023-12-26 12:53:15,831][123090] Updated weights for policy 1, policy_version 1653508 (0.0010) [2023-12-26 12:53:15,885][123090] Updated weights for policy 1, policy_version 1653518 (0.0008) [2023-12-26 12:53:15,939][123090] Updated weights for policy 1, policy_version 1653528 (0.0006) [2023-12-26 12:53:16,433][123091] Updated weights for policy 0, policy_version 1664721 (0.0006) [2023-12-26 12:53:16,477][123091] Updated weights for policy 0, policy_version 1664731 (0.0010) [2023-12-26 12:53:16,527][123091] Updated weights for policy 0, policy_version 1664741 (0.0010) [2023-12-26 12:53:16,593][123091] Updated weights for policy 0, policy_version 1664751 (0.0010) [2023-12-26 12:53:16,643][123090] Updated weights for policy 1, policy_version 1653538 (0.0005) [2023-12-26 12:53:16,725][123090] Updated weights for policy 1, policy_version 1653548 (0.0006) [2023-12-26 12:53:16,778][123090] Updated weights for policy 1, policy_version 1653558 (0.0005) [2023-12-26 12:53:16,826][123090] Updated weights for policy 1, policy_version 1653568 (0.0005) [2023-12-26 12:53:17,291][123091] Updated weights for policy 0, policy_version 1664761 (0.0007) [2023-12-26 12:53:17,343][123091] Updated weights for policy 0, policy_version 1664771 (0.0005) [2023-12-26 12:53:17,400][123091] Updated weights for policy 0, policy_version 1664781 (0.0005) [2023-12-26 12:53:17,513][123090] Updated weights for policy 1, policy_version 1653578 (0.0005) [2023-12-26 12:53:17,571][123090] Updated weights for policy 1, policy_version 1653588 (0.0006) [2023-12-26 12:53:17,635][123090] Updated weights for policy 1, policy_version 1653598 (0.0008) [2023-12-26 12:53:18,115][123091] Updated weights for policy 0, policy_version 1664791 (0.0009) [2023-12-26 12:53:18,178][123091] Updated weights for policy 0, policy_version 1664801 (0.0011) [2023-12-26 12:53:18,233][123091] Updated weights for policy 0, policy_version 1664811 (0.0011) [2023-12-26 12:53:18,382][123090] Updated weights for policy 1, policy_version 1653608 (0.0009) [2023-12-26 12:53:18,450][123090] Updated weights for policy 1, policy_version 1653618 (0.0010) [2023-12-26 12:53:18,521][123090] Updated weights for policy 1, policy_version 1653628 (0.0010) [2023-12-26 12:53:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 849526784. Throughput: 0: 9109.5, 1: 8877.3. Samples: 849536676. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:18,785][121949] Avg episode reward: [(0, '6000.945'), (1, '5870.859')] [2023-12-26 12:53:19,054][123091] Updated weights for policy 0, policy_version 1664821 (0.0011) [2023-12-26 12:53:19,124][123091] Updated weights for policy 0, policy_version 1664831 (0.0009) [2023-12-26 12:53:19,200][123091] Updated weights for policy 0, policy_version 1664841 (0.0006) [2023-12-26 12:53:19,286][123090] Updated weights for policy 1, policy_version 1653638 (0.0008) [2023-12-26 12:53:19,361][123090] Updated weights for policy 1, policy_version 1653648 (0.0007) [2023-12-26 12:53:19,428][123090] Updated weights for policy 1, policy_version 1653658 (0.0006) [2023-12-26 12:53:19,943][123091] Updated weights for policy 0, policy_version 1664851 (0.0008) [2023-12-26 12:53:20,014][123091] Updated weights for policy 0, policy_version 1664861 (0.0011) [2023-12-26 12:53:20,081][123091] Updated weights for policy 0, policy_version 1664871 (0.0010) [2023-12-26 12:53:20,224][123090] Updated weights for policy 1, policy_version 1653668 (0.0007) [2023-12-26 12:53:20,286][123090] Updated weights for policy 1, policy_version 1653678 (0.0009) [2023-12-26 12:53:20,348][123090] Updated weights for policy 1, policy_version 1653688 (0.0009) [2023-12-26 12:53:20,909][123091] Updated weights for policy 0, policy_version 1664881 (0.0010) [2023-12-26 12:53:20,980][123091] Updated weights for policy 0, policy_version 1664891 (0.0010) [2023-12-26 12:53:21,045][123091] Updated weights for policy 0, policy_version 1664901 (0.0010) [2023-12-26 12:53:21,120][123091] Updated weights for policy 0, policy_version 1664911 (0.0010) [2023-12-26 12:53:21,217][123090] Updated weights for policy 1, policy_version 1653698 (0.0009) [2023-12-26 12:53:21,289][123090] Updated weights for policy 1, policy_version 1653708 (0.0008) [2023-12-26 12:53:21,354][123090] Updated weights for policy 1, policy_version 1653718 (0.0007) [2023-12-26 12:53:21,425][123090] Updated weights for policy 1, policy_version 1653728 (0.0011) [2023-12-26 12:53:21,986][123091] Updated weights for policy 0, policy_version 1664921 (0.0011) [2023-12-26 12:53:22,050][123091] Updated weights for policy 0, policy_version 1664931 (0.0011) [2023-12-26 12:53:22,116][123091] Updated weights for policy 0, policy_version 1664941 (0.0011) [2023-12-26 12:53:22,174][123090] Updated weights for policy 1, policy_version 1653738 (0.0005) [2023-12-26 12:53:22,233][123090] Updated weights for policy 1, policy_version 1653748 (0.0005) [2023-12-26 12:53:22,299][123090] Updated weights for policy 1, policy_version 1653758 (0.0007) [2023-12-26 12:53:22,937][123090] Updated weights for policy 1, policy_version 1653768 (0.0005) [2023-12-26 12:53:22,989][123091] Updated weights for policy 0, policy_version 1664951 (0.0011) [2023-12-26 12:53:23,012][123090] Updated weights for policy 1, policy_version 1653778 (0.0005) [2023-12-26 12:53:23,041][123091] Updated weights for policy 0, policy_version 1664961 (0.0011) [2023-12-26 12:53:23,079][123090] Updated weights for policy 1, policy_version 1653788 (0.0006) [2023-12-26 12:53:23,093][123091] Updated weights for policy 0, policy_version 1664971 (0.0011) [2023-12-26 12:53:23,751][123090] Updated weights for policy 1, policy_version 1653798 (0.0008) [2023-12-26 12:53:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 849608704. Throughput: 0: 9051.2, 1: 8859.8. Samples: 849588752. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:23,784][121949] Avg episode reward: [(0, '5903.100'), (1, '5645.107')] [2023-12-26 12:53:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001664976_426237952.pth... [2023-12-26 12:53:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001663920_425967616.pth [2023-12-26 12:53:23,806][123090] Updated weights for policy 1, policy_version 1653809 (0.0009) [2023-12-26 12:53:23,855][123090] Updated weights for policy 1, policy_version 1653819 (0.0009) [2023-12-26 12:53:23,884][123091] Updated weights for policy 0, policy_version 1664981 (0.0010) [2023-12-26 12:53:23,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001653824_423378944.pth... [2023-12-26 12:53:23,891][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001652768_423108608.pth [2023-12-26 12:53:23,951][123091] Updated weights for policy 0, policy_version 1664991 (0.0010) [2023-12-26 12:53:24,021][123091] Updated weights for policy 0, policy_version 1665001 (0.0010) [2023-12-26 12:53:24,613][123090] Updated weights for policy 1, policy_version 1653829 (0.0008) [2023-12-26 12:53:24,682][123090] Updated weights for policy 1, policy_version 1653839 (0.0009) [2023-12-26 12:53:24,749][123090] Updated weights for policy 1, policy_version 1653849 (0.0009) [2023-12-26 12:53:24,780][123091] Updated weights for policy 0, policy_version 1665011 (0.0008) [2023-12-26 12:53:24,831][123091] Updated weights for policy 0, policy_version 1665021 (0.0009) [2023-12-26 12:53:24,879][123091] Updated weights for policy 0, policy_version 1665031 (0.0009) [2023-12-26 12:53:25,579][123091] Updated weights for policy 0, policy_version 1665041 (0.0010) [2023-12-26 12:53:25,641][123091] Updated weights for policy 0, policy_version 1665051 (0.0008) [2023-12-26 12:53:25,642][123090] Updated weights for policy 1, policy_version 1653859 (0.0009) [2023-12-26 12:53:25,713][123091] Updated weights for policy 0, policy_version 1665061 (0.0006) [2023-12-26 12:53:25,718][123090] Updated weights for policy 1, policy_version 1653869 (0.0008) [2023-12-26 12:53:25,769][123090] Updated weights for policy 1, policy_version 1653879 (0.0008) [2023-12-26 12:53:25,785][123091] Updated weights for policy 0, policy_version 1665071 (0.0005) [2023-12-26 12:53:26,541][123091] Updated weights for policy 0, policy_version 1665081 (0.0010) [2023-12-26 12:53:26,580][123090] Updated weights for policy 1, policy_version 1653889 (0.0009) [2023-12-26 12:53:26,592][123091] Updated weights for policy 0, policy_version 1665091 (0.0010) [2023-12-26 12:53:26,638][123090] Updated weights for policy 1, policy_version 1653899 (0.0008) [2023-12-26 12:53:26,641][123091] Updated weights for policy 0, policy_version 1665101 (0.0010) [2023-12-26 12:53:26,701][123090] Updated weights for policy 1, policy_version 1653909 (0.0008) [2023-12-26 12:53:26,761][123090] Updated weights for policy 1, policy_version 1653919 (0.0009) [2023-12-26 12:53:27,436][123091] Updated weights for policy 0, policy_version 1665111 (0.0007) [2023-12-26 12:53:27,490][123091] Updated weights for policy 0, policy_version 1665121 (0.0005) [2023-12-26 12:53:27,538][123091] Updated weights for policy 0, policy_version 1665131 (0.0005) [2023-12-26 12:53:27,637][123090] Updated weights for policy 1, policy_version 1653929 (0.0010) [2023-12-26 12:53:27,691][123090] Updated weights for policy 1, policy_version 1653940 (0.0010) [2023-12-26 12:53:27,746][123090] Updated weights for policy 1, policy_version 1653950 (0.0010) [2023-12-26 12:53:28,234][123091] Updated weights for policy 0, policy_version 1665141 (0.0005) [2023-12-26 12:53:28,297][123091] Updated weights for policy 0, policy_version 1665151 (0.0010) [2023-12-26 12:53:28,360][123091] Updated weights for policy 0, policy_version 1665161 (0.0010) [2023-12-26 12:53:28,613][123090] Updated weights for policy 1, policy_version 1653960 (0.0010) [2023-12-26 12:53:28,681][123090] Updated weights for policy 1, policy_version 1653970 (0.0010) [2023-12-26 12:53:28,744][123090] Updated weights for policy 1, policy_version 1653980 (0.0009) [2023-12-26 12:53:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 849707008. Throughput: 0: 9031.2, 1: 8897.0. Samples: 849696848. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:28,784][121949] Avg episode reward: [(0, '5847.063'), (1, '5637.038')] [2023-12-26 12:53:29,156][123091] Updated weights for policy 0, policy_version 1665171 (0.0008) [2023-12-26 12:53:29,220][123091] Updated weights for policy 0, policy_version 1665181 (0.0009) [2023-12-26 12:53:29,282][123091] Updated weights for policy 0, policy_version 1665191 (0.0009) [2023-12-26 12:53:29,571][123090] Updated weights for policy 1, policy_version 1653990 (0.0010) [2023-12-26 12:53:29,634][123090] Updated weights for policy 1, policy_version 1654000 (0.0009) [2023-12-26 12:53:29,687][123090] Updated weights for policy 1, policy_version 1654010 (0.0009) [2023-12-26 12:53:30,128][123091] Updated weights for policy 0, policy_version 1665201 (0.0009) [2023-12-26 12:53:30,185][123091] Updated weights for policy 0, policy_version 1665211 (0.0008) [2023-12-26 12:53:30,256][123091] Updated weights for policy 0, policy_version 1665221 (0.0010) [2023-12-26 12:53:30,321][123091] Updated weights for policy 0, policy_version 1665231 (0.0009) [2023-12-26 12:53:30,527][123090] Updated weights for policy 1, policy_version 1654020 (0.0009) [2023-12-26 12:53:30,588][123090] Updated weights for policy 1, policy_version 1654030 (0.0009) [2023-12-26 12:53:30,654][123090] Updated weights for policy 1, policy_version 1654040 (0.0009) [2023-12-26 12:53:31,133][123091] Updated weights for policy 0, policy_version 1665241 (0.0010) [2023-12-26 12:53:31,191][123091] Updated weights for policy 0, policy_version 1665251 (0.0009) [2023-12-26 12:53:31,258][123091] Updated weights for policy 0, policy_version 1665261 (0.0009) [2023-12-26 12:53:31,459][123090] Updated weights for policy 1, policy_version 1654050 (0.0009) [2023-12-26 12:53:31,512][123090] Updated weights for policy 1, policy_version 1654060 (0.0009) [2023-12-26 12:53:31,564][123090] Updated weights for policy 1, policy_version 1654070 (0.0009) [2023-12-26 12:53:31,611][123090] Updated weights for policy 1, policy_version 1654080 (0.0008) [2023-12-26 12:53:32,106][123091] Updated weights for policy 0, policy_version 1665271 (0.0009) [2023-12-26 12:53:32,155][123091] Updated weights for policy 0, policy_version 1665281 (0.0009) [2023-12-26 12:53:32,209][123091] Updated weights for policy 0, policy_version 1665291 (0.0008) [2023-12-26 12:53:32,441][123090] Updated weights for policy 1, policy_version 1654090 (0.0010) [2023-12-26 12:53:32,512][123090] Updated weights for policy 1, policy_version 1654100 (0.0007) [2023-12-26 12:53:32,573][123090] Updated weights for policy 1, policy_version 1654110 (0.0009) [2023-12-26 12:53:32,988][123091] Updated weights for policy 0, policy_version 1665301 (0.0008) [2023-12-26 12:53:33,042][123091] Updated weights for policy 0, policy_version 1665311 (0.0010) [2023-12-26 12:53:33,104][123091] Updated weights for policy 0, policy_version 1665321 (0.0010) [2023-12-26 12:53:33,405][123090] Updated weights for policy 1, policy_version 1654120 (0.0009) [2023-12-26 12:53:33,463][123090] Updated weights for policy 1, policy_version 1654130 (0.0009) [2023-12-26 12:53:33,522][123090] Updated weights for policy 1, policy_version 1654140 (0.0008) [2023-12-26 12:53:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 849788928. Throughput: 0: 9040.3, 1: 8743.5. Samples: 849800248. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:33,784][121949] Avg episode reward: [(0, '5840.693'), (1, '5834.856')] [2023-12-26 12:53:33,900][123091] Updated weights for policy 0, policy_version 1665331 (0.0009) [2023-12-26 12:53:33,968][123091] Updated weights for policy 0, policy_version 1665341 (0.0005) [2023-12-26 12:53:34,031][123091] Updated weights for policy 0, policy_version 1665351 (0.0005) [2023-12-26 12:53:34,404][123090] Updated weights for policy 1, policy_version 1654150 (0.0007) [2023-12-26 12:53:34,477][123090] Updated weights for policy 1, policy_version 1654160 (0.0009) [2023-12-26 12:53:34,550][123090] Updated weights for policy 1, policy_version 1654170 (0.0009) [2023-12-26 12:53:34,783][123091] Updated weights for policy 0, policy_version 1665361 (0.0008) [2023-12-26 12:53:34,846][123091] Updated weights for policy 0, policy_version 1665371 (0.0011) [2023-12-26 12:53:34,913][123091] Updated weights for policy 0, policy_version 1665381 (0.0011) [2023-12-26 12:53:34,984][123091] Updated weights for policy 0, policy_version 1665391 (0.0011) [2023-12-26 12:53:35,334][123090] Updated weights for policy 1, policy_version 1654180 (0.0009) [2023-12-26 12:53:35,382][123090] Updated weights for policy 1, policy_version 1654190 (0.0009) [2023-12-26 12:53:35,437][123090] Updated weights for policy 1, policy_version 1654200 (0.0009) [2023-12-26 12:53:35,790][123091] Updated weights for policy 0, policy_version 1665401 (0.0010) [2023-12-26 12:53:35,838][123091] Updated weights for policy 0, policy_version 1665411 (0.0009) [2023-12-26 12:53:35,892][123091] Updated weights for policy 0, policy_version 1665421 (0.0006) [2023-12-26 12:53:36,265][123090] Updated weights for policy 1, policy_version 1654210 (0.0005) [2023-12-26 12:53:36,333][123090] Updated weights for policy 1, policy_version 1654220 (0.0006) [2023-12-26 12:53:36,405][123090] Updated weights for policy 1, policy_version 1654230 (0.0006) [2023-12-26 12:53:36,478][123090] Updated weights for policy 1, policy_version 1654240 (0.0006) [2023-12-26 12:53:36,708][123091] Updated weights for policy 0, policy_version 1665431 (0.0011) [2023-12-26 12:53:36,780][123091] Updated weights for policy 0, policy_version 1665441 (0.0011) [2023-12-26 12:53:36,844][123091] Updated weights for policy 0, policy_version 1665451 (0.0007) [2023-12-26 12:53:37,135][123090] Updated weights for policy 1, policy_version 1654250 (0.0007) [2023-12-26 12:53:37,190][123090] Updated weights for policy 1, policy_version 1654260 (0.0006) [2023-12-26 12:53:37,260][123090] Updated weights for policy 1, policy_version 1654270 (0.0010) [2023-12-26 12:53:37,566][123091] Updated weights for policy 0, policy_version 1665461 (0.0007) [2023-12-26 12:53:37,635][123091] Updated weights for policy 0, policy_version 1665471 (0.0006) [2023-12-26 12:53:37,704][123091] Updated weights for policy 0, policy_version 1665481 (0.0005) [2023-12-26 12:53:38,087][123090] Updated weights for policy 1, policy_version 1654280 (0.0011) [2023-12-26 12:53:38,157][123090] Updated weights for policy 1, policy_version 1654290 (0.0006) [2023-12-26 12:53:38,228][123090] Updated weights for policy 1, policy_version 1654300 (0.0005) [2023-12-26 12:53:38,462][123091] Updated weights for policy 0, policy_version 1665491 (0.0008) [2023-12-26 12:53:38,510][123091] Updated weights for policy 0, policy_version 1665501 (0.0006) [2023-12-26 12:53:38,565][123091] Updated weights for policy 0, policy_version 1665511 (0.0006) [2023-12-26 12:53:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 849879040. Throughput: 0: 9044.3, 1: 8749.0. Samples: 849853292. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:38,785][121949] Avg episode reward: [(0, '5838.701'), (1, '5868.831')] [2023-12-26 12:53:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001654304_423501824.pth... [2023-12-26 12:53:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001665520_426377216.pth... [2023-12-26 12:53:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001653280_423239680.pth [2023-12-26 12:53:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001664464_426106880.pth [2023-12-26 12:53:38,995][123090] Updated weights for policy 1, policy_version 1654310 (0.0009) [2023-12-26 12:53:39,062][123090] Updated weights for policy 1, policy_version 1654320 (0.0011) [2023-12-26 12:53:39,126][123090] Updated weights for policy 1, policy_version 1654330 (0.0010) [2023-12-26 12:53:39,418][123091] Updated weights for policy 0, policy_version 1665521 (0.0011) [2023-12-26 12:53:39,485][123091] Updated weights for policy 0, policy_version 1665531 (0.0011) [2023-12-26 12:53:39,551][123091] Updated weights for policy 0, policy_version 1665541 (0.0009) [2023-12-26 12:53:39,617][123091] Updated weights for policy 0, policy_version 1665551 (0.0009) [2023-12-26 12:53:39,901][123090] Updated weights for policy 1, policy_version 1654340 (0.0008) [2023-12-26 12:53:39,964][123090] Updated weights for policy 1, policy_version 1654350 (0.0006) [2023-12-26 12:53:40,028][123090] Updated weights for policy 1, policy_version 1654360 (0.0006) [2023-12-26 12:53:40,450][123091] Updated weights for policy 0, policy_version 1665561 (0.0009) [2023-12-26 12:53:40,517][123091] Updated weights for policy 0, policy_version 1665571 (0.0010) [2023-12-26 12:53:40,583][123091] Updated weights for policy 0, policy_version 1665581 (0.0011) [2023-12-26 12:53:40,734][123090] Updated weights for policy 1, policy_version 1654370 (0.0008) [2023-12-26 12:53:40,800][123090] Updated weights for policy 1, policy_version 1654380 (0.0005) [2023-12-26 12:53:40,864][123090] Updated weights for policy 1, policy_version 1654390 (0.0009) [2023-12-26 12:53:40,932][123090] Updated weights for policy 1, policy_version 1654400 (0.0009) [2023-12-26 12:53:41,376][123091] Updated weights for policy 0, policy_version 1665591 (0.0011) [2023-12-26 12:53:41,447][123091] Updated weights for policy 0, policy_version 1665601 (0.0010) [2023-12-26 12:53:41,514][123091] Updated weights for policy 0, policy_version 1665611 (0.0011) [2023-12-26 12:53:41,715][123090] Updated weights for policy 1, policy_version 1654410 (0.0009) [2023-12-26 12:53:41,784][123090] Updated weights for policy 1, policy_version 1654420 (0.0009) [2023-12-26 12:53:41,848][123090] Updated weights for policy 1, policy_version 1654430 (0.0010) [2023-12-26 12:53:42,400][123091] Updated weights for policy 0, policy_version 1665621 (0.0009) [2023-12-26 12:53:42,463][123091] Updated weights for policy 0, policy_version 1665631 (0.0008) [2023-12-26 12:53:42,521][123091] Updated weights for policy 0, policy_version 1665641 (0.0008) [2023-12-26 12:53:42,702][123090] Updated weights for policy 1, policy_version 1654440 (0.0010) [2023-12-26 12:53:42,752][123090] Updated weights for policy 1, policy_version 1654450 (0.0009) [2023-12-26 12:53:42,804][123090] Updated weights for policy 1, policy_version 1654460 (0.0009) [2023-12-26 12:53:43,315][123091] Updated weights for policy 0, policy_version 1665651 (0.0009) [2023-12-26 12:53:43,381][123091] Updated weights for policy 0, policy_version 1665661 (0.0010) [2023-12-26 12:53:43,440][123091] Updated weights for policy 0, policy_version 1665671 (0.0009) [2023-12-26 12:53:43,632][123090] Updated weights for policy 1, policy_version 1654470 (0.0007) [2023-12-26 12:53:43,688][123090] Updated weights for policy 1, policy_version 1654480 (0.0007) [2023-12-26 12:53:43,756][123090] Updated weights for policy 1, policy_version 1654490 (0.0005) [2023-12-26 12:53:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 849969152. Throughput: 0: 8923.5, 1: 8764.0. Samples: 849958380. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:43,785][121949] Avg episode reward: [(0, '6018.881'), (1, '5732.305')] [2023-12-26 12:53:44,151][123091] Updated weights for policy 0, policy_version 1665681 (0.0010) [2023-12-26 12:53:44,213][123091] Updated weights for policy 0, policy_version 1665691 (0.0005) [2023-12-26 12:53:44,261][123091] Updated weights for policy 0, policy_version 1665701 (0.0005) [2023-12-26 12:53:44,312][123091] Updated weights for policy 0, policy_version 1665711 (0.0005) [2023-12-26 12:53:44,423][123090] Updated weights for policy 1, policy_version 1654500 (0.0006) [2023-12-26 12:53:44,470][123090] Updated weights for policy 1, policy_version 1654510 (0.0005) [2023-12-26 12:53:44,525][123090] Updated weights for policy 1, policy_version 1654520 (0.0005) [2023-12-26 12:53:44,991][123091] Updated weights for policy 0, policy_version 1665721 (0.0009) [2023-12-26 12:53:45,059][123091] Updated weights for policy 0, policy_version 1665731 (0.0011) [2023-12-26 12:53:45,133][123091] Updated weights for policy 0, policy_version 1665741 (0.0011) [2023-12-26 12:53:45,354][123090] Updated weights for policy 1, policy_version 1654530 (0.0006) [2023-12-26 12:53:45,420][123090] Updated weights for policy 1, policy_version 1654540 (0.0008) [2023-12-26 12:53:45,479][123090] Updated weights for policy 1, policy_version 1654550 (0.0009) [2023-12-26 12:53:45,546][123090] Updated weights for policy 1, policy_version 1654560 (0.0009) [2023-12-26 12:53:45,912][123091] Updated weights for policy 0, policy_version 1665751 (0.0007) [2023-12-26 12:53:45,965][123091] Updated weights for policy 0, policy_version 1665761 (0.0005) [2023-12-26 12:53:46,021][123091] Updated weights for policy 0, policy_version 1665771 (0.0005) [2023-12-26 12:53:46,416][123090] Updated weights for policy 1, policy_version 1654570 (0.0009) [2023-12-26 12:53:46,481][123090] Updated weights for policy 1, policy_version 1654580 (0.0010) [2023-12-26 12:53:46,548][123090] Updated weights for policy 1, policy_version 1654590 (0.0010) [2023-12-26 12:53:46,617][123091] Updated weights for policy 0, policy_version 1665781 (0.0005) [2023-12-26 12:53:46,688][123091] Updated weights for policy 0, policy_version 1665791 (0.0005) [2023-12-26 12:53:46,759][123091] Updated weights for policy 0, policy_version 1665801 (0.0005) [2023-12-26 12:53:47,384][123091] Updated weights for policy 0, policy_version 1665811 (0.0005) [2023-12-26 12:53:47,445][123090] Updated weights for policy 1, policy_version 1654600 (0.0009) [2023-12-26 12:53:47,448][123091] Updated weights for policy 0, policy_version 1665821 (0.0008) [2023-12-26 12:53:47,498][123090] Updated weights for policy 1, policy_version 1654610 (0.0007) [2023-12-26 12:53:47,500][123091] Updated weights for policy 0, policy_version 1665831 (0.0010) [2023-12-26 12:53:47,553][123090] Updated weights for policy 1, policy_version 1654620 (0.0006) [2023-12-26 12:53:48,247][123091] Updated weights for policy 0, policy_version 1665841 (0.0010) [2023-12-26 12:53:48,320][123091] Updated weights for policy 0, policy_version 1665851 (0.0005) [2023-12-26 12:53:48,385][123091] Updated weights for policy 0, policy_version 1665861 (0.0011) [2023-12-26 12:53:48,431][123090] Updated weights for policy 1, policy_version 1654630 (0.0007) [2023-12-26 12:53:48,444][123091] Updated weights for policy 0, policy_version 1665871 (0.0011) [2023-12-26 12:53:48,499][123090] Updated weights for policy 1, policy_version 1654640 (0.0008) [2023-12-26 12:53:48,567][123090] Updated weights for policy 1, policy_version 1654650 (0.0008) [2023-12-26 12:53:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 850059264. Throughput: 0: 9049.3, 1: 8730.5. Samples: 850068016. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:48,785][121949] Avg episode reward: [(0, '6012.621'), (1, '5630.272')] [2023-12-26 12:53:49,230][123091] Updated weights for policy 0, policy_version 1665881 (0.0011) [2023-12-26 12:53:49,297][123091] Updated weights for policy 0, policy_version 1665891 (0.0010) [2023-12-26 12:53:49,326][123090] Updated weights for policy 1, policy_version 1654660 (0.0008) [2023-12-26 12:53:49,361][123091] Updated weights for policy 0, policy_version 1665901 (0.0011) [2023-12-26 12:53:49,399][123090] Updated weights for policy 1, policy_version 1654670 (0.0009) [2023-12-26 12:53:49,460][123090] Updated weights for policy 1, policy_version 1654680 (0.0009) [2023-12-26 12:53:50,208][123091] Updated weights for policy 0, policy_version 1665911 (0.0010) [2023-12-26 12:53:50,275][123091] Updated weights for policy 0, policy_version 1665921 (0.0009) [2023-12-26 12:53:50,302][123090] Updated weights for policy 1, policy_version 1654690 (0.0007) [2023-12-26 12:53:50,339][123091] Updated weights for policy 0, policy_version 1665931 (0.0010) [2023-12-26 12:53:50,373][123090] Updated weights for policy 1, policy_version 1654700 (0.0007) [2023-12-26 12:53:50,439][123090] Updated weights for policy 1, policy_version 1654710 (0.0009) [2023-12-26 12:53:50,503][123090] Updated weights for policy 1, policy_version 1654720 (0.0007) [2023-12-26 12:53:51,182][123091] Updated weights for policy 0, policy_version 1665941 (0.0010) [2023-12-26 12:53:51,258][123091] Updated weights for policy 0, policy_version 1665951 (0.0008) [2023-12-26 12:53:51,319][123091] Updated weights for policy 0, policy_version 1665961 (0.0011) [2023-12-26 12:53:51,323][123090] Updated weights for policy 1, policy_version 1654730 (0.0008) [2023-12-26 12:53:51,391][123090] Updated weights for policy 1, policy_version 1654740 (0.0009) [2023-12-26 12:53:51,465][123090] Updated weights for policy 1, policy_version 1654750 (0.0007) [2023-12-26 12:53:52,090][123091] Updated weights for policy 0, policy_version 1665971 (0.0009) [2023-12-26 12:53:52,166][123091] Updated weights for policy 0, policy_version 1665981 (0.0006) [2023-12-26 12:53:52,214][123090] Updated weights for policy 1, policy_version 1654760 (0.0007) [2023-12-26 12:53:52,231][123091] Updated weights for policy 0, policy_version 1665991 (0.0009) [2023-12-26 12:53:52,273][123090] Updated weights for policy 1, policy_version 1654770 (0.0009) [2023-12-26 12:53:52,338][123090] Updated weights for policy 1, policy_version 1654780 (0.0010) [2023-12-26 12:53:53,050][123091] Updated weights for policy 0, policy_version 1666001 (0.0007) [2023-12-26 12:53:53,120][123091] Updated weights for policy 0, policy_version 1666011 (0.0009) [2023-12-26 12:53:53,158][123090] Updated weights for policy 1, policy_version 1654790 (0.0009) [2023-12-26 12:53:53,186][123091] Updated weights for policy 0, policy_version 1666021 (0.0011) [2023-12-26 12:53:53,210][123090] Updated weights for policy 1, policy_version 1654800 (0.0010) [2023-12-26 12:53:53,249][123091] Updated weights for policy 0, policy_version 1666031 (0.0010) [2023-12-26 12:53:53,261][123090] Updated weights for policy 1, policy_version 1654810 (0.0008) [2023-12-26 12:53:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 850141184. Throughput: 0: 8934.7, 1: 8739.7. Samples: 850118660. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:53,785][121949] Avg episode reward: [(0, '6030.483'), (1, '5726.080')] [2023-12-26 12:53:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001666032_426508288.pth... [2023-12-26 12:53:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001654816_423632896.pth... [2023-12-26 12:53:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001664976_426237952.pth [2023-12-26 12:53:53,795][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001666032_426508288.pth [2023-12-26 12:53:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001653824_423378944.pth [2023-12-26 12:53:53,797][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001654816_423632896.pth [2023-12-26 12:53:53,966][123090] Updated weights for policy 1, policy_version 1654820 (0.0005) [2023-12-26 12:53:54,009][123091] Updated weights for policy 0, policy_version 1666041 (0.0006) [2023-12-26 12:53:54,027][123090] Updated weights for policy 1, policy_version 1654830 (0.0005) [2023-12-26 12:53:54,064][123091] Updated weights for policy 0, policy_version 1666051 (0.0006) [2023-12-26 12:53:54,091][123090] Updated weights for policy 1, policy_version 1654840 (0.0005) [2023-12-26 12:53:54,117][123091] Updated weights for policy 0, policy_version 1666061 (0.0006) [2023-12-26 12:53:54,698][123090] Updated weights for policy 1, policy_version 1654850 (0.0006) [2023-12-26 12:53:54,757][123090] Updated weights for policy 1, policy_version 1654860 (0.0009) [2023-12-26 12:53:54,819][123090] Updated weights for policy 1, policy_version 1654870 (0.0010) [2023-12-26 12:53:54,883][123090] Updated weights for policy 1, policy_version 1654880 (0.0007) [2023-12-26 12:53:54,903][123091] Updated weights for policy 0, policy_version 1666071 (0.0009) [2023-12-26 12:53:54,960][123091] Updated weights for policy 0, policy_version 1666081 (0.0009) [2023-12-26 12:53:55,029][123091] Updated weights for policy 0, policy_version 1666091 (0.0009) [2023-12-26 12:53:55,745][123091] Updated weights for policy 0, policy_version 1666101 (0.0008) [2023-12-26 12:53:55,778][123090] Updated weights for policy 1, policy_version 1654890 (0.0010) [2023-12-26 12:53:55,814][123091] Updated weights for policy 0, policy_version 1666111 (0.0006) [2023-12-26 12:53:55,834][123090] Updated weights for policy 1, policy_version 1654901 (0.0010) [2023-12-26 12:53:55,876][123091] Updated weights for policy 0, policy_version 1666121 (0.0008) [2023-12-26 12:53:55,893][123090] Updated weights for policy 1, policy_version 1654911 (0.0008) [2023-12-26 12:53:56,655][123091] Updated weights for policy 0, policy_version 1666131 (0.0011) [2023-12-26 12:53:56,706][123091] Updated weights for policy 0, policy_version 1666141 (0.0010) [2023-12-26 12:53:56,708][123090] Updated weights for policy 1, policy_version 1654921 (0.0006) [2023-12-26 12:53:56,749][123091] Updated weights for policy 0, policy_version 1666151 (0.0010) [2023-12-26 12:53:56,751][123090] Updated weights for policy 1, policy_version 1654931 (0.0005) [2023-12-26 12:53:56,799][123090] Updated weights for policy 1, policy_version 1654941 (0.0006) [2023-12-26 12:53:57,592][123091] Updated weights for policy 0, policy_version 1666161 (0.0010) [2023-12-26 12:53:57,615][123090] Updated weights for policy 1, policy_version 1654951 (0.0006) [2023-12-26 12:53:57,647][123091] Updated weights for policy 0, policy_version 1666171 (0.0005) [2023-12-26 12:53:57,672][123090] Updated weights for policy 1, policy_version 1654961 (0.0005) [2023-12-26 12:53:57,710][123091] Updated weights for policy 0, policy_version 1666181 (0.0006) [2023-12-26 12:53:57,730][123090] Updated weights for policy 1, policy_version 1654971 (0.0005) [2023-12-26 12:53:57,783][123091] Updated weights for policy 0, policy_version 1666191 (0.0005) [2023-12-26 12:53:58,459][123090] Updated weights for policy 1, policy_version 1654981 (0.0007) [2023-12-26 12:53:58,507][123091] Updated weights for policy 0, policy_version 1666201 (0.0008) [2023-12-26 12:53:58,523][123090] Updated weights for policy 1, policy_version 1654991 (0.0008) [2023-12-26 12:53:58,569][123091] Updated weights for policy 0, policy_version 1666211 (0.0009) [2023-12-26 12:53:58,592][123090] Updated weights for policy 1, policy_version 1655001 (0.0008) [2023-12-26 12:53:58,630][123091] Updated weights for policy 0, policy_version 1666221 (0.0008) [2023-12-26 12:53:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 850239488. Throughput: 0: 8968.5, 1: 8813.1. Samples: 850227296. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:53:58,785][121949] Avg episode reward: [(0, '5991.351'), (1, '5779.692')] [2023-12-26 12:53:59,356][123091] Updated weights for policy 0, policy_version 1666231 (0.0007) [2023-12-26 12:53:59,414][123091] Updated weights for policy 0, policy_version 1666241 (0.0007) [2023-12-26 12:53:59,448][123090] Updated weights for policy 1, policy_version 1655011 (0.0007) [2023-12-26 12:53:59,469][123091] Updated weights for policy 0, policy_version 1666251 (0.0006) [2023-12-26 12:53:59,506][123090] Updated weights for policy 1, policy_version 1655021 (0.0008) [2023-12-26 12:53:59,558][123090] Updated weights for policy 1, policy_version 1655031 (0.0008) [2023-12-26 12:54:00,315][123091] Updated weights for policy 0, policy_version 1666261 (0.0008) [2023-12-26 12:54:00,373][123091] Updated weights for policy 0, policy_version 1666271 (0.0010) [2023-12-26 12:54:00,415][123090] Updated weights for policy 1, policy_version 1655041 (0.0009) [2023-12-26 12:54:00,435][123091] Updated weights for policy 0, policy_version 1666281 (0.0009) [2023-12-26 12:54:00,483][123090] Updated weights for policy 1, policy_version 1655051 (0.0008) [2023-12-26 12:54:00,554][123090] Updated weights for policy 1, policy_version 1655061 (0.0010) [2023-12-26 12:54:00,628][123090] Updated weights for policy 1, policy_version 1655071 (0.0010) [2023-12-26 12:54:01,195][123091] Updated weights for policy 0, policy_version 1666291 (0.0006) [2023-12-26 12:54:01,253][123091] Updated weights for policy 0, policy_version 1666301 (0.0006) [2023-12-26 12:54:01,322][123091] Updated weights for policy 0, policy_version 1666311 (0.0007) [2023-12-26 12:54:01,475][123090] Updated weights for policy 1, policy_version 1655081 (0.0010) [2023-12-26 12:54:01,543][123090] Updated weights for policy 1, policy_version 1655091 (0.0009) [2023-12-26 12:54:01,606][123090] Updated weights for policy 1, policy_version 1655101 (0.0009) [2023-12-26 12:54:02,052][123091] Updated weights for policy 0, policy_version 1666321 (0.0007) [2023-12-26 12:54:02,119][123091] Updated weights for policy 0, policy_version 1666331 (0.0010) [2023-12-26 12:54:02,185][123091] Updated weights for policy 0, policy_version 1666341 (0.0009) [2023-12-26 12:54:02,246][123091] Updated weights for policy 0, policy_version 1666351 (0.0009) [2023-12-26 12:54:02,357][123090] Updated weights for policy 1, policy_version 1655111 (0.0008) [2023-12-26 12:54:02,421][123090] Updated weights for policy 1, policy_version 1655121 (0.0010) [2023-12-26 12:54:02,484][123090] Updated weights for policy 1, policy_version 1655131 (0.0009) [2023-12-26 12:54:03,092][123091] Updated weights for policy 0, policy_version 1666361 (0.0008) [2023-12-26 12:54:03,155][123091] Updated weights for policy 0, policy_version 1666371 (0.0005) [2023-12-26 12:54:03,219][123091] Updated weights for policy 0, policy_version 1666381 (0.0005) [2023-12-26 12:54:03,323][123090] Updated weights for policy 1, policy_version 1655141 (0.0009) [2023-12-26 12:54:03,390][123090] Updated weights for policy 1, policy_version 1655151 (0.0010) [2023-12-26 12:54:03,445][123090] Updated weights for policy 1, policy_version 1655161 (0.0009) [2023-12-26 12:54:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 850321408. Throughput: 0: 8982.2, 1: 8732.7. Samples: 850333848. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:54:03,784][121949] Avg episode reward: [(0, '5978.504'), (1, '5770.547')] [2023-12-26 12:54:03,791][123091] Updated weights for policy 0, policy_version 1666391 (0.0006) [2023-12-26 12:54:03,844][123091] Updated weights for policy 0, policy_version 1666401 (0.0009) [2023-12-26 12:54:03,905][123091] Updated weights for policy 0, policy_version 1666411 (0.0010) [2023-12-26 12:54:04,309][123090] Updated weights for policy 1, policy_version 1655172 (0.0010) [2023-12-26 12:54:04,365][123090] Updated weights for policy 1, policy_version 1655182 (0.0009) [2023-12-26 12:54:04,436][123090] Updated weights for policy 1, policy_version 1655192 (0.0009) [2023-12-26 12:54:04,769][123091] Updated weights for policy 0, policy_version 1666421 (0.0008) [2023-12-26 12:54:04,822][123091] Updated weights for policy 0, policy_version 1666431 (0.0006) [2023-12-26 12:54:04,875][123091] Updated weights for policy 0, policy_version 1666441 (0.0005) [2023-12-26 12:54:05,230][123090] Updated weights for policy 1, policy_version 1655202 (0.0006) [2023-12-26 12:54:05,288][123090] Updated weights for policy 1, policy_version 1655212 (0.0008) [2023-12-26 12:54:05,335][123090] Updated weights for policy 1, policy_version 1655222 (0.0009) [2023-12-26 12:54:05,399][123090] Updated weights for policy 1, policy_version 1655232 (0.0006) [2023-12-26 12:54:05,604][123091] Updated weights for policy 0, policy_version 1666451 (0.0007) [2023-12-26 12:54:05,659][123091] Updated weights for policy 0, policy_version 1666461 (0.0011) [2023-12-26 12:54:05,710][123091] Updated weights for policy 0, policy_version 1666471 (0.0010) [2023-12-26 12:54:06,219][123090] Updated weights for policy 1, policy_version 1655242 (0.0009) [2023-12-26 12:54:06,284][123090] Updated weights for policy 1, policy_version 1655252 (0.0009) [2023-12-26 12:54:06,349][123090] Updated weights for policy 1, policy_version 1655262 (0.0009) [2023-12-26 12:54:06,528][123091] Updated weights for policy 0, policy_version 1666481 (0.0010) [2023-12-26 12:54:06,594][123091] Updated weights for policy 0, policy_version 1666491 (0.0009) [2023-12-26 12:54:06,661][123091] Updated weights for policy 0, policy_version 1666501 (0.0011) [2023-12-26 12:54:06,724][123091] Updated weights for policy 0, policy_version 1666511 (0.0011) [2023-12-26 12:54:07,191][123090] Updated weights for policy 1, policy_version 1655272 (0.0008) [2023-12-26 12:54:07,254][123090] Updated weights for policy 1, policy_version 1655282 (0.0005) [2023-12-26 12:54:07,313][123090] Updated weights for policy 1, policy_version 1655292 (0.0005) [2023-12-26 12:54:07,482][123091] Updated weights for policy 0, policy_version 1666521 (0.0009) [2023-12-26 12:54:07,543][123091] Updated weights for policy 0, policy_version 1666531 (0.0008) [2023-12-26 12:54:07,595][123091] Updated weights for policy 0, policy_version 1666541 (0.0009) [2023-12-26 12:54:08,069][123090] Updated weights for policy 1, policy_version 1655302 (0.0009) [2023-12-26 12:54:08,129][123090] Updated weights for policy 1, policy_version 1655312 (0.0011) [2023-12-26 12:54:08,199][123090] Updated weights for policy 1, policy_version 1655322 (0.0010) [2023-12-26 12:54:08,445][123091] Updated weights for policy 0, policy_version 1666551 (0.0009) [2023-12-26 12:54:08,497][123091] Updated weights for policy 0, policy_version 1666561 (0.0009) [2023-12-26 12:54:08,554][123091] Updated weights for policy 0, policy_version 1666571 (0.0009) [2023-12-26 12:54:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 850411520. Throughput: 0: 9015.4, 1: 8717.0. Samples: 850386708. Policy #0 lag: (min: 31.0, avg: 38.0, max: 63.0) [2023-12-26 12:54:08,785][121949] Avg episode reward: [(0, '5882.493'), (1, '5872.354')] [2023-12-26 12:54:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001666576_426647552.pth... [2023-12-26 12:54:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001655328_423763968.pth... [2023-12-26 12:54:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001665520_426377216.pth [2023-12-26 12:54:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001654304_423501824.pth [2023-12-26 12:54:09,029][123090] Updated weights for policy 1, policy_version 1655332 (0.0011) [2023-12-26 12:54:09,080][123090] Updated weights for policy 1, policy_version 1655342 (0.0009) [2023-12-26 12:54:09,132][123090] Updated weights for policy 1, policy_version 1655352 (0.0008) [2023-12-26 12:54:09,393][123091] Updated weights for policy 0, policy_version 1666581 (0.0010) [2023-12-26 12:54:09,462][123091] Updated weights for policy 0, policy_version 1666591 (0.0010) [2023-12-26 12:54:09,531][123091] Updated weights for policy 0, policy_version 1666601 (0.0005) [2023-12-26 12:54:09,987][123090] Updated weights for policy 1, policy_version 1655362 (0.0009) [2023-12-26 12:54:10,050][123090] Updated weights for policy 1, policy_version 1655372 (0.0009) [2023-12-26 12:54:10,117][123090] Updated weights for policy 1, policy_version 1655382 (0.0009) [2023-12-26 12:54:10,181][123090] Updated weights for policy 1, policy_version 1655392 (0.0008) [2023-12-26 12:54:10,259][123091] Updated weights for policy 0, policy_version 1666611 (0.0006) [2023-12-26 12:54:10,322][123091] Updated weights for policy 0, policy_version 1666621 (0.0006) [2023-12-26 12:54:10,388][123091] Updated weights for policy 0, policy_version 1666631 (0.0005) [2023-12-26 12:54:10,941][123090] Updated weights for policy 1, policy_version 1655402 (0.0007) [2023-12-26 12:54:11,009][123090] Updated weights for policy 1, policy_version 1655412 (0.0006) [2023-12-26 12:54:11,086][123091] Updated weights for policy 0, policy_version 1666641 (0.0006) [2023-12-26 12:54:11,095][123090] Updated weights for policy 1, policy_version 1655423 (0.0008) [2023-12-26 12:54:11,150][123091] Updated weights for policy 0, policy_version 1666651 (0.0010) [2023-12-26 12:54:11,223][123091] Updated weights for policy 0, policy_version 1666661 (0.0011) [2023-12-26 12:54:11,293][123091] Updated weights for policy 0, policy_version 1666671 (0.0010) [2023-12-26 12:54:11,853][123090] Updated weights for policy 1, policy_version 1655433 (0.0010) [2023-12-26 12:54:11,929][123090] Updated weights for policy 1, policy_version 1655443 (0.0009) [2023-12-26 12:54:12,000][123090] Updated weights for policy 1, policy_version 1655453 (0.0010) [2023-12-26 12:54:12,168][123091] Updated weights for policy 0, policy_version 1666681 (0.0010) [2023-12-26 12:54:12,230][123091] Updated weights for policy 0, policy_version 1666691 (0.0009) [2023-12-26 12:54:12,300][123091] Updated weights for policy 0, policy_version 1666701 (0.0010) [2023-12-26 12:54:12,805][123090] Updated weights for policy 1, policy_version 1655463 (0.0009) [2023-12-26 12:54:12,871][123090] Updated weights for policy 1, policy_version 1655473 (0.0008) [2023-12-26 12:54:12,932][123090] Updated weights for policy 1, policy_version 1655483 (0.0010) [2023-12-26 12:54:13,140][123091] Updated weights for policy 0, policy_version 1666711 (0.0010) [2023-12-26 12:54:13,195][123091] Updated weights for policy 0, policy_version 1666721 (0.0008) [2023-12-26 12:54:13,260][123091] Updated weights for policy 0, policy_version 1666731 (0.0009) [2023-12-26 12:54:13,742][123090] Updated weights for policy 1, policy_version 1655493 (0.0009) [2023-12-26 12:54:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 850493440. Throughput: 0: 8977.9, 1: 8686.6. Samples: 850491752. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:13,785][121949] Avg episode reward: [(0, '5805.832'), (1, '5804.421')] [2023-12-26 12:54:13,811][123090] Updated weights for policy 1, policy_version 1655503 (0.0009) [2023-12-26 12:54:13,870][123090] Updated weights for policy 1, policy_version 1655513 (0.0009) [2023-12-26 12:54:14,084][123091] Updated weights for policy 0, policy_version 1666741 (0.0010) [2023-12-26 12:54:14,152][123091] Updated weights for policy 0, policy_version 1666751 (0.0009) [2023-12-26 12:54:14,216][123091] Updated weights for policy 0, policy_version 1666761 (0.0009) [2023-12-26 12:54:14,666][123090] Updated weights for policy 1, policy_version 1655523 (0.0010) [2023-12-26 12:54:14,730][123090] Updated weights for policy 1, policy_version 1655533 (0.0009) [2023-12-26 12:54:14,802][123090] Updated weights for policy 1, policy_version 1655543 (0.0009) [2023-12-26 12:54:15,040][123091] Updated weights for policy 0, policy_version 1666771 (0.0009) [2023-12-26 12:54:15,104][123091] Updated weights for policy 0, policy_version 1666781 (0.0011) [2023-12-26 12:54:15,175][123091] Updated weights for policy 0, policy_version 1666791 (0.0007) [2023-12-26 12:54:15,568][123090] Updated weights for policy 1, policy_version 1655553 (0.0009) [2023-12-26 12:54:15,630][123090] Updated weights for policy 1, policy_version 1655563 (0.0005) [2023-12-26 12:54:15,682][123090] Updated weights for policy 1, policy_version 1655573 (0.0005) [2023-12-26 12:54:15,736][123090] Updated weights for policy 1, policy_version 1655583 (0.0005) [2023-12-26 12:54:15,863][123091] Updated weights for policy 0, policy_version 1666801 (0.0009) [2023-12-26 12:54:15,916][123091] Updated weights for policy 0, policy_version 1666811 (0.0005) [2023-12-26 12:54:15,973][123091] Updated weights for policy 0, policy_version 1666821 (0.0006) [2023-12-26 12:54:16,028][123091] Updated weights for policy 0, policy_version 1666831 (0.0006) [2023-12-26 12:54:16,383][123090] Updated weights for policy 1, policy_version 1655593 (0.0005) [2023-12-26 12:54:16,448][123090] Updated weights for policy 1, policy_version 1655603 (0.0006) [2023-12-26 12:54:16,514][123090] Updated weights for policy 1, policy_version 1655613 (0.0005) [2023-12-26 12:54:16,705][123091] Updated weights for policy 0, policy_version 1666841 (0.0005) [2023-12-26 12:54:16,766][123091] Updated weights for policy 0, policy_version 1666851 (0.0005) [2023-12-26 12:54:16,815][123091] Updated weights for policy 0, policy_version 1666861 (0.0005) [2023-12-26 12:54:17,146][123090] Updated weights for policy 1, policy_version 1655623 (0.0007) [2023-12-26 12:54:17,211][123090] Updated weights for policy 1, policy_version 1655633 (0.0007) [2023-12-26 12:54:17,273][123090] Updated weights for policy 1, policy_version 1655643 (0.0008) [2023-12-26 12:54:17,474][123091] Updated weights for policy 0, policy_version 1666871 (0.0005) [2023-12-26 12:54:17,538][123091] Updated weights for policy 0, policy_version 1666881 (0.0005) [2023-12-26 12:54:17,605][123091] Updated weights for policy 0, policy_version 1666891 (0.0006) [2023-12-26 12:54:17,923][123090] Updated weights for policy 1, policy_version 1655653 (0.0006) [2023-12-26 12:54:17,989][123090] Updated weights for policy 1, policy_version 1655663 (0.0005) [2023-12-26 12:54:18,054][123090] Updated weights for policy 1, policy_version 1655673 (0.0008) [2023-12-26 12:54:18,334][123091] Updated weights for policy 0, policy_version 1666901 (0.0009) [2023-12-26 12:54:18,400][123091] Updated weights for policy 0, policy_version 1666911 (0.0009) [2023-12-26 12:54:18,457][123091] Updated weights for policy 0, policy_version 1666921 (0.0010) [2023-12-26 12:54:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 850591744. Throughput: 0: 9036.0, 1: 8839.0. Samples: 850604624. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:18,784][121949] Avg episode reward: [(0, '5912.605'), (1, '5848.893')] [2023-12-26 12:54:18,859][123090] Updated weights for policy 1, policy_version 1655683 (0.0009) [2023-12-26 12:54:18,913][123090] Updated weights for policy 1, policy_version 1655693 (0.0008) [2023-12-26 12:54:18,970][123090] Updated weights for policy 1, policy_version 1655703 (0.0008) [2023-12-26 12:54:19,212][123091] Updated weights for policy 0, policy_version 1666931 (0.0009) [2023-12-26 12:54:19,294][123091] Updated weights for policy 0, policy_version 1666941 (0.0007) [2023-12-26 12:54:19,361][123091] Updated weights for policy 0, policy_version 1666951 (0.0009) [2023-12-26 12:54:19,780][123090] Updated weights for policy 1, policy_version 1655713 (0.0009) [2023-12-26 12:54:19,849][123090] Updated weights for policy 1, policy_version 1655723 (0.0008) [2023-12-26 12:54:19,916][123090] Updated weights for policy 1, policy_version 1655733 (0.0008) [2023-12-26 12:54:19,991][123090] Updated weights for policy 1, policy_version 1655743 (0.0007) [2023-12-26 12:54:20,110][123091] Updated weights for policy 0, policy_version 1666961 (0.0010) [2023-12-26 12:54:20,175][123091] Updated weights for policy 0, policy_version 1666971 (0.0011) [2023-12-26 12:54:20,236][123091] Updated weights for policy 0, policy_version 1666981 (0.0011) [2023-12-26 12:54:20,293][123091] Updated weights for policy 0, policy_version 1666991 (0.0011) [2023-12-26 12:54:20,747][123090] Updated weights for policy 1, policy_version 1655753 (0.0009) [2023-12-26 12:54:20,809][123090] Updated weights for policy 1, policy_version 1655763 (0.0009) [2023-12-26 12:54:20,868][123090] Updated weights for policy 1, policy_version 1655773 (0.0009) [2023-12-26 12:54:21,147][123091] Updated weights for policy 0, policy_version 1667001 (0.0011) [2023-12-26 12:54:21,216][123091] Updated weights for policy 0, policy_version 1667011 (0.0011) [2023-12-26 12:54:21,288][123091] Updated weights for policy 0, policy_version 1667021 (0.0011) [2023-12-26 12:54:21,703][123090] Updated weights for policy 1, policy_version 1655783 (0.0009) [2023-12-26 12:54:21,776][123090] Updated weights for policy 1, policy_version 1655793 (0.0008) [2023-12-26 12:54:21,831][123090] Updated weights for policy 1, policy_version 1655803 (0.0009) [2023-12-26 12:54:22,135][123091] Updated weights for policy 0, policy_version 1667031 (0.0010) [2023-12-26 12:54:22,191][123091] Updated weights for policy 0, policy_version 1667041 (0.0010) [2023-12-26 12:54:22,245][123091] Updated weights for policy 0, policy_version 1667052 (0.0010) [2023-12-26 12:54:22,641][123090] Updated weights for policy 1, policy_version 1655813 (0.0010) [2023-12-26 12:54:22,711][123090] Updated weights for policy 1, policy_version 1655823 (0.0010) [2023-12-26 12:54:22,771][123090] Updated weights for policy 1, policy_version 1655833 (0.0010) [2023-12-26 12:54:23,095][123091] Updated weights for policy 0, policy_version 1667062 (0.0008) [2023-12-26 12:54:23,155][123091] Updated weights for policy 0, policy_version 1667072 (0.0009) [2023-12-26 12:54:23,213][123091] Updated weights for policy 0, policy_version 1667082 (0.0010) [2023-12-26 12:54:23,638][123090] Updated weights for policy 1, policy_version 1655843 (0.0009) [2023-12-26 12:54:23,687][123090] Updated weights for policy 1, policy_version 1655853 (0.0009) [2023-12-26 12:54:23,747][123090] Updated weights for policy 1, policy_version 1655863 (0.0009) [2023-12-26 12:54:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 850673664. Throughput: 0: 9018.9, 1: 8830.6. Samples: 850656520. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:23,785][121949] Avg episode reward: [(0, '5917.321'), (1, '5919.344')] [2023-12-26 12:54:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001667088_426778624.pth... [2023-12-26 12:54:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001666032_426508288.pth [2023-12-26 12:54:23,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001655872_423903232.pth... [2023-12-26 12:54:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001654816_423632896.pth [2023-12-26 12:54:24,066][123091] Updated weights for policy 0, policy_version 1667092 (0.0010) [2023-12-26 12:54:24,131][123091] Updated weights for policy 0, policy_version 1667102 (0.0009) [2023-12-26 12:54:24,184][123091] Updated weights for policy 0, policy_version 1667112 (0.0009) [2023-12-26 12:54:24,587][123090] Updated weights for policy 1, policy_version 1655873 (0.0010) [2023-12-26 12:54:24,665][123090] Updated weights for policy 1, policy_version 1655883 (0.0006) [2023-12-26 12:54:24,740][123090] Updated weights for policy 1, policy_version 1655893 (0.0007) [2023-12-26 12:54:24,810][123090] Updated weights for policy 1, policy_version 1655903 (0.0010) [2023-12-26 12:54:24,938][123091] Updated weights for policy 0, policy_version 1667122 (0.0009) [2023-12-26 12:54:25,005][123091] Updated weights for policy 0, policy_version 1667132 (0.0005) [2023-12-26 12:54:25,080][123091] Updated weights for policy 0, policy_version 1667142 (0.0005) [2023-12-26 12:54:25,132][123091] Updated weights for policy 0, policy_version 1667152 (0.0005) [2023-12-26 12:54:25,538][123090] Updated weights for policy 1, policy_version 1655913 (0.0006) [2023-12-26 12:54:25,607][123090] Updated weights for policy 1, policy_version 1655923 (0.0007) [2023-12-26 12:54:25,661][123090] Updated weights for policy 1, policy_version 1655933 (0.0008) [2023-12-26 12:54:25,788][123091] Updated weights for policy 0, policy_version 1667162 (0.0005) [2023-12-26 12:54:25,856][123091] Updated weights for policy 0, policy_version 1667172 (0.0005) [2023-12-26 12:54:25,928][123091] Updated weights for policy 0, policy_version 1667182 (0.0005) [2023-12-26 12:54:26,484][123090] Updated weights for policy 1, policy_version 1655943 (0.0009) [2023-12-26 12:54:26,543][123090] Updated weights for policy 1, policy_version 1655953 (0.0010) [2023-12-26 12:54:26,558][123091] Updated weights for policy 0, policy_version 1667192 (0.0008) [2023-12-26 12:54:26,604][123090] Updated weights for policy 1, policy_version 1655963 (0.0007) [2023-12-26 12:54:26,620][123091] Updated weights for policy 0, policy_version 1667202 (0.0008) [2023-12-26 12:54:26,683][123091] Updated weights for policy 0, policy_version 1667212 (0.0010) [2023-12-26 12:54:27,404][123090] Updated weights for policy 1, policy_version 1655973 (0.0008) [2023-12-26 12:54:27,466][123091] Updated weights for policy 0, policy_version 1667222 (0.0007) [2023-12-26 12:54:27,468][123090] Updated weights for policy 1, policy_version 1655983 (0.0008) [2023-12-26 12:54:27,520][123091] Updated weights for policy 0, policy_version 1667232 (0.0007) [2023-12-26 12:54:27,522][123090] Updated weights for policy 1, policy_version 1655993 (0.0009) [2023-12-26 12:54:27,566][123091] Updated weights for policy 0, policy_version 1667242 (0.0008) [2023-12-26 12:54:28,336][123091] Updated weights for policy 0, policy_version 1667252 (0.0010) [2023-12-26 12:54:28,359][123090] Updated weights for policy 1, policy_version 1656003 (0.0007) [2023-12-26 12:54:28,392][123091] Updated weights for policy 0, policy_version 1667262 (0.0008) [2023-12-26 12:54:28,417][123090] Updated weights for policy 1, policy_version 1656013 (0.0008) [2023-12-26 12:54:28,442][123091] Updated weights for policy 0, policy_version 1667272 (0.0008) [2023-12-26 12:54:28,471][123090] Updated weights for policy 1, policy_version 1656023 (0.0008) [2023-12-26 12:54:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 850771968. Throughput: 0: 9091.4, 1: 8782.2. Samples: 850762688. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:28,785][121949] Avg episode reward: [(0, '5790.062'), (1, '5673.331')] [2023-12-26 12:54:29,186][123090] Updated weights for policy 1, policy_version 1656033 (0.0008) [2023-12-26 12:54:29,255][123090] Updated weights for policy 1, policy_version 1656043 (0.0009) [2023-12-26 12:54:29,315][123090] Updated weights for policy 1, policy_version 1656053 (0.0009) [2023-12-26 12:54:29,331][123091] Updated weights for policy 0, policy_version 1667282 (0.0009) [2023-12-26 12:54:29,380][123090] Updated weights for policy 1, policy_version 1656063 (0.0007) [2023-12-26 12:54:29,391][123091] Updated weights for policy 0, policy_version 1667292 (0.0010) [2023-12-26 12:54:29,448][123091] Updated weights for policy 0, policy_version 1667302 (0.0009) [2023-12-26 12:54:29,513][123091] Updated weights for policy 0, policy_version 1667312 (0.0008) [2023-12-26 12:54:30,188][123090] Updated weights for policy 1, policy_version 1656073 (0.0007) [2023-12-26 12:54:30,237][123090] Updated weights for policy 1, policy_version 1656083 (0.0007) [2023-12-26 12:54:30,275][123091] Updated weights for policy 0, policy_version 1667322 (0.0005) [2023-12-26 12:54:30,300][123090] Updated weights for policy 1, policy_version 1656093 (0.0009) [2023-12-26 12:54:30,334][123091] Updated weights for policy 0, policy_version 1667332 (0.0007) [2023-12-26 12:54:30,392][123091] Updated weights for policy 0, policy_version 1667342 (0.0010) [2023-12-26 12:54:30,937][123091] Updated weights for policy 0, policy_version 1667352 (0.0006) [2023-12-26 12:54:30,988][123091] Updated weights for policy 0, policy_version 1667362 (0.0005) [2023-12-26 12:54:31,061][123091] Updated weights for policy 0, policy_version 1667374 (0.0008) [2023-12-26 12:54:31,162][123090] Updated weights for policy 1, policy_version 1656103 (0.0009) [2023-12-26 12:54:31,227][123090] Updated weights for policy 1, policy_version 1656113 (0.0009) [2023-12-26 12:54:31,287][123090] Updated weights for policy 1, policy_version 1656123 (0.0009) [2023-12-26 12:54:31,863][123091] Updated weights for policy 0, policy_version 1667384 (0.0010) [2023-12-26 12:54:31,912][123091] Updated weights for policy 0, policy_version 1667394 (0.0009) [2023-12-26 12:54:31,975][123091] Updated weights for policy 0, policy_version 1667404 (0.0009) [2023-12-26 12:54:32,125][123090] Updated weights for policy 1, policy_version 1656133 (0.0009) [2023-12-26 12:54:32,184][123090] Updated weights for policy 1, policy_version 1656143 (0.0009) [2023-12-26 12:54:32,241][123090] Updated weights for policy 1, policy_version 1656153 (0.0009) [2023-12-26 12:54:32,849][123091] Updated weights for policy 0, policy_version 1667414 (0.0009) [2023-12-26 12:54:32,910][123091] Updated weights for policy 0, policy_version 1667424 (0.0009) [2023-12-26 12:54:32,980][123091] Updated weights for policy 0, policy_version 1667434 (0.0005) [2023-12-26 12:54:33,113][123090] Updated weights for policy 1, policy_version 1656163 (0.0010) [2023-12-26 12:54:33,180][123090] Updated weights for policy 1, policy_version 1656173 (0.0010) [2023-12-26 12:54:33,249][123090] Updated weights for policy 1, policy_version 1656183 (0.0010) [2023-12-26 12:54:33,622][123091] Updated weights for policy 0, policy_version 1667444 (0.0005) [2023-12-26 12:54:33,677][123091] Updated weights for policy 0, policy_version 1667454 (0.0005) [2023-12-26 12:54:33,732][123091] Updated weights for policy 0, policy_version 1667464 (0.0005) [2023-12-26 12:54:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 850853888. Throughput: 0: 9029.3, 1: 8795.7. Samples: 850870140. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:33,784][121949] Avg episode reward: [(0, '5898.881'), (1, '5520.058')] [2023-12-26 12:54:34,047][123090] Updated weights for policy 1, policy_version 1656193 (0.0010) [2023-12-26 12:54:34,117][123090] Updated weights for policy 1, policy_version 1656203 (0.0010) [2023-12-26 12:54:34,184][123090] Updated weights for policy 1, policy_version 1656213 (0.0010) [2023-12-26 12:54:34,244][123090] Updated weights for policy 1, policy_version 1656223 (0.0006) [2023-12-26 12:54:34,485][123091] Updated weights for policy 0, policy_version 1667474 (0.0007) [2023-12-26 12:54:34,555][123091] Updated weights for policy 0, policy_version 1667484 (0.0009) [2023-12-26 12:54:34,625][123091] Updated weights for policy 0, policy_version 1667494 (0.0010) [2023-12-26 12:54:34,699][123091] Updated weights for policy 0, policy_version 1667504 (0.0010) [2023-12-26 12:54:34,887][123090] Updated weights for policy 1, policy_version 1656233 (0.0005) [2023-12-26 12:54:34,944][123090] Updated weights for policy 1, policy_version 1656243 (0.0008) [2023-12-26 12:54:34,997][123090] Updated weights for policy 1, policy_version 1656253 (0.0005) [2023-12-26 12:54:35,450][123091] Updated weights for policy 0, policy_version 1667514 (0.0005) [2023-12-26 12:54:35,519][123091] Updated weights for policy 0, policy_version 1667524 (0.0005) [2023-12-26 12:54:35,588][123091] Updated weights for policy 0, policy_version 1667534 (0.0006) [2023-12-26 12:54:35,615][123090] Updated weights for policy 1, policy_version 1656263 (0.0005) [2023-12-26 12:54:35,663][123090] Updated weights for policy 1, policy_version 1656273 (0.0005) [2023-12-26 12:54:35,721][123090] Updated weights for policy 1, policy_version 1656283 (0.0005) [2023-12-26 12:54:36,364][123091] Updated weights for policy 0, policy_version 1667544 (0.0008) [2023-12-26 12:54:36,428][123091] Updated weights for policy 0, policy_version 1667554 (0.0008) [2023-12-26 12:54:36,433][123090] Updated weights for policy 1, policy_version 1656293 (0.0008) [2023-12-26 12:54:36,495][123091] Updated weights for policy 0, policy_version 1667564 (0.0008) [2023-12-26 12:54:36,504][123090] Updated weights for policy 1, policy_version 1656303 (0.0007) [2023-12-26 12:54:36,574][123090] Updated weights for policy 1, policy_version 1656313 (0.0009) [2023-12-26 12:54:37,303][123091] Updated weights for policy 0, policy_version 1667574 (0.0008) [2023-12-26 12:54:37,361][123091] Updated weights for policy 0, policy_version 1667584 (0.0009) [2023-12-26 12:54:37,400][123090] Updated weights for policy 1, policy_version 1656323 (0.0009) [2023-12-26 12:54:37,428][123091] Updated weights for policy 0, policy_version 1667594 (0.0010) [2023-12-26 12:54:37,470][123090] Updated weights for policy 1, policy_version 1656333 (0.0007) [2023-12-26 12:54:37,534][123090] Updated weights for policy 1, policy_version 1656343 (0.0010) [2023-12-26 12:54:38,235][123091] Updated weights for policy 0, policy_version 1667604 (0.0007) [2023-12-26 12:54:38,302][123091] Updated weights for policy 0, policy_version 1667614 (0.0010) [2023-12-26 12:54:38,372][123091] Updated weights for policy 0, policy_version 1667624 (0.0010) [2023-12-26 12:54:38,375][123090] Updated weights for policy 1, policy_version 1656353 (0.0009) [2023-12-26 12:54:38,428][123090] Updated weights for policy 1, policy_version 1656363 (0.0007) [2023-12-26 12:54:38,479][123090] Updated weights for policy 1, policy_version 1656373 (0.0010) [2023-12-26 12:54:38,530][123090] Updated weights for policy 1, policy_version 1656383 (0.0009) [2023-12-26 12:54:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 850952192. Throughput: 0: 9072.1, 1: 8881.3. Samples: 850926560. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:38,785][121949] Avg episode reward: [(0, '5967.028'), (1, '5583.811')] [2023-12-26 12:54:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001667632_426917888.pth... [2023-12-26 12:54:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001656384_424034304.pth... [2023-12-26 12:54:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001666576_426647552.pth [2023-12-26 12:54:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001655328_423763968.pth [2023-12-26 12:54:39,152][123091] Updated weights for policy 0, policy_version 1667634 (0.0009) [2023-12-26 12:54:39,230][123091] Updated weights for policy 0, policy_version 1667644 (0.0006) [2023-12-26 12:54:39,296][123091] Updated weights for policy 0, policy_version 1667654 (0.0007) [2023-12-26 12:54:39,354][123090] Updated weights for policy 1, policy_version 1656393 (0.0009) [2023-12-26 12:54:39,368][123091] Updated weights for policy 0, policy_version 1667664 (0.0009) [2023-12-26 12:54:39,421][123090] Updated weights for policy 1, policy_version 1656403 (0.0009) [2023-12-26 12:54:39,474][123090] Updated weights for policy 1, policy_version 1656413 (0.0009) [2023-12-26 12:54:40,149][123091] Updated weights for policy 0, policy_version 1667674 (0.0011) [2023-12-26 12:54:40,213][123091] Updated weights for policy 0, policy_version 1667684 (0.0011) [2023-12-26 12:54:40,280][123091] Updated weights for policy 0, policy_version 1667694 (0.0011) [2023-12-26 12:54:40,364][123090] Updated weights for policy 1, policy_version 1656423 (0.0009) [2023-12-26 12:54:40,413][123090] Updated weights for policy 1, policy_version 1656433 (0.0008) [2023-12-26 12:54:40,472][123090] Updated weights for policy 1, policy_version 1656443 (0.0009) [2023-12-26 12:54:41,053][123091] Updated weights for policy 0, policy_version 1667704 (0.0010) [2023-12-26 12:54:41,125][123091] Updated weights for policy 0, policy_version 1667714 (0.0013) [2023-12-26 12:54:41,194][123091] Updated weights for policy 0, policy_version 1667724 (0.0009) [2023-12-26 12:54:41,399][123090] Updated weights for policy 1, policy_version 1656453 (0.0009) [2023-12-26 12:54:41,476][123090] Updated weights for policy 1, policy_version 1656463 (0.0010) [2023-12-26 12:54:41,549][123090] Updated weights for policy 1, policy_version 1656473 (0.0010) [2023-12-26 12:54:41,973][123091] Updated weights for policy 0, policy_version 1667734 (0.0010) [2023-12-26 12:54:42,040][123091] Updated weights for policy 0, policy_version 1667744 (0.0010) [2023-12-26 12:54:42,098][123091] Updated weights for policy 0, policy_version 1667754 (0.0010) [2023-12-26 12:54:42,274][123090] Updated weights for policy 1, policy_version 1656483 (0.0009) [2023-12-26 12:54:42,341][123090] Updated weights for policy 1, policy_version 1656493 (0.0008) [2023-12-26 12:54:42,409][123090] Updated weights for policy 1, policy_version 1656503 (0.0009) [2023-12-26 12:54:42,982][123091] Updated weights for policy 0, policy_version 1667764 (0.0010) [2023-12-26 12:54:43,041][123091] Updated weights for policy 0, policy_version 1667774 (0.0010) [2023-12-26 12:54:43,098][123091] Updated weights for policy 0, policy_version 1667784 (0.0009) [2023-12-26 12:54:43,254][123090] Updated weights for policy 1, policy_version 1656513 (0.0009) [2023-12-26 12:54:43,307][123090] Updated weights for policy 1, policy_version 1656523 (0.0009) [2023-12-26 12:54:43,353][123090] Updated weights for policy 1, policy_version 1656533 (0.0008) [2023-12-26 12:54:43,403][123090] Updated weights for policy 1, policy_version 1656543 (0.0008) [2023-12-26 12:54:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 851034112. Throughput: 0: 9026.8, 1: 8785.2. Samples: 851028832. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:43,785][121949] Avg episode reward: [(0, '5973.775'), (1, '5721.326')] [2023-12-26 12:54:43,970][123091] Updated weights for policy 0, policy_version 1667794 (0.0009) [2023-12-26 12:54:44,030][123091] Updated weights for policy 0, policy_version 1667804 (0.0010) [2023-12-26 12:54:44,085][123091] Updated weights for policy 0, policy_version 1667815 (0.0010) [2023-12-26 12:54:44,135][123090] Updated weights for policy 1, policy_version 1656553 (0.0006) [2023-12-26 12:54:44,196][123090] Updated weights for policy 1, policy_version 1656563 (0.0005) [2023-12-26 12:54:44,255][123090] Updated weights for policy 1, policy_version 1656573 (0.0007) [2023-12-26 12:54:44,942][123091] Updated weights for policy 0, policy_version 1667825 (0.0009) [2023-12-26 12:54:44,984][123090] Updated weights for policy 1, policy_version 1656583 (0.0009) [2023-12-26 12:54:45,002][123091] Updated weights for policy 0, policy_version 1667835 (0.0011) [2023-12-26 12:54:45,048][123090] Updated weights for policy 1, policy_version 1656593 (0.0011) [2023-12-26 12:54:45,066][123091] Updated weights for policy 0, policy_version 1667845 (0.0011) [2023-12-26 12:54:45,113][123090] Updated weights for policy 1, policy_version 1656603 (0.0011) [2023-12-26 12:54:45,130][123091] Updated weights for policy 0, policy_version 1667855 (0.0011) [2023-12-26 12:54:45,845][123090] Updated weights for policy 1, policy_version 1656613 (0.0008) [2023-12-26 12:54:45,907][123090] Updated weights for policy 1, policy_version 1656623 (0.0005) [2023-12-26 12:54:45,944][123091] Updated weights for policy 0, policy_version 1667865 (0.0009) [2023-12-26 12:54:45,974][123090] Updated weights for policy 1, policy_version 1656633 (0.0009) [2023-12-26 12:54:46,001][123091] Updated weights for policy 0, policy_version 1667875 (0.0008) [2023-12-26 12:54:46,063][123091] Updated weights for policy 0, policy_version 1667885 (0.0009) [2023-12-26 12:54:46,720][123090] Updated weights for policy 1, policy_version 1656643 (0.0009) [2023-12-26 12:54:46,782][123090] Updated weights for policy 1, policy_version 1656653 (0.0005) [2023-12-26 12:54:46,803][123091] Updated weights for policy 0, policy_version 1667895 (0.0006) [2023-12-26 12:54:46,857][123090] Updated weights for policy 1, policy_version 1656663 (0.0005) [2023-12-26 12:54:46,866][123091] Updated weights for policy 0, policy_version 1667905 (0.0007) [2023-12-26 12:54:46,917][123091] Updated weights for policy 0, policy_version 1667915 (0.0009) [2023-12-26 12:54:47,423][123090] Updated weights for policy 1, policy_version 1656673 (0.0005) [2023-12-26 12:54:47,487][123090] Updated weights for policy 1, policy_version 1656683 (0.0005) [2023-12-26 12:54:47,542][123090] Updated weights for policy 1, policy_version 1656693 (0.0006) [2023-12-26 12:54:47,596][123090] Updated weights for policy 1, policy_version 1656703 (0.0010) [2023-12-26 12:54:47,701][123091] Updated weights for policy 0, policy_version 1667925 (0.0010) [2023-12-26 12:54:47,764][123091] Updated weights for policy 0, policy_version 1667935 (0.0009) [2023-12-26 12:54:47,822][123091] Updated weights for policy 0, policy_version 1667945 (0.0009) [2023-12-26 12:54:48,283][123090] Updated weights for policy 1, policy_version 1656713 (0.0009) [2023-12-26 12:54:48,356][123090] Updated weights for policy 1, policy_version 1656723 (0.0010) [2023-12-26 12:54:48,417][123090] Updated weights for policy 1, policy_version 1656733 (0.0008) [2023-12-26 12:54:48,697][123091] Updated weights for policy 0, policy_version 1667955 (0.0009) [2023-12-26 12:54:48,767][123091] Updated weights for policy 0, policy_version 1667965 (0.0008) [2023-12-26 12:54:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 851124224. Throughput: 0: 8941.5, 1: 8921.0. Samples: 851137664. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:48,785][121949] Avg episode reward: [(0, '5848.284'), (1, '5499.170')] [2023-12-26 12:54:48,839][123091] Updated weights for policy 0, policy_version 1667975 (0.0008) [2023-12-26 12:54:49,261][123090] Updated weights for policy 1, policy_version 1656743 (0.0008) [2023-12-26 12:54:49,330][123090] Updated weights for policy 1, policy_version 1656753 (0.0005) [2023-12-26 12:54:49,401][123090] Updated weights for policy 1, policy_version 1656763 (0.0008) [2023-12-26 12:54:49,590][123091] Updated weights for policy 0, policy_version 1667985 (0.0008) [2023-12-26 12:54:49,645][123091] Updated weights for policy 0, policy_version 1667995 (0.0005) [2023-12-26 12:54:49,709][123091] Updated weights for policy 0, policy_version 1668005 (0.0006) [2023-12-26 12:54:49,762][123091] Updated weights for policy 0, policy_version 1668015 (0.0008) [2023-12-26 12:54:50,226][123090] Updated weights for policy 1, policy_version 1656773 (0.0007) [2023-12-26 12:54:50,294][123090] Updated weights for policy 1, policy_version 1656783 (0.0010) [2023-12-26 12:54:50,352][123090] Updated weights for policy 1, policy_version 1656793 (0.0009) [2023-12-26 12:54:50,552][123091] Updated weights for policy 0, policy_version 1668025 (0.0009) [2023-12-26 12:54:50,616][123091] Updated weights for policy 0, policy_version 1668035 (0.0008) [2023-12-26 12:54:50,680][123091] Updated weights for policy 0, policy_version 1668045 (0.0006) [2023-12-26 12:54:51,230][123090] Updated weights for policy 1, policy_version 1656803 (0.0010) [2023-12-26 12:54:51,306][123090] Updated weights for policy 1, policy_version 1656813 (0.0011) [2023-12-26 12:54:51,380][123091] Updated weights for policy 0, policy_version 1668055 (0.0008) [2023-12-26 12:54:51,382][123090] Updated weights for policy 1, policy_version 1656823 (0.0010) [2023-12-26 12:54:51,447][123091] Updated weights for policy 0, policy_version 1668065 (0.0006) [2023-12-26 12:54:51,512][123091] Updated weights for policy 0, policy_version 1668075 (0.0007) [2023-12-26 12:54:52,218][123090] Updated weights for policy 1, policy_version 1656833 (0.0008) [2023-12-26 12:54:52,227][123091] Updated weights for policy 0, policy_version 1668085 (0.0009) [2023-12-26 12:54:52,286][123090] Updated weights for policy 1, policy_version 1656843 (0.0007) [2023-12-26 12:54:52,287][123091] Updated weights for policy 0, policy_version 1668095 (0.0009) [2023-12-26 12:54:52,354][123090] Updated weights for policy 1, policy_version 1656853 (0.0009) [2023-12-26 12:54:52,354][123091] Updated weights for policy 0, policy_version 1668105 (0.0010) [2023-12-26 12:54:52,418][123090] Updated weights for policy 1, policy_version 1656863 (0.0008) [2023-12-26 12:54:53,193][123091] Updated weights for policy 0, policy_version 1668115 (0.0009) [2023-12-26 12:54:53,216][123090] Updated weights for policy 1, policy_version 1656873 (0.0007) [2023-12-26 12:54:53,243][123091] Updated weights for policy 0, policy_version 1668125 (0.0007) [2023-12-26 12:54:53,276][123090] Updated weights for policy 1, policy_version 1656883 (0.0008) [2023-12-26 12:54:53,308][123091] Updated weights for policy 0, policy_version 1668135 (0.0009) [2023-12-26 12:54:53,340][123090] Updated weights for policy 1, policy_version 1656893 (0.0007) [2023-12-26 12:54:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 851214336. Throughput: 0: 8952.2, 1: 8898.1. Samples: 851189972. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:53,785][121949] Avg episode reward: [(0, '5757.310'), (1, '5560.915')] [2023-12-26 12:54:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001656896_424165376.pth... [2023-12-26 12:54:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001668144_427048960.pth... [2023-12-26 12:54:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001655872_423903232.pth [2023-12-26 12:54:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001667088_426778624.pth [2023-12-26 12:54:54,120][123091] Updated weights for policy 0, policy_version 1668145 (0.0007) [2023-12-26 12:54:54,151][123090] Updated weights for policy 1, policy_version 1656903 (0.0009) [2023-12-26 12:54:54,183][123091] Updated weights for policy 0, policy_version 1668155 (0.0007) [2023-12-26 12:54:54,211][123090] Updated weights for policy 1, policy_version 1656913 (0.0008) [2023-12-26 12:54:54,245][123091] Updated weights for policy 0, policy_version 1668165 (0.0006) [2023-12-26 12:54:54,269][123090] Updated weights for policy 1, policy_version 1656924 (0.0009) [2023-12-26 12:54:54,300][123091] Updated weights for policy 0, policy_version 1668175 (0.0008) [2023-12-26 12:54:55,070][123090] Updated weights for policy 1, policy_version 1656934 (0.0006) [2023-12-26 12:54:55,131][123090] Updated weights for policy 1, policy_version 1656944 (0.0008) [2023-12-26 12:54:55,133][123091] Updated weights for policy 0, policy_version 1668185 (0.0006) [2023-12-26 12:54:55,179][123091] Updated weights for policy 0, policy_version 1668195 (0.0005) [2023-12-26 12:54:55,192][123090] Updated weights for policy 1, policy_version 1656954 (0.0008) [2023-12-26 12:54:55,230][123091] Updated weights for policy 0, policy_version 1668205 (0.0006) [2023-12-26 12:54:55,972][123091] Updated weights for policy 0, policy_version 1668215 (0.0009) [2023-12-26 12:54:55,988][123090] Updated weights for policy 1, policy_version 1656964 (0.0007) [2023-12-26 12:54:56,035][123091] Updated weights for policy 0, policy_version 1668225 (0.0009) [2023-12-26 12:54:56,052][123090] Updated weights for policy 1, policy_version 1656974 (0.0005) [2023-12-26 12:54:56,089][123091] Updated weights for policy 0, policy_version 1668235 (0.0005) [2023-12-26 12:54:56,103][123090] Updated weights for policy 1, policy_version 1656984 (0.0005) [2023-12-26 12:54:56,642][123091] Updated weights for policy 0, policy_version 1668245 (0.0008) [2023-12-26 12:54:56,701][123091] Updated weights for policy 0, policy_version 1668255 (0.0010) [2023-12-26 12:54:56,753][123091] Updated weights for policy 0, policy_version 1668265 (0.0009) [2023-12-26 12:54:56,905][123090] Updated weights for policy 1, policy_version 1656994 (0.0006) [2023-12-26 12:54:56,965][123090] Updated weights for policy 1, policy_version 1657004 (0.0006) [2023-12-26 12:54:57,011][123090] Updated weights for policy 1, policy_version 1657014 (0.0005) [2023-12-26 12:54:57,058][123090] Updated weights for policy 1, policy_version 1657024 (0.0005) [2023-12-26 12:54:57,429][123091] Updated weights for policy 0, policy_version 1668275 (0.0007) [2023-12-26 12:54:57,486][123091] Updated weights for policy 0, policy_version 1668285 (0.0010) [2023-12-26 12:54:57,540][123091] Updated weights for policy 0, policy_version 1668295 (0.0010) [2023-12-26 12:54:57,762][123090] Updated weights for policy 1, policy_version 1657034 (0.0008) [2023-12-26 12:54:57,825][123090] Updated weights for policy 1, policy_version 1657044 (0.0005) [2023-12-26 12:54:57,893][123090] Updated weights for policy 1, policy_version 1657054 (0.0005) [2023-12-26 12:54:58,279][123091] Updated weights for policy 0, policy_version 1668305 (0.0010) [2023-12-26 12:54:58,347][123091] Updated weights for policy 0, policy_version 1668315 (0.0007) [2023-12-26 12:54:58,415][123091] Updated weights for policy 0, policy_version 1668325 (0.0008) [2023-12-26 12:54:58,481][123091] Updated weights for policy 0, policy_version 1668335 (0.0009) [2023-12-26 12:54:58,717][123090] Updated weights for policy 1, policy_version 1657064 (0.0010) [2023-12-26 12:54:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 851304448. Throughput: 0: 9018.6, 1: 8934.7. Samples: 851299648. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:54:58,785][121949] Avg episode reward: [(0, '5883.949'), (1, '5617.056')] [2023-12-26 12:54:58,786][123090] Updated weights for policy 1, policy_version 1657074 (0.0010) [2023-12-26 12:54:58,863][123090] Updated weights for policy 1, policy_version 1657084 (0.0010) [2023-12-26 12:54:59,263][123091] Updated weights for policy 0, policy_version 1668345 (0.0011) [2023-12-26 12:54:59,319][123091] Updated weights for policy 0, policy_version 1668355 (0.0010) [2023-12-26 12:54:59,387][123091] Updated weights for policy 0, policy_version 1668365 (0.0011) [2023-12-26 12:54:59,637][123090] Updated weights for policy 1, policy_version 1657094 (0.0009) [2023-12-26 12:54:59,706][123090] Updated weights for policy 1, policy_version 1657104 (0.0009) [2023-12-26 12:54:59,757][123090] Updated weights for policy 1, policy_version 1657114 (0.0008) [2023-12-26 12:55:00,172][123091] Updated weights for policy 0, policy_version 1668375 (0.0007) [2023-12-26 12:55:00,234][123091] Updated weights for policy 0, policy_version 1668385 (0.0005) [2023-12-26 12:55:00,291][123091] Updated weights for policy 0, policy_version 1668395 (0.0005) [2023-12-26 12:55:00,635][123090] Updated weights for policy 1, policy_version 1657124 (0.0010) [2023-12-26 12:55:00,683][123090] Updated weights for policy 1, policy_version 1657134 (0.0009) [2023-12-26 12:55:00,733][123090] Updated weights for policy 1, policy_version 1657144 (0.0009) [2023-12-26 12:55:00,997][123091] Updated weights for policy 0, policy_version 1668405 (0.0005) [2023-12-26 12:55:01,063][123091] Updated weights for policy 0, policy_version 1668415 (0.0008) [2023-12-26 12:55:01,115][123091] Updated weights for policy 0, policy_version 1668425 (0.0009) [2023-12-26 12:55:01,599][123090] Updated weights for policy 1, policy_version 1657154 (0.0009) [2023-12-26 12:55:01,667][123090] Updated weights for policy 1, policy_version 1657164 (0.0008) [2023-12-26 12:55:01,748][123090] Updated weights for policy 1, policy_version 1657174 (0.0009) [2023-12-26 12:55:01,808][123090] Updated weights for policy 1, policy_version 1657184 (0.0010) [2023-12-26 12:55:01,962][123091] Updated weights for policy 0, policy_version 1668435 (0.0009) [2023-12-26 12:55:02,021][123091] Updated weights for policy 0, policy_version 1668445 (0.0008) [2023-12-26 12:55:02,087][123091] Updated weights for policy 0, policy_version 1668455 (0.0008) [2023-12-26 12:55:02,682][123090] Updated weights for policy 1, policy_version 1657194 (0.0008) [2023-12-26 12:55:02,738][123090] Updated weights for policy 1, policy_version 1657204 (0.0005) [2023-12-26 12:55:02,797][123090] Updated weights for policy 1, policy_version 1657214 (0.0007) [2023-12-26 12:55:02,805][123091] Updated weights for policy 0, policy_version 1668465 (0.0008) [2023-12-26 12:55:02,855][123091] Updated weights for policy 0, policy_version 1668476 (0.0008) [2023-12-26 12:55:02,903][123091] Updated weights for policy 0, policy_version 1668486 (0.0009) [2023-12-26 12:55:02,952][123091] Updated weights for policy 0, policy_version 1668496 (0.0009) [2023-12-26 12:55:03,410][123090] Updated weights for policy 1, policy_version 1657224 (0.0006) [2023-12-26 12:55:03,467][123090] Updated weights for policy 1, policy_version 1657234 (0.0006) [2023-12-26 12:55:03,514][123090] Updated weights for policy 1, policy_version 1657244 (0.0005) [2023-12-26 12:55:03,689][123091] Updated weights for policy 0, policy_version 1668506 (0.0007) [2023-12-26 12:55:03,745][123091] Updated weights for policy 0, policy_version 1668516 (0.0006) [2023-12-26 12:55:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 851394560. Throughput: 0: 9019.1, 1: 8810.9. Samples: 851406976. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:03,785][121949] Avg episode reward: [(0, '5910.264'), (1, '5829.729')] [2023-12-26 12:55:03,802][123091] Updated weights for policy 0, policy_version 1668526 (0.0006) [2023-12-26 12:55:04,242][123090] Updated weights for policy 1, policy_version 1657254 (0.0008) [2023-12-26 12:55:04,314][123090] Updated weights for policy 1, policy_version 1657264 (0.0009) [2023-12-26 12:55:04,387][123090] Updated weights for policy 1, policy_version 1657274 (0.0010) [2023-12-26 12:55:04,598][123091] Updated weights for policy 0, policy_version 1668536 (0.0006) [2023-12-26 12:55:04,652][123091] Updated weights for policy 0, policy_version 1668546 (0.0009) [2023-12-26 12:55:04,715][123091] Updated weights for policy 0, policy_version 1668556 (0.0009) [2023-12-26 12:55:05,185][123090] Updated weights for policy 1, policy_version 1657284 (0.0009) [2023-12-26 12:55:05,255][123090] Updated weights for policy 1, policy_version 1657294 (0.0009) [2023-12-26 12:55:05,306][123090] Updated weights for policy 1, policy_version 1657304 (0.0008) [2023-12-26 12:55:05,452][123091] Updated weights for policy 0, policy_version 1668566 (0.0010) [2023-12-26 12:55:05,515][123091] Updated weights for policy 0, policy_version 1668576 (0.0010) [2023-12-26 12:55:05,573][123091] Updated weights for policy 0, policy_version 1668586 (0.0010) [2023-12-26 12:55:06,221][123090] Updated weights for policy 1, policy_version 1657314 (0.0009) [2023-12-26 12:55:06,266][123091] Updated weights for policy 0, policy_version 1668596 (0.0006) [2023-12-26 12:55:06,286][123090] Updated weights for policy 1, policy_version 1657324 (0.0008) [2023-12-26 12:55:06,328][123091] Updated weights for policy 0, policy_version 1668606 (0.0007) [2023-12-26 12:55:06,352][123090] Updated weights for policy 1, policy_version 1657334 (0.0007) [2023-12-26 12:55:06,395][123091] Updated weights for policy 0, policy_version 1668616 (0.0010) [2023-12-26 12:55:06,412][123090] Updated weights for policy 1, policy_version 1657344 (0.0008) [2023-12-26 12:55:07,187][123091] Updated weights for policy 0, policy_version 1668626 (0.0011) [2023-12-26 12:55:07,253][123091] Updated weights for policy 0, policy_version 1668636 (0.0010) [2023-12-26 12:55:07,268][123090] Updated weights for policy 1, policy_version 1657354 (0.0006) [2023-12-26 12:55:07,308][123091] Updated weights for policy 0, policy_version 1668646 (0.0010) [2023-12-26 12:55:07,328][123090] Updated weights for policy 1, policy_version 1657364 (0.0007) [2023-12-26 12:55:07,367][123091] Updated weights for policy 0, policy_version 1668656 (0.0010) [2023-12-26 12:55:07,389][123090] Updated weights for policy 1, policy_version 1657374 (0.0009) [2023-12-26 12:55:08,092][123091] Updated weights for policy 0, policy_version 1668666 (0.0005) [2023-12-26 12:55:08,161][123091] Updated weights for policy 0, policy_version 1668676 (0.0008) [2023-12-26 12:55:08,227][123091] Updated weights for policy 0, policy_version 1668686 (0.0011) [2023-12-26 12:55:08,276][123090] Updated weights for policy 1, policy_version 1657384 (0.0009) [2023-12-26 12:55:08,337][123090] Updated weights for policy 1, policy_version 1657394 (0.0009) [2023-12-26 12:55:08,395][123090] Updated weights for policy 1, policy_version 1657404 (0.0009) [2023-12-26 12:55:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 851484672. Throughput: 0: 9069.8, 1: 8799.8. Samples: 851460652. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:08,785][121949] Avg episode reward: [(0, '5997.269'), (1, '5637.284')] [2023-12-26 12:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001668688_427188224.pth... [2023-12-26 12:55:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001657408_424296448.pth... [2023-12-26 12:55:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001667632_426917888.pth [2023-12-26 12:55:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001656384_424034304.pth [2023-12-26 12:55:09,036][123091] Updated weights for policy 0, policy_version 1668696 (0.0011) [2023-12-26 12:55:09,109][123091] Updated weights for policy 0, policy_version 1668706 (0.0011) [2023-12-26 12:55:09,183][123091] Updated weights for policy 0, policy_version 1668716 (0.0011) [2023-12-26 12:55:09,255][123090] Updated weights for policy 1, policy_version 1657414 (0.0009) [2023-12-26 12:55:09,319][123090] Updated weights for policy 1, policy_version 1657424 (0.0009) [2023-12-26 12:55:09,397][123090] Updated weights for policy 1, policy_version 1657434 (0.0008) [2023-12-26 12:55:09,989][123091] Updated weights for policy 0, policy_version 1668726 (0.0009) [2023-12-26 12:55:10,045][123091] Updated weights for policy 0, policy_version 1668736 (0.0008) [2023-12-26 12:55:10,098][123091] Updated weights for policy 0, policy_version 1668746 (0.0008) [2023-12-26 12:55:10,248][123090] Updated weights for policy 1, policy_version 1657444 (0.0010) [2023-12-26 12:55:10,315][123090] Updated weights for policy 1, policy_version 1657454 (0.0010) [2023-12-26 12:55:10,380][123090] Updated weights for policy 1, policy_version 1657464 (0.0010) [2023-12-26 12:55:10,907][123091] Updated weights for policy 0, policy_version 1668756 (0.0009) [2023-12-26 12:55:10,959][123091] Updated weights for policy 0, policy_version 1668766 (0.0007) [2023-12-26 12:55:11,026][123091] Updated weights for policy 0, policy_version 1668776 (0.0008) [2023-12-26 12:55:11,229][123090] Updated weights for policy 1, policy_version 1657474 (0.0010) [2023-12-26 12:55:11,299][123090] Updated weights for policy 1, policy_version 1657484 (0.0009) [2023-12-26 12:55:11,358][123090] Updated weights for policy 1, policy_version 1657494 (0.0010) [2023-12-26 12:55:11,434][123090] Updated weights for policy 1, policy_version 1657504 (0.0009) [2023-12-26 12:55:11,916][123091] Updated weights for policy 0, policy_version 1668786 (0.0009) [2023-12-26 12:55:11,983][123091] Updated weights for policy 0, policy_version 1668796 (0.0009) [2023-12-26 12:55:12,049][123091] Updated weights for policy 0, policy_version 1668806 (0.0010) [2023-12-26 12:55:12,105][123091] Updated weights for policy 0, policy_version 1668816 (0.0010) [2023-12-26 12:55:12,260][123090] Updated weights for policy 1, policy_version 1657514 (0.0009) [2023-12-26 12:55:12,324][123090] Updated weights for policy 1, policy_version 1657524 (0.0009) [2023-12-26 12:55:12,389][123090] Updated weights for policy 1, policy_version 1657534 (0.0010) [2023-12-26 12:55:12,875][123091] Updated weights for policy 0, policy_version 1668826 (0.0009) [2023-12-26 12:55:12,928][123091] Updated weights for policy 0, policy_version 1668837 (0.0010) [2023-12-26 12:55:12,991][123091] Updated weights for policy 0, policy_version 1668847 (0.0009) [2023-12-26 12:55:13,281][123090] Updated weights for policy 1, policy_version 1657544 (0.0009) [2023-12-26 12:55:13,337][123090] Updated weights for policy 1, policy_version 1657554 (0.0010) [2023-12-26 12:55:13,391][123090] Updated weights for policy 1, policy_version 1657564 (0.0010) [2023-12-26 12:55:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 851566592. Throughput: 0: 9018.7, 1: 8738.5. Samples: 851561760. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:13,785][121949] Avg episode reward: [(0, '5982.109'), (1, '5668.910')] [2023-12-26 12:55:13,800][123091] Updated weights for policy 0, policy_version 1668857 (0.0006) [2023-12-26 12:55:13,864][123091] Updated weights for policy 0, policy_version 1668867 (0.0008) [2023-12-26 12:55:13,922][123091] Updated weights for policy 0, policy_version 1668877 (0.0009) [2023-12-26 12:55:14,289][123090] Updated weights for policy 1, policy_version 1657574 (0.0009) [2023-12-26 12:55:14,341][123090] Updated weights for policy 1, policy_version 1657584 (0.0009) [2023-12-26 12:55:14,398][123090] Updated weights for policy 1, policy_version 1657594 (0.0010) [2023-12-26 12:55:14,663][123091] Updated weights for policy 0, policy_version 1668887 (0.0009) [2023-12-26 12:55:14,721][123091] Updated weights for policy 0, policy_version 1668897 (0.0009) [2023-12-26 12:55:14,784][123091] Updated weights for policy 0, policy_version 1668907 (0.0009) [2023-12-26 12:55:15,242][123090] Updated weights for policy 1, policy_version 1657604 (0.0008) [2023-12-26 12:55:15,316][123090] Updated weights for policy 1, policy_version 1657614 (0.0006) [2023-12-26 12:55:15,391][123090] Updated weights for policy 1, policy_version 1657624 (0.0006) [2023-12-26 12:55:15,644][123091] Updated weights for policy 0, policy_version 1668917 (0.0009) [2023-12-26 12:55:15,718][123091] Updated weights for policy 0, policy_version 1668927 (0.0009) [2023-12-26 12:55:15,771][123091] Updated weights for policy 0, policy_version 1668937 (0.0010) [2023-12-26 12:55:16,029][123090] Updated weights for policy 1, policy_version 1657634 (0.0006) [2023-12-26 12:55:16,104][123090] Updated weights for policy 1, policy_version 1657644 (0.0005) [2023-12-26 12:55:16,163][123090] Updated weights for policy 1, policy_version 1657654 (0.0005) [2023-12-26 12:55:16,217][123090] Updated weights for policy 1, policy_version 1657664 (0.0005) [2023-12-26 12:55:16,680][123091] Updated weights for policy 0, policy_version 1668948 (0.0009) [2023-12-26 12:55:16,745][123091] Updated weights for policy 0, policy_version 1668958 (0.0006) [2023-12-26 12:55:16,811][123091] Updated weights for policy 0, policy_version 1668968 (0.0005) [2023-12-26 12:55:16,949][123090] Updated weights for policy 1, policy_version 1657674 (0.0010) [2023-12-26 12:55:17,020][123090] Updated weights for policy 1, policy_version 1657684 (0.0010) [2023-12-26 12:55:17,086][123090] Updated weights for policy 1, policy_version 1657694 (0.0009) [2023-12-26 12:55:17,468][123091] Updated weights for policy 0, policy_version 1668978 (0.0005) [2023-12-26 12:55:17,528][123091] Updated weights for policy 0, policy_version 1668988 (0.0005) [2023-12-26 12:55:17,587][123091] Updated weights for policy 0, policy_version 1668998 (0.0005) [2023-12-26 12:55:17,645][123091] Updated weights for policy 0, policy_version 1669008 (0.0005) [2023-12-26 12:55:17,768][123090] Updated weights for policy 1, policy_version 1657704 (0.0010) [2023-12-26 12:55:17,819][123090] Updated weights for policy 1, policy_version 1657714 (0.0010) [2023-12-26 12:55:17,878][123090] Updated weights for policy 1, policy_version 1657724 (0.0010) [2023-12-26 12:55:18,344][123091] Updated weights for policy 0, policy_version 1669018 (0.0011) [2023-12-26 12:55:18,408][123091] Updated weights for policy 0, policy_version 1669028 (0.0011) [2023-12-26 12:55:18,471][123091] Updated weights for policy 0, policy_version 1669038 (0.0006) [2023-12-26 12:55:18,657][123090] Updated weights for policy 1, policy_version 1657734 (0.0009) [2023-12-26 12:55:18,710][123090] Updated weights for policy 1, policy_version 1657744 (0.0007) [2023-12-26 12:55:18,762][123090] Updated weights for policy 1, policy_version 1657754 (0.0010) [2023-12-26 12:55:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 851656704. Throughput: 0: 8997.1, 1: 8815.9. Samples: 851671728. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:18,785][121949] Avg episode reward: [(0, '5903.658'), (1, '5901.672')] [2023-12-26 12:55:19,156][123091] Updated weights for policy 0, policy_version 1669048 (0.0005) [2023-12-26 12:55:19,235][123091] Updated weights for policy 0, policy_version 1669058 (0.0006) [2023-12-26 12:55:19,302][123091] Updated weights for policy 0, policy_version 1669068 (0.0007) [2023-12-26 12:55:19,563][123090] Updated weights for policy 1, policy_version 1657764 (0.0011) [2023-12-26 12:55:19,629][123090] Updated weights for policy 1, policy_version 1657774 (0.0010) [2023-12-26 12:55:19,710][123090] Updated weights for policy 1, policy_version 1657784 (0.0005) [2023-12-26 12:55:19,987][123091] Updated weights for policy 0, policy_version 1669078 (0.0010) [2023-12-26 12:55:20,052][123091] Updated weights for policy 0, policy_version 1669088 (0.0011) [2023-12-26 12:55:20,126][123091] Updated weights for policy 0, policy_version 1669098 (0.0011) [2023-12-26 12:55:20,449][123090] Updated weights for policy 1, policy_version 1657794 (0.0005) [2023-12-26 12:55:20,511][123090] Updated weights for policy 1, policy_version 1657804 (0.0005) [2023-12-26 12:55:20,579][123090] Updated weights for policy 1, policy_version 1657814 (0.0009) [2023-12-26 12:55:20,642][123090] Updated weights for policy 1, policy_version 1657824 (0.0011) [2023-12-26 12:55:20,903][123091] Updated weights for policy 0, policy_version 1669108 (0.0009) [2023-12-26 12:55:20,958][123091] Updated weights for policy 0, policy_version 1669118 (0.0008) [2023-12-26 12:55:21,026][123091] Updated weights for policy 0, policy_version 1669128 (0.0008) [2023-12-26 12:55:21,394][123090] Updated weights for policy 1, policy_version 1657834 (0.0009) [2023-12-26 12:55:21,456][123090] Updated weights for policy 1, policy_version 1657844 (0.0006) [2023-12-26 12:55:21,534][123090] Updated weights for policy 1, policy_version 1657854 (0.0006) [2023-12-26 12:55:21,835][123091] Updated weights for policy 0, policy_version 1669138 (0.0010) [2023-12-26 12:55:21,896][123091] Updated weights for policy 0, policy_version 1669148 (0.0011) [2023-12-26 12:55:21,951][123091] Updated weights for policy 0, policy_version 1669158 (0.0011) [2023-12-26 12:55:22,011][123091] Updated weights for policy 0, policy_version 1669168 (0.0011) [2023-12-26 12:55:22,336][123090] Updated weights for policy 1, policy_version 1657864 (0.0008) [2023-12-26 12:55:22,411][123090] Updated weights for policy 1, policy_version 1657874 (0.0006) [2023-12-26 12:55:22,486][123090] Updated weights for policy 1, policy_version 1657884 (0.0006) [2023-12-26 12:55:22,864][123091] Updated weights for policy 0, policy_version 1669178 (0.0010) [2023-12-26 12:55:22,930][123091] Updated weights for policy 0, policy_version 1669188 (0.0009) [2023-12-26 12:55:22,984][123091] Updated weights for policy 0, policy_version 1669198 (0.0009) [2023-12-26 12:55:23,258][123090] Updated weights for policy 1, policy_version 1657894 (0.0009) [2023-12-26 12:55:23,308][123090] Updated weights for policy 1, policy_version 1657905 (0.0009) [2023-12-26 12:55:23,371][123090] Updated weights for policy 1, policy_version 1657915 (0.0010) [2023-12-26 12:55:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 851746816. Throughput: 0: 9020.3, 1: 8758.2. Samples: 851726592. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:23,785][121949] Avg episode reward: [(0, '5840.993'), (1, '5910.421')] [2023-12-26 12:55:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001669200_427319296.pth... [2023-12-26 12:55:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001657920_424427520.pth... [2023-12-26 12:55:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001668144_427048960.pth [2023-12-26 12:55:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001656896_424165376.pth [2023-12-26 12:55:23,923][123091] Updated weights for policy 0, policy_version 1669208 (0.0010) [2023-12-26 12:55:23,989][123091] Updated weights for policy 0, policy_version 1669218 (0.0010) [2023-12-26 12:55:24,047][123091] Updated weights for policy 0, policy_version 1669228 (0.0009) [2023-12-26 12:55:24,125][123090] Updated weights for policy 1, policy_version 1657925 (0.0009) [2023-12-26 12:55:24,174][123090] Updated weights for policy 1, policy_version 1657935 (0.0009) [2023-12-26 12:55:24,230][123090] Updated weights for policy 1, policy_version 1657945 (0.0009) [2023-12-26 12:55:24,796][123091] Updated weights for policy 0, policy_version 1669238 (0.0008) [2023-12-26 12:55:24,856][123091] Updated weights for policy 0, policy_version 1669248 (0.0008) [2023-12-26 12:55:24,929][123091] Updated weights for policy 0, policy_version 1669259 (0.0008) [2023-12-26 12:55:25,000][123090] Updated weights for policy 1, policy_version 1657955 (0.0008) [2023-12-26 12:55:25,050][123090] Updated weights for policy 1, policy_version 1657965 (0.0005) [2023-12-26 12:55:25,100][123090] Updated weights for policy 1, policy_version 1657975 (0.0005) [2023-12-26 12:55:25,560][123091] Updated weights for policy 0, policy_version 1669269 (0.0006) [2023-12-26 12:55:25,611][123091] Updated weights for policy 0, policy_version 1669279 (0.0007) [2023-12-26 12:55:25,668][123091] Updated weights for policy 0, policy_version 1669289 (0.0009) [2023-12-26 12:55:25,924][123090] Updated weights for policy 1, policy_version 1657985 (0.0006) [2023-12-26 12:55:25,990][123090] Updated weights for policy 1, policy_version 1657995 (0.0010) [2023-12-26 12:55:26,052][123090] Updated weights for policy 1, policy_version 1658005 (0.0010) [2023-12-26 12:55:26,119][123090] Updated weights for policy 1, policy_version 1658015 (0.0009) [2023-12-26 12:55:26,419][123091] Updated weights for policy 0, policy_version 1669299 (0.0008) [2023-12-26 12:55:26,472][123091] Updated weights for policy 0, policy_version 1669309 (0.0005) [2023-12-26 12:55:26,529][123091] Updated weights for policy 0, policy_version 1669319 (0.0006) [2023-12-26 12:55:27,031][123090] Updated weights for policy 1, policy_version 1658025 (0.0009) [2023-12-26 12:55:27,099][123090] Updated weights for policy 1, policy_version 1658035 (0.0010) [2023-12-26 12:55:27,168][123090] Updated weights for policy 1, policy_version 1658045 (0.0010) [2023-12-26 12:55:27,192][123091] Updated weights for policy 0, policy_version 1669329 (0.0005) [2023-12-26 12:55:27,246][123091] Updated weights for policy 0, policy_version 1669339 (0.0005) [2023-12-26 12:55:27,316][123091] Updated weights for policy 0, policy_version 1669349 (0.0008) [2023-12-26 12:55:27,374][123091] Updated weights for policy 0, policy_version 1669359 (0.0006) [2023-12-26 12:55:27,922][123091] Updated weights for policy 0, policy_version 1669369 (0.0006) [2023-12-26 12:55:27,975][123091] Updated weights for policy 0, policy_version 1669379 (0.0005) [2023-12-26 12:55:28,028][123091] Updated weights for policy 0, policy_version 1669389 (0.0005) [2023-12-26 12:55:28,048][123090] Updated weights for policy 1, policy_version 1658055 (0.0009) [2023-12-26 12:55:28,115][123090] Updated weights for policy 1, policy_version 1658065 (0.0009) [2023-12-26 12:55:28,178][123090] Updated weights for policy 1, policy_version 1658075 (0.0010) [2023-12-26 12:55:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 851836928. Throughput: 0: 9105.4, 1: 8795.2. Samples: 851834356. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:28,784][121949] Avg episode reward: [(0, '5870.297'), (1, '5967.717')] [2023-12-26 12:55:28,801][123091] Updated weights for policy 0, policy_version 1669399 (0.0007) [2023-12-26 12:55:28,860][123091] Updated weights for policy 0, policy_version 1669409 (0.0011) [2023-12-26 12:55:28,919][123091] Updated weights for policy 0, policy_version 1669419 (0.0011) [2023-12-26 12:55:28,950][123090] Updated weights for policy 1, policy_version 1658085 (0.0010) [2023-12-26 12:55:29,014][123090] Updated weights for policy 1, policy_version 1658095 (0.0009) [2023-12-26 12:55:29,079][123090] Updated weights for policy 1, policy_version 1658105 (0.0005) [2023-12-26 12:55:29,607][123091] Updated weights for policy 0, policy_version 1669429 (0.0006) [2023-12-26 12:55:29,682][123091] Updated weights for policy 0, policy_version 1669439 (0.0008) [2023-12-26 12:55:29,741][123091] Updated weights for policy 0, policy_version 1669449 (0.0006) [2023-12-26 12:55:29,803][123090] Updated weights for policy 1, policy_version 1658115 (0.0005) [2023-12-26 12:55:29,886][123090] Updated weights for policy 1, policy_version 1658125 (0.0007) [2023-12-26 12:55:29,953][123090] Updated weights for policy 1, policy_version 1658135 (0.0012) [2023-12-26 12:55:30,575][123091] Updated weights for policy 0, policy_version 1669459 (0.0007) [2023-12-26 12:55:30,644][123091] Updated weights for policy 0, policy_version 1669469 (0.0011) [2023-12-26 12:55:30,694][123090] Updated weights for policy 1, policy_version 1658145 (0.0007) [2023-12-26 12:55:30,700][123091] Updated weights for policy 0, policy_version 1669479 (0.0011) [2023-12-26 12:55:30,755][123090] Updated weights for policy 1, policy_version 1658155 (0.0006) [2023-12-26 12:55:30,818][123090] Updated weights for policy 1, policy_version 1658165 (0.0008) [2023-12-26 12:55:30,882][123090] Updated weights for policy 1, policy_version 1658175 (0.0009) [2023-12-26 12:55:31,530][123091] Updated weights for policy 0, policy_version 1669489 (0.0011) [2023-12-26 12:55:31,578][123091] Updated weights for policy 0, policy_version 1669499 (0.0010) [2023-12-26 12:55:31,641][123091] Updated weights for policy 0, policy_version 1669509 (0.0014) [2023-12-26 12:55:31,708][123091] Updated weights for policy 0, policy_version 1669519 (0.0011) [2023-12-26 12:55:31,728][123090] Updated weights for policy 1, policy_version 1658185 (0.0007) [2023-12-26 12:55:31,800][123090] Updated weights for policy 1, policy_version 1658195 (0.0008) [2023-12-26 12:55:31,859][123090] Updated weights for policy 1, policy_version 1658205 (0.0008) [2023-12-26 12:55:32,563][123091] Updated weights for policy 0, policy_version 1669529 (0.0011) [2023-12-26 12:55:32,631][123091] Updated weights for policy 0, policy_version 1669539 (0.0008) [2023-12-26 12:55:32,661][123090] Updated weights for policy 1, policy_version 1658215 (0.0006) [2023-12-26 12:55:32,691][123091] Updated weights for policy 0, policy_version 1669549 (0.0008) [2023-12-26 12:55:32,735][123090] Updated weights for policy 1, policy_version 1658225 (0.0006) [2023-12-26 12:55:32,805][123090] Updated weights for policy 1, policy_version 1658235 (0.0006) [2023-12-26 12:55:33,390][123091] Updated weights for policy 0, policy_version 1669559 (0.0006) [2023-12-26 12:55:33,435][123091] Updated weights for policy 0, policy_version 1669569 (0.0010) [2023-12-26 12:55:33,482][123091] Updated weights for policy 0, policy_version 1669579 (0.0010) [2023-12-26 12:55:33,524][123090] Updated weights for policy 1, policy_version 1658245 (0.0006) [2023-12-26 12:55:33,576][123090] Updated weights for policy 1, policy_version 1658255 (0.0005) [2023-12-26 12:55:33,637][123090] Updated weights for policy 1, policy_version 1658265 (0.0006) [2023-12-26 12:55:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 851935232. Throughput: 0: 9161.8, 1: 8723.6. Samples: 851942512. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:33,785][121949] Avg episode reward: [(0, '6059.343'), (1, '5884.133')] [2023-12-26 12:55:34,302][123091] Updated weights for policy 0, policy_version 1669589 (0.0010) [2023-12-26 12:55:34,330][123090] Updated weights for policy 1, policy_version 1658275 (0.0007) [2023-12-26 12:55:34,353][123091] Updated weights for policy 0, policy_version 1669599 (0.0010) [2023-12-26 12:55:34,390][123090] Updated weights for policy 1, policy_version 1658285 (0.0006) [2023-12-26 12:55:34,405][123091] Updated weights for policy 0, policy_version 1669609 (0.0010) [2023-12-26 12:55:34,459][123090] Updated weights for policy 1, policy_version 1658295 (0.0008) [2023-12-26 12:55:35,208][123090] Updated weights for policy 1, policy_version 1658305 (0.0007) [2023-12-26 12:55:35,254][123091] Updated weights for policy 0, policy_version 1669619 (0.0011) [2023-12-26 12:55:35,268][123090] Updated weights for policy 1, policy_version 1658315 (0.0006) [2023-12-26 12:55:35,301][123091] Updated weights for policy 0, policy_version 1669629 (0.0010) [2023-12-26 12:55:35,323][123090] Updated weights for policy 1, policy_version 1658325 (0.0005) [2023-12-26 12:55:35,359][123091] Updated weights for policy 0, policy_version 1669639 (0.0010) [2023-12-26 12:55:35,377][123090] Updated weights for policy 1, policy_version 1658335 (0.0006) [2023-12-26 12:55:36,094][123091] Updated weights for policy 0, policy_version 1669649 (0.0010) [2023-12-26 12:55:36,143][123090] Updated weights for policy 1, policy_version 1658345 (0.0007) [2023-12-26 12:55:36,155][123091] Updated weights for policy 0, policy_version 1669659 (0.0008) [2023-12-26 12:55:36,208][123090] Updated weights for policy 1, policy_version 1658355 (0.0006) [2023-12-26 12:55:36,221][123091] Updated weights for policy 0, policy_version 1669669 (0.0008) [2023-12-26 12:55:36,274][123090] Updated weights for policy 1, policy_version 1658365 (0.0008) [2023-12-26 12:55:36,285][123091] Updated weights for policy 0, policy_version 1669679 (0.0006) [2023-12-26 12:55:36,958][123091] Updated weights for policy 0, policy_version 1669689 (0.0005) [2023-12-26 12:55:37,024][123091] Updated weights for policy 0, policy_version 1669699 (0.0006) [2023-12-26 12:55:37,085][123091] Updated weights for policy 0, policy_version 1669709 (0.0006) [2023-12-26 12:55:37,145][123090] Updated weights for policy 1, policy_version 1658375 (0.0006) [2023-12-26 12:55:37,200][123090] Updated weights for policy 1, policy_version 1658385 (0.0005) [2023-12-26 12:55:37,254][123090] Updated weights for policy 1, policy_version 1658395 (0.0008) [2023-12-26 12:55:37,706][123091] Updated weights for policy 0, policy_version 1669719 (0.0005) [2023-12-26 12:55:37,761][123091] Updated weights for policy 0, policy_version 1669729 (0.0011) [2023-12-26 12:55:37,813][123091] Updated weights for policy 0, policy_version 1669739 (0.0011) [2023-12-26 12:55:38,118][123090] Updated weights for policy 1, policy_version 1658405 (0.0009) [2023-12-26 12:55:38,171][123090] Updated weights for policy 1, policy_version 1658415 (0.0005) [2023-12-26 12:55:38,219][123090] Updated weights for policy 1, policy_version 1658425 (0.0005) [2023-12-26 12:55:38,659][123091] Updated weights for policy 0, policy_version 1669749 (0.0010) [2023-12-26 12:55:38,724][123091] Updated weights for policy 0, policy_version 1669759 (0.0009) [2023-12-26 12:55:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 852017152. Throughput: 0: 9150.6, 1: 8791.2. Samples: 851997352. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:38,785][121949] Avg episode reward: [(0, '6001.394'), (1, '5741.862')] [2023-12-26 12:55:38,786][123091] Updated weights for policy 0, policy_version 1669769 (0.0009) [2023-12-26 12:55:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001658432_424558592.pth... [2023-12-26 12:55:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001657408_424296448.pth [2023-12-26 12:55:38,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001669776_427466752.pth... [2023-12-26 12:55:38,835][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001668688_427188224.pth [2023-12-26 12:55:39,023][123090] Updated weights for policy 1, policy_version 1658435 (0.0008) [2023-12-26 12:55:39,085][123090] Updated weights for policy 1, policy_version 1658445 (0.0010) [2023-12-26 12:55:39,150][123090] Updated weights for policy 1, policy_version 1658455 (0.0010) [2023-12-26 12:55:39,635][123091] Updated weights for policy 0, policy_version 1669779 (0.0009) [2023-12-26 12:55:39,695][123091] Updated weights for policy 0, policy_version 1669789 (0.0009) [2023-12-26 12:55:39,744][123091] Updated weights for policy 0, policy_version 1669799 (0.0009) [2023-12-26 12:55:39,974][123090] Updated weights for policy 1, policy_version 1658465 (0.0010) [2023-12-26 12:55:40,034][123090] Updated weights for policy 1, policy_version 1658475 (0.0011) [2023-12-26 12:55:40,094][123090] Updated weights for policy 1, policy_version 1658485 (0.0011) [2023-12-26 12:55:40,151][123090] Updated weights for policy 1, policy_version 1658495 (0.0010) [2023-12-26 12:55:40,575][123091] Updated weights for policy 0, policy_version 1669809 (0.0008) [2023-12-26 12:55:40,622][123091] Updated weights for policy 0, policy_version 1669819 (0.0005) [2023-12-26 12:55:40,672][123091] Updated weights for policy 0, policy_version 1669829 (0.0008) [2023-12-26 12:55:40,729][123091] Updated weights for policy 0, policy_version 1669839 (0.0009) [2023-12-26 12:55:41,030][123090] Updated weights for policy 1, policy_version 1658505 (0.0008) [2023-12-26 12:55:41,104][123090] Updated weights for policy 1, policy_version 1658515 (0.0008) [2023-12-26 12:55:41,187][123090] Updated weights for policy 1, policy_version 1658525 (0.0008) [2023-12-26 12:55:41,564][123091] Updated weights for policy 0, policy_version 1669849 (0.0010) [2023-12-26 12:55:41,636][123091] Updated weights for policy 0, policy_version 1669859 (0.0010) [2023-12-26 12:55:41,698][123091] Updated weights for policy 0, policy_version 1669869 (0.0009) [2023-12-26 12:55:41,978][123090] Updated weights for policy 1, policy_version 1658535 (0.0009) [2023-12-26 12:55:42,045][123090] Updated weights for policy 1, policy_version 1658545 (0.0011) [2023-12-26 12:55:42,117][123090] Updated weights for policy 1, policy_version 1658555 (0.0011) [2023-12-26 12:55:42,558][123091] Updated weights for policy 0, policy_version 1669879 (0.0010) [2023-12-26 12:55:42,623][123091] Updated weights for policy 0, policy_version 1669889 (0.0009) [2023-12-26 12:55:42,686][123091] Updated weights for policy 0, policy_version 1669899 (0.0009) [2023-12-26 12:55:42,933][123090] Updated weights for policy 1, policy_version 1658565 (0.0008) [2023-12-26 12:55:43,004][123090] Updated weights for policy 1, policy_version 1658575 (0.0005) [2023-12-26 12:55:43,064][123090] Updated weights for policy 1, policy_version 1658585 (0.0005) [2023-12-26 12:55:43,452][123091] Updated weights for policy 0, policy_version 1669909 (0.0008) [2023-12-26 12:55:43,504][123091] Updated weights for policy 0, policy_version 1669919 (0.0009) [2023-12-26 12:55:43,572][123091] Updated weights for policy 0, policy_version 1669929 (0.0009) [2023-12-26 12:55:43,698][123090] Updated weights for policy 1, policy_version 1658595 (0.0007) [2023-12-26 12:55:43,754][123090] Updated weights for policy 1, policy_version 1658605 (0.0010) [2023-12-26 12:55:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 852107264. Throughput: 0: 9092.6, 1: 8725.6. Samples: 852101468. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:43,785][121949] Avg episode reward: [(0, '5824.382'), (1, '5743.007')] [2023-12-26 12:55:43,804][123090] Updated weights for policy 1, policy_version 1658615 (0.0010) [2023-12-26 12:55:44,386][123091] Updated weights for policy 0, policy_version 1669939 (0.0010) [2023-12-26 12:55:44,448][123091] Updated weights for policy 0, policy_version 1669949 (0.0011) [2023-12-26 12:55:44,492][123090] Updated weights for policy 1, policy_version 1658625 (0.0010) [2023-12-26 12:55:44,501][123091] Updated weights for policy 0, policy_version 1669959 (0.0011) [2023-12-26 12:55:44,551][123090] Updated weights for policy 1, policy_version 1658635 (0.0005) [2023-12-26 12:55:44,622][123090] Updated weights for policy 1, policy_version 1658645 (0.0005) [2023-12-26 12:55:44,689][123090] Updated weights for policy 1, policy_version 1658655 (0.0005) [2023-12-26 12:55:45,327][123091] Updated weights for policy 0, policy_version 1669969 (0.0010) [2023-12-26 12:55:45,388][123090] Updated weights for policy 1, policy_version 1658665 (0.0009) [2023-12-26 12:55:45,399][123091] Updated weights for policy 0, policy_version 1669979 (0.0008) [2023-12-26 12:55:45,452][123090] Updated weights for policy 1, policy_version 1658675 (0.0011) [2023-12-26 12:55:45,459][123091] Updated weights for policy 0, policy_version 1669989 (0.0006) [2023-12-26 12:55:45,515][123090] Updated weights for policy 1, policy_version 1658685 (0.0011) [2023-12-26 12:55:45,522][123091] Updated weights for policy 0, policy_version 1669999 (0.0006) [2023-12-26 12:55:46,205][123090] Updated weights for policy 1, policy_version 1658695 (0.0007) [2023-12-26 12:55:46,243][123091] Updated weights for policy 0, policy_version 1670009 (0.0008) [2023-12-26 12:55:46,267][123090] Updated weights for policy 1, policy_version 1658705 (0.0006) [2023-12-26 12:55:46,299][123091] Updated weights for policy 0, policy_version 1670019 (0.0006) [2023-12-26 12:55:46,330][123090] Updated weights for policy 1, policy_version 1658715 (0.0010) [2023-12-26 12:55:46,359][123091] Updated weights for policy 0, policy_version 1670029 (0.0006) [2023-12-26 12:55:46,948][123090] Updated weights for policy 1, policy_version 1658725 (0.0006) [2023-12-26 12:55:47,002][123090] Updated weights for policy 1, policy_version 1658735 (0.0005) [2023-12-26 12:55:47,062][123090] Updated weights for policy 1, policy_version 1658745 (0.0005) [2023-12-26 12:55:47,239][123091] Updated weights for policy 0, policy_version 1670039 (0.0009) [2023-12-26 12:55:47,310][123091] Updated weights for policy 0, policy_version 1670050 (0.0010) [2023-12-26 12:55:47,369][123091] Updated weights for policy 0, policy_version 1670060 (0.0010) [2023-12-26 12:55:47,721][123090] Updated weights for policy 1, policy_version 1658755 (0.0005) [2023-12-26 12:55:47,784][123090] Updated weights for policy 1, policy_version 1658765 (0.0005) [2023-12-26 12:55:47,841][123090] Updated weights for policy 1, policy_version 1658775 (0.0005) [2023-12-26 12:55:48,306][123091] Updated weights for policy 0, policy_version 1670070 (0.0010) [2023-12-26 12:55:48,385][123091] Updated weights for policy 0, policy_version 1670080 (0.0009) [2023-12-26 12:55:48,448][123091] Updated weights for policy 0, policy_version 1670090 (0.0009) [2023-12-26 12:55:48,511][123090] Updated weights for policy 1, policy_version 1658785 (0.0006) [2023-12-26 12:55:48,571][123090] Updated weights for policy 1, policy_version 1658795 (0.0010) [2023-12-26 12:55:48,628][123090] Updated weights for policy 1, policy_version 1658805 (0.0011) [2023-12-26 12:55:48,680][123090] Updated weights for policy 1, policy_version 1658815 (0.0011) [2023-12-26 12:55:48,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 852205568. Throughput: 0: 8997.3, 1: 8908.6. Samples: 852212744. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:48,785][121949] Avg episode reward: [(0, '5644.375'), (1, '5878.453')] [2023-12-26 12:55:49,265][123091] Updated weights for policy 0, policy_version 1670100 (0.0009) [2023-12-26 12:55:49,330][123091] Updated weights for policy 0, policy_version 1670110 (0.0009) [2023-12-26 12:55:49,398][123091] Updated weights for policy 0, policy_version 1670120 (0.0009) [2023-12-26 12:55:49,525][123090] Updated weights for policy 1, policy_version 1658825 (0.0006) [2023-12-26 12:55:49,595][123090] Updated weights for policy 1, policy_version 1658835 (0.0005) [2023-12-26 12:55:49,663][123090] Updated weights for policy 1, policy_version 1658845 (0.0006) [2023-12-26 12:55:50,263][123091] Updated weights for policy 0, policy_version 1670130 (0.0009) [2023-12-26 12:55:50,320][123091] Updated weights for policy 0, policy_version 1670140 (0.0010) [2023-12-26 12:55:50,364][123090] Updated weights for policy 1, policy_version 1658855 (0.0007) [2023-12-26 12:55:50,376][123091] Updated weights for policy 0, policy_version 1670150 (0.0008) [2023-12-26 12:55:50,431][123090] Updated weights for policy 1, policy_version 1658865 (0.0005) [2023-12-26 12:55:50,440][123091] Updated weights for policy 0, policy_version 1670160 (0.0010) [2023-12-26 12:55:50,495][123090] Updated weights for policy 1, policy_version 1658875 (0.0006) [2023-12-26 12:55:51,188][123090] Updated weights for policy 1, policy_version 1658885 (0.0005) [2023-12-26 12:55:51,244][123090] Updated weights for policy 1, policy_version 1658895 (0.0005) [2023-12-26 12:55:51,312][123090] Updated weights for policy 1, policy_version 1658905 (0.0009) [2023-12-26 12:55:51,357][123091] Updated weights for policy 0, policy_version 1670170 (0.0008) [2023-12-26 12:55:51,430][123091] Updated weights for policy 0, policy_version 1670180 (0.0010) [2023-12-26 12:55:51,495][123091] Updated weights for policy 0, policy_version 1670190 (0.0009) [2023-12-26 12:55:52,031][123090] Updated weights for policy 1, policy_version 1658915 (0.0010) [2023-12-26 12:55:52,077][123090] Updated weights for policy 1, policy_version 1658925 (0.0005) [2023-12-26 12:55:52,132][123090] Updated weights for policy 1, policy_version 1658935 (0.0005) [2023-12-26 12:55:52,406][123091] Updated weights for policy 0, policy_version 1670200 (0.0009) [2023-12-26 12:55:52,458][123091] Updated weights for policy 0, policy_version 1670210 (0.0008) [2023-12-26 12:55:52,507][123091] Updated weights for policy 0, policy_version 1670220 (0.0009) [2023-12-26 12:55:52,842][123090] Updated weights for policy 1, policy_version 1658945 (0.0006) [2023-12-26 12:55:52,908][123090] Updated weights for policy 1, policy_version 1658955 (0.0010) [2023-12-26 12:55:52,974][123090] Updated weights for policy 1, policy_version 1658965 (0.0010) [2023-12-26 12:55:53,033][123090] Updated weights for policy 1, policy_version 1658975 (0.0010) [2023-12-26 12:55:53,360][123091] Updated weights for policy 0, policy_version 1670230 (0.0008) [2023-12-26 12:55:53,413][123091] Updated weights for policy 0, policy_version 1670240 (0.0009) [2023-12-26 12:55:53,465][123091] Updated weights for policy 0, policy_version 1670250 (0.0009) [2023-12-26 12:55:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 852287488. Throughput: 0: 8915.2, 1: 8970.5. Samples: 852265508. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:53,785][121949] Avg episode reward: [(0, '5821.354'), (1, '5961.005')] [2023-12-26 12:55:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001670256_427589632.pth... [2023-12-26 12:55:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001669200_427319296.pth [2023-12-26 12:55:53,847][123090] Updated weights for policy 1, policy_version 1658985 (0.0011) [2023-12-26 12:55:53,910][123090] Updated weights for policy 1, policy_version 1658995 (0.0010) [2023-12-26 12:55:53,976][123090] Updated weights for policy 1, policy_version 1659005 (0.0010) [2023-12-26 12:55:53,994][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001659008_424706048.pth... [2023-12-26 12:55:53,999][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001657920_424427520.pth [2023-12-26 12:55:54,314][123091] Updated weights for policy 0, policy_version 1670260 (0.0009) [2023-12-26 12:55:54,381][123091] Updated weights for policy 0, policy_version 1670270 (0.0009) [2023-12-26 12:55:54,429][123091] Updated weights for policy 0, policy_version 1670280 (0.0008) [2023-12-26 12:55:54,802][123090] Updated weights for policy 1, policy_version 1659015 (0.0010) [2023-12-26 12:55:54,854][123090] Updated weights for policy 1, policy_version 1659025 (0.0010) [2023-12-26 12:55:54,901][123090] Updated weights for policy 1, policy_version 1659035 (0.0010) [2023-12-26 12:55:55,260][123091] Updated weights for policy 0, policy_version 1670290 (0.0009) [2023-12-26 12:55:55,319][123091] Updated weights for policy 0, policy_version 1670300 (0.0009) [2023-12-26 12:55:55,378][123091] Updated weights for policy 0, policy_version 1670310 (0.0009) [2023-12-26 12:55:55,441][123091] Updated weights for policy 0, policy_version 1670320 (0.0009) [2023-12-26 12:55:55,752][123090] Updated weights for policy 1, policy_version 1659045 (0.0010) [2023-12-26 12:55:55,807][123090] Updated weights for policy 1, policy_version 1659055 (0.0010) [2023-12-26 12:55:55,858][123090] Updated weights for policy 1, policy_version 1659065 (0.0010) [2023-12-26 12:55:56,238][123091] Updated weights for policy 0, policy_version 1670330 (0.0007) [2023-12-26 12:55:56,296][123091] Updated weights for policy 0, policy_version 1670340 (0.0010) [2023-12-26 12:55:56,350][123091] Updated weights for policy 0, policy_version 1670350 (0.0009) [2023-12-26 12:55:56,581][123090] Updated weights for policy 1, policy_version 1659075 (0.0009) [2023-12-26 12:55:56,636][123090] Updated weights for policy 1, policy_version 1659085 (0.0005) [2023-12-26 12:55:56,684][123090] Updated weights for policy 1, policy_version 1659095 (0.0005) [2023-12-26 12:55:57,120][123091] Updated weights for policy 0, policy_version 1670360 (0.0009) [2023-12-26 12:55:57,181][123091] Updated weights for policy 0, policy_version 1670370 (0.0010) [2023-12-26 12:55:57,232][123091] Updated weights for policy 0, policy_version 1670380 (0.0010) [2023-12-26 12:55:57,402][123090] Updated weights for policy 1, policy_version 1659105 (0.0006) [2023-12-26 12:55:57,460][123090] Updated weights for policy 1, policy_version 1659115 (0.0010) [2023-12-26 12:55:57,523][123090] Updated weights for policy 1, policy_version 1659125 (0.0010) [2023-12-26 12:55:57,572][123090] Updated weights for policy 1, policy_version 1659135 (0.0009) [2023-12-26 12:55:58,051][123091] Updated weights for policy 0, policy_version 1670390 (0.0010) [2023-12-26 12:55:58,121][123091] Updated weights for policy 0, policy_version 1670400 (0.0010) [2023-12-26 12:55:58,186][123091] Updated weights for policy 0, policy_version 1670410 (0.0010) [2023-12-26 12:55:58,333][123090] Updated weights for policy 1, policy_version 1659145 (0.0009) [2023-12-26 12:55:58,392][123090] Updated weights for policy 1, policy_version 1659155 (0.0009) [2023-12-26 12:55:58,449][123090] Updated weights for policy 1, policy_version 1659165 (0.0009) [2023-12-26 12:55:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 852377600. Throughput: 0: 8888.4, 1: 9087.4. Samples: 852370672. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:55:58,785][121949] Avg episode reward: [(0, '6006.540'), (1, '6009.167')] [2023-12-26 12:55:59,033][123091] Updated weights for policy 0, policy_version 1670420 (0.0008) [2023-12-26 12:55:59,089][123091] Updated weights for policy 0, policy_version 1670430 (0.0005) [2023-12-26 12:55:59,143][123091] Updated weights for policy 0, policy_version 1670440 (0.0005) [2023-12-26 12:55:59,286][123090] Updated weights for policy 1, policy_version 1659175 (0.0010) [2023-12-26 12:55:59,356][123090] Updated weights for policy 1, policy_version 1659185 (0.0010) [2023-12-26 12:55:59,423][123090] Updated weights for policy 1, policy_version 1659195 (0.0009) [2023-12-26 12:55:59,828][123091] Updated weights for policy 0, policy_version 1670450 (0.0006) [2023-12-26 12:55:59,895][123091] Updated weights for policy 0, policy_version 1670460 (0.0011) [2023-12-26 12:55:59,964][123091] Updated weights for policy 0, policy_version 1670470 (0.0009) [2023-12-26 12:56:00,030][123091] Updated weights for policy 0, policy_version 1670480 (0.0009) [2023-12-26 12:56:00,212][123090] Updated weights for policy 1, policy_version 1659205 (0.0005) [2023-12-26 12:56:00,267][123090] Updated weights for policy 1, policy_version 1659215 (0.0005) [2023-12-26 12:56:00,323][123090] Updated weights for policy 1, policy_version 1659225 (0.0008) [2023-12-26 12:56:00,855][123091] Updated weights for policy 0, policy_version 1670490 (0.0010) [2023-12-26 12:56:00,908][123091] Updated weights for policy 0, policy_version 1670500 (0.0010) [2023-12-26 12:56:00,963][123090] Updated weights for policy 1, policy_version 1659235 (0.0008) [2023-12-26 12:56:00,966][123091] Updated weights for policy 0, policy_version 1670510 (0.0009) [2023-12-26 12:56:01,031][123090] Updated weights for policy 1, policy_version 1659245 (0.0007) [2023-12-26 12:56:01,096][123090] Updated weights for policy 1, policy_version 1659255 (0.0006) [2023-12-26 12:56:01,817][123090] Updated weights for policy 1, policy_version 1659265 (0.0008) [2023-12-26 12:56:01,888][123091] Updated weights for policy 0, policy_version 1670520 (0.0009) [2023-12-26 12:56:01,894][123090] Updated weights for policy 1, policy_version 1659275 (0.0005) [2023-12-26 12:56:01,957][123091] Updated weights for policy 0, policy_version 1670530 (0.0008) [2023-12-26 12:56:01,965][123090] Updated weights for policy 1, policy_version 1659285 (0.0006) [2023-12-26 12:56:02,023][123090] Updated weights for policy 1, policy_version 1659295 (0.0009) [2023-12-26 12:56:02,029][123091] Updated weights for policy 0, policy_version 1670540 (0.0008) [2023-12-26 12:56:02,836][123090] Updated weights for policy 1, policy_version 1659305 (0.0010) [2023-12-26 12:56:02,860][123091] Updated weights for policy 0, policy_version 1670550 (0.0009) [2023-12-26 12:56:02,889][123090] Updated weights for policy 1, policy_version 1659315 (0.0010) [2023-12-26 12:56:02,922][123091] Updated weights for policy 0, policy_version 1670560 (0.0007) [2023-12-26 12:56:02,958][123090] Updated weights for policy 1, policy_version 1659325 (0.0011) [2023-12-26 12:56:02,982][123091] Updated weights for policy 0, policy_version 1670570 (0.0006) [2023-12-26 12:56:03,606][123090] Updated weights for policy 1, policy_version 1659335 (0.0007) [2023-12-26 12:56:03,663][123090] Updated weights for policy 1, policy_version 1659345 (0.0009) [2023-12-26 12:56:03,710][123090] Updated weights for policy 1, policy_version 1659355 (0.0010) [2023-12-26 12:56:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 852467712. Throughput: 0: 8799.8, 1: 9113.4. Samples: 852477824. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:56:03,784][121949] Avg episode reward: [(0, '6038.764'), (1, '5708.387')] [2023-12-26 12:56:03,878][123091] Updated weights for policy 0, policy_version 1670580 (0.0010) [2023-12-26 12:56:03,931][123091] Updated weights for policy 0, policy_version 1670590 (0.0009) [2023-12-26 12:56:03,988][123091] Updated weights for policy 0, policy_version 1670600 (0.0009) [2023-12-26 12:56:04,522][123090] Updated weights for policy 1, policy_version 1659365 (0.0010) [2023-12-26 12:56:04,585][123090] Updated weights for policy 1, policy_version 1659375 (0.0010) [2023-12-26 12:56:04,651][123090] Updated weights for policy 1, policy_version 1659385 (0.0010) [2023-12-26 12:56:04,859][123091] Updated weights for policy 0, policy_version 1670610 (0.0009) [2023-12-26 12:56:04,917][123091] Updated weights for policy 0, policy_version 1670620 (0.0005) [2023-12-26 12:56:04,985][123091] Updated weights for policy 0, policy_version 1670630 (0.0005) [2023-12-26 12:56:05,049][123091] Updated weights for policy 0, policy_version 1670640 (0.0006) [2023-12-26 12:56:05,472][123090] Updated weights for policy 1, policy_version 1659395 (0.0010) [2023-12-26 12:56:05,542][123090] Updated weights for policy 1, policy_version 1659405 (0.0010) [2023-12-26 12:56:05,608][123090] Updated weights for policy 1, policy_version 1659415 (0.0010) [2023-12-26 12:56:05,816][123091] Updated weights for policy 0, policy_version 1670650 (0.0009) [2023-12-26 12:56:05,864][123091] Updated weights for policy 0, policy_version 1670660 (0.0009) [2023-12-26 12:56:05,927][123091] Updated weights for policy 0, policy_version 1670670 (0.0008) [2023-12-26 12:56:06,416][123090] Updated weights for policy 1, policy_version 1659425 (0.0010) [2023-12-26 12:56:06,488][123090] Updated weights for policy 1, policy_version 1659435 (0.0011) [2023-12-26 12:56:06,556][123090] Updated weights for policy 1, policy_version 1659445 (0.0011) [2023-12-26 12:56:06,628][123090] Updated weights for policy 1, policy_version 1659455 (0.0011) [2023-12-26 12:56:06,806][123091] Updated weights for policy 0, policy_version 1670680 (0.0010) [2023-12-26 12:56:06,865][123091] Updated weights for policy 0, policy_version 1670690 (0.0010) [2023-12-26 12:56:06,924][123091] Updated weights for policy 0, policy_version 1670700 (0.0010) [2023-12-26 12:56:07,365][123090] Updated weights for policy 1, policy_version 1659465 (0.0007) [2023-12-26 12:56:07,415][123090] Updated weights for policy 1, policy_version 1659475 (0.0005) [2023-12-26 12:56:07,488][123090] Updated weights for policy 1, policy_version 1659485 (0.0005) [2023-12-26 12:56:07,846][123091] Updated weights for policy 0, policy_version 1670710 (0.0010) [2023-12-26 12:56:07,900][123091] Updated weights for policy 0, policy_version 1670720 (0.0010) [2023-12-26 12:56:07,963][123091] Updated weights for policy 0, policy_version 1670730 (0.0010) [2023-12-26 12:56:08,150][123090] Updated weights for policy 1, policy_version 1659495 (0.0005) [2023-12-26 12:56:08,204][123090] Updated weights for policy 1, policy_version 1659505 (0.0005) [2023-12-26 12:56:08,266][123090] Updated weights for policy 1, policy_version 1659515 (0.0005) [2023-12-26 12:56:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 852549632. Throughput: 0: 8751.3, 1: 9087.0. Samples: 852529316. Policy #0 lag: (min: 31.0, avg: 41.2, max: 63.0) [2023-12-26 12:56:08,785][121949] Avg episode reward: [(0, '5948.805'), (1, '5708.142')] [2023-12-26 12:56:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001670736_427712512.pth... [2023-12-26 12:56:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001659520_424837120.pth... [2023-12-26 12:56:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001658432_424558592.pth [2023-12-26 12:56:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001669776_427466752.pth [2023-12-26 12:56:08,870][123091] Updated weights for policy 0, policy_version 1670740 (0.0009) [2023-12-26 12:56:08,925][123090] Updated weights for policy 1, policy_version 1659525 (0.0008) [2023-12-26 12:56:08,936][123091] Updated weights for policy 0, policy_version 1670750 (0.0007) [2023-12-26 12:56:09,002][123091] Updated weights for policy 0, policy_version 1670760 (0.0009) [2023-12-26 12:56:09,003][123090] Updated weights for policy 1, policy_version 1659535 (0.0010) [2023-12-26 12:56:09,065][123090] Updated weights for policy 1, policy_version 1659545 (0.0006) [2023-12-26 12:56:09,862][123090] Updated weights for policy 1, policy_version 1659555 (0.0006) [2023-12-26 12:56:09,867][123091] Updated weights for policy 0, policy_version 1670770 (0.0009) [2023-12-26 12:56:09,925][123091] Updated weights for policy 0, policy_version 1670780 (0.0009) [2023-12-26 12:56:09,927][123090] Updated weights for policy 1, policy_version 1659565 (0.0008) [2023-12-26 12:56:09,988][123091] Updated weights for policy 0, policy_version 1670790 (0.0006) [2023-12-26 12:56:09,989][123090] Updated weights for policy 1, policy_version 1659575 (0.0009) [2023-12-26 12:56:10,051][123091] Updated weights for policy 0, policy_version 1670800 (0.0006) [2023-12-26 12:56:10,739][123091] Updated weights for policy 0, policy_version 1670810 (0.0008) [2023-12-26 12:56:10,802][123091] Updated weights for policy 0, policy_version 1670820 (0.0011) [2023-12-26 12:56:10,864][123091] Updated weights for policy 0, policy_version 1670830 (0.0011) [2023-12-26 12:56:10,884][123090] Updated weights for policy 1, policy_version 1659585 (0.0008) [2023-12-26 12:56:10,940][123090] Updated weights for policy 1, policy_version 1659595 (0.0006) [2023-12-26 12:56:11,000][123090] Updated weights for policy 1, policy_version 1659605 (0.0008) [2023-12-26 12:56:11,068][123090] Updated weights for policy 1, policy_version 1659615 (0.0009) [2023-12-26 12:56:11,680][123091] Updated weights for policy 0, policy_version 1670840 (0.0010) [2023-12-26 12:56:11,753][123091] Updated weights for policy 0, policy_version 1670850 (0.0010) [2023-12-26 12:56:11,813][123091] Updated weights for policy 0, policy_version 1670860 (0.0009) [2023-12-26 12:56:11,878][123090] Updated weights for policy 1, policy_version 1659625 (0.0009) [2023-12-26 12:56:11,942][123090] Updated weights for policy 1, policy_version 1659635 (0.0009) [2023-12-26 12:56:12,001][123090] Updated weights for policy 1, policy_version 1659645 (0.0010) [2023-12-26 12:56:12,648][123091] Updated weights for policy 0, policy_version 1670870 (0.0008) [2023-12-26 12:56:12,701][123091] Updated weights for policy 0, policy_version 1670880 (0.0010) [2023-12-26 12:56:12,752][123091] Updated weights for policy 0, policy_version 1670890 (0.0009) [2023-12-26 12:56:12,875][123090] Updated weights for policy 1, policy_version 1659655 (0.0009) [2023-12-26 12:56:12,937][123090] Updated weights for policy 1, policy_version 1659665 (0.0009) [2023-12-26 12:56:12,999][123090] Updated weights for policy 1, policy_version 1659675 (0.0010) [2023-12-26 12:56:13,497][123091] Updated weights for policy 0, policy_version 1670900 (0.0006) [2023-12-26 12:56:13,544][123091] Updated weights for policy 0, policy_version 1670910 (0.0005) [2023-12-26 12:56:13,608][123091] Updated weights for policy 0, policy_version 1670920 (0.0005) [2023-12-26 12:56:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 852639744. Throughput: 0: 8621.5, 1: 9127.3. Samples: 852633056. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:13,785][121949] Avg episode reward: [(0, '5974.444'), (1, '5511.482')] [2023-12-26 12:56:13,926][123090] Updated weights for policy 1, policy_version 1659685 (0.0009) [2023-12-26 12:56:13,980][123090] Updated weights for policy 1, policy_version 1659696 (0.0010) [2023-12-26 12:56:14,035][123090] Updated weights for policy 1, policy_version 1659708 (0.0011) [2023-12-26 12:56:14,218][123091] Updated weights for policy 0, policy_version 1670930 (0.0006) [2023-12-26 12:56:14,283][123091] Updated weights for policy 0, policy_version 1670940 (0.0008) [2023-12-26 12:56:14,351][123091] Updated weights for policy 0, policy_version 1670950 (0.0005) [2023-12-26 12:56:14,396][123091] Updated weights for policy 0, policy_version 1670960 (0.0005) [2023-12-26 12:56:14,859][123090] Updated weights for policy 1, policy_version 1659718 (0.0007) [2023-12-26 12:56:14,931][123090] Updated weights for policy 1, policy_version 1659728 (0.0007) [2023-12-26 12:56:15,000][123090] Updated weights for policy 1, policy_version 1659738 (0.0006) [2023-12-26 12:56:15,109][123091] Updated weights for policy 0, policy_version 1670970 (0.0006) [2023-12-26 12:56:15,181][123091] Updated weights for policy 0, policy_version 1670980 (0.0011) [2023-12-26 12:56:15,253][123091] Updated weights for policy 0, policy_version 1670990 (0.0011) [2023-12-26 12:56:15,733][123090] Updated weights for policy 1, policy_version 1659748 (0.0008) [2023-12-26 12:56:15,797][123090] Updated weights for policy 1, policy_version 1659758 (0.0009) [2023-12-26 12:56:15,846][123090] Updated weights for policy 1, policy_version 1659768 (0.0009) [2023-12-26 12:56:16,006][123091] Updated weights for policy 0, policy_version 1671000 (0.0006) [2023-12-26 12:56:16,066][123091] Updated weights for policy 0, policy_version 1671010 (0.0005) [2023-12-26 12:56:16,122][123091] Updated weights for policy 0, policy_version 1671020 (0.0005) [2023-12-26 12:56:16,646][123091] Updated weights for policy 0, policy_version 1671030 (0.0007) [2023-12-26 12:56:16,702][123090] Updated weights for policy 1, policy_version 1659778 (0.0008) [2023-12-26 12:56:16,711][123091] Updated weights for policy 0, policy_version 1671040 (0.0011) [2023-12-26 12:56:16,759][123090] Updated weights for policy 1, policy_version 1659788 (0.0008) [2023-12-26 12:56:16,773][123091] Updated weights for policy 0, policy_version 1671050 (0.0010) [2023-12-26 12:56:16,830][123090] Updated weights for policy 1, policy_version 1659798 (0.0006) [2023-12-26 12:56:16,901][123090] Updated weights for policy 1, policy_version 1659808 (0.0005) [2023-12-26 12:56:17,556][123091] Updated weights for policy 0, policy_version 1671060 (0.0009) [2023-12-26 12:56:17,580][123090] Updated weights for policy 1, policy_version 1659818 (0.0010) [2023-12-26 12:56:17,601][123091] Updated weights for policy 0, policy_version 1671070 (0.0006) [2023-12-26 12:56:17,632][123090] Updated weights for policy 1, policy_version 1659828 (0.0010) [2023-12-26 12:56:17,647][123091] Updated weights for policy 0, policy_version 1671080 (0.0010) [2023-12-26 12:56:17,680][123090] Updated weights for policy 1, policy_version 1659838 (0.0010) [2023-12-26 12:56:18,515][123091] Updated weights for policy 0, policy_version 1671090 (0.0007) [2023-12-26 12:56:18,539][123090] Updated weights for policy 1, policy_version 1659848 (0.0008) [2023-12-26 12:56:18,567][123091] Updated weights for policy 0, policy_version 1671100 (0.0010) [2023-12-26 12:56:18,597][123090] Updated weights for policy 1, policy_version 1659858 (0.0006) [2023-12-26 12:56:18,624][123091] Updated weights for policy 0, policy_version 1671110 (0.0010) [2023-12-26 12:56:18,662][123090] Updated weights for policy 1, policy_version 1659868 (0.0008) [2023-12-26 12:56:18,679][123091] Updated weights for policy 0, policy_version 1671120 (0.0011) [2023-12-26 12:56:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 852738048. Throughput: 0: 8688.3, 1: 9093.0. Samples: 852742668. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:18,784][121949] Avg episode reward: [(0, '5879.844'), (1, '5266.449')] [2023-12-26 12:56:19,491][123091] Updated weights for policy 0, policy_version 1671130 (0.0007) [2023-12-26 12:56:19,550][123090] Updated weights for policy 1, policy_version 1659878 (0.0009) [2023-12-26 12:56:19,557][123091] Updated weights for policy 0, policy_version 1671140 (0.0008) [2023-12-26 12:56:19,610][123090] Updated weights for policy 1, policy_version 1659888 (0.0007) [2023-12-26 12:56:19,625][123091] Updated weights for policy 0, policy_version 1671150 (0.0008) [2023-12-26 12:56:19,674][123090] Updated weights for policy 1, policy_version 1659898 (0.0005) [2023-12-26 12:56:20,389][123090] Updated weights for policy 1, policy_version 1659908 (0.0007) [2023-12-26 12:56:20,451][123090] Updated weights for policy 1, policy_version 1659918 (0.0010) [2023-12-26 12:56:20,484][123091] Updated weights for policy 0, policy_version 1671160 (0.0009) [2023-12-26 12:56:20,517][123090] Updated weights for policy 1, policy_version 1659928 (0.0009) [2023-12-26 12:56:20,556][123091] Updated weights for policy 0, policy_version 1671170 (0.0007) [2023-12-26 12:56:20,626][123091] Updated weights for policy 0, policy_version 1671180 (0.0008) [2023-12-26 12:56:21,396][123091] Updated weights for policy 0, policy_version 1671190 (0.0008) [2023-12-26 12:56:21,412][123090] Updated weights for policy 1, policy_version 1659938 (0.0009) [2023-12-26 12:56:21,452][123091] Updated weights for policy 0, policy_version 1671200 (0.0009) [2023-12-26 12:56:21,481][123090] Updated weights for policy 1, policy_version 1659948 (0.0007) [2023-12-26 12:56:21,519][123091] Updated weights for policy 0, policy_version 1671210 (0.0009) [2023-12-26 12:56:21,543][123090] Updated weights for policy 1, policy_version 1659958 (0.0008) [2023-12-26 12:56:21,612][123090] Updated weights for policy 1, policy_version 1659968 (0.0008) [2023-12-26 12:56:22,306][123091] Updated weights for policy 0, policy_version 1671220 (0.0008) [2023-12-26 12:56:22,369][123091] Updated weights for policy 0, policy_version 1671230 (0.0008) [2023-12-26 12:56:22,435][123091] Updated weights for policy 0, policy_version 1671240 (0.0007) [2023-12-26 12:56:22,478][123090] Updated weights for policy 1, policy_version 1659978 (0.0010) [2023-12-26 12:56:22,541][123090] Updated weights for policy 1, policy_version 1659988 (0.0007) [2023-12-26 12:56:22,599][123090] Updated weights for policy 1, policy_version 1659998 (0.0005) [2023-12-26 12:56:23,203][123091] Updated weights for policy 0, policy_version 1671250 (0.0007) [2023-12-26 12:56:23,255][123091] Updated weights for policy 0, policy_version 1671260 (0.0010) [2023-12-26 12:56:23,309][123090] Updated weights for policy 1, policy_version 1660008 (0.0006) [2023-12-26 12:56:23,314][123091] Updated weights for policy 0, policy_version 1671270 (0.0011) [2023-12-26 12:56:23,373][123090] Updated weights for policy 1, policy_version 1660018 (0.0008) [2023-12-26 12:56:23,378][123091] Updated weights for policy 0, policy_version 1671280 (0.0011) [2023-12-26 12:56:23,440][123090] Updated weights for policy 1, policy_version 1660028 (0.0009) [2023-12-26 12:56:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 852819968. Throughput: 0: 8659.7, 1: 9030.5. Samples: 852793416. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:23,785][121949] Avg episode reward: [(0, '5628.316'), (1, '5571.074')] [2023-12-26 12:56:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001671280_427851776.pth... [2023-12-26 12:56:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001660032_424968192.pth... [2023-12-26 12:56:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001670256_427589632.pth [2023-12-26 12:56:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001659008_424706048.pth [2023-12-26 12:56:24,143][123091] Updated weights for policy 0, policy_version 1671290 (0.0008) [2023-12-26 12:56:24,192][123091] Updated weights for policy 0, policy_version 1671300 (0.0009) [2023-12-26 12:56:24,243][123090] Updated weights for policy 1, policy_version 1660038 (0.0008) [2023-12-26 12:56:24,245][123091] Updated weights for policy 0, policy_version 1671310 (0.0011) [2023-12-26 12:56:24,301][123090] Updated weights for policy 1, policy_version 1660048 (0.0008) [2023-12-26 12:56:24,358][123090] Updated weights for policy 1, policy_version 1660058 (0.0009) [2023-12-26 12:56:25,100][123091] Updated weights for policy 0, policy_version 1671320 (0.0009) [2023-12-26 12:56:25,147][123090] Updated weights for policy 1, policy_version 1660068 (0.0008) [2023-12-26 12:56:25,168][123091] Updated weights for policy 0, policy_version 1671330 (0.0009) [2023-12-26 12:56:25,201][123090] Updated weights for policy 1, policy_version 1660078 (0.0006) [2023-12-26 12:56:25,231][123091] Updated weights for policy 0, policy_version 1671340 (0.0010) [2023-12-26 12:56:25,252][123090] Updated weights for policy 1, policy_version 1660088 (0.0009) [2023-12-26 12:56:25,947][123091] Updated weights for policy 0, policy_version 1671350 (0.0007) [2023-12-26 12:56:25,973][123090] Updated weights for policy 1, policy_version 1660098 (0.0008) [2023-12-26 12:56:26,007][123091] Updated weights for policy 0, policy_version 1671360 (0.0008) [2023-12-26 12:56:26,038][123090] Updated weights for policy 1, policy_version 1660108 (0.0007) [2023-12-26 12:56:26,069][123091] Updated weights for policy 0, policy_version 1671370 (0.0010) [2023-12-26 12:56:26,095][123090] Updated weights for policy 1, policy_version 1660118 (0.0009) [2023-12-26 12:56:26,153][123090] Updated weights for policy 1, policy_version 1660128 (0.0008) [2023-12-26 12:56:26,683][123091] Updated weights for policy 0, policy_version 1671380 (0.0010) [2023-12-26 12:56:26,742][123091] Updated weights for policy 0, policy_version 1671390 (0.0010) [2023-12-26 12:56:26,805][123091] Updated weights for policy 0, policy_version 1671400 (0.0010) [2023-12-26 12:56:26,816][123090] Updated weights for policy 1, policy_version 1660138 (0.0006) [2023-12-26 12:56:26,872][123090] Updated weights for policy 1, policy_version 1660148 (0.0007) [2023-12-26 12:56:26,919][123090] Updated weights for policy 1, policy_version 1660158 (0.0008) [2023-12-26 12:56:27,599][123091] Updated weights for policy 0, policy_version 1671410 (0.0009) [2023-12-26 12:56:27,653][123091] Updated weights for policy 0, policy_version 1671420 (0.0005) [2023-12-26 12:56:27,713][123091] Updated weights for policy 0, policy_version 1671430 (0.0010) [2023-12-26 12:56:27,756][123090] Updated weights for policy 1, policy_version 1660168 (0.0006) [2023-12-26 12:56:27,760][123091] Updated weights for policy 0, policy_version 1671440 (0.0010) [2023-12-26 12:56:27,812][123090] Updated weights for policy 1, policy_version 1660178 (0.0005) [2023-12-26 12:56:27,864][123090] Updated weights for policy 1, policy_version 1660188 (0.0005) [2023-12-26 12:56:28,470][123091] Updated weights for policy 0, policy_version 1671450 (0.0010) [2023-12-26 12:56:28,533][123091] Updated weights for policy 0, policy_version 1671460 (0.0010) [2023-12-26 12:56:28,561][123090] Updated weights for policy 1, policy_version 1660198 (0.0006) [2023-12-26 12:56:28,584][123091] Updated weights for policy 0, policy_version 1671470 (0.0010) [2023-12-26 12:56:28,622][123090] Updated weights for policy 1, policy_version 1660208 (0.0008) [2023-12-26 12:56:28,674][123090] Updated weights for policy 1, policy_version 1660218 (0.0009) [2023-12-26 12:56:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 852918272. Throughput: 0: 8718.0, 1: 9111.5. Samples: 852903792. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:28,785][121949] Avg episode reward: [(0, '5627.859'), (1, '5781.654')] [2023-12-26 12:56:29,364][123091] Updated weights for policy 0, policy_version 1671480 (0.0010) [2023-12-26 12:56:29,416][123091] Updated weights for policy 0, policy_version 1671490 (0.0012) [2023-12-26 12:56:29,474][123091] Updated weights for policy 0, policy_version 1671500 (0.0011) [2023-12-26 12:56:29,543][123090] Updated weights for policy 1, policy_version 1660228 (0.0008) [2023-12-26 12:56:29,590][123090] Updated weights for policy 1, policy_version 1660238 (0.0005) [2023-12-26 12:56:29,647][123090] Updated weights for policy 1, policy_version 1660248 (0.0005) [2023-12-26 12:56:30,289][123090] Updated weights for policy 1, policy_version 1660258 (0.0005) [2023-12-26 12:56:30,318][123091] Updated weights for policy 0, policy_version 1671510 (0.0007) [2023-12-26 12:56:30,348][123090] Updated weights for policy 1, policy_version 1660268 (0.0006) [2023-12-26 12:56:30,372][123091] Updated weights for policy 0, policy_version 1671520 (0.0005) [2023-12-26 12:56:30,417][123090] Updated weights for policy 1, policy_version 1660278 (0.0006) [2023-12-26 12:56:30,441][123091] Updated weights for policy 0, policy_version 1671530 (0.0009) [2023-12-26 12:56:30,485][123090] Updated weights for policy 1, policy_version 1660288 (0.0007) [2023-12-26 12:56:31,161][123090] Updated weights for policy 1, policy_version 1660298 (0.0008) [2023-12-26 12:56:31,192][123091] Updated weights for policy 0, policy_version 1671540 (0.0008) [2023-12-26 12:56:31,224][123090] Updated weights for policy 1, policy_version 1660308 (0.0008) [2023-12-26 12:56:31,261][123091] Updated weights for policy 0, policy_version 1671550 (0.0005) [2023-12-26 12:56:31,290][123090] Updated weights for policy 1, policy_version 1660318 (0.0007) [2023-12-26 12:56:31,329][123091] Updated weights for policy 0, policy_version 1671560 (0.0009) [2023-12-26 12:56:32,036][123090] Updated weights for policy 1, policy_version 1660328 (0.0005) [2023-12-26 12:56:32,083][123091] Updated weights for policy 0, policy_version 1671570 (0.0009) [2023-12-26 12:56:32,097][123090] Updated weights for policy 1, policy_version 1660338 (0.0007) [2023-12-26 12:56:32,146][123091] Updated weights for policy 0, policy_version 1671580 (0.0011) [2023-12-26 12:56:32,162][123090] Updated weights for policy 1, policy_version 1660348 (0.0005) [2023-12-26 12:56:32,215][123091] Updated weights for policy 0, policy_version 1671590 (0.0010) [2023-12-26 12:56:32,281][123091] Updated weights for policy 0, policy_version 1671600 (0.0011) [2023-12-26 12:56:32,958][123090] Updated weights for policy 1, policy_version 1660358 (0.0006) [2023-12-26 12:56:33,007][123090] Updated weights for policy 1, policy_version 1660368 (0.0005) [2023-12-26 12:56:33,036][123091] Updated weights for policy 0, policy_version 1671610 (0.0005) [2023-12-26 12:56:33,067][123090] Updated weights for policy 1, policy_version 1660378 (0.0005) [2023-12-26 12:56:33,101][123091] Updated weights for policy 0, policy_version 1671620 (0.0005) [2023-12-26 12:56:33,148][123091] Updated weights for policy 0, policy_version 1671630 (0.0005) [2023-12-26 12:56:33,750][123090] Updated weights for policy 1, policy_version 1660388 (0.0007) [2023-12-26 12:56:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 853000192. Throughput: 0: 8821.4, 1: 9062.8. Samples: 853017532. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:33,785][121949] Avg episode reward: [(0, '5776.551'), (1, '5733.197')] [2023-12-26 12:56:33,800][123091] Updated weights for policy 0, policy_version 1671640 (0.0007) [2023-12-26 12:56:33,811][123090] Updated weights for policy 1, policy_version 1660398 (0.0011) [2023-12-26 12:56:33,864][123091] Updated weights for policy 0, policy_version 1671650 (0.0009) [2023-12-26 12:56:33,871][123090] Updated weights for policy 1, policy_version 1660408 (0.0010) [2023-12-26 12:56:33,912][123091] Updated weights for policy 0, policy_version 1671660 (0.0009) [2023-12-26 12:56:34,725][123090] Updated weights for policy 1, policy_version 1660418 (0.0010) [2023-12-26 12:56:34,758][123091] Updated weights for policy 0, policy_version 1671670 (0.0010) [2023-12-26 12:56:34,778][123090] Updated weights for policy 1, policy_version 1660428 (0.0010) [2023-12-26 12:56:34,817][123091] Updated weights for policy 0, policy_version 1671680 (0.0007) [2023-12-26 12:56:34,834][123090] Updated weights for policy 1, policy_version 1660438 (0.0010) [2023-12-26 12:56:34,877][123091] Updated weights for policy 0, policy_version 1671690 (0.0005) [2023-12-26 12:56:34,886][123090] Updated weights for policy 1, policy_version 1660448 (0.0010) [2023-12-26 12:56:35,567][123091] Updated weights for policy 0, policy_version 1671700 (0.0005) [2023-12-26 12:56:35,612][123091] Updated weights for policy 0, policy_version 1671710 (0.0005) [2023-12-26 12:56:35,655][123091] Updated weights for policy 0, policy_version 1671720 (0.0005) [2023-12-26 12:56:35,729][123090] Updated weights for policy 1, policy_version 1660458 (0.0010) [2023-12-26 12:56:35,787][123090] Updated weights for policy 1, policy_version 1660468 (0.0010) [2023-12-26 12:56:35,846][123090] Updated weights for policy 1, policy_version 1660478 (0.0010) [2023-12-26 12:56:36,417][123091] Updated weights for policy 0, policy_version 1671730 (0.0006) [2023-12-26 12:56:36,489][123091] Updated weights for policy 0, policy_version 1671740 (0.0011) [2023-12-26 12:56:36,557][123091] Updated weights for policy 0, policy_version 1671750 (0.0011) [2023-12-26 12:56:36,606][123090] Updated weights for policy 1, policy_version 1660488 (0.0010) [2023-12-26 12:56:36,622][123091] Updated weights for policy 0, policy_version 1671760 (0.0011) [2023-12-26 12:56:36,674][123090] Updated weights for policy 1, policy_version 1660498 (0.0011) [2023-12-26 12:56:36,738][123090] Updated weights for policy 1, policy_version 1660508 (0.0011) [2023-12-26 12:56:37,423][123091] Updated weights for policy 0, policy_version 1671770 (0.0010) [2023-12-26 12:56:37,476][123091] Updated weights for policy 0, policy_version 1671781 (0.0010) [2023-12-26 12:56:37,528][123091] Updated weights for policy 0, policy_version 1671791 (0.0008) [2023-12-26 12:56:37,530][123090] Updated weights for policy 1, policy_version 1660518 (0.0009) [2023-12-26 12:56:37,601][123090] Updated weights for policy 1, policy_version 1660528 (0.0009) [2023-12-26 12:56:37,672][123090] Updated weights for policy 1, policy_version 1660538 (0.0008) [2023-12-26 12:56:38,287][123091] Updated weights for policy 0, policy_version 1671801 (0.0010) [2023-12-26 12:56:38,339][123091] Updated weights for policy 0, policy_version 1671811 (0.0010) [2023-12-26 12:56:38,398][123091] Updated weights for policy 0, policy_version 1671821 (0.0011) [2023-12-26 12:56:38,440][123090] Updated weights for policy 1, policy_version 1660548 (0.0008) [2023-12-26 12:56:38,500][123090] Updated weights for policy 1, policy_version 1660558 (0.0009) [2023-12-26 12:56:38,557][123090] Updated weights for policy 1, policy_version 1660568 (0.0008) [2023-12-26 12:56:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 853098496. Throughput: 0: 8907.5, 1: 9018.6. Samples: 853072184. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:38,785][121949] Avg episode reward: [(0, '5728.062'), (1, '5649.149')] [2023-12-26 12:56:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001671824_427991040.pth... [2023-12-26 12:56:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001660576_425107456.pth... [2023-12-26 12:56:38,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001659520_424837120.pth [2023-12-26 12:56:38,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001670736_427712512.pth [2023-12-26 12:56:39,283][123091] Updated weights for policy 0, policy_version 1671831 (0.0010) [2023-12-26 12:56:39,358][123091] Updated weights for policy 0, policy_version 1671841 (0.0010) [2023-12-26 12:56:39,422][123091] Updated weights for policy 0, policy_version 1671851 (0.0008) [2023-12-26 12:56:39,422][123090] Updated weights for policy 1, policy_version 1660578 (0.0009) [2023-12-26 12:56:39,491][123090] Updated weights for policy 1, policy_version 1660588 (0.0010) [2023-12-26 12:56:39,553][123090] Updated weights for policy 1, policy_version 1660598 (0.0009) [2023-12-26 12:56:39,611][123090] Updated weights for policy 1, policy_version 1660608 (0.0009) [2023-12-26 12:56:40,153][123091] Updated weights for policy 0, policy_version 1671861 (0.0009) [2023-12-26 12:56:40,216][123091] Updated weights for policy 0, policy_version 1671871 (0.0011) [2023-12-26 12:56:40,284][123091] Updated weights for policy 0, policy_version 1671881 (0.0010) [2023-12-26 12:56:40,498][123090] Updated weights for policy 1, policy_version 1660618 (0.0009) [2023-12-26 12:56:40,558][123090] Updated weights for policy 1, policy_version 1660628 (0.0009) [2023-12-26 12:56:40,618][123090] Updated weights for policy 1, policy_version 1660638 (0.0009) [2023-12-26 12:56:41,101][123091] Updated weights for policy 0, policy_version 1671891 (0.0011) [2023-12-26 12:56:41,159][123091] Updated weights for policy 0, policy_version 1671901 (0.0009) [2023-12-26 12:56:41,236][123091] Updated weights for policy 0, policy_version 1671911 (0.0006) [2023-12-26 12:56:41,473][123090] Updated weights for policy 1, policy_version 1660648 (0.0009) [2023-12-26 12:56:41,543][123090] Updated weights for policy 1, policy_version 1660658 (0.0010) [2023-12-26 12:56:41,606][123090] Updated weights for policy 1, policy_version 1660668 (0.0009) [2023-12-26 12:56:42,081][123091] Updated weights for policy 0, policy_version 1671921 (0.0009) [2023-12-26 12:56:42,142][123091] Updated weights for policy 0, policy_version 1671931 (0.0008) [2023-12-26 12:56:42,197][123091] Updated weights for policy 0, policy_version 1671941 (0.0006) [2023-12-26 12:56:42,259][123091] Updated weights for policy 0, policy_version 1671951 (0.0007) [2023-12-26 12:56:42,459][123090] Updated weights for policy 1, policy_version 1660678 (0.0010) [2023-12-26 12:56:42,512][123090] Updated weights for policy 1, policy_version 1660688 (0.0010) [2023-12-26 12:56:42,566][123090] Updated weights for policy 1, policy_version 1660698 (0.0010) [2023-12-26 12:56:42,995][123091] Updated weights for policy 0, policy_version 1671961 (0.0010) [2023-12-26 12:56:43,067][123091] Updated weights for policy 0, policy_version 1671971 (0.0011) [2023-12-26 12:56:43,138][123091] Updated weights for policy 0, policy_version 1671981 (0.0011) [2023-12-26 12:56:43,502][123090] Updated weights for policy 1, policy_version 1660711 (0.0011) [2023-12-26 12:56:43,560][123090] Updated weights for policy 1, policy_version 1660721 (0.0010) [2023-12-26 12:56:43,613][123090] Updated weights for policy 1, policy_version 1660731 (0.0010) [2023-12-26 12:56:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 853180416. Throughput: 0: 8922.4, 1: 8921.3. Samples: 853173640. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:43,785][121949] Avg episode reward: [(0, '5698.690'), (1, '5414.665')] [2023-12-26 12:56:43,850][123091] Updated weights for policy 0, policy_version 1671991 (0.0009) [2023-12-26 12:56:43,900][123091] Updated weights for policy 0, policy_version 1672001 (0.0009) [2023-12-26 12:56:43,956][123091] Updated weights for policy 0, policy_version 1672011 (0.0009) [2023-12-26 12:56:44,545][123090] Updated weights for policy 1, policy_version 1660741 (0.0009) [2023-12-26 12:56:44,607][123090] Updated weights for policy 1, policy_version 1660751 (0.0005) [2023-12-26 12:56:44,671][123090] Updated weights for policy 1, policy_version 1660761 (0.0010) [2023-12-26 12:56:44,777][123091] Updated weights for policy 0, policy_version 1672022 (0.0010) [2023-12-26 12:56:44,849][123091] Updated weights for policy 0, policy_version 1672032 (0.0006) [2023-12-26 12:56:44,917][123091] Updated weights for policy 0, policy_version 1672042 (0.0008) [2023-12-26 12:56:45,508][123090] Updated weights for policy 1, policy_version 1660771 (0.0009) [2023-12-26 12:56:45,567][123090] Updated weights for policy 1, policy_version 1660781 (0.0010) [2023-12-26 12:56:45,618][123090] Updated weights for policy 1, policy_version 1660791 (0.0010) [2023-12-26 12:56:45,671][123091] Updated weights for policy 0, policy_version 1672052 (0.0008) [2023-12-26 12:56:45,725][123091] Updated weights for policy 0, policy_version 1672062 (0.0010) [2023-12-26 12:56:45,775][123091] Updated weights for policy 0, policy_version 1672072 (0.0010) [2023-12-26 12:56:46,479][123091] Updated weights for policy 0, policy_version 1672082 (0.0008) [2023-12-26 12:56:46,503][123090] Updated weights for policy 1, policy_version 1660801 (0.0009) [2023-12-26 12:56:46,533][123091] Updated weights for policy 0, policy_version 1672092 (0.0005) [2023-12-26 12:56:46,576][123090] Updated weights for policy 1, policy_version 1660811 (0.0008) [2023-12-26 12:56:46,585][123091] Updated weights for policy 0, policy_version 1672102 (0.0005) [2023-12-26 12:56:46,634][123091] Updated weights for policy 0, policy_version 1672112 (0.0007) [2023-12-26 12:56:46,636][123090] Updated weights for policy 1, policy_version 1660821 (0.0009) [2023-12-26 12:56:46,685][123090] Updated weights for policy 1, policy_version 1660831 (0.0009) [2023-12-26 12:56:47,330][123091] Updated weights for policy 0, policy_version 1672122 (0.0010) [2023-12-26 12:56:47,382][123091] Updated weights for policy 0, policy_version 1672132 (0.0010) [2023-12-26 12:56:47,434][123091] Updated weights for policy 0, policy_version 1672142 (0.0010) [2023-12-26 12:56:47,504][123090] Updated weights for policy 1, policy_version 1660841 (0.0006) [2023-12-26 12:56:47,561][123090] Updated weights for policy 1, policy_version 1660851 (0.0005) [2023-12-26 12:56:47,606][123090] Updated weights for policy 1, policy_version 1660861 (0.0005) [2023-12-26 12:56:48,167][123091] Updated weights for policy 0, policy_version 1672152 (0.0010) [2023-12-26 12:56:48,191][123090] Updated weights for policy 1, policy_version 1660871 (0.0005) [2023-12-26 12:56:48,217][123091] Updated weights for policy 0, policy_version 1672162 (0.0010) [2023-12-26 12:56:48,239][123090] Updated weights for policy 1, policy_version 1660881 (0.0005) [2023-12-26 12:56:48,270][123091] Updated weights for policy 0, policy_version 1672172 (0.0009) [2023-12-26 12:56:48,294][123090] Updated weights for policy 1, policy_version 1660891 (0.0006) [2023-12-26 12:56:48,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 853270528. Throughput: 0: 9061.2, 1: 8813.0. Samples: 853282164. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:48,785][121949] Avg episode reward: [(0, '5853.704'), (1, '5580.025')] [2023-12-26 12:56:49,054][123091] Updated weights for policy 0, policy_version 1672182 (0.0010) [2023-12-26 12:56:49,106][123091] Updated weights for policy 0, policy_version 1672192 (0.0009) [2023-12-26 12:56:49,149][123090] Updated weights for policy 1, policy_version 1660901 (0.0007) [2023-12-26 12:56:49,158][123091] Updated weights for policy 0, policy_version 1672202 (0.0010) [2023-12-26 12:56:49,211][123090] Updated weights for policy 1, policy_version 1660911 (0.0008) [2023-12-26 12:56:49,284][123090] Updated weights for policy 1, policy_version 1660921 (0.0010) [2023-12-26 12:56:50,039][123091] Updated weights for policy 0, policy_version 1672212 (0.0008) [2023-12-26 12:56:50,109][123091] Updated weights for policy 0, policy_version 1672222 (0.0009) [2023-12-26 12:56:50,123][123090] Updated weights for policy 1, policy_version 1660931 (0.0009) [2023-12-26 12:56:50,163][123091] Updated weights for policy 0, policy_version 1672232 (0.0009) [2023-12-26 12:56:50,178][123090] Updated weights for policy 1, policy_version 1660941 (0.0008) [2023-12-26 12:56:50,249][123090] Updated weights for policy 1, policy_version 1660951 (0.0007) [2023-12-26 12:56:50,865][123091] Updated weights for policy 0, policy_version 1672242 (0.0011) [2023-12-26 12:56:50,921][123091] Updated weights for policy 0, policy_version 1672252 (0.0011) [2023-12-26 12:56:50,977][123091] Updated weights for policy 0, policy_version 1672262 (0.0011) [2023-12-26 12:56:51,030][123091] Updated weights for policy 0, policy_version 1672272 (0.0010) [2023-12-26 12:56:51,126][123090] Updated weights for policy 1, policy_version 1660961 (0.0009) [2023-12-26 12:56:51,187][123090] Updated weights for policy 1, policy_version 1660971 (0.0009) [2023-12-26 12:56:51,237][123090] Updated weights for policy 1, policy_version 1660981 (0.0009) [2023-12-26 12:56:51,305][123090] Updated weights for policy 1, policy_version 1660991 (0.0009) [2023-12-26 12:56:51,885][123091] Updated weights for policy 0, policy_version 1672282 (0.0006) [2023-12-26 12:56:51,953][123091] Updated weights for policy 0, policy_version 1672292 (0.0005) [2023-12-26 12:56:52,002][123091] Updated weights for policy 0, policy_version 1672302 (0.0005) [2023-12-26 12:56:52,113][123090] Updated weights for policy 1, policy_version 1661001 (0.0006) [2023-12-26 12:56:52,170][123090] Updated weights for policy 1, policy_version 1661011 (0.0005) [2023-12-26 12:56:52,238][123090] Updated weights for policy 1, policy_version 1661021 (0.0007) [2023-12-26 12:56:52,748][123091] Updated weights for policy 0, policy_version 1672312 (0.0005) [2023-12-26 12:56:52,825][123091] Updated weights for policy 0, policy_version 1672322 (0.0007) [2023-12-26 12:56:52,891][123091] Updated weights for policy 0, policy_version 1672332 (0.0010) [2023-12-26 12:56:53,038][123090] Updated weights for policy 1, policy_version 1661031 (0.0009) [2023-12-26 12:56:53,097][123090] Updated weights for policy 1, policy_version 1661041 (0.0010) [2023-12-26 12:56:53,160][123090] Updated weights for policy 1, policy_version 1661051 (0.0010) [2023-12-26 12:56:53,560][123091] Updated weights for policy 0, policy_version 1672342 (0.0010) [2023-12-26 12:56:53,611][123091] Updated weights for policy 0, policy_version 1672352 (0.0009) [2023-12-26 12:56:53,663][123091] Updated weights for policy 0, policy_version 1672362 (0.0009) [2023-12-26 12:56:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 853360640. Throughput: 0: 9087.7, 1: 8782.0. Samples: 853333452. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:53,784][121949] Avg episode reward: [(0, '5838.690'), (1, '5626.028')] [2023-12-26 12:56:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001661056_425230336.pth... [2023-12-26 12:56:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001672368_428130304.pth... [2023-12-26 12:56:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001671280_427851776.pth [2023-12-26 12:56:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001660032_424968192.pth [2023-12-26 12:56:53,992][123090] Updated weights for policy 1, policy_version 1661061 (0.0008) [2023-12-26 12:56:54,052][123090] Updated weights for policy 1, policy_version 1661071 (0.0006) [2023-12-26 12:56:54,111][123090] Updated weights for policy 1, policy_version 1661081 (0.0007) [2023-12-26 12:56:54,589][123091] Updated weights for policy 0, policy_version 1672372 (0.0010) [2023-12-26 12:56:54,646][123091] Updated weights for policy 0, policy_version 1672382 (0.0009) [2023-12-26 12:56:54,697][123091] Updated weights for policy 0, policy_version 1672392 (0.0009) [2023-12-26 12:56:54,805][123090] Updated weights for policy 1, policy_version 1661091 (0.0007) [2023-12-26 12:56:54,870][123090] Updated weights for policy 1, policy_version 1661101 (0.0006) [2023-12-26 12:56:54,938][123090] Updated weights for policy 1, policy_version 1661111 (0.0006) [2023-12-26 12:56:55,589][123091] Updated weights for policy 0, policy_version 1672402 (0.0009) [2023-12-26 12:56:55,638][123091] Updated weights for policy 0, policy_version 1672412 (0.0009) [2023-12-26 12:56:55,660][123090] Updated weights for policy 1, policy_version 1661121 (0.0006) [2023-12-26 12:56:55,689][123091] Updated weights for policy 0, policy_version 1672422 (0.0007) [2023-12-26 12:56:55,716][123090] Updated weights for policy 1, policy_version 1661131 (0.0010) [2023-12-26 12:56:55,734][123091] Updated weights for policy 0, policy_version 1672432 (0.0009) [2023-12-26 12:56:55,767][123090] Updated weights for policy 1, policy_version 1661141 (0.0010) [2023-12-26 12:56:55,821][123090] Updated weights for policy 1, policy_version 1661151 (0.0010) [2023-12-26 12:56:56,607][123091] Updated weights for policy 0, policy_version 1672442 (0.0009) [2023-12-26 12:56:56,625][123090] Updated weights for policy 1, policy_version 1661161 (0.0006) [2023-12-26 12:56:56,661][123091] Updated weights for policy 0, policy_version 1672452 (0.0010) [2023-12-26 12:56:56,680][123090] Updated weights for policy 1, policy_version 1661171 (0.0006) [2023-12-26 12:56:56,709][123091] Updated weights for policy 0, policy_version 1672462 (0.0008) [2023-12-26 12:56:56,743][123090] Updated weights for policy 1, policy_version 1661181 (0.0005) [2023-12-26 12:56:57,374][123090] Updated weights for policy 1, policy_version 1661191 (0.0009) [2023-12-26 12:56:57,425][123090] Updated weights for policy 1, policy_version 1661201 (0.0010) [2023-12-26 12:56:57,468][123090] Updated weights for policy 1, policy_version 1661211 (0.0010) [2023-12-26 12:56:57,590][123091] Updated weights for policy 0, policy_version 1672472 (0.0010) [2023-12-26 12:56:57,654][123091] Updated weights for policy 0, policy_version 1672482 (0.0011) [2023-12-26 12:56:57,708][123091] Updated weights for policy 0, policy_version 1672494 (0.0010) [2023-12-26 12:56:58,055][123090] Updated weights for policy 1, policy_version 1661221 (0.0008) [2023-12-26 12:56:58,119][123090] Updated weights for policy 1, policy_version 1661231 (0.0010) [2023-12-26 12:56:58,182][123090] Updated weights for policy 1, policy_version 1661241 (0.0011) [2023-12-26 12:56:58,628][123091] Updated weights for policy 0, policy_version 1672504 (0.0009) [2023-12-26 12:56:58,688][123091] Updated weights for policy 0, policy_version 1672514 (0.0010) [2023-12-26 12:56:58,761][123091] Updated weights for policy 0, policy_version 1672524 (0.0009) [2023-12-26 12:56:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 853442560. Throughput: 0: 9117.3, 1: 8842.0. Samples: 853441220. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:56:58,785][121949] Avg episode reward: [(0, '5952.730'), (1, '5827.007')] [2023-12-26 12:56:59,121][123090] Updated weights for policy 1, policy_version 1661251 (0.0010) [2023-12-26 12:56:59,188][123090] Updated weights for policy 1, policy_version 1661261 (0.0011) [2023-12-26 12:56:59,258][123090] Updated weights for policy 1, policy_version 1661271 (0.0010) [2023-12-26 12:56:59,643][123091] Updated weights for policy 0, policy_version 1672534 (0.0010) [2023-12-26 12:56:59,706][123091] Updated weights for policy 0, policy_version 1672544 (0.0011) [2023-12-26 12:56:59,769][123091] Updated weights for policy 0, policy_version 1672554 (0.0010) [2023-12-26 12:56:59,927][123090] Updated weights for policy 1, policy_version 1661281 (0.0013) [2023-12-26 12:56:59,978][123090] Updated weights for policy 1, policy_version 1661291 (0.0009) [2023-12-26 12:57:00,030][123090] Updated weights for policy 1, policy_version 1661301 (0.0009) [2023-12-26 12:57:00,090][123090] Updated weights for policy 1, policy_version 1661311 (0.0009) [2023-12-26 12:57:00,557][123091] Updated weights for policy 0, policy_version 1672564 (0.0010) [2023-12-26 12:57:00,612][123091] Updated weights for policy 0, policy_version 1672574 (0.0009) [2023-12-26 12:57:00,660][123091] Updated weights for policy 0, policy_version 1672584 (0.0009) [2023-12-26 12:57:00,952][123090] Updated weights for policy 1, policy_version 1661321 (0.0010) [2023-12-26 12:57:01,000][123090] Updated weights for policy 1, policy_version 1661332 (0.0009) [2023-12-26 12:57:01,062][123090] Updated weights for policy 1, policy_version 1661342 (0.0009) [2023-12-26 12:57:01,389][123091] Updated weights for policy 0, policy_version 1672594 (0.0010) [2023-12-26 12:57:01,441][123091] Updated weights for policy 0, policy_version 1672604 (0.0011) [2023-12-26 12:57:01,492][123091] Updated weights for policy 0, policy_version 1672614 (0.0010) [2023-12-26 12:57:01,555][123091] Updated weights for policy 0, policy_version 1672624 (0.0011) [2023-12-26 12:57:01,882][123090] Updated weights for policy 1, policy_version 1661352 (0.0006) [2023-12-26 12:57:01,950][123090] Updated weights for policy 1, policy_version 1661362 (0.0006) [2023-12-26 12:57:02,027][123090] Updated weights for policy 1, policy_version 1661372 (0.0005) [2023-12-26 12:57:02,384][123091] Updated weights for policy 0, policy_version 1672634 (0.0009) [2023-12-26 12:57:02,442][123091] Updated weights for policy 0, policy_version 1672644 (0.0010) [2023-12-26 12:57:02,507][123091] Updated weights for policy 0, policy_version 1672654 (0.0010) [2023-12-26 12:57:02,746][123090] Updated weights for policy 1, policy_version 1661382 (0.0005) [2023-12-26 12:57:02,817][123090] Updated weights for policy 1, policy_version 1661392 (0.0006) [2023-12-26 12:57:02,878][123090] Updated weights for policy 1, policy_version 1661402 (0.0009) [2023-12-26 12:57:03,331][123091] Updated weights for policy 0, policy_version 1672664 (0.0010) [2023-12-26 12:57:03,393][123091] Updated weights for policy 0, policy_version 1672674 (0.0010) [2023-12-26 12:57:03,440][123091] Updated weights for policy 0, policy_version 1672684 (0.0010) [2023-12-26 12:57:03,495][123090] Updated weights for policy 1, policy_version 1661412 (0.0006) [2023-12-26 12:57:03,550][123090] Updated weights for policy 1, policy_version 1661422 (0.0005) [2023-12-26 12:57:03,626][123090] Updated weights for policy 1, policy_version 1661432 (0.0005) [2023-12-26 12:57:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 853540864. Throughput: 0: 8985.3, 1: 8902.8. Samples: 853547636. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:03,785][121949] Avg episode reward: [(0, '5905.468'), (1, '5918.023')] [2023-12-26 12:57:04,274][123091] Updated weights for policy 0, policy_version 1672694 (0.0011) [2023-12-26 12:57:04,316][123090] Updated weights for policy 1, policy_version 1661442 (0.0005) [2023-12-26 12:57:04,342][123091] Updated weights for policy 0, policy_version 1672704 (0.0011) [2023-12-26 12:57:04,386][123090] Updated weights for policy 1, policy_version 1661452 (0.0008) [2023-12-26 12:57:04,410][123091] Updated weights for policy 0, policy_version 1672714 (0.0011) [2023-12-26 12:57:04,453][123090] Updated weights for policy 1, policy_version 1661462 (0.0007) [2023-12-26 12:57:04,526][123090] Updated weights for policy 1, policy_version 1661472 (0.0006) [2023-12-26 12:57:05,103][123091] Updated weights for policy 0, policy_version 1672724 (0.0009) [2023-12-26 12:57:05,163][123091] Updated weights for policy 0, policy_version 1672734 (0.0005) [2023-12-26 12:57:05,236][123091] Updated weights for policy 0, policy_version 1672744 (0.0005) [2023-12-26 12:57:05,326][123090] Updated weights for policy 1, policy_version 1661482 (0.0005) [2023-12-26 12:57:05,374][123090] Updated weights for policy 1, policy_version 1661492 (0.0005) [2023-12-26 12:57:05,426][123090] Updated weights for policy 1, policy_version 1661502 (0.0005) [2023-12-26 12:57:05,908][123091] Updated weights for policy 0, policy_version 1672754 (0.0006) [2023-12-26 12:57:05,966][123091] Updated weights for policy 0, policy_version 1672764 (0.0010) [2023-12-26 12:57:06,020][123091] Updated weights for policy 0, policy_version 1672774 (0.0010) [2023-12-26 12:57:06,078][123091] Updated weights for policy 0, policy_version 1672784 (0.0010) [2023-12-26 12:57:06,151][123090] Updated weights for policy 1, policy_version 1661512 (0.0008) [2023-12-26 12:57:06,221][123090] Updated weights for policy 1, policy_version 1661522 (0.0005) [2023-12-26 12:57:06,290][123090] Updated weights for policy 1, policy_version 1661532 (0.0006) [2023-12-26 12:57:06,875][123091] Updated weights for policy 0, policy_version 1672794 (0.0006) [2023-12-26 12:57:06,939][123091] Updated weights for policy 0, policy_version 1672804 (0.0005) [2023-12-26 12:57:07,014][123091] Updated weights for policy 0, policy_version 1672814 (0.0006) [2023-12-26 12:57:07,062][123090] Updated weights for policy 1, policy_version 1661542 (0.0006) [2023-12-26 12:57:07,126][123090] Updated weights for policy 1, policy_version 1661552 (0.0010) [2023-12-26 12:57:07,196][123090] Updated weights for policy 1, policy_version 1661562 (0.0010) [2023-12-26 12:57:07,766][123091] Updated weights for policy 0, policy_version 1672824 (0.0009) [2023-12-26 12:57:07,821][123091] Updated weights for policy 0, policy_version 1672836 (0.0011) [2023-12-26 12:57:07,875][123091] Updated weights for policy 0, policy_version 1672847 (0.0010) [2023-12-26 12:57:07,941][123090] Updated weights for policy 1, policy_version 1661572 (0.0007) [2023-12-26 12:57:07,993][123090] Updated weights for policy 1, policy_version 1661582 (0.0005) [2023-12-26 12:57:08,042][123090] Updated weights for policy 1, policy_version 1661592 (0.0005) [2023-12-26 12:57:08,657][123091] Updated weights for policy 0, policy_version 1672857 (0.0006) [2023-12-26 12:57:08,715][123090] Updated weights for policy 1, policy_version 1661602 (0.0005) [2023-12-26 12:57:08,723][123091] Updated weights for policy 0, policy_version 1672867 (0.0006) [2023-12-26 12:57:08,781][123090] Updated weights for policy 1, policy_version 1661612 (0.0006) [2023-12-26 12:57:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 853622784. Throughput: 0: 9033.1, 1: 8981.2. Samples: 853604056. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:08,785][121949] Avg episode reward: [(0, '5954.767'), (1, '5849.010')] [2023-12-26 12:57:08,788][123091] Updated weights for policy 0, policy_version 1672877 (0.0006) [2023-12-26 12:57:08,805][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001672880_428261376.pth... [2023-12-26 12:57:08,808][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001671824_427991040.pth [2023-12-26 12:57:08,847][123090] Updated weights for policy 1, policy_version 1661622 (0.0010) [2023-12-26 12:57:08,900][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001661632_425377792.pth... [2023-12-26 12:57:08,902][123090] Updated weights for policy 1, policy_version 1661632 (0.0010) [2023-12-26 12:57:08,904][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001660576_425107456.pth [2023-12-26 12:57:09,518][123091] Updated weights for policy 0, policy_version 1672887 (0.0006) [2023-12-26 12:57:09,580][123091] Updated weights for policy 0, policy_version 1672897 (0.0010) [2023-12-26 12:57:09,638][123091] Updated weights for policy 0, policy_version 1672907 (0.0009) [2023-12-26 12:57:09,716][123090] Updated weights for policy 1, policy_version 1661642 (0.0006) [2023-12-26 12:57:09,788][123090] Updated weights for policy 1, policy_version 1661652 (0.0007) [2023-12-26 12:57:09,857][123090] Updated weights for policy 1, policy_version 1661662 (0.0010) [2023-12-26 12:57:10,459][123091] Updated weights for policy 0, policy_version 1672917 (0.0010) [2023-12-26 12:57:10,523][123091] Updated weights for policy 0, policy_version 1672927 (0.0009) [2023-12-26 12:57:10,578][123091] Updated weights for policy 0, policy_version 1672937 (0.0009) [2023-12-26 12:57:10,606][123090] Updated weights for policy 1, policy_version 1661672 (0.0011) [2023-12-26 12:57:10,674][123090] Updated weights for policy 1, policy_version 1661682 (0.0011) [2023-12-26 12:57:10,734][123090] Updated weights for policy 1, policy_version 1661692 (0.0010) [2023-12-26 12:57:11,435][123091] Updated weights for policy 0, policy_version 1672947 (0.0007) [2023-12-26 12:57:11,502][123091] Updated weights for policy 0, policy_version 1672957 (0.0008) [2023-12-26 12:57:11,566][123091] Updated weights for policy 0, policy_version 1672967 (0.0009) [2023-12-26 12:57:11,624][123090] Updated weights for policy 1, policy_version 1661702 (0.0011) [2023-12-26 12:57:11,697][123090] Updated weights for policy 1, policy_version 1661712 (0.0011) [2023-12-26 12:57:11,775][123090] Updated weights for policy 1, policy_version 1661722 (0.0010) [2023-12-26 12:57:12,285][123091] Updated weights for policy 0, policy_version 1672977 (0.0008) [2023-12-26 12:57:12,347][123091] Updated weights for policy 0, policy_version 1672987 (0.0008) [2023-12-26 12:57:12,420][123091] Updated weights for policy 0, policy_version 1672997 (0.0008) [2023-12-26 12:57:12,485][123091] Updated weights for policy 0, policy_version 1673007 (0.0008) [2023-12-26 12:57:12,515][123090] Updated weights for policy 1, policy_version 1661732 (0.0008) [2023-12-26 12:57:12,582][123090] Updated weights for policy 1, policy_version 1661742 (0.0006) [2023-12-26 12:57:12,656][123090] Updated weights for policy 1, policy_version 1661752 (0.0008) [2023-12-26 12:57:13,199][123091] Updated weights for policy 0, policy_version 1673017 (0.0010) [2023-12-26 12:57:13,257][123091] Updated weights for policy 0, policy_version 1673027 (0.0010) [2023-12-26 12:57:13,312][123091] Updated weights for policy 0, policy_version 1673037 (0.0009) [2023-12-26 12:57:13,318][123090] Updated weights for policy 1, policy_version 1661762 (0.0010) [2023-12-26 12:57:13,363][123090] Updated weights for policy 1, policy_version 1661772 (0.0005) [2023-12-26 12:57:13,429][123090] Updated weights for policy 1, policy_version 1661782 (0.0005) [2023-12-26 12:57:13,494][123090] Updated weights for policy 1, policy_version 1661792 (0.0008) [2023-12-26 12:57:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 853721088. Throughput: 0: 8989.3, 1: 8981.2. Samples: 853712460. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:13,784][121949] Avg episode reward: [(0, '6021.996'), (1, '5468.219')] [2023-12-26 12:57:14,162][123091] Updated weights for policy 0, policy_version 1673047 (0.0008) [2023-12-26 12:57:14,218][123091] Updated weights for policy 0, policy_version 1673057 (0.0009) [2023-12-26 12:57:14,275][123091] Updated weights for policy 0, policy_version 1673067 (0.0009) [2023-12-26 12:57:14,290][123090] Updated weights for policy 1, policy_version 1661802 (0.0009) [2023-12-26 12:57:14,361][123090] Updated weights for policy 1, policy_version 1661812 (0.0010) [2023-12-26 12:57:14,425][123090] Updated weights for policy 1, policy_version 1661822 (0.0009) [2023-12-26 12:57:15,073][123091] Updated weights for policy 0, policy_version 1673077 (0.0007) [2023-12-26 12:57:15,147][123091] Updated weights for policy 0, policy_version 1673087 (0.0008) [2023-12-26 12:57:15,208][123091] Updated weights for policy 0, policy_version 1673097 (0.0008) [2023-12-26 12:57:15,285][123090] Updated weights for policy 1, policy_version 1661832 (0.0008) [2023-12-26 12:57:15,347][123090] Updated weights for policy 1, policy_version 1661842 (0.0008) [2023-12-26 12:57:15,399][123090] Updated weights for policy 1, policy_version 1661852 (0.0009) [2023-12-26 12:57:15,942][123091] Updated weights for policy 0, policy_version 1673107 (0.0007) [2023-12-26 12:57:15,989][123091] Updated weights for policy 0, policy_version 1673117 (0.0005) [2023-12-26 12:57:16,035][123091] Updated weights for policy 0, policy_version 1673127 (0.0005) [2023-12-26 12:57:16,212][123090] Updated weights for policy 1, policy_version 1661862 (0.0010) [2023-12-26 12:57:16,267][123090] Updated weights for policy 1, policy_version 1661872 (0.0010) [2023-12-26 12:57:16,323][123090] Updated weights for policy 1, policy_version 1661883 (0.0010) [2023-12-26 12:57:16,794][123091] Updated weights for policy 0, policy_version 1673137 (0.0005) [2023-12-26 12:57:16,860][123091] Updated weights for policy 0, policy_version 1673147 (0.0005) [2023-12-26 12:57:16,917][123091] Updated weights for policy 0, policy_version 1673157 (0.0006) [2023-12-26 12:57:16,973][123091] Updated weights for policy 0, policy_version 1673167 (0.0007) [2023-12-26 12:57:17,154][123090] Updated weights for policy 1, policy_version 1661894 (0.0009) [2023-12-26 12:57:17,202][123090] Updated weights for policy 1, policy_version 1661904 (0.0008) [2023-12-26 12:57:17,261][123090] Updated weights for policy 1, policy_version 1661914 (0.0009) [2023-12-26 12:57:17,739][123091] Updated weights for policy 0, policy_version 1673177 (0.0007) [2023-12-26 12:57:17,810][123091] Updated weights for policy 0, policy_version 1673187 (0.0006) [2023-12-26 12:57:17,881][123091] Updated weights for policy 0, policy_version 1673197 (0.0005) [2023-12-26 12:57:18,057][123090] Updated weights for policy 1, policy_version 1661924 (0.0007) [2023-12-26 12:57:18,108][123090] Updated weights for policy 1, policy_version 1661934 (0.0006) [2023-12-26 12:57:18,163][123090] Updated weights for policy 1, policy_version 1661944 (0.0005) [2023-12-26 12:57:18,572][123091] Updated weights for policy 0, policy_version 1673207 (0.0009) [2023-12-26 12:57:18,621][123091] Updated weights for policy 0, policy_version 1673217 (0.0010) [2023-12-26 12:57:18,673][123091] Updated weights for policy 0, policy_version 1673227 (0.0011) [2023-12-26 12:57:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 853811200. Throughput: 0: 8985.9, 1: 8887.4. Samples: 853821832. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:18,785][121949] Avg episode reward: [(0, '6014.364'), (1, '5242.312')] [2023-12-26 12:57:18,860][123090] Updated weights for policy 1, policy_version 1661954 (0.0006) [2023-12-26 12:57:18,920][123090] Updated weights for policy 1, policy_version 1661964 (0.0009) [2023-12-26 12:57:18,972][123090] Updated weights for policy 1, policy_version 1661974 (0.0008) [2023-12-26 12:57:19,020][123090] Updated weights for policy 1, policy_version 1661984 (0.0009) [2023-12-26 12:57:19,517][123091] Updated weights for policy 0, policy_version 1673237 (0.0011) [2023-12-26 12:57:19,585][123091] Updated weights for policy 0, policy_version 1673247 (0.0009) [2023-12-26 12:57:19,651][123091] Updated weights for policy 0, policy_version 1673257 (0.0007) [2023-12-26 12:57:19,954][123090] Updated weights for policy 1, policy_version 1661994 (0.0009) [2023-12-26 12:57:20,018][123090] Updated weights for policy 1, policy_version 1662004 (0.0010) [2023-12-26 12:57:20,081][123090] Updated weights for policy 1, policy_version 1662014 (0.0010) [2023-12-26 12:57:20,261][123091] Updated weights for policy 0, policy_version 1673267 (0.0006) [2023-12-26 12:57:20,340][123091] Updated weights for policy 0, policy_version 1673277 (0.0011) [2023-12-26 12:57:20,397][123091] Updated weights for policy 0, policy_version 1673287 (0.0007) [2023-12-26 12:57:20,801][123090] Updated weights for policy 1, policy_version 1662024 (0.0009) [2023-12-26 12:57:20,862][123090] Updated weights for policy 1, policy_version 1662034 (0.0009) [2023-12-26 12:57:20,923][123090] Updated weights for policy 1, policy_version 1662044 (0.0009) [2023-12-26 12:57:21,198][123091] Updated weights for policy 0, policy_version 1673297 (0.0010) [2023-12-26 12:57:21,268][123091] Updated weights for policy 0, policy_version 1673307 (0.0007) [2023-12-26 12:57:21,337][123091] Updated weights for policy 0, policy_version 1673317 (0.0007) [2023-12-26 12:57:21,412][123091] Updated weights for policy 0, policy_version 1673327 (0.0010) [2023-12-26 12:57:21,814][123090] Updated weights for policy 1, policy_version 1662054 (0.0009) [2023-12-26 12:57:21,870][123090] Updated weights for policy 1, policy_version 1662064 (0.0009) [2023-12-26 12:57:21,922][123090] Updated weights for policy 1, policy_version 1662074 (0.0010) [2023-12-26 12:57:22,236][123091] Updated weights for policy 0, policy_version 1673337 (0.0006) [2023-12-26 12:57:22,303][123091] Updated weights for policy 0, policy_version 1673347 (0.0008) [2023-12-26 12:57:22,375][123091] Updated weights for policy 0, policy_version 1673357 (0.0009) [2023-12-26 12:57:22,776][123090] Updated weights for policy 1, policy_version 1662084 (0.0008) [2023-12-26 12:57:22,836][123090] Updated weights for policy 1, policy_version 1662094 (0.0006) [2023-12-26 12:57:22,893][123090] Updated weights for policy 1, policy_version 1662104 (0.0007) [2023-12-26 12:57:23,119][123091] Updated weights for policy 0, policy_version 1673367 (0.0007) [2023-12-26 12:57:23,192][123091] Updated weights for policy 0, policy_version 1673377 (0.0006) [2023-12-26 12:57:23,260][123091] Updated weights for policy 0, policy_version 1673387 (0.0005) [2023-12-26 12:57:23,763][123090] Updated weights for policy 1, policy_version 1662114 (0.0010) [2023-12-26 12:57:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 853893120. Throughput: 0: 8941.3, 1: 8852.7. Samples: 853872908. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:23,785][121949] Avg episode reward: [(0, '5899.418'), (1, '5383.069')] [2023-12-26 12:57:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001673392_428392448.pth... [2023-12-26 12:57:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001672368_428130304.pth [2023-12-26 12:57:23,816][123090] Updated weights for policy 1, policy_version 1662124 (0.0009) [2023-12-26 12:57:23,873][123090] Updated weights for policy 1, policy_version 1662134 (0.0009) [2023-12-26 12:57:23,927][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001662144_425508864.pth... [2023-12-26 12:57:23,927][123090] Updated weights for policy 1, policy_version 1662144 (0.0009) [2023-12-26 12:57:23,930][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001661056_425230336.pth [2023-12-26 12:57:24,021][123091] Updated weights for policy 0, policy_version 1673397 (0.0009) [2023-12-26 12:57:24,092][123091] Updated weights for policy 0, policy_version 1673407 (0.0011) [2023-12-26 12:57:24,163][123091] Updated weights for policy 0, policy_version 1673417 (0.0007) [2023-12-26 12:57:24,690][123090] Updated weights for policy 1, policy_version 1662154 (0.0009) [2023-12-26 12:57:24,754][123090] Updated weights for policy 1, policy_version 1662164 (0.0009) [2023-12-26 12:57:24,803][123090] Updated weights for policy 1, policy_version 1662174 (0.0009) [2023-12-26 12:57:24,989][123091] Updated weights for policy 0, policy_version 1673427 (0.0011) [2023-12-26 12:57:25,053][123091] Updated weights for policy 0, policy_version 1673437 (0.0011) [2023-12-26 12:57:25,111][123091] Updated weights for policy 0, policy_version 1673447 (0.0009) [2023-12-26 12:57:25,573][123090] Updated weights for policy 1, policy_version 1662184 (0.0006) [2023-12-26 12:57:25,646][123090] Updated weights for policy 1, policy_version 1662194 (0.0006) [2023-12-26 12:57:25,712][123090] Updated weights for policy 1, policy_version 1662204 (0.0005) [2023-12-26 12:57:25,937][123091] Updated weights for policy 0, policy_version 1673457 (0.0010) [2023-12-26 12:57:26,006][123091] Updated weights for policy 0, policy_version 1673467 (0.0006) [2023-12-26 12:57:26,076][123091] Updated weights for policy 0, policy_version 1673477 (0.0007) [2023-12-26 12:57:26,146][123091] Updated weights for policy 0, policy_version 1673487 (0.0010) [2023-12-26 12:57:26,346][123090] Updated weights for policy 1, policy_version 1662214 (0.0005) [2023-12-26 12:57:26,400][123090] Updated weights for policy 1, policy_version 1662224 (0.0005) [2023-12-26 12:57:26,446][123090] Updated weights for policy 1, policy_version 1662234 (0.0005) [2023-12-26 12:57:26,858][123091] Updated weights for policy 0, policy_version 1673497 (0.0006) [2023-12-26 12:57:26,916][123091] Updated weights for policy 0, policy_version 1673507 (0.0005) [2023-12-26 12:57:26,977][123091] Updated weights for policy 0, policy_version 1673517 (0.0005) [2023-12-26 12:57:27,135][123090] Updated weights for policy 1, policy_version 1662244 (0.0006) [2023-12-26 12:57:27,209][123090] Updated weights for policy 1, policy_version 1662254 (0.0007) [2023-12-26 12:57:27,280][123090] Updated weights for policy 1, policy_version 1662264 (0.0006) [2023-12-26 12:57:27,607][123091] Updated weights for policy 0, policy_version 1673527 (0.0005) [2023-12-26 12:57:27,656][123091] Updated weights for policy 0, policy_version 1673537 (0.0007) [2023-12-26 12:57:27,704][123091] Updated weights for policy 0, policy_version 1673547 (0.0005) [2023-12-26 12:57:27,941][123090] Updated weights for policy 1, policy_version 1662274 (0.0006) [2023-12-26 12:57:28,002][123090] Updated weights for policy 1, policy_version 1662284 (0.0005) [2023-12-26 12:57:28,061][123090] Updated weights for policy 1, policy_version 1662294 (0.0005) [2023-12-26 12:57:28,120][123090] Updated weights for policy 1, policy_version 1662304 (0.0005) [2023-12-26 12:57:28,398][123091] Updated weights for policy 0, policy_version 1673557 (0.0008) [2023-12-26 12:57:28,456][123091] Updated weights for policy 0, policy_version 1673567 (0.0010) [2023-12-26 12:57:28,519][123091] Updated weights for policy 0, policy_version 1673577 (0.0010) [2023-12-26 12:57:28,729][123090] Updated weights for policy 1, policy_version 1662314 (0.0008) [2023-12-26 12:57:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 853991424. Throughput: 0: 9015.7, 1: 9008.3. Samples: 853984716. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:28,784][121949] Avg episode reward: [(0, '5751.517'), (1, '5394.419')] [2023-12-26 12:57:28,798][123090] Updated weights for policy 1, policy_version 1662324 (0.0008) [2023-12-26 12:57:28,863][123090] Updated weights for policy 1, policy_version 1662334 (0.0009) [2023-12-26 12:57:29,377][123091] Updated weights for policy 0, policy_version 1673587 (0.0008) [2023-12-26 12:57:29,443][123091] Updated weights for policy 0, policy_version 1673597 (0.0006) [2023-12-26 12:57:29,503][123091] Updated weights for policy 0, policy_version 1673607 (0.0006) [2023-12-26 12:57:29,662][123090] Updated weights for policy 1, policy_version 1662344 (0.0009) [2023-12-26 12:57:29,724][123090] Updated weights for policy 1, policy_version 1662354 (0.0010) [2023-12-26 12:57:29,781][123090] Updated weights for policy 1, policy_version 1662364 (0.0009) [2023-12-26 12:57:30,236][123091] Updated weights for policy 0, policy_version 1673617 (0.0009) [2023-12-26 12:57:30,301][123091] Updated weights for policy 0, policy_version 1673627 (0.0008) [2023-12-26 12:57:30,365][123091] Updated weights for policy 0, policy_version 1673637 (0.0008) [2023-12-26 12:57:30,426][123091] Updated weights for policy 0, policy_version 1673647 (0.0009) [2023-12-26 12:57:30,673][123090] Updated weights for policy 1, policy_version 1662374 (0.0009) [2023-12-26 12:57:30,738][123090] Updated weights for policy 1, policy_version 1662384 (0.0009) [2023-12-26 12:57:30,798][123090] Updated weights for policy 1, policy_version 1662394 (0.0009) [2023-12-26 12:57:31,203][123091] Updated weights for policy 0, policy_version 1673657 (0.0011) [2023-12-26 12:57:31,267][123091] Updated weights for policy 0, policy_version 1673667 (0.0010) [2023-12-26 12:57:31,322][123091] Updated weights for policy 0, policy_version 1673677 (0.0008) [2023-12-26 12:57:31,655][123090] Updated weights for policy 1, policy_version 1662404 (0.0008) [2023-12-26 12:57:31,724][123090] Updated weights for policy 1, policy_version 1662414 (0.0007) [2023-12-26 12:57:31,794][123090] Updated weights for policy 1, policy_version 1662424 (0.0006) [2023-12-26 12:57:32,118][123091] Updated weights for policy 0, policy_version 1673687 (0.0008) [2023-12-26 12:57:32,184][123091] Updated weights for policy 0, policy_version 1673697 (0.0011) [2023-12-26 12:57:32,247][123091] Updated weights for policy 0, policy_version 1673707 (0.0010) [2023-12-26 12:57:32,518][123090] Updated weights for policy 1, policy_version 1662434 (0.0006) [2023-12-26 12:57:32,588][123090] Updated weights for policy 1, policy_version 1662444 (0.0009) [2023-12-26 12:57:32,660][123090] Updated weights for policy 1, policy_version 1662454 (0.0006) [2023-12-26 12:57:32,726][123090] Updated weights for policy 1, policy_version 1662464 (0.0010) [2023-12-26 12:57:32,995][123091] Updated weights for policy 0, policy_version 1673717 (0.0008) [2023-12-26 12:57:33,053][123091] Updated weights for policy 0, policy_version 1673727 (0.0010) [2023-12-26 12:57:33,104][123091] Updated weights for policy 0, policy_version 1673737 (0.0010) [2023-12-26 12:57:33,444][123090] Updated weights for policy 1, policy_version 1662474 (0.0008) [2023-12-26 12:57:33,499][123090] Updated weights for policy 1, policy_version 1662484 (0.0009) [2023-12-26 12:57:33,556][123090] Updated weights for policy 1, policy_version 1662494 (0.0009) [2023-12-26 12:57:33,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 854081536. Throughput: 0: 8965.8, 1: 9066.9. Samples: 854093640. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:33,785][121949] Avg episode reward: [(0, '5565.219'), (1, '5538.321')] [2023-12-26 12:57:33,926][123091] Updated weights for policy 0, policy_version 1673747 (0.0010) [2023-12-26 12:57:33,980][123091] Updated weights for policy 0, policy_version 1673757 (0.0010) [2023-12-26 12:57:34,037][123091] Updated weights for policy 0, policy_version 1673767 (0.0010) [2023-12-26 12:57:34,394][123090] Updated weights for policy 1, policy_version 1662504 (0.0006) [2023-12-26 12:57:34,468][123090] Updated weights for policy 1, policy_version 1662514 (0.0008) [2023-12-26 12:57:34,535][123090] Updated weights for policy 1, policy_version 1662524 (0.0010) [2023-12-26 12:57:34,795][123091] Updated weights for policy 0, policy_version 1673777 (0.0010) [2023-12-26 12:57:34,860][123091] Updated weights for policy 0, policy_version 1673787 (0.0010) [2023-12-26 12:57:34,926][123091] Updated weights for policy 0, policy_version 1673797 (0.0006) [2023-12-26 12:57:34,989][123091] Updated weights for policy 0, policy_version 1673807 (0.0005) [2023-12-26 12:57:35,375][123090] Updated weights for policy 1, policy_version 1662534 (0.0010) [2023-12-26 12:57:35,435][123090] Updated weights for policy 1, policy_version 1662544 (0.0009) [2023-12-26 12:57:35,503][123090] Updated weights for policy 1, policy_version 1662554 (0.0008) [2023-12-26 12:57:35,734][123091] Updated weights for policy 0, policy_version 1673817 (0.0005) [2023-12-26 12:57:35,802][123091] Updated weights for policy 0, policy_version 1673827 (0.0006) [2023-12-26 12:57:35,869][123091] Updated weights for policy 0, policy_version 1673837 (0.0009) [2023-12-26 12:57:36,417][123090] Updated weights for policy 1, policy_version 1662564 (0.0008) [2023-12-26 12:57:36,435][123091] Updated weights for policy 0, policy_version 1673847 (0.0006) [2023-12-26 12:57:36,484][123090] Updated weights for policy 1, policy_version 1662574 (0.0010) [2023-12-26 12:57:36,496][123091] Updated weights for policy 0, policy_version 1673857 (0.0008) [2023-12-26 12:57:36,545][123090] Updated weights for policy 1, policy_version 1662584 (0.0011) [2023-12-26 12:57:36,560][123091] Updated weights for policy 0, policy_version 1673867 (0.0007) [2023-12-26 12:57:37,335][123091] Updated weights for policy 0, policy_version 1673877 (0.0010) [2023-12-26 12:57:37,388][123091] Updated weights for policy 0, policy_version 1673887 (0.0011) [2023-12-26 12:57:37,411][123090] Updated weights for policy 1, policy_version 1662594 (0.0007) [2023-12-26 12:57:37,446][123091] Updated weights for policy 0, policy_version 1673897 (0.0013) [2023-12-26 12:57:37,466][123090] Updated weights for policy 1, policy_version 1662604 (0.0007) [2023-12-26 12:57:37,526][123090] Updated weights for policy 1, policy_version 1662614 (0.0008) [2023-12-26 12:57:37,589][123090] Updated weights for policy 1, policy_version 1662624 (0.0009) [2023-12-26 12:57:38,290][123091] Updated weights for policy 0, policy_version 1673907 (0.0011) [2023-12-26 12:57:38,359][123091] Updated weights for policy 0, policy_version 1673917 (0.0009) [2023-12-26 12:57:38,431][123091] Updated weights for policy 0, policy_version 1673927 (0.0007) [2023-12-26 12:57:38,457][123090] Updated weights for policy 1, policy_version 1662634 (0.0006) [2023-12-26 12:57:38,520][123090] Updated weights for policy 1, policy_version 1662644 (0.0009) [2023-12-26 12:57:38,574][123090] Updated weights for policy 1, policy_version 1662654 (0.0009) [2023-12-26 12:57:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 854171648. Throughput: 0: 9006.5, 1: 9068.2. Samples: 854146812. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:38,785][121949] Avg episode reward: [(0, '5821.156'), (1, '5564.935')] [2023-12-26 12:57:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001673936_428531712.pth... [2023-12-26 12:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001662656_425639936.pth... [2023-12-26 12:57:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001672880_428261376.pth [2023-12-26 12:57:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001661632_425377792.pth [2023-12-26 12:57:38,991][123091] Updated weights for policy 0, policy_version 1673937 (0.0006) [2023-12-26 12:57:39,056][123091] Updated weights for policy 0, policy_version 1673947 (0.0005) [2023-12-26 12:57:39,118][123091] Updated weights for policy 0, policy_version 1673957 (0.0005) [2023-12-26 12:57:39,183][123091] Updated weights for policy 0, policy_version 1673967 (0.0005) [2023-12-26 12:57:39,477][123090] Updated weights for policy 1, policy_version 1662664 (0.0009) [2023-12-26 12:57:39,538][123090] Updated weights for policy 1, policy_version 1662674 (0.0009) [2023-12-26 12:57:39,608][123090] Updated weights for policy 1, policy_version 1662684 (0.0009) [2023-12-26 12:57:39,874][123091] Updated weights for policy 0, policy_version 1673977 (0.0007) [2023-12-26 12:57:39,938][123091] Updated weights for policy 0, policy_version 1673987 (0.0006) [2023-12-26 12:57:40,008][123091] Updated weights for policy 0, policy_version 1673997 (0.0007) [2023-12-26 12:57:40,536][123090] Updated weights for policy 1, policy_version 1662694 (0.0008) [2023-12-26 12:57:40,605][123090] Updated weights for policy 1, policy_version 1662704 (0.0006) [2023-12-26 12:57:40,675][123090] Updated weights for policy 1, policy_version 1662714 (0.0006) [2023-12-26 12:57:40,697][123091] Updated weights for policy 0, policy_version 1674007 (0.0009) [2023-12-26 12:57:40,756][123091] Updated weights for policy 0, policy_version 1674017 (0.0009) [2023-12-26 12:57:40,813][123091] Updated weights for policy 0, policy_version 1674027 (0.0009) [2023-12-26 12:57:41,312][123090] Updated weights for policy 1, policy_version 1662724 (0.0007) [2023-12-26 12:57:41,382][123090] Updated weights for policy 1, policy_version 1662734 (0.0009) [2023-12-26 12:57:41,441][123090] Updated weights for policy 1, policy_version 1662744 (0.0009) [2023-12-26 12:57:41,653][123091] Updated weights for policy 0, policy_version 1674037 (0.0009) [2023-12-26 12:57:41,719][123091] Updated weights for policy 0, policy_version 1674047 (0.0007) [2023-12-26 12:57:41,789][123091] Updated weights for policy 0, policy_version 1674057 (0.0008) [2023-12-26 12:57:42,348][123090] Updated weights for policy 1, policy_version 1662754 (0.0009) [2023-12-26 12:57:42,424][123090] Updated weights for policy 1, policy_version 1662764 (0.0006) [2023-12-26 12:57:42,494][123090] Updated weights for policy 1, policy_version 1662774 (0.0006) [2023-12-26 12:57:42,562][123090] Updated weights for policy 1, policy_version 1662784 (0.0006) [2023-12-26 12:57:42,582][123091] Updated weights for policy 0, policy_version 1674067 (0.0008) [2023-12-26 12:57:42,639][123091] Updated weights for policy 0, policy_version 1674077 (0.0009) [2023-12-26 12:57:42,700][123091] Updated weights for policy 0, policy_version 1674087 (0.0009) [2023-12-26 12:57:43,273][123090] Updated weights for policy 1, policy_version 1662794 (0.0006) [2023-12-26 12:57:43,333][123090] Updated weights for policy 1, policy_version 1662804 (0.0008) [2023-12-26 12:57:43,397][123090] Updated weights for policy 1, policy_version 1662814 (0.0006) [2023-12-26 12:57:43,571][123091] Updated weights for policy 0, policy_version 1674097 (0.0009) [2023-12-26 12:57:43,631][123091] Updated weights for policy 0, policy_version 1674107 (0.0009) [2023-12-26 12:57:43,691][123091] Updated weights for policy 0, policy_version 1674117 (0.0009) [2023-12-26 12:57:43,754][123091] Updated weights for policy 0, policy_version 1674127 (0.0009) [2023-12-26 12:57:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 854261760. Throughput: 0: 9072.2, 1: 8910.1. Samples: 854250424. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:43,785][121949] Avg episode reward: [(0, '5957.458'), (1, '5761.342')] [2023-12-26 12:57:44,185][123090] Updated weights for policy 1, policy_version 1662824 (0.0008) [2023-12-26 12:57:44,231][123090] Updated weights for policy 1, policy_version 1662834 (0.0007) [2023-12-26 12:57:44,286][123090] Updated weights for policy 1, policy_version 1662844 (0.0005) [2023-12-26 12:57:44,629][123091] Updated weights for policy 0, policy_version 1674138 (0.0010) [2023-12-26 12:57:44,683][123091] Updated weights for policy 0, policy_version 1674149 (0.0010) [2023-12-26 12:57:44,738][123091] Updated weights for policy 0, policy_version 1674160 (0.0010) [2023-12-26 12:57:45,010][123090] Updated weights for policy 1, policy_version 1662854 (0.0008) [2023-12-26 12:57:45,071][123090] Updated weights for policy 1, policy_version 1662864 (0.0010) [2023-12-26 12:57:45,130][123090] Updated weights for policy 1, policy_version 1662874 (0.0007) [2023-12-26 12:57:45,661][123091] Updated weights for policy 0, policy_version 1674170 (0.0010) [2023-12-26 12:57:45,721][123091] Updated weights for policy 0, policy_version 1674180 (0.0010) [2023-12-26 12:57:45,787][123091] Updated weights for policy 0, policy_version 1674190 (0.0009) [2023-12-26 12:57:45,945][123090] Updated weights for policy 1, policy_version 1662884 (0.0005) [2023-12-26 12:57:45,998][123090] Updated weights for policy 1, policy_version 1662894 (0.0005) [2023-12-26 12:57:46,048][123090] Updated weights for policy 1, policy_version 1662904 (0.0007) [2023-12-26 12:57:46,636][123091] Updated weights for policy 0, policy_version 1674200 (0.0011) [2023-12-26 12:57:46,686][123091] Updated weights for policy 0, policy_version 1674210 (0.0010) [2023-12-26 12:57:46,735][123091] Updated weights for policy 0, policy_version 1674220 (0.0010) [2023-12-26 12:57:46,849][123090] Updated weights for policy 1, policy_version 1662914 (0.0009) [2023-12-26 12:57:46,913][123090] Updated weights for policy 1, policy_version 1662924 (0.0010) [2023-12-26 12:57:46,970][123090] Updated weights for policy 1, policy_version 1662934 (0.0009) [2023-12-26 12:57:47,030][123090] Updated weights for policy 1, policy_version 1662944 (0.0008) [2023-12-26 12:57:47,566][123091] Updated weights for policy 0, policy_version 1674230 (0.0009) [2023-12-26 12:57:47,620][123091] Updated weights for policy 0, policy_version 1674240 (0.0010) [2023-12-26 12:57:47,669][123091] Updated weights for policy 0, policy_version 1674250 (0.0008) [2023-12-26 12:57:47,869][123090] Updated weights for policy 1, policy_version 1662954 (0.0009) [2023-12-26 12:57:47,917][123090] Updated weights for policy 1, policy_version 1662964 (0.0009) [2023-12-26 12:57:47,965][123090] Updated weights for policy 1, policy_version 1662974 (0.0009) [2023-12-26 12:57:48,506][123091] Updated weights for policy 0, policy_version 1674260 (0.0009) [2023-12-26 12:57:48,558][123091] Updated weights for policy 0, policy_version 1674270 (0.0009) [2023-12-26 12:57:48,611][123091] Updated weights for policy 0, policy_version 1674280 (0.0009) [2023-12-26 12:57:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 854343680. Throughput: 0: 9041.0, 1: 8869.7. Samples: 854353616. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:48,784][121949] Avg episode reward: [(0, '5579.818'), (1, '5865.575')] [2023-12-26 12:57:48,858][123090] Updated weights for policy 1, policy_version 1662984 (0.0009) [2023-12-26 12:57:48,910][123090] Updated weights for policy 1, policy_version 1662994 (0.0009) [2023-12-26 12:57:48,973][123090] Updated weights for policy 1, policy_version 1663004 (0.0010) [2023-12-26 12:57:49,455][123091] Updated weights for policy 0, policy_version 1674290 (0.0010) [2023-12-26 12:57:49,511][123091] Updated weights for policy 0, policy_version 1674300 (0.0010) [2023-12-26 12:57:49,560][123091] Updated weights for policy 0, policy_version 1674310 (0.0010) [2023-12-26 12:57:49,610][123091] Updated weights for policy 0, policy_version 1674320 (0.0009) [2023-12-26 12:57:49,827][123090] Updated weights for policy 1, policy_version 1663014 (0.0007) [2023-12-26 12:57:49,893][123090] Updated weights for policy 1, policy_version 1663024 (0.0007) [2023-12-26 12:57:49,965][123090] Updated weights for policy 1, policy_version 1663034 (0.0008) [2023-12-26 12:57:50,497][123091] Updated weights for policy 0, policy_version 1674330 (0.0006) [2023-12-26 12:57:50,560][123091] Updated weights for policy 0, policy_version 1674340 (0.0006) [2023-12-26 12:57:50,625][123091] Updated weights for policy 0, policy_version 1674350 (0.0007) [2023-12-26 12:57:50,803][123090] Updated weights for policy 1, policy_version 1663044 (0.0008) [2023-12-26 12:57:50,871][123090] Updated weights for policy 1, policy_version 1663054 (0.0009) [2023-12-26 12:57:50,947][123090] Updated weights for policy 1, policy_version 1663064 (0.0009) [2023-12-26 12:57:51,389][123091] Updated weights for policy 0, policy_version 1674360 (0.0009) [2023-12-26 12:57:51,441][123091] Updated weights for policy 0, policy_version 1674370 (0.0011) [2023-12-26 12:57:51,498][123091] Updated weights for policy 0, policy_version 1674380 (0.0011) [2023-12-26 12:57:51,708][123090] Updated weights for policy 1, policy_version 1663074 (0.0006) [2023-12-26 12:57:51,775][123090] Updated weights for policy 1, policy_version 1663084 (0.0009) [2023-12-26 12:57:51,833][123090] Updated weights for policy 1, policy_version 1663094 (0.0009) [2023-12-26 12:57:51,894][123090] Updated weights for policy 1, policy_version 1663104 (0.0009) [2023-12-26 12:57:52,360][123091] Updated weights for policy 0, policy_version 1674390 (0.0011) [2023-12-26 12:57:52,424][123091] Updated weights for policy 0, policy_version 1674400 (0.0011) [2023-12-26 12:57:52,487][123091] Updated weights for policy 0, policy_version 1674410 (0.0011) [2023-12-26 12:57:52,674][123090] Updated weights for policy 1, policy_version 1663114 (0.0009) [2023-12-26 12:57:52,743][123090] Updated weights for policy 1, policy_version 1663124 (0.0009) [2023-12-26 12:57:52,804][123090] Updated weights for policy 1, policy_version 1663134 (0.0009) [2023-12-26 12:57:53,294][123091] Updated weights for policy 0, policy_version 1674420 (0.0011) [2023-12-26 12:57:53,352][123091] Updated weights for policy 0, policy_version 1674431 (0.0011) [2023-12-26 12:57:53,408][123091] Updated weights for policy 0, policy_version 1674441 (0.0010) [2023-12-26 12:57:53,602][123090] Updated weights for policy 1, policy_version 1663144 (0.0006) [2023-12-26 12:57:53,652][123090] Updated weights for policy 1, policy_version 1663154 (0.0005) [2023-12-26 12:57:53,706][123090] Updated weights for policy 1, policy_version 1663164 (0.0007) [2023-12-26 12:57:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 854433792. Throughput: 0: 9009.7, 1: 8823.4. Samples: 854406548. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:53,785][121949] Avg episode reward: [(0, '5609.435'), (1, '5849.743')] [2023-12-26 12:57:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001674448_428662784.pth... [2023-12-26 12:57:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001663168_425771008.pth... [2023-12-26 12:57:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001673392_428392448.pth [2023-12-26 12:57:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001662144_425508864.pth [2023-12-26 12:57:54,195][123091] Updated weights for policy 0, policy_version 1674451 (0.0010) [2023-12-26 12:57:54,253][123091] Updated weights for policy 0, policy_version 1674461 (0.0010) [2023-12-26 12:57:54,318][123091] Updated weights for policy 0, policy_version 1674471 (0.0010) [2023-12-26 12:57:54,517][123090] Updated weights for policy 1, policy_version 1663174 (0.0009) [2023-12-26 12:57:54,586][123090] Updated weights for policy 1, policy_version 1663184 (0.0009) [2023-12-26 12:57:54,658][123090] Updated weights for policy 1, policy_version 1663194 (0.0007) [2023-12-26 12:57:55,139][123091] Updated weights for policy 0, policy_version 1674481 (0.0010) [2023-12-26 12:57:55,202][123091] Updated weights for policy 0, policy_version 1674491 (0.0011) [2023-12-26 12:57:55,261][123091] Updated weights for policy 0, policy_version 1674501 (0.0010) [2023-12-26 12:57:55,320][123091] Updated weights for policy 0, policy_version 1674511 (0.0010) [2023-12-26 12:57:55,354][123090] Updated weights for policy 1, policy_version 1663204 (0.0007) [2023-12-26 12:57:55,409][123090] Updated weights for policy 1, policy_version 1663214 (0.0006) [2023-12-26 12:57:55,470][123090] Updated weights for policy 1, policy_version 1663224 (0.0005) [2023-12-26 12:57:56,125][123091] Updated weights for policy 0, policy_version 1674521 (0.0010) [2023-12-26 12:57:56,169][123091] Updated weights for policy 0, policy_version 1674531 (0.0010) [2023-12-26 12:57:56,209][123090] Updated weights for policy 1, policy_version 1663234 (0.0005) [2023-12-26 12:57:56,231][123091] Updated weights for policy 0, policy_version 1674541 (0.0011) [2023-12-26 12:57:56,271][123090] Updated weights for policy 1, policy_version 1663244 (0.0007) [2023-12-26 12:57:56,343][123090] Updated weights for policy 1, policy_version 1663254 (0.0005) [2023-12-26 12:57:56,414][123090] Updated weights for policy 1, policy_version 1663264 (0.0005) [2023-12-26 12:57:57,056][123090] Updated weights for policy 1, policy_version 1663274 (0.0009) [2023-12-26 12:57:57,058][123091] Updated weights for policy 0, policy_version 1674551 (0.0010) [2023-12-26 12:57:57,111][123090] Updated weights for policy 1, policy_version 1663284 (0.0010) [2023-12-26 12:57:57,112][123091] Updated weights for policy 0, policy_version 1674561 (0.0010) [2023-12-26 12:57:57,170][123090] Updated weights for policy 1, policy_version 1663294 (0.0009) [2023-12-26 12:57:57,177][123091] Updated weights for policy 0, policy_version 1674571 (0.0010) [2023-12-26 12:57:57,850][123090] Updated weights for policy 1, policy_version 1663304 (0.0005) [2023-12-26 12:57:57,898][123090] Updated weights for policy 1, policy_version 1663314 (0.0005) [2023-12-26 12:57:57,955][123090] Updated weights for policy 1, policy_version 1663324 (0.0010) [2023-12-26 12:57:57,994][123091] Updated weights for policy 0, policy_version 1674581 (0.0010) [2023-12-26 12:57:58,045][123091] Updated weights for policy 0, policy_version 1674591 (0.0010) [2023-12-26 12:57:58,117][123091] Updated weights for policy 0, policy_version 1674601 (0.0011) [2023-12-26 12:57:58,709][123090] Updated weights for policy 1, policy_version 1663334 (0.0009) [2023-12-26 12:57:58,783][123090] Updated weights for policy 1, policy_version 1663344 (0.0008) [2023-12-26 12:57:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 854515712. Throughput: 0: 8979.4, 1: 8846.2. Samples: 854514612. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:57:58,785][121949] Avg episode reward: [(0, '5898.130'), (1, '5741.466')] [2023-12-26 12:57:58,856][123090] Updated weights for policy 1, policy_version 1663354 (0.0008) [2023-12-26 12:57:58,963][123091] Updated weights for policy 0, policy_version 1674611 (0.0011) [2023-12-26 12:57:59,007][123091] Updated weights for policy 0, policy_version 1674621 (0.0010) [2023-12-26 12:57:59,061][123091] Updated weights for policy 0, policy_version 1674631 (0.0010) [2023-12-26 12:57:59,584][123090] Updated weights for policy 1, policy_version 1663364 (0.0008) [2023-12-26 12:57:59,646][123090] Updated weights for policy 1, policy_version 1663374 (0.0010) [2023-12-26 12:57:59,715][123090] Updated weights for policy 1, policy_version 1663384 (0.0010) [2023-12-26 12:57:59,835][123091] Updated weights for policy 0, policy_version 1674641 (0.0011) [2023-12-26 12:57:59,901][123091] Updated weights for policy 0, policy_version 1674651 (0.0011) [2023-12-26 12:57:59,970][123091] Updated weights for policy 0, policy_version 1674661 (0.0011) [2023-12-26 12:58:00,034][123091] Updated weights for policy 0, policy_version 1674671 (0.0011) [2023-12-26 12:58:00,543][123090] Updated weights for policy 1, policy_version 1663394 (0.0010) [2023-12-26 12:58:00,601][123090] Updated weights for policy 1, policy_version 1663404 (0.0010) [2023-12-26 12:58:00,662][123090] Updated weights for policy 1, policy_version 1663414 (0.0010) [2023-12-26 12:58:00,712][123090] Updated weights for policy 1, policy_version 1663424 (0.0010) [2023-12-26 12:58:00,832][123091] Updated weights for policy 0, policy_version 1674681 (0.0010) [2023-12-26 12:58:00,904][123091] Updated weights for policy 0, policy_version 1674691 (0.0009) [2023-12-26 12:58:00,970][123091] Updated weights for policy 0, policy_version 1674701 (0.0005) [2023-12-26 12:58:01,553][123090] Updated weights for policy 1, policy_version 1663434 (0.0009) [2023-12-26 12:58:01,602][123090] Updated weights for policy 1, policy_version 1663444 (0.0008) [2023-12-26 12:58:01,667][123090] Updated weights for policy 1, policy_version 1663454 (0.0009) [2023-12-26 12:58:01,748][123091] Updated weights for policy 0, policy_version 1674711 (0.0009) [2023-12-26 12:58:01,807][123091] Updated weights for policy 0, policy_version 1674721 (0.0010) [2023-12-26 12:58:01,862][123091] Updated weights for policy 0, policy_version 1674731 (0.0010) [2023-12-26 12:58:02,534][123090] Updated weights for policy 1, policy_version 1663464 (0.0009) [2023-12-26 12:58:02,582][123090] Updated weights for policy 1, policy_version 1663474 (0.0009) [2023-12-26 12:58:02,631][123090] Updated weights for policy 1, policy_version 1663484 (0.0008) [2023-12-26 12:58:02,704][123091] Updated weights for policy 0, policy_version 1674741 (0.0010) [2023-12-26 12:58:02,755][123091] Updated weights for policy 0, policy_version 1674751 (0.0010) [2023-12-26 12:58:02,809][123091] Updated weights for policy 0, policy_version 1674761 (0.0010) [2023-12-26 12:58:03,412][123090] Updated weights for policy 1, policy_version 1663494 (0.0007) [2023-12-26 12:58:03,472][123090] Updated weights for policy 1, policy_version 1663504 (0.0005) [2023-12-26 12:58:03,536][123090] Updated weights for policy 1, policy_version 1663514 (0.0005) [2023-12-26 12:58:03,586][123091] Updated weights for policy 0, policy_version 1674771 (0.0010) [2023-12-26 12:58:03,633][123091] Updated weights for policy 0, policy_version 1674781 (0.0010) [2023-12-26 12:58:03,684][123091] Updated weights for policy 0, policy_version 1674791 (0.0010) [2023-12-26 12:58:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 854614016. Throughput: 0: 8908.9, 1: 8845.8. Samples: 854620800. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:58:03,785][121949] Avg episode reward: [(0, '5888.906'), (1, '5847.180')] [2023-12-26 12:58:04,213][123090] Updated weights for policy 1, policy_version 1663524 (0.0007) [2023-12-26 12:58:04,281][123090] Updated weights for policy 1, policy_version 1663534 (0.0009) [2023-12-26 12:58:04,350][123090] Updated weights for policy 1, policy_version 1663544 (0.0010) [2023-12-26 12:58:04,502][123091] Updated weights for policy 0, policy_version 1674801 (0.0010) [2023-12-26 12:58:04,566][123091] Updated weights for policy 0, policy_version 1674811 (0.0009) [2023-12-26 12:58:04,626][123091] Updated weights for policy 0, policy_version 1674821 (0.0010) [2023-12-26 12:58:04,695][123091] Updated weights for policy 0, policy_version 1674831 (0.0010) [2023-12-26 12:58:05,135][123090] Updated weights for policy 1, policy_version 1663554 (0.0009) [2023-12-26 12:58:05,195][123090] Updated weights for policy 1, policy_version 1663564 (0.0008) [2023-12-26 12:58:05,243][123090] Updated weights for policy 1, policy_version 1663574 (0.0009) [2023-12-26 12:58:05,297][123090] Updated weights for policy 1, policy_version 1663584 (0.0008) [2023-12-26 12:58:05,492][123091] Updated weights for policy 0, policy_version 1674841 (0.0006) [2023-12-26 12:58:05,548][123091] Updated weights for policy 0, policy_version 1674851 (0.0006) [2023-12-26 12:58:05,607][123091] Updated weights for policy 0, policy_version 1674861 (0.0006) [2023-12-26 12:58:06,067][123090] Updated weights for policy 1, policy_version 1663594 (0.0005) [2023-12-26 12:58:06,132][123090] Updated weights for policy 1, policy_version 1663604 (0.0008) [2023-12-26 12:58:06,190][123090] Updated weights for policy 1, policy_version 1663614 (0.0010) [2023-12-26 12:58:06,296][123091] Updated weights for policy 0, policy_version 1674871 (0.0006) [2023-12-26 12:58:06,368][123091] Updated weights for policy 0, policy_version 1674881 (0.0008) [2023-12-26 12:58:06,440][123091] Updated weights for policy 0, policy_version 1674891 (0.0011) [2023-12-26 12:58:07,057][123090] Updated weights for policy 1, policy_version 1663624 (0.0009) [2023-12-26 12:58:07,118][123090] Updated weights for policy 1, policy_version 1663634 (0.0009) [2023-12-26 12:58:07,182][123090] Updated weights for policy 1, policy_version 1663644 (0.0008) [2023-12-26 12:58:07,188][123091] Updated weights for policy 0, policy_version 1674901 (0.0009) [2023-12-26 12:58:07,243][123091] Updated weights for policy 0, policy_version 1674911 (0.0010) [2023-12-26 12:58:07,299][123091] Updated weights for policy 0, policy_version 1674921 (0.0010) [2023-12-26 12:58:07,959][123091] Updated weights for policy 0, policy_version 1674931 (0.0005) [2023-12-26 12:58:07,991][123090] Updated weights for policy 1, policy_version 1663654 (0.0005) [2023-12-26 12:58:08,030][123091] Updated weights for policy 0, policy_version 1674941 (0.0010) [2023-12-26 12:58:08,059][123090] Updated weights for policy 1, policy_version 1663664 (0.0009) [2023-12-26 12:58:08,094][123091] Updated weights for policy 0, policy_version 1674951 (0.0009) [2023-12-26 12:58:08,115][123090] Updated weights for policy 1, policy_version 1663674 (0.0010) [2023-12-26 12:58:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 854695936. Throughput: 0: 8930.3, 1: 8909.3. Samples: 854675692. Policy #0 lag: (min: 31.0, avg: 35.0, max: 63.0) [2023-12-26 12:58:08,785][121949] Avg episode reward: [(0, '5840.368'), (1, '6013.453')] [2023-12-26 12:58:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001674960_428793856.pth... [2023-12-26 12:58:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001663680_425902080.pth... [2023-12-26 12:58:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001673936_428531712.pth [2023-12-26 12:58:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001662656_425639936.pth [2023-12-26 12:58:08,827][123091] Updated weights for policy 0, policy_version 1674961 (0.0005) [2023-12-26 12:58:08,896][123091] Updated weights for policy 0, policy_version 1674971 (0.0005) [2023-12-26 12:58:08,939][123090] Updated weights for policy 1, policy_version 1663684 (0.0011) [2023-12-26 12:58:08,955][123091] Updated weights for policy 0, policy_version 1674981 (0.0008) [2023-12-26 12:58:09,002][123091] Updated weights for policy 0, policy_version 1674991 (0.0005) [2023-12-26 12:58:09,006][123090] Updated weights for policy 1, policy_version 1663694 (0.0011) [2023-12-26 12:58:09,077][123090] Updated weights for policy 1, policy_version 1663704 (0.0010) [2023-12-26 12:58:09,779][123091] Updated weights for policy 0, policy_version 1675001 (0.0014) [2023-12-26 12:58:09,847][123091] Updated weights for policy 0, policy_version 1675011 (0.0010) [2023-12-26 12:58:09,865][123090] Updated weights for policy 1, policy_version 1663714 (0.0010) [2023-12-26 12:58:09,913][123091] Updated weights for policy 0, policy_version 1675021 (0.0009) [2023-12-26 12:58:09,936][123090] Updated weights for policy 1, policy_version 1663725 (0.0009) [2023-12-26 12:58:09,993][123090] Updated weights for policy 1, policy_version 1663735 (0.0009) [2023-12-26 12:58:10,626][123091] Updated weights for policy 0, policy_version 1675031 (0.0007) [2023-12-26 12:58:10,685][123091] Updated weights for policy 0, policy_version 1675041 (0.0006) [2023-12-26 12:58:10,748][123091] Updated weights for policy 0, policy_version 1675051 (0.0005) [2023-12-26 12:58:10,896][123090] Updated weights for policy 1, policy_version 1663745 (0.0009) [2023-12-26 12:58:10,966][123090] Updated weights for policy 1, policy_version 1663755 (0.0009) [2023-12-26 12:58:11,037][123090] Updated weights for policy 1, policy_version 1663765 (0.0009) [2023-12-26 12:58:11,102][123090] Updated weights for policy 1, policy_version 1663775 (0.0008) [2023-12-26 12:58:11,480][123091] Updated weights for policy 0, policy_version 1675061 (0.0008) [2023-12-26 12:58:11,531][123091] Updated weights for policy 0, policy_version 1675071 (0.0009) [2023-12-26 12:58:11,582][123091] Updated weights for policy 0, policy_version 1675081 (0.0010) [2023-12-26 12:58:11,942][123090] Updated weights for policy 1, policy_version 1663785 (0.0006) [2023-12-26 12:58:12,012][123090] Updated weights for policy 1, policy_version 1663795 (0.0006) [2023-12-26 12:58:12,080][123090] Updated weights for policy 1, policy_version 1663805 (0.0007) [2023-12-26 12:58:12,523][123091] Updated weights for policy 0, policy_version 1675091 (0.0010) [2023-12-26 12:58:12,585][123091] Updated weights for policy 0, policy_version 1675101 (0.0009) [2023-12-26 12:58:12,651][123091] Updated weights for policy 0, policy_version 1675111 (0.0009) [2023-12-26 12:58:12,789][123090] Updated weights for policy 1, policy_version 1663815 (0.0009) [2023-12-26 12:58:12,858][123090] Updated weights for policy 1, policy_version 1663825 (0.0009) [2023-12-26 12:58:12,916][123090] Updated weights for policy 1, policy_version 1663835 (0.0006) [2023-12-26 12:58:13,484][123091] Updated weights for policy 0, policy_version 1675121 (0.0009) [2023-12-26 12:58:13,544][123091] Updated weights for policy 0, policy_version 1675131 (0.0009) [2023-12-26 12:58:13,559][123090] Updated weights for policy 1, policy_version 1663845 (0.0005) [2023-12-26 12:58:13,597][123091] Updated weights for policy 0, policy_version 1675141 (0.0008) [2023-12-26 12:58:13,613][123090] Updated weights for policy 1, policy_version 1663855 (0.0006) [2023-12-26 12:58:13,646][123091] Updated weights for policy 0, policy_version 1675151 (0.0006) [2023-12-26 12:58:13,672][123090] Updated weights for policy 1, policy_version 1663865 (0.0010) [2023-12-26 12:58:13,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 854794240. Throughput: 0: 8911.5, 1: 8791.6. Samples: 854781360. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:13,785][121949] Avg episode reward: [(0, '5678.614'), (1, '5971.519')] [2023-12-26 12:58:14,478][123090] Updated weights for policy 1, policy_version 1663875 (0.0009) [2023-12-26 12:58:14,517][123091] Updated weights for policy 0, policy_version 1675161 (0.0005) [2023-12-26 12:58:14,539][123090] Updated weights for policy 1, policy_version 1663885 (0.0008) [2023-12-26 12:58:14,586][123091] Updated weights for policy 0, policy_version 1675171 (0.0008) [2023-12-26 12:58:14,605][123090] Updated weights for policy 1, policy_version 1663895 (0.0009) [2023-12-26 12:58:14,650][123091] Updated weights for policy 0, policy_version 1675181 (0.0008) [2023-12-26 12:58:15,352][123091] Updated weights for policy 0, policy_version 1675191 (0.0010) [2023-12-26 12:58:15,447][123091] Updated weights for policy 0, policy_version 1675201 (0.0010) [2023-12-26 12:58:15,483][123090] Updated weights for policy 1, policy_version 1663905 (0.0008) [2023-12-26 12:58:15,505][123091] Updated weights for policy 0, policy_version 1675211 (0.0009) [2023-12-26 12:58:15,556][123090] Updated weights for policy 1, policy_version 1663915 (0.0005) [2023-12-26 12:58:15,636][123090] Updated weights for policy 1, policy_version 1663925 (0.0005) [2023-12-26 12:58:15,711][123090] Updated weights for policy 1, policy_version 1663935 (0.0007) [2023-12-26 12:58:16,362][123091] Updated weights for policy 0, policy_version 1675221 (0.0008) [2023-12-26 12:58:16,369][123090] Updated weights for policy 1, policy_version 1663945 (0.0007) [2023-12-26 12:58:16,424][123091] Updated weights for policy 0, policy_version 1675231 (0.0010) [2023-12-26 12:58:16,428][123090] Updated weights for policy 1, policy_version 1663955 (0.0005) [2023-12-26 12:58:16,477][123091] Updated weights for policy 0, policy_version 1675241 (0.0009) [2023-12-26 12:58:16,488][123090] Updated weights for policy 1, policy_version 1663965 (0.0005) [2023-12-26 12:58:17,270][123090] Updated weights for policy 1, policy_version 1663975 (0.0008) [2023-12-26 12:58:17,294][123091] Updated weights for policy 0, policy_version 1675251 (0.0009) [2023-12-26 12:58:17,331][123090] Updated weights for policy 1, policy_version 1663985 (0.0008) [2023-12-26 12:58:17,347][123091] Updated weights for policy 0, policy_version 1675261 (0.0009) [2023-12-26 12:58:17,385][123090] Updated weights for policy 1, policy_version 1663995 (0.0008) [2023-12-26 12:58:17,403][123091] Updated weights for policy 0, policy_version 1675271 (0.0008) [2023-12-26 12:58:18,208][123090] Updated weights for policy 1, policy_version 1664005 (0.0008) [2023-12-26 12:58:18,243][123091] Updated weights for policy 0, policy_version 1675281 (0.0010) [2023-12-26 12:58:18,269][123090] Updated weights for policy 1, policy_version 1664015 (0.0010) [2023-12-26 12:58:18,302][123091] Updated weights for policy 0, policy_version 1675291 (0.0007) [2023-12-26 12:58:18,326][123090] Updated weights for policy 1, policy_version 1664025 (0.0008) [2023-12-26 12:58:18,369][123091] Updated weights for policy 0, policy_version 1675301 (0.0009) [2023-12-26 12:58:18,432][123091] Updated weights for policy 0, policy_version 1675311 (0.0010) [2023-12-26 12:58:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 854876160. Throughput: 0: 8845.3, 1: 8779.5. Samples: 854886752. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:18,785][121949] Avg episode reward: [(0, '5689.915'), (1, '5921.735')] [2023-12-26 12:58:19,169][123090] Updated weights for policy 1, policy_version 1664035 (0.0009) [2023-12-26 12:58:19,224][123091] Updated weights for policy 0, policy_version 1675321 (0.0009) [2023-12-26 12:58:19,243][123090] Updated weights for policy 1, policy_version 1664045 (0.0008) [2023-12-26 12:58:19,296][123091] Updated weights for policy 0, policy_version 1675331 (0.0007) [2023-12-26 12:58:19,318][123090] Updated weights for policy 1, policy_version 1664055 (0.0007) [2023-12-26 12:58:19,366][123091] Updated weights for policy 0, policy_version 1675341 (0.0007) [2023-12-26 12:58:20,177][123090] Updated weights for policy 1, policy_version 1664065 (0.0010) [2023-12-26 12:58:20,191][123091] Updated weights for policy 0, policy_version 1675351 (0.0009) [2023-12-26 12:58:20,243][123090] Updated weights for policy 1, policy_version 1664075 (0.0010) [2023-12-26 12:58:20,258][123091] Updated weights for policy 0, policy_version 1675361 (0.0007) [2023-12-26 12:58:20,294][123090] Updated weights for policy 1, policy_version 1664085 (0.0008) [2023-12-26 12:58:20,324][123091] Updated weights for policy 0, policy_version 1675371 (0.0009) [2023-12-26 12:58:20,355][123090] Updated weights for policy 1, policy_version 1664095 (0.0008) [2023-12-26 12:58:21,143][123090] Updated weights for policy 1, policy_version 1664105 (0.0009) [2023-12-26 12:58:21,193][123091] Updated weights for policy 0, policy_version 1675381 (0.0007) [2023-12-26 12:58:21,207][123090] Updated weights for policy 1, policy_version 1664115 (0.0011) [2023-12-26 12:58:21,254][123091] Updated weights for policy 0, policy_version 1675391 (0.0010) [2023-12-26 12:58:21,267][123090] Updated weights for policy 1, policy_version 1664125 (0.0011) [2023-12-26 12:58:21,315][123091] Updated weights for policy 0, policy_version 1675401 (0.0009) [2023-12-26 12:58:22,123][123090] Updated weights for policy 1, policy_version 1664135 (0.0010) [2023-12-26 12:58:22,182][123090] Updated weights for policy 1, policy_version 1664145 (0.0010) [2023-12-26 12:58:22,191][123091] Updated weights for policy 0, policy_version 1675411 (0.0009) [2023-12-26 12:58:22,240][123091] Updated weights for policy 0, policy_version 1675421 (0.0007) [2023-12-26 12:58:22,244][123090] Updated weights for policy 1, policy_version 1664155 (0.0009) [2023-12-26 12:58:22,307][123091] Updated weights for policy 0, policy_version 1675431 (0.0009) [2023-12-26 12:58:23,014][123090] Updated weights for policy 1, policy_version 1664165 (0.0007) [2023-12-26 12:58:23,066][123090] Updated weights for policy 1, policy_version 1664175 (0.0005) [2023-12-26 12:58:23,131][123090] Updated weights for policy 1, policy_version 1664185 (0.0006) [2023-12-26 12:58:23,241][123091] Updated weights for policy 0, policy_version 1675441 (0.0010) [2023-12-26 12:58:23,300][123091] Updated weights for policy 0, policy_version 1675451 (0.0009) [2023-12-26 12:58:23,361][123091] Updated weights for policy 0, policy_version 1675461 (0.0010) [2023-12-26 12:58:23,420][123091] Updated weights for policy 0, policy_version 1675471 (0.0008) [2023-12-26 12:58:23,784][121949] Fps is (10 sec: 16383.6, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 854958080. Throughput: 0: 8760.0, 1: 8800.3. Samples: 854937028. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:23,785][121949] Avg episode reward: [(0, '5893.551'), (1, '5866.298')] [2023-12-26 12:58:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001664192_426033152.pth... [2023-12-26 12:58:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001675472_428924928.pth... [2023-12-26 12:58:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001663168_425771008.pth [2023-12-26 12:58:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001674448_428662784.pth [2023-12-26 12:58:23,837][123090] Updated weights for policy 1, policy_version 1664195 (0.0010) [2023-12-26 12:58:23,905][123090] Updated weights for policy 1, policy_version 1664205 (0.0008) [2023-12-26 12:58:23,961][123090] Updated weights for policy 1, policy_version 1664215 (0.0009) [2023-12-26 12:58:24,239][123091] Updated weights for policy 0, policy_version 1675481 (0.0006) [2023-12-26 12:58:24,293][123091] Updated weights for policy 0, policy_version 1675491 (0.0005) [2023-12-26 12:58:24,345][123091] Updated weights for policy 0, policy_version 1675501 (0.0005) [2023-12-26 12:58:24,818][123090] Updated weights for policy 1, policy_version 1664225 (0.0009) [2023-12-26 12:58:24,890][123090] Updated weights for policy 1, policy_version 1664235 (0.0009) [2023-12-26 12:58:24,959][123090] Updated weights for policy 1, policy_version 1664245 (0.0008) [2023-12-26 12:58:25,028][123090] Updated weights for policy 1, policy_version 1664255 (0.0007) [2023-12-26 12:58:25,111][123091] Updated weights for policy 0, policy_version 1675511 (0.0008) [2023-12-26 12:58:25,176][123091] Updated weights for policy 0, policy_version 1675521 (0.0009) [2023-12-26 12:58:25,237][123091] Updated weights for policy 0, policy_version 1675531 (0.0009) [2023-12-26 12:58:25,781][123090] Updated weights for policy 1, policy_version 1664265 (0.0011) [2023-12-26 12:58:25,849][123090] Updated weights for policy 1, policy_version 1664275 (0.0006) [2023-12-26 12:58:25,915][123090] Updated weights for policy 1, policy_version 1664285 (0.0005) [2023-12-26 12:58:26,064][123091] Updated weights for policy 0, policy_version 1675541 (0.0007) [2023-12-26 12:58:26,133][123091] Updated weights for policy 0, policy_version 1675551 (0.0005) [2023-12-26 12:58:26,190][123091] Updated weights for policy 0, policy_version 1675561 (0.0005) [2023-12-26 12:58:26,627][123090] Updated weights for policy 1, policy_version 1664295 (0.0005) [2023-12-26 12:58:26,684][123090] Updated weights for policy 1, policy_version 1664305 (0.0005) [2023-12-26 12:58:26,731][123090] Updated weights for policy 1, policy_version 1664315 (0.0005) [2023-12-26 12:58:26,979][123091] Updated weights for policy 0, policy_version 1675571 (0.0007) [2023-12-26 12:58:27,034][123091] Updated weights for policy 0, policy_version 1675581 (0.0010) [2023-12-26 12:58:27,085][123091] Updated weights for policy 0, policy_version 1675591 (0.0009) [2023-12-26 12:58:27,405][123090] Updated weights for policy 1, policy_version 1664325 (0.0007) [2023-12-26 12:58:27,464][123090] Updated weights for policy 1, policy_version 1664335 (0.0006) [2023-12-26 12:58:27,531][123090] Updated weights for policy 1, policy_version 1664345 (0.0005) [2023-12-26 12:58:28,003][123091] Updated weights for policy 0, policy_version 1675601 (0.0010) [2023-12-26 12:58:28,054][123091] Updated weights for policy 0, policy_version 1675611 (0.0009) [2023-12-26 12:58:28,109][123091] Updated weights for policy 0, policy_version 1675621 (0.0009) [2023-12-26 12:58:28,120][123090] Updated weights for policy 1, policy_version 1664355 (0.0005) [2023-12-26 12:58:28,157][123091] Updated weights for policy 0, policy_version 1675631 (0.0010) [2023-12-26 12:58:28,170][123090] Updated weights for policy 1, policy_version 1664365 (0.0005) [2023-12-26 12:58:28,234][123090] Updated weights for policy 1, policy_version 1664375 (0.0005) [2023-12-26 12:58:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 855048192. Throughput: 0: 8685.1, 1: 8926.3. Samples: 855042936. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:28,785][121949] Avg episode reward: [(0, '6070.242'), (1, '5905.632')] [2023-12-26 12:58:28,901][123090] Updated weights for policy 1, policy_version 1664385 (0.0005) [2023-12-26 12:58:28,961][123090] Updated weights for policy 1, policy_version 1664395 (0.0005) [2023-12-26 12:58:29,016][123090] Updated weights for policy 1, policy_version 1664405 (0.0005) [2023-12-26 12:58:29,062][123090] Updated weights for policy 1, policy_version 1664415 (0.0005) [2023-12-26 12:58:29,127][123091] Updated weights for policy 0, policy_version 1675641 (0.0009) [2023-12-26 12:58:29,179][123091] Updated weights for policy 0, policy_version 1675651 (0.0009) [2023-12-26 12:58:29,242][123091] Updated weights for policy 0, policy_version 1675661 (0.0009) [2023-12-26 12:58:29,800][123090] Updated weights for policy 1, policy_version 1664425 (0.0010) [2023-12-26 12:58:29,862][123090] Updated weights for policy 1, policy_version 1664435 (0.0010) [2023-12-26 12:58:29,927][123090] Updated weights for policy 1, policy_version 1664445 (0.0008) [2023-12-26 12:58:30,162][123091] Updated weights for policy 0, policy_version 1675671 (0.0010) [2023-12-26 12:58:30,218][123091] Updated weights for policy 0, policy_version 1675681 (0.0009) [2023-12-26 12:58:30,285][123091] Updated weights for policy 0, policy_version 1675691 (0.0006) [2023-12-26 12:58:30,642][123090] Updated weights for policy 1, policy_version 1664455 (0.0006) [2023-12-26 12:58:30,704][123090] Updated weights for policy 1, policy_version 1664465 (0.0008) [2023-12-26 12:58:30,758][123090] Updated weights for policy 1, policy_version 1664475 (0.0007) [2023-12-26 12:58:31,086][123091] Updated weights for policy 0, policy_version 1675701 (0.0007) [2023-12-26 12:58:31,153][123091] Updated weights for policy 0, policy_version 1675711 (0.0010) [2023-12-26 12:58:31,213][123091] Updated weights for policy 0, policy_version 1675721 (0.0009) [2023-12-26 12:58:31,536][123090] Updated weights for policy 1, policy_version 1664485 (0.0005) [2023-12-26 12:58:31,608][123090] Updated weights for policy 1, policy_version 1664495 (0.0008) [2023-12-26 12:58:31,670][123090] Updated weights for policy 1, policy_version 1664505 (0.0009) [2023-12-26 12:58:32,077][123091] Updated weights for policy 0, policy_version 1675731 (0.0010) [2023-12-26 12:58:32,143][123091] Updated weights for policy 0, policy_version 1675741 (0.0009) [2023-12-26 12:58:32,200][123091] Updated weights for policy 0, policy_version 1675751 (0.0009) [2023-12-26 12:58:32,413][123090] Updated weights for policy 1, policy_version 1664515 (0.0009) [2023-12-26 12:58:32,468][123090] Updated weights for policy 1, policy_version 1664525 (0.0008) [2023-12-26 12:58:32,519][123090] Updated weights for policy 1, policy_version 1664535 (0.0008) [2023-12-26 12:58:32,951][123091] Updated weights for policy 0, policy_version 1675761 (0.0009) [2023-12-26 12:58:33,007][123091] Updated weights for policy 0, policy_version 1675771 (0.0009) [2023-12-26 12:58:33,063][123091] Updated weights for policy 0, policy_version 1675781 (0.0008) [2023-12-26 12:58:33,125][123091] Updated weights for policy 0, policy_version 1675791 (0.0009) [2023-12-26 12:58:33,350][123090] Updated weights for policy 1, policy_version 1664545 (0.0006) [2023-12-26 12:58:33,403][123090] Updated weights for policy 1, policy_version 1664555 (0.0009) [2023-12-26 12:58:33,466][123090] Updated weights for policy 1, policy_version 1664565 (0.0006) [2023-12-26 12:58:33,526][123090] Updated weights for policy 1, policy_version 1664575 (0.0005) [2023-12-26 12:58:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 855138304. Throughput: 0: 8682.0, 1: 9028.9. Samples: 855150608. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:33,785][121949] Avg episode reward: [(0, '5805.987'), (1, '6034.313')] [2023-12-26 12:58:33,903][123091] Updated weights for policy 0, policy_version 1675801 (0.0006) [2023-12-26 12:58:33,950][123091] Updated weights for policy 0, policy_version 1675811 (0.0009) [2023-12-26 12:58:34,001][123091] Updated weights for policy 0, policy_version 1675821 (0.0009) [2023-12-26 12:58:34,136][123090] Updated weights for policy 1, policy_version 1664585 (0.0006) [2023-12-26 12:58:34,204][123090] Updated weights for policy 1, policy_version 1664595 (0.0007) [2023-12-26 12:58:34,270][123090] Updated weights for policy 1, policy_version 1664605 (0.0006) [2023-12-26 12:58:34,804][123091] Updated weights for policy 0, policy_version 1675831 (0.0007) [2023-12-26 12:58:34,854][123091] Updated weights for policy 0, policy_version 1675841 (0.0005) [2023-12-26 12:58:34,901][123091] Updated weights for policy 0, policy_version 1675851 (0.0005) [2023-12-26 12:58:35,108][123090] Updated weights for policy 1, policy_version 1664615 (0.0008) [2023-12-26 12:58:35,175][123090] Updated weights for policy 1, policy_version 1664625 (0.0005) [2023-12-26 12:58:35,228][123090] Updated weights for policy 1, policy_version 1664635 (0.0005) [2023-12-26 12:58:35,530][123091] Updated weights for policy 0, policy_version 1675861 (0.0005) [2023-12-26 12:58:35,584][123091] Updated weights for policy 0, policy_version 1675871 (0.0005) [2023-12-26 12:58:35,650][123091] Updated weights for policy 0, policy_version 1675881 (0.0005) [2023-12-26 12:58:35,852][123090] Updated weights for policy 1, policy_version 1664645 (0.0007) [2023-12-26 12:58:35,901][123090] Updated weights for policy 1, policy_version 1664655 (0.0009) [2023-12-26 12:58:35,961][123090] Updated weights for policy 1, policy_version 1664665 (0.0009) [2023-12-26 12:58:36,477][123091] Updated weights for policy 0, policy_version 1675891 (0.0010) [2023-12-26 12:58:36,541][123091] Updated weights for policy 0, policy_version 1675901 (0.0011) [2023-12-26 12:58:36,597][123091] Updated weights for policy 0, policy_version 1675911 (0.0011) [2023-12-26 12:58:36,841][123090] Updated weights for policy 1, policy_version 1664675 (0.0009) [2023-12-26 12:58:36,903][123090] Updated weights for policy 1, policy_version 1664685 (0.0009) [2023-12-26 12:58:36,964][123090] Updated weights for policy 1, policy_version 1664695 (0.0009) [2023-12-26 12:58:37,426][123091] Updated weights for policy 0, policy_version 1675921 (0.0010) [2023-12-26 12:58:37,496][123091] Updated weights for policy 0, policy_version 1675931 (0.0011) [2023-12-26 12:58:37,564][123091] Updated weights for policy 0, policy_version 1675941 (0.0009) [2023-12-26 12:58:37,631][123091] Updated weights for policy 0, policy_version 1675951 (0.0009) [2023-12-26 12:58:37,811][123090] Updated weights for policy 1, policy_version 1664705 (0.0009) [2023-12-26 12:58:37,873][123090] Updated weights for policy 1, policy_version 1664715 (0.0009) [2023-12-26 12:58:37,934][123090] Updated weights for policy 1, policy_version 1664725 (0.0010) [2023-12-26 12:58:37,995][123090] Updated weights for policy 1, policy_version 1664735 (0.0010) [2023-12-26 12:58:38,315][123091] Updated weights for policy 0, policy_version 1675961 (0.0006) [2023-12-26 12:58:38,388][123091] Updated weights for policy 0, policy_version 1675971 (0.0007) [2023-12-26 12:58:38,461][123091] Updated weights for policy 0, policy_version 1675981 (0.0010) [2023-12-26 12:58:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 855228416. Throughput: 0: 8717.4, 1: 9065.5. Samples: 855206776. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:38,785][121949] Avg episode reward: [(0, '5745.635'), (1, '5967.777')] [2023-12-26 12:58:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001675984_429056000.pth... [2023-12-26 12:58:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001664736_426172416.pth... [2023-12-26 12:58:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001674960_428793856.pth [2023-12-26 12:58:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001663680_425902080.pth [2023-12-26 12:58:38,904][123090] Updated weights for policy 1, policy_version 1664745 (0.0010) [2023-12-26 12:58:38,960][123090] Updated weights for policy 1, policy_version 1664755 (0.0006) [2023-12-26 12:58:39,022][123090] Updated weights for policy 1, policy_version 1664765 (0.0006) [2023-12-26 12:58:39,234][123091] Updated weights for policy 0, policy_version 1675991 (0.0009) [2023-12-26 12:58:39,306][123091] Updated weights for policy 0, policy_version 1676001 (0.0009) [2023-12-26 12:58:39,378][123091] Updated weights for policy 0, policy_version 1676011 (0.0010) [2023-12-26 12:58:39,835][123090] Updated weights for policy 1, policy_version 1664775 (0.0008) [2023-12-26 12:58:39,901][123090] Updated weights for policy 1, policy_version 1664785 (0.0010) [2023-12-26 12:58:39,971][123090] Updated weights for policy 1, policy_version 1664795 (0.0008) [2023-12-26 12:58:40,193][123091] Updated weights for policy 0, policy_version 1676021 (0.0009) [2023-12-26 12:58:40,264][123091] Updated weights for policy 0, policy_version 1676031 (0.0008) [2023-12-26 12:58:40,324][123091] Updated weights for policy 0, policy_version 1676041 (0.0010) [2023-12-26 12:58:40,806][123090] Updated weights for policy 1, policy_version 1664805 (0.0008) [2023-12-26 12:58:40,865][123090] Updated weights for policy 1, policy_version 1664815 (0.0005) [2023-12-26 12:58:40,924][123090] Updated weights for policy 1, policy_version 1664825 (0.0008) [2023-12-26 12:58:41,113][123091] Updated weights for policy 0, policy_version 1676051 (0.0009) [2023-12-26 12:58:41,185][123091] Updated weights for policy 0, policy_version 1676061 (0.0010) [2023-12-26 12:58:41,249][123091] Updated weights for policy 0, policy_version 1676071 (0.0009) [2023-12-26 12:58:41,760][123090] Updated weights for policy 1, policy_version 1664835 (0.0007) [2023-12-26 12:58:41,824][123090] Updated weights for policy 1, policy_version 1664845 (0.0009) [2023-12-26 12:58:41,880][123090] Updated weights for policy 1, policy_version 1664855 (0.0009) [2023-12-26 12:58:42,066][123091] Updated weights for policy 0, policy_version 1676081 (0.0010) [2023-12-26 12:58:42,133][123091] Updated weights for policy 0, policy_version 1676091 (0.0011) [2023-12-26 12:58:42,201][123091] Updated weights for policy 0, policy_version 1676101 (0.0011) [2023-12-26 12:58:42,261][123091] Updated weights for policy 0, policy_version 1676111 (0.0011) [2023-12-26 12:58:42,733][123090] Updated weights for policy 1, policy_version 1664865 (0.0009) [2023-12-26 12:58:42,790][123090] Updated weights for policy 1, policy_version 1664875 (0.0008) [2023-12-26 12:58:42,854][123090] Updated weights for policy 1, policy_version 1664885 (0.0009) [2023-12-26 12:58:42,906][123090] Updated weights for policy 1, policy_version 1664895 (0.0009) [2023-12-26 12:58:43,090][123091] Updated weights for policy 0, policy_version 1676121 (0.0007) [2023-12-26 12:58:43,146][123091] Updated weights for policy 0, policy_version 1676131 (0.0008) [2023-12-26 12:58:43,194][123091] Updated weights for policy 0, policy_version 1676141 (0.0009) [2023-12-26 12:58:43,744][123090] Updated weights for policy 1, policy_version 1664905 (0.0009) [2023-12-26 12:58:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 855310336. Throughput: 0: 8727.4, 1: 8938.7. Samples: 855309584. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:43,785][121949] Avg episode reward: [(0, '5810.372'), (1, '5895.217')] [2023-12-26 12:58:43,803][123090] Updated weights for policy 1, policy_version 1664915 (0.0009) [2023-12-26 12:58:43,854][123090] Updated weights for policy 1, policy_version 1664925 (0.0009) [2023-12-26 12:58:44,004][123091] Updated weights for policy 0, policy_version 1676151 (0.0007) [2023-12-26 12:58:44,061][123091] Updated weights for policy 0, policy_version 1676161 (0.0009) [2023-12-26 12:58:44,108][123091] Updated weights for policy 0, policy_version 1676171 (0.0008) [2023-12-26 12:58:44,654][123090] Updated weights for policy 1, policy_version 1664935 (0.0007) [2023-12-26 12:58:44,704][123090] Updated weights for policy 1, policy_version 1664945 (0.0005) [2023-12-26 12:58:44,755][123090] Updated weights for policy 1, policy_version 1664955 (0.0005) [2023-12-26 12:58:44,949][123091] Updated weights for policy 0, policy_version 1676181 (0.0010) [2023-12-26 12:58:45,007][123091] Updated weights for policy 0, policy_version 1676191 (0.0010) [2023-12-26 12:58:45,070][123091] Updated weights for policy 0, policy_version 1676201 (0.0010) [2023-12-26 12:58:45,524][123090] Updated weights for policy 1, policy_version 1664965 (0.0008) [2023-12-26 12:58:45,584][123090] Updated weights for policy 1, policy_version 1664975 (0.0006) [2023-12-26 12:58:45,644][123090] Updated weights for policy 1, policy_version 1664985 (0.0009) [2023-12-26 12:58:45,941][123091] Updated weights for policy 0, policy_version 1676211 (0.0010) [2023-12-26 12:58:45,997][123091] Updated weights for policy 0, policy_version 1676221 (0.0009) [2023-12-26 12:58:46,054][123091] Updated weights for policy 0, policy_version 1676231 (0.0009) [2023-12-26 12:58:46,436][123090] Updated weights for policy 1, policy_version 1664995 (0.0011) [2023-12-26 12:58:46,495][123090] Updated weights for policy 1, policy_version 1665005 (0.0010) [2023-12-26 12:58:46,564][123090] Updated weights for policy 1, policy_version 1665015 (0.0009) [2023-12-26 12:58:46,913][123091] Updated weights for policy 0, policy_version 1676241 (0.0009) [2023-12-26 12:58:46,967][123091] Updated weights for policy 0, policy_version 1676251 (0.0010) [2023-12-26 12:58:47,027][123091] Updated weights for policy 0, policy_version 1676261 (0.0010) [2023-12-26 12:58:47,080][123091] Updated weights for policy 0, policy_version 1676271 (0.0009) [2023-12-26 12:58:47,272][123090] Updated weights for policy 1, policy_version 1665025 (0.0010) [2023-12-26 12:58:47,338][123090] Updated weights for policy 1, policy_version 1665035 (0.0005) [2023-12-26 12:58:47,408][123090] Updated weights for policy 1, policy_version 1665045 (0.0005) [2023-12-26 12:58:47,481][123090] Updated weights for policy 1, policy_version 1665055 (0.0006) [2023-12-26 12:58:47,990][123091] Updated weights for policy 0, policy_version 1676281 (0.0010) [2023-12-26 12:58:48,055][123091] Updated weights for policy 0, policy_version 1676291 (0.0009) [2023-12-26 12:58:48,115][123091] Updated weights for policy 0, policy_version 1676301 (0.0009) [2023-12-26 12:58:48,227][123090] Updated weights for policy 1, policy_version 1665065 (0.0009) [2023-12-26 12:58:48,283][123090] Updated weights for policy 1, policy_version 1665075 (0.0008) [2023-12-26 12:58:48,344][123090] Updated weights for policy 1, policy_version 1665085 (0.0008) [2023-12-26 12:58:48,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17828.0). Total num frames: 855400448. Throughput: 0: 8680.3, 1: 8954.2. Samples: 855414352. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:48,785][121949] Avg episode reward: [(0, '5837.435'), (1, '5847.194')] [2023-12-26 12:58:48,958][123091] Updated weights for policy 0, policy_version 1676311 (0.0009) [2023-12-26 12:58:49,011][123091] Updated weights for policy 0, policy_version 1676321 (0.0009) [2023-12-26 12:58:49,081][123091] Updated weights for policy 0, policy_version 1676331 (0.0009) [2023-12-26 12:58:49,126][123090] Updated weights for policy 1, policy_version 1665095 (0.0009) [2023-12-26 12:58:49,191][123090] Updated weights for policy 1, policy_version 1665105 (0.0010) [2023-12-26 12:58:49,263][123090] Updated weights for policy 1, policy_version 1665115 (0.0009) [2023-12-26 12:58:49,950][123090] Updated weights for policy 1, policy_version 1665125 (0.0009) [2023-12-26 12:58:49,993][123091] Updated weights for policy 0, policy_version 1676341 (0.0009) [2023-12-26 12:58:50,017][123090] Updated weights for policy 1, policy_version 1665135 (0.0008) [2023-12-26 12:58:50,054][123091] Updated weights for policy 0, policy_version 1676351 (0.0007) [2023-12-26 12:58:50,081][123090] Updated weights for policy 1, policy_version 1665145 (0.0008) [2023-12-26 12:58:50,123][123091] Updated weights for policy 0, policy_version 1676361 (0.0008) [2023-12-26 12:58:50,859][123091] Updated weights for policy 0, policy_version 1676371 (0.0009) [2023-12-26 12:58:50,912][123091] Updated weights for policy 0, policy_version 1676381 (0.0009) [2023-12-26 12:58:50,931][123090] Updated weights for policy 1, policy_version 1665155 (0.0009) [2023-12-26 12:58:50,970][123091] Updated weights for policy 0, policy_version 1676391 (0.0007) [2023-12-26 12:58:50,996][123090] Updated weights for policy 1, policy_version 1665165 (0.0010) [2023-12-26 12:58:51,062][123090] Updated weights for policy 1, policy_version 1665175 (0.0009) [2023-12-26 12:58:51,798][123091] Updated weights for policy 0, policy_version 1676401 (0.0007) [2023-12-26 12:58:51,859][123091] Updated weights for policy 0, policy_version 1676411 (0.0009) [2023-12-26 12:58:51,926][123091] Updated weights for policy 0, policy_version 1676421 (0.0010) [2023-12-26 12:58:51,951][123090] Updated weights for policy 1, policy_version 1665185 (0.0009) [2023-12-26 12:58:51,981][123091] Updated weights for policy 0, policy_version 1676431 (0.0009) [2023-12-26 12:58:52,023][123090] Updated weights for policy 1, policy_version 1665195 (0.0008) [2023-12-26 12:58:52,097][123090] Updated weights for policy 1, policy_version 1665205 (0.0006) [2023-12-26 12:58:52,169][123090] Updated weights for policy 1, policy_version 1665215 (0.0006) [2023-12-26 12:58:52,859][123091] Updated weights for policy 0, policy_version 1676441 (0.0010) [2023-12-26 12:58:52,910][123091] Updated weights for policy 0, policy_version 1676451 (0.0009) [2023-12-26 12:58:52,922][123090] Updated weights for policy 1, policy_version 1665225 (0.0006) [2023-12-26 12:58:52,962][123091] Updated weights for policy 0, policy_version 1676461 (0.0008) [2023-12-26 12:58:52,981][123090] Updated weights for policy 1, policy_version 1665235 (0.0005) [2023-12-26 12:58:53,054][123090] Updated weights for policy 1, policy_version 1665245 (0.0008) [2023-12-26 12:58:53,742][123091] Updated weights for policy 0, policy_version 1676471 (0.0008) [2023-12-26 12:58:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 855482368. Throughput: 0: 8643.7, 1: 8912.3. Samples: 855465708. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:53,784][121949] Avg episode reward: [(0, '5684.014'), (1, '5780.121')] [2023-12-26 12:58:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001665248_426303488.pth... [2023-12-26 12:58:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001664192_426033152.pth [2023-12-26 12:58:53,803][123091] Updated weights for policy 0, policy_version 1676481 (0.0010) [2023-12-26 12:58:53,859][123091] Updated weights for policy 0, policy_version 1676491 (0.0007) [2023-12-26 12:58:53,869][123090] Updated weights for policy 1, policy_version 1665255 (0.0010) [2023-12-26 12:58:53,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001676496_429187072.pth... [2023-12-26 12:58:53,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001675472_428924928.pth [2023-12-26 12:58:53,928][123090] Updated weights for policy 1, policy_version 1665265 (0.0009) [2023-12-26 12:58:53,982][123090] Updated weights for policy 1, policy_version 1665275 (0.0010) [2023-12-26 12:58:54,649][123091] Updated weights for policy 0, policy_version 1676501 (0.0009) [2023-12-26 12:58:54,708][123091] Updated weights for policy 0, policy_version 1676512 (0.0007) [2023-12-26 12:58:54,761][123091] Updated weights for policy 0, policy_version 1676522 (0.0005) [2023-12-26 12:58:54,804][123090] Updated weights for policy 1, policy_version 1665286 (0.0010) [2023-12-26 12:58:54,858][123090] Updated weights for policy 1, policy_version 1665296 (0.0010) [2023-12-26 12:58:54,915][123090] Updated weights for policy 1, policy_version 1665306 (0.0010) [2023-12-26 12:58:55,496][123091] Updated weights for policy 0, policy_version 1676532 (0.0007) [2023-12-26 12:58:55,560][123091] Updated weights for policy 0, policy_version 1676542 (0.0010) [2023-12-26 12:58:55,627][123091] Updated weights for policy 0, policy_version 1676552 (0.0009) [2023-12-26 12:58:55,773][123090] Updated weights for policy 1, policy_version 1665316 (0.0010) [2023-12-26 12:58:55,843][123090] Updated weights for policy 1, policy_version 1665326 (0.0009) [2023-12-26 12:58:55,909][123090] Updated weights for policy 1, policy_version 1665336 (0.0009) [2023-12-26 12:58:56,408][123091] Updated weights for policy 0, policy_version 1676562 (0.0010) [2023-12-26 12:58:56,464][123091] Updated weights for policy 0, policy_version 1676572 (0.0009) [2023-12-26 12:58:56,521][123091] Updated weights for policy 0, policy_version 1676582 (0.0006) [2023-12-26 12:58:56,593][123091] Updated weights for policy 0, policy_version 1676592 (0.0008) [2023-12-26 12:58:56,748][123090] Updated weights for policy 1, policy_version 1665346 (0.0009) [2023-12-26 12:58:56,809][123090] Updated weights for policy 1, policy_version 1665356 (0.0009) [2023-12-26 12:58:56,861][123090] Updated weights for policy 1, policy_version 1665366 (0.0009) [2023-12-26 12:58:56,915][123090] Updated weights for policy 1, policy_version 1665376 (0.0009) [2023-12-26 12:58:57,332][123091] Updated weights for policy 0, policy_version 1676602 (0.0006) [2023-12-26 12:58:57,391][123091] Updated weights for policy 0, policy_version 1676612 (0.0007) [2023-12-26 12:58:57,448][123091] Updated weights for policy 0, policy_version 1676622 (0.0005) [2023-12-26 12:58:57,829][123090] Updated weights for policy 1, policy_version 1665386 (0.0010) [2023-12-26 12:58:57,883][123090] Updated weights for policy 1, policy_version 1665396 (0.0009) [2023-12-26 12:58:57,942][123090] Updated weights for policy 1, policy_version 1665406 (0.0005) [2023-12-26 12:58:58,077][123091] Updated weights for policy 0, policy_version 1676632 (0.0008) [2023-12-26 12:58:58,140][123091] Updated weights for policy 0, policy_version 1676642 (0.0008) [2023-12-26 12:58:58,201][123091] Updated weights for policy 0, policy_version 1676652 (0.0008) [2023-12-26 12:58:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 855572480. Throughput: 0: 8632.1, 1: 8904.0. Samples: 855570484. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:58:58,785][121949] Avg episode reward: [(0, '5684.371'), (1, '5731.713')] [2023-12-26 12:58:58,823][123090] Updated weights for policy 1, policy_version 1665416 (0.0007) [2023-12-26 12:58:58,890][123090] Updated weights for policy 1, policy_version 1665426 (0.0009) [2023-12-26 12:58:58,948][123091] Updated weights for policy 0, policy_version 1676662 (0.0010) [2023-12-26 12:58:58,949][123090] Updated weights for policy 1, policy_version 1665436 (0.0010) [2023-12-26 12:58:59,010][123091] Updated weights for policy 0, policy_version 1676672 (0.0011) [2023-12-26 12:58:59,071][123091] Updated weights for policy 0, policy_version 1676682 (0.0010) [2023-12-26 12:58:59,692][123090] Updated weights for policy 1, policy_version 1665446 (0.0007) [2023-12-26 12:58:59,748][123090] Updated weights for policy 1, policy_version 1665456 (0.0005) [2023-12-26 12:58:59,818][123090] Updated weights for policy 1, policy_version 1665466 (0.0006) [2023-12-26 12:58:59,873][123091] Updated weights for policy 0, policy_version 1676692 (0.0008) [2023-12-26 12:58:59,940][123091] Updated weights for policy 0, policy_version 1676702 (0.0008) [2023-12-26 12:58:59,995][123091] Updated weights for policy 0, policy_version 1676712 (0.0008) [2023-12-26 12:59:00,502][123090] Updated weights for policy 1, policy_version 1665476 (0.0011) [2023-12-26 12:59:00,575][123090] Updated weights for policy 1, policy_version 1665486 (0.0010) [2023-12-26 12:59:00,641][123090] Updated weights for policy 1, policy_version 1665496 (0.0010) [2023-12-26 12:59:00,818][123091] Updated weights for policy 0, policy_version 1676722 (0.0009) [2023-12-26 12:59:00,887][123091] Updated weights for policy 0, policy_version 1676732 (0.0010) [2023-12-26 12:59:00,951][123091] Updated weights for policy 0, policy_version 1676742 (0.0010) [2023-12-26 12:59:01,017][123091] Updated weights for policy 0, policy_version 1676752 (0.0010) [2023-12-26 12:59:01,456][123090] Updated weights for policy 1, policy_version 1665506 (0.0010) [2023-12-26 12:59:01,557][123090] Updated weights for policy 1, policy_version 1665516 (0.0007) [2023-12-26 12:59:01,616][123090] Updated weights for policy 1, policy_version 1665526 (0.0007) [2023-12-26 12:59:01,680][123090] Updated weights for policy 1, policy_version 1665536 (0.0010) [2023-12-26 12:59:01,756][123091] Updated weights for policy 0, policy_version 1676762 (0.0008) [2023-12-26 12:59:01,824][123091] Updated weights for policy 0, policy_version 1676772 (0.0008) [2023-12-26 12:59:01,892][123091] Updated weights for policy 0, policy_version 1676782 (0.0008) [2023-12-26 12:59:02,415][123090] Updated weights for policy 1, policy_version 1665546 (0.0007) [2023-12-26 12:59:02,484][123090] Updated weights for policy 1, policy_version 1665556 (0.0007) [2023-12-26 12:59:02,537][123090] Updated weights for policy 1, policy_version 1665566 (0.0005) [2023-12-26 12:59:02,733][123091] Updated weights for policy 0, policy_version 1676792 (0.0010) [2023-12-26 12:59:02,791][123091] Updated weights for policy 0, policy_version 1676802 (0.0008) [2023-12-26 12:59:02,846][123091] Updated weights for policy 0, policy_version 1676812 (0.0009) [2023-12-26 12:59:03,311][123090] Updated weights for policy 1, policy_version 1665576 (0.0006) [2023-12-26 12:59:03,386][123090] Updated weights for policy 1, policy_version 1665586 (0.0007) [2023-12-26 12:59:03,444][123090] Updated weights for policy 1, policy_version 1665596 (0.0010) [2023-12-26 12:59:03,576][123091] Updated weights for policy 0, policy_version 1676822 (0.0009) [2023-12-26 12:59:03,638][123091] Updated weights for policy 0, policy_version 1676832 (0.0008) [2023-12-26 12:59:03,689][123091] Updated weights for policy 0, policy_version 1676842 (0.0005) [2023-12-26 12:59:03,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 855670784. Throughput: 0: 8692.4, 1: 8908.2. Samples: 855678780. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:03,785][121949] Avg episode reward: [(0, '5983.321'), (1, '5925.703')] [2023-12-26 12:59:04,200][123090] Updated weights for policy 1, policy_version 1665606 (0.0007) [2023-12-26 12:59:04,272][123090] Updated weights for policy 1, policy_version 1665616 (0.0006) [2023-12-26 12:59:04,338][123090] Updated weights for policy 1, policy_version 1665626 (0.0007) [2023-12-26 12:59:04,394][123091] Updated weights for policy 0, policy_version 1676852 (0.0005) [2023-12-26 12:59:04,455][123091] Updated weights for policy 0, policy_version 1676862 (0.0006) [2023-12-26 12:59:04,524][123091] Updated weights for policy 0, policy_version 1676872 (0.0006) [2023-12-26 12:59:05,140][123090] Updated weights for policy 1, policy_version 1665636 (0.0008) [2023-12-26 12:59:05,170][123091] Updated weights for policy 0, policy_version 1676882 (0.0007) [2023-12-26 12:59:05,207][123090] Updated weights for policy 1, policy_version 1665646 (0.0009) [2023-12-26 12:59:05,217][123091] Updated weights for policy 0, policy_version 1676892 (0.0010) [2023-12-26 12:59:05,266][123090] Updated weights for policy 1, policy_version 1665656 (0.0010) [2023-12-26 12:59:05,269][123091] Updated weights for policy 0, policy_version 1676902 (0.0010) [2023-12-26 12:59:05,324][123091] Updated weights for policy 0, policy_version 1676912 (0.0006) [2023-12-26 12:59:06,004][123090] Updated weights for policy 1, policy_version 1665666 (0.0009) [2023-12-26 12:59:06,074][123090] Updated weights for policy 1, policy_version 1665676 (0.0005) [2023-12-26 12:59:06,125][123091] Updated weights for policy 0, policy_version 1676922 (0.0009) [2023-12-26 12:59:06,132][123090] Updated weights for policy 1, policy_version 1665686 (0.0007) [2023-12-26 12:59:06,190][123091] Updated weights for policy 0, policy_version 1676932 (0.0008) [2023-12-26 12:59:06,193][123090] Updated weights for policy 1, policy_version 1665696 (0.0005) [2023-12-26 12:59:06,252][123091] Updated weights for policy 0, policy_version 1676942 (0.0010) [2023-12-26 12:59:06,969][123090] Updated weights for policy 1, policy_version 1665706 (0.0011) [2023-12-26 12:59:07,035][123090] Updated weights for policy 1, policy_version 1665716 (0.0010) [2023-12-26 12:59:07,084][123091] Updated weights for policy 0, policy_version 1676952 (0.0011) [2023-12-26 12:59:07,095][123090] Updated weights for policy 1, policy_version 1665726 (0.0010) [2023-12-26 12:59:07,141][123091] Updated weights for policy 0, policy_version 1676962 (0.0006) [2023-12-26 12:59:07,196][123091] Updated weights for policy 0, policy_version 1676972 (0.0005) [2023-12-26 12:59:07,870][123090] Updated weights for policy 1, policy_version 1665736 (0.0006) [2023-12-26 12:59:07,918][123090] Updated weights for policy 1, policy_version 1665746 (0.0005) [2023-12-26 12:59:07,957][123091] Updated weights for policy 0, policy_version 1676982 (0.0010) [2023-12-26 12:59:07,974][123090] Updated weights for policy 1, policy_version 1665756 (0.0005) [2023-12-26 12:59:08,020][123091] Updated weights for policy 0, policy_version 1676992 (0.0011) [2023-12-26 12:59:08,091][123091] Updated weights for policy 0, policy_version 1677002 (0.0010) [2023-12-26 12:59:08,570][123090] Updated weights for policy 1, policy_version 1665766 (0.0006) [2023-12-26 12:59:08,620][123090] Updated weights for policy 1, policy_version 1665776 (0.0005) [2023-12-26 12:59:08,674][123090] Updated weights for policy 1, policy_version 1665786 (0.0005) [2023-12-26 12:59:08,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 855760896. Throughput: 0: 8780.9, 1: 8949.6. Samples: 855734900. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:08,785][121949] Avg episode reward: [(0, '5963.824'), (1, '5772.996')] [2023-12-26 12:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001677008_429318144.pth... [2023-12-26 12:59:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001665792_426442752.pth... [2023-12-26 12:59:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001675984_429056000.pth [2023-12-26 12:59:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001664736_426172416.pth [2023-12-26 12:59:08,912][123091] Updated weights for policy 0, policy_version 1677012 (0.0010) [2023-12-26 12:59:08,972][123091] Updated weights for policy 0, policy_version 1677022 (0.0011) [2023-12-26 12:59:09,024][123091] Updated weights for policy 0, policy_version 1677032 (0.0010) [2023-12-26 12:59:09,485][123090] Updated weights for policy 1, policy_version 1665796 (0.0006) [2023-12-26 12:59:09,540][123090] Updated weights for policy 1, policy_version 1665806 (0.0008) [2023-12-26 12:59:09,600][123090] Updated weights for policy 1, policy_version 1665816 (0.0010) [2023-12-26 12:59:09,890][123091] Updated weights for policy 0, policy_version 1677042 (0.0009) [2023-12-26 12:59:09,961][123091] Updated weights for policy 0, policy_version 1677052 (0.0008) [2023-12-26 12:59:10,029][123091] Updated weights for policy 0, policy_version 1677062 (0.0008) [2023-12-26 12:59:10,085][123091] Updated weights for policy 0, policy_version 1677072 (0.0009) [2023-12-26 12:59:10,496][123090] Updated weights for policy 1, policy_version 1665826 (0.0009) [2023-12-26 12:59:10,546][123090] Updated weights for policy 1, policy_version 1665836 (0.0009) [2023-12-26 12:59:10,604][123090] Updated weights for policy 1, policy_version 1665846 (0.0010) [2023-12-26 12:59:10,666][123090] Updated weights for policy 1, policy_version 1665856 (0.0010) [2023-12-26 12:59:10,896][123091] Updated weights for policy 0, policy_version 1677082 (0.0010) [2023-12-26 12:59:10,954][123091] Updated weights for policy 0, policy_version 1677092 (0.0010) [2023-12-26 12:59:11,004][123091] Updated weights for policy 0, policy_version 1677102 (0.0010) [2023-12-26 12:59:11,566][123090] Updated weights for policy 1, policy_version 1665866 (0.0009) [2023-12-26 12:59:11,638][123090] Updated weights for policy 1, policy_version 1665876 (0.0008) [2023-12-26 12:59:11,708][123090] Updated weights for policy 1, policy_version 1665886 (0.0009) [2023-12-26 12:59:11,890][123091] Updated weights for policy 0, policy_version 1677112 (0.0009) [2023-12-26 12:59:11,945][123091] Updated weights for policy 0, policy_version 1677122 (0.0010) [2023-12-26 12:59:11,996][123091] Updated weights for policy 0, policy_version 1677132 (0.0010) [2023-12-26 12:59:12,500][123090] Updated weights for policy 1, policy_version 1665896 (0.0007) [2023-12-26 12:59:12,558][123090] Updated weights for policy 1, policy_version 1665906 (0.0011) [2023-12-26 12:59:12,623][123090] Updated weights for policy 1, policy_version 1665916 (0.0010) [2023-12-26 12:59:12,900][123091] Updated weights for policy 0, policy_version 1677142 (0.0009) [2023-12-26 12:59:12,962][123091] Updated weights for policy 0, policy_version 1677152 (0.0009) [2023-12-26 12:59:13,029][123091] Updated weights for policy 0, policy_version 1677162 (0.0009) [2023-12-26 12:59:13,421][123090] Updated weights for policy 1, policy_version 1665926 (0.0008) [2023-12-26 12:59:13,472][123090] Updated weights for policy 1, policy_version 1665936 (0.0008) [2023-12-26 12:59:13,527][123090] Updated weights for policy 1, policy_version 1665946 (0.0008) [2023-12-26 12:59:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 855842816. Throughput: 0: 8775.5, 1: 8887.7. Samples: 855837784. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:13,785][121949] Avg episode reward: [(0, '5868.584'), (1, '5609.440')] [2023-12-26 12:59:13,898][123091] Updated weights for policy 0, policy_version 1677172 (0.0007) [2023-12-26 12:59:13,946][123091] Updated weights for policy 0, policy_version 1677182 (0.0005) [2023-12-26 12:59:13,994][123091] Updated weights for policy 0, policy_version 1677192 (0.0009) [2023-12-26 12:59:14,167][123090] Updated weights for policy 1, policy_version 1665956 (0.0005) [2023-12-26 12:59:14,228][123090] Updated weights for policy 1, policy_version 1665966 (0.0005) [2023-12-26 12:59:14,294][123090] Updated weights for policy 1, policy_version 1665976 (0.0010) [2023-12-26 12:59:14,906][123090] Updated weights for policy 1, policy_version 1665986 (0.0009) [2023-12-26 12:59:14,913][123091] Updated weights for policy 0, policy_version 1677203 (0.0009) [2023-12-26 12:59:14,966][123090] Updated weights for policy 1, policy_version 1665996 (0.0008) [2023-12-26 12:59:14,973][123091] Updated weights for policy 0, policy_version 1677213 (0.0006) [2023-12-26 12:59:15,030][123090] Updated weights for policy 1, policy_version 1666006 (0.0008) [2023-12-26 12:59:15,034][123091] Updated weights for policy 0, policy_version 1677223 (0.0006) [2023-12-26 12:59:15,091][123090] Updated weights for policy 1, policy_version 1666016 (0.0008) [2023-12-26 12:59:15,877][123090] Updated weights for policy 1, policy_version 1666026 (0.0005) [2023-12-26 12:59:15,900][123091] Updated weights for policy 0, policy_version 1677233 (0.0010) [2023-12-26 12:59:15,938][123090] Updated weights for policy 1, policy_version 1666036 (0.0008) [2023-12-26 12:59:15,966][123091] Updated weights for policy 0, policy_version 1677243 (0.0008) [2023-12-26 12:59:15,986][123090] Updated weights for policy 1, policy_version 1666046 (0.0007) [2023-12-26 12:59:16,036][123091] Updated weights for policy 0, policy_version 1677253 (0.0007) [2023-12-26 12:59:16,104][123091] Updated weights for policy 0, policy_version 1677263 (0.0009) [2023-12-26 12:59:16,752][123090] Updated weights for policy 1, policy_version 1666056 (0.0009) [2023-12-26 12:59:16,802][123090] Updated weights for policy 1, policy_version 1666067 (0.0010) [2023-12-26 12:59:16,864][123090] Updated weights for policy 1, policy_version 1666077 (0.0010) [2023-12-26 12:59:16,904][123091] Updated weights for policy 0, policy_version 1677273 (0.0009) [2023-12-26 12:59:16,958][123091] Updated weights for policy 0, policy_version 1677283 (0.0009) [2023-12-26 12:59:17,005][123091] Updated weights for policy 0, policy_version 1677293 (0.0009) [2023-12-26 12:59:17,607][123090] Updated weights for policy 1, policy_version 1666087 (0.0009) [2023-12-26 12:59:17,670][123090] Updated weights for policy 1, policy_version 1666097 (0.0009) [2023-12-26 12:59:17,731][123090] Updated weights for policy 1, policy_version 1666107 (0.0009) [2023-12-26 12:59:17,872][123091] Updated weights for policy 0, policy_version 1677303 (0.0009) [2023-12-26 12:59:17,936][123091] Updated weights for policy 0, policy_version 1677313 (0.0009) [2023-12-26 12:59:17,988][123091] Updated weights for policy 0, policy_version 1677323 (0.0009) [2023-12-26 12:59:18,535][123090] Updated weights for policy 1, policy_version 1666117 (0.0009) [2023-12-26 12:59:18,609][123090] Updated weights for policy 1, policy_version 1666127 (0.0011) [2023-12-26 12:59:18,673][123090] Updated weights for policy 1, policy_version 1666137 (0.0011) [2023-12-26 12:59:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 855932928. Throughput: 0: 8767.6, 1: 8860.8. Samples: 855943884. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:18,784][121949] Avg episode reward: [(0, '5967.295'), (1, '5654.381')] [2023-12-26 12:59:18,838][123091] Updated weights for policy 0, policy_version 1677333 (0.0008) [2023-12-26 12:59:18,902][123091] Updated weights for policy 0, policy_version 1677343 (0.0008) [2023-12-26 12:59:18,962][123091] Updated weights for policy 0, policy_version 1677353 (0.0008) [2023-12-26 12:59:19,502][123090] Updated weights for policy 1, policy_version 1666147 (0.0011) [2023-12-26 12:59:19,574][123090] Updated weights for policy 1, policy_version 1666157 (0.0006) [2023-12-26 12:59:19,641][123090] Updated weights for policy 1, policy_version 1666167 (0.0007) [2023-12-26 12:59:19,797][123091] Updated weights for policy 0, policy_version 1677363 (0.0008) [2023-12-26 12:59:19,864][123091] Updated weights for policy 0, policy_version 1677373 (0.0010) [2023-12-26 12:59:19,934][123091] Updated weights for policy 0, policy_version 1677383 (0.0010) [2023-12-26 12:59:20,422][123090] Updated weights for policy 1, policy_version 1666177 (0.0011) [2023-12-26 12:59:20,475][123090] Updated weights for policy 1, policy_version 1666187 (0.0011) [2023-12-26 12:59:20,532][123090] Updated weights for policy 1, policy_version 1666197 (0.0011) [2023-12-26 12:59:20,595][123090] Updated weights for policy 1, policy_version 1666207 (0.0011) [2023-12-26 12:59:20,800][123091] Updated weights for policy 0, policy_version 1677393 (0.0009) [2023-12-26 12:59:20,867][123091] Updated weights for policy 0, policy_version 1677403 (0.0009) [2023-12-26 12:59:20,931][123091] Updated weights for policy 0, policy_version 1677413 (0.0009) [2023-12-26 12:59:20,987][123091] Updated weights for policy 0, policy_version 1677423 (0.0009) [2023-12-26 12:59:21,461][123090] Updated weights for policy 1, policy_version 1666217 (0.0011) [2023-12-26 12:59:21,514][123090] Updated weights for policy 1, policy_version 1666227 (0.0011) [2023-12-26 12:59:21,568][123090] Updated weights for policy 1, policy_version 1666237 (0.0011) [2023-12-26 12:59:21,852][123091] Updated weights for policy 0, policy_version 1677433 (0.0009) [2023-12-26 12:59:21,915][123091] Updated weights for policy 0, policy_version 1677443 (0.0009) [2023-12-26 12:59:21,972][123091] Updated weights for policy 0, policy_version 1677453 (0.0009) [2023-12-26 12:59:22,456][123090] Updated weights for policy 1, policy_version 1666247 (0.0010) [2023-12-26 12:59:22,512][123090] Updated weights for policy 1, policy_version 1666257 (0.0010) [2023-12-26 12:59:22,573][123090] Updated weights for policy 1, policy_version 1666267 (0.0011) [2023-12-26 12:59:22,831][123091] Updated weights for policy 0, policy_version 1677463 (0.0009) [2023-12-26 12:59:22,895][123091] Updated weights for policy 0, policy_version 1677473 (0.0009) [2023-12-26 12:59:22,956][123091] Updated weights for policy 0, policy_version 1677483 (0.0009) [2023-12-26 12:59:23,433][123090] Updated weights for policy 1, policy_version 1666277 (0.0010) [2023-12-26 12:59:23,492][123090] Updated weights for policy 1, policy_version 1666287 (0.0010) [2023-12-26 12:59:23,550][123090] Updated weights for policy 1, policy_version 1666297 (0.0010) [2023-12-26 12:59:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 856014848. Throughput: 0: 8689.2, 1: 8808.1. Samples: 855994160. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:23,785][121949] Avg episode reward: [(0, '5938.974'), (1, '5846.778')] [2023-12-26 12:59:23,789][123091] Updated weights for policy 0, policy_version 1677493 (0.0009) [2023-12-26 12:59:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001666304_426573824.pth... [2023-12-26 12:59:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001665248_426303488.pth [2023-12-26 12:59:23,845][123091] Updated weights for policy 0, policy_version 1677503 (0.0010) [2023-12-26 12:59:23,897][123091] Updated weights for policy 0, policy_version 1677513 (0.0010) [2023-12-26 12:59:23,926][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001677520_429449216.pth... [2023-12-26 12:59:23,929][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001676496_429187072.pth [2023-12-26 12:59:24,297][123090] Updated weights for policy 1, policy_version 1666307 (0.0009) [2023-12-26 12:59:24,367][123090] Updated weights for policy 1, policy_version 1666317 (0.0005) [2023-12-26 12:59:24,432][123090] Updated weights for policy 1, policy_version 1666327 (0.0007) [2023-12-26 12:59:24,801][123091] Updated weights for policy 0, policy_version 1677524 (0.0010) [2023-12-26 12:59:24,864][123091] Updated weights for policy 0, policy_version 1677534 (0.0010) [2023-12-26 12:59:24,926][123091] Updated weights for policy 0, policy_version 1677544 (0.0010) [2023-12-26 12:59:25,033][123090] Updated weights for policy 1, policy_version 1666337 (0.0007) [2023-12-26 12:59:25,097][123090] Updated weights for policy 1, policy_version 1666347 (0.0008) [2023-12-26 12:59:25,154][123090] Updated weights for policy 1, policy_version 1666357 (0.0010) [2023-12-26 12:59:25,206][123090] Updated weights for policy 1, policy_version 1666367 (0.0005) [2023-12-26 12:59:25,673][123091] Updated weights for policy 0, policy_version 1677554 (0.0009) [2023-12-26 12:59:25,744][123091] Updated weights for policy 0, policy_version 1677564 (0.0006) [2023-12-26 12:59:25,805][123091] Updated weights for policy 0, policy_version 1677574 (0.0007) [2023-12-26 12:59:25,857][123091] Updated weights for policy 0, policy_version 1677584 (0.0009) [2023-12-26 12:59:25,930][123090] Updated weights for policy 1, policy_version 1666377 (0.0005) [2023-12-26 12:59:25,992][123090] Updated weights for policy 1, policy_version 1666387 (0.0005) [2023-12-26 12:59:26,056][123090] Updated weights for policy 1, policy_version 1666397 (0.0005) [2023-12-26 12:59:26,620][123091] Updated weights for policy 0, policy_version 1677594 (0.0006) [2023-12-26 12:59:26,678][123091] Updated weights for policy 0, policy_version 1677604 (0.0010) [2023-12-26 12:59:26,739][123091] Updated weights for policy 0, policy_version 1677614 (0.0010) [2023-12-26 12:59:26,829][123090] Updated weights for policy 1, policy_version 1666407 (0.0005) [2023-12-26 12:59:26,898][123090] Updated weights for policy 1, policy_version 1666417 (0.0008) [2023-12-26 12:59:26,960][123090] Updated weights for policy 1, policy_version 1666427 (0.0008) [2023-12-26 12:59:27,452][123091] Updated weights for policy 0, policy_version 1677624 (0.0006) [2023-12-26 12:59:27,503][123091] Updated weights for policy 0, policy_version 1677634 (0.0005) [2023-12-26 12:59:27,565][123091] Updated weights for policy 0, policy_version 1677644 (0.0005) [2023-12-26 12:59:27,723][123090] Updated weights for policy 1, policy_version 1666437 (0.0010) [2023-12-26 12:59:27,766][123090] Updated weights for policy 1, policy_version 1666447 (0.0010) [2023-12-26 12:59:27,813][123090] Updated weights for policy 1, policy_version 1666457 (0.0010) [2023-12-26 12:59:28,214][123091] Updated weights for policy 0, policy_version 1677654 (0.0005) [2023-12-26 12:59:28,276][123091] Updated weights for policy 0, policy_version 1677664 (0.0009) [2023-12-26 12:59:28,326][123091] Updated weights for policy 0, policy_version 1677674 (0.0010) [2023-12-26 12:59:28,665][123090] Updated weights for policy 1, policy_version 1666467 (0.0010) [2023-12-26 12:59:28,723][123090] Updated weights for policy 1, policy_version 1666477 (0.0010) [2023-12-26 12:59:28,778][123090] Updated weights for policy 1, policy_version 1666487 (0.0010) [2023-12-26 12:59:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 856104960. Throughput: 0: 8691.1, 1: 8922.1. Samples: 856102180. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:28,784][121949] Avg episode reward: [(0, '5733.792'), (1, '5970.218')] [2023-12-26 12:59:29,142][123091] Updated weights for policy 0, policy_version 1677684 (0.0011) [2023-12-26 12:59:29,203][123091] Updated weights for policy 0, policy_version 1677694 (0.0010) [2023-12-26 12:59:29,271][123091] Updated weights for policy 0, policy_version 1677704 (0.0011) [2023-12-26 12:59:29,604][123090] Updated weights for policy 1, policy_version 1666497 (0.0010) [2023-12-26 12:59:29,663][123090] Updated weights for policy 1, policy_version 1666507 (0.0011) [2023-12-26 12:59:29,729][123090] Updated weights for policy 1, policy_version 1666517 (0.0010) [2023-12-26 12:59:29,799][123090] Updated weights for policy 1, policy_version 1666527 (0.0011) [2023-12-26 12:59:30,099][123091] Updated weights for policy 0, policy_version 1677714 (0.0010) [2023-12-26 12:59:30,146][123091] Updated weights for policy 0, policy_version 1677724 (0.0010) [2023-12-26 12:59:30,193][123091] Updated weights for policy 0, policy_version 1677734 (0.0010) [2023-12-26 12:59:30,251][123091] Updated weights for policy 0, policy_version 1677744 (0.0010) [2023-12-26 12:59:30,600][123090] Updated weights for policy 1, policy_version 1666537 (0.0010) [2023-12-26 12:59:30,650][123090] Updated weights for policy 1, policy_version 1666547 (0.0010) [2023-12-26 12:59:30,703][123090] Updated weights for policy 1, policy_version 1666557 (0.0007) [2023-12-26 12:59:31,095][123091] Updated weights for policy 0, policy_version 1677754 (0.0011) [2023-12-26 12:59:31,165][123091] Updated weights for policy 0, policy_version 1677764 (0.0009) [2023-12-26 12:59:31,229][123091] Updated weights for policy 0, policy_version 1677774 (0.0009) [2023-12-26 12:59:31,442][123090] Updated weights for policy 1, policy_version 1666567 (0.0009) [2023-12-26 12:59:31,500][123090] Updated weights for policy 1, policy_version 1666577 (0.0010) [2023-12-26 12:59:31,559][123090] Updated weights for policy 1, policy_version 1666587 (0.0010) [2023-12-26 12:59:32,020][123091] Updated weights for policy 0, policy_version 1677784 (0.0007) [2023-12-26 12:59:32,076][123091] Updated weights for policy 0, policy_version 1677794 (0.0006) [2023-12-26 12:59:32,131][123091] Updated weights for policy 0, policy_version 1677804 (0.0008) [2023-12-26 12:59:32,381][123090] Updated weights for policy 1, policy_version 1666597 (0.0008) [2023-12-26 12:59:32,439][123090] Updated weights for policy 1, policy_version 1666607 (0.0008) [2023-12-26 12:59:32,487][123090] Updated weights for policy 1, policy_version 1666617 (0.0008) [2023-12-26 12:59:32,979][123091] Updated weights for policy 0, policy_version 1677814 (0.0010) [2023-12-26 12:59:33,027][123091] Updated weights for policy 0, policy_version 1677824 (0.0010) [2023-12-26 12:59:33,085][123091] Updated weights for policy 0, policy_version 1677834 (0.0010) [2023-12-26 12:59:33,344][123090] Updated weights for policy 1, policy_version 1666627 (0.0009) [2023-12-26 12:59:33,401][123090] Updated weights for policy 1, policy_version 1666637 (0.0008) [2023-12-26 12:59:33,449][123090] Updated weights for policy 1, policy_version 1666647 (0.0008) [2023-12-26 12:59:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 856195072. Throughput: 0: 8743.4, 1: 8865.4. Samples: 856206744. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:33,785][121949] Avg episode reward: [(0, '5869.545'), (1, '5877.056')] [2023-12-26 12:59:33,851][123091] Updated weights for policy 0, policy_version 1677844 (0.0010) [2023-12-26 12:59:33,918][123091] Updated weights for policy 0, policy_version 1677854 (0.0008) [2023-12-26 12:59:33,980][123091] Updated weights for policy 0, policy_version 1677864 (0.0007) [2023-12-26 12:59:34,190][123090] Updated weights for policy 1, policy_version 1666657 (0.0008) [2023-12-26 12:59:34,253][123090] Updated weights for policy 1, policy_version 1666667 (0.0011) [2023-12-26 12:59:34,306][123090] Updated weights for policy 1, policy_version 1666677 (0.0011) [2023-12-26 12:59:34,355][123090] Updated weights for policy 1, policy_version 1666687 (0.0010) [2023-12-26 12:59:34,752][123091] Updated weights for policy 0, policy_version 1677874 (0.0008) [2023-12-26 12:59:34,818][123091] Updated weights for policy 0, policy_version 1677884 (0.0011) [2023-12-26 12:59:34,880][123091] Updated weights for policy 0, policy_version 1677894 (0.0010) [2023-12-26 12:59:34,941][123091] Updated weights for policy 0, policy_version 1677904 (0.0010) [2023-12-26 12:59:35,217][123090] Updated weights for policy 1, policy_version 1666697 (0.0006) [2023-12-26 12:59:35,276][123090] Updated weights for policy 1, policy_version 1666707 (0.0009) [2023-12-26 12:59:35,342][123090] Updated weights for policy 1, policy_version 1666717 (0.0010) [2023-12-26 12:59:35,737][123091] Updated weights for policy 0, policy_version 1677914 (0.0007) [2023-12-26 12:59:35,793][123091] Updated weights for policy 0, policy_version 1677924 (0.0009) [2023-12-26 12:59:35,852][123091] Updated weights for policy 0, policy_version 1677934 (0.0009) [2023-12-26 12:59:36,068][123090] Updated weights for policy 1, policy_version 1666727 (0.0007) [2023-12-26 12:59:36,136][123090] Updated weights for policy 1, policy_version 1666737 (0.0008) [2023-12-26 12:59:36,198][123090] Updated weights for policy 1, policy_version 1666747 (0.0010) [2023-12-26 12:59:36,734][123091] Updated weights for policy 0, policy_version 1677944 (0.0007) [2023-12-26 12:59:36,809][123091] Updated weights for policy 0, policy_version 1677954 (0.0006) [2023-12-26 12:59:36,867][123091] Updated weights for policy 0, policy_version 1677964 (0.0006) [2023-12-26 12:59:36,902][123090] Updated weights for policy 1, policy_version 1666757 (0.0009) [2023-12-26 12:59:36,967][123090] Updated weights for policy 1, policy_version 1666767 (0.0006) [2023-12-26 12:59:37,033][123090] Updated weights for policy 1, policy_version 1666777 (0.0005) [2023-12-26 12:59:37,529][123091] Updated weights for policy 0, policy_version 1677974 (0.0006) [2023-12-26 12:59:37,598][123091] Updated weights for policy 0, policy_version 1677984 (0.0006) [2023-12-26 12:59:37,675][123091] Updated weights for policy 0, policy_version 1677994 (0.0006) [2023-12-26 12:59:37,774][123090] Updated weights for policy 1, policy_version 1666787 (0.0005) [2023-12-26 12:59:37,823][123090] Updated weights for policy 1, policy_version 1666797 (0.0005) [2023-12-26 12:59:37,875][123090] Updated weights for policy 1, policy_version 1666807 (0.0005) [2023-12-26 12:59:38,349][123091] Updated weights for policy 0, policy_version 1678004 (0.0007) [2023-12-26 12:59:38,412][123091] Updated weights for policy 0, policy_version 1678014 (0.0006) [2023-12-26 12:59:38,470][123091] Updated weights for policy 0, policy_version 1678024 (0.0010) [2023-12-26 12:59:38,682][123090] Updated weights for policy 1, policy_version 1666817 (0.0005) [2023-12-26 12:59:38,752][123090] Updated weights for policy 1, policy_version 1666827 (0.0009) [2023-12-26 12:59:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 856285184. Throughput: 0: 8758.2, 1: 8907.2. Samples: 856260652. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:38,785][121949] Avg episode reward: [(0, '5884.618'), (1, '5869.020')] [2023-12-26 12:59:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001678032_429580288.pth... [2023-12-26 12:59:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001677008_429318144.pth [2023-12-26 12:59:38,819][123090] Updated weights for policy 1, policy_version 1666837 (0.0008) [2023-12-26 12:59:38,895][123090] Updated weights for policy 1, policy_version 1666847 (0.0005) [2023-12-26 12:59:38,902][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001666848_426713088.pth... [2023-12-26 12:59:38,907][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001665792_426442752.pth [2023-12-26 12:59:39,375][123091] Updated weights for policy 0, policy_version 1678034 (0.0008) [2023-12-26 12:59:39,439][123091] Updated weights for policy 0, policy_version 1678044 (0.0010) [2023-12-26 12:59:39,491][123091] Updated weights for policy 0, policy_version 1678054 (0.0011) [2023-12-26 12:59:39,559][123091] Updated weights for policy 0, policy_version 1678064 (0.0011) [2023-12-26 12:59:39,647][123090] Updated weights for policy 1, policy_version 1666857 (0.0010) [2023-12-26 12:59:39,711][123090] Updated weights for policy 1, policy_version 1666867 (0.0011) [2023-12-26 12:59:39,767][123090] Updated weights for policy 1, policy_version 1666877 (0.0010) [2023-12-26 12:59:40,442][123091] Updated weights for policy 0, policy_version 1678074 (0.0011) [2023-12-26 12:59:40,513][123091] Updated weights for policy 0, policy_version 1678084 (0.0011) [2023-12-26 12:59:40,551][123090] Updated weights for policy 1, policy_version 1666887 (0.0007) [2023-12-26 12:59:40,588][123091] Updated weights for policy 0, policy_version 1678094 (0.0011) [2023-12-26 12:59:40,614][123090] Updated weights for policy 1, policy_version 1666897 (0.0006) [2023-12-26 12:59:40,682][123090] Updated weights for policy 1, policy_version 1666907 (0.0006) [2023-12-26 12:59:41,349][123091] Updated weights for policy 0, policy_version 1678104 (0.0007) [2023-12-26 12:59:41,416][123091] Updated weights for policy 0, policy_version 1678114 (0.0009) [2023-12-26 12:59:41,488][123091] Updated weights for policy 0, policy_version 1678124 (0.0009) [2023-12-26 12:59:41,513][123090] Updated weights for policy 1, policy_version 1666917 (0.0009) [2023-12-26 12:59:41,580][123090] Updated weights for policy 1, policy_version 1666927 (0.0008) [2023-12-26 12:59:41,652][123090] Updated weights for policy 1, policy_version 1666937 (0.0009) [2023-12-26 12:59:42,281][123091] Updated weights for policy 0, policy_version 1678134 (0.0008) [2023-12-26 12:59:42,349][123091] Updated weights for policy 0, policy_version 1678144 (0.0010) [2023-12-26 12:59:42,421][123091] Updated weights for policy 0, policy_version 1678154 (0.0009) [2023-12-26 12:59:42,541][123090] Updated weights for policy 1, policy_version 1666947 (0.0008) [2023-12-26 12:59:42,614][123090] Updated weights for policy 1, policy_version 1666957 (0.0005) [2023-12-26 12:59:42,675][123090] Updated weights for policy 1, policy_version 1666967 (0.0006) [2023-12-26 12:59:43,254][123091] Updated weights for policy 0, policy_version 1678164 (0.0010) [2023-12-26 12:59:43,317][123091] Updated weights for policy 0, policy_version 1678174 (0.0009) [2023-12-26 12:59:43,388][123091] Updated weights for policy 0, policy_version 1678184 (0.0009) [2023-12-26 12:59:43,443][123090] Updated weights for policy 1, policy_version 1666977 (0.0006) [2023-12-26 12:59:43,508][123090] Updated weights for policy 1, policy_version 1666987 (0.0010) [2023-12-26 12:59:43,578][123090] Updated weights for policy 1, policy_version 1666997 (0.0008) [2023-12-26 12:59:43,644][123090] Updated weights for policy 1, policy_version 1667007 (0.0008) [2023-12-26 12:59:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 856375296. Throughput: 0: 8726.8, 1: 8951.5. Samples: 856366004. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:43,785][121949] Avg episode reward: [(0, '5841.064'), (1, '5885.225')] [2023-12-26 12:59:44,255][123091] Updated weights for policy 0, policy_version 1678194 (0.0010) [2023-12-26 12:59:44,312][123091] Updated weights for policy 0, policy_version 1678204 (0.0010) [2023-12-26 12:59:44,333][123090] Updated weights for policy 1, policy_version 1667017 (0.0007) [2023-12-26 12:59:44,374][123091] Updated weights for policy 0, policy_version 1678214 (0.0008) [2023-12-26 12:59:44,400][123090] Updated weights for policy 1, policy_version 1667027 (0.0009) [2023-12-26 12:59:44,425][123091] Updated weights for policy 0, policy_version 1678224 (0.0007) [2023-12-26 12:59:44,468][123090] Updated weights for policy 1, policy_version 1667037 (0.0010) [2023-12-26 12:59:45,252][123090] Updated weights for policy 1, policy_version 1667047 (0.0008) [2023-12-26 12:59:45,268][123091] Updated weights for policy 0, policy_version 1678234 (0.0007) [2023-12-26 12:59:45,310][123090] Updated weights for policy 1, policy_version 1667057 (0.0009) [2023-12-26 12:59:45,328][123091] Updated weights for policy 0, policy_version 1678244 (0.0009) [2023-12-26 12:59:45,363][123090] Updated weights for policy 1, policy_version 1667067 (0.0009) [2023-12-26 12:59:45,388][123091] Updated weights for policy 0, policy_version 1678254 (0.0008) [2023-12-26 12:59:46,150][123090] Updated weights for policy 1, policy_version 1667077 (0.0006) [2023-12-26 12:59:46,178][123091] Updated weights for policy 0, policy_version 1678264 (0.0008) [2023-12-26 12:59:46,198][123090] Updated weights for policy 1, policy_version 1667087 (0.0008) [2023-12-26 12:59:46,227][123091] Updated weights for policy 0, policy_version 1678274 (0.0008) [2023-12-26 12:59:46,251][123090] Updated weights for policy 1, policy_version 1667097 (0.0008) [2023-12-26 12:59:46,283][123091] Updated weights for policy 0, policy_version 1678284 (0.0007) [2023-12-26 12:59:47,046][123091] Updated weights for policy 0, policy_version 1678294 (0.0007) [2023-12-26 12:59:47,104][123091] Updated weights for policy 0, policy_version 1678304 (0.0005) [2023-12-26 12:59:47,111][123090] Updated weights for policy 1, policy_version 1667107 (0.0007) [2023-12-26 12:59:47,166][123091] Updated weights for policy 0, policy_version 1678314 (0.0006) [2023-12-26 12:59:47,174][123090] Updated weights for policy 1, policy_version 1667117 (0.0006) [2023-12-26 12:59:47,229][123090] Updated weights for policy 1, policy_version 1667127 (0.0008) [2023-12-26 12:59:47,797][123091] Updated weights for policy 0, policy_version 1678324 (0.0007) [2023-12-26 12:59:47,853][123091] Updated weights for policy 0, policy_version 1678334 (0.0010) [2023-12-26 12:59:47,908][123091] Updated weights for policy 0, policy_version 1678344 (0.0009) [2023-12-26 12:59:48,048][123090] Updated weights for policy 1, policy_version 1667137 (0.0009) [2023-12-26 12:59:48,115][123090] Updated weights for policy 1, policy_version 1667147 (0.0010) [2023-12-26 12:59:48,177][123090] Updated weights for policy 1, policy_version 1667157 (0.0009) [2023-12-26 12:59:48,234][123090] Updated weights for policy 1, policy_version 1667167 (0.0008) [2023-12-26 12:59:48,711][123091] Updated weights for policy 0, policy_version 1678354 (0.0009) [2023-12-26 12:59:48,774][123091] Updated weights for policy 0, policy_version 1678364 (0.0011) [2023-12-26 12:59:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 856457216. Throughput: 0: 8687.3, 1: 8945.2. Samples: 856472240. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:48,785][121949] Avg episode reward: [(0, '5718.458'), (1, '5910.512')] [2023-12-26 12:59:48,820][123091] Updated weights for policy 0, policy_version 1678374 (0.0006) [2023-12-26 12:59:48,877][123091] Updated weights for policy 0, policy_version 1678384 (0.0005) [2023-12-26 12:59:49,003][123090] Updated weights for policy 1, policy_version 1667177 (0.0010) [2023-12-26 12:59:49,074][123090] Updated weights for policy 1, policy_version 1667187 (0.0011) [2023-12-26 12:59:49,145][123090] Updated weights for policy 1, policy_version 1667197 (0.0010) [2023-12-26 12:59:49,655][123091] Updated weights for policy 0, policy_version 1678394 (0.0008) [2023-12-26 12:59:49,713][123091] Updated weights for policy 0, policy_version 1678404 (0.0009) [2023-12-26 12:59:49,780][123091] Updated weights for policy 0, policy_version 1678414 (0.0010) [2023-12-26 12:59:49,955][123090] Updated weights for policy 1, policy_version 1667207 (0.0009) [2023-12-26 12:59:50,023][123090] Updated weights for policy 1, policy_version 1667217 (0.0007) [2023-12-26 12:59:50,079][123090] Updated weights for policy 1, policy_version 1667227 (0.0010) [2023-12-26 12:59:50,667][123091] Updated weights for policy 0, policy_version 1678424 (0.0010) [2023-12-26 12:59:50,721][123091] Updated weights for policy 0, policy_version 1678434 (0.0010) [2023-12-26 12:59:50,786][123091] Updated weights for policy 0, policy_version 1678444 (0.0009) [2023-12-26 12:59:50,853][123090] Updated weights for policy 1, policy_version 1667237 (0.0008) [2023-12-26 12:59:50,920][123090] Updated weights for policy 1, policy_version 1667247 (0.0006) [2023-12-26 12:59:50,988][123090] Updated weights for policy 1, policy_version 1667257 (0.0009) [2023-12-26 12:59:51,594][123091] Updated weights for policy 0, policy_version 1678454 (0.0006) [2023-12-26 12:59:51,660][123091] Updated weights for policy 0, policy_version 1678464 (0.0010) [2023-12-26 12:59:51,733][123091] Updated weights for policy 0, policy_version 1678474 (0.0009) [2023-12-26 12:59:51,756][123090] Updated weights for policy 1, policy_version 1667267 (0.0010) [2023-12-26 12:59:51,821][123090] Updated weights for policy 1, policy_version 1667277 (0.0009) [2023-12-26 12:59:51,891][123090] Updated weights for policy 1, policy_version 1667287 (0.0007) [2023-12-26 12:59:52,461][123091] Updated weights for policy 0, policy_version 1678484 (0.0009) [2023-12-26 12:59:52,529][123091] Updated weights for policy 0, policy_version 1678495 (0.0010) [2023-12-26 12:59:52,584][123091] Updated weights for policy 0, policy_version 1678505 (0.0010) [2023-12-26 12:59:52,685][123090] Updated weights for policy 1, policy_version 1667297 (0.0009) [2023-12-26 12:59:52,746][123090] Updated weights for policy 1, policy_version 1667307 (0.0009) [2023-12-26 12:59:52,800][123090] Updated weights for policy 1, policy_version 1667317 (0.0009) [2023-12-26 12:59:52,868][123090] Updated weights for policy 1, policy_version 1667327 (0.0009) [2023-12-26 12:59:53,455][123091] Updated weights for policy 0, policy_version 1678515 (0.0009) [2023-12-26 12:59:53,514][123091] Updated weights for policy 0, policy_version 1678525 (0.0008) [2023-12-26 12:59:53,554][123090] Updated weights for policy 1, policy_version 1667337 (0.0008) [2023-12-26 12:59:53,561][123091] Updated weights for policy 0, policy_version 1678535 (0.0009) [2023-12-26 12:59:53,605][123090] Updated weights for policy 1, policy_version 1667347 (0.0010) [2023-12-26 12:59:53,652][123090] Updated weights for policy 1, policy_version 1667357 (0.0010) [2023-12-26 12:59:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 856555520. Throughput: 0: 8620.6, 1: 8934.4. Samples: 856524876. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:53,785][121949] Avg episode reward: [(0, '5774.994'), (1, '5725.998')] [2023-12-26 12:59:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001667360_426844160.pth... [2023-12-26 12:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001678544_429711360.pth... [2023-12-26 12:59:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001666304_426573824.pth [2023-12-26 12:59:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001677520_429449216.pth [2023-12-26 12:59:54,362][123091] Updated weights for policy 0, policy_version 1678545 (0.0006) [2023-12-26 12:59:54,396][123090] Updated weights for policy 1, policy_version 1667367 (0.0010) [2023-12-26 12:59:54,416][123091] Updated weights for policy 0, policy_version 1678555 (0.0006) [2023-12-26 12:59:54,448][123090] Updated weights for policy 1, policy_version 1667377 (0.0010) [2023-12-26 12:59:54,471][123091] Updated weights for policy 0, policy_version 1678565 (0.0010) [2023-12-26 12:59:54,511][123090] Updated weights for policy 1, policy_version 1667387 (0.0006) [2023-12-26 12:59:54,532][123091] Updated weights for policy 0, policy_version 1678575 (0.0009) [2023-12-26 12:59:55,293][123091] Updated weights for policy 0, policy_version 1678585 (0.0009) [2023-12-26 12:59:55,300][123090] Updated weights for policy 1, policy_version 1667397 (0.0006) [2023-12-26 12:59:55,345][123091] Updated weights for policy 0, policy_version 1678595 (0.0008) [2023-12-26 12:59:55,356][123090] Updated weights for policy 1, policy_version 1667407 (0.0005) [2023-12-26 12:59:55,399][123091] Updated weights for policy 0, policy_version 1678605 (0.0009) [2023-12-26 12:59:55,414][123090] Updated weights for policy 1, policy_version 1667417 (0.0005) [2023-12-26 12:59:56,189][123090] Updated weights for policy 1, policy_version 1667427 (0.0007) [2023-12-26 12:59:56,237][123090] Updated weights for policy 1, policy_version 1667437 (0.0009) [2023-12-26 12:59:56,243][123091] Updated weights for policy 0, policy_version 1678615 (0.0006) [2023-12-26 12:59:56,293][123090] Updated weights for policy 1, policy_version 1667447 (0.0009) [2023-12-26 12:59:56,311][123091] Updated weights for policy 0, policy_version 1678625 (0.0008) [2023-12-26 12:59:56,363][123091] Updated weights for policy 0, policy_version 1678635 (0.0009) [2023-12-26 12:59:57,049][123090] Updated weights for policy 1, policy_version 1667457 (0.0007) [2023-12-26 12:59:57,114][123090] Updated weights for policy 1, policy_version 1667467 (0.0010) [2023-12-26 12:59:57,175][123091] Updated weights for policy 0, policy_version 1678645 (0.0008) [2023-12-26 12:59:57,177][123090] Updated weights for policy 1, policy_version 1667477 (0.0009) [2023-12-26 12:59:57,226][123091] Updated weights for policy 0, policy_version 1678655 (0.0005) [2023-12-26 12:59:57,238][123090] Updated weights for policy 1, policy_version 1667487 (0.0008) [2023-12-26 12:59:57,282][123091] Updated weights for policy 0, policy_version 1678665 (0.0005) [2023-12-26 12:59:57,962][123091] Updated weights for policy 0, policy_version 1678675 (0.0006) [2023-12-26 12:59:58,030][123091] Updated weights for policy 0, policy_version 1678685 (0.0009) [2023-12-26 12:59:58,096][123091] Updated weights for policy 0, policy_version 1678695 (0.0009) [2023-12-26 12:59:58,112][123090] Updated weights for policy 1, policy_version 1667497 (0.0008) [2023-12-26 12:59:58,176][123090] Updated weights for policy 1, policy_version 1667507 (0.0010) [2023-12-26 12:59:58,244][123090] Updated weights for policy 1, policy_version 1667517 (0.0009) [2023-12-26 12:59:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 856637440. Throughput: 0: 8675.3, 1: 8983.9. Samples: 856632448. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 12:59:58,785][121949] Avg episode reward: [(0, '5794.241'), (1, '5778.453')] [2023-12-26 12:59:59,007][123091] Updated weights for policy 0, policy_version 1678705 (0.0007) [2023-12-26 12:59:59,075][123091] Updated weights for policy 0, policy_version 1678715 (0.0008) [2023-12-26 12:59:59,133][123091] Updated weights for policy 0, policy_version 1678725 (0.0008) [2023-12-26 12:59:59,194][123091] Updated weights for policy 0, policy_version 1678735 (0.0007) [2023-12-26 12:59:59,201][123090] Updated weights for policy 1, policy_version 1667527 (0.0010) [2023-12-26 12:59:59,271][123090] Updated weights for policy 1, policy_version 1667537 (0.0009) [2023-12-26 12:59:59,334][123090] Updated weights for policy 1, policy_version 1667547 (0.0010) [2023-12-26 13:00:00,014][123091] Updated weights for policy 0, policy_version 1678745 (0.0008) [2023-12-26 13:00:00,087][123091] Updated weights for policy 0, policy_version 1678755 (0.0006) [2023-12-26 13:00:00,112][123090] Updated weights for policy 1, policy_version 1667557 (0.0009) [2023-12-26 13:00:00,149][123091] Updated weights for policy 0, policy_version 1678765 (0.0007) [2023-12-26 13:00:00,174][123090] Updated weights for policy 1, policy_version 1667567 (0.0007) [2023-12-26 13:00:00,238][123090] Updated weights for policy 1, policy_version 1667577 (0.0010) [2023-12-26 13:00:00,867][123091] Updated weights for policy 0, policy_version 1678775 (0.0007) [2023-12-26 13:00:00,932][123090] Updated weights for policy 1, policy_version 1667587 (0.0009) [2023-12-26 13:00:00,932][123091] Updated weights for policy 0, policy_version 1678785 (0.0005) [2023-12-26 13:00:00,993][123090] Updated weights for policy 1, policy_version 1667597 (0.0007) [2023-12-26 13:00:01,002][123091] Updated weights for policy 0, policy_version 1678795 (0.0005) [2023-12-26 13:00:01,059][123090] Updated weights for policy 1, policy_version 1667607 (0.0008) [2023-12-26 13:00:01,645][123091] Updated weights for policy 0, policy_version 1678805 (0.0008) [2023-12-26 13:00:01,714][123091] Updated weights for policy 0, policy_version 1678815 (0.0010) [2023-12-26 13:00:01,774][123091] Updated weights for policy 0, policy_version 1678825 (0.0010) [2023-12-26 13:00:01,874][123090] Updated weights for policy 1, policy_version 1667617 (0.0010) [2023-12-26 13:00:01,933][123090] Updated weights for policy 1, policy_version 1667627 (0.0009) [2023-12-26 13:00:02,001][123090] Updated weights for policy 1, policy_version 1667637 (0.0009) [2023-12-26 13:00:02,069][123090] Updated weights for policy 1, policy_version 1667647 (0.0009) [2023-12-26 13:00:02,609][123091] Updated weights for policy 0, policy_version 1678835 (0.0008) [2023-12-26 13:00:02,656][123091] Updated weights for policy 0, policy_version 1678845 (0.0005) [2023-12-26 13:00:02,701][123091] Updated weights for policy 0, policy_version 1678855 (0.0005) [2023-12-26 13:00:02,858][123090] Updated weights for policy 1, policy_version 1667657 (0.0011) [2023-12-26 13:00:02,917][123090] Updated weights for policy 1, policy_version 1667667 (0.0010) [2023-12-26 13:00:02,961][123090] Updated weights for policy 1, policy_version 1667677 (0.0010) [2023-12-26 13:00:03,454][123091] Updated weights for policy 0, policy_version 1678865 (0.0008) [2023-12-26 13:00:03,505][123091] Updated weights for policy 0, policy_version 1678875 (0.0008) [2023-12-26 13:00:03,552][123091] Updated weights for policy 0, policy_version 1678885 (0.0008) [2023-12-26 13:00:03,599][123091] Updated weights for policy 0, policy_version 1678895 (0.0009) [2023-12-26 13:00:03,773][123090] Updated weights for policy 1, policy_version 1667687 (0.0007) [2023-12-26 13:00:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 856727552. Throughput: 0: 8797.6, 1: 8872.6. Samples: 856739044. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 13:00:03,785][121949] Avg episode reward: [(0, '5792.503'), (1, '5883.562')] [2023-12-26 13:00:03,823][123090] Updated weights for policy 1, policy_version 1667697 (0.0005) [2023-12-26 13:00:03,884][123090] Updated weights for policy 1, policy_version 1667707 (0.0007) [2023-12-26 13:00:04,491][123091] Updated weights for policy 0, policy_version 1678905 (0.0009) [2023-12-26 13:00:04,555][123091] Updated weights for policy 0, policy_version 1678915 (0.0009) [2023-12-26 13:00:04,607][123091] Updated weights for policy 0, policy_version 1678925 (0.0009) [2023-12-26 13:00:04,679][123090] Updated weights for policy 1, policy_version 1667717 (0.0008) [2023-12-26 13:00:04,749][123090] Updated weights for policy 1, policy_version 1667727 (0.0010) [2023-12-26 13:00:04,827][123090] Updated weights for policy 1, policy_version 1667737 (0.0011) [2023-12-26 13:00:05,326][123091] Updated weights for policy 0, policy_version 1678935 (0.0009) [2023-12-26 13:00:05,374][123091] Updated weights for policy 0, policy_version 1678945 (0.0009) [2023-12-26 13:00:05,438][123091] Updated weights for policy 0, policy_version 1678955 (0.0009) [2023-12-26 13:00:05,637][123090] Updated weights for policy 1, policy_version 1667747 (0.0009) [2023-12-26 13:00:05,691][123090] Updated weights for policy 1, policy_version 1667757 (0.0008) [2023-12-26 13:00:05,741][123090] Updated weights for policy 1, policy_version 1667767 (0.0005) [2023-12-26 13:00:06,303][123091] Updated weights for policy 0, policy_version 1678965 (0.0008) [2023-12-26 13:00:06,371][123091] Updated weights for policy 0, policy_version 1678975 (0.0009) [2023-12-26 13:00:06,402][123090] Updated weights for policy 1, policy_version 1667777 (0.0007) [2023-12-26 13:00:06,439][123091] Updated weights for policy 0, policy_version 1678985 (0.0010) [2023-12-26 13:00:06,478][123090] Updated weights for policy 1, policy_version 1667787 (0.0008) [2023-12-26 13:00:06,544][123090] Updated weights for policy 1, policy_version 1667797 (0.0010) [2023-12-26 13:00:06,614][123090] Updated weights for policy 1, policy_version 1667807 (0.0010) [2023-12-26 13:00:07,298][123091] Updated weights for policy 0, policy_version 1678995 (0.0008) [2023-12-26 13:00:07,347][123091] Updated weights for policy 0, policy_version 1679005 (0.0009) [2023-12-26 13:00:07,395][123091] Updated weights for policy 0, policy_version 1679015 (0.0008) [2023-12-26 13:00:07,453][123090] Updated weights for policy 1, policy_version 1667817 (0.0010) [2023-12-26 13:00:07,500][123090] Updated weights for policy 1, policy_version 1667827 (0.0010) [2023-12-26 13:00:07,548][123090] Updated weights for policy 1, policy_version 1667837 (0.0010) [2023-12-26 13:00:08,266][123091] Updated weights for policy 0, policy_version 1679025 (0.0007) [2023-12-26 13:00:08,334][123091] Updated weights for policy 0, policy_version 1679035 (0.0009) [2023-12-26 13:00:08,397][123091] Updated weights for policy 0, policy_version 1679045 (0.0010) [2023-12-26 13:00:08,403][123090] Updated weights for policy 1, policy_version 1667847 (0.0010) [2023-12-26 13:00:08,455][123091] Updated weights for policy 0, policy_version 1679055 (0.0007) [2023-12-26 13:00:08,467][123090] Updated weights for policy 1, policy_version 1667857 (0.0010) [2023-12-26 13:00:08,529][123090] Updated weights for policy 1, policy_version 1667867 (0.0010) [2023-12-26 13:00:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 856817664. Throughput: 0: 8818.6, 1: 8908.7. Samples: 856791888. Policy #0 lag: (min: 31.0, avg: 32.3, max: 63.0) [2023-12-26 13:00:08,785][121949] Avg episode reward: [(0, '5831.422'), (1, '5932.695')] [2023-12-26 13:00:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001679056_429842432.pth... [2023-12-26 13:00:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001667872_426975232.pth... [2023-12-26 13:00:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001678032_429580288.pth [2023-12-26 13:00:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001666848_426713088.pth [2023-12-26 13:00:09,333][123091] Updated weights for policy 0, policy_version 1679065 (0.0008) [2023-12-26 13:00:09,343][123090] Updated weights for policy 1, policy_version 1667877 (0.0008) [2023-12-26 13:00:09,407][123091] Updated weights for policy 0, policy_version 1679075 (0.0008) [2023-12-26 13:00:09,436][123090] Updated weights for policy 1, policy_version 1667888 (0.0009) [2023-12-26 13:00:09,470][123091] Updated weights for policy 0, policy_version 1679085 (0.0008) [2023-12-26 13:00:09,505][123090] Updated weights for policy 1, policy_version 1667898 (0.0006) [2023-12-26 13:00:10,266][123090] Updated weights for policy 1, policy_version 1667908 (0.0006) [2023-12-26 13:00:10,299][123091] Updated weights for policy 0, policy_version 1679095 (0.0008) [2023-12-26 13:00:10,328][123090] Updated weights for policy 1, policy_version 1667918 (0.0011) [2023-12-26 13:00:10,363][123091] Updated weights for policy 0, policy_version 1679105 (0.0008) [2023-12-26 13:00:10,395][123090] Updated weights for policy 1, policy_version 1667928 (0.0011) [2023-12-26 13:00:10,426][123091] Updated weights for policy 0, policy_version 1679115 (0.0009) [2023-12-26 13:00:11,208][123090] Updated weights for policy 1, policy_version 1667938 (0.0011) [2023-12-26 13:00:11,262][123091] Updated weights for policy 0, policy_version 1679125 (0.0009) [2023-12-26 13:00:11,273][123090] Updated weights for policy 1, policy_version 1667948 (0.0011) [2023-12-26 13:00:11,329][123091] Updated weights for policy 0, policy_version 1679135 (0.0006) [2023-12-26 13:00:11,339][123090] Updated weights for policy 1, policy_version 1667958 (0.0011) [2023-12-26 13:00:11,401][123091] Updated weights for policy 0, policy_version 1679145 (0.0009) [2023-12-26 13:00:11,411][123090] Updated weights for policy 1, policy_version 1667968 (0.0009) [2023-12-26 13:00:12,229][123090] Updated weights for policy 1, policy_version 1667978 (0.0005) [2023-12-26 13:00:12,283][123091] Updated weights for policy 0, policy_version 1679155 (0.0009) [2023-12-26 13:00:12,295][123090] Updated weights for policy 1, policy_version 1667988 (0.0006) [2023-12-26 13:00:12,346][123091] Updated weights for policy 0, policy_version 1679165 (0.0008) [2023-12-26 13:00:12,358][123090] Updated weights for policy 1, policy_version 1667998 (0.0007) [2023-12-26 13:00:12,408][123091] Updated weights for policy 0, policy_version 1679175 (0.0009) [2023-12-26 13:00:13,157][123090] Updated weights for policy 1, policy_version 1668008 (0.0006) [2023-12-26 13:00:13,216][123090] Updated weights for policy 1, policy_version 1668018 (0.0010) [2023-12-26 13:00:13,223][123091] Updated weights for policy 0, policy_version 1679185 (0.0009) [2023-12-26 13:00:13,281][123090] Updated weights for policy 1, policy_version 1668028 (0.0006) [2023-12-26 13:00:13,283][123091] Updated weights for policy 0, policy_version 1679195 (0.0009) [2023-12-26 13:00:13,342][123091] Updated weights for policy 0, policy_version 1679205 (0.0009) [2023-12-26 13:00:13,401][123091] Updated weights for policy 0, policy_version 1679215 (0.0009) [2023-12-26 13:00:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 856899584. Throughput: 0: 8740.1, 1: 8838.0. Samples: 856893192. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:13,785][121949] Avg episode reward: [(0, '5760.709'), (1, '5942.728')] [2023-12-26 13:00:13,979][123090] Updated weights for policy 1, policy_version 1668038 (0.0005) [2023-12-26 13:00:14,043][123090] Updated weights for policy 1, policy_version 1668048 (0.0005) [2023-12-26 13:00:14,105][123090] Updated weights for policy 1, policy_version 1668058 (0.0009) [2023-12-26 13:00:14,130][123091] Updated weights for policy 0, policy_version 1679225 (0.0008) [2023-12-26 13:00:14,183][123091] Updated weights for policy 0, policy_version 1679235 (0.0007) [2023-12-26 13:00:14,245][123091] Updated weights for policy 0, policy_version 1679245 (0.0009) [2023-12-26 13:00:14,899][123090] Updated weights for policy 1, policy_version 1668068 (0.0009) [2023-12-26 13:00:14,976][123090] Updated weights for policy 1, policy_version 1668078 (0.0009) [2023-12-26 13:00:15,044][123090] Updated weights for policy 1, policy_version 1668088 (0.0009) [2023-12-26 13:00:15,060][123091] Updated weights for policy 0, policy_version 1679255 (0.0007) [2023-12-26 13:00:15,126][123091] Updated weights for policy 0, policy_version 1679265 (0.0006) [2023-12-26 13:00:15,197][123091] Updated weights for policy 0, policy_version 1679275 (0.0007) [2023-12-26 13:00:15,923][123091] Updated weights for policy 0, policy_version 1679285 (0.0009) [2023-12-26 13:00:15,925][123090] Updated weights for policy 1, policy_version 1668098 (0.0010) [2023-12-26 13:00:15,982][123091] Updated weights for policy 0, policy_version 1679295 (0.0007) [2023-12-26 13:00:15,988][123090] Updated weights for policy 1, policy_version 1668108 (0.0010) [2023-12-26 13:00:16,036][123091] Updated weights for policy 0, policy_version 1679305 (0.0005) [2023-12-26 13:00:16,049][123090] Updated weights for policy 1, policy_version 1668118 (0.0009) [2023-12-26 13:00:16,114][123090] Updated weights for policy 1, policy_version 1668128 (0.0010) [2023-12-26 13:00:16,789][123091] Updated weights for policy 0, policy_version 1679315 (0.0007) [2023-12-26 13:00:16,848][123091] Updated weights for policy 0, policy_version 1679325 (0.0009) [2023-12-26 13:00:16,891][123091] Updated weights for policy 0, policy_version 1679335 (0.0010) [2023-12-26 13:00:16,983][123090] Updated weights for policy 1, policy_version 1668138 (0.0009) [2023-12-26 13:00:17,035][123090] Updated weights for policy 1, policy_version 1668148 (0.0009) [2023-12-26 13:00:17,090][123090] Updated weights for policy 1, policy_version 1668158 (0.0008) [2023-12-26 13:00:17,720][123091] Updated weights for policy 0, policy_version 1679345 (0.0010) [2023-12-26 13:00:17,773][123091] Updated weights for policy 0, policy_version 1679355 (0.0011) [2023-12-26 13:00:17,834][123091] Updated weights for policy 0, policy_version 1679365 (0.0011) [2023-12-26 13:00:17,837][123090] Updated weights for policy 1, policy_version 1668168 (0.0007) [2023-12-26 13:00:17,894][123091] Updated weights for policy 0, policy_version 1679375 (0.0011) [2023-12-26 13:00:17,902][123090] Updated weights for policy 1, policy_version 1668178 (0.0007) [2023-12-26 13:00:17,966][123090] Updated weights for policy 1, policy_version 1668188 (0.0008) [2023-12-26 13:00:18,686][123090] Updated weights for policy 1, policy_version 1668198 (0.0009) [2023-12-26 13:00:18,706][123091] Updated weights for policy 0, policy_version 1679385 (0.0011) [2023-12-26 13:00:18,734][123090] Updated weights for policy 1, policy_version 1668208 (0.0010) [2023-12-26 13:00:18,754][123091] Updated weights for policy 0, policy_version 1679395 (0.0010) [2023-12-26 13:00:18,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 856981504. Throughput: 0: 8782.7, 1: 8867.4. Samples: 857000996. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:18,784][121949] Avg episode reward: [(0, '5809.891'), (1, '6033.550')] [2023-12-26 13:00:18,790][123090] Updated weights for policy 1, policy_version 1668218 (0.0011) [2023-12-26 13:00:18,817][123091] Updated weights for policy 0, policy_version 1679405 (0.0011) [2023-12-26 13:00:19,620][123090] Updated weights for policy 1, policy_version 1668228 (0.0009) [2023-12-26 13:00:19,651][123091] Updated weights for policy 0, policy_version 1679415 (0.0011) [2023-12-26 13:00:19,687][123090] Updated weights for policy 1, policy_version 1668238 (0.0008) [2023-12-26 13:00:19,714][123091] Updated weights for policy 0, policy_version 1679425 (0.0011) [2023-12-26 13:00:19,744][123090] Updated weights for policy 1, policy_version 1668248 (0.0009) [2023-12-26 13:00:19,781][123091] Updated weights for policy 0, policy_version 1679435 (0.0011) [2023-12-26 13:00:20,484][123090] Updated weights for policy 1, policy_version 1668258 (0.0010) [2023-12-26 13:00:20,518][123091] Updated weights for policy 0, policy_version 1679445 (0.0011) [2023-12-26 13:00:20,549][123090] Updated weights for policy 1, policy_version 1668268 (0.0009) [2023-12-26 13:00:20,590][123091] Updated weights for policy 0, policy_version 1679455 (0.0007) [2023-12-26 13:00:20,616][123090] Updated weights for policy 1, policy_version 1668278 (0.0011) [2023-12-26 13:00:20,652][123091] Updated weights for policy 0, policy_version 1679465 (0.0008) [2023-12-26 13:00:20,683][123090] Updated weights for policy 1, policy_version 1668288 (0.0011) [2023-12-26 13:00:21,478][123091] Updated weights for policy 0, policy_version 1679475 (0.0009) [2023-12-26 13:00:21,537][123090] Updated weights for policy 1, policy_version 1668298 (0.0008) [2023-12-26 13:00:21,552][123091] Updated weights for policy 0, policy_version 1679485 (0.0009) [2023-12-26 13:00:21,605][123090] Updated weights for policy 1, policy_version 1668308 (0.0007) [2023-12-26 13:00:21,627][123091] Updated weights for policy 0, policy_version 1679495 (0.0010) [2023-12-26 13:00:21,684][123090] Updated weights for policy 1, policy_version 1668318 (0.0009) [2023-12-26 13:00:22,450][123091] Updated weights for policy 0, policy_version 1679505 (0.0010) [2023-12-26 13:00:22,516][123091] Updated weights for policy 0, policy_version 1679515 (0.0010) [2023-12-26 13:00:22,558][123090] Updated weights for policy 1, policy_version 1668328 (0.0008) [2023-12-26 13:00:22,578][123091] Updated weights for policy 0, policy_version 1679525 (0.0008) [2023-12-26 13:00:22,625][123090] Updated weights for policy 1, policy_version 1668338 (0.0008) [2023-12-26 13:00:22,646][123091] Updated weights for policy 0, policy_version 1679535 (0.0009) [2023-12-26 13:00:22,693][123090] Updated weights for policy 1, policy_version 1668348 (0.0006) [2023-12-26 13:00:23,477][123091] Updated weights for policy 0, policy_version 1679545 (0.0010) [2023-12-26 13:00:23,536][123091] Updated weights for policy 0, policy_version 1679555 (0.0009) [2023-12-26 13:00:23,538][123090] Updated weights for policy 1, policy_version 1668358 (0.0009) [2023-12-26 13:00:23,590][123091] Updated weights for policy 0, policy_version 1679565 (0.0006) [2023-12-26 13:00:23,602][123090] Updated weights for policy 1, policy_version 1668368 (0.0010) [2023-12-26 13:00:23,667][123090] Updated weights for policy 1, policy_version 1668378 (0.0007) [2023-12-26 13:00:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 857079808. Throughput: 0: 8771.3, 1: 8832.3. Samples: 857052812. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:23,784][121949] Avg episode reward: [(0, '5838.966'), (1, '5870.529')] [2023-12-26 13:00:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001679568_429973504.pth... [2023-12-26 13:00:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001668384_427106304.pth... [2023-12-26 13:00:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001678544_429711360.pth [2023-12-26 13:00:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001667360_426844160.pth [2023-12-26 13:00:24,293][123091] Updated weights for policy 0, policy_version 1679575 (0.0010) [2023-12-26 13:00:24,353][123091] Updated weights for policy 0, policy_version 1679585 (0.0009) [2023-12-26 13:00:24,405][123091] Updated weights for policy 0, policy_version 1679595 (0.0009) [2023-12-26 13:00:24,508][123090] Updated weights for policy 1, policy_version 1668388 (0.0007) [2023-12-26 13:00:24,572][123090] Updated weights for policy 1, policy_version 1668398 (0.0006) [2023-12-26 13:00:24,640][123090] Updated weights for policy 1, policy_version 1668408 (0.0005) [2023-12-26 13:00:25,238][123091] Updated weights for policy 0, policy_version 1679605 (0.0007) [2023-12-26 13:00:25,295][123091] Updated weights for policy 0, policy_version 1679615 (0.0005) [2023-12-26 13:00:25,339][123091] Updated weights for policy 0, policy_version 1679625 (0.0005) [2023-12-26 13:00:25,436][123090] Updated weights for policy 1, policy_version 1668418 (0.0008) [2023-12-26 13:00:25,496][123090] Updated weights for policy 1, policy_version 1668428 (0.0008) [2023-12-26 13:00:25,555][123090] Updated weights for policy 1, policy_version 1668438 (0.0010) [2023-12-26 13:00:25,622][123090] Updated weights for policy 1, policy_version 1668448 (0.0006) [2023-12-26 13:00:26,227][123091] Updated weights for policy 0, policy_version 1679636 (0.0007) [2023-12-26 13:00:26,286][123091] Updated weights for policy 0, policy_version 1679646 (0.0009) [2023-12-26 13:00:26,339][123090] Updated weights for policy 1, policy_version 1668458 (0.0008) [2023-12-26 13:00:26,346][123091] Updated weights for policy 0, policy_version 1679656 (0.0007) [2023-12-26 13:00:26,401][123090] Updated weights for policy 1, policy_version 1668468 (0.0008) [2023-12-26 13:00:26,456][123090] Updated weights for policy 1, policy_version 1668478 (0.0008) [2023-12-26 13:00:27,079][123091] Updated weights for policy 0, policy_version 1679666 (0.0008) [2023-12-26 13:00:27,151][123091] Updated weights for policy 0, policy_version 1679676 (0.0005) [2023-12-26 13:00:27,214][123091] Updated weights for policy 0, policy_version 1679686 (0.0005) [2023-12-26 13:00:27,277][123091] Updated weights for policy 0, policy_version 1679696 (0.0006) [2023-12-26 13:00:27,280][123090] Updated weights for policy 1, policy_version 1668488 (0.0010) [2023-12-26 13:00:27,333][123090] Updated weights for policy 1, policy_version 1668498 (0.0011) [2023-12-26 13:00:27,392][123090] Updated weights for policy 1, policy_version 1668508 (0.0011) [2023-12-26 13:00:28,037][123091] Updated weights for policy 0, policy_version 1679706 (0.0010) [2023-12-26 13:00:28,084][123091] Updated weights for policy 0, policy_version 1679716 (0.0010) [2023-12-26 13:00:28,147][123091] Updated weights for policy 0, policy_version 1679726 (0.0011) [2023-12-26 13:00:28,159][123090] Updated weights for policy 1, policy_version 1668518 (0.0010) [2023-12-26 13:00:28,211][123090] Updated weights for policy 1, policy_version 1668528 (0.0010) [2023-12-26 13:00:28,269][123090] Updated weights for policy 1, policy_version 1668538 (0.0007) [2023-12-26 13:00:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 857161728. Throughput: 0: 8774.8, 1: 8804.3. Samples: 857157064. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:28,785][121949] Avg episode reward: [(0, '5780.072'), (1, '5789.978')] [2023-12-26 13:00:28,996][123091] Updated weights for policy 0, policy_version 1679736 (0.0011) [2023-12-26 13:00:29,044][123091] Updated weights for policy 0, policy_version 1679746 (0.0010) [2023-12-26 13:00:29,076][123090] Updated weights for policy 1, policy_version 1668548 (0.0007) [2023-12-26 13:00:29,092][123091] Updated weights for policy 0, policy_version 1679756 (0.0010) [2023-12-26 13:00:29,135][123090] Updated weights for policy 1, policy_version 1668558 (0.0011) [2023-12-26 13:00:29,195][123090] Updated weights for policy 1, policy_version 1668568 (0.0010) [2023-12-26 13:00:29,917][123091] Updated weights for policy 0, policy_version 1679766 (0.0008) [2023-12-26 13:00:29,987][123091] Updated weights for policy 0, policy_version 1679776 (0.0008) [2023-12-26 13:00:30,038][123090] Updated weights for policy 1, policy_version 1668578 (0.0011) [2023-12-26 13:00:30,051][123091] Updated weights for policy 0, policy_version 1679786 (0.0009) [2023-12-26 13:00:30,098][123090] Updated weights for policy 1, policy_version 1668588 (0.0011) [2023-12-26 13:00:30,150][123090] Updated weights for policy 1, policy_version 1668598 (0.0010) [2023-12-26 13:00:30,221][123090] Updated weights for policy 1, policy_version 1668608 (0.0011) [2023-12-26 13:00:30,790][123091] Updated weights for policy 0, policy_version 1679796 (0.0009) [2023-12-26 13:00:30,853][123091] Updated weights for policy 0, policy_version 1679806 (0.0005) [2023-12-26 13:00:30,923][123091] Updated weights for policy 0, policy_version 1679816 (0.0008) [2023-12-26 13:00:31,019][123090] Updated weights for policy 1, policy_version 1668618 (0.0010) [2023-12-26 13:00:31,086][123090] Updated weights for policy 1, policy_version 1668628 (0.0010) [2023-12-26 13:00:31,160][123090] Updated weights for policy 1, policy_version 1668638 (0.0010) [2023-12-26 13:00:31,787][123091] Updated weights for policy 0, policy_version 1679826 (0.0010) [2023-12-26 13:00:31,842][123091] Updated weights for policy 0, policy_version 1679836 (0.0009) [2023-12-26 13:00:31,905][123091] Updated weights for policy 0, policy_version 1679846 (0.0009) [2023-12-26 13:00:31,963][123091] Updated weights for policy 0, policy_version 1679856 (0.0010) [2023-12-26 13:00:31,965][123090] Updated weights for policy 1, policy_version 1668648 (0.0006) [2023-12-26 13:00:32,022][123090] Updated weights for policy 1, policy_version 1668658 (0.0008) [2023-12-26 13:00:32,081][123090] Updated weights for policy 1, policy_version 1668668 (0.0010) [2023-12-26 13:00:32,831][123091] Updated weights for policy 0, policy_version 1679866 (0.0008) [2023-12-26 13:00:32,893][123091] Updated weights for policy 0, policy_version 1679876 (0.0008) [2023-12-26 13:00:32,893][123090] Updated weights for policy 1, policy_version 1668678 (0.0010) [2023-12-26 13:00:32,951][123091] Updated weights for policy 0, policy_version 1679886 (0.0008) [2023-12-26 13:00:32,956][123090] Updated weights for policy 1, policy_version 1668688 (0.0010) [2023-12-26 13:00:33,018][123090] Updated weights for policy 1, policy_version 1668698 (0.0010) [2023-12-26 13:00:33,781][123091] Updated weights for policy 0, policy_version 1679896 (0.0009) [2023-12-26 13:00:33,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 857243648. Throughput: 0: 8738.3, 1: 8789.6. Samples: 857260996. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:33,784][121949] Avg episode reward: [(0, '5783.820'), (1, '5708.342')] [2023-12-26 13:00:33,813][123090] Updated weights for policy 1, policy_version 1668708 (0.0010) [2023-12-26 13:00:33,831][123091] Updated weights for policy 0, policy_version 1679906 (0.0009) [2023-12-26 13:00:33,872][123090] Updated weights for policy 1, policy_version 1668718 (0.0007) [2023-12-26 13:00:33,877][123091] Updated weights for policy 0, policy_version 1679916 (0.0008) [2023-12-26 13:00:33,936][123090] Updated weights for policy 1, policy_version 1668728 (0.0008) [2023-12-26 13:00:34,704][123090] Updated weights for policy 1, policy_version 1668738 (0.0008) [2023-12-26 13:00:34,763][123091] Updated weights for policy 0, policy_version 1679926 (0.0009) [2023-12-26 13:00:34,768][123090] Updated weights for policy 1, policy_version 1668748 (0.0005) [2023-12-26 13:00:34,826][123090] Updated weights for policy 1, policy_version 1668758 (0.0005) [2023-12-26 13:00:34,834][123091] Updated weights for policy 0, policy_version 1679936 (0.0009) [2023-12-26 13:00:34,892][123090] Updated weights for policy 1, policy_version 1668768 (0.0005) [2023-12-26 13:00:34,905][123091] Updated weights for policy 0, policy_version 1679946 (0.0010) [2023-12-26 13:00:35,528][123090] Updated weights for policy 1, policy_version 1668778 (0.0010) [2023-12-26 13:00:35,592][123090] Updated weights for policy 1, policy_version 1668788 (0.0010) [2023-12-26 13:00:35,606][123091] Updated weights for policy 0, policy_version 1679956 (0.0009) [2023-12-26 13:00:35,652][123091] Updated weights for policy 0, policy_version 1679966 (0.0005) [2023-12-26 13:00:35,655][123090] Updated weights for policy 1, policy_version 1668798 (0.0010) [2023-12-26 13:00:35,709][123091] Updated weights for policy 0, policy_version 1679976 (0.0005) [2023-12-26 13:00:36,415][123090] Updated weights for policy 1, policy_version 1668808 (0.0007) [2023-12-26 13:00:36,467][123090] Updated weights for policy 1, policy_version 1668818 (0.0010) [2023-12-26 13:00:36,512][123091] Updated weights for policy 0, policy_version 1679986 (0.0007) [2023-12-26 13:00:36,520][123090] Updated weights for policy 1, policy_version 1668828 (0.0010) [2023-12-26 13:00:36,580][123091] Updated weights for policy 0, policy_version 1679996 (0.0011) [2023-12-26 13:00:36,645][123091] Updated weights for policy 0, policy_version 1680006 (0.0011) [2023-12-26 13:00:36,705][123091] Updated weights for policy 0, policy_version 1680016 (0.0010) [2023-12-26 13:00:37,324][123090] Updated weights for policy 1, policy_version 1668838 (0.0010) [2023-12-26 13:00:37,389][123090] Updated weights for policy 1, policy_version 1668848 (0.0010) [2023-12-26 13:00:37,452][123090] Updated weights for policy 1, policy_version 1668858 (0.0010) [2023-12-26 13:00:37,543][123091] Updated weights for policy 0, policy_version 1680026 (0.0011) [2023-12-26 13:00:37,609][123091] Updated weights for policy 0, policy_version 1680036 (0.0011) [2023-12-26 13:00:37,678][123091] Updated weights for policy 0, policy_version 1680046 (0.0011) [2023-12-26 13:00:38,241][123090] Updated weights for policy 1, policy_version 1668868 (0.0008) [2023-12-26 13:00:38,308][123090] Updated weights for policy 1, policy_version 1668878 (0.0005) [2023-12-26 13:00:38,379][123090] Updated weights for policy 1, policy_version 1668888 (0.0008) [2023-12-26 13:00:38,511][123091] Updated weights for policy 0, policy_version 1680056 (0.0011) [2023-12-26 13:00:38,571][123091] Updated weights for policy 0, policy_version 1680066 (0.0011) [2023-12-26 13:00:38,638][123091] Updated weights for policy 0, policy_version 1680076 (0.0011) [2023-12-26 13:00:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 857341952. Throughput: 0: 8761.9, 1: 8810.9. Samples: 857315648. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:38,785][121949] Avg episode reward: [(0, '5894.447'), (1, '5773.995')] [2023-12-26 13:00:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001680080_430104576.pth... [2023-12-26 13:00:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001668896_427237376.pth... [2023-12-26 13:00:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001667872_426975232.pth [2023-12-26 13:00:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001679056_429842432.pth [2023-12-26 13:00:39,133][123090] Updated weights for policy 1, policy_version 1668898 (0.0007) [2023-12-26 13:00:39,184][123090] Updated weights for policy 1, policy_version 1668908 (0.0005) [2023-12-26 13:00:39,250][123090] Updated weights for policy 1, policy_version 1668918 (0.0007) [2023-12-26 13:00:39,312][123090] Updated weights for policy 1, policy_version 1668928 (0.0009) [2023-12-26 13:00:39,466][123091] Updated weights for policy 0, policy_version 1680086 (0.0008) [2023-12-26 13:00:39,532][123091] Updated weights for policy 0, policy_version 1680096 (0.0010) [2023-12-26 13:00:39,604][123091] Updated weights for policy 0, policy_version 1680106 (0.0011) [2023-12-26 13:00:40,177][123090] Updated weights for policy 1, policy_version 1668938 (0.0009) [2023-12-26 13:00:40,239][123090] Updated weights for policy 1, policy_version 1668948 (0.0009) [2023-12-26 13:00:40,310][123090] Updated weights for policy 1, policy_version 1668958 (0.0009) [2023-12-26 13:00:40,356][123091] Updated weights for policy 0, policy_version 1680116 (0.0009) [2023-12-26 13:00:40,407][123091] Updated weights for policy 0, policy_version 1680126 (0.0005) [2023-12-26 13:00:40,459][123091] Updated weights for policy 0, policy_version 1680136 (0.0006) [2023-12-26 13:00:41,190][123090] Updated weights for policy 1, policy_version 1668968 (0.0010) [2023-12-26 13:00:41,235][123091] Updated weights for policy 0, policy_version 1680146 (0.0006) [2023-12-26 13:00:41,255][123090] Updated weights for policy 1, policy_version 1668978 (0.0009) [2023-12-26 13:00:41,302][123091] Updated weights for policy 0, policy_version 1680156 (0.0009) [2023-12-26 13:00:41,323][123090] Updated weights for policy 1, policy_version 1668988 (0.0009) [2023-12-26 13:00:41,381][123091] Updated weights for policy 0, policy_version 1680166 (0.0010) [2023-12-26 13:00:41,437][123091] Updated weights for policy 0, policy_version 1680176 (0.0010) [2023-12-26 13:00:42,101][123090] Updated weights for policy 1, policy_version 1668998 (0.0010) [2023-12-26 13:00:42,167][123090] Updated weights for policy 1, policy_version 1669008 (0.0009) [2023-12-26 13:00:42,241][123090] Updated weights for policy 1, policy_version 1669018 (0.0008) [2023-12-26 13:00:42,342][123091] Updated weights for policy 0, policy_version 1680186 (0.0006) [2023-12-26 13:00:42,414][123091] Updated weights for policy 0, policy_version 1680196 (0.0009) [2023-12-26 13:00:42,485][123091] Updated weights for policy 0, policy_version 1680206 (0.0009) [2023-12-26 13:00:43,119][123090] Updated weights for policy 1, policy_version 1669028 (0.0007) [2023-12-26 13:00:43,177][123090] Updated weights for policy 1, policy_version 1669038 (0.0005) [2023-12-26 13:00:43,237][123091] Updated weights for policy 0, policy_version 1680216 (0.0010) [2023-12-26 13:00:43,238][123090] Updated weights for policy 1, policy_version 1669048 (0.0005) [2023-12-26 13:00:43,299][123091] Updated weights for policy 0, policy_version 1680226 (0.0010) [2023-12-26 13:00:43,360][123091] Updated weights for policy 0, policy_version 1680236 (0.0010) [2023-12-26 13:00:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 857423872. Throughput: 0: 8716.0, 1: 8730.7. Samples: 857417552. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:43,785][121949] Avg episode reward: [(0, '6061.020'), (1, '6006.547')] [2023-12-26 13:00:43,865][123090] Updated weights for policy 1, policy_version 1669058 (0.0008) [2023-12-26 13:00:43,913][123090] Updated weights for policy 1, policy_version 1669068 (0.0009) [2023-12-26 13:00:43,960][123090] Updated weights for policy 1, policy_version 1669078 (0.0010) [2023-12-26 13:00:44,009][123090] Updated weights for policy 1, policy_version 1669088 (0.0010) [2023-12-26 13:00:44,084][123091] Updated weights for policy 0, policy_version 1680246 (0.0009) [2023-12-26 13:00:44,139][123091] Updated weights for policy 0, policy_version 1680256 (0.0005) [2023-12-26 13:00:44,189][123091] Updated weights for policy 0, policy_version 1680266 (0.0005) [2023-12-26 13:00:44,912][123091] Updated weights for policy 0, policy_version 1680276 (0.0007) [2023-12-26 13:00:44,919][123090] Updated weights for policy 1, policy_version 1669098 (0.0008) [2023-12-26 13:00:44,979][123091] Updated weights for policy 0, policy_version 1680286 (0.0010) [2023-12-26 13:00:44,986][123090] Updated weights for policy 1, policy_version 1669108 (0.0007) [2023-12-26 13:00:45,048][123091] Updated weights for policy 0, policy_version 1680296 (0.0010) [2023-12-26 13:00:45,056][123090] Updated weights for policy 1, policy_version 1669118 (0.0009) [2023-12-26 13:00:45,709][123091] Updated weights for policy 0, policy_version 1680306 (0.0007) [2023-12-26 13:00:45,781][123091] Updated weights for policy 0, policy_version 1680316 (0.0010) [2023-12-26 13:00:45,845][123091] Updated weights for policy 0, policy_version 1680326 (0.0006) [2023-12-26 13:00:45,873][123090] Updated weights for policy 1, policy_version 1669128 (0.0010) [2023-12-26 13:00:45,909][123091] Updated weights for policy 0, policy_version 1680336 (0.0005) [2023-12-26 13:00:45,932][123090] Updated weights for policy 1, policy_version 1669138 (0.0010) [2023-12-26 13:00:45,984][123090] Updated weights for policy 1, policy_version 1669148 (0.0010) [2023-12-26 13:00:46,572][123091] Updated weights for policy 0, policy_version 1680346 (0.0005) [2023-12-26 13:00:46,635][123091] Updated weights for policy 0, policy_version 1680356 (0.0005) [2023-12-26 13:00:46,677][123090] Updated weights for policy 1, policy_version 1669158 (0.0009) [2023-12-26 13:00:46,697][123091] Updated weights for policy 0, policy_version 1680366 (0.0009) [2023-12-26 13:00:46,742][123090] Updated weights for policy 1, policy_version 1669168 (0.0009) [2023-12-26 13:00:46,805][123090] Updated weights for policy 1, policy_version 1669178 (0.0010) [2023-12-26 13:00:47,482][123091] Updated weights for policy 0, policy_version 1680376 (0.0009) [2023-12-26 13:00:47,542][123091] Updated weights for policy 0, policy_version 1680386 (0.0009) [2023-12-26 13:00:47,567][123090] Updated weights for policy 1, policy_version 1669188 (0.0008) [2023-12-26 13:00:47,599][123091] Updated weights for policy 0, policy_version 1680396 (0.0009) [2023-12-26 13:00:47,627][123090] Updated weights for policy 1, policy_version 1669198 (0.0005) [2023-12-26 13:00:47,687][123090] Updated weights for policy 1, policy_version 1669208 (0.0007) [2023-12-26 13:00:48,423][123091] Updated weights for policy 0, policy_version 1680406 (0.0010) [2023-12-26 13:00:48,474][123091] Updated weights for policy 0, policy_version 1680416 (0.0010) [2023-12-26 13:00:48,522][123090] Updated weights for policy 1, policy_version 1669218 (0.0009) [2023-12-26 13:00:48,534][123091] Updated weights for policy 0, policy_version 1680426 (0.0010) [2023-12-26 13:00:48,590][123090] Updated weights for policy 1, policy_version 1669228 (0.0009) [2023-12-26 13:00:48,654][123090] Updated weights for policy 1, policy_version 1669238 (0.0009) [2023-12-26 13:00:48,718][123090] Updated weights for policy 1, policy_version 1669248 (0.0010) [2023-12-26 13:00:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 857522176. Throughput: 0: 8740.6, 1: 8795.7. Samples: 857528176. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:48,784][121949] Avg episode reward: [(0, '5982.137'), (1, '6082.549')] [2023-12-26 13:00:49,261][123091] Updated weights for policy 0, policy_version 1680436 (0.0008) [2023-12-26 13:00:49,320][123091] Updated weights for policy 0, policy_version 1680446 (0.0006) [2023-12-26 13:00:49,384][123091] Updated weights for policy 0, policy_version 1680456 (0.0009) [2023-12-26 13:00:49,511][123090] Updated weights for policy 1, policy_version 1669258 (0.0009) [2023-12-26 13:00:49,564][123090] Updated weights for policy 1, policy_version 1669268 (0.0009) [2023-12-26 13:00:49,618][123090] Updated weights for policy 1, policy_version 1669278 (0.0010) [2023-12-26 13:00:50,192][123091] Updated weights for policy 0, policy_version 1680466 (0.0009) [2023-12-26 13:00:50,252][123091] Updated weights for policy 0, policy_version 1680476 (0.0010) [2023-12-26 13:00:50,310][123091] Updated weights for policy 0, policy_version 1680486 (0.0009) [2023-12-26 13:00:50,375][123091] Updated weights for policy 0, policy_version 1680496 (0.0009) [2023-12-26 13:00:50,445][123090] Updated weights for policy 1, policy_version 1669288 (0.0010) [2023-12-26 13:00:50,497][123090] Updated weights for policy 1, policy_version 1669298 (0.0010) [2023-12-26 13:00:50,551][123090] Updated weights for policy 1, policy_version 1669308 (0.0010) [2023-12-26 13:00:51,270][123091] Updated weights for policy 0, policy_version 1680506 (0.0009) [2023-12-26 13:00:51,341][123091] Updated weights for policy 0, policy_version 1680516 (0.0008) [2023-12-26 13:00:51,354][123090] Updated weights for policy 1, policy_version 1669318 (0.0008) [2023-12-26 13:00:51,416][123091] Updated weights for policy 0, policy_version 1680526 (0.0009) [2023-12-26 13:00:51,423][123090] Updated weights for policy 1, policy_version 1669328 (0.0007) [2023-12-26 13:00:51,472][123090] Updated weights for policy 1, policy_version 1669338 (0.0005) [2023-12-26 13:00:52,253][123090] Updated weights for policy 1, policy_version 1669348 (0.0006) [2023-12-26 13:00:52,301][123091] Updated weights for policy 0, policy_version 1680536 (0.0009) [2023-12-26 13:00:52,313][123090] Updated weights for policy 1, policy_version 1669358 (0.0009) [2023-12-26 13:00:52,365][123091] Updated weights for policy 0, policy_version 1680546 (0.0007) [2023-12-26 13:00:52,383][123090] Updated weights for policy 1, policy_version 1669368 (0.0009) [2023-12-26 13:00:52,431][123091] Updated weights for policy 0, policy_version 1680556 (0.0008) [2023-12-26 13:00:53,144][123090] Updated weights for policy 1, policy_version 1669378 (0.0009) [2023-12-26 13:00:53,154][123091] Updated weights for policy 0, policy_version 1680566 (0.0009) [2023-12-26 13:00:53,208][123091] Updated weights for policy 0, policy_version 1680576 (0.0009) [2023-12-26 13:00:53,210][123090] Updated weights for policy 1, policy_version 1669388 (0.0008) [2023-12-26 13:00:53,258][123091] Updated weights for policy 0, policy_version 1680586 (0.0009) [2023-12-26 13:00:53,276][123090] Updated weights for policy 1, policy_version 1669398 (0.0008) [2023-12-26 13:00:53,341][123090] Updated weights for policy 1, policy_version 1669408 (0.0009) [2023-12-26 13:00:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 857604096. Throughput: 0: 8738.3, 1: 8786.1. Samples: 857580488. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:53,786][121949] Avg episode reward: [(0, '5634.899'), (1, '6017.709')] [2023-12-26 13:00:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001680592_430235648.pth... [2023-12-26 13:00:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001669408_427368448.pth... [2023-12-26 13:00:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001679568_429973504.pth [2023-12-26 13:00:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001668384_427106304.pth [2023-12-26 13:00:54,096][123091] Updated weights for policy 0, policy_version 1680596 (0.0009) [2023-12-26 13:00:54,166][123091] Updated weights for policy 0, policy_version 1680606 (0.0006) [2023-12-26 13:00:54,167][123090] Updated weights for policy 1, policy_version 1669418 (0.0011) [2023-12-26 13:00:54,227][123090] Updated weights for policy 1, policy_version 1669428 (0.0010) [2023-12-26 13:00:54,229][123091] Updated weights for policy 0, policy_version 1680616 (0.0006) [2023-12-26 13:00:54,278][123090] Updated weights for policy 1, policy_version 1669438 (0.0009) [2023-12-26 13:00:54,966][123090] Updated weights for policy 1, policy_version 1669448 (0.0009) [2023-12-26 13:00:55,031][123090] Updated weights for policy 1, policy_version 1669458 (0.0011) [2023-12-26 13:00:55,101][123090] Updated weights for policy 1, policy_version 1669468 (0.0011) [2023-12-26 13:00:55,110][123091] Updated weights for policy 0, policy_version 1680626 (0.0008) [2023-12-26 13:00:55,165][123091] Updated weights for policy 0, policy_version 1680636 (0.0009) [2023-12-26 13:00:55,229][123091] Updated weights for policy 0, policy_version 1680646 (0.0008) [2023-12-26 13:00:55,289][123091] Updated weights for policy 0, policy_version 1680656 (0.0009) [2023-12-26 13:00:55,913][123090] Updated weights for policy 1, policy_version 1669478 (0.0011) [2023-12-26 13:00:55,976][123090] Updated weights for policy 1, policy_version 1669488 (0.0010) [2023-12-26 13:00:56,032][123090] Updated weights for policy 1, policy_version 1669498 (0.0011) [2023-12-26 13:00:56,115][123091] Updated weights for policy 0, policy_version 1680666 (0.0008) [2023-12-26 13:00:56,174][123091] Updated weights for policy 0, policy_version 1680676 (0.0008) [2023-12-26 13:00:56,239][123091] Updated weights for policy 0, policy_version 1680686 (0.0009) [2023-12-26 13:00:56,867][123090] Updated weights for policy 1, policy_version 1669508 (0.0010) [2023-12-26 13:00:56,937][123090] Updated weights for policy 1, policy_version 1669518 (0.0011) [2023-12-26 13:00:57,007][123090] Updated weights for policy 1, policy_version 1669528 (0.0011) [2023-12-26 13:00:57,081][123091] Updated weights for policy 0, policy_version 1680696 (0.0010) [2023-12-26 13:00:57,141][123091] Updated weights for policy 0, policy_version 1680706 (0.0009) [2023-12-26 13:00:57,203][123091] Updated weights for policy 0, policy_version 1680716 (0.0009) [2023-12-26 13:00:57,815][123090] Updated weights for policy 1, policy_version 1669538 (0.0011) [2023-12-26 13:00:57,863][123090] Updated weights for policy 1, policy_version 1669548 (0.0010) [2023-12-26 13:00:57,911][123090] Updated weights for policy 1, policy_version 1669558 (0.0010) [2023-12-26 13:00:57,955][123090] Updated weights for policy 1, policy_version 1669568 (0.0010) [2023-12-26 13:00:58,034][123091] Updated weights for policy 0, policy_version 1680726 (0.0009) [2023-12-26 13:00:58,105][123091] Updated weights for policy 0, policy_version 1680736 (0.0009) [2023-12-26 13:00:58,162][123091] Updated weights for policy 0, policy_version 1680746 (0.0009) [2023-12-26 13:00:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 857686016. Throughput: 0: 8766.2, 1: 8813.1. Samples: 857684260. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:00:58,785][121949] Avg episode reward: [(0, '5767.009'), (1, '5966.440')] [2023-12-26 13:00:58,890][123090] Updated weights for policy 1, policy_version 1669578 (0.0011) [2023-12-26 13:00:58,961][123090] Updated weights for policy 1, policy_version 1669588 (0.0009) [2023-12-26 13:00:59,034][123090] Updated weights for policy 1, policy_version 1669598 (0.0011) [2023-12-26 13:00:59,161][123091] Updated weights for policy 0, policy_version 1680756 (0.0009) [2023-12-26 13:00:59,226][123091] Updated weights for policy 0, policy_version 1680766 (0.0009) [2023-12-26 13:00:59,295][123091] Updated weights for policy 0, policy_version 1680776 (0.0009) [2023-12-26 13:00:59,854][123090] Updated weights for policy 1, policy_version 1669608 (0.0010) [2023-12-26 13:00:59,919][123090] Updated weights for policy 1, policy_version 1669618 (0.0010) [2023-12-26 13:00:59,984][123090] Updated weights for policy 1, policy_version 1669628 (0.0010) [2023-12-26 13:01:00,131][123091] Updated weights for policy 0, policy_version 1680786 (0.0010) [2023-12-26 13:01:00,196][123091] Updated weights for policy 0, policy_version 1680796 (0.0010) [2023-12-26 13:01:00,260][123091] Updated weights for policy 0, policy_version 1680806 (0.0010) [2023-12-26 13:01:00,320][123091] Updated weights for policy 0, policy_version 1680816 (0.0009) [2023-12-26 13:01:00,761][123090] Updated weights for policy 1, policy_version 1669638 (0.0007) [2023-12-26 13:01:00,823][123090] Updated weights for policy 1, policy_version 1669648 (0.0005) [2023-12-26 13:01:00,869][123090] Updated weights for policy 1, policy_version 1669658 (0.0005) [2023-12-26 13:01:01,109][123091] Updated weights for policy 0, policy_version 1680826 (0.0010) [2023-12-26 13:01:01,174][123091] Updated weights for policy 0, policy_version 1680836 (0.0009) [2023-12-26 13:01:01,239][123091] Updated weights for policy 0, policy_version 1680846 (0.0009) [2023-12-26 13:01:01,569][123090] Updated weights for policy 1, policy_version 1669668 (0.0007) [2023-12-26 13:01:01,648][123090] Updated weights for policy 1, policy_version 1669678 (0.0010) [2023-12-26 13:01:01,707][123090] Updated weights for policy 1, policy_version 1669688 (0.0009) [2023-12-26 13:01:02,039][123091] Updated weights for policy 0, policy_version 1680856 (0.0008) [2023-12-26 13:01:02,107][123091] Updated weights for policy 0, policy_version 1680866 (0.0006) [2023-12-26 13:01:02,165][123091] Updated weights for policy 0, policy_version 1680876 (0.0005) [2023-12-26 13:01:02,529][123090] Updated weights for policy 1, policy_version 1669698 (0.0009) [2023-12-26 13:01:02,581][123090] Updated weights for policy 1, policy_version 1669708 (0.0009) [2023-12-26 13:01:02,632][123090] Updated weights for policy 1, policy_version 1669718 (0.0009) [2023-12-26 13:01:02,686][123090] Updated weights for policy 1, policy_version 1669728 (0.0005) [2023-12-26 13:01:02,898][123091] Updated weights for policy 0, policy_version 1680886 (0.0008) [2023-12-26 13:01:02,951][123091] Updated weights for policy 0, policy_version 1680896 (0.0009) [2023-12-26 13:01:03,007][123091] Updated weights for policy 0, policy_version 1680906 (0.0010) [2023-12-26 13:01:03,295][123090] Updated weights for policy 1, policy_version 1669738 (0.0008) [2023-12-26 13:01:03,350][123090] Updated weights for policy 1, policy_version 1669748 (0.0010) [2023-12-26 13:01:03,405][123090] Updated weights for policy 1, policy_version 1669758 (0.0010) [2023-12-26 13:01:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 857776128. Throughput: 0: 8696.2, 1: 8803.5. Samples: 857788484. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:03,785][121949] Avg episode reward: [(0, '5958.247'), (1, '5981.915')] [2023-12-26 13:01:03,825][123091] Updated weights for policy 0, policy_version 1680916 (0.0010) [2023-12-26 13:01:03,891][123091] Updated weights for policy 0, policy_version 1680926 (0.0010) [2023-12-26 13:01:03,953][123091] Updated weights for policy 0, policy_version 1680936 (0.0009) [2023-12-26 13:01:04,152][123090] Updated weights for policy 1, policy_version 1669769 (0.0006) [2023-12-26 13:01:04,228][123090] Updated weights for policy 1, policy_version 1669779 (0.0006) [2023-12-26 13:01:04,304][123090] Updated weights for policy 1, policy_version 1669789 (0.0009) [2023-12-26 13:01:04,835][123091] Updated weights for policy 0, policy_version 1680946 (0.0010) [2023-12-26 13:01:04,892][123091] Updated weights for policy 0, policy_version 1680956 (0.0009) [2023-12-26 13:01:04,949][123091] Updated weights for policy 0, policy_version 1680967 (0.0009) [2023-12-26 13:01:04,970][123090] Updated weights for policy 1, policy_version 1669799 (0.0008) [2023-12-26 13:01:05,029][123090] Updated weights for policy 1, policy_version 1669809 (0.0007) [2023-12-26 13:01:05,097][123090] Updated weights for policy 1, policy_version 1669819 (0.0009) [2023-12-26 13:01:05,643][123091] Updated weights for policy 0, policy_version 1680977 (0.0010) [2023-12-26 13:01:05,699][123091] Updated weights for policy 0, policy_version 1680987 (0.0007) [2023-12-26 13:01:05,757][123091] Updated weights for policy 0, policy_version 1680997 (0.0010) [2023-12-26 13:01:05,815][123091] Updated weights for policy 0, policy_version 1681007 (0.0011) [2023-12-26 13:01:05,834][123090] Updated weights for policy 1, policy_version 1669829 (0.0008) [2023-12-26 13:01:05,891][123090] Updated weights for policy 1, policy_version 1669839 (0.0009) [2023-12-26 13:01:05,939][123090] Updated weights for policy 1, policy_version 1669849 (0.0008) [2023-12-26 13:01:06,602][123091] Updated weights for policy 0, policy_version 1681017 (0.0011) [2023-12-26 13:01:06,661][123091] Updated weights for policy 0, policy_version 1681027 (0.0011) [2023-12-26 13:01:06,717][123091] Updated weights for policy 0, policy_version 1681037 (0.0011) [2023-12-26 13:01:06,821][123090] Updated weights for policy 1, policy_version 1669859 (0.0009) [2023-12-26 13:01:06,885][123090] Updated weights for policy 1, policy_version 1669869 (0.0009) [2023-12-26 13:01:06,946][123090] Updated weights for policy 1, policy_version 1669879 (0.0009) [2023-12-26 13:01:07,577][123091] Updated weights for policy 0, policy_version 1681047 (0.0010) [2023-12-26 13:01:07,645][123091] Updated weights for policy 0, policy_version 1681057 (0.0010) [2023-12-26 13:01:07,702][123090] Updated weights for policy 1, policy_version 1669889 (0.0009) [2023-12-26 13:01:07,710][123091] Updated weights for policy 0, policy_version 1681067 (0.0009) [2023-12-26 13:01:07,766][123090] Updated weights for policy 1, policy_version 1669899 (0.0010) [2023-12-26 13:01:07,832][123090] Updated weights for policy 1, policy_version 1669909 (0.0010) [2023-12-26 13:01:07,894][123090] Updated weights for policy 1, policy_version 1669919 (0.0009) [2023-12-26 13:01:08,557][123091] Updated weights for policy 0, policy_version 1681077 (0.0008) [2023-12-26 13:01:08,628][123091] Updated weights for policy 0, policy_version 1681087 (0.0009) [2023-12-26 13:01:08,686][123091] Updated weights for policy 0, policy_version 1681097 (0.0007) [2023-12-26 13:01:08,709][123090] Updated weights for policy 1, policy_version 1669929 (0.0010) [2023-12-26 13:01:08,760][123090] Updated weights for policy 1, policy_version 1669939 (0.0010) [2023-12-26 13:01:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 857866240. Throughput: 0: 8709.4, 1: 8845.8. Samples: 857842796. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:08,785][121949] Avg episode reward: [(0, '5874.289'), (1, '5994.725')] [2023-12-26 13:01:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001681104_430366720.pth... [2023-12-26 13:01:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001680080_430104576.pth [2023-12-26 13:01:08,812][123090] Updated weights for policy 1, policy_version 1669949 (0.0010) [2023-12-26 13:01:08,827][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001669952_427507712.pth... [2023-12-26 13:01:08,832][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001668896_427237376.pth [2023-12-26 13:01:09,580][123091] Updated weights for policy 0, policy_version 1681107 (0.0009) [2023-12-26 13:01:09,646][123091] Updated weights for policy 0, policy_version 1681117 (0.0010) [2023-12-26 13:01:09,704][123090] Updated weights for policy 1, policy_version 1669959 (0.0008) [2023-12-26 13:01:09,715][123091] Updated weights for policy 0, policy_version 1681127 (0.0009) [2023-12-26 13:01:09,767][123090] Updated weights for policy 1, policy_version 1669969 (0.0007) [2023-12-26 13:01:09,832][123090] Updated weights for policy 1, policy_version 1669979 (0.0006) [2023-12-26 13:01:10,585][123091] Updated weights for policy 0, policy_version 1681137 (0.0009) [2023-12-26 13:01:10,626][123090] Updated weights for policy 1, policy_version 1669989 (0.0010) [2023-12-26 13:01:10,635][123091] Updated weights for policy 0, policy_version 1681147 (0.0010) [2023-12-26 13:01:10,678][123090] Updated weights for policy 1, policy_version 1669999 (0.0010) [2023-12-26 13:01:10,685][123091] Updated weights for policy 0, policy_version 1681157 (0.0007) [2023-12-26 13:01:10,730][123090] Updated weights for policy 1, policy_version 1670009 (0.0010) [2023-12-26 13:01:10,733][123091] Updated weights for policy 0, policy_version 1681167 (0.0005) [2023-12-26 13:01:11,582][123090] Updated weights for policy 1, policy_version 1670019 (0.0009) [2023-12-26 13:01:11,619][123091] Updated weights for policy 0, policy_version 1681177 (0.0009) [2023-12-26 13:01:11,654][123090] Updated weights for policy 1, policy_version 1670029 (0.0008) [2023-12-26 13:01:11,715][123091] Updated weights for policy 0, policy_version 1681187 (0.0012) [2023-12-26 13:01:11,722][123090] Updated weights for policy 1, policy_version 1670039 (0.0007) [2023-12-26 13:01:11,790][123091] Updated weights for policy 0, policy_version 1681197 (0.0008) [2023-12-26 13:01:12,479][123090] Updated weights for policy 1, policy_version 1670049 (0.0008) [2023-12-26 13:01:12,547][123090] Updated weights for policy 1, policy_version 1670059 (0.0009) [2023-12-26 13:01:12,574][123091] Updated weights for policy 0, policy_version 1681207 (0.0009) [2023-12-26 13:01:12,609][123090] Updated weights for policy 1, policy_version 1670069 (0.0007) [2023-12-26 13:01:12,638][123091] Updated weights for policy 0, policy_version 1681217 (0.0008) [2023-12-26 13:01:12,673][123090] Updated weights for policy 1, policy_version 1670079 (0.0009) [2023-12-26 13:01:12,700][123091] Updated weights for policy 0, policy_version 1681227 (0.0007) [2023-12-26 13:01:13,386][123090] Updated weights for policy 1, policy_version 1670089 (0.0006) [2023-12-26 13:01:13,440][123090] Updated weights for policy 1, policy_version 1670099 (0.0005) [2023-12-26 13:01:13,489][123090] Updated weights for policy 1, policy_version 1670109 (0.0005) [2023-12-26 13:01:13,503][123091] Updated weights for policy 0, policy_version 1681237 (0.0009) [2023-12-26 13:01:13,557][123091] Updated weights for policy 0, policy_version 1681247 (0.0010) [2023-12-26 13:01:13,607][123091] Updated weights for policy 0, policy_version 1681257 (0.0010) [2023-12-26 13:01:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 857956352. Throughput: 0: 8639.3, 1: 8856.1. Samples: 857944364. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:13,785][121949] Avg episode reward: [(0, '5852.043'), (1, '5954.815')] [2023-12-26 13:01:14,187][123090] Updated weights for policy 1, policy_version 1670119 (0.0007) [2023-12-26 13:01:14,260][123090] Updated weights for policy 1, policy_version 1670129 (0.0006) [2023-12-26 13:01:14,327][123090] Updated weights for policy 1, policy_version 1670139 (0.0005) [2023-12-26 13:01:14,454][123091] Updated weights for policy 0, policy_version 1681267 (0.0010) [2023-12-26 13:01:14,531][123091] Updated weights for policy 0, policy_version 1681277 (0.0011) [2023-12-26 13:01:14,597][123091] Updated weights for policy 0, policy_version 1681287 (0.0010) [2023-12-26 13:01:15,095][123090] Updated weights for policy 1, policy_version 1670149 (0.0009) [2023-12-26 13:01:15,148][123090] Updated weights for policy 1, policy_version 1670159 (0.0009) [2023-12-26 13:01:15,207][123090] Updated weights for policy 1, policy_version 1670169 (0.0008) [2023-12-26 13:01:15,313][123091] Updated weights for policy 0, policy_version 1681297 (0.0010) [2023-12-26 13:01:15,376][123091] Updated weights for policy 0, policy_version 1681307 (0.0006) [2023-12-26 13:01:15,429][123091] Updated weights for policy 0, policy_version 1681317 (0.0007) [2023-12-26 13:01:15,482][123091] Updated weights for policy 0, policy_version 1681327 (0.0009) [2023-12-26 13:01:16,060][123090] Updated weights for policy 1, policy_version 1670179 (0.0009) [2023-12-26 13:01:16,116][123090] Updated weights for policy 1, policy_version 1670189 (0.0009) [2023-12-26 13:01:16,171][123090] Updated weights for policy 1, policy_version 1670199 (0.0007) [2023-12-26 13:01:16,275][123091] Updated weights for policy 0, policy_version 1681337 (0.0010) [2023-12-26 13:01:16,326][123091] Updated weights for policy 0, policy_version 1681347 (0.0010) [2023-12-26 13:01:16,373][123091] Updated weights for policy 0, policy_version 1681357 (0.0010) [2023-12-26 13:01:16,979][123090] Updated weights for policy 1, policy_version 1670209 (0.0006) [2023-12-26 13:01:17,039][123090] Updated weights for policy 1, policy_version 1670220 (0.0010) [2023-12-26 13:01:17,093][123090] Updated weights for policy 1, policy_version 1670230 (0.0010) [2023-12-26 13:01:17,141][123090] Updated weights for policy 1, policy_version 1670240 (0.0009) [2023-12-26 13:01:17,144][123091] Updated weights for policy 0, policy_version 1681367 (0.0009) [2023-12-26 13:01:17,195][123091] Updated weights for policy 0, policy_version 1681377 (0.0010) [2023-12-26 13:01:17,253][123091] Updated weights for policy 0, policy_version 1681387 (0.0010) [2023-12-26 13:01:17,902][123090] Updated weights for policy 1, policy_version 1670250 (0.0006) [2023-12-26 13:01:17,959][123090] Updated weights for policy 1, policy_version 1670260 (0.0005) [2023-12-26 13:01:18,017][123090] Updated weights for policy 1, policy_version 1670270 (0.0007) [2023-12-26 13:01:18,073][123091] Updated weights for policy 0, policy_version 1681397 (0.0008) [2023-12-26 13:01:18,135][123091] Updated weights for policy 0, policy_version 1681407 (0.0005) [2023-12-26 13:01:18,204][123091] Updated weights for policy 0, policy_version 1681417 (0.0007) [2023-12-26 13:01:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 858038272. Throughput: 0: 8692.9, 1: 8916.3. Samples: 858053412. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:18,785][121949] Avg episode reward: [(0, '5838.105'), (1, '6091.974')] [2023-12-26 13:01:18,792][123090] Updated weights for policy 1, policy_version 1670280 (0.0010) [2023-12-26 13:01:18,848][123090] Updated weights for policy 1, policy_version 1670290 (0.0010) [2023-12-26 13:01:18,919][123090] Updated weights for policy 1, policy_version 1670300 (0.0011) [2023-12-26 13:01:19,003][123091] Updated weights for policy 0, policy_version 1681427 (0.0011) [2023-12-26 13:01:19,055][123091] Updated weights for policy 0, policy_version 1681437 (0.0011) [2023-12-26 13:01:19,110][123091] Updated weights for policy 0, policy_version 1681447 (0.0011) [2023-12-26 13:01:19,707][123090] Updated weights for policy 1, policy_version 1670310 (0.0008) [2023-12-26 13:01:19,774][123090] Updated weights for policy 1, policy_version 1670320 (0.0006) [2023-12-26 13:01:19,847][123090] Updated weights for policy 1, policy_version 1670330 (0.0009) [2023-12-26 13:01:19,983][123091] Updated weights for policy 0, policy_version 1681457 (0.0010) [2023-12-26 13:01:20,057][123091] Updated weights for policy 0, policy_version 1681467 (0.0008) [2023-12-26 13:01:20,119][123091] Updated weights for policy 0, policy_version 1681477 (0.0006) [2023-12-26 13:01:20,187][123091] Updated weights for policy 0, policy_version 1681487 (0.0008) [2023-12-26 13:01:20,632][123090] Updated weights for policy 1, policy_version 1670340 (0.0011) [2023-12-26 13:01:20,696][123090] Updated weights for policy 1, policy_version 1670350 (0.0011) [2023-12-26 13:01:20,765][123090] Updated weights for policy 1, policy_version 1670360 (0.0011) [2023-12-26 13:01:20,889][123091] Updated weights for policy 0, policy_version 1681497 (0.0008) [2023-12-26 13:01:20,955][123091] Updated weights for policy 0, policy_version 1681507 (0.0008) [2023-12-26 13:01:21,015][123091] Updated weights for policy 0, policy_version 1681517 (0.0007) [2023-12-26 13:01:21,589][123090] Updated weights for policy 1, policy_version 1670370 (0.0007) [2023-12-26 13:01:21,657][123090] Updated weights for policy 1, policy_version 1670380 (0.0009) [2023-12-26 13:01:21,731][123090] Updated weights for policy 1, policy_version 1670390 (0.0008) [2023-12-26 13:01:21,787][123091] Updated weights for policy 0, policy_version 1681527 (0.0010) [2023-12-26 13:01:21,798][123090] Updated weights for policy 1, policy_version 1670400 (0.0008) [2023-12-26 13:01:21,850][123091] Updated weights for policy 0, policy_version 1681537 (0.0010) [2023-12-26 13:01:21,921][123091] Updated weights for policy 0, policy_version 1681547 (0.0010) [2023-12-26 13:01:22,634][123090] Updated weights for policy 1, policy_version 1670410 (0.0009) [2023-12-26 13:01:22,687][123090] Updated weights for policy 1, policy_version 1670420 (0.0009) [2023-12-26 13:01:22,745][123091] Updated weights for policy 0, policy_version 1681557 (0.0011) [2023-12-26 13:01:22,747][123090] Updated weights for policy 1, policy_version 1670430 (0.0007) [2023-12-26 13:01:22,808][123091] Updated weights for policy 0, policy_version 1681567 (0.0010) [2023-12-26 13:01:22,863][123091] Updated weights for policy 0, policy_version 1681577 (0.0010) [2023-12-26 13:01:23,617][123091] Updated weights for policy 0, policy_version 1681587 (0.0009) [2023-12-26 13:01:23,660][123090] Updated weights for policy 1, policy_version 1670440 (0.0008) [2023-12-26 13:01:23,674][123091] Updated weights for policy 0, policy_version 1681597 (0.0005) [2023-12-26 13:01:23,720][123090] Updated weights for policy 1, policy_version 1670450 (0.0009) [2023-12-26 13:01:23,720][123091] Updated weights for policy 0, policy_version 1681607 (0.0005) [2023-12-26 13:01:23,773][123090] Updated weights for policy 1, policy_version 1670460 (0.0008) [2023-12-26 13:01:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 858128384. Throughput: 0: 8680.5, 1: 8884.4. Samples: 858106068. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:23,784][121949] Avg episode reward: [(0, '5933.694'), (1, '6120.908')] [2023-12-26 13:01:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001681616_430497792.pth... [2023-12-26 13:01:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001670464_427638784.pth... [2023-12-26 13:01:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001669408_427368448.pth [2023-12-26 13:01:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001680592_430235648.pth [2023-12-26 13:01:24,471][123091] Updated weights for policy 0, policy_version 1681617 (0.0006) [2023-12-26 13:01:24,524][123091] Updated weights for policy 0, policy_version 1681627 (0.0010) [2023-12-26 13:01:24,573][123091] Updated weights for policy 0, policy_version 1681637 (0.0006) [2023-12-26 13:01:24,621][123091] Updated weights for policy 0, policy_version 1681647 (0.0005) [2023-12-26 13:01:24,688][123090] Updated weights for policy 1, policy_version 1670470 (0.0009) [2023-12-26 13:01:24,748][123090] Updated weights for policy 1, policy_version 1670480 (0.0009) [2023-12-26 13:01:24,807][123090] Updated weights for policy 1, policy_version 1670490 (0.0010) [2023-12-26 13:01:25,343][123091] Updated weights for policy 0, policy_version 1681657 (0.0007) [2023-12-26 13:01:25,395][123091] Updated weights for policy 0, policy_version 1681667 (0.0009) [2023-12-26 13:01:25,450][123091] Updated weights for policy 0, policy_version 1681677 (0.0009) [2023-12-26 13:01:25,667][123090] Updated weights for policy 1, policy_version 1670500 (0.0010) [2023-12-26 13:01:25,716][123090] Updated weights for policy 1, policy_version 1670511 (0.0009) [2023-12-26 13:01:25,763][123090] Updated weights for policy 1, policy_version 1670521 (0.0009) [2023-12-26 13:01:26,247][123091] Updated weights for policy 0, policy_version 1681687 (0.0010) [2023-12-26 13:01:26,296][123091] Updated weights for policy 0, policy_version 1681697 (0.0009) [2023-12-26 13:01:26,345][123091] Updated weights for policy 0, policy_version 1681707 (0.0009) [2023-12-26 13:01:26,601][123090] Updated weights for policy 1, policy_version 1670531 (0.0010) [2023-12-26 13:01:26,665][123090] Updated weights for policy 1, policy_version 1670541 (0.0010) [2023-12-26 13:01:26,734][123090] Updated weights for policy 1, policy_version 1670551 (0.0009) [2023-12-26 13:01:27,142][123091] Updated weights for policy 0, policy_version 1681717 (0.0008) [2023-12-26 13:01:27,202][123091] Updated weights for policy 0, policy_version 1681727 (0.0010) [2023-12-26 13:01:27,253][123091] Updated weights for policy 0, policy_version 1681737 (0.0009) [2023-12-26 13:01:27,553][123090] Updated weights for policy 1, policy_version 1670561 (0.0009) [2023-12-26 13:01:27,606][123090] Updated weights for policy 1, policy_version 1670572 (0.0009) [2023-12-26 13:01:27,654][123090] Updated weights for policy 1, policy_version 1670582 (0.0009) [2023-12-26 13:01:28,084][123091] Updated weights for policy 0, policy_version 1681747 (0.0009) [2023-12-26 13:01:28,131][123091] Updated weights for policy 0, policy_version 1681757 (0.0009) [2023-12-26 13:01:28,190][123091] Updated weights for policy 0, policy_version 1681767 (0.0009) [2023-12-26 13:01:28,492][123090] Updated weights for policy 1, policy_version 1670593 (0.0009) [2023-12-26 13:01:28,546][123090] Updated weights for policy 1, policy_version 1670603 (0.0008) [2023-12-26 13:01:28,598][123090] Updated weights for policy 1, policy_version 1670613 (0.0005) [2023-12-26 13:01:28,653][123090] Updated weights for policy 1, policy_version 1670623 (0.0006) [2023-12-26 13:01:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 858218496. Throughput: 0: 8764.8, 1: 8839.3. Samples: 858209736. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:28,786][121949] Avg episode reward: [(0, '5963.635'), (1, '6073.719')] [2023-12-26 13:01:29,024][123091] Updated weights for policy 0, policy_version 1681777 (0.0009) [2023-12-26 13:01:29,072][123091] Updated weights for policy 0, policy_version 1681787 (0.0009) [2023-12-26 13:01:29,122][123091] Updated weights for policy 0, policy_version 1681797 (0.0010) [2023-12-26 13:01:29,173][123091] Updated weights for policy 0, policy_version 1681807 (0.0009) [2023-12-26 13:01:29,440][123090] Updated weights for policy 1, policy_version 1670633 (0.0009) [2023-12-26 13:01:29,499][123090] Updated weights for policy 1, policy_version 1670643 (0.0009) [2023-12-26 13:01:29,559][123090] Updated weights for policy 1, policy_version 1670653 (0.0009) [2023-12-26 13:01:30,028][123091] Updated weights for policy 0, policy_version 1681817 (0.0009) [2023-12-26 13:01:30,079][123091] Updated weights for policy 0, policy_version 1681827 (0.0009) [2023-12-26 13:01:30,133][123091] Updated weights for policy 0, policy_version 1681837 (0.0009) [2023-12-26 13:01:30,397][123090] Updated weights for policy 1, policy_version 1670663 (0.0007) [2023-12-26 13:01:30,447][123090] Updated weights for policy 1, policy_version 1670673 (0.0005) [2023-12-26 13:01:30,501][123090] Updated weights for policy 1, policy_version 1670683 (0.0005) [2023-12-26 13:01:30,881][123091] Updated weights for policy 0, policy_version 1681847 (0.0005) [2023-12-26 13:01:30,955][123091] Updated weights for policy 0, policy_version 1681857 (0.0005) [2023-12-26 13:01:31,024][123091] Updated weights for policy 0, policy_version 1681867 (0.0006) [2023-12-26 13:01:31,186][123090] Updated weights for policy 1, policy_version 1670693 (0.0007) [2023-12-26 13:01:31,247][123090] Updated weights for policy 1, policy_version 1670703 (0.0006) [2023-12-26 13:01:31,308][123090] Updated weights for policy 1, policy_version 1670713 (0.0006) [2023-12-26 13:01:31,784][123091] Updated weights for policy 0, policy_version 1681877 (0.0008) [2023-12-26 13:01:31,849][123091] Updated weights for policy 0, policy_version 1681887 (0.0008) [2023-12-26 13:01:31,913][123091] Updated weights for policy 0, policy_version 1681897 (0.0008) [2023-12-26 13:01:32,064][123090] Updated weights for policy 1, policy_version 1670723 (0.0007) [2023-12-26 13:01:32,127][123090] Updated weights for policy 1, policy_version 1670733 (0.0010) [2023-12-26 13:01:32,193][123090] Updated weights for policy 1, policy_version 1670743 (0.0010) [2023-12-26 13:01:32,621][123091] Updated weights for policy 0, policy_version 1681907 (0.0008) [2023-12-26 13:01:32,682][123091] Updated weights for policy 0, policy_version 1681917 (0.0008) [2023-12-26 13:01:32,745][123091] Updated weights for policy 0, policy_version 1681927 (0.0009) [2023-12-26 13:01:33,085][123090] Updated weights for policy 1, policy_version 1670753 (0.0010) [2023-12-26 13:01:33,146][123090] Updated weights for policy 1, policy_version 1670763 (0.0010) [2023-12-26 13:01:33,223][123090] Updated weights for policy 1, policy_version 1670773 (0.0011) [2023-12-26 13:01:33,292][123090] Updated weights for policy 1, policy_version 1670783 (0.0010) [2023-12-26 13:01:33,451][123091] Updated weights for policy 0, policy_version 1681937 (0.0010) [2023-12-26 13:01:33,518][123091] Updated weights for policy 0, policy_version 1681947 (0.0005) [2023-12-26 13:01:33,563][123091] Updated weights for policy 0, policy_version 1681957 (0.0005) [2023-12-26 13:01:33,608][123091] Updated weights for policy 0, policy_version 1681967 (0.0005) [2023-12-26 13:01:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 858308608. Throughput: 0: 8727.2, 1: 8819.3. Samples: 858317768. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:33,784][121949] Avg episode reward: [(0, '5776.530'), (1, '6027.950')] [2023-12-26 13:01:34,072][123090] Updated weights for policy 1, policy_version 1670793 (0.0010) [2023-12-26 13:01:34,123][123090] Updated weights for policy 1, policy_version 1670803 (0.0010) [2023-12-26 13:01:34,188][123090] Updated weights for policy 1, policy_version 1670813 (0.0011) [2023-12-26 13:01:34,252][123091] Updated weights for policy 0, policy_version 1681977 (0.0010) [2023-12-26 13:01:34,318][123091] Updated weights for policy 0, policy_version 1681987 (0.0011) [2023-12-26 13:01:34,381][123091] Updated weights for policy 0, policy_version 1681997 (0.0011) [2023-12-26 13:01:35,050][123090] Updated weights for policy 1, policy_version 1670823 (0.0010) [2023-12-26 13:01:35,093][123090] Updated weights for policy 1, policy_version 1670833 (0.0010) [2023-12-26 13:01:35,137][123090] Updated weights for policy 1, policy_version 1670843 (0.0010) [2023-12-26 13:01:35,186][123091] Updated weights for policy 0, policy_version 1682007 (0.0010) [2023-12-26 13:01:35,254][123091] Updated weights for policy 0, policy_version 1682017 (0.0011) [2023-12-26 13:01:35,324][123091] Updated weights for policy 0, policy_version 1682027 (0.0010) [2023-12-26 13:01:35,971][123090] Updated weights for policy 1, policy_version 1670853 (0.0010) [2023-12-26 13:01:36,027][123090] Updated weights for policy 1, policy_version 1670863 (0.0009) [2023-12-26 13:01:36,089][123090] Updated weights for policy 1, policy_version 1670873 (0.0010) [2023-12-26 13:01:36,126][123091] Updated weights for policy 0, policy_version 1682037 (0.0010) [2023-12-26 13:01:36,186][123091] Updated weights for policy 0, policy_version 1682047 (0.0010) [2023-12-26 13:01:36,246][123091] Updated weights for policy 0, policy_version 1682057 (0.0009) [2023-12-26 13:01:36,790][123090] Updated weights for policy 1, policy_version 1670883 (0.0007) [2023-12-26 13:01:36,839][123090] Updated weights for policy 1, policy_version 1670893 (0.0005) [2023-12-26 13:01:36,895][123090] Updated weights for policy 1, policy_version 1670903 (0.0006) [2023-12-26 13:01:37,154][123091] Updated weights for policy 0, policy_version 1682067 (0.0010) [2023-12-26 13:01:37,220][123091] Updated weights for policy 0, policy_version 1682077 (0.0010) [2023-12-26 13:01:37,283][123091] Updated weights for policy 0, policy_version 1682087 (0.0009) [2023-12-26 13:01:37,611][123090] Updated weights for policy 1, policy_version 1670913 (0.0006) [2023-12-26 13:01:37,665][123090] Updated weights for policy 1, policy_version 1670924 (0.0010) [2023-12-26 13:01:37,721][123090] Updated weights for policy 1, policy_version 1670934 (0.0009) [2023-12-26 13:01:37,783][123090] Updated weights for policy 1, policy_version 1670944 (0.0009) [2023-12-26 13:01:37,975][123091] Updated weights for policy 0, policy_version 1682097 (0.0007) [2023-12-26 13:01:38,043][123091] Updated weights for policy 0, policy_version 1682107 (0.0006) [2023-12-26 13:01:38,091][123091] Updated weights for policy 0, policy_version 1682117 (0.0008) [2023-12-26 13:01:38,150][123091] Updated weights for policy 0, policy_version 1682127 (0.0010) [2023-12-26 13:01:38,590][123090] Updated weights for policy 1, policy_version 1670954 (0.0009) [2023-12-26 13:01:38,652][123090] Updated weights for policy 1, policy_version 1670964 (0.0009) [2023-12-26 13:01:38,718][123090] Updated weights for policy 1, policy_version 1670974 (0.0008) [2023-12-26 13:01:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 858398720. Throughput: 0: 8745.0, 1: 8815.0. Samples: 858370688. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:38,785][121949] Avg episode reward: [(0, '5696.789'), (1, '6058.346')] [2023-12-26 13:01:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001670976_427769856.pth... [2023-12-26 13:01:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001682128_430628864.pth... [2023-12-26 13:01:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001681104_430366720.pth [2023-12-26 13:01:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001669952_427507712.pth [2023-12-26 13:01:38,940][123091] Updated weights for policy 0, policy_version 1682137 (0.0011) [2023-12-26 13:01:39,003][123091] Updated weights for policy 0, policy_version 1682147 (0.0011) [2023-12-26 13:01:39,059][123091] Updated weights for policy 0, policy_version 1682157 (0.0011) [2023-12-26 13:01:39,582][123090] Updated weights for policy 1, policy_version 1670984 (0.0010) [2023-12-26 13:01:39,649][123090] Updated weights for policy 1, policy_version 1670994 (0.0007) [2023-12-26 13:01:39,722][123090] Updated weights for policy 1, policy_version 1671004 (0.0009) [2023-12-26 13:01:39,956][123091] Updated weights for policy 0, policy_version 1682167 (0.0010) [2023-12-26 13:01:40,026][123091] Updated weights for policy 0, policy_version 1682177 (0.0011) [2023-12-26 13:01:40,098][123091] Updated weights for policy 0, policy_version 1682187 (0.0011) [2023-12-26 13:01:40,504][123090] Updated weights for policy 1, policy_version 1671014 (0.0009) [2023-12-26 13:01:40,583][123090] Updated weights for policy 1, policy_version 1671024 (0.0010) [2023-12-26 13:01:40,651][123090] Updated weights for policy 1, policy_version 1671034 (0.0009) [2023-12-26 13:01:40,905][123091] Updated weights for policy 0, policy_version 1682197 (0.0008) [2023-12-26 13:01:40,969][123091] Updated weights for policy 0, policy_version 1682207 (0.0009) [2023-12-26 13:01:41,031][123091] Updated weights for policy 0, policy_version 1682217 (0.0011) [2023-12-26 13:01:41,474][123090] Updated weights for policy 1, policy_version 1671044 (0.0009) [2023-12-26 13:01:41,541][123090] Updated weights for policy 1, policy_version 1671054 (0.0011) [2023-12-26 13:01:41,609][123090] Updated weights for policy 1, policy_version 1671064 (0.0010) [2023-12-26 13:01:41,863][123091] Updated weights for policy 0, policy_version 1682227 (0.0009) [2023-12-26 13:01:41,926][123091] Updated weights for policy 0, policy_version 1682237 (0.0009) [2023-12-26 13:01:42,000][123091] Updated weights for policy 0, policy_version 1682247 (0.0006) [2023-12-26 13:01:42,464][123090] Updated weights for policy 1, policy_version 1671074 (0.0009) [2023-12-26 13:01:42,534][123090] Updated weights for policy 1, policy_version 1671084 (0.0006) [2023-12-26 13:01:42,598][123090] Updated weights for policy 1, policy_version 1671094 (0.0006) [2023-12-26 13:01:42,659][123090] Updated weights for policy 1, policy_version 1671104 (0.0007) [2023-12-26 13:01:42,758][123091] Updated weights for policy 0, policy_version 1682257 (0.0006) [2023-12-26 13:01:42,833][123091] Updated weights for policy 0, policy_version 1682267 (0.0006) [2023-12-26 13:01:42,895][123091] Updated weights for policy 0, policy_version 1682277 (0.0005) [2023-12-26 13:01:42,960][123091] Updated weights for policy 0, policy_version 1682287 (0.0006) [2023-12-26 13:01:43,357][123090] Updated weights for policy 1, policy_version 1671114 (0.0010) [2023-12-26 13:01:43,422][123090] Updated weights for policy 1, policy_version 1671124 (0.0010) [2023-12-26 13:01:43,485][123090] Updated weights for policy 1, policy_version 1671134 (0.0010) [2023-12-26 13:01:43,609][123091] Updated weights for policy 0, policy_version 1682297 (0.0009) [2023-12-26 13:01:43,657][123091] Updated weights for policy 0, policy_version 1682307 (0.0009) [2023-12-26 13:01:43,700][123091] Updated weights for policy 0, policy_version 1682317 (0.0005) [2023-12-26 13:01:43,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 858488832. Throughput: 0: 8783.5, 1: 8788.8. Samples: 858475016. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:43,785][121949] Avg episode reward: [(0, '5750.506'), (1, '5970.186')] [2023-12-26 13:01:44,252][123090] Updated weights for policy 1, policy_version 1671144 (0.0007) [2023-12-26 13:01:44,321][123090] Updated weights for policy 1, policy_version 1671154 (0.0006) [2023-12-26 13:01:44,368][123090] Updated weights for policy 1, policy_version 1671164 (0.0005) [2023-12-26 13:01:44,531][123091] Updated weights for policy 0, policy_version 1682327 (0.0005) [2023-12-26 13:01:44,576][123091] Updated weights for policy 0, policy_version 1682337 (0.0005) [2023-12-26 13:01:44,639][123091] Updated weights for policy 0, policy_version 1682347 (0.0005) [2023-12-26 13:01:45,219][123090] Updated weights for policy 1, policy_version 1671174 (0.0008) [2023-12-26 13:01:45,279][123090] Updated weights for policy 1, policy_version 1671184 (0.0010) [2023-12-26 13:01:45,338][123090] Updated weights for policy 1, policy_version 1671194 (0.0009) [2023-12-26 13:01:45,358][123091] Updated weights for policy 0, policy_version 1682357 (0.0006) [2023-12-26 13:01:45,404][123091] Updated weights for policy 0, policy_version 1682367 (0.0008) [2023-12-26 13:01:45,452][123091] Updated weights for policy 0, policy_version 1682377 (0.0008) [2023-12-26 13:01:46,222][123091] Updated weights for policy 0, policy_version 1682387 (0.0005) [2023-12-26 13:01:46,234][123090] Updated weights for policy 1, policy_version 1671204 (0.0008) [2023-12-26 13:01:46,284][123091] Updated weights for policy 0, policy_version 1682397 (0.0005) [2023-12-26 13:01:46,290][123090] Updated weights for policy 1, policy_version 1671214 (0.0009) [2023-12-26 13:01:46,338][123090] Updated weights for policy 1, policy_version 1671224 (0.0010) [2023-12-26 13:01:46,346][123091] Updated weights for policy 0, policy_version 1682407 (0.0008) [2023-12-26 13:01:47,051][123091] Updated weights for policy 0, policy_version 1682417 (0.0009) [2023-12-26 13:01:47,099][123091] Updated weights for policy 0, policy_version 1682427 (0.0005) [2023-12-26 13:01:47,156][123091] Updated weights for policy 0, policy_version 1682437 (0.0005) [2023-12-26 13:01:47,207][123091] Updated weights for policy 0, policy_version 1682447 (0.0006) [2023-12-26 13:01:47,230][123090] Updated weights for policy 1, policy_version 1671234 (0.0008) [2023-12-26 13:01:47,285][123090] Updated weights for policy 1, policy_version 1671244 (0.0010) [2023-12-26 13:01:47,338][123090] Updated weights for policy 1, policy_version 1671254 (0.0009) [2023-12-26 13:01:47,395][123090] Updated weights for policy 1, policy_version 1671264 (0.0009) [2023-12-26 13:01:47,956][123091] Updated weights for policy 0, policy_version 1682457 (0.0009) [2023-12-26 13:01:48,002][123091] Updated weights for policy 0, policy_version 1682467 (0.0009) [2023-12-26 13:01:48,055][123091] Updated weights for policy 0, policy_version 1682477 (0.0006) [2023-12-26 13:01:48,250][123090] Updated weights for policy 1, policy_version 1671274 (0.0009) [2023-12-26 13:01:48,300][123090] Updated weights for policy 1, policy_version 1671284 (0.0009) [2023-12-26 13:01:48,367][123090] Updated weights for policy 1, policy_version 1671295 (0.0009) [2023-12-26 13:01:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 858570752. Throughput: 0: 8919.8, 1: 8777.3. Samples: 858584852. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:48,785][121949] Avg episode reward: [(0, '6071.234'), (1, '5970.916')] [2023-12-26 13:01:48,853][123091] Updated weights for policy 0, policy_version 1682487 (0.0005) [2023-12-26 13:01:48,921][123091] Updated weights for policy 0, policy_version 1682497 (0.0006) [2023-12-26 13:01:48,984][123091] Updated weights for policy 0, policy_version 1682507 (0.0007) [2023-12-26 13:01:49,161][123090] Updated weights for policy 1, policy_version 1671305 (0.0009) [2023-12-26 13:01:49,216][123090] Updated weights for policy 1, policy_version 1671315 (0.0009) [2023-12-26 13:01:49,292][123090] Updated weights for policy 1, policy_version 1671325 (0.0010) [2023-12-26 13:01:49,669][123091] Updated weights for policy 0, policy_version 1682517 (0.0007) [2023-12-26 13:01:49,741][123091] Updated weights for policy 0, policy_version 1682527 (0.0009) [2023-12-26 13:01:49,806][123091] Updated weights for policy 0, policy_version 1682537 (0.0010) [2023-12-26 13:01:50,198][123090] Updated weights for policy 1, policy_version 1671335 (0.0009) [2023-12-26 13:01:50,260][123090] Updated weights for policy 1, policy_version 1671345 (0.0010) [2023-12-26 13:01:50,325][123090] Updated weights for policy 1, policy_version 1671355 (0.0009) [2023-12-26 13:01:50,560][123091] Updated weights for policy 0, policy_version 1682547 (0.0008) [2023-12-26 13:01:50,626][123091] Updated weights for policy 0, policy_version 1682557 (0.0007) [2023-12-26 13:01:50,691][123091] Updated weights for policy 0, policy_version 1682567 (0.0006) [2023-12-26 13:01:51,239][123090] Updated weights for policy 1, policy_version 1671365 (0.0009) [2023-12-26 13:01:51,303][123090] Updated weights for policy 1, policy_version 1671375 (0.0010) [2023-12-26 13:01:51,374][123090] Updated weights for policy 1, policy_version 1671385 (0.0009) [2023-12-26 13:01:51,428][123091] Updated weights for policy 0, policy_version 1682577 (0.0005) [2023-12-26 13:01:51,494][123091] Updated weights for policy 0, policy_version 1682587 (0.0006) [2023-12-26 13:01:51,557][123091] Updated weights for policy 0, policy_version 1682597 (0.0009) [2023-12-26 13:01:51,614][123091] Updated weights for policy 0, policy_version 1682607 (0.0009) [2023-12-26 13:01:52,191][123090] Updated weights for policy 1, policy_version 1671395 (0.0008) [2023-12-26 13:01:52,262][123090] Updated weights for policy 1, policy_version 1671405 (0.0007) [2023-12-26 13:01:52,332][123090] Updated weights for policy 1, policy_version 1671415 (0.0009) [2023-12-26 13:01:52,454][123091] Updated weights for policy 0, policy_version 1682617 (0.0008) [2023-12-26 13:01:52,522][123091] Updated weights for policy 0, policy_version 1682627 (0.0009) [2023-12-26 13:01:52,585][123091] Updated weights for policy 0, policy_version 1682637 (0.0009) [2023-12-26 13:01:53,183][123090] Updated weights for policy 1, policy_version 1671425 (0.0009) [2023-12-26 13:01:53,244][123090] Updated weights for policy 1, policy_version 1671435 (0.0009) [2023-12-26 13:01:53,303][123090] Updated weights for policy 1, policy_version 1671445 (0.0010) [2023-12-26 13:01:53,356][123091] Updated weights for policy 0, policy_version 1682647 (0.0007) [2023-12-26 13:01:53,366][123090] Updated weights for policy 1, policy_version 1671455 (0.0010) [2023-12-26 13:01:53,410][123091] Updated weights for policy 0, policy_version 1682657 (0.0008) [2023-12-26 13:01:53,462][123091] Updated weights for policy 0, policy_version 1682667 (0.0008) [2023-12-26 13:01:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 858660864. Throughput: 0: 8953.4, 1: 8697.1. Samples: 858637072. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:53,785][121949] Avg episode reward: [(0, '6169.235'), (1, '5976.917')] [2023-12-26 13:01:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001682672_430768128.pth... [2023-12-26 13:01:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001671456_427892736.pth... [2023-12-26 13:01:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001681616_430497792.pth [2023-12-26 13:01:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001670464_427638784.pth [2023-12-26 13:01:54,125][123090] Updated weights for policy 1, policy_version 1671465 (0.0011) [2023-12-26 13:01:54,182][123090] Updated weights for policy 1, policy_version 1671475 (0.0010) [2023-12-26 13:01:54,214][123091] Updated weights for policy 0, policy_version 1682677 (0.0005) [2023-12-26 13:01:54,247][123090] Updated weights for policy 1, policy_version 1671485 (0.0011) [2023-12-26 13:01:54,271][123091] Updated weights for policy 0, policy_version 1682687 (0.0006) [2023-12-26 13:01:54,320][123091] Updated weights for policy 0, policy_version 1682697 (0.0008) [2023-12-26 13:01:55,066][123090] Updated weights for policy 1, policy_version 1671495 (0.0010) [2023-12-26 13:01:55,145][123091] Updated weights for policy 0, policy_version 1682707 (0.0007) [2023-12-26 13:01:55,155][123090] Updated weights for policy 1, policy_version 1671505 (0.0010) [2023-12-26 13:01:55,193][123091] Updated weights for policy 0, policy_version 1682717 (0.0006) [2023-12-26 13:01:55,208][123090] Updated weights for policy 1, policy_version 1671515 (0.0010) [2023-12-26 13:01:55,246][123091] Updated weights for policy 0, policy_version 1682727 (0.0006) [2023-12-26 13:01:55,865][123090] Updated weights for policy 1, policy_version 1671525 (0.0008) [2023-12-26 13:01:55,918][123090] Updated weights for policy 1, policy_version 1671535 (0.0006) [2023-12-26 13:01:55,970][123090] Updated weights for policy 1, policy_version 1671545 (0.0010) [2023-12-26 13:01:56,080][123091] Updated weights for policy 0, policy_version 1682737 (0.0009) [2023-12-26 13:01:56,142][123091] Updated weights for policy 0, policy_version 1682747 (0.0010) [2023-12-26 13:01:56,190][123091] Updated weights for policy 0, policy_version 1682757 (0.0010) [2023-12-26 13:01:56,242][123091] Updated weights for policy 0, policy_version 1682767 (0.0010) [2023-12-26 13:01:56,694][123090] Updated weights for policy 1, policy_version 1671555 (0.0009) [2023-12-26 13:01:56,757][123090] Updated weights for policy 1, policy_version 1671565 (0.0008) [2023-12-26 13:01:56,828][123090] Updated weights for policy 1, policy_version 1671575 (0.0009) [2023-12-26 13:01:57,003][123091] Updated weights for policy 0, policy_version 1682777 (0.0009) [2023-12-26 13:01:57,065][123091] Updated weights for policy 0, policy_version 1682787 (0.0005) [2023-12-26 13:01:57,142][123091] Updated weights for policy 0, policy_version 1682797 (0.0005) [2023-12-26 13:01:57,519][123090] Updated weights for policy 1, policy_version 1671585 (0.0007) [2023-12-26 13:01:57,582][123090] Updated weights for policy 1, policy_version 1671595 (0.0005) [2023-12-26 13:01:57,647][123090] Updated weights for policy 1, policy_version 1671605 (0.0005) [2023-12-26 13:01:57,698][123090] Updated weights for policy 1, policy_version 1671615 (0.0005) [2023-12-26 13:01:57,846][123091] Updated weights for policy 0, policy_version 1682807 (0.0006) [2023-12-26 13:01:57,900][123091] Updated weights for policy 0, policy_version 1682817 (0.0005) [2023-12-26 13:01:57,945][123091] Updated weights for policy 0, policy_version 1682827 (0.0005) [2023-12-26 13:01:58,328][123090] Updated weights for policy 1, policy_version 1671625 (0.0007) [2023-12-26 13:01:58,400][123090] Updated weights for policy 1, policy_version 1671635 (0.0008) [2023-12-26 13:01:58,471][123090] Updated weights for policy 1, policy_version 1671645 (0.0007) [2023-12-26 13:01:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 17748.8, 300 sec: 17661.3). Total num frames: 858750976. Throughput: 0: 9063.3, 1: 8765.3. Samples: 858746680. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:01:58,787][121949] Avg episode reward: [(0, '6161.811'), (1, '5811.576')] [2023-12-26 13:01:58,799][123091] Updated weights for policy 0, policy_version 1682837 (0.0008) [2023-12-26 13:01:58,866][123091] Updated weights for policy 0, policy_version 1682847 (0.0009) [2023-12-26 13:01:58,927][123091] Updated weights for policy 0, policy_version 1682857 (0.0009) [2023-12-26 13:01:59,336][123090] Updated weights for policy 1, policy_version 1671655 (0.0008) [2023-12-26 13:01:59,406][123090] Updated weights for policy 1, policy_version 1671665 (0.0009) [2023-12-26 13:01:59,465][123090] Updated weights for policy 1, policy_version 1671675 (0.0009) [2023-12-26 13:01:59,748][123091] Updated weights for policy 0, policy_version 1682867 (0.0008) [2023-12-26 13:01:59,796][123091] Updated weights for policy 0, policy_version 1682877 (0.0005) [2023-12-26 13:01:59,864][123091] Updated weights for policy 0, policy_version 1682887 (0.0007) [2023-12-26 13:02:00,325][123090] Updated weights for policy 1, policy_version 1671685 (0.0010) [2023-12-26 13:02:00,380][123090] Updated weights for policy 1, policy_version 1671695 (0.0010) [2023-12-26 13:02:00,427][123090] Updated weights for policy 1, policy_version 1671705 (0.0008) [2023-12-26 13:02:00,570][123091] Updated weights for policy 0, policy_version 1682897 (0.0006) [2023-12-26 13:02:00,625][123091] Updated weights for policy 0, policy_version 1682907 (0.0005) [2023-12-26 13:02:00,679][123091] Updated weights for policy 0, policy_version 1682917 (0.0006) [2023-12-26 13:02:00,724][123091] Updated weights for policy 0, policy_version 1682927 (0.0005) [2023-12-26 13:02:01,260][123090] Updated weights for policy 1, policy_version 1671715 (0.0006) [2023-12-26 13:02:01,310][123090] Updated weights for policy 1, policy_version 1671725 (0.0006) [2023-12-26 13:02:01,371][123090] Updated weights for policy 1, policy_version 1671735 (0.0010) [2023-12-26 13:02:01,397][123091] Updated weights for policy 0, policy_version 1682937 (0.0008) [2023-12-26 13:02:01,459][123091] Updated weights for policy 0, policy_version 1682947 (0.0009) [2023-12-26 13:02:01,523][123091] Updated weights for policy 0, policy_version 1682957 (0.0010) [2023-12-26 13:02:02,163][123090] Updated weights for policy 1, policy_version 1671745 (0.0007) [2023-12-26 13:02:02,228][123090] Updated weights for policy 1, policy_version 1671755 (0.0005) [2023-12-26 13:02:02,304][123090] Updated weights for policy 1, policy_version 1671765 (0.0006) [2023-12-26 13:02:02,370][123090] Updated weights for policy 1, policy_version 1671775 (0.0007) [2023-12-26 13:02:02,381][123091] Updated weights for policy 0, policy_version 1682967 (0.0009) [2023-12-26 13:02:02,448][123091] Updated weights for policy 0, policy_version 1682977 (0.0009) [2023-12-26 13:02:02,509][123091] Updated weights for policy 0, policy_version 1682987 (0.0009) [2023-12-26 13:02:03,138][123090] Updated weights for policy 1, policy_version 1671785 (0.0006) [2023-12-26 13:02:03,193][123090] Updated weights for policy 1, policy_version 1671795 (0.0006) [2023-12-26 13:02:03,250][123090] Updated weights for policy 1, policy_version 1671805 (0.0006) [2023-12-26 13:02:03,260][123091] Updated weights for policy 0, policy_version 1682997 (0.0007) [2023-12-26 13:02:03,328][123091] Updated weights for policy 0, policy_version 1683007 (0.0006) [2023-12-26 13:02:03,386][123091] Updated weights for policy 0, policy_version 1683017 (0.0005) [2023-12-26 13:02:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 858841088. Throughput: 0: 9072.6, 1: 8714.7. Samples: 858853844. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:02:03,785][121949] Avg episode reward: [(0, '6060.083'), (1, '5853.049')] [2023-12-26 13:02:03,924][123090] Updated weights for policy 1, policy_version 1671815 (0.0005) [2023-12-26 13:02:03,991][123090] Updated weights for policy 1, policy_version 1671825 (0.0005) [2023-12-26 13:02:04,059][123091] Updated weights for policy 0, policy_version 1683027 (0.0005) [2023-12-26 13:02:04,063][123090] Updated weights for policy 1, policy_version 1671835 (0.0005) [2023-12-26 13:02:04,131][123091] Updated weights for policy 0, policy_version 1683037 (0.0006) [2023-12-26 13:02:04,201][123091] Updated weights for policy 0, policy_version 1683047 (0.0005) [2023-12-26 13:02:04,797][123090] Updated weights for policy 1, policy_version 1671845 (0.0006) [2023-12-26 13:02:04,863][123090] Updated weights for policy 1, policy_version 1671855 (0.0005) [2023-12-26 13:02:04,879][123091] Updated weights for policy 0, policy_version 1683057 (0.0007) [2023-12-26 13:02:04,924][123090] Updated weights for policy 1, policy_version 1671865 (0.0005) [2023-12-26 13:02:04,935][123091] Updated weights for policy 0, policy_version 1683067 (0.0006) [2023-12-26 13:02:05,003][123091] Updated weights for policy 0, policy_version 1683077 (0.0005) [2023-12-26 13:02:05,064][123091] Updated weights for policy 0, policy_version 1683087 (0.0010) [2023-12-26 13:02:05,656][123090] Updated weights for policy 1, policy_version 1671875 (0.0009) [2023-12-26 13:02:05,703][123090] Updated weights for policy 1, policy_version 1671885 (0.0010) [2023-12-26 13:02:05,761][123090] Updated weights for policy 1, policy_version 1671895 (0.0010) [2023-12-26 13:02:05,804][123091] Updated weights for policy 0, policy_version 1683097 (0.0006) [2023-12-26 13:02:05,870][123091] Updated weights for policy 0, policy_version 1683107 (0.0008) [2023-12-26 13:02:05,932][123091] Updated weights for policy 0, policy_version 1683117 (0.0010) [2023-12-26 13:02:06,625][123090] Updated weights for policy 1, policy_version 1671905 (0.0010) [2023-12-26 13:02:06,667][123091] Updated weights for policy 0, policy_version 1683127 (0.0008) [2023-12-26 13:02:06,677][123090] Updated weights for policy 1, policy_version 1671915 (0.0010) [2023-12-26 13:02:06,722][123091] Updated weights for policy 0, policy_version 1683137 (0.0007) [2023-12-26 13:02:06,740][123090] Updated weights for policy 1, policy_version 1671925 (0.0008) [2023-12-26 13:02:06,778][123091] Updated weights for policy 0, policy_version 1683147 (0.0007) [2023-12-26 13:02:06,792][123090] Updated weights for policy 1, policy_version 1671935 (0.0006) [2023-12-26 13:02:07,541][123091] Updated weights for policy 0, policy_version 1683157 (0.0007) [2023-12-26 13:02:07,598][123091] Updated weights for policy 0, policy_version 1683167 (0.0005) [2023-12-26 13:02:07,627][123090] Updated weights for policy 1, policy_version 1671945 (0.0005) [2023-12-26 13:02:07,655][123091] Updated weights for policy 0, policy_version 1683177 (0.0005) [2023-12-26 13:02:07,687][123090] Updated weights for policy 1, policy_version 1671955 (0.0005) [2023-12-26 13:02:07,762][123090] Updated weights for policy 1, policy_version 1671965 (0.0005) [2023-12-26 13:02:08,232][123091] Updated weights for policy 0, policy_version 1683187 (0.0005) [2023-12-26 13:02:08,298][123091] Updated weights for policy 0, policy_version 1683197 (0.0005) [2023-12-26 13:02:08,371][123091] Updated weights for policy 0, policy_version 1683207 (0.0008) [2023-12-26 13:02:08,394][123090] Updated weights for policy 1, policy_version 1671975 (0.0008) [2023-12-26 13:02:08,460][123090] Updated weights for policy 1, policy_version 1671985 (0.0008) [2023-12-26 13:02:08,531][123090] Updated weights for policy 1, policy_version 1671995 (0.0010) [2023-12-26 13:02:08,784][121949] Fps is (10 sec: 18845.0, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 858939392. Throughput: 0: 9133.2, 1: 8730.0. Samples: 858909912. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:02:08,785][121949] Avg episode reward: [(0, '5979.299'), (1, '5973.994')] [2023-12-26 13:02:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001683216_430907392.pth... [2023-12-26 13:02:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001672000_428032000.pth... [2023-12-26 13:02:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001682128_430628864.pth [2023-12-26 13:02:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001670976_427769856.pth [2023-12-26 13:02:09,076][123091] Updated weights for policy 0, policy_version 1683217 (0.0006) [2023-12-26 13:02:09,132][123091] Updated weights for policy 0, policy_version 1683227 (0.0010) [2023-12-26 13:02:09,184][123091] Updated weights for policy 0, policy_version 1683237 (0.0009) [2023-12-26 13:02:09,249][123091] Updated weights for policy 0, policy_version 1683248 (0.0010) [2023-12-26 13:02:09,341][123090] Updated weights for policy 1, policy_version 1672005 (0.0008) [2023-12-26 13:02:09,410][123090] Updated weights for policy 1, policy_version 1672015 (0.0008) [2023-12-26 13:02:09,478][123090] Updated weights for policy 1, policy_version 1672025 (0.0008) [2023-12-26 13:02:10,170][123091] Updated weights for policy 0, policy_version 1683258 (0.0009) [2023-12-26 13:02:10,230][123091] Updated weights for policy 0, policy_version 1683268 (0.0007) [2023-12-26 13:02:10,283][123090] Updated weights for policy 1, policy_version 1672035 (0.0009) [2023-12-26 13:02:10,286][123091] Updated weights for policy 0, policy_version 1683278 (0.0008) [2023-12-26 13:02:10,351][123090] Updated weights for policy 1, policy_version 1672045 (0.0011) [2023-12-26 13:02:10,408][123090] Updated weights for policy 1, policy_version 1672055 (0.0011) [2023-12-26 13:02:11,059][123091] Updated weights for policy 0, policy_version 1683288 (0.0010) [2023-12-26 13:02:11,119][123091] Updated weights for policy 0, policy_version 1683298 (0.0010) [2023-12-26 13:02:11,189][123091] Updated weights for policy 0, policy_version 1683308 (0.0008) [2023-12-26 13:02:11,302][123090] Updated weights for policy 1, policy_version 1672065 (0.0011) [2023-12-26 13:02:11,370][123090] Updated weights for policy 1, policy_version 1672075 (0.0007) [2023-12-26 13:02:11,445][123090] Updated weights for policy 1, policy_version 1672085 (0.0009) [2023-12-26 13:02:11,512][123090] Updated weights for policy 1, policy_version 1672095 (0.0009) [2023-12-26 13:02:12,024][123091] Updated weights for policy 0, policy_version 1683318 (0.0008) [2023-12-26 13:02:12,076][123091] Updated weights for policy 0, policy_version 1683328 (0.0008) [2023-12-26 13:02:12,138][123091] Updated weights for policy 0, policy_version 1683338 (0.0008) [2023-12-26 13:02:12,425][123090] Updated weights for policy 1, policy_version 1672105 (0.0008) [2023-12-26 13:02:12,486][123090] Updated weights for policy 1, policy_version 1672115 (0.0008) [2023-12-26 13:02:12,553][123090] Updated weights for policy 1, policy_version 1672125 (0.0008) [2023-12-26 13:02:12,962][123091] Updated weights for policy 0, policy_version 1683348 (0.0009) [2023-12-26 13:02:13,023][123091] Updated weights for policy 0, policy_version 1683358 (0.0011) [2023-12-26 13:02:13,090][123091] Updated weights for policy 0, policy_version 1683368 (0.0010) [2023-12-26 13:02:13,400][123090] Updated weights for policy 1, policy_version 1672135 (0.0008) [2023-12-26 13:02:13,451][123090] Updated weights for policy 1, policy_version 1672145 (0.0009) [2023-12-26 13:02:13,506][123090] Updated weights for policy 1, policy_version 1672155 (0.0009) [2023-12-26 13:02:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 859021312. Throughput: 0: 9114.2, 1: 8785.7. Samples: 859015224. Policy #0 lag: (min: 31.0, avg: 45.8, max: 63.0) [2023-12-26 13:02:13,784][121949] Avg episode reward: [(0, '5885.143'), (1, '5749.712')] [2023-12-26 13:02:13,886][123091] Updated weights for policy 0, policy_version 1683378 (0.0008) [2023-12-26 13:02:13,949][123091] Updated weights for policy 0, policy_version 1683388 (0.0010) [2023-12-26 13:02:14,008][123091] Updated weights for policy 0, policy_version 1683398 (0.0010) [2023-12-26 13:02:14,071][123091] Updated weights for policy 0, policy_version 1683408 (0.0011) [2023-12-26 13:02:14,129][123090] Updated weights for policy 1, policy_version 1672165 (0.0007) [2023-12-26 13:02:14,190][123090] Updated weights for policy 1, policy_version 1672175 (0.0005) [2023-12-26 13:02:14,241][123090] Updated weights for policy 1, policy_version 1672185 (0.0006) [2023-12-26 13:02:14,767][123091] Updated weights for policy 0, policy_version 1683418 (0.0011) [2023-12-26 13:02:14,838][123091] Updated weights for policy 0, policy_version 1683428 (0.0012) [2023-12-26 13:02:14,892][123091] Updated weights for policy 0, policy_version 1683438 (0.0008) [2023-12-26 13:02:14,931][123090] Updated weights for policy 1, policy_version 1672195 (0.0007) [2023-12-26 13:02:14,983][123090] Updated weights for policy 1, policy_version 1672205 (0.0009) [2023-12-26 13:02:15,040][123090] Updated weights for policy 1, policy_version 1672216 (0.0010) [2023-12-26 13:02:15,739][123091] Updated weights for policy 0, policy_version 1683448 (0.0009) [2023-12-26 13:02:15,788][123091] Updated weights for policy 0, policy_version 1683458 (0.0009) [2023-12-26 13:02:15,816][123090] Updated weights for policy 1, policy_version 1672226 (0.0007) [2023-12-26 13:02:15,845][123091] Updated weights for policy 0, policy_version 1683468 (0.0007) [2023-12-26 13:02:15,876][123090] Updated weights for policy 1, policy_version 1672236 (0.0010) [2023-12-26 13:02:15,923][123090] Updated weights for policy 1, policy_version 1672246 (0.0010) [2023-12-26 13:02:15,974][123090] Updated weights for policy 1, policy_version 1672256 (0.0010) [2023-12-26 13:02:16,618][123091] Updated weights for policy 0, policy_version 1683478 (0.0008) [2023-12-26 13:02:16,667][123091] Updated weights for policy 0, policy_version 1683488 (0.0008) [2023-12-26 13:02:16,719][123091] Updated weights for policy 0, policy_version 1683498 (0.0009) [2023-12-26 13:02:16,818][123090] Updated weights for policy 1, policy_version 1672266 (0.0010) [2023-12-26 13:02:16,872][123090] Updated weights for policy 1, policy_version 1672276 (0.0010) [2023-12-26 13:02:16,943][123090] Updated weights for policy 1, policy_version 1672286 (0.0010) [2023-12-26 13:02:17,574][123091] Updated weights for policy 0, policy_version 1683508 (0.0009) [2023-12-26 13:02:17,622][123091] Updated weights for policy 0, policy_version 1683518 (0.0008) [2023-12-26 13:02:17,671][123091] Updated weights for policy 0, policy_version 1683528 (0.0009) [2023-12-26 13:02:17,761][123090] Updated weights for policy 1, policy_version 1672296 (0.0011) [2023-12-26 13:02:17,828][123090] Updated weights for policy 1, policy_version 1672306 (0.0011) [2023-12-26 13:02:17,887][123090] Updated weights for policy 1, policy_version 1672316 (0.0010) [2023-12-26 13:02:18,589][123091] Updated weights for policy 0, policy_version 1683539 (0.0008) [2023-12-26 13:02:18,593][123090] Updated weights for policy 1, policy_version 1672326 (0.0010) [2023-12-26 13:02:18,638][123091] Updated weights for policy 0, policy_version 1683549 (0.0006) [2023-12-26 13:02:18,652][123090] Updated weights for policy 1, policy_version 1672336 (0.0008) [2023-12-26 13:02:18,688][123091] Updated weights for policy 0, policy_version 1683559 (0.0009) [2023-12-26 13:02:18,714][123090] Updated weights for policy 1, policy_version 1672346 (0.0008) [2023-12-26 13:02:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 859119616. Throughput: 0: 9080.7, 1: 8831.6. Samples: 859123824. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:18,785][121949] Avg episode reward: [(0, '5915.757'), (1, '5662.307')] [2023-12-26 13:02:19,516][123090] Updated weights for policy 1, policy_version 1672356 (0.0010) [2023-12-26 13:02:19,574][123091] Updated weights for policy 0, policy_version 1683569 (0.0010) [2023-12-26 13:02:19,576][123090] Updated weights for policy 1, policy_version 1672366 (0.0011) [2023-12-26 13:02:19,635][123091] Updated weights for policy 0, policy_version 1683579 (0.0006) [2023-12-26 13:02:19,643][123090] Updated weights for policy 1, policy_version 1672376 (0.0011) [2023-12-26 13:02:19,698][123091] Updated weights for policy 0, policy_version 1683589 (0.0009) [2023-12-26 13:02:19,748][123091] Updated weights for policy 0, policy_version 1683599 (0.0009) [2023-12-26 13:02:20,475][123090] Updated weights for policy 1, policy_version 1672386 (0.0010) [2023-12-26 13:02:20,527][123090] Updated weights for policy 1, policy_version 1672396 (0.0009) [2023-12-26 13:02:20,595][123090] Updated weights for policy 1, policy_version 1672406 (0.0009) [2023-12-26 13:02:20,640][123091] Updated weights for policy 0, policy_version 1683609 (0.0010) [2023-12-26 13:02:20,662][123090] Updated weights for policy 1, policy_version 1672416 (0.0009) [2023-12-26 13:02:20,709][123091] Updated weights for policy 0, policy_version 1683619 (0.0011) [2023-12-26 13:02:20,778][123091] Updated weights for policy 0, policy_version 1683629 (0.0011) [2023-12-26 13:02:21,578][123090] Updated weights for policy 1, policy_version 1672426 (0.0009) [2023-12-26 13:02:21,604][123091] Updated weights for policy 0, policy_version 1683639 (0.0011) [2023-12-26 13:02:21,644][123090] Updated weights for policy 1, policy_version 1672436 (0.0008) [2023-12-26 13:02:21,674][123091] Updated weights for policy 0, policy_version 1683649 (0.0010) [2023-12-26 13:02:21,718][123090] Updated weights for policy 1, policy_version 1672446 (0.0010) [2023-12-26 13:02:21,741][123091] Updated weights for policy 0, policy_version 1683659 (0.0009) [2023-12-26 13:02:22,561][123090] Updated weights for policy 1, policy_version 1672456 (0.0007) [2023-12-26 13:02:22,615][123091] Updated weights for policy 0, policy_version 1683669 (0.0011) [2023-12-26 13:02:22,623][123090] Updated weights for policy 1, policy_version 1672466 (0.0008) [2023-12-26 13:02:22,679][123091] Updated weights for policy 0, policy_version 1683679 (0.0011) [2023-12-26 13:02:22,687][123090] Updated weights for policy 1, policy_version 1672476 (0.0009) [2023-12-26 13:02:22,743][123091] Updated weights for policy 0, policy_version 1683689 (0.0011) [2023-12-26 13:02:23,501][123090] Updated weights for policy 1, policy_version 1672486 (0.0006) [2023-12-26 13:02:23,562][123090] Updated weights for policy 1, policy_version 1672496 (0.0006) [2023-12-26 13:02:23,578][123091] Updated weights for policy 0, policy_version 1683699 (0.0011) [2023-12-26 13:02:23,626][123091] Updated weights for policy 0, policy_version 1683709 (0.0010) [2023-12-26 13:02:23,627][123090] Updated weights for policy 1, policy_version 1672506 (0.0006) [2023-12-26 13:02:23,678][123091] Updated weights for policy 0, policy_version 1683719 (0.0010) [2023-12-26 13:02:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 859201536. Throughput: 0: 9037.0, 1: 8798.5. Samples: 859173284. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:23,785][121949] Avg episode reward: [(0, '6025.234'), (1, '5789.433')] [2023-12-26 13:02:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001683728_431038464.pth... [2023-12-26 13:02:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001672512_428163072.pth... [2023-12-26 13:02:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001671456_427892736.pth [2023-12-26 13:02:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001682672_430768128.pth [2023-12-26 13:02:24,272][123090] Updated weights for policy 1, policy_version 1672516 (0.0005) [2023-12-26 13:02:24,336][123090] Updated weights for policy 1, policy_version 1672526 (0.0008) [2023-12-26 13:02:24,402][123090] Updated weights for policy 1, policy_version 1672536 (0.0008) [2023-12-26 13:02:24,467][123091] Updated weights for policy 0, policy_version 1683729 (0.0010) [2023-12-26 13:02:24,534][123091] Updated weights for policy 0, policy_version 1683739 (0.0011) [2023-12-26 13:02:24,601][123091] Updated weights for policy 0, policy_version 1683749 (0.0009) [2023-12-26 13:02:24,666][123091] Updated weights for policy 0, policy_version 1683759 (0.0005) [2023-12-26 13:02:25,147][123090] Updated weights for policy 1, policy_version 1672546 (0.0009) [2023-12-26 13:02:25,204][123090] Updated weights for policy 1, policy_version 1672556 (0.0007) [2023-12-26 13:02:25,271][123090] Updated weights for policy 1, policy_version 1672566 (0.0009) [2023-12-26 13:02:25,274][123091] Updated weights for policy 0, policy_version 1683769 (0.0010) [2023-12-26 13:02:25,325][123091] Updated weights for policy 0, policy_version 1683779 (0.0010) [2023-12-26 13:02:25,333][123090] Updated weights for policy 1, policy_version 1672576 (0.0009) [2023-12-26 13:02:25,383][123091] Updated weights for policy 0, policy_version 1683789 (0.0010) [2023-12-26 13:02:26,052][123090] Updated weights for policy 1, policy_version 1672586 (0.0009) [2023-12-26 13:02:26,108][123090] Updated weights for policy 1, policy_version 1672596 (0.0009) [2023-12-26 13:02:26,168][123090] Updated weights for policy 1, policy_version 1672606 (0.0008) [2023-12-26 13:02:26,239][123091] Updated weights for policy 0, policy_version 1683799 (0.0010) [2023-12-26 13:02:26,303][123091] Updated weights for policy 0, policy_version 1683809 (0.0009) [2023-12-26 13:02:26,365][123091] Updated weights for policy 0, policy_version 1683819 (0.0009) [2023-12-26 13:02:26,943][123090] Updated weights for policy 1, policy_version 1672616 (0.0005) [2023-12-26 13:02:26,992][123090] Updated weights for policy 1, policy_version 1672626 (0.0005) [2023-12-26 13:02:27,049][123090] Updated weights for policy 1, policy_version 1672636 (0.0005) [2023-12-26 13:02:27,220][123091] Updated weights for policy 0, policy_version 1683829 (0.0009) [2023-12-26 13:02:27,272][123091] Updated weights for policy 0, policy_version 1683839 (0.0010) [2023-12-26 13:02:27,327][123091] Updated weights for policy 0, policy_version 1683849 (0.0010) [2023-12-26 13:02:27,870][123090] Updated weights for policy 1, policy_version 1672646 (0.0008) [2023-12-26 13:02:27,920][123090] Updated weights for policy 1, policy_version 1672656 (0.0009) [2023-12-26 13:02:27,983][123090] Updated weights for policy 1, policy_version 1672666 (0.0008) [2023-12-26 13:02:27,987][123091] Updated weights for policy 0, policy_version 1683859 (0.0009) [2023-12-26 13:02:28,047][123091] Updated weights for policy 0, policy_version 1683869 (0.0007) [2023-12-26 13:02:28,110][123091] Updated weights for policy 0, policy_version 1683879 (0.0005) [2023-12-26 13:02:28,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 859283456. Throughput: 0: 9053.6, 1: 8858.8. Samples: 859281076. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:28,785][121949] Avg episode reward: [(0, '5921.174'), (1, '5834.309')] [2023-12-26 13:02:28,834][123091] Updated weights for policy 0, policy_version 1683889 (0.0005) [2023-12-26 13:02:28,842][123090] Updated weights for policy 1, policy_version 1672676 (0.0007) [2023-12-26 13:02:28,889][123091] Updated weights for policy 0, policy_version 1683899 (0.0008) [2023-12-26 13:02:28,891][123090] Updated weights for policy 1, policy_version 1672686 (0.0007) [2023-12-26 13:02:28,938][123091] Updated weights for policy 0, policy_version 1683909 (0.0007) [2023-12-26 13:02:28,940][123090] Updated weights for policy 1, policy_version 1672696 (0.0007) [2023-12-26 13:02:28,991][123091] Updated weights for policy 0, policy_version 1683919 (0.0009) [2023-12-26 13:02:29,763][123090] Updated weights for policy 1, policy_version 1672706 (0.0007) [2023-12-26 13:02:29,825][123090] Updated weights for policy 1, policy_version 1672716 (0.0009) [2023-12-26 13:02:29,850][123091] Updated weights for policy 0, policy_version 1683929 (0.0009) [2023-12-26 13:02:29,888][123090] Updated weights for policy 1, policy_version 1672726 (0.0008) [2023-12-26 13:02:29,904][123091] Updated weights for policy 0, policy_version 1683939 (0.0009) [2023-12-26 13:02:29,954][123090] Updated weights for policy 1, policy_version 1672736 (0.0009) [2023-12-26 13:02:29,975][123091] Updated weights for policy 0, policy_version 1683949 (0.0007) [2023-12-26 13:02:30,771][123090] Updated weights for policy 1, policy_version 1672746 (0.0009) [2023-12-26 13:02:30,808][123091] Updated weights for policy 0, policy_version 1683959 (0.0010) [2023-12-26 13:02:30,815][123090] Updated weights for policy 1, policy_version 1672756 (0.0006) [2023-12-26 13:02:30,862][123091] Updated weights for policy 0, policy_version 1683969 (0.0010) [2023-12-26 13:02:30,872][123090] Updated weights for policy 1, policy_version 1672766 (0.0009) [2023-12-26 13:02:30,907][123091] Updated weights for policy 0, policy_version 1683979 (0.0006) [2023-12-26 13:02:31,717][123091] Updated weights for policy 0, policy_version 1683989 (0.0007) [2023-12-26 13:02:31,782][123090] Updated weights for policy 1, policy_version 1672776 (0.0007) [2023-12-26 13:02:31,794][123091] Updated weights for policy 0, policy_version 1683999 (0.0008) [2023-12-26 13:02:31,852][123090] Updated weights for policy 1, policy_version 1672786 (0.0008) [2023-12-26 13:02:31,855][123091] Updated weights for policy 0, policy_version 1684009 (0.0008) [2023-12-26 13:02:31,911][123090] Updated weights for policy 1, policy_version 1672796 (0.0006) [2023-12-26 13:02:32,649][123091] Updated weights for policy 0, policy_version 1684019 (0.0009) [2023-12-26 13:02:32,676][123090] Updated weights for policy 1, policy_version 1672806 (0.0005) [2023-12-26 13:02:32,710][123091] Updated weights for policy 0, policy_version 1684029 (0.0009) [2023-12-26 13:02:32,725][123090] Updated weights for policy 1, policy_version 1672816 (0.0006) [2023-12-26 13:02:32,766][123091] Updated weights for policy 0, policy_version 1684039 (0.0008) [2023-12-26 13:02:32,787][123090] Updated weights for policy 1, policy_version 1672826 (0.0005) [2023-12-26 13:02:33,498][123090] Updated weights for policy 1, policy_version 1672836 (0.0007) [2023-12-26 13:02:33,560][123090] Updated weights for policy 1, policy_version 1672846 (0.0006) [2023-12-26 13:02:33,624][123090] Updated weights for policy 1, policy_version 1672856 (0.0006) [2023-12-26 13:02:33,641][123091] Updated weights for policy 0, policy_version 1684049 (0.0008) [2023-12-26 13:02:33,702][123091] Updated weights for policy 0, policy_version 1684059 (0.0010) [2023-12-26 13:02:33,755][123091] Updated weights for policy 0, policy_version 1684069 (0.0010) [2023-12-26 13:02:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 859373568. Throughput: 0: 8950.1, 1: 8861.3. Samples: 859386360. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:33,785][121949] Avg episode reward: [(0, '5845.206'), (1, '5932.844')] [2023-12-26 13:02:33,809][123091] Updated weights for policy 0, policy_version 1684079 (0.0009) [2023-12-26 13:02:34,303][123090] Updated weights for policy 1, policy_version 1672866 (0.0007) [2023-12-26 13:02:34,358][123090] Updated weights for policy 1, policy_version 1672876 (0.0009) [2023-12-26 13:02:34,409][123090] Updated weights for policy 1, policy_version 1672886 (0.0009) [2023-12-26 13:02:34,459][123090] Updated weights for policy 1, policy_version 1672896 (0.0009) [2023-12-26 13:02:34,692][123091] Updated weights for policy 0, policy_version 1684089 (0.0009) [2023-12-26 13:02:34,749][123091] Updated weights for policy 0, policy_version 1684099 (0.0009) [2023-12-26 13:02:34,803][123091] Updated weights for policy 0, policy_version 1684109 (0.0009) [2023-12-26 13:02:35,246][123090] Updated weights for policy 1, policy_version 1672906 (0.0005) [2023-12-26 13:02:35,306][123090] Updated weights for policy 1, policy_version 1672916 (0.0011) [2023-12-26 13:02:35,364][123090] Updated weights for policy 1, policy_version 1672926 (0.0010) [2023-12-26 13:02:35,591][123091] Updated weights for policy 0, policy_version 1684119 (0.0009) [2023-12-26 13:02:35,654][123091] Updated weights for policy 0, policy_version 1684129 (0.0009) [2023-12-26 13:02:35,701][123091] Updated weights for policy 0, policy_version 1684139 (0.0008) [2023-12-26 13:02:36,148][123090] Updated weights for policy 1, policy_version 1672936 (0.0010) [2023-12-26 13:02:36,215][123090] Updated weights for policy 1, policy_version 1672946 (0.0005) [2023-12-26 13:02:36,290][123090] Updated weights for policy 1, policy_version 1672956 (0.0005) [2023-12-26 13:02:36,574][123091] Updated weights for policy 0, policy_version 1684149 (0.0009) [2023-12-26 13:02:36,629][123091] Updated weights for policy 0, policy_version 1684159 (0.0010) [2023-12-26 13:02:36,683][123091] Updated weights for policy 0, policy_version 1684169 (0.0010) [2023-12-26 13:02:36,955][123090] Updated weights for policy 1, policy_version 1672966 (0.0005) [2023-12-26 13:02:37,033][123090] Updated weights for policy 1, policy_version 1672976 (0.0005) [2023-12-26 13:02:37,098][123090] Updated weights for policy 1, policy_version 1672986 (0.0005) [2023-12-26 13:02:37,388][123091] Updated weights for policy 0, policy_version 1684179 (0.0007) [2023-12-26 13:02:37,456][123091] Updated weights for policy 0, policy_version 1684189 (0.0005) [2023-12-26 13:02:37,524][123091] Updated weights for policy 0, policy_version 1684199 (0.0005) [2023-12-26 13:02:37,859][123090] Updated weights for policy 1, policy_version 1672996 (0.0006) [2023-12-26 13:02:37,911][123090] Updated weights for policy 1, policy_version 1673006 (0.0005) [2023-12-26 13:02:37,969][123090] Updated weights for policy 1, policy_version 1673016 (0.0008) [2023-12-26 13:02:38,205][123091] Updated weights for policy 0, policy_version 1684209 (0.0005) [2023-12-26 13:02:38,277][123091] Updated weights for policy 0, policy_version 1684219 (0.0007) [2023-12-26 13:02:38,339][123091] Updated weights for policy 0, policy_version 1684229 (0.0007) [2023-12-26 13:02:38,406][123091] Updated weights for policy 0, policy_version 1684239 (0.0011) [2023-12-26 13:02:38,780][123090] Updated weights for policy 1, policy_version 1673026 (0.0009) [2023-12-26 13:02:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 859463680. Throughput: 0: 8886.9, 1: 8939.0. Samples: 859439232. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:38,785][121949] Avg episode reward: [(0, '5972.192'), (1, '5968.914')] [2023-12-26 13:02:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001684240_431169536.pth... [2023-12-26 13:02:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001683216_430907392.pth [2023-12-26 13:02:38,846][123090] Updated weights for policy 1, policy_version 1673036 (0.0010) [2023-12-26 13:02:38,917][123090] Updated weights for policy 1, policy_version 1673046 (0.0009) [2023-12-26 13:02:38,971][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001673056_428302336.pth... [2023-12-26 13:02:38,971][123090] Updated weights for policy 1, policy_version 1673056 (0.0005) [2023-12-26 13:02:38,974][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001672000_428032000.pth [2023-12-26 13:02:39,167][123091] Updated weights for policy 0, policy_version 1684249 (0.0011) [2023-12-26 13:02:39,223][123091] Updated weights for policy 0, policy_version 1684259 (0.0011) [2023-12-26 13:02:39,293][123091] Updated weights for policy 0, policy_version 1684269 (0.0011) [2023-12-26 13:02:39,856][123090] Updated weights for policy 1, policy_version 1673066 (0.0010) [2023-12-26 13:02:39,910][123090] Updated weights for policy 1, policy_version 1673076 (0.0009) [2023-12-26 13:02:39,973][123090] Updated weights for policy 1, policy_version 1673086 (0.0009) [2023-12-26 13:02:40,069][123091] Updated weights for policy 0, policy_version 1684279 (0.0011) [2023-12-26 13:02:40,121][123091] Updated weights for policy 0, policy_version 1684289 (0.0011) [2023-12-26 13:02:40,169][123091] Updated weights for policy 0, policy_version 1684299 (0.0010) [2023-12-26 13:02:40,862][123090] Updated weights for policy 1, policy_version 1673096 (0.0009) [2023-12-26 13:02:40,923][123090] Updated weights for policy 1, policy_version 1673106 (0.0009) [2023-12-26 13:02:40,945][123091] Updated weights for policy 0, policy_version 1684309 (0.0007) [2023-12-26 13:02:40,993][123090] Updated weights for policy 1, policy_version 1673116 (0.0009) [2023-12-26 13:02:41,012][123091] Updated weights for policy 0, policy_version 1684319 (0.0006) [2023-12-26 13:02:41,086][123091] Updated weights for policy 0, policy_version 1684329 (0.0008) [2023-12-26 13:02:41,896][123090] Updated weights for policy 1, policy_version 1673126 (0.0009) [2023-12-26 13:02:41,910][123091] Updated weights for policy 0, policy_version 1684339 (0.0008) [2023-12-26 13:02:41,960][123090] Updated weights for policy 1, policy_version 1673136 (0.0009) [2023-12-26 13:02:41,967][123091] Updated weights for policy 0, policy_version 1684349 (0.0011) [2023-12-26 13:02:42,024][123091] Updated weights for policy 0, policy_version 1684359 (0.0011) [2023-12-26 13:02:42,025][123090] Updated weights for policy 1, policy_version 1673146 (0.0009) [2023-12-26 13:02:42,813][123091] Updated weights for policy 0, policy_version 1684369 (0.0011) [2023-12-26 13:02:42,865][123091] Updated weights for policy 0, policy_version 1684379 (0.0011) [2023-12-26 13:02:42,902][123090] Updated weights for policy 1, policy_version 1673156 (0.0009) [2023-12-26 13:02:42,924][123091] Updated weights for policy 0, policy_version 1684389 (0.0011) [2023-12-26 13:02:42,965][123090] Updated weights for policy 1, policy_version 1673166 (0.0007) [2023-12-26 13:02:42,975][123091] Updated weights for policy 0, policy_version 1684399 (0.0011) [2023-12-26 13:02:43,034][123090] Updated weights for policy 1, policy_version 1673176 (0.0010) [2023-12-26 13:02:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 859545600. Throughput: 0: 8911.4, 1: 8834.9. Samples: 859545232. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:43,785][121949] Avg episode reward: [(0, '5933.828'), (1, '5837.498')] [2023-12-26 13:02:43,785][123090] Updated weights for policy 1, policy_version 1673186 (0.0010) [2023-12-26 13:02:43,817][123091] Updated weights for policy 0, policy_version 1684409 (0.0010) [2023-12-26 13:02:43,850][123090] Updated weights for policy 1, policy_version 1673196 (0.0011) [2023-12-26 13:02:43,869][123091] Updated weights for policy 0, policy_version 1684419 (0.0011) [2023-12-26 13:02:43,907][123090] Updated weights for policy 1, policy_version 1673206 (0.0011) [2023-12-26 13:02:43,938][123091] Updated weights for policy 0, policy_version 1684429 (0.0011) [2023-12-26 13:02:43,972][123090] Updated weights for policy 1, policy_version 1673216 (0.0011) [2023-12-26 13:02:44,687][123091] Updated weights for policy 0, policy_version 1684439 (0.0007) [2023-12-26 13:02:44,741][123091] Updated weights for policy 0, policy_version 1684449 (0.0005) [2023-12-26 13:02:44,806][123091] Updated weights for policy 0, policy_version 1684459 (0.0006) [2023-12-26 13:02:44,822][123090] Updated weights for policy 1, policy_version 1673226 (0.0008) [2023-12-26 13:02:44,884][123090] Updated weights for policy 1, policy_version 1673236 (0.0010) [2023-12-26 13:02:44,942][123090] Updated weights for policy 1, policy_version 1673246 (0.0011) [2023-12-26 13:02:45,580][123091] Updated weights for policy 0, policy_version 1684469 (0.0006) [2023-12-26 13:02:45,640][123091] Updated weights for policy 0, policy_version 1684479 (0.0006) [2023-12-26 13:02:45,641][123090] Updated weights for policy 1, policy_version 1673256 (0.0006) [2023-12-26 13:02:45,687][123091] Updated weights for policy 0, policy_version 1684489 (0.0009) [2023-12-26 13:02:45,704][123090] Updated weights for policy 1, policy_version 1673266 (0.0008) [2023-12-26 13:02:45,771][123090] Updated weights for policy 1, policy_version 1673276 (0.0009) [2023-12-26 13:02:46,482][123091] Updated weights for policy 0, policy_version 1684499 (0.0010) [2023-12-26 13:02:46,547][123091] Updated weights for policy 0, policy_version 1684509 (0.0006) [2023-12-26 13:02:46,594][123090] Updated weights for policy 1, policy_version 1673286 (0.0009) [2023-12-26 13:02:46,613][123091] Updated weights for policy 0, policy_version 1684519 (0.0005) [2023-12-26 13:02:46,659][123090] Updated weights for policy 1, policy_version 1673296 (0.0006) [2023-12-26 13:02:46,734][123090] Updated weights for policy 1, policy_version 1673306 (0.0005) [2023-12-26 13:02:47,360][123091] Updated weights for policy 0, policy_version 1684529 (0.0006) [2023-12-26 13:02:47,400][123090] Updated weights for policy 1, policy_version 1673316 (0.0005) [2023-12-26 13:02:47,414][123091] Updated weights for policy 0, policy_version 1684539 (0.0010) [2023-12-26 13:02:47,460][123090] Updated weights for policy 1, policy_version 1673326 (0.0005) [2023-12-26 13:02:47,461][123091] Updated weights for policy 0, policy_version 1684549 (0.0010) [2023-12-26 13:02:47,512][123091] Updated weights for policy 0, policy_version 1684559 (0.0010) [2023-12-26 13:02:47,522][123090] Updated weights for policy 1, policy_version 1673336 (0.0005) [2023-12-26 13:02:48,234][123090] Updated weights for policy 1, policy_version 1673346 (0.0005) [2023-12-26 13:02:48,238][123091] Updated weights for policy 0, policy_version 1684569 (0.0007) [2023-12-26 13:02:48,293][123090] Updated weights for policy 1, policy_version 1673356 (0.0005) [2023-12-26 13:02:48,299][123091] Updated weights for policy 0, policy_version 1684579 (0.0006) [2023-12-26 13:02:48,365][123090] Updated weights for policy 1, policy_version 1673366 (0.0007) [2023-12-26 13:02:48,365][123091] Updated weights for policy 0, policy_version 1684589 (0.0007) [2023-12-26 13:02:48,432][123090] Updated weights for policy 1, policy_version 1673376 (0.0006) [2023-12-26 13:02:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 859643904. Throughput: 0: 8936.8, 1: 8877.7. Samples: 859655496. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:48,785][121949] Avg episode reward: [(0, '5601.743'), (1, '5803.152')] [2023-12-26 13:02:49,074][123091] Updated weights for policy 0, policy_version 1684599 (0.0009) [2023-12-26 13:02:49,130][123091] Updated weights for policy 0, policy_version 1684609 (0.0010) [2023-12-26 13:02:49,158][123090] Updated weights for policy 1, policy_version 1673386 (0.0007) [2023-12-26 13:02:49,181][123091] Updated weights for policy 0, policy_version 1684619 (0.0010) [2023-12-26 13:02:49,206][123090] Updated weights for policy 1, policy_version 1673396 (0.0005) [2023-12-26 13:02:49,279][123090] Updated weights for policy 1, policy_version 1673406 (0.0007) [2023-12-26 13:02:50,034][123091] Updated weights for policy 0, policy_version 1684629 (0.0011) [2023-12-26 13:02:50,075][123090] Updated weights for policy 1, policy_version 1673416 (0.0008) [2023-12-26 13:02:50,094][123091] Updated weights for policy 0, policy_version 1684639 (0.0011) [2023-12-26 13:02:50,139][123090] Updated weights for policy 1, policy_version 1673426 (0.0006) [2023-12-26 13:02:50,153][123091] Updated weights for policy 0, policy_version 1684649 (0.0010) [2023-12-26 13:02:50,195][123090] Updated weights for policy 1, policy_version 1673436 (0.0008) [2023-12-26 13:02:50,986][123091] Updated weights for policy 0, policy_version 1684659 (0.0010) [2023-12-26 13:02:51,048][123091] Updated weights for policy 0, policy_version 1684669 (0.0010) [2023-12-26 13:02:51,056][123090] Updated weights for policy 1, policy_version 1673446 (0.0009) [2023-12-26 13:02:51,108][123091] Updated weights for policy 0, policy_version 1684679 (0.0008) [2023-12-26 13:02:51,128][123090] Updated weights for policy 1, policy_version 1673456 (0.0007) [2023-12-26 13:02:51,197][123090] Updated weights for policy 1, policy_version 1673466 (0.0008) [2023-12-26 13:02:51,926][123091] Updated weights for policy 0, policy_version 1684689 (0.0007) [2023-12-26 13:02:51,988][123091] Updated weights for policy 0, policy_version 1684699 (0.0010) [2023-12-26 13:02:52,017][123090] Updated weights for policy 1, policy_version 1673476 (0.0007) [2023-12-26 13:02:52,052][123091] Updated weights for policy 0, policy_version 1684709 (0.0008) [2023-12-26 13:02:52,064][123090] Updated weights for policy 1, policy_version 1673486 (0.0009) [2023-12-26 13:02:52,115][123091] Updated weights for policy 0, policy_version 1684719 (0.0009) [2023-12-26 13:02:52,124][123090] Updated weights for policy 1, policy_version 1673496 (0.0007) [2023-12-26 13:02:52,923][123090] Updated weights for policy 1, policy_version 1673506 (0.0006) [2023-12-26 13:02:52,949][123091] Updated weights for policy 0, policy_version 1684729 (0.0008) [2023-12-26 13:02:52,982][123090] Updated weights for policy 1, policy_version 1673516 (0.0010) [2023-12-26 13:02:53,015][123091] Updated weights for policy 0, policy_version 1684739 (0.0006) [2023-12-26 13:02:53,042][123090] Updated weights for policy 1, policy_version 1673526 (0.0010) [2023-12-26 13:02:53,074][123091] Updated weights for policy 0, policy_version 1684749 (0.0006) [2023-12-26 13:02:53,111][123090] Updated weights for policy 1, policy_version 1673536 (0.0011) [2023-12-26 13:02:53,740][123091] Updated weights for policy 0, policy_version 1684759 (0.0006) [2023-12-26 13:02:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 859725824. Throughput: 0: 8861.8, 1: 8852.7. Samples: 859707064. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:53,785][121949] Avg episode reward: [(0, '5552.819'), (1, '5889.833')] [2023-12-26 13:02:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001673536_428425216.pth... [2023-12-26 13:02:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001672512_428163072.pth [2023-12-26 13:02:53,795][123091] Updated weights for policy 0, policy_version 1684769 (0.0005) [2023-12-26 13:02:53,863][123091] Updated weights for policy 0, policy_version 1684779 (0.0010) [2023-12-26 13:02:53,893][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001684784_431308800.pth... [2023-12-26 13:02:53,896][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001683728_431038464.pth [2023-12-26 13:02:53,929][123090] Updated weights for policy 1, policy_version 1673546 (0.0005) [2023-12-26 13:02:53,999][123090] Updated weights for policy 1, policy_version 1673556 (0.0005) [2023-12-26 13:02:54,052][123090] Updated weights for policy 1, policy_version 1673566 (0.0005) [2023-12-26 13:02:54,552][123091] Updated weights for policy 0, policy_version 1684789 (0.0009) [2023-12-26 13:02:54,607][123091] Updated weights for policy 0, policy_version 1684799 (0.0010) [2023-12-26 13:02:54,662][123091] Updated weights for policy 0, policy_version 1684809 (0.0010) [2023-12-26 13:02:54,800][123090] Updated weights for policy 1, policy_version 1673576 (0.0009) [2023-12-26 13:02:54,863][123090] Updated weights for policy 1, policy_version 1673586 (0.0010) [2023-12-26 13:02:54,930][123090] Updated weights for policy 1, policy_version 1673596 (0.0008) [2023-12-26 13:02:55,391][123091] Updated weights for policy 0, policy_version 1684819 (0.0009) [2023-12-26 13:02:55,456][123091] Updated weights for policy 0, policy_version 1684829 (0.0008) [2023-12-26 13:02:55,525][123091] Updated weights for policy 0, policy_version 1684839 (0.0009) [2023-12-26 13:02:55,603][123090] Updated weights for policy 1, policy_version 1673606 (0.0006) [2023-12-26 13:02:55,673][123090] Updated weights for policy 1, policy_version 1673616 (0.0005) [2023-12-26 13:02:55,746][123090] Updated weights for policy 1, policy_version 1673626 (0.0005) [2023-12-26 13:02:56,219][123091] Updated weights for policy 0, policy_version 1684849 (0.0009) [2023-12-26 13:02:56,283][123091] Updated weights for policy 0, policy_version 1684859 (0.0009) [2023-12-26 13:02:56,345][123091] Updated weights for policy 0, policy_version 1684869 (0.0009) [2023-12-26 13:02:56,413][123091] Updated weights for policy 0, policy_version 1684879 (0.0010) [2023-12-26 13:02:56,417][123090] Updated weights for policy 1, policy_version 1673636 (0.0005) [2023-12-26 13:02:56,476][123090] Updated weights for policy 1, policy_version 1673646 (0.0005) [2023-12-26 13:02:56,531][123090] Updated weights for policy 1, policy_version 1673656 (0.0005) [2023-12-26 13:02:57,109][123091] Updated weights for policy 0, policy_version 1684889 (0.0010) [2023-12-26 13:02:57,156][123091] Updated weights for policy 0, policy_version 1684899 (0.0010) [2023-12-26 13:02:57,203][123090] Updated weights for policy 1, policy_version 1673666 (0.0005) [2023-12-26 13:02:57,210][123091] Updated weights for policy 0, policy_version 1684909 (0.0010) [2023-12-26 13:02:57,251][123090] Updated weights for policy 1, policy_version 1673676 (0.0005) [2023-12-26 13:02:57,298][123090] Updated weights for policy 1, policy_version 1673686 (0.0005) [2023-12-26 13:02:57,358][123090] Updated weights for policy 1, policy_version 1673696 (0.0007) [2023-12-26 13:02:57,905][123091] Updated weights for policy 0, policy_version 1684919 (0.0009) [2023-12-26 13:02:57,960][123091] Updated weights for policy 0, policy_version 1684929 (0.0010) [2023-12-26 13:02:58,018][123091] Updated weights for policy 0, policy_version 1684939 (0.0006) [2023-12-26 13:02:58,146][123090] Updated weights for policy 1, policy_version 1673706 (0.0007) [2023-12-26 13:02:58,217][123090] Updated weights for policy 1, policy_version 1673716 (0.0007) [2023-12-26 13:02:58,285][123090] Updated weights for policy 1, policy_version 1673726 (0.0008) [2023-12-26 13:02:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.4, 300 sec: 17661.4). Total num frames: 859824128. Throughput: 0: 8945.6, 1: 8962.2. Samples: 859821076. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:02:58,785][121949] Avg episode reward: [(0, '5704.963'), (1, '5964.711')] [2023-12-26 13:02:58,834][123091] Updated weights for policy 0, policy_version 1684949 (0.0009) [2023-12-26 13:02:58,904][123091] Updated weights for policy 0, policy_version 1684959 (0.0011) [2023-12-26 13:02:58,974][123091] Updated weights for policy 0, policy_version 1684969 (0.0011) [2023-12-26 13:02:59,069][123090] Updated weights for policy 1, policy_version 1673736 (0.0009) [2023-12-26 13:02:59,124][123090] Updated weights for policy 1, policy_version 1673746 (0.0008) [2023-12-26 13:02:59,187][123090] Updated weights for policy 1, policy_version 1673756 (0.0005) [2023-12-26 13:02:59,719][123091] Updated weights for policy 0, policy_version 1684979 (0.0010) [2023-12-26 13:02:59,779][123091] Updated weights for policy 0, policy_version 1684989 (0.0007) [2023-12-26 13:02:59,850][123091] Updated weights for policy 0, policy_version 1684999 (0.0008) [2023-12-26 13:03:00,015][123090] Updated weights for policy 1, policy_version 1673766 (0.0009) [2023-12-26 13:03:00,077][123090] Updated weights for policy 1, policy_version 1673776 (0.0009) [2023-12-26 13:03:00,133][123090] Updated weights for policy 1, policy_version 1673786 (0.0007) [2023-12-26 13:03:00,541][123091] Updated weights for policy 0, policy_version 1685009 (0.0008) [2023-12-26 13:03:00,619][123091] Updated weights for policy 0, policy_version 1685019 (0.0005) [2023-12-26 13:03:00,687][123091] Updated weights for policy 0, policy_version 1685029 (0.0005) [2023-12-26 13:03:00,755][123091] Updated weights for policy 0, policy_version 1685039 (0.0007) [2023-12-26 13:03:00,932][123090] Updated weights for policy 1, policy_version 1673796 (0.0008) [2023-12-26 13:03:00,995][123090] Updated weights for policy 1, policy_version 1673806 (0.0005) [2023-12-26 13:03:01,066][123090] Updated weights for policy 1, policy_version 1673816 (0.0007) [2023-12-26 13:03:01,489][123091] Updated weights for policy 0, policy_version 1685049 (0.0006) [2023-12-26 13:03:01,546][123091] Updated weights for policy 0, policy_version 1685059 (0.0006) [2023-12-26 13:03:01,601][123091] Updated weights for policy 0, policy_version 1685069 (0.0010) [2023-12-26 13:03:01,862][123090] Updated weights for policy 1, policy_version 1673826 (0.0009) [2023-12-26 13:03:01,911][123090] Updated weights for policy 1, policy_version 1673836 (0.0010) [2023-12-26 13:03:01,963][123090] Updated weights for policy 1, policy_version 1673846 (0.0010) [2023-12-26 13:03:02,014][123090] Updated weights for policy 1, policy_version 1673856 (0.0010) [2023-12-26 13:03:02,247][123091] Updated weights for policy 0, policy_version 1685079 (0.0009) [2023-12-26 13:03:02,295][123091] Updated weights for policy 0, policy_version 1685089 (0.0009) [2023-12-26 13:03:02,343][123091] Updated weights for policy 0, policy_version 1685099 (0.0008) [2023-12-26 13:03:02,797][123090] Updated weights for policy 1, policy_version 1673866 (0.0005) [2023-12-26 13:03:02,859][123090] Updated weights for policy 1, policy_version 1673876 (0.0008) [2023-12-26 13:03:02,907][123090] Updated weights for policy 1, policy_version 1673886 (0.0006) [2023-12-26 13:03:03,151][123091] Updated weights for policy 0, policy_version 1685109 (0.0008) [2023-12-26 13:03:03,202][123091] Updated weights for policy 0, policy_version 1685119 (0.0008) [2023-12-26 13:03:03,249][123091] Updated weights for policy 0, policy_version 1685129 (0.0009) [2023-12-26 13:03:03,666][123090] Updated weights for policy 1, policy_version 1673896 (0.0005) [2023-12-26 13:03:03,743][123090] Updated weights for policy 1, policy_version 1673906 (0.0005) [2023-12-26 13:03:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 859914240. Throughput: 0: 9019.3, 1: 8930.1. Samples: 859931548. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:03,785][121949] Avg episode reward: [(0, '5926.315'), (1, '6014.759')] [2023-12-26 13:03:03,814][123090] Updated weights for policy 1, policy_version 1673916 (0.0005) [2023-12-26 13:03:04,061][123091] Updated weights for policy 0, policy_version 1685139 (0.0009) [2023-12-26 13:03:04,126][123091] Updated weights for policy 0, policy_version 1685149 (0.0006) [2023-12-26 13:03:04,202][123091] Updated weights for policy 0, policy_version 1685159 (0.0006) [2023-12-26 13:03:04,412][123090] Updated weights for policy 1, policy_version 1673926 (0.0006) [2023-12-26 13:03:04,494][123090] Updated weights for policy 1, policy_version 1673936 (0.0006) [2023-12-26 13:03:04,572][123090] Updated weights for policy 1, policy_version 1673946 (0.0008) [2023-12-26 13:03:04,829][123091] Updated weights for policy 0, policy_version 1685169 (0.0010) [2023-12-26 13:03:04,886][123091] Updated weights for policy 0, policy_version 1685180 (0.0010) [2023-12-26 13:03:04,946][123091] Updated weights for policy 0, policy_version 1685190 (0.0010) [2023-12-26 13:03:05,007][123091] Updated weights for policy 0, policy_version 1685200 (0.0009) [2023-12-26 13:03:05,307][123090] Updated weights for policy 1, policy_version 1673956 (0.0007) [2023-12-26 13:03:05,361][123090] Updated weights for policy 1, policy_version 1673966 (0.0009) [2023-12-26 13:03:05,419][123090] Updated weights for policy 1, policy_version 1673976 (0.0009) [2023-12-26 13:03:05,836][123091] Updated weights for policy 0, policy_version 1685210 (0.0009) [2023-12-26 13:03:05,891][123091] Updated weights for policy 0, policy_version 1685220 (0.0009) [2023-12-26 13:03:05,949][123091] Updated weights for policy 0, policy_version 1685230 (0.0009) [2023-12-26 13:03:06,210][123090] Updated weights for policy 1, policy_version 1673986 (0.0006) [2023-12-26 13:03:06,266][123090] Updated weights for policy 1, policy_version 1673996 (0.0010) [2023-12-26 13:03:06,334][123090] Updated weights for policy 1, policy_version 1674006 (0.0011) [2023-12-26 13:03:06,394][123090] Updated weights for policy 1, policy_version 1674016 (0.0010) [2023-12-26 13:03:06,806][123091] Updated weights for policy 0, policy_version 1685240 (0.0009) [2023-12-26 13:03:06,874][123091] Updated weights for policy 0, policy_version 1685250 (0.0010) [2023-12-26 13:03:06,935][123091] Updated weights for policy 0, policy_version 1685260 (0.0009) [2023-12-26 13:03:07,225][123090] Updated weights for policy 1, policy_version 1674026 (0.0011) [2023-12-26 13:03:07,292][123090] Updated weights for policy 1, policy_version 1674036 (0.0011) [2023-12-26 13:03:07,363][123090] Updated weights for policy 1, policy_version 1674046 (0.0011) [2023-12-26 13:03:07,632][123091] Updated weights for policy 0, policy_version 1685270 (0.0007) [2023-12-26 13:03:07,695][123091] Updated weights for policy 0, policy_version 1685280 (0.0006) [2023-12-26 13:03:07,758][123091] Updated weights for policy 0, policy_version 1685290 (0.0011) [2023-12-26 13:03:08,183][123090] Updated weights for policy 1, policy_version 1674056 (0.0009) [2023-12-26 13:03:08,245][123090] Updated weights for policy 1, policy_version 1674066 (0.0009) [2023-12-26 13:03:08,320][123090] Updated weights for policy 1, policy_version 1674076 (0.0010) [2023-12-26 13:03:08,471][123091] Updated weights for policy 0, policy_version 1685300 (0.0008) [2023-12-26 13:03:08,524][123091] Updated weights for policy 0, policy_version 1685310 (0.0005) [2023-12-26 13:03:08,573][123091] Updated weights for policy 0, policy_version 1685320 (0.0005) [2023-12-26 13:03:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 860012544. Throughput: 0: 9073.8, 1: 8979.4. Samples: 859985676. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:08,785][121949] Avg episode reward: [(0, '6046.839'), (1, '6102.080')] [2023-12-26 13:03:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001685328_431448064.pth... [2023-12-26 13:03:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001674080_428564480.pth... [2023-12-26 13:03:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001684240_431169536.pth [2023-12-26 13:03:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001673056_428302336.pth [2023-12-26 13:03:09,255][123090] Updated weights for policy 1, policy_version 1674086 (0.0009) [2023-12-26 13:03:09,257][123091] Updated weights for policy 0, policy_version 1685330 (0.0006) [2023-12-26 13:03:09,313][123090] Updated weights for policy 1, policy_version 1674096 (0.0007) [2023-12-26 13:03:09,320][123091] Updated weights for policy 0, policy_version 1685340 (0.0009) [2023-12-26 13:03:09,387][123091] Updated weights for policy 0, policy_version 1685350 (0.0009) [2023-12-26 13:03:09,394][123090] Updated weights for policy 1, policy_version 1674106 (0.0009) [2023-12-26 13:03:09,453][123091] Updated weights for policy 0, policy_version 1685360 (0.0008) [2023-12-26 13:03:10,255][123091] Updated weights for policy 0, policy_version 1685370 (0.0009) [2023-12-26 13:03:10,280][123090] Updated weights for policy 1, policy_version 1674116 (0.0009) [2023-12-26 13:03:10,324][123091] Updated weights for policy 0, policy_version 1685380 (0.0008) [2023-12-26 13:03:10,332][123090] Updated weights for policy 1, policy_version 1674126 (0.0009) [2023-12-26 13:03:10,391][123091] Updated weights for policy 0, policy_version 1685390 (0.0007) [2023-12-26 13:03:10,395][123090] Updated weights for policy 1, policy_version 1674136 (0.0008) [2023-12-26 13:03:11,154][123091] Updated weights for policy 0, policy_version 1685400 (0.0009) [2023-12-26 13:03:11,217][123091] Updated weights for policy 0, policy_version 1685410 (0.0009) [2023-12-26 13:03:11,279][123091] Updated weights for policy 0, policy_version 1685420 (0.0008) [2023-12-26 13:03:11,289][123090] Updated weights for policy 1, policy_version 1674146 (0.0010) [2023-12-26 13:03:11,354][123090] Updated weights for policy 1, policy_version 1674156 (0.0011) [2023-12-26 13:03:11,417][123090] Updated weights for policy 1, policy_version 1674166 (0.0010) [2023-12-26 13:03:11,471][123090] Updated weights for policy 1, policy_version 1674176 (0.0009) [2023-12-26 13:03:12,123][123091] Updated weights for policy 0, policy_version 1685430 (0.0009) [2023-12-26 13:03:12,184][123091] Updated weights for policy 0, policy_version 1685440 (0.0009) [2023-12-26 13:03:12,254][123091] Updated weights for policy 0, policy_version 1685450 (0.0008) [2023-12-26 13:03:12,368][123090] Updated weights for policy 1, policy_version 1674186 (0.0007) [2023-12-26 13:03:12,448][123090] Updated weights for policy 1, policy_version 1674196 (0.0011) [2023-12-26 13:03:12,523][123090] Updated weights for policy 1, policy_version 1674206 (0.0010) [2023-12-26 13:03:13,014][123091] Updated weights for policy 0, policy_version 1685460 (0.0008) [2023-12-26 13:03:13,062][123091] Updated weights for policy 0, policy_version 1685470 (0.0005) [2023-12-26 13:03:13,112][123091] Updated weights for policy 0, policy_version 1685480 (0.0006) [2023-12-26 13:03:13,203][123090] Updated weights for policy 1, policy_version 1674216 (0.0008) [2023-12-26 13:03:13,261][123090] Updated weights for policy 1, policy_version 1674226 (0.0005) [2023-12-26 13:03:13,325][123090] Updated weights for policy 1, policy_version 1674236 (0.0005) [2023-12-26 13:03:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 860094464. Throughput: 0: 9110.7, 1: 8845.7. Samples: 860089112. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:13,784][121949] Avg episode reward: [(0, '6053.156'), (1, '6127.789')] [2023-12-26 13:03:13,802][123091] Updated weights for policy 0, policy_version 1685490 (0.0006) [2023-12-26 13:03:13,864][123091] Updated weights for policy 0, policy_version 1685500 (0.0010) [2023-12-26 13:03:13,922][123091] Updated weights for policy 0, policy_version 1685510 (0.0008) [2023-12-26 13:03:13,985][123091] Updated weights for policy 0, policy_version 1685520 (0.0008) [2023-12-26 13:03:14,004][123090] Updated weights for policy 1, policy_version 1674246 (0.0008) [2023-12-26 13:03:14,070][123090] Updated weights for policy 1, policy_version 1674256 (0.0011) [2023-12-26 13:03:14,123][123090] Updated weights for policy 1, policy_version 1674266 (0.0011) [2023-12-26 13:03:14,777][123091] Updated weights for policy 0, policy_version 1685530 (0.0007) [2023-12-26 13:03:14,850][123091] Updated weights for policy 0, policy_version 1685540 (0.0007) [2023-12-26 13:03:14,920][123091] Updated weights for policy 0, policy_version 1685550 (0.0010) [2023-12-26 13:03:14,951][123090] Updated weights for policy 1, policy_version 1674276 (0.0008) [2023-12-26 13:03:15,007][123090] Updated weights for policy 1, policy_version 1674286 (0.0007) [2023-12-26 13:03:15,071][123090] Updated weights for policy 1, policy_version 1674296 (0.0006) [2023-12-26 13:03:15,646][123091] Updated weights for policy 0, policy_version 1685560 (0.0011) [2023-12-26 13:03:15,700][123091] Updated weights for policy 0, policy_version 1685571 (0.0009) [2023-12-26 13:03:15,708][123090] Updated weights for policy 1, policy_version 1674306 (0.0006) [2023-12-26 13:03:15,747][123091] Updated weights for policy 0, policy_version 1685581 (0.0008) [2023-12-26 13:03:15,766][123090] Updated weights for policy 1, policy_version 1674316 (0.0007) [2023-12-26 13:03:15,827][123090] Updated weights for policy 1, policy_version 1674326 (0.0010) [2023-12-26 13:03:15,888][123090] Updated weights for policy 1, policy_version 1674336 (0.0009) [2023-12-26 13:03:16,602][123091] Updated weights for policy 0, policy_version 1685591 (0.0009) [2023-12-26 13:03:16,665][123091] Updated weights for policy 0, policy_version 1685601 (0.0006) [2023-12-26 13:03:16,707][123090] Updated weights for policy 1, policy_version 1674346 (0.0009) [2023-12-26 13:03:16,715][123091] Updated weights for policy 0, policy_version 1685611 (0.0005) [2023-12-26 13:03:16,766][123090] Updated weights for policy 1, policy_version 1674356 (0.0009) [2023-12-26 13:03:16,823][123090] Updated weights for policy 1, policy_version 1674366 (0.0009) [2023-12-26 13:03:17,473][123091] Updated weights for policy 0, policy_version 1685621 (0.0006) [2023-12-26 13:03:17,520][123091] Updated weights for policy 0, policy_version 1685631 (0.0005) [2023-12-26 13:03:17,575][123091] Updated weights for policy 0, policy_version 1685641 (0.0005) [2023-12-26 13:03:17,705][123090] Updated weights for policy 1, policy_version 1674376 (0.0010) [2023-12-26 13:03:17,764][123090] Updated weights for policy 1, policy_version 1674386 (0.0010) [2023-12-26 13:03:17,819][123090] Updated weights for policy 1, policy_version 1674396 (0.0010) [2023-12-26 13:03:18,273][123091] Updated weights for policy 0, policy_version 1685651 (0.0005) [2023-12-26 13:03:18,335][123091] Updated weights for policy 0, policy_version 1685661 (0.0008) [2023-12-26 13:03:18,400][123091] Updated weights for policy 0, policy_version 1685671 (0.0011) [2023-12-26 13:03:18,734][123090] Updated weights for policy 1, policy_version 1674406 (0.0009) [2023-12-26 13:03:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 860184576. Throughput: 0: 9186.8, 1: 8882.6. Samples: 860199484. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:18,785][121949] Avg episode reward: [(0, '6036.226'), (1, '6078.135')] [2023-12-26 13:03:18,802][123090] Updated weights for policy 1, policy_version 1674416 (0.0009) [2023-12-26 13:03:18,859][123090] Updated weights for policy 1, policy_version 1674426 (0.0009) [2023-12-26 13:03:19,212][123091] Updated weights for policy 0, policy_version 1685681 (0.0011) [2023-12-26 13:03:19,282][123091] Updated weights for policy 0, policy_version 1685691 (0.0011) [2023-12-26 13:03:19,350][123091] Updated weights for policy 0, policy_version 1685701 (0.0011) [2023-12-26 13:03:19,416][123091] Updated weights for policy 0, policy_version 1685711 (0.0011) [2023-12-26 13:03:19,696][123090] Updated weights for policy 1, policy_version 1674436 (0.0009) [2023-12-26 13:03:19,761][123090] Updated weights for policy 1, policy_version 1674446 (0.0009) [2023-12-26 13:03:19,827][123090] Updated weights for policy 1, policy_version 1674456 (0.0009) [2023-12-26 13:03:20,212][123091] Updated weights for policy 0, policy_version 1685721 (0.0008) [2023-12-26 13:03:20,268][123091] Updated weights for policy 0, policy_version 1685731 (0.0008) [2023-12-26 13:03:20,326][123091] Updated weights for policy 0, policy_version 1685741 (0.0008) [2023-12-26 13:03:20,709][123090] Updated weights for policy 1, policy_version 1674466 (0.0010) [2023-12-26 13:03:20,769][123090] Updated weights for policy 1, policy_version 1674476 (0.0010) [2023-12-26 13:03:20,833][123090] Updated weights for policy 1, policy_version 1674486 (0.0009) [2023-12-26 13:03:20,903][123090] Updated weights for policy 1, policy_version 1674496 (0.0009) [2023-12-26 13:03:21,061][123091] Updated weights for policy 0, policy_version 1685751 (0.0007) [2023-12-26 13:03:21,128][123091] Updated weights for policy 0, policy_version 1685761 (0.0009) [2023-12-26 13:03:21,199][123091] Updated weights for policy 0, policy_version 1685771 (0.0010) [2023-12-26 13:03:21,758][123090] Updated weights for policy 1, policy_version 1674506 (0.0009) [2023-12-26 13:03:21,825][123090] Updated weights for policy 1, policy_version 1674516 (0.0008) [2023-12-26 13:03:21,892][123090] Updated weights for policy 1, policy_version 1674526 (0.0008) [2023-12-26 13:03:22,030][123091] Updated weights for policy 0, policy_version 1685781 (0.0010) [2023-12-26 13:03:22,093][123091] Updated weights for policy 0, policy_version 1685791 (0.0009) [2023-12-26 13:03:22,148][123091] Updated weights for policy 0, policy_version 1685801 (0.0010) [2023-12-26 13:03:22,700][123090] Updated weights for policy 1, policy_version 1674536 (0.0010) [2023-12-26 13:03:22,758][123090] Updated weights for policy 1, policy_version 1674546 (0.0009) [2023-12-26 13:03:22,832][123090] Updated weights for policy 1, policy_version 1674557 (0.0008) [2023-12-26 13:03:23,067][123091] Updated weights for policy 0, policy_version 1685811 (0.0010) [2023-12-26 13:03:23,128][123091] Updated weights for policy 0, policy_version 1685821 (0.0009) [2023-12-26 13:03:23,190][123091] Updated weights for policy 0, policy_version 1685831 (0.0010) [2023-12-26 13:03:23,667][123090] Updated weights for policy 1, policy_version 1674567 (0.0009) [2023-12-26 13:03:23,718][123090] Updated weights for policy 1, policy_version 1674577 (0.0009) [2023-12-26 13:03:23,772][123090] Updated weights for policy 1, policy_version 1674587 (0.0009) [2023-12-26 13:03:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 860266496. Throughput: 0: 9207.5, 1: 8804.8. Samples: 860249784. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:23,785][121949] Avg episode reward: [(0, '6076.013'), (1, '5926.953')] [2023-12-26 13:03:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001685840_431579136.pth... [2023-12-26 13:03:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001684784_431308800.pth [2023-12-26 13:03:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001674592_428695552.pth... [2023-12-26 13:03:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001673536_428425216.pth [2023-12-26 13:03:23,990][123091] Updated weights for policy 0, policy_version 1685842 (0.0010) [2023-12-26 13:03:24,053][123091] Updated weights for policy 0, policy_version 1685852 (0.0008) [2023-12-26 13:03:24,123][123091] Updated weights for policy 0, policy_version 1685862 (0.0010) [2023-12-26 13:03:24,194][123091] Updated weights for policy 0, policy_version 1685872 (0.0010) [2023-12-26 13:03:24,410][123090] Updated weights for policy 1, policy_version 1674597 (0.0007) [2023-12-26 13:03:24,477][123090] Updated weights for policy 1, policy_version 1674607 (0.0006) [2023-12-26 13:03:24,553][123090] Updated weights for policy 1, policy_version 1674617 (0.0010) [2023-12-26 13:03:25,047][123091] Updated weights for policy 0, policy_version 1685882 (0.0011) [2023-12-26 13:03:25,102][123091] Updated weights for policy 0, policy_version 1685892 (0.0010) [2023-12-26 13:03:25,165][123091] Updated weights for policy 0, policy_version 1685902 (0.0010) [2023-12-26 13:03:25,238][123090] Updated weights for policy 1, policy_version 1674627 (0.0009) [2023-12-26 13:03:25,300][123090] Updated weights for policy 1, policy_version 1674637 (0.0005) [2023-12-26 13:03:25,349][123090] Updated weights for policy 1, policy_version 1674647 (0.0005) [2023-12-26 13:03:25,858][123091] Updated weights for policy 0, policy_version 1685912 (0.0006) [2023-12-26 13:03:25,916][123091] Updated weights for policy 0, policy_version 1685922 (0.0005) [2023-12-26 13:03:25,964][123091] Updated weights for policy 0, policy_version 1685932 (0.0005) [2023-12-26 13:03:26,019][123090] Updated weights for policy 1, policy_version 1674657 (0.0005) [2023-12-26 13:03:26,074][123090] Updated weights for policy 1, policy_version 1674667 (0.0006) [2023-12-26 13:03:26,128][123090] Updated weights for policy 1, policy_version 1674677 (0.0005) [2023-12-26 13:03:26,186][123090] Updated weights for policy 1, policy_version 1674687 (0.0005) [2023-12-26 13:03:26,627][123091] Updated weights for policy 0, policy_version 1685942 (0.0006) [2023-12-26 13:03:26,690][123091] Updated weights for policy 0, policy_version 1685952 (0.0005) [2023-12-26 13:03:26,751][123091] Updated weights for policy 0, policy_version 1685962 (0.0006) [2023-12-26 13:03:26,845][123090] Updated weights for policy 1, policy_version 1674697 (0.0005) [2023-12-26 13:03:26,899][123090] Updated weights for policy 1, policy_version 1674707 (0.0008) [2023-12-26 13:03:26,946][123090] Updated weights for policy 1, policy_version 1674717 (0.0010) [2023-12-26 13:03:27,426][123091] Updated weights for policy 0, policy_version 1685972 (0.0005) [2023-12-26 13:03:27,479][123091] Updated weights for policy 0, policy_version 1685982 (0.0005) [2023-12-26 13:03:27,540][123091] Updated weights for policy 0, policy_version 1685992 (0.0007) [2023-12-26 13:03:27,728][123090] Updated weights for policy 1, policy_version 1674727 (0.0007) [2023-12-26 13:03:27,776][123090] Updated weights for policy 1, policy_version 1674737 (0.0005) [2023-12-26 13:03:27,825][123090] Updated weights for policy 1, policy_version 1674747 (0.0005) [2023-12-26 13:03:28,283][123091] Updated weights for policy 0, policy_version 1686002 (0.0007) [2023-12-26 13:03:28,348][123091] Updated weights for policy 0, policy_version 1686012 (0.0006) [2023-12-26 13:03:28,419][123091] Updated weights for policy 0, policy_version 1686022 (0.0008) [2023-12-26 13:03:28,488][123091] Updated weights for policy 0, policy_version 1686032 (0.0008) [2023-12-26 13:03:28,525][123090] Updated weights for policy 1, policy_version 1674757 (0.0007) [2023-12-26 13:03:28,588][123090] Updated weights for policy 1, policy_version 1674767 (0.0010) [2023-12-26 13:03:28,657][123090] Updated weights for policy 1, policy_version 1674777 (0.0009) [2023-12-26 13:03:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18159.0, 300 sec: 17744.7). Total num frames: 860372992. Throughput: 0: 9184.5, 1: 8949.9. Samples: 860361280. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:28,785][121949] Avg episode reward: [(0, '6057.272'), (1, '5797.438')] [2023-12-26 13:03:29,130][123091] Updated weights for policy 0, policy_version 1686042 (0.0008) [2023-12-26 13:03:29,190][123091] Updated weights for policy 0, policy_version 1686052 (0.0010) [2023-12-26 13:03:29,253][123091] Updated weights for policy 0, policy_version 1686062 (0.0011) [2023-12-26 13:03:29,518][123090] Updated weights for policy 1, policy_version 1674787 (0.0009) [2023-12-26 13:03:29,578][123090] Updated weights for policy 1, policy_version 1674797 (0.0009) [2023-12-26 13:03:29,644][123090] Updated weights for policy 1, policy_version 1674807 (0.0007) [2023-12-26 13:03:29,968][123091] Updated weights for policy 0, policy_version 1686072 (0.0011) [2023-12-26 13:03:30,024][123091] Updated weights for policy 0, policy_version 1686082 (0.0011) [2023-12-26 13:03:30,082][123091] Updated weights for policy 0, policy_version 1686092 (0.0010) [2023-12-26 13:03:30,406][123090] Updated weights for policy 1, policy_version 1674817 (0.0006) [2023-12-26 13:03:30,470][123090] Updated weights for policy 1, policy_version 1674827 (0.0009) [2023-12-26 13:03:30,522][123090] Updated weights for policy 1, policy_version 1674837 (0.0008) [2023-12-26 13:03:30,577][123090] Updated weights for policy 1, policy_version 1674847 (0.0009) [2023-12-26 13:03:30,909][123091] Updated weights for policy 0, policy_version 1686102 (0.0010) [2023-12-26 13:03:30,963][123091] Updated weights for policy 0, policy_version 1686112 (0.0010) [2023-12-26 13:03:31,014][123091] Updated weights for policy 0, policy_version 1686122 (0.0009) [2023-12-26 13:03:31,413][123090] Updated weights for policy 1, policy_version 1674857 (0.0008) [2023-12-26 13:03:31,464][123090] Updated weights for policy 1, policy_version 1674867 (0.0008) [2023-12-26 13:03:31,515][123090] Updated weights for policy 1, policy_version 1674877 (0.0008) [2023-12-26 13:03:31,830][123091] Updated weights for policy 0, policy_version 1686132 (0.0008) [2023-12-26 13:03:31,899][123091] Updated weights for policy 0, policy_version 1686142 (0.0008) [2023-12-26 13:03:31,972][123091] Updated weights for policy 0, policy_version 1686152 (0.0008) [2023-12-26 13:03:32,354][123090] Updated weights for policy 1, policy_version 1674887 (0.0008) [2023-12-26 13:03:32,420][123090] Updated weights for policy 1, policy_version 1674897 (0.0009) [2023-12-26 13:03:32,473][123090] Updated weights for policy 1, policy_version 1674907 (0.0009) [2023-12-26 13:03:32,644][123091] Updated weights for policy 0, policy_version 1686162 (0.0007) [2023-12-26 13:03:32,706][123091] Updated weights for policy 0, policy_version 1686172 (0.0005) [2023-12-26 13:03:32,768][123091] Updated weights for policy 0, policy_version 1686182 (0.0005) [2023-12-26 13:03:32,832][123091] Updated weights for policy 0, policy_version 1686192 (0.0005) [2023-12-26 13:03:33,386][123090] Updated weights for policy 1, policy_version 1674917 (0.0007) [2023-12-26 13:03:33,452][123090] Updated weights for policy 1, policy_version 1674927 (0.0005) [2023-12-26 13:03:33,483][123091] Updated weights for policy 0, policy_version 1686202 (0.0007) [2023-12-26 13:03:33,511][123090] Updated weights for policy 1, policy_version 1674937 (0.0006) [2023-12-26 13:03:33,533][123091] Updated weights for policy 0, policy_version 1686212 (0.0007) [2023-12-26 13:03:33,599][123091] Updated weights for policy 0, policy_version 1686222 (0.0008) [2023-12-26 13:03:33,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 860463104. Throughput: 0: 9231.6, 1: 8895.3. Samples: 860471208. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:33,785][121949] Avg episode reward: [(0, '5955.000'), (1, '5866.718')] [2023-12-26 13:03:34,165][123090] Updated weights for policy 1, policy_version 1674948 (0.0006) [2023-12-26 13:03:34,229][123090] Updated weights for policy 1, policy_version 1674959 (0.0007) [2023-12-26 13:03:34,250][123091] Updated weights for policy 0, policy_version 1686232 (0.0008) [2023-12-26 13:03:34,285][123090] Updated weights for policy 1, policy_version 1674969 (0.0006) [2023-12-26 13:03:34,312][123091] Updated weights for policy 0, policy_version 1686242 (0.0008) [2023-12-26 13:03:34,374][123091] Updated weights for policy 0, policy_version 1686252 (0.0008) [2023-12-26 13:03:35,072][123090] Updated weights for policy 1, policy_version 1674979 (0.0006) [2023-12-26 13:03:35,117][123090] Updated weights for policy 1, policy_version 1674989 (0.0005) [2023-12-26 13:03:35,166][123090] Updated weights for policy 1, policy_version 1674999 (0.0006) [2023-12-26 13:03:35,175][123091] Updated weights for policy 0, policy_version 1686262 (0.0010) [2023-12-26 13:03:35,231][123091] Updated weights for policy 0, policy_version 1686272 (0.0010) [2023-12-26 13:03:35,302][123091] Updated weights for policy 0, policy_version 1686282 (0.0005) [2023-12-26 13:03:35,962][123090] Updated weights for policy 1, policy_version 1675009 (0.0010) [2023-12-26 13:03:35,978][123091] Updated weights for policy 0, policy_version 1686292 (0.0007) [2023-12-26 13:03:36,028][123091] Updated weights for policy 0, policy_version 1686302 (0.0007) [2023-12-26 13:03:36,030][123090] Updated weights for policy 1, policy_version 1675019 (0.0005) [2023-12-26 13:03:36,111][123091] Updated weights for policy 0, policy_version 1686312 (0.0008) [2023-12-26 13:03:36,114][123090] Updated weights for policy 1, policy_version 1675029 (0.0009) [2023-12-26 13:03:36,183][123090] Updated weights for policy 1, policy_version 1675039 (0.0013) [2023-12-26 13:03:36,799][123091] Updated weights for policy 0, policy_version 1686322 (0.0006) [2023-12-26 13:03:36,858][123091] Updated weights for policy 0, policy_version 1686332 (0.0009) [2023-12-26 13:03:36,881][123090] Updated weights for policy 1, policy_version 1675049 (0.0005) [2023-12-26 13:03:36,921][123091] Updated weights for policy 0, policy_version 1686342 (0.0008) [2023-12-26 13:03:36,959][123090] Updated weights for policy 1, policy_version 1675059 (0.0005) [2023-12-26 13:03:36,990][123091] Updated weights for policy 0, policy_version 1686352 (0.0007) [2023-12-26 13:03:37,015][123090] Updated weights for policy 1, policy_version 1675069 (0.0006) [2023-12-26 13:03:37,635][123090] Updated weights for policy 1, policy_version 1675079 (0.0005) [2023-12-26 13:03:37,707][123091] Updated weights for policy 0, policy_version 1686362 (0.0005) [2023-12-26 13:03:37,709][123090] Updated weights for policy 1, policy_version 1675089 (0.0007) [2023-12-26 13:03:37,760][123090] Updated weights for policy 1, policy_version 1675099 (0.0010) [2023-12-26 13:03:37,767][123091] Updated weights for policy 0, policy_version 1686372 (0.0011) [2023-12-26 13:03:37,826][123091] Updated weights for policy 0, policy_version 1686382 (0.0010) [2023-12-26 13:03:38,486][123090] Updated weights for policy 1, policy_version 1675109 (0.0008) [2023-12-26 13:03:38,547][123091] Updated weights for policy 0, policy_version 1686392 (0.0006) [2023-12-26 13:03:38,560][123090] Updated weights for policy 1, policy_version 1675119 (0.0005) [2023-12-26 13:03:38,596][123091] Updated weights for policy 0, policy_version 1686402 (0.0005) [2023-12-26 13:03:38,627][123090] Updated weights for policy 1, policy_version 1675129 (0.0006) [2023-12-26 13:03:38,649][123091] Updated weights for policy 0, policy_version 1686412 (0.0007) [2023-12-26 13:03:38,784][121949] Fps is (10 sec: 18840.9, 60 sec: 18295.4, 300 sec: 17800.2). Total num frames: 860561408. Throughput: 0: 9320.9, 1: 8947.6. Samples: 860529152. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:38,785][121949] Avg episode reward: [(0, '6036.625'), (1, '5769.955')] [2023-12-26 13:03:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001686416_431726592.pth... [2023-12-26 13:03:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001675136_428834816.pth... [2023-12-26 13:03:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001674080_428564480.pth [2023-12-26 13:03:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001685328_431448064.pth [2023-12-26 13:03:39,284][123090] Updated weights for policy 1, policy_version 1675139 (0.0007) [2023-12-26 13:03:39,362][123090] Updated weights for policy 1, policy_version 1675149 (0.0009) [2023-12-26 13:03:39,433][123090] Updated weights for policy 1, policy_version 1675159 (0.0008) [2023-12-26 13:03:39,474][123091] Updated weights for policy 0, policy_version 1686422 (0.0010) [2023-12-26 13:03:39,532][123091] Updated weights for policy 0, policy_version 1686432 (0.0009) [2023-12-26 13:03:39,594][123091] Updated weights for policy 0, policy_version 1686442 (0.0009) [2023-12-26 13:03:40,274][123090] Updated weights for policy 1, policy_version 1675169 (0.0009) [2023-12-26 13:03:40,339][123090] Updated weights for policy 1, policy_version 1675179 (0.0009) [2023-12-26 13:03:40,403][123090] Updated weights for policy 1, policy_version 1675189 (0.0009) [2023-12-26 13:03:40,458][123091] Updated weights for policy 0, policy_version 1686452 (0.0010) [2023-12-26 13:03:40,469][123090] Updated weights for policy 1, policy_version 1675199 (0.0007) [2023-12-26 13:03:40,521][123091] Updated weights for policy 0, policy_version 1686462 (0.0011) [2023-12-26 13:03:40,569][123091] Updated weights for policy 0, policy_version 1686472 (0.0010) [2023-12-26 13:03:41,303][123090] Updated weights for policy 1, policy_version 1675209 (0.0009) [2023-12-26 13:03:41,378][123090] Updated weights for policy 1, policy_version 1675219 (0.0009) [2023-12-26 13:03:41,415][123091] Updated weights for policy 0, policy_version 1686482 (0.0010) [2023-12-26 13:03:41,439][123090] Updated weights for policy 1, policy_version 1675229 (0.0008) [2023-12-26 13:03:41,482][123091] Updated weights for policy 0, policy_version 1686492 (0.0008) [2023-12-26 13:03:41,548][123091] Updated weights for policy 0, policy_version 1686502 (0.0008) [2023-12-26 13:03:41,611][123091] Updated weights for policy 0, policy_version 1686512 (0.0008) [2023-12-26 13:03:42,278][123090] Updated weights for policy 1, policy_version 1675239 (0.0009) [2023-12-26 13:03:42,355][123090] Updated weights for policy 1, policy_version 1675249 (0.0010) [2023-12-26 13:03:42,366][123091] Updated weights for policy 0, policy_version 1686522 (0.0010) [2023-12-26 13:03:42,426][123090] Updated weights for policy 1, policy_version 1675259 (0.0007) [2023-12-26 13:03:42,438][123091] Updated weights for policy 0, policy_version 1686532 (0.0011) [2023-12-26 13:03:42,494][123091] Updated weights for policy 0, policy_version 1686542 (0.0011) [2023-12-26 13:03:43,230][123090] Updated weights for policy 1, policy_version 1675269 (0.0009) [2023-12-26 13:03:43,298][123090] Updated weights for policy 1, policy_version 1675279 (0.0008) [2023-12-26 13:03:43,316][123091] Updated weights for policy 0, policy_version 1686552 (0.0011) [2023-12-26 13:03:43,358][123090] Updated weights for policy 1, policy_version 1675289 (0.0007) [2023-12-26 13:03:43,371][123091] Updated weights for policy 0, policy_version 1686562 (0.0009) [2023-12-26 13:03:43,426][123091] Updated weights for policy 0, policy_version 1686572 (0.0010) [2023-12-26 13:03:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18295.4, 300 sec: 17772.5). Total num frames: 860643328. Throughput: 0: 9230.3, 1: 8891.5. Samples: 860636560. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:43,785][121949] Avg episode reward: [(0, '6241.087'), (1, '5843.690')] [2023-12-26 13:03:44,135][123090] Updated weights for policy 1, policy_version 1675299 (0.0009) [2023-12-26 13:03:44,201][123090] Updated weights for policy 1, policy_version 1675309 (0.0009) [2023-12-26 13:03:44,244][123091] Updated weights for policy 0, policy_version 1686582 (0.0008) [2023-12-26 13:03:44,270][123090] Updated weights for policy 1, policy_version 1675319 (0.0008) [2023-12-26 13:03:44,304][123091] Updated weights for policy 0, policy_version 1686592 (0.0007) [2023-12-26 13:03:44,368][123091] Updated weights for policy 0, policy_version 1686602 (0.0006) [2023-12-26 13:03:45,071][123090] Updated weights for policy 1, policy_version 1675329 (0.0009) [2023-12-26 13:03:45,088][123091] Updated weights for policy 0, policy_version 1686612 (0.0006) [2023-12-26 13:03:45,134][123090] Updated weights for policy 1, policy_version 1675339 (0.0009) [2023-12-26 13:03:45,155][123091] Updated weights for policy 0, policy_version 1686622 (0.0008) [2023-12-26 13:03:45,201][123090] Updated weights for policy 1, policy_version 1675349 (0.0009) [2023-12-26 13:03:45,218][123091] Updated weights for policy 0, policy_version 1686632 (0.0010) [2023-12-26 13:03:45,272][123090] Updated weights for policy 1, policy_version 1675359 (0.0007) [2023-12-26 13:03:45,987][123090] Updated weights for policy 1, policy_version 1675369 (0.0006) [2023-12-26 13:03:46,060][123090] Updated weights for policy 1, policy_version 1675379 (0.0005) [2023-12-26 13:03:46,105][123091] Updated weights for policy 0, policy_version 1686642 (0.0009) [2023-12-26 13:03:46,123][123090] Updated weights for policy 1, policy_version 1675389 (0.0005) [2023-12-26 13:03:46,158][123091] Updated weights for policy 0, policy_version 1686652 (0.0009) [2023-12-26 13:03:46,210][123091] Updated weights for policy 0, policy_version 1686663 (0.0010) [2023-12-26 13:03:46,883][123090] Updated weights for policy 1, policy_version 1675399 (0.0007) [2023-12-26 13:03:46,935][123090] Updated weights for policy 1, policy_version 1675409 (0.0009) [2023-12-26 13:03:46,983][123090] Updated weights for policy 1, policy_version 1675419 (0.0008) [2023-12-26 13:03:47,082][123091] Updated weights for policy 0, policy_version 1686673 (0.0009) [2023-12-26 13:03:47,132][123091] Updated weights for policy 0, policy_version 1686683 (0.0010) [2023-12-26 13:03:47,190][123091] Updated weights for policy 0, policy_version 1686693 (0.0010) [2023-12-26 13:03:47,248][123091] Updated weights for policy 0, policy_version 1686703 (0.0010) [2023-12-26 13:03:47,840][123090] Updated weights for policy 1, policy_version 1675429 (0.0009) [2023-12-26 13:03:47,893][123090] Updated weights for policy 1, policy_version 1675439 (0.0009) [2023-12-26 13:03:47,946][123090] Updated weights for policy 1, policy_version 1675449 (0.0010) [2023-12-26 13:03:48,029][123091] Updated weights for policy 0, policy_version 1686713 (0.0009) [2023-12-26 13:03:48,088][123091] Updated weights for policy 0, policy_version 1686723 (0.0008) [2023-12-26 13:03:48,150][123091] Updated weights for policy 0, policy_version 1686733 (0.0008) [2023-12-26 13:03:48,771][123090] Updated weights for policy 1, policy_version 1675459 (0.0009) [2023-12-26 13:03:48,784][121949] Fps is (10 sec: 16384.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 860725248. Throughput: 0: 9146.7, 1: 8865.4. Samples: 860742092. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:48,785][121949] Avg episode reward: [(0, '6384.784'), (1, '5986.245')] [2023-12-26 13:03:48,839][123090] Updated weights for policy 1, policy_version 1675469 (0.0011) [2023-12-26 13:03:48,895][123090] Updated weights for policy 1, policy_version 1675479 (0.0010) [2023-12-26 13:03:48,897][123091] Updated weights for policy 0, policy_version 1686743 (0.0010) [2023-12-26 13:03:48,952][123091] Updated weights for policy 0, policy_version 1686753 (0.0008) [2023-12-26 13:03:49,006][123091] Updated weights for policy 0, policy_version 1686763 (0.0008) [2023-12-26 13:03:49,703][123090] Updated weights for policy 1, policy_version 1675489 (0.0011) [2023-12-26 13:03:49,767][123090] Updated weights for policy 1, policy_version 1675499 (0.0011) [2023-12-26 13:03:49,773][123091] Updated weights for policy 0, policy_version 1686773 (0.0009) [2023-12-26 13:03:49,833][123090] Updated weights for policy 1, policy_version 1675509 (0.0007) [2023-12-26 13:03:49,845][123091] Updated weights for policy 0, policy_version 1686783 (0.0011) [2023-12-26 13:03:49,907][123090] Updated weights for policy 1, policy_version 1675519 (0.0008) [2023-12-26 13:03:49,909][123091] Updated weights for policy 0, policy_version 1686793 (0.0010) [2023-12-26 13:03:50,703][123091] Updated weights for policy 0, policy_version 1686803 (0.0011) [2023-12-26 13:03:50,715][123090] Updated weights for policy 1, policy_version 1675529 (0.0011) [2023-12-26 13:03:50,770][123091] Updated weights for policy 0, policy_version 1686813 (0.0007) [2023-12-26 13:03:50,776][123090] Updated weights for policy 1, policy_version 1675539 (0.0011) [2023-12-26 13:03:50,827][123091] Updated weights for policy 0, policy_version 1686823 (0.0006) [2023-12-26 13:03:50,838][123090] Updated weights for policy 1, policy_version 1675549 (0.0011) [2023-12-26 13:03:51,672][123091] Updated weights for policy 0, policy_version 1686833 (0.0007) [2023-12-26 13:03:51,743][123091] Updated weights for policy 0, policy_version 1686843 (0.0009) [2023-12-26 13:03:51,760][123090] Updated weights for policy 1, policy_version 1675559 (0.0009) [2023-12-26 13:03:51,800][123091] Updated weights for policy 0, policy_version 1686853 (0.0008) [2023-12-26 13:03:51,819][123090] Updated weights for policy 1, policy_version 1675569 (0.0009) [2023-12-26 13:03:51,850][123091] Updated weights for policy 0, policy_version 1686863 (0.0009) [2023-12-26 13:03:51,887][123090] Updated weights for policy 1, policy_version 1675579 (0.0010) [2023-12-26 13:03:52,618][123091] Updated weights for policy 0, policy_version 1686873 (0.0009) [2023-12-26 13:03:52,682][123091] Updated weights for policy 0, policy_version 1686883 (0.0010) [2023-12-26 13:03:52,724][123090] Updated weights for policy 1, policy_version 1675589 (0.0009) [2023-12-26 13:03:52,750][123091] Updated weights for policy 0, policy_version 1686893 (0.0009) [2023-12-26 13:03:52,789][123090] Updated weights for policy 1, policy_version 1675599 (0.0007) [2023-12-26 13:03:52,852][123090] Updated weights for policy 1, policy_version 1675609 (0.0006) [2023-12-26 13:03:53,482][123090] Updated weights for policy 1, policy_version 1675619 (0.0005) [2023-12-26 13:03:53,530][123090] Updated weights for policy 1, policy_version 1675629 (0.0005) [2023-12-26 13:03:53,557][123091] Updated weights for policy 0, policy_version 1686903 (0.0007) [2023-12-26 13:03:53,578][123090] Updated weights for policy 1, policy_version 1675639 (0.0005) [2023-12-26 13:03:53,623][123091] Updated weights for policy 0, policy_version 1686913 (0.0009) [2023-12-26 13:03:53,689][123091] Updated weights for policy 0, policy_version 1686923 (0.0009) [2023-12-26 13:03:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18295.4, 300 sec: 17800.2). Total num frames: 860823552. Throughput: 0: 9132.4, 1: 8835.3. Samples: 860794224. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:53,785][121949] Avg episode reward: [(0, '6214.064'), (1, '5978.544')] [2023-12-26 13:03:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001686928_431857664.pth... [2023-12-26 13:03:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001675648_428965888.pth... [2023-12-26 13:03:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001674592_428695552.pth [2023-12-26 13:03:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001685840_431579136.pth [2023-12-26 13:03:54,361][123090] Updated weights for policy 1, policy_version 1675649 (0.0005) [2023-12-26 13:03:54,417][123090] Updated weights for policy 1, policy_version 1675659 (0.0010) [2023-12-26 13:03:54,438][123091] Updated weights for policy 0, policy_version 1686933 (0.0009) [2023-12-26 13:03:54,477][123090] Updated weights for policy 1, policy_version 1675669 (0.0009) [2023-12-26 13:03:54,500][123091] Updated weights for policy 0, policy_version 1686943 (0.0008) [2023-12-26 13:03:54,531][123090] Updated weights for policy 1, policy_version 1675679 (0.0008) [2023-12-26 13:03:54,567][123091] Updated weights for policy 0, policy_version 1686953 (0.0009) [2023-12-26 13:03:55,331][123090] Updated weights for policy 1, policy_version 1675689 (0.0006) [2023-12-26 13:03:55,344][123091] Updated weights for policy 0, policy_version 1686963 (0.0009) [2023-12-26 13:03:55,395][123090] Updated weights for policy 1, policy_version 1675699 (0.0006) [2023-12-26 13:03:55,403][123091] Updated weights for policy 0, policy_version 1686973 (0.0009) [2023-12-26 13:03:55,453][123090] Updated weights for policy 1, policy_version 1675709 (0.0006) [2023-12-26 13:03:55,459][123091] Updated weights for policy 0, policy_version 1686983 (0.0010) [2023-12-26 13:03:56,211][123090] Updated weights for policy 1, policy_version 1675719 (0.0005) [2023-12-26 13:03:56,267][123090] Updated weights for policy 1, policy_version 1675729 (0.0005) [2023-12-26 13:03:56,321][123091] Updated weights for policy 0, policy_version 1686993 (0.0009) [2023-12-26 13:03:56,322][123090] Updated weights for policy 1, policy_version 1675739 (0.0005) [2023-12-26 13:03:56,385][123091] Updated weights for policy 0, policy_version 1687003 (0.0009) [2023-12-26 13:03:56,453][123091] Updated weights for policy 0, policy_version 1687013 (0.0008) [2023-12-26 13:03:56,522][123091] Updated weights for policy 0, policy_version 1687023 (0.0010) [2023-12-26 13:03:56,908][123090] Updated weights for policy 1, policy_version 1675749 (0.0007) [2023-12-26 13:03:56,957][123090] Updated weights for policy 1, policy_version 1675759 (0.0009) [2023-12-26 13:03:57,005][123090] Updated weights for policy 1, policy_version 1675769 (0.0009) [2023-12-26 13:03:57,344][123091] Updated weights for policy 0, policy_version 1687033 (0.0006) [2023-12-26 13:03:57,397][123091] Updated weights for policy 0, policy_version 1687043 (0.0005) [2023-12-26 13:03:57,453][123091] Updated weights for policy 0, policy_version 1687053 (0.0005) [2023-12-26 13:03:57,853][123090] Updated weights for policy 1, policy_version 1675780 (0.0009) [2023-12-26 13:03:57,912][123090] Updated weights for policy 1, policy_version 1675790 (0.0008) [2023-12-26 13:03:57,970][123090] Updated weights for policy 1, policy_version 1675800 (0.0009) [2023-12-26 13:03:58,251][123091] Updated weights for policy 0, policy_version 1687063 (0.0009) [2023-12-26 13:03:58,327][123091] Updated weights for policy 0, policy_version 1687073 (0.0008) [2023-12-26 13:03:58,395][123091] Updated weights for policy 0, policy_version 1687083 (0.0009) [2023-12-26 13:03:58,786][121949] Fps is (10 sec: 18019.0, 60 sec: 18021.8, 300 sec: 17744.6). Total num frames: 860905472. Throughput: 0: 9069.1, 1: 9000.1. Samples: 860902260. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:03:58,786][121949] Avg episode reward: [(0, '6051.291'), (1, '6038.526')] [2023-12-26 13:03:58,979][123090] Updated weights for policy 1, policy_version 1675810 (0.0009) [2023-12-26 13:03:59,031][123090] Updated weights for policy 1, policy_version 1675820 (0.0010) [2023-12-26 13:03:59,103][123090] Updated weights for policy 1, policy_version 1675830 (0.0008) [2023-12-26 13:03:59,170][123090] Updated weights for policy 1, policy_version 1675840 (0.0009) [2023-12-26 13:03:59,365][123091] Updated weights for policy 0, policy_version 1687093 (0.0009) [2023-12-26 13:03:59,430][123091] Updated weights for policy 0, policy_version 1687103 (0.0008) [2023-12-26 13:03:59,482][123091] Updated weights for policy 0, policy_version 1687113 (0.0009) [2023-12-26 13:03:59,966][123090] Updated weights for policy 1, policy_version 1675850 (0.0009) [2023-12-26 13:04:00,031][123090] Updated weights for policy 1, policy_version 1675860 (0.0010) [2023-12-26 13:04:00,084][123090] Updated weights for policy 1, policy_version 1675870 (0.0009) [2023-12-26 13:04:00,360][123091] Updated weights for policy 0, policy_version 1687123 (0.0010) [2023-12-26 13:04:00,419][123091] Updated weights for policy 0, policy_version 1687133 (0.0009) [2023-12-26 13:04:00,482][123091] Updated weights for policy 0, policy_version 1687143 (0.0008) [2023-12-26 13:04:00,836][123090] Updated weights for policy 1, policy_version 1675880 (0.0009) [2023-12-26 13:04:00,891][123090] Updated weights for policy 1, policy_version 1675890 (0.0009) [2023-12-26 13:04:00,959][123090] Updated weights for policy 1, policy_version 1675900 (0.0005) [2023-12-26 13:04:01,308][123091] Updated weights for policy 0, policy_version 1687153 (0.0009) [2023-12-26 13:04:01,379][123091] Updated weights for policy 0, policy_version 1687163 (0.0010) [2023-12-26 13:04:01,463][123091] Updated weights for policy 0, policy_version 1687173 (0.0009) [2023-12-26 13:04:01,517][123091] Updated weights for policy 0, policy_version 1687183 (0.0009) [2023-12-26 13:04:01,801][123090] Updated weights for policy 1, policy_version 1675910 (0.0008) [2023-12-26 13:04:01,858][123090] Updated weights for policy 1, policy_version 1675921 (0.0009) [2023-12-26 13:04:01,906][123090] Updated weights for policy 1, policy_version 1675931 (0.0008) [2023-12-26 13:04:02,358][123091] Updated weights for policy 0, policy_version 1687193 (0.0009) [2023-12-26 13:04:02,421][123091] Updated weights for policy 0, policy_version 1687203 (0.0009) [2023-12-26 13:04:02,477][123091] Updated weights for policy 0, policy_version 1687213 (0.0009) [2023-12-26 13:04:02,765][123090] Updated weights for policy 1, policy_version 1675941 (0.0009) [2023-12-26 13:04:02,819][123090] Updated weights for policy 1, policy_version 1675951 (0.0010) [2023-12-26 13:04:02,877][123090] Updated weights for policy 1, policy_version 1675961 (0.0010) [2023-12-26 13:04:03,082][123091] Updated weights for policy 0, policy_version 1687223 (0.0006) [2023-12-26 13:04:03,127][123091] Updated weights for policy 0, policy_version 1687233 (0.0005) [2023-12-26 13:04:03,173][123091] Updated weights for policy 0, policy_version 1687243 (0.0005) [2023-12-26 13:04:03,768][123090] Updated weights for policy 1, policy_version 1675971 (0.0009) [2023-12-26 13:04:03,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 860987392. Throughput: 0: 8980.4, 1: 8906.0. Samples: 861004368. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:04:03,785][121949] Avg episode reward: [(0, '5988.299'), (1, '5899.446')] [2023-12-26 13:04:03,816][123091] Updated weights for policy 0, policy_version 1687253 (0.0005) [2023-12-26 13:04:03,830][123090] Updated weights for policy 1, policy_version 1675981 (0.0009) [2023-12-26 13:04:03,882][123091] Updated weights for policy 0, policy_version 1687263 (0.0007) [2023-12-26 13:04:03,897][123090] Updated weights for policy 1, policy_version 1675991 (0.0008) [2023-12-26 13:04:03,946][123091] Updated weights for policy 0, policy_version 1687273 (0.0008) [2023-12-26 13:04:04,750][123090] Updated weights for policy 1, policy_version 1676001 (0.0007) [2023-12-26 13:04:04,755][123091] Updated weights for policy 0, policy_version 1687285 (0.0010) [2023-12-26 13:04:04,802][123091] Updated weights for policy 0, policy_version 1687295 (0.0006) [2023-12-26 13:04:04,807][123090] Updated weights for policy 1, policy_version 1676011 (0.0008) [2023-12-26 13:04:04,858][123090] Updated weights for policy 1, policy_version 1676021 (0.0008) [2023-12-26 13:04:04,865][123091] Updated weights for policy 0, policy_version 1687305 (0.0008) [2023-12-26 13:04:04,922][123090] Updated weights for policy 1, policy_version 1676031 (0.0009) [2023-12-26 13:04:05,577][123091] Updated weights for policy 0, policy_version 1687315 (0.0007) [2023-12-26 13:04:05,642][123091] Updated weights for policy 0, policy_version 1687325 (0.0006) [2023-12-26 13:04:05,693][123090] Updated weights for policy 1, policy_version 1676041 (0.0006) [2023-12-26 13:04:05,710][123091] Updated weights for policy 0, policy_version 1687335 (0.0005) [2023-12-26 13:04:05,741][123090] Updated weights for policy 1, policy_version 1676051 (0.0005) [2023-12-26 13:04:05,788][123090] Updated weights for policy 1, policy_version 1676061 (0.0005) [2023-12-26 13:04:06,420][123091] Updated weights for policy 0, policy_version 1687345 (0.0005) [2023-12-26 13:04:06,493][123091] Updated weights for policy 0, policy_version 1687355 (0.0008) [2023-12-26 13:04:06,562][123091] Updated weights for policy 0, policy_version 1687365 (0.0010) [2023-12-26 13:04:06,598][123090] Updated weights for policy 1, policy_version 1676071 (0.0007) [2023-12-26 13:04:06,626][123091] Updated weights for policy 0, policy_version 1687375 (0.0007) [2023-12-26 13:04:06,666][123090] Updated weights for policy 1, policy_version 1676081 (0.0009) [2023-12-26 13:04:06,731][123090] Updated weights for policy 1, policy_version 1676091 (0.0010) [2023-12-26 13:04:07,431][123091] Updated weights for policy 0, policy_version 1687385 (0.0006) [2023-12-26 13:04:07,444][123090] Updated weights for policy 1, policy_version 1676101 (0.0008) [2023-12-26 13:04:07,481][123091] Updated weights for policy 0, policy_version 1687395 (0.0006) [2023-12-26 13:04:07,509][123090] Updated weights for policy 1, policy_version 1676111 (0.0010) [2023-12-26 13:04:07,542][123091] Updated weights for policy 0, policy_version 1687405 (0.0006) [2023-12-26 13:04:07,570][123090] Updated weights for policy 1, policy_version 1676121 (0.0010) [2023-12-26 13:04:08,238][123091] Updated weights for policy 0, policy_version 1687415 (0.0009) [2023-12-26 13:04:08,288][123091] Updated weights for policy 0, policy_version 1687425 (0.0009) [2023-12-26 13:04:08,347][123091] Updated weights for policy 0, policy_version 1687435 (0.0009) [2023-12-26 13:04:08,481][123090] Updated weights for policy 1, policy_version 1676131 (0.0010) [2023-12-26 13:04:08,536][123090] Updated weights for policy 1, policy_version 1676141 (0.0010) [2023-12-26 13:04:08,592][123090] Updated weights for policy 1, policy_version 1676152 (0.0011) [2023-12-26 13:04:08,784][121949] Fps is (10 sec: 18025.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 861085696. Throughput: 0: 9041.0, 1: 8948.4. Samples: 861059304. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:04:08,785][121949] Avg episode reward: [(0, '5969.685'), (1, '5744.224')] [2023-12-26 13:04:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001687440_431988736.pth... [2023-12-26 13:04:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001676160_429096960.pth... [2023-12-26 13:04:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001686416_431726592.pth [2023-12-26 13:04:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001675136_428834816.pth [2023-12-26 13:04:09,085][123091] Updated weights for policy 0, policy_version 1687445 (0.0007) [2023-12-26 13:04:09,137][123091] Updated weights for policy 0, policy_version 1687455 (0.0007) [2023-12-26 13:04:09,202][123091] Updated weights for policy 0, policy_version 1687465 (0.0010) [2023-12-26 13:04:09,457][123090] Updated weights for policy 1, policy_version 1676162 (0.0009) [2023-12-26 13:04:09,537][123090] Updated weights for policy 1, policy_version 1676172 (0.0007) [2023-12-26 13:04:09,607][123090] Updated weights for policy 1, policy_version 1676182 (0.0011) [2023-12-26 13:04:09,678][123090] Updated weights for policy 1, policy_version 1676192 (0.0009) [2023-12-26 13:04:09,888][123091] Updated weights for policy 0, policy_version 1687475 (0.0010) [2023-12-26 13:04:09,955][123091] Updated weights for policy 0, policy_version 1687485 (0.0008) [2023-12-26 13:04:10,023][123091] Updated weights for policy 0, policy_version 1687495 (0.0008) [2023-12-26 13:04:10,431][123090] Updated weights for policy 1, policy_version 1676202 (0.0005) [2023-12-26 13:04:10,479][123090] Updated weights for policy 1, policy_version 1676212 (0.0005) [2023-12-26 13:04:10,540][123090] Updated weights for policy 1, policy_version 1676222 (0.0005) [2023-12-26 13:04:10,837][123091] Updated weights for policy 0, policy_version 1687505 (0.0008) [2023-12-26 13:04:10,907][123091] Updated weights for policy 0, policy_version 1687515 (0.0011) [2023-12-26 13:04:10,976][123091] Updated weights for policy 0, policy_version 1687525 (0.0011) [2023-12-26 13:04:11,044][123091] Updated weights for policy 0, policy_version 1687535 (0.0011) [2023-12-26 13:04:11,385][123090] Updated weights for policy 1, policy_version 1676232 (0.0008) [2023-12-26 13:04:11,457][123090] Updated weights for policy 1, policy_version 1676242 (0.0011) [2023-12-26 13:04:11,515][123090] Updated weights for policy 1, policy_version 1676252 (0.0010) [2023-12-26 13:04:11,825][123091] Updated weights for policy 0, policy_version 1687545 (0.0006) [2023-12-26 13:04:11,892][123091] Updated weights for policy 0, policy_version 1687555 (0.0005) [2023-12-26 13:04:11,950][123091] Updated weights for policy 0, policy_version 1687565 (0.0005) [2023-12-26 13:04:12,423][123090] Updated weights for policy 1, policy_version 1676262 (0.0009) [2023-12-26 13:04:12,485][123090] Updated weights for policy 1, policy_version 1676272 (0.0008) [2023-12-26 13:04:12,540][123090] Updated weights for policy 1, policy_version 1676282 (0.0009) [2023-12-26 13:04:12,681][123091] Updated weights for policy 0, policy_version 1687575 (0.0007) [2023-12-26 13:04:12,747][123091] Updated weights for policy 0, policy_version 1687585 (0.0010) [2023-12-26 13:04:12,805][123091] Updated weights for policy 0, policy_version 1687595 (0.0009) [2023-12-26 13:04:13,382][123090] Updated weights for policy 1, policy_version 1676292 (0.0009) [2023-12-26 13:04:13,435][123090] Updated weights for policy 1, policy_version 1676302 (0.0009) [2023-12-26 13:04:13,490][123090] Updated weights for policy 1, policy_version 1676312 (0.0010) [2023-12-26 13:04:13,620][123091] Updated weights for policy 0, policy_version 1687605 (0.0010) [2023-12-26 13:04:13,693][123091] Updated weights for policy 0, policy_version 1687615 (0.0010) [2023-12-26 13:04:13,757][123091] Updated weights for policy 0, policy_version 1687625 (0.0010) [2023-12-26 13:04:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 861167616. Throughput: 0: 9057.1, 1: 8798.5. Samples: 861164780. Policy #0 lag: (min: 31.0, avg: 36.2, max: 63.0) [2023-12-26 13:04:13,785][121949] Avg episode reward: [(0, '5956.311'), (1, '5828.339')] [2023-12-26 13:04:14,301][123090] Updated weights for policy 1, policy_version 1676322 (0.0010) [2023-12-26 13:04:14,357][123090] Updated weights for policy 1, policy_version 1676332 (0.0008) [2023-12-26 13:04:14,412][123090] Updated weights for policy 1, policy_version 1676342 (0.0010) [2023-12-26 13:04:14,461][123090] Updated weights for policy 1, policy_version 1676352 (0.0009) [2023-12-26 13:04:14,589][123091] Updated weights for policy 0, policy_version 1687635 (0.0010) [2023-12-26 13:04:14,647][123091] Updated weights for policy 0, policy_version 1687645 (0.0009) [2023-12-26 13:04:14,714][123091] Updated weights for policy 0, policy_version 1687655 (0.0009) [2023-12-26 13:04:15,261][123090] Updated weights for policy 1, policy_version 1676362 (0.0006) [2023-12-26 13:04:15,326][123090] Updated weights for policy 1, policy_version 1676372 (0.0006) [2023-12-26 13:04:15,401][123090] Updated weights for policy 1, policy_version 1676382 (0.0006) [2023-12-26 13:04:15,610][123091] Updated weights for policy 0, policy_version 1687665 (0.0010) [2023-12-26 13:04:15,665][123091] Updated weights for policy 0, policy_version 1687675 (0.0010) [2023-12-26 13:04:15,738][123091] Updated weights for policy 0, policy_version 1687685 (0.0007) [2023-12-26 13:04:15,796][123091] Updated weights for policy 0, policy_version 1687695 (0.0006) [2023-12-26 13:04:16,098][123090] Updated weights for policy 1, policy_version 1676392 (0.0009) [2023-12-26 13:04:16,162][123090] Updated weights for policy 1, policy_version 1676402 (0.0007) [2023-12-26 13:04:16,225][123090] Updated weights for policy 1, policy_version 1676412 (0.0008) [2023-12-26 13:04:16,610][123091] Updated weights for policy 0, policy_version 1687705 (0.0010) [2023-12-26 13:04:16,672][123091] Updated weights for policy 0, policy_version 1687715 (0.0010) [2023-12-26 13:04:16,730][123091] Updated weights for policy 0, policy_version 1687725 (0.0009) [2023-12-26 13:04:16,912][123090] Updated weights for policy 1, policy_version 1676422 (0.0010) [2023-12-26 13:04:16,975][123090] Updated weights for policy 1, policy_version 1676432 (0.0010) [2023-12-26 13:04:17,034][123090] Updated weights for policy 1, policy_version 1676442 (0.0010) [2023-12-26 13:04:17,597][123091] Updated weights for policy 0, policy_version 1687735 (0.0010) [2023-12-26 13:04:17,652][123091] Updated weights for policy 0, policy_version 1687745 (0.0009) [2023-12-26 13:04:17,708][123091] Updated weights for policy 0, policy_version 1687755 (0.0009) [2023-12-26 13:04:17,831][123090] Updated weights for policy 1, policy_version 1676452 (0.0008) [2023-12-26 13:04:17,886][123090] Updated weights for policy 1, policy_version 1676462 (0.0006) [2023-12-26 13:04:17,941][123090] Updated weights for policy 1, policy_version 1676472 (0.0008) [2023-12-26 13:04:18,603][123091] Updated weights for policy 0, policy_version 1687765 (0.0010) [2023-12-26 13:04:18,654][123090] Updated weights for policy 1, policy_version 1676482 (0.0009) [2023-12-26 13:04:18,663][123091] Updated weights for policy 0, policy_version 1687775 (0.0009) [2023-12-26 13:04:18,723][123091] Updated weights for policy 0, policy_version 1687785 (0.0009) [2023-12-26 13:04:18,724][123090] Updated weights for policy 1, policy_version 1676492 (0.0006) [2023-12-26 13:04:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 861257728. Throughput: 0: 8892.2, 1: 8853.7. Samples: 861269772. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:18,785][121949] Avg episode reward: [(0, '5818.488'), (1, '5936.669')] [2023-12-26 13:04:18,788][123090] Updated weights for policy 1, policy_version 1676502 (0.0006) [2023-12-26 13:04:18,840][123090] Updated weights for policy 1, policy_version 1676512 (0.0005) [2023-12-26 13:04:19,591][123091] Updated weights for policy 0, policy_version 1687795 (0.0009) [2023-12-26 13:04:19,594][123090] Updated weights for policy 1, policy_version 1676522 (0.0009) [2023-12-26 13:04:19,652][123090] Updated weights for policy 1, policy_version 1676532 (0.0007) [2023-12-26 13:04:19,661][123091] Updated weights for policy 0, policy_version 1687805 (0.0008) [2023-12-26 13:04:19,719][123090] Updated weights for policy 1, policy_version 1676542 (0.0006) [2023-12-26 13:04:19,720][123091] Updated weights for policy 0, policy_version 1687815 (0.0008) [2023-12-26 13:04:20,542][123091] Updated weights for policy 0, policy_version 1687825 (0.0008) [2023-12-26 13:04:20,572][123090] Updated weights for policy 1, policy_version 1676552 (0.0010) [2023-12-26 13:04:20,609][123091] Updated weights for policy 0, policy_version 1687835 (0.0008) [2023-12-26 13:04:20,641][123090] Updated weights for policy 1, policy_version 1676562 (0.0008) [2023-12-26 13:04:20,677][123091] Updated weights for policy 0, policy_version 1687845 (0.0009) [2023-12-26 13:04:20,710][123090] Updated weights for policy 1, policy_version 1676572 (0.0009) [2023-12-26 13:04:20,745][123091] Updated weights for policy 0, policy_version 1687855 (0.0009) [2023-12-26 13:04:21,552][123091] Updated weights for policy 0, policy_version 1687865 (0.0010) [2023-12-26 13:04:21,571][123090] Updated weights for policy 1, policy_version 1676582 (0.0009) [2023-12-26 13:04:21,616][123091] Updated weights for policy 0, policy_version 1687875 (0.0007) [2023-12-26 13:04:21,635][123090] Updated weights for policy 1, policy_version 1676592 (0.0009) [2023-12-26 13:04:21,685][123091] Updated weights for policy 0, policy_version 1687885 (0.0009) [2023-12-26 13:04:21,705][123090] Updated weights for policy 1, policy_version 1676602 (0.0008) [2023-12-26 13:04:22,419][123091] Updated weights for policy 0, policy_version 1687895 (0.0010) [2023-12-26 13:04:22,488][123091] Updated weights for policy 0, policy_version 1687905 (0.0009) [2023-12-26 13:04:22,547][123091] Updated weights for policy 0, policy_version 1687915 (0.0010) [2023-12-26 13:04:22,594][123090] Updated weights for policy 1, policy_version 1676612 (0.0010) [2023-12-26 13:04:22,657][123090] Updated weights for policy 1, policy_version 1676622 (0.0009) [2023-12-26 13:04:22,718][123090] Updated weights for policy 1, policy_version 1676632 (0.0010) [2023-12-26 13:04:23,379][123091] Updated weights for policy 0, policy_version 1687925 (0.0009) [2023-12-26 13:04:23,431][123091] Updated weights for policy 0, policy_version 1687935 (0.0009) [2023-12-26 13:04:23,487][123091] Updated weights for policy 0, policy_version 1687945 (0.0010) [2023-12-26 13:04:23,567][123090] Updated weights for policy 1, policy_version 1676642 (0.0009) [2023-12-26 13:04:23,624][123090] Updated weights for policy 1, policy_version 1676652 (0.0009) [2023-12-26 13:04:23,679][123090] Updated weights for policy 1, policy_version 1676662 (0.0010) [2023-12-26 13:04:23,733][123090] Updated weights for policy 1, policy_version 1676672 (0.0009) [2023-12-26 13:04:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 861347840. Throughput: 0: 8785.3, 1: 8800.2. Samples: 861320496. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:23,785][121949] Avg episode reward: [(0, '5783.530'), (1, '5928.884')] [2023-12-26 13:04:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001687952_432119808.pth... [2023-12-26 13:04:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001676672_429228032.pth... [2023-12-26 13:04:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001686928_431857664.pth [2023-12-26 13:04:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001675648_428965888.pth [2023-12-26 13:04:24,297][123091] Updated weights for policy 0, policy_version 1687955 (0.0009) [2023-12-26 13:04:24,358][123091] Updated weights for policy 0, policy_version 1687965 (0.0009) [2023-12-26 13:04:24,422][123091] Updated weights for policy 0, policy_version 1687975 (0.0009) [2023-12-26 13:04:24,599][123090] Updated weights for policy 1, policy_version 1676682 (0.0010) [2023-12-26 13:04:24,659][123090] Updated weights for policy 1, policy_version 1676692 (0.0009) [2023-12-26 13:04:24,722][123090] Updated weights for policy 1, policy_version 1676702 (0.0009) [2023-12-26 13:04:25,215][123091] Updated weights for policy 0, policy_version 1687985 (0.0010) [2023-12-26 13:04:25,269][123091] Updated weights for policy 0, policy_version 1687995 (0.0009) [2023-12-26 13:04:25,322][123091] Updated weights for policy 0, policy_version 1688005 (0.0009) [2023-12-26 13:04:25,383][123091] Updated weights for policy 0, policy_version 1688015 (0.0010) [2023-12-26 13:04:25,562][123090] Updated weights for policy 1, policy_version 1676712 (0.0009) [2023-12-26 13:04:25,611][123090] Updated weights for policy 1, policy_version 1676722 (0.0009) [2023-12-26 13:04:25,675][123090] Updated weights for policy 1, policy_version 1676732 (0.0010) [2023-12-26 13:04:26,097][123091] Updated weights for policy 0, policy_version 1688025 (0.0009) [2023-12-26 13:04:26,146][123091] Updated weights for policy 0, policy_version 1688036 (0.0009) [2023-12-26 13:04:26,205][123091] Updated weights for policy 0, policy_version 1688046 (0.0008) [2023-12-26 13:04:26,555][123090] Updated weights for policy 1, policy_version 1676742 (0.0009) [2023-12-26 13:04:26,619][123090] Updated weights for policy 1, policy_version 1676752 (0.0008) [2023-12-26 13:04:26,687][123090] Updated weights for policy 1, policy_version 1676762 (0.0008) [2023-12-26 13:04:27,069][123091] Updated weights for policy 0, policy_version 1688056 (0.0009) [2023-12-26 13:04:27,120][123091] Updated weights for policy 0, policy_version 1688066 (0.0010) [2023-12-26 13:04:27,175][123091] Updated weights for policy 0, policy_version 1688076 (0.0009) [2023-12-26 13:04:27,466][123090] Updated weights for policy 1, policy_version 1676772 (0.0008) [2023-12-26 13:04:27,525][123090] Updated weights for policy 1, policy_version 1676782 (0.0009) [2023-12-26 13:04:27,584][123090] Updated weights for policy 1, policy_version 1676792 (0.0009) [2023-12-26 13:04:27,954][123091] Updated weights for policy 0, policy_version 1688086 (0.0009) [2023-12-26 13:04:28,011][123091] Updated weights for policy 0, policy_version 1688096 (0.0009) [2023-12-26 13:04:28,073][123091] Updated weights for policy 0, policy_version 1688106 (0.0009) [2023-12-26 13:04:28,425][123090] Updated weights for policy 1, policy_version 1676802 (0.0010) [2023-12-26 13:04:28,477][123090] Updated weights for policy 1, policy_version 1676812 (0.0009) [2023-12-26 13:04:28,533][123090] Updated weights for policy 1, policy_version 1676822 (0.0009) [2023-12-26 13:04:28,594][123090] Updated weights for policy 1, policy_version 1676832 (0.0009) [2023-12-26 13:04:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 861429760. Throughput: 0: 8773.3, 1: 8710.4. Samples: 861423328. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:28,785][121949] Avg episode reward: [(0, '5743.004'), (1, '5887.257')] [2023-12-26 13:04:28,913][123091] Updated weights for policy 0, policy_version 1688116 (0.0009) [2023-12-26 13:04:28,964][123091] Updated weights for policy 0, policy_version 1688127 (0.0009) [2023-12-26 13:04:29,024][123091] Updated weights for policy 0, policy_version 1688137 (0.0009) [2023-12-26 13:04:29,404][123090] Updated weights for policy 1, policy_version 1676842 (0.0007) [2023-12-26 13:04:29,470][123090] Updated weights for policy 1, policy_version 1676852 (0.0006) [2023-12-26 13:04:29,533][123090] Updated weights for policy 1, policy_version 1676862 (0.0009) [2023-12-26 13:04:29,933][123091] Updated weights for policy 0, policy_version 1688147 (0.0009) [2023-12-26 13:04:30,006][123091] Updated weights for policy 0, policy_version 1688157 (0.0010) [2023-12-26 13:04:30,070][123091] Updated weights for policy 0, policy_version 1688167 (0.0010) [2023-12-26 13:04:30,244][123090] Updated weights for policy 1, policy_version 1676872 (0.0006) [2023-12-26 13:04:30,316][123090] Updated weights for policy 1, policy_version 1676882 (0.0007) [2023-12-26 13:04:30,384][123090] Updated weights for policy 1, policy_version 1676892 (0.0009) [2023-12-26 13:04:30,919][123091] Updated weights for policy 0, policy_version 1688177 (0.0009) [2023-12-26 13:04:30,980][123091] Updated weights for policy 0, policy_version 1688187 (0.0009) [2023-12-26 13:04:31,041][123091] Updated weights for policy 0, policy_version 1688197 (0.0010) [2023-12-26 13:04:31,101][123091] Updated weights for policy 0, policy_version 1688207 (0.0009) [2023-12-26 13:04:31,136][123090] Updated weights for policy 1, policy_version 1676902 (0.0009) [2023-12-26 13:04:31,203][123090] Updated weights for policy 1, policy_version 1676912 (0.0010) [2023-12-26 13:04:31,275][123090] Updated weights for policy 1, policy_version 1676922 (0.0009) [2023-12-26 13:04:31,980][123091] Updated weights for policy 0, policy_version 1688217 (0.0006) [2023-12-26 13:04:32,042][123091] Updated weights for policy 0, policy_version 1688227 (0.0005) [2023-12-26 13:04:32,089][123090] Updated weights for policy 1, policy_version 1676932 (0.0009) [2023-12-26 13:04:32,099][123091] Updated weights for policy 0, policy_version 1688237 (0.0005) [2023-12-26 13:04:32,141][123090] Updated weights for policy 1, policy_version 1676942 (0.0011) [2023-12-26 13:04:32,189][123090] Updated weights for policy 1, policy_version 1676952 (0.0010) [2023-12-26 13:04:32,792][123091] Updated weights for policy 0, policy_version 1688247 (0.0005) [2023-12-26 13:04:32,873][123091] Updated weights for policy 0, policy_version 1688257 (0.0005) [2023-12-26 13:04:32,894][123090] Updated weights for policy 1, policy_version 1676962 (0.0009) [2023-12-26 13:04:32,945][123091] Updated weights for policy 0, policy_version 1688267 (0.0005) [2023-12-26 13:04:32,946][123090] Updated weights for policy 1, policy_version 1676972 (0.0009) [2023-12-26 13:04:32,994][123090] Updated weights for policy 1, policy_version 1676982 (0.0009) [2023-12-26 13:04:33,058][123090] Updated weights for policy 1, policy_version 1676992 (0.0005) [2023-12-26 13:04:33,559][123091] Updated weights for policy 0, policy_version 1688277 (0.0005) [2023-12-26 13:04:33,619][123091] Updated weights for policy 0, policy_version 1688287 (0.0005) [2023-12-26 13:04:33,674][123091] Updated weights for policy 0, policy_version 1688297 (0.0005) [2023-12-26 13:04:33,685][123090] Updated weights for policy 1, policy_version 1677002 (0.0006) [2023-12-26 13:04:33,741][123090] Updated weights for policy 1, policy_version 1677012 (0.0006) [2023-12-26 13:04:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 861519872. Throughput: 0: 8782.0, 1: 8753.9. Samples: 861531208. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:33,784][121949] Avg episode reward: [(0, '5896.061'), (1, '5954.754')] [2023-12-26 13:04:33,797][123090] Updated weights for policy 1, policy_version 1677022 (0.0005) [2023-12-26 13:04:34,416][123091] Updated weights for policy 0, policy_version 1688307 (0.0006) [2023-12-26 13:04:34,468][123091] Updated weights for policy 0, policy_version 1688317 (0.0010) [2023-12-26 13:04:34,515][123090] Updated weights for policy 1, policy_version 1677032 (0.0008) [2023-12-26 13:04:34,527][123091] Updated weights for policy 0, policy_version 1688327 (0.0007) [2023-12-26 13:04:34,572][123090] Updated weights for policy 1, policy_version 1677042 (0.0010) [2023-12-26 13:04:34,630][123090] Updated weights for policy 1, policy_version 1677052 (0.0007) [2023-12-26 13:04:35,338][123090] Updated weights for policy 1, policy_version 1677062 (0.0007) [2023-12-26 13:04:35,409][123090] Updated weights for policy 1, policy_version 1677072 (0.0005) [2023-12-26 13:04:35,445][123091] Updated weights for policy 0, policy_version 1688337 (0.0007) [2023-12-26 13:04:35,475][123090] Updated weights for policy 1, policy_version 1677082 (0.0005) [2023-12-26 13:04:35,502][123091] Updated weights for policy 0, policy_version 1688347 (0.0010) [2023-12-26 13:04:35,558][123091] Updated weights for policy 0, policy_version 1688357 (0.0009) [2023-12-26 13:04:35,619][123091] Updated weights for policy 0, policy_version 1688367 (0.0009) [2023-12-26 13:04:36,052][123090] Updated weights for policy 1, policy_version 1677092 (0.0006) [2023-12-26 13:04:36,113][123090] Updated weights for policy 1, policy_version 1677102 (0.0006) [2023-12-26 13:04:36,177][123090] Updated weights for policy 1, policy_version 1677112 (0.0009) [2023-12-26 13:04:36,379][123091] Updated weights for policy 0, policy_version 1688377 (0.0006) [2023-12-26 13:04:36,450][123091] Updated weights for policy 0, policy_version 1688387 (0.0011) [2023-12-26 13:04:36,521][123091] Updated weights for policy 0, policy_version 1688397 (0.0011) [2023-12-26 13:04:36,894][123090] Updated weights for policy 1, policy_version 1677122 (0.0005) [2023-12-26 13:04:36,948][123090] Updated weights for policy 1, policy_version 1677132 (0.0005) [2023-12-26 13:04:37,005][123090] Updated weights for policy 1, policy_version 1677142 (0.0005) [2023-12-26 13:04:37,074][123090] Updated weights for policy 1, policy_version 1677152 (0.0006) [2023-12-26 13:04:37,321][123091] Updated weights for policy 0, policy_version 1688407 (0.0007) [2023-12-26 13:04:37,380][123091] Updated weights for policy 0, policy_version 1688417 (0.0010) [2023-12-26 13:04:37,447][123091] Updated weights for policy 0, policy_version 1688427 (0.0009) [2023-12-26 13:04:37,849][123090] Updated weights for policy 1, policy_version 1677162 (0.0009) [2023-12-26 13:04:37,902][123090] Updated weights for policy 1, policy_version 1677172 (0.0009) [2023-12-26 13:04:37,964][123090] Updated weights for policy 1, policy_version 1677182 (0.0010) [2023-12-26 13:04:38,222][123091] Updated weights for policy 0, policy_version 1688437 (0.0009) [2023-12-26 13:04:38,283][123091] Updated weights for policy 0, policy_version 1688447 (0.0007) [2023-12-26 13:04:38,354][123091] Updated weights for policy 0, policy_version 1688457 (0.0007) [2023-12-26 13:04:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17744.7). Total num frames: 861609984. Throughput: 0: 8783.4, 1: 8855.5. Samples: 861587972. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:38,785][121949] Avg episode reward: [(0, '6029.186'), (1, '6070.325')] [2023-12-26 13:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001688464_432250880.pth... [2023-12-26 13:04:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001677184_429359104.pth... [2023-12-26 13:04:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001687440_431988736.pth [2023-12-26 13:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001676160_429096960.pth [2023-12-26 13:04:38,863][123090] Updated weights for policy 1, policy_version 1677192 (0.0010) [2023-12-26 13:04:38,928][123090] Updated weights for policy 1, policy_version 1677202 (0.0009) [2023-12-26 13:04:38,997][123090] Updated weights for policy 1, policy_version 1677212 (0.0008) [2023-12-26 13:04:39,137][123091] Updated weights for policy 0, policy_version 1688467 (0.0006) [2023-12-26 13:04:39,195][123091] Updated weights for policy 0, policy_version 1688477 (0.0005) [2023-12-26 13:04:39,260][123091] Updated weights for policy 0, policy_version 1688487 (0.0009) [2023-12-26 13:04:39,857][123090] Updated weights for policy 1, policy_version 1677222 (0.0010) [2023-12-26 13:04:39,927][123090] Updated weights for policy 1, policy_version 1677232 (0.0007) [2023-12-26 13:04:39,986][123090] Updated weights for policy 1, policy_version 1677242 (0.0006) [2023-12-26 13:04:40,058][123091] Updated weights for policy 0, policy_version 1688497 (0.0010) [2023-12-26 13:04:40,123][123091] Updated weights for policy 0, policy_version 1688507 (0.0010) [2023-12-26 13:04:40,184][123091] Updated weights for policy 0, policy_version 1688517 (0.0009) [2023-12-26 13:04:40,254][123091] Updated weights for policy 0, policy_version 1688527 (0.0010) [2023-12-26 13:04:40,739][123090] Updated weights for policy 1, policy_version 1677252 (0.0006) [2023-12-26 13:04:40,816][123090] Updated weights for policy 1, policy_version 1677262 (0.0007) [2023-12-26 13:04:40,876][123090] Updated weights for policy 1, policy_version 1677272 (0.0009) [2023-12-26 13:04:41,081][123091] Updated weights for policy 0, policy_version 1688537 (0.0010) [2023-12-26 13:04:41,142][123091] Updated weights for policy 0, policy_version 1688547 (0.0010) [2023-12-26 13:04:41,213][123091] Updated weights for policy 0, policy_version 1688557 (0.0010) [2023-12-26 13:04:41,638][123090] Updated weights for policy 1, policy_version 1677282 (0.0008) [2023-12-26 13:04:41,710][123090] Updated weights for policy 1, policy_version 1677292 (0.0010) [2023-12-26 13:04:41,786][123090] Updated weights for policy 1, policy_version 1677302 (0.0009) [2023-12-26 13:04:41,852][123090] Updated weights for policy 1, policy_version 1677312 (0.0010) [2023-12-26 13:04:42,048][123091] Updated weights for policy 0, policy_version 1688567 (0.0010) [2023-12-26 13:04:42,106][123091] Updated weights for policy 0, policy_version 1688577 (0.0009) [2023-12-26 13:04:42,164][123091] Updated weights for policy 0, policy_version 1688587 (0.0010) [2023-12-26 13:04:42,640][123090] Updated weights for policy 1, policy_version 1677322 (0.0010) [2023-12-26 13:04:42,692][123090] Updated weights for policy 1, policy_version 1677332 (0.0010) [2023-12-26 13:04:42,740][123090] Updated weights for policy 1, policy_version 1677342 (0.0010) [2023-12-26 13:04:42,930][123091] Updated weights for policy 0, policy_version 1688597 (0.0008) [2023-12-26 13:04:42,999][123091] Updated weights for policy 0, policy_version 1688607 (0.0007) [2023-12-26 13:04:43,056][123091] Updated weights for policy 0, policy_version 1688617 (0.0010) [2023-12-26 13:04:43,559][123090] Updated weights for policy 1, policy_version 1677352 (0.0009) [2023-12-26 13:04:43,628][123090] Updated weights for policy 1, policy_version 1677362 (0.0009) [2023-12-26 13:04:43,704][123090] Updated weights for policy 1, policy_version 1677372 (0.0009) [2023-12-26 13:04:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 861700096. Throughput: 0: 8794.7, 1: 8771.3. Samples: 861692696. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:43,785][121949] Avg episode reward: [(0, '6009.252'), (1, '6041.644')] [2023-12-26 13:04:43,861][123091] Updated weights for policy 0, policy_version 1688627 (0.0010) [2023-12-26 13:04:43,910][123091] Updated weights for policy 0, policy_version 1688637 (0.0008) [2023-12-26 13:04:43,965][123091] Updated weights for policy 0, policy_version 1688647 (0.0010) [2023-12-26 13:04:44,532][123090] Updated weights for policy 1, policy_version 1677382 (0.0008) [2023-12-26 13:04:44,593][123090] Updated weights for policy 1, policy_version 1677392 (0.0009) [2023-12-26 13:04:44,649][123090] Updated weights for policy 1, policy_version 1677402 (0.0008) [2023-12-26 13:04:44,826][123091] Updated weights for policy 0, policy_version 1688657 (0.0011) [2023-12-26 13:04:44,890][123091] Updated weights for policy 0, policy_version 1688667 (0.0011) [2023-12-26 13:04:44,938][123091] Updated weights for policy 0, policy_version 1688677 (0.0011) [2023-12-26 13:04:44,994][123091] Updated weights for policy 0, policy_version 1688687 (0.0010) [2023-12-26 13:04:45,519][123090] Updated weights for policy 1, policy_version 1677412 (0.0007) [2023-12-26 13:04:45,590][123090] Updated weights for policy 1, policy_version 1677422 (0.0008) [2023-12-26 13:04:45,660][123090] Updated weights for policy 1, policy_version 1677432 (0.0006) [2023-12-26 13:04:45,881][123091] Updated weights for policy 0, policy_version 1688697 (0.0009) [2023-12-26 13:04:45,948][123091] Updated weights for policy 0, policy_version 1688707 (0.0011) [2023-12-26 13:04:46,007][123091] Updated weights for policy 0, policy_version 1688717 (0.0009) [2023-12-26 13:04:46,381][123090] Updated weights for policy 1, policy_version 1677442 (0.0006) [2023-12-26 13:04:46,436][123090] Updated weights for policy 1, policy_version 1677452 (0.0009) [2023-12-26 13:04:46,490][123090] Updated weights for policy 1, policy_version 1677462 (0.0009) [2023-12-26 13:04:46,559][123090] Updated weights for policy 1, policy_version 1677472 (0.0009) [2023-12-26 13:04:46,820][123091] Updated weights for policy 0, policy_version 1688727 (0.0007) [2023-12-26 13:04:46,879][123091] Updated weights for policy 0, policy_version 1688738 (0.0010) [2023-12-26 13:04:46,942][123091] Updated weights for policy 0, policy_version 1688748 (0.0009) [2023-12-26 13:04:47,353][123090] Updated weights for policy 1, policy_version 1677482 (0.0009) [2023-12-26 13:04:47,401][123090] Updated weights for policy 1, policy_version 1677492 (0.0005) [2023-12-26 13:04:47,449][123090] Updated weights for policy 1, policy_version 1677502 (0.0005) [2023-12-26 13:04:47,682][123091] Updated weights for policy 0, policy_version 1688758 (0.0007) [2023-12-26 13:04:47,732][123091] Updated weights for policy 0, policy_version 1688768 (0.0005) [2023-12-26 13:04:47,778][123091] Updated weights for policy 0, policy_version 1688778 (0.0005) [2023-12-26 13:04:48,159][123090] Updated weights for policy 1, policy_version 1677512 (0.0005) [2023-12-26 13:04:48,222][123090] Updated weights for policy 1, policy_version 1677522 (0.0005) [2023-12-26 13:04:48,282][123090] Updated weights for policy 1, policy_version 1677532 (0.0005) [2023-12-26 13:04:48,546][123091] Updated weights for policy 0, policy_version 1688788 (0.0007) [2023-12-26 13:04:48,611][123091] Updated weights for policy 0, policy_version 1688798 (0.0009) [2023-12-26 13:04:48,676][123091] Updated weights for policy 0, policy_version 1688808 (0.0009) [2023-12-26 13:04:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 861790208. Throughput: 0: 8815.2, 1: 8860.8. Samples: 861799788. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:48,785][121949] Avg episode reward: [(0, '5895.836'), (1, '5862.118')] [2023-12-26 13:04:49,031][123090] Updated weights for policy 1, policy_version 1677542 (0.0008) [2023-12-26 13:04:49,085][123090] Updated weights for policy 1, policy_version 1677552 (0.0010) [2023-12-26 13:04:49,144][123090] Updated weights for policy 1, policy_version 1677562 (0.0010) [2023-12-26 13:04:49,300][123091] Updated weights for policy 0, policy_version 1688818 (0.0006) [2023-12-26 13:04:49,363][123091] Updated weights for policy 0, policy_version 1688828 (0.0009) [2023-12-26 13:04:49,433][123091] Updated weights for policy 0, policy_version 1688838 (0.0010) [2023-12-26 13:04:49,484][123091] Updated weights for policy 0, policy_version 1688848 (0.0009) [2023-12-26 13:04:50,033][123090] Updated weights for policy 1, policy_version 1677572 (0.0008) [2023-12-26 13:04:50,095][123090] Updated weights for policy 1, policy_version 1677582 (0.0006) [2023-12-26 13:04:50,157][123090] Updated weights for policy 1, policy_version 1677592 (0.0006) [2023-12-26 13:04:50,333][123091] Updated weights for policy 0, policy_version 1688858 (0.0009) [2023-12-26 13:04:50,388][123091] Updated weights for policy 0, policy_version 1688868 (0.0009) [2023-12-26 13:04:50,439][123091] Updated weights for policy 0, policy_version 1688878 (0.0009) [2023-12-26 13:04:50,930][123090] Updated weights for policy 1, policy_version 1677602 (0.0005) [2023-12-26 13:04:50,994][123090] Updated weights for policy 1, policy_version 1677612 (0.0009) [2023-12-26 13:04:51,060][123090] Updated weights for policy 1, policy_version 1677622 (0.0009) [2023-12-26 13:04:51,121][123090] Updated weights for policy 1, policy_version 1677632 (0.0010) [2023-12-26 13:04:51,365][123091] Updated weights for policy 0, policy_version 1688888 (0.0009) [2023-12-26 13:04:51,431][123091] Updated weights for policy 0, policy_version 1688898 (0.0006) [2023-12-26 13:04:51,485][123091] Updated weights for policy 0, policy_version 1688908 (0.0006) [2023-12-26 13:04:51,999][123090] Updated weights for policy 1, policy_version 1677642 (0.0009) [2023-12-26 13:04:52,060][123090] Updated weights for policy 1, policy_version 1677652 (0.0009) [2023-12-26 13:04:52,116][123090] Updated weights for policy 1, policy_version 1677662 (0.0010) [2023-12-26 13:04:52,220][123091] Updated weights for policy 0, policy_version 1688918 (0.0008) [2023-12-26 13:04:52,275][123091] Updated weights for policy 0, policy_version 1688928 (0.0010) [2023-12-26 13:04:52,333][123091] Updated weights for policy 0, policy_version 1688938 (0.0009) [2023-12-26 13:04:52,903][123090] Updated weights for policy 1, policy_version 1677672 (0.0009) [2023-12-26 13:04:52,956][123090] Updated weights for policy 1, policy_version 1677682 (0.0008) [2023-12-26 13:04:53,010][123090] Updated weights for policy 1, policy_version 1677692 (0.0010) [2023-12-26 13:04:53,113][123091] Updated weights for policy 0, policy_version 1688948 (0.0008) [2023-12-26 13:04:53,175][123091] Updated weights for policy 0, policy_version 1688958 (0.0005) [2023-12-26 13:04:53,224][123091] Updated weights for policy 0, policy_version 1688968 (0.0009) [2023-12-26 13:04:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 861872128. Throughput: 0: 8754.0, 1: 8836.0. Samples: 861850856. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:53,785][121949] Avg episode reward: [(0, '5839.292'), (1, '5957.490')] [2023-12-26 13:04:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001688976_432381952.pth... [2023-12-26 13:04:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001677696_429490176.pth... [2023-12-26 13:04:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001676672_429228032.pth [2023-12-26 13:04:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001687952_432119808.pth [2023-12-26 13:04:53,922][123090] Updated weights for policy 1, policy_version 1677702 (0.0010) [2023-12-26 13:04:53,946][123091] Updated weights for policy 0, policy_version 1688978 (0.0009) [2023-12-26 13:04:53,989][123090] Updated weights for policy 1, policy_version 1677712 (0.0011) [2023-12-26 13:04:54,007][123091] Updated weights for policy 0, policy_version 1688988 (0.0006) [2023-12-26 13:04:54,056][123090] Updated weights for policy 1, policy_version 1677722 (0.0010) [2023-12-26 13:04:54,073][123091] Updated weights for policy 0, policy_version 1688998 (0.0008) [2023-12-26 13:04:54,140][123091] Updated weights for policy 0, policy_version 1689008 (0.0006) [2023-12-26 13:04:54,822][123090] Updated weights for policy 1, policy_version 1677732 (0.0010) [2023-12-26 13:04:54,845][123091] Updated weights for policy 0, policy_version 1689018 (0.0006) [2023-12-26 13:04:54,881][123090] Updated weights for policy 1, policy_version 1677742 (0.0010) [2023-12-26 13:04:54,893][123091] Updated weights for policy 0, policy_version 1689028 (0.0008) [2023-12-26 13:04:54,940][123090] Updated weights for policy 1, policy_version 1677752 (0.0010) [2023-12-26 13:04:54,943][123091] Updated weights for policy 0, policy_version 1689038 (0.0008) [2023-12-26 13:04:55,662][123090] Updated weights for policy 1, policy_version 1677762 (0.0010) [2023-12-26 13:04:55,706][123091] Updated weights for policy 0, policy_version 1689048 (0.0006) [2023-12-26 13:04:55,722][123090] Updated weights for policy 1, policy_version 1677772 (0.0006) [2023-12-26 13:04:55,753][123091] Updated weights for policy 0, policy_version 1689058 (0.0005) [2023-12-26 13:04:55,779][123090] Updated weights for policy 1, policy_version 1677782 (0.0005) [2023-12-26 13:04:55,799][123091] Updated weights for policy 0, policy_version 1689068 (0.0006) [2023-12-26 13:04:55,835][123090] Updated weights for policy 1, policy_version 1677792 (0.0006) [2023-12-26 13:04:56,489][123091] Updated weights for policy 0, policy_version 1689078 (0.0006) [2023-12-26 13:04:56,499][123090] Updated weights for policy 1, policy_version 1677802 (0.0006) [2023-12-26 13:04:56,551][123091] Updated weights for policy 0, policy_version 1689088 (0.0006) [2023-12-26 13:04:56,561][123090] Updated weights for policy 1, policy_version 1677812 (0.0007) [2023-12-26 13:04:56,615][123091] Updated weights for policy 0, policy_version 1689098 (0.0007) [2023-12-26 13:04:56,625][123090] Updated weights for policy 1, policy_version 1677822 (0.0006) [2023-12-26 13:04:57,202][123091] Updated weights for policy 0, policy_version 1689108 (0.0008) [2023-12-26 13:04:57,262][123091] Updated weights for policy 0, policy_version 1689118 (0.0009) [2023-12-26 13:04:57,276][123090] Updated weights for policy 1, policy_version 1677832 (0.0006) [2023-12-26 13:04:57,324][123091] Updated weights for policy 0, policy_version 1689128 (0.0008) [2023-12-26 13:04:57,339][123090] Updated weights for policy 1, policy_version 1677842 (0.0006) [2023-12-26 13:04:57,412][123090] Updated weights for policy 1, policy_version 1677852 (0.0008) [2023-12-26 13:04:58,056][123090] Updated weights for policy 1, policy_version 1677862 (0.0007) [2023-12-26 13:04:58,107][123091] Updated weights for policy 0, policy_version 1689138 (0.0006) [2023-12-26 13:04:58,127][123090] Updated weights for policy 1, policy_version 1677872 (0.0007) [2023-12-26 13:04:58,167][123091] Updated weights for policy 0, policy_version 1689148 (0.0010) [2023-12-26 13:04:58,200][123090] Updated weights for policy 1, policy_version 1677882 (0.0008) [2023-12-26 13:04:58,234][123091] Updated weights for policy 0, policy_version 1689158 (0.0011) [2023-12-26 13:04:58,304][123091] Updated weights for policy 0, policy_version 1689168 (0.0011) [2023-12-26 13:04:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.8, 300 sec: 17772.5). Total num frames: 861970432. Throughput: 0: 8840.8, 1: 8950.1. Samples: 861965376. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:04:58,785][121949] Avg episode reward: [(0, '5902.022'), (1, '6035.938')] [2023-12-26 13:04:59,060][123090] Updated weights for policy 1, policy_version 1677892 (0.0009) [2023-12-26 13:04:59,113][123090] Updated weights for policy 1, policy_version 1677902 (0.0010) [2023-12-26 13:04:59,161][123090] Updated weights for policy 1, policy_version 1677912 (0.0009) [2023-12-26 13:04:59,171][123091] Updated weights for policy 0, policy_version 1689178 (0.0010) [2023-12-26 13:04:59,240][123091] Updated weights for policy 0, policy_version 1689188 (0.0010) [2023-12-26 13:04:59,299][123091] Updated weights for policy 0, policy_version 1689198 (0.0011) [2023-12-26 13:04:59,938][123090] Updated weights for policy 1, policy_version 1677922 (0.0009) [2023-12-26 13:05:00,005][123090] Updated weights for policy 1, policy_version 1677932 (0.0006) [2023-12-26 13:05:00,070][123090] Updated weights for policy 1, policy_version 1677942 (0.0006) [2023-12-26 13:05:00,079][123091] Updated weights for policy 0, policy_version 1689208 (0.0009) [2023-12-26 13:05:00,128][123090] Updated weights for policy 1, policy_version 1677952 (0.0010) [2023-12-26 13:05:00,140][123091] Updated weights for policy 0, policy_version 1689218 (0.0007) [2023-12-26 13:05:00,197][123091] Updated weights for policy 0, policy_version 1689228 (0.0007) [2023-12-26 13:05:00,850][123090] Updated weights for policy 1, policy_version 1677962 (0.0008) [2023-12-26 13:05:00,898][123090] Updated weights for policy 1, policy_version 1677972 (0.0011) [2023-12-26 13:05:00,968][123090] Updated weights for policy 1, policy_version 1677982 (0.0009) [2023-12-26 13:05:01,053][123091] Updated weights for policy 0, policy_version 1689238 (0.0007) [2023-12-26 13:05:01,117][123091] Updated weights for policy 0, policy_version 1689248 (0.0009) [2023-12-26 13:05:01,179][123091] Updated weights for policy 0, policy_version 1689258 (0.0009) [2023-12-26 13:05:01,765][123090] Updated weights for policy 1, policy_version 1677992 (0.0009) [2023-12-26 13:05:01,824][123090] Updated weights for policy 1, policy_version 1678002 (0.0010) [2023-12-26 13:05:01,876][123090] Updated weights for policy 1, policy_version 1678012 (0.0010) [2023-12-26 13:05:02,067][123091] Updated weights for policy 0, policy_version 1689268 (0.0010) [2023-12-26 13:05:02,128][123091] Updated weights for policy 0, policy_version 1689278 (0.0010) [2023-12-26 13:05:02,175][123091] Updated weights for policy 0, policy_version 1689288 (0.0005) [2023-12-26 13:05:02,712][123090] Updated weights for policy 1, policy_version 1678022 (0.0007) [2023-12-26 13:05:02,777][123090] Updated weights for policy 1, policy_version 1678032 (0.0006) [2023-12-26 13:05:02,837][123090] Updated weights for policy 1, policy_version 1678042 (0.0005) [2023-12-26 13:05:02,982][123091] Updated weights for policy 0, policy_version 1689298 (0.0006) [2023-12-26 13:05:03,044][123091] Updated weights for policy 0, policy_version 1689308 (0.0009) [2023-12-26 13:05:03,103][123091] Updated weights for policy 0, policy_version 1689318 (0.0009) [2023-12-26 13:05:03,164][123091] Updated weights for policy 0, policy_version 1689328 (0.0009) [2023-12-26 13:05:03,525][123090] Updated weights for policy 1, policy_version 1678052 (0.0005) [2023-12-26 13:05:03,574][123090] Updated weights for policy 1, policy_version 1678062 (0.0005) [2023-12-26 13:05:03,631][123090] Updated weights for policy 1, policy_version 1678072 (0.0007) [2023-12-26 13:05:03,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 862060544. Throughput: 0: 8854.2, 1: 8962.5. Samples: 862071524. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:03,785][121949] Avg episode reward: [(0, '5903.844'), (1, '6081.116')] [2023-12-26 13:05:04,022][123091] Updated weights for policy 0, policy_version 1689338 (0.0006) [2023-12-26 13:05:04,093][123091] Updated weights for policy 0, policy_version 1689348 (0.0006) [2023-12-26 13:05:04,157][123091] Updated weights for policy 0, policy_version 1689358 (0.0009) [2023-12-26 13:05:04,272][123090] Updated weights for policy 1, policy_version 1678082 (0.0006) [2023-12-26 13:05:04,333][123090] Updated weights for policy 1, policy_version 1678092 (0.0005) [2023-12-26 13:05:04,406][123090] Updated weights for policy 1, policy_version 1678102 (0.0006) [2023-12-26 13:05:04,476][123090] Updated weights for policy 1, policy_version 1678112 (0.0009) [2023-12-26 13:05:04,956][123091] Updated weights for policy 0, policy_version 1689368 (0.0009) [2023-12-26 13:05:05,023][123091] Updated weights for policy 0, policy_version 1689378 (0.0010) [2023-12-26 13:05:05,085][123091] Updated weights for policy 0, policy_version 1689388 (0.0009) [2023-12-26 13:05:05,193][123090] Updated weights for policy 1, policy_version 1678122 (0.0010) [2023-12-26 13:05:05,254][123090] Updated weights for policy 1, policy_version 1678132 (0.0009) [2023-12-26 13:05:05,308][123090] Updated weights for policy 1, policy_version 1678143 (0.0010) [2023-12-26 13:05:05,796][123091] Updated weights for policy 0, policy_version 1689398 (0.0007) [2023-12-26 13:05:05,867][123091] Updated weights for policy 0, policy_version 1689408 (0.0005) [2023-12-26 13:05:05,920][123091] Updated weights for policy 0, policy_version 1689418 (0.0005) [2023-12-26 13:05:06,118][123090] Updated weights for policy 1, policy_version 1678153 (0.0007) [2023-12-26 13:05:06,181][123090] Updated weights for policy 1, policy_version 1678163 (0.0008) [2023-12-26 13:05:06,248][123090] Updated weights for policy 1, policy_version 1678173 (0.0008) [2023-12-26 13:05:06,644][123091] Updated weights for policy 0, policy_version 1689428 (0.0005) [2023-12-26 13:05:06,692][123091] Updated weights for policy 0, policy_version 1689438 (0.0005) [2023-12-26 13:05:06,760][123091] Updated weights for policy 0, policy_version 1689448 (0.0006) [2023-12-26 13:05:07,084][123090] Updated weights for policy 1, policy_version 1678183 (0.0010) [2023-12-26 13:05:07,142][123090] Updated weights for policy 1, policy_version 1678193 (0.0010) [2023-12-26 13:05:07,208][123090] Updated weights for policy 1, policy_version 1678203 (0.0010) [2023-12-26 13:05:07,535][123091] Updated weights for policy 0, policy_version 1689458 (0.0006) [2023-12-26 13:05:07,597][123091] Updated weights for policy 0, policy_version 1689468 (0.0010) [2023-12-26 13:05:07,666][123091] Updated weights for policy 0, policy_version 1689478 (0.0009) [2023-12-26 13:05:07,729][123091] Updated weights for policy 0, policy_version 1689488 (0.0009) [2023-12-26 13:05:08,015][123090] Updated weights for policy 1, policy_version 1678213 (0.0010) [2023-12-26 13:05:08,067][123090] Updated weights for policy 1, policy_version 1678224 (0.0009) [2023-12-26 13:05:08,121][123090] Updated weights for policy 1, policy_version 1678234 (0.0009) [2023-12-26 13:05:08,559][123091] Updated weights for policy 0, policy_version 1689498 (0.0010) [2023-12-26 13:05:08,611][123091] Updated weights for policy 0, policy_version 1689508 (0.0009) [2023-12-26 13:05:08,667][123091] Updated weights for policy 0, policy_version 1689518 (0.0010) [2023-12-26 13:05:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 862150656. Throughput: 0: 8909.8, 1: 8999.3. Samples: 862126404. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:08,785][121949] Avg episode reward: [(0, '5784.585'), (1, '6094.747')] [2023-12-26 13:05:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001689520_432521216.pth... [2023-12-26 13:05:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001678240_429629440.pth... [2023-12-26 13:05:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001688464_432250880.pth [2023-12-26 13:05:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001677184_429359104.pth [2023-12-26 13:05:08,899][123090] Updated weights for policy 1, policy_version 1678244 (0.0008) [2023-12-26 13:05:08,952][123090] Updated weights for policy 1, policy_version 1678254 (0.0005) [2023-12-26 13:05:09,024][123090] Updated weights for policy 1, policy_version 1678265 (0.0007) [2023-12-26 13:05:09,586][123091] Updated weights for policy 0, policy_version 1689528 (0.0010) [2023-12-26 13:05:09,653][123091] Updated weights for policy 0, policy_version 1689538 (0.0009) [2023-12-26 13:05:09,726][123091] Updated weights for policy 0, policy_version 1689548 (0.0010) [2023-12-26 13:05:09,831][123090] Updated weights for policy 1, policy_version 1678275 (0.0009) [2023-12-26 13:05:09,900][123090] Updated weights for policy 1, policy_version 1678285 (0.0009) [2023-12-26 13:05:09,968][123090] Updated weights for policy 1, policy_version 1678295 (0.0009) [2023-12-26 13:05:10,387][123091] Updated weights for policy 0, policy_version 1689558 (0.0007) [2023-12-26 13:05:10,443][123091] Updated weights for policy 0, policy_version 1689568 (0.0005) [2023-12-26 13:05:10,507][123091] Updated weights for policy 0, policy_version 1689578 (0.0006) [2023-12-26 13:05:10,846][123090] Updated weights for policy 1, policy_version 1678305 (0.0006) [2023-12-26 13:05:10,915][123090] Updated weights for policy 1, policy_version 1678315 (0.0010) [2023-12-26 13:05:10,986][123090] Updated weights for policy 1, policy_version 1678325 (0.0010) [2023-12-26 13:05:11,060][123090] Updated weights for policy 1, policy_version 1678335 (0.0010) [2023-12-26 13:05:11,141][123091] Updated weights for policy 0, policy_version 1689588 (0.0007) [2023-12-26 13:05:11,212][123091] Updated weights for policy 0, policy_version 1689598 (0.0008) [2023-12-26 13:05:11,285][123091] Updated weights for policy 0, policy_version 1689608 (0.0009) [2023-12-26 13:05:11,940][123090] Updated weights for policy 1, policy_version 1678345 (0.0006) [2023-12-26 13:05:11,998][123090] Updated weights for policy 1, policy_version 1678356 (0.0010) [2023-12-26 13:05:12,068][123090] Updated weights for policy 1, policy_version 1678366 (0.0009) [2023-12-26 13:05:12,095][123091] Updated weights for policy 0, policy_version 1689618 (0.0010) [2023-12-26 13:05:12,155][123091] Updated weights for policy 0, policy_version 1689628 (0.0009) [2023-12-26 13:05:12,219][123091] Updated weights for policy 0, policy_version 1689638 (0.0009) [2023-12-26 13:05:12,289][123091] Updated weights for policy 0, policy_version 1689648 (0.0009) [2023-12-26 13:05:12,875][123090] Updated weights for policy 1, policy_version 1678376 (0.0010) [2023-12-26 13:05:12,949][123090] Updated weights for policy 1, policy_version 1678386 (0.0009) [2023-12-26 13:05:13,013][123090] Updated weights for policy 1, policy_version 1678396 (0.0009) [2023-12-26 13:05:13,126][123091] Updated weights for policy 0, policy_version 1689658 (0.0010) [2023-12-26 13:05:13,175][123091] Updated weights for policy 0, policy_version 1689668 (0.0009) [2023-12-26 13:05:13,227][123091] Updated weights for policy 0, policy_version 1689678 (0.0009) [2023-12-26 13:05:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 862232576. Throughput: 0: 8912.5, 1: 9034.7. Samples: 862230948. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:13,785][121949] Avg episode reward: [(0, '5890.857'), (1, '5932.458')] [2023-12-26 13:05:13,824][123090] Updated weights for policy 1, policy_version 1678406 (0.0009) [2023-12-26 13:05:13,876][123090] Updated weights for policy 1, policy_version 1678416 (0.0009) [2023-12-26 13:05:13,925][123090] Updated weights for policy 1, policy_version 1678426 (0.0008) [2023-12-26 13:05:14,089][123091] Updated weights for policy 0, policy_version 1689688 (0.0011) [2023-12-26 13:05:14,153][123091] Updated weights for policy 0, policy_version 1689698 (0.0011) [2023-12-26 13:05:14,218][123091] Updated weights for policy 0, policy_version 1689708 (0.0010) [2023-12-26 13:05:14,824][123090] Updated weights for policy 1, policy_version 1678436 (0.0009) [2023-12-26 13:05:14,893][123090] Updated weights for policy 1, policy_version 1678446 (0.0005) [2023-12-26 13:05:14,969][123090] Updated weights for policy 1, policy_version 1678456 (0.0009) [2023-12-26 13:05:14,976][123091] Updated weights for policy 0, policy_version 1689718 (0.0008) [2023-12-26 13:05:15,045][123091] Updated weights for policy 0, policy_version 1689728 (0.0006) [2023-12-26 13:05:15,114][123091] Updated weights for policy 0, policy_version 1689738 (0.0006) [2023-12-26 13:05:15,774][123090] Updated weights for policy 1, policy_version 1678466 (0.0009) [2023-12-26 13:05:15,821][123090] Updated weights for policy 1, policy_version 1678476 (0.0008) [2023-12-26 13:05:15,869][123090] Updated weights for policy 1, policy_version 1678486 (0.0008) [2023-12-26 13:05:15,902][123091] Updated weights for policy 0, policy_version 1689748 (0.0010) [2023-12-26 13:05:15,929][123090] Updated weights for policy 1, policy_version 1678496 (0.0007) [2023-12-26 13:05:15,957][123091] Updated weights for policy 0, policy_version 1689758 (0.0010) [2023-12-26 13:05:16,012][123091] Updated weights for policy 0, policy_version 1689768 (0.0010) [2023-12-26 13:05:16,718][123091] Updated weights for policy 0, policy_version 1689778 (0.0010) [2023-12-26 13:05:16,773][123091] Updated weights for policy 0, policy_version 1689788 (0.0010) [2023-12-26 13:05:16,792][123090] Updated weights for policy 1, policy_version 1678506 (0.0008) [2023-12-26 13:05:16,823][123091] Updated weights for policy 0, policy_version 1689798 (0.0009) [2023-12-26 13:05:16,848][123090] Updated weights for policy 1, policy_version 1678516 (0.0007) [2023-12-26 13:05:16,881][123091] Updated weights for policy 0, policy_version 1689808 (0.0007) [2023-12-26 13:05:16,909][123090] Updated weights for policy 1, policy_version 1678526 (0.0009) [2023-12-26 13:05:17,569][123091] Updated weights for policy 0, policy_version 1689818 (0.0008) [2023-12-26 13:05:17,635][123091] Updated weights for policy 0, policy_version 1689828 (0.0009) [2023-12-26 13:05:17,695][123091] Updated weights for policy 0, policy_version 1689838 (0.0005) [2023-12-26 13:05:17,775][123090] Updated weights for policy 1, policy_version 1678536 (0.0008) [2023-12-26 13:05:17,827][123090] Updated weights for policy 1, policy_version 1678546 (0.0010) [2023-12-26 13:05:17,875][123090] Updated weights for policy 1, policy_version 1678556 (0.0010) [2023-12-26 13:05:18,481][123091] Updated weights for policy 0, policy_version 1689848 (0.0009) [2023-12-26 13:05:18,541][123091] Updated weights for policy 0, policy_version 1689858 (0.0011) [2023-12-26 13:05:18,603][123091] Updated weights for policy 0, policy_version 1689868 (0.0010) [2023-12-26 13:05:18,678][123090] Updated weights for policy 1, policy_version 1678566 (0.0007) [2023-12-26 13:05:18,743][123090] Updated weights for policy 1, policy_version 1678576 (0.0005) [2023-12-26 13:05:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 862322688. Throughput: 0: 8955.6, 1: 8939.3. Samples: 862336480. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:18,785][121949] Avg episode reward: [(0, '5871.976'), (1, '5929.507')] [2023-12-26 13:05:18,800][123090] Updated weights for policy 1, policy_version 1678586 (0.0005) [2023-12-26 13:05:19,349][123091] Updated weights for policy 0, policy_version 1689878 (0.0006) [2023-12-26 13:05:19,415][123091] Updated weights for policy 0, policy_version 1689888 (0.0009) [2023-12-26 13:05:19,447][123090] Updated weights for policy 1, policy_version 1678596 (0.0006) [2023-12-26 13:05:19,475][123091] Updated weights for policy 0, policy_version 1689899 (0.0010) [2023-12-26 13:05:19,515][123090] Updated weights for policy 1, policy_version 1678606 (0.0008) [2023-12-26 13:05:19,586][123090] Updated weights for policy 1, policy_version 1678616 (0.0008) [2023-12-26 13:05:20,301][123091] Updated weights for policy 0, policy_version 1689909 (0.0008) [2023-12-26 13:05:20,354][123091] Updated weights for policy 0, policy_version 1689919 (0.0008) [2023-12-26 13:05:20,403][123090] Updated weights for policy 1, policy_version 1678626 (0.0008) [2023-12-26 13:05:20,421][123091] Updated weights for policy 0, policy_version 1689929 (0.0010) [2023-12-26 13:05:20,468][123090] Updated weights for policy 1, policy_version 1678636 (0.0007) [2023-12-26 13:05:20,533][123090] Updated weights for policy 1, policy_version 1678646 (0.0009) [2023-12-26 13:05:20,602][123090] Updated weights for policy 1, policy_version 1678656 (0.0010) [2023-12-26 13:05:21,263][123091] Updated weights for policy 0, policy_version 1689939 (0.0010) [2023-12-26 13:05:21,334][123091] Updated weights for policy 0, policy_version 1689949 (0.0009) [2023-12-26 13:05:21,406][123091] Updated weights for policy 0, policy_version 1689959 (0.0010) [2023-12-26 13:05:21,465][123090] Updated weights for policy 1, policy_version 1678666 (0.0009) [2023-12-26 13:05:21,533][123090] Updated weights for policy 1, policy_version 1678676 (0.0009) [2023-12-26 13:05:21,610][123090] Updated weights for policy 1, policy_version 1678686 (0.0010) [2023-12-26 13:05:22,180][123091] Updated weights for policy 0, policy_version 1689969 (0.0009) [2023-12-26 13:05:22,246][123091] Updated weights for policy 0, policy_version 1689979 (0.0009) [2023-12-26 13:05:22,310][123091] Updated weights for policy 0, policy_version 1689989 (0.0009) [2023-12-26 13:05:22,383][123091] Updated weights for policy 0, policy_version 1689999 (0.0009) [2023-12-26 13:05:22,458][123090] Updated weights for policy 1, policy_version 1678696 (0.0006) [2023-12-26 13:05:22,523][123090] Updated weights for policy 1, policy_version 1678706 (0.0008) [2023-12-26 13:05:22,589][123090] Updated weights for policy 1, policy_version 1678716 (0.0009) [2023-12-26 13:05:23,224][123091] Updated weights for policy 0, policy_version 1690009 (0.0006) [2023-12-26 13:05:23,292][123091] Updated weights for policy 0, policy_version 1690019 (0.0006) [2023-12-26 13:05:23,361][123091] Updated weights for policy 0, policy_version 1690029 (0.0005) [2023-12-26 13:05:23,404][123090] Updated weights for policy 1, policy_version 1678726 (0.0009) [2023-12-26 13:05:23,474][123090] Updated weights for policy 1, policy_version 1678736 (0.0007) [2023-12-26 13:05:23,547][123090] Updated weights for policy 1, policy_version 1678746 (0.0006) [2023-12-26 13:05:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 862412800. Throughput: 0: 8958.8, 1: 8841.7. Samples: 862389000. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:23,786][121949] Avg episode reward: [(0, '5820.535'), (1, '5999.404')] [2023-12-26 13:05:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001690032_432652288.pth... [2023-12-26 13:05:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001678752_429760512.pth... [2023-12-26 13:05:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001688976_432381952.pth [2023-12-26 13:05:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001677696_429490176.pth [2023-12-26 13:05:24,113][123091] Updated weights for policy 0, policy_version 1690039 (0.0009) [2023-12-26 13:05:24,172][123091] Updated weights for policy 0, policy_version 1690049 (0.0009) [2023-12-26 13:05:24,191][123090] Updated weights for policy 1, policy_version 1678756 (0.0009) [2023-12-26 13:05:24,234][123091] Updated weights for policy 0, policy_version 1690059 (0.0008) [2023-12-26 13:05:24,257][123090] Updated weights for policy 1, policy_version 1678766 (0.0008) [2023-12-26 13:05:24,324][123090] Updated weights for policy 1, policy_version 1678776 (0.0008) [2023-12-26 13:05:25,000][123091] Updated weights for policy 0, policy_version 1690069 (0.0010) [2023-12-26 13:05:25,047][123091] Updated weights for policy 0, policy_version 1690079 (0.0008) [2023-12-26 13:05:25,100][123090] Updated weights for policy 1, policy_version 1678786 (0.0007) [2023-12-26 13:05:25,102][123091] Updated weights for policy 0, policy_version 1690089 (0.0009) [2023-12-26 13:05:25,159][123090] Updated weights for policy 1, policy_version 1678796 (0.0011) [2023-12-26 13:05:25,218][123090] Updated weights for policy 1, policy_version 1678806 (0.0010) [2023-12-26 13:05:25,285][123090] Updated weights for policy 1, policy_version 1678816 (0.0010) [2023-12-26 13:05:25,949][123091] Updated weights for policy 0, policy_version 1690099 (0.0007) [2023-12-26 13:05:26,002][123091] Updated weights for policy 0, policy_version 1690109 (0.0009) [2023-12-26 13:05:26,061][123091] Updated weights for policy 0, policy_version 1690119 (0.0009) [2023-12-26 13:05:26,094][123090] Updated weights for policy 1, policy_version 1678826 (0.0011) [2023-12-26 13:05:26,150][123090] Updated weights for policy 1, policy_version 1678836 (0.0010) [2023-12-26 13:05:26,216][123090] Updated weights for policy 1, policy_version 1678846 (0.0010) [2023-12-26 13:05:26,835][123091] Updated weights for policy 0, policy_version 1690129 (0.0007) [2023-12-26 13:05:26,882][123091] Updated weights for policy 0, policy_version 1690139 (0.0008) [2023-12-26 13:05:26,930][123091] Updated weights for policy 0, policy_version 1690149 (0.0009) [2023-12-26 13:05:26,978][123091] Updated weights for policy 0, policy_version 1690159 (0.0008) [2023-12-26 13:05:27,052][123090] Updated weights for policy 1, policy_version 1678856 (0.0010) [2023-12-26 13:05:27,114][123090] Updated weights for policy 1, policy_version 1678866 (0.0010) [2023-12-26 13:05:27,176][123090] Updated weights for policy 1, policy_version 1678876 (0.0010) [2023-12-26 13:05:27,830][123091] Updated weights for policy 0, policy_version 1690169 (0.0009) [2023-12-26 13:05:27,882][123091] Updated weights for policy 0, policy_version 1690179 (0.0009) [2023-12-26 13:05:27,939][123091] Updated weights for policy 0, policy_version 1690189 (0.0009) [2023-12-26 13:05:27,982][123090] Updated weights for policy 1, policy_version 1678886 (0.0009) [2023-12-26 13:05:28,035][123090] Updated weights for policy 1, policy_version 1678896 (0.0008) [2023-12-26 13:05:28,097][123090] Updated weights for policy 1, policy_version 1678906 (0.0009) [2023-12-26 13:05:28,766][123091] Updated weights for policy 0, policy_version 1690199 (0.0009) [2023-12-26 13:05:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 862494720. Throughput: 0: 8969.1, 1: 8857.4. Samples: 862494888. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:28,784][121949] Avg episode reward: [(0, '5940.786'), (1, '5999.150')] [2023-12-26 13:05:28,831][123091] Updated weights for policy 0, policy_version 1690209 (0.0010) [2023-12-26 13:05:28,901][123091] Updated weights for policy 0, policy_version 1690219 (0.0009) [2023-12-26 13:05:28,951][123090] Updated weights for policy 1, policy_version 1678916 (0.0010) [2023-12-26 13:05:29,013][123090] Updated weights for policy 1, policy_version 1678926 (0.0009) [2023-12-26 13:05:29,077][123090] Updated weights for policy 1, policy_version 1678936 (0.0010) [2023-12-26 13:05:29,732][123091] Updated weights for policy 0, policy_version 1690229 (0.0010) [2023-12-26 13:05:29,796][123091] Updated weights for policy 0, policy_version 1690239 (0.0010) [2023-12-26 13:05:29,861][123091] Updated weights for policy 0, policy_version 1690249 (0.0008) [2023-12-26 13:05:29,896][123090] Updated weights for policy 1, policy_version 1678946 (0.0010) [2023-12-26 13:05:29,957][123090] Updated weights for policy 1, policy_version 1678956 (0.0009) [2023-12-26 13:05:30,017][123090] Updated weights for policy 1, policy_version 1678966 (0.0010) [2023-12-26 13:05:30,068][123090] Updated weights for policy 1, policy_version 1678976 (0.0008) [2023-12-26 13:05:30,659][123091] Updated weights for policy 0, policy_version 1690259 (0.0006) [2023-12-26 13:05:30,719][123091] Updated weights for policy 0, policy_version 1690269 (0.0005) [2023-12-26 13:05:30,786][123091] Updated weights for policy 0, policy_version 1690279 (0.0005) [2023-12-26 13:05:30,934][123090] Updated weights for policy 1, policy_version 1678986 (0.0010) [2023-12-26 13:05:30,993][123090] Updated weights for policy 1, policy_version 1678996 (0.0010) [2023-12-26 13:05:31,053][123090] Updated weights for policy 1, policy_version 1679006 (0.0011) [2023-12-26 13:05:31,548][123091] Updated weights for policy 0, policy_version 1690289 (0.0006) [2023-12-26 13:05:31,609][123091] Updated weights for policy 0, policy_version 1690299 (0.0009) [2023-12-26 13:05:31,676][123091] Updated weights for policy 0, policy_version 1690309 (0.0009) [2023-12-26 13:05:31,738][123091] Updated weights for policy 0, policy_version 1690319 (0.0009) [2023-12-26 13:05:31,915][123090] Updated weights for policy 1, policy_version 1679016 (0.0011) [2023-12-26 13:05:31,974][123090] Updated weights for policy 1, policy_version 1679026 (0.0010) [2023-12-26 13:05:32,029][123090] Updated weights for policy 1, policy_version 1679036 (0.0010) [2023-12-26 13:05:32,571][123091] Updated weights for policy 0, policy_version 1690329 (0.0009) [2023-12-26 13:05:32,636][123091] Updated weights for policy 0, policy_version 1690339 (0.0009) [2023-12-26 13:05:32,703][123091] Updated weights for policy 0, policy_version 1690349 (0.0009) [2023-12-26 13:05:32,847][123090] Updated weights for policy 1, policy_version 1679046 (0.0010) [2023-12-26 13:05:32,908][123090] Updated weights for policy 1, policy_version 1679056 (0.0010) [2023-12-26 13:05:32,967][123090] Updated weights for policy 1, policy_version 1679066 (0.0010) [2023-12-26 13:05:33,530][123091] Updated weights for policy 0, policy_version 1690359 (0.0009) [2023-12-26 13:05:33,582][123091] Updated weights for policy 0, policy_version 1690369 (0.0008) [2023-12-26 13:05:33,647][123091] Updated weights for policy 0, policy_version 1690379 (0.0009) [2023-12-26 13:05:33,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 862584832. Throughput: 0: 8930.0, 1: 8789.5. Samples: 862597164. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:33,784][121949] Avg episode reward: [(0, '5827.290'), (1, '5859.835')] [2023-12-26 13:05:33,790][123090] Updated weights for policy 1, policy_version 1679076 (0.0010) [2023-12-26 13:05:33,843][123090] Updated weights for policy 1, policy_version 1679086 (0.0010) [2023-12-26 13:05:33,897][123090] Updated weights for policy 1, policy_version 1679096 (0.0010) [2023-12-26 13:05:34,471][123091] Updated weights for policy 0, policy_version 1690389 (0.0010) [2023-12-26 13:05:34,535][123091] Updated weights for policy 0, policy_version 1690399 (0.0010) [2023-12-26 13:05:34,609][123091] Updated weights for policy 0, policy_version 1690409 (0.0006) [2023-12-26 13:05:34,736][123090] Updated weights for policy 1, policy_version 1679106 (0.0010) [2023-12-26 13:05:34,803][123090] Updated weights for policy 1, policy_version 1679116 (0.0011) [2023-12-26 13:05:34,870][123090] Updated weights for policy 1, policy_version 1679126 (0.0011) [2023-12-26 13:05:34,934][123090] Updated weights for policy 1, policy_version 1679136 (0.0010) [2023-12-26 13:05:35,215][123091] Updated weights for policy 0, policy_version 1690419 (0.0006) [2023-12-26 13:05:35,280][123091] Updated weights for policy 0, policy_version 1690429 (0.0005) [2023-12-26 13:05:35,327][123091] Updated weights for policy 0, policy_version 1690439 (0.0005) [2023-12-26 13:05:35,616][123090] Updated weights for policy 1, policy_version 1679146 (0.0005) [2023-12-26 13:05:35,687][123090] Updated weights for policy 1, policy_version 1679156 (0.0005) [2023-12-26 13:05:35,756][123090] Updated weights for policy 1, policy_version 1679166 (0.0005) [2023-12-26 13:05:35,976][123091] Updated weights for policy 0, policy_version 1690449 (0.0006) [2023-12-26 13:05:36,031][123091] Updated weights for policy 0, policy_version 1690459 (0.0010) [2023-12-26 13:05:36,095][123091] Updated weights for policy 0, policy_version 1690469 (0.0010) [2023-12-26 13:05:36,158][123091] Updated weights for policy 0, policy_version 1690479 (0.0009) [2023-12-26 13:05:36,436][123090] Updated weights for policy 1, policy_version 1679176 (0.0006) [2023-12-26 13:05:36,508][123090] Updated weights for policy 1, policy_version 1679186 (0.0007) [2023-12-26 13:05:36,581][123090] Updated weights for policy 1, policy_version 1679196 (0.0007) [2023-12-26 13:05:37,052][123091] Updated weights for policy 0, policy_version 1690489 (0.0009) [2023-12-26 13:05:37,116][123091] Updated weights for policy 0, policy_version 1690499 (0.0009) [2023-12-26 13:05:37,175][123091] Updated weights for policy 0, policy_version 1690509 (0.0008) [2023-12-26 13:05:37,236][123090] Updated weights for policy 1, policy_version 1679206 (0.0010) [2023-12-26 13:05:37,299][123090] Updated weights for policy 1, policy_version 1679216 (0.0010) [2023-12-26 13:05:37,364][123090] Updated weights for policy 1, policy_version 1679226 (0.0010) [2023-12-26 13:05:38,065][123091] Updated weights for policy 0, policy_version 1690519 (0.0008) [2023-12-26 13:05:38,073][123090] Updated weights for policy 1, policy_version 1679236 (0.0007) [2023-12-26 13:05:38,121][123091] Updated weights for policy 0, policy_version 1690529 (0.0008) [2023-12-26 13:05:38,130][123090] Updated weights for policy 1, policy_version 1679246 (0.0005) [2023-12-26 13:05:38,178][123091] Updated weights for policy 0, policy_version 1690539 (0.0009) [2023-12-26 13:05:38,181][123090] Updated weights for policy 1, policy_version 1679256 (0.0005) [2023-12-26 13:05:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 862674944. Throughput: 0: 8989.2, 1: 8858.7. Samples: 862654008. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:38,785][121949] Avg episode reward: [(0, '5854.902'), (1, '5936.484')] [2023-12-26 13:05:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001690544_432783360.pth... [2023-12-26 13:05:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001679264_429891584.pth... [2023-12-26 13:05:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001689520_432521216.pth [2023-12-26 13:05:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001678240_429629440.pth [2023-12-26 13:05:38,939][123090] Updated weights for policy 1, policy_version 1679266 (0.0006) [2023-12-26 13:05:38,998][123090] Updated weights for policy 1, policy_version 1679276 (0.0009) [2023-12-26 13:05:39,059][123090] Updated weights for policy 1, policy_version 1679286 (0.0010) [2023-12-26 13:05:39,082][123091] Updated weights for policy 0, policy_version 1690549 (0.0008) [2023-12-26 13:05:39,126][123090] Updated weights for policy 1, policy_version 1679296 (0.0009) [2023-12-26 13:05:39,139][123091] Updated weights for policy 0, policy_version 1690559 (0.0007) [2023-12-26 13:05:39,195][123091] Updated weights for policy 0, policy_version 1690569 (0.0010) [2023-12-26 13:05:39,972][123090] Updated weights for policy 1, policy_version 1679306 (0.0009) [2023-12-26 13:05:40,033][123090] Updated weights for policy 1, policy_version 1679316 (0.0009) [2023-12-26 13:05:40,054][123091] Updated weights for policy 0, policy_version 1690579 (0.0008) [2023-12-26 13:05:40,096][123090] Updated weights for policy 1, policy_version 1679326 (0.0009) [2023-12-26 13:05:40,117][123091] Updated weights for policy 0, policy_version 1690589 (0.0008) [2023-12-26 13:05:40,179][123091] Updated weights for policy 0, policy_version 1690599 (0.0010) [2023-12-26 13:05:40,947][123090] Updated weights for policy 1, policy_version 1679336 (0.0010) [2023-12-26 13:05:41,007][123090] Updated weights for policy 1, policy_version 1679346 (0.0007) [2023-12-26 13:05:41,019][123091] Updated weights for policy 0, policy_version 1690609 (0.0009) [2023-12-26 13:05:41,079][123090] Updated weights for policy 1, policy_version 1679356 (0.0007) [2023-12-26 13:05:41,088][123091] Updated weights for policy 0, policy_version 1690619 (0.0009) [2023-12-26 13:05:41,159][123091] Updated weights for policy 0, policy_version 1690629 (0.0010) [2023-12-26 13:05:41,221][123091] Updated weights for policy 0, policy_version 1690639 (0.0009) [2023-12-26 13:05:41,906][123090] Updated weights for policy 1, policy_version 1679366 (0.0008) [2023-12-26 13:05:41,960][123090] Updated weights for policy 1, policy_version 1679376 (0.0009) [2023-12-26 13:05:42,029][123090] Updated weights for policy 1, policy_version 1679386 (0.0009) [2023-12-26 13:05:42,072][123091] Updated weights for policy 0, policy_version 1690649 (0.0010) [2023-12-26 13:05:42,144][123091] Updated weights for policy 0, policy_version 1690659 (0.0011) [2023-12-26 13:05:42,216][123091] Updated weights for policy 0, policy_version 1690669 (0.0010) [2023-12-26 13:05:42,743][123090] Updated weights for policy 1, policy_version 1679396 (0.0008) [2023-12-26 13:05:42,821][123090] Updated weights for policy 1, policy_version 1679406 (0.0005) [2023-12-26 13:05:42,873][123090] Updated weights for policy 1, policy_version 1679416 (0.0006) [2023-12-26 13:05:43,018][123091] Updated weights for policy 0, policy_version 1690679 (0.0006) [2023-12-26 13:05:43,085][123091] Updated weights for policy 0, policy_version 1690689 (0.0008) [2023-12-26 13:05:43,139][123091] Updated weights for policy 0, policy_version 1690699 (0.0009) [2023-12-26 13:05:43,697][123090] Updated weights for policy 1, policy_version 1679426 (0.0010) [2023-12-26 13:05:43,766][123090] Updated weights for policy 1, policy_version 1679436 (0.0009) [2023-12-26 13:05:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 862756864. Throughput: 0: 8765.6, 1: 8838.6. Samples: 862757564. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:43,785][121949] Avg episode reward: [(0, '6030.282'), (1, '6071.699')] [2023-12-26 13:05:43,817][123090] Updated weights for policy 1, policy_version 1679446 (0.0009) [2023-12-26 13:05:43,852][123091] Updated weights for policy 0, policy_version 1690709 (0.0009) [2023-12-26 13:05:43,878][123090] Updated weights for policy 1, policy_version 1679456 (0.0009) [2023-12-26 13:05:43,921][123091] Updated weights for policy 0, policy_version 1690719 (0.0008) [2023-12-26 13:05:43,975][123091] Updated weights for policy 0, policy_version 1690729 (0.0010) [2023-12-26 13:05:44,688][123090] Updated weights for policy 1, policy_version 1679466 (0.0005) [2023-12-26 13:05:44,763][123091] Updated weights for policy 0, policy_version 1690739 (0.0009) [2023-12-26 13:05:44,768][123090] Updated weights for policy 1, policy_version 1679476 (0.0007) [2023-12-26 13:05:44,832][123091] Updated weights for policy 0, policy_version 1690749 (0.0008) [2023-12-26 13:05:44,837][123090] Updated weights for policy 1, policy_version 1679486 (0.0009) [2023-12-26 13:05:44,901][123091] Updated weights for policy 0, policy_version 1690759 (0.0009) [2023-12-26 13:05:45,629][123090] Updated weights for policy 1, policy_version 1679496 (0.0008) [2023-12-26 13:05:45,695][123090] Updated weights for policy 1, policy_version 1679506 (0.0006) [2023-12-26 13:05:45,742][123091] Updated weights for policy 0, policy_version 1690769 (0.0010) [2023-12-26 13:05:45,759][123090] Updated weights for policy 1, policy_version 1679516 (0.0009) [2023-12-26 13:05:45,791][123091] Updated weights for policy 0, policy_version 1690779 (0.0009) [2023-12-26 13:05:45,849][123091] Updated weights for policy 0, policy_version 1690789 (0.0009) [2023-12-26 13:05:45,901][123091] Updated weights for policy 0, policy_version 1690799 (0.0009) [2023-12-26 13:05:46,504][123090] Updated weights for policy 1, policy_version 1679526 (0.0007) [2023-12-26 13:05:46,565][123090] Updated weights for policy 1, policy_version 1679536 (0.0005) [2023-12-26 13:05:46,627][123090] Updated weights for policy 1, policy_version 1679546 (0.0008) [2023-12-26 13:05:46,666][123091] Updated weights for policy 0, policy_version 1690809 (0.0006) [2023-12-26 13:05:46,726][123091] Updated weights for policy 0, policy_version 1690819 (0.0006) [2023-12-26 13:05:46,790][123091] Updated weights for policy 0, policy_version 1690829 (0.0007) [2023-12-26 13:05:47,223][123090] Updated weights for policy 1, policy_version 1679556 (0.0007) [2023-12-26 13:05:47,276][123090] Updated weights for policy 1, policy_version 1679566 (0.0010) [2023-12-26 13:05:47,332][123090] Updated weights for policy 1, policy_version 1679576 (0.0010) [2023-12-26 13:05:47,479][123091] Updated weights for policy 0, policy_version 1690839 (0.0008) [2023-12-26 13:05:47,527][123091] Updated weights for policy 0, policy_version 1690849 (0.0011) [2023-12-26 13:05:47,587][123091] Updated weights for policy 0, policy_version 1690859 (0.0011) [2023-12-26 13:05:48,181][123090] Updated weights for policy 1, policy_version 1679586 (0.0009) [2023-12-26 13:05:48,248][123090] Updated weights for policy 1, policy_version 1679596 (0.0006) [2023-12-26 13:05:48,328][123090] Updated weights for policy 1, policy_version 1679606 (0.0006) [2023-12-26 13:05:48,389][123091] Updated weights for policy 0, policy_version 1690869 (0.0011) [2023-12-26 13:05:48,402][123090] Updated weights for policy 1, policy_version 1679616 (0.0010) [2023-12-26 13:05:48,452][123091] Updated weights for policy 0, policy_version 1690879 (0.0011) [2023-12-26 13:05:48,508][123091] Updated weights for policy 0, policy_version 1690889 (0.0011) [2023-12-26 13:05:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 862855168. Throughput: 0: 8856.9, 1: 8802.1. Samples: 862866176. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:48,785][121949] Avg episode reward: [(0, '6035.881'), (1, '5902.564')] [2023-12-26 13:05:49,013][123090] Updated weights for policy 1, policy_version 1679626 (0.0009) [2023-12-26 13:05:49,076][123090] Updated weights for policy 1, policy_version 1679636 (0.0010) [2023-12-26 13:05:49,138][123090] Updated weights for policy 1, policy_version 1679646 (0.0010) [2023-12-26 13:05:49,340][123091] Updated weights for policy 0, policy_version 1690899 (0.0014) [2023-12-26 13:05:49,401][123091] Updated weights for policy 0, policy_version 1690909 (0.0009) [2023-12-26 13:05:49,457][123091] Updated weights for policy 0, policy_version 1690919 (0.0009) [2023-12-26 13:05:49,980][123090] Updated weights for policy 1, policy_version 1679656 (0.0008) [2023-12-26 13:05:50,046][123090] Updated weights for policy 1, policy_version 1679666 (0.0009) [2023-12-26 13:05:50,121][123090] Updated weights for policy 1, policy_version 1679676 (0.0006) [2023-12-26 13:05:50,350][123091] Updated weights for policy 0, policy_version 1690929 (0.0009) [2023-12-26 13:05:50,407][123091] Updated weights for policy 0, policy_version 1690939 (0.0010) [2023-12-26 13:05:50,461][123091] Updated weights for policy 0, policy_version 1690949 (0.0010) [2023-12-26 13:05:50,517][123091] Updated weights for policy 0, policy_version 1690960 (0.0010) [2023-12-26 13:05:50,825][123090] Updated weights for policy 1, policy_version 1679686 (0.0009) [2023-12-26 13:05:50,885][123090] Updated weights for policy 1, policy_version 1679696 (0.0010) [2023-12-26 13:05:50,948][123090] Updated weights for policy 1, policy_version 1679706 (0.0011) [2023-12-26 13:05:51,440][123091] Updated weights for policy 0, policy_version 1690970 (0.0009) [2023-12-26 13:05:51,494][123091] Updated weights for policy 0, policy_version 1690980 (0.0009) [2023-12-26 13:05:51,547][123091] Updated weights for policy 0, policy_version 1690990 (0.0009) [2023-12-26 13:05:51,740][123090] Updated weights for policy 1, policy_version 1679716 (0.0010) [2023-12-26 13:05:51,814][123090] Updated weights for policy 1, policy_version 1679726 (0.0007) [2023-12-26 13:05:51,885][123090] Updated weights for policy 1, policy_version 1679736 (0.0008) [2023-12-26 13:05:52,443][123091] Updated weights for policy 0, policy_version 1691000 (0.0006) [2023-12-26 13:05:52,510][123091] Updated weights for policy 0, policy_version 1691010 (0.0008) [2023-12-26 13:05:52,577][123091] Updated weights for policy 0, policy_version 1691020 (0.0007) [2023-12-26 13:05:52,605][123090] Updated weights for policy 1, policy_version 1679746 (0.0008) [2023-12-26 13:05:52,666][123090] Updated weights for policy 1, policy_version 1679756 (0.0009) [2023-12-26 13:05:52,727][123090] Updated weights for policy 1, policy_version 1679766 (0.0009) [2023-12-26 13:05:52,784][123090] Updated weights for policy 1, policy_version 1679776 (0.0009) [2023-12-26 13:05:53,094][123091] Updated weights for policy 0, policy_version 1691030 (0.0007) [2023-12-26 13:05:53,142][123091] Updated weights for policy 0, policy_version 1691040 (0.0009) [2023-12-26 13:05:53,190][123091] Updated weights for policy 0, policy_version 1691050 (0.0009) [2023-12-26 13:05:53,652][123090] Updated weights for policy 1, policy_version 1679786 (0.0006) [2023-12-26 13:05:53,717][123090] Updated weights for policy 1, policy_version 1679796 (0.0006) [2023-12-26 13:05:53,772][123090] Updated weights for policy 1, policy_version 1679806 (0.0005) [2023-12-26 13:05:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 862945280. Throughput: 0: 8782.3, 1: 8810.4. Samples: 862918076. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:53,785][121949] Avg episode reward: [(0, '6114.958'), (1, '5864.878')] [2023-12-26 13:05:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001691056_432914432.pth... [2023-12-26 13:05:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001679808_430030848.pth... [2023-12-26 13:05:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001678752_429760512.pth [2023-12-26 13:05:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001690032_432652288.pth [2023-12-26 13:05:54,114][123091] Updated weights for policy 0, policy_version 1691060 (0.0009) [2023-12-26 13:05:54,179][123091] Updated weights for policy 0, policy_version 1691070 (0.0009) [2023-12-26 13:05:54,242][123091] Updated weights for policy 0, policy_version 1691080 (0.0010) [2023-12-26 13:05:54,471][123090] Updated weights for policy 1, policy_version 1679816 (0.0006) [2023-12-26 13:05:54,529][123090] Updated weights for policy 1, policy_version 1679826 (0.0006) [2023-12-26 13:05:54,596][123090] Updated weights for policy 1, policy_version 1679836 (0.0008) [2023-12-26 13:05:55,133][123091] Updated weights for policy 0, policy_version 1691090 (0.0009) [2023-12-26 13:05:55,185][123091] Updated weights for policy 0, policy_version 1691101 (0.0009) [2023-12-26 13:05:55,234][123091] Updated weights for policy 0, policy_version 1691111 (0.0009) [2023-12-26 13:05:55,323][123090] Updated weights for policy 1, policy_version 1679846 (0.0009) [2023-12-26 13:05:55,369][123090] Updated weights for policy 1, policy_version 1679856 (0.0008) [2023-12-26 13:05:55,416][123090] Updated weights for policy 1, policy_version 1679866 (0.0008) [2023-12-26 13:05:56,063][123091] Updated weights for policy 0, policy_version 1691121 (0.0010) [2023-12-26 13:05:56,132][123091] Updated weights for policy 0, policy_version 1691131 (0.0009) [2023-12-26 13:05:56,182][123091] Updated weights for policy 0, policy_version 1691141 (0.0009) [2023-12-26 13:05:56,190][123090] Updated weights for policy 1, policy_version 1679876 (0.0008) [2023-12-26 13:05:56,229][123091] Updated weights for policy 0, policy_version 1691151 (0.0008) [2023-12-26 13:05:56,251][123090] Updated weights for policy 1, policy_version 1679886 (0.0006) [2023-12-26 13:05:56,319][123090] Updated weights for policy 1, policy_version 1679896 (0.0006) [2023-12-26 13:05:56,964][123090] Updated weights for policy 1, policy_version 1679906 (0.0006) [2023-12-26 13:05:57,020][123090] Updated weights for policy 1, policy_version 1679916 (0.0010) [2023-12-26 13:05:57,074][123090] Updated weights for policy 1, policy_version 1679926 (0.0010) [2023-12-26 13:05:57,118][123090] Updated weights for policy 1, policy_version 1679936 (0.0010) [2023-12-26 13:05:57,120][123091] Updated weights for policy 0, policy_version 1691161 (0.0009) [2023-12-26 13:05:57,170][123091] Updated weights for policy 0, policy_version 1691171 (0.0008) [2023-12-26 13:05:57,222][123091] Updated weights for policy 0, policy_version 1691181 (0.0008) [2023-12-26 13:05:57,952][123090] Updated weights for policy 1, policy_version 1679946 (0.0010) [2023-12-26 13:05:58,015][123090] Updated weights for policy 1, policy_version 1679956 (0.0010) [2023-12-26 13:05:58,076][123091] Updated weights for policy 0, policy_version 1691191 (0.0009) [2023-12-26 13:05:58,082][123090] Updated weights for policy 1, policy_version 1679966 (0.0010) [2023-12-26 13:05:58,138][123091] Updated weights for policy 0, policy_version 1691201 (0.0008) [2023-12-26 13:05:58,206][123091] Updated weights for policy 0, policy_version 1691211 (0.0009) [2023-12-26 13:05:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 863027200. Throughput: 0: 8733.8, 1: 8902.6. Samples: 863024584. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:05:58,785][121949] Avg episode reward: [(0, '5901.511'), (1, '5916.998')] [2023-12-26 13:05:58,913][123090] Updated weights for policy 1, policy_version 1679976 (0.0007) [2023-12-26 13:05:58,971][123090] Updated weights for policy 1, policy_version 1679986 (0.0005) [2023-12-26 13:05:59,032][123091] Updated weights for policy 0, policy_version 1691221 (0.0008) [2023-12-26 13:05:59,037][123090] Updated weights for policy 1, policy_version 1679996 (0.0008) [2023-12-26 13:05:59,091][123091] Updated weights for policy 0, policy_version 1691231 (0.0008) [2023-12-26 13:05:59,150][123091] Updated weights for policy 0, policy_version 1691241 (0.0008) [2023-12-26 13:05:59,816][123090] Updated weights for policy 1, policy_version 1680006 (0.0008) [2023-12-26 13:05:59,878][123090] Updated weights for policy 1, policy_version 1680016 (0.0007) [2023-12-26 13:05:59,936][123090] Updated weights for policy 1, policy_version 1680026 (0.0006) [2023-12-26 13:05:59,992][123091] Updated weights for policy 0, policy_version 1691251 (0.0009) [2023-12-26 13:06:00,047][123091] Updated weights for policy 0, policy_version 1691261 (0.0009) [2023-12-26 13:06:00,096][123091] Updated weights for policy 0, policy_version 1691271 (0.0009) [2023-12-26 13:06:00,716][123090] Updated weights for policy 1, policy_version 1680036 (0.0010) [2023-12-26 13:06:00,780][123090] Updated weights for policy 1, policy_version 1680046 (0.0011) [2023-12-26 13:06:00,843][123090] Updated weights for policy 1, policy_version 1680056 (0.0011) [2023-12-26 13:06:00,945][123091] Updated weights for policy 0, policy_version 1691281 (0.0009) [2023-12-26 13:06:01,004][123091] Updated weights for policy 0, policy_version 1691291 (0.0009) [2023-12-26 13:06:01,066][123091] Updated weights for policy 0, policy_version 1691301 (0.0009) [2023-12-26 13:06:01,136][123091] Updated weights for policy 0, policy_version 1691311 (0.0009) [2023-12-26 13:06:01,704][123090] Updated weights for policy 1, policy_version 1680066 (0.0010) [2023-12-26 13:06:01,775][123090] Updated weights for policy 1, policy_version 1680076 (0.0010) [2023-12-26 13:06:01,837][123090] Updated weights for policy 1, policy_version 1680086 (0.0009) [2023-12-26 13:06:01,927][123090] Updated weights for policy 1, policy_version 1680096 (0.0010) [2023-12-26 13:06:01,951][123091] Updated weights for policy 0, policy_version 1691321 (0.0006) [2023-12-26 13:06:02,011][123091] Updated weights for policy 0, policy_version 1691331 (0.0006) [2023-12-26 13:06:02,083][123091] Updated weights for policy 0, policy_version 1691341 (0.0006) [2023-12-26 13:06:02,692][123090] Updated weights for policy 1, policy_version 1680106 (0.0006) [2023-12-26 13:06:02,765][123090] Updated weights for policy 1, policy_version 1680116 (0.0006) [2023-12-26 13:06:02,808][123091] Updated weights for policy 0, policy_version 1691351 (0.0009) [2023-12-26 13:06:02,831][123090] Updated weights for policy 1, policy_version 1680126 (0.0008) [2023-12-26 13:06:02,870][123091] Updated weights for policy 0, policy_version 1691361 (0.0008) [2023-12-26 13:06:02,922][123091] Updated weights for policy 0, policy_version 1691371 (0.0009) [2023-12-26 13:06:03,617][123090] Updated weights for policy 1, policy_version 1680136 (0.0011) [2023-12-26 13:06:03,650][123091] Updated weights for policy 0, policy_version 1691381 (0.0008) [2023-12-26 13:06:03,668][123090] Updated weights for policy 1, policy_version 1680146 (0.0010) [2023-12-26 13:06:03,706][123091] Updated weights for policy 0, policy_version 1691391 (0.0008) [2023-12-26 13:06:03,720][123090] Updated weights for policy 1, policy_version 1680156 (0.0010) [2023-12-26 13:06:03,762][123091] Updated weights for policy 0, policy_version 1691401 (0.0006) [2023-12-26 13:06:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 863117312. Throughput: 0: 8695.0, 1: 8939.7. Samples: 863130036. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:06:03,787][121949] Avg episode reward: [(0, '6056.086'), (1, '5941.423')] [2023-12-26 13:06:04,569][123090] Updated weights for policy 1, policy_version 1680166 (0.0010) [2023-12-26 13:06:04,606][123091] Updated weights for policy 0, policy_version 1691411 (0.0008) [2023-12-26 13:06:04,625][123090] Updated weights for policy 1, policy_version 1680176 (0.0010) [2023-12-26 13:06:04,662][123091] Updated weights for policy 0, policy_version 1691421 (0.0007) [2023-12-26 13:06:04,673][123090] Updated weights for policy 1, policy_version 1680186 (0.0010) [2023-12-26 13:06:04,715][123091] Updated weights for policy 0, policy_version 1691431 (0.0006) [2023-12-26 13:06:05,528][123090] Updated weights for policy 1, policy_version 1680196 (0.0010) [2023-12-26 13:06:05,562][123091] Updated weights for policy 0, policy_version 1691441 (0.0008) [2023-12-26 13:06:05,584][123090] Updated weights for policy 1, policy_version 1680206 (0.0010) [2023-12-26 13:06:05,616][123091] Updated weights for policy 0, policy_version 1691451 (0.0006) [2023-12-26 13:06:05,639][123090] Updated weights for policy 1, policy_version 1680216 (0.0010) [2023-12-26 13:06:05,676][123091] Updated weights for policy 0, policy_version 1691461 (0.0006) [2023-12-26 13:06:05,728][123091] Updated weights for policy 0, policy_version 1691472 (0.0010) [2023-12-26 13:06:06,353][123090] Updated weights for policy 1, policy_version 1680226 (0.0008) [2023-12-26 13:06:06,411][123090] Updated weights for policy 1, policy_version 1680236 (0.0006) [2023-12-26 13:06:06,472][123090] Updated weights for policy 1, policy_version 1680246 (0.0005) [2023-12-26 13:06:06,540][123091] Updated weights for policy 0, policy_version 1691482 (0.0008) [2023-12-26 13:06:06,540][123090] Updated weights for policy 1, policy_version 1680256 (0.0009) [2023-12-26 13:06:06,598][123091] Updated weights for policy 0, policy_version 1691492 (0.0008) [2023-12-26 13:06:06,663][123091] Updated weights for policy 0, policy_version 1691502 (0.0010) [2023-12-26 13:06:07,326][123090] Updated weights for policy 1, policy_version 1680266 (0.0011) [2023-12-26 13:06:07,381][123090] Updated weights for policy 1, policy_version 1680276 (0.0010) [2023-12-26 13:06:07,444][123090] Updated weights for policy 1, policy_version 1680286 (0.0010) [2023-12-26 13:06:07,466][123091] Updated weights for policy 0, policy_version 1691512 (0.0008) [2023-12-26 13:06:07,514][123091] Updated weights for policy 0, policy_version 1691522 (0.0008) [2023-12-26 13:06:07,560][123091] Updated weights for policy 0, policy_version 1691532 (0.0008) [2023-12-26 13:06:08,264][123090] Updated weights for policy 1, policy_version 1680296 (0.0009) [2023-12-26 13:06:08,344][123090] Updated weights for policy 1, policy_version 1680306 (0.0009) [2023-12-26 13:06:08,407][123090] Updated weights for policy 1, policy_version 1680316 (0.0007) [2023-12-26 13:06:08,422][123091] Updated weights for policy 0, policy_version 1691542 (0.0006) [2023-12-26 13:06:08,482][123091] Updated weights for policy 0, policy_version 1691552 (0.0007) [2023-12-26 13:06:08,546][123091] Updated weights for policy 0, policy_version 1691562 (0.0009) [2023-12-26 13:06:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 863207424. Throughput: 0: 8670.8, 1: 8946.8. Samples: 863181788. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:06:08,785][121949] Avg episode reward: [(0, '6241.410'), (1, '5870.420')] [2023-12-26 13:06:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001691568_433045504.pth... [2023-12-26 13:06:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001680320_430161920.pth... [2023-12-26 13:06:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001690544_432783360.pth [2023-12-26 13:06:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001679264_429891584.pth [2023-12-26 13:06:09,082][123090] Updated weights for policy 1, policy_version 1680326 (0.0006) [2023-12-26 13:06:09,138][123090] Updated weights for policy 1, policy_version 1680336 (0.0005) [2023-12-26 13:06:09,193][123090] Updated weights for policy 1, policy_version 1680346 (0.0006) [2023-12-26 13:06:09,452][123091] Updated weights for policy 0, policy_version 1691572 (0.0008) [2023-12-26 13:06:09,519][123091] Updated weights for policy 0, policy_version 1691582 (0.0009) [2023-12-26 13:06:09,586][123091] Updated weights for policy 0, policy_version 1691592 (0.0009) [2023-12-26 13:06:09,954][123090] Updated weights for policy 1, policy_version 1680356 (0.0008) [2023-12-26 13:06:10,017][123090] Updated weights for policy 1, policy_version 1680366 (0.0008) [2023-12-26 13:06:10,080][123090] Updated weights for policy 1, policy_version 1680376 (0.0008) [2023-12-26 13:06:10,470][123091] Updated weights for policy 0, policy_version 1691602 (0.0008) [2023-12-26 13:06:10,532][123091] Updated weights for policy 0, policy_version 1691612 (0.0008) [2023-12-26 13:06:10,595][123091] Updated weights for policy 0, policy_version 1691622 (0.0009) [2023-12-26 13:06:10,652][123091] Updated weights for policy 0, policy_version 1691632 (0.0008) [2023-12-26 13:06:10,786][123090] Updated weights for policy 1, policy_version 1680386 (0.0006) [2023-12-26 13:06:10,839][123090] Updated weights for policy 1, policy_version 1680396 (0.0005) [2023-12-26 13:06:10,897][123090] Updated weights for policy 1, policy_version 1680406 (0.0005) [2023-12-26 13:06:10,952][123090] Updated weights for policy 1, policy_version 1680416 (0.0005) [2023-12-26 13:06:11,574][123091] Updated weights for policy 0, policy_version 1691642 (0.0010) [2023-12-26 13:06:11,641][123091] Updated weights for policy 0, policy_version 1691652 (0.0009) [2023-12-26 13:06:11,706][123091] Updated weights for policy 0, policy_version 1691662 (0.0009) [2023-12-26 13:06:11,769][123090] Updated weights for policy 1, policy_version 1680426 (0.0009) [2023-12-26 13:06:11,835][123090] Updated weights for policy 1, policy_version 1680436 (0.0009) [2023-12-26 13:06:11,887][123090] Updated weights for policy 1, policy_version 1680446 (0.0008) [2023-12-26 13:06:12,591][123091] Updated weights for policy 0, policy_version 1691672 (0.0010) [2023-12-26 13:06:12,653][123091] Updated weights for policy 0, policy_version 1691682 (0.0009) [2023-12-26 13:06:12,719][123091] Updated weights for policy 0, policy_version 1691692 (0.0010) [2023-12-26 13:06:12,735][123090] Updated weights for policy 1, policy_version 1680456 (0.0007) [2023-12-26 13:06:12,797][123090] Updated weights for policy 1, policy_version 1680466 (0.0009) [2023-12-26 13:06:12,854][123090] Updated weights for policy 1, policy_version 1680476 (0.0008) [2023-12-26 13:06:13,517][123091] Updated weights for policy 0, policy_version 1691702 (0.0009) [2023-12-26 13:06:13,567][123091] Updated weights for policy 0, policy_version 1691713 (0.0010) [2023-12-26 13:06:13,622][123091] Updated weights for policy 0, policy_version 1691723 (0.0009) [2023-12-26 13:06:13,633][123090] Updated weights for policy 1, policy_version 1680486 (0.0007) [2023-12-26 13:06:13,687][123090] Updated weights for policy 1, policy_version 1680496 (0.0009) [2023-12-26 13:06:13,740][123090] Updated weights for policy 1, policy_version 1680506 (0.0009) [2023-12-26 13:06:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 863297536. Throughput: 0: 8594.0, 1: 8954.2. Samples: 863284556. Policy #0 lag: (min: 31.0, avg: 36.7, max: 63.0) [2023-12-26 13:06:13,785][121949] Avg episode reward: [(0, '6127.627'), (1, '5977.575')] [2023-12-26 13:06:14,453][123091] Updated weights for policy 0, policy_version 1691733 (0.0009) [2023-12-26 13:06:14,507][123091] Updated weights for policy 0, policy_version 1691743 (0.0009) [2023-12-26 13:06:14,560][123091] Updated weights for policy 0, policy_version 1691753 (0.0009) [2023-12-26 13:06:14,620][123090] Updated weights for policy 1, policy_version 1680516 (0.0009) [2023-12-26 13:06:14,671][123090] Updated weights for policy 1, policy_version 1680526 (0.0009) [2023-12-26 13:06:14,733][123090] Updated weights for policy 1, policy_version 1680536 (0.0009) [2023-12-26 13:06:15,411][123091] Updated weights for policy 0, policy_version 1691763 (0.0009) [2023-12-26 13:06:15,478][123091] Updated weights for policy 0, policy_version 1691773 (0.0009) [2023-12-26 13:06:15,539][123091] Updated weights for policy 0, policy_version 1691783 (0.0009) [2023-12-26 13:06:15,559][123090] Updated weights for policy 1, policy_version 1680546 (0.0008) [2023-12-26 13:06:15,617][123090] Updated weights for policy 1, policy_version 1680556 (0.0009) [2023-12-26 13:06:15,679][123090] Updated weights for policy 1, policy_version 1680566 (0.0008) [2023-12-26 13:06:15,731][123090] Updated weights for policy 1, policy_version 1680576 (0.0008) [2023-12-26 13:06:16,377][123091] Updated weights for policy 0, policy_version 1691793 (0.0008) [2023-12-26 13:06:16,431][123091] Updated weights for policy 0, policy_version 1691803 (0.0010) [2023-12-26 13:06:16,489][123091] Updated weights for policy 0, policy_version 1691813 (0.0007) [2023-12-26 13:06:16,519][123090] Updated weights for policy 1, policy_version 1680586 (0.0009) [2023-12-26 13:06:16,542][123091] Updated weights for policy 0, policy_version 1691823 (0.0005) [2023-12-26 13:06:16,582][123090] Updated weights for policy 1, policy_version 1680596 (0.0009) [2023-12-26 13:06:16,642][123090] Updated weights for policy 1, policy_version 1680606 (0.0010) [2023-12-26 13:06:17,349][123091] Updated weights for policy 0, policy_version 1691833 (0.0009) [2023-12-26 13:06:17,406][123091] Updated weights for policy 0, policy_version 1691843 (0.0009) [2023-12-26 13:06:17,442][123090] Updated weights for policy 1, policy_version 1680616 (0.0006) [2023-12-26 13:06:17,462][123091] Updated weights for policy 0, policy_version 1691853 (0.0009) [2023-12-26 13:06:17,492][123090] Updated weights for policy 1, policy_version 1680626 (0.0009) [2023-12-26 13:06:17,546][123090] Updated weights for policy 1, policy_version 1680636 (0.0008) [2023-12-26 13:06:18,303][123091] Updated weights for policy 0, policy_version 1691863 (0.0006) [2023-12-26 13:06:18,364][123090] Updated weights for policy 1, policy_version 1680646 (0.0010) [2023-12-26 13:06:18,376][123091] Updated weights for policy 0, policy_version 1691873 (0.0010) [2023-12-26 13:06:18,429][123090] Updated weights for policy 1, policy_version 1680656 (0.0011) [2023-12-26 13:06:18,444][123091] Updated weights for policy 0, policy_version 1691883 (0.0011) [2023-12-26 13:06:18,488][123090] Updated weights for policy 1, policy_version 1680666 (0.0010) [2023-12-26 13:06:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 863379456. Throughput: 0: 8596.0, 1: 8980.9. Samples: 863388124. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:18,785][121949] Avg episode reward: [(0, '6068.395'), (1, '5988.366')] [2023-12-26 13:06:19,146][123091] Updated weights for policy 0, policy_version 1691893 (0.0008) [2023-12-26 13:06:19,233][123091] Updated weights for policy 0, policy_version 1691903 (0.0006) [2023-12-26 13:06:19,295][123091] Updated weights for policy 0, policy_version 1691913 (0.0009) [2023-12-26 13:06:19,327][123090] Updated weights for policy 1, policy_version 1680676 (0.0011) [2023-12-26 13:06:19,399][123090] Updated weights for policy 1, policy_version 1680686 (0.0010) [2023-12-26 13:06:19,458][123090] Updated weights for policy 1, policy_version 1680696 (0.0010) [2023-12-26 13:06:20,027][123091] Updated weights for policy 0, policy_version 1691923 (0.0009) [2023-12-26 13:06:20,096][123091] Updated weights for policy 0, policy_version 1691933 (0.0008) [2023-12-26 13:06:20,159][123091] Updated weights for policy 0, policy_version 1691943 (0.0008) [2023-12-26 13:06:20,330][123090] Updated weights for policy 1, policy_version 1680706 (0.0009) [2023-12-26 13:06:20,392][123090] Updated weights for policy 1, policy_version 1680716 (0.0008) [2023-12-26 13:06:20,467][123090] Updated weights for policy 1, policy_version 1680726 (0.0005) [2023-12-26 13:06:20,539][123090] Updated weights for policy 1, policy_version 1680736 (0.0008) [2023-12-26 13:06:20,991][123091] Updated weights for policy 0, policy_version 1691953 (0.0009) [2023-12-26 13:06:21,069][123091] Updated weights for policy 0, policy_version 1691963 (0.0011) [2023-12-26 13:06:21,140][123091] Updated weights for policy 0, policy_version 1691973 (0.0011) [2023-12-26 13:06:21,208][123091] Updated weights for policy 0, policy_version 1691983 (0.0009) [2023-12-26 13:06:21,326][123090] Updated weights for policy 1, policy_version 1680746 (0.0010) [2023-12-26 13:06:21,397][123090] Updated weights for policy 1, policy_version 1680756 (0.0010) [2023-12-26 13:06:21,455][123090] Updated weights for policy 1, policy_version 1680766 (0.0009) [2023-12-26 13:06:22,016][123091] Updated weights for policy 0, policy_version 1691993 (0.0006) [2023-12-26 13:06:22,086][123091] Updated weights for policy 0, policy_version 1692003 (0.0006) [2023-12-26 13:06:22,166][123091] Updated weights for policy 0, policy_version 1692013 (0.0008) [2023-12-26 13:06:22,356][123090] Updated weights for policy 1, policy_version 1680776 (0.0009) [2023-12-26 13:06:22,422][123090] Updated weights for policy 1, policy_version 1680786 (0.0010) [2023-12-26 13:06:22,485][123090] Updated weights for policy 1, policy_version 1680796 (0.0010) [2023-12-26 13:06:22,891][123091] Updated weights for policy 0, policy_version 1692023 (0.0006) [2023-12-26 13:06:22,954][123091] Updated weights for policy 0, policy_version 1692033 (0.0005) [2023-12-26 13:06:23,012][123091] Updated weights for policy 0, policy_version 1692043 (0.0006) [2023-12-26 13:06:23,289][123090] Updated weights for policy 1, policy_version 1680806 (0.0010) [2023-12-26 13:06:23,357][123090] Updated weights for policy 1, policy_version 1680816 (0.0009) [2023-12-26 13:06:23,421][123090] Updated weights for policy 1, policy_version 1680826 (0.0008) [2023-12-26 13:06:23,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 863461376. Throughput: 0: 8541.9, 1: 8907.5. Samples: 863439236. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:23,785][121949] Avg episode reward: [(0, '6185.840'), (1, '5873.017')] [2023-12-26 13:06:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001692048_433168384.pth... [2023-12-26 13:06:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001680832_430292992.pth... [2023-12-26 13:06:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001691056_432914432.pth [2023-12-26 13:06:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001679808_430030848.pth [2023-12-26 13:06:23,841][123091] Updated weights for policy 0, policy_version 1692053 (0.0009) [2023-12-26 13:06:23,896][123091] Updated weights for policy 0, policy_version 1692063 (0.0009) [2023-12-26 13:06:23,959][123091] Updated weights for policy 0, policy_version 1692073 (0.0009) [2023-12-26 13:06:24,144][123090] Updated weights for policy 1, policy_version 1680836 (0.0008) [2023-12-26 13:06:24,199][123090] Updated weights for policy 1, policy_version 1680846 (0.0009) [2023-12-26 13:06:24,250][123090] Updated weights for policy 1, policy_version 1680856 (0.0009) [2023-12-26 13:06:24,819][123091] Updated weights for policy 0, policy_version 1692083 (0.0009) [2023-12-26 13:06:24,876][123091] Updated weights for policy 0, policy_version 1692093 (0.0006) [2023-12-26 13:06:24,940][123091] Updated weights for policy 0, policy_version 1692103 (0.0008) [2023-12-26 13:06:25,012][123090] Updated weights for policy 1, policy_version 1680866 (0.0009) [2023-12-26 13:06:25,066][123090] Updated weights for policy 1, policy_version 1680876 (0.0010) [2023-12-26 13:06:25,125][123090] Updated weights for policy 1, policy_version 1680887 (0.0010) [2023-12-26 13:06:25,652][123091] Updated weights for policy 0, policy_version 1692113 (0.0008) [2023-12-26 13:06:25,713][123091] Updated weights for policy 0, policy_version 1692123 (0.0007) [2023-12-26 13:06:25,778][123091] Updated weights for policy 0, policy_version 1692133 (0.0005) [2023-12-26 13:06:25,841][123091] Updated weights for policy 0, policy_version 1692143 (0.0006) [2023-12-26 13:06:26,026][123090] Updated weights for policy 1, policy_version 1680897 (0.0010) [2023-12-26 13:06:26,098][123090] Updated weights for policy 1, policy_version 1680907 (0.0008) [2023-12-26 13:06:26,156][123090] Updated weights for policy 1, policy_version 1680917 (0.0010) [2023-12-26 13:06:26,208][123090] Updated weights for policy 1, policy_version 1680927 (0.0009) [2023-12-26 13:06:26,509][123091] Updated weights for policy 0, policy_version 1692153 (0.0006) [2023-12-26 13:06:26,569][123091] Updated weights for policy 0, policy_version 1692163 (0.0005) [2023-12-26 13:06:26,630][123091] Updated weights for policy 0, policy_version 1692173 (0.0009) [2023-12-26 13:06:26,962][123090] Updated weights for policy 1, policy_version 1680937 (0.0006) [2023-12-26 13:06:27,013][123090] Updated weights for policy 1, policy_version 1680947 (0.0007) [2023-12-26 13:06:27,064][123090] Updated weights for policy 1, policy_version 1680957 (0.0009) [2023-12-26 13:06:27,379][123091] Updated weights for policy 0, policy_version 1692183 (0.0007) [2023-12-26 13:06:27,426][123091] Updated weights for policy 0, policy_version 1692193 (0.0010) [2023-12-26 13:06:27,483][123091] Updated weights for policy 0, policy_version 1692203 (0.0010) [2023-12-26 13:06:27,888][123090] Updated weights for policy 1, policy_version 1680967 (0.0006) [2023-12-26 13:06:27,941][123090] Updated weights for policy 1, policy_version 1680977 (0.0005) [2023-12-26 13:06:27,990][123090] Updated weights for policy 1, policy_version 1680987 (0.0005) [2023-12-26 13:06:28,225][123091] Updated weights for policy 0, policy_version 1692213 (0.0011) [2023-12-26 13:06:28,276][123091] Updated weights for policy 0, policy_version 1692223 (0.0010) [2023-12-26 13:06:28,354][123091] Updated weights for policy 0, policy_version 1692233 (0.0011) [2023-12-26 13:06:28,692][123090] Updated weights for policy 1, policy_version 1680997 (0.0005) [2023-12-26 13:06:28,745][123090] Updated weights for policy 1, policy_version 1681007 (0.0005) [2023-12-26 13:06:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 863551488. Throughput: 0: 8674.3, 1: 8873.0. Samples: 863547192. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:28,785][121949] Avg episode reward: [(0, '6076.979'), (1, '5953.246')] [2023-12-26 13:06:28,798][123090] Updated weights for policy 1, policy_version 1681017 (0.0006) [2023-12-26 13:06:29,183][123091] Updated weights for policy 0, policy_version 1692243 (0.0010) [2023-12-26 13:06:29,242][123091] Updated weights for policy 0, policy_version 1692253 (0.0010) [2023-12-26 13:06:29,306][123091] Updated weights for policy 0, policy_version 1692263 (0.0009) [2023-12-26 13:06:29,528][123090] Updated weights for policy 1, policy_version 1681027 (0.0006) [2023-12-26 13:06:29,582][123090] Updated weights for policy 1, policy_version 1681037 (0.0005) [2023-12-26 13:06:29,629][123090] Updated weights for policy 1, policy_version 1681047 (0.0005) [2023-12-26 13:06:30,174][123091] Updated weights for policy 0, policy_version 1692273 (0.0010) [2023-12-26 13:06:30,223][123091] Updated weights for policy 0, policy_version 1692283 (0.0009) [2023-12-26 13:06:30,284][123091] Updated weights for policy 0, policy_version 1692293 (0.0010) [2023-12-26 13:06:30,336][123091] Updated weights for policy 0, policy_version 1692303 (0.0009) [2023-12-26 13:06:30,394][123090] Updated weights for policy 1, policy_version 1681057 (0.0005) [2023-12-26 13:06:30,440][123090] Updated weights for policy 1, policy_version 1681067 (0.0005) [2023-12-26 13:06:30,496][123090] Updated weights for policy 1, policy_version 1681077 (0.0005) [2023-12-26 13:06:30,544][123090] Updated weights for policy 1, policy_version 1681087 (0.0005) [2023-12-26 13:06:31,122][123091] Updated weights for policy 0, policy_version 1692313 (0.0006) [2023-12-26 13:06:31,191][123091] Updated weights for policy 0, policy_version 1692323 (0.0009) [2023-12-26 13:06:31,248][123091] Updated weights for policy 0, policy_version 1692333 (0.0009) [2023-12-26 13:06:31,296][123090] Updated weights for policy 1, policy_version 1681097 (0.0010) [2023-12-26 13:06:31,366][123090] Updated weights for policy 1, policy_version 1681107 (0.0010) [2023-12-26 13:06:31,430][123090] Updated weights for policy 1, policy_version 1681117 (0.0007) [2023-12-26 13:06:31,974][123091] Updated weights for policy 0, policy_version 1692343 (0.0009) [2023-12-26 13:06:32,032][123091] Updated weights for policy 0, policy_version 1692353 (0.0010) [2023-12-26 13:06:32,085][123091] Updated weights for policy 0, policy_version 1692363 (0.0009) [2023-12-26 13:06:32,286][123090] Updated weights for policy 1, policy_version 1681127 (0.0007) [2023-12-26 13:06:32,356][123090] Updated weights for policy 1, policy_version 1681137 (0.0009) [2023-12-26 13:06:32,427][123090] Updated weights for policy 1, policy_version 1681147 (0.0006) [2023-12-26 13:06:32,977][123091] Updated weights for policy 0, policy_version 1692373 (0.0010) [2023-12-26 13:06:33,032][123091] Updated weights for policy 0, policy_version 1692383 (0.0009) [2023-12-26 13:06:33,086][123091] Updated weights for policy 0, policy_version 1692393 (0.0010) [2023-12-26 13:06:33,122][123090] Updated weights for policy 1, policy_version 1681157 (0.0009) [2023-12-26 13:06:33,179][123090] Updated weights for policy 1, policy_version 1681167 (0.0009) [2023-12-26 13:06:33,240][123090] Updated weights for policy 1, policy_version 1681177 (0.0008) [2023-12-26 13:06:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 863641600. Throughput: 0: 8619.5, 1: 8919.3. Samples: 863655424. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:33,785][121949] Avg episode reward: [(0, '6107.353'), (1, '6008.567')] [2023-12-26 13:06:33,824][123091] Updated weights for policy 0, policy_version 1692403 (0.0010) [2023-12-26 13:06:33,875][123091] Updated weights for policy 0, policy_version 1692413 (0.0010) [2023-12-26 13:06:33,936][123091] Updated weights for policy 0, policy_version 1692424 (0.0010) [2023-12-26 13:06:34,028][123090] Updated weights for policy 1, policy_version 1681187 (0.0010) [2023-12-26 13:06:34,103][123090] Updated weights for policy 1, policy_version 1681197 (0.0010) [2023-12-26 13:06:34,177][123090] Updated weights for policy 1, policy_version 1681207 (0.0009) [2023-12-26 13:06:34,754][123091] Updated weights for policy 0, policy_version 1692434 (0.0009) [2023-12-26 13:06:34,809][123091] Updated weights for policy 0, policy_version 1692444 (0.0009) [2023-12-26 13:06:34,862][123091] Updated weights for policy 0, policy_version 1692454 (0.0009) [2023-12-26 13:06:34,918][123091] Updated weights for policy 0, policy_version 1692464 (0.0009) [2023-12-26 13:06:35,002][123090] Updated weights for policy 1, policy_version 1681217 (0.0010) [2023-12-26 13:06:35,050][123090] Updated weights for policy 1, policy_version 1681227 (0.0009) [2023-12-26 13:06:35,098][123090] Updated weights for policy 1, policy_version 1681237 (0.0009) [2023-12-26 13:06:35,147][123090] Updated weights for policy 1, policy_version 1681247 (0.0009) [2023-12-26 13:06:35,663][123091] Updated weights for policy 0, policy_version 1692474 (0.0009) [2023-12-26 13:06:35,733][123091] Updated weights for policy 0, policy_version 1692484 (0.0009) [2023-12-26 13:06:35,793][123091] Updated weights for policy 0, policy_version 1692494 (0.0009) [2023-12-26 13:06:36,033][123090] Updated weights for policy 1, policy_version 1681257 (0.0010) [2023-12-26 13:06:36,081][123090] Updated weights for policy 1, policy_version 1681267 (0.0009) [2023-12-26 13:06:36,149][123090] Updated weights for policy 1, policy_version 1681277 (0.0010) [2023-12-26 13:06:36,601][123091] Updated weights for policy 0, policy_version 1692504 (0.0006) [2023-12-26 13:06:36,668][123091] Updated weights for policy 0, policy_version 1692514 (0.0006) [2023-12-26 13:06:36,741][123091] Updated weights for policy 0, policy_version 1692524 (0.0006) [2023-12-26 13:06:36,992][123090] Updated weights for policy 1, policy_version 1681287 (0.0006) [2023-12-26 13:06:37,061][123090] Updated weights for policy 1, policy_version 1681297 (0.0005) [2023-12-26 13:06:37,113][123090] Updated weights for policy 1, policy_version 1681307 (0.0005) [2023-12-26 13:06:37,477][123091] Updated weights for policy 0, policy_version 1692534 (0.0007) [2023-12-26 13:06:37,543][123091] Updated weights for policy 0, policy_version 1692544 (0.0008) [2023-12-26 13:06:37,595][123091] Updated weights for policy 0, policy_version 1692554 (0.0007) [2023-12-26 13:06:37,921][123090] Updated weights for policy 1, policy_version 1681317 (0.0008) [2023-12-26 13:06:37,987][123090] Updated weights for policy 1, policy_version 1681327 (0.0010) [2023-12-26 13:06:38,051][123090] Updated weights for policy 1, policy_version 1681337 (0.0009) [2023-12-26 13:06:38,365][123091] Updated weights for policy 0, policy_version 1692564 (0.0009) [2023-12-26 13:06:38,424][123091] Updated weights for policy 0, policy_version 1692574 (0.0009) [2023-12-26 13:06:38,483][123091] Updated weights for policy 0, policy_version 1692584 (0.0010) [2023-12-26 13:06:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 863731712. Throughput: 0: 8696.2, 1: 8851.8. Samples: 863707732. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:38,785][121949] Avg episode reward: [(0, '6120.322'), (1, '6007.393')] [2023-12-26 13:06:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001692592_433307648.pth... [2023-12-26 13:06:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001681344_430424064.pth... [2023-12-26 13:06:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001680320_430161920.pth [2023-12-26 13:06:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001691568_433045504.pth [2023-12-26 13:06:38,862][123090] Updated weights for policy 1, policy_version 1681347 (0.0009) [2023-12-26 13:06:38,931][123090] Updated weights for policy 1, policy_version 1681357 (0.0010) [2023-12-26 13:06:38,997][123090] Updated weights for policy 1, policy_version 1681367 (0.0009) [2023-12-26 13:06:39,340][123091] Updated weights for policy 0, policy_version 1692594 (0.0009) [2023-12-26 13:06:39,417][123091] Updated weights for policy 0, policy_version 1692604 (0.0009) [2023-12-26 13:06:39,475][123091] Updated weights for policy 0, policy_version 1692614 (0.0010) [2023-12-26 13:06:39,541][123091] Updated weights for policy 0, policy_version 1692624 (0.0010) [2023-12-26 13:06:39,810][123090] Updated weights for policy 1, policy_version 1681377 (0.0009) [2023-12-26 13:06:39,880][123090] Updated weights for policy 1, policy_version 1681387 (0.0010) [2023-12-26 13:06:39,945][123090] Updated weights for policy 1, policy_version 1681397 (0.0009) [2023-12-26 13:06:40,018][123090] Updated weights for policy 1, policy_version 1681407 (0.0009) [2023-12-26 13:06:40,368][123091] Updated weights for policy 0, policy_version 1692634 (0.0009) [2023-12-26 13:06:40,430][123091] Updated weights for policy 0, policy_version 1692644 (0.0008) [2023-12-26 13:06:40,494][123091] Updated weights for policy 0, policy_version 1692654 (0.0010) [2023-12-26 13:06:40,852][123090] Updated weights for policy 1, policy_version 1681417 (0.0009) [2023-12-26 13:06:40,912][123090] Updated weights for policy 1, policy_version 1681427 (0.0009) [2023-12-26 13:06:40,978][123090] Updated weights for policy 1, policy_version 1681437 (0.0005) [2023-12-26 13:06:41,352][123091] Updated weights for policy 0, policy_version 1692664 (0.0009) [2023-12-26 13:06:41,434][123091] Updated weights for policy 0, policy_version 1692674 (0.0009) [2023-12-26 13:06:41,502][123091] Updated weights for policy 0, policy_version 1692684 (0.0007) [2023-12-26 13:06:41,745][123090] Updated weights for policy 1, policy_version 1681447 (0.0007) [2023-12-26 13:06:41,815][123090] Updated weights for policy 1, policy_version 1681457 (0.0009) [2023-12-26 13:06:41,881][123090] Updated weights for policy 1, policy_version 1681467 (0.0010) [2023-12-26 13:06:42,251][123091] Updated weights for policy 0, policy_version 1692694 (0.0006) [2023-12-26 13:06:42,327][123091] Updated weights for policy 0, policy_version 1692704 (0.0007) [2023-12-26 13:06:42,397][123091] Updated weights for policy 0, policy_version 1692714 (0.0010) [2023-12-26 13:06:42,699][123090] Updated weights for policy 1, policy_version 1681477 (0.0010) [2023-12-26 13:06:42,772][123090] Updated weights for policy 1, policy_version 1681487 (0.0009) [2023-12-26 13:06:42,840][123090] Updated weights for policy 1, policy_version 1681497 (0.0009) [2023-12-26 13:06:43,231][123091] Updated weights for policy 0, policy_version 1692724 (0.0009) [2023-12-26 13:06:43,279][123091] Updated weights for policy 0, policy_version 1692734 (0.0009) [2023-12-26 13:06:43,326][123091] Updated weights for policy 0, policy_version 1692744 (0.0009) [2023-12-26 13:06:43,643][123090] Updated weights for policy 1, policy_version 1681507 (0.0010) [2023-12-26 13:06:43,701][123090] Updated weights for policy 1, policy_version 1681517 (0.0009) [2023-12-26 13:06:43,770][123090] Updated weights for policy 1, policy_version 1681527 (0.0009) [2023-12-26 13:06:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 863813632. Throughput: 0: 8711.9, 1: 8776.3. Samples: 863811556. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:43,785][121949] Avg episode reward: [(0, '6188.257'), (1, '5877.473')] [2023-12-26 13:06:44,176][123091] Updated weights for policy 0, policy_version 1692754 (0.0010) [2023-12-26 13:06:44,227][123091] Updated weights for policy 0, policy_version 1692764 (0.0009) [2023-12-26 13:06:44,286][123091] Updated weights for policy 0, policy_version 1692774 (0.0009) [2023-12-26 13:06:44,334][123091] Updated weights for policy 0, policy_version 1692784 (0.0009) [2023-12-26 13:06:44,623][123090] Updated weights for policy 1, policy_version 1681537 (0.0009) [2023-12-26 13:06:44,685][123090] Updated weights for policy 1, policy_version 1681547 (0.0009) [2023-12-26 13:06:44,754][123090] Updated weights for policy 1, policy_version 1681557 (0.0008) [2023-12-26 13:06:44,816][123090] Updated weights for policy 1, policy_version 1681567 (0.0009) [2023-12-26 13:06:45,244][123091] Updated weights for policy 0, policy_version 1692794 (0.0010) [2023-12-26 13:06:45,308][123091] Updated weights for policy 0, policy_version 1692804 (0.0009) [2023-12-26 13:06:45,370][123091] Updated weights for policy 0, policy_version 1692814 (0.0009) [2023-12-26 13:06:45,670][123090] Updated weights for policy 1, policy_version 1681577 (0.0008) [2023-12-26 13:06:45,733][123090] Updated weights for policy 1, policy_version 1681587 (0.0008) [2023-12-26 13:06:45,800][123090] Updated weights for policy 1, policy_version 1681597 (0.0009) [2023-12-26 13:06:46,170][123091] Updated weights for policy 0, policy_version 1692824 (0.0006) [2023-12-26 13:06:46,216][123091] Updated weights for policy 0, policy_version 1692834 (0.0007) [2023-12-26 13:06:46,268][123091] Updated weights for policy 0, policy_version 1692844 (0.0011) [2023-12-26 13:06:46,649][123090] Updated weights for policy 1, policy_version 1681607 (0.0009) [2023-12-26 13:06:46,705][123090] Updated weights for policy 1, policy_version 1681617 (0.0009) [2023-12-26 13:06:46,761][123090] Updated weights for policy 1, policy_version 1681627 (0.0009) [2023-12-26 13:06:47,093][123091] Updated weights for policy 0, policy_version 1692854 (0.0007) [2023-12-26 13:06:47,139][123091] Updated weights for policy 0, policy_version 1692864 (0.0005) [2023-12-26 13:06:47,188][123091] Updated weights for policy 0, policy_version 1692874 (0.0005) [2023-12-26 13:06:47,601][123090] Updated weights for policy 1, policy_version 1681637 (0.0008) [2023-12-26 13:06:47,672][123090] Updated weights for policy 1, policy_version 1681647 (0.0009) [2023-12-26 13:06:47,740][123090] Updated weights for policy 1, policy_version 1681657 (0.0009) [2023-12-26 13:06:47,823][123091] Updated weights for policy 0, policy_version 1692884 (0.0006) [2023-12-26 13:06:47,882][123091] Updated weights for policy 0, policy_version 1692894 (0.0006) [2023-12-26 13:06:47,940][123091] Updated weights for policy 0, policy_version 1692904 (0.0005) [2023-12-26 13:06:48,492][123091] Updated weights for policy 0, policy_version 1692914 (0.0006) [2023-12-26 13:06:48,552][123091] Updated weights for policy 0, policy_version 1692924 (0.0009) [2023-12-26 13:06:48,620][123091] Updated weights for policy 0, policy_version 1692934 (0.0007) [2023-12-26 13:06:48,634][123090] Updated weights for policy 1, policy_version 1681667 (0.0009) [2023-12-26 13:06:48,682][123091] Updated weights for policy 0, policy_version 1692944 (0.0010) [2023-12-26 13:06:48,693][123090] Updated weights for policy 1, policy_version 1681677 (0.0007) [2023-12-26 13:06:48,763][123090] Updated weights for policy 1, policy_version 1681687 (0.0009) [2023-12-26 13:06:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 863903744. Throughput: 0: 8753.1, 1: 8717.9. Samples: 863916236. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:48,785][121949] Avg episode reward: [(0, '6112.141'), (1, '5875.320')] [2023-12-26 13:06:49,439][123091] Updated weights for policy 0, policy_version 1692954 (0.0006) [2023-12-26 13:06:49,499][123091] Updated weights for policy 0, policy_version 1692964 (0.0005) [2023-12-26 13:06:49,567][123091] Updated weights for policy 0, policy_version 1692974 (0.0007) [2023-12-26 13:06:49,574][123090] Updated weights for policy 1, policy_version 1681697 (0.0009) [2023-12-26 13:06:49,632][123090] Updated weights for policy 1, policy_version 1681707 (0.0009) [2023-12-26 13:06:49,688][123090] Updated weights for policy 1, policy_version 1681717 (0.0009) [2023-12-26 13:06:49,745][123090] Updated weights for policy 1, policy_version 1681727 (0.0009) [2023-12-26 13:06:50,360][123091] Updated weights for policy 0, policy_version 1692984 (0.0008) [2023-12-26 13:06:50,421][123091] Updated weights for policy 0, policy_version 1692994 (0.0006) [2023-12-26 13:06:50,483][123091] Updated weights for policy 0, policy_version 1693004 (0.0005) [2023-12-26 13:06:50,627][123090] Updated weights for policy 1, policy_version 1681737 (0.0009) [2023-12-26 13:06:50,687][123090] Updated weights for policy 1, policy_version 1681747 (0.0009) [2023-12-26 13:06:50,749][123090] Updated weights for policy 1, policy_version 1681757 (0.0009) [2023-12-26 13:06:51,272][123091] Updated weights for policy 0, policy_version 1693014 (0.0009) [2023-12-26 13:06:51,335][123091] Updated weights for policy 0, policy_version 1693024 (0.0011) [2023-12-26 13:06:51,403][123091] Updated weights for policy 0, policy_version 1693034 (0.0009) [2023-12-26 13:06:51,612][123090] Updated weights for policy 1, policy_version 1681767 (0.0007) [2023-12-26 13:06:51,671][123090] Updated weights for policy 1, policy_version 1681777 (0.0007) [2023-12-26 13:06:51,738][123090] Updated weights for policy 1, policy_version 1681787 (0.0007) [2023-12-26 13:06:52,266][123091] Updated weights for policy 0, policy_version 1693044 (0.0010) [2023-12-26 13:06:52,321][123091] Updated weights for policy 0, policy_version 1693054 (0.0010) [2023-12-26 13:06:52,391][123091] Updated weights for policy 0, policy_version 1693064 (0.0009) [2023-12-26 13:06:52,534][123090] Updated weights for policy 1, policy_version 1681797 (0.0006) [2023-12-26 13:06:52,604][123090] Updated weights for policy 1, policy_version 1681807 (0.0007) [2023-12-26 13:06:52,664][123090] Updated weights for policy 1, policy_version 1681817 (0.0009) [2023-12-26 13:06:53,239][123091] Updated weights for policy 0, policy_version 1693074 (0.0010) [2023-12-26 13:06:53,290][123091] Updated weights for policy 0, policy_version 1693084 (0.0010) [2023-12-26 13:06:53,351][123091] Updated weights for policy 0, policy_version 1693094 (0.0009) [2023-12-26 13:06:53,393][123090] Updated weights for policy 1, policy_version 1681827 (0.0008) [2023-12-26 13:06:53,417][123091] Updated weights for policy 0, policy_version 1693104 (0.0008) [2023-12-26 13:06:53,450][123090] Updated weights for policy 1, policy_version 1681837 (0.0005) [2023-12-26 13:06:53,506][123090] Updated weights for policy 1, policy_version 1681847 (0.0008) [2023-12-26 13:06:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17772.6). Total num frames: 863993856. Throughput: 0: 8768.3, 1: 8693.1. Samples: 863967556. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:53,785][121949] Avg episode reward: [(0, '5916.004'), (1, '5829.458')] [2023-12-26 13:06:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001693104_433438720.pth... [2023-12-26 13:06:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001681856_430555136.pth... [2023-12-26 13:06:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001692048_433168384.pth [2023-12-26 13:06:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001680832_430292992.pth [2023-12-26 13:06:54,109][123090] Updated weights for policy 1, policy_version 1681857 (0.0008) [2023-12-26 13:06:54,172][123090] Updated weights for policy 1, policy_version 1681867 (0.0005) [2023-12-26 13:06:54,240][123090] Updated weights for policy 1, policy_version 1681877 (0.0005) [2023-12-26 13:06:54,287][123091] Updated weights for policy 0, policy_version 1693114 (0.0005) [2023-12-26 13:06:54,307][123090] Updated weights for policy 1, policy_version 1681887 (0.0006) [2023-12-26 13:06:54,342][123091] Updated weights for policy 0, policy_version 1693125 (0.0007) [2023-12-26 13:06:54,399][123091] Updated weights for policy 0, policy_version 1693135 (0.0008) [2023-12-26 13:06:55,092][123090] Updated weights for policy 1, policy_version 1681897 (0.0009) [2023-12-26 13:06:55,148][123090] Updated weights for policy 1, policy_version 1681907 (0.0008) [2023-12-26 13:06:55,150][123091] Updated weights for policy 0, policy_version 1693145 (0.0007) [2023-12-26 13:06:55,200][123090] Updated weights for policy 1, policy_version 1681917 (0.0008) [2023-12-26 13:06:55,214][123091] Updated weights for policy 0, policy_version 1693155 (0.0008) [2023-12-26 13:06:55,313][123091] Updated weights for policy 0, policy_version 1693165 (0.0010) [2023-12-26 13:06:56,023][123090] Updated weights for policy 1, policy_version 1681927 (0.0006) [2023-12-26 13:06:56,080][123090] Updated weights for policy 1, policy_version 1681937 (0.0006) [2023-12-26 13:06:56,103][123091] Updated weights for policy 0, policy_version 1693175 (0.0008) [2023-12-26 13:06:56,140][123090] Updated weights for policy 1, policy_version 1681947 (0.0006) [2023-12-26 13:06:56,168][123091] Updated weights for policy 0, policy_version 1693185 (0.0009) [2023-12-26 13:06:56,231][123091] Updated weights for policy 0, policy_version 1693195 (0.0009) [2023-12-26 13:06:56,954][123091] Updated weights for policy 0, policy_version 1693205 (0.0007) [2023-12-26 13:06:56,970][123090] Updated weights for policy 1, policy_version 1681957 (0.0007) [2023-12-26 13:06:57,002][123091] Updated weights for policy 0, policy_version 1693215 (0.0010) [2023-12-26 13:06:57,022][123090] Updated weights for policy 1, policy_version 1681967 (0.0006) [2023-12-26 13:06:57,050][123091] Updated weights for policy 0, policy_version 1693225 (0.0010) [2023-12-26 13:06:57,065][123090] Updated weights for policy 1, policy_version 1681977 (0.0005) [2023-12-26 13:06:57,778][123091] Updated weights for policy 0, policy_version 1693235 (0.0009) [2023-12-26 13:06:57,827][123091] Updated weights for policy 0, policy_version 1693245 (0.0005) [2023-12-26 13:06:57,887][123091] Updated weights for policy 0, policy_version 1693255 (0.0005) [2023-12-26 13:06:57,989][123090] Updated weights for policy 1, policy_version 1681987 (0.0008) [2023-12-26 13:06:58,055][123090] Updated weights for policy 1, policy_version 1681997 (0.0009) [2023-12-26 13:06:58,126][123090] Updated weights for policy 1, policy_version 1682007 (0.0008) [2023-12-26 13:06:58,711][123091] Updated weights for policy 0, policy_version 1693265 (0.0006) [2023-12-26 13:06:58,783][123091] Updated weights for policy 0, policy_version 1693275 (0.0008) [2023-12-26 13:06:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 864075776. Throughput: 0: 8847.1, 1: 8705.9. Samples: 864074444. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:06:58,785][121949] Avg episode reward: [(0, '5999.737'), (1, '5848.209')] [2023-12-26 13:06:58,855][123091] Updated weights for policy 0, policy_version 1693285 (0.0008) [2023-12-26 13:06:58,927][123091] Updated weights for policy 0, policy_version 1693295 (0.0010) [2023-12-26 13:06:58,965][123090] Updated weights for policy 1, policy_version 1682017 (0.0008) [2023-12-26 13:06:59,038][123090] Updated weights for policy 1, policy_version 1682027 (0.0008) [2023-12-26 13:06:59,104][123090] Updated weights for policy 1, policy_version 1682037 (0.0009) [2023-12-26 13:06:59,160][123090] Updated weights for policy 1, policy_version 1682047 (0.0009) [2023-12-26 13:06:59,761][123091] Updated weights for policy 0, policy_version 1693305 (0.0009) [2023-12-26 13:06:59,824][123091] Updated weights for policy 0, policy_version 1693315 (0.0009) [2023-12-26 13:06:59,889][123091] Updated weights for policy 0, policy_version 1693325 (0.0009) [2023-12-26 13:06:59,988][123090] Updated weights for policy 1, policy_version 1682057 (0.0009) [2023-12-26 13:07:00,059][123090] Updated weights for policy 1, policy_version 1682067 (0.0008) [2023-12-26 13:07:00,130][123090] Updated weights for policy 1, policy_version 1682077 (0.0009) [2023-12-26 13:07:00,661][123091] Updated weights for policy 0, policy_version 1693335 (0.0008) [2023-12-26 13:07:00,723][123091] Updated weights for policy 0, policy_version 1693345 (0.0008) [2023-12-26 13:07:00,784][123091] Updated weights for policy 0, policy_version 1693355 (0.0009) [2023-12-26 13:07:00,952][123090] Updated weights for policy 1, policy_version 1682087 (0.0010) [2023-12-26 13:07:01,005][123090] Updated weights for policy 1, policy_version 1682097 (0.0010) [2023-12-26 13:07:01,076][123090] Updated weights for policy 1, policy_version 1682107 (0.0009) [2023-12-26 13:07:01,512][123091] Updated weights for policy 0, policy_version 1693365 (0.0010) [2023-12-26 13:07:01,567][123091] Updated weights for policy 0, policy_version 1693375 (0.0009) [2023-12-26 13:07:01,632][123091] Updated weights for policy 0, policy_version 1693385 (0.0009) [2023-12-26 13:07:01,929][123090] Updated weights for policy 1, policy_version 1682117 (0.0010) [2023-12-26 13:07:01,981][123090] Updated weights for policy 1, policy_version 1682127 (0.0009) [2023-12-26 13:07:02,032][123090] Updated weights for policy 1, policy_version 1682138 (0.0010) [2023-12-26 13:07:02,428][123091] Updated weights for policy 0, policy_version 1693395 (0.0009) [2023-12-26 13:07:02,482][123091] Updated weights for policy 0, policy_version 1693405 (0.0006) [2023-12-26 13:07:02,531][123091] Updated weights for policy 0, policy_version 1693415 (0.0009) [2023-12-26 13:07:02,943][123090] Updated weights for policy 1, policy_version 1682148 (0.0010) [2023-12-26 13:07:03,000][123090] Updated weights for policy 1, policy_version 1682159 (0.0010) [2023-12-26 13:07:03,070][123090] Updated weights for policy 1, policy_version 1682169 (0.0009) [2023-12-26 13:07:03,204][123091] Updated weights for policy 0, policy_version 1693425 (0.0006) [2023-12-26 13:07:03,264][123091] Updated weights for policy 0, policy_version 1693435 (0.0005) [2023-12-26 13:07:03,319][123091] Updated weights for policy 0, policy_version 1693445 (0.0005) [2023-12-26 13:07:03,373][123091] Updated weights for policy 0, policy_version 1693455 (0.0005) [2023-12-26 13:07:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 864165888. Throughput: 0: 8937.2, 1: 8638.1. Samples: 864179016. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:03,785][121949] Avg episode reward: [(0, '6177.982'), (1, '5763.514')] [2023-12-26 13:07:03,957][123090] Updated weights for policy 1, policy_version 1682179 (0.0008) [2023-12-26 13:07:04,024][123090] Updated weights for policy 1, policy_version 1682189 (0.0006) [2023-12-26 13:07:04,050][123091] Updated weights for policy 0, policy_version 1693465 (0.0005) [2023-12-26 13:07:04,081][123090] Updated weights for policy 1, policy_version 1682199 (0.0006) [2023-12-26 13:07:04,119][123091] Updated weights for policy 0, policy_version 1693475 (0.0006) [2023-12-26 13:07:04,192][123091] Updated weights for policy 0, policy_version 1693485 (0.0006) [2023-12-26 13:07:04,783][123090] Updated weights for policy 1, policy_version 1682209 (0.0010) [2023-12-26 13:07:04,831][123090] Updated weights for policy 1, policy_version 1682219 (0.0010) [2023-12-26 13:07:04,845][123091] Updated weights for policy 0, policy_version 1693495 (0.0005) [2023-12-26 13:07:04,878][123090] Updated weights for policy 1, policy_version 1682229 (0.0010) [2023-12-26 13:07:04,894][123091] Updated weights for policy 0, policy_version 1693505 (0.0005) [2023-12-26 13:07:04,945][123090] Updated weights for policy 1, policy_version 1682239 (0.0010) [2023-12-26 13:07:04,947][123091] Updated weights for policy 0, policy_version 1693515 (0.0008) [2023-12-26 13:07:05,764][123090] Updated weights for policy 1, policy_version 1682249 (0.0010) [2023-12-26 13:07:05,787][123091] Updated weights for policy 0, policy_version 1693525 (0.0008) [2023-12-26 13:07:05,834][123090] Updated weights for policy 1, policy_version 1682259 (0.0006) [2023-12-26 13:07:05,855][123091] Updated weights for policy 0, policy_version 1693535 (0.0009) [2023-12-26 13:07:05,900][123090] Updated weights for policy 1, policy_version 1682269 (0.0007) [2023-12-26 13:07:05,916][123091] Updated weights for policy 0, policy_version 1693545 (0.0007) [2023-12-26 13:07:06,668][123090] Updated weights for policy 1, policy_version 1682279 (0.0008) [2023-12-26 13:07:06,741][123090] Updated weights for policy 1, policy_version 1682289 (0.0005) [2023-12-26 13:07:06,787][123091] Updated weights for policy 0, policy_version 1693555 (0.0008) [2023-12-26 13:07:06,811][123090] Updated weights for policy 1, policy_version 1682299 (0.0007) [2023-12-26 13:07:06,840][123091] Updated weights for policy 0, policy_version 1693565 (0.0006) [2023-12-26 13:07:06,897][123091] Updated weights for policy 0, policy_version 1693576 (0.0009) [2023-12-26 13:07:07,528][123090] Updated weights for policy 1, policy_version 1682309 (0.0009) [2023-12-26 13:07:07,591][123090] Updated weights for policy 1, policy_version 1682319 (0.0009) [2023-12-26 13:07:07,660][123090] Updated weights for policy 1, policy_version 1682329 (0.0008) [2023-12-26 13:07:07,795][123091] Updated weights for policy 0, policy_version 1693586 (0.0009) [2023-12-26 13:07:07,864][123091] Updated weights for policy 0, policy_version 1693596 (0.0006) [2023-12-26 13:07:07,925][123091] Updated weights for policy 0, policy_version 1693606 (0.0006) [2023-12-26 13:07:07,979][123091] Updated weights for policy 0, policy_version 1693616 (0.0009) [2023-12-26 13:07:08,533][123090] Updated weights for policy 1, policy_version 1682339 (0.0010) [2023-12-26 13:07:08,605][123090] Updated weights for policy 1, policy_version 1682349 (0.0011) [2023-12-26 13:07:08,617][123091] Updated weights for policy 0, policy_version 1693626 (0.0006) [2023-12-26 13:07:08,668][123090] Updated weights for policy 1, policy_version 1682359 (0.0011) [2023-12-26 13:07:08,675][123091] Updated weights for policy 0, policy_version 1693636 (0.0006) [2023-12-26 13:07:08,740][123091] Updated weights for policy 0, policy_version 1693646 (0.0006) [2023-12-26 13:07:08,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 864264192. Throughput: 0: 8968.0, 1: 8692.4. Samples: 864233952. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:08,785][121949] Avg episode reward: [(0, '6214.929'), (1, '5825.634')] [2023-12-26 13:07:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001693648_433577984.pth... [2023-12-26 13:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001682368_430686208.pth... [2023-12-26 13:07:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001692592_433307648.pth [2023-12-26 13:07:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001681344_430424064.pth [2023-12-26 13:07:09,492][123090] Updated weights for policy 1, policy_version 1682369 (0.0010) [2023-12-26 13:07:09,566][123090] Updated weights for policy 1, policy_version 1682379 (0.0006) [2023-12-26 13:07:09,609][123091] Updated weights for policy 0, policy_version 1693656 (0.0008) [2023-12-26 13:07:09,628][123090] Updated weights for policy 1, policy_version 1682389 (0.0009) [2023-12-26 13:07:09,665][123091] Updated weights for policy 0, policy_version 1693666 (0.0007) [2023-12-26 13:07:09,692][123090] Updated weights for policy 1, policy_version 1682399 (0.0009) [2023-12-26 13:07:09,724][123091] Updated weights for policy 0, policy_version 1693676 (0.0005) [2023-12-26 13:07:10,427][123090] Updated weights for policy 1, policy_version 1682409 (0.0007) [2023-12-26 13:07:10,503][123090] Updated weights for policy 1, policy_version 1682419 (0.0010) [2023-12-26 13:07:10,556][123091] Updated weights for policy 0, policy_version 1693686 (0.0010) [2023-12-26 13:07:10,569][123090] Updated weights for policy 1, policy_version 1682429 (0.0010) [2023-12-26 13:07:10,623][123091] Updated weights for policy 0, policy_version 1693696 (0.0010) [2023-12-26 13:07:10,689][123091] Updated weights for policy 0, policy_version 1693706 (0.0010) [2023-12-26 13:07:11,347][123090] Updated weights for policy 1, policy_version 1682439 (0.0011) [2023-12-26 13:07:11,425][123090] Updated weights for policy 1, policy_version 1682449 (0.0009) [2023-12-26 13:07:11,498][123090] Updated weights for policy 1, policy_version 1682459 (0.0009) [2023-12-26 13:07:11,545][123091] Updated weights for policy 0, policy_version 1693716 (0.0008) [2023-12-26 13:07:11,623][123091] Updated weights for policy 0, policy_version 1693726 (0.0006) [2023-12-26 13:07:11,697][123091] Updated weights for policy 0, policy_version 1693736 (0.0009) [2023-12-26 13:07:12,200][123090] Updated weights for policy 1, policy_version 1682469 (0.0010) [2023-12-26 13:07:12,266][123090] Updated weights for policy 1, policy_version 1682479 (0.0009) [2023-12-26 13:07:12,335][123090] Updated weights for policy 1, policy_version 1682489 (0.0010) [2023-12-26 13:07:12,497][123091] Updated weights for policy 0, policy_version 1693746 (0.0010) [2023-12-26 13:07:12,559][123091] Updated weights for policy 0, policy_version 1693756 (0.0009) [2023-12-26 13:07:12,627][123091] Updated weights for policy 0, policy_version 1693766 (0.0009) [2023-12-26 13:07:12,682][123091] Updated weights for policy 0, policy_version 1693776 (0.0009) [2023-12-26 13:07:13,191][123090] Updated weights for policy 1, policy_version 1682499 (0.0009) [2023-12-26 13:07:13,257][123090] Updated weights for policy 1, policy_version 1682509 (0.0010) [2023-12-26 13:07:13,321][123090] Updated weights for policy 1, policy_version 1682519 (0.0009) [2023-12-26 13:07:13,397][123091] Updated weights for policy 0, policy_version 1693786 (0.0008) [2023-12-26 13:07:13,459][123091] Updated weights for policy 0, policy_version 1693796 (0.0010) [2023-12-26 13:07:13,517][123091] Updated weights for policy 0, policy_version 1693806 (0.0010) [2023-12-26 13:07:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 864346112. Throughput: 0: 8881.4, 1: 8692.7. Samples: 864338028. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:13,784][121949] Avg episode reward: [(0, '6186.168'), (1, '5901.134')] [2023-12-26 13:07:14,088][123090] Updated weights for policy 1, policy_version 1682529 (0.0009) [2023-12-26 13:07:14,151][123090] Updated weights for policy 1, policy_version 1682539 (0.0010) [2023-12-26 13:07:14,209][123090] Updated weights for policy 1, policy_version 1682549 (0.0010) [2023-12-26 13:07:14,260][123090] Updated weights for policy 1, policy_version 1682559 (0.0010) [2023-12-26 13:07:14,396][123091] Updated weights for policy 0, policy_version 1693816 (0.0006) [2023-12-26 13:07:14,449][123091] Updated weights for policy 0, policy_version 1693826 (0.0005) [2023-12-26 13:07:14,498][123091] Updated weights for policy 0, policy_version 1693836 (0.0005) [2023-12-26 13:07:15,074][123090] Updated weights for policy 1, policy_version 1682569 (0.0008) [2023-12-26 13:07:15,127][123090] Updated weights for policy 1, policy_version 1682579 (0.0008) [2023-12-26 13:07:15,179][123090] Updated weights for policy 1, policy_version 1682589 (0.0008) [2023-12-26 13:07:15,242][123091] Updated weights for policy 0, policy_version 1693846 (0.0006) [2023-12-26 13:07:15,303][123091] Updated weights for policy 0, policy_version 1693856 (0.0005) [2023-12-26 13:07:15,368][123091] Updated weights for policy 0, policy_version 1693866 (0.0005) [2023-12-26 13:07:15,868][123090] Updated weights for policy 1, policy_version 1682599 (0.0009) [2023-12-26 13:07:15,931][123090] Updated weights for policy 1, policy_version 1682609 (0.0010) [2023-12-26 13:07:15,990][123090] Updated weights for policy 1, policy_version 1682619 (0.0010) [2023-12-26 13:07:16,078][123091] Updated weights for policy 0, policy_version 1693876 (0.0007) [2023-12-26 13:07:16,124][123091] Updated weights for policy 0, policy_version 1693886 (0.0010) [2023-12-26 13:07:16,172][123091] Updated weights for policy 0, policy_version 1693896 (0.0008) [2023-12-26 13:07:16,731][123090] Updated weights for policy 1, policy_version 1682629 (0.0008) [2023-12-26 13:07:16,780][123090] Updated weights for policy 1, policy_version 1682639 (0.0005) [2023-12-26 13:07:16,838][123090] Updated weights for policy 1, policy_version 1682649 (0.0006) [2023-12-26 13:07:17,090][123091] Updated weights for policy 0, policy_version 1693906 (0.0009) [2023-12-26 13:07:17,142][123091] Updated weights for policy 0, policy_version 1693916 (0.0010) [2023-12-26 13:07:17,204][123091] Updated weights for policy 0, policy_version 1693926 (0.0010) [2023-12-26 13:07:17,251][123091] Updated weights for policy 0, policy_version 1693936 (0.0010) [2023-12-26 13:07:17,512][123090] Updated weights for policy 1, policy_version 1682659 (0.0007) [2023-12-26 13:07:17,568][123090] Updated weights for policy 1, policy_version 1682669 (0.0009) [2023-12-26 13:07:17,635][123090] Updated weights for policy 1, policy_version 1682679 (0.0009) [2023-12-26 13:07:18,017][123091] Updated weights for policy 0, policy_version 1693946 (0.0006) [2023-12-26 13:07:18,073][123091] Updated weights for policy 0, policy_version 1693956 (0.0011) [2023-12-26 13:07:18,127][123091] Updated weights for policy 0, policy_version 1693966 (0.0005) [2023-12-26 13:07:18,361][123090] Updated weights for policy 1, policy_version 1682689 (0.0009) [2023-12-26 13:07:18,423][123090] Updated weights for policy 1, policy_version 1682699 (0.0009) [2023-12-26 13:07:18,492][123090] Updated weights for policy 1, policy_version 1682709 (0.0009) [2023-12-26 13:07:18,557][123090] Updated weights for policy 1, policy_version 1682719 (0.0009) [2023-12-26 13:07:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 864436224. Throughput: 0: 8933.4, 1: 8671.8. Samples: 864447652. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:18,785][121949] Avg episode reward: [(0, '5965.412'), (1, '5771.831')] [2023-12-26 13:07:18,867][123091] Updated weights for policy 0, policy_version 1693976 (0.0005) [2023-12-26 13:07:18,927][123091] Updated weights for policy 0, policy_version 1693986 (0.0005) [2023-12-26 13:07:18,989][123091] Updated weights for policy 0, policy_version 1693996 (0.0005) [2023-12-26 13:07:19,357][123090] Updated weights for policy 1, policy_version 1682729 (0.0010) [2023-12-26 13:07:19,427][123090] Updated weights for policy 1, policy_version 1682739 (0.0008) [2023-12-26 13:07:19,502][123090] Updated weights for policy 1, policy_version 1682749 (0.0008) [2023-12-26 13:07:19,792][123091] Updated weights for policy 0, policy_version 1694006 (0.0008) [2023-12-26 13:07:19,859][123091] Updated weights for policy 0, policy_version 1694016 (0.0009) [2023-12-26 13:07:19,926][123091] Updated weights for policy 0, policy_version 1694026 (0.0008) [2023-12-26 13:07:20,394][123090] Updated weights for policy 1, policy_version 1682759 (0.0006) [2023-12-26 13:07:20,465][123090] Updated weights for policy 1, policy_version 1682769 (0.0009) [2023-12-26 13:07:20,532][123090] Updated weights for policy 1, policy_version 1682779 (0.0010) [2023-12-26 13:07:20,657][123091] Updated weights for policy 0, policy_version 1694036 (0.0008) [2023-12-26 13:07:20,709][123091] Updated weights for policy 0, policy_version 1694046 (0.0006) [2023-12-26 13:07:20,763][123091] Updated weights for policy 0, policy_version 1694056 (0.0005) [2023-12-26 13:07:21,444][123090] Updated weights for policy 1, policy_version 1682789 (0.0010) [2023-12-26 13:07:21,518][123090] Updated weights for policy 1, policy_version 1682799 (0.0008) [2023-12-26 13:07:21,531][123091] Updated weights for policy 0, policy_version 1694066 (0.0007) [2023-12-26 13:07:21,577][123090] Updated weights for policy 1, policy_version 1682809 (0.0006) [2023-12-26 13:07:21,604][123091] Updated weights for policy 0, policy_version 1694076 (0.0011) [2023-12-26 13:07:21,668][123091] Updated weights for policy 0, policy_version 1694086 (0.0013) [2023-12-26 13:07:21,742][123091] Updated weights for policy 0, policy_version 1694096 (0.0009) [2023-12-26 13:07:22,414][123090] Updated weights for policy 1, policy_version 1682819 (0.0008) [2023-12-26 13:07:22,464][123090] Updated weights for policy 1, policy_version 1682829 (0.0009) [2023-12-26 13:07:22,515][123090] Updated weights for policy 1, policy_version 1682839 (0.0009) [2023-12-26 13:07:22,611][123091] Updated weights for policy 0, policy_version 1694106 (0.0009) [2023-12-26 13:07:22,670][123091] Updated weights for policy 0, policy_version 1694116 (0.0009) [2023-12-26 13:07:22,721][123091] Updated weights for policy 0, policy_version 1694126 (0.0010) [2023-12-26 13:07:23,363][123090] Updated weights for policy 1, policy_version 1682849 (0.0009) [2023-12-26 13:07:23,432][123090] Updated weights for policy 1, policy_version 1682859 (0.0009) [2023-12-26 13:07:23,487][123090] Updated weights for policy 1, policy_version 1682869 (0.0009) [2023-12-26 13:07:23,536][123090] Updated weights for policy 1, policy_version 1682879 (0.0009) [2023-12-26 13:07:23,560][123091] Updated weights for policy 0, policy_version 1694136 (0.0010) [2023-12-26 13:07:23,618][123091] Updated weights for policy 0, policy_version 1694146 (0.0010) [2023-12-26 13:07:23,682][123091] Updated weights for policy 0, policy_version 1694156 (0.0011) [2023-12-26 13:07:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 864526336. Throughput: 0: 8923.8, 1: 8670.5. Samples: 864499476. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:23,785][121949] Avg episode reward: [(0, '5965.761'), (1, '5565.931')] [2023-12-26 13:07:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001694160_433709056.pth... [2023-12-26 13:07:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001682880_430817280.pth... [2023-12-26 13:07:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001681856_430555136.pth [2023-12-26 13:07:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001693104_433438720.pth [2023-12-26 13:07:24,216][123090] Updated weights for policy 1, policy_version 1682889 (0.0006) [2023-12-26 13:07:24,286][123090] Updated weights for policy 1, policy_version 1682899 (0.0005) [2023-12-26 13:07:24,345][123090] Updated weights for policy 1, policy_version 1682909 (0.0011) [2023-12-26 13:07:24,498][123091] Updated weights for policy 0, policy_version 1694166 (0.0008) [2023-12-26 13:07:24,556][123091] Updated weights for policy 0, policy_version 1694176 (0.0009) [2023-12-26 13:07:24,615][123091] Updated weights for policy 0, policy_version 1694186 (0.0009) [2023-12-26 13:07:25,035][123090] Updated weights for policy 1, policy_version 1682919 (0.0008) [2023-12-26 13:07:25,088][123090] Updated weights for policy 1, policy_version 1682929 (0.0006) [2023-12-26 13:07:25,136][123090] Updated weights for policy 1, policy_version 1682939 (0.0005) [2023-12-26 13:07:25,475][123091] Updated weights for policy 0, policy_version 1694196 (0.0010) [2023-12-26 13:07:25,523][123091] Updated weights for policy 0, policy_version 1694206 (0.0008) [2023-12-26 13:07:25,570][123091] Updated weights for policy 0, policy_version 1694216 (0.0009) [2023-12-26 13:07:25,874][123090] Updated weights for policy 1, policy_version 1682949 (0.0008) [2023-12-26 13:07:25,944][123090] Updated weights for policy 1, policy_version 1682959 (0.0010) [2023-12-26 13:07:26,002][123090] Updated weights for policy 1, policy_version 1682969 (0.0010) [2023-12-26 13:07:26,403][123091] Updated weights for policy 0, policy_version 1694226 (0.0009) [2023-12-26 13:07:26,463][123091] Updated weights for policy 0, policy_version 1694236 (0.0009) [2023-12-26 13:07:26,526][123091] Updated weights for policy 0, policy_version 1694246 (0.0009) [2023-12-26 13:07:26,592][123091] Updated weights for policy 0, policy_version 1694256 (0.0009) [2023-12-26 13:07:26,822][123090] Updated weights for policy 1, policy_version 1682979 (0.0011) [2023-12-26 13:07:26,881][123090] Updated weights for policy 1, policy_version 1682989 (0.0010) [2023-12-26 13:07:26,955][123090] Updated weights for policy 1, policy_version 1682999 (0.0011) [2023-12-26 13:07:27,419][123091] Updated weights for policy 0, policy_version 1694266 (0.0006) [2023-12-26 13:07:27,483][123091] Updated weights for policy 0, policy_version 1694276 (0.0006) [2023-12-26 13:07:27,547][123091] Updated weights for policy 0, policy_version 1694286 (0.0008) [2023-12-26 13:07:27,698][123090] Updated weights for policy 1, policy_version 1683009 (0.0010) [2023-12-26 13:07:27,764][123090] Updated weights for policy 1, policy_version 1683019 (0.0005) [2023-12-26 13:07:27,824][123090] Updated weights for policy 1, policy_version 1683029 (0.0005) [2023-12-26 13:07:27,870][123090] Updated weights for policy 1, policy_version 1683039 (0.0005) [2023-12-26 13:07:28,172][123091] Updated weights for policy 0, policy_version 1694296 (0.0005) [2023-12-26 13:07:28,215][123091] Updated weights for policy 0, policy_version 1694306 (0.0005) [2023-12-26 13:07:28,264][123091] Updated weights for policy 0, policy_version 1694316 (0.0005) [2023-12-26 13:07:28,660][123090] Updated weights for policy 1, policy_version 1683049 (0.0010) [2023-12-26 13:07:28,722][123090] Updated weights for policy 1, policy_version 1683059 (0.0010) [2023-12-26 13:07:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 864608256. Throughput: 0: 8910.4, 1: 8742.8. Samples: 864605952. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:28,786][121949] Avg episode reward: [(0, '6115.436'), (1, '5562.479')] [2023-12-26 13:07:28,793][123090] Updated weights for policy 1, policy_version 1683069 (0.0011) [2023-12-26 13:07:29,015][123091] Updated weights for policy 0, policy_version 1694326 (0.0005) [2023-12-26 13:07:29,070][123091] Updated weights for policy 0, policy_version 1694336 (0.0006) [2023-12-26 13:07:29,122][123091] Updated weights for policy 0, policy_version 1694346 (0.0006) [2023-12-26 13:07:29,543][123090] Updated weights for policy 1, policy_version 1683079 (0.0011) [2023-12-26 13:07:29,612][123090] Updated weights for policy 1, policy_version 1683089 (0.0010) [2023-12-26 13:07:29,679][123090] Updated weights for policy 1, policy_version 1683099 (0.0010) [2023-12-26 13:07:29,923][123091] Updated weights for policy 0, policy_version 1694356 (0.0007) [2023-12-26 13:07:29,987][123091] Updated weights for policy 0, policy_version 1694366 (0.0010) [2023-12-26 13:07:30,053][123091] Updated weights for policy 0, policy_version 1694376 (0.0010) [2023-12-26 13:07:30,374][123090] Updated weights for policy 1, policy_version 1683109 (0.0009) [2023-12-26 13:07:30,422][123090] Updated weights for policy 1, policy_version 1683119 (0.0005) [2023-12-26 13:07:30,475][123090] Updated weights for policy 1, policy_version 1683129 (0.0005) [2023-12-26 13:07:30,954][123091] Updated weights for policy 0, policy_version 1694386 (0.0009) [2023-12-26 13:07:31,019][123091] Updated weights for policy 0, policy_version 1694396 (0.0009) [2023-12-26 13:07:31,086][123091] Updated weights for policy 0, policy_version 1694406 (0.0010) [2023-12-26 13:07:31,087][123090] Updated weights for policy 1, policy_version 1683139 (0.0006) [2023-12-26 13:07:31,157][123090] Updated weights for policy 1, policy_version 1683149 (0.0006) [2023-12-26 13:07:31,217][123090] Updated weights for policy 1, policy_version 1683159 (0.0009) [2023-12-26 13:07:31,968][123091] Updated weights for policy 0, policy_version 1694417 (0.0009) [2023-12-26 13:07:32,004][123090] Updated weights for policy 1, policy_version 1683169 (0.0010) [2023-12-26 13:07:32,019][123091] Updated weights for policy 0, policy_version 1694427 (0.0010) [2023-12-26 13:07:32,066][123090] Updated weights for policy 1, policy_version 1683179 (0.0009) [2023-12-26 13:07:32,071][123091] Updated weights for policy 0, policy_version 1694437 (0.0007) [2023-12-26 13:07:32,120][123091] Updated weights for policy 0, policy_version 1694447 (0.0009) [2023-12-26 13:07:32,125][123090] Updated weights for policy 1, policy_version 1683189 (0.0009) [2023-12-26 13:07:32,180][123090] Updated weights for policy 1, policy_version 1683199 (0.0009) [2023-12-26 13:07:32,971][123091] Updated weights for policy 0, policy_version 1694457 (0.0009) [2023-12-26 13:07:33,017][123091] Updated weights for policy 0, policy_version 1694467 (0.0007) [2023-12-26 13:07:33,027][123090] Updated weights for policy 1, policy_version 1683209 (0.0009) [2023-12-26 13:07:33,068][123091] Updated weights for policy 0, policy_version 1694477 (0.0007) [2023-12-26 13:07:33,086][123090] Updated weights for policy 1, policy_version 1683219 (0.0009) [2023-12-26 13:07:33,149][123090] Updated weights for policy 1, policy_version 1683229 (0.0009) [2023-12-26 13:07:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 864698368. Throughput: 0: 8866.1, 1: 8861.6. Samples: 864713984. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:33,785][121949] Avg episode reward: [(0, '6114.578'), (1, '5794.781')] [2023-12-26 13:07:33,845][123091] Updated weights for policy 0, policy_version 1694487 (0.0005) [2023-12-26 13:07:33,902][123091] Updated weights for policy 0, policy_version 1694497 (0.0006) [2023-12-26 13:07:33,958][123090] Updated weights for policy 1, policy_version 1683239 (0.0006) [2023-12-26 13:07:33,962][123091] Updated weights for policy 0, policy_version 1694507 (0.0008) [2023-12-26 13:07:34,009][123090] Updated weights for policy 1, policy_version 1683249 (0.0006) [2023-12-26 13:07:34,062][123090] Updated weights for policy 1, policy_version 1683259 (0.0009) [2023-12-26 13:07:34,734][123091] Updated weights for policy 0, policy_version 1694517 (0.0010) [2023-12-26 13:07:34,800][123091] Updated weights for policy 0, policy_version 1694527 (0.0011) [2023-12-26 13:07:34,825][123090] Updated weights for policy 1, policy_version 1683269 (0.0008) [2023-12-26 13:07:34,862][123091] Updated weights for policy 0, policy_version 1694537 (0.0011) [2023-12-26 13:07:34,878][123090] Updated weights for policy 1, policy_version 1683279 (0.0007) [2023-12-26 13:07:34,931][123090] Updated weights for policy 1, policy_version 1683289 (0.0008) [2023-12-26 13:07:35,621][123090] Updated weights for policy 1, policy_version 1683299 (0.0006) [2023-12-26 13:07:35,634][123091] Updated weights for policy 0, policy_version 1694547 (0.0009) [2023-12-26 13:07:35,669][123090] Updated weights for policy 1, policy_version 1683309 (0.0005) [2023-12-26 13:07:35,700][123091] Updated weights for policy 0, policy_version 1694557 (0.0006) [2023-12-26 13:07:35,717][123090] Updated weights for policy 1, policy_version 1683319 (0.0005) [2023-12-26 13:07:35,759][123091] Updated weights for policy 0, policy_version 1694567 (0.0007) [2023-12-26 13:07:36,375][123090] Updated weights for policy 1, policy_version 1683329 (0.0005) [2023-12-26 13:07:36,453][123090] Updated weights for policy 1, policy_version 1683339 (0.0006) [2023-12-26 13:07:36,456][123091] Updated weights for policy 0, policy_version 1694577 (0.0008) [2023-12-26 13:07:36,525][123091] Updated weights for policy 0, policy_version 1694587 (0.0009) [2023-12-26 13:07:36,528][123090] Updated weights for policy 1, policy_version 1683349 (0.0008) [2023-12-26 13:07:36,588][123091] Updated weights for policy 0, policy_version 1694597 (0.0006) [2023-12-26 13:07:36,597][123090] Updated weights for policy 1, policy_version 1683359 (0.0008) [2023-12-26 13:07:36,657][123091] Updated weights for policy 0, policy_version 1694607 (0.0005) [2023-12-26 13:07:37,305][123091] Updated weights for policy 0, policy_version 1694617 (0.0007) [2023-12-26 13:07:37,373][123091] Updated weights for policy 0, policy_version 1694627 (0.0005) [2023-12-26 13:07:37,448][123091] Updated weights for policy 0, policy_version 1694637 (0.0006) [2023-12-26 13:07:37,500][123090] Updated weights for policy 1, policy_version 1683369 (0.0009) [2023-12-26 13:07:37,562][123090] Updated weights for policy 1, policy_version 1683379 (0.0010) [2023-12-26 13:07:37,622][123090] Updated weights for policy 1, policy_version 1683389 (0.0010) [2023-12-26 13:07:38,050][123091] Updated weights for policy 0, policy_version 1694647 (0.0005) [2023-12-26 13:07:38,109][123091] Updated weights for policy 0, policy_version 1694657 (0.0005) [2023-12-26 13:07:38,175][123091] Updated weights for policy 0, policy_version 1694667 (0.0011) [2023-12-26 13:07:38,545][123090] Updated weights for policy 1, policy_version 1683399 (0.0007) [2023-12-26 13:07:38,600][123090] Updated weights for policy 1, policy_version 1683409 (0.0010) [2023-12-26 13:07:38,663][123090] Updated weights for policy 1, policy_version 1683419 (0.0010) [2023-12-26 13:07:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 864796672. Throughput: 0: 8918.0, 1: 8944.3. Samples: 864771364. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:38,785][121949] Avg episode reward: [(0, '5975.710'), (1, '5892.807')] [2023-12-26 13:07:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001683424_430956544.pth... [2023-12-26 13:07:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001694672_433840128.pth... [2023-12-26 13:07:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001682368_430686208.pth [2023-12-26 13:07:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001693648_433577984.pth [2023-12-26 13:07:38,958][123091] Updated weights for policy 0, policy_version 1694677 (0.0009) [2023-12-26 13:07:39,022][123091] Updated weights for policy 0, policy_version 1694687 (0.0009) [2023-12-26 13:07:39,088][123091] Updated weights for policy 0, policy_version 1694697 (0.0010) [2023-12-26 13:07:39,467][123090] Updated weights for policy 1, policy_version 1683429 (0.0009) [2023-12-26 13:07:39,520][123090] Updated weights for policy 1, policy_version 1683439 (0.0008) [2023-12-26 13:07:39,583][123090] Updated weights for policy 1, policy_version 1683449 (0.0008) [2023-12-26 13:07:39,950][123091] Updated weights for policy 0, policy_version 1694707 (0.0010) [2023-12-26 13:07:40,013][123091] Updated weights for policy 0, policy_version 1694717 (0.0010) [2023-12-26 13:07:40,078][123091] Updated weights for policy 0, policy_version 1694727 (0.0009) [2023-12-26 13:07:40,404][123090] Updated weights for policy 1, policy_version 1683459 (0.0010) [2023-12-26 13:07:40,458][123090] Updated weights for policy 1, policy_version 1683469 (0.0010) [2023-12-26 13:07:40,521][123090] Updated weights for policy 1, policy_version 1683479 (0.0009) [2023-12-26 13:07:40,941][123091] Updated weights for policy 0, policy_version 1694737 (0.0010) [2023-12-26 13:07:41,004][123091] Updated weights for policy 0, policy_version 1694747 (0.0010) [2023-12-26 13:07:41,074][123091] Updated weights for policy 0, policy_version 1694757 (0.0009) [2023-12-26 13:07:41,138][123091] Updated weights for policy 0, policy_version 1694767 (0.0010) [2023-12-26 13:07:41,346][123090] Updated weights for policy 1, policy_version 1683489 (0.0009) [2023-12-26 13:07:41,414][123090] Updated weights for policy 1, policy_version 1683499 (0.0009) [2023-12-26 13:07:41,471][123090] Updated weights for policy 1, policy_version 1683509 (0.0009) [2023-12-26 13:07:41,545][123090] Updated weights for policy 1, policy_version 1683519 (0.0009) [2023-12-26 13:07:41,983][123091] Updated weights for policy 0, policy_version 1694777 (0.0006) [2023-12-26 13:07:42,055][123091] Updated weights for policy 0, policy_version 1694787 (0.0007) [2023-12-26 13:07:42,117][123091] Updated weights for policy 0, policy_version 1694797 (0.0010) [2023-12-26 13:07:42,432][123090] Updated weights for policy 1, policy_version 1683529 (0.0009) [2023-12-26 13:07:42,493][123090] Updated weights for policy 1, policy_version 1683539 (0.0009) [2023-12-26 13:07:42,550][123090] Updated weights for policy 1, policy_version 1683549 (0.0009) [2023-12-26 13:07:42,904][123091] Updated weights for policy 0, policy_version 1694807 (0.0011) [2023-12-26 13:07:42,974][123091] Updated weights for policy 0, policy_version 1694817 (0.0011) [2023-12-26 13:07:43,043][123091] Updated weights for policy 0, policy_version 1694827 (0.0006) [2023-12-26 13:07:43,437][123090] Updated weights for policy 1, policy_version 1683559 (0.0009) [2023-12-26 13:07:43,490][123090] Updated weights for policy 1, policy_version 1683569 (0.0010) [2023-12-26 13:07:43,545][123090] Updated weights for policy 1, policy_version 1683579 (0.0008) [2023-12-26 13:07:43,644][123091] Updated weights for policy 0, policy_version 1694837 (0.0008) [2023-12-26 13:07:43,691][123091] Updated weights for policy 0, policy_version 1694847 (0.0010) [2023-12-26 13:07:43,738][123091] Updated weights for policy 0, policy_version 1694857 (0.0005) [2023-12-26 13:07:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 864886784. Throughput: 0: 8921.0, 1: 8834.1. Samples: 864873424. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:43,785][121949] Avg episode reward: [(0, '6003.373'), (1, '5792.251')] [2023-12-26 13:07:44,357][123090] Updated weights for policy 1, policy_version 1683589 (0.0006) [2023-12-26 13:07:44,421][123090] Updated weights for policy 1, policy_version 1683599 (0.0005) [2023-12-26 13:07:44,480][123090] Updated weights for policy 1, policy_version 1683609 (0.0005) [2023-12-26 13:07:44,560][123091] Updated weights for policy 0, policy_version 1694867 (0.0007) [2023-12-26 13:07:44,618][123091] Updated weights for policy 0, policy_version 1694877 (0.0010) [2023-12-26 13:07:44,684][123091] Updated weights for policy 0, policy_version 1694887 (0.0010) [2023-12-26 13:07:45,197][123090] Updated weights for policy 1, policy_version 1683619 (0.0006) [2023-12-26 13:07:45,272][123090] Updated weights for policy 1, policy_version 1683629 (0.0006) [2023-12-26 13:07:45,339][123090] Updated weights for policy 1, policy_version 1683639 (0.0006) [2023-12-26 13:07:45,438][123091] Updated weights for policy 0, policy_version 1694897 (0.0007) [2023-12-26 13:07:45,504][123091] Updated weights for policy 0, policy_version 1694907 (0.0005) [2023-12-26 13:07:45,558][123091] Updated weights for policy 0, policy_version 1694917 (0.0006) [2023-12-26 13:07:45,614][123091] Updated weights for policy 0, policy_version 1694927 (0.0006) [2023-12-26 13:07:46,135][123090] Updated weights for policy 1, policy_version 1683649 (0.0005) [2023-12-26 13:07:46,177][123091] Updated weights for policy 0, policy_version 1694937 (0.0005) [2023-12-26 13:07:46,188][123090] Updated weights for policy 1, policy_version 1683659 (0.0005) [2023-12-26 13:07:46,227][123091] Updated weights for policy 0, policy_version 1694947 (0.0005) [2023-12-26 13:07:46,251][123090] Updated weights for policy 1, policy_version 1683669 (0.0005) [2023-12-26 13:07:46,291][123091] Updated weights for policy 0, policy_version 1694957 (0.0006) [2023-12-26 13:07:46,326][123090] Updated weights for policy 1, policy_version 1683679 (0.0005) [2023-12-26 13:07:46,941][123091] Updated weights for policy 0, policy_version 1694967 (0.0006) [2023-12-26 13:07:46,986][123091] Updated weights for policy 0, policy_version 1694977 (0.0007) [2023-12-26 13:07:47,004][123090] Updated weights for policy 1, policy_version 1683689 (0.0009) [2023-12-26 13:07:47,032][123091] Updated weights for policy 0, policy_version 1694987 (0.0008) [2023-12-26 13:07:47,051][123090] Updated weights for policy 1, policy_version 1683699 (0.0006) [2023-12-26 13:07:47,105][123090] Updated weights for policy 1, policy_version 1683709 (0.0005) [2023-12-26 13:07:47,891][123090] Updated weights for policy 1, policy_version 1683719 (0.0009) [2023-12-26 13:07:47,902][123091] Updated weights for policy 0, policy_version 1694997 (0.0008) [2023-12-26 13:07:47,945][123090] Updated weights for policy 1, policy_version 1683729 (0.0010) [2023-12-26 13:07:47,961][123091] Updated weights for policy 0, policy_version 1695007 (0.0007) [2023-12-26 13:07:48,000][123090] Updated weights for policy 1, policy_version 1683739 (0.0010) [2023-12-26 13:07:48,020][123091] Updated weights for policy 0, policy_version 1695017 (0.0007) [2023-12-26 13:07:48,716][123090] Updated weights for policy 1, policy_version 1683749 (0.0008) [2023-12-26 13:07:48,767][123090] Updated weights for policy 1, policy_version 1683759 (0.0010) [2023-12-26 13:07:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 864968704. Throughput: 0: 8941.8, 1: 8979.9. Samples: 864985492. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:48,785][121949] Avg episode reward: [(0, '5878.479'), (1, '5696.196')] [2023-12-26 13:07:48,822][123090] Updated weights for policy 1, policy_version 1683769 (0.0010) [2023-12-26 13:07:48,912][123091] Updated weights for policy 0, policy_version 1695027 (0.0010) [2023-12-26 13:07:48,985][123091] Updated weights for policy 0, policy_version 1695037 (0.0009) [2023-12-26 13:07:49,048][123091] Updated weights for policy 0, policy_version 1695047 (0.0010) [2023-12-26 13:07:49,603][123090] Updated weights for policy 1, policy_version 1683779 (0.0009) [2023-12-26 13:07:49,677][123090] Updated weights for policy 1, policy_version 1683789 (0.0005) [2023-12-26 13:07:49,750][123090] Updated weights for policy 1, policy_version 1683799 (0.0009) [2023-12-26 13:07:49,958][123091] Updated weights for policy 0, policy_version 1695057 (0.0010) [2023-12-26 13:07:50,011][123091] Updated weights for policy 0, policy_version 1695067 (0.0010) [2023-12-26 13:07:50,063][123091] Updated weights for policy 0, policy_version 1695077 (0.0009) [2023-12-26 13:07:50,128][123091] Updated weights for policy 0, policy_version 1695087 (0.0010) [2023-12-26 13:07:50,456][123090] Updated weights for policy 1, policy_version 1683809 (0.0010) [2023-12-26 13:07:50,522][123090] Updated weights for policy 1, policy_version 1683819 (0.0008) [2023-12-26 13:07:50,606][123090] Updated weights for policy 1, policy_version 1683829 (0.0010) [2023-12-26 13:07:50,661][123090] Updated weights for policy 1, policy_version 1683839 (0.0010) [2023-12-26 13:07:50,857][123091] Updated weights for policy 0, policy_version 1695097 (0.0006) [2023-12-26 13:07:50,928][123091] Updated weights for policy 0, policy_version 1695107 (0.0007) [2023-12-26 13:07:50,990][123091] Updated weights for policy 0, policy_version 1695117 (0.0009) [2023-12-26 13:07:51,407][123090] Updated weights for policy 1, policy_version 1683849 (0.0007) [2023-12-26 13:07:51,477][123090] Updated weights for policy 1, policy_version 1683859 (0.0009) [2023-12-26 13:07:51,534][123090] Updated weights for policy 1, policy_version 1683869 (0.0010) [2023-12-26 13:07:51,856][123091] Updated weights for policy 0, policy_version 1695127 (0.0010) [2023-12-26 13:07:51,910][123091] Updated weights for policy 0, policy_version 1695137 (0.0009) [2023-12-26 13:07:51,962][123091] Updated weights for policy 0, policy_version 1695147 (0.0008) [2023-12-26 13:07:52,350][123090] Updated weights for policy 1, policy_version 1683879 (0.0010) [2023-12-26 13:07:52,417][123090] Updated weights for policy 1, policy_version 1683889 (0.0008) [2023-12-26 13:07:52,475][123090] Updated weights for policy 1, policy_version 1683899 (0.0006) [2023-12-26 13:07:52,835][123091] Updated weights for policy 0, policy_version 1695157 (0.0010) [2023-12-26 13:07:52,907][123091] Updated weights for policy 0, policy_version 1695167 (0.0011) [2023-12-26 13:07:52,970][123091] Updated weights for policy 0, policy_version 1695177 (0.0011) [2023-12-26 13:07:53,252][123090] Updated weights for policy 1, policy_version 1683909 (0.0006) [2023-12-26 13:07:53,305][123090] Updated weights for policy 1, policy_version 1683919 (0.0009) [2023-12-26 13:07:53,362][123090] Updated weights for policy 1, policy_version 1683929 (0.0005) [2023-12-26 13:07:53,694][123091] Updated weights for policy 0, policy_version 1695187 (0.0009) [2023-12-26 13:07:53,751][123091] Updated weights for policy 0, policy_version 1695197 (0.0005) [2023-12-26 13:07:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 865058816. Throughput: 0: 8891.6, 1: 8973.6. Samples: 865037888. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:53,785][121949] Avg episode reward: [(0, '5993.131'), (1, '5660.480')] [2023-12-26 13:07:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001683936_431087616.pth... [2023-12-26 13:07:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001682880_430817280.pth [2023-12-26 13:07:53,805][123091] Updated weights for policy 0, policy_version 1695207 (0.0006) [2023-12-26 13:07:53,868][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001695216_433979392.pth... [2023-12-26 13:07:53,872][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001694160_433709056.pth [2023-12-26 13:07:54,136][123090] Updated weights for policy 1, policy_version 1683939 (0.0006) [2023-12-26 13:07:54,194][123090] Updated weights for policy 1, policy_version 1683949 (0.0010) [2023-12-26 13:07:54,264][123090] Updated weights for policy 1, policy_version 1683959 (0.0010) [2023-12-26 13:07:54,494][123091] Updated weights for policy 0, policy_version 1695217 (0.0005) [2023-12-26 13:07:54,540][123091] Updated weights for policy 0, policy_version 1695227 (0.0005) [2023-12-26 13:07:54,594][123091] Updated weights for policy 0, policy_version 1695237 (0.0008) [2023-12-26 13:07:54,665][123091] Updated weights for policy 0, policy_version 1695247 (0.0005) [2023-12-26 13:07:54,983][123090] Updated weights for policy 1, policy_version 1683969 (0.0010) [2023-12-26 13:07:55,033][123090] Updated weights for policy 1, policy_version 1683979 (0.0005) [2023-12-26 13:07:55,088][123090] Updated weights for policy 1, policy_version 1683989 (0.0006) [2023-12-26 13:07:55,151][123090] Updated weights for policy 1, policy_version 1683999 (0.0008) [2023-12-26 13:07:55,389][123091] Updated weights for policy 0, policy_version 1695257 (0.0009) [2023-12-26 13:07:55,442][123091] Updated weights for policy 0, policy_version 1695267 (0.0008) [2023-12-26 13:07:55,494][123091] Updated weights for policy 0, policy_version 1695277 (0.0009) [2023-12-26 13:07:55,900][123090] Updated weights for policy 1, policy_version 1684009 (0.0005) [2023-12-26 13:07:55,956][123090] Updated weights for policy 1, policy_version 1684019 (0.0005) [2023-12-26 13:07:56,021][123090] Updated weights for policy 1, policy_version 1684029 (0.0009) [2023-12-26 13:07:56,377][123091] Updated weights for policy 0, policy_version 1695287 (0.0009) [2023-12-26 13:07:56,431][123091] Updated weights for policy 0, policy_version 1695297 (0.0010) [2023-12-26 13:07:56,489][123091] Updated weights for policy 0, policy_version 1695307 (0.0009) [2023-12-26 13:07:56,771][123090] Updated weights for policy 1, policy_version 1684039 (0.0010) [2023-12-26 13:07:56,818][123090] Updated weights for policy 1, policy_version 1684049 (0.0008) [2023-12-26 13:07:56,870][123090] Updated weights for policy 1, policy_version 1684059 (0.0008) [2023-12-26 13:07:57,342][123091] Updated weights for policy 0, policy_version 1695317 (0.0008) [2023-12-26 13:07:57,399][123091] Updated weights for policy 0, policy_version 1695327 (0.0006) [2023-12-26 13:07:57,451][123091] Updated weights for policy 0, policy_version 1695337 (0.0007) [2023-12-26 13:07:57,672][123090] Updated weights for policy 1, policy_version 1684069 (0.0010) [2023-12-26 13:07:57,735][123090] Updated weights for policy 1, policy_version 1684079 (0.0010) [2023-12-26 13:07:57,796][123090] Updated weights for policy 1, policy_version 1684089 (0.0007) [2023-12-26 13:07:58,177][123091] Updated weights for policy 0, policy_version 1695347 (0.0010) [2023-12-26 13:07:58,235][123091] Updated weights for policy 0, policy_version 1695357 (0.0008) [2023-12-26 13:07:58,298][123091] Updated weights for policy 0, policy_version 1695367 (0.0007) [2023-12-26 13:07:58,630][123090] Updated weights for policy 1, policy_version 1684099 (0.0006) [2023-12-26 13:07:58,697][123090] Updated weights for policy 1, policy_version 1684109 (0.0008) [2023-12-26 13:07:58,765][123090] Updated weights for policy 1, policy_version 1684119 (0.0010) [2023-12-26 13:07:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 865148928. Throughput: 0: 8948.5, 1: 9020.3. Samples: 865146628. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:07:58,785][121949] Avg episode reward: [(0, '5970.757'), (1, '5822.217')] [2023-12-26 13:07:59,198][123091] Updated weights for policy 0, policy_version 1695377 (0.0008) [2023-12-26 13:07:59,269][123091] Updated weights for policy 0, policy_version 1695387 (0.0009) [2023-12-26 13:07:59,332][123091] Updated weights for policy 0, policy_version 1695397 (0.0010) [2023-12-26 13:07:59,400][123091] Updated weights for policy 0, policy_version 1695407 (0.0010) [2023-12-26 13:07:59,644][123090] Updated weights for policy 1, policy_version 1684129 (0.0008) [2023-12-26 13:07:59,701][123090] Updated weights for policy 1, policy_version 1684139 (0.0006) [2023-12-26 13:07:59,771][123090] Updated weights for policy 1, policy_version 1684149 (0.0006) [2023-12-26 13:07:59,841][123090] Updated weights for policy 1, policy_version 1684159 (0.0007) [2023-12-26 13:08:00,269][123091] Updated weights for policy 0, policy_version 1695417 (0.0006) [2023-12-26 13:08:00,326][123091] Updated weights for policy 0, policy_version 1695427 (0.0007) [2023-12-26 13:08:00,403][123091] Updated weights for policy 0, policy_version 1695437 (0.0006) [2023-12-26 13:08:00,569][123090] Updated weights for policy 1, policy_version 1684169 (0.0006) [2023-12-26 13:08:00,634][123090] Updated weights for policy 1, policy_version 1684179 (0.0005) [2023-12-26 13:08:00,691][123090] Updated weights for policy 1, policy_version 1684189 (0.0005) [2023-12-26 13:08:01,080][123091] Updated weights for policy 0, policy_version 1695447 (0.0007) [2023-12-26 13:08:01,151][123091] Updated weights for policy 0, policy_version 1695457 (0.0007) [2023-12-26 13:08:01,204][123091] Updated weights for policy 0, policy_version 1695467 (0.0008) [2023-12-26 13:08:01,356][123090] Updated weights for policy 1, policy_version 1684199 (0.0009) [2023-12-26 13:08:01,421][123090] Updated weights for policy 1, policy_version 1684209 (0.0009) [2023-12-26 13:08:01,481][123090] Updated weights for policy 1, policy_version 1684219 (0.0010) [2023-12-26 13:08:02,026][123091] Updated weights for policy 0, policy_version 1695477 (0.0010) [2023-12-26 13:08:02,094][123091] Updated weights for policy 0, policy_version 1695487 (0.0010) [2023-12-26 13:08:02,162][123091] Updated weights for policy 0, policy_version 1695497 (0.0009) [2023-12-26 13:08:02,349][123090] Updated weights for policy 1, policy_version 1684229 (0.0009) [2023-12-26 13:08:02,425][123090] Updated weights for policy 1, policy_version 1684239 (0.0009) [2023-12-26 13:08:02,487][123090] Updated weights for policy 1, policy_version 1684249 (0.0010) [2023-12-26 13:08:02,982][123091] Updated weights for policy 0, policy_version 1695507 (0.0009) [2023-12-26 13:08:03,038][123091] Updated weights for policy 0, policy_version 1695517 (0.0009) [2023-12-26 13:08:03,100][123091] Updated weights for policy 0, policy_version 1695527 (0.0009) [2023-12-26 13:08:03,276][123090] Updated weights for policy 1, policy_version 1684259 (0.0010) [2023-12-26 13:08:03,330][123090] Updated weights for policy 1, policy_version 1684269 (0.0010) [2023-12-26 13:08:03,381][123090] Updated weights for policy 1, policy_version 1684279 (0.0010) [2023-12-26 13:08:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 865239040. Throughput: 0: 8906.2, 1: 8958.9. Samples: 865251580. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:08:03,784][121949] Avg episode reward: [(0, '5987.077'), (1, '6000.859')] [2023-12-26 13:08:03,963][123091] Updated weights for policy 0, policy_version 1695537 (0.0009) [2023-12-26 13:08:04,023][123091] Updated weights for policy 0, policy_version 1695547 (0.0009) [2023-12-26 13:08:04,079][123091] Updated weights for policy 0, policy_version 1695557 (0.0009) [2023-12-26 13:08:04,135][123091] Updated weights for policy 0, policy_version 1695567 (0.0009) [2023-12-26 13:08:04,145][123090] Updated weights for policy 1, policy_version 1684289 (0.0010) [2023-12-26 13:08:04,197][123090] Updated weights for policy 1, policy_version 1684299 (0.0011) [2023-12-26 13:08:04,249][123090] Updated weights for policy 1, policy_version 1684309 (0.0010) [2023-12-26 13:08:04,302][123090] Updated weights for policy 1, policy_version 1684319 (0.0010) [2023-12-26 13:08:04,984][123091] Updated weights for policy 0, policy_version 1695577 (0.0008) [2023-12-26 13:08:05,042][123091] Updated weights for policy 0, policy_version 1695587 (0.0009) [2023-12-26 13:08:05,104][123091] Updated weights for policy 0, policy_version 1695597 (0.0009) [2023-12-26 13:08:05,126][123090] Updated weights for policy 1, policy_version 1684329 (0.0006) [2023-12-26 13:08:05,187][123090] Updated weights for policy 1, policy_version 1684339 (0.0005) [2023-12-26 13:08:05,234][123090] Updated weights for policy 1, policy_version 1684349 (0.0005) [2023-12-26 13:08:05,811][123091] Updated weights for policy 0, policy_version 1695607 (0.0008) [2023-12-26 13:08:05,859][123091] Updated weights for policy 0, policy_version 1695617 (0.0009) [2023-12-26 13:08:05,914][123091] Updated weights for policy 0, policy_version 1695627 (0.0008) [2023-12-26 13:08:06,001][123090] Updated weights for policy 1, policy_version 1684359 (0.0009) [2023-12-26 13:08:06,065][123090] Updated weights for policy 1, policy_version 1684369 (0.0008) [2023-12-26 13:08:06,130][123090] Updated weights for policy 1, policy_version 1684379 (0.0007) [2023-12-26 13:08:06,784][123091] Updated weights for policy 0, policy_version 1695637 (0.0009) [2023-12-26 13:08:06,843][123091] Updated weights for policy 0, policy_version 1695647 (0.0009) [2023-12-26 13:08:06,909][123091] Updated weights for policy 0, policy_version 1695657 (0.0010) [2023-12-26 13:08:06,960][123090] Updated weights for policy 1, policy_version 1684389 (0.0009) [2023-12-26 13:08:07,027][123090] Updated weights for policy 1, policy_version 1684399 (0.0009) [2023-12-26 13:08:07,080][123090] Updated weights for policy 1, policy_version 1684409 (0.0009) [2023-12-26 13:08:07,717][123091] Updated weights for policy 0, policy_version 1695667 (0.0009) [2023-12-26 13:08:07,770][123091] Updated weights for policy 0, policy_version 1695677 (0.0009) [2023-12-26 13:08:07,830][123091] Updated weights for policy 0, policy_version 1695687 (0.0010) [2023-12-26 13:08:07,925][123090] Updated weights for policy 1, policy_version 1684419 (0.0008) [2023-12-26 13:08:07,975][123090] Updated weights for policy 1, policy_version 1684429 (0.0009) [2023-12-26 13:08:08,029][123090] Updated weights for policy 1, policy_version 1684439 (0.0009) [2023-12-26 13:08:08,697][123091] Updated weights for policy 0, policy_version 1695697 (0.0009) [2023-12-26 13:08:08,767][123091] Updated weights for policy 0, policy_version 1695707 (0.0009) [2023-12-26 13:08:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 865320960. Throughput: 0: 8890.3, 1: 9012.8. Samples: 865305112. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:08:08,785][121949] Avg episode reward: [(0, '6072.967'), (1, '6007.117')] [2023-12-26 13:08:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001684448_431218688.pth... [2023-12-26 13:08:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001683424_430956544.pth [2023-12-26 13:08:08,835][123091] Updated weights for policy 0, policy_version 1695717 (0.0009) [2023-12-26 13:08:08,848][123090] Updated weights for policy 1, policy_version 1684449 (0.0009) [2023-12-26 13:08:08,899][123091] Updated weights for policy 0, policy_version 1695727 (0.0008) [2023-12-26 13:08:08,906][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001695728_434110464.pth... [2023-12-26 13:08:08,911][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001694672_433840128.pth [2023-12-26 13:08:08,915][123090] Updated weights for policy 1, policy_version 1684459 (0.0007) [2023-12-26 13:08:08,987][123090] Updated weights for policy 1, policy_version 1684469 (0.0006) [2023-12-26 13:08:09,053][123090] Updated weights for policy 1, policy_version 1684479 (0.0007) [2023-12-26 13:08:09,764][123091] Updated weights for policy 0, policy_version 1695737 (0.0008) [2023-12-26 13:08:09,783][123090] Updated weights for policy 1, policy_version 1684489 (0.0010) [2023-12-26 13:08:09,833][123091] Updated weights for policy 0, policy_version 1695747 (0.0007) [2023-12-26 13:08:09,852][123090] Updated weights for policy 1, policy_version 1684499 (0.0009) [2023-12-26 13:08:09,900][123091] Updated weights for policy 0, policy_version 1695757 (0.0009) [2023-12-26 13:08:09,922][123090] Updated weights for policy 1, policy_version 1684509 (0.0010) [2023-12-26 13:08:10,624][123090] Updated weights for policy 1, policy_version 1684519 (0.0009) [2023-12-26 13:08:10,687][123090] Updated weights for policy 1, policy_version 1684529 (0.0010) [2023-12-26 13:08:10,745][123091] Updated weights for policy 0, policy_version 1695767 (0.0008) [2023-12-26 13:08:10,749][123090] Updated weights for policy 1, policy_version 1684539 (0.0010) [2023-12-26 13:08:10,809][123091] Updated weights for policy 0, policy_version 1695777 (0.0009) [2023-12-26 13:08:10,869][123091] Updated weights for policy 0, policy_version 1695787 (0.0008) [2023-12-26 13:08:11,532][123090] Updated weights for policy 1, policy_version 1684549 (0.0008) [2023-12-26 13:08:11,594][123090] Updated weights for policy 1, policy_version 1684559 (0.0006) [2023-12-26 13:08:11,668][123090] Updated weights for policy 1, policy_version 1684569 (0.0010) [2023-12-26 13:08:11,700][123091] Updated weights for policy 0, policy_version 1695797 (0.0008) [2023-12-26 13:08:11,774][123091] Updated weights for policy 0, policy_version 1695807 (0.0009) [2023-12-26 13:08:11,845][123091] Updated weights for policy 0, policy_version 1695817 (0.0009) [2023-12-26 13:08:12,466][123090] Updated weights for policy 1, policy_version 1684579 (0.0009) [2023-12-26 13:08:12,524][123090] Updated weights for policy 1, policy_version 1684589 (0.0009) [2023-12-26 13:08:12,593][123090] Updated weights for policy 1, policy_version 1684599 (0.0009) [2023-12-26 13:08:12,720][123091] Updated weights for policy 0, policy_version 1695827 (0.0010) [2023-12-26 13:08:12,786][123091] Updated weights for policy 0, policy_version 1695837 (0.0011) [2023-12-26 13:08:12,850][123091] Updated weights for policy 0, policy_version 1695847 (0.0011) [2023-12-26 13:08:13,418][123090] Updated weights for policy 1, policy_version 1684609 (0.0009) [2023-12-26 13:08:13,474][123090] Updated weights for policy 1, policy_version 1684619 (0.0009) [2023-12-26 13:08:13,506][123091] Updated weights for policy 0, policy_version 1695857 (0.0011) [2023-12-26 13:08:13,528][123090] Updated weights for policy 1, policy_version 1684629 (0.0005) [2023-12-26 13:08:13,561][123091] Updated weights for policy 0, policy_version 1695867 (0.0010) [2023-12-26 13:08:13,585][123090] Updated weights for policy 1, policy_version 1684639 (0.0005) [2023-12-26 13:08:13,613][123091] Updated weights for policy 0, policy_version 1695877 (0.0010) [2023-12-26 13:08:13,660][123091] Updated weights for policy 0, policy_version 1695887 (0.0010) [2023-12-26 13:08:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 865419264. Throughput: 0: 8856.5, 1: 8960.2. Samples: 865407700. Policy #0 lag: (min: 31.0, avg: 38.6, max: 63.0) [2023-12-26 13:08:13,785][121949] Avg episode reward: [(0, '6160.823'), (1, '5963.882')] [2023-12-26 13:08:14,222][123090] Updated weights for policy 1, policy_version 1684649 (0.0010) [2023-12-26 13:08:14,292][123090] Updated weights for policy 1, policy_version 1684659 (0.0010) [2023-12-26 13:08:14,293][123091] Updated weights for policy 0, policy_version 1695897 (0.0006) [2023-12-26 13:08:14,356][123091] Updated weights for policy 0, policy_version 1695907 (0.0007) [2023-12-26 13:08:14,358][123090] Updated weights for policy 1, policy_version 1684669 (0.0010) [2023-12-26 13:08:14,410][123091] Updated weights for policy 0, policy_version 1695917 (0.0007) [2023-12-26 13:08:15,153][123090] Updated weights for policy 1, policy_version 1684679 (0.0009) [2023-12-26 13:08:15,188][123091] Updated weights for policy 0, policy_version 1695927 (0.0009) [2023-12-26 13:08:15,216][123090] Updated weights for policy 1, policy_version 1684689 (0.0009) [2023-12-26 13:08:15,247][123091] Updated weights for policy 0, policy_version 1695937 (0.0011) [2023-12-26 13:08:15,282][123090] Updated weights for policy 1, policy_version 1684699 (0.0009) [2023-12-26 13:08:15,303][123091] Updated weights for policy 0, policy_version 1695947 (0.0010) [2023-12-26 13:08:16,081][123090] Updated weights for policy 1, policy_version 1684709 (0.0009) [2023-12-26 13:08:16,122][123091] Updated weights for policy 0, policy_version 1695957 (0.0011) [2023-12-26 13:08:16,148][123090] Updated weights for policy 1, policy_version 1684719 (0.0010) [2023-12-26 13:08:16,177][123091] Updated weights for policy 0, policy_version 1695967 (0.0010) [2023-12-26 13:08:16,203][123090] Updated weights for policy 1, policy_version 1684729 (0.0010) [2023-12-26 13:08:16,232][123091] Updated weights for policy 0, policy_version 1695977 (0.0010) [2023-12-26 13:08:16,896][123090] Updated weights for policy 1, policy_version 1684739 (0.0010) [2023-12-26 13:08:16,963][123090] Updated weights for policy 1, policy_version 1684749 (0.0008) [2023-12-26 13:08:17,036][123090] Updated weights for policy 1, policy_version 1684759 (0.0007) [2023-12-26 13:08:17,066][123091] Updated weights for policy 0, policy_version 1695987 (0.0010) [2023-12-26 13:08:17,117][123091] Updated weights for policy 0, policy_version 1695997 (0.0010) [2023-12-26 13:08:17,161][123091] Updated weights for policy 0, policy_version 1696007 (0.0010) [2023-12-26 13:08:17,790][123090] Updated weights for policy 1, policy_version 1684769 (0.0008) [2023-12-26 13:08:17,859][123090] Updated weights for policy 1, policy_version 1684779 (0.0010) [2023-12-26 13:08:17,897][123091] Updated weights for policy 0, policy_version 1696017 (0.0006) [2023-12-26 13:08:17,919][123090] Updated weights for policy 1, policy_version 1684789 (0.0011) [2023-12-26 13:08:17,965][123091] Updated weights for policy 0, policy_version 1696028 (0.0007) [2023-12-26 13:08:17,972][123090] Updated weights for policy 1, policy_version 1684799 (0.0011) [2023-12-26 13:08:18,015][123091] Updated weights for policy 0, policy_version 1696038 (0.0009) [2023-12-26 13:08:18,071][123091] Updated weights for policy 0, policy_version 1696048 (0.0007) [2023-12-26 13:08:18,733][123090] Updated weights for policy 1, policy_version 1684809 (0.0006) [2023-12-26 13:08:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 865501184. Throughput: 0: 8909.1, 1: 8957.0. Samples: 865517956. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:18,785][121949] Avg episode reward: [(0, '6094.348'), (1, '5758.113')] [2023-12-26 13:08:18,792][123090] Updated weights for policy 1, policy_version 1684819 (0.0005) [2023-12-26 13:08:18,861][123090] Updated weights for policy 1, policy_version 1684829 (0.0005) [2023-12-26 13:08:18,920][123091] Updated weights for policy 0, policy_version 1696058 (0.0010) [2023-12-26 13:08:18,976][123091] Updated weights for policy 0, policy_version 1696068 (0.0010) [2023-12-26 13:08:19,029][123091] Updated weights for policy 0, policy_version 1696078 (0.0010) [2023-12-26 13:08:19,574][123090] Updated weights for policy 1, policy_version 1684839 (0.0009) [2023-12-26 13:08:19,643][123090] Updated weights for policy 1, policy_version 1684849 (0.0007) [2023-12-26 13:08:19,710][123090] Updated weights for policy 1, policy_version 1684859 (0.0005) [2023-12-26 13:08:19,832][123091] Updated weights for policy 0, policy_version 1696088 (0.0009) [2023-12-26 13:08:19,898][123091] Updated weights for policy 0, policy_version 1696098 (0.0009) [2023-12-26 13:08:19,959][123091] Updated weights for policy 0, policy_version 1696108 (0.0009) [2023-12-26 13:08:20,416][123090] Updated weights for policy 1, policy_version 1684869 (0.0008) [2023-12-26 13:08:20,465][123090] Updated weights for policy 1, policy_version 1684879 (0.0010) [2023-12-26 13:08:20,523][123090] Updated weights for policy 1, policy_version 1684889 (0.0006) [2023-12-26 13:08:20,889][123091] Updated weights for policy 0, policy_version 1696118 (0.0010) [2023-12-26 13:08:20,959][123091] Updated weights for policy 0, policy_version 1696128 (0.0009) [2023-12-26 13:08:21,019][123091] Updated weights for policy 0, policy_version 1696138 (0.0010) [2023-12-26 13:08:21,394][123090] Updated weights for policy 1, policy_version 1684899 (0.0008) [2023-12-26 13:08:21,467][123090] Updated weights for policy 1, policy_version 1684909 (0.0008) [2023-12-26 13:08:21,534][123090] Updated weights for policy 1, policy_version 1684919 (0.0009) [2023-12-26 13:08:21,850][123091] Updated weights for policy 0, policy_version 1696148 (0.0008) [2023-12-26 13:08:21,902][123091] Updated weights for policy 0, policy_version 1696158 (0.0010) [2023-12-26 13:08:21,954][123091] Updated weights for policy 0, policy_version 1696168 (0.0010) [2023-12-26 13:08:22,434][123090] Updated weights for policy 1, policy_version 1684929 (0.0010) [2023-12-26 13:08:22,490][123090] Updated weights for policy 1, policy_version 1684939 (0.0009) [2023-12-26 13:08:22,549][123090] Updated weights for policy 1, policy_version 1684949 (0.0009) [2023-12-26 13:08:22,617][123090] Updated weights for policy 1, policy_version 1684959 (0.0010) [2023-12-26 13:08:22,833][123091] Updated weights for policy 0, policy_version 1696178 (0.0010) [2023-12-26 13:08:22,898][123091] Updated weights for policy 0, policy_version 1696188 (0.0009) [2023-12-26 13:08:22,967][123091] Updated weights for policy 0, policy_version 1696198 (0.0010) [2023-12-26 13:08:23,030][123091] Updated weights for policy 0, policy_version 1696208 (0.0010) [2023-12-26 13:08:23,415][123090] Updated weights for policy 1, policy_version 1684969 (0.0006) [2023-12-26 13:08:23,480][123090] Updated weights for policy 1, policy_version 1684979 (0.0005) [2023-12-26 13:08:23,547][123090] Updated weights for policy 1, policy_version 1684989 (0.0005) [2023-12-26 13:08:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 865591296. Throughput: 0: 8827.0, 1: 8908.6. Samples: 865569468. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:23,785][121949] Avg episode reward: [(0, '5934.970'), (1, '5650.087')] [2023-12-26 13:08:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001696208_434233344.pth... [2023-12-26 13:08:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001684992_431357952.pth... [2023-12-26 13:08:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001695216_433979392.pth [2023-12-26 13:08:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001683936_431087616.pth [2023-12-26 13:08:23,921][123091] Updated weights for policy 0, policy_version 1696218 (0.0009) [2023-12-26 13:08:23,982][123091] Updated weights for policy 0, policy_version 1696229 (0.0010) [2023-12-26 13:08:24,038][123091] Updated weights for policy 0, policy_version 1696239 (0.0009) [2023-12-26 13:08:24,258][123090] Updated weights for policy 1, policy_version 1684999 (0.0010) [2023-12-26 13:08:24,327][123090] Updated weights for policy 1, policy_version 1685009 (0.0007) [2023-12-26 13:08:24,394][123090] Updated weights for policy 1, policy_version 1685019 (0.0008) [2023-12-26 13:08:24,898][123091] Updated weights for policy 0, policy_version 1696249 (0.0010) [2023-12-26 13:08:24,942][123091] Updated weights for policy 0, policy_version 1696259 (0.0010) [2023-12-26 13:08:24,989][123091] Updated weights for policy 0, policy_version 1696269 (0.0010) [2023-12-26 13:08:25,088][123090] Updated weights for policy 1, policy_version 1685029 (0.0006) [2023-12-26 13:08:25,141][123090] Updated weights for policy 1, policy_version 1685039 (0.0005) [2023-12-26 13:08:25,211][123090] Updated weights for policy 1, policy_version 1685049 (0.0005) [2023-12-26 13:08:25,709][123091] Updated weights for policy 0, policy_version 1696279 (0.0006) [2023-12-26 13:08:25,766][123091] Updated weights for policy 0, policy_version 1696289 (0.0005) [2023-12-26 13:08:25,837][123091] Updated weights for policy 0, policy_version 1696299 (0.0005) [2023-12-26 13:08:25,883][123090] Updated weights for policy 1, policy_version 1685059 (0.0005) [2023-12-26 13:08:25,942][123090] Updated weights for policy 1, policy_version 1685069 (0.0005) [2023-12-26 13:08:26,000][123090] Updated weights for policy 1, policy_version 1685079 (0.0005) [2023-12-26 13:08:26,576][123091] Updated weights for policy 0, policy_version 1696309 (0.0009) [2023-12-26 13:08:26,619][123091] Updated weights for policy 0, policy_version 1696319 (0.0006) [2023-12-26 13:08:26,650][123090] Updated weights for policy 1, policy_version 1685089 (0.0005) [2023-12-26 13:08:26,665][123091] Updated weights for policy 0, policy_version 1696329 (0.0005) [2023-12-26 13:08:26,718][123090] Updated weights for policy 1, policy_version 1685099 (0.0005) [2023-12-26 13:08:26,787][123090] Updated weights for policy 1, policy_version 1685109 (0.0005) [2023-12-26 13:08:26,855][123090] Updated weights for policy 1, policy_version 1685119 (0.0005) [2023-12-26 13:08:27,330][123091] Updated weights for policy 0, policy_version 1696339 (0.0005) [2023-12-26 13:08:27,388][123090] Updated weights for policy 1, policy_version 1685129 (0.0006) [2023-12-26 13:08:27,397][123091] Updated weights for policy 0, policy_version 1696349 (0.0009) [2023-12-26 13:08:27,441][123090] Updated weights for policy 1, policy_version 1685139 (0.0005) [2023-12-26 13:08:27,462][123091] Updated weights for policy 0, policy_version 1696359 (0.0010) [2023-12-26 13:08:27,495][123090] Updated weights for policy 1, policy_version 1685149 (0.0005) [2023-12-26 13:08:28,243][123090] Updated weights for policy 1, policy_version 1685159 (0.0009) [2023-12-26 13:08:28,253][123091] Updated weights for policy 0, policy_version 1696369 (0.0010) [2023-12-26 13:08:28,298][123090] Updated weights for policy 1, policy_version 1685169 (0.0009) [2023-12-26 13:08:28,316][123091] Updated weights for policy 0, policy_version 1696379 (0.0008) [2023-12-26 13:08:28,362][123090] Updated weights for policy 1, policy_version 1685179 (0.0009) [2023-12-26 13:08:28,384][123091] Updated weights for policy 0, policy_version 1696389 (0.0008) [2023-12-26 13:08:28,450][123091] Updated weights for policy 0, policy_version 1696399 (0.0009) [2023-12-26 13:08:28,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 865689600. Throughput: 0: 8842.2, 1: 9118.4. Samples: 865681652. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:28,785][121949] Avg episode reward: [(0, '5806.477'), (1, '6021.158')] [2023-12-26 13:08:29,113][123090] Updated weights for policy 1, policy_version 1685189 (0.0009) [2023-12-26 13:08:29,177][123090] Updated weights for policy 1, policy_version 1685199 (0.0008) [2023-12-26 13:08:29,237][123090] Updated weights for policy 1, policy_version 1685209 (0.0007) [2023-12-26 13:08:29,273][123091] Updated weights for policy 0, policy_version 1696409 (0.0011) [2023-12-26 13:08:29,333][123091] Updated weights for policy 0, policy_version 1696419 (0.0011) [2023-12-26 13:08:29,391][123091] Updated weights for policy 0, policy_version 1696429 (0.0009) [2023-12-26 13:08:30,121][123090] Updated weights for policy 1, policy_version 1685219 (0.0007) [2023-12-26 13:08:30,135][123091] Updated weights for policy 0, policy_version 1696439 (0.0009) [2023-12-26 13:08:30,181][123090] Updated weights for policy 1, policy_version 1685229 (0.0006) [2023-12-26 13:08:30,183][123091] Updated weights for policy 0, policy_version 1696449 (0.0010) [2023-12-26 13:08:30,246][123090] Updated weights for policy 1, policy_version 1685239 (0.0006) [2023-12-26 13:08:30,247][123091] Updated weights for policy 0, policy_version 1696459 (0.0011) [2023-12-26 13:08:30,953][123091] Updated weights for policy 0, policy_version 1696469 (0.0007) [2023-12-26 13:08:31,032][123091] Updated weights for policy 0, policy_version 1696479 (0.0006) [2023-12-26 13:08:31,096][123091] Updated weights for policy 0, policy_version 1696489 (0.0007) [2023-12-26 13:08:31,105][123090] Updated weights for policy 1, policy_version 1685249 (0.0007) [2023-12-26 13:08:31,172][123090] Updated weights for policy 1, policy_version 1685259 (0.0008) [2023-12-26 13:08:31,224][123090] Updated weights for policy 1, policy_version 1685269 (0.0010) [2023-12-26 13:08:31,282][123090] Updated weights for policy 1, policy_version 1685279 (0.0009) [2023-12-26 13:08:31,865][123091] Updated weights for policy 0, policy_version 1696499 (0.0008) [2023-12-26 13:08:31,926][123091] Updated weights for policy 0, policy_version 1696509 (0.0005) [2023-12-26 13:08:31,999][123091] Updated weights for policy 0, policy_version 1696519 (0.0005) [2023-12-26 13:08:32,082][123090] Updated weights for policy 1, policy_version 1685289 (0.0010) [2023-12-26 13:08:32,151][123090] Updated weights for policy 1, policy_version 1685299 (0.0006) [2023-12-26 13:08:32,208][123090] Updated weights for policy 1, policy_version 1685309 (0.0005) [2023-12-26 13:08:32,690][123091] Updated weights for policy 0, policy_version 1696529 (0.0009) [2023-12-26 13:08:32,734][123091] Updated weights for policy 0, policy_version 1696539 (0.0010) [2023-12-26 13:08:32,785][123091] Updated weights for policy 0, policy_version 1696549 (0.0010) [2023-12-26 13:08:32,828][123091] Updated weights for policy 0, policy_version 1696559 (0.0010) [2023-12-26 13:08:32,909][123090] Updated weights for policy 1, policy_version 1685319 (0.0008) [2023-12-26 13:08:32,970][123090] Updated weights for policy 1, policy_version 1685329 (0.0009) [2023-12-26 13:08:33,016][123090] Updated weights for policy 1, policy_version 1685339 (0.0005) [2023-12-26 13:08:33,553][123091] Updated weights for policy 0, policy_version 1696569 (0.0008) [2023-12-26 13:08:33,599][123091] Updated weights for policy 0, policy_version 1696579 (0.0010) [2023-12-26 13:08:33,647][123091] Updated weights for policy 0, policy_version 1696589 (0.0010) [2023-12-26 13:08:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 865779712. Throughput: 0: 8825.9, 1: 9061.5. Samples: 865790424. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:33,785][121949] Avg episode reward: [(0, '5867.964'), (1, '5927.183')] [2023-12-26 13:08:33,819][123090] Updated weights for policy 1, policy_version 1685349 (0.0007) [2023-12-26 13:08:33,880][123090] Updated weights for policy 1, policy_version 1685359 (0.0008) [2023-12-26 13:08:33,939][123090] Updated weights for policy 1, policy_version 1685369 (0.0007) [2023-12-26 13:08:34,443][123091] Updated weights for policy 0, policy_version 1696599 (0.0007) [2023-12-26 13:08:34,512][123091] Updated weights for policy 0, policy_version 1696609 (0.0008) [2023-12-26 13:08:34,574][123091] Updated weights for policy 0, policy_version 1696619 (0.0009) [2023-12-26 13:08:34,725][123090] Updated weights for policy 1, policy_version 1685379 (0.0007) [2023-12-26 13:08:34,800][123090] Updated weights for policy 1, policy_version 1685389 (0.0006) [2023-12-26 13:08:34,871][123090] Updated weights for policy 1, policy_version 1685399 (0.0006) [2023-12-26 13:08:35,286][123091] Updated weights for policy 0, policy_version 1696629 (0.0008) [2023-12-26 13:08:35,337][123091] Updated weights for policy 0, policy_version 1696639 (0.0010) [2023-12-26 13:08:35,388][123091] Updated weights for policy 0, policy_version 1696649 (0.0010) [2023-12-26 13:08:35,551][123090] Updated weights for policy 1, policy_version 1685409 (0.0010) [2023-12-26 13:08:35,602][123090] Updated weights for policy 1, policy_version 1685419 (0.0005) [2023-12-26 13:08:35,656][123090] Updated weights for policy 1, policy_version 1685429 (0.0005) [2023-12-26 13:08:35,715][123090] Updated weights for policy 1, policy_version 1685439 (0.0005) [2023-12-26 13:08:36,039][123091] Updated weights for policy 0, policy_version 1696659 (0.0006) [2023-12-26 13:08:36,089][123091] Updated weights for policy 0, policy_version 1696669 (0.0006) [2023-12-26 13:08:36,153][123091] Updated weights for policy 0, policy_version 1696679 (0.0007) [2023-12-26 13:08:36,432][123090] Updated weights for policy 1, policy_version 1685449 (0.0009) [2023-12-26 13:08:36,493][123090] Updated weights for policy 1, policy_version 1685459 (0.0006) [2023-12-26 13:08:36,549][123090] Updated weights for policy 1, policy_version 1685469 (0.0006) [2023-12-26 13:08:36,894][123091] Updated weights for policy 0, policy_version 1696689 (0.0008) [2023-12-26 13:08:36,958][123091] Updated weights for policy 0, policy_version 1696699 (0.0006) [2023-12-26 13:08:37,019][123091] Updated weights for policy 0, policy_version 1696709 (0.0005) [2023-12-26 13:08:37,090][123091] Updated weights for policy 0, policy_version 1696719 (0.0008) [2023-12-26 13:08:37,281][123090] Updated weights for policy 1, policy_version 1685479 (0.0008) [2023-12-26 13:08:37,339][123090] Updated weights for policy 1, policy_version 1685489 (0.0009) [2023-12-26 13:08:37,392][123090] Updated weights for policy 1, policy_version 1685499 (0.0009) [2023-12-26 13:08:37,751][123091] Updated weights for policy 0, policy_version 1696729 (0.0007) [2023-12-26 13:08:37,800][123091] Updated weights for policy 0, policy_version 1696739 (0.0006) [2023-12-26 13:08:37,847][123091] Updated weights for policy 0, policy_version 1696749 (0.0005) [2023-12-26 13:08:38,320][123090] Updated weights for policy 1, policy_version 1685509 (0.0009) [2023-12-26 13:08:38,382][123090] Updated weights for policy 1, policy_version 1685519 (0.0009) [2023-12-26 13:08:38,438][123090] Updated weights for policy 1, policy_version 1685529 (0.0010) [2023-12-26 13:08:38,539][123091] Updated weights for policy 0, policy_version 1696759 (0.0009) [2023-12-26 13:08:38,594][123091] Updated weights for policy 0, policy_version 1696769 (0.0010) [2023-12-26 13:08:38,651][123091] Updated weights for policy 0, policy_version 1696779 (0.0010) [2023-12-26 13:08:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 865878016. Throughput: 0: 8889.4, 1: 9097.2. Samples: 865847280. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:38,785][121949] Avg episode reward: [(0, '5904.462'), (1, '5787.353')] [2023-12-26 13:08:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001696784_434380800.pth... [2023-12-26 13:08:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001685536_431497216.pth... [2023-12-26 13:08:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001695728_434110464.pth [2023-12-26 13:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001684448_431218688.pth [2023-12-26 13:08:39,244][123090] Updated weights for policy 1, policy_version 1685539 (0.0009) [2023-12-26 13:08:39,302][123090] Updated weights for policy 1, policy_version 1685549 (0.0009) [2023-12-26 13:08:39,381][123090] Updated weights for policy 1, policy_version 1685559 (0.0009) [2023-12-26 13:08:39,595][123091] Updated weights for policy 0, policy_version 1696789 (0.0010) [2023-12-26 13:08:39,659][123091] Updated weights for policy 0, policy_version 1696799 (0.0007) [2023-12-26 13:08:39,723][123091] Updated weights for policy 0, policy_version 1696809 (0.0005) [2023-12-26 13:08:40,248][123090] Updated weights for policy 1, policy_version 1685569 (0.0009) [2023-12-26 13:08:40,316][123090] Updated weights for policy 1, policy_version 1685579 (0.0009) [2023-12-26 13:08:40,378][123090] Updated weights for policy 1, policy_version 1685589 (0.0010) [2023-12-26 13:08:40,446][123090] Updated weights for policy 1, policy_version 1685599 (0.0010) [2023-12-26 13:08:40,504][123091] Updated weights for policy 0, policy_version 1696819 (0.0006) [2023-12-26 13:08:40,568][123091] Updated weights for policy 0, policy_version 1696829 (0.0009) [2023-12-26 13:08:40,633][123091] Updated weights for policy 0, policy_version 1696839 (0.0009) [2023-12-26 13:08:41,252][123090] Updated weights for policy 1, policy_version 1685609 (0.0010) [2023-12-26 13:08:41,321][123090] Updated weights for policy 1, policy_version 1685619 (0.0010) [2023-12-26 13:08:41,399][123090] Updated weights for policy 1, policy_version 1685629 (0.0009) [2023-12-26 13:08:41,436][123091] Updated weights for policy 0, policy_version 1696849 (0.0010) [2023-12-26 13:08:41,500][123091] Updated weights for policy 0, policy_version 1696859 (0.0010) [2023-12-26 13:08:41,554][123091] Updated weights for policy 0, policy_version 1696869 (0.0010) [2023-12-26 13:08:41,613][123091] Updated weights for policy 0, policy_version 1696879 (0.0009) [2023-12-26 13:08:42,211][123090] Updated weights for policy 1, policy_version 1685639 (0.0010) [2023-12-26 13:08:42,283][123090] Updated weights for policy 1, policy_version 1685649 (0.0010) [2023-12-26 13:08:42,350][123090] Updated weights for policy 1, policy_version 1685659 (0.0010) [2023-12-26 13:08:42,488][123091] Updated weights for policy 0, policy_version 1696889 (0.0009) [2023-12-26 13:08:42,542][123091] Updated weights for policy 0, policy_version 1696899 (0.0010) [2023-12-26 13:08:42,596][123091] Updated weights for policy 0, policy_version 1696909 (0.0009) [2023-12-26 13:08:43,096][123090] Updated weights for policy 1, policy_version 1685669 (0.0007) [2023-12-26 13:08:43,159][123090] Updated weights for policy 1, policy_version 1685679 (0.0006) [2023-12-26 13:08:43,228][123090] Updated weights for policy 1, policy_version 1685689 (0.0005) [2023-12-26 13:08:43,424][123091] Updated weights for policy 0, policy_version 1696919 (0.0006) [2023-12-26 13:08:43,470][123091] Updated weights for policy 0, policy_version 1696929 (0.0005) [2023-12-26 13:08:43,528][123091] Updated weights for policy 0, policy_version 1696939 (0.0005) [2023-12-26 13:08:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 865959936. Throughput: 0: 8882.2, 1: 8997.1. Samples: 865951196. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:43,785][121949] Avg episode reward: [(0, '6096.857'), (1, '5827.274')] [2023-12-26 13:08:43,975][123090] Updated weights for policy 1, policy_version 1685699 (0.0007) [2023-12-26 13:08:44,033][123090] Updated weights for policy 1, policy_version 1685709 (0.0009) [2023-12-26 13:08:44,079][123090] Updated weights for policy 1, policy_version 1685719 (0.0010) [2023-12-26 13:08:44,290][123091] Updated weights for policy 0, policy_version 1696949 (0.0006) [2023-12-26 13:08:44,363][123091] Updated weights for policy 0, policy_version 1696959 (0.0007) [2023-12-26 13:08:44,421][123091] Updated weights for policy 0, policy_version 1696969 (0.0005) [2023-12-26 13:08:44,886][123090] Updated weights for policy 1, policy_version 1685729 (0.0010) [2023-12-26 13:08:44,954][123090] Updated weights for policy 1, policy_version 1685739 (0.0011) [2023-12-26 13:08:45,018][123090] Updated weights for policy 1, policy_version 1685749 (0.0011) [2023-12-26 13:08:45,070][123090] Updated weights for policy 1, policy_version 1685759 (0.0010) [2023-12-26 13:08:45,199][123091] Updated weights for policy 0, policy_version 1696979 (0.0007) [2023-12-26 13:08:45,259][123091] Updated weights for policy 0, policy_version 1696989 (0.0011) [2023-12-26 13:08:45,323][123091] Updated weights for policy 0, policy_version 1696999 (0.0010) [2023-12-26 13:08:45,893][123090] Updated weights for policy 1, policy_version 1685769 (0.0010) [2023-12-26 13:08:45,955][123090] Updated weights for policy 1, policy_version 1685779 (0.0008) [2023-12-26 13:08:46,021][123090] Updated weights for policy 1, policy_version 1685789 (0.0008) [2023-12-26 13:08:46,127][123091] Updated weights for policy 0, policy_version 1697009 (0.0009) [2023-12-26 13:08:46,184][123091] Updated weights for policy 0, policy_version 1697019 (0.0006) [2023-12-26 13:08:46,240][123091] Updated weights for policy 0, policy_version 1697029 (0.0006) [2023-12-26 13:08:46,304][123091] Updated weights for policy 0, policy_version 1697039 (0.0005) [2023-12-26 13:08:46,707][123090] Updated weights for policy 1, policy_version 1685799 (0.0006) [2023-12-26 13:08:46,764][123090] Updated weights for policy 1, policy_version 1685809 (0.0005) [2023-12-26 13:08:46,831][123090] Updated weights for policy 1, policy_version 1685819 (0.0005) [2023-12-26 13:08:46,987][123091] Updated weights for policy 0, policy_version 1697049 (0.0005) [2023-12-26 13:08:47,045][123091] Updated weights for policy 0, policy_version 1697059 (0.0005) [2023-12-26 13:08:47,107][123091] Updated weights for policy 0, policy_version 1697069 (0.0005) [2023-12-26 13:08:47,454][123090] Updated weights for policy 1, policy_version 1685829 (0.0005) [2023-12-26 13:08:47,503][123090] Updated weights for policy 1, policy_version 1685839 (0.0005) [2023-12-26 13:08:47,552][123090] Updated weights for policy 1, policy_version 1685849 (0.0005) [2023-12-26 13:08:47,752][123091] Updated weights for policy 0, policy_version 1697079 (0.0005) [2023-12-26 13:08:47,820][123091] Updated weights for policy 0, policy_version 1697089 (0.0005) [2023-12-26 13:08:47,869][123091] Updated weights for policy 0, policy_version 1697099 (0.0009) [2023-12-26 13:08:48,291][123090] Updated weights for policy 1, policy_version 1685859 (0.0007) [2023-12-26 13:08:48,351][123090] Updated weights for policy 1, policy_version 1685869 (0.0010) [2023-12-26 13:08:48,404][123090] Updated weights for policy 1, policy_version 1685879 (0.0010) [2023-12-26 13:08:48,661][123091] Updated weights for policy 0, policy_version 1697109 (0.0008) [2023-12-26 13:08:48,714][123091] Updated weights for policy 0, policy_version 1697119 (0.0006) [2023-12-26 13:08:48,766][123091] Updated weights for policy 0, policy_version 1697129 (0.0006) [2023-12-26 13:08:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 866050048. Throughput: 0: 8980.4, 1: 9077.1. Samples: 866064172. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:48,785][121949] Avg episode reward: [(0, '6132.587'), (1, '5808.707')] [2023-12-26 13:08:49,222][123090] Updated weights for policy 1, policy_version 1685889 (0.0010) [2023-12-26 13:08:49,293][123090] Updated weights for policy 1, policy_version 1685899 (0.0007) [2023-12-26 13:08:49,367][123090] Updated weights for policy 1, policy_version 1685909 (0.0009) [2023-12-26 13:08:49,434][123090] Updated weights for policy 1, policy_version 1685919 (0.0006) [2023-12-26 13:08:49,539][123091] Updated weights for policy 0, policy_version 1697139 (0.0006) [2023-12-26 13:08:49,602][123091] Updated weights for policy 0, policy_version 1697149 (0.0006) [2023-12-26 13:08:49,664][123091] Updated weights for policy 0, policy_version 1697159 (0.0006) [2023-12-26 13:08:50,261][123090] Updated weights for policy 1, policy_version 1685929 (0.0007) [2023-12-26 13:08:50,318][123090] Updated weights for policy 1, policy_version 1685939 (0.0011) [2023-12-26 13:08:50,373][123090] Updated weights for policy 1, policy_version 1685949 (0.0010) [2023-12-26 13:08:50,447][123091] Updated weights for policy 0, policy_version 1697169 (0.0008) [2023-12-26 13:08:50,509][123091] Updated weights for policy 0, policy_version 1697179 (0.0008) [2023-12-26 13:08:50,571][123091] Updated weights for policy 0, policy_version 1697189 (0.0009) [2023-12-26 13:08:50,633][123091] Updated weights for policy 0, policy_version 1697199 (0.0010) [2023-12-26 13:08:51,216][123090] Updated weights for policy 1, policy_version 1685959 (0.0011) [2023-12-26 13:08:51,286][123090] Updated weights for policy 1, policy_version 1685969 (0.0010) [2023-12-26 13:08:51,359][123090] Updated weights for policy 1, policy_version 1685979 (0.0007) [2023-12-26 13:08:51,469][123091] Updated weights for policy 0, policy_version 1697209 (0.0008) [2023-12-26 13:08:51,538][123091] Updated weights for policy 0, policy_version 1697219 (0.0007) [2023-12-26 13:08:51,605][123091] Updated weights for policy 0, policy_version 1697229 (0.0008) [2023-12-26 13:08:52,152][123090] Updated weights for policy 1, policy_version 1685989 (0.0007) [2023-12-26 13:08:52,213][123090] Updated weights for policy 1, policy_version 1685999 (0.0006) [2023-12-26 13:08:52,275][123090] Updated weights for policy 1, policy_version 1686009 (0.0007) [2023-12-26 13:08:52,379][123091] Updated weights for policy 0, policy_version 1697239 (0.0010) [2023-12-26 13:08:52,446][123091] Updated weights for policy 0, policy_version 1697249 (0.0010) [2023-12-26 13:08:52,502][123091] Updated weights for policy 0, policy_version 1697259 (0.0010) [2023-12-26 13:08:52,966][123090] Updated weights for policy 1, policy_version 1686019 (0.0005) [2023-12-26 13:08:53,017][123090] Updated weights for policy 1, policy_version 1686029 (0.0005) [2023-12-26 13:08:53,068][123090] Updated weights for policy 1, policy_version 1686039 (0.0006) [2023-12-26 13:08:53,328][123091] Updated weights for policy 0, policy_version 1697270 (0.0011) [2023-12-26 13:08:53,372][123091] Updated weights for policy 0, policy_version 1697280 (0.0009) [2023-12-26 13:08:53,426][123091] Updated weights for policy 0, policy_version 1697290 (0.0009) [2023-12-26 13:08:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17744.8). Total num frames: 866140160. Throughput: 0: 8973.8, 1: 9038.3. Samples: 866115660. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:53,785][121949] Avg episode reward: [(0, '6067.052'), (1, '5903.994')] [2023-12-26 13:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001686048_431628288.pth... [2023-12-26 13:08:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001697296_434511872.pth... [2023-12-26 13:08:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001684992_431357952.pth [2023-12-26 13:08:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001696208_434233344.pth [2023-12-26 13:08:53,879][123090] Updated weights for policy 1, policy_version 1686049 (0.0009) [2023-12-26 13:08:53,946][123090] Updated weights for policy 1, policy_version 1686059 (0.0010) [2023-12-26 13:08:54,016][123090] Updated weights for policy 1, policy_version 1686069 (0.0006) [2023-12-26 13:08:54,088][123090] Updated weights for policy 1, policy_version 1686079 (0.0005) [2023-12-26 13:08:54,211][123091] Updated weights for policy 0, policy_version 1697300 (0.0009) [2023-12-26 13:08:54,278][123091] Updated weights for policy 0, policy_version 1697310 (0.0007) [2023-12-26 13:08:54,345][123091] Updated weights for policy 0, policy_version 1697320 (0.0007) [2023-12-26 13:08:54,901][123090] Updated weights for policy 1, policy_version 1686089 (0.0009) [2023-12-26 13:08:54,955][123090] Updated weights for policy 1, policy_version 1686099 (0.0010) [2023-12-26 13:08:54,985][123091] Updated weights for policy 0, policy_version 1697330 (0.0008) [2023-12-26 13:08:55,016][123090] Updated weights for policy 1, policy_version 1686109 (0.0009) [2023-12-26 13:08:55,047][123091] Updated weights for policy 0, policy_version 1697340 (0.0008) [2023-12-26 13:08:55,106][123091] Updated weights for policy 0, policy_version 1697350 (0.0010) [2023-12-26 13:08:55,162][123091] Updated weights for policy 0, policy_version 1697360 (0.0009) [2023-12-26 13:08:55,823][123090] Updated weights for policy 1, policy_version 1686119 (0.0006) [2023-12-26 13:08:55,878][123090] Updated weights for policy 1, policy_version 1686129 (0.0009) [2023-12-26 13:08:55,928][123090] Updated weights for policy 1, policy_version 1686139 (0.0008) [2023-12-26 13:08:55,976][123091] Updated weights for policy 0, policy_version 1697370 (0.0010) [2023-12-26 13:08:56,028][123091] Updated weights for policy 0, policy_version 1697381 (0.0009) [2023-12-26 13:08:56,074][123091] Updated weights for policy 0, policy_version 1697391 (0.0007) [2023-12-26 13:08:56,760][123090] Updated weights for policy 1, policy_version 1686149 (0.0007) [2023-12-26 13:08:56,794][123091] Updated weights for policy 0, policy_version 1697401 (0.0009) [2023-12-26 13:08:56,814][123090] Updated weights for policy 1, policy_version 1686159 (0.0007) [2023-12-26 13:08:56,854][123091] Updated weights for policy 0, policy_version 1697411 (0.0010) [2023-12-26 13:08:56,876][123090] Updated weights for policy 1, policy_version 1686169 (0.0007) [2023-12-26 13:08:56,913][123091] Updated weights for policy 0, policy_version 1697421 (0.0007) [2023-12-26 13:08:57,601][123091] Updated weights for policy 0, policy_version 1697431 (0.0008) [2023-12-26 13:08:57,653][123091] Updated weights for policy 0, policy_version 1697441 (0.0009) [2023-12-26 13:08:57,716][123091] Updated weights for policy 0, policy_version 1697451 (0.0009) [2023-12-26 13:08:57,749][123090] Updated weights for policy 1, policy_version 1686179 (0.0010) [2023-12-26 13:08:57,804][123090] Updated weights for policy 1, policy_version 1686189 (0.0009) [2023-12-26 13:08:57,878][123090] Updated weights for policy 1, policy_version 1686199 (0.0009) [2023-12-26 13:08:58,543][123091] Updated weights for policy 0, policy_version 1697461 (0.0008) [2023-12-26 13:08:58,614][123091] Updated weights for policy 0, policy_version 1697471 (0.0009) [2023-12-26 13:08:58,657][123090] Updated weights for policy 1, policy_version 1686209 (0.0007) [2023-12-26 13:08:58,689][123091] Updated weights for policy 0, policy_version 1697482 (0.0009) [2023-12-26 13:08:58,740][123090] Updated weights for policy 1, policy_version 1686219 (0.0007) [2023-12-26 13:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 866230272. Throughput: 0: 9124.9, 1: 9051.0. Samples: 866225616. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:08:58,785][121949] Avg episode reward: [(0, '5958.788'), (1, '5989.525')] [2023-12-26 13:08:58,819][123090] Updated weights for policy 1, policy_version 1686229 (0.0008) [2023-12-26 13:08:58,891][123090] Updated weights for policy 1, policy_version 1686239 (0.0009) [2023-12-26 13:08:59,560][123091] Updated weights for policy 0, policy_version 1697492 (0.0009) [2023-12-26 13:08:59,627][123091] Updated weights for policy 0, policy_version 1697502 (0.0009) [2023-12-26 13:08:59,630][123090] Updated weights for policy 1, policy_version 1686249 (0.0007) [2023-12-26 13:08:59,684][123091] Updated weights for policy 0, policy_version 1697512 (0.0007) [2023-12-26 13:08:59,696][123090] Updated weights for policy 1, policy_version 1686259 (0.0009) [2023-12-26 13:08:59,771][123090] Updated weights for policy 1, policy_version 1686269 (0.0009) [2023-12-26 13:09:00,548][123090] Updated weights for policy 1, policy_version 1686279 (0.0009) [2023-12-26 13:09:00,549][123091] Updated weights for policy 0, policy_version 1697522 (0.0006) [2023-12-26 13:09:00,608][123091] Updated weights for policy 0, policy_version 1697532 (0.0008) [2023-12-26 13:09:00,611][123090] Updated weights for policy 1, policy_version 1686289 (0.0007) [2023-12-26 13:09:00,666][123091] Updated weights for policy 0, policy_version 1697542 (0.0008) [2023-12-26 13:09:00,670][123090] Updated weights for policy 1, policy_version 1686299 (0.0006) [2023-12-26 13:09:00,727][123091] Updated weights for policy 0, policy_version 1697552 (0.0008) [2023-12-26 13:09:01,496][123090] Updated weights for policy 1, policy_version 1686309 (0.0008) [2023-12-26 13:09:01,556][123090] Updated weights for policy 1, policy_version 1686319 (0.0008) [2023-12-26 13:09:01,571][123091] Updated weights for policy 0, policy_version 1697562 (0.0009) [2023-12-26 13:09:01,623][123090] Updated weights for policy 1, policy_version 1686329 (0.0008) [2023-12-26 13:09:01,640][123091] Updated weights for policy 0, policy_version 1697572 (0.0008) [2023-12-26 13:09:01,686][123091] Updated weights for policy 0, policy_version 1697582 (0.0009) [2023-12-26 13:09:02,281][123090] Updated weights for policy 1, policy_version 1686339 (0.0009) [2023-12-26 13:09:02,344][123090] Updated weights for policy 1, policy_version 1686349 (0.0011) [2023-12-26 13:09:02,406][123090] Updated weights for policy 1, policy_version 1686359 (0.0011) [2023-12-26 13:09:02,550][123091] Updated weights for policy 0, policy_version 1697592 (0.0009) [2023-12-26 13:09:02,598][123091] Updated weights for policy 0, policy_version 1697602 (0.0008) [2023-12-26 13:09:02,647][123091] Updated weights for policy 0, policy_version 1697612 (0.0009) [2023-12-26 13:09:03,227][123090] Updated weights for policy 1, policy_version 1686369 (0.0010) [2023-12-26 13:09:03,296][123090] Updated weights for policy 1, policy_version 1686379 (0.0010) [2023-12-26 13:09:03,351][123090] Updated weights for policy 1, policy_version 1686389 (0.0010) [2023-12-26 13:09:03,395][123090] Updated weights for policy 1, policy_version 1686399 (0.0010) [2023-12-26 13:09:03,503][123091] Updated weights for policy 0, policy_version 1697622 (0.0009) [2023-12-26 13:09:03,562][123091] Updated weights for policy 0, policy_version 1697632 (0.0009) [2023-12-26 13:09:03,610][123091] Updated weights for policy 0, policy_version 1697642 (0.0009) [2023-12-26 13:09:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 866320384. Throughput: 0: 8991.6, 1: 8995.5. Samples: 866327376. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:03,784][121949] Avg episode reward: [(0, '6120.155'), (1, '5972.817')] [2023-12-26 13:09:04,231][123090] Updated weights for policy 1, policy_version 1686409 (0.0010) [2023-12-26 13:09:04,290][123090] Updated weights for policy 1, policy_version 1686419 (0.0010) [2023-12-26 13:09:04,354][123090] Updated weights for policy 1, policy_version 1686429 (0.0010) [2023-12-26 13:09:04,454][123091] Updated weights for policy 0, policy_version 1697652 (0.0009) [2023-12-26 13:09:04,514][123091] Updated weights for policy 0, policy_version 1697662 (0.0009) [2023-12-26 13:09:04,577][123091] Updated weights for policy 0, policy_version 1697672 (0.0009) [2023-12-26 13:09:05,147][123090] Updated weights for policy 1, policy_version 1686439 (0.0007) [2023-12-26 13:09:05,192][123090] Updated weights for policy 1, policy_version 1686449 (0.0005) [2023-12-26 13:09:05,248][123090] Updated weights for policy 1, policy_version 1686459 (0.0005) [2023-12-26 13:09:05,416][123091] Updated weights for policy 0, policy_version 1697682 (0.0009) [2023-12-26 13:09:05,475][123091] Updated weights for policy 0, policy_version 1697692 (0.0010) [2023-12-26 13:09:05,531][123091] Updated weights for policy 0, policy_version 1697702 (0.0008) [2023-12-26 13:09:05,605][123091] Updated weights for policy 0, policy_version 1697712 (0.0005) [2023-12-26 13:09:05,916][123090] Updated weights for policy 1, policy_version 1686469 (0.0005) [2023-12-26 13:09:05,977][123090] Updated weights for policy 1, policy_version 1686479 (0.0005) [2023-12-26 13:09:06,031][123090] Updated weights for policy 1, policy_version 1686489 (0.0005) [2023-12-26 13:09:06,380][123091] Updated weights for policy 0, policy_version 1697722 (0.0009) [2023-12-26 13:09:06,449][123091] Updated weights for policy 0, policy_version 1697732 (0.0009) [2023-12-26 13:09:06,511][123091] Updated weights for policy 0, policy_version 1697742 (0.0009) [2023-12-26 13:09:06,849][123090] Updated weights for policy 1, policy_version 1686499 (0.0007) [2023-12-26 13:09:06,915][123090] Updated weights for policy 1, policy_version 1686509 (0.0011) [2023-12-26 13:09:06,979][123090] Updated weights for policy 1, policy_version 1686519 (0.0011) [2023-12-26 13:09:07,365][123091] Updated weights for policy 0, policy_version 1697752 (0.0010) [2023-12-26 13:09:07,419][123091] Updated weights for policy 0, policy_version 1697762 (0.0010) [2023-12-26 13:09:07,475][123091] Updated weights for policy 0, policy_version 1697773 (0.0007) [2023-12-26 13:09:07,733][123090] Updated weights for policy 1, policy_version 1686529 (0.0008) [2023-12-26 13:09:07,782][123090] Updated weights for policy 1, policy_version 1686539 (0.0011) [2023-12-26 13:09:07,834][123090] Updated weights for policy 1, policy_version 1686549 (0.0010) [2023-12-26 13:09:07,899][123090] Updated weights for policy 1, policy_version 1686559 (0.0011) [2023-12-26 13:09:08,294][123091] Updated weights for policy 0, policy_version 1697784 (0.0011) [2023-12-26 13:09:08,350][123091] Updated weights for policy 0, policy_version 1697794 (0.0008) [2023-12-26 13:09:08,419][123091] Updated weights for policy 0, policy_version 1697804 (0.0006) [2023-12-26 13:09:08,628][123090] Updated weights for policy 1, policy_version 1686569 (0.0006) [2023-12-26 13:09:08,694][123090] Updated weights for policy 1, policy_version 1686579 (0.0006) [2023-12-26 13:09:08,767][123090] Updated weights for policy 1, policy_version 1686589 (0.0006) [2023-12-26 13:09:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 866402304. Throughput: 0: 9014.0, 1: 9023.7. Samples: 866381168. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:08,785][121949] Avg episode reward: [(0, '6147.069'), (1, '5833.864')] [2023-12-26 13:09:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001697808_434642944.pth... [2023-12-26 13:09:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001686592_431767552.pth... [2023-12-26 13:09:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001685536_431497216.pth [2023-12-26 13:09:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001696784_434380800.pth [2023-12-26 13:09:09,153][123091] Updated weights for policy 0, policy_version 1697814 (0.0005) [2023-12-26 13:09:09,199][123091] Updated weights for policy 0, policy_version 1697824 (0.0007) [2023-12-26 13:09:09,272][123091] Updated weights for policy 0, policy_version 1697834 (0.0009) [2023-12-26 13:09:09,427][123090] Updated weights for policy 1, policy_version 1686599 (0.0008) [2023-12-26 13:09:09,493][123090] Updated weights for policy 1, policy_version 1686609 (0.0009) [2023-12-26 13:09:09,569][123090] Updated weights for policy 1, policy_version 1686619 (0.0010) [2023-12-26 13:09:10,139][123091] Updated weights for policy 0, policy_version 1697844 (0.0007) [2023-12-26 13:09:10,208][123091] Updated weights for policy 0, policy_version 1697854 (0.0006) [2023-12-26 13:09:10,280][123091] Updated weights for policy 0, policy_version 1697864 (0.0006) [2023-12-26 13:09:10,509][123090] Updated weights for policy 1, policy_version 1686629 (0.0009) [2023-12-26 13:09:10,559][123090] Updated weights for policy 1, policy_version 1686639 (0.0010) [2023-12-26 13:09:10,616][123090] Updated weights for policy 1, policy_version 1686650 (0.0010) [2023-12-26 13:09:11,001][123091] Updated weights for policy 0, policy_version 1697874 (0.0006) [2023-12-26 13:09:11,069][123091] Updated weights for policy 0, policy_version 1697884 (0.0008) [2023-12-26 13:09:11,135][123091] Updated weights for policy 0, policy_version 1697894 (0.0010) [2023-12-26 13:09:11,207][123091] Updated weights for policy 0, policy_version 1697904 (0.0009) [2023-12-26 13:09:11,425][123090] Updated weights for policy 1, policy_version 1686660 (0.0008) [2023-12-26 13:09:11,495][123090] Updated weights for policy 1, policy_version 1686670 (0.0008) [2023-12-26 13:09:11,565][123090] Updated weights for policy 1, policy_version 1686680 (0.0008) [2023-12-26 13:09:12,061][123091] Updated weights for policy 0, policy_version 1697914 (0.0009) [2023-12-26 13:09:12,129][123091] Updated weights for policy 0, policy_version 1697924 (0.0009) [2023-12-26 13:09:12,189][123091] Updated weights for policy 0, policy_version 1697934 (0.0010) [2023-12-26 13:09:12,348][123090] Updated weights for policy 1, policy_version 1686690 (0.0008) [2023-12-26 13:09:12,417][123090] Updated weights for policy 1, policy_version 1686700 (0.0008) [2023-12-26 13:09:12,487][123090] Updated weights for policy 1, policy_version 1686710 (0.0009) [2023-12-26 13:09:12,551][123090] Updated weights for policy 1, policy_version 1686720 (0.0011) [2023-12-26 13:09:12,993][123091] Updated weights for policy 0, policy_version 1697944 (0.0006) [2023-12-26 13:09:13,053][123091] Updated weights for policy 0, policy_version 1697954 (0.0005) [2023-12-26 13:09:13,105][123091] Updated weights for policy 0, policy_version 1697964 (0.0007) [2023-12-26 13:09:13,355][123090] Updated weights for policy 1, policy_version 1686730 (0.0010) [2023-12-26 13:09:13,418][123090] Updated weights for policy 1, policy_version 1686740 (0.0010) [2023-12-26 13:09:13,469][123090] Updated weights for policy 1, policy_version 1686750 (0.0010) [2023-12-26 13:09:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 866492416. Throughput: 0: 8972.8, 1: 8910.8. Samples: 866486412. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:13,785][121949] Avg episode reward: [(0, '5938.309'), (1, '5834.554')] [2023-12-26 13:09:13,914][123091] Updated weights for policy 0, policy_version 1697974 (0.0010) [2023-12-26 13:09:13,969][123091] Updated weights for policy 0, policy_version 1697985 (0.0009) [2023-12-26 13:09:14,017][123091] Updated weights for policy 0, policy_version 1697995 (0.0009) [2023-12-26 13:09:14,219][123090] Updated weights for policy 1, policy_version 1686760 (0.0006) [2023-12-26 13:09:14,281][123090] Updated weights for policy 1, policy_version 1686770 (0.0005) [2023-12-26 13:09:14,354][123090] Updated weights for policy 1, policy_version 1686780 (0.0005) [2023-12-26 13:09:14,782][123091] Updated weights for policy 0, policy_version 1698005 (0.0008) [2023-12-26 13:09:14,845][123091] Updated weights for policy 0, policy_version 1698015 (0.0009) [2023-12-26 13:09:14,909][123091] Updated weights for policy 0, policy_version 1698025 (0.0008) [2023-12-26 13:09:15,067][123090] Updated weights for policy 1, policy_version 1686790 (0.0009) [2023-12-26 13:09:15,133][123090] Updated weights for policy 1, policy_version 1686800 (0.0011) [2023-12-26 13:09:15,197][123090] Updated weights for policy 1, policy_version 1686810 (0.0011) [2023-12-26 13:09:15,545][123091] Updated weights for policy 0, policy_version 1698035 (0.0008) [2023-12-26 13:09:15,602][123091] Updated weights for policy 0, policy_version 1698045 (0.0006) [2023-12-26 13:09:15,659][123091] Updated weights for policy 0, policy_version 1698055 (0.0009) [2023-12-26 13:09:16,022][123090] Updated weights for policy 1, policy_version 1686820 (0.0011) [2023-12-26 13:09:16,074][123090] Updated weights for policy 1, policy_version 1686830 (0.0010) [2023-12-26 13:09:16,134][123090] Updated weights for policy 1, policy_version 1686840 (0.0010) [2023-12-26 13:09:16,462][123091] Updated weights for policy 0, policy_version 1698065 (0.0007) [2023-12-26 13:09:16,509][123091] Updated weights for policy 0, policy_version 1698075 (0.0008) [2023-12-26 13:09:16,573][123091] Updated weights for policy 0, policy_version 1698085 (0.0009) [2023-12-26 13:09:16,631][123091] Updated weights for policy 0, policy_version 1698095 (0.0010) [2023-12-26 13:09:16,867][123090] Updated weights for policy 1, policy_version 1686850 (0.0010) [2023-12-26 13:09:16,925][123090] Updated weights for policy 1, policy_version 1686860 (0.0006) [2023-12-26 13:09:16,982][123090] Updated weights for policy 1, policy_version 1686870 (0.0006) [2023-12-26 13:09:17,043][123090] Updated weights for policy 1, policy_version 1686880 (0.0005) [2023-12-26 13:09:17,526][123091] Updated weights for policy 0, policy_version 1698105 (0.0006) [2023-12-26 13:09:17,589][123091] Updated weights for policy 0, policy_version 1698115 (0.0009) [2023-12-26 13:09:17,648][123091] Updated weights for policy 0, policy_version 1698125 (0.0009) [2023-12-26 13:09:17,828][123090] Updated weights for policy 1, policy_version 1686890 (0.0010) [2023-12-26 13:09:17,883][123090] Updated weights for policy 1, policy_version 1686900 (0.0010) [2023-12-26 13:09:17,938][123090] Updated weights for policy 1, policy_version 1686910 (0.0010) [2023-12-26 13:09:18,458][123091] Updated weights for policy 0, policy_version 1698135 (0.0009) [2023-12-26 13:09:18,514][123091] Updated weights for policy 0, policy_version 1698145 (0.0009) [2023-12-26 13:09:18,571][123091] Updated weights for policy 0, policy_version 1698155 (0.0009) [2023-12-26 13:09:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 866582528. Throughput: 0: 8922.0, 1: 8949.4. Samples: 866594640. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:18,785][121949] Avg episode reward: [(0, '5905.129'), (1, '5810.234')] [2023-12-26 13:09:18,786][123090] Updated weights for policy 1, policy_version 1686920 (0.0007) [2023-12-26 13:09:18,849][123090] Updated weights for policy 1, policy_version 1686930 (0.0005) [2023-12-26 13:09:18,923][123090] Updated weights for policy 1, policy_version 1686940 (0.0008) [2023-12-26 13:09:19,435][123091] Updated weights for policy 0, policy_version 1698165 (0.0009) [2023-12-26 13:09:19,510][123091] Updated weights for policy 0, policy_version 1698175 (0.0009) [2023-12-26 13:09:19,580][123091] Updated weights for policy 0, policy_version 1698185 (0.0006) [2023-12-26 13:09:19,741][123090] Updated weights for policy 1, policy_version 1686950 (0.0010) [2023-12-26 13:09:19,809][123090] Updated weights for policy 1, policy_version 1686960 (0.0011) [2023-12-26 13:09:19,875][123090] Updated weights for policy 1, policy_version 1686970 (0.0010) [2023-12-26 13:09:20,343][123091] Updated weights for policy 0, policy_version 1698195 (0.0007) [2023-12-26 13:09:20,410][123091] Updated weights for policy 0, policy_version 1698205 (0.0007) [2023-12-26 13:09:20,471][123091] Updated weights for policy 0, policy_version 1698215 (0.0005) [2023-12-26 13:09:20,701][123090] Updated weights for policy 1, policy_version 1686980 (0.0009) [2023-12-26 13:09:20,759][123090] Updated weights for policy 1, policy_version 1686990 (0.0009) [2023-12-26 13:09:20,821][123090] Updated weights for policy 1, policy_version 1687000 (0.0009) [2023-12-26 13:09:21,262][123091] Updated weights for policy 0, policy_version 1698225 (0.0008) [2023-12-26 13:09:21,331][123091] Updated weights for policy 0, policy_version 1698235 (0.0006) [2023-12-26 13:09:21,406][123091] Updated weights for policy 0, policy_version 1698245 (0.0008) [2023-12-26 13:09:21,475][123091] Updated weights for policy 0, policy_version 1698255 (0.0005) [2023-12-26 13:09:21,638][123090] Updated weights for policy 1, policy_version 1687010 (0.0009) [2023-12-26 13:09:21,705][123090] Updated weights for policy 1, policy_version 1687020 (0.0007) [2023-12-26 13:09:21,777][123090] Updated weights for policy 1, policy_version 1687031 (0.0011) [2023-12-26 13:09:22,196][123091] Updated weights for policy 0, policy_version 1698265 (0.0009) [2023-12-26 13:09:22,263][123091] Updated weights for policy 0, policy_version 1698275 (0.0010) [2023-12-26 13:09:22,325][123091] Updated weights for policy 0, policy_version 1698285 (0.0009) [2023-12-26 13:09:22,553][123090] Updated weights for policy 1, policy_version 1687041 (0.0007) [2023-12-26 13:09:22,622][123090] Updated weights for policy 1, policy_version 1687051 (0.0005) [2023-12-26 13:09:22,692][123090] Updated weights for policy 1, policy_version 1687061 (0.0006) [2023-12-26 13:09:22,760][123090] Updated weights for policy 1, policy_version 1687071 (0.0010) [2023-12-26 13:09:23,171][123091] Updated weights for policy 0, policy_version 1698295 (0.0010) [2023-12-26 13:09:23,237][123091] Updated weights for policy 0, policy_version 1698305 (0.0008) [2023-12-26 13:09:23,286][123091] Updated weights for policy 0, policy_version 1698315 (0.0009) [2023-12-26 13:09:23,549][123090] Updated weights for policy 1, policy_version 1687082 (0.0010) [2023-12-26 13:09:23,601][123090] Updated weights for policy 1, policy_version 1687092 (0.0010) [2023-12-26 13:09:23,653][123090] Updated weights for policy 1, policy_version 1687102 (0.0008) [2023-12-26 13:09:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 866672640. Throughput: 0: 8887.6, 1: 8881.7. Samples: 866646896. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:23,784][121949] Avg episode reward: [(0, '5942.689'), (1, '5756.073')] [2023-12-26 13:09:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001687104_431898624.pth... [2023-12-26 13:09:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001698320_434774016.pth... [2023-12-26 13:09:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001697296_434511872.pth [2023-12-26 13:09:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001686048_431628288.pth [2023-12-26 13:09:24,072][123091] Updated weights for policy 0, policy_version 1698325 (0.0007) [2023-12-26 13:09:24,142][123091] Updated weights for policy 0, policy_version 1698335 (0.0006) [2023-12-26 13:09:24,197][123091] Updated weights for policy 0, policy_version 1698345 (0.0006) [2023-12-26 13:09:24,582][123090] Updated weights for policy 1, policy_version 1687112 (0.0009) [2023-12-26 13:09:24,633][123090] Updated weights for policy 1, policy_version 1687122 (0.0009) [2023-12-26 13:09:24,686][123090] Updated weights for policy 1, policy_version 1687133 (0.0009) [2023-12-26 13:09:24,946][123091] Updated weights for policy 0, policy_version 1698355 (0.0007) [2023-12-26 13:09:25,022][123091] Updated weights for policy 0, policy_version 1698365 (0.0009) [2023-12-26 13:09:25,083][123091] Updated weights for policy 0, policy_version 1698375 (0.0006) [2023-12-26 13:09:25,392][123090] Updated weights for policy 1, policy_version 1687143 (0.0007) [2023-12-26 13:09:25,453][123090] Updated weights for policy 1, policy_version 1687153 (0.0005) [2023-12-26 13:09:25,521][123090] Updated weights for policy 1, policy_version 1687163 (0.0005) [2023-12-26 13:09:25,962][123091] Updated weights for policy 0, policy_version 1698385 (0.0007) [2023-12-26 13:09:26,021][123091] Updated weights for policy 0, policy_version 1698395 (0.0010) [2023-12-26 13:09:26,077][123091] Updated weights for policy 0, policy_version 1698405 (0.0010) [2023-12-26 13:09:26,122][123090] Updated weights for policy 1, policy_version 1687173 (0.0005) [2023-12-26 13:09:26,137][123091] Updated weights for policy 0, policy_version 1698415 (0.0009) [2023-12-26 13:09:26,191][123090] Updated weights for policy 1, policy_version 1687183 (0.0005) [2023-12-26 13:09:26,257][123090] Updated weights for policy 1, policy_version 1687193 (0.0005) [2023-12-26 13:09:26,915][123090] Updated weights for policy 1, policy_version 1687203 (0.0005) [2023-12-26 13:09:26,965][123090] Updated weights for policy 1, policy_version 1687213 (0.0005) [2023-12-26 13:09:27,018][123090] Updated weights for policy 1, policy_version 1687223 (0.0005) [2023-12-26 13:09:27,057][123091] Updated weights for policy 0, policy_version 1698425 (0.0009) [2023-12-26 13:09:27,115][123091] Updated weights for policy 0, policy_version 1698436 (0.0010) [2023-12-26 13:09:27,169][123091] Updated weights for policy 0, policy_version 1698446 (0.0010) [2023-12-26 13:09:27,695][123090] Updated weights for policy 1, policy_version 1687233 (0.0005) [2023-12-26 13:09:27,754][123090] Updated weights for policy 1, policy_version 1687243 (0.0005) [2023-12-26 13:09:27,805][123090] Updated weights for policy 1, policy_version 1687253 (0.0006) [2023-12-26 13:09:27,860][123090] Updated weights for policy 1, policy_version 1687263 (0.0005) [2023-12-26 13:09:28,106][123091] Updated weights for policy 0, policy_version 1698456 (0.0010) [2023-12-26 13:09:28,159][123091] Updated weights for policy 0, policy_version 1698466 (0.0007) [2023-12-26 13:09:28,211][123091] Updated weights for policy 0, policy_version 1698476 (0.0005) [2023-12-26 13:09:28,566][123090] Updated weights for policy 1, policy_version 1687273 (0.0009) [2023-12-26 13:09:28,627][123090] Updated weights for policy 1, policy_version 1687283 (0.0010) [2023-12-26 13:09:28,684][123090] Updated weights for policy 1, policy_version 1687293 (0.0009) [2023-12-26 13:09:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 866762752. Throughput: 0: 8820.8, 1: 9009.9. Samples: 866753584. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:28,785][121949] Avg episode reward: [(0, '6113.004'), (1, '5901.754')] [2023-12-26 13:09:28,915][123091] Updated weights for policy 0, policy_version 1698486 (0.0005) [2023-12-26 13:09:28,990][123091] Updated weights for policy 0, policy_version 1698496 (0.0005) [2023-12-26 13:09:29,058][123091] Updated weights for policy 0, policy_version 1698506 (0.0005) [2023-12-26 13:09:29,593][123090] Updated weights for policy 1, policy_version 1687304 (0.0009) [2023-12-26 13:09:29,646][123090] Updated weights for policy 1, policy_version 1687314 (0.0009) [2023-12-26 13:09:29,702][123091] Updated weights for policy 0, policy_version 1698516 (0.0005) [2023-12-26 13:09:29,704][123090] Updated weights for policy 1, policy_version 1687324 (0.0009) [2023-12-26 13:09:29,757][123091] Updated weights for policy 0, policy_version 1698526 (0.0005) [2023-12-26 13:09:29,825][123091] Updated weights for policy 0, policy_version 1698536 (0.0006) [2023-12-26 13:09:30,562][123090] Updated weights for policy 1, policy_version 1687334 (0.0009) [2023-12-26 13:09:30,576][123091] Updated weights for policy 0, policy_version 1698546 (0.0009) [2023-12-26 13:09:30,626][123090] Updated weights for policy 1, policy_version 1687344 (0.0009) [2023-12-26 13:09:30,635][123091] Updated weights for policy 0, policy_version 1698556 (0.0006) [2023-12-26 13:09:30,700][123090] Updated weights for policy 1, policy_version 1687354 (0.0009) [2023-12-26 13:09:30,700][123091] Updated weights for policy 0, policy_version 1698566 (0.0005) [2023-12-26 13:09:30,771][123091] Updated weights for policy 0, policy_version 1698576 (0.0005) [2023-12-26 13:09:31,485][123091] Updated weights for policy 0, policy_version 1698586 (0.0011) [2023-12-26 13:09:31,546][123091] Updated weights for policy 0, policy_version 1698596 (0.0011) [2023-12-26 13:09:31,579][123090] Updated weights for policy 1, policy_version 1687364 (0.0007) [2023-12-26 13:09:31,604][123091] Updated weights for policy 0, policy_version 1698606 (0.0009) [2023-12-26 13:09:31,643][123090] Updated weights for policy 1, policy_version 1687374 (0.0010) [2023-12-26 13:09:31,705][123090] Updated weights for policy 1, policy_version 1687384 (0.0009) [2023-12-26 13:09:32,379][123090] Updated weights for policy 1, policy_version 1687394 (0.0008) [2023-12-26 13:09:32,453][123090] Updated weights for policy 1, policy_version 1687404 (0.0010) [2023-12-26 13:09:32,519][123090] Updated weights for policy 1, policy_version 1687414 (0.0008) [2023-12-26 13:09:32,524][123091] Updated weights for policy 0, policy_version 1698616 (0.0007) [2023-12-26 13:09:32,585][123090] Updated weights for policy 1, policy_version 1687424 (0.0006) [2023-12-26 13:09:32,587][123091] Updated weights for policy 0, policy_version 1698626 (0.0008) [2023-12-26 13:09:32,642][123091] Updated weights for policy 0, policy_version 1698636 (0.0011) [2023-12-26 13:09:33,243][123090] Updated weights for policy 1, policy_version 1687434 (0.0005) [2023-12-26 13:09:33,287][123090] Updated weights for policy 1, policy_version 1687444 (0.0005) [2023-12-26 13:09:33,338][123090] Updated weights for policy 1, policy_version 1687454 (0.0005) [2023-12-26 13:09:33,418][123091] Updated weights for policy 0, policy_version 1698646 (0.0010) [2023-12-26 13:09:33,482][123091] Updated weights for policy 0, policy_version 1698656 (0.0007) [2023-12-26 13:09:33,533][123091] Updated weights for policy 0, policy_version 1698666 (0.0010) [2023-12-26 13:09:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 866852864. Throughput: 0: 8768.3, 1: 8969.7. Samples: 866862384. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:33,785][121949] Avg episode reward: [(0, '6174.270'), (1, '5801.870')] [2023-12-26 13:09:34,011][123090] Updated weights for policy 1, policy_version 1687464 (0.0005) [2023-12-26 13:09:34,055][123090] Updated weights for policy 1, policy_version 1687474 (0.0006) [2023-12-26 13:09:34,117][123090] Updated weights for policy 1, policy_version 1687484 (0.0006) [2023-12-26 13:09:34,215][123091] Updated weights for policy 0, policy_version 1698676 (0.0010) [2023-12-26 13:09:34,276][123091] Updated weights for policy 0, policy_version 1698686 (0.0009) [2023-12-26 13:09:34,344][123091] Updated weights for policy 0, policy_version 1698696 (0.0009) [2023-12-26 13:09:34,913][123090] Updated weights for policy 1, policy_version 1687494 (0.0009) [2023-12-26 13:09:34,976][123090] Updated weights for policy 1, policy_version 1687504 (0.0009) [2023-12-26 13:09:35,039][123090] Updated weights for policy 1, policy_version 1687514 (0.0008) [2023-12-26 13:09:35,173][123091] Updated weights for policy 0, policy_version 1698706 (0.0011) [2023-12-26 13:09:35,223][123091] Updated weights for policy 0, policy_version 1698716 (0.0010) [2023-12-26 13:09:35,280][123091] Updated weights for policy 0, policy_version 1698726 (0.0007) [2023-12-26 13:09:35,338][123091] Updated weights for policy 0, policy_version 1698736 (0.0010) [2023-12-26 13:09:35,894][123090] Updated weights for policy 1, policy_version 1687524 (0.0009) [2023-12-26 13:09:35,950][123090] Updated weights for policy 1, policy_version 1687534 (0.0007) [2023-12-26 13:09:36,007][123090] Updated weights for policy 1, policy_version 1687544 (0.0005) [2023-12-26 13:09:36,177][123091] Updated weights for policy 0, policy_version 1698746 (0.0010) [2023-12-26 13:09:36,240][123091] Updated weights for policy 0, policy_version 1698756 (0.0011) [2023-12-26 13:09:36,304][123091] Updated weights for policy 0, policy_version 1698766 (0.0011) [2023-12-26 13:09:36,762][123090] Updated weights for policy 1, policy_version 1687554 (0.0006) [2023-12-26 13:09:36,814][123090] Updated weights for policy 1, policy_version 1687564 (0.0009) [2023-12-26 13:09:36,861][123090] Updated weights for policy 1, policy_version 1687574 (0.0008) [2023-12-26 13:09:36,919][123090] Updated weights for policy 1, policy_version 1687584 (0.0009) [2023-12-26 13:09:37,106][123091] Updated weights for policy 0, policy_version 1698776 (0.0009) [2023-12-26 13:09:37,154][123091] Updated weights for policy 0, policy_version 1698786 (0.0008) [2023-12-26 13:09:37,207][123091] Updated weights for policy 0, policy_version 1698796 (0.0007) [2023-12-26 13:09:37,782][123090] Updated weights for policy 1, policy_version 1687594 (0.0008) [2023-12-26 13:09:37,837][123090] Updated weights for policy 1, policy_version 1687604 (0.0005) [2023-12-26 13:09:37,882][123090] Updated weights for policy 1, policy_version 1687614 (0.0005) [2023-12-26 13:09:38,044][123091] Updated weights for policy 0, policy_version 1698806 (0.0008) [2023-12-26 13:09:38,105][123091] Updated weights for policy 0, policy_version 1698816 (0.0010) [2023-12-26 13:09:38,172][123091] Updated weights for policy 0, policy_version 1698826 (0.0009) [2023-12-26 13:09:38,549][123090] Updated weights for policy 1, policy_version 1687624 (0.0010) [2023-12-26 13:09:38,602][123090] Updated weights for policy 1, policy_version 1687634 (0.0011) [2023-12-26 13:09:38,650][123090] Updated weights for policy 1, policy_version 1687644 (0.0010) [2023-12-26 13:09:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 866942976. Throughput: 0: 8784.1, 1: 9009.4. Samples: 866916368. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:38,785][121949] Avg episode reward: [(0, '6137.956'), (1, '5765.831')] [2023-12-26 13:09:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001698832_434905088.pth... [2023-12-26 13:09:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001687648_432037888.pth... [2023-12-26 13:09:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001697808_434642944.pth [2023-12-26 13:09:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001686592_431767552.pth [2023-12-26 13:09:38,968][123091] Updated weights for policy 0, policy_version 1698836 (0.0009) [2023-12-26 13:09:39,019][123091] Updated weights for policy 0, policy_version 1698846 (0.0010) [2023-12-26 13:09:39,091][123091] Updated weights for policy 0, policy_version 1698856 (0.0005) [2023-12-26 13:09:39,377][123090] Updated weights for policy 1, policy_version 1687654 (0.0009) [2023-12-26 13:09:39,447][123090] Updated weights for policy 1, policy_version 1687664 (0.0009) [2023-12-26 13:09:39,503][123090] Updated weights for policy 1, policy_version 1687674 (0.0009) [2023-12-26 13:09:39,804][123091] Updated weights for policy 0, policy_version 1698866 (0.0005) [2023-12-26 13:09:39,880][123091] Updated weights for policy 0, policy_version 1698876 (0.0009) [2023-12-26 13:09:39,952][123091] Updated weights for policy 0, policy_version 1698886 (0.0009) [2023-12-26 13:09:40,008][123091] Updated weights for policy 0, policy_version 1698896 (0.0009) [2023-12-26 13:09:40,301][123090] Updated weights for policy 1, policy_version 1687684 (0.0009) [2023-12-26 13:09:40,365][123090] Updated weights for policy 1, policy_version 1687694 (0.0009) [2023-12-26 13:09:40,430][123090] Updated weights for policy 1, policy_version 1687704 (0.0009) [2023-12-26 13:09:40,754][123091] Updated weights for policy 0, policy_version 1698906 (0.0009) [2023-12-26 13:09:40,816][123091] Updated weights for policy 0, policy_version 1698916 (0.0010) [2023-12-26 13:09:40,876][123091] Updated weights for policy 0, policy_version 1698926 (0.0009) [2023-12-26 13:09:41,302][123090] Updated weights for policy 1, policy_version 1687714 (0.0009) [2023-12-26 13:09:41,368][123090] Updated weights for policy 1, policy_version 1687724 (0.0009) [2023-12-26 13:09:41,439][123090] Updated weights for policy 1, policy_version 1687734 (0.0008) [2023-12-26 13:09:41,513][123090] Updated weights for policy 1, policy_version 1687744 (0.0008) [2023-12-26 13:09:41,740][123091] Updated weights for policy 0, policy_version 1698936 (0.0011) [2023-12-26 13:09:41,809][123091] Updated weights for policy 0, policy_version 1698946 (0.0011) [2023-12-26 13:09:41,879][123091] Updated weights for policy 0, policy_version 1698956 (0.0008) [2023-12-26 13:09:42,374][123090] Updated weights for policy 1, policy_version 1687754 (0.0007) [2023-12-26 13:09:42,439][123090] Updated weights for policy 1, policy_version 1687764 (0.0007) [2023-12-26 13:09:42,503][123090] Updated weights for policy 1, policy_version 1687774 (0.0009) [2023-12-26 13:09:42,701][123091] Updated weights for policy 0, policy_version 1698966 (0.0010) [2023-12-26 13:09:42,758][123091] Updated weights for policy 0, policy_version 1698976 (0.0010) [2023-12-26 13:09:42,822][123091] Updated weights for policy 0, policy_version 1698986 (0.0009) [2023-12-26 13:09:43,318][123090] Updated weights for policy 1, policy_version 1687784 (0.0009) [2023-12-26 13:09:43,376][123090] Updated weights for policy 1, policy_version 1687794 (0.0008) [2023-12-26 13:09:43,443][123090] Updated weights for policy 1, policy_version 1687804 (0.0005) [2023-12-26 13:09:43,641][123091] Updated weights for policy 0, policy_version 1698996 (0.0008) [2023-12-26 13:09:43,697][123091] Updated weights for policy 0, policy_version 1699006 (0.0008) [2023-12-26 13:09:43,766][123091] Updated weights for policy 0, policy_version 1699016 (0.0009) [2023-12-26 13:09:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 867024896. Throughput: 0: 8704.5, 1: 8984.3. Samples: 867021608. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:43,785][121949] Avg episode reward: [(0, '6187.344'), (1, '5605.381')] [2023-12-26 13:09:44,128][123090] Updated weights for policy 1, policy_version 1687814 (0.0007) [2023-12-26 13:09:44,178][123090] Updated weights for policy 1, policy_version 1687824 (0.0009) [2023-12-26 13:09:44,235][123090] Updated weights for policy 1, policy_version 1687834 (0.0009) [2023-12-26 13:09:44,598][123091] Updated weights for policy 0, policy_version 1699026 (0.0006) [2023-12-26 13:09:44,664][123091] Updated weights for policy 0, policy_version 1699036 (0.0009) [2023-12-26 13:09:44,726][123091] Updated weights for policy 0, policy_version 1699046 (0.0009) [2023-12-26 13:09:44,798][123091] Updated weights for policy 0, policy_version 1699056 (0.0009) [2023-12-26 13:09:45,052][123090] Updated weights for policy 1, policy_version 1687844 (0.0010) [2023-12-26 13:09:45,115][123090] Updated weights for policy 1, policy_version 1687854 (0.0010) [2023-12-26 13:09:45,183][123090] Updated weights for policy 1, policy_version 1687864 (0.0010) [2023-12-26 13:09:45,598][123091] Updated weights for policy 0, policy_version 1699066 (0.0009) [2023-12-26 13:09:45,664][123091] Updated weights for policy 0, policy_version 1699076 (0.0009) [2023-12-26 13:09:45,728][123091] Updated weights for policy 0, policy_version 1699086 (0.0009) [2023-12-26 13:09:45,988][123090] Updated weights for policy 1, policy_version 1687874 (0.0010) [2023-12-26 13:09:46,054][123090] Updated weights for policy 1, policy_version 1687884 (0.0008) [2023-12-26 13:09:46,127][123090] Updated weights for policy 1, policy_version 1687894 (0.0007) [2023-12-26 13:09:46,194][123090] Updated weights for policy 1, policy_version 1687904 (0.0007) [2023-12-26 13:09:46,591][123091] Updated weights for policy 0, policy_version 1699096 (0.0006) [2023-12-26 13:09:46,648][123091] Updated weights for policy 0, policy_version 1699106 (0.0006) [2023-12-26 13:09:46,697][123091] Updated weights for policy 0, policy_version 1699116 (0.0005) [2023-12-26 13:09:46,890][123090] Updated weights for policy 1, policy_version 1687914 (0.0005) [2023-12-26 13:09:46,939][123090] Updated weights for policy 1, policy_version 1687924 (0.0005) [2023-12-26 13:09:46,995][123090] Updated weights for policy 1, policy_version 1687934 (0.0005) [2023-12-26 13:09:47,283][123091] Updated weights for policy 0, policy_version 1699126 (0.0005) [2023-12-26 13:09:47,334][123091] Updated weights for policy 0, policy_version 1699136 (0.0005) [2023-12-26 13:09:47,403][123091] Updated weights for policy 0, policy_version 1699146 (0.0005) [2023-12-26 13:09:47,666][123090] Updated weights for policy 1, policy_version 1687944 (0.0005) [2023-12-26 13:09:47,726][123090] Updated weights for policy 1, policy_version 1687954 (0.0005) [2023-12-26 13:09:47,783][123090] Updated weights for policy 1, policy_version 1687964 (0.0005) [2023-12-26 13:09:48,106][123091] Updated weights for policy 0, policy_version 1699156 (0.0007) [2023-12-26 13:09:48,164][123091] Updated weights for policy 0, policy_version 1699166 (0.0010) [2023-12-26 13:09:48,233][123091] Updated weights for policy 0, policy_version 1699176 (0.0007) [2023-12-26 13:09:48,483][123090] Updated weights for policy 1, policy_version 1687974 (0.0008) [2023-12-26 13:09:48,550][123090] Updated weights for policy 1, policy_version 1687984 (0.0009) [2023-12-26 13:09:48,605][123090] Updated weights for policy 1, policy_version 1687994 (0.0009) [2023-12-26 13:09:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 867123200. Throughput: 0: 8814.9, 1: 9083.8. Samples: 867132816. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:48,784][121949] Avg episode reward: [(0, '6025.504'), (1, '5315.639')] [2023-12-26 13:09:49,011][123091] Updated weights for policy 0, policy_version 1699186 (0.0006) [2023-12-26 13:09:49,074][123091] Updated weights for policy 0, policy_version 1699196 (0.0010) [2023-12-26 13:09:49,133][123091] Updated weights for policy 0, policy_version 1699206 (0.0010) [2023-12-26 13:09:49,188][123091] Updated weights for policy 0, policy_version 1699216 (0.0010) [2023-12-26 13:09:49,437][123090] Updated weights for policy 1, policy_version 1688004 (0.0008) [2023-12-26 13:09:49,508][123090] Updated weights for policy 1, policy_version 1688014 (0.0008) [2023-12-26 13:09:49,570][123090] Updated weights for policy 1, policy_version 1688024 (0.0008) [2023-12-26 13:09:49,984][123091] Updated weights for policy 0, policy_version 1699226 (0.0010) [2023-12-26 13:09:50,047][123091] Updated weights for policy 0, policy_version 1699236 (0.0010) [2023-12-26 13:09:50,115][123091] Updated weights for policy 0, policy_version 1699246 (0.0006) [2023-12-26 13:09:50,245][123090] Updated weights for policy 1, policy_version 1688034 (0.0008) [2023-12-26 13:09:50,312][123090] Updated weights for policy 1, policy_version 1688044 (0.0010) [2023-12-26 13:09:50,387][123090] Updated weights for policy 1, policy_version 1688054 (0.0008) [2023-12-26 13:09:50,457][123090] Updated weights for policy 1, policy_version 1688064 (0.0009) [2023-12-26 13:09:50,947][123091] Updated weights for policy 0, policy_version 1699256 (0.0009) [2023-12-26 13:09:51,003][123091] Updated weights for policy 0, policy_version 1699266 (0.0008) [2023-12-26 13:09:51,076][123091] Updated weights for policy 0, policy_version 1699276 (0.0009) [2023-12-26 13:09:51,251][123090] Updated weights for policy 1, policy_version 1688074 (0.0008) [2023-12-26 13:09:51,317][123090] Updated weights for policy 1, policy_version 1688084 (0.0008) [2023-12-26 13:09:51,385][123090] Updated weights for policy 1, policy_version 1688094 (0.0008) [2023-12-26 13:09:51,986][123091] Updated weights for policy 0, policy_version 1699286 (0.0009) [2023-12-26 13:09:52,043][123091] Updated weights for policy 0, policy_version 1699296 (0.0009) [2023-12-26 13:09:52,108][123091] Updated weights for policy 0, policy_version 1699306 (0.0009) [2023-12-26 13:09:52,153][123090] Updated weights for policy 1, policy_version 1688104 (0.0008) [2023-12-26 13:09:52,211][123090] Updated weights for policy 1, policy_version 1688114 (0.0010) [2023-12-26 13:09:52,288][123090] Updated weights for policy 1, policy_version 1688124 (0.0010) [2023-12-26 13:09:52,973][123091] Updated weights for policy 0, policy_version 1699316 (0.0009) [2023-12-26 13:09:53,044][123091] Updated weights for policy 0, policy_version 1699326 (0.0009) [2023-12-26 13:09:53,076][123090] Updated weights for policy 1, policy_version 1688134 (0.0007) [2023-12-26 13:09:53,106][123091] Updated weights for policy 0, policy_version 1699336 (0.0009) [2023-12-26 13:09:53,146][123090] Updated weights for policy 1, policy_version 1688144 (0.0009) [2023-12-26 13:09:53,198][123090] Updated weights for policy 1, policy_version 1688154 (0.0007) [2023-12-26 13:09:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 867205120. Throughput: 0: 8809.5, 1: 9052.4. Samples: 867184952. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:53,785][121949] Avg episode reward: [(0, '5873.748'), (1, '5466.125')] [2023-12-26 13:09:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001688160_432168960.pth... [2023-12-26 13:09:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001699344_435036160.pth... [2023-12-26 13:09:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001698320_434774016.pth [2023-12-26 13:09:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001687104_431898624.pth [2023-12-26 13:09:53,926][123090] Updated weights for policy 1, policy_version 1688164 (0.0007) [2023-12-26 13:09:53,976][123091] Updated weights for policy 0, policy_version 1699346 (0.0007) [2023-12-26 13:09:53,977][123090] Updated weights for policy 1, policy_version 1688174 (0.0009) [2023-12-26 13:09:54,028][123091] Updated weights for policy 0, policy_version 1699356 (0.0008) [2023-12-26 13:09:54,032][123090] Updated weights for policy 1, policy_version 1688184 (0.0010) [2023-12-26 13:09:54,078][123091] Updated weights for policy 0, policy_version 1699366 (0.0010) [2023-12-26 13:09:54,142][123091] Updated weights for policy 0, policy_version 1699376 (0.0009) [2023-12-26 13:09:54,772][123090] Updated weights for policy 1, policy_version 1688194 (0.0007) [2023-12-26 13:09:54,826][123090] Updated weights for policy 1, policy_version 1688204 (0.0005) [2023-12-26 13:09:54,886][123091] Updated weights for policy 0, policy_version 1699386 (0.0010) [2023-12-26 13:09:54,890][123090] Updated weights for policy 1, policy_version 1688214 (0.0005) [2023-12-26 13:09:54,946][123091] Updated weights for policy 0, policy_version 1699396 (0.0011) [2023-12-26 13:09:54,948][123090] Updated weights for policy 1, policy_version 1688224 (0.0007) [2023-12-26 13:09:54,994][123091] Updated weights for policy 0, policy_version 1699406 (0.0010) [2023-12-26 13:09:55,752][123090] Updated weights for policy 1, policy_version 1688234 (0.0010) [2023-12-26 13:09:55,799][123091] Updated weights for policy 0, policy_version 1699416 (0.0008) [2023-12-26 13:09:55,813][123090] Updated weights for policy 1, policy_version 1688244 (0.0007) [2023-12-26 13:09:55,849][123091] Updated weights for policy 0, policy_version 1699427 (0.0009) [2023-12-26 13:09:55,878][123090] Updated weights for policy 1, policy_version 1688254 (0.0007) [2023-12-26 13:09:55,899][123091] Updated weights for policy 0, policy_version 1699437 (0.0010) [2023-12-26 13:09:56,652][123091] Updated weights for policy 0, policy_version 1699447 (0.0006) [2023-12-26 13:09:56,713][123091] Updated weights for policy 0, policy_version 1699457 (0.0007) [2023-12-26 13:09:56,738][123090] Updated weights for policy 1, policy_version 1688264 (0.0007) [2023-12-26 13:09:56,775][123091] Updated weights for policy 0, policy_version 1699467 (0.0006) [2023-12-26 13:09:56,802][123090] Updated weights for policy 1, policy_version 1688274 (0.0009) [2023-12-26 13:09:56,862][123090] Updated weights for policy 1, policy_version 1688284 (0.0009) [2023-12-26 13:09:57,419][123091] Updated weights for policy 0, policy_version 1699477 (0.0007) [2023-12-26 13:09:57,477][123091] Updated weights for policy 0, policy_version 1699487 (0.0010) [2023-12-26 13:09:57,544][123091] Updated weights for policy 0, policy_version 1699497 (0.0009) [2023-12-26 13:09:57,716][123090] Updated weights for policy 1, policy_version 1688294 (0.0009) [2023-12-26 13:09:57,774][123090] Updated weights for policy 1, policy_version 1688304 (0.0008) [2023-12-26 13:09:57,828][123090] Updated weights for policy 1, policy_version 1688314 (0.0008) [2023-12-26 13:09:58,382][123091] Updated weights for policy 0, policy_version 1699507 (0.0009) [2023-12-26 13:09:58,443][123091] Updated weights for policy 0, policy_version 1699517 (0.0010) [2023-12-26 13:09:58,500][123091] Updated weights for policy 0, policy_version 1699527 (0.0009) [2023-12-26 13:09:58,737][123090] Updated weights for policy 1, policy_version 1688324 (0.0009) [2023-12-26 13:09:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 867295232. Throughput: 0: 8828.1, 1: 9061.2. Samples: 867291432. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:09:58,785][121949] Avg episode reward: [(0, '6084.473'), (1, '5503.267')] [2023-12-26 13:09:58,806][123090] Updated weights for policy 1, policy_version 1688334 (0.0007) [2023-12-26 13:09:58,887][123090] Updated weights for policy 1, policy_version 1688344 (0.0008) [2023-12-26 13:09:59,482][123091] Updated weights for policy 0, policy_version 1699537 (0.0009) [2023-12-26 13:09:59,537][123091] Updated weights for policy 0, policy_version 1699547 (0.0005) [2023-12-26 13:09:59,598][123091] Updated weights for policy 0, policy_version 1699557 (0.0006) [2023-12-26 13:09:59,660][123091] Updated weights for policy 0, policy_version 1699567 (0.0005) [2023-12-26 13:09:59,669][123090] Updated weights for policy 1, policy_version 1688354 (0.0007) [2023-12-26 13:09:59,738][123090] Updated weights for policy 1, policy_version 1688364 (0.0009) [2023-12-26 13:09:59,803][123090] Updated weights for policy 1, policy_version 1688374 (0.0009) [2023-12-26 13:09:59,866][123090] Updated weights for policy 1, policy_version 1688384 (0.0009) [2023-12-26 13:10:00,423][123091] Updated weights for policy 0, policy_version 1699577 (0.0005) [2023-12-26 13:10:00,483][123091] Updated weights for policy 0, policy_version 1699587 (0.0007) [2023-12-26 13:10:00,539][123091] Updated weights for policy 0, policy_version 1699597 (0.0009) [2023-12-26 13:10:00,703][123090] Updated weights for policy 1, policy_version 1688394 (0.0010) [2023-12-26 13:10:00,756][123090] Updated weights for policy 1, policy_version 1688405 (0.0010) [2023-12-26 13:10:00,830][123090] Updated weights for policy 1, policy_version 1688415 (0.0009) [2023-12-26 13:10:01,303][123091] Updated weights for policy 0, policy_version 1699607 (0.0009) [2023-12-26 13:10:01,369][123091] Updated weights for policy 0, policy_version 1699617 (0.0009) [2023-12-26 13:10:01,431][123091] Updated weights for policy 0, policy_version 1699627 (0.0010) [2023-12-26 13:10:01,680][123090] Updated weights for policy 1, policy_version 1688425 (0.0010) [2023-12-26 13:10:01,751][123090] Updated weights for policy 1, policy_version 1688435 (0.0011) [2023-12-26 13:10:01,795][123090] Updated weights for policy 1, policy_version 1688445 (0.0010) [2023-12-26 13:10:02,294][123091] Updated weights for policy 0, policy_version 1699637 (0.0009) [2023-12-26 13:10:02,365][123091] Updated weights for policy 0, policy_version 1699647 (0.0010) [2023-12-26 13:10:02,430][123091] Updated weights for policy 0, policy_version 1699657 (0.0010) [2023-12-26 13:10:02,571][123090] Updated weights for policy 1, policy_version 1688455 (0.0010) [2023-12-26 13:10:02,636][123090] Updated weights for policy 1, policy_version 1688465 (0.0009) [2023-12-26 13:10:02,701][123090] Updated weights for policy 1, policy_version 1688475 (0.0009) [2023-12-26 13:10:03,273][123091] Updated weights for policy 0, policy_version 1699667 (0.0010) [2023-12-26 13:10:03,329][123091] Updated weights for policy 0, policy_version 1699677 (0.0006) [2023-12-26 13:10:03,384][123091] Updated weights for policy 0, policy_version 1699687 (0.0005) [2023-12-26 13:10:03,424][123090] Updated weights for policy 1, policy_version 1688485 (0.0007) [2023-12-26 13:10:03,472][123090] Updated weights for policy 1, policy_version 1688495 (0.0005) [2023-12-26 13:10:03,517][123090] Updated weights for policy 1, policy_version 1688505 (0.0005) [2023-12-26 13:10:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 867385344. Throughput: 0: 8775.9, 1: 8998.8. Samples: 867394500. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:10:03,785][121949] Avg episode reward: [(0, '6040.511'), (1, '5517.467')] [2023-12-26 13:10:04,055][123091] Updated weights for policy 0, policy_version 1699697 (0.0005) [2023-12-26 13:10:04,127][123091] Updated weights for policy 0, policy_version 1699707 (0.0006) [2023-12-26 13:10:04,143][123090] Updated weights for policy 1, policy_version 1688515 (0.0005) [2023-12-26 13:10:04,190][123091] Updated weights for policy 0, policy_version 1699717 (0.0009) [2023-12-26 13:10:04,206][123090] Updated weights for policy 1, policy_version 1688525 (0.0008) [2023-12-26 13:10:04,256][123091] Updated weights for policy 0, policy_version 1699727 (0.0009) [2023-12-26 13:10:04,268][123090] Updated weights for policy 1, policy_version 1688535 (0.0006) [2023-12-26 13:10:05,018][123091] Updated weights for policy 0, policy_version 1699737 (0.0006) [2023-12-26 13:10:05,067][123091] Updated weights for policy 0, policy_version 1699747 (0.0005) [2023-12-26 13:10:05,098][123090] Updated weights for policy 1, policy_version 1688545 (0.0007) [2023-12-26 13:10:05,121][123091] Updated weights for policy 0, policy_version 1699757 (0.0005) [2023-12-26 13:10:05,155][123090] Updated weights for policy 1, policy_version 1688555 (0.0009) [2023-12-26 13:10:05,207][123090] Updated weights for policy 1, policy_version 1688565 (0.0010) [2023-12-26 13:10:05,264][123090] Updated weights for policy 1, policy_version 1688575 (0.0010) [2023-12-26 13:10:05,807][123091] Updated weights for policy 0, policy_version 1699767 (0.0008) [2023-12-26 13:10:05,857][123091] Updated weights for policy 0, policy_version 1699778 (0.0010) [2023-12-26 13:10:05,906][123091] Updated weights for policy 0, policy_version 1699788 (0.0009) [2023-12-26 13:10:06,158][123090] Updated weights for policy 1, policy_version 1688585 (0.0009) [2023-12-26 13:10:06,223][123090] Updated weights for policy 1, policy_version 1688595 (0.0008) [2023-12-26 13:10:06,289][123090] Updated weights for policy 1, policy_version 1688605 (0.0009) [2023-12-26 13:10:06,775][123091] Updated weights for policy 0, policy_version 1699799 (0.0009) [2023-12-26 13:10:06,832][123091] Updated weights for policy 0, policy_version 1699809 (0.0009) [2023-12-26 13:10:06,892][123091] Updated weights for policy 0, policy_version 1699819 (0.0009) [2023-12-26 13:10:07,104][123090] Updated weights for policy 1, policy_version 1688615 (0.0010) [2023-12-26 13:10:07,169][123090] Updated weights for policy 1, policy_version 1688625 (0.0008) [2023-12-26 13:10:07,235][123090] Updated weights for policy 1, policy_version 1688635 (0.0005) [2023-12-26 13:10:07,647][123091] Updated weights for policy 0, policy_version 1699829 (0.0009) [2023-12-26 13:10:07,702][123091] Updated weights for policy 0, policy_version 1699839 (0.0008) [2023-12-26 13:10:07,761][123091] Updated weights for policy 0, policy_version 1699849 (0.0008) [2023-12-26 13:10:07,980][123090] Updated weights for policy 1, policy_version 1688645 (0.0008) [2023-12-26 13:10:08,034][123090] Updated weights for policy 1, policy_version 1688655 (0.0010) [2023-12-26 13:10:08,086][123090] Updated weights for policy 1, policy_version 1688665 (0.0010) [2023-12-26 13:10:08,607][123091] Updated weights for policy 0, policy_version 1699859 (0.0009) [2023-12-26 13:10:08,672][123091] Updated weights for policy 0, policy_version 1699869 (0.0009) [2023-12-26 13:10:08,732][123091] Updated weights for policy 0, policy_version 1699879 (0.0008) [2023-12-26 13:10:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 867467264. Throughput: 0: 8817.2, 1: 9013.9. Samples: 867449296. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:10:08,785][121949] Avg episode reward: [(0, '5867.852'), (1, '5723.257')] [2023-12-26 13:10:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001688672_432300032.pth... [2023-12-26 13:10:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001699888_435175424.pth... [2023-12-26 13:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001698832_434905088.pth [2023-12-26 13:10:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001687648_432037888.pth [2023-12-26 13:10:08,920][123090] Updated weights for policy 1, policy_version 1688675 (0.0010) [2023-12-26 13:10:08,979][123090] Updated weights for policy 1, policy_version 1688685 (0.0011) [2023-12-26 13:10:09,038][123090] Updated weights for policy 1, policy_version 1688695 (0.0010) [2023-12-26 13:10:09,564][123091] Updated weights for policy 0, policy_version 1699889 (0.0009) [2023-12-26 13:10:09,628][123091] Updated weights for policy 0, policy_version 1699899 (0.0008) [2023-12-26 13:10:09,689][123091] Updated weights for policy 0, policy_version 1699909 (0.0009) [2023-12-26 13:10:09,749][123091] Updated weights for policy 0, policy_version 1699919 (0.0009) [2023-12-26 13:10:09,878][123090] Updated weights for policy 1, policy_version 1688705 (0.0010) [2023-12-26 13:10:09,931][123090] Updated weights for policy 1, policy_version 1688715 (0.0011) [2023-12-26 13:10:10,008][123090] Updated weights for policy 1, policy_version 1688725 (0.0011) [2023-12-26 13:10:10,068][123090] Updated weights for policy 1, policy_version 1688735 (0.0011) [2023-12-26 13:10:10,592][123091] Updated weights for policy 0, policy_version 1699929 (0.0009) [2023-12-26 13:10:10,645][123091] Updated weights for policy 0, policy_version 1699939 (0.0008) [2023-12-26 13:10:10,709][123091] Updated weights for policy 0, policy_version 1699949 (0.0009) [2023-12-26 13:10:10,917][123090] Updated weights for policy 1, policy_version 1688745 (0.0010) [2023-12-26 13:10:10,987][123090] Updated weights for policy 1, policy_version 1688755 (0.0011) [2023-12-26 13:10:11,058][123090] Updated weights for policy 1, policy_version 1688765 (0.0011) [2023-12-26 13:10:11,591][123091] Updated weights for policy 0, policy_version 1699959 (0.0007) [2023-12-26 13:10:11,663][123091] Updated weights for policy 0, policy_version 1699969 (0.0008) [2023-12-26 13:10:11,745][123091] Updated weights for policy 0, policy_version 1699979 (0.0007) [2023-12-26 13:10:11,880][123090] Updated weights for policy 1, policy_version 1688775 (0.0010) [2023-12-26 13:10:11,945][123090] Updated weights for policy 1, policy_version 1688785 (0.0010) [2023-12-26 13:10:12,014][123090] Updated weights for policy 1, policy_version 1688795 (0.0010) [2023-12-26 13:10:12,483][123091] Updated weights for policy 0, policy_version 1699989 (0.0010) [2023-12-26 13:10:12,545][123091] Updated weights for policy 0, policy_version 1699999 (0.0010) [2023-12-26 13:10:12,601][123091] Updated weights for policy 0, policy_version 1700009 (0.0006) [2023-12-26 13:10:12,918][123090] Updated weights for policy 1, policy_version 1688805 (0.0009) [2023-12-26 13:10:12,966][123090] Updated weights for policy 1, policy_version 1688815 (0.0008) [2023-12-26 13:10:13,021][123090] Updated weights for policy 1, policy_version 1688825 (0.0009) [2023-12-26 13:10:13,379][123091] Updated weights for policy 0, policy_version 1700019 (0.0010) [2023-12-26 13:10:13,431][123091] Updated weights for policy 0, policy_version 1700029 (0.0008) [2023-12-26 13:10:13,494][123091] Updated weights for policy 0, policy_version 1700039 (0.0005) [2023-12-26 13:10:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 867557376. Throughput: 0: 8841.1, 1: 8896.5. Samples: 867551772. Policy #0 lag: (min: 6.0, avg: 12.1, max: 38.0) [2023-12-26 13:10:13,785][121949] Avg episode reward: [(0, '5969.138'), (1, '5771.111')] [2023-12-26 13:10:13,914][123090] Updated weights for policy 1, policy_version 1688835 (0.0009) [2023-12-26 13:10:13,972][123090] Updated weights for policy 1, policy_version 1688845 (0.0010) [2023-12-26 13:10:14,039][123090] Updated weights for policy 1, policy_version 1688855 (0.0010) [2023-12-26 13:10:14,185][123091] Updated weights for policy 0, policy_version 1700049 (0.0006) [2023-12-26 13:10:14,247][123091] Updated weights for policy 0, policy_version 1700059 (0.0009) [2023-12-26 13:10:14,310][123091] Updated weights for policy 0, policy_version 1700069 (0.0010) [2023-12-26 13:10:14,370][123091] Updated weights for policy 0, policy_version 1700079 (0.0008) [2023-12-26 13:10:14,888][123090] Updated weights for policy 1, policy_version 1688865 (0.0009) [2023-12-26 13:10:14,943][123090] Updated weights for policy 1, policy_version 1688875 (0.0010) [2023-12-26 13:10:14,999][123090] Updated weights for policy 1, policy_version 1688885 (0.0010) [2023-12-26 13:10:15,065][123090] Updated weights for policy 1, policy_version 1688895 (0.0011) [2023-12-26 13:10:15,186][123091] Updated weights for policy 0, policy_version 1700089 (0.0010) [2023-12-26 13:10:15,250][123091] Updated weights for policy 0, policy_version 1700099 (0.0009) [2023-12-26 13:10:15,312][123091] Updated weights for policy 0, policy_version 1700109 (0.0009) [2023-12-26 13:10:15,943][123090] Updated weights for policy 1, policy_version 1688905 (0.0010) [2023-12-26 13:10:16,006][123090] Updated weights for policy 1, policy_version 1688915 (0.0009) [2023-12-26 13:10:16,060][123090] Updated weights for policy 1, policy_version 1688925 (0.0009) [2023-12-26 13:10:16,118][123091] Updated weights for policy 0, policy_version 1700119 (0.0010) [2023-12-26 13:10:16,173][123091] Updated weights for policy 0, policy_version 1700129 (0.0009) [2023-12-26 13:10:16,237][123091] Updated weights for policy 0, policy_version 1700139 (0.0008) [2023-12-26 13:10:16,924][123090] Updated weights for policy 1, policy_version 1688935 (0.0011) [2023-12-26 13:10:16,987][123090] Updated weights for policy 1, policy_version 1688945 (0.0010) [2023-12-26 13:10:17,041][123091] Updated weights for policy 0, policy_version 1700149 (0.0008) [2023-12-26 13:10:17,047][123090] Updated weights for policy 1, policy_version 1688955 (0.0011) [2023-12-26 13:10:17,103][123091] Updated weights for policy 0, policy_version 1700159 (0.0007) [2023-12-26 13:10:17,156][123091] Updated weights for policy 0, policy_version 1700169 (0.0009) [2023-12-26 13:10:17,769][123090] Updated weights for policy 1, policy_version 1688965 (0.0008) [2023-12-26 13:10:17,841][123090] Updated weights for policy 1, policy_version 1688975 (0.0005) [2023-12-26 13:10:17,905][123090] Updated weights for policy 1, policy_version 1688985 (0.0007) [2023-12-26 13:10:17,954][123091] Updated weights for policy 0, policy_version 1700179 (0.0008) [2023-12-26 13:10:18,006][123091] Updated weights for policy 0, policy_version 1700189 (0.0005) [2023-12-26 13:10:18,053][123091] Updated weights for policy 0, policy_version 1700199 (0.0005) [2023-12-26 13:10:18,761][123090] Updated weights for policy 1, policy_version 1688995 (0.0011) [2023-12-26 13:10:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 867639296. Throughput: 0: 8838.3, 1: 8806.9. Samples: 867656412. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:18,784][121949] Avg episode reward: [(0, '5879.733'), (1, '5530.237')] [2023-12-26 13:10:18,809][123091] Updated weights for policy 0, policy_version 1700209 (0.0006) [2023-12-26 13:10:18,834][123090] Updated weights for policy 1, policy_version 1689005 (0.0009) [2023-12-26 13:10:18,881][123091] Updated weights for policy 0, policy_version 1700219 (0.0010) [2023-12-26 13:10:18,895][123090] Updated weights for policy 1, policy_version 1689015 (0.0006) [2023-12-26 13:10:18,951][123091] Updated weights for policy 0, policy_version 1700229 (0.0010) [2023-12-26 13:10:19,015][123091] Updated weights for policy 0, policy_version 1700239 (0.0010) [2023-12-26 13:10:19,656][123090] Updated weights for policy 1, policy_version 1689025 (0.0007) [2023-12-26 13:10:19,726][123090] Updated weights for policy 1, policy_version 1689035 (0.0009) [2023-12-26 13:10:19,791][123090] Updated weights for policy 1, policy_version 1689045 (0.0007) [2023-12-26 13:10:19,809][123091] Updated weights for policy 0, policy_version 1700249 (0.0010) [2023-12-26 13:10:19,861][123090] Updated weights for policy 1, policy_version 1689055 (0.0007) [2023-12-26 13:10:19,896][123091] Updated weights for policy 0, policy_version 1700259 (0.0007) [2023-12-26 13:10:19,971][123091] Updated weights for policy 0, policy_version 1700269 (0.0009) [2023-12-26 13:10:20,518][123090] Updated weights for policy 1, policy_version 1689065 (0.0007) [2023-12-26 13:10:20,571][123090] Updated weights for policy 1, policy_version 1689075 (0.0009) [2023-12-26 13:10:20,638][123090] Updated weights for policy 1, policy_version 1689085 (0.0009) [2023-12-26 13:10:20,780][123091] Updated weights for policy 0, policy_version 1700279 (0.0010) [2023-12-26 13:10:20,849][123091] Updated weights for policy 0, policy_version 1700289 (0.0010) [2023-12-26 13:10:20,920][123091] Updated weights for policy 0, policy_version 1700299 (0.0011) [2023-12-26 13:10:21,482][123090] Updated weights for policy 1, policy_version 1689095 (0.0009) [2023-12-26 13:10:21,547][123090] Updated weights for policy 1, policy_version 1689105 (0.0009) [2023-12-26 13:10:21,605][123090] Updated weights for policy 1, policy_version 1689115 (0.0007) [2023-12-26 13:10:21,819][123091] Updated weights for policy 0, policy_version 1700309 (0.0011) [2023-12-26 13:10:21,887][123091] Updated weights for policy 0, policy_version 1700319 (0.0011) [2023-12-26 13:10:21,942][123091] Updated weights for policy 0, policy_version 1700329 (0.0011) [2023-12-26 13:10:22,450][123090] Updated weights for policy 1, policy_version 1689125 (0.0007) [2023-12-26 13:10:22,505][123090] Updated weights for policy 1, policy_version 1689135 (0.0009) [2023-12-26 13:10:22,566][123090] Updated weights for policy 1, policy_version 1689145 (0.0009) [2023-12-26 13:10:22,718][123091] Updated weights for policy 0, policy_version 1700339 (0.0009) [2023-12-26 13:10:22,778][123091] Updated weights for policy 0, policy_version 1700349 (0.0006) [2023-12-26 13:10:22,845][123091] Updated weights for policy 0, policy_version 1700359 (0.0008) [2023-12-26 13:10:23,389][123090] Updated weights for policy 1, policy_version 1689155 (0.0010) [2023-12-26 13:10:23,460][123090] Updated weights for policy 1, policy_version 1689165 (0.0009) [2023-12-26 13:10:23,517][123090] Updated weights for policy 1, policy_version 1689175 (0.0008) [2023-12-26 13:10:23,640][123091] Updated weights for policy 0, policy_version 1700369 (0.0006) [2023-12-26 13:10:23,717][123091] Updated weights for policy 0, policy_version 1700379 (0.0008) [2023-12-26 13:10:23,772][123091] Updated weights for policy 0, policy_version 1700389 (0.0010) [2023-12-26 13:10:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 867729408. Throughput: 0: 8793.9, 1: 8788.4. Samples: 867707568. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:23,785][121949] Avg episode reward: [(0, '5934.449'), (1, '5491.838')] [2023-12-26 13:10:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001689184_432431104.pth... [2023-12-26 13:10:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001688160_432168960.pth [2023-12-26 13:10:23,837][123091] Updated weights for policy 0, policy_version 1700399 (0.0010) [2023-12-26 13:10:23,842][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001700400_435306496.pth... [2023-12-26 13:10:23,845][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001699344_435036160.pth [2023-12-26 13:10:24,342][123090] Updated weights for policy 1, policy_version 1689185 (0.0009) [2023-12-26 13:10:24,414][123090] Updated weights for policy 1, policy_version 1689195 (0.0008) [2023-12-26 13:10:24,476][123090] Updated weights for policy 1, policy_version 1689205 (0.0010) [2023-12-26 13:10:24,542][123090] Updated weights for policy 1, policy_version 1689215 (0.0009) [2023-12-26 13:10:24,649][123091] Updated weights for policy 0, policy_version 1700409 (0.0009) [2023-12-26 13:10:24,712][123091] Updated weights for policy 0, policy_version 1700419 (0.0010) [2023-12-26 13:10:24,783][123091] Updated weights for policy 0, policy_version 1700429 (0.0010) [2023-12-26 13:10:25,361][123090] Updated weights for policy 1, policy_version 1689225 (0.0006) [2023-12-26 13:10:25,426][123090] Updated weights for policy 1, policy_version 1689235 (0.0005) [2023-12-26 13:10:25,486][123090] Updated weights for policy 1, policy_version 1689245 (0.0006) [2023-12-26 13:10:25,534][123091] Updated weights for policy 0, policy_version 1700439 (0.0007) [2023-12-26 13:10:25,580][123091] Updated weights for policy 0, policy_version 1700449 (0.0005) [2023-12-26 13:10:25,634][123091] Updated weights for policy 0, policy_version 1700459 (0.0005) [2023-12-26 13:10:26,142][123090] Updated weights for policy 1, policy_version 1689255 (0.0007) [2023-12-26 13:10:26,199][123090] Updated weights for policy 1, policy_version 1689265 (0.0005) [2023-12-26 13:10:26,263][123090] Updated weights for policy 1, policy_version 1689275 (0.0005) [2023-12-26 13:10:26,288][123091] Updated weights for policy 0, policy_version 1700469 (0.0007) [2023-12-26 13:10:26,341][123091] Updated weights for policy 0, policy_version 1700480 (0.0010) [2023-12-26 13:10:26,395][123091] Updated weights for policy 0, policy_version 1700490 (0.0007) [2023-12-26 13:10:26,864][123090] Updated weights for policy 1, policy_version 1689285 (0.0006) [2023-12-26 13:10:26,935][123090] Updated weights for policy 1, policy_version 1689295 (0.0011) [2023-12-26 13:10:26,997][123090] Updated weights for policy 1, policy_version 1689305 (0.0010) [2023-12-26 13:10:27,099][123091] Updated weights for policy 0, policy_version 1700500 (0.0005) [2023-12-26 13:10:27,149][123091] Updated weights for policy 0, policy_version 1700510 (0.0005) [2023-12-26 13:10:27,204][123091] Updated weights for policy 0, policy_version 1700520 (0.0005) [2023-12-26 13:10:27,787][123090] Updated weights for policy 1, policy_version 1689315 (0.0008) [2023-12-26 13:10:27,834][123090] Updated weights for policy 1, policy_version 1689325 (0.0010) [2023-12-26 13:10:27,880][123090] Updated weights for policy 1, policy_version 1689335 (0.0010) [2023-12-26 13:10:27,918][123091] Updated weights for policy 0, policy_version 1700530 (0.0005) [2023-12-26 13:10:27,975][123091] Updated weights for policy 0, policy_version 1700540 (0.0005) [2023-12-26 13:10:28,025][123091] Updated weights for policy 0, policy_version 1700550 (0.0005) [2023-12-26 13:10:28,080][123091] Updated weights for policy 0, policy_version 1700560 (0.0006) [2023-12-26 13:10:28,638][123090] Updated weights for policy 1, policy_version 1689345 (0.0010) [2023-12-26 13:10:28,696][123090] Updated weights for policy 1, policy_version 1689355 (0.0008) [2023-12-26 13:10:28,759][123090] Updated weights for policy 1, policy_version 1689365 (0.0006) [2023-12-26 13:10:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 867819520. Throughput: 0: 8862.7, 1: 8836.2. Samples: 867818056. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:28,785][121949] Avg episode reward: [(0, '6027.368'), (1, '5618.531')] [2023-12-26 13:10:28,815][123090] Updated weights for policy 1, policy_version 1689375 (0.0005) [2023-12-26 13:10:28,859][123091] Updated weights for policy 0, policy_version 1700570 (0.0010) [2023-12-26 13:10:28,918][123091] Updated weights for policy 0, policy_version 1700580 (0.0010) [2023-12-26 13:10:28,972][123091] Updated weights for policy 0, policy_version 1700590 (0.0010) [2023-12-26 13:10:29,559][123090] Updated weights for policy 1, policy_version 1689385 (0.0008) [2023-12-26 13:10:29,606][123090] Updated weights for policy 1, policy_version 1689395 (0.0008) [2023-12-26 13:10:29,653][123090] Updated weights for policy 1, policy_version 1689405 (0.0008) [2023-12-26 13:10:29,836][123091] Updated weights for policy 0, policy_version 1700600 (0.0011) [2023-12-26 13:10:29,913][123091] Updated weights for policy 0, policy_version 1700610 (0.0010) [2023-12-26 13:10:29,985][123091] Updated weights for policy 0, policy_version 1700620 (0.0010) [2023-12-26 13:10:30,432][123090] Updated weights for policy 1, policy_version 1689415 (0.0005) [2023-12-26 13:10:30,485][123090] Updated weights for policy 1, policy_version 1689425 (0.0007) [2023-12-26 13:10:30,551][123090] Updated weights for policy 1, policy_version 1689435 (0.0006) [2023-12-26 13:10:30,747][123091] Updated weights for policy 0, policy_version 1700630 (0.0007) [2023-12-26 13:10:30,807][123091] Updated weights for policy 0, policy_version 1700641 (0.0008) [2023-12-26 13:10:30,859][123091] Updated weights for policy 0, policy_version 1700651 (0.0009) [2023-12-26 13:10:31,317][123090] Updated weights for policy 1, policy_version 1689445 (0.0008) [2023-12-26 13:10:31,389][123090] Updated weights for policy 1, policy_version 1689455 (0.0008) [2023-12-26 13:10:31,458][123090] Updated weights for policy 1, policy_version 1689465 (0.0006) [2023-12-26 13:10:31,753][123091] Updated weights for policy 0, policy_version 1700661 (0.0009) [2023-12-26 13:10:31,814][123091] Updated weights for policy 0, policy_version 1700671 (0.0009) [2023-12-26 13:10:31,870][123091] Updated weights for policy 0, policy_version 1700681 (0.0008) [2023-12-26 13:10:32,192][123090] Updated weights for policy 1, policy_version 1689475 (0.0006) [2023-12-26 13:10:32,259][123090] Updated weights for policy 1, policy_version 1689485 (0.0010) [2023-12-26 13:10:32,320][123090] Updated weights for policy 1, policy_version 1689495 (0.0008) [2023-12-26 13:10:32,729][123091] Updated weights for policy 0, policy_version 1700691 (0.0010) [2023-12-26 13:10:32,782][123091] Updated weights for policy 0, policy_version 1700701 (0.0009) [2023-12-26 13:10:32,838][123091] Updated weights for policy 0, policy_version 1700711 (0.0010) [2023-12-26 13:10:33,132][123090] Updated weights for policy 1, policy_version 1689505 (0.0009) [2023-12-26 13:10:33,198][123090] Updated weights for policy 1, policy_version 1689515 (0.0009) [2023-12-26 13:10:33,268][123090] Updated weights for policy 1, policy_version 1689525 (0.0010) [2023-12-26 13:10:33,317][123090] Updated weights for policy 1, policy_version 1689535 (0.0009) [2023-12-26 13:10:33,631][123091] Updated weights for policy 0, policy_version 1700721 (0.0010) [2023-12-26 13:10:33,683][123091] Updated weights for policy 0, policy_version 1700731 (0.0009) [2023-12-26 13:10:33,735][123091] Updated weights for policy 0, policy_version 1700741 (0.0009) [2023-12-26 13:10:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 867909632. Throughput: 0: 8813.1, 1: 8783.2. Samples: 867924652. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:33,785][123091] Updated weights for policy 0, policy_version 1700751 (0.0005) [2023-12-26 13:10:33,785][121949] Avg episode reward: [(0, '6165.325'), (1, '5518.523')] [2023-12-26 13:10:34,190][123090] Updated weights for policy 1, policy_version 1689545 (0.0009) [2023-12-26 13:10:34,254][123090] Updated weights for policy 1, policy_version 1689555 (0.0009) [2023-12-26 13:10:34,315][123090] Updated weights for policy 1, policy_version 1689565 (0.0009) [2023-12-26 13:10:34,601][123091] Updated weights for policy 0, policy_version 1700761 (0.0010) [2023-12-26 13:10:34,662][123091] Updated weights for policy 0, policy_version 1700771 (0.0011) [2023-12-26 13:10:34,729][123091] Updated weights for policy 0, policy_version 1700781 (0.0010) [2023-12-26 13:10:35,127][123090] Updated weights for policy 1, policy_version 1689575 (0.0006) [2023-12-26 13:10:35,174][123090] Updated weights for policy 1, policy_version 1689585 (0.0005) [2023-12-26 13:10:35,224][123090] Updated weights for policy 1, policy_version 1689595 (0.0005) [2023-12-26 13:10:35,497][123091] Updated weights for policy 0, policy_version 1700791 (0.0011) [2023-12-26 13:10:35,564][123091] Updated weights for policy 0, policy_version 1700801 (0.0011) [2023-12-26 13:10:35,618][123091] Updated weights for policy 0, policy_version 1700811 (0.0010) [2023-12-26 13:10:35,838][123090] Updated weights for policy 1, policy_version 1689605 (0.0007) [2023-12-26 13:10:35,890][123090] Updated weights for policy 1, policy_version 1689615 (0.0008) [2023-12-26 13:10:35,948][123090] Updated weights for policy 1, policy_version 1689625 (0.0010) [2023-12-26 13:10:36,322][123091] Updated weights for policy 0, policy_version 1700821 (0.0011) [2023-12-26 13:10:36,388][123091] Updated weights for policy 0, policy_version 1700831 (0.0008) [2023-12-26 13:10:36,458][123091] Updated weights for policy 0, policy_version 1700841 (0.0010) [2023-12-26 13:10:36,833][123090] Updated weights for policy 1, policy_version 1689635 (0.0010) [2023-12-26 13:10:36,896][123090] Updated weights for policy 1, policy_version 1689645 (0.0009) [2023-12-26 13:10:36,952][123090] Updated weights for policy 1, policy_version 1689655 (0.0008) [2023-12-26 13:10:37,176][123091] Updated weights for policy 0, policy_version 1700851 (0.0007) [2023-12-26 13:10:37,246][123091] Updated weights for policy 0, policy_version 1700861 (0.0011) [2023-12-26 13:10:37,315][123091] Updated weights for policy 0, policy_version 1700871 (0.0011) [2023-12-26 13:10:37,753][123090] Updated weights for policy 1, policy_version 1689665 (0.0008) [2023-12-26 13:10:37,803][123090] Updated weights for policy 1, policy_version 1689675 (0.0005) [2023-12-26 13:10:37,855][123090] Updated weights for policy 1, policy_version 1689685 (0.0005) [2023-12-26 13:10:37,910][123090] Updated weights for policy 1, policy_version 1689695 (0.0005) [2023-12-26 13:10:38,069][123091] Updated weights for policy 0, policy_version 1700881 (0.0011) [2023-12-26 13:10:38,125][123091] Updated weights for policy 0, policy_version 1700891 (0.0009) [2023-12-26 13:10:38,204][123091] Updated weights for policy 0, policy_version 1700901 (0.0009) [2023-12-26 13:10:38,279][123091] Updated weights for policy 0, policy_version 1700911 (0.0010) [2023-12-26 13:10:38,620][123090] Updated weights for policy 1, policy_version 1689705 (0.0008) [2023-12-26 13:10:38,684][123090] Updated weights for policy 1, policy_version 1689715 (0.0009) [2023-12-26 13:10:38,744][123090] Updated weights for policy 1, policy_version 1689725 (0.0009) [2023-12-26 13:10:38,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 868007936. Throughput: 0: 8860.2, 1: 8790.2. Samples: 867979224. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:38,785][121949] Avg episode reward: [(0, '6138.213'), (1, '5147.662')] [2023-12-26 13:10:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001700912_435437568.pth... [2023-12-26 13:10:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001689728_432570368.pth... [2023-12-26 13:10:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001699888_435175424.pth [2023-12-26 13:10:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001688672_432300032.pth [2023-12-26 13:10:39,057][123091] Updated weights for policy 0, policy_version 1700921 (0.0010) [2023-12-26 13:10:39,108][123091] Updated weights for policy 0, policy_version 1700931 (0.0010) [2023-12-26 13:10:39,174][123091] Updated weights for policy 0, policy_version 1700941 (0.0010) [2023-12-26 13:10:39,483][123090] Updated weights for policy 1, policy_version 1689735 (0.0010) [2023-12-26 13:10:39,554][123090] Updated weights for policy 1, policy_version 1689745 (0.0011) [2023-12-26 13:10:39,627][123090] Updated weights for policy 1, policy_version 1689755 (0.0011) [2023-12-26 13:10:40,067][123091] Updated weights for policy 0, policy_version 1700951 (0.0010) [2023-12-26 13:10:40,134][123091] Updated weights for policy 0, policy_version 1700961 (0.0006) [2023-12-26 13:10:40,208][123091] Updated weights for policy 0, policy_version 1700971 (0.0005) [2023-12-26 13:10:40,492][123090] Updated weights for policy 1, policy_version 1689765 (0.0011) [2023-12-26 13:10:40,554][123090] Updated weights for policy 1, policy_version 1689775 (0.0011) [2023-12-26 13:10:40,621][123090] Updated weights for policy 1, policy_version 1689785 (0.0011) [2023-12-26 13:10:40,927][123091] Updated weights for policy 0, policy_version 1700981 (0.0005) [2023-12-26 13:10:40,993][123091] Updated weights for policy 0, policy_version 1700991 (0.0005) [2023-12-26 13:10:41,061][123091] Updated weights for policy 0, policy_version 1701001 (0.0009) [2023-12-26 13:10:41,382][123090] Updated weights for policy 1, policy_version 1689795 (0.0010) [2023-12-26 13:10:41,457][123090] Updated weights for policy 1, policy_version 1689805 (0.0007) [2023-12-26 13:10:41,528][123090] Updated weights for policy 1, policy_version 1689815 (0.0007) [2023-12-26 13:10:41,887][123091] Updated weights for policy 0, policy_version 1701011 (0.0008) [2023-12-26 13:10:41,944][123091] Updated weights for policy 0, policy_version 1701021 (0.0006) [2023-12-26 13:10:42,012][123091] Updated weights for policy 0, policy_version 1701031 (0.0011) [2023-12-26 13:10:42,322][123090] Updated weights for policy 1, policy_version 1689825 (0.0008) [2023-12-26 13:10:42,386][123090] Updated weights for policy 1, policy_version 1689835 (0.0009) [2023-12-26 13:10:42,453][123090] Updated weights for policy 1, policy_version 1689845 (0.0008) [2023-12-26 13:10:42,517][123090] Updated weights for policy 1, policy_version 1689855 (0.0009) [2023-12-26 13:10:42,824][123091] Updated weights for policy 0, policy_version 1701041 (0.0011) [2023-12-26 13:10:42,894][123091] Updated weights for policy 0, policy_version 1701051 (0.0011) [2023-12-26 13:10:42,958][123091] Updated weights for policy 0, policy_version 1701061 (0.0011) [2023-12-26 13:10:43,014][123091] Updated weights for policy 0, policy_version 1701071 (0.0011) [2023-12-26 13:10:43,349][123090] Updated weights for policy 1, policy_version 1689865 (0.0009) [2023-12-26 13:10:43,408][123090] Updated weights for policy 1, policy_version 1689875 (0.0008) [2023-12-26 13:10:43,472][123090] Updated weights for policy 1, policy_version 1689885 (0.0007) [2023-12-26 13:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 868089856. Throughput: 0: 8882.4, 1: 8786.6. Samples: 868086536. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:43,785][121949] Avg episode reward: [(0, '6110.415'), (1, '5169.756')] [2023-12-26 13:10:43,792][123091] Updated weights for policy 0, policy_version 1701081 (0.0006) [2023-12-26 13:10:43,869][123091] Updated weights for policy 0, policy_version 1701091 (0.0006) [2023-12-26 13:10:43,932][123091] Updated weights for policy 0, policy_version 1701101 (0.0006) [2023-12-26 13:10:44,194][123090] Updated weights for policy 1, policy_version 1689895 (0.0008) [2023-12-26 13:10:44,253][123090] Updated weights for policy 1, policy_version 1689905 (0.0010) [2023-12-26 13:10:44,302][123090] Updated weights for policy 1, policy_version 1689915 (0.0010) [2023-12-26 13:10:44,621][123091] Updated weights for policy 0, policy_version 1701111 (0.0008) [2023-12-26 13:10:44,677][123091] Updated weights for policy 0, policy_version 1701121 (0.0009) [2023-12-26 13:10:44,728][123091] Updated weights for policy 0, policy_version 1701131 (0.0009) [2023-12-26 13:10:45,129][123090] Updated weights for policy 1, policy_version 1689925 (0.0009) [2023-12-26 13:10:45,189][123090] Updated weights for policy 1, policy_version 1689935 (0.0010) [2023-12-26 13:10:45,249][123090] Updated weights for policy 1, policy_version 1689945 (0.0010) [2023-12-26 13:10:45,536][123091] Updated weights for policy 0, policy_version 1701141 (0.0008) [2023-12-26 13:10:45,600][123091] Updated weights for policy 0, policy_version 1701151 (0.0010) [2023-12-26 13:10:45,659][123091] Updated weights for policy 0, policy_version 1701161 (0.0010) [2023-12-26 13:10:46,090][123090] Updated weights for policy 1, policy_version 1689955 (0.0010) [2023-12-26 13:10:46,150][123090] Updated weights for policy 1, policy_version 1689965 (0.0009) [2023-12-26 13:10:46,198][123090] Updated weights for policy 1, policy_version 1689975 (0.0009) [2023-12-26 13:10:46,477][123091] Updated weights for policy 0, policy_version 1701171 (0.0010) [2023-12-26 13:10:46,526][123091] Updated weights for policy 0, policy_version 1701181 (0.0009) [2023-12-26 13:10:46,590][123091] Updated weights for policy 0, policy_version 1701191 (0.0008) [2023-12-26 13:10:46,968][123090] Updated weights for policy 1, policy_version 1689985 (0.0009) [2023-12-26 13:10:47,038][123090] Updated weights for policy 1, policy_version 1689995 (0.0006) [2023-12-26 13:10:47,108][123090] Updated weights for policy 1, policy_version 1690005 (0.0011) [2023-12-26 13:10:47,180][123090] Updated weights for policy 1, policy_version 1690015 (0.0011) [2023-12-26 13:10:47,318][123091] Updated weights for policy 0, policy_version 1701201 (0.0006) [2023-12-26 13:10:47,382][123091] Updated weights for policy 0, policy_version 1701211 (0.0009) [2023-12-26 13:10:47,449][123091] Updated weights for policy 0, policy_version 1701221 (0.0009) [2023-12-26 13:10:47,511][123091] Updated weights for policy 0, policy_version 1701231 (0.0008) [2023-12-26 13:10:47,974][123090] Updated weights for policy 1, policy_version 1690025 (0.0010) [2023-12-26 13:10:48,041][123090] Updated weights for policy 1, policy_version 1690035 (0.0007) [2023-12-26 13:10:48,121][123090] Updated weights for policy 1, policy_version 1690045 (0.0005) [2023-12-26 13:10:48,370][123091] Updated weights for policy 0, policy_version 1701241 (0.0009) [2023-12-26 13:10:48,428][123091] Updated weights for policy 0, policy_version 1701251 (0.0009) [2023-12-26 13:10:48,487][123091] Updated weights for policy 0, policy_version 1701261 (0.0009) [2023-12-26 13:10:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 868179968. Throughput: 0: 8920.6, 1: 8821.1. Samples: 868192876. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:48,785][121949] Avg episode reward: [(0, '5986.558'), (1, '5491.656')] [2023-12-26 13:10:48,863][123090] Updated weights for policy 1, policy_version 1690055 (0.0009) [2023-12-26 13:10:48,930][123090] Updated weights for policy 1, policy_version 1690065 (0.0010) [2023-12-26 13:10:49,003][123090] Updated weights for policy 1, policy_version 1690075 (0.0011) [2023-12-26 13:10:49,245][123091] Updated weights for policy 0, policy_version 1701271 (0.0008) [2023-12-26 13:10:49,314][123091] Updated weights for policy 0, policy_version 1701281 (0.0008) [2023-12-26 13:10:49,387][123091] Updated weights for policy 0, policy_version 1701291 (0.0009) [2023-12-26 13:10:49,798][123090] Updated weights for policy 1, policy_version 1690085 (0.0008) [2023-12-26 13:10:49,865][123090] Updated weights for policy 1, policy_version 1690095 (0.0008) [2023-12-26 13:10:49,933][123090] Updated weights for policy 1, policy_version 1690105 (0.0008) [2023-12-26 13:10:50,153][123091] Updated weights for policy 0, policy_version 1701301 (0.0010) [2023-12-26 13:10:50,208][123091] Updated weights for policy 0, policy_version 1701311 (0.0010) [2023-12-26 13:10:50,263][123091] Updated weights for policy 0, policy_version 1701321 (0.0010) [2023-12-26 13:10:50,663][123090] Updated weights for policy 1, policy_version 1690115 (0.0011) [2023-12-26 13:10:50,735][123090] Updated weights for policy 1, policy_version 1690125 (0.0011) [2023-12-26 13:10:50,810][123090] Updated weights for policy 1, policy_version 1690135 (0.0011) [2023-12-26 13:10:51,117][123091] Updated weights for policy 0, policy_version 1701331 (0.0010) [2023-12-26 13:10:51,177][123091] Updated weights for policy 0, policy_version 1701341 (0.0010) [2023-12-26 13:10:51,237][123091] Updated weights for policy 0, policy_version 1701351 (0.0010) [2023-12-26 13:10:51,647][123090] Updated weights for policy 1, policy_version 1690145 (0.0010) [2023-12-26 13:10:51,719][123090] Updated weights for policy 1, policy_version 1690155 (0.0008) [2023-12-26 13:10:51,792][123090] Updated weights for policy 1, policy_version 1690165 (0.0008) [2023-12-26 13:10:51,856][123090] Updated weights for policy 1, policy_version 1690175 (0.0008) [2023-12-26 13:10:52,077][123091] Updated weights for policy 0, policy_version 1701361 (0.0010) [2023-12-26 13:10:52,150][123091] Updated weights for policy 0, policy_version 1701371 (0.0005) [2023-12-26 13:10:52,219][123091] Updated weights for policy 0, policy_version 1701381 (0.0005) [2023-12-26 13:10:52,291][123091] Updated weights for policy 0, policy_version 1701391 (0.0007) [2023-12-26 13:10:52,694][123090] Updated weights for policy 1, policy_version 1690185 (0.0009) [2023-12-26 13:10:52,747][123090] Updated weights for policy 1, policy_version 1690196 (0.0010) [2023-12-26 13:10:52,802][123090] Updated weights for policy 1, policy_version 1690206 (0.0009) [2023-12-26 13:10:52,944][123091] Updated weights for policy 0, policy_version 1701401 (0.0009) [2023-12-26 13:10:52,996][123091] Updated weights for policy 0, policy_version 1701411 (0.0009) [2023-12-26 13:10:53,059][123091] Updated weights for policy 0, policy_version 1701421 (0.0009) [2023-12-26 13:10:53,655][123090] Updated weights for policy 1, policy_version 1690216 (0.0008) [2023-12-26 13:10:53,718][123090] Updated weights for policy 1, policy_version 1690226 (0.0010) [2023-12-26 13:10:53,778][123090] Updated weights for policy 1, policy_version 1690236 (0.0010) [2023-12-26 13:10:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 868261888. Throughput: 0: 8870.8, 1: 8822.7. Samples: 868245508. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:53,785][121949] Avg episode reward: [(0, '5865.767'), (1, '5630.843')] [2023-12-26 13:10:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001701424_435568640.pth... [2023-12-26 13:10:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001700400_435306496.pth [2023-12-26 13:10:53,801][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001690240_432701440.pth... [2023-12-26 13:10:53,806][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001689184_432431104.pth [2023-12-26 13:10:53,862][123091] Updated weights for policy 0, policy_version 1701431 (0.0009) [2023-12-26 13:10:53,912][123091] Updated weights for policy 0, policy_version 1701442 (0.0009) [2023-12-26 13:10:53,964][123091] Updated weights for policy 0, policy_version 1701452 (0.0005) [2023-12-26 13:10:54,545][123090] Updated weights for policy 1, policy_version 1690246 (0.0010) [2023-12-26 13:10:54,605][123090] Updated weights for policy 1, policy_version 1690256 (0.0008) [2023-12-26 13:10:54,670][123090] Updated weights for policy 1, policy_version 1690266 (0.0009) [2023-12-26 13:10:54,762][123091] Updated weights for policy 0, policy_version 1701462 (0.0008) [2023-12-26 13:10:54,821][123091] Updated weights for policy 0, policy_version 1701472 (0.0010) [2023-12-26 13:10:54,882][123091] Updated weights for policy 0, policy_version 1701482 (0.0010) [2023-12-26 13:10:55,387][123090] Updated weights for policy 1, policy_version 1690276 (0.0007) [2023-12-26 13:10:55,453][123090] Updated weights for policy 1, policy_version 1690286 (0.0005) [2023-12-26 13:10:55,523][123090] Updated weights for policy 1, policy_version 1690296 (0.0005) [2023-12-26 13:10:55,596][123091] Updated weights for policy 0, policy_version 1701492 (0.0008) [2023-12-26 13:10:55,661][123091] Updated weights for policy 0, policy_version 1701502 (0.0005) [2023-12-26 13:10:55,735][123091] Updated weights for policy 0, policy_version 1701512 (0.0007) [2023-12-26 13:10:56,271][123090] Updated weights for policy 1, policy_version 1690306 (0.0005) [2023-12-26 13:10:56,334][123090] Updated weights for policy 1, policy_version 1690316 (0.0008) [2023-12-26 13:10:56,393][123090] Updated weights for policy 1, policy_version 1690326 (0.0008) [2023-12-26 13:10:56,402][123091] Updated weights for policy 0, policy_version 1701522 (0.0012) [2023-12-26 13:10:56,450][123090] Updated weights for policy 1, policy_version 1690336 (0.0008) [2023-12-26 13:10:56,470][123091] Updated weights for policy 0, policy_version 1701532 (0.0009) [2023-12-26 13:10:56,534][123091] Updated weights for policy 0, policy_version 1701542 (0.0009) [2023-12-26 13:10:56,592][123091] Updated weights for policy 0, policy_version 1701552 (0.0006) [2023-12-26 13:10:57,165][123090] Updated weights for policy 1, policy_version 1690346 (0.0008) [2023-12-26 13:10:57,242][123090] Updated weights for policy 1, policy_version 1690356 (0.0005) [2023-12-26 13:10:57,312][123090] Updated weights for policy 1, policy_version 1690366 (0.0006) [2023-12-26 13:10:57,365][123091] Updated weights for policy 0, policy_version 1701562 (0.0005) [2023-12-26 13:10:57,430][123091] Updated weights for policy 0, policy_version 1701572 (0.0005) [2023-12-26 13:10:57,494][123091] Updated weights for policy 0, policy_version 1701582 (0.0006) [2023-12-26 13:10:57,985][123090] Updated weights for policy 1, policy_version 1690376 (0.0006) [2023-12-26 13:10:58,051][123090] Updated weights for policy 1, policy_version 1690386 (0.0009) [2023-12-26 13:10:58,114][123090] Updated weights for policy 1, policy_version 1690396 (0.0010) [2023-12-26 13:10:58,283][123091] Updated weights for policy 0, policy_version 1701592 (0.0007) [2023-12-26 13:10:58,353][123091] Updated weights for policy 0, policy_version 1701602 (0.0008) [2023-12-26 13:10:58,424][123091] Updated weights for policy 0, policy_version 1701612 (0.0008) [2023-12-26 13:10:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 868360192. Throughput: 0: 8950.4, 1: 8896.4. Samples: 868354876. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:10:58,785][121949] Avg episode reward: [(0, '5900.142'), (1, '5758.906')] [2023-12-26 13:10:58,990][123090] Updated weights for policy 1, policy_version 1690406 (0.0009) [2023-12-26 13:10:59,056][123090] Updated weights for policy 1, policy_version 1690416 (0.0008) [2023-12-26 13:10:59,123][123090] Updated weights for policy 1, policy_version 1690426 (0.0006) [2023-12-26 13:10:59,345][123091] Updated weights for policy 0, policy_version 1701622 (0.0008) [2023-12-26 13:10:59,411][123091] Updated weights for policy 0, policy_version 1701632 (0.0008) [2023-12-26 13:10:59,476][123091] Updated weights for policy 0, policy_version 1701642 (0.0008) [2023-12-26 13:10:59,943][123090] Updated weights for policy 1, policy_version 1690436 (0.0007) [2023-12-26 13:11:00,008][123090] Updated weights for policy 1, policy_version 1690446 (0.0010) [2023-12-26 13:11:00,060][123090] Updated weights for policy 1, policy_version 1690456 (0.0007) [2023-12-26 13:11:00,287][123091] Updated weights for policy 0, policy_version 1701652 (0.0009) [2023-12-26 13:11:00,339][123091] Updated weights for policy 0, policy_version 1701663 (0.0010) [2023-12-26 13:11:00,386][123091] Updated weights for policy 0, policy_version 1701673 (0.0009) [2023-12-26 13:11:00,868][123090] Updated weights for policy 1, policy_version 1690466 (0.0010) [2023-12-26 13:11:00,922][123090] Updated weights for policy 1, policy_version 1690476 (0.0009) [2023-12-26 13:11:00,979][123090] Updated weights for policy 1, policy_version 1690487 (0.0010) [2023-12-26 13:11:01,098][123091] Updated weights for policy 0, policy_version 1701683 (0.0008) [2023-12-26 13:11:01,164][123091] Updated weights for policy 0, policy_version 1701693 (0.0010) [2023-12-26 13:11:01,222][123091] Updated weights for policy 0, policy_version 1701703 (0.0009) [2023-12-26 13:11:01,908][123090] Updated weights for policy 1, policy_version 1690497 (0.0009) [2023-12-26 13:11:01,976][123090] Updated weights for policy 1, policy_version 1690507 (0.0010) [2023-12-26 13:11:02,031][123091] Updated weights for policy 0, policy_version 1701713 (0.0010) [2023-12-26 13:11:02,042][123090] Updated weights for policy 1, policy_version 1690517 (0.0009) [2023-12-26 13:11:02,088][123091] Updated weights for policy 0, policy_version 1701723 (0.0007) [2023-12-26 13:11:02,104][123090] Updated weights for policy 1, policy_version 1690527 (0.0007) [2023-12-26 13:11:02,138][123091] Updated weights for policy 0, policy_version 1701733 (0.0009) [2023-12-26 13:11:02,195][123091] Updated weights for policy 0, policy_version 1701743 (0.0010) [2023-12-26 13:11:02,938][123090] Updated weights for policy 1, policy_version 1690537 (0.0009) [2023-12-26 13:11:02,979][123091] Updated weights for policy 0, policy_version 1701753 (0.0009) [2023-12-26 13:11:02,992][123090] Updated weights for policy 1, policy_version 1690547 (0.0009) [2023-12-26 13:11:03,041][123091] Updated weights for policy 0, policy_version 1701763 (0.0008) [2023-12-26 13:11:03,052][123090] Updated weights for policy 1, policy_version 1690557 (0.0008) [2023-12-26 13:11:03,104][123091] Updated weights for policy 0, policy_version 1701773 (0.0009) [2023-12-26 13:11:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 868442112. Throughput: 0: 8927.6, 1: 8904.8. Samples: 868458872. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:03,784][121949] Avg episode reward: [(0, '6014.424'), (1, '5822.227')] [2023-12-26 13:11:03,884][123090] Updated weights for policy 1, policy_version 1690567 (0.0008) [2023-12-26 13:11:03,931][123091] Updated weights for policy 0, policy_version 1701783 (0.0011) [2023-12-26 13:11:03,947][123090] Updated weights for policy 1, policy_version 1690577 (0.0008) [2023-12-26 13:11:03,983][123091] Updated weights for policy 0, policy_version 1701793 (0.0011) [2023-12-26 13:11:04,010][123090] Updated weights for policy 1, policy_version 1690587 (0.0008) [2023-12-26 13:11:04,036][123091] Updated weights for policy 0, policy_version 1701803 (0.0011) [2023-12-26 13:11:04,772][123091] Updated weights for policy 0, policy_version 1701813 (0.0009) [2023-12-26 13:11:04,777][123090] Updated weights for policy 1, policy_version 1690597 (0.0009) [2023-12-26 13:11:04,831][123091] Updated weights for policy 0, policy_version 1701823 (0.0010) [2023-12-26 13:11:04,833][123090] Updated weights for policy 1, policy_version 1690607 (0.0008) [2023-12-26 13:11:04,882][123091] Updated weights for policy 0, policy_version 1701833 (0.0005) [2023-12-26 13:11:04,903][123090] Updated weights for policy 1, policy_version 1690617 (0.0006) [2023-12-26 13:11:05,570][123091] Updated weights for policy 0, policy_version 1701843 (0.0007) [2023-12-26 13:11:05,613][123091] Updated weights for policy 0, policy_version 1701853 (0.0010) [2023-12-26 13:11:05,668][123091] Updated weights for policy 0, policy_version 1701863 (0.0010) [2023-12-26 13:11:05,669][123090] Updated weights for policy 1, policy_version 1690627 (0.0007) [2023-12-26 13:11:05,723][123090] Updated weights for policy 1, policy_version 1690637 (0.0010) [2023-12-26 13:11:05,771][123090] Updated weights for policy 1, policy_version 1690647 (0.0010) [2023-12-26 13:11:06,441][123091] Updated weights for policy 0, policy_version 1701873 (0.0010) [2023-12-26 13:11:06,509][123091] Updated weights for policy 0, policy_version 1701883 (0.0006) [2023-12-26 13:11:06,582][123091] Updated weights for policy 0, policy_version 1701893 (0.0006) [2023-12-26 13:11:06,615][123090] Updated weights for policy 1, policy_version 1690657 (0.0010) [2023-12-26 13:11:06,656][123091] Updated weights for policy 0, policy_version 1701903 (0.0006) [2023-12-26 13:11:06,679][123090] Updated weights for policy 1, policy_version 1690667 (0.0011) [2023-12-26 13:11:06,743][123090] Updated weights for policy 1, policy_version 1690677 (0.0011) [2023-12-26 13:11:06,807][123090] Updated weights for policy 1, policy_version 1690687 (0.0011) [2023-12-26 13:11:07,315][123091] Updated weights for policy 0, policy_version 1701913 (0.0006) [2023-12-26 13:11:07,370][123091] Updated weights for policy 0, policy_version 1701923 (0.0006) [2023-12-26 13:11:07,427][123091] Updated weights for policy 0, policy_version 1701933 (0.0006) [2023-12-26 13:11:07,589][123090] Updated weights for policy 1, policy_version 1690697 (0.0010) [2023-12-26 13:11:07,652][123090] Updated weights for policy 1, policy_version 1690707 (0.0011) [2023-12-26 13:11:07,730][123090] Updated weights for policy 1, policy_version 1690717 (0.0006) [2023-12-26 13:11:08,184][123091] Updated weights for policy 0, policy_version 1701943 (0.0009) [2023-12-26 13:11:08,242][123091] Updated weights for policy 0, policy_version 1701953 (0.0010) [2023-12-26 13:11:08,297][123091] Updated weights for policy 0, policy_version 1701965 (0.0011) [2023-12-26 13:11:08,384][123090] Updated weights for policy 1, policy_version 1690727 (0.0006) [2023-12-26 13:11:08,447][123090] Updated weights for policy 1, policy_version 1690737 (0.0011) [2023-12-26 13:11:08,511][123090] Updated weights for policy 1, policy_version 1690747 (0.0010) [2023-12-26 13:11:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 868540416. Throughput: 0: 9001.1, 1: 8918.6. Samples: 868513952. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:08,785][121949] Avg episode reward: [(0, '6142.020'), (1, '5914.770')] [2023-12-26 13:11:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001701968_435707904.pth... [2023-12-26 13:11:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001690752_432832512.pth... [2023-12-26 13:11:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001700912_435437568.pth [2023-12-26 13:11:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001689728_432570368.pth [2023-12-26 13:11:09,191][123091] Updated weights for policy 0, policy_version 1701975 (0.0007) [2023-12-26 13:11:09,200][123090] Updated weights for policy 1, policy_version 1690757 (0.0008) [2023-12-26 13:11:09,255][123091] Updated weights for policy 0, policy_version 1701985 (0.0009) [2023-12-26 13:11:09,272][123090] Updated weights for policy 1, policy_version 1690767 (0.0008) [2023-12-26 13:11:09,324][123091] Updated weights for policy 0, policy_version 1701995 (0.0008) [2023-12-26 13:11:09,339][123090] Updated weights for policy 1, policy_version 1690777 (0.0008) [2023-12-26 13:11:10,087][123091] Updated weights for policy 0, policy_version 1702005 (0.0009) [2023-12-26 13:11:10,137][123090] Updated weights for policy 1, policy_version 1690787 (0.0009) [2023-12-26 13:11:10,139][123091] Updated weights for policy 0, policy_version 1702015 (0.0008) [2023-12-26 13:11:10,196][123091] Updated weights for policy 0, policy_version 1702025 (0.0007) [2023-12-26 13:11:10,201][123090] Updated weights for policy 1, policy_version 1690797 (0.0011) [2023-12-26 13:11:10,265][123090] Updated weights for policy 1, policy_version 1690807 (0.0011) [2023-12-26 13:11:10,946][123091] Updated weights for policy 0, policy_version 1702035 (0.0007) [2023-12-26 13:11:10,997][123091] Updated weights for policy 0, policy_version 1702045 (0.0006) [2023-12-26 13:11:11,048][123090] Updated weights for policy 1, policy_version 1690817 (0.0011) [2023-12-26 13:11:11,061][123091] Updated weights for policy 0, policy_version 1702055 (0.0007) [2023-12-26 13:11:11,112][123090] Updated weights for policy 1, policy_version 1690827 (0.0007) [2023-12-26 13:11:11,182][123090] Updated weights for policy 1, policy_version 1690837 (0.0009) [2023-12-26 13:11:11,244][123090] Updated weights for policy 1, policy_version 1690847 (0.0009) [2023-12-26 13:11:11,962][123091] Updated weights for policy 0, policy_version 1702065 (0.0009) [2023-12-26 13:11:12,028][123091] Updated weights for policy 0, policy_version 1702075 (0.0007) [2023-12-26 13:11:12,095][123091] Updated weights for policy 0, policy_version 1702085 (0.0010) [2023-12-26 13:11:12,150][123090] Updated weights for policy 1, policy_version 1690857 (0.0009) [2023-12-26 13:11:12,163][123091] Updated weights for policy 0, policy_version 1702095 (0.0009) [2023-12-26 13:11:12,218][123090] Updated weights for policy 1, policy_version 1690867 (0.0011) [2023-12-26 13:11:12,279][123090] Updated weights for policy 1, policy_version 1690877 (0.0011) [2023-12-26 13:11:12,978][123090] Updated weights for policy 1, policy_version 1690887 (0.0007) [2023-12-26 13:11:13,044][123090] Updated weights for policy 1, policy_version 1690897 (0.0005) [2023-12-26 13:11:13,079][123091] Updated weights for policy 0, policy_version 1702105 (0.0009) [2023-12-26 13:11:13,109][123090] Updated weights for policy 1, policy_version 1690907 (0.0005) [2023-12-26 13:11:13,142][123091] Updated weights for policy 0, policy_version 1702115 (0.0008) [2023-12-26 13:11:13,194][123091] Updated weights for policy 0, policy_version 1702125 (0.0009) [2023-12-26 13:11:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 868622336. Throughput: 0: 8927.9, 1: 8888.4. Samples: 868619788. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:13,784][121949] Avg episode reward: [(0, '6074.139'), (1, '5535.435')] [2023-12-26 13:11:13,827][123090] Updated weights for policy 1, policy_version 1690917 (0.0009) [2023-12-26 13:11:13,899][123090] Updated weights for policy 1, policy_version 1690927 (0.0009) [2023-12-26 13:11:13,972][123090] Updated weights for policy 1, policy_version 1690937 (0.0009) [2023-12-26 13:11:14,058][123091] Updated weights for policy 0, policy_version 1702135 (0.0006) [2023-12-26 13:11:14,119][123091] Updated weights for policy 0, policy_version 1702145 (0.0006) [2023-12-26 13:11:14,190][123091] Updated weights for policy 0, policy_version 1702156 (0.0007) [2023-12-26 13:11:14,811][123090] Updated weights for policy 1, policy_version 1690947 (0.0010) [2023-12-26 13:11:14,850][123091] Updated weights for policy 0, policy_version 1702166 (0.0008) [2023-12-26 13:11:14,866][123090] Updated weights for policy 1, policy_version 1690957 (0.0009) [2023-12-26 13:11:14,904][123091] Updated weights for policy 0, policy_version 1702176 (0.0008) [2023-12-26 13:11:14,930][123090] Updated weights for policy 1, policy_version 1690967 (0.0008) [2023-12-26 13:11:14,968][123091] Updated weights for policy 0, policy_version 1702186 (0.0008) [2023-12-26 13:11:15,748][123091] Updated weights for policy 0, policy_version 1702196 (0.0007) [2023-12-26 13:11:15,806][123091] Updated weights for policy 0, policy_version 1702206 (0.0009) [2023-12-26 13:11:15,819][123090] Updated weights for policy 1, policy_version 1690977 (0.0008) [2023-12-26 13:11:15,858][123091] Updated weights for policy 0, policy_version 1702216 (0.0009) [2023-12-26 13:11:15,878][123090] Updated weights for policy 1, policy_version 1690987 (0.0005) [2023-12-26 13:11:15,936][123090] Updated weights for policy 1, policy_version 1690997 (0.0005) [2023-12-26 13:11:15,985][123090] Updated weights for policy 1, policy_version 1691007 (0.0005) [2023-12-26 13:11:16,495][123091] Updated weights for policy 0, policy_version 1702226 (0.0007) [2023-12-26 13:11:16,548][123091] Updated weights for policy 0, policy_version 1702236 (0.0005) [2023-12-26 13:11:16,611][123091] Updated weights for policy 0, policy_version 1702246 (0.0005) [2023-12-26 13:11:16,689][123091] Updated weights for policy 0, policy_version 1702256 (0.0005) [2023-12-26 13:11:16,730][123090] Updated weights for policy 1, policy_version 1691017 (0.0007) [2023-12-26 13:11:16,788][123090] Updated weights for policy 1, policy_version 1691027 (0.0010) [2023-12-26 13:11:16,849][123090] Updated weights for policy 1, policy_version 1691037 (0.0008) [2023-12-26 13:11:17,433][123091] Updated weights for policy 0, policy_version 1702267 (0.0009) [2023-12-26 13:11:17,491][123091] Updated weights for policy 0, policy_version 1702278 (0.0010) [2023-12-26 13:11:17,544][123091] Updated weights for policy 0, policy_version 1702288 (0.0009) [2023-12-26 13:11:17,628][123090] Updated weights for policy 1, policy_version 1691047 (0.0009) [2023-12-26 13:11:17,681][123090] Updated weights for policy 1, policy_version 1691057 (0.0010) [2023-12-26 13:11:17,739][123090] Updated weights for policy 1, policy_version 1691068 (0.0010) [2023-12-26 13:11:18,362][123091] Updated weights for policy 0, policy_version 1702298 (0.0010) [2023-12-26 13:11:18,429][123091] Updated weights for policy 0, policy_version 1702308 (0.0010) [2023-12-26 13:11:18,496][123091] Updated weights for policy 0, policy_version 1702318 (0.0010) [2023-12-26 13:11:18,601][123090] Updated weights for policy 1, policy_version 1691078 (0.0009) [2023-12-26 13:11:18,669][123090] Updated weights for policy 1, policy_version 1691088 (0.0006) [2023-12-26 13:11:18,731][123090] Updated weights for policy 1, policy_version 1691098 (0.0005) [2023-12-26 13:11:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 868720640. Throughput: 0: 8975.0, 1: 8854.0. Samples: 868726960. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:18,785][121949] Avg episode reward: [(0, '6040.331'), (1, '5512.324')] [2023-12-26 13:11:19,388][123091] Updated weights for policy 0, policy_version 1702328 (0.0008) [2023-12-26 13:11:19,448][123091] Updated weights for policy 0, policy_version 1702338 (0.0009) [2023-12-26 13:11:19,510][123090] Updated weights for policy 1, policy_version 1691108 (0.0007) [2023-12-26 13:11:19,535][123091] Updated weights for policy 0, policy_version 1702348 (0.0009) [2023-12-26 13:11:19,579][123090] Updated weights for policy 1, policy_version 1691118 (0.0008) [2023-12-26 13:11:19,653][123090] Updated weights for policy 1, policy_version 1691128 (0.0006) [2023-12-26 13:11:20,342][123091] Updated weights for policy 0, policy_version 1702358 (0.0010) [2023-12-26 13:11:20,371][123090] Updated weights for policy 1, policy_version 1691138 (0.0007) [2023-12-26 13:11:20,402][123091] Updated weights for policy 0, policy_version 1702368 (0.0011) [2023-12-26 13:11:20,419][123090] Updated weights for policy 1, policy_version 1691148 (0.0010) [2023-12-26 13:11:20,457][123091] Updated weights for policy 0, policy_version 1702378 (0.0011) [2023-12-26 13:11:20,471][123090] Updated weights for policy 1, policy_version 1691158 (0.0010) [2023-12-26 13:11:20,522][123090] Updated weights for policy 1, policy_version 1691168 (0.0010) [2023-12-26 13:11:21,293][123091] Updated weights for policy 0, policy_version 1702388 (0.0010) [2023-12-26 13:11:21,366][123091] Updated weights for policy 0, policy_version 1702398 (0.0011) [2023-12-26 13:11:21,398][123090] Updated weights for policy 1, policy_version 1691178 (0.0010) [2023-12-26 13:11:21,441][123091] Updated weights for policy 0, policy_version 1702409 (0.0008) [2023-12-26 13:11:21,457][123090] Updated weights for policy 1, policy_version 1691188 (0.0008) [2023-12-26 13:11:21,523][123090] Updated weights for policy 1, policy_version 1691198 (0.0005) [2023-12-26 13:11:22,303][123091] Updated weights for policy 0, policy_version 1702419 (0.0008) [2023-12-26 13:11:22,336][123090] Updated weights for policy 1, policy_version 1691208 (0.0009) [2023-12-26 13:11:22,374][123091] Updated weights for policy 0, policy_version 1702429 (0.0007) [2023-12-26 13:11:22,415][123090] Updated weights for policy 1, policy_version 1691218 (0.0010) [2023-12-26 13:11:22,443][123091] Updated weights for policy 0, policy_version 1702439 (0.0006) [2023-12-26 13:11:22,488][123090] Updated weights for policy 1, policy_version 1691228 (0.0009) [2023-12-26 13:11:23,237][123091] Updated weights for policy 0, policy_version 1702449 (0.0009) [2023-12-26 13:11:23,294][123090] Updated weights for policy 1, policy_version 1691238 (0.0009) [2023-12-26 13:11:23,301][123091] Updated weights for policy 0, policy_version 1702459 (0.0007) [2023-12-26 13:11:23,349][123090] Updated weights for policy 1, policy_version 1691248 (0.0010) [2023-12-26 13:11:23,363][123091] Updated weights for policy 0, policy_version 1702469 (0.0007) [2023-12-26 13:11:23,401][123090] Updated weights for policy 1, policy_version 1691258 (0.0005) [2023-12-26 13:11:23,423][123091] Updated weights for policy 0, policy_version 1702479 (0.0008) [2023-12-26 13:11:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 868802560. Throughput: 0: 8908.3, 1: 8860.2. Samples: 868778804. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:23,785][121949] Avg episode reward: [(0, '6189.033'), (1, '5669.047')] [2023-12-26 13:11:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001702480_435838976.pth... [2023-12-26 13:11:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001691264_432963584.pth... [2023-12-26 13:11:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001690240_432701440.pth [2023-12-26 13:11:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001701424_435568640.pth [2023-12-26 13:11:24,158][123091] Updated weights for policy 0, policy_version 1702489 (0.0010) [2023-12-26 13:11:24,211][123091] Updated weights for policy 0, policy_version 1702499 (0.0008) [2023-12-26 13:11:24,221][123090] Updated weights for policy 1, policy_version 1691268 (0.0010) [2023-12-26 13:11:24,283][123091] Updated weights for policy 0, policy_version 1702509 (0.0006) [2023-12-26 13:11:24,284][123090] Updated weights for policy 1, policy_version 1691278 (0.0010) [2023-12-26 13:11:24,347][123090] Updated weights for policy 1, policy_version 1691288 (0.0010) [2023-12-26 13:11:24,999][123091] Updated weights for policy 0, policy_version 1702519 (0.0011) [2023-12-26 13:11:25,058][123091] Updated weights for policy 0, policy_version 1702529 (0.0008) [2023-12-26 13:11:25,114][123091] Updated weights for policy 0, policy_version 1702539 (0.0007) [2023-12-26 13:11:25,181][123090] Updated weights for policy 1, policy_version 1691298 (0.0010) [2023-12-26 13:11:25,248][123090] Updated weights for policy 1, policy_version 1691308 (0.0010) [2023-12-26 13:11:25,311][123090] Updated weights for policy 1, policy_version 1691318 (0.0010) [2023-12-26 13:11:25,373][123090] Updated weights for policy 1, policy_version 1691328 (0.0010) [2023-12-26 13:11:25,801][123091] Updated weights for policy 0, policy_version 1702549 (0.0006) [2023-12-26 13:11:25,860][123091] Updated weights for policy 0, policy_version 1702559 (0.0005) [2023-12-26 13:11:25,925][123091] Updated weights for policy 0, policy_version 1702569 (0.0005) [2023-12-26 13:11:26,174][123090] Updated weights for policy 1, policy_version 1691338 (0.0010) [2023-12-26 13:11:26,241][123090] Updated weights for policy 1, policy_version 1691348 (0.0010) [2023-12-26 13:11:26,304][123090] Updated weights for policy 1, policy_version 1691358 (0.0011) [2023-12-26 13:11:26,590][123091] Updated weights for policy 0, policy_version 1702579 (0.0006) [2023-12-26 13:11:26,641][123091] Updated weights for policy 0, policy_version 1702589 (0.0009) [2023-12-26 13:11:26,700][123091] Updated weights for policy 0, policy_version 1702599 (0.0008) [2023-12-26 13:11:27,115][123090] Updated weights for policy 1, policy_version 1691368 (0.0010) [2023-12-26 13:11:27,159][123090] Updated weights for policy 1, policy_version 1691378 (0.0010) [2023-12-26 13:11:27,206][123090] Updated weights for policy 1, policy_version 1691388 (0.0010) [2023-12-26 13:11:27,424][123091] Updated weights for policy 0, policy_version 1702609 (0.0009) [2023-12-26 13:11:27,486][123091] Updated weights for policy 0, policy_version 1702619 (0.0008) [2023-12-26 13:11:27,546][123091] Updated weights for policy 0, policy_version 1702629 (0.0005) [2023-12-26 13:11:27,602][123091] Updated weights for policy 0, policy_version 1702639 (0.0005) [2023-12-26 13:11:28,066][123090] Updated weights for policy 1, policy_version 1691398 (0.0010) [2023-12-26 13:11:28,117][123090] Updated weights for policy 1, policy_version 1691408 (0.0010) [2023-12-26 13:11:28,161][123090] Updated weights for policy 1, policy_version 1691418 (0.0010) [2023-12-26 13:11:28,280][123091] Updated weights for policy 0, policy_version 1702649 (0.0007) [2023-12-26 13:11:28,337][123091] Updated weights for policy 0, policy_version 1702659 (0.0006) [2023-12-26 13:11:28,402][123091] Updated weights for policy 0, policy_version 1702669 (0.0008) [2023-12-26 13:11:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 868892672. Throughput: 0: 8982.3, 1: 8805.7. Samples: 868886996. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:28,785][121949] Avg episode reward: [(0, '6265.190'), (1, '5945.476')] [2023-12-26 13:11:28,894][123090] Updated weights for policy 1, policy_version 1691428 (0.0008) [2023-12-26 13:11:28,957][123090] Updated weights for policy 1, policy_version 1691438 (0.0005) [2023-12-26 13:11:29,020][123090] Updated weights for policy 1, policy_version 1691448 (0.0005) [2023-12-26 13:11:29,194][123091] Updated weights for policy 0, policy_version 1702679 (0.0009) [2023-12-26 13:11:29,257][123091] Updated weights for policy 0, policy_version 1702689 (0.0009) [2023-12-26 13:11:29,326][123091] Updated weights for policy 0, policy_version 1702699 (0.0009) [2023-12-26 13:11:29,816][123090] Updated weights for policy 1, policy_version 1691458 (0.0010) [2023-12-26 13:11:29,881][123090] Updated weights for policy 1, policy_version 1691468 (0.0011) [2023-12-26 13:11:29,949][123090] Updated weights for policy 1, policy_version 1691478 (0.0011) [2023-12-26 13:11:30,016][123090] Updated weights for policy 1, policy_version 1691488 (0.0011) [2023-12-26 13:11:30,155][123091] Updated weights for policy 0, policy_version 1702709 (0.0007) [2023-12-26 13:11:30,204][123091] Updated weights for policy 0, policy_version 1702719 (0.0005) [2023-12-26 13:11:30,253][123091] Updated weights for policy 0, policy_version 1702729 (0.0006) [2023-12-26 13:11:30,832][123090] Updated weights for policy 1, policy_version 1691498 (0.0005) [2023-12-26 13:11:30,881][123090] Updated weights for policy 1, policy_version 1691508 (0.0005) [2023-12-26 13:11:30,935][123091] Updated weights for policy 0, policy_version 1702739 (0.0006) [2023-12-26 13:11:30,941][123090] Updated weights for policy 1, policy_version 1691518 (0.0005) [2023-12-26 13:11:31,003][123091] Updated weights for policy 0, policy_version 1702749 (0.0006) [2023-12-26 13:11:31,070][123091] Updated weights for policy 0, policy_version 1702759 (0.0009) [2023-12-26 13:11:31,655][123090] Updated weights for policy 1, policy_version 1691528 (0.0008) [2023-12-26 13:11:31,725][123090] Updated weights for policy 1, policy_version 1691538 (0.0009) [2023-12-26 13:11:31,794][123090] Updated weights for policy 1, policy_version 1691548 (0.0009) [2023-12-26 13:11:31,837][123091] Updated weights for policy 0, policy_version 1702769 (0.0011) [2023-12-26 13:11:31,903][123091] Updated weights for policy 0, policy_version 1702779 (0.0010) [2023-12-26 13:11:31,955][123091] Updated weights for policy 0, policy_version 1702789 (0.0010) [2023-12-26 13:11:32,002][123091] Updated weights for policy 0, policy_version 1702799 (0.0010) [2023-12-26 13:11:32,532][123090] Updated weights for policy 1, policy_version 1691558 (0.0009) [2023-12-26 13:11:32,588][123090] Updated weights for policy 1, policy_version 1691568 (0.0009) [2023-12-26 13:11:32,650][123090] Updated weights for policy 1, policy_version 1691578 (0.0009) [2023-12-26 13:11:32,810][123091] Updated weights for policy 0, policy_version 1702809 (0.0006) [2023-12-26 13:11:32,868][123091] Updated weights for policy 0, policy_version 1702819 (0.0006) [2023-12-26 13:11:32,926][123091] Updated weights for policy 0, policy_version 1702829 (0.0005) [2023-12-26 13:11:33,368][123090] Updated weights for policy 1, policy_version 1691588 (0.0007) [2023-12-26 13:11:33,436][123090] Updated weights for policy 1, policy_version 1691598 (0.0005) [2023-12-26 13:11:33,507][123090] Updated weights for policy 1, policy_version 1691608 (0.0008) [2023-12-26 13:11:33,643][123091] Updated weights for policy 0, policy_version 1702839 (0.0009) [2023-12-26 13:11:33,701][123091] Updated weights for policy 0, policy_version 1702849 (0.0010) [2023-12-26 13:11:33,762][123091] Updated weights for policy 0, policy_version 1702859 (0.0010) [2023-12-26 13:11:33,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 868990976. Throughput: 0: 9049.3, 1: 8835.1. Samples: 868997672. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:33,784][121949] Avg episode reward: [(0, '6109.146'), (1, '5824.174')] [2023-12-26 13:11:34,210][123090] Updated weights for policy 1, policy_version 1691618 (0.0009) [2023-12-26 13:11:34,263][123090] Updated weights for policy 1, policy_version 1691628 (0.0009) [2023-12-26 13:11:34,321][123090] Updated weights for policy 1, policy_version 1691638 (0.0008) [2023-12-26 13:11:34,376][123090] Updated weights for policy 1, policy_version 1691648 (0.0007) [2023-12-26 13:11:34,523][123091] Updated weights for policy 0, policy_version 1702869 (0.0011) [2023-12-26 13:11:34,602][123091] Updated weights for policy 0, policy_version 1702879 (0.0011) [2023-12-26 13:11:34,674][123091] Updated weights for policy 0, policy_version 1702889 (0.0011) [2023-12-26 13:11:35,082][123090] Updated weights for policy 1, policy_version 1691658 (0.0005) [2023-12-26 13:11:35,136][123090] Updated weights for policy 1, policy_version 1691668 (0.0005) [2023-12-26 13:11:35,192][123090] Updated weights for policy 1, policy_version 1691678 (0.0005) [2023-12-26 13:11:35,475][123091] Updated weights for policy 0, policy_version 1702899 (0.0011) [2023-12-26 13:11:35,540][123091] Updated weights for policy 0, policy_version 1702909 (0.0010) [2023-12-26 13:11:35,602][123091] Updated weights for policy 0, policy_version 1702919 (0.0011) [2023-12-26 13:11:35,983][123090] Updated weights for policy 1, policy_version 1691688 (0.0005) [2023-12-26 13:11:36,039][123090] Updated weights for policy 1, policy_version 1691698 (0.0008) [2023-12-26 13:11:36,093][123090] Updated weights for policy 1, policy_version 1691708 (0.0008) [2023-12-26 13:11:36,373][123091] Updated weights for policy 0, policy_version 1702929 (0.0010) [2023-12-26 13:11:36,449][123091] Updated weights for policy 0, policy_version 1702939 (0.0010) [2023-12-26 13:11:36,516][123091] Updated weights for policy 0, policy_version 1702949 (0.0011) [2023-12-26 13:11:36,596][123091] Updated weights for policy 0, policy_version 1702959 (0.0011) [2023-12-26 13:11:36,814][123090] Updated weights for policy 1, policy_version 1691718 (0.0007) [2023-12-26 13:11:36,883][123090] Updated weights for policy 1, policy_version 1691728 (0.0009) [2023-12-26 13:11:36,946][123090] Updated weights for policy 1, policy_version 1691738 (0.0010) [2023-12-26 13:11:37,300][123091] Updated weights for policy 0, policy_version 1702969 (0.0006) [2023-12-26 13:11:37,348][123091] Updated weights for policy 0, policy_version 1702979 (0.0006) [2023-12-26 13:11:37,404][123091] Updated weights for policy 0, policy_version 1702989 (0.0005) [2023-12-26 13:11:37,740][123090] Updated weights for policy 1, policy_version 1691748 (0.0010) [2023-12-26 13:11:37,801][123090] Updated weights for policy 1, policy_version 1691758 (0.0010) [2023-12-26 13:11:37,874][123090] Updated weights for policy 1, policy_version 1691768 (0.0011) [2023-12-26 13:11:38,013][123091] Updated weights for policy 0, policy_version 1702999 (0.0005) [2023-12-26 13:11:38,089][123091] Updated weights for policy 0, policy_version 1703009 (0.0006) [2023-12-26 13:11:38,146][123091] Updated weights for policy 0, policy_version 1703019 (0.0010) [2023-12-26 13:11:38,574][123090] Updated weights for policy 1, policy_version 1691778 (0.0008) [2023-12-26 13:11:38,653][123090] Updated weights for policy 1, policy_version 1691788 (0.0006) [2023-12-26 13:11:38,730][123090] Updated weights for policy 1, policy_version 1691798 (0.0006) [2023-12-26 13:11:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 869072896. Throughput: 0: 9052.2, 1: 8871.4. Samples: 869052060. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:38,785][121949] Avg episode reward: [(0, '5972.452'), (1, '5758.124')] [2023-12-26 13:11:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001703024_435978240.pth... [2023-12-26 13:11:38,792][123090] Updated weights for policy 1, policy_version 1691808 (0.0007) [2023-12-26 13:11:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001691808_433102848.pth... [2023-12-26 13:11:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001701968_435707904.pth [2023-12-26 13:11:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001690752_432832512.pth [2023-12-26 13:11:38,903][123091] Updated weights for policy 0, policy_version 1703029 (0.0011) [2023-12-26 13:11:38,951][123091] Updated weights for policy 0, policy_version 1703039 (0.0010) [2023-12-26 13:11:39,018][123091] Updated weights for policy 0, policy_version 1703049 (0.0011) [2023-12-26 13:11:39,539][123090] Updated weights for policy 1, policy_version 1691818 (0.0008) [2023-12-26 13:11:39,606][123090] Updated weights for policy 1, policy_version 1691828 (0.0006) [2023-12-26 13:11:39,672][123090] Updated weights for policy 1, policy_version 1691838 (0.0005) [2023-12-26 13:11:39,815][123091] Updated weights for policy 0, policy_version 1703059 (0.0009) [2023-12-26 13:11:39,886][123091] Updated weights for policy 0, policy_version 1703069 (0.0008) [2023-12-26 13:11:39,961][123091] Updated weights for policy 0, policy_version 1703079 (0.0011) [2023-12-26 13:11:40,477][123090] Updated weights for policy 1, policy_version 1691848 (0.0008) [2023-12-26 13:11:40,533][123090] Updated weights for policy 1, policy_version 1691858 (0.0009) [2023-12-26 13:11:40,607][123090] Updated weights for policy 1, policy_version 1691868 (0.0010) [2023-12-26 13:11:40,681][123091] Updated weights for policy 0, policy_version 1703089 (0.0010) [2023-12-26 13:11:40,755][123091] Updated weights for policy 0, policy_version 1703099 (0.0005) [2023-12-26 13:11:40,825][123091] Updated weights for policy 0, policy_version 1703109 (0.0007) [2023-12-26 13:11:40,896][123091] Updated weights for policy 0, policy_version 1703119 (0.0009) [2023-12-26 13:11:41,468][123090] Updated weights for policy 1, policy_version 1691878 (0.0010) [2023-12-26 13:11:41,540][123090] Updated weights for policy 1, policy_version 1691888 (0.0010) [2023-12-26 13:11:41,616][123090] Updated weights for policy 1, policy_version 1691898 (0.0010) [2023-12-26 13:11:41,660][123091] Updated weights for policy 0, policy_version 1703129 (0.0008) [2023-12-26 13:11:41,718][123091] Updated weights for policy 0, policy_version 1703139 (0.0010) [2023-12-26 13:11:41,789][123091] Updated weights for policy 0, policy_version 1703149 (0.0010) [2023-12-26 13:11:42,469][123090] Updated weights for policy 1, policy_version 1691908 (0.0009) [2023-12-26 13:11:42,533][123090] Updated weights for policy 1, policy_version 1691918 (0.0010) [2023-12-26 13:11:42,596][123090] Updated weights for policy 1, policy_version 1691928 (0.0008) [2023-12-26 13:11:42,599][123091] Updated weights for policy 0, policy_version 1703159 (0.0010) [2023-12-26 13:11:42,651][123091] Updated weights for policy 0, policy_version 1703169 (0.0009) [2023-12-26 13:11:42,705][123091] Updated weights for policy 0, policy_version 1703179 (0.0009) [2023-12-26 13:11:43,437][123090] Updated weights for policy 1, policy_version 1691938 (0.0008) [2023-12-26 13:11:43,489][123091] Updated weights for policy 0, policy_version 1703189 (0.0007) [2023-12-26 13:11:43,508][123090] Updated weights for policy 1, policy_version 1691948 (0.0008) [2023-12-26 13:11:43,547][123091] Updated weights for policy 0, policy_version 1703199 (0.0007) [2023-12-26 13:11:43,578][123090] Updated weights for policy 1, policy_version 1691958 (0.0006) [2023-12-26 13:11:43,607][123091] Updated weights for policy 0, policy_version 1703209 (0.0007) [2023-12-26 13:11:43,650][123090] Updated weights for policy 1, policy_version 1691968 (0.0006) [2023-12-26 13:11:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 869171200. Throughput: 0: 9033.9, 1: 8821.7. Samples: 869158376. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:43,784][121949] Avg episode reward: [(0, '6036.411'), (1, '5971.612')] [2023-12-26 13:11:44,256][123091] Updated weights for policy 0, policy_version 1703219 (0.0006) [2023-12-26 13:11:44,303][123090] Updated weights for policy 1, policy_version 1691978 (0.0008) [2023-12-26 13:11:44,322][123091] Updated weights for policy 0, policy_version 1703229 (0.0005) [2023-12-26 13:11:44,368][123090] Updated weights for policy 1, policy_version 1691988 (0.0005) [2023-12-26 13:11:44,392][123091] Updated weights for policy 0, policy_version 1703239 (0.0006) [2023-12-26 13:11:44,431][123090] Updated weights for policy 1, policy_version 1691998 (0.0006) [2023-12-26 13:11:45,090][123091] Updated weights for policy 0, policy_version 1703249 (0.0006) [2023-12-26 13:11:45,150][123091] Updated weights for policy 0, policy_version 1703259 (0.0011) [2023-12-26 13:11:45,181][123090] Updated weights for policy 1, policy_version 1692008 (0.0010) [2023-12-26 13:11:45,215][123091] Updated weights for policy 0, policy_version 1703269 (0.0011) [2023-12-26 13:11:45,246][123090] Updated weights for policy 1, policy_version 1692018 (0.0011) [2023-12-26 13:11:45,283][123091] Updated weights for policy 0, policy_version 1703279 (0.0011) [2023-12-26 13:11:45,307][123090] Updated weights for policy 1, policy_version 1692028 (0.0011) [2023-12-26 13:11:46,086][123091] Updated weights for policy 0, policy_version 1703289 (0.0010) [2023-12-26 13:11:46,135][123090] Updated weights for policy 1, policy_version 1692038 (0.0008) [2023-12-26 13:11:46,142][123091] Updated weights for policy 0, policy_version 1703299 (0.0011) [2023-12-26 13:11:46,192][123090] Updated weights for policy 1, policy_version 1692048 (0.0008) [2023-12-26 13:11:46,194][123091] Updated weights for policy 0, policy_version 1703309 (0.0011) [2023-12-26 13:11:46,266][123090] Updated weights for policy 1, policy_version 1692058 (0.0010) [2023-12-26 13:11:47,002][123091] Updated weights for policy 0, policy_version 1703319 (0.0008) [2023-12-26 13:11:47,013][123090] Updated weights for policy 1, policy_version 1692068 (0.0009) [2023-12-26 13:11:47,070][123091] Updated weights for policy 0, policy_version 1703329 (0.0008) [2023-12-26 13:11:47,082][123090] Updated weights for policy 1, policy_version 1692078 (0.0006) [2023-12-26 13:11:47,134][123091] Updated weights for policy 0, policy_version 1703339 (0.0007) [2023-12-26 13:11:47,149][123090] Updated weights for policy 1, policy_version 1692088 (0.0009) [2023-12-26 13:11:47,911][123091] Updated weights for policy 0, policy_version 1703349 (0.0006) [2023-12-26 13:11:47,967][123090] Updated weights for policy 1, policy_version 1692098 (0.0009) [2023-12-26 13:11:47,977][123091] Updated weights for policy 0, policy_version 1703359 (0.0006) [2023-12-26 13:11:48,029][123090] Updated weights for policy 1, policy_version 1692108 (0.0006) [2023-12-26 13:11:48,046][123091] Updated weights for policy 0, policy_version 1703369 (0.0006) [2023-12-26 13:11:48,101][123090] Updated weights for policy 1, policy_version 1692118 (0.0005) [2023-12-26 13:11:48,179][123090] Updated weights for policy 1, policy_version 1692128 (0.0006) [2023-12-26 13:11:48,735][123091] Updated weights for policy 0, policy_version 1703379 (0.0007) [2023-12-26 13:11:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 869253120. Throughput: 0: 9123.7, 1: 8897.4. Samples: 869269824. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:48,785][121949] Avg episode reward: [(0, '6067.081'), (1, '6023.371')] [2023-12-26 13:11:48,806][123091] Updated weights for policy 0, policy_version 1703389 (0.0009) [2023-12-26 13:11:48,878][123091] Updated weights for policy 0, policy_version 1703399 (0.0010) [2023-12-26 13:11:48,940][123090] Updated weights for policy 1, policy_version 1692138 (0.0005) [2023-12-26 13:11:48,997][123090] Updated weights for policy 1, policy_version 1692148 (0.0006) [2023-12-26 13:11:49,057][123090] Updated weights for policy 1, policy_version 1692158 (0.0008) [2023-12-26 13:11:49,690][123091] Updated weights for policy 0, policy_version 1703409 (0.0010) [2023-12-26 13:11:49,752][123091] Updated weights for policy 0, policy_version 1703419 (0.0010) [2023-12-26 13:11:49,815][123091] Updated weights for policy 0, policy_version 1703429 (0.0010) [2023-12-26 13:11:49,831][123090] Updated weights for policy 1, policy_version 1692168 (0.0008) [2023-12-26 13:11:49,884][123091] Updated weights for policy 0, policy_version 1703439 (0.0010) [2023-12-26 13:11:49,898][123090] Updated weights for policy 1, policy_version 1692178 (0.0007) [2023-12-26 13:11:49,968][123090] Updated weights for policy 1, policy_version 1692188 (0.0009) [2023-12-26 13:11:50,703][123091] Updated weights for policy 0, policy_version 1703449 (0.0011) [2023-12-26 13:11:50,767][123091] Updated weights for policy 0, policy_version 1703459 (0.0011) [2023-12-26 13:11:50,805][123090] Updated weights for policy 1, policy_version 1692198 (0.0007) [2023-12-26 13:11:50,833][123091] Updated weights for policy 0, policy_version 1703469 (0.0010) [2023-12-26 13:11:50,859][123090] Updated weights for policy 1, policy_version 1692208 (0.0007) [2023-12-26 13:11:50,917][123090] Updated weights for policy 1, policy_version 1692218 (0.0009) [2023-12-26 13:11:51,688][123091] Updated weights for policy 0, policy_version 1703479 (0.0010) [2023-12-26 13:11:51,764][123091] Updated weights for policy 0, policy_version 1703489 (0.0010) [2023-12-26 13:11:51,819][123090] Updated weights for policy 1, policy_version 1692228 (0.0009) [2023-12-26 13:11:51,832][123091] Updated weights for policy 0, policy_version 1703499 (0.0011) [2023-12-26 13:11:51,878][123090] Updated weights for policy 1, policy_version 1692238 (0.0008) [2023-12-26 13:11:51,950][123090] Updated weights for policy 1, policy_version 1692248 (0.0008) [2023-12-26 13:11:52,600][123091] Updated weights for policy 0, policy_version 1703509 (0.0010) [2023-12-26 13:11:52,665][123091] Updated weights for policy 0, policy_version 1703519 (0.0009) [2023-12-26 13:11:52,724][123091] Updated weights for policy 0, policy_version 1703529 (0.0009) [2023-12-26 13:11:52,797][123090] Updated weights for policy 1, policy_version 1692258 (0.0008) [2023-12-26 13:11:52,861][123090] Updated weights for policy 1, policy_version 1692268 (0.0010) [2023-12-26 13:11:52,935][123090] Updated weights for policy 1, policy_version 1692278 (0.0011) [2023-12-26 13:11:52,998][123090] Updated weights for policy 1, policy_version 1692288 (0.0010) [2023-12-26 13:11:53,429][123091] Updated weights for policy 0, policy_version 1703539 (0.0009) [2023-12-26 13:11:53,496][123091] Updated weights for policy 0, policy_version 1703549 (0.0006) [2023-12-26 13:11:53,549][123091] Updated weights for policy 0, policy_version 1703559 (0.0009) [2023-12-26 13:11:53,727][123090] Updated weights for policy 1, policy_version 1692298 (0.0010) [2023-12-26 13:11:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 869343232. Throughput: 0: 9066.8, 1: 8876.6. Samples: 869321404. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:53,785][121949] Avg episode reward: [(0, '6141.751'), (1, '6019.942')] [2023-12-26 13:11:53,785][123090] Updated weights for policy 1, policy_version 1692308 (0.0010) [2023-12-26 13:11:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001703568_436117504.pth... [2023-12-26 13:11:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001702480_435838976.pth [2023-12-26 13:11:53,833][123090] Updated weights for policy 1, policy_version 1692318 (0.0010) [2023-12-26 13:11:53,843][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001692320_433233920.pth... [2023-12-26 13:11:53,848][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001691264_432963584.pth [2023-12-26 13:11:54,267][123091] Updated weights for policy 0, policy_version 1703569 (0.0008) [2023-12-26 13:11:54,329][123091] Updated weights for policy 0, policy_version 1703579 (0.0005) [2023-12-26 13:11:54,389][123091] Updated weights for policy 0, policy_version 1703589 (0.0006) [2023-12-26 13:11:54,448][123091] Updated weights for policy 0, policy_version 1703600 (0.0007) [2023-12-26 13:11:54,630][123090] Updated weights for policy 1, policy_version 1692328 (0.0010) [2023-12-26 13:11:54,692][123090] Updated weights for policy 1, policy_version 1692338 (0.0009) [2023-12-26 13:11:54,754][123090] Updated weights for policy 1, policy_version 1692348 (0.0005) [2023-12-26 13:11:55,109][123091] Updated weights for policy 0, policy_version 1703610 (0.0008) [2023-12-26 13:11:55,162][123091] Updated weights for policy 0, policy_version 1703620 (0.0010) [2023-12-26 13:11:55,229][123091] Updated weights for policy 0, policy_version 1703630 (0.0009) [2023-12-26 13:11:55,523][123090] Updated weights for policy 1, policy_version 1692358 (0.0006) [2023-12-26 13:11:55,583][123090] Updated weights for policy 1, policy_version 1692368 (0.0008) [2023-12-26 13:11:55,636][123090] Updated weights for policy 1, policy_version 1692378 (0.0006) [2023-12-26 13:11:55,989][123091] Updated weights for policy 0, policy_version 1703640 (0.0006) [2023-12-26 13:11:56,041][123091] Updated weights for policy 0, policy_version 1703650 (0.0005) [2023-12-26 13:11:56,092][123091] Updated weights for policy 0, policy_version 1703660 (0.0005) [2023-12-26 13:11:56,304][123090] Updated weights for policy 1, policy_version 1692388 (0.0005) [2023-12-26 13:11:56,370][123090] Updated weights for policy 1, policy_version 1692398 (0.0006) [2023-12-26 13:11:56,444][123090] Updated weights for policy 1, policy_version 1692408 (0.0005) [2023-12-26 13:11:56,807][123091] Updated weights for policy 0, policy_version 1703670 (0.0006) [2023-12-26 13:11:56,859][123091] Updated weights for policy 0, policy_version 1703680 (0.0005) [2023-12-26 13:11:56,916][123091] Updated weights for policy 0, policy_version 1703690 (0.0005) [2023-12-26 13:11:57,087][123090] Updated weights for policy 1, policy_version 1692418 (0.0005) [2023-12-26 13:11:57,140][123090] Updated weights for policy 1, policy_version 1692428 (0.0005) [2023-12-26 13:11:57,192][123090] Updated weights for policy 1, policy_version 1692438 (0.0005) [2023-12-26 13:11:57,244][123090] Updated weights for policy 1, policy_version 1692448 (0.0005) [2023-12-26 13:11:57,452][123091] Updated weights for policy 0, policy_version 1703700 (0.0005) [2023-12-26 13:11:57,501][123091] Updated weights for policy 0, policy_version 1703710 (0.0005) [2023-12-26 13:11:57,552][123091] Updated weights for policy 0, policy_version 1703720 (0.0005) [2023-12-26 13:11:58,120][123090] Updated weights for policy 1, policy_version 1692458 (0.0010) [2023-12-26 13:11:58,181][123090] Updated weights for policy 1, policy_version 1692468 (0.0009) [2023-12-26 13:11:58,202][123091] Updated weights for policy 0, policy_version 1703730 (0.0006) [2023-12-26 13:11:58,244][123090] Updated weights for policy 1, policy_version 1692478 (0.0008) [2023-12-26 13:11:58,265][123091] Updated weights for policy 0, policy_version 1703740 (0.0007) [2023-12-26 13:11:58,330][123091] Updated weights for policy 0, policy_version 1703750 (0.0008) [2023-12-26 13:11:58,403][123091] Updated weights for policy 0, policy_version 1703760 (0.0008) [2023-12-26 13:11:58,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 869441536. Throughput: 0: 9206.7, 1: 8932.3. Samples: 869436044. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:11:58,785][121949] Avg episode reward: [(0, '6220.156'), (1, '5969.021')] [2023-12-26 13:11:59,120][123090] Updated weights for policy 1, policy_version 1692488 (0.0007) [2023-12-26 13:11:59,188][123090] Updated weights for policy 1, policy_version 1692498 (0.0007) [2023-12-26 13:11:59,263][123090] Updated weights for policy 1, policy_version 1692508 (0.0008) [2023-12-26 13:11:59,270][123091] Updated weights for policy 0, policy_version 1703770 (0.0008) [2023-12-26 13:11:59,332][123091] Updated weights for policy 0, policy_version 1703780 (0.0008) [2023-12-26 13:11:59,410][123091] Updated weights for policy 0, policy_version 1703790 (0.0008) [2023-12-26 13:11:59,995][123090] Updated weights for policy 1, policy_version 1692518 (0.0006) [2023-12-26 13:12:00,063][123090] Updated weights for policy 1, policy_version 1692528 (0.0009) [2023-12-26 13:12:00,124][123090] Updated weights for policy 1, policy_version 1692538 (0.0009) [2023-12-26 13:12:00,184][123091] Updated weights for policy 0, policy_version 1703800 (0.0007) [2023-12-26 13:12:00,255][123091] Updated weights for policy 0, policy_version 1703810 (0.0006) [2023-12-26 13:12:00,314][123091] Updated weights for policy 0, policy_version 1703821 (0.0009) [2023-12-26 13:12:00,951][123090] Updated weights for policy 1, policy_version 1692548 (0.0007) [2023-12-26 13:12:00,999][123090] Updated weights for policy 1, policy_version 1692558 (0.0005) [2023-12-26 13:12:01,059][123090] Updated weights for policy 1, policy_version 1692568 (0.0007) [2023-12-26 13:12:01,101][123091] Updated weights for policy 0, policy_version 1703831 (0.0008) [2023-12-26 13:12:01,165][123091] Updated weights for policy 0, policy_version 1703841 (0.0010) [2023-12-26 13:12:01,216][123091] Updated weights for policy 0, policy_version 1703851 (0.0009) [2023-12-26 13:12:01,816][123090] Updated weights for policy 1, policy_version 1692578 (0.0007) [2023-12-26 13:12:01,886][123090] Updated weights for policy 1, policy_version 1692588 (0.0005) [2023-12-26 13:12:01,946][123090] Updated weights for policy 1, policy_version 1692598 (0.0005) [2023-12-26 13:12:02,010][123090] Updated weights for policy 1, policy_version 1692608 (0.0008) [2023-12-26 13:12:02,030][123091] Updated weights for policy 0, policy_version 1703861 (0.0009) [2023-12-26 13:12:02,082][123091] Updated weights for policy 0, policy_version 1703871 (0.0010) [2023-12-26 13:12:02,132][123091] Updated weights for policy 0, policy_version 1703881 (0.0010) [2023-12-26 13:12:02,837][123090] Updated weights for policy 1, policy_version 1692618 (0.0005) [2023-12-26 13:12:02,900][123090] Updated weights for policy 1, policy_version 1692628 (0.0005) [2023-12-26 13:12:02,962][123090] Updated weights for policy 1, policy_version 1692638 (0.0008) [2023-12-26 13:12:02,990][123091] Updated weights for policy 0, policy_version 1703891 (0.0009) [2023-12-26 13:12:03,042][123091] Updated weights for policy 0, policy_version 1703901 (0.0011) [2023-12-26 13:12:03,089][123091] Updated weights for policy 0, policy_version 1703911 (0.0008) [2023-12-26 13:12:03,740][123091] Updated weights for policy 0, policy_version 1703921 (0.0005) [2023-12-26 13:12:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 869523456. Throughput: 0: 9211.9, 1: 8898.0. Samples: 869541904. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:12:03,784][121949] Avg episode reward: [(0, '6323.154'), (1, '5732.018')] [2023-12-26 13:12:03,794][123091] Updated weights for policy 0, policy_version 1703931 (0.0005) [2023-12-26 13:12:03,822][123090] Updated weights for policy 1, policy_version 1692648 (0.0005) [2023-12-26 13:12:03,867][123091] Updated weights for policy 0, policy_version 1703941 (0.0007) [2023-12-26 13:12:03,891][123090] Updated weights for policy 1, policy_version 1692658 (0.0006) [2023-12-26 13:12:03,941][123091] Updated weights for policy 0, policy_version 1703951 (0.0006) [2023-12-26 13:12:03,966][123090] Updated weights for policy 1, policy_version 1692668 (0.0006) [2023-12-26 13:12:04,598][123091] Updated weights for policy 0, policy_version 1703961 (0.0007) [2023-12-26 13:12:04,653][123091] Updated weights for policy 0, policy_version 1703971 (0.0010) [2023-12-26 13:12:04,712][123091] Updated weights for policy 0, policy_version 1703981 (0.0011) [2023-12-26 13:12:04,721][123090] Updated weights for policy 1, policy_version 1692678 (0.0006) [2023-12-26 13:12:04,783][123090] Updated weights for policy 1, policy_version 1692688 (0.0006) [2023-12-26 13:12:04,842][123090] Updated weights for policy 1, policy_version 1692698 (0.0006) [2023-12-26 13:12:05,496][123091] Updated weights for policy 0, policy_version 1703991 (0.0011) [2023-12-26 13:12:05,554][123091] Updated weights for policy 0, policy_version 1704001 (0.0010) [2023-12-26 13:12:05,612][123091] Updated weights for policy 0, policy_version 1704011 (0.0010) [2023-12-26 13:12:05,628][123090] Updated weights for policy 1, policy_version 1692708 (0.0006) [2023-12-26 13:12:05,697][123090] Updated weights for policy 1, policy_version 1692718 (0.0005) [2023-12-26 13:12:05,751][123090] Updated weights for policy 1, policy_version 1692728 (0.0005) [2023-12-26 13:12:06,428][123091] Updated weights for policy 0, policy_version 1704021 (0.0011) [2023-12-26 13:12:06,455][123090] Updated weights for policy 1, policy_version 1692738 (0.0006) [2023-12-26 13:12:06,495][123091] Updated weights for policy 0, policy_version 1704031 (0.0011) [2023-12-26 13:12:06,515][123090] Updated weights for policy 1, policy_version 1692748 (0.0007) [2023-12-26 13:12:06,555][123091] Updated weights for policy 0, policy_version 1704041 (0.0011) [2023-12-26 13:12:06,580][123090] Updated weights for policy 1, policy_version 1692758 (0.0006) [2023-12-26 13:12:06,644][123090] Updated weights for policy 1, policy_version 1692768 (0.0009) [2023-12-26 13:12:07,365][123091] Updated weights for policy 0, policy_version 1704051 (0.0010) [2023-12-26 13:12:07,413][123091] Updated weights for policy 0, policy_version 1704061 (0.0006) [2023-12-26 13:12:07,473][123091] Updated weights for policy 0, policy_version 1704071 (0.0008) [2023-12-26 13:12:07,492][123090] Updated weights for policy 1, policy_version 1692778 (0.0008) [2023-12-26 13:12:07,554][123090] Updated weights for policy 1, policy_version 1692788 (0.0009) [2023-12-26 13:12:07,622][123090] Updated weights for policy 1, policy_version 1692798 (0.0009) [2023-12-26 13:12:08,105][123091] Updated weights for policy 0, policy_version 1704081 (0.0008) [2023-12-26 13:12:08,162][123091] Updated weights for policy 0, policy_version 1704091 (0.0006) [2023-12-26 13:12:08,215][123091] Updated weights for policy 0, policy_version 1704101 (0.0005) [2023-12-26 13:12:08,261][123091] Updated weights for policy 0, policy_version 1704111 (0.0005) [2023-12-26 13:12:08,439][123090] Updated weights for policy 1, policy_version 1692808 (0.0009) [2023-12-26 13:12:08,508][123090] Updated weights for policy 1, policy_version 1692818 (0.0008) [2023-12-26 13:12:08,578][123090] Updated weights for policy 1, policy_version 1692828 (0.0010) [2023-12-26 13:12:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 869621760. Throughput: 0: 9275.0, 1: 8892.1. Samples: 869596320. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:12:08,785][121949] Avg episode reward: [(0, '6203.510'), (1, '5690.107')] [2023-12-26 13:12:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001692832_433364992.pth... [2023-12-26 13:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001704112_436256768.pth... [2023-12-26 13:12:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001691808_433102848.pth [2023-12-26 13:12:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001703024_435978240.pth [2023-12-26 13:12:08,961][123091] Updated weights for policy 0, policy_version 1704121 (0.0009) [2023-12-26 13:12:09,022][123091] Updated weights for policy 0, policy_version 1704131 (0.0008) [2023-12-26 13:12:09,083][123091] Updated weights for policy 0, policy_version 1704141 (0.0010) [2023-12-26 13:12:09,445][123090] Updated weights for policy 1, policy_version 1692838 (0.0010) [2023-12-26 13:12:09,509][123090] Updated weights for policy 1, policy_version 1692848 (0.0010) [2023-12-26 13:12:09,579][123090] Updated weights for policy 1, policy_version 1692858 (0.0010) [2023-12-26 13:12:09,884][123091] Updated weights for policy 0, policy_version 1704151 (0.0010) [2023-12-26 13:12:09,959][123091] Updated weights for policy 0, policy_version 1704161 (0.0010) [2023-12-26 13:12:10,016][123091] Updated weights for policy 0, policy_version 1704171 (0.0009) [2023-12-26 13:12:10,492][123090] Updated weights for policy 1, policy_version 1692868 (0.0010) [2023-12-26 13:12:10,543][123090] Updated weights for policy 1, policy_version 1692878 (0.0010) [2023-12-26 13:12:10,602][123090] Updated weights for policy 1, policy_version 1692888 (0.0009) [2023-12-26 13:12:10,776][123091] Updated weights for policy 0, policy_version 1704181 (0.0007) [2023-12-26 13:12:10,823][123091] Updated weights for policy 0, policy_version 1704191 (0.0005) [2023-12-26 13:12:10,876][123091] Updated weights for policy 0, policy_version 1704201 (0.0005) [2023-12-26 13:12:11,545][123090] Updated weights for policy 1, policy_version 1692898 (0.0010) [2023-12-26 13:12:11,616][123090] Updated weights for policy 1, policy_version 1692908 (0.0008) [2023-12-26 13:12:11,631][123091] Updated weights for policy 0, policy_version 1704211 (0.0007) [2023-12-26 13:12:11,682][123090] Updated weights for policy 1, policy_version 1692918 (0.0008) [2023-12-26 13:12:11,698][123091] Updated weights for policy 0, policy_version 1704221 (0.0009) [2023-12-26 13:12:11,750][123090] Updated weights for policy 1, policy_version 1692928 (0.0009) [2023-12-26 13:12:11,770][123091] Updated weights for policy 0, policy_version 1704231 (0.0010) [2023-12-26 13:12:12,601][123091] Updated weights for policy 0, policy_version 1704241 (0.0009) [2023-12-26 13:12:12,627][123090] Updated weights for policy 1, policy_version 1692938 (0.0009) [2023-12-26 13:12:12,653][123091] Updated weights for policy 0, policy_version 1704251 (0.0009) [2023-12-26 13:12:12,691][123090] Updated weights for policy 1, policy_version 1692948 (0.0009) [2023-12-26 13:12:12,705][123091] Updated weights for policy 0, policy_version 1704261 (0.0009) [2023-12-26 13:12:12,756][123090] Updated weights for policy 1, policy_version 1692958 (0.0008) [2023-12-26 13:12:12,771][123091] Updated weights for policy 0, policy_version 1704271 (0.0010) [2023-12-26 13:12:13,481][123091] Updated weights for policy 0, policy_version 1704281 (0.0006) [2023-12-26 13:12:13,531][123091] Updated weights for policy 0, policy_version 1704291 (0.0006) [2023-12-26 13:12:13,580][123090] Updated weights for policy 1, policy_version 1692968 (0.0008) [2023-12-26 13:12:13,583][123091] Updated weights for policy 0, policy_version 1704301 (0.0005) [2023-12-26 13:12:13,636][123090] Updated weights for policy 1, policy_version 1692978 (0.0010) [2023-12-26 13:12:13,703][123090] Updated weights for policy 1, policy_version 1692988 (0.0010) [2023-12-26 13:12:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17883.6). Total num frames: 869711872. Throughput: 0: 9255.9, 1: 8832.4. Samples: 869700964. Policy #0 lag: (min: 25.0, avg: 36.7, max: 57.0) [2023-12-26 13:12:13,784][121949] Avg episode reward: [(0, '6020.416'), (1, '5930.162')] [2023-12-26 13:12:14,300][123091] Updated weights for policy 0, policy_version 1704311 (0.0006) [2023-12-26 13:12:14,355][123091] Updated weights for policy 0, policy_version 1704321 (0.0006) [2023-12-26 13:12:14,417][123091] Updated weights for policy 0, policy_version 1704331 (0.0005) [2023-12-26 13:12:14,619][123090] Updated weights for policy 1, policy_version 1692998 (0.0010) [2023-12-26 13:12:14,679][123090] Updated weights for policy 1, policy_version 1693008 (0.0009) [2023-12-26 13:12:14,740][123090] Updated weights for policy 1, policy_version 1693018 (0.0010) [2023-12-26 13:12:15,168][123091] Updated weights for policy 0, policy_version 1704341 (0.0007) [2023-12-26 13:12:15,234][123091] Updated weights for policy 0, policy_version 1704351 (0.0009) [2023-12-26 13:12:15,292][123091] Updated weights for policy 0, policy_version 1704361 (0.0009) [2023-12-26 13:12:15,595][123090] Updated weights for policy 1, policy_version 1693028 (0.0009) [2023-12-26 13:12:15,655][123090] Updated weights for policy 1, policy_version 1693038 (0.0005) [2023-12-26 13:12:15,721][123090] Updated weights for policy 1, policy_version 1693048 (0.0005) [2023-12-26 13:12:16,190][123091] Updated weights for policy 0, policy_version 1704371 (0.0009) [2023-12-26 13:12:16,244][123091] Updated weights for policy 0, policy_version 1704381 (0.0010) [2023-12-26 13:12:16,304][123091] Updated weights for policy 0, policy_version 1704392 (0.0010) [2023-12-26 13:12:16,344][123090] Updated weights for policy 1, policy_version 1693058 (0.0006) [2023-12-26 13:12:16,403][123090] Updated weights for policy 1, policy_version 1693068 (0.0009) [2023-12-26 13:12:16,457][123090] Updated weights for policy 1, policy_version 1693078 (0.0009) [2023-12-26 13:12:16,522][123090] Updated weights for policy 1, policy_version 1693088 (0.0009) [2023-12-26 13:12:17,128][123091] Updated weights for policy 0, policy_version 1704403 (0.0009) [2023-12-26 13:12:17,195][123091] Updated weights for policy 0, policy_version 1704413 (0.0009) [2023-12-26 13:12:17,263][123091] Updated weights for policy 0, policy_version 1704423 (0.0010) [2023-12-26 13:12:17,390][123090] Updated weights for policy 1, policy_version 1693098 (0.0009) [2023-12-26 13:12:17,454][123090] Updated weights for policy 1, policy_version 1693108 (0.0009) [2023-12-26 13:12:17,521][123090] Updated weights for policy 1, policy_version 1693118 (0.0009) [2023-12-26 13:12:18,013][123091] Updated weights for policy 0, policy_version 1704433 (0.0009) [2023-12-26 13:12:18,064][123091] Updated weights for policy 0, policy_version 1704443 (0.0006) [2023-12-26 13:12:18,120][123091] Updated weights for policy 0, policy_version 1704453 (0.0007) [2023-12-26 13:12:18,180][123091] Updated weights for policy 0, policy_version 1704463 (0.0009) [2023-12-26 13:12:18,311][123090] Updated weights for policy 1, policy_version 1693128 (0.0007) [2023-12-26 13:12:18,383][123090] Updated weights for policy 1, policy_version 1693138 (0.0008) [2023-12-26 13:12:18,459][123090] Updated weights for policy 1, policy_version 1693148 (0.0005) [2023-12-26 13:12:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 869793792. Throughput: 0: 9213.7, 1: 8769.6. Samples: 869806920. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:18,785][121949] Avg episode reward: [(0, '6044.631'), (1, '5881.506')] [2023-12-26 13:12:19,014][123091] Updated weights for policy 0, policy_version 1704473 (0.0009) [2023-12-26 13:12:19,077][123091] Updated weights for policy 0, policy_version 1704483 (0.0009) [2023-12-26 13:12:19,135][123091] Updated weights for policy 0, policy_version 1704493 (0.0009) [2023-12-26 13:12:19,230][123090] Updated weights for policy 1, policy_version 1693158 (0.0008) [2023-12-26 13:12:19,291][123090] Updated weights for policy 1, policy_version 1693168 (0.0009) [2023-12-26 13:12:19,354][123090] Updated weights for policy 1, policy_version 1693178 (0.0009) [2023-12-26 13:12:20,031][123091] Updated weights for policy 0, policy_version 1704503 (0.0009) [2023-12-26 13:12:20,110][123091] Updated weights for policy 0, policy_version 1704513 (0.0010) [2023-12-26 13:12:20,149][123090] Updated weights for policy 1, policy_version 1693188 (0.0007) [2023-12-26 13:12:20,168][123091] Updated weights for policy 0, policy_version 1704523 (0.0010) [2023-12-26 13:12:20,214][123090] Updated weights for policy 1, policy_version 1693198 (0.0006) [2023-12-26 13:12:20,288][123090] Updated weights for policy 1, policy_version 1693208 (0.0009) [2023-12-26 13:12:20,960][123091] Updated weights for policy 0, policy_version 1704533 (0.0010) [2023-12-26 13:12:21,003][123090] Updated weights for policy 1, policy_version 1693218 (0.0009) [2023-12-26 13:12:21,025][123091] Updated weights for policy 0, policy_version 1704543 (0.0009) [2023-12-26 13:12:21,081][123090] Updated weights for policy 1, policy_version 1693228 (0.0008) [2023-12-26 13:12:21,099][123091] Updated weights for policy 0, policy_version 1704553 (0.0008) [2023-12-26 13:12:21,154][123090] Updated weights for policy 1, policy_version 1693238 (0.0008) [2023-12-26 13:12:21,224][123090] Updated weights for policy 1, policy_version 1693248 (0.0009) [2023-12-26 13:12:21,941][123091] Updated weights for policy 0, policy_version 1704563 (0.0009) [2023-12-26 13:12:22,014][123091] Updated weights for policy 0, policy_version 1704573 (0.0011) [2023-12-26 13:12:22,073][123090] Updated weights for policy 1, policy_version 1693258 (0.0008) [2023-12-26 13:12:22,079][123091] Updated weights for policy 0, policy_version 1704583 (0.0011) [2023-12-26 13:12:22,134][123090] Updated weights for policy 1, policy_version 1693268 (0.0006) [2023-12-26 13:12:22,203][123090] Updated weights for policy 1, policy_version 1693278 (0.0008) [2023-12-26 13:12:22,913][123091] Updated weights for policy 0, policy_version 1704593 (0.0011) [2023-12-26 13:12:22,983][123091] Updated weights for policy 0, policy_version 1704603 (0.0011) [2023-12-26 13:12:23,037][123090] Updated weights for policy 1, policy_version 1693288 (0.0008) [2023-12-26 13:12:23,039][123091] Updated weights for policy 0, policy_version 1704613 (0.0011) [2023-12-26 13:12:23,092][123091] Updated weights for policy 0, policy_version 1704623 (0.0011) [2023-12-26 13:12:23,102][123090] Updated weights for policy 1, policy_version 1693298 (0.0008) [2023-12-26 13:12:23,164][123090] Updated weights for policy 1, policy_version 1693308 (0.0009) [2023-12-26 13:12:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 869875712. Throughput: 0: 9187.7, 1: 8734.5. Samples: 869858564. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:23,785][121949] Avg episode reward: [(0, '6119.213'), (1, '5931.000')] [2023-12-26 13:12:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001704624_436387840.pth... [2023-12-26 13:12:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001693312_433487872.pth... [2023-12-26 13:12:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001703568_436117504.pth [2023-12-26 13:12:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001692320_433233920.pth [2023-12-26 13:12:23,926][123091] Updated weights for policy 0, policy_version 1704633 (0.0010) [2023-12-26 13:12:23,977][123091] Updated weights for policy 0, policy_version 1704643 (0.0010) [2023-12-26 13:12:24,001][123090] Updated weights for policy 1, policy_version 1693318 (0.0008) [2023-12-26 13:12:24,028][123091] Updated weights for policy 0, policy_version 1704653 (0.0010) [2023-12-26 13:12:24,061][123090] Updated weights for policy 1, policy_version 1693328 (0.0006) [2023-12-26 13:12:24,124][123090] Updated weights for policy 1, policy_version 1693338 (0.0008) [2023-12-26 13:12:24,854][123090] Updated weights for policy 1, policy_version 1693348 (0.0008) [2023-12-26 13:12:24,874][123091] Updated weights for policy 0, policy_version 1704663 (0.0011) [2023-12-26 13:12:24,912][123090] Updated weights for policy 1, policy_version 1693358 (0.0006) [2023-12-26 13:12:24,936][123091] Updated weights for policy 0, policy_version 1704673 (0.0011) [2023-12-26 13:12:24,974][123090] Updated weights for policy 1, policy_version 1693368 (0.0008) [2023-12-26 13:12:24,995][123091] Updated weights for policy 0, policy_version 1704683 (0.0010) [2023-12-26 13:12:25,608][123090] Updated weights for policy 1, policy_version 1693378 (0.0007) [2023-12-26 13:12:25,676][123090] Updated weights for policy 1, policy_version 1693388 (0.0006) [2023-12-26 13:12:25,742][123090] Updated weights for policy 1, policy_version 1693398 (0.0009) [2023-12-26 13:12:25,800][123090] Updated weights for policy 1, policy_version 1693408 (0.0009) [2023-12-26 13:12:25,825][123091] Updated weights for policy 0, policy_version 1704693 (0.0010) [2023-12-26 13:12:25,889][123091] Updated weights for policy 0, policy_version 1704703 (0.0010) [2023-12-26 13:12:25,952][123091] Updated weights for policy 0, policy_version 1704713 (0.0010) [2023-12-26 13:12:26,424][123090] Updated weights for policy 1, policy_version 1693418 (0.0005) [2023-12-26 13:12:26,472][123090] Updated weights for policy 1, policy_version 1693428 (0.0005) [2023-12-26 13:12:26,519][123090] Updated weights for policy 1, policy_version 1693438 (0.0005) [2023-12-26 13:12:26,884][123091] Updated weights for policy 0, policy_version 1704723 (0.0010) [2023-12-26 13:12:26,942][123091] Updated weights for policy 0, policy_version 1704733 (0.0009) [2023-12-26 13:12:27,002][123091] Updated weights for policy 0, policy_version 1704743 (0.0009) [2023-12-26 13:12:27,168][123090] Updated weights for policy 1, policy_version 1693448 (0.0009) [2023-12-26 13:12:27,230][123090] Updated weights for policy 1, policy_version 1693458 (0.0010) [2023-12-26 13:12:27,288][123090] Updated weights for policy 1, policy_version 1693468 (0.0010) [2023-12-26 13:12:27,724][123091] Updated weights for policy 0, policy_version 1704753 (0.0008) [2023-12-26 13:12:27,785][123091] Updated weights for policy 0, policy_version 1704763 (0.0008) [2023-12-26 13:12:27,833][123091] Updated weights for policy 0, policy_version 1704773 (0.0009) [2023-12-26 13:12:27,880][123091] Updated weights for policy 0, policy_version 1704783 (0.0009) [2023-12-26 13:12:28,046][123090] Updated weights for policy 1, policy_version 1693478 (0.0007) [2023-12-26 13:12:28,100][123090] Updated weights for policy 1, policy_version 1693488 (0.0005) [2023-12-26 13:12:28,150][123090] Updated weights for policy 1, policy_version 1693498 (0.0005) [2023-12-26 13:12:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 869965824. Throughput: 0: 9104.3, 1: 8805.1. Samples: 869964296. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:28,785][121949] Avg episode reward: [(0, '6040.393'), (1, '5942.152')] [2023-12-26 13:12:28,786][123091] Updated weights for policy 0, policy_version 1704793 (0.0010) [2023-12-26 13:12:28,823][123090] Updated weights for policy 1, policy_version 1693508 (0.0006) [2023-12-26 13:12:28,835][123091] Updated weights for policy 0, policy_version 1704803 (0.0008) [2023-12-26 13:12:28,883][123091] Updated weights for policy 0, policy_version 1704813 (0.0010) [2023-12-26 13:12:28,883][123090] Updated weights for policy 1, policy_version 1693518 (0.0010) [2023-12-26 13:12:28,941][123090] Updated weights for policy 1, policy_version 1693528 (0.0010) [2023-12-26 13:12:29,749][123090] Updated weights for policy 1, policy_version 1693538 (0.0010) [2023-12-26 13:12:29,769][123091] Updated weights for policy 0, policy_version 1704823 (0.0008) [2023-12-26 13:12:29,808][123090] Updated weights for policy 1, policy_version 1693548 (0.0009) [2023-12-26 13:12:29,841][123091] Updated weights for policy 0, policy_version 1704833 (0.0008) [2023-12-26 13:12:29,877][123090] Updated weights for policy 1, policy_version 1693558 (0.0009) [2023-12-26 13:12:29,897][123091] Updated weights for policy 0, policy_version 1704843 (0.0006) [2023-12-26 13:12:29,934][123090] Updated weights for policy 1, policy_version 1693568 (0.0008) [2023-12-26 13:12:30,732][123090] Updated weights for policy 1, policy_version 1693578 (0.0005) [2023-12-26 13:12:30,746][123091] Updated weights for policy 0, policy_version 1704853 (0.0009) [2023-12-26 13:12:30,787][123090] Updated weights for policy 1, policy_version 1693588 (0.0005) [2023-12-26 13:12:30,807][123091] Updated weights for policy 0, policy_version 1704863 (0.0009) [2023-12-26 13:12:30,848][123090] Updated weights for policy 1, policy_version 1693598 (0.0005) [2023-12-26 13:12:30,858][123091] Updated weights for policy 0, policy_version 1704873 (0.0009) [2023-12-26 13:12:31,640][123090] Updated weights for policy 1, policy_version 1693608 (0.0007) [2023-12-26 13:12:31,709][123090] Updated weights for policy 1, policy_version 1693618 (0.0006) [2023-12-26 13:12:31,732][123091] Updated weights for policy 0, policy_version 1704883 (0.0008) [2023-12-26 13:12:31,777][123090] Updated weights for policy 1, policy_version 1693628 (0.0008) [2023-12-26 13:12:31,799][123091] Updated weights for policy 0, policy_version 1704893 (0.0008) [2023-12-26 13:12:31,867][123091] Updated weights for policy 0, policy_version 1704903 (0.0008) [2023-12-26 13:12:32,548][123090] Updated weights for policy 1, policy_version 1693638 (0.0008) [2023-12-26 13:12:32,598][123090] Updated weights for policy 1, policy_version 1693648 (0.0005) [2023-12-26 13:12:32,601][123091] Updated weights for policy 0, policy_version 1704913 (0.0008) [2023-12-26 13:12:32,661][123090] Updated weights for policy 1, policy_version 1693658 (0.0007) [2023-12-26 13:12:32,662][123091] Updated weights for policy 0, policy_version 1704923 (0.0005) [2023-12-26 13:12:32,727][123091] Updated weights for policy 0, policy_version 1704933 (0.0005) [2023-12-26 13:12:32,796][123091] Updated weights for policy 0, policy_version 1704943 (0.0006) [2023-12-26 13:12:33,375][123090] Updated weights for policy 1, policy_version 1693668 (0.0009) [2023-12-26 13:12:33,415][123091] Updated weights for policy 0, policy_version 1704953 (0.0005) [2023-12-26 13:12:33,424][123090] Updated weights for policy 1, policy_version 1693678 (0.0009) [2023-12-26 13:12:33,461][123091] Updated weights for policy 0, policy_version 1704963 (0.0005) [2023-12-26 13:12:33,471][123090] Updated weights for policy 1, policy_version 1693688 (0.0008) [2023-12-26 13:12:33,512][123091] Updated weights for policy 0, policy_version 1704973 (0.0005) [2023-12-26 13:12:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 870064128. Throughput: 0: 9001.8, 1: 8844.4. Samples: 870072904. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:33,785][121949] Avg episode reward: [(0, '6237.031'), (1, '6020.630')] [2023-12-26 13:12:34,117][123091] Updated weights for policy 0, policy_version 1704983 (0.0005) [2023-12-26 13:12:34,185][123091] Updated weights for policy 0, policy_version 1704993 (0.0007) [2023-12-26 13:12:34,249][123091] Updated weights for policy 0, policy_version 1705003 (0.0006) [2023-12-26 13:12:34,358][123090] Updated weights for policy 1, policy_version 1693698 (0.0009) [2023-12-26 13:12:34,411][123090] Updated weights for policy 1, policy_version 1693708 (0.0010) [2023-12-26 13:12:34,469][123090] Updated weights for policy 1, policy_version 1693718 (0.0008) [2023-12-26 13:12:34,531][123090] Updated weights for policy 1, policy_version 1693728 (0.0005) [2023-12-26 13:12:35,015][123091] Updated weights for policy 0, policy_version 1705013 (0.0008) [2023-12-26 13:12:35,061][123091] Updated weights for policy 0, policy_version 1705023 (0.0005) [2023-12-26 13:12:35,112][123091] Updated weights for policy 0, policy_version 1705033 (0.0005) [2023-12-26 13:12:35,291][123090] Updated weights for policy 1, policy_version 1693738 (0.0005) [2023-12-26 13:12:35,357][123090] Updated weights for policy 1, policy_version 1693748 (0.0005) [2023-12-26 13:12:35,421][123090] Updated weights for policy 1, policy_version 1693758 (0.0005) [2023-12-26 13:12:35,847][123091] Updated weights for policy 0, policy_version 1705043 (0.0007) [2023-12-26 13:12:35,917][123091] Updated weights for policy 0, policy_version 1705053 (0.0011) [2023-12-26 13:12:35,985][123091] Updated weights for policy 0, policy_version 1705063 (0.0010) [2023-12-26 13:12:36,040][123090] Updated weights for policy 1, policy_version 1693768 (0.0008) [2023-12-26 13:12:36,092][123090] Updated weights for policy 1, policy_version 1693778 (0.0009) [2023-12-26 13:12:36,165][123090] Updated weights for policy 1, policy_version 1693788 (0.0009) [2023-12-26 13:12:36,779][123091] Updated weights for policy 0, policy_version 1705073 (0.0006) [2023-12-26 13:12:36,843][123091] Updated weights for policy 0, policy_version 1705083 (0.0011) [2023-12-26 13:12:36,915][123091] Updated weights for policy 0, policy_version 1705093 (0.0008) [2023-12-26 13:12:36,991][123091] Updated weights for policy 0, policy_version 1705103 (0.0007) [2023-12-26 13:12:37,042][123090] Updated weights for policy 1, policy_version 1693798 (0.0009) [2023-12-26 13:12:37,116][123090] Updated weights for policy 1, policy_version 1693808 (0.0009) [2023-12-26 13:12:37,183][123090] Updated weights for policy 1, policy_version 1693818 (0.0008) [2023-12-26 13:12:37,746][123091] Updated weights for policy 0, policy_version 1705113 (0.0008) [2023-12-26 13:12:37,800][123091] Updated weights for policy 0, policy_version 1705123 (0.0006) [2023-12-26 13:12:37,857][123091] Updated weights for policy 0, policy_version 1705133 (0.0007) [2023-12-26 13:12:37,863][123090] Updated weights for policy 1, policy_version 1693828 (0.0009) [2023-12-26 13:12:37,931][123090] Updated weights for policy 1, policy_version 1693838 (0.0008) [2023-12-26 13:12:37,996][123090] Updated weights for policy 1, policy_version 1693848 (0.0009) [2023-12-26 13:12:38,578][123091] Updated weights for policy 0, policy_version 1705143 (0.0006) [2023-12-26 13:12:38,627][123091] Updated weights for policy 0, policy_version 1705153 (0.0005) [2023-12-26 13:12:38,689][123091] Updated weights for policy 0, policy_version 1705163 (0.0005) [2023-12-26 13:12:38,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 870154240. Throughput: 0: 9078.9, 1: 8871.2. Samples: 870129160. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:38,785][121949] Avg episode reward: [(0, '6219.800'), (1, '5937.975')] [2023-12-26 13:12:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001693856_433627136.pth... [2023-12-26 13:12:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001705168_436527104.pth... [2023-12-26 13:12:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001692832_433364992.pth [2023-12-26 13:12:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001704112_436256768.pth [2023-12-26 13:12:38,880][123090] Updated weights for policy 1, policy_version 1693858 (0.0009) [2023-12-26 13:12:38,935][123090] Updated weights for policy 1, policy_version 1693868 (0.0009) [2023-12-26 13:12:38,998][123090] Updated weights for policy 1, policy_version 1693879 (0.0009) [2023-12-26 13:12:39,414][123091] Updated weights for policy 0, policy_version 1705173 (0.0007) [2023-12-26 13:12:39,485][123091] Updated weights for policy 0, policy_version 1705183 (0.0007) [2023-12-26 13:12:39,554][123091] Updated weights for policy 0, policy_version 1705193 (0.0006) [2023-12-26 13:12:39,843][123090] Updated weights for policy 1, policy_version 1693889 (0.0010) [2023-12-26 13:12:39,912][123090] Updated weights for policy 1, policy_version 1693899 (0.0006) [2023-12-26 13:12:39,988][123090] Updated weights for policy 1, policy_version 1693909 (0.0008) [2023-12-26 13:12:40,053][123090] Updated weights for policy 1, policy_version 1693919 (0.0009) [2023-12-26 13:12:40,268][123091] Updated weights for policy 0, policy_version 1705203 (0.0007) [2023-12-26 13:12:40,325][123091] Updated weights for policy 0, policy_version 1705213 (0.0011) [2023-12-26 13:12:40,387][123091] Updated weights for policy 0, policy_version 1705223 (0.0010) [2023-12-26 13:12:40,866][123090] Updated weights for policy 1, policy_version 1693929 (0.0007) [2023-12-26 13:12:40,931][123090] Updated weights for policy 1, policy_version 1693939 (0.0009) [2023-12-26 13:12:41,002][123090] Updated weights for policy 1, policy_version 1693949 (0.0010) [2023-12-26 13:12:41,197][123091] Updated weights for policy 0, policy_version 1705233 (0.0010) [2023-12-26 13:12:41,263][123091] Updated weights for policy 0, policy_version 1705243 (0.0008) [2023-12-26 13:12:41,323][123091] Updated weights for policy 0, policy_version 1705253 (0.0006) [2023-12-26 13:12:41,396][123091] Updated weights for policy 0, policy_version 1705263 (0.0010) [2023-12-26 13:12:41,868][123090] Updated weights for policy 1, policy_version 1693959 (0.0009) [2023-12-26 13:12:41,943][123090] Updated weights for policy 1, policy_version 1693969 (0.0007) [2023-12-26 13:12:42,015][123090] Updated weights for policy 1, policy_version 1693979 (0.0006) [2023-12-26 13:12:42,204][123091] Updated weights for policy 0, policy_version 1705273 (0.0011) [2023-12-26 13:12:42,261][123091] Updated weights for policy 0, policy_version 1705283 (0.0011) [2023-12-26 13:12:42,323][123091] Updated weights for policy 0, policy_version 1705293 (0.0010) [2023-12-26 13:12:42,837][123090] Updated weights for policy 1, policy_version 1693989 (0.0008) [2023-12-26 13:12:42,909][123090] Updated weights for policy 1, policy_version 1693999 (0.0011) [2023-12-26 13:12:42,965][123090] Updated weights for policy 1, policy_version 1694009 (0.0009) [2023-12-26 13:12:42,997][123091] Updated weights for policy 0, policy_version 1705303 (0.0006) [2023-12-26 13:12:43,063][123091] Updated weights for policy 0, policy_version 1705313 (0.0005) [2023-12-26 13:12:43,142][123091] Updated weights for policy 0, policy_version 1705323 (0.0006) [2023-12-26 13:12:43,666][123090] Updated weights for policy 1, policy_version 1694019 (0.0008) [2023-12-26 13:12:43,730][123090] Updated weights for policy 1, policy_version 1694029 (0.0009) [2023-12-26 13:12:43,763][123091] Updated weights for policy 0, policy_version 1705333 (0.0007) [2023-12-26 13:12:43,776][123090] Updated weights for policy 1, policy_version 1694039 (0.0007) [2023-12-26 13:12:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 870236160. Throughput: 0: 8984.8, 1: 8772.7. Samples: 870235132. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:43,784][121949] Avg episode reward: [(0, '6066.229'), (1, '5814.596')] [2023-12-26 13:12:43,826][123091] Updated weights for policy 0, policy_version 1705343 (0.0009) [2023-12-26 13:12:43,882][123091] Updated weights for policy 0, policy_version 1705353 (0.0009) [2023-12-26 13:12:44,526][123090] Updated weights for policy 1, policy_version 1694049 (0.0007) [2023-12-26 13:12:44,592][123090] Updated weights for policy 1, policy_version 1694059 (0.0006) [2023-12-26 13:12:44,598][123091] Updated weights for policy 0, policy_version 1705363 (0.0010) [2023-12-26 13:12:44,649][123090] Updated weights for policy 1, policy_version 1694069 (0.0005) [2023-12-26 13:12:44,650][123091] Updated weights for policy 0, policy_version 1705373 (0.0011) [2023-12-26 13:12:44,701][123090] Updated weights for policy 1, policy_version 1694079 (0.0005) [2023-12-26 13:12:44,702][123091] Updated weights for policy 0, policy_version 1705383 (0.0010) [2023-12-26 13:12:45,445][123090] Updated weights for policy 1, policy_version 1694089 (0.0005) [2023-12-26 13:12:45,513][123090] Updated weights for policy 1, policy_version 1694099 (0.0006) [2023-12-26 13:12:45,564][123091] Updated weights for policy 0, policy_version 1705393 (0.0010) [2023-12-26 13:12:45,572][123090] Updated weights for policy 1, policy_version 1694109 (0.0005) [2023-12-26 13:12:45,632][123091] Updated weights for policy 0, policy_version 1705403 (0.0011) [2023-12-26 13:12:45,699][123091] Updated weights for policy 0, policy_version 1705413 (0.0011) [2023-12-26 13:12:45,753][123091] Updated weights for policy 0, policy_version 1705423 (0.0006) [2023-12-26 13:12:46,224][123090] Updated weights for policy 1, policy_version 1694119 (0.0005) [2023-12-26 13:12:46,272][123090] Updated weights for policy 1, policy_version 1694129 (0.0005) [2023-12-26 13:12:46,318][123090] Updated weights for policy 1, policy_version 1694139 (0.0005) [2023-12-26 13:12:46,507][123091] Updated weights for policy 0, policy_version 1705433 (0.0006) [2023-12-26 13:12:46,560][123091] Updated weights for policy 0, policy_version 1705443 (0.0010) [2023-12-26 13:12:46,607][123091] Updated weights for policy 0, policy_version 1705453 (0.0010) [2023-12-26 13:12:47,093][123090] Updated weights for policy 1, policy_version 1694149 (0.0007) [2023-12-26 13:12:47,158][123090] Updated weights for policy 1, policy_version 1694159 (0.0009) [2023-12-26 13:12:47,224][123090] Updated weights for policy 1, policy_version 1694169 (0.0009) [2023-12-26 13:12:47,418][123091] Updated weights for policy 0, policy_version 1705463 (0.0011) [2023-12-26 13:12:47,487][123091] Updated weights for policy 0, policy_version 1705473 (0.0011) [2023-12-26 13:12:47,554][123091] Updated weights for policy 0, policy_version 1705483 (0.0005) [2023-12-26 13:12:48,104][123090] Updated weights for policy 1, policy_version 1694179 (0.0009) [2023-12-26 13:12:48,158][123090] Updated weights for policy 1, policy_version 1694189 (0.0010) [2023-12-26 13:12:48,217][123091] Updated weights for policy 0, policy_version 1705493 (0.0006) [2023-12-26 13:12:48,218][123090] Updated weights for policy 1, policy_version 1694199 (0.0009) [2023-12-26 13:12:48,280][123091] Updated weights for policy 0, policy_version 1705503 (0.0005) [2023-12-26 13:12:48,343][123091] Updated weights for policy 0, policy_version 1705513 (0.0007) [2023-12-26 13:12:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 870334464. Throughput: 0: 9040.4, 1: 8833.0. Samples: 870346212. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:48,785][121949] Avg episode reward: [(0, '6146.915'), (1, '5871.564')] [2023-12-26 13:12:48,956][123091] Updated weights for policy 0, policy_version 1705523 (0.0008) [2023-12-26 13:12:49,014][123091] Updated weights for policy 0, policy_version 1705533 (0.0010) [2023-12-26 13:12:49,061][123091] Updated weights for policy 0, policy_version 1705543 (0.0010) [2023-12-26 13:12:49,113][123090] Updated weights for policy 1, policy_version 1694209 (0.0009) [2023-12-26 13:12:49,172][123090] Updated weights for policy 1, policy_version 1694219 (0.0009) [2023-12-26 13:12:49,257][123090] Updated weights for policy 1, policy_version 1694229 (0.0009) [2023-12-26 13:12:49,328][123090] Updated weights for policy 1, policy_version 1694239 (0.0006) [2023-12-26 13:12:49,908][123091] Updated weights for policy 0, policy_version 1705553 (0.0010) [2023-12-26 13:12:49,972][123091] Updated weights for policy 0, policy_version 1705563 (0.0011) [2023-12-26 13:12:50,035][123091] Updated weights for policy 0, policy_version 1705573 (0.0010) [2023-12-26 13:12:50,091][123091] Updated weights for policy 0, policy_version 1705583 (0.0008) [2023-12-26 13:12:50,131][123090] Updated weights for policy 1, policy_version 1694249 (0.0008) [2023-12-26 13:12:50,195][123090] Updated weights for policy 1, policy_version 1694259 (0.0008) [2023-12-26 13:12:50,259][123090] Updated weights for policy 1, policy_version 1694269 (0.0010) [2023-12-26 13:12:50,777][123091] Updated weights for policy 0, policy_version 1705593 (0.0005) [2023-12-26 13:12:50,855][123091] Updated weights for policy 0, policy_version 1705603 (0.0006) [2023-12-26 13:12:50,912][123091] Updated weights for policy 0, policy_version 1705614 (0.0010) [2023-12-26 13:12:51,042][123090] Updated weights for policy 1, policy_version 1694279 (0.0008) [2023-12-26 13:12:51,108][123090] Updated weights for policy 1, policy_version 1694289 (0.0006) [2023-12-26 13:12:51,181][123090] Updated weights for policy 1, policy_version 1694299 (0.0007) [2023-12-26 13:12:51,685][123091] Updated weights for policy 0, policy_version 1705624 (0.0009) [2023-12-26 13:12:51,744][123091] Updated weights for policy 0, policy_version 1705634 (0.0009) [2023-12-26 13:12:51,812][123091] Updated weights for policy 0, policy_version 1705644 (0.0009) [2023-12-26 13:12:51,956][123090] Updated weights for policy 1, policy_version 1694309 (0.0009) [2023-12-26 13:12:52,010][123090] Updated weights for policy 1, policy_version 1694319 (0.0010) [2023-12-26 13:12:52,071][123090] Updated weights for policy 1, policy_version 1694329 (0.0008) [2023-12-26 13:12:52,659][123091] Updated weights for policy 0, policy_version 1705654 (0.0009) [2023-12-26 13:12:52,707][123091] Updated weights for policy 0, policy_version 1705664 (0.0007) [2023-12-26 13:12:52,768][123091] Updated weights for policy 0, policy_version 1705674 (0.0006) [2023-12-26 13:12:52,900][123090] Updated weights for policy 1, policy_version 1694339 (0.0008) [2023-12-26 13:12:52,958][123090] Updated weights for policy 1, policy_version 1694349 (0.0006) [2023-12-26 13:12:53,019][123090] Updated weights for policy 1, policy_version 1694359 (0.0006) [2023-12-26 13:12:53,505][123091] Updated weights for policy 0, policy_version 1705684 (0.0007) [2023-12-26 13:12:53,576][123091] Updated weights for policy 0, policy_version 1705694 (0.0007) [2023-12-26 13:12:53,649][123091] Updated weights for policy 0, policy_version 1705704 (0.0006) [2023-12-26 13:12:53,784][121949] Fps is (10 sec: 18841.2, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 870424576. Throughput: 0: 9049.2, 1: 8803.0. Samples: 870399672. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:53,785][121949] Avg episode reward: [(0, '6308.608'), (1, '5782.457')] [2023-12-26 13:12:53,787][123090] Updated weights for policy 1, policy_version 1694369 (0.0008) [2023-12-26 13:12:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001705712_436666368.pth... [2023-12-26 13:12:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001704624_436387840.pth [2023-12-26 13:12:53,857][123090] Updated weights for policy 1, policy_version 1694379 (0.0006) [2023-12-26 13:12:53,923][123090] Updated weights for policy 1, policy_version 1694389 (0.0006) [2023-12-26 13:12:53,992][123090] Updated weights for policy 1, policy_version 1694399 (0.0007) [2023-12-26 13:12:53,995][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001694400_433766400.pth... [2023-12-26 13:12:53,999][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001693312_433487872.pth [2023-12-26 13:12:54,407][123091] Updated weights for policy 0, policy_version 1705714 (0.0009) [2023-12-26 13:12:54,463][123091] Updated weights for policy 0, policy_version 1705724 (0.0010) [2023-12-26 13:12:54,522][123091] Updated weights for policy 0, policy_version 1705734 (0.0010) [2023-12-26 13:12:54,582][123091] Updated weights for policy 0, policy_version 1705744 (0.0010) [2023-12-26 13:12:54,801][123090] Updated weights for policy 1, policy_version 1694409 (0.0010) [2023-12-26 13:12:54,865][123090] Updated weights for policy 1, policy_version 1694419 (0.0007) [2023-12-26 13:12:54,938][123090] Updated weights for policy 1, policy_version 1694429 (0.0009) [2023-12-26 13:12:55,413][123091] Updated weights for policy 0, policy_version 1705754 (0.0009) [2023-12-26 13:12:55,459][123091] Updated weights for policy 0, policy_version 1705764 (0.0010) [2023-12-26 13:12:55,510][123091] Updated weights for policy 0, policy_version 1705774 (0.0010) [2023-12-26 13:12:55,632][123090] Updated weights for policy 1, policy_version 1694439 (0.0007) [2023-12-26 13:12:55,703][123090] Updated weights for policy 1, policy_version 1694449 (0.0005) [2023-12-26 13:12:55,772][123090] Updated weights for policy 1, policy_version 1694459 (0.0005) [2023-12-26 13:12:56,334][123091] Updated weights for policy 0, policy_version 1705784 (0.0007) [2023-12-26 13:12:56,390][123091] Updated weights for policy 0, policy_version 1705794 (0.0005) [2023-12-26 13:12:56,418][123090] Updated weights for policy 1, policy_version 1694469 (0.0006) [2023-12-26 13:12:56,446][123091] Updated weights for policy 0, policy_version 1705804 (0.0005) [2023-12-26 13:12:56,473][123090] Updated weights for policy 1, policy_version 1694479 (0.0006) [2023-12-26 13:12:56,526][123090] Updated weights for policy 1, policy_version 1694489 (0.0005) [2023-12-26 13:12:57,169][123091] Updated weights for policy 0, policy_version 1705814 (0.0008) [2023-12-26 13:12:57,223][123091] Updated weights for policy 0, policy_version 1705824 (0.0010) [2023-12-26 13:12:57,243][123090] Updated weights for policy 1, policy_version 1694499 (0.0006) [2023-12-26 13:12:57,273][123091] Updated weights for policy 0, policy_version 1705834 (0.0009) [2023-12-26 13:12:57,297][123090] Updated weights for policy 1, policy_version 1694509 (0.0005) [2023-12-26 13:12:57,361][123090] Updated weights for policy 1, policy_version 1694519 (0.0005) [2023-12-26 13:12:58,000][123090] Updated weights for policy 1, policy_version 1694529 (0.0006) [2023-12-26 13:12:58,062][123091] Updated weights for policy 0, policy_version 1705844 (0.0008) [2023-12-26 13:12:58,062][123090] Updated weights for policy 1, policy_version 1694539 (0.0008) [2023-12-26 13:12:58,126][123090] Updated weights for policy 1, policy_version 1694549 (0.0008) [2023-12-26 13:12:58,128][123091] Updated weights for policy 0, policy_version 1705854 (0.0007) [2023-12-26 13:12:58,191][123090] Updated weights for policy 1, policy_version 1694559 (0.0008) [2023-12-26 13:12:58,194][123091] Updated weights for policy 0, policy_version 1705864 (0.0006) [2023-12-26 13:12:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 870514688. Throughput: 0: 8985.8, 1: 8990.4. Samples: 870509896. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:12:58,785][121949] Avg episode reward: [(0, '6216.343'), (1, '5953.386')] [2023-12-26 13:12:58,960][123091] Updated weights for policy 0, policy_version 1705874 (0.0006) [2023-12-26 13:12:59,022][123091] Updated weights for policy 0, policy_version 1705884 (0.0007) [2023-12-26 13:12:59,037][123090] Updated weights for policy 1, policy_version 1694569 (0.0008) [2023-12-26 13:12:59,084][123091] Updated weights for policy 0, policy_version 1705894 (0.0007) [2023-12-26 13:12:59,097][123090] Updated weights for policy 1, policy_version 1694579 (0.0009) [2023-12-26 13:12:59,141][123091] Updated weights for policy 0, policy_version 1705904 (0.0008) [2023-12-26 13:12:59,156][123090] Updated weights for policy 1, policy_version 1694589 (0.0009) [2023-12-26 13:12:59,893][123091] Updated weights for policy 0, policy_version 1705914 (0.0008) [2023-12-26 13:12:59,959][123091] Updated weights for policy 0, policy_version 1705924 (0.0009) [2023-12-26 13:13:00,017][123090] Updated weights for policy 1, policy_version 1694599 (0.0010) [2023-12-26 13:13:00,025][123091] Updated weights for policy 0, policy_version 1705934 (0.0007) [2023-12-26 13:13:00,076][123090] Updated weights for policy 1, policy_version 1694609 (0.0009) [2023-12-26 13:13:00,132][123090] Updated weights for policy 1, policy_version 1694619 (0.0009) [2023-12-26 13:13:00,833][123091] Updated weights for policy 0, policy_version 1705944 (0.0009) [2023-12-26 13:13:00,891][123091] Updated weights for policy 0, policy_version 1705955 (0.0010) [2023-12-26 13:13:00,914][123090] Updated weights for policy 1, policy_version 1694629 (0.0010) [2023-12-26 13:13:00,939][123091] Updated weights for policy 0, policy_version 1705965 (0.0006) [2023-12-26 13:13:00,965][123090] Updated weights for policy 1, policy_version 1694639 (0.0010) [2023-12-26 13:13:01,037][123090] Updated weights for policy 1, policy_version 1694649 (0.0010) [2023-12-26 13:13:01,712][123091] Updated weights for policy 0, policy_version 1705975 (0.0008) [2023-12-26 13:13:01,772][123091] Updated weights for policy 0, policy_version 1705985 (0.0010) [2023-12-26 13:13:01,797][123090] Updated weights for policy 1, policy_version 1694659 (0.0009) [2023-12-26 13:13:01,822][123091] Updated weights for policy 0, policy_version 1705995 (0.0008) [2023-12-26 13:13:01,855][123090] Updated weights for policy 1, policy_version 1694669 (0.0006) [2023-12-26 13:13:01,906][123090] Updated weights for policy 1, policy_version 1694679 (0.0010) [2023-12-26 13:13:02,681][123091] Updated weights for policy 0, policy_version 1706005 (0.0008) [2023-12-26 13:13:02,710][123090] Updated weights for policy 1, policy_version 1694689 (0.0010) [2023-12-26 13:13:02,735][123091] Updated weights for policy 0, policy_version 1706015 (0.0008) [2023-12-26 13:13:02,772][123090] Updated weights for policy 1, policy_version 1694699 (0.0010) [2023-12-26 13:13:02,798][123091] Updated weights for policy 0, policy_version 1706025 (0.0010) [2023-12-26 13:13:02,831][123090] Updated weights for policy 1, policy_version 1694709 (0.0010) [2023-12-26 13:13:02,891][123090] Updated weights for policy 1, policy_version 1694719 (0.0010) [2023-12-26 13:13:03,619][123091] Updated weights for policy 0, policy_version 1706035 (0.0009) [2023-12-26 13:13:03,632][123090] Updated weights for policy 1, policy_version 1694729 (0.0006) [2023-12-26 13:13:03,677][123091] Updated weights for policy 0, policy_version 1706045 (0.0009) [2023-12-26 13:13:03,689][123090] Updated weights for policy 1, policy_version 1694739 (0.0005) [2023-12-26 13:13:03,729][123091] Updated weights for policy 0, policy_version 1706055 (0.0008) [2023-12-26 13:13:03,738][123090] Updated weights for policy 1, policy_version 1694749 (0.0005) [2023-12-26 13:13:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18158.9, 300 sec: 17939.1). Total num frames: 870612992. Throughput: 0: 8976.6, 1: 9025.6. Samples: 870617020. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:03,785][121949] Avg episode reward: [(0, '6089.091'), (1, '6022.133')] [2023-12-26 13:13:04,518][123090] Updated weights for policy 1, policy_version 1694759 (0.0009) [2023-12-26 13:13:04,582][123090] Updated weights for policy 1, policy_version 1694769 (0.0010) [2023-12-26 13:13:04,627][123091] Updated weights for policy 0, policy_version 1706065 (0.0009) [2023-12-26 13:13:04,633][123090] Updated weights for policy 1, policy_version 1694779 (0.0010) [2023-12-26 13:13:04,690][123091] Updated weights for policy 0, policy_version 1706075 (0.0008) [2023-12-26 13:13:04,740][123091] Updated weights for policy 0, policy_version 1706085 (0.0009) [2023-12-26 13:13:04,794][123091] Updated weights for policy 0, policy_version 1706096 (0.0010) [2023-12-26 13:13:05,322][123090] Updated weights for policy 1, policy_version 1694789 (0.0007) [2023-12-26 13:13:05,368][123090] Updated weights for policy 1, policy_version 1694799 (0.0005) [2023-12-26 13:13:05,425][123090] Updated weights for policy 1, policy_version 1694809 (0.0006) [2023-12-26 13:13:05,715][123091] Updated weights for policy 0, policy_version 1706107 (0.0010) [2023-12-26 13:13:05,768][123091] Updated weights for policy 0, policy_version 1706118 (0.0010) [2023-12-26 13:13:06,069][123090] Updated weights for policy 1, policy_version 1694819 (0.0005) [2023-12-26 13:13:06,131][123090] Updated weights for policy 1, policy_version 1694829 (0.0008) [2023-12-26 13:13:06,197][123090] Updated weights for policy 1, policy_version 1694839 (0.0010) [2023-12-26 13:13:06,707][123091] Updated weights for policy 0, policy_version 1706129 (0.0011) [2023-12-26 13:13:06,770][123091] Updated weights for policy 0, policy_version 1706139 (0.0008) [2023-12-26 13:13:06,842][123091] Updated weights for policy 0, policy_version 1706149 (0.0008) [2023-12-26 13:13:06,906][123091] Updated weights for policy 0, policy_version 1706159 (0.0009) [2023-12-26 13:13:06,978][123090] Updated weights for policy 1, policy_version 1694849 (0.0009) [2023-12-26 13:13:07,032][123090] Updated weights for policy 1, policy_version 1694859 (0.0010) [2023-12-26 13:13:07,085][123090] Updated weights for policy 1, policy_version 1694869 (0.0010) [2023-12-26 13:13:07,141][123090] Updated weights for policy 1, policy_version 1694879 (0.0009) [2023-12-26 13:13:07,692][123091] Updated weights for policy 0, policy_version 1706169 (0.0009) [2023-12-26 13:13:07,754][123091] Updated weights for policy 0, policy_version 1706180 (0.0010) [2023-12-26 13:13:07,802][123091] Updated weights for policy 0, policy_version 1706190 (0.0009) [2023-12-26 13:13:08,059][123090] Updated weights for policy 1, policy_version 1694889 (0.0006) [2023-12-26 13:13:08,118][123090] Updated weights for policy 1, policy_version 1694899 (0.0010) [2023-12-26 13:13:08,173][123090] Updated weights for policy 1, policy_version 1694909 (0.0010) [2023-12-26 13:13:08,708][123091] Updated weights for policy 0, policy_version 1706200 (0.0010) [2023-12-26 13:13:08,763][123091] Updated weights for policy 0, policy_version 1706210 (0.0011) [2023-12-26 13:13:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 870686720. Throughput: 0: 8946.8, 1: 9080.0. Samples: 870669768. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:08,785][121949] Avg episode reward: [(0, '5857.433'), (1, '5876.629')] [2023-12-26 13:13:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001694912_433897472.pth... [2023-12-26 13:13:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001693856_433627136.pth [2023-12-26 13:13:08,815][123091] Updated weights for policy 0, policy_version 1706220 (0.0009) [2023-12-26 13:13:08,835][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001706224_436797440.pth... [2023-12-26 13:13:08,840][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001705168_436527104.pth [2023-12-26 13:13:08,873][123090] Updated weights for policy 1, policy_version 1694919 (0.0009) [2023-12-26 13:13:08,932][123090] Updated weights for policy 1, policy_version 1694929 (0.0010) [2023-12-26 13:13:08,994][123090] Updated weights for policy 1, policy_version 1694939 (0.0010) [2023-12-26 13:13:09,639][123091] Updated weights for policy 0, policy_version 1706230 (0.0009) [2023-12-26 13:13:09,695][123091] Updated weights for policy 0, policy_version 1706240 (0.0006) [2023-12-26 13:13:09,755][123091] Updated weights for policy 0, policy_version 1706250 (0.0006) [2023-12-26 13:13:09,874][123090] Updated weights for policy 1, policy_version 1694949 (0.0011) [2023-12-26 13:13:09,931][123090] Updated weights for policy 1, policy_version 1694959 (0.0008) [2023-12-26 13:13:10,003][123090] Updated weights for policy 1, policy_version 1694969 (0.0009) [2023-12-26 13:13:10,566][123091] Updated weights for policy 0, policy_version 1706260 (0.0008) [2023-12-26 13:13:10,632][123091] Updated weights for policy 0, policy_version 1706270 (0.0006) [2023-12-26 13:13:10,686][123091] Updated weights for policy 0, policy_version 1706280 (0.0006) [2023-12-26 13:13:10,798][123090] Updated weights for policy 1, policy_version 1694979 (0.0010) [2023-12-26 13:13:10,864][123090] Updated weights for policy 1, policy_version 1694989 (0.0009) [2023-12-26 13:13:10,926][123090] Updated weights for policy 1, policy_version 1694999 (0.0009) [2023-12-26 13:13:11,420][123091] Updated weights for policy 0, policy_version 1706290 (0.0007) [2023-12-26 13:13:11,476][123091] Updated weights for policy 0, policy_version 1706300 (0.0009) [2023-12-26 13:13:11,539][123091] Updated weights for policy 0, policy_version 1706310 (0.0009) [2023-12-26 13:13:11,604][123091] Updated weights for policy 0, policy_version 1706320 (0.0006) [2023-12-26 13:13:11,765][123090] Updated weights for policy 1, policy_version 1695009 (0.0009) [2023-12-26 13:13:11,838][123090] Updated weights for policy 1, policy_version 1695019 (0.0006) [2023-12-26 13:13:11,906][123090] Updated weights for policy 1, policy_version 1695029 (0.0009) [2023-12-26 13:13:11,973][123090] Updated weights for policy 1, policy_version 1695039 (0.0010) [2023-12-26 13:13:12,474][123091] Updated weights for policy 0, policy_version 1706330 (0.0010) [2023-12-26 13:13:12,532][123091] Updated weights for policy 0, policy_version 1706340 (0.0009) [2023-12-26 13:13:12,587][123091] Updated weights for policy 0, policy_version 1706350 (0.0010) [2023-12-26 13:13:12,807][123090] Updated weights for policy 1, policy_version 1695049 (0.0009) [2023-12-26 13:13:12,862][123090] Updated weights for policy 1, policy_version 1695059 (0.0009) [2023-12-26 13:13:12,932][123090] Updated weights for policy 1, policy_version 1695069 (0.0009) [2023-12-26 13:13:13,421][123091] Updated weights for policy 0, policy_version 1706360 (0.0010) [2023-12-26 13:13:13,482][123091] Updated weights for policy 0, policy_version 1706370 (0.0009) [2023-12-26 13:13:13,542][123091] Updated weights for policy 0, policy_version 1706380 (0.0010) [2023-12-26 13:13:13,752][123090] Updated weights for policy 1, policy_version 1695079 (0.0009) [2023-12-26 13:13:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 870776832. Throughput: 0: 8955.0, 1: 9004.2. Samples: 870772460. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:13,784][121949] Avg episode reward: [(0, '5897.078'), (1, '5836.381')] [2023-12-26 13:13:13,803][123090] Updated weights for policy 1, policy_version 1695089 (0.0008) [2023-12-26 13:13:13,859][123090] Updated weights for policy 1, policy_version 1695099 (0.0010) [2023-12-26 13:13:14,371][123091] Updated weights for policy 0, policy_version 1706390 (0.0009) [2023-12-26 13:13:14,427][123091] Updated weights for policy 0, policy_version 1706400 (0.0009) [2023-12-26 13:13:14,478][123091] Updated weights for policy 0, policy_version 1706410 (0.0005) [2023-12-26 13:13:14,722][123090] Updated weights for policy 1, policy_version 1695109 (0.0009) [2023-12-26 13:13:14,786][123090] Updated weights for policy 1, policy_version 1695119 (0.0010) [2023-12-26 13:13:14,844][123090] Updated weights for policy 1, policy_version 1695129 (0.0010) [2023-12-26 13:13:15,306][123091] Updated weights for policy 0, policy_version 1706420 (0.0007) [2023-12-26 13:13:15,361][123091] Updated weights for policy 0, policy_version 1706430 (0.0009) [2023-12-26 13:13:15,415][123091] Updated weights for policy 0, policy_version 1706440 (0.0010) [2023-12-26 13:13:15,652][123090] Updated weights for policy 1, policy_version 1695139 (0.0010) [2023-12-26 13:13:15,709][123090] Updated weights for policy 1, policy_version 1695149 (0.0009) [2023-12-26 13:13:15,760][123090] Updated weights for policy 1, policy_version 1695159 (0.0010) [2023-12-26 13:13:16,268][123091] Updated weights for policy 0, policy_version 1706450 (0.0010) [2023-12-26 13:13:16,322][123091] Updated weights for policy 0, policy_version 1706460 (0.0010) [2023-12-26 13:13:16,370][123091] Updated weights for policy 0, policy_version 1706470 (0.0009) [2023-12-26 13:13:16,444][123091] Updated weights for policy 0, policy_version 1706480 (0.0005) [2023-12-26 13:13:16,616][123090] Updated weights for policy 1, policy_version 1695169 (0.0009) [2023-12-26 13:13:16,671][123090] Updated weights for policy 1, policy_version 1695181 (0.0011) [2023-12-26 13:13:16,737][123090] Updated weights for policy 1, policy_version 1695191 (0.0009) [2023-12-26 13:13:17,168][123091] Updated weights for policy 0, policy_version 1706490 (0.0009) [2023-12-26 13:13:17,228][123091] Updated weights for policy 0, policy_version 1706500 (0.0009) [2023-12-26 13:13:17,281][123091] Updated weights for policy 0, policy_version 1706510 (0.0009) [2023-12-26 13:13:17,554][123090] Updated weights for policy 1, policy_version 1695201 (0.0008) [2023-12-26 13:13:17,623][123090] Updated weights for policy 1, policy_version 1695211 (0.0006) [2023-12-26 13:13:17,692][123090] Updated weights for policy 1, policy_version 1695221 (0.0009) [2023-12-26 13:13:17,750][123090] Updated weights for policy 1, policy_version 1695231 (0.0009) [2023-12-26 13:13:18,140][123091] Updated weights for policy 0, policy_version 1706521 (0.0009) [2023-12-26 13:13:18,191][123091] Updated weights for policy 0, policy_version 1706531 (0.0008) [2023-12-26 13:13:18,244][123091] Updated weights for policy 0, policy_version 1706541 (0.0009) [2023-12-26 13:13:18,578][123090] Updated weights for policy 1, policy_version 1695241 (0.0010) [2023-12-26 13:13:18,645][123090] Updated weights for policy 1, policy_version 1695251 (0.0010) [2023-12-26 13:13:18,707][123090] Updated weights for policy 1, policy_version 1695261 (0.0010) [2023-12-26 13:13:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 870866944. Throughput: 0: 8944.7, 1: 8897.3. Samples: 870875796. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:18,785][121949] Avg episode reward: [(0, '6096.611'), (1, '5838.556')] [2023-12-26 13:13:19,045][123091] Updated weights for policy 0, policy_version 1706551 (0.0006) [2023-12-26 13:13:19,102][123091] Updated weights for policy 0, policy_version 1706561 (0.0009) [2023-12-26 13:13:19,159][123091] Updated weights for policy 0, policy_version 1706572 (0.0009) [2023-12-26 13:13:19,584][123090] Updated weights for policy 1, policy_version 1695271 (0.0008) [2023-12-26 13:13:19,662][123090] Updated weights for policy 1, policy_version 1695281 (0.0006) [2023-12-26 13:13:19,733][123090] Updated weights for policy 1, policy_version 1695291 (0.0006) [2023-12-26 13:13:20,027][123091] Updated weights for policy 0, policy_version 1706582 (0.0009) [2023-12-26 13:13:20,097][123091] Updated weights for policy 0, policy_version 1706592 (0.0010) [2023-12-26 13:13:20,158][123091] Updated weights for policy 0, policy_version 1706602 (0.0010) [2023-12-26 13:13:20,536][123090] Updated weights for policy 1, policy_version 1695301 (0.0009) [2023-12-26 13:13:20,611][123090] Updated weights for policy 1, policy_version 1695311 (0.0009) [2023-12-26 13:13:20,670][123090] Updated weights for policy 1, policy_version 1695321 (0.0010) [2023-12-26 13:13:20,939][123091] Updated weights for policy 0, policy_version 1706612 (0.0010) [2023-12-26 13:13:20,995][123091] Updated weights for policy 0, policy_version 1706622 (0.0010) [2023-12-26 13:13:21,067][123091] Updated weights for policy 0, policy_version 1706632 (0.0009) [2023-12-26 13:13:21,507][123090] Updated weights for policy 1, policy_version 1695331 (0.0009) [2023-12-26 13:13:21,561][123090] Updated weights for policy 1, policy_version 1695341 (0.0009) [2023-12-26 13:13:21,618][123090] Updated weights for policy 1, policy_version 1695351 (0.0010) [2023-12-26 13:13:21,911][123091] Updated weights for policy 0, policy_version 1706642 (0.0009) [2023-12-26 13:13:21,978][123091] Updated weights for policy 0, policy_version 1706652 (0.0011) [2023-12-26 13:13:22,037][123091] Updated weights for policy 0, policy_version 1706662 (0.0006) [2023-12-26 13:13:22,090][123091] Updated weights for policy 0, policy_version 1706672 (0.0010) [2023-12-26 13:13:22,431][123090] Updated weights for policy 1, policy_version 1695361 (0.0008) [2023-12-26 13:13:22,504][123090] Updated weights for policy 1, policy_version 1695371 (0.0008) [2023-12-26 13:13:22,572][123090] Updated weights for policy 1, policy_version 1695381 (0.0008) [2023-12-26 13:13:22,632][123090] Updated weights for policy 1, policy_version 1695391 (0.0009) [2023-12-26 13:13:22,878][123091] Updated weights for policy 0, policy_version 1706682 (0.0011) [2023-12-26 13:13:22,945][123091] Updated weights for policy 0, policy_version 1706692 (0.0010) [2023-12-26 13:13:23,012][123091] Updated weights for policy 0, policy_version 1706702 (0.0011) [2023-12-26 13:13:23,438][123090] Updated weights for policy 1, policy_version 1695401 (0.0009) [2023-12-26 13:13:23,485][123090] Updated weights for policy 1, policy_version 1695411 (0.0008) [2023-12-26 13:13:23,533][123090] Updated weights for policy 1, policy_version 1695421 (0.0009) [2023-12-26 13:13:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 870948864. Throughput: 0: 8875.2, 1: 8845.8. Samples: 870926604. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:23,785][121949] Avg episode reward: [(0, '5887.706'), (1, '5881.467')] [2023-12-26 13:13:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001695424_434028544.pth... [2023-12-26 13:13:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001694400_433766400.pth [2023-12-26 13:13:23,821][123091] Updated weights for policy 0, policy_version 1706712 (0.0010) [2023-12-26 13:13:23,886][123091] Updated weights for policy 0, policy_version 1706722 (0.0010) [2023-12-26 13:13:23,934][123091] Updated weights for policy 0, policy_version 1706732 (0.0010) [2023-12-26 13:13:23,950][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001706736_436928512.pth... [2023-12-26 13:13:23,953][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001705712_436666368.pth [2023-12-26 13:13:24,409][123090] Updated weights for policy 1, policy_version 1695431 (0.0009) [2023-12-26 13:13:24,457][123090] Updated weights for policy 1, policy_version 1695441 (0.0009) [2023-12-26 13:13:24,505][123090] Updated weights for policy 1, policy_version 1695451 (0.0008) [2023-12-26 13:13:24,761][123091] Updated weights for policy 0, policy_version 1706742 (0.0010) [2023-12-26 13:13:24,824][123091] Updated weights for policy 0, policy_version 1706752 (0.0010) [2023-12-26 13:13:24,879][123091] Updated weights for policy 0, policy_version 1706762 (0.0010) [2023-12-26 13:13:25,365][123090] Updated weights for policy 1, policy_version 1695461 (0.0009) [2023-12-26 13:13:25,413][123090] Updated weights for policy 1, policy_version 1695471 (0.0009) [2023-12-26 13:13:25,471][123090] Updated weights for policy 1, policy_version 1695481 (0.0009) [2023-12-26 13:13:25,726][123091] Updated weights for policy 0, policy_version 1706772 (0.0010) [2023-12-26 13:13:25,779][123091] Updated weights for policy 0, policy_version 1706782 (0.0007) [2023-12-26 13:13:25,841][123091] Updated weights for policy 0, policy_version 1706793 (0.0011) [2023-12-26 13:13:26,333][123090] Updated weights for policy 1, policy_version 1695491 (0.0008) [2023-12-26 13:13:26,386][123090] Updated weights for policy 1, policy_version 1695501 (0.0006) [2023-12-26 13:13:26,448][123090] Updated weights for policy 1, policy_version 1695511 (0.0009) [2023-12-26 13:13:26,606][123091] Updated weights for policy 0, policy_version 1706803 (0.0009) [2023-12-26 13:13:26,664][123091] Updated weights for policy 0, policy_version 1706813 (0.0005) [2023-12-26 13:13:26,725][123091] Updated weights for policy 0, policy_version 1706823 (0.0005) [2023-12-26 13:13:27,281][123090] Updated weights for policy 1, policy_version 1695521 (0.0009) [2023-12-26 13:13:27,346][123090] Updated weights for policy 1, policy_version 1695531 (0.0008) [2023-12-26 13:13:27,374][123091] Updated weights for policy 0, policy_version 1706833 (0.0005) [2023-12-26 13:13:27,398][123090] Updated weights for policy 1, policy_version 1695541 (0.0009) [2023-12-26 13:13:27,433][123091] Updated weights for policy 0, policy_version 1706843 (0.0008) [2023-12-26 13:13:27,449][123090] Updated weights for policy 1, policy_version 1695551 (0.0009) [2023-12-26 13:13:27,487][123091] Updated weights for policy 0, policy_version 1706853 (0.0009) [2023-12-26 13:13:27,534][123091] Updated weights for policy 0, policy_version 1706863 (0.0010) [2023-12-26 13:13:28,291][123091] Updated weights for policy 0, policy_version 1706873 (0.0010) [2023-12-26 13:13:28,322][123090] Updated weights for policy 1, policy_version 1695561 (0.0008) [2023-12-26 13:13:28,348][123091] Updated weights for policy 0, policy_version 1706883 (0.0008) [2023-12-26 13:13:28,394][123090] Updated weights for policy 1, policy_version 1695571 (0.0007) [2023-12-26 13:13:28,409][123091] Updated weights for policy 0, policy_version 1706893 (0.0007) [2023-12-26 13:13:28,463][123090] Updated weights for policy 1, policy_version 1695581 (0.0009) [2023-12-26 13:13:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 871038976. Throughput: 0: 8846.9, 1: 8842.7. Samples: 871031164. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:28,784][121949] Avg episode reward: [(0, '5858.040'), (1, '5821.113')] [2023-12-26 13:13:29,194][123091] Updated weights for policy 0, policy_version 1706903 (0.0008) [2023-12-26 13:13:29,250][123090] Updated weights for policy 1, policy_version 1695591 (0.0007) [2023-12-26 13:13:29,258][123091] Updated weights for policy 0, policy_version 1706913 (0.0009) [2023-12-26 13:13:29,315][123090] Updated weights for policy 1, policy_version 1695601 (0.0006) [2023-12-26 13:13:29,319][123091] Updated weights for policy 0, policy_version 1706923 (0.0007) [2023-12-26 13:13:29,389][123090] Updated weights for policy 1, policy_version 1695611 (0.0008) [2023-12-26 13:13:30,093][123091] Updated weights for policy 0, policy_version 1706933 (0.0006) [2023-12-26 13:13:30,152][123091] Updated weights for policy 0, policy_version 1706943 (0.0006) [2023-12-26 13:13:30,175][123090] Updated weights for policy 1, policy_version 1695621 (0.0008) [2023-12-26 13:13:30,212][123091] Updated weights for policy 0, policy_version 1706953 (0.0006) [2023-12-26 13:13:30,235][123090] Updated weights for policy 1, policy_version 1695631 (0.0006) [2023-12-26 13:13:30,304][123090] Updated weights for policy 1, policy_version 1695641 (0.0007) [2023-12-26 13:13:30,906][123091] Updated weights for policy 0, policy_version 1706963 (0.0006) [2023-12-26 13:13:30,963][123091] Updated weights for policy 0, policy_version 1706973 (0.0009) [2023-12-26 13:13:30,989][123090] Updated weights for policy 1, policy_version 1695651 (0.0005) [2023-12-26 13:13:31,012][123091] Updated weights for policy 0, policy_version 1706983 (0.0009) [2023-12-26 13:13:31,056][123090] Updated weights for policy 1, policy_version 1695661 (0.0007) [2023-12-26 13:13:31,124][123090] Updated weights for policy 1, policy_version 1695671 (0.0007) [2023-12-26 13:13:31,792][123091] Updated weights for policy 0, policy_version 1706993 (0.0006) [2023-12-26 13:13:31,845][123091] Updated weights for policy 0, policy_version 1707003 (0.0008) [2023-12-26 13:13:31,906][123091] Updated weights for policy 0, policy_version 1707013 (0.0009) [2023-12-26 13:13:31,920][123090] Updated weights for policy 1, policy_version 1695681 (0.0010) [2023-12-26 13:13:31,966][123091] Updated weights for policy 0, policy_version 1707023 (0.0007) [2023-12-26 13:13:31,971][123090] Updated weights for policy 1, policy_version 1695691 (0.0010) [2023-12-26 13:13:32,026][123090] Updated weights for policy 1, policy_version 1695701 (0.0010) [2023-12-26 13:13:32,089][123090] Updated weights for policy 1, policy_version 1695711 (0.0010) [2023-12-26 13:13:32,799][123091] Updated weights for policy 0, policy_version 1707033 (0.0008) [2023-12-26 13:13:32,867][123091] Updated weights for policy 0, policy_version 1707043 (0.0009) [2023-12-26 13:13:32,935][123091] Updated weights for policy 0, policy_version 1707053 (0.0009) [2023-12-26 13:13:32,954][123090] Updated weights for policy 1, policy_version 1695721 (0.0010) [2023-12-26 13:13:33,008][123090] Updated weights for policy 1, policy_version 1695731 (0.0010) [2023-12-26 13:13:33,067][123090] Updated weights for policy 1, policy_version 1695741 (0.0010) [2023-12-26 13:13:33,761][123091] Updated weights for policy 0, policy_version 1707063 (0.0008) [2023-12-26 13:13:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 871120896. Throughput: 0: 8810.2, 1: 8801.0. Samples: 871138712. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:33,785][121949] Avg episode reward: [(0, '6049.569'), (1, '5678.211')] [2023-12-26 13:13:33,811][123091] Updated weights for policy 0, policy_version 1707073 (0.0009) [2023-12-26 13:13:33,863][123091] Updated weights for policy 0, policy_version 1707084 (0.0010) [2023-12-26 13:13:33,880][123090] Updated weights for policy 1, policy_version 1695751 (0.0007) [2023-12-26 13:13:33,931][123090] Updated weights for policy 1, policy_version 1695761 (0.0005) [2023-12-26 13:13:33,991][123090] Updated weights for policy 1, policy_version 1695771 (0.0005) [2023-12-26 13:13:34,714][123090] Updated weights for policy 1, policy_version 1695781 (0.0005) [2023-12-26 13:13:34,788][123090] Updated weights for policy 1, policy_version 1695791 (0.0006) [2023-12-26 13:13:34,812][123091] Updated weights for policy 0, policy_version 1707094 (0.0008) [2023-12-26 13:13:34,857][123090] Updated weights for policy 1, policy_version 1695801 (0.0009) [2023-12-26 13:13:34,880][123091] Updated weights for policy 0, policy_version 1707104 (0.0008) [2023-12-26 13:13:34,949][123091] Updated weights for policy 0, policy_version 1707115 (0.0008) [2023-12-26 13:13:35,537][123090] Updated weights for policy 1, policy_version 1695811 (0.0007) [2023-12-26 13:13:35,609][123090] Updated weights for policy 1, policy_version 1695821 (0.0010) [2023-12-26 13:13:35,667][123090] Updated weights for policy 1, policy_version 1695831 (0.0010) [2023-12-26 13:13:35,808][123091] Updated weights for policy 0, policy_version 1707125 (0.0010) [2023-12-26 13:13:35,866][123091] Updated weights for policy 0, policy_version 1707135 (0.0009) [2023-12-26 13:13:35,921][123091] Updated weights for policy 0, policy_version 1707145 (0.0010) [2023-12-26 13:13:36,304][123090] Updated weights for policy 1, policy_version 1695841 (0.0010) [2023-12-26 13:13:36,380][123090] Updated weights for policy 1, policy_version 1695851 (0.0005) [2023-12-26 13:13:36,453][123090] Updated weights for policy 1, policy_version 1695861 (0.0005) [2023-12-26 13:13:36,516][123090] Updated weights for policy 1, policy_version 1695871 (0.0005) [2023-12-26 13:13:36,747][123091] Updated weights for policy 0, policy_version 1707155 (0.0009) [2023-12-26 13:13:36,796][123091] Updated weights for policy 0, policy_version 1707165 (0.0006) [2023-12-26 13:13:36,848][123091] Updated weights for policy 0, policy_version 1707175 (0.0006) [2023-12-26 13:13:37,204][123090] Updated weights for policy 1, policy_version 1695881 (0.0010) [2023-12-26 13:13:37,272][123090] Updated weights for policy 1, policy_version 1695891 (0.0010) [2023-12-26 13:13:37,338][123090] Updated weights for policy 1, policy_version 1695901 (0.0010) [2023-12-26 13:13:37,596][123091] Updated weights for policy 0, policy_version 1707185 (0.0006) [2023-12-26 13:13:37,652][123091] Updated weights for policy 0, policy_version 1707195 (0.0011) [2023-12-26 13:13:37,711][123091] Updated weights for policy 0, policy_version 1707205 (0.0010) [2023-12-26 13:13:37,769][123091] Updated weights for policy 0, policy_version 1707215 (0.0010) [2023-12-26 13:13:38,117][123090] Updated weights for policy 1, policy_version 1695911 (0.0007) [2023-12-26 13:13:38,170][123090] Updated weights for policy 1, policy_version 1695921 (0.0005) [2023-12-26 13:13:38,218][123090] Updated weights for policy 1, policy_version 1695931 (0.0005) [2023-12-26 13:13:38,603][123091] Updated weights for policy 0, policy_version 1707225 (0.0010) [2023-12-26 13:13:38,675][123091] Updated weights for policy 0, policy_version 1707235 (0.0010) [2023-12-26 13:13:38,747][123091] Updated weights for policy 0, policy_version 1707245 (0.0010) [2023-12-26 13:13:38,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 871219200. Throughput: 0: 8733.4, 1: 8882.2. Samples: 871192376. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:38,785][121949] Avg episode reward: [(0, '6116.713'), (1, '5604.613')] [2023-12-26 13:13:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001707248_437059584.pth... [2023-12-26 13:13:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001695936_434159616.pth... [2023-12-26 13:13:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001706224_436797440.pth [2023-12-26 13:13:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001694912_433897472.pth [2023-12-26 13:13:38,993][123090] Updated weights for policy 1, policy_version 1695941 (0.0007) [2023-12-26 13:13:39,041][123090] Updated weights for policy 1, policy_version 1695951 (0.0009) [2023-12-26 13:13:39,095][123090] Updated weights for policy 1, policy_version 1695961 (0.0006) [2023-12-26 13:13:39,641][123091] Updated weights for policy 0, policy_version 1707255 (0.0009) [2023-12-26 13:13:39,691][123091] Updated weights for policy 0, policy_version 1707265 (0.0009) [2023-12-26 13:13:39,744][123091] Updated weights for policy 0, policy_version 1707275 (0.0009) [2023-12-26 13:13:40,014][123090] Updated weights for policy 1, policy_version 1695971 (0.0006) [2023-12-26 13:13:40,079][123090] Updated weights for policy 1, policy_version 1695981 (0.0010) [2023-12-26 13:13:40,151][123090] Updated weights for policy 1, policy_version 1695991 (0.0011) [2023-12-26 13:13:40,614][123091] Updated weights for policy 0, policy_version 1707285 (0.0010) [2023-12-26 13:13:40,670][123091] Updated weights for policy 0, policy_version 1707295 (0.0009) [2023-12-26 13:13:40,732][123091] Updated weights for policy 0, policy_version 1707305 (0.0008) [2023-12-26 13:13:40,917][123090] Updated weights for policy 1, policy_version 1696001 (0.0010) [2023-12-26 13:13:40,976][123090] Updated weights for policy 1, policy_version 1696011 (0.0010) [2023-12-26 13:13:41,043][123090] Updated weights for policy 1, policy_version 1696021 (0.0010) [2023-12-26 13:13:41,110][123090] Updated weights for policy 1, policy_version 1696031 (0.0010) [2023-12-26 13:13:41,558][123091] Updated weights for policy 0, policy_version 1707315 (0.0007) [2023-12-26 13:13:41,614][123091] Updated weights for policy 0, policy_version 1707325 (0.0010) [2023-12-26 13:13:41,683][123091] Updated weights for policy 0, policy_version 1707335 (0.0010) [2023-12-26 13:13:41,847][123090] Updated weights for policy 1, policy_version 1696041 (0.0010) [2023-12-26 13:13:41,913][123090] Updated weights for policy 1, policy_version 1696051 (0.0008) [2023-12-26 13:13:41,974][123090] Updated weights for policy 1, policy_version 1696061 (0.0010) [2023-12-26 13:13:42,551][123091] Updated weights for policy 0, policy_version 1707345 (0.0010) [2023-12-26 13:13:42,606][123091] Updated weights for policy 0, policy_version 1707355 (0.0009) [2023-12-26 13:13:42,658][123091] Updated weights for policy 0, policy_version 1707365 (0.0009) [2023-12-26 13:13:42,718][123091] Updated weights for policy 0, policy_version 1707375 (0.0009) [2023-12-26 13:13:42,759][123090] Updated weights for policy 1, policy_version 1696071 (0.0007) [2023-12-26 13:13:42,826][123090] Updated weights for policy 1, policy_version 1696081 (0.0007) [2023-12-26 13:13:42,885][123090] Updated weights for policy 1, policy_version 1696091 (0.0007) [2023-12-26 13:13:43,531][123091] Updated weights for policy 0, policy_version 1707385 (0.0005) [2023-12-26 13:13:43,592][123091] Updated weights for policy 0, policy_version 1707395 (0.0005) [2023-12-26 13:13:43,645][123091] Updated weights for policy 0, policy_version 1707405 (0.0008) [2023-12-26 13:13:43,711][123090] Updated weights for policy 1, policy_version 1696101 (0.0009) [2023-12-26 13:13:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 871301120. Throughput: 0: 8667.8, 1: 8796.3. Samples: 871295784. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:43,785][121949] Avg episode reward: [(0, '5953.069'), (1, '5743.718')] [2023-12-26 13:13:43,789][123090] Updated weights for policy 1, policy_version 1696111 (0.0011) [2023-12-26 13:13:43,855][123090] Updated weights for policy 1, policy_version 1696121 (0.0010) [2023-12-26 13:13:44,399][123091] Updated weights for policy 0, policy_version 1707415 (0.0010) [2023-12-26 13:13:44,463][123091] Updated weights for policy 0, policy_version 1707425 (0.0008) [2023-12-26 13:13:44,526][123091] Updated weights for policy 0, policy_version 1707435 (0.0011) [2023-12-26 13:13:44,623][123090] Updated weights for policy 1, policy_version 1696131 (0.0010) [2023-12-26 13:13:44,695][123090] Updated weights for policy 1, policy_version 1696141 (0.0010) [2023-12-26 13:13:44,756][123090] Updated weights for policy 1, policy_version 1696151 (0.0008) [2023-12-26 13:13:45,402][123091] Updated weights for policy 0, policy_version 1707445 (0.0010) [2023-12-26 13:13:45,465][123091] Updated weights for policy 0, policy_version 1707455 (0.0008) [2023-12-26 13:13:45,535][123091] Updated weights for policy 0, policy_version 1707465 (0.0009) [2023-12-26 13:13:45,540][123090] Updated weights for policy 1, policy_version 1696161 (0.0008) [2023-12-26 13:13:45,598][123090] Updated weights for policy 1, policy_version 1696171 (0.0008) [2023-12-26 13:13:45,650][123090] Updated weights for policy 1, policy_version 1696181 (0.0009) [2023-12-26 13:13:45,701][123090] Updated weights for policy 1, policy_version 1696191 (0.0010) [2023-12-26 13:13:46,278][123091] Updated weights for policy 0, policy_version 1707475 (0.0009) [2023-12-26 13:13:46,351][123091] Updated weights for policy 0, policy_version 1707485 (0.0010) [2023-12-26 13:13:46,397][123091] Updated weights for policy 0, policy_version 1707495 (0.0005) [2023-12-26 13:13:46,611][123090] Updated weights for policy 1, policy_version 1696201 (0.0006) [2023-12-26 13:13:46,667][123090] Updated weights for policy 1, policy_version 1696211 (0.0005) [2023-12-26 13:13:46,715][123090] Updated weights for policy 1, policy_version 1696221 (0.0006) [2023-12-26 13:13:47,143][123091] Updated weights for policy 0, policy_version 1707505 (0.0006) [2023-12-26 13:13:47,213][123091] Updated weights for policy 0, policy_version 1707515 (0.0011) [2023-12-26 13:13:47,275][123091] Updated weights for policy 0, policy_version 1707525 (0.0011) [2023-12-26 13:13:47,339][123091] Updated weights for policy 0, policy_version 1707535 (0.0008) [2023-12-26 13:13:47,373][123090] Updated weights for policy 1, policy_version 1696231 (0.0006) [2023-12-26 13:13:47,421][123090] Updated weights for policy 1, policy_version 1696241 (0.0009) [2023-12-26 13:13:47,469][123090] Updated weights for policy 1, policy_version 1696251 (0.0010) [2023-12-26 13:13:48,104][123091] Updated weights for policy 0, policy_version 1707545 (0.0010) [2023-12-26 13:13:48,160][123091] Updated weights for policy 0, policy_version 1707555 (0.0011) [2023-12-26 13:13:48,226][123091] Updated weights for policy 0, policy_version 1707565 (0.0011) [2023-12-26 13:13:48,271][123090] Updated weights for policy 1, policy_version 1696261 (0.0009) [2023-12-26 13:13:48,334][123090] Updated weights for policy 1, policy_version 1696271 (0.0008) [2023-12-26 13:13:48,393][123090] Updated weights for policy 1, policy_version 1696281 (0.0009) [2023-12-26 13:13:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 871391232. Throughput: 0: 8674.4, 1: 8792.1. Samples: 871403012. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:48,785][121949] Avg episode reward: [(0, '5988.783'), (1, '5746.507')] [2023-12-26 13:13:49,042][123091] Updated weights for policy 0, policy_version 1707575 (0.0011) [2023-12-26 13:13:49,104][123091] Updated weights for policy 0, policy_version 1707585 (0.0010) [2023-12-26 13:13:49,165][123090] Updated weights for policy 1, policy_version 1696291 (0.0007) [2023-12-26 13:13:49,166][123091] Updated weights for policy 0, policy_version 1707595 (0.0011) [2023-12-26 13:13:49,222][123090] Updated weights for policy 1, policy_version 1696301 (0.0006) [2023-12-26 13:13:49,286][123090] Updated weights for policy 1, policy_version 1696311 (0.0007) [2023-12-26 13:13:49,923][123091] Updated weights for policy 0, policy_version 1707605 (0.0010) [2023-12-26 13:13:49,989][123091] Updated weights for policy 0, policy_version 1707615 (0.0010) [2023-12-26 13:13:50,053][123091] Updated weights for policy 0, policy_version 1707625 (0.0009) [2023-12-26 13:13:50,097][123090] Updated weights for policy 1, policy_version 1696321 (0.0006) [2023-12-26 13:13:50,162][123090] Updated weights for policy 1, policy_version 1696331 (0.0006) [2023-12-26 13:13:50,234][123090] Updated weights for policy 1, policy_version 1696341 (0.0008) [2023-12-26 13:13:50,303][123090] Updated weights for policy 1, policy_version 1696351 (0.0010) [2023-12-26 13:13:50,861][123091] Updated weights for policy 0, policy_version 1707635 (0.0008) [2023-12-26 13:13:50,925][123091] Updated weights for policy 0, policy_version 1707645 (0.0009) [2023-12-26 13:13:50,988][123091] Updated weights for policy 0, policy_version 1707655 (0.0010) [2023-12-26 13:13:51,112][123090] Updated weights for policy 1, policy_version 1696361 (0.0007) [2023-12-26 13:13:51,188][123090] Updated weights for policy 1, policy_version 1696371 (0.0008) [2023-12-26 13:13:51,253][123090] Updated weights for policy 1, policy_version 1696381 (0.0010) [2023-12-26 13:13:51,802][123091] Updated weights for policy 0, policy_version 1707665 (0.0010) [2023-12-26 13:13:51,868][123091] Updated weights for policy 0, policy_version 1707675 (0.0010) [2023-12-26 13:13:51,931][123091] Updated weights for policy 0, policy_version 1707685 (0.0010) [2023-12-26 13:13:51,995][123091] Updated weights for policy 0, policy_version 1707695 (0.0009) [2023-12-26 13:13:52,019][123090] Updated weights for policy 1, policy_version 1696391 (0.0008) [2023-12-26 13:13:52,083][123090] Updated weights for policy 1, policy_version 1696401 (0.0011) [2023-12-26 13:13:52,142][123090] Updated weights for policy 1, policy_version 1696411 (0.0010) [2023-12-26 13:13:52,837][123091] Updated weights for policy 0, policy_version 1707705 (0.0009) [2023-12-26 13:13:52,897][123091] Updated weights for policy 0, policy_version 1707715 (0.0009) [2023-12-26 13:13:52,953][123091] Updated weights for policy 0, policy_version 1707725 (0.0008) [2023-12-26 13:13:52,959][123090] Updated weights for policy 1, policy_version 1696421 (0.0010) [2023-12-26 13:13:53,018][123090] Updated weights for policy 1, policy_version 1696431 (0.0010) [2023-12-26 13:13:53,084][123090] Updated weights for policy 1, policy_version 1696441 (0.0010) [2023-12-26 13:13:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 871473152. Throughput: 0: 8727.2, 1: 8721.8. Samples: 871454980. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:53,786][121949] Avg episode reward: [(0, '6003.042'), (1, '5619.431')] [2023-12-26 13:13:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001696448_434290688.pth... [2023-12-26 13:13:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001695424_434028544.pth [2023-12-26 13:13:53,797][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001696448_434290688.pth [2023-12-26 13:13:53,836][123091] Updated weights for policy 0, policy_version 1707735 (0.0009) [2023-12-26 13:13:53,841][123090] Updated weights for policy 1, policy_version 1696451 (0.0009) [2023-12-26 13:13:53,892][123090] Updated weights for policy 1, policy_version 1696461 (0.0005) [2023-12-26 13:13:53,893][123091] Updated weights for policy 0, policy_version 1707745 (0.0008) [2023-12-26 13:13:53,947][123090] Updated weights for policy 1, policy_version 1696471 (0.0005) [2023-12-26 13:13:53,956][123091] Updated weights for policy 0, policy_version 1707755 (0.0007) [2023-12-26 13:13:53,991][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001707760_437190656.pth... [2023-12-26 13:13:53,995][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001706736_436928512.pth [2023-12-26 13:13:53,996][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001707760_437190656.pth [2023-12-26 13:13:54,632][123090] Updated weights for policy 1, policy_version 1696481 (0.0006) [2023-12-26 13:13:54,642][123091] Updated weights for policy 0, policy_version 1707765 (0.0005) [2023-12-26 13:13:54,692][123090] Updated weights for policy 1, policy_version 1696491 (0.0006) [2023-12-26 13:13:54,701][123091] Updated weights for policy 0, policy_version 1707775 (0.0006) [2023-12-26 13:13:54,750][123090] Updated weights for policy 1, policy_version 1696501 (0.0005) [2023-12-26 13:13:54,758][123091] Updated weights for policy 0, policy_version 1707785 (0.0007) [2023-12-26 13:13:54,821][123090] Updated weights for policy 1, policy_version 1696511 (0.0005) [2023-12-26 13:13:55,529][123091] Updated weights for policy 0, policy_version 1707795 (0.0007) [2023-12-26 13:13:55,577][123090] Updated weights for policy 1, policy_version 1696521 (0.0007) [2023-12-26 13:13:55,586][123091] Updated weights for policy 0, policy_version 1707805 (0.0008) [2023-12-26 13:13:55,641][123090] Updated weights for policy 1, policy_version 1696531 (0.0007) [2023-12-26 13:13:55,646][123091] Updated weights for policy 0, policy_version 1707815 (0.0010) [2023-12-26 13:13:55,701][123090] Updated weights for policy 1, policy_version 1696541 (0.0009) [2023-12-26 13:13:56,427][123091] Updated weights for policy 0, policy_version 1707825 (0.0008) [2023-12-26 13:13:56,489][123091] Updated weights for policy 0, policy_version 1707835 (0.0009) [2023-12-26 13:13:56,544][123091] Updated weights for policy 0, policy_version 1707845 (0.0009) [2023-12-26 13:13:56,568][123090] Updated weights for policy 1, policy_version 1696551 (0.0009) [2023-12-26 13:13:56,605][123091] Updated weights for policy 0, policy_version 1707855 (0.0009) [2023-12-26 13:13:56,625][123090] Updated weights for policy 1, policy_version 1696561 (0.0007) [2023-12-26 13:13:56,693][123090] Updated weights for policy 1, policy_version 1696571 (0.0009) [2023-12-26 13:13:57,442][123091] Updated weights for policy 0, policy_version 1707865 (0.0009) [2023-12-26 13:13:57,507][123091] Updated weights for policy 0, policy_version 1707875 (0.0009) [2023-12-26 13:13:57,524][123090] Updated weights for policy 1, policy_version 1696581 (0.0010) [2023-12-26 13:13:57,563][123091] Updated weights for policy 0, policy_version 1707885 (0.0008) [2023-12-26 13:13:57,585][123090] Updated weights for policy 1, policy_version 1696591 (0.0010) [2023-12-26 13:13:57,654][123090] Updated weights for policy 1, policy_version 1696601 (0.0009) [2023-12-26 13:13:58,397][123090] Updated weights for policy 1, policy_version 1696611 (0.0009) [2023-12-26 13:13:58,411][123091] Updated weights for policy 0, policy_version 1707895 (0.0008) [2023-12-26 13:13:58,469][123090] Updated weights for policy 1, policy_version 1696621 (0.0008) [2023-12-26 13:13:58,472][123091] Updated weights for policy 0, policy_version 1707905 (0.0008) [2023-12-26 13:13:58,528][123091] Updated weights for policy 0, policy_version 1707915 (0.0007) [2023-12-26 13:13:58,536][123090] Updated weights for policy 1, policy_version 1696631 (0.0008) [2023-12-26 13:13:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 871571456. Throughput: 0: 8767.5, 1: 8780.1. Samples: 871562104. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:13:58,785][121949] Avg episode reward: [(0, '6124.846'), (1, '5714.267')] [2023-12-26 13:13:59,253][123091] Updated weights for policy 0, policy_version 1707925 (0.0007) [2023-12-26 13:13:59,312][123091] Updated weights for policy 0, policy_version 1707935 (0.0006) [2023-12-26 13:13:59,313][123090] Updated weights for policy 1, policy_version 1696641 (0.0008) [2023-12-26 13:13:59,380][123091] Updated weights for policy 0, policy_version 1707945 (0.0008) [2023-12-26 13:13:59,381][123090] Updated weights for policy 1, policy_version 1696651 (0.0009) [2023-12-26 13:13:59,428][123090] Updated weights for policy 1, policy_version 1696661 (0.0010) [2023-12-26 13:13:59,494][123090] Updated weights for policy 1, policy_version 1696671 (0.0010) [2023-12-26 13:14:00,075][123091] Updated weights for policy 0, policy_version 1707955 (0.0008) [2023-12-26 13:14:00,127][123091] Updated weights for policy 0, policy_version 1707965 (0.0009) [2023-12-26 13:14:00,191][123091] Updated weights for policy 0, policy_version 1707975 (0.0008) [2023-12-26 13:14:00,338][123090] Updated weights for policy 1, policy_version 1696681 (0.0010) [2023-12-26 13:14:00,385][123090] Updated weights for policy 1, policy_version 1696691 (0.0010) [2023-12-26 13:14:00,432][123090] Updated weights for policy 1, policy_version 1696701 (0.0010) [2023-12-26 13:14:01,047][123091] Updated weights for policy 0, policy_version 1707985 (0.0009) [2023-12-26 13:14:01,110][123091] Updated weights for policy 0, policy_version 1707995 (0.0008) [2023-12-26 13:14:01,124][123090] Updated weights for policy 1, policy_version 1696711 (0.0010) [2023-12-26 13:14:01,182][123091] Updated weights for policy 0, policy_version 1708005 (0.0010) [2023-12-26 13:14:01,194][123090] Updated weights for policy 1, policy_version 1696721 (0.0010) [2023-12-26 13:14:01,257][123091] Updated weights for policy 0, policy_version 1708015 (0.0009) [2023-12-26 13:14:01,258][123090] Updated weights for policy 1, policy_version 1696731 (0.0011) [2023-12-26 13:14:02,057][123090] Updated weights for policy 1, policy_version 1696741 (0.0010) [2023-12-26 13:14:02,082][123091] Updated weights for policy 0, policy_version 1708025 (0.0008) [2023-12-26 13:14:02,120][123090] Updated weights for policy 1, policy_version 1696751 (0.0010) [2023-12-26 13:14:02,143][123091] Updated weights for policy 0, policy_version 1708035 (0.0010) [2023-12-26 13:14:02,172][123090] Updated weights for policy 1, policy_version 1696761 (0.0010) [2023-12-26 13:14:02,188][123091] Updated weights for policy 0, policy_version 1708045 (0.0006) [2023-12-26 13:14:02,993][123090] Updated weights for policy 1, policy_version 1696771 (0.0010) [2023-12-26 13:14:03,034][123091] Updated weights for policy 0, policy_version 1708055 (0.0008) [2023-12-26 13:14:03,045][123090] Updated weights for policy 1, policy_version 1696781 (0.0010) [2023-12-26 13:14:03,090][123091] Updated weights for policy 0, policy_version 1708065 (0.0006) [2023-12-26 13:14:03,104][123090] Updated weights for policy 1, policy_version 1696791 (0.0010) [2023-12-26 13:14:03,157][123091] Updated weights for policy 0, policy_version 1708075 (0.0006) [2023-12-26 13:14:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17800.2). Total num frames: 871653376. Throughput: 0: 8768.3, 1: 8841.2. Samples: 871668228. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:14:03,785][121949] Avg episode reward: [(0, '6013.797'), (1, '6024.772')] [2023-12-26 13:14:03,871][123090] Updated weights for policy 1, policy_version 1696801 (0.0011) [2023-12-26 13:14:03,930][123090] Updated weights for policy 1, policy_version 1696811 (0.0010) [2023-12-26 13:14:03,991][123090] Updated weights for policy 1, policy_version 1696821 (0.0006) [2023-12-26 13:14:04,016][123091] Updated weights for policy 0, policy_version 1708085 (0.0008) [2023-12-26 13:14:04,043][123090] Updated weights for policy 1, policy_version 1696831 (0.0010) [2023-12-26 13:14:04,086][123091] Updated weights for policy 0, policy_version 1708095 (0.0008) [2023-12-26 13:14:04,149][123091] Updated weights for policy 0, policy_version 1708105 (0.0007) [2023-12-26 13:14:04,880][123090] Updated weights for policy 1, policy_version 1696841 (0.0010) [2023-12-26 13:14:04,890][123091] Updated weights for policy 0, policy_version 1708115 (0.0009) [2023-12-26 13:14:04,942][123090] Updated weights for policy 1, policy_version 1696851 (0.0010) [2023-12-26 13:14:04,943][123091] Updated weights for policy 0, policy_version 1708125 (0.0007) [2023-12-26 13:14:04,993][123091] Updated weights for policy 0, policy_version 1708135 (0.0009) [2023-12-26 13:14:04,998][123090] Updated weights for policy 1, policy_version 1696861 (0.0007) [2023-12-26 13:14:05,763][123090] Updated weights for policy 1, policy_version 1696871 (0.0009) [2023-12-26 13:14:05,819][123090] Updated weights for policy 1, policy_version 1696881 (0.0009) [2023-12-26 13:14:05,858][123091] Updated weights for policy 0, policy_version 1708145 (0.0009) [2023-12-26 13:14:05,872][123090] Updated weights for policy 1, policy_version 1696891 (0.0009) [2023-12-26 13:14:05,906][123091] Updated weights for policy 0, policy_version 1708155 (0.0008) [2023-12-26 13:14:05,961][123091] Updated weights for policy 0, policy_version 1708165 (0.0010) [2023-12-26 13:14:06,013][123091] Updated weights for policy 0, policy_version 1708175 (0.0009) [2023-12-26 13:14:06,770][123090] Updated weights for policy 1, policy_version 1696901 (0.0008) [2023-12-26 13:14:06,830][123090] Updated weights for policy 1, policy_version 1696911 (0.0009) [2023-12-26 13:14:06,880][123091] Updated weights for policy 0, policy_version 1708185 (0.0011) [2023-12-26 13:14:06,888][123090] Updated weights for policy 1, policy_version 1696921 (0.0006) [2023-12-26 13:14:06,943][123091] Updated weights for policy 0, policy_version 1708195 (0.0009) [2023-12-26 13:14:07,002][123091] Updated weights for policy 0, policy_version 1708205 (0.0009) [2023-12-26 13:14:07,719][123090] Updated weights for policy 1, policy_version 1696931 (0.0009) [2023-12-26 13:14:07,779][123090] Updated weights for policy 1, policy_version 1696941 (0.0009) [2023-12-26 13:14:07,809][123091] Updated weights for policy 0, policy_version 1708215 (0.0006) [2023-12-26 13:14:07,832][123090] Updated weights for policy 1, policy_version 1696951 (0.0009) [2023-12-26 13:14:07,866][123091] Updated weights for policy 0, policy_version 1708225 (0.0006) [2023-12-26 13:14:07,921][123091] Updated weights for policy 0, policy_version 1708235 (0.0005) [2023-12-26 13:14:08,699][123091] Updated weights for policy 0, policy_version 1708245 (0.0009) [2023-12-26 13:14:08,720][123090] Updated weights for policy 1, policy_version 1696961 (0.0009) [2023-12-26 13:14:08,748][123091] Updated weights for policy 0, policy_version 1708255 (0.0006) [2023-12-26 13:14:08,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 871735296. Throughput: 0: 8778.9, 1: 8866.3. Samples: 871720640. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:14:08,785][121949] Avg episode reward: [(0, '6162.439'), (1, '5810.824')] [2023-12-26 13:14:08,793][123090] Updated weights for policy 1, policy_version 1696971 (0.0009) [2023-12-26 13:14:08,808][123091] Updated weights for policy 0, policy_version 1708265 (0.0006) [2023-12-26 13:14:08,842][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001708272_437321728.pth... [2023-12-26 13:14:08,846][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001707248_437059584.pth [2023-12-26 13:14:08,857][123090] Updated weights for policy 1, policy_version 1696981 (0.0008) [2023-12-26 13:14:08,924][123090] Updated weights for policy 1, policy_version 1696991 (0.0008) [2023-12-26 13:14:08,929][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001696992_434429952.pth... [2023-12-26 13:14:08,933][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001695936_434159616.pth [2023-12-26 13:14:09,611][123091] Updated weights for policy 0, policy_version 1708275 (0.0006) [2023-12-26 13:14:09,674][123091] Updated weights for policy 0, policy_version 1708285 (0.0005) [2023-12-26 13:14:09,727][123091] Updated weights for policy 0, policy_version 1708295 (0.0006) [2023-12-26 13:14:09,785][123090] Updated weights for policy 1, policy_version 1697001 (0.0010) [2023-12-26 13:14:09,852][123090] Updated weights for policy 1, policy_version 1697011 (0.0009) [2023-12-26 13:14:09,916][123090] Updated weights for policy 1, policy_version 1697021 (0.0008) [2023-12-26 13:14:10,514][123091] Updated weights for policy 0, policy_version 1708305 (0.0006) [2023-12-26 13:14:10,573][123091] Updated weights for policy 0, policy_version 1708315 (0.0009) [2023-12-26 13:14:10,627][123091] Updated weights for policy 0, policy_version 1708325 (0.0009) [2023-12-26 13:14:10,682][123091] Updated weights for policy 0, policy_version 1708335 (0.0009) [2023-12-26 13:14:10,772][123090] Updated weights for policy 1, policy_version 1697031 (0.0010) [2023-12-26 13:14:10,842][123090] Updated weights for policy 1, policy_version 1697041 (0.0010) [2023-12-26 13:14:10,912][123090] Updated weights for policy 1, policy_version 1697051 (0.0009) [2023-12-26 13:14:11,470][123091] Updated weights for policy 0, policy_version 1708345 (0.0011) [2023-12-26 13:14:11,537][123091] Updated weights for policy 0, policy_version 1708355 (0.0007) [2023-12-26 13:14:11,605][123091] Updated weights for policy 0, policy_version 1708365 (0.0008) [2023-12-26 13:14:11,759][123090] Updated weights for policy 1, policy_version 1697061 (0.0010) [2023-12-26 13:14:11,828][123090] Updated weights for policy 1, policy_version 1697071 (0.0010) [2023-12-26 13:14:11,895][123090] Updated weights for policy 1, policy_version 1697081 (0.0009) [2023-12-26 13:14:12,449][123091] Updated weights for policy 0, policy_version 1708375 (0.0008) [2023-12-26 13:14:12,515][123091] Updated weights for policy 0, policy_version 1708385 (0.0008) [2023-12-26 13:14:12,584][123091] Updated weights for policy 0, policy_version 1708395 (0.0008) [2023-12-26 13:14:12,733][123090] Updated weights for policy 1, policy_version 1697091 (0.0010) [2023-12-26 13:14:12,797][123090] Updated weights for policy 1, policy_version 1697101 (0.0010) [2023-12-26 13:14:12,867][123090] Updated weights for policy 1, policy_version 1697111 (0.0007) [2023-12-26 13:14:13,344][123091] Updated weights for policy 0, policy_version 1708405 (0.0009) [2023-12-26 13:14:13,398][123091] Updated weights for policy 0, policy_version 1708415 (0.0008) [2023-12-26 13:14:13,456][123091] Updated weights for policy 0, policy_version 1708425 (0.0009) [2023-12-26 13:14:13,689][123090] Updated weights for policy 1, policy_version 1697121 (0.0008) [2023-12-26 13:14:13,749][123090] Updated weights for policy 1, policy_version 1697131 (0.0008) [2023-12-26 13:14:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 871825408. Throughput: 0: 8764.4, 1: 8839.6. Samples: 871823348. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:14:13,784][121949] Avg episode reward: [(0, '6176.705'), (1, '5538.849')] [2023-12-26 13:14:13,810][123090] Updated weights for policy 1, policy_version 1697141 (0.0009) [2023-12-26 13:14:13,877][123090] Updated weights for policy 1, policy_version 1697151 (0.0009) [2023-12-26 13:14:14,264][123091] Updated weights for policy 0, policy_version 1708435 (0.0010) [2023-12-26 13:14:14,314][123091] Updated weights for policy 0, policy_version 1708445 (0.0010) [2023-12-26 13:14:14,369][123091] Updated weights for policy 0, policy_version 1708455 (0.0010) [2023-12-26 13:14:14,725][123090] Updated weights for policy 1, policy_version 1697161 (0.0006) [2023-12-26 13:14:14,779][123090] Updated weights for policy 1, policy_version 1697171 (0.0007) [2023-12-26 13:14:14,845][123090] Updated weights for policy 1, policy_version 1697181 (0.0007) [2023-12-26 13:14:15,134][123091] Updated weights for policy 0, policy_version 1708465 (0.0010) [2023-12-26 13:14:15,191][123091] Updated weights for policy 0, policy_version 1708475 (0.0011) [2023-12-26 13:14:15,248][123091] Updated weights for policy 0, policy_version 1708485 (0.0011) [2023-12-26 13:14:15,300][123091] Updated weights for policy 0, policy_version 1708495 (0.0011) [2023-12-26 13:14:15,670][123090] Updated weights for policy 1, policy_version 1697191 (0.0009) [2023-12-26 13:14:15,723][123090] Updated weights for policy 1, policy_version 1697201 (0.0009) [2023-12-26 13:14:15,781][123090] Updated weights for policy 1, policy_version 1697211 (0.0009) [2023-12-26 13:14:16,130][123091] Updated weights for policy 0, policy_version 1708505 (0.0011) [2023-12-26 13:14:16,187][123091] Updated weights for policy 0, policy_version 1708515 (0.0010) [2023-12-26 13:14:16,246][123091] Updated weights for policy 0, policy_version 1708525 (0.0006) [2023-12-26 13:14:16,628][123090] Updated weights for policy 1, policy_version 1697221 (0.0009) [2023-12-26 13:14:16,698][123090] Updated weights for policy 1, policy_version 1697231 (0.0009) [2023-12-26 13:14:16,766][123090] Updated weights for policy 1, policy_version 1697241 (0.0010) [2023-12-26 13:14:16,974][123091] Updated weights for policy 0, policy_version 1708535 (0.0006) [2023-12-26 13:14:17,025][123091] Updated weights for policy 0, policy_version 1708545 (0.0006) [2023-12-26 13:14:17,084][123091] Updated weights for policy 0, policy_version 1708555 (0.0008) [2023-12-26 13:14:17,550][123090] Updated weights for policy 1, policy_version 1697251 (0.0010) [2023-12-26 13:14:17,610][123090] Updated weights for policy 1, policy_version 1697261 (0.0009) [2023-12-26 13:14:17,658][123090] Updated weights for policy 1, policy_version 1697271 (0.0009) [2023-12-26 13:14:17,853][123091] Updated weights for policy 0, policy_version 1708565 (0.0011) [2023-12-26 13:14:17,917][123091] Updated weights for policy 0, policy_version 1708575 (0.0007) [2023-12-26 13:14:17,976][123091] Updated weights for policy 0, policy_version 1708585 (0.0009) [2023-12-26 13:14:18,525][123090] Updated weights for policy 1, policy_version 1697281 (0.0009) [2023-12-26 13:14:18,597][123090] Updated weights for policy 1, policy_version 1697291 (0.0006) [2023-12-26 13:14:18,668][123090] Updated weights for policy 1, policy_version 1697301 (0.0006) [2023-12-26 13:14:18,742][123090] Updated weights for policy 1, policy_version 1697311 (0.0007) [2023-12-26 13:14:18,771][123091] Updated weights for policy 0, policy_version 1708595 (0.0009) [2023-12-26 13:14:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 871915520. Throughput: 0: 8743.6, 1: 8803.0. Samples: 871928312. Policy #0 lag: (min: 7.0, avg: 31.2, max: 33.0) [2023-12-26 13:14:18,785][121949] Avg episode reward: [(0, '6170.379'), (1, '5532.233')] [2023-12-26 13:14:18,837][123091] Updated weights for policy 0, policy_version 1708605 (0.0011) [2023-12-26 13:14:18,909][123091] Updated weights for policy 0, policy_version 1708615 (0.0008) [2023-12-26 13:14:19,418][123090] Updated weights for policy 1, policy_version 1697321 (0.0009) [2023-12-26 13:14:19,475][123090] Updated weights for policy 1, policy_version 1697331 (0.0009) [2023-12-26 13:14:19,537][123090] Updated weights for policy 1, policy_version 1697341 (0.0009) [2023-12-26 13:14:19,655][123091] Updated weights for policy 0, policy_version 1708625 (0.0006) [2023-12-26 13:14:19,718][123091] Updated weights for policy 0, policy_version 1708635 (0.0011) [2023-12-26 13:14:19,777][123091] Updated weights for policy 0, policy_version 1708645 (0.0005) [2023-12-26 13:14:19,849][123091] Updated weights for policy 0, policy_version 1708655 (0.0009) [2023-12-26 13:14:20,365][123090] Updated weights for policy 1, policy_version 1697351 (0.0007) [2023-12-26 13:14:20,416][123090] Updated weights for policy 1, policy_version 1697361 (0.0006) [2023-12-26 13:14:20,477][123090] Updated weights for policy 1, policy_version 1697371 (0.0009) [2023-12-26 13:14:20,665][123091] Updated weights for policy 0, policy_version 1708665 (0.0011) [2023-12-26 13:14:20,726][123091] Updated weights for policy 0, policy_version 1708675 (0.0011) [2023-12-26 13:14:20,787][123091] Updated weights for policy 0, policy_version 1708685 (0.0011) [2023-12-26 13:14:21,303][123090] Updated weights for policy 1, policy_version 1697381 (0.0009) [2023-12-26 13:14:21,372][123090] Updated weights for policy 1, policy_version 1697391 (0.0010) [2023-12-26 13:14:21,434][123090] Updated weights for policy 1, policy_version 1697401 (0.0006) [2023-12-26 13:14:21,672][123091] Updated weights for policy 0, policy_version 1708695 (0.0010) [2023-12-26 13:14:21,737][123091] Updated weights for policy 0, policy_version 1708705 (0.0009) [2023-12-26 13:14:21,807][123091] Updated weights for policy 0, policy_version 1708715 (0.0005) [2023-12-26 13:14:22,293][123090] Updated weights for policy 1, policy_version 1697411 (0.0008) [2023-12-26 13:14:22,363][123090] Updated weights for policy 1, policy_version 1697421 (0.0010) [2023-12-26 13:14:22,442][123090] Updated weights for policy 1, policy_version 1697431 (0.0008) [2023-12-26 13:14:22,584][123091] Updated weights for policy 0, policy_version 1708725 (0.0010) [2023-12-26 13:14:22,638][123091] Updated weights for policy 0, policy_version 1708735 (0.0009) [2023-12-26 13:14:22,693][123091] Updated weights for policy 0, policy_version 1708745 (0.0010) [2023-12-26 13:14:23,355][123090] Updated weights for policy 1, policy_version 1697441 (0.0010) [2023-12-26 13:14:23,410][123090] Updated weights for policy 1, policy_version 1697451 (0.0010) [2023-12-26 13:14:23,450][123091] Updated weights for policy 0, policy_version 1708755 (0.0009) [2023-12-26 13:14:23,462][123090] Updated weights for policy 1, policy_version 1697461 (0.0008) [2023-12-26 13:14:23,510][123090] Updated weights for policy 1, policy_version 1697471 (0.0009) [2023-12-26 13:14:23,513][123091] Updated weights for policy 0, policy_version 1708765 (0.0008) [2023-12-26 13:14:23,575][123091] Updated weights for policy 0, policy_version 1708775 (0.0009) [2023-12-26 13:14:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 872005632. Throughput: 0: 8774.6, 1: 8729.4. Samples: 871980056. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:23,785][121949] Avg episode reward: [(0, '6150.963'), (1, '5795.178')] [2023-12-26 13:14:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001697472_434552832.pth... [2023-12-26 13:14:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001708784_437452800.pth... [2023-12-26 13:14:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001696448_434290688.pth [2023-12-26 13:14:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001707760_437190656.pth [2023-12-26 13:14:24,273][123090] Updated weights for policy 1, policy_version 1697481 (0.0005) [2023-12-26 13:14:24,325][123090] Updated weights for policy 1, policy_version 1697491 (0.0005) [2023-12-26 13:14:24,381][123090] Updated weights for policy 1, policy_version 1697501 (0.0006) [2023-12-26 13:14:24,454][123091] Updated weights for policy 0, policy_version 1708785 (0.0010) [2023-12-26 13:14:24,507][123091] Updated weights for policy 0, policy_version 1708795 (0.0009) [2023-12-26 13:14:24,568][123091] Updated weights for policy 0, policy_version 1708805 (0.0009) [2023-12-26 13:14:24,631][123091] Updated weights for policy 0, policy_version 1708815 (0.0010) [2023-12-26 13:14:25,171][123090] Updated weights for policy 1, policy_version 1697511 (0.0009) [2023-12-26 13:14:25,223][123090] Updated weights for policy 1, policy_version 1697521 (0.0009) [2023-12-26 13:14:25,277][123090] Updated weights for policy 1, policy_version 1697531 (0.0009) [2023-12-26 13:14:25,413][123091] Updated weights for policy 0, policy_version 1708825 (0.0009) [2023-12-26 13:14:25,463][123091] Updated weights for policy 0, policy_version 1708835 (0.0009) [2023-12-26 13:14:25,510][123091] Updated weights for policy 0, policy_version 1708845 (0.0008) [2023-12-26 13:14:26,024][123090] Updated weights for policy 1, policy_version 1697541 (0.0006) [2023-12-26 13:14:26,091][123090] Updated weights for policy 1, policy_version 1697551 (0.0008) [2023-12-26 13:14:26,149][123090] Updated weights for policy 1, policy_version 1697561 (0.0009) [2023-12-26 13:14:26,368][123091] Updated weights for policy 0, policy_version 1708855 (0.0009) [2023-12-26 13:14:26,420][123091] Updated weights for policy 0, policy_version 1708865 (0.0009) [2023-12-26 13:14:26,478][123091] Updated weights for policy 0, policy_version 1708875 (0.0010) [2023-12-26 13:14:26,910][123090] Updated weights for policy 1, policy_version 1697571 (0.0009) [2023-12-26 13:14:26,962][123090] Updated weights for policy 1, policy_version 1697581 (0.0009) [2023-12-26 13:14:27,016][123090] Updated weights for policy 1, policy_version 1697591 (0.0009) [2023-12-26 13:14:27,342][123091] Updated weights for policy 0, policy_version 1708885 (0.0010) [2023-12-26 13:14:27,395][123091] Updated weights for policy 0, policy_version 1708896 (0.0010) [2023-12-26 13:14:27,447][123091] Updated weights for policy 0, policy_version 1708906 (0.0009) [2023-12-26 13:14:27,782][123090] Updated weights for policy 1, policy_version 1697601 (0.0009) [2023-12-26 13:14:27,844][123090] Updated weights for policy 1, policy_version 1697611 (0.0008) [2023-12-26 13:14:27,905][123090] Updated weights for policy 1, policy_version 1697621 (0.0007) [2023-12-26 13:14:27,964][123090] Updated weights for policy 1, policy_version 1697631 (0.0005) [2023-12-26 13:14:28,351][123091] Updated weights for policy 0, policy_version 1708916 (0.0009) [2023-12-26 13:14:28,410][123091] Updated weights for policy 0, policy_version 1708926 (0.0010) [2023-12-26 13:14:28,476][123091] Updated weights for policy 0, policy_version 1708936 (0.0009) [2023-12-26 13:14:28,635][123090] Updated weights for policy 1, policy_version 1697641 (0.0008) [2023-12-26 13:14:28,702][123090] Updated weights for policy 1, policy_version 1697651 (0.0010) [2023-12-26 13:14:28,768][123090] Updated weights for policy 1, policy_version 1697661 (0.0009) [2023-12-26 13:14:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 872087552. Throughput: 0: 8792.6, 1: 8736.2. Samples: 872084576. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:28,785][121949] Avg episode reward: [(0, '6113.181'), (1, '5649.100')] [2023-12-26 13:14:29,295][123091] Updated weights for policy 0, policy_version 1708946 (0.0009) [2023-12-26 13:14:29,358][123091] Updated weights for policy 0, policy_version 1708956 (0.0010) [2023-12-26 13:14:29,421][123091] Updated weights for policy 0, policy_version 1708966 (0.0009) [2023-12-26 13:14:29,485][123091] Updated weights for policy 0, policy_version 1708976 (0.0008) [2023-12-26 13:14:29,594][123090] Updated weights for policy 1, policy_version 1697671 (0.0010) [2023-12-26 13:14:29,648][123090] Updated weights for policy 1, policy_version 1697681 (0.0009) [2023-12-26 13:14:29,712][123090] Updated weights for policy 1, policy_version 1697691 (0.0010) [2023-12-26 13:14:30,223][123091] Updated weights for policy 0, policy_version 1708986 (0.0011) [2023-12-26 13:14:30,286][123091] Updated weights for policy 0, policy_version 1708996 (0.0010) [2023-12-26 13:14:30,340][123091] Updated weights for policy 0, policy_version 1709006 (0.0006) [2023-12-26 13:14:30,617][123090] Updated weights for policy 1, policy_version 1697701 (0.0009) [2023-12-26 13:14:30,684][123090] Updated weights for policy 1, policy_version 1697711 (0.0008) [2023-12-26 13:14:30,748][123090] Updated weights for policy 1, policy_version 1697721 (0.0009) [2023-12-26 13:14:31,132][123091] Updated weights for policy 0, policy_version 1709016 (0.0010) [2023-12-26 13:14:31,195][123091] Updated weights for policy 0, policy_version 1709026 (0.0007) [2023-12-26 13:14:31,253][123091] Updated weights for policy 0, policy_version 1709036 (0.0011) [2023-12-26 13:14:31,480][123090] Updated weights for policy 1, policy_version 1697731 (0.0006) [2023-12-26 13:14:31,536][123090] Updated weights for policy 1, policy_version 1697741 (0.0005) [2023-12-26 13:14:31,591][123090] Updated weights for policy 1, policy_version 1697751 (0.0006) [2023-12-26 13:14:32,051][123091] Updated weights for policy 0, policy_version 1709046 (0.0010) [2023-12-26 13:14:32,099][123091] Updated weights for policy 0, policy_version 1709056 (0.0009) [2023-12-26 13:14:32,150][123091] Updated weights for policy 0, policy_version 1709066 (0.0008) [2023-12-26 13:14:32,403][123090] Updated weights for policy 1, policy_version 1697761 (0.0007) [2023-12-26 13:14:32,457][123090] Updated weights for policy 1, policy_version 1697771 (0.0009) [2023-12-26 13:14:32,511][123090] Updated weights for policy 1, policy_version 1697781 (0.0009) [2023-12-26 13:14:32,561][123090] Updated weights for policy 1, policy_version 1697791 (0.0008) [2023-12-26 13:14:32,909][123091] Updated weights for policy 0, policy_version 1709076 (0.0005) [2023-12-26 13:14:32,980][123091] Updated weights for policy 0, policy_version 1709086 (0.0006) [2023-12-26 13:14:33,048][123091] Updated weights for policy 0, policy_version 1709096 (0.0006) [2023-12-26 13:14:33,404][123090] Updated weights for policy 1, policy_version 1697801 (0.0008) [2023-12-26 13:14:33,471][123090] Updated weights for policy 1, policy_version 1697811 (0.0006) [2023-12-26 13:14:33,528][123090] Updated weights for policy 1, policy_version 1697821 (0.0006) [2023-12-26 13:14:33,690][123091] Updated weights for policy 0, policy_version 1709106 (0.0006) [2023-12-26 13:14:33,759][123091] Updated weights for policy 0, policy_version 1709116 (0.0005) [2023-12-26 13:14:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 872177664. Throughput: 0: 8801.5, 1: 8731.3. Samples: 872191988. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:33,785][121949] Avg episode reward: [(0, '6092.281'), (1, '5521.942')] [2023-12-26 13:14:33,827][123091] Updated weights for policy 0, policy_version 1709126 (0.0005) [2023-12-26 13:14:33,883][123091] Updated weights for policy 0, policy_version 1709136 (0.0005) [2023-12-26 13:14:34,155][123090] Updated weights for policy 1, policy_version 1697831 (0.0007) [2023-12-26 13:14:34,218][123090] Updated weights for policy 1, policy_version 1697841 (0.0006) [2023-12-26 13:14:34,291][123090] Updated weights for policy 1, policy_version 1697851 (0.0009) [2023-12-26 13:14:34,577][123091] Updated weights for policy 0, policy_version 1709146 (0.0010) [2023-12-26 13:14:34,643][123091] Updated weights for policy 0, policy_version 1709156 (0.0010) [2023-12-26 13:14:34,705][123091] Updated weights for policy 0, policy_version 1709166 (0.0009) [2023-12-26 13:14:35,092][123090] Updated weights for policy 1, policy_version 1697861 (0.0007) [2023-12-26 13:14:35,142][123090] Updated weights for policy 1, policy_version 1697871 (0.0005) [2023-12-26 13:14:35,194][123090] Updated weights for policy 1, policy_version 1697881 (0.0006) [2023-12-26 13:14:35,464][123091] Updated weights for policy 0, policy_version 1709176 (0.0006) [2023-12-26 13:14:35,533][123091] Updated weights for policy 0, policy_version 1709186 (0.0005) [2023-12-26 13:14:35,589][123091] Updated weights for policy 0, policy_version 1709196 (0.0005) [2023-12-26 13:14:36,093][123090] Updated weights for policy 1, policy_version 1697891 (0.0009) [2023-12-26 13:14:36,166][123090] Updated weights for policy 1, policy_version 1697901 (0.0008) [2023-12-26 13:14:36,228][123090] Updated weights for policy 1, policy_version 1697911 (0.0010) [2023-12-26 13:14:36,262][123091] Updated weights for policy 0, policy_version 1709206 (0.0007) [2023-12-26 13:14:36,319][123091] Updated weights for policy 0, policy_version 1709216 (0.0011) [2023-12-26 13:14:36,383][123091] Updated weights for policy 0, policy_version 1709226 (0.0011) [2023-12-26 13:14:37,108][123090] Updated weights for policy 1, policy_version 1697921 (0.0007) [2023-12-26 13:14:37,153][123091] Updated weights for policy 0, policy_version 1709236 (0.0009) [2023-12-26 13:14:37,170][123090] Updated weights for policy 1, policy_version 1697931 (0.0010) [2023-12-26 13:14:37,207][123091] Updated weights for policy 0, policy_version 1709246 (0.0005) [2023-12-26 13:14:37,238][123090] Updated weights for policy 1, policy_version 1697941 (0.0008) [2023-12-26 13:14:37,262][123091] Updated weights for policy 0, policy_version 1709256 (0.0005) [2023-12-26 13:14:37,309][123090] Updated weights for policy 1, policy_version 1697951 (0.0010) [2023-12-26 13:14:37,860][123091] Updated weights for policy 0, policy_version 1709266 (0.0006) [2023-12-26 13:14:37,929][123091] Updated weights for policy 0, policy_version 1709276 (0.0005) [2023-12-26 13:14:37,987][123091] Updated weights for policy 0, policy_version 1709286 (0.0005) [2023-12-26 13:14:38,054][123091] Updated weights for policy 0, policy_version 1709296 (0.0006) [2023-12-26 13:14:38,203][123090] Updated weights for policy 1, policy_version 1697961 (0.0009) [2023-12-26 13:14:38,268][123090] Updated weights for policy 1, policy_version 1697971 (0.0009) [2023-12-26 13:14:38,339][123090] Updated weights for policy 1, policy_version 1697981 (0.0009) [2023-12-26 13:14:38,703][123091] Updated weights for policy 0, policy_version 1709306 (0.0010) [2023-12-26 13:14:38,775][123091] Updated weights for policy 0, policy_version 1709316 (0.0009) [2023-12-26 13:14:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17772.5). Total num frames: 872267776. Throughput: 0: 8850.7, 1: 8755.0. Samples: 872247228. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:38,784][121949] Avg episode reward: [(0, '6120.191'), (1, '5517.067')] [2023-12-26 13:14:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001697984_434683904.pth... [2023-12-26 13:14:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001696992_434429952.pth [2023-12-26 13:14:38,846][123091] Updated weights for policy 0, policy_version 1709326 (0.0010) [2023-12-26 13:14:38,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001709328_437592064.pth... [2023-12-26 13:14:38,867][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001708272_437321728.pth [2023-12-26 13:14:39,184][123090] Updated weights for policy 1, policy_version 1697991 (0.0009) [2023-12-26 13:14:39,255][123090] Updated weights for policy 1, policy_version 1698001 (0.0009) [2023-12-26 13:14:39,317][123090] Updated weights for policy 1, policy_version 1698011 (0.0009) [2023-12-26 13:14:39,689][123091] Updated weights for policy 0, policy_version 1709336 (0.0009) [2023-12-26 13:14:39,756][123091] Updated weights for policy 0, policy_version 1709346 (0.0009) [2023-12-26 13:14:39,823][123091] Updated weights for policy 0, policy_version 1709356 (0.0009) [2023-12-26 13:14:40,104][123090] Updated weights for policy 1, policy_version 1698021 (0.0008) [2023-12-26 13:14:40,156][123090] Updated weights for policy 1, policy_version 1698031 (0.0008) [2023-12-26 13:14:40,212][123090] Updated weights for policy 1, policy_version 1698041 (0.0008) [2023-12-26 13:14:40,631][123091] Updated weights for policy 0, policy_version 1709366 (0.0010) [2023-12-26 13:14:40,690][123091] Updated weights for policy 0, policy_version 1709377 (0.0010) [2023-12-26 13:14:40,748][123091] Updated weights for policy 0, policy_version 1709387 (0.0010) [2023-12-26 13:14:40,968][123090] Updated weights for policy 1, policy_version 1698051 (0.0008) [2023-12-26 13:14:41,036][123090] Updated weights for policy 1, policy_version 1698061 (0.0007) [2023-12-26 13:14:41,106][123090] Updated weights for policy 1, policy_version 1698071 (0.0009) [2023-12-26 13:14:41,613][123091] Updated weights for policy 0, policy_version 1709397 (0.0010) [2023-12-26 13:14:41,690][123091] Updated weights for policy 0, policy_version 1709407 (0.0010) [2023-12-26 13:14:41,767][123091] Updated weights for policy 0, policy_version 1709417 (0.0010) [2023-12-26 13:14:41,831][123090] Updated weights for policy 1, policy_version 1698081 (0.0008) [2023-12-26 13:14:41,897][123090] Updated weights for policy 1, policy_version 1698091 (0.0009) [2023-12-26 13:14:41,969][123090] Updated weights for policy 1, policy_version 1698101 (0.0009) [2023-12-26 13:14:42,037][123090] Updated weights for policy 1, policy_version 1698111 (0.0009) [2023-12-26 13:14:42,579][123091] Updated weights for policy 0, policy_version 1709427 (0.0010) [2023-12-26 13:14:42,636][123091] Updated weights for policy 0, policy_version 1709438 (0.0009) [2023-12-26 13:14:42,693][123091] Updated weights for policy 0, policy_version 1709449 (0.0010) [2023-12-26 13:14:42,858][123090] Updated weights for policy 1, policy_version 1698121 (0.0009) [2023-12-26 13:14:42,921][123090] Updated weights for policy 1, policy_version 1698131 (0.0008) [2023-12-26 13:14:42,983][123090] Updated weights for policy 1, policy_version 1698141 (0.0009) [2023-12-26 13:14:43,564][123091] Updated weights for policy 0, policy_version 1709460 (0.0010) [2023-12-26 13:14:43,618][123091] Updated weights for policy 0, policy_version 1709470 (0.0010) [2023-12-26 13:14:43,676][123091] Updated weights for policy 0, policy_version 1709480 (0.0010) [2023-12-26 13:14:43,744][123090] Updated weights for policy 1, policy_version 1698151 (0.0007) [2023-12-26 13:14:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 872357888. Throughput: 0: 8864.0, 1: 8683.8. Samples: 872351756. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:43,785][121949] Avg episode reward: [(0, '6032.938'), (1, '5342.202')] [2023-12-26 13:14:43,799][123090] Updated weights for policy 1, policy_version 1698161 (0.0009) [2023-12-26 13:14:43,855][123090] Updated weights for policy 1, policy_version 1698171 (0.0009) [2023-12-26 13:14:44,538][123091] Updated weights for policy 0, policy_version 1709490 (0.0010) [2023-12-26 13:14:44,601][123091] Updated weights for policy 0, policy_version 1709500 (0.0009) [2023-12-26 13:14:44,663][123091] Updated weights for policy 0, policy_version 1709510 (0.0009) [2023-12-26 13:14:44,689][123090] Updated weights for policy 1, policy_version 1698181 (0.0008) [2023-12-26 13:14:44,713][123091] Updated weights for policy 0, policy_version 1709520 (0.0008) [2023-12-26 13:14:44,736][123090] Updated weights for policy 1, policy_version 1698191 (0.0008) [2023-12-26 13:14:44,794][123090] Updated weights for policy 1, policy_version 1698201 (0.0008) [2023-12-26 13:14:45,576][123091] Updated weights for policy 0, policy_version 1709530 (0.0009) [2023-12-26 13:14:45,634][123091] Updated weights for policy 0, policy_version 1709540 (0.0010) [2023-12-26 13:14:45,648][123090] Updated weights for policy 1, policy_version 1698211 (0.0009) [2023-12-26 13:14:45,701][123091] Updated weights for policy 0, policy_version 1709550 (0.0009) [2023-12-26 13:14:45,713][123090] Updated weights for policy 1, policy_version 1698221 (0.0007) [2023-12-26 13:14:45,780][123090] Updated weights for policy 1, policy_version 1698231 (0.0009) [2023-12-26 13:14:46,530][123091] Updated weights for policy 0, policy_version 1709560 (0.0006) [2023-12-26 13:14:46,599][123091] Updated weights for policy 0, policy_version 1709570 (0.0005) [2023-12-26 13:14:46,619][123090] Updated weights for policy 1, policy_version 1698241 (0.0008) [2023-12-26 13:14:46,666][123091] Updated weights for policy 0, policy_version 1709580 (0.0005) [2023-12-26 13:14:46,683][123090] Updated weights for policy 1, policy_version 1698251 (0.0009) [2023-12-26 13:14:46,746][123090] Updated weights for policy 1, policy_version 1698261 (0.0010) [2023-12-26 13:14:46,805][123090] Updated weights for policy 1, policy_version 1698271 (0.0009) [2023-12-26 13:14:47,394][123091] Updated weights for policy 0, policy_version 1709590 (0.0005) [2023-12-26 13:14:47,460][123091] Updated weights for policy 0, policy_version 1709600 (0.0010) [2023-12-26 13:14:47,522][123091] Updated weights for policy 0, policy_version 1709610 (0.0009) [2023-12-26 13:14:47,525][123090] Updated weights for policy 1, policy_version 1698281 (0.0008) [2023-12-26 13:14:47,579][123090] Updated weights for policy 1, policy_version 1698291 (0.0007) [2023-12-26 13:14:47,627][123090] Updated weights for policy 1, policy_version 1698301 (0.0009) [2023-12-26 13:14:48,259][123091] Updated weights for policy 0, policy_version 1709620 (0.0010) [2023-12-26 13:14:48,323][123091] Updated weights for policy 0, policy_version 1709630 (0.0010) [2023-12-26 13:14:48,391][123091] Updated weights for policy 0, policy_version 1709640 (0.0008) [2023-12-26 13:14:48,516][123090] Updated weights for policy 1, policy_version 1698311 (0.0010) [2023-12-26 13:14:48,583][123090] Updated weights for policy 1, policy_version 1698321 (0.0009) [2023-12-26 13:14:48,647][123090] Updated weights for policy 1, policy_version 1698331 (0.0009) [2023-12-26 13:14:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 872448000. Throughput: 0: 8868.8, 1: 8632.5. Samples: 872455788. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:48,785][121949] Avg episode reward: [(0, '5981.129'), (1, '5367.116')] [2023-12-26 13:14:49,148][123091] Updated weights for policy 0, policy_version 1709650 (0.0009) [2023-12-26 13:14:49,209][123091] Updated weights for policy 0, policy_version 1709660 (0.0010) [2023-12-26 13:14:49,269][123091] Updated weights for policy 0, policy_version 1709670 (0.0009) [2023-12-26 13:14:49,330][123091] Updated weights for policy 0, policy_version 1709680 (0.0011) [2023-12-26 13:14:49,496][123090] Updated weights for policy 1, policy_version 1698341 (0.0008) [2023-12-26 13:14:49,546][123090] Updated weights for policy 1, policy_version 1698351 (0.0009) [2023-12-26 13:14:49,603][123090] Updated weights for policy 1, policy_version 1698361 (0.0009) [2023-12-26 13:14:50,143][123091] Updated weights for policy 0, policy_version 1709690 (0.0011) [2023-12-26 13:14:50,202][123091] Updated weights for policy 0, policy_version 1709700 (0.0011) [2023-12-26 13:14:50,255][123091] Updated weights for policy 0, policy_version 1709710 (0.0011) [2023-12-26 13:14:50,472][123090] Updated weights for policy 1, policy_version 1698371 (0.0007) [2023-12-26 13:14:50,542][123090] Updated weights for policy 1, policy_version 1698381 (0.0005) [2023-12-26 13:14:50,606][123090] Updated weights for policy 1, policy_version 1698391 (0.0008) [2023-12-26 13:14:51,052][123091] Updated weights for policy 0, policy_version 1709720 (0.0010) [2023-12-26 13:14:51,119][123091] Updated weights for policy 0, policy_version 1709730 (0.0011) [2023-12-26 13:14:51,184][123091] Updated weights for policy 0, policy_version 1709740 (0.0009) [2023-12-26 13:14:51,384][123090] Updated weights for policy 1, policy_version 1698401 (0.0008) [2023-12-26 13:14:51,443][123090] Updated weights for policy 1, policy_version 1698411 (0.0010) [2023-12-26 13:14:51,495][123090] Updated weights for policy 1, policy_version 1698421 (0.0009) [2023-12-26 13:14:51,569][123090] Updated weights for policy 1, policy_version 1698431 (0.0009) [2023-12-26 13:14:51,963][123091] Updated weights for policy 0, policy_version 1709750 (0.0006) [2023-12-26 13:14:52,038][123091] Updated weights for policy 0, policy_version 1709760 (0.0006) [2023-12-26 13:14:52,113][123091] Updated weights for policy 0, policy_version 1709770 (0.0006) [2023-12-26 13:14:52,504][123090] Updated weights for policy 1, policy_version 1698441 (0.0010) [2023-12-26 13:14:52,570][123090] Updated weights for policy 1, policy_version 1698451 (0.0010) [2023-12-26 13:14:52,634][123090] Updated weights for policy 1, policy_version 1698461 (0.0009) [2023-12-26 13:14:52,774][123091] Updated weights for policy 0, policy_version 1709780 (0.0007) [2023-12-26 13:14:52,827][123091] Updated weights for policy 0, policy_version 1709790 (0.0005) [2023-12-26 13:14:52,893][123091] Updated weights for policy 0, policy_version 1709800 (0.0006) [2023-12-26 13:14:53,422][123090] Updated weights for policy 1, policy_version 1698471 (0.0006) [2023-12-26 13:14:53,471][123090] Updated weights for policy 1, policy_version 1698481 (0.0005) [2023-12-26 13:14:53,531][123090] Updated weights for policy 1, policy_version 1698491 (0.0005) [2023-12-26 13:14:53,577][123091] Updated weights for policy 0, policy_version 1709810 (0.0006) [2023-12-26 13:14:53,638][123091] Updated weights for policy 0, policy_version 1709820 (0.0005) [2023-12-26 13:14:53,684][123091] Updated weights for policy 0, policy_version 1709830 (0.0005) [2023-12-26 13:14:53,747][123091] Updated weights for policy 0, policy_version 1709840 (0.0005) [2023-12-26 13:14:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 872538112. Throughput: 0: 8870.0, 1: 8610.5. Samples: 872507264. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:53,785][121949] Avg episode reward: [(0, '6059.790'), (1, '5269.778')] [2023-12-26 13:14:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001709840_437723136.pth... [2023-12-26 13:14:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001698496_434814976.pth... [2023-12-26 13:14:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001708784_437452800.pth [2023-12-26 13:14:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001697472_434552832.pth [2023-12-26 13:14:54,178][123090] Updated weights for policy 1, policy_version 1698501 (0.0008) [2023-12-26 13:14:54,245][123090] Updated weights for policy 1, policy_version 1698511 (0.0011) [2023-12-26 13:14:54,312][123090] Updated weights for policy 1, policy_version 1698521 (0.0010) [2023-12-26 13:14:54,519][123091] Updated weights for policy 0, policy_version 1709850 (0.0011) [2023-12-26 13:14:54,581][123091] Updated weights for policy 0, policy_version 1709860 (0.0010) [2023-12-26 13:14:54,633][123091] Updated weights for policy 0, policy_version 1709870 (0.0010) [2023-12-26 13:14:54,983][123090] Updated weights for policy 1, policy_version 1698531 (0.0006) [2023-12-26 13:14:55,044][123090] Updated weights for policy 1, policy_version 1698541 (0.0006) [2023-12-26 13:14:55,108][123090] Updated weights for policy 1, policy_version 1698551 (0.0005) [2023-12-26 13:14:55,466][123091] Updated weights for policy 0, policy_version 1709880 (0.0011) [2023-12-26 13:14:55,515][123091] Updated weights for policy 0, policy_version 1709890 (0.0005) [2023-12-26 13:14:55,575][123091] Updated weights for policy 0, policy_version 1709900 (0.0005) [2023-12-26 13:14:55,827][123090] Updated weights for policy 1, policy_version 1698561 (0.0008) [2023-12-26 13:14:55,896][123090] Updated weights for policy 1, policy_version 1698571 (0.0009) [2023-12-26 13:14:55,950][123090] Updated weights for policy 1, policy_version 1698581 (0.0010) [2023-12-26 13:14:55,994][123090] Updated weights for policy 1, policy_version 1698591 (0.0010) [2023-12-26 13:14:56,291][123091] Updated weights for policy 0, policy_version 1709910 (0.0007) [2023-12-26 13:14:56,345][123091] Updated weights for policy 0, policy_version 1709920 (0.0006) [2023-12-26 13:14:56,417][123091] Updated weights for policy 0, policy_version 1709930 (0.0005) [2023-12-26 13:14:56,835][123090] Updated weights for policy 1, policy_version 1698601 (0.0011) [2023-12-26 13:14:56,898][123090] Updated weights for policy 1, policy_version 1698611 (0.0011) [2023-12-26 13:14:56,951][123090] Updated weights for policy 1, policy_version 1698621 (0.0007) [2023-12-26 13:14:57,127][123091] Updated weights for policy 0, policy_version 1709940 (0.0009) [2023-12-26 13:14:57,187][123091] Updated weights for policy 0, policy_version 1709950 (0.0009) [2023-12-26 13:14:57,240][123091] Updated weights for policy 0, policy_version 1709960 (0.0010) [2023-12-26 13:14:57,691][123090] Updated weights for policy 1, policy_version 1698631 (0.0009) [2023-12-26 13:14:57,745][123090] Updated weights for policy 1, policy_version 1698641 (0.0010) [2023-12-26 13:14:57,800][123090] Updated weights for policy 1, policy_version 1698651 (0.0010) [2023-12-26 13:14:58,086][123091] Updated weights for policy 0, policy_version 1709971 (0.0010) [2023-12-26 13:14:58,146][123091] Updated weights for policy 0, policy_version 1709981 (0.0009) [2023-12-26 13:14:58,197][123091] Updated weights for policy 0, policy_version 1709991 (0.0009) [2023-12-26 13:14:58,599][123090] Updated weights for policy 1, policy_version 1698661 (0.0009) [2023-12-26 13:14:58,667][123090] Updated weights for policy 1, policy_version 1698671 (0.0008) [2023-12-26 13:14:58,744][123090] Updated weights for policy 1, policy_version 1698681 (0.0010) [2023-12-26 13:14:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 872620032. Throughput: 0: 8958.8, 1: 8732.6. Samples: 872619464. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:14:58,785][121949] Avg episode reward: [(0, '6066.594'), (1, '5560.696')] [2023-12-26 13:14:59,156][123091] Updated weights for policy 0, policy_version 1710001 (0.0009) [2023-12-26 13:14:59,231][123091] Updated weights for policy 0, policy_version 1710011 (0.0008) [2023-12-26 13:14:59,313][123091] Updated weights for policy 0, policy_version 1710021 (0.0008) [2023-12-26 13:14:59,386][123091] Updated weights for policy 0, policy_version 1710031 (0.0009) [2023-12-26 13:14:59,653][123090] Updated weights for policy 1, policy_version 1698691 (0.0008) [2023-12-26 13:14:59,713][123090] Updated weights for policy 1, policy_version 1698701 (0.0007) [2023-12-26 13:14:59,771][123090] Updated weights for policy 1, policy_version 1698711 (0.0009) [2023-12-26 13:15:00,185][123091] Updated weights for policy 0, policy_version 1710041 (0.0009) [2023-12-26 13:15:00,251][123091] Updated weights for policy 0, policy_version 1710051 (0.0009) [2023-12-26 13:15:00,309][123091] Updated weights for policy 0, policy_version 1710061 (0.0010) [2023-12-26 13:15:00,551][123090] Updated weights for policy 1, policy_version 1698721 (0.0009) [2023-12-26 13:15:00,615][123090] Updated weights for policy 1, policy_version 1698731 (0.0005) [2023-12-26 13:15:00,683][123090] Updated weights for policy 1, policy_version 1698741 (0.0005) [2023-12-26 13:15:00,744][123090] Updated weights for policy 1, policy_version 1698751 (0.0005) [2023-12-26 13:15:01,156][123091] Updated weights for policy 0, policy_version 1710071 (0.0009) [2023-12-26 13:15:01,206][123091] Updated weights for policy 0, policy_version 1710081 (0.0009) [2023-12-26 13:15:01,270][123091] Updated weights for policy 0, policy_version 1710091 (0.0009) [2023-12-26 13:15:01,511][123090] Updated weights for policy 1, policy_version 1698761 (0.0009) [2023-12-26 13:15:01,576][123090] Updated weights for policy 1, policy_version 1698771 (0.0010) [2023-12-26 13:15:01,648][123090] Updated weights for policy 1, policy_version 1698781 (0.0008) [2023-12-26 13:15:02,129][123091] Updated weights for policy 0, policy_version 1710101 (0.0009) [2023-12-26 13:15:02,179][123091] Updated weights for policy 0, policy_version 1710111 (0.0009) [2023-12-26 13:15:02,228][123091] Updated weights for policy 0, policy_version 1710121 (0.0009) [2023-12-26 13:15:02,501][123090] Updated weights for policy 1, policy_version 1698791 (0.0009) [2023-12-26 13:15:02,550][123090] Updated weights for policy 1, policy_version 1698801 (0.0009) [2023-12-26 13:15:02,597][123090] Updated weights for policy 1, policy_version 1698811 (0.0009) [2023-12-26 13:15:03,061][123091] Updated weights for policy 0, policy_version 1710132 (0.0009) [2023-12-26 13:15:03,125][123091] Updated weights for policy 0, policy_version 1710142 (0.0007) [2023-12-26 13:15:03,175][123091] Updated weights for policy 0, policy_version 1710152 (0.0010) [2023-12-26 13:15:03,445][123090] Updated weights for policy 1, policy_version 1698821 (0.0009) [2023-12-26 13:15:03,501][123090] Updated weights for policy 1, policy_version 1698831 (0.0009) [2023-12-26 13:15:03,565][123090] Updated weights for policy 1, policy_version 1698841 (0.0009) [2023-12-26 13:15:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 872710144. Throughput: 0: 8876.7, 1: 8744.3. Samples: 872721264. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:03,786][121949] Avg episode reward: [(0, '6040.131'), (1, '5955.133')] [2023-12-26 13:15:03,955][123091] Updated weights for policy 0, policy_version 1710162 (0.0009) [2023-12-26 13:15:04,012][123091] Updated weights for policy 0, policy_version 1710172 (0.0010) [2023-12-26 13:15:04,065][123091] Updated weights for policy 0, policy_version 1710182 (0.0010) [2023-12-26 13:15:04,131][123091] Updated weights for policy 0, policy_version 1710192 (0.0010) [2023-12-26 13:15:04,382][123090] Updated weights for policy 1, policy_version 1698851 (0.0009) [2023-12-26 13:15:04,440][123090] Updated weights for policy 1, policy_version 1698861 (0.0009) [2023-12-26 13:15:04,488][123090] Updated weights for policy 1, policy_version 1698871 (0.0009) [2023-12-26 13:15:04,963][123091] Updated weights for policy 0, policy_version 1710202 (0.0009) [2023-12-26 13:15:05,020][123091] Updated weights for policy 0, policy_version 1710212 (0.0009) [2023-12-26 13:15:05,069][123091] Updated weights for policy 0, policy_version 1710222 (0.0008) [2023-12-26 13:15:05,235][123090] Updated weights for policy 1, policy_version 1698881 (0.0009) [2023-12-26 13:15:05,291][123090] Updated weights for policy 1, policy_version 1698891 (0.0005) [2023-12-26 13:15:05,355][123090] Updated weights for policy 1, policy_version 1698901 (0.0005) [2023-12-26 13:15:05,412][123090] Updated weights for policy 1, policy_version 1698911 (0.0005) [2023-12-26 13:15:05,790][123091] Updated weights for policy 0, policy_version 1710232 (0.0005) [2023-12-26 13:15:05,845][123091] Updated weights for policy 0, policy_version 1710242 (0.0005) [2023-12-26 13:15:05,896][123091] Updated weights for policy 0, policy_version 1710252 (0.0005) [2023-12-26 13:15:06,124][123090] Updated weights for policy 1, policy_version 1698921 (0.0008) [2023-12-26 13:15:06,179][123090] Updated weights for policy 1, policy_version 1698931 (0.0009) [2023-12-26 13:15:06,237][123090] Updated weights for policy 1, policy_version 1698941 (0.0011) [2023-12-26 13:15:06,617][123091] Updated weights for policy 0, policy_version 1710262 (0.0009) [2023-12-26 13:15:06,681][123091] Updated weights for policy 0, policy_version 1710272 (0.0011) [2023-12-26 13:15:06,749][123091] Updated weights for policy 0, policy_version 1710282 (0.0011) [2023-12-26 13:15:07,085][123090] Updated weights for policy 1, policy_version 1698951 (0.0011) [2023-12-26 13:15:07,142][123090] Updated weights for policy 1, policy_version 1698961 (0.0010) [2023-12-26 13:15:07,194][123090] Updated weights for policy 1, policy_version 1698971 (0.0010) [2023-12-26 13:15:07,453][123091] Updated weights for policy 0, policy_version 1710292 (0.0011) [2023-12-26 13:15:07,517][123091] Updated weights for policy 0, policy_version 1710302 (0.0011) [2023-12-26 13:15:07,585][123091] Updated weights for policy 0, policy_version 1710312 (0.0009) [2023-12-26 13:15:07,997][123090] Updated weights for policy 1, policy_version 1698981 (0.0010) [2023-12-26 13:15:08,057][123090] Updated weights for policy 1, policy_version 1698991 (0.0009) [2023-12-26 13:15:08,124][123090] Updated weights for policy 1, policy_version 1699001 (0.0010) [2023-12-26 13:15:08,314][123091] Updated weights for policy 0, policy_version 1710322 (0.0006) [2023-12-26 13:15:08,379][123091] Updated weights for policy 0, policy_version 1710332 (0.0008) [2023-12-26 13:15:08,441][123091] Updated weights for policy 0, policy_version 1710342 (0.0009) [2023-12-26 13:15:08,491][123091] Updated weights for policy 0, policy_version 1710352 (0.0009) [2023-12-26 13:15:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 872800256. Throughput: 0: 8914.4, 1: 8771.2. Samples: 872775908. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:08,785][121949] Avg episode reward: [(0, '6144.217'), (1, '5719.931')] [2023-12-26 13:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001710352_437854208.pth... [2023-12-26 13:15:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001699008_434946048.pth... [2023-12-26 13:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001709328_437592064.pth [2023-12-26 13:15:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001697984_434683904.pth [2023-12-26 13:15:08,947][123090] Updated weights for policy 1, policy_version 1699011 (0.0010) [2023-12-26 13:15:08,999][123090] Updated weights for policy 1, policy_version 1699021 (0.0010) [2023-12-26 13:15:09,046][123090] Updated weights for policy 1, policy_version 1699031 (0.0010) [2023-12-26 13:15:09,335][123091] Updated weights for policy 0, policy_version 1710362 (0.0009) [2023-12-26 13:15:09,402][123091] Updated weights for policy 0, policy_version 1710372 (0.0009) [2023-12-26 13:15:09,464][123091] Updated weights for policy 0, policy_version 1710382 (0.0008) [2023-12-26 13:15:09,893][123090] Updated weights for policy 1, policy_version 1699041 (0.0010) [2023-12-26 13:15:09,968][123090] Updated weights for policy 1, policy_version 1699051 (0.0010) [2023-12-26 13:15:10,039][123090] Updated weights for policy 1, policy_version 1699061 (0.0007) [2023-12-26 13:15:10,114][123090] Updated weights for policy 1, policy_version 1699071 (0.0006) [2023-12-26 13:15:10,279][123091] Updated weights for policy 0, policy_version 1710392 (0.0010) [2023-12-26 13:15:10,331][123091] Updated weights for policy 0, policy_version 1710402 (0.0011) [2023-12-26 13:15:10,394][123091] Updated weights for policy 0, policy_version 1710412 (0.0011) [2023-12-26 13:15:10,893][123090] Updated weights for policy 1, policy_version 1699081 (0.0010) [2023-12-26 13:15:10,942][123090] Updated weights for policy 1, policy_version 1699091 (0.0010) [2023-12-26 13:15:10,994][123090] Updated weights for policy 1, policy_version 1699101 (0.0010) [2023-12-26 13:15:11,227][123091] Updated weights for policy 0, policy_version 1710422 (0.0010) [2023-12-26 13:15:11,293][123091] Updated weights for policy 0, policy_version 1710432 (0.0009) [2023-12-26 13:15:11,354][123091] Updated weights for policy 0, policy_version 1710442 (0.0009) [2023-12-26 13:15:11,857][123090] Updated weights for policy 1, policy_version 1699111 (0.0009) [2023-12-26 13:15:11,907][123090] Updated weights for policy 1, policy_version 1699121 (0.0009) [2023-12-26 13:15:11,974][123090] Updated weights for policy 1, policy_version 1699131 (0.0008) [2023-12-26 13:15:12,096][123091] Updated weights for policy 0, policy_version 1710452 (0.0007) [2023-12-26 13:15:12,167][123091] Updated weights for policy 0, policy_version 1710462 (0.0006) [2023-12-26 13:15:12,222][123091] Updated weights for policy 0, policy_version 1710472 (0.0005) [2023-12-26 13:15:12,887][123090] Updated weights for policy 1, policy_version 1699141 (0.0009) [2023-12-26 13:15:12,957][123090] Updated weights for policy 1, policy_version 1699151 (0.0009) [2023-12-26 13:15:12,966][123091] Updated weights for policy 0, policy_version 1710482 (0.0008) [2023-12-26 13:15:13,017][123090] Updated weights for policy 1, policy_version 1699161 (0.0008) [2023-12-26 13:15:13,024][123091] Updated weights for policy 0, policy_version 1710492 (0.0010) [2023-12-26 13:15:13,090][123091] Updated weights for policy 0, policy_version 1710502 (0.0010) [2023-12-26 13:15:13,148][123091] Updated weights for policy 0, policy_version 1710512 (0.0010) [2023-12-26 13:15:13,701][123090] Updated weights for policy 1, policy_version 1699171 (0.0009) [2023-12-26 13:15:13,758][123090] Updated weights for policy 1, policy_version 1699181 (0.0009) [2023-12-26 13:15:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 872882176. Throughput: 0: 8979.0, 1: 8719.8. Samples: 872881024. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:13,785][121949] Avg episode reward: [(0, '6067.713'), (1, '5707.842')] [2023-12-26 13:15:13,814][123090] Updated weights for policy 1, policy_version 1699191 (0.0008) [2023-12-26 13:15:13,947][123091] Updated weights for policy 0, policy_version 1710522 (0.0006) [2023-12-26 13:15:14,017][123091] Updated weights for policy 0, policy_version 1710532 (0.0005) [2023-12-26 13:15:14,082][123091] Updated weights for policy 0, policy_version 1710542 (0.0006) [2023-12-26 13:15:14,706][123090] Updated weights for policy 1, policy_version 1699201 (0.0009) [2023-12-26 13:15:14,710][123091] Updated weights for policy 0, policy_version 1710552 (0.0005) [2023-12-26 13:15:14,762][123090] Updated weights for policy 1, policy_version 1699211 (0.0009) [2023-12-26 13:15:14,766][123091] Updated weights for policy 0, policy_version 1710562 (0.0006) [2023-12-26 13:15:14,828][123090] Updated weights for policy 1, policy_version 1699221 (0.0009) [2023-12-26 13:15:14,829][123091] Updated weights for policy 0, policy_version 1710572 (0.0011) [2023-12-26 13:15:14,886][123090] Updated weights for policy 1, policy_version 1699231 (0.0007) [2023-12-26 13:15:15,652][123091] Updated weights for policy 0, policy_version 1710582 (0.0011) [2023-12-26 13:15:15,704][123091] Updated weights for policy 0, policy_version 1710592 (0.0009) [2023-12-26 13:15:15,752][123091] Updated weights for policy 0, policy_version 1710602 (0.0007) [2023-12-26 13:15:15,754][123090] Updated weights for policy 1, policy_version 1699241 (0.0008) [2023-12-26 13:15:15,824][123090] Updated weights for policy 1, policy_version 1699251 (0.0009) [2023-12-26 13:15:15,896][123090] Updated weights for policy 1, policy_version 1699261 (0.0007) [2023-12-26 13:15:16,464][123091] Updated weights for policy 0, policy_version 1710612 (0.0007) [2023-12-26 13:15:16,523][123091] Updated weights for policy 0, policy_version 1710622 (0.0010) [2023-12-26 13:15:16,574][123091] Updated weights for policy 0, policy_version 1710632 (0.0010) [2023-12-26 13:15:16,577][123090] Updated weights for policy 1, policy_version 1699271 (0.0006) [2023-12-26 13:15:16,639][123090] Updated weights for policy 1, policy_version 1699281 (0.0009) [2023-12-26 13:15:16,695][123090] Updated weights for policy 1, policy_version 1699291 (0.0009) [2023-12-26 13:15:17,330][123091] Updated weights for policy 0, policy_version 1710642 (0.0009) [2023-12-26 13:15:17,388][123091] Updated weights for policy 0, policy_version 1710652 (0.0006) [2023-12-26 13:15:17,448][123091] Updated weights for policy 0, policy_version 1710662 (0.0006) [2023-12-26 13:15:17,504][123091] Updated weights for policy 0, policy_version 1710672 (0.0010) [2023-12-26 13:15:17,526][123090] Updated weights for policy 1, policy_version 1699301 (0.0008) [2023-12-26 13:15:17,574][123090] Updated weights for policy 1, policy_version 1699311 (0.0009) [2023-12-26 13:15:17,629][123090] Updated weights for policy 1, policy_version 1699321 (0.0009) [2023-12-26 13:15:18,178][123091] Updated weights for policy 0, policy_version 1710682 (0.0011) [2023-12-26 13:15:18,236][123091] Updated weights for policy 0, policy_version 1710692 (0.0008) [2023-12-26 13:15:18,299][123091] Updated weights for policy 0, policy_version 1710702 (0.0009) [2023-12-26 13:15:18,540][123090] Updated weights for policy 1, policy_version 1699331 (0.0010) [2023-12-26 13:15:18,602][123090] Updated weights for policy 1, policy_version 1699341 (0.0009) [2023-12-26 13:15:18,663][123090] Updated weights for policy 1, policy_version 1699351 (0.0010) [2023-12-26 13:15:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 872980480. Throughput: 0: 9026.0, 1: 8697.0. Samples: 872989520. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:18,785][121949] Avg episode reward: [(0, '6175.896'), (1, '5848.655')] [2023-12-26 13:15:19,043][123091] Updated weights for policy 0, policy_version 1710712 (0.0011) [2023-12-26 13:15:19,109][123091] Updated weights for policy 0, policy_version 1710722 (0.0011) [2023-12-26 13:15:19,175][123091] Updated weights for policy 0, policy_version 1710732 (0.0006) [2023-12-26 13:15:19,586][123090] Updated weights for policy 1, policy_version 1699361 (0.0009) [2023-12-26 13:15:19,651][123090] Updated weights for policy 1, policy_version 1699371 (0.0009) [2023-12-26 13:15:19,716][123090] Updated weights for policy 1, policy_version 1699381 (0.0009) [2023-12-26 13:15:19,782][123090] Updated weights for policy 1, policy_version 1699391 (0.0007) [2023-12-26 13:15:19,934][123091] Updated weights for policy 0, policy_version 1710742 (0.0009) [2023-12-26 13:15:20,001][123091] Updated weights for policy 0, policy_version 1710752 (0.0011) [2023-12-26 13:15:20,069][123091] Updated weights for policy 0, policy_version 1710762 (0.0011) [2023-12-26 13:15:20,549][123090] Updated weights for policy 1, policy_version 1699401 (0.0006) [2023-12-26 13:15:20,620][123090] Updated weights for policy 1, policy_version 1699411 (0.0006) [2023-12-26 13:15:20,684][123090] Updated weights for policy 1, policy_version 1699421 (0.0006) [2023-12-26 13:15:20,916][123091] Updated weights for policy 0, policy_version 1710772 (0.0011) [2023-12-26 13:15:20,983][123091] Updated weights for policy 0, policy_version 1710782 (0.0011) [2023-12-26 13:15:21,047][123091] Updated weights for policy 0, policy_version 1710792 (0.0011) [2023-12-26 13:15:21,396][123090] Updated weights for policy 1, policy_version 1699431 (0.0007) [2023-12-26 13:15:21,464][123090] Updated weights for policy 1, policy_version 1699441 (0.0009) [2023-12-26 13:15:21,521][123090] Updated weights for policy 1, policy_version 1699451 (0.0009) [2023-12-26 13:15:21,880][123091] Updated weights for policy 0, policy_version 1710802 (0.0010) [2023-12-26 13:15:21,945][123091] Updated weights for policy 0, policy_version 1710812 (0.0010) [2023-12-26 13:15:22,006][123091] Updated weights for policy 0, policy_version 1710822 (0.0008) [2023-12-26 13:15:22,056][123091] Updated weights for policy 0, policy_version 1710832 (0.0009) [2023-12-26 13:15:22,379][123090] Updated weights for policy 1, policy_version 1699461 (0.0009) [2023-12-26 13:15:22,447][123090] Updated weights for policy 1, policy_version 1699471 (0.0009) [2023-12-26 13:15:22,512][123090] Updated weights for policy 1, policy_version 1699481 (0.0010) [2023-12-26 13:15:22,899][123091] Updated weights for policy 0, policy_version 1710842 (0.0010) [2023-12-26 13:15:22,964][123091] Updated weights for policy 0, policy_version 1710852 (0.0009) [2023-12-26 13:15:23,031][123091] Updated weights for policy 0, policy_version 1710862 (0.0009) [2023-12-26 13:15:23,317][123090] Updated weights for policy 1, policy_version 1699491 (0.0009) [2023-12-26 13:15:23,391][123090] Updated weights for policy 1, policy_version 1699501 (0.0005) [2023-12-26 13:15:23,465][123090] Updated weights for policy 1, policy_version 1699511 (0.0006) [2023-12-26 13:15:23,768][123091] Updated weights for policy 0, policy_version 1710872 (0.0006) [2023-12-26 13:15:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 873062400. Throughput: 0: 8977.0, 1: 8667.9. Samples: 873041248. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:23,785][121949] Avg episode reward: [(0, '6194.060'), (1, '5732.749')] [2023-12-26 13:15:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001699520_435077120.pth... [2023-12-26 13:15:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001698496_434814976.pth [2023-12-26 13:15:23,826][123091] Updated weights for policy 0, policy_version 1710882 (0.0006) [2023-12-26 13:15:23,880][123091] Updated weights for policy 0, policy_version 1710892 (0.0010) [2023-12-26 13:15:23,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001710896_437993472.pth... [2023-12-26 13:15:23,903][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001709840_437723136.pth [2023-12-26 13:15:24,160][123090] Updated weights for policy 1, policy_version 1699521 (0.0009) [2023-12-26 13:15:24,226][123090] Updated weights for policy 1, policy_version 1699531 (0.0010) [2023-12-26 13:15:24,299][123090] Updated weights for policy 1, policy_version 1699541 (0.0010) [2023-12-26 13:15:24,369][123090] Updated weights for policy 1, policy_version 1699551 (0.0010) [2023-12-26 13:15:24,648][123091] Updated weights for policy 0, policy_version 1710902 (0.0011) [2023-12-26 13:15:24,708][123091] Updated weights for policy 0, policy_version 1710912 (0.0006) [2023-12-26 13:15:24,773][123091] Updated weights for policy 0, policy_version 1710922 (0.0005) [2023-12-26 13:15:25,098][123090] Updated weights for policy 1, policy_version 1699561 (0.0006) [2023-12-26 13:15:25,162][123090] Updated weights for policy 1, policy_version 1699571 (0.0005) [2023-12-26 13:15:25,232][123090] Updated weights for policy 1, policy_version 1699581 (0.0005) [2023-12-26 13:15:25,596][123091] Updated weights for policy 0, policy_version 1710932 (0.0007) [2023-12-26 13:15:25,655][123091] Updated weights for policy 0, policy_version 1710942 (0.0009) [2023-12-26 13:15:25,702][123091] Updated weights for policy 0, policy_version 1710952 (0.0009) [2023-12-26 13:15:25,973][123090] Updated weights for policy 1, policy_version 1699591 (0.0009) [2023-12-26 13:15:26,031][123090] Updated weights for policy 1, policy_version 1699601 (0.0010) [2023-12-26 13:15:26,090][123090] Updated weights for policy 1, policy_version 1699611 (0.0008) [2023-12-26 13:15:26,470][123091] Updated weights for policy 0, policy_version 1710962 (0.0009) [2023-12-26 13:15:26,538][123091] Updated weights for policy 0, policy_version 1710972 (0.0007) [2023-12-26 13:15:26,603][123091] Updated weights for policy 0, policy_version 1710982 (0.0006) [2023-12-26 13:15:26,667][123091] Updated weights for policy 0, policy_version 1710992 (0.0005) [2023-12-26 13:15:26,904][123090] Updated weights for policy 1, policy_version 1699621 (0.0008) [2023-12-26 13:15:26,957][123090] Updated weights for policy 1, policy_version 1699631 (0.0010) [2023-12-26 13:15:27,011][123090] Updated weights for policy 1, policy_version 1699641 (0.0008) [2023-12-26 13:15:27,278][123091] Updated weights for policy 0, policy_version 1711002 (0.0010) [2023-12-26 13:15:27,340][123091] Updated weights for policy 0, policy_version 1711012 (0.0010) [2023-12-26 13:15:27,402][123091] Updated weights for policy 0, policy_version 1711022 (0.0010) [2023-12-26 13:15:27,903][123090] Updated weights for policy 1, policy_version 1699651 (0.0009) [2023-12-26 13:15:27,961][123090] Updated weights for policy 1, policy_version 1699661 (0.0009) [2023-12-26 13:15:28,010][123090] Updated weights for policy 1, policy_version 1699671 (0.0005) [2023-12-26 13:15:28,133][123091] Updated weights for policy 0, policy_version 1711032 (0.0009) [2023-12-26 13:15:28,200][123091] Updated weights for policy 0, policy_version 1711042 (0.0009) [2023-12-26 13:15:28,263][123091] Updated weights for policy 0, policy_version 1711052 (0.0010) [2023-12-26 13:15:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 873152512. Throughput: 0: 8992.0, 1: 8732.8. Samples: 873149372. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:28,785][121949] Avg episode reward: [(0, '6120.276'), (1, '5463.310')] [2023-12-26 13:15:28,843][123090] Updated weights for policy 1, policy_version 1699681 (0.0005) [2023-12-26 13:15:28,906][123090] Updated weights for policy 1, policy_version 1699691 (0.0006) [2023-12-26 13:15:28,974][123090] Updated weights for policy 1, policy_version 1699701 (0.0006) [2023-12-26 13:15:29,043][123090] Updated weights for policy 1, policy_version 1699711 (0.0006) [2023-12-26 13:15:29,064][123091] Updated weights for policy 0, policy_version 1711062 (0.0010) [2023-12-26 13:15:29,122][123091] Updated weights for policy 0, policy_version 1711072 (0.0010) [2023-12-26 13:15:29,183][123091] Updated weights for policy 0, policy_version 1711082 (0.0009) [2023-12-26 13:15:29,733][123090] Updated weights for policy 1, policy_version 1699721 (0.0009) [2023-12-26 13:15:29,798][123090] Updated weights for policy 1, policy_version 1699731 (0.0009) [2023-12-26 13:15:29,871][123090] Updated weights for policy 1, policy_version 1699741 (0.0009) [2023-12-26 13:15:29,980][123091] Updated weights for policy 0, policy_version 1711092 (0.0008) [2023-12-26 13:15:30,048][123091] Updated weights for policy 0, policy_version 1711102 (0.0009) [2023-12-26 13:15:30,120][123091] Updated weights for policy 0, policy_version 1711112 (0.0011) [2023-12-26 13:15:30,754][123090] Updated weights for policy 1, policy_version 1699751 (0.0009) [2023-12-26 13:15:30,806][123090] Updated weights for policy 1, policy_version 1699761 (0.0009) [2023-12-26 13:15:30,856][123090] Updated weights for policy 1, policy_version 1699771 (0.0009) [2023-12-26 13:15:30,878][123091] Updated weights for policy 0, policy_version 1711122 (0.0010) [2023-12-26 13:15:30,963][123091] Updated weights for policy 0, policy_version 1711132 (0.0009) [2023-12-26 13:15:31,017][123091] Updated weights for policy 0, policy_version 1711142 (0.0009) [2023-12-26 13:15:31,082][123091] Updated weights for policy 0, policy_version 1711152 (0.0008) [2023-12-26 13:15:31,721][123090] Updated weights for policy 1, policy_version 1699781 (0.0007) [2023-12-26 13:15:31,788][123090] Updated weights for policy 1, policy_version 1699791 (0.0008) [2023-12-26 13:15:31,858][123090] Updated weights for policy 1, policy_version 1699801 (0.0008) [2023-12-26 13:15:31,915][123091] Updated weights for policy 0, policy_version 1711162 (0.0006) [2023-12-26 13:15:31,976][123091] Updated weights for policy 0, policy_version 1711172 (0.0008) [2023-12-26 13:15:32,041][123091] Updated weights for policy 0, policy_version 1711182 (0.0009) [2023-12-26 13:15:32,666][123090] Updated weights for policy 1, policy_version 1699811 (0.0009) [2023-12-26 13:15:32,735][123090] Updated weights for policy 1, policy_version 1699821 (0.0010) [2023-12-26 13:15:32,806][123090] Updated weights for policy 1, policy_version 1699831 (0.0010) [2023-12-26 13:15:32,834][123091] Updated weights for policy 0, policy_version 1711192 (0.0008) [2023-12-26 13:15:32,886][123091] Updated weights for policy 0, policy_version 1711202 (0.0009) [2023-12-26 13:15:32,939][123091] Updated weights for policy 0, policy_version 1711212 (0.0009) [2023-12-26 13:15:33,593][123090] Updated weights for policy 1, policy_version 1699841 (0.0008) [2023-12-26 13:15:33,648][123090] Updated weights for policy 1, policy_version 1699851 (0.0009) [2023-12-26 13:15:33,699][123090] Updated weights for policy 1, policy_version 1699862 (0.0010) [2023-12-26 13:15:33,750][123090] Updated weights for policy 1, policy_version 1699872 (0.0009) [2023-12-26 13:15:33,783][123091] Updated weights for policy 0, policy_version 1711222 (0.0009) [2023-12-26 13:15:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 873242624. Throughput: 0: 9008.0, 1: 8727.1. Samples: 873253868. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:33,785][121949] Avg episode reward: [(0, '6052.902'), (1, '5696.029')] [2023-12-26 13:15:33,839][123091] Updated weights for policy 0, policy_version 1711232 (0.0007) [2023-12-26 13:15:33,914][123091] Updated weights for policy 0, policy_version 1711242 (0.0007) [2023-12-26 13:15:34,646][123090] Updated weights for policy 1, policy_version 1699882 (0.0011) [2023-12-26 13:15:34,703][123090] Updated weights for policy 1, policy_version 1699892 (0.0009) [2023-12-26 13:15:34,715][123091] Updated weights for policy 0, policy_version 1711252 (0.0007) [2023-12-26 13:15:34,767][123090] Updated weights for policy 1, policy_version 1699902 (0.0009) [2023-12-26 13:15:34,770][123091] Updated weights for policy 0, policy_version 1711262 (0.0008) [2023-12-26 13:15:34,831][123091] Updated weights for policy 0, policy_version 1711272 (0.0009) [2023-12-26 13:15:35,647][123090] Updated weights for policy 1, policy_version 1699912 (0.0009) [2023-12-26 13:15:35,689][123091] Updated weights for policy 0, policy_version 1711282 (0.0009) [2023-12-26 13:15:35,710][123090] Updated weights for policy 1, policy_version 1699922 (0.0009) [2023-12-26 13:15:35,735][123091] Updated weights for policy 0, policy_version 1711292 (0.0008) [2023-12-26 13:15:35,775][123090] Updated weights for policy 1, policy_version 1699932 (0.0009) [2023-12-26 13:15:35,790][123091] Updated weights for policy 0, policy_version 1711302 (0.0007) [2023-12-26 13:15:35,846][123091] Updated weights for policy 0, policy_version 1711312 (0.0010) [2023-12-26 13:15:36,604][123090] Updated weights for policy 1, policy_version 1699942 (0.0008) [2023-12-26 13:15:36,671][123090] Updated weights for policy 1, policy_version 1699952 (0.0009) [2023-12-26 13:15:36,722][123091] Updated weights for policy 0, policy_version 1711322 (0.0009) [2023-12-26 13:15:36,739][123090] Updated weights for policy 1, policy_version 1699962 (0.0009) [2023-12-26 13:15:36,782][123091] Updated weights for policy 0, policy_version 1711332 (0.0009) [2023-12-26 13:15:36,848][123091] Updated weights for policy 0, policy_version 1711342 (0.0009) [2023-12-26 13:15:37,530][123090] Updated weights for policy 1, policy_version 1699972 (0.0008) [2023-12-26 13:15:37,602][123090] Updated weights for policy 1, policy_version 1699982 (0.0007) [2023-12-26 13:15:37,667][123090] Updated weights for policy 1, policy_version 1699992 (0.0010) [2023-12-26 13:15:37,692][123091] Updated weights for policy 0, policy_version 1711352 (0.0007) [2023-12-26 13:15:37,761][123091] Updated weights for policy 0, policy_version 1711362 (0.0007) [2023-12-26 13:15:37,820][123091] Updated weights for policy 0, policy_version 1711372 (0.0010) [2023-12-26 13:15:38,347][123090] Updated weights for policy 1, policy_version 1700002 (0.0010) [2023-12-26 13:15:38,402][123090] Updated weights for policy 1, policy_version 1700012 (0.0008) [2023-12-26 13:15:38,455][123090] Updated weights for policy 1, policy_version 1700022 (0.0008) [2023-12-26 13:15:38,508][123090] Updated weights for policy 1, policy_version 1700032 (0.0008) [2023-12-26 13:15:38,716][123091] Updated weights for policy 0, policy_version 1711382 (0.0010) [2023-12-26 13:15:38,782][123091] Updated weights for policy 0, policy_version 1711392 (0.0009) [2023-12-26 13:15:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 873324544. Throughput: 0: 8986.6, 1: 8718.8. Samples: 873304004. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:38,784][121949] Avg episode reward: [(0, '6070.089'), (1, '5788.913')] [2023-12-26 13:15:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001700032_435208192.pth... [2023-12-26 13:15:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001699008_434946048.pth [2023-12-26 13:15:38,842][123091] Updated weights for policy 0, policy_version 1711402 (0.0010) [2023-12-26 13:15:38,878][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001711408_438124544.pth... [2023-12-26 13:15:38,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001710352_437854208.pth [2023-12-26 13:15:39,346][123090] Updated weights for policy 1, policy_version 1700042 (0.0011) [2023-12-26 13:15:39,422][123090] Updated weights for policy 1, policy_version 1700052 (0.0009) [2023-12-26 13:15:39,487][123090] Updated weights for policy 1, policy_version 1700062 (0.0006) [2023-12-26 13:15:39,707][123091] Updated weights for policy 0, policy_version 1711412 (0.0009) [2023-12-26 13:15:39,778][123091] Updated weights for policy 0, policy_version 1711422 (0.0011) [2023-12-26 13:15:39,853][123091] Updated weights for policy 0, policy_version 1711432 (0.0008) [2023-12-26 13:15:40,245][123090] Updated weights for policy 1, policy_version 1700072 (0.0006) [2023-12-26 13:15:40,313][123090] Updated weights for policy 1, policy_version 1700082 (0.0005) [2023-12-26 13:15:40,380][123090] Updated weights for policy 1, policy_version 1700092 (0.0007) [2023-12-26 13:15:40,698][123091] Updated weights for policy 0, policy_version 1711442 (0.0008) [2023-12-26 13:15:40,760][123091] Updated weights for policy 0, policy_version 1711452 (0.0009) [2023-12-26 13:15:40,824][123091] Updated weights for policy 0, policy_version 1711462 (0.0009) [2023-12-26 13:15:40,888][123091] Updated weights for policy 0, policy_version 1711472 (0.0009) [2023-12-26 13:15:41,127][123090] Updated weights for policy 1, policy_version 1700102 (0.0011) [2023-12-26 13:15:41,198][123090] Updated weights for policy 1, policy_version 1700112 (0.0011) [2023-12-26 13:15:41,255][123090] Updated weights for policy 1, policy_version 1700122 (0.0009) [2023-12-26 13:15:41,744][123091] Updated weights for policy 0, policy_version 1711482 (0.0009) [2023-12-26 13:15:41,812][123091] Updated weights for policy 0, policy_version 1711492 (0.0008) [2023-12-26 13:15:41,877][123091] Updated weights for policy 0, policy_version 1711502 (0.0009) [2023-12-26 13:15:42,141][123090] Updated weights for policy 1, policy_version 1700132 (0.0009) [2023-12-26 13:15:42,206][123090] Updated weights for policy 1, policy_version 1700142 (0.0010) [2023-12-26 13:15:42,277][123090] Updated weights for policy 1, policy_version 1700152 (0.0009) [2023-12-26 13:15:42,699][123091] Updated weights for policy 0, policy_version 1711512 (0.0009) [2023-12-26 13:15:42,753][123091] Updated weights for policy 0, policy_version 1711522 (0.0009) [2023-12-26 13:15:42,806][123091] Updated weights for policy 0, policy_version 1711532 (0.0010) [2023-12-26 13:15:43,131][123090] Updated weights for policy 1, policy_version 1700162 (0.0008) [2023-12-26 13:15:43,186][123090] Updated weights for policy 1, policy_version 1700172 (0.0010) [2023-12-26 13:15:43,240][123090] Updated weights for policy 1, policy_version 1700182 (0.0010) [2023-12-26 13:15:43,298][123090] Updated weights for policy 1, policy_version 1700192 (0.0010) [2023-12-26 13:15:43,534][123091] Updated weights for policy 0, policy_version 1711542 (0.0007) [2023-12-26 13:15:43,604][123091] Updated weights for policy 0, policy_version 1711552 (0.0005) [2023-12-26 13:15:43,666][123091] Updated weights for policy 0, policy_version 1711562 (0.0005) [2023-12-26 13:15:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 873414656. Throughput: 0: 8819.4, 1: 8647.4. Samples: 873405472. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:43,785][121949] Avg episode reward: [(0, '5987.349'), (1, '5637.411')] [2023-12-26 13:15:44,217][123090] Updated weights for policy 1, policy_version 1700202 (0.0009) [2023-12-26 13:15:44,283][123090] Updated weights for policy 1, policy_version 1700212 (0.0010) [2023-12-26 13:15:44,301][123091] Updated weights for policy 0, policy_version 1711572 (0.0006) [2023-12-26 13:15:44,349][123090] Updated weights for policy 1, policy_version 1700222 (0.0009) [2023-12-26 13:15:44,370][123091] Updated weights for policy 0, policy_version 1711582 (0.0007) [2023-12-26 13:15:44,430][123091] Updated weights for policy 0, policy_version 1711592 (0.0007) [2023-12-26 13:15:45,173][123090] Updated weights for policy 1, policy_version 1700232 (0.0010) [2023-12-26 13:15:45,203][123091] Updated weights for policy 0, policy_version 1711602 (0.0007) [2023-12-26 13:15:45,240][123090] Updated weights for policy 1, policy_version 1700242 (0.0009) [2023-12-26 13:15:45,264][123091] Updated weights for policy 0, policy_version 1711612 (0.0009) [2023-12-26 13:15:45,300][123090] Updated weights for policy 1, policy_version 1700252 (0.0007) [2023-12-26 13:15:45,315][123091] Updated weights for policy 0, policy_version 1711622 (0.0009) [2023-12-26 13:15:45,371][123091] Updated weights for policy 0, policy_version 1711632 (0.0008) [2023-12-26 13:15:46,126][123090] Updated weights for policy 1, policy_version 1700262 (0.0007) [2023-12-26 13:15:46,186][123090] Updated weights for policy 1, policy_version 1700272 (0.0008) [2023-12-26 13:15:46,215][123091] Updated weights for policy 0, policy_version 1711642 (0.0008) [2023-12-26 13:15:46,253][123090] Updated weights for policy 1, policy_version 1700282 (0.0007) [2023-12-26 13:15:46,273][123091] Updated weights for policy 0, policy_version 1711652 (0.0008) [2023-12-26 13:15:46,338][123091] Updated weights for policy 0, policy_version 1711662 (0.0008) [2023-12-26 13:15:47,074][123090] Updated weights for policy 1, policy_version 1700292 (0.0009) [2023-12-26 13:15:47,090][123091] Updated weights for policy 0, policy_version 1711672 (0.0007) [2023-12-26 13:15:47,129][123090] Updated weights for policy 1, policy_version 1700302 (0.0009) [2023-12-26 13:15:47,147][123091] Updated weights for policy 0, policy_version 1711682 (0.0008) [2023-12-26 13:15:47,199][123090] Updated weights for policy 1, policy_version 1700312 (0.0008) [2023-12-26 13:15:47,210][123091] Updated weights for policy 0, policy_version 1711692 (0.0008) [2023-12-26 13:15:47,886][123091] Updated weights for policy 0, policy_version 1711702 (0.0009) [2023-12-26 13:15:47,945][123091] Updated weights for policy 0, policy_version 1711712 (0.0008) [2023-12-26 13:15:47,980][123090] Updated weights for policy 1, policy_version 1700322 (0.0008) [2023-12-26 13:15:48,003][123091] Updated weights for policy 0, policy_version 1711722 (0.0010) [2023-12-26 13:15:48,036][123090] Updated weights for policy 1, policy_version 1700332 (0.0010) [2023-12-26 13:15:48,088][123090] Updated weights for policy 1, policy_version 1700342 (0.0010) [2023-12-26 13:15:48,136][123090] Updated weights for policy 1, policy_version 1700352 (0.0010) [2023-12-26 13:15:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 873496576. Throughput: 0: 8939.7, 1: 8631.0. Samples: 873511940. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:48,785][121949] Avg episode reward: [(0, '5798.754'), (1, '5744.210')] [2023-12-26 13:15:48,827][123091] Updated weights for policy 0, policy_version 1711732 (0.0009) [2023-12-26 13:15:48,886][123091] Updated weights for policy 0, policy_version 1711742 (0.0009) [2023-12-26 13:15:48,957][123091] Updated weights for policy 0, policy_version 1711752 (0.0008) [2023-12-26 13:15:48,996][123090] Updated weights for policy 1, policy_version 1700362 (0.0011) [2023-12-26 13:15:49,065][123090] Updated weights for policy 1, policy_version 1700372 (0.0011) [2023-12-26 13:15:49,132][123090] Updated weights for policy 1, policy_version 1700382 (0.0011) [2023-12-26 13:15:49,836][123091] Updated weights for policy 0, policy_version 1711762 (0.0007) [2023-12-26 13:15:49,897][123091] Updated weights for policy 0, policy_version 1711772 (0.0009) [2023-12-26 13:15:49,920][123090] Updated weights for policy 1, policy_version 1700392 (0.0008) [2023-12-26 13:15:49,968][123091] Updated weights for policy 0, policy_version 1711782 (0.0007) [2023-12-26 13:15:49,988][123090] Updated weights for policy 1, policy_version 1700402 (0.0008) [2023-12-26 13:15:50,033][123091] Updated weights for policy 0, policy_version 1711792 (0.0006) [2023-12-26 13:15:50,048][123090] Updated weights for policy 1, policy_version 1700412 (0.0009) [2023-12-26 13:15:50,803][123091] Updated weights for policy 0, policy_version 1711802 (0.0009) [2023-12-26 13:15:50,833][123090] Updated weights for policy 1, policy_version 1700422 (0.0008) [2023-12-26 13:15:50,861][123091] Updated weights for policy 0, policy_version 1711812 (0.0009) [2023-12-26 13:15:50,901][123090] Updated weights for policy 1, policy_version 1700432 (0.0008) [2023-12-26 13:15:50,917][123091] Updated weights for policy 0, policy_version 1711822 (0.0008) [2023-12-26 13:15:50,959][123090] Updated weights for policy 1, policy_version 1700442 (0.0005) [2023-12-26 13:15:51,754][123090] Updated weights for policy 1, policy_version 1700452 (0.0007) [2023-12-26 13:15:51,799][123091] Updated weights for policy 0, policy_version 1711832 (0.0008) [2023-12-26 13:15:51,817][123090] Updated weights for policy 1, policy_version 1700462 (0.0009) [2023-12-26 13:15:51,849][123091] Updated weights for policy 0, policy_version 1711842 (0.0009) [2023-12-26 13:15:51,878][123090] Updated weights for policy 1, policy_version 1700472 (0.0008) [2023-12-26 13:15:51,901][123091] Updated weights for policy 0, policy_version 1711852 (0.0008) [2023-12-26 13:15:52,696][123091] Updated weights for policy 0, policy_version 1711862 (0.0010) [2023-12-26 13:15:52,705][123090] Updated weights for policy 1, policy_version 1700482 (0.0006) [2023-12-26 13:15:52,759][123091] Updated weights for policy 0, policy_version 1711872 (0.0010) [2023-12-26 13:15:52,766][123090] Updated weights for policy 1, policy_version 1700492 (0.0007) [2023-12-26 13:15:52,819][123090] Updated weights for policy 1, policy_version 1700502 (0.0007) [2023-12-26 13:15:52,821][123091] Updated weights for policy 0, policy_version 1711882 (0.0009) [2023-12-26 13:15:52,874][123090] Updated weights for policy 1, policy_version 1700512 (0.0008) [2023-12-26 13:15:53,606][123090] Updated weights for policy 1, policy_version 1700522 (0.0010) [2023-12-26 13:15:53,660][123090] Updated weights for policy 1, policy_version 1700532 (0.0008) [2023-12-26 13:15:53,683][123091] Updated weights for policy 0, policy_version 1711892 (0.0009) [2023-12-26 13:15:53,715][123090] Updated weights for policy 1, policy_version 1700542 (0.0008) [2023-12-26 13:15:53,741][123091] Updated weights for policy 0, policy_version 1711902 (0.0007) [2023-12-26 13:15:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 873586688. Throughput: 0: 8880.9, 1: 8619.4. Samples: 873563420. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:53,785][121949] Avg episode reward: [(0, '5823.739'), (1, '5891.343')] [2023-12-26 13:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001700544_435339264.pth... [2023-12-26 13:15:53,795][123091] Updated weights for policy 0, policy_version 1711912 (0.0010) [2023-12-26 13:15:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001699520_435077120.pth [2023-12-26 13:15:53,828][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001711920_438255616.pth... [2023-12-26 13:15:53,832][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001710896_437993472.pth [2023-12-26 13:15:54,502][123090] Updated weights for policy 1, policy_version 1700552 (0.0009) [2023-12-26 13:15:54,572][123090] Updated weights for policy 1, policy_version 1700562 (0.0009) [2023-12-26 13:15:54,642][123090] Updated weights for policy 1, policy_version 1700572 (0.0009) [2023-12-26 13:15:54,655][123091] Updated weights for policy 0, policy_version 1711923 (0.0010) [2023-12-26 13:15:54,711][123091] Updated weights for policy 0, policy_version 1711933 (0.0010) [2023-12-26 13:15:54,764][123091] Updated weights for policy 0, policy_version 1711943 (0.0010) [2023-12-26 13:15:55,476][123091] Updated weights for policy 0, policy_version 1711953 (0.0011) [2023-12-26 13:15:55,505][123090] Updated weights for policy 1, policy_version 1700582 (0.0006) [2023-12-26 13:15:55,531][123091] Updated weights for policy 0, policy_version 1711963 (0.0010) [2023-12-26 13:15:55,563][123090] Updated weights for policy 1, policy_version 1700592 (0.0007) [2023-12-26 13:15:55,582][123091] Updated weights for policy 0, policy_version 1711973 (0.0010) [2023-12-26 13:15:55,612][123090] Updated weights for policy 1, policy_version 1700602 (0.0006) [2023-12-26 13:15:55,635][123091] Updated weights for policy 0, policy_version 1711983 (0.0010) [2023-12-26 13:15:56,310][123090] Updated weights for policy 1, policy_version 1700612 (0.0005) [2023-12-26 13:15:56,382][123090] Updated weights for policy 1, policy_version 1700622 (0.0005) [2023-12-26 13:15:56,452][123090] Updated weights for policy 1, policy_version 1700632 (0.0005) [2023-12-26 13:15:56,486][123091] Updated weights for policy 0, policy_version 1711993 (0.0007) [2023-12-26 13:15:56,531][123091] Updated weights for policy 0, policy_version 1712003 (0.0006) [2023-12-26 13:15:56,576][123091] Updated weights for policy 0, policy_version 1712013 (0.0005) [2023-12-26 13:15:57,198][123090] Updated weights for policy 1, policy_version 1700642 (0.0006) [2023-12-26 13:15:57,246][123090] Updated weights for policy 1, policy_version 1700652 (0.0008) [2023-12-26 13:15:57,296][123090] Updated weights for policy 1, policy_version 1700663 (0.0009) [2023-12-26 13:15:57,339][123091] Updated weights for policy 0, policy_version 1712023 (0.0009) [2023-12-26 13:15:57,385][123091] Updated weights for policy 0, policy_version 1712033 (0.0010) [2023-12-26 13:15:57,432][123091] Updated weights for policy 0, policy_version 1712043 (0.0010) [2023-12-26 13:15:58,216][123090] Updated weights for policy 1, policy_version 1700673 (0.0008) [2023-12-26 13:15:58,220][123091] Updated weights for policy 0, policy_version 1712053 (0.0009) [2023-12-26 13:15:58,273][123091] Updated weights for policy 0, policy_version 1712063 (0.0007) [2023-12-26 13:15:58,279][123090] Updated weights for policy 1, policy_version 1700683 (0.0008) [2023-12-26 13:15:58,333][123091] Updated weights for policy 0, policy_version 1712073 (0.0008) [2023-12-26 13:15:58,349][123090] Updated weights for policy 1, policy_version 1700693 (0.0009) [2023-12-26 13:15:58,412][123090] Updated weights for policy 1, policy_version 1700703 (0.0009) [2023-12-26 13:15:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 873676800. Throughput: 0: 8855.1, 1: 8682.6. Samples: 873670220. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:15:58,785][121949] Avg episode reward: [(0, '5851.636'), (1, '5835.881')] [2023-12-26 13:15:59,170][123091] Updated weights for policy 0, policy_version 1712083 (0.0007) [2023-12-26 13:15:59,228][123091] Updated weights for policy 0, policy_version 1712093 (0.0009) [2023-12-26 13:15:59,266][123090] Updated weights for policy 1, policy_version 1700713 (0.0008) [2023-12-26 13:15:59,300][123091] Updated weights for policy 0, policy_version 1712103 (0.0008) [2023-12-26 13:15:59,336][123090] Updated weights for policy 1, policy_version 1700723 (0.0008) [2023-12-26 13:15:59,411][123090] Updated weights for policy 1, policy_version 1700733 (0.0009) [2023-12-26 13:16:00,097][123091] Updated weights for policy 0, policy_version 1712113 (0.0008) [2023-12-26 13:16:00,153][123091] Updated weights for policy 0, policy_version 1712123 (0.0010) [2023-12-26 13:16:00,218][123091] Updated weights for policy 0, policy_version 1712133 (0.0010) [2023-12-26 13:16:00,287][123091] Updated weights for policy 0, policy_version 1712143 (0.0007) [2023-12-26 13:16:00,290][123090] Updated weights for policy 1, policy_version 1700743 (0.0007) [2023-12-26 13:16:00,363][123090] Updated weights for policy 1, policy_version 1700753 (0.0010) [2023-12-26 13:16:00,420][123090] Updated weights for policy 1, policy_version 1700763 (0.0010) [2023-12-26 13:16:00,970][123091] Updated weights for policy 0, policy_version 1712153 (0.0010) [2023-12-26 13:16:01,022][123091] Updated weights for policy 0, policy_version 1712163 (0.0010) [2023-12-26 13:16:01,087][123091] Updated weights for policy 0, policy_version 1712173 (0.0009) [2023-12-26 13:16:01,252][123090] Updated weights for policy 1, policy_version 1700773 (0.0008) [2023-12-26 13:16:01,317][123090] Updated weights for policy 1, policy_version 1700783 (0.0008) [2023-12-26 13:16:01,388][123090] Updated weights for policy 1, policy_version 1700793 (0.0008) [2023-12-26 13:16:01,922][123091] Updated weights for policy 0, policy_version 1712183 (0.0005) [2023-12-26 13:16:01,975][123091] Updated weights for policy 0, policy_version 1712193 (0.0010) [2023-12-26 13:16:02,037][123091] Updated weights for policy 0, policy_version 1712203 (0.0010) [2023-12-26 13:16:02,140][123090] Updated weights for policy 1, policy_version 1700803 (0.0008) [2023-12-26 13:16:02,196][123090] Updated weights for policy 1, policy_version 1700813 (0.0005) [2023-12-26 13:16:02,250][123090] Updated weights for policy 1, policy_version 1700823 (0.0006) [2023-12-26 13:16:02,804][123091] Updated weights for policy 0, policy_version 1712213 (0.0011) [2023-12-26 13:16:02,859][123091] Updated weights for policy 0, policy_version 1712223 (0.0010) [2023-12-26 13:16:02,917][123091] Updated weights for policy 0, policy_version 1712233 (0.0010) [2023-12-26 13:16:03,055][123090] Updated weights for policy 1, policy_version 1700833 (0.0009) [2023-12-26 13:16:03,112][123090] Updated weights for policy 1, policy_version 1700843 (0.0006) [2023-12-26 13:16:03,179][123090] Updated weights for policy 1, policy_version 1700853 (0.0006) [2023-12-26 13:16:03,247][123090] Updated weights for policy 1, policy_version 1700863 (0.0005) [2023-12-26 13:16:03,758][123091] Updated weights for policy 0, policy_version 1712243 (0.0011) [2023-12-26 13:16:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17689.2). Total num frames: 873758720. Throughput: 0: 8803.2, 1: 8664.7. Samples: 873775576. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:16:03,785][121949] Avg episode reward: [(0, '6011.203'), (1, '5726.234')] [2023-12-26 13:16:03,814][123091] Updated weights for policy 0, policy_version 1712253 (0.0010) [2023-12-26 13:16:03,882][123091] Updated weights for policy 0, policy_version 1712263 (0.0011) [2023-12-26 13:16:03,953][123090] Updated weights for policy 1, policy_version 1700873 (0.0007) [2023-12-26 13:16:04,027][123090] Updated weights for policy 1, policy_version 1700883 (0.0007) [2023-12-26 13:16:04,090][123090] Updated weights for policy 1, policy_version 1700893 (0.0009) [2023-12-26 13:16:04,739][123091] Updated weights for policy 0, policy_version 1712273 (0.0008) [2023-12-26 13:16:04,803][123091] Updated weights for policy 0, policy_version 1712283 (0.0009) [2023-12-26 13:16:04,866][123091] Updated weights for policy 0, policy_version 1712293 (0.0008) [2023-12-26 13:16:04,894][123090] Updated weights for policy 1, policy_version 1700903 (0.0010) [2023-12-26 13:16:04,927][123091] Updated weights for policy 0, policy_version 1712303 (0.0007) [2023-12-26 13:16:04,958][123090] Updated weights for policy 1, policy_version 1700913 (0.0011) [2023-12-26 13:16:05,025][123090] Updated weights for policy 1, policy_version 1700923 (0.0011) [2023-12-26 13:16:05,577][123091] Updated weights for policy 0, policy_version 1712313 (0.0005) [2023-12-26 13:16:05,629][123091] Updated weights for policy 0, policy_version 1712323 (0.0005) [2023-12-26 13:16:05,681][123091] Updated weights for policy 0, policy_version 1712333 (0.0005) [2023-12-26 13:16:05,812][123090] Updated weights for policy 1, policy_version 1700933 (0.0011) [2023-12-26 13:16:05,870][123090] Updated weights for policy 1, policy_version 1700943 (0.0010) [2023-12-26 13:16:05,922][123090] Updated weights for policy 1, policy_version 1700953 (0.0010) [2023-12-26 13:16:06,376][123091] Updated weights for policy 0, policy_version 1712343 (0.0008) [2023-12-26 13:16:06,436][123091] Updated weights for policy 0, policy_version 1712353 (0.0009) [2023-12-26 13:16:06,496][123091] Updated weights for policy 0, policy_version 1712363 (0.0009) [2023-12-26 13:16:06,769][123090] Updated weights for policy 1, policy_version 1700963 (0.0010) [2023-12-26 13:16:06,829][123090] Updated weights for policy 1, policy_version 1700973 (0.0011) [2023-12-26 13:16:06,881][123090] Updated weights for policy 1, policy_version 1700983 (0.0010) [2023-12-26 13:16:07,249][123091] Updated weights for policy 0, policy_version 1712373 (0.0007) [2023-12-26 13:16:07,323][123091] Updated weights for policy 0, policy_version 1712383 (0.0006) [2023-12-26 13:16:07,390][123091] Updated weights for policy 0, policy_version 1712393 (0.0005) [2023-12-26 13:16:07,606][123090] Updated weights for policy 1, policy_version 1700993 (0.0010) [2023-12-26 13:16:07,666][123090] Updated weights for policy 1, policy_version 1701003 (0.0010) [2023-12-26 13:16:07,738][123090] Updated weights for policy 1, policy_version 1701013 (0.0007) [2023-12-26 13:16:07,792][123090] Updated weights for policy 1, policy_version 1701023 (0.0005) [2023-12-26 13:16:08,042][123091] Updated weights for policy 0, policy_version 1712403 (0.0006) [2023-12-26 13:16:08,101][123091] Updated weights for policy 0, policy_version 1712413 (0.0005) [2023-12-26 13:16:08,151][123091] Updated weights for policy 0, policy_version 1712423 (0.0005) [2023-12-26 13:16:08,490][123090] Updated weights for policy 1, policy_version 1701033 (0.0010) [2023-12-26 13:16:08,552][123090] Updated weights for policy 1, policy_version 1701043 (0.0010) [2023-12-26 13:16:08,623][123090] Updated weights for policy 1, policy_version 1701053 (0.0011) [2023-12-26 13:16:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 873857024. Throughput: 0: 8832.4, 1: 8672.7. Samples: 873828976. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:16:08,784][121949] Avg episode reward: [(0, '6115.750'), (1, '5856.884')] [2023-12-26 13:16:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001701056_435470336.pth... [2023-12-26 13:16:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001712432_438386688.pth... [2023-12-26 13:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001700032_435208192.pth [2023-12-26 13:16:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001711408_438124544.pth [2023-12-26 13:16:08,890][123091] Updated weights for policy 0, policy_version 1712433 (0.0006) [2023-12-26 13:16:08,956][123091] Updated weights for policy 0, policy_version 1712443 (0.0009) [2023-12-26 13:16:09,021][123091] Updated weights for policy 0, policy_version 1712453 (0.0008) [2023-12-26 13:16:09,093][123091] Updated weights for policy 0, policy_version 1712463 (0.0006) [2023-12-26 13:16:09,296][123090] Updated weights for policy 1, policy_version 1701063 (0.0009) [2023-12-26 13:16:09,375][123090] Updated weights for policy 1, policy_version 1701073 (0.0009) [2023-12-26 13:16:09,443][123090] Updated weights for policy 1, policy_version 1701083 (0.0010) [2023-12-26 13:16:09,809][123091] Updated weights for policy 0, policy_version 1712473 (0.0007) [2023-12-26 13:16:09,881][123091] Updated weights for policy 0, policy_version 1712483 (0.0008) [2023-12-26 13:16:09,941][123091] Updated weights for policy 0, policy_version 1712493 (0.0008) [2023-12-26 13:16:10,255][123090] Updated weights for policy 1, policy_version 1701093 (0.0007) [2023-12-26 13:16:10,312][123090] Updated weights for policy 1, policy_version 1701103 (0.0005) [2023-12-26 13:16:10,383][123090] Updated weights for policy 1, policy_version 1701113 (0.0008) [2023-12-26 13:16:10,699][123091] Updated weights for policy 0, policy_version 1712503 (0.0006) [2023-12-26 13:16:10,752][123091] Updated weights for policy 0, policy_version 1712513 (0.0008) [2023-12-26 13:16:10,808][123091] Updated weights for policy 0, policy_version 1712523 (0.0010) [2023-12-26 13:16:11,180][123090] Updated weights for policy 1, policy_version 1701123 (0.0006) [2023-12-26 13:16:11,250][123090] Updated weights for policy 1, policy_version 1701133 (0.0006) [2023-12-26 13:16:11,326][123090] Updated weights for policy 1, policy_version 1701143 (0.0007) [2023-12-26 13:16:11,669][123091] Updated weights for policy 0, policy_version 1712533 (0.0009) [2023-12-26 13:16:11,733][123091] Updated weights for policy 0, policy_version 1712543 (0.0007) [2023-12-26 13:16:11,806][123091] Updated weights for policy 0, policy_version 1712553 (0.0007) [2023-12-26 13:16:12,048][123090] Updated weights for policy 1, policy_version 1701153 (0.0009) [2023-12-26 13:16:12,110][123090] Updated weights for policy 1, policy_version 1701163 (0.0006) [2023-12-26 13:16:12,165][123090] Updated weights for policy 1, policy_version 1701173 (0.0006) [2023-12-26 13:16:12,227][123090] Updated weights for policy 1, policy_version 1701183 (0.0005) [2023-12-26 13:16:12,563][123091] Updated weights for policy 0, policy_version 1712563 (0.0007) [2023-12-26 13:16:12,634][123091] Updated weights for policy 0, policy_version 1712573 (0.0010) [2023-12-26 13:16:12,699][123091] Updated weights for policy 0, policy_version 1712583 (0.0009) [2023-12-26 13:16:12,967][123090] Updated weights for policy 1, policy_version 1701193 (0.0009) [2023-12-26 13:16:13,024][123090] Updated weights for policy 1, policy_version 1701203 (0.0006) [2023-12-26 13:16:13,069][123090] Updated weights for policy 1, policy_version 1701213 (0.0005) [2023-12-26 13:16:13,531][123091] Updated weights for policy 0, policy_version 1712593 (0.0008) [2023-12-26 13:16:13,597][123091] Updated weights for policy 0, policy_version 1712603 (0.0005) [2023-12-26 13:16:13,663][123091] Updated weights for policy 0, policy_version 1712613 (0.0005) [2023-12-26 13:16:13,730][123091] Updated weights for policy 0, policy_version 1712623 (0.0005) [2023-12-26 13:16:13,761][123090] Updated weights for policy 1, policy_version 1701223 (0.0008) [2023-12-26 13:16:13,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 873947136. Throughput: 0: 8877.0, 1: 8700.8. Samples: 873940372. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:16:13,785][121949] Avg episode reward: [(0, '6189.147'), (1, '5885.847')] [2023-12-26 13:16:13,815][123090] Updated weights for policy 1, policy_version 1701234 (0.0010) [2023-12-26 13:16:13,868][123090] Updated weights for policy 1, policy_version 1701244 (0.0010) [2023-12-26 13:16:14,365][123091] Updated weights for policy 0, policy_version 1712633 (0.0009) [2023-12-26 13:16:14,432][123091] Updated weights for policy 0, policy_version 1712643 (0.0006) [2023-12-26 13:16:14,498][123091] Updated weights for policy 0, policy_version 1712653 (0.0005) [2023-12-26 13:16:14,647][123090] Updated weights for policy 1, policy_version 1701254 (0.0006) [2023-12-26 13:16:14,718][123090] Updated weights for policy 1, policy_version 1701264 (0.0005) [2023-12-26 13:16:14,785][123090] Updated weights for policy 1, policy_version 1701274 (0.0007) [2023-12-26 13:16:15,265][123091] Updated weights for policy 0, policy_version 1712663 (0.0006) [2023-12-26 13:16:15,328][123091] Updated weights for policy 0, policy_version 1712673 (0.0009) [2023-12-26 13:16:15,391][123091] Updated weights for policy 0, policy_version 1712683 (0.0008) [2023-12-26 13:16:15,471][123090] Updated weights for policy 1, policy_version 1701284 (0.0008) [2023-12-26 13:16:15,534][123090] Updated weights for policy 1, policy_version 1701294 (0.0010) [2023-12-26 13:16:15,590][123090] Updated weights for policy 1, policy_version 1701304 (0.0009) [2023-12-26 13:16:15,983][123091] Updated weights for policy 0, policy_version 1712693 (0.0005) [2023-12-26 13:16:16,037][123091] Updated weights for policy 0, policy_version 1712703 (0.0005) [2023-12-26 13:16:16,094][123091] Updated weights for policy 0, policy_version 1712713 (0.0005) [2023-12-26 13:16:16,282][123090] Updated weights for policy 1, policy_version 1701314 (0.0008) [2023-12-26 13:16:16,333][123090] Updated weights for policy 1, policy_version 1701324 (0.0005) [2023-12-26 13:16:16,392][123090] Updated weights for policy 1, policy_version 1701334 (0.0005) [2023-12-26 13:16:16,452][123090] Updated weights for policy 1, policy_version 1701344 (0.0005) [2023-12-26 13:16:16,815][123091] Updated weights for policy 0, policy_version 1712723 (0.0006) [2023-12-26 13:16:16,864][123091] Updated weights for policy 0, policy_version 1712734 (0.0009) [2023-12-26 13:16:16,912][123091] Updated weights for policy 0, policy_version 1712744 (0.0009) [2023-12-26 13:16:17,078][123090] Updated weights for policy 1, policy_version 1701354 (0.0010) [2023-12-26 13:16:17,129][123090] Updated weights for policy 1, policy_version 1701364 (0.0010) [2023-12-26 13:16:17,180][123090] Updated weights for policy 1, policy_version 1701374 (0.0010) [2023-12-26 13:16:17,771][123091] Updated weights for policy 0, policy_version 1712754 (0.0009) [2023-12-26 13:16:17,835][123091] Updated weights for policy 0, policy_version 1712764 (0.0008) [2023-12-26 13:16:17,893][123091] Updated weights for policy 0, policy_version 1712774 (0.0008) [2023-12-26 13:16:17,947][123091] Updated weights for policy 0, policy_version 1712784 (0.0006) [2023-12-26 13:16:17,970][123090] Updated weights for policy 1, policy_version 1701384 (0.0006) [2023-12-26 13:16:18,018][123090] Updated weights for policy 1, policy_version 1701394 (0.0005) [2023-12-26 13:16:18,067][123090] Updated weights for policy 1, policy_version 1701404 (0.0005) [2023-12-26 13:16:18,735][123090] Updated weights for policy 1, policy_version 1701414 (0.0008) [2023-12-26 13:16:18,769][123091] Updated weights for policy 0, policy_version 1712794 (0.0008) [2023-12-26 13:16:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 874037248. Throughput: 0: 8932.8, 1: 8874.3. Samples: 874055188. Policy #0 lag: (min: 23.0, avg: 30.8, max: 55.0) [2023-12-26 13:16:18,785][121949] Avg episode reward: [(0, '6026.752'), (1, '5629.011')] [2023-12-26 13:16:18,788][123090] Updated weights for policy 1, policy_version 1701424 (0.0007) [2023-12-26 13:16:18,832][123091] Updated weights for policy 0, policy_version 1712804 (0.0008) [2023-12-26 13:16:18,847][123090] Updated weights for policy 1, policy_version 1701434 (0.0009) [2023-12-26 13:16:18,893][123091] Updated weights for policy 0, policy_version 1712814 (0.0009) [2023-12-26 13:16:19,640][123090] Updated weights for policy 1, policy_version 1701444 (0.0006) [2023-12-26 13:16:19,700][123090] Updated weights for policy 1, policy_version 1701454 (0.0007) [2023-12-26 13:16:19,761][123090] Updated weights for policy 1, policy_version 1701464 (0.0008) [2023-12-26 13:16:19,768][123091] Updated weights for policy 0, policy_version 1712824 (0.0010) [2023-12-26 13:16:19,824][123091] Updated weights for policy 0, policy_version 1712834 (0.0009) [2023-12-26 13:16:19,892][123091] Updated weights for policy 0, policy_version 1712844 (0.0009) [2023-12-26 13:16:20,616][123090] Updated weights for policy 1, policy_version 1701474 (0.0009) [2023-12-26 13:16:20,643][123091] Updated weights for policy 0, policy_version 1712854 (0.0007) [2023-12-26 13:16:20,678][123090] Updated weights for policy 1, policy_version 1701484 (0.0007) [2023-12-26 13:16:20,712][123091] Updated weights for policy 0, policy_version 1712864 (0.0010) [2023-12-26 13:16:20,746][123090] Updated weights for policy 1, policy_version 1701494 (0.0008) [2023-12-26 13:16:20,774][123091] Updated weights for policy 0, policy_version 1712874 (0.0006) [2023-12-26 13:16:20,806][123090] Updated weights for policy 1, policy_version 1701504 (0.0009) [2023-12-26 13:16:21,628][123090] Updated weights for policy 1, policy_version 1701514 (0.0006) [2023-12-26 13:16:21,646][123091] Updated weights for policy 0, policy_version 1712884 (0.0007) [2023-12-26 13:16:21,696][123090] Updated weights for policy 1, policy_version 1701524 (0.0007) [2023-12-26 13:16:21,715][123091] Updated weights for policy 0, policy_version 1712894 (0.0007) [2023-12-26 13:16:21,771][123090] Updated weights for policy 1, policy_version 1701534 (0.0009) [2023-12-26 13:16:21,784][123091] Updated weights for policy 0, policy_version 1712904 (0.0008) [2023-12-26 13:16:22,575][123091] Updated weights for policy 0, policy_version 1712914 (0.0009) [2023-12-26 13:16:22,599][123090] Updated weights for policy 1, policy_version 1701544 (0.0008) [2023-12-26 13:16:22,645][123091] Updated weights for policy 0, policy_version 1712924 (0.0005) [2023-12-26 13:16:22,659][123090] Updated weights for policy 1, policy_version 1701554 (0.0008) [2023-12-26 13:16:22,714][123091] Updated weights for policy 0, policy_version 1712934 (0.0007) [2023-12-26 13:16:22,727][123090] Updated weights for policy 1, policy_version 1701564 (0.0006) [2023-12-26 13:16:22,780][123091] Updated weights for policy 0, policy_version 1712944 (0.0010) [2023-12-26 13:16:23,510][123091] Updated weights for policy 0, policy_version 1712954 (0.0006) [2023-12-26 13:16:23,563][123091] Updated weights for policy 0, policy_version 1712964 (0.0008) [2023-12-26 13:16:23,569][123090] Updated weights for policy 1, policy_version 1701574 (0.0006) [2023-12-26 13:16:23,610][123091] Updated weights for policy 0, policy_version 1712974 (0.0010) [2023-12-26 13:16:23,629][123090] Updated weights for policy 1, policy_version 1701584 (0.0005) [2023-12-26 13:16:23,698][123090] Updated weights for policy 1, policy_version 1701594 (0.0007) [2023-12-26 13:16:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 874135552. Throughput: 0: 8934.0, 1: 8905.1. Samples: 874106764. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:23,784][121949] Avg episode reward: [(0, '6006.364'), (1, '5572.330')] [2023-12-26 13:16:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001701600_435609600.pth... [2023-12-26 13:16:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001712976_438525952.pth... [2023-12-26 13:16:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001700544_435339264.pth [2023-12-26 13:16:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001711920_438255616.pth [2023-12-26 13:16:24,426][123090] Updated weights for policy 1, policy_version 1701604 (0.0006) [2023-12-26 13:16:24,437][123091] Updated weights for policy 0, policy_version 1712984 (0.0011) [2023-12-26 13:16:24,483][123090] Updated weights for policy 1, policy_version 1701614 (0.0007) [2023-12-26 13:16:24,500][123091] Updated weights for policy 0, policy_version 1712994 (0.0010) [2023-12-26 13:16:24,544][123090] Updated weights for policy 1, policy_version 1701624 (0.0007) [2023-12-26 13:16:24,562][123091] Updated weights for policy 0, policy_version 1713004 (0.0010) [2023-12-26 13:16:25,303][123090] Updated weights for policy 1, policy_version 1701634 (0.0007) [2023-12-26 13:16:25,361][123090] Updated weights for policy 1, policy_version 1701644 (0.0008) [2023-12-26 13:16:25,382][123091] Updated weights for policy 0, policy_version 1713014 (0.0011) [2023-12-26 13:16:25,427][123090] Updated weights for policy 1, policy_version 1701654 (0.0010) [2023-12-26 13:16:25,445][123091] Updated weights for policy 0, policy_version 1713024 (0.0008) [2023-12-26 13:16:25,494][123090] Updated weights for policy 1, policy_version 1701664 (0.0006) [2023-12-26 13:16:25,508][123091] Updated weights for policy 0, policy_version 1713034 (0.0010) [2023-12-26 13:16:26,271][123090] Updated weights for policy 1, policy_version 1701674 (0.0007) [2023-12-26 13:16:26,313][123091] Updated weights for policy 0, policy_version 1713044 (0.0010) [2023-12-26 13:16:26,321][123090] Updated weights for policy 1, policy_version 1701684 (0.0005) [2023-12-26 13:16:26,372][123091] Updated weights for policy 0, policy_version 1713054 (0.0011) [2023-12-26 13:16:26,383][123090] Updated weights for policy 1, policy_version 1701694 (0.0005) [2023-12-26 13:16:26,432][123091] Updated weights for policy 0, policy_version 1713064 (0.0011) [2023-12-26 13:16:27,086][123090] Updated weights for policy 1, policy_version 1701704 (0.0007) [2023-12-26 13:16:27,164][123090] Updated weights for policy 1, policy_version 1701714 (0.0006) [2023-12-26 13:16:27,182][123091] Updated weights for policy 0, policy_version 1713074 (0.0009) [2023-12-26 13:16:27,220][123090] Updated weights for policy 1, policy_version 1701724 (0.0005) [2023-12-26 13:16:27,245][123091] Updated weights for policy 0, policy_version 1713084 (0.0005) [2023-12-26 13:16:27,303][123091] Updated weights for policy 0, policy_version 1713094 (0.0005) [2023-12-26 13:16:27,356][123091] Updated weights for policy 0, policy_version 1713104 (0.0010) [2023-12-26 13:16:27,822][123090] Updated weights for policy 1, policy_version 1701734 (0.0005) [2023-12-26 13:16:27,869][123090] Updated weights for policy 1, policy_version 1701744 (0.0005) [2023-12-26 13:16:27,918][123090] Updated weights for policy 1, policy_version 1701754 (0.0005) [2023-12-26 13:16:28,048][123091] Updated weights for policy 0, policy_version 1713114 (0.0006) [2023-12-26 13:16:28,110][123091] Updated weights for policy 0, policy_version 1713124 (0.0005) [2023-12-26 13:16:28,171][123091] Updated weights for policy 0, policy_version 1713134 (0.0005) [2023-12-26 13:16:28,734][123090] Updated weights for policy 1, policy_version 1701764 (0.0007) [2023-12-26 13:16:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 874217472. Throughput: 0: 9030.8, 1: 8975.1. Samples: 874215736. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:28,785][121949] Avg episode reward: [(0, '5986.109'), (1, '5815.279')] [2023-12-26 13:16:28,788][123090] Updated weights for policy 1, policy_version 1701774 (0.0008) [2023-12-26 13:16:28,815][123091] Updated weights for policy 0, policy_version 1713144 (0.0010) [2023-12-26 13:16:28,845][123090] Updated weights for policy 1, policy_version 1701784 (0.0009) [2023-12-26 13:16:28,874][123091] Updated weights for policy 0, policy_version 1713154 (0.0010) [2023-12-26 13:16:28,933][123091] Updated weights for policy 0, policy_version 1713164 (0.0010) [2023-12-26 13:16:29,720][123091] Updated weights for policy 0, policy_version 1713174 (0.0008) [2023-12-26 13:16:29,724][123090] Updated weights for policy 1, policy_version 1701794 (0.0007) [2023-12-26 13:16:29,777][123090] Updated weights for policy 1, policy_version 1701805 (0.0008) [2023-12-26 13:16:29,779][123091] Updated weights for policy 0, policy_version 1713184 (0.0005) [2023-12-26 13:16:29,846][123090] Updated weights for policy 1, policy_version 1701815 (0.0007) [2023-12-26 13:16:29,849][123091] Updated weights for policy 0, policy_version 1713194 (0.0010) [2023-12-26 13:16:30,525][123090] Updated weights for policy 1, policy_version 1701825 (0.0006) [2023-12-26 13:16:30,591][123090] Updated weights for policy 1, policy_version 1701835 (0.0007) [2023-12-26 13:16:30,618][123091] Updated weights for policy 0, policy_version 1713204 (0.0008) [2023-12-26 13:16:30,653][123090] Updated weights for policy 1, policy_version 1701845 (0.0006) [2023-12-26 13:16:30,669][123091] Updated weights for policy 0, policy_version 1713214 (0.0010) [2023-12-26 13:16:30,719][123090] Updated weights for policy 1, policy_version 1701855 (0.0005) [2023-12-26 13:16:30,728][123091] Updated weights for policy 0, policy_version 1713224 (0.0010) [2023-12-26 13:16:31,397][123090] Updated weights for policy 1, policy_version 1701865 (0.0009) [2023-12-26 13:16:31,463][123090] Updated weights for policy 1, policy_version 1701875 (0.0007) [2023-12-26 13:16:31,526][123090] Updated weights for policy 1, policy_version 1701885 (0.0009) [2023-12-26 13:16:31,563][123091] Updated weights for policy 0, policy_version 1713234 (0.0010) [2023-12-26 13:16:31,625][123091] Updated weights for policy 0, policy_version 1713244 (0.0009) [2023-12-26 13:16:31,694][123091] Updated weights for policy 0, policy_version 1713255 (0.0009) [2023-12-26 13:16:32,318][123090] Updated weights for policy 1, policy_version 1701895 (0.0007) [2023-12-26 13:16:32,386][123090] Updated weights for policy 1, policy_version 1701905 (0.0009) [2023-12-26 13:16:32,443][123090] Updated weights for policy 1, policy_version 1701915 (0.0007) [2023-12-26 13:16:32,569][123091] Updated weights for policy 0, policy_version 1713265 (0.0009) [2023-12-26 13:16:32,631][123091] Updated weights for policy 0, policy_version 1713275 (0.0006) [2023-12-26 13:16:32,681][123091] Updated weights for policy 0, policy_version 1713285 (0.0005) [2023-12-26 13:16:32,731][123091] Updated weights for policy 0, policy_version 1713295 (0.0005) [2023-12-26 13:16:33,152][123090] Updated weights for policy 1, policy_version 1701925 (0.0008) [2023-12-26 13:16:33,197][123090] Updated weights for policy 1, policy_version 1701935 (0.0007) [2023-12-26 13:16:33,244][123090] Updated weights for policy 1, policy_version 1701945 (0.0010) [2023-12-26 13:16:33,376][123091] Updated weights for policy 0, policy_version 1713305 (0.0005) [2023-12-26 13:16:33,433][123091] Updated weights for policy 0, policy_version 1713315 (0.0005) [2023-12-26 13:16:33,498][123091] Updated weights for policy 0, policy_version 1713325 (0.0005) [2023-12-26 13:16:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 874315776. Throughput: 0: 9020.8, 1: 9095.0. Samples: 874327152. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:33,785][121949] Avg episode reward: [(0, '5886.264'), (1, '5803.350')] [2023-12-26 13:16:33,995][123090] Updated weights for policy 1, policy_version 1701955 (0.0009) [2023-12-26 13:16:34,045][123091] Updated weights for policy 0, policy_version 1713335 (0.0005) [2023-12-26 13:16:34,046][123090] Updated weights for policy 1, policy_version 1701965 (0.0010) [2023-12-26 13:16:34,100][123091] Updated weights for policy 0, policy_version 1713345 (0.0005) [2023-12-26 13:16:34,100][123090] Updated weights for policy 1, policy_version 1701975 (0.0010) [2023-12-26 13:16:34,164][123091] Updated weights for policy 0, policy_version 1713355 (0.0008) [2023-12-26 13:16:34,895][123090] Updated weights for policy 1, policy_version 1701985 (0.0008) [2023-12-26 13:16:34,947][123090] Updated weights for policy 1, policy_version 1701995 (0.0010) [2023-12-26 13:16:34,963][123091] Updated weights for policy 0, policy_version 1713365 (0.0007) [2023-12-26 13:16:35,011][123090] Updated weights for policy 1, policy_version 1702005 (0.0008) [2023-12-26 13:16:35,022][123091] Updated weights for policy 0, policy_version 1713375 (0.0005) [2023-12-26 13:16:35,075][123090] Updated weights for policy 1, policy_version 1702015 (0.0008) [2023-12-26 13:16:35,093][123091] Updated weights for policy 0, policy_version 1713385 (0.0005) [2023-12-26 13:16:35,745][123091] Updated weights for policy 0, policy_version 1713395 (0.0007) [2023-12-26 13:16:35,811][123091] Updated weights for policy 0, policy_version 1713405 (0.0009) [2023-12-26 13:16:35,880][123091] Updated weights for policy 0, policy_version 1713415 (0.0011) [2023-12-26 13:16:35,926][123090] Updated weights for policy 1, policy_version 1702025 (0.0010) [2023-12-26 13:16:35,978][123090] Updated weights for policy 1, policy_version 1702035 (0.0010) [2023-12-26 13:16:36,026][123090] Updated weights for policy 1, policy_version 1702045 (0.0010) [2023-12-26 13:16:36,733][123091] Updated weights for policy 0, policy_version 1713425 (0.0009) [2023-12-26 13:16:36,793][123091] Updated weights for policy 0, policy_version 1713435 (0.0009) [2023-12-26 13:16:36,860][123091] Updated weights for policy 0, policy_version 1713445 (0.0009) [2023-12-26 13:16:36,872][123090] Updated weights for policy 1, policy_version 1702055 (0.0007) [2023-12-26 13:16:36,927][123091] Updated weights for policy 0, policy_version 1713455 (0.0009) [2023-12-26 13:16:36,934][123090] Updated weights for policy 1, policy_version 1702065 (0.0006) [2023-12-26 13:16:37,001][123090] Updated weights for policy 1, policy_version 1702075 (0.0006) [2023-12-26 13:16:37,552][123090] Updated weights for policy 1, policy_version 1702085 (0.0005) [2023-12-26 13:16:37,621][123090] Updated weights for policy 1, policy_version 1702095 (0.0005) [2023-12-26 13:16:37,669][123090] Updated weights for policy 1, policy_version 1702105 (0.0005) [2023-12-26 13:16:37,720][123091] Updated weights for policy 0, policy_version 1713465 (0.0006) [2023-12-26 13:16:37,774][123091] Updated weights for policy 0, policy_version 1713475 (0.0005) [2023-12-26 13:16:37,851][123091] Updated weights for policy 0, policy_version 1713485 (0.0006) [2023-12-26 13:16:38,310][123090] Updated weights for policy 1, policy_version 1702115 (0.0006) [2023-12-26 13:16:38,382][123090] Updated weights for policy 1, policy_version 1702125 (0.0010) [2023-12-26 13:16:38,434][123090] Updated weights for policy 1, policy_version 1702135 (0.0009) [2023-12-26 13:16:38,619][123091] Updated weights for policy 0, policy_version 1713495 (0.0008) [2023-12-26 13:16:38,680][123091] Updated weights for policy 0, policy_version 1713505 (0.0009) [2023-12-26 13:16:38,736][123091] Updated weights for policy 0, policy_version 1713515 (0.0010) [2023-12-26 13:16:38,784][121949] Fps is (10 sec: 19661.1, 60 sec: 18159.0, 300 sec: 17772.5). Total num frames: 874414080. Throughput: 0: 9110.7, 1: 9085.9. Samples: 874382264. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:38,784][121949] Avg episode reward: [(0, '5989.763'), (1, '5672.396')] [2023-12-26 13:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001713520_438665216.pth... [2023-12-26 13:16:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001702144_435748864.pth... [2023-12-26 13:16:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001712432_438386688.pth [2023-12-26 13:16:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001701056_435470336.pth [2023-12-26 13:16:39,268][123090] Updated weights for policy 1, policy_version 1702145 (0.0009) [2023-12-26 13:16:39,334][123090] Updated weights for policy 1, policy_version 1702155 (0.0009) [2023-12-26 13:16:39,404][123090] Updated weights for policy 1, policy_version 1702165 (0.0009) [2023-12-26 13:16:39,469][123090] Updated weights for policy 1, policy_version 1702175 (0.0009) [2023-12-26 13:16:39,597][123091] Updated weights for policy 0, policy_version 1713525 (0.0010) [2023-12-26 13:16:39,665][123091] Updated weights for policy 0, policy_version 1713535 (0.0008) [2023-12-26 13:16:39,726][123091] Updated weights for policy 0, policy_version 1713545 (0.0005) [2023-12-26 13:16:40,346][123090] Updated weights for policy 1, policy_version 1702185 (0.0010) [2023-12-26 13:16:40,409][123090] Updated weights for policy 1, policy_version 1702195 (0.0010) [2023-12-26 13:16:40,473][123090] Updated weights for policy 1, policy_version 1702205 (0.0009) [2023-12-26 13:16:40,512][123091] Updated weights for policy 0, policy_version 1713555 (0.0006) [2023-12-26 13:16:40,578][123091] Updated weights for policy 0, policy_version 1713565 (0.0008) [2023-12-26 13:16:40,637][123091] Updated weights for policy 0, policy_version 1713575 (0.0007) [2023-12-26 13:16:41,300][123090] Updated weights for policy 1, policy_version 1702215 (0.0009) [2023-12-26 13:16:41,344][123091] Updated weights for policy 0, policy_version 1713585 (0.0006) [2023-12-26 13:16:41,377][123090] Updated weights for policy 1, policy_version 1702225 (0.0010) [2023-12-26 13:16:41,411][123091] Updated weights for policy 0, policy_version 1713595 (0.0010) [2023-12-26 13:16:41,452][123090] Updated weights for policy 1, policy_version 1702235 (0.0006) [2023-12-26 13:16:41,473][123091] Updated weights for policy 0, policy_version 1713605 (0.0008) [2023-12-26 13:16:41,543][123091] Updated weights for policy 0, policy_version 1713615 (0.0010) [2023-12-26 13:16:42,286][123090] Updated weights for policy 1, policy_version 1702245 (0.0007) [2023-12-26 13:16:42,354][123090] Updated weights for policy 1, policy_version 1702255 (0.0008) [2023-12-26 13:16:42,409][123091] Updated weights for policy 0, policy_version 1713625 (0.0010) [2023-12-26 13:16:42,413][123090] Updated weights for policy 1, policy_version 1702265 (0.0008) [2023-12-26 13:16:42,462][123091] Updated weights for policy 0, policy_version 1713635 (0.0009) [2023-12-26 13:16:42,524][123091] Updated weights for policy 0, policy_version 1713645 (0.0009) [2023-12-26 13:16:43,179][123090] Updated weights for policy 1, policy_version 1702275 (0.0007) [2023-12-26 13:16:43,241][123090] Updated weights for policy 1, policy_version 1702285 (0.0008) [2023-12-26 13:16:43,297][123090] Updated weights for policy 1, policy_version 1702295 (0.0007) [2023-12-26 13:16:43,416][123091] Updated weights for policy 0, policy_version 1713655 (0.0010) [2023-12-26 13:16:43,491][123091] Updated weights for policy 0, policy_version 1713665 (0.0010) [2023-12-26 13:16:43,567][123091] Updated weights for policy 0, policy_version 1713675 (0.0009) [2023-12-26 13:16:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 874496000. Throughput: 0: 9086.9, 1: 9076.7. Samples: 874487580. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:43,785][121949] Avg episode reward: [(0, '6090.181'), (1, '5739.803')] [2023-12-26 13:16:43,970][123090] Updated weights for policy 1, policy_version 1702305 (0.0005) [2023-12-26 13:16:44,023][123090] Updated weights for policy 1, policy_version 1702315 (0.0005) [2023-12-26 13:16:44,074][123090] Updated weights for policy 1, policy_version 1702325 (0.0008) [2023-12-26 13:16:44,140][123090] Updated weights for policy 1, policy_version 1702335 (0.0009) [2023-12-26 13:16:44,401][123091] Updated weights for policy 0, policy_version 1713685 (0.0010) [2023-12-26 13:16:44,457][123091] Updated weights for policy 0, policy_version 1713695 (0.0010) [2023-12-26 13:16:44,521][123091] Updated weights for policy 0, policy_version 1713705 (0.0009) [2023-12-26 13:16:44,932][123090] Updated weights for policy 1, policy_version 1702345 (0.0006) [2023-12-26 13:16:45,007][123090] Updated weights for policy 1, policy_version 1702355 (0.0005) [2023-12-26 13:16:45,069][123090] Updated weights for policy 1, policy_version 1702365 (0.0006) [2023-12-26 13:16:45,381][123091] Updated weights for policy 0, policy_version 1713715 (0.0008) [2023-12-26 13:16:45,442][123091] Updated weights for policy 0, policy_version 1713725 (0.0006) [2023-12-26 13:16:45,493][123091] Updated weights for policy 0, policy_version 1713735 (0.0006) [2023-12-26 13:16:45,892][123090] Updated weights for policy 1, policy_version 1702375 (0.0008) [2023-12-26 13:16:45,950][123090] Updated weights for policy 1, policy_version 1702385 (0.0009) [2023-12-26 13:16:46,019][123090] Updated weights for policy 1, policy_version 1702395 (0.0008) [2023-12-26 13:16:46,146][123091] Updated weights for policy 0, policy_version 1713745 (0.0005) [2023-12-26 13:16:46,213][123091] Updated weights for policy 0, policy_version 1713755 (0.0005) [2023-12-26 13:16:46,272][123091] Updated weights for policy 0, policy_version 1713765 (0.0007) [2023-12-26 13:16:46,316][123091] Updated weights for policy 0, policy_version 1713775 (0.0008) [2023-12-26 13:16:46,931][123090] Updated weights for policy 1, policy_version 1702405 (0.0009) [2023-12-26 13:16:46,989][123090] Updated weights for policy 1, policy_version 1702415 (0.0009) [2023-12-26 13:16:47,016][123091] Updated weights for policy 0, policy_version 1713785 (0.0007) [2023-12-26 13:16:47,036][123090] Updated weights for policy 1, policy_version 1702425 (0.0007) [2023-12-26 13:16:47,071][123091] Updated weights for policy 0, policy_version 1713795 (0.0008) [2023-12-26 13:16:47,135][123091] Updated weights for policy 0, policy_version 1713805 (0.0009) [2023-12-26 13:16:47,810][123090] Updated weights for policy 1, policy_version 1702435 (0.0008) [2023-12-26 13:16:47,831][123091] Updated weights for policy 0, policy_version 1713815 (0.0007) [2023-12-26 13:16:47,868][123090] Updated weights for policy 1, policy_version 1702445 (0.0008) [2023-12-26 13:16:47,879][123091] Updated weights for policy 0, policy_version 1713825 (0.0007) [2023-12-26 13:16:47,921][123090] Updated weights for policy 1, policy_version 1702455 (0.0009) [2023-12-26 13:16:47,936][123091] Updated weights for policy 0, policy_version 1713835 (0.0006) [2023-12-26 13:16:48,689][123091] Updated weights for policy 0, policy_version 1713845 (0.0008) [2023-12-26 13:16:48,744][123091] Updated weights for policy 0, policy_version 1713855 (0.0010) [2023-12-26 13:16:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 874577920. Throughput: 0: 9115.2, 1: 9115.6. Samples: 874595960. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:48,784][121949] Avg episode reward: [(0, '5988.047'), (1, '5728.862')] [2023-12-26 13:16:48,803][123091] Updated weights for policy 0, policy_version 1713865 (0.0010) [2023-12-26 13:16:48,816][123090] Updated weights for policy 1, policy_version 1702465 (0.0008) [2023-12-26 13:16:48,873][123090] Updated weights for policy 1, policy_version 1702475 (0.0009) [2023-12-26 13:16:48,921][123090] Updated weights for policy 1, policy_version 1702485 (0.0008) [2023-12-26 13:16:48,971][123090] Updated weights for policy 1, policy_version 1702495 (0.0008) [2023-12-26 13:16:49,586][123091] Updated weights for policy 0, policy_version 1713875 (0.0009) [2023-12-26 13:16:49,651][123091] Updated weights for policy 0, policy_version 1713885 (0.0006) [2023-12-26 13:16:49,724][123091] Updated weights for policy 0, policy_version 1713895 (0.0010) [2023-12-26 13:16:49,922][123090] Updated weights for policy 1, policy_version 1702505 (0.0010) [2023-12-26 13:16:49,980][123090] Updated weights for policy 1, policy_version 1702515 (0.0009) [2023-12-26 13:16:50,035][123090] Updated weights for policy 1, policy_version 1702525 (0.0009) [2023-12-26 13:16:50,527][123091] Updated weights for policy 0, policy_version 1713905 (0.0010) [2023-12-26 13:16:50,599][123091] Updated weights for policy 0, policy_version 1713915 (0.0010) [2023-12-26 13:16:50,674][123091] Updated weights for policy 0, policy_version 1713925 (0.0011) [2023-12-26 13:16:50,737][123091] Updated weights for policy 0, policy_version 1713935 (0.0011) [2023-12-26 13:16:50,925][123090] Updated weights for policy 1, policy_version 1702535 (0.0007) [2023-12-26 13:16:50,999][123090] Updated weights for policy 1, policy_version 1702545 (0.0005) [2023-12-26 13:16:51,073][123090] Updated weights for policy 1, policy_version 1702555 (0.0008) [2023-12-26 13:16:51,559][123091] Updated weights for policy 0, policy_version 1713945 (0.0011) [2023-12-26 13:16:51,626][123091] Updated weights for policy 0, policy_version 1713955 (0.0011) [2023-12-26 13:16:51,695][123091] Updated weights for policy 0, policy_version 1713965 (0.0011) [2023-12-26 13:16:51,870][123090] Updated weights for policy 1, policy_version 1702565 (0.0009) [2023-12-26 13:16:51,920][123090] Updated weights for policy 1, policy_version 1702575 (0.0009) [2023-12-26 13:16:51,972][123090] Updated weights for policy 1, policy_version 1702585 (0.0009) [2023-12-26 13:16:52,489][123091] Updated weights for policy 0, policy_version 1713975 (0.0011) [2023-12-26 13:16:52,537][123091] Updated weights for policy 0, policy_version 1713985 (0.0011) [2023-12-26 13:16:52,600][123091] Updated weights for policy 0, policy_version 1713995 (0.0010) [2023-12-26 13:16:52,892][123090] Updated weights for policy 1, policy_version 1702595 (0.0008) [2023-12-26 13:16:52,948][123090] Updated weights for policy 1, policy_version 1702605 (0.0010) [2023-12-26 13:16:53,010][123090] Updated weights for policy 1, policy_version 1702615 (0.0010) [2023-12-26 13:16:53,329][123091] Updated weights for policy 0, policy_version 1714005 (0.0008) [2023-12-26 13:16:53,386][123091] Updated weights for policy 0, policy_version 1714015 (0.0005) [2023-12-26 13:16:53,452][123091] Updated weights for policy 0, policy_version 1714025 (0.0005) [2023-12-26 13:16:53,784][121949] Fps is (10 sec: 17202.7, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 874668032. Throughput: 0: 9083.4, 1: 9090.0. Samples: 874646784. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:53,785][121949] Avg episode reward: [(0, '6005.539'), (1, '5544.956')] [2023-12-26 13:16:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001714032_438796288.pth... [2023-12-26 13:16:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001702624_435871744.pth... [2023-12-26 13:16:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001712976_438525952.pth [2023-12-26 13:16:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001701600_435609600.pth [2023-12-26 13:16:53,966][123090] Updated weights for policy 1, policy_version 1702625 (0.0009) [2023-12-26 13:16:54,028][123090] Updated weights for policy 1, policy_version 1702635 (0.0010) [2023-12-26 13:16:54,042][123091] Updated weights for policy 0, policy_version 1714035 (0.0005) [2023-12-26 13:16:54,092][123090] Updated weights for policy 1, policy_version 1702645 (0.0007) [2023-12-26 13:16:54,101][123091] Updated weights for policy 0, policy_version 1714045 (0.0005) [2023-12-26 13:16:54,158][123090] Updated weights for policy 1, policy_version 1702655 (0.0009) [2023-12-26 13:16:54,161][123091] Updated weights for policy 0, policy_version 1714055 (0.0006) [2023-12-26 13:16:54,956][123091] Updated weights for policy 0, policy_version 1714065 (0.0006) [2023-12-26 13:16:54,994][123090] Updated weights for policy 1, policy_version 1702665 (0.0008) [2023-12-26 13:16:55,005][123091] Updated weights for policy 0, policy_version 1714075 (0.0009) [2023-12-26 13:16:55,052][123090] Updated weights for policy 1, policy_version 1702675 (0.0008) [2023-12-26 13:16:55,056][123091] Updated weights for policy 0, policy_version 1714085 (0.0005) [2023-12-26 13:16:55,106][123090] Updated weights for policy 1, policy_version 1702685 (0.0009) [2023-12-26 13:16:55,109][123091] Updated weights for policy 0, policy_version 1714095 (0.0005) [2023-12-26 13:16:55,817][123091] Updated weights for policy 0, policy_version 1714105 (0.0007) [2023-12-26 13:16:55,868][123091] Updated weights for policy 0, policy_version 1714115 (0.0010) [2023-12-26 13:16:55,937][123091] Updated weights for policy 0, policy_version 1714125 (0.0010) [2023-12-26 13:16:56,015][123090] Updated weights for policy 1, policy_version 1702695 (0.0009) [2023-12-26 13:16:56,082][123090] Updated weights for policy 1, policy_version 1702705 (0.0010) [2023-12-26 13:16:56,152][123090] Updated weights for policy 1, policy_version 1702715 (0.0010) [2023-12-26 13:16:56,626][123091] Updated weights for policy 0, policy_version 1714135 (0.0007) [2023-12-26 13:16:56,695][123091] Updated weights for policy 0, policy_version 1714145 (0.0005) [2023-12-26 13:16:56,761][123091] Updated weights for policy 0, policy_version 1714155 (0.0005) [2023-12-26 13:16:57,071][123090] Updated weights for policy 1, policy_version 1702725 (0.0011) [2023-12-26 13:16:57,126][123090] Updated weights for policy 1, policy_version 1702736 (0.0010) [2023-12-26 13:16:57,183][123090] Updated weights for policy 1, policy_version 1702746 (0.0010) [2023-12-26 13:16:57,270][123091] Updated weights for policy 0, policy_version 1714165 (0.0006) [2023-12-26 13:16:57,325][123091] Updated weights for policy 0, policy_version 1714175 (0.0010) [2023-12-26 13:16:57,397][123091] Updated weights for policy 0, policy_version 1714185 (0.0005) [2023-12-26 13:16:58,085][123090] Updated weights for policy 1, policy_version 1702756 (0.0010) [2023-12-26 13:16:58,100][123091] Updated weights for policy 0, policy_version 1714195 (0.0007) [2023-12-26 13:16:58,152][123090] Updated weights for policy 1, policy_version 1702766 (0.0007) [2023-12-26 13:16:58,166][123091] Updated weights for policy 0, policy_version 1714205 (0.0011) [2023-12-26 13:16:58,216][123090] Updated weights for policy 1, policy_version 1702776 (0.0008) [2023-12-26 13:16:58,229][123091] Updated weights for policy 0, policy_version 1714215 (0.0011) [2023-12-26 13:16:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 874758144. Throughput: 0: 9147.0, 1: 8912.9. Samples: 874753068. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:16:58,785][121949] Avg episode reward: [(0, '6064.748'), (1, '5603.035')] [2023-12-26 13:16:59,017][123090] Updated weights for policy 1, policy_version 1702786 (0.0008) [2023-12-26 13:16:59,066][123091] Updated weights for policy 0, policy_version 1714225 (0.0010) [2023-12-26 13:16:59,079][123090] Updated weights for policy 1, policy_version 1702796 (0.0010) [2023-12-26 13:16:59,110][123091] Updated weights for policy 0, policy_version 1714235 (0.0007) [2023-12-26 13:16:59,136][123090] Updated weights for policy 1, policy_version 1702806 (0.0007) [2023-12-26 13:16:59,155][123091] Updated weights for policy 0, policy_version 1714245 (0.0005) [2023-12-26 13:16:59,197][123090] Updated weights for policy 1, policy_version 1702816 (0.0005) [2023-12-26 13:16:59,212][123091] Updated weights for policy 0, policy_version 1714255 (0.0005) [2023-12-26 13:16:59,971][123090] Updated weights for policy 1, policy_version 1702826 (0.0011) [2023-12-26 13:16:59,986][123091] Updated weights for policy 0, policy_version 1714265 (0.0006) [2023-12-26 13:17:00,039][123090] Updated weights for policy 1, policy_version 1702836 (0.0010) [2023-12-26 13:17:00,055][123091] Updated weights for policy 0, policy_version 1714275 (0.0006) [2023-12-26 13:17:00,104][123090] Updated weights for policy 1, policy_version 1702846 (0.0009) [2023-12-26 13:17:00,115][123091] Updated weights for policy 0, policy_version 1714285 (0.0006) [2023-12-26 13:17:00,769][123091] Updated weights for policy 0, policy_version 1714295 (0.0008) [2023-12-26 13:17:00,823][123091] Updated weights for policy 0, policy_version 1714305 (0.0009) [2023-12-26 13:17:00,857][123090] Updated weights for policy 1, policy_version 1702856 (0.0005) [2023-12-26 13:17:00,872][123091] Updated weights for policy 0, policy_version 1714316 (0.0009) [2023-12-26 13:17:00,906][123090] Updated weights for policy 1, policy_version 1702866 (0.0005) [2023-12-26 13:17:00,957][123090] Updated weights for policy 1, policy_version 1702876 (0.0005) [2023-12-26 13:17:01,701][123091] Updated weights for policy 0, policy_version 1714326 (0.0009) [2023-12-26 13:17:01,737][123090] Updated weights for policy 1, policy_version 1702886 (0.0008) [2023-12-26 13:17:01,762][123091] Updated weights for policy 0, policy_version 1714336 (0.0007) [2023-12-26 13:17:01,790][123090] Updated weights for policy 1, policy_version 1702896 (0.0011) [2023-12-26 13:17:01,811][123091] Updated weights for policy 0, policy_version 1714346 (0.0008) [2023-12-26 13:17:01,834][123090] Updated weights for policy 1, policy_version 1702906 (0.0010) [2023-12-26 13:17:02,673][123090] Updated weights for policy 1, policy_version 1702916 (0.0010) [2023-12-26 13:17:02,684][123091] Updated weights for policy 0, policy_version 1714356 (0.0006) [2023-12-26 13:17:02,741][123090] Updated weights for policy 1, policy_version 1702926 (0.0008) [2023-12-26 13:17:02,747][123091] Updated weights for policy 0, policy_version 1714366 (0.0008) [2023-12-26 13:17:02,804][123091] Updated weights for policy 0, policy_version 1714376 (0.0009) [2023-12-26 13:17:02,812][123090] Updated weights for policy 1, policy_version 1702936 (0.0006) [2023-12-26 13:17:03,475][123091] Updated weights for policy 0, policy_version 1714386 (0.0007) [2023-12-26 13:17:03,526][123091] Updated weights for policy 0, policy_version 1714396 (0.0010) [2023-12-26 13:17:03,576][123091] Updated weights for policy 0, policy_version 1714406 (0.0010) [2023-12-26 13:17:03,603][123090] Updated weights for policy 1, policy_version 1702946 (0.0010) [2023-12-26 13:17:03,635][123091] Updated weights for policy 0, policy_version 1714416 (0.0010) [2023-12-26 13:17:03,654][123090] Updated weights for policy 1, policy_version 1702956 (0.0010) [2023-12-26 13:17:03,720][123090] Updated weights for policy 1, policy_version 1702966 (0.0010) [2023-12-26 13:17:03,779][123090] Updated weights for policy 1, policy_version 1702976 (0.0005) [2023-12-26 13:17:03,784][121949] Fps is (10 sec: 18842.2, 60 sec: 18295.5, 300 sec: 17744.7). Total num frames: 874856448. Throughput: 0: 9126.7, 1: 8782.4. Samples: 874861096. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:03,784][121949] Avg episode reward: [(0, '6019.750'), (1, '5554.701')] [2023-12-26 13:17:04,457][123091] Updated weights for policy 0, policy_version 1714426 (0.0005) [2023-12-26 13:17:04,506][123090] Updated weights for policy 1, policy_version 1702986 (0.0011) [2023-12-26 13:17:04,522][123091] Updated weights for policy 0, policy_version 1714436 (0.0006) [2023-12-26 13:17:04,582][123090] Updated weights for policy 1, policy_version 1702996 (0.0011) [2023-12-26 13:17:04,586][123091] Updated weights for policy 0, policy_version 1714446 (0.0005) [2023-12-26 13:17:04,652][123090] Updated weights for policy 1, policy_version 1703006 (0.0011) [2023-12-26 13:17:05,326][123091] Updated weights for policy 0, policy_version 1714456 (0.0009) [2023-12-26 13:17:05,365][123090] Updated weights for policy 1, policy_version 1703016 (0.0007) [2023-12-26 13:17:05,389][123091] Updated weights for policy 0, policy_version 1714466 (0.0011) [2023-12-26 13:17:05,422][123090] Updated weights for policy 1, policy_version 1703026 (0.0007) [2023-12-26 13:17:05,452][123091] Updated weights for policy 0, policy_version 1714476 (0.0011) [2023-12-26 13:17:05,476][123090] Updated weights for policy 1, policy_version 1703036 (0.0008) [2023-12-26 13:17:06,184][123091] Updated weights for policy 0, policy_version 1714486 (0.0009) [2023-12-26 13:17:06,249][123091] Updated weights for policy 0, policy_version 1714496 (0.0009) [2023-12-26 13:17:06,316][123091] Updated weights for policy 0, policy_version 1714506 (0.0009) [2023-12-26 13:17:06,390][123090] Updated weights for policy 1, policy_version 1703046 (0.0010) [2023-12-26 13:17:06,457][123090] Updated weights for policy 1, policy_version 1703056 (0.0008) [2023-12-26 13:17:06,530][123090] Updated weights for policy 1, policy_version 1703066 (0.0006) [2023-12-26 13:17:07,198][123091] Updated weights for policy 0, policy_version 1714516 (0.0009) [2023-12-26 13:17:07,261][123091] Updated weights for policy 0, policy_version 1714526 (0.0009) [2023-12-26 13:17:07,265][123090] Updated weights for policy 1, policy_version 1703076 (0.0006) [2023-12-26 13:17:07,317][123091] Updated weights for policy 0, policy_version 1714536 (0.0009) [2023-12-26 13:17:07,325][123090] Updated weights for policy 1, policy_version 1703086 (0.0006) [2023-12-26 13:17:07,391][123090] Updated weights for policy 1, policy_version 1703096 (0.0006) [2023-12-26 13:17:08,096][123090] Updated weights for policy 1, policy_version 1703106 (0.0007) [2023-12-26 13:17:08,111][123091] Updated weights for policy 0, policy_version 1714546 (0.0009) [2023-12-26 13:17:08,156][123090] Updated weights for policy 1, policy_version 1703116 (0.0006) [2023-12-26 13:17:08,166][123091] Updated weights for policy 0, policy_version 1714556 (0.0010) [2023-12-26 13:17:08,216][123090] Updated weights for policy 1, policy_version 1703126 (0.0008) [2023-12-26 13:17:08,228][123091] Updated weights for policy 0, policy_version 1714566 (0.0010) [2023-12-26 13:17:08,278][123090] Updated weights for policy 1, policy_version 1703136 (0.0009) [2023-12-26 13:17:08,283][123091] Updated weights for policy 0, policy_version 1714576 (0.0010) [2023-12-26 13:17:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.3, 300 sec: 17716.9). Total num frames: 874938368. Throughput: 0: 9177.8, 1: 8799.7. Samples: 874915756. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:08,785][121949] Avg episode reward: [(0, '5913.324'), (1, '5346.295')] [2023-12-26 13:17:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001714576_438935552.pth... [2023-12-26 13:17:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001703136_436002816.pth... [2023-12-26 13:17:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001713520_438665216.pth [2023-12-26 13:17:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001702144_435748864.pth [2023-12-26 13:17:08,953][123091] Updated weights for policy 0, policy_version 1714586 (0.0010) [2023-12-26 13:17:09,013][123091] Updated weights for policy 0, policy_version 1714596 (0.0008) [2023-12-26 13:17:09,078][123091] Updated weights for policy 0, policy_version 1714606 (0.0006) [2023-12-26 13:17:09,114][123090] Updated weights for policy 1, policy_version 1703146 (0.0006) [2023-12-26 13:17:09,182][123090] Updated weights for policy 1, policy_version 1703156 (0.0005) [2023-12-26 13:17:09,249][123090] Updated weights for policy 1, policy_version 1703166 (0.0008) [2023-12-26 13:17:09,869][123091] Updated weights for policy 0, policy_version 1714616 (0.0009) [2023-12-26 13:17:09,934][123091] Updated weights for policy 0, policy_version 1714626 (0.0010) [2023-12-26 13:17:09,999][123091] Updated weights for policy 0, policy_version 1714636 (0.0011) [2023-12-26 13:17:10,061][123090] Updated weights for policy 1, policy_version 1703176 (0.0009) [2023-12-26 13:17:10,121][123090] Updated weights for policy 1, policy_version 1703186 (0.0008) [2023-12-26 13:17:10,184][123090] Updated weights for policy 1, policy_version 1703196 (0.0008) [2023-12-26 13:17:10,817][123091] Updated weights for policy 0, policy_version 1714646 (0.0011) [2023-12-26 13:17:10,869][123091] Updated weights for policy 0, policy_version 1714656 (0.0011) [2023-12-26 13:17:10,886][123090] Updated weights for policy 1, policy_version 1703206 (0.0007) [2023-12-26 13:17:10,921][123091] Updated weights for policy 0, policy_version 1714666 (0.0011) [2023-12-26 13:17:10,938][123090] Updated weights for policy 1, policy_version 1703216 (0.0005) [2023-12-26 13:17:10,993][123090] Updated weights for policy 1, policy_version 1703226 (0.0005) [2023-12-26 13:17:11,817][123090] Updated weights for policy 1, policy_version 1703236 (0.0007) [2023-12-26 13:17:11,844][123091] Updated weights for policy 0, policy_version 1714676 (0.0011) [2023-12-26 13:17:11,888][123090] Updated weights for policy 1, policy_version 1703246 (0.0010) [2023-12-26 13:17:11,913][123091] Updated weights for policy 0, policy_version 1714686 (0.0011) [2023-12-26 13:17:11,963][123090] Updated weights for policy 1, policy_version 1703256 (0.0008) [2023-12-26 13:17:11,978][123091] Updated weights for policy 0, policy_version 1714696 (0.0010) [2023-12-26 13:17:12,756][123091] Updated weights for policy 0, policy_version 1714706 (0.0007) [2023-12-26 13:17:12,819][123091] Updated weights for policy 0, policy_version 1714716 (0.0011) [2023-12-26 13:17:12,874][123090] Updated weights for policy 1, policy_version 1703266 (0.0008) [2023-12-26 13:17:12,884][123091] Updated weights for policy 0, policy_version 1714726 (0.0011) [2023-12-26 13:17:12,940][123090] Updated weights for policy 1, policy_version 1703276 (0.0006) [2023-12-26 13:17:12,951][123091] Updated weights for policy 0, policy_version 1714736 (0.0011) [2023-12-26 13:17:13,001][123090] Updated weights for policy 1, policy_version 1703286 (0.0005) [2023-12-26 13:17:13,051][123090] Updated weights for policy 1, policy_version 1703296 (0.0005) [2023-12-26 13:17:13,628][123091] Updated weights for policy 0, policy_version 1714746 (0.0005) [2023-12-26 13:17:13,693][123091] Updated weights for policy 0, policy_version 1714756 (0.0005) [2023-12-26 13:17:13,709][123090] Updated weights for policy 1, policy_version 1703306 (0.0007) [2023-12-26 13:17:13,755][123091] Updated weights for policy 0, policy_version 1714766 (0.0005) [2023-12-26 13:17:13,772][123090] Updated weights for policy 1, policy_version 1703316 (0.0008) [2023-12-26 13:17:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 875028480. Throughput: 0: 9143.8, 1: 8749.9. Samples: 875020952. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:13,785][121949] Avg episode reward: [(0, '5933.959'), (1, '5453.442')] [2023-12-26 13:17:13,826][123090] Updated weights for policy 1, policy_version 1703326 (0.0010) [2023-12-26 13:17:14,395][123091] Updated weights for policy 0, policy_version 1714776 (0.0006) [2023-12-26 13:17:14,465][123091] Updated weights for policy 0, policy_version 1714786 (0.0011) [2023-12-26 13:17:14,531][123091] Updated weights for policy 0, policy_version 1714796 (0.0011) [2023-12-26 13:17:14,719][123090] Updated weights for policy 1, policy_version 1703336 (0.0009) [2023-12-26 13:17:14,789][123090] Updated weights for policy 1, policy_version 1703346 (0.0007) [2023-12-26 13:17:14,858][123090] Updated weights for policy 1, policy_version 1703356 (0.0006) [2023-12-26 13:17:15,282][123091] Updated weights for policy 0, policy_version 1714806 (0.0010) [2023-12-26 13:17:15,346][123091] Updated weights for policy 0, policy_version 1714816 (0.0009) [2023-12-26 13:17:15,397][123091] Updated weights for policy 0, policy_version 1714826 (0.0009) [2023-12-26 13:17:15,646][123090] Updated weights for policy 1, policy_version 1703366 (0.0008) [2023-12-26 13:17:15,698][123090] Updated weights for policy 1, policy_version 1703376 (0.0010) [2023-12-26 13:17:15,759][123090] Updated weights for policy 1, policy_version 1703386 (0.0010) [2023-12-26 13:17:16,198][123091] Updated weights for policy 0, policy_version 1714836 (0.0009) [2023-12-26 13:17:16,246][123091] Updated weights for policy 0, policy_version 1714846 (0.0009) [2023-12-26 13:17:16,289][123091] Updated weights for policy 0, policy_version 1714856 (0.0007) [2023-12-26 13:17:16,588][123090] Updated weights for policy 1, policy_version 1703396 (0.0010) [2023-12-26 13:17:16,635][123090] Updated weights for policy 1, policy_version 1703406 (0.0010) [2023-12-26 13:17:16,686][123090] Updated weights for policy 1, policy_version 1703416 (0.0010) [2023-12-26 13:17:17,023][123091] Updated weights for policy 0, policy_version 1714866 (0.0006) [2023-12-26 13:17:17,081][123091] Updated weights for policy 0, policy_version 1714876 (0.0009) [2023-12-26 13:17:17,130][123091] Updated weights for policy 0, policy_version 1714886 (0.0009) [2023-12-26 13:17:17,180][123091] Updated weights for policy 0, policy_version 1714896 (0.0009) [2023-12-26 13:17:17,528][123090] Updated weights for policy 1, policy_version 1703426 (0.0010) [2023-12-26 13:17:17,575][123090] Updated weights for policy 1, policy_version 1703436 (0.0010) [2023-12-26 13:17:17,631][123090] Updated weights for policy 1, policy_version 1703446 (0.0010) [2023-12-26 13:17:17,692][123090] Updated weights for policy 1, policy_version 1703456 (0.0008) [2023-12-26 13:17:18,019][123091] Updated weights for policy 0, policy_version 1714906 (0.0009) [2023-12-26 13:17:18,077][123091] Updated weights for policy 0, policy_version 1714916 (0.0010) [2023-12-26 13:17:18,140][123091] Updated weights for policy 0, policy_version 1714926 (0.0010) [2023-12-26 13:17:18,475][123090] Updated weights for policy 1, policy_version 1703466 (0.0005) [2023-12-26 13:17:18,537][123090] Updated weights for policy 1, policy_version 1703476 (0.0006) [2023-12-26 13:17:18,591][123090] Updated weights for policy 1, policy_version 1703486 (0.0005) [2023-12-26 13:17:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 875118592. Throughput: 0: 9161.2, 1: 8687.8. Samples: 875130360. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:18,784][121949] Avg episode reward: [(0, '6054.962'), (1, '5615.897')] [2023-12-26 13:17:18,941][123091] Updated weights for policy 0, policy_version 1714936 (0.0010) [2023-12-26 13:17:18,996][123091] Updated weights for policy 0, policy_version 1714946 (0.0010) [2023-12-26 13:17:19,044][123091] Updated weights for policy 0, policy_version 1714956 (0.0010) [2023-12-26 13:17:19,177][123090] Updated weights for policy 1, policy_version 1703496 (0.0005) [2023-12-26 13:17:19,241][123090] Updated weights for policy 1, policy_version 1703506 (0.0006) [2023-12-26 13:17:19,307][123090] Updated weights for policy 1, policy_version 1703516 (0.0011) [2023-12-26 13:17:19,867][123091] Updated weights for policy 0, policy_version 1714966 (0.0011) [2023-12-26 13:17:19,938][123091] Updated weights for policy 0, policy_version 1714976 (0.0010) [2023-12-26 13:17:20,003][123091] Updated weights for policy 0, policy_version 1714986 (0.0008) [2023-12-26 13:17:20,029][123090] Updated weights for policy 1, policy_version 1703526 (0.0009) [2023-12-26 13:17:20,097][123090] Updated weights for policy 1, policy_version 1703536 (0.0009) [2023-12-26 13:17:20,163][123090] Updated weights for policy 1, policy_version 1703546 (0.0009) [2023-12-26 13:17:20,867][123091] Updated weights for policy 0, policy_version 1714996 (0.0009) [2023-12-26 13:17:20,933][123091] Updated weights for policy 0, policy_version 1715006 (0.0009) [2023-12-26 13:17:20,948][123090] Updated weights for policy 1, policy_version 1703556 (0.0009) [2023-12-26 13:17:20,994][123091] Updated weights for policy 0, policy_version 1715016 (0.0006) [2023-12-26 13:17:21,015][123090] Updated weights for policy 1, policy_version 1703566 (0.0011) [2023-12-26 13:17:21,088][123090] Updated weights for policy 1, policy_version 1703576 (0.0011) [2023-12-26 13:17:21,913][123090] Updated weights for policy 1, policy_version 1703586 (0.0011) [2023-12-26 13:17:21,937][123091] Updated weights for policy 0, policy_version 1715026 (0.0008) [2023-12-26 13:17:21,981][123090] Updated weights for policy 1, policy_version 1703596 (0.0011) [2023-12-26 13:17:22,003][123091] Updated weights for policy 0, policy_version 1715036 (0.0011) [2023-12-26 13:17:22,046][123090] Updated weights for policy 1, policy_version 1703606 (0.0010) [2023-12-26 13:17:22,067][123091] Updated weights for policy 0, policy_version 1715046 (0.0008) [2023-12-26 13:17:22,108][123090] Updated weights for policy 1, policy_version 1703616 (0.0008) [2023-12-26 13:17:22,137][123091] Updated weights for policy 0, policy_version 1715056 (0.0006) [2023-12-26 13:17:22,873][123091] Updated weights for policy 0, policy_version 1715066 (0.0010) [2023-12-26 13:17:22,928][123090] Updated weights for policy 1, policy_version 1703626 (0.0006) [2023-12-26 13:17:22,936][123091] Updated weights for policy 0, policy_version 1715076 (0.0009) [2023-12-26 13:17:22,989][123090] Updated weights for policy 1, policy_version 1703636 (0.0007) [2023-12-26 13:17:22,994][123091] Updated weights for policy 0, policy_version 1715086 (0.0010) [2023-12-26 13:17:23,052][123090] Updated weights for policy 1, policy_version 1703646 (0.0009) [2023-12-26 13:17:23,764][123091] Updated weights for policy 0, policy_version 1715096 (0.0010) [2023-12-26 13:17:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 875200512. Throughput: 0: 9066.6, 1: 8710.4. Samples: 875182236. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:23,785][121949] Avg episode reward: [(0, '5946.607'), (1, '5648.797')] [2023-12-26 13:17:23,815][123091] Updated weights for policy 0, policy_version 1715107 (0.0009) [2023-12-26 13:17:23,835][123090] Updated weights for policy 1, policy_version 1703656 (0.0006) [2023-12-26 13:17:23,868][123091] Updated weights for policy 0, policy_version 1715117 (0.0009) [2023-12-26 13:17:23,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001715120_439074816.pth... [2023-12-26 13:17:23,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001714032_438796288.pth [2023-12-26 13:17:23,888][123090] Updated weights for policy 1, policy_version 1703666 (0.0005) [2023-12-26 13:17:23,943][123090] Updated weights for policy 1, policy_version 1703676 (0.0005) [2023-12-26 13:17:23,970][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001703680_436142080.pth... [2023-12-26 13:17:23,975][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001702624_435871744.pth [2023-12-26 13:17:24,568][123090] Updated weights for policy 1, policy_version 1703686 (0.0008) [2023-12-26 13:17:24,624][123090] Updated weights for policy 1, policy_version 1703696 (0.0009) [2023-12-26 13:17:24,626][123091] Updated weights for policy 0, policy_version 1715127 (0.0008) [2023-12-26 13:17:24,683][123090] Updated weights for policy 1, policy_version 1703706 (0.0007) [2023-12-26 13:17:24,692][123091] Updated weights for policy 0, policy_version 1715137 (0.0007) [2023-12-26 13:17:24,755][123091] Updated weights for policy 0, policy_version 1715147 (0.0009) [2023-12-26 13:17:25,422][123090] Updated weights for policy 1, policy_version 1703716 (0.0005) [2023-12-26 13:17:25,488][123090] Updated weights for policy 1, policy_version 1703726 (0.0005) [2023-12-26 13:17:25,546][123090] Updated weights for policy 1, policy_version 1703736 (0.0006) [2023-12-26 13:17:25,580][123091] Updated weights for policy 0, policy_version 1715157 (0.0009) [2023-12-26 13:17:25,636][123091] Updated weights for policy 0, policy_version 1715167 (0.0009) [2023-12-26 13:17:25,693][123091] Updated weights for policy 0, policy_version 1715177 (0.0009) [2023-12-26 13:17:26,241][123090] Updated weights for policy 1, policy_version 1703746 (0.0008) [2023-12-26 13:17:26,288][123090] Updated weights for policy 1, policy_version 1703756 (0.0008) [2023-12-26 13:17:26,334][123090] Updated weights for policy 1, policy_version 1703766 (0.0008) [2023-12-26 13:17:26,386][123090] Updated weights for policy 1, policy_version 1703776 (0.0009) [2023-12-26 13:17:26,581][123091] Updated weights for policy 0, policy_version 1715187 (0.0010) [2023-12-26 13:17:26,636][123091] Updated weights for policy 0, policy_version 1715197 (0.0009) [2023-12-26 13:17:26,688][123091] Updated weights for policy 0, policy_version 1715207 (0.0009) [2023-12-26 13:17:27,196][123090] Updated weights for policy 1, policy_version 1703786 (0.0005) [2023-12-26 13:17:27,243][123090] Updated weights for policy 1, policy_version 1703796 (0.0005) [2023-12-26 13:17:27,304][123090] Updated weights for policy 1, policy_version 1703806 (0.0006) [2023-12-26 13:17:27,576][123091] Updated weights for policy 0, policy_version 1715217 (0.0010) [2023-12-26 13:17:27,635][123091] Updated weights for policy 0, policy_version 1715227 (0.0009) [2023-12-26 13:17:27,701][123091] Updated weights for policy 0, policy_version 1715238 (0.0013) [2023-12-26 13:17:27,759][123091] Updated weights for policy 0, policy_version 1715248 (0.0010) [2023-12-26 13:17:27,981][123090] Updated weights for policy 1, policy_version 1703816 (0.0005) [2023-12-26 13:17:28,050][123090] Updated weights for policy 1, policy_version 1703826 (0.0005) [2023-12-26 13:17:28,102][123090] Updated weights for policy 1, policy_version 1703836 (0.0005) [2023-12-26 13:17:28,706][123091] Updated weights for policy 0, policy_version 1715258 (0.0009) [2023-12-26 13:17:28,767][123091] Updated weights for policy 0, policy_version 1715268 (0.0009) [2023-12-26 13:17:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 875290624. Throughput: 0: 9055.9, 1: 8787.9. Samples: 875290552. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:28,785][121949] Avg episode reward: [(0, '5977.029'), (1, '5572.184')] [2023-12-26 13:17:28,799][123090] Updated weights for policy 1, policy_version 1703846 (0.0006) [2023-12-26 13:17:28,824][123091] Updated weights for policy 0, policy_version 1715278 (0.0008) [2023-12-26 13:17:28,858][123090] Updated weights for policy 1, policy_version 1703856 (0.0010) [2023-12-26 13:17:28,923][123090] Updated weights for policy 1, policy_version 1703866 (0.0009) [2023-12-26 13:17:29,669][123090] Updated weights for policy 1, policy_version 1703876 (0.0007) [2023-12-26 13:17:29,692][123091] Updated weights for policy 0, policy_version 1715288 (0.0009) [2023-12-26 13:17:29,731][123090] Updated weights for policy 1, policy_version 1703886 (0.0011) [2023-12-26 13:17:29,743][123091] Updated weights for policy 0, policy_version 1715298 (0.0008) [2023-12-26 13:17:29,786][123090] Updated weights for policy 1, policy_version 1703896 (0.0010) [2023-12-26 13:17:29,802][123091] Updated weights for policy 0, policy_version 1715308 (0.0006) [2023-12-26 13:17:30,561][123090] Updated weights for policy 1, policy_version 1703906 (0.0009) [2023-12-26 13:17:30,619][123090] Updated weights for policy 1, policy_version 1703916 (0.0006) [2023-12-26 13:17:30,691][123090] Updated weights for policy 1, policy_version 1703926 (0.0006) [2023-12-26 13:17:30,722][123091] Updated weights for policy 0, policy_version 1715318 (0.0008) [2023-12-26 13:17:30,747][123090] Updated weights for policy 1, policy_version 1703936 (0.0005) [2023-12-26 13:17:30,773][123091] Updated weights for policy 0, policy_version 1715328 (0.0009) [2023-12-26 13:17:30,826][123091] Updated weights for policy 0, policy_version 1715338 (0.0010) [2023-12-26 13:17:31,394][123090] Updated weights for policy 1, policy_version 1703946 (0.0009) [2023-12-26 13:17:31,458][123090] Updated weights for policy 1, policy_version 1703956 (0.0009) [2023-12-26 13:17:31,536][123090] Updated weights for policy 1, policy_version 1703966 (0.0005) [2023-12-26 13:17:31,697][123091] Updated weights for policy 0, policy_version 1715348 (0.0008) [2023-12-26 13:17:31,770][123091] Updated weights for policy 0, policy_version 1715358 (0.0010) [2023-12-26 13:17:31,833][123091] Updated weights for policy 0, policy_version 1715368 (0.0008) [2023-12-26 13:17:32,232][123090] Updated weights for policy 1, policy_version 1703976 (0.0005) [2023-12-26 13:17:32,289][123090] Updated weights for policy 1, policy_version 1703986 (0.0006) [2023-12-26 13:17:32,350][123090] Updated weights for policy 1, policy_version 1703996 (0.0008) [2023-12-26 13:17:32,747][123091] Updated weights for policy 0, policy_version 1715378 (0.0010) [2023-12-26 13:17:32,801][123091] Updated weights for policy 0, policy_version 1715388 (0.0010) [2023-12-26 13:17:32,854][123091] Updated weights for policy 0, policy_version 1715398 (0.0010) [2023-12-26 13:17:32,932][123091] Updated weights for policy 0, policy_version 1715408 (0.0009) [2023-12-26 13:17:33,043][123090] Updated weights for policy 1, policy_version 1704006 (0.0007) [2023-12-26 13:17:33,113][123090] Updated weights for policy 1, policy_version 1704016 (0.0006) [2023-12-26 13:17:33,185][123090] Updated weights for policy 1, policy_version 1704026 (0.0009) [2023-12-26 13:17:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 875380736. Throughput: 0: 8883.5, 1: 8914.4. Samples: 875396864. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:33,784][121949] Avg episode reward: [(0, '5987.603'), (1, '5642.744')] [2023-12-26 13:17:33,844][123090] Updated weights for policy 1, policy_version 1704036 (0.0009) [2023-12-26 13:17:33,858][123091] Updated weights for policy 0, policy_version 1715418 (0.0009) [2023-12-26 13:17:33,888][123090] Updated weights for policy 1, policy_version 1704046 (0.0005) [2023-12-26 13:17:33,910][123091] Updated weights for policy 0, policy_version 1715428 (0.0009) [2023-12-26 13:17:33,934][123090] Updated weights for policy 1, policy_version 1704056 (0.0005) [2023-12-26 13:17:33,968][123091] Updated weights for policy 0, policy_version 1715438 (0.0009) [2023-12-26 13:17:34,650][123090] Updated weights for policy 1, policy_version 1704066 (0.0006) [2023-12-26 13:17:34,706][123090] Updated weights for policy 1, policy_version 1704076 (0.0010) [2023-12-26 13:17:34,765][123090] Updated weights for policy 1, policy_version 1704086 (0.0010) [2023-12-26 13:17:34,823][123090] Updated weights for policy 1, policy_version 1704096 (0.0010) [2023-12-26 13:17:34,854][123091] Updated weights for policy 0, policy_version 1715448 (0.0008) [2023-12-26 13:17:34,915][123091] Updated weights for policy 0, policy_version 1715458 (0.0009) [2023-12-26 13:17:34,976][123091] Updated weights for policy 0, policy_version 1715468 (0.0009) [2023-12-26 13:17:35,511][123090] Updated weights for policy 1, policy_version 1704106 (0.0010) [2023-12-26 13:17:35,566][123090] Updated weights for policy 1, policy_version 1704116 (0.0009) [2023-12-26 13:17:35,635][123090] Updated weights for policy 1, policy_version 1704126 (0.0007) [2023-12-26 13:17:35,877][123091] Updated weights for policy 0, policy_version 1715478 (0.0009) [2023-12-26 13:17:35,951][123091] Updated weights for policy 0, policy_version 1715488 (0.0009) [2023-12-26 13:17:36,021][123091] Updated weights for policy 0, policy_version 1715498 (0.0009) [2023-12-26 13:17:36,448][123090] Updated weights for policy 1, policy_version 1704136 (0.0010) [2023-12-26 13:17:36,515][123090] Updated weights for policy 1, policy_version 1704146 (0.0011) [2023-12-26 13:17:36,593][123090] Updated weights for policy 1, policy_version 1704156 (0.0009) [2023-12-26 13:17:36,768][123091] Updated weights for policy 0, policy_version 1715508 (0.0007) [2023-12-26 13:17:36,817][123091] Updated weights for policy 0, policy_version 1715518 (0.0005) [2023-12-26 13:17:36,862][123091] Updated weights for policy 0, policy_version 1715528 (0.0005) [2023-12-26 13:17:37,224][123090] Updated weights for policy 1, policy_version 1704166 (0.0005) [2023-12-26 13:17:37,292][123090] Updated weights for policy 1, policy_version 1704176 (0.0005) [2023-12-26 13:17:37,361][123090] Updated weights for policy 1, policy_version 1704186 (0.0005) [2023-12-26 13:17:37,575][123091] Updated weights for policy 0, policy_version 1715538 (0.0006) [2023-12-26 13:17:37,628][123091] Updated weights for policy 0, policy_version 1715548 (0.0007) [2023-12-26 13:17:37,674][123091] Updated weights for policy 0, policy_version 1715558 (0.0005) [2023-12-26 13:17:37,734][123091] Updated weights for policy 0, policy_version 1715568 (0.0008) [2023-12-26 13:17:38,095][123090] Updated weights for policy 1, policy_version 1704196 (0.0007) [2023-12-26 13:17:38,160][123090] Updated weights for policy 1, policy_version 1704206 (0.0011) [2023-12-26 13:17:38,227][123090] Updated weights for policy 1, policy_version 1704216 (0.0011) [2023-12-26 13:17:38,496][123091] Updated weights for policy 0, policy_version 1715578 (0.0006) [2023-12-26 13:17:38,556][123091] Updated weights for policy 0, policy_version 1715588 (0.0006) [2023-12-26 13:17:38,619][123091] Updated weights for policy 0, policy_version 1715598 (0.0007) [2023-12-26 13:17:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 875479040. Throughput: 0: 8848.9, 1: 8994.6. Samples: 875449740. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:38,785][121949] Avg episode reward: [(0, '5970.609'), (1, '5645.836')] [2023-12-26 13:17:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001715600_439197696.pth... [2023-12-26 13:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001704224_436281344.pth... [2023-12-26 13:17:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001714576_438935552.pth [2023-12-26 13:17:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001703136_436002816.pth [2023-12-26 13:17:38,984][123090] Updated weights for policy 1, policy_version 1704226 (0.0009) [2023-12-26 13:17:39,047][123090] Updated weights for policy 1, policy_version 1704236 (0.0006) [2023-12-26 13:17:39,111][123090] Updated weights for policy 1, policy_version 1704246 (0.0006) [2023-12-26 13:17:39,185][123090] Updated weights for policy 1, policy_version 1704256 (0.0006) [2023-12-26 13:17:39,332][123091] Updated weights for policy 0, policy_version 1715608 (0.0008) [2023-12-26 13:17:39,408][123091] Updated weights for policy 0, policy_version 1715618 (0.0010) [2023-12-26 13:17:39,468][123091] Updated weights for policy 0, policy_version 1715628 (0.0008) [2023-12-26 13:17:39,954][123090] Updated weights for policy 1, policy_version 1704266 (0.0008) [2023-12-26 13:17:40,019][123090] Updated weights for policy 1, policy_version 1704276 (0.0007) [2023-12-26 13:17:40,086][123090] Updated weights for policy 1, policy_version 1704286 (0.0009) [2023-12-26 13:17:40,367][123091] Updated weights for policy 0, policy_version 1715638 (0.0010) [2023-12-26 13:17:40,427][123091] Updated weights for policy 0, policy_version 1715648 (0.0010) [2023-12-26 13:17:40,487][123091] Updated weights for policy 0, policy_version 1715658 (0.0009) [2023-12-26 13:17:40,856][123090] Updated weights for policy 1, policy_version 1704296 (0.0010) [2023-12-26 13:17:40,908][123090] Updated weights for policy 1, policy_version 1704306 (0.0009) [2023-12-26 13:17:40,965][123090] Updated weights for policy 1, policy_version 1704316 (0.0010) [2023-12-26 13:17:41,294][123091] Updated weights for policy 0, policy_version 1715668 (0.0009) [2023-12-26 13:17:41,357][123091] Updated weights for policy 0, policy_version 1715678 (0.0008) [2023-12-26 13:17:41,433][123091] Updated weights for policy 0, policy_version 1715688 (0.0008) [2023-12-26 13:17:41,843][123090] Updated weights for policy 1, policy_version 1704326 (0.0010) [2023-12-26 13:17:41,906][123090] Updated weights for policy 1, policy_version 1704336 (0.0011) [2023-12-26 13:17:41,969][123090] Updated weights for policy 1, policy_version 1704346 (0.0010) [2023-12-26 13:17:42,245][123091] Updated weights for policy 0, policy_version 1715698 (0.0008) [2023-12-26 13:17:42,309][123091] Updated weights for policy 0, policy_version 1715708 (0.0009) [2023-12-26 13:17:42,377][123091] Updated weights for policy 0, policy_version 1715718 (0.0010) [2023-12-26 13:17:42,461][123091] Updated weights for policy 0, policy_version 1715728 (0.0009) [2023-12-26 13:17:42,775][123090] Updated weights for policy 1, policy_version 1704356 (0.0010) [2023-12-26 13:17:42,843][123090] Updated weights for policy 1, policy_version 1704366 (0.0010) [2023-12-26 13:17:42,903][123090] Updated weights for policy 1, policy_version 1704376 (0.0009) [2023-12-26 13:17:43,263][123091] Updated weights for policy 0, policy_version 1715738 (0.0009) [2023-12-26 13:17:43,320][123091] Updated weights for policy 0, policy_version 1715748 (0.0009) [2023-12-26 13:17:43,376][123091] Updated weights for policy 0, policy_version 1715758 (0.0009) [2023-12-26 13:17:43,737][123090] Updated weights for policy 1, policy_version 1704386 (0.0008) [2023-12-26 13:17:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 875560960. Throughput: 0: 8741.8, 1: 9146.8. Samples: 875558052. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:43,784][121949] Avg episode reward: [(0, '6076.738'), (1, '5318.946')] [2023-12-26 13:17:43,791][123090] Updated weights for policy 1, policy_version 1704396 (0.0008) [2023-12-26 13:17:43,851][123090] Updated weights for policy 1, policy_version 1704406 (0.0009) [2023-12-26 13:17:43,905][123090] Updated weights for policy 1, policy_version 1704416 (0.0008) [2023-12-26 13:17:44,222][123091] Updated weights for policy 0, policy_version 1715768 (0.0009) [2023-12-26 13:17:44,274][123091] Updated weights for policy 0, policy_version 1715778 (0.0009) [2023-12-26 13:17:44,336][123091] Updated weights for policy 0, policy_version 1715788 (0.0009) [2023-12-26 13:17:44,748][123090] Updated weights for policy 1, policy_version 1704426 (0.0009) [2023-12-26 13:17:44,810][123090] Updated weights for policy 1, policy_version 1704436 (0.0010) [2023-12-26 13:17:44,869][123090] Updated weights for policy 1, policy_version 1704446 (0.0007) [2023-12-26 13:17:45,217][123091] Updated weights for policy 0, policy_version 1715798 (0.0010) [2023-12-26 13:17:45,285][123091] Updated weights for policy 0, policy_version 1715808 (0.0011) [2023-12-26 13:17:45,352][123091] Updated weights for policy 0, policy_version 1715818 (0.0011) [2023-12-26 13:17:45,713][123090] Updated weights for policy 1, policy_version 1704456 (0.0009) [2023-12-26 13:17:45,761][123090] Updated weights for policy 1, policy_version 1704466 (0.0008) [2023-12-26 13:17:45,821][123090] Updated weights for policy 1, policy_version 1704476 (0.0009) [2023-12-26 13:17:46,077][123091] Updated weights for policy 0, policy_version 1715828 (0.0011) [2023-12-26 13:17:46,147][123091] Updated weights for policy 0, policy_version 1715838 (0.0011) [2023-12-26 13:17:46,209][123091] Updated weights for policy 0, policy_version 1715848 (0.0010) [2023-12-26 13:17:46,698][123090] Updated weights for policy 1, policy_version 1704486 (0.0009) [2023-12-26 13:17:46,754][123090] Updated weights for policy 1, policy_version 1704496 (0.0009) [2023-12-26 13:17:46,820][123090] Updated weights for policy 1, policy_version 1704506 (0.0009) [2023-12-26 13:17:46,989][123091] Updated weights for policy 0, policy_version 1715858 (0.0010) [2023-12-26 13:17:47,054][123091] Updated weights for policy 0, policy_version 1715868 (0.0006) [2023-12-26 13:17:47,124][123091] Updated weights for policy 0, policy_version 1715878 (0.0007) [2023-12-26 13:17:47,186][123091] Updated weights for policy 0, policy_version 1715888 (0.0010) [2023-12-26 13:17:47,711][123090] Updated weights for policy 1, policy_version 1704516 (0.0009) [2023-12-26 13:17:47,767][123090] Updated weights for policy 1, policy_version 1704526 (0.0009) [2023-12-26 13:17:47,822][123090] Updated weights for policy 1, policy_version 1704536 (0.0009) [2023-12-26 13:17:47,862][123091] Updated weights for policy 0, policy_version 1715898 (0.0005) [2023-12-26 13:17:47,920][123091] Updated weights for policy 0, policy_version 1715908 (0.0005) [2023-12-26 13:17:47,998][123091] Updated weights for policy 0, policy_version 1715918 (0.0007) [2023-12-26 13:17:48,640][123090] Updated weights for policy 1, policy_version 1704546 (0.0008) [2023-12-26 13:17:48,662][123091] Updated weights for policy 0, policy_version 1715928 (0.0008) [2023-12-26 13:17:48,711][123090] Updated weights for policy 1, policy_version 1704556 (0.0007) [2023-12-26 13:17:48,728][123091] Updated weights for policy 0, policy_version 1715938 (0.0007) [2023-12-26 13:17:48,782][123090] Updated weights for policy 1, policy_version 1704566 (0.0008) [2023-12-26 13:17:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 875642880. Throughput: 0: 8729.2, 1: 9083.6. Samples: 875662672. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:48,784][123091] Updated weights for policy 0, policy_version 1715948 (0.0008) [2023-12-26 13:17:48,784][121949] Avg episode reward: [(0, '6223.625'), (1, '5232.974')] [2023-12-26 13:17:48,851][123090] Updated weights for policy 1, policy_version 1704576 (0.0007) [2023-12-26 13:17:49,498][123091] Updated weights for policy 0, policy_version 1715958 (0.0007) [2023-12-26 13:17:49,573][123091] Updated weights for policy 0, policy_version 1715968 (0.0005) [2023-12-26 13:17:49,629][123091] Updated weights for policy 0, policy_version 1715978 (0.0005) [2023-12-26 13:17:49,728][123090] Updated weights for policy 1, policy_version 1704586 (0.0009) [2023-12-26 13:17:49,798][123090] Updated weights for policy 1, policy_version 1704596 (0.0009) [2023-12-26 13:17:49,878][123090] Updated weights for policy 1, policy_version 1704606 (0.0009) [2023-12-26 13:17:50,321][123091] Updated weights for policy 0, policy_version 1715988 (0.0007) [2023-12-26 13:17:50,391][123091] Updated weights for policy 0, policy_version 1715998 (0.0006) [2023-12-26 13:17:50,449][123091] Updated weights for policy 0, policy_version 1716008 (0.0008) [2023-12-26 13:17:50,714][123090] Updated weights for policy 1, policy_version 1704616 (0.0010) [2023-12-26 13:17:50,772][123090] Updated weights for policy 1, policy_version 1704626 (0.0010) [2023-12-26 13:17:50,829][123090] Updated weights for policy 1, policy_version 1704637 (0.0010) [2023-12-26 13:17:51,262][123091] Updated weights for policy 0, policy_version 1716018 (0.0010) [2023-12-26 13:17:51,332][123091] Updated weights for policy 0, policy_version 1716028 (0.0009) [2023-12-26 13:17:51,403][123091] Updated weights for policy 0, policy_version 1716038 (0.0010) [2023-12-26 13:17:51,465][123091] Updated weights for policy 0, policy_version 1716048 (0.0010) [2023-12-26 13:17:51,696][123090] Updated weights for policy 1, policy_version 1704647 (0.0009) [2023-12-26 13:17:51,771][123090] Updated weights for policy 1, policy_version 1704657 (0.0010) [2023-12-26 13:17:51,843][123090] Updated weights for policy 1, policy_version 1704667 (0.0009) [2023-12-26 13:17:52,300][123091] Updated weights for policy 0, policy_version 1716058 (0.0009) [2023-12-26 13:17:52,368][123091] Updated weights for policy 0, policy_version 1716068 (0.0009) [2023-12-26 13:17:52,422][123091] Updated weights for policy 0, policy_version 1716078 (0.0009) [2023-12-26 13:17:52,681][123090] Updated weights for policy 1, policy_version 1704677 (0.0010) [2023-12-26 13:17:52,751][123090] Updated weights for policy 1, policy_version 1704687 (0.0009) [2023-12-26 13:17:52,809][123090] Updated weights for policy 1, policy_version 1704697 (0.0009) [2023-12-26 13:17:53,200][123091] Updated weights for policy 0, policy_version 1716088 (0.0006) [2023-12-26 13:17:53,246][123091] Updated weights for policy 0, policy_version 1716098 (0.0005) [2023-12-26 13:17:53,302][123091] Updated weights for policy 0, policy_version 1716108 (0.0007) [2023-12-26 13:17:53,669][123090] Updated weights for policy 1, policy_version 1704707 (0.0007) [2023-12-26 13:17:53,740][123090] Updated weights for policy 1, policy_version 1704717 (0.0007) [2023-12-26 13:17:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 875732992. Throughput: 0: 8717.0, 1: 9031.1. Samples: 875714420. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:53,785][121949] Avg episode reward: [(0, '6148.219'), (1, '5268.514')] [2023-12-26 13:17:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001716112_439328768.pth... [2023-12-26 13:17:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001715120_439074816.pth [2023-12-26 13:17:53,795][123090] Updated weights for policy 1, policy_version 1704727 (0.0010) [2023-12-26 13:17:53,844][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001704736_436412416.pth... [2023-12-26 13:17:53,847][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001703680_436142080.pth [2023-12-26 13:17:54,076][123091] Updated weights for policy 0, policy_version 1716118 (0.0007) [2023-12-26 13:17:54,142][123091] Updated weights for policy 0, policy_version 1716128 (0.0007) [2023-12-26 13:17:54,206][123091] Updated weights for policy 0, policy_version 1716138 (0.0011) [2023-12-26 13:17:54,547][123090] Updated weights for policy 1, policy_version 1704737 (0.0010) [2023-12-26 13:17:54,595][123090] Updated weights for policy 1, policy_version 1704747 (0.0005) [2023-12-26 13:17:54,642][123090] Updated weights for policy 1, policy_version 1704757 (0.0005) [2023-12-26 13:17:54,696][123090] Updated weights for policy 1, policy_version 1704767 (0.0005) [2023-12-26 13:17:54,990][123091] Updated weights for policy 0, policy_version 1716148 (0.0009) [2023-12-26 13:17:55,060][123091] Updated weights for policy 0, policy_version 1716158 (0.0006) [2023-12-26 13:17:55,123][123091] Updated weights for policy 0, policy_version 1716168 (0.0005) [2023-12-26 13:17:55,434][123090] Updated weights for policy 1, policy_version 1704777 (0.0010) [2023-12-26 13:17:55,489][123090] Updated weights for policy 1, policy_version 1704787 (0.0010) [2023-12-26 13:17:55,539][123090] Updated weights for policy 1, policy_version 1704797 (0.0009) [2023-12-26 13:17:55,754][123091] Updated weights for policy 0, policy_version 1716178 (0.0006) [2023-12-26 13:17:55,809][123091] Updated weights for policy 0, policy_version 1716188 (0.0010) [2023-12-26 13:17:55,861][123091] Updated weights for policy 0, policy_version 1716198 (0.0010) [2023-12-26 13:17:55,912][123091] Updated weights for policy 0, policy_version 1716208 (0.0010) [2023-12-26 13:17:56,218][123090] Updated weights for policy 1, policy_version 1704807 (0.0005) [2023-12-26 13:17:56,269][123090] Updated weights for policy 1, policy_version 1704817 (0.0005) [2023-12-26 13:17:56,319][123090] Updated weights for policy 1, policy_version 1704827 (0.0005) [2023-12-26 13:17:56,638][123091] Updated weights for policy 0, policy_version 1716218 (0.0005) [2023-12-26 13:17:56,685][123091] Updated weights for policy 0, policy_version 1716228 (0.0005) [2023-12-26 13:17:56,730][123091] Updated weights for policy 0, policy_version 1716238 (0.0005) [2023-12-26 13:17:57,015][123090] Updated weights for policy 1, policy_version 1704837 (0.0006) [2023-12-26 13:17:57,062][123090] Updated weights for policy 1, policy_version 1704847 (0.0010) [2023-12-26 13:17:57,113][123090] Updated weights for policy 1, policy_version 1704857 (0.0010) [2023-12-26 13:17:57,397][123091] Updated weights for policy 0, policy_version 1716248 (0.0005) [2023-12-26 13:17:57,464][123091] Updated weights for policy 0, policy_version 1716258 (0.0005) [2023-12-26 13:17:57,523][123091] Updated weights for policy 0, policy_version 1716268 (0.0005) [2023-12-26 13:17:57,927][123090] Updated weights for policy 1, policy_version 1704867 (0.0010) [2023-12-26 13:17:57,981][123090] Updated weights for policy 1, policy_version 1704877 (0.0010) [2023-12-26 13:17:58,032][123090] Updated weights for policy 1, policy_version 1704887 (0.0010) [2023-12-26 13:17:58,219][123091] Updated weights for policy 0, policy_version 1716278 (0.0006) [2023-12-26 13:17:58,291][123091] Updated weights for policy 0, policy_version 1716288 (0.0010) [2023-12-26 13:17:58,355][123091] Updated weights for policy 0, policy_version 1716298 (0.0009) [2023-12-26 13:17:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 875831296. Throughput: 0: 8835.7, 1: 9080.9. Samples: 875827200. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:17:58,785][121949] Avg episode reward: [(0, '6073.647'), (1, '5016.605')] [2023-12-26 13:17:58,950][123090] Updated weights for policy 1, policy_version 1704897 (0.0009) [2023-12-26 13:17:59,013][123090] Updated weights for policy 1, policy_version 1704907 (0.0009) [2023-12-26 13:17:59,072][123090] Updated weights for policy 1, policy_version 1704917 (0.0009) [2023-12-26 13:17:59,134][123090] Updated weights for policy 1, policy_version 1704927 (0.0009) [2023-12-26 13:17:59,320][123091] Updated weights for policy 0, policy_version 1716308 (0.0010) [2023-12-26 13:17:59,386][123091] Updated weights for policy 0, policy_version 1716318 (0.0008) [2023-12-26 13:17:59,465][123091] Updated weights for policy 0, policy_version 1716328 (0.0008) [2023-12-26 13:18:00,068][123090] Updated weights for policy 1, policy_version 1704937 (0.0010) [2023-12-26 13:18:00,135][123090] Updated weights for policy 1, policy_version 1704947 (0.0010) [2023-12-26 13:18:00,202][123090] Updated weights for policy 1, policy_version 1704957 (0.0010) [2023-12-26 13:18:00,245][123091] Updated weights for policy 0, policy_version 1716338 (0.0009) [2023-12-26 13:18:00,308][123091] Updated weights for policy 0, policy_version 1716348 (0.0009) [2023-12-26 13:18:00,370][123091] Updated weights for policy 0, policy_version 1716358 (0.0009) [2023-12-26 13:18:00,423][123091] Updated weights for policy 0, policy_version 1716368 (0.0009) [2023-12-26 13:18:00,993][123090] Updated weights for policy 1, policy_version 1704967 (0.0010) [2023-12-26 13:18:01,062][123090] Updated weights for policy 1, policy_version 1704977 (0.0010) [2023-12-26 13:18:01,128][123090] Updated weights for policy 1, policy_version 1704987 (0.0009) [2023-12-26 13:18:01,286][123091] Updated weights for policy 0, policy_version 1716378 (0.0008) [2023-12-26 13:18:01,348][123091] Updated weights for policy 0, policy_version 1716388 (0.0008) [2023-12-26 13:18:01,415][123091] Updated weights for policy 0, policy_version 1716398 (0.0008) [2023-12-26 13:18:02,015][123090] Updated weights for policy 1, policy_version 1704997 (0.0009) [2023-12-26 13:18:02,073][123090] Updated weights for policy 1, policy_version 1705007 (0.0010) [2023-12-26 13:18:02,137][123090] Updated weights for policy 1, policy_version 1705017 (0.0006) [2023-12-26 13:18:02,180][123091] Updated weights for policy 0, policy_version 1716408 (0.0006) [2023-12-26 13:18:02,243][123091] Updated weights for policy 0, policy_version 1716418 (0.0005) [2023-12-26 13:18:02,307][123091] Updated weights for policy 0, policy_version 1716428 (0.0006) [2023-12-26 13:18:02,900][123090] Updated weights for policy 1, policy_version 1705027 (0.0006) [2023-12-26 13:18:02,955][123090] Updated weights for policy 1, policy_version 1705037 (0.0009) [2023-12-26 13:18:03,003][123090] Updated weights for policy 1, policy_version 1705047 (0.0009) [2023-12-26 13:18:03,081][123091] Updated weights for policy 0, policy_version 1716438 (0.0009) [2023-12-26 13:18:03,150][123091] Updated weights for policy 0, policy_version 1716448 (0.0011) [2023-12-26 13:18:03,216][123091] Updated weights for policy 0, policy_version 1716458 (0.0010) [2023-12-26 13:18:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 875913216. Throughput: 0: 8727.3, 1: 9007.1. Samples: 875928408. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:18:03,785][121949] Avg episode reward: [(0, '5879.553'), (1, '5100.314')] [2023-12-26 13:18:03,869][123090] Updated weights for policy 1, policy_version 1705057 (0.0009) [2023-12-26 13:18:03,928][123091] Updated weights for policy 0, policy_version 1716468 (0.0009) [2023-12-26 13:18:03,937][123090] Updated weights for policy 1, policy_version 1705067 (0.0010) [2023-12-26 13:18:03,984][123091] Updated weights for policy 0, policy_version 1716478 (0.0008) [2023-12-26 13:18:04,004][123090] Updated weights for policy 1, policy_version 1705077 (0.0007) [2023-12-26 13:18:04,044][123091] Updated weights for policy 0, policy_version 1716488 (0.0008) [2023-12-26 13:18:04,060][123090] Updated weights for policy 1, policy_version 1705087 (0.0008) [2023-12-26 13:18:04,820][123091] Updated weights for policy 0, policy_version 1716498 (0.0010) [2023-12-26 13:18:04,876][123091] Updated weights for policy 0, policy_version 1716508 (0.0007) [2023-12-26 13:18:04,891][123090] Updated weights for policy 1, policy_version 1705097 (0.0009) [2023-12-26 13:18:04,933][123091] Updated weights for policy 0, policy_version 1716518 (0.0009) [2023-12-26 13:18:04,944][123090] Updated weights for policy 1, policy_version 1705107 (0.0008) [2023-12-26 13:18:04,991][123091] Updated weights for policy 0, policy_version 1716528 (0.0010) [2023-12-26 13:18:04,994][123090] Updated weights for policy 1, policy_version 1705117 (0.0008) [2023-12-26 13:18:05,771][123091] Updated weights for policy 0, policy_version 1716538 (0.0007) [2023-12-26 13:18:05,828][123091] Updated weights for policy 0, policy_version 1716548 (0.0007) [2023-12-26 13:18:05,863][123090] Updated weights for policy 1, policy_version 1705127 (0.0008) [2023-12-26 13:18:05,893][123091] Updated weights for policy 0, policy_version 1716558 (0.0006) [2023-12-26 13:18:05,920][123090] Updated weights for policy 1, policy_version 1705137 (0.0010) [2023-12-26 13:18:05,977][123090] Updated weights for policy 1, policy_version 1705147 (0.0009) [2023-12-26 13:18:06,575][123091] Updated weights for policy 0, policy_version 1716568 (0.0010) [2023-12-26 13:18:06,641][123091] Updated weights for policy 0, policy_version 1716578 (0.0010) [2023-12-26 13:18:06,705][123091] Updated weights for policy 0, policy_version 1716588 (0.0008) [2023-12-26 13:18:06,894][123090] Updated weights for policy 1, policy_version 1705157 (0.0010) [2023-12-26 13:18:06,952][123090] Updated weights for policy 1, policy_version 1705167 (0.0010) [2023-12-26 13:18:07,006][123090] Updated weights for policy 1, policy_version 1705177 (0.0009) [2023-12-26 13:18:07,482][123091] Updated weights for policy 0, policy_version 1716598 (0.0011) [2023-12-26 13:18:07,542][123091] Updated weights for policy 0, policy_version 1716608 (0.0011) [2023-12-26 13:18:07,590][123091] Updated weights for policy 0, policy_version 1716618 (0.0010) [2023-12-26 13:18:07,854][123090] Updated weights for policy 1, policy_version 1705187 (0.0009) [2023-12-26 13:18:07,925][123090] Updated weights for policy 1, policy_version 1705197 (0.0009) [2023-12-26 13:18:07,979][123090] Updated weights for policy 1, policy_version 1705207 (0.0009) [2023-12-26 13:18:08,409][123091] Updated weights for policy 0, policy_version 1716628 (0.0011) [2023-12-26 13:18:08,465][123091] Updated weights for policy 0, policy_version 1716638 (0.0011) [2023-12-26 13:18:08,528][123091] Updated weights for policy 0, policy_version 1716648 (0.0011) [2023-12-26 13:18:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 876003328. Throughput: 0: 8812.3, 1: 8945.3. Samples: 875981328. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:18:08,785][121949] Avg episode reward: [(0, '5832.893'), (1, '5239.782')] [2023-12-26 13:18:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001716656_439468032.pth... [2023-12-26 13:18:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001705216_436535296.pth... [2023-12-26 13:18:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001715600_439197696.pth [2023-12-26 13:18:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001704224_436281344.pth [2023-12-26 13:18:08,822][123090] Updated weights for policy 1, policy_version 1705217 (0.0009) [2023-12-26 13:18:08,884][123090] Updated weights for policy 1, policy_version 1705227 (0.0009) [2023-12-26 13:18:08,945][123090] Updated weights for policy 1, policy_version 1705237 (0.0010) [2023-12-26 13:18:09,010][123090] Updated weights for policy 1, policy_version 1705247 (0.0010) [2023-12-26 13:18:09,340][123091] Updated weights for policy 0, policy_version 1716658 (0.0009) [2023-12-26 13:18:09,419][123091] Updated weights for policy 0, policy_version 1716668 (0.0009) [2023-12-26 13:18:09,488][123091] Updated weights for policy 0, policy_version 1716678 (0.0010) [2023-12-26 13:18:09,554][123091] Updated weights for policy 0, policy_version 1716688 (0.0010) [2023-12-26 13:18:09,858][123090] Updated weights for policy 1, policy_version 1705257 (0.0008) [2023-12-26 13:18:09,941][123090] Updated weights for policy 1, policy_version 1705267 (0.0008) [2023-12-26 13:18:10,010][123090] Updated weights for policy 1, policy_version 1705277 (0.0008) [2023-12-26 13:18:10,411][123091] Updated weights for policy 0, policy_version 1716698 (0.0009) [2023-12-26 13:18:10,474][123091] Updated weights for policy 0, policy_version 1716708 (0.0009) [2023-12-26 13:18:10,526][123091] Updated weights for policy 0, policy_version 1716718 (0.0009) [2023-12-26 13:18:10,779][123090] Updated weights for policy 1, policy_version 1705287 (0.0007) [2023-12-26 13:18:10,837][123090] Updated weights for policy 1, policy_version 1705297 (0.0010) [2023-12-26 13:18:10,897][123090] Updated weights for policy 1, policy_version 1705307 (0.0010) [2023-12-26 13:18:11,414][123091] Updated weights for policy 0, policy_version 1716728 (0.0009) [2023-12-26 13:18:11,486][123091] Updated weights for policy 0, policy_version 1716738 (0.0009) [2023-12-26 13:18:11,563][123091] Updated weights for policy 0, policy_version 1716748 (0.0009) [2023-12-26 13:18:11,815][123090] Updated weights for policy 1, policy_version 1705317 (0.0009) [2023-12-26 13:18:11,890][123090] Updated weights for policy 1, policy_version 1705327 (0.0008) [2023-12-26 13:18:11,957][123090] Updated weights for policy 1, policy_version 1705337 (0.0007) [2023-12-26 13:18:12,393][123091] Updated weights for policy 0, policy_version 1716758 (0.0009) [2023-12-26 13:18:12,446][123091] Updated weights for policy 0, policy_version 1716768 (0.0009) [2023-12-26 13:18:12,508][123091] Updated weights for policy 0, policy_version 1716778 (0.0009) [2023-12-26 13:18:12,760][123090] Updated weights for policy 1, policy_version 1705347 (0.0010) [2023-12-26 13:18:12,832][123090] Updated weights for policy 1, policy_version 1705357 (0.0011) [2023-12-26 13:18:12,893][123090] Updated weights for policy 1, policy_version 1705367 (0.0011) [2023-12-26 13:18:13,383][123091] Updated weights for policy 0, policy_version 1716788 (0.0010) [2023-12-26 13:18:13,448][123091] Updated weights for policy 0, policy_version 1716798 (0.0008) [2023-12-26 13:18:13,499][123091] Updated weights for policy 0, policy_version 1716808 (0.0005) [2023-12-26 13:18:13,722][123090] Updated weights for policy 1, policy_version 1705377 (0.0012) [2023-12-26 13:18:13,777][123090] Updated weights for policy 1, policy_version 1705387 (0.0010) [2023-12-26 13:18:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 876085248. Throughput: 0: 8780.8, 1: 8790.7. Samples: 876081272. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:18:13,785][121949] Avg episode reward: [(0, '6000.064'), (1, '5313.870')] [2023-12-26 13:18:13,825][123090] Updated weights for policy 1, policy_version 1705397 (0.0010) [2023-12-26 13:18:13,877][123090] Updated weights for policy 1, policy_version 1705407 (0.0010) [2023-12-26 13:18:14,245][123091] Updated weights for policy 0, policy_version 1716818 (0.0006) [2023-12-26 13:18:14,310][123091] Updated weights for policy 0, policy_version 1716828 (0.0009) [2023-12-26 13:18:14,363][123091] Updated weights for policy 0, policy_version 1716838 (0.0009) [2023-12-26 13:18:14,431][123091] Updated weights for policy 0, policy_version 1716848 (0.0009) [2023-12-26 13:18:14,714][123090] Updated weights for policy 1, policy_version 1705417 (0.0010) [2023-12-26 13:18:14,762][123090] Updated weights for policy 1, policy_version 1705427 (0.0010) [2023-12-26 13:18:14,831][123090] Updated weights for policy 1, policy_version 1705437 (0.0010) [2023-12-26 13:18:15,207][123091] Updated weights for policy 0, policy_version 1716858 (0.0009) [2023-12-26 13:18:15,278][123091] Updated weights for policy 0, policy_version 1716868 (0.0009) [2023-12-26 13:18:15,345][123091] Updated weights for policy 0, policy_version 1716878 (0.0009) [2023-12-26 13:18:15,623][123090] Updated weights for policy 1, policy_version 1705447 (0.0007) [2023-12-26 13:18:15,697][123090] Updated weights for policy 1, policy_version 1705457 (0.0005) [2023-12-26 13:18:15,764][123090] Updated weights for policy 1, policy_version 1705467 (0.0005) [2023-12-26 13:18:16,135][123091] Updated weights for policy 0, policy_version 1716888 (0.0008) [2023-12-26 13:18:16,197][123091] Updated weights for policy 0, policy_version 1716898 (0.0010) [2023-12-26 13:18:16,254][123091] Updated weights for policy 0, policy_version 1716908 (0.0009) [2023-12-26 13:18:16,376][123090] Updated weights for policy 1, policy_version 1705477 (0.0005) [2023-12-26 13:18:16,424][123090] Updated weights for policy 1, policy_version 1705487 (0.0005) [2023-12-26 13:18:16,477][123090] Updated weights for policy 1, policy_version 1705497 (0.0005) [2023-12-26 13:18:17,149][123091] Updated weights for policy 0, policy_version 1716918 (0.0009) [2023-12-26 13:18:17,177][123090] Updated weights for policy 1, policy_version 1705507 (0.0007) [2023-12-26 13:18:17,217][123091] Updated weights for policy 0, policy_version 1716928 (0.0005) [2023-12-26 13:18:17,232][123090] Updated weights for policy 1, policy_version 1705517 (0.0010) [2023-12-26 13:18:17,285][123091] Updated weights for policy 0, policy_version 1716938 (0.0007) [2023-12-26 13:18:17,291][123090] Updated weights for policy 1, policy_version 1705527 (0.0010) [2023-12-26 13:18:18,092][123091] Updated weights for policy 0, policy_version 1716948 (0.0007) [2023-12-26 13:18:18,115][123090] Updated weights for policy 1, policy_version 1705537 (0.0010) [2023-12-26 13:18:18,143][123091] Updated weights for policy 0, policy_version 1716958 (0.0009) [2023-12-26 13:18:18,163][123090] Updated weights for policy 1, policy_version 1705547 (0.0010) [2023-12-26 13:18:18,196][123091] Updated weights for policy 0, policy_version 1716968 (0.0006) [2023-12-26 13:18:18,215][123090] Updated weights for policy 1, policy_version 1705557 (0.0008) [2023-12-26 13:18:18,271][123090] Updated weights for policy 1, policy_version 1705567 (0.0005) [2023-12-26 13:18:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 876175360. Throughput: 0: 8886.4, 1: 8710.0. Samples: 876188708. Policy #0 lag: (min: 31.0, avg: 35.2, max: 63.0) [2023-12-26 13:18:18,785][121949] Avg episode reward: [(0, '6171.459'), (1, '5342.295')] [2023-12-26 13:18:18,948][123091] Updated weights for policy 0, policy_version 1716978 (0.0007) [2023-12-26 13:18:19,009][123090] Updated weights for policy 1, policy_version 1705577 (0.0006) [2023-12-26 13:18:19,014][123091] Updated weights for policy 0, policy_version 1716988 (0.0006) [2023-12-26 13:18:19,062][123091] Updated weights for policy 0, policy_version 1716998 (0.0005) [2023-12-26 13:18:19,073][123090] Updated weights for policy 1, policy_version 1705587 (0.0007) [2023-12-26 13:18:19,113][123091] Updated weights for policy 0, policy_version 1717008 (0.0005) [2023-12-26 13:18:19,121][123090] Updated weights for policy 1, policy_version 1705597 (0.0010) [2023-12-26 13:18:19,807][123091] Updated weights for policy 0, policy_version 1717018 (0.0006) [2023-12-26 13:18:19,876][123091] Updated weights for policy 0, policy_version 1717028 (0.0011) [2023-12-26 13:18:19,946][123091] Updated weights for policy 0, policy_version 1717038 (0.0010) [2023-12-26 13:18:19,984][123090] Updated weights for policy 1, policy_version 1705607 (0.0009) [2023-12-26 13:18:20,045][123090] Updated weights for policy 1, policy_version 1705617 (0.0009) [2023-12-26 13:18:20,106][123090] Updated weights for policy 1, policy_version 1705627 (0.0009) [2023-12-26 13:18:20,759][123091] Updated weights for policy 0, policy_version 1717048 (0.0011) [2023-12-26 13:18:20,854][123091] Updated weights for policy 0, policy_version 1717058 (0.0011) [2023-12-26 13:18:20,921][123091] Updated weights for policy 0, policy_version 1717068 (0.0011) [2023-12-26 13:18:20,973][123090] Updated weights for policy 1, policy_version 1705637 (0.0007) [2023-12-26 13:18:21,051][123090] Updated weights for policy 1, policy_version 1705647 (0.0006) [2023-12-26 13:18:21,128][123090] Updated weights for policy 1, policy_version 1705657 (0.0007) [2023-12-26 13:18:21,774][123091] Updated weights for policy 0, policy_version 1717078 (0.0009) [2023-12-26 13:18:21,831][123091] Updated weights for policy 0, policy_version 1717088 (0.0006) [2023-12-26 13:18:21,896][123091] Updated weights for policy 0, policy_version 1717098 (0.0006) [2023-12-26 13:18:21,903][123090] Updated weights for policy 1, policy_version 1705667 (0.0007) [2023-12-26 13:18:21,957][123090] Updated weights for policy 1, policy_version 1705677 (0.0007) [2023-12-26 13:18:22,020][123090] Updated weights for policy 1, policy_version 1705687 (0.0008) [2023-12-26 13:18:22,715][123091] Updated weights for policy 0, policy_version 1717108 (0.0010) [2023-12-26 13:18:22,763][123090] Updated weights for policy 1, policy_version 1705697 (0.0008) [2023-12-26 13:18:22,782][123091] Updated weights for policy 0, policy_version 1717118 (0.0011) [2023-12-26 13:18:22,827][123090] Updated weights for policy 1, policy_version 1705707 (0.0005) [2023-12-26 13:18:22,845][123091] Updated weights for policy 0, policy_version 1717128 (0.0011) [2023-12-26 13:18:22,891][123090] Updated weights for policy 1, policy_version 1705717 (0.0009) [2023-12-26 13:18:22,954][123090] Updated weights for policy 1, policy_version 1705727 (0.0007) [2023-12-26 13:18:23,639][123091] Updated weights for policy 0, policy_version 1717138 (0.0010) [2023-12-26 13:18:23,687][123091] Updated weights for policy 0, policy_version 1717148 (0.0010) [2023-12-26 13:18:23,696][123090] Updated weights for policy 1, policy_version 1705737 (0.0009) [2023-12-26 13:18:23,731][123091] Updated weights for policy 0, policy_version 1717158 (0.0010) [2023-12-26 13:18:23,754][123090] Updated weights for policy 1, policy_version 1705747 (0.0006) [2023-12-26 13:18:23,778][123091] Updated weights for policy 0, policy_version 1717168 (0.0010) [2023-12-26 13:18:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 876265472. Throughput: 0: 8941.3, 1: 8646.9. Samples: 876241212. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:23,785][121949] Avg episode reward: [(0, '6209.317'), (1, '5662.423')] [2023-12-26 13:18:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001717168_439599104.pth... [2023-12-26 13:18:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001716112_439328768.pth [2023-12-26 13:18:23,812][123090] Updated weights for policy 1, policy_version 1705757 (0.0007) [2023-12-26 13:18:23,830][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001705760_436674560.pth... [2023-12-26 13:18:23,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001704736_436412416.pth [2023-12-26 13:18:24,640][123091] Updated weights for policy 0, policy_version 1717179 (0.0010) [2023-12-26 13:18:24,671][123090] Updated weights for policy 1, policy_version 1705767 (0.0008) [2023-12-26 13:18:24,701][123091] Updated weights for policy 0, policy_version 1717189 (0.0010) [2023-12-26 13:18:24,734][123090] Updated weights for policy 1, policy_version 1705777 (0.0007) [2023-12-26 13:18:24,764][123091] Updated weights for policy 0, policy_version 1717199 (0.0010) [2023-12-26 13:18:24,785][123090] Updated weights for policy 1, policy_version 1705787 (0.0008) [2023-12-26 13:18:25,580][123091] Updated weights for policy 0, policy_version 1717209 (0.0010) [2023-12-26 13:18:25,620][123090] Updated weights for policy 1, policy_version 1705797 (0.0007) [2023-12-26 13:18:25,642][123091] Updated weights for policy 0, policy_version 1717219 (0.0011) [2023-12-26 13:18:25,679][123090] Updated weights for policy 1, policy_version 1705807 (0.0007) [2023-12-26 13:18:25,707][123091] Updated weights for policy 0, policy_version 1717229 (0.0010) [2023-12-26 13:18:25,732][123090] Updated weights for policy 1, policy_version 1705817 (0.0008) [2023-12-26 13:18:26,526][123091] Updated weights for policy 0, policy_version 1717239 (0.0010) [2023-12-26 13:18:26,564][123090] Updated weights for policy 1, policy_version 1705827 (0.0009) [2023-12-26 13:18:26,586][123091] Updated weights for policy 0, policy_version 1717249 (0.0007) [2023-12-26 13:18:26,616][123090] Updated weights for policy 1, policy_version 1705837 (0.0009) [2023-12-26 13:18:26,647][123091] Updated weights for policy 0, policy_version 1717259 (0.0005) [2023-12-26 13:18:26,685][123090] Updated weights for policy 1, policy_version 1705847 (0.0008) [2023-12-26 13:18:27,314][123091] Updated weights for policy 0, policy_version 1717269 (0.0008) [2023-12-26 13:18:27,365][123091] Updated weights for policy 0, policy_version 1717279 (0.0010) [2023-12-26 13:18:27,368][123090] Updated weights for policy 1, policy_version 1705857 (0.0006) [2023-12-26 13:18:27,420][123091] Updated weights for policy 0, policy_version 1717289 (0.0010) [2023-12-26 13:18:27,424][123090] Updated weights for policy 1, policy_version 1705867 (0.0005) [2023-12-26 13:18:27,477][123090] Updated weights for policy 1, policy_version 1705877 (0.0006) [2023-12-26 13:18:27,539][123090] Updated weights for policy 1, policy_version 1705887 (0.0010) [2023-12-26 13:18:28,243][123091] Updated weights for policy 0, policy_version 1717299 (0.0010) [2023-12-26 13:18:28,246][123090] Updated weights for policy 1, policy_version 1705897 (0.0006) [2023-12-26 13:18:28,294][123091] Updated weights for policy 0, policy_version 1717309 (0.0010) [2023-12-26 13:18:28,301][123090] Updated weights for policy 1, policy_version 1705907 (0.0005) [2023-12-26 13:18:28,349][123091] Updated weights for policy 0, policy_version 1717319 (0.0010) [2023-12-26 13:18:28,370][123090] Updated weights for policy 1, policy_version 1705917 (0.0007) [2023-12-26 13:18:28,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 876355584. Throughput: 0: 8924.1, 1: 8634.2. Samples: 876348176. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:28,784][121949] Avg episode reward: [(0, '6099.836'), (1, '5729.282')] [2023-12-26 13:18:29,038][123090] Updated weights for policy 1, policy_version 1705927 (0.0005) [2023-12-26 13:18:29,088][123090] Updated weights for policy 1, policy_version 1705937 (0.0005) [2023-12-26 13:18:29,148][123090] Updated weights for policy 1, policy_version 1705947 (0.0005) [2023-12-26 13:18:29,167][123091] Updated weights for policy 0, policy_version 1717329 (0.0010) [2023-12-26 13:18:29,227][123091] Updated weights for policy 0, policy_version 1717339 (0.0009) [2023-12-26 13:18:29,296][123091] Updated weights for policy 0, policy_version 1717349 (0.0006) [2023-12-26 13:18:29,363][123091] Updated weights for policy 0, policy_version 1717359 (0.0007) [2023-12-26 13:18:29,914][123090] Updated weights for policy 1, policy_version 1705957 (0.0005) [2023-12-26 13:18:29,988][123090] Updated weights for policy 1, policy_version 1705967 (0.0006) [2023-12-26 13:18:30,045][123090] Updated weights for policy 1, policy_version 1705977 (0.0005) [2023-12-26 13:18:30,078][123091] Updated weights for policy 0, policy_version 1717369 (0.0008) [2023-12-26 13:18:30,134][123091] Updated weights for policy 0, policy_version 1717379 (0.0009) [2023-12-26 13:18:30,182][123091] Updated weights for policy 0, policy_version 1717389 (0.0009) [2023-12-26 13:18:30,834][123090] Updated weights for policy 1, policy_version 1705987 (0.0005) [2023-12-26 13:18:30,907][123090] Updated weights for policy 1, policy_version 1705997 (0.0007) [2023-12-26 13:18:30,961][123090] Updated weights for policy 1, policy_version 1706007 (0.0010) [2023-12-26 13:18:31,051][123091] Updated weights for policy 0, policy_version 1717399 (0.0009) [2023-12-26 13:18:31,119][123091] Updated weights for policy 0, policy_version 1717409 (0.0009) [2023-12-26 13:18:31,187][123091] Updated weights for policy 0, policy_version 1717419 (0.0009) [2023-12-26 13:18:31,758][123090] Updated weights for policy 1, policy_version 1706017 (0.0010) [2023-12-26 13:18:31,821][123090] Updated weights for policy 1, policy_version 1706027 (0.0010) [2023-12-26 13:18:31,888][123090] Updated weights for policy 1, policy_version 1706037 (0.0010) [2023-12-26 13:18:31,957][123090] Updated weights for policy 1, policy_version 1706047 (0.0011) [2023-12-26 13:18:32,005][123091] Updated weights for policy 0, policy_version 1717429 (0.0009) [2023-12-26 13:18:32,060][123091] Updated weights for policy 0, policy_version 1717439 (0.0008) [2023-12-26 13:18:32,114][123091] Updated weights for policy 0, policy_version 1717449 (0.0008) [2023-12-26 13:18:32,730][123090] Updated weights for policy 1, policy_version 1706057 (0.0010) [2023-12-26 13:18:32,782][123090] Updated weights for policy 1, policy_version 1706067 (0.0009) [2023-12-26 13:18:32,833][123090] Updated weights for policy 1, policy_version 1706077 (0.0009) [2023-12-26 13:18:32,955][123091] Updated weights for policy 0, policy_version 1717459 (0.0009) [2023-12-26 13:18:33,006][123091] Updated weights for policy 0, policy_version 1717469 (0.0009) [2023-12-26 13:18:33,072][123091] Updated weights for policy 0, policy_version 1717479 (0.0009) [2023-12-26 13:18:33,705][123090] Updated weights for policy 1, policy_version 1706087 (0.0009) [2023-12-26 13:18:33,754][123090] Updated weights for policy 1, policy_version 1706097 (0.0009) [2023-12-26 13:18:33,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 876437504. Throughput: 0: 8893.8, 1: 8731.7. Samples: 876455824. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:33,785][121949] Avg episode reward: [(0, '6184.602'), (1, '5529.814')] [2023-12-26 13:18:33,805][123090] Updated weights for policy 1, policy_version 1706108 (0.0009) [2023-12-26 13:18:33,811][123091] Updated weights for policy 0, policy_version 1717489 (0.0007) [2023-12-26 13:18:33,867][123091] Updated weights for policy 0, policy_version 1717500 (0.0009) [2023-12-26 13:18:33,918][123091] Updated weights for policy 0, policy_version 1717510 (0.0009) [2023-12-26 13:18:33,969][123091] Updated weights for policy 0, policy_version 1717520 (0.0009) [2023-12-26 13:18:34,615][123090] Updated weights for policy 1, policy_version 1706118 (0.0008) [2023-12-26 13:18:34,681][123090] Updated weights for policy 1, policy_version 1706128 (0.0006) [2023-12-26 13:18:34,731][123090] Updated weights for policy 1, policy_version 1706138 (0.0005) [2023-12-26 13:18:34,855][123091] Updated weights for policy 0, policy_version 1717530 (0.0010) [2023-12-26 13:18:34,919][123091] Updated weights for policy 0, policy_version 1717540 (0.0011) [2023-12-26 13:18:34,992][123091] Updated weights for policy 0, policy_version 1717550 (0.0010) [2023-12-26 13:18:35,562][123090] Updated weights for policy 1, policy_version 1706148 (0.0007) [2023-12-26 13:18:35,622][123090] Updated weights for policy 1, policy_version 1706158 (0.0010) [2023-12-26 13:18:35,686][123090] Updated weights for policy 1, policy_version 1706168 (0.0009) [2023-12-26 13:18:35,707][123091] Updated weights for policy 0, policy_version 1717560 (0.0006) [2023-12-26 13:18:35,768][123091] Updated weights for policy 0, policy_version 1717570 (0.0005) [2023-12-26 13:18:35,827][123091] Updated weights for policy 0, policy_version 1717580 (0.0005) [2023-12-26 13:18:36,486][123091] Updated weights for policy 0, policy_version 1717590 (0.0006) [2023-12-26 13:18:36,574][123091] Updated weights for policy 0, policy_version 1717600 (0.0010) [2023-12-26 13:18:36,591][123090] Updated weights for policy 1, policy_version 1706178 (0.0007) [2023-12-26 13:18:36,643][123091] Updated weights for policy 0, policy_version 1717610 (0.0011) [2023-12-26 13:18:36,659][123090] Updated weights for policy 1, policy_version 1706188 (0.0006) [2023-12-26 13:18:36,721][123090] Updated weights for policy 1, policy_version 1706198 (0.0008) [2023-12-26 13:18:36,780][123090] Updated weights for policy 1, policy_version 1706208 (0.0007) [2023-12-26 13:18:37,284][123091] Updated weights for policy 0, policy_version 1717620 (0.0011) [2023-12-26 13:18:37,343][123091] Updated weights for policy 0, policy_version 1717630 (0.0011) [2023-12-26 13:18:37,405][123091] Updated weights for policy 0, policy_version 1717640 (0.0011) [2023-12-26 13:18:37,642][123090] Updated weights for policy 1, policy_version 1706218 (0.0009) [2023-12-26 13:18:37,694][123090] Updated weights for policy 1, policy_version 1706228 (0.0009) [2023-12-26 13:18:37,755][123090] Updated weights for policy 1, policy_version 1706238 (0.0009) [2023-12-26 13:18:38,197][123091] Updated weights for policy 0, policy_version 1717650 (0.0010) [2023-12-26 13:18:38,243][123091] Updated weights for policy 0, policy_version 1717660 (0.0005) [2023-12-26 13:18:38,300][123091] Updated weights for policy 0, policy_version 1717670 (0.0005) [2023-12-26 13:18:38,366][123091] Updated weights for policy 0, policy_version 1717680 (0.0009) [2023-12-26 13:18:38,639][123090] Updated weights for policy 1, policy_version 1706248 (0.0010) [2023-12-26 13:18:38,699][123090] Updated weights for policy 1, policy_version 1706258 (0.0010) [2023-12-26 13:18:38,767][123090] Updated weights for policy 1, policy_version 1706268 (0.0010) [2023-12-26 13:18:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 876527616. Throughput: 0: 8906.8, 1: 8758.1. Samples: 876509340. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:38,785][121949] Avg episode reward: [(0, '6093.319'), (1, '5565.301')] [2023-12-26 13:18:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001717680_439730176.pth... [2023-12-26 13:18:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001706272_436805632.pth... [2023-12-26 13:18:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001705216_436535296.pth [2023-12-26 13:18:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001716656_439468032.pth [2023-12-26 13:18:39,046][123091] Updated weights for policy 0, policy_version 1717690 (0.0008) [2023-12-26 13:18:39,106][123091] Updated weights for policy 0, policy_version 1717700 (0.0011) [2023-12-26 13:18:39,170][123091] Updated weights for policy 0, policy_version 1717710 (0.0011) [2023-12-26 13:18:39,680][123090] Updated weights for policy 1, policy_version 1706278 (0.0009) [2023-12-26 13:18:39,742][123090] Updated weights for policy 1, policy_version 1706288 (0.0009) [2023-12-26 13:18:39,807][123090] Updated weights for policy 1, policy_version 1706298 (0.0009) [2023-12-26 13:18:40,030][123091] Updated weights for policy 0, policy_version 1717720 (0.0007) [2023-12-26 13:18:40,086][123091] Updated weights for policy 0, policy_version 1717730 (0.0009) [2023-12-26 13:18:40,142][123091] Updated weights for policy 0, policy_version 1717740 (0.0011) [2023-12-26 13:18:40,660][123090] Updated weights for policy 1, policy_version 1706308 (0.0009) [2023-12-26 13:18:40,712][123090] Updated weights for policy 1, policy_version 1706318 (0.0009) [2023-12-26 13:18:40,774][123090] Updated weights for policy 1, policy_version 1706328 (0.0009) [2023-12-26 13:18:40,856][123091] Updated weights for policy 0, policy_version 1717750 (0.0009) [2023-12-26 13:18:40,917][123091] Updated weights for policy 0, policy_version 1717760 (0.0008) [2023-12-26 13:18:40,985][123091] Updated weights for policy 0, policy_version 1717770 (0.0008) [2023-12-26 13:18:41,598][123090] Updated weights for policy 1, policy_version 1706338 (0.0010) [2023-12-26 13:18:41,680][123090] Updated weights for policy 1, policy_version 1706348 (0.0011) [2023-12-26 13:18:41,752][123090] Updated weights for policy 1, policy_version 1706358 (0.0009) [2023-12-26 13:18:41,759][123091] Updated weights for policy 0, policy_version 1717780 (0.0009) [2023-12-26 13:18:41,813][123090] Updated weights for policy 1, policy_version 1706368 (0.0009) [2023-12-26 13:18:41,819][123091] Updated weights for policy 0, policy_version 1717790 (0.0008) [2023-12-26 13:18:41,874][123091] Updated weights for policy 0, policy_version 1717800 (0.0010) [2023-12-26 13:18:42,649][123090] Updated weights for policy 1, policy_version 1706378 (0.0008) [2023-12-26 13:18:42,721][123090] Updated weights for policy 1, policy_version 1706388 (0.0010) [2023-12-26 13:18:42,764][123091] Updated weights for policy 0, policy_version 1717810 (0.0010) [2023-12-26 13:18:42,785][123090] Updated weights for policy 1, policy_version 1706398 (0.0011) [2023-12-26 13:18:42,824][123091] Updated weights for policy 0, policy_version 1717820 (0.0011) [2023-12-26 13:18:42,883][123091] Updated weights for policy 0, policy_version 1717830 (0.0011) [2023-12-26 13:18:42,947][123091] Updated weights for policy 0, policy_version 1717840 (0.0011) [2023-12-26 13:18:43,592][123090] Updated weights for policy 1, policy_version 1706408 (0.0010) [2023-12-26 13:18:43,643][123090] Updated weights for policy 1, policy_version 1706418 (0.0010) [2023-12-26 13:18:43,699][123090] Updated weights for policy 1, policy_version 1706428 (0.0010) [2023-12-26 13:18:43,777][123091] Updated weights for policy 0, policy_version 1717850 (0.0007) [2023-12-26 13:18:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 876617728. Throughput: 0: 8830.8, 1: 8619.9. Samples: 876612484. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:43,785][121949] Avg episode reward: [(0, '6071.087'), (1, '5536.088')] [2023-12-26 13:18:43,849][123091] Updated weights for policy 0, policy_version 1717860 (0.0006) [2023-12-26 13:18:43,928][123091] Updated weights for policy 0, policy_version 1717870 (0.0005) [2023-12-26 13:18:44,506][123090] Updated weights for policy 1, policy_version 1706438 (0.0010) [2023-12-26 13:18:44,574][123090] Updated weights for policy 1, policy_version 1706448 (0.0008) [2023-12-26 13:18:44,633][123090] Updated weights for policy 1, policy_version 1706458 (0.0005) [2023-12-26 13:18:44,673][123091] Updated weights for policy 0, policy_version 1717880 (0.0009) [2023-12-26 13:18:44,747][123091] Updated weights for policy 0, policy_version 1717890 (0.0010) [2023-12-26 13:18:44,814][123091] Updated weights for policy 0, policy_version 1717900 (0.0010) [2023-12-26 13:18:45,319][123090] Updated weights for policy 1, policy_version 1706468 (0.0007) [2023-12-26 13:18:45,389][123090] Updated weights for policy 1, policy_version 1706478 (0.0010) [2023-12-26 13:18:45,458][123090] Updated weights for policy 1, policy_version 1706488 (0.0010) [2023-12-26 13:18:45,678][123091] Updated weights for policy 0, policy_version 1717910 (0.0009) [2023-12-26 13:18:45,736][123091] Updated weights for policy 0, policy_version 1717920 (0.0010) [2023-12-26 13:18:45,802][123091] Updated weights for policy 0, policy_version 1717930 (0.0009) [2023-12-26 13:18:46,267][123090] Updated weights for policy 1, policy_version 1706498 (0.0009) [2023-12-26 13:18:46,316][123090] Updated weights for policy 1, policy_version 1706508 (0.0005) [2023-12-26 13:18:46,362][123090] Updated weights for policy 1, policy_version 1706518 (0.0005) [2023-12-26 13:18:46,407][123090] Updated weights for policy 1, policy_version 1706528 (0.0006) [2023-12-26 13:18:46,655][123091] Updated weights for policy 0, policy_version 1717940 (0.0005) [2023-12-26 13:18:46,710][123091] Updated weights for policy 0, policy_version 1717950 (0.0005) [2023-12-26 13:18:46,756][123091] Updated weights for policy 0, policy_version 1717960 (0.0005) [2023-12-26 13:18:47,074][123090] Updated weights for policy 1, policy_version 1706538 (0.0006) [2023-12-26 13:18:47,130][123090] Updated weights for policy 1, policy_version 1706548 (0.0008) [2023-12-26 13:18:47,186][123090] Updated weights for policy 1, policy_version 1706558 (0.0010) [2023-12-26 13:18:47,512][123091] Updated weights for policy 0, policy_version 1717970 (0.0006) [2023-12-26 13:18:47,565][123091] Updated weights for policy 0, policy_version 1717980 (0.0010) [2023-12-26 13:18:47,620][123091] Updated weights for policy 0, policy_version 1717990 (0.0008) [2023-12-26 13:18:47,675][123091] Updated weights for policy 0, policy_version 1718000 (0.0009) [2023-12-26 13:18:47,928][123090] Updated weights for policy 1, policy_version 1706568 (0.0009) [2023-12-26 13:18:47,985][123090] Updated weights for policy 1, policy_version 1706578 (0.0009) [2023-12-26 13:18:48,050][123090] Updated weights for policy 1, policy_version 1706588 (0.0010) [2023-12-26 13:18:48,475][123091] Updated weights for policy 0, policy_version 1718010 (0.0007) [2023-12-26 13:18:48,527][123091] Updated weights for policy 0, policy_version 1718020 (0.0011) [2023-12-26 13:18:48,594][123091] Updated weights for policy 0, policy_version 1718030 (0.0011) [2023-12-26 13:18:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 876707840. Throughput: 0: 8847.7, 1: 8723.4. Samples: 876719104. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:48,785][121949] Avg episode reward: [(0, '6127.193'), (1, '5463.767')] [2023-12-26 13:18:48,898][123090] Updated weights for policy 1, policy_version 1706598 (0.0010) [2023-12-26 13:18:48,947][123090] Updated weights for policy 1, policy_version 1706608 (0.0009) [2023-12-26 13:18:48,995][123090] Updated weights for policy 1, policy_version 1706618 (0.0008) [2023-12-26 13:18:49,377][123091] Updated weights for policy 0, policy_version 1718040 (0.0010) [2023-12-26 13:18:49,434][123091] Updated weights for policy 0, policy_version 1718050 (0.0005) [2023-12-26 13:18:49,489][123091] Updated weights for policy 0, policy_version 1718060 (0.0005) [2023-12-26 13:18:49,814][123090] Updated weights for policy 1, policy_version 1706628 (0.0009) [2023-12-26 13:18:49,886][123090] Updated weights for policy 1, policy_version 1706638 (0.0011) [2023-12-26 13:18:49,953][123090] Updated weights for policy 1, policy_version 1706648 (0.0010) [2023-12-26 13:18:50,285][123091] Updated weights for policy 0, policy_version 1718070 (0.0007) [2023-12-26 13:18:50,333][123091] Updated weights for policy 0, policy_version 1718080 (0.0010) [2023-12-26 13:18:50,399][123091] Updated weights for policy 0, policy_version 1718090 (0.0011) [2023-12-26 13:18:50,652][123090] Updated weights for policy 1, policy_version 1706658 (0.0009) [2023-12-26 13:18:50,714][123090] Updated weights for policy 1, policy_version 1706668 (0.0009) [2023-12-26 13:18:50,776][123090] Updated weights for policy 1, policy_version 1706678 (0.0005) [2023-12-26 13:18:50,837][123090] Updated weights for policy 1, policy_version 1706688 (0.0010) [2023-12-26 13:18:51,232][123091] Updated weights for policy 0, policy_version 1718100 (0.0009) [2023-12-26 13:18:51,299][123091] Updated weights for policy 0, policy_version 1718110 (0.0010) [2023-12-26 13:18:51,368][123091] Updated weights for policy 0, policy_version 1718120 (0.0007) [2023-12-26 13:18:51,673][123090] Updated weights for policy 1, policy_version 1706698 (0.0008) [2023-12-26 13:18:51,738][123090] Updated weights for policy 1, policy_version 1706708 (0.0011) [2023-12-26 13:18:51,805][123090] Updated weights for policy 1, policy_version 1706718 (0.0010) [2023-12-26 13:18:51,997][123091] Updated weights for policy 0, policy_version 1718130 (0.0007) [2023-12-26 13:18:52,062][123091] Updated weights for policy 0, policy_version 1718140 (0.0006) [2023-12-26 13:18:52,125][123091] Updated weights for policy 0, policy_version 1718150 (0.0008) [2023-12-26 13:18:52,190][123091] Updated weights for policy 0, policy_version 1718160 (0.0008) [2023-12-26 13:18:52,627][123090] Updated weights for policy 1, policy_version 1706728 (0.0010) [2023-12-26 13:18:52,697][123090] Updated weights for policy 1, policy_version 1706738 (0.0010) [2023-12-26 13:18:52,753][123090] Updated weights for policy 1, policy_version 1706748 (0.0010) [2023-12-26 13:18:53,006][123091] Updated weights for policy 0, policy_version 1718170 (0.0009) [2023-12-26 13:18:53,059][123091] Updated weights for policy 0, policy_version 1718180 (0.0009) [2023-12-26 13:18:53,118][123091] Updated weights for policy 0, policy_version 1718190 (0.0009) [2023-12-26 13:18:53,554][123090] Updated weights for policy 1, policy_version 1706758 (0.0010) [2023-12-26 13:18:53,600][123090] Updated weights for policy 1, policy_version 1706768 (0.0010) [2023-12-26 13:18:53,647][123090] Updated weights for policy 1, policy_version 1706778 (0.0010) [2023-12-26 13:18:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 876797952. Throughput: 0: 8813.8, 1: 8775.4. Samples: 876772848. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:53,785][121949] Avg episode reward: [(0, '5998.874'), (1, '5388.047')] [2023-12-26 13:18:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001718192_439861248.pth... [2023-12-26 13:18:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001706784_436936704.pth... [2023-12-26 13:18:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001717168_439599104.pth [2023-12-26 13:18:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001705760_436674560.pth [2023-12-26 13:18:53,962][123091] Updated weights for policy 0, policy_version 1718200 (0.0009) [2023-12-26 13:18:54,021][123091] Updated weights for policy 0, policy_version 1718210 (0.0009) [2023-12-26 13:18:54,082][123091] Updated weights for policy 0, policy_version 1718220 (0.0009) [2023-12-26 13:18:54,424][123090] Updated weights for policy 1, policy_version 1706788 (0.0008) [2023-12-26 13:18:54,477][123090] Updated weights for policy 1, policy_version 1706798 (0.0009) [2023-12-26 13:18:54,532][123090] Updated weights for policy 1, policy_version 1706808 (0.0009) [2023-12-26 13:18:54,911][123091] Updated weights for policy 0, policy_version 1718230 (0.0009) [2023-12-26 13:18:54,965][123091] Updated weights for policy 0, policy_version 1718240 (0.0010) [2023-12-26 13:18:55,019][123091] Updated weights for policy 0, policy_version 1718250 (0.0010) [2023-12-26 13:18:55,268][123090] Updated weights for policy 1, policy_version 1706818 (0.0010) [2023-12-26 13:18:55,326][123090] Updated weights for policy 1, policy_version 1706828 (0.0010) [2023-12-26 13:18:55,382][123090] Updated weights for policy 1, policy_version 1706838 (0.0010) [2023-12-26 13:18:55,448][123090] Updated weights for policy 1, policy_version 1706848 (0.0010) [2023-12-26 13:18:55,938][123091] Updated weights for policy 0, policy_version 1718260 (0.0008) [2023-12-26 13:18:56,003][123091] Updated weights for policy 0, policy_version 1718270 (0.0007) [2023-12-26 13:18:56,054][123091] Updated weights for policy 0, policy_version 1718280 (0.0009) [2023-12-26 13:18:56,138][123090] Updated weights for policy 1, policy_version 1706858 (0.0005) [2023-12-26 13:18:56,207][123090] Updated weights for policy 1, policy_version 1706868 (0.0005) [2023-12-26 13:18:56,282][123090] Updated weights for policy 1, policy_version 1706878 (0.0005) [2023-12-26 13:18:56,927][123090] Updated weights for policy 1, policy_version 1706888 (0.0006) [2023-12-26 13:18:56,953][123091] Updated weights for policy 0, policy_version 1718290 (0.0009) [2023-12-26 13:18:56,980][123090] Updated weights for policy 1, policy_version 1706898 (0.0005) [2023-12-26 13:18:57,002][123091] Updated weights for policy 0, policy_version 1718300 (0.0009) [2023-12-26 13:18:57,030][123090] Updated weights for policy 1, policy_version 1706908 (0.0005) [2023-12-26 13:18:57,051][123091] Updated weights for policy 0, policy_version 1718310 (0.0009) [2023-12-26 13:18:57,109][123091] Updated weights for policy 0, policy_version 1718320 (0.0011) [2023-12-26 13:18:57,628][123090] Updated weights for policy 1, policy_version 1706918 (0.0005) [2023-12-26 13:18:57,680][123090] Updated weights for policy 1, policy_version 1706928 (0.0005) [2023-12-26 13:18:57,745][123090] Updated weights for policy 1, policy_version 1706938 (0.0005) [2023-12-26 13:18:58,029][123091] Updated weights for policy 0, policy_version 1718330 (0.0010) [2023-12-26 13:18:58,086][123091] Updated weights for policy 0, policy_version 1718340 (0.0009) [2023-12-26 13:18:58,148][123091] Updated weights for policy 0, policy_version 1718350 (0.0006) [2023-12-26 13:18:58,487][123090] Updated weights for policy 1, policy_version 1706948 (0.0008) [2023-12-26 13:18:58,556][123090] Updated weights for policy 1, policy_version 1706958 (0.0013) [2023-12-26 13:18:58,628][123090] Updated weights for policy 1, policy_version 1706969 (0.0011) [2023-12-26 13:18:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 876888064. Throughput: 0: 8810.1, 1: 8939.8. Samples: 876880020. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:18:58,785][121949] Avg episode reward: [(0, '6050.594'), (1, '5240.570')] [2023-12-26 13:18:58,927][123091] Updated weights for policy 0, policy_version 1718360 (0.0009) [2023-12-26 13:18:58,991][123091] Updated weights for policy 0, policy_version 1718370 (0.0009) [2023-12-26 13:18:59,055][123091] Updated weights for policy 0, policy_version 1718380 (0.0010) [2023-12-26 13:18:59,428][123090] Updated weights for policy 1, policy_version 1706979 (0.0009) [2023-12-26 13:18:59,486][123090] Updated weights for policy 1, policy_version 1706989 (0.0006) [2023-12-26 13:18:59,541][123090] Updated weights for policy 1, policy_version 1706999 (0.0005) [2023-12-26 13:18:59,966][123091] Updated weights for policy 0, policy_version 1718391 (0.0008) [2023-12-26 13:19:00,020][123091] Updated weights for policy 0, policy_version 1718401 (0.0005) [2023-12-26 13:19:00,068][123091] Updated weights for policy 0, policy_version 1718411 (0.0005) [2023-12-26 13:19:00,268][123090] Updated weights for policy 1, policy_version 1707009 (0.0005) [2023-12-26 13:19:00,339][123090] Updated weights for policy 1, policy_version 1707019 (0.0006) [2023-12-26 13:19:00,402][123090] Updated weights for policy 1, policy_version 1707029 (0.0010) [2023-12-26 13:19:00,466][123090] Updated weights for policy 1, policy_version 1707039 (0.0007) [2023-12-26 13:19:00,861][123091] Updated weights for policy 0, policy_version 1718421 (0.0007) [2023-12-26 13:19:00,914][123091] Updated weights for policy 0, policy_version 1718431 (0.0010) [2023-12-26 13:19:00,965][123091] Updated weights for policy 0, policy_version 1718441 (0.0009) [2023-12-26 13:19:01,161][123090] Updated weights for policy 1, policy_version 1707049 (0.0009) [2023-12-26 13:19:01,235][123090] Updated weights for policy 1, policy_version 1707059 (0.0010) [2023-12-26 13:19:01,305][123090] Updated weights for policy 1, policy_version 1707069 (0.0010) [2023-12-26 13:19:01,910][123091] Updated weights for policy 0, policy_version 1718451 (0.0010) [2023-12-26 13:19:01,976][123091] Updated weights for policy 0, policy_version 1718461 (0.0009) [2023-12-26 13:19:02,038][123091] Updated weights for policy 0, policy_version 1718471 (0.0009) [2023-12-26 13:19:02,067][123090] Updated weights for policy 1, policy_version 1707079 (0.0008) [2023-12-26 13:19:02,132][123090] Updated weights for policy 1, policy_version 1707089 (0.0008) [2023-12-26 13:19:02,198][123090] Updated weights for policy 1, policy_version 1707099 (0.0009) [2023-12-26 13:19:02,868][123091] Updated weights for policy 0, policy_version 1718481 (0.0010) [2023-12-26 13:19:02,924][123091] Updated weights for policy 0, policy_version 1718491 (0.0009) [2023-12-26 13:19:02,976][123091] Updated weights for policy 0, policy_version 1718501 (0.0009) [2023-12-26 13:19:03,022][123090] Updated weights for policy 1, policy_version 1707109 (0.0009) [2023-12-26 13:19:03,033][123091] Updated weights for policy 0, policy_version 1718511 (0.0009) [2023-12-26 13:19:03,077][123090] Updated weights for policy 1, policy_version 1707119 (0.0009) [2023-12-26 13:19:03,138][123090] Updated weights for policy 1, policy_version 1707129 (0.0009) [2023-12-26 13:19:03,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 876969984. Throughput: 0: 8772.2, 1: 8924.6. Samples: 876985060. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:03,785][121949] Avg episode reward: [(0, '5983.654'), (1, '5212.192')] [2023-12-26 13:19:03,886][123091] Updated weights for policy 0, policy_version 1718521 (0.0009) [2023-12-26 13:19:03,937][123091] Updated weights for policy 0, policy_version 1718531 (0.0009) [2023-12-26 13:19:03,947][123090] Updated weights for policy 1, policy_version 1707139 (0.0009) [2023-12-26 13:19:03,997][123091] Updated weights for policy 0, policy_version 1718541 (0.0006) [2023-12-26 13:19:04,009][123090] Updated weights for policy 1, policy_version 1707149 (0.0010) [2023-12-26 13:19:04,071][123090] Updated weights for policy 1, policy_version 1707159 (0.0009) [2023-12-26 13:19:04,795][123091] Updated weights for policy 0, policy_version 1718551 (0.0007) [2023-12-26 13:19:04,844][123091] Updated weights for policy 0, policy_version 1718561 (0.0006) [2023-12-26 13:19:04,906][123091] Updated weights for policy 0, policy_version 1718571 (0.0006) [2023-12-26 13:19:04,926][123090] Updated weights for policy 1, policy_version 1707169 (0.0008) [2023-12-26 13:19:04,996][123090] Updated weights for policy 1, policy_version 1707179 (0.0006) [2023-12-26 13:19:05,066][123090] Updated weights for policy 1, policy_version 1707189 (0.0006) [2023-12-26 13:19:05,127][123090] Updated weights for policy 1, policy_version 1707199 (0.0005) [2023-12-26 13:19:05,642][123091] Updated weights for policy 0, policy_version 1718581 (0.0006) [2023-12-26 13:19:05,687][123091] Updated weights for policy 0, policy_version 1718591 (0.0005) [2023-12-26 13:19:05,765][123090] Updated weights for policy 1, policy_version 1707209 (0.0007) [2023-12-26 13:19:05,774][123091] Updated weights for policy 0, policy_version 1718601 (0.0008) [2023-12-26 13:19:05,824][123090] Updated weights for policy 1, policy_version 1707219 (0.0009) [2023-12-26 13:19:05,877][123090] Updated weights for policy 1, policy_version 1707229 (0.0009) [2023-12-26 13:19:06,525][123091] Updated weights for policy 0, policy_version 1718611 (0.0007) [2023-12-26 13:19:06,591][123091] Updated weights for policy 0, policy_version 1718621 (0.0010) [2023-12-26 13:19:06,651][123091] Updated weights for policy 0, policy_version 1718631 (0.0010) [2023-12-26 13:19:06,719][123090] Updated weights for policy 1, policy_version 1707239 (0.0008) [2023-12-26 13:19:06,783][123090] Updated weights for policy 1, policy_version 1707249 (0.0008) [2023-12-26 13:19:06,852][123090] Updated weights for policy 1, policy_version 1707259 (0.0009) [2023-12-26 13:19:07,482][123091] Updated weights for policy 0, policy_version 1718641 (0.0009) [2023-12-26 13:19:07,530][123091] Updated weights for policy 0, policy_version 1718651 (0.0009) [2023-12-26 13:19:07,585][123091] Updated weights for policy 0, policy_version 1718661 (0.0010) [2023-12-26 13:19:07,649][123091] Updated weights for policy 0, policy_version 1718671 (0.0009) [2023-12-26 13:19:07,688][123090] Updated weights for policy 1, policy_version 1707269 (0.0009) [2023-12-26 13:19:07,742][123090] Updated weights for policy 1, policy_version 1707279 (0.0009) [2023-12-26 13:19:07,805][123090] Updated weights for policy 1, policy_version 1707289 (0.0009) [2023-12-26 13:19:08,540][123091] Updated weights for policy 0, policy_version 1718681 (0.0010) [2023-12-26 13:19:08,595][123091] Updated weights for policy 0, policy_version 1718691 (0.0009) [2023-12-26 13:19:08,648][123090] Updated weights for policy 1, policy_version 1707299 (0.0008) [2023-12-26 13:19:08,655][123091] Updated weights for policy 0, policy_version 1718701 (0.0009) [2023-12-26 13:19:08,699][123090] Updated weights for policy 1, policy_version 1707309 (0.0008) [2023-12-26 13:19:08,749][123090] Updated weights for policy 1, policy_version 1707319 (0.0009) [2023-12-26 13:19:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 877060096. Throughput: 0: 8780.3, 1: 8958.5. Samples: 877039456. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:08,784][121949] Avg episode reward: [(0, '6086.899'), (1, '5098.359')] [2023-12-26 13:19:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001718704_439992320.pth... [2023-12-26 13:19:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001717680_439730176.pth [2023-12-26 13:19:08,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001707328_437075968.pth... [2023-12-26 13:19:08,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001706272_436805632.pth [2023-12-26 13:19:09,493][123091] Updated weights for policy 0, policy_version 1718711 (0.0009) [2023-12-26 13:19:09,555][123091] Updated weights for policy 0, policy_version 1718721 (0.0009) [2023-12-26 13:19:09,605][123090] Updated weights for policy 1, policy_version 1707329 (0.0010) [2023-12-26 13:19:09,614][123091] Updated weights for policy 0, policy_version 1718731 (0.0008) [2023-12-26 13:19:09,672][123090] Updated weights for policy 1, policy_version 1707339 (0.0010) [2023-12-26 13:19:09,736][123090] Updated weights for policy 1, policy_version 1707349 (0.0009) [2023-12-26 13:19:09,801][123090] Updated weights for policy 1, policy_version 1707359 (0.0009) [2023-12-26 13:19:10,408][123091] Updated weights for policy 0, policy_version 1718741 (0.0008) [2023-12-26 13:19:10,470][123091] Updated weights for policy 0, policy_version 1718751 (0.0009) [2023-12-26 13:19:10,537][123091] Updated weights for policy 0, policy_version 1718761 (0.0010) [2023-12-26 13:19:10,667][123090] Updated weights for policy 1, policy_version 1707369 (0.0009) [2023-12-26 13:19:10,726][123090] Updated weights for policy 1, policy_version 1707379 (0.0009) [2023-12-26 13:19:10,777][123090] Updated weights for policy 1, policy_version 1707390 (0.0010) [2023-12-26 13:19:11,414][123091] Updated weights for policy 0, policy_version 1718771 (0.0009) [2023-12-26 13:19:11,482][123091] Updated weights for policy 0, policy_version 1718781 (0.0010) [2023-12-26 13:19:11,521][123090] Updated weights for policy 1, policy_version 1707400 (0.0010) [2023-12-26 13:19:11,545][123091] Updated weights for policy 0, policy_version 1718791 (0.0009) [2023-12-26 13:19:11,577][123090] Updated weights for policy 1, policy_version 1707410 (0.0009) [2023-12-26 13:19:11,647][123090] Updated weights for policy 1, policy_version 1707420 (0.0007) [2023-12-26 13:19:12,403][123091] Updated weights for policy 0, policy_version 1718801 (0.0009) [2023-12-26 13:19:12,474][123091] Updated weights for policy 0, policy_version 1718811 (0.0009) [2023-12-26 13:19:12,492][123090] Updated weights for policy 1, policy_version 1707430 (0.0006) [2023-12-26 13:19:12,536][123091] Updated weights for policy 0, policy_version 1718821 (0.0009) [2023-12-26 13:19:12,558][123090] Updated weights for policy 1, policy_version 1707440 (0.0008) [2023-12-26 13:19:12,597][123091] Updated weights for policy 0, policy_version 1718831 (0.0006) [2023-12-26 13:19:12,626][123090] Updated weights for policy 1, policy_version 1707450 (0.0008) [2023-12-26 13:19:13,358][123090] Updated weights for policy 1, policy_version 1707460 (0.0009) [2023-12-26 13:19:13,392][123091] Updated weights for policy 0, policy_version 1718841 (0.0005) [2023-12-26 13:19:13,415][123090] Updated weights for policy 1, policy_version 1707470 (0.0006) [2023-12-26 13:19:13,462][123091] Updated weights for policy 0, policy_version 1718851 (0.0006) [2023-12-26 13:19:13,473][123090] Updated weights for policy 1, policy_version 1707480 (0.0010) [2023-12-26 13:19:13,528][123091] Updated weights for policy 0, policy_version 1718861 (0.0007) [2023-12-26 13:19:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 877150208. Throughput: 0: 8705.9, 1: 8899.4. Samples: 877140416. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:13,785][121949] Avg episode reward: [(0, '6010.658'), (1, '4934.873')] [2023-12-26 13:19:14,206][123090] Updated weights for policy 1, policy_version 1707490 (0.0010) [2023-12-26 13:19:14,214][123091] Updated weights for policy 0, policy_version 1718871 (0.0008) [2023-12-26 13:19:14,261][123090] Updated weights for policy 1, policy_version 1707500 (0.0006) [2023-12-26 13:19:14,270][123091] Updated weights for policy 0, policy_version 1718881 (0.0009) [2023-12-26 13:19:14,312][123090] Updated weights for policy 1, policy_version 1707510 (0.0008) [2023-12-26 13:19:14,319][123091] Updated weights for policy 0, policy_version 1718891 (0.0007) [2023-12-26 13:19:14,359][123090] Updated weights for policy 1, policy_version 1707520 (0.0006) [2023-12-26 13:19:15,126][123090] Updated weights for policy 1, policy_version 1707530 (0.0006) [2023-12-26 13:19:15,194][123090] Updated weights for policy 1, policy_version 1707540 (0.0007) [2023-12-26 13:19:15,209][123091] Updated weights for policy 0, policy_version 1718901 (0.0009) [2023-12-26 13:19:15,256][123090] Updated weights for policy 1, policy_version 1707550 (0.0007) [2023-12-26 13:19:15,280][123091] Updated weights for policy 0, policy_version 1718911 (0.0009) [2023-12-26 13:19:15,341][123091] Updated weights for policy 0, policy_version 1718921 (0.0009) [2023-12-26 13:19:15,961][123090] Updated weights for policy 1, policy_version 1707560 (0.0009) [2023-12-26 13:19:16,008][123090] Updated weights for policy 1, policy_version 1707570 (0.0010) [2023-12-26 13:19:16,055][123090] Updated weights for policy 1, policy_version 1707580 (0.0006) [2023-12-26 13:19:16,200][123091] Updated weights for policy 0, policy_version 1718931 (0.0010) [2023-12-26 13:19:16,249][123091] Updated weights for policy 0, policy_version 1718941 (0.0008) [2023-12-26 13:19:16,311][123091] Updated weights for policy 0, policy_version 1718951 (0.0007) [2023-12-26 13:19:16,792][123090] Updated weights for policy 1, policy_version 1707590 (0.0006) [2023-12-26 13:19:16,849][123090] Updated weights for policy 1, policy_version 1707600 (0.0006) [2023-12-26 13:19:16,919][123090] Updated weights for policy 1, policy_version 1707610 (0.0006) [2023-12-26 13:19:17,016][123091] Updated weights for policy 0, policy_version 1718961 (0.0005) [2023-12-26 13:19:17,092][123091] Updated weights for policy 0, policy_version 1718971 (0.0005) [2023-12-26 13:19:17,159][123091] Updated weights for policy 0, policy_version 1718981 (0.0010) [2023-12-26 13:19:17,223][123091] Updated weights for policy 0, policy_version 1718991 (0.0009) [2023-12-26 13:19:17,477][123090] Updated weights for policy 1, policy_version 1707620 (0.0005) [2023-12-26 13:19:17,546][123090] Updated weights for policy 1, policy_version 1707630 (0.0005) [2023-12-26 13:19:17,623][123090] Updated weights for policy 1, policy_version 1707640 (0.0006) [2023-12-26 13:19:17,981][123091] Updated weights for policy 0, policy_version 1719001 (0.0009) [2023-12-26 13:19:18,043][123091] Updated weights for policy 0, policy_version 1719012 (0.0009) [2023-12-26 13:19:18,110][123091] Updated weights for policy 0, policy_version 1719022 (0.0010) [2023-12-26 13:19:18,306][123090] Updated weights for policy 1, policy_version 1707650 (0.0008) [2023-12-26 13:19:18,367][123090] Updated weights for policy 1, policy_version 1707660 (0.0011) [2023-12-26 13:19:18,429][123090] Updated weights for policy 1, policy_version 1707670 (0.0009) [2023-12-26 13:19:18,498][123090] Updated weights for policy 1, policy_version 1707680 (0.0006) [2023-12-26 13:19:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 877240320. Throughput: 0: 8715.3, 1: 8983.9. Samples: 877252288. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:18,785][121949] Avg episode reward: [(0, '5685.519'), (1, '5054.235')] [2023-12-26 13:19:18,938][123091] Updated weights for policy 0, policy_version 1719032 (0.0009) [2023-12-26 13:19:18,994][123091] Updated weights for policy 0, policy_version 1719042 (0.0011) [2023-12-26 13:19:19,050][123091] Updated weights for policy 0, policy_version 1719052 (0.0007) [2023-12-26 13:19:19,371][123090] Updated weights for policy 1, policy_version 1707690 (0.0010) [2023-12-26 13:19:19,434][123090] Updated weights for policy 1, policy_version 1707700 (0.0009) [2023-12-26 13:19:19,502][123090] Updated weights for policy 1, policy_version 1707710 (0.0009) [2023-12-26 13:19:19,882][123091] Updated weights for policy 0, policy_version 1719062 (0.0010) [2023-12-26 13:19:19,957][123091] Updated weights for policy 0, policy_version 1719072 (0.0009) [2023-12-26 13:19:20,025][123091] Updated weights for policy 0, policy_version 1719082 (0.0010) [2023-12-26 13:19:20,355][123090] Updated weights for policy 1, policy_version 1707720 (0.0011) [2023-12-26 13:19:20,419][123090] Updated weights for policy 1, policy_version 1707730 (0.0011) [2023-12-26 13:19:20,479][123090] Updated weights for policy 1, policy_version 1707740 (0.0010) [2023-12-26 13:19:20,772][123091] Updated weights for policy 0, policy_version 1719092 (0.0008) [2023-12-26 13:19:20,828][123091] Updated weights for policy 0, policy_version 1719102 (0.0011) [2023-12-26 13:19:20,896][123091] Updated weights for policy 0, policy_version 1719112 (0.0011) [2023-12-26 13:19:21,297][123090] Updated weights for policy 1, policy_version 1707750 (0.0011) [2023-12-26 13:19:21,372][123090] Updated weights for policy 1, policy_version 1707760 (0.0010) [2023-12-26 13:19:21,444][123090] Updated weights for policy 1, policy_version 1707770 (0.0010) [2023-12-26 13:19:21,748][123091] Updated weights for policy 0, policy_version 1719122 (0.0014) [2023-12-26 13:19:21,813][123091] Updated weights for policy 0, policy_version 1719132 (0.0010) [2023-12-26 13:19:21,887][123091] Updated weights for policy 0, policy_version 1719142 (0.0011) [2023-12-26 13:19:21,954][123091] Updated weights for policy 0, policy_version 1719152 (0.0011) [2023-12-26 13:19:22,303][123090] Updated weights for policy 1, policy_version 1707780 (0.0011) [2023-12-26 13:19:22,373][123090] Updated weights for policy 1, policy_version 1707790 (0.0011) [2023-12-26 13:19:22,449][123090] Updated weights for policy 1, policy_version 1707800 (0.0011) [2023-12-26 13:19:22,699][123091] Updated weights for policy 0, policy_version 1719162 (0.0011) [2023-12-26 13:19:22,769][123091] Updated weights for policy 0, policy_version 1719172 (0.0006) [2023-12-26 13:19:22,843][123091] Updated weights for policy 0, policy_version 1719182 (0.0005) [2023-12-26 13:19:23,212][123090] Updated weights for policy 1, policy_version 1707810 (0.0011) [2023-12-26 13:19:23,271][123090] Updated weights for policy 1, policy_version 1707820 (0.0010) [2023-12-26 13:19:23,330][123090] Updated weights for policy 1, policy_version 1707830 (0.0010) [2023-12-26 13:19:23,397][123090] Updated weights for policy 1, policy_version 1707840 (0.0010) [2023-12-26 13:19:23,551][123091] Updated weights for policy 0, policy_version 1719192 (0.0009) [2023-12-26 13:19:23,600][123091] Updated weights for policy 0, policy_version 1719202 (0.0007) [2023-12-26 13:19:23,648][123091] Updated weights for policy 0, policy_version 1719212 (0.0005) [2023-12-26 13:19:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 877330432. Throughput: 0: 8675.8, 1: 8973.7. Samples: 877303564. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:23,785][121949] Avg episode reward: [(0, '5778.864'), (1, '5352.335')] [2023-12-26 13:19:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001719216_440123392.pth... [2023-12-26 13:19:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001707840_437207040.pth... [2023-12-26 13:19:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001718192_439861248.pth [2023-12-26 13:19:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001706784_436936704.pth [2023-12-26 13:19:24,162][123090] Updated weights for policy 1, policy_version 1707850 (0.0009) [2023-12-26 13:19:24,214][123090] Updated weights for policy 1, policy_version 1707860 (0.0008) [2023-12-26 13:19:24,274][123090] Updated weights for policy 1, policy_version 1707870 (0.0009) [2023-12-26 13:19:24,403][123091] Updated weights for policy 0, policy_version 1719222 (0.0008) [2023-12-26 13:19:24,462][123091] Updated weights for policy 0, policy_version 1719232 (0.0011) [2023-12-26 13:19:24,525][123091] Updated weights for policy 0, policy_version 1719242 (0.0011) [2023-12-26 13:19:25,138][123090] Updated weights for policy 1, policy_version 1707880 (0.0009) [2023-12-26 13:19:25,200][123090] Updated weights for policy 1, policy_version 1707890 (0.0008) [2023-12-26 13:19:25,261][123090] Updated weights for policy 1, policy_version 1707900 (0.0009) [2023-12-26 13:19:25,342][123091] Updated weights for policy 0, policy_version 1719252 (0.0011) [2023-12-26 13:19:25,396][123091] Updated weights for policy 0, policy_version 1719262 (0.0010) [2023-12-26 13:19:25,462][123091] Updated weights for policy 0, policy_version 1719272 (0.0011) [2023-12-26 13:19:26,030][123090] Updated weights for policy 1, policy_version 1707910 (0.0006) [2023-12-26 13:19:26,086][123090] Updated weights for policy 1, policy_version 1707920 (0.0006) [2023-12-26 13:19:26,161][123090] Updated weights for policy 1, policy_version 1707930 (0.0005) [2023-12-26 13:19:26,167][123091] Updated weights for policy 0, policy_version 1719282 (0.0010) [2023-12-26 13:19:26,232][123091] Updated weights for policy 0, policy_version 1719292 (0.0006) [2023-12-26 13:19:26,288][123091] Updated weights for policy 0, policy_version 1719302 (0.0005) [2023-12-26 13:19:26,347][123091] Updated weights for policy 0, policy_version 1719312 (0.0008) [2023-12-26 13:19:26,736][123090] Updated weights for policy 1, policy_version 1707940 (0.0005) [2023-12-26 13:19:26,795][123090] Updated weights for policy 1, policy_version 1707950 (0.0005) [2023-12-26 13:19:26,853][123090] Updated weights for policy 1, policy_version 1707960 (0.0005) [2023-12-26 13:19:27,043][123091] Updated weights for policy 0, policy_version 1719322 (0.0005) [2023-12-26 13:19:27,098][123091] Updated weights for policy 0, policy_version 1719332 (0.0006) [2023-12-26 13:19:27,154][123091] Updated weights for policy 0, policy_version 1719342 (0.0007) [2023-12-26 13:19:27,496][123090] Updated weights for policy 1, policy_version 1707970 (0.0005) [2023-12-26 13:19:27,553][123090] Updated weights for policy 1, policy_version 1707980 (0.0005) [2023-12-26 13:19:27,612][123090] Updated weights for policy 1, policy_version 1707990 (0.0005) [2023-12-26 13:19:27,668][123090] Updated weights for policy 1, policy_version 1708000 (0.0008) [2023-12-26 13:19:27,876][123091] Updated weights for policy 0, policy_version 1719353 (0.0009) [2023-12-26 13:19:27,929][123091] Updated weights for policy 0, policy_version 1719363 (0.0009) [2023-12-26 13:19:27,983][123091] Updated weights for policy 0, policy_version 1719375 (0.0010) [2023-12-26 13:19:28,428][123090] Updated weights for policy 1, policy_version 1708010 (0.0009) [2023-12-26 13:19:28,487][123090] Updated weights for policy 1, policy_version 1708020 (0.0009) [2023-12-26 13:19:28,546][123090] Updated weights for policy 1, policy_version 1708030 (0.0009) [2023-12-26 13:19:28,747][123091] Updated weights for policy 0, policy_version 1719385 (0.0006) [2023-12-26 13:19:28,785][121949] Fps is (10 sec: 18021.3, 60 sec: 17749.1, 300 sec: 17772.4). Total num frames: 877420544. Throughput: 0: 8738.9, 1: 9122.0. Samples: 877416236. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:28,786][121949] Avg episode reward: [(0, '5921.192'), (1, '5529.376')] [2023-12-26 13:19:28,827][123091] Updated weights for policy 0, policy_version 1719395 (0.0005) [2023-12-26 13:19:28,902][123091] Updated weights for policy 0, policy_version 1719405 (0.0005) [2023-12-26 13:19:29,384][123090] Updated weights for policy 1, policy_version 1708040 (0.0011) [2023-12-26 13:19:29,445][123090] Updated weights for policy 1, policy_version 1708050 (0.0010) [2023-12-26 13:19:29,494][123090] Updated weights for policy 1, policy_version 1708060 (0.0010) [2023-12-26 13:19:29,604][123091] Updated weights for policy 0, policy_version 1719415 (0.0008) [2023-12-26 13:19:29,663][123091] Updated weights for policy 0, policy_version 1719425 (0.0008) [2023-12-26 13:19:29,715][123091] Updated weights for policy 0, policy_version 1719435 (0.0009) [2023-12-26 13:19:30,340][123090] Updated weights for policy 1, policy_version 1708070 (0.0010) [2023-12-26 13:19:30,396][123090] Updated weights for policy 1, policy_version 1708080 (0.0010) [2023-12-26 13:19:30,443][123090] Updated weights for policy 1, policy_version 1708090 (0.0010) [2023-12-26 13:19:30,565][123091] Updated weights for policy 0, policy_version 1719445 (0.0009) [2023-12-26 13:19:30,613][123091] Updated weights for policy 0, policy_version 1719455 (0.0008) [2023-12-26 13:19:30,664][123091] Updated weights for policy 0, policy_version 1719465 (0.0008) [2023-12-26 13:19:31,282][123090] Updated weights for policy 1, policy_version 1708100 (0.0011) [2023-12-26 13:19:31,350][123090] Updated weights for policy 1, policy_version 1708110 (0.0010) [2023-12-26 13:19:31,425][123090] Updated weights for policy 1, policy_version 1708120 (0.0010) [2023-12-26 13:19:31,530][123091] Updated weights for policy 0, policy_version 1719475 (0.0008) [2023-12-26 13:19:31,587][123091] Updated weights for policy 0, policy_version 1719485 (0.0009) [2023-12-26 13:19:31,654][123091] Updated weights for policy 0, policy_version 1719495 (0.0009) [2023-12-26 13:19:32,257][123090] Updated weights for policy 1, policy_version 1708130 (0.0011) [2023-12-26 13:19:32,319][123090] Updated weights for policy 1, policy_version 1708140 (0.0011) [2023-12-26 13:19:32,389][123090] Updated weights for policy 1, policy_version 1708150 (0.0011) [2023-12-26 13:19:32,448][123090] Updated weights for policy 1, policy_version 1708160 (0.0011) [2023-12-26 13:19:32,519][123091] Updated weights for policy 0, policy_version 1719505 (0.0009) [2023-12-26 13:19:32,583][123091] Updated weights for policy 0, policy_version 1719515 (0.0009) [2023-12-26 13:19:32,644][123091] Updated weights for policy 0, policy_version 1719525 (0.0009) [2023-12-26 13:19:32,705][123091] Updated weights for policy 0, policy_version 1719535 (0.0009) [2023-12-26 13:19:33,256][123090] Updated weights for policy 1, policy_version 1708170 (0.0009) [2023-12-26 13:19:33,303][123090] Updated weights for policy 1, policy_version 1708180 (0.0007) [2023-12-26 13:19:33,350][123090] Updated weights for policy 1, policy_version 1708190 (0.0005) [2023-12-26 13:19:33,483][123091] Updated weights for policy 0, policy_version 1719545 (0.0006) [2023-12-26 13:19:33,554][123091] Updated weights for policy 0, policy_version 1719555 (0.0005) [2023-12-26 13:19:33,628][123091] Updated weights for policy 0, policy_version 1719565 (0.0005) [2023-12-26 13:19:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 877510656. Throughput: 0: 8760.3, 1: 9081.1. Samples: 877521968. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:33,785][121949] Avg episode reward: [(0, '6079.022'), (1, '5358.400')] [2023-12-26 13:19:33,973][123090] Updated weights for policy 1, policy_version 1708200 (0.0005) [2023-12-26 13:19:34,027][123090] Updated weights for policy 1, policy_version 1708210 (0.0005) [2023-12-26 13:19:34,095][123090] Updated weights for policy 1, policy_version 1708220 (0.0005) [2023-12-26 13:19:34,172][123091] Updated weights for policy 0, policy_version 1719575 (0.0008) [2023-12-26 13:19:34,232][123091] Updated weights for policy 0, policy_version 1719585 (0.0009) [2023-12-26 13:19:34,294][123091] Updated weights for policy 0, policy_version 1719595 (0.0009) [2023-12-26 13:19:34,834][123090] Updated weights for policy 1, policy_version 1708230 (0.0007) [2023-12-26 13:19:34,894][123090] Updated weights for policy 1, policy_version 1708240 (0.0007) [2023-12-26 13:19:34,963][123090] Updated weights for policy 1, policy_version 1708250 (0.0006) [2023-12-26 13:19:35,180][123091] Updated weights for policy 0, policy_version 1719605 (0.0008) [2023-12-26 13:19:35,237][123091] Updated weights for policy 0, policy_version 1719615 (0.0010) [2023-12-26 13:19:35,303][123091] Updated weights for policy 0, policy_version 1719625 (0.0010) [2023-12-26 13:19:35,677][123090] Updated weights for policy 1, policy_version 1708260 (0.0008) [2023-12-26 13:19:35,744][123090] Updated weights for policy 1, policy_version 1708270 (0.0005) [2023-12-26 13:19:35,812][123090] Updated weights for policy 1, policy_version 1708280 (0.0005) [2023-12-26 13:19:36,184][123091] Updated weights for policy 0, policy_version 1719635 (0.0010) [2023-12-26 13:19:36,244][123091] Updated weights for policy 0, policy_version 1719645 (0.0009) [2023-12-26 13:19:36,304][123091] Updated weights for policy 0, policy_version 1719655 (0.0010) [2023-12-26 13:19:36,518][123090] Updated weights for policy 1, policy_version 1708290 (0.0006) [2023-12-26 13:19:36,569][123090] Updated weights for policy 1, policy_version 1708300 (0.0010) [2023-12-26 13:19:36,626][123090] Updated weights for policy 1, policy_version 1708310 (0.0008) [2023-12-26 13:19:36,682][123090] Updated weights for policy 1, policy_version 1708320 (0.0009) [2023-12-26 13:19:37,212][123091] Updated weights for policy 0, policy_version 1719665 (0.0010) [2023-12-26 13:19:37,283][123091] Updated weights for policy 0, policy_version 1719675 (0.0010) [2023-12-26 13:19:37,353][123091] Updated weights for policy 0, policy_version 1719685 (0.0009) [2023-12-26 13:19:37,426][123091] Updated weights for policy 0, policy_version 1719695 (0.0010) [2023-12-26 13:19:37,479][123090] Updated weights for policy 1, policy_version 1708330 (0.0009) [2023-12-26 13:19:37,546][123090] Updated weights for policy 1, policy_version 1708340 (0.0010) [2023-12-26 13:19:37,596][123090] Updated weights for policy 1, policy_version 1708350 (0.0009) [2023-12-26 13:19:38,216][123091] Updated weights for policy 0, policy_version 1719705 (0.0006) [2023-12-26 13:19:38,279][123091] Updated weights for policy 0, policy_version 1719715 (0.0008) [2023-12-26 13:19:38,340][123091] Updated weights for policy 0, policy_version 1719725 (0.0009) [2023-12-26 13:19:38,474][123090] Updated weights for policy 1, policy_version 1708360 (0.0006) [2023-12-26 13:19:38,543][123090] Updated weights for policy 1, policy_version 1708370 (0.0005) [2023-12-26 13:19:38,613][123090] Updated weights for policy 1, policy_version 1708380 (0.0005) [2023-12-26 13:19:38,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 877600768. Throughput: 0: 8727.8, 1: 9125.7. Samples: 877576252. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:38,785][121949] Avg episode reward: [(0, '5990.305'), (1, '4931.135')] [2023-12-26 13:19:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001719728_440254464.pth... [2023-12-26 13:19:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001708384_437346304.pth... [2023-12-26 13:19:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001718704_439992320.pth [2023-12-26 13:19:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001707328_437075968.pth [2023-12-26 13:19:39,122][123091] Updated weights for policy 0, policy_version 1719735 (0.0007) [2023-12-26 13:19:39,189][123091] Updated weights for policy 0, policy_version 1719745 (0.0007) [2023-12-26 13:19:39,267][123091] Updated weights for policy 0, policy_version 1719755 (0.0009) [2023-12-26 13:19:39,377][123090] Updated weights for policy 1, policy_version 1708390 (0.0008) [2023-12-26 13:19:39,454][123090] Updated weights for policy 1, policy_version 1708400 (0.0006) [2023-12-26 13:19:39,513][123090] Updated weights for policy 1, policy_version 1708410 (0.0006) [2023-12-26 13:19:39,995][123091] Updated weights for policy 0, policy_version 1719765 (0.0011) [2023-12-26 13:19:40,065][123091] Updated weights for policy 0, policy_version 1719775 (0.0011) [2023-12-26 13:19:40,124][123091] Updated weights for policy 0, policy_version 1719785 (0.0007) [2023-12-26 13:19:40,360][123090] Updated weights for policy 1, policy_version 1708420 (0.0007) [2023-12-26 13:19:40,411][123090] Updated weights for policy 1, policy_version 1708430 (0.0006) [2023-12-26 13:19:40,463][123090] Updated weights for policy 1, policy_version 1708440 (0.0005) [2023-12-26 13:19:40,877][123091] Updated weights for policy 0, policy_version 1719795 (0.0009) [2023-12-26 13:19:40,940][123091] Updated weights for policy 0, policy_version 1719805 (0.0006) [2023-12-26 13:19:40,990][123091] Updated weights for policy 0, policy_version 1719815 (0.0005) [2023-12-26 13:19:41,271][123090] Updated weights for policy 1, policy_version 1708450 (0.0010) [2023-12-26 13:19:41,331][123090] Updated weights for policy 1, policy_version 1708460 (0.0008) [2023-12-26 13:19:41,404][123090] Updated weights for policy 1, policy_version 1708470 (0.0010) [2023-12-26 13:19:41,471][123090] Updated weights for policy 1, policy_version 1708480 (0.0006) [2023-12-26 13:19:41,776][123091] Updated weights for policy 0, policy_version 1719825 (0.0007) [2023-12-26 13:19:41,845][123091] Updated weights for policy 0, policy_version 1719835 (0.0006) [2023-12-26 13:19:41,916][123091] Updated weights for policy 0, policy_version 1719845 (0.0005) [2023-12-26 13:19:41,990][123091] Updated weights for policy 0, policy_version 1719855 (0.0007) [2023-12-26 13:19:42,244][123090] Updated weights for policy 1, policy_version 1708490 (0.0005) [2023-12-26 13:19:42,314][123090] Updated weights for policy 1, policy_version 1708500 (0.0011) [2023-12-26 13:19:42,385][123090] Updated weights for policy 1, policy_version 1708510 (0.0010) [2023-12-26 13:19:42,681][123091] Updated weights for policy 0, policy_version 1719865 (0.0006) [2023-12-26 13:19:42,737][123091] Updated weights for policy 0, policy_version 1719875 (0.0009) [2023-12-26 13:19:42,793][123091] Updated weights for policy 0, policy_version 1719885 (0.0011) [2023-12-26 13:19:43,085][123090] Updated weights for policy 1, policy_version 1708520 (0.0009) [2023-12-26 13:19:43,136][123090] Updated weights for policy 1, policy_version 1708530 (0.0010) [2023-12-26 13:19:43,203][123090] Updated weights for policy 1, policy_version 1708540 (0.0010) [2023-12-26 13:19:43,561][123091] Updated weights for policy 0, policy_version 1719895 (0.0009) [2023-12-26 13:19:43,614][123091] Updated weights for policy 0, policy_version 1719905 (0.0008) [2023-12-26 13:19:43,674][123091] Updated weights for policy 0, policy_version 1719915 (0.0006) [2023-12-26 13:19:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 877690880. Throughput: 0: 8817.8, 1: 9025.4. Samples: 877682964. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:43,785][121949] Avg episode reward: [(0, '5989.974'), (1, '4730.741')] [2023-12-26 13:19:44,017][123090] Updated weights for policy 1, policy_version 1708550 (0.0010) [2023-12-26 13:19:44,072][123090] Updated weights for policy 1, policy_version 1708560 (0.0010) [2023-12-26 13:19:44,131][123090] Updated weights for policy 1, policy_version 1708570 (0.0010) [2023-12-26 13:19:44,387][123091] Updated weights for policy 0, policy_version 1719925 (0.0007) [2023-12-26 13:19:44,443][123091] Updated weights for policy 0, policy_version 1719935 (0.0009) [2023-12-26 13:19:44,491][123091] Updated weights for policy 0, policy_version 1719945 (0.0008) [2023-12-26 13:19:44,899][123090] Updated weights for policy 1, policy_version 1708580 (0.0008) [2023-12-26 13:19:44,970][123090] Updated weights for policy 1, policy_version 1708590 (0.0009) [2023-12-26 13:19:45,039][123090] Updated weights for policy 1, policy_version 1708600 (0.0008) [2023-12-26 13:19:45,389][123091] Updated weights for policy 0, policy_version 1719955 (0.0009) [2023-12-26 13:19:45,462][123091] Updated weights for policy 0, policy_version 1719965 (0.0009) [2023-12-26 13:19:45,532][123091] Updated weights for policy 0, policy_version 1719975 (0.0009) [2023-12-26 13:19:45,855][123090] Updated weights for policy 1, policy_version 1708610 (0.0009) [2023-12-26 13:19:45,916][123090] Updated weights for policy 1, policy_version 1708620 (0.0010) [2023-12-26 13:19:45,978][123090] Updated weights for policy 1, policy_version 1708630 (0.0007) [2023-12-26 13:19:46,035][123090] Updated weights for policy 1, policy_version 1708640 (0.0005) [2023-12-26 13:19:46,365][123091] Updated weights for policy 0, policy_version 1719985 (0.0009) [2023-12-26 13:19:46,419][123091] Updated weights for policy 0, policy_version 1719995 (0.0007) [2023-12-26 13:19:46,472][123091] Updated weights for policy 0, policy_version 1720005 (0.0009) [2023-12-26 13:19:46,535][123091] Updated weights for policy 0, policy_version 1720015 (0.0009) [2023-12-26 13:19:46,727][123090] Updated weights for policy 1, policy_version 1708650 (0.0008) [2023-12-26 13:19:46,791][123090] Updated weights for policy 1, policy_version 1708660 (0.0008) [2023-12-26 13:19:46,854][123090] Updated weights for policy 1, policy_version 1708670 (0.0008) [2023-12-26 13:19:47,385][123091] Updated weights for policy 0, policy_version 1720025 (0.0009) [2023-12-26 13:19:47,441][123091] Updated weights for policy 0, policy_version 1720035 (0.0009) [2023-12-26 13:19:47,499][123091] Updated weights for policy 0, policy_version 1720045 (0.0009) [2023-12-26 13:19:47,539][123090] Updated weights for policy 1, policy_version 1708680 (0.0007) [2023-12-26 13:19:47,596][123090] Updated weights for policy 1, policy_version 1708690 (0.0009) [2023-12-26 13:19:47,657][123090] Updated weights for policy 1, policy_version 1708700 (0.0009) [2023-12-26 13:19:48,306][123091] Updated weights for policy 0, policy_version 1720055 (0.0009) [2023-12-26 13:19:48,382][123091] Updated weights for policy 0, policy_version 1720065 (0.0009) [2023-12-26 13:19:48,456][123091] Updated weights for policy 0, policy_version 1720075 (0.0010) [2023-12-26 13:19:48,512][123090] Updated weights for policy 1, policy_version 1708710 (0.0008) [2023-12-26 13:19:48,573][123090] Updated weights for policy 1, policy_version 1708720 (0.0009) [2023-12-26 13:19:48,625][123090] Updated weights for policy 1, policy_version 1708730 (0.0010) [2023-12-26 13:19:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 877780992. Throughput: 0: 8846.4, 1: 8993.8. Samples: 877787868. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:48,785][121949] Avg episode reward: [(0, '6110.927'), (1, '4935.594')] [2023-12-26 13:19:49,257][123091] Updated weights for policy 0, policy_version 1720085 (0.0010) [2023-12-26 13:19:49,318][123091] Updated weights for policy 0, policy_version 1720095 (0.0009) [2023-12-26 13:19:49,386][123091] Updated weights for policy 0, policy_version 1720105 (0.0010) [2023-12-26 13:19:49,492][123090] Updated weights for policy 1, policy_version 1708740 (0.0010) [2023-12-26 13:19:49,549][123090] Updated weights for policy 1, policy_version 1708750 (0.0008) [2023-12-26 13:19:49,609][123090] Updated weights for policy 1, policy_version 1708760 (0.0009) [2023-12-26 13:19:50,234][123091] Updated weights for policy 0, policy_version 1720115 (0.0009) [2023-12-26 13:19:50,295][123091] Updated weights for policy 0, policy_version 1720125 (0.0010) [2023-12-26 13:19:50,367][123091] Updated weights for policy 0, policy_version 1720135 (0.0010) [2023-12-26 13:19:50,424][123090] Updated weights for policy 1, policy_version 1708771 (0.0009) [2023-12-26 13:19:50,489][123090] Updated weights for policy 1, policy_version 1708781 (0.0010) [2023-12-26 13:19:50,549][123090] Updated weights for policy 1, policy_version 1708791 (0.0009) [2023-12-26 13:19:51,251][123091] Updated weights for policy 0, policy_version 1720145 (0.0009) [2023-12-26 13:19:51,311][123091] Updated weights for policy 0, policy_version 1720155 (0.0010) [2023-12-26 13:19:51,381][123091] Updated weights for policy 0, policy_version 1720165 (0.0010) [2023-12-26 13:19:51,421][123090] Updated weights for policy 1, policy_version 1708801 (0.0010) [2023-12-26 13:19:51,445][123091] Updated weights for policy 0, policy_version 1720175 (0.0010) [2023-12-26 13:19:51,489][123090] Updated weights for policy 1, policy_version 1708811 (0.0009) [2023-12-26 13:19:51,557][123090] Updated weights for policy 1, policy_version 1708821 (0.0009) [2023-12-26 13:19:51,625][123090] Updated weights for policy 1, policy_version 1708831 (0.0009) [2023-12-26 13:19:52,310][123091] Updated weights for policy 0, policy_version 1720185 (0.0007) [2023-12-26 13:19:52,378][123091] Updated weights for policy 0, policy_version 1720195 (0.0008) [2023-12-26 13:19:52,442][123091] Updated weights for policy 0, policy_version 1720205 (0.0009) [2023-12-26 13:19:52,477][123090] Updated weights for policy 1, policy_version 1708841 (0.0006) [2023-12-26 13:19:52,533][123090] Updated weights for policy 1, policy_version 1708851 (0.0009) [2023-12-26 13:19:52,591][123090] Updated weights for policy 1, policy_version 1708861 (0.0010) [2023-12-26 13:19:53,270][123091] Updated weights for policy 0, policy_version 1720215 (0.0009) [2023-12-26 13:19:53,345][123091] Updated weights for policy 0, policy_version 1720225 (0.0010) [2023-12-26 13:19:53,376][123090] Updated weights for policy 1, policy_version 1708871 (0.0007) [2023-12-26 13:19:53,409][123091] Updated weights for policy 0, policy_version 1720235 (0.0008) [2023-12-26 13:19:53,433][123090] Updated weights for policy 1, policy_version 1708881 (0.0005) [2023-12-26 13:19:53,487][123090] Updated weights for policy 1, policy_version 1708891 (0.0005) [2023-12-26 13:19:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 877862912. Throughput: 0: 8787.1, 1: 8949.0. Samples: 877837580. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:53,785][121949] Avg episode reward: [(0, '6075.860'), (1, '5057.836')] [2023-12-26 13:19:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001720240_440385536.pth... [2023-12-26 13:19:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001708896_437477376.pth... [2023-12-26 13:19:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001719216_440123392.pth [2023-12-26 13:19:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001707840_437207040.pth [2023-12-26 13:19:54,096][123091] Updated weights for policy 0, policy_version 1720246 (0.0010) [2023-12-26 13:19:54,131][123090] Updated weights for policy 1, policy_version 1708901 (0.0005) [2023-12-26 13:19:54,155][123091] Updated weights for policy 0, policy_version 1720256 (0.0008) [2023-12-26 13:19:54,183][123090] Updated weights for policy 1, policy_version 1708911 (0.0008) [2023-12-26 13:19:54,203][123091] Updated weights for policy 0, policy_version 1720266 (0.0009) [2023-12-26 13:19:54,235][123090] Updated weights for policy 1, policy_version 1708921 (0.0009) [2023-12-26 13:19:55,050][123091] Updated weights for policy 0, policy_version 1720276 (0.0007) [2023-12-26 13:19:55,060][123090] Updated weights for policy 1, policy_version 1708931 (0.0010) [2023-12-26 13:19:55,102][123091] Updated weights for policy 0, policy_version 1720286 (0.0007) [2023-12-26 13:19:55,123][123090] Updated weights for policy 1, policy_version 1708941 (0.0010) [2023-12-26 13:19:55,152][123091] Updated weights for policy 0, policy_version 1720296 (0.0008) [2023-12-26 13:19:55,187][123090] Updated weights for policy 1, policy_version 1708951 (0.0010) [2023-12-26 13:19:55,904][123090] Updated weights for policy 1, policy_version 1708961 (0.0010) [2023-12-26 13:19:55,962][123090] Updated weights for policy 1, policy_version 1708971 (0.0009) [2023-12-26 13:19:56,019][123090] Updated weights for policy 1, policy_version 1708981 (0.0009) [2023-12-26 13:19:56,032][123091] Updated weights for policy 0, policy_version 1720306 (0.0008) [2023-12-26 13:19:56,066][123090] Updated weights for policy 1, policy_version 1708991 (0.0009) [2023-12-26 13:19:56,095][123091] Updated weights for policy 0, policy_version 1720316 (0.0008) [2023-12-26 13:19:56,156][123091] Updated weights for policy 0, policy_version 1720326 (0.0009) [2023-12-26 13:19:56,213][123091] Updated weights for policy 0, policy_version 1720336 (0.0010) [2023-12-26 13:19:56,892][123090] Updated weights for policy 1, policy_version 1709001 (0.0007) [2023-12-26 13:19:56,948][123090] Updated weights for policy 1, policy_version 1709011 (0.0005) [2023-12-26 13:19:57,000][123090] Updated weights for policy 1, policy_version 1709021 (0.0005) [2023-12-26 13:19:57,012][123091] Updated weights for policy 0, policy_version 1720346 (0.0009) [2023-12-26 13:19:57,065][123091] Updated weights for policy 0, policy_version 1720356 (0.0010) [2023-12-26 13:19:57,118][123091] Updated weights for policy 0, policy_version 1720366 (0.0010) [2023-12-26 13:19:57,699][123090] Updated weights for policy 1, policy_version 1709031 (0.0008) [2023-12-26 13:19:57,756][123090] Updated weights for policy 1, policy_version 1709041 (0.0009) [2023-12-26 13:19:57,806][123090] Updated weights for policy 1, policy_version 1709051 (0.0009) [2023-12-26 13:19:57,984][123091] Updated weights for policy 0, policy_version 1720376 (0.0010) [2023-12-26 13:19:58,030][123091] Updated weights for policy 0, policy_version 1720386 (0.0006) [2023-12-26 13:19:58,095][123091] Updated weights for policy 0, policy_version 1720396 (0.0007) [2023-12-26 13:19:58,720][123090] Updated weights for policy 1, policy_version 1709061 (0.0009) [2023-12-26 13:19:58,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 877944832. Throughput: 0: 8816.3, 1: 9059.2. Samples: 877944812. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:19:58,785][121949] Avg episode reward: [(0, '6034.377'), (1, '5287.114')] [2023-12-26 13:19:58,789][123090] Updated weights for policy 1, policy_version 1709071 (0.0008) [2023-12-26 13:19:58,855][123090] Updated weights for policy 1, policy_version 1709081 (0.0008) [2023-12-26 13:19:58,936][123091] Updated weights for policy 0, policy_version 1720406 (0.0008) [2023-12-26 13:19:58,998][123091] Updated weights for policy 0, policy_version 1720416 (0.0009) [2023-12-26 13:19:59,053][123091] Updated weights for policy 0, policy_version 1720426 (0.0009) [2023-12-26 13:19:59,726][123090] Updated weights for policy 1, policy_version 1709091 (0.0009) [2023-12-26 13:19:59,787][123090] Updated weights for policy 1, policy_version 1709101 (0.0009) [2023-12-26 13:19:59,860][123090] Updated weights for policy 1, policy_version 1709111 (0.0010) [2023-12-26 13:19:59,874][123091] Updated weights for policy 0, policy_version 1720436 (0.0009) [2023-12-26 13:19:59,941][123091] Updated weights for policy 0, policy_version 1720446 (0.0007) [2023-12-26 13:20:00,008][123091] Updated weights for policy 0, policy_version 1720456 (0.0008) [2023-12-26 13:20:00,672][123091] Updated weights for policy 0, policy_version 1720466 (0.0008) [2023-12-26 13:20:00,727][123091] Updated weights for policy 0, policy_version 1720476 (0.0005) [2023-12-26 13:20:00,736][123090] Updated weights for policy 1, policy_version 1709121 (0.0009) [2023-12-26 13:20:00,783][123091] Updated weights for policy 0, policy_version 1720486 (0.0005) [2023-12-26 13:20:00,785][123090] Updated weights for policy 1, policy_version 1709131 (0.0009) [2023-12-26 13:20:00,832][123091] Updated weights for policy 0, policy_version 1720496 (0.0009) [2023-12-26 13:20:00,839][123090] Updated weights for policy 1, policy_version 1709141 (0.0007) [2023-12-26 13:20:00,891][123090] Updated weights for policy 1, policy_version 1709151 (0.0009) [2023-12-26 13:20:01,621][123091] Updated weights for policy 0, policy_version 1720506 (0.0006) [2023-12-26 13:20:01,687][123091] Updated weights for policy 0, policy_version 1720516 (0.0006) [2023-12-26 13:20:01,745][123091] Updated weights for policy 0, policy_version 1720526 (0.0007) [2023-12-26 13:20:01,754][123090] Updated weights for policy 1, policy_version 1709161 (0.0009) [2023-12-26 13:20:01,806][123090] Updated weights for policy 1, policy_version 1709171 (0.0009) [2023-12-26 13:20:01,859][123090] Updated weights for policy 1, policy_version 1709181 (0.0008) [2023-12-26 13:20:02,497][123091] Updated weights for policy 0, policy_version 1720536 (0.0007) [2023-12-26 13:20:02,559][123091] Updated weights for policy 0, policy_version 1720546 (0.0010) [2023-12-26 13:20:02,618][123091] Updated weights for policy 0, policy_version 1720556 (0.0009) [2023-12-26 13:20:02,724][123090] Updated weights for policy 1, policy_version 1709191 (0.0009) [2023-12-26 13:20:02,788][123090] Updated weights for policy 1, policy_version 1709201 (0.0010) [2023-12-26 13:20:02,847][123090] Updated weights for policy 1, policy_version 1709211 (0.0009) [2023-12-26 13:20:03,350][123091] Updated weights for policy 0, policy_version 1720566 (0.0007) [2023-12-26 13:20:03,410][123091] Updated weights for policy 0, policy_version 1720576 (0.0007) [2023-12-26 13:20:03,473][123091] Updated weights for policy 0, policy_version 1720586 (0.0006) [2023-12-26 13:20:03,758][123090] Updated weights for policy 1, policy_version 1709222 (0.0010) [2023-12-26 13:20:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 878034944. Throughput: 0: 8852.4, 1: 8847.7. Samples: 878048796. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:20:03,785][121949] Avg episode reward: [(0, '6038.123'), (1, '5214.085')] [2023-12-26 13:20:03,813][123090] Updated weights for policy 1, policy_version 1709233 (0.0009) [2023-12-26 13:20:03,874][123090] Updated weights for policy 1, policy_version 1709243 (0.0009) [2023-12-26 13:20:04,150][123091] Updated weights for policy 0, policy_version 1720596 (0.0007) [2023-12-26 13:20:04,208][123091] Updated weights for policy 0, policy_version 1720606 (0.0009) [2023-12-26 13:20:04,280][123091] Updated weights for policy 0, policy_version 1720616 (0.0009) [2023-12-26 13:20:04,744][123090] Updated weights for policy 1, policy_version 1709253 (0.0009) [2023-12-26 13:20:04,805][123090] Updated weights for policy 1, policy_version 1709263 (0.0010) [2023-12-26 13:20:04,865][123090] Updated weights for policy 1, policy_version 1709273 (0.0009) [2023-12-26 13:20:05,089][123091] Updated weights for policy 0, policy_version 1720626 (0.0009) [2023-12-26 13:20:05,138][123091] Updated weights for policy 0, policy_version 1720636 (0.0005) [2023-12-26 13:20:05,185][123091] Updated weights for policy 0, policy_version 1720646 (0.0005) [2023-12-26 13:20:05,251][123091] Updated weights for policy 0, policy_version 1720656 (0.0006) [2023-12-26 13:20:05,625][123090] Updated weights for policy 1, policy_version 1709283 (0.0009) [2023-12-26 13:20:05,689][123090] Updated weights for policy 1, policy_version 1709293 (0.0008) [2023-12-26 13:20:05,756][123090] Updated weights for policy 1, policy_version 1709303 (0.0009) [2023-12-26 13:20:06,023][123091] Updated weights for policy 0, policy_version 1720666 (0.0009) [2023-12-26 13:20:06,083][123091] Updated weights for policy 0, policy_version 1720676 (0.0010) [2023-12-26 13:20:06,154][123091] Updated weights for policy 0, policy_version 1720686 (0.0010) [2023-12-26 13:20:06,635][123090] Updated weights for policy 1, policy_version 1709313 (0.0010) [2023-12-26 13:20:06,686][123090] Updated weights for policy 1, policy_version 1709323 (0.0007) [2023-12-26 13:20:06,757][123090] Updated weights for policy 1, policy_version 1709333 (0.0005) [2023-12-26 13:20:06,822][123090] Updated weights for policy 1, policy_version 1709343 (0.0008) [2023-12-26 13:20:06,958][123091] Updated weights for policy 0, policy_version 1720696 (0.0010) [2023-12-26 13:20:07,021][123091] Updated weights for policy 0, policy_version 1720706 (0.0009) [2023-12-26 13:20:07,090][123091] Updated weights for policy 0, policy_version 1720716 (0.0010) [2023-12-26 13:20:07,619][123090] Updated weights for policy 1, policy_version 1709353 (0.0010) [2023-12-26 13:20:07,683][123090] Updated weights for policy 1, policy_version 1709363 (0.0009) [2023-12-26 13:20:07,737][123090] Updated weights for policy 1, policy_version 1709373 (0.0010) [2023-12-26 13:20:07,805][123091] Updated weights for policy 0, policy_version 1720726 (0.0008) [2023-12-26 13:20:07,850][123091] Updated weights for policy 0, policy_version 1720736 (0.0006) [2023-12-26 13:20:07,897][123091] Updated weights for policy 0, policy_version 1720746 (0.0005) [2023-12-26 13:20:08,512][123090] Updated weights for policy 1, policy_version 1709383 (0.0008) [2023-12-26 13:20:08,574][123090] Updated weights for policy 1, policy_version 1709393 (0.0008) [2023-12-26 13:20:08,624][123090] Updated weights for policy 1, policy_version 1709403 (0.0006) [2023-12-26 13:20:08,688][123091] Updated weights for policy 0, policy_version 1720756 (0.0006) [2023-12-26 13:20:08,736][123091] Updated weights for policy 0, policy_version 1720766 (0.0008) [2023-12-26 13:20:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 878125056. Throughput: 0: 8871.2, 1: 8845.6. Samples: 878100820. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:20:08,785][121949] Avg episode reward: [(0, '5888.176'), (1, '5205.201')] [2023-12-26 13:20:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001709408_437608448.pth... [2023-12-26 13:20:08,793][123091] Updated weights for policy 0, policy_version 1720776 (0.0010) [2023-12-26 13:20:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001708384_437346304.pth [2023-12-26 13:20:08,830][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001720784_440524800.pth... [2023-12-26 13:20:08,834][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001719728_440254464.pth [2023-12-26 13:20:09,409][123090] Updated weights for policy 1, policy_version 1709413 (0.0007) [2023-12-26 13:20:09,480][123090] Updated weights for policy 1, policy_version 1709423 (0.0010) [2023-12-26 13:20:09,536][123090] Updated weights for policy 1, policy_version 1709433 (0.0010) [2023-12-26 13:20:09,709][123091] Updated weights for policy 0, policy_version 1720786 (0.0010) [2023-12-26 13:20:09,780][123091] Updated weights for policy 0, policy_version 1720796 (0.0009) [2023-12-26 13:20:09,846][123091] Updated weights for policy 0, policy_version 1720806 (0.0009) [2023-12-26 13:20:09,908][123091] Updated weights for policy 0, policy_version 1720816 (0.0010) [2023-12-26 13:20:10,377][123090] Updated weights for policy 1, policy_version 1709443 (0.0010) [2023-12-26 13:20:10,440][123090] Updated weights for policy 1, policy_version 1709453 (0.0009) [2023-12-26 13:20:10,505][123090] Updated weights for policy 1, policy_version 1709463 (0.0007) [2023-12-26 13:20:10,598][123091] Updated weights for policy 0, policy_version 1720826 (0.0005) [2023-12-26 13:20:10,652][123091] Updated weights for policy 0, policy_version 1720836 (0.0005) [2023-12-26 13:20:10,719][123091] Updated weights for policy 0, policy_version 1720846 (0.0005) [2023-12-26 13:20:11,222][123090] Updated weights for policy 1, policy_version 1709473 (0.0006) [2023-12-26 13:20:11,286][123090] Updated weights for policy 1, policy_version 1709483 (0.0007) [2023-12-26 13:20:11,359][123090] Updated weights for policy 1, policy_version 1709493 (0.0007) [2023-12-26 13:20:11,426][123090] Updated weights for policy 1, policy_version 1709503 (0.0009) [2023-12-26 13:20:11,557][123091] Updated weights for policy 0, policy_version 1720856 (0.0009) [2023-12-26 13:20:11,628][123091] Updated weights for policy 0, policy_version 1720866 (0.0011) [2023-12-26 13:20:11,697][123091] Updated weights for policy 0, policy_version 1720876 (0.0011) [2023-12-26 13:20:12,243][123090] Updated weights for policy 1, policy_version 1709513 (0.0010) [2023-12-26 13:20:12,312][123090] Updated weights for policy 1, policy_version 1709523 (0.0009) [2023-12-26 13:20:12,382][123090] Updated weights for policy 1, policy_version 1709533 (0.0009) [2023-12-26 13:20:12,471][123091] Updated weights for policy 0, policy_version 1720886 (0.0008) [2023-12-26 13:20:12,545][123091] Updated weights for policy 0, policy_version 1720896 (0.0006) [2023-12-26 13:20:12,608][123091] Updated weights for policy 0, policy_version 1720906 (0.0005) [2023-12-26 13:20:13,145][123090] Updated weights for policy 1, policy_version 1709543 (0.0009) [2023-12-26 13:20:13,204][123090] Updated weights for policy 1, policy_version 1709553 (0.0010) [2023-12-26 13:20:13,259][123090] Updated weights for policy 1, policy_version 1709563 (0.0009) [2023-12-26 13:20:13,283][123091] Updated weights for policy 0, policy_version 1720916 (0.0007) [2023-12-26 13:20:13,338][123091] Updated weights for policy 0, policy_version 1720926 (0.0010) [2023-12-26 13:20:13,393][123091] Updated weights for policy 0, policy_version 1720936 (0.0008) [2023-12-26 13:20:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 878215168. Throughput: 0: 8797.5, 1: 8787.2. Samples: 878207536. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:20:13,784][121949] Avg episode reward: [(0, '6015.640'), (1, '5132.884')] [2023-12-26 13:20:14,018][123091] Updated weights for policy 0, policy_version 1720946 (0.0005) [2023-12-26 13:20:14,068][123091] Updated weights for policy 0, policy_version 1720956 (0.0005) [2023-12-26 13:20:14,136][123091] Updated weights for policy 0, policy_version 1720966 (0.0007) [2023-12-26 13:20:14,185][123090] Updated weights for policy 1, policy_version 1709573 (0.0006) [2023-12-26 13:20:14,192][123091] Updated weights for policy 0, policy_version 1720976 (0.0010) [2023-12-26 13:20:14,242][123090] Updated weights for policy 1, policy_version 1709583 (0.0007) [2023-12-26 13:20:14,290][123090] Updated weights for policy 1, policy_version 1709593 (0.0008) [2023-12-26 13:20:15,014][123091] Updated weights for policy 0, policy_version 1720986 (0.0011) [2023-12-26 13:20:15,068][123090] Updated weights for policy 1, policy_version 1709603 (0.0008) [2023-12-26 13:20:15,074][123091] Updated weights for policy 0, policy_version 1720996 (0.0010) [2023-12-26 13:20:15,128][123090] Updated weights for policy 1, policy_version 1709613 (0.0006) [2023-12-26 13:20:15,138][123091] Updated weights for policy 0, policy_version 1721006 (0.0011) [2023-12-26 13:20:15,190][123090] Updated weights for policy 1, policy_version 1709623 (0.0009) [2023-12-26 13:20:15,960][123091] Updated weights for policy 0, policy_version 1721016 (0.0009) [2023-12-26 13:20:16,007][123091] Updated weights for policy 0, policy_version 1721026 (0.0009) [2023-12-26 13:20:16,029][123090] Updated weights for policy 1, policy_version 1709633 (0.0008) [2023-12-26 13:20:16,065][123091] Updated weights for policy 0, policy_version 1721036 (0.0010) [2023-12-26 13:20:16,090][123090] Updated weights for policy 1, policy_version 1709643 (0.0006) [2023-12-26 13:20:16,154][123090] Updated weights for policy 1, policy_version 1709653 (0.0008) [2023-12-26 13:20:16,204][123090] Updated weights for policy 1, policy_version 1709663 (0.0008) [2023-12-26 13:20:16,891][123091] Updated weights for policy 0, policy_version 1721046 (0.0009) [2023-12-26 13:20:16,959][123091] Updated weights for policy 0, policy_version 1721056 (0.0009) [2023-12-26 13:20:17,018][123091] Updated weights for policy 0, policy_version 1721066 (0.0010) [2023-12-26 13:20:17,020][123090] Updated weights for policy 1, policy_version 1709673 (0.0008) [2023-12-26 13:20:17,084][123090] Updated weights for policy 1, policy_version 1709683 (0.0009) [2023-12-26 13:20:17,143][123090] Updated weights for policy 1, policy_version 1709693 (0.0009) [2023-12-26 13:20:17,840][123091] Updated weights for policy 0, policy_version 1721076 (0.0008) [2023-12-26 13:20:17,901][123091] Updated weights for policy 0, policy_version 1721086 (0.0010) [2023-12-26 13:20:17,961][123091] Updated weights for policy 0, policy_version 1721096 (0.0010) [2023-12-26 13:20:17,971][123090] Updated weights for policy 1, policy_version 1709703 (0.0008) [2023-12-26 13:20:18,032][123090] Updated weights for policy 1, policy_version 1709713 (0.0008) [2023-12-26 13:20:18,090][123090] Updated weights for policy 1, policy_version 1709723 (0.0010) [2023-12-26 13:20:18,769][123091] Updated weights for policy 0, policy_version 1721106 (0.0009) [2023-12-26 13:20:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 878297088. Throughput: 0: 8834.8, 1: 8748.5. Samples: 878313216. Policy #0 lag: (min: 10.0, avg: 24.8, max: 42.0) [2023-12-26 13:20:18,785][121949] Avg episode reward: [(0, '5997.939'), (1, '5189.219')] [2023-12-26 13:20:18,834][123091] Updated weights for policy 0, policy_version 1721116 (0.0010) [2023-12-26 13:20:18,899][123091] Updated weights for policy 0, policy_version 1721126 (0.0010) [2023-12-26 13:20:18,959][123091] Updated weights for policy 0, policy_version 1721136 (0.0009) [2023-12-26 13:20:18,975][123090] Updated weights for policy 1, policy_version 1709733 (0.0009) [2023-12-26 13:20:19,031][123090] Updated weights for policy 1, policy_version 1709743 (0.0009) [2023-12-26 13:20:19,097][123090] Updated weights for policy 1, policy_version 1709753 (0.0010) [2023-12-26 13:20:19,862][123091] Updated weights for policy 0, policy_version 1721146 (0.0008) [2023-12-26 13:20:19,933][123091] Updated weights for policy 0, policy_version 1721156 (0.0008) [2023-12-26 13:20:19,944][123090] Updated weights for policy 1, policy_version 1709763 (0.0009) [2023-12-26 13:20:20,005][123091] Updated weights for policy 0, policy_version 1721166 (0.0006) [2023-12-26 13:20:20,010][123090] Updated weights for policy 1, policy_version 1709773 (0.0007) [2023-12-26 13:20:20,081][123090] Updated weights for policy 1, policy_version 1709783 (0.0006) [2023-12-26 13:20:20,738][123091] Updated weights for policy 0, policy_version 1721176 (0.0009) [2023-12-26 13:20:20,809][123091] Updated weights for policy 0, policy_version 1721186 (0.0006) [2023-12-26 13:20:20,809][123090] Updated weights for policy 1, policy_version 1709793 (0.0007) [2023-12-26 13:20:20,880][123090] Updated weights for policy 1, policy_version 1709803 (0.0006) [2023-12-26 13:20:20,880][123091] Updated weights for policy 0, policy_version 1721196 (0.0006) [2023-12-26 13:20:20,954][123090] Updated weights for policy 1, policy_version 1709813 (0.0006) [2023-12-26 13:20:21,012][123090] Updated weights for policy 1, policy_version 1709823 (0.0008) [2023-12-26 13:20:21,627][123091] Updated weights for policy 0, policy_version 1721206 (0.0009) [2023-12-26 13:20:21,701][123091] Updated weights for policy 0, policy_version 1721216 (0.0009) [2023-12-26 13:20:21,777][123091] Updated weights for policy 0, policy_version 1721226 (0.0009) [2023-12-26 13:20:21,834][123090] Updated weights for policy 1, policy_version 1709833 (0.0009) [2023-12-26 13:20:21,895][123090] Updated weights for policy 1, policy_version 1709843 (0.0010) [2023-12-26 13:20:21,960][123090] Updated weights for policy 1, policy_version 1709853 (0.0009) [2023-12-26 13:20:22,585][123091] Updated weights for policy 0, policy_version 1721236 (0.0008) [2023-12-26 13:20:22,648][123091] Updated weights for policy 0, policy_version 1721246 (0.0009) [2023-12-26 13:20:22,711][123091] Updated weights for policy 0, policy_version 1721256 (0.0010) [2023-12-26 13:20:22,829][123090] Updated weights for policy 1, policy_version 1709863 (0.0009) [2023-12-26 13:20:22,893][123090] Updated weights for policy 1, policy_version 1709873 (0.0009) [2023-12-26 13:20:22,960][123090] Updated weights for policy 1, policy_version 1709883 (0.0010) [2023-12-26 13:20:23,531][123091] Updated weights for policy 0, policy_version 1721266 (0.0010) [2023-12-26 13:20:23,597][123091] Updated weights for policy 0, policy_version 1721276 (0.0008) [2023-12-26 13:20:23,651][123091] Updated weights for policy 0, policy_version 1721286 (0.0011) [2023-12-26 13:20:23,701][123091] Updated weights for policy 0, policy_version 1721296 (0.0009) [2023-12-26 13:20:23,783][123090] Updated weights for policy 1, policy_version 1709893 (0.0009) [2023-12-26 13:20:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 878387200. Throughput: 0: 8839.0, 1: 8692.5. Samples: 878365164. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:23,785][121949] Avg episode reward: [(0, '5810.194'), (1, '5242.302')] [2023-12-26 13:20:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001721296_440655872.pth... [2023-12-26 13:20:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001720240_440385536.pth [2023-12-26 13:20:23,840][123090] Updated weights for policy 1, policy_version 1709903 (0.0010) [2023-12-26 13:20:23,892][123090] Updated weights for policy 1, policy_version 1709913 (0.0009) [2023-12-26 13:20:23,932][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001709920_437739520.pth... [2023-12-26 13:20:23,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001708896_437477376.pth [2023-12-26 13:20:24,518][123091] Updated weights for policy 0, policy_version 1721306 (0.0010) [2023-12-26 13:20:24,576][123091] Updated weights for policy 0, policy_version 1721316 (0.0009) [2023-12-26 13:20:24,628][123091] Updated weights for policy 0, policy_version 1721328 (0.0010) [2023-12-26 13:20:24,732][123090] Updated weights for policy 1, policy_version 1709923 (0.0009) [2023-12-26 13:20:24,798][123090] Updated weights for policy 1, policy_version 1709933 (0.0009) [2023-12-26 13:20:24,853][123090] Updated weights for policy 1, policy_version 1709943 (0.0009) [2023-12-26 13:20:25,468][123091] Updated weights for policy 0, policy_version 1721338 (0.0009) [2023-12-26 13:20:25,524][123091] Updated weights for policy 0, policy_version 1721348 (0.0010) [2023-12-26 13:20:25,575][123091] Updated weights for policy 0, policy_version 1721359 (0.0010) [2023-12-26 13:20:25,674][123090] Updated weights for policy 1, policy_version 1709953 (0.0009) [2023-12-26 13:20:25,724][123090] Updated weights for policy 1, policy_version 1709963 (0.0009) [2023-12-26 13:20:25,778][123090] Updated weights for policy 1, policy_version 1709974 (0.0010) [2023-12-26 13:20:26,363][123091] Updated weights for policy 0, policy_version 1721369 (0.0009) [2023-12-26 13:20:26,416][123091] Updated weights for policy 0, policy_version 1721379 (0.0010) [2023-12-26 13:20:26,465][123091] Updated weights for policy 0, policy_version 1721389 (0.0009) [2023-12-26 13:20:26,675][123090] Updated weights for policy 1, policy_version 1709985 (0.0010) [2023-12-26 13:20:26,739][123090] Updated weights for policy 1, policy_version 1709995 (0.0009) [2023-12-26 13:20:26,803][123090] Updated weights for policy 1, policy_version 1710005 (0.0009) [2023-12-26 13:20:26,861][123090] Updated weights for policy 1, policy_version 1710015 (0.0009) [2023-12-26 13:20:27,272][123091] Updated weights for policy 0, policy_version 1721399 (0.0010) [2023-12-26 13:20:27,322][123091] Updated weights for policy 0, policy_version 1721410 (0.0010) [2023-12-26 13:20:27,376][123091] Updated weights for policy 0, policy_version 1721420 (0.0010) [2023-12-26 13:20:27,667][123090] Updated weights for policy 1, policy_version 1710025 (0.0007) [2023-12-26 13:20:27,730][123090] Updated weights for policy 1, policy_version 1710035 (0.0010) [2023-12-26 13:20:27,783][123090] Updated weights for policy 1, policy_version 1710046 (0.0010) [2023-12-26 13:20:28,167][123091] Updated weights for policy 0, policy_version 1721430 (0.0007) [2023-12-26 13:20:28,236][123091] Updated weights for policy 0, policy_version 1721440 (0.0005) [2023-12-26 13:20:28,303][123091] Updated weights for policy 0, policy_version 1721450 (0.0005) [2023-12-26 13:20:28,592][123090] Updated weights for policy 1, policy_version 1710056 (0.0011) [2023-12-26 13:20:28,647][123090] Updated weights for policy 1, policy_version 1710066 (0.0010) [2023-12-26 13:20:28,713][123090] Updated weights for policy 1, policy_version 1710076 (0.0010) [2023-12-26 13:20:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17744.7). Total num frames: 878477312. Throughput: 0: 8798.3, 1: 8645.4. Samples: 878467928. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:28,784][121949] Avg episode reward: [(0, '5831.991'), (1, '5321.493')] [2023-12-26 13:20:29,001][123091] Updated weights for policy 0, policy_version 1721460 (0.0008) [2023-12-26 13:20:29,060][123091] Updated weights for policy 0, policy_version 1721470 (0.0005) [2023-12-26 13:20:29,108][123091] Updated weights for policy 0, policy_version 1721480 (0.0005) [2023-12-26 13:20:29,531][123090] Updated weights for policy 1, policy_version 1710086 (0.0010) [2023-12-26 13:20:29,583][123090] Updated weights for policy 1, policy_version 1710096 (0.0010) [2023-12-26 13:20:29,644][123090] Updated weights for policy 1, policy_version 1710106 (0.0010) [2023-12-26 13:20:29,865][123091] Updated weights for policy 0, policy_version 1721490 (0.0006) [2023-12-26 13:20:29,928][123091] Updated weights for policy 0, policy_version 1721500 (0.0008) [2023-12-26 13:20:29,993][123091] Updated weights for policy 0, policy_version 1721510 (0.0006) [2023-12-26 13:20:30,059][123091] Updated weights for policy 0, policy_version 1721520 (0.0010) [2023-12-26 13:20:30,360][123090] Updated weights for policy 1, policy_version 1710116 (0.0009) [2023-12-26 13:20:30,426][123090] Updated weights for policy 1, policy_version 1710126 (0.0010) [2023-12-26 13:20:30,492][123090] Updated weights for policy 1, policy_version 1710136 (0.0010) [2023-12-26 13:20:30,785][123091] Updated weights for policy 0, policy_version 1721530 (0.0005) [2023-12-26 13:20:30,838][123091] Updated weights for policy 0, policy_version 1721540 (0.0005) [2023-12-26 13:20:30,886][123091] Updated weights for policy 0, policy_version 1721550 (0.0005) [2023-12-26 13:20:31,141][123090] Updated weights for policy 1, policy_version 1710146 (0.0008) [2023-12-26 13:20:31,205][123090] Updated weights for policy 1, policy_version 1710157 (0.0006) [2023-12-26 13:20:31,267][123090] Updated weights for policy 1, policy_version 1710167 (0.0006) [2023-12-26 13:20:31,576][123091] Updated weights for policy 0, policy_version 1721560 (0.0006) [2023-12-26 13:20:31,640][123091] Updated weights for policy 0, policy_version 1721570 (0.0008) [2023-12-26 13:20:31,701][123091] Updated weights for policy 0, policy_version 1721580 (0.0009) [2023-12-26 13:20:32,087][123090] Updated weights for policy 1, policy_version 1710177 (0.0006) [2023-12-26 13:20:32,153][123090] Updated weights for policy 1, policy_version 1710187 (0.0010) [2023-12-26 13:20:32,216][123090] Updated weights for policy 1, policy_version 1710197 (0.0011) [2023-12-26 13:20:32,277][123090] Updated weights for policy 1, policy_version 1710207 (0.0010) [2023-12-26 13:20:32,512][123091] Updated weights for policy 0, policy_version 1721590 (0.0009) [2023-12-26 13:20:32,561][123091] Updated weights for policy 0, policy_version 1721600 (0.0009) [2023-12-26 13:20:32,608][123091] Updated weights for policy 0, policy_version 1721610 (0.0007) [2023-12-26 13:20:33,032][123090] Updated weights for policy 1, policy_version 1710217 (0.0009) [2023-12-26 13:20:33,080][123090] Updated weights for policy 1, policy_version 1710227 (0.0010) [2023-12-26 13:20:33,132][123090] Updated weights for policy 1, policy_version 1710237 (0.0010) [2023-12-26 13:20:33,479][123091] Updated weights for policy 0, policy_version 1721620 (0.0009) [2023-12-26 13:20:33,543][123091] Updated weights for policy 0, policy_version 1721630 (0.0006) [2023-12-26 13:20:33,605][123091] Updated weights for policy 0, policy_version 1721640 (0.0005) [2023-12-26 13:20:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 878567424. Throughput: 0: 8887.7, 1: 8678.1. Samples: 878578324. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:33,785][121949] Avg episode reward: [(0, '5837.226'), (1, '5163.383')] [2023-12-26 13:20:33,956][123090] Updated weights for policy 1, policy_version 1710247 (0.0010) [2023-12-26 13:20:34,019][123090] Updated weights for policy 1, policy_version 1710257 (0.0010) [2023-12-26 13:20:34,082][123090] Updated weights for policy 1, policy_version 1710267 (0.0010) [2023-12-26 13:20:34,234][123091] Updated weights for policy 0, policy_version 1721650 (0.0006) [2023-12-26 13:20:34,307][123091] Updated weights for policy 0, policy_version 1721660 (0.0011) [2023-12-26 13:20:34,380][123091] Updated weights for policy 0, policy_version 1721670 (0.0011) [2023-12-26 13:20:34,441][123091] Updated weights for policy 0, policy_version 1721680 (0.0011) [2023-12-26 13:20:34,897][123090] Updated weights for policy 1, policy_version 1710277 (0.0008) [2023-12-26 13:20:34,954][123090] Updated weights for policy 1, policy_version 1710287 (0.0006) [2023-12-26 13:20:35,025][123090] Updated weights for policy 1, policy_version 1710297 (0.0005) [2023-12-26 13:20:35,259][123091] Updated weights for policy 0, policy_version 1721690 (0.0009) [2023-12-26 13:20:35,332][123091] Updated weights for policy 0, policy_version 1721700 (0.0009) [2023-12-26 13:20:35,394][123091] Updated weights for policy 0, policy_version 1721710 (0.0010) [2023-12-26 13:20:35,581][123090] Updated weights for policy 1, policy_version 1710307 (0.0005) [2023-12-26 13:20:35,625][123090] Updated weights for policy 1, policy_version 1710317 (0.0005) [2023-12-26 13:20:35,682][123090] Updated weights for policy 1, policy_version 1710327 (0.0007) [2023-12-26 13:20:36,251][123091] Updated weights for policy 0, policy_version 1721720 (0.0010) [2023-12-26 13:20:36,325][123091] Updated weights for policy 0, policy_version 1721730 (0.0010) [2023-12-26 13:20:36,397][123091] Updated weights for policy 0, policy_version 1721740 (0.0010) [2023-12-26 13:20:36,470][123090] Updated weights for policy 1, policy_version 1710337 (0.0008) [2023-12-26 13:20:36,537][123090] Updated weights for policy 1, policy_version 1710347 (0.0009) [2023-12-26 13:20:36,605][123090] Updated weights for policy 1, policy_version 1710357 (0.0009) [2023-12-26 13:20:36,669][123090] Updated weights for policy 1, policy_version 1710367 (0.0009) [2023-12-26 13:20:37,190][123091] Updated weights for policy 0, policy_version 1721750 (0.0007) [2023-12-26 13:20:37,238][123091] Updated weights for policy 0, policy_version 1721760 (0.0006) [2023-12-26 13:20:37,286][123091] Updated weights for policy 0, policy_version 1721770 (0.0005) [2023-12-26 13:20:37,473][123090] Updated weights for policy 1, policy_version 1710377 (0.0010) [2023-12-26 13:20:37,542][123090] Updated weights for policy 1, policy_version 1710387 (0.0011) [2023-12-26 13:20:37,594][123090] Updated weights for policy 1, policy_version 1710397 (0.0010) [2023-12-26 13:20:37,988][123091] Updated weights for policy 0, policy_version 1721781 (0.0007) [2023-12-26 13:20:38,038][123091] Updated weights for policy 0, policy_version 1721791 (0.0009) [2023-12-26 13:20:38,088][123091] Updated weights for policy 0, policy_version 1721801 (0.0009) [2023-12-26 13:20:38,404][123090] Updated weights for policy 1, policy_version 1710407 (0.0009) [2023-12-26 13:20:38,463][123090] Updated weights for policy 1, policy_version 1710417 (0.0011) [2023-12-26 13:20:38,523][123090] Updated weights for policy 1, policy_version 1710427 (0.0010) [2023-12-26 13:20:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 878657536. Throughput: 0: 8919.9, 1: 8738.7. Samples: 878632216. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:38,785][121949] Avg episode reward: [(0, '5992.455'), (1, '5334.619')] [2023-12-26 13:20:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001721808_440786944.pth... [2023-12-26 13:20:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001710432_437870592.pth... [2023-12-26 13:20:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001720784_440524800.pth [2023-12-26 13:20:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001709408_437608448.pth [2023-12-26 13:20:38,961][123091] Updated weights for policy 0, policy_version 1721812 (0.0010) [2023-12-26 13:20:39,009][123091] Updated weights for policy 0, policy_version 1721822 (0.0008) [2023-12-26 13:20:39,064][123091] Updated weights for policy 0, policy_version 1721832 (0.0009) [2023-12-26 13:20:39,378][123090] Updated weights for policy 1, policy_version 1710437 (0.0009) [2023-12-26 13:20:39,441][123090] Updated weights for policy 1, policy_version 1710447 (0.0007) [2023-12-26 13:20:39,516][123090] Updated weights for policy 1, policy_version 1710457 (0.0010) [2023-12-26 13:20:39,933][123091] Updated weights for policy 0, policy_version 1721842 (0.0009) [2023-12-26 13:20:40,004][123091] Updated weights for policy 0, policy_version 1721852 (0.0009) [2023-12-26 13:20:40,070][123091] Updated weights for policy 0, policy_version 1721862 (0.0009) [2023-12-26 13:20:40,139][123091] Updated weights for policy 0, policy_version 1721872 (0.0009) [2023-12-26 13:20:40,347][123090] Updated weights for policy 1, policy_version 1710467 (0.0010) [2023-12-26 13:20:40,407][123090] Updated weights for policy 1, policy_version 1710477 (0.0008) [2023-12-26 13:20:40,473][123090] Updated weights for policy 1, policy_version 1710487 (0.0007) [2023-12-26 13:20:40,952][123091] Updated weights for policy 0, policy_version 1721882 (0.0011) [2023-12-26 13:20:41,014][123091] Updated weights for policy 0, policy_version 1721892 (0.0010) [2023-12-26 13:20:41,080][123091] Updated weights for policy 0, policy_version 1721902 (0.0009) [2023-12-26 13:20:41,321][123090] Updated weights for policy 1, policy_version 1710497 (0.0008) [2023-12-26 13:20:41,394][123090] Updated weights for policy 1, policy_version 1710507 (0.0008) [2023-12-26 13:20:41,454][123090] Updated weights for policy 1, policy_version 1710517 (0.0009) [2023-12-26 13:20:41,514][123090] Updated weights for policy 1, policy_version 1710527 (0.0009) [2023-12-26 13:20:41,942][123091] Updated weights for policy 0, policy_version 1721912 (0.0010) [2023-12-26 13:20:41,997][123091] Updated weights for policy 0, policy_version 1721922 (0.0010) [2023-12-26 13:20:42,060][123091] Updated weights for policy 0, policy_version 1721932 (0.0010) [2023-12-26 13:20:42,365][123090] Updated weights for policy 1, policy_version 1710537 (0.0011) [2023-12-26 13:20:42,423][123090] Updated weights for policy 1, policy_version 1710547 (0.0008) [2023-12-26 13:20:42,490][123090] Updated weights for policy 1, policy_version 1710557 (0.0006) [2023-12-26 13:20:42,825][123091] Updated weights for policy 0, policy_version 1721942 (0.0009) [2023-12-26 13:20:42,869][123091] Updated weights for policy 0, policy_version 1721952 (0.0010) [2023-12-26 13:20:42,918][123091] Updated weights for policy 0, policy_version 1721962 (0.0009) [2023-12-26 13:20:43,248][123090] Updated weights for policy 1, policy_version 1710567 (0.0009) [2023-12-26 13:20:43,295][123090] Updated weights for policy 1, policy_version 1710577 (0.0010) [2023-12-26 13:20:43,351][123090] Updated weights for policy 1, policy_version 1710587 (0.0010) [2023-12-26 13:20:43,652][123091] Updated weights for policy 0, policy_version 1721972 (0.0005) [2023-12-26 13:20:43,707][123091] Updated weights for policy 0, policy_version 1721982 (0.0005) [2023-12-26 13:20:43,755][123091] Updated weights for policy 0, policy_version 1721992 (0.0005) [2023-12-26 13:20:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 878739456. Throughput: 0: 8931.1, 1: 8637.8. Samples: 878735412. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:43,785][121949] Avg episode reward: [(0, '6057.823'), (1, '5453.162')] [2023-12-26 13:20:44,195][123090] Updated weights for policy 1, policy_version 1710597 (0.0010) [2023-12-26 13:20:44,245][123090] Updated weights for policy 1, policy_version 1710607 (0.0006) [2023-12-26 13:20:44,296][123090] Updated weights for policy 1, policy_version 1710617 (0.0005) [2023-12-26 13:20:44,378][123091] Updated weights for policy 0, policy_version 1722002 (0.0005) [2023-12-26 13:20:44,440][123091] Updated weights for policy 0, policy_version 1722012 (0.0006) [2023-12-26 13:20:44,497][123091] Updated weights for policy 0, policy_version 1722022 (0.0005) [2023-12-26 13:20:44,553][123091] Updated weights for policy 0, policy_version 1722032 (0.0005) [2023-12-26 13:20:44,909][123090] Updated weights for policy 1, policy_version 1710627 (0.0007) [2023-12-26 13:20:44,962][123090] Updated weights for policy 1, policy_version 1710637 (0.0011) [2023-12-26 13:20:45,028][123090] Updated weights for policy 1, policy_version 1710647 (0.0010) [2023-12-26 13:20:45,278][123091] Updated weights for policy 0, policy_version 1722042 (0.0006) [2023-12-26 13:20:45,341][123091] Updated weights for policy 0, policy_version 1722052 (0.0006) [2023-12-26 13:20:45,407][123091] Updated weights for policy 0, policy_version 1722062 (0.0009) [2023-12-26 13:20:45,877][123090] Updated weights for policy 1, policy_version 1710657 (0.0011) [2023-12-26 13:20:45,932][123090] Updated weights for policy 1, policy_version 1710667 (0.0010) [2023-12-26 13:20:46,010][123090] Updated weights for policy 1, policy_version 1710677 (0.0011) [2023-12-26 13:20:46,080][123090] Updated weights for policy 1, policy_version 1710687 (0.0010) [2023-12-26 13:20:46,129][123091] Updated weights for policy 0, policy_version 1722072 (0.0006) [2023-12-26 13:20:46,183][123091] Updated weights for policy 0, policy_version 1722082 (0.0005) [2023-12-26 13:20:46,238][123091] Updated weights for policy 0, policy_version 1722092 (0.0006) [2023-12-26 13:20:46,777][123090] Updated weights for policy 1, policy_version 1710697 (0.0010) [2023-12-26 13:20:46,840][123090] Updated weights for policy 1, policy_version 1710707 (0.0010) [2023-12-26 13:20:46,903][123090] Updated weights for policy 1, policy_version 1710717 (0.0010) [2023-12-26 13:20:46,973][123091] Updated weights for policy 0, policy_version 1722102 (0.0008) [2023-12-26 13:20:47,029][123091] Updated weights for policy 0, policy_version 1722112 (0.0007) [2023-12-26 13:20:47,098][123091] Updated weights for policy 0, policy_version 1722122 (0.0009) [2023-12-26 13:20:47,625][123090] Updated weights for policy 1, policy_version 1710727 (0.0007) [2023-12-26 13:20:47,679][123090] Updated weights for policy 1, policy_version 1710737 (0.0005) [2023-12-26 13:20:47,728][123090] Updated weights for policy 1, policy_version 1710747 (0.0005) [2023-12-26 13:20:48,002][123091] Updated weights for policy 0, policy_version 1722132 (0.0010) [2023-12-26 13:20:48,063][123091] Updated weights for policy 0, policy_version 1722142 (0.0009) [2023-12-26 13:20:48,117][123091] Updated weights for policy 0, policy_version 1722152 (0.0010) [2023-12-26 13:20:48,355][123090] Updated weights for policy 1, policy_version 1710757 (0.0006) [2023-12-26 13:20:48,419][123090] Updated weights for policy 1, policy_version 1710767 (0.0006) [2023-12-26 13:20:48,475][123090] Updated weights for policy 1, policy_version 1710777 (0.0006) [2023-12-26 13:20:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 878837760. Throughput: 0: 8964.8, 1: 8805.7. Samples: 878848468. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:48,785][121949] Avg episode reward: [(0, '5992.244'), (1, '5468.855')] [2023-12-26 13:20:49,054][123091] Updated weights for policy 0, policy_version 1722162 (0.0010) [2023-12-26 13:20:49,108][123091] Updated weights for policy 0, policy_version 1722172 (0.0010) [2023-12-26 13:20:49,156][123090] Updated weights for policy 1, policy_version 1710787 (0.0005) [2023-12-26 13:20:49,169][123091] Updated weights for policy 0, policy_version 1722182 (0.0010) [2023-12-26 13:20:49,214][123090] Updated weights for policy 1, policy_version 1710797 (0.0006) [2023-12-26 13:20:49,233][123091] Updated weights for policy 0, policy_version 1722192 (0.0009) [2023-12-26 13:20:49,285][123090] Updated weights for policy 1, policy_version 1710807 (0.0009) [2023-12-26 13:20:50,054][123090] Updated weights for policy 1, policy_version 1710818 (0.0011) [2023-12-26 13:20:50,121][123090] Updated weights for policy 1, policy_version 1710828 (0.0009) [2023-12-26 13:20:50,188][123090] Updated weights for policy 1, policy_version 1710838 (0.0006) [2023-12-26 13:20:50,191][123091] Updated weights for policy 0, policy_version 1722202 (0.0010) [2023-12-26 13:20:50,256][123090] Updated weights for policy 1, policy_version 1710848 (0.0006) [2023-12-26 13:20:50,257][123091] Updated weights for policy 0, policy_version 1722212 (0.0009) [2023-12-26 13:20:50,324][123091] Updated weights for policy 0, policy_version 1722222 (0.0005) [2023-12-26 13:20:51,056][123090] Updated weights for policy 1, policy_version 1710858 (0.0007) [2023-12-26 13:20:51,107][123091] Updated weights for policy 0, policy_version 1722232 (0.0007) [2023-12-26 13:20:51,119][123090] Updated weights for policy 1, policy_version 1710868 (0.0006) [2023-12-26 13:20:51,180][123091] Updated weights for policy 0, policy_version 1722242 (0.0006) [2023-12-26 13:20:51,186][123090] Updated weights for policy 1, policy_version 1710878 (0.0009) [2023-12-26 13:20:51,247][123091] Updated weights for policy 0, policy_version 1722252 (0.0009) [2023-12-26 13:20:51,998][123090] Updated weights for policy 1, policy_version 1710888 (0.0009) [2023-12-26 13:20:52,053][123090] Updated weights for policy 1, policy_version 1710899 (0.0010) [2023-12-26 13:20:52,086][123091] Updated weights for policy 0, policy_version 1722262 (0.0008) [2023-12-26 13:20:52,117][123090] Updated weights for policy 1, policy_version 1710909 (0.0006) [2023-12-26 13:20:52,141][123091] Updated weights for policy 0, policy_version 1722272 (0.0009) [2023-12-26 13:20:52,195][123091] Updated weights for policy 0, policy_version 1722282 (0.0009) [2023-12-26 13:20:52,960][123090] Updated weights for policy 1, policy_version 1710919 (0.0006) [2023-12-26 13:20:53,010][123090] Updated weights for policy 1, policy_version 1710929 (0.0005) [2023-12-26 13:20:53,058][123091] Updated weights for policy 0, policy_version 1722292 (0.0010) [2023-12-26 13:20:53,074][123090] Updated weights for policy 1, policy_version 1710939 (0.0009) [2023-12-26 13:20:53,121][123091] Updated weights for policy 0, policy_version 1722302 (0.0010) [2023-12-26 13:20:53,183][123091] Updated weights for policy 0, policy_version 1722312 (0.0010) [2023-12-26 13:20:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 878919680. Throughput: 0: 8917.6, 1: 8842.8. Samples: 878900040. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:53,785][121949] Avg episode reward: [(0, '5874.217'), (1, '5464.138')] [2023-12-26 13:20:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001710944_438001664.pth... [2023-12-26 13:20:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001722320_440918016.pth... [2023-12-26 13:20:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001721296_440655872.pth [2023-12-26 13:20:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001709920_437739520.pth [2023-12-26 13:20:53,842][123090] Updated weights for policy 1, policy_version 1710949 (0.0011) [2023-12-26 13:20:53,902][123090] Updated weights for policy 1, policy_version 1710959 (0.0010) [2023-12-26 13:20:53,957][123090] Updated weights for policy 1, policy_version 1710969 (0.0010) [2023-12-26 13:20:53,992][123091] Updated weights for policy 0, policy_version 1722322 (0.0010) [2023-12-26 13:20:54,052][123091] Updated weights for policy 0, policy_version 1722332 (0.0011) [2023-12-26 13:20:54,119][123091] Updated weights for policy 0, policy_version 1722342 (0.0011) [2023-12-26 13:20:54,182][123091] Updated weights for policy 0, policy_version 1722352 (0.0010) [2023-12-26 13:20:54,782][123090] Updated weights for policy 1, policy_version 1710979 (0.0010) [2023-12-26 13:20:54,833][123090] Updated weights for policy 1, policy_version 1710989 (0.0010) [2023-12-26 13:20:54,892][123090] Updated weights for policy 1, policy_version 1710999 (0.0010) [2023-12-26 13:20:55,011][123091] Updated weights for policy 0, policy_version 1722362 (0.0010) [2023-12-26 13:20:55,059][123091] Updated weights for policy 0, policy_version 1722372 (0.0010) [2023-12-26 13:20:55,110][123091] Updated weights for policy 0, policy_version 1722382 (0.0010) [2023-12-26 13:20:55,731][123090] Updated weights for policy 1, policy_version 1711009 (0.0010) [2023-12-26 13:20:55,789][123090] Updated weights for policy 1, policy_version 1711019 (0.0010) [2023-12-26 13:20:55,806][123091] Updated weights for policy 0, policy_version 1722392 (0.0006) [2023-12-26 13:20:55,841][123090] Updated weights for policy 1, policy_version 1711029 (0.0010) [2023-12-26 13:20:55,859][123091] Updated weights for policy 0, policy_version 1722402 (0.0005) [2023-12-26 13:20:55,893][123090] Updated weights for policy 1, policy_version 1711039 (0.0010) [2023-12-26 13:20:55,930][123091] Updated weights for policy 0, policy_version 1722412 (0.0006) [2023-12-26 13:20:56,456][123091] Updated weights for policy 0, policy_version 1722422 (0.0006) [2023-12-26 13:20:56,524][123091] Updated weights for policy 0, policy_version 1722432 (0.0005) [2023-12-26 13:20:56,577][123091] Updated weights for policy 0, policy_version 1722442 (0.0009) [2023-12-26 13:20:56,614][123090] Updated weights for policy 1, policy_version 1711049 (0.0007) [2023-12-26 13:20:56,665][123090] Updated weights for policy 1, policy_version 1711059 (0.0009) [2023-12-26 13:20:56,720][123090] Updated weights for policy 1, policy_version 1711069 (0.0009) [2023-12-26 13:20:57,335][123091] Updated weights for policy 0, policy_version 1722452 (0.0008) [2023-12-26 13:20:57,388][123091] Updated weights for policy 0, policy_version 1722462 (0.0007) [2023-12-26 13:20:57,435][123091] Updated weights for policy 0, policy_version 1722472 (0.0010) [2023-12-26 13:20:57,467][123090] Updated weights for policy 1, policy_version 1711079 (0.0007) [2023-12-26 13:20:57,518][123090] Updated weights for policy 1, policy_version 1711089 (0.0009) [2023-12-26 13:20:57,569][123090] Updated weights for policy 1, policy_version 1711099 (0.0008) [2023-12-26 13:20:58,137][123091] Updated weights for policy 0, policy_version 1722482 (0.0006) [2023-12-26 13:20:58,189][123091] Updated weights for policy 0, policy_version 1722492 (0.0008) [2023-12-26 13:20:58,241][123091] Updated weights for policy 0, policy_version 1722502 (0.0008) [2023-12-26 13:20:58,299][123090] Updated weights for policy 1, policy_version 1711109 (0.0008) [2023-12-26 13:20:58,311][123091] Updated weights for policy 0, policy_version 1722512 (0.0008) [2023-12-26 13:20:58,369][123090] Updated weights for policy 1, policy_version 1711119 (0.0012) [2023-12-26 13:20:58,431][123090] Updated weights for policy 1, policy_version 1711129 (0.0010) [2023-12-26 13:20:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 879017984. Throughput: 0: 8940.9, 1: 8873.7. Samples: 879009192. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:20:58,785][121949] Avg episode reward: [(0, '5914.938'), (1, '5186.118')] [2023-12-26 13:20:59,135][123091] Updated weights for policy 0, policy_version 1722522 (0.0009) [2023-12-26 13:20:59,188][123091] Updated weights for policy 0, policy_version 1722532 (0.0009) [2023-12-26 13:20:59,257][123091] Updated weights for policy 0, policy_version 1722542 (0.0008) [2023-12-26 13:20:59,306][123090] Updated weights for policy 1, policy_version 1711139 (0.0010) [2023-12-26 13:20:59,376][123090] Updated weights for policy 1, policy_version 1711149 (0.0009) [2023-12-26 13:20:59,442][123090] Updated weights for policy 1, policy_version 1711159 (0.0010) [2023-12-26 13:21:00,159][123090] Updated weights for policy 1, policy_version 1711169 (0.0008) [2023-12-26 13:21:00,170][123091] Updated weights for policy 0, policy_version 1722552 (0.0010) [2023-12-26 13:21:00,214][123090] Updated weights for policy 1, policy_version 1711179 (0.0005) [2023-12-26 13:21:00,224][123091] Updated weights for policy 0, policy_version 1722562 (0.0009) [2023-12-26 13:21:00,278][123090] Updated weights for policy 1, policy_version 1711189 (0.0005) [2023-12-26 13:21:00,284][123091] Updated weights for policy 0, policy_version 1722572 (0.0009) [2023-12-26 13:21:00,342][123090] Updated weights for policy 1, policy_version 1711199 (0.0006) [2023-12-26 13:21:01,075][123091] Updated weights for policy 0, policy_version 1722582 (0.0009) [2023-12-26 13:21:01,131][123090] Updated weights for policy 1, policy_version 1711209 (0.0009) [2023-12-26 13:21:01,144][123091] Updated weights for policy 0, policy_version 1722592 (0.0009) [2023-12-26 13:21:01,195][123091] Updated weights for policy 0, policy_version 1722602 (0.0008) [2023-12-26 13:21:01,200][123090] Updated weights for policy 1, policy_version 1711219 (0.0008) [2023-12-26 13:21:01,270][123090] Updated weights for policy 1, policy_version 1711229 (0.0008) [2023-12-26 13:21:02,017][123091] Updated weights for policy 0, policy_version 1722612 (0.0009) [2023-12-26 13:21:02,051][123090] Updated weights for policy 1, policy_version 1711239 (0.0009) [2023-12-26 13:21:02,083][123091] Updated weights for policy 0, policy_version 1722622 (0.0009) [2023-12-26 13:21:02,113][123090] Updated weights for policy 1, policy_version 1711249 (0.0008) [2023-12-26 13:21:02,146][123091] Updated weights for policy 0, policy_version 1722632 (0.0008) [2023-12-26 13:21:02,167][123090] Updated weights for policy 1, policy_version 1711259 (0.0009) [2023-12-26 13:21:02,920][123091] Updated weights for policy 0, policy_version 1722642 (0.0007) [2023-12-26 13:21:02,970][123091] Updated weights for policy 0, policy_version 1722652 (0.0010) [2023-12-26 13:21:03,019][123090] Updated weights for policy 1, policy_version 1711269 (0.0009) [2023-12-26 13:21:03,031][123091] Updated weights for policy 0, policy_version 1722662 (0.0008) [2023-12-26 13:21:03,072][123090] Updated weights for policy 1, policy_version 1711279 (0.0006) [2023-12-26 13:21:03,092][123091] Updated weights for policy 0, policy_version 1722672 (0.0007) [2023-12-26 13:21:03,125][123090] Updated weights for policy 1, policy_version 1711289 (0.0005) [2023-12-26 13:21:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 879099904. Throughput: 0: 8921.7, 1: 8933.0. Samples: 879116676. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:03,784][121949] Avg episode reward: [(0, '6058.421'), (1, '5132.439')] [2023-12-26 13:21:03,800][123091] Updated weights for policy 0, policy_version 1722682 (0.0009) [2023-12-26 13:21:03,848][123090] Updated weights for policy 1, policy_version 1711299 (0.0006) [2023-12-26 13:21:03,866][123091] Updated weights for policy 0, policy_version 1722692 (0.0009) [2023-12-26 13:21:03,917][123090] Updated weights for policy 1, policy_version 1711309 (0.0009) [2023-12-26 13:21:03,925][123091] Updated weights for policy 0, policy_version 1722702 (0.0010) [2023-12-26 13:21:03,982][123090] Updated weights for policy 1, policy_version 1711319 (0.0009) [2023-12-26 13:21:04,811][123091] Updated weights for policy 0, policy_version 1722712 (0.0010) [2023-12-26 13:21:04,824][123090] Updated weights for policy 1, policy_version 1711329 (0.0008) [2023-12-26 13:21:04,876][123091] Updated weights for policy 0, policy_version 1722722 (0.0010) [2023-12-26 13:21:04,888][123090] Updated weights for policy 1, policy_version 1711339 (0.0008) [2023-12-26 13:21:04,935][123091] Updated weights for policy 0, policy_version 1722732 (0.0008) [2023-12-26 13:21:04,952][123090] Updated weights for policy 1, policy_version 1711349 (0.0008) [2023-12-26 13:21:05,015][123090] Updated weights for policy 1, policy_version 1711359 (0.0006) [2023-12-26 13:21:05,775][123091] Updated weights for policy 0, policy_version 1722742 (0.0009) [2023-12-26 13:21:05,804][123090] Updated weights for policy 1, policy_version 1711369 (0.0009) [2023-12-26 13:21:05,838][123091] Updated weights for policy 0, policy_version 1722752 (0.0007) [2023-12-26 13:21:05,870][123090] Updated weights for policy 1, policy_version 1711379 (0.0008) [2023-12-26 13:21:05,902][123091] Updated weights for policy 0, policy_version 1722762 (0.0007) [2023-12-26 13:21:05,926][123090] Updated weights for policy 1, policy_version 1711389 (0.0009) [2023-12-26 13:21:06,707][123090] Updated weights for policy 1, policy_version 1711399 (0.0009) [2023-12-26 13:21:06,732][123091] Updated weights for policy 0, policy_version 1722772 (0.0007) [2023-12-26 13:21:06,771][123090] Updated weights for policy 1, policy_version 1711409 (0.0008) [2023-12-26 13:21:06,796][123091] Updated weights for policy 0, policy_version 1722782 (0.0008) [2023-12-26 13:21:06,832][123090] Updated weights for policy 1, policy_version 1711419 (0.0010) [2023-12-26 13:21:06,860][123091] Updated weights for policy 0, policy_version 1722792 (0.0007) [2023-12-26 13:21:07,654][123090] Updated weights for policy 1, policy_version 1711429 (0.0008) [2023-12-26 13:21:07,698][123091] Updated weights for policy 0, policy_version 1722802 (0.0010) [2023-12-26 13:21:07,716][123090] Updated weights for policy 1, policy_version 1711439 (0.0009) [2023-12-26 13:21:07,748][123091] Updated weights for policy 0, policy_version 1722812 (0.0010) [2023-12-26 13:21:07,770][123090] Updated weights for policy 1, policy_version 1711449 (0.0008) [2023-12-26 13:21:07,797][123091] Updated weights for policy 0, policy_version 1722822 (0.0009) [2023-12-26 13:21:07,848][123091] Updated weights for policy 0, policy_version 1722832 (0.0007) [2023-12-26 13:21:08,516][123090] Updated weights for policy 1, policy_version 1711459 (0.0006) [2023-12-26 13:21:08,557][123091] Updated weights for policy 0, policy_version 1722842 (0.0009) [2023-12-26 13:21:08,582][123090] Updated weights for policy 1, policy_version 1711469 (0.0006) [2023-12-26 13:21:08,622][123091] Updated weights for policy 0, policy_version 1722852 (0.0009) [2023-12-26 13:21:08,644][123090] Updated weights for policy 1, policy_version 1711479 (0.0008) [2023-12-26 13:21:08,688][123091] Updated weights for policy 0, policy_version 1722862 (0.0008) [2023-12-26 13:21:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 879198208. Throughput: 0: 8912.2, 1: 8936.5. Samples: 879168356. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:08,785][121949] Avg episode reward: [(0, '6055.277'), (1, '5148.408')] [2023-12-26 13:21:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001722864_441057280.pth... [2023-12-26 13:21:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001711488_438140928.pth... [2023-12-26 13:21:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001710432_437870592.pth [2023-12-26 13:21:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001721808_440786944.pth [2023-12-26 13:21:09,474][123091] Updated weights for policy 0, policy_version 1722872 (0.0009) [2023-12-26 13:21:09,492][123090] Updated weights for policy 1, policy_version 1711489 (0.0009) [2023-12-26 13:21:09,539][123091] Updated weights for policy 0, policy_version 1722882 (0.0007) [2023-12-26 13:21:09,559][123090] Updated weights for policy 1, policy_version 1711499 (0.0009) [2023-12-26 13:21:09,608][123091] Updated weights for policy 0, policy_version 1722892 (0.0009) [2023-12-26 13:21:09,627][123090] Updated weights for policy 1, policy_version 1711509 (0.0008) [2023-12-26 13:21:09,694][123090] Updated weights for policy 1, policy_version 1711519 (0.0008) [2023-12-26 13:21:10,478][123091] Updated weights for policy 0, policy_version 1722902 (0.0008) [2023-12-26 13:21:10,496][123090] Updated weights for policy 1, policy_version 1711529 (0.0008) [2023-12-26 13:21:10,538][123091] Updated weights for policy 0, policy_version 1722912 (0.0008) [2023-12-26 13:21:10,545][123090] Updated weights for policy 1, policy_version 1711539 (0.0007) [2023-12-26 13:21:10,592][123091] Updated weights for policy 0, policy_version 1722922 (0.0009) [2023-12-26 13:21:10,594][123090] Updated weights for policy 1, policy_version 1711549 (0.0006) [2023-12-26 13:21:11,396][123091] Updated weights for policy 0, policy_version 1722932 (0.0009) [2023-12-26 13:21:11,466][123091] Updated weights for policy 0, policy_version 1722942 (0.0005) [2023-12-26 13:21:11,482][123090] Updated weights for policy 1, policy_version 1711559 (0.0008) [2023-12-26 13:21:11,537][123091] Updated weights for policy 0, policy_version 1722952 (0.0008) [2023-12-26 13:21:11,549][123090] Updated weights for policy 1, policy_version 1711569 (0.0007) [2023-12-26 13:21:11,621][123090] Updated weights for policy 1, policy_version 1711579 (0.0009) [2023-12-26 13:21:12,272][123091] Updated weights for policy 0, policy_version 1722962 (0.0010) [2023-12-26 13:21:12,348][123091] Updated weights for policy 0, policy_version 1722972 (0.0007) [2023-12-26 13:21:12,408][123090] Updated weights for policy 1, policy_version 1711589 (0.0011) [2023-12-26 13:21:12,416][123091] Updated weights for policy 0, policy_version 1722982 (0.0007) [2023-12-26 13:21:12,471][123090] Updated weights for policy 1, policy_version 1711599 (0.0011) [2023-12-26 13:21:12,474][123091] Updated weights for policy 0, policy_version 1722992 (0.0008) [2023-12-26 13:21:12,532][123090] Updated weights for policy 1, policy_version 1711609 (0.0011) [2023-12-26 13:21:13,283][123091] Updated weights for policy 0, policy_version 1723002 (0.0010) [2023-12-26 13:21:13,352][123091] Updated weights for policy 0, policy_version 1723012 (0.0010) [2023-12-26 13:21:13,368][123090] Updated weights for policy 1, policy_version 1711619 (0.0009) [2023-12-26 13:21:13,425][123091] Updated weights for policy 0, policy_version 1723022 (0.0009) [2023-12-26 13:21:13,434][123090] Updated weights for policy 1, policy_version 1711629 (0.0005) [2023-12-26 13:21:13,505][123090] Updated weights for policy 1, policy_version 1711639 (0.0005) [2023-12-26 13:21:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 879280128. Throughput: 0: 8922.4, 1: 8939.3. Samples: 879271704. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:13,785][121949] Avg episode reward: [(0, '6110.190'), (1, '5007.805')] [2023-12-26 13:21:14,106][123091] Updated weights for policy 0, policy_version 1723032 (0.0007) [2023-12-26 13:21:14,166][123090] Updated weights for policy 1, policy_version 1711649 (0.0009) [2023-12-26 13:21:14,203][123091] Updated weights for policy 0, policy_version 1723042 (0.0005) [2023-12-26 13:21:14,241][123090] Updated weights for policy 1, policy_version 1711659 (0.0011) [2023-12-26 13:21:14,267][123091] Updated weights for policy 0, policy_version 1723052 (0.0005) [2023-12-26 13:21:14,312][123090] Updated weights for policy 1, policy_version 1711669 (0.0011) [2023-12-26 13:21:14,367][123090] Updated weights for policy 1, policy_version 1711679 (0.0010) [2023-12-26 13:21:14,927][123091] Updated weights for policy 0, policy_version 1723062 (0.0007) [2023-12-26 13:21:14,996][123091] Updated weights for policy 0, policy_version 1723072 (0.0009) [2023-12-26 13:21:15,067][123091] Updated weights for policy 0, policy_version 1723082 (0.0008) [2023-12-26 13:21:15,162][123090] Updated weights for policy 1, policy_version 1711689 (0.0010) [2023-12-26 13:21:15,220][123090] Updated weights for policy 1, policy_version 1711699 (0.0008) [2023-12-26 13:21:15,269][123090] Updated weights for policy 1, policy_version 1711709 (0.0008) [2023-12-26 13:21:15,865][123091] Updated weights for policy 0, policy_version 1723092 (0.0010) [2023-12-26 13:21:15,910][123091] Updated weights for policy 0, policy_version 1723102 (0.0007) [2023-12-26 13:21:15,965][123091] Updated weights for policy 0, policy_version 1723112 (0.0010) [2023-12-26 13:21:16,087][123090] Updated weights for policy 1, policy_version 1711719 (0.0009) [2023-12-26 13:21:16,148][123090] Updated weights for policy 1, policy_version 1711729 (0.0005) [2023-12-26 13:21:16,209][123090] Updated weights for policy 1, policy_version 1711739 (0.0005) [2023-12-26 13:21:16,801][123091] Updated weights for policy 0, policy_version 1723122 (0.0010) [2023-12-26 13:21:16,860][123091] Updated weights for policy 0, policy_version 1723132 (0.0010) [2023-12-26 13:21:16,909][123091] Updated weights for policy 0, policy_version 1723142 (0.0010) [2023-12-26 13:21:16,971][123091] Updated weights for policy 0, policy_version 1723152 (0.0010) [2023-12-26 13:21:17,015][123090] Updated weights for policy 1, policy_version 1711749 (0.0010) [2023-12-26 13:21:17,068][123090] Updated weights for policy 1, policy_version 1711759 (0.0010) [2023-12-26 13:21:17,122][123090] Updated weights for policy 1, policy_version 1711769 (0.0006) [2023-12-26 13:21:17,767][123091] Updated weights for policy 0, policy_version 1723162 (0.0010) [2023-12-26 13:21:17,833][123091] Updated weights for policy 0, policy_version 1723172 (0.0010) [2023-12-26 13:21:17,894][123091] Updated weights for policy 0, policy_version 1723182 (0.0010) [2023-12-26 13:21:17,911][123090] Updated weights for policy 1, policy_version 1711779 (0.0007) [2023-12-26 13:21:17,958][123090] Updated weights for policy 1, policy_version 1711789 (0.0010) [2023-12-26 13:21:18,022][123090] Updated weights for policy 1, policy_version 1711799 (0.0011) [2023-12-26 13:21:18,627][123091] Updated weights for policy 0, policy_version 1723192 (0.0006) [2023-12-26 13:21:18,695][123091] Updated weights for policy 0, policy_version 1723202 (0.0005) [2023-12-26 13:21:18,759][123091] Updated weights for policy 0, policy_version 1723212 (0.0005) [2023-12-26 13:21:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 879370240. Throughput: 0: 8890.4, 1: 8950.8. Samples: 879381184. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:18,785][121949] Avg episode reward: [(0, '6089.244'), (1, '5027.951')] [2023-12-26 13:21:18,805][123090] Updated weights for policy 1, policy_version 1711809 (0.0011) [2023-12-26 13:21:18,857][123090] Updated weights for policy 1, policy_version 1711819 (0.0010) [2023-12-26 13:21:18,920][123090] Updated weights for policy 1, policy_version 1711829 (0.0011) [2023-12-26 13:21:18,987][123090] Updated weights for policy 1, policy_version 1711839 (0.0011) [2023-12-26 13:21:19,521][123091] Updated weights for policy 0, policy_version 1723222 (0.0008) [2023-12-26 13:21:19,594][123091] Updated weights for policy 0, policy_version 1723232 (0.0007) [2023-12-26 13:21:19,657][123091] Updated weights for policy 0, policy_version 1723242 (0.0010) [2023-12-26 13:21:19,825][123090] Updated weights for policy 1, policy_version 1711849 (0.0011) [2023-12-26 13:21:19,892][123090] Updated weights for policy 1, policy_version 1711859 (0.0011) [2023-12-26 13:21:19,958][123090] Updated weights for policy 1, policy_version 1711869 (0.0011) [2023-12-26 13:21:20,443][123091] Updated weights for policy 0, policy_version 1723252 (0.0010) [2023-12-26 13:21:20,507][123091] Updated weights for policy 0, policy_version 1723262 (0.0009) [2023-12-26 13:21:20,581][123091] Updated weights for policy 0, policy_version 1723272 (0.0010) [2023-12-26 13:21:20,825][123090] Updated weights for policy 1, policy_version 1711879 (0.0011) [2023-12-26 13:21:20,890][123090] Updated weights for policy 1, policy_version 1711889 (0.0011) [2023-12-26 13:21:20,967][123090] Updated weights for policy 1, policy_version 1711899 (0.0011) [2023-12-26 13:21:21,388][123091] Updated weights for policy 0, policy_version 1723282 (0.0009) [2023-12-26 13:21:21,461][123091] Updated weights for policy 0, policy_version 1723292 (0.0008) [2023-12-26 13:21:21,533][123091] Updated weights for policy 0, policy_version 1723302 (0.0010) [2023-12-26 13:21:21,604][123091] Updated weights for policy 0, policy_version 1723312 (0.0011) [2023-12-26 13:21:21,819][123090] Updated weights for policy 1, policy_version 1711909 (0.0011) [2023-12-26 13:21:21,884][123090] Updated weights for policy 1, policy_version 1711919 (0.0011) [2023-12-26 13:21:21,959][123090] Updated weights for policy 1, policy_version 1711929 (0.0011) [2023-12-26 13:21:22,306][123091] Updated weights for policy 0, policy_version 1723322 (0.0006) [2023-12-26 13:21:22,368][123091] Updated weights for policy 0, policy_version 1723332 (0.0009) [2023-12-26 13:21:22,417][123091] Updated weights for policy 0, policy_version 1723342 (0.0010) [2023-12-26 13:21:22,797][123090] Updated weights for policy 1, policy_version 1711939 (0.0010) [2023-12-26 13:21:22,860][123090] Updated weights for policy 1, policy_version 1711949 (0.0009) [2023-12-26 13:21:22,937][123090] Updated weights for policy 1, policy_version 1711959 (0.0007) [2023-12-26 13:21:23,220][123091] Updated weights for policy 0, policy_version 1723352 (0.0007) [2023-12-26 13:21:23,288][123091] Updated weights for policy 0, policy_version 1723362 (0.0005) [2023-12-26 13:21:23,339][123091] Updated weights for policy 0, policy_version 1723372 (0.0009) [2023-12-26 13:21:23,639][123090] Updated weights for policy 1, policy_version 1711969 (0.0006) [2023-12-26 13:21:23,702][123090] Updated weights for policy 1, policy_version 1711979 (0.0010) [2023-12-26 13:21:23,753][123090] Updated weights for policy 1, policy_version 1711989 (0.0010) [2023-12-26 13:21:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.2, 300 sec: 17744.7). Total num frames: 879452160. Throughput: 0: 8889.7, 1: 8874.1. Samples: 879431592. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:23,786][121949] Avg episode reward: [(0, '6021.203'), (1, '5348.290')] [2023-12-26 13:21:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001723376_441188352.pth... [2023-12-26 13:21:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001722320_440918016.pth [2023-12-26 13:21:23,819][123090] Updated weights for policy 1, policy_version 1711999 (0.0010) [2023-12-26 13:21:23,824][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001712000_438272000.pth... [2023-12-26 13:21:23,829][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001710944_438001664.pth [2023-12-26 13:21:24,131][123091] Updated weights for policy 0, policy_version 1723382 (0.0009) [2023-12-26 13:21:24,192][123091] Updated weights for policy 0, policy_version 1723392 (0.0007) [2023-12-26 13:21:24,264][123091] Updated weights for policy 0, policy_version 1723402 (0.0005) [2023-12-26 13:21:24,658][123090] Updated weights for policy 1, policy_version 1712009 (0.0010) [2023-12-26 13:21:24,706][123090] Updated weights for policy 1, policy_version 1712019 (0.0010) [2023-12-26 13:21:24,761][123090] Updated weights for policy 1, policy_version 1712029 (0.0010) [2023-12-26 13:21:24,964][123091] Updated weights for policy 0, policy_version 1723412 (0.0007) [2023-12-26 13:21:25,034][123091] Updated weights for policy 0, policy_version 1723422 (0.0005) [2023-12-26 13:21:25,099][123091] Updated weights for policy 0, policy_version 1723432 (0.0005) [2023-12-26 13:21:25,491][123090] Updated weights for policy 1, policy_version 1712040 (0.0007) [2023-12-26 13:21:25,542][123090] Updated weights for policy 1, policy_version 1712050 (0.0006) [2023-12-26 13:21:25,597][123090] Updated weights for policy 1, policy_version 1712060 (0.0005) [2023-12-26 13:21:25,806][123091] Updated weights for policy 0, policy_version 1723442 (0.0005) [2023-12-26 13:21:25,872][123091] Updated weights for policy 0, policy_version 1723452 (0.0005) [2023-12-26 13:21:25,934][123091] Updated weights for policy 0, policy_version 1723462 (0.0005) [2023-12-26 13:21:25,992][123091] Updated weights for policy 0, policy_version 1723472 (0.0006) [2023-12-26 13:21:26,268][123090] Updated weights for policy 1, policy_version 1712070 (0.0008) [2023-12-26 13:21:26,330][123090] Updated weights for policy 1, policy_version 1712080 (0.0010) [2023-12-26 13:21:26,389][123090] Updated weights for policy 1, policy_version 1712090 (0.0010) [2023-12-26 13:21:26,584][123091] Updated weights for policy 0, policy_version 1723482 (0.0005) [2023-12-26 13:21:26,643][123091] Updated weights for policy 0, policy_version 1723492 (0.0005) [2023-12-26 13:21:26,701][123091] Updated weights for policy 0, policy_version 1723502 (0.0005) [2023-12-26 13:21:27,203][123090] Updated weights for policy 1, policy_version 1712100 (0.0010) [2023-12-26 13:21:27,225][123091] Updated weights for policy 0, policy_version 1723512 (0.0005) [2023-12-26 13:21:27,246][123090] Updated weights for policy 1, policy_version 1712110 (0.0010) [2023-12-26 13:21:27,272][123091] Updated weights for policy 0, policy_version 1723522 (0.0005) [2023-12-26 13:21:27,298][123090] Updated weights for policy 1, policy_version 1712120 (0.0010) [2023-12-26 13:21:27,329][123091] Updated weights for policy 0, policy_version 1723532 (0.0006) [2023-12-26 13:21:28,031][123090] Updated weights for policy 1, policy_version 1712130 (0.0007) [2023-12-26 13:21:28,094][123090] Updated weights for policy 1, policy_version 1712140 (0.0009) [2023-12-26 13:21:28,109][123091] Updated weights for policy 0, policy_version 1723542 (0.0007) [2023-12-26 13:21:28,143][123090] Updated weights for policy 1, policy_version 1712150 (0.0009) [2023-12-26 13:21:28,155][123091] Updated weights for policy 0, policy_version 1723552 (0.0005) [2023-12-26 13:21:28,192][123090] Updated weights for policy 1, policy_version 1712160 (0.0009) [2023-12-26 13:21:28,209][123091] Updated weights for policy 0, policy_version 1723562 (0.0005) [2023-12-26 13:21:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 879550464. Throughput: 0: 9053.4, 1: 8940.1. Samples: 879545120. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:28,785][121949] Avg episode reward: [(0, '5971.179'), (1, '5386.487')] [2023-12-26 13:21:28,956][123091] Updated weights for policy 0, policy_version 1723572 (0.0007) [2023-12-26 13:21:29,010][123091] Updated weights for policy 0, policy_version 1723582 (0.0010) [2023-12-26 13:21:29,032][123090] Updated weights for policy 1, policy_version 1712170 (0.0008) [2023-12-26 13:21:29,072][123091] Updated weights for policy 0, policy_version 1723592 (0.0010) [2023-12-26 13:21:29,080][123090] Updated weights for policy 1, policy_version 1712180 (0.0008) [2023-12-26 13:21:29,129][123090] Updated weights for policy 1, policy_version 1712190 (0.0008) [2023-12-26 13:21:29,794][123091] Updated weights for policy 0, policy_version 1723602 (0.0009) [2023-12-26 13:21:29,860][123091] Updated weights for policy 0, policy_version 1723612 (0.0008) [2023-12-26 13:21:29,926][123091] Updated weights for policy 0, policy_version 1723622 (0.0008) [2023-12-26 13:21:29,950][123090] Updated weights for policy 1, policy_version 1712200 (0.0008) [2023-12-26 13:21:29,986][123091] Updated weights for policy 0, policy_version 1723632 (0.0009) [2023-12-26 13:21:30,005][123090] Updated weights for policy 1, policy_version 1712210 (0.0006) [2023-12-26 13:21:30,077][123090] Updated weights for policy 1, policy_version 1712220 (0.0006) [2023-12-26 13:21:30,764][123091] Updated weights for policy 0, policy_version 1723642 (0.0009) [2023-12-26 13:21:30,782][123090] Updated weights for policy 1, policy_version 1712230 (0.0008) [2023-12-26 13:21:30,827][123091] Updated weights for policy 0, policy_version 1723652 (0.0009) [2023-12-26 13:21:30,851][123090] Updated weights for policy 1, policy_version 1712240 (0.0007) [2023-12-26 13:21:30,879][123091] Updated weights for policy 0, policy_version 1723662 (0.0009) [2023-12-26 13:21:30,925][123090] Updated weights for policy 1, policy_version 1712250 (0.0006) [2023-12-26 13:21:31,679][123091] Updated weights for policy 0, policy_version 1723672 (0.0009) [2023-12-26 13:21:31,742][123091] Updated weights for policy 0, policy_version 1723682 (0.0008) [2023-12-26 13:21:31,746][123090] Updated weights for policy 1, policy_version 1712260 (0.0008) [2023-12-26 13:21:31,807][123091] Updated weights for policy 0, policy_version 1723692 (0.0007) [2023-12-26 13:21:31,819][123090] Updated weights for policy 1, policy_version 1712270 (0.0008) [2023-12-26 13:21:31,879][123090] Updated weights for policy 1, policy_version 1712280 (0.0009) [2023-12-26 13:21:32,483][123091] Updated weights for policy 0, policy_version 1723702 (0.0009) [2023-12-26 13:21:32,540][123091] Updated weights for policy 0, policy_version 1723714 (0.0010) [2023-12-26 13:21:32,600][123091] Updated weights for policy 0, policy_version 1723724 (0.0009) [2023-12-26 13:21:32,742][123090] Updated weights for policy 1, policy_version 1712290 (0.0010) [2023-12-26 13:21:32,792][123090] Updated weights for policy 1, policy_version 1712300 (0.0009) [2023-12-26 13:21:32,846][123090] Updated weights for policy 1, policy_version 1712310 (0.0009) [2023-12-26 13:21:32,898][123090] Updated weights for policy 1, policy_version 1712320 (0.0009) [2023-12-26 13:21:33,447][123091] Updated weights for policy 0, policy_version 1723734 (0.0009) [2023-12-26 13:21:33,496][123091] Updated weights for policy 0, policy_version 1723744 (0.0009) [2023-12-26 13:21:33,549][123091] Updated weights for policy 0, policy_version 1723754 (0.0010) [2023-12-26 13:21:33,756][123090] Updated weights for policy 1, policy_version 1712330 (0.0010) [2023-12-26 13:21:33,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 879640576. Throughput: 0: 9017.6, 1: 8863.6. Samples: 879653120. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:33,784][121949] Avg episode reward: [(0, '5980.753'), (1, '5490.929')] [2023-12-26 13:21:33,802][123090] Updated weights for policy 1, policy_version 1712340 (0.0008) [2023-12-26 13:21:33,849][123090] Updated weights for policy 1, policy_version 1712350 (0.0009) [2023-12-26 13:21:34,408][123091] Updated weights for policy 0, policy_version 1723764 (0.0010) [2023-12-26 13:21:34,473][123091] Updated weights for policy 0, policy_version 1723774 (0.0009) [2023-12-26 13:21:34,538][123091] Updated weights for policy 0, policy_version 1723784 (0.0010) [2023-12-26 13:21:34,696][123090] Updated weights for policy 1, policy_version 1712360 (0.0009) [2023-12-26 13:21:34,763][123090] Updated weights for policy 1, policy_version 1712370 (0.0009) [2023-12-26 13:21:34,822][123090] Updated weights for policy 1, policy_version 1712380 (0.0010) [2023-12-26 13:21:35,377][123091] Updated weights for policy 0, policy_version 1723794 (0.0010) [2023-12-26 13:21:35,443][123091] Updated weights for policy 0, policy_version 1723804 (0.0010) [2023-12-26 13:21:35,498][123091] Updated weights for policy 0, policy_version 1723814 (0.0009) [2023-12-26 13:21:35,558][123091] Updated weights for policy 0, policy_version 1723824 (0.0010) [2023-12-26 13:21:35,663][123090] Updated weights for policy 1, policy_version 1712390 (0.0009) [2023-12-26 13:21:35,718][123090] Updated weights for policy 1, policy_version 1712400 (0.0009) [2023-12-26 13:21:35,773][123090] Updated weights for policy 1, policy_version 1712410 (0.0009) [2023-12-26 13:21:36,377][123091] Updated weights for policy 0, policy_version 1723834 (0.0009) [2023-12-26 13:21:36,432][123091] Updated weights for policy 0, policy_version 1723844 (0.0009) [2023-12-26 13:21:36,487][123091] Updated weights for policy 0, policy_version 1723854 (0.0009) [2023-12-26 13:21:36,663][123090] Updated weights for policy 1, policy_version 1712420 (0.0009) [2023-12-26 13:21:36,723][123090] Updated weights for policy 1, policy_version 1712430 (0.0009) [2023-12-26 13:21:36,794][123090] Updated weights for policy 1, policy_version 1712440 (0.0011) [2023-12-26 13:21:37,350][123091] Updated weights for policy 0, policy_version 1723864 (0.0010) [2023-12-26 13:21:37,413][123091] Updated weights for policy 0, policy_version 1723874 (0.0011) [2023-12-26 13:21:37,476][123091] Updated weights for policy 0, policy_version 1723884 (0.0011) [2023-12-26 13:21:37,592][123090] Updated weights for policy 1, policy_version 1712450 (0.0010) [2023-12-26 13:21:37,658][123090] Updated weights for policy 1, policy_version 1712460 (0.0007) [2023-12-26 13:21:37,733][123090] Updated weights for policy 1, policy_version 1712470 (0.0008) [2023-12-26 13:21:37,785][123090] Updated weights for policy 1, policy_version 1712480 (0.0008) [2023-12-26 13:21:38,327][123091] Updated weights for policy 0, policy_version 1723894 (0.0011) [2023-12-26 13:21:38,393][123091] Updated weights for policy 0, policy_version 1723904 (0.0008) [2023-12-26 13:21:38,466][123091] Updated weights for policy 0, policy_version 1723914 (0.0006) [2023-12-26 13:21:38,576][123090] Updated weights for policy 1, policy_version 1712490 (0.0010) [2023-12-26 13:21:38,638][123090] Updated weights for policy 1, policy_version 1712500 (0.0009) [2023-12-26 13:21:38,688][123090] Updated weights for policy 1, policy_version 1712510 (0.0009) [2023-12-26 13:21:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 879730688. Throughput: 0: 9031.8, 1: 8828.4. Samples: 879703752. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:38,785][121949] Avg episode reward: [(0, '5884.092'), (1, '5601.797')] [2023-12-26 13:21:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001723920_441327616.pth... [2023-12-26 13:21:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001712512_438403072.pth... [2023-12-26 13:21:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001722864_441057280.pth [2023-12-26 13:21:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001711488_438140928.pth [2023-12-26 13:21:39,219][123091] Updated weights for policy 0, policy_version 1723924 (0.0009) [2023-12-26 13:21:39,289][123091] Updated weights for policy 0, policy_version 1723934 (0.0008) [2023-12-26 13:21:39,360][123091] Updated weights for policy 0, policy_version 1723944 (0.0010) [2023-12-26 13:21:39,539][123090] Updated weights for policy 1, policy_version 1712520 (0.0006) [2023-12-26 13:21:39,610][123090] Updated weights for policy 1, policy_version 1712530 (0.0005) [2023-12-26 13:21:39,676][123090] Updated weights for policy 1, policy_version 1712540 (0.0009) [2023-12-26 13:21:40,225][123091] Updated weights for policy 0, policy_version 1723954 (0.0010) [2023-12-26 13:21:40,284][123091] Updated weights for policy 0, policy_version 1723964 (0.0010) [2023-12-26 13:21:40,342][123091] Updated weights for policy 0, policy_version 1723974 (0.0010) [2023-12-26 13:21:40,402][123091] Updated weights for policy 0, policy_version 1723984 (0.0010) [2023-12-26 13:21:40,480][123090] Updated weights for policy 1, policy_version 1712550 (0.0009) [2023-12-26 13:21:40,543][123090] Updated weights for policy 1, policy_version 1712560 (0.0009) [2023-12-26 13:21:40,610][123090] Updated weights for policy 1, policy_version 1712570 (0.0010) [2023-12-26 13:21:41,035][123091] Updated weights for policy 0, policy_version 1723994 (0.0009) [2023-12-26 13:21:41,102][123091] Updated weights for policy 0, policy_version 1724004 (0.0008) [2023-12-26 13:21:41,176][123091] Updated weights for policy 0, policy_version 1724014 (0.0008) [2023-12-26 13:21:41,500][123090] Updated weights for policy 1, policy_version 1712580 (0.0010) [2023-12-26 13:21:41,564][123090] Updated weights for policy 1, policy_version 1712590 (0.0009) [2023-12-26 13:21:41,636][123090] Updated weights for policy 1, policy_version 1712600 (0.0009) [2023-12-26 13:21:41,985][123091] Updated weights for policy 0, policy_version 1724024 (0.0009) [2023-12-26 13:21:42,047][123091] Updated weights for policy 0, policy_version 1724034 (0.0010) [2023-12-26 13:21:42,113][123091] Updated weights for policy 0, policy_version 1724044 (0.0010) [2023-12-26 13:21:42,484][123090] Updated weights for policy 1, policy_version 1712610 (0.0009) [2023-12-26 13:21:42,550][123090] Updated weights for policy 1, policy_version 1712620 (0.0010) [2023-12-26 13:21:42,611][123090] Updated weights for policy 1, policy_version 1712631 (0.0010) [2023-12-26 13:21:42,904][123091] Updated weights for policy 0, policy_version 1724054 (0.0007) [2023-12-26 13:21:42,959][123091] Updated weights for policy 0, policy_version 1724064 (0.0005) [2023-12-26 13:21:43,013][123091] Updated weights for policy 0, policy_version 1724074 (0.0005) [2023-12-26 13:21:43,510][123090] Updated weights for policy 1, policy_version 1712641 (0.0010) [2023-12-26 13:21:43,569][123090] Updated weights for policy 1, policy_version 1712651 (0.0007) [2023-12-26 13:21:43,624][123090] Updated weights for policy 1, policy_version 1712661 (0.0005) [2023-12-26 13:21:43,678][123090] Updated weights for policy 1, policy_version 1712671 (0.0005) [2023-12-26 13:21:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 879812608. Throughput: 0: 8972.9, 1: 8735.3. Samples: 879806068. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:43,785][121949] Avg episode reward: [(0, '5768.931'), (1, '5456.547')] [2023-12-26 13:21:43,829][123091] Updated weights for policy 0, policy_version 1724084 (0.0007) [2023-12-26 13:21:43,885][123091] Updated weights for policy 0, policy_version 1724094 (0.0009) [2023-12-26 13:21:43,949][123091] Updated weights for policy 0, policy_version 1724104 (0.0009) [2023-12-26 13:21:44,362][123090] Updated weights for policy 1, policy_version 1712681 (0.0008) [2023-12-26 13:21:44,410][123090] Updated weights for policy 1, policy_version 1712691 (0.0005) [2023-12-26 13:21:44,455][123090] Updated weights for policy 1, policy_version 1712701 (0.0005) [2023-12-26 13:21:44,893][123091] Updated weights for policy 0, policy_version 1724114 (0.0009) [2023-12-26 13:21:44,956][123091] Updated weights for policy 0, policy_version 1724124 (0.0008) [2023-12-26 13:21:45,032][123091] Updated weights for policy 0, policy_version 1724134 (0.0006) [2023-12-26 13:21:45,112][123091] Updated weights for policy 0, policy_version 1724144 (0.0007) [2023-12-26 13:21:45,214][123090] Updated weights for policy 1, policy_version 1712711 (0.0006) [2023-12-26 13:21:45,288][123090] Updated weights for policy 1, policy_version 1712721 (0.0008) [2023-12-26 13:21:45,357][123090] Updated weights for policy 1, policy_version 1712731 (0.0007) [2023-12-26 13:21:45,863][123091] Updated weights for policy 0, policy_version 1724154 (0.0009) [2023-12-26 13:21:45,892][123090] Updated weights for policy 1, policy_version 1712741 (0.0009) [2023-12-26 13:21:45,920][123091] Updated weights for policy 0, policy_version 1724164 (0.0006) [2023-12-26 13:21:45,943][123090] Updated weights for policy 1, policy_version 1712751 (0.0010) [2023-12-26 13:21:45,985][123091] Updated weights for policy 0, policy_version 1724174 (0.0007) [2023-12-26 13:21:46,008][123090] Updated weights for policy 1, policy_version 1712761 (0.0008) [2023-12-26 13:21:46,716][123091] Updated weights for policy 0, policy_version 1724184 (0.0006) [2023-12-26 13:21:46,764][123090] Updated weights for policy 1, policy_version 1712771 (0.0007) [2023-12-26 13:21:46,780][123091] Updated weights for policy 0, policy_version 1724194 (0.0005) [2023-12-26 13:21:46,821][123090] Updated weights for policy 1, policy_version 1712781 (0.0005) [2023-12-26 13:21:46,839][123091] Updated weights for policy 0, policy_version 1724204 (0.0005) [2023-12-26 13:21:46,868][123090] Updated weights for policy 1, policy_version 1712791 (0.0005) [2023-12-26 13:21:47,538][123091] Updated weights for policy 0, policy_version 1724214 (0.0008) [2023-12-26 13:21:47,575][123090] Updated weights for policy 1, policy_version 1712801 (0.0005) [2023-12-26 13:21:47,593][123091] Updated weights for policy 0, policy_version 1724225 (0.0010) [2023-12-26 13:21:47,634][123090] Updated weights for policy 1, policy_version 1712811 (0.0008) [2023-12-26 13:21:47,653][123091] Updated weights for policy 0, policy_version 1724235 (0.0008) [2023-12-26 13:21:47,683][123090] Updated weights for policy 1, policy_version 1712821 (0.0009) [2023-12-26 13:21:47,730][123090] Updated weights for policy 1, policy_version 1712831 (0.0008) [2023-12-26 13:21:48,411][123090] Updated weights for policy 1, policy_version 1712841 (0.0006) [2023-12-26 13:21:48,478][123090] Updated weights for policy 1, policy_version 1712851 (0.0011) [2023-12-26 13:21:48,545][123090] Updated weights for policy 1, policy_version 1712861 (0.0010) [2023-12-26 13:21:48,554][123091] Updated weights for policy 0, policy_version 1724245 (0.0008) [2023-12-26 13:21:48,601][123091] Updated weights for policy 0, policy_version 1724255 (0.0005) [2023-12-26 13:21:48,646][123091] Updated weights for policy 0, policy_version 1724265 (0.0009) [2023-12-26 13:21:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 879910912. Throughput: 0: 8956.0, 1: 8833.2. Samples: 879917196. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:48,785][121949] Avg episode reward: [(0, '6019.261'), (1, '5360.735')] [2023-12-26 13:21:49,349][123090] Updated weights for policy 1, policy_version 1712871 (0.0010) [2023-12-26 13:21:49,414][123091] Updated weights for policy 0, policy_version 1724275 (0.0011) [2023-12-26 13:21:49,420][123090] Updated weights for policy 1, policy_version 1712881 (0.0009) [2023-12-26 13:21:49,470][123091] Updated weights for policy 0, policy_version 1724285 (0.0011) [2023-12-26 13:21:49,481][123090] Updated weights for policy 1, policy_version 1712891 (0.0006) [2023-12-26 13:21:49,526][123091] Updated weights for policy 0, policy_version 1724295 (0.0011) [2023-12-26 13:21:50,300][123091] Updated weights for policy 0, policy_version 1724305 (0.0010) [2023-12-26 13:21:50,344][123090] Updated weights for policy 1, policy_version 1712901 (0.0008) [2023-12-26 13:21:50,357][123091] Updated weights for policy 0, policy_version 1724315 (0.0006) [2023-12-26 13:21:50,412][123091] Updated weights for policy 0, policy_version 1724325 (0.0005) [2023-12-26 13:21:50,414][123090] Updated weights for policy 1, policy_version 1712911 (0.0010) [2023-12-26 13:21:50,461][123091] Updated weights for policy 0, policy_version 1724335 (0.0005) [2023-12-26 13:21:50,471][123090] Updated weights for policy 1, policy_version 1712921 (0.0010) [2023-12-26 13:21:51,300][123091] Updated weights for policy 0, policy_version 1724345 (0.0010) [2023-12-26 13:21:51,361][123090] Updated weights for policy 1, policy_version 1712931 (0.0009) [2023-12-26 13:21:51,374][123091] Updated weights for policy 0, policy_version 1724355 (0.0009) [2023-12-26 13:21:51,424][123090] Updated weights for policy 1, policy_version 1712941 (0.0007) [2023-12-26 13:21:51,431][123091] Updated weights for policy 0, policy_version 1724365 (0.0009) [2023-12-26 13:21:51,476][123090] Updated weights for policy 1, policy_version 1712951 (0.0008) [2023-12-26 13:21:52,298][123091] Updated weights for policy 0, policy_version 1724375 (0.0010) [2023-12-26 13:21:52,348][123090] Updated weights for policy 1, policy_version 1712961 (0.0009) [2023-12-26 13:21:52,375][123091] Updated weights for policy 0, policy_version 1724385 (0.0010) [2023-12-26 13:21:52,415][123090] Updated weights for policy 1, policy_version 1712971 (0.0007) [2023-12-26 13:21:52,441][123091] Updated weights for policy 0, policy_version 1724396 (0.0009) [2023-12-26 13:21:52,487][123090] Updated weights for policy 1, policy_version 1712981 (0.0008) [2023-12-26 13:21:52,549][123090] Updated weights for policy 1, policy_version 1712991 (0.0007) [2023-12-26 13:21:53,182][123091] Updated weights for policy 0, policy_version 1724406 (0.0010) [2023-12-26 13:21:53,248][123091] Updated weights for policy 0, policy_version 1724416 (0.0010) [2023-12-26 13:21:53,283][123090] Updated weights for policy 1, policy_version 1713001 (0.0006) [2023-12-26 13:21:53,315][123091] Updated weights for policy 0, policy_version 1724426 (0.0008) [2023-12-26 13:21:53,350][123090] Updated weights for policy 1, policy_version 1713011 (0.0007) [2023-12-26 13:21:53,426][123090] Updated weights for policy 1, policy_version 1713021 (0.0006) [2023-12-26 13:21:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 879992832. Throughput: 0: 8986.7, 1: 8793.2. Samples: 879968456. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:53,785][121949] Avg episode reward: [(0, '6027.619'), (1, '5369.756')] [2023-12-26 13:21:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001724432_441458688.pth... [2023-12-26 13:21:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001713024_438534144.pth... [2023-12-26 13:21:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001723376_441188352.pth [2023-12-26 13:21:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001712000_438272000.pth [2023-12-26 13:21:54,053][123091] Updated weights for policy 0, policy_version 1724436 (0.0007) [2023-12-26 13:21:54,128][123091] Updated weights for policy 0, policy_version 1724446 (0.0007) [2023-12-26 13:21:54,197][123091] Updated weights for policy 0, policy_version 1724456 (0.0010) [2023-12-26 13:21:54,226][123090] Updated weights for policy 1, policy_version 1713031 (0.0007) [2023-12-26 13:21:54,287][123090] Updated weights for policy 1, policy_version 1713041 (0.0008) [2023-12-26 13:21:54,339][123090] Updated weights for policy 1, policy_version 1713051 (0.0009) [2023-12-26 13:21:54,974][123091] Updated weights for policy 0, policy_version 1724466 (0.0009) [2023-12-26 13:21:55,041][123091] Updated weights for policy 0, policy_version 1724476 (0.0006) [2023-12-26 13:21:55,108][123091] Updated weights for policy 0, policy_version 1724486 (0.0007) [2023-12-26 13:21:55,160][123091] Updated weights for policy 0, policy_version 1724496 (0.0010) [2023-12-26 13:21:55,191][123090] Updated weights for policy 1, policy_version 1713061 (0.0009) [2023-12-26 13:21:55,251][123090] Updated weights for policy 1, policy_version 1713071 (0.0009) [2023-12-26 13:21:55,306][123090] Updated weights for policy 1, policy_version 1713081 (0.0009) [2023-12-26 13:21:55,951][123091] Updated weights for policy 0, policy_version 1724506 (0.0010) [2023-12-26 13:21:55,994][123091] Updated weights for policy 0, policy_version 1724516 (0.0009) [2023-12-26 13:21:56,011][123090] Updated weights for policy 1, policy_version 1713091 (0.0008) [2023-12-26 13:21:56,048][123091] Updated weights for policy 0, policy_version 1724526 (0.0005) [2023-12-26 13:21:56,070][123090] Updated weights for policy 1, policy_version 1713101 (0.0006) [2023-12-26 13:21:56,131][123090] Updated weights for policy 1, policy_version 1713111 (0.0009) [2023-12-26 13:21:56,732][123091] Updated weights for policy 0, policy_version 1724536 (0.0007) [2023-12-26 13:21:56,787][123091] Updated weights for policy 0, policy_version 1724546 (0.0005) [2023-12-26 13:21:56,844][123090] Updated weights for policy 1, policy_version 1713121 (0.0010) [2023-12-26 13:21:56,848][123091] Updated weights for policy 0, policy_version 1724556 (0.0005) [2023-12-26 13:21:56,917][123090] Updated weights for policy 1, policy_version 1713131 (0.0005) [2023-12-26 13:21:56,985][123090] Updated weights for policy 1, policy_version 1713141 (0.0005) [2023-12-26 13:21:57,037][123090] Updated weights for policy 1, policy_version 1713151 (0.0005) [2023-12-26 13:21:57,487][123091] Updated weights for policy 0, policy_version 1724566 (0.0005) [2023-12-26 13:21:57,539][123091] Updated weights for policy 0, policy_version 1724576 (0.0010) [2023-12-26 13:21:57,594][123091] Updated weights for policy 0, policy_version 1724586 (0.0010) [2023-12-26 13:21:57,699][123090] Updated weights for policy 1, policy_version 1713161 (0.0010) [2023-12-26 13:21:57,757][123090] Updated weights for policy 1, policy_version 1713171 (0.0006) [2023-12-26 13:21:57,817][123090] Updated weights for policy 1, policy_version 1713181 (0.0005) [2023-12-26 13:21:58,324][123091] Updated weights for policy 0, policy_version 1724596 (0.0010) [2023-12-26 13:21:58,399][123091] Updated weights for policy 0, policy_version 1724607 (0.0007) [2023-12-26 13:21:58,480][123091] Updated weights for policy 0, policy_version 1724617 (0.0008) [2023-12-26 13:21:58,557][123090] Updated weights for policy 1, policy_version 1713191 (0.0009) [2023-12-26 13:21:58,634][123090] Updated weights for policy 1, policy_version 1713201 (0.0009) [2023-12-26 13:21:58,697][123090] Updated weights for policy 1, policy_version 1713211 (0.0009) [2023-12-26 13:21:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 880091136. Throughput: 0: 9060.2, 1: 8878.5. Samples: 880078948. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:21:58,785][121949] Avg episode reward: [(0, '6045.359'), (1, '5394.493')] [2023-12-26 13:21:59,309][123091] Updated weights for policy 0, policy_version 1724627 (0.0010) [2023-12-26 13:21:59,373][123091] Updated weights for policy 0, policy_version 1724637 (0.0008) [2023-12-26 13:21:59,435][123091] Updated weights for policy 0, policy_version 1724647 (0.0010) [2023-12-26 13:21:59,626][123090] Updated weights for policy 1, policy_version 1713221 (0.0010) [2023-12-26 13:21:59,691][123090] Updated weights for policy 1, policy_version 1713231 (0.0010) [2023-12-26 13:21:59,738][123090] Updated weights for policy 1, policy_version 1713241 (0.0010) [2023-12-26 13:22:00,276][123091] Updated weights for policy 0, policy_version 1724657 (0.0011) [2023-12-26 13:22:00,345][123091] Updated weights for policy 0, policy_version 1724667 (0.0010) [2023-12-26 13:22:00,413][123091] Updated weights for policy 0, policy_version 1724677 (0.0010) [2023-12-26 13:22:00,440][123090] Updated weights for policy 1, policy_version 1713251 (0.0009) [2023-12-26 13:22:00,483][123091] Updated weights for policy 0, policy_version 1724687 (0.0011) [2023-12-26 13:22:00,500][123090] Updated weights for policy 1, policy_version 1713261 (0.0005) [2023-12-26 13:22:00,569][123090] Updated weights for policy 1, policy_version 1713271 (0.0005) [2023-12-26 13:22:01,211][123090] Updated weights for policy 1, policy_version 1713281 (0.0006) [2023-12-26 13:22:01,244][123091] Updated weights for policy 0, policy_version 1724697 (0.0008) [2023-12-26 13:22:01,279][123090] Updated weights for policy 1, policy_version 1713291 (0.0008) [2023-12-26 13:22:01,308][123091] Updated weights for policy 0, policy_version 1724707 (0.0007) [2023-12-26 13:22:01,343][123090] Updated weights for policy 1, policy_version 1713301 (0.0008) [2023-12-26 13:22:01,373][123091] Updated weights for policy 0, policy_version 1724717 (0.0008) [2023-12-26 13:22:01,413][123090] Updated weights for policy 1, policy_version 1713311 (0.0008) [2023-12-26 13:22:02,204][123090] Updated weights for policy 1, policy_version 1713321 (0.0006) [2023-12-26 13:22:02,207][123091] Updated weights for policy 0, policy_version 1724727 (0.0008) [2023-12-26 13:22:02,264][123090] Updated weights for policy 1, policy_version 1713331 (0.0007) [2023-12-26 13:22:02,271][123091] Updated weights for policy 0, policy_version 1724737 (0.0008) [2023-12-26 13:22:02,323][123090] Updated weights for policy 1, policy_version 1713341 (0.0010) [2023-12-26 13:22:02,338][123091] Updated weights for policy 0, policy_version 1724747 (0.0007) [2023-12-26 13:22:03,107][123091] Updated weights for policy 0, policy_version 1724757 (0.0007) [2023-12-26 13:22:03,133][123090] Updated weights for policy 1, policy_version 1713351 (0.0010) [2023-12-26 13:22:03,166][123091] Updated weights for policy 0, policy_version 1724767 (0.0007) [2023-12-26 13:22:03,196][123090] Updated weights for policy 1, policy_version 1713361 (0.0010) [2023-12-26 13:22:03,231][123091] Updated weights for policy 0, policy_version 1724777 (0.0005) [2023-12-26 13:22:03,254][123090] Updated weights for policy 1, policy_version 1713371 (0.0010) [2023-12-26 13:22:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 880173056. Throughput: 0: 9026.6, 1: 8852.2. Samples: 880185728. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:22:03,785][121949] Avg episode reward: [(0, '6009.112'), (1, '5484.449')] [2023-12-26 13:22:04,058][123091] Updated weights for policy 0, policy_version 1724787 (0.0007) [2023-12-26 13:22:04,078][123090] Updated weights for policy 1, policy_version 1713381 (0.0010) [2023-12-26 13:22:04,107][123091] Updated weights for policy 0, policy_version 1724797 (0.0006) [2023-12-26 13:22:04,126][123090] Updated weights for policy 1, policy_version 1713391 (0.0010) [2023-12-26 13:22:04,159][123091] Updated weights for policy 0, policy_version 1724807 (0.0006) [2023-12-26 13:22:04,188][123090] Updated weights for policy 1, policy_version 1713401 (0.0010) [2023-12-26 13:22:05,004][123091] Updated weights for policy 0, policy_version 1724817 (0.0008) [2023-12-26 13:22:05,028][123090] Updated weights for policy 1, policy_version 1713411 (0.0010) [2023-12-26 13:22:05,060][123091] Updated weights for policy 0, policy_version 1724827 (0.0006) [2023-12-26 13:22:05,079][123090] Updated weights for policy 1, policy_version 1713421 (0.0010) [2023-12-26 13:22:05,106][123091] Updated weights for policy 0, policy_version 1724837 (0.0009) [2023-12-26 13:22:05,142][123090] Updated weights for policy 1, policy_version 1713431 (0.0010) [2023-12-26 13:22:05,166][123091] Updated weights for policy 0, policy_version 1724847 (0.0006) [2023-12-26 13:22:05,981][123090] Updated weights for policy 1, policy_version 1713441 (0.0010) [2023-12-26 13:22:06,007][123091] Updated weights for policy 0, policy_version 1724857 (0.0007) [2023-12-26 13:22:06,034][123090] Updated weights for policy 1, policy_version 1713451 (0.0010) [2023-12-26 13:22:06,067][123091] Updated weights for policy 0, policy_version 1724867 (0.0008) [2023-12-26 13:22:06,098][123090] Updated weights for policy 1, policy_version 1713461 (0.0011) [2023-12-26 13:22:06,130][123091] Updated weights for policy 0, policy_version 1724877 (0.0008) [2023-12-26 13:22:06,167][123090] Updated weights for policy 1, policy_version 1713471 (0.0011) [2023-12-26 13:22:06,972][123091] Updated weights for policy 0, policy_version 1724887 (0.0008) [2023-12-26 13:22:07,001][123090] Updated weights for policy 1, policy_version 1713481 (0.0009) [2023-12-26 13:22:07,033][123091] Updated weights for policy 0, policy_version 1724897 (0.0009) [2023-12-26 13:22:07,058][123090] Updated weights for policy 1, policy_version 1713491 (0.0007) [2023-12-26 13:22:07,090][123091] Updated weights for policy 0, policy_version 1724907 (0.0007) [2023-12-26 13:22:07,119][123090] Updated weights for policy 1, policy_version 1713501 (0.0009) [2023-12-26 13:22:07,865][123091] Updated weights for policy 0, policy_version 1724917 (0.0007) [2023-12-26 13:22:07,930][123091] Updated weights for policy 0, policy_version 1724927 (0.0010) [2023-12-26 13:22:07,995][123091] Updated weights for policy 0, policy_version 1724937 (0.0008) [2023-12-26 13:22:08,011][123090] Updated weights for policy 1, policy_version 1713511 (0.0008) [2023-12-26 13:22:08,068][123090] Updated weights for policy 1, policy_version 1713521 (0.0008) [2023-12-26 13:22:08,138][123090] Updated weights for policy 1, policy_version 1713531 (0.0009) [2023-12-26 13:22:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 880254976. Throughput: 0: 9008.6, 1: 8883.0. Samples: 880236708. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:22:08,785][121949] Avg episode reward: [(0, '6011.848'), (1, '5483.704')] [2023-12-26 13:22:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001713536_438665216.pth... [2023-12-26 13:22:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001712512_438403072.pth [2023-12-26 13:22:08,801][123091] Updated weights for policy 0, policy_version 1724947 (0.0009) [2023-12-26 13:22:08,867][123091] Updated weights for policy 0, policy_version 1724957 (0.0009) [2023-12-26 13:22:08,927][123091] Updated weights for policy 0, policy_version 1724967 (0.0008) [2023-12-26 13:22:08,979][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001724976_441597952.pth... [2023-12-26 13:22:08,983][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001723920_441327616.pth [2023-12-26 13:22:08,996][123090] Updated weights for policy 1, policy_version 1713541 (0.0009) [2023-12-26 13:22:09,071][123090] Updated weights for policy 1, policy_version 1713551 (0.0009) [2023-12-26 13:22:09,133][123090] Updated weights for policy 1, policy_version 1713561 (0.0009) [2023-12-26 13:22:09,735][123091] Updated weights for policy 0, policy_version 1724977 (0.0010) [2023-12-26 13:22:09,796][123091] Updated weights for policy 0, policy_version 1724987 (0.0010) [2023-12-26 13:22:09,867][123091] Updated weights for policy 0, policy_version 1724997 (0.0010) [2023-12-26 13:22:09,927][123091] Updated weights for policy 0, policy_version 1725007 (0.0009) [2023-12-26 13:22:09,990][123090] Updated weights for policy 1, policy_version 1713571 (0.0008) [2023-12-26 13:22:10,063][123090] Updated weights for policy 1, policy_version 1713581 (0.0006) [2023-12-26 13:22:10,130][123090] Updated weights for policy 1, policy_version 1713591 (0.0006) [2023-12-26 13:22:10,810][123090] Updated weights for policy 1, policy_version 1713601 (0.0007) [2023-12-26 13:22:10,827][123091] Updated weights for policy 0, policy_version 1725017 (0.0009) [2023-12-26 13:22:10,863][123090] Updated weights for policy 1, policy_version 1713611 (0.0009) [2023-12-26 13:22:10,897][123091] Updated weights for policy 0, policy_version 1725027 (0.0006) [2023-12-26 13:22:10,920][123090] Updated weights for policy 1, policy_version 1713621 (0.0008) [2023-12-26 13:22:10,962][123091] Updated weights for policy 0, policy_version 1725037 (0.0008) [2023-12-26 13:22:10,978][123090] Updated weights for policy 1, policy_version 1713631 (0.0007) [2023-12-26 13:22:11,848][123090] Updated weights for policy 1, policy_version 1713641 (0.0008) [2023-12-26 13:22:11,855][123091] Updated weights for policy 0, policy_version 1725047 (0.0009) [2023-12-26 13:22:11,901][123090] Updated weights for policy 1, policy_version 1713651 (0.0007) [2023-12-26 13:22:11,920][123091] Updated weights for policy 0, policy_version 1725057 (0.0010) [2023-12-26 13:22:11,967][123090] Updated weights for policy 1, policy_version 1713661 (0.0008) [2023-12-26 13:22:11,986][123091] Updated weights for policy 0, policy_version 1725067 (0.0007) [2023-12-26 13:22:12,742][123091] Updated weights for policy 0, policy_version 1725077 (0.0010) [2023-12-26 13:22:12,791][123090] Updated weights for policy 1, policy_version 1713671 (0.0006) [2023-12-26 13:22:12,809][123091] Updated weights for policy 0, policy_version 1725087 (0.0011) [2023-12-26 13:22:12,858][123090] Updated weights for policy 1, policy_version 1713681 (0.0008) [2023-12-26 13:22:12,876][123091] Updated weights for policy 0, policy_version 1725097 (0.0011) [2023-12-26 13:22:12,924][123090] Updated weights for policy 1, policy_version 1713691 (0.0007) [2023-12-26 13:22:13,680][123090] Updated weights for policy 1, policy_version 1713701 (0.0007) [2023-12-26 13:22:13,695][123091] Updated weights for policy 0, policy_version 1725107 (0.0011) [2023-12-26 13:22:13,739][123090] Updated weights for policy 1, policy_version 1713711 (0.0006) [2023-12-26 13:22:13,753][123091] Updated weights for policy 0, policy_version 1725117 (0.0011) [2023-12-26 13:22:13,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 880336896. Throughput: 0: 8828.2, 1: 8811.2. Samples: 880338892. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:22:13,784][121949] Avg episode reward: [(0, '6132.669'), (1, '5499.451')] [2023-12-26 13:22:13,795][123090] Updated weights for policy 1, policy_version 1713721 (0.0006) [2023-12-26 13:22:13,801][123091] Updated weights for policy 0, policy_version 1725127 (0.0010) [2023-12-26 13:22:14,584][123090] Updated weights for policy 1, policy_version 1713731 (0.0006) [2023-12-26 13:22:14,626][123091] Updated weights for policy 0, policy_version 1725137 (0.0010) [2023-12-26 13:22:14,637][123090] Updated weights for policy 1, policy_version 1713741 (0.0007) [2023-12-26 13:22:14,692][123090] Updated weights for policy 1, policy_version 1713751 (0.0006) [2023-12-26 13:22:14,693][123091] Updated weights for policy 0, policy_version 1725147 (0.0010) [2023-12-26 13:22:14,756][123091] Updated weights for policy 0, policy_version 1725157 (0.0011) [2023-12-26 13:22:14,825][123091] Updated weights for policy 0, policy_version 1725167 (0.0009) [2023-12-26 13:22:15,458][123090] Updated weights for policy 1, policy_version 1713761 (0.0008) [2023-12-26 13:22:15,510][123091] Updated weights for policy 0, policy_version 1725177 (0.0006) [2023-12-26 13:22:15,522][123090] Updated weights for policy 1, policy_version 1713771 (0.0011) [2023-12-26 13:22:15,573][123091] Updated weights for policy 0, policy_version 1725187 (0.0005) [2023-12-26 13:22:15,586][123090] Updated weights for policy 1, policy_version 1713781 (0.0011) [2023-12-26 13:22:15,634][123091] Updated weights for policy 0, policy_version 1725197 (0.0005) [2023-12-26 13:22:15,650][123090] Updated weights for policy 1, policy_version 1713791 (0.0010) [2023-12-26 13:22:16,386][123091] Updated weights for policy 0, policy_version 1725207 (0.0006) [2023-12-26 13:22:16,424][123090] Updated weights for policy 1, policy_version 1713801 (0.0006) [2023-12-26 13:22:16,435][123091] Updated weights for policy 0, policy_version 1725217 (0.0008) [2023-12-26 13:22:16,483][123091] Updated weights for policy 0, policy_version 1725227 (0.0009) [2023-12-26 13:22:16,503][123090] Updated weights for policy 1, policy_version 1713811 (0.0007) [2023-12-26 13:22:16,564][123090] Updated weights for policy 1, policy_version 1713821 (0.0010) [2023-12-26 13:22:17,293][123091] Updated weights for policy 0, policy_version 1725237 (0.0009) [2023-12-26 13:22:17,344][123090] Updated weights for policy 1, policy_version 1713831 (0.0010) [2023-12-26 13:22:17,346][123091] Updated weights for policy 0, policy_version 1725247 (0.0007) [2023-12-26 13:22:17,399][123091] Updated weights for policy 0, policy_version 1725257 (0.0009) [2023-12-26 13:22:17,401][123090] Updated weights for policy 1, policy_version 1713841 (0.0007) [2023-12-26 13:22:17,455][123090] Updated weights for policy 1, policy_version 1713851 (0.0010) [2023-12-26 13:22:18,194][123091] Updated weights for policy 0, policy_version 1725267 (0.0008) [2023-12-26 13:22:18,249][123091] Updated weights for policy 0, policy_version 1725277 (0.0009) [2023-12-26 13:22:18,306][123091] Updated weights for policy 0, policy_version 1725287 (0.0008) [2023-12-26 13:22:18,318][123090] Updated weights for policy 1, policy_version 1713861 (0.0011) [2023-12-26 13:22:18,384][123090] Updated weights for policy 1, policy_version 1713872 (0.0011) [2023-12-26 13:22:18,449][123090] Updated weights for policy 1, policy_version 1713882 (0.0009) [2023-12-26 13:22:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 880435200. Throughput: 0: 8799.5, 1: 8809.3. Samples: 880445516. Policy #0 lag: (min: 21.0, avg: 25.9, max: 53.0) [2023-12-26 13:22:18,785][121949] Avg episode reward: [(0, '6193.897'), (1, '5312.446')] [2023-12-26 13:22:19,080][123091] Updated weights for policy 0, policy_version 1725297 (0.0008) [2023-12-26 13:22:19,128][123091] Updated weights for policy 0, policy_version 1725307 (0.0005) [2023-12-26 13:22:19,173][123091] Updated weights for policy 0, policy_version 1725317 (0.0005) [2023-12-26 13:22:19,238][123091] Updated weights for policy 0, policy_version 1725327 (0.0006) [2023-12-26 13:22:19,283][123090] Updated weights for policy 1, policy_version 1713892 (0.0007) [2023-12-26 13:22:19,341][123090] Updated weights for policy 1, policy_version 1713902 (0.0010) [2023-12-26 13:22:19,410][123090] Updated weights for policy 1, policy_version 1713912 (0.0011) [2023-12-26 13:22:19,926][123091] Updated weights for policy 0, policy_version 1725337 (0.0006) [2023-12-26 13:22:19,992][123091] Updated weights for policy 0, policy_version 1725347 (0.0008) [2023-12-26 13:22:20,063][123091] Updated weights for policy 0, policy_version 1725357 (0.0005) [2023-12-26 13:22:20,366][123090] Updated weights for policy 1, policy_version 1713923 (0.0010) [2023-12-26 13:22:20,440][123090] Updated weights for policy 1, policy_version 1713933 (0.0010) [2023-12-26 13:22:20,499][123090] Updated weights for policy 1, policy_version 1713943 (0.0009) [2023-12-26 13:22:20,780][123091] Updated weights for policy 0, policy_version 1725367 (0.0009) [2023-12-26 13:22:20,844][123091] Updated weights for policy 0, policy_version 1725377 (0.0009) [2023-12-26 13:22:20,907][123091] Updated weights for policy 0, policy_version 1725387 (0.0008) [2023-12-26 13:22:21,353][123090] Updated weights for policy 1, policy_version 1713953 (0.0009) [2023-12-26 13:22:21,421][123090] Updated weights for policy 1, policy_version 1713963 (0.0009) [2023-12-26 13:22:21,482][123090] Updated weights for policy 1, policy_version 1713973 (0.0009) [2023-12-26 13:22:21,540][123090] Updated weights for policy 1, policy_version 1713983 (0.0009) [2023-12-26 13:22:21,757][123091] Updated weights for policy 0, policy_version 1725397 (0.0008) [2023-12-26 13:22:21,826][123091] Updated weights for policy 0, policy_version 1725407 (0.0009) [2023-12-26 13:22:21,890][123091] Updated weights for policy 0, policy_version 1725417 (0.0009) [2023-12-26 13:22:22,426][123090] Updated weights for policy 1, policy_version 1713993 (0.0009) [2023-12-26 13:22:22,494][123090] Updated weights for policy 1, policy_version 1714003 (0.0009) [2023-12-26 13:22:22,552][123090] Updated weights for policy 1, policy_version 1714013 (0.0009) [2023-12-26 13:22:22,692][123091] Updated weights for policy 0, policy_version 1725427 (0.0010) [2023-12-26 13:22:22,759][123091] Updated weights for policy 0, policy_version 1725437 (0.0011) [2023-12-26 13:22:22,826][123091] Updated weights for policy 0, policy_version 1725447 (0.0011) [2023-12-26 13:22:23,333][123090] Updated weights for policy 1, policy_version 1714023 (0.0009) [2023-12-26 13:22:23,383][123090] Updated weights for policy 1, policy_version 1714033 (0.0009) [2023-12-26 13:22:23,443][123090] Updated weights for policy 1, policy_version 1714043 (0.0010) [2023-12-26 13:22:23,556][123091] Updated weights for policy 0, policy_version 1725457 (0.0010) [2023-12-26 13:22:23,609][123091] Updated weights for policy 0, policy_version 1725467 (0.0005) [2023-12-26 13:22:23,668][123091] Updated weights for policy 0, policy_version 1725477 (0.0005) [2023-12-26 13:22:23,737][123091] Updated weights for policy 0, policy_version 1725487 (0.0006) [2023-12-26 13:22:23,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 880525312. Throughput: 0: 8859.2, 1: 8776.3. Samples: 880497348. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:23,785][121949] Avg episode reward: [(0, '6030.846'), (1, '5020.070')] [2023-12-26 13:22:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001725488_441729024.pth... [2023-12-26 13:22:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001714048_438796288.pth... [2023-12-26 13:22:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001724432_441458688.pth [2023-12-26 13:22:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001713024_438534144.pth [2023-12-26 13:22:24,410][123090] Updated weights for policy 1, policy_version 1714053 (0.0009) [2023-12-26 13:22:24,417][123091] Updated weights for policy 0, policy_version 1725497 (0.0007) [2023-12-26 13:22:24,467][123090] Updated weights for policy 1, policy_version 1714063 (0.0008) [2023-12-26 13:22:24,474][123091] Updated weights for policy 0, policy_version 1725507 (0.0007) [2023-12-26 13:22:24,516][123090] Updated weights for policy 1, policy_version 1714073 (0.0009) [2023-12-26 13:22:24,535][123091] Updated weights for policy 0, policy_version 1725517 (0.0008) [2023-12-26 13:22:25,341][123091] Updated weights for policy 0, policy_version 1725527 (0.0007) [2023-12-26 13:22:25,377][123090] Updated weights for policy 1, policy_version 1714083 (0.0008) [2023-12-26 13:22:25,394][123091] Updated weights for policy 0, policy_version 1725537 (0.0005) [2023-12-26 13:22:25,443][123090] Updated weights for policy 1, policy_version 1714093 (0.0010) [2023-12-26 13:22:25,448][123091] Updated weights for policy 0, policy_version 1725547 (0.0005) [2023-12-26 13:22:25,510][123090] Updated weights for policy 1, policy_version 1714103 (0.0010) [2023-12-26 13:22:26,045][123091] Updated weights for policy 0, policy_version 1725557 (0.0005) [2023-12-26 13:22:26,095][123091] Updated weights for policy 0, policy_version 1725567 (0.0005) [2023-12-26 13:22:26,143][123091] Updated weights for policy 0, policy_version 1725577 (0.0005) [2023-12-26 13:22:26,408][123090] Updated weights for policy 1, policy_version 1714113 (0.0009) [2023-12-26 13:22:26,463][123090] Updated weights for policy 1, policy_version 1714124 (0.0010) [2023-12-26 13:22:26,515][123090] Updated weights for policy 1, policy_version 1714134 (0.0009) [2023-12-26 13:22:26,568][123090] Updated weights for policy 1, policy_version 1714144 (0.0006) [2023-12-26 13:22:26,801][123091] Updated weights for policy 0, policy_version 1725587 (0.0007) [2023-12-26 13:22:26,855][123091] Updated weights for policy 0, policy_version 1725597 (0.0009) [2023-12-26 13:22:26,916][123091] Updated weights for policy 0, policy_version 1725607 (0.0009) [2023-12-26 13:22:27,367][123090] Updated weights for policy 1, policy_version 1714154 (0.0008) [2023-12-26 13:22:27,430][123090] Updated weights for policy 1, policy_version 1714164 (0.0009) [2023-12-26 13:22:27,496][123090] Updated weights for policy 1, policy_version 1714174 (0.0009) [2023-12-26 13:22:27,747][123091] Updated weights for policy 0, policy_version 1725617 (0.0008) [2023-12-26 13:22:27,789][123091] Updated weights for policy 0, policy_version 1725627 (0.0010) [2023-12-26 13:22:27,840][123091] Updated weights for policy 0, policy_version 1725637 (0.0010) [2023-12-26 13:22:27,894][123091] Updated weights for policy 0, policy_version 1725647 (0.0010) [2023-12-26 13:22:28,266][123090] Updated weights for policy 1, policy_version 1714184 (0.0010) [2023-12-26 13:22:28,321][123090] Updated weights for policy 1, policy_version 1714194 (0.0010) [2023-12-26 13:22:28,384][123090] Updated weights for policy 1, policy_version 1714204 (0.0010) [2023-12-26 13:22:28,743][123091] Updated weights for policy 0, policy_version 1725657 (0.0011) [2023-12-26 13:22:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 880607232. Throughput: 0: 8974.8, 1: 8764.8. Samples: 880604352. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:28,785][121949] Avg episode reward: [(0, '6055.311'), (1, '5052.946')] [2023-12-26 13:22:28,812][123091] Updated weights for policy 0, policy_version 1725667 (0.0010) [2023-12-26 13:22:28,882][123091] Updated weights for policy 0, policy_version 1725677 (0.0010) [2023-12-26 13:22:29,167][123090] Updated weights for policy 1, policy_version 1714214 (0.0007) [2023-12-26 13:22:29,236][123090] Updated weights for policy 1, policy_version 1714224 (0.0006) [2023-12-26 13:22:29,294][123090] Updated weights for policy 1, policy_version 1714234 (0.0006) [2023-12-26 13:22:29,616][123091] Updated weights for policy 0, policy_version 1725687 (0.0007) [2023-12-26 13:22:29,667][123091] Updated weights for policy 0, policy_version 1725697 (0.0009) [2023-12-26 13:22:29,721][123091] Updated weights for policy 0, policy_version 1725707 (0.0005) [2023-12-26 13:22:30,065][123090] Updated weights for policy 1, policy_version 1714244 (0.0006) [2023-12-26 13:22:30,131][123090] Updated weights for policy 1, policy_version 1714254 (0.0010) [2023-12-26 13:22:30,204][123090] Updated weights for policy 1, policy_version 1714264 (0.0010) [2023-12-26 13:22:30,411][123091] Updated weights for policy 0, policy_version 1725717 (0.0005) [2023-12-26 13:22:30,476][123091] Updated weights for policy 0, policy_version 1725727 (0.0005) [2023-12-26 13:22:30,535][123091] Updated weights for policy 0, policy_version 1725737 (0.0005) [2023-12-26 13:22:30,977][123090] Updated weights for policy 1, policy_version 1714274 (0.0011) [2023-12-26 13:22:31,037][123090] Updated weights for policy 1, policy_version 1714284 (0.0010) [2023-12-26 13:22:31,095][123090] Updated weights for policy 1, policy_version 1714294 (0.0010) [2023-12-26 13:22:31,175][123090] Updated weights for policy 1, policy_version 1714304 (0.0006) [2023-12-26 13:22:31,202][123091] Updated weights for policy 0, policy_version 1725747 (0.0006) [2023-12-26 13:22:31,267][123091] Updated weights for policy 0, policy_version 1725757 (0.0008) [2023-12-26 13:22:31,336][123091] Updated weights for policy 0, policy_version 1725767 (0.0008) [2023-12-26 13:22:31,960][123090] Updated weights for policy 1, policy_version 1714314 (0.0006) [2023-12-26 13:22:32,009][123090] Updated weights for policy 1, policy_version 1714324 (0.0005) [2023-12-26 13:22:32,065][123090] Updated weights for policy 1, policy_version 1714334 (0.0005) [2023-12-26 13:22:32,091][123091] Updated weights for policy 0, policy_version 1725777 (0.0008) [2023-12-26 13:22:32,142][123091] Updated weights for policy 0, policy_version 1725787 (0.0010) [2023-12-26 13:22:32,196][123091] Updated weights for policy 0, policy_version 1725797 (0.0010) [2023-12-26 13:22:32,247][123091] Updated weights for policy 0, policy_version 1725807 (0.0010) [2023-12-26 13:22:32,919][123090] Updated weights for policy 1, policy_version 1714344 (0.0008) [2023-12-26 13:22:32,919][123091] Updated weights for policy 0, policy_version 1725817 (0.0006) [2023-12-26 13:22:32,972][123090] Updated weights for policy 1, policy_version 1714354 (0.0009) [2023-12-26 13:22:32,985][123091] Updated weights for policy 0, policy_version 1725827 (0.0007) [2023-12-26 13:22:33,042][123091] Updated weights for policy 0, policy_version 1725837 (0.0007) [2023-12-26 13:22:33,048][123090] Updated weights for policy 1, policy_version 1714364 (0.0005) [2023-12-26 13:22:33,642][123090] Updated weights for policy 1, policy_version 1714374 (0.0005) [2023-12-26 13:22:33,719][123090] Updated weights for policy 1, policy_version 1714384 (0.0005) [2023-12-26 13:22:33,739][123091] Updated weights for policy 0, policy_version 1725847 (0.0007) [2023-12-26 13:22:33,776][123090] Updated weights for policy 1, policy_version 1714394 (0.0008) [2023-12-26 13:22:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 880697344. Throughput: 0: 9066.3, 1: 8699.4. Samples: 880716648. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:33,785][121949] Avg episode reward: [(0, '6035.988'), (1, '5538.122')] [2023-12-26 13:22:33,787][123091] Updated weights for policy 0, policy_version 1725857 (0.0008) [2023-12-26 13:22:33,843][123091] Updated weights for policy 0, policy_version 1725867 (0.0006) [2023-12-26 13:22:34,493][123091] Updated weights for policy 0, policy_version 1725877 (0.0005) [2023-12-26 13:22:34,551][123090] Updated weights for policy 1, policy_version 1714404 (0.0009) [2023-12-26 13:22:34,561][123091] Updated weights for policy 0, policy_version 1725887 (0.0008) [2023-12-26 13:22:34,615][123090] Updated weights for policy 1, policy_version 1714414 (0.0008) [2023-12-26 13:22:34,623][123091] Updated weights for policy 0, policy_version 1725898 (0.0010) [2023-12-26 13:22:34,677][123090] Updated weights for policy 1, policy_version 1714424 (0.0006) [2023-12-26 13:22:35,304][123091] Updated weights for policy 0, policy_version 1725908 (0.0010) [2023-12-26 13:22:35,351][123091] Updated weights for policy 0, policy_version 1725918 (0.0010) [2023-12-26 13:22:35,409][123091] Updated weights for policy 0, policy_version 1725928 (0.0010) [2023-12-26 13:22:35,505][123090] Updated weights for policy 1, policy_version 1714434 (0.0008) [2023-12-26 13:22:35,578][123090] Updated weights for policy 1, policy_version 1714444 (0.0005) [2023-12-26 13:22:35,634][123090] Updated weights for policy 1, policy_version 1714454 (0.0005) [2023-12-26 13:22:35,685][123090] Updated weights for policy 1, policy_version 1714464 (0.0005) [2023-12-26 13:22:36,244][123091] Updated weights for policy 0, policy_version 1725938 (0.0011) [2023-12-26 13:22:36,315][123091] Updated weights for policy 0, policy_version 1725948 (0.0011) [2023-12-26 13:22:36,382][123090] Updated weights for policy 1, policy_version 1714474 (0.0007) [2023-12-26 13:22:36,383][123091] Updated weights for policy 0, policy_version 1725958 (0.0011) [2023-12-26 13:22:36,440][123091] Updated weights for policy 0, policy_version 1725968 (0.0011) [2023-12-26 13:22:36,453][123090] Updated weights for policy 1, policy_version 1714484 (0.0009) [2023-12-26 13:22:36,525][123090] Updated weights for policy 1, policy_version 1714494 (0.0011) [2023-12-26 13:22:37,252][123091] Updated weights for policy 0, policy_version 1725978 (0.0005) [2023-12-26 13:22:37,289][123090] Updated weights for policy 1, policy_version 1714504 (0.0010) [2023-12-26 13:22:37,314][123091] Updated weights for policy 0, policy_version 1725988 (0.0011) [2023-12-26 13:22:37,346][123090] Updated weights for policy 1, policy_version 1714514 (0.0008) [2023-12-26 13:22:37,366][123091] Updated weights for policy 0, policy_version 1725998 (0.0010) [2023-12-26 13:22:37,399][123090] Updated weights for policy 1, policy_version 1714524 (0.0006) [2023-12-26 13:22:38,083][123091] Updated weights for policy 0, policy_version 1726008 (0.0008) [2023-12-26 13:22:38,147][123091] Updated weights for policy 0, policy_version 1726018 (0.0011) [2023-12-26 13:22:38,177][123090] Updated weights for policy 1, policy_version 1714534 (0.0010) [2023-12-26 13:22:38,217][123091] Updated weights for policy 0, policy_version 1726028 (0.0009) [2023-12-26 13:22:38,244][123090] Updated weights for policy 1, policy_version 1714544 (0.0010) [2023-12-26 13:22:38,315][123090] Updated weights for policy 1, policy_version 1714554 (0.0010) [2023-12-26 13:22:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 880795648. Throughput: 0: 9098.7, 1: 8753.9. Samples: 880771820. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:38,785][121949] Avg episode reward: [(0, '6056.469'), (1, '5649.604')] [2023-12-26 13:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001714560_438927360.pth... [2023-12-26 13:22:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001726032_441868288.pth... [2023-12-26 13:22:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001724976_441597952.pth [2023-12-26 13:22:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001713536_438665216.pth [2023-12-26 13:22:38,891][123091] Updated weights for policy 0, policy_version 1726038 (0.0008) [2023-12-26 13:22:38,954][123091] Updated weights for policy 0, policy_version 1726048 (0.0008) [2023-12-26 13:22:39,009][123091] Updated weights for policy 0, policy_version 1726058 (0.0010) [2023-12-26 13:22:39,182][123090] Updated weights for policy 1, policy_version 1714564 (0.0010) [2023-12-26 13:22:39,255][123090] Updated weights for policy 1, policy_version 1714574 (0.0010) [2023-12-26 13:22:39,330][123090] Updated weights for policy 1, policy_version 1714585 (0.0013) [2023-12-26 13:22:39,841][123091] Updated weights for policy 0, policy_version 1726068 (0.0010) [2023-12-26 13:22:39,908][123091] Updated weights for policy 0, policy_version 1726078 (0.0013) [2023-12-26 13:22:39,977][123091] Updated weights for policy 0, policy_version 1726088 (0.0008) [2023-12-26 13:22:40,149][123090] Updated weights for policy 1, policy_version 1714595 (0.0009) [2023-12-26 13:22:40,224][123090] Updated weights for policy 1, policy_version 1714605 (0.0005) [2023-12-26 13:22:40,301][123090] Updated weights for policy 1, policy_version 1714615 (0.0006) [2023-12-26 13:22:40,682][123091] Updated weights for policy 0, policy_version 1726098 (0.0006) [2023-12-26 13:22:40,750][123091] Updated weights for policy 0, policy_version 1726108 (0.0005) [2023-12-26 13:22:40,798][123091] Updated weights for policy 0, policy_version 1726118 (0.0006) [2023-12-26 13:22:40,855][123091] Updated weights for policy 0, policy_version 1726128 (0.0006) [2023-12-26 13:22:40,975][123090] Updated weights for policy 1, policy_version 1714625 (0.0006) [2023-12-26 13:22:41,052][123090] Updated weights for policy 1, policy_version 1714635 (0.0010) [2023-12-26 13:22:41,120][123090] Updated weights for policy 1, policy_version 1714645 (0.0011) [2023-12-26 13:22:41,188][123090] Updated weights for policy 1, policy_version 1714655 (0.0011) [2023-12-26 13:22:41,624][123091] Updated weights for policy 0, policy_version 1726138 (0.0008) [2023-12-26 13:22:41,692][123091] Updated weights for policy 0, policy_version 1726148 (0.0009) [2023-12-26 13:22:41,760][123091] Updated weights for policy 0, policy_version 1726158 (0.0008) [2023-12-26 13:22:41,997][123090] Updated weights for policy 1, policy_version 1714665 (0.0009) [2023-12-26 13:22:42,059][123090] Updated weights for policy 1, policy_version 1714675 (0.0009) [2023-12-26 13:22:42,131][123090] Updated weights for policy 1, policy_version 1714685 (0.0008) [2023-12-26 13:22:42,579][123091] Updated weights for policy 0, policy_version 1726168 (0.0010) [2023-12-26 13:22:42,636][123091] Updated weights for policy 0, policy_version 1726178 (0.0010) [2023-12-26 13:22:42,688][123091] Updated weights for policy 0, policy_version 1726188 (0.0010) [2023-12-26 13:22:42,969][123090] Updated weights for policy 1, policy_version 1714695 (0.0008) [2023-12-26 13:22:43,025][123090] Updated weights for policy 1, policy_version 1714705 (0.0008) [2023-12-26 13:22:43,073][123090] Updated weights for policy 1, policy_version 1714715 (0.0008) [2023-12-26 13:22:43,529][123091] Updated weights for policy 0, policy_version 1726198 (0.0010) [2023-12-26 13:22:43,595][123091] Updated weights for policy 0, policy_version 1726208 (0.0010) [2023-12-26 13:22:43,660][123091] Updated weights for policy 0, policy_version 1726218 (0.0009) [2023-12-26 13:22:43,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 880885760. Throughput: 0: 9094.8, 1: 8708.2. Samples: 880880088. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:43,785][121949] Avg episode reward: [(0, '5983.772'), (1, '5738.192')] [2023-12-26 13:22:43,896][123090] Updated weights for policy 1, policy_version 1714725 (0.0007) [2023-12-26 13:22:43,962][123090] Updated weights for policy 1, policy_version 1714735 (0.0006) [2023-12-26 13:22:44,021][123090] Updated weights for policy 1, policy_version 1714745 (0.0007) [2023-12-26 13:22:44,442][123091] Updated weights for policy 0, policy_version 1726228 (0.0011) [2023-12-26 13:22:44,493][123091] Updated weights for policy 0, policy_version 1726238 (0.0010) [2023-12-26 13:22:44,545][123091] Updated weights for policy 0, policy_version 1726248 (0.0010) [2023-12-26 13:22:44,709][123090] Updated weights for policy 1, policy_version 1714755 (0.0009) [2023-12-26 13:22:44,778][123090] Updated weights for policy 1, policy_version 1714765 (0.0010) [2023-12-26 13:22:44,841][123090] Updated weights for policy 1, policy_version 1714775 (0.0010) [2023-12-26 13:22:45,371][123091] Updated weights for policy 0, policy_version 1726258 (0.0009) [2023-12-26 13:22:45,431][123091] Updated weights for policy 0, policy_version 1726268 (0.0005) [2023-12-26 13:22:45,492][123091] Updated weights for policy 0, policy_version 1726278 (0.0005) [2023-12-26 13:22:45,553][123091] Updated weights for policy 0, policy_version 1726288 (0.0007) [2023-12-26 13:22:45,658][123090] Updated weights for policy 1, policy_version 1714785 (0.0010) [2023-12-26 13:22:45,733][123090] Updated weights for policy 1, policy_version 1714795 (0.0009) [2023-12-26 13:22:45,803][123090] Updated weights for policy 1, policy_version 1714805 (0.0009) [2023-12-26 13:22:45,868][123090] Updated weights for policy 1, policy_version 1714815 (0.0008) [2023-12-26 13:22:46,326][123091] Updated weights for policy 0, policy_version 1726298 (0.0011) [2023-12-26 13:22:46,378][123091] Updated weights for policy 0, policy_version 1726308 (0.0010) [2023-12-26 13:22:46,430][123091] Updated weights for policy 0, policy_version 1726318 (0.0010) [2023-12-26 13:22:46,555][123090] Updated weights for policy 1, policy_version 1714825 (0.0006) [2023-12-26 13:22:46,616][123090] Updated weights for policy 1, policy_version 1714835 (0.0007) [2023-12-26 13:22:46,678][123090] Updated weights for policy 1, policy_version 1714845 (0.0005) [2023-12-26 13:22:47,222][123091] Updated weights for policy 0, policy_version 1726328 (0.0006) [2023-12-26 13:22:47,268][123091] Updated weights for policy 0, policy_version 1726338 (0.0005) [2023-12-26 13:22:47,320][123091] Updated weights for policy 0, policy_version 1726348 (0.0005) [2023-12-26 13:22:47,385][123090] Updated weights for policy 1, policy_version 1714855 (0.0009) [2023-12-26 13:22:47,440][123090] Updated weights for policy 1, policy_version 1714865 (0.0010) [2023-12-26 13:22:47,499][123090] Updated weights for policy 1, policy_version 1714876 (0.0010) [2023-12-26 13:22:47,929][123091] Updated weights for policy 0, policy_version 1726358 (0.0005) [2023-12-26 13:22:47,976][123091] Updated weights for policy 0, policy_version 1726368 (0.0005) [2023-12-26 13:22:48,034][123091] Updated weights for policy 0, policy_version 1726378 (0.0008) [2023-12-26 13:22:48,254][123090] Updated weights for policy 1, policy_version 1714886 (0.0007) [2023-12-26 13:22:48,318][123090] Updated weights for policy 1, policy_version 1714896 (0.0006) [2023-12-26 13:22:48,375][123090] Updated weights for policy 1, policy_version 1714906 (0.0008) [2023-12-26 13:22:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 880975872. Throughput: 0: 9125.2, 1: 8737.7. Samples: 880989552. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:48,784][121949] Avg episode reward: [(0, '5974.955'), (1, '5673.545')] [2023-12-26 13:22:48,842][123091] Updated weights for policy 0, policy_version 1726388 (0.0009) [2023-12-26 13:22:48,923][123091] Updated weights for policy 0, policy_version 1726398 (0.0007) [2023-12-26 13:22:48,988][123091] Updated weights for policy 0, policy_version 1726408 (0.0009) [2023-12-26 13:22:49,072][123090] Updated weights for policy 1, policy_version 1714916 (0.0007) [2023-12-26 13:22:49,134][123090] Updated weights for policy 1, policy_version 1714926 (0.0005) [2023-12-26 13:22:49,213][123090] Updated weights for policy 1, policy_version 1714936 (0.0006) [2023-12-26 13:22:49,719][123091] Updated weights for policy 0, policy_version 1726418 (0.0009) [2023-12-26 13:22:49,766][123091] Updated weights for policy 0, policy_version 1726428 (0.0010) [2023-12-26 13:22:49,833][123091] Updated weights for policy 0, policy_version 1726438 (0.0007) [2023-12-26 13:22:49,903][123091] Updated weights for policy 0, policy_version 1726448 (0.0007) [2023-12-26 13:22:49,939][123090] Updated weights for policy 1, policy_version 1714946 (0.0008) [2023-12-26 13:22:50,006][123090] Updated weights for policy 1, policy_version 1714956 (0.0007) [2023-12-26 13:22:50,066][123090] Updated weights for policy 1, policy_version 1714966 (0.0009) [2023-12-26 13:22:50,123][123090] Updated weights for policy 1, policy_version 1714976 (0.0010) [2023-12-26 13:22:50,654][123091] Updated weights for policy 0, policy_version 1726458 (0.0011) [2023-12-26 13:22:50,712][123091] Updated weights for policy 0, policy_version 1726468 (0.0009) [2023-12-26 13:22:50,783][123091] Updated weights for policy 0, policy_version 1726478 (0.0011) [2023-12-26 13:22:50,985][123090] Updated weights for policy 1, policy_version 1714986 (0.0010) [2023-12-26 13:22:51,060][123090] Updated weights for policy 1, policy_version 1714996 (0.0010) [2023-12-26 13:22:51,132][123090] Updated weights for policy 1, policy_version 1715006 (0.0010) [2023-12-26 13:22:51,555][123091] Updated weights for policy 0, policy_version 1726488 (0.0010) [2023-12-26 13:22:51,624][123091] Updated weights for policy 0, policy_version 1726498 (0.0010) [2023-12-26 13:22:51,688][123091] Updated weights for policy 0, policy_version 1726508 (0.0010) [2023-12-26 13:22:51,978][123090] Updated weights for policy 1, policy_version 1715016 (0.0010) [2023-12-26 13:22:52,039][123090] Updated weights for policy 1, policy_version 1715026 (0.0008) [2023-12-26 13:22:52,099][123090] Updated weights for policy 1, policy_version 1715036 (0.0009) [2023-12-26 13:22:52,539][123091] Updated weights for policy 0, policy_version 1726518 (0.0010) [2023-12-26 13:22:52,606][123091] Updated weights for policy 0, policy_version 1726528 (0.0009) [2023-12-26 13:22:52,680][123091] Updated weights for policy 0, policy_version 1726538 (0.0010) [2023-12-26 13:22:52,924][123090] Updated weights for policy 1, policy_version 1715046 (0.0009) [2023-12-26 13:22:52,986][123090] Updated weights for policy 1, policy_version 1715056 (0.0009) [2023-12-26 13:22:53,053][123090] Updated weights for policy 1, policy_version 1715066 (0.0008) [2023-12-26 13:22:53,487][123091] Updated weights for policy 0, policy_version 1726548 (0.0010) [2023-12-26 13:22:53,548][123091] Updated weights for policy 0, policy_version 1726558 (0.0009) [2023-12-26 13:22:53,596][123091] Updated weights for policy 0, policy_version 1726568 (0.0009) [2023-12-26 13:22:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17886.0, 300 sec: 17744.7). Total num frames: 881065984. Throughput: 0: 9175.8, 1: 8743.9. Samples: 881043096. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:53,785][121949] Avg episode reward: [(0, '6012.346'), (1, '5412.815')] [2023-12-26 13:22:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001726576_442007552.pth... [2023-12-26 13:22:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001715072_439058432.pth... [2023-12-26 13:22:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001725488_441729024.pth [2023-12-26 13:22:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001714048_438796288.pth [2023-12-26 13:22:53,908][123090] Updated weights for policy 1, policy_version 1715076 (0.0010) [2023-12-26 13:22:53,964][123090] Updated weights for policy 1, policy_version 1715086 (0.0010) [2023-12-26 13:22:54,027][123090] Updated weights for policy 1, policy_version 1715096 (0.0010) [2023-12-26 13:22:54,451][123091] Updated weights for policy 0, policy_version 1726578 (0.0009) [2023-12-26 13:22:54,507][123091] Updated weights for policy 0, policy_version 1726588 (0.0008) [2023-12-26 13:22:54,570][123091] Updated weights for policy 0, policy_version 1726598 (0.0008) [2023-12-26 13:22:54,638][123091] Updated weights for policy 0, policy_version 1726608 (0.0009) [2023-12-26 13:22:54,875][123090] Updated weights for policy 1, policy_version 1715106 (0.0010) [2023-12-26 13:22:54,932][123090] Updated weights for policy 1, policy_version 1715116 (0.0011) [2023-12-26 13:22:55,004][123090] Updated weights for policy 1, policy_version 1715126 (0.0011) [2023-12-26 13:22:55,069][123090] Updated weights for policy 1, policy_version 1715136 (0.0011) [2023-12-26 13:22:55,453][123091] Updated weights for policy 0, policy_version 1726618 (0.0009) [2023-12-26 13:22:55,515][123091] Updated weights for policy 0, policy_version 1726628 (0.0009) [2023-12-26 13:22:55,590][123091] Updated weights for policy 0, policy_version 1726638 (0.0010) [2023-12-26 13:22:55,793][123090] Updated weights for policy 1, policy_version 1715146 (0.0009) [2023-12-26 13:22:55,842][123090] Updated weights for policy 1, policy_version 1715156 (0.0009) [2023-12-26 13:22:55,893][123090] Updated weights for policy 1, policy_version 1715166 (0.0009) [2023-12-26 13:22:56,428][123091] Updated weights for policy 0, policy_version 1726649 (0.0009) [2023-12-26 13:22:56,482][123091] Updated weights for policy 0, policy_version 1726660 (0.0010) [2023-12-26 13:22:56,541][123091] Updated weights for policy 0, policy_version 1726670 (0.0008) [2023-12-26 13:22:56,730][123090] Updated weights for policy 1, policy_version 1715176 (0.0006) [2023-12-26 13:22:56,799][123090] Updated weights for policy 1, policy_version 1715186 (0.0005) [2023-12-26 13:22:56,863][123090] Updated weights for policy 1, policy_version 1715196 (0.0005) [2023-12-26 13:22:57,231][123091] Updated weights for policy 0, policy_version 1726680 (0.0005) [2023-12-26 13:22:57,302][123091] Updated weights for policy 0, policy_version 1726690 (0.0006) [2023-12-26 13:22:57,368][123091] Updated weights for policy 0, policy_version 1726700 (0.0005) [2023-12-26 13:22:57,461][123090] Updated weights for policy 1, policy_version 1715206 (0.0008) [2023-12-26 13:22:57,515][123090] Updated weights for policy 1, policy_version 1715217 (0.0010) [2023-12-26 13:22:57,578][123090] Updated weights for policy 1, policy_version 1715228 (0.0010) [2023-12-26 13:22:58,035][123091] Updated weights for policy 0, policy_version 1726710 (0.0008) [2023-12-26 13:22:58,105][123091] Updated weights for policy 0, policy_version 1726720 (0.0009) [2023-12-26 13:22:58,163][123091] Updated weights for policy 0, policy_version 1726730 (0.0010) [2023-12-26 13:22:58,434][123090] Updated weights for policy 1, policy_version 1715238 (0.0008) [2023-12-26 13:22:58,513][123090] Updated weights for policy 1, policy_version 1715248 (0.0009) [2023-12-26 13:22:58,582][123090] Updated weights for policy 1, policy_version 1715258 (0.0008) [2023-12-26 13:22:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 881156096. Throughput: 0: 9206.9, 1: 8780.0. Samples: 881148304. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:22:58,785][121949] Avg episode reward: [(0, '6097.831'), (1, '5549.136')] [2023-12-26 13:22:59,037][123091] Updated weights for policy 0, policy_version 1726740 (0.0010) [2023-12-26 13:22:59,104][123091] Updated weights for policy 0, policy_version 1726750 (0.0009) [2023-12-26 13:22:59,174][123091] Updated weights for policy 0, policy_version 1726760 (0.0007) [2023-12-26 13:22:59,526][123090] Updated weights for policy 1, policy_version 1715268 (0.0009) [2023-12-26 13:22:59,593][123090] Updated weights for policy 1, policy_version 1715278 (0.0010) [2023-12-26 13:22:59,668][123090] Updated weights for policy 1, policy_version 1715288 (0.0010) [2023-12-26 13:22:59,880][123091] Updated weights for policy 0, policy_version 1726770 (0.0007) [2023-12-26 13:22:59,948][123091] Updated weights for policy 0, policy_version 1726780 (0.0010) [2023-12-26 13:23:00,014][123091] Updated weights for policy 0, policy_version 1726790 (0.0006) [2023-12-26 13:23:00,074][123091] Updated weights for policy 0, policy_version 1726800 (0.0010) [2023-12-26 13:23:00,506][123090] Updated weights for policy 1, policy_version 1715298 (0.0010) [2023-12-26 13:23:00,559][123090] Updated weights for policy 1, policy_version 1715308 (0.0009) [2023-12-26 13:23:00,610][123090] Updated weights for policy 1, policy_version 1715318 (0.0007) [2023-12-26 13:23:00,664][123090] Updated weights for policy 1, policy_version 1715328 (0.0010) [2023-12-26 13:23:00,890][123091] Updated weights for policy 0, policy_version 1726810 (0.0009) [2023-12-26 13:23:00,938][123091] Updated weights for policy 0, policy_version 1726820 (0.0009) [2023-12-26 13:23:00,987][123091] Updated weights for policy 0, policy_version 1726830 (0.0009) [2023-12-26 13:23:01,544][123090] Updated weights for policy 1, policy_version 1715338 (0.0009) [2023-12-26 13:23:01,603][123090] Updated weights for policy 1, policy_version 1715349 (0.0010) [2023-12-26 13:23:01,668][123090] Updated weights for policy 1, policy_version 1715359 (0.0010) [2023-12-26 13:23:01,824][123091] Updated weights for policy 0, policy_version 1726840 (0.0009) [2023-12-26 13:23:01,887][123091] Updated weights for policy 0, policy_version 1726850 (0.0009) [2023-12-26 13:23:01,955][123091] Updated weights for policy 0, policy_version 1726860 (0.0009) [2023-12-26 13:23:02,519][123090] Updated weights for policy 1, policy_version 1715369 (0.0008) [2023-12-26 13:23:02,588][123090] Updated weights for policy 1, policy_version 1715379 (0.0007) [2023-12-26 13:23:02,661][123090] Updated weights for policy 1, policy_version 1715389 (0.0006) [2023-12-26 13:23:02,681][123091] Updated weights for policy 0, policy_version 1726870 (0.0007) [2023-12-26 13:23:02,743][123091] Updated weights for policy 0, policy_version 1726880 (0.0005) [2023-12-26 13:23:02,811][123091] Updated weights for policy 0, policy_version 1726890 (0.0005) [2023-12-26 13:23:03,302][123090] Updated weights for policy 1, policy_version 1715399 (0.0005) [2023-12-26 13:23:03,376][123090] Updated weights for policy 1, policy_version 1715409 (0.0005) [2023-12-26 13:23:03,434][123090] Updated weights for policy 1, policy_version 1715419 (0.0005) [2023-12-26 13:23:03,463][123091] Updated weights for policy 0, policy_version 1726900 (0.0005) [2023-12-26 13:23:03,508][123091] Updated weights for policy 0, policy_version 1726910 (0.0005) [2023-12-26 13:23:03,560][123091] Updated weights for policy 0, policy_version 1726920 (0.0009) [2023-12-26 13:23:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 881246208. Throughput: 0: 9237.2, 1: 8761.3. Samples: 881255448. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:03,784][121949] Avg episode reward: [(0, '5999.703'), (1, '5846.667')] [2023-12-26 13:23:04,060][123090] Updated weights for policy 1, policy_version 1715429 (0.0005) [2023-12-26 13:23:04,140][123090] Updated weights for policy 1, policy_version 1715439 (0.0007) [2023-12-26 13:23:04,192][123090] Updated weights for policy 1, policy_version 1715449 (0.0006) [2023-12-26 13:23:04,442][123091] Updated weights for policy 0, policy_version 1726930 (0.0010) [2023-12-26 13:23:04,505][123091] Updated weights for policy 0, policy_version 1726940 (0.0011) [2023-12-26 13:23:04,561][123091] Updated weights for policy 0, policy_version 1726950 (0.0010) [2023-12-26 13:23:04,616][123091] Updated weights for policy 0, policy_version 1726960 (0.0010) [2023-12-26 13:23:04,920][123090] Updated weights for policy 1, policy_version 1715459 (0.0007) [2023-12-26 13:23:04,998][123090] Updated weights for policy 1, policy_version 1715469 (0.0005) [2023-12-26 13:23:05,073][123090] Updated weights for policy 1, policy_version 1715479 (0.0006) [2023-12-26 13:23:05,313][123091] Updated weights for policy 0, policy_version 1726970 (0.0005) [2023-12-26 13:23:05,365][123091] Updated weights for policy 0, policy_version 1726980 (0.0005) [2023-12-26 13:23:05,413][123091] Updated weights for policy 0, policy_version 1726990 (0.0005) [2023-12-26 13:23:05,691][123090] Updated weights for policy 1, policy_version 1715489 (0.0006) [2023-12-26 13:23:05,743][123090] Updated weights for policy 1, policy_version 1715499 (0.0005) [2023-12-26 13:23:05,791][123090] Updated weights for policy 1, policy_version 1715509 (0.0005) [2023-12-26 13:23:05,845][123090] Updated weights for policy 1, policy_version 1715519 (0.0005) [2023-12-26 13:23:06,087][123091] Updated weights for policy 0, policy_version 1727000 (0.0006) [2023-12-26 13:23:06,154][123091] Updated weights for policy 0, policy_version 1727010 (0.0007) [2023-12-26 13:23:06,208][123091] Updated weights for policy 0, policy_version 1727020 (0.0010) [2023-12-26 13:23:06,578][123090] Updated weights for policy 1, policy_version 1715529 (0.0008) [2023-12-26 13:23:06,653][123090] Updated weights for policy 1, policy_version 1715539 (0.0007) [2023-12-26 13:23:06,729][123090] Updated weights for policy 1, policy_version 1715549 (0.0006) [2023-12-26 13:23:06,997][123091] Updated weights for policy 0, policy_version 1727030 (0.0006) [2023-12-26 13:23:07,063][123091] Updated weights for policy 0, policy_version 1727040 (0.0006) [2023-12-26 13:23:07,132][123091] Updated weights for policy 0, policy_version 1727050 (0.0009) [2023-12-26 13:23:07,445][123090] Updated weights for policy 1, policy_version 1715559 (0.0010) [2023-12-26 13:23:07,510][123090] Updated weights for policy 1, policy_version 1715569 (0.0010) [2023-12-26 13:23:07,560][123090] Updated weights for policy 1, policy_version 1715579 (0.0006) [2023-12-26 13:23:07,846][123091] Updated weights for policy 0, policy_version 1727060 (0.0010) [2023-12-26 13:23:07,901][123091] Updated weights for policy 0, policy_version 1727071 (0.0010) [2023-12-26 13:23:07,951][123091] Updated weights for policy 0, policy_version 1727081 (0.0009) [2023-12-26 13:23:08,242][123090] Updated weights for policy 1, policy_version 1715589 (0.0005) [2023-12-26 13:23:08,290][123090] Updated weights for policy 1, policy_version 1715599 (0.0005) [2023-12-26 13:23:08,353][123090] Updated weights for policy 1, policy_version 1715609 (0.0007) [2023-12-26 13:23:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 881336320. Throughput: 0: 9240.9, 1: 8890.0. Samples: 881313236. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:08,784][121949] Avg episode reward: [(0, '5977.821'), (1, '5849.138')] [2023-12-26 13:23:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001727088_442138624.pth... [2023-12-26 13:23:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001715616_439197696.pth... [2023-12-26 13:23:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001714560_438927360.pth [2023-12-26 13:23:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001726032_441868288.pth [2023-12-26 13:23:08,837][123091] Updated weights for policy 0, policy_version 1727091 (0.0009) [2023-12-26 13:23:08,886][123091] Updated weights for policy 0, policy_version 1727101 (0.0009) [2023-12-26 13:23:08,939][123091] Updated weights for policy 0, policy_version 1727111 (0.0009) [2023-12-26 13:23:09,207][123090] Updated weights for policy 1, policy_version 1715619 (0.0010) [2023-12-26 13:23:09,281][123090] Updated weights for policy 1, policy_version 1715629 (0.0008) [2023-12-26 13:23:09,352][123090] Updated weights for policy 1, policy_version 1715639 (0.0008) [2023-12-26 13:23:09,824][123091] Updated weights for policy 0, policy_version 1727121 (0.0009) [2023-12-26 13:23:09,897][123091] Updated weights for policy 0, policy_version 1727131 (0.0011) [2023-12-26 13:23:09,974][123091] Updated weights for policy 0, policy_version 1727141 (0.0011) [2023-12-26 13:23:10,044][123091] Updated weights for policy 0, policy_version 1727151 (0.0011) [2023-12-26 13:23:10,121][123090] Updated weights for policy 1, policy_version 1715649 (0.0009) [2023-12-26 13:23:10,178][123090] Updated weights for policy 1, policy_version 1715659 (0.0009) [2023-12-26 13:23:10,252][123090] Updated weights for policy 1, policy_version 1715669 (0.0009) [2023-12-26 13:23:10,323][123090] Updated weights for policy 1, policy_version 1715679 (0.0009) [2023-12-26 13:23:10,852][123091] Updated weights for policy 0, policy_version 1727161 (0.0010) [2023-12-26 13:23:10,911][123091] Updated weights for policy 0, policy_version 1727171 (0.0011) [2023-12-26 13:23:10,978][123091] Updated weights for policy 0, policy_version 1727181 (0.0011) [2023-12-26 13:23:11,107][123090] Updated weights for policy 1, policy_version 1715689 (0.0009) [2023-12-26 13:23:11,189][123090] Updated weights for policy 1, policy_version 1715699 (0.0010) [2023-12-26 13:23:11,250][123090] Updated weights for policy 1, policy_version 1715709 (0.0009) [2023-12-26 13:23:11,824][123091] Updated weights for policy 0, policy_version 1727191 (0.0009) [2023-12-26 13:23:11,887][123091] Updated weights for policy 0, policy_version 1727201 (0.0009) [2023-12-26 13:23:11,956][123091] Updated weights for policy 0, policy_version 1727211 (0.0009) [2023-12-26 13:23:12,105][123090] Updated weights for policy 1, policy_version 1715719 (0.0010) [2023-12-26 13:23:12,158][123090] Updated weights for policy 1, policy_version 1715729 (0.0009) [2023-12-26 13:23:12,220][123090] Updated weights for policy 1, policy_version 1715739 (0.0008) [2023-12-26 13:23:12,823][123091] Updated weights for policy 0, policy_version 1727221 (0.0010) [2023-12-26 13:23:12,884][123091] Updated weights for policy 0, policy_version 1727231 (0.0009) [2023-12-26 13:23:12,941][123091] Updated weights for policy 0, policy_version 1727241 (0.0009) [2023-12-26 13:23:13,014][123090] Updated weights for policy 1, policy_version 1715749 (0.0010) [2023-12-26 13:23:13,085][123090] Updated weights for policy 1, policy_version 1715759 (0.0009) [2023-12-26 13:23:13,146][123090] Updated weights for policy 1, policy_version 1715769 (0.0009) [2023-12-26 13:23:13,739][123091] Updated weights for policy 0, policy_version 1727251 (0.0007) [2023-12-26 13:23:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 881418240. Throughput: 0: 9106.6, 1: 8964.8. Samples: 881417564. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:13,784][121949] Avg episode reward: [(0, '6066.896'), (1, '5674.406')] [2023-12-26 13:23:13,791][123091] Updated weights for policy 0, policy_version 1727261 (0.0008) [2023-12-26 13:23:13,847][123091] Updated weights for policy 0, policy_version 1727271 (0.0009) [2023-12-26 13:23:13,978][123090] Updated weights for policy 1, policy_version 1715779 (0.0008) [2023-12-26 13:23:14,036][123090] Updated weights for policy 1, policy_version 1715789 (0.0007) [2023-12-26 13:23:14,084][123090] Updated weights for policy 1, policy_version 1715799 (0.0009) [2023-12-26 13:23:14,607][123091] Updated weights for policy 0, policy_version 1727281 (0.0006) [2023-12-26 13:23:14,662][123091] Updated weights for policy 0, policy_version 1727291 (0.0009) [2023-12-26 13:23:14,713][123091] Updated weights for policy 0, policy_version 1727301 (0.0009) [2023-12-26 13:23:14,766][123091] Updated weights for policy 0, policy_version 1727311 (0.0009) [2023-12-26 13:23:14,921][123090] Updated weights for policy 1, policy_version 1715809 (0.0009) [2023-12-26 13:23:14,991][123090] Updated weights for policy 1, policy_version 1715819 (0.0005) [2023-12-26 13:23:15,066][123090] Updated weights for policy 1, policy_version 1715829 (0.0005) [2023-12-26 13:23:15,142][123090] Updated weights for policy 1, policy_version 1715839 (0.0006) [2023-12-26 13:23:15,550][123091] Updated weights for policy 0, policy_version 1727321 (0.0010) [2023-12-26 13:23:15,607][123091] Updated weights for policy 0, policy_version 1727331 (0.0010) [2023-12-26 13:23:15,662][123091] Updated weights for policy 0, policy_version 1727341 (0.0009) [2023-12-26 13:23:15,749][123090] Updated weights for policy 1, policy_version 1715849 (0.0009) [2023-12-26 13:23:15,794][123090] Updated weights for policy 1, policy_version 1715859 (0.0007) [2023-12-26 13:23:15,854][123090] Updated weights for policy 1, policy_version 1715869 (0.0005) [2023-12-26 13:23:16,275][123091] Updated weights for policy 0, policy_version 1727352 (0.0006) [2023-12-26 13:23:16,334][123091] Updated weights for policy 0, policy_version 1727362 (0.0005) [2023-12-26 13:23:16,385][123091] Updated weights for policy 0, policy_version 1727372 (0.0005) [2023-12-26 13:23:16,627][123090] Updated weights for policy 1, policy_version 1715879 (0.0005) [2023-12-26 13:23:16,704][123090] Updated weights for policy 1, policy_version 1715889 (0.0005) [2023-12-26 13:23:16,778][123090] Updated weights for policy 1, policy_version 1715899 (0.0006) [2023-12-26 13:23:17,193][123091] Updated weights for policy 0, policy_version 1727382 (0.0010) [2023-12-26 13:23:17,254][123091] Updated weights for policy 0, policy_version 1727392 (0.0010) [2023-12-26 13:23:17,306][123091] Updated weights for policy 0, policy_version 1727402 (0.0010) [2023-12-26 13:23:17,532][123090] Updated weights for policy 1, policy_version 1715909 (0.0008) [2023-12-26 13:23:17,593][123090] Updated weights for policy 1, policy_version 1715919 (0.0009) [2023-12-26 13:23:17,663][123090] Updated weights for policy 1, policy_version 1715929 (0.0006) [2023-12-26 13:23:18,137][123091] Updated weights for policy 0, policy_version 1727412 (0.0010) [2023-12-26 13:23:18,193][123091] Updated weights for policy 0, policy_version 1727422 (0.0009) [2023-12-26 13:23:18,257][123091] Updated weights for policy 0, policy_version 1727432 (0.0009) [2023-12-26 13:23:18,450][123090] Updated weights for policy 1, policy_version 1715939 (0.0006) [2023-12-26 13:23:18,510][123090] Updated weights for policy 1, policy_version 1715950 (0.0009) [2023-12-26 13:23:18,564][123090] Updated weights for policy 1, policy_version 1715960 (0.0009) [2023-12-26 13:23:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 881516544. Throughput: 0: 9033.4, 1: 8945.2. Samples: 881525688. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:18,785][121949] Avg episode reward: [(0, '6103.317'), (1, '5421.434')] [2023-12-26 13:23:19,090][123091] Updated weights for policy 0, policy_version 1727442 (0.0009) [2023-12-26 13:23:19,156][123091] Updated weights for policy 0, policy_version 1727452 (0.0010) [2023-12-26 13:23:19,217][123091] Updated weights for policy 0, policy_version 1727462 (0.0009) [2023-12-26 13:23:19,283][123091] Updated weights for policy 0, policy_version 1727472 (0.0010) [2023-12-26 13:23:19,417][123090] Updated weights for policy 1, policy_version 1715970 (0.0008) [2023-12-26 13:23:19,478][123090] Updated weights for policy 1, policy_version 1715980 (0.0009) [2023-12-26 13:23:19,548][123090] Updated weights for policy 1, policy_version 1715990 (0.0008) [2023-12-26 13:23:19,620][123090] Updated weights for policy 1, policy_version 1716000 (0.0007) [2023-12-26 13:23:20,157][123091] Updated weights for policy 0, policy_version 1727482 (0.0010) [2023-12-26 13:23:20,217][123091] Updated weights for policy 0, policy_version 1727492 (0.0010) [2023-12-26 13:23:20,287][123091] Updated weights for policy 0, policy_version 1727502 (0.0009) [2023-12-26 13:23:20,345][123090] Updated weights for policy 1, policy_version 1716010 (0.0009) [2023-12-26 13:23:20,419][123090] Updated weights for policy 1, policy_version 1716020 (0.0010) [2023-12-26 13:23:20,493][123090] Updated weights for policy 1, policy_version 1716030 (0.0010) [2023-12-26 13:23:21,080][123091] Updated weights for policy 0, policy_version 1727512 (0.0009) [2023-12-26 13:23:21,148][123091] Updated weights for policy 0, policy_version 1727522 (0.0009) [2023-12-26 13:23:21,225][123091] Updated weights for policy 0, policy_version 1727532 (0.0010) [2023-12-26 13:23:21,341][123090] Updated weights for policy 1, policy_version 1716040 (0.0009) [2023-12-26 13:23:21,420][123090] Updated weights for policy 1, policy_version 1716050 (0.0009) [2023-12-26 13:23:21,483][123090] Updated weights for policy 1, policy_version 1716060 (0.0006) [2023-12-26 13:23:22,048][123091] Updated weights for policy 0, policy_version 1727542 (0.0009) [2023-12-26 13:23:22,105][123091] Updated weights for policy 0, policy_version 1727552 (0.0007) [2023-12-26 13:23:22,173][123091] Updated weights for policy 0, policy_version 1727562 (0.0010) [2023-12-26 13:23:22,316][123090] Updated weights for policy 1, policy_version 1716070 (0.0008) [2023-12-26 13:23:22,384][123090] Updated weights for policy 1, policy_version 1716080 (0.0009) [2023-12-26 13:23:22,449][123090] Updated weights for policy 1, policy_version 1716090 (0.0008) [2023-12-26 13:23:23,030][123091] Updated weights for policy 0, policy_version 1727572 (0.0010) [2023-12-26 13:23:23,098][123091] Updated weights for policy 0, policy_version 1727582 (0.0009) [2023-12-26 13:23:23,165][123091] Updated weights for policy 0, policy_version 1727592 (0.0007) [2023-12-26 13:23:23,283][123090] Updated weights for policy 1, policy_version 1716100 (0.0009) [2023-12-26 13:23:23,348][123090] Updated weights for policy 1, policy_version 1716110 (0.0009) [2023-12-26 13:23:23,408][123090] Updated weights for policy 1, policy_version 1716120 (0.0009) [2023-12-26 13:23:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 881598464. Throughput: 0: 8970.3, 1: 8911.1. Samples: 881576480. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:23,785][121949] Avg episode reward: [(0, '6107.464'), (1, '5446.801')] [2023-12-26 13:23:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001727600_442269696.pth... [2023-12-26 13:23:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001716128_439328768.pth... [2023-12-26 13:23:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001726576_442007552.pth [2023-12-26 13:23:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001715072_439058432.pth [2023-12-26 13:23:23,978][123091] Updated weights for policy 0, policy_version 1727602 (0.0010) [2023-12-26 13:23:24,050][123091] Updated weights for policy 0, policy_version 1727612 (0.0011) [2023-12-26 13:23:24,109][123091] Updated weights for policy 0, policy_version 1727622 (0.0010) [2023-12-26 13:23:24,171][123091] Updated weights for policy 0, policy_version 1727632 (0.0010) [2023-12-26 13:23:24,246][123090] Updated weights for policy 1, policy_version 1716130 (0.0008) [2023-12-26 13:23:24,293][123090] Updated weights for policy 1, policy_version 1716140 (0.0008) [2023-12-26 13:23:24,353][123090] Updated weights for policy 1, policy_version 1716150 (0.0009) [2023-12-26 13:23:24,415][123090] Updated weights for policy 1, policy_version 1716160 (0.0008) [2023-12-26 13:23:25,001][123091] Updated weights for policy 0, policy_version 1727642 (0.0010) [2023-12-26 13:23:25,063][123091] Updated weights for policy 0, policy_version 1727652 (0.0010) [2023-12-26 13:23:25,132][123091] Updated weights for policy 0, policy_version 1727662 (0.0010) [2023-12-26 13:23:25,255][123090] Updated weights for policy 1, policy_version 1716170 (0.0009) [2023-12-26 13:23:25,314][123090] Updated weights for policy 1, policy_version 1716180 (0.0008) [2023-12-26 13:23:25,378][123090] Updated weights for policy 1, policy_version 1716190 (0.0009) [2023-12-26 13:23:25,887][123091] Updated weights for policy 0, policy_version 1727672 (0.0011) [2023-12-26 13:23:25,949][123091] Updated weights for policy 0, policy_version 1727682 (0.0009) [2023-12-26 13:23:26,003][123091] Updated weights for policy 0, policy_version 1727692 (0.0010) [2023-12-26 13:23:26,106][123090] Updated weights for policy 1, policy_version 1716200 (0.0009) [2023-12-26 13:23:26,160][123090] Updated weights for policy 1, policy_version 1716210 (0.0010) [2023-12-26 13:23:26,217][123090] Updated weights for policy 1, policy_version 1716220 (0.0011) [2023-12-26 13:23:26,706][123091] Updated weights for policy 0, policy_version 1727702 (0.0007) [2023-12-26 13:23:26,772][123091] Updated weights for policy 0, policy_version 1727712 (0.0005) [2023-12-26 13:23:26,832][123091] Updated weights for policy 0, policy_version 1727722 (0.0005) [2023-12-26 13:23:27,184][123090] Updated weights for policy 1, policy_version 1716230 (0.0009) [2023-12-26 13:23:27,237][123090] Updated weights for policy 1, policy_version 1716240 (0.0010) [2023-12-26 13:23:27,300][123090] Updated weights for policy 1, policy_version 1716251 (0.0010) [2023-12-26 13:23:27,474][123091] Updated weights for policy 0, policy_version 1727732 (0.0005) [2023-12-26 13:23:27,532][123091] Updated weights for policy 0, policy_version 1727742 (0.0007) [2023-12-26 13:23:27,586][123091] Updated weights for policy 0, policy_version 1727752 (0.0007) [2023-12-26 13:23:28,193][123090] Updated weights for policy 1, policy_version 1716261 (0.0009) [2023-12-26 13:23:28,229][123091] Updated weights for policy 0, policy_version 1727762 (0.0006) [2023-12-26 13:23:28,239][123090] Updated weights for policy 1, policy_version 1716271 (0.0009) [2023-12-26 13:23:28,279][123091] Updated weights for policy 0, policy_version 1727772 (0.0010) [2023-12-26 13:23:28,295][123090] Updated weights for policy 1, policy_version 1716281 (0.0006) [2023-12-26 13:23:28,327][123091] Updated weights for policy 0, policy_version 1727782 (0.0010) [2023-12-26 13:23:28,389][123091] Updated weights for policy 0, policy_version 1727792 (0.0008) [2023-12-26 13:23:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 881688576. Throughput: 0: 8940.6, 1: 8848.9. Samples: 881680612. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:28,785][121949] Avg episode reward: [(0, '6007.574'), (1, '5550.475')] [2023-12-26 13:23:29,100][123091] Updated weights for policy 0, policy_version 1727802 (0.0007) [2023-12-26 13:23:29,105][123090] Updated weights for policy 1, policy_version 1716291 (0.0007) [2023-12-26 13:23:29,157][123091] Updated weights for policy 0, policy_version 1727812 (0.0009) [2023-12-26 13:23:29,159][123090] Updated weights for policy 1, policy_version 1716301 (0.0007) [2023-12-26 13:23:29,208][123091] Updated weights for policy 0, policy_version 1727822 (0.0009) [2023-12-26 13:23:29,208][123090] Updated weights for policy 1, policy_version 1716311 (0.0007) [2023-12-26 13:23:29,912][123091] Updated weights for policy 0, policy_version 1727832 (0.0009) [2023-12-26 13:23:29,978][123091] Updated weights for policy 0, policy_version 1727842 (0.0009) [2023-12-26 13:23:30,040][123091] Updated weights for policy 0, policy_version 1727852 (0.0009) [2023-12-26 13:23:30,059][123090] Updated weights for policy 1, policy_version 1716321 (0.0010) [2023-12-26 13:23:30,126][123090] Updated weights for policy 1, policy_version 1716331 (0.0010) [2023-12-26 13:23:30,194][123090] Updated weights for policy 1, policy_version 1716341 (0.0009) [2023-12-26 13:23:30,261][123090] Updated weights for policy 1, policy_version 1716351 (0.0009) [2023-12-26 13:23:30,814][123091] Updated weights for policy 0, policy_version 1727862 (0.0006) [2023-12-26 13:23:30,857][123091] Updated weights for policy 0, policy_version 1727872 (0.0005) [2023-12-26 13:23:30,905][123091] Updated weights for policy 0, policy_version 1727882 (0.0005) [2023-12-26 13:23:31,105][123090] Updated weights for policy 1, policy_version 1716361 (0.0007) [2023-12-26 13:23:31,176][123090] Updated weights for policy 1, policy_version 1716371 (0.0009) [2023-12-26 13:23:31,244][123090] Updated weights for policy 1, policy_version 1716382 (0.0009) [2023-12-26 13:23:31,690][123091] Updated weights for policy 0, policy_version 1727892 (0.0006) [2023-12-26 13:23:31,759][123091] Updated weights for policy 0, policy_version 1727902 (0.0007) [2023-12-26 13:23:31,832][123091] Updated weights for policy 0, policy_version 1727912 (0.0005) [2023-12-26 13:23:32,038][123090] Updated weights for policy 1, policy_version 1716392 (0.0010) [2023-12-26 13:23:32,104][123090] Updated weights for policy 1, policy_version 1716402 (0.0009) [2023-12-26 13:23:32,169][123090] Updated weights for policy 1, policy_version 1716412 (0.0009) [2023-12-26 13:23:32,517][123091] Updated weights for policy 0, policy_version 1727922 (0.0006) [2023-12-26 13:23:32,568][123091] Updated weights for policy 0, policy_version 1727932 (0.0010) [2023-12-26 13:23:32,617][123091] Updated weights for policy 0, policy_version 1727942 (0.0009) [2023-12-26 13:23:32,673][123091] Updated weights for policy 0, policy_version 1727952 (0.0005) [2023-12-26 13:23:33,012][123090] Updated weights for policy 1, policy_version 1716422 (0.0010) [2023-12-26 13:23:33,066][123090] Updated weights for policy 1, policy_version 1716432 (0.0010) [2023-12-26 13:23:33,118][123090] Updated weights for policy 1, policy_version 1716442 (0.0010) [2023-12-26 13:23:33,407][123091] Updated weights for policy 0, policy_version 1727962 (0.0005) [2023-12-26 13:23:33,473][123091] Updated weights for policy 0, policy_version 1727972 (0.0005) [2023-12-26 13:23:33,535][123091] Updated weights for policy 0, policy_version 1727982 (0.0006) [2023-12-26 13:23:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 881778688. Throughput: 0: 9019.1, 1: 8758.3. Samples: 881789536. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:33,785][121949] Avg episode reward: [(0, '6087.708'), (1, '5378.654')] [2023-12-26 13:23:34,040][123090] Updated weights for policy 1, policy_version 1716452 (0.0010) [2023-12-26 13:23:34,106][123090] Updated weights for policy 1, policy_version 1716462 (0.0009) [2023-12-26 13:23:34,172][123090] Updated weights for policy 1, policy_version 1716472 (0.0010) [2023-12-26 13:23:34,189][123091] Updated weights for policy 0, policy_version 1727992 (0.0007) [2023-12-26 13:23:34,254][123091] Updated weights for policy 0, policy_version 1728002 (0.0007) [2023-12-26 13:23:34,305][123091] Updated weights for policy 0, policy_version 1728012 (0.0006) [2023-12-26 13:23:35,026][123091] Updated weights for policy 0, policy_version 1728022 (0.0009) [2023-12-26 13:23:35,077][123091] Updated weights for policy 0, policy_version 1728032 (0.0010) [2023-12-26 13:23:35,092][123090] Updated weights for policy 1, policy_version 1716482 (0.0008) [2023-12-26 13:23:35,129][123091] Updated weights for policy 0, policy_version 1728042 (0.0011) [2023-12-26 13:23:35,161][123090] Updated weights for policy 1, policy_version 1716492 (0.0007) [2023-12-26 13:23:35,231][123090] Updated weights for policy 1, policy_version 1716502 (0.0010) [2023-12-26 13:23:35,289][123090] Updated weights for policy 1, policy_version 1716512 (0.0010) [2023-12-26 13:23:35,837][123091] Updated weights for policy 0, policy_version 1728052 (0.0008) [2023-12-26 13:23:35,889][123091] Updated weights for policy 0, policy_version 1728062 (0.0010) [2023-12-26 13:23:35,947][123091] Updated weights for policy 0, policy_version 1728072 (0.0011) [2023-12-26 13:23:36,151][123090] Updated weights for policy 1, policy_version 1716522 (0.0007) [2023-12-26 13:23:36,223][123090] Updated weights for policy 1, policy_version 1716532 (0.0007) [2023-12-26 13:23:36,293][123090] Updated weights for policy 1, policy_version 1716542 (0.0009) [2023-12-26 13:23:36,782][123091] Updated weights for policy 0, policy_version 1728082 (0.0010) [2023-12-26 13:23:36,844][123091] Updated weights for policy 0, policy_version 1728092 (0.0009) [2023-12-26 13:23:36,900][123091] Updated weights for policy 0, policy_version 1728102 (0.0009) [2023-12-26 13:23:36,966][123091] Updated weights for policy 0, policy_version 1728112 (0.0009) [2023-12-26 13:23:37,049][123090] Updated weights for policy 1, policy_version 1716552 (0.0009) [2023-12-26 13:23:37,110][123090] Updated weights for policy 1, policy_version 1716562 (0.0010) [2023-12-26 13:23:37,175][123090] Updated weights for policy 1, policy_version 1716573 (0.0009) [2023-12-26 13:23:37,685][123091] Updated weights for policy 0, policy_version 1728122 (0.0005) [2023-12-26 13:23:37,747][123091] Updated weights for policy 0, policy_version 1728133 (0.0008) [2023-12-26 13:23:37,810][123091] Updated weights for policy 0, policy_version 1728143 (0.0009) [2023-12-26 13:23:38,077][123090] Updated weights for policy 1, policy_version 1716583 (0.0010) [2023-12-26 13:23:38,146][123090] Updated weights for policy 1, policy_version 1716593 (0.0010) [2023-12-26 13:23:38,212][123090] Updated weights for policy 1, policy_version 1716603 (0.0009) [2023-12-26 13:23:38,645][123091] Updated weights for policy 0, policy_version 1728153 (0.0010) [2023-12-26 13:23:38,703][123091] Updated weights for policy 0, policy_version 1728163 (0.0010) [2023-12-26 13:23:38,749][123091] Updated weights for policy 0, policy_version 1728173 (0.0007) [2023-12-26 13:23:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 881868800. Throughput: 0: 9050.1, 1: 8725.8. Samples: 881843008. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:38,784][121949] Avg episode reward: [(0, '6121.003'), (1, '5496.549')] [2023-12-26 13:23:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001716608_439451648.pth... [2023-12-26 13:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001728176_442417152.pth... [2023-12-26 13:23:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001727088_442138624.pth [2023-12-26 13:23:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001715616_439197696.pth [2023-12-26 13:23:39,014][123090] Updated weights for policy 1, policy_version 1716613 (0.0009) [2023-12-26 13:23:39,068][123090] Updated weights for policy 1, policy_version 1716624 (0.0010) [2023-12-26 13:23:39,120][123090] Updated weights for policy 1, policy_version 1716634 (0.0009) [2023-12-26 13:23:39,519][123091] Updated weights for policy 0, policy_version 1728183 (0.0008) [2023-12-26 13:23:39,577][123091] Updated weights for policy 0, policy_version 1728193 (0.0010) [2023-12-26 13:23:39,629][123091] Updated weights for policy 0, policy_version 1728203 (0.0009) [2023-12-26 13:23:40,066][123090] Updated weights for policy 1, policy_version 1716645 (0.0010) [2023-12-26 13:23:40,133][123090] Updated weights for policy 1, policy_version 1716655 (0.0010) [2023-12-26 13:23:40,200][123090] Updated weights for policy 1, policy_version 1716665 (0.0010) [2023-12-26 13:23:40,443][123091] Updated weights for policy 0, policy_version 1728213 (0.0010) [2023-12-26 13:23:40,511][123091] Updated weights for policy 0, policy_version 1728223 (0.0007) [2023-12-26 13:23:40,583][123091] Updated weights for policy 0, policy_version 1728233 (0.0008) [2023-12-26 13:23:41,087][123090] Updated weights for policy 1, policy_version 1716675 (0.0009) [2023-12-26 13:23:41,157][123090] Updated weights for policy 1, policy_version 1716685 (0.0009) [2023-12-26 13:23:41,217][123090] Updated weights for policy 1, policy_version 1716695 (0.0010) [2023-12-26 13:23:41,313][123091] Updated weights for policy 0, policy_version 1728243 (0.0009) [2023-12-26 13:23:41,377][123091] Updated weights for policy 0, policy_version 1728253 (0.0010) [2023-12-26 13:23:41,452][123091] Updated weights for policy 0, policy_version 1728263 (0.0011) [2023-12-26 13:23:42,094][123090] Updated weights for policy 1, policy_version 1716705 (0.0009) [2023-12-26 13:23:42,158][123090] Updated weights for policy 1, policy_version 1716715 (0.0009) [2023-12-26 13:23:42,226][123090] Updated weights for policy 1, policy_version 1716725 (0.0009) [2023-12-26 13:23:42,297][123090] Updated weights for policy 1, policy_version 1716735 (0.0009) [2023-12-26 13:23:42,314][123091] Updated weights for policy 0, policy_version 1728273 (0.0010) [2023-12-26 13:23:42,385][123091] Updated weights for policy 0, policy_version 1728283 (0.0009) [2023-12-26 13:23:42,436][123091] Updated weights for policy 0, policy_version 1728293 (0.0010) [2023-12-26 13:23:42,496][123091] Updated weights for policy 0, policy_version 1728303 (0.0010) [2023-12-26 13:23:43,073][123090] Updated weights for policy 1, policy_version 1716745 (0.0005) [2023-12-26 13:23:43,122][123090] Updated weights for policy 1, policy_version 1716755 (0.0005) [2023-12-26 13:23:43,174][123090] Updated weights for policy 1, policy_version 1716765 (0.0005) [2023-12-26 13:23:43,272][123091] Updated weights for policy 0, policy_version 1728313 (0.0010) [2023-12-26 13:23:43,327][123091] Updated weights for policy 0, policy_version 1728323 (0.0010) [2023-12-26 13:23:43,384][123091] Updated weights for policy 0, policy_version 1728333 (0.0009) [2023-12-26 13:23:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 881950720. Throughput: 0: 9072.3, 1: 8630.0. Samples: 881944912. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:43,785][121949] Avg episode reward: [(0, '6121.806'), (1, '5467.757')] [2023-12-26 13:23:43,869][123090] Updated weights for policy 1, policy_version 1716775 (0.0006) [2023-12-26 13:23:43,934][123090] Updated weights for policy 1, policy_version 1716785 (0.0005) [2023-12-26 13:23:44,001][123090] Updated weights for policy 1, policy_version 1716795 (0.0006) [2023-12-26 13:23:44,277][123091] Updated weights for policy 0, policy_version 1728343 (0.0010) [2023-12-26 13:23:44,333][123091] Updated weights for policy 0, policy_version 1728353 (0.0009) [2023-12-26 13:23:44,383][123091] Updated weights for policy 0, policy_version 1728363 (0.0009) [2023-12-26 13:23:44,578][123090] Updated weights for policy 1, policy_version 1716805 (0.0008) [2023-12-26 13:23:44,632][123090] Updated weights for policy 1, policy_version 1716815 (0.0010) [2023-12-26 13:23:44,702][123090] Updated weights for policy 1, policy_version 1716825 (0.0006) [2023-12-26 13:23:45,198][123091] Updated weights for policy 0, policy_version 1728373 (0.0010) [2023-12-26 13:23:45,263][123091] Updated weights for policy 0, policy_version 1728383 (0.0011) [2023-12-26 13:23:45,332][123091] Updated weights for policy 0, policy_version 1728393 (0.0011) [2023-12-26 13:23:45,508][123090] Updated weights for policy 1, policy_version 1716835 (0.0006) [2023-12-26 13:23:45,576][123090] Updated weights for policy 1, policy_version 1716845 (0.0009) [2023-12-26 13:23:45,636][123090] Updated weights for policy 1, policy_version 1716855 (0.0009) [2023-12-26 13:23:46,148][123091] Updated weights for policy 0, policy_version 1728403 (0.0011) [2023-12-26 13:23:46,210][123091] Updated weights for policy 0, policy_version 1728413 (0.0010) [2023-12-26 13:23:46,273][123091] Updated weights for policy 0, policy_version 1728423 (0.0010) [2023-12-26 13:23:46,461][123090] Updated weights for policy 1, policy_version 1716865 (0.0009) [2023-12-26 13:23:46,516][123090] Updated weights for policy 1, policy_version 1716875 (0.0005) [2023-12-26 13:23:46,581][123090] Updated weights for policy 1, policy_version 1716885 (0.0005) [2023-12-26 13:23:46,656][123090] Updated weights for policy 1, policy_version 1716895 (0.0005) [2023-12-26 13:23:47,094][123091] Updated weights for policy 0, policy_version 1728433 (0.0010) [2023-12-26 13:23:47,152][123091] Updated weights for policy 0, policy_version 1728443 (0.0010) [2023-12-26 13:23:47,199][123091] Updated weights for policy 0, policy_version 1728453 (0.0010) [2023-12-26 13:23:47,250][123091] Updated weights for policy 0, policy_version 1728463 (0.0010) [2023-12-26 13:23:47,381][123090] Updated weights for policy 1, policy_version 1716905 (0.0010) [2023-12-26 13:23:47,432][123090] Updated weights for policy 1, policy_version 1716915 (0.0010) [2023-12-26 13:23:47,484][123090] Updated weights for policy 1, policy_version 1716925 (0.0010) [2023-12-26 13:23:47,976][123091] Updated weights for policy 0, policy_version 1728473 (0.0005) [2023-12-26 13:23:48,033][123091] Updated weights for policy 0, policy_version 1728483 (0.0006) [2023-12-26 13:23:48,082][123091] Updated weights for policy 0, policy_version 1728493 (0.0006) [2023-12-26 13:23:48,328][123090] Updated weights for policy 1, policy_version 1716935 (0.0010) [2023-12-26 13:23:48,384][123090] Updated weights for policy 1, policy_version 1716945 (0.0010) [2023-12-26 13:23:48,440][123090] Updated weights for policy 1, policy_version 1716955 (0.0010) [2023-12-26 13:23:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 882040832. Throughput: 0: 9045.2, 1: 8693.8. Samples: 882053704. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:48,785][121949] Avg episode reward: [(0, '6203.766'), (1, '5340.629')] [2023-12-26 13:23:48,793][123091] Updated weights for policy 0, policy_version 1728503 (0.0007) [2023-12-26 13:23:48,850][123091] Updated weights for policy 0, policy_version 1728513 (0.0006) [2023-12-26 13:23:48,922][123091] Updated weights for policy 0, policy_version 1728523 (0.0006) [2023-12-26 13:23:49,206][123090] Updated weights for policy 1, policy_version 1716965 (0.0008) [2023-12-26 13:23:49,282][123090] Updated weights for policy 1, policy_version 1716975 (0.0009) [2023-12-26 13:23:49,349][123090] Updated weights for policy 1, policy_version 1716985 (0.0009) [2023-12-26 13:23:49,704][123091] Updated weights for policy 0, policy_version 1728533 (0.0008) [2023-12-26 13:23:49,760][123091] Updated weights for policy 0, policy_version 1728543 (0.0008) [2023-12-26 13:23:49,826][123091] Updated weights for policy 0, policy_version 1728553 (0.0009) [2023-12-26 13:23:50,151][123090] Updated weights for policy 1, policy_version 1716995 (0.0010) [2023-12-26 13:23:50,214][123090] Updated weights for policy 1, policy_version 1717005 (0.0009) [2023-12-26 13:23:50,278][123090] Updated weights for policy 1, policy_version 1717015 (0.0010) [2023-12-26 13:23:50,682][123091] Updated weights for policy 0, policy_version 1728563 (0.0009) [2023-12-26 13:23:50,732][123091] Updated weights for policy 0, policy_version 1728573 (0.0010) [2023-12-26 13:23:50,782][123091] Updated weights for policy 0, policy_version 1728583 (0.0009) [2023-12-26 13:23:51,151][123090] Updated weights for policy 1, policy_version 1717025 (0.0009) [2023-12-26 13:23:51,209][123090] Updated weights for policy 1, policy_version 1717035 (0.0009) [2023-12-26 13:23:51,271][123090] Updated weights for policy 1, policy_version 1717045 (0.0008) [2023-12-26 13:23:51,336][123090] Updated weights for policy 1, policy_version 1717055 (0.0009) [2023-12-26 13:23:51,685][123091] Updated weights for policy 0, policy_version 1728593 (0.0010) [2023-12-26 13:23:51,757][123091] Updated weights for policy 0, policy_version 1728603 (0.0009) [2023-12-26 13:23:51,817][123091] Updated weights for policy 0, policy_version 1728613 (0.0008) [2023-12-26 13:23:51,884][123091] Updated weights for policy 0, policy_version 1728623 (0.0008) [2023-12-26 13:23:52,221][123090] Updated weights for policy 1, policy_version 1717065 (0.0009) [2023-12-26 13:23:52,294][123090] Updated weights for policy 1, policy_version 1717075 (0.0008) [2023-12-26 13:23:52,356][123090] Updated weights for policy 1, policy_version 1717085 (0.0009) [2023-12-26 13:23:52,702][123091] Updated weights for policy 0, policy_version 1728633 (0.0010) [2023-12-26 13:23:52,750][123091] Updated weights for policy 0, policy_version 1728643 (0.0010) [2023-12-26 13:23:52,802][123091] Updated weights for policy 0, policy_version 1728653 (0.0010) [2023-12-26 13:23:53,184][123090] Updated weights for policy 1, policy_version 1717095 (0.0009) [2023-12-26 13:23:53,237][123090] Updated weights for policy 1, policy_version 1717105 (0.0009) [2023-12-26 13:23:53,302][123090] Updated weights for policy 1, policy_version 1717115 (0.0009) [2023-12-26 13:23:53,651][123091] Updated weights for policy 0, policy_version 1728663 (0.0011) [2023-12-26 13:23:53,713][123091] Updated weights for policy 0, policy_version 1728673 (0.0010) [2023-12-26 13:23:53,760][123091] Updated weights for policy 0, policy_version 1728683 (0.0010) [2023-12-26 13:23:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 882122752. Throughput: 0: 8983.5, 1: 8607.2. Samples: 882104816. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:53,784][121949] Avg episode reward: [(0, '6177.313'), (1, '5523.288')] [2023-12-26 13:23:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001728688_442548224.pth... [2023-12-26 13:23:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001717120_439582720.pth... [2023-12-26 13:23:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001727600_442269696.pth [2023-12-26 13:23:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001716128_439328768.pth [2023-12-26 13:23:54,079][123090] Updated weights for policy 1, policy_version 1717125 (0.0007) [2023-12-26 13:23:54,129][123090] Updated weights for policy 1, policy_version 1717135 (0.0005) [2023-12-26 13:23:54,177][123090] Updated weights for policy 1, policy_version 1717145 (0.0005) [2023-12-26 13:23:54,539][123091] Updated weights for policy 0, policy_version 1728693 (0.0008) [2023-12-26 13:23:54,613][123091] Updated weights for policy 0, policy_version 1728703 (0.0005) [2023-12-26 13:23:54,683][123091] Updated weights for policy 0, policy_version 1728713 (0.0005) [2023-12-26 13:23:54,982][123090] Updated weights for policy 1, policy_version 1717155 (0.0005) [2023-12-26 13:23:55,050][123090] Updated weights for policy 1, policy_version 1717165 (0.0006) [2023-12-26 13:23:55,101][123090] Updated weights for policy 1, policy_version 1717175 (0.0006) [2023-12-26 13:23:55,295][123091] Updated weights for policy 0, policy_version 1728723 (0.0005) [2023-12-26 13:23:55,346][123091] Updated weights for policy 0, policy_version 1728733 (0.0005) [2023-12-26 13:23:55,402][123091] Updated weights for policy 0, policy_version 1728743 (0.0005) [2023-12-26 13:23:55,772][123090] Updated weights for policy 1, policy_version 1717185 (0.0006) [2023-12-26 13:23:55,836][123090] Updated weights for policy 1, policy_version 1717195 (0.0008) [2023-12-26 13:23:55,898][123090] Updated weights for policy 1, policy_version 1717205 (0.0009) [2023-12-26 13:23:55,959][123090] Updated weights for policy 1, policy_version 1717215 (0.0009) [2023-12-26 13:23:56,127][123091] Updated weights for policy 0, policy_version 1728753 (0.0006) [2023-12-26 13:23:56,173][123091] Updated weights for policy 0, policy_version 1728763 (0.0010) [2023-12-26 13:23:56,220][123091] Updated weights for policy 0, policy_version 1728773 (0.0010) [2023-12-26 13:23:56,274][123091] Updated weights for policy 0, policy_version 1728783 (0.0010) [2023-12-26 13:23:56,827][123090] Updated weights for policy 1, policy_version 1717225 (0.0010) [2023-12-26 13:23:56,894][123090] Updated weights for policy 1, policy_version 1717235 (0.0007) [2023-12-26 13:23:56,962][123090] Updated weights for policy 1, policy_version 1717245 (0.0009) [2023-12-26 13:23:56,982][123091] Updated weights for policy 0, policy_version 1728793 (0.0008) [2023-12-26 13:23:57,034][123091] Updated weights for policy 0, policy_version 1728803 (0.0009) [2023-12-26 13:23:57,093][123091] Updated weights for policy 0, policy_version 1728813 (0.0009) [2023-12-26 13:23:57,616][123090] Updated weights for policy 1, policy_version 1717255 (0.0006) [2023-12-26 13:23:57,660][123090] Updated weights for policy 1, policy_version 1717265 (0.0005) [2023-12-26 13:23:57,706][123090] Updated weights for policy 1, policy_version 1717275 (0.0005) [2023-12-26 13:23:57,837][123091] Updated weights for policy 0, policy_version 1728823 (0.0008) [2023-12-26 13:23:57,882][123091] Updated weights for policy 0, policy_version 1728833 (0.0005) [2023-12-26 13:23:57,931][123091] Updated weights for policy 0, policy_version 1728843 (0.0005) [2023-12-26 13:23:58,436][123090] Updated weights for policy 1, policy_version 1717285 (0.0007) [2023-12-26 13:23:58,521][123090] Updated weights for policy 1, policy_version 1717296 (0.0009) [2023-12-26 13:23:58,597][123090] Updated weights for policy 1, policy_version 1717306 (0.0009) [2023-12-26 13:23:58,697][123091] Updated weights for policy 0, policy_version 1728853 (0.0007) [2023-12-26 13:23:58,770][123091] Updated weights for policy 0, policy_version 1728863 (0.0009) [2023-12-26 13:23:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 882221056. Throughput: 0: 9071.8, 1: 8630.6. Samples: 882214172. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:23:58,785][121949] Avg episode reward: [(0, '6199.161'), (1, '5550.943')] [2023-12-26 13:23:58,841][123091] Updated weights for policy 0, policy_version 1728873 (0.0009) [2023-12-26 13:23:59,412][123090] Updated weights for policy 1, policy_version 1717316 (0.0011) [2023-12-26 13:23:59,479][123090] Updated weights for policy 1, policy_version 1717326 (0.0010) [2023-12-26 13:23:59,551][123090] Updated weights for policy 1, policy_version 1717336 (0.0009) [2023-12-26 13:23:59,608][123091] Updated weights for policy 0, policy_version 1728883 (0.0009) [2023-12-26 13:23:59,671][123091] Updated weights for policy 0, policy_version 1728893 (0.0010) [2023-12-26 13:23:59,731][123091] Updated weights for policy 0, policy_version 1728903 (0.0010) [2023-12-26 13:24:00,301][123090] Updated weights for policy 1, policy_version 1717346 (0.0006) [2023-12-26 13:24:00,375][123090] Updated weights for policy 1, policy_version 1717356 (0.0006) [2023-12-26 13:24:00,446][123090] Updated weights for policy 1, policy_version 1717366 (0.0007) [2023-12-26 13:24:00,513][123090] Updated weights for policy 1, policy_version 1717376 (0.0007) [2023-12-26 13:24:00,573][123091] Updated weights for policy 0, policy_version 1728913 (0.0009) [2023-12-26 13:24:00,639][123091] Updated weights for policy 0, policy_version 1728923 (0.0010) [2023-12-26 13:24:00,697][123091] Updated weights for policy 0, policy_version 1728933 (0.0009) [2023-12-26 13:24:00,746][123091] Updated weights for policy 0, policy_version 1728943 (0.0009) [2023-12-26 13:24:01,263][123090] Updated weights for policy 1, policy_version 1717386 (0.0010) [2023-12-26 13:24:01,328][123090] Updated weights for policy 1, policy_version 1717396 (0.0009) [2023-12-26 13:24:01,400][123090] Updated weights for policy 1, policy_version 1717406 (0.0009) [2023-12-26 13:24:01,480][123091] Updated weights for policy 0, policy_version 1728953 (0.0006) [2023-12-26 13:24:01,545][123091] Updated weights for policy 0, policy_version 1728963 (0.0006) [2023-12-26 13:24:01,621][123091] Updated weights for policy 0, policy_version 1728973 (0.0006) [2023-12-26 13:24:02,231][123090] Updated weights for policy 1, policy_version 1717416 (0.0006) [2023-12-26 13:24:02,300][123090] Updated weights for policy 1, policy_version 1717426 (0.0008) [2023-12-26 13:24:02,368][123090] Updated weights for policy 1, policy_version 1717436 (0.0010) [2023-12-26 13:24:02,384][123091] Updated weights for policy 0, policy_version 1728983 (0.0007) [2023-12-26 13:24:02,454][123091] Updated weights for policy 0, policy_version 1728993 (0.0005) [2023-12-26 13:24:02,527][123091] Updated weights for policy 0, policy_version 1729003 (0.0006) [2023-12-26 13:24:03,148][123091] Updated weights for policy 0, policy_version 1729013 (0.0009) [2023-12-26 13:24:03,209][123091] Updated weights for policy 0, policy_version 1729023 (0.0009) [2023-12-26 13:24:03,224][123090] Updated weights for policy 1, policy_version 1717446 (0.0008) [2023-12-26 13:24:03,269][123090] Updated weights for policy 1, policy_version 1717456 (0.0008) [2023-12-26 13:24:03,300][123091] Updated weights for policy 0, policy_version 1729033 (0.0010) [2023-12-26 13:24:03,321][123090] Updated weights for policy 1, policy_version 1717466 (0.0007) [2023-12-26 13:24:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 882311168. Throughput: 0: 9094.0, 1: 8607.7. Samples: 882322268. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:24:03,785][121949] Avg episode reward: [(0, '6116.595'), (1, '5115.948')] [2023-12-26 13:24:04,021][123091] Updated weights for policy 0, policy_version 1729043 (0.0009) [2023-12-26 13:24:04,080][123091] Updated weights for policy 0, policy_version 1729053 (0.0009) [2023-12-26 13:24:04,150][123091] Updated weights for policy 0, policy_version 1729063 (0.0009) [2023-12-26 13:24:04,207][123090] Updated weights for policy 1, policy_version 1717476 (0.0007) [2023-12-26 13:24:04,264][123090] Updated weights for policy 1, policy_version 1717486 (0.0009) [2023-12-26 13:24:04,324][123090] Updated weights for policy 1, policy_version 1717496 (0.0008) [2023-12-26 13:24:04,971][123091] Updated weights for policy 0, policy_version 1729073 (0.0009) [2023-12-26 13:24:05,030][123091] Updated weights for policy 0, policy_version 1729083 (0.0005) [2023-12-26 13:24:05,078][123091] Updated weights for policy 0, policy_version 1729093 (0.0005) [2023-12-26 13:24:05,147][123091] Updated weights for policy 0, policy_version 1729103 (0.0005) [2023-12-26 13:24:05,186][123090] Updated weights for policy 1, policy_version 1717507 (0.0010) [2023-12-26 13:24:05,248][123090] Updated weights for policy 1, policy_version 1717517 (0.0010) [2023-12-26 13:24:05,310][123090] Updated weights for policy 1, policy_version 1717527 (0.0010) [2023-12-26 13:24:05,842][123091] Updated weights for policy 0, policy_version 1729113 (0.0005) [2023-12-26 13:24:05,893][123091] Updated weights for policy 0, policy_version 1729123 (0.0006) [2023-12-26 13:24:05,963][123091] Updated weights for policy 0, policy_version 1729133 (0.0011) [2023-12-26 13:24:06,201][123090] Updated weights for policy 1, policy_version 1717537 (0.0010) [2023-12-26 13:24:06,270][123090] Updated weights for policy 1, policy_version 1717547 (0.0009) [2023-12-26 13:24:06,342][123090] Updated weights for policy 1, policy_version 1717557 (0.0008) [2023-12-26 13:24:06,418][123090] Updated weights for policy 1, policy_version 1717567 (0.0009) [2023-12-26 13:24:06,801][123091] Updated weights for policy 0, policy_version 1729143 (0.0011) [2023-12-26 13:24:06,861][123091] Updated weights for policy 0, policy_version 1729153 (0.0011) [2023-12-26 13:24:06,916][123091] Updated weights for policy 0, policy_version 1729163 (0.0011) [2023-12-26 13:24:07,205][123090] Updated weights for policy 1, policy_version 1717577 (0.0008) [2023-12-26 13:24:07,257][123090] Updated weights for policy 1, policy_version 1717587 (0.0008) [2023-12-26 13:24:07,312][123090] Updated weights for policy 1, policy_version 1717597 (0.0008) [2023-12-26 13:24:07,756][123091] Updated weights for policy 0, policy_version 1729173 (0.0009) [2023-12-26 13:24:07,820][123091] Updated weights for policy 0, policy_version 1729183 (0.0009) [2023-12-26 13:24:07,877][123091] Updated weights for policy 0, policy_version 1729193 (0.0008) [2023-12-26 13:24:08,193][123090] Updated weights for policy 1, policy_version 1717607 (0.0010) [2023-12-26 13:24:08,247][123090] Updated weights for policy 1, policy_version 1717617 (0.0010) [2023-12-26 13:24:08,324][123090] Updated weights for policy 1, policy_version 1717627 (0.0009) [2023-12-26 13:24:08,653][123091] Updated weights for policy 0, policy_version 1729203 (0.0006) [2023-12-26 13:24:08,726][123091] Updated weights for policy 0, policy_version 1729213 (0.0007) [2023-12-26 13:24:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 882393088. Throughput: 0: 9144.1, 1: 8585.0. Samples: 882374288. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:24:08,784][121949] Avg episode reward: [(0, '6166.482'), (1, '5203.464')] [2023-12-26 13:24:08,785][123091] Updated weights for policy 0, policy_version 1729223 (0.0005) [2023-12-26 13:24:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001717632_439713792.pth... [2023-12-26 13:24:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001716608_439451648.pth [2023-12-26 13:24:08,844][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001729232_442687488.pth... [2023-12-26 13:24:08,847][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001728176_442417152.pth [2023-12-26 13:24:08,984][123090] Updated weights for policy 1, policy_version 1717637 (0.0007) [2023-12-26 13:24:09,032][123090] Updated weights for policy 1, policy_version 1717647 (0.0005) [2023-12-26 13:24:09,090][123090] Updated weights for policy 1, policy_version 1717657 (0.0005) [2023-12-26 13:24:09,522][123091] Updated weights for policy 0, policy_version 1729233 (0.0006) [2023-12-26 13:24:09,581][123091] Updated weights for policy 0, policy_version 1729243 (0.0006) [2023-12-26 13:24:09,644][123091] Updated weights for policy 0, policy_version 1729253 (0.0006) [2023-12-26 13:24:09,712][123091] Updated weights for policy 0, policy_version 1729263 (0.0006) [2023-12-26 13:24:09,834][123090] Updated weights for policy 1, policy_version 1717667 (0.0006) [2023-12-26 13:24:09,904][123090] Updated weights for policy 1, policy_version 1717677 (0.0010) [2023-12-26 13:24:09,975][123090] Updated weights for policy 1, policy_version 1717687 (0.0010) [2023-12-26 13:24:10,550][123091] Updated weights for policy 0, policy_version 1729273 (0.0009) [2023-12-26 13:24:10,605][123091] Updated weights for policy 0, policy_version 1729283 (0.0010) [2023-12-26 13:24:10,668][123091] Updated weights for policy 0, policy_version 1729293 (0.0010) [2023-12-26 13:24:10,706][123090] Updated weights for policy 1, policy_version 1717697 (0.0006) [2023-12-26 13:24:10,775][123090] Updated weights for policy 1, policy_version 1717707 (0.0010) [2023-12-26 13:24:10,839][123090] Updated weights for policy 1, policy_version 1717717 (0.0011) [2023-12-26 13:24:10,908][123090] Updated weights for policy 1, policy_version 1717727 (0.0008) [2023-12-26 13:24:11,602][123091] Updated weights for policy 0, policy_version 1729303 (0.0010) [2023-12-26 13:24:11,668][123091] Updated weights for policy 0, policy_version 1729313 (0.0009) [2023-12-26 13:24:11,695][123090] Updated weights for policy 1, policy_version 1717737 (0.0009) [2023-12-26 13:24:11,734][123091] Updated weights for policy 0, policy_version 1729323 (0.0009) [2023-12-26 13:24:11,755][123090] Updated weights for policy 1, policy_version 1717747 (0.0008) [2023-12-26 13:24:11,806][123090] Updated weights for policy 1, policy_version 1717757 (0.0006) [2023-12-26 13:24:12,579][123090] Updated weights for policy 1, policy_version 1717767 (0.0006) [2023-12-26 13:24:12,650][123090] Updated weights for policy 1, policy_version 1717777 (0.0006) [2023-12-26 13:24:12,672][123091] Updated weights for policy 0, policy_version 1729333 (0.0009) [2023-12-26 13:24:12,717][123090] Updated weights for policy 1, policy_version 1717787 (0.0007) [2023-12-26 13:24:12,732][123091] Updated weights for policy 0, policy_version 1729343 (0.0009) [2023-12-26 13:24:12,784][123091] Updated weights for policy 0, policy_version 1729353 (0.0010) [2023-12-26 13:24:13,453][123090] Updated weights for policy 1, policy_version 1717797 (0.0008) [2023-12-26 13:24:13,511][123090] Updated weights for policy 1, policy_version 1717807 (0.0009) [2023-12-26 13:24:13,573][123090] Updated weights for policy 1, policy_version 1717817 (0.0009) [2023-12-26 13:24:13,642][123091] Updated weights for policy 0, policy_version 1729363 (0.0010) [2023-12-26 13:24:13,694][123091] Updated weights for policy 0, policy_version 1729373 (0.0010) [2023-12-26 13:24:13,750][123091] Updated weights for policy 0, policy_version 1729383 (0.0009) [2023-12-26 13:24:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 882483200. Throughput: 0: 9066.8, 1: 8695.3. Samples: 882479908. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:24:13,785][121949] Avg episode reward: [(0, '6169.352'), (1, '5559.366')] [2023-12-26 13:24:14,277][123090] Updated weights for policy 1, policy_version 1717827 (0.0008) [2023-12-26 13:24:14,336][123090] Updated weights for policy 1, policy_version 1717837 (0.0009) [2023-12-26 13:24:14,382][123090] Updated weights for policy 1, policy_version 1717847 (0.0010) [2023-12-26 13:24:14,552][123091] Updated weights for policy 0, policy_version 1729394 (0.0010) [2023-12-26 13:24:14,611][123091] Updated weights for policy 0, policy_version 1729404 (0.0009) [2023-12-26 13:24:14,658][123091] Updated weights for policy 0, policy_version 1729414 (0.0008) [2023-12-26 13:24:14,705][123091] Updated weights for policy 0, policy_version 1729424 (0.0008) [2023-12-26 13:24:15,225][123090] Updated weights for policy 1, policy_version 1717857 (0.0010) [2023-12-26 13:24:15,290][123090] Updated weights for policy 1, policy_version 1717867 (0.0007) [2023-12-26 13:24:15,359][123090] Updated weights for policy 1, policy_version 1717877 (0.0010) [2023-12-26 13:24:15,434][123090] Updated weights for policy 1, policy_version 1717887 (0.0010) [2023-12-26 13:24:15,512][123091] Updated weights for policy 0, policy_version 1729434 (0.0006) [2023-12-26 13:24:15,581][123091] Updated weights for policy 0, policy_version 1729444 (0.0006) [2023-12-26 13:24:15,652][123091] Updated weights for policy 0, policy_version 1729454 (0.0006) [2023-12-26 13:24:16,227][123091] Updated weights for policy 0, policy_version 1729464 (0.0008) [2023-12-26 13:24:16,278][123091] Updated weights for policy 0, policy_version 1729474 (0.0008) [2023-12-26 13:24:16,289][123090] Updated weights for policy 1, policy_version 1717897 (0.0007) [2023-12-26 13:24:16,330][123091] Updated weights for policy 0, policy_version 1729484 (0.0008) [2023-12-26 13:24:16,346][123090] Updated weights for policy 1, policy_version 1717907 (0.0008) [2023-12-26 13:24:16,401][123090] Updated weights for policy 1, policy_version 1717917 (0.0010) [2023-12-26 13:24:17,172][123091] Updated weights for policy 0, policy_version 1729494 (0.0009) [2023-12-26 13:24:17,222][123090] Updated weights for policy 1, policy_version 1717927 (0.0008) [2023-12-26 13:24:17,228][123091] Updated weights for policy 0, policy_version 1729504 (0.0009) [2023-12-26 13:24:17,273][123091] Updated weights for policy 0, policy_version 1729514 (0.0008) [2023-12-26 13:24:17,284][123090] Updated weights for policy 1, policy_version 1717937 (0.0008) [2023-12-26 13:24:17,340][123090] Updated weights for policy 1, policy_version 1717947 (0.0008) [2023-12-26 13:24:18,113][123091] Updated weights for policy 0, policy_version 1729524 (0.0009) [2023-12-26 13:24:18,171][123091] Updated weights for policy 0, policy_version 1729534 (0.0010) [2023-12-26 13:24:18,179][123090] Updated weights for policy 1, policy_version 1717957 (0.0008) [2023-12-26 13:24:18,236][123091] Updated weights for policy 0, policy_version 1729544 (0.0010) [2023-12-26 13:24:18,245][123090] Updated weights for policy 1, policy_version 1717967 (0.0010) [2023-12-26 13:24:18,307][123090] Updated weights for policy 1, policy_version 1717977 (0.0009) [2023-12-26 13:24:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 882573312. Throughput: 0: 8974.5, 1: 8729.7. Samples: 882586224. Policy #0 lag: (min: 3.0, avg: 10.4, max: 35.0) [2023-12-26 13:24:18,784][121949] Avg episode reward: [(0, '6205.453'), (1, '5700.044')] [2023-12-26 13:24:19,004][123091] Updated weights for policy 0, policy_version 1729554 (0.0010) [2023-12-26 13:24:19,070][123091] Updated weights for policy 0, policy_version 1729564 (0.0010) [2023-12-26 13:24:19,137][123091] Updated weights for policy 0, policy_version 1729574 (0.0010) [2023-12-26 13:24:19,181][123090] Updated weights for policy 1, policy_version 1717987 (0.0009) [2023-12-26 13:24:19,196][123091] Updated weights for policy 0, policy_version 1729584 (0.0010) [2023-12-26 13:24:19,246][123090] Updated weights for policy 1, policy_version 1717997 (0.0009) [2023-12-26 13:24:19,304][123090] Updated weights for policy 1, policy_version 1718007 (0.0010) [2023-12-26 13:24:20,001][123091] Updated weights for policy 0, policy_version 1729594 (0.0007) [2023-12-26 13:24:20,064][123091] Updated weights for policy 0, policy_version 1729604 (0.0006) [2023-12-26 13:24:20,128][123091] Updated weights for policy 0, policy_version 1729614 (0.0010) [2023-12-26 13:24:20,172][123090] Updated weights for policy 1, policy_version 1718017 (0.0010) [2023-12-26 13:24:20,239][123090] Updated weights for policy 1, policy_version 1718027 (0.0008) [2023-12-26 13:24:20,310][123090] Updated weights for policy 1, policy_version 1718037 (0.0009) [2023-12-26 13:24:20,372][123090] Updated weights for policy 1, policy_version 1718047 (0.0010) [2023-12-26 13:24:20,964][123091] Updated weights for policy 0, policy_version 1729624 (0.0010) [2023-12-26 13:24:21,030][123091] Updated weights for policy 0, policy_version 1729634 (0.0009) [2023-12-26 13:24:21,098][123091] Updated weights for policy 0, policy_version 1729644 (0.0010) [2023-12-26 13:24:21,235][123090] Updated weights for policy 1, policy_version 1718057 (0.0010) [2023-12-26 13:24:21,306][123090] Updated weights for policy 1, policy_version 1718067 (0.0010) [2023-12-26 13:24:21,379][123090] Updated weights for policy 1, policy_version 1718077 (0.0010) [2023-12-26 13:24:21,965][123091] Updated weights for policy 0, policy_version 1729654 (0.0010) [2023-12-26 13:24:22,027][123091] Updated weights for policy 0, policy_version 1729664 (0.0009) [2023-12-26 13:24:22,088][123091] Updated weights for policy 0, policy_version 1729674 (0.0010) [2023-12-26 13:24:22,207][123090] Updated weights for policy 1, policy_version 1718087 (0.0010) [2023-12-26 13:24:22,266][123090] Updated weights for policy 1, policy_version 1718097 (0.0009) [2023-12-26 13:24:22,340][123090] Updated weights for policy 1, policy_version 1718107 (0.0009) [2023-12-26 13:24:22,883][123091] Updated weights for policy 0, policy_version 1729684 (0.0009) [2023-12-26 13:24:22,949][123091] Updated weights for policy 0, policy_version 1729694 (0.0009) [2023-12-26 13:24:23,015][123091] Updated weights for policy 0, policy_version 1729704 (0.0009) [2023-12-26 13:24:23,175][123090] Updated weights for policy 1, policy_version 1718117 (0.0010) [2023-12-26 13:24:23,236][123090] Updated weights for policy 1, policy_version 1718127 (0.0009) [2023-12-26 13:24:23,295][123090] Updated weights for policy 1, policy_version 1718137 (0.0010) [2023-12-26 13:24:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 882655232. Throughput: 0: 8891.5, 1: 8724.9. Samples: 882635748. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:23,785][121949] Avg episode reward: [(0, '6090.882'), (1, '5612.993')] [2023-12-26 13:24:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001729712_442810368.pth... [2023-12-26 13:24:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001718144_439844864.pth... [2023-12-26 13:24:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001728688_442548224.pth [2023-12-26 13:24:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001717120_439582720.pth [2023-12-26 13:24:23,841][123091] Updated weights for policy 0, policy_version 1729714 (0.0010) [2023-12-26 13:24:23,907][123091] Updated weights for policy 0, policy_version 1729724 (0.0010) [2023-12-26 13:24:23,975][123091] Updated weights for policy 0, policy_version 1729734 (0.0009) [2023-12-26 13:24:24,039][123091] Updated weights for policy 0, policy_version 1729744 (0.0009) [2023-12-26 13:24:24,139][123090] Updated weights for policy 1, policy_version 1718147 (0.0010) [2023-12-26 13:24:24,195][123090] Updated weights for policy 1, policy_version 1718157 (0.0009) [2023-12-26 13:24:24,256][123090] Updated weights for policy 1, policy_version 1718167 (0.0009) [2023-12-26 13:24:24,852][123091] Updated weights for policy 0, policy_version 1729754 (0.0009) [2023-12-26 13:24:24,914][123091] Updated weights for policy 0, policy_version 1729764 (0.0009) [2023-12-26 13:24:24,975][123091] Updated weights for policy 0, policy_version 1729774 (0.0007) [2023-12-26 13:24:25,080][123090] Updated weights for policy 1, policy_version 1718177 (0.0009) [2023-12-26 13:24:25,138][123090] Updated weights for policy 1, policy_version 1718188 (0.0011) [2023-12-26 13:24:25,190][123090] Updated weights for policy 1, policy_version 1718198 (0.0009) [2023-12-26 13:24:25,243][123090] Updated weights for policy 1, policy_version 1718208 (0.0009) [2023-12-26 13:24:25,717][123091] Updated weights for policy 0, policy_version 1729784 (0.0005) [2023-12-26 13:24:25,788][123091] Updated weights for policy 0, policy_version 1729794 (0.0005) [2023-12-26 13:24:25,847][123091] Updated weights for policy 0, policy_version 1729804 (0.0005) [2023-12-26 13:24:26,184][123090] Updated weights for policy 1, policy_version 1718218 (0.0009) [2023-12-26 13:24:26,237][123090] Updated weights for policy 1, policy_version 1718228 (0.0009) [2023-12-26 13:24:26,301][123090] Updated weights for policy 1, policy_version 1718238 (0.0009) [2023-12-26 13:24:26,449][123091] Updated weights for policy 0, policy_version 1729814 (0.0005) [2023-12-26 13:24:26,496][123091] Updated weights for policy 0, policy_version 1729824 (0.0005) [2023-12-26 13:24:26,540][123091] Updated weights for policy 0, policy_version 1729834 (0.0005) [2023-12-26 13:24:27,185][123091] Updated weights for policy 0, policy_version 1729844 (0.0005) [2023-12-26 13:24:27,216][123090] Updated weights for policy 1, policy_version 1718248 (0.0009) [2023-12-26 13:24:27,236][123091] Updated weights for policy 0, policy_version 1729854 (0.0006) [2023-12-26 13:24:27,281][123090] Updated weights for policy 1, policy_version 1718258 (0.0008) [2023-12-26 13:24:27,290][123091] Updated weights for policy 0, policy_version 1729864 (0.0007) [2023-12-26 13:24:27,343][123090] Updated weights for policy 1, policy_version 1718268 (0.0007) [2023-12-26 13:24:28,024][123091] Updated weights for policy 0, policy_version 1729874 (0.0008) [2023-12-26 13:24:28,080][123091] Updated weights for policy 0, policy_version 1729884 (0.0005) [2023-12-26 13:24:28,123][123090] Updated weights for policy 1, policy_version 1718278 (0.0006) [2023-12-26 13:24:28,129][123091] Updated weights for policy 0, policy_version 1729894 (0.0005) [2023-12-26 13:24:28,178][123090] Updated weights for policy 1, policy_version 1718288 (0.0005) [2023-12-26 13:24:28,188][123091] Updated weights for policy 0, policy_version 1729904 (0.0005) [2023-12-26 13:24:28,233][123090] Updated weights for policy 1, policy_version 1718298 (0.0007) [2023-12-26 13:24:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 882745344. Throughput: 0: 8935.6, 1: 8739.6. Samples: 882740300. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:28,785][121949] Avg episode reward: [(0, '6042.592'), (1, '5597.375')] [2023-12-26 13:24:28,941][123091] Updated weights for policy 0, policy_version 1729914 (0.0008) [2023-12-26 13:24:28,988][123091] Updated weights for policy 0, policy_version 1729924 (0.0008) [2023-12-26 13:24:29,017][123090] Updated weights for policy 1, policy_version 1718308 (0.0010) [2023-12-26 13:24:29,036][123091] Updated weights for policy 0, policy_version 1729934 (0.0007) [2023-12-26 13:24:29,075][123090] Updated weights for policy 1, policy_version 1718318 (0.0010) [2023-12-26 13:24:29,129][123090] Updated weights for policy 1, policy_version 1718328 (0.0010) [2023-12-26 13:24:29,889][123091] Updated weights for policy 0, policy_version 1729944 (0.0008) [2023-12-26 13:24:29,963][123090] Updated weights for policy 1, policy_version 1718338 (0.0009) [2023-12-26 13:24:29,970][123091] Updated weights for policy 0, policy_version 1729954 (0.0010) [2023-12-26 13:24:30,023][123090] Updated weights for policy 1, policy_version 1718348 (0.0006) [2023-12-26 13:24:30,029][123091] Updated weights for policy 0, policy_version 1729964 (0.0009) [2023-12-26 13:24:30,086][123090] Updated weights for policy 1, policy_version 1718358 (0.0010) [2023-12-26 13:24:30,140][123090] Updated weights for policy 1, policy_version 1718368 (0.0009) [2023-12-26 13:24:30,837][123090] Updated weights for policy 1, policy_version 1718378 (0.0007) [2023-12-26 13:24:30,897][123091] Updated weights for policy 0, policy_version 1729974 (0.0009) [2023-12-26 13:24:30,898][123090] Updated weights for policy 1, policy_version 1718388 (0.0009) [2023-12-26 13:24:30,951][123091] Updated weights for policy 0, policy_version 1729984 (0.0010) [2023-12-26 13:24:30,959][123090] Updated weights for policy 1, policy_version 1718398 (0.0007) [2023-12-26 13:24:31,014][123091] Updated weights for policy 0, policy_version 1729994 (0.0010) [2023-12-26 13:24:31,772][123090] Updated weights for policy 1, policy_version 1718408 (0.0010) [2023-12-26 13:24:31,834][123090] Updated weights for policy 1, policy_version 1718418 (0.0010) [2023-12-26 13:24:31,888][123091] Updated weights for policy 0, policy_version 1730004 (0.0008) [2023-12-26 13:24:31,898][123090] Updated weights for policy 1, policy_version 1718428 (0.0009) [2023-12-26 13:24:31,956][123091] Updated weights for policy 0, policy_version 1730014 (0.0009) [2023-12-26 13:24:32,016][123091] Updated weights for policy 0, policy_version 1730024 (0.0010) [2023-12-26 13:24:32,707][123090] Updated weights for policy 1, policy_version 1718438 (0.0009) [2023-12-26 13:24:32,774][123090] Updated weights for policy 1, policy_version 1718448 (0.0008) [2023-12-26 13:24:32,841][123090] Updated weights for policy 1, policy_version 1718458 (0.0008) [2023-12-26 13:24:32,869][123091] Updated weights for policy 0, policy_version 1730034 (0.0010) [2023-12-26 13:24:32,920][123091] Updated weights for policy 0, policy_version 1730044 (0.0010) [2023-12-26 13:24:32,979][123091] Updated weights for policy 0, policy_version 1730054 (0.0009) [2023-12-26 13:24:33,034][123091] Updated weights for policy 0, policy_version 1730064 (0.0009) [2023-12-26 13:24:33,494][123090] Updated weights for policy 1, policy_version 1718468 (0.0008) [2023-12-26 13:24:33,540][123090] Updated weights for policy 1, policy_version 1718478 (0.0008) [2023-12-26 13:24:33,598][123090] Updated weights for policy 1, policy_version 1718489 (0.0009) [2023-12-26 13:24:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 882835456. Throughput: 0: 8894.6, 1: 8732.0. Samples: 882846904. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:33,785][121949] Avg episode reward: [(0, '5974.991'), (1, '5664.167')] [2023-12-26 13:24:33,917][123091] Updated weights for policy 0, policy_version 1730074 (0.0010) [2023-12-26 13:24:33,977][123091] Updated weights for policy 0, policy_version 1730084 (0.0009) [2023-12-26 13:24:34,041][123091] Updated weights for policy 0, policy_version 1730094 (0.0009) [2023-12-26 13:24:34,254][123090] Updated weights for policy 1, policy_version 1718499 (0.0007) [2023-12-26 13:24:34,318][123090] Updated weights for policy 1, policy_version 1718509 (0.0006) [2023-12-26 13:24:34,373][123090] Updated weights for policy 1, policy_version 1718519 (0.0006) [2023-12-26 13:24:34,955][123091] Updated weights for policy 0, policy_version 1730104 (0.0010) [2023-12-26 13:24:35,034][123091] Updated weights for policy 0, policy_version 1730114 (0.0009) [2023-12-26 13:24:35,075][123090] Updated weights for policy 1, policy_version 1718529 (0.0010) [2023-12-26 13:24:35,108][123091] Updated weights for policy 0, policy_version 1730124 (0.0009) [2023-12-26 13:24:35,125][123090] Updated weights for policy 1, policy_version 1718539 (0.0006) [2023-12-26 13:24:35,177][123090] Updated weights for policy 1, policy_version 1718549 (0.0009) [2023-12-26 13:24:35,233][123090] Updated weights for policy 1, policy_version 1718559 (0.0009) [2023-12-26 13:24:35,875][123091] Updated weights for policy 0, policy_version 1730134 (0.0009) [2023-12-26 13:24:35,938][123091] Updated weights for policy 0, policy_version 1730144 (0.0010) [2023-12-26 13:24:35,975][123090] Updated weights for policy 1, policy_version 1718569 (0.0008) [2023-12-26 13:24:35,990][123091] Updated weights for policy 0, policy_version 1730154 (0.0007) [2023-12-26 13:24:36,029][123090] Updated weights for policy 1, policy_version 1718579 (0.0007) [2023-12-26 13:24:36,092][123090] Updated weights for policy 1, policy_version 1718589 (0.0009) [2023-12-26 13:24:36,821][123091] Updated weights for policy 0, policy_version 1730164 (0.0009) [2023-12-26 13:24:36,880][123091] Updated weights for policy 0, policy_version 1730174 (0.0009) [2023-12-26 13:24:36,931][123091] Updated weights for policy 0, policy_version 1730184 (0.0009) [2023-12-26 13:24:36,939][123090] Updated weights for policy 1, policy_version 1718599 (0.0007) [2023-12-26 13:24:37,004][123090] Updated weights for policy 1, policy_version 1718609 (0.0009) [2023-12-26 13:24:37,075][123090] Updated weights for policy 1, policy_version 1718619 (0.0006) [2023-12-26 13:24:37,768][123090] Updated weights for policy 1, policy_version 1718629 (0.0006) [2023-12-26 13:24:37,822][123090] Updated weights for policy 1, policy_version 1718639 (0.0006) [2023-12-26 13:24:37,847][123091] Updated weights for policy 0, policy_version 1730194 (0.0009) [2023-12-26 13:24:37,879][123090] Updated weights for policy 1, policy_version 1718649 (0.0005) [2023-12-26 13:24:37,910][123091] Updated weights for policy 0, policy_version 1730204 (0.0009) [2023-12-26 13:24:37,960][123091] Updated weights for policy 0, policy_version 1730214 (0.0009) [2023-12-26 13:24:38,013][123091] Updated weights for policy 0, policy_version 1730224 (0.0010) [2023-12-26 13:24:38,556][123090] Updated weights for policy 1, policy_version 1718659 (0.0007) [2023-12-26 13:24:38,624][123090] Updated weights for policy 1, policy_version 1718669 (0.0010) [2023-12-26 13:24:38,690][123090] Updated weights for policy 1, policy_version 1718679 (0.0008) [2023-12-26 13:24:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 882925568. Throughput: 0: 8889.0, 1: 8776.8. Samples: 882899780. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:38,785][121949] Avg episode reward: [(0, '6093.884'), (1, '5723.762')] [2023-12-26 13:24:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001730224_442941440.pth... [2023-12-26 13:24:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001718688_439984128.pth... [2023-12-26 13:24:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001729232_442687488.pth [2023-12-26 13:24:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001717632_439713792.pth [2023-12-26 13:24:38,909][123091] Updated weights for policy 0, policy_version 1730234 (0.0009) [2023-12-26 13:24:38,979][123091] Updated weights for policy 0, policy_version 1730244 (0.0009) [2023-12-26 13:24:39,048][123091] Updated weights for policy 0, policy_version 1730254 (0.0009) [2023-12-26 13:24:39,512][123090] Updated weights for policy 1, policy_version 1718689 (0.0008) [2023-12-26 13:24:39,574][123090] Updated weights for policy 1, policy_version 1718699 (0.0009) [2023-12-26 13:24:39,634][123090] Updated weights for policy 1, policy_version 1718709 (0.0007) [2023-12-26 13:24:39,701][123090] Updated weights for policy 1, policy_version 1718719 (0.0008) [2023-12-26 13:24:39,886][123091] Updated weights for policy 0, policy_version 1730264 (0.0010) [2023-12-26 13:24:39,955][123091] Updated weights for policy 0, policy_version 1730275 (0.0010) [2023-12-26 13:24:40,014][123091] Updated weights for policy 0, policy_version 1730285 (0.0009) [2023-12-26 13:24:40,425][123090] Updated weights for policy 1, policy_version 1718729 (0.0008) [2023-12-26 13:24:40,488][123090] Updated weights for policy 1, policy_version 1718739 (0.0009) [2023-12-26 13:24:40,554][123090] Updated weights for policy 1, policy_version 1718749 (0.0008) [2023-12-26 13:24:40,891][123091] Updated weights for policy 0, policy_version 1730295 (0.0006) [2023-12-26 13:24:40,970][123091] Updated weights for policy 0, policy_version 1730305 (0.0006) [2023-12-26 13:24:41,049][123091] Updated weights for policy 0, policy_version 1730315 (0.0009) [2023-12-26 13:24:41,346][123090] Updated weights for policy 1, policy_version 1718759 (0.0008) [2023-12-26 13:24:41,419][123090] Updated weights for policy 1, policy_version 1718769 (0.0010) [2023-12-26 13:24:41,486][123090] Updated weights for policy 1, policy_version 1718779 (0.0010) [2023-12-26 13:24:41,844][123091] Updated weights for policy 0, policy_version 1730325 (0.0010) [2023-12-26 13:24:41,906][123091] Updated weights for policy 0, policy_version 1730335 (0.0009) [2023-12-26 13:24:41,966][123091] Updated weights for policy 0, policy_version 1730345 (0.0009) [2023-12-26 13:24:42,375][123090] Updated weights for policy 1, policy_version 1718789 (0.0009) [2023-12-26 13:24:42,439][123090] Updated weights for policy 1, policy_version 1718799 (0.0009) [2023-12-26 13:24:42,505][123090] Updated weights for policy 1, policy_version 1718809 (0.0009) [2023-12-26 13:24:42,766][123091] Updated weights for policy 0, policy_version 1730355 (0.0010) [2023-12-26 13:24:42,833][123091] Updated weights for policy 0, policy_version 1730365 (0.0011) [2023-12-26 13:24:42,903][123091] Updated weights for policy 0, policy_version 1730375 (0.0011) [2023-12-26 13:24:43,386][123090] Updated weights for policy 1, policy_version 1718819 (0.0009) [2023-12-26 13:24:43,441][123090] Updated weights for policy 1, policy_version 1718831 (0.0011) [2023-12-26 13:24:43,498][123090] Updated weights for policy 1, policy_version 1718841 (0.0009) [2023-12-26 13:24:43,590][123091] Updated weights for policy 0, policy_version 1730385 (0.0010) [2023-12-26 13:24:43,644][123091] Updated weights for policy 0, policy_version 1730395 (0.0005) [2023-12-26 13:24:43,692][123091] Updated weights for policy 0, policy_version 1730405 (0.0005) [2023-12-26 13:24:43,743][123091] Updated weights for policy 0, policy_version 1730415 (0.0006) [2023-12-26 13:24:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 883015680. Throughput: 0: 8766.0, 1: 8780.3. Samples: 883003760. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:43,785][121949] Avg episode reward: [(0, '6011.940'), (1, '5762.451')] [2023-12-26 13:24:44,396][123090] Updated weights for policy 1, policy_version 1718851 (0.0009) [2023-12-26 13:24:44,457][123090] Updated weights for policy 1, policy_version 1718861 (0.0008) [2023-12-26 13:24:44,518][123090] Updated weights for policy 1, policy_version 1718871 (0.0008) [2023-12-26 13:24:44,544][123091] Updated weights for policy 0, policy_version 1730425 (0.0010) [2023-12-26 13:24:44,607][123091] Updated weights for policy 0, policy_version 1730435 (0.0006) [2023-12-26 13:24:44,679][123091] Updated weights for policy 0, policy_version 1730445 (0.0005) [2023-12-26 13:24:45,355][123090] Updated weights for policy 1, policy_version 1718881 (0.0009) [2023-12-26 13:24:45,375][123091] Updated weights for policy 0, policy_version 1730455 (0.0009) [2023-12-26 13:24:45,412][123090] Updated weights for policy 1, policy_version 1718891 (0.0005) [2023-12-26 13:24:45,427][123091] Updated weights for policy 0, policy_version 1730465 (0.0010) [2023-12-26 13:24:45,477][123090] Updated weights for policy 1, policy_version 1718901 (0.0006) [2023-12-26 13:24:45,486][123091] Updated weights for policy 0, policy_version 1730475 (0.0011) [2023-12-26 13:24:45,534][123090] Updated weights for policy 1, policy_version 1718911 (0.0009) [2023-12-26 13:24:46,212][123091] Updated weights for policy 0, policy_version 1730485 (0.0008) [2023-12-26 13:24:46,267][123091] Updated weights for policy 0, policy_version 1730495 (0.0010) [2023-12-26 13:24:46,321][123091] Updated weights for policy 0, policy_version 1730505 (0.0010) [2023-12-26 13:24:46,389][123090] Updated weights for policy 1, policy_version 1718921 (0.0006) [2023-12-26 13:24:46,448][123090] Updated weights for policy 1, policy_version 1718931 (0.0006) [2023-12-26 13:24:46,517][123090] Updated weights for policy 1, policy_version 1718941 (0.0010) [2023-12-26 13:24:47,156][123091] Updated weights for policy 0, policy_version 1730515 (0.0009) [2023-12-26 13:24:47,202][123091] Updated weights for policy 0, policy_version 1730525 (0.0005) [2023-12-26 13:24:47,236][123090] Updated weights for policy 1, policy_version 1718951 (0.0009) [2023-12-26 13:24:47,248][123091] Updated weights for policy 0, policy_version 1730535 (0.0005) [2023-12-26 13:24:47,295][123090] Updated weights for policy 1, policy_version 1718961 (0.0006) [2023-12-26 13:24:47,348][123090] Updated weights for policy 1, policy_version 1718971 (0.0005) [2023-12-26 13:24:47,890][123091] Updated weights for policy 0, policy_version 1730545 (0.0008) [2023-12-26 13:24:47,937][123091] Updated weights for policy 0, policy_version 1730555 (0.0005) [2023-12-26 13:24:47,981][123091] Updated weights for policy 0, policy_version 1730565 (0.0005) [2023-12-26 13:24:48,036][123091] Updated weights for policy 0, policy_version 1730575 (0.0005) [2023-12-26 13:24:48,074][123090] Updated weights for policy 1, policy_version 1718981 (0.0005) [2023-12-26 13:24:48,141][123090] Updated weights for policy 1, policy_version 1718991 (0.0006) [2023-12-26 13:24:48,210][123090] Updated weights for policy 1, policy_version 1719001 (0.0005) [2023-12-26 13:24:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 883097600. Throughput: 0: 8804.6, 1: 8784.5. Samples: 883113776. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:48,785][121949] Avg episode reward: [(0, '5878.813'), (1, '5795.450')] [2023-12-26 13:24:48,833][123090] Updated weights for policy 1, policy_version 1719011 (0.0006) [2023-12-26 13:24:48,861][123091] Updated weights for policy 0, policy_version 1730585 (0.0008) [2023-12-26 13:24:48,895][123090] Updated weights for policy 1, policy_version 1719021 (0.0008) [2023-12-26 13:24:48,925][123091] Updated weights for policy 0, policy_version 1730595 (0.0010) [2023-12-26 13:24:48,959][123090] Updated weights for policy 1, policy_version 1719031 (0.0008) [2023-12-26 13:24:48,990][123091] Updated weights for policy 0, policy_version 1730605 (0.0010) [2023-12-26 13:24:49,809][123091] Updated weights for policy 0, policy_version 1730615 (0.0008) [2023-12-26 13:24:49,810][123090] Updated weights for policy 1, policy_version 1719041 (0.0008) [2023-12-26 13:24:49,876][123091] Updated weights for policy 0, policy_version 1730625 (0.0008) [2023-12-26 13:24:49,877][123090] Updated weights for policy 1, policy_version 1719051 (0.0013) [2023-12-26 13:24:49,946][123090] Updated weights for policy 1, policy_version 1719061 (0.0010) [2023-12-26 13:24:49,951][123091] Updated weights for policy 0, policy_version 1730635 (0.0008) [2023-12-26 13:24:50,001][123090] Updated weights for policy 1, policy_version 1719071 (0.0005) [2023-12-26 13:24:50,738][123091] Updated weights for policy 0, policy_version 1730645 (0.0008) [2023-12-26 13:24:50,778][123090] Updated weights for policy 1, policy_version 1719081 (0.0006) [2023-12-26 13:24:50,807][123091] Updated weights for policy 0, policy_version 1730655 (0.0006) [2023-12-26 13:24:50,845][123090] Updated weights for policy 1, policy_version 1719091 (0.0006) [2023-12-26 13:24:50,875][123091] Updated weights for policy 0, policy_version 1730665 (0.0006) [2023-12-26 13:24:50,901][123090] Updated weights for policy 1, policy_version 1719101 (0.0009) [2023-12-26 13:24:51,603][123090] Updated weights for policy 1, policy_version 1719111 (0.0009) [2023-12-26 13:24:51,632][123091] Updated weights for policy 0, policy_version 1730675 (0.0009) [2023-12-26 13:24:51,670][123090] Updated weights for policy 1, policy_version 1719121 (0.0008) [2023-12-26 13:24:51,694][123091] Updated weights for policy 0, policy_version 1730685 (0.0007) [2023-12-26 13:24:51,757][123090] Updated weights for policy 1, policy_version 1719131 (0.0011) [2023-12-26 13:24:51,763][123091] Updated weights for policy 0, policy_version 1730695 (0.0007) [2023-12-26 13:24:52,520][123091] Updated weights for policy 0, policy_version 1730705 (0.0008) [2023-12-26 13:24:52,574][123090] Updated weights for policy 1, policy_version 1719141 (0.0011) [2023-12-26 13:24:52,582][123091] Updated weights for policy 0, policy_version 1730715 (0.0008) [2023-12-26 13:24:52,637][123090] Updated weights for policy 1, policy_version 1719151 (0.0009) [2023-12-26 13:24:52,647][123091] Updated weights for policy 0, policy_version 1730725 (0.0008) [2023-12-26 13:24:52,701][123090] Updated weights for policy 1, policy_version 1719161 (0.0006) [2023-12-26 13:24:52,706][123091] Updated weights for policy 0, policy_version 1730735 (0.0008) [2023-12-26 13:24:53,357][123090] Updated weights for policy 1, policy_version 1719171 (0.0005) [2023-12-26 13:24:53,381][123091] Updated weights for policy 0, policy_version 1730745 (0.0007) [2023-12-26 13:24:53,425][123090] Updated weights for policy 1, policy_version 1719181 (0.0005) [2023-12-26 13:24:53,441][123091] Updated weights for policy 0, policy_version 1730755 (0.0005) [2023-12-26 13:24:53,490][123090] Updated weights for policy 1, policy_version 1719191 (0.0005) [2023-12-26 13:24:53,506][123091] Updated weights for policy 0, policy_version 1730765 (0.0005) [2023-12-26 13:24:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 883195904. Throughput: 0: 8783.4, 1: 8844.4. Samples: 883167544. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:53,785][121949] Avg episode reward: [(0, '5925.591'), (1, '5765.284')] [2023-12-26 13:24:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001730768_443080704.pth... [2023-12-26 13:24:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001719200_440115200.pth... [2023-12-26 13:24:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001718144_439844864.pth [2023-12-26 13:24:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001729712_442810368.pth [2023-12-26 13:24:54,228][123090] Updated weights for policy 1, policy_version 1719201 (0.0006) [2023-12-26 13:24:54,248][123091] Updated weights for policy 0, policy_version 1730775 (0.0006) [2023-12-26 13:24:54,280][123090] Updated weights for policy 1, policy_version 1719211 (0.0010) [2023-12-26 13:24:54,301][123091] Updated weights for policy 0, policy_version 1730785 (0.0007) [2023-12-26 13:24:54,344][123090] Updated weights for policy 1, policy_version 1719221 (0.0011) [2023-12-26 13:24:54,363][123091] Updated weights for policy 0, policy_version 1730795 (0.0009) [2023-12-26 13:24:54,405][123090] Updated weights for policy 1, policy_version 1719231 (0.0011) [2023-12-26 13:24:55,129][123090] Updated weights for policy 1, policy_version 1719241 (0.0006) [2023-12-26 13:24:55,187][123090] Updated weights for policy 1, policy_version 1719251 (0.0006) [2023-12-26 13:24:55,201][123091] Updated weights for policy 0, policy_version 1730805 (0.0009) [2023-12-26 13:24:55,241][123090] Updated weights for policy 1, policy_version 1719261 (0.0006) [2023-12-26 13:24:55,257][123091] Updated weights for policy 0, policy_version 1730815 (0.0009) [2023-12-26 13:24:55,310][123091] Updated weights for policy 0, policy_version 1730825 (0.0009) [2023-12-26 13:24:55,921][123090] Updated weights for policy 1, policy_version 1719271 (0.0005) [2023-12-26 13:24:55,995][123090] Updated weights for policy 1, policy_version 1719281 (0.0005) [2023-12-26 13:24:56,072][123090] Updated weights for policy 1, policy_version 1719291 (0.0005) [2023-12-26 13:24:56,230][123091] Updated weights for policy 0, policy_version 1730835 (0.0010) [2023-12-26 13:24:56,284][123091] Updated weights for policy 0, policy_version 1730845 (0.0010) [2023-12-26 13:24:56,339][123091] Updated weights for policy 0, policy_version 1730856 (0.0010) [2023-12-26 13:24:56,680][123090] Updated weights for policy 1, policy_version 1719301 (0.0005) [2023-12-26 13:24:56,739][123090] Updated weights for policy 1, policy_version 1719311 (0.0005) [2023-12-26 13:24:56,801][123090] Updated weights for policy 1, policy_version 1719321 (0.0005) [2023-12-26 13:24:57,274][123091] Updated weights for policy 0, policy_version 1730866 (0.0010) [2023-12-26 13:24:57,336][123091] Updated weights for policy 0, policy_version 1730876 (0.0009) [2023-12-26 13:24:57,379][123090] Updated weights for policy 1, policy_version 1719331 (0.0007) [2023-12-26 13:24:57,400][123091] Updated weights for policy 0, policy_version 1730886 (0.0007) [2023-12-26 13:24:57,433][123090] Updated weights for policy 1, policy_version 1719341 (0.0009) [2023-12-26 13:24:57,445][123091] Updated weights for policy 0, policy_version 1730896 (0.0006) [2023-12-26 13:24:57,481][123090] Updated weights for policy 1, policy_version 1719351 (0.0009) [2023-12-26 13:24:58,263][123091] Updated weights for policy 0, policy_version 1730906 (0.0009) [2023-12-26 13:24:58,332][123091] Updated weights for policy 0, policy_version 1730916 (0.0012) [2023-12-26 13:24:58,356][123090] Updated weights for policy 1, policy_version 1719361 (0.0009) [2023-12-26 13:24:58,399][123091] Updated weights for policy 0, policy_version 1730926 (0.0010) [2023-12-26 13:24:58,437][123090] Updated weights for policy 1, policy_version 1719371 (0.0008) [2023-12-26 13:24:58,506][123090] Updated weights for policy 1, policy_version 1719381 (0.0008) [2023-12-26 13:24:58,570][123090] Updated weights for policy 1, policy_version 1719391 (0.0008) [2023-12-26 13:24:58,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 883286016. Throughput: 0: 8801.9, 1: 8935.8. Samples: 883278104. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:24:58,785][121949] Avg episode reward: [(0, '6120.034'), (1, '5710.294')] [2023-12-26 13:24:59,307][123091] Updated weights for policy 0, policy_version 1730936 (0.0008) [2023-12-26 13:24:59,386][123091] Updated weights for policy 0, policy_version 1730946 (0.0008) [2023-12-26 13:24:59,396][123090] Updated weights for policy 1, policy_version 1719401 (0.0012) [2023-12-26 13:24:59,460][123091] Updated weights for policy 0, policy_version 1730956 (0.0008) [2023-12-26 13:24:59,462][123090] Updated weights for policy 1, policy_version 1719411 (0.0008) [2023-12-26 13:24:59,521][123090] Updated weights for policy 1, policy_version 1719421 (0.0010) [2023-12-26 13:25:00,317][123091] Updated weights for policy 0, policy_version 1730966 (0.0009) [2023-12-26 13:25:00,329][123090] Updated weights for policy 1, policy_version 1719431 (0.0007) [2023-12-26 13:25:00,379][123091] Updated weights for policy 0, policy_version 1730976 (0.0006) [2023-12-26 13:25:00,393][123090] Updated weights for policy 1, policy_version 1719441 (0.0009) [2023-12-26 13:25:00,439][123091] Updated weights for policy 0, policy_version 1730986 (0.0005) [2023-12-26 13:25:00,445][123090] Updated weights for policy 1, policy_version 1719451 (0.0009) [2023-12-26 13:25:01,123][123091] Updated weights for policy 0, policy_version 1730996 (0.0007) [2023-12-26 13:25:01,193][123091] Updated weights for policy 0, policy_version 1731006 (0.0008) [2023-12-26 13:25:01,201][123090] Updated weights for policy 1, policy_version 1719461 (0.0008) [2023-12-26 13:25:01,260][123091] Updated weights for policy 0, policy_version 1731016 (0.0009) [2023-12-26 13:25:01,266][123090] Updated weights for policy 1, policy_version 1719471 (0.0007) [2023-12-26 13:25:01,323][123090] Updated weights for policy 1, policy_version 1719481 (0.0006) [2023-12-26 13:25:01,983][123091] Updated weights for policy 0, policy_version 1731026 (0.0010) [2023-12-26 13:25:02,034][123091] Updated weights for policy 0, policy_version 1731036 (0.0005) [2023-12-26 13:25:02,086][123091] Updated weights for policy 0, policy_version 1731046 (0.0006) [2023-12-26 13:25:02,110][123090] Updated weights for policy 1, policy_version 1719491 (0.0007) [2023-12-26 13:25:02,152][123091] Updated weights for policy 0, policy_version 1731056 (0.0006) [2023-12-26 13:25:02,181][123090] Updated weights for policy 1, policy_version 1719501 (0.0008) [2023-12-26 13:25:02,249][123090] Updated weights for policy 1, policy_version 1719511 (0.0009) [2023-12-26 13:25:02,940][123091] Updated weights for policy 0, policy_version 1731066 (0.0010) [2023-12-26 13:25:03,006][123091] Updated weights for policy 0, policy_version 1731076 (0.0010) [2023-12-26 13:25:03,053][123091] Updated weights for policy 0, policy_version 1731086 (0.0010) [2023-12-26 13:25:03,054][123090] Updated weights for policy 1, policy_version 1719521 (0.0009) [2023-12-26 13:25:03,108][123090] Updated weights for policy 1, policy_version 1719531 (0.0008) [2023-12-26 13:25:03,156][123090] Updated weights for policy 1, policy_version 1719541 (0.0009) [2023-12-26 13:25:03,208][123090] Updated weights for policy 1, policy_version 1719551 (0.0009) [2023-12-26 13:25:03,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 883367936. Throughput: 0: 8780.0, 1: 8930.4. Samples: 883383200. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:03,785][121949] Avg episode reward: [(0, '6272.920'), (1, '5685.000')] [2023-12-26 13:25:03,873][123091] Updated weights for policy 0, policy_version 1731096 (0.0011) [2023-12-26 13:25:03,933][123091] Updated weights for policy 0, policy_version 1731106 (0.0010) [2023-12-26 13:25:03,996][123091] Updated weights for policy 0, policy_version 1731116 (0.0011) [2023-12-26 13:25:04,019][123090] Updated weights for policy 1, policy_version 1719561 (0.0010) [2023-12-26 13:25:04,087][123090] Updated weights for policy 1, policy_version 1719571 (0.0009) [2023-12-26 13:25:04,158][123090] Updated weights for policy 1, policy_version 1719581 (0.0006) [2023-12-26 13:25:04,813][123091] Updated weights for policy 0, policy_version 1731126 (0.0011) [2023-12-26 13:25:04,880][123091] Updated weights for policy 0, policy_version 1731136 (0.0011) [2023-12-26 13:25:04,906][123090] Updated weights for policy 1, policy_version 1719591 (0.0007) [2023-12-26 13:25:04,932][123091] Updated weights for policy 0, policy_version 1731146 (0.0010) [2023-12-26 13:25:04,973][123090] Updated weights for policy 1, policy_version 1719601 (0.0007) [2023-12-26 13:25:05,034][123090] Updated weights for policy 1, policy_version 1719611 (0.0009) [2023-12-26 13:25:05,529][123091] Updated weights for policy 0, policy_version 1731156 (0.0007) [2023-12-26 13:25:05,577][123091] Updated weights for policy 0, policy_version 1731166 (0.0005) [2023-12-26 13:25:05,623][123091] Updated weights for policy 0, policy_version 1731176 (0.0005) [2023-12-26 13:25:05,882][123090] Updated weights for policy 1, policy_version 1719621 (0.0007) [2023-12-26 13:25:05,943][123090] Updated weights for policy 1, policy_version 1719631 (0.0005) [2023-12-26 13:25:06,009][123090] Updated weights for policy 1, policy_version 1719641 (0.0006) [2023-12-26 13:25:06,328][123091] Updated weights for policy 0, policy_version 1731186 (0.0006) [2023-12-26 13:25:06,394][123091] Updated weights for policy 0, policy_version 1731196 (0.0006) [2023-12-26 13:25:06,454][123091] Updated weights for policy 0, policy_version 1731206 (0.0011) [2023-12-26 13:25:06,514][123091] Updated weights for policy 0, policy_version 1731216 (0.0011) [2023-12-26 13:25:06,838][123090] Updated weights for policy 1, policy_version 1719651 (0.0010) [2023-12-26 13:25:06,909][123090] Updated weights for policy 1, policy_version 1719661 (0.0010) [2023-12-26 13:25:06,960][123090] Updated weights for policy 1, policy_version 1719671 (0.0010) [2023-12-26 13:25:07,280][123091] Updated weights for policy 0, policy_version 1731226 (0.0011) [2023-12-26 13:25:07,330][123091] Updated weights for policy 0, policy_version 1731236 (0.0009) [2023-12-26 13:25:07,377][123091] Updated weights for policy 0, policy_version 1731246 (0.0005) [2023-12-26 13:25:07,795][123090] Updated weights for policy 1, policy_version 1719681 (0.0010) [2023-12-26 13:25:07,848][123090] Updated weights for policy 1, policy_version 1719691 (0.0007) [2023-12-26 13:25:07,897][123090] Updated weights for policy 1, policy_version 1719701 (0.0005) [2023-12-26 13:25:07,956][123090] Updated weights for policy 1, policy_version 1719711 (0.0010) [2023-12-26 13:25:08,065][123091] Updated weights for policy 0, policy_version 1731256 (0.0005) [2023-12-26 13:25:08,122][123091] Updated weights for policy 0, policy_version 1731266 (0.0008) [2023-12-26 13:25:08,180][123091] Updated weights for policy 0, policy_version 1731276 (0.0005) [2023-12-26 13:25:08,675][123090] Updated weights for policy 1, policy_version 1719721 (0.0006) [2023-12-26 13:25:08,731][123090] Updated weights for policy 1, policy_version 1719731 (0.0005) [2023-12-26 13:25:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 883458048. Throughput: 0: 8849.6, 1: 8974.9. Samples: 883437848. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:08,785][121949] Avg episode reward: [(0, '6094.484'), (1, '5671.597')] [2023-12-26 13:25:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001731280_443211776.pth... [2023-12-26 13:25:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001730224_442941440.pth [2023-12-26 13:25:08,797][123090] Updated weights for policy 1, policy_version 1719741 (0.0005) [2023-12-26 13:25:08,820][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001719744_440254464.pth... [2023-12-26 13:25:08,826][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001718688_439984128.pth [2023-12-26 13:25:08,876][123091] Updated weights for policy 0, policy_version 1731286 (0.0007) [2023-12-26 13:25:08,948][123091] Updated weights for policy 0, policy_version 1731296 (0.0006) [2023-12-26 13:25:09,017][123091] Updated weights for policy 0, policy_version 1731306 (0.0005) [2023-12-26 13:25:09,662][123090] Updated weights for policy 1, policy_version 1719751 (0.0008) [2023-12-26 13:25:09,726][123091] Updated weights for policy 0, policy_version 1731316 (0.0005) [2023-12-26 13:25:09,738][123090] Updated weights for policy 1, policy_version 1719761 (0.0010) [2023-12-26 13:25:09,793][123091] Updated weights for policy 0, policy_version 1731326 (0.0006) [2023-12-26 13:25:09,810][123090] Updated weights for policy 1, policy_version 1719771 (0.0010) [2023-12-26 13:25:09,865][123091] Updated weights for policy 0, policy_version 1731336 (0.0008) [2023-12-26 13:25:10,594][123090] Updated weights for policy 1, policy_version 1719781 (0.0010) [2023-12-26 13:25:10,650][123090] Updated weights for policy 1, policy_version 1719791 (0.0010) [2023-12-26 13:25:10,670][123091] Updated weights for policy 0, policy_version 1731346 (0.0009) [2023-12-26 13:25:10,710][123090] Updated weights for policy 1, policy_version 1719801 (0.0011) [2023-12-26 13:25:10,724][123091] Updated weights for policy 0, policy_version 1731356 (0.0006) [2023-12-26 13:25:10,774][123091] Updated weights for policy 0, policy_version 1731366 (0.0009) [2023-12-26 13:25:10,833][123091] Updated weights for policy 0, policy_version 1731376 (0.0010) [2023-12-26 13:25:11,472][123090] Updated weights for policy 1, policy_version 1719811 (0.0008) [2023-12-26 13:25:11,544][123090] Updated weights for policy 1, policy_version 1719821 (0.0011) [2023-12-26 13:25:11,609][123090] Updated weights for policy 1, policy_version 1719831 (0.0011) [2023-12-26 13:25:11,747][123091] Updated weights for policy 0, policy_version 1731386 (0.0008) [2023-12-26 13:25:11,804][123091] Updated weights for policy 0, policy_version 1731396 (0.0009) [2023-12-26 13:25:11,859][123091] Updated weights for policy 0, policy_version 1731406 (0.0009) [2023-12-26 13:25:12,458][123090] Updated weights for policy 1, policy_version 1719841 (0.0011) [2023-12-26 13:25:12,515][123090] Updated weights for policy 1, policy_version 1719851 (0.0011) [2023-12-26 13:25:12,567][123090] Updated weights for policy 1, policy_version 1719861 (0.0010) [2023-12-26 13:25:12,628][123090] Updated weights for policy 1, policy_version 1719871 (0.0010) [2023-12-26 13:25:12,732][123091] Updated weights for policy 0, policy_version 1731416 (0.0009) [2023-12-26 13:25:12,792][123091] Updated weights for policy 0, policy_version 1731426 (0.0009) [2023-12-26 13:25:12,842][123091] Updated weights for policy 0, policy_version 1731436 (0.0009) [2023-12-26 13:25:13,407][123090] Updated weights for policy 1, policy_version 1719881 (0.0009) [2023-12-26 13:25:13,465][123090] Updated weights for policy 1, policy_version 1719891 (0.0007) [2023-12-26 13:25:13,523][123090] Updated weights for policy 1, policy_version 1719901 (0.0006) [2023-12-26 13:25:13,753][123091] Updated weights for policy 0, policy_version 1731446 (0.0007) [2023-12-26 13:25:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 883548160. Throughput: 0: 8833.0, 1: 9042.8. Samples: 883544708. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:13,785][121949] Avg episode reward: [(0, '5979.435'), (1, '5762.450')] [2023-12-26 13:25:13,808][123091] Updated weights for policy 0, policy_version 1731456 (0.0005) [2023-12-26 13:25:13,863][123091] Updated weights for policy 0, policy_version 1731466 (0.0006) [2023-12-26 13:25:14,252][123090] Updated weights for policy 1, policy_version 1719911 (0.0005) [2023-12-26 13:25:14,312][123090] Updated weights for policy 1, policy_version 1719921 (0.0006) [2023-12-26 13:25:14,382][123090] Updated weights for policy 1, policy_version 1719931 (0.0010) [2023-12-26 13:25:14,485][123091] Updated weights for policy 0, policy_version 1731476 (0.0006) [2023-12-26 13:25:14,539][123091] Updated weights for policy 0, policy_version 1731486 (0.0006) [2023-12-26 13:25:14,607][123091] Updated weights for policy 0, policy_version 1731496 (0.0006) [2023-12-26 13:25:15,144][123090] Updated weights for policy 1, policy_version 1719941 (0.0010) [2023-12-26 13:25:15,213][123090] Updated weights for policy 1, policy_version 1719951 (0.0010) [2023-12-26 13:25:15,282][123090] Updated weights for policy 1, policy_version 1719961 (0.0011) [2023-12-26 13:25:15,325][123091] Updated weights for policy 0, policy_version 1731506 (0.0008) [2023-12-26 13:25:15,393][123091] Updated weights for policy 0, policy_version 1731516 (0.0008) [2023-12-26 13:25:15,472][123091] Updated weights for policy 0, policy_version 1731526 (0.0006) [2023-12-26 13:25:15,538][123091] Updated weights for policy 0, policy_version 1731536 (0.0011) [2023-12-26 13:25:15,972][123090] Updated weights for policy 1, policy_version 1719971 (0.0009) [2023-12-26 13:25:16,022][123090] Updated weights for policy 1, policy_version 1719981 (0.0005) [2023-12-26 13:25:16,076][123090] Updated weights for policy 1, policy_version 1719991 (0.0008) [2023-12-26 13:25:16,242][123091] Updated weights for policy 0, policy_version 1731546 (0.0006) [2023-12-26 13:25:16,302][123091] Updated weights for policy 0, policy_version 1731556 (0.0006) [2023-12-26 13:25:16,363][123091] Updated weights for policy 0, policy_version 1731566 (0.0005) [2023-12-26 13:25:16,759][123090] Updated weights for policy 1, policy_version 1720001 (0.0010) [2023-12-26 13:25:16,821][123090] Updated weights for policy 1, policy_version 1720011 (0.0005) [2023-12-26 13:25:16,876][123090] Updated weights for policy 1, policy_version 1720021 (0.0005) [2023-12-26 13:25:16,936][123090] Updated weights for policy 1, policy_version 1720031 (0.0005) [2023-12-26 13:25:17,006][123091] Updated weights for policy 0, policy_version 1731576 (0.0009) [2023-12-26 13:25:17,061][123091] Updated weights for policy 0, policy_version 1731586 (0.0010) [2023-12-26 13:25:17,116][123091] Updated weights for policy 0, policy_version 1731596 (0.0007) [2023-12-26 13:25:17,615][123090] Updated weights for policy 1, policy_version 1720041 (0.0005) [2023-12-26 13:25:17,678][123090] Updated weights for policy 1, policy_version 1720051 (0.0006) [2023-12-26 13:25:17,744][123090] Updated weights for policy 1, policy_version 1720061 (0.0005) [2023-12-26 13:25:17,787][123091] Updated weights for policy 0, policy_version 1731606 (0.0006) [2023-12-26 13:25:17,841][123091] Updated weights for policy 0, policy_version 1731616 (0.0010) [2023-12-26 13:25:17,896][123091] Updated weights for policy 0, policy_version 1731626 (0.0010) [2023-12-26 13:25:18,480][123090] Updated weights for policy 1, policy_version 1720071 (0.0007) [2023-12-26 13:25:18,552][123090] Updated weights for policy 1, policy_version 1720081 (0.0008) [2023-12-26 13:25:18,630][123090] Updated weights for policy 1, policy_version 1720091 (0.0007) [2023-12-26 13:25:18,719][123091] Updated weights for policy 0, policy_version 1731636 (0.0010) [2023-12-26 13:25:18,783][123091] Updated weights for policy 0, policy_version 1731646 (0.0010) [2023-12-26 13:25:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 883646464. Throughput: 0: 8940.6, 1: 9103.1. Samples: 883658868. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:18,785][121949] Avg episode reward: [(0, '6129.401'), (1, '5389.991')] [2023-12-26 13:25:18,857][123091] Updated weights for policy 0, policy_version 1731656 (0.0008) [2023-12-26 13:25:19,372][123090] Updated weights for policy 1, policy_version 1720101 (0.0008) [2023-12-26 13:25:19,436][123090] Updated weights for policy 1, policy_version 1720111 (0.0008) [2023-12-26 13:25:19,505][123090] Updated weights for policy 1, policy_version 1720121 (0.0009) [2023-12-26 13:25:19,609][123091] Updated weights for policy 0, policy_version 1731666 (0.0008) [2023-12-26 13:25:19,680][123091] Updated weights for policy 0, policy_version 1731676 (0.0011) [2023-12-26 13:25:19,746][123091] Updated weights for policy 0, policy_version 1731686 (0.0009) [2023-12-26 13:25:19,816][123091] Updated weights for policy 0, policy_version 1731696 (0.0007) [2023-12-26 13:25:20,377][123090] Updated weights for policy 1, policy_version 1720131 (0.0008) [2023-12-26 13:25:20,455][123090] Updated weights for policy 1, policy_version 1720141 (0.0006) [2023-12-26 13:25:20,522][123090] Updated weights for policy 1, policy_version 1720151 (0.0007) [2023-12-26 13:25:20,524][123091] Updated weights for policy 0, policy_version 1731706 (0.0006) [2023-12-26 13:25:20,607][123091] Updated weights for policy 0, policy_version 1731716 (0.0008) [2023-12-26 13:25:20,660][123091] Updated weights for policy 0, policy_version 1731726 (0.0010) [2023-12-26 13:25:21,275][123090] Updated weights for policy 1, policy_version 1720161 (0.0008) [2023-12-26 13:25:21,347][123090] Updated weights for policy 1, policy_version 1720171 (0.0008) [2023-12-26 13:25:21,413][123090] Updated weights for policy 1, policy_version 1720181 (0.0010) [2023-12-26 13:25:21,478][123090] Updated weights for policy 1, policy_version 1720191 (0.0009) [2023-12-26 13:25:21,502][123091] Updated weights for policy 0, policy_version 1731736 (0.0007) [2023-12-26 13:25:21,564][123091] Updated weights for policy 0, policy_version 1731746 (0.0005) [2023-12-26 13:25:21,625][123091] Updated weights for policy 0, policy_version 1731756 (0.0007) [2023-12-26 13:25:22,288][123090] Updated weights for policy 1, policy_version 1720201 (0.0010) [2023-12-26 13:25:22,355][123090] Updated weights for policy 1, policy_version 1720211 (0.0010) [2023-12-26 13:25:22,426][123090] Updated weights for policy 1, policy_version 1720221 (0.0010) [2023-12-26 13:25:22,475][123091] Updated weights for policy 0, policy_version 1731766 (0.0009) [2023-12-26 13:25:22,529][123091] Updated weights for policy 0, policy_version 1731776 (0.0009) [2023-12-26 13:25:22,584][123091] Updated weights for policy 0, policy_version 1731786 (0.0009) [2023-12-26 13:25:23,246][123090] Updated weights for policy 1, policy_version 1720231 (0.0008) [2023-12-26 13:25:23,302][123090] Updated weights for policy 1, policy_version 1720242 (0.0009) [2023-12-26 13:25:23,361][123090] Updated weights for policy 1, policy_version 1720252 (0.0010) [2023-12-26 13:25:23,440][123091] Updated weights for policy 0, policy_version 1731796 (0.0009) [2023-12-26 13:25:23,494][123091] Updated weights for policy 0, policy_version 1731806 (0.0009) [2023-12-26 13:25:23,543][123091] Updated weights for policy 0, policy_version 1731816 (0.0009) [2023-12-26 13:25:23,785][121949] Fps is (10 sec: 18840.8, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 883736576. Throughput: 0: 8974.5, 1: 9064.7. Samples: 883711552. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:23,786][121949] Avg episode reward: [(0, '6189.607'), (1, '5340.943')] [2023-12-26 13:25:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001731824_443351040.pth... [2023-12-26 13:25:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001720256_440385536.pth... [2023-12-26 13:25:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001719200_440115200.pth [2023-12-26 13:25:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001730768_443080704.pth [2023-12-26 13:25:24,191][123090] Updated weights for policy 1, policy_version 1720262 (0.0009) [2023-12-26 13:25:24,262][123090] Updated weights for policy 1, policy_version 1720272 (0.0009) [2023-12-26 13:25:24,317][123090] Updated weights for policy 1, policy_version 1720282 (0.0009) [2023-12-26 13:25:24,410][123091] Updated weights for policy 0, policy_version 1731826 (0.0010) [2023-12-26 13:25:24,480][123091] Updated weights for policy 0, policy_version 1731836 (0.0009) [2023-12-26 13:25:24,543][123091] Updated weights for policy 0, policy_version 1731846 (0.0009) [2023-12-26 13:25:24,613][123091] Updated weights for policy 0, policy_version 1731856 (0.0009) [2023-12-26 13:25:25,048][123090] Updated weights for policy 1, policy_version 1720292 (0.0008) [2023-12-26 13:25:25,112][123090] Updated weights for policy 1, policy_version 1720302 (0.0008) [2023-12-26 13:25:25,184][123090] Updated weights for policy 1, policy_version 1720312 (0.0006) [2023-12-26 13:25:25,496][123091] Updated weights for policy 0, policy_version 1731866 (0.0009) [2023-12-26 13:25:25,564][123091] Updated weights for policy 0, policy_version 1731876 (0.0009) [2023-12-26 13:25:25,634][123091] Updated weights for policy 0, policy_version 1731886 (0.0010) [2023-12-26 13:25:25,917][123090] Updated weights for policy 1, policy_version 1720322 (0.0009) [2023-12-26 13:25:25,965][123090] Updated weights for policy 1, policy_version 1720332 (0.0005) [2023-12-26 13:25:26,018][123090] Updated weights for policy 1, policy_version 1720342 (0.0005) [2023-12-26 13:25:26,081][123090] Updated weights for policy 1, policy_version 1720352 (0.0005) [2023-12-26 13:25:26,484][123091] Updated weights for policy 0, policy_version 1731896 (0.0010) [2023-12-26 13:25:26,536][123091] Updated weights for policy 0, policy_version 1731906 (0.0009) [2023-12-26 13:25:26,588][123091] Updated weights for policy 0, policy_version 1731916 (0.0010) [2023-12-26 13:25:26,843][123090] Updated weights for policy 1, policy_version 1720362 (0.0005) [2023-12-26 13:25:26,894][123090] Updated weights for policy 1, policy_version 1720372 (0.0005) [2023-12-26 13:25:26,941][123090] Updated weights for policy 1, policy_version 1720382 (0.0005) [2023-12-26 13:25:27,468][123091] Updated weights for policy 0, policy_version 1731926 (0.0009) [2023-12-26 13:25:27,523][123091] Updated weights for policy 0, policy_version 1731936 (0.0009) [2023-12-26 13:25:27,570][123091] Updated weights for policy 0, policy_version 1731946 (0.0009) [2023-12-26 13:25:27,641][123090] Updated weights for policy 1, policy_version 1720392 (0.0008) [2023-12-26 13:25:27,685][123090] Updated weights for policy 1, policy_version 1720402 (0.0007) [2023-12-26 13:25:27,743][123090] Updated weights for policy 1, policy_version 1720412 (0.0007) [2023-12-26 13:25:28,457][123090] Updated weights for policy 1, policy_version 1720422 (0.0007) [2023-12-26 13:25:28,473][123091] Updated weights for policy 0, policy_version 1731956 (0.0009) [2023-12-26 13:25:28,521][123090] Updated weights for policy 1, policy_version 1720432 (0.0007) [2023-12-26 13:25:28,536][123091] Updated weights for policy 0, policy_version 1731966 (0.0009) [2023-12-26 13:25:28,584][123090] Updated weights for policy 1, policy_version 1720442 (0.0006) [2023-12-26 13:25:28,605][123091] Updated weights for policy 0, policy_version 1731976 (0.0009) [2023-12-26 13:25:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 883826688. Throughput: 0: 8966.3, 1: 9069.3. Samples: 883815360. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:28,785][121949] Avg episode reward: [(0, '6210.616'), (1, '5679.379')] [2023-12-26 13:25:29,356][123090] Updated weights for policy 1, policy_version 1720452 (0.0009) [2023-12-26 13:25:29,411][123091] Updated weights for policy 0, policy_version 1731986 (0.0008) [2023-12-26 13:25:29,425][123090] Updated weights for policy 1, policy_version 1720462 (0.0008) [2023-12-26 13:25:29,469][123091] Updated weights for policy 0, policy_version 1731996 (0.0009) [2023-12-26 13:25:29,497][123090] Updated weights for policy 1, policy_version 1720472 (0.0006) [2023-12-26 13:25:29,526][123091] Updated weights for policy 0, policy_version 1732006 (0.0008) [2023-12-26 13:25:29,576][123091] Updated weights for policy 0, policy_version 1732016 (0.0009) [2023-12-26 13:25:30,313][123090] Updated weights for policy 1, policy_version 1720482 (0.0006) [2023-12-26 13:25:30,370][123090] Updated weights for policy 1, policy_version 1720492 (0.0010) [2023-12-26 13:25:30,381][123091] Updated weights for policy 0, policy_version 1732026 (0.0008) [2023-12-26 13:25:30,424][123090] Updated weights for policy 1, policy_version 1720502 (0.0008) [2023-12-26 13:25:30,448][123091] Updated weights for policy 0, policy_version 1732036 (0.0008) [2023-12-26 13:25:30,483][123090] Updated weights for policy 1, policy_version 1720512 (0.0010) [2023-12-26 13:25:30,504][123091] Updated weights for policy 0, policy_version 1732046 (0.0007) [2023-12-26 13:25:31,272][123090] Updated weights for policy 1, policy_version 1720523 (0.0007) [2023-12-26 13:25:31,331][123090] Updated weights for policy 1, policy_version 1720533 (0.0006) [2023-12-26 13:25:31,350][123091] Updated weights for policy 0, policy_version 1732056 (0.0010) [2023-12-26 13:25:31,403][123090] Updated weights for policy 1, policy_version 1720543 (0.0009) [2023-12-26 13:25:31,422][123091] Updated weights for policy 0, policy_version 1732066 (0.0009) [2023-12-26 13:25:31,483][123091] Updated weights for policy 0, policy_version 1732076 (0.0008) [2023-12-26 13:25:32,238][123090] Updated weights for policy 1, policy_version 1720553 (0.0009) [2023-12-26 13:25:32,303][123090] Updated weights for policy 1, policy_version 1720563 (0.0009) [2023-12-26 13:25:32,316][123091] Updated weights for policy 0, policy_version 1732086 (0.0010) [2023-12-26 13:25:32,358][123090] Updated weights for policy 1, policy_version 1720573 (0.0010) [2023-12-26 13:25:32,376][123091] Updated weights for policy 0, policy_version 1732096 (0.0011) [2023-12-26 13:25:32,435][123091] Updated weights for policy 0, policy_version 1732106 (0.0009) [2023-12-26 13:25:33,122][123090] Updated weights for policy 1, policy_version 1720583 (0.0009) [2023-12-26 13:25:33,173][123090] Updated weights for policy 1, policy_version 1720593 (0.0008) [2023-12-26 13:25:33,233][123090] Updated weights for policy 1, policy_version 1720603 (0.0009) [2023-12-26 13:25:33,314][123091] Updated weights for policy 0, policy_version 1732116 (0.0010) [2023-12-26 13:25:33,370][123091] Updated weights for policy 0, policy_version 1732126 (0.0009) [2023-12-26 13:25:33,430][123091] Updated weights for policy 0, policy_version 1732136 (0.0009) [2023-12-26 13:25:33,784][121949] Fps is (10 sec: 17204.0, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 883908608. Throughput: 0: 8831.4, 1: 9078.4. Samples: 883919716. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:33,784][121949] Avg episode reward: [(0, '6054.368'), (1, '5720.942')] [2023-12-26 13:25:34,086][123090] Updated weights for policy 1, policy_version 1720613 (0.0007) [2023-12-26 13:25:34,158][123090] Updated weights for policy 1, policy_version 1720623 (0.0008) [2023-12-26 13:25:34,231][123090] Updated weights for policy 1, policy_version 1720633 (0.0011) [2023-12-26 13:25:34,238][123091] Updated weights for policy 0, policy_version 1732146 (0.0009) [2023-12-26 13:25:34,305][123091] Updated weights for policy 0, policy_version 1732156 (0.0008) [2023-12-26 13:25:34,371][123091] Updated weights for policy 0, policy_version 1732166 (0.0008) [2023-12-26 13:25:34,441][123091] Updated weights for policy 0, policy_version 1732176 (0.0006) [2023-12-26 13:25:35,069][123090] Updated weights for policy 1, policy_version 1720643 (0.0010) [2023-12-26 13:25:35,121][123090] Updated weights for policy 1, policy_version 1720653 (0.0009) [2023-12-26 13:25:35,174][123090] Updated weights for policy 1, policy_version 1720663 (0.0008) [2023-12-26 13:25:35,215][123091] Updated weights for policy 0, policy_version 1732186 (0.0010) [2023-12-26 13:25:35,259][123091] Updated weights for policy 0, policy_version 1732196 (0.0010) [2023-12-26 13:25:35,314][123091] Updated weights for policy 0, policy_version 1732206 (0.0010) [2023-12-26 13:25:35,849][123090] Updated weights for policy 1, policy_version 1720673 (0.0007) [2023-12-26 13:25:35,920][123090] Updated weights for policy 1, policy_version 1720683 (0.0005) [2023-12-26 13:25:35,974][123090] Updated weights for policy 1, policy_version 1720693 (0.0006) [2023-12-26 13:25:36,031][123090] Updated weights for policy 1, policy_version 1720703 (0.0005) [2023-12-26 13:25:36,148][123091] Updated weights for policy 0, policy_version 1732216 (0.0010) [2023-12-26 13:25:36,214][123091] Updated weights for policy 0, policy_version 1732226 (0.0011) [2023-12-26 13:25:36,278][123091] Updated weights for policy 0, policy_version 1732236 (0.0007) [2023-12-26 13:25:36,833][123090] Updated weights for policy 1, policy_version 1720713 (0.0008) [2023-12-26 13:25:36,899][123090] Updated weights for policy 1, policy_version 1720723 (0.0009) [2023-12-26 13:25:36,957][123090] Updated weights for policy 1, policy_version 1720733 (0.0009) [2023-12-26 13:25:37,094][123091] Updated weights for policy 0, policy_version 1732246 (0.0007) [2023-12-26 13:25:37,146][123091] Updated weights for policy 0, policy_version 1732256 (0.0008) [2023-12-26 13:25:37,200][123091] Updated weights for policy 0, policy_version 1732266 (0.0010) [2023-12-26 13:25:37,714][123090] Updated weights for policy 1, policy_version 1720743 (0.0006) [2023-12-26 13:25:37,786][123090] Updated weights for policy 1, policy_version 1720753 (0.0005) [2023-12-26 13:25:37,859][123090] Updated weights for policy 1, policy_version 1720763 (0.0005) [2023-12-26 13:25:38,032][123091] Updated weights for policy 0, policy_version 1732276 (0.0011) [2023-12-26 13:25:38,088][123091] Updated weights for policy 0, policy_version 1732286 (0.0011) [2023-12-26 13:25:38,136][123091] Updated weights for policy 0, policy_version 1732296 (0.0011) [2023-12-26 13:25:38,451][123090] Updated weights for policy 1, policy_version 1720773 (0.0007) [2023-12-26 13:25:38,516][123090] Updated weights for policy 1, policy_version 1720783 (0.0008) [2023-12-26 13:25:38,583][123090] Updated weights for policy 1, policy_version 1720793 (0.0008) [2023-12-26 13:25:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 883998720. Throughput: 0: 8823.1, 1: 9070.1. Samples: 883972740. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:38,785][121949] Avg episode reward: [(0, '6136.941'), (1, '5743.247')] [2023-12-26 13:25:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001732304_443473920.pth... [2023-12-26 13:25:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001720800_440524800.pth... [2023-12-26 13:25:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001719744_440254464.pth [2023-12-26 13:25:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001731280_443211776.pth [2023-12-26 13:25:38,953][123091] Updated weights for policy 0, policy_version 1732306 (0.0009) [2023-12-26 13:25:39,025][123091] Updated weights for policy 0, policy_version 1732316 (0.0005) [2023-12-26 13:25:39,100][123091] Updated weights for policy 0, policy_version 1732326 (0.0005) [2023-12-26 13:25:39,166][123091] Updated weights for policy 0, policy_version 1732336 (0.0009) [2023-12-26 13:25:39,418][123090] Updated weights for policy 1, policy_version 1720803 (0.0008) [2023-12-26 13:25:39,473][123090] Updated weights for policy 1, policy_version 1720813 (0.0008) [2023-12-26 13:25:39,529][123090] Updated weights for policy 1, policy_version 1720823 (0.0008) [2023-12-26 13:25:39,986][123091] Updated weights for policy 0, policy_version 1732346 (0.0007) [2023-12-26 13:25:40,057][123091] Updated weights for policy 0, policy_version 1732356 (0.0008) [2023-12-26 13:25:40,124][123091] Updated weights for policy 0, policy_version 1732366 (0.0009) [2023-12-26 13:25:40,376][123090] Updated weights for policy 1, policy_version 1720833 (0.0008) [2023-12-26 13:25:40,440][123090] Updated weights for policy 1, policy_version 1720843 (0.0010) [2023-12-26 13:25:40,504][123090] Updated weights for policy 1, policy_version 1720853 (0.0010) [2023-12-26 13:25:40,557][123090] Updated weights for policy 1, policy_version 1720863 (0.0010) [2023-12-26 13:25:40,824][123091] Updated weights for policy 0, policy_version 1732376 (0.0006) [2023-12-26 13:25:40,890][123091] Updated weights for policy 0, policy_version 1732386 (0.0006) [2023-12-26 13:25:40,959][123091] Updated weights for policy 0, policy_version 1732396 (0.0005) [2023-12-26 13:25:41,457][123090] Updated weights for policy 1, policy_version 1720873 (0.0009) [2023-12-26 13:25:41,517][123090] Updated weights for policy 1, policy_version 1720883 (0.0009) [2023-12-26 13:25:41,580][123090] Updated weights for policy 1, policy_version 1720893 (0.0010) [2023-12-26 13:25:41,758][123091] Updated weights for policy 0, policy_version 1732406 (0.0009) [2023-12-26 13:25:41,821][123091] Updated weights for policy 0, policy_version 1732416 (0.0006) [2023-12-26 13:25:41,874][123091] Updated weights for policy 0, policy_version 1732426 (0.0006) [2023-12-26 13:25:42,525][123090] Updated weights for policy 1, policy_version 1720903 (0.0009) [2023-12-26 13:25:42,535][123091] Updated weights for policy 0, policy_version 1732436 (0.0006) [2023-12-26 13:25:42,594][123091] Updated weights for policy 0, policy_version 1732446 (0.0007) [2023-12-26 13:25:42,597][123090] Updated weights for policy 1, policy_version 1720913 (0.0009) [2023-12-26 13:25:42,655][123091] Updated weights for policy 0, policy_version 1732456 (0.0007) [2023-12-26 13:25:42,663][123090] Updated weights for policy 1, policy_version 1720923 (0.0009) [2023-12-26 13:25:43,348][123091] Updated weights for policy 0, policy_version 1732466 (0.0006) [2023-12-26 13:25:43,412][123091] Updated weights for policy 0, policy_version 1732476 (0.0005) [2023-12-26 13:25:43,474][123091] Updated weights for policy 0, policy_version 1732486 (0.0005) [2023-12-26 13:25:43,491][123090] Updated weights for policy 1, policy_version 1720933 (0.0008) [2023-12-26 13:25:43,528][123091] Updated weights for policy 0, policy_version 1732496 (0.0005) [2023-12-26 13:25:43,549][123090] Updated weights for policy 1, policy_version 1720943 (0.0005) [2023-12-26 13:25:43,608][123090] Updated weights for policy 1, policy_version 1720953 (0.0005) [2023-12-26 13:25:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 884088832. Throughput: 0: 8869.1, 1: 8904.1. Samples: 884077896. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:43,785][121949] Avg episode reward: [(0, '6237.834'), (1, '5635.290')] [2023-12-26 13:25:44,209][123091] Updated weights for policy 0, policy_version 1732506 (0.0005) [2023-12-26 13:25:44,262][123091] Updated weights for policy 0, policy_version 1732516 (0.0005) [2023-12-26 13:25:44,291][123090] Updated weights for policy 1, policy_version 1720963 (0.0007) [2023-12-26 13:25:44,323][123091] Updated weights for policy 0, policy_version 1732526 (0.0010) [2023-12-26 13:25:44,339][123090] Updated weights for policy 1, policy_version 1720973 (0.0010) [2023-12-26 13:25:44,386][123090] Updated weights for policy 1, policy_version 1720983 (0.0010) [2023-12-26 13:25:45,063][123091] Updated weights for policy 0, policy_version 1732536 (0.0011) [2023-12-26 13:25:45,124][123091] Updated weights for policy 0, policy_version 1732546 (0.0011) [2023-12-26 13:25:45,183][123090] Updated weights for policy 1, policy_version 1720993 (0.0010) [2023-12-26 13:25:45,189][123091] Updated weights for policy 0, policy_version 1732556 (0.0011) [2023-12-26 13:25:45,247][123090] Updated weights for policy 1, policy_version 1721003 (0.0008) [2023-12-26 13:25:45,317][123090] Updated weights for policy 1, policy_version 1721013 (0.0008) [2023-12-26 13:25:45,383][123090] Updated weights for policy 1, policy_version 1721023 (0.0008) [2023-12-26 13:25:45,926][123091] Updated weights for policy 0, policy_version 1732566 (0.0008) [2023-12-26 13:25:45,994][123091] Updated weights for policy 0, policy_version 1732576 (0.0005) [2023-12-26 13:25:46,059][123090] Updated weights for policy 1, policy_version 1721033 (0.0007) [2023-12-26 13:25:46,065][123091] Updated weights for policy 0, policy_version 1732586 (0.0008) [2023-12-26 13:25:46,106][123090] Updated weights for policy 1, policy_version 1721043 (0.0007) [2023-12-26 13:25:46,153][123090] Updated weights for policy 1, policy_version 1721053 (0.0005) [2023-12-26 13:25:46,737][123091] Updated weights for policy 0, policy_version 1732596 (0.0009) [2023-12-26 13:25:46,799][123091] Updated weights for policy 0, policy_version 1732606 (0.0007) [2023-12-26 13:25:46,862][123091] Updated weights for policy 0, policy_version 1732616 (0.0010) [2023-12-26 13:25:46,872][123090] Updated weights for policy 1, policy_version 1721063 (0.0005) [2023-12-26 13:25:46,925][123090] Updated weights for policy 1, policy_version 1721073 (0.0007) [2023-12-26 13:25:46,976][123090] Updated weights for policy 1, policy_version 1721083 (0.0010) [2023-12-26 13:25:47,551][123091] Updated weights for policy 0, policy_version 1732626 (0.0009) [2023-12-26 13:25:47,625][123091] Updated weights for policy 0, policy_version 1732636 (0.0005) [2023-12-26 13:25:47,675][123091] Updated weights for policy 0, policy_version 1732646 (0.0005) [2023-12-26 13:25:47,742][123091] Updated weights for policy 0, policy_version 1732656 (0.0005) [2023-12-26 13:25:47,766][123090] Updated weights for policy 1, policy_version 1721093 (0.0008) [2023-12-26 13:25:47,838][123090] Updated weights for policy 1, policy_version 1721103 (0.0006) [2023-12-26 13:25:47,908][123090] Updated weights for policy 1, policy_version 1721113 (0.0005) [2023-12-26 13:25:48,396][123091] Updated weights for policy 0, policy_version 1732666 (0.0006) [2023-12-26 13:25:48,454][123091] Updated weights for policy 0, policy_version 1732676 (0.0006) [2023-12-26 13:25:48,524][123091] Updated weights for policy 0, policy_version 1732686 (0.0006) [2023-12-26 13:25:48,566][123090] Updated weights for policy 1, policy_version 1721123 (0.0005) [2023-12-26 13:25:48,624][123090] Updated weights for policy 1, policy_version 1721133 (0.0007) [2023-12-26 13:25:48,677][123090] Updated weights for policy 1, policy_version 1721143 (0.0009) [2023-12-26 13:25:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18158.9, 300 sec: 17855.8). Total num frames: 884187136. Throughput: 0: 9014.5, 1: 9008.7. Samples: 884194244. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:48,785][121949] Avg episode reward: [(0, '6207.096'), (1, '5590.834')] [2023-12-26 13:25:49,272][123091] Updated weights for policy 0, policy_version 1732696 (0.0010) [2023-12-26 13:25:49,343][123091] Updated weights for policy 0, policy_version 1732706 (0.0010) [2023-12-26 13:25:49,406][123090] Updated weights for policy 1, policy_version 1721153 (0.0006) [2023-12-26 13:25:49,412][123091] Updated weights for policy 0, policy_version 1732716 (0.0009) [2023-12-26 13:25:49,476][123090] Updated weights for policy 1, policy_version 1721163 (0.0007) [2023-12-26 13:25:49,545][123090] Updated weights for policy 1, policy_version 1721173 (0.0009) [2023-12-26 13:25:49,613][123090] Updated weights for policy 1, policy_version 1721183 (0.0008) [2023-12-26 13:25:50,189][123091] Updated weights for policy 0, policy_version 1732726 (0.0009) [2023-12-26 13:25:50,257][123091] Updated weights for policy 0, policy_version 1732736 (0.0010) [2023-12-26 13:25:50,317][123091] Updated weights for policy 0, policy_version 1732746 (0.0009) [2023-12-26 13:25:50,339][123090] Updated weights for policy 1, policy_version 1721193 (0.0008) [2023-12-26 13:25:50,408][123090] Updated weights for policy 1, policy_version 1721203 (0.0009) [2023-12-26 13:25:50,470][123090] Updated weights for policy 1, policy_version 1721213 (0.0009) [2023-12-26 13:25:51,122][123091] Updated weights for policy 0, policy_version 1732756 (0.0008) [2023-12-26 13:25:51,197][123091] Updated weights for policy 0, policy_version 1732766 (0.0010) [2023-12-26 13:25:51,266][123091] Updated weights for policy 0, policy_version 1732776 (0.0009) [2023-12-26 13:25:51,276][123090] Updated weights for policy 1, policy_version 1721223 (0.0007) [2023-12-26 13:25:51,341][123090] Updated weights for policy 1, policy_version 1721233 (0.0008) [2023-12-26 13:25:51,415][123090] Updated weights for policy 1, policy_version 1721243 (0.0009) [2023-12-26 13:25:52,136][123091] Updated weights for policy 0, policy_version 1732786 (0.0010) [2023-12-26 13:25:52,169][123090] Updated weights for policy 1, policy_version 1721253 (0.0007) [2023-12-26 13:25:52,192][123091] Updated weights for policy 0, policy_version 1732796 (0.0008) [2023-12-26 13:25:52,234][123090] Updated weights for policy 1, policy_version 1721263 (0.0005) [2023-12-26 13:25:52,244][123091] Updated weights for policy 0, policy_version 1732806 (0.0008) [2023-12-26 13:25:52,299][123090] Updated weights for policy 1, policy_version 1721273 (0.0008) [2023-12-26 13:25:52,304][123091] Updated weights for policy 0, policy_version 1732816 (0.0008) [2023-12-26 13:25:53,034][123090] Updated weights for policy 1, policy_version 1721283 (0.0009) [2023-12-26 13:25:53,081][123090] Updated weights for policy 1, policy_version 1721293 (0.0005) [2023-12-26 13:25:53,139][123090] Updated weights for policy 1, policy_version 1721303 (0.0006) [2023-12-26 13:25:53,167][123091] Updated weights for policy 0, policy_version 1732826 (0.0009) [2023-12-26 13:25:53,227][123091] Updated weights for policy 0, policy_version 1732836 (0.0008) [2023-12-26 13:25:53,294][123091] Updated weights for policy 0, policy_version 1732846 (0.0010) [2023-12-26 13:25:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 884269056. Throughput: 0: 8958.8, 1: 9018.9. Samples: 884246848. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:53,785][121949] Avg episode reward: [(0, '6217.739'), (1, '5602.597')] [2023-12-26 13:25:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001721312_440655872.pth... [2023-12-26 13:25:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001732848_443613184.pth... [2023-12-26 13:25:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001720256_440385536.pth [2023-12-26 13:25:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001731824_443351040.pth [2023-12-26 13:25:53,877][123090] Updated weights for policy 1, policy_version 1721313 (0.0009) [2023-12-26 13:25:53,948][123090] Updated weights for policy 1, policy_version 1721323 (0.0009) [2023-12-26 13:25:54,014][123090] Updated weights for policy 1, policy_version 1721333 (0.0006) [2023-12-26 13:25:54,063][123090] Updated weights for policy 1, policy_version 1721343 (0.0007) [2023-12-26 13:25:54,077][123091] Updated weights for policy 0, policy_version 1732856 (0.0008) [2023-12-26 13:25:54,130][123091] Updated weights for policy 0, policy_version 1732866 (0.0009) [2023-12-26 13:25:54,178][123091] Updated weights for policy 0, policy_version 1732876 (0.0009) [2023-12-26 13:25:54,807][123090] Updated weights for policy 1, policy_version 1721353 (0.0006) [2023-12-26 13:25:54,878][123090] Updated weights for policy 1, policy_version 1721363 (0.0005) [2023-12-26 13:25:54,947][123090] Updated weights for policy 1, policy_version 1721373 (0.0006) [2023-12-26 13:25:54,999][123091] Updated weights for policy 0, policy_version 1732886 (0.0008) [2023-12-26 13:25:55,071][123091] Updated weights for policy 0, policy_version 1732896 (0.0010) [2023-12-26 13:25:55,132][123091] Updated weights for policy 0, policy_version 1732906 (0.0010) [2023-12-26 13:25:55,660][123090] Updated weights for policy 1, policy_version 1721383 (0.0008) [2023-12-26 13:25:55,707][123090] Updated weights for policy 1, policy_version 1721393 (0.0005) [2023-12-26 13:25:55,768][123090] Updated weights for policy 1, policy_version 1721403 (0.0007) [2023-12-26 13:25:55,827][123091] Updated weights for policy 0, policy_version 1732916 (0.0006) [2023-12-26 13:25:55,887][123091] Updated weights for policy 0, policy_version 1732926 (0.0006) [2023-12-26 13:25:55,942][123091] Updated weights for policy 0, policy_version 1732936 (0.0006) [2023-12-26 13:25:56,462][123090] Updated weights for policy 1, policy_version 1721413 (0.0006) [2023-12-26 13:25:56,522][123090] Updated weights for policy 1, policy_version 1721423 (0.0005) [2023-12-26 13:25:56,588][123090] Updated weights for policy 1, policy_version 1721433 (0.0005) [2023-12-26 13:25:56,649][123091] Updated weights for policy 0, policy_version 1732946 (0.0006) [2023-12-26 13:25:56,696][123091] Updated weights for policy 0, policy_version 1732956 (0.0005) [2023-12-26 13:25:56,740][123091] Updated weights for policy 0, policy_version 1732966 (0.0007) [2023-12-26 13:25:56,790][123091] Updated weights for policy 0, policy_version 1732976 (0.0009) [2023-12-26 13:25:57,274][123090] Updated weights for policy 1, policy_version 1721443 (0.0007) [2023-12-26 13:25:57,330][123090] Updated weights for policy 1, policy_version 1721453 (0.0008) [2023-12-26 13:25:57,392][123090] Updated weights for policy 1, policy_version 1721463 (0.0006) [2023-12-26 13:25:57,533][123091] Updated weights for policy 0, policy_version 1732986 (0.0008) [2023-12-26 13:25:57,595][123091] Updated weights for policy 0, policy_version 1732996 (0.0008) [2023-12-26 13:25:57,663][123091] Updated weights for policy 0, policy_version 1733006 (0.0009) [2023-12-26 13:25:58,093][123090] Updated weights for policy 1, policy_version 1721473 (0.0006) [2023-12-26 13:25:58,159][123090] Updated weights for policy 1, policy_version 1721483 (0.0008) [2023-12-26 13:25:58,211][123090] Updated weights for policy 1, policy_version 1721493 (0.0007) [2023-12-26 13:25:58,264][123090] Updated weights for policy 1, policy_version 1721503 (0.0007) [2023-12-26 13:25:58,505][123091] Updated weights for policy 0, policy_version 1733016 (0.0008) [2023-12-26 13:25:58,568][123091] Updated weights for policy 0, policy_version 1733026 (0.0006) [2023-12-26 13:25:58,634][123091] Updated weights for policy 0, policy_version 1733036 (0.0006) [2023-12-26 13:25:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 884367360. Throughput: 0: 8955.8, 1: 9137.3. Samples: 884358900. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:25:58,785][121949] Avg episode reward: [(0, '6225.217'), (1, '5734.192')] [2023-12-26 13:25:59,118][123090] Updated weights for policy 1, policy_version 1721513 (0.0006) [2023-12-26 13:25:59,168][123090] Updated weights for policy 1, policy_version 1721523 (0.0005) [2023-12-26 13:25:59,224][123090] Updated weights for policy 1, policy_version 1721533 (0.0006) [2023-12-26 13:25:59,449][123091] Updated weights for policy 0, policy_version 1733046 (0.0009) [2023-12-26 13:25:59,507][123091] Updated weights for policy 0, policy_version 1733056 (0.0008) [2023-12-26 13:25:59,574][123091] Updated weights for policy 0, policy_version 1733066 (0.0008) [2023-12-26 13:26:00,026][123090] Updated weights for policy 1, policy_version 1721543 (0.0009) [2023-12-26 13:26:00,089][123090] Updated weights for policy 1, policy_version 1721553 (0.0009) [2023-12-26 13:26:00,165][123090] Updated weights for policy 1, policy_version 1721563 (0.0007) [2023-12-26 13:26:00,374][123091] Updated weights for policy 0, policy_version 1733076 (0.0006) [2023-12-26 13:26:00,451][123091] Updated weights for policy 0, policy_version 1733086 (0.0006) [2023-12-26 13:26:00,518][123091] Updated weights for policy 0, policy_version 1733096 (0.0005) [2023-12-26 13:26:00,960][123090] Updated weights for policy 1, policy_version 1721573 (0.0010) [2023-12-26 13:26:01,018][123090] Updated weights for policy 1, policy_version 1721583 (0.0010) [2023-12-26 13:26:01,089][123090] Updated weights for policy 1, policy_version 1721593 (0.0011) [2023-12-26 13:26:01,264][123091] Updated weights for policy 0, policy_version 1733106 (0.0006) [2023-12-26 13:26:01,318][123091] Updated weights for policy 0, policy_version 1733116 (0.0009) [2023-12-26 13:26:01,391][123091] Updated weights for policy 0, policy_version 1733126 (0.0009) [2023-12-26 13:26:01,452][123091] Updated weights for policy 0, policy_version 1733136 (0.0009) [2023-12-26 13:26:01,939][123090] Updated weights for policy 1, policy_version 1721603 (0.0009) [2023-12-26 13:26:02,008][123090] Updated weights for policy 1, policy_version 1721613 (0.0007) [2023-12-26 13:26:02,072][123090] Updated weights for policy 1, policy_version 1721623 (0.0005) [2023-12-26 13:26:02,242][123091] Updated weights for policy 0, policy_version 1733146 (0.0011) [2023-12-26 13:26:02,294][123091] Updated weights for policy 0, policy_version 1733156 (0.0011) [2023-12-26 13:26:02,345][123091] Updated weights for policy 0, policy_version 1733166 (0.0011) [2023-12-26 13:26:02,905][123090] Updated weights for policy 1, policy_version 1721633 (0.0006) [2023-12-26 13:26:02,963][123090] Updated weights for policy 1, policy_version 1721643 (0.0010) [2023-12-26 13:26:03,017][123090] Updated weights for policy 1, policy_version 1721653 (0.0009) [2023-12-26 13:26:03,068][123091] Updated weights for policy 0, policy_version 1733176 (0.0008) [2023-12-26 13:26:03,077][123090] Updated weights for policy 1, policy_version 1721663 (0.0008) [2023-12-26 13:26:03,129][123091] Updated weights for policy 0, policy_version 1733186 (0.0005) [2023-12-26 13:26:03,182][123091] Updated weights for policy 0, policy_version 1733196 (0.0005) [2023-12-26 13:26:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 884449280. Throughput: 0: 8900.6, 1: 9028.2. Samples: 884465664. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:26:03,784][121949] Avg episode reward: [(0, '6064.267'), (1, '5764.795')] [2023-12-26 13:26:03,807][123090] Updated weights for policy 1, policy_version 1721673 (0.0008) [2023-12-26 13:26:03,807][123091] Updated weights for policy 0, policy_version 1733206 (0.0007) [2023-12-26 13:26:03,871][123090] Updated weights for policy 1, policy_version 1721683 (0.0009) [2023-12-26 13:26:03,873][123091] Updated weights for policy 0, policy_version 1733216 (0.0010) [2023-12-26 13:26:03,933][123091] Updated weights for policy 0, policy_version 1733226 (0.0010) [2023-12-26 13:26:03,937][123090] Updated weights for policy 1, policy_version 1721693 (0.0008) [2023-12-26 13:26:04,694][123091] Updated weights for policy 0, policy_version 1733236 (0.0006) [2023-12-26 13:26:04,744][123091] Updated weights for policy 0, policy_version 1733246 (0.0006) [2023-12-26 13:26:04,796][123091] Updated weights for policy 0, policy_version 1733256 (0.0007) [2023-12-26 13:26:04,803][123090] Updated weights for policy 1, policy_version 1721703 (0.0009) [2023-12-26 13:26:04,856][123090] Updated weights for policy 1, policy_version 1721713 (0.0009) [2023-12-26 13:26:04,913][123090] Updated weights for policy 1, policy_version 1721723 (0.0009) [2023-12-26 13:26:05,621][123091] Updated weights for policy 0, policy_version 1733266 (0.0011) [2023-12-26 13:26:05,683][123091] Updated weights for policy 0, policy_version 1733276 (0.0011) [2023-12-26 13:26:05,745][123091] Updated weights for policy 0, policy_version 1733286 (0.0010) [2023-12-26 13:26:05,786][123090] Updated weights for policy 1, policy_version 1721733 (0.0008) [2023-12-26 13:26:05,811][123091] Updated weights for policy 0, policy_version 1733296 (0.0011) [2023-12-26 13:26:05,841][123090] Updated weights for policy 1, policy_version 1721743 (0.0009) [2023-12-26 13:26:05,893][123090] Updated weights for policy 1, policy_version 1721753 (0.0009) [2023-12-26 13:26:06,548][123091] Updated weights for policy 0, policy_version 1733306 (0.0009) [2023-12-26 13:26:06,606][123091] Updated weights for policy 0, policy_version 1733316 (0.0009) [2023-12-26 13:26:06,666][123091] Updated weights for policy 0, policy_version 1733326 (0.0007) [2023-12-26 13:26:06,800][123090] Updated weights for policy 1, policy_version 1721763 (0.0009) [2023-12-26 13:26:06,864][123090] Updated weights for policy 1, policy_version 1721773 (0.0009) [2023-12-26 13:26:06,928][123090] Updated weights for policy 1, policy_version 1721783 (0.0010) [2023-12-26 13:26:07,428][123091] Updated weights for policy 0, policy_version 1733336 (0.0008) [2023-12-26 13:26:07,479][123091] Updated weights for policy 0, policy_version 1733346 (0.0008) [2023-12-26 13:26:07,541][123091] Updated weights for policy 0, policy_version 1733356 (0.0009) [2023-12-26 13:26:07,788][123090] Updated weights for policy 1, policy_version 1721793 (0.0010) [2023-12-26 13:26:07,857][123090] Updated weights for policy 1, policy_version 1721803 (0.0010) [2023-12-26 13:26:07,919][123090] Updated weights for policy 1, policy_version 1721813 (0.0009) [2023-12-26 13:26:07,979][123090] Updated weights for policy 1, policy_version 1721823 (0.0009) [2023-12-26 13:26:08,354][123091] Updated weights for policy 0, policy_version 1733366 (0.0010) [2023-12-26 13:26:08,417][123091] Updated weights for policy 0, policy_version 1733376 (0.0010) [2023-12-26 13:26:08,470][123091] Updated weights for policy 0, policy_version 1733386 (0.0009) [2023-12-26 13:26:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 884539392. Throughput: 0: 8911.1, 1: 9008.3. Samples: 884517920. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:26:08,785][121949] Avg episode reward: [(0, '5936.715'), (1, '5809.251')] [2023-12-26 13:26:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001733392_443752448.pth... [2023-12-26 13:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001732304_443473920.pth [2023-12-26 13:26:08,809][123090] Updated weights for policy 1, policy_version 1721833 (0.0010) [2023-12-26 13:26:08,866][123090] Updated weights for policy 1, policy_version 1721843 (0.0009) [2023-12-26 13:26:08,929][123090] Updated weights for policy 1, policy_version 1721853 (0.0010) [2023-12-26 13:26:08,946][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001721856_440795136.pth... [2023-12-26 13:26:08,951][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001720800_440524800.pth [2023-12-26 13:26:09,321][123091] Updated weights for policy 0, policy_version 1733396 (0.0010) [2023-12-26 13:26:09,389][123091] Updated weights for policy 0, policy_version 1733406 (0.0009) [2023-12-26 13:26:09,462][123091] Updated weights for policy 0, policy_version 1733416 (0.0009) [2023-12-26 13:26:09,754][123090] Updated weights for policy 1, policy_version 1721863 (0.0007) [2023-12-26 13:26:09,850][123090] Updated weights for policy 1, policy_version 1721873 (0.0007) [2023-12-26 13:26:09,919][123090] Updated weights for policy 1, policy_version 1721883 (0.0009) [2023-12-26 13:26:10,327][123091] Updated weights for policy 0, policy_version 1733426 (0.0010) [2023-12-26 13:26:10,390][123091] Updated weights for policy 0, policy_version 1733436 (0.0009) [2023-12-26 13:26:10,444][123091] Updated weights for policy 0, policy_version 1733446 (0.0010) [2023-12-26 13:26:10,497][123091] Updated weights for policy 0, policy_version 1733456 (0.0009) [2023-12-26 13:26:10,744][123090] Updated weights for policy 1, policy_version 1721893 (0.0010) [2023-12-26 13:26:10,810][123090] Updated weights for policy 1, policy_version 1721903 (0.0010) [2023-12-26 13:26:10,880][123090] Updated weights for policy 1, policy_version 1721913 (0.0009) [2023-12-26 13:26:11,283][123091] Updated weights for policy 0, policy_version 1733466 (0.0010) [2023-12-26 13:26:11,349][123091] Updated weights for policy 0, policy_version 1733476 (0.0009) [2023-12-26 13:26:11,426][123091] Updated weights for policy 0, policy_version 1733486 (0.0009) [2023-12-26 13:26:11,733][123090] Updated weights for policy 1, policy_version 1721923 (0.0009) [2023-12-26 13:26:11,799][123090] Updated weights for policy 1, policy_version 1721933 (0.0009) [2023-12-26 13:26:11,853][123090] Updated weights for policy 1, policy_version 1721943 (0.0008) [2023-12-26 13:26:12,244][123091] Updated weights for policy 0, policy_version 1733496 (0.0010) [2023-12-26 13:26:12,301][123091] Updated weights for policy 0, policy_version 1733506 (0.0009) [2023-12-26 13:26:12,368][123091] Updated weights for policy 0, policy_version 1733516 (0.0009) [2023-12-26 13:26:12,693][123090] Updated weights for policy 1, policy_version 1721953 (0.0009) [2023-12-26 13:26:12,748][123090] Updated weights for policy 1, policy_version 1721963 (0.0009) [2023-12-26 13:26:12,805][123090] Updated weights for policy 1, policy_version 1721973 (0.0008) [2023-12-26 13:26:12,856][123090] Updated weights for policy 1, policy_version 1721983 (0.0010) [2023-12-26 13:26:13,185][123091] Updated weights for policy 0, policy_version 1733526 (0.0007) [2023-12-26 13:26:13,246][123091] Updated weights for policy 0, policy_version 1733536 (0.0006) [2023-12-26 13:26:13,292][123091] Updated weights for policy 0, policy_version 1733546 (0.0005) [2023-12-26 13:26:13,646][123090] Updated weights for policy 1, policy_version 1721993 (0.0010) [2023-12-26 13:26:13,709][123090] Updated weights for policy 1, policy_version 1722003 (0.0010) [2023-12-26 13:26:13,775][123090] Updated weights for policy 1, policy_version 1722013 (0.0010) [2023-12-26 13:26:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 884621312. Throughput: 0: 8961.4, 1: 8906.9. Samples: 884619428. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:26:13,784][121949] Avg episode reward: [(0, '6022.212'), (1, '5703.216')] [2023-12-26 13:26:13,939][123091] Updated weights for policy 0, policy_version 1733556 (0.0005) [2023-12-26 13:26:13,989][123091] Updated weights for policy 0, policy_version 1733566 (0.0006) [2023-12-26 13:26:14,045][123091] Updated weights for policy 0, policy_version 1733576 (0.0005) [2023-12-26 13:26:14,527][123090] Updated weights for policy 1, policy_version 1722023 (0.0009) [2023-12-26 13:26:14,583][123090] Updated weights for policy 1, policy_version 1722033 (0.0008) [2023-12-26 13:26:14,643][123090] Updated weights for policy 1, policy_version 1722043 (0.0005) [2023-12-26 13:26:14,760][123091] Updated weights for policy 0, policy_version 1733586 (0.0006) [2023-12-26 13:26:14,830][123091] Updated weights for policy 0, policy_version 1733596 (0.0009) [2023-12-26 13:26:14,905][123091] Updated weights for policy 0, policy_version 1733606 (0.0009) [2023-12-26 13:26:14,974][123091] Updated weights for policy 0, policy_version 1733616 (0.0009) [2023-12-26 13:26:15,382][123090] Updated weights for policy 1, policy_version 1722053 (0.0008) [2023-12-26 13:26:15,438][123090] Updated weights for policy 1, policy_version 1722063 (0.0010) [2023-12-26 13:26:15,501][123090] Updated weights for policy 1, policy_version 1722073 (0.0010) [2023-12-26 13:26:15,792][123091] Updated weights for policy 0, policy_version 1733626 (0.0010) [2023-12-26 13:26:15,863][123091] Updated weights for policy 0, policy_version 1733636 (0.0011) [2023-12-26 13:26:15,931][123091] Updated weights for policy 0, policy_version 1733646 (0.0011) [2023-12-26 13:26:16,245][123090] Updated weights for policy 1, policy_version 1722083 (0.0009) [2023-12-26 13:26:16,304][123090] Updated weights for policy 1, policy_version 1722093 (0.0005) [2023-12-26 13:26:16,371][123090] Updated weights for policy 1, policy_version 1722103 (0.0006) [2023-12-26 13:26:16,736][123091] Updated weights for policy 0, policy_version 1733656 (0.0007) [2023-12-26 13:26:16,804][123091] Updated weights for policy 0, policy_version 1733666 (0.0007) [2023-12-26 13:26:16,863][123091] Updated weights for policy 0, policy_version 1733676 (0.0010) [2023-12-26 13:26:17,124][123090] Updated weights for policy 1, policy_version 1722113 (0.0006) [2023-12-26 13:26:17,173][123090] Updated weights for policy 1, policy_version 1722123 (0.0009) [2023-12-26 13:26:17,230][123090] Updated weights for policy 1, policy_version 1722133 (0.0009) [2023-12-26 13:26:17,283][123090] Updated weights for policy 1, policy_version 1722143 (0.0009) [2023-12-26 13:26:17,652][123091] Updated weights for policy 0, policy_version 1733686 (0.0010) [2023-12-26 13:26:17,709][123091] Updated weights for policy 0, policy_version 1733696 (0.0010) [2023-12-26 13:26:17,764][123091] Updated weights for policy 0, policy_version 1733706 (0.0010) [2023-12-26 13:26:18,029][123090] Updated weights for policy 1, policy_version 1722153 (0.0007) [2023-12-26 13:26:18,087][123090] Updated weights for policy 1, policy_version 1722163 (0.0006) [2023-12-26 13:26:18,147][123090] Updated weights for policy 1, policy_version 1722173 (0.0006) [2023-12-26 13:26:18,486][123091] Updated weights for policy 0, policy_version 1733716 (0.0008) [2023-12-26 13:26:18,555][123091] Updated weights for policy 0, policy_version 1733726 (0.0005) [2023-12-26 13:26:18,633][123091] Updated weights for policy 0, policy_version 1733736 (0.0008) [2023-12-26 13:26:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 884719616. Throughput: 0: 9083.5, 1: 8950.1. Samples: 884731228. Policy #0 lag: (min: 31.0, avg: 31.1, max: 37.0) [2023-12-26 13:26:18,784][121949] Avg episode reward: [(0, '6150.377'), (1, '5550.304')] [2023-12-26 13:26:18,865][123090] Updated weights for policy 1, policy_version 1722183 (0.0009) [2023-12-26 13:26:18,921][123090] Updated weights for policy 1, policy_version 1722193 (0.0010) [2023-12-26 13:26:18,977][123090] Updated weights for policy 1, policy_version 1722203 (0.0010) [2023-12-26 13:26:19,380][123091] Updated weights for policy 0, policy_version 1733746 (0.0007) [2023-12-26 13:26:19,443][123091] Updated weights for policy 0, policy_version 1733756 (0.0010) [2023-12-26 13:26:19,506][123091] Updated weights for policy 0, policy_version 1733766 (0.0010) [2023-12-26 13:26:19,571][123091] Updated weights for policy 0, policy_version 1733776 (0.0010) [2023-12-26 13:26:19,820][123090] Updated weights for policy 1, policy_version 1722213 (0.0010) [2023-12-26 13:26:19,884][123090] Updated weights for policy 1, policy_version 1722223 (0.0011) [2023-12-26 13:26:19,951][123090] Updated weights for policy 1, policy_version 1722233 (0.0008) [2023-12-26 13:26:20,401][123091] Updated weights for policy 0, policy_version 1733786 (0.0011) [2023-12-26 13:26:20,468][123091] Updated weights for policy 0, policy_version 1733796 (0.0011) [2023-12-26 13:26:20,534][123091] Updated weights for policy 0, policy_version 1733806 (0.0011) [2023-12-26 13:26:20,745][123090] Updated weights for policy 1, policy_version 1722243 (0.0008) [2023-12-26 13:26:20,820][123090] Updated weights for policy 1, policy_version 1722253 (0.0006) [2023-12-26 13:26:20,897][123090] Updated weights for policy 1, policy_version 1722263 (0.0005) [2023-12-26 13:26:21,368][123091] Updated weights for policy 0, policy_version 1733816 (0.0010) [2023-12-26 13:26:21,431][123091] Updated weights for policy 0, policy_version 1733826 (0.0009) [2023-12-26 13:26:21,480][123091] Updated weights for policy 0, policy_version 1733836 (0.0008) [2023-12-26 13:26:21,689][123090] Updated weights for policy 1, policy_version 1722273 (0.0006) [2023-12-26 13:26:21,749][123090] Updated weights for policy 1, policy_version 1722283 (0.0009) [2023-12-26 13:26:21,810][123090] Updated weights for policy 1, policy_version 1722293 (0.0006) [2023-12-26 13:26:21,883][123090] Updated weights for policy 1, policy_version 1722303 (0.0007) [2023-12-26 13:26:22,352][123091] Updated weights for policy 0, policy_version 1733846 (0.0010) [2023-12-26 13:26:22,414][123091] Updated weights for policy 0, policy_version 1733856 (0.0010) [2023-12-26 13:26:22,465][123091] Updated weights for policy 0, policy_version 1733866 (0.0010) [2023-12-26 13:26:22,745][123090] Updated weights for policy 1, policy_version 1722313 (0.0009) [2023-12-26 13:26:22,804][123090] Updated weights for policy 1, policy_version 1722323 (0.0009) [2023-12-26 13:26:22,861][123090] Updated weights for policy 1, policy_version 1722333 (0.0009) [2023-12-26 13:26:23,195][123091] Updated weights for policy 0, policy_version 1733876 (0.0008) [2023-12-26 13:26:23,250][123091] Updated weights for policy 0, policy_version 1733886 (0.0005) [2023-12-26 13:26:23,301][123091] Updated weights for policy 0, policy_version 1733896 (0.0005) [2023-12-26 13:26:23,761][123090] Updated weights for policy 1, policy_version 1722344 (0.0009) [2023-12-26 13:26:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.5, 300 sec: 17800.2). Total num frames: 884801536. Throughput: 0: 9078.2, 1: 8932.6. Samples: 884783224. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:23,784][121949] Avg episode reward: [(0, '6153.639'), (1, '5659.983')] [2023-12-26 13:26:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001733904_443883520.pth... [2023-12-26 13:26:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001732848_443613184.pth [2023-12-26 13:26:23,822][123090] Updated weights for policy 1, policy_version 1722354 (0.0007) [2023-12-26 13:26:23,874][123090] Updated weights for policy 1, policy_version 1722364 (0.0005) [2023-12-26 13:26:23,896][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001722368_440926208.pth... [2023-12-26 13:26:23,899][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001721312_440655872.pth [2023-12-26 13:26:24,009][123091] Updated weights for policy 0, policy_version 1733906 (0.0006) [2023-12-26 13:26:24,061][123091] Updated weights for policy 0, policy_version 1733916 (0.0009) [2023-12-26 13:26:24,127][123091] Updated weights for policy 0, policy_version 1733926 (0.0010) [2023-12-26 13:26:24,188][123091] Updated weights for policy 0, policy_version 1733936 (0.0009) [2023-12-26 13:26:24,699][123090] Updated weights for policy 1, policy_version 1722374 (0.0007) [2023-12-26 13:26:24,768][123090] Updated weights for policy 1, policy_version 1722384 (0.0010) [2023-12-26 13:26:24,829][123090] Updated weights for policy 1, policy_version 1722394 (0.0009) [2023-12-26 13:26:25,004][123091] Updated weights for policy 0, policy_version 1733946 (0.0010) [2023-12-26 13:26:25,051][123091] Updated weights for policy 0, policy_version 1733956 (0.0009) [2023-12-26 13:26:25,108][123091] Updated weights for policy 0, policy_version 1733966 (0.0009) [2023-12-26 13:26:25,702][123090] Updated weights for policy 1, policy_version 1722405 (0.0010) [2023-12-26 13:26:25,750][123090] Updated weights for policy 1, policy_version 1722415 (0.0009) [2023-12-26 13:26:25,797][123090] Updated weights for policy 1, policy_version 1722425 (0.0009) [2023-12-26 13:26:25,858][123091] Updated weights for policy 0, policy_version 1733976 (0.0009) [2023-12-26 13:26:25,912][123091] Updated weights for policy 0, policy_version 1733986 (0.0009) [2023-12-26 13:26:25,964][123091] Updated weights for policy 0, policy_version 1733997 (0.0010) [2023-12-26 13:26:26,625][123090] Updated weights for policy 1, policy_version 1722435 (0.0009) [2023-12-26 13:26:26,681][123090] Updated weights for policy 1, policy_version 1722446 (0.0010) [2023-12-26 13:26:26,732][123090] Updated weights for policy 1, policy_version 1722456 (0.0008) [2023-12-26 13:26:26,733][123091] Updated weights for policy 0, policy_version 1734007 (0.0007) [2023-12-26 13:26:26,794][123091] Updated weights for policy 0, policy_version 1734017 (0.0005) [2023-12-26 13:26:26,856][123091] Updated weights for policy 0, policy_version 1734027 (0.0005) [2023-12-26 13:26:27,494][123090] Updated weights for policy 1, policy_version 1722466 (0.0007) [2023-12-26 13:26:27,543][123090] Updated weights for policy 1, policy_version 1722476 (0.0005) [2023-12-26 13:26:27,561][123091] Updated weights for policy 0, policy_version 1734037 (0.0007) [2023-12-26 13:26:27,602][123090] Updated weights for policy 1, policy_version 1722486 (0.0005) [2023-12-26 13:26:27,626][123091] Updated weights for policy 0, policy_version 1734047 (0.0009) [2023-12-26 13:26:27,660][123090] Updated weights for policy 1, policy_version 1722496 (0.0006) [2023-12-26 13:26:27,683][123091] Updated weights for policy 0, policy_version 1734057 (0.0008) [2023-12-26 13:26:28,266][123090] Updated weights for policy 1, policy_version 1722506 (0.0006) [2023-12-26 13:26:28,318][123090] Updated weights for policy 1, policy_version 1722516 (0.0006) [2023-12-26 13:26:28,386][123090] Updated weights for policy 1, policy_version 1722526 (0.0007) [2023-12-26 13:26:28,549][123091] Updated weights for policy 0, policy_version 1734067 (0.0009) [2023-12-26 13:26:28,607][123091] Updated weights for policy 0, policy_version 1734077 (0.0010) [2023-12-26 13:26:28,660][123091] Updated weights for policy 0, policy_version 1734087 (0.0010) [2023-12-26 13:26:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 884899840. Throughput: 0: 9108.2, 1: 8942.3. Samples: 884890168. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:28,785][121949] Avg episode reward: [(0, '6080.980'), (1, '5673.572')] [2023-12-26 13:26:29,041][123090] Updated weights for policy 1, policy_version 1722536 (0.0006) [2023-12-26 13:26:29,103][123090] Updated weights for policy 1, policy_version 1722546 (0.0006) [2023-12-26 13:26:29,167][123090] Updated weights for policy 1, policy_version 1722556 (0.0006) [2023-12-26 13:26:29,463][123091] Updated weights for policy 0, policy_version 1734098 (0.0010) [2023-12-26 13:26:29,522][123091] Updated weights for policy 0, policy_version 1734108 (0.0010) [2023-12-26 13:26:29,580][123091] Updated weights for policy 0, policy_version 1734118 (0.0008) [2023-12-26 13:26:29,639][123091] Updated weights for policy 0, policy_version 1734128 (0.0010) [2023-12-26 13:26:29,946][123090] Updated weights for policy 1, policy_version 1722566 (0.0009) [2023-12-26 13:26:30,013][123090] Updated weights for policy 1, policy_version 1722576 (0.0011) [2023-12-26 13:26:30,075][123090] Updated weights for policy 1, policy_version 1722586 (0.0010) [2023-12-26 13:26:30,449][123091] Updated weights for policy 0, policy_version 1734138 (0.0011) [2023-12-26 13:26:30,511][123091] Updated weights for policy 0, policy_version 1734148 (0.0011) [2023-12-26 13:26:30,573][123091] Updated weights for policy 0, policy_version 1734158 (0.0010) [2023-12-26 13:26:30,743][123090] Updated weights for policy 1, policy_version 1722596 (0.0008) [2023-12-26 13:26:30,790][123090] Updated weights for policy 1, policy_version 1722606 (0.0007) [2023-12-26 13:26:30,843][123090] Updated weights for policy 1, policy_version 1722616 (0.0005) [2023-12-26 13:26:31,292][123091] Updated weights for policy 0, policy_version 1734168 (0.0010) [2023-12-26 13:26:31,352][123091] Updated weights for policy 0, policy_version 1734178 (0.0009) [2023-12-26 13:26:31,419][123091] Updated weights for policy 0, policy_version 1734188 (0.0007) [2023-12-26 13:26:31,669][123090] Updated weights for policy 1, policy_version 1722626 (0.0006) [2023-12-26 13:26:31,743][123090] Updated weights for policy 1, policy_version 1722636 (0.0009) [2023-12-26 13:26:31,799][123090] Updated weights for policy 1, policy_version 1722646 (0.0009) [2023-12-26 13:26:31,866][123090] Updated weights for policy 1, policy_version 1722656 (0.0010) [2023-12-26 13:26:32,199][123091] Updated weights for policy 0, policy_version 1734198 (0.0008) [2023-12-26 13:26:32,248][123091] Updated weights for policy 0, policy_version 1734208 (0.0009) [2023-12-26 13:26:32,309][123091] Updated weights for policy 0, policy_version 1734218 (0.0009) [2023-12-26 13:26:32,688][123090] Updated weights for policy 1, policy_version 1722666 (0.0009) [2023-12-26 13:26:32,746][123090] Updated weights for policy 1, policy_version 1722676 (0.0009) [2023-12-26 13:26:32,800][123090] Updated weights for policy 1, policy_version 1722686 (0.0009) [2023-12-26 13:26:33,171][123091] Updated weights for policy 0, policy_version 1734228 (0.0010) [2023-12-26 13:26:33,218][123091] Updated weights for policy 0, policy_version 1734238 (0.0009) [2023-12-26 13:26:33,265][123091] Updated weights for policy 0, policy_version 1734248 (0.0009) [2023-12-26 13:26:33,637][123090] Updated weights for policy 1, policy_version 1722696 (0.0009) [2023-12-26 13:26:33,695][123090] Updated weights for policy 1, policy_version 1722706 (0.0008) [2023-12-26 13:26:33,748][123090] Updated weights for policy 1, policy_version 1722716 (0.0009) [2023-12-26 13:26:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 884989952. Throughput: 0: 8943.8, 1: 8911.9. Samples: 884997752. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:33,785][121949] Avg episode reward: [(0, '6049.759'), (1, '5555.717')] [2023-12-26 13:26:34,122][123091] Updated weights for policy 0, policy_version 1734259 (0.0009) [2023-12-26 13:26:34,185][123091] Updated weights for policy 0, policy_version 1734269 (0.0009) [2023-12-26 13:26:34,243][123091] Updated weights for policy 0, policy_version 1734279 (0.0010) [2023-12-26 13:26:34,554][123090] Updated weights for policy 1, policy_version 1722726 (0.0007) [2023-12-26 13:26:34,628][123090] Updated weights for policy 1, policy_version 1722736 (0.0006) [2023-12-26 13:26:34,693][123090] Updated weights for policy 1, policy_version 1722746 (0.0006) [2023-12-26 13:26:35,139][123091] Updated weights for policy 0, policy_version 1734289 (0.0009) [2023-12-26 13:26:35,195][123091] Updated weights for policy 0, policy_version 1734299 (0.0005) [2023-12-26 13:26:35,251][123091] Updated weights for policy 0, policy_version 1734309 (0.0007) [2023-12-26 13:26:35,296][123090] Updated weights for policy 1, policy_version 1722756 (0.0006) [2023-12-26 13:26:35,304][123091] Updated weights for policy 0, policy_version 1734319 (0.0005) [2023-12-26 13:26:35,352][123090] Updated weights for policy 1, policy_version 1722766 (0.0009) [2023-12-26 13:26:35,406][123090] Updated weights for policy 1, policy_version 1722776 (0.0010) [2023-12-26 13:26:36,003][123091] Updated weights for policy 0, policy_version 1734329 (0.0006) [2023-12-26 13:26:36,052][123091] Updated weights for policy 0, policy_version 1734339 (0.0006) [2023-12-26 13:26:36,120][123091] Updated weights for policy 0, policy_version 1734349 (0.0007) [2023-12-26 13:26:36,211][123090] Updated weights for policy 1, policy_version 1722786 (0.0010) [2023-12-26 13:26:36,271][123090] Updated weights for policy 1, policy_version 1722796 (0.0010) [2023-12-26 13:26:36,339][123090] Updated weights for policy 1, policy_version 1722806 (0.0011) [2023-12-26 13:26:36,400][123090] Updated weights for policy 1, policy_version 1722816 (0.0011) [2023-12-26 13:26:36,897][123091] Updated weights for policy 0, policy_version 1734359 (0.0010) [2023-12-26 13:26:36,952][123091] Updated weights for policy 0, policy_version 1734369 (0.0010) [2023-12-26 13:26:37,006][123091] Updated weights for policy 0, policy_version 1734379 (0.0009) [2023-12-26 13:26:37,192][123090] Updated weights for policy 1, policy_version 1722826 (0.0005) [2023-12-26 13:26:37,246][123090] Updated weights for policy 1, policy_version 1722836 (0.0005) [2023-12-26 13:26:37,307][123090] Updated weights for policy 1, policy_version 1722846 (0.0005) [2023-12-26 13:26:37,930][123091] Updated weights for policy 0, policy_version 1734389 (0.0010) [2023-12-26 13:26:37,994][123091] Updated weights for policy 0, policy_version 1734399 (0.0011) [2023-12-26 13:26:38,027][123090] Updated weights for policy 1, policy_version 1722856 (0.0006) [2023-12-26 13:26:38,050][123091] Updated weights for policy 0, policy_version 1734409 (0.0011) [2023-12-26 13:26:38,083][123090] Updated weights for policy 1, policy_version 1722866 (0.0006) [2023-12-26 13:26:38,152][123090] Updated weights for policy 1, policy_version 1722876 (0.0006) [2023-12-26 13:26:38,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 885071872. Throughput: 0: 8973.0, 1: 8932.8. Samples: 885052612. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:38,785][121949] Avg episode reward: [(0, '6134.085'), (1, '5696.439')] [2023-12-26 13:26:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001722880_441057280.pth... [2023-12-26 13:26:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001734416_444014592.pth... [2023-12-26 13:26:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001721856_440795136.pth [2023-12-26 13:26:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001733392_443752448.pth [2023-12-26 13:26:38,872][123091] Updated weights for policy 0, policy_version 1734419 (0.0011) [2023-12-26 13:26:38,898][123090] Updated weights for policy 1, policy_version 1722886 (0.0008) [2023-12-26 13:26:38,928][123091] Updated weights for policy 0, policy_version 1734429 (0.0011) [2023-12-26 13:26:38,954][123090] Updated weights for policy 1, policy_version 1722896 (0.0009) [2023-12-26 13:26:38,989][123091] Updated weights for policy 0, policy_version 1734439 (0.0010) [2023-12-26 13:26:39,006][123090] Updated weights for policy 1, policy_version 1722906 (0.0009) [2023-12-26 13:26:39,818][123090] Updated weights for policy 1, policy_version 1722916 (0.0009) [2023-12-26 13:26:39,885][123091] Updated weights for policy 0, policy_version 1734449 (0.0008) [2023-12-26 13:26:39,888][123090] Updated weights for policy 1, policy_version 1722926 (0.0010) [2023-12-26 13:26:39,957][123091] Updated weights for policy 0, policy_version 1734459 (0.0010) [2023-12-26 13:26:39,958][123090] Updated weights for policy 1, policy_version 1722936 (0.0009) [2023-12-26 13:26:40,018][123091] Updated weights for policy 0, policy_version 1734469 (0.0007) [2023-12-26 13:26:40,079][123091] Updated weights for policy 0, policy_version 1734479 (0.0007) [2023-12-26 13:26:40,806][123090] Updated weights for policy 1, policy_version 1722946 (0.0009) [2023-12-26 13:26:40,866][123090] Updated weights for policy 1, policy_version 1722956 (0.0008) [2023-12-26 13:26:40,871][123091] Updated weights for policy 0, policy_version 1734489 (0.0010) [2023-12-26 13:26:40,922][123091] Updated weights for policy 0, policy_version 1734499 (0.0009) [2023-12-26 13:26:40,931][123090] Updated weights for policy 1, policy_version 1722966 (0.0008) [2023-12-26 13:26:40,979][123091] Updated weights for policy 0, policy_version 1734509 (0.0007) [2023-12-26 13:26:40,993][123090] Updated weights for policy 1, policy_version 1722976 (0.0008) [2023-12-26 13:26:41,850][123090] Updated weights for policy 1, policy_version 1722986 (0.0008) [2023-12-26 13:26:41,857][123091] Updated weights for policy 0, policy_version 1734519 (0.0008) [2023-12-26 13:26:41,919][123090] Updated weights for policy 1, policy_version 1722996 (0.0008) [2023-12-26 13:26:41,925][123091] Updated weights for policy 0, policy_version 1734529 (0.0008) [2023-12-26 13:26:41,985][123090] Updated weights for policy 1, policy_version 1723006 (0.0007) [2023-12-26 13:26:41,989][123091] Updated weights for policy 0, policy_version 1734539 (0.0008) [2023-12-26 13:26:42,807][123091] Updated weights for policy 0, policy_version 1734549 (0.0010) [2023-12-26 13:26:42,819][123090] Updated weights for policy 1, policy_version 1723016 (0.0007) [2023-12-26 13:26:42,871][123091] Updated weights for policy 0, policy_version 1734559 (0.0006) [2023-12-26 13:26:42,874][123090] Updated weights for policy 1, policy_version 1723026 (0.0008) [2023-12-26 13:26:42,938][123091] Updated weights for policy 0, policy_version 1734569 (0.0010) [2023-12-26 13:26:42,942][123090] Updated weights for policy 1, policy_version 1723036 (0.0007) [2023-12-26 13:26:43,751][123090] Updated weights for policy 1, policy_version 1723046 (0.0009) [2023-12-26 13:26:43,756][123091] Updated weights for policy 0, policy_version 1734579 (0.0009) [2023-12-26 13:26:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 885153792. Throughput: 0: 8863.6, 1: 8818.7. Samples: 885154600. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:43,784][121949] Avg episode reward: [(0, '6071.445'), (1, '5811.152')] [2023-12-26 13:26:43,800][123091] Updated weights for policy 0, policy_version 1734589 (0.0008) [2023-12-26 13:26:43,802][123090] Updated weights for policy 1, policy_version 1723056 (0.0009) [2023-12-26 13:26:43,847][123091] Updated weights for policy 0, policy_version 1734599 (0.0008) [2023-12-26 13:26:43,853][123090] Updated weights for policy 1, policy_version 1723066 (0.0011) [2023-12-26 13:26:44,703][123091] Updated weights for policy 0, policy_version 1734609 (0.0008) [2023-12-26 13:26:44,709][123090] Updated weights for policy 1, policy_version 1723076 (0.0008) [2023-12-26 13:26:44,748][123091] Updated weights for policy 0, policy_version 1734619 (0.0008) [2023-12-26 13:26:44,771][123090] Updated weights for policy 1, policy_version 1723086 (0.0007) [2023-12-26 13:26:44,818][123091] Updated weights for policy 0, policy_version 1734629 (0.0009) [2023-12-26 13:26:44,839][123090] Updated weights for policy 1, policy_version 1723096 (0.0008) [2023-12-26 13:26:44,884][123091] Updated weights for policy 0, policy_version 1734639 (0.0006) [2023-12-26 13:26:45,636][123091] Updated weights for policy 0, policy_version 1734649 (0.0010) [2023-12-26 13:26:45,663][123090] Updated weights for policy 1, policy_version 1723106 (0.0009) [2023-12-26 13:26:45,700][123091] Updated weights for policy 0, policy_version 1734659 (0.0011) [2023-12-26 13:26:45,720][123090] Updated weights for policy 1, policy_version 1723116 (0.0007) [2023-12-26 13:26:45,752][123091] Updated weights for policy 0, policy_version 1734669 (0.0010) [2023-12-26 13:26:45,777][123090] Updated weights for policy 1, policy_version 1723126 (0.0006) [2023-12-26 13:26:45,838][123090] Updated weights for policy 1, policy_version 1723136 (0.0009) [2023-12-26 13:26:46,489][123091] Updated weights for policy 0, policy_version 1734679 (0.0008) [2023-12-26 13:26:46,553][123091] Updated weights for policy 0, policy_version 1734689 (0.0006) [2023-12-26 13:26:46,605][123091] Updated weights for policy 0, policy_version 1734699 (0.0010) [2023-12-26 13:26:46,745][123090] Updated weights for policy 1, policy_version 1723146 (0.0009) [2023-12-26 13:26:46,804][123090] Updated weights for policy 1, policy_version 1723156 (0.0008) [2023-12-26 13:26:46,867][123090] Updated weights for policy 1, policy_version 1723166 (0.0009) [2023-12-26 13:26:47,421][123091] Updated weights for policy 0, policy_version 1734709 (0.0008) [2023-12-26 13:26:47,471][123091] Updated weights for policy 0, policy_version 1734719 (0.0005) [2023-12-26 13:26:47,522][123091] Updated weights for policy 0, policy_version 1734729 (0.0005) [2023-12-26 13:26:47,722][123090] Updated weights for policy 1, policy_version 1723176 (0.0010) [2023-12-26 13:26:47,783][123090] Updated weights for policy 1, policy_version 1723186 (0.0009) [2023-12-26 13:26:47,839][123090] Updated weights for policy 1, policy_version 1723196 (0.0009) [2023-12-26 13:26:48,118][123091] Updated weights for policy 0, policy_version 1734739 (0.0007) [2023-12-26 13:26:48,169][123091] Updated weights for policy 0, policy_version 1734749 (0.0010) [2023-12-26 13:26:48,238][123091] Updated weights for policy 0, policy_version 1734759 (0.0011) [2023-12-26 13:26:48,749][123090] Updated weights for policy 1, policy_version 1723206 (0.0008) [2023-12-26 13:26:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 885243904. Throughput: 0: 8878.0, 1: 8749.9. Samples: 885258920. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:48,784][121949] Avg episode reward: [(0, '6086.792'), (1, '5781.840')] [2023-12-26 13:26:48,812][123090] Updated weights for policy 1, policy_version 1723216 (0.0006) [2023-12-26 13:26:48,892][123090] Updated weights for policy 1, policy_version 1723226 (0.0005) [2023-12-26 13:26:48,957][123091] Updated weights for policy 0, policy_version 1734769 (0.0011) [2023-12-26 13:26:49,009][123091] Updated weights for policy 0, policy_version 1734779 (0.0010) [2023-12-26 13:26:49,072][123091] Updated weights for policy 0, policy_version 1734789 (0.0011) [2023-12-26 13:26:49,131][123091] Updated weights for policy 0, policy_version 1734799 (0.0011) [2023-12-26 13:26:49,649][123090] Updated weights for policy 1, policy_version 1723236 (0.0006) [2023-12-26 13:26:49,709][123090] Updated weights for policy 1, policy_version 1723246 (0.0006) [2023-12-26 13:26:49,766][123090] Updated weights for policy 1, policy_version 1723256 (0.0006) [2023-12-26 13:26:49,935][123091] Updated weights for policy 0, policy_version 1734809 (0.0010) [2023-12-26 13:26:50,000][123091] Updated weights for policy 0, policy_version 1734819 (0.0010) [2023-12-26 13:26:50,059][123091] Updated weights for policy 0, policy_version 1734829 (0.0006) [2023-12-26 13:26:50,582][123090] Updated weights for policy 1, policy_version 1723266 (0.0008) [2023-12-26 13:26:50,650][123090] Updated weights for policy 1, policy_version 1723276 (0.0009) [2023-12-26 13:26:50,714][123090] Updated weights for policy 1, policy_version 1723286 (0.0009) [2023-12-26 13:26:50,772][123090] Updated weights for policy 1, policy_version 1723296 (0.0009) [2023-12-26 13:26:50,858][123091] Updated weights for policy 0, policy_version 1734839 (0.0007) [2023-12-26 13:26:50,918][123091] Updated weights for policy 0, policy_version 1734849 (0.0005) [2023-12-26 13:26:50,978][123091] Updated weights for policy 0, policy_version 1734859 (0.0006) [2023-12-26 13:26:51,672][123090] Updated weights for policy 1, policy_version 1723306 (0.0009) [2023-12-26 13:26:51,749][123090] Updated weights for policy 1, policy_version 1723316 (0.0009) [2023-12-26 13:26:51,798][123091] Updated weights for policy 0, policy_version 1734869 (0.0007) [2023-12-26 13:26:51,808][123090] Updated weights for policy 1, policy_version 1723326 (0.0010) [2023-12-26 13:26:51,865][123091] Updated weights for policy 0, policy_version 1734879 (0.0008) [2023-12-26 13:26:51,917][123091] Updated weights for policy 0, policy_version 1734889 (0.0010) [2023-12-26 13:26:52,630][123090] Updated weights for policy 1, policy_version 1723336 (0.0010) [2023-12-26 13:26:52,682][123090] Updated weights for policy 1, policy_version 1723346 (0.0009) [2023-12-26 13:26:52,750][123090] Updated weights for policy 1, policy_version 1723356 (0.0010) [2023-12-26 13:26:52,764][123091] Updated weights for policy 0, policy_version 1734900 (0.0009) [2023-12-26 13:26:52,812][123091] Updated weights for policy 0, policy_version 1734910 (0.0009) [2023-12-26 13:26:52,866][123091] Updated weights for policy 0, policy_version 1734920 (0.0009) [2023-12-26 13:26:53,577][123090] Updated weights for policy 1, policy_version 1723366 (0.0010) [2023-12-26 13:26:53,632][123090] Updated weights for policy 1, policy_version 1723376 (0.0008) [2023-12-26 13:26:53,680][123090] Updated weights for policy 1, policy_version 1723386 (0.0009) [2023-12-26 13:26:53,711][123091] Updated weights for policy 0, policy_version 1734930 (0.0010) [2023-12-26 13:26:53,770][123091] Updated weights for policy 0, policy_version 1734940 (0.0009) [2023-12-26 13:26:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 885334016. Throughput: 0: 8871.7, 1: 8769.4. Samples: 885311772. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:53,785][121949] Avg episode reward: [(0, '6051.009'), (1, '5653.913')] [2023-12-26 13:26:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001723392_441188352.pth... [2023-12-26 13:26:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001722368_440926208.pth [2023-12-26 13:26:53,830][123091] Updated weights for policy 0, policy_version 1734950 (0.0009) [2023-12-26 13:26:53,876][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001734960_444153856.pth... [2023-12-26 13:26:53,878][123091] Updated weights for policy 0, policy_version 1734960 (0.0008) [2023-12-26 13:26:53,879][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001733904_443883520.pth [2023-12-26 13:26:54,544][123090] Updated weights for policy 1, policy_version 1723396 (0.0008) [2023-12-26 13:26:54,611][123090] Updated weights for policy 1, policy_version 1723406 (0.0008) [2023-12-26 13:26:54,670][123090] Updated weights for policy 1, policy_version 1723416 (0.0008) [2023-12-26 13:26:54,718][123091] Updated weights for policy 0, policy_version 1734970 (0.0008) [2023-12-26 13:26:54,765][123091] Updated weights for policy 0, policy_version 1734980 (0.0009) [2023-12-26 13:26:54,832][123091] Updated weights for policy 0, policy_version 1734990 (0.0009) [2023-12-26 13:26:55,470][123090] Updated weights for policy 1, policy_version 1723426 (0.0008) [2023-12-26 13:26:55,535][123090] Updated weights for policy 1, policy_version 1723436 (0.0005) [2023-12-26 13:26:55,601][123090] Updated weights for policy 1, policy_version 1723446 (0.0008) [2023-12-26 13:26:55,664][123090] Updated weights for policy 1, policy_version 1723456 (0.0011) [2023-12-26 13:26:55,701][123091] Updated weights for policy 0, policy_version 1735000 (0.0008) [2023-12-26 13:26:55,764][123091] Updated weights for policy 0, policy_version 1735010 (0.0008) [2023-12-26 13:26:55,824][123091] Updated weights for policy 0, policy_version 1735020 (0.0009) [2023-12-26 13:26:56,366][123090] Updated weights for policy 1, policy_version 1723466 (0.0005) [2023-12-26 13:26:56,421][123090] Updated weights for policy 1, policy_version 1723476 (0.0006) [2023-12-26 13:26:56,478][123090] Updated weights for policy 1, policy_version 1723486 (0.0010) [2023-12-26 13:26:56,695][123091] Updated weights for policy 0, policy_version 1735030 (0.0009) [2023-12-26 13:26:56,765][123091] Updated weights for policy 0, policy_version 1735040 (0.0010) [2023-12-26 13:26:56,820][123091] Updated weights for policy 0, policy_version 1735050 (0.0010) [2023-12-26 13:26:57,225][123090] Updated weights for policy 1, policy_version 1723496 (0.0010) [2023-12-26 13:26:57,284][123090] Updated weights for policy 1, policy_version 1723506 (0.0009) [2023-12-26 13:26:57,350][123090] Updated weights for policy 1, policy_version 1723516 (0.0010) [2023-12-26 13:26:57,663][123091] Updated weights for policy 0, policy_version 1735060 (0.0010) [2023-12-26 13:26:57,721][123091] Updated weights for policy 0, policy_version 1735070 (0.0008) [2023-12-26 13:26:57,782][123091] Updated weights for policy 0, policy_version 1735080 (0.0009) [2023-12-26 13:26:58,177][123090] Updated weights for policy 1, policy_version 1723526 (0.0010) [2023-12-26 13:26:58,244][123090] Updated weights for policy 1, policy_version 1723536 (0.0010) [2023-12-26 13:26:58,310][123090] Updated weights for policy 1, policy_version 1723546 (0.0009) [2023-12-26 13:26:58,647][123091] Updated weights for policy 0, policy_version 1735090 (0.0008) [2023-12-26 13:26:58,709][123091] Updated weights for policy 0, policy_version 1735100 (0.0010) [2023-12-26 13:26:58,782][123091] Updated weights for policy 0, policy_version 1735110 (0.0008) [2023-12-26 13:26:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 885415936. Throughput: 0: 8843.3, 1: 8824.1. Samples: 885414460. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:26:58,785][121949] Avg episode reward: [(0, '6041.659'), (1, '5604.810')] [2023-12-26 13:26:58,846][123091] Updated weights for policy 0, policy_version 1735120 (0.0009) [2023-12-26 13:26:59,099][123090] Updated weights for policy 1, policy_version 1723556 (0.0008) [2023-12-26 13:26:59,147][123090] Updated weights for policy 1, policy_version 1723566 (0.0005) [2023-12-26 13:26:59,193][123090] Updated weights for policy 1, policy_version 1723576 (0.0005) [2023-12-26 13:26:59,734][123091] Updated weights for policy 0, policy_version 1735130 (0.0010) [2023-12-26 13:26:59,798][123091] Updated weights for policy 0, policy_version 1735140 (0.0009) [2023-12-26 13:26:59,859][123091] Updated weights for policy 0, policy_version 1735150 (0.0009) [2023-12-26 13:27:00,020][123090] Updated weights for policy 1, policy_version 1723586 (0.0007) [2023-12-26 13:27:00,080][123090] Updated weights for policy 1, policy_version 1723596 (0.0009) [2023-12-26 13:27:00,129][123090] Updated weights for policy 1, policy_version 1723606 (0.0009) [2023-12-26 13:27:00,185][123090] Updated weights for policy 1, policy_version 1723616 (0.0009) [2023-12-26 13:27:00,752][123091] Updated weights for policy 0, policy_version 1735160 (0.0009) [2023-12-26 13:27:00,803][123091] Updated weights for policy 0, policy_version 1735170 (0.0009) [2023-12-26 13:27:00,860][123091] Updated weights for policy 0, policy_version 1735180 (0.0008) [2023-12-26 13:27:01,039][123090] Updated weights for policy 1, policy_version 1723626 (0.0008) [2023-12-26 13:27:01,108][123090] Updated weights for policy 1, policy_version 1723636 (0.0007) [2023-12-26 13:27:01,184][123090] Updated weights for policy 1, policy_version 1723646 (0.0008) [2023-12-26 13:27:01,677][123091] Updated weights for policy 0, policy_version 1735190 (0.0007) [2023-12-26 13:27:01,742][123091] Updated weights for policy 0, policy_version 1735200 (0.0010) [2023-12-26 13:27:01,801][123091] Updated weights for policy 0, policy_version 1735210 (0.0009) [2023-12-26 13:27:01,929][123090] Updated weights for policy 1, policy_version 1723656 (0.0008) [2023-12-26 13:27:01,978][123090] Updated weights for policy 1, policy_version 1723666 (0.0007) [2023-12-26 13:27:02,024][123090] Updated weights for policy 1, policy_version 1723676 (0.0005) [2023-12-26 13:27:02,659][123091] Updated weights for policy 0, policy_version 1735220 (0.0009) [2023-12-26 13:27:02,721][123091] Updated weights for policy 0, policy_version 1735230 (0.0010) [2023-12-26 13:27:02,772][123091] Updated weights for policy 0, policy_version 1735240 (0.0010) [2023-12-26 13:27:02,858][123090] Updated weights for policy 1, policy_version 1723686 (0.0008) [2023-12-26 13:27:02,909][123090] Updated weights for policy 1, policy_version 1723696 (0.0008) [2023-12-26 13:27:02,959][123090] Updated weights for policy 1, policy_version 1723706 (0.0009) [2023-12-26 13:27:03,502][123091] Updated weights for policy 0, policy_version 1735250 (0.0008) [2023-12-26 13:27:03,550][123091] Updated weights for policy 0, policy_version 1735260 (0.0005) [2023-12-26 13:27:03,614][123091] Updated weights for policy 0, policy_version 1735270 (0.0005) [2023-12-26 13:27:03,671][123091] Updated weights for policy 0, policy_version 1735280 (0.0006) [2023-12-26 13:27:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 885506048. Throughput: 0: 8722.6, 1: 8749.3. Samples: 885517468. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:03,785][121949] Avg episode reward: [(0, '5781.663'), (1, '5862.636')] [2023-12-26 13:27:03,865][123090] Updated weights for policy 1, policy_version 1723716 (0.0010) [2023-12-26 13:27:03,918][123090] Updated weights for policy 1, policy_version 1723726 (0.0010) [2023-12-26 13:27:03,972][123090] Updated weights for policy 1, policy_version 1723736 (0.0010) [2023-12-26 13:27:04,428][123091] Updated weights for policy 0, policy_version 1735290 (0.0005) [2023-12-26 13:27:04,496][123091] Updated weights for policy 0, policy_version 1735300 (0.0006) [2023-12-26 13:27:04,568][123091] Updated weights for policy 0, policy_version 1735310 (0.0008) [2023-12-26 13:27:04,795][123090] Updated weights for policy 1, policy_version 1723746 (0.0011) [2023-12-26 13:27:04,848][123090] Updated weights for policy 1, policy_version 1723757 (0.0009) [2023-12-26 13:27:04,896][123090] Updated weights for policy 1, policy_version 1723767 (0.0008) [2023-12-26 13:27:05,257][123091] Updated weights for policy 0, policy_version 1735320 (0.0005) [2023-12-26 13:27:05,324][123091] Updated weights for policy 0, policy_version 1735330 (0.0005) [2023-12-26 13:27:05,396][123091] Updated weights for policy 0, policy_version 1735340 (0.0006) [2023-12-26 13:27:05,693][123090] Updated weights for policy 1, policy_version 1723777 (0.0009) [2023-12-26 13:27:05,748][123090] Updated weights for policy 1, policy_version 1723787 (0.0010) [2023-12-26 13:27:05,806][123090] Updated weights for policy 1, policy_version 1723797 (0.0005) [2023-12-26 13:27:05,858][123090] Updated weights for policy 1, policy_version 1723807 (0.0005) [2023-12-26 13:27:06,132][123091] Updated weights for policy 0, policy_version 1735350 (0.0009) [2023-12-26 13:27:06,204][123091] Updated weights for policy 0, policy_version 1735360 (0.0010) [2023-12-26 13:27:06,277][123091] Updated weights for policy 0, policy_version 1735370 (0.0010) [2023-12-26 13:27:06,562][123090] Updated weights for policy 1, policy_version 1723817 (0.0006) [2023-12-26 13:27:06,629][123090] Updated weights for policy 1, policy_version 1723827 (0.0007) [2023-12-26 13:27:06,699][123090] Updated weights for policy 1, policy_version 1723837 (0.0006) [2023-12-26 13:27:07,130][123091] Updated weights for policy 0, policy_version 1735380 (0.0011) [2023-12-26 13:27:07,182][123091] Updated weights for policy 0, policy_version 1735390 (0.0009) [2023-12-26 13:27:07,243][123091] Updated weights for policy 0, policy_version 1735400 (0.0010) [2023-12-26 13:27:07,398][123090] Updated weights for policy 1, policy_version 1723847 (0.0008) [2023-12-26 13:27:07,462][123090] Updated weights for policy 1, policy_version 1723857 (0.0010) [2023-12-26 13:27:07,525][123090] Updated weights for policy 1, policy_version 1723867 (0.0010) [2023-12-26 13:27:08,085][123091] Updated weights for policy 0, policy_version 1735410 (0.0010) [2023-12-26 13:27:08,143][123091] Updated weights for policy 0, policy_version 1735420 (0.0009) [2023-12-26 13:27:08,192][123091] Updated weights for policy 0, policy_version 1735430 (0.0009) [2023-12-26 13:27:08,242][123091] Updated weights for policy 0, policy_version 1735440 (0.0009) [2023-12-26 13:27:08,350][123090] Updated weights for policy 1, policy_version 1723877 (0.0009) [2023-12-26 13:27:08,416][123090] Updated weights for policy 1, policy_version 1723887 (0.0010) [2023-12-26 13:27:08,484][123090] Updated weights for policy 1, policy_version 1723897 (0.0010) [2023-12-26 13:27:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 885596160. Throughput: 0: 8750.6, 1: 8767.2. Samples: 885571524. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:08,785][121949] Avg episode reward: [(0, '5771.277'), (1, '6017.734')] [2023-12-26 13:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001723904_441319424.pth... [2023-12-26 13:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001735440_444276736.pth... [2023-12-26 13:27:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001722880_441057280.pth [2023-12-26 13:27:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001734416_444014592.pth [2023-12-26 13:27:09,108][123091] Updated weights for policy 0, policy_version 1735450 (0.0009) [2023-12-26 13:27:09,164][123091] Updated weights for policy 0, policy_version 1735460 (0.0009) [2023-12-26 13:27:09,215][123091] Updated weights for policy 0, policy_version 1735471 (0.0009) [2023-12-26 13:27:09,314][123090] Updated weights for policy 1, policy_version 1723907 (0.0009) [2023-12-26 13:27:09,397][123090] Updated weights for policy 1, policy_version 1723917 (0.0010) [2023-12-26 13:27:09,470][123090] Updated weights for policy 1, policy_version 1723927 (0.0009) [2023-12-26 13:27:10,067][123091] Updated weights for policy 0, policy_version 1735481 (0.0010) [2023-12-26 13:27:10,137][123091] Updated weights for policy 0, policy_version 1735491 (0.0009) [2023-12-26 13:27:10,207][123091] Updated weights for policy 0, policy_version 1735501 (0.0010) [2023-12-26 13:27:10,323][123090] Updated weights for policy 1, policy_version 1723937 (0.0009) [2023-12-26 13:27:10,389][123090] Updated weights for policy 1, policy_version 1723947 (0.0009) [2023-12-26 13:27:10,464][123090] Updated weights for policy 1, policy_version 1723957 (0.0009) [2023-12-26 13:27:10,527][123090] Updated weights for policy 1, policy_version 1723967 (0.0009) [2023-12-26 13:27:10,947][123091] Updated weights for policy 0, policy_version 1735511 (0.0007) [2023-12-26 13:27:10,997][123091] Updated weights for policy 0, policy_version 1735521 (0.0006) [2023-12-26 13:27:11,063][123091] Updated weights for policy 0, policy_version 1735531 (0.0007) [2023-12-26 13:27:11,472][123090] Updated weights for policy 1, policy_version 1723977 (0.0009) [2023-12-26 13:27:11,534][123090] Updated weights for policy 1, policy_version 1723987 (0.0009) [2023-12-26 13:27:11,596][123090] Updated weights for policy 1, policy_version 1723997 (0.0009) [2023-12-26 13:27:11,874][123091] Updated weights for policy 0, policy_version 1735541 (0.0008) [2023-12-26 13:27:11,940][123091] Updated weights for policy 0, policy_version 1735551 (0.0010) [2023-12-26 13:27:12,004][123091] Updated weights for policy 0, policy_version 1735561 (0.0010) [2023-12-26 13:27:12,432][123090] Updated weights for policy 1, policy_version 1724007 (0.0008) [2023-12-26 13:27:12,497][123090] Updated weights for policy 1, policy_version 1724017 (0.0009) [2023-12-26 13:27:12,564][123090] Updated weights for policy 1, policy_version 1724027 (0.0010) [2023-12-26 13:27:12,847][123091] Updated weights for policy 0, policy_version 1735571 (0.0010) [2023-12-26 13:27:12,903][123091] Updated weights for policy 0, policy_version 1735581 (0.0009) [2023-12-26 13:27:12,963][123091] Updated weights for policy 0, policy_version 1735591 (0.0010) [2023-12-26 13:27:13,415][123090] Updated weights for policy 1, policy_version 1724037 (0.0010) [2023-12-26 13:27:13,466][123090] Updated weights for policy 1, policy_version 1724047 (0.0010) [2023-12-26 13:27:13,534][123090] Updated weights for policy 1, policy_version 1724057 (0.0010) [2023-12-26 13:27:13,770][123091] Updated weights for policy 0, policy_version 1735601 (0.0009) [2023-12-26 13:27:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 885678080. Throughput: 0: 8678.2, 1: 8727.7. Samples: 885673436. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:13,785][121949] Avg episode reward: [(0, '5641.549'), (1, '5684.922')] [2023-12-26 13:27:13,833][123091] Updated weights for policy 0, policy_version 1735611 (0.0005) [2023-12-26 13:27:13,903][123091] Updated weights for policy 0, policy_version 1735621 (0.0005) [2023-12-26 13:27:13,972][123091] Updated weights for policy 0, policy_version 1735631 (0.0007) [2023-12-26 13:27:14,312][123090] Updated weights for policy 1, policy_version 1724067 (0.0010) [2023-12-26 13:27:14,376][123090] Updated weights for policy 1, policy_version 1724077 (0.0009) [2023-12-26 13:27:14,437][123090] Updated weights for policy 1, policy_version 1724087 (0.0010) [2023-12-26 13:27:14,780][123091] Updated weights for policy 0, policy_version 1735641 (0.0009) [2023-12-26 13:27:14,846][123091] Updated weights for policy 0, policy_version 1735651 (0.0009) [2023-12-26 13:27:14,911][123091] Updated weights for policy 0, policy_version 1735661 (0.0011) [2023-12-26 13:27:15,258][123090] Updated weights for policy 1, policy_version 1724097 (0.0010) [2023-12-26 13:27:15,320][123090] Updated weights for policy 1, policy_version 1724107 (0.0009) [2023-12-26 13:27:15,370][123090] Updated weights for policy 1, policy_version 1724117 (0.0009) [2023-12-26 13:27:15,420][123090] Updated weights for policy 1, policy_version 1724127 (0.0009) [2023-12-26 13:27:15,766][123091] Updated weights for policy 0, policy_version 1735671 (0.0009) [2023-12-26 13:27:15,829][123091] Updated weights for policy 0, policy_version 1735681 (0.0009) [2023-12-26 13:27:15,897][123091] Updated weights for policy 0, policy_version 1735691 (0.0009) [2023-12-26 13:27:16,292][123090] Updated weights for policy 1, policy_version 1724137 (0.0009) [2023-12-26 13:27:16,350][123090] Updated weights for policy 1, policy_version 1724147 (0.0010) [2023-12-26 13:27:16,405][123090] Updated weights for policy 1, policy_version 1724158 (0.0009) [2023-12-26 13:27:16,725][123091] Updated weights for policy 0, policy_version 1735701 (0.0009) [2023-12-26 13:27:16,776][123091] Updated weights for policy 0, policy_version 1735711 (0.0008) [2023-12-26 13:27:16,829][123091] Updated weights for policy 0, policy_version 1735721 (0.0009) [2023-12-26 13:27:17,222][123090] Updated weights for policy 1, policy_version 1724168 (0.0008) [2023-12-26 13:27:17,282][123090] Updated weights for policy 1, policy_version 1724178 (0.0010) [2023-12-26 13:27:17,342][123090] Updated weights for policy 1, policy_version 1724188 (0.0008) [2023-12-26 13:27:17,668][123091] Updated weights for policy 0, policy_version 1735731 (0.0008) [2023-12-26 13:27:17,724][123091] Updated weights for policy 0, policy_version 1735741 (0.0010) [2023-12-26 13:27:17,772][123091] Updated weights for policy 0, policy_version 1735751 (0.0010) [2023-12-26 13:27:18,110][123090] Updated weights for policy 1, policy_version 1724198 (0.0010) [2023-12-26 13:27:18,170][123090] Updated weights for policy 1, policy_version 1724208 (0.0009) [2023-12-26 13:27:18,233][123090] Updated weights for policy 1, policy_version 1724218 (0.0008) [2023-12-26 13:27:18,551][123091] Updated weights for policy 0, policy_version 1735761 (0.0009) [2023-12-26 13:27:18,610][123091] Updated weights for policy 0, policy_version 1735771 (0.0006) [2023-12-26 13:27:18,665][123091] Updated weights for policy 0, policy_version 1735781 (0.0006) [2023-12-26 13:27:18,729][123091] Updated weights for policy 0, policy_version 1735791 (0.0006) [2023-12-26 13:27:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 885768192. Throughput: 0: 8682.5, 1: 8657.2. Samples: 885778036. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:18,785][121949] Avg episode reward: [(0, '5800.355'), (1, '5472.615')] [2023-12-26 13:27:19,104][123090] Updated weights for policy 1, policy_version 1724228 (0.0009) [2023-12-26 13:27:19,164][123090] Updated weights for policy 1, policy_version 1724238 (0.0010) [2023-12-26 13:27:19,226][123090] Updated weights for policy 1, policy_version 1724248 (0.0010) [2023-12-26 13:27:19,512][123091] Updated weights for policy 0, policy_version 1735801 (0.0006) [2023-12-26 13:27:19,578][123091] Updated weights for policy 0, policy_version 1735811 (0.0007) [2023-12-26 13:27:19,640][123091] Updated weights for policy 0, policy_version 1735821 (0.0010) [2023-12-26 13:27:20,063][123090] Updated weights for policy 1, policy_version 1724258 (0.0010) [2023-12-26 13:27:20,124][123090] Updated weights for policy 1, policy_version 1724268 (0.0010) [2023-12-26 13:27:20,192][123090] Updated weights for policy 1, policy_version 1724278 (0.0010) [2023-12-26 13:27:20,260][123090] Updated weights for policy 1, policy_version 1724288 (0.0010) [2023-12-26 13:27:20,457][123091] Updated weights for policy 0, policy_version 1735831 (0.0010) [2023-12-26 13:27:20,524][123091] Updated weights for policy 0, policy_version 1735841 (0.0009) [2023-12-26 13:27:20,589][123091] Updated weights for policy 0, policy_version 1735851 (0.0009) [2023-12-26 13:27:21,068][123090] Updated weights for policy 1, policy_version 1724298 (0.0010) [2023-12-26 13:27:21,127][123090] Updated weights for policy 1, policy_version 1724308 (0.0009) [2023-12-26 13:27:21,198][123090] Updated weights for policy 1, policy_version 1724318 (0.0009) [2023-12-26 13:27:21,431][123091] Updated weights for policy 0, policy_version 1735861 (0.0009) [2023-12-26 13:27:21,476][123091] Updated weights for policy 0, policy_version 1735871 (0.0010) [2023-12-26 13:27:21,533][123091] Updated weights for policy 0, policy_version 1735881 (0.0009) [2023-12-26 13:27:22,087][123090] Updated weights for policy 1, policy_version 1724328 (0.0009) [2023-12-26 13:27:22,153][123090] Updated weights for policy 1, policy_version 1724338 (0.0008) [2023-12-26 13:27:22,219][123090] Updated weights for policy 1, policy_version 1724348 (0.0008) [2023-12-26 13:27:22,286][123091] Updated weights for policy 0, policy_version 1735891 (0.0008) [2023-12-26 13:27:22,378][123091] Updated weights for policy 0, policy_version 1735901 (0.0011) [2023-12-26 13:27:22,452][123091] Updated weights for policy 0, policy_version 1735912 (0.0007) [2023-12-26 13:27:23,023][123090] Updated weights for policy 1, policy_version 1724358 (0.0010) [2023-12-26 13:27:23,087][123090] Updated weights for policy 1, policy_version 1724368 (0.0009) [2023-12-26 13:27:23,158][123090] Updated weights for policy 1, policy_version 1724378 (0.0009) [2023-12-26 13:27:23,172][123091] Updated weights for policy 0, policy_version 1735922 (0.0006) [2023-12-26 13:27:23,231][123091] Updated weights for policy 0, policy_version 1735932 (0.0010) [2023-12-26 13:27:23,281][123091] Updated weights for policy 0, policy_version 1735942 (0.0009) [2023-12-26 13:27:23,338][123091] Updated weights for policy 0, policy_version 1735952 (0.0009) [2023-12-26 13:27:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 885850112. Throughput: 0: 8641.2, 1: 8595.2. Samples: 885828252. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:23,785][121949] Avg episode reward: [(0, '6005.781'), (1, '5728.676')] [2023-12-26 13:27:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001724384_441442304.pth... [2023-12-26 13:27:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001735952_444407808.pth... [2023-12-26 13:27:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001734960_444153856.pth [2023-12-26 13:27:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001723392_441188352.pth [2023-12-26 13:27:24,005][123090] Updated weights for policy 1, policy_version 1724388 (0.0008) [2023-12-26 13:27:24,065][123090] Updated weights for policy 1, policy_version 1724398 (0.0008) [2023-12-26 13:27:24,132][123090] Updated weights for policy 1, policy_version 1724408 (0.0009) [2023-12-26 13:27:24,143][123091] Updated weights for policy 0, policy_version 1735962 (0.0006) [2023-12-26 13:27:24,188][123091] Updated weights for policy 0, policy_version 1735972 (0.0006) [2023-12-26 13:27:24,234][123091] Updated weights for policy 0, policy_version 1735982 (0.0005) [2023-12-26 13:27:24,923][123091] Updated weights for policy 0, policy_version 1735992 (0.0005) [2023-12-26 13:27:24,977][123091] Updated weights for policy 0, policy_version 1736002 (0.0005) [2023-12-26 13:27:25,031][123090] Updated weights for policy 1, policy_version 1724418 (0.0009) [2023-12-26 13:27:25,040][123091] Updated weights for policy 0, policy_version 1736012 (0.0007) [2023-12-26 13:27:25,110][123090] Updated weights for policy 1, policy_version 1724428 (0.0008) [2023-12-26 13:27:25,181][123090] Updated weights for policy 1, policy_version 1724438 (0.0008) [2023-12-26 13:27:25,245][123090] Updated weights for policy 1, policy_version 1724448 (0.0008) [2023-12-26 13:27:25,669][123091] Updated weights for policy 0, policy_version 1736022 (0.0006) [2023-12-26 13:27:25,724][123091] Updated weights for policy 0, policy_version 1736032 (0.0006) [2023-12-26 13:27:25,776][123091] Updated weights for policy 0, policy_version 1736042 (0.0006) [2023-12-26 13:27:25,967][123090] Updated weights for policy 1, policy_version 1724458 (0.0008) [2023-12-26 13:27:26,019][123090] Updated weights for policy 1, policy_version 1724468 (0.0010) [2023-12-26 13:27:26,064][123090] Updated weights for policy 1, policy_version 1724478 (0.0010) [2023-12-26 13:27:26,532][123091] Updated weights for policy 0, policy_version 1736052 (0.0006) [2023-12-26 13:27:26,587][123091] Updated weights for policy 0, policy_version 1736062 (0.0005) [2023-12-26 13:27:26,657][123091] Updated weights for policy 0, policy_version 1736072 (0.0005) [2023-12-26 13:27:26,775][123090] Updated weights for policy 1, policy_version 1724488 (0.0006) [2023-12-26 13:27:26,843][123090] Updated weights for policy 1, policy_version 1724498 (0.0005) [2023-12-26 13:27:26,908][123090] Updated weights for policy 1, policy_version 1724508 (0.0008) [2023-12-26 13:27:27,319][123091] Updated weights for policy 0, policy_version 1736082 (0.0006) [2023-12-26 13:27:27,370][123091] Updated weights for policy 0, policy_version 1736092 (0.0006) [2023-12-26 13:27:27,428][123091] Updated weights for policy 0, policy_version 1736102 (0.0005) [2023-12-26 13:27:27,474][123091] Updated weights for policy 0, policy_version 1736112 (0.0005) [2023-12-26 13:27:27,565][123090] Updated weights for policy 1, policy_version 1724518 (0.0009) [2023-12-26 13:27:27,633][123090] Updated weights for policy 1, policy_version 1724528 (0.0011) [2023-12-26 13:27:27,698][123090] Updated weights for policy 1, policy_version 1724538 (0.0010) [2023-12-26 13:27:28,258][123091] Updated weights for policy 0, policy_version 1736122 (0.0005) [2023-12-26 13:27:28,311][123091] Updated weights for policy 0, policy_version 1736132 (0.0005) [2023-12-26 13:27:28,377][123091] Updated weights for policy 0, policy_version 1736142 (0.0006) [2023-12-26 13:27:28,444][123090] Updated weights for policy 1, policy_version 1724548 (0.0008) [2023-12-26 13:27:28,506][123090] Updated weights for policy 1, policy_version 1724558 (0.0005) [2023-12-26 13:27:28,569][123090] Updated weights for policy 1, policy_version 1724568 (0.0009) [2023-12-26 13:27:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 885948416. Throughput: 0: 8833.0, 1: 8618.2. Samples: 885939908. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:28,785][121949] Avg episode reward: [(0, '5975.396'), (1, '5763.516')] [2023-12-26 13:27:29,041][123091] Updated weights for policy 0, policy_version 1736152 (0.0005) [2023-12-26 13:27:29,093][123091] Updated weights for policy 0, policy_version 1736162 (0.0005) [2023-12-26 13:27:29,146][123091] Updated weights for policy 0, policy_version 1736172 (0.0005) [2023-12-26 13:27:29,271][123090] Updated weights for policy 1, policy_version 1724578 (0.0010) [2023-12-26 13:27:29,335][123090] Updated weights for policy 1, policy_version 1724588 (0.0009) [2023-12-26 13:27:29,402][123090] Updated weights for policy 1, policy_version 1724598 (0.0009) [2023-12-26 13:27:29,450][123090] Updated weights for policy 1, policy_version 1724608 (0.0009) [2023-12-26 13:27:29,936][123091] Updated weights for policy 0, policy_version 1736182 (0.0006) [2023-12-26 13:27:30,007][123091] Updated weights for policy 0, policy_version 1736192 (0.0006) [2023-12-26 13:27:30,075][123091] Updated weights for policy 0, policy_version 1736202 (0.0007) [2023-12-26 13:27:30,286][123090] Updated weights for policy 1, policy_version 1724618 (0.0006) [2023-12-26 13:27:30,353][123090] Updated weights for policy 1, policy_version 1724628 (0.0008) [2023-12-26 13:27:30,422][123090] Updated weights for policy 1, policy_version 1724638 (0.0008) [2023-12-26 13:27:30,762][123091] Updated weights for policy 0, policy_version 1736212 (0.0008) [2023-12-26 13:27:30,812][123091] Updated weights for policy 0, policy_version 1736222 (0.0005) [2023-12-26 13:27:30,857][123091] Updated weights for policy 0, policy_version 1736232 (0.0010) [2023-12-26 13:27:31,203][123090] Updated weights for policy 1, policy_version 1724648 (0.0009) [2023-12-26 13:27:31,266][123090] Updated weights for policy 1, policy_version 1724658 (0.0008) [2023-12-26 13:27:31,328][123090] Updated weights for policy 1, policy_version 1724668 (0.0008) [2023-12-26 13:27:31,664][123091] Updated weights for policy 0, policy_version 1736242 (0.0010) [2023-12-26 13:27:31,723][123091] Updated weights for policy 0, policy_version 1736252 (0.0010) [2023-12-26 13:27:31,790][123091] Updated weights for policy 0, policy_version 1736262 (0.0008) [2023-12-26 13:27:31,855][123091] Updated weights for policy 0, policy_version 1736272 (0.0010) [2023-12-26 13:27:32,075][123090] Updated weights for policy 1, policy_version 1724678 (0.0007) [2023-12-26 13:27:32,146][123090] Updated weights for policy 1, policy_version 1724688 (0.0008) [2023-12-26 13:27:32,203][123090] Updated weights for policy 1, policy_version 1724698 (0.0010) [2023-12-26 13:27:32,594][123091] Updated weights for policy 0, policy_version 1736282 (0.0006) [2023-12-26 13:27:32,649][123091] Updated weights for policy 0, policy_version 1736292 (0.0005) [2023-12-26 13:27:32,707][123091] Updated weights for policy 0, policy_version 1736302 (0.0007) [2023-12-26 13:27:33,004][123090] Updated weights for policy 1, policy_version 1724708 (0.0008) [2023-12-26 13:27:33,080][123090] Updated weights for policy 1, policy_version 1724718 (0.0006) [2023-12-26 13:27:33,144][123090] Updated weights for policy 1, policy_version 1724728 (0.0005) [2023-12-26 13:27:33,406][123091] Updated weights for policy 0, policy_version 1736312 (0.0010) [2023-12-26 13:27:33,456][123091] Updated weights for policy 0, policy_version 1736322 (0.0007) [2023-12-26 13:27:33,502][123091] Updated weights for policy 0, policy_version 1736332 (0.0005) [2023-12-26 13:27:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 886038528. Throughput: 0: 8873.4, 1: 8729.8. Samples: 886051068. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:33,785][121949] Avg episode reward: [(0, '5998.119'), (1, '5630.824')] [2023-12-26 13:27:33,832][123090] Updated weights for policy 1, policy_version 1724738 (0.0005) [2023-12-26 13:27:33,898][123090] Updated weights for policy 1, policy_version 1724748 (0.0005) [2023-12-26 13:27:33,952][123090] Updated weights for policy 1, policy_version 1724758 (0.0006) [2023-12-26 13:27:34,000][123090] Updated weights for policy 1, policy_version 1724768 (0.0005) [2023-12-26 13:27:34,234][123091] Updated weights for policy 0, policy_version 1736342 (0.0007) [2023-12-26 13:27:34,295][123091] Updated weights for policy 0, policy_version 1736352 (0.0008) [2023-12-26 13:27:34,370][123091] Updated weights for policy 0, policy_version 1736362 (0.0009) [2023-12-26 13:27:34,800][123090] Updated weights for policy 1, policy_version 1724778 (0.0011) [2023-12-26 13:27:34,859][123090] Updated weights for policy 1, policy_version 1724788 (0.0011) [2023-12-26 13:27:34,915][123090] Updated weights for policy 1, policy_version 1724798 (0.0010) [2023-12-26 13:27:35,107][123091] Updated weights for policy 0, policy_version 1736372 (0.0009) [2023-12-26 13:27:35,159][123091] Updated weights for policy 0, policy_version 1736382 (0.0009) [2023-12-26 13:27:35,211][123091] Updated weights for policy 0, policy_version 1736392 (0.0009) [2023-12-26 13:27:35,631][123090] Updated weights for policy 1, policy_version 1724808 (0.0008) [2023-12-26 13:27:35,697][123090] Updated weights for policy 1, policy_version 1724818 (0.0010) [2023-12-26 13:27:35,759][123090] Updated weights for policy 1, policy_version 1724828 (0.0011) [2023-12-26 13:27:36,127][123091] Updated weights for policy 0, policy_version 1736402 (0.0012) [2023-12-26 13:27:36,187][123091] Updated weights for policy 0, policy_version 1736412 (0.0010) [2023-12-26 13:27:36,240][123091] Updated weights for policy 0, policy_version 1736422 (0.0009) [2023-12-26 13:27:36,294][123091] Updated weights for policy 0, policy_version 1736432 (0.0010) [2023-12-26 13:27:36,534][123090] Updated weights for policy 1, policy_version 1724838 (0.0010) [2023-12-26 13:27:36,601][123090] Updated weights for policy 1, policy_version 1724848 (0.0009) [2023-12-26 13:27:36,661][123090] Updated weights for policy 1, policy_version 1724858 (0.0009) [2023-12-26 13:27:37,190][123091] Updated weights for policy 0, policy_version 1736442 (0.0009) [2023-12-26 13:27:37,253][123091] Updated weights for policy 0, policy_version 1736452 (0.0009) [2023-12-26 13:27:37,319][123091] Updated weights for policy 0, policy_version 1736462 (0.0009) [2023-12-26 13:27:37,384][123090] Updated weights for policy 1, policy_version 1724868 (0.0006) [2023-12-26 13:27:37,443][123090] Updated weights for policy 1, policy_version 1724878 (0.0005) [2023-12-26 13:27:37,505][123090] Updated weights for policy 1, policy_version 1724888 (0.0005) [2023-12-26 13:27:38,100][123090] Updated weights for policy 1, policy_version 1724898 (0.0007) [2023-12-26 13:27:38,162][123090] Updated weights for policy 1, policy_version 1724908 (0.0010) [2023-12-26 13:27:38,217][123090] Updated weights for policy 1, policy_version 1724918 (0.0010) [2023-12-26 13:27:38,227][123091] Updated weights for policy 0, policy_version 1736472 (0.0010) [2023-12-26 13:27:38,264][123090] Updated weights for policy 1, policy_version 1724928 (0.0010) [2023-12-26 13:27:38,280][123091] Updated weights for policy 0, policy_version 1736482 (0.0008) [2023-12-26 13:27:38,348][123091] Updated weights for policy 0, policy_version 1736492 (0.0009) [2023-12-26 13:27:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 886128640. Throughput: 0: 8858.5, 1: 8754.5. Samples: 886104356. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:38,785][121949] Avg episode reward: [(0, '6082.154'), (1, '5593.884')] [2023-12-26 13:27:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001736496_444547072.pth... [2023-12-26 13:27:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001724928_441581568.pth... [2023-12-26 13:27:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001735440_444276736.pth [2023-12-26 13:27:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001723904_441319424.pth [2023-12-26 13:27:39,071][123090] Updated weights for policy 1, policy_version 1724938 (0.0010) [2023-12-26 13:27:39,136][123090] Updated weights for policy 1, policy_version 1724948 (0.0010) [2023-12-26 13:27:39,205][123090] Updated weights for policy 1, policy_version 1724958 (0.0010) [2023-12-26 13:27:39,208][123091] Updated weights for policy 0, policy_version 1736502 (0.0008) [2023-12-26 13:27:39,276][123091] Updated weights for policy 0, policy_version 1736512 (0.0008) [2023-12-26 13:27:39,354][123091] Updated weights for policy 0, policy_version 1736523 (0.0008) [2023-12-26 13:27:40,009][123090] Updated weights for policy 1, policy_version 1724968 (0.0011) [2023-12-26 13:27:40,069][123090] Updated weights for policy 1, policy_version 1724978 (0.0011) [2023-12-26 13:27:40,137][123090] Updated weights for policy 1, policy_version 1724988 (0.0011) [2023-12-26 13:27:40,192][123091] Updated weights for policy 0, policy_version 1736533 (0.0009) [2023-12-26 13:27:40,261][123091] Updated weights for policy 0, policy_version 1736543 (0.0009) [2023-12-26 13:27:40,327][123091] Updated weights for policy 0, policy_version 1736553 (0.0010) [2023-12-26 13:27:40,936][123090] Updated weights for policy 1, policy_version 1724998 (0.0010) [2023-12-26 13:27:40,995][123090] Updated weights for policy 1, policy_version 1725008 (0.0010) [2023-12-26 13:27:41,031][123091] Updated weights for policy 0, policy_version 1736563 (0.0010) [2023-12-26 13:27:41,059][123090] Updated weights for policy 1, policy_version 1725018 (0.0010) [2023-12-26 13:27:41,101][123091] Updated weights for policy 0, policy_version 1736573 (0.0007) [2023-12-26 13:27:41,179][123091] Updated weights for policy 0, policy_version 1736583 (0.0009) [2023-12-26 13:27:41,916][123090] Updated weights for policy 1, policy_version 1725028 (0.0010) [2023-12-26 13:27:41,977][123090] Updated weights for policy 1, policy_version 1725038 (0.0011) [2023-12-26 13:27:42,048][123090] Updated weights for policy 1, policy_version 1725048 (0.0010) [2023-12-26 13:27:42,054][123091] Updated weights for policy 0, policy_version 1736593 (0.0009) [2023-12-26 13:27:42,114][123091] Updated weights for policy 0, policy_version 1736603 (0.0011) [2023-12-26 13:27:42,162][123091] Updated weights for policy 0, policy_version 1736613 (0.0011) [2023-12-26 13:27:42,225][123091] Updated weights for policy 0, policy_version 1736623 (0.0011) [2023-12-26 13:27:42,864][123090] Updated weights for policy 1, policy_version 1725058 (0.0010) [2023-12-26 13:27:42,937][123090] Updated weights for policy 1, policy_version 1725068 (0.0006) [2023-12-26 13:27:43,021][123090] Updated weights for policy 1, policy_version 1725078 (0.0006) [2023-12-26 13:27:43,080][123091] Updated weights for policy 0, policy_version 1736633 (0.0011) [2023-12-26 13:27:43,090][123090] Updated weights for policy 1, policy_version 1725088 (0.0008) [2023-12-26 13:27:43,148][123091] Updated weights for policy 0, policy_version 1736643 (0.0011) [2023-12-26 13:27:43,213][123091] Updated weights for policy 0, policy_version 1736653 (0.0011) [2023-12-26 13:27:43,738][123090] Updated weights for policy 1, policy_version 1725098 (0.0005) [2023-12-26 13:27:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 886210560. Throughput: 0: 8836.3, 1: 8784.1. Samples: 886207376. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:43,785][121949] Avg episode reward: [(0, '6161.791'), (1, '5613.368')] [2023-12-26 13:27:43,799][123090] Updated weights for policy 1, policy_version 1725108 (0.0005) [2023-12-26 13:27:43,864][123090] Updated weights for policy 1, policy_version 1725118 (0.0005) [2023-12-26 13:27:44,031][123091] Updated weights for policy 0, policy_version 1736663 (0.0011) [2023-12-26 13:27:44,097][123091] Updated weights for policy 0, policy_version 1736673 (0.0011) [2023-12-26 13:27:44,153][123091] Updated weights for policy 0, policy_version 1736683 (0.0011) [2023-12-26 13:27:44,540][123090] Updated weights for policy 1, policy_version 1725128 (0.0009) [2023-12-26 13:27:44,587][123090] Updated weights for policy 1, policy_version 1725138 (0.0010) [2023-12-26 13:27:44,634][123090] Updated weights for policy 1, policy_version 1725148 (0.0010) [2023-12-26 13:27:44,976][123091] Updated weights for policy 0, policy_version 1736693 (0.0008) [2023-12-26 13:27:45,045][123091] Updated weights for policy 0, policy_version 1736703 (0.0006) [2023-12-26 13:27:45,112][123091] Updated weights for policy 0, policy_version 1736713 (0.0006) [2023-12-26 13:27:45,521][123090] Updated weights for policy 1, policy_version 1725158 (0.0010) [2023-12-26 13:27:45,589][123090] Updated weights for policy 1, policy_version 1725168 (0.0010) [2023-12-26 13:27:45,653][123090] Updated weights for policy 1, policy_version 1725178 (0.0010) [2023-12-26 13:27:45,842][123091] Updated weights for policy 0, policy_version 1736723 (0.0006) [2023-12-26 13:27:45,900][123091] Updated weights for policy 0, policy_version 1736733 (0.0006) [2023-12-26 13:27:45,949][123091] Updated weights for policy 0, policy_version 1736743 (0.0005) [2023-12-26 13:27:46,473][123090] Updated weights for policy 1, policy_version 1725188 (0.0011) [2023-12-26 13:27:46,533][123090] Updated weights for policy 1, policy_version 1725198 (0.0010) [2023-12-26 13:27:46,596][123090] Updated weights for policy 1, policy_version 1725208 (0.0010) [2023-12-26 13:27:46,613][123091] Updated weights for policy 0, policy_version 1736753 (0.0006) [2023-12-26 13:27:46,670][123091] Updated weights for policy 0, policy_version 1736763 (0.0011) [2023-12-26 13:27:46,718][123091] Updated weights for policy 0, policy_version 1736773 (0.0010) [2023-12-26 13:27:46,769][123091] Updated weights for policy 0, policy_version 1736783 (0.0010) [2023-12-26 13:27:47,395][123090] Updated weights for policy 1, policy_version 1725218 (0.0008) [2023-12-26 13:27:47,453][123090] Updated weights for policy 1, policy_version 1725228 (0.0007) [2023-12-26 13:27:47,500][123090] Updated weights for policy 1, policy_version 1725238 (0.0008) [2023-12-26 13:27:47,556][123090] Updated weights for policy 1, policy_version 1725248 (0.0009) [2023-12-26 13:27:47,607][123091] Updated weights for policy 0, policy_version 1736793 (0.0009) [2023-12-26 13:27:47,656][123091] Updated weights for policy 0, policy_version 1736803 (0.0009) [2023-12-26 13:27:47,703][123091] Updated weights for policy 0, policy_version 1736813 (0.0008) [2023-12-26 13:27:48,383][123090] Updated weights for policy 1, policy_version 1725258 (0.0008) [2023-12-26 13:27:48,444][123090] Updated weights for policy 1, policy_version 1725268 (0.0009) [2023-12-26 13:27:48,509][123090] Updated weights for policy 1, policy_version 1725278 (0.0009) [2023-12-26 13:27:48,575][123091] Updated weights for policy 0, policy_version 1736823 (0.0010) [2023-12-26 13:27:48,634][123091] Updated weights for policy 0, policy_version 1736833 (0.0010) [2023-12-26 13:27:48,698][123091] Updated weights for policy 0, policy_version 1736843 (0.0010) [2023-12-26 13:27:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 886308864. Throughput: 0: 8905.6, 1: 8819.2. Samples: 886315084. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:48,785][121949] Avg episode reward: [(0, '6182.395'), (1, '5763.475')] [2023-12-26 13:27:49,402][123090] Updated weights for policy 1, policy_version 1725288 (0.0009) [2023-12-26 13:27:49,467][123090] Updated weights for policy 1, policy_version 1725298 (0.0008) [2023-12-26 13:27:49,531][123090] Updated weights for policy 1, policy_version 1725308 (0.0009) [2023-12-26 13:27:49,552][123091] Updated weights for policy 0, policy_version 1736853 (0.0009) [2023-12-26 13:27:49,612][123091] Updated weights for policy 0, policy_version 1736863 (0.0009) [2023-12-26 13:27:49,674][123091] Updated weights for policy 0, policy_version 1736873 (0.0009) [2023-12-26 13:27:50,362][123090] Updated weights for policy 1, policy_version 1725318 (0.0008) [2023-12-26 13:27:50,420][123090] Updated weights for policy 1, policy_version 1725328 (0.0010) [2023-12-26 13:27:50,484][123090] Updated weights for policy 1, policy_version 1725339 (0.0010) [2023-12-26 13:27:50,524][123091] Updated weights for policy 0, policy_version 1736883 (0.0008) [2023-12-26 13:27:50,583][123091] Updated weights for policy 0, policy_version 1736893 (0.0007) [2023-12-26 13:27:50,654][123091] Updated weights for policy 0, policy_version 1736903 (0.0009) [2023-12-26 13:27:51,319][123090] Updated weights for policy 1, policy_version 1725349 (0.0009) [2023-12-26 13:27:51,379][123090] Updated weights for policy 1, policy_version 1725359 (0.0009) [2023-12-26 13:27:51,444][123090] Updated weights for policy 1, policy_version 1725369 (0.0009) [2023-12-26 13:27:51,456][123091] Updated weights for policy 0, policy_version 1736913 (0.0009) [2023-12-26 13:27:51,511][123091] Updated weights for policy 0, policy_version 1736923 (0.0010) [2023-12-26 13:27:51,570][123091] Updated weights for policy 0, policy_version 1736933 (0.0010) [2023-12-26 13:27:51,636][123091] Updated weights for policy 0, policy_version 1736943 (0.0010) [2023-12-26 13:27:52,286][123090] Updated weights for policy 1, policy_version 1725379 (0.0008) [2023-12-26 13:27:52,361][123090] Updated weights for policy 1, policy_version 1725389 (0.0008) [2023-12-26 13:27:52,423][123090] Updated weights for policy 1, policy_version 1725399 (0.0009) [2023-12-26 13:27:52,517][123091] Updated weights for policy 0, policy_version 1736953 (0.0008) [2023-12-26 13:27:52,565][123091] Updated weights for policy 0, policy_version 1736963 (0.0010) [2023-12-26 13:27:52,628][123091] Updated weights for policy 0, policy_version 1736973 (0.0011) [2023-12-26 13:27:53,251][123090] Updated weights for policy 1, policy_version 1725409 (0.0008) [2023-12-26 13:27:53,307][123090] Updated weights for policy 1, policy_version 1725419 (0.0008) [2023-12-26 13:27:53,372][123090] Updated weights for policy 1, policy_version 1725429 (0.0007) [2023-12-26 13:27:53,441][123090] Updated weights for policy 1, policy_version 1725439 (0.0009) [2023-12-26 13:27:53,458][123091] Updated weights for policy 0, policy_version 1736983 (0.0010) [2023-12-26 13:27:53,513][123091] Updated weights for policy 0, policy_version 1736993 (0.0010) [2023-12-26 13:27:53,562][123091] Updated weights for policy 0, policy_version 1737003 (0.0011) [2023-12-26 13:27:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 886390784. Throughput: 0: 8858.6, 1: 8776.0. Samples: 886365080. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:53,785][121949] Avg episode reward: [(0, '6035.214'), (1, '5784.112')] [2023-12-26 13:27:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001737008_444678144.pth... [2023-12-26 13:27:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001725440_441712640.pth... [2023-12-26 13:27:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001724384_441442304.pth [2023-12-26 13:27:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001735952_444407808.pth [2023-12-26 13:27:54,269][123090] Updated weights for policy 1, policy_version 1725449 (0.0009) [2023-12-26 13:27:54,325][123090] Updated weights for policy 1, policy_version 1725459 (0.0009) [2023-12-26 13:27:54,384][123090] Updated weights for policy 1, policy_version 1725469 (0.0008) [2023-12-26 13:27:54,410][123091] Updated weights for policy 0, policy_version 1737013 (0.0010) [2023-12-26 13:27:54,473][123091] Updated weights for policy 0, policy_version 1737023 (0.0010) [2023-12-26 13:27:54,528][123091] Updated weights for policy 0, policy_version 1737033 (0.0010) [2023-12-26 13:27:55,218][123090] Updated weights for policy 1, policy_version 1725479 (0.0008) [2023-12-26 13:27:55,278][123090] Updated weights for policy 1, policy_version 1725489 (0.0008) [2023-12-26 13:27:55,287][123091] Updated weights for policy 0, policy_version 1737043 (0.0010) [2023-12-26 13:27:55,350][123090] Updated weights for policy 1, policy_version 1725499 (0.0009) [2023-12-26 13:27:55,353][123091] Updated weights for policy 0, policy_version 1737053 (0.0010) [2023-12-26 13:27:55,416][123091] Updated weights for policy 0, policy_version 1737063 (0.0010) [2023-12-26 13:27:56,142][123090] Updated weights for policy 1, policy_version 1725509 (0.0008) [2023-12-26 13:27:56,193][123091] Updated weights for policy 0, policy_version 1737073 (0.0010) [2023-12-26 13:27:56,195][123090] Updated weights for policy 1, policy_version 1725519 (0.0009) [2023-12-26 13:27:56,246][123091] Updated weights for policy 0, policy_version 1737083 (0.0005) [2023-12-26 13:27:56,255][123090] Updated weights for policy 1, policy_version 1725529 (0.0009) [2023-12-26 13:27:56,297][123091] Updated weights for policy 0, policy_version 1737093 (0.0005) [2023-12-26 13:27:56,345][123091] Updated weights for policy 0, policy_version 1737103 (0.0005) [2023-12-26 13:27:56,979][123091] Updated weights for policy 0, policy_version 1737113 (0.0006) [2023-12-26 13:27:56,984][123090] Updated weights for policy 1, policy_version 1725539 (0.0007) [2023-12-26 13:27:57,042][123090] Updated weights for policy 1, policy_version 1725549 (0.0008) [2023-12-26 13:27:57,046][123091] Updated weights for policy 0, policy_version 1737123 (0.0008) [2023-12-26 13:27:57,104][123090] Updated weights for policy 1, policy_version 1725559 (0.0009) [2023-12-26 13:27:57,106][123091] Updated weights for policy 0, policy_version 1737133 (0.0008) [2023-12-26 13:27:57,811][123090] Updated weights for policy 1, policy_version 1725569 (0.0006) [2023-12-26 13:27:57,867][123090] Updated weights for policy 1, policy_version 1725579 (0.0005) [2023-12-26 13:27:57,886][123091] Updated weights for policy 0, policy_version 1737143 (0.0009) [2023-12-26 13:27:57,918][123090] Updated weights for policy 1, policy_version 1725589 (0.0005) [2023-12-26 13:27:57,943][123091] Updated weights for policy 0, policy_version 1737153 (0.0010) [2023-12-26 13:27:57,969][123090] Updated weights for policy 1, policy_version 1725599 (0.0005) [2023-12-26 13:27:57,996][123091] Updated weights for policy 0, policy_version 1737163 (0.0009) [2023-12-26 13:27:58,714][123090] Updated weights for policy 1, policy_version 1725609 (0.0007) [2023-12-26 13:27:58,783][123090] Updated weights for policy 1, policy_version 1725619 (0.0010) [2023-12-26 13:27:58,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 886472704. Throughput: 0: 8910.2, 1: 8830.5. Samples: 886471764. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:27:58,785][121949] Avg episode reward: [(0, '5812.644'), (1, '5689.857')] [2023-12-26 13:27:58,813][123091] Updated weights for policy 0, policy_version 1737173 (0.0008) [2023-12-26 13:27:58,847][123090] Updated weights for policy 1, policy_version 1725629 (0.0011) [2023-12-26 13:27:58,882][123091] Updated weights for policy 0, policy_version 1737183 (0.0008) [2023-12-26 13:27:58,943][123091] Updated weights for policy 0, policy_version 1737193 (0.0008) [2023-12-26 13:27:59,680][123091] Updated weights for policy 0, policy_version 1737203 (0.0007) [2023-12-26 13:27:59,693][123090] Updated weights for policy 1, policy_version 1725639 (0.0010) [2023-12-26 13:27:59,746][123091] Updated weights for policy 0, policy_version 1737213 (0.0009) [2023-12-26 13:27:59,756][123090] Updated weights for policy 1, policy_version 1725649 (0.0007) [2023-12-26 13:27:59,801][123091] Updated weights for policy 0, policy_version 1737223 (0.0008) [2023-12-26 13:27:59,826][123090] Updated weights for policy 1, policy_version 1725659 (0.0006) [2023-12-26 13:28:00,476][123090] Updated weights for policy 1, policy_version 1725669 (0.0006) [2023-12-26 13:28:00,513][123091] Updated weights for policy 0, policy_version 1737233 (0.0007) [2023-12-26 13:28:00,538][123090] Updated weights for policy 1, policy_version 1725679 (0.0006) [2023-12-26 13:28:00,573][123091] Updated weights for policy 0, policy_version 1737243 (0.0008) [2023-12-26 13:28:00,589][123090] Updated weights for policy 1, policy_version 1725689 (0.0005) [2023-12-26 13:28:00,632][123091] Updated weights for policy 0, policy_version 1737253 (0.0009) [2023-12-26 13:28:00,686][123091] Updated weights for policy 0, policy_version 1737264 (0.0010) [2023-12-26 13:28:01,371][123090] Updated weights for policy 1, policy_version 1725699 (0.0006) [2023-12-26 13:28:01,448][123090] Updated weights for policy 1, policy_version 1725709 (0.0010) [2023-12-26 13:28:01,513][123090] Updated weights for policy 1, policy_version 1725719 (0.0007) [2023-12-26 13:28:01,529][123091] Updated weights for policy 0, policy_version 1737274 (0.0008) [2023-12-26 13:28:01,590][123091] Updated weights for policy 0, policy_version 1737284 (0.0009) [2023-12-26 13:28:01,649][123091] Updated weights for policy 0, policy_version 1737294 (0.0009) [2023-12-26 13:28:02,371][123090] Updated weights for policy 1, policy_version 1725729 (0.0007) [2023-12-26 13:28:02,418][123091] Updated weights for policy 0, policy_version 1737304 (0.0009) [2023-12-26 13:28:02,429][123090] Updated weights for policy 1, policy_version 1725739 (0.0008) [2023-12-26 13:28:02,479][123091] Updated weights for policy 0, policy_version 1737314 (0.0010) [2023-12-26 13:28:02,494][123090] Updated weights for policy 1, policy_version 1725749 (0.0006) [2023-12-26 13:28:02,541][123091] Updated weights for policy 0, policy_version 1737324 (0.0010) [2023-12-26 13:28:02,550][123090] Updated weights for policy 1, policy_version 1725759 (0.0008) [2023-12-26 13:28:03,278][123090] Updated weights for policy 1, policy_version 1725769 (0.0006) [2023-12-26 13:28:03,301][123091] Updated weights for policy 0, policy_version 1737334 (0.0010) [2023-12-26 13:28:03,326][123090] Updated weights for policy 1, policy_version 1725779 (0.0006) [2023-12-26 13:28:03,356][123091] Updated weights for policy 0, policy_version 1737344 (0.0010) [2023-12-26 13:28:03,372][123090] Updated weights for policy 1, policy_version 1725789 (0.0008) [2023-12-26 13:28:03,418][123091] Updated weights for policy 0, policy_version 1737354 (0.0010) [2023-12-26 13:28:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 886571008. Throughput: 0: 8959.3, 1: 8893.3. Samples: 886581408. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:28:03,785][121949] Avg episode reward: [(0, '5773.043'), (1, '5888.067')] [2023-12-26 13:28:04,092][123090] Updated weights for policy 1, policy_version 1725799 (0.0006) [2023-12-26 13:28:04,151][123091] Updated weights for policy 0, policy_version 1737364 (0.0007) [2023-12-26 13:28:04,155][123090] Updated weights for policy 1, policy_version 1725809 (0.0008) [2023-12-26 13:28:04,216][123091] Updated weights for policy 0, policy_version 1737374 (0.0008) [2023-12-26 13:28:04,217][123090] Updated weights for policy 1, policy_version 1725819 (0.0009) [2023-12-26 13:28:04,276][123091] Updated weights for policy 0, policy_version 1737384 (0.0008) [2023-12-26 13:28:04,993][123090] Updated weights for policy 1, policy_version 1725829 (0.0006) [2023-12-26 13:28:05,011][123091] Updated weights for policy 0, policy_version 1737394 (0.0009) [2023-12-26 13:28:05,050][123090] Updated weights for policy 1, policy_version 1725839 (0.0005) [2023-12-26 13:28:05,056][123091] Updated weights for policy 0, policy_version 1737404 (0.0007) [2023-12-26 13:28:05,101][123090] Updated weights for policy 1, policy_version 1725849 (0.0006) [2023-12-26 13:28:05,104][123091] Updated weights for policy 0, policy_version 1737414 (0.0007) [2023-12-26 13:28:05,152][123091] Updated weights for policy 0, policy_version 1737424 (0.0010) [2023-12-26 13:28:05,777][123090] Updated weights for policy 1, policy_version 1725859 (0.0007) [2023-12-26 13:28:05,846][123090] Updated weights for policy 1, policy_version 1725869 (0.0009) [2023-12-26 13:28:05,900][123091] Updated weights for policy 0, policy_version 1737434 (0.0010) [2023-12-26 13:28:05,902][123090] Updated weights for policy 1, policy_version 1725879 (0.0005) [2023-12-26 13:28:05,948][123091] Updated weights for policy 0, policy_version 1737444 (0.0010) [2023-12-26 13:28:06,006][123091] Updated weights for policy 0, policy_version 1737454 (0.0010) [2023-12-26 13:28:06,696][123090] Updated weights for policy 1, policy_version 1725889 (0.0006) [2023-12-26 13:28:06,747][123091] Updated weights for policy 0, policy_version 1737464 (0.0008) [2023-12-26 13:28:06,764][123090] Updated weights for policy 1, policy_version 1725899 (0.0011) [2023-12-26 13:28:06,802][123091] Updated weights for policy 0, policy_version 1737474 (0.0007) [2023-12-26 13:28:06,835][123090] Updated weights for policy 1, policy_version 1725909 (0.0011) [2023-12-26 13:28:06,859][123091] Updated weights for policy 0, policy_version 1737484 (0.0007) [2023-12-26 13:28:06,895][123090] Updated weights for policy 1, policy_version 1725919 (0.0011) [2023-12-26 13:28:07,491][123091] Updated weights for policy 0, policy_version 1737494 (0.0005) [2023-12-26 13:28:07,552][123091] Updated weights for policy 0, policy_version 1737504 (0.0008) [2023-12-26 13:28:07,603][123091] Updated weights for policy 0, policy_version 1737514 (0.0006) [2023-12-26 13:28:07,663][123090] Updated weights for policy 1, policy_version 1725929 (0.0006) [2023-12-26 13:28:07,735][123090] Updated weights for policy 1, policy_version 1725939 (0.0006) [2023-12-26 13:28:07,807][123090] Updated weights for policy 1, policy_version 1725949 (0.0006) [2023-12-26 13:28:08,375][123091] Updated weights for policy 0, policy_version 1737524 (0.0009) [2023-12-26 13:28:08,426][123091] Updated weights for policy 0, policy_version 1737534 (0.0008) [2023-12-26 13:28:08,428][123090] Updated weights for policy 1, policy_version 1725959 (0.0008) [2023-12-26 13:28:08,482][123091] Updated weights for policy 0, policy_version 1737544 (0.0006) [2023-12-26 13:28:08,483][123090] Updated weights for policy 1, policy_version 1725969 (0.0008) [2023-12-26 13:28:08,553][123090] Updated weights for policy 1, policy_version 1725979 (0.0008) [2023-12-26 13:28:08,784][121949] Fps is (10 sec: 19660.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 886669312. Throughput: 0: 9035.5, 1: 8982.9. Samples: 886639084. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:28:08,786][121949] Avg episode reward: [(0, '5929.694'), (1, '5935.434')] [2023-12-26 13:28:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001737552_444817408.pth... [2023-12-26 13:28:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001725984_441851904.pth... [2023-12-26 13:28:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001736496_444547072.pth [2023-12-26 13:28:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001724928_441581568.pth [2023-12-26 13:28:09,282][123090] Updated weights for policy 1, policy_version 1725989 (0.0009) [2023-12-26 13:28:09,348][123090] Updated weights for policy 1, policy_version 1725999 (0.0011) [2023-12-26 13:28:09,387][123091] Updated weights for policy 0, policy_version 1737554 (0.0008) [2023-12-26 13:28:09,413][123090] Updated weights for policy 1, policy_version 1726009 (0.0010) [2023-12-26 13:28:09,458][123091] Updated weights for policy 0, policy_version 1737564 (0.0008) [2023-12-26 13:28:09,525][123091] Updated weights for policy 0, policy_version 1737574 (0.0009) [2023-12-26 13:28:09,596][123091] Updated weights for policy 0, policy_version 1737584 (0.0009) [2023-12-26 13:28:10,207][123090] Updated weights for policy 1, policy_version 1726019 (0.0011) [2023-12-26 13:28:10,281][123090] Updated weights for policy 1, policy_version 1726029 (0.0007) [2023-12-26 13:28:10,351][123090] Updated weights for policy 1, policy_version 1726039 (0.0007) [2023-12-26 13:28:10,435][123091] Updated weights for policy 0, policy_version 1737594 (0.0008) [2023-12-26 13:28:10,503][123091] Updated weights for policy 0, policy_version 1737604 (0.0009) [2023-12-26 13:28:10,570][123091] Updated weights for policy 0, policy_version 1737614 (0.0010) [2023-12-26 13:28:11,154][123090] Updated weights for policy 1, policy_version 1726049 (0.0009) [2023-12-26 13:28:11,212][123090] Updated weights for policy 1, policy_version 1726059 (0.0009) [2023-12-26 13:28:11,277][123090] Updated weights for policy 1, policy_version 1726069 (0.0009) [2023-12-26 13:28:11,335][123090] Updated weights for policy 1, policy_version 1726079 (0.0009) [2023-12-26 13:28:11,445][123091] Updated weights for policy 0, policy_version 1737624 (0.0010) [2023-12-26 13:28:11,499][123091] Updated weights for policy 0, policy_version 1737634 (0.0010) [2023-12-26 13:28:11,558][123091] Updated weights for policy 0, policy_version 1737644 (0.0010) [2023-12-26 13:28:12,220][123090] Updated weights for policy 1, policy_version 1726089 (0.0007) [2023-12-26 13:28:12,286][123090] Updated weights for policy 1, policy_version 1726099 (0.0010) [2023-12-26 13:28:12,354][123090] Updated weights for policy 1, policy_version 1726109 (0.0009) [2023-12-26 13:28:12,478][123091] Updated weights for policy 0, policy_version 1737654 (0.0010) [2023-12-26 13:28:12,532][123091] Updated weights for policy 0, policy_version 1737665 (0.0010) [2023-12-26 13:28:12,584][123091] Updated weights for policy 0, policy_version 1737675 (0.0010) [2023-12-26 13:28:13,071][123090] Updated weights for policy 1, policy_version 1726119 (0.0009) [2023-12-26 13:28:13,134][123090] Updated weights for policy 1, policy_version 1726129 (0.0009) [2023-12-26 13:28:13,197][123090] Updated weights for policy 1, policy_version 1726139 (0.0008) [2023-12-26 13:28:13,499][123091] Updated weights for policy 0, policy_version 1737685 (0.0010) [2023-12-26 13:28:13,566][123091] Updated weights for policy 0, policy_version 1737695 (0.0010) [2023-12-26 13:28:13,634][123091] Updated weights for policy 0, policy_version 1737705 (0.0009) [2023-12-26 13:28:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 886751232. Throughput: 0: 8870.4, 1: 8990.4. Samples: 886743640. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:28:13,784][121949] Avg episode reward: [(0, '6235.137'), (1, '5868.412')] [2023-12-26 13:28:13,958][123090] Updated weights for policy 1, policy_version 1726149 (0.0009) [2023-12-26 13:28:14,015][123090] Updated weights for policy 1, policy_version 1726159 (0.0009) [2023-12-26 13:28:14,078][123090] Updated weights for policy 1, policy_version 1726169 (0.0010) [2023-12-26 13:28:14,469][123091] Updated weights for policy 0, policy_version 1737715 (0.0009) [2023-12-26 13:28:14,523][123091] Updated weights for policy 0, policy_version 1737725 (0.0005) [2023-12-26 13:28:14,580][123091] Updated weights for policy 0, policy_version 1737735 (0.0006) [2023-12-26 13:28:14,899][123090] Updated weights for policy 1, policy_version 1726179 (0.0010) [2023-12-26 13:28:14,964][123090] Updated weights for policy 1, policy_version 1726189 (0.0010) [2023-12-26 13:28:15,026][123090] Updated weights for policy 1, policy_version 1726199 (0.0010) [2023-12-26 13:28:15,289][123091] Updated weights for policy 0, policy_version 1737745 (0.0008) [2023-12-26 13:28:15,357][123091] Updated weights for policy 0, policy_version 1737755 (0.0010) [2023-12-26 13:28:15,427][123091] Updated weights for policy 0, policy_version 1737765 (0.0010) [2023-12-26 13:28:15,492][123091] Updated weights for policy 0, policy_version 1737775 (0.0008) [2023-12-26 13:28:15,889][123090] Updated weights for policy 1, policy_version 1726209 (0.0008) [2023-12-26 13:28:15,957][123090] Updated weights for policy 1, policy_version 1726219 (0.0009) [2023-12-26 13:28:16,021][123090] Updated weights for policy 1, policy_version 1726229 (0.0009) [2023-12-26 13:28:16,089][123090] Updated weights for policy 1, policy_version 1726239 (0.0009) [2023-12-26 13:28:16,210][123091] Updated weights for policy 0, policy_version 1737785 (0.0009) [2023-12-26 13:28:16,266][123091] Updated weights for policy 0, policy_version 1737795 (0.0009) [2023-12-26 13:28:16,314][123091] Updated weights for policy 0, policy_version 1737805 (0.0009) [2023-12-26 13:28:16,875][123090] Updated weights for policy 1, policy_version 1726249 (0.0010) [2023-12-26 13:28:16,936][123090] Updated weights for policy 1, policy_version 1726259 (0.0009) [2023-12-26 13:28:16,990][123090] Updated weights for policy 1, policy_version 1726269 (0.0009) [2023-12-26 13:28:17,157][123091] Updated weights for policy 0, policy_version 1737816 (0.0008) [2023-12-26 13:28:17,226][123091] Updated weights for policy 0, policy_version 1737826 (0.0010) [2023-12-26 13:28:17,290][123091] Updated weights for policy 0, policy_version 1737836 (0.0009) [2023-12-26 13:28:17,832][123090] Updated weights for policy 1, policy_version 1726279 (0.0009) [2023-12-26 13:28:17,882][123090] Updated weights for policy 1, policy_version 1726289 (0.0009) [2023-12-26 13:28:17,932][123090] Updated weights for policy 1, policy_version 1726299 (0.0008) [2023-12-26 13:28:18,069][123091] Updated weights for policy 0, policy_version 1737846 (0.0010) [2023-12-26 13:28:18,124][123091] Updated weights for policy 0, policy_version 1737856 (0.0010) [2023-12-26 13:28:18,186][123091] Updated weights for policy 0, policy_version 1737866 (0.0010) [2023-12-26 13:28:18,784][121949] Fps is (10 sec: 16384.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 886833152. Throughput: 0: 8779.5, 1: 8934.0. Samples: 886848172. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:28:18,785][121949] Avg episode reward: [(0, '6189.096'), (1, '5795.936')] [2023-12-26 13:28:18,789][123090] Updated weights for policy 1, policy_version 1726309 (0.0009) [2023-12-26 13:28:18,851][123090] Updated weights for policy 1, policy_version 1726319 (0.0009) [2023-12-26 13:28:18,907][123090] Updated weights for policy 1, policy_version 1726329 (0.0009) [2023-12-26 13:28:19,060][123091] Updated weights for policy 0, policy_version 1737876 (0.0010) [2023-12-26 13:28:19,118][123091] Updated weights for policy 0, policy_version 1737886 (0.0010) [2023-12-26 13:28:19,175][123091] Updated weights for policy 0, policy_version 1737896 (0.0010) [2023-12-26 13:28:19,728][123090] Updated weights for policy 1, policy_version 1726339 (0.0010) [2023-12-26 13:28:19,791][123090] Updated weights for policy 1, policy_version 1726349 (0.0008) [2023-12-26 13:28:19,862][123090] Updated weights for policy 1, policy_version 1726359 (0.0008) [2023-12-26 13:28:20,082][123091] Updated weights for policy 0, policy_version 1737906 (0.0010) [2023-12-26 13:28:20,144][123091] Updated weights for policy 0, policy_version 1737916 (0.0006) [2023-12-26 13:28:20,206][123091] Updated weights for policy 0, policy_version 1737926 (0.0010) [2023-12-26 13:28:20,269][123091] Updated weights for policy 0, policy_version 1737936 (0.0008) [2023-12-26 13:28:20,712][123090] Updated weights for policy 1, policy_version 1726369 (0.0008) [2023-12-26 13:28:20,790][123090] Updated weights for policy 1, policy_version 1726379 (0.0006) [2023-12-26 13:28:20,865][123090] Updated weights for policy 1, policy_version 1726389 (0.0007) [2023-12-26 13:28:20,944][123090] Updated weights for policy 1, policy_version 1726399 (0.0006) [2023-12-26 13:28:21,042][123091] Updated weights for policy 0, policy_version 1737946 (0.0008) [2023-12-26 13:28:21,114][123091] Updated weights for policy 0, policy_version 1737956 (0.0009) [2023-12-26 13:28:21,179][123091] Updated weights for policy 0, policy_version 1737966 (0.0010) [2023-12-26 13:28:21,667][123090] Updated weights for policy 1, policy_version 1726409 (0.0009) [2023-12-26 13:28:21,741][123090] Updated weights for policy 1, policy_version 1726419 (0.0009) [2023-12-26 13:28:21,799][123090] Updated weights for policy 1, policy_version 1726429 (0.0009) [2023-12-26 13:28:22,028][123091] Updated weights for policy 0, policy_version 1737976 (0.0009) [2023-12-26 13:28:22,084][123091] Updated weights for policy 0, policy_version 1737986 (0.0008) [2023-12-26 13:28:22,142][123091] Updated weights for policy 0, policy_version 1737996 (0.0006) [2023-12-26 13:28:22,700][123090] Updated weights for policy 1, policy_version 1726439 (0.0010) [2023-12-26 13:28:22,751][123090] Updated weights for policy 1, policy_version 1726449 (0.0009) [2023-12-26 13:28:22,826][123090] Updated weights for policy 1, policy_version 1726459 (0.0010) [2023-12-26 13:28:22,933][123091] Updated weights for policy 0, policy_version 1738006 (0.0008) [2023-12-26 13:28:22,984][123091] Updated weights for policy 0, policy_version 1738016 (0.0010) [2023-12-26 13:28:23,035][123091] Updated weights for policy 0, policy_version 1738026 (0.0010) [2023-12-26 13:28:23,650][123090] Updated weights for policy 1, policy_version 1726469 (0.0009) [2023-12-26 13:28:23,699][123090] Updated weights for policy 1, policy_version 1726479 (0.0009) [2023-12-26 13:28:23,754][123090] Updated weights for policy 1, policy_version 1726489 (0.0008) [2023-12-26 13:28:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 886915072. Throughput: 0: 8763.2, 1: 8903.2. Samples: 886899344. Policy #0 lag: (min: 18.0, avg: 31.2, max: 32.0) [2023-12-26 13:28:23,785][121949] Avg episode reward: [(0, '6066.071'), (1, '5677.520')] [2023-12-26 13:28:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001726496_441982976.pth... [2023-12-26 13:28:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001738032_444940288.pth... [2023-12-26 13:28:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001725440_441712640.pth [2023-12-26 13:28:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001737008_444678144.pth [2023-12-26 13:28:23,911][123091] Updated weights for policy 0, policy_version 1738036 (0.0009) [2023-12-26 13:28:23,963][123091] Updated weights for policy 0, policy_version 1738046 (0.0009) [2023-12-26 13:28:24,013][123091] Updated weights for policy 0, policy_version 1738056 (0.0009) [2023-12-26 13:28:24,572][123090] Updated weights for policy 1, policy_version 1726499 (0.0009) [2023-12-26 13:28:24,629][123090] Updated weights for policy 1, policy_version 1726509 (0.0009) [2023-12-26 13:28:24,690][123090] Updated weights for policy 1, policy_version 1726519 (0.0008) [2023-12-26 13:28:24,863][123091] Updated weights for policy 0, policy_version 1738066 (0.0010) [2023-12-26 13:28:24,910][123091] Updated weights for policy 0, policy_version 1738076 (0.0006) [2023-12-26 13:28:24,958][123091] Updated weights for policy 0, policy_version 1738086 (0.0005) [2023-12-26 13:28:25,008][123091] Updated weights for policy 0, policy_version 1738096 (0.0005) [2023-12-26 13:28:25,404][123090] Updated weights for policy 1, policy_version 1726529 (0.0006) [2023-12-26 13:28:25,460][123090] Updated weights for policy 1, policy_version 1726539 (0.0007) [2023-12-26 13:28:25,529][123090] Updated weights for policy 1, policy_version 1726549 (0.0009) [2023-12-26 13:28:25,591][123090] Updated weights for policy 1, policy_version 1726559 (0.0007) [2023-12-26 13:28:25,670][123091] Updated weights for policy 0, policy_version 1738106 (0.0010) [2023-12-26 13:28:25,725][123091] Updated weights for policy 0, policy_version 1738116 (0.0010) [2023-12-26 13:28:25,778][123091] Updated weights for policy 0, policy_version 1738126 (0.0010) [2023-12-26 13:28:26,225][123090] Updated weights for policy 1, policy_version 1726569 (0.0008) [2023-12-26 13:28:26,281][123090] Updated weights for policy 1, policy_version 1726579 (0.0009) [2023-12-26 13:28:26,337][123090] Updated weights for policy 1, policy_version 1726589 (0.0009) [2023-12-26 13:28:26,645][123091] Updated weights for policy 0, policy_version 1738136 (0.0010) [2023-12-26 13:28:26,706][123091] Updated weights for policy 0, policy_version 1738146 (0.0006) [2023-12-26 13:28:26,773][123091] Updated weights for policy 0, policy_version 1738156 (0.0005) [2023-12-26 13:28:27,091][123090] Updated weights for policy 1, policy_version 1726599 (0.0006) [2023-12-26 13:28:27,138][123090] Updated weights for policy 1, policy_version 1726609 (0.0005) [2023-12-26 13:28:27,185][123090] Updated weights for policy 1, policy_version 1726619 (0.0005) [2023-12-26 13:28:27,524][123091] Updated weights for policy 0, policy_version 1738166 (0.0008) [2023-12-26 13:28:27,581][123091] Updated weights for policy 0, policy_version 1738177 (0.0009) [2023-12-26 13:28:27,634][123091] Updated weights for policy 0, policy_version 1738187 (0.0006) [2023-12-26 13:28:27,899][123090] Updated weights for policy 1, policy_version 1726629 (0.0007) [2023-12-26 13:28:27,954][123090] Updated weights for policy 1, policy_version 1726639 (0.0005) [2023-12-26 13:28:28,003][123090] Updated weights for policy 1, policy_version 1726649 (0.0005) [2023-12-26 13:28:28,463][123091] Updated weights for policy 0, policy_version 1738197 (0.0007) [2023-12-26 13:28:28,528][123091] Updated weights for policy 0, policy_version 1738207 (0.0010) [2023-12-26 13:28:28,590][123091] Updated weights for policy 0, policy_version 1738217 (0.0009) [2023-12-26 13:28:28,710][123090] Updated weights for policy 1, policy_version 1726659 (0.0007) [2023-12-26 13:28:28,776][123090] Updated weights for policy 1, policy_version 1726669 (0.0009) [2023-12-26 13:28:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 887013376. Throughput: 0: 8860.4, 1: 8909.7. Samples: 887007032. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:28,785][121949] Avg episode reward: [(0, '5959.569'), (1, '5719.665')] [2023-12-26 13:28:28,838][123090] Updated weights for policy 1, policy_version 1726679 (0.0010) [2023-12-26 13:28:29,366][123091] Updated weights for policy 0, policy_version 1738227 (0.0008) [2023-12-26 13:28:29,422][123091] Updated weights for policy 0, policy_version 1738237 (0.0008) [2023-12-26 13:28:29,475][123091] Updated weights for policy 0, policy_version 1738247 (0.0005) [2023-12-26 13:28:29,647][123090] Updated weights for policy 1, policy_version 1726689 (0.0011) [2023-12-26 13:28:29,699][123090] Updated weights for policy 1, policy_version 1726699 (0.0006) [2023-12-26 13:28:29,761][123090] Updated weights for policy 1, policy_version 1726709 (0.0010) [2023-12-26 13:28:29,824][123090] Updated weights for policy 1, policy_version 1726719 (0.0010) [2023-12-26 13:28:30,181][123091] Updated weights for policy 0, policy_version 1738257 (0.0006) [2023-12-26 13:28:30,234][123091] Updated weights for policy 0, policy_version 1738267 (0.0005) [2023-12-26 13:28:30,298][123091] Updated weights for policy 0, policy_version 1738277 (0.0006) [2023-12-26 13:28:30,358][123091] Updated weights for policy 0, policy_version 1738287 (0.0005) [2023-12-26 13:28:30,614][123090] Updated weights for policy 1, policy_version 1726729 (0.0010) [2023-12-26 13:28:30,670][123090] Updated weights for policy 1, policy_version 1726739 (0.0010) [2023-12-26 13:28:30,747][123090] Updated weights for policy 1, policy_version 1726749 (0.0009) [2023-12-26 13:28:30,978][123091] Updated weights for policy 0, policy_version 1738297 (0.0007) [2023-12-26 13:28:31,038][123091] Updated weights for policy 0, policy_version 1738307 (0.0006) [2023-12-26 13:28:31,107][123091] Updated weights for policy 0, policy_version 1738317 (0.0006) [2023-12-26 13:28:31,534][123090] Updated weights for policy 1, policy_version 1726759 (0.0007) [2023-12-26 13:28:31,598][123090] Updated weights for policy 1, policy_version 1726769 (0.0007) [2023-12-26 13:28:31,664][123090] Updated weights for policy 1, policy_version 1726779 (0.0010) [2023-12-26 13:28:31,848][123091] Updated weights for policy 0, policy_version 1738327 (0.0009) [2023-12-26 13:28:31,908][123091] Updated weights for policy 0, policy_version 1738337 (0.0009) [2023-12-26 13:28:31,979][123091] Updated weights for policy 0, policy_version 1738347 (0.0007) [2023-12-26 13:28:32,380][123090] Updated weights for policy 1, policy_version 1726789 (0.0008) [2023-12-26 13:28:32,453][123090] Updated weights for policy 1, policy_version 1726799 (0.0010) [2023-12-26 13:28:32,512][123090] Updated weights for policy 1, policy_version 1726809 (0.0010) [2023-12-26 13:28:32,639][123091] Updated weights for policy 0, policy_version 1738357 (0.0007) [2023-12-26 13:28:32,694][123091] Updated weights for policy 0, policy_version 1738367 (0.0005) [2023-12-26 13:28:32,753][123091] Updated weights for policy 0, policy_version 1738377 (0.0005) [2023-12-26 13:28:33,303][123090] Updated weights for policy 1, policy_version 1726819 (0.0010) [2023-12-26 13:28:33,349][123090] Updated weights for policy 1, policy_version 1726829 (0.0010) [2023-12-26 13:28:33,392][123090] Updated weights for policy 1, policy_version 1726839 (0.0010) [2023-12-26 13:28:33,528][123091] Updated weights for policy 0, policy_version 1738387 (0.0005) [2023-12-26 13:28:33,580][123091] Updated weights for policy 0, policy_version 1738397 (0.0005) [2023-12-26 13:28:33,638][123091] Updated weights for policy 0, policy_version 1738407 (0.0005) [2023-12-26 13:28:33,784][121949] Fps is (10 sec: 19660.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 887111680. Throughput: 0: 8938.4, 1: 8928.3. Samples: 887119084. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:33,785][121949] Avg episode reward: [(0, '5967.716'), (1, '5883.165')] [2023-12-26 13:28:34,214][123090] Updated weights for policy 1, policy_version 1726849 (0.0010) [2023-12-26 13:28:34,244][123091] Updated weights for policy 0, policy_version 1738417 (0.0006) [2023-12-26 13:28:34,271][123090] Updated weights for policy 1, policy_version 1726859 (0.0009) [2023-12-26 13:28:34,309][123091] Updated weights for policy 0, policy_version 1738427 (0.0009) [2023-12-26 13:28:34,333][123090] Updated weights for policy 1, policy_version 1726869 (0.0009) [2023-12-26 13:28:34,373][123091] Updated weights for policy 0, policy_version 1738437 (0.0009) [2023-12-26 13:28:34,382][123090] Updated weights for policy 1, policy_version 1726879 (0.0009) [2023-12-26 13:28:34,438][123091] Updated weights for policy 0, policy_version 1738447 (0.0009) [2023-12-26 13:28:35,189][123091] Updated weights for policy 0, policy_version 1738457 (0.0006) [2023-12-26 13:28:35,252][123091] Updated weights for policy 0, policy_version 1738468 (0.0007) [2023-12-26 13:28:35,271][123090] Updated weights for policy 1, policy_version 1726889 (0.0006) [2023-12-26 13:28:35,297][123091] Updated weights for policy 0, policy_version 1738478 (0.0005) [2023-12-26 13:28:35,322][123090] Updated weights for policy 1, policy_version 1726899 (0.0007) [2023-12-26 13:28:35,372][123090] Updated weights for policy 1, policy_version 1726909 (0.0009) [2023-12-26 13:28:35,961][123091] Updated weights for policy 0, policy_version 1738488 (0.0008) [2023-12-26 13:28:36,009][123091] Updated weights for policy 0, policy_version 1738498 (0.0008) [2023-12-26 13:28:36,065][123091] Updated weights for policy 0, policy_version 1738508 (0.0009) [2023-12-26 13:28:36,199][123090] Updated weights for policy 1, policy_version 1726919 (0.0007) [2023-12-26 13:28:36,261][123090] Updated weights for policy 1, policy_version 1726929 (0.0010) [2023-12-26 13:28:36,329][123090] Updated weights for policy 1, policy_version 1726939 (0.0011) [2023-12-26 13:28:36,894][123091] Updated weights for policy 0, policy_version 1738518 (0.0010) [2023-12-26 13:28:36,965][123091] Updated weights for policy 0, policy_version 1738528 (0.0011) [2023-12-26 13:28:37,028][123091] Updated weights for policy 0, policy_version 1738538 (0.0011) [2023-12-26 13:28:37,156][123090] Updated weights for policy 1, policy_version 1726949 (0.0011) [2023-12-26 13:28:37,209][123090] Updated weights for policy 1, policy_version 1726959 (0.0011) [2023-12-26 13:28:37,268][123090] Updated weights for policy 1, policy_version 1726969 (0.0011) [2023-12-26 13:28:37,749][123091] Updated weights for policy 0, policy_version 1738548 (0.0009) [2023-12-26 13:28:37,799][123091] Updated weights for policy 0, policy_version 1738558 (0.0007) [2023-12-26 13:28:37,853][123091] Updated weights for policy 0, policy_version 1738568 (0.0007) [2023-12-26 13:28:38,012][123090] Updated weights for policy 1, policy_version 1726979 (0.0009) [2023-12-26 13:28:38,073][123090] Updated weights for policy 1, policy_version 1726989 (0.0006) [2023-12-26 13:28:38,130][123090] Updated weights for policy 1, policy_version 1726999 (0.0006) [2023-12-26 13:28:38,722][123091] Updated weights for policy 0, policy_version 1738578 (0.0009) [2023-12-26 13:28:38,779][123091] Updated weights for policy 0, policy_version 1738588 (0.0010) [2023-12-26 13:28:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 887193600. Throughput: 0: 9040.4, 1: 8948.7. Samples: 887174584. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:38,785][121949] Avg episode reward: [(0, '6106.996'), (1, '5749.076')] [2023-12-26 13:28:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001727008_442114048.pth... [2023-12-26 13:28:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001725984_441851904.pth [2023-12-26 13:28:38,831][123091] Updated weights for policy 0, policy_version 1738598 (0.0009) [2023-12-26 13:28:38,840][123090] Updated weights for policy 1, policy_version 1727009 (0.0006) [2023-12-26 13:28:38,882][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001738608_445087744.pth... [2023-12-26 13:28:38,885][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001737552_444817408.pth [2023-12-26 13:28:38,886][123091] Updated weights for policy 0, policy_version 1738608 (0.0009) [2023-12-26 13:28:38,896][123090] Updated weights for policy 1, policy_version 1727019 (0.0005) [2023-12-26 13:28:38,961][123090] Updated weights for policy 1, policy_version 1727029 (0.0005) [2023-12-26 13:28:39,028][123090] Updated weights for policy 1, policy_version 1727039 (0.0005) [2023-12-26 13:28:39,766][123090] Updated weights for policy 1, policy_version 1727049 (0.0010) [2023-12-26 13:28:39,782][123091] Updated weights for policy 0, policy_version 1738618 (0.0008) [2023-12-26 13:28:39,844][123090] Updated weights for policy 1, policy_version 1727060 (0.0010) [2023-12-26 13:28:39,848][123091] Updated weights for policy 0, policy_version 1738628 (0.0007) [2023-12-26 13:28:39,902][123090] Updated weights for policy 1, policy_version 1727070 (0.0007) [2023-12-26 13:28:39,908][123091] Updated weights for policy 0, policy_version 1738638 (0.0009) [2023-12-26 13:28:40,659][123090] Updated weights for policy 1, policy_version 1727080 (0.0010) [2023-12-26 13:28:40,679][123091] Updated weights for policy 0, policy_version 1738648 (0.0006) [2023-12-26 13:28:40,732][123090] Updated weights for policy 1, policy_version 1727090 (0.0011) [2023-12-26 13:28:40,745][123091] Updated weights for policy 0, policy_version 1738658 (0.0008) [2023-12-26 13:28:40,794][123090] Updated weights for policy 1, policy_version 1727100 (0.0007) [2023-12-26 13:28:40,810][123091] Updated weights for policy 0, policy_version 1738668 (0.0009) [2023-12-26 13:28:41,542][123091] Updated weights for policy 0, policy_version 1738678 (0.0007) [2023-12-26 13:28:41,593][123091] Updated weights for policy 0, policy_version 1738688 (0.0008) [2023-12-26 13:28:41,666][123091] Updated weights for policy 0, policy_version 1738698 (0.0007) [2023-12-26 13:28:41,669][123090] Updated weights for policy 1, policy_version 1727110 (0.0008) [2023-12-26 13:28:41,741][123090] Updated weights for policy 1, policy_version 1727120 (0.0008) [2023-12-26 13:28:41,807][123090] Updated weights for policy 1, policy_version 1727130 (0.0010) [2023-12-26 13:28:42,518][123091] Updated weights for policy 0, policy_version 1738708 (0.0010) [2023-12-26 13:28:42,575][123091] Updated weights for policy 0, policy_version 1738718 (0.0009) [2023-12-26 13:28:42,634][123091] Updated weights for policy 0, policy_version 1738728 (0.0008) [2023-12-26 13:28:42,671][123090] Updated weights for policy 1, policy_version 1727140 (0.0009) [2023-12-26 13:28:42,738][123090] Updated weights for policy 1, policy_version 1727150 (0.0006) [2023-12-26 13:28:42,802][123090] Updated weights for policy 1, policy_version 1727160 (0.0009) [2023-12-26 13:28:43,376][123091] Updated weights for policy 0, policy_version 1738738 (0.0010) [2023-12-26 13:28:43,436][123091] Updated weights for policy 0, policy_version 1738748 (0.0011) [2023-12-26 13:28:43,491][123091] Updated weights for policy 0, policy_version 1738758 (0.0008) [2023-12-26 13:28:43,538][123091] Updated weights for policy 0, policy_version 1738768 (0.0005) [2023-12-26 13:28:43,579][123090] Updated weights for policy 1, policy_version 1727170 (0.0010) [2023-12-26 13:28:43,651][123090] Updated weights for policy 1, policy_version 1727180 (0.0007) [2023-12-26 13:28:43,718][123090] Updated weights for policy 1, policy_version 1727190 (0.0010) [2023-12-26 13:28:43,770][123090] Updated weights for policy 1, policy_version 1727200 (0.0010) [2023-12-26 13:28:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 887291904. Throughput: 0: 8992.1, 1: 8973.2. Samples: 887280204. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:43,785][121949] Avg episode reward: [(0, '6060.187'), (1, '5550.003')] [2023-12-26 13:28:44,241][123091] Updated weights for policy 0, policy_version 1738778 (0.0006) [2023-12-26 13:28:44,304][123091] Updated weights for policy 0, policy_version 1738788 (0.0009) [2023-12-26 13:28:44,355][123091] Updated weights for policy 0, policy_version 1738798 (0.0010) [2023-12-26 13:28:44,536][123090] Updated weights for policy 1, policy_version 1727210 (0.0005) [2023-12-26 13:28:44,581][123090] Updated weights for policy 1, policy_version 1727220 (0.0005) [2023-12-26 13:28:44,630][123090] Updated weights for policy 1, policy_version 1727230 (0.0008) [2023-12-26 13:28:45,143][123091] Updated weights for policy 0, policy_version 1738808 (0.0011) [2023-12-26 13:28:45,206][123091] Updated weights for policy 0, policy_version 1738818 (0.0011) [2023-12-26 13:28:45,263][123091] Updated weights for policy 0, policy_version 1738828 (0.0011) [2023-12-26 13:28:45,424][123090] Updated weights for policy 1, policy_version 1727240 (0.0007) [2023-12-26 13:28:45,480][123090] Updated weights for policy 1, policy_version 1727250 (0.0010) [2023-12-26 13:28:45,528][123090] Updated weights for policy 1, policy_version 1727260 (0.0010) [2023-12-26 13:28:46,092][123091] Updated weights for policy 0, policy_version 1738838 (0.0011) [2023-12-26 13:28:46,139][123091] Updated weights for policy 0, policy_version 1738848 (0.0010) [2023-12-26 13:28:46,183][123091] Updated weights for policy 0, policy_version 1738858 (0.0007) [2023-12-26 13:28:46,251][123090] Updated weights for policy 1, policy_version 1727270 (0.0010) [2023-12-26 13:28:46,299][123090] Updated weights for policy 1, policy_version 1727280 (0.0010) [2023-12-26 13:28:46,346][123090] Updated weights for policy 1, policy_version 1727290 (0.0010) [2023-12-26 13:28:46,925][123091] Updated weights for policy 0, policy_version 1738868 (0.0007) [2023-12-26 13:28:46,979][123091] Updated weights for policy 0, policy_version 1738878 (0.0010) [2023-12-26 13:28:47,027][123091] Updated weights for policy 0, policy_version 1738888 (0.0011) [2023-12-26 13:28:47,187][123090] Updated weights for policy 1, policy_version 1727300 (0.0010) [2023-12-26 13:28:47,235][123090] Updated weights for policy 1, policy_version 1727310 (0.0010) [2023-12-26 13:28:47,294][123090] Updated weights for policy 1, policy_version 1727320 (0.0010) [2023-12-26 13:28:47,836][123091] Updated weights for policy 0, policy_version 1738898 (0.0010) [2023-12-26 13:28:47,901][123091] Updated weights for policy 0, policy_version 1738908 (0.0010) [2023-12-26 13:28:47,964][123091] Updated weights for policy 0, policy_version 1738918 (0.0009) [2023-12-26 13:28:48,031][123091] Updated weights for policy 0, policy_version 1738928 (0.0009) [2023-12-26 13:28:48,109][123090] Updated weights for policy 1, policy_version 1727330 (0.0010) [2023-12-26 13:28:48,157][123090] Updated weights for policy 1, policy_version 1727340 (0.0009) [2023-12-26 13:28:48,205][123090] Updated weights for policy 1, policy_version 1727350 (0.0010) [2023-12-26 13:28:48,248][123090] Updated weights for policy 1, policy_version 1727360 (0.0010) [2023-12-26 13:28:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 887373824. Throughput: 0: 8995.6, 1: 8950.2. Samples: 887388968. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:48,785][121949] Avg episode reward: [(0, '6076.705'), (1, '5570.383')] [2023-12-26 13:28:48,836][123091] Updated weights for policy 0, policy_version 1738938 (0.0009) [2023-12-26 13:28:48,885][123091] Updated weights for policy 0, policy_version 1738948 (0.0009) [2023-12-26 13:28:48,934][123091] Updated weights for policy 0, policy_version 1738958 (0.0009) [2023-12-26 13:28:49,140][123090] Updated weights for policy 1, policy_version 1727370 (0.0010) [2023-12-26 13:28:49,206][123090] Updated weights for policy 1, policy_version 1727380 (0.0010) [2023-12-26 13:28:49,274][123090] Updated weights for policy 1, policy_version 1727390 (0.0010) [2023-12-26 13:28:49,778][123091] Updated weights for policy 0, policy_version 1738968 (0.0006) [2023-12-26 13:28:49,846][123091] Updated weights for policy 0, policy_version 1738978 (0.0009) [2023-12-26 13:28:49,911][123091] Updated weights for policy 0, policy_version 1738988 (0.0010) [2023-12-26 13:28:50,046][123090] Updated weights for policy 1, policy_version 1727400 (0.0011) [2023-12-26 13:28:50,108][123090] Updated weights for policy 1, policy_version 1727410 (0.0012) [2023-12-26 13:28:50,168][123090] Updated weights for policy 1, policy_version 1727420 (0.0010) [2023-12-26 13:28:50,735][123091] Updated weights for policy 0, policy_version 1738998 (0.0008) [2023-12-26 13:28:50,788][123091] Updated weights for policy 0, policy_version 1739008 (0.0009) [2023-12-26 13:28:50,841][123091] Updated weights for policy 0, policy_version 1739018 (0.0009) [2023-12-26 13:28:50,932][123090] Updated weights for policy 1, policy_version 1727430 (0.0010) [2023-12-26 13:28:50,989][123090] Updated weights for policy 1, policy_version 1727440 (0.0010) [2023-12-26 13:28:51,065][123090] Updated weights for policy 1, policy_version 1727450 (0.0008) [2023-12-26 13:28:51,687][123091] Updated weights for policy 0, policy_version 1739028 (0.0008) [2023-12-26 13:28:51,760][123091] Updated weights for policy 0, policy_version 1739038 (0.0008) [2023-12-26 13:28:51,822][123091] Updated weights for policy 0, policy_version 1739048 (0.0009) [2023-12-26 13:28:51,852][123090] Updated weights for policy 1, policy_version 1727460 (0.0007) [2023-12-26 13:28:51,924][123090] Updated weights for policy 1, policy_version 1727470 (0.0009) [2023-12-26 13:28:51,993][123090] Updated weights for policy 1, policy_version 1727480 (0.0009) [2023-12-26 13:28:52,572][123091] Updated weights for policy 0, policy_version 1739058 (0.0009) [2023-12-26 13:28:52,624][123091] Updated weights for policy 0, policy_version 1739068 (0.0009) [2023-12-26 13:28:52,684][123091] Updated weights for policy 0, policy_version 1739078 (0.0009) [2023-12-26 13:28:52,750][123090] Updated weights for policy 1, policy_version 1727490 (0.0010) [2023-12-26 13:28:52,751][123091] Updated weights for policy 0, policy_version 1739088 (0.0008) [2023-12-26 13:28:52,823][123090] Updated weights for policy 1, policy_version 1727500 (0.0010) [2023-12-26 13:28:52,876][123090] Updated weights for policy 1, policy_version 1727510 (0.0008) [2023-12-26 13:28:52,930][123090] Updated weights for policy 1, policy_version 1727520 (0.0005) [2023-12-26 13:28:53,570][123090] Updated weights for policy 1, policy_version 1727530 (0.0006) [2023-12-26 13:28:53,625][123090] Updated weights for policy 1, policy_version 1727540 (0.0008) [2023-12-26 13:28:53,627][123091] Updated weights for policy 0, policy_version 1739098 (0.0008) [2023-12-26 13:28:53,688][123091] Updated weights for policy 0, policy_version 1739108 (0.0005) [2023-12-26 13:28:53,693][123090] Updated weights for policy 1, policy_version 1727550 (0.0008) [2023-12-26 13:28:53,758][123091] Updated weights for policy 0, policy_version 1739118 (0.0006) [2023-12-26 13:28:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 887472128. Throughput: 0: 8935.0, 1: 8896.2. Samples: 887441484. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:53,785][121949] Avg episode reward: [(0, '6110.119'), (1, '5498.902')] [2023-12-26 13:28:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001739120_445218816.pth... [2023-12-26 13:28:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001727552_442253312.pth... [2023-12-26 13:28:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001726496_441982976.pth [2023-12-26 13:28:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001738032_444940288.pth [2023-12-26 13:28:54,471][123091] Updated weights for policy 0, policy_version 1739128 (0.0010) [2023-12-26 13:28:54,525][123090] Updated weights for policy 1, policy_version 1727560 (0.0006) [2023-12-26 13:28:54,537][123091] Updated weights for policy 0, policy_version 1739138 (0.0009) [2023-12-26 13:28:54,581][123090] Updated weights for policy 1, policy_version 1727570 (0.0005) [2023-12-26 13:28:54,606][123091] Updated weights for policy 0, policy_version 1739148 (0.0008) [2023-12-26 13:28:54,642][123090] Updated weights for policy 1, policy_version 1727580 (0.0005) [2023-12-26 13:28:55,376][123091] Updated weights for policy 0, policy_version 1739158 (0.0007) [2023-12-26 13:28:55,406][123090] Updated weights for policy 1, policy_version 1727590 (0.0008) [2023-12-26 13:28:55,434][123091] Updated weights for policy 0, policy_version 1739168 (0.0006) [2023-12-26 13:28:55,462][123090] Updated weights for policy 1, policy_version 1727600 (0.0010) [2023-12-26 13:28:55,483][123091] Updated weights for policy 0, policy_version 1739178 (0.0006) [2023-12-26 13:28:55,515][123090] Updated weights for policy 1, policy_version 1727610 (0.0010) [2023-12-26 13:28:56,269][123090] Updated weights for policy 1, policy_version 1727620 (0.0010) [2023-12-26 13:28:56,285][123091] Updated weights for policy 0, policy_version 1739188 (0.0006) [2023-12-26 13:28:56,337][123090] Updated weights for policy 1, policy_version 1727630 (0.0011) [2023-12-26 13:28:56,350][123091] Updated weights for policy 0, policy_version 1739198 (0.0006) [2023-12-26 13:28:56,400][123090] Updated weights for policy 1, policy_version 1727640 (0.0010) [2023-12-26 13:28:56,408][123091] Updated weights for policy 0, policy_version 1739208 (0.0005) [2023-12-26 13:28:57,159][123090] Updated weights for policy 1, policy_version 1727650 (0.0010) [2023-12-26 13:28:57,231][123091] Updated weights for policy 0, policy_version 1739218 (0.0010) [2023-12-26 13:28:57,236][123090] Updated weights for policy 1, policy_version 1727660 (0.0008) [2023-12-26 13:28:57,296][123091] Updated weights for policy 0, policy_version 1739228 (0.0007) [2023-12-26 13:28:57,303][123090] Updated weights for policy 1, policy_version 1727670 (0.0010) [2023-12-26 13:28:57,357][123090] Updated weights for policy 1, policy_version 1727680 (0.0007) [2023-12-26 13:28:57,360][123091] Updated weights for policy 0, policy_version 1739238 (0.0007) [2023-12-26 13:28:57,414][123091] Updated weights for policy 0, policy_version 1739248 (0.0010) [2023-12-26 13:28:57,948][123090] Updated weights for policy 1, policy_version 1727690 (0.0006) [2023-12-26 13:28:58,003][123090] Updated weights for policy 1, policy_version 1727700 (0.0005) [2023-12-26 13:28:58,081][123090] Updated weights for policy 1, policy_version 1727710 (0.0007) [2023-12-26 13:28:58,223][123091] Updated weights for policy 0, policy_version 1739258 (0.0010) [2023-12-26 13:28:58,285][123091] Updated weights for policy 0, policy_version 1739268 (0.0010) [2023-12-26 13:28:58,355][123091] Updated weights for policy 0, policy_version 1739278 (0.0011) [2023-12-26 13:28:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 887554048. Throughput: 0: 8976.6, 1: 8943.0. Samples: 887550024. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:28:58,785][121949] Avg episode reward: [(0, '6143.665'), (1, '5520.561')] [2023-12-26 13:28:58,897][123090] Updated weights for policy 1, policy_version 1727720 (0.0009) [2023-12-26 13:28:58,960][123090] Updated weights for policy 1, policy_version 1727730 (0.0009) [2023-12-26 13:28:59,022][123090] Updated weights for policy 1, policy_version 1727740 (0.0009) [2023-12-26 13:28:59,156][123091] Updated weights for policy 0, policy_version 1739288 (0.0007) [2023-12-26 13:28:59,221][123091] Updated weights for policy 0, policy_version 1739298 (0.0006) [2023-12-26 13:28:59,288][123091] Updated weights for policy 0, policy_version 1739308 (0.0009) [2023-12-26 13:28:59,806][123090] Updated weights for policy 1, policy_version 1727750 (0.0006) [2023-12-26 13:28:59,878][123090] Updated weights for policy 1, policy_version 1727760 (0.0006) [2023-12-26 13:28:59,946][123090] Updated weights for policy 1, policy_version 1727770 (0.0006) [2023-12-26 13:29:00,089][123091] Updated weights for policy 0, policy_version 1739318 (0.0007) [2023-12-26 13:29:00,157][123091] Updated weights for policy 0, policy_version 1739328 (0.0005) [2023-12-26 13:29:00,211][123091] Updated weights for policy 0, policy_version 1739338 (0.0005) [2023-12-26 13:29:00,692][123090] Updated weights for policy 1, policy_version 1727780 (0.0006) [2023-12-26 13:29:00,749][123090] Updated weights for policy 1, policy_version 1727790 (0.0005) [2023-12-26 13:29:00,801][123090] Updated weights for policy 1, policy_version 1727800 (0.0005) [2023-12-26 13:29:00,964][123091] Updated weights for policy 0, policy_version 1739348 (0.0007) [2023-12-26 13:29:01,024][123091] Updated weights for policy 0, policy_version 1739358 (0.0005) [2023-12-26 13:29:01,096][123091] Updated weights for policy 0, policy_version 1739368 (0.0010) [2023-12-26 13:29:01,523][123090] Updated weights for policy 1, policy_version 1727810 (0.0006) [2023-12-26 13:29:01,579][123090] Updated weights for policy 1, policy_version 1727820 (0.0009) [2023-12-26 13:29:01,643][123090] Updated weights for policy 1, policy_version 1727830 (0.0007) [2023-12-26 13:29:01,709][123090] Updated weights for policy 1, policy_version 1727840 (0.0006) [2023-12-26 13:29:01,864][123091] Updated weights for policy 0, policy_version 1739378 (0.0006) [2023-12-26 13:29:01,923][123091] Updated weights for policy 0, policy_version 1739388 (0.0005) [2023-12-26 13:29:01,989][123091] Updated weights for policy 0, policy_version 1739398 (0.0005) [2023-12-26 13:29:02,058][123091] Updated weights for policy 0, policy_version 1739408 (0.0005) [2023-12-26 13:29:02,496][123090] Updated weights for policy 1, policy_version 1727850 (0.0008) [2023-12-26 13:29:02,577][123090] Updated weights for policy 1, policy_version 1727860 (0.0010) [2023-12-26 13:29:02,630][123090] Updated weights for policy 1, policy_version 1727870 (0.0009) [2023-12-26 13:29:02,683][123091] Updated weights for policy 0, policy_version 1739418 (0.0007) [2023-12-26 13:29:02,731][123091] Updated weights for policy 0, policy_version 1739428 (0.0010) [2023-12-26 13:29:02,793][123091] Updated weights for policy 0, policy_version 1739438 (0.0010) [2023-12-26 13:29:03,471][123090] Updated weights for policy 1, policy_version 1727880 (0.0009) [2023-12-26 13:29:03,530][123090] Updated weights for policy 1, policy_version 1727890 (0.0008) [2023-12-26 13:29:03,584][123090] Updated weights for policy 1, policy_version 1727900 (0.0009) [2023-12-26 13:29:03,584][123091] Updated weights for policy 0, policy_version 1739448 (0.0010) [2023-12-26 13:29:03,636][123091] Updated weights for policy 0, policy_version 1739458 (0.0010) [2023-12-26 13:29:03,693][123091] Updated weights for policy 0, policy_version 1739468 (0.0011) [2023-12-26 13:29:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.5, 300 sec: 17828.0). Total num frames: 887652352. Throughput: 0: 9013.5, 1: 8976.4. Samples: 887657716. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:03,784][121949] Avg episode reward: [(0, '6143.250'), (1, '5620.220')] [2023-12-26 13:29:04,429][123090] Updated weights for policy 1, policy_version 1727910 (0.0009) [2023-12-26 13:29:04,485][123090] Updated weights for policy 1, policy_version 1727920 (0.0009) [2023-12-26 13:29:04,513][123091] Updated weights for policy 0, policy_version 1739479 (0.0009) [2023-12-26 13:29:04,543][123090] Updated weights for policy 1, policy_version 1727930 (0.0009) [2023-12-26 13:29:04,573][123091] Updated weights for policy 0, policy_version 1739489 (0.0005) [2023-12-26 13:29:04,638][123091] Updated weights for policy 0, policy_version 1739499 (0.0009) [2023-12-26 13:29:05,343][123090] Updated weights for policy 1, policy_version 1727940 (0.0009) [2023-12-26 13:29:05,345][123091] Updated weights for policy 0, policy_version 1739509 (0.0008) [2023-12-26 13:29:05,394][123091] Updated weights for policy 0, policy_version 1739519 (0.0007) [2023-12-26 13:29:05,403][123090] Updated weights for policy 1, policy_version 1727950 (0.0009) [2023-12-26 13:29:05,439][123091] Updated weights for policy 0, policy_version 1739529 (0.0008) [2023-12-26 13:29:05,467][123090] Updated weights for policy 1, policy_version 1727960 (0.0006) [2023-12-26 13:29:06,076][123090] Updated weights for policy 1, policy_version 1727970 (0.0005) [2023-12-26 13:29:06,148][123090] Updated weights for policy 1, policy_version 1727980 (0.0008) [2023-12-26 13:29:06,173][123091] Updated weights for policy 0, policy_version 1739539 (0.0005) [2023-12-26 13:29:06,219][123090] Updated weights for policy 1, policy_version 1727990 (0.0008) [2023-12-26 13:29:06,223][123091] Updated weights for policy 0, policy_version 1739549 (0.0008) [2023-12-26 13:29:06,273][123091] Updated weights for policy 0, policy_version 1739559 (0.0007) [2023-12-26 13:29:06,282][123090] Updated weights for policy 1, policy_version 1728000 (0.0008) [2023-12-26 13:29:07,036][123090] Updated weights for policy 1, policy_version 1728010 (0.0006) [2023-12-26 13:29:07,087][123090] Updated weights for policy 1, policy_version 1728020 (0.0009) [2023-12-26 13:29:07,146][123090] Updated weights for policy 1, policy_version 1728030 (0.0008) [2023-12-26 13:29:07,151][123091] Updated weights for policy 0, policy_version 1739569 (0.0010) [2023-12-26 13:29:07,213][123091] Updated weights for policy 0, policy_version 1739579 (0.0007) [2023-12-26 13:29:07,262][123091] Updated weights for policy 0, policy_version 1739589 (0.0005) [2023-12-26 13:29:07,323][123091] Updated weights for policy 0, policy_version 1739599 (0.0005) [2023-12-26 13:29:07,932][123090] Updated weights for policy 1, policy_version 1728040 (0.0005) [2023-12-26 13:29:07,988][123090] Updated weights for policy 1, policy_version 1728050 (0.0006) [2023-12-26 13:29:08,053][123090] Updated weights for policy 1, policy_version 1728060 (0.0007) [2023-12-26 13:29:08,067][123091] Updated weights for policy 0, policy_version 1739609 (0.0006) [2023-12-26 13:29:08,143][123091] Updated weights for policy 0, policy_version 1739619 (0.0006) [2023-12-26 13:29:08,221][123091] Updated weights for policy 0, policy_version 1739629 (0.0005) [2023-12-26 13:29:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 887734272. Throughput: 0: 9060.1, 1: 9026.4. Samples: 887713236. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:08,785][121949] Avg episode reward: [(0, '6183.787'), (1, '5717.718')] [2023-12-26 13:29:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001739632_445349888.pth... [2023-12-26 13:29:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001738608_445087744.pth [2023-12-26 13:29:08,804][123090] Updated weights for policy 1, policy_version 1728070 (0.0009) [2023-12-26 13:29:08,859][123090] Updated weights for policy 1, policy_version 1728080 (0.0010) [2023-12-26 13:29:08,888][123091] Updated weights for policy 0, policy_version 1739639 (0.0006) [2023-12-26 13:29:08,923][123090] Updated weights for policy 1, policy_version 1728090 (0.0011) [2023-12-26 13:29:08,942][123091] Updated weights for policy 0, policy_version 1739649 (0.0009) [2023-12-26 13:29:08,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001728096_442392576.pth... [2023-12-26 13:29:08,962][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001727008_442114048.pth [2023-12-26 13:29:08,992][123091] Updated weights for policy 0, policy_version 1739659 (0.0008) [2023-12-26 13:29:09,758][123091] Updated weights for policy 0, policy_version 1739669 (0.0007) [2023-12-26 13:29:09,761][123090] Updated weights for policy 1, policy_version 1728100 (0.0011) [2023-12-26 13:29:09,810][123090] Updated weights for policy 1, policy_version 1728110 (0.0010) [2023-12-26 13:29:09,822][123091] Updated weights for policy 0, policy_version 1739679 (0.0006) [2023-12-26 13:29:09,875][123090] Updated weights for policy 1, policy_version 1728120 (0.0008) [2023-12-26 13:29:09,878][123091] Updated weights for policy 0, policy_version 1739689 (0.0009) [2023-12-26 13:29:10,621][123090] Updated weights for policy 1, policy_version 1728130 (0.0009) [2023-12-26 13:29:10,684][123090] Updated weights for policy 1, policy_version 1728140 (0.0006) [2023-12-26 13:29:10,734][123091] Updated weights for policy 0, policy_version 1739699 (0.0008) [2023-12-26 13:29:10,751][123090] Updated weights for policy 1, policy_version 1728150 (0.0011) [2023-12-26 13:29:10,802][123091] Updated weights for policy 0, policy_version 1739709 (0.0005) [2023-12-26 13:29:10,818][123090] Updated weights for policy 1, policy_version 1728160 (0.0010) [2023-12-26 13:29:10,871][123091] Updated weights for policy 0, policy_version 1739719 (0.0006) [2023-12-26 13:29:11,618][123090] Updated weights for policy 1, policy_version 1728170 (0.0010) [2023-12-26 13:29:11,676][123091] Updated weights for policy 0, policy_version 1739729 (0.0006) [2023-12-26 13:29:11,679][123090] Updated weights for policy 1, policy_version 1728180 (0.0009) [2023-12-26 13:29:11,740][123091] Updated weights for policy 0, policy_version 1739739 (0.0008) [2023-12-26 13:29:11,746][123090] Updated weights for policy 1, policy_version 1728190 (0.0009) [2023-12-26 13:29:11,795][123091] Updated weights for policy 0, policy_version 1739749 (0.0007) [2023-12-26 13:29:11,874][123091] Updated weights for policy 0, policy_version 1739759 (0.0006) [2023-12-26 13:29:12,582][123090] Updated weights for policy 1, policy_version 1728200 (0.0006) [2023-12-26 13:29:12,652][123090] Updated weights for policy 1, policy_version 1728210 (0.0006) [2023-12-26 13:29:12,684][123091] Updated weights for policy 0, policy_version 1739769 (0.0009) [2023-12-26 13:29:12,720][123090] Updated weights for policy 1, policy_version 1728220 (0.0006) [2023-12-26 13:29:12,757][123091] Updated weights for policy 0, policy_version 1739779 (0.0007) [2023-12-26 13:29:12,824][123091] Updated weights for policy 0, policy_version 1739789 (0.0005) [2023-12-26 13:29:13,404][123090] Updated weights for policy 1, policy_version 1728231 (0.0008) [2023-12-26 13:29:13,451][123090] Updated weights for policy 1, policy_version 1728241 (0.0008) [2023-12-26 13:29:13,512][123090] Updated weights for policy 1, policy_version 1728251 (0.0009) [2023-12-26 13:29:13,659][123091] Updated weights for policy 0, policy_version 1739799 (0.0009) [2023-12-26 13:29:13,723][123091] Updated weights for policy 0, policy_version 1739809 (0.0009) [2023-12-26 13:29:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 887824384. Throughput: 0: 9072.1, 1: 8996.5. Samples: 887820116. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:13,784][121949] Avg episode reward: [(0, '6036.277'), (1, '5814.527')] [2023-12-26 13:29:13,792][123091] Updated weights for policy 0, policy_version 1739819 (0.0009) [2023-12-26 13:29:14,276][123090] Updated weights for policy 1, policy_version 1728261 (0.0007) [2023-12-26 13:29:14,345][123090] Updated weights for policy 1, policy_version 1728271 (0.0008) [2023-12-26 13:29:14,408][123090] Updated weights for policy 1, policy_version 1728281 (0.0008) [2023-12-26 13:29:14,650][123091] Updated weights for policy 0, policy_version 1739829 (0.0008) [2023-12-26 13:29:14,728][123091] Updated weights for policy 0, policy_version 1739839 (0.0008) [2023-12-26 13:29:14,800][123091] Updated weights for policy 0, policy_version 1739849 (0.0011) [2023-12-26 13:29:15,187][123090] Updated weights for policy 1, policy_version 1728291 (0.0008) [2023-12-26 13:29:15,260][123090] Updated weights for policy 1, policy_version 1728301 (0.0007) [2023-12-26 13:29:15,323][123090] Updated weights for policy 1, policy_version 1728311 (0.0009) [2023-12-26 13:29:15,618][123091] Updated weights for policy 0, policy_version 1739859 (0.0011) [2023-12-26 13:29:15,700][123091] Updated weights for policy 0, policy_version 1739869 (0.0010) [2023-12-26 13:29:15,767][123091] Updated weights for policy 0, policy_version 1739879 (0.0011) [2023-12-26 13:29:16,118][123090] Updated weights for policy 1, policy_version 1728321 (0.0007) [2023-12-26 13:29:16,169][123090] Updated weights for policy 1, policy_version 1728331 (0.0006) [2023-12-26 13:29:16,214][123090] Updated weights for policy 1, policy_version 1728341 (0.0005) [2023-12-26 13:29:16,260][123090] Updated weights for policy 1, policy_version 1728351 (0.0005) [2023-12-26 13:29:16,564][123091] Updated weights for policy 0, policy_version 1739889 (0.0011) [2023-12-26 13:29:16,616][123091] Updated weights for policy 0, policy_version 1739899 (0.0011) [2023-12-26 13:29:16,681][123091] Updated weights for policy 0, policy_version 1739909 (0.0010) [2023-12-26 13:29:16,730][123091] Updated weights for policy 0, policy_version 1739919 (0.0009) [2023-12-26 13:29:17,086][123090] Updated weights for policy 1, policy_version 1728361 (0.0009) [2023-12-26 13:29:17,150][123090] Updated weights for policy 1, policy_version 1728371 (0.0009) [2023-12-26 13:29:17,215][123090] Updated weights for policy 1, policy_version 1728381 (0.0009) [2023-12-26 13:29:17,524][123091] Updated weights for policy 0, policy_version 1739929 (0.0010) [2023-12-26 13:29:17,593][123091] Updated weights for policy 0, policy_version 1739939 (0.0010) [2023-12-26 13:29:17,654][123091] Updated weights for policy 0, policy_version 1739949 (0.0009) [2023-12-26 13:29:18,014][123090] Updated weights for policy 1, policy_version 1728391 (0.0008) [2023-12-26 13:29:18,070][123090] Updated weights for policy 1, policy_version 1728401 (0.0009) [2023-12-26 13:29:18,134][123090] Updated weights for policy 1, policy_version 1728411 (0.0010) [2023-12-26 13:29:18,452][123091] Updated weights for policy 0, policy_version 1739959 (0.0007) [2023-12-26 13:29:18,522][123091] Updated weights for policy 0, policy_version 1739969 (0.0006) [2023-12-26 13:29:18,588][123091] Updated weights for policy 0, policy_version 1739979 (0.0010) [2023-12-26 13:29:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 887914496. Throughput: 0: 8938.3, 1: 8980.4. Samples: 887925424. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:18,785][121949] Avg episode reward: [(0, '5996.122'), (1, '5920.055')] [2023-12-26 13:29:18,973][123090] Updated weights for policy 1, policy_version 1728421 (0.0009) [2023-12-26 13:29:19,043][123090] Updated weights for policy 1, policy_version 1728431 (0.0010) [2023-12-26 13:29:19,099][123090] Updated weights for policy 1, policy_version 1728441 (0.0010) [2023-12-26 13:29:19,279][123091] Updated weights for policy 0, policy_version 1739989 (0.0010) [2023-12-26 13:29:19,346][123091] Updated weights for policy 0, policy_version 1739999 (0.0010) [2023-12-26 13:29:19,413][123091] Updated weights for policy 0, policy_version 1740009 (0.0009) [2023-12-26 13:29:19,934][123090] Updated weights for policy 1, policy_version 1728451 (0.0009) [2023-12-26 13:29:20,002][123090] Updated weights for policy 1, policy_version 1728461 (0.0010) [2023-12-26 13:29:20,061][123090] Updated weights for policy 1, policy_version 1728471 (0.0009) [2023-12-26 13:29:20,285][123091] Updated weights for policy 0, policy_version 1740019 (0.0010) [2023-12-26 13:29:20,349][123091] Updated weights for policy 0, policy_version 1740029 (0.0008) [2023-12-26 13:29:20,408][123091] Updated weights for policy 0, policy_version 1740039 (0.0009) [2023-12-26 13:29:20,905][123090] Updated weights for policy 1, policy_version 1728481 (0.0009) [2023-12-26 13:29:20,971][123090] Updated weights for policy 1, policy_version 1728491 (0.0010) [2023-12-26 13:29:21,036][123090] Updated weights for policy 1, policy_version 1728501 (0.0010) [2023-12-26 13:29:21,103][123090] Updated weights for policy 1, policy_version 1728511 (0.0010) [2023-12-26 13:29:21,262][123091] Updated weights for policy 0, policy_version 1740049 (0.0009) [2023-12-26 13:29:21,325][123091] Updated weights for policy 0, policy_version 1740059 (0.0008) [2023-12-26 13:29:21,399][123091] Updated weights for policy 0, policy_version 1740069 (0.0009) [2023-12-26 13:29:21,469][123091] Updated weights for policy 0, policy_version 1740079 (0.0009) [2023-12-26 13:29:21,849][123090] Updated weights for policy 1, policy_version 1728521 (0.0010) [2023-12-26 13:29:21,917][123090] Updated weights for policy 1, policy_version 1728531 (0.0007) [2023-12-26 13:29:21,979][123090] Updated weights for policy 1, policy_version 1728541 (0.0009) [2023-12-26 13:29:22,283][123091] Updated weights for policy 0, policy_version 1740089 (0.0009) [2023-12-26 13:29:22,347][123091] Updated weights for policy 0, policy_version 1740099 (0.0010) [2023-12-26 13:29:22,414][123091] Updated weights for policy 0, policy_version 1740109 (0.0010) [2023-12-26 13:29:22,799][123090] Updated weights for policy 1, policy_version 1728551 (0.0007) [2023-12-26 13:29:22,853][123090] Updated weights for policy 1, policy_version 1728561 (0.0007) [2023-12-26 13:29:22,916][123090] Updated weights for policy 1, policy_version 1728571 (0.0005) [2023-12-26 13:29:23,290][123091] Updated weights for policy 0, policy_version 1740119 (0.0009) [2023-12-26 13:29:23,340][123091] Updated weights for policy 0, policy_version 1740129 (0.0009) [2023-12-26 13:29:23,390][123091] Updated weights for policy 0, policy_version 1740139 (0.0009) [2023-12-26 13:29:23,622][123090] Updated weights for policy 1, policy_version 1728581 (0.0007) [2023-12-26 13:29:23,683][123090] Updated weights for policy 1, policy_version 1728591 (0.0006) [2023-12-26 13:29:23,737][123090] Updated weights for policy 1, policy_version 1728601 (0.0006) [2023-12-26 13:29:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 888004608. Throughput: 0: 8840.0, 1: 8971.7. Samples: 887976112. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:23,785][121949] Avg episode reward: [(0, '6274.730'), (1, '5851.771')] [2023-12-26 13:29:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001740144_445480960.pth... [2023-12-26 13:29:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001728608_442523648.pth... [2023-12-26 13:29:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001727552_442253312.pth [2023-12-26 13:29:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001739120_445218816.pth [2023-12-26 13:29:24,212][123091] Updated weights for policy 0, policy_version 1740149 (0.0009) [2023-12-26 13:29:24,274][123091] Updated weights for policy 0, policy_version 1740159 (0.0009) [2023-12-26 13:29:24,336][123091] Updated weights for policy 0, policy_version 1740169 (0.0010) [2023-12-26 13:29:24,532][123090] Updated weights for policy 1, policy_version 1728611 (0.0009) [2023-12-26 13:29:24,585][123090] Updated weights for policy 1, policy_version 1728621 (0.0009) [2023-12-26 13:29:24,654][123090] Updated weights for policy 1, policy_version 1728632 (0.0009) [2023-12-26 13:29:25,209][123091] Updated weights for policy 0, policy_version 1740179 (0.0009) [2023-12-26 13:29:25,268][123091] Updated weights for policy 0, policy_version 1740189 (0.0009) [2023-12-26 13:29:25,315][123091] Updated weights for policy 0, policy_version 1740199 (0.0008) [2023-12-26 13:29:25,404][123090] Updated weights for policy 1, policy_version 1728642 (0.0010) [2023-12-26 13:29:25,466][123090] Updated weights for policy 1, policy_version 1728652 (0.0010) [2023-12-26 13:29:25,536][123090] Updated weights for policy 1, policy_version 1728662 (0.0010) [2023-12-26 13:29:25,609][123090] Updated weights for policy 1, policy_version 1728672 (0.0010) [2023-12-26 13:29:26,125][123091] Updated weights for policy 0, policy_version 1740209 (0.0009) [2023-12-26 13:29:26,181][123091] Updated weights for policy 0, policy_version 1740219 (0.0009) [2023-12-26 13:29:26,249][123091] Updated weights for policy 0, policy_version 1740229 (0.0009) [2023-12-26 13:29:26,301][123091] Updated weights for policy 0, policy_version 1740239 (0.0009) [2023-12-26 13:29:26,427][123090] Updated weights for policy 1, policy_version 1728682 (0.0011) [2023-12-26 13:29:26,495][123090] Updated weights for policy 1, policy_version 1728692 (0.0011) [2023-12-26 13:29:26,567][123090] Updated weights for policy 1, policy_version 1728702 (0.0011) [2023-12-26 13:29:27,133][123091] Updated weights for policy 0, policy_version 1740249 (0.0006) [2023-12-26 13:29:27,189][123091] Updated weights for policy 0, policy_version 1740259 (0.0008) [2023-12-26 13:29:27,240][123091] Updated weights for policy 0, policy_version 1740269 (0.0008) [2023-12-26 13:29:27,359][123090] Updated weights for policy 1, policy_version 1728712 (0.0008) [2023-12-26 13:29:27,410][123090] Updated weights for policy 1, policy_version 1728722 (0.0009) [2023-12-26 13:29:27,462][123090] Updated weights for policy 1, policy_version 1728732 (0.0010) [2023-12-26 13:29:27,910][123091] Updated weights for policy 0, policy_version 1740279 (0.0006) [2023-12-26 13:29:27,964][123091] Updated weights for policy 0, policy_version 1740289 (0.0005) [2023-12-26 13:29:28,034][123091] Updated weights for policy 0, policy_version 1740299 (0.0005) [2023-12-26 13:29:28,252][123090] Updated weights for policy 1, policy_version 1728743 (0.0007) [2023-12-26 13:29:28,304][123090] Updated weights for policy 1, policy_version 1728753 (0.0005) [2023-12-26 13:29:28,359][123090] Updated weights for policy 1, policy_version 1728763 (0.0006) [2023-12-26 13:29:28,674][123091] Updated weights for policy 0, policy_version 1740309 (0.0007) [2023-12-26 13:29:28,726][123091] Updated weights for policy 0, policy_version 1740319 (0.0008) [2023-12-26 13:29:28,782][123091] Updated weights for policy 0, policy_version 1740329 (0.0009) [2023-12-26 13:29:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 888086528. Throughput: 0: 8835.0, 1: 8959.7. Samples: 888080968. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:28,784][121949] Avg episode reward: [(0, '6171.149'), (1, '5723.722')] [2023-12-26 13:29:29,154][123090] Updated weights for policy 1, policy_version 1728773 (0.0006) [2023-12-26 13:29:29,210][123090] Updated weights for policy 1, policy_version 1728783 (0.0006) [2023-12-26 13:29:29,279][123090] Updated weights for policy 1, policy_version 1728793 (0.0008) [2023-12-26 13:29:29,575][123091] Updated weights for policy 0, policy_version 1740339 (0.0008) [2023-12-26 13:29:29,637][123091] Updated weights for policy 0, policy_version 1740349 (0.0006) [2023-12-26 13:29:29,697][123091] Updated weights for policy 0, policy_version 1740359 (0.0008) [2023-12-26 13:29:30,068][123090] Updated weights for policy 1, policy_version 1728803 (0.0007) [2023-12-26 13:29:30,130][123090] Updated weights for policy 1, policy_version 1728813 (0.0009) [2023-12-26 13:29:30,196][123090] Updated weights for policy 1, policy_version 1728823 (0.0005) [2023-12-26 13:29:30,443][123091] Updated weights for policy 0, policy_version 1740369 (0.0009) [2023-12-26 13:29:30,520][123091] Updated weights for policy 0, policy_version 1740379 (0.0005) [2023-12-26 13:29:30,578][123091] Updated weights for policy 0, policy_version 1740389 (0.0005) [2023-12-26 13:29:30,639][123091] Updated weights for policy 0, policy_version 1740399 (0.0005) [2023-12-26 13:29:30,898][123090] Updated weights for policy 1, policy_version 1728833 (0.0009) [2023-12-26 13:29:30,952][123090] Updated weights for policy 1, policy_version 1728843 (0.0005) [2023-12-26 13:29:31,006][123090] Updated weights for policy 1, policy_version 1728853 (0.0005) [2023-12-26 13:29:31,080][123090] Updated weights for policy 1, policy_version 1728863 (0.0009) [2023-12-26 13:29:31,394][123091] Updated weights for policy 0, policy_version 1740409 (0.0009) [2023-12-26 13:29:31,449][123091] Updated weights for policy 0, policy_version 1740419 (0.0008) [2023-12-26 13:29:31,505][123091] Updated weights for policy 0, policy_version 1740429 (0.0009) [2023-12-26 13:29:31,831][123090] Updated weights for policy 1, policy_version 1728873 (0.0008) [2023-12-26 13:29:31,891][123090] Updated weights for policy 1, policy_version 1728883 (0.0008) [2023-12-26 13:29:31,951][123090] Updated weights for policy 1, policy_version 1728893 (0.0006) [2023-12-26 13:29:32,407][123091] Updated weights for policy 0, policy_version 1740439 (0.0009) [2023-12-26 13:29:32,469][123091] Updated weights for policy 0, policy_version 1740449 (0.0010) [2023-12-26 13:29:32,530][123091] Updated weights for policy 0, policy_version 1740459 (0.0009) [2023-12-26 13:29:32,690][123090] Updated weights for policy 1, policy_version 1728903 (0.0009) [2023-12-26 13:29:32,749][123090] Updated weights for policy 1, policy_version 1728913 (0.0008) [2023-12-26 13:29:32,815][123090] Updated weights for policy 1, policy_version 1728923 (0.0006) [2023-12-26 13:29:33,303][123091] Updated weights for policy 0, policy_version 1740469 (0.0009) [2023-12-26 13:29:33,353][123091] Updated weights for policy 0, policy_version 1740479 (0.0009) [2023-12-26 13:29:33,411][123091] Updated weights for policy 0, policy_version 1740489 (0.0009) [2023-12-26 13:29:33,618][123090] Updated weights for policy 1, policy_version 1728933 (0.0009) [2023-12-26 13:29:33,684][123090] Updated weights for policy 1, policy_version 1728943 (0.0009) [2023-12-26 13:29:33,748][123090] Updated weights for policy 1, policy_version 1728953 (0.0010) [2023-12-26 13:29:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 888176640. Throughput: 0: 8834.0, 1: 8992.7. Samples: 888191172. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:33,785][121949] Avg episode reward: [(0, '6163.382'), (1, '5653.448')] [2023-12-26 13:29:34,166][123091] Updated weights for policy 0, policy_version 1740499 (0.0008) [2023-12-26 13:29:34,214][123091] Updated weights for policy 0, policy_version 1740509 (0.0006) [2023-12-26 13:29:34,277][123091] Updated weights for policy 0, policy_version 1740519 (0.0006) [2023-12-26 13:29:34,537][123090] Updated weights for policy 1, policy_version 1728963 (0.0008) [2023-12-26 13:29:34,617][123090] Updated weights for policy 1, policy_version 1728973 (0.0006) [2023-12-26 13:29:34,691][123090] Updated weights for policy 1, policy_version 1728983 (0.0009) [2023-12-26 13:29:34,989][123091] Updated weights for policy 0, policy_version 1740529 (0.0006) [2023-12-26 13:29:35,041][123091] Updated weights for policy 0, policy_version 1740539 (0.0005) [2023-12-26 13:29:35,100][123091] Updated weights for policy 0, policy_version 1740549 (0.0005) [2023-12-26 13:29:35,159][123091] Updated weights for policy 0, policy_version 1740559 (0.0005) [2023-12-26 13:29:35,472][123090] Updated weights for policy 1, policy_version 1728993 (0.0008) [2023-12-26 13:29:35,528][123090] Updated weights for policy 1, policy_version 1729003 (0.0005) [2023-12-26 13:29:35,585][123090] Updated weights for policy 1, policy_version 1729013 (0.0005) [2023-12-26 13:29:35,661][123090] Updated weights for policy 1, policy_version 1729023 (0.0005) [2023-12-26 13:29:35,825][123091] Updated weights for policy 0, policy_version 1740569 (0.0009) [2023-12-26 13:29:35,868][123091] Updated weights for policy 0, policy_version 1740579 (0.0010) [2023-12-26 13:29:35,915][123091] Updated weights for policy 0, policy_version 1740589 (0.0010) [2023-12-26 13:29:36,398][123090] Updated weights for policy 1, policy_version 1729033 (0.0007) [2023-12-26 13:29:36,463][123090] Updated weights for policy 1, policy_version 1729043 (0.0009) [2023-12-26 13:29:36,525][123090] Updated weights for policy 1, policy_version 1729053 (0.0010) [2023-12-26 13:29:36,770][123091] Updated weights for policy 0, policy_version 1740599 (0.0010) [2023-12-26 13:29:36,830][123091] Updated weights for policy 0, policy_version 1740609 (0.0010) [2023-12-26 13:29:36,886][123091] Updated weights for policy 0, policy_version 1740620 (0.0009) [2023-12-26 13:29:37,228][123090] Updated weights for policy 1, policy_version 1729063 (0.0008) [2023-12-26 13:29:37,295][123090] Updated weights for policy 1, policy_version 1729073 (0.0009) [2023-12-26 13:29:37,364][123090] Updated weights for policy 1, policy_version 1729083 (0.0008) [2023-12-26 13:29:37,792][123091] Updated weights for policy 0, policy_version 1740630 (0.0009) [2023-12-26 13:29:37,845][123091] Updated weights for policy 0, policy_version 1740640 (0.0009) [2023-12-26 13:29:37,896][123091] Updated weights for policy 0, policy_version 1740650 (0.0009) [2023-12-26 13:29:38,098][123090] Updated weights for policy 1, policy_version 1729093 (0.0007) [2023-12-26 13:29:38,148][123090] Updated weights for policy 1, policy_version 1729103 (0.0005) [2023-12-26 13:29:38,222][123090] Updated weights for policy 1, policy_version 1729113 (0.0006) [2023-12-26 13:29:38,681][123091] Updated weights for policy 0, policy_version 1740660 (0.0007) [2023-12-26 13:29:38,740][123091] Updated weights for policy 0, policy_version 1740670 (0.0011) [2023-12-26 13:29:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 888266752. Throughput: 0: 8898.1, 1: 9009.5. Samples: 888247320. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:38,784][121949] Avg episode reward: [(0, '6134.852'), (1, '5599.065')] [2023-12-26 13:29:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001729120_442654720.pth... [2023-12-26 13:29:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001728096_442392576.pth [2023-12-26 13:29:38,803][123091] Updated weights for policy 0, policy_version 1740680 (0.0011) [2023-12-26 13:29:38,845][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001740688_445620224.pth... [2023-12-26 13:29:38,848][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001739632_445349888.pth [2023-12-26 13:29:38,936][123090] Updated weights for policy 1, policy_version 1729123 (0.0007) [2023-12-26 13:29:38,991][123090] Updated weights for policy 1, policy_version 1729133 (0.0010) [2023-12-26 13:29:39,050][123090] Updated weights for policy 1, policy_version 1729143 (0.0010) [2023-12-26 13:29:39,652][123091] Updated weights for policy 0, policy_version 1740690 (0.0010) [2023-12-26 13:29:39,713][123091] Updated weights for policy 0, policy_version 1740700 (0.0009) [2023-12-26 13:29:39,778][123091] Updated weights for policy 0, policy_version 1740710 (0.0009) [2023-12-26 13:29:39,845][123091] Updated weights for policy 0, policy_version 1740720 (0.0009) [2023-12-26 13:29:39,902][123090] Updated weights for policy 1, policy_version 1729153 (0.0011) [2023-12-26 13:29:39,972][123090] Updated weights for policy 1, policy_version 1729163 (0.0011) [2023-12-26 13:29:40,040][123090] Updated weights for policy 1, policy_version 1729173 (0.0011) [2023-12-26 13:29:40,100][123090] Updated weights for policy 1, policy_version 1729183 (0.0011) [2023-12-26 13:29:40,687][123091] Updated weights for policy 0, policy_version 1740730 (0.0006) [2023-12-26 13:29:40,742][123091] Updated weights for policy 0, policy_version 1740740 (0.0007) [2023-12-26 13:29:40,815][123091] Updated weights for policy 0, policy_version 1740750 (0.0008) [2023-12-26 13:29:40,933][123090] Updated weights for policy 1, policy_version 1729193 (0.0010) [2023-12-26 13:29:40,992][123090] Updated weights for policy 1, policy_version 1729203 (0.0010) [2023-12-26 13:29:41,061][123090] Updated weights for policy 1, policy_version 1729213 (0.0009) [2023-12-26 13:29:41,629][123091] Updated weights for policy 0, policy_version 1740760 (0.0009) [2023-12-26 13:29:41,695][123091] Updated weights for policy 0, policy_version 1740770 (0.0008) [2023-12-26 13:29:41,766][123091] Updated weights for policy 0, policy_version 1740780 (0.0007) [2023-12-26 13:29:41,839][123090] Updated weights for policy 1, policy_version 1729223 (0.0010) [2023-12-26 13:29:41,907][123090] Updated weights for policy 1, policy_version 1729233 (0.0011) [2023-12-26 13:29:41,971][123090] Updated weights for policy 1, policy_version 1729243 (0.0011) [2023-12-26 13:29:42,609][123091] Updated weights for policy 0, policy_version 1740790 (0.0008) [2023-12-26 13:29:42,673][123091] Updated weights for policy 0, policy_version 1740800 (0.0009) [2023-12-26 13:29:42,735][123091] Updated weights for policy 0, policy_version 1740810 (0.0009) [2023-12-26 13:29:42,752][123090] Updated weights for policy 1, policy_version 1729253 (0.0009) [2023-12-26 13:29:42,816][123090] Updated weights for policy 1, policy_version 1729263 (0.0006) [2023-12-26 13:29:42,890][123090] Updated weights for policy 1, policy_version 1729273 (0.0009) [2023-12-26 13:29:43,583][123091] Updated weights for policy 0, policy_version 1740820 (0.0008) [2023-12-26 13:29:43,594][123090] Updated weights for policy 1, policy_version 1729283 (0.0009) [2023-12-26 13:29:43,646][123091] Updated weights for policy 0, policy_version 1740830 (0.0011) [2023-12-26 13:29:43,647][123090] Updated weights for policy 1, policy_version 1729293 (0.0005) [2023-12-26 13:29:43,704][123090] Updated weights for policy 1, policy_version 1729303 (0.0007) [2023-12-26 13:29:43,713][123091] Updated weights for policy 0, policy_version 1740840 (0.0011) [2023-12-26 13:29:43,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 888365056. Throughput: 0: 8853.2, 1: 8969.5. Samples: 888352048. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:43,785][121949] Avg episode reward: [(0, '6034.875'), (1, '5790.382')] [2023-12-26 13:29:44,494][123091] Updated weights for policy 0, policy_version 1740850 (0.0009) [2023-12-26 13:29:44,510][123090] Updated weights for policy 1, policy_version 1729313 (0.0010) [2023-12-26 13:29:44,547][123091] Updated weights for policy 0, policy_version 1740860 (0.0007) [2023-12-26 13:29:44,565][123090] Updated weights for policy 1, policy_version 1729323 (0.0010) [2023-12-26 13:29:44,611][123091] Updated weights for policy 0, policy_version 1740870 (0.0008) [2023-12-26 13:29:44,621][123090] Updated weights for policy 1, policy_version 1729333 (0.0010) [2023-12-26 13:29:44,661][123091] Updated weights for policy 0, policy_version 1740880 (0.0007) [2023-12-26 13:29:44,672][123090] Updated weights for policy 1, policy_version 1729343 (0.0010) [2023-12-26 13:29:45,403][123091] Updated weights for policy 0, policy_version 1740890 (0.0009) [2023-12-26 13:29:45,462][123091] Updated weights for policy 0, policy_version 1740900 (0.0010) [2023-12-26 13:29:45,477][123090] Updated weights for policy 1, policy_version 1729353 (0.0008) [2023-12-26 13:29:45,530][123091] Updated weights for policy 0, policy_version 1740910 (0.0006) [2023-12-26 13:29:45,534][123090] Updated weights for policy 1, policy_version 1729363 (0.0008) [2023-12-26 13:29:45,600][123090] Updated weights for policy 1, policy_version 1729373 (0.0010) [2023-12-26 13:29:46,360][123091] Updated weights for policy 0, policy_version 1740920 (0.0009) [2023-12-26 13:29:46,403][123090] Updated weights for policy 1, policy_version 1729383 (0.0008) [2023-12-26 13:29:46,429][123091] Updated weights for policy 0, policy_version 1740930 (0.0008) [2023-12-26 13:29:46,457][123090] Updated weights for policy 1, policy_version 1729393 (0.0006) [2023-12-26 13:29:46,481][123091] Updated weights for policy 0, policy_version 1740940 (0.0008) [2023-12-26 13:29:46,521][123090] Updated weights for policy 1, policy_version 1729403 (0.0009) [2023-12-26 13:29:47,257][123090] Updated weights for policy 1, policy_version 1729413 (0.0007) [2023-12-26 13:29:47,333][123090] Updated weights for policy 1, policy_version 1729423 (0.0005) [2023-12-26 13:29:47,342][123091] Updated weights for policy 0, policy_version 1740950 (0.0007) [2023-12-26 13:29:47,393][123090] Updated weights for policy 1, policy_version 1729433 (0.0005) [2023-12-26 13:29:47,405][123091] Updated weights for policy 0, policy_version 1740960 (0.0005) [2023-12-26 13:29:47,462][123091] Updated weights for policy 0, policy_version 1740970 (0.0005) [2023-12-26 13:29:48,080][123090] Updated weights for policy 1, policy_version 1729443 (0.0005) [2023-12-26 13:29:48,148][123090] Updated weights for policy 1, policy_version 1729453 (0.0005) [2023-12-26 13:29:48,172][123091] Updated weights for policy 0, policy_version 1740980 (0.0006) [2023-12-26 13:29:48,200][123090] Updated weights for policy 1, policy_version 1729463 (0.0006) [2023-12-26 13:29:48,234][123091] Updated weights for policy 0, policy_version 1740990 (0.0005) [2023-12-26 13:29:48,291][123091] Updated weights for policy 0, policy_version 1741000 (0.0005) [2023-12-26 13:29:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 888446976. Throughput: 0: 8822.0, 1: 9013.9. Samples: 888460332. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:48,784][121949] Avg episode reward: [(0, '6131.771'), (1, '5892.377')] [2023-12-26 13:29:48,996][123090] Updated weights for policy 1, policy_version 1729473 (0.0006) [2023-12-26 13:29:49,041][123091] Updated weights for policy 0, policy_version 1741010 (0.0006) [2023-12-26 13:29:49,048][123090] Updated weights for policy 1, policy_version 1729483 (0.0009) [2023-12-26 13:29:49,093][123091] Updated weights for policy 0, policy_version 1741020 (0.0010) [2023-12-26 13:29:49,099][123090] Updated weights for policy 1, policy_version 1729493 (0.0008) [2023-12-26 13:29:49,149][123090] Updated weights for policy 1, policy_version 1729503 (0.0008) [2023-12-26 13:29:49,155][123091] Updated weights for policy 0, policy_version 1741030 (0.0011) [2023-12-26 13:29:49,210][123091] Updated weights for policy 0, policy_version 1741040 (0.0011) [2023-12-26 13:29:50,028][123090] Updated weights for policy 1, policy_version 1729513 (0.0008) [2023-12-26 13:29:50,034][123091] Updated weights for policy 0, policy_version 1741050 (0.0006) [2023-12-26 13:29:50,087][123090] Updated weights for policy 1, policy_version 1729523 (0.0008) [2023-12-26 13:29:50,088][123091] Updated weights for policy 0, policy_version 1741060 (0.0005) [2023-12-26 13:29:50,138][123091] Updated weights for policy 0, policy_version 1741070 (0.0006) [2023-12-26 13:29:50,142][123090] Updated weights for policy 1, policy_version 1729533 (0.0008) [2023-12-26 13:29:50,927][123091] Updated weights for policy 0, policy_version 1741080 (0.0008) [2023-12-26 13:29:50,965][123090] Updated weights for policy 1, policy_version 1729543 (0.0006) [2023-12-26 13:29:51,000][123091] Updated weights for policy 0, policy_version 1741090 (0.0006) [2023-12-26 13:29:51,039][123090] Updated weights for policy 1, policy_version 1729553 (0.0008) [2023-12-26 13:29:51,071][123091] Updated weights for policy 0, policy_version 1741100 (0.0008) [2023-12-26 13:29:51,110][123090] Updated weights for policy 1, policy_version 1729563 (0.0009) [2023-12-26 13:29:51,856][123091] Updated weights for policy 0, policy_version 1741110 (0.0009) [2023-12-26 13:29:51,908][123091] Updated weights for policy 0, policy_version 1741120 (0.0008) [2023-12-26 13:29:51,918][123090] Updated weights for policy 1, policy_version 1729573 (0.0010) [2023-12-26 13:29:51,976][123091] Updated weights for policy 0, policy_version 1741130 (0.0006) [2023-12-26 13:29:51,978][123090] Updated weights for policy 1, policy_version 1729583 (0.0010) [2023-12-26 13:29:52,030][123090] Updated weights for policy 1, policy_version 1729593 (0.0010) [2023-12-26 13:29:52,836][123091] Updated weights for policy 0, policy_version 1741140 (0.0008) [2023-12-26 13:29:52,866][123090] Updated weights for policy 1, policy_version 1729603 (0.0010) [2023-12-26 13:29:52,894][123091] Updated weights for policy 0, policy_version 1741150 (0.0008) [2023-12-26 13:29:52,922][123090] Updated weights for policy 1, policy_version 1729613 (0.0008) [2023-12-26 13:29:52,952][123091] Updated weights for policy 0, policy_version 1741160 (0.0007) [2023-12-26 13:29:52,972][123090] Updated weights for policy 1, policy_version 1729623 (0.0009) [2023-12-26 13:29:53,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 888528896. Throughput: 0: 8807.5, 1: 8953.5. Samples: 888512480. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:53,785][123091] Updated weights for policy 0, policy_version 1741170 (0.0006) [2023-12-26 13:29:53,785][121949] Avg episode reward: [(0, '6118.109'), (1, '5743.831')] [2023-12-26 13:29:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001729632_442785792.pth... [2023-12-26 13:29:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001728608_442523648.pth [2023-12-26 13:29:53,824][123090] Updated weights for policy 1, policy_version 1729633 (0.0010) [2023-12-26 13:29:53,840][123091] Updated weights for policy 0, policy_version 1741180 (0.0008) [2023-12-26 13:29:53,868][123090] Updated weights for policy 1, policy_version 1729643 (0.0010) [2023-12-26 13:29:53,888][123091] Updated weights for policy 0, policy_version 1741190 (0.0005) [2023-12-26 13:29:53,928][123090] Updated weights for policy 1, policy_version 1729653 (0.0010) [2023-12-26 13:29:53,941][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001741200_445751296.pth... [2023-12-26 13:29:53,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001740144_445480960.pth [2023-12-26 13:29:53,945][123091] Updated weights for policy 0, policy_version 1741200 (0.0007) [2023-12-26 13:29:53,973][123090] Updated weights for policy 1, policy_version 1729663 (0.0006) [2023-12-26 13:29:54,704][123090] Updated weights for policy 1, policy_version 1729673 (0.0009) [2023-12-26 13:29:54,764][123090] Updated weights for policy 1, policy_version 1729683 (0.0008) [2023-12-26 13:29:54,816][123091] Updated weights for policy 0, policy_version 1741210 (0.0007) [2023-12-26 13:29:54,821][123090] Updated weights for policy 1, policy_version 1729693 (0.0009) [2023-12-26 13:29:54,879][123091] Updated weights for policy 0, policy_version 1741220 (0.0009) [2023-12-26 13:29:54,938][123091] Updated weights for policy 0, policy_version 1741230 (0.0008) [2023-12-26 13:29:55,488][123090] Updated weights for policy 1, policy_version 1729703 (0.0006) [2023-12-26 13:29:55,539][123090] Updated weights for policy 1, policy_version 1729713 (0.0007) [2023-12-26 13:29:55,589][123090] Updated weights for policy 1, policy_version 1729723 (0.0009) [2023-12-26 13:29:55,784][123091] Updated weights for policy 0, policy_version 1741240 (0.0009) [2023-12-26 13:29:55,841][123091] Updated weights for policy 0, policy_version 1741250 (0.0009) [2023-12-26 13:29:55,913][123091] Updated weights for policy 0, policy_version 1741260 (0.0008) [2023-12-26 13:29:56,274][123090] Updated weights for policy 1, policy_version 1729733 (0.0008) [2023-12-26 13:29:56,335][123090] Updated weights for policy 1, policy_version 1729743 (0.0006) [2023-12-26 13:29:56,386][123090] Updated weights for policy 1, policy_version 1729753 (0.0010) [2023-12-26 13:29:56,824][123091] Updated weights for policy 0, policy_version 1741270 (0.0009) [2023-12-26 13:29:56,897][123091] Updated weights for policy 0, policy_version 1741280 (0.0010) [2023-12-26 13:29:56,956][123091] Updated weights for policy 0, policy_version 1741290 (0.0009) [2023-12-26 13:29:57,163][123090] Updated weights for policy 1, policy_version 1729763 (0.0009) [2023-12-26 13:29:57,216][123090] Updated weights for policy 1, policy_version 1729773 (0.0009) [2023-12-26 13:29:57,268][123090] Updated weights for policy 1, policy_version 1729784 (0.0011) [2023-12-26 13:29:57,745][123091] Updated weights for policy 0, policy_version 1741300 (0.0009) [2023-12-26 13:29:57,793][123091] Updated weights for policy 0, policy_version 1741310 (0.0008) [2023-12-26 13:29:57,845][123091] Updated weights for policy 0, policy_version 1741321 (0.0009) [2023-12-26 13:29:58,114][123090] Updated weights for policy 1, policy_version 1729794 (0.0010) [2023-12-26 13:29:58,171][123090] Updated weights for policy 1, policy_version 1729804 (0.0008) [2023-12-26 13:29:58,221][123090] Updated weights for policy 1, policy_version 1729814 (0.0008) [2023-12-26 13:29:58,290][123090] Updated weights for policy 1, policy_version 1729824 (0.0007) [2023-12-26 13:29:58,761][123091] Updated weights for policy 0, policy_version 1741331 (0.0009) [2023-12-26 13:29:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 888619008. Throughput: 0: 8714.7, 1: 8989.0. Samples: 888616784. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:29:58,785][121949] Avg episode reward: [(0, '6002.147'), (1, '5704.594')] [2023-12-26 13:29:58,834][123091] Updated weights for policy 0, policy_version 1741341 (0.0008) [2023-12-26 13:29:58,902][123091] Updated weights for policy 0, policy_version 1741351 (0.0008) [2023-12-26 13:29:59,217][123090] Updated weights for policy 1, policy_version 1729834 (0.0009) [2023-12-26 13:29:59,285][123090] Updated weights for policy 1, policy_version 1729844 (0.0007) [2023-12-26 13:29:59,373][123090] Updated weights for policy 1, policy_version 1729854 (0.0009) [2023-12-26 13:29:59,676][123091] Updated weights for policy 0, policy_version 1741361 (0.0008) [2023-12-26 13:29:59,726][123091] Updated weights for policy 0, policy_version 1741371 (0.0005) [2023-12-26 13:29:59,780][123091] Updated weights for policy 0, policy_version 1741381 (0.0005) [2023-12-26 13:29:59,843][123091] Updated weights for policy 0, policy_version 1741391 (0.0008) [2023-12-26 13:30:00,216][123090] Updated weights for policy 1, policy_version 1729864 (0.0010) [2023-12-26 13:30:00,275][123090] Updated weights for policy 1, policy_version 1729874 (0.0010) [2023-12-26 13:30:00,342][123090] Updated weights for policy 1, policy_version 1729884 (0.0011) [2023-12-26 13:30:00,604][123091] Updated weights for policy 0, policy_version 1741401 (0.0008) [2023-12-26 13:30:00,651][123091] Updated weights for policy 0, policy_version 1741411 (0.0009) [2023-12-26 13:30:00,706][123091] Updated weights for policy 0, policy_version 1741421 (0.0008) [2023-12-26 13:30:01,142][123090] Updated weights for policy 1, policy_version 1729894 (0.0010) [2023-12-26 13:30:01,208][123090] Updated weights for policy 1, policy_version 1729904 (0.0010) [2023-12-26 13:30:01,282][123090] Updated weights for policy 1, policy_version 1729914 (0.0011) [2023-12-26 13:30:01,555][123091] Updated weights for policy 0, policy_version 1741431 (0.0006) [2023-12-26 13:30:01,615][123091] Updated weights for policy 0, policy_version 1741441 (0.0006) [2023-12-26 13:30:01,681][123091] Updated weights for policy 0, policy_version 1741451 (0.0008) [2023-12-26 13:30:02,078][123090] Updated weights for policy 1, policy_version 1729924 (0.0010) [2023-12-26 13:30:02,133][123090] Updated weights for policy 1, policy_version 1729934 (0.0010) [2023-12-26 13:30:02,185][123090] Updated weights for policy 1, policy_version 1729944 (0.0009) [2023-12-26 13:30:02,492][123091] Updated weights for policy 0, policy_version 1741461 (0.0007) [2023-12-26 13:30:02,552][123091] Updated weights for policy 0, policy_version 1741471 (0.0005) [2023-12-26 13:30:02,618][123091] Updated weights for policy 0, policy_version 1741481 (0.0008) [2023-12-26 13:30:02,987][123090] Updated weights for policy 1, policy_version 1729954 (0.0008) [2023-12-26 13:30:03,048][123090] Updated weights for policy 1, policy_version 1729964 (0.0010) [2023-12-26 13:30:03,104][123090] Updated weights for policy 1, policy_version 1729974 (0.0009) [2023-12-26 13:30:03,161][123090] Updated weights for policy 1, policy_version 1729984 (0.0009) [2023-12-26 13:30:03,393][123091] Updated weights for policy 0, policy_version 1741491 (0.0008) [2023-12-26 13:30:03,439][123091] Updated weights for policy 0, policy_version 1741501 (0.0005) [2023-12-26 13:30:03,492][123091] Updated weights for policy 0, policy_version 1741511 (0.0005) [2023-12-26 13:30:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 888709120. Throughput: 0: 8744.6, 1: 8930.7. Samples: 888720812. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:30:03,785][121949] Avg episode reward: [(0, '5969.567'), (1, '5709.119')] [2023-12-26 13:30:04,018][123090] Updated weights for policy 1, policy_version 1729994 (0.0009) [2023-12-26 13:30:04,088][123090] Updated weights for policy 1, policy_version 1730004 (0.0009) [2023-12-26 13:30:04,121][123091] Updated weights for policy 0, policy_version 1741521 (0.0005) [2023-12-26 13:30:04,157][123090] Updated weights for policy 1, policy_version 1730014 (0.0010) [2023-12-26 13:30:04,183][123091] Updated weights for policy 0, policy_version 1741531 (0.0005) [2023-12-26 13:30:04,250][123091] Updated weights for policy 0, policy_version 1741541 (0.0007) [2023-12-26 13:30:04,313][123091] Updated weights for policy 0, policy_version 1741551 (0.0009) [2023-12-26 13:30:04,984][123090] Updated weights for policy 1, policy_version 1730024 (0.0008) [2023-12-26 13:30:05,033][123090] Updated weights for policy 1, policy_version 1730034 (0.0007) [2023-12-26 13:30:05,096][123090] Updated weights for policy 1, policy_version 1730044 (0.0005) [2023-12-26 13:30:05,136][123091] Updated weights for policy 0, policy_version 1741561 (0.0009) [2023-12-26 13:30:05,196][123091] Updated weights for policy 0, policy_version 1741571 (0.0009) [2023-12-26 13:30:05,250][123091] Updated weights for policy 0, policy_version 1741581 (0.0010) [2023-12-26 13:30:05,751][123090] Updated weights for policy 1, policy_version 1730054 (0.0007) [2023-12-26 13:30:05,810][123090] Updated weights for policy 1, policy_version 1730064 (0.0009) [2023-12-26 13:30:05,866][123090] Updated weights for policy 1, policy_version 1730074 (0.0009) [2023-12-26 13:30:06,115][123091] Updated weights for policy 0, policy_version 1741591 (0.0010) [2023-12-26 13:30:06,175][123091] Updated weights for policy 0, policy_version 1741601 (0.0010) [2023-12-26 13:30:06,235][123091] Updated weights for policy 0, policy_version 1741611 (0.0009) [2023-12-26 13:30:06,641][123090] Updated weights for policy 1, policy_version 1730084 (0.0009) [2023-12-26 13:30:06,707][123090] Updated weights for policy 1, policy_version 1730094 (0.0010) [2023-12-26 13:30:06,774][123090] Updated weights for policy 1, policy_version 1730104 (0.0010) [2023-12-26 13:30:06,991][123091] Updated weights for policy 0, policy_version 1741621 (0.0009) [2023-12-26 13:30:07,056][123091] Updated weights for policy 0, policy_version 1741631 (0.0008) [2023-12-26 13:30:07,123][123091] Updated weights for policy 0, policy_version 1741641 (0.0010) [2023-12-26 13:30:07,575][123090] Updated weights for policy 1, policy_version 1730114 (0.0010) [2023-12-26 13:30:07,627][123090] Updated weights for policy 1, policy_version 1730124 (0.0009) [2023-12-26 13:30:07,677][123090] Updated weights for policy 1, policy_version 1730134 (0.0009) [2023-12-26 13:30:07,735][123090] Updated weights for policy 1, policy_version 1730144 (0.0009) [2023-12-26 13:30:07,936][123091] Updated weights for policy 0, policy_version 1741651 (0.0009) [2023-12-26 13:30:08,006][123091] Updated weights for policy 0, policy_version 1741661 (0.0009) [2023-12-26 13:30:08,072][123091] Updated weights for policy 0, policy_version 1741671 (0.0009) [2023-12-26 13:30:08,543][123090] Updated weights for policy 1, policy_version 1730154 (0.0005) [2023-12-26 13:30:08,614][123090] Updated weights for policy 1, policy_version 1730164 (0.0005) [2023-12-26 13:30:08,692][123090] Updated weights for policy 1, policy_version 1730174 (0.0007) [2023-12-26 13:30:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 888799232. Throughput: 0: 8781.6, 1: 8965.6. Samples: 888774736. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:30:08,785][121949] Avg episode reward: [(0, '5995.649'), (1, '5570.589')] [2023-12-26 13:30:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001741680_445874176.pth... [2023-12-26 13:30:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001730176_442925056.pth... [2023-12-26 13:30:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001729120_442654720.pth [2023-12-26 13:30:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001740688_445620224.pth [2023-12-26 13:30:08,846][123091] Updated weights for policy 0, policy_version 1741681 (0.0009) [2023-12-26 13:30:08,909][123091] Updated weights for policy 0, policy_version 1741691 (0.0009) [2023-12-26 13:30:08,970][123091] Updated weights for policy 0, policy_version 1741701 (0.0009) [2023-12-26 13:30:09,036][123091] Updated weights for policy 0, policy_version 1741711 (0.0010) [2023-12-26 13:30:09,506][123090] Updated weights for policy 1, policy_version 1730184 (0.0010) [2023-12-26 13:30:09,562][123090] Updated weights for policy 1, policy_version 1730194 (0.0010) [2023-12-26 13:30:09,616][123090] Updated weights for policy 1, policy_version 1730204 (0.0010) [2023-12-26 13:30:09,840][123091] Updated weights for policy 0, policy_version 1741721 (0.0010) [2023-12-26 13:30:09,906][123091] Updated weights for policy 0, policy_version 1741731 (0.0010) [2023-12-26 13:30:09,970][123091] Updated weights for policy 0, policy_version 1741741 (0.0010) [2023-12-26 13:30:10,491][123090] Updated weights for policy 1, policy_version 1730214 (0.0010) [2023-12-26 13:30:10,547][123090] Updated weights for policy 1, policy_version 1730224 (0.0009) [2023-12-26 13:30:10,597][123090] Updated weights for policy 1, policy_version 1730234 (0.0010) [2023-12-26 13:30:10,842][123091] Updated weights for policy 0, policy_version 1741751 (0.0009) [2023-12-26 13:30:10,903][123091] Updated weights for policy 0, policy_version 1741761 (0.0009) [2023-12-26 13:30:10,971][123091] Updated weights for policy 0, policy_version 1741771 (0.0006) [2023-12-26 13:30:11,451][123090] Updated weights for policy 1, policy_version 1730244 (0.0008) [2023-12-26 13:30:11,512][123090] Updated weights for policy 1, policy_version 1730254 (0.0008) [2023-12-26 13:30:11,587][123090] Updated weights for policy 1, policy_version 1730264 (0.0011) [2023-12-26 13:30:11,779][123091] Updated weights for policy 0, policy_version 1741781 (0.0008) [2023-12-26 13:30:11,850][123091] Updated weights for policy 0, policy_version 1741791 (0.0008) [2023-12-26 13:30:11,898][123091] Updated weights for policy 0, policy_version 1741801 (0.0010) [2023-12-26 13:30:12,388][123090] Updated weights for policy 1, policy_version 1730274 (0.0010) [2023-12-26 13:30:12,454][123090] Updated weights for policy 1, policy_version 1730284 (0.0006) [2023-12-26 13:30:12,504][123090] Updated weights for policy 1, policy_version 1730294 (0.0007) [2023-12-26 13:30:12,552][123090] Updated weights for policy 1, policy_version 1730304 (0.0010) [2023-12-26 13:30:12,604][123091] Updated weights for policy 0, policy_version 1741811 (0.0006) [2023-12-26 13:30:12,660][123091] Updated weights for policy 0, policy_version 1741821 (0.0006) [2023-12-26 13:30:12,717][123091] Updated weights for policy 0, policy_version 1741831 (0.0005) [2023-12-26 13:30:13,313][123090] Updated weights for policy 1, policy_version 1730314 (0.0010) [2023-12-26 13:30:13,386][123091] Updated weights for policy 0, policy_version 1741841 (0.0006) [2023-12-26 13:30:13,387][123090] Updated weights for policy 1, policy_version 1730324 (0.0010) [2023-12-26 13:30:13,436][123090] Updated weights for policy 1, policy_version 1730334 (0.0009) [2023-12-26 13:30:13,451][123091] Updated weights for policy 0, policy_version 1741851 (0.0009) [2023-12-26 13:30:13,499][123091] Updated weights for policy 0, policy_version 1741861 (0.0010) [2023-12-26 13:30:13,547][123091] Updated weights for policy 0, policy_version 1741871 (0.0007) [2023-12-26 13:30:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 888889344. Throughput: 0: 8802.0, 1: 8939.5. Samples: 888879336. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:30:13,785][121949] Avg episode reward: [(0, '5987.472'), (1, '5388.086')] [2023-12-26 13:30:14,219][123091] Updated weights for policy 0, policy_version 1741881 (0.0005) [2023-12-26 13:30:14,225][123090] Updated weights for policy 1, policy_version 1730344 (0.0009) [2023-12-26 13:30:14,278][123090] Updated weights for policy 1, policy_version 1730354 (0.0007) [2023-12-26 13:30:14,279][123091] Updated weights for policy 0, policy_version 1741891 (0.0008) [2023-12-26 13:30:14,333][123090] Updated weights for policy 1, policy_version 1730364 (0.0006) [2023-12-26 13:30:14,334][123091] Updated weights for policy 0, policy_version 1741901 (0.0010) [2023-12-26 13:30:15,136][123091] Updated weights for policy 0, policy_version 1741911 (0.0011) [2023-12-26 13:30:15,200][123091] Updated weights for policy 0, policy_version 1741921 (0.0011) [2023-12-26 13:30:15,204][123090] Updated weights for policy 1, policy_version 1730374 (0.0007) [2023-12-26 13:30:15,265][123091] Updated weights for policy 0, policy_version 1741931 (0.0009) [2023-12-26 13:30:15,274][123090] Updated weights for policy 1, policy_version 1730384 (0.0007) [2023-12-26 13:30:15,338][123090] Updated weights for policy 1, policy_version 1730394 (0.0008) [2023-12-26 13:30:16,036][123090] Updated weights for policy 1, policy_version 1730404 (0.0007) [2023-12-26 13:30:16,085][123091] Updated weights for policy 0, policy_version 1741941 (0.0008) [2023-12-26 13:30:16,102][123090] Updated weights for policy 1, policy_version 1730414 (0.0005) [2023-12-26 13:30:16,148][123091] Updated weights for policy 0, policy_version 1741951 (0.0007) [2023-12-26 13:30:16,158][123090] Updated weights for policy 1, policy_version 1730424 (0.0005) [2023-12-26 13:30:16,223][123091] Updated weights for policy 0, policy_version 1741961 (0.0008) [2023-12-26 13:30:16,671][123090] Updated weights for policy 1, policy_version 1730434 (0.0006) [2023-12-26 13:30:16,737][123090] Updated weights for policy 1, policy_version 1730444 (0.0008) [2023-12-26 13:30:16,798][123090] Updated weights for policy 1, policy_version 1730454 (0.0010) [2023-12-26 13:30:16,862][123090] Updated weights for policy 1, policy_version 1730464 (0.0010) [2023-12-26 13:30:17,003][123091] Updated weights for policy 0, policy_version 1741971 (0.0008) [2023-12-26 13:30:17,062][123091] Updated weights for policy 0, policy_version 1741981 (0.0005) [2023-12-26 13:30:17,127][123091] Updated weights for policy 0, policy_version 1741991 (0.0005) [2023-12-26 13:30:17,651][123090] Updated weights for policy 1, policy_version 1730474 (0.0005) [2023-12-26 13:30:17,713][123090] Updated weights for policy 1, policy_version 1730484 (0.0009) [2023-12-26 13:30:17,713][123091] Updated weights for policy 0, policy_version 1742001 (0.0005) [2023-12-26 13:30:17,765][123091] Updated weights for policy 0, policy_version 1742011 (0.0007) [2023-12-26 13:30:17,789][123090] Updated weights for policy 1, policy_version 1730494 (0.0009) [2023-12-26 13:30:17,821][123091] Updated weights for policy 0, policy_version 1742021 (0.0006) [2023-12-26 13:30:17,877][123091] Updated weights for policy 0, policy_version 1742031 (0.0005) [2023-12-26 13:30:18,611][123091] Updated weights for policy 0, policy_version 1742041 (0.0010) [2023-12-26 13:30:18,647][123090] Updated weights for policy 1, policy_version 1730504 (0.0009) [2023-12-26 13:30:18,667][123091] Updated weights for policy 0, policy_version 1742051 (0.0011) [2023-12-26 13:30:18,712][123090] Updated weights for policy 1, policy_version 1730514 (0.0006) [2023-12-26 13:30:18,735][123091] Updated weights for policy 0, policy_version 1742061 (0.0011) [2023-12-26 13:30:18,782][123090] Updated weights for policy 1, policy_version 1730524 (0.0008) [2023-12-26 13:30:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 888979456. Throughput: 0: 8875.8, 1: 8921.6. Samples: 888992052. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:30:18,785][121949] Avg episode reward: [(0, '5948.992'), (1, '5469.397')] [2023-12-26 13:30:19,515][123091] Updated weights for policy 0, policy_version 1742071 (0.0011) [2023-12-26 13:30:19,575][123091] Updated weights for policy 0, policy_version 1742081 (0.0011) [2023-12-26 13:30:19,627][123090] Updated weights for policy 1, policy_version 1730534 (0.0009) [2023-12-26 13:30:19,647][123091] Updated weights for policy 0, policy_version 1742091 (0.0011) [2023-12-26 13:30:19,697][123090] Updated weights for policy 1, policy_version 1730544 (0.0007) [2023-12-26 13:30:19,757][123090] Updated weights for policy 1, policy_version 1730554 (0.0009) [2023-12-26 13:30:20,438][123091] Updated weights for policy 0, policy_version 1742101 (0.0008) [2023-12-26 13:30:20,491][123091] Updated weights for policy 0, policy_version 1742111 (0.0006) [2023-12-26 13:30:20,539][123091] Updated weights for policy 0, policy_version 1742121 (0.0005) [2023-12-26 13:30:20,640][123090] Updated weights for policy 1, policy_version 1730564 (0.0009) [2023-12-26 13:30:20,697][123090] Updated weights for policy 1, policy_version 1730574 (0.0009) [2023-12-26 13:30:20,751][123090] Updated weights for policy 1, policy_version 1730584 (0.0010) [2023-12-26 13:30:21,285][123091] Updated weights for policy 0, policy_version 1742131 (0.0008) [2023-12-26 13:30:21,351][123091] Updated weights for policy 0, policy_version 1742141 (0.0010) [2023-12-26 13:30:21,426][123091] Updated weights for policy 0, policy_version 1742151 (0.0009) [2023-12-26 13:30:21,653][123090] Updated weights for policy 1, policy_version 1730594 (0.0010) [2023-12-26 13:30:21,726][123090] Updated weights for policy 1, policy_version 1730604 (0.0010) [2023-12-26 13:30:21,805][123090] Updated weights for policy 1, policy_version 1730614 (0.0010) [2023-12-26 13:30:21,885][123090] Updated weights for policy 1, policy_version 1730624 (0.0010) [2023-12-26 13:30:22,207][123091] Updated weights for policy 0, policy_version 1742161 (0.0010) [2023-12-26 13:30:22,269][123091] Updated weights for policy 0, policy_version 1742171 (0.0010) [2023-12-26 13:30:22,339][123091] Updated weights for policy 0, policy_version 1742181 (0.0009) [2023-12-26 13:30:22,410][123091] Updated weights for policy 0, policy_version 1742191 (0.0010) [2023-12-26 13:30:22,726][123090] Updated weights for policy 1, policy_version 1730634 (0.0009) [2023-12-26 13:30:22,794][123090] Updated weights for policy 1, policy_version 1730644 (0.0010) [2023-12-26 13:30:22,856][123090] Updated weights for policy 1, policy_version 1730654 (0.0009) [2023-12-26 13:30:23,202][123091] Updated weights for policy 0, policy_version 1742201 (0.0010) [2023-12-26 13:30:23,263][123091] Updated weights for policy 0, policy_version 1742212 (0.0011) [2023-12-26 13:30:23,330][123091] Updated weights for policy 0, policy_version 1742222 (0.0009) [2023-12-26 13:30:23,679][123090] Updated weights for policy 1, policy_version 1730664 (0.0008) [2023-12-26 13:30:23,744][123090] Updated weights for policy 1, policy_version 1730674 (0.0009) [2023-12-26 13:30:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 889061376. Throughput: 0: 8838.9, 1: 8854.3. Samples: 889043520. Policy #0 lag: (min: 8.0, avg: 34.3, max: 40.0) [2023-12-26 13:30:23,785][121949] Avg episode reward: [(0, '5940.154'), (1, '5547.049')] [2023-12-26 13:30:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001742224_446013440.pth... [2023-12-26 13:30:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001741200_445751296.pth [2023-12-26 13:30:23,810][123090] Updated weights for policy 1, policy_version 1730684 (0.0008) [2023-12-26 13:30:23,827][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001730688_443056128.pth... [2023-12-26 13:30:23,830][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001729632_442785792.pth [2023-12-26 13:30:24,107][123091] Updated weights for policy 0, policy_version 1742232 (0.0006) [2023-12-26 13:30:24,187][123091] Updated weights for policy 0, policy_version 1742242 (0.0006) [2023-12-26 13:30:24,243][123091] Updated weights for policy 0, policy_version 1742252 (0.0006) [2023-12-26 13:30:24,636][123090] Updated weights for policy 1, policy_version 1730694 (0.0009) [2023-12-26 13:30:24,708][123090] Updated weights for policy 1, policy_version 1730704 (0.0010) [2023-12-26 13:30:24,775][123090] Updated weights for policy 1, policy_version 1730714 (0.0009) [2023-12-26 13:30:24,873][123091] Updated weights for policy 0, policy_version 1742262 (0.0005) [2023-12-26 13:30:24,942][123091] Updated weights for policy 0, policy_version 1742272 (0.0006) [2023-12-26 13:30:25,009][123091] Updated weights for policy 0, policy_version 1742282 (0.0005) [2023-12-26 13:30:25,647][123090] Updated weights for policy 1, policy_version 1730724 (0.0009) [2023-12-26 13:30:25,696][123091] Updated weights for policy 0, policy_version 1742292 (0.0006) [2023-12-26 13:30:25,696][123090] Updated weights for policy 1, policy_version 1730734 (0.0009) [2023-12-26 13:30:25,748][123090] Updated weights for policy 1, policy_version 1730744 (0.0009) [2023-12-26 13:30:25,759][123091] Updated weights for policy 0, policy_version 1742302 (0.0007) [2023-12-26 13:30:25,819][123091] Updated weights for policy 0, policy_version 1742312 (0.0005) [2023-12-26 13:30:26,585][123091] Updated weights for policy 0, policy_version 1742322 (0.0006) [2023-12-26 13:30:26,607][123090] Updated weights for policy 1, policy_version 1730754 (0.0009) [2023-12-26 13:30:26,631][123091] Updated weights for policy 0, policy_version 1742332 (0.0008) [2023-12-26 13:30:26,670][123090] Updated weights for policy 1, policy_version 1730764 (0.0008) [2023-12-26 13:30:26,677][123091] Updated weights for policy 0, policy_version 1742342 (0.0009) [2023-12-26 13:30:26,737][123090] Updated weights for policy 1, policy_version 1730774 (0.0008) [2023-12-26 13:30:26,739][123091] Updated weights for policy 0, policy_version 1742352 (0.0010) [2023-12-26 13:30:26,796][123090] Updated weights for policy 1, policy_version 1730784 (0.0009) [2023-12-26 13:30:27,569][123091] Updated weights for policy 0, policy_version 1742362 (0.0011) [2023-12-26 13:30:27,628][123091] Updated weights for policy 0, policy_version 1742372 (0.0009) [2023-12-26 13:30:27,635][123090] Updated weights for policy 1, policy_version 1730794 (0.0008) [2023-12-26 13:30:27,682][123091] Updated weights for policy 0, policy_version 1742382 (0.0009) [2023-12-26 13:30:27,685][123090] Updated weights for policy 1, policy_version 1730804 (0.0007) [2023-12-26 13:30:27,745][123090] Updated weights for policy 1, policy_version 1730814 (0.0009) [2023-12-26 13:30:28,523][123091] Updated weights for policy 0, policy_version 1742392 (0.0007) [2023-12-26 13:30:28,582][123091] Updated weights for policy 0, policy_version 1742402 (0.0009) [2023-12-26 13:30:28,601][123090] Updated weights for policy 1, policy_version 1730824 (0.0009) [2023-12-26 13:30:28,639][123091] Updated weights for policy 0, policy_version 1742412 (0.0006) [2023-12-26 13:30:28,667][123090] Updated weights for policy 1, policy_version 1730834 (0.0010) [2023-12-26 13:30:28,735][123090] Updated weights for policy 1, policy_version 1730844 (0.0009) [2023-12-26 13:30:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 889159680. Throughput: 0: 8954.1, 1: 8754.0. Samples: 889148912. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:28,785][121949] Avg episode reward: [(0, '5963.739'), (1, '5480.428')] [2023-12-26 13:30:29,423][123091] Updated weights for policy 0, policy_version 1742422 (0.0008) [2023-12-26 13:30:29,477][123091] Updated weights for policy 0, policy_version 1742432 (0.0009) [2023-12-26 13:30:29,530][123091] Updated weights for policy 0, policy_version 1742442 (0.0010) [2023-12-26 13:30:29,602][123090] Updated weights for policy 1, policy_version 1730854 (0.0007) [2023-12-26 13:30:29,673][123090] Updated weights for policy 1, policy_version 1730864 (0.0010) [2023-12-26 13:30:29,732][123090] Updated weights for policy 1, policy_version 1730874 (0.0009) [2023-12-26 13:30:30,402][123091] Updated weights for policy 0, policy_version 1742452 (0.0009) [2023-12-26 13:30:30,467][123091] Updated weights for policy 0, policy_version 1742462 (0.0009) [2023-12-26 13:30:30,535][123091] Updated weights for policy 0, policy_version 1742472 (0.0009) [2023-12-26 13:30:30,588][123090] Updated weights for policy 1, policy_version 1730884 (0.0009) [2023-12-26 13:30:30,647][123090] Updated weights for policy 1, policy_version 1730894 (0.0009) [2023-12-26 13:30:30,711][123090] Updated weights for policy 1, policy_version 1730904 (0.0009) [2023-12-26 13:30:31,391][123091] Updated weights for policy 0, policy_version 1742482 (0.0010) [2023-12-26 13:30:31,447][123091] Updated weights for policy 0, policy_version 1742492 (0.0010) [2023-12-26 13:30:31,509][123091] Updated weights for policy 0, policy_version 1742502 (0.0009) [2023-12-26 13:30:31,570][123091] Updated weights for policy 0, policy_version 1742512 (0.0009) [2023-12-26 13:30:31,581][123090] Updated weights for policy 1, policy_version 1730914 (0.0009) [2023-12-26 13:30:31,653][123090] Updated weights for policy 1, policy_version 1730924 (0.0009) [2023-12-26 13:30:31,723][123090] Updated weights for policy 1, policy_version 1730934 (0.0010) [2023-12-26 13:30:31,793][123090] Updated weights for policy 1, policy_version 1730944 (0.0010) [2023-12-26 13:30:32,416][123091] Updated weights for policy 0, policy_version 1742522 (0.0007) [2023-12-26 13:30:32,485][123091] Updated weights for policy 0, policy_version 1742532 (0.0006) [2023-12-26 13:30:32,553][123091] Updated weights for policy 0, policy_version 1742542 (0.0008) [2023-12-26 13:30:32,623][123090] Updated weights for policy 1, policy_version 1730954 (0.0011) [2023-12-26 13:30:32,690][123090] Updated weights for policy 1, policy_version 1730964 (0.0011) [2023-12-26 13:30:32,753][123090] Updated weights for policy 1, policy_version 1730974 (0.0010) [2023-12-26 13:30:33,246][123091] Updated weights for policy 0, policy_version 1742552 (0.0009) [2023-12-26 13:30:33,310][123091] Updated weights for policy 0, policy_version 1742562 (0.0009) [2023-12-26 13:30:33,364][123091] Updated weights for policy 0, policy_version 1742572 (0.0008) [2023-12-26 13:30:33,572][123090] Updated weights for policy 1, policy_version 1730984 (0.0006) [2023-12-26 13:30:33,645][123090] Updated weights for policy 1, policy_version 1730994 (0.0005) [2023-12-26 13:30:33,723][123090] Updated weights for policy 1, policy_version 1731004 (0.0005) [2023-12-26 13:30:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 889241600. Throughput: 0: 8928.5, 1: 8642.8. Samples: 889251044. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:33,785][121949] Avg episode reward: [(0, '6127.213'), (1, '5576.161')] [2023-12-26 13:30:34,263][123091] Updated weights for policy 0, policy_version 1742582 (0.0008) [2023-12-26 13:30:34,315][123090] Updated weights for policy 1, policy_version 1731014 (0.0009) [2023-12-26 13:30:34,322][123091] Updated weights for policy 0, policy_version 1742592 (0.0007) [2023-12-26 13:30:34,379][123090] Updated weights for policy 1, policy_version 1731024 (0.0006) [2023-12-26 13:30:34,382][123091] Updated weights for policy 0, policy_version 1742602 (0.0008) [2023-12-26 13:30:34,442][123090] Updated weights for policy 1, policy_version 1731034 (0.0007) [2023-12-26 13:30:35,123][123090] Updated weights for policy 1, policy_version 1731044 (0.0007) [2023-12-26 13:30:35,192][123090] Updated weights for policy 1, policy_version 1731054 (0.0006) [2023-12-26 13:30:35,241][123091] Updated weights for policy 0, policy_version 1742612 (0.0008) [2023-12-26 13:30:35,264][123090] Updated weights for policy 1, policy_version 1731064 (0.0005) [2023-12-26 13:30:35,309][123091] Updated weights for policy 0, policy_version 1742622 (0.0009) [2023-12-26 13:30:35,373][123091] Updated weights for policy 0, policy_version 1742632 (0.0009) [2023-12-26 13:30:35,939][123090] Updated weights for policy 1, policy_version 1731074 (0.0006) [2023-12-26 13:30:36,003][123090] Updated weights for policy 1, policy_version 1731084 (0.0008) [2023-12-26 13:30:36,053][123090] Updated weights for policy 1, policy_version 1731094 (0.0006) [2023-12-26 13:30:36,118][123090] Updated weights for policy 1, policy_version 1731104 (0.0006) [2023-12-26 13:30:36,269][123091] Updated weights for policy 0, policy_version 1742642 (0.0006) [2023-12-26 13:30:36,334][123091] Updated weights for policy 0, policy_version 1742652 (0.0010) [2023-12-26 13:30:36,402][123091] Updated weights for policy 0, policy_version 1742662 (0.0010) [2023-12-26 13:30:36,471][123091] Updated weights for policy 0, policy_version 1742672 (0.0009) [2023-12-26 13:30:36,912][123090] Updated weights for policy 1, policy_version 1731114 (0.0011) [2023-12-26 13:30:36,977][123090] Updated weights for policy 1, policy_version 1731124 (0.0011) [2023-12-26 13:30:37,042][123090] Updated weights for policy 1, policy_version 1731134 (0.0011) [2023-12-26 13:30:37,314][123091] Updated weights for policy 0, policy_version 1742682 (0.0005) [2023-12-26 13:30:37,379][123091] Updated weights for policy 0, policy_version 1742692 (0.0007) [2023-12-26 13:30:37,437][123091] Updated weights for policy 0, policy_version 1742702 (0.0006) [2023-12-26 13:30:37,875][123090] Updated weights for policy 1, policy_version 1731144 (0.0011) [2023-12-26 13:30:37,935][123090] Updated weights for policy 1, policy_version 1731154 (0.0011) [2023-12-26 13:30:37,992][123090] Updated weights for policy 1, policy_version 1731164 (0.0011) [2023-12-26 13:30:38,040][123091] Updated weights for policy 0, policy_version 1742712 (0.0009) [2023-12-26 13:30:38,104][123091] Updated weights for policy 0, policy_version 1742722 (0.0011) [2023-12-26 13:30:38,169][123091] Updated weights for policy 0, policy_version 1742732 (0.0010) [2023-12-26 13:30:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 889323520. Throughput: 0: 8857.9, 1: 8741.8. Samples: 889304464. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:38,785][121949] Avg episode reward: [(0, '6111.737'), (1, '5706.883')] [2023-12-26 13:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001742736_446144512.pth... [2023-12-26 13:30:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001741680_445874176.pth [2023-12-26 13:30:38,829][123090] Updated weights for policy 1, policy_version 1731174 (0.0008) [2023-12-26 13:30:38,891][123090] Updated weights for policy 1, policy_version 1731184 (0.0009) [2023-12-26 13:30:38,940][123090] Updated weights for policy 1, policy_version 1731194 (0.0009) [2023-12-26 13:30:38,972][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001731200_443187200.pth... [2023-12-26 13:30:38,975][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001730176_442925056.pth [2023-12-26 13:30:39,050][123091] Updated weights for policy 0, policy_version 1742742 (0.0010) [2023-12-26 13:30:39,105][123091] Updated weights for policy 0, policy_version 1742752 (0.0009) [2023-12-26 13:30:39,158][123091] Updated weights for policy 0, policy_version 1742762 (0.0010) [2023-12-26 13:30:39,783][123090] Updated weights for policy 1, policy_version 1731204 (0.0009) [2023-12-26 13:30:39,850][123090] Updated weights for policy 1, policy_version 1731214 (0.0009) [2023-12-26 13:30:39,912][123090] Updated weights for policy 1, policy_version 1731224 (0.0009) [2023-12-26 13:30:40,024][123091] Updated weights for policy 0, policy_version 1742773 (0.0011) [2023-12-26 13:30:40,098][123091] Updated weights for policy 0, policy_version 1742783 (0.0009) [2023-12-26 13:30:40,151][123091] Updated weights for policy 0, policy_version 1742793 (0.0011) [2023-12-26 13:30:40,756][123090] Updated weights for policy 1, policy_version 1731234 (0.0009) [2023-12-26 13:30:40,804][123090] Updated weights for policy 1, policy_version 1731244 (0.0008) [2023-12-26 13:30:40,856][123090] Updated weights for policy 1, policy_version 1731254 (0.0007) [2023-12-26 13:30:40,889][123091] Updated weights for policy 0, policy_version 1742803 (0.0009) [2023-12-26 13:30:40,920][123090] Updated weights for policy 1, policy_version 1731264 (0.0008) [2023-12-26 13:30:40,957][123091] Updated weights for policy 0, policy_version 1742813 (0.0006) [2023-12-26 13:30:41,030][123091] Updated weights for policy 0, policy_version 1742823 (0.0006) [2023-12-26 13:30:41,773][123091] Updated weights for policy 0, policy_version 1742833 (0.0008) [2023-12-26 13:30:41,804][123090] Updated weights for policy 1, policy_version 1731274 (0.0010) [2023-12-26 13:30:41,840][123091] Updated weights for policy 0, policy_version 1742843 (0.0008) [2023-12-26 13:30:41,868][123090] Updated weights for policy 1, policy_version 1731284 (0.0009) [2023-12-26 13:30:41,903][123091] Updated weights for policy 0, policy_version 1742853 (0.0008) [2023-12-26 13:30:41,927][123090] Updated weights for policy 1, policy_version 1731294 (0.0010) [2023-12-26 13:30:41,972][123091] Updated weights for policy 0, policy_version 1742863 (0.0008) [2023-12-26 13:30:42,663][123090] Updated weights for policy 1, policy_version 1731304 (0.0005) [2023-12-26 13:30:42,723][123090] Updated weights for policy 1, policy_version 1731314 (0.0005) [2023-12-26 13:30:42,782][123090] Updated weights for policy 1, policy_version 1731324 (0.0008) [2023-12-26 13:30:42,820][123091] Updated weights for policy 0, policy_version 1742873 (0.0009) [2023-12-26 13:30:42,880][123091] Updated weights for policy 0, policy_version 1742883 (0.0010) [2023-12-26 13:30:42,931][123091] Updated weights for policy 0, policy_version 1742893 (0.0009) [2023-12-26 13:30:43,545][123090] Updated weights for policy 1, policy_version 1731334 (0.0006) [2023-12-26 13:30:43,599][123090] Updated weights for policy 1, policy_version 1731344 (0.0005) [2023-12-26 13:30:43,668][123090] Updated weights for policy 1, policy_version 1731354 (0.0005) [2023-12-26 13:30:43,748][123091] Updated weights for policy 0, policy_version 1742903 (0.0010) [2023-12-26 13:30:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 889413632. Throughput: 0: 8935.3, 1: 8666.5. Samples: 889408864. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:43,785][121949] Avg episode reward: [(0, '5981.458'), (1, '5750.203')] [2023-12-26 13:30:43,815][123091] Updated weights for policy 0, policy_version 1742913 (0.0009) [2023-12-26 13:30:43,872][123091] Updated weights for policy 0, policy_version 1742923 (0.0010) [2023-12-26 13:30:44,350][123090] Updated weights for policy 1, policy_version 1731364 (0.0008) [2023-12-26 13:30:44,405][123090] Updated weights for policy 1, policy_version 1731374 (0.0010) [2023-12-26 13:30:44,452][123090] Updated weights for policy 1, policy_version 1731384 (0.0008) [2023-12-26 13:30:44,722][123091] Updated weights for policy 0, policy_version 1742933 (0.0010) [2023-12-26 13:30:44,796][123091] Updated weights for policy 0, policy_version 1742943 (0.0009) [2023-12-26 13:30:44,850][123091] Updated weights for policy 0, policy_version 1742953 (0.0010) [2023-12-26 13:30:45,228][123090] Updated weights for policy 1, policy_version 1731394 (0.0009) [2023-12-26 13:30:45,302][123090] Updated weights for policy 1, policy_version 1731404 (0.0009) [2023-12-26 13:30:45,366][123090] Updated weights for policy 1, policy_version 1731414 (0.0009) [2023-12-26 13:30:45,425][123090] Updated weights for policy 1, policy_version 1731424 (0.0009) [2023-12-26 13:30:45,688][123091] Updated weights for policy 0, policy_version 1742963 (0.0010) [2023-12-26 13:30:45,753][123091] Updated weights for policy 0, policy_version 1742973 (0.0010) [2023-12-26 13:30:45,815][123091] Updated weights for policy 0, policy_version 1742983 (0.0010) [2023-12-26 13:30:46,265][123090] Updated weights for policy 1, policy_version 1731434 (0.0010) [2023-12-26 13:30:46,323][123090] Updated weights for policy 1, policy_version 1731445 (0.0009) [2023-12-26 13:30:46,399][123090] Updated weights for policy 1, policy_version 1731455 (0.0006) [2023-12-26 13:30:46,557][123091] Updated weights for policy 0, policy_version 1742993 (0.0010) [2023-12-26 13:30:46,614][123091] Updated weights for policy 0, policy_version 1743003 (0.0009) [2023-12-26 13:30:46,663][123091] Updated weights for policy 0, policy_version 1743013 (0.0010) [2023-12-26 13:30:46,722][123091] Updated weights for policy 0, policy_version 1743023 (0.0009) [2023-12-26 13:30:47,216][123090] Updated weights for policy 1, policy_version 1731465 (0.0009) [2023-12-26 13:30:47,271][123090] Updated weights for policy 1, policy_version 1731475 (0.0009) [2023-12-26 13:30:47,323][123090] Updated weights for policy 1, policy_version 1731485 (0.0005) [2023-12-26 13:30:47,446][123091] Updated weights for policy 0, policy_version 1743033 (0.0006) [2023-12-26 13:30:47,501][123091] Updated weights for policy 0, policy_version 1743043 (0.0011) [2023-12-26 13:30:47,556][123091] Updated weights for policy 0, policy_version 1743053 (0.0009) [2023-12-26 13:30:48,149][123090] Updated weights for policy 1, policy_version 1731495 (0.0009) [2023-12-26 13:30:48,213][123090] Updated weights for policy 1, policy_version 1731505 (0.0008) [2023-12-26 13:30:48,277][123090] Updated weights for policy 1, policy_version 1731515 (0.0009) [2023-12-26 13:30:48,280][123091] Updated weights for policy 0, policy_version 1743063 (0.0007) [2023-12-26 13:30:48,345][123091] Updated weights for policy 0, policy_version 1743073 (0.0008) [2023-12-26 13:30:48,409][123091] Updated weights for policy 0, policy_version 1743083 (0.0009) [2023-12-26 13:30:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 889503744. Throughput: 0: 8933.5, 1: 8699.2. Samples: 889514284. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:48,786][121949] Avg episode reward: [(0, '5938.232'), (1, '5669.452')] [2023-12-26 13:30:49,102][123090] Updated weights for policy 1, policy_version 1731525 (0.0009) [2023-12-26 13:30:49,171][123090] Updated weights for policy 1, policy_version 1731535 (0.0010) [2023-12-26 13:30:49,239][123091] Updated weights for policy 0, policy_version 1743093 (0.0009) [2023-12-26 13:30:49,243][123090] Updated weights for policy 1, policy_version 1731545 (0.0009) [2023-12-26 13:30:49,312][123091] Updated weights for policy 0, policy_version 1743103 (0.0008) [2023-12-26 13:30:49,385][123091] Updated weights for policy 0, policy_version 1743113 (0.0008) [2023-12-26 13:30:50,101][123090] Updated weights for policy 1, policy_version 1731555 (0.0010) [2023-12-26 13:30:50,170][123090] Updated weights for policy 1, policy_version 1731565 (0.0010) [2023-12-26 13:30:50,200][123091] Updated weights for policy 0, policy_version 1743123 (0.0009) [2023-12-26 13:30:50,237][123090] Updated weights for policy 1, policy_version 1731575 (0.0009) [2023-12-26 13:30:50,267][123091] Updated weights for policy 0, policy_version 1743133 (0.0008) [2023-12-26 13:30:50,337][123091] Updated weights for policy 0, policy_version 1743143 (0.0009) [2023-12-26 13:30:51,095][123090] Updated weights for policy 1, policy_version 1731585 (0.0010) [2023-12-26 13:30:51,156][123090] Updated weights for policy 1, policy_version 1731595 (0.0009) [2023-12-26 13:30:51,156][123091] Updated weights for policy 0, policy_version 1743153 (0.0010) [2023-12-26 13:30:51,217][123091] Updated weights for policy 0, policy_version 1743163 (0.0010) [2023-12-26 13:30:51,219][123090] Updated weights for policy 1, policy_version 1731605 (0.0007) [2023-12-26 13:30:51,280][123091] Updated weights for policy 0, policy_version 1743173 (0.0007) [2023-12-26 13:30:51,282][123090] Updated weights for policy 1, policy_version 1731615 (0.0010) [2023-12-26 13:30:51,348][123091] Updated weights for policy 0, policy_version 1743183 (0.0010) [2023-12-26 13:30:52,155][123090] Updated weights for policy 1, policy_version 1731625 (0.0009) [2023-12-26 13:30:52,223][123090] Updated weights for policy 1, policy_version 1731635 (0.0010) [2023-12-26 13:30:52,227][123091] Updated weights for policy 0, policy_version 1743193 (0.0009) [2023-12-26 13:30:52,286][123090] Updated weights for policy 1, policy_version 1731645 (0.0009) [2023-12-26 13:30:52,290][123091] Updated weights for policy 0, policy_version 1743203 (0.0007) [2023-12-26 13:30:52,352][123091] Updated weights for policy 0, policy_version 1743213 (0.0010) [2023-12-26 13:30:53,072][123090] Updated weights for policy 1, policy_version 1731655 (0.0008) [2023-12-26 13:30:53,128][123090] Updated weights for policy 1, policy_version 1731665 (0.0009) [2023-12-26 13:30:53,193][123091] Updated weights for policy 0, policy_version 1743223 (0.0008) [2023-12-26 13:30:53,193][123090] Updated weights for policy 1, policy_version 1731675 (0.0010) [2023-12-26 13:30:53,258][123091] Updated weights for policy 0, policy_version 1743233 (0.0009) [2023-12-26 13:30:53,322][123091] Updated weights for policy 0, policy_version 1743243 (0.0007) [2023-12-26 13:30:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 889585664. Throughput: 0: 8898.5, 1: 8645.1. Samples: 889564204. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:53,785][121949] Avg episode reward: [(0, '5963.629'), (1, '5634.109')] [2023-12-26 13:30:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001731680_443310080.pth... [2023-12-26 13:30:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001743248_446275584.pth... [2023-12-26 13:30:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001730688_443056128.pth [2023-12-26 13:30:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001742224_446013440.pth [2023-12-26 13:30:53,991][123090] Updated weights for policy 1, policy_version 1731685 (0.0009) [2023-12-26 13:30:54,009][123091] Updated weights for policy 0, policy_version 1743253 (0.0007) [2023-12-26 13:30:54,044][123090] Updated weights for policy 1, policy_version 1731695 (0.0010) [2023-12-26 13:30:54,076][123091] Updated weights for policy 0, policy_version 1743263 (0.0005) [2023-12-26 13:30:54,108][123090] Updated weights for policy 1, policy_version 1731705 (0.0008) [2023-12-26 13:30:54,128][123091] Updated weights for policy 0, policy_version 1743273 (0.0009) [2023-12-26 13:30:54,926][123091] Updated weights for policy 0, policy_version 1743283 (0.0009) [2023-12-26 13:30:54,958][123090] Updated weights for policy 1, policy_version 1731715 (0.0008) [2023-12-26 13:30:54,989][123091] Updated weights for policy 0, policy_version 1743293 (0.0009) [2023-12-26 13:30:55,019][123090] Updated weights for policy 1, policy_version 1731725 (0.0008) [2023-12-26 13:30:55,050][123091] Updated weights for policy 0, policy_version 1743303 (0.0008) [2023-12-26 13:30:55,066][123090] Updated weights for policy 1, policy_version 1731735 (0.0007) [2023-12-26 13:30:55,810][123091] Updated weights for policy 0, policy_version 1743313 (0.0006) [2023-12-26 13:30:55,879][123091] Updated weights for policy 0, policy_version 1743323 (0.0005) [2023-12-26 13:30:55,936][123090] Updated weights for policy 1, policy_version 1731745 (0.0008) [2023-12-26 13:30:55,941][123091] Updated weights for policy 0, policy_version 1743333 (0.0005) [2023-12-26 13:30:55,981][123090] Updated weights for policy 1, policy_version 1731755 (0.0007) [2023-12-26 13:30:56,007][123091] Updated weights for policy 0, policy_version 1743343 (0.0010) [2023-12-26 13:30:56,042][123090] Updated weights for policy 1, policy_version 1731765 (0.0008) [2023-12-26 13:30:56,093][123090] Updated weights for policy 1, policy_version 1731775 (0.0009) [2023-12-26 13:30:56,697][123091] Updated weights for policy 0, policy_version 1743353 (0.0006) [2023-12-26 13:30:56,746][123091] Updated weights for policy 0, policy_version 1743363 (0.0006) [2023-12-26 13:30:56,788][123091] Updated weights for policy 0, policy_version 1743373 (0.0008) [2023-12-26 13:30:56,984][123090] Updated weights for policy 1, policy_version 1731785 (0.0010) [2023-12-26 13:30:57,055][123090] Updated weights for policy 1, policy_version 1731795 (0.0009) [2023-12-26 13:30:57,117][123090] Updated weights for policy 1, policy_version 1731805 (0.0008) [2023-12-26 13:30:57,566][123091] Updated weights for policy 0, policy_version 1743383 (0.0010) [2023-12-26 13:30:57,618][123091] Updated weights for policy 0, policy_version 1743393 (0.0010) [2023-12-26 13:30:57,665][123091] Updated weights for policy 0, policy_version 1743403 (0.0010) [2023-12-26 13:30:57,952][123090] Updated weights for policy 1, policy_version 1731815 (0.0009) [2023-12-26 13:30:58,004][123090] Updated weights for policy 1, policy_version 1731826 (0.0010) [2023-12-26 13:30:58,065][123090] Updated weights for policy 1, policy_version 1731836 (0.0009) [2023-12-26 13:30:58,530][123091] Updated weights for policy 0, policy_version 1743413 (0.0010) [2023-12-26 13:30:58,602][123091] Updated weights for policy 0, policy_version 1743423 (0.0009) [2023-12-26 13:30:58,669][123091] Updated weights for policy 0, policy_version 1743433 (0.0008) [2023-12-26 13:30:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 889675776. Throughput: 0: 8926.7, 1: 8620.3. Samples: 889668956. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:30:58,785][121949] Avg episode reward: [(0, '5956.463'), (1, '5843.108')] [2023-12-26 13:30:59,043][123090] Updated weights for policy 1, policy_version 1731846 (0.0007) [2023-12-26 13:30:59,112][123090] Updated weights for policy 1, policy_version 1731856 (0.0006) [2023-12-26 13:30:59,188][123090] Updated weights for policy 1, policy_version 1731866 (0.0007) [2023-12-26 13:30:59,539][123091] Updated weights for policy 0, policy_version 1743443 (0.0007) [2023-12-26 13:30:59,610][123091] Updated weights for policy 0, policy_version 1743453 (0.0007) [2023-12-26 13:30:59,674][123091] Updated weights for policy 0, policy_version 1743463 (0.0009) [2023-12-26 13:30:59,961][123090] Updated weights for policy 1, policy_version 1731876 (0.0007) [2023-12-26 13:31:00,025][123090] Updated weights for policy 1, policy_version 1731886 (0.0007) [2023-12-26 13:31:00,086][123090] Updated weights for policy 1, policy_version 1731896 (0.0009) [2023-12-26 13:31:00,498][123091] Updated weights for policy 0, policy_version 1743473 (0.0006) [2023-12-26 13:31:00,562][123091] Updated weights for policy 0, policy_version 1743483 (0.0010) [2023-12-26 13:31:00,626][123091] Updated weights for policy 0, policy_version 1743493 (0.0009) [2023-12-26 13:31:00,675][123091] Updated weights for policy 0, policy_version 1743503 (0.0009) [2023-12-26 13:31:00,817][123090] Updated weights for policy 1, policy_version 1731906 (0.0007) [2023-12-26 13:31:00,878][123090] Updated weights for policy 1, policy_version 1731916 (0.0009) [2023-12-26 13:31:00,946][123090] Updated weights for policy 1, policy_version 1731926 (0.0009) [2023-12-26 13:31:01,005][123090] Updated weights for policy 1, policy_version 1731936 (0.0010) [2023-12-26 13:31:01,505][123091] Updated weights for policy 0, policy_version 1743513 (0.0010) [2023-12-26 13:31:01,564][123091] Updated weights for policy 0, policy_version 1743523 (0.0010) [2023-12-26 13:31:01,625][123091] Updated weights for policy 0, policy_version 1743533 (0.0010) [2023-12-26 13:31:01,820][123090] Updated weights for policy 1, policy_version 1731946 (0.0009) [2023-12-26 13:31:01,883][123090] Updated weights for policy 1, policy_version 1731956 (0.0009) [2023-12-26 13:31:01,943][123090] Updated weights for policy 1, policy_version 1731966 (0.0008) [2023-12-26 13:31:02,450][123091] Updated weights for policy 0, policy_version 1743543 (0.0011) [2023-12-26 13:31:02,514][123091] Updated weights for policy 0, policy_version 1743553 (0.0011) [2023-12-26 13:31:02,576][123091] Updated weights for policy 0, policy_version 1743563 (0.0008) [2023-12-26 13:31:02,676][123090] Updated weights for policy 1, policy_version 1731976 (0.0006) [2023-12-26 13:31:02,733][123090] Updated weights for policy 1, policy_version 1731986 (0.0005) [2023-12-26 13:31:02,784][123090] Updated weights for policy 1, policy_version 1731996 (0.0006) [2023-12-26 13:31:03,223][123091] Updated weights for policy 0, policy_version 1743573 (0.0007) [2023-12-26 13:31:03,269][123091] Updated weights for policy 0, policy_version 1743583 (0.0005) [2023-12-26 13:31:03,324][123091] Updated weights for policy 0, policy_version 1743593 (0.0006) [2023-12-26 13:31:03,613][123090] Updated weights for policy 1, policy_version 1732007 (0.0008) [2023-12-26 13:31:03,667][123090] Updated weights for policy 1, policy_version 1732017 (0.0010) [2023-12-26 13:31:03,724][123090] Updated weights for policy 1, policy_version 1732027 (0.0010) [2023-12-26 13:31:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 889765888. Throughput: 0: 8812.8, 1: 8562.2. Samples: 889773928. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:03,785][121949] Avg episode reward: [(0, '5960.429'), (1, '5665.276')] [2023-12-26 13:31:03,965][123091] Updated weights for policy 0, policy_version 1743603 (0.0007) [2023-12-26 13:31:04,022][123091] Updated weights for policy 0, policy_version 1743613 (0.0006) [2023-12-26 13:31:04,085][123091] Updated weights for policy 0, policy_version 1743623 (0.0006) [2023-12-26 13:31:04,586][123090] Updated weights for policy 1, policy_version 1732037 (0.0010) [2023-12-26 13:31:04,640][123090] Updated weights for policy 1, policy_version 1732047 (0.0009) [2023-12-26 13:31:04,694][123090] Updated weights for policy 1, policy_version 1732057 (0.0010) [2023-12-26 13:31:04,845][123091] Updated weights for policy 0, policy_version 1743633 (0.0008) [2023-12-26 13:31:04,904][123091] Updated weights for policy 0, policy_version 1743643 (0.0006) [2023-12-26 13:31:04,950][123091] Updated weights for policy 0, policy_version 1743653 (0.0010) [2023-12-26 13:31:05,002][123091] Updated weights for policy 0, policy_version 1743663 (0.0010) [2023-12-26 13:31:05,504][123090] Updated weights for policy 1, policy_version 1732067 (0.0008) [2023-12-26 13:31:05,578][123090] Updated weights for policy 1, policy_version 1732077 (0.0008) [2023-12-26 13:31:05,651][123090] Updated weights for policy 1, policy_version 1732087 (0.0010) [2023-12-26 13:31:05,695][123091] Updated weights for policy 0, policy_version 1743673 (0.0010) [2023-12-26 13:31:05,754][123091] Updated weights for policy 0, policy_version 1743683 (0.0010) [2023-12-26 13:31:05,809][123091] Updated weights for policy 0, policy_version 1743693 (0.0010) [2023-12-26 13:31:06,399][123090] Updated weights for policy 1, policy_version 1732097 (0.0010) [2023-12-26 13:31:06,471][123090] Updated weights for policy 1, policy_version 1732107 (0.0006) [2023-12-26 13:31:06,545][123090] Updated weights for policy 1, policy_version 1732117 (0.0009) [2023-12-26 13:31:06,617][123090] Updated weights for policy 1, policy_version 1732127 (0.0008) [2023-12-26 13:31:06,629][123091] Updated weights for policy 0, policy_version 1743703 (0.0011) [2023-12-26 13:31:06,693][123091] Updated weights for policy 0, policy_version 1743713 (0.0009) [2023-12-26 13:31:06,761][123091] Updated weights for policy 0, policy_version 1743723 (0.0011) [2023-12-26 13:31:07,405][123090] Updated weights for policy 1, policy_version 1732137 (0.0010) [2023-12-26 13:31:07,460][123090] Updated weights for policy 1, policy_version 1732147 (0.0010) [2023-12-26 13:31:07,514][123091] Updated weights for policy 0, policy_version 1743733 (0.0008) [2023-12-26 13:31:07,516][123090] Updated weights for policy 1, policy_version 1732157 (0.0006) [2023-12-26 13:31:07,581][123091] Updated weights for policy 0, policy_version 1743743 (0.0007) [2023-12-26 13:31:07,644][123091] Updated weights for policy 0, policy_version 1743753 (0.0010) [2023-12-26 13:31:08,250][123090] Updated weights for policy 1, policy_version 1732167 (0.0006) [2023-12-26 13:31:08,309][123090] Updated weights for policy 1, policy_version 1732177 (0.0005) [2023-12-26 13:31:08,345][123091] Updated weights for policy 0, policy_version 1743763 (0.0010) [2023-12-26 13:31:08,371][123090] Updated weights for policy 1, policy_version 1732187 (0.0010) [2023-12-26 13:31:08,411][123091] Updated weights for policy 0, policy_version 1743773 (0.0008) [2023-12-26 13:31:08,474][123091] Updated weights for policy 0, policy_version 1743783 (0.0008) [2023-12-26 13:31:08,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 889856000. Throughput: 0: 8832.9, 1: 8618.1. Samples: 889828812. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:08,785][121949] Avg episode reward: [(0, '6106.272'), (1, '5527.449')] [2023-12-26 13:31:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001743792_446414848.pth... [2023-12-26 13:31:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001732192_443441152.pth... [2023-12-26 13:31:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001742736_446144512.pth [2023-12-26 13:31:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001731200_443187200.pth [2023-12-26 13:31:09,172][123090] Updated weights for policy 1, policy_version 1732197 (0.0009) [2023-12-26 13:31:09,218][123090] Updated weights for policy 1, policy_version 1732207 (0.0009) [2023-12-26 13:31:09,284][123090] Updated weights for policy 1, policy_version 1732217 (0.0009) [2023-12-26 13:31:09,301][123091] Updated weights for policy 0, policy_version 1743793 (0.0008) [2023-12-26 13:31:09,373][123091] Updated weights for policy 0, policy_version 1743803 (0.0008) [2023-12-26 13:31:09,446][123091] Updated weights for policy 0, policy_version 1743813 (0.0007) [2023-12-26 13:31:09,508][123091] Updated weights for policy 0, policy_version 1743823 (0.0008) [2023-12-26 13:31:10,238][123090] Updated weights for policy 1, policy_version 1732227 (0.0008) [2023-12-26 13:31:10,256][123091] Updated weights for policy 0, policy_version 1743833 (0.0006) [2023-12-26 13:31:10,307][123090] Updated weights for policy 1, policy_version 1732237 (0.0010) [2023-12-26 13:31:10,320][123091] Updated weights for policy 0, policy_version 1743843 (0.0005) [2023-12-26 13:31:10,373][123090] Updated weights for policy 1, policy_version 1732247 (0.0009) [2023-12-26 13:31:10,378][123091] Updated weights for policy 0, policy_version 1743853 (0.0007) [2023-12-26 13:31:11,048][123090] Updated weights for policy 1, policy_version 1732257 (0.0006) [2023-12-26 13:31:11,092][123091] Updated weights for policy 0, policy_version 1743863 (0.0007) [2023-12-26 13:31:11,120][123090] Updated weights for policy 1, policy_version 1732267 (0.0010) [2023-12-26 13:31:11,152][123091] Updated weights for policy 0, policy_version 1743873 (0.0008) [2023-12-26 13:31:11,191][123090] Updated weights for policy 1, policy_version 1732277 (0.0009) [2023-12-26 13:31:11,218][123091] Updated weights for policy 0, policy_version 1743883 (0.0009) [2023-12-26 13:31:11,256][123090] Updated weights for policy 1, policy_version 1732287 (0.0007) [2023-12-26 13:31:12,090][123091] Updated weights for policy 0, policy_version 1743893 (0.0009) [2023-12-26 13:31:12,101][123090] Updated weights for policy 1, policy_version 1732297 (0.0009) [2023-12-26 13:31:12,159][123091] Updated weights for policy 0, policy_version 1743903 (0.0009) [2023-12-26 13:31:12,161][123090] Updated weights for policy 1, policy_version 1732307 (0.0009) [2023-12-26 13:31:12,221][123090] Updated weights for policy 1, policy_version 1732317 (0.0007) [2023-12-26 13:31:12,223][123091] Updated weights for policy 0, policy_version 1743913 (0.0008) [2023-12-26 13:31:13,038][123091] Updated weights for policy 0, policy_version 1743923 (0.0007) [2023-12-26 13:31:13,090][123091] Updated weights for policy 0, policy_version 1743933 (0.0006) [2023-12-26 13:31:13,133][123090] Updated weights for policy 1, policy_version 1732327 (0.0008) [2023-12-26 13:31:13,145][123091] Updated weights for policy 0, policy_version 1743943 (0.0007) [2023-12-26 13:31:13,201][123090] Updated weights for policy 1, policy_version 1732337 (0.0007) [2023-12-26 13:31:13,252][123090] Updated weights for policy 1, policy_version 1732347 (0.0005) [2023-12-26 13:31:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 889937920. Throughput: 0: 8807.3, 1: 8656.1. Samples: 889934764. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:13,784][121949] Avg episode reward: [(0, '6200.737'), (1, '5759.357')] [2023-12-26 13:31:13,858][123091] Updated weights for policy 0, policy_version 1743953 (0.0007) [2023-12-26 13:31:13,925][123091] Updated weights for policy 0, policy_version 1743963 (0.0008) [2023-12-26 13:31:13,988][123091] Updated weights for policy 0, policy_version 1743973 (0.0009) [2023-12-26 13:31:13,996][123090] Updated weights for policy 1, policy_version 1732357 (0.0008) [2023-12-26 13:31:14,044][123091] Updated weights for policy 0, policy_version 1743983 (0.0007) [2023-12-26 13:31:14,047][123090] Updated weights for policy 1, policy_version 1732367 (0.0010) [2023-12-26 13:31:14,104][123090] Updated weights for policy 1, policy_version 1732377 (0.0010) [2023-12-26 13:31:14,680][123091] Updated weights for policy 0, policy_version 1743993 (0.0005) [2023-12-26 13:31:14,746][123091] Updated weights for policy 0, policy_version 1744003 (0.0005) [2023-12-26 13:31:14,816][123091] Updated weights for policy 0, policy_version 1744013 (0.0007) [2023-12-26 13:31:14,926][123090] Updated weights for policy 1, policy_version 1732387 (0.0010) [2023-12-26 13:31:14,978][123090] Updated weights for policy 1, policy_version 1732397 (0.0010) [2023-12-26 13:31:15,032][123090] Updated weights for policy 1, policy_version 1732407 (0.0006) [2023-12-26 13:31:15,571][123091] Updated weights for policy 0, policy_version 1744023 (0.0009) [2023-12-26 13:31:15,631][123091] Updated weights for policy 0, policy_version 1744033 (0.0011) [2023-12-26 13:31:15,695][123091] Updated weights for policy 0, policy_version 1744043 (0.0011) [2023-12-26 13:31:15,814][123090] Updated weights for policy 1, policy_version 1732417 (0.0006) [2023-12-26 13:31:15,883][123090] Updated weights for policy 1, policy_version 1732427 (0.0008) [2023-12-26 13:31:15,941][123090] Updated weights for policy 1, policy_version 1732437 (0.0005) [2023-12-26 13:31:16,005][123090] Updated weights for policy 1, policy_version 1732447 (0.0005) [2023-12-26 13:31:16,388][123091] Updated weights for policy 0, policy_version 1744053 (0.0009) [2023-12-26 13:31:16,450][123091] Updated weights for policy 0, policy_version 1744063 (0.0010) [2023-12-26 13:31:16,504][123091] Updated weights for policy 0, policy_version 1744073 (0.0010) [2023-12-26 13:31:16,627][123090] Updated weights for policy 1, policy_version 1732457 (0.0005) [2023-12-26 13:31:16,688][123090] Updated weights for policy 1, policy_version 1732467 (0.0005) [2023-12-26 13:31:16,762][123090] Updated weights for policy 1, policy_version 1732477 (0.0005) [2023-12-26 13:31:17,194][123091] Updated weights for policy 0, policy_version 1744083 (0.0009) [2023-12-26 13:31:17,260][123091] Updated weights for policy 0, policy_version 1744093 (0.0005) [2023-12-26 13:31:17,316][123091] Updated weights for policy 0, policy_version 1744103 (0.0011) [2023-12-26 13:31:17,438][123090] Updated weights for policy 1, policy_version 1732487 (0.0008) [2023-12-26 13:31:17,490][123090] Updated weights for policy 1, policy_version 1732497 (0.0008) [2023-12-26 13:31:17,557][123090] Updated weights for policy 1, policy_version 1732507 (0.0009) [2023-12-26 13:31:17,961][123091] Updated weights for policy 0, policy_version 1744113 (0.0011) [2023-12-26 13:31:18,020][123091] Updated weights for policy 0, policy_version 1744123 (0.0010) [2023-12-26 13:31:18,079][123091] Updated weights for policy 0, policy_version 1744133 (0.0011) [2023-12-26 13:31:18,129][123091] Updated weights for policy 0, policy_version 1744143 (0.0008) [2023-12-26 13:31:18,431][123090] Updated weights for policy 1, policy_version 1732517 (0.0009) [2023-12-26 13:31:18,499][123090] Updated weights for policy 1, policy_version 1732527 (0.0009) [2023-12-26 13:31:18,577][123090] Updated weights for policy 1, policy_version 1732537 (0.0010) [2023-12-26 13:31:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 890036224. Throughput: 0: 8949.3, 1: 8748.2. Samples: 890047432. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:18,785][121949] Avg episode reward: [(0, '6138.685'), (1, '5693.832')] [2023-12-26 13:31:18,882][123091] Updated weights for policy 0, policy_version 1744153 (0.0007) [2023-12-26 13:31:18,947][123091] Updated weights for policy 0, policy_version 1744163 (0.0006) [2023-12-26 13:31:19,000][123091] Updated weights for policy 0, policy_version 1744173 (0.0009) [2023-12-26 13:31:19,473][123090] Updated weights for policy 1, policy_version 1732547 (0.0010) [2023-12-26 13:31:19,545][123090] Updated weights for policy 1, policy_version 1732557 (0.0009) [2023-12-26 13:31:19,617][123090] Updated weights for policy 1, policy_version 1732567 (0.0009) [2023-12-26 13:31:19,819][123091] Updated weights for policy 0, policy_version 1744183 (0.0011) [2023-12-26 13:31:19,887][123091] Updated weights for policy 0, policy_version 1744193 (0.0011) [2023-12-26 13:31:19,955][123091] Updated weights for policy 0, policy_version 1744203 (0.0011) [2023-12-26 13:31:20,497][123090] Updated weights for policy 1, policy_version 1732577 (0.0009) [2023-12-26 13:31:20,567][123090] Updated weights for policy 1, policy_version 1732587 (0.0007) [2023-12-26 13:31:20,640][123090] Updated weights for policy 1, policy_version 1732597 (0.0009) [2023-12-26 13:31:20,707][123090] Updated weights for policy 1, policy_version 1732607 (0.0009) [2023-12-26 13:31:20,736][123091] Updated weights for policy 0, policy_version 1744213 (0.0008) [2023-12-26 13:31:20,805][123091] Updated weights for policy 0, policy_version 1744223 (0.0011) [2023-12-26 13:31:20,878][123091] Updated weights for policy 0, policy_version 1744233 (0.0011) [2023-12-26 13:31:21,527][123090] Updated weights for policy 1, policy_version 1732617 (0.0007) [2023-12-26 13:31:21,587][123090] Updated weights for policy 1, policy_version 1732627 (0.0010) [2023-12-26 13:31:21,661][123090] Updated weights for policy 1, policy_version 1732637 (0.0011) [2023-12-26 13:31:21,753][123091] Updated weights for policy 0, policy_version 1744243 (0.0010) [2023-12-26 13:31:21,822][123091] Updated weights for policy 0, policy_version 1744253 (0.0009) [2023-12-26 13:31:21,892][123091] Updated weights for policy 0, policy_version 1744263 (0.0010) [2023-12-26 13:31:22,386][123090] Updated weights for policy 1, policy_version 1732647 (0.0010) [2023-12-26 13:31:22,450][123090] Updated weights for policy 1, policy_version 1732657 (0.0006) [2023-12-26 13:31:22,511][123090] Updated weights for policy 1, policy_version 1732667 (0.0008) [2023-12-26 13:31:22,646][123091] Updated weights for policy 0, policy_version 1744273 (0.0009) [2023-12-26 13:31:22,718][123091] Updated weights for policy 0, policy_version 1744283 (0.0010) [2023-12-26 13:31:22,772][123091] Updated weights for policy 0, policy_version 1744293 (0.0006) [2023-12-26 13:31:22,817][123091] Updated weights for policy 0, policy_version 1744303 (0.0005) [2023-12-26 13:31:23,322][123090] Updated weights for policy 1, policy_version 1732677 (0.0010) [2023-12-26 13:31:23,384][123090] Updated weights for policy 1, policy_version 1732687 (0.0009) [2023-12-26 13:31:23,449][123090] Updated weights for policy 1, policy_version 1732697 (0.0006) [2023-12-26 13:31:23,518][123091] Updated weights for policy 0, policy_version 1744313 (0.0010) [2023-12-26 13:31:23,577][123091] Updated weights for policy 0, policy_version 1744323 (0.0011) [2023-12-26 13:31:23,643][123091] Updated weights for policy 0, policy_version 1744333 (0.0011) [2023-12-26 13:31:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 890126336. Throughput: 0: 8997.4, 1: 8632.1. Samples: 890097792. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:23,784][121949] Avg episode reward: [(0, '5983.081'), (1, '5593.851')] [2023-12-26 13:31:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001744336_446554112.pth... [2023-12-26 13:31:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001732704_443572224.pth... [2023-12-26 13:31:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001743248_446275584.pth [2023-12-26 13:31:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001731680_443310080.pth [2023-12-26 13:31:24,175][123090] Updated weights for policy 1, policy_version 1732707 (0.0006) [2023-12-26 13:31:24,221][123090] Updated weights for policy 1, policy_version 1732717 (0.0008) [2023-12-26 13:31:24,274][123090] Updated weights for policy 1, policy_version 1732727 (0.0008) [2023-12-26 13:31:24,419][123091] Updated weights for policy 0, policy_version 1744343 (0.0009) [2023-12-26 13:31:24,488][123091] Updated weights for policy 0, policy_version 1744353 (0.0011) [2023-12-26 13:31:24,558][123091] Updated weights for policy 0, policy_version 1744363 (0.0011) [2023-12-26 13:31:25,070][123090] Updated weights for policy 1, policy_version 1732737 (0.0010) [2023-12-26 13:31:25,147][123090] Updated weights for policy 1, policy_version 1732747 (0.0010) [2023-12-26 13:31:25,219][123090] Updated weights for policy 1, policy_version 1732757 (0.0010) [2023-12-26 13:31:25,289][123090] Updated weights for policy 1, policy_version 1732767 (0.0010) [2023-12-26 13:31:25,315][123091] Updated weights for policy 0, policy_version 1744373 (0.0008) [2023-12-26 13:31:25,373][123091] Updated weights for policy 0, policy_version 1744383 (0.0006) [2023-12-26 13:31:25,435][123091] Updated weights for policy 0, policy_version 1744393 (0.0006) [2023-12-26 13:31:25,986][123090] Updated weights for policy 1, policy_version 1732777 (0.0005) [2023-12-26 13:31:26,031][123090] Updated weights for policy 1, policy_version 1732787 (0.0005) [2023-12-26 13:31:26,085][123090] Updated weights for policy 1, policy_version 1732797 (0.0005) [2023-12-26 13:31:26,088][123091] Updated weights for policy 0, policy_version 1744403 (0.0009) [2023-12-26 13:31:26,140][123091] Updated weights for policy 0, policy_version 1744413 (0.0005) [2023-12-26 13:31:26,195][123091] Updated weights for policy 0, policy_version 1744423 (0.0005) [2023-12-26 13:31:26,784][123090] Updated weights for policy 1, policy_version 1732807 (0.0005) [2023-12-26 13:31:26,835][123090] Updated weights for policy 1, policy_version 1732817 (0.0005) [2023-12-26 13:31:26,865][123091] Updated weights for policy 0, policy_version 1744433 (0.0005) [2023-12-26 13:31:26,888][123090] Updated weights for policy 1, policy_version 1732827 (0.0005) [2023-12-26 13:31:26,924][123091] Updated weights for policy 0, policy_version 1744443 (0.0005) [2023-12-26 13:31:26,970][123091] Updated weights for policy 0, policy_version 1744453 (0.0005) [2023-12-26 13:31:27,016][123091] Updated weights for policy 0, policy_version 1744463 (0.0005) [2023-12-26 13:31:27,599][123090] Updated weights for policy 1, policy_version 1732837 (0.0005) [2023-12-26 13:31:27,667][123090] Updated weights for policy 1, policy_version 1732847 (0.0006) [2023-12-26 13:31:27,726][123090] Updated weights for policy 1, policy_version 1732857 (0.0008) [2023-12-26 13:31:27,760][123091] Updated weights for policy 0, policy_version 1744473 (0.0008) [2023-12-26 13:31:27,811][123091] Updated weights for policy 0, policy_version 1744483 (0.0009) [2023-12-26 13:31:27,859][123091] Updated weights for policy 0, policy_version 1744493 (0.0009) [2023-12-26 13:31:28,496][123090] Updated weights for policy 1, policy_version 1732867 (0.0009) [2023-12-26 13:31:28,555][123090] Updated weights for policy 1, policy_version 1732877 (0.0010) [2023-12-26 13:31:28,610][123090] Updated weights for policy 1, policy_version 1732887 (0.0010) [2023-12-26 13:31:28,618][123091] Updated weights for policy 0, policy_version 1744503 (0.0010) [2023-12-26 13:31:28,688][123091] Updated weights for policy 0, policy_version 1744513 (0.0011) [2023-12-26 13:31:28,755][123091] Updated weights for policy 0, policy_version 1744523 (0.0010) [2023-12-26 13:31:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 890216448. Throughput: 0: 9099.6, 1: 8737.6. Samples: 890211536. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:28,785][121949] Avg episode reward: [(0, '6022.109'), (1, '5592.833')] [2023-12-26 13:31:29,384][123090] Updated weights for policy 1, policy_version 1732897 (0.0007) [2023-12-26 13:31:29,451][123090] Updated weights for policy 1, policy_version 1732907 (0.0010) [2023-12-26 13:31:29,513][123090] Updated weights for policy 1, policy_version 1732917 (0.0010) [2023-12-26 13:31:29,578][123090] Updated weights for policy 1, policy_version 1732927 (0.0010) [2023-12-26 13:31:29,582][123091] Updated weights for policy 0, policy_version 1744533 (0.0010) [2023-12-26 13:31:29,637][123091] Updated weights for policy 0, policy_version 1744543 (0.0009) [2023-12-26 13:31:29,690][123091] Updated weights for policy 0, policy_version 1744553 (0.0009) [2023-12-26 13:31:30,452][123090] Updated weights for policy 1, policy_version 1732937 (0.0007) [2023-12-26 13:31:30,486][123091] Updated weights for policy 0, policy_version 1744563 (0.0009) [2023-12-26 13:31:30,515][123090] Updated weights for policy 1, policy_version 1732947 (0.0006) [2023-12-26 13:31:30,550][123091] Updated weights for policy 0, policy_version 1744573 (0.0009) [2023-12-26 13:31:30,581][123090] Updated weights for policy 1, policy_version 1732957 (0.0005) [2023-12-26 13:31:30,617][123091] Updated weights for policy 0, policy_version 1744584 (0.0010) [2023-12-26 13:31:31,292][123090] Updated weights for policy 1, policy_version 1732967 (0.0009) [2023-12-26 13:31:31,362][123090] Updated weights for policy 1, policy_version 1732977 (0.0010) [2023-12-26 13:31:31,427][123090] Updated weights for policy 1, policy_version 1732987 (0.0012) [2023-12-26 13:31:31,435][123091] Updated weights for policy 0, policy_version 1744594 (0.0009) [2023-12-26 13:31:31,494][123091] Updated weights for policy 0, policy_version 1744604 (0.0009) [2023-12-26 13:31:31,544][123091] Updated weights for policy 0, policy_version 1744614 (0.0010) [2023-12-26 13:31:31,595][123091] Updated weights for policy 0, policy_version 1744624 (0.0010) [2023-12-26 13:31:32,210][123090] Updated weights for policy 1, policy_version 1732997 (0.0007) [2023-12-26 13:31:32,280][123090] Updated weights for policy 1, policy_version 1733007 (0.0007) [2023-12-26 13:31:32,335][123090] Updated weights for policy 1, policy_version 1733017 (0.0005) [2023-12-26 13:31:32,394][123091] Updated weights for policy 0, policy_version 1744634 (0.0008) [2023-12-26 13:31:32,469][123091] Updated weights for policy 0, policy_version 1744644 (0.0009) [2023-12-26 13:31:32,538][123091] Updated weights for policy 0, policy_version 1744654 (0.0008) [2023-12-26 13:31:33,128][123091] Updated weights for policy 0, policy_version 1744664 (0.0006) [2023-12-26 13:31:33,187][123090] Updated weights for policy 1, policy_version 1733028 (0.0011) [2023-12-26 13:31:33,192][123091] Updated weights for policy 0, policy_version 1744674 (0.0005) [2023-12-26 13:31:33,250][123090] Updated weights for policy 1, policy_version 1733038 (0.0008) [2023-12-26 13:31:33,252][123091] Updated weights for policy 0, policy_version 1744684 (0.0005) [2023-12-26 13:31:33,308][123090] Updated weights for policy 1, policy_version 1733048 (0.0009) [2023-12-26 13:31:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 890306560. Throughput: 0: 9140.8, 1: 8735.6. Samples: 890318720. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:33,785][121949] Avg episode reward: [(0, '6050.837'), (1, '5523.428')] [2023-12-26 13:31:34,017][123091] Updated weights for policy 0, policy_version 1744694 (0.0008) [2023-12-26 13:31:34,072][123091] Updated weights for policy 0, policy_version 1744704 (0.0007) [2023-12-26 13:31:34,125][123091] Updated weights for policy 0, policy_version 1744714 (0.0005) [2023-12-26 13:31:34,145][123090] Updated weights for policy 1, policy_version 1733058 (0.0009) [2023-12-26 13:31:34,211][123090] Updated weights for policy 1, policy_version 1733068 (0.0007) [2023-12-26 13:31:34,280][123090] Updated weights for policy 1, policy_version 1733078 (0.0005) [2023-12-26 13:31:34,354][123090] Updated weights for policy 1, policy_version 1733088 (0.0007) [2023-12-26 13:31:34,983][123091] Updated weights for policy 0, policy_version 1744724 (0.0010) [2023-12-26 13:31:35,047][123091] Updated weights for policy 0, policy_version 1744734 (0.0011) [2023-12-26 13:31:35,064][123090] Updated weights for policy 1, policy_version 1733098 (0.0005) [2023-12-26 13:31:35,103][123091] Updated weights for policy 0, policy_version 1744744 (0.0010) [2023-12-26 13:31:35,121][123090] Updated weights for policy 1, policy_version 1733108 (0.0005) [2023-12-26 13:31:35,172][123090] Updated weights for policy 1, policy_version 1733118 (0.0005) [2023-12-26 13:31:35,830][123091] Updated weights for policy 0, policy_version 1744754 (0.0009) [2023-12-26 13:31:35,857][123090] Updated weights for policy 1, policy_version 1733128 (0.0008) [2023-12-26 13:31:35,898][123091] Updated weights for policy 0, policy_version 1744764 (0.0005) [2023-12-26 13:31:35,909][123090] Updated weights for policy 1, policy_version 1733138 (0.0006) [2023-12-26 13:31:35,961][123091] Updated weights for policy 0, policy_version 1744774 (0.0005) [2023-12-26 13:31:35,984][123090] Updated weights for policy 1, policy_version 1733148 (0.0005) [2023-12-26 13:31:36,023][123091] Updated weights for policy 0, policy_version 1744784 (0.0009) [2023-12-26 13:31:36,677][123090] Updated weights for policy 1, policy_version 1733158 (0.0007) [2023-12-26 13:31:36,738][123090] Updated weights for policy 1, policy_version 1733168 (0.0009) [2023-12-26 13:31:36,806][123090] Updated weights for policy 1, policy_version 1733178 (0.0010) [2023-12-26 13:31:36,817][123091] Updated weights for policy 0, policy_version 1744794 (0.0011) [2023-12-26 13:31:36,876][123091] Updated weights for policy 0, policy_version 1744804 (0.0011) [2023-12-26 13:31:36,932][123091] Updated weights for policy 0, policy_version 1744814 (0.0010) [2023-12-26 13:31:37,619][123090] Updated weights for policy 1, policy_version 1733188 (0.0010) [2023-12-26 13:31:37,676][123090] Updated weights for policy 1, policy_version 1733198 (0.0011) [2023-12-26 13:31:37,734][123090] Updated weights for policy 1, policy_version 1733208 (0.0006) [2023-12-26 13:31:37,759][123091] Updated weights for policy 0, policy_version 1744824 (0.0011) [2023-12-26 13:31:37,815][123091] Updated weights for policy 0, policy_version 1744834 (0.0011) [2023-12-26 13:31:37,878][123091] Updated weights for policy 0, policy_version 1744844 (0.0010) [2023-12-26 13:31:38,556][123090] Updated weights for policy 1, policy_version 1733218 (0.0008) [2023-12-26 13:31:38,620][123090] Updated weights for policy 1, policy_version 1733228 (0.0011) [2023-12-26 13:31:38,685][123090] Updated weights for policy 1, policy_version 1733238 (0.0011) [2023-12-26 13:31:38,711][123091] Updated weights for policy 0, policy_version 1744854 (0.0011) [2023-12-26 13:31:38,738][123090] Updated weights for policy 1, policy_version 1733248 (0.0011) [2023-12-26 13:31:38,775][123091] Updated weights for policy 0, policy_version 1744864 (0.0011) [2023-12-26 13:31:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 890396672. Throughput: 0: 9176.0, 1: 8830.0. Samples: 890374476. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:38,785][121949] Avg episode reward: [(0, '6038.921'), (1, '5444.597')] [2023-12-26 13:31:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001733248_443711488.pth... [2023-12-26 13:31:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001732192_443441152.pth [2023-12-26 13:31:38,840][123091] Updated weights for policy 0, policy_version 1744874 (0.0011) [2023-12-26 13:31:38,870][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001744880_446693376.pth... [2023-12-26 13:31:38,874][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001743792_446414848.pth [2023-12-26 13:31:39,571][123091] Updated weights for policy 0, policy_version 1744884 (0.0010) [2023-12-26 13:31:39,599][123090] Updated weights for policy 1, policy_version 1733258 (0.0011) [2023-12-26 13:31:39,636][123091] Updated weights for policy 0, policy_version 1744894 (0.0009) [2023-12-26 13:31:39,662][123090] Updated weights for policy 1, policy_version 1733268 (0.0011) [2023-12-26 13:31:39,694][123091] Updated weights for policy 0, policy_version 1744904 (0.0009) [2023-12-26 13:31:39,730][123090] Updated weights for policy 1, policy_version 1733278 (0.0011) [2023-12-26 13:31:40,476][123091] Updated weights for policy 0, policy_version 1744914 (0.0009) [2023-12-26 13:31:40,547][123091] Updated weights for policy 0, policy_version 1744924 (0.0010) [2023-12-26 13:31:40,592][123090] Updated weights for policy 1, policy_version 1733288 (0.0010) [2023-12-26 13:31:40,606][123091] Updated weights for policy 0, policy_version 1744934 (0.0010) [2023-12-26 13:31:40,653][123090] Updated weights for policy 1, policy_version 1733298 (0.0009) [2023-12-26 13:31:40,654][123091] Updated weights for policy 0, policy_version 1744944 (0.0010) [2023-12-26 13:31:40,722][123090] Updated weights for policy 1, policy_version 1733308 (0.0006) [2023-12-26 13:31:41,490][123091] Updated weights for policy 0, policy_version 1744954 (0.0009) [2023-12-26 13:31:41,522][123090] Updated weights for policy 1, policy_version 1733318 (0.0008) [2023-12-26 13:31:41,543][123091] Updated weights for policy 0, policy_version 1744964 (0.0009) [2023-12-26 13:31:41,572][123090] Updated weights for policy 1, policy_version 1733328 (0.0007) [2023-12-26 13:31:41,606][123091] Updated weights for policy 0, policy_version 1744974 (0.0009) [2023-12-26 13:31:41,630][123090] Updated weights for policy 1, policy_version 1733338 (0.0009) [2023-12-26 13:31:42,406][123090] Updated weights for policy 1, policy_version 1733348 (0.0010) [2023-12-26 13:31:42,479][123090] Updated weights for policy 1, policy_version 1733358 (0.0009) [2023-12-26 13:31:42,538][123091] Updated weights for policy 0, policy_version 1744984 (0.0007) [2023-12-26 13:31:42,548][123090] Updated weights for policy 1, policy_version 1733368 (0.0007) [2023-12-26 13:31:42,596][123091] Updated weights for policy 0, policy_version 1744994 (0.0006) [2023-12-26 13:31:42,662][123091] Updated weights for policy 0, policy_version 1745004 (0.0007) [2023-12-26 13:31:43,370][123090] Updated weights for policy 1, policy_version 1733378 (0.0006) [2023-12-26 13:31:43,432][123090] Updated weights for policy 1, policy_version 1733388 (0.0010) [2023-12-26 13:31:43,459][123091] Updated weights for policy 0, policy_version 1745014 (0.0009) [2023-12-26 13:31:43,479][123090] Updated weights for policy 1, policy_version 1733398 (0.0009) [2023-12-26 13:31:43,521][123091] Updated weights for policy 0, policy_version 1745024 (0.0007) [2023-12-26 13:31:43,528][123090] Updated weights for policy 1, policy_version 1733408 (0.0009) [2023-12-26 13:31:43,582][123091] Updated weights for policy 0, policy_version 1745034 (0.0010) [2023-12-26 13:31:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 890486784. Throughput: 0: 9121.0, 1: 8844.0. Samples: 890477380. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:43,785][121949] Avg episode reward: [(0, '6170.328'), (1, '5447.772')] [2023-12-26 13:31:44,330][123090] Updated weights for policy 1, policy_version 1733418 (0.0009) [2023-12-26 13:31:44,395][123090] Updated weights for policy 1, policy_version 1733428 (0.0009) [2023-12-26 13:31:44,413][123091] Updated weights for policy 0, policy_version 1745045 (0.0010) [2023-12-26 13:31:44,459][123090] Updated weights for policy 1, policy_version 1733438 (0.0006) [2023-12-26 13:31:44,476][123091] Updated weights for policy 0, policy_version 1745055 (0.0009) [2023-12-26 13:31:44,537][123091] Updated weights for policy 0, policy_version 1745065 (0.0009) [2023-12-26 13:31:45,295][123090] Updated weights for policy 1, policy_version 1733448 (0.0009) [2023-12-26 13:31:45,356][123091] Updated weights for policy 0, policy_version 1745075 (0.0009) [2023-12-26 13:31:45,359][123090] Updated weights for policy 1, policy_version 1733458 (0.0010) [2023-12-26 13:31:45,421][123091] Updated weights for policy 0, policy_version 1745085 (0.0008) [2023-12-26 13:31:45,428][123090] Updated weights for policy 1, policy_version 1733468 (0.0008) [2023-12-26 13:31:45,483][123091] Updated weights for policy 0, policy_version 1745095 (0.0009) [2023-12-26 13:31:46,119][123090] Updated weights for policy 1, policy_version 1733478 (0.0009) [2023-12-26 13:31:46,168][123090] Updated weights for policy 1, policy_version 1733488 (0.0009) [2023-12-26 13:31:46,217][123090] Updated weights for policy 1, policy_version 1733498 (0.0009) [2023-12-26 13:31:46,264][123091] Updated weights for policy 0, policy_version 1745105 (0.0009) [2023-12-26 13:31:46,317][123091] Updated weights for policy 0, policy_version 1745115 (0.0005) [2023-12-26 13:31:46,393][123091] Updated weights for policy 0, policy_version 1745125 (0.0005) [2023-12-26 13:31:46,453][123091] Updated weights for policy 0, policy_version 1745135 (0.0005) [2023-12-26 13:31:47,049][123090] Updated weights for policy 1, policy_version 1733509 (0.0008) [2023-12-26 13:31:47,099][123090] Updated weights for policy 1, policy_version 1733519 (0.0005) [2023-12-26 13:31:47,107][123091] Updated weights for policy 0, policy_version 1745145 (0.0006) [2023-12-26 13:31:47,146][123090] Updated weights for policy 1, policy_version 1733529 (0.0005) [2023-12-26 13:31:47,176][123091] Updated weights for policy 0, policy_version 1745155 (0.0005) [2023-12-26 13:31:47,232][123091] Updated weights for policy 0, policy_version 1745166 (0.0010) [2023-12-26 13:31:47,902][123090] Updated weights for policy 1, policy_version 1733539 (0.0006) [2023-12-26 13:31:47,954][123090] Updated weights for policy 1, policy_version 1733549 (0.0006) [2023-12-26 13:31:47,992][123091] Updated weights for policy 0, policy_version 1745176 (0.0009) [2023-12-26 13:31:48,005][123090] Updated weights for policy 1, policy_version 1733559 (0.0008) [2023-12-26 13:31:48,056][123091] Updated weights for policy 0, policy_version 1745186 (0.0009) [2023-12-26 13:31:48,126][123091] Updated weights for policy 0, policy_version 1745196 (0.0010) [2023-12-26 13:31:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 890568704. Throughput: 0: 9135.4, 1: 8887.8. Samples: 890584972. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:48,785][121949] Avg episode reward: [(0, '6290.332'), (1, '5594.354')] [2023-12-26 13:31:48,793][123090] Updated weights for policy 1, policy_version 1733569 (0.0006) [2023-12-26 13:31:48,854][123090] Updated weights for policy 1, policy_version 1733579 (0.0009) [2023-12-26 13:31:48,919][123090] Updated weights for policy 1, policy_version 1733589 (0.0009) [2023-12-26 13:31:48,947][123091] Updated weights for policy 0, policy_version 1745206 (0.0008) [2023-12-26 13:31:48,987][123090] Updated weights for policy 1, policy_version 1733599 (0.0008) [2023-12-26 13:31:48,997][123091] Updated weights for policy 0, policy_version 1745216 (0.0010) [2023-12-26 13:31:49,063][123091] Updated weights for policy 0, policy_version 1745226 (0.0010) [2023-12-26 13:31:49,730][123090] Updated weights for policy 1, policy_version 1733609 (0.0006) [2023-12-26 13:31:49,790][123090] Updated weights for policy 1, policy_version 1733619 (0.0006) [2023-12-26 13:31:49,864][123090] Updated weights for policy 1, policy_version 1733629 (0.0008) [2023-12-26 13:31:49,927][123091] Updated weights for policy 0, policy_version 1745236 (0.0010) [2023-12-26 13:31:49,994][123091] Updated weights for policy 0, policy_version 1745246 (0.0010) [2023-12-26 13:31:50,059][123091] Updated weights for policy 0, policy_version 1745256 (0.0010) [2023-12-26 13:31:50,540][123090] Updated weights for policy 1, policy_version 1733639 (0.0007) [2023-12-26 13:31:50,614][123090] Updated weights for policy 1, policy_version 1733649 (0.0009) [2023-12-26 13:31:50,680][123090] Updated weights for policy 1, policy_version 1733659 (0.0010) [2023-12-26 13:31:50,824][123091] Updated weights for policy 0, policy_version 1745266 (0.0009) [2023-12-26 13:31:50,885][123091] Updated weights for policy 0, policy_version 1745277 (0.0006) [2023-12-26 13:31:50,952][123091] Updated weights for policy 0, policy_version 1745287 (0.0006) [2023-12-26 13:31:51,506][123090] Updated weights for policy 1, policy_version 1733669 (0.0009) [2023-12-26 13:31:51,569][123090] Updated weights for policy 1, policy_version 1733679 (0.0009) [2023-12-26 13:31:51,645][123090] Updated weights for policy 1, policy_version 1733689 (0.0009) [2023-12-26 13:31:51,757][123091] Updated weights for policy 0, policy_version 1745297 (0.0007) [2023-12-26 13:31:51,816][123091] Updated weights for policy 0, policy_version 1745307 (0.0009) [2023-12-26 13:31:51,882][123091] Updated weights for policy 0, policy_version 1745317 (0.0009) [2023-12-26 13:31:51,953][123091] Updated weights for policy 0, policy_version 1745327 (0.0009) [2023-12-26 13:31:52,437][123090] Updated weights for policy 1, policy_version 1733699 (0.0009) [2023-12-26 13:31:52,507][123090] Updated weights for policy 1, policy_version 1733709 (0.0010) [2023-12-26 13:31:52,572][123090] Updated weights for policy 1, policy_version 1733719 (0.0009) [2023-12-26 13:31:52,716][123091] Updated weights for policy 0, policy_version 1745337 (0.0009) [2023-12-26 13:31:52,765][123091] Updated weights for policy 0, policy_version 1745347 (0.0009) [2023-12-26 13:31:52,817][123091] Updated weights for policy 0, policy_version 1745357 (0.0009) [2023-12-26 13:31:53,427][123090] Updated weights for policy 1, policy_version 1733729 (0.0011) [2023-12-26 13:31:53,490][123090] Updated weights for policy 1, policy_version 1733739 (0.0011) [2023-12-26 13:31:53,557][123090] Updated weights for policy 1, policy_version 1733749 (0.0010) [2023-12-26 13:31:53,612][123090] Updated weights for policy 1, policy_version 1733759 (0.0010) [2023-12-26 13:31:53,677][123091] Updated weights for policy 0, policy_version 1745367 (0.0009) [2023-12-26 13:31:53,724][123091] Updated weights for policy 0, policy_version 1745377 (0.0009) [2023-12-26 13:31:53,784][123091] Updated weights for policy 0, policy_version 1745387 (0.0008) [2023-12-26 13:31:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 890658816. Throughput: 0: 9089.3, 1: 8891.9. Samples: 890637968. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:53,785][121949] Avg episode reward: [(0, '6337.910'), (1, '5547.806')] [2023-12-26 13:31:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001733760_443842560.pth... [2023-12-26 13:31:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001732704_443572224.pth [2023-12-26 13:31:53,814][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001745392_446824448.pth... [2023-12-26 13:31:53,817][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001744336_446554112.pth [2023-12-26 13:31:54,299][123090] Updated weights for policy 1, policy_version 1733769 (0.0008) [2023-12-26 13:31:54,364][123090] Updated weights for policy 1, policy_version 1733779 (0.0008) [2023-12-26 13:31:54,428][123090] Updated weights for policy 1, policy_version 1733789 (0.0008) [2023-12-26 13:31:54,618][123091] Updated weights for policy 0, policy_version 1745397 (0.0009) [2023-12-26 13:31:54,667][123091] Updated weights for policy 0, policy_version 1745407 (0.0009) [2023-12-26 13:31:54,713][123091] Updated weights for policy 0, policy_version 1745417 (0.0009) [2023-12-26 13:31:55,196][123090] Updated weights for policy 1, policy_version 1733799 (0.0009) [2023-12-26 13:31:55,245][123090] Updated weights for policy 1, policy_version 1733809 (0.0008) [2023-12-26 13:31:55,308][123090] Updated weights for policy 1, policy_version 1733819 (0.0009) [2023-12-26 13:31:55,519][123091] Updated weights for policy 0, policy_version 1745427 (0.0010) [2023-12-26 13:31:55,571][123091] Updated weights for policy 0, policy_version 1745437 (0.0009) [2023-12-26 13:31:55,633][123091] Updated weights for policy 0, policy_version 1745447 (0.0010) [2023-12-26 13:31:56,096][123090] Updated weights for policy 1, policy_version 1733829 (0.0009) [2023-12-26 13:31:56,153][123090] Updated weights for policy 1, policy_version 1733839 (0.0010) [2023-12-26 13:31:56,240][123090] Updated weights for policy 1, policy_version 1733849 (0.0009) [2023-12-26 13:31:56,467][123091] Updated weights for policy 0, policy_version 1745457 (0.0009) [2023-12-26 13:31:56,520][123091] Updated weights for policy 0, policy_version 1745467 (0.0009) [2023-12-26 13:31:56,570][123091] Updated weights for policy 0, policy_version 1745478 (0.0010) [2023-12-26 13:31:56,622][123091] Updated weights for policy 0, policy_version 1745488 (0.0010) [2023-12-26 13:31:57,014][123090] Updated weights for policy 1, policy_version 1733859 (0.0009) [2023-12-26 13:31:57,060][123090] Updated weights for policy 1, policy_version 1733869 (0.0008) [2023-12-26 13:31:57,119][123090] Updated weights for policy 1, policy_version 1733879 (0.0009) [2023-12-26 13:31:57,457][123091] Updated weights for policy 0, policy_version 1745498 (0.0010) [2023-12-26 13:31:57,511][123091] Updated weights for policy 0, policy_version 1745508 (0.0010) [2023-12-26 13:31:57,577][123091] Updated weights for policy 0, policy_version 1745518 (0.0009) [2023-12-26 13:31:57,908][123090] Updated weights for policy 1, policy_version 1733889 (0.0008) [2023-12-26 13:31:57,965][123090] Updated weights for policy 1, policy_version 1733899 (0.0007) [2023-12-26 13:31:58,019][123090] Updated weights for policy 1, policy_version 1733909 (0.0009) [2023-12-26 13:31:58,075][123090] Updated weights for policy 1, policy_version 1733919 (0.0009) [2023-12-26 13:31:58,443][123091] Updated weights for policy 0, policy_version 1745528 (0.0010) [2023-12-26 13:31:58,515][123091] Updated weights for policy 0, policy_version 1745538 (0.0010) [2023-12-26 13:31:58,581][123091] Updated weights for policy 0, policy_version 1745548 (0.0009) [2023-12-26 13:31:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 890748928. Throughput: 0: 9018.3, 1: 8934.5. Samples: 890742644. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:31:58,785][121949] Avg episode reward: [(0, '6301.561'), (1, '5510.908')] [2023-12-26 13:31:58,963][123090] Updated weights for policy 1, policy_version 1733929 (0.0009) [2023-12-26 13:31:59,022][123090] Updated weights for policy 1, policy_version 1733939 (0.0010) [2023-12-26 13:31:59,087][123090] Updated weights for policy 1, policy_version 1733949 (0.0009) [2023-12-26 13:31:59,486][123091] Updated weights for policy 0, policy_version 1745558 (0.0008) [2023-12-26 13:31:59,567][123091] Updated weights for policy 0, policy_version 1745568 (0.0007) [2023-12-26 13:31:59,643][123091] Updated weights for policy 0, policy_version 1745578 (0.0009) [2023-12-26 13:31:59,868][123090] Updated weights for policy 1, policy_version 1733959 (0.0008) [2023-12-26 13:31:59,934][123090] Updated weights for policy 1, policy_version 1733969 (0.0008) [2023-12-26 13:31:59,994][123090] Updated weights for policy 1, policy_version 1733979 (0.0010) [2023-12-26 13:32:00,403][123091] Updated weights for policy 0, policy_version 1745588 (0.0009) [2023-12-26 13:32:00,458][123091] Updated weights for policy 0, policy_version 1745598 (0.0009) [2023-12-26 13:32:00,524][123091] Updated weights for policy 0, policy_version 1745608 (0.0010) [2023-12-26 13:32:00,789][123090] Updated weights for policy 1, policy_version 1733989 (0.0007) [2023-12-26 13:32:00,850][123090] Updated weights for policy 1, policy_version 1733999 (0.0005) [2023-12-26 13:32:00,913][123090] Updated weights for policy 1, policy_version 1734009 (0.0005) [2023-12-26 13:32:01,295][123091] Updated weights for policy 0, policy_version 1745618 (0.0011) [2023-12-26 13:32:01,357][123091] Updated weights for policy 0, policy_version 1745628 (0.0010) [2023-12-26 13:32:01,423][123091] Updated weights for policy 0, policy_version 1745638 (0.0009) [2023-12-26 13:32:01,479][123091] Updated weights for policy 0, policy_version 1745648 (0.0011) [2023-12-26 13:32:01,693][123090] Updated weights for policy 1, policy_version 1734019 (0.0005) [2023-12-26 13:32:01,751][123090] Updated weights for policy 1, policy_version 1734029 (0.0010) [2023-12-26 13:32:01,809][123090] Updated weights for policy 1, policy_version 1734039 (0.0010) [2023-12-26 13:32:02,238][123091] Updated weights for policy 0, policy_version 1745658 (0.0007) [2023-12-26 13:32:02,309][123091] Updated weights for policy 0, policy_version 1745668 (0.0007) [2023-12-26 13:32:02,374][123091] Updated weights for policy 0, policy_version 1745678 (0.0006) [2023-12-26 13:32:02,739][123090] Updated weights for policy 1, policy_version 1734049 (0.0010) [2023-12-26 13:32:02,792][123090] Updated weights for policy 1, policy_version 1734059 (0.0009) [2023-12-26 13:32:02,845][123090] Updated weights for policy 1, policy_version 1734069 (0.0009) [2023-12-26 13:32:02,901][123090] Updated weights for policy 1, policy_version 1734079 (0.0009) [2023-12-26 13:32:03,068][123091] Updated weights for policy 0, policy_version 1745688 (0.0006) [2023-12-26 13:32:03,146][123091] Updated weights for policy 0, policy_version 1745698 (0.0005) [2023-12-26 13:32:03,229][123091] Updated weights for policy 0, policy_version 1745708 (0.0007) [2023-12-26 13:32:03,616][123090] Updated weights for policy 1, policy_version 1734089 (0.0006) [2023-12-26 13:32:03,668][123090] Updated weights for policy 1, policy_version 1734099 (0.0005) [2023-12-26 13:32:03,715][123090] Updated weights for policy 1, policy_version 1734109 (0.0005) [2023-12-26 13:32:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 890839040. Throughput: 0: 8931.7, 1: 8879.2. Samples: 890848924. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:32:03,785][121949] Avg episode reward: [(0, '6128.806'), (1, '5680.485')] [2023-12-26 13:32:03,858][123091] Updated weights for policy 0, policy_version 1745718 (0.0009) [2023-12-26 13:32:03,911][123091] Updated weights for policy 0, policy_version 1745728 (0.0012) [2023-12-26 13:32:03,980][123091] Updated weights for policy 0, policy_version 1745738 (0.0007) [2023-12-26 13:32:04,413][123090] Updated weights for policy 1, policy_version 1734119 (0.0005) [2023-12-26 13:32:04,469][123090] Updated weights for policy 1, policy_version 1734129 (0.0009) [2023-12-26 13:32:04,522][123090] Updated weights for policy 1, policy_version 1734139 (0.0009) [2023-12-26 13:32:04,719][123091] Updated weights for policy 0, policy_version 1745748 (0.0005) [2023-12-26 13:32:04,770][123091] Updated weights for policy 0, policy_version 1745758 (0.0005) [2023-12-26 13:32:04,822][123091] Updated weights for policy 0, policy_version 1745768 (0.0005) [2023-12-26 13:32:05,327][123090] Updated weights for policy 1, policy_version 1734149 (0.0009) [2023-12-26 13:32:05,399][123090] Updated weights for policy 1, policy_version 1734159 (0.0010) [2023-12-26 13:32:05,460][123091] Updated weights for policy 0, policy_version 1745778 (0.0005) [2023-12-26 13:32:05,469][123090] Updated weights for policy 1, policy_version 1734169 (0.0010) [2023-12-26 13:32:05,517][123091] Updated weights for policy 0, policy_version 1745788 (0.0008) [2023-12-26 13:32:05,567][123091] Updated weights for policy 0, policy_version 1745798 (0.0010) [2023-12-26 13:32:05,622][123091] Updated weights for policy 0, policy_version 1745808 (0.0010) [2023-12-26 13:32:06,304][123090] Updated weights for policy 1, policy_version 1734179 (0.0009) [2023-12-26 13:32:06,369][123090] Updated weights for policy 1, policy_version 1734189 (0.0011) [2023-12-26 13:32:06,424][123091] Updated weights for policy 0, policy_version 1745818 (0.0005) [2023-12-26 13:32:06,436][123090] Updated weights for policy 1, policy_version 1734199 (0.0011) [2023-12-26 13:32:06,488][123091] Updated weights for policy 0, policy_version 1745828 (0.0005) [2023-12-26 13:32:06,560][123091] Updated weights for policy 0, policy_version 1745838 (0.0006) [2023-12-26 13:32:07,258][123091] Updated weights for policy 0, policy_version 1745848 (0.0009) [2023-12-26 13:32:07,268][123090] Updated weights for policy 1, policy_version 1734209 (0.0010) [2023-12-26 13:32:07,314][123091] Updated weights for policy 0, policy_version 1745858 (0.0008) [2023-12-26 13:32:07,330][123090] Updated weights for policy 1, policy_version 1734219 (0.0006) [2023-12-26 13:32:07,378][123091] Updated weights for policy 0, policy_version 1745868 (0.0008) [2023-12-26 13:32:07,395][123090] Updated weights for policy 1, policy_version 1734229 (0.0008) [2023-12-26 13:32:07,451][123090] Updated weights for policy 1, policy_version 1734239 (0.0009) [2023-12-26 13:32:08,212][123091] Updated weights for policy 0, policy_version 1745878 (0.0007) [2023-12-26 13:32:08,222][123090] Updated weights for policy 1, policy_version 1734249 (0.0009) [2023-12-26 13:32:08,260][123091] Updated weights for policy 0, policy_version 1745888 (0.0007) [2023-12-26 13:32:08,279][123090] Updated weights for policy 1, policy_version 1734259 (0.0009) [2023-12-26 13:32:08,313][123091] Updated weights for policy 0, policy_version 1745898 (0.0008) [2023-12-26 13:32:08,343][123090] Updated weights for policy 1, policy_version 1734269 (0.0007) [2023-12-26 13:32:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 890929152. Throughput: 0: 9005.8, 1: 8940.9. Samples: 890905392. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:32:08,785][121949] Avg episode reward: [(0, '6057.334'), (1, '5609.110')] [2023-12-26 13:32:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001734272_443973632.pth... [2023-12-26 13:32:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001745904_446955520.pth... [2023-12-26 13:32:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001733248_443711488.pth [2023-12-26 13:32:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001744880_446693376.pth [2023-12-26 13:32:09,121][123090] Updated weights for policy 1, policy_version 1734279 (0.0008) [2023-12-26 13:32:09,191][123090] Updated weights for policy 1, policy_version 1734289 (0.0009) [2023-12-26 13:32:09,212][123091] Updated weights for policy 0, policy_version 1745908 (0.0009) [2023-12-26 13:32:09,258][123090] Updated weights for policy 1, policy_version 1734299 (0.0008) [2023-12-26 13:32:09,277][123091] Updated weights for policy 0, policy_version 1745918 (0.0008) [2023-12-26 13:32:09,346][123091] Updated weights for policy 0, policy_version 1745928 (0.0009) [2023-12-26 13:32:10,106][123091] Updated weights for policy 0, policy_version 1745938 (0.0009) [2023-12-26 13:32:10,115][123090] Updated weights for policy 1, policy_version 1734309 (0.0008) [2023-12-26 13:32:10,162][123091] Updated weights for policy 0, policy_version 1745948 (0.0007) [2023-12-26 13:32:10,181][123090] Updated weights for policy 1, policy_version 1734319 (0.0008) [2023-12-26 13:32:10,222][123091] Updated weights for policy 0, policy_version 1745958 (0.0008) [2023-12-26 13:32:10,253][123090] Updated weights for policy 1, policy_version 1734329 (0.0007) [2023-12-26 13:32:10,277][123091] Updated weights for policy 0, policy_version 1745968 (0.0006) [2023-12-26 13:32:10,938][123090] Updated weights for policy 1, policy_version 1734339 (0.0008) [2023-12-26 13:32:11,015][123090] Updated weights for policy 1, policy_version 1734349 (0.0005) [2023-12-26 13:32:11,079][123090] Updated weights for policy 1, policy_version 1734359 (0.0008) [2023-12-26 13:32:11,105][123091] Updated weights for policy 0, policy_version 1745978 (0.0008) [2023-12-26 13:32:11,183][123091] Updated weights for policy 0, policy_version 1745988 (0.0009) [2023-12-26 13:32:11,249][123091] Updated weights for policy 0, policy_version 1745998 (0.0011) [2023-12-26 13:32:11,885][123090] Updated weights for policy 1, policy_version 1734369 (0.0008) [2023-12-26 13:32:11,950][123090] Updated weights for policy 1, policy_version 1734379 (0.0006) [2023-12-26 13:32:12,028][123090] Updated weights for policy 1, policy_version 1734389 (0.0009) [2023-12-26 13:32:12,088][123090] Updated weights for policy 1, policy_version 1734399 (0.0011) [2023-12-26 13:32:12,135][123091] Updated weights for policy 0, policy_version 1746008 (0.0009) [2023-12-26 13:32:12,195][123091] Updated weights for policy 0, policy_version 1746018 (0.0009) [2023-12-26 13:32:12,256][123091] Updated weights for policy 0, policy_version 1746028 (0.0009) [2023-12-26 13:32:12,900][123090] Updated weights for policy 1, policy_version 1734409 (0.0011) [2023-12-26 13:32:12,960][123090] Updated weights for policy 1, policy_version 1734419 (0.0011) [2023-12-26 13:32:13,027][123090] Updated weights for policy 1, policy_version 1734429 (0.0011) [2023-12-26 13:32:13,126][123091] Updated weights for policy 0, policy_version 1746038 (0.0009) [2023-12-26 13:32:13,184][123091] Updated weights for policy 0, policy_version 1746048 (0.0009) [2023-12-26 13:32:13,248][123091] Updated weights for policy 0, policy_version 1746058 (0.0009) [2023-12-26 13:32:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 891011072. Throughput: 0: 8838.9, 1: 8875.0. Samples: 891008660. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:32:13,785][121949] Avg episode reward: [(0, '6052.696'), (1, '5623.254')] [2023-12-26 13:32:13,844][123090] Updated weights for policy 1, policy_version 1734439 (0.0010) [2023-12-26 13:32:13,910][123090] Updated weights for policy 1, policy_version 1734449 (0.0010) [2023-12-26 13:32:13,976][123090] Updated weights for policy 1, policy_version 1734459 (0.0010) [2023-12-26 13:32:14,082][123091] Updated weights for policy 0, policy_version 1746068 (0.0009) [2023-12-26 13:32:14,135][123091] Updated weights for policy 0, policy_version 1746078 (0.0009) [2023-12-26 13:32:14,187][123091] Updated weights for policy 0, policy_version 1746088 (0.0009) [2023-12-26 13:32:14,784][123090] Updated weights for policy 1, policy_version 1734469 (0.0011) [2023-12-26 13:32:14,844][123090] Updated weights for policy 1, policy_version 1734479 (0.0011) [2023-12-26 13:32:14,900][123090] Updated weights for policy 1, policy_version 1734489 (0.0011) [2023-12-26 13:32:15,007][123091] Updated weights for policy 0, policy_version 1746098 (0.0009) [2023-12-26 13:32:15,076][123091] Updated weights for policy 0, policy_version 1746108 (0.0011) [2023-12-26 13:32:15,140][123091] Updated weights for policy 0, policy_version 1746118 (0.0011) [2023-12-26 13:32:15,193][123091] Updated weights for policy 0, policy_version 1746128 (0.0011) [2023-12-26 13:32:15,732][123090] Updated weights for policy 1, policy_version 1734499 (0.0011) [2023-12-26 13:32:15,787][123090] Updated weights for policy 1, policy_version 1734509 (0.0010) [2023-12-26 13:32:15,838][123090] Updated weights for policy 1, policy_version 1734519 (0.0010) [2023-12-26 13:32:16,013][123091] Updated weights for policy 0, policy_version 1746138 (0.0009) [2023-12-26 13:32:16,069][123091] Updated weights for policy 0, policy_version 1746148 (0.0009) [2023-12-26 13:32:16,126][123091] Updated weights for policy 0, policy_version 1746158 (0.0006) [2023-12-26 13:32:16,671][123090] Updated weights for policy 1, policy_version 1734529 (0.0010) [2023-12-26 13:32:16,730][123090] Updated weights for policy 1, policy_version 1734539 (0.0010) [2023-12-26 13:32:16,777][123090] Updated weights for policy 1, policy_version 1734549 (0.0010) [2023-12-26 13:32:16,829][123090] Updated weights for policy 1, policy_version 1734559 (0.0010) [2023-12-26 13:32:16,855][123091] Updated weights for policy 0, policy_version 1746168 (0.0007) [2023-12-26 13:32:16,908][123091] Updated weights for policy 0, policy_version 1746178 (0.0009) [2023-12-26 13:32:16,965][123091] Updated weights for policy 0, policy_version 1746188 (0.0009) [2023-12-26 13:32:17,659][123090] Updated weights for policy 1, policy_version 1734569 (0.0010) [2023-12-26 13:32:17,715][123090] Updated weights for policy 1, policy_version 1734579 (0.0010) [2023-12-26 13:32:17,777][123090] Updated weights for policy 1, policy_version 1734589 (0.0010) [2023-12-26 13:32:17,808][123091] Updated weights for policy 0, policy_version 1746198 (0.0010) [2023-12-26 13:32:17,867][123091] Updated weights for policy 0, policy_version 1746208 (0.0010) [2023-12-26 13:32:17,925][123091] Updated weights for policy 0, policy_version 1746218 (0.0010) [2023-12-26 13:32:18,616][123090] Updated weights for policy 1, policy_version 1734599 (0.0011) [2023-12-26 13:32:18,651][123091] Updated weights for policy 0, policy_version 1746228 (0.0009) [2023-12-26 13:32:18,677][123090] Updated weights for policy 1, policy_version 1734609 (0.0010) [2023-12-26 13:32:18,697][123091] Updated weights for policy 0, policy_version 1746238 (0.0005) [2023-12-26 13:32:18,733][123090] Updated weights for policy 1, policy_version 1734619 (0.0010) [2023-12-26 13:32:18,745][123091] Updated weights for policy 0, policy_version 1746248 (0.0006) [2023-12-26 13:32:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 891109376. Throughput: 0: 8804.1, 1: 8842.3. Samples: 891112804. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:32:18,784][121949] Avg episode reward: [(0, '6131.913'), (1, '5540.528')] [2023-12-26 13:32:19,459][123091] Updated weights for policy 0, policy_version 1746258 (0.0006) [2023-12-26 13:32:19,527][123091] Updated weights for policy 0, policy_version 1746268 (0.0008) [2023-12-26 13:32:19,586][123090] Updated weights for policy 1, policy_version 1734629 (0.0010) [2023-12-26 13:32:19,593][123091] Updated weights for policy 0, policy_version 1746278 (0.0008) [2023-12-26 13:32:19,645][123091] Updated weights for policy 0, policy_version 1746288 (0.0008) [2023-12-26 13:32:19,646][123090] Updated weights for policy 1, policy_version 1734639 (0.0010) [2023-12-26 13:32:19,705][123090] Updated weights for policy 1, policy_version 1734649 (0.0010) [2023-12-26 13:32:20,422][123091] Updated weights for policy 0, policy_version 1746298 (0.0009) [2023-12-26 13:32:20,487][123091] Updated weights for policy 0, policy_version 1746308 (0.0009) [2023-12-26 13:32:20,540][123091] Updated weights for policy 0, policy_version 1746318 (0.0009) [2023-12-26 13:32:20,543][123090] Updated weights for policy 1, policy_version 1734659 (0.0010) [2023-12-26 13:32:20,614][123090] Updated weights for policy 1, policy_version 1734669 (0.0011) [2023-12-26 13:32:20,686][123090] Updated weights for policy 1, policy_version 1734679 (0.0011) [2023-12-26 13:32:21,397][123091] Updated weights for policy 0, policy_version 1746328 (0.0008) [2023-12-26 13:32:21,466][123091] Updated weights for policy 0, policy_version 1746338 (0.0009) [2023-12-26 13:32:21,526][123090] Updated weights for policy 1, policy_version 1734689 (0.0010) [2023-12-26 13:32:21,531][123091] Updated weights for policy 0, policy_version 1746348 (0.0006) [2023-12-26 13:32:21,595][123090] Updated weights for policy 1, policy_version 1734699 (0.0011) [2023-12-26 13:32:21,668][123090] Updated weights for policy 1, policy_version 1734709 (0.0008) [2023-12-26 13:32:21,738][123090] Updated weights for policy 1, policy_version 1734719 (0.0008) [2023-12-26 13:32:22,405][123091] Updated weights for policy 0, policy_version 1746358 (0.0009) [2023-12-26 13:32:22,471][123091] Updated weights for policy 0, policy_version 1746368 (0.0009) [2023-12-26 13:32:22,531][123091] Updated weights for policy 0, policy_version 1746378 (0.0006) [2023-12-26 13:32:22,584][123090] Updated weights for policy 1, policy_version 1734729 (0.0009) [2023-12-26 13:32:22,648][123090] Updated weights for policy 1, policy_version 1734739 (0.0011) [2023-12-26 13:32:22,711][123090] Updated weights for policy 1, policy_version 1734749 (0.0010) [2023-12-26 13:32:23,259][123091] Updated weights for policy 0, policy_version 1746388 (0.0008) [2023-12-26 13:32:23,314][123091] Updated weights for policy 0, policy_version 1746398 (0.0011) [2023-12-26 13:32:23,362][123091] Updated weights for policy 0, policy_version 1746408 (0.0010) [2023-12-26 13:32:23,471][123090] Updated weights for policy 1, policy_version 1734759 (0.0010) [2023-12-26 13:32:23,535][123090] Updated weights for policy 1, policy_version 1734769 (0.0007) [2023-12-26 13:32:23,609][123090] Updated weights for policy 1, policy_version 1734779 (0.0005) [2023-12-26 13:32:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 891191296. Throughput: 0: 8804.8, 1: 8755.1. Samples: 891164672. Policy #0 lag: (min: 10.0, avg: 29.4, max: 42.0) [2023-12-26 13:32:23,785][121949] Avg episode reward: [(0, '6153.065'), (1, '5778.505')] [2023-12-26 13:32:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001746416_447086592.pth... [2023-12-26 13:32:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001734784_444104704.pth... [2023-12-26 13:32:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001745392_446824448.pth [2023-12-26 13:32:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001733760_443842560.pth [2023-12-26 13:32:24,189][123091] Updated weights for policy 0, policy_version 1746418 (0.0010) [2023-12-26 13:32:24,277][123091] Updated weights for policy 0, policy_version 1746428 (0.0011) [2023-12-26 13:32:24,325][123090] Updated weights for policy 1, policy_version 1734789 (0.0008) [2023-12-26 13:32:24,337][123091] Updated weights for policy 0, policy_version 1746438 (0.0011) [2023-12-26 13:32:24,389][123090] Updated weights for policy 1, policy_version 1734799 (0.0011) [2023-12-26 13:32:24,394][123091] Updated weights for policy 0, policy_version 1746448 (0.0011) [2023-12-26 13:32:24,453][123090] Updated weights for policy 1, policy_version 1734809 (0.0010) [2023-12-26 13:32:25,140][123091] Updated weights for policy 0, policy_version 1746458 (0.0005) [2023-12-26 13:32:25,189][123091] Updated weights for policy 0, policy_version 1746468 (0.0006) [2023-12-26 13:32:25,244][123091] Updated weights for policy 0, policy_version 1746478 (0.0006) [2023-12-26 13:32:25,265][123090] Updated weights for policy 1, policy_version 1734819 (0.0011) [2023-12-26 13:32:25,317][123090] Updated weights for policy 1, policy_version 1734829 (0.0010) [2023-12-26 13:32:25,369][123090] Updated weights for policy 1, policy_version 1734839 (0.0010) [2023-12-26 13:32:25,995][123091] Updated weights for policy 0, policy_version 1746488 (0.0005) [2023-12-26 13:32:26,055][123090] Updated weights for policy 1, policy_version 1734849 (0.0009) [2023-12-26 13:32:26,072][123091] Updated weights for policy 0, policy_version 1746498 (0.0005) [2023-12-26 13:32:26,110][123090] Updated weights for policy 1, policy_version 1734859 (0.0010) [2023-12-26 13:32:26,139][123091] Updated weights for policy 0, policy_version 1746508 (0.0005) [2023-12-26 13:32:26,165][123090] Updated weights for policy 1, policy_version 1734869 (0.0010) [2023-12-26 13:32:26,216][123090] Updated weights for policy 1, policy_version 1734879 (0.0010) [2023-12-26 13:32:26,763][123091] Updated weights for policy 0, policy_version 1746518 (0.0005) [2023-12-26 13:32:26,813][123091] Updated weights for policy 0, policy_version 1746528 (0.0006) [2023-12-26 13:32:26,858][123091] Updated weights for policy 0, policy_version 1746538 (0.0005) [2023-12-26 13:32:27,038][123090] Updated weights for policy 1, policy_version 1734889 (0.0006) [2023-12-26 13:32:27,092][123090] Updated weights for policy 1, policy_version 1734899 (0.0006) [2023-12-26 13:32:27,143][123090] Updated weights for policy 1, policy_version 1734909 (0.0005) [2023-12-26 13:32:27,538][123091] Updated weights for policy 0, policy_version 1746548 (0.0005) [2023-12-26 13:32:27,583][123091] Updated weights for policy 0, policy_version 1746558 (0.0005) [2023-12-26 13:32:27,635][123091] Updated weights for policy 0, policy_version 1746568 (0.0005) [2023-12-26 13:32:27,983][123090] Updated weights for policy 1, policy_version 1734919 (0.0008) [2023-12-26 13:32:28,049][123090] Updated weights for policy 1, policy_version 1734929 (0.0010) [2023-12-26 13:32:28,119][123090] Updated weights for policy 1, policy_version 1734939 (0.0010) [2023-12-26 13:32:28,340][123091] Updated weights for policy 0, policy_version 1746578 (0.0006) [2023-12-26 13:32:28,400][123091] Updated weights for policy 0, policy_version 1746588 (0.0006) [2023-12-26 13:32:28,456][123091] Updated weights for policy 0, policy_version 1746598 (0.0005) [2023-12-26 13:32:28,513][123091] Updated weights for policy 0, policy_version 1746608 (0.0005) [2023-12-26 13:32:28,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 891281408. Throughput: 0: 8920.0, 1: 8820.6. Samples: 891275712. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:28,786][121949] Avg episode reward: [(0, '6119.768'), (1, '5887.968')] [2023-12-26 13:32:29,004][123090] Updated weights for policy 1, policy_version 1734949 (0.0009) [2023-12-26 13:32:29,052][123090] Updated weights for policy 1, policy_version 1734959 (0.0009) [2023-12-26 13:32:29,101][123090] Updated weights for policy 1, policy_version 1734970 (0.0009) [2023-12-26 13:32:29,223][123091] Updated weights for policy 0, policy_version 1746618 (0.0011) [2023-12-26 13:32:29,287][123091] Updated weights for policy 0, policy_version 1746628 (0.0008) [2023-12-26 13:32:29,356][123091] Updated weights for policy 0, policy_version 1746638 (0.0009) [2023-12-26 13:32:29,982][123090] Updated weights for policy 1, policy_version 1734980 (0.0008) [2023-12-26 13:32:30,032][123090] Updated weights for policy 1, policy_version 1734990 (0.0006) [2023-12-26 13:32:30,084][123090] Updated weights for policy 1, policy_version 1735000 (0.0009) [2023-12-26 13:32:30,121][123091] Updated weights for policy 0, policy_version 1746648 (0.0011) [2023-12-26 13:32:30,189][123091] Updated weights for policy 0, policy_version 1746658 (0.0011) [2023-12-26 13:32:30,256][123091] Updated weights for policy 0, policy_version 1746668 (0.0011) [2023-12-26 13:32:30,934][123090] Updated weights for policy 1, policy_version 1735010 (0.0007) [2023-12-26 13:32:30,989][123090] Updated weights for policy 1, policy_version 1735020 (0.0009) [2023-12-26 13:32:31,046][123090] Updated weights for policy 1, policy_version 1735030 (0.0008) [2023-12-26 13:32:31,068][123091] Updated weights for policy 0, policy_version 1746678 (0.0010) [2023-12-26 13:32:31,109][123090] Updated weights for policy 1, policy_version 1735040 (0.0008) [2023-12-26 13:32:31,137][123091] Updated weights for policy 0, policy_version 1746688 (0.0007) [2023-12-26 13:32:31,202][123091] Updated weights for policy 0, policy_version 1746698 (0.0010) [2023-12-26 13:32:31,960][123091] Updated weights for policy 0, policy_version 1746708 (0.0007) [2023-12-26 13:32:31,984][123090] Updated weights for policy 1, policy_version 1735050 (0.0007) [2023-12-26 13:32:32,019][123091] Updated weights for policy 0, policy_version 1746718 (0.0010) [2023-12-26 13:32:32,047][123090] Updated weights for policy 1, policy_version 1735060 (0.0006) [2023-12-26 13:32:32,077][123091] Updated weights for policy 0, policy_version 1746728 (0.0010) [2023-12-26 13:32:32,106][123090] Updated weights for policy 1, policy_version 1735070 (0.0008) [2023-12-26 13:32:32,900][123091] Updated weights for policy 0, policy_version 1746738 (0.0010) [2023-12-26 13:32:32,962][123091] Updated weights for policy 0, policy_version 1746748 (0.0008) [2023-12-26 13:32:32,973][123090] Updated weights for policy 1, policy_version 1735080 (0.0007) [2023-12-26 13:32:33,007][123091] Updated weights for policy 0, policy_version 1746758 (0.0008) [2023-12-26 13:32:33,032][123090] Updated weights for policy 1, policy_version 1735090 (0.0007) [2023-12-26 13:32:33,065][123091] Updated weights for policy 0, policy_version 1746768 (0.0009) [2023-12-26 13:32:33,083][123090] Updated weights for policy 1, policy_version 1735100 (0.0008) [2023-12-26 13:32:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 891363328. Throughput: 0: 8963.1, 1: 8718.8. Samples: 891380660. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:33,785][121949] Avg episode reward: [(0, '6115.301'), (1, '5837.916')] [2023-12-26 13:32:33,853][123091] Updated weights for policy 0, policy_version 1746778 (0.0010) [2023-12-26 13:32:33,914][123091] Updated weights for policy 0, policy_version 1746788 (0.0010) [2023-12-26 13:32:33,930][123090] Updated weights for policy 1, policy_version 1735110 (0.0008) [2023-12-26 13:32:33,976][123091] Updated weights for policy 0, policy_version 1746798 (0.0010) [2023-12-26 13:32:33,989][123090] Updated weights for policy 1, policy_version 1735120 (0.0007) [2023-12-26 13:32:34,055][123090] Updated weights for policy 1, policy_version 1735130 (0.0010) [2023-12-26 13:32:34,674][123091] Updated weights for policy 0, policy_version 1746808 (0.0009) [2023-12-26 13:32:34,735][123091] Updated weights for policy 0, policy_version 1746818 (0.0009) [2023-12-26 13:32:34,791][123091] Updated weights for policy 0, policy_version 1746828 (0.0009) [2023-12-26 13:32:34,890][123090] Updated weights for policy 1, policy_version 1735140 (0.0008) [2023-12-26 13:32:34,949][123090] Updated weights for policy 1, policy_version 1735150 (0.0005) [2023-12-26 13:32:35,006][123090] Updated weights for policy 1, policy_version 1735160 (0.0009) [2023-12-26 13:32:35,603][123091] Updated weights for policy 0, policy_version 1746838 (0.0010) [2023-12-26 13:32:35,654][123091] Updated weights for policy 0, policy_version 1746848 (0.0009) [2023-12-26 13:32:35,700][123090] Updated weights for policy 1, policy_version 1735170 (0.0009) [2023-12-26 13:32:35,712][123091] Updated weights for policy 0, policy_version 1746858 (0.0008) [2023-12-26 13:32:35,754][123090] Updated weights for policy 1, policy_version 1735180 (0.0006) [2023-12-26 13:32:35,817][123090] Updated weights for policy 1, policy_version 1735190 (0.0005) [2023-12-26 13:32:35,882][123090] Updated weights for policy 1, policy_version 1735200 (0.0005) [2023-12-26 13:32:36,507][123091] Updated weights for policy 0, policy_version 1746868 (0.0008) [2023-12-26 13:32:36,573][123091] Updated weights for policy 0, policy_version 1746878 (0.0009) [2023-12-26 13:32:36,627][123090] Updated weights for policy 1, policy_version 1735210 (0.0008) [2023-12-26 13:32:36,641][123091] Updated weights for policy 0, policy_version 1746888 (0.0009) [2023-12-26 13:32:36,677][123090] Updated weights for policy 1, policy_version 1735220 (0.0008) [2023-12-26 13:32:36,726][123090] Updated weights for policy 1, policy_version 1735230 (0.0009) [2023-12-26 13:32:37,462][123091] Updated weights for policy 0, policy_version 1746898 (0.0008) [2023-12-26 13:32:37,521][123091] Updated weights for policy 0, policy_version 1746908 (0.0009) [2023-12-26 13:32:37,582][123090] Updated weights for policy 1, policy_version 1735240 (0.0007) [2023-12-26 13:32:37,583][123091] Updated weights for policy 0, policy_version 1746918 (0.0009) [2023-12-26 13:32:37,647][123090] Updated weights for policy 1, policy_version 1735250 (0.0006) [2023-12-26 13:32:37,649][123091] Updated weights for policy 0, policy_version 1746928 (0.0010) [2023-12-26 13:32:37,715][123090] Updated weights for policy 1, policy_version 1735260 (0.0009) [2023-12-26 13:32:38,454][123091] Updated weights for policy 0, policy_version 1746938 (0.0007) [2023-12-26 13:32:38,517][123091] Updated weights for policy 0, policy_version 1746948 (0.0009) [2023-12-26 13:32:38,561][123090] Updated weights for policy 1, policy_version 1735270 (0.0009) [2023-12-26 13:32:38,581][123091] Updated weights for policy 0, policy_version 1746958 (0.0009) [2023-12-26 13:32:38,616][123090] Updated weights for policy 1, policy_version 1735280 (0.0008) [2023-12-26 13:32:38,680][123090] Updated weights for policy 1, policy_version 1735290 (0.0009) [2023-12-26 13:32:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 891461632. Throughput: 0: 8981.7, 1: 8742.0. Samples: 891435532. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:38,785][121949] Avg episode reward: [(0, '6142.292'), (1, '5817.891')] [2023-12-26 13:32:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001746960_447225856.pth... [2023-12-26 13:32:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001735296_444235776.pth... [2023-12-26 13:32:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001745904_446955520.pth [2023-12-26 13:32:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001734272_443973632.pth [2023-12-26 13:32:39,378][123091] Updated weights for policy 0, policy_version 1746968 (0.0011) [2023-12-26 13:32:39,443][123091] Updated weights for policy 0, policy_version 1746978 (0.0011) [2023-12-26 13:32:39,515][123091] Updated weights for policy 0, policy_version 1746988 (0.0011) [2023-12-26 13:32:39,539][123090] Updated weights for policy 1, policy_version 1735300 (0.0007) [2023-12-26 13:32:39,608][123090] Updated weights for policy 1, policy_version 1735310 (0.0009) [2023-12-26 13:32:39,673][123090] Updated weights for policy 1, policy_version 1735320 (0.0009) [2023-12-26 13:32:40,316][123091] Updated weights for policy 0, policy_version 1746998 (0.0007) [2023-12-26 13:32:40,372][123091] Updated weights for policy 0, policy_version 1747008 (0.0007) [2023-12-26 13:32:40,440][123091] Updated weights for policy 0, policy_version 1747018 (0.0006) [2023-12-26 13:32:40,554][123090] Updated weights for policy 1, policy_version 1735330 (0.0010) [2023-12-26 13:32:40,620][123090] Updated weights for policy 1, policy_version 1735340 (0.0008) [2023-12-26 13:32:40,682][123090] Updated weights for policy 1, policy_version 1735350 (0.0010) [2023-12-26 13:32:40,747][123090] Updated weights for policy 1, policy_version 1735360 (0.0009) [2023-12-26 13:32:41,203][123091] Updated weights for policy 0, policy_version 1747028 (0.0007) [2023-12-26 13:32:41,262][123091] Updated weights for policy 0, policy_version 1747038 (0.0009) [2023-12-26 13:32:41,317][123091] Updated weights for policy 0, policy_version 1747048 (0.0009) [2023-12-26 13:32:41,563][123090] Updated weights for policy 1, policy_version 1735370 (0.0006) [2023-12-26 13:32:41,617][123090] Updated weights for policy 1, policy_version 1735380 (0.0008) [2023-12-26 13:32:41,686][123090] Updated weights for policy 1, policy_version 1735390 (0.0008) [2023-12-26 13:32:42,145][123091] Updated weights for policy 0, policy_version 1747058 (0.0009) [2023-12-26 13:32:42,213][123091] Updated weights for policy 0, policy_version 1747068 (0.0011) [2023-12-26 13:32:42,273][123091] Updated weights for policy 0, policy_version 1747078 (0.0010) [2023-12-26 13:32:42,349][123091] Updated weights for policy 0, policy_version 1747088 (0.0007) [2023-12-26 13:32:42,467][123090] Updated weights for policy 1, policy_version 1735400 (0.0010) [2023-12-26 13:32:42,539][123090] Updated weights for policy 1, policy_version 1735410 (0.0009) [2023-12-26 13:32:42,603][123090] Updated weights for policy 1, policy_version 1735420 (0.0008) [2023-12-26 13:32:43,121][123091] Updated weights for policy 0, policy_version 1747098 (0.0011) [2023-12-26 13:32:43,198][123091] Updated weights for policy 0, policy_version 1747108 (0.0010) [2023-12-26 13:32:43,267][123091] Updated weights for policy 0, policy_version 1747118 (0.0010) [2023-12-26 13:32:43,448][123090] Updated weights for policy 1, policy_version 1735430 (0.0009) [2023-12-26 13:32:43,510][123090] Updated weights for policy 1, policy_version 1735440 (0.0009) [2023-12-26 13:32:43,577][123090] Updated weights for policy 1, policy_version 1735450 (0.0009) [2023-12-26 13:32:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 891543552. Throughput: 0: 9000.4, 1: 8663.9. Samples: 891537540. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:43,785][121949] Avg episode reward: [(0, '6231.727'), (1, '5691.892')] [2023-12-26 13:32:44,041][123091] Updated weights for policy 0, policy_version 1747128 (0.0007) [2023-12-26 13:32:44,097][123091] Updated weights for policy 0, policy_version 1747138 (0.0006) [2023-12-26 13:32:44,160][123091] Updated weights for policy 0, policy_version 1747148 (0.0006) [2023-12-26 13:32:44,429][123090] Updated weights for policy 1, policy_version 1735460 (0.0009) [2023-12-26 13:32:44,477][123090] Updated weights for policy 1, policy_version 1735470 (0.0009) [2023-12-26 13:32:44,526][123090] Updated weights for policy 1, policy_version 1735480 (0.0009) [2023-12-26 13:32:44,833][123091] Updated weights for policy 0, policy_version 1747158 (0.0007) [2023-12-26 13:32:44,896][123091] Updated weights for policy 0, policy_version 1747168 (0.0008) [2023-12-26 13:32:44,958][123091] Updated weights for policy 0, policy_version 1747178 (0.0008) [2023-12-26 13:32:45,441][123090] Updated weights for policy 1, policy_version 1735490 (0.0008) [2023-12-26 13:32:45,502][123090] Updated weights for policy 1, policy_version 1735500 (0.0009) [2023-12-26 13:32:45,567][123090] Updated weights for policy 1, policy_version 1735510 (0.0009) [2023-12-26 13:32:45,630][123090] Updated weights for policy 1, policy_version 1735520 (0.0009) [2023-12-26 13:32:45,706][123091] Updated weights for policy 0, policy_version 1747188 (0.0009) [2023-12-26 13:32:45,754][123091] Updated weights for policy 0, policy_version 1747198 (0.0010) [2023-12-26 13:32:45,802][123091] Updated weights for policy 0, policy_version 1747208 (0.0010) [2023-12-26 13:32:46,532][123090] Updated weights for policy 1, policy_version 1735530 (0.0010) [2023-12-26 13:32:46,545][123091] Updated weights for policy 0, policy_version 1747218 (0.0009) [2023-12-26 13:32:46,593][123091] Updated weights for policy 0, policy_version 1747228 (0.0005) [2023-12-26 13:32:46,594][123090] Updated weights for policy 1, policy_version 1735540 (0.0009) [2023-12-26 13:32:46,639][123091] Updated weights for policy 0, policy_version 1747238 (0.0006) [2023-12-26 13:32:46,656][123090] Updated weights for policy 1, policy_version 1735550 (0.0009) [2023-12-26 13:32:46,681][123091] Updated weights for policy 0, policy_version 1747248 (0.0005) [2023-12-26 13:32:47,369][123090] Updated weights for policy 1, policy_version 1735560 (0.0006) [2023-12-26 13:32:47,409][123091] Updated weights for policy 0, policy_version 1747258 (0.0005) [2023-12-26 13:32:47,425][123090] Updated weights for policy 1, policy_version 1735570 (0.0009) [2023-12-26 13:32:47,461][123091] Updated weights for policy 0, policy_version 1747268 (0.0005) [2023-12-26 13:32:47,479][123090] Updated weights for policy 1, policy_version 1735580 (0.0009) [2023-12-26 13:32:47,510][123091] Updated weights for policy 0, policy_version 1747278 (0.0005) [2023-12-26 13:32:48,180][123091] Updated weights for policy 0, policy_version 1747288 (0.0010) [2023-12-26 13:32:48,247][123091] Updated weights for policy 0, policy_version 1747298 (0.0011) [2023-12-26 13:32:48,306][123091] Updated weights for policy 0, policy_version 1747308 (0.0011) [2023-12-26 13:32:48,349][123090] Updated weights for policy 1, policy_version 1735590 (0.0009) [2023-12-26 13:32:48,421][123090] Updated weights for policy 1, policy_version 1735600 (0.0009) [2023-12-26 13:32:48,479][123090] Updated weights for policy 1, policy_version 1735610 (0.0008) [2023-12-26 13:32:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 891633664. Throughput: 0: 9053.6, 1: 8608.1. Samples: 891643700. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:48,785][121949] Avg episode reward: [(0, '6288.804'), (1, '5516.094')] [2023-12-26 13:32:49,142][123091] Updated weights for policy 0, policy_version 1747318 (0.0010) [2023-12-26 13:32:49,199][123091] Updated weights for policy 0, policy_version 1747328 (0.0010) [2023-12-26 13:32:49,270][123091] Updated weights for policy 0, policy_version 1747338 (0.0009) [2023-12-26 13:32:49,307][123090] Updated weights for policy 1, policy_version 1735620 (0.0007) [2023-12-26 13:32:49,376][123090] Updated weights for policy 1, policy_version 1735630 (0.0010) [2023-12-26 13:32:49,443][123090] Updated weights for policy 1, policy_version 1735640 (0.0010) [2023-12-26 13:32:50,115][123091] Updated weights for policy 0, policy_version 1747348 (0.0008) [2023-12-26 13:32:50,166][123091] Updated weights for policy 0, policy_version 1747358 (0.0010) [2023-12-26 13:32:50,220][123091] Updated weights for policy 0, policy_version 1747368 (0.0010) [2023-12-26 13:32:50,266][123090] Updated weights for policy 1, policy_version 1735650 (0.0010) [2023-12-26 13:32:50,319][123090] Updated weights for policy 1, policy_version 1735660 (0.0009) [2023-12-26 13:32:50,387][123090] Updated weights for policy 1, policy_version 1735670 (0.0009) [2023-12-26 13:32:50,450][123090] Updated weights for policy 1, policy_version 1735680 (0.0009) [2023-12-26 13:32:51,021][123091] Updated weights for policy 0, policy_version 1747378 (0.0008) [2023-12-26 13:32:51,081][123091] Updated weights for policy 0, policy_version 1747388 (0.0009) [2023-12-26 13:32:51,141][123091] Updated weights for policy 0, policy_version 1747398 (0.0010) [2023-12-26 13:32:51,196][123091] Updated weights for policy 0, policy_version 1747408 (0.0009) [2023-12-26 13:32:51,345][123090] Updated weights for policy 1, policy_version 1735690 (0.0009) [2023-12-26 13:32:51,420][123090] Updated weights for policy 1, policy_version 1735700 (0.0010) [2023-12-26 13:32:51,476][123090] Updated weights for policy 1, policy_version 1735711 (0.0011) [2023-12-26 13:32:52,038][123091] Updated weights for policy 0, policy_version 1747418 (0.0005) [2023-12-26 13:32:52,096][123091] Updated weights for policy 0, policy_version 1747428 (0.0006) [2023-12-26 13:32:52,154][123091] Updated weights for policy 0, policy_version 1747438 (0.0006) [2023-12-26 13:32:52,408][123090] Updated weights for policy 1, policy_version 1735721 (0.0010) [2023-12-26 13:32:52,470][123090] Updated weights for policy 1, policy_version 1735731 (0.0009) [2023-12-26 13:32:52,532][123090] Updated weights for policy 1, policy_version 1735741 (0.0010) [2023-12-26 13:32:52,926][123091] Updated weights for policy 0, policy_version 1747448 (0.0010) [2023-12-26 13:32:52,989][123091] Updated weights for policy 0, policy_version 1747458 (0.0010) [2023-12-26 13:32:53,048][123091] Updated weights for policy 0, policy_version 1747468 (0.0011) [2023-12-26 13:32:53,354][123090] Updated weights for policy 1, policy_version 1735751 (0.0007) [2023-12-26 13:32:53,421][123090] Updated weights for policy 1, policy_version 1735761 (0.0005) [2023-12-26 13:32:53,486][123090] Updated weights for policy 1, policy_version 1735771 (0.0007) [2023-12-26 13:32:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 891715584. Throughput: 0: 8987.6, 1: 8541.3. Samples: 891694196. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:53,785][121949] Avg episode reward: [(0, '6240.642'), (1, '5516.011')] [2023-12-26 13:32:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001747472_447356928.pth... [2023-12-26 13:32:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001735776_444358656.pth... [2023-12-26 13:32:53,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001734784_444104704.pth [2023-12-26 13:32:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001746416_447086592.pth [2023-12-26 13:32:53,862][123091] Updated weights for policy 0, policy_version 1747478 (0.0010) [2023-12-26 13:32:53,928][123091] Updated weights for policy 0, policy_version 1747488 (0.0010) [2023-12-26 13:32:53,996][123091] Updated weights for policy 0, policy_version 1747498 (0.0010) [2023-12-26 13:32:54,238][123090] Updated weights for policy 1, policy_version 1735781 (0.0007) [2023-12-26 13:32:54,286][123090] Updated weights for policy 1, policy_version 1735791 (0.0009) [2023-12-26 13:32:54,332][123090] Updated weights for policy 1, policy_version 1735801 (0.0008) [2023-12-26 13:32:54,806][123091] Updated weights for policy 0, policy_version 1747508 (0.0011) [2023-12-26 13:32:54,868][123091] Updated weights for policy 0, policy_version 1747518 (0.0011) [2023-12-26 13:32:54,925][123091] Updated weights for policy 0, policy_version 1747528 (0.0010) [2023-12-26 13:32:55,074][123090] Updated weights for policy 1, policy_version 1735811 (0.0006) [2023-12-26 13:32:55,138][123090] Updated weights for policy 1, policy_version 1735821 (0.0010) [2023-12-26 13:32:55,197][123090] Updated weights for policy 1, policy_version 1735831 (0.0010) [2023-12-26 13:32:55,707][123091] Updated weights for policy 0, policy_version 1747538 (0.0010) [2023-12-26 13:32:55,764][123091] Updated weights for policy 0, policy_version 1747548 (0.0009) [2023-12-26 13:32:55,812][123091] Updated weights for policy 0, policy_version 1747558 (0.0010) [2023-12-26 13:32:55,857][123091] Updated weights for policy 0, policy_version 1747568 (0.0010) [2023-12-26 13:32:55,886][123090] Updated weights for policy 1, policy_version 1735841 (0.0009) [2023-12-26 13:32:55,946][123090] Updated weights for policy 1, policy_version 1735851 (0.0006) [2023-12-26 13:32:56,006][123090] Updated weights for policy 1, policy_version 1735861 (0.0006) [2023-12-26 13:32:56,062][123090] Updated weights for policy 1, policy_version 1735871 (0.0006) [2023-12-26 13:32:56,683][123091] Updated weights for policy 0, policy_version 1747578 (0.0011) [2023-12-26 13:32:56,734][123091] Updated weights for policy 0, policy_version 1747588 (0.0011) [2023-12-26 13:32:56,786][123091] Updated weights for policy 0, policy_version 1747598 (0.0011) [2023-12-26 13:32:56,835][123090] Updated weights for policy 1, policy_version 1735881 (0.0008) [2023-12-26 13:32:56,883][123090] Updated weights for policy 1, policy_version 1735891 (0.0009) [2023-12-26 13:32:56,941][123090] Updated weights for policy 1, policy_version 1735901 (0.0009) [2023-12-26 13:32:57,620][123091] Updated weights for policy 0, policy_version 1747608 (0.0010) [2023-12-26 13:32:57,670][123091] Updated weights for policy 0, policy_version 1747618 (0.0010) [2023-12-26 13:32:57,724][123091] Updated weights for policy 0, policy_version 1747628 (0.0010) [2023-12-26 13:32:57,762][123090] Updated weights for policy 1, policy_version 1735911 (0.0006) [2023-12-26 13:32:57,817][123090] Updated weights for policy 1, policy_version 1735921 (0.0007) [2023-12-26 13:32:57,865][123090] Updated weights for policy 1, policy_version 1735931 (0.0008) [2023-12-26 13:32:58,586][123091] Updated weights for policy 0, policy_version 1747638 (0.0009) [2023-12-26 13:32:58,655][123091] Updated weights for policy 0, policy_version 1747648 (0.0008) [2023-12-26 13:32:58,714][123090] Updated weights for policy 1, policy_version 1735941 (0.0007) [2023-12-26 13:32:58,722][123091] Updated weights for policy 0, policy_version 1747658 (0.0007) [2023-12-26 13:32:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 891805696. Throughput: 0: 9041.1, 1: 8588.5. Samples: 891801996. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:32:58,785][121949] Avg episode reward: [(0, '6176.290'), (1, '5705.058')] [2023-12-26 13:32:58,788][123090] Updated weights for policy 1, policy_version 1735951 (0.0008) [2023-12-26 13:32:58,861][123090] Updated weights for policy 1, policy_version 1735961 (0.0008) [2023-12-26 13:32:59,329][123091] Updated weights for policy 0, policy_version 1747668 (0.0008) [2023-12-26 13:32:59,383][123091] Updated weights for policy 0, policy_version 1747678 (0.0006) [2023-12-26 13:32:59,452][123091] Updated weights for policy 0, policy_version 1747688 (0.0010) [2023-12-26 13:32:59,696][123090] Updated weights for policy 1, policy_version 1735971 (0.0008) [2023-12-26 13:32:59,752][123090] Updated weights for policy 1, policy_version 1735981 (0.0008) [2023-12-26 13:32:59,805][123090] Updated weights for policy 1, policy_version 1735991 (0.0008) [2023-12-26 13:33:00,255][123091] Updated weights for policy 0, policy_version 1747698 (0.0011) [2023-12-26 13:33:00,320][123091] Updated weights for policy 0, policy_version 1747708 (0.0010) [2023-12-26 13:33:00,381][123091] Updated weights for policy 0, policy_version 1747718 (0.0009) [2023-12-26 13:33:00,447][123091] Updated weights for policy 0, policy_version 1747728 (0.0005) [2023-12-26 13:33:00,697][123090] Updated weights for policy 1, policy_version 1736001 (0.0008) [2023-12-26 13:33:00,759][123090] Updated weights for policy 1, policy_version 1736011 (0.0008) [2023-12-26 13:33:00,818][123090] Updated weights for policy 1, policy_version 1736021 (0.0009) [2023-12-26 13:33:00,878][123090] Updated weights for policy 1, policy_version 1736031 (0.0008) [2023-12-26 13:33:01,151][123091] Updated weights for policy 0, policy_version 1747738 (0.0011) [2023-12-26 13:33:01,211][123091] Updated weights for policy 0, policy_version 1747748 (0.0008) [2023-12-26 13:33:01,273][123091] Updated weights for policy 0, policy_version 1747758 (0.0008) [2023-12-26 13:33:01,786][123090] Updated weights for policy 1, policy_version 1736041 (0.0006) [2023-12-26 13:33:01,868][123090] Updated weights for policy 1, policy_version 1736051 (0.0005) [2023-12-26 13:33:01,946][123090] Updated weights for policy 1, policy_version 1736061 (0.0005) [2023-12-26 13:33:02,073][123091] Updated weights for policy 0, policy_version 1747768 (0.0010) [2023-12-26 13:33:02,120][123091] Updated weights for policy 0, policy_version 1747778 (0.0010) [2023-12-26 13:33:02,163][123091] Updated weights for policy 0, policy_version 1747788 (0.0010) [2023-12-26 13:33:02,665][123090] Updated weights for policy 1, policy_version 1736071 (0.0008) [2023-12-26 13:33:02,712][123090] Updated weights for policy 1, policy_version 1736081 (0.0008) [2023-12-26 13:33:02,768][123090] Updated weights for policy 1, policy_version 1736091 (0.0008) [2023-12-26 13:33:03,009][123091] Updated weights for policy 0, policy_version 1747798 (0.0010) [2023-12-26 13:33:03,078][123091] Updated weights for policy 0, policy_version 1747808 (0.0010) [2023-12-26 13:33:03,143][123091] Updated weights for policy 0, policy_version 1747818 (0.0010) [2023-12-26 13:33:03,631][123090] Updated weights for policy 1, policy_version 1736101 (0.0007) [2023-12-26 13:33:03,682][123090] Updated weights for policy 1, policy_version 1736111 (0.0005) [2023-12-26 13:33:03,734][123090] Updated weights for policy 1, policy_version 1736121 (0.0006) [2023-12-26 13:33:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 891895808. Throughput: 0: 9056.0, 1: 8567.3. Samples: 891905852. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:03,785][121949] Avg episode reward: [(0, '6187.920'), (1, '5822.644')] [2023-12-26 13:33:03,786][123091] Updated weights for policy 0, policy_version 1747828 (0.0008) [2023-12-26 13:33:03,851][123091] Updated weights for policy 0, policy_version 1747838 (0.0007) [2023-12-26 13:33:03,905][123091] Updated weights for policy 0, policy_version 1747848 (0.0009) [2023-12-26 13:33:04,485][123090] Updated weights for policy 1, policy_version 1736131 (0.0010) [2023-12-26 13:33:04,544][123090] Updated weights for policy 1, policy_version 1736141 (0.0009) [2023-12-26 13:33:04,598][123090] Updated weights for policy 1, policy_version 1736151 (0.0010) [2023-12-26 13:33:04,756][123091] Updated weights for policy 0, policy_version 1747858 (0.0009) [2023-12-26 13:33:04,811][123091] Updated weights for policy 0, policy_version 1747868 (0.0005) [2023-12-26 13:33:04,877][123091] Updated weights for policy 0, policy_version 1747878 (0.0008) [2023-12-26 13:33:04,932][123091] Updated weights for policy 0, policy_version 1747888 (0.0009) [2023-12-26 13:33:05,484][123090] Updated weights for policy 1, policy_version 1736161 (0.0009) [2023-12-26 13:33:05,533][123090] Updated weights for policy 1, policy_version 1736171 (0.0009) [2023-12-26 13:33:05,593][123090] Updated weights for policy 1, policy_version 1736181 (0.0010) [2023-12-26 13:33:05,643][123090] Updated weights for policy 1, policy_version 1736191 (0.0008) [2023-12-26 13:33:05,714][123091] Updated weights for policy 0, policy_version 1747898 (0.0010) [2023-12-26 13:33:05,769][123091] Updated weights for policy 0, policy_version 1747908 (0.0010) [2023-12-26 13:33:05,834][123091] Updated weights for policy 0, policy_version 1747918 (0.0010) [2023-12-26 13:33:06,417][123090] Updated weights for policy 1, policy_version 1736201 (0.0010) [2023-12-26 13:33:06,484][123090] Updated weights for policy 1, policy_version 1736211 (0.0009) [2023-12-26 13:33:06,551][123090] Updated weights for policy 1, policy_version 1736221 (0.0009) [2023-12-26 13:33:06,639][123091] Updated weights for policy 0, policy_version 1747928 (0.0010) [2023-12-26 13:33:06,687][123091] Updated weights for policy 0, policy_version 1747938 (0.0010) [2023-12-26 13:33:06,751][123091] Updated weights for policy 0, policy_version 1747948 (0.0011) [2023-12-26 13:33:07,377][123090] Updated weights for policy 1, policy_version 1736231 (0.0006) [2023-12-26 13:33:07,436][123090] Updated weights for policy 1, policy_version 1736241 (0.0005) [2023-12-26 13:33:07,485][123090] Updated weights for policy 1, policy_version 1736251 (0.0005) [2023-12-26 13:33:07,588][123091] Updated weights for policy 0, policy_version 1747958 (0.0010) [2023-12-26 13:33:07,654][123091] Updated weights for policy 0, policy_version 1747968 (0.0010) [2023-12-26 13:33:07,712][123091] Updated weights for policy 0, policy_version 1747978 (0.0010) [2023-12-26 13:33:08,127][123090] Updated weights for policy 1, policy_version 1736261 (0.0005) [2023-12-26 13:33:08,188][123090] Updated weights for policy 1, policy_version 1736271 (0.0010) [2023-12-26 13:33:08,247][123090] Updated weights for policy 1, policy_version 1736281 (0.0010) [2023-12-26 13:33:08,540][123091] Updated weights for policy 0, policy_version 1747988 (0.0011) [2023-12-26 13:33:08,592][123091] Updated weights for policy 0, policy_version 1747998 (0.0010) [2023-12-26 13:33:08,647][123091] Updated weights for policy 0, policy_version 1748008 (0.0010) [2023-12-26 13:33:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 891985920. Throughput: 0: 9052.4, 1: 8595.0. Samples: 891958800. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:08,784][121949] Avg episode reward: [(0, '6203.705'), (1, '5829.367')] [2023-12-26 13:33:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001748016_447496192.pth... [2023-12-26 13:33:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001736288_444489728.pth... [2023-12-26 13:33:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001746960_447225856.pth [2023-12-26 13:33:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001735296_444235776.pth [2023-12-26 13:33:08,988][123090] Updated weights for policy 1, policy_version 1736291 (0.0010) [2023-12-26 13:33:09,039][123090] Updated weights for policy 1, policy_version 1736301 (0.0010) [2023-12-26 13:33:09,088][123090] Updated weights for policy 1, policy_version 1736311 (0.0010) [2023-12-26 13:33:09,514][123091] Updated weights for policy 0, policy_version 1748018 (0.0011) [2023-12-26 13:33:09,578][123091] Updated weights for policy 0, policy_version 1748028 (0.0008) [2023-12-26 13:33:09,639][123091] Updated weights for policy 0, policy_version 1748038 (0.0008) [2023-12-26 13:33:09,694][123091] Updated weights for policy 0, policy_version 1748048 (0.0008) [2023-12-26 13:33:09,989][123090] Updated weights for policy 1, policy_version 1736321 (0.0010) [2023-12-26 13:33:10,055][123090] Updated weights for policy 1, policy_version 1736331 (0.0009) [2023-12-26 13:33:10,120][123090] Updated weights for policy 1, policy_version 1736341 (0.0009) [2023-12-26 13:33:10,186][123090] Updated weights for policy 1, policy_version 1736351 (0.0009) [2023-12-26 13:33:10,543][123091] Updated weights for policy 0, policy_version 1748058 (0.0011) [2023-12-26 13:33:10,600][123091] Updated weights for policy 0, policy_version 1748068 (0.0010) [2023-12-26 13:33:10,655][123091] Updated weights for policy 0, policy_version 1748078 (0.0010) [2023-12-26 13:33:11,021][123090] Updated weights for policy 1, policy_version 1736361 (0.0009) [2023-12-26 13:33:11,094][123090] Updated weights for policy 1, policy_version 1736371 (0.0008) [2023-12-26 13:33:11,164][123090] Updated weights for policy 1, policy_version 1736381 (0.0007) [2023-12-26 13:33:11,496][123091] Updated weights for policy 0, policy_version 1748088 (0.0011) [2023-12-26 13:33:11,556][123091] Updated weights for policy 0, policy_version 1748098 (0.0010) [2023-12-26 13:33:11,623][123091] Updated weights for policy 0, policy_version 1748108 (0.0010) [2023-12-26 13:33:11,912][123090] Updated weights for policy 1, policy_version 1736391 (0.0008) [2023-12-26 13:33:11,973][123090] Updated weights for policy 1, policy_version 1736401 (0.0009) [2023-12-26 13:33:12,047][123090] Updated weights for policy 1, policy_version 1736411 (0.0009) [2023-12-26 13:33:12,535][123091] Updated weights for policy 0, policy_version 1748118 (0.0010) [2023-12-26 13:33:12,592][123091] Updated weights for policy 0, policy_version 1748129 (0.0010) [2023-12-26 13:33:12,642][123091] Updated weights for policy 0, policy_version 1748139 (0.0010) [2023-12-26 13:33:12,865][123090] Updated weights for policy 1, policy_version 1736421 (0.0009) [2023-12-26 13:33:12,917][123090] Updated weights for policy 1, policy_version 1736431 (0.0009) [2023-12-26 13:33:12,969][123090] Updated weights for policy 1, policy_version 1736441 (0.0009) [2023-12-26 13:33:13,495][123091] Updated weights for policy 0, policy_version 1748149 (0.0010) [2023-12-26 13:33:13,566][123091] Updated weights for policy 0, policy_version 1748159 (0.0011) [2023-12-26 13:33:13,638][123091] Updated weights for policy 0, policy_version 1748169 (0.0011) [2023-12-26 13:33:13,680][123090] Updated weights for policy 1, policy_version 1736451 (0.0008) [2023-12-26 13:33:13,755][123090] Updated weights for policy 1, policy_version 1736461 (0.0005) [2023-12-26 13:33:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 892067840. Throughput: 0: 8901.1, 1: 8570.5. Samples: 892061928. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:13,785][121949] Avg episode reward: [(0, '6167.515'), (1, '5867.022')] [2023-12-26 13:33:13,822][123090] Updated weights for policy 1, policy_version 1736471 (0.0005) [2023-12-26 13:33:14,396][123090] Updated weights for policy 1, policy_version 1736481 (0.0005) [2023-12-26 13:33:14,459][123090] Updated weights for policy 1, policy_version 1736491 (0.0005) [2023-12-26 13:33:14,481][123091] Updated weights for policy 0, policy_version 1748179 (0.0008) [2023-12-26 13:33:14,523][123090] Updated weights for policy 1, policy_version 1736501 (0.0005) [2023-12-26 13:33:14,535][123091] Updated weights for policy 0, policy_version 1748189 (0.0009) [2023-12-26 13:33:14,590][123090] Updated weights for policy 1, policy_version 1736511 (0.0006) [2023-12-26 13:33:14,594][123091] Updated weights for policy 0, policy_version 1748199 (0.0005) [2023-12-26 13:33:15,323][123090] Updated weights for policy 1, policy_version 1736521 (0.0010) [2023-12-26 13:33:15,374][123090] Updated weights for policy 1, policy_version 1736531 (0.0009) [2023-12-26 13:33:15,428][123090] Updated weights for policy 1, policy_version 1736541 (0.0010) [2023-12-26 13:33:15,457][123091] Updated weights for policy 0, policy_version 1748209 (0.0008) [2023-12-26 13:33:15,512][123091] Updated weights for policy 0, policy_version 1748219 (0.0009) [2023-12-26 13:33:15,561][123091] Updated weights for policy 0, policy_version 1748229 (0.0008) [2023-12-26 13:33:15,615][123091] Updated weights for policy 0, policy_version 1748239 (0.0007) [2023-12-26 13:33:16,306][123090] Updated weights for policy 1, policy_version 1736551 (0.0007) [2023-12-26 13:33:16,363][123091] Updated weights for policy 0, policy_version 1748249 (0.0010) [2023-12-26 13:33:16,365][123090] Updated weights for policy 1, policy_version 1736561 (0.0007) [2023-12-26 13:33:16,408][123091] Updated weights for policy 0, policy_version 1748259 (0.0010) [2023-12-26 13:33:16,415][123090] Updated weights for policy 1, policy_version 1736571 (0.0008) [2023-12-26 13:33:16,459][123091] Updated weights for policy 0, policy_version 1748269 (0.0010) [2023-12-26 13:33:17,112][123090] Updated weights for policy 1, policy_version 1736581 (0.0005) [2023-12-26 13:33:17,158][123090] Updated weights for policy 1, policy_version 1736591 (0.0005) [2023-12-26 13:33:17,211][123090] Updated weights for policy 1, policy_version 1736601 (0.0005) [2023-12-26 13:33:17,336][123091] Updated weights for policy 0, policy_version 1748279 (0.0011) [2023-12-26 13:33:17,403][123091] Updated weights for policy 0, policy_version 1748289 (0.0009) [2023-12-26 13:33:17,476][123091] Updated weights for policy 0, policy_version 1748299 (0.0006) [2023-12-26 13:33:17,939][123090] Updated weights for policy 1, policy_version 1736611 (0.0006) [2023-12-26 13:33:18,000][123090] Updated weights for policy 1, policy_version 1736621 (0.0009) [2023-12-26 13:33:18,049][123090] Updated weights for policy 1, policy_version 1736631 (0.0009) [2023-12-26 13:33:18,259][123091] Updated weights for policy 0, policy_version 1748309 (0.0008) [2023-12-26 13:33:18,333][123091] Updated weights for policy 0, policy_version 1748319 (0.0011) [2023-12-26 13:33:18,406][123091] Updated weights for policy 0, policy_version 1748329 (0.0011) [2023-12-26 13:33:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 892157952. Throughput: 0: 8833.0, 1: 8720.3. Samples: 892170556. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:18,784][121949] Avg episode reward: [(0, '6099.462'), (1, '5681.330')] [2023-12-26 13:33:18,904][123090] Updated weights for policy 1, policy_version 1736641 (0.0009) [2023-12-26 13:33:18,986][123090] Updated weights for policy 1, policy_version 1736651 (0.0010) [2023-12-26 13:33:19,042][123090] Updated weights for policy 1, policy_version 1736661 (0.0009) [2023-12-26 13:33:19,071][123091] Updated weights for policy 0, policy_version 1748339 (0.0009) [2023-12-26 13:33:19,112][123090] Updated weights for policy 1, policy_version 1736671 (0.0005) [2023-12-26 13:33:19,130][123091] Updated weights for policy 0, policy_version 1748349 (0.0006) [2023-12-26 13:33:19,201][123091] Updated weights for policy 0, policy_version 1748359 (0.0006) [2023-12-26 13:33:19,869][123090] Updated weights for policy 1, policy_version 1736681 (0.0008) [2023-12-26 13:33:19,944][123090] Updated weights for policy 1, policy_version 1736691 (0.0008) [2023-12-26 13:33:19,999][123091] Updated weights for policy 0, policy_version 1748369 (0.0008) [2023-12-26 13:33:20,023][123090] Updated weights for policy 1, policy_version 1736701 (0.0008) [2023-12-26 13:33:20,068][123091] Updated weights for policy 0, policy_version 1748379 (0.0010) [2023-12-26 13:33:20,132][123091] Updated weights for policy 0, policy_version 1748389 (0.0011) [2023-12-26 13:33:20,203][123091] Updated weights for policy 0, policy_version 1748399 (0.0011) [2023-12-26 13:33:20,806][123090] Updated weights for policy 1, policy_version 1736711 (0.0009) [2023-12-26 13:33:20,859][123090] Updated weights for policy 1, policy_version 1736721 (0.0009) [2023-12-26 13:33:20,919][123090] Updated weights for policy 1, policy_version 1736731 (0.0010) [2023-12-26 13:33:20,997][123091] Updated weights for policy 0, policy_version 1748409 (0.0009) [2023-12-26 13:33:21,064][123091] Updated weights for policy 0, policy_version 1748419 (0.0009) [2023-12-26 13:33:21,127][123091] Updated weights for policy 0, policy_version 1748429 (0.0010) [2023-12-26 13:33:21,768][123090] Updated weights for policy 1, policy_version 1736741 (0.0008) [2023-12-26 13:33:21,834][123090] Updated weights for policy 1, policy_version 1736751 (0.0006) [2023-12-26 13:33:21,899][123090] Updated weights for policy 1, policy_version 1736761 (0.0006) [2023-12-26 13:33:22,052][123091] Updated weights for policy 0, policy_version 1748439 (0.0008) [2023-12-26 13:33:22,123][123091] Updated weights for policy 0, policy_version 1748449 (0.0009) [2023-12-26 13:33:22,196][123091] Updated weights for policy 0, policy_version 1748459 (0.0006) [2023-12-26 13:33:22,677][123090] Updated weights for policy 1, policy_version 1736771 (0.0006) [2023-12-26 13:33:22,738][123090] Updated weights for policy 1, policy_version 1736781 (0.0009) [2023-12-26 13:33:22,801][123090] Updated weights for policy 1, policy_version 1736791 (0.0010) [2023-12-26 13:33:22,889][123091] Updated weights for policy 0, policy_version 1748469 (0.0008) [2023-12-26 13:33:22,953][123091] Updated weights for policy 0, policy_version 1748479 (0.0010) [2023-12-26 13:33:23,021][123091] Updated weights for policy 0, policy_version 1748489 (0.0009) [2023-12-26 13:33:23,641][123090] Updated weights for policy 1, policy_version 1736801 (0.0010) [2023-12-26 13:33:23,698][123090] Updated weights for policy 1, policy_version 1736811 (0.0009) [2023-12-26 13:33:23,756][123090] Updated weights for policy 1, policy_version 1736821 (0.0010) [2023-12-26 13:33:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 892239872. Throughput: 0: 8820.4, 1: 8671.9. Samples: 892222684. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:23,785][121949] Avg episode reward: [(0, '6285.385'), (1, '5644.985')] [2023-12-26 13:33:23,796][123091] Updated weights for policy 0, policy_version 1748499 (0.0009) [2023-12-26 13:33:23,807][123090] Updated weights for policy 1, policy_version 1736831 (0.0008) [2023-12-26 13:33:23,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001736832_444628992.pth... [2023-12-26 13:33:23,814][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001735776_444358656.pth [2023-12-26 13:33:23,843][123091] Updated weights for policy 0, policy_version 1748509 (0.0005) [2023-12-26 13:33:23,900][123091] Updated weights for policy 0, policy_version 1748519 (0.0006) [2023-12-26 13:33:23,959][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001748528_447627264.pth... [2023-12-26 13:33:23,965][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001747472_447356928.pth [2023-12-26 13:33:24,649][123091] Updated weights for policy 0, policy_version 1748529 (0.0006) [2023-12-26 13:33:24,704][123091] Updated weights for policy 0, policy_version 1748539 (0.0008) [2023-12-26 13:33:24,713][123090] Updated weights for policy 1, policy_version 1736841 (0.0010) [2023-12-26 13:33:24,764][123091] Updated weights for policy 0, policy_version 1748549 (0.0008) [2023-12-26 13:33:24,773][123090] Updated weights for policy 1, policy_version 1736851 (0.0009) [2023-12-26 13:33:24,825][123091] Updated weights for policy 0, policy_version 1748559 (0.0005) [2023-12-26 13:33:24,835][123090] Updated weights for policy 1, policy_version 1736861 (0.0010) [2023-12-26 13:33:25,503][123091] Updated weights for policy 0, policy_version 1748569 (0.0005) [2023-12-26 13:33:25,558][123091] Updated weights for policy 0, policy_version 1748579 (0.0005) [2023-12-26 13:33:25,604][123091] Updated weights for policy 0, policy_version 1748589 (0.0005) [2023-12-26 13:33:25,669][123090] Updated weights for policy 1, policy_version 1736871 (0.0007) [2023-12-26 13:33:25,729][123090] Updated weights for policy 1, policy_version 1736881 (0.0006) [2023-12-26 13:33:25,782][123090] Updated weights for policy 1, policy_version 1736891 (0.0005) [2023-12-26 13:33:26,223][123091] Updated weights for policy 0, policy_version 1748599 (0.0005) [2023-12-26 13:33:26,286][123091] Updated weights for policy 0, policy_version 1748610 (0.0007) [2023-12-26 13:33:26,331][123091] Updated weights for policy 0, policy_version 1748620 (0.0005) [2023-12-26 13:33:26,449][123090] Updated weights for policy 1, policy_version 1736901 (0.0005) [2023-12-26 13:33:26,503][123090] Updated weights for policy 1, policy_version 1736911 (0.0008) [2023-12-26 13:33:26,551][123090] Updated weights for policy 1, policy_version 1736921 (0.0010) [2023-12-26 13:33:27,003][123091] Updated weights for policy 0, policy_version 1748630 (0.0006) [2023-12-26 13:33:27,058][123091] Updated weights for policy 0, policy_version 1748640 (0.0006) [2023-12-26 13:33:27,120][123091] Updated weights for policy 0, policy_version 1748650 (0.0006) [2023-12-26 13:33:27,285][123090] Updated weights for policy 1, policy_version 1736931 (0.0009) [2023-12-26 13:33:27,348][123090] Updated weights for policy 1, policy_version 1736941 (0.0006) [2023-12-26 13:33:27,412][123090] Updated weights for policy 1, policy_version 1736951 (0.0005) [2023-12-26 13:33:27,885][123091] Updated weights for policy 0, policy_version 1748660 (0.0008) [2023-12-26 13:33:27,941][123091] Updated weights for policy 0, policy_version 1748670 (0.0010) [2023-12-26 13:33:28,000][123091] Updated weights for policy 0, policy_version 1748680 (0.0010) [2023-12-26 13:33:28,040][123090] Updated weights for policy 1, policy_version 1736961 (0.0005) [2023-12-26 13:33:28,089][123090] Updated weights for policy 1, policy_version 1736971 (0.0005) [2023-12-26 13:33:28,144][123090] Updated weights for policy 1, policy_version 1736981 (0.0006) [2023-12-26 13:33:28,188][123090] Updated weights for policy 1, policy_version 1736991 (0.0005) [2023-12-26 13:33:28,652][123091] Updated weights for policy 0, policy_version 1748690 (0.0010) [2023-12-26 13:33:28,703][123091] Updated weights for policy 0, policy_version 1748700 (0.0005) [2023-12-26 13:33:28,766][123091] Updated weights for policy 0, policy_version 1748710 (0.0005) [2023-12-26 13:33:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 892338176. Throughput: 0: 8960.0, 1: 8775.2. Samples: 892335620. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:28,785][121949] Avg episode reward: [(0, '6159.913'), (1, '5778.788')] [2023-12-26 13:33:28,822][123091] Updated weights for policy 0, policy_version 1748720 (0.0005) [2023-12-26 13:33:28,987][123090] Updated weights for policy 1, policy_version 1737001 (0.0010) [2023-12-26 13:33:29,052][123090] Updated weights for policy 1, policy_version 1737011 (0.0010) [2023-12-26 13:33:29,114][123090] Updated weights for policy 1, policy_version 1737021 (0.0009) [2023-12-26 13:33:29,570][123091] Updated weights for policy 0, policy_version 1748730 (0.0005) [2023-12-26 13:33:29,635][123091] Updated weights for policy 0, policy_version 1748740 (0.0005) [2023-12-26 13:33:29,694][123091] Updated weights for policy 0, policy_version 1748750 (0.0006) [2023-12-26 13:33:29,987][123090] Updated weights for policy 1, policy_version 1737031 (0.0007) [2023-12-26 13:33:30,058][123090] Updated weights for policy 1, policy_version 1737041 (0.0006) [2023-12-26 13:33:30,119][123090] Updated weights for policy 1, policy_version 1737051 (0.0005) [2023-12-26 13:33:30,395][123091] Updated weights for policy 0, policy_version 1748760 (0.0010) [2023-12-26 13:33:30,447][123091] Updated weights for policy 0, policy_version 1748770 (0.0010) [2023-12-26 13:33:30,499][123091] Updated weights for policy 0, policy_version 1748780 (0.0008) [2023-12-26 13:33:30,842][123090] Updated weights for policy 1, policy_version 1737061 (0.0007) [2023-12-26 13:33:30,897][123090] Updated weights for policy 1, policy_version 1737071 (0.0009) [2023-12-26 13:33:30,948][123090] Updated weights for policy 1, policy_version 1737081 (0.0009) [2023-12-26 13:33:31,274][123091] Updated weights for policy 0, policy_version 1748790 (0.0008) [2023-12-26 13:33:31,342][123091] Updated weights for policy 0, policy_version 1748800 (0.0006) [2023-12-26 13:33:31,426][123091] Updated weights for policy 0, policy_version 1748810 (0.0010) [2023-12-26 13:33:31,820][123090] Updated weights for policy 1, policy_version 1737091 (0.0009) [2023-12-26 13:33:31,875][123090] Updated weights for policy 1, policy_version 1737101 (0.0008) [2023-12-26 13:33:31,934][123090] Updated weights for policy 1, policy_version 1737111 (0.0009) [2023-12-26 13:33:32,119][123091] Updated weights for policy 0, policy_version 1748820 (0.0010) [2023-12-26 13:33:32,177][123091] Updated weights for policy 0, policy_version 1748830 (0.0010) [2023-12-26 13:33:32,234][123091] Updated weights for policy 0, policy_version 1748840 (0.0009) [2023-12-26 13:33:32,776][123090] Updated weights for policy 1, policy_version 1737121 (0.0010) [2023-12-26 13:33:32,824][123090] Updated weights for policy 1, policy_version 1737131 (0.0009) [2023-12-26 13:33:32,873][123090] Updated weights for policy 1, policy_version 1737141 (0.0009) [2023-12-26 13:33:32,920][123090] Updated weights for policy 1, policy_version 1737151 (0.0008) [2023-12-26 13:33:33,092][123091] Updated weights for policy 0, policy_version 1748850 (0.0009) [2023-12-26 13:33:33,154][123091] Updated weights for policy 0, policy_version 1748860 (0.0009) [2023-12-26 13:33:33,212][123091] Updated weights for policy 0, policy_version 1748870 (0.0010) [2023-12-26 13:33:33,285][123091] Updated weights for policy 0, policy_version 1748880 (0.0008) [2023-12-26 13:33:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 892428288. Throughput: 0: 8948.4, 1: 8846.2. Samples: 892444460. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:33,785][121949] Avg episode reward: [(0, '6061.344'), (1, '5857.286')] [2023-12-26 13:33:33,814][123090] Updated weights for policy 1, policy_version 1737161 (0.0010) [2023-12-26 13:33:33,866][123090] Updated weights for policy 1, policy_version 1737171 (0.0009) [2023-12-26 13:33:33,915][123090] Updated weights for policy 1, policy_version 1737181 (0.0008) [2023-12-26 13:33:33,936][123091] Updated weights for policy 0, policy_version 1748890 (0.0005) [2023-12-26 13:33:33,982][123091] Updated weights for policy 0, policy_version 1748900 (0.0005) [2023-12-26 13:33:34,041][123091] Updated weights for policy 0, policy_version 1748910 (0.0005) [2023-12-26 13:33:34,714][123091] Updated weights for policy 0, policy_version 1748920 (0.0005) [2023-12-26 13:33:34,786][123091] Updated weights for policy 0, policy_version 1748930 (0.0005) [2023-12-26 13:33:34,838][123090] Updated weights for policy 1, policy_version 1737191 (0.0006) [2023-12-26 13:33:34,842][123091] Updated weights for policy 0, policy_version 1748940 (0.0005) [2023-12-26 13:33:34,898][123090] Updated weights for policy 1, policy_version 1737201 (0.0005) [2023-12-26 13:33:34,948][123090] Updated weights for policy 1, policy_version 1737211 (0.0005) [2023-12-26 13:33:35,577][123091] Updated weights for policy 0, policy_version 1748950 (0.0005) [2023-12-26 13:33:35,581][123090] Updated weights for policy 1, policy_version 1737221 (0.0005) [2023-12-26 13:33:35,626][123091] Updated weights for policy 0, policy_version 1748960 (0.0005) [2023-12-26 13:33:35,645][123090] Updated weights for policy 1, policy_version 1737231 (0.0005) [2023-12-26 13:33:35,684][123091] Updated weights for policy 0, policy_version 1748970 (0.0005) [2023-12-26 13:33:35,701][123090] Updated weights for policy 1, policy_version 1737241 (0.0005) [2023-12-26 13:33:36,430][123090] Updated weights for policy 1, policy_version 1737251 (0.0006) [2023-12-26 13:33:36,448][123091] Updated weights for policy 0, policy_version 1748980 (0.0007) [2023-12-26 13:33:36,492][123090] Updated weights for policy 1, policy_version 1737261 (0.0010) [2023-12-26 13:33:36,507][123091] Updated weights for policy 0, policy_version 1748990 (0.0011) [2023-12-26 13:33:36,557][123090] Updated weights for policy 1, policy_version 1737271 (0.0006) [2023-12-26 13:33:36,571][123091] Updated weights for policy 0, policy_version 1749000 (0.0011) [2023-12-26 13:33:37,325][123090] Updated weights for policy 1, policy_version 1737281 (0.0007) [2023-12-26 13:33:37,384][123090] Updated weights for policy 1, policy_version 1737291 (0.0009) [2023-12-26 13:33:37,395][123091] Updated weights for policy 0, policy_version 1749010 (0.0008) [2023-12-26 13:33:37,444][123090] Updated weights for policy 1, policy_version 1737301 (0.0009) [2023-12-26 13:33:37,456][123091] Updated weights for policy 0, policy_version 1749020 (0.0008) [2023-12-26 13:33:37,500][123090] Updated weights for policy 1, policy_version 1737311 (0.0006) [2023-12-26 13:33:37,511][123091] Updated weights for policy 0, policy_version 1749030 (0.0010) [2023-12-26 13:33:37,558][123091] Updated weights for policy 0, policy_version 1749040 (0.0010) [2023-12-26 13:33:38,278][123090] Updated weights for policy 1, policy_version 1737321 (0.0009) [2023-12-26 13:33:38,335][123090] Updated weights for policy 1, policy_version 1737331 (0.0009) [2023-12-26 13:33:38,370][123091] Updated weights for policy 0, policy_version 1749050 (0.0008) [2023-12-26 13:33:38,401][123090] Updated weights for policy 1, policy_version 1737341 (0.0009) [2023-12-26 13:33:38,430][123091] Updated weights for policy 0, policy_version 1749060 (0.0008) [2023-12-26 13:33:38,484][123091] Updated weights for policy 0, policy_version 1749070 (0.0009) [2023-12-26 13:33:38,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 892526592. Throughput: 0: 9004.5, 1: 8910.7. Samples: 892500384. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:38,785][121949] Avg episode reward: [(0, '6134.036'), (1, '5844.417')] [2023-12-26 13:33:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001749072_447766528.pth... [2023-12-26 13:33:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001737344_444760064.pth... [2023-12-26 13:33:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001736288_444489728.pth [2023-12-26 13:33:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001748016_447496192.pth [2023-12-26 13:33:39,190][123090] Updated weights for policy 1, policy_version 1737351 (0.0009) [2023-12-26 13:33:39,251][123090] Updated weights for policy 1, policy_version 1737361 (0.0010) [2023-12-26 13:33:39,313][123090] Updated weights for policy 1, policy_version 1737371 (0.0007) [2023-12-26 13:33:39,316][123091] Updated weights for policy 0, policy_version 1749080 (0.0009) [2023-12-26 13:33:39,388][123091] Updated weights for policy 0, policy_version 1749090 (0.0010) [2023-12-26 13:33:39,455][123091] Updated weights for policy 0, policy_version 1749100 (0.0008) [2023-12-26 13:33:40,083][123090] Updated weights for policy 1, policy_version 1737381 (0.0010) [2023-12-26 13:33:40,150][123090] Updated weights for policy 1, policy_version 1737391 (0.0011) [2023-12-26 13:33:40,211][123090] Updated weights for policy 1, policy_version 1737401 (0.0011) [2023-12-26 13:33:40,293][123091] Updated weights for policy 0, policy_version 1749110 (0.0008) [2023-12-26 13:33:40,349][123091] Updated weights for policy 0, policy_version 1749120 (0.0006) [2023-12-26 13:33:40,421][123091] Updated weights for policy 0, policy_version 1749130 (0.0005) [2023-12-26 13:33:41,054][123090] Updated weights for policy 1, policy_version 1737411 (0.0011) [2023-12-26 13:33:41,123][123090] Updated weights for policy 1, policy_version 1737421 (0.0011) [2023-12-26 13:33:41,135][123091] Updated weights for policy 0, policy_version 1749140 (0.0007) [2023-12-26 13:33:41,194][123090] Updated weights for policy 1, policy_version 1737431 (0.0011) [2023-12-26 13:33:41,200][123091] Updated weights for policy 0, policy_version 1749150 (0.0009) [2023-12-26 13:33:41,255][123091] Updated weights for policy 0, policy_version 1749160 (0.0009) [2023-12-26 13:33:41,996][123090] Updated weights for policy 1, policy_version 1737441 (0.0010) [2023-12-26 13:33:42,067][123090] Updated weights for policy 1, policy_version 1737451 (0.0006) [2023-12-26 13:33:42,068][123091] Updated weights for policy 0, policy_version 1749170 (0.0009) [2023-12-26 13:33:42,129][123090] Updated weights for policy 1, policy_version 1737461 (0.0007) [2023-12-26 13:33:42,134][123091] Updated weights for policy 0, policy_version 1749180 (0.0009) [2023-12-26 13:33:42,193][123091] Updated weights for policy 0, policy_version 1749190 (0.0009) [2023-12-26 13:33:42,200][123090] Updated weights for policy 1, policy_version 1737471 (0.0006) [2023-12-26 13:33:42,242][123091] Updated weights for policy 0, policy_version 1749200 (0.0009) [2023-12-26 13:33:42,913][123090] Updated weights for policy 1, policy_version 1737481 (0.0009) [2023-12-26 13:33:42,979][123090] Updated weights for policy 1, policy_version 1737491 (0.0009) [2023-12-26 13:33:42,995][123091] Updated weights for policy 0, policy_version 1749210 (0.0005) [2023-12-26 13:33:43,040][123090] Updated weights for policy 1, policy_version 1737501 (0.0009) [2023-12-26 13:33:43,048][123091] Updated weights for policy 0, policy_version 1749220 (0.0005) [2023-12-26 13:33:43,124][123091] Updated weights for policy 0, policy_version 1749230 (0.0005) [2023-12-26 13:33:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 892608512. Throughput: 0: 9008.1, 1: 8867.2. Samples: 892606384. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:43,785][121949] Avg episode reward: [(0, '6175.127'), (1, '5859.906')] [2023-12-26 13:33:43,882][123090] Updated weights for policy 1, policy_version 1737511 (0.0008) [2023-12-26 13:33:43,908][123091] Updated weights for policy 0, policy_version 1749240 (0.0009) [2023-12-26 13:33:43,935][123090] Updated weights for policy 1, policy_version 1737521 (0.0008) [2023-12-26 13:33:43,973][123091] Updated weights for policy 0, policy_version 1749250 (0.0007) [2023-12-26 13:33:43,984][123090] Updated weights for policy 1, policy_version 1737531 (0.0007) [2023-12-26 13:33:44,038][123091] Updated weights for policy 0, policy_version 1749260 (0.0008) [2023-12-26 13:33:44,818][123091] Updated weights for policy 0, policy_version 1749270 (0.0008) [2023-12-26 13:33:44,855][123090] Updated weights for policy 1, policy_version 1737541 (0.0010) [2023-12-26 13:33:44,885][123091] Updated weights for policy 0, policy_version 1749280 (0.0006) [2023-12-26 13:33:44,915][123090] Updated weights for policy 1, policy_version 1737551 (0.0011) [2023-12-26 13:33:44,954][123091] Updated weights for policy 0, policy_version 1749290 (0.0008) [2023-12-26 13:33:44,980][123090] Updated weights for policy 1, policy_version 1737561 (0.0011) [2023-12-26 13:33:45,667][123091] Updated weights for policy 0, policy_version 1749300 (0.0009) [2023-12-26 13:33:45,740][123091] Updated weights for policy 0, policy_version 1749310 (0.0009) [2023-12-26 13:33:45,798][123091] Updated weights for policy 0, policy_version 1749321 (0.0010) [2023-12-26 13:33:45,810][123090] Updated weights for policy 1, policy_version 1737571 (0.0009) [2023-12-26 13:33:45,863][123090] Updated weights for policy 1, policy_version 1737581 (0.0005) [2023-12-26 13:33:45,930][123090] Updated weights for policy 1, policy_version 1737591 (0.0009) [2023-12-26 13:33:46,605][123090] Updated weights for policy 1, policy_version 1737601 (0.0009) [2023-12-26 13:33:46,659][123090] Updated weights for policy 1, policy_version 1737611 (0.0007) [2023-12-26 13:33:46,693][123091] Updated weights for policy 0, policy_version 1749331 (0.0008) [2023-12-26 13:33:46,717][123090] Updated weights for policy 1, policy_version 1737621 (0.0009) [2023-12-26 13:33:46,741][123091] Updated weights for policy 0, policy_version 1749341 (0.0007) [2023-12-26 13:33:46,775][123090] Updated weights for policy 1, policy_version 1737631 (0.0008) [2023-12-26 13:33:46,791][123091] Updated weights for policy 0, policy_version 1749351 (0.0008) [2023-12-26 13:33:47,505][123090] Updated weights for policy 1, policy_version 1737641 (0.0006) [2023-12-26 13:33:47,557][123090] Updated weights for policy 1, policy_version 1737651 (0.0005) [2023-12-26 13:33:47,609][123090] Updated weights for policy 1, policy_version 1737661 (0.0005) [2023-12-26 13:33:47,672][123091] Updated weights for policy 0, policy_version 1749361 (0.0009) [2023-12-26 13:33:47,738][123091] Updated weights for policy 0, policy_version 1749371 (0.0010) [2023-12-26 13:33:47,800][123091] Updated weights for policy 0, policy_version 1749381 (0.0010) [2023-12-26 13:33:47,875][123091] Updated weights for policy 0, policy_version 1749391 (0.0007) [2023-12-26 13:33:48,369][123090] Updated weights for policy 1, policy_version 1737671 (0.0008) [2023-12-26 13:33:48,430][123090] Updated weights for policy 1, policy_version 1737681 (0.0009) [2023-12-26 13:33:48,479][123090] Updated weights for policy 1, policy_version 1737691 (0.0009) [2023-12-26 13:33:48,589][123091] Updated weights for policy 0, policy_version 1749401 (0.0010) [2023-12-26 13:33:48,656][123091] Updated weights for policy 0, policy_version 1749411 (0.0005) [2023-12-26 13:33:48,717][123091] Updated weights for policy 0, policy_version 1749421 (0.0011) [2023-12-26 13:33:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 892706816. Throughput: 0: 8990.3, 1: 8952.9. Samples: 892713292. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:48,785][121949] Avg episode reward: [(0, '6120.869'), (1, '5699.617')] [2023-12-26 13:33:49,364][123090] Updated weights for policy 1, policy_version 1737701 (0.0010) [2023-12-26 13:33:49,433][123090] Updated weights for policy 1, policy_version 1737711 (0.0010) [2023-12-26 13:33:49,470][123091] Updated weights for policy 0, policy_version 1749431 (0.0009) [2023-12-26 13:33:49,501][123090] Updated weights for policy 1, policy_version 1737721 (0.0006) [2023-12-26 13:33:49,528][123091] Updated weights for policy 0, policy_version 1749441 (0.0010) [2023-12-26 13:33:49,583][123091] Updated weights for policy 0, policy_version 1749451 (0.0005) [2023-12-26 13:33:50,290][123091] Updated weights for policy 0, policy_version 1749461 (0.0007) [2023-12-26 13:33:50,352][123091] Updated weights for policy 0, policy_version 1749471 (0.0007) [2023-12-26 13:33:50,414][123091] Updated weights for policy 0, policy_version 1749481 (0.0008) [2023-12-26 13:33:50,421][123090] Updated weights for policy 1, policy_version 1737731 (0.0007) [2023-12-26 13:33:50,471][123090] Updated weights for policy 1, policy_version 1737741 (0.0007) [2023-12-26 13:33:50,528][123090] Updated weights for policy 1, policy_version 1737751 (0.0009) [2023-12-26 13:33:51,196][123091] Updated weights for policy 0, policy_version 1749491 (0.0011) [2023-12-26 13:33:51,264][123091] Updated weights for policy 0, policy_version 1749501 (0.0009) [2023-12-26 13:33:51,325][123091] Updated weights for policy 0, policy_version 1749511 (0.0009) [2023-12-26 13:33:51,426][123090] Updated weights for policy 1, policy_version 1737761 (0.0009) [2023-12-26 13:33:51,497][123090] Updated weights for policy 1, policy_version 1737771 (0.0010) [2023-12-26 13:33:51,562][123090] Updated weights for policy 1, policy_version 1737781 (0.0010) [2023-12-26 13:33:51,624][123090] Updated weights for policy 1, policy_version 1737791 (0.0010) [2023-12-26 13:33:52,195][123091] Updated weights for policy 0, policy_version 1749521 (0.0011) [2023-12-26 13:33:52,258][123091] Updated weights for policy 0, policy_version 1749531 (0.0009) [2023-12-26 13:33:52,317][123091] Updated weights for policy 0, policy_version 1749541 (0.0009) [2023-12-26 13:33:52,380][123091] Updated weights for policy 0, policy_version 1749551 (0.0009) [2023-12-26 13:33:52,462][123090] Updated weights for policy 1, policy_version 1737801 (0.0010) [2023-12-26 13:33:52,522][123090] Updated weights for policy 1, policy_version 1737811 (0.0010) [2023-12-26 13:33:52,579][123090] Updated weights for policy 1, policy_version 1737821 (0.0009) [2023-12-26 13:33:53,185][123091] Updated weights for policy 0, policy_version 1749561 (0.0006) [2023-12-26 13:33:53,242][123091] Updated weights for policy 0, policy_version 1749571 (0.0006) [2023-12-26 13:33:53,294][123091] Updated weights for policy 0, policy_version 1749581 (0.0008) [2023-12-26 13:33:53,428][123090] Updated weights for policy 1, policy_version 1737831 (0.0010) [2023-12-26 13:33:53,492][123090] Updated weights for policy 1, policy_version 1737841 (0.0010) [2023-12-26 13:33:53,543][123090] Updated weights for policy 1, policy_version 1737851 (0.0009) [2023-12-26 13:33:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 892788736. Throughput: 0: 8997.8, 1: 8902.6. Samples: 892764316. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:53,785][121949] Avg episode reward: [(0, '6074.281'), (1, '5703.709')] [2023-12-26 13:33:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001749584_447897600.pth... [2023-12-26 13:33:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001737856_444891136.pth... [2023-12-26 13:33:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001748528_447627264.pth [2023-12-26 13:33:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001736832_444628992.pth [2023-12-26 13:33:53,795][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001737856_444891136.pth [2023-12-26 13:33:53,796][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001749584_447897600.pth [2023-12-26 13:33:54,012][123091] Updated weights for policy 0, policy_version 1749592 (0.0010) [2023-12-26 13:33:54,070][123091] Updated weights for policy 0, policy_version 1749602 (0.0006) [2023-12-26 13:33:54,128][123091] Updated weights for policy 0, policy_version 1749612 (0.0005) [2023-12-26 13:33:54,462][123090] Updated weights for policy 1, policy_version 1737861 (0.0009) [2023-12-26 13:33:54,514][123090] Updated weights for policy 1, policy_version 1737871 (0.0010) [2023-12-26 13:33:54,564][123090] Updated weights for policy 1, policy_version 1737881 (0.0009) [2023-12-26 13:33:54,884][123091] Updated weights for policy 0, policy_version 1749622 (0.0008) [2023-12-26 13:33:54,947][123091] Updated weights for policy 0, policy_version 1749632 (0.0009) [2023-12-26 13:33:54,995][123091] Updated weights for policy 0, policy_version 1749642 (0.0008) [2023-12-26 13:33:55,441][123090] Updated weights for policy 1, policy_version 1737891 (0.0010) [2023-12-26 13:33:55,500][123090] Updated weights for policy 1, policy_version 1737901 (0.0009) [2023-12-26 13:33:55,561][123090] Updated weights for policy 1, policy_version 1737911 (0.0009) [2023-12-26 13:33:55,768][123091] Updated weights for policy 0, policy_version 1749652 (0.0010) [2023-12-26 13:33:55,820][123091] Updated weights for policy 0, policy_version 1749662 (0.0010) [2023-12-26 13:33:55,873][123091] Updated weights for policy 0, policy_version 1749672 (0.0009) [2023-12-26 13:33:56,386][123090] Updated weights for policy 1, policy_version 1737921 (0.0009) [2023-12-26 13:33:56,448][123090] Updated weights for policy 1, policy_version 1737931 (0.0008) [2023-12-26 13:33:56,510][123090] Updated weights for policy 1, policy_version 1737941 (0.0005) [2023-12-26 13:33:56,558][123090] Updated weights for policy 1, policy_version 1737951 (0.0009) [2023-12-26 13:33:56,716][123091] Updated weights for policy 0, policy_version 1749682 (0.0010) [2023-12-26 13:33:56,776][123091] Updated weights for policy 0, policy_version 1749692 (0.0010) [2023-12-26 13:33:56,828][123091] Updated weights for policy 0, policy_version 1749702 (0.0009) [2023-12-26 13:33:56,878][123091] Updated weights for policy 0, policy_version 1749712 (0.0009) [2023-12-26 13:33:57,321][123090] Updated weights for policy 1, policy_version 1737961 (0.0009) [2023-12-26 13:33:57,386][123090] Updated weights for policy 1, policy_version 1737971 (0.0009) [2023-12-26 13:33:57,448][123090] Updated weights for policy 1, policy_version 1737981 (0.0009) [2023-12-26 13:33:57,684][123091] Updated weights for policy 0, policy_version 1749722 (0.0010) [2023-12-26 13:33:57,744][123091] Updated weights for policy 0, policy_version 1749732 (0.0009) [2023-12-26 13:33:57,805][123091] Updated weights for policy 0, policy_version 1749742 (0.0009) [2023-12-26 13:33:58,221][123090] Updated weights for policy 1, policy_version 1737991 (0.0008) [2023-12-26 13:33:58,290][123090] Updated weights for policy 1, policy_version 1738001 (0.0007) [2023-12-26 13:33:58,362][123090] Updated weights for policy 1, policy_version 1738011 (0.0008) [2023-12-26 13:33:58,713][123091] Updated weights for policy 0, policy_version 1749752 (0.0009) [2023-12-26 13:33:58,782][123091] Updated weights for policy 0, policy_version 1749762 (0.0011) [2023-12-26 13:33:58,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 892870656. Throughput: 0: 9075.6, 1: 8838.8. Samples: 892868080. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:33:58,785][121949] Avg episode reward: [(0, '6005.859'), (1, '5836.883')] [2023-12-26 13:33:58,851][123091] Updated weights for policy 0, policy_version 1749772 (0.0009) [2023-12-26 13:33:59,160][123090] Updated weights for policy 1, policy_version 1738021 (0.0008) [2023-12-26 13:33:59,216][123090] Updated weights for policy 1, policy_version 1738031 (0.0006) [2023-12-26 13:33:59,287][123090] Updated weights for policy 1, policy_version 1738041 (0.0007) [2023-12-26 13:33:59,682][123091] Updated weights for policy 0, policy_version 1749782 (0.0007) [2023-12-26 13:33:59,740][123091] Updated weights for policy 0, policy_version 1749792 (0.0007) [2023-12-26 13:33:59,797][123091] Updated weights for policy 0, policy_version 1749802 (0.0007) [2023-12-26 13:34:00,148][123090] Updated weights for policy 1, policy_version 1738051 (0.0009) [2023-12-26 13:34:00,214][123090] Updated weights for policy 1, policy_version 1738061 (0.0010) [2023-12-26 13:34:00,278][123090] Updated weights for policy 1, policy_version 1738071 (0.0010) [2023-12-26 13:34:00,584][123091] Updated weights for policy 0, policy_version 1749812 (0.0010) [2023-12-26 13:34:00,639][123091] Updated weights for policy 0, policy_version 1749822 (0.0009) [2023-12-26 13:34:00,690][123091] Updated weights for policy 0, policy_version 1749832 (0.0010) [2023-12-26 13:34:01,073][123090] Updated weights for policy 1, policy_version 1738081 (0.0007) [2023-12-26 13:34:01,138][123090] Updated weights for policy 1, policy_version 1738091 (0.0009) [2023-12-26 13:34:01,204][123090] Updated weights for policy 1, policy_version 1738101 (0.0010) [2023-12-26 13:34:01,269][123090] Updated weights for policy 1, policy_version 1738111 (0.0009) [2023-12-26 13:34:01,532][123091] Updated weights for policy 0, policy_version 1749842 (0.0010) [2023-12-26 13:34:01,589][123091] Updated weights for policy 0, policy_version 1749852 (0.0009) [2023-12-26 13:34:01,653][123091] Updated weights for policy 0, policy_version 1749862 (0.0008) [2023-12-26 13:34:01,726][123091] Updated weights for policy 0, policy_version 1749872 (0.0007) [2023-12-26 13:34:02,076][123090] Updated weights for policy 1, policy_version 1738121 (0.0007) [2023-12-26 13:34:02,148][123090] Updated weights for policy 1, policy_version 1738131 (0.0009) [2023-12-26 13:34:02,220][123090] Updated weights for policy 1, policy_version 1738141 (0.0009) [2023-12-26 13:34:02,487][123091] Updated weights for policy 0, policy_version 1749882 (0.0010) [2023-12-26 13:34:02,551][123091] Updated weights for policy 0, policy_version 1749892 (0.0009) [2023-12-26 13:34:02,613][123091] Updated weights for policy 0, policy_version 1749902 (0.0007) [2023-12-26 13:34:02,990][123090] Updated weights for policy 1, policy_version 1738151 (0.0009) [2023-12-26 13:34:03,049][123090] Updated weights for policy 1, policy_version 1738161 (0.0010) [2023-12-26 13:34:03,110][123090] Updated weights for policy 1, policy_version 1738171 (0.0009) [2023-12-26 13:34:03,343][123091] Updated weights for policy 0, policy_version 1749912 (0.0006) [2023-12-26 13:34:03,393][123091] Updated weights for policy 0, policy_version 1749922 (0.0005) [2023-12-26 13:34:03,439][123091] Updated weights for policy 0, policy_version 1749932 (0.0005) [2023-12-26 13:34:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 892960768. Throughput: 0: 9093.8, 1: 8740.9. Samples: 892973124. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:34:03,785][121949] Avg episode reward: [(0, '6148.138'), (1, '5711.609')] [2023-12-26 13:34:03,986][123090] Updated weights for policy 1, policy_version 1738181 (0.0009) [2023-12-26 13:34:04,051][123090] Updated weights for policy 1, policy_version 1738191 (0.0010) [2023-12-26 13:34:04,110][123091] Updated weights for policy 0, policy_version 1749942 (0.0008) [2023-12-26 13:34:04,118][123090] Updated weights for policy 1, policy_version 1738201 (0.0009) [2023-12-26 13:34:04,164][123091] Updated weights for policy 0, policy_version 1749952 (0.0009) [2023-12-26 13:34:04,228][123091] Updated weights for policy 0, policy_version 1749962 (0.0010) [2023-12-26 13:34:04,961][123090] Updated weights for policy 1, policy_version 1738211 (0.0009) [2023-12-26 13:34:05,026][123090] Updated weights for policy 1, policy_version 1738221 (0.0009) [2023-12-26 13:34:05,061][123091] Updated weights for policy 0, policy_version 1749972 (0.0008) [2023-12-26 13:34:05,084][123090] Updated weights for policy 1, policy_version 1738231 (0.0010) [2023-12-26 13:34:05,113][123091] Updated weights for policy 0, policy_version 1749982 (0.0007) [2023-12-26 13:34:05,164][123091] Updated weights for policy 0, policy_version 1749992 (0.0008) [2023-12-26 13:34:05,903][123090] Updated weights for policy 1, policy_version 1738241 (0.0008) [2023-12-26 13:34:05,957][123090] Updated weights for policy 1, policy_version 1738251 (0.0009) [2023-12-26 13:34:06,007][123090] Updated weights for policy 1, policy_version 1738261 (0.0009) [2023-12-26 13:34:06,022][123091] Updated weights for policy 0, policy_version 1750002 (0.0009) [2023-12-26 13:34:06,059][123090] Updated weights for policy 1, policy_version 1738271 (0.0007) [2023-12-26 13:34:06,080][123091] Updated weights for policy 0, policy_version 1750012 (0.0009) [2023-12-26 13:34:06,138][123091] Updated weights for policy 0, policy_version 1750022 (0.0010) [2023-12-26 13:34:06,189][123091] Updated weights for policy 0, policy_version 1750032 (0.0009) [2023-12-26 13:34:06,917][123090] Updated weights for policy 1, policy_version 1738281 (0.0009) [2023-12-26 13:34:06,965][123090] Updated weights for policy 1, policy_version 1738291 (0.0009) [2023-12-26 13:34:07,025][123090] Updated weights for policy 1, policy_version 1738301 (0.0009) [2023-12-26 13:34:07,044][123091] Updated weights for policy 0, policy_version 1750042 (0.0005) [2023-12-26 13:34:07,093][123091] Updated weights for policy 0, policy_version 1750052 (0.0005) [2023-12-26 13:34:07,143][123091] Updated weights for policy 0, policy_version 1750062 (0.0005) [2023-12-26 13:34:07,793][123091] Updated weights for policy 0, policy_version 1750072 (0.0005) [2023-12-26 13:34:07,841][123091] Updated weights for policy 0, policy_version 1750082 (0.0005) [2023-12-26 13:34:07,894][123091] Updated weights for policy 0, policy_version 1750092 (0.0005) [2023-12-26 13:34:07,958][123090] Updated weights for policy 1, policy_version 1738311 (0.0010) [2023-12-26 13:34:08,011][123090] Updated weights for policy 1, policy_version 1738321 (0.0009) [2023-12-26 13:34:08,062][123090] Updated weights for policy 1, policy_version 1738331 (0.0009) [2023-12-26 13:34:08,704][123091] Updated weights for policy 0, policy_version 1750102 (0.0008) [2023-12-26 13:34:08,763][123091] Updated weights for policy 0, policy_version 1750112 (0.0010) [2023-12-26 13:34:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 893042688. Throughput: 0: 9081.5, 1: 8730.2. Samples: 893024212. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:34:08,785][121949] Avg episode reward: [(0, '6301.903'), (1, '5580.061')] [2023-12-26 13:34:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001738336_445014016.pth... [2023-12-26 13:34:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001737344_444760064.pth [2023-12-26 13:34:08,826][123091] Updated weights for policy 0, policy_version 1750122 (0.0011) [2023-12-26 13:34:08,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001750128_448036864.pth... [2023-12-26 13:34:08,870][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001749072_447766528.pth [2023-12-26 13:34:08,920][123090] Updated weights for policy 1, policy_version 1738341 (0.0009) [2023-12-26 13:34:08,979][123090] Updated weights for policy 1, policy_version 1738351 (0.0008) [2023-12-26 13:34:09,039][123090] Updated weights for policy 1, policy_version 1738361 (0.0008) [2023-12-26 13:34:09,661][123091] Updated weights for policy 0, policy_version 1750132 (0.0009) [2023-12-26 13:34:09,721][123091] Updated weights for policy 0, policy_version 1750142 (0.0011) [2023-12-26 13:34:09,784][123091] Updated weights for policy 0, policy_version 1750152 (0.0011) [2023-12-26 13:34:09,904][123090] Updated weights for policy 1, policy_version 1738371 (0.0009) [2023-12-26 13:34:09,965][123090] Updated weights for policy 1, policy_version 1738381 (0.0009) [2023-12-26 13:34:10,018][123090] Updated weights for policy 1, policy_version 1738391 (0.0009) [2023-12-26 13:34:10,605][123091] Updated weights for policy 0, policy_version 1750162 (0.0010) [2023-12-26 13:34:10,657][123091] Updated weights for policy 0, policy_version 1750172 (0.0011) [2023-12-26 13:34:10,705][123091] Updated weights for policy 0, policy_version 1750182 (0.0011) [2023-12-26 13:34:10,758][123091] Updated weights for policy 0, policy_version 1750192 (0.0011) [2023-12-26 13:34:10,863][123090] Updated weights for policy 1, policy_version 1738401 (0.0009) [2023-12-26 13:34:10,926][123090] Updated weights for policy 1, policy_version 1738411 (0.0008) [2023-12-26 13:34:10,978][123090] Updated weights for policy 1, policy_version 1738421 (0.0009) [2023-12-26 13:34:11,046][123090] Updated weights for policy 1, policy_version 1738431 (0.0008) [2023-12-26 13:34:11,627][123091] Updated weights for policy 0, policy_version 1750202 (0.0008) [2023-12-26 13:34:11,689][123091] Updated weights for policy 0, policy_version 1750212 (0.0010) [2023-12-26 13:34:11,756][123091] Updated weights for policy 0, policy_version 1750222 (0.0010) [2023-12-26 13:34:11,908][123090] Updated weights for policy 1, policy_version 1738441 (0.0007) [2023-12-26 13:34:11,971][123090] Updated weights for policy 1, policy_version 1738451 (0.0009) [2023-12-26 13:34:12,041][123090] Updated weights for policy 1, policy_version 1738461 (0.0010) [2023-12-26 13:34:12,587][123091] Updated weights for policy 0, policy_version 1750232 (0.0009) [2023-12-26 13:34:12,657][123091] Updated weights for policy 0, policy_version 1750242 (0.0007) [2023-12-26 13:34:12,719][123091] Updated weights for policy 0, policy_version 1750252 (0.0005) [2023-12-26 13:34:12,868][123090] Updated weights for policy 1, policy_version 1738471 (0.0008) [2023-12-26 13:34:12,931][123090] Updated weights for policy 1, policy_version 1738481 (0.0008) [2023-12-26 13:34:13,002][123090] Updated weights for policy 1, policy_version 1738491 (0.0007) [2023-12-26 13:34:13,464][123091] Updated weights for policy 0, policy_version 1750262 (0.0008) [2023-12-26 13:34:13,517][123091] Updated weights for policy 0, policy_version 1750272 (0.0010) [2023-12-26 13:34:13,577][123091] Updated weights for policy 0, policy_version 1750282 (0.0010) [2023-12-26 13:34:13,742][123090] Updated weights for policy 1, policy_version 1738501 (0.0006) [2023-12-26 13:34:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 893132800. Throughput: 0: 8960.3, 1: 8612.9. Samples: 893126412. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:34:13,784][121949] Avg episode reward: [(0, '6277.632'), (1, '5734.694')] [2023-12-26 13:34:13,797][123090] Updated weights for policy 1, policy_version 1738511 (0.0007) [2023-12-26 13:34:13,858][123090] Updated weights for policy 1, policy_version 1738521 (0.0009) [2023-12-26 13:34:14,378][123091] Updated weights for policy 0, policy_version 1750292 (0.0010) [2023-12-26 13:34:14,445][123091] Updated weights for policy 0, policy_version 1750302 (0.0009) [2023-12-26 13:34:14,498][123091] Updated weights for policy 0, policy_version 1750312 (0.0009) [2023-12-26 13:34:14,747][123090] Updated weights for policy 1, policy_version 1738531 (0.0008) [2023-12-26 13:34:14,820][123090] Updated weights for policy 1, policy_version 1738541 (0.0006) [2023-12-26 13:34:14,882][123090] Updated weights for policy 1, policy_version 1738551 (0.0005) [2023-12-26 13:34:15,314][123091] Updated weights for policy 0, policy_version 1750322 (0.0007) [2023-12-26 13:34:15,377][123091] Updated weights for policy 0, policy_version 1750332 (0.0008) [2023-12-26 13:34:15,432][123091] Updated weights for policy 0, policy_version 1750342 (0.0010) [2023-12-26 13:34:15,564][123090] Updated weights for policy 1, policy_version 1738561 (0.0006) [2023-12-26 13:34:15,627][123090] Updated weights for policy 1, policy_version 1738571 (0.0010) [2023-12-26 13:34:15,690][123090] Updated weights for policy 1, policy_version 1738581 (0.0011) [2023-12-26 13:34:15,764][123090] Updated weights for policy 1, policy_version 1738591 (0.0010) [2023-12-26 13:34:16,315][123091] Updated weights for policy 0, policy_version 1750353 (0.0010) [2023-12-26 13:34:16,387][123091] Updated weights for policy 0, policy_version 1750363 (0.0010) [2023-12-26 13:34:16,445][123091] Updated weights for policy 0, policy_version 1750373 (0.0009) [2023-12-26 13:34:16,457][123090] Updated weights for policy 1, policy_version 1738601 (0.0008) [2023-12-26 13:34:16,502][123091] Updated weights for policy 0, policy_version 1750383 (0.0007) [2023-12-26 13:34:16,515][123090] Updated weights for policy 1, policy_version 1738611 (0.0010) [2023-12-26 13:34:16,575][123090] Updated weights for policy 1, policy_version 1738621 (0.0010) [2023-12-26 13:34:17,327][123090] Updated weights for policy 1, policy_version 1738631 (0.0007) [2023-12-26 13:34:17,339][123091] Updated weights for policy 0, policy_version 1750393 (0.0008) [2023-12-26 13:34:17,388][123090] Updated weights for policy 1, policy_version 1738641 (0.0006) [2023-12-26 13:34:17,391][123091] Updated weights for policy 0, policy_version 1750403 (0.0005) [2023-12-26 13:34:17,456][123090] Updated weights for policy 1, policy_version 1738651 (0.0006) [2023-12-26 13:34:17,460][123091] Updated weights for policy 0, policy_version 1750413 (0.0005) [2023-12-26 13:34:18,182][123090] Updated weights for policy 1, policy_version 1738661 (0.0006) [2023-12-26 13:34:18,230][123091] Updated weights for policy 0, policy_version 1750423 (0.0009) [2023-12-26 13:34:18,241][123090] Updated weights for policy 1, policy_version 1738671 (0.0008) [2023-12-26 13:34:18,286][123091] Updated weights for policy 0, policy_version 1750433 (0.0011) [2023-12-26 13:34:18,302][123090] Updated weights for policy 1, policy_version 1738681 (0.0006) [2023-12-26 13:34:18,360][123091] Updated weights for policy 0, policy_version 1750443 (0.0012) [2023-12-26 13:34:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 893222912. Throughput: 0: 8889.3, 1: 8661.4. Samples: 893234240. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:34:18,784][121949] Avg episode reward: [(0, '6108.586'), (1, '5820.261')] [2023-12-26 13:34:19,121][123090] Updated weights for policy 1, policy_version 1738691 (0.0008) [2023-12-26 13:34:19,189][123090] Updated weights for policy 1, policy_version 1738701 (0.0011) [2023-12-26 13:34:19,201][123091] Updated weights for policy 0, policy_version 1750453 (0.0008) [2023-12-26 13:34:19,254][123090] Updated weights for policy 1, policy_version 1738711 (0.0011) [2023-12-26 13:34:19,271][123091] Updated weights for policy 0, policy_version 1750463 (0.0009) [2023-12-26 13:34:19,335][123091] Updated weights for policy 0, policy_version 1750473 (0.0009) [2023-12-26 13:34:20,092][123090] Updated weights for policy 1, policy_version 1738721 (0.0010) [2023-12-26 13:34:20,148][123090] Updated weights for policy 1, policy_version 1738731 (0.0008) [2023-12-26 13:34:20,198][123091] Updated weights for policy 0, policy_version 1750483 (0.0009) [2023-12-26 13:34:20,211][123090] Updated weights for policy 1, policy_version 1738741 (0.0008) [2023-12-26 13:34:20,267][123091] Updated weights for policy 0, policy_version 1750493 (0.0008) [2023-12-26 13:34:20,274][123090] Updated weights for policy 1, policy_version 1738751 (0.0008) [2023-12-26 13:34:20,319][123091] Updated weights for policy 0, policy_version 1750503 (0.0005) [2023-12-26 13:34:21,078][123090] Updated weights for policy 1, policy_version 1738761 (0.0009) [2023-12-26 13:34:21,087][123091] Updated weights for policy 0, policy_version 1750513 (0.0006) [2023-12-26 13:34:21,146][123090] Updated weights for policy 1, policy_version 1738771 (0.0009) [2023-12-26 13:34:21,150][123091] Updated weights for policy 0, policy_version 1750523 (0.0008) [2023-12-26 13:34:21,207][123090] Updated weights for policy 1, policy_version 1738781 (0.0008) [2023-12-26 13:34:21,219][123091] Updated weights for policy 0, policy_version 1750533 (0.0008) [2023-12-26 13:34:21,292][123091] Updated weights for policy 0, policy_version 1750543 (0.0008) [2023-12-26 13:34:22,053][123090] Updated weights for policy 1, policy_version 1738791 (0.0009) [2023-12-26 13:34:22,085][123091] Updated weights for policy 0, policy_version 1750553 (0.0007) [2023-12-26 13:34:22,106][123090] Updated weights for policy 1, policy_version 1738801 (0.0011) [2023-12-26 13:34:22,148][123091] Updated weights for policy 0, policy_version 1750563 (0.0011) [2023-12-26 13:34:22,154][123090] Updated weights for policy 1, policy_version 1738811 (0.0011) [2023-12-26 13:34:22,208][123091] Updated weights for policy 0, policy_version 1750573 (0.0011) [2023-12-26 13:34:22,990][123091] Updated weights for policy 0, policy_version 1750583 (0.0007) [2023-12-26 13:34:23,008][123090] Updated weights for policy 1, policy_version 1738821 (0.0011) [2023-12-26 13:34:23,052][123091] Updated weights for policy 0, policy_version 1750593 (0.0005) [2023-12-26 13:34:23,068][123090] Updated weights for policy 1, policy_version 1738831 (0.0011) [2023-12-26 13:34:23,113][123091] Updated weights for policy 0, policy_version 1750603 (0.0009) [2023-12-26 13:34:23,124][123090] Updated weights for policy 1, policy_version 1738841 (0.0011) [2023-12-26 13:34:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 893304832. Throughput: 0: 8805.5, 1: 8637.0. Samples: 893285292. Policy #0 lag: (min: 7.0, avg: 11.4, max: 39.0) [2023-12-26 13:34:23,785][121949] Avg episode reward: [(0, '5983.009'), (1, '5803.572')] [2023-12-26 13:34:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001738848_445145088.pth... [2023-12-26 13:34:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001737856_444891136.pth [2023-12-26 13:34:23,816][123091] Updated weights for policy 0, policy_version 1750613 (0.0008) [2023-12-26 13:34:23,879][123091] Updated weights for policy 0, policy_version 1750623 (0.0005) [2023-12-26 13:34:23,940][123091] Updated weights for policy 0, policy_version 1750633 (0.0010) [2023-12-26 13:34:23,956][123090] Updated weights for policy 1, policy_version 1738851 (0.0009) [2023-12-26 13:34:23,981][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001750640_448167936.pth... [2023-12-26 13:34:23,984][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001749584_447897600.pth [2023-12-26 13:34:24,011][123090] Updated weights for policy 1, policy_version 1738861 (0.0006) [2023-12-26 13:34:24,073][123090] Updated weights for policy 1, policy_version 1738871 (0.0005) [2023-12-26 13:34:24,725][123090] Updated weights for policy 1, policy_version 1738881 (0.0006) [2023-12-26 13:34:24,729][123091] Updated weights for policy 0, policy_version 1750643 (0.0011) [2023-12-26 13:34:24,781][123090] Updated weights for policy 1, policy_version 1738891 (0.0010) [2023-12-26 13:34:24,789][123091] Updated weights for policy 0, policy_version 1750653 (0.0011) [2023-12-26 13:34:24,848][123090] Updated weights for policy 1, policy_version 1738901 (0.0011) [2023-12-26 13:34:24,848][123091] Updated weights for policy 0, policy_version 1750663 (0.0011) [2023-12-26 13:34:24,914][123090] Updated weights for policy 1, policy_version 1738911 (0.0010) [2023-12-26 13:34:25,667][123090] Updated weights for policy 1, policy_version 1738921 (0.0010) [2023-12-26 13:34:25,676][123091] Updated weights for policy 0, policy_version 1750673 (0.0011) [2023-12-26 13:34:25,715][123090] Updated weights for policy 1, policy_version 1738931 (0.0010) [2023-12-26 13:34:25,723][123091] Updated weights for policy 0, policy_version 1750683 (0.0010) [2023-12-26 13:34:25,769][123090] Updated weights for policy 1, policy_version 1738941 (0.0010) [2023-12-26 13:34:25,786][123091] Updated weights for policy 0, policy_version 1750693 (0.0010) [2023-12-26 13:34:25,855][123091] Updated weights for policy 0, policy_version 1750703 (0.0011) [2023-12-26 13:34:26,598][123090] Updated weights for policy 1, policy_version 1738951 (0.0009) [2023-12-26 13:34:26,658][123090] Updated weights for policy 1, policy_version 1738961 (0.0010) [2023-12-26 13:34:26,663][123091] Updated weights for policy 0, policy_version 1750713 (0.0010) [2023-12-26 13:34:26,718][123091] Updated weights for policy 0, policy_version 1750723 (0.0010) [2023-12-26 13:34:26,721][123090] Updated weights for policy 1, policy_version 1738971 (0.0006) [2023-12-26 13:34:26,774][123091] Updated weights for policy 0, policy_version 1750733 (0.0010) [2023-12-26 13:34:27,439][123090] Updated weights for policy 1, policy_version 1738981 (0.0005) [2023-12-26 13:34:27,505][123090] Updated weights for policy 1, policy_version 1738991 (0.0005) [2023-12-26 13:34:27,576][123090] Updated weights for policy 1, policy_version 1739001 (0.0005) [2023-12-26 13:34:27,579][123091] Updated weights for policy 0, policy_version 1750743 (0.0008) [2023-12-26 13:34:27,638][123091] Updated weights for policy 0, policy_version 1750753 (0.0006) [2023-12-26 13:34:27,702][123091] Updated weights for policy 0, policy_version 1750763 (0.0005) [2023-12-26 13:34:28,177][123090] Updated weights for policy 1, policy_version 1739011 (0.0006) [2023-12-26 13:34:28,251][123090] Updated weights for policy 1, policy_version 1739021 (0.0005) [2023-12-26 13:34:28,325][123090] Updated weights for policy 1, policy_version 1739031 (0.0006) [2023-12-26 13:34:28,362][123091] Updated weights for policy 0, policy_version 1750773 (0.0008) [2023-12-26 13:34:28,421][123091] Updated weights for policy 0, policy_version 1750783 (0.0010) [2023-12-26 13:34:28,490][123091] Updated weights for policy 0, policy_version 1750793 (0.0011) [2023-12-26 13:34:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 893403136. Throughput: 0: 8824.0, 1: 8669.5. Samples: 893393584. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:28,785][121949] Avg episode reward: [(0, '6128.268'), (1, '5678.567')] [2023-12-26 13:34:28,960][123090] Updated weights for policy 1, policy_version 1739041 (0.0010) [2023-12-26 13:34:29,026][123090] Updated weights for policy 1, policy_version 1739051 (0.0007) [2023-12-26 13:34:29,108][123090] Updated weights for policy 1, policy_version 1739061 (0.0007) [2023-12-26 13:34:29,182][123090] Updated weights for policy 1, policy_version 1739071 (0.0009) [2023-12-26 13:34:29,241][123091] Updated weights for policy 0, policy_version 1750803 (0.0010) [2023-12-26 13:34:29,309][123091] Updated weights for policy 0, policy_version 1750813 (0.0005) [2023-12-26 13:34:29,379][123091] Updated weights for policy 0, policy_version 1750823 (0.0008) [2023-12-26 13:34:29,926][123090] Updated weights for policy 1, policy_version 1739081 (0.0006) [2023-12-26 13:34:29,997][123090] Updated weights for policy 1, policy_version 1739091 (0.0010) [2023-12-26 13:34:30,061][123090] Updated weights for policy 1, policy_version 1739101 (0.0008) [2023-12-26 13:34:30,198][123091] Updated weights for policy 0, policy_version 1750833 (0.0010) [2023-12-26 13:34:30,266][123091] Updated weights for policy 0, policy_version 1750843 (0.0009) [2023-12-26 13:34:30,332][123091] Updated weights for policy 0, policy_version 1750853 (0.0010) [2023-12-26 13:34:30,402][123091] Updated weights for policy 0, policy_version 1750863 (0.0009) [2023-12-26 13:34:30,778][123090] Updated weights for policy 1, policy_version 1739111 (0.0009) [2023-12-26 13:34:30,842][123090] Updated weights for policy 1, policy_version 1739121 (0.0006) [2023-12-26 13:34:30,894][123090] Updated weights for policy 1, policy_version 1739131 (0.0005) [2023-12-26 13:34:31,273][123091] Updated weights for policy 0, policy_version 1750873 (0.0009) [2023-12-26 13:34:31,325][123091] Updated weights for policy 0, policy_version 1750883 (0.0006) [2023-12-26 13:34:31,408][123091] Updated weights for policy 0, policy_version 1750893 (0.0011) [2023-12-26 13:34:31,573][123090] Updated weights for policy 1, policy_version 1739141 (0.0007) [2023-12-26 13:34:31,632][123090] Updated weights for policy 1, policy_version 1739151 (0.0009) [2023-12-26 13:34:31,698][123090] Updated weights for policy 1, policy_version 1739161 (0.0009) [2023-12-26 13:34:32,252][123091] Updated weights for policy 0, policy_version 1750903 (0.0010) [2023-12-26 13:34:32,300][123091] Updated weights for policy 0, policy_version 1750913 (0.0005) [2023-12-26 13:34:32,359][123091] Updated weights for policy 0, policy_version 1750923 (0.0009) [2023-12-26 13:34:32,555][123090] Updated weights for policy 1, policy_version 1739171 (0.0010) [2023-12-26 13:34:32,611][123090] Updated weights for policy 1, policy_version 1739181 (0.0010) [2023-12-26 13:34:32,665][123090] Updated weights for policy 1, policy_version 1739191 (0.0010) [2023-12-26 13:34:33,158][123091] Updated weights for policy 0, policy_version 1750933 (0.0010) [2023-12-26 13:34:33,230][123091] Updated weights for policy 0, policy_version 1750943 (0.0009) [2023-12-26 13:34:33,281][123091] Updated weights for policy 0, policy_version 1750953 (0.0009) [2023-12-26 13:34:33,510][123090] Updated weights for policy 1, policy_version 1739201 (0.0009) [2023-12-26 13:34:33,578][123090] Updated weights for policy 1, policy_version 1739211 (0.0005) [2023-12-26 13:34:33,624][123090] Updated weights for policy 1, policy_version 1739221 (0.0005) [2023-12-26 13:34:33,669][123090] Updated weights for policy 1, policy_version 1739231 (0.0005) [2023-12-26 13:34:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 893493248. Throughput: 0: 8818.3, 1: 8706.4. Samples: 893501904. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:33,785][121949] Avg episode reward: [(0, '6137.692'), (1, '5752.804')] [2023-12-26 13:34:34,083][123091] Updated weights for policy 0, policy_version 1750963 (0.0007) [2023-12-26 13:34:34,142][123091] Updated weights for policy 0, policy_version 1750973 (0.0006) [2023-12-26 13:34:34,204][123091] Updated weights for policy 0, policy_version 1750983 (0.0008) [2023-12-26 13:34:34,451][123090] Updated weights for policy 1, policy_version 1739241 (0.0010) [2023-12-26 13:34:34,511][123090] Updated weights for policy 1, policy_version 1739251 (0.0010) [2023-12-26 13:34:34,566][123090] Updated weights for policy 1, policy_version 1739261 (0.0010) [2023-12-26 13:34:35,022][123091] Updated weights for policy 0, policy_version 1750993 (0.0008) [2023-12-26 13:34:35,075][123091] Updated weights for policy 0, policy_version 1751003 (0.0010) [2023-12-26 13:34:35,135][123091] Updated weights for policy 0, policy_version 1751013 (0.0009) [2023-12-26 13:34:35,198][123091] Updated weights for policy 0, policy_version 1751023 (0.0010) [2023-12-26 13:34:35,382][123090] Updated weights for policy 1, policy_version 1739271 (0.0010) [2023-12-26 13:34:35,440][123090] Updated weights for policy 1, policy_version 1739281 (0.0010) [2023-12-26 13:34:35,496][123090] Updated weights for policy 1, policy_version 1739291 (0.0009) [2023-12-26 13:34:35,971][123091] Updated weights for policy 0, policy_version 1751033 (0.0007) [2023-12-26 13:34:36,048][123091] Updated weights for policy 0, policy_version 1751043 (0.0010) [2023-12-26 13:34:36,126][123091] Updated weights for policy 0, policy_version 1751053 (0.0009) [2023-12-26 13:34:36,359][123090] Updated weights for policy 1, policy_version 1739301 (0.0010) [2023-12-26 13:34:36,423][123090] Updated weights for policy 1, policy_version 1739311 (0.0009) [2023-12-26 13:34:36,489][123090] Updated weights for policy 1, policy_version 1739321 (0.0010) [2023-12-26 13:34:36,927][123091] Updated weights for policy 0, policy_version 1751063 (0.0008) [2023-12-26 13:34:36,996][123091] Updated weights for policy 0, policy_version 1751073 (0.0009) [2023-12-26 13:34:37,065][123091] Updated weights for policy 0, policy_version 1751083 (0.0009) [2023-12-26 13:34:37,313][123090] Updated weights for policy 1, policy_version 1739331 (0.0010) [2023-12-26 13:34:37,385][123090] Updated weights for policy 1, policy_version 1739341 (0.0007) [2023-12-26 13:34:37,460][123090] Updated weights for policy 1, policy_version 1739351 (0.0009) [2023-12-26 13:34:37,811][123091] Updated weights for policy 0, policy_version 1751093 (0.0010) [2023-12-26 13:34:37,877][123091] Updated weights for policy 0, policy_version 1751103 (0.0010) [2023-12-26 13:34:37,936][123091] Updated weights for policy 0, policy_version 1751113 (0.0010) [2023-12-26 13:34:38,279][123090] Updated weights for policy 1, policy_version 1739361 (0.0011) [2023-12-26 13:34:38,355][123090] Updated weights for policy 1, policy_version 1739371 (0.0011) [2023-12-26 13:34:38,419][123090] Updated weights for policy 1, policy_version 1739381 (0.0011) [2023-12-26 13:34:38,486][123090] Updated weights for policy 1, policy_version 1739391 (0.0011) [2023-12-26 13:34:38,663][123091] Updated weights for policy 0, policy_version 1751123 (0.0010) [2023-12-26 13:34:38,735][123091] Updated weights for policy 0, policy_version 1751133 (0.0009) [2023-12-26 13:34:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 893575168. Throughput: 0: 8811.6, 1: 8742.0. Samples: 893554232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:38,785][121949] Avg episode reward: [(0, '6061.447'), (1, '5878.933')] [2023-12-26 13:34:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001739392_445284352.pth... [2023-12-26 13:34:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001738336_445014016.pth [2023-12-26 13:34:38,808][123091] Updated weights for policy 0, policy_version 1751143 (0.0008) [2023-12-26 13:34:38,866][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001751152_448299008.pth... [2023-12-26 13:34:38,872][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001750128_448036864.pth [2023-12-26 13:34:39,301][123090] Updated weights for policy 1, policy_version 1739401 (0.0011) [2023-12-26 13:34:39,373][123090] Updated weights for policy 1, policy_version 1739411 (0.0009) [2023-12-26 13:34:39,446][123090] Updated weights for policy 1, policy_version 1739421 (0.0008) [2023-12-26 13:34:39,538][123091] Updated weights for policy 0, policy_version 1751153 (0.0008) [2023-12-26 13:34:39,609][123091] Updated weights for policy 0, policy_version 1751163 (0.0009) [2023-12-26 13:34:39,675][123091] Updated weights for policy 0, policy_version 1751173 (0.0009) [2023-12-26 13:34:39,744][123091] Updated weights for policy 0, policy_version 1751183 (0.0010) [2023-12-26 13:34:40,218][123090] Updated weights for policy 1, policy_version 1739431 (0.0009) [2023-12-26 13:34:40,286][123090] Updated weights for policy 1, policy_version 1739441 (0.0009) [2023-12-26 13:34:40,355][123090] Updated weights for policy 1, policy_version 1739451 (0.0010) [2023-12-26 13:34:40,536][123091] Updated weights for policy 0, policy_version 1751193 (0.0010) [2023-12-26 13:34:40,599][123091] Updated weights for policy 0, policy_version 1751203 (0.0010) [2023-12-26 13:34:40,662][123091] Updated weights for policy 0, policy_version 1751213 (0.0010) [2023-12-26 13:34:41,190][123090] Updated weights for policy 1, policy_version 1739461 (0.0010) [2023-12-26 13:34:41,241][123090] Updated weights for policy 1, policy_version 1739471 (0.0012) [2023-12-26 13:34:41,313][123090] Updated weights for policy 1, policy_version 1739481 (0.0012) [2023-12-26 13:34:41,521][123091] Updated weights for policy 0, policy_version 1751223 (0.0009) [2023-12-26 13:34:41,585][123091] Updated weights for policy 0, policy_version 1751233 (0.0009) [2023-12-26 13:34:41,651][123091] Updated weights for policy 0, policy_version 1751243 (0.0010) [2023-12-26 13:34:42,186][123090] Updated weights for policy 1, policy_version 1739491 (0.0009) [2023-12-26 13:34:42,254][123090] Updated weights for policy 1, policy_version 1739501 (0.0009) [2023-12-26 13:34:42,310][123091] Updated weights for policy 0, policy_version 1751253 (0.0008) [2023-12-26 13:34:42,320][123090] Updated weights for policy 1, policy_version 1739511 (0.0009) [2023-12-26 13:34:42,379][123091] Updated weights for policy 0, policy_version 1751263 (0.0009) [2023-12-26 13:34:42,435][123091] Updated weights for policy 0, policy_version 1751273 (0.0009) [2023-12-26 13:34:43,176][123090] Updated weights for policy 1, policy_version 1739521 (0.0009) [2023-12-26 13:34:43,229][123090] Updated weights for policy 1, policy_version 1739531 (0.0010) [2023-12-26 13:34:43,269][123091] Updated weights for policy 0, policy_version 1751283 (0.0010) [2023-12-26 13:34:43,280][123090] Updated weights for policy 1, policy_version 1739541 (0.0008) [2023-12-26 13:34:43,327][123091] Updated weights for policy 0, policy_version 1751293 (0.0008) [2023-12-26 13:34:43,329][123090] Updated weights for policy 1, policy_version 1739551 (0.0008) [2023-12-26 13:34:43,390][123091] Updated weights for policy 0, policy_version 1751303 (0.0008) [2023-12-26 13:34:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 893665280. Throughput: 0: 8816.8, 1: 8739.4. Samples: 893658108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:43,785][121949] Avg episode reward: [(0, '5957.186'), (1, '5692.149')] [2023-12-26 13:34:44,183][123091] Updated weights for policy 0, policy_version 1751313 (0.0008) [2023-12-26 13:34:44,190][123090] Updated weights for policy 1, policy_version 1739561 (0.0009) [2023-12-26 13:34:44,248][123090] Updated weights for policy 1, policy_version 1739571 (0.0009) [2023-12-26 13:34:44,248][123091] Updated weights for policy 0, policy_version 1751323 (0.0008) [2023-12-26 13:34:44,297][123091] Updated weights for policy 0, policy_version 1751333 (0.0009) [2023-12-26 13:34:44,316][123090] Updated weights for policy 1, policy_version 1739581 (0.0008) [2023-12-26 13:34:44,357][123091] Updated weights for policy 0, policy_version 1751343 (0.0008) [2023-12-26 13:34:45,134][123090] Updated weights for policy 1, policy_version 1739591 (0.0009) [2023-12-26 13:34:45,205][123090] Updated weights for policy 1, policy_version 1739601 (0.0010) [2023-12-26 13:34:45,229][123091] Updated weights for policy 0, policy_version 1751353 (0.0009) [2023-12-26 13:34:45,269][123090] Updated weights for policy 1, policy_version 1739611 (0.0010) [2023-12-26 13:34:45,294][123091] Updated weights for policy 0, policy_version 1751363 (0.0006) [2023-12-26 13:34:45,357][123091] Updated weights for policy 0, policy_version 1751373 (0.0009) [2023-12-26 13:34:46,057][123090] Updated weights for policy 1, policy_version 1739621 (0.0009) [2023-12-26 13:34:46,112][123090] Updated weights for policy 1, policy_version 1739631 (0.0009) [2023-12-26 13:34:46,172][123090] Updated weights for policy 1, policy_version 1739641 (0.0009) [2023-12-26 13:34:46,192][123091] Updated weights for policy 0, policy_version 1751383 (0.0007) [2023-12-26 13:34:46,240][123091] Updated weights for policy 0, policy_version 1751393 (0.0005) [2023-12-26 13:34:46,300][123091] Updated weights for policy 0, policy_version 1751403 (0.0005) [2023-12-26 13:34:46,985][123091] Updated weights for policy 0, policy_version 1751413 (0.0007) [2023-12-26 13:34:47,037][123091] Updated weights for policy 0, policy_version 1751423 (0.0009) [2023-12-26 13:34:47,050][123090] Updated weights for policy 1, policy_version 1739651 (0.0009) [2023-12-26 13:34:47,095][123091] Updated weights for policy 0, policy_version 1751433 (0.0010) [2023-12-26 13:34:47,104][123090] Updated weights for policy 1, policy_version 1739661 (0.0007) [2023-12-26 13:34:47,163][123090] Updated weights for policy 1, policy_version 1739671 (0.0007) [2023-12-26 13:34:47,850][123091] Updated weights for policy 0, policy_version 1751443 (0.0009) [2023-12-26 13:34:47,910][123091] Updated weights for policy 0, policy_version 1751453 (0.0007) [2023-12-26 13:34:47,963][123091] Updated weights for policy 0, policy_version 1751463 (0.0009) [2023-12-26 13:34:48,026][123090] Updated weights for policy 1, policy_version 1739681 (0.0010) [2023-12-26 13:34:48,097][123090] Updated weights for policy 1, policy_version 1739691 (0.0009) [2023-12-26 13:34:48,157][123090] Updated weights for policy 1, policy_version 1739701 (0.0010) [2023-12-26 13:34:48,216][123090] Updated weights for policy 1, policy_version 1739711 (0.0009) [2023-12-26 13:34:48,764][123091] Updated weights for policy 0, policy_version 1751473 (0.0009) [2023-12-26 13:34:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 893747200. Throughput: 0: 8826.0, 1: 8713.9. Samples: 893762420. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:48,785][121949] Avg episode reward: [(0, '6086.959'), (1, '5489.524')] [2023-12-26 13:34:48,824][123091] Updated weights for policy 0, policy_version 1751483 (0.0010) [2023-12-26 13:34:48,890][123091] Updated weights for policy 0, policy_version 1751494 (0.0010) [2023-12-26 13:34:48,942][123091] Updated weights for policy 0, policy_version 1751504 (0.0010) [2023-12-26 13:34:49,029][123090] Updated weights for policy 1, policy_version 1739721 (0.0010) [2023-12-26 13:34:49,086][123090] Updated weights for policy 1, policy_version 1739731 (0.0010) [2023-12-26 13:34:49,140][123090] Updated weights for policy 1, policy_version 1739741 (0.0009) [2023-12-26 13:34:49,819][123091] Updated weights for policy 0, policy_version 1751514 (0.0009) [2023-12-26 13:34:49,885][123091] Updated weights for policy 0, policy_version 1751524 (0.0010) [2023-12-26 13:34:49,951][123091] Updated weights for policy 0, policy_version 1751534 (0.0009) [2023-12-26 13:34:49,978][123090] Updated weights for policy 1, policy_version 1739751 (0.0009) [2023-12-26 13:34:50,037][123090] Updated weights for policy 1, policy_version 1739762 (0.0010) [2023-12-26 13:34:50,095][123090] Updated weights for policy 1, policy_version 1739772 (0.0009) [2023-12-26 13:34:50,736][123091] Updated weights for policy 0, policy_version 1751544 (0.0009) [2023-12-26 13:34:50,798][123091] Updated weights for policy 0, policy_version 1751554 (0.0009) [2023-12-26 13:34:50,867][123091] Updated weights for policy 0, policy_version 1751564 (0.0011) [2023-12-26 13:34:50,995][123090] Updated weights for policy 1, policy_version 1739782 (0.0009) [2023-12-26 13:34:51,065][123090] Updated weights for policy 1, policy_version 1739792 (0.0010) [2023-12-26 13:34:51,127][123090] Updated weights for policy 1, policy_version 1739802 (0.0009) [2023-12-26 13:34:51,783][123091] Updated weights for policy 0, policy_version 1751574 (0.0009) [2023-12-26 13:34:51,841][123091] Updated weights for policy 0, policy_version 1751584 (0.0009) [2023-12-26 13:34:51,895][123091] Updated weights for policy 0, policy_version 1751594 (0.0009) [2023-12-26 13:34:52,025][123090] Updated weights for policy 1, policy_version 1739812 (0.0010) [2023-12-26 13:34:52,076][123090] Updated weights for policy 1, policy_version 1739822 (0.0009) [2023-12-26 13:34:52,126][123090] Updated weights for policy 1, policy_version 1739832 (0.0009) [2023-12-26 13:34:52,754][123091] Updated weights for policy 0, policy_version 1751604 (0.0007) [2023-12-26 13:34:52,803][123091] Updated weights for policy 0, policy_version 1751614 (0.0007) [2023-12-26 13:34:52,859][123091] Updated weights for policy 0, policy_version 1751626 (0.0011) [2023-12-26 13:34:52,971][123090] Updated weights for policy 1, policy_version 1739842 (0.0009) [2023-12-26 13:34:53,038][123090] Updated weights for policy 1, policy_version 1739852 (0.0009) [2023-12-26 13:34:53,100][123090] Updated weights for policy 1, policy_version 1739862 (0.0009) [2023-12-26 13:34:53,157][123090] Updated weights for policy 1, policy_version 1739872 (0.0009) [2023-12-26 13:34:53,720][123091] Updated weights for policy 0, policy_version 1751637 (0.0011) [2023-12-26 13:34:53,782][123091] Updated weights for policy 0, policy_version 1751647 (0.0010) [2023-12-26 13:34:53,785][121949] Fps is (10 sec: 16383.4, 60 sec: 17339.6, 300 sec: 17661.4). Total num frames: 893829120. Throughput: 0: 8801.4, 1: 8703.9. Samples: 893811960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:53,786][121949] Avg episode reward: [(0, '6283.991'), (1, '5719.496')] [2023-12-26 13:34:53,837][123091] Updated weights for policy 0, policy_version 1751657 (0.0011) [2023-12-26 13:34:53,859][123090] Updated weights for policy 1, policy_version 1739882 (0.0006) [2023-12-26 13:34:53,871][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001751664_448430080.pth... [2023-12-26 13:34:53,875][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001750640_448167936.pth [2023-12-26 13:34:53,927][123090] Updated weights for policy 1, policy_version 1739892 (0.0007) [2023-12-26 13:34:53,987][123090] Updated weights for policy 1, policy_version 1739902 (0.0009) [2023-12-26 13:34:53,997][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001739904_445415424.pth... [2023-12-26 13:34:54,002][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001738848_445145088.pth [2023-12-26 13:34:54,655][123091] Updated weights for policy 0, policy_version 1751667 (0.0011) [2023-12-26 13:34:54,720][123091] Updated weights for policy 0, policy_version 1751677 (0.0010) [2023-12-26 13:34:54,748][123090] Updated weights for policy 1, policy_version 1739912 (0.0006) [2023-12-26 13:34:54,776][123091] Updated weights for policy 0, policy_version 1751687 (0.0010) [2023-12-26 13:34:54,807][123090] Updated weights for policy 1, policy_version 1739922 (0.0006) [2023-12-26 13:34:54,857][123090] Updated weights for policy 1, policy_version 1739932 (0.0008) [2023-12-26 13:34:55,613][123091] Updated weights for policy 0, policy_version 1751697 (0.0011) [2023-12-26 13:34:55,637][123090] Updated weights for policy 1, policy_version 1739942 (0.0007) [2023-12-26 13:34:55,673][123091] Updated weights for policy 0, policy_version 1751707 (0.0011) [2023-12-26 13:34:55,689][123090] Updated weights for policy 1, policy_version 1739952 (0.0007) [2023-12-26 13:34:55,726][123091] Updated weights for policy 0, policy_version 1751717 (0.0010) [2023-12-26 13:34:55,743][123090] Updated weights for policy 1, policy_version 1739962 (0.0007) [2023-12-26 13:34:55,784][123091] Updated weights for policy 0, policy_version 1751727 (0.0005) [2023-12-26 13:34:56,517][123091] Updated weights for policy 0, policy_version 1751737 (0.0010) [2023-12-26 13:34:56,565][123091] Updated weights for policy 0, policy_version 1751747 (0.0010) [2023-12-26 13:34:56,612][123091] Updated weights for policy 0, policy_version 1751757 (0.0010) [2023-12-26 13:34:56,636][123090] Updated weights for policy 1, policy_version 1739972 (0.0008) [2023-12-26 13:34:56,692][123090] Updated weights for policy 1, policy_version 1739982 (0.0006) [2023-12-26 13:34:56,743][123090] Updated weights for policy 1, policy_version 1739992 (0.0009) [2023-12-26 13:34:57,448][123091] Updated weights for policy 0, policy_version 1751767 (0.0010) [2023-12-26 13:34:57,478][123090] Updated weights for policy 1, policy_version 1740002 (0.0008) [2023-12-26 13:34:57,511][123091] Updated weights for policy 0, policy_version 1751777 (0.0011) [2023-12-26 13:34:57,538][123090] Updated weights for policy 1, policy_version 1740012 (0.0007) [2023-12-26 13:34:57,569][123091] Updated weights for policy 0, policy_version 1751787 (0.0010) [2023-12-26 13:34:57,596][123090] Updated weights for policy 1, policy_version 1740022 (0.0010) [2023-12-26 13:34:57,650][123090] Updated weights for policy 1, policy_version 1740032 (0.0010) [2023-12-26 13:34:58,301][123091] Updated weights for policy 0, policy_version 1751797 (0.0009) [2023-12-26 13:34:58,369][123091] Updated weights for policy 0, policy_version 1751807 (0.0010) [2023-12-26 13:34:58,432][123091] Updated weights for policy 0, policy_version 1751817 (0.0011) [2023-12-26 13:34:58,515][123090] Updated weights for policy 1, policy_version 1740042 (0.0009) [2023-12-26 13:34:58,582][123090] Updated weights for policy 1, policy_version 1740052 (0.0008) [2023-12-26 13:34:58,655][123090] Updated weights for policy 1, policy_version 1740062 (0.0008) [2023-12-26 13:34:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 893927424. Throughput: 0: 8769.3, 1: 8801.3. Samples: 893917092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:34:58,784][121949] Avg episode reward: [(0, '6223.627'), (1, '5740.076')] [2023-12-26 13:34:59,240][123091] Updated weights for policy 0, policy_version 1751827 (0.0009) [2023-12-26 13:34:59,315][123091] Updated weights for policy 0, policy_version 1751837 (0.0006) [2023-12-26 13:34:59,386][123091] Updated weights for policy 0, policy_version 1751847 (0.0010) [2023-12-26 13:34:59,440][123090] Updated weights for policy 1, policy_version 1740072 (0.0006) [2023-12-26 13:34:59,488][123090] Updated weights for policy 1, policy_version 1740082 (0.0009) [2023-12-26 13:34:59,537][123090] Updated weights for policy 1, policy_version 1740092 (0.0009) [2023-12-26 13:35:00,135][123091] Updated weights for policy 0, policy_version 1751857 (0.0010) [2023-12-26 13:35:00,202][123091] Updated weights for policy 0, policy_version 1751867 (0.0006) [2023-12-26 13:35:00,274][123091] Updated weights for policy 0, policy_version 1751877 (0.0008) [2023-12-26 13:35:00,345][123091] Updated weights for policy 0, policy_version 1751887 (0.0007) [2023-12-26 13:35:00,451][123090] Updated weights for policy 1, policy_version 1740102 (0.0009) [2023-12-26 13:35:00,506][123090] Updated weights for policy 1, policy_version 1740112 (0.0010) [2023-12-26 13:35:00,564][123090] Updated weights for policy 1, policy_version 1740122 (0.0010) [2023-12-26 13:35:01,073][123091] Updated weights for policy 0, policy_version 1751897 (0.0010) [2023-12-26 13:35:01,140][123091] Updated weights for policy 0, policy_version 1751907 (0.0011) [2023-12-26 13:35:01,203][123091] Updated weights for policy 0, policy_version 1751917 (0.0008) [2023-12-26 13:35:01,326][123090] Updated weights for policy 1, policy_version 1740132 (0.0010) [2023-12-26 13:35:01,390][123090] Updated weights for policy 1, policy_version 1740142 (0.0009) [2023-12-26 13:35:01,439][123090] Updated weights for policy 1, policy_version 1740152 (0.0009) [2023-12-26 13:35:02,029][123091] Updated weights for policy 0, policy_version 1751927 (0.0005) [2023-12-26 13:35:02,100][123091] Updated weights for policy 0, policy_version 1751937 (0.0009) [2023-12-26 13:35:02,168][123091] Updated weights for policy 0, policy_version 1751947 (0.0010) [2023-12-26 13:35:02,274][123090] Updated weights for policy 1, policy_version 1740162 (0.0009) [2023-12-26 13:35:02,338][123090] Updated weights for policy 1, policy_version 1740172 (0.0009) [2023-12-26 13:35:02,410][123090] Updated weights for policy 1, policy_version 1740182 (0.0009) [2023-12-26 13:35:02,477][123090] Updated weights for policy 1, policy_version 1740192 (0.0009) [2023-12-26 13:35:02,947][123091] Updated weights for policy 0, policy_version 1751957 (0.0010) [2023-12-26 13:35:03,013][123091] Updated weights for policy 0, policy_version 1751967 (0.0010) [2023-12-26 13:35:03,068][123091] Updated weights for policy 0, policy_version 1751977 (0.0009) [2023-12-26 13:35:03,265][123090] Updated weights for policy 1, policy_version 1740202 (0.0005) [2023-12-26 13:35:03,327][123090] Updated weights for policy 1, policy_version 1740212 (0.0005) [2023-12-26 13:35:03,383][123090] Updated weights for policy 1, policy_version 1740222 (0.0005) [2023-12-26 13:35:03,764][123091] Updated weights for policy 0, policy_version 1751987 (0.0008) [2023-12-26 13:35:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 894009344. Throughput: 0: 8799.6, 1: 8742.0. Samples: 894023616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:03,785][121949] Avg episode reward: [(0, '6006.201'), (1, '5617.403')] [2023-12-26 13:35:03,819][123091] Updated weights for policy 0, policy_version 1751997 (0.0005) [2023-12-26 13:35:03,887][123091] Updated weights for policy 0, policy_version 1752007 (0.0009) [2023-12-26 13:35:04,036][123090] Updated weights for policy 1, policy_version 1740232 (0.0005) [2023-12-26 13:35:04,111][123090] Updated weights for policy 1, policy_version 1740242 (0.0007) [2023-12-26 13:35:04,178][123090] Updated weights for policy 1, policy_version 1740252 (0.0010) [2023-12-26 13:35:04,710][123091] Updated weights for policy 0, policy_version 1752017 (0.0010) [2023-12-26 13:35:04,767][123091] Updated weights for policy 0, policy_version 1752027 (0.0005) [2023-12-26 13:35:04,818][123091] Updated weights for policy 0, policy_version 1752037 (0.0005) [2023-12-26 13:35:04,869][123091] Updated weights for policy 0, policy_version 1752047 (0.0005) [2023-12-26 13:35:04,904][123090] Updated weights for policy 1, policy_version 1740262 (0.0010) [2023-12-26 13:35:04,964][123090] Updated weights for policy 1, policy_version 1740272 (0.0007) [2023-12-26 13:35:05,023][123090] Updated weights for policy 1, policy_version 1740282 (0.0006) [2023-12-26 13:35:05,528][123091] Updated weights for policy 0, policy_version 1752057 (0.0005) [2023-12-26 13:35:05,581][123091] Updated weights for policy 0, policy_version 1752067 (0.0005) [2023-12-26 13:35:05,638][123091] Updated weights for policy 0, policy_version 1752077 (0.0005) [2023-12-26 13:35:05,654][123090] Updated weights for policy 1, policy_version 1740292 (0.0005) [2023-12-26 13:35:05,709][123090] Updated weights for policy 1, policy_version 1740302 (0.0005) [2023-12-26 13:35:05,769][123090] Updated weights for policy 1, policy_version 1740312 (0.0005) [2023-12-26 13:35:06,431][123091] Updated weights for policy 0, policy_version 1752087 (0.0009) [2023-12-26 13:35:06,499][123091] Updated weights for policy 0, policy_version 1752097 (0.0010) [2023-12-26 13:35:06,517][123090] Updated weights for policy 1, policy_version 1740322 (0.0005) [2023-12-26 13:35:06,557][123091] Updated weights for policy 0, policy_version 1752107 (0.0008) [2023-12-26 13:35:06,573][123090] Updated weights for policy 1, policy_version 1740332 (0.0009) [2023-12-26 13:35:06,625][123090] Updated weights for policy 1, policy_version 1740342 (0.0009) [2023-12-26 13:35:06,675][123090] Updated weights for policy 1, policy_version 1740352 (0.0009) [2023-12-26 13:35:07,401][123091] Updated weights for policy 0, policy_version 1752117 (0.0009) [2023-12-26 13:35:07,448][123091] Updated weights for policy 0, policy_version 1752127 (0.0009) [2023-12-26 13:35:07,503][123091] Updated weights for policy 0, policy_version 1752137 (0.0008) [2023-12-26 13:35:07,533][123090] Updated weights for policy 1, policy_version 1740362 (0.0009) [2023-12-26 13:35:07,583][123090] Updated weights for policy 1, policy_version 1740372 (0.0009) [2023-12-26 13:35:07,634][123090] Updated weights for policy 1, policy_version 1740382 (0.0009) [2023-12-26 13:35:08,286][123091] Updated weights for policy 0, policy_version 1752147 (0.0007) [2023-12-26 13:35:08,357][123091] Updated weights for policy 0, policy_version 1752157 (0.0008) [2023-12-26 13:35:08,369][123090] Updated weights for policy 1, policy_version 1740392 (0.0007) [2023-12-26 13:35:08,422][123091] Updated weights for policy 0, policy_version 1752167 (0.0009) [2023-12-26 13:35:08,434][123090] Updated weights for policy 1, policy_version 1740402 (0.0006) [2023-12-26 13:35:08,489][123090] Updated weights for policy 1, policy_version 1740412 (0.0006) [2023-12-26 13:35:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 894107648. Throughput: 0: 8856.7, 1: 8815.5. Samples: 894080544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:08,785][121949] Avg episode reward: [(0, '6122.639'), (1, '5669.436')] [2023-12-26 13:35:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001752176_448561152.pth... [2023-12-26 13:35:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001740416_445546496.pth... [2023-12-26 13:35:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001751152_448299008.pth [2023-12-26 13:35:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001739392_445284352.pth [2023-12-26 13:35:09,170][123091] Updated weights for policy 0, policy_version 1752177 (0.0009) [2023-12-26 13:35:09,247][123091] Updated weights for policy 0, policy_version 1752187 (0.0007) [2023-12-26 13:35:09,251][123090] Updated weights for policy 1, policy_version 1740422 (0.0007) [2023-12-26 13:35:09,303][123091] Updated weights for policy 0, policy_version 1752197 (0.0006) [2023-12-26 13:35:09,316][123090] Updated weights for policy 1, policy_version 1740432 (0.0009) [2023-12-26 13:35:09,367][123091] Updated weights for policy 0, policy_version 1752207 (0.0008) [2023-12-26 13:35:09,390][123090] Updated weights for policy 1, policy_version 1740442 (0.0008) [2023-12-26 13:35:10,187][123091] Updated weights for policy 0, policy_version 1752217 (0.0008) [2023-12-26 13:35:10,212][123090] Updated weights for policy 1, policy_version 1740452 (0.0009) [2023-12-26 13:35:10,241][123091] Updated weights for policy 0, policy_version 1752227 (0.0006) [2023-12-26 13:35:10,281][123090] Updated weights for policy 1, policy_version 1740462 (0.0010) [2023-12-26 13:35:10,292][123091] Updated weights for policy 0, policy_version 1752237 (0.0007) [2023-12-26 13:35:10,352][123090] Updated weights for policy 1, policy_version 1740472 (0.0009) [2023-12-26 13:35:11,150][123091] Updated weights for policy 0, policy_version 1752247 (0.0009) [2023-12-26 13:35:11,215][123091] Updated weights for policy 0, policy_version 1752257 (0.0009) [2023-12-26 13:35:11,243][123090] Updated weights for policy 1, policy_version 1740482 (0.0009) [2023-12-26 13:35:11,279][123091] Updated weights for policy 0, policy_version 1752267 (0.0009) [2023-12-26 13:35:11,309][123090] Updated weights for policy 1, policy_version 1740492 (0.0008) [2023-12-26 13:35:11,378][123090] Updated weights for policy 1, policy_version 1740502 (0.0008) [2023-12-26 13:35:11,440][123090] Updated weights for policy 1, policy_version 1740512 (0.0006) [2023-12-26 13:35:12,131][123091] Updated weights for policy 0, policy_version 1752277 (0.0009) [2023-12-26 13:35:12,180][123091] Updated weights for policy 0, policy_version 1752287 (0.0009) [2023-12-26 13:35:12,228][123091] Updated weights for policy 0, policy_version 1752297 (0.0009) [2023-12-26 13:35:12,352][123090] Updated weights for policy 1, policy_version 1740522 (0.0010) [2023-12-26 13:35:12,424][123090] Updated weights for policy 1, policy_version 1740532 (0.0010) [2023-12-26 13:35:12,491][123090] Updated weights for policy 1, policy_version 1740542 (0.0010) [2023-12-26 13:35:12,972][123091] Updated weights for policy 0, policy_version 1752307 (0.0009) [2023-12-26 13:35:13,025][123091] Updated weights for policy 0, policy_version 1752317 (0.0008) [2023-12-26 13:35:13,086][123091] Updated weights for policy 0, policy_version 1752327 (0.0006) [2023-12-26 13:35:13,375][123090] Updated weights for policy 1, policy_version 1740552 (0.0010) [2023-12-26 13:35:13,432][123090] Updated weights for policy 1, policy_version 1740562 (0.0009) [2023-12-26 13:35:13,499][123090] Updated weights for policy 1, policy_version 1740572 (0.0010) [2023-12-26 13:35:13,727][123091] Updated weights for policy 0, policy_version 1752337 (0.0005) [2023-12-26 13:35:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 894189568. Throughput: 0: 8822.9, 1: 8744.0. Samples: 894184100. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:13,786][121949] Avg episode reward: [(0, '6190.117'), (1, '5797.654')] [2023-12-26 13:35:13,792][123091] Updated weights for policy 0, policy_version 1752347 (0.0005) [2023-12-26 13:35:13,862][123091] Updated weights for policy 0, policy_version 1752357 (0.0005) [2023-12-26 13:35:13,928][123091] Updated weights for policy 0, policy_version 1752367 (0.0005) [2023-12-26 13:35:14,325][123090] Updated weights for policy 1, policy_version 1740582 (0.0007) [2023-12-26 13:35:14,403][123090] Updated weights for policy 1, policy_version 1740592 (0.0008) [2023-12-26 13:35:14,468][123090] Updated weights for policy 1, policy_version 1740602 (0.0009) [2023-12-26 13:35:14,549][123091] Updated weights for policy 0, policy_version 1752377 (0.0008) [2023-12-26 13:35:14,606][123091] Updated weights for policy 0, policy_version 1752387 (0.0008) [2023-12-26 13:35:14,670][123091] Updated weights for policy 0, policy_version 1752397 (0.0008) [2023-12-26 13:35:15,271][123090] Updated weights for policy 1, policy_version 1740612 (0.0010) [2023-12-26 13:35:15,347][123090] Updated weights for policy 1, policy_version 1740622 (0.0010) [2023-12-26 13:35:15,420][123090] Updated weights for policy 1, policy_version 1740632 (0.0010) [2023-12-26 13:35:15,458][123091] Updated weights for policy 0, policy_version 1752407 (0.0007) [2023-12-26 13:35:15,534][123091] Updated weights for policy 0, policy_version 1752417 (0.0007) [2023-12-26 13:35:15,581][123091] Updated weights for policy 0, policy_version 1752427 (0.0005) [2023-12-26 13:35:16,236][123090] Updated weights for policy 1, policy_version 1740642 (0.0009) [2023-12-26 13:35:16,291][123090] Updated weights for policy 1, policy_version 1740652 (0.0009) [2023-12-26 13:35:16,337][123091] Updated weights for policy 0, policy_version 1752437 (0.0008) [2023-12-26 13:35:16,343][123090] Updated weights for policy 1, policy_version 1740662 (0.0008) [2023-12-26 13:35:16,393][123090] Updated weights for policy 1, policy_version 1740672 (0.0009) [2023-12-26 13:35:16,396][123091] Updated weights for policy 0, policy_version 1752447 (0.0007) [2023-12-26 13:35:16,461][123091] Updated weights for policy 0, policy_version 1752457 (0.0010) [2023-12-26 13:35:17,236][123091] Updated weights for policy 0, policy_version 1752468 (0.0010) [2023-12-26 13:35:17,237][123090] Updated weights for policy 1, policy_version 1740682 (0.0009) [2023-12-26 13:35:17,285][123090] Updated weights for policy 1, policy_version 1740692 (0.0009) [2023-12-26 13:35:17,306][123091] Updated weights for policy 0, policy_version 1752478 (0.0010) [2023-12-26 13:35:17,340][123090] Updated weights for policy 1, policy_version 1740702 (0.0009) [2023-12-26 13:35:17,365][123091] Updated weights for policy 0, policy_version 1752488 (0.0010) [2023-12-26 13:35:18,110][123091] Updated weights for policy 0, policy_version 1752498 (0.0010) [2023-12-26 13:35:18,168][123091] Updated weights for policy 0, policy_version 1752508 (0.0009) [2023-12-26 13:35:18,215][123091] Updated weights for policy 0, policy_version 1752518 (0.0010) [2023-12-26 13:35:18,225][123090] Updated weights for policy 1, policy_version 1740712 (0.0007) [2023-12-26 13:35:18,270][123091] Updated weights for policy 0, policy_version 1752528 (0.0010) [2023-12-26 13:35:18,294][123090] Updated weights for policy 1, policy_version 1740722 (0.0008) [2023-12-26 13:35:18,365][123090] Updated weights for policy 1, policy_version 1740732 (0.0009) [2023-12-26 13:35:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 894279680. Throughput: 0: 8918.1, 1: 8622.2. Samples: 894291216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:18,785][121949] Avg episode reward: [(0, '6075.681'), (1, '5789.691')] [2023-12-26 13:35:19,073][123091] Updated weights for policy 0, policy_version 1752538 (0.0005) [2023-12-26 13:35:19,122][123091] Updated weights for policy 0, policy_version 1752548 (0.0006) [2023-12-26 13:35:19,176][123091] Updated weights for policy 0, policy_version 1752558 (0.0005) [2023-12-26 13:35:19,205][123090] Updated weights for policy 1, policy_version 1740742 (0.0009) [2023-12-26 13:35:19,278][123090] Updated weights for policy 1, policy_version 1740752 (0.0009) [2023-12-26 13:35:19,348][123090] Updated weights for policy 1, policy_version 1740762 (0.0009) [2023-12-26 13:35:20,014][123091] Updated weights for policy 0, policy_version 1752568 (0.0010) [2023-12-26 13:35:20,062][123091] Updated weights for policy 0, policy_version 1752578 (0.0011) [2023-12-26 13:35:20,114][123091] Updated weights for policy 0, policy_version 1752588 (0.0011) [2023-12-26 13:35:20,194][123090] Updated weights for policy 1, policy_version 1740772 (0.0009) [2023-12-26 13:35:20,262][123090] Updated weights for policy 1, policy_version 1740782 (0.0008) [2023-12-26 13:35:20,327][123090] Updated weights for policy 1, policy_version 1740792 (0.0009) [2023-12-26 13:35:20,981][123091] Updated weights for policy 0, policy_version 1752598 (0.0010) [2023-12-26 13:35:21,047][123091] Updated weights for policy 0, policy_version 1752608 (0.0010) [2023-12-26 13:35:21,108][123091] Updated weights for policy 0, policy_version 1752618 (0.0010) [2023-12-26 13:35:21,172][123090] Updated weights for policy 1, policy_version 1740802 (0.0009) [2023-12-26 13:35:21,237][123090] Updated weights for policy 1, policy_version 1740812 (0.0007) [2023-12-26 13:35:21,303][123090] Updated weights for policy 1, policy_version 1740822 (0.0009) [2023-12-26 13:35:21,371][123090] Updated weights for policy 1, policy_version 1740832 (0.0009) [2023-12-26 13:35:21,966][123091] Updated weights for policy 0, policy_version 1752628 (0.0009) [2023-12-26 13:35:22,042][123091] Updated weights for policy 0, policy_version 1752638 (0.0008) [2023-12-26 13:35:22,105][123091] Updated weights for policy 0, policy_version 1752648 (0.0008) [2023-12-26 13:35:22,205][123090] Updated weights for policy 1, policy_version 1740842 (0.0008) [2023-12-26 13:35:22,274][123090] Updated weights for policy 1, policy_version 1740852 (0.0010) [2023-12-26 13:35:22,333][123090] Updated weights for policy 1, policy_version 1740862 (0.0009) [2023-12-26 13:35:22,947][123091] Updated weights for policy 0, policy_version 1752658 (0.0009) [2023-12-26 13:35:23,000][123091] Updated weights for policy 0, policy_version 1752668 (0.0009) [2023-12-26 13:35:23,064][123091] Updated weights for policy 0, policy_version 1752678 (0.0009) [2023-12-26 13:35:23,133][123091] Updated weights for policy 0, policy_version 1752688 (0.0008) [2023-12-26 13:35:23,136][123090] Updated weights for policy 1, policy_version 1740872 (0.0009) [2023-12-26 13:35:23,199][123090] Updated weights for policy 1, policy_version 1740882 (0.0009) [2023-12-26 13:35:23,266][123090] Updated weights for policy 1, policy_version 1740892 (0.0009) [2023-12-26 13:35:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 894361600. Throughput: 0: 8895.5, 1: 8604.0. Samples: 894341708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:23,785][121949] Avg episode reward: [(0, '5910.979'), (1, '5794.779')] [2023-12-26 13:35:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001752688_448692224.pth... [2023-12-26 13:35:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001740896_445669376.pth... [2023-12-26 13:35:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001751664_448430080.pth [2023-12-26 13:35:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001739904_445415424.pth [2023-12-26 13:35:23,974][123091] Updated weights for policy 0, policy_version 1752698 (0.0009) [2023-12-26 13:35:24,028][123090] Updated weights for policy 1, policy_version 1740902 (0.0007) [2023-12-26 13:35:24,031][123091] Updated weights for policy 0, policy_version 1752708 (0.0005) [2023-12-26 13:35:24,083][123090] Updated weights for policy 1, policy_version 1740912 (0.0006) [2023-12-26 13:35:24,099][123091] Updated weights for policy 0, policy_version 1752718 (0.0005) [2023-12-26 13:35:24,144][123090] Updated weights for policy 1, policy_version 1740922 (0.0005) [2023-12-26 13:35:24,799][123091] Updated weights for policy 0, policy_version 1752728 (0.0005) [2023-12-26 13:35:24,862][123091] Updated weights for policy 0, policy_version 1752738 (0.0005) [2023-12-26 13:35:24,899][123090] Updated weights for policy 1, policy_version 1740932 (0.0007) [2023-12-26 13:35:24,919][123091] Updated weights for policy 0, policy_version 1752748 (0.0005) [2023-12-26 13:35:24,958][123090] Updated weights for policy 1, policy_version 1740942 (0.0009) [2023-12-26 13:35:25,014][123090] Updated weights for policy 1, policy_version 1740952 (0.0010) [2023-12-26 13:35:25,570][123091] Updated weights for policy 0, policy_version 1752758 (0.0005) [2023-12-26 13:35:25,626][123091] Updated weights for policy 0, policy_version 1752768 (0.0005) [2023-12-26 13:35:25,686][123091] Updated weights for policy 0, policy_version 1752778 (0.0007) [2023-12-26 13:35:25,951][123090] Updated weights for policy 1, policy_version 1740962 (0.0010) [2023-12-26 13:35:26,007][123090] Updated weights for policy 1, policy_version 1740972 (0.0009) [2023-12-26 13:35:26,055][123090] Updated weights for policy 1, policy_version 1740982 (0.0008) [2023-12-26 13:35:26,116][123090] Updated weights for policy 1, policy_version 1740992 (0.0009) [2023-12-26 13:35:26,461][123091] Updated weights for policy 0, policy_version 1752788 (0.0007) [2023-12-26 13:35:26,531][123091] Updated weights for policy 0, policy_version 1752798 (0.0007) [2023-12-26 13:35:26,603][123091] Updated weights for policy 0, policy_version 1752808 (0.0007) [2023-12-26 13:35:27,023][123090] Updated weights for policy 1, policy_version 1741002 (0.0007) [2023-12-26 13:35:27,091][123090] Updated weights for policy 1, policy_version 1741012 (0.0006) [2023-12-26 13:35:27,153][123091] Updated weights for policy 0, policy_version 1752818 (0.0006) [2023-12-26 13:35:27,157][123090] Updated weights for policy 1, policy_version 1741022 (0.0005) [2023-12-26 13:35:27,199][123091] Updated weights for policy 0, policy_version 1752828 (0.0006) [2023-12-26 13:35:27,260][123091] Updated weights for policy 0, policy_version 1752838 (0.0010) [2023-12-26 13:35:27,311][123091] Updated weights for policy 0, policy_version 1752848 (0.0008) [2023-12-26 13:35:27,896][123090] Updated weights for policy 1, policy_version 1741032 (0.0006) [2023-12-26 13:35:27,955][123090] Updated weights for policy 1, policy_version 1741042 (0.0006) [2023-12-26 13:35:28,025][123090] Updated weights for policy 1, policy_version 1741052 (0.0006) [2023-12-26 13:35:28,033][123091] Updated weights for policy 0, policy_version 1752858 (0.0005) [2023-12-26 13:35:28,086][123091] Updated weights for policy 0, policy_version 1752868 (0.0005) [2023-12-26 13:35:28,152][123091] Updated weights for policy 0, policy_version 1752878 (0.0005) [2023-12-26 13:35:28,773][123090] Updated weights for policy 1, policy_version 1741062 (0.0006) [2023-12-26 13:35:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 894451712. Throughput: 0: 8949.6, 1: 8625.8. Samples: 894448996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:28,785][121949] Avg episode reward: [(0, '5879.449'), (1, '5732.586')] [2023-12-26 13:35:28,837][123090] Updated weights for policy 1, policy_version 1741072 (0.0005) [2023-12-26 13:35:28,896][123090] Updated weights for policy 1, policy_version 1741082 (0.0007) [2023-12-26 13:35:28,932][123091] Updated weights for policy 0, policy_version 1752888 (0.0009) [2023-12-26 13:35:29,002][123091] Updated weights for policy 0, policy_version 1752898 (0.0010) [2023-12-26 13:35:29,060][123091] Updated weights for policy 0, policy_version 1752908 (0.0008) [2023-12-26 13:35:29,558][123090] Updated weights for policy 1, policy_version 1741092 (0.0007) [2023-12-26 13:35:29,628][123090] Updated weights for policy 1, policy_version 1741102 (0.0006) [2023-12-26 13:35:29,699][123090] Updated weights for policy 1, policy_version 1741112 (0.0005) [2023-12-26 13:35:29,764][123091] Updated weights for policy 0, policy_version 1752918 (0.0007) [2023-12-26 13:35:29,823][123091] Updated weights for policy 0, policy_version 1752928 (0.0006) [2023-12-26 13:35:29,886][123091] Updated weights for policy 0, policy_version 1752938 (0.0006) [2023-12-26 13:35:30,446][123090] Updated weights for policy 1, policy_version 1741122 (0.0006) [2023-12-26 13:35:30,502][123090] Updated weights for policy 1, policy_version 1741133 (0.0010) [2023-12-26 13:35:30,557][123090] Updated weights for policy 1, policy_version 1741143 (0.0010) [2023-12-26 13:35:30,602][123091] Updated weights for policy 0, policy_version 1752948 (0.0006) [2023-12-26 13:35:30,671][123091] Updated weights for policy 0, policy_version 1752958 (0.0006) [2023-12-26 13:35:30,746][123091] Updated weights for policy 0, policy_version 1752968 (0.0011) [2023-12-26 13:35:31,324][123090] Updated weights for policy 1, policy_version 1741153 (0.0009) [2023-12-26 13:35:31,413][123090] Updated weights for policy 1, policy_version 1741163 (0.0009) [2023-12-26 13:35:31,466][123090] Updated weights for policy 1, policy_version 1741173 (0.0010) [2023-12-26 13:35:31,517][123090] Updated weights for policy 1, policy_version 1741184 (0.0010) [2023-12-26 13:35:31,546][123091] Updated weights for policy 0, policy_version 1752978 (0.0007) [2023-12-26 13:35:31,602][123091] Updated weights for policy 0, policy_version 1752988 (0.0009) [2023-12-26 13:35:31,666][123091] Updated weights for policy 0, policy_version 1752998 (0.0009) [2023-12-26 13:35:31,725][123091] Updated weights for policy 0, policy_version 1753008 (0.0010) [2023-12-26 13:35:32,374][123090] Updated weights for policy 1, policy_version 1741194 (0.0009) [2023-12-26 13:35:32,438][123090] Updated weights for policy 1, policy_version 1741204 (0.0010) [2023-12-26 13:35:32,497][123090] Updated weights for policy 1, policy_version 1741214 (0.0009) [2023-12-26 13:35:32,560][123091] Updated weights for policy 0, policy_version 1753018 (0.0010) [2023-12-26 13:35:32,622][123091] Updated weights for policy 0, policy_version 1753028 (0.0008) [2023-12-26 13:35:32,683][123091] Updated weights for policy 0, policy_version 1753038 (0.0008) [2023-12-26 13:35:33,180][123090] Updated weights for policy 1, policy_version 1741224 (0.0006) [2023-12-26 13:35:33,232][123090] Updated weights for policy 1, policy_version 1741234 (0.0009) [2023-12-26 13:35:33,287][123090] Updated weights for policy 1, policy_version 1741245 (0.0010) [2023-12-26 13:35:33,496][123091] Updated weights for policy 0, policy_version 1753048 (0.0006) [2023-12-26 13:35:33,551][123091] Updated weights for policy 0, policy_version 1753058 (0.0005) [2023-12-26 13:35:33,606][123091] Updated weights for policy 0, policy_version 1753068 (0.0005) [2023-12-26 13:35:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 894550016. Throughput: 0: 8974.3, 1: 8725.5. Samples: 894558908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:33,785][121949] Avg episode reward: [(0, '6112.373'), (1, '5627.348')] [2023-12-26 13:35:34,196][123090] Updated weights for policy 1, policy_version 1741255 (0.0009) [2023-12-26 13:35:34,267][123090] Updated weights for policy 1, policy_version 1741265 (0.0008) [2023-12-26 13:35:34,285][123091] Updated weights for policy 0, policy_version 1753078 (0.0007) [2023-12-26 13:35:34,340][123090] Updated weights for policy 1, policy_version 1741275 (0.0006) [2023-12-26 13:35:34,342][123091] Updated weights for policy 0, policy_version 1753088 (0.0009) [2023-12-26 13:35:34,408][123091] Updated weights for policy 0, policy_version 1753098 (0.0009) [2023-12-26 13:35:35,040][123090] Updated weights for policy 1, policy_version 1741285 (0.0006) [2023-12-26 13:35:35,092][123090] Updated weights for policy 1, policy_version 1741295 (0.0005) [2023-12-26 13:35:35,147][123090] Updated weights for policy 1, policy_version 1741305 (0.0005) [2023-12-26 13:35:35,266][123091] Updated weights for policy 0, policy_version 1753108 (0.0008) [2023-12-26 13:35:35,330][123091] Updated weights for policy 0, policy_version 1753118 (0.0005) [2023-12-26 13:35:35,404][123091] Updated weights for policy 0, policy_version 1753128 (0.0006) [2023-12-26 13:35:35,883][123090] Updated weights for policy 1, policy_version 1741315 (0.0005) [2023-12-26 13:35:35,951][123090] Updated weights for policy 1, policy_version 1741325 (0.0007) [2023-12-26 13:35:36,000][123090] Updated weights for policy 1, policy_version 1741335 (0.0009) [2023-12-26 13:35:36,081][123091] Updated weights for policy 0, policy_version 1753138 (0.0006) [2023-12-26 13:35:36,148][123091] Updated weights for policy 0, policy_version 1753149 (0.0010) [2023-12-26 13:35:36,215][123091] Updated weights for policy 0, policy_version 1753159 (0.0009) [2023-12-26 13:35:36,746][123090] Updated weights for policy 1, policy_version 1741345 (0.0009) [2023-12-26 13:35:36,801][123090] Updated weights for policy 1, policy_version 1741355 (0.0005) [2023-12-26 13:35:36,859][123090] Updated weights for policy 1, policy_version 1741365 (0.0006) [2023-12-26 13:35:36,925][123090] Updated weights for policy 1, policy_version 1741375 (0.0008) [2023-12-26 13:35:37,122][123091] Updated weights for policy 0, policy_version 1753169 (0.0010) [2023-12-26 13:35:37,192][123091] Updated weights for policy 0, policy_version 1753179 (0.0009) [2023-12-26 13:35:37,246][123091] Updated weights for policy 0, policy_version 1753189 (0.0010) [2023-12-26 13:35:37,299][123091] Updated weights for policy 0, policy_version 1753199 (0.0009) [2023-12-26 13:35:37,604][123090] Updated weights for policy 1, policy_version 1741385 (0.0005) [2023-12-26 13:35:37,658][123090] Updated weights for policy 1, policy_version 1741395 (0.0005) [2023-12-26 13:35:37,730][123090] Updated weights for policy 1, policy_version 1741405 (0.0007) [2023-12-26 13:35:38,076][123091] Updated weights for policy 0, policy_version 1753209 (0.0010) [2023-12-26 13:35:38,129][123091] Updated weights for policy 0, policy_version 1753219 (0.0007) [2023-12-26 13:35:38,190][123091] Updated weights for policy 0, policy_version 1753229 (0.0006) [2023-12-26 13:35:38,442][123090] Updated weights for policy 1, policy_version 1741415 (0.0008) [2023-12-26 13:35:38,504][123090] Updated weights for policy 1, policy_version 1741425 (0.0008) [2023-12-26 13:35:38,574][123090] Updated weights for policy 1, policy_version 1741435 (0.0009) [2023-12-26 13:35:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 894640128. Throughput: 0: 9034.4, 1: 8789.5. Samples: 894614028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:38,785][121949] Avg episode reward: [(0, '6255.594'), (1, '5578.173')] [2023-12-26 13:35:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001753232_448831488.pth... [2023-12-26 13:35:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001741440_445808640.pth... [2023-12-26 13:35:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001752176_448561152.pth [2023-12-26 13:35:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001740416_445546496.pth [2023-12-26 13:35:38,964][123091] Updated weights for policy 0, policy_version 1753239 (0.0009) [2023-12-26 13:35:39,030][123091] Updated weights for policy 0, policy_version 1753249 (0.0010) [2023-12-26 13:35:39,091][123091] Updated weights for policy 0, policy_version 1753259 (0.0010) [2023-12-26 13:35:39,390][123090] Updated weights for policy 1, policy_version 1741445 (0.0011) [2023-12-26 13:35:39,461][123090] Updated weights for policy 1, policy_version 1741455 (0.0010) [2023-12-26 13:35:39,524][123090] Updated weights for policy 1, policy_version 1741465 (0.0010) [2023-12-26 13:35:39,918][123091] Updated weights for policy 0, policy_version 1753269 (0.0009) [2023-12-26 13:35:39,968][123091] Updated weights for policy 0, policy_version 1753279 (0.0007) [2023-12-26 13:35:40,036][123091] Updated weights for policy 0, policy_version 1753289 (0.0005) [2023-12-26 13:35:40,359][123090] Updated weights for policy 1, policy_version 1741475 (0.0010) [2023-12-26 13:35:40,422][123090] Updated weights for policy 1, policy_version 1741485 (0.0009) [2023-12-26 13:35:40,496][123090] Updated weights for policy 1, policy_version 1741495 (0.0006) [2023-12-26 13:35:40,844][123091] Updated weights for policy 0, policy_version 1753299 (0.0007) [2023-12-26 13:35:40,891][123091] Updated weights for policy 0, policy_version 1753309 (0.0010) [2023-12-26 13:35:40,955][123091] Updated weights for policy 0, policy_version 1753319 (0.0011) [2023-12-26 13:35:41,248][123090] Updated weights for policy 1, policy_version 1741505 (0.0009) [2023-12-26 13:35:41,315][123090] Updated weights for policy 1, policy_version 1741515 (0.0009) [2023-12-26 13:35:41,381][123090] Updated weights for policy 1, policy_version 1741525 (0.0009) [2023-12-26 13:35:41,460][123090] Updated weights for policy 1, policy_version 1741535 (0.0008) [2023-12-26 13:35:41,779][123091] Updated weights for policy 0, policy_version 1753329 (0.0010) [2023-12-26 13:35:41,832][123091] Updated weights for policy 0, policy_version 1753339 (0.0005) [2023-12-26 13:35:41,893][123091] Updated weights for policy 0, policy_version 1753349 (0.0008) [2023-12-26 13:35:41,956][123091] Updated weights for policy 0, policy_version 1753359 (0.0010) [2023-12-26 13:35:42,288][123090] Updated weights for policy 1, policy_version 1741545 (0.0008) [2023-12-26 13:35:42,357][123090] Updated weights for policy 1, policy_version 1741555 (0.0008) [2023-12-26 13:35:42,431][123090] Updated weights for policy 1, policy_version 1741565 (0.0009) [2023-12-26 13:35:42,758][123091] Updated weights for policy 0, policy_version 1753369 (0.0006) [2023-12-26 13:35:42,822][123091] Updated weights for policy 0, policy_version 1753379 (0.0006) [2023-12-26 13:35:42,883][123091] Updated weights for policy 0, policy_version 1753389 (0.0010) [2023-12-26 13:35:43,251][123090] Updated weights for policy 1, policy_version 1741575 (0.0006) [2023-12-26 13:35:43,313][123090] Updated weights for policy 1, policy_version 1741585 (0.0007) [2023-12-26 13:35:43,366][123090] Updated weights for policy 1, policy_version 1741595 (0.0009) [2023-12-26 13:35:43,668][123091] Updated weights for policy 0, policy_version 1753399 (0.0006) [2023-12-26 13:35:43,744][123091] Updated weights for policy 0, policy_version 1753409 (0.0005) [2023-12-26 13:35:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 894722048. Throughput: 0: 9056.1, 1: 8783.5. Samples: 894719876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:43,784][121949] Avg episode reward: [(0, '6225.388'), (1, '5650.080')] [2023-12-26 13:35:43,826][123091] Updated weights for policy 0, policy_version 1753419 (0.0005) [2023-12-26 13:35:44,102][123090] Updated weights for policy 1, policy_version 1741605 (0.0009) [2023-12-26 13:35:44,177][123090] Updated weights for policy 1, policy_version 1741615 (0.0009) [2023-12-26 13:35:44,235][123090] Updated weights for policy 1, policy_version 1741625 (0.0010) [2023-12-26 13:35:44,423][123091] Updated weights for policy 0, policy_version 1753429 (0.0005) [2023-12-26 13:35:44,496][123091] Updated weights for policy 0, policy_version 1753439 (0.0009) [2023-12-26 13:35:44,544][123091] Updated weights for policy 0, policy_version 1753449 (0.0009) [2023-12-26 13:35:45,112][123090] Updated weights for policy 1, policy_version 1741635 (0.0010) [2023-12-26 13:35:45,168][123090] Updated weights for policy 1, policy_version 1741645 (0.0008) [2023-12-26 13:35:45,230][123090] Updated weights for policy 1, policy_version 1741655 (0.0009) [2023-12-26 13:35:45,291][123091] Updated weights for policy 0, policy_version 1753459 (0.0009) [2023-12-26 13:35:45,335][123091] Updated weights for policy 0, policy_version 1753469 (0.0010) [2023-12-26 13:35:45,384][123091] Updated weights for policy 0, policy_version 1753479 (0.0010) [2023-12-26 13:35:45,974][123090] Updated weights for policy 1, policy_version 1741667 (0.0009) [2023-12-26 13:35:46,026][123090] Updated weights for policy 1, policy_version 1741677 (0.0006) [2023-12-26 13:35:46,097][123090] Updated weights for policy 1, policy_version 1741687 (0.0006) [2023-12-26 13:35:46,151][123091] Updated weights for policy 0, policy_version 1753489 (0.0010) [2023-12-26 13:35:46,217][123091] Updated weights for policy 0, policy_version 1753499 (0.0009) [2023-12-26 13:35:46,280][123091] Updated weights for policy 0, policy_version 1753509 (0.0009) [2023-12-26 13:35:46,339][123091] Updated weights for policy 0, policy_version 1753519 (0.0010) [2023-12-26 13:35:46,805][123090] Updated weights for policy 1, policy_version 1741697 (0.0006) [2023-12-26 13:35:46,865][123090] Updated weights for policy 1, policy_version 1741707 (0.0005) [2023-12-26 13:35:46,928][123090] Updated weights for policy 1, policy_version 1741717 (0.0005) [2023-12-26 13:35:46,991][123090] Updated weights for policy 1, policy_version 1741727 (0.0009) [2023-12-26 13:35:47,116][123091] Updated weights for policy 0, policy_version 1753529 (0.0008) [2023-12-26 13:35:47,181][123091] Updated weights for policy 0, policy_version 1753539 (0.0005) [2023-12-26 13:35:47,244][123091] Updated weights for policy 0, policy_version 1753549 (0.0005) [2023-12-26 13:35:47,718][123090] Updated weights for policy 1, policy_version 1741737 (0.0010) [2023-12-26 13:35:47,773][123090] Updated weights for policy 1, policy_version 1741747 (0.0009) [2023-12-26 13:35:47,806][123091] Updated weights for policy 0, policy_version 1753559 (0.0008) [2023-12-26 13:35:47,825][123090] Updated weights for policy 1, policy_version 1741757 (0.0006) [2023-12-26 13:35:47,874][123091] Updated weights for policy 0, policy_version 1753569 (0.0008) [2023-12-26 13:35:47,940][123091] Updated weights for policy 0, policy_version 1753579 (0.0008) [2023-12-26 13:35:48,529][123090] Updated weights for policy 1, policy_version 1741767 (0.0006) [2023-12-26 13:35:48,594][123090] Updated weights for policy 1, policy_version 1741777 (0.0006) [2023-12-26 13:35:48,641][123091] Updated weights for policy 0, policy_version 1753589 (0.0008) [2023-12-26 13:35:48,648][123090] Updated weights for policy 1, policy_version 1741787 (0.0008) [2023-12-26 13:35:48,698][123091] Updated weights for policy 0, policy_version 1753599 (0.0009) [2023-12-26 13:35:48,751][123091] Updated weights for policy 0, policy_version 1753609 (0.0009) [2023-12-26 13:35:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 894828544. Throughput: 0: 9129.9, 1: 8856.4. Samples: 894832996. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:48,785][121949] Avg episode reward: [(0, '6240.605'), (1, '5686.030')] [2023-12-26 13:35:49,469][123090] Updated weights for policy 1, policy_version 1741797 (0.0008) [2023-12-26 13:35:49,525][123090] Updated weights for policy 1, policy_version 1741807 (0.0010) [2023-12-26 13:35:49,575][123090] Updated weights for policy 1, policy_version 1741817 (0.0009) [2023-12-26 13:35:49,631][123091] Updated weights for policy 0, policy_version 1753620 (0.0008) [2023-12-26 13:35:49,687][123091] Updated weights for policy 0, policy_version 1753630 (0.0009) [2023-12-26 13:35:49,748][123091] Updated weights for policy 0, policy_version 1753640 (0.0009) [2023-12-26 13:35:50,469][123090] Updated weights for policy 1, policy_version 1741827 (0.0009) [2023-12-26 13:35:50,495][123091] Updated weights for policy 0, policy_version 1753650 (0.0009) [2023-12-26 13:35:50,523][123090] Updated weights for policy 1, policy_version 1741837 (0.0010) [2023-12-26 13:35:50,544][123091] Updated weights for policy 0, policy_version 1753660 (0.0008) [2023-12-26 13:35:50,578][123090] Updated weights for policy 1, policy_version 1741847 (0.0008) [2023-12-26 13:35:50,604][123091] Updated weights for policy 0, policy_version 1753670 (0.0009) [2023-12-26 13:35:50,670][123091] Updated weights for policy 0, policy_version 1753680 (0.0008) [2023-12-26 13:35:51,442][123090] Updated weights for policy 1, policy_version 1741857 (0.0008) [2023-12-26 13:35:51,513][123090] Updated weights for policy 1, policy_version 1741867 (0.0006) [2023-12-26 13:35:51,534][123091] Updated weights for policy 0, policy_version 1753690 (0.0010) [2023-12-26 13:35:51,578][123090] Updated weights for policy 1, policy_version 1741877 (0.0005) [2023-12-26 13:35:51,596][123091] Updated weights for policy 0, policy_version 1753700 (0.0008) [2023-12-26 13:35:51,646][123090] Updated weights for policy 1, policy_version 1741887 (0.0007) [2023-12-26 13:35:51,667][123091] Updated weights for policy 0, policy_version 1753710 (0.0011) [2023-12-26 13:35:52,434][123090] Updated weights for policy 1, policy_version 1741897 (0.0006) [2023-12-26 13:35:52,496][123090] Updated weights for policy 1, policy_version 1741907 (0.0008) [2023-12-26 13:35:52,507][123091] Updated weights for policy 0, policy_version 1753720 (0.0008) [2023-12-26 13:35:52,550][123090] Updated weights for policy 1, policy_version 1741917 (0.0006) [2023-12-26 13:35:52,569][123091] Updated weights for policy 0, policy_version 1753730 (0.0010) [2023-12-26 13:35:52,632][123091] Updated weights for policy 0, policy_version 1753740 (0.0010) [2023-12-26 13:35:53,333][123090] Updated weights for policy 1, policy_version 1741927 (0.0008) [2023-12-26 13:35:53,388][123090] Updated weights for policy 1, policy_version 1741937 (0.0009) [2023-12-26 13:35:53,441][123090] Updated weights for policy 1, policy_version 1741947 (0.0010) [2023-12-26 13:35:53,465][123091] Updated weights for policy 0, policy_version 1753750 (0.0008) [2023-12-26 13:35:53,515][123091] Updated weights for policy 0, policy_version 1753760 (0.0009) [2023-12-26 13:35:53,569][123091] Updated weights for policy 0, policy_version 1753770 (0.0009) [2023-12-26 13:35:53,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 894910464. Throughput: 0: 9083.6, 1: 8763.1. Samples: 894883644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:53,785][121949] Avg episode reward: [(0, '6227.773'), (1, '5653.024')] [2023-12-26 13:35:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001753776_448970752.pth... [2023-12-26 13:35:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001741952_445939712.pth... [2023-12-26 13:35:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001752688_448692224.pth [2023-12-26 13:35:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001740896_445669376.pth [2023-12-26 13:35:54,301][123090] Updated weights for policy 1, policy_version 1741957 (0.0009) [2023-12-26 13:35:54,353][123090] Updated weights for policy 1, policy_version 1741967 (0.0009) [2023-12-26 13:35:54,359][123091] Updated weights for policy 0, policy_version 1753781 (0.0008) [2023-12-26 13:35:54,416][123090] Updated weights for policy 1, policy_version 1741977 (0.0009) [2023-12-26 13:35:54,419][123091] Updated weights for policy 0, policy_version 1753791 (0.0006) [2023-12-26 13:35:54,480][123091] Updated weights for policy 0, policy_version 1753801 (0.0007) [2023-12-26 13:35:55,163][123090] Updated weights for policy 1, policy_version 1741987 (0.0010) [2023-12-26 13:35:55,196][123091] Updated weights for policy 0, policy_version 1753811 (0.0008) [2023-12-26 13:35:55,213][123090] Updated weights for policy 1, policy_version 1741997 (0.0009) [2023-12-26 13:35:55,251][123091] Updated weights for policy 0, policy_version 1753821 (0.0006) [2023-12-26 13:35:55,271][123090] Updated weights for policy 1, policy_version 1742008 (0.0009) [2023-12-26 13:35:55,301][123091] Updated weights for policy 0, policy_version 1753831 (0.0006) [2023-12-26 13:35:56,004][123091] Updated weights for policy 0, policy_version 1753841 (0.0005) [2023-12-26 13:35:56,058][123091] Updated weights for policy 0, policy_version 1753851 (0.0009) [2023-12-26 13:35:56,107][123091] Updated weights for policy 0, policy_version 1753862 (0.0009) [2023-12-26 13:35:56,153][123090] Updated weights for policy 1, policy_version 1742018 (0.0009) [2023-12-26 13:35:56,163][123091] Updated weights for policy 0, policy_version 1753872 (0.0009) [2023-12-26 13:35:56,218][123090] Updated weights for policy 1, policy_version 1742028 (0.0009) [2023-12-26 13:35:56,282][123090] Updated weights for policy 1, policy_version 1742038 (0.0009) [2023-12-26 13:35:56,338][123090] Updated weights for policy 1, policy_version 1742048 (0.0009) [2023-12-26 13:35:56,844][123091] Updated weights for policy 0, policy_version 1753882 (0.0005) [2023-12-26 13:35:56,890][123091] Updated weights for policy 0, policy_version 1753892 (0.0005) [2023-12-26 13:35:56,962][123091] Updated weights for policy 0, policy_version 1753902 (0.0005) [2023-12-26 13:35:57,247][123090] Updated weights for policy 1, policy_version 1742058 (0.0010) [2023-12-26 13:35:57,310][123090] Updated weights for policy 1, policy_version 1742068 (0.0009) [2023-12-26 13:35:57,369][123090] Updated weights for policy 1, policy_version 1742078 (0.0009) [2023-12-26 13:35:57,717][123091] Updated weights for policy 0, policy_version 1753912 (0.0009) [2023-12-26 13:35:57,769][123091] Updated weights for policy 0, policy_version 1753922 (0.0010) [2023-12-26 13:35:57,830][123091] Updated weights for policy 0, policy_version 1753932 (0.0009) [2023-12-26 13:35:58,199][123090] Updated weights for policy 1, policy_version 1742088 (0.0010) [2023-12-26 13:35:58,269][123090] Updated weights for policy 1, policy_version 1742098 (0.0010) [2023-12-26 13:35:58,339][123090] Updated weights for policy 1, policy_version 1742108 (0.0009) [2023-12-26 13:35:58,639][123091] Updated weights for policy 0, policy_version 1753942 (0.0008) [2023-12-26 13:35:58,713][123091] Updated weights for policy 0, policy_version 1753952 (0.0007) [2023-12-26 13:35:58,786][121949] Fps is (10 sec: 16381.0, 60 sec: 17748.8, 300 sec: 17716.8). Total num frames: 894992384. Throughput: 0: 9176.8, 1: 8749.8. Samples: 894990828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:35:58,787][121949] Avg episode reward: [(0, '6193.701'), (1, '5636.942')] [2023-12-26 13:35:58,788][123091] Updated weights for policy 0, policy_version 1753962 (0.0008) [2023-12-26 13:35:59,314][123090] Updated weights for policy 1, policy_version 1742118 (0.0008) [2023-12-26 13:35:59,377][123090] Updated weights for policy 1, policy_version 1742128 (0.0009) [2023-12-26 13:35:59,438][123090] Updated weights for policy 1, policy_version 1742138 (0.0009) [2023-12-26 13:35:59,605][123091] Updated weights for policy 0, policy_version 1753972 (0.0008) [2023-12-26 13:35:59,666][123091] Updated weights for policy 0, policy_version 1753982 (0.0010) [2023-12-26 13:35:59,732][123091] Updated weights for policy 0, policy_version 1753992 (0.0009) [2023-12-26 13:36:00,244][123090] Updated weights for policy 1, policy_version 1742148 (0.0009) [2023-12-26 13:36:00,303][123090] Updated weights for policy 1, policy_version 1742158 (0.0009) [2023-12-26 13:36:00,364][123090] Updated weights for policy 1, policy_version 1742168 (0.0009) [2023-12-26 13:36:00,509][123091] Updated weights for policy 0, policy_version 1754002 (0.0009) [2023-12-26 13:36:00,574][123091] Updated weights for policy 0, policy_version 1754012 (0.0005) [2023-12-26 13:36:00,636][123091] Updated weights for policy 0, policy_version 1754022 (0.0006) [2023-12-26 13:36:00,689][123091] Updated weights for policy 0, policy_version 1754032 (0.0005) [2023-12-26 13:36:01,189][123091] Updated weights for policy 0, policy_version 1754042 (0.0010) [2023-12-26 13:36:01,221][123090] Updated weights for policy 1, policy_version 1742178 (0.0009) [2023-12-26 13:36:01,250][123091] Updated weights for policy 0, policy_version 1754052 (0.0010) [2023-12-26 13:36:01,288][123090] Updated weights for policy 1, policy_version 1742188 (0.0005) [2023-12-26 13:36:01,308][123091] Updated weights for policy 0, policy_version 1754062 (0.0009) [2023-12-26 13:36:01,344][123090] Updated weights for policy 1, policy_version 1742198 (0.0008) [2023-12-26 13:36:01,407][123090] Updated weights for policy 1, policy_version 1742208 (0.0008) [2023-12-26 13:36:02,101][123091] Updated weights for policy 0, policy_version 1754072 (0.0009) [2023-12-26 13:36:02,164][123091] Updated weights for policy 0, policy_version 1754082 (0.0009) [2023-12-26 13:36:02,219][123091] Updated weights for policy 0, policy_version 1754092 (0.0010) [2023-12-26 13:36:02,262][123090] Updated weights for policy 1, policy_version 1742218 (0.0009) [2023-12-26 13:36:02,309][123090] Updated weights for policy 1, policy_version 1742228 (0.0009) [2023-12-26 13:36:02,361][123090] Updated weights for policy 1, policy_version 1742238 (0.0009) [2023-12-26 13:36:03,033][123091] Updated weights for policy 0, policy_version 1754102 (0.0009) [2023-12-26 13:36:03,089][123091] Updated weights for policy 0, policy_version 1754112 (0.0009) [2023-12-26 13:36:03,137][123091] Updated weights for policy 0, policy_version 1754122 (0.0009) [2023-12-26 13:36:03,207][123090] Updated weights for policy 1, policy_version 1742248 (0.0009) [2023-12-26 13:36:03,272][123090] Updated weights for policy 1, policy_version 1742258 (0.0007) [2023-12-26 13:36:03,337][123090] Updated weights for policy 1, policy_version 1742268 (0.0010) [2023-12-26 13:36:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17886.0, 300 sec: 17716.9). Total num frames: 895082496. Throughput: 0: 9107.9, 1: 8743.8. Samples: 895094540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:36:03,784][121949] Avg episode reward: [(0, '6131.515'), (1, '5562.815')] [2023-12-26 13:36:03,963][123091] Updated weights for policy 0, policy_version 1754132 (0.0010) [2023-12-26 13:36:04,020][123091] Updated weights for policy 0, policy_version 1754142 (0.0009) [2023-12-26 13:36:04,089][123091] Updated weights for policy 0, policy_version 1754152 (0.0011) [2023-12-26 13:36:04,147][123090] Updated weights for policy 1, policy_version 1742278 (0.0008) [2023-12-26 13:36:04,204][123090] Updated weights for policy 1, policy_version 1742288 (0.0006) [2023-12-26 13:36:04,263][123090] Updated weights for policy 1, policy_version 1742298 (0.0009) [2023-12-26 13:36:04,915][123091] Updated weights for policy 0, policy_version 1754162 (0.0011) [2023-12-26 13:36:04,963][123091] Updated weights for policy 0, policy_version 1754172 (0.0010) [2023-12-26 13:36:05,017][123091] Updated weights for policy 0, policy_version 1754182 (0.0010) [2023-12-26 13:36:05,086][123091] Updated weights for policy 0, policy_version 1754192 (0.0009) [2023-12-26 13:36:05,102][123090] Updated weights for policy 1, policy_version 1742308 (0.0009) [2023-12-26 13:36:05,164][123090] Updated weights for policy 1, policy_version 1742318 (0.0009) [2023-12-26 13:36:05,212][123090] Updated weights for policy 1, policy_version 1742328 (0.0008) [2023-12-26 13:36:05,815][123091] Updated weights for policy 0, policy_version 1754202 (0.0010) [2023-12-26 13:36:05,886][123091] Updated weights for policy 0, policy_version 1754212 (0.0011) [2023-12-26 13:36:05,949][123091] Updated weights for policy 0, policy_version 1754222 (0.0011) [2023-12-26 13:36:06,016][123090] Updated weights for policy 1, policy_version 1742338 (0.0008) [2023-12-26 13:36:06,075][123090] Updated weights for policy 1, policy_version 1742348 (0.0007) [2023-12-26 13:36:06,143][123090] Updated weights for policy 1, policy_version 1742358 (0.0011) [2023-12-26 13:36:06,199][123090] Updated weights for policy 1, policy_version 1742368 (0.0011) [2023-12-26 13:36:06,809][123091] Updated weights for policy 0, policy_version 1754232 (0.0011) [2023-12-26 13:36:06,866][123091] Updated weights for policy 0, policy_version 1754242 (0.0011) [2023-12-26 13:36:06,919][123091] Updated weights for policy 0, policy_version 1754252 (0.0011) [2023-12-26 13:36:07,021][123090] Updated weights for policy 1, policy_version 1742378 (0.0010) [2023-12-26 13:36:07,069][123090] Updated weights for policy 1, policy_version 1742388 (0.0010) [2023-12-26 13:36:07,125][123090] Updated weights for policy 1, policy_version 1742398 (0.0010) [2023-12-26 13:36:07,771][123091] Updated weights for policy 0, policy_version 1754262 (0.0011) [2023-12-26 13:36:07,838][123091] Updated weights for policy 0, policy_version 1754272 (0.0011) [2023-12-26 13:36:07,893][123091] Updated weights for policy 0, policy_version 1754282 (0.0010) [2023-12-26 13:36:07,979][123090] Updated weights for policy 1, policy_version 1742408 (0.0010) [2023-12-26 13:36:08,029][123090] Updated weights for policy 1, policy_version 1742418 (0.0008) [2023-12-26 13:36:08,101][123090] Updated weights for policy 1, policy_version 1742428 (0.0005) [2023-12-26 13:36:08,628][123091] Updated weights for policy 0, policy_version 1754292 (0.0009) [2023-12-26 13:36:08,685][123091] Updated weights for policy 0, policy_version 1754302 (0.0006) [2023-12-26 13:36:08,747][123091] Updated weights for policy 0, policy_version 1754312 (0.0006) [2023-12-26 13:36:08,784][121949] Fps is (10 sec: 17206.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 895164416. Throughput: 0: 9122.7, 1: 8778.3. Samples: 895147252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:36:08,785][121949] Avg episode reward: [(0, '6200.422'), (1, '5511.454')] [2023-12-26 13:36:08,785][123090] Updated weights for policy 1, policy_version 1742438 (0.0006) [2023-12-26 13:36:08,799][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001754320_449110016.pth... [2023-12-26 13:36:08,804][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001753232_448831488.pth [2023-12-26 13:36:08,855][123090] Updated weights for policy 1, policy_version 1742448 (0.0007) [2023-12-26 13:36:08,909][123090] Updated weights for policy 1, policy_version 1742458 (0.0006) [2023-12-26 13:36:08,947][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001742464_446070784.pth... [2023-12-26 13:36:08,952][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001741440_445808640.pth [2023-12-26 13:36:09,529][123091] Updated weights for policy 0, policy_version 1754322 (0.0007) [2023-12-26 13:36:09,588][123090] Updated weights for policy 1, policy_version 1742468 (0.0008) [2023-12-26 13:36:09,588][123091] Updated weights for policy 0, policy_version 1754332 (0.0006) [2023-12-26 13:36:09,651][123091] Updated weights for policy 0, policy_version 1754342 (0.0007) [2023-12-26 13:36:09,653][123090] Updated weights for policy 1, policy_version 1742478 (0.0011) [2023-12-26 13:36:09,708][123091] Updated weights for policy 0, policy_version 1754352 (0.0008) [2023-12-26 13:36:09,721][123090] Updated weights for policy 1, policy_version 1742488 (0.0011) [2023-12-26 13:36:10,525][123091] Updated weights for policy 0, policy_version 1754362 (0.0009) [2023-12-26 13:36:10,567][123090] Updated weights for policy 1, policy_version 1742498 (0.0011) [2023-12-26 13:36:10,583][123091] Updated weights for policy 0, policy_version 1754372 (0.0007) [2023-12-26 13:36:10,619][123090] Updated weights for policy 1, policy_version 1742508 (0.0010) [2023-12-26 13:36:10,639][123091] Updated weights for policy 0, policy_version 1754382 (0.0006) [2023-12-26 13:36:10,674][123090] Updated weights for policy 1, policy_version 1742518 (0.0006) [2023-12-26 13:36:10,737][123090] Updated weights for policy 1, policy_version 1742528 (0.0005) [2023-12-26 13:36:11,525][123091] Updated weights for policy 0, policy_version 1754392 (0.0010) [2023-12-26 13:36:11,573][123090] Updated weights for policy 1, policy_version 1742538 (0.0010) [2023-12-26 13:36:11,581][123091] Updated weights for policy 0, policy_version 1754402 (0.0010) [2023-12-26 13:36:11,635][123090] Updated weights for policy 1, policy_version 1742548 (0.0011) [2023-12-26 13:36:11,649][123091] Updated weights for policy 0, policy_version 1754412 (0.0009) [2023-12-26 13:36:11,703][123090] Updated weights for policy 1, policy_version 1742558 (0.0007) [2023-12-26 13:36:12,404][123090] Updated weights for policy 1, policy_version 1742568 (0.0009) [2023-12-26 13:36:12,467][123090] Updated weights for policy 1, policy_version 1742578 (0.0009) [2023-12-26 13:36:12,520][123091] Updated weights for policy 0, policy_version 1754422 (0.0008) [2023-12-26 13:36:12,529][123090] Updated weights for policy 1, policy_version 1742588 (0.0009) [2023-12-26 13:36:12,570][123091] Updated weights for policy 0, policy_version 1754432 (0.0009) [2023-12-26 13:36:12,631][123091] Updated weights for policy 0, policy_version 1754442 (0.0008) [2023-12-26 13:36:13,363][123090] Updated weights for policy 1, policy_version 1742598 (0.0010) [2023-12-26 13:36:13,434][123090] Updated weights for policy 1, policy_version 1742608 (0.0009) [2023-12-26 13:36:13,493][123091] Updated weights for policy 0, policy_version 1754452 (0.0009) [2023-12-26 13:36:13,494][123090] Updated weights for policy 1, policy_version 1742618 (0.0008) [2023-12-26 13:36:13,559][123091] Updated weights for policy 0, policy_version 1754462 (0.0009) [2023-12-26 13:36:13,618][123091] Updated weights for policy 0, policy_version 1754472 (0.0009) [2023-12-26 13:36:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 895262720. Throughput: 0: 9026.0, 1: 8828.2. Samples: 895252440. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:36:13,785][121949] Avg episode reward: [(0, '6200.658'), (1, '5611.174')] [2023-12-26 13:36:14,211][123090] Updated weights for policy 1, policy_version 1742628 (0.0009) [2023-12-26 13:36:14,267][123090] Updated weights for policy 1, policy_version 1742638 (0.0010) [2023-12-26 13:36:14,332][123090] Updated weights for policy 1, policy_version 1742648 (0.0010) [2023-12-26 13:36:14,490][123091] Updated weights for policy 0, policy_version 1754482 (0.0010) [2023-12-26 13:36:14,538][123091] Updated weights for policy 0, policy_version 1754492 (0.0008) [2023-12-26 13:36:14,594][123091] Updated weights for policy 0, policy_version 1754502 (0.0009) [2023-12-26 13:36:14,647][123091] Updated weights for policy 0, policy_version 1754512 (0.0009) [2023-12-26 13:36:15,110][123090] Updated weights for policy 1, policy_version 1742658 (0.0010) [2023-12-26 13:36:15,182][123090] Updated weights for policy 1, policy_version 1742668 (0.0010) [2023-12-26 13:36:15,250][123090] Updated weights for policy 1, policy_version 1742678 (0.0011) [2023-12-26 13:36:15,314][123090] Updated weights for policy 1, policy_version 1742688 (0.0011) [2023-12-26 13:36:15,491][123091] Updated weights for policy 0, policy_version 1754522 (0.0008) [2023-12-26 13:36:15,549][123091] Updated weights for policy 0, policy_version 1754532 (0.0008) [2023-12-26 13:36:15,611][123091] Updated weights for policy 0, policy_version 1754542 (0.0009) [2023-12-26 13:36:16,053][123090] Updated weights for policy 1, policy_version 1742698 (0.0010) [2023-12-26 13:36:16,112][123090] Updated weights for policy 1, policy_version 1742708 (0.0010) [2023-12-26 13:36:16,178][123090] Updated weights for policy 1, policy_version 1742718 (0.0007) [2023-12-26 13:36:16,375][123091] Updated weights for policy 0, policy_version 1754552 (0.0006) [2023-12-26 13:36:16,421][123091] Updated weights for policy 0, policy_version 1754562 (0.0007) [2023-12-26 13:36:16,474][123091] Updated weights for policy 0, policy_version 1754572 (0.0009) [2023-12-26 13:36:16,891][123090] Updated weights for policy 1, policy_version 1742728 (0.0005) [2023-12-26 13:36:16,937][123090] Updated weights for policy 1, policy_version 1742738 (0.0005) [2023-12-26 13:36:16,988][123090] Updated weights for policy 1, policy_version 1742748 (0.0005) [2023-12-26 13:36:17,371][123091] Updated weights for policy 0, policy_version 1754582 (0.0010) [2023-12-26 13:36:17,428][123091] Updated weights for policy 0, policy_version 1754592 (0.0009) [2023-12-26 13:36:17,485][123091] Updated weights for policy 0, policy_version 1754602 (0.0009) [2023-12-26 13:36:17,744][123090] Updated weights for policy 1, policy_version 1742759 (0.0008) [2023-12-26 13:36:17,810][123090] Updated weights for policy 1, policy_version 1742769 (0.0010) [2023-12-26 13:36:17,865][123090] Updated weights for policy 1, policy_version 1742779 (0.0009) [2023-12-26 13:36:18,317][123091] Updated weights for policy 0, policy_version 1754612 (0.0009) [2023-12-26 13:36:18,378][123091] Updated weights for policy 0, policy_version 1754622 (0.0009) [2023-12-26 13:36:18,441][123091] Updated weights for policy 0, policy_version 1754632 (0.0009) [2023-12-26 13:36:18,725][123090] Updated weights for policy 1, policy_version 1742789 (0.0010) [2023-12-26 13:36:18,781][123090] Updated weights for policy 1, policy_version 1742799 (0.0010) [2023-12-26 13:36:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 895344640. Throughput: 0: 8944.6, 1: 8821.4. Samples: 895358376. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:36:18,784][121949] Avg episode reward: [(0, '6197.022'), (1, '5633.574')] [2023-12-26 13:36:18,829][123090] Updated weights for policy 1, policy_version 1742809 (0.0009) [2023-12-26 13:36:19,281][123091] Updated weights for policy 0, policy_version 1754642 (0.0009) [2023-12-26 13:36:19,355][123091] Updated weights for policy 0, policy_version 1754652 (0.0009) [2023-12-26 13:36:19,424][123091] Updated weights for policy 0, policy_version 1754662 (0.0009) [2023-12-26 13:36:19,693][123090] Updated weights for policy 1, policy_version 1742819 (0.0009) [2023-12-26 13:36:19,746][123090] Updated weights for policy 1, policy_version 1742829 (0.0009) [2023-12-26 13:36:19,799][123090] Updated weights for policy 1, policy_version 1742839 (0.0009) [2023-12-26 13:36:20,283][123091] Updated weights for policy 0, policy_version 1754673 (0.0010) [2023-12-26 13:36:20,343][123091] Updated weights for policy 0, policy_version 1754683 (0.0010) [2023-12-26 13:36:20,412][123091] Updated weights for policy 0, policy_version 1754693 (0.0010) [2023-12-26 13:36:20,476][123091] Updated weights for policy 0, policy_version 1754703 (0.0009) [2023-12-26 13:36:20,667][123090] Updated weights for policy 1, policy_version 1742849 (0.0010) [2023-12-26 13:36:20,728][123090] Updated weights for policy 1, policy_version 1742859 (0.0006) [2023-12-26 13:36:20,791][123090] Updated weights for policy 1, policy_version 1742869 (0.0006) [2023-12-26 13:36:20,857][123090] Updated weights for policy 1, policy_version 1742879 (0.0006) [2023-12-26 13:36:21,353][123091] Updated weights for policy 0, policy_version 1754713 (0.0008) [2023-12-26 13:36:21,424][123091] Updated weights for policy 0, policy_version 1754723 (0.0009) [2023-12-26 13:36:21,489][123091] Updated weights for policy 0, policy_version 1754733 (0.0010) [2023-12-26 13:36:21,630][123090] Updated weights for policy 1, policy_version 1742889 (0.0009) [2023-12-26 13:36:21,700][123090] Updated weights for policy 1, policy_version 1742899 (0.0010) [2023-12-26 13:36:21,771][123090] Updated weights for policy 1, policy_version 1742909 (0.0009) [2023-12-26 13:36:22,255][123091] Updated weights for policy 0, policy_version 1754743 (0.0008) [2023-12-26 13:36:22,316][123091] Updated weights for policy 0, policy_version 1754753 (0.0006) [2023-12-26 13:36:22,390][123091] Updated weights for policy 0, policy_version 1754763 (0.0008) [2023-12-26 13:36:22,629][123090] Updated weights for policy 1, policy_version 1742919 (0.0009) [2023-12-26 13:36:22,689][123090] Updated weights for policy 1, policy_version 1742929 (0.0009) [2023-12-26 13:36:22,744][123090] Updated weights for policy 1, policy_version 1742939 (0.0009) [2023-12-26 13:36:23,180][123091] Updated weights for policy 0, policy_version 1754773 (0.0008) [2023-12-26 13:36:23,242][123091] Updated weights for policy 0, policy_version 1754783 (0.0010) [2023-12-26 13:36:23,299][123091] Updated weights for policy 0, policy_version 1754794 (0.0011) [2023-12-26 13:36:23,575][123090] Updated weights for policy 1, policy_version 1742949 (0.0009) [2023-12-26 13:36:23,624][123090] Updated weights for policy 1, policy_version 1742959 (0.0009) [2023-12-26 13:36:23,670][123090] Updated weights for policy 1, policy_version 1742969 (0.0008) [2023-12-26 13:36:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 895434752. Throughput: 0: 8886.1, 1: 8771.2. Samples: 895408608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:36:23,785][121949] Avg episode reward: [(0, '6164.228'), (1, '5830.315')] [2023-12-26 13:36:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001754800_449232896.pth... [2023-12-26 13:36:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001742976_446201856.pth... [2023-12-26 13:36:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001753776_448970752.pth [2023-12-26 13:36:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001741952_445939712.pth [2023-12-26 13:36:24,132][123091] Updated weights for policy 0, policy_version 1754804 (0.0010) [2023-12-26 13:36:24,192][123091] Updated weights for policy 0, policy_version 1754814 (0.0009) [2023-12-26 13:36:24,243][123091] Updated weights for policy 0, policy_version 1754824 (0.0010) [2023-12-26 13:36:24,480][123090] Updated weights for policy 1, policy_version 1742979 (0.0008) [2023-12-26 13:36:24,541][123090] Updated weights for policy 1, policy_version 1742989 (0.0007) [2023-12-26 13:36:24,604][123090] Updated weights for policy 1, policy_version 1742999 (0.0009) [2023-12-26 13:36:25,101][123091] Updated weights for policy 0, policy_version 1754834 (0.0009) [2023-12-26 13:36:25,162][123091] Updated weights for policy 0, policy_version 1754844 (0.0009) [2023-12-26 13:36:25,223][123091] Updated weights for policy 0, policy_version 1754854 (0.0010) [2023-12-26 13:36:25,286][123091] Updated weights for policy 0, policy_version 1754864 (0.0009) [2023-12-26 13:36:25,297][123090] Updated weights for policy 1, policy_version 1743009 (0.0009) [2023-12-26 13:36:25,372][123090] Updated weights for policy 1, policy_version 1743019 (0.0006) [2023-12-26 13:36:25,436][123090] Updated weights for policy 1, policy_version 1743029 (0.0005) [2023-12-26 13:36:25,506][123090] Updated weights for policy 1, policy_version 1743039 (0.0008) [2023-12-26 13:36:26,115][123091] Updated weights for policy 0, policy_version 1754874 (0.0010) [2023-12-26 13:36:26,138][123090] Updated weights for policy 1, policy_version 1743049 (0.0006) [2023-12-26 13:36:26,168][123091] Updated weights for policy 0, policy_version 1754884 (0.0009) [2023-12-26 13:36:26,197][123090] Updated weights for policy 1, policy_version 1743059 (0.0005) [2023-12-26 13:36:26,222][123091] Updated weights for policy 0, policy_version 1754894 (0.0009) [2023-12-26 13:36:26,248][123090] Updated weights for policy 1, policy_version 1743069 (0.0005) [2023-12-26 13:36:26,892][123090] Updated weights for policy 1, policy_version 1743079 (0.0005) [2023-12-26 13:36:26,961][123090] Updated weights for policy 1, policy_version 1743089 (0.0005) [2023-12-26 13:36:27,032][123090] Updated weights for policy 1, policy_version 1743099 (0.0005) [2023-12-26 13:36:27,140][123091] Updated weights for policy 0, policy_version 1754904 (0.0008) [2023-12-26 13:36:27,202][123091] Updated weights for policy 0, policy_version 1754914 (0.0009) [2023-12-26 13:36:27,252][123091] Updated weights for policy 0, policy_version 1754924 (0.0010) [2023-12-26 13:36:27,723][123090] Updated weights for policy 1, policy_version 1743109 (0.0007) [2023-12-26 13:36:27,779][123090] Updated weights for policy 1, policy_version 1743119 (0.0009) [2023-12-26 13:36:27,839][123090] Updated weights for policy 1, policy_version 1743129 (0.0009) [2023-12-26 13:36:28,081][123091] Updated weights for policy 0, policy_version 1754935 (0.0007) [2023-12-26 13:36:28,127][123091] Updated weights for policy 0, policy_version 1754945 (0.0005) [2023-12-26 13:36:28,171][123091] Updated weights for policy 0, policy_version 1754955 (0.0005) [2023-12-26 13:36:28,633][123090] Updated weights for policy 1, policy_version 1743139 (0.0008) [2023-12-26 13:36:28,698][123090] Updated weights for policy 1, policy_version 1743149 (0.0011) [2023-12-26 13:36:28,768][123090] Updated weights for policy 1, policy_version 1743159 (0.0006) [2023-12-26 13:36:28,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 895516672. Throughput: 0: 8836.6, 1: 8834.6. Samples: 895515084. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:28,785][121949] Avg episode reward: [(0, '6228.839'), (1, '5587.472')] [2023-12-26 13:36:29,030][123091] Updated weights for policy 0, policy_version 1754965 (0.0008) [2023-12-26 13:36:29,077][123091] Updated weights for policy 0, policy_version 1754975 (0.0010) [2023-12-26 13:36:29,131][123091] Updated weights for policy 0, policy_version 1754985 (0.0010) [2023-12-26 13:36:29,479][123090] Updated weights for policy 1, policy_version 1743169 (0.0005) [2023-12-26 13:36:29,537][123090] Updated weights for policy 1, policy_version 1743179 (0.0005) [2023-12-26 13:36:29,593][123090] Updated weights for policy 1, policy_version 1743189 (0.0005) [2023-12-26 13:36:29,646][123090] Updated weights for policy 1, policy_version 1743199 (0.0006) [2023-12-26 13:36:29,939][123091] Updated weights for policy 0, policy_version 1754995 (0.0007) [2023-12-26 13:36:30,005][123091] Updated weights for policy 0, policy_version 1755005 (0.0011) [2023-12-26 13:36:30,069][123091] Updated weights for policy 0, policy_version 1755015 (0.0011) [2023-12-26 13:36:30,412][123090] Updated weights for policy 1, policy_version 1743209 (0.0009) [2023-12-26 13:36:30,476][123090] Updated weights for policy 1, policy_version 1743219 (0.0009) [2023-12-26 13:36:30,534][123090] Updated weights for policy 1, policy_version 1743229 (0.0009) [2023-12-26 13:36:30,859][123091] Updated weights for policy 0, policy_version 1755025 (0.0010) [2023-12-26 13:36:30,905][123091] Updated weights for policy 0, policy_version 1755035 (0.0005) [2023-12-26 13:36:30,951][123091] Updated weights for policy 0, policy_version 1755045 (0.0005) [2023-12-26 13:36:31,004][123091] Updated weights for policy 0, policy_version 1755055 (0.0005) [2023-12-26 13:36:31,420][123090] Updated weights for policy 1, policy_version 1743239 (0.0009) [2023-12-26 13:36:31,482][123090] Updated weights for policy 1, policy_version 1743249 (0.0009) [2023-12-26 13:36:31,553][123090] Updated weights for policy 1, policy_version 1743259 (0.0010) [2023-12-26 13:36:31,820][123091] Updated weights for policy 0, policy_version 1755065 (0.0010) [2023-12-26 13:36:31,876][123091] Updated weights for policy 0, policy_version 1755075 (0.0009) [2023-12-26 13:36:31,931][123091] Updated weights for policy 0, policy_version 1755085 (0.0009) [2023-12-26 13:36:32,272][123090] Updated weights for policy 1, policy_version 1743269 (0.0006) [2023-12-26 13:36:32,335][123090] Updated weights for policy 1, policy_version 1743279 (0.0007) [2023-12-26 13:36:32,394][123090] Updated weights for policy 1, policy_version 1743289 (0.0009) [2023-12-26 13:36:32,799][123091] Updated weights for policy 0, policy_version 1755095 (0.0010) [2023-12-26 13:36:32,852][123091] Updated weights for policy 0, policy_version 1755107 (0.0010) [2023-12-26 13:36:32,904][123091] Updated weights for policy 0, policy_version 1755117 (0.0009) [2023-12-26 13:36:33,086][123090] Updated weights for policy 1, policy_version 1743299 (0.0008) [2023-12-26 13:36:33,135][123090] Updated weights for policy 1, policy_version 1743309 (0.0005) [2023-12-26 13:36:33,192][123090] Updated weights for policy 1, policy_version 1743319 (0.0009) [2023-12-26 13:36:33,646][123091] Updated weights for policy 0, policy_version 1755127 (0.0007) [2023-12-26 13:36:33,707][123091] Updated weights for policy 0, policy_version 1755137 (0.0005) [2023-12-26 13:36:33,754][123091] Updated weights for policy 0, policy_version 1755147 (0.0005) [2023-12-26 13:36:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 895614976. Throughput: 0: 8747.6, 1: 8819.9. Samples: 895623536. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:33,785][121949] Avg episode reward: [(0, '6174.830'), (1, '5395.411')] [2023-12-26 13:36:33,904][123090] Updated weights for policy 1, policy_version 1743329 (0.0010) [2023-12-26 13:36:33,970][123090] Updated weights for policy 1, policy_version 1743339 (0.0005) [2023-12-26 13:36:34,031][123090] Updated weights for policy 1, policy_version 1743349 (0.0005) [2023-12-26 13:36:34,104][123090] Updated weights for policy 1, policy_version 1743359 (0.0008) [2023-12-26 13:36:34,422][123091] Updated weights for policy 0, policy_version 1755157 (0.0005) [2023-12-26 13:36:34,490][123091] Updated weights for policy 0, policy_version 1755167 (0.0006) [2023-12-26 13:36:34,554][123091] Updated weights for policy 0, policy_version 1755177 (0.0007) [2023-12-26 13:36:34,893][123090] Updated weights for policy 1, policy_version 1743369 (0.0010) [2023-12-26 13:36:34,944][123090] Updated weights for policy 1, policy_version 1743379 (0.0010) [2023-12-26 13:36:34,991][123090] Updated weights for policy 1, policy_version 1743389 (0.0010) [2023-12-26 13:36:35,232][123091] Updated weights for policy 0, policy_version 1755187 (0.0009) [2023-12-26 13:36:35,285][123091] Updated weights for policy 0, policy_version 1755197 (0.0009) [2023-12-26 13:36:35,337][123091] Updated weights for policy 0, policy_version 1755207 (0.0009) [2023-12-26 13:36:35,850][123090] Updated weights for policy 1, policy_version 1743399 (0.0009) [2023-12-26 13:36:35,905][123090] Updated weights for policy 1, policy_version 1743409 (0.0010) [2023-12-26 13:36:35,971][123090] Updated weights for policy 1, policy_version 1743419 (0.0009) [2023-12-26 13:36:36,089][123091] Updated weights for policy 0, policy_version 1755217 (0.0010) [2023-12-26 13:36:36,157][123091] Updated weights for policy 0, policy_version 1755227 (0.0010) [2023-12-26 13:36:36,220][123091] Updated weights for policy 0, policy_version 1755237 (0.0010) [2023-12-26 13:36:36,283][123091] Updated weights for policy 0, policy_version 1755247 (0.0009) [2023-12-26 13:36:36,883][123090] Updated weights for policy 1, policy_version 1743429 (0.0009) [2023-12-26 13:36:36,943][123090] Updated weights for policy 1, policy_version 1743439 (0.0008) [2023-12-26 13:36:37,014][123090] Updated weights for policy 1, policy_version 1743449 (0.0008) [2023-12-26 13:36:37,043][123091] Updated weights for policy 0, policy_version 1755257 (0.0009) [2023-12-26 13:36:37,113][123091] Updated weights for policy 0, policy_version 1755267 (0.0010) [2023-12-26 13:36:37,188][123091] Updated weights for policy 0, policy_version 1755277 (0.0010) [2023-12-26 13:36:37,796][123090] Updated weights for policy 1, policy_version 1743459 (0.0009) [2023-12-26 13:36:37,846][123090] Updated weights for policy 1, policy_version 1743469 (0.0010) [2023-12-26 13:36:37,905][123090] Updated weights for policy 1, policy_version 1743479 (0.0009) [2023-12-26 13:36:38,010][123091] Updated weights for policy 0, policy_version 1755287 (0.0008) [2023-12-26 13:36:38,061][123091] Updated weights for policy 0, policy_version 1755297 (0.0010) [2023-12-26 13:36:38,124][123091] Updated weights for policy 0, policy_version 1755307 (0.0009) [2023-12-26 13:36:38,764][123090] Updated weights for policy 1, policy_version 1743489 (0.0009) [2023-12-26 13:36:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 895696896. Throughput: 0: 8823.4, 1: 8836.4. Samples: 895678332. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:38,785][121949] Avg episode reward: [(0, '6115.268'), (1, '5478.045')] [2023-12-26 13:36:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001755312_449363968.pth... [2023-12-26 13:36:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001754320_449110016.pth [2023-12-26 13:36:38,822][123090] Updated weights for policy 1, policy_version 1743499 (0.0009) [2023-12-26 13:36:38,882][123090] Updated weights for policy 1, policy_version 1743509 (0.0010) [2023-12-26 13:36:38,939][123091] Updated weights for policy 0, policy_version 1755317 (0.0008) [2023-12-26 13:36:38,952][123090] Updated weights for policy 1, policy_version 1743519 (0.0008) [2023-12-26 13:36:38,958][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001743520_446341120.pth... [2023-12-26 13:36:38,962][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001742464_446070784.pth [2023-12-26 13:36:38,994][123091] Updated weights for policy 0, policy_version 1755327 (0.0009) [2023-12-26 13:36:39,057][123091] Updated weights for policy 0, policy_version 1755337 (0.0010) [2023-12-26 13:36:39,826][123090] Updated weights for policy 1, policy_version 1743529 (0.0010) [2023-12-26 13:36:39,888][123090] Updated weights for policy 1, policy_version 1743539 (0.0010) [2023-12-26 13:36:39,904][123091] Updated weights for policy 0, policy_version 1755347 (0.0009) [2023-12-26 13:36:39,959][123090] Updated weights for policy 1, policy_version 1743549 (0.0009) [2023-12-26 13:36:39,970][123091] Updated weights for policy 0, policy_version 1755357 (0.0008) [2023-12-26 13:36:40,023][123091] Updated weights for policy 0, policy_version 1755367 (0.0009) [2023-12-26 13:36:40,752][123091] Updated weights for policy 0, policy_version 1755377 (0.0009) [2023-12-26 13:36:40,810][123091] Updated weights for policy 0, policy_version 1755387 (0.0005) [2023-12-26 13:36:40,868][123090] Updated weights for policy 1, policy_version 1743559 (0.0007) [2023-12-26 13:36:40,877][123091] Updated weights for policy 0, policy_version 1755397 (0.0010) [2023-12-26 13:36:40,930][123090] Updated weights for policy 1, policy_version 1743569 (0.0008) [2023-12-26 13:36:40,940][123091] Updated weights for policy 0, policy_version 1755407 (0.0008) [2023-12-26 13:36:40,991][123090] Updated weights for policy 1, policy_version 1743579 (0.0009) [2023-12-26 13:36:41,783][123091] Updated weights for policy 0, policy_version 1755417 (0.0009) [2023-12-26 13:36:41,837][123091] Updated weights for policy 0, policy_version 1755427 (0.0009) [2023-12-26 13:36:41,868][123090] Updated weights for policy 1, policy_version 1743589 (0.0009) [2023-12-26 13:36:41,892][123091] Updated weights for policy 0, policy_version 1755437 (0.0008) [2023-12-26 13:36:41,928][123090] Updated weights for policy 1, policy_version 1743599 (0.0009) [2023-12-26 13:36:41,982][123090] Updated weights for policy 1, policy_version 1743609 (0.0009) [2023-12-26 13:36:42,747][123091] Updated weights for policy 0, policy_version 1755447 (0.0010) [2023-12-26 13:36:42,820][123091] Updated weights for policy 0, policy_version 1755457 (0.0010) [2023-12-26 13:36:42,820][123090] Updated weights for policy 1, policy_version 1743619 (0.0009) [2023-12-26 13:36:42,881][123090] Updated weights for policy 1, policy_version 1743629 (0.0006) [2023-12-26 13:36:42,883][123091] Updated weights for policy 0, policy_version 1755467 (0.0008) [2023-12-26 13:36:42,940][123090] Updated weights for policy 1, policy_version 1743639 (0.0007) [2023-12-26 13:36:43,721][123091] Updated weights for policy 0, policy_version 1755477 (0.0009) [2023-12-26 13:36:43,735][123090] Updated weights for policy 1, policy_version 1743649 (0.0009) [2023-12-26 13:36:43,781][123091] Updated weights for policy 0, policy_version 1755487 (0.0009) [2023-12-26 13:36:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 895778816. Throughput: 0: 8728.6, 1: 8810.4. Samples: 895780052. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:43,784][123090] Updated weights for policy 1, policy_version 1743659 (0.0007) [2023-12-26 13:36:43,785][121949] Avg episode reward: [(0, '6185.054'), (1, '5717.000')] [2023-12-26 13:36:43,836][123091] Updated weights for policy 0, policy_version 1755497 (0.0007) [2023-12-26 13:36:43,847][123090] Updated weights for policy 1, policy_version 1743669 (0.0010) [2023-12-26 13:36:43,909][123090] Updated weights for policy 1, policy_version 1743679 (0.0009) [2023-12-26 13:36:44,655][123090] Updated weights for policy 1, policy_version 1743689 (0.0006) [2023-12-26 13:36:44,703][123090] Updated weights for policy 1, policy_version 1743699 (0.0005) [2023-12-26 13:36:44,711][123091] Updated weights for policy 0, policy_version 1755507 (0.0007) [2023-12-26 13:36:44,767][123090] Updated weights for policy 1, policy_version 1743709 (0.0006) [2023-12-26 13:36:44,772][123091] Updated weights for policy 0, policy_version 1755517 (0.0009) [2023-12-26 13:36:44,836][123091] Updated weights for policy 0, policy_version 1755527 (0.0009) [2023-12-26 13:36:45,550][123090] Updated weights for policy 1, policy_version 1743719 (0.0010) [2023-12-26 13:36:45,615][123090] Updated weights for policy 1, policy_version 1743729 (0.0011) [2023-12-26 13:36:45,616][123091] Updated weights for policy 0, policy_version 1755537 (0.0009) [2023-12-26 13:36:45,678][123091] Updated weights for policy 0, policy_version 1755547 (0.0007) [2023-12-26 13:36:45,679][123090] Updated weights for policy 1, policy_version 1743739 (0.0011) [2023-12-26 13:36:45,743][123091] Updated weights for policy 0, policy_version 1755557 (0.0007) [2023-12-26 13:36:45,806][123091] Updated weights for policy 0, policy_version 1755567 (0.0009) [2023-12-26 13:36:46,495][123090] Updated weights for policy 1, policy_version 1743749 (0.0009) [2023-12-26 13:36:46,559][123090] Updated weights for policy 1, policy_version 1743759 (0.0011) [2023-12-26 13:36:46,611][123090] Updated weights for policy 1, policy_version 1743769 (0.0010) [2023-12-26 13:36:46,639][123091] Updated weights for policy 0, policy_version 1755577 (0.0007) [2023-12-26 13:36:46,695][123091] Updated weights for policy 0, policy_version 1755587 (0.0005) [2023-12-26 13:36:46,760][123091] Updated weights for policy 0, policy_version 1755597 (0.0005) [2023-12-26 13:36:47,369][123090] Updated weights for policy 1, policy_version 1743779 (0.0010) [2023-12-26 13:36:47,436][123090] Updated weights for policy 1, policy_version 1743789 (0.0008) [2023-12-26 13:36:47,492][123091] Updated weights for policy 0, policy_version 1755607 (0.0006) [2023-12-26 13:36:47,499][123090] Updated weights for policy 1, policy_version 1743799 (0.0009) [2023-12-26 13:36:47,556][123091] Updated weights for policy 0, policy_version 1755617 (0.0009) [2023-12-26 13:36:47,605][123091] Updated weights for policy 0, policy_version 1755627 (0.0009) [2023-12-26 13:36:48,302][123090] Updated weights for policy 1, policy_version 1743809 (0.0007) [2023-12-26 13:36:48,365][123090] Updated weights for policy 1, policy_version 1743819 (0.0009) [2023-12-26 13:36:48,422][123091] Updated weights for policy 0, policy_version 1755637 (0.0007) [2023-12-26 13:36:48,434][123090] Updated weights for policy 1, policy_version 1743829 (0.0009) [2023-12-26 13:36:48,473][123091] Updated weights for policy 0, policy_version 1755647 (0.0008) [2023-12-26 13:36:48,484][123090] Updated weights for policy 1, policy_version 1743839 (0.0009) [2023-12-26 13:36:48,525][123091] Updated weights for policy 0, policy_version 1755657 (0.0008) [2023-12-26 13:36:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 895877120. Throughput: 0: 8681.4, 1: 8900.8. Samples: 895885740. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:48,785][121949] Avg episode reward: [(0, '6178.415'), (1, '5455.778')] [2023-12-26 13:36:49,332][123090] Updated weights for policy 1, policy_version 1743849 (0.0009) [2023-12-26 13:36:49,358][123091] Updated weights for policy 0, policy_version 1755668 (0.0009) [2023-12-26 13:36:49,396][123090] Updated weights for policy 1, policy_version 1743859 (0.0009) [2023-12-26 13:36:49,433][123091] Updated weights for policy 0, policy_version 1755678 (0.0009) [2023-12-26 13:36:49,458][123090] Updated weights for policy 1, policy_version 1743869 (0.0007) [2023-12-26 13:36:49,490][123091] Updated weights for policy 0, policy_version 1755688 (0.0009) [2023-12-26 13:36:50,296][123091] Updated weights for policy 0, policy_version 1755698 (0.0009) [2023-12-26 13:36:50,307][123090] Updated weights for policy 1, policy_version 1743879 (0.0007) [2023-12-26 13:36:50,350][123091] Updated weights for policy 0, policy_version 1755708 (0.0009) [2023-12-26 13:36:50,370][123090] Updated weights for policy 1, policy_version 1743889 (0.0008) [2023-12-26 13:36:50,410][123091] Updated weights for policy 0, policy_version 1755718 (0.0010) [2023-12-26 13:36:50,422][123090] Updated weights for policy 1, policy_version 1743899 (0.0007) [2023-12-26 13:36:50,461][123091] Updated weights for policy 0, policy_version 1755728 (0.0010) [2023-12-26 13:36:51,240][123091] Updated weights for policy 0, policy_version 1755738 (0.0010) [2023-12-26 13:36:51,308][123091] Updated weights for policy 0, policy_version 1755748 (0.0010) [2023-12-26 13:36:51,328][123090] Updated weights for policy 1, policy_version 1743909 (0.0009) [2023-12-26 13:36:51,379][123091] Updated weights for policy 0, policy_version 1755758 (0.0009) [2023-12-26 13:36:51,398][123090] Updated weights for policy 1, policy_version 1743919 (0.0009) [2023-12-26 13:36:51,452][123090] Updated weights for policy 1, policy_version 1743929 (0.0008) [2023-12-26 13:36:52,192][123091] Updated weights for policy 0, policy_version 1755768 (0.0008) [2023-12-26 13:36:52,256][123091] Updated weights for policy 0, policy_version 1755778 (0.0006) [2023-12-26 13:36:52,302][123090] Updated weights for policy 1, policy_version 1743939 (0.0008) [2023-12-26 13:36:52,324][123091] Updated weights for policy 0, policy_version 1755788 (0.0008) [2023-12-26 13:36:52,370][123090] Updated weights for policy 1, policy_version 1743949 (0.0007) [2023-12-26 13:36:52,443][123090] Updated weights for policy 1, policy_version 1743959 (0.0009) [2023-12-26 13:36:52,913][123091] Updated weights for policy 0, policy_version 1755798 (0.0010) [2023-12-26 13:36:52,964][123091] Updated weights for policy 0, policy_version 1755808 (0.0010) [2023-12-26 13:36:53,017][123091] Updated weights for policy 0, policy_version 1755818 (0.0009) [2023-12-26 13:36:53,261][123090] Updated weights for policy 1, policy_version 1743969 (0.0010) [2023-12-26 13:36:53,329][123090] Updated weights for policy 1, policy_version 1743979 (0.0009) [2023-12-26 13:36:53,402][123090] Updated weights for policy 1, policy_version 1743989 (0.0009) [2023-12-26 13:36:53,468][123090] Updated weights for policy 1, policy_version 1743999 (0.0009) [2023-12-26 13:36:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 895959040. Throughput: 0: 8685.4, 1: 8858.5. Samples: 895936728. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:53,785][121949] Avg episode reward: [(0, '6231.154'), (1, '5439.098')] [2023-12-26 13:36:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001755824_449495040.pth... [2023-12-26 13:36:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001744000_446464000.pth... [2023-12-26 13:36:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001742976_446201856.pth [2023-12-26 13:36:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001754800_449232896.pth [2023-12-26 13:36:53,844][123091] Updated weights for policy 0, policy_version 1755828 (0.0008) [2023-12-26 13:36:53,913][123091] Updated weights for policy 0, policy_version 1755838 (0.0006) [2023-12-26 13:36:53,966][123091] Updated weights for policy 0, policy_version 1755848 (0.0010) [2023-12-26 13:36:54,244][123090] Updated weights for policy 1, policy_version 1744009 (0.0006) [2023-12-26 13:36:54,297][123090] Updated weights for policy 1, policy_version 1744019 (0.0005) [2023-12-26 13:36:54,349][123090] Updated weights for policy 1, policy_version 1744029 (0.0005) [2023-12-26 13:36:54,814][123091] Updated weights for policy 0, policy_version 1755858 (0.0009) [2023-12-26 13:36:54,885][123091] Updated weights for policy 0, policy_version 1755868 (0.0010) [2023-12-26 13:36:54,948][123091] Updated weights for policy 0, policy_version 1755878 (0.0010) [2023-12-26 13:36:55,011][123091] Updated weights for policy 0, policy_version 1755888 (0.0009) [2023-12-26 13:36:55,017][123090] Updated weights for policy 1, policy_version 1744039 (0.0005) [2023-12-26 13:36:55,086][123090] Updated weights for policy 1, policy_version 1744049 (0.0010) [2023-12-26 13:36:55,149][123090] Updated weights for policy 1, policy_version 1744059 (0.0010) [2023-12-26 13:36:55,822][123090] Updated weights for policy 1, policy_version 1744069 (0.0008) [2023-12-26 13:36:55,875][123090] Updated weights for policy 1, policy_version 1744079 (0.0005) [2023-12-26 13:36:55,895][123091] Updated weights for policy 0, policy_version 1755898 (0.0008) [2023-12-26 13:36:55,930][123090] Updated weights for policy 1, policy_version 1744089 (0.0005) [2023-12-26 13:36:55,950][123091] Updated weights for policy 0, policy_version 1755908 (0.0010) [2023-12-26 13:36:56,002][123091] Updated weights for policy 0, policy_version 1755918 (0.0009) [2023-12-26 13:36:56,632][123090] Updated weights for policy 1, policy_version 1744099 (0.0007) [2023-12-26 13:36:56,682][123090] Updated weights for policy 1, policy_version 1744109 (0.0010) [2023-12-26 13:36:56,736][123090] Updated weights for policy 1, policy_version 1744119 (0.0010) [2023-12-26 13:36:56,871][123091] Updated weights for policy 0, policy_version 1755928 (0.0009) [2023-12-26 13:36:56,923][123091] Updated weights for policy 0, policy_version 1755938 (0.0009) [2023-12-26 13:36:56,981][123091] Updated weights for policy 0, policy_version 1755948 (0.0008) [2023-12-26 13:36:57,562][123090] Updated weights for policy 1, policy_version 1744129 (0.0010) [2023-12-26 13:36:57,624][123090] Updated weights for policy 1, policy_version 1744139 (0.0010) [2023-12-26 13:36:57,685][123090] Updated weights for policy 1, policy_version 1744149 (0.0010) [2023-12-26 13:36:57,750][123090] Updated weights for policy 1, policy_version 1744159 (0.0010) [2023-12-26 13:36:57,811][123091] Updated weights for policy 0, policy_version 1755958 (0.0009) [2023-12-26 13:36:57,859][123091] Updated weights for policy 0, policy_version 1755968 (0.0009) [2023-12-26 13:36:57,911][123091] Updated weights for policy 0, policy_version 1755978 (0.0009) [2023-12-26 13:36:58,532][123090] Updated weights for policy 1, policy_version 1744169 (0.0007) [2023-12-26 13:36:58,598][123090] Updated weights for policy 1, policy_version 1744179 (0.0007) [2023-12-26 13:36:58,668][123090] Updated weights for policy 1, policy_version 1744189 (0.0007) [2023-12-26 13:36:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17613.3, 300 sec: 17661.4). Total num frames: 896049152. Throughput: 0: 8678.4, 1: 8904.1. Samples: 896043652. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:36:58,785][121949] Avg episode reward: [(0, '6220.403'), (1, '5570.293')] [2023-12-26 13:36:58,918][123091] Updated weights for policy 0, policy_version 1755988 (0.0009) [2023-12-26 13:36:58,989][123091] Updated weights for policy 0, policy_version 1755998 (0.0009) [2023-12-26 13:36:59,048][123091] Updated weights for policy 0, policy_version 1756008 (0.0009) [2023-12-26 13:36:59,481][123090] Updated weights for policy 1, policy_version 1744199 (0.0010) [2023-12-26 13:36:59,536][123090] Updated weights for policy 1, policy_version 1744209 (0.0010) [2023-12-26 13:36:59,591][123090] Updated weights for policy 1, policy_version 1744219 (0.0010) [2023-12-26 13:36:59,943][123091] Updated weights for policy 0, policy_version 1756018 (0.0010) [2023-12-26 13:37:00,002][123091] Updated weights for policy 0, policy_version 1756028 (0.0010) [2023-12-26 13:37:00,067][123091] Updated weights for policy 0, policy_version 1756038 (0.0009) [2023-12-26 13:37:00,125][123091] Updated weights for policy 0, policy_version 1756048 (0.0009) [2023-12-26 13:37:00,383][123090] Updated weights for policy 1, policy_version 1744229 (0.0009) [2023-12-26 13:37:00,448][123090] Updated weights for policy 1, policy_version 1744239 (0.0009) [2023-12-26 13:37:00,507][123090] Updated weights for policy 1, policy_version 1744249 (0.0009) [2023-12-26 13:37:00,977][123091] Updated weights for policy 0, policy_version 1756058 (0.0009) [2023-12-26 13:37:01,044][123091] Updated weights for policy 0, policy_version 1756068 (0.0010) [2023-12-26 13:37:01,111][123091] Updated weights for policy 0, policy_version 1756078 (0.0007) [2023-12-26 13:37:01,334][123090] Updated weights for policy 1, policy_version 1744260 (0.0009) [2023-12-26 13:37:01,401][123090] Updated weights for policy 1, policy_version 1744270 (0.0009) [2023-12-26 13:37:01,450][123090] Updated weights for policy 1, policy_version 1744280 (0.0009) [2023-12-26 13:37:01,922][123091] Updated weights for policy 0, policy_version 1756088 (0.0007) [2023-12-26 13:37:01,974][123091] Updated weights for policy 0, policy_version 1756098 (0.0005) [2023-12-26 13:37:02,026][123091] Updated weights for policy 0, policy_version 1756108 (0.0009) [2023-12-26 13:37:02,297][123090] Updated weights for policy 1, policy_version 1744290 (0.0009) [2023-12-26 13:37:02,380][123090] Updated weights for policy 1, policy_version 1744300 (0.0010) [2023-12-26 13:37:02,446][123090] Updated weights for policy 1, policy_version 1744310 (0.0010) [2023-12-26 13:37:02,515][123090] Updated weights for policy 1, policy_version 1744320 (0.0009) [2023-12-26 13:37:02,747][123091] Updated weights for policy 0, policy_version 1756119 (0.0007) [2023-12-26 13:37:02,802][123091] Updated weights for policy 0, policy_version 1756129 (0.0005) [2023-12-26 13:37:02,858][123091] Updated weights for policy 0, policy_version 1756139 (0.0005) [2023-12-26 13:37:03,237][123090] Updated weights for policy 1, policy_version 1744330 (0.0005) [2023-12-26 13:37:03,282][123090] Updated weights for policy 1, policy_version 1744340 (0.0005) [2023-12-26 13:37:03,326][123090] Updated weights for policy 1, policy_version 1744350 (0.0005) [2023-12-26 13:37:03,618][123091] Updated weights for policy 0, policy_version 1756149 (0.0005) [2023-12-26 13:37:03,666][123091] Updated weights for policy 0, policy_version 1756159 (0.0005) [2023-12-26 13:37:03,712][123091] Updated weights for policy 0, policy_version 1756169 (0.0008) [2023-12-26 13:37:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 896139264. Throughput: 0: 8680.0, 1: 8855.3. Samples: 896147464. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:03,784][121949] Avg episode reward: [(0, '6141.602'), (1, '5399.061')] [2023-12-26 13:37:04,082][123090] Updated weights for policy 1, policy_version 1744360 (0.0010) [2023-12-26 13:37:04,145][123090] Updated weights for policy 1, policy_version 1744370 (0.0011) [2023-12-26 13:37:04,205][123090] Updated weights for policy 1, policy_version 1744380 (0.0011) [2023-12-26 13:37:04,565][123091] Updated weights for policy 0, policy_version 1756179 (0.0009) [2023-12-26 13:37:04,633][123091] Updated weights for policy 0, policy_version 1756189 (0.0009) [2023-12-26 13:37:04,693][123091] Updated weights for policy 0, policy_version 1756199 (0.0009) [2023-12-26 13:37:05,034][123090] Updated weights for policy 1, policy_version 1744390 (0.0011) [2023-12-26 13:37:05,097][123090] Updated weights for policy 1, policy_version 1744400 (0.0010) [2023-12-26 13:37:05,156][123090] Updated weights for policy 1, policy_version 1744410 (0.0010) [2023-12-26 13:37:05,524][123091] Updated weights for policy 0, policy_version 1756209 (0.0009) [2023-12-26 13:37:05,583][123091] Updated weights for policy 0, policy_version 1756219 (0.0007) [2023-12-26 13:37:05,655][123091] Updated weights for policy 0, policy_version 1756229 (0.0006) [2023-12-26 13:37:05,726][123091] Updated weights for policy 0, policy_version 1756239 (0.0007) [2023-12-26 13:37:05,874][123090] Updated weights for policy 1, policy_version 1744420 (0.0008) [2023-12-26 13:37:05,936][123090] Updated weights for policy 1, policy_version 1744430 (0.0007) [2023-12-26 13:37:06,003][123090] Updated weights for policy 1, policy_version 1744440 (0.0006) [2023-12-26 13:37:06,370][123091] Updated weights for policy 0, policy_version 1756249 (0.0008) [2023-12-26 13:37:06,444][123091] Updated weights for policy 0, policy_version 1756259 (0.0005) [2023-12-26 13:37:06,518][123091] Updated weights for policy 0, policy_version 1756269 (0.0006) [2023-12-26 13:37:06,837][123090] Updated weights for policy 1, policy_version 1744450 (0.0008) [2023-12-26 13:37:06,901][123090] Updated weights for policy 1, policy_version 1744461 (0.0010) [2023-12-26 13:37:06,956][123090] Updated weights for policy 1, policy_version 1744471 (0.0010) [2023-12-26 13:37:07,219][123091] Updated weights for policy 0, policy_version 1756279 (0.0006) [2023-12-26 13:37:07,273][123091] Updated weights for policy 0, policy_version 1756289 (0.0008) [2023-12-26 13:37:07,324][123091] Updated weights for policy 0, policy_version 1756299 (0.0008) [2023-12-26 13:37:07,737][123090] Updated weights for policy 1, policy_version 1744481 (0.0006) [2023-12-26 13:37:07,801][123090] Updated weights for policy 1, policy_version 1744491 (0.0009) [2023-12-26 13:37:07,863][123090] Updated weights for policy 1, policy_version 1744501 (0.0009) [2023-12-26 13:37:07,928][123090] Updated weights for policy 1, policy_version 1744511 (0.0009) [2023-12-26 13:37:08,133][123091] Updated weights for policy 0, policy_version 1756309 (0.0005) [2023-12-26 13:37:08,214][123091] Updated weights for policy 0, policy_version 1756319 (0.0005) [2023-12-26 13:37:08,273][123091] Updated weights for policy 0, policy_version 1756329 (0.0007) [2023-12-26 13:37:08,776][123090] Updated weights for policy 1, policy_version 1744521 (0.0010) [2023-12-26 13:37:08,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 896221184. Throughput: 0: 8728.0, 1: 8875.3. Samples: 896200756. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:08,785][121949] Avg episode reward: [(0, '6148.296'), (1, '5524.340')] [2023-12-26 13:37:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001756336_449626112.pth... [2023-12-26 13:37:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001755312_449363968.pth [2023-12-26 13:37:08,844][123090] Updated weights for policy 1, policy_version 1744531 (0.0011) [2023-12-26 13:37:08,913][123090] Updated weights for policy 1, policy_version 1744541 (0.0011) [2023-12-26 13:37:08,931][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001744544_446603264.pth... [2023-12-26 13:37:08,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001743520_446341120.pth [2023-12-26 13:37:09,035][123091] Updated weights for policy 0, policy_version 1756339 (0.0010) [2023-12-26 13:37:09,092][123091] Updated weights for policy 0, policy_version 1756349 (0.0009) [2023-12-26 13:37:09,157][123091] Updated weights for policy 0, policy_version 1756359 (0.0009) [2023-12-26 13:37:09,794][123090] Updated weights for policy 1, policy_version 1744551 (0.0011) [2023-12-26 13:37:09,873][123090] Updated weights for policy 1, policy_version 1744561 (0.0010) [2023-12-26 13:37:09,948][123090] Updated weights for policy 1, policy_version 1744571 (0.0008) [2023-12-26 13:37:10,013][123091] Updated weights for policy 0, policy_version 1756369 (0.0009) [2023-12-26 13:37:10,078][123091] Updated weights for policy 0, policy_version 1756379 (0.0007) [2023-12-26 13:37:10,146][123091] Updated weights for policy 0, policy_version 1756389 (0.0006) [2023-12-26 13:37:10,223][123091] Updated weights for policy 0, policy_version 1756399 (0.0006) [2023-12-26 13:37:10,776][123090] Updated weights for policy 1, policy_version 1744581 (0.0011) [2023-12-26 13:37:10,831][123090] Updated weights for policy 1, policy_version 1744591 (0.0005) [2023-12-26 13:37:10,898][123090] Updated weights for policy 1, policy_version 1744601 (0.0010) [2023-12-26 13:37:10,932][123091] Updated weights for policy 0, policy_version 1756409 (0.0007) [2023-12-26 13:37:10,997][123091] Updated weights for policy 0, policy_version 1756419 (0.0010) [2023-12-26 13:37:11,062][123091] Updated weights for policy 0, policy_version 1756429 (0.0009) [2023-12-26 13:37:11,671][123090] Updated weights for policy 1, policy_version 1744611 (0.0008) [2023-12-26 13:37:11,742][123090] Updated weights for policy 1, policy_version 1744621 (0.0010) [2023-12-26 13:37:11,811][123090] Updated weights for policy 1, policy_version 1744631 (0.0010) [2023-12-26 13:37:11,932][123091] Updated weights for policy 0, policy_version 1756439 (0.0009) [2023-12-26 13:37:11,996][123091] Updated weights for policy 0, policy_version 1756449 (0.0011) [2023-12-26 13:37:12,059][123091] Updated weights for policy 0, policy_version 1756459 (0.0011) [2023-12-26 13:37:12,576][123090] Updated weights for policy 1, policy_version 1744641 (0.0011) [2023-12-26 13:37:12,645][123090] Updated weights for policy 1, policy_version 1744651 (0.0011) [2023-12-26 13:37:12,698][123090] Updated weights for policy 1, policy_version 1744661 (0.0011) [2023-12-26 13:37:12,749][123090] Updated weights for policy 1, policy_version 1744671 (0.0010) [2023-12-26 13:37:12,898][123091] Updated weights for policy 0, policy_version 1756469 (0.0009) [2023-12-26 13:37:12,946][123091] Updated weights for policy 0, policy_version 1756479 (0.0008) [2023-12-26 13:37:12,999][123091] Updated weights for policy 0, policy_version 1756489 (0.0010) [2023-12-26 13:37:13,577][123090] Updated weights for policy 1, policy_version 1744681 (0.0010) [2023-12-26 13:37:13,641][123090] Updated weights for policy 1, policy_version 1744691 (0.0008) [2023-12-26 13:37:13,697][123090] Updated weights for policy 1, policy_version 1744701 (0.0005) [2023-12-26 13:37:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 896311296. Throughput: 0: 8765.8, 1: 8769.0. Samples: 896304148. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:13,785][121949] Avg episode reward: [(0, '6170.743'), (1, '5608.042')] [2023-12-26 13:37:13,873][123091] Updated weights for policy 0, policy_version 1756499 (0.0009) [2023-12-26 13:37:13,927][123091] Updated weights for policy 0, policy_version 1756509 (0.0009) [2023-12-26 13:37:13,979][123091] Updated weights for policy 0, policy_version 1756519 (0.0009) [2023-12-26 13:37:14,462][123090] Updated weights for policy 1, policy_version 1744711 (0.0007) [2023-12-26 13:37:14,525][123090] Updated weights for policy 1, policy_version 1744721 (0.0010) [2023-12-26 13:37:14,602][123090] Updated weights for policy 1, policy_version 1744731 (0.0005) [2023-12-26 13:37:14,800][123091] Updated weights for policy 0, policy_version 1756529 (0.0009) [2023-12-26 13:37:14,855][123091] Updated weights for policy 0, policy_version 1756539 (0.0008) [2023-12-26 13:37:14,923][123091] Updated weights for policy 0, policy_version 1756549 (0.0009) [2023-12-26 13:37:14,987][123091] Updated weights for policy 0, policy_version 1756559 (0.0009) [2023-12-26 13:37:15,297][123090] Updated weights for policy 1, policy_version 1744741 (0.0008) [2023-12-26 13:37:15,370][123090] Updated weights for policy 1, policy_version 1744751 (0.0011) [2023-12-26 13:37:15,438][123090] Updated weights for policy 1, policy_version 1744761 (0.0007) [2023-12-26 13:37:15,822][123091] Updated weights for policy 0, policy_version 1756569 (0.0009) [2023-12-26 13:37:15,886][123091] Updated weights for policy 0, policy_version 1756579 (0.0009) [2023-12-26 13:37:15,956][123091] Updated weights for policy 0, policy_version 1756589 (0.0009) [2023-12-26 13:37:16,165][123090] Updated weights for policy 1, policy_version 1744771 (0.0007) [2023-12-26 13:37:16,217][123090] Updated weights for policy 1, policy_version 1744781 (0.0010) [2023-12-26 13:37:16,272][123090] Updated weights for policy 1, policy_version 1744791 (0.0010) [2023-12-26 13:37:16,592][123091] Updated weights for policy 0, policy_version 1756599 (0.0006) [2023-12-26 13:37:16,641][123091] Updated weights for policy 0, policy_version 1756609 (0.0005) [2023-12-26 13:37:16,707][123091] Updated weights for policy 0, policy_version 1756619 (0.0005) [2023-12-26 13:37:17,106][123090] Updated weights for policy 1, policy_version 1744801 (0.0011) [2023-12-26 13:37:17,177][123090] Updated weights for policy 1, policy_version 1744811 (0.0011) [2023-12-26 13:37:17,243][123090] Updated weights for policy 1, policy_version 1744821 (0.0011) [2023-12-26 13:37:17,313][123090] Updated weights for policy 1, policy_version 1744831 (0.0010) [2023-12-26 13:37:17,378][123091] Updated weights for policy 0, policy_version 1756629 (0.0007) [2023-12-26 13:37:17,434][123091] Updated weights for policy 0, policy_version 1756639 (0.0009) [2023-12-26 13:37:17,481][123091] Updated weights for policy 0, policy_version 1756649 (0.0009) [2023-12-26 13:37:18,085][123090] Updated weights for policy 1, policy_version 1744841 (0.0006) [2023-12-26 13:37:18,137][123090] Updated weights for policy 1, policy_version 1744851 (0.0005) [2023-12-26 13:37:18,193][123090] Updated weights for policy 1, policy_version 1744861 (0.0006) [2023-12-26 13:37:18,338][123091] Updated weights for policy 0, policy_version 1756659 (0.0009) [2023-12-26 13:37:18,398][123091] Updated weights for policy 0, policy_version 1756669 (0.0011) [2023-12-26 13:37:18,462][123091] Updated weights for policy 0, policy_version 1756679 (0.0011) [2023-12-26 13:37:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 896401408. Throughput: 0: 8765.9, 1: 8751.5. Samples: 896411816. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:18,785][121949] Avg episode reward: [(0, '6186.038'), (1, '5722.996')] [2023-12-26 13:37:18,888][123090] Updated weights for policy 1, policy_version 1744871 (0.0009) [2023-12-26 13:37:18,951][123090] Updated weights for policy 1, policy_version 1744881 (0.0010) [2023-12-26 13:37:19,021][123090] Updated weights for policy 1, policy_version 1744891 (0.0010) [2023-12-26 13:37:19,207][123091] Updated weights for policy 0, policy_version 1756689 (0.0010) [2023-12-26 13:37:19,276][123091] Updated weights for policy 0, policy_version 1756699 (0.0008) [2023-12-26 13:37:19,337][123091] Updated weights for policy 0, policy_version 1756709 (0.0008) [2023-12-26 13:37:19,395][123091] Updated weights for policy 0, policy_version 1756719 (0.0008) [2023-12-26 13:37:19,843][123090] Updated weights for policy 1, policy_version 1744901 (0.0010) [2023-12-26 13:37:19,914][123090] Updated weights for policy 1, policy_version 1744911 (0.0009) [2023-12-26 13:37:19,970][123090] Updated weights for policy 1, policy_version 1744921 (0.0010) [2023-12-26 13:37:20,172][123091] Updated weights for policy 0, policy_version 1756729 (0.0009) [2023-12-26 13:37:20,237][123091] Updated weights for policy 0, policy_version 1756739 (0.0008) [2023-12-26 13:37:20,303][123091] Updated weights for policy 0, policy_version 1756749 (0.0009) [2023-12-26 13:37:20,811][123090] Updated weights for policy 1, policy_version 1744931 (0.0009) [2023-12-26 13:37:20,880][123090] Updated weights for policy 1, policy_version 1744941 (0.0009) [2023-12-26 13:37:20,951][123090] Updated weights for policy 1, policy_version 1744951 (0.0010) [2023-12-26 13:37:21,071][123091] Updated weights for policy 0, policy_version 1756759 (0.0009) [2023-12-26 13:37:21,139][123091] Updated weights for policy 0, policy_version 1756769 (0.0009) [2023-12-26 13:37:21,206][123091] Updated weights for policy 0, policy_version 1756779 (0.0008) [2023-12-26 13:37:21,855][123090] Updated weights for policy 1, policy_version 1744961 (0.0010) [2023-12-26 13:37:21,927][123090] Updated weights for policy 1, policy_version 1744971 (0.0010) [2023-12-26 13:37:21,986][123090] Updated weights for policy 1, policy_version 1744981 (0.0009) [2023-12-26 13:37:22,023][123091] Updated weights for policy 0, policy_version 1756789 (0.0007) [2023-12-26 13:37:22,043][123090] Updated weights for policy 1, policy_version 1744991 (0.0009) [2023-12-26 13:37:22,085][123091] Updated weights for policy 0, policy_version 1756799 (0.0010) [2023-12-26 13:37:22,152][123091] Updated weights for policy 0, policy_version 1756809 (0.0010) [2023-12-26 13:37:22,913][123090] Updated weights for policy 1, policy_version 1745001 (0.0009) [2023-12-26 13:37:22,966][123091] Updated weights for policy 0, policy_version 1756819 (0.0009) [2023-12-26 13:37:22,968][123090] Updated weights for policy 1, policy_version 1745011 (0.0009) [2023-12-26 13:37:23,021][123091] Updated weights for policy 0, policy_version 1756829 (0.0009) [2023-12-26 13:37:23,031][123090] Updated weights for policy 1, policy_version 1745021 (0.0008) [2023-12-26 13:37:23,073][123091] Updated weights for policy 0, policy_version 1756839 (0.0009) [2023-12-26 13:37:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 896483328. Throughput: 0: 8731.1, 1: 8730.7. Samples: 896464116. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:23,785][121949] Avg episode reward: [(0, '6152.893'), (1, '5729.676')] [2023-12-26 13:37:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001756848_449757184.pth... [2023-12-26 13:37:23,794][123090] Updated weights for policy 1, policy_version 1745031 (0.0006) [2023-12-26 13:37:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001755824_449495040.pth [2023-12-26 13:37:23,853][123090] Updated weights for policy 1, policy_version 1745041 (0.0005) [2023-12-26 13:37:23,908][123090] Updated weights for policy 1, policy_version 1745051 (0.0005) [2023-12-26 13:37:23,937][123091] Updated weights for policy 0, policy_version 1756849 (0.0010) [2023-12-26 13:37:23,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001745056_446734336.pth... [2023-12-26 13:37:23,944][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001744000_446464000.pth [2023-12-26 13:37:23,996][123091] Updated weights for policy 0, policy_version 1756859 (0.0011) [2023-12-26 13:37:24,063][123091] Updated weights for policy 0, policy_version 1756869 (0.0011) [2023-12-26 13:37:24,131][123091] Updated weights for policy 0, policy_version 1756879 (0.0011) [2023-12-26 13:37:24,600][123090] Updated weights for policy 1, policy_version 1745061 (0.0005) [2023-12-26 13:37:24,657][123090] Updated weights for policy 1, policy_version 1745071 (0.0005) [2023-12-26 13:37:24,713][123090] Updated weights for policy 1, policy_version 1745081 (0.0005) [2023-12-26 13:37:24,909][123091] Updated weights for policy 0, policy_version 1756889 (0.0010) [2023-12-26 13:37:24,975][123091] Updated weights for policy 0, policy_version 1756899 (0.0011) [2023-12-26 13:37:25,045][123091] Updated weights for policy 0, policy_version 1756909 (0.0011) [2023-12-26 13:37:25,422][123090] Updated weights for policy 1, policy_version 1745091 (0.0006) [2023-12-26 13:37:25,478][123090] Updated weights for policy 1, policy_version 1745101 (0.0009) [2023-12-26 13:37:25,529][123090] Updated weights for policy 1, policy_version 1745111 (0.0008) [2023-12-26 13:37:25,783][123091] Updated weights for policy 0, policy_version 1756919 (0.0011) [2023-12-26 13:37:25,830][123091] Updated weights for policy 0, policy_version 1756929 (0.0010) [2023-12-26 13:37:25,877][123091] Updated weights for policy 0, policy_version 1756939 (0.0010) [2023-12-26 13:37:26,374][123090] Updated weights for policy 1, policy_version 1745121 (0.0009) [2023-12-26 13:37:26,434][123090] Updated weights for policy 1, policy_version 1745131 (0.0011) [2023-12-26 13:37:26,495][123090] Updated weights for policy 1, policy_version 1745141 (0.0011) [2023-12-26 13:37:26,548][123090] Updated weights for policy 1, policy_version 1745151 (0.0011) [2023-12-26 13:37:26,660][123091] Updated weights for policy 0, policy_version 1756949 (0.0008) [2023-12-26 13:37:26,720][123091] Updated weights for policy 0, policy_version 1756959 (0.0005) [2023-12-26 13:37:26,779][123091] Updated weights for policy 0, policy_version 1756969 (0.0005) [2023-12-26 13:37:27,350][123090] Updated weights for policy 1, policy_version 1745161 (0.0006) [2023-12-26 13:37:27,408][123090] Updated weights for policy 1, policy_version 1745171 (0.0005) [2023-12-26 13:37:27,473][123090] Updated weights for policy 1, policy_version 1745181 (0.0005) [2023-12-26 13:37:27,552][123091] Updated weights for policy 0, policy_version 1756979 (0.0009) [2023-12-26 13:37:27,598][123091] Updated weights for policy 0, policy_version 1756989 (0.0010) [2023-12-26 13:37:27,645][123091] Updated weights for policy 0, policy_version 1756999 (0.0010) [2023-12-26 13:37:28,175][123090] Updated weights for policy 1, policy_version 1745191 (0.0008) [2023-12-26 13:37:28,235][123090] Updated weights for policy 1, policy_version 1745201 (0.0005) [2023-12-26 13:37:28,298][123090] Updated weights for policy 1, policy_version 1745211 (0.0005) [2023-12-26 13:37:28,385][123091] Updated weights for policy 0, policy_version 1757009 (0.0010) [2023-12-26 13:37:28,436][123091] Updated weights for policy 0, policy_version 1757019 (0.0010) [2023-12-26 13:37:28,491][123091] Updated weights for policy 0, policy_version 1757029 (0.0010) [2023-12-26 13:37:28,550][123091] Updated weights for policy 0, policy_version 1757039 (0.0011) [2023-12-26 13:37:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 896581632. Throughput: 0: 8754.1, 1: 8851.2. Samples: 896572288. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:28,785][121949] Avg episode reward: [(0, '6220.186'), (1, '5641.822')] [2023-12-26 13:37:29,117][123090] Updated weights for policy 1, policy_version 1745221 (0.0009) [2023-12-26 13:37:29,163][123090] Updated weights for policy 1, policy_version 1745231 (0.0010) [2023-12-26 13:37:29,218][123090] Updated weights for policy 1, policy_version 1745241 (0.0010) [2023-12-26 13:37:29,402][123091] Updated weights for policy 0, policy_version 1757049 (0.0011) [2023-12-26 13:37:29,464][123091] Updated weights for policy 0, policy_version 1757059 (0.0010) [2023-12-26 13:37:29,526][123091] Updated weights for policy 0, policy_version 1757069 (0.0010) [2023-12-26 13:37:30,086][123090] Updated weights for policy 1, policy_version 1745251 (0.0011) [2023-12-26 13:37:30,144][123090] Updated weights for policy 1, policy_version 1745261 (0.0008) [2023-12-26 13:37:30,207][123090] Updated weights for policy 1, policy_version 1745271 (0.0006) [2023-12-26 13:37:30,335][123091] Updated weights for policy 0, policy_version 1757079 (0.0011) [2023-12-26 13:37:30,390][123091] Updated weights for policy 0, policy_version 1757089 (0.0010) [2023-12-26 13:37:30,448][123091] Updated weights for policy 0, policy_version 1757099 (0.0010) [2023-12-26 13:37:30,939][123090] Updated weights for policy 1, policy_version 1745281 (0.0006) [2023-12-26 13:37:30,999][123090] Updated weights for policy 1, policy_version 1745291 (0.0009) [2023-12-26 13:37:31,054][123090] Updated weights for policy 1, policy_version 1745301 (0.0008) [2023-12-26 13:37:31,109][123090] Updated weights for policy 1, policy_version 1745311 (0.0008) [2023-12-26 13:37:31,243][123091] Updated weights for policy 0, policy_version 1757109 (0.0011) [2023-12-26 13:37:31,309][123091] Updated weights for policy 0, policy_version 1757119 (0.0011) [2023-12-26 13:37:31,379][123091] Updated weights for policy 0, policy_version 1757129 (0.0011) [2023-12-26 13:37:31,878][123090] Updated weights for policy 1, policy_version 1745321 (0.0005) [2023-12-26 13:37:31,944][123090] Updated weights for policy 1, policy_version 1745331 (0.0005) [2023-12-26 13:37:32,014][123090] Updated weights for policy 1, policy_version 1745341 (0.0005) [2023-12-26 13:37:32,215][123091] Updated weights for policy 0, policy_version 1757139 (0.0011) [2023-12-26 13:37:32,274][123091] Updated weights for policy 0, policy_version 1757149 (0.0011) [2023-12-26 13:37:32,337][123091] Updated weights for policy 0, policy_version 1757159 (0.0010) [2023-12-26 13:37:32,693][123090] Updated weights for policy 1, policy_version 1745351 (0.0006) [2023-12-26 13:37:32,752][123090] Updated weights for policy 1, policy_version 1745361 (0.0006) [2023-12-26 13:37:32,803][123090] Updated weights for policy 1, policy_version 1745371 (0.0005) [2023-12-26 13:37:33,140][123091] Updated weights for policy 0, policy_version 1757169 (0.0009) [2023-12-26 13:37:33,212][123091] Updated weights for policy 0, policy_version 1757179 (0.0010) [2023-12-26 13:37:33,284][123091] Updated weights for policy 0, policy_version 1757189 (0.0010) [2023-12-26 13:37:33,356][123091] Updated weights for policy 0, policy_version 1757199 (0.0010) [2023-12-26 13:37:33,475][123090] Updated weights for policy 1, policy_version 1745381 (0.0008) [2023-12-26 13:37:33,525][123090] Updated weights for policy 1, policy_version 1745391 (0.0010) [2023-12-26 13:37:33,573][123090] Updated weights for policy 1, policy_version 1745401 (0.0010) [2023-12-26 13:37:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 896671744. Throughput: 0: 8779.3, 1: 8877.6. Samples: 896680300. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:33,785][121949] Avg episode reward: [(0, '6205.122'), (1, '5683.027')] [2023-12-26 13:37:34,054][123091] Updated weights for policy 0, policy_version 1757209 (0.0011) [2023-12-26 13:37:34,113][123091] Updated weights for policy 0, policy_version 1757219 (0.0011) [2023-12-26 13:37:34,184][123091] Updated weights for policy 0, policy_version 1757229 (0.0011) [2023-12-26 13:37:34,353][123090] Updated weights for policy 1, policy_version 1745411 (0.0010) [2023-12-26 13:37:34,401][123090] Updated weights for policy 1, policy_version 1745421 (0.0008) [2023-12-26 13:37:34,451][123090] Updated weights for policy 1, policy_version 1745431 (0.0009) [2023-12-26 13:37:35,022][123091] Updated weights for policy 0, policy_version 1757239 (0.0011) [2023-12-26 13:37:35,088][123091] Updated weights for policy 0, policy_version 1757249 (0.0010) [2023-12-26 13:37:35,157][123091] Updated weights for policy 0, policy_version 1757259 (0.0010) [2023-12-26 13:37:35,244][123090] Updated weights for policy 1, policy_version 1745441 (0.0009) [2023-12-26 13:37:35,307][123090] Updated weights for policy 1, policy_version 1745451 (0.0009) [2023-12-26 13:37:35,362][123090] Updated weights for policy 1, policy_version 1745462 (0.0010) [2023-12-26 13:37:35,947][123091] Updated weights for policy 0, policy_version 1757269 (0.0010) [2023-12-26 13:37:36,002][123091] Updated weights for policy 0, policy_version 1757279 (0.0011) [2023-12-26 13:37:36,061][123091] Updated weights for policy 0, policy_version 1757289 (0.0010) [2023-12-26 13:37:36,183][123090] Updated weights for policy 1, policy_version 1745473 (0.0009) [2023-12-26 13:37:36,254][123090] Updated weights for policy 1, policy_version 1745483 (0.0008) [2023-12-26 13:37:36,317][123090] Updated weights for policy 1, policy_version 1745493 (0.0008) [2023-12-26 13:37:36,383][123090] Updated weights for policy 1, policy_version 1745503 (0.0008) [2023-12-26 13:37:36,867][123091] Updated weights for policy 0, policy_version 1757299 (0.0010) [2023-12-26 13:37:36,922][123091] Updated weights for policy 0, policy_version 1757309 (0.0011) [2023-12-26 13:37:36,970][123091] Updated weights for policy 0, policy_version 1757319 (0.0010) [2023-12-26 13:37:37,165][123090] Updated weights for policy 1, policy_version 1745513 (0.0010) [2023-12-26 13:37:37,216][123090] Updated weights for policy 1, policy_version 1745523 (0.0010) [2023-12-26 13:37:37,275][123090] Updated weights for policy 1, policy_version 1745533 (0.0011) [2023-12-26 13:37:37,809][123091] Updated weights for policy 0, policy_version 1757329 (0.0010) [2023-12-26 13:37:37,872][123091] Updated weights for policy 0, policy_version 1757339 (0.0011) [2023-12-26 13:37:37,932][123091] Updated weights for policy 0, policy_version 1757349 (0.0011) [2023-12-26 13:37:37,998][123091] Updated weights for policy 0, policy_version 1757359 (0.0011) [2023-12-26 13:37:38,115][123090] Updated weights for policy 1, policy_version 1745543 (0.0010) [2023-12-26 13:37:38,174][123090] Updated weights for policy 1, policy_version 1745553 (0.0010) [2023-12-26 13:37:38,233][123090] Updated weights for policy 1, policy_version 1745563 (0.0010) [2023-12-26 13:37:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 896753664. Throughput: 0: 8777.7, 1: 8933.9. Samples: 896733748. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:38,785][121949] Avg episode reward: [(0, '6281.185'), (1, '5751.821')] [2023-12-26 13:37:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001745568_446865408.pth... [2023-12-26 13:37:38,795][123091] Updated weights for policy 0, policy_version 1757369 (0.0006) [2023-12-26 13:37:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001744544_446603264.pth [2023-12-26 13:37:38,854][123091] Updated weights for policy 0, policy_version 1757379 (0.0007) [2023-12-26 13:37:38,918][123091] Updated weights for policy 0, policy_version 1757389 (0.0009) [2023-12-26 13:37:38,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001757392_449896448.pth... [2023-12-26 13:37:38,939][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001756336_449626112.pth [2023-12-26 13:37:39,062][123090] Updated weights for policy 1, policy_version 1745573 (0.0011) [2023-12-26 13:37:39,109][123090] Updated weights for policy 1, policy_version 1745583 (0.0010) [2023-12-26 13:37:39,164][123090] Updated weights for policy 1, policy_version 1745593 (0.0010) [2023-12-26 13:37:39,751][123091] Updated weights for policy 0, policy_version 1757399 (0.0009) [2023-12-26 13:37:39,831][123091] Updated weights for policy 0, policy_version 1757409 (0.0008) [2023-12-26 13:37:39,895][123091] Updated weights for policy 0, policy_version 1757419 (0.0007) [2023-12-26 13:37:40,032][123090] Updated weights for policy 1, policy_version 1745603 (0.0010) [2023-12-26 13:37:40,093][123090] Updated weights for policy 1, policy_version 1745613 (0.0011) [2023-12-26 13:37:40,166][123090] Updated weights for policy 1, policy_version 1745623 (0.0011) [2023-12-26 13:37:40,614][123091] Updated weights for policy 0, policy_version 1757429 (0.0006) [2023-12-26 13:37:40,686][123091] Updated weights for policy 0, policy_version 1757439 (0.0006) [2023-12-26 13:37:40,762][123091] Updated weights for policy 0, policy_version 1757449 (0.0006) [2023-12-26 13:37:40,933][123090] Updated weights for policy 1, policy_version 1745633 (0.0010) [2023-12-26 13:37:41,006][123090] Updated weights for policy 1, policy_version 1745643 (0.0006) [2023-12-26 13:37:41,083][123090] Updated weights for policy 1, policy_version 1745653 (0.0008) [2023-12-26 13:37:41,150][123090] Updated weights for policy 1, policy_version 1745663 (0.0009) [2023-12-26 13:37:41,535][123091] Updated weights for policy 0, policy_version 1757459 (0.0008) [2023-12-26 13:37:41,601][123091] Updated weights for policy 0, policy_version 1757469 (0.0009) [2023-12-26 13:37:41,686][123091] Updated weights for policy 0, policy_version 1757479 (0.0010) [2023-12-26 13:37:41,972][123090] Updated weights for policy 1, policy_version 1745673 (0.0009) [2023-12-26 13:37:42,035][123090] Updated weights for policy 1, policy_version 1745683 (0.0010) [2023-12-26 13:37:42,096][123090] Updated weights for policy 1, policy_version 1745693 (0.0006) [2023-12-26 13:37:42,538][123091] Updated weights for policy 0, policy_version 1757489 (0.0010) [2023-12-26 13:37:42,593][123091] Updated weights for policy 0, policy_version 1757499 (0.0009) [2023-12-26 13:37:42,656][123091] Updated weights for policy 0, policy_version 1757509 (0.0009) [2023-12-26 13:37:42,712][123091] Updated weights for policy 0, policy_version 1757519 (0.0009) [2023-12-26 13:37:42,880][123090] Updated weights for policy 1, policy_version 1745703 (0.0005) [2023-12-26 13:37:42,930][123090] Updated weights for policy 1, policy_version 1745713 (0.0006) [2023-12-26 13:37:42,984][123090] Updated weights for policy 1, policy_version 1745723 (0.0009) [2023-12-26 13:37:43,579][123091] Updated weights for policy 0, policy_version 1757529 (0.0010) [2023-12-26 13:37:43,640][123091] Updated weights for policy 0, policy_version 1757539 (0.0010) [2023-12-26 13:37:43,694][123091] Updated weights for policy 0, policy_version 1757551 (0.0010) [2023-12-26 13:37:43,766][123090] Updated weights for policy 1, policy_version 1745733 (0.0006) [2023-12-26 13:37:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 896843776. Throughput: 0: 8794.5, 1: 8845.3. Samples: 896837444. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:43,785][121949] Avg episode reward: [(0, '6015.261'), (1, '5608.975')] [2023-12-26 13:37:43,831][123090] Updated weights for policy 1, policy_version 1745743 (0.0009) [2023-12-26 13:37:43,899][123090] Updated weights for policy 1, policy_version 1745753 (0.0010) [2023-12-26 13:37:44,543][123091] Updated weights for policy 0, policy_version 1757561 (0.0006) [2023-12-26 13:37:44,571][123090] Updated weights for policy 1, policy_version 1745763 (0.0006) [2023-12-26 13:37:44,613][123091] Updated weights for policy 0, policy_version 1757571 (0.0007) [2023-12-26 13:37:44,638][123090] Updated weights for policy 1, policy_version 1745773 (0.0008) [2023-12-26 13:37:44,677][123091] Updated weights for policy 0, policy_version 1757581 (0.0007) [2023-12-26 13:37:44,697][123090] Updated weights for policy 1, policy_version 1745783 (0.0009) [2023-12-26 13:37:45,428][123091] Updated weights for policy 0, policy_version 1757591 (0.0006) [2023-12-26 13:37:45,495][123091] Updated weights for policy 0, policy_version 1757601 (0.0005) [2023-12-26 13:37:45,538][123090] Updated weights for policy 1, policy_version 1745793 (0.0010) [2023-12-26 13:37:45,563][123091] Updated weights for policy 0, policy_version 1757611 (0.0006) [2023-12-26 13:37:45,601][123090] Updated weights for policy 1, policy_version 1745803 (0.0008) [2023-12-26 13:37:45,670][123090] Updated weights for policy 1, policy_version 1745813 (0.0007) [2023-12-26 13:37:45,729][123090] Updated weights for policy 1, policy_version 1745823 (0.0010) [2023-12-26 13:37:46,272][123091] Updated weights for policy 0, policy_version 1757621 (0.0005) [2023-12-26 13:37:46,328][123091] Updated weights for policy 0, policy_version 1757631 (0.0005) [2023-12-26 13:37:46,389][123091] Updated weights for policy 0, policy_version 1757641 (0.0005) [2023-12-26 13:37:46,604][123090] Updated weights for policy 1, policy_version 1745833 (0.0010) [2023-12-26 13:37:46,661][123090] Updated weights for policy 1, policy_version 1745843 (0.0010) [2023-12-26 13:37:46,713][123090] Updated weights for policy 1, policy_version 1745853 (0.0009) [2023-12-26 13:37:47,120][123091] Updated weights for policy 0, policy_version 1757651 (0.0007) [2023-12-26 13:37:47,175][123091] Updated weights for policy 0, policy_version 1757661 (0.0010) [2023-12-26 13:37:47,225][123091] Updated weights for policy 0, policy_version 1757671 (0.0010) [2023-12-26 13:37:47,476][123090] Updated weights for policy 1, policy_version 1745863 (0.0008) [2023-12-26 13:37:47,534][123090] Updated weights for policy 1, policy_version 1745873 (0.0010) [2023-12-26 13:37:47,582][123090] Updated weights for policy 1, policy_version 1745883 (0.0010) [2023-12-26 13:37:47,944][123091] Updated weights for policy 0, policy_version 1757681 (0.0010) [2023-12-26 13:37:48,006][123091] Updated weights for policy 0, policy_version 1757691 (0.0005) [2023-12-26 13:37:48,065][123091] Updated weights for policy 0, policy_version 1757701 (0.0005) [2023-12-26 13:37:48,119][123091] Updated weights for policy 0, policy_version 1757711 (0.0007) [2023-12-26 13:37:48,291][123090] Updated weights for policy 1, policy_version 1745893 (0.0009) [2023-12-26 13:37:48,355][123090] Updated weights for policy 1, policy_version 1745903 (0.0011) [2023-12-26 13:37:48,426][123090] Updated weights for policy 1, policy_version 1745913 (0.0011) [2023-12-26 13:37:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 896933888. Throughput: 0: 8897.5, 1: 8870.1. Samples: 896947008. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:48,785][121949] Avg episode reward: [(0, '5940.293'), (1, '5454.769')] [2023-12-26 13:37:48,899][123091] Updated weights for policy 0, policy_version 1757721 (0.0011) [2023-12-26 13:37:48,958][123091] Updated weights for policy 0, policy_version 1757731 (0.0010) [2023-12-26 13:37:49,013][123091] Updated weights for policy 0, policy_version 1757741 (0.0010) [2023-12-26 13:37:49,157][123090] Updated weights for policy 1, policy_version 1745923 (0.0009) [2023-12-26 13:37:49,225][123090] Updated weights for policy 1, policy_version 1745933 (0.0007) [2023-12-26 13:37:49,298][123090] Updated weights for policy 1, policy_version 1745943 (0.0009) [2023-12-26 13:37:49,839][123091] Updated weights for policy 0, policy_version 1757751 (0.0011) [2023-12-26 13:37:49,903][123091] Updated weights for policy 0, policy_version 1757761 (0.0011) [2023-12-26 13:37:49,976][123091] Updated weights for policy 0, policy_version 1757771 (0.0009) [2023-12-26 13:37:50,075][123090] Updated weights for policy 1, policy_version 1745953 (0.0008) [2023-12-26 13:37:50,149][123090] Updated weights for policy 1, policy_version 1745963 (0.0005) [2023-12-26 13:37:50,222][123090] Updated weights for policy 1, policy_version 1745973 (0.0006) [2023-12-26 13:37:50,297][123090] Updated weights for policy 1, policy_version 1745983 (0.0005) [2023-12-26 13:37:50,700][123091] Updated weights for policy 0, policy_version 1757781 (0.0010) [2023-12-26 13:37:50,772][123091] Updated weights for policy 0, policy_version 1757791 (0.0006) [2023-12-26 13:37:50,844][123091] Updated weights for policy 0, policy_version 1757801 (0.0005) [2023-12-26 13:37:51,101][123090] Updated weights for policy 1, policy_version 1745993 (0.0007) [2023-12-26 13:37:51,171][123090] Updated weights for policy 1, policy_version 1746003 (0.0009) [2023-12-26 13:37:51,233][123090] Updated weights for policy 1, policy_version 1746013 (0.0008) [2023-12-26 13:37:51,613][123091] Updated weights for policy 0, policy_version 1757811 (0.0007) [2023-12-26 13:37:51,675][123091] Updated weights for policy 0, policy_version 1757821 (0.0009) [2023-12-26 13:37:51,740][123091] Updated weights for policy 0, policy_version 1757831 (0.0008) [2023-12-26 13:37:52,047][123090] Updated weights for policy 1, policy_version 1746023 (0.0010) [2023-12-26 13:37:52,106][123090] Updated weights for policy 1, policy_version 1746033 (0.0010) [2023-12-26 13:37:52,174][123090] Updated weights for policy 1, policy_version 1746043 (0.0010) [2023-12-26 13:37:52,554][123091] Updated weights for policy 0, policy_version 1757841 (0.0007) [2023-12-26 13:37:52,610][123091] Updated weights for policy 0, policy_version 1757851 (0.0009) [2023-12-26 13:37:52,666][123091] Updated weights for policy 0, policy_version 1757861 (0.0009) [2023-12-26 13:37:52,720][123091] Updated weights for policy 0, policy_version 1757871 (0.0009) [2023-12-26 13:37:52,922][123090] Updated weights for policy 1, policy_version 1746053 (0.0008) [2023-12-26 13:37:52,981][123090] Updated weights for policy 1, policy_version 1746063 (0.0005) [2023-12-26 13:37:53,049][123090] Updated weights for policy 1, policy_version 1746073 (0.0005) [2023-12-26 13:37:53,393][123091] Updated weights for policy 0, policy_version 1757881 (0.0006) [2023-12-26 13:37:53,453][123091] Updated weights for policy 0, policy_version 1757891 (0.0007) [2023-12-26 13:37:53,513][123091] Updated weights for policy 0, policy_version 1757901 (0.0006) [2023-12-26 13:37:53,708][123090] Updated weights for policy 1, policy_version 1746083 (0.0005) [2023-12-26 13:37:53,766][123090] Updated weights for policy 1, policy_version 1746093 (0.0005) [2023-12-26 13:37:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 897024000. Throughput: 0: 8886.3, 1: 8875.2. Samples: 897000024. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:53,785][121949] Avg episode reward: [(0, '6081.469'), (1, '5626.206')] [2023-12-26 13:37:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001757904_450027520.pth... [2023-12-26 13:37:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001756848_449757184.pth [2023-12-26 13:37:53,823][123090] Updated weights for policy 1, policy_version 1746103 (0.0005) [2023-12-26 13:37:53,871][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001746112_447004672.pth... [2023-12-26 13:37:53,874][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001745056_446734336.pth [2023-12-26 13:37:54,208][123091] Updated weights for policy 0, policy_version 1757911 (0.0008) [2023-12-26 13:37:54,260][123091] Updated weights for policy 0, policy_version 1757921 (0.0010) [2023-12-26 13:37:54,327][123091] Updated weights for policy 0, policy_version 1757932 (0.0010) [2023-12-26 13:37:54,494][123090] Updated weights for policy 1, policy_version 1746113 (0.0008) [2023-12-26 13:37:54,546][123090] Updated weights for policy 1, policy_version 1746123 (0.0005) [2023-12-26 13:37:54,592][123090] Updated weights for policy 1, policy_version 1746133 (0.0007) [2023-12-26 13:37:54,648][123090] Updated weights for policy 1, policy_version 1746143 (0.0005) [2023-12-26 13:37:55,239][123091] Updated weights for policy 0, policy_version 1757942 (0.0010) [2023-12-26 13:37:55,304][123091] Updated weights for policy 0, policy_version 1757952 (0.0009) [2023-12-26 13:37:55,359][123091] Updated weights for policy 0, policy_version 1757962 (0.0009) [2023-12-26 13:37:55,482][123090] Updated weights for policy 1, policy_version 1746153 (0.0009) [2023-12-26 13:37:55,530][123090] Updated weights for policy 1, policy_version 1746163 (0.0008) [2023-12-26 13:37:55,595][123090] Updated weights for policy 1, policy_version 1746173 (0.0008) [2023-12-26 13:37:56,223][123091] Updated weights for policy 0, policy_version 1757972 (0.0009) [2023-12-26 13:37:56,280][123091] Updated weights for policy 0, policy_version 1757982 (0.0009) [2023-12-26 13:37:56,344][123091] Updated weights for policy 0, policy_version 1757992 (0.0009) [2023-12-26 13:37:56,416][123090] Updated weights for policy 1, policy_version 1746183 (0.0008) [2023-12-26 13:37:56,472][123090] Updated weights for policy 1, policy_version 1746193 (0.0005) [2023-12-26 13:37:56,545][123090] Updated weights for policy 1, policy_version 1746203 (0.0005) [2023-12-26 13:37:57,050][123091] Updated weights for policy 0, policy_version 1758003 (0.0009) [2023-12-26 13:37:57,110][123091] Updated weights for policy 0, policy_version 1758013 (0.0005) [2023-12-26 13:37:57,114][123090] Updated weights for policy 1, policy_version 1746213 (0.0006) [2023-12-26 13:37:57,164][123091] Updated weights for policy 0, policy_version 1758023 (0.0005) [2023-12-26 13:37:57,170][123090] Updated weights for policy 1, policy_version 1746223 (0.0010) [2023-12-26 13:37:57,226][123090] Updated weights for policy 1, policy_version 1746233 (0.0008) [2023-12-26 13:37:57,866][123091] Updated weights for policy 0, policy_version 1758033 (0.0006) [2023-12-26 13:37:57,917][123091] Updated weights for policy 0, policy_version 1758043 (0.0007) [2023-12-26 13:37:57,963][123091] Updated weights for policy 0, policy_version 1758053 (0.0009) [2023-12-26 13:37:58,022][123091] Updated weights for policy 0, policy_version 1758063 (0.0009) [2023-12-26 13:37:58,080][123090] Updated weights for policy 1, policy_version 1746244 (0.0010) [2023-12-26 13:37:58,144][123090] Updated weights for policy 1, policy_version 1746254 (0.0008) [2023-12-26 13:37:58,198][123090] Updated weights for policy 1, policy_version 1746264 (0.0009) [2023-12-26 13:37:58,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 897114112. Throughput: 0: 8945.1, 1: 8988.7. Samples: 897111168. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:37:58,785][121949] Avg episode reward: [(0, '6165.078'), (1, '5679.873')] [2023-12-26 13:37:58,892][123091] Updated weights for policy 0, policy_version 1758073 (0.0008) [2023-12-26 13:37:58,955][123091] Updated weights for policy 0, policy_version 1758083 (0.0009) [2023-12-26 13:37:59,018][123091] Updated weights for policy 0, policy_version 1758093 (0.0009) [2023-12-26 13:37:59,190][123090] Updated weights for policy 1, policy_version 1746274 (0.0009) [2023-12-26 13:37:59,263][123090] Updated weights for policy 1, policy_version 1746284 (0.0008) [2023-12-26 13:37:59,336][123090] Updated weights for policy 1, policy_version 1746294 (0.0008) [2023-12-26 13:37:59,404][123090] Updated weights for policy 1, policy_version 1746304 (0.0008) [2023-12-26 13:37:59,974][123091] Updated weights for policy 0, policy_version 1758103 (0.0010) [2023-12-26 13:38:00,035][123091] Updated weights for policy 0, policy_version 1758113 (0.0010) [2023-12-26 13:38:00,103][123091] Updated weights for policy 0, policy_version 1758123 (0.0009) [2023-12-26 13:38:00,123][123090] Updated weights for policy 1, policy_version 1746314 (0.0008) [2023-12-26 13:38:00,173][123090] Updated weights for policy 1, policy_version 1746324 (0.0009) [2023-12-26 13:38:00,245][123090] Updated weights for policy 1, policy_version 1746334 (0.0009) [2023-12-26 13:38:00,974][123091] Updated weights for policy 0, policy_version 1758133 (0.0007) [2023-12-26 13:38:01,028][123090] Updated weights for policy 1, policy_version 1746344 (0.0006) [2023-12-26 13:38:01,042][123091] Updated weights for policy 0, policy_version 1758143 (0.0008) [2023-12-26 13:38:01,099][123090] Updated weights for policy 1, policy_version 1746354 (0.0007) [2023-12-26 13:38:01,113][123091] Updated weights for policy 0, policy_version 1758153 (0.0010) [2023-12-26 13:38:01,154][123090] Updated weights for policy 1, policy_version 1746364 (0.0005) [2023-12-26 13:38:01,913][123090] Updated weights for policy 1, policy_version 1746374 (0.0005) [2023-12-26 13:38:01,960][123090] Updated weights for policy 1, policy_version 1746384 (0.0008) [2023-12-26 13:38:01,986][123091] Updated weights for policy 0, policy_version 1758163 (0.0009) [2023-12-26 13:38:02,011][123090] Updated weights for policy 1, policy_version 1746394 (0.0008) [2023-12-26 13:38:02,035][123091] Updated weights for policy 0, policy_version 1758173 (0.0007) [2023-12-26 13:38:02,094][123091] Updated weights for policy 0, policy_version 1758183 (0.0010) [2023-12-26 13:38:02,837][123090] Updated weights for policy 1, policy_version 1746404 (0.0009) [2023-12-26 13:38:02,888][123090] Updated weights for policy 1, policy_version 1746414 (0.0009) [2023-12-26 13:38:02,935][123091] Updated weights for policy 0, policy_version 1758193 (0.0009) [2023-12-26 13:38:02,947][123090] Updated weights for policy 1, policy_version 1746424 (0.0009) [2023-12-26 13:38:02,987][123091] Updated weights for policy 0, policy_version 1758203 (0.0008) [2023-12-26 13:38:03,037][123091] Updated weights for policy 0, policy_version 1758213 (0.0008) [2023-12-26 13:38:03,090][123091] Updated weights for policy 0, policy_version 1758223 (0.0010) [2023-12-26 13:38:03,714][123090] Updated weights for policy 1, policy_version 1746434 (0.0007) [2023-12-26 13:38:03,762][123090] Updated weights for policy 1, policy_version 1746444 (0.0005) [2023-12-26 13:38:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 897196032. Throughput: 0: 8854.6, 1: 8960.4. Samples: 897213496. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:38:03,785][121949] Avg episode reward: [(0, '6129.104'), (1, '5764.834')] [2023-12-26 13:38:03,808][123090] Updated weights for policy 1, policy_version 1746454 (0.0005) [2023-12-26 13:38:03,865][123091] Updated weights for policy 0, policy_version 1758233 (0.0007) [2023-12-26 13:38:03,880][123090] Updated weights for policy 1, policy_version 1746464 (0.0007) [2023-12-26 13:38:03,916][123091] Updated weights for policy 0, policy_version 1758243 (0.0006) [2023-12-26 13:38:03,981][123091] Updated weights for policy 0, policy_version 1758253 (0.0008) [2023-12-26 13:38:04,700][123090] Updated weights for policy 1, policy_version 1746474 (0.0005) [2023-12-26 13:38:04,770][123090] Updated weights for policy 1, policy_version 1746484 (0.0008) [2023-12-26 13:38:04,801][123091] Updated weights for policy 0, policy_version 1758263 (0.0010) [2023-12-26 13:38:04,836][123090] Updated weights for policy 1, policy_version 1746494 (0.0008) [2023-12-26 13:38:04,853][123091] Updated weights for policy 0, policy_version 1758273 (0.0009) [2023-12-26 13:38:04,916][123091] Updated weights for policy 0, policy_version 1758283 (0.0009) [2023-12-26 13:38:05,476][123090] Updated weights for policy 1, policy_version 1746504 (0.0006) [2023-12-26 13:38:05,535][123090] Updated weights for policy 1, policy_version 1746514 (0.0005) [2023-12-26 13:38:05,582][123090] Updated weights for policy 1, policy_version 1746524 (0.0009) [2023-12-26 13:38:05,795][123091] Updated weights for policy 0, policy_version 1758293 (0.0009) [2023-12-26 13:38:05,847][123091] Updated weights for policy 0, policy_version 1758303 (0.0008) [2023-12-26 13:38:05,905][123091] Updated weights for policy 0, policy_version 1758313 (0.0009) [2023-12-26 13:38:06,335][123090] Updated weights for policy 1, policy_version 1746534 (0.0010) [2023-12-26 13:38:06,392][123090] Updated weights for policy 1, policy_version 1746544 (0.0009) [2023-12-26 13:38:06,447][123090] Updated weights for policy 1, policy_version 1746554 (0.0008) [2023-12-26 13:38:06,760][123091] Updated weights for policy 0, policy_version 1758323 (0.0010) [2023-12-26 13:38:06,825][123091] Updated weights for policy 0, policy_version 1758333 (0.0009) [2023-12-26 13:38:06,874][123091] Updated weights for policy 0, policy_version 1758343 (0.0009) [2023-12-26 13:38:07,287][123090] Updated weights for policy 1, policy_version 1746564 (0.0010) [2023-12-26 13:38:07,336][123090] Updated weights for policy 1, policy_version 1746574 (0.0009) [2023-12-26 13:38:07,389][123090] Updated weights for policy 1, policy_version 1746584 (0.0010) [2023-12-26 13:38:07,720][123091] Updated weights for policy 0, policy_version 1758353 (0.0010) [2023-12-26 13:38:07,778][123091] Updated weights for policy 0, policy_version 1758363 (0.0010) [2023-12-26 13:38:07,826][123091] Updated weights for policy 0, policy_version 1758373 (0.0009) [2023-12-26 13:38:07,878][123091] Updated weights for policy 0, policy_version 1758383 (0.0010) [2023-12-26 13:38:08,243][123090] Updated weights for policy 1, policy_version 1746594 (0.0009) [2023-12-26 13:38:08,297][123090] Updated weights for policy 1, policy_version 1746604 (0.0010) [2023-12-26 13:38:08,358][123090] Updated weights for policy 1, policy_version 1746614 (0.0010) [2023-12-26 13:38:08,413][123090] Updated weights for policy 1, policy_version 1746624 (0.0009) [2023-12-26 13:38:08,735][123091] Updated weights for policy 0, policy_version 1758393 (0.0010) [2023-12-26 13:38:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 897286144. Throughput: 0: 8814.6, 1: 9022.6. Samples: 897266788. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:38:08,785][121949] Avg episode reward: [(0, '5984.330'), (1, '5839.216')] [2023-12-26 13:38:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001746624_447135744.pth... [2023-12-26 13:38:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001745568_446865408.pth [2023-12-26 13:38:08,817][123091] Updated weights for policy 0, policy_version 1758403 (0.0009) [2023-12-26 13:38:08,884][123091] Updated weights for policy 0, policy_version 1758413 (0.0007) [2023-12-26 13:38:08,904][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001758416_450158592.pth... [2023-12-26 13:38:08,908][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001757392_449896448.pth [2023-12-26 13:38:09,262][123090] Updated weights for policy 1, policy_version 1746634 (0.0010) [2023-12-26 13:38:09,319][123090] Updated weights for policy 1, policy_version 1746644 (0.0010) [2023-12-26 13:38:09,382][123090] Updated weights for policy 1, policy_version 1746654 (0.0008) [2023-12-26 13:38:09,682][123091] Updated weights for policy 0, policy_version 1758423 (0.0007) [2023-12-26 13:38:09,752][123091] Updated weights for policy 0, policy_version 1758433 (0.0005) [2023-12-26 13:38:09,822][123091] Updated weights for policy 0, policy_version 1758443 (0.0006) [2023-12-26 13:38:10,171][123090] Updated weights for policy 1, policy_version 1746664 (0.0009) [2023-12-26 13:38:10,244][123090] Updated weights for policy 1, policy_version 1746674 (0.0009) [2023-12-26 13:38:10,308][123090] Updated weights for policy 1, policy_version 1746684 (0.0010) [2023-12-26 13:38:10,556][123091] Updated weights for policy 0, policy_version 1758453 (0.0008) [2023-12-26 13:38:10,604][123091] Updated weights for policy 0, policy_version 1758463 (0.0006) [2023-12-26 13:38:10,666][123091] Updated weights for policy 0, policy_version 1758473 (0.0005) [2023-12-26 13:38:11,185][123090] Updated weights for policy 1, policy_version 1746694 (0.0009) [2023-12-26 13:38:11,252][123090] Updated weights for policy 1, policy_version 1746704 (0.0007) [2023-12-26 13:38:11,321][123090] Updated weights for policy 1, policy_version 1746714 (0.0009) [2023-12-26 13:38:11,422][123091] Updated weights for policy 0, policy_version 1758483 (0.0006) [2023-12-26 13:38:11,482][123091] Updated weights for policy 0, policy_version 1758493 (0.0006) [2023-12-26 13:38:11,533][123091] Updated weights for policy 0, policy_version 1758503 (0.0006) [2023-12-26 13:38:12,131][123090] Updated weights for policy 1, policy_version 1746724 (0.0010) [2023-12-26 13:38:12,188][123090] Updated weights for policy 1, policy_version 1746734 (0.0011) [2023-12-26 13:38:12,243][123091] Updated weights for policy 0, policy_version 1758513 (0.0006) [2023-12-26 13:38:12,254][123090] Updated weights for policy 1, policy_version 1746744 (0.0011) [2023-12-26 13:38:12,314][123091] Updated weights for policy 0, policy_version 1758523 (0.0007) [2023-12-26 13:38:12,389][123091] Updated weights for policy 0, policy_version 1758533 (0.0008) [2023-12-26 13:38:12,450][123091] Updated weights for policy 0, policy_version 1758543 (0.0009) [2023-12-26 13:38:13,118][123090] Updated weights for policy 1, policy_version 1746754 (0.0011) [2023-12-26 13:38:13,182][123090] Updated weights for policy 1, policy_version 1746764 (0.0008) [2023-12-26 13:38:13,197][123091] Updated weights for policy 0, policy_version 1758553 (0.0007) [2023-12-26 13:38:13,252][123091] Updated weights for policy 0, policy_version 1758563 (0.0007) [2023-12-26 13:38:13,258][123090] Updated weights for policy 1, policy_version 1746774 (0.0008) [2023-12-26 13:38:13,318][123091] Updated weights for policy 0, policy_version 1758573 (0.0008) [2023-12-26 13:38:13,326][123090] Updated weights for policy 1, policy_version 1746784 (0.0007) [2023-12-26 13:38:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 897376256. Throughput: 0: 8804.8, 1: 8931.0. Samples: 897370404. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:38:13,785][121949] Avg episode reward: [(0, '6059.849'), (1, '5835.685')] [2023-12-26 13:38:13,972][123091] Updated weights for policy 0, policy_version 1758583 (0.0005) [2023-12-26 13:38:13,979][123090] Updated weights for policy 1, policy_version 1746794 (0.0005) [2023-12-26 13:38:14,022][123091] Updated weights for policy 0, policy_version 1758593 (0.0006) [2023-12-26 13:38:14,038][123090] Updated weights for policy 1, policy_version 1746804 (0.0005) [2023-12-26 13:38:14,078][123091] Updated weights for policy 0, policy_version 1758603 (0.0005) [2023-12-26 13:38:14,094][123090] Updated weights for policy 1, policy_version 1746814 (0.0007) [2023-12-26 13:38:14,731][123091] Updated weights for policy 0, policy_version 1758613 (0.0006) [2023-12-26 13:38:14,809][123091] Updated weights for policy 0, policy_version 1758623 (0.0007) [2023-12-26 13:38:14,868][123091] Updated weights for policy 0, policy_version 1758633 (0.0008) [2023-12-26 13:38:14,910][123090] Updated weights for policy 1, policy_version 1746824 (0.0007) [2023-12-26 13:38:14,972][123090] Updated weights for policy 1, policy_version 1746834 (0.0009) [2023-12-26 13:38:15,039][123090] Updated weights for policy 1, policy_version 1746844 (0.0009) [2023-12-26 13:38:15,586][123091] Updated weights for policy 0, policy_version 1758643 (0.0009) [2023-12-26 13:38:15,653][123091] Updated weights for policy 0, policy_version 1758653 (0.0007) [2023-12-26 13:38:15,723][123091] Updated weights for policy 0, policy_version 1758663 (0.0005) [2023-12-26 13:38:15,891][123090] Updated weights for policy 1, policy_version 1746854 (0.0009) [2023-12-26 13:38:15,956][123090] Updated weights for policy 1, policy_version 1746864 (0.0006) [2023-12-26 13:38:16,014][123090] Updated weights for policy 1, policy_version 1746874 (0.0005) [2023-12-26 13:38:16,393][123091] Updated weights for policy 0, policy_version 1758673 (0.0008) [2023-12-26 13:38:16,456][123091] Updated weights for policy 0, policy_version 1758683 (0.0009) [2023-12-26 13:38:16,511][123091] Updated weights for policy 0, policy_version 1758693 (0.0010) [2023-12-26 13:38:16,574][123091] Updated weights for policy 0, policy_version 1758703 (0.0010) [2023-12-26 13:38:16,738][123090] Updated weights for policy 1, policy_version 1746884 (0.0007) [2023-12-26 13:38:16,797][123090] Updated weights for policy 1, policy_version 1746895 (0.0010) [2023-12-26 13:38:16,851][123090] Updated weights for policy 1, policy_version 1746905 (0.0009) [2023-12-26 13:38:17,198][123091] Updated weights for policy 0, policy_version 1758713 (0.0008) [2023-12-26 13:38:17,249][123091] Updated weights for policy 0, policy_version 1758723 (0.0005) [2023-12-26 13:38:17,312][123091] Updated weights for policy 0, policy_version 1758733 (0.0005) [2023-12-26 13:38:17,793][123090] Updated weights for policy 1, policy_version 1746915 (0.0010) [2023-12-26 13:38:17,842][123090] Updated weights for policy 1, policy_version 1746925 (0.0009) [2023-12-26 13:38:17,901][123090] Updated weights for policy 1, policy_version 1746935 (0.0009) [2023-12-26 13:38:17,982][123091] Updated weights for policy 0, policy_version 1758743 (0.0008) [2023-12-26 13:38:18,035][123091] Updated weights for policy 0, policy_version 1758753 (0.0009) [2023-12-26 13:38:18,090][123091] Updated weights for policy 0, policy_version 1758763 (0.0009) [2023-12-26 13:38:18,705][123090] Updated weights for policy 1, policy_version 1746945 (0.0008) [2023-12-26 13:38:18,777][123090] Updated weights for policy 1, policy_version 1746955 (0.0006) [2023-12-26 13:38:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 897466368. Throughput: 0: 8958.1, 1: 8875.4. Samples: 897482808. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:38:18,785][121949] Avg episode reward: [(0, '6204.341'), (1, '5871.081')] [2023-12-26 13:38:18,835][123090] Updated weights for policy 1, policy_version 1746965 (0.0006) [2023-12-26 13:38:18,858][123091] Updated weights for policy 0, policy_version 1758773 (0.0007) [2023-12-26 13:38:18,894][123090] Updated weights for policy 1, policy_version 1746975 (0.0006) [2023-12-26 13:38:18,923][123091] Updated weights for policy 0, policy_version 1758783 (0.0005) [2023-12-26 13:38:18,980][123091] Updated weights for policy 0, policy_version 1758793 (0.0006) [2023-12-26 13:38:19,696][123090] Updated weights for policy 1, policy_version 1746985 (0.0009) [2023-12-26 13:38:19,727][123091] Updated weights for policy 0, policy_version 1758803 (0.0005) [2023-12-26 13:38:19,760][123090] Updated weights for policy 1, policy_version 1746995 (0.0009) [2023-12-26 13:38:19,792][123091] Updated weights for policy 0, policy_version 1758813 (0.0006) [2023-12-26 13:38:19,825][123090] Updated weights for policy 1, policy_version 1747005 (0.0009) [2023-12-26 13:38:19,860][123091] Updated weights for policy 0, policy_version 1758823 (0.0007) [2023-12-26 13:38:20,658][123090] Updated weights for policy 1, policy_version 1747015 (0.0009) [2023-12-26 13:38:20,712][123091] Updated weights for policy 0, policy_version 1758833 (0.0009) [2023-12-26 13:38:20,714][123090] Updated weights for policy 1, policy_version 1747025 (0.0009) [2023-12-26 13:38:20,776][123090] Updated weights for policy 1, policy_version 1747035 (0.0009) [2023-12-26 13:38:20,776][123091] Updated weights for policy 0, policy_version 1758843 (0.0008) [2023-12-26 13:38:20,847][123091] Updated weights for policy 0, policy_version 1758853 (0.0010) [2023-12-26 13:38:20,901][123091] Updated weights for policy 0, policy_version 1758863 (0.0010) [2023-12-26 13:38:21,575][123090] Updated weights for policy 1, policy_version 1747045 (0.0008) [2023-12-26 13:38:21,642][123090] Updated weights for policy 1, policy_version 1747055 (0.0007) [2023-12-26 13:38:21,707][123090] Updated weights for policy 1, policy_version 1747065 (0.0009) [2023-12-26 13:38:21,804][123091] Updated weights for policy 0, policy_version 1758873 (0.0009) [2023-12-26 13:38:21,881][123091] Updated weights for policy 0, policy_version 1758883 (0.0009) [2023-12-26 13:38:21,941][123091] Updated weights for policy 0, policy_version 1758893 (0.0010) [2023-12-26 13:38:22,507][123090] Updated weights for policy 1, policy_version 1747075 (0.0008) [2023-12-26 13:38:22,573][123090] Updated weights for policy 1, policy_version 1747085 (0.0007) [2023-12-26 13:38:22,635][123090] Updated weights for policy 1, policy_version 1747095 (0.0008) [2023-12-26 13:38:22,798][123091] Updated weights for policy 0, policy_version 1758903 (0.0010) [2023-12-26 13:38:22,854][123091] Updated weights for policy 0, policy_version 1758913 (0.0005) [2023-12-26 13:38:22,921][123091] Updated weights for policy 0, policy_version 1758923 (0.0010) [2023-12-26 13:38:23,408][123090] Updated weights for policy 1, policy_version 1747105 (0.0010) [2023-12-26 13:38:23,476][123090] Updated weights for policy 1, policy_version 1747115 (0.0009) [2023-12-26 13:38:23,533][123090] Updated weights for policy 1, policy_version 1747125 (0.0009) [2023-12-26 13:38:23,592][123090] Updated weights for policy 1, policy_version 1747135 (0.0009) [2023-12-26 13:38:23,738][123091] Updated weights for policy 0, policy_version 1758933 (0.0011) [2023-12-26 13:38:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17689.1). Total num frames: 897556480. Throughput: 0: 8958.7, 1: 8862.6. Samples: 897535712. Policy #0 lag: (min: 27.0, avg: 29.3, max: 59.0) [2023-12-26 13:38:23,785][121949] Avg episode reward: [(0, '6190.144'), (1, '5780.271')] [2023-12-26 13:38:23,789][123091] Updated weights for policy 0, policy_version 1758943 (0.0010) [2023-12-26 13:38:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001747136_447266816.pth... [2023-12-26 13:38:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001746112_447004672.pth [2023-12-26 13:38:23,846][123091] Updated weights for policy 0, policy_version 1758953 (0.0010) [2023-12-26 13:38:23,883][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001758960_450297856.pth... [2023-12-26 13:38:23,886][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001757904_450027520.pth [2023-12-26 13:38:24,479][123090] Updated weights for policy 1, policy_version 1747145 (0.0009) [2023-12-26 13:38:24,541][123090] Updated weights for policy 1, policy_version 1747155 (0.0009) [2023-12-26 13:38:24,608][123090] Updated weights for policy 1, policy_version 1747165 (0.0008) [2023-12-26 13:38:24,618][123091] Updated weights for policy 0, policy_version 1758963 (0.0010) [2023-12-26 13:38:24,669][123091] Updated weights for policy 0, policy_version 1758973 (0.0010) [2023-12-26 13:38:24,716][123091] Updated weights for policy 0, policy_version 1758983 (0.0010) [2023-12-26 13:38:25,436][123090] Updated weights for policy 1, policy_version 1747175 (0.0008) [2023-12-26 13:38:25,501][123090] Updated weights for policy 1, policy_version 1747185 (0.0008) [2023-12-26 13:38:25,546][123091] Updated weights for policy 0, policy_version 1758993 (0.0010) [2023-12-26 13:38:25,574][123090] Updated weights for policy 1, policy_version 1747195 (0.0006) [2023-12-26 13:38:25,614][123091] Updated weights for policy 0, policy_version 1759003 (0.0011) [2023-12-26 13:38:25,683][123091] Updated weights for policy 0, policy_version 1759013 (0.0010) [2023-12-26 13:38:25,735][123091] Updated weights for policy 0, policy_version 1759023 (0.0009) [2023-12-26 13:38:26,357][123090] Updated weights for policy 1, policy_version 1747205 (0.0008) [2023-12-26 13:38:26,414][123090] Updated weights for policy 1, policy_version 1747215 (0.0006) [2023-12-26 13:38:26,414][123091] Updated weights for policy 0, policy_version 1759033 (0.0005) [2023-12-26 13:38:26,484][123090] Updated weights for policy 1, policy_version 1747225 (0.0006) [2023-12-26 13:38:26,486][123091] Updated weights for policy 0, policy_version 1759043 (0.0009) [2023-12-26 13:38:26,541][123091] Updated weights for policy 0, policy_version 1759053 (0.0009) [2023-12-26 13:38:27,119][123090] Updated weights for policy 1, policy_version 1747235 (0.0005) [2023-12-26 13:38:27,167][123090] Updated weights for policy 1, policy_version 1747245 (0.0005) [2023-12-26 13:38:27,219][123090] Updated weights for policy 1, policy_version 1747255 (0.0005) [2023-12-26 13:38:27,425][123091] Updated weights for policy 0, policy_version 1759063 (0.0009) [2023-12-26 13:38:27,482][123091] Updated weights for policy 0, policy_version 1759073 (0.0010) [2023-12-26 13:38:27,539][123091] Updated weights for policy 0, policy_version 1759083 (0.0010) [2023-12-26 13:38:27,962][123090] Updated weights for policy 1, policy_version 1747265 (0.0006) [2023-12-26 13:38:28,025][123090] Updated weights for policy 1, policy_version 1747275 (0.0009) [2023-12-26 13:38:28,074][123090] Updated weights for policy 1, policy_version 1747285 (0.0009) [2023-12-26 13:38:28,122][123090] Updated weights for policy 1, policy_version 1747295 (0.0009) [2023-12-26 13:38:28,382][123091] Updated weights for policy 0, policy_version 1759093 (0.0009) [2023-12-26 13:38:28,451][123091] Updated weights for policy 0, policy_version 1759103 (0.0008) [2023-12-26 13:38:28,508][123091] Updated weights for policy 0, policy_version 1759113 (0.0009) [2023-12-26 13:38:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 897646592. Throughput: 0: 8953.5, 1: 8912.2. Samples: 897641400. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:28,784][121949] Avg episode reward: [(0, '6234.404'), (1, '5804.373')] [2023-12-26 13:38:28,966][123090] Updated weights for policy 1, policy_version 1747305 (0.0006) [2023-12-26 13:38:29,019][123090] Updated weights for policy 1, policy_version 1747315 (0.0005) [2023-12-26 13:38:29,074][123090] Updated weights for policy 1, policy_version 1747325 (0.0005) [2023-12-26 13:38:29,331][123091] Updated weights for policy 0, policy_version 1759123 (0.0010) [2023-12-26 13:38:29,400][123091] Updated weights for policy 0, policy_version 1759133 (0.0008) [2023-12-26 13:38:29,458][123091] Updated weights for policy 0, policy_version 1759143 (0.0008) [2023-12-26 13:38:29,837][123090] Updated weights for policy 1, policy_version 1747335 (0.0008) [2023-12-26 13:38:29,911][123090] Updated weights for policy 1, policy_version 1747345 (0.0008) [2023-12-26 13:38:29,978][123090] Updated weights for policy 1, policy_version 1747355 (0.0008) [2023-12-26 13:38:30,270][123091] Updated weights for policy 0, policy_version 1759153 (0.0008) [2023-12-26 13:38:30,324][123091] Updated weights for policy 0, policy_version 1759163 (0.0010) [2023-12-26 13:38:30,381][123091] Updated weights for policy 0, policy_version 1759173 (0.0009) [2023-12-26 13:38:30,439][123091] Updated weights for policy 0, policy_version 1759183 (0.0009) [2023-12-26 13:38:30,740][123090] Updated weights for policy 1, policy_version 1747365 (0.0008) [2023-12-26 13:38:30,789][123090] Updated weights for policy 1, policy_version 1747375 (0.0009) [2023-12-26 13:38:30,837][123090] Updated weights for policy 1, policy_version 1747385 (0.0009) [2023-12-26 13:38:31,312][123091] Updated weights for policy 0, policy_version 1759193 (0.0009) [2023-12-26 13:38:31,387][123091] Updated weights for policy 0, policy_version 1759203 (0.0010) [2023-12-26 13:38:31,454][123091] Updated weights for policy 0, policy_version 1759213 (0.0009) [2023-12-26 13:38:31,725][123090] Updated weights for policy 1, policy_version 1747395 (0.0008) [2023-12-26 13:38:31,785][123090] Updated weights for policy 1, policy_version 1747405 (0.0008) [2023-12-26 13:38:31,837][123090] Updated weights for policy 1, policy_version 1747415 (0.0009) [2023-12-26 13:38:32,254][123091] Updated weights for policy 0, policy_version 1759223 (0.0006) [2023-12-26 13:38:32,327][123091] Updated weights for policy 0, policy_version 1759233 (0.0006) [2023-12-26 13:38:32,398][123091] Updated weights for policy 0, policy_version 1759243 (0.0007) [2023-12-26 13:38:32,699][123090] Updated weights for policy 1, policy_version 1747425 (0.0009) [2023-12-26 13:38:32,754][123090] Updated weights for policy 1, policy_version 1747435 (0.0010) [2023-12-26 13:38:32,821][123090] Updated weights for policy 1, policy_version 1747445 (0.0010) [2023-12-26 13:38:32,883][123090] Updated weights for policy 1, policy_version 1747455 (0.0010) [2023-12-26 13:38:33,127][123091] Updated weights for policy 0, policy_version 1759253 (0.0009) [2023-12-26 13:38:33,174][123091] Updated weights for policy 0, policy_version 1759263 (0.0010) [2023-12-26 13:38:33,218][123091] Updated weights for policy 0, policy_version 1759273 (0.0010) [2023-12-26 13:38:33,627][123090] Updated weights for policy 1, policy_version 1747465 (0.0006) [2023-12-26 13:38:33,679][123090] Updated weights for policy 1, policy_version 1747475 (0.0008) [2023-12-26 13:38:33,746][123090] Updated weights for policy 1, policy_version 1747485 (0.0008) [2023-12-26 13:38:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 897736704. Throughput: 0: 8873.9, 1: 8877.6. Samples: 897745824. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:33,785][121949] Avg episode reward: [(0, '6230.238'), (1, '5752.925')] [2023-12-26 13:38:34,068][123091] Updated weights for policy 0, policy_version 1759283 (0.0010) [2023-12-26 13:38:34,130][123091] Updated weights for policy 0, policy_version 1759293 (0.0011) [2023-12-26 13:38:34,195][123091] Updated weights for policy 0, policy_version 1759303 (0.0011) [2023-12-26 13:38:34,559][123090] Updated weights for policy 1, policy_version 1747495 (0.0006) [2023-12-26 13:38:34,616][123090] Updated weights for policy 1, policy_version 1747505 (0.0009) [2023-12-26 13:38:34,677][123090] Updated weights for policy 1, policy_version 1747515 (0.0005) [2023-12-26 13:38:35,015][123091] Updated weights for policy 0, policy_version 1759313 (0.0011) [2023-12-26 13:38:35,088][123091] Updated weights for policy 0, policy_version 1759323 (0.0011) [2023-12-26 13:38:35,157][123091] Updated weights for policy 0, policy_version 1759333 (0.0011) [2023-12-26 13:38:35,219][123091] Updated weights for policy 0, policy_version 1759343 (0.0011) [2023-12-26 13:38:35,409][123090] Updated weights for policy 1, policy_version 1747525 (0.0006) [2023-12-26 13:38:35,460][123090] Updated weights for policy 1, policy_version 1747535 (0.0005) [2023-12-26 13:38:35,506][123090] Updated weights for policy 1, policy_version 1747545 (0.0005) [2023-12-26 13:38:36,003][123091] Updated weights for policy 0, policy_version 1759353 (0.0006) [2023-12-26 13:38:36,055][123091] Updated weights for policy 0, policy_version 1759363 (0.0005) [2023-12-26 13:38:36,074][123090] Updated weights for policy 1, policy_version 1747555 (0.0005) [2023-12-26 13:38:36,115][123091] Updated weights for policy 0, policy_version 1759373 (0.0008) [2023-12-26 13:38:36,141][123090] Updated weights for policy 1, policy_version 1747565 (0.0008) [2023-12-26 13:38:36,203][123090] Updated weights for policy 1, policy_version 1747575 (0.0008) [2023-12-26 13:38:36,957][123091] Updated weights for policy 0, policy_version 1759383 (0.0009) [2023-12-26 13:38:37,011][123090] Updated weights for policy 1, policy_version 1747585 (0.0008) [2023-12-26 13:38:37,022][123091] Updated weights for policy 0, policy_version 1759393 (0.0009) [2023-12-26 13:38:37,068][123090] Updated weights for policy 1, policy_version 1747595 (0.0008) [2023-12-26 13:38:37,083][123091] Updated weights for policy 0, policy_version 1759403 (0.0009) [2023-12-26 13:38:37,120][123090] Updated weights for policy 1, policy_version 1747605 (0.0006) [2023-12-26 13:38:37,175][123090] Updated weights for policy 1, policy_version 1747615 (0.0010) [2023-12-26 13:38:37,890][123091] Updated weights for policy 0, policy_version 1759413 (0.0008) [2023-12-26 13:38:37,946][123091] Updated weights for policy 0, policy_version 1759423 (0.0010) [2023-12-26 13:38:37,999][123091] Updated weights for policy 0, policy_version 1759433 (0.0010) [2023-12-26 13:38:38,045][123090] Updated weights for policy 1, policy_version 1747625 (0.0008) [2023-12-26 13:38:38,105][123090] Updated weights for policy 1, policy_version 1747635 (0.0009) [2023-12-26 13:38:38,173][123090] Updated weights for policy 1, policy_version 1747645 (0.0009) [2023-12-26 13:38:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 897818624. Throughput: 0: 8859.9, 1: 8928.4. Samples: 897800496. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:38,785][121949] Avg episode reward: [(0, '6178.969'), (1, '5731.687')] [2023-12-26 13:38:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001759440_450420736.pth... [2023-12-26 13:38:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001747648_447397888.pth... [2023-12-26 13:38:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001758416_450158592.pth [2023-12-26 13:38:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001746624_447135744.pth [2023-12-26 13:38:38,891][123091] Updated weights for policy 0, policy_version 1759443 (0.0009) [2023-12-26 13:38:38,937][123090] Updated weights for policy 1, policy_version 1747655 (0.0007) [2023-12-26 13:38:38,953][123091] Updated weights for policy 0, policy_version 1759453 (0.0006) [2023-12-26 13:38:39,004][123090] Updated weights for policy 1, policy_version 1747665 (0.0006) [2023-12-26 13:38:39,019][123091] Updated weights for policy 0, policy_version 1759463 (0.0007) [2023-12-26 13:38:39,071][123090] Updated weights for policy 1, policy_version 1747675 (0.0006) [2023-12-26 13:38:39,833][123091] Updated weights for policy 0, policy_version 1759473 (0.0010) [2023-12-26 13:38:39,901][123091] Updated weights for policy 0, policy_version 1759483 (0.0009) [2023-12-26 13:38:39,903][123090] Updated weights for policy 1, policy_version 1747685 (0.0006) [2023-12-26 13:38:39,975][123091] Updated weights for policy 0, policy_version 1759493 (0.0007) [2023-12-26 13:38:39,976][123090] Updated weights for policy 1, policy_version 1747695 (0.0008) [2023-12-26 13:38:40,028][123090] Updated weights for policy 1, policy_version 1747705 (0.0007) [2023-12-26 13:38:40,048][123091] Updated weights for policy 0, policy_version 1759503 (0.0006) [2023-12-26 13:38:40,699][123090] Updated weights for policy 1, policy_version 1747715 (0.0007) [2023-12-26 13:38:40,758][123090] Updated weights for policy 1, policy_version 1747725 (0.0006) [2023-12-26 13:38:40,803][123090] Updated weights for policy 1, policy_version 1747735 (0.0008) [2023-12-26 13:38:40,812][123091] Updated weights for policy 0, policy_version 1759513 (0.0009) [2023-12-26 13:38:40,869][123091] Updated weights for policy 0, policy_version 1759523 (0.0009) [2023-12-26 13:38:40,920][123091] Updated weights for policy 0, policy_version 1759534 (0.0009) [2023-12-26 13:38:41,645][123090] Updated weights for policy 1, policy_version 1747745 (0.0008) [2023-12-26 13:38:41,719][123090] Updated weights for policy 1, policy_version 1747755 (0.0008) [2023-12-26 13:38:41,790][123090] Updated weights for policy 1, policy_version 1747765 (0.0008) [2023-12-26 13:38:41,798][123091] Updated weights for policy 0, policy_version 1759544 (0.0009) [2023-12-26 13:38:41,860][123090] Updated weights for policy 1, policy_version 1747775 (0.0007) [2023-12-26 13:38:41,862][123091] Updated weights for policy 0, policy_version 1759554 (0.0007) [2023-12-26 13:38:41,920][123091] Updated weights for policy 0, policy_version 1759564 (0.0010) [2023-12-26 13:38:42,682][123090] Updated weights for policy 1, policy_version 1747785 (0.0009) [2023-12-26 13:38:42,682][123091] Updated weights for policy 0, policy_version 1759574 (0.0010) [2023-12-26 13:38:42,748][123090] Updated weights for policy 1, policy_version 1747795 (0.0009) [2023-12-26 13:38:42,750][123091] Updated weights for policy 0, policy_version 1759584 (0.0009) [2023-12-26 13:38:42,812][123090] Updated weights for policy 1, policy_version 1747805 (0.0007) [2023-12-26 13:38:42,814][123091] Updated weights for policy 0, policy_version 1759594 (0.0008) [2023-12-26 13:38:43,593][123090] Updated weights for policy 1, policy_version 1747815 (0.0008) [2023-12-26 13:38:43,645][123090] Updated weights for policy 1, policy_version 1747825 (0.0010) [2023-12-26 13:38:43,676][123091] Updated weights for policy 0, policy_version 1759604 (0.0009) [2023-12-26 13:38:43,700][123090] Updated weights for policy 1, policy_version 1747835 (0.0009) [2023-12-26 13:38:43,729][123091] Updated weights for policy 0, policy_version 1759614 (0.0011) [2023-12-26 13:38:43,784][123091] Updated weights for policy 0, policy_version 1759624 (0.0011) [2023-12-26 13:38:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 897908736. Throughput: 0: 8787.9, 1: 8838.7. Samples: 897904368. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:43,785][121949] Avg episode reward: [(0, '6136.181'), (1, '5715.724')] [2023-12-26 13:38:44,481][123091] Updated weights for policy 0, policy_version 1759634 (0.0009) [2023-12-26 13:38:44,544][123091] Updated weights for policy 0, policy_version 1759644 (0.0005) [2023-12-26 13:38:44,552][123090] Updated weights for policy 1, policy_version 1747845 (0.0009) [2023-12-26 13:38:44,602][123091] Updated weights for policy 0, policy_version 1759654 (0.0010) [2023-12-26 13:38:44,605][123090] Updated weights for policy 1, policy_version 1747855 (0.0006) [2023-12-26 13:38:44,657][123091] Updated weights for policy 0, policy_version 1759664 (0.0010) [2023-12-26 13:38:44,660][123090] Updated weights for policy 1, policy_version 1747865 (0.0005) [2023-12-26 13:38:45,477][123091] Updated weights for policy 0, policy_version 1759674 (0.0011) [2023-12-26 13:38:45,514][123090] Updated weights for policy 1, policy_version 1747875 (0.0008) [2023-12-26 13:38:45,534][123091] Updated weights for policy 0, policy_version 1759684 (0.0011) [2023-12-26 13:38:45,576][123090] Updated weights for policy 1, policy_version 1747885 (0.0006) [2023-12-26 13:38:45,591][123091] Updated weights for policy 0, policy_version 1759694 (0.0011) [2023-12-26 13:38:45,636][123090] Updated weights for policy 1, policy_version 1747895 (0.0009) [2023-12-26 13:38:46,413][123091] Updated weights for policy 0, policy_version 1759704 (0.0011) [2023-12-26 13:38:46,468][123090] Updated weights for policy 1, policy_version 1747905 (0.0008) [2023-12-26 13:38:46,474][123091] Updated weights for policy 0, policy_version 1759714 (0.0011) [2023-12-26 13:38:46,528][123091] Updated weights for policy 0, policy_version 1759724 (0.0006) [2023-12-26 13:38:46,532][123090] Updated weights for policy 1, policy_version 1747915 (0.0008) [2023-12-26 13:38:46,600][123090] Updated weights for policy 1, policy_version 1747925 (0.0007) [2023-12-26 13:38:46,666][123090] Updated weights for policy 1, policy_version 1747935 (0.0009) [2023-12-26 13:38:47,256][123091] Updated weights for policy 0, policy_version 1759734 (0.0006) [2023-12-26 13:38:47,313][123091] Updated weights for policy 0, policy_version 1759744 (0.0005) [2023-12-26 13:38:47,375][123091] Updated weights for policy 0, policy_version 1759754 (0.0007) [2023-12-26 13:38:47,547][123090] Updated weights for policy 1, policy_version 1747945 (0.0009) [2023-12-26 13:38:47,601][123090] Updated weights for policy 1, policy_version 1747955 (0.0010) [2023-12-26 13:38:47,654][123090] Updated weights for policy 1, policy_version 1747965 (0.0010) [2023-12-26 13:38:47,973][123091] Updated weights for policy 0, policy_version 1759764 (0.0009) [2023-12-26 13:38:48,032][123091] Updated weights for policy 0, policy_version 1759774 (0.0011) [2023-12-26 13:38:48,083][123091] Updated weights for policy 0, policy_version 1759784 (0.0010) [2023-12-26 13:38:48,574][123090] Updated weights for policy 1, policy_version 1747976 (0.0009) [2023-12-26 13:38:48,636][123090] Updated weights for policy 1, policy_version 1747986 (0.0009) [2023-12-26 13:38:48,697][123090] Updated weights for policy 1, policy_version 1747996 (0.0009) [2023-12-26 13:38:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 897998848. Throughput: 0: 8904.2, 1: 8781.5. Samples: 898009352. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:48,785][121949] Avg episode reward: [(0, '6149.444'), (1, '5751.162')] [2023-12-26 13:38:48,818][123091] Updated weights for policy 0, policy_version 1759794 (0.0009) [2023-12-26 13:38:48,884][123091] Updated weights for policy 0, policy_version 1759804 (0.0005) [2023-12-26 13:38:48,952][123091] Updated weights for policy 0, policy_version 1759814 (0.0009) [2023-12-26 13:38:49,010][123091] Updated weights for policy 0, policy_version 1759824 (0.0010) [2023-12-26 13:38:49,568][123090] Updated weights for policy 1, policy_version 1748006 (0.0009) [2023-12-26 13:38:49,617][123090] Updated weights for policy 1, policy_version 1748016 (0.0008) [2023-12-26 13:38:49,670][123090] Updated weights for policy 1, policy_version 1748026 (0.0009) [2023-12-26 13:38:49,786][123091] Updated weights for policy 0, policy_version 1759834 (0.0009) [2023-12-26 13:38:49,851][123091] Updated weights for policy 0, policy_version 1759844 (0.0010) [2023-12-26 13:38:49,918][123091] Updated weights for policy 0, policy_version 1759854 (0.0010) [2023-12-26 13:38:50,532][123090] Updated weights for policy 1, policy_version 1748036 (0.0009) [2023-12-26 13:38:50,593][123090] Updated weights for policy 1, policy_version 1748046 (0.0009) [2023-12-26 13:38:50,659][123090] Updated weights for policy 1, policy_version 1748056 (0.0010) [2023-12-26 13:38:50,737][123091] Updated weights for policy 0, policy_version 1759864 (0.0008) [2023-12-26 13:38:50,806][123091] Updated weights for policy 0, policy_version 1759874 (0.0008) [2023-12-26 13:38:50,875][123091] Updated weights for policy 0, policy_version 1759884 (0.0008) [2023-12-26 13:38:51,529][123090] Updated weights for policy 1, policy_version 1748066 (0.0009) [2023-12-26 13:38:51,589][123090] Updated weights for policy 1, policy_version 1748076 (0.0010) [2023-12-26 13:38:51,655][123091] Updated weights for policy 0, policy_version 1759894 (0.0008) [2023-12-26 13:38:51,661][123090] Updated weights for policy 1, policy_version 1748086 (0.0008) [2023-12-26 13:38:51,717][123091] Updated weights for policy 0, policy_version 1759904 (0.0007) [2023-12-26 13:38:51,740][123090] Updated weights for policy 1, policy_version 1748096 (0.0009) [2023-12-26 13:38:51,789][123091] Updated weights for policy 0, policy_version 1759914 (0.0009) [2023-12-26 13:38:52,596][123090] Updated weights for policy 1, policy_version 1748106 (0.0010) [2023-12-26 13:38:52,653][123091] Updated weights for policy 0, policy_version 1759924 (0.0009) [2023-12-26 13:38:52,659][123090] Updated weights for policy 1, policy_version 1748116 (0.0010) [2023-12-26 13:38:52,721][123091] Updated weights for policy 0, policy_version 1759934 (0.0005) [2023-12-26 13:38:52,724][123090] Updated weights for policy 1, policy_version 1748126 (0.0010) [2023-12-26 13:38:52,781][123091] Updated weights for policy 0, policy_version 1759944 (0.0009) [2023-12-26 13:38:53,511][123091] Updated weights for policy 0, policy_version 1759954 (0.0009) [2023-12-26 13:38:53,574][123090] Updated weights for policy 1, policy_version 1748136 (0.0008) [2023-12-26 13:38:53,580][123091] Updated weights for policy 0, policy_version 1759964 (0.0009) [2023-12-26 13:38:53,636][123091] Updated weights for policy 0, policy_version 1759974 (0.0010) [2023-12-26 13:38:53,638][123090] Updated weights for policy 1, policy_version 1748146 (0.0005) [2023-12-26 13:38:53,691][123091] Updated weights for policy 0, policy_version 1759984 (0.0010) [2023-12-26 13:38:53,698][123090] Updated weights for policy 1, policy_version 1748156 (0.0006) [2023-12-26 13:38:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 898088960. Throughput: 0: 8924.9, 1: 8712.9. Samples: 898060496. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:53,785][121949] Avg episode reward: [(0, '6190.895'), (1, '5656.925')] [2023-12-26 13:38:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001759984_450560000.pth... [2023-12-26 13:38:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001748160_447528960.pth... [2023-12-26 13:38:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001747136_447266816.pth [2023-12-26 13:38:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001758960_450297856.pth [2023-12-26 13:38:54,481][123090] Updated weights for policy 1, policy_version 1748166 (0.0008) [2023-12-26 13:38:54,501][123091] Updated weights for policy 0, policy_version 1759994 (0.0007) [2023-12-26 13:38:54,547][123090] Updated weights for policy 1, policy_version 1748176 (0.0005) [2023-12-26 13:38:54,552][123091] Updated weights for policy 0, policy_version 1760004 (0.0008) [2023-12-26 13:38:54,612][123090] Updated weights for policy 1, policy_version 1748186 (0.0007) [2023-12-26 13:38:54,619][123091] Updated weights for policy 0, policy_version 1760014 (0.0010) [2023-12-26 13:38:55,309][123090] Updated weights for policy 1, policy_version 1748196 (0.0006) [2023-12-26 13:38:55,367][123090] Updated weights for policy 1, policy_version 1748206 (0.0005) [2023-12-26 13:38:55,405][123091] Updated weights for policy 0, policy_version 1760024 (0.0010) [2023-12-26 13:38:55,421][123090] Updated weights for policy 1, policy_version 1748216 (0.0006) [2023-12-26 13:38:55,457][123091] Updated weights for policy 0, policy_version 1760034 (0.0010) [2023-12-26 13:38:55,512][123091] Updated weights for policy 0, policy_version 1760044 (0.0010) [2023-12-26 13:38:56,160][123090] Updated weights for policy 1, policy_version 1748226 (0.0007) [2023-12-26 13:38:56,218][123090] Updated weights for policy 1, policy_version 1748236 (0.0009) [2023-12-26 13:38:56,277][123090] Updated weights for policy 1, policy_version 1748246 (0.0009) [2023-12-26 13:38:56,294][123091] Updated weights for policy 0, policy_version 1760054 (0.0009) [2023-12-26 13:38:56,330][123090] Updated weights for policy 1, policy_version 1748256 (0.0009) [2023-12-26 13:38:56,340][123091] Updated weights for policy 0, policy_version 1760064 (0.0006) [2023-12-26 13:38:56,385][123091] Updated weights for policy 0, policy_version 1760074 (0.0005) [2023-12-26 13:38:57,143][123091] Updated weights for policy 0, policy_version 1760084 (0.0007) [2023-12-26 13:38:57,205][123091] Updated weights for policy 0, policy_version 1760094 (0.0010) [2023-12-26 13:38:57,240][123090] Updated weights for policy 1, policy_version 1748266 (0.0009) [2023-12-26 13:38:57,273][123091] Updated weights for policy 0, policy_version 1760104 (0.0010) [2023-12-26 13:38:57,294][123090] Updated weights for policy 1, policy_version 1748276 (0.0010) [2023-12-26 13:38:57,373][123090] Updated weights for policy 1, policy_version 1748286 (0.0010) [2023-12-26 13:38:58,056][123091] Updated weights for policy 0, policy_version 1760114 (0.0010) [2023-12-26 13:38:58,074][123090] Updated weights for policy 1, policy_version 1748296 (0.0006) [2023-12-26 13:38:58,124][123091] Updated weights for policy 0, policy_version 1760124 (0.0008) [2023-12-26 13:38:58,139][123090] Updated weights for policy 1, policy_version 1748306 (0.0008) [2023-12-26 13:38:58,184][123091] Updated weights for policy 0, policy_version 1760134 (0.0006) [2023-12-26 13:38:58,201][123090] Updated weights for policy 1, policy_version 1748316 (0.0008) [2023-12-26 13:38:58,243][123091] Updated weights for policy 0, policy_version 1760144 (0.0010) [2023-12-26 13:38:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 898170880. Throughput: 0: 8951.7, 1: 8750.2. Samples: 898166984. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:38:58,785][121949] Avg episode reward: [(0, '6023.704'), (1, '5691.656')] [2023-12-26 13:38:59,042][123090] Updated weights for policy 1, policy_version 1748326 (0.0009) [2023-12-26 13:38:59,099][123091] Updated weights for policy 0, policy_version 1760154 (0.0010) [2023-12-26 13:38:59,106][123090] Updated weights for policy 1, policy_version 1748336 (0.0009) [2023-12-26 13:38:59,163][123091] Updated weights for policy 0, policy_version 1760164 (0.0009) [2023-12-26 13:38:59,170][123090] Updated weights for policy 1, policy_version 1748346 (0.0007) [2023-12-26 13:38:59,229][123091] Updated weights for policy 0, policy_version 1760174 (0.0010) [2023-12-26 13:39:00,004][123090] Updated weights for policy 1, policy_version 1748356 (0.0008) [2023-12-26 13:39:00,065][123090] Updated weights for policy 1, policy_version 1748366 (0.0009) [2023-12-26 13:39:00,073][123091] Updated weights for policy 0, policy_version 1760184 (0.0011) [2023-12-26 13:39:00,118][123090] Updated weights for policy 1, policy_version 1748376 (0.0008) [2023-12-26 13:39:00,131][123091] Updated weights for policy 0, policy_version 1760194 (0.0010) [2023-12-26 13:39:00,193][123091] Updated weights for policy 0, policy_version 1760204 (0.0010) [2023-12-26 13:39:00,970][123091] Updated weights for policy 0, policy_version 1760214 (0.0010) [2023-12-26 13:39:00,976][123090] Updated weights for policy 1, policy_version 1748386 (0.0009) [2023-12-26 13:39:01,024][123091] Updated weights for policy 0, policy_version 1760224 (0.0009) [2023-12-26 13:39:01,031][123090] Updated weights for policy 1, policy_version 1748396 (0.0008) [2023-12-26 13:39:01,095][123091] Updated weights for policy 0, policy_version 1760234 (0.0009) [2023-12-26 13:39:01,098][123090] Updated weights for policy 1, policy_version 1748406 (0.0007) [2023-12-26 13:39:01,164][123090] Updated weights for policy 1, policy_version 1748416 (0.0009) [2023-12-26 13:39:01,932][123091] Updated weights for policy 0, policy_version 1760244 (0.0009) [2023-12-26 13:39:01,979][123091] Updated weights for policy 0, policy_version 1760254 (0.0008) [2023-12-26 13:39:01,989][123090] Updated weights for policy 1, policy_version 1748426 (0.0008) [2023-12-26 13:39:02,036][123091] Updated weights for policy 0, policy_version 1760264 (0.0007) [2023-12-26 13:39:02,054][123090] Updated weights for policy 1, policy_version 1748436 (0.0009) [2023-12-26 13:39:02,115][123090] Updated weights for policy 1, policy_version 1748446 (0.0007) [2023-12-26 13:39:02,802][123091] Updated weights for policy 0, policy_version 1760274 (0.0007) [2023-12-26 13:39:02,862][123091] Updated weights for policy 0, policy_version 1760284 (0.0006) [2023-12-26 13:39:02,885][123090] Updated weights for policy 1, policy_version 1748456 (0.0008) [2023-12-26 13:39:02,921][123091] Updated weights for policy 0, policy_version 1760294 (0.0008) [2023-12-26 13:39:02,940][123090] Updated weights for policy 1, policy_version 1748466 (0.0008) [2023-12-26 13:39:02,984][123091] Updated weights for policy 0, policy_version 1760304 (0.0008) [2023-12-26 13:39:02,992][123090] Updated weights for policy 1, policy_version 1748476 (0.0008) [2023-12-26 13:39:03,619][123091] Updated weights for policy 0, policy_version 1760314 (0.0005) [2023-12-26 13:39:03,673][123091] Updated weights for policy 0, policy_version 1760324 (0.0008) [2023-12-26 13:39:03,730][123091] Updated weights for policy 0, policy_version 1760334 (0.0008) [2023-12-26 13:39:03,753][123090] Updated weights for policy 1, policy_version 1748486 (0.0007) [2023-12-26 13:39:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 898260992. Throughput: 0: 8825.1, 1: 8756.5. Samples: 898273984. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:03,785][121949] Avg episode reward: [(0, '5892.556'), (1, '5720.105')] [2023-12-26 13:39:03,806][123090] Updated weights for policy 1, policy_version 1748496 (0.0005) [2023-12-26 13:39:03,865][123090] Updated weights for policy 1, policy_version 1748506 (0.0006) [2023-12-26 13:39:04,500][123091] Updated weights for policy 0, policy_version 1760344 (0.0009) [2023-12-26 13:39:04,555][123091] Updated weights for policy 0, policy_version 1760354 (0.0009) [2023-12-26 13:39:04,613][123091] Updated weights for policy 0, policy_version 1760364 (0.0008) [2023-12-26 13:39:04,635][123090] Updated weights for policy 1, policy_version 1748516 (0.0007) [2023-12-26 13:39:04,687][123090] Updated weights for policy 1, policy_version 1748526 (0.0009) [2023-12-26 13:39:04,735][123090] Updated weights for policy 1, policy_version 1748536 (0.0009) [2023-12-26 13:39:05,461][123091] Updated weights for policy 0, policy_version 1760374 (0.0009) [2023-12-26 13:39:05,511][123091] Updated weights for policy 0, policy_version 1760384 (0.0008) [2023-12-26 13:39:05,557][123091] Updated weights for policy 0, policy_version 1760394 (0.0005) [2023-12-26 13:39:05,591][123090] Updated weights for policy 1, policy_version 1748546 (0.0009) [2023-12-26 13:39:05,657][123090] Updated weights for policy 1, policy_version 1748556 (0.0008) [2023-12-26 13:39:05,728][123090] Updated weights for policy 1, policy_version 1748566 (0.0009) [2023-12-26 13:39:05,793][123090] Updated weights for policy 1, policy_version 1748576 (0.0009) [2023-12-26 13:39:06,362][123091] Updated weights for policy 0, policy_version 1760404 (0.0007) [2023-12-26 13:39:06,411][123091] Updated weights for policy 0, policy_version 1760414 (0.0009) [2023-12-26 13:39:06,464][123091] Updated weights for policy 0, policy_version 1760424 (0.0009) [2023-12-26 13:39:06,522][123090] Updated weights for policy 1, policy_version 1748586 (0.0011) [2023-12-26 13:39:06,590][123090] Updated weights for policy 1, policy_version 1748596 (0.0011) [2023-12-26 13:39:06,655][123090] Updated weights for policy 1, policy_version 1748606 (0.0010) [2023-12-26 13:39:07,283][123091] Updated weights for policy 0, policy_version 1760434 (0.0006) [2023-12-26 13:39:07,344][123091] Updated weights for policy 0, policy_version 1760444 (0.0006) [2023-12-26 13:39:07,390][123091] Updated weights for policy 0, policy_version 1760454 (0.0005) [2023-12-26 13:39:07,456][123091] Updated weights for policy 0, policy_version 1760464 (0.0007) [2023-12-26 13:39:07,458][123090] Updated weights for policy 1, policy_version 1748616 (0.0009) [2023-12-26 13:39:07,512][123090] Updated weights for policy 1, policy_version 1748626 (0.0010) [2023-12-26 13:39:07,565][123090] Updated weights for policy 1, policy_version 1748636 (0.0010) [2023-12-26 13:39:08,218][123091] Updated weights for policy 0, policy_version 1760474 (0.0011) [2023-12-26 13:39:08,283][123091] Updated weights for policy 0, policy_version 1760484 (0.0010) [2023-12-26 13:39:08,350][123091] Updated weights for policy 0, policy_version 1760494 (0.0011) [2023-12-26 13:39:08,381][123090] Updated weights for policy 1, policy_version 1748646 (0.0008) [2023-12-26 13:39:08,456][123090] Updated weights for policy 1, policy_version 1748656 (0.0005) [2023-12-26 13:39:08,530][123090] Updated weights for policy 1, policy_version 1748666 (0.0005) [2023-12-26 13:39:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 898351104. Throughput: 0: 8823.8, 1: 8769.3. Samples: 898327396. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:08,785][121949] Avg episode reward: [(0, '5959.760'), (1, '5738.340')] [2023-12-26 13:39:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001760496_450691072.pth... [2023-12-26 13:39:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001748672_447660032.pth... [2023-12-26 13:39:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001759440_450420736.pth [2023-12-26 13:39:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001747648_447397888.pth [2023-12-26 13:39:09,098][123091] Updated weights for policy 0, policy_version 1760504 (0.0011) [2023-12-26 13:39:09,158][123091] Updated weights for policy 0, policy_version 1760514 (0.0011) [2023-12-26 13:39:09,204][123091] Updated weights for policy 0, policy_version 1760524 (0.0010) [2023-12-26 13:39:09,268][123090] Updated weights for policy 1, policy_version 1748676 (0.0007) [2023-12-26 13:39:09,337][123090] Updated weights for policy 1, policy_version 1748686 (0.0011) [2023-12-26 13:39:09,404][123090] Updated weights for policy 1, policy_version 1748696 (0.0009) [2023-12-26 13:39:09,982][123091] Updated weights for policy 0, policy_version 1760534 (0.0009) [2023-12-26 13:39:10,043][123091] Updated weights for policy 0, policy_version 1760544 (0.0010) [2023-12-26 13:39:10,100][123091] Updated weights for policy 0, policy_version 1760554 (0.0010) [2023-12-26 13:39:10,202][123090] Updated weights for policy 1, policy_version 1748706 (0.0009) [2023-12-26 13:39:10,255][123090] Updated weights for policy 1, policy_version 1748716 (0.0008) [2023-12-26 13:39:10,327][123090] Updated weights for policy 1, policy_version 1748726 (0.0006) [2023-12-26 13:39:10,391][123090] Updated weights for policy 1, policy_version 1748736 (0.0006) [2023-12-26 13:39:10,894][123091] Updated weights for policy 0, policy_version 1760564 (0.0010) [2023-12-26 13:39:10,954][123091] Updated weights for policy 0, policy_version 1760574 (0.0009) [2023-12-26 13:39:11,017][123091] Updated weights for policy 0, policy_version 1760584 (0.0009) [2023-12-26 13:39:11,029][123090] Updated weights for policy 1, policy_version 1748746 (0.0009) [2023-12-26 13:39:11,104][123090] Updated weights for policy 1, policy_version 1748756 (0.0008) [2023-12-26 13:39:11,171][123090] Updated weights for policy 1, policy_version 1748766 (0.0009) [2023-12-26 13:39:11,970][123090] Updated weights for policy 1, policy_version 1748776 (0.0008) [2023-12-26 13:39:11,976][123091] Updated weights for policy 0, policy_version 1760594 (0.0008) [2023-12-26 13:39:12,036][123090] Updated weights for policy 1, policy_version 1748786 (0.0008) [2023-12-26 13:39:12,043][123091] Updated weights for policy 0, policy_version 1760604 (0.0006) [2023-12-26 13:39:12,093][123090] Updated weights for policy 1, policy_version 1748796 (0.0010) [2023-12-26 13:39:12,104][123091] Updated weights for policy 0, policy_version 1760614 (0.0006) [2023-12-26 13:39:12,167][123091] Updated weights for policy 0, policy_version 1760624 (0.0005) [2023-12-26 13:39:12,917][123090] Updated weights for policy 1, policy_version 1748806 (0.0010) [2023-12-26 13:39:12,929][123091] Updated weights for policy 0, policy_version 1760634 (0.0008) [2023-12-26 13:39:12,984][123090] Updated weights for policy 1, policy_version 1748816 (0.0010) [2023-12-26 13:39:12,989][123091] Updated weights for policy 0, policy_version 1760644 (0.0009) [2023-12-26 13:39:13,049][123091] Updated weights for policy 0, policy_version 1760654 (0.0006) [2023-12-26 13:39:13,050][123090] Updated weights for policy 1, policy_version 1748826 (0.0010) [2023-12-26 13:39:13,783][123090] Updated weights for policy 1, policy_version 1748836 (0.0010) [2023-12-26 13:39:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 898433024. Throughput: 0: 8849.1, 1: 8762.0. Samples: 898433896. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:13,784][121949] Avg episode reward: [(0, '6025.274'), (1, '5669.692')] [2023-12-26 13:39:13,837][123090] Updated weights for policy 1, policy_version 1748846 (0.0010) [2023-12-26 13:39:13,896][123090] Updated weights for policy 1, policy_version 1748856 (0.0011) [2023-12-26 13:39:13,911][123091] Updated weights for policy 0, policy_version 1760664 (0.0008) [2023-12-26 13:39:13,973][123091] Updated weights for policy 0, policy_version 1760674 (0.0007) [2023-12-26 13:39:14,032][123091] Updated weights for policy 0, policy_version 1760684 (0.0008) [2023-12-26 13:39:14,695][123090] Updated weights for policy 1, policy_version 1748866 (0.0011) [2023-12-26 13:39:14,747][123090] Updated weights for policy 1, policy_version 1748876 (0.0010) [2023-12-26 13:39:14,818][123090] Updated weights for policy 1, policy_version 1748886 (0.0009) [2023-12-26 13:39:14,873][123091] Updated weights for policy 0, policy_version 1760694 (0.0009) [2023-12-26 13:39:14,881][123090] Updated weights for policy 1, policy_version 1748896 (0.0006) [2023-12-26 13:39:14,931][123091] Updated weights for policy 0, policy_version 1760704 (0.0009) [2023-12-26 13:39:14,988][123091] Updated weights for policy 0, policy_version 1760714 (0.0010) [2023-12-26 13:39:15,737][123090] Updated weights for policy 1, policy_version 1748906 (0.0010) [2023-12-26 13:39:15,799][123090] Updated weights for policy 1, policy_version 1748916 (0.0009) [2023-12-26 13:39:15,817][123091] Updated weights for policy 0, policy_version 1760724 (0.0008) [2023-12-26 13:39:15,872][123091] Updated weights for policy 0, policy_version 1760734 (0.0005) [2023-12-26 13:39:15,873][123090] Updated weights for policy 1, policy_version 1748926 (0.0005) [2023-12-26 13:39:15,924][123091] Updated weights for policy 0, policy_version 1760744 (0.0009) [2023-12-26 13:39:16,568][123090] Updated weights for policy 1, policy_version 1748936 (0.0006) [2023-12-26 13:39:16,638][123090] Updated weights for policy 1, policy_version 1748946 (0.0006) [2023-12-26 13:39:16,679][123091] Updated weights for policy 0, policy_version 1760754 (0.0010) [2023-12-26 13:39:16,704][123090] Updated weights for policy 1, policy_version 1748956 (0.0007) [2023-12-26 13:39:16,734][123091] Updated weights for policy 0, policy_version 1760764 (0.0009) [2023-12-26 13:39:16,807][123091] Updated weights for policy 0, policy_version 1760774 (0.0010) [2023-12-26 13:39:16,875][123091] Updated weights for policy 0, policy_version 1760784 (0.0008) [2023-12-26 13:39:17,456][123090] Updated weights for policy 1, policy_version 1748966 (0.0010) [2023-12-26 13:39:17,509][123090] Updated weights for policy 1, policy_version 1748978 (0.0010) [2023-12-26 13:39:17,568][123091] Updated weights for policy 0, policy_version 1760794 (0.0005) [2023-12-26 13:39:17,570][123090] Updated weights for policy 1, policy_version 1748988 (0.0007) [2023-12-26 13:39:17,623][123091] Updated weights for policy 0, policy_version 1760804 (0.0005) [2023-12-26 13:39:17,670][123091] Updated weights for policy 0, policy_version 1760814 (0.0005) [2023-12-26 13:39:18,277][123090] Updated weights for policy 1, policy_version 1748998 (0.0005) [2023-12-26 13:39:18,336][123090] Updated weights for policy 1, policy_version 1749008 (0.0010) [2023-12-26 13:39:18,353][123091] Updated weights for policy 0, policy_version 1760824 (0.0010) [2023-12-26 13:39:18,404][123090] Updated weights for policy 1, policy_version 1749018 (0.0011) [2023-12-26 13:39:18,405][123091] Updated weights for policy 0, policy_version 1760834 (0.0011) [2023-12-26 13:39:18,469][123091] Updated weights for policy 0, policy_version 1760844 (0.0011) [2023-12-26 13:39:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 898531328. Throughput: 0: 8871.0, 1: 8805.8. Samples: 898541280. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:18,785][121949] Avg episode reward: [(0, '5939.790'), (1, '5534.294')] [2023-12-26 13:39:19,222][123090] Updated weights for policy 1, policy_version 1749028 (0.0010) [2023-12-26 13:39:19,288][123090] Updated weights for policy 1, policy_version 1749038 (0.0009) [2023-12-26 13:39:19,298][123091] Updated weights for policy 0, policy_version 1760854 (0.0011) [2023-12-26 13:39:19,348][123090] Updated weights for policy 1, policy_version 1749048 (0.0010) [2023-12-26 13:39:19,363][123091] Updated weights for policy 0, policy_version 1760864 (0.0010) [2023-12-26 13:39:19,435][123091] Updated weights for policy 0, policy_version 1760874 (0.0010) [2023-12-26 13:39:20,123][123090] Updated weights for policy 1, policy_version 1749058 (0.0009) [2023-12-26 13:39:20,195][123090] Updated weights for policy 1, policy_version 1749068 (0.0011) [2023-12-26 13:39:20,270][123090] Updated weights for policy 1, policy_version 1749078 (0.0011) [2023-12-26 13:39:20,299][123091] Updated weights for policy 0, policy_version 1760884 (0.0009) [2023-12-26 13:39:20,335][123090] Updated weights for policy 1, policy_version 1749088 (0.0011) [2023-12-26 13:39:20,366][123091] Updated weights for policy 0, policy_version 1760894 (0.0008) [2023-12-26 13:39:20,434][123091] Updated weights for policy 0, policy_version 1760904 (0.0008) [2023-12-26 13:39:21,190][123090] Updated weights for policy 1, policy_version 1749098 (0.0011) [2023-12-26 13:39:21,263][123091] Updated weights for policy 0, policy_version 1760914 (0.0010) [2023-12-26 13:39:21,266][123090] Updated weights for policy 1, policy_version 1749108 (0.0011) [2023-12-26 13:39:21,323][123091] Updated weights for policy 0, policy_version 1760924 (0.0011) [2023-12-26 13:39:21,334][123090] Updated weights for policy 1, policy_version 1749118 (0.0011) [2023-12-26 13:39:21,397][123091] Updated weights for policy 0, policy_version 1760934 (0.0010) [2023-12-26 13:39:21,470][123091] Updated weights for policy 0, policy_version 1760944 (0.0006) [2023-12-26 13:39:22,191][123090] Updated weights for policy 1, policy_version 1749128 (0.0009) [2023-12-26 13:39:22,257][123090] Updated weights for policy 1, policy_version 1749138 (0.0009) [2023-12-26 13:39:22,278][123091] Updated weights for policy 0, policy_version 1760954 (0.0011) [2023-12-26 13:39:22,317][123090] Updated weights for policy 1, policy_version 1749148 (0.0009) [2023-12-26 13:39:22,344][123091] Updated weights for policy 0, policy_version 1760964 (0.0012) [2023-12-26 13:39:22,415][123091] Updated weights for policy 0, policy_version 1760974 (0.0010) [2023-12-26 13:39:23,190][123091] Updated weights for policy 0, policy_version 1760984 (0.0010) [2023-12-26 13:39:23,196][123090] Updated weights for policy 1, policy_version 1749158 (0.0007) [2023-12-26 13:39:23,241][123091] Updated weights for policy 0, policy_version 1760994 (0.0010) [2023-12-26 13:39:23,252][123090] Updated weights for policy 1, policy_version 1749168 (0.0006) [2023-12-26 13:39:23,292][123091] Updated weights for policy 0, policy_version 1761004 (0.0010) [2023-12-26 13:39:23,307][123090] Updated weights for policy 1, policy_version 1749178 (0.0005) [2023-12-26 13:39:23,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 898613248. Throughput: 0: 8850.1, 1: 8721.8. Samples: 898591236. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:23,785][121949] Avg episode reward: [(0, '5963.168'), (1, '5494.100')] [2023-12-26 13:39:23,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001761008_450822144.pth... [2023-12-26 13:39:23,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001749184_447791104.pth... [2023-12-26 13:39:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001759984_450560000.pth [2023-12-26 13:39:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001748160_447528960.pth [2023-12-26 13:39:23,932][123091] Updated weights for policy 0, policy_version 1761014 (0.0008) [2023-12-26 13:39:23,976][123091] Updated weights for policy 0, policy_version 1761024 (0.0005) [2023-12-26 13:39:24,025][123091] Updated weights for policy 0, policy_version 1761034 (0.0005) [2023-12-26 13:39:24,032][123090] Updated weights for policy 1, policy_version 1749188 (0.0007) [2023-12-26 13:39:24,089][123090] Updated weights for policy 1, policy_version 1749198 (0.0010) [2023-12-26 13:39:24,138][123090] Updated weights for policy 1, policy_version 1749208 (0.0010) [2023-12-26 13:39:24,649][123091] Updated weights for policy 0, policy_version 1761044 (0.0005) [2023-12-26 13:39:24,694][123091] Updated weights for policy 0, policy_version 1761054 (0.0005) [2023-12-26 13:39:24,748][123091] Updated weights for policy 0, policy_version 1761064 (0.0005) [2023-12-26 13:39:24,981][123090] Updated weights for policy 1, policy_version 1749218 (0.0010) [2023-12-26 13:39:25,032][123090] Updated weights for policy 1, policy_version 1749228 (0.0010) [2023-12-26 13:39:25,083][123090] Updated weights for policy 1, policy_version 1749238 (0.0010) [2023-12-26 13:39:25,147][123090] Updated weights for policy 1, policy_version 1749248 (0.0009) [2023-12-26 13:39:25,437][123091] Updated weights for policy 0, policy_version 1761074 (0.0006) [2023-12-26 13:39:25,499][123091] Updated weights for policy 0, policy_version 1761084 (0.0010) [2023-12-26 13:39:25,553][123091] Updated weights for policy 0, policy_version 1761094 (0.0010) [2023-12-26 13:39:25,600][123091] Updated weights for policy 0, policy_version 1761104 (0.0010) [2023-12-26 13:39:25,847][123090] Updated weights for policy 1, policy_version 1749258 (0.0005) [2023-12-26 13:39:25,909][123090] Updated weights for policy 1, policy_version 1749268 (0.0007) [2023-12-26 13:39:25,971][123090] Updated weights for policy 1, policy_version 1749278 (0.0005) [2023-12-26 13:39:26,479][123091] Updated weights for policy 0, policy_version 1761114 (0.0009) [2023-12-26 13:39:26,537][123091] Updated weights for policy 0, policy_version 1761124 (0.0009) [2023-12-26 13:39:26,589][123091] Updated weights for policy 0, policy_version 1761134 (0.0008) [2023-12-26 13:39:26,602][123090] Updated weights for policy 1, policy_version 1749288 (0.0009) [2023-12-26 13:39:26,655][123090] Updated weights for policy 1, policy_version 1749298 (0.0009) [2023-12-26 13:39:26,704][123090] Updated weights for policy 1, policy_version 1749308 (0.0009) [2023-12-26 13:39:27,450][123091] Updated weights for policy 0, policy_version 1761144 (0.0009) [2023-12-26 13:39:27,506][123091] Updated weights for policy 0, policy_version 1761154 (0.0008) [2023-12-26 13:39:27,517][123090] Updated weights for policy 1, policy_version 1749318 (0.0008) [2023-12-26 13:39:27,561][123090] Updated weights for policy 1, policy_version 1749328 (0.0010) [2023-12-26 13:39:27,562][123091] Updated weights for policy 0, policy_version 1761164 (0.0008) [2023-12-26 13:39:27,617][123090] Updated weights for policy 1, policy_version 1749339 (0.0008) [2023-12-26 13:39:28,334][123091] Updated weights for policy 0, policy_version 1761174 (0.0007) [2023-12-26 13:39:28,365][123090] Updated weights for policy 1, policy_version 1749349 (0.0006) [2023-12-26 13:39:28,403][123091] Updated weights for policy 0, policy_version 1761184 (0.0008) [2023-12-26 13:39:28,429][123090] Updated weights for policy 1, policy_version 1749359 (0.0008) [2023-12-26 13:39:28,467][123091] Updated weights for policy 0, policy_version 1761194 (0.0008) [2023-12-26 13:39:28,488][123090] Updated weights for policy 1, policy_version 1749369 (0.0007) [2023-12-26 13:39:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 898711552. Throughput: 0: 8944.3, 1: 8760.1. Samples: 898701064. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:28,785][121949] Avg episode reward: [(0, '6096.475'), (1, '5665.986')] [2023-12-26 13:39:29,264][123091] Updated weights for policy 0, policy_version 1761204 (0.0009) [2023-12-26 13:39:29,295][123090] Updated weights for policy 1, policy_version 1749379 (0.0010) [2023-12-26 13:39:29,324][123091] Updated weights for policy 0, policy_version 1761214 (0.0009) [2023-12-26 13:39:29,363][123090] Updated weights for policy 1, policy_version 1749389 (0.0007) [2023-12-26 13:39:29,391][123091] Updated weights for policy 0, policy_version 1761224 (0.0008) [2023-12-26 13:39:29,435][123090] Updated weights for policy 1, policy_version 1749399 (0.0008) [2023-12-26 13:39:30,169][123090] Updated weights for policy 1, policy_version 1749409 (0.0006) [2023-12-26 13:39:30,235][123090] Updated weights for policy 1, policy_version 1749419 (0.0005) [2023-12-26 13:39:30,241][123091] Updated weights for policy 0, policy_version 1761234 (0.0008) [2023-12-26 13:39:30,297][123090] Updated weights for policy 1, policy_version 1749429 (0.0005) [2023-12-26 13:39:30,302][123091] Updated weights for policy 0, policy_version 1761244 (0.0008) [2023-12-26 13:39:30,355][123090] Updated weights for policy 1, policy_version 1749439 (0.0005) [2023-12-26 13:39:30,370][123091] Updated weights for policy 0, policy_version 1761254 (0.0009) [2023-12-26 13:39:30,423][123091] Updated weights for policy 0, policy_version 1761264 (0.0010) [2023-12-26 13:39:31,028][123090] Updated weights for policy 1, policy_version 1749449 (0.0006) [2023-12-26 13:39:31,090][123090] Updated weights for policy 1, policy_version 1749459 (0.0010) [2023-12-26 13:39:31,154][123090] Updated weights for policy 1, policy_version 1749469 (0.0011) [2023-12-26 13:39:31,235][123091] Updated weights for policy 0, policy_version 1761274 (0.0009) [2023-12-26 13:39:31,296][123091] Updated weights for policy 0, policy_version 1761284 (0.0009) [2023-12-26 13:39:31,362][123091] Updated weights for policy 0, policy_version 1761294 (0.0009) [2023-12-26 13:39:32,009][123090] Updated weights for policy 1, policy_version 1749479 (0.0008) [2023-12-26 13:39:32,061][123090] Updated weights for policy 1, policy_version 1749489 (0.0006) [2023-12-26 13:39:32,121][123090] Updated weights for policy 1, policy_version 1749499 (0.0010) [2023-12-26 13:39:32,164][123091] Updated weights for policy 0, policy_version 1761304 (0.0006) [2023-12-26 13:39:32,220][123091] Updated weights for policy 0, policy_version 1761314 (0.0010) [2023-12-26 13:39:32,284][123091] Updated weights for policy 0, policy_version 1761324 (0.0009) [2023-12-26 13:39:32,847][123090] Updated weights for policy 1, policy_version 1749509 (0.0008) [2023-12-26 13:39:32,916][123090] Updated weights for policy 1, policy_version 1749519 (0.0005) [2023-12-26 13:39:32,975][123090] Updated weights for policy 1, policy_version 1749529 (0.0005) [2023-12-26 13:39:33,077][123091] Updated weights for policy 0, policy_version 1761334 (0.0009) [2023-12-26 13:39:33,139][123091] Updated weights for policy 0, policy_version 1761344 (0.0008) [2023-12-26 13:39:33,193][123091] Updated weights for policy 0, policy_version 1761354 (0.0008) [2023-12-26 13:39:33,681][123090] Updated weights for policy 1, policy_version 1749539 (0.0005) [2023-12-26 13:39:33,735][123090] Updated weights for policy 1, policy_version 1749549 (0.0005) [2023-12-26 13:39:33,780][123090] Updated weights for policy 1, policy_version 1749559 (0.0005) [2023-12-26 13:39:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 898793472. Throughput: 0: 8901.3, 1: 8885.3. Samples: 898809744. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:33,785][121949] Avg episode reward: [(0, '6151.026'), (1, '5870.533')] [2023-12-26 13:39:33,991][123091] Updated weights for policy 0, policy_version 1761364 (0.0009) [2023-12-26 13:39:34,039][123091] Updated weights for policy 0, policy_version 1761375 (0.0009) [2023-12-26 13:39:34,090][123091] Updated weights for policy 0, policy_version 1761385 (0.0009) [2023-12-26 13:39:34,575][123090] Updated weights for policy 1, policy_version 1749569 (0.0007) [2023-12-26 13:39:34,631][123090] Updated weights for policy 1, policy_version 1749579 (0.0010) [2023-12-26 13:39:34,697][123090] Updated weights for policy 1, policy_version 1749589 (0.0010) [2023-12-26 13:39:34,759][123090] Updated weights for policy 1, policy_version 1749599 (0.0010) [2023-12-26 13:39:34,930][123091] Updated weights for policy 0, policy_version 1761395 (0.0009) [2023-12-26 13:39:34,989][123091] Updated weights for policy 0, policy_version 1761405 (0.0007) [2023-12-26 13:39:35,039][123091] Updated weights for policy 0, policy_version 1761415 (0.0006) [2023-12-26 13:39:35,610][123090] Updated weights for policy 1, policy_version 1749609 (0.0010) [2023-12-26 13:39:35,634][123091] Updated weights for policy 0, policy_version 1761425 (0.0006) [2023-12-26 13:39:35,660][123090] Updated weights for policy 1, policy_version 1749619 (0.0009) [2023-12-26 13:39:35,692][123091] Updated weights for policy 0, policy_version 1761435 (0.0007) [2023-12-26 13:39:35,704][123090] Updated weights for policy 1, policy_version 1749629 (0.0010) [2023-12-26 13:39:35,754][123091] Updated weights for policy 0, policy_version 1761445 (0.0008) [2023-12-26 13:39:35,811][123091] Updated weights for policy 0, policy_version 1761455 (0.0009) [2023-12-26 13:39:36,568][123090] Updated weights for policy 1, policy_version 1749639 (0.0010) [2023-12-26 13:39:36,634][123090] Updated weights for policy 1, policy_version 1749649 (0.0011) [2023-12-26 13:39:36,664][123091] Updated weights for policy 0, policy_version 1761465 (0.0010) [2023-12-26 13:39:36,697][123090] Updated weights for policy 1, policy_version 1749659 (0.0008) [2023-12-26 13:39:36,728][123091] Updated weights for policy 0, policy_version 1761475 (0.0008) [2023-12-26 13:39:36,790][123091] Updated weights for policy 0, policy_version 1761485 (0.0010) [2023-12-26 13:39:37,491][123090] Updated weights for policy 1, policy_version 1749669 (0.0008) [2023-12-26 13:39:37,555][123090] Updated weights for policy 1, policy_version 1749679 (0.0007) [2023-12-26 13:39:37,620][123091] Updated weights for policy 0, policy_version 1761495 (0.0010) [2023-12-26 13:39:37,622][123090] Updated weights for policy 1, policy_version 1749689 (0.0007) [2023-12-26 13:39:37,672][123091] Updated weights for policy 0, policy_version 1761505 (0.0011) [2023-12-26 13:39:37,727][123091] Updated weights for policy 0, policy_version 1761515 (0.0010) [2023-12-26 13:39:38,285][123090] Updated weights for policy 1, policy_version 1749699 (0.0007) [2023-12-26 13:39:38,346][123090] Updated weights for policy 1, policy_version 1749709 (0.0012) [2023-12-26 13:39:38,412][123090] Updated weights for policy 1, policy_version 1749719 (0.0009) [2023-12-26 13:39:38,585][123091] Updated weights for policy 0, policy_version 1761525 (0.0011) [2023-12-26 13:39:38,652][123091] Updated weights for policy 0, policy_version 1761535 (0.0011) [2023-12-26 13:39:38,715][123091] Updated weights for policy 0, policy_version 1761545 (0.0011) [2023-12-26 13:39:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 898891776. Throughput: 0: 8920.9, 1: 8910.5. Samples: 898862908. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:38,785][121949] Avg episode reward: [(0, '6242.039'), (1, '5963.353')] [2023-12-26 13:39:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001749728_447930368.pth... [2023-12-26 13:39:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001761552_450961408.pth... [2023-12-26 13:39:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001748672_447660032.pth [2023-12-26 13:39:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001760496_450691072.pth [2023-12-26 13:39:39,264][123090] Updated weights for policy 1, policy_version 1749729 (0.0009) [2023-12-26 13:39:39,329][123090] Updated weights for policy 1, policy_version 1749739 (0.0010) [2023-12-26 13:39:39,393][123090] Updated weights for policy 1, policy_version 1749749 (0.0010) [2023-12-26 13:39:39,467][123090] Updated weights for policy 1, policy_version 1749759 (0.0008) [2023-12-26 13:39:39,520][123091] Updated weights for policy 0, policy_version 1761555 (0.0010) [2023-12-26 13:39:39,579][123091] Updated weights for policy 0, policy_version 1761565 (0.0008) [2023-12-26 13:39:39,643][123091] Updated weights for policy 0, policy_version 1761575 (0.0008) [2023-12-26 13:39:40,418][123090] Updated weights for policy 1, policy_version 1749769 (0.0009) [2023-12-26 13:39:40,461][123091] Updated weights for policy 0, policy_version 1761585 (0.0008) [2023-12-26 13:39:40,487][123090] Updated weights for policy 1, policy_version 1749779 (0.0010) [2023-12-26 13:39:40,528][123091] Updated weights for policy 0, policy_version 1761595 (0.0008) [2023-12-26 13:39:40,557][123090] Updated weights for policy 1, policy_version 1749789 (0.0008) [2023-12-26 13:39:40,597][123091] Updated weights for policy 0, policy_version 1761605 (0.0010) [2023-12-26 13:39:40,661][123091] Updated weights for policy 0, policy_version 1761615 (0.0010) [2023-12-26 13:39:41,443][123090] Updated weights for policy 1, policy_version 1749799 (0.0009) [2023-12-26 13:39:41,477][123091] Updated weights for policy 0, policy_version 1761625 (0.0009) [2023-12-26 13:39:41,506][123090] Updated weights for policy 1, policy_version 1749809 (0.0008) [2023-12-26 13:39:41,537][123091] Updated weights for policy 0, policy_version 1761635 (0.0009) [2023-12-26 13:39:41,572][123090] Updated weights for policy 1, policy_version 1749819 (0.0008) [2023-12-26 13:39:41,604][123091] Updated weights for policy 0, policy_version 1761645 (0.0009) [2023-12-26 13:39:42,410][123091] Updated weights for policy 0, policy_version 1761655 (0.0009) [2023-12-26 13:39:42,448][123090] Updated weights for policy 1, policy_version 1749829 (0.0008) [2023-12-26 13:39:42,469][123091] Updated weights for policy 0, policy_version 1761665 (0.0008) [2023-12-26 13:39:42,510][123090] Updated weights for policy 1, policy_version 1749839 (0.0010) [2023-12-26 13:39:42,532][123091] Updated weights for policy 0, policy_version 1761675 (0.0008) [2023-12-26 13:39:42,569][123090] Updated weights for policy 1, policy_version 1749849 (0.0009) [2023-12-26 13:39:43,401][123091] Updated weights for policy 0, policy_version 1761685 (0.0008) [2023-12-26 13:39:43,428][123090] Updated weights for policy 1, policy_version 1749859 (0.0008) [2023-12-26 13:39:43,447][123091] Updated weights for policy 0, policy_version 1761695 (0.0010) [2023-12-26 13:39:43,476][123090] Updated weights for policy 1, policy_version 1749869 (0.0007) [2023-12-26 13:39:43,497][123091] Updated weights for policy 0, policy_version 1761705 (0.0007) [2023-12-26 13:39:43,540][123090] Updated weights for policy 1, policy_version 1749879 (0.0009) [2023-12-26 13:39:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 898973696. Throughput: 0: 8849.8, 1: 8854.9. Samples: 898963700. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:43,785][121949] Avg episode reward: [(0, '6178.875'), (1, '5758.274')] [2023-12-26 13:39:44,354][123091] Updated weights for policy 0, policy_version 1761715 (0.0007) [2023-12-26 13:39:44,365][123090] Updated weights for policy 1, policy_version 1749889 (0.0007) [2023-12-26 13:39:44,416][123091] Updated weights for policy 0, policy_version 1761725 (0.0008) [2023-12-26 13:39:44,416][123090] Updated weights for policy 1, policy_version 1749899 (0.0009) [2023-12-26 13:39:44,474][123091] Updated weights for policy 0, policy_version 1761735 (0.0009) [2023-12-26 13:39:44,478][123090] Updated weights for policy 1, policy_version 1749909 (0.0007) [2023-12-26 13:39:44,535][123090] Updated weights for policy 1, policy_version 1749919 (0.0007) [2023-12-26 13:39:45,327][123091] Updated weights for policy 0, policy_version 1761745 (0.0009) [2023-12-26 13:39:45,365][123090] Updated weights for policy 1, policy_version 1749929 (0.0010) [2023-12-26 13:39:45,391][123091] Updated weights for policy 0, policy_version 1761755 (0.0008) [2023-12-26 13:39:45,425][123090] Updated weights for policy 1, policy_version 1749939 (0.0006) [2023-12-26 13:39:45,458][123091] Updated weights for policy 0, policy_version 1761765 (0.0009) [2023-12-26 13:39:45,493][123090] Updated weights for policy 1, policy_version 1749949 (0.0006) [2023-12-26 13:39:45,513][123091] Updated weights for policy 0, policy_version 1761775 (0.0009) [2023-12-26 13:39:46,293][123091] Updated weights for policy 0, policy_version 1761785 (0.0006) [2023-12-26 13:39:46,344][123090] Updated weights for policy 1, policy_version 1749959 (0.0009) [2023-12-26 13:39:46,354][123091] Updated weights for policy 0, policy_version 1761795 (0.0008) [2023-12-26 13:39:46,413][123090] Updated weights for policy 1, policy_version 1749969 (0.0007) [2023-12-26 13:39:46,424][123091] Updated weights for policy 0, policy_version 1761805 (0.0009) [2023-12-26 13:39:46,475][123090] Updated weights for policy 1, policy_version 1749979 (0.0009) [2023-12-26 13:39:47,175][123091] Updated weights for policy 0, policy_version 1761815 (0.0008) [2023-12-26 13:39:47,240][123091] Updated weights for policy 0, policy_version 1761825 (0.0010) [2023-12-26 13:39:47,310][123091] Updated weights for policy 0, policy_version 1761835 (0.0009) [2023-12-26 13:39:47,313][123090] Updated weights for policy 1, policy_version 1749989 (0.0009) [2023-12-26 13:39:47,372][123090] Updated weights for policy 1, policy_version 1749999 (0.0009) [2023-12-26 13:39:47,432][123090] Updated weights for policy 1, policy_version 1750009 (0.0009) [2023-12-26 13:39:48,191][123091] Updated weights for policy 0, policy_version 1761845 (0.0008) [2023-12-26 13:39:48,210][123090] Updated weights for policy 1, policy_version 1750019 (0.0008) [2023-12-26 13:39:48,251][123091] Updated weights for policy 0, policy_version 1761855 (0.0009) [2023-12-26 13:39:48,267][123090] Updated weights for policy 1, policy_version 1750029 (0.0005) [2023-12-26 13:39:48,320][123091] Updated weights for policy 0, policy_version 1761865 (0.0008) [2023-12-26 13:39:48,341][123090] Updated weights for policy 1, policy_version 1750039 (0.0006) [2023-12-26 13:39:48,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 899055616. Throughput: 0: 8786.1, 1: 8840.9. Samples: 899067196. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:48,785][121949] Avg episode reward: [(0, '6171.409'), (1, '5536.409')] [2023-12-26 13:39:49,061][123090] Updated weights for policy 1, policy_version 1750049 (0.0006) [2023-12-26 13:39:49,080][123091] Updated weights for policy 0, policy_version 1761875 (0.0009) [2023-12-26 13:39:49,118][123090] Updated weights for policy 1, policy_version 1750059 (0.0006) [2023-12-26 13:39:49,138][123091] Updated weights for policy 0, policy_version 1761885 (0.0009) [2023-12-26 13:39:49,178][123090] Updated weights for policy 1, policy_version 1750069 (0.0008) [2023-12-26 13:39:49,206][123091] Updated weights for policy 0, policy_version 1761895 (0.0008) [2023-12-26 13:39:49,262][123090] Updated weights for policy 1, policy_version 1750079 (0.0007) [2023-12-26 13:39:50,022][123091] Updated weights for policy 0, policy_version 1761905 (0.0009) [2023-12-26 13:39:50,077][123091] Updated weights for policy 0, policy_version 1761915 (0.0010) [2023-12-26 13:39:50,090][123090] Updated weights for policy 1, policy_version 1750089 (0.0007) [2023-12-26 13:39:50,131][123091] Updated weights for policy 0, policy_version 1761925 (0.0010) [2023-12-26 13:39:50,147][123090] Updated weights for policy 1, policy_version 1750099 (0.0008) [2023-12-26 13:39:50,180][123091] Updated weights for policy 0, policy_version 1761935 (0.0010) [2023-12-26 13:39:50,204][123090] Updated weights for policy 1, policy_version 1750109 (0.0007) [2023-12-26 13:39:50,995][123091] Updated weights for policy 0, policy_version 1761945 (0.0011) [2023-12-26 13:39:51,043][123090] Updated weights for policy 1, policy_version 1750119 (0.0008) [2023-12-26 13:39:51,063][123091] Updated weights for policy 0, policy_version 1761955 (0.0011) [2023-12-26 13:39:51,118][123090] Updated weights for policy 1, policy_version 1750129 (0.0007) [2023-12-26 13:39:51,134][123091] Updated weights for policy 0, policy_version 1761965 (0.0011) [2023-12-26 13:39:51,192][123090] Updated weights for policy 1, policy_version 1750139 (0.0010) [2023-12-26 13:39:52,005][123090] Updated weights for policy 1, policy_version 1750149 (0.0008) [2023-12-26 13:39:52,022][123091] Updated weights for policy 0, policy_version 1761975 (0.0011) [2023-12-26 13:39:52,056][123090] Updated weights for policy 1, policy_version 1750159 (0.0006) [2023-12-26 13:39:52,069][123091] Updated weights for policy 0, policy_version 1761985 (0.0010) [2023-12-26 13:39:52,115][123090] Updated weights for policy 1, policy_version 1750169 (0.0007) [2023-12-26 13:39:52,124][123091] Updated weights for policy 0, policy_version 1761995 (0.0011) [2023-12-26 13:39:52,863][123091] Updated weights for policy 0, policy_version 1762005 (0.0009) [2023-12-26 13:39:52,925][123091] Updated weights for policy 0, policy_version 1762015 (0.0008) [2023-12-26 13:39:52,994][123091] Updated weights for policy 0, policy_version 1762025 (0.0008) [2023-12-26 13:39:52,995][123090] Updated weights for policy 1, policy_version 1750179 (0.0008) [2023-12-26 13:39:53,054][123090] Updated weights for policy 1, policy_version 1750189 (0.0010) [2023-12-26 13:39:53,117][123090] Updated weights for policy 1, policy_version 1750199 (0.0010) [2023-12-26 13:39:53,766][123091] Updated weights for policy 0, policy_version 1762035 (0.0008) [2023-12-26 13:39:53,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 899137536. Throughput: 0: 8771.5, 1: 8804.7. Samples: 899118328. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:53,785][121949] Avg episode reward: [(0, '6122.199'), (1, '5298.856')] [2023-12-26 13:39:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001750208_448053248.pth... [2023-12-26 13:39:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001749184_447791104.pth [2023-12-26 13:39:53,812][123091] Updated weights for policy 0, policy_version 1762045 (0.0005) [2023-12-26 13:39:53,861][123091] Updated weights for policy 0, policy_version 1762055 (0.0006) [2023-12-26 13:39:53,909][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001762064_451092480.pth... [2023-12-26 13:39:53,912][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001761008_450822144.pth [2023-12-26 13:39:53,938][123090] Updated weights for policy 1, policy_version 1750209 (0.0010) [2023-12-26 13:39:53,993][123090] Updated weights for policy 1, policy_version 1750219 (0.0010) [2023-12-26 13:39:54,059][123090] Updated weights for policy 1, policy_version 1750229 (0.0010) [2023-12-26 13:39:54,122][123090] Updated weights for policy 1, policy_version 1750239 (0.0010) [2023-12-26 13:39:54,622][123091] Updated weights for policy 0, policy_version 1762065 (0.0006) [2023-12-26 13:39:54,677][123091] Updated weights for policy 0, policy_version 1762075 (0.0010) [2023-12-26 13:39:54,738][123091] Updated weights for policy 0, policy_version 1762085 (0.0010) [2023-12-26 13:39:54,803][123091] Updated weights for policy 0, policy_version 1762095 (0.0010) [2023-12-26 13:39:54,914][123090] Updated weights for policy 1, policy_version 1750249 (0.0010) [2023-12-26 13:39:54,977][123090] Updated weights for policy 1, policy_version 1750259 (0.0011) [2023-12-26 13:39:55,037][123090] Updated weights for policy 1, policy_version 1750269 (0.0010) [2023-12-26 13:39:55,623][123091] Updated weights for policy 0, policy_version 1762105 (0.0010) [2023-12-26 13:39:55,684][123091] Updated weights for policy 0, policy_version 1762115 (0.0010) [2023-12-26 13:39:55,745][123091] Updated weights for policy 0, policy_version 1762125 (0.0010) [2023-12-26 13:39:55,855][123090] Updated weights for policy 1, policy_version 1750279 (0.0010) [2023-12-26 13:39:55,921][123090] Updated weights for policy 1, policy_version 1750289 (0.0010) [2023-12-26 13:39:55,994][123090] Updated weights for policy 1, policy_version 1750299 (0.0010) [2023-12-26 13:39:56,542][123091] Updated weights for policy 0, policy_version 1762135 (0.0010) [2023-12-26 13:39:56,589][123091] Updated weights for policy 0, policy_version 1762145 (0.0010) [2023-12-26 13:39:56,639][123091] Updated weights for policy 0, policy_version 1762155 (0.0010) [2023-12-26 13:39:56,790][123090] Updated weights for policy 1, policy_version 1750309 (0.0010) [2023-12-26 13:39:56,849][123090] Updated weights for policy 1, policy_version 1750319 (0.0010) [2023-12-26 13:39:56,907][123090] Updated weights for policy 1, policy_version 1750329 (0.0010) [2023-12-26 13:39:57,443][123091] Updated weights for policy 0, policy_version 1762165 (0.0010) [2023-12-26 13:39:57,494][123091] Updated weights for policy 0, policy_version 1762175 (0.0010) [2023-12-26 13:39:57,558][123091] Updated weights for policy 0, policy_version 1762185 (0.0010) [2023-12-26 13:39:57,740][123090] Updated weights for policy 1, policy_version 1750339 (0.0010) [2023-12-26 13:39:57,785][123090] Updated weights for policy 1, policy_version 1750349 (0.0009) [2023-12-26 13:39:57,840][123090] Updated weights for policy 1, policy_version 1750359 (0.0006) [2023-12-26 13:39:58,364][123091] Updated weights for policy 0, policy_version 1762195 (0.0009) [2023-12-26 13:39:58,437][123091] Updated weights for policy 0, policy_version 1762205 (0.0008) [2023-12-26 13:39:58,505][123091] Updated weights for policy 0, policy_version 1762215 (0.0008) [2023-12-26 13:39:58,554][123090] Updated weights for policy 1, policy_version 1750369 (0.0006) [2023-12-26 13:39:58,627][123090] Updated weights for policy 1, policy_version 1750379 (0.0007) [2023-12-26 13:39:58,693][123090] Updated weights for policy 1, policy_version 1750389 (0.0008) [2023-12-26 13:39:58,764][123090] Updated weights for policy 1, policy_version 1750399 (0.0007) [2023-12-26 13:39:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 899235840. Throughput: 0: 8794.7, 1: 8759.6. Samples: 899223836. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:39:58,785][121949] Avg episode reward: [(0, '6052.405'), (1, '5407.648')] [2023-12-26 13:39:59,240][123091] Updated weights for policy 0, policy_version 1762225 (0.0008) [2023-12-26 13:39:59,315][123091] Updated weights for policy 0, policy_version 1762235 (0.0010) [2023-12-26 13:39:59,380][123091] Updated weights for policy 0, policy_version 1762245 (0.0008) [2023-12-26 13:39:59,444][123091] Updated weights for policy 0, policy_version 1762255 (0.0005) [2023-12-26 13:39:59,599][123090] Updated weights for policy 1, policy_version 1750409 (0.0010) [2023-12-26 13:39:59,661][123090] Updated weights for policy 1, policy_version 1750419 (0.0010) [2023-12-26 13:39:59,727][123090] Updated weights for policy 1, policy_version 1750429 (0.0007) [2023-12-26 13:40:00,178][123091] Updated weights for policy 0, policy_version 1762265 (0.0008) [2023-12-26 13:40:00,240][123091] Updated weights for policy 0, policy_version 1762275 (0.0009) [2023-12-26 13:40:00,302][123091] Updated weights for policy 0, policy_version 1762285 (0.0010) [2023-12-26 13:40:00,569][123090] Updated weights for policy 1, policy_version 1750439 (0.0008) [2023-12-26 13:40:00,625][123090] Updated weights for policy 1, policy_version 1750451 (0.0010) [2023-12-26 13:40:00,679][123090] Updated weights for policy 1, policy_version 1750463 (0.0010) [2023-12-26 13:40:00,944][123091] Updated weights for policy 0, policy_version 1762295 (0.0005) [2023-12-26 13:40:00,999][123091] Updated weights for policy 0, policy_version 1762305 (0.0005) [2023-12-26 13:40:01,061][123091] Updated weights for policy 0, policy_version 1762315 (0.0007) [2023-12-26 13:40:01,560][123090] Updated weights for policy 1, policy_version 1750473 (0.0009) [2023-12-26 13:40:01,622][123090] Updated weights for policy 1, policy_version 1750483 (0.0009) [2023-12-26 13:40:01,691][123090] Updated weights for policy 1, policy_version 1750493 (0.0009) [2023-12-26 13:40:01,880][123091] Updated weights for policy 0, policy_version 1762325 (0.0007) [2023-12-26 13:40:01,937][123091] Updated weights for policy 0, policy_version 1762335 (0.0009) [2023-12-26 13:40:01,999][123091] Updated weights for policy 0, policy_version 1762345 (0.0009) [2023-12-26 13:40:02,579][123090] Updated weights for policy 1, policy_version 1750503 (0.0009) [2023-12-26 13:40:02,634][123090] Updated weights for policy 1, policy_version 1750513 (0.0008) [2023-12-26 13:40:02,695][123090] Updated weights for policy 1, policy_version 1750523 (0.0009) [2023-12-26 13:40:02,858][123091] Updated weights for policy 0, policy_version 1762355 (0.0009) [2023-12-26 13:40:02,916][123091] Updated weights for policy 0, policy_version 1762365 (0.0010) [2023-12-26 13:40:02,970][123091] Updated weights for policy 0, policy_version 1762375 (0.0009) [2023-12-26 13:40:03,586][123090] Updated weights for policy 1, policy_version 1750533 (0.0009) [2023-12-26 13:40:03,640][123090] Updated weights for policy 1, policy_version 1750543 (0.0010) [2023-12-26 13:40:03,681][123091] Updated weights for policy 0, policy_version 1762385 (0.0009) [2023-12-26 13:40:03,699][123090] Updated weights for policy 1, policy_version 1750553 (0.0009) [2023-12-26 13:40:03,728][123091] Updated weights for policy 0, policy_version 1762395 (0.0005) [2023-12-26 13:40:03,776][123091] Updated weights for policy 0, policy_version 1762405 (0.0005) [2023-12-26 13:40:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17661.4). Total num frames: 899317760. Throughput: 0: 8838.8, 1: 8672.5. Samples: 899329284. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:40:03,784][121949] Avg episode reward: [(0, '6141.715'), (1, '5753.809')] [2023-12-26 13:40:03,836][123091] Updated weights for policy 0, policy_version 1762415 (0.0005) [2023-12-26 13:40:04,556][123090] Updated weights for policy 1, policy_version 1750563 (0.0008) [2023-12-26 13:40:04,604][123091] Updated weights for policy 0, policy_version 1762425 (0.0009) [2023-12-26 13:40:04,619][123090] Updated weights for policy 1, policy_version 1750573 (0.0008) [2023-12-26 13:40:04,658][123091] Updated weights for policy 0, policy_version 1762435 (0.0007) [2023-12-26 13:40:04,681][123090] Updated weights for policy 1, policy_version 1750583 (0.0010) [2023-12-26 13:40:04,713][123091] Updated weights for policy 0, policy_version 1762445 (0.0008) [2023-12-26 13:40:05,441][123090] Updated weights for policy 1, policy_version 1750593 (0.0009) [2023-12-26 13:40:05,504][123090] Updated weights for policy 1, policy_version 1750603 (0.0009) [2023-12-26 13:40:05,540][123091] Updated weights for policy 0, policy_version 1762455 (0.0008) [2023-12-26 13:40:05,569][123090] Updated weights for policy 1, policy_version 1750613 (0.0008) [2023-12-26 13:40:05,588][123091] Updated weights for policy 0, policy_version 1762465 (0.0007) [2023-12-26 13:40:05,624][123090] Updated weights for policy 1, policy_version 1750623 (0.0009) [2023-12-26 13:40:05,635][123091] Updated weights for policy 0, policy_version 1762475 (0.0006) [2023-12-26 13:40:06,477][123090] Updated weights for policy 1, policy_version 1750633 (0.0008) [2023-12-26 13:40:06,488][123091] Updated weights for policy 0, policy_version 1762485 (0.0009) [2023-12-26 13:40:06,544][123090] Updated weights for policy 1, policy_version 1750643 (0.0006) [2023-12-26 13:40:06,551][123091] Updated weights for policy 0, policy_version 1762495 (0.0008) [2023-12-26 13:40:06,605][123091] Updated weights for policy 0, policy_version 1762505 (0.0008) [2023-12-26 13:40:06,610][123090] Updated weights for policy 1, policy_version 1750653 (0.0006) [2023-12-26 13:40:07,419][123090] Updated weights for policy 1, policy_version 1750663 (0.0009) [2023-12-26 13:40:07,446][123091] Updated weights for policy 0, policy_version 1762515 (0.0009) [2023-12-26 13:40:07,477][123090] Updated weights for policy 1, policy_version 1750673 (0.0009) [2023-12-26 13:40:07,515][123091] Updated weights for policy 0, policy_version 1762525 (0.0006) [2023-12-26 13:40:07,533][123090] Updated weights for policy 1, policy_version 1750683 (0.0008) [2023-12-26 13:40:07,572][123091] Updated weights for policy 0, policy_version 1762535 (0.0006) [2023-12-26 13:40:08,243][123091] Updated weights for policy 0, policy_version 1762545 (0.0006) [2023-12-26 13:40:08,308][123091] Updated weights for policy 0, policy_version 1762555 (0.0007) [2023-12-26 13:40:08,368][123091] Updated weights for policy 0, policy_version 1762565 (0.0008) [2023-12-26 13:40:08,417][123091] Updated weights for policy 0, policy_version 1762575 (0.0009) [2023-12-26 13:40:08,468][123090] Updated weights for policy 1, policy_version 1750693 (0.0010) [2023-12-26 13:40:08,529][123090] Updated weights for policy 1, policy_version 1750703 (0.0010) [2023-12-26 13:40:08,590][123090] Updated weights for policy 1, policy_version 1750713 (0.0009) [2023-12-26 13:40:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 899407872. Throughput: 0: 8871.6, 1: 8689.2. Samples: 899381468. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:40:08,785][121949] Avg episode reward: [(0, '6268.206'), (1, '5803.170')] [2023-12-26 13:40:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001762576_451223552.pth... [2023-12-26 13:40:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001750720_448184320.pth... [2023-12-26 13:40:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001761552_450961408.pth [2023-12-26 13:40:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001749728_447930368.pth [2023-12-26 13:40:09,077][123091] Updated weights for policy 0, policy_version 1762585 (0.0007) [2023-12-26 13:40:09,128][123091] Updated weights for policy 0, policy_version 1762595 (0.0006) [2023-12-26 13:40:09,194][123091] Updated weights for policy 0, policy_version 1762605 (0.0005) [2023-12-26 13:40:09,510][123090] Updated weights for policy 1, policy_version 1750723 (0.0010) [2023-12-26 13:40:09,572][123090] Updated weights for policy 1, policy_version 1750733 (0.0009) [2023-12-26 13:40:09,638][123090] Updated weights for policy 1, policy_version 1750743 (0.0009) [2023-12-26 13:40:09,976][123091] Updated weights for policy 0, policy_version 1762615 (0.0008) [2023-12-26 13:40:10,048][123091] Updated weights for policy 0, policy_version 1762625 (0.0011) [2023-12-26 13:40:10,116][123091] Updated weights for policy 0, policy_version 1762635 (0.0011) [2023-12-26 13:40:10,491][123090] Updated weights for policy 1, policy_version 1750753 (0.0010) [2023-12-26 13:40:10,544][123090] Updated weights for policy 1, policy_version 1750763 (0.0009) [2023-12-26 13:40:10,592][123090] Updated weights for policy 1, policy_version 1750773 (0.0009) [2023-12-26 13:40:10,640][123090] Updated weights for policy 1, policy_version 1750783 (0.0008) [2023-12-26 13:40:10,874][123091] Updated weights for policy 0, policy_version 1762645 (0.0008) [2023-12-26 13:40:10,935][123091] Updated weights for policy 0, policy_version 1762655 (0.0007) [2023-12-26 13:40:10,992][123091] Updated weights for policy 0, policy_version 1762665 (0.0008) [2023-12-26 13:40:11,629][123090] Updated weights for policy 1, policy_version 1750793 (0.0012) [2023-12-26 13:40:11,695][123090] Updated weights for policy 1, policy_version 1750803 (0.0010) [2023-12-26 13:40:11,768][123090] Updated weights for policy 1, policy_version 1750813 (0.0007) [2023-12-26 13:40:11,795][123091] Updated weights for policy 0, policy_version 1762675 (0.0008) [2023-12-26 13:40:11,861][123091] Updated weights for policy 0, policy_version 1762685 (0.0009) [2023-12-26 13:40:11,933][123091] Updated weights for policy 0, policy_version 1762695 (0.0010) [2023-12-26 13:40:12,602][123090] Updated weights for policy 1, policy_version 1750823 (0.0008) [2023-12-26 13:40:12,651][123090] Updated weights for policy 1, policy_version 1750833 (0.0009) [2023-12-26 13:40:12,714][123090] Updated weights for policy 1, policy_version 1750843 (0.0009) [2023-12-26 13:40:12,751][123091] Updated weights for policy 0, policy_version 1762705 (0.0010) [2023-12-26 13:40:12,813][123091] Updated weights for policy 0, policy_version 1762715 (0.0010) [2023-12-26 13:40:12,880][123091] Updated weights for policy 0, policy_version 1762725 (0.0009) [2023-12-26 13:40:12,941][123091] Updated weights for policy 0, policy_version 1762735 (0.0009) [2023-12-26 13:40:13,590][123090] Updated weights for policy 1, policy_version 1750853 (0.0010) [2023-12-26 13:40:13,656][123090] Updated weights for policy 1, policy_version 1750863 (0.0009) [2023-12-26 13:40:13,707][123090] Updated weights for policy 1, policy_version 1750873 (0.0009) [2023-12-26 13:40:13,714][123091] Updated weights for policy 0, policy_version 1762745 (0.0006) [2023-12-26 13:40:13,760][123091] Updated weights for policy 0, policy_version 1762755 (0.0005) [2023-12-26 13:40:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 899489792. Throughput: 0: 8862.4, 1: 8552.6. Samples: 899484736. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:40:13,784][121949] Avg episode reward: [(0, '6224.477'), (1, '5755.921')] [2023-12-26 13:40:13,815][123091] Updated weights for policy 0, policy_version 1762765 (0.0009) [2023-12-26 13:40:14,461][123091] Updated weights for policy 0, policy_version 1762775 (0.0007) [2023-12-26 13:40:14,516][123091] Updated weights for policy 0, policy_version 1762785 (0.0005) [2023-12-26 13:40:14,562][123090] Updated weights for policy 1, policy_version 1750883 (0.0008) [2023-12-26 13:40:14,568][123091] Updated weights for policy 0, policy_version 1762795 (0.0009) [2023-12-26 13:40:14,622][123090] Updated weights for policy 1, policy_version 1750893 (0.0007) [2023-12-26 13:40:14,689][123090] Updated weights for policy 1, policy_version 1750903 (0.0009) [2023-12-26 13:40:15,341][123091] Updated weights for policy 0, policy_version 1762805 (0.0011) [2023-12-26 13:40:15,404][123091] Updated weights for policy 0, policy_version 1762815 (0.0011) [2023-12-26 13:40:15,467][123091] Updated weights for policy 0, policy_version 1762825 (0.0011) [2023-12-26 13:40:15,554][123090] Updated weights for policy 1, policy_version 1750913 (0.0010) [2023-12-26 13:40:15,624][123090] Updated weights for policy 1, policy_version 1750923 (0.0010) [2023-12-26 13:40:15,693][123090] Updated weights for policy 1, policy_version 1750933 (0.0009) [2023-12-26 13:40:15,764][123090] Updated weights for policy 1, policy_version 1750943 (0.0007) [2023-12-26 13:40:16,210][123091] Updated weights for policy 0, policy_version 1762835 (0.0006) [2023-12-26 13:40:16,282][123091] Updated weights for policy 0, policy_version 1762845 (0.0005) [2023-12-26 13:40:16,345][123091] Updated weights for policy 0, policy_version 1762855 (0.0005) [2023-12-26 13:40:16,646][123090] Updated weights for policy 1, policy_version 1750953 (0.0009) [2023-12-26 13:40:16,707][123090] Updated weights for policy 1, policy_version 1750963 (0.0010) [2023-12-26 13:40:16,780][123090] Updated weights for policy 1, policy_version 1750973 (0.0010) [2023-12-26 13:40:16,919][123091] Updated weights for policy 0, policy_version 1762865 (0.0006) [2023-12-26 13:40:16,978][123091] Updated weights for policy 0, policy_version 1762875 (0.0007) [2023-12-26 13:40:17,050][123091] Updated weights for policy 0, policy_version 1762885 (0.0005) [2023-12-26 13:40:17,113][123091] Updated weights for policy 0, policy_version 1762895 (0.0010) [2023-12-26 13:40:17,637][123090] Updated weights for policy 1, policy_version 1750983 (0.0009) [2023-12-26 13:40:17,699][123090] Updated weights for policy 1, policy_version 1750993 (0.0009) [2023-12-26 13:40:17,768][123090] Updated weights for policy 1, policy_version 1751003 (0.0010) [2023-12-26 13:40:17,862][123091] Updated weights for policy 0, policy_version 1762905 (0.0010) [2023-12-26 13:40:17,920][123091] Updated weights for policy 0, policy_version 1762915 (0.0009) [2023-12-26 13:40:17,974][123091] Updated weights for policy 0, policy_version 1762925 (0.0009) [2023-12-26 13:40:18,574][123090] Updated weights for policy 1, policy_version 1751013 (0.0010) [2023-12-26 13:40:18,654][123090] Updated weights for policy 1, policy_version 1751023 (0.0009) [2023-12-26 13:40:18,724][123090] Updated weights for policy 1, policy_version 1751033 (0.0010) [2023-12-26 13:40:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 899579904. Throughput: 0: 8950.5, 1: 8400.3. Samples: 899590528. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:40:18,785][121949] Avg episode reward: [(0, '6214.394'), (1, '5341.431')] [2023-12-26 13:40:18,811][123091] Updated weights for policy 0, policy_version 1762935 (0.0007) [2023-12-26 13:40:18,891][123091] Updated weights for policy 0, policy_version 1762945 (0.0006) [2023-12-26 13:40:18,965][123091] Updated weights for policy 0, policy_version 1762955 (0.0006) [2023-12-26 13:40:19,593][123090] Updated weights for policy 1, policy_version 1751043 (0.0009) [2023-12-26 13:40:19,596][123091] Updated weights for policy 0, policy_version 1762965 (0.0005) [2023-12-26 13:40:19,654][123090] Updated weights for policy 1, policy_version 1751053 (0.0009) [2023-12-26 13:40:19,665][123091] Updated weights for policy 0, policy_version 1762975 (0.0006) [2023-12-26 13:40:19,723][123091] Updated weights for policy 0, policy_version 1762985 (0.0007) [2023-12-26 13:40:19,725][123090] Updated weights for policy 1, policy_version 1751063 (0.0008) [2023-12-26 13:40:20,514][123091] Updated weights for policy 0, policy_version 1762995 (0.0009) [2023-12-26 13:40:20,549][123090] Updated weights for policy 1, policy_version 1751073 (0.0009) [2023-12-26 13:40:20,581][123091] Updated weights for policy 0, policy_version 1763005 (0.0010) [2023-12-26 13:40:20,617][123090] Updated weights for policy 1, policy_version 1751083 (0.0007) [2023-12-26 13:40:20,650][123091] Updated weights for policy 0, policy_version 1763015 (0.0010) [2023-12-26 13:40:20,685][123090] Updated weights for policy 1, policy_version 1751093 (0.0007) [2023-12-26 13:40:20,754][123090] Updated weights for policy 1, policy_version 1751103 (0.0009) [2023-12-26 13:40:21,436][123091] Updated weights for policy 0, policy_version 1763025 (0.0009) [2023-12-26 13:40:21,505][123091] Updated weights for policy 0, policy_version 1763035 (0.0011) [2023-12-26 13:40:21,529][123090] Updated weights for policy 1, policy_version 1751113 (0.0006) [2023-12-26 13:40:21,561][123091] Updated weights for policy 0, policy_version 1763045 (0.0011) [2023-12-26 13:40:21,589][123090] Updated weights for policy 1, policy_version 1751123 (0.0006) [2023-12-26 13:40:21,619][123091] Updated weights for policy 0, policy_version 1763055 (0.0011) [2023-12-26 13:40:21,654][123090] Updated weights for policy 1, policy_version 1751133 (0.0008) [2023-12-26 13:40:22,446][123091] Updated weights for policy 0, policy_version 1763065 (0.0010) [2023-12-26 13:40:22,513][123091] Updated weights for policy 0, policy_version 1763075 (0.0010) [2023-12-26 13:40:22,521][123090] Updated weights for policy 1, policy_version 1751143 (0.0008) [2023-12-26 13:40:22,569][123091] Updated weights for policy 0, policy_version 1763085 (0.0010) [2023-12-26 13:40:22,585][123090] Updated weights for policy 1, policy_version 1751153 (0.0008) [2023-12-26 13:40:22,650][123090] Updated weights for policy 1, policy_version 1751163 (0.0009) [2023-12-26 13:40:23,415][123091] Updated weights for policy 0, policy_version 1763095 (0.0010) [2023-12-26 13:40:23,480][123090] Updated weights for policy 1, policy_version 1751173 (0.0008) [2023-12-26 13:40:23,481][123091] Updated weights for policy 0, policy_version 1763105 (0.0010) [2023-12-26 13:40:23,530][123090] Updated weights for policy 1, policy_version 1751183 (0.0008) [2023-12-26 13:40:23,544][123091] Updated weights for policy 0, policy_version 1763115 (0.0010) [2023-12-26 13:40:23,587][123090] Updated weights for policy 1, policy_version 1751193 (0.0009) [2023-12-26 13:40:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 899670016. Throughput: 0: 8945.6, 1: 8375.5. Samples: 899642356. Policy #0 lag: (min: 31.0, avg: 31.6, max: 53.0) [2023-12-26 13:40:23,784][121949] Avg episode reward: [(0, '6238.416'), (1, '4997.507')] [2023-12-26 13:40:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001763120_451362816.pth... [2023-12-26 13:40:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001751200_448307200.pth... [2023-12-26 13:40:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001762064_451092480.pth [2023-12-26 13:40:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001750208_448053248.pth [2023-12-26 13:40:24,361][123091] Updated weights for policy 0, policy_version 1763125 (0.0010) [2023-12-26 13:40:24,415][123091] Updated weights for policy 0, policy_version 1763135 (0.0010) [2023-12-26 13:40:24,445][123090] Updated weights for policy 1, policy_version 1751203 (0.0008) [2023-12-26 13:40:24,470][123091] Updated weights for policy 0, policy_version 1763145 (0.0009) [2023-12-26 13:40:24,506][123090] Updated weights for policy 1, policy_version 1751213 (0.0009) [2023-12-26 13:40:24,569][123090] Updated weights for policy 1, policy_version 1751223 (0.0009) [2023-12-26 13:40:25,284][123091] Updated weights for policy 0, policy_version 1763155 (0.0010) [2023-12-26 13:40:25,327][123091] Updated weights for policy 0, policy_version 1763165 (0.0010) [2023-12-26 13:40:25,375][123091] Updated weights for policy 0, policy_version 1763175 (0.0010) [2023-12-26 13:40:25,411][123090] Updated weights for policy 1, policy_version 1751233 (0.0008) [2023-12-26 13:40:25,468][123090] Updated weights for policy 1, policy_version 1751243 (0.0008) [2023-12-26 13:40:25,527][123090] Updated weights for policy 1, policy_version 1751253 (0.0009) [2023-12-26 13:40:25,588][123090] Updated weights for policy 1, policy_version 1751263 (0.0009) [2023-12-26 13:40:26,217][123091] Updated weights for policy 0, policy_version 1763185 (0.0010) [2023-12-26 13:40:26,274][123091] Updated weights for policy 0, policy_version 1763195 (0.0005) [2023-12-26 13:40:26,327][123091] Updated weights for policy 0, policy_version 1763205 (0.0005) [2023-12-26 13:40:26,380][123091] Updated weights for policy 0, policy_version 1763215 (0.0005) [2023-12-26 13:40:26,399][123090] Updated weights for policy 1, policy_version 1751273 (0.0009) [2023-12-26 13:40:26,454][123090] Updated weights for policy 1, policy_version 1751283 (0.0010) [2023-12-26 13:40:26,509][123090] Updated weights for policy 1, policy_version 1751293 (0.0010) [2023-12-26 13:40:27,062][123091] Updated weights for policy 0, policy_version 1763225 (0.0005) [2023-12-26 13:40:27,118][123091] Updated weights for policy 0, policy_version 1763235 (0.0005) [2023-12-26 13:40:27,184][123091] Updated weights for policy 0, policy_version 1763245 (0.0008) [2023-12-26 13:40:27,411][123090] Updated weights for policy 1, policy_version 1751303 (0.0007) [2023-12-26 13:40:27,473][123090] Updated weights for policy 1, policy_version 1751313 (0.0005) [2023-12-26 13:40:27,541][123090] Updated weights for policy 1, policy_version 1751323 (0.0005) [2023-12-26 13:40:27,963][123091] Updated weights for policy 0, policy_version 1763255 (0.0007) [2023-12-26 13:40:28,015][123091] Updated weights for policy 0, policy_version 1763265 (0.0006) [2023-12-26 13:40:28,080][123091] Updated weights for policy 0, policy_version 1763275 (0.0010) [2023-12-26 13:40:28,139][123090] Updated weights for policy 1, policy_version 1751333 (0.0006) [2023-12-26 13:40:28,194][123090] Updated weights for policy 1, policy_version 1751343 (0.0005) [2023-12-26 13:40:28,246][123090] Updated weights for policy 1, policy_version 1751353 (0.0005) [2023-12-26 13:40:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 899751936. Throughput: 0: 9015.8, 1: 8391.3. Samples: 899747020. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:28,785][121949] Avg episode reward: [(0, '6223.259'), (1, '5200.723')] [2023-12-26 13:40:28,863][123091] Updated weights for policy 0, policy_version 1763285 (0.0010) [2023-12-26 13:40:28,887][123090] Updated weights for policy 1, policy_version 1751363 (0.0006) [2023-12-26 13:40:28,940][123091] Updated weights for policy 0, policy_version 1763295 (0.0009) [2023-12-26 13:40:28,957][123090] Updated weights for policy 1, policy_version 1751373 (0.0006) [2023-12-26 13:40:29,005][123091] Updated weights for policy 0, policy_version 1763305 (0.0007) [2023-12-26 13:40:29,022][123090] Updated weights for policy 1, policy_version 1751383 (0.0008) [2023-12-26 13:40:29,821][123090] Updated weights for policy 1, policy_version 1751393 (0.0006) [2023-12-26 13:40:29,844][123091] Updated weights for policy 0, policy_version 1763315 (0.0008) [2023-12-26 13:40:29,899][123090] Updated weights for policy 1, policy_version 1751403 (0.0008) [2023-12-26 13:40:29,916][123091] Updated weights for policy 0, policy_version 1763325 (0.0006) [2023-12-26 13:40:29,964][123090] Updated weights for policy 1, policy_version 1751413 (0.0008) [2023-12-26 13:40:29,976][123091] Updated weights for policy 0, policy_version 1763335 (0.0008) [2023-12-26 13:40:30,020][123090] Updated weights for policy 1, policy_version 1751423 (0.0010) [2023-12-26 13:40:30,759][123090] Updated weights for policy 1, policy_version 1751433 (0.0005) [2023-12-26 13:40:30,825][123090] Updated weights for policy 1, policy_version 1751443 (0.0006) [2023-12-26 13:40:30,857][123091] Updated weights for policy 0, policy_version 1763345 (0.0007) [2023-12-26 13:40:30,890][123090] Updated weights for policy 1, policy_version 1751453 (0.0007) [2023-12-26 13:40:30,915][123091] Updated weights for policy 0, policy_version 1763355 (0.0007) [2023-12-26 13:40:30,971][123091] Updated weights for policy 0, policy_version 1763365 (0.0005) [2023-12-26 13:40:31,027][123091] Updated weights for policy 0, policy_version 1763375 (0.0006) [2023-12-26 13:40:31,641][123090] Updated weights for policy 1, policy_version 1751463 (0.0008) [2023-12-26 13:40:31,714][123090] Updated weights for policy 1, policy_version 1751473 (0.0008) [2023-12-26 13:40:31,781][123090] Updated weights for policy 1, policy_version 1751483 (0.0008) [2023-12-26 13:40:31,851][123091] Updated weights for policy 0, policy_version 1763385 (0.0009) [2023-12-26 13:40:31,901][123091] Updated weights for policy 0, policy_version 1763395 (0.0009) [2023-12-26 13:40:31,957][123091] Updated weights for policy 0, policy_version 1763405 (0.0010) [2023-12-26 13:40:32,527][123090] Updated weights for policy 1, policy_version 1751493 (0.0009) [2023-12-26 13:40:32,583][123090] Updated weights for policy 1, policy_version 1751503 (0.0010) [2023-12-26 13:40:32,640][123090] Updated weights for policy 1, policy_version 1751513 (0.0010) [2023-12-26 13:40:32,688][123091] Updated weights for policy 0, policy_version 1763415 (0.0006) [2023-12-26 13:40:32,750][123091] Updated weights for policy 0, policy_version 1763425 (0.0005) [2023-12-26 13:40:32,809][123091] Updated weights for policy 0, policy_version 1763435 (0.0005) [2023-12-26 13:40:33,504][123090] Updated weights for policy 1, policy_version 1751523 (0.0009) [2023-12-26 13:40:33,560][123090] Updated weights for policy 1, policy_version 1751533 (0.0009) [2023-12-26 13:40:33,600][123091] Updated weights for policy 0, policy_version 1763445 (0.0006) [2023-12-26 13:40:33,619][123090] Updated weights for policy 1, policy_version 1751543 (0.0009) [2023-12-26 13:40:33,669][123091] Updated weights for policy 0, policy_version 1763455 (0.0006) [2023-12-26 13:40:33,722][123091] Updated weights for policy 0, policy_version 1763465 (0.0008) [2023-12-26 13:40:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 899850240. Throughput: 0: 9043.7, 1: 8471.3. Samples: 899855372. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:33,785][121949] Avg episode reward: [(0, '6191.292'), (1, '5402.866')] [2023-12-26 13:40:34,452][123090] Updated weights for policy 1, policy_version 1751553 (0.0009) [2023-12-26 13:40:34,521][123090] Updated weights for policy 1, policy_version 1751563 (0.0008) [2023-12-26 13:40:34,522][123091] Updated weights for policy 0, policy_version 1763475 (0.0008) [2023-12-26 13:40:34,571][123090] Updated weights for policy 1, policy_version 1751573 (0.0008) [2023-12-26 13:40:34,585][123091] Updated weights for policy 0, policy_version 1763485 (0.0008) [2023-12-26 13:40:34,627][123090] Updated weights for policy 1, policy_version 1751583 (0.0005) [2023-12-26 13:40:34,656][123091] Updated weights for policy 0, policy_version 1763495 (0.0008) [2023-12-26 13:40:35,344][123090] Updated weights for policy 1, policy_version 1751593 (0.0007) [2023-12-26 13:40:35,397][123090] Updated weights for policy 1, policy_version 1751603 (0.0005) [2023-12-26 13:40:35,445][123091] Updated weights for policy 0, policy_version 1763505 (0.0008) [2023-12-26 13:40:35,453][123090] Updated weights for policy 1, policy_version 1751613 (0.0006) [2023-12-26 13:40:35,513][123091] Updated weights for policy 0, policy_version 1763515 (0.0010) [2023-12-26 13:40:35,576][123091] Updated weights for policy 0, policy_version 1763525 (0.0009) [2023-12-26 13:40:35,641][123091] Updated weights for policy 0, policy_version 1763535 (0.0006) [2023-12-26 13:40:36,132][123090] Updated weights for policy 1, policy_version 1751623 (0.0006) [2023-12-26 13:40:36,206][123090] Updated weights for policy 1, policy_version 1751633 (0.0007) [2023-12-26 13:40:36,264][123090] Updated weights for policy 1, policy_version 1751643 (0.0010) [2023-12-26 13:40:36,323][123091] Updated weights for policy 0, policy_version 1763545 (0.0006) [2023-12-26 13:40:36,393][123091] Updated weights for policy 0, policy_version 1763555 (0.0006) [2023-12-26 13:40:36,463][123091] Updated weights for policy 0, policy_version 1763565 (0.0009) [2023-12-26 13:40:37,058][123090] Updated weights for policy 1, policy_version 1751653 (0.0010) [2023-12-26 13:40:37,110][123090] Updated weights for policy 1, policy_version 1751663 (0.0010) [2023-12-26 13:40:37,169][123090] Updated weights for policy 1, policy_version 1751673 (0.0008) [2023-12-26 13:40:37,231][123091] Updated weights for policy 0, policy_version 1763575 (0.0007) [2023-12-26 13:40:37,290][123091] Updated weights for policy 0, policy_version 1763585 (0.0005) [2023-12-26 13:40:37,346][123091] Updated weights for policy 0, policy_version 1763595 (0.0006) [2023-12-26 13:40:37,969][123091] Updated weights for policy 0, policy_version 1763605 (0.0005) [2023-12-26 13:40:37,982][123090] Updated weights for policy 1, policy_version 1751683 (0.0009) [2023-12-26 13:40:38,033][123091] Updated weights for policy 0, policy_version 1763615 (0.0007) [2023-12-26 13:40:38,047][123090] Updated weights for policy 1, policy_version 1751693 (0.0011) [2023-12-26 13:40:38,089][123091] Updated weights for policy 0, policy_version 1763625 (0.0006) [2023-12-26 13:40:38,111][123090] Updated weights for policy 1, policy_version 1751703 (0.0010) [2023-12-26 13:40:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 899932160. Throughput: 0: 9074.5, 1: 8548.8. Samples: 899911376. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:38,785][121949] Avg episode reward: [(0, '6208.519'), (1, '5512.806')] [2023-12-26 13:40:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001763632_451493888.pth... [2023-12-26 13:40:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001751712_448438272.pth... [2023-12-26 13:40:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001750720_448184320.pth [2023-12-26 13:40:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001762576_451223552.pth [2023-12-26 13:40:38,868][123090] Updated weights for policy 1, policy_version 1751713 (0.0010) [2023-12-26 13:40:38,870][123091] Updated weights for policy 0, policy_version 1763635 (0.0006) [2023-12-26 13:40:38,928][123090] Updated weights for policy 1, policy_version 1751723 (0.0008) [2023-12-26 13:40:38,932][123091] Updated weights for policy 0, policy_version 1763645 (0.0010) [2023-12-26 13:40:38,975][123090] Updated weights for policy 1, policy_version 1751733 (0.0008) [2023-12-26 13:40:38,995][123091] Updated weights for policy 0, policy_version 1763655 (0.0007) [2023-12-26 13:40:39,034][123090] Updated weights for policy 1, policy_version 1751743 (0.0008) [2023-12-26 13:40:39,847][123091] Updated weights for policy 0, policy_version 1763665 (0.0009) [2023-12-26 13:40:39,894][123090] Updated weights for policy 1, policy_version 1751753 (0.0009) [2023-12-26 13:40:39,909][123091] Updated weights for policy 0, policy_version 1763675 (0.0008) [2023-12-26 13:40:39,967][123090] Updated weights for policy 1, policy_version 1751763 (0.0008) [2023-12-26 13:40:39,984][123091] Updated weights for policy 0, policy_version 1763685 (0.0007) [2023-12-26 13:40:40,036][123090] Updated weights for policy 1, policy_version 1751773 (0.0009) [2023-12-26 13:40:40,038][123091] Updated weights for policy 0, policy_version 1763695 (0.0008) [2023-12-26 13:40:40,859][123091] Updated weights for policy 0, policy_version 1763705 (0.0009) [2023-12-26 13:40:40,874][123090] Updated weights for policy 1, policy_version 1751783 (0.0008) [2023-12-26 13:40:40,927][123091] Updated weights for policy 0, policy_version 1763715 (0.0008) [2023-12-26 13:40:40,937][123090] Updated weights for policy 1, policy_version 1751793 (0.0007) [2023-12-26 13:40:40,990][123091] Updated weights for policy 0, policy_version 1763725 (0.0007) [2023-12-26 13:40:40,995][123090] Updated weights for policy 1, policy_version 1751803 (0.0009) [2023-12-26 13:40:41,847][123091] Updated weights for policy 0, policy_version 1763735 (0.0008) [2023-12-26 13:40:41,851][123090] Updated weights for policy 1, policy_version 1751813 (0.0009) [2023-12-26 13:40:41,901][123091] Updated weights for policy 0, policy_version 1763745 (0.0008) [2023-12-26 13:40:41,919][123090] Updated weights for policy 1, policy_version 1751823 (0.0009) [2023-12-26 13:40:41,955][123091] Updated weights for policy 0, policy_version 1763755 (0.0009) [2023-12-26 13:40:41,982][123090] Updated weights for policy 1, policy_version 1751833 (0.0009) [2023-12-26 13:40:42,816][123091] Updated weights for policy 0, policy_version 1763765 (0.0008) [2023-12-26 13:40:42,818][123090] Updated weights for policy 1, policy_version 1751843 (0.0009) [2023-12-26 13:40:42,869][123091] Updated weights for policy 0, policy_version 1763776 (0.0009) [2023-12-26 13:40:42,872][123090] Updated weights for policy 1, policy_version 1751853 (0.0006) [2023-12-26 13:40:42,926][123090] Updated weights for policy 1, policy_version 1751863 (0.0005) [2023-12-26 13:40:42,926][123091] Updated weights for policy 0, policy_version 1763786 (0.0009) [2023-12-26 13:40:43,643][123090] Updated weights for policy 1, policy_version 1751873 (0.0008) [2023-12-26 13:40:43,705][123090] Updated weights for policy 1, policy_version 1751883 (0.0005) [2023-12-26 13:40:43,752][123091] Updated weights for policy 0, policy_version 1763796 (0.0007) [2023-12-26 13:40:43,783][123090] Updated weights for policy 1, policy_version 1751893 (0.0005) [2023-12-26 13:40:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17578.1). Total num frames: 900014080. Throughput: 0: 9037.2, 1: 8545.7. Samples: 900015068. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:43,785][121949] Avg episode reward: [(0, '6209.576'), (1, '5527.877')] [2023-12-26 13:40:43,806][123091] Updated weights for policy 0, policy_version 1763806 (0.0005) [2023-12-26 13:40:43,856][123090] Updated weights for policy 1, policy_version 1751903 (0.0008) [2023-12-26 13:40:43,857][123091] Updated weights for policy 0, policy_version 1763816 (0.0007) [2023-12-26 13:40:44,502][123090] Updated weights for policy 1, policy_version 1751913 (0.0006) [2023-12-26 13:40:44,553][123091] Updated weights for policy 0, policy_version 1763826 (0.0006) [2023-12-26 13:40:44,572][123090] Updated weights for policy 1, policy_version 1751923 (0.0007) [2023-12-26 13:40:44,620][123091] Updated weights for policy 0, policy_version 1763836 (0.0011) [2023-12-26 13:40:44,634][123090] Updated weights for policy 1, policy_version 1751933 (0.0011) [2023-12-26 13:40:44,683][123091] Updated weights for policy 0, policy_version 1763846 (0.0011) [2023-12-26 13:40:44,750][123091] Updated weights for policy 0, policy_version 1763856 (0.0011) [2023-12-26 13:40:45,300][123090] Updated weights for policy 1, policy_version 1751943 (0.0011) [2023-12-26 13:40:45,359][123090] Updated weights for policy 1, policy_version 1751953 (0.0011) [2023-12-26 13:40:45,411][123090] Updated weights for policy 1, policy_version 1751963 (0.0010) [2023-12-26 13:40:45,575][123091] Updated weights for policy 0, policy_version 1763866 (0.0009) [2023-12-26 13:40:45,635][123091] Updated weights for policy 0, policy_version 1763877 (0.0008) [2023-12-26 13:40:45,694][123091] Updated weights for policy 0, policy_version 1763887 (0.0010) [2023-12-26 13:40:46,245][123090] Updated weights for policy 1, policy_version 1751973 (0.0009) [2023-12-26 13:40:46,298][123090] Updated weights for policy 1, policy_version 1751983 (0.0008) [2023-12-26 13:40:46,357][123090] Updated weights for policy 1, policy_version 1751993 (0.0010) [2023-12-26 13:40:46,485][123091] Updated weights for policy 0, policy_version 1763897 (0.0005) [2023-12-26 13:40:46,540][123091] Updated weights for policy 0, policy_version 1763907 (0.0007) [2023-12-26 13:40:46,595][123091] Updated weights for policy 0, policy_version 1763917 (0.0009) [2023-12-26 13:40:47,139][123090] Updated weights for policy 1, policy_version 1752003 (0.0010) [2023-12-26 13:40:47,201][123090] Updated weights for policy 1, policy_version 1752013 (0.0010) [2023-12-26 13:40:47,259][123090] Updated weights for policy 1, policy_version 1752023 (0.0010) [2023-12-26 13:40:47,445][123091] Updated weights for policy 0, policy_version 1763927 (0.0009) [2023-12-26 13:40:47,515][123091] Updated weights for policy 0, policy_version 1763937 (0.0009) [2023-12-26 13:40:47,570][123091] Updated weights for policy 0, policy_version 1763947 (0.0008) [2023-12-26 13:40:48,085][123090] Updated weights for policy 1, policy_version 1752033 (0.0010) [2023-12-26 13:40:48,144][123090] Updated weights for policy 1, policy_version 1752043 (0.0010) [2023-12-26 13:40:48,203][123090] Updated weights for policy 1, policy_version 1752053 (0.0010) [2023-12-26 13:40:48,263][123090] Updated weights for policy 1, policy_version 1752063 (0.0007) [2023-12-26 13:40:48,277][123091] Updated weights for policy 0, policy_version 1763957 (0.0007) [2023-12-26 13:40:48,345][123091] Updated weights for policy 0, policy_version 1763967 (0.0006) [2023-12-26 13:40:48,412][123091] Updated weights for policy 0, policy_version 1763977 (0.0010) [2023-12-26 13:40:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 900112384. Throughput: 0: 9012.4, 1: 8653.4. Samples: 900124248. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:48,785][121949] Avg episode reward: [(0, '6235.072'), (1, '5535.093')] [2023-12-26 13:40:49,070][123090] Updated weights for policy 1, policy_version 1752073 (0.0010) [2023-12-26 13:40:49,136][123090] Updated weights for policy 1, policy_version 1752083 (0.0010) [2023-12-26 13:40:49,201][123090] Updated weights for policy 1, policy_version 1752093 (0.0008) [2023-12-26 13:40:49,217][123091] Updated weights for policy 0, policy_version 1763987 (0.0010) [2023-12-26 13:40:49,282][123091] Updated weights for policy 0, policy_version 1763997 (0.0008) [2023-12-26 13:40:49,345][123091] Updated weights for policy 0, policy_version 1764007 (0.0009) [2023-12-26 13:40:49,929][123090] Updated weights for policy 1, policy_version 1752103 (0.0008) [2023-12-26 13:40:49,996][123090] Updated weights for policy 1, policy_version 1752113 (0.0007) [2023-12-26 13:40:50,064][123090] Updated weights for policy 1, policy_version 1752123 (0.0006) [2023-12-26 13:40:50,272][123091] Updated weights for policy 0, policy_version 1764018 (0.0010) [2023-12-26 13:40:50,328][123091] Updated weights for policy 0, policy_version 1764028 (0.0010) [2023-12-26 13:40:50,395][123091] Updated weights for policy 0, policy_version 1764038 (0.0011) [2023-12-26 13:40:50,459][123091] Updated weights for policy 0, policy_version 1764048 (0.0011) [2023-12-26 13:40:50,865][123090] Updated weights for policy 1, policy_version 1752133 (0.0008) [2023-12-26 13:40:50,935][123090] Updated weights for policy 1, policy_version 1752143 (0.0011) [2023-12-26 13:40:51,006][123090] Updated weights for policy 1, policy_version 1752153 (0.0006) [2023-12-26 13:40:51,231][123091] Updated weights for policy 0, policy_version 1764058 (0.0008) [2023-12-26 13:40:51,299][123091] Updated weights for policy 0, policy_version 1764068 (0.0010) [2023-12-26 13:40:51,364][123091] Updated weights for policy 0, policy_version 1764078 (0.0013) [2023-12-26 13:40:51,704][123090] Updated weights for policy 1, policy_version 1752163 (0.0011) [2023-12-26 13:40:51,778][123090] Updated weights for policy 1, policy_version 1752173 (0.0009) [2023-12-26 13:40:51,839][123090] Updated weights for policy 1, policy_version 1752183 (0.0013) [2023-12-26 13:40:52,110][123091] Updated weights for policy 0, policy_version 1764088 (0.0006) [2023-12-26 13:40:52,176][123091] Updated weights for policy 0, policy_version 1764098 (0.0006) [2023-12-26 13:40:52,234][123091] Updated weights for policy 0, policy_version 1764108 (0.0006) [2023-12-26 13:40:52,622][123090] Updated weights for policy 1, policy_version 1752193 (0.0010) [2023-12-26 13:40:52,694][123090] Updated weights for policy 1, policy_version 1752203 (0.0006) [2023-12-26 13:40:52,753][123090] Updated weights for policy 1, policy_version 1752213 (0.0008) [2023-12-26 13:40:52,812][123090] Updated weights for policy 1, policy_version 1752223 (0.0005) [2023-12-26 13:40:52,873][123091] Updated weights for policy 0, policy_version 1764118 (0.0006) [2023-12-26 13:40:52,941][123091] Updated weights for policy 0, policy_version 1764128 (0.0005) [2023-12-26 13:40:53,010][123091] Updated weights for policy 0, policy_version 1764138 (0.0006) [2023-12-26 13:40:53,597][123090] Updated weights for policy 1, policy_version 1752233 (0.0009) [2023-12-26 13:40:53,657][123090] Updated weights for policy 1, policy_version 1752243 (0.0010) [2023-12-26 13:40:53,717][123090] Updated weights for policy 1, policy_version 1752253 (0.0009) [2023-12-26 13:40:53,719][123091] Updated weights for policy 0, policy_version 1764148 (0.0005) [2023-12-26 13:40:53,772][123091] Updated weights for policy 0, policy_version 1764158 (0.0005) [2023-12-26 13:40:53,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17661.5). Total num frames: 900202496. Throughput: 0: 8990.9, 1: 8682.4. Samples: 900176764. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:53,785][121949] Avg episode reward: [(0, '6271.286'), (1, '5745.987')] [2023-12-26 13:40:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001752256_448577536.pth... [2023-12-26 13:40:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001751200_448307200.pth [2023-12-26 13:40:53,838][123091] Updated weights for policy 0, policy_version 1764168 (0.0010) [2023-12-26 13:40:53,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001764176_451633152.pth... [2023-12-26 13:40:53,884][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001763120_451362816.pth [2023-12-26 13:40:54,552][123091] Updated weights for policy 0, policy_version 1764178 (0.0010) [2023-12-26 13:40:54,605][123091] Updated weights for policy 0, policy_version 1764188 (0.0010) [2023-12-26 13:40:54,628][123090] Updated weights for policy 1, policy_version 1752263 (0.0007) [2023-12-26 13:40:54,657][123091] Updated weights for policy 0, policy_version 1764198 (0.0010) [2023-12-26 13:40:54,685][123090] Updated weights for policy 1, policy_version 1752273 (0.0006) [2023-12-26 13:40:54,719][123091] Updated weights for policy 0, policy_version 1764208 (0.0010) [2023-12-26 13:40:54,737][123090] Updated weights for policy 1, policy_version 1752283 (0.0008) [2023-12-26 13:40:55,550][123091] Updated weights for policy 0, policy_version 1764218 (0.0005) [2023-12-26 13:40:55,561][123090] Updated weights for policy 1, policy_version 1752293 (0.0008) [2023-12-26 13:40:55,596][123091] Updated weights for policy 0, policy_version 1764228 (0.0005) [2023-12-26 13:40:55,613][123090] Updated weights for policy 1, policy_version 1752303 (0.0008) [2023-12-26 13:40:55,649][123091] Updated weights for policy 0, policy_version 1764238 (0.0006) [2023-12-26 13:40:55,666][123090] Updated weights for policy 1, policy_version 1752313 (0.0009) [2023-12-26 13:40:56,343][123090] Updated weights for policy 1, policy_version 1752323 (0.0009) [2023-12-26 13:40:56,370][123091] Updated weights for policy 0, policy_version 1764248 (0.0009) [2023-12-26 13:40:56,406][123090] Updated weights for policy 1, policy_version 1752333 (0.0008) [2023-12-26 13:40:56,425][123091] Updated weights for policy 0, policy_version 1764258 (0.0010) [2023-12-26 13:40:56,466][123090] Updated weights for policy 1, policy_version 1752343 (0.0006) [2023-12-26 13:40:56,480][123091] Updated weights for policy 0, policy_version 1764268 (0.0010) [2023-12-26 13:40:57,246][123090] Updated weights for policy 1, policy_version 1752353 (0.0006) [2023-12-26 13:40:57,293][123090] Updated weights for policy 1, policy_version 1752363 (0.0005) [2023-12-26 13:40:57,308][123091] Updated weights for policy 0, policy_version 1764278 (0.0010) [2023-12-26 13:40:57,356][123090] Updated weights for policy 1, policy_version 1752373 (0.0005) [2023-12-26 13:40:57,371][123091] Updated weights for policy 0, policy_version 1764288 (0.0010) [2023-12-26 13:40:57,413][123090] Updated weights for policy 1, policy_version 1752383 (0.0009) [2023-12-26 13:40:57,429][123091] Updated weights for policy 0, policy_version 1764298 (0.0010) [2023-12-26 13:40:58,119][123090] Updated weights for policy 1, policy_version 1752393 (0.0008) [2023-12-26 13:40:58,195][123090] Updated weights for policy 1, policy_version 1752403 (0.0009) [2023-12-26 13:40:58,253][123091] Updated weights for policy 0, policy_version 1764308 (0.0010) [2023-12-26 13:40:58,262][123090] Updated weights for policy 1, policy_version 1752413 (0.0008) [2023-12-26 13:40:58,322][123091] Updated weights for policy 0, policy_version 1764318 (0.0010) [2023-12-26 13:40:58,393][123091] Updated weights for policy 0, policy_version 1764328 (0.0008) [2023-12-26 13:40:58,786][121949] Fps is (10 sec: 18019.1, 60 sec: 17612.3, 300 sec: 17661.3). Total num frames: 900292608. Throughput: 0: 9009.4, 1: 8802.5. Samples: 900286304. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:40:58,786][121949] Avg episode reward: [(0, '6222.700'), (1, '5704.386')] [2023-12-26 13:40:59,145][123090] Updated weights for policy 1, policy_version 1752423 (0.0009) [2023-12-26 13:40:59,193][123090] Updated weights for policy 1, policy_version 1752433 (0.0009) [2023-12-26 13:40:59,261][123090] Updated weights for policy 1, policy_version 1752443 (0.0008) [2023-12-26 13:40:59,304][123091] Updated weights for policy 0, policy_version 1764338 (0.0008) [2023-12-26 13:40:59,374][123091] Updated weights for policy 0, policy_version 1764348 (0.0010) [2023-12-26 13:40:59,429][123091] Updated weights for policy 0, policy_version 1764358 (0.0005) [2023-12-26 13:40:59,484][123091] Updated weights for policy 0, policy_version 1764368 (0.0005) [2023-12-26 13:41:00,085][123090] Updated weights for policy 1, policy_version 1752453 (0.0009) [2023-12-26 13:41:00,143][123090] Updated weights for policy 1, policy_version 1752463 (0.0010) [2023-12-26 13:41:00,175][123091] Updated weights for policy 0, policy_version 1764378 (0.0006) [2023-12-26 13:41:00,205][123090] Updated weights for policy 1, policy_version 1752473 (0.0007) [2023-12-26 13:41:00,239][123091] Updated weights for policy 0, policy_version 1764388 (0.0009) [2023-12-26 13:41:00,334][123091] Updated weights for policy 0, policy_version 1764398 (0.0007) [2023-12-26 13:41:01,052][123091] Updated weights for policy 0, policy_version 1764408 (0.0010) [2023-12-26 13:41:01,073][123090] Updated weights for policy 1, policy_version 1752483 (0.0009) [2023-12-26 13:41:01,116][123091] Updated weights for policy 0, policy_version 1764418 (0.0007) [2023-12-26 13:41:01,141][123090] Updated weights for policy 1, policy_version 1752493 (0.0009) [2023-12-26 13:41:01,180][123091] Updated weights for policy 0, policy_version 1764428 (0.0008) [2023-12-26 13:41:01,209][123090] Updated weights for policy 1, policy_version 1752503 (0.0007) [2023-12-26 13:41:01,887][123091] Updated weights for policy 0, policy_version 1764438 (0.0010) [2023-12-26 13:41:01,947][123091] Updated weights for policy 0, policy_version 1764448 (0.0009) [2023-12-26 13:41:01,982][123090] Updated weights for policy 1, policy_version 1752513 (0.0009) [2023-12-26 13:41:02,007][123091] Updated weights for policy 0, policy_version 1764458 (0.0009) [2023-12-26 13:41:02,039][123090] Updated weights for policy 1, policy_version 1752523 (0.0010) [2023-12-26 13:41:02,106][123090] Updated weights for policy 1, policy_version 1752533 (0.0010) [2023-12-26 13:41:02,173][123090] Updated weights for policy 1, policy_version 1752543 (0.0009) [2023-12-26 13:41:02,813][123091] Updated weights for policy 0, policy_version 1764468 (0.0008) [2023-12-26 13:41:02,865][123091] Updated weights for policy 0, policy_version 1764478 (0.0009) [2023-12-26 13:41:02,924][123091] Updated weights for policy 0, policy_version 1764488 (0.0009) [2023-12-26 13:41:02,960][123090] Updated weights for policy 1, policy_version 1752553 (0.0006) [2023-12-26 13:41:03,027][123090] Updated weights for policy 1, policy_version 1752563 (0.0011) [2023-12-26 13:41:03,091][123090] Updated weights for policy 1, policy_version 1752573 (0.0011) [2023-12-26 13:41:03,674][123091] Updated weights for policy 0, policy_version 1764498 (0.0008) [2023-12-26 13:41:03,727][123091] Updated weights for policy 0, policy_version 1764508 (0.0005) [2023-12-26 13:41:03,778][123091] Updated weights for policy 0, policy_version 1764518 (0.0006) [2023-12-26 13:41:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 900374528. Throughput: 0: 8948.5, 1: 8872.0. Samples: 900392448. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:03,784][121949] Avg episode reward: [(0, '6131.569'), (1, '5510.406')] [2023-12-26 13:41:03,818][123090] Updated weights for policy 1, policy_version 1752583 (0.0010) [2023-12-26 13:41:03,842][123091] Updated weights for policy 0, policy_version 1764528 (0.0006) [2023-12-26 13:41:03,890][123090] Updated weights for policy 1, policy_version 1752593 (0.0010) [2023-12-26 13:41:03,965][123090] Updated weights for policy 1, policy_version 1752603 (0.0011) [2023-12-26 13:41:04,664][123091] Updated weights for policy 0, policy_version 1764538 (0.0009) [2023-12-26 13:41:04,713][123091] Updated weights for policy 0, policy_version 1764548 (0.0009) [2023-12-26 13:41:04,769][123091] Updated weights for policy 0, policy_version 1764558 (0.0009) [2023-12-26 13:41:04,805][123090] Updated weights for policy 1, policy_version 1752613 (0.0011) [2023-12-26 13:41:04,857][123090] Updated weights for policy 1, policy_version 1752623 (0.0010) [2023-12-26 13:41:04,909][123090] Updated weights for policy 1, policy_version 1752633 (0.0010) [2023-12-26 13:41:05,638][123091] Updated weights for policy 0, policy_version 1764568 (0.0009) [2023-12-26 13:41:05,693][123091] Updated weights for policy 0, policy_version 1764578 (0.0009) [2023-12-26 13:41:05,740][123091] Updated weights for policy 0, policy_version 1764588 (0.0008) [2023-12-26 13:41:05,745][123090] Updated weights for policy 1, policy_version 1752643 (0.0010) [2023-12-26 13:41:05,812][123090] Updated weights for policy 1, policy_version 1752653 (0.0011) [2023-12-26 13:41:05,875][123090] Updated weights for policy 1, policy_version 1752663 (0.0011) [2023-12-26 13:41:06,630][123091] Updated weights for policy 0, policy_version 1764598 (0.0008) [2023-12-26 13:41:06,690][123090] Updated weights for policy 1, policy_version 1752673 (0.0010) [2023-12-26 13:41:06,697][123091] Updated weights for policy 0, policy_version 1764608 (0.0009) [2023-12-26 13:41:06,745][123090] Updated weights for policy 1, policy_version 1752683 (0.0007) [2023-12-26 13:41:06,762][123091] Updated weights for policy 0, policy_version 1764618 (0.0008) [2023-12-26 13:41:06,811][123090] Updated weights for policy 1, policy_version 1752693 (0.0006) [2023-12-26 13:41:06,879][123090] Updated weights for policy 1, policy_version 1752703 (0.0008) [2023-12-26 13:41:07,526][123090] Updated weights for policy 1, policy_version 1752713 (0.0006) [2023-12-26 13:41:07,581][123090] Updated weights for policy 1, policy_version 1752723 (0.0005) [2023-12-26 13:41:07,616][123091] Updated weights for policy 0, policy_version 1764628 (0.0009) [2023-12-26 13:41:07,628][123090] Updated weights for policy 1, policy_version 1752733 (0.0005) [2023-12-26 13:41:07,662][123091] Updated weights for policy 0, policy_version 1764638 (0.0005) [2023-12-26 13:41:07,716][123091] Updated weights for policy 0, policy_version 1764648 (0.0005) [2023-12-26 13:41:08,382][123090] Updated weights for policy 1, policy_version 1752743 (0.0006) [2023-12-26 13:41:08,404][123091] Updated weights for policy 0, policy_version 1764658 (0.0006) [2023-12-26 13:41:08,446][123090] Updated weights for policy 1, policy_version 1752753 (0.0005) [2023-12-26 13:41:08,461][123091] Updated weights for policy 0, policy_version 1764668 (0.0007) [2023-12-26 13:41:08,516][123090] Updated weights for policy 1, policy_version 1752763 (0.0006) [2023-12-26 13:41:08,523][123091] Updated weights for policy 0, policy_version 1764678 (0.0007) [2023-12-26 13:41:08,586][123091] Updated weights for policy 0, policy_version 1764688 (0.0007) [2023-12-26 13:41:08,784][121949] Fps is (10 sec: 18025.5, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 900472832. Throughput: 0: 8912.2, 1: 8889.8. Samples: 900443448. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:08,785][121949] Avg episode reward: [(0, '6181.397'), (1, '5361.284')] [2023-12-26 13:41:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001764688_451764224.pth... [2023-12-26 13:41:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001752768_448708608.pth... [2023-12-26 13:41:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001763632_451493888.pth [2023-12-26 13:41:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001751712_448438272.pth [2023-12-26 13:41:09,251][123090] Updated weights for policy 1, policy_version 1752773 (0.0009) [2023-12-26 13:41:09,321][123090] Updated weights for policy 1, policy_version 1752783 (0.0009) [2023-12-26 13:41:09,387][123091] Updated weights for policy 0, policy_version 1764698 (0.0008) [2023-12-26 13:41:09,390][123090] Updated weights for policy 1, policy_version 1752793 (0.0009) [2023-12-26 13:41:09,462][123091] Updated weights for policy 0, policy_version 1764708 (0.0008) [2023-12-26 13:41:09,533][123091] Updated weights for policy 0, policy_version 1764718 (0.0008) [2023-12-26 13:41:10,193][123090] Updated weights for policy 1, policy_version 1752803 (0.0007) [2023-12-26 13:41:10,250][123090] Updated weights for policy 1, policy_version 1752813 (0.0009) [2023-12-26 13:41:10,273][123091] Updated weights for policy 0, policy_version 1764728 (0.0008) [2023-12-26 13:41:10,319][123090] Updated weights for policy 1, policy_version 1752823 (0.0006) [2023-12-26 13:41:10,336][123091] Updated weights for policy 0, policy_version 1764738 (0.0008) [2023-12-26 13:41:10,404][123091] Updated weights for policy 0, policy_version 1764748 (0.0006) [2023-12-26 13:41:11,137][123090] Updated weights for policy 1, policy_version 1752833 (0.0010) [2023-12-26 13:41:11,214][123090] Updated weights for policy 1, policy_version 1752843 (0.0009) [2023-12-26 13:41:11,232][123091] Updated weights for policy 0, policy_version 1764758 (0.0007) [2023-12-26 13:41:11,279][123090] Updated weights for policy 1, policy_version 1752853 (0.0008) [2023-12-26 13:41:11,303][123091] Updated weights for policy 0, policy_version 1764768 (0.0009) [2023-12-26 13:41:11,342][123090] Updated weights for policy 1, policy_version 1752863 (0.0007) [2023-12-26 13:41:11,371][123091] Updated weights for policy 0, policy_version 1764778 (0.0010) [2023-12-26 13:41:12,147][123090] Updated weights for policy 1, policy_version 1752873 (0.0010) [2023-12-26 13:41:12,204][123090] Updated weights for policy 1, policy_version 1752883 (0.0010) [2023-12-26 13:41:12,257][123090] Updated weights for policy 1, policy_version 1752893 (0.0010) [2023-12-26 13:41:12,271][123091] Updated weights for policy 0, policy_version 1764788 (0.0009) [2023-12-26 13:41:12,337][123091] Updated weights for policy 0, policy_version 1764798 (0.0008) [2023-12-26 13:41:12,412][123091] Updated weights for policy 0, policy_version 1764808 (0.0008) [2023-12-26 13:41:12,994][123090] Updated weights for policy 1, policy_version 1752903 (0.0007) [2023-12-26 13:41:13,010][123091] Updated weights for policy 0, policy_version 1764818 (0.0009) [2023-12-26 13:41:13,054][123090] Updated weights for policy 1, policy_version 1752913 (0.0005) [2023-12-26 13:41:13,072][123091] Updated weights for policy 0, policy_version 1764828 (0.0009) [2023-12-26 13:41:13,117][123090] Updated weights for policy 1, policy_version 1752923 (0.0005) [2023-12-26 13:41:13,140][123091] Updated weights for policy 0, policy_version 1764838 (0.0008) [2023-12-26 13:41:13,219][123091] Updated weights for policy 0, policy_version 1764848 (0.0007) [2023-12-26 13:41:13,729][123090] Updated weights for policy 1, policy_version 1752933 (0.0005) [2023-12-26 13:41:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 900554752. Throughput: 0: 8880.7, 1: 8964.2. Samples: 900550040. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:13,785][121949] Avg episode reward: [(0, '6238.795'), (1, '5340.263')] [2023-12-26 13:41:13,794][123090] Updated weights for policy 1, policy_version 1752943 (0.0005) [2023-12-26 13:41:13,859][123090] Updated weights for policy 1, policy_version 1752953 (0.0005) [2023-12-26 13:41:13,861][123091] Updated weights for policy 0, policy_version 1764858 (0.0010) [2023-12-26 13:41:13,924][123091] Updated weights for policy 0, policy_version 1764868 (0.0011) [2023-12-26 13:41:13,992][123091] Updated weights for policy 0, policy_version 1764878 (0.0011) [2023-12-26 13:41:14,548][123090] Updated weights for policy 1, policy_version 1752963 (0.0007) [2023-12-26 13:41:14,614][123090] Updated weights for policy 1, policy_version 1752973 (0.0010) [2023-12-26 13:41:14,683][123090] Updated weights for policy 1, policy_version 1752983 (0.0010) [2023-12-26 13:41:14,688][123091] Updated weights for policy 0, policy_version 1764888 (0.0007) [2023-12-26 13:41:14,745][123091] Updated weights for policy 0, policy_version 1764898 (0.0007) [2023-12-26 13:41:14,807][123091] Updated weights for policy 0, policy_version 1764908 (0.0008) [2023-12-26 13:41:15,481][123090] Updated weights for policy 1, policy_version 1752993 (0.0009) [2023-12-26 13:41:15,499][123091] Updated weights for policy 0, policy_version 1764918 (0.0009) [2023-12-26 13:41:15,541][123090] Updated weights for policy 1, policy_version 1753003 (0.0006) [2023-12-26 13:41:15,562][123091] Updated weights for policy 0, policy_version 1764928 (0.0011) [2023-12-26 13:41:15,605][123090] Updated weights for policy 1, policy_version 1753013 (0.0008) [2023-12-26 13:41:15,629][123091] Updated weights for policy 0, policy_version 1764938 (0.0010) [2023-12-26 13:41:15,656][123090] Updated weights for policy 1, policy_version 1753023 (0.0006) [2023-12-26 13:41:16,358][123090] Updated weights for policy 1, policy_version 1753033 (0.0006) [2023-12-26 13:41:16,401][123091] Updated weights for policy 0, policy_version 1764948 (0.0009) [2023-12-26 13:41:16,419][123090] Updated weights for policy 1, policy_version 1753043 (0.0009) [2023-12-26 13:41:16,450][123091] Updated weights for policy 0, policy_version 1764958 (0.0006) [2023-12-26 13:41:16,473][123090] Updated weights for policy 1, policy_version 1753053 (0.0010) [2023-12-26 13:41:16,504][123091] Updated weights for policy 0, policy_version 1764968 (0.0007) [2023-12-26 13:41:17,240][123091] Updated weights for policy 0, policy_version 1764978 (0.0010) [2023-12-26 13:41:17,279][123090] Updated weights for policy 1, policy_version 1753063 (0.0009) [2023-12-26 13:41:17,286][123091] Updated weights for policy 0, policy_version 1764988 (0.0008) [2023-12-26 13:41:17,329][123091] Updated weights for policy 0, policy_version 1764998 (0.0006) [2023-12-26 13:41:17,333][123090] Updated weights for policy 1, policy_version 1753073 (0.0010) [2023-12-26 13:41:17,381][123091] Updated weights for policy 0, policy_version 1765008 (0.0005) [2023-12-26 13:41:17,391][123090] Updated weights for policy 1, policy_version 1753083 (0.0009) [2023-12-26 13:41:18,196][123090] Updated weights for policy 1, policy_version 1753093 (0.0008) [2023-12-26 13:41:18,198][123091] Updated weights for policy 0, policy_version 1765018 (0.0010) [2023-12-26 13:41:18,261][123091] Updated weights for policy 0, policy_version 1765028 (0.0006) [2023-12-26 13:41:18,263][123090] Updated weights for policy 1, policy_version 1753103 (0.0008) [2023-12-26 13:41:18,326][123091] Updated weights for policy 0, policy_version 1765038 (0.0010) [2023-12-26 13:41:18,326][123090] Updated weights for policy 1, policy_version 1753113 (0.0007) [2023-12-26 13:41:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 900653056. Throughput: 0: 8994.6, 1: 8996.6. Samples: 900664976. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:18,785][121949] Avg episode reward: [(0, '6248.866'), (1, '5553.637')] [2023-12-26 13:41:18,999][123091] Updated weights for policy 0, policy_version 1765048 (0.0010) [2023-12-26 13:41:19,067][123091] Updated weights for policy 0, policy_version 1765058 (0.0010) [2023-12-26 13:41:19,069][123090] Updated weights for policy 1, policy_version 1753123 (0.0006) [2023-12-26 13:41:19,119][123091] Updated weights for policy 0, policy_version 1765068 (0.0009) [2023-12-26 13:41:19,125][123090] Updated weights for policy 1, policy_version 1753133 (0.0007) [2023-12-26 13:41:19,182][123090] Updated weights for policy 1, policy_version 1753143 (0.0010) [2023-12-26 13:41:19,985][123091] Updated weights for policy 0, policy_version 1765078 (0.0008) [2023-12-26 13:41:19,987][123090] Updated weights for policy 1, policy_version 1753153 (0.0009) [2023-12-26 13:41:20,051][123091] Updated weights for policy 0, policy_version 1765088 (0.0008) [2023-12-26 13:41:20,054][123090] Updated weights for policy 1, policy_version 1753163 (0.0008) [2023-12-26 13:41:20,114][123091] Updated weights for policy 0, policy_version 1765098 (0.0009) [2023-12-26 13:41:20,121][123090] Updated weights for policy 1, policy_version 1753173 (0.0007) [2023-12-26 13:41:20,186][123090] Updated weights for policy 1, policy_version 1753183 (0.0010) [2023-12-26 13:41:20,920][123091] Updated weights for policy 0, policy_version 1765108 (0.0008) [2023-12-26 13:41:20,978][123091] Updated weights for policy 0, policy_version 1765118 (0.0010) [2023-12-26 13:41:21,049][123091] Updated weights for policy 0, policy_version 1765128 (0.0009) [2023-12-26 13:41:21,061][123090] Updated weights for policy 1, policy_version 1753193 (0.0008) [2023-12-26 13:41:21,133][123090] Updated weights for policy 1, policy_version 1753203 (0.0010) [2023-12-26 13:41:21,203][123090] Updated weights for policy 1, policy_version 1753213 (0.0009) [2023-12-26 13:41:21,887][123091] Updated weights for policy 0, policy_version 1765138 (0.0009) [2023-12-26 13:41:21,964][123091] Updated weights for policy 0, policy_version 1765148 (0.0011) [2023-12-26 13:41:22,035][123091] Updated weights for policy 0, policy_version 1765158 (0.0011) [2023-12-26 13:41:22,092][123091] Updated weights for policy 0, policy_version 1765168 (0.0011) [2023-12-26 13:41:22,098][123090] Updated weights for policy 1, policy_version 1753223 (0.0007) [2023-12-26 13:41:22,168][123090] Updated weights for policy 1, policy_version 1753233 (0.0009) [2023-12-26 13:41:22,241][123090] Updated weights for policy 1, policy_version 1753243 (0.0009) [2023-12-26 13:41:22,934][123091] Updated weights for policy 0, policy_version 1765178 (0.0011) [2023-12-26 13:41:23,004][123091] Updated weights for policy 0, policy_version 1765188 (0.0011) [2023-12-26 13:41:23,066][123090] Updated weights for policy 1, policy_version 1753253 (0.0006) [2023-12-26 13:41:23,073][123091] Updated weights for policy 0, policy_version 1765198 (0.0010) [2023-12-26 13:41:23,121][123090] Updated weights for policy 1, policy_version 1753263 (0.0008) [2023-12-26 13:41:23,176][123090] Updated weights for policy 1, policy_version 1753273 (0.0009) [2023-12-26 13:41:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 900734976. Throughput: 0: 8962.9, 1: 8910.9. Samples: 900715692. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:23,785][121949] Avg episode reward: [(0, '6265.062'), (1, '5583.388')] [2023-12-26 13:41:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001765200_451895296.pth... [2023-12-26 13:41:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001753280_448839680.pth... [2023-12-26 13:41:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001764176_451633152.pth [2023-12-26 13:41:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001752256_448577536.pth [2023-12-26 13:41:23,860][123091] Updated weights for policy 0, policy_version 1765208 (0.0009) [2023-12-26 13:41:23,909][123091] Updated weights for policy 0, policy_version 1765218 (0.0009) [2023-12-26 13:41:23,964][123091] Updated weights for policy 0, policy_version 1765228 (0.0010) [2023-12-26 13:41:23,992][123090] Updated weights for policy 1, policy_version 1753283 (0.0008) [2023-12-26 13:41:24,051][123090] Updated weights for policy 1, policy_version 1753293 (0.0009) [2023-12-26 13:41:24,109][123090] Updated weights for policy 1, policy_version 1753303 (0.0010) [2023-12-26 13:41:24,825][123091] Updated weights for policy 0, policy_version 1765238 (0.0009) [2023-12-26 13:41:24,869][123091] Updated weights for policy 0, policy_version 1765248 (0.0007) [2023-12-26 13:41:24,917][123091] Updated weights for policy 0, policy_version 1765258 (0.0007) [2023-12-26 13:41:24,950][123090] Updated weights for policy 1, policy_version 1753313 (0.0009) [2023-12-26 13:41:25,010][123090] Updated weights for policy 1, policy_version 1753323 (0.0010) [2023-12-26 13:41:25,060][123090] Updated weights for policy 1, policy_version 1753333 (0.0009) [2023-12-26 13:41:25,107][123090] Updated weights for policy 1, policy_version 1753343 (0.0009) [2023-12-26 13:41:25,667][123091] Updated weights for policy 0, policy_version 1765268 (0.0008) [2023-12-26 13:41:25,735][123091] Updated weights for policy 0, policy_version 1765278 (0.0008) [2023-12-26 13:41:25,811][123091] Updated weights for policy 0, policy_version 1765288 (0.0008) [2023-12-26 13:41:26,010][123090] Updated weights for policy 1, policy_version 1753353 (0.0008) [2023-12-26 13:41:26,067][123090] Updated weights for policy 1, policy_version 1753363 (0.0009) [2023-12-26 13:41:26,125][123090] Updated weights for policy 1, policy_version 1753373 (0.0008) [2023-12-26 13:41:26,576][123091] Updated weights for policy 0, policy_version 1765298 (0.0009) [2023-12-26 13:41:26,639][123091] Updated weights for policy 0, policy_version 1765308 (0.0005) [2023-12-26 13:41:26,705][123091] Updated weights for policy 0, policy_version 1765318 (0.0008) [2023-12-26 13:41:26,760][123091] Updated weights for policy 0, policy_version 1765328 (0.0007) [2023-12-26 13:41:27,018][123090] Updated weights for policy 1, policy_version 1753383 (0.0009) [2023-12-26 13:41:27,076][123090] Updated weights for policy 1, policy_version 1753393 (0.0009) [2023-12-26 13:41:27,129][123090] Updated weights for policy 1, policy_version 1753403 (0.0009) [2023-12-26 13:41:27,518][123091] Updated weights for policy 0, policy_version 1765338 (0.0010) [2023-12-26 13:41:27,586][123091] Updated weights for policy 0, policy_version 1765348 (0.0009) [2023-12-26 13:41:27,635][123091] Updated weights for policy 0, policy_version 1765358 (0.0010) [2023-12-26 13:41:27,871][123090] Updated weights for policy 1, policy_version 1753413 (0.0009) [2023-12-26 13:41:27,919][123090] Updated weights for policy 1, policy_version 1753423 (0.0008) [2023-12-26 13:41:27,971][123090] Updated weights for policy 1, policy_version 1753433 (0.0009) [2023-12-26 13:41:28,433][123091] Updated weights for policy 0, policy_version 1765368 (0.0006) [2023-12-26 13:41:28,504][123091] Updated weights for policy 0, policy_version 1765378 (0.0007) [2023-12-26 13:41:28,562][123091] Updated weights for policy 0, policy_version 1765388 (0.0010) [2023-12-26 13:41:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 900825088. Throughput: 0: 8986.6, 1: 8891.6. Samples: 900819592. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:28,785][121949] Avg episode reward: [(0, '6217.015'), (1, '5625.283')] [2023-12-26 13:41:28,844][123090] Updated weights for policy 1, policy_version 1753443 (0.0008) [2023-12-26 13:41:28,898][123090] Updated weights for policy 1, policy_version 1753453 (0.0010) [2023-12-26 13:41:28,951][123090] Updated weights for policy 1, policy_version 1753464 (0.0010) [2023-12-26 13:41:29,250][123091] Updated weights for policy 0, policy_version 1765398 (0.0007) [2023-12-26 13:41:29,320][123091] Updated weights for policy 0, policy_version 1765408 (0.0007) [2023-12-26 13:41:29,395][123091] Updated weights for policy 0, policy_version 1765418 (0.0008) [2023-12-26 13:41:29,788][123090] Updated weights for policy 1, policy_version 1753474 (0.0009) [2023-12-26 13:41:29,841][123090] Updated weights for policy 1, policy_version 1753484 (0.0009) [2023-12-26 13:41:29,898][123090] Updated weights for policy 1, policy_version 1753494 (0.0010) [2023-12-26 13:41:29,965][123090] Updated weights for policy 1, policy_version 1753504 (0.0009) [2023-12-26 13:41:30,207][123091] Updated weights for policy 0, policy_version 1765428 (0.0006) [2023-12-26 13:41:30,259][123091] Updated weights for policy 0, policy_version 1765438 (0.0005) [2023-12-26 13:41:30,326][123091] Updated weights for policy 0, policy_version 1765448 (0.0006) [2023-12-26 13:41:30,840][123090] Updated weights for policy 1, policy_version 1753514 (0.0005) [2023-12-26 13:41:30,895][123090] Updated weights for policy 1, policy_version 1753524 (0.0005) [2023-12-26 13:41:30,941][123090] Updated weights for policy 1, policy_version 1753534 (0.0005) [2023-12-26 13:41:31,102][123091] Updated weights for policy 0, policy_version 1765458 (0.0009) [2023-12-26 13:41:31,178][123091] Updated weights for policy 0, policy_version 1765468 (0.0008) [2023-12-26 13:41:31,244][123091] Updated weights for policy 0, policy_version 1765478 (0.0008) [2023-12-26 13:41:31,309][123091] Updated weights for policy 0, policy_version 1765488 (0.0009) [2023-12-26 13:41:31,742][123090] Updated weights for policy 1, policy_version 1753544 (0.0007) [2023-12-26 13:41:31,816][123090] Updated weights for policy 1, policy_version 1753554 (0.0005) [2023-12-26 13:41:31,875][123090] Updated weights for policy 1, policy_version 1753564 (0.0005) [2023-12-26 13:41:32,069][123091] Updated weights for policy 0, policy_version 1765498 (0.0006) [2023-12-26 13:41:32,133][123091] Updated weights for policy 0, policy_version 1765508 (0.0005) [2023-12-26 13:41:32,206][123091] Updated weights for policy 0, policy_version 1765518 (0.0005) [2023-12-26 13:41:32,522][123090] Updated weights for policy 1, policy_version 1753574 (0.0007) [2023-12-26 13:41:32,591][123090] Updated weights for policy 1, policy_version 1753584 (0.0007) [2023-12-26 13:41:32,645][123090] Updated weights for policy 1, policy_version 1753594 (0.0006) [2023-12-26 13:41:32,888][123091] Updated weights for policy 0, policy_version 1765528 (0.0009) [2023-12-26 13:41:32,961][123091] Updated weights for policy 0, policy_version 1765538 (0.0010) [2023-12-26 13:41:33,024][123091] Updated weights for policy 0, policy_version 1765548 (0.0009) [2023-12-26 13:41:33,402][123090] Updated weights for policy 1, policy_version 1753604 (0.0007) [2023-12-26 13:41:33,462][123090] Updated weights for policy 1, policy_version 1753614 (0.0009) [2023-12-26 13:41:33,529][123090] Updated weights for policy 1, policy_version 1753624 (0.0008) [2023-12-26 13:41:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 900915200. Throughput: 0: 8990.9, 1: 8841.7. Samples: 900926720. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:33,785][121949] Avg episode reward: [(0, '6172.534'), (1, '5665.993')] [2023-12-26 13:41:33,851][123091] Updated weights for policy 0, policy_version 1765558 (0.0010) [2023-12-26 13:41:33,926][123091] Updated weights for policy 0, policy_version 1765568 (0.0005) [2023-12-26 13:41:33,981][123091] Updated weights for policy 0, policy_version 1765578 (0.0005) [2023-12-26 13:41:34,270][123090] Updated weights for policy 1, policy_version 1753634 (0.0008) [2023-12-26 13:41:34,342][123090] Updated weights for policy 1, policy_version 1753644 (0.0010) [2023-12-26 13:41:34,409][123090] Updated weights for policy 1, policy_version 1753654 (0.0010) [2023-12-26 13:41:34,473][123090] Updated weights for policy 1, policy_version 1753664 (0.0011) [2023-12-26 13:41:34,675][123091] Updated weights for policy 0, policy_version 1765588 (0.0008) [2023-12-26 13:41:34,735][123091] Updated weights for policy 0, policy_version 1765598 (0.0011) [2023-12-26 13:41:34,787][123091] Updated weights for policy 0, policy_version 1765608 (0.0011) [2023-12-26 13:41:35,215][123090] Updated weights for policy 1, policy_version 1753674 (0.0007) [2023-12-26 13:41:35,286][123090] Updated weights for policy 1, policy_version 1753684 (0.0005) [2023-12-26 13:41:35,357][123090] Updated weights for policy 1, policy_version 1753694 (0.0005) [2023-12-26 13:41:35,428][123091] Updated weights for policy 0, policy_version 1765618 (0.0005) [2023-12-26 13:41:35,483][123091] Updated weights for policy 0, policy_version 1765628 (0.0005) [2023-12-26 13:41:35,533][123091] Updated weights for policy 0, policy_version 1765638 (0.0006) [2023-12-26 13:41:35,581][123091] Updated weights for policy 0, policy_version 1765648 (0.0009) [2023-12-26 13:41:36,097][123090] Updated weights for policy 1, policy_version 1753704 (0.0009) [2023-12-26 13:41:36,159][123090] Updated weights for policy 1, policy_version 1753714 (0.0008) [2023-12-26 13:41:36,226][123090] Updated weights for policy 1, policy_version 1753724 (0.0008) [2023-12-26 13:41:36,404][123091] Updated weights for policy 0, policy_version 1765658 (0.0010) [2023-12-26 13:41:36,474][123091] Updated weights for policy 0, policy_version 1765668 (0.0010) [2023-12-26 13:41:36,535][123091] Updated weights for policy 0, policy_version 1765678 (0.0009) [2023-12-26 13:41:37,000][123090] Updated weights for policy 1, policy_version 1753734 (0.0008) [2023-12-26 13:41:37,067][123090] Updated weights for policy 1, policy_version 1753744 (0.0008) [2023-12-26 13:41:37,126][123090] Updated weights for policy 1, policy_version 1753754 (0.0008) [2023-12-26 13:41:37,359][123091] Updated weights for policy 0, policy_version 1765688 (0.0010) [2023-12-26 13:41:37,415][123091] Updated weights for policy 0, policy_version 1765698 (0.0009) [2023-12-26 13:41:37,470][123091] Updated weights for policy 0, policy_version 1765708 (0.0010) [2023-12-26 13:41:37,947][123090] Updated weights for policy 1, policy_version 1753764 (0.0008) [2023-12-26 13:41:38,009][123090] Updated weights for policy 1, policy_version 1753774 (0.0009) [2023-12-26 13:41:38,063][123090] Updated weights for policy 1, policy_version 1753784 (0.0009) [2023-12-26 13:41:38,330][123091] Updated weights for policy 0, policy_version 1765718 (0.0010) [2023-12-26 13:41:38,399][123091] Updated weights for policy 0, policy_version 1765728 (0.0010) [2023-12-26 13:41:38,461][123091] Updated weights for policy 0, policy_version 1765738 (0.0009) [2023-12-26 13:41:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 901005312. Throughput: 0: 9055.7, 1: 8865.4. Samples: 900983216. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:38,785][121949] Avg episode reward: [(0, '6273.684'), (1, '5407.800')] [2023-12-26 13:41:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001765744_452034560.pth... [2023-12-26 13:41:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001753792_448970752.pth... [2023-12-26 13:41:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001752768_448708608.pth [2023-12-26 13:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001764688_451764224.pth [2023-12-26 13:41:38,893][123090] Updated weights for policy 1, policy_version 1753794 (0.0009) [2023-12-26 13:41:38,955][123090] Updated weights for policy 1, policy_version 1753804 (0.0006) [2023-12-26 13:41:39,030][123090] Updated weights for policy 1, policy_version 1753814 (0.0005) [2023-12-26 13:41:39,098][123090] Updated weights for policy 1, policy_version 1753824 (0.0005) [2023-12-26 13:41:39,337][123091] Updated weights for policy 0, policy_version 1765748 (0.0009) [2023-12-26 13:41:39,400][123091] Updated weights for policy 0, policy_version 1765758 (0.0010) [2023-12-26 13:41:39,457][123091] Updated weights for policy 0, policy_version 1765768 (0.0009) [2023-12-26 13:41:39,802][123090] Updated weights for policy 1, policy_version 1753834 (0.0011) [2023-12-26 13:41:39,873][123090] Updated weights for policy 1, policy_version 1753844 (0.0008) [2023-12-26 13:41:39,952][123090] Updated weights for policy 1, policy_version 1753854 (0.0006) [2023-12-26 13:41:40,355][123091] Updated weights for policy 0, policy_version 1765778 (0.0009) [2023-12-26 13:41:40,415][123091] Updated weights for policy 0, policy_version 1765788 (0.0010) [2023-12-26 13:41:40,476][123091] Updated weights for policy 0, policy_version 1765798 (0.0010) [2023-12-26 13:41:40,536][123091] Updated weights for policy 0, policy_version 1765808 (0.0010) [2023-12-26 13:41:40,734][123090] Updated weights for policy 1, policy_version 1753864 (0.0009) [2023-12-26 13:41:40,788][123090] Updated weights for policy 1, policy_version 1753874 (0.0009) [2023-12-26 13:41:40,838][123090] Updated weights for policy 1, policy_version 1753884 (0.0009) [2023-12-26 13:41:41,408][123091] Updated weights for policy 0, policy_version 1765818 (0.0007) [2023-12-26 13:41:41,480][123091] Updated weights for policy 0, policy_version 1765828 (0.0008) [2023-12-26 13:41:41,545][123091] Updated weights for policy 0, policy_version 1765838 (0.0008) [2023-12-26 13:41:41,738][123090] Updated weights for policy 1, policy_version 1753894 (0.0009) [2023-12-26 13:41:41,813][123090] Updated weights for policy 1, policy_version 1753904 (0.0009) [2023-12-26 13:41:41,883][123090] Updated weights for policy 1, policy_version 1753914 (0.0010) [2023-12-26 13:41:42,326][123091] Updated weights for policy 0, policy_version 1765848 (0.0009) [2023-12-26 13:41:42,397][123091] Updated weights for policy 0, policy_version 1765858 (0.0010) [2023-12-26 13:41:42,464][123091] Updated weights for policy 0, policy_version 1765868 (0.0010) [2023-12-26 13:41:42,705][123090] Updated weights for policy 1, policy_version 1753924 (0.0009) [2023-12-26 13:41:42,758][123090] Updated weights for policy 1, policy_version 1753934 (0.0009) [2023-12-26 13:41:42,820][123090] Updated weights for policy 1, policy_version 1753944 (0.0009) [2023-12-26 13:41:43,213][123091] Updated weights for policy 0, policy_version 1765878 (0.0008) [2023-12-26 13:41:43,271][123091] Updated weights for policy 0, policy_version 1765888 (0.0008) [2023-12-26 13:41:43,339][123091] Updated weights for policy 0, policy_version 1765898 (0.0007) [2023-12-26 13:41:43,718][123090] Updated weights for policy 1, policy_version 1753954 (0.0009) [2023-12-26 13:41:43,771][123090] Updated weights for policy 1, policy_version 1753964 (0.0009) [2023-12-26 13:41:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 901087232. Throughput: 0: 8914.7, 1: 8835.5. Samples: 901085028. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:43,784][121949] Avg episode reward: [(0, '6307.531'), (1, '5349.433')] [2023-12-26 13:41:43,817][123090] Updated weights for policy 1, policy_version 1753974 (0.0008) [2023-12-26 13:41:43,870][123090] Updated weights for policy 1, policy_version 1753984 (0.0009) [2023-12-26 13:41:43,980][123091] Updated weights for policy 0, policy_version 1765909 (0.0007) [2023-12-26 13:41:44,041][123091] Updated weights for policy 0, policy_version 1765919 (0.0007) [2023-12-26 13:41:44,100][123091] Updated weights for policy 0, policy_version 1765929 (0.0009) [2023-12-26 13:41:44,700][123090] Updated weights for policy 1, policy_version 1753994 (0.0005) [2023-12-26 13:41:44,784][123090] Updated weights for policy 1, policy_version 1754004 (0.0006) [2023-12-26 13:41:44,839][123090] Updated weights for policy 1, policy_version 1754014 (0.0006) [2023-12-26 13:41:44,897][123091] Updated weights for policy 0, policy_version 1765939 (0.0009) [2023-12-26 13:41:44,953][123091] Updated weights for policy 0, policy_version 1765949 (0.0008) [2023-12-26 13:41:45,011][123091] Updated weights for policy 0, policy_version 1765959 (0.0006) [2023-12-26 13:41:45,640][123090] Updated weights for policy 1, policy_version 1754024 (0.0008) [2023-12-26 13:41:45,711][123090] Updated weights for policy 1, policy_version 1754034 (0.0006) [2023-12-26 13:41:45,757][123091] Updated weights for policy 0, policy_version 1765969 (0.0006) [2023-12-26 13:41:45,775][123090] Updated weights for policy 1, policy_version 1754044 (0.0007) [2023-12-26 13:41:45,814][123091] Updated weights for policy 0, policy_version 1765979 (0.0007) [2023-12-26 13:41:45,873][123091] Updated weights for policy 0, policy_version 1765989 (0.0010) [2023-12-26 13:41:45,934][123091] Updated weights for policy 0, policy_version 1765999 (0.0011) [2023-12-26 13:41:46,537][123090] Updated weights for policy 1, policy_version 1754054 (0.0010) [2023-12-26 13:41:46,593][123090] Updated weights for policy 1, policy_version 1754064 (0.0010) [2023-12-26 13:41:46,649][123090] Updated weights for policy 1, policy_version 1754074 (0.0010) [2023-12-26 13:41:46,714][123091] Updated weights for policy 0, policy_version 1766010 (0.0010) [2023-12-26 13:41:46,767][123091] Updated weights for policy 0, policy_version 1766020 (0.0010) [2023-12-26 13:41:46,822][123091] Updated weights for policy 0, policy_version 1766032 (0.0010) [2023-12-26 13:41:47,434][123090] Updated weights for policy 1, policy_version 1754084 (0.0006) [2023-12-26 13:41:47,505][123090] Updated weights for policy 1, policy_version 1754094 (0.0005) [2023-12-26 13:41:47,576][123090] Updated weights for policy 1, policy_version 1754104 (0.0005) [2023-12-26 13:41:47,620][123091] Updated weights for policy 0, policy_version 1766042 (0.0009) [2023-12-26 13:41:47,685][123091] Updated weights for policy 0, policy_version 1766052 (0.0009) [2023-12-26 13:41:47,748][123091] Updated weights for policy 0, policy_version 1766062 (0.0010) [2023-12-26 13:41:48,313][123090] Updated weights for policy 1, policy_version 1754114 (0.0008) [2023-12-26 13:41:48,387][123090] Updated weights for policy 1, policy_version 1754124 (0.0009) [2023-12-26 13:41:48,455][123090] Updated weights for policy 1, policy_version 1754134 (0.0010) [2023-12-26 13:41:48,527][123090] Updated weights for policy 1, policy_version 1754144 (0.0007) [2023-12-26 13:41:48,589][123091] Updated weights for policy 0, policy_version 1766072 (0.0009) [2023-12-26 13:41:48,652][123091] Updated weights for policy 0, policy_version 1766082 (0.0009) [2023-12-26 13:41:48,717][123091] Updated weights for policy 0, policy_version 1766092 (0.0009) [2023-12-26 13:41:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 901185536. Throughput: 0: 8949.0, 1: 8826.2. Samples: 901192332. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:48,784][121949] Avg episode reward: [(0, '6331.975'), (1, '5426.625')] [2023-12-26 13:41:49,264][123090] Updated weights for policy 1, policy_version 1754154 (0.0007) [2023-12-26 13:41:49,332][123090] Updated weights for policy 1, policy_version 1754164 (0.0007) [2023-12-26 13:41:49,404][123090] Updated weights for policy 1, policy_version 1754174 (0.0011) [2023-12-26 13:41:49,472][123091] Updated weights for policy 0, policy_version 1766102 (0.0008) [2023-12-26 13:41:49,537][123091] Updated weights for policy 0, policy_version 1766112 (0.0008) [2023-12-26 13:41:49,593][123091] Updated weights for policy 0, policy_version 1766122 (0.0009) [2023-12-26 13:41:50,116][123090] Updated weights for policy 1, policy_version 1754184 (0.0008) [2023-12-26 13:41:50,179][123090] Updated weights for policy 1, policy_version 1754194 (0.0006) [2023-12-26 13:41:50,249][123090] Updated weights for policy 1, policy_version 1754204 (0.0008) [2023-12-26 13:41:50,470][123091] Updated weights for policy 0, policy_version 1766132 (0.0009) [2023-12-26 13:41:50,525][123091] Updated weights for policy 0, policy_version 1766142 (0.0009) [2023-12-26 13:41:50,590][123091] Updated weights for policy 0, policy_version 1766152 (0.0010) [2023-12-26 13:41:51,064][123090] Updated weights for policy 1, policy_version 1754214 (0.0009) [2023-12-26 13:41:51,128][123090] Updated weights for policy 1, policy_version 1754224 (0.0008) [2023-12-26 13:41:51,198][123090] Updated weights for policy 1, policy_version 1754234 (0.0009) [2023-12-26 13:41:51,501][123091] Updated weights for policy 0, policy_version 1766162 (0.0010) [2023-12-26 13:41:51,562][123091] Updated weights for policy 0, policy_version 1766172 (0.0009) [2023-12-26 13:41:51,626][123091] Updated weights for policy 0, policy_version 1766182 (0.0010) [2023-12-26 13:41:51,684][123091] Updated weights for policy 0, policy_version 1766192 (0.0009) [2023-12-26 13:41:51,982][123090] Updated weights for policy 1, policy_version 1754244 (0.0008) [2023-12-26 13:41:52,041][123090] Updated weights for policy 1, policy_version 1754254 (0.0008) [2023-12-26 13:41:52,102][123090] Updated weights for policy 1, policy_version 1754264 (0.0009) [2023-12-26 13:41:52,522][123091] Updated weights for policy 0, policy_version 1766202 (0.0007) [2023-12-26 13:41:52,573][123091] Updated weights for policy 0, policy_version 1766212 (0.0005) [2023-12-26 13:41:52,638][123091] Updated weights for policy 0, policy_version 1766222 (0.0006) [2023-12-26 13:41:52,968][123090] Updated weights for policy 1, policy_version 1754274 (0.0010) [2023-12-26 13:41:53,027][123090] Updated weights for policy 1, policy_version 1754284 (0.0009) [2023-12-26 13:41:53,084][123090] Updated weights for policy 1, policy_version 1754294 (0.0009) [2023-12-26 13:41:53,143][123090] Updated weights for policy 1, policy_version 1754304 (0.0008) [2023-12-26 13:41:53,380][123091] Updated weights for policy 0, policy_version 1766232 (0.0007) [2023-12-26 13:41:53,446][123091] Updated weights for policy 0, policy_version 1766242 (0.0005) [2023-12-26 13:41:53,512][123091] Updated weights for policy 0, policy_version 1766252 (0.0007) [2023-12-26 13:41:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 901267456. Throughput: 0: 8942.9, 1: 8853.3. Samples: 901244276. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:53,784][121949] Avg episode reward: [(0, '6313.156'), (1, '5099.817')] [2023-12-26 13:41:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001754304_449101824.pth... [2023-12-26 13:41:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001766256_452165632.pth... [2023-12-26 13:41:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001765200_451895296.pth [2023-12-26 13:41:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001753280_448839680.pth [2023-12-26 13:41:53,955][123090] Updated weights for policy 1, policy_version 1754314 (0.0005) [2023-12-26 13:41:54,010][123090] Updated weights for policy 1, policy_version 1754324 (0.0007) [2023-12-26 13:41:54,059][123090] Updated weights for policy 1, policy_version 1754334 (0.0006) [2023-12-26 13:41:54,107][123091] Updated weights for policy 0, policy_version 1766262 (0.0009) [2023-12-26 13:41:54,170][123091] Updated weights for policy 0, policy_version 1766272 (0.0010) [2023-12-26 13:41:54,241][123091] Updated weights for policy 0, policy_version 1766282 (0.0010) [2023-12-26 13:41:54,732][123090] Updated weights for policy 1, policy_version 1754344 (0.0009) [2023-12-26 13:41:54,785][123090] Updated weights for policy 1, policy_version 1754354 (0.0009) [2023-12-26 13:41:54,843][123090] Updated weights for policy 1, policy_version 1754364 (0.0010) [2023-12-26 13:41:54,924][123091] Updated weights for policy 0, policy_version 1766292 (0.0005) [2023-12-26 13:41:54,991][123091] Updated weights for policy 0, policy_version 1766302 (0.0009) [2023-12-26 13:41:55,063][123091] Updated weights for policy 0, policy_version 1766312 (0.0011) [2023-12-26 13:41:55,701][123091] Updated weights for policy 0, policy_version 1766322 (0.0009) [2023-12-26 13:41:55,726][123090] Updated weights for policy 1, policy_version 1754374 (0.0009) [2023-12-26 13:41:55,758][123091] Updated weights for policy 0, policy_version 1766332 (0.0006) [2023-12-26 13:41:55,787][123090] Updated weights for policy 1, policy_version 1754384 (0.0009) [2023-12-26 13:41:55,824][123091] Updated weights for policy 0, policy_version 1766342 (0.0006) [2023-12-26 13:41:55,839][123090] Updated weights for policy 1, policy_version 1754394 (0.0008) [2023-12-26 13:41:55,871][123091] Updated weights for policy 0, policy_version 1766352 (0.0008) [2023-12-26 13:41:56,537][123091] Updated weights for policy 0, policy_version 1766362 (0.0010) [2023-12-26 13:41:56,587][123091] Updated weights for policy 0, policy_version 1766372 (0.0010) [2023-12-26 13:41:56,634][123091] Updated weights for policy 0, policy_version 1766382 (0.0010) [2023-12-26 13:41:56,678][123090] Updated weights for policy 1, policy_version 1754404 (0.0009) [2023-12-26 13:41:56,738][123090] Updated weights for policy 1, policy_version 1754415 (0.0010) [2023-12-26 13:41:56,793][123090] Updated weights for policy 1, policy_version 1754425 (0.0011) [2023-12-26 13:41:57,437][123091] Updated weights for policy 0, policy_version 1766392 (0.0006) [2023-12-26 13:41:57,497][123091] Updated weights for policy 0, policy_version 1766402 (0.0005) [2023-12-26 13:41:57,549][123091] Updated weights for policy 0, policy_version 1766412 (0.0005) [2023-12-26 13:41:57,578][123090] Updated weights for policy 1, policy_version 1754435 (0.0009) [2023-12-26 13:41:57,640][123090] Updated weights for policy 1, policy_version 1754445 (0.0006) [2023-12-26 13:41:57,696][123090] Updated weights for policy 1, policy_version 1754455 (0.0005) [2023-12-26 13:41:58,195][123091] Updated weights for policy 0, policy_version 1766422 (0.0008) [2023-12-26 13:41:58,258][123091] Updated weights for policy 0, policy_version 1766432 (0.0011) [2023-12-26 13:41:58,321][123091] Updated weights for policy 0, policy_version 1766442 (0.0011) [2023-12-26 13:41:58,490][123090] Updated weights for policy 1, policy_version 1754465 (0.0010) [2023-12-26 13:41:58,557][123090] Updated weights for policy 1, policy_version 1754475 (0.0011) [2023-12-26 13:41:58,628][123090] Updated weights for policy 1, policy_version 1754485 (0.0010) [2023-12-26 13:41:58,692][123090] Updated weights for policy 1, policy_version 1754495 (0.0010) [2023-12-26 13:41:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17886.4, 300 sec: 17716.9). Total num frames: 901365760. Throughput: 0: 9049.0, 1: 8826.1. Samples: 901354420. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:41:58,785][121949] Avg episode reward: [(0, '6295.570'), (1, '5132.741')] [2023-12-26 13:41:59,192][123091] Updated weights for policy 0, policy_version 1766452 (0.0009) [2023-12-26 13:41:59,253][123091] Updated weights for policy 0, policy_version 1766462 (0.0007) [2023-12-26 13:41:59,327][123091] Updated weights for policy 0, policy_version 1766472 (0.0008) [2023-12-26 13:41:59,513][123090] Updated weights for policy 1, policy_version 1754505 (0.0007) [2023-12-26 13:41:59,584][123090] Updated weights for policy 1, policy_version 1754515 (0.0005) [2023-12-26 13:41:59,650][123090] Updated weights for policy 1, policy_version 1754525 (0.0005) [2023-12-26 13:42:00,209][123091] Updated weights for policy 0, policy_version 1766482 (0.0009) [2023-12-26 13:42:00,281][123091] Updated weights for policy 0, policy_version 1766492 (0.0007) [2023-12-26 13:42:00,346][123091] Updated weights for policy 0, policy_version 1766502 (0.0006) [2023-12-26 13:42:00,377][123090] Updated weights for policy 1, policy_version 1754535 (0.0009) [2023-12-26 13:42:00,407][123091] Updated weights for policy 0, policy_version 1766512 (0.0007) [2023-12-26 13:42:00,434][123090] Updated weights for policy 1, policy_version 1754545 (0.0011) [2023-12-26 13:42:00,482][123090] Updated weights for policy 1, policy_version 1754555 (0.0010) [2023-12-26 13:42:01,047][123091] Updated weights for policy 0, policy_version 1766522 (0.0006) [2023-12-26 13:42:01,117][123091] Updated weights for policy 0, policy_version 1766532 (0.0007) [2023-12-26 13:42:01,180][123091] Updated weights for policy 0, policy_version 1766542 (0.0009) [2023-12-26 13:42:01,346][123090] Updated weights for policy 1, policy_version 1754565 (0.0011) [2023-12-26 13:42:01,417][123090] Updated weights for policy 1, policy_version 1754575 (0.0013) [2023-12-26 13:42:01,476][123090] Updated weights for policy 1, policy_version 1754585 (0.0011) [2023-12-26 13:42:01,991][123091] Updated weights for policy 0, policy_version 1766552 (0.0006) [2023-12-26 13:42:02,038][123091] Updated weights for policy 0, policy_version 1766562 (0.0005) [2023-12-26 13:42:02,091][123091] Updated weights for policy 0, policy_version 1766572 (0.0005) [2023-12-26 13:42:02,271][123090] Updated weights for policy 1, policy_version 1754595 (0.0011) [2023-12-26 13:42:02,331][123090] Updated weights for policy 1, policy_version 1754605 (0.0011) [2023-12-26 13:42:02,403][123090] Updated weights for policy 1, policy_version 1754615 (0.0011) [2023-12-26 13:42:02,845][123091] Updated weights for policy 0, policy_version 1766582 (0.0006) [2023-12-26 13:42:02,910][123091] Updated weights for policy 0, policy_version 1766592 (0.0005) [2023-12-26 13:42:02,958][123091] Updated weights for policy 0, policy_version 1766602 (0.0007) [2023-12-26 13:42:03,237][123090] Updated weights for policy 1, policy_version 1754625 (0.0010) [2023-12-26 13:42:03,300][123090] Updated weights for policy 1, policy_version 1754635 (0.0010) [2023-12-26 13:42:03,348][123090] Updated weights for policy 1, policy_version 1754645 (0.0010) [2023-12-26 13:42:03,407][123090] Updated weights for policy 1, policy_version 1754655 (0.0010) [2023-12-26 13:42:03,641][123091] Updated weights for policy 0, policy_version 1766612 (0.0006) [2023-12-26 13:42:03,688][123091] Updated weights for policy 0, policy_version 1766622 (0.0005) [2023-12-26 13:42:03,744][123091] Updated weights for policy 0, policy_version 1766632 (0.0007) [2023-12-26 13:42:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 901447680. Throughput: 0: 9005.3, 1: 8707.0. Samples: 901462024. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:42:03,784][121949] Avg episode reward: [(0, '6383.892'), (1, '5270.640')] [2023-12-26 13:42:04,222][123090] Updated weights for policy 1, policy_version 1754665 (0.0010) [2023-12-26 13:42:04,285][123090] Updated weights for policy 1, policy_version 1754675 (0.0010) [2023-12-26 13:42:04,352][123090] Updated weights for policy 1, policy_version 1754685 (0.0009) [2023-12-26 13:42:04,580][123091] Updated weights for policy 0, policy_version 1766642 (0.0009) [2023-12-26 13:42:04,639][123091] Updated weights for policy 0, policy_version 1766652 (0.0011) [2023-12-26 13:42:04,693][123091] Updated weights for policy 0, policy_version 1766662 (0.0010) [2023-12-26 13:42:04,744][123091] Updated weights for policy 0, policy_version 1766672 (0.0010) [2023-12-26 13:42:05,174][123090] Updated weights for policy 1, policy_version 1754695 (0.0009) [2023-12-26 13:42:05,236][123090] Updated weights for policy 1, policy_version 1754705 (0.0010) [2023-12-26 13:42:05,294][123090] Updated weights for policy 1, policy_version 1754715 (0.0010) [2023-12-26 13:42:05,471][123091] Updated weights for policy 0, policy_version 1766682 (0.0005) [2023-12-26 13:42:05,524][123091] Updated weights for policy 0, policy_version 1766692 (0.0005) [2023-12-26 13:42:05,578][123091] Updated weights for policy 0, policy_version 1766702 (0.0005) [2023-12-26 13:42:06,166][123090] Updated weights for policy 1, policy_version 1754725 (0.0010) [2023-12-26 13:42:06,233][123090] Updated weights for policy 1, policy_version 1754735 (0.0009) [2023-12-26 13:42:06,306][123090] Updated weights for policy 1, policy_version 1754745 (0.0008) [2023-12-26 13:42:06,354][123091] Updated weights for policy 0, policy_version 1766712 (0.0010) [2023-12-26 13:42:06,421][123091] Updated weights for policy 0, policy_version 1766722 (0.0011) [2023-12-26 13:42:06,493][123091] Updated weights for policy 0, policy_version 1766732 (0.0011) [2023-12-26 13:42:07,087][123090] Updated weights for policy 1, policy_version 1754755 (0.0007) [2023-12-26 13:42:07,144][123090] Updated weights for policy 1, policy_version 1754765 (0.0009) [2023-12-26 13:42:07,197][123090] Updated weights for policy 1, policy_version 1754775 (0.0009) [2023-12-26 13:42:07,314][123091] Updated weights for policy 0, policy_version 1766742 (0.0011) [2023-12-26 13:42:07,383][123091] Updated weights for policy 0, policy_version 1766752 (0.0010) [2023-12-26 13:42:07,434][123091] Updated weights for policy 0, policy_version 1766762 (0.0010) [2023-12-26 13:42:08,064][123090] Updated weights for policy 1, policy_version 1754785 (0.0009) [2023-12-26 13:42:08,123][123090] Updated weights for policy 1, policy_version 1754795 (0.0008) [2023-12-26 13:42:08,168][123091] Updated weights for policy 0, policy_version 1766772 (0.0009) [2023-12-26 13:42:08,170][123090] Updated weights for policy 1, policy_version 1754805 (0.0009) [2023-12-26 13:42:08,218][123090] Updated weights for policy 1, policy_version 1754815 (0.0006) [2023-12-26 13:42:08,219][123091] Updated weights for policy 0, policy_version 1766782 (0.0010) [2023-12-26 13:42:08,270][123091] Updated weights for policy 0, policy_version 1766792 (0.0010) [2023-12-26 13:42:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 901537792. Throughput: 0: 9038.4, 1: 8715.6. Samples: 901514624. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:42:08,785][121949] Avg episode reward: [(0, '6368.028'), (1, '5357.500')] [2023-12-26 13:42:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001766800_452304896.pth... [2023-12-26 13:42:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001754816_449232896.pth... [2023-12-26 13:42:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001765744_452034560.pth [2023-12-26 13:42:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001753792_448970752.pth [2023-12-26 13:42:09,046][123090] Updated weights for policy 1, policy_version 1754825 (0.0008) [2023-12-26 13:42:09,097][123090] Updated weights for policy 1, policy_version 1754835 (0.0008) [2023-12-26 13:42:09,134][123091] Updated weights for policy 0, policy_version 1766802 (0.0010) [2023-12-26 13:42:09,150][123090] Updated weights for policy 1, policy_version 1754845 (0.0009) [2023-12-26 13:42:09,198][123091] Updated weights for policy 0, policy_version 1766812 (0.0010) [2023-12-26 13:42:09,262][123091] Updated weights for policy 0, policy_version 1766822 (0.0010) [2023-12-26 13:42:09,336][123091] Updated weights for policy 0, policy_version 1766832 (0.0010) [2023-12-26 13:42:10,032][123090] Updated weights for policy 1, policy_version 1754855 (0.0008) [2023-12-26 13:42:10,103][123090] Updated weights for policy 1, policy_version 1754865 (0.0008) [2023-12-26 13:42:10,155][123090] Updated weights for policy 1, policy_version 1754875 (0.0008) [2023-12-26 13:42:10,175][123091] Updated weights for policy 0, policy_version 1766842 (0.0008) [2023-12-26 13:42:10,234][123091] Updated weights for policy 0, policy_version 1766852 (0.0009) [2023-12-26 13:42:10,292][123091] Updated weights for policy 0, policy_version 1766862 (0.0009) [2023-12-26 13:42:10,931][123090] Updated weights for policy 1, policy_version 1754885 (0.0007) [2023-12-26 13:42:10,984][123090] Updated weights for policy 1, policy_version 1754895 (0.0005) [2023-12-26 13:42:11,058][123090] Updated weights for policy 1, policy_version 1754905 (0.0008) [2023-12-26 13:42:11,225][123091] Updated weights for policy 0, policy_version 1766872 (0.0007) [2023-12-26 13:42:11,288][123091] Updated weights for policy 0, policy_version 1766882 (0.0007) [2023-12-26 13:42:11,355][123091] Updated weights for policy 0, policy_version 1766892 (0.0008) [2023-12-26 13:42:11,819][123090] Updated weights for policy 1, policy_version 1754915 (0.0011) [2023-12-26 13:42:11,887][123090] Updated weights for policy 1, policy_version 1754925 (0.0011) [2023-12-26 13:42:11,959][123090] Updated weights for policy 1, policy_version 1754935 (0.0011) [2023-12-26 13:42:12,198][123091] Updated weights for policy 0, policy_version 1766902 (0.0010) [2023-12-26 13:42:12,250][123091] Updated weights for policy 0, policy_version 1766912 (0.0011) [2023-12-26 13:42:12,307][123091] Updated weights for policy 0, policy_version 1766922 (0.0011) [2023-12-26 13:42:12,779][123090] Updated weights for policy 1, policy_version 1754945 (0.0011) [2023-12-26 13:42:12,845][123090] Updated weights for policy 1, policy_version 1754955 (0.0010) [2023-12-26 13:42:12,912][123090] Updated weights for policy 1, policy_version 1754965 (0.0010) [2023-12-26 13:42:12,970][123090] Updated weights for policy 1, policy_version 1754975 (0.0010) [2023-12-26 13:42:13,186][123091] Updated weights for policy 0, policy_version 1766932 (0.0010) [2023-12-26 13:42:13,238][123091] Updated weights for policy 0, policy_version 1766942 (0.0008) [2023-12-26 13:42:13,294][123091] Updated weights for policy 0, policy_version 1766952 (0.0009) [2023-12-26 13:42:13,760][123090] Updated weights for policy 1, policy_version 1754985 (0.0007) [2023-12-26 13:42:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 901619712. Throughput: 0: 8970.9, 1: 8752.5. Samples: 901617140. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:42:13,785][121949] Avg episode reward: [(0, '6321.928'), (1, '5432.958')] [2023-12-26 13:42:13,810][123090] Updated weights for policy 1, policy_version 1754995 (0.0009) [2023-12-26 13:42:13,866][123090] Updated weights for policy 1, policy_version 1755005 (0.0010) [2023-12-26 13:42:14,033][123091] Updated weights for policy 0, policy_version 1766962 (0.0008) [2023-12-26 13:42:14,090][123091] Updated weights for policy 0, policy_version 1766972 (0.0007) [2023-12-26 13:42:14,149][123091] Updated weights for policy 0, policy_version 1766982 (0.0010) [2023-12-26 13:42:14,213][123091] Updated weights for policy 0, policy_version 1766992 (0.0009) [2023-12-26 13:42:14,695][123090] Updated weights for policy 1, policy_version 1755015 (0.0006) [2023-12-26 13:42:14,756][123090] Updated weights for policy 1, policy_version 1755025 (0.0005) [2023-12-26 13:42:14,817][123090] Updated weights for policy 1, policy_version 1755035 (0.0007) [2023-12-26 13:42:14,914][123091] Updated weights for policy 0, policy_version 1767002 (0.0010) [2023-12-26 13:42:14,976][123091] Updated weights for policy 0, policy_version 1767012 (0.0010) [2023-12-26 13:42:15,037][123091] Updated weights for policy 0, policy_version 1767022 (0.0009) [2023-12-26 13:42:15,504][123090] Updated weights for policy 1, policy_version 1755045 (0.0005) [2023-12-26 13:42:15,577][123090] Updated weights for policy 1, policy_version 1755055 (0.0005) [2023-12-26 13:42:15,648][123090] Updated weights for policy 1, policy_version 1755065 (0.0005) [2023-12-26 13:42:15,848][123091] Updated weights for policy 0, policy_version 1767032 (0.0008) [2023-12-26 13:42:15,912][123091] Updated weights for policy 0, policy_version 1767042 (0.0011) [2023-12-26 13:42:15,975][123091] Updated weights for policy 0, policy_version 1767052 (0.0011) [2023-12-26 13:42:16,383][123090] Updated weights for policy 1, policy_version 1755075 (0.0007) [2023-12-26 13:42:16,430][123090] Updated weights for policy 1, policy_version 1755085 (0.0006) [2023-12-26 13:42:16,476][123090] Updated weights for policy 1, policy_version 1755095 (0.0008) [2023-12-26 13:42:16,686][123091] Updated weights for policy 0, policy_version 1767062 (0.0007) [2023-12-26 13:42:16,740][123091] Updated weights for policy 0, policy_version 1767072 (0.0005) [2023-12-26 13:42:16,791][123091] Updated weights for policy 0, policy_version 1767082 (0.0005) [2023-12-26 13:42:17,222][123090] Updated weights for policy 1, policy_version 1755105 (0.0006) [2023-12-26 13:42:17,284][123090] Updated weights for policy 1, policy_version 1755115 (0.0010) [2023-12-26 13:42:17,331][123090] Updated weights for policy 1, policy_version 1755125 (0.0010) [2023-12-26 13:42:17,383][123090] Updated weights for policy 1, policy_version 1755135 (0.0010) [2023-12-26 13:42:17,472][123091] Updated weights for policy 0, policy_version 1767092 (0.0005) [2023-12-26 13:42:17,536][123091] Updated weights for policy 0, policy_version 1767102 (0.0007) [2023-12-26 13:42:17,597][123091] Updated weights for policy 0, policy_version 1767112 (0.0010) [2023-12-26 13:42:18,190][123090] Updated weights for policy 1, policy_version 1755145 (0.0006) [2023-12-26 13:42:18,259][123090] Updated weights for policy 1, policy_version 1755155 (0.0006) [2023-12-26 13:42:18,328][123090] Updated weights for policy 1, policy_version 1755165 (0.0007) [2023-12-26 13:42:18,352][123091] Updated weights for policy 0, policy_version 1767122 (0.0010) [2023-12-26 13:42:18,418][123091] Updated weights for policy 0, policy_version 1767132 (0.0007) [2023-12-26 13:42:18,482][123091] Updated weights for policy 0, policy_version 1767142 (0.0010) [2023-12-26 13:42:18,552][123091] Updated weights for policy 0, policy_version 1767152 (0.0010) [2023-12-26 13:42:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 901718016. Throughput: 0: 9005.1, 1: 8791.4. Samples: 901727560. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:42:18,785][121949] Avg episode reward: [(0, '6381.573'), (1, '5163.067')] [2023-12-26 13:42:19,070][123090] Updated weights for policy 1, policy_version 1755175 (0.0010) [2023-12-26 13:42:19,131][123090] Updated weights for policy 1, policy_version 1755185 (0.0010) [2023-12-26 13:42:19,195][123090] Updated weights for policy 1, policy_version 1755195 (0.0010) [2023-12-26 13:42:19,364][123091] Updated weights for policy 0, policy_version 1767162 (0.0008) [2023-12-26 13:42:19,429][123091] Updated weights for policy 0, policy_version 1767172 (0.0008) [2023-12-26 13:42:19,494][123091] Updated weights for policy 0, policy_version 1767182 (0.0008) [2023-12-26 13:42:20,067][123090] Updated weights for policy 1, policy_version 1755205 (0.0011) [2023-12-26 13:42:20,136][123090] Updated weights for policy 1, policy_version 1755215 (0.0009) [2023-12-26 13:42:20,199][123090] Updated weights for policy 1, policy_version 1755225 (0.0009) [2023-12-26 13:42:20,305][123091] Updated weights for policy 0, policy_version 1767192 (0.0009) [2023-12-26 13:42:20,356][123091] Updated weights for policy 0, policy_version 1767202 (0.0008) [2023-12-26 13:42:20,404][123091] Updated weights for policy 0, policy_version 1767212 (0.0005) [2023-12-26 13:42:21,152][123090] Updated weights for policy 1, policy_version 1755235 (0.0009) [2023-12-26 13:42:21,179][123091] Updated weights for policy 0, policy_version 1767222 (0.0008) [2023-12-26 13:42:21,209][123090] Updated weights for policy 1, policy_version 1755245 (0.0008) [2023-12-26 13:42:21,244][123091] Updated weights for policy 0, policy_version 1767232 (0.0009) [2023-12-26 13:42:21,274][123090] Updated weights for policy 1, policy_version 1755255 (0.0008) [2023-12-26 13:42:21,315][123091] Updated weights for policy 0, policy_version 1767242 (0.0009) [2023-12-26 13:42:22,073][123091] Updated weights for policy 0, policy_version 1767252 (0.0010) [2023-12-26 13:42:22,133][123091] Updated weights for policy 0, policy_version 1767262 (0.0007) [2023-12-26 13:42:22,162][123090] Updated weights for policy 1, policy_version 1755265 (0.0009) [2023-12-26 13:42:22,202][123091] Updated weights for policy 0, policy_version 1767272 (0.0007) [2023-12-26 13:42:22,229][123090] Updated weights for policy 1, policy_version 1755275 (0.0006) [2023-12-26 13:42:22,301][123090] Updated weights for policy 1, policy_version 1755285 (0.0010) [2023-12-26 13:42:22,372][123090] Updated weights for policy 1, policy_version 1755295 (0.0011) [2023-12-26 13:42:23,017][123091] Updated weights for policy 0, policy_version 1767282 (0.0008) [2023-12-26 13:42:23,071][123091] Updated weights for policy 0, policy_version 1767292 (0.0009) [2023-12-26 13:42:23,120][123091] Updated weights for policy 0, policy_version 1767302 (0.0009) [2023-12-26 13:42:23,168][123090] Updated weights for policy 1, policy_version 1755305 (0.0010) [2023-12-26 13:42:23,176][123091] Updated weights for policy 0, policy_version 1767312 (0.0005) [2023-12-26 13:42:23,224][123090] Updated weights for policy 1, policy_version 1755315 (0.0010) [2023-12-26 13:42:23,279][123090] Updated weights for policy 1, policy_version 1755325 (0.0010) [2023-12-26 13:42:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.2, 300 sec: 17689.1). Total num frames: 901799936. Throughput: 0: 8968.2, 1: 8696.5. Samples: 901778128. Policy #0 lag: (min: 31.0, avg: 32.5, max: 63.0) [2023-12-26 13:42:23,785][121949] Avg episode reward: [(0, '6417.700'), (1, '5372.069')] [2023-12-26 13:42:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001755328_449363968.pth... [2023-12-26 13:42:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001767312_452435968.pth... [2023-12-26 13:42:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001754304_449101824.pth [2023-12-26 13:42:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001766256_452165632.pth [2023-12-26 13:42:24,034][123091] Updated weights for policy 0, policy_version 1767322 (0.0009) [2023-12-26 13:42:24,097][123091] Updated weights for policy 0, policy_version 1767332 (0.0009) [2023-12-26 13:42:24,100][123090] Updated weights for policy 1, policy_version 1755335 (0.0009) [2023-12-26 13:42:24,154][123091] Updated weights for policy 0, policy_version 1767342 (0.0009) [2023-12-26 13:42:24,166][123090] Updated weights for policy 1, policy_version 1755345 (0.0007) [2023-12-26 13:42:24,219][123090] Updated weights for policy 1, policy_version 1755355 (0.0009) [2023-12-26 13:42:24,922][123091] Updated weights for policy 0, policy_version 1767352 (0.0010) [2023-12-26 13:42:24,982][123091] Updated weights for policy 0, policy_version 1767362 (0.0009) [2023-12-26 13:42:25,038][123090] Updated weights for policy 1, policy_version 1755365 (0.0007) [2023-12-26 13:42:25,050][123091] Updated weights for policy 0, policy_version 1767372 (0.0008) [2023-12-26 13:42:25,094][123090] Updated weights for policy 1, policy_version 1755375 (0.0005) [2023-12-26 13:42:25,150][123090] Updated weights for policy 1, policy_version 1755385 (0.0005) [2023-12-26 13:42:25,874][123091] Updated weights for policy 0, policy_version 1767382 (0.0006) [2023-12-26 13:42:25,936][123091] Updated weights for policy 0, policy_version 1767392 (0.0005) [2023-12-26 13:42:25,965][123090] Updated weights for policy 1, policy_version 1755395 (0.0010) [2023-12-26 13:42:26,000][123091] Updated weights for policy 0, policy_version 1767402 (0.0005) [2023-12-26 13:42:26,021][123090] Updated weights for policy 1, policy_version 1755405 (0.0010) [2023-12-26 13:42:26,069][123090] Updated weights for policy 1, policy_version 1755415 (0.0010) [2023-12-26 13:42:26,763][123090] Updated weights for policy 1, policy_version 1755425 (0.0010) [2023-12-26 13:42:26,781][123091] Updated weights for policy 0, policy_version 1767412 (0.0006) [2023-12-26 13:42:26,813][123090] Updated weights for policy 1, policy_version 1755435 (0.0010) [2023-12-26 13:42:26,837][123091] Updated weights for policy 0, policy_version 1767422 (0.0005) [2023-12-26 13:42:26,864][123090] Updated weights for policy 1, policy_version 1755445 (0.0010) [2023-12-26 13:42:26,889][123091] Updated weights for policy 0, policy_version 1767432 (0.0006) [2023-12-26 13:42:26,912][123090] Updated weights for policy 1, policy_version 1755455 (0.0010) [2023-12-26 13:42:27,650][123091] Updated weights for policy 0, policy_version 1767442 (0.0007) [2023-12-26 13:42:27,692][123090] Updated weights for policy 1, policy_version 1755465 (0.0008) [2023-12-26 13:42:27,702][123091] Updated weights for policy 0, policy_version 1767452 (0.0005) [2023-12-26 13:42:27,745][123090] Updated weights for policy 1, policy_version 1755475 (0.0009) [2023-12-26 13:42:27,749][123091] Updated weights for policy 0, policy_version 1767462 (0.0006) [2023-12-26 13:42:27,795][123090] Updated weights for policy 1, policy_version 1755485 (0.0007) [2023-12-26 13:42:28,505][123091] Updated weights for policy 0, policy_version 1767473 (0.0008) [2023-12-26 13:42:28,573][123091] Updated weights for policy 0, policy_version 1767483 (0.0008) [2023-12-26 13:42:28,634][123090] Updated weights for policy 1, policy_version 1755495 (0.0010) [2023-12-26 13:42:28,637][123091] Updated weights for policy 0, policy_version 1767493 (0.0008) [2023-12-26 13:42:28,689][123090] Updated weights for policy 1, policy_version 1755505 (0.0010) [2023-12-26 13:42:28,699][123091] Updated weights for policy 0, policy_version 1767503 (0.0008) [2023-12-26 13:42:28,741][123090] Updated weights for policy 1, policy_version 1755515 (0.0010) [2023-12-26 13:42:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 901898240. Throughput: 0: 9036.4, 1: 8737.1. Samples: 901884840. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:28,785][121949] Avg episode reward: [(0, '6248.031'), (1, '5490.976')] [2023-12-26 13:42:29,468][123091] Updated weights for policy 0, policy_version 1767513 (0.0005) [2023-12-26 13:42:29,496][123090] Updated weights for policy 1, policy_version 1755525 (0.0008) [2023-12-26 13:42:29,538][123091] Updated weights for policy 0, policy_version 1767523 (0.0005) [2023-12-26 13:42:29,553][123090] Updated weights for policy 1, policy_version 1755535 (0.0007) [2023-12-26 13:42:29,613][123091] Updated weights for policy 0, policy_version 1767533 (0.0005) [2023-12-26 13:42:29,619][123090] Updated weights for policy 1, policy_version 1755545 (0.0005) [2023-12-26 13:42:30,313][123091] Updated weights for policy 0, policy_version 1767543 (0.0008) [2023-12-26 13:42:30,367][123091] Updated weights for policy 0, policy_version 1767553 (0.0009) [2023-12-26 13:42:30,381][123090] Updated weights for policy 1, policy_version 1755555 (0.0007) [2023-12-26 13:42:30,420][123091] Updated weights for policy 0, policy_version 1767563 (0.0007) [2023-12-26 13:42:30,440][123090] Updated weights for policy 1, policy_version 1755565 (0.0007) [2023-12-26 13:42:30,498][123090] Updated weights for policy 1, policy_version 1755575 (0.0009) [2023-12-26 13:42:31,255][123090] Updated weights for policy 1, policy_version 1755585 (0.0011) [2023-12-26 13:42:31,291][123091] Updated weights for policy 0, policy_version 1767573 (0.0007) [2023-12-26 13:42:31,315][123090] Updated weights for policy 1, policy_version 1755595 (0.0011) [2023-12-26 13:42:31,363][123091] Updated weights for policy 0, policy_version 1767583 (0.0007) [2023-12-26 13:42:31,384][123090] Updated weights for policy 1, policy_version 1755605 (0.0011) [2023-12-26 13:42:31,434][123091] Updated weights for policy 0, policy_version 1767593 (0.0008) [2023-12-26 13:42:31,446][123090] Updated weights for policy 1, policy_version 1755615 (0.0011) [2023-12-26 13:42:32,199][123091] Updated weights for policy 0, policy_version 1767603 (0.0009) [2023-12-26 13:42:32,248][123091] Updated weights for policy 0, policy_version 1767613 (0.0007) [2023-12-26 13:42:32,270][123090] Updated weights for policy 1, policy_version 1755625 (0.0011) [2023-12-26 13:42:32,304][123091] Updated weights for policy 0, policy_version 1767623 (0.0009) [2023-12-26 13:42:32,329][123090] Updated weights for policy 1, policy_version 1755635 (0.0011) [2023-12-26 13:42:32,393][123090] Updated weights for policy 1, policy_version 1755645 (0.0009) [2023-12-26 13:42:32,959][123091] Updated weights for policy 0, policy_version 1767633 (0.0008) [2023-12-26 13:42:33,014][123091] Updated weights for policy 0, policy_version 1767643 (0.0005) [2023-12-26 13:42:33,085][123091] Updated weights for policy 0, policy_version 1767653 (0.0005) [2023-12-26 13:42:33,145][123091] Updated weights for policy 0, policy_version 1767663 (0.0008) [2023-12-26 13:42:33,163][123090] Updated weights for policy 1, policy_version 1755655 (0.0007) [2023-12-26 13:42:33,235][123090] Updated weights for policy 1, policy_version 1755665 (0.0006) [2023-12-26 13:42:33,289][123090] Updated weights for policy 1, policy_version 1755675 (0.0005) [2023-12-26 13:42:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 901980160. Throughput: 0: 9035.4, 1: 8798.3. Samples: 901994848. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:33,785][121949] Avg episode reward: [(0, '6187.676'), (1, '5623.852')] [2023-12-26 13:42:33,932][123091] Updated weights for policy 0, policy_version 1767673 (0.0010) [2023-12-26 13:42:33,987][123091] Updated weights for policy 0, policy_version 1767683 (0.0010) [2023-12-26 13:42:34,019][123090] Updated weights for policy 1, policy_version 1755685 (0.0005) [2023-12-26 13:42:34,038][123091] Updated weights for policy 0, policy_version 1767693 (0.0010) [2023-12-26 13:42:34,069][123090] Updated weights for policy 1, policy_version 1755695 (0.0007) [2023-12-26 13:42:34,122][123090] Updated weights for policy 1, policy_version 1755705 (0.0010) [2023-12-26 13:42:34,801][123091] Updated weights for policy 0, policy_version 1767703 (0.0007) [2023-12-26 13:42:34,855][123091] Updated weights for policy 0, policy_version 1767713 (0.0005) [2023-12-26 13:42:34,902][123091] Updated weights for policy 0, policy_version 1767723 (0.0005) [2023-12-26 13:42:35,045][123090] Updated weights for policy 1, policy_version 1755715 (0.0008) [2023-12-26 13:42:35,115][123090] Updated weights for policy 1, policy_version 1755725 (0.0009) [2023-12-26 13:42:35,180][123090] Updated weights for policy 1, policy_version 1755735 (0.0009) [2023-12-26 13:42:35,666][123091] Updated weights for policy 0, policy_version 1767733 (0.0007) [2023-12-26 13:42:35,731][123091] Updated weights for policy 0, policy_version 1767743 (0.0010) [2023-12-26 13:42:35,801][123091] Updated weights for policy 0, policy_version 1767753 (0.0011) [2023-12-26 13:42:35,949][123090] Updated weights for policy 1, policy_version 1755745 (0.0009) [2023-12-26 13:42:36,003][123090] Updated weights for policy 1, policy_version 1755755 (0.0005) [2023-12-26 13:42:36,054][123090] Updated weights for policy 1, policy_version 1755765 (0.0005) [2023-12-26 13:42:36,124][123090] Updated weights for policy 1, policy_version 1755775 (0.0007) [2023-12-26 13:42:36,569][123091] Updated weights for policy 0, policy_version 1767763 (0.0011) [2023-12-26 13:42:36,633][123091] Updated weights for policy 0, policy_version 1767773 (0.0011) [2023-12-26 13:42:36,696][123091] Updated weights for policy 0, policy_version 1767783 (0.0011) [2023-12-26 13:42:36,926][123090] Updated weights for policy 1, policy_version 1755785 (0.0006) [2023-12-26 13:42:36,982][123090] Updated weights for policy 1, policy_version 1755795 (0.0008) [2023-12-26 13:42:37,043][123090] Updated weights for policy 1, policy_version 1755806 (0.0010) [2023-12-26 13:42:37,410][123091] Updated weights for policy 0, policy_version 1767793 (0.0010) [2023-12-26 13:42:37,478][123091] Updated weights for policy 0, policy_version 1767803 (0.0009) [2023-12-26 13:42:37,552][123091] Updated weights for policy 0, policy_version 1767813 (0.0005) [2023-12-26 13:42:37,624][123091] Updated weights for policy 0, policy_version 1767823 (0.0005) [2023-12-26 13:42:37,926][123090] Updated weights for policy 1, policy_version 1755816 (0.0009) [2023-12-26 13:42:37,980][123090] Updated weights for policy 1, policy_version 1755826 (0.0009) [2023-12-26 13:42:38,038][123090] Updated weights for policy 1, policy_version 1755836 (0.0010) [2023-12-26 13:42:38,232][123091] Updated weights for policy 0, policy_version 1767833 (0.0006) [2023-12-26 13:42:38,277][123091] Updated weights for policy 0, policy_version 1767843 (0.0007) [2023-12-26 13:42:38,328][123091] Updated weights for policy 0, policy_version 1767853 (0.0009) [2023-12-26 13:42:38,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 902070272. Throughput: 0: 9077.4, 1: 8769.2. Samples: 902047372. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:38,784][121949] Avg episode reward: [(0, '6188.146'), (1, '5474.260')] [2023-12-26 13:42:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001767856_452575232.pth... [2023-12-26 13:42:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001755840_449495040.pth... [2023-12-26 13:42:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001766800_452304896.pth [2023-12-26 13:42:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001754816_449232896.pth [2023-12-26 13:42:38,958][123090] Updated weights for policy 1, policy_version 1755846 (0.0010) [2023-12-26 13:42:39,021][123090] Updated weights for policy 1, policy_version 1755856 (0.0008) [2023-12-26 13:42:39,098][123090] Updated weights for policy 1, policy_version 1755866 (0.0005) [2023-12-26 13:42:39,123][123091] Updated weights for policy 0, policy_version 1767863 (0.0007) [2023-12-26 13:42:39,189][123091] Updated weights for policy 0, policy_version 1767873 (0.0005) [2023-12-26 13:42:39,250][123091] Updated weights for policy 0, policy_version 1767883 (0.0007) [2023-12-26 13:42:39,884][123090] Updated weights for policy 1, policy_version 1755876 (0.0008) [2023-12-26 13:42:39,956][123090] Updated weights for policy 1, policy_version 1755886 (0.0009) [2023-12-26 13:42:40,014][123090] Updated weights for policy 1, policy_version 1755896 (0.0009) [2023-12-26 13:42:40,050][123091] Updated weights for policy 0, policy_version 1767893 (0.0009) [2023-12-26 13:42:40,107][123091] Updated weights for policy 0, policy_version 1767903 (0.0011) [2023-12-26 13:42:40,163][123091] Updated weights for policy 0, policy_version 1767913 (0.0011) [2023-12-26 13:42:40,852][123090] Updated weights for policy 1, policy_version 1755906 (0.0006) [2023-12-26 13:42:40,910][123090] Updated weights for policy 1, policy_version 1755916 (0.0010) [2023-12-26 13:42:40,968][123090] Updated weights for policy 1, policy_version 1755926 (0.0010) [2023-12-26 13:42:40,998][123091] Updated weights for policy 0, policy_version 1767923 (0.0011) [2023-12-26 13:42:41,034][123090] Updated weights for policy 1, policy_version 1755936 (0.0011) [2023-12-26 13:42:41,064][123091] Updated weights for policy 0, policy_version 1767933 (0.0011) [2023-12-26 13:42:41,129][123091] Updated weights for policy 0, policy_version 1767943 (0.0010) [2023-12-26 13:42:41,895][123090] Updated weights for policy 1, policy_version 1755946 (0.0011) [2023-12-26 13:42:41,946][123091] Updated weights for policy 0, policy_version 1767953 (0.0011) [2023-12-26 13:42:41,966][123090] Updated weights for policy 1, policy_version 1755956 (0.0006) [2023-12-26 13:42:42,008][123091] Updated weights for policy 0, policy_version 1767963 (0.0008) [2023-12-26 13:42:42,025][123090] Updated weights for policy 1, policy_version 1755966 (0.0006) [2023-12-26 13:42:42,068][123091] Updated weights for policy 0, policy_version 1767973 (0.0009) [2023-12-26 13:42:42,129][123091] Updated weights for policy 0, policy_version 1767983 (0.0009) [2023-12-26 13:42:42,783][123090] Updated weights for policy 1, policy_version 1755976 (0.0008) [2023-12-26 13:42:42,857][123090] Updated weights for policy 1, policy_version 1755986 (0.0009) [2023-12-26 13:42:42,914][123090] Updated weights for policy 1, policy_version 1755996 (0.0009) [2023-12-26 13:42:42,949][123091] Updated weights for policy 0, policy_version 1767993 (0.0006) [2023-12-26 13:42:43,004][123091] Updated weights for policy 0, policy_version 1768003 (0.0006) [2023-12-26 13:42:43,051][123091] Updated weights for policy 0, policy_version 1768013 (0.0010) [2023-12-26 13:42:43,766][123091] Updated weights for policy 0, policy_version 1768023 (0.0008) [2023-12-26 13:42:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 902152192. Throughput: 0: 9025.0, 1: 8719.9. Samples: 902152940. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:43,785][121949] Avg episode reward: [(0, '6185.603'), (1, '5263.609')] [2023-12-26 13:42:43,789][123090] Updated weights for policy 1, policy_version 1756006 (0.0008) [2023-12-26 13:42:43,821][123091] Updated weights for policy 0, policy_version 1768033 (0.0007) [2023-12-26 13:42:43,844][123090] Updated weights for policy 1, policy_version 1756016 (0.0009) [2023-12-26 13:42:43,868][123091] Updated weights for policy 0, policy_version 1768043 (0.0005) [2023-12-26 13:42:43,893][123090] Updated weights for policy 1, policy_version 1756026 (0.0009) [2023-12-26 13:42:44,529][123091] Updated weights for policy 0, policy_version 1768053 (0.0005) [2023-12-26 13:42:44,585][123091] Updated weights for policy 0, policy_version 1768063 (0.0006) [2023-12-26 13:42:44,629][123091] Updated weights for policy 0, policy_version 1768073 (0.0005) [2023-12-26 13:42:44,846][123090] Updated weights for policy 1, policy_version 1756036 (0.0010) [2023-12-26 13:42:44,908][123090] Updated weights for policy 1, policy_version 1756046 (0.0010) [2023-12-26 13:42:44,967][123090] Updated weights for policy 1, policy_version 1756056 (0.0009) [2023-12-26 13:42:45,339][123091] Updated weights for policy 0, policy_version 1768083 (0.0007) [2023-12-26 13:42:45,398][123091] Updated weights for policy 0, policy_version 1768093 (0.0011) [2023-12-26 13:42:45,467][123091] Updated weights for policy 0, policy_version 1768103 (0.0007) [2023-12-26 13:42:45,781][123090] Updated weights for policy 1, policy_version 1756066 (0.0009) [2023-12-26 13:42:45,857][123090] Updated weights for policy 1, policy_version 1756076 (0.0005) [2023-12-26 13:42:45,915][123090] Updated weights for policy 1, policy_version 1756086 (0.0005) [2023-12-26 13:42:45,973][123090] Updated weights for policy 1, policy_version 1756096 (0.0005) [2023-12-26 13:42:46,102][123091] Updated weights for policy 0, policy_version 1768113 (0.0006) [2023-12-26 13:42:46,162][123091] Updated weights for policy 0, policy_version 1768123 (0.0009) [2023-12-26 13:42:46,227][123091] Updated weights for policy 0, policy_version 1768133 (0.0009) [2023-12-26 13:42:46,288][123091] Updated weights for policy 0, policy_version 1768143 (0.0009) [2023-12-26 13:42:46,638][123090] Updated weights for policy 1, policy_version 1756106 (0.0007) [2023-12-26 13:42:46,697][123090] Updated weights for policy 1, policy_version 1756116 (0.0007) [2023-12-26 13:42:46,771][123090] Updated weights for policy 1, policy_version 1756126 (0.0005) [2023-12-26 13:42:47,158][123091] Updated weights for policy 0, policy_version 1768153 (0.0005) [2023-12-26 13:42:47,223][123091] Updated weights for policy 0, policy_version 1768163 (0.0007) [2023-12-26 13:42:47,277][123091] Updated weights for policy 0, policy_version 1768173 (0.0008) [2023-12-26 13:42:47,475][123090] Updated weights for policy 1, policy_version 1756137 (0.0009) [2023-12-26 13:42:47,529][123090] Updated weights for policy 1, policy_version 1756148 (0.0010) [2023-12-26 13:42:47,600][123090] Updated weights for policy 1, policy_version 1756158 (0.0009) [2023-12-26 13:42:48,004][123091] Updated weights for policy 0, policy_version 1768183 (0.0009) [2023-12-26 13:42:48,060][123091] Updated weights for policy 0, policy_version 1768193 (0.0010) [2023-12-26 13:42:48,111][123091] Updated weights for policy 0, policy_version 1768203 (0.0010) [2023-12-26 13:42:48,250][123090] Updated weights for policy 1, policy_version 1756168 (0.0005) [2023-12-26 13:42:48,320][123090] Updated weights for policy 1, policy_version 1756178 (0.0008) [2023-12-26 13:42:48,388][123090] Updated weights for policy 1, policy_version 1756188 (0.0009) [2023-12-26 13:42:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 902250496. Throughput: 0: 9047.1, 1: 8745.6. Samples: 902262700. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:48,785][121949] Avg episode reward: [(0, '6273.959'), (1, '5209.266')] [2023-12-26 13:42:48,950][123091] Updated weights for policy 0, policy_version 1768213 (0.0011) [2023-12-26 13:42:49,006][123091] Updated weights for policy 0, policy_version 1768223 (0.0010) [2023-12-26 13:42:49,069][123091] Updated weights for policy 0, policy_version 1768233 (0.0010) [2023-12-26 13:42:49,202][123090] Updated weights for policy 1, policy_version 1756198 (0.0009) [2023-12-26 13:42:49,274][123090] Updated weights for policy 1, policy_version 1756208 (0.0009) [2023-12-26 13:42:49,326][123090] Updated weights for policy 1, policy_version 1756218 (0.0008) [2023-12-26 13:42:49,944][123091] Updated weights for policy 0, policy_version 1768243 (0.0010) [2023-12-26 13:42:50,012][123091] Updated weights for policy 0, policy_version 1768253 (0.0007) [2023-12-26 13:42:50,081][123091] Updated weights for policy 0, policy_version 1768263 (0.0005) [2023-12-26 13:42:50,156][123090] Updated weights for policy 1, policy_version 1756228 (0.0008) [2023-12-26 13:42:50,213][123090] Updated weights for policy 1, policy_version 1756238 (0.0005) [2023-12-26 13:42:50,275][123090] Updated weights for policy 1, policy_version 1756248 (0.0005) [2023-12-26 13:42:50,868][123091] Updated weights for policy 0, policy_version 1768273 (0.0008) [2023-12-26 13:42:50,920][123091] Updated weights for policy 0, policy_version 1768283 (0.0006) [2023-12-26 13:42:50,979][123091] Updated weights for policy 0, policy_version 1768293 (0.0007) [2023-12-26 13:42:51,042][123091] Updated weights for policy 0, policy_version 1768303 (0.0010) [2023-12-26 13:42:51,111][123090] Updated weights for policy 1, policy_version 1756258 (0.0009) [2023-12-26 13:42:51,174][123090] Updated weights for policy 1, policy_version 1756268 (0.0010) [2023-12-26 13:42:51,234][123090] Updated weights for policy 1, policy_version 1756278 (0.0010) [2023-12-26 13:42:51,300][123090] Updated weights for policy 1, policy_version 1756288 (0.0010) [2023-12-26 13:42:51,878][123091] Updated weights for policy 0, policy_version 1768313 (0.0010) [2023-12-26 13:42:51,942][123091] Updated weights for policy 0, policy_version 1768323 (0.0010) [2023-12-26 13:42:52,006][123091] Updated weights for policy 0, policy_version 1768333 (0.0010) [2023-12-26 13:42:52,113][123090] Updated weights for policy 1, policy_version 1756298 (0.0010) [2023-12-26 13:42:52,173][123090] Updated weights for policy 1, policy_version 1756308 (0.0009) [2023-12-26 13:42:52,238][123090] Updated weights for policy 1, policy_version 1756318 (0.0007) [2023-12-26 13:42:52,773][123091] Updated weights for policy 0, policy_version 1768343 (0.0010) [2023-12-26 13:42:52,835][123091] Updated weights for policy 0, policy_version 1768353 (0.0009) [2023-12-26 13:42:52,892][123091] Updated weights for policy 0, policy_version 1768363 (0.0011) [2023-12-26 13:42:53,068][123090] Updated weights for policy 1, policy_version 1756328 (0.0009) [2023-12-26 13:42:53,116][123090] Updated weights for policy 1, policy_version 1756338 (0.0009) [2023-12-26 13:42:53,165][123090] Updated weights for policy 1, policy_version 1756348 (0.0009) [2023-12-26 13:42:53,733][123091] Updated weights for policy 0, policy_version 1768373 (0.0008) [2023-12-26 13:42:53,784][123091] Updated weights for policy 0, policy_version 1768383 (0.0005) [2023-12-26 13:42:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 902332416. Throughput: 0: 9019.3, 1: 8754.7. Samples: 902314452. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:53,785][121949] Avg episode reward: [(0, '6310.344'), (1, '5347.656')] [2023-12-26 13:42:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001756352_449626112.pth... [2023-12-26 13:42:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001755328_449363968.pth [2023-12-26 13:42:53,839][123091] Updated weights for policy 0, policy_version 1768393 (0.0006) [2023-12-26 13:42:53,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001768400_452714496.pth... [2023-12-26 13:42:53,888][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001767312_452435968.pth [2023-12-26 13:42:54,042][123090] Updated weights for policy 1, policy_version 1756358 (0.0009) [2023-12-26 13:42:54,100][123090] Updated weights for policy 1, policy_version 1756368 (0.0009) [2023-12-26 13:42:54,151][123090] Updated weights for policy 1, policy_version 1756378 (0.0009) [2023-12-26 13:42:54,536][123091] Updated weights for policy 0, policy_version 1768403 (0.0008) [2023-12-26 13:42:54,589][123091] Updated weights for policy 0, policy_version 1768413 (0.0005) [2023-12-26 13:42:54,646][123091] Updated weights for policy 0, policy_version 1768423 (0.0005) [2023-12-26 13:42:55,027][123090] Updated weights for policy 1, policy_version 1756388 (0.0009) [2023-12-26 13:42:55,083][123090] Updated weights for policy 1, policy_version 1756398 (0.0009) [2023-12-26 13:42:55,143][123090] Updated weights for policy 1, policy_version 1756408 (0.0009) [2023-12-26 13:42:55,386][123091] Updated weights for policy 0, policy_version 1768433 (0.0005) [2023-12-26 13:42:55,433][123091] Updated weights for policy 0, policy_version 1768443 (0.0005) [2023-12-26 13:42:55,483][123091] Updated weights for policy 0, policy_version 1768453 (0.0005) [2023-12-26 13:42:55,530][123091] Updated weights for policy 0, policy_version 1768463 (0.0006) [2023-12-26 13:42:56,040][123090] Updated weights for policy 1, policy_version 1756418 (0.0009) [2023-12-26 13:42:56,096][123090] Updated weights for policy 1, policy_version 1756428 (0.0010) [2023-12-26 13:42:56,144][123090] Updated weights for policy 1, policy_version 1756438 (0.0008) [2023-12-26 13:42:56,268][123091] Updated weights for policy 0, policy_version 1768473 (0.0006) [2023-12-26 13:42:56,332][123091] Updated weights for policy 0, policy_version 1768483 (0.0005) [2023-12-26 13:42:56,392][123091] Updated weights for policy 0, policy_version 1768493 (0.0005) [2023-12-26 13:42:56,927][123090] Updated weights for policy 1, policy_version 1756449 (0.0010) [2023-12-26 13:42:56,978][123090] Updated weights for policy 1, policy_version 1756459 (0.0008) [2023-12-26 13:42:57,038][123090] Updated weights for policy 1, policy_version 1756469 (0.0008) [2023-12-26 13:42:57,087][123090] Updated weights for policy 1, policy_version 1756479 (0.0009) [2023-12-26 13:42:57,151][123091] Updated weights for policy 0, policy_version 1768503 (0.0009) [2023-12-26 13:42:57,196][123091] Updated weights for policy 0, policy_version 1768513 (0.0010) [2023-12-26 13:42:57,243][123091] Updated weights for policy 0, policy_version 1768523 (0.0010) [2023-12-26 13:42:57,995][123091] Updated weights for policy 0, policy_version 1768533 (0.0008) [2023-12-26 13:42:58,003][123090] Updated weights for policy 1, policy_version 1756489 (0.0009) [2023-12-26 13:42:58,047][123091] Updated weights for policy 0, policy_version 1768543 (0.0006) [2023-12-26 13:42:58,058][123090] Updated weights for policy 1, policy_version 1756500 (0.0009) [2023-12-26 13:42:58,119][123091] Updated weights for policy 0, policy_version 1768553 (0.0010) [2023-12-26 13:42:58,126][123090] Updated weights for policy 1, policy_version 1756510 (0.0008) [2023-12-26 13:42:58,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17717.0). Total num frames: 902422528. Throughput: 0: 9111.7, 1: 8719.1. Samples: 902419520. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:42:58,785][121949] Avg episode reward: [(0, '6371.947'), (1, '5629.373')] [2023-12-26 13:42:58,955][123091] Updated weights for policy 0, policy_version 1768563 (0.0010) [2023-12-26 13:42:59,013][123091] Updated weights for policy 0, policy_version 1768573 (0.0009) [2023-12-26 13:42:59,065][123090] Updated weights for policy 1, policy_version 1756520 (0.0007) [2023-12-26 13:42:59,076][123091] Updated weights for policy 0, policy_version 1768583 (0.0009) [2023-12-26 13:42:59,139][123090] Updated weights for policy 1, policy_version 1756530 (0.0009) [2023-12-26 13:42:59,212][123090] Updated weights for policy 1, policy_version 1756540 (0.0010) [2023-12-26 13:42:59,846][123091] Updated weights for policy 0, policy_version 1768593 (0.0006) [2023-12-26 13:42:59,899][123091] Updated weights for policy 0, policy_version 1768603 (0.0009) [2023-12-26 13:42:59,967][123091] Updated weights for policy 0, policy_version 1768613 (0.0009) [2023-12-26 13:42:59,982][123090] Updated weights for policy 1, policy_version 1756550 (0.0008) [2023-12-26 13:43:00,028][123091] Updated weights for policy 0, policy_version 1768623 (0.0009) [2023-12-26 13:43:00,035][123090] Updated weights for policy 1, policy_version 1756560 (0.0006) [2023-12-26 13:43:00,084][123090] Updated weights for policy 1, policy_version 1756570 (0.0009) [2023-12-26 13:43:00,756][123090] Updated weights for policy 1, policy_version 1756580 (0.0007) [2023-12-26 13:43:00,814][123090] Updated weights for policy 1, policy_version 1756590 (0.0006) [2023-12-26 13:43:00,880][123090] Updated weights for policy 1, policy_version 1756600 (0.0010) [2023-12-26 13:43:00,910][123091] Updated weights for policy 0, policy_version 1768633 (0.0005) [2023-12-26 13:43:00,960][123091] Updated weights for policy 0, policy_version 1768643 (0.0005) [2023-12-26 13:43:01,029][123091] Updated weights for policy 0, policy_version 1768653 (0.0006) [2023-12-26 13:43:01,649][123090] Updated weights for policy 1, policy_version 1756610 (0.0010) [2023-12-26 13:43:01,729][123090] Updated weights for policy 1, policy_version 1756620 (0.0010) [2023-12-26 13:43:01,760][123091] Updated weights for policy 0, policy_version 1768663 (0.0008) [2023-12-26 13:43:01,796][123090] Updated weights for policy 1, policy_version 1756630 (0.0007) [2023-12-26 13:43:01,826][123091] Updated weights for policy 0, policy_version 1768673 (0.0008) [2023-12-26 13:43:01,863][123090] Updated weights for policy 1, policy_version 1756640 (0.0008) [2023-12-26 13:43:01,889][123091] Updated weights for policy 0, policy_version 1768683 (0.0008) [2023-12-26 13:43:02,577][123090] Updated weights for policy 1, policy_version 1756650 (0.0005) [2023-12-26 13:43:02,646][123090] Updated weights for policy 1, policy_version 1756660 (0.0009) [2023-12-26 13:43:02,653][123091] Updated weights for policy 0, policy_version 1768693 (0.0008) [2023-12-26 13:43:02,703][123090] Updated weights for policy 1, policy_version 1756670 (0.0009) [2023-12-26 13:43:02,714][123091] Updated weights for policy 0, policy_version 1768703 (0.0008) [2023-12-26 13:43:02,777][123091] Updated weights for policy 0, policy_version 1768713 (0.0006) [2023-12-26 13:43:03,388][123090] Updated weights for policy 1, policy_version 1756680 (0.0005) [2023-12-26 13:43:03,406][123091] Updated weights for policy 0, policy_version 1768723 (0.0005) [2023-12-26 13:43:03,432][123090] Updated weights for policy 1, policy_version 1756690 (0.0005) [2023-12-26 13:43:03,460][123091] Updated weights for policy 0, policy_version 1768733 (0.0006) [2023-12-26 13:43:03,484][123090] Updated weights for policy 1, policy_version 1756700 (0.0005) [2023-12-26 13:43:03,509][123091] Updated weights for policy 0, policy_version 1768743 (0.0009) [2023-12-26 13:43:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 902520832. Throughput: 0: 9103.2, 1: 8706.4. Samples: 902528992. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:03,785][121949] Avg episode reward: [(0, '6269.425'), (1, '5672.081')] [2023-12-26 13:43:04,172][123090] Updated weights for policy 1, policy_version 1756710 (0.0005) [2023-12-26 13:43:04,221][123090] Updated weights for policy 1, policy_version 1756720 (0.0005) [2023-12-26 13:43:04,282][123090] Updated weights for policy 1, policy_version 1756730 (0.0006) [2023-12-26 13:43:04,421][123091] Updated weights for policy 0, policy_version 1768755 (0.0010) [2023-12-26 13:43:04,473][123091] Updated weights for policy 0, policy_version 1768765 (0.0006) [2023-12-26 13:43:04,526][123091] Updated weights for policy 0, policy_version 1768775 (0.0005) [2023-12-26 13:43:04,967][123090] Updated weights for policy 1, policy_version 1756740 (0.0006) [2023-12-26 13:43:05,027][123090] Updated weights for policy 1, policy_version 1756750 (0.0011) [2023-12-26 13:43:05,085][123090] Updated weights for policy 1, policy_version 1756760 (0.0010) [2023-12-26 13:43:05,327][123091] Updated weights for policy 0, policy_version 1768785 (0.0009) [2023-12-26 13:43:05,391][123091] Updated weights for policy 0, policy_version 1768795 (0.0005) [2023-12-26 13:43:05,457][123091] Updated weights for policy 0, policy_version 1768805 (0.0005) [2023-12-26 13:43:05,502][123091] Updated weights for policy 0, policy_version 1768815 (0.0005) [2023-12-26 13:43:05,910][123090] Updated weights for policy 1, policy_version 1756770 (0.0011) [2023-12-26 13:43:05,974][123090] Updated weights for policy 1, policy_version 1756780 (0.0011) [2023-12-26 13:43:06,037][123090] Updated weights for policy 1, policy_version 1756790 (0.0010) [2023-12-26 13:43:06,106][123090] Updated weights for policy 1, policy_version 1756800 (0.0011) [2023-12-26 13:43:06,117][123091] Updated weights for policy 0, policy_version 1768825 (0.0007) [2023-12-26 13:43:06,182][123091] Updated weights for policy 0, policy_version 1768835 (0.0008) [2023-12-26 13:43:06,248][123091] Updated weights for policy 0, policy_version 1768845 (0.0011) [2023-12-26 13:43:06,923][123090] Updated weights for policy 1, policy_version 1756810 (0.0005) [2023-12-26 13:43:06,980][123090] Updated weights for policy 1, policy_version 1756820 (0.0007) [2023-12-26 13:43:07,040][123090] Updated weights for policy 1, policy_version 1756830 (0.0011) [2023-12-26 13:43:07,080][123091] Updated weights for policy 0, policy_version 1768855 (0.0011) [2023-12-26 13:43:07,140][123091] Updated weights for policy 0, policy_version 1768865 (0.0011) [2023-12-26 13:43:07,214][123091] Updated weights for policy 0, policy_version 1768875 (0.0011) [2023-12-26 13:43:07,852][123090] Updated weights for policy 1, policy_version 1756840 (0.0011) [2023-12-26 13:43:07,919][123090] Updated weights for policy 1, policy_version 1756850 (0.0010) [2023-12-26 13:43:07,951][123091] Updated weights for policy 0, policy_version 1768885 (0.0008) [2023-12-26 13:43:07,975][123090] Updated weights for policy 1, policy_version 1756860 (0.0010) [2023-12-26 13:43:08,006][123091] Updated weights for policy 0, policy_version 1768895 (0.0005) [2023-12-26 13:43:08,058][123091] Updated weights for policy 0, policy_version 1768905 (0.0008) [2023-12-26 13:43:08,725][123090] Updated weights for policy 1, policy_version 1756870 (0.0010) [2023-12-26 13:43:08,781][123090] Updated weights for policy 1, policy_version 1756880 (0.0011) [2023-12-26 13:43:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 902602752. Throughput: 0: 9115.8, 1: 8801.1. Samples: 902584384. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:08,785][121949] Avg episode reward: [(0, '6221.509'), (1, '5749.788')] [2023-12-26 13:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001768912_452845568.pth... [2023-12-26 13:43:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001767856_452575232.pth [2023-12-26 13:43:08,844][123090] Updated weights for policy 1, policy_version 1756890 (0.0010) [2023-12-26 13:43:08,870][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001756896_449765376.pth... [2023-12-26 13:43:08,873][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001755840_449495040.pth [2023-12-26 13:43:08,903][123091] Updated weights for policy 0, policy_version 1768915 (0.0009) [2023-12-26 13:43:08,964][123091] Updated weights for policy 0, policy_version 1768925 (0.0009) [2023-12-26 13:43:09,018][123091] Updated weights for policy 0, policy_version 1768935 (0.0010) [2023-12-26 13:43:09,654][123090] Updated weights for policy 1, policy_version 1756900 (0.0010) [2023-12-26 13:43:09,706][123090] Updated weights for policy 1, policy_version 1756910 (0.0010) [2023-12-26 13:43:09,755][123090] Updated weights for policy 1, policy_version 1756920 (0.0010) [2023-12-26 13:43:09,906][123091] Updated weights for policy 0, policy_version 1768945 (0.0009) [2023-12-26 13:43:09,980][123091] Updated weights for policy 0, policy_version 1768955 (0.0009) [2023-12-26 13:43:10,050][123091] Updated weights for policy 0, policy_version 1768965 (0.0010) [2023-12-26 13:43:10,111][123091] Updated weights for policy 0, policy_version 1768975 (0.0008) [2023-12-26 13:43:10,570][123090] Updated weights for policy 1, policy_version 1756930 (0.0010) [2023-12-26 13:43:10,623][123090] Updated weights for policy 1, policy_version 1756940 (0.0009) [2023-12-26 13:43:10,683][123090] Updated weights for policy 1, policy_version 1756950 (0.0009) [2023-12-26 13:43:10,748][123090] Updated weights for policy 1, policy_version 1756960 (0.0009) [2023-12-26 13:43:10,945][123091] Updated weights for policy 0, policy_version 1768985 (0.0008) [2023-12-26 13:43:11,014][123091] Updated weights for policy 0, policy_version 1768995 (0.0010) [2023-12-26 13:43:11,082][123091] Updated weights for policy 0, policy_version 1769005 (0.0010) [2023-12-26 13:43:11,493][123090] Updated weights for policy 1, policy_version 1756970 (0.0008) [2023-12-26 13:43:11,542][123090] Updated weights for policy 1, policy_version 1756980 (0.0008) [2023-12-26 13:43:11,591][123090] Updated weights for policy 1, policy_version 1756990 (0.0008) [2023-12-26 13:43:11,970][123091] Updated weights for policy 0, policy_version 1769015 (0.0010) [2023-12-26 13:43:12,038][123091] Updated weights for policy 0, policy_version 1769025 (0.0011) [2023-12-26 13:43:12,102][123091] Updated weights for policy 0, policy_version 1769035 (0.0010) [2023-12-26 13:43:12,451][123090] Updated weights for policy 1, policy_version 1757000 (0.0010) [2023-12-26 13:43:12,510][123090] Updated weights for policy 1, policy_version 1757010 (0.0010) [2023-12-26 13:43:12,573][123090] Updated weights for policy 1, policy_version 1757020 (0.0010) [2023-12-26 13:43:12,876][123091] Updated weights for policy 0, policy_version 1769045 (0.0010) [2023-12-26 13:43:12,932][123091] Updated weights for policy 0, policy_version 1769055 (0.0010) [2023-12-26 13:43:12,986][123091] Updated weights for policy 0, policy_version 1769066 (0.0010) [2023-12-26 13:43:13,451][123090] Updated weights for policy 1, policy_version 1757030 (0.0009) [2023-12-26 13:43:13,517][123090] Updated weights for policy 1, policy_version 1757040 (0.0006) [2023-12-26 13:43:13,585][123090] Updated weights for policy 1, policy_version 1757050 (0.0005) [2023-12-26 13:43:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 902692864. Throughput: 0: 9061.0, 1: 8778.3. Samples: 902687608. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:13,785][121949] Avg episode reward: [(0, '6267.563'), (1, '5633.990')] [2023-12-26 13:43:13,833][123091] Updated weights for policy 0, policy_version 1769076 (0.0007) [2023-12-26 13:43:13,896][123091] Updated weights for policy 0, policy_version 1769086 (0.0009) [2023-12-26 13:43:13,951][123091] Updated weights for policy 0, policy_version 1769096 (0.0009) [2023-12-26 13:43:14,250][123090] Updated weights for policy 1, policy_version 1757060 (0.0006) [2023-12-26 13:43:14,295][123090] Updated weights for policy 1, policy_version 1757070 (0.0008) [2023-12-26 13:43:14,341][123090] Updated weights for policy 1, policy_version 1757080 (0.0007) [2023-12-26 13:43:14,833][123091] Updated weights for policy 0, policy_version 1769107 (0.0011) [2023-12-26 13:43:14,902][123091] Updated weights for policy 0, policy_version 1769117 (0.0010) [2023-12-26 13:43:14,958][123091] Updated weights for policy 0, policy_version 1769127 (0.0009) [2023-12-26 13:43:15,085][123090] Updated weights for policy 1, policy_version 1757090 (0.0006) [2023-12-26 13:43:15,154][123090] Updated weights for policy 1, policy_version 1757100 (0.0009) [2023-12-26 13:43:15,219][123090] Updated weights for policy 1, policy_version 1757110 (0.0009) [2023-12-26 13:43:15,286][123090] Updated weights for policy 1, policy_version 1757120 (0.0009) [2023-12-26 13:43:15,819][123091] Updated weights for policy 0, policy_version 1769137 (0.0009) [2023-12-26 13:43:15,887][123091] Updated weights for policy 0, policy_version 1769147 (0.0010) [2023-12-26 13:43:15,964][123091] Updated weights for policy 0, policy_version 1769157 (0.0009) [2023-12-26 13:43:16,019][123091] Updated weights for policy 0, policy_version 1769167 (0.0009) [2023-12-26 13:43:16,096][123090] Updated weights for policy 1, policy_version 1757130 (0.0006) [2023-12-26 13:43:16,146][123090] Updated weights for policy 1, policy_version 1757140 (0.0005) [2023-12-26 13:43:16,193][123090] Updated weights for policy 1, policy_version 1757150 (0.0005) [2023-12-26 13:43:16,879][123091] Updated weights for policy 0, policy_version 1769177 (0.0009) [2023-12-26 13:43:16,903][123090] Updated weights for policy 1, policy_version 1757160 (0.0005) [2023-12-26 13:43:16,933][123091] Updated weights for policy 0, policy_version 1769187 (0.0009) [2023-12-26 13:43:16,965][123090] Updated weights for policy 1, policy_version 1757170 (0.0005) [2023-12-26 13:43:16,982][123091] Updated weights for policy 0, policy_version 1769198 (0.0009) [2023-12-26 13:43:17,026][123090] Updated weights for policy 1, policy_version 1757180 (0.0005) [2023-12-26 13:43:17,783][123090] Updated weights for policy 1, policy_version 1757190 (0.0008) [2023-12-26 13:43:17,839][123090] Updated weights for policy 1, policy_version 1757200 (0.0009) [2023-12-26 13:43:17,855][123091] Updated weights for policy 0, policy_version 1769208 (0.0008) [2023-12-26 13:43:17,892][123090] Updated weights for policy 1, policy_version 1757210 (0.0008) [2023-12-26 13:43:17,912][123091] Updated weights for policy 0, policy_version 1769218 (0.0008) [2023-12-26 13:43:17,963][123091] Updated weights for policy 0, policy_version 1769228 (0.0011) [2023-12-26 13:43:18,741][123091] Updated weights for policy 0, policy_version 1769238 (0.0007) [2023-12-26 13:43:18,766][123090] Updated weights for policy 1, policy_version 1757220 (0.0007) [2023-12-26 13:43:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 902774784. Throughput: 0: 8957.2, 1: 8781.6. Samples: 902793096. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:18,785][121949] Avg episode reward: [(0, '6280.908'), (1, '5592.353')] [2023-12-26 13:43:18,800][123091] Updated weights for policy 0, policy_version 1769248 (0.0005) [2023-12-26 13:43:18,824][123090] Updated weights for policy 1, policy_version 1757230 (0.0009) [2023-12-26 13:43:18,868][123091] Updated weights for policy 0, policy_version 1769258 (0.0009) [2023-12-26 13:43:18,891][123090] Updated weights for policy 1, policy_version 1757240 (0.0009) [2023-12-26 13:43:19,670][123091] Updated weights for policy 0, policy_version 1769268 (0.0011) [2023-12-26 13:43:19,738][123090] Updated weights for policy 1, policy_version 1757250 (0.0010) [2023-12-26 13:43:19,738][123091] Updated weights for policy 0, policy_version 1769278 (0.0011) [2023-12-26 13:43:19,798][123091] Updated weights for policy 0, policy_version 1769288 (0.0011) [2023-12-26 13:43:19,806][123090] Updated weights for policy 1, policy_version 1757260 (0.0011) [2023-12-26 13:43:19,871][123090] Updated weights for policy 1, policy_version 1757270 (0.0010) [2023-12-26 13:43:19,943][123090] Updated weights for policy 1, policy_version 1757280 (0.0010) [2023-12-26 13:43:20,582][123091] Updated weights for policy 0, policy_version 1769298 (0.0009) [2023-12-26 13:43:20,646][123091] Updated weights for policy 0, policy_version 1769308 (0.0009) [2023-12-26 13:43:20,689][123090] Updated weights for policy 1, policy_version 1757290 (0.0009) [2023-12-26 13:43:20,712][123091] Updated weights for policy 0, policy_version 1769318 (0.0005) [2023-12-26 13:43:20,752][123090] Updated weights for policy 1, policy_version 1757300 (0.0009) [2023-12-26 13:43:20,777][123091] Updated weights for policy 0, policy_version 1769328 (0.0006) [2023-12-26 13:43:20,816][123090] Updated weights for policy 1, policy_version 1757310 (0.0008) [2023-12-26 13:43:21,566][123091] Updated weights for policy 0, policy_version 1769338 (0.0009) [2023-12-26 13:43:21,633][123090] Updated weights for policy 1, policy_version 1757320 (0.0009) [2023-12-26 13:43:21,645][123091] Updated weights for policy 0, policy_version 1769348 (0.0009) [2023-12-26 13:43:21,709][123090] Updated weights for policy 1, policy_version 1757330 (0.0009) [2023-12-26 13:43:21,712][123091] Updated weights for policy 0, policy_version 1769358 (0.0007) [2023-12-26 13:43:21,803][123090] Updated weights for policy 1, policy_version 1757340 (0.0009) [2023-12-26 13:43:22,557][123091] Updated weights for policy 0, policy_version 1769368 (0.0010) [2023-12-26 13:43:22,585][123090] Updated weights for policy 1, policy_version 1757350 (0.0007) [2023-12-26 13:43:22,624][123091] Updated weights for policy 0, policy_version 1769378 (0.0007) [2023-12-26 13:43:22,640][123090] Updated weights for policy 1, policy_version 1757360 (0.0010) [2023-12-26 13:43:22,681][123091] Updated weights for policy 0, policy_version 1769388 (0.0009) [2023-12-26 13:43:22,703][123090] Updated weights for policy 1, policy_version 1757370 (0.0007) [2023-12-26 13:43:23,501][123091] Updated weights for policy 0, policy_version 1769398 (0.0008) [2023-12-26 13:43:23,527][123090] Updated weights for policy 1, policy_version 1757380 (0.0008) [2023-12-26 13:43:23,553][123091] Updated weights for policy 0, policy_version 1769408 (0.0011) [2023-12-26 13:43:23,588][123090] Updated weights for policy 1, policy_version 1757390 (0.0005) [2023-12-26 13:43:23,613][123091] Updated weights for policy 0, policy_version 1769418 (0.0011) [2023-12-26 13:43:23,658][123090] Updated weights for policy 1, policy_version 1757400 (0.0005) [2023-12-26 13:43:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 902873088. Throughput: 0: 8937.9, 1: 8790.1. Samples: 902845136. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:23,785][121949] Avg episode reward: [(0, '6217.309'), (1, '5699.619')] [2023-12-26 13:43:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001769424_452976640.pth... [2023-12-26 13:43:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001757408_449896448.pth... [2023-12-26 13:43:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001768400_452714496.pth [2023-12-26 13:43:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001756352_449626112.pth [2023-12-26 13:43:24,369][123090] Updated weights for policy 1, policy_version 1757410 (0.0005) [2023-12-26 13:43:24,404][123091] Updated weights for policy 0, policy_version 1769428 (0.0011) [2023-12-26 13:43:24,434][123090] Updated weights for policy 1, policy_version 1757420 (0.0005) [2023-12-26 13:43:24,456][123091] Updated weights for policy 0, policy_version 1769438 (0.0010) [2023-12-26 13:43:24,499][123090] Updated weights for policy 1, policy_version 1757430 (0.0005) [2023-12-26 13:43:24,508][123091] Updated weights for policy 0, policy_version 1769448 (0.0010) [2023-12-26 13:43:24,554][123090] Updated weights for policy 1, policy_version 1757440 (0.0005) [2023-12-26 13:43:25,263][123090] Updated weights for policy 1, policy_version 1757450 (0.0011) [2023-12-26 13:43:25,325][123090] Updated weights for policy 1, policy_version 1757460 (0.0010) [2023-12-26 13:43:25,346][123091] Updated weights for policy 0, policy_version 1769458 (0.0009) [2023-12-26 13:43:25,377][123090] Updated weights for policy 1, policy_version 1757470 (0.0010) [2023-12-26 13:43:25,401][123091] Updated weights for policy 0, policy_version 1769468 (0.0007) [2023-12-26 13:43:25,446][123091] Updated weights for policy 0, policy_version 1769478 (0.0005) [2023-12-26 13:43:25,495][123091] Updated weights for policy 0, policy_version 1769488 (0.0006) [2023-12-26 13:43:26,065][123090] Updated weights for policy 1, policy_version 1757480 (0.0006) [2023-12-26 13:43:26,129][123090] Updated weights for policy 1, policy_version 1757490 (0.0008) [2023-12-26 13:43:26,152][123091] Updated weights for policy 0, policy_version 1769498 (0.0007) [2023-12-26 13:43:26,192][123090] Updated weights for policy 1, policy_version 1757500 (0.0006) [2023-12-26 13:43:26,212][123091] Updated weights for policy 0, policy_version 1769508 (0.0008) [2023-12-26 13:43:26,267][123091] Updated weights for policy 0, policy_version 1769518 (0.0005) [2023-12-26 13:43:26,894][123090] Updated weights for policy 1, policy_version 1757510 (0.0007) [2023-12-26 13:43:26,918][123091] Updated weights for policy 0, policy_version 1769528 (0.0010) [2023-12-26 13:43:26,951][123090] Updated weights for policy 1, policy_version 1757520 (0.0009) [2023-12-26 13:43:26,973][123091] Updated weights for policy 0, policy_version 1769538 (0.0010) [2023-12-26 13:43:27,006][123090] Updated weights for policy 1, policy_version 1757530 (0.0010) [2023-12-26 13:43:27,020][123091] Updated weights for policy 0, policy_version 1769548 (0.0010) [2023-12-26 13:43:27,701][123090] Updated weights for policy 1, policy_version 1757540 (0.0008) [2023-12-26 13:43:27,770][123090] Updated weights for policy 1, policy_version 1757550 (0.0005) [2023-12-26 13:43:27,836][123090] Updated weights for policy 1, policy_version 1757560 (0.0005) [2023-12-26 13:43:27,863][123091] Updated weights for policy 0, policy_version 1769558 (0.0010) [2023-12-26 13:43:27,931][123091] Updated weights for policy 0, policy_version 1769568 (0.0011) [2023-12-26 13:43:27,999][123091] Updated weights for policy 0, policy_version 1769578 (0.0011) [2023-12-26 13:43:28,532][123090] Updated weights for policy 1, policy_version 1757570 (0.0005) [2023-12-26 13:43:28,605][123090] Updated weights for policy 1, policy_version 1757580 (0.0005) [2023-12-26 13:43:28,672][123090] Updated weights for policy 1, policy_version 1757590 (0.0006) [2023-12-26 13:43:28,730][123090] Updated weights for policy 1, policy_version 1757600 (0.0005) [2023-12-26 13:43:28,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 902963200. Throughput: 0: 8928.2, 1: 8918.6. Samples: 902956044. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:28,785][121949] Avg episode reward: [(0, '6221.663'), (1, '5602.067')] [2023-12-26 13:43:28,804][123091] Updated weights for policy 0, policy_version 1769588 (0.0010) [2023-12-26 13:43:28,874][123091] Updated weights for policy 0, policy_version 1769598 (0.0010) [2023-12-26 13:43:28,945][123091] Updated weights for policy 0, policy_version 1769608 (0.0010) [2023-12-26 13:43:29,416][123090] Updated weights for policy 1, policy_version 1757610 (0.0008) [2023-12-26 13:43:29,482][123090] Updated weights for policy 1, policy_version 1757620 (0.0010) [2023-12-26 13:43:29,550][123090] Updated weights for policy 1, policy_version 1757630 (0.0008) [2023-12-26 13:43:29,783][123091] Updated weights for policy 0, policy_version 1769618 (0.0009) [2023-12-26 13:43:29,853][123091] Updated weights for policy 0, policy_version 1769628 (0.0007) [2023-12-26 13:43:29,926][123091] Updated weights for policy 0, policy_version 1769638 (0.0006) [2023-12-26 13:43:29,990][123091] Updated weights for policy 0, policy_version 1769648 (0.0006) [2023-12-26 13:43:30,321][123090] Updated weights for policy 1, policy_version 1757640 (0.0006) [2023-12-26 13:43:30,396][123090] Updated weights for policy 1, policy_version 1757650 (0.0009) [2023-12-26 13:43:30,466][123090] Updated weights for policy 1, policy_version 1757660 (0.0010) [2023-12-26 13:43:30,603][123091] Updated weights for policy 0, policy_version 1769658 (0.0006) [2023-12-26 13:43:30,662][123091] Updated weights for policy 0, policy_version 1769668 (0.0008) [2023-12-26 13:43:30,720][123091] Updated weights for policy 0, policy_version 1769678 (0.0008) [2023-12-26 13:43:31,177][123090] Updated weights for policy 1, policy_version 1757670 (0.0013) [2023-12-26 13:43:31,240][123090] Updated weights for policy 1, policy_version 1757680 (0.0011) [2023-12-26 13:43:31,312][123090] Updated weights for policy 1, policy_version 1757690 (0.0011) [2023-12-26 13:43:31,525][123091] Updated weights for policy 0, policy_version 1769688 (0.0009) [2023-12-26 13:43:31,594][123091] Updated weights for policy 0, policy_version 1769698 (0.0010) [2023-12-26 13:43:31,658][123091] Updated weights for policy 0, policy_version 1769708 (0.0007) [2023-12-26 13:43:32,019][123090] Updated weights for policy 1, policy_version 1757700 (0.0009) [2023-12-26 13:43:32,076][123090] Updated weights for policy 1, policy_version 1757710 (0.0009) [2023-12-26 13:43:32,141][123090] Updated weights for policy 1, policy_version 1757720 (0.0010) [2023-12-26 13:43:32,490][123091] Updated weights for policy 0, policy_version 1769718 (0.0010) [2023-12-26 13:43:32,560][123091] Updated weights for policy 0, policy_version 1769728 (0.0010) [2023-12-26 13:43:32,613][123091] Updated weights for policy 0, policy_version 1769738 (0.0009) [2023-12-26 13:43:32,986][123090] Updated weights for policy 1, policy_version 1757730 (0.0010) [2023-12-26 13:43:33,038][123090] Updated weights for policy 1, policy_version 1757740 (0.0010) [2023-12-26 13:43:33,095][123090] Updated weights for policy 1, policy_version 1757750 (0.0009) [2023-12-26 13:43:33,158][123090] Updated weights for policy 1, policy_version 1757760 (0.0009) [2023-12-26 13:43:33,453][123091] Updated weights for policy 0, policy_version 1769748 (0.0009) [2023-12-26 13:43:33,505][123091] Updated weights for policy 0, policy_version 1769758 (0.0009) [2023-12-26 13:43:33,560][123091] Updated weights for policy 0, policy_version 1769768 (0.0009) [2023-12-26 13:43:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 903053312. Throughput: 0: 8831.1, 1: 8955.1. Samples: 903063080. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:33,785][121949] Avg episode reward: [(0, '6351.641'), (1, '5421.872')] [2023-12-26 13:43:33,978][123090] Updated weights for policy 1, policy_version 1757770 (0.0009) [2023-12-26 13:43:34,040][123090] Updated weights for policy 1, policy_version 1757780 (0.0010) [2023-12-26 13:43:34,089][123090] Updated weights for policy 1, policy_version 1757790 (0.0010) [2023-12-26 13:43:34,409][123091] Updated weights for policy 0, policy_version 1769778 (0.0008) [2023-12-26 13:43:34,471][123091] Updated weights for policy 0, policy_version 1769788 (0.0009) [2023-12-26 13:43:34,542][123091] Updated weights for policy 0, policy_version 1769798 (0.0009) [2023-12-26 13:43:34,611][123091] Updated weights for policy 0, policy_version 1769808 (0.0009) [2023-12-26 13:43:34,923][123090] Updated weights for policy 1, policy_version 1757800 (0.0006) [2023-12-26 13:43:34,980][123090] Updated weights for policy 1, policy_version 1757810 (0.0005) [2023-12-26 13:43:35,035][123090] Updated weights for policy 1, policy_version 1757820 (0.0005) [2023-12-26 13:43:35,487][123091] Updated weights for policy 0, policy_version 1769818 (0.0009) [2023-12-26 13:43:35,539][123091] Updated weights for policy 0, policy_version 1769828 (0.0009) [2023-12-26 13:43:35,586][123091] Updated weights for policy 0, policy_version 1769839 (0.0009) [2023-12-26 13:43:35,764][123090] Updated weights for policy 1, policy_version 1757830 (0.0008) [2023-12-26 13:43:35,819][123090] Updated weights for policy 1, policy_version 1757841 (0.0009) [2023-12-26 13:43:35,869][123090] Updated weights for policy 1, policy_version 1757851 (0.0009) [2023-12-26 13:43:36,430][123091] Updated weights for policy 0, policy_version 1769849 (0.0010) [2023-12-26 13:43:36,494][123091] Updated weights for policy 0, policy_version 1769859 (0.0009) [2023-12-26 13:43:36,564][123091] Updated weights for policy 0, policy_version 1769869 (0.0009) [2023-12-26 13:43:36,734][123090] Updated weights for policy 1, policy_version 1757862 (0.0009) [2023-12-26 13:43:36,794][123090] Updated weights for policy 1, policy_version 1757872 (0.0009) [2023-12-26 13:43:36,864][123090] Updated weights for policy 1, policy_version 1757882 (0.0009) [2023-12-26 13:43:37,392][123091] Updated weights for policy 0, policy_version 1769879 (0.0009) [2023-12-26 13:43:37,462][123091] Updated weights for policy 0, policy_version 1769889 (0.0010) [2023-12-26 13:43:37,518][123091] Updated weights for policy 0, policy_version 1769899 (0.0010) [2023-12-26 13:43:37,696][123090] Updated weights for policy 1, policy_version 1757892 (0.0009) [2023-12-26 13:43:37,756][123090] Updated weights for policy 1, policy_version 1757902 (0.0010) [2023-12-26 13:43:37,815][123090] Updated weights for policy 1, policy_version 1757912 (0.0010) [2023-12-26 13:43:38,215][123091] Updated weights for policy 0, policy_version 1769909 (0.0009) [2023-12-26 13:43:38,279][123091] Updated weights for policy 0, policy_version 1769919 (0.0009) [2023-12-26 13:43:38,329][123091] Updated weights for policy 0, policy_version 1769929 (0.0010) [2023-12-26 13:43:38,670][123090] Updated weights for policy 1, policy_version 1757923 (0.0010) [2023-12-26 13:43:38,740][123090] Updated weights for policy 1, policy_version 1757933 (0.0011) [2023-12-26 13:43:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 903135232. Throughput: 0: 8808.5, 1: 8988.5. Samples: 903115320. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:38,785][121949] Avg episode reward: [(0, '6293.806'), (1, '5442.568')] [2023-12-26 13:43:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001769936_453107712.pth... [2023-12-26 13:43:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001768912_452845568.pth [2023-12-26 13:43:38,808][123090] Updated weights for policy 1, policy_version 1757943 (0.0011) [2023-12-26 13:43:38,867][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001757952_450035712.pth... [2023-12-26 13:43:38,872][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001756896_449765376.pth [2023-12-26 13:43:39,145][123091] Updated weights for policy 0, policy_version 1769939 (0.0008) [2023-12-26 13:43:39,198][123091] Updated weights for policy 0, policy_version 1769949 (0.0006) [2023-12-26 13:43:39,260][123091] Updated weights for policy 0, policy_version 1769959 (0.0007) [2023-12-26 13:43:39,637][123090] Updated weights for policy 1, policy_version 1757953 (0.0011) [2023-12-26 13:43:39,711][123090] Updated weights for policy 1, policy_version 1757963 (0.0010) [2023-12-26 13:43:39,776][123090] Updated weights for policy 1, policy_version 1757973 (0.0011) [2023-12-26 13:43:39,836][123090] Updated weights for policy 1, policy_version 1757983 (0.0011) [2023-12-26 13:43:40,044][123091] Updated weights for policy 0, policy_version 1769969 (0.0007) [2023-12-26 13:43:40,108][123091] Updated weights for policy 0, policy_version 1769979 (0.0008) [2023-12-26 13:43:40,174][123091] Updated weights for policy 0, policy_version 1769989 (0.0008) [2023-12-26 13:43:40,239][123091] Updated weights for policy 0, policy_version 1769999 (0.0009) [2023-12-26 13:43:40,575][123090] Updated weights for policy 1, policy_version 1757993 (0.0006) [2023-12-26 13:43:40,644][123090] Updated weights for policy 1, policy_version 1758003 (0.0005) [2023-12-26 13:43:40,714][123090] Updated weights for policy 1, policy_version 1758013 (0.0006) [2023-12-26 13:43:41,058][123091] Updated weights for policy 0, policy_version 1770009 (0.0008) [2023-12-26 13:43:41,126][123091] Updated weights for policy 0, policy_version 1770019 (0.0007) [2023-12-26 13:43:41,200][123091] Updated weights for policy 0, policy_version 1770029 (0.0010) [2023-12-26 13:43:41,369][123090] Updated weights for policy 1, policy_version 1758023 (0.0006) [2023-12-26 13:43:41,441][123090] Updated weights for policy 1, policy_version 1758033 (0.0009) [2023-12-26 13:43:41,507][123090] Updated weights for policy 1, policy_version 1758043 (0.0008) [2023-12-26 13:43:42,008][123091] Updated weights for policy 0, policy_version 1770039 (0.0007) [2023-12-26 13:43:42,069][123091] Updated weights for policy 0, policy_version 1770049 (0.0007) [2023-12-26 13:43:42,152][123091] Updated weights for policy 0, policy_version 1770059 (0.0006) [2023-12-26 13:43:42,362][123090] Updated weights for policy 1, policy_version 1758053 (0.0008) [2023-12-26 13:43:42,422][123090] Updated weights for policy 1, policy_version 1758063 (0.0010) [2023-12-26 13:43:42,483][123090] Updated weights for policy 1, policy_version 1758073 (0.0011) [2023-12-26 13:43:42,906][123091] Updated weights for policy 0, policy_version 1770069 (0.0008) [2023-12-26 13:43:42,954][123091] Updated weights for policy 0, policy_version 1770079 (0.0008) [2023-12-26 13:43:43,013][123091] Updated weights for policy 0, policy_version 1770089 (0.0009) [2023-12-26 13:43:43,316][123090] Updated weights for policy 1, policy_version 1758083 (0.0010) [2023-12-26 13:43:43,375][123090] Updated weights for policy 1, policy_version 1758093 (0.0010) [2023-12-26 13:43:43,434][123090] Updated weights for policy 1, policy_version 1758103 (0.0010) [2023-12-26 13:43:43,761][123091] Updated weights for policy 0, policy_version 1770099 (0.0006) [2023-12-26 13:43:43,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 903225344. Throughput: 0: 8776.6, 1: 9023.0. Samples: 903220504. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:43,784][121949] Avg episode reward: [(0, '6308.815'), (1, '5675.464')] [2023-12-26 13:43:43,812][123091] Updated weights for policy 0, policy_version 1770109 (0.0009) [2023-12-26 13:43:43,874][123091] Updated weights for policy 0, policy_version 1770119 (0.0009) [2023-12-26 13:43:44,249][123090] Updated weights for policy 1, policy_version 1758113 (0.0010) [2023-12-26 13:43:44,317][123090] Updated weights for policy 1, policy_version 1758123 (0.0006) [2023-12-26 13:43:44,384][123090] Updated weights for policy 1, policy_version 1758133 (0.0008) [2023-12-26 13:43:44,455][123090] Updated weights for policy 1, policy_version 1758143 (0.0009) [2023-12-26 13:43:44,734][123091] Updated weights for policy 0, policy_version 1770129 (0.0009) [2023-12-26 13:43:44,792][123091] Updated weights for policy 0, policy_version 1770139 (0.0009) [2023-12-26 13:43:44,854][123091] Updated weights for policy 0, policy_version 1770149 (0.0009) [2023-12-26 13:43:44,906][123091] Updated weights for policy 0, policy_version 1770159 (0.0009) [2023-12-26 13:43:45,240][123090] Updated weights for policy 1, policy_version 1758153 (0.0007) [2023-12-26 13:43:45,314][123090] Updated weights for policy 1, policy_version 1758163 (0.0006) [2023-12-26 13:43:45,380][123090] Updated weights for policy 1, policy_version 1758173 (0.0010) [2023-12-26 13:43:45,727][123091] Updated weights for policy 0, policy_version 1770169 (0.0010) [2023-12-26 13:43:45,776][123091] Updated weights for policy 0, policy_version 1770179 (0.0009) [2023-12-26 13:43:45,833][123091] Updated weights for policy 0, policy_version 1770189 (0.0010) [2023-12-26 13:43:46,154][123090] Updated weights for policy 1, policy_version 1758183 (0.0006) [2023-12-26 13:43:46,226][123090] Updated weights for policy 1, policy_version 1758193 (0.0005) [2023-12-26 13:43:46,291][123090] Updated weights for policy 1, policy_version 1758203 (0.0005) [2023-12-26 13:43:46,754][123091] Updated weights for policy 0, policy_version 1770199 (0.0010) [2023-12-26 13:43:46,818][123091] Updated weights for policy 0, policy_version 1770209 (0.0009) [2023-12-26 13:43:46,883][123091] Updated weights for policy 0, policy_version 1770219 (0.0009) [2023-12-26 13:43:46,944][123090] Updated weights for policy 1, policy_version 1758213 (0.0005) [2023-12-26 13:43:47,005][123090] Updated weights for policy 1, policy_version 1758223 (0.0005) [2023-12-26 13:43:47,061][123090] Updated weights for policy 1, policy_version 1758233 (0.0005) [2023-12-26 13:43:47,733][123091] Updated weights for policy 0, policy_version 1770229 (0.0010) [2023-12-26 13:43:47,795][123091] Updated weights for policy 0, policy_version 1770239 (0.0009) [2023-12-26 13:43:47,828][123090] Updated weights for policy 1, policy_version 1758243 (0.0007) [2023-12-26 13:43:47,848][123091] Updated weights for policy 0, policy_version 1770249 (0.0009) [2023-12-26 13:43:47,889][123090] Updated weights for policy 1, policy_version 1758253 (0.0009) [2023-12-26 13:43:47,944][123090] Updated weights for policy 1, policy_version 1758263 (0.0007) [2023-12-26 13:43:48,697][123091] Updated weights for policy 0, policy_version 1770259 (0.0008) [2023-12-26 13:43:48,758][123091] Updated weights for policy 0, policy_version 1770269 (0.0009) [2023-12-26 13:43:48,759][123090] Updated weights for policy 1, policy_version 1758273 (0.0006) [2023-12-26 13:43:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 903307264. Throughput: 0: 8679.8, 1: 9017.6. Samples: 903325372. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:48,785][121949] Avg episode reward: [(0, '6252.641'), (1, '5637.369')] [2023-12-26 13:43:48,811][123090] Updated weights for policy 1, policy_version 1758283 (0.0005) [2023-12-26 13:43:48,824][123091] Updated weights for policy 0, policy_version 1770279 (0.0009) [2023-12-26 13:43:48,859][123090] Updated weights for policy 1, policy_version 1758293 (0.0005) [2023-12-26 13:43:48,911][123090] Updated weights for policy 1, policy_version 1758303 (0.0005) [2023-12-26 13:43:49,690][123091] Updated weights for policy 0, policy_version 1770289 (0.0008) [2023-12-26 13:43:49,726][123090] Updated weights for policy 1, policy_version 1758313 (0.0009) [2023-12-26 13:43:49,746][123091] Updated weights for policy 0, policy_version 1770299 (0.0006) [2023-12-26 13:43:49,778][123090] Updated weights for policy 1, policy_version 1758323 (0.0010) [2023-12-26 13:43:49,807][123091] Updated weights for policy 0, policy_version 1770309 (0.0006) [2023-12-26 13:43:49,836][123090] Updated weights for policy 1, policy_version 1758333 (0.0010) [2023-12-26 13:43:49,874][123091] Updated weights for policy 0, policy_version 1770319 (0.0008) [2023-12-26 13:43:50,689][123090] Updated weights for policy 1, policy_version 1758343 (0.0011) [2023-12-26 13:43:50,718][123091] Updated weights for policy 0, policy_version 1770329 (0.0008) [2023-12-26 13:43:50,757][123090] Updated weights for policy 1, policy_version 1758353 (0.0011) [2023-12-26 13:43:50,772][123091] Updated weights for policy 0, policy_version 1770339 (0.0010) [2023-12-26 13:43:50,820][123090] Updated weights for policy 1, policy_version 1758363 (0.0010) [2023-12-26 13:43:50,822][123091] Updated weights for policy 0, policy_version 1770349 (0.0007) [2023-12-26 13:43:51,675][123090] Updated weights for policy 1, policy_version 1758373 (0.0009) [2023-12-26 13:43:51,692][123091] Updated weights for policy 0, policy_version 1770359 (0.0008) [2023-12-26 13:43:51,744][123090] Updated weights for policy 1, policy_version 1758383 (0.0012) [2023-12-26 13:43:51,760][123091] Updated weights for policy 0, policy_version 1770369 (0.0008) [2023-12-26 13:43:51,811][123090] Updated weights for policy 1, policy_version 1758393 (0.0010) [2023-12-26 13:43:51,858][123091] Updated weights for policy 0, policy_version 1770379 (0.0007) [2023-12-26 13:43:52,607][123090] Updated weights for policy 1, policy_version 1758403 (0.0009) [2023-12-26 13:43:52,625][123091] Updated weights for policy 0, policy_version 1770389 (0.0010) [2023-12-26 13:43:52,670][123090] Updated weights for policy 1, policy_version 1758413 (0.0009) [2023-12-26 13:43:52,688][123091] Updated weights for policy 0, policy_version 1770399 (0.0009) [2023-12-26 13:43:52,737][123090] Updated weights for policy 1, policy_version 1758423 (0.0009) [2023-12-26 13:43:52,751][123091] Updated weights for policy 0, policy_version 1770409 (0.0011) [2023-12-26 13:43:53,467][123090] Updated weights for policy 1, policy_version 1758433 (0.0006) [2023-12-26 13:43:53,482][123091] Updated weights for policy 0, policy_version 1770419 (0.0009) [2023-12-26 13:43:53,517][123090] Updated weights for policy 1, policy_version 1758443 (0.0005) [2023-12-26 13:43:53,546][123091] Updated weights for policy 0, policy_version 1770429 (0.0005) [2023-12-26 13:43:53,565][123090] Updated weights for policy 1, policy_version 1758453 (0.0005) [2023-12-26 13:43:53,594][123091] Updated weights for policy 0, policy_version 1770439 (0.0005) [2023-12-26 13:43:53,615][123090] Updated weights for policy 1, policy_version 1758463 (0.0006) [2023-12-26 13:43:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 903405568. Throughput: 0: 8626.3, 1: 8965.3. Samples: 903376008. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:53,785][121949] Avg episode reward: [(0, '6314.945'), (1, '5456.087')] [2023-12-26 13:43:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001758464_450166784.pth... [2023-12-26 13:43:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001770448_453238784.pth... [2023-12-26 13:43:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001757408_449896448.pth [2023-12-26 13:43:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001769424_452976640.pth [2023-12-26 13:43:54,369][123091] Updated weights for policy 0, policy_version 1770449 (0.0007) [2023-12-26 13:43:54,432][123091] Updated weights for policy 0, policy_version 1770459 (0.0009) [2023-12-26 13:43:54,443][123090] Updated weights for policy 1, policy_version 1758473 (0.0008) [2023-12-26 13:43:54,493][123090] Updated weights for policy 1, policy_version 1758483 (0.0008) [2023-12-26 13:43:54,493][123091] Updated weights for policy 0, policy_version 1770469 (0.0009) [2023-12-26 13:43:54,545][123091] Updated weights for policy 0, policy_version 1770479 (0.0009) [2023-12-26 13:43:54,552][123090] Updated weights for policy 1, policy_version 1758493 (0.0009) [2023-12-26 13:43:55,324][123090] Updated weights for policy 1, policy_version 1758503 (0.0009) [2023-12-26 13:43:55,375][123091] Updated weights for policy 0, policy_version 1770489 (0.0009) [2023-12-26 13:43:55,385][123090] Updated weights for policy 1, policy_version 1758513 (0.0009) [2023-12-26 13:43:55,445][123091] Updated weights for policy 0, policy_version 1770499 (0.0007) [2023-12-26 13:43:55,453][123090] Updated weights for policy 1, policy_version 1758523 (0.0009) [2023-12-26 13:43:55,508][123091] Updated weights for policy 0, policy_version 1770509 (0.0009) [2023-12-26 13:43:56,202][123090] Updated weights for policy 1, policy_version 1758533 (0.0008) [2023-12-26 13:43:56,258][123090] Updated weights for policy 1, policy_version 1758543 (0.0005) [2023-12-26 13:43:56,312][123090] Updated weights for policy 1, policy_version 1758553 (0.0005) [2023-12-26 13:43:56,365][123091] Updated weights for policy 0, policy_version 1770519 (0.0009) [2023-12-26 13:43:56,427][123091] Updated weights for policy 0, policy_version 1770529 (0.0010) [2023-12-26 13:43:56,488][123091] Updated weights for policy 0, policy_version 1770539 (0.0009) [2023-12-26 13:43:56,885][123090] Updated weights for policy 1, policy_version 1758563 (0.0005) [2023-12-26 13:43:56,936][123090] Updated weights for policy 1, policy_version 1758573 (0.0005) [2023-12-26 13:43:56,994][123090] Updated weights for policy 1, policy_version 1758583 (0.0005) [2023-12-26 13:43:57,393][123091] Updated weights for policy 0, policy_version 1770549 (0.0009) [2023-12-26 13:43:57,457][123091] Updated weights for policy 0, policy_version 1770559 (0.0010) [2023-12-26 13:43:57,526][123091] Updated weights for policy 0, policy_version 1770569 (0.0010) [2023-12-26 13:43:57,672][123090] Updated weights for policy 1, policy_version 1758593 (0.0005) [2023-12-26 13:43:57,731][123090] Updated weights for policy 1, policy_version 1758603 (0.0006) [2023-12-26 13:43:57,779][123090] Updated weights for policy 1, policy_version 1758613 (0.0008) [2023-12-26 13:43:57,832][123090] Updated weights for policy 1, policy_version 1758624 (0.0010) [2023-12-26 13:43:58,355][123091] Updated weights for policy 0, policy_version 1770579 (0.0009) [2023-12-26 13:43:58,426][123091] Updated weights for policy 0, policy_version 1770589 (0.0007) [2023-12-26 13:43:58,500][123091] Updated weights for policy 0, policy_version 1770600 (0.0010) [2023-12-26 13:43:58,647][123090] Updated weights for policy 1, policy_version 1758634 (0.0008) [2023-12-26 13:43:58,732][123090] Updated weights for policy 1, policy_version 1758644 (0.0017) [2023-12-26 13:43:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 903487488. Throughput: 0: 8645.1, 1: 9059.7. Samples: 903484320. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:43:58,785][121949] Avg episode reward: [(0, '6220.464'), (1, '5517.288')] [2023-12-26 13:43:58,804][123090] Updated weights for policy 1, policy_version 1758654 (0.0009) [2023-12-26 13:43:59,459][123091] Updated weights for policy 0, policy_version 1770610 (0.0009) [2023-12-26 13:43:59,514][123091] Updated weights for policy 0, policy_version 1770620 (0.0011) [2023-12-26 13:43:59,571][123091] Updated weights for policy 0, policy_version 1770630 (0.0009) [2023-12-26 13:43:59,622][123091] Updated weights for policy 0, policy_version 1770640 (0.0010) [2023-12-26 13:43:59,665][123090] Updated weights for policy 1, policy_version 1758664 (0.0010) [2023-12-26 13:43:59,717][123090] Updated weights for policy 1, policy_version 1758674 (0.0010) [2023-12-26 13:43:59,780][123090] Updated weights for policy 1, policy_version 1758684 (0.0010) [2023-12-26 13:44:00,422][123091] Updated weights for policy 0, policy_version 1770650 (0.0007) [2023-12-26 13:44:00,486][123091] Updated weights for policy 0, policy_version 1770660 (0.0007) [2023-12-26 13:44:00,559][123091] Updated weights for policy 0, policy_version 1770670 (0.0006) [2023-12-26 13:44:00,625][123090] Updated weights for policy 1, policy_version 1758694 (0.0010) [2023-12-26 13:44:00,681][123090] Updated weights for policy 1, policy_version 1758704 (0.0010) [2023-12-26 13:44:00,740][123090] Updated weights for policy 1, policy_version 1758714 (0.0010) [2023-12-26 13:44:01,235][123091] Updated weights for policy 0, policy_version 1770680 (0.0006) [2023-12-26 13:44:01,303][123091] Updated weights for policy 0, policy_version 1770690 (0.0009) [2023-12-26 13:44:01,367][123091] Updated weights for policy 0, policy_version 1770700 (0.0009) [2023-12-26 13:44:01,595][123090] Updated weights for policy 1, policy_version 1758724 (0.0009) [2023-12-26 13:44:01,662][123090] Updated weights for policy 1, policy_version 1758734 (0.0009) [2023-12-26 13:44:01,716][123090] Updated weights for policy 1, policy_version 1758744 (0.0009) [2023-12-26 13:44:02,112][123091] Updated weights for policy 0, policy_version 1770710 (0.0007) [2023-12-26 13:44:02,157][123091] Updated weights for policy 0, policy_version 1770720 (0.0005) [2023-12-26 13:44:02,210][123091] Updated weights for policy 0, policy_version 1770730 (0.0005) [2023-12-26 13:44:02,623][123090] Updated weights for policy 1, policy_version 1758754 (0.0009) [2023-12-26 13:44:02,688][123090] Updated weights for policy 1, policy_version 1758764 (0.0009) [2023-12-26 13:44:02,736][123090] Updated weights for policy 1, policy_version 1758774 (0.0010) [2023-12-26 13:44:02,789][123090] Updated weights for policy 1, policy_version 1758784 (0.0010) [2023-12-26 13:44:02,974][123091] Updated weights for policy 0, policy_version 1770740 (0.0008) [2023-12-26 13:44:03,040][123091] Updated weights for policy 0, policy_version 1770750 (0.0010) [2023-12-26 13:44:03,108][123091] Updated weights for policy 0, policy_version 1770760 (0.0007) [2023-12-26 13:44:03,582][123090] Updated weights for policy 1, policy_version 1758794 (0.0005) [2023-12-26 13:44:03,643][123090] Updated weights for policy 1, policy_version 1758804 (0.0006) [2023-12-26 13:44:03,700][123090] Updated weights for policy 1, policy_version 1758814 (0.0006) [2023-12-26 13:44:03,781][123091] Updated weights for policy 0, policy_version 1770770 (0.0006) [2023-12-26 13:44:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 903577600. Throughput: 0: 8722.4, 1: 8973.4. Samples: 903589408. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:44:03,785][121949] Avg episode reward: [(0, '6310.812'), (1, '5505.719')] [2023-12-26 13:44:03,848][123091] Updated weights for policy 0, policy_version 1770780 (0.0009) [2023-12-26 13:44:03,911][123091] Updated weights for policy 0, policy_version 1770790 (0.0010) [2023-12-26 13:44:03,974][123091] Updated weights for policy 0, policy_version 1770800 (0.0011) [2023-12-26 13:44:04,412][123090] Updated weights for policy 1, policy_version 1758824 (0.0006) [2023-12-26 13:44:04,471][123090] Updated weights for policy 1, policy_version 1758834 (0.0009) [2023-12-26 13:44:04,530][123090] Updated weights for policy 1, policy_version 1758844 (0.0010) [2023-12-26 13:44:04,785][123091] Updated weights for policy 0, policy_version 1770810 (0.0010) [2023-12-26 13:44:04,848][123091] Updated weights for policy 0, policy_version 1770820 (0.0010) [2023-12-26 13:44:04,914][123091] Updated weights for policy 0, policy_version 1770830 (0.0010) [2023-12-26 13:44:05,340][123090] Updated weights for policy 1, policy_version 1758854 (0.0010) [2023-12-26 13:44:05,387][123090] Updated weights for policy 1, policy_version 1758864 (0.0010) [2023-12-26 13:44:05,442][123090] Updated weights for policy 1, policy_version 1758874 (0.0010) [2023-12-26 13:44:05,708][123091] Updated weights for policy 0, policy_version 1770840 (0.0010) [2023-12-26 13:44:05,755][123091] Updated weights for policy 0, policy_version 1770850 (0.0010) [2023-12-26 13:44:05,811][123091] Updated weights for policy 0, policy_version 1770860 (0.0010) [2023-12-26 13:44:06,276][123090] Updated weights for policy 1, policy_version 1758884 (0.0011) [2023-12-26 13:44:06,328][123090] Updated weights for policy 1, policy_version 1758894 (0.0011) [2023-12-26 13:44:06,380][123090] Updated weights for policy 1, policy_version 1758904 (0.0011) [2023-12-26 13:44:06,619][123091] Updated weights for policy 0, policy_version 1770870 (0.0010) [2023-12-26 13:44:06,675][123091] Updated weights for policy 0, policy_version 1770880 (0.0011) [2023-12-26 13:44:06,734][123091] Updated weights for policy 0, policy_version 1770890 (0.0010) [2023-12-26 13:44:07,234][123090] Updated weights for policy 1, policy_version 1758914 (0.0011) [2023-12-26 13:44:07,293][123090] Updated weights for policy 1, policy_version 1758924 (0.0010) [2023-12-26 13:44:07,345][123090] Updated weights for policy 1, policy_version 1758934 (0.0010) [2023-12-26 13:44:07,404][123090] Updated weights for policy 1, policy_version 1758944 (0.0010) [2023-12-26 13:44:07,576][123091] Updated weights for policy 0, policy_version 1770900 (0.0011) [2023-12-26 13:44:07,635][123091] Updated weights for policy 0, policy_version 1770910 (0.0010) [2023-12-26 13:44:07,685][123091] Updated weights for policy 0, policy_version 1770920 (0.0010) [2023-12-26 13:44:08,109][123090] Updated weights for policy 1, policy_version 1758954 (0.0006) [2023-12-26 13:44:08,165][123090] Updated weights for policy 1, policy_version 1758964 (0.0006) [2023-12-26 13:44:08,223][123090] Updated weights for policy 1, policy_version 1758974 (0.0005) [2023-12-26 13:44:08,558][123091] Updated weights for policy 0, policy_version 1770930 (0.0011) [2023-12-26 13:44:08,619][123091] Updated weights for policy 0, policy_version 1770940 (0.0011) [2023-12-26 13:44:08,676][123091] Updated weights for policy 0, policy_version 1770950 (0.0011) [2023-12-26 13:44:08,743][123091] Updated weights for policy 0, policy_version 1770960 (0.0011) [2023-12-26 13:44:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 903667712. Throughput: 0: 8719.5, 1: 8981.2. Samples: 903641672. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:44:08,785][121949] Avg episode reward: [(0, '6352.115'), (1, '5657.476')] [2023-12-26 13:44:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001770960_453369856.pth... [2023-12-26 13:44:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001758976_450297856.pth... [2023-12-26 13:44:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001769936_453107712.pth [2023-12-26 13:44:08,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001757952_450035712.pth [2023-12-26 13:44:08,929][123090] Updated weights for policy 1, policy_version 1758984 (0.0010) [2023-12-26 13:44:08,996][123090] Updated weights for policy 1, policy_version 1758994 (0.0010) [2023-12-26 13:44:09,061][123090] Updated weights for policy 1, policy_version 1759004 (0.0010) [2023-12-26 13:44:09,613][123091] Updated weights for policy 0, policy_version 1770970 (0.0011) [2023-12-26 13:44:09,676][123091] Updated weights for policy 0, policy_version 1770980 (0.0011) [2023-12-26 13:44:09,740][123091] Updated weights for policy 0, policy_version 1770990 (0.0011) [2023-12-26 13:44:09,870][123090] Updated weights for policy 1, policy_version 1759014 (0.0010) [2023-12-26 13:44:09,944][123090] Updated weights for policy 1, policy_version 1759024 (0.0010) [2023-12-26 13:44:10,014][123090] Updated weights for policy 1, policy_version 1759034 (0.0007) [2023-12-26 13:44:10,524][123091] Updated weights for policy 0, policy_version 1771000 (0.0011) [2023-12-26 13:44:10,587][123091] Updated weights for policy 0, policy_version 1771010 (0.0011) [2023-12-26 13:44:10,647][123091] Updated weights for policy 0, policy_version 1771020 (0.0011) [2023-12-26 13:44:10,651][123090] Updated weights for policy 1, policy_version 1759044 (0.0005) [2023-12-26 13:44:10,726][123090] Updated weights for policy 1, policy_version 1759054 (0.0005) [2023-12-26 13:44:10,801][123090] Updated weights for policy 1, policy_version 1759064 (0.0006) [2023-12-26 13:44:11,454][123091] Updated weights for policy 0, policy_version 1771030 (0.0010) [2023-12-26 13:44:11,524][123091] Updated weights for policy 0, policy_version 1771040 (0.0010) [2023-12-26 13:44:11,575][123090] Updated weights for policy 1, policy_version 1759074 (0.0009) [2023-12-26 13:44:11,579][123091] Updated weights for policy 0, policy_version 1771050 (0.0009) [2023-12-26 13:44:11,644][123090] Updated weights for policy 1, policy_version 1759084 (0.0007) [2023-12-26 13:44:11,713][123090] Updated weights for policy 1, policy_version 1759094 (0.0007) [2023-12-26 13:44:11,782][123090] Updated weights for policy 1, policy_version 1759104 (0.0009) [2023-12-26 13:44:12,430][123091] Updated weights for policy 0, policy_version 1771060 (0.0010) [2023-12-26 13:44:12,480][123091] Updated weights for policy 0, policy_version 1771070 (0.0006) [2023-12-26 13:44:12,532][123091] Updated weights for policy 0, policy_version 1771080 (0.0006) [2023-12-26 13:44:12,642][123090] Updated weights for policy 1, policy_version 1759114 (0.0009) [2023-12-26 13:44:12,699][123090] Updated weights for policy 1, policy_version 1759124 (0.0009) [2023-12-26 13:44:12,760][123090] Updated weights for policy 1, policy_version 1759134 (0.0009) [2023-12-26 13:44:13,345][123091] Updated weights for policy 0, policy_version 1771090 (0.0007) [2023-12-26 13:44:13,404][123091] Updated weights for policy 0, policy_version 1771100 (0.0009) [2023-12-26 13:44:13,479][123091] Updated weights for policy 0, policy_version 1771110 (0.0009) [2023-12-26 13:44:13,532][123091] Updated weights for policy 0, policy_version 1771120 (0.0010) [2023-12-26 13:44:13,567][123090] Updated weights for policy 1, policy_version 1759144 (0.0006) [2023-12-26 13:44:13,622][123090] Updated weights for policy 1, policy_version 1759154 (0.0006) [2023-12-26 13:44:13,685][123090] Updated weights for policy 1, policy_version 1759164 (0.0009) [2023-12-26 13:44:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 903757824. Throughput: 0: 8632.9, 1: 8939.5. Samples: 903746800. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:44:13,784][121949] Avg episode reward: [(0, '6277.589'), (1, '5709.743')] [2023-12-26 13:44:14,382][123091] Updated weights for policy 0, policy_version 1771130 (0.0010) [2023-12-26 13:44:14,444][123091] Updated weights for policy 0, policy_version 1771140 (0.0009) [2023-12-26 13:44:14,482][123090] Updated weights for policy 1, policy_version 1759174 (0.0009) [2023-12-26 13:44:14,509][123091] Updated weights for policy 0, policy_version 1771150 (0.0007) [2023-12-26 13:44:14,538][123090] Updated weights for policy 1, policy_version 1759184 (0.0009) [2023-12-26 13:44:14,585][123090] Updated weights for policy 1, policy_version 1759194 (0.0007) [2023-12-26 13:44:15,336][123091] Updated weights for policy 0, policy_version 1771160 (0.0009) [2023-12-26 13:44:15,388][123091] Updated weights for policy 0, policy_version 1771170 (0.0009) [2023-12-26 13:44:15,445][123091] Updated weights for policy 0, policy_version 1771180 (0.0010) [2023-12-26 13:44:15,469][123090] Updated weights for policy 1, policy_version 1759204 (0.0010) [2023-12-26 13:44:15,527][123090] Updated weights for policy 1, policy_version 1759214 (0.0009) [2023-12-26 13:44:15,580][123090] Updated weights for policy 1, policy_version 1759224 (0.0009) [2023-12-26 13:44:16,282][123091] Updated weights for policy 0, policy_version 1771190 (0.0006) [2023-12-26 13:44:16,350][123091] Updated weights for policy 0, policy_version 1771200 (0.0005) [2023-12-26 13:44:16,394][123091] Updated weights for policy 0, policy_version 1771210 (0.0005) [2023-12-26 13:44:16,430][123090] Updated weights for policy 1, policy_version 1759234 (0.0009) [2023-12-26 13:44:16,487][123090] Updated weights for policy 1, policy_version 1759244 (0.0010) [2023-12-26 13:44:16,539][123090] Updated weights for policy 1, policy_version 1759254 (0.0008) [2023-12-26 13:44:16,591][123090] Updated weights for policy 1, policy_version 1759264 (0.0008) [2023-12-26 13:44:17,123][123091] Updated weights for policy 0, policy_version 1771220 (0.0007) [2023-12-26 13:44:17,192][123091] Updated weights for policy 0, policy_version 1771230 (0.0009) [2023-12-26 13:44:17,260][123091] Updated weights for policy 0, policy_version 1771240 (0.0010) [2023-12-26 13:44:17,463][123090] Updated weights for policy 1, policy_version 1759274 (0.0009) [2023-12-26 13:44:17,524][123090] Updated weights for policy 1, policy_version 1759284 (0.0008) [2023-12-26 13:44:17,584][123090] Updated weights for policy 1, policy_version 1759294 (0.0009) [2023-12-26 13:44:18,061][123091] Updated weights for policy 0, policy_version 1771250 (0.0011) [2023-12-26 13:44:18,127][123091] Updated weights for policy 0, policy_version 1771260 (0.0011) [2023-12-26 13:44:18,178][123091] Updated weights for policy 0, policy_version 1771270 (0.0010) [2023-12-26 13:44:18,237][123091] Updated weights for policy 0, policy_version 1771280 (0.0010) [2023-12-26 13:44:18,437][123090] Updated weights for policy 1, policy_version 1759304 (0.0009) [2023-12-26 13:44:18,495][123090] Updated weights for policy 1, policy_version 1759314 (0.0009) [2023-12-26 13:44:18,560][123090] Updated weights for policy 1, policy_version 1759324 (0.0009) [2023-12-26 13:44:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17717.0). Total num frames: 903839744. Throughput: 0: 8625.3, 1: 8842.5. Samples: 903849128. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:44:18,785][121949] Avg episode reward: [(0, '6252.349'), (1, '5664.275')] [2023-12-26 13:44:19,067][123091] Updated weights for policy 0, policy_version 1771290 (0.0011) [2023-12-26 13:44:19,125][123091] Updated weights for policy 0, policy_version 1771300 (0.0010) [2023-12-26 13:44:19,172][123091] Updated weights for policy 0, policy_version 1771310 (0.0010) [2023-12-26 13:44:19,410][123090] Updated weights for policy 1, policy_version 1759334 (0.0009) [2023-12-26 13:44:19,463][123090] Updated weights for policy 1, policy_version 1759344 (0.0009) [2023-12-26 13:44:19,527][123090] Updated weights for policy 1, policy_version 1759354 (0.0009) [2023-12-26 13:44:20,016][123091] Updated weights for policy 0, policy_version 1771320 (0.0011) [2023-12-26 13:44:20,081][123091] Updated weights for policy 0, policy_version 1771330 (0.0011) [2023-12-26 13:44:20,145][123091] Updated weights for policy 0, policy_version 1771340 (0.0011) [2023-12-26 13:44:20,411][123090] Updated weights for policy 1, policy_version 1759364 (0.0009) [2023-12-26 13:44:20,470][123090] Updated weights for policy 1, policy_version 1759374 (0.0009) [2023-12-26 13:44:20,537][123090] Updated weights for policy 1, policy_version 1759384 (0.0009) [2023-12-26 13:44:20,989][123091] Updated weights for policy 0, policy_version 1771350 (0.0011) [2023-12-26 13:44:21,062][123091] Updated weights for policy 0, policy_version 1771360 (0.0011) [2023-12-26 13:44:21,123][123091] Updated weights for policy 0, policy_version 1771370 (0.0011) [2023-12-26 13:44:21,400][123090] Updated weights for policy 1, policy_version 1759394 (0.0009) [2023-12-26 13:44:21,467][123090] Updated weights for policy 1, policy_version 1759404 (0.0009) [2023-12-26 13:44:21,533][123090] Updated weights for policy 1, policy_version 1759414 (0.0009) [2023-12-26 13:44:21,601][123090] Updated weights for policy 1, policy_version 1759424 (0.0009) [2023-12-26 13:44:21,961][123091] Updated weights for policy 0, policy_version 1771380 (0.0011) [2023-12-26 13:44:22,029][123091] Updated weights for policy 0, policy_version 1771390 (0.0011) [2023-12-26 13:44:22,080][123091] Updated weights for policy 0, policy_version 1771400 (0.0011) [2023-12-26 13:44:22,465][123090] Updated weights for policy 1, policy_version 1759434 (0.0009) [2023-12-26 13:44:22,536][123090] Updated weights for policy 1, policy_version 1759444 (0.0009) [2023-12-26 13:44:22,598][123090] Updated weights for policy 1, policy_version 1759454 (0.0009) [2023-12-26 13:44:22,919][123091] Updated weights for policy 0, policy_version 1771410 (0.0011) [2023-12-26 13:44:22,977][123091] Updated weights for policy 0, policy_version 1771420 (0.0011) [2023-12-26 13:44:23,040][123091] Updated weights for policy 0, policy_version 1771430 (0.0011) [2023-12-26 13:44:23,099][123091] Updated weights for policy 0, policy_version 1771440 (0.0011) [2023-12-26 13:44:23,438][123090] Updated weights for policy 1, policy_version 1759464 (0.0009) [2023-12-26 13:44:23,496][123090] Updated weights for policy 1, policy_version 1759474 (0.0009) [2023-12-26 13:44:23,558][123090] Updated weights for policy 1, policy_version 1759484 (0.0009) [2023-12-26 13:44:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 903921664. Throughput: 0: 8628.2, 1: 8776.4. Samples: 903898524. Policy #0 lag: (min: 31.0, avg: 41.6, max: 63.0) [2023-12-26 13:44:23,785][121949] Avg episode reward: [(0, '6295.023'), (1, '5717.885')] [2023-12-26 13:44:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001771440_453492736.pth... [2023-12-26 13:44:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001759488_450428928.pth... [2023-12-26 13:44:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001770448_453238784.pth [2023-12-26 13:44:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001758464_450166784.pth [2023-12-26 13:44:23,935][123091] Updated weights for policy 0, policy_version 1771450 (0.0011) [2023-12-26 13:44:23,983][123091] Updated weights for policy 0, policy_version 1771460 (0.0010) [2023-12-26 13:44:24,026][123091] Updated weights for policy 0, policy_version 1771470 (0.0010) [2023-12-26 13:44:24,423][123090] Updated weights for policy 1, policy_version 1759494 (0.0009) [2023-12-26 13:44:24,492][123090] Updated weights for policy 1, policy_version 1759504 (0.0009) [2023-12-26 13:44:24,545][123090] Updated weights for policy 1, policy_version 1759514 (0.0008) [2023-12-26 13:44:24,851][123091] Updated weights for policy 0, policy_version 1771480 (0.0010) [2023-12-26 13:44:24,912][123091] Updated weights for policy 0, policy_version 1771490 (0.0010) [2023-12-26 13:44:24,981][123091] Updated weights for policy 0, policy_version 1771500 (0.0009) [2023-12-26 13:44:25,397][123090] Updated weights for policy 1, policy_version 1759524 (0.0010) [2023-12-26 13:44:25,473][123090] Updated weights for policy 1, policy_version 1759534 (0.0009) [2023-12-26 13:44:25,541][123090] Updated weights for policy 1, policy_version 1759544 (0.0010) [2023-12-26 13:44:25,743][123091] Updated weights for policy 0, policy_version 1771510 (0.0006) [2023-12-26 13:44:25,793][123091] Updated weights for policy 0, policy_version 1771520 (0.0005) [2023-12-26 13:44:25,842][123091] Updated weights for policy 0, policy_version 1771530 (0.0005) [2023-12-26 13:44:26,369][123090] Updated weights for policy 1, policy_version 1759554 (0.0010) [2023-12-26 13:44:26,423][123090] Updated weights for policy 1, policy_version 1759564 (0.0009) [2023-12-26 13:44:26,483][123090] Updated weights for policy 1, policy_version 1759574 (0.0008) [2023-12-26 13:44:26,537][123090] Updated weights for policy 1, policy_version 1759584 (0.0009) [2023-12-26 13:44:26,567][123091] Updated weights for policy 0, policy_version 1771540 (0.0007) [2023-12-26 13:44:26,633][123091] Updated weights for policy 0, policy_version 1771550 (0.0009) [2023-12-26 13:44:26,680][123091] Updated weights for policy 0, policy_version 1771560 (0.0009) [2023-12-26 13:44:27,426][123090] Updated weights for policy 1, policy_version 1759594 (0.0009) [2023-12-26 13:44:27,438][123091] Updated weights for policy 0, policy_version 1771570 (0.0009) [2023-12-26 13:44:27,479][123090] Updated weights for policy 1, policy_version 1759604 (0.0008) [2023-12-26 13:44:27,489][123091] Updated weights for policy 0, policy_version 1771580 (0.0005) [2023-12-26 13:44:27,530][123090] Updated weights for policy 1, policy_version 1759615 (0.0009) [2023-12-26 13:44:27,550][123091] Updated weights for policy 0, policy_version 1771590 (0.0005) [2023-12-26 13:44:27,613][123091] Updated weights for policy 0, policy_version 1771600 (0.0005) [2023-12-26 13:44:28,355][123091] Updated weights for policy 0, policy_version 1771610 (0.0010) [2023-12-26 13:44:28,406][123090] Updated weights for policy 1, policy_version 1759625 (0.0008) [2023-12-26 13:44:28,415][123091] Updated weights for policy 0, policy_version 1771620 (0.0009) [2023-12-26 13:44:28,470][123091] Updated weights for policy 0, policy_version 1771630 (0.0006) [2023-12-26 13:44:28,472][123090] Updated weights for policy 1, policy_version 1759635 (0.0010) [2023-12-26 13:44:28,542][123090] Updated weights for policy 1, policy_version 1759645 (0.0009) [2023-12-26 13:44:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 904011776. Throughput: 0: 8654.6, 1: 8718.9. Samples: 904002316. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:28,785][121949] Avg episode reward: [(0, '6336.341'), (1, '5827.380')] [2023-12-26 13:44:29,315][123090] Updated weights for policy 1, policy_version 1759655 (0.0008) [2023-12-26 13:44:29,351][123091] Updated weights for policy 0, policy_version 1771640 (0.0007) [2023-12-26 13:44:29,384][123090] Updated weights for policy 1, policy_version 1759665 (0.0008) [2023-12-26 13:44:29,411][123091] Updated weights for policy 0, policy_version 1771650 (0.0009) [2023-12-26 13:44:29,441][123090] Updated weights for policy 1, policy_version 1759675 (0.0008) [2023-12-26 13:44:29,460][123091] Updated weights for policy 0, policy_version 1771660 (0.0008) [2023-12-26 13:44:30,256][123091] Updated weights for policy 0, policy_version 1771670 (0.0007) [2023-12-26 13:44:30,300][123090] Updated weights for policy 1, policy_version 1759685 (0.0008) [2023-12-26 13:44:30,317][123091] Updated weights for policy 0, policy_version 1771680 (0.0011) [2023-12-26 13:44:30,351][123090] Updated weights for policy 1, policy_version 1759695 (0.0008) [2023-12-26 13:44:30,375][123091] Updated weights for policy 0, policy_version 1771690 (0.0010) [2023-12-26 13:44:30,411][123090] Updated weights for policy 1, policy_version 1759705 (0.0006) [2023-12-26 13:44:31,099][123091] Updated weights for policy 0, policy_version 1771700 (0.0011) [2023-12-26 13:44:31,169][123091] Updated weights for policy 0, policy_version 1771710 (0.0011) [2023-12-26 13:44:31,233][123091] Updated weights for policy 0, policy_version 1771720 (0.0011) [2023-12-26 13:44:31,310][123090] Updated weights for policy 1, policy_version 1759715 (0.0009) [2023-12-26 13:44:31,379][123090] Updated weights for policy 1, policy_version 1759725 (0.0009) [2023-12-26 13:44:31,440][123090] Updated weights for policy 1, policy_version 1759735 (0.0010) [2023-12-26 13:44:32,001][123091] Updated weights for policy 0, policy_version 1771730 (0.0011) [2023-12-26 13:44:32,063][123091] Updated weights for policy 0, policy_version 1771740 (0.0006) [2023-12-26 13:44:32,140][123091] Updated weights for policy 0, policy_version 1771750 (0.0005) [2023-12-26 13:44:32,208][123091] Updated weights for policy 0, policy_version 1771760 (0.0006) [2023-12-26 13:44:32,354][123090] Updated weights for policy 1, policy_version 1759745 (0.0009) [2023-12-26 13:44:32,421][123090] Updated weights for policy 1, policy_version 1759755 (0.0008) [2023-12-26 13:44:32,477][123090] Updated weights for policy 1, policy_version 1759765 (0.0008) [2023-12-26 13:44:32,532][123090] Updated weights for policy 1, policy_version 1759775 (0.0008) [2023-12-26 13:44:32,936][123091] Updated weights for policy 0, policy_version 1771770 (0.0010) [2023-12-26 13:44:32,990][123091] Updated weights for policy 0, policy_version 1771780 (0.0005) [2023-12-26 13:44:33,051][123091] Updated weights for policy 0, policy_version 1771790 (0.0009) [2023-12-26 13:44:33,272][123090] Updated weights for policy 1, policy_version 1759785 (0.0006) [2023-12-26 13:44:33,332][123090] Updated weights for policy 1, policy_version 1759795 (0.0010) [2023-12-26 13:44:33,387][123090] Updated weights for policy 1, policy_version 1759805 (0.0009) [2023-12-26 13:44:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17633.6). Total num frames: 904093696. Throughput: 0: 8709.9, 1: 8659.4. Samples: 904106988. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:33,784][121949] Avg episode reward: [(0, '6381.147'), (1, '5883.273')] [2023-12-26 13:44:33,891][123091] Updated weights for policy 0, policy_version 1771800 (0.0010) [2023-12-26 13:44:33,942][123091] Updated weights for policy 0, policy_version 1771810 (0.0009) [2023-12-26 13:44:33,997][123091] Updated weights for policy 0, policy_version 1771821 (0.0009) [2023-12-26 13:44:34,161][123090] Updated weights for policy 1, policy_version 1759815 (0.0008) [2023-12-26 13:44:34,230][123090] Updated weights for policy 1, policy_version 1759825 (0.0006) [2023-12-26 13:44:34,304][123090] Updated weights for policy 1, policy_version 1759835 (0.0006) [2023-12-26 13:44:34,886][123091] Updated weights for policy 0, policy_version 1771831 (0.0009) [2023-12-26 13:44:34,941][123091] Updated weights for policy 0, policy_version 1771841 (0.0009) [2023-12-26 13:44:34,977][123090] Updated weights for policy 1, policy_version 1759845 (0.0006) [2023-12-26 13:44:35,001][123091] Updated weights for policy 0, policy_version 1771851 (0.0009) [2023-12-26 13:44:35,033][123090] Updated weights for policy 1, policy_version 1759855 (0.0009) [2023-12-26 13:44:35,089][123090] Updated weights for policy 1, policy_version 1759865 (0.0009) [2023-12-26 13:44:35,840][123091] Updated weights for policy 0, policy_version 1771861 (0.0008) [2023-12-26 13:44:35,897][123091] Updated weights for policy 0, policy_version 1771871 (0.0010) [2023-12-26 13:44:35,911][123090] Updated weights for policy 1, policy_version 1759875 (0.0009) [2023-12-26 13:44:35,949][123091] Updated weights for policy 0, policy_version 1771881 (0.0007) [2023-12-26 13:44:35,973][123090] Updated weights for policy 1, policy_version 1759885 (0.0009) [2023-12-26 13:44:36,029][123090] Updated weights for policy 1, policy_version 1759895 (0.0008) [2023-12-26 13:44:36,806][123091] Updated weights for policy 0, policy_version 1771891 (0.0010) [2023-12-26 13:44:36,834][123090] Updated weights for policy 1, policy_version 1759905 (0.0009) [2023-12-26 13:44:36,868][123091] Updated weights for policy 0, policy_version 1771901 (0.0010) [2023-12-26 13:44:36,895][123090] Updated weights for policy 1, policy_version 1759915 (0.0010) [2023-12-26 13:44:36,931][123091] Updated weights for policy 0, policy_version 1771911 (0.0009) [2023-12-26 13:44:36,960][123090] Updated weights for policy 1, policy_version 1759925 (0.0007) [2023-12-26 13:44:37,027][123090] Updated weights for policy 1, policy_version 1759935 (0.0010) [2023-12-26 13:44:37,754][123091] Updated weights for policy 0, policy_version 1771921 (0.0009) [2023-12-26 13:44:37,811][123091] Updated weights for policy 0, policy_version 1771931 (0.0008) [2023-12-26 13:44:37,840][123090] Updated weights for policy 1, policy_version 1759945 (0.0009) [2023-12-26 13:44:37,873][123091] Updated weights for policy 0, policy_version 1771941 (0.0008) [2023-12-26 13:44:37,902][123090] Updated weights for policy 1, policy_version 1759955 (0.0008) [2023-12-26 13:44:37,922][123091] Updated weights for policy 0, policy_version 1771951 (0.0007) [2023-12-26 13:44:37,966][123090] Updated weights for policy 1, policy_version 1759965 (0.0009) [2023-12-26 13:44:38,772][123091] Updated weights for policy 0, policy_version 1771961 (0.0010) [2023-12-26 13:44:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 904175616. Throughput: 0: 8713.4, 1: 8680.7. Samples: 904158744. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:38,785][121949] Avg episode reward: [(0, '6363.201'), (1, '5572.450')] [2023-12-26 13:44:38,834][123090] Updated weights for policy 1, policy_version 1759975 (0.0010) [2023-12-26 13:44:38,840][123091] Updated weights for policy 0, policy_version 1771971 (0.0009) [2023-12-26 13:44:38,903][123090] Updated weights for policy 1, policy_version 1759985 (0.0008) [2023-12-26 13:44:38,906][123091] Updated weights for policy 0, policy_version 1771981 (0.0010) [2023-12-26 13:44:38,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001771984_453632000.pth... [2023-12-26 13:44:38,922][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001770960_453369856.pth [2023-12-26 13:44:38,968][123090] Updated weights for policy 1, policy_version 1759995 (0.0009) [2023-12-26 13:44:38,999][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001760000_450560000.pth... [2023-12-26 13:44:39,004][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001758976_450297856.pth [2023-12-26 13:44:39,756][123090] Updated weights for policy 1, policy_version 1760005 (0.0008) [2023-12-26 13:44:39,796][123091] Updated weights for policy 0, policy_version 1771991 (0.0009) [2023-12-26 13:44:39,819][123090] Updated weights for policy 1, policy_version 1760015 (0.0006) [2023-12-26 13:44:39,866][123091] Updated weights for policy 0, policy_version 1772001 (0.0008) [2023-12-26 13:44:39,889][123090] Updated weights for policy 1, policy_version 1760025 (0.0007) [2023-12-26 13:44:39,934][123091] Updated weights for policy 0, policy_version 1772011 (0.0009) [2023-12-26 13:44:40,674][123090] Updated weights for policy 1, policy_version 1760035 (0.0008) [2023-12-26 13:44:40,727][123090] Updated weights for policy 1, policy_version 1760045 (0.0010) [2023-12-26 13:44:40,794][123090] Updated weights for policy 1, policy_version 1760055 (0.0008) [2023-12-26 13:44:40,798][123091] Updated weights for policy 0, policy_version 1772021 (0.0009) [2023-12-26 13:44:40,863][123091] Updated weights for policy 0, policy_version 1772031 (0.0008) [2023-12-26 13:44:40,938][123091] Updated weights for policy 0, policy_version 1772041 (0.0010) [2023-12-26 13:44:41,590][123090] Updated weights for policy 1, policy_version 1760065 (0.0008) [2023-12-26 13:44:41,660][123090] Updated weights for policy 1, policy_version 1760075 (0.0009) [2023-12-26 13:44:41,729][123090] Updated weights for policy 1, policy_version 1760085 (0.0009) [2023-12-26 13:44:41,787][123091] Updated weights for policy 0, policy_version 1772051 (0.0009) [2023-12-26 13:44:41,793][123090] Updated weights for policy 1, policy_version 1760095 (0.0008) [2023-12-26 13:44:41,848][123091] Updated weights for policy 0, policy_version 1772061 (0.0008) [2023-12-26 13:44:41,902][123091] Updated weights for policy 0, policy_version 1772071 (0.0009) [2023-12-26 13:44:42,631][123090] Updated weights for policy 1, policy_version 1760105 (0.0009) [2023-12-26 13:44:42,680][123090] Updated weights for policy 1, policy_version 1760115 (0.0008) [2023-12-26 13:44:42,753][123090] Updated weights for policy 1, policy_version 1760125 (0.0006) [2023-12-26 13:44:42,772][123091] Updated weights for policy 0, policy_version 1772081 (0.0010) [2023-12-26 13:44:42,844][123091] Updated weights for policy 0, policy_version 1772091 (0.0005) [2023-12-26 13:44:42,913][123091] Updated weights for policy 0, policy_version 1772101 (0.0006) [2023-12-26 13:44:42,977][123091] Updated weights for policy 0, policy_version 1772111 (0.0006) [2023-12-26 13:44:43,576][123090] Updated weights for policy 1, policy_version 1760135 (0.0010) [2023-12-26 13:44:43,648][123090] Updated weights for policy 1, policy_version 1760145 (0.0010) [2023-12-26 13:44:43,700][123091] Updated weights for policy 0, policy_version 1772121 (0.0010) [2023-12-26 13:44:43,712][123090] Updated weights for policy 1, policy_version 1760155 (0.0006) [2023-12-26 13:44:43,750][123091] Updated weights for policy 0, policy_version 1772131 (0.0009) [2023-12-26 13:44:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 904265728. Throughput: 0: 8672.2, 1: 8559.7. Samples: 904259752. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:43,784][121949] Avg episode reward: [(0, '6399.697'), (1, '5532.313')] [2023-12-26 13:44:43,802][123091] Updated weights for policy 0, policy_version 1772141 (0.0009) [2023-12-26 13:44:44,516][123090] Updated weights for policy 1, policy_version 1760165 (0.0009) [2023-12-26 13:44:44,575][123090] Updated weights for policy 1, policy_version 1760175 (0.0009) [2023-12-26 13:44:44,631][123091] Updated weights for policy 0, policy_version 1772151 (0.0009) [2023-12-26 13:44:44,632][123090] Updated weights for policy 1, policy_version 1760185 (0.0009) [2023-12-26 13:44:44,694][123091] Updated weights for policy 0, policy_version 1772161 (0.0009) [2023-12-26 13:44:44,748][123091] Updated weights for policy 0, policy_version 1772171 (0.0008) [2023-12-26 13:44:45,493][123090] Updated weights for policy 1, policy_version 1760195 (0.0010) [2023-12-26 13:44:45,550][123090] Updated weights for policy 1, policy_version 1760205 (0.0009) [2023-12-26 13:44:45,594][123091] Updated weights for policy 0, policy_version 1772181 (0.0008) [2023-12-26 13:44:45,605][123090] Updated weights for policy 1, policy_version 1760215 (0.0008) [2023-12-26 13:44:45,649][123091] Updated weights for policy 0, policy_version 1772191 (0.0007) [2023-12-26 13:44:45,706][123091] Updated weights for policy 0, policy_version 1772201 (0.0010) [2023-12-26 13:44:46,439][123090] Updated weights for policy 1, policy_version 1760225 (0.0008) [2023-12-26 13:44:46,504][123090] Updated weights for policy 1, policy_version 1760235 (0.0010) [2023-12-26 13:44:46,544][123091] Updated weights for policy 0, policy_version 1772211 (0.0008) [2023-12-26 13:44:46,558][123090] Updated weights for policy 1, policy_version 1760245 (0.0009) [2023-12-26 13:44:46,608][123091] Updated weights for policy 0, policy_version 1772221 (0.0006) [2023-12-26 13:44:46,622][123090] Updated weights for policy 1, policy_version 1760255 (0.0008) [2023-12-26 13:44:46,675][123091] Updated weights for policy 0, policy_version 1772231 (0.0009) [2023-12-26 13:44:47,390][123090] Updated weights for policy 1, policy_version 1760265 (0.0008) [2023-12-26 13:44:47,462][123090] Updated weights for policy 1, policy_version 1760275 (0.0005) [2023-12-26 13:44:47,518][123091] Updated weights for policy 0, policy_version 1772241 (0.0010) [2023-12-26 13:44:47,534][123090] Updated weights for policy 1, policy_version 1760285 (0.0006) [2023-12-26 13:44:47,577][123091] Updated weights for policy 0, policy_version 1772251 (0.0009) [2023-12-26 13:44:47,635][123091] Updated weights for policy 0, policy_version 1772261 (0.0009) [2023-12-26 13:44:47,695][123091] Updated weights for policy 0, policy_version 1772271 (0.0009) [2023-12-26 13:44:48,186][123090] Updated weights for policy 1, policy_version 1760295 (0.0006) [2023-12-26 13:44:48,253][123090] Updated weights for policy 1, policy_version 1760305 (0.0009) [2023-12-26 13:44:48,320][123090] Updated weights for policy 1, policy_version 1760315 (0.0010) [2023-12-26 13:44:48,589][123091] Updated weights for policy 0, policy_version 1772281 (0.0010) [2023-12-26 13:44:48,656][123091] Updated weights for policy 0, policy_version 1772291 (0.0009) [2023-12-26 13:44:48,720][123091] Updated weights for policy 0, policy_version 1772301 (0.0009) [2023-12-26 13:44:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 904355840. Throughput: 0: 8604.1, 1: 8608.8. Samples: 904363988. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:48,785][121949] Avg episode reward: [(0, '6385.765'), (1, '5779.578')] [2023-12-26 13:44:49,074][123090] Updated weights for policy 1, policy_version 1760325 (0.0007) [2023-12-26 13:44:49,148][123090] Updated weights for policy 1, policy_version 1760335 (0.0005) [2023-12-26 13:44:49,201][123090] Updated weights for policy 1, policy_version 1760345 (0.0005) [2023-12-26 13:44:49,550][123091] Updated weights for policy 0, policy_version 1772311 (0.0008) [2023-12-26 13:44:49,606][123091] Updated weights for policy 0, policy_version 1772321 (0.0009) [2023-12-26 13:44:49,666][123091] Updated weights for policy 0, policy_version 1772331 (0.0009) [2023-12-26 13:44:49,998][123090] Updated weights for policy 1, policy_version 1760355 (0.0009) [2023-12-26 13:44:50,047][123090] Updated weights for policy 1, policy_version 1760365 (0.0009) [2023-12-26 13:44:50,097][123090] Updated weights for policy 1, policy_version 1760375 (0.0009) [2023-12-26 13:44:50,530][123091] Updated weights for policy 0, policy_version 1772341 (0.0010) [2023-12-26 13:44:50,598][123091] Updated weights for policy 0, policy_version 1772351 (0.0009) [2023-12-26 13:44:50,652][123091] Updated weights for policy 0, policy_version 1772361 (0.0009) [2023-12-26 13:44:50,968][123090] Updated weights for policy 1, policy_version 1760385 (0.0009) [2023-12-26 13:44:51,026][123090] Updated weights for policy 1, policy_version 1760395 (0.0010) [2023-12-26 13:44:51,087][123090] Updated weights for policy 1, policy_version 1760405 (0.0007) [2023-12-26 13:44:51,151][123090] Updated weights for policy 1, policy_version 1760415 (0.0007) [2023-12-26 13:44:51,469][123091] Updated weights for policy 0, policy_version 1772371 (0.0010) [2023-12-26 13:44:51,528][123091] Updated weights for policy 0, policy_version 1772381 (0.0011) [2023-12-26 13:44:51,587][123091] Updated weights for policy 0, policy_version 1772391 (0.0011) [2023-12-26 13:44:51,946][123090] Updated weights for policy 1, policy_version 1760426 (0.0006) [2023-12-26 13:44:52,008][123090] Updated weights for policy 1, policy_version 1760436 (0.0006) [2023-12-26 13:44:52,074][123090] Updated weights for policy 1, policy_version 1760446 (0.0005) [2023-12-26 13:44:52,338][123091] Updated weights for policy 0, policy_version 1772401 (0.0011) [2023-12-26 13:44:52,406][123091] Updated weights for policy 0, policy_version 1772411 (0.0011) [2023-12-26 13:44:52,461][123091] Updated weights for policy 0, policy_version 1772421 (0.0011) [2023-12-26 13:44:52,517][123091] Updated weights for policy 0, policy_version 1772431 (0.0011) [2023-12-26 13:44:52,801][123090] Updated weights for policy 1, policy_version 1760456 (0.0006) [2023-12-26 13:44:52,865][123090] Updated weights for policy 1, policy_version 1760466 (0.0005) [2023-12-26 13:44:52,930][123090] Updated weights for policy 1, policy_version 1760476 (0.0005) [2023-12-26 13:44:53,346][123091] Updated weights for policy 0, policy_version 1772441 (0.0010) [2023-12-26 13:44:53,406][123091] Updated weights for policy 0, policy_version 1772451 (0.0009) [2023-12-26 13:44:53,466][123091] Updated weights for policy 0, policy_version 1772461 (0.0011) [2023-12-26 13:44:53,536][123090] Updated weights for policy 1, policy_version 1760486 (0.0005) [2023-12-26 13:44:53,585][123090] Updated weights for policy 1, policy_version 1760496 (0.0005) [2023-12-26 13:44:53,637][123090] Updated weights for policy 1, policy_version 1760506 (0.0007) [2023-12-26 13:44:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 904445952. Throughput: 0: 8581.0, 1: 8614.3. Samples: 904415456. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:53,785][121949] Avg episode reward: [(0, '6375.803'), (1, '5781.003')] [2023-12-26 13:44:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001772464_453754880.pth... [2023-12-26 13:44:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001760512_450691072.pth... [2023-12-26 13:44:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001759488_450428928.pth [2023-12-26 13:44:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001771440_453492736.pth [2023-12-26 13:44:54,286][123091] Updated weights for policy 0, policy_version 1772471 (0.0009) [2023-12-26 13:44:54,347][123091] Updated weights for policy 0, policy_version 1772481 (0.0008) [2023-12-26 13:44:54,369][123090] Updated weights for policy 1, policy_version 1760516 (0.0008) [2023-12-26 13:44:54,423][123091] Updated weights for policy 0, policy_version 1772491 (0.0008) [2023-12-26 13:44:54,427][123090] Updated weights for policy 1, policy_version 1760526 (0.0006) [2023-12-26 13:44:54,486][123090] Updated weights for policy 1, policy_version 1760536 (0.0006) [2023-12-26 13:44:55,092][123091] Updated weights for policy 0, policy_version 1772501 (0.0008) [2023-12-26 13:44:55,156][123091] Updated weights for policy 0, policy_version 1772511 (0.0006) [2023-12-26 13:44:55,192][123090] Updated weights for policy 1, policy_version 1760546 (0.0006) [2023-12-26 13:44:55,207][123091] Updated weights for policy 0, policy_version 1772521 (0.0005) [2023-12-26 13:44:55,247][123090] Updated weights for policy 1, policy_version 1760556 (0.0006) [2023-12-26 13:44:55,298][123090] Updated weights for policy 1, policy_version 1760566 (0.0005) [2023-12-26 13:44:55,360][123090] Updated weights for policy 1, policy_version 1760576 (0.0005) [2023-12-26 13:44:55,950][123091] Updated weights for policy 0, policy_version 1772531 (0.0008) [2023-12-26 13:44:56,018][123091] Updated weights for policy 0, policy_version 1772541 (0.0008) [2023-12-26 13:44:56,079][123091] Updated weights for policy 0, policy_version 1772551 (0.0007) [2023-12-26 13:44:56,117][123090] Updated weights for policy 1, policy_version 1760586 (0.0010) [2023-12-26 13:44:56,179][123090] Updated weights for policy 1, policy_version 1760596 (0.0010) [2023-12-26 13:44:56,255][123090] Updated weights for policy 1, policy_version 1760606 (0.0010) [2023-12-26 13:44:56,809][123091] Updated weights for policy 0, policy_version 1772561 (0.0006) [2023-12-26 13:44:56,857][123091] Updated weights for policy 0, policy_version 1772571 (0.0008) [2023-12-26 13:44:56,905][123091] Updated weights for policy 0, policy_version 1772581 (0.0009) [2023-12-26 13:44:56,954][123091] Updated weights for policy 0, policy_version 1772591 (0.0010) [2023-12-26 13:44:56,981][123090] Updated weights for policy 1, policy_version 1760616 (0.0010) [2023-12-26 13:44:57,027][123090] Updated weights for policy 1, policy_version 1760626 (0.0010) [2023-12-26 13:44:57,077][123090] Updated weights for policy 1, policy_version 1760636 (0.0010) [2023-12-26 13:44:57,817][123091] Updated weights for policy 0, policy_version 1772601 (0.0008) [2023-12-26 13:44:57,865][123091] Updated weights for policy 0, policy_version 1772611 (0.0009) [2023-12-26 13:44:57,899][123090] Updated weights for policy 1, policy_version 1760646 (0.0010) [2023-12-26 13:44:57,910][123091] Updated weights for policy 0, policy_version 1772621 (0.0007) [2023-12-26 13:44:57,949][123090] Updated weights for policy 1, policy_version 1760656 (0.0010) [2023-12-26 13:44:58,003][123090] Updated weights for policy 1, policy_version 1760666 (0.0010) [2023-12-26 13:44:58,723][123091] Updated weights for policy 0, policy_version 1772631 (0.0008) [2023-12-26 13:44:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 904527872. Throughput: 0: 8678.4, 1: 8692.1. Samples: 904528472. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:44:58,785][121949] Avg episode reward: [(0, '6391.629'), (1, '5635.413')] [2023-12-26 13:44:58,791][123091] Updated weights for policy 0, policy_version 1772641 (0.0008) [2023-12-26 13:44:58,865][123091] Updated weights for policy 0, policy_version 1772651 (0.0008) [2023-12-26 13:44:58,908][123090] Updated weights for policy 1, policy_version 1760676 (0.0009) [2023-12-26 13:44:58,988][123090] Updated weights for policy 1, policy_version 1760686 (0.0005) [2023-12-26 13:44:59,062][123090] Updated weights for policy 1, policy_version 1760696 (0.0005) [2023-12-26 13:44:59,619][123091] Updated weights for policy 0, policy_version 1772661 (0.0007) [2023-12-26 13:44:59,686][123091] Updated weights for policy 0, policy_version 1772671 (0.0006) [2023-12-26 13:44:59,757][123091] Updated weights for policy 0, policy_version 1772681 (0.0007) [2023-12-26 13:44:59,780][123090] Updated weights for policy 1, policy_version 1760706 (0.0006) [2023-12-26 13:44:59,842][123090] Updated weights for policy 1, policy_version 1760716 (0.0009) [2023-12-26 13:44:59,900][123090] Updated weights for policy 1, policy_version 1760726 (0.0009) [2023-12-26 13:44:59,962][123090] Updated weights for policy 1, policy_version 1760736 (0.0009) [2023-12-26 13:45:00,467][123091] Updated weights for policy 0, policy_version 1772691 (0.0008) [2023-12-26 13:45:00,530][123091] Updated weights for policy 0, policy_version 1772701 (0.0009) [2023-12-26 13:45:00,606][123091] Updated weights for policy 0, policy_version 1772711 (0.0010) [2023-12-26 13:45:00,722][123090] Updated weights for policy 1, policy_version 1760746 (0.0005) [2023-12-26 13:45:00,794][123090] Updated weights for policy 1, policy_version 1760756 (0.0005) [2023-12-26 13:45:00,869][123090] Updated weights for policy 1, policy_version 1760766 (0.0006) [2023-12-26 13:45:01,451][123091] Updated weights for policy 0, policy_version 1772721 (0.0009) [2023-12-26 13:45:01,511][123091] Updated weights for policy 0, policy_version 1772731 (0.0009) [2023-12-26 13:45:01,559][123091] Updated weights for policy 0, policy_version 1772741 (0.0009) [2023-12-26 13:45:01,612][123091] Updated weights for policy 0, policy_version 1772751 (0.0008) [2023-12-26 13:45:01,639][123090] Updated weights for policy 1, policy_version 1760776 (0.0011) [2023-12-26 13:45:01,710][123090] Updated weights for policy 1, policy_version 1760786 (0.0011) [2023-12-26 13:45:01,778][123090] Updated weights for policy 1, policy_version 1760796 (0.0011) [2023-12-26 13:45:02,461][123091] Updated weights for policy 0, policy_version 1772761 (0.0009) [2023-12-26 13:45:02,511][123091] Updated weights for policy 0, policy_version 1772771 (0.0009) [2023-12-26 13:45:02,563][123091] Updated weights for policy 0, policy_version 1772781 (0.0009) [2023-12-26 13:45:02,595][123090] Updated weights for policy 1, policy_version 1760806 (0.0009) [2023-12-26 13:45:02,648][123090] Updated weights for policy 1, policy_version 1760816 (0.0010) [2023-12-26 13:45:02,698][123090] Updated weights for policy 1, policy_version 1760826 (0.0009) [2023-12-26 13:45:03,423][123091] Updated weights for policy 0, policy_version 1772792 (0.0010) [2023-12-26 13:45:03,484][123090] Updated weights for policy 1, policy_version 1760836 (0.0009) [2023-12-26 13:45:03,488][123091] Updated weights for policy 0, policy_version 1772802 (0.0007) [2023-12-26 13:45:03,546][123091] Updated weights for policy 0, policy_version 1772812 (0.0007) [2023-12-26 13:45:03,547][123090] Updated weights for policy 1, policy_version 1760846 (0.0011) [2023-12-26 13:45:03,610][123090] Updated weights for policy 1, policy_version 1760856 (0.0010) [2023-12-26 13:45:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 904626176. Throughput: 0: 8685.3, 1: 8733.3. Samples: 904632968. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:03,785][121949] Avg episode reward: [(0, '6323.034'), (1, '5355.449')] [2023-12-26 13:45:04,383][123091] Updated weights for policy 0, policy_version 1772822 (0.0010) [2023-12-26 13:45:04,403][123090] Updated weights for policy 1, policy_version 1760866 (0.0010) [2023-12-26 13:45:04,448][123091] Updated weights for policy 0, policy_version 1772832 (0.0011) [2023-12-26 13:45:04,463][123090] Updated weights for policy 1, policy_version 1760876 (0.0008) [2023-12-26 13:45:04,513][123091] Updated weights for policy 0, policy_version 1772842 (0.0010) [2023-12-26 13:45:04,519][123090] Updated weights for policy 1, policy_version 1760886 (0.0009) [2023-12-26 13:45:04,568][123090] Updated weights for policy 1, policy_version 1760896 (0.0009) [2023-12-26 13:45:05,268][123090] Updated weights for policy 1, policy_version 1760906 (0.0009) [2023-12-26 13:45:05,331][123090] Updated weights for policy 1, policy_version 1760916 (0.0011) [2023-12-26 13:45:05,342][123091] Updated weights for policy 0, policy_version 1772852 (0.0008) [2023-12-26 13:45:05,395][123090] Updated weights for policy 1, policy_version 1760926 (0.0011) [2023-12-26 13:45:05,401][123091] Updated weights for policy 0, policy_version 1772862 (0.0006) [2023-12-26 13:45:05,469][123091] Updated weights for policy 0, policy_version 1772872 (0.0009) [2023-12-26 13:45:06,123][123091] Updated weights for policy 0, policy_version 1772882 (0.0009) [2023-12-26 13:45:06,138][123090] Updated weights for policy 1, policy_version 1760936 (0.0008) [2023-12-26 13:45:06,189][123091] Updated weights for policy 0, policy_version 1772892 (0.0008) [2023-12-26 13:45:06,199][123090] Updated weights for policy 1, policy_version 1760946 (0.0008) [2023-12-26 13:45:06,254][123091] Updated weights for policy 0, policy_version 1772902 (0.0006) [2023-12-26 13:45:06,259][123090] Updated weights for policy 1, policy_version 1760956 (0.0011) [2023-12-26 13:45:06,313][123091] Updated weights for policy 0, policy_version 1772912 (0.0009) [2023-12-26 13:45:07,075][123090] Updated weights for policy 1, policy_version 1760966 (0.0011) [2023-12-26 13:45:07,127][123090] Updated weights for policy 1, policy_version 1760976 (0.0010) [2023-12-26 13:45:07,134][123091] Updated weights for policy 0, policy_version 1772922 (0.0009) [2023-12-26 13:45:07,179][123090] Updated weights for policy 1, policy_version 1760986 (0.0005) [2023-12-26 13:45:07,193][123091] Updated weights for policy 0, policy_version 1772932 (0.0009) [2023-12-26 13:45:07,255][123091] Updated weights for policy 0, policy_version 1772942 (0.0010) [2023-12-26 13:45:07,990][123090] Updated weights for policy 1, policy_version 1760996 (0.0005) [2023-12-26 13:45:08,046][123090] Updated weights for policy 1, policy_version 1761006 (0.0005) [2023-12-26 13:45:08,094][123090] Updated weights for policy 1, policy_version 1761016 (0.0005) [2023-12-26 13:45:08,116][123091] Updated weights for policy 0, policy_version 1772952 (0.0009) [2023-12-26 13:45:08,167][123091] Updated weights for policy 0, policy_version 1772963 (0.0010) [2023-12-26 13:45:08,217][123091] Updated weights for policy 0, policy_version 1772974 (0.0010) [2023-12-26 13:45:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17689.2). Total num frames: 904708096. Throughput: 0: 8710.6, 1: 8804.6. Samples: 904686708. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:08,785][121949] Avg episode reward: [(0, '6236.392'), (1, '5292.964')] [2023-12-26 13:45:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001772976_453885952.pth... [2023-12-26 13:45:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001761024_450822144.pth... [2023-12-26 13:45:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001771984_453632000.pth [2023-12-26 13:45:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001760000_450560000.pth [2023-12-26 13:45:08,880][123090] Updated weights for policy 1, policy_version 1761026 (0.0006) [2023-12-26 13:45:08,940][123090] Updated weights for policy 1, policy_version 1761036 (0.0009) [2023-12-26 13:45:09,000][123090] Updated weights for policy 1, policy_version 1761046 (0.0009) [2023-12-26 13:45:09,068][123090] Updated weights for policy 1, policy_version 1761056 (0.0009) [2023-12-26 13:45:09,107][123091] Updated weights for policy 0, policy_version 1772984 (0.0010) [2023-12-26 13:45:09,158][123091] Updated weights for policy 0, policy_version 1772994 (0.0010) [2023-12-26 13:45:09,217][123091] Updated weights for policy 0, policy_version 1773004 (0.0013) [2023-12-26 13:45:09,929][123090] Updated weights for policy 1, policy_version 1761066 (0.0010) [2023-12-26 13:45:09,998][123090] Updated weights for policy 1, policy_version 1761076 (0.0009) [2023-12-26 13:45:10,066][123090] Updated weights for policy 1, policy_version 1761086 (0.0009) [2023-12-26 13:45:10,152][123091] Updated weights for policy 0, policy_version 1773014 (0.0011) [2023-12-26 13:45:10,211][123091] Updated weights for policy 0, policy_version 1773024 (0.0008) [2023-12-26 13:45:10,287][123091] Updated weights for policy 0, policy_version 1773034 (0.0008) [2023-12-26 13:45:10,934][123090] Updated weights for policy 1, policy_version 1761096 (0.0009) [2023-12-26 13:45:10,985][123090] Updated weights for policy 1, policy_version 1761106 (0.0010) [2023-12-26 13:45:11,046][123090] Updated weights for policy 1, policy_version 1761116 (0.0009) [2023-12-26 13:45:11,087][123091] Updated weights for policy 0, policy_version 1773044 (0.0010) [2023-12-26 13:45:11,156][123091] Updated weights for policy 0, policy_version 1773054 (0.0008) [2023-12-26 13:45:11,211][123091] Updated weights for policy 0, policy_version 1773064 (0.0008) [2023-12-26 13:45:11,952][123090] Updated weights for policy 1, policy_version 1761126 (0.0010) [2023-12-26 13:45:12,009][123090] Updated weights for policy 1, policy_version 1761136 (0.0010) [2023-12-26 13:45:12,038][123091] Updated weights for policy 0, policy_version 1773074 (0.0008) [2023-12-26 13:45:12,076][123090] Updated weights for policy 1, policy_version 1761146 (0.0008) [2023-12-26 13:45:12,097][123091] Updated weights for policy 0, policy_version 1773084 (0.0008) [2023-12-26 13:45:12,152][123091] Updated weights for policy 0, policy_version 1773094 (0.0008) [2023-12-26 13:45:12,219][123091] Updated weights for policy 0, policy_version 1773104 (0.0009) [2023-12-26 13:45:12,931][123090] Updated weights for policy 1, policy_version 1761156 (0.0009) [2023-12-26 13:45:12,992][123090] Updated weights for policy 1, policy_version 1761166 (0.0009) [2023-12-26 13:45:13,051][123091] Updated weights for policy 0, policy_version 1773114 (0.0010) [2023-12-26 13:45:13,057][123090] Updated weights for policy 1, policy_version 1761176 (0.0009) [2023-12-26 13:45:13,119][123091] Updated weights for policy 0, policy_version 1773124 (0.0006) [2023-12-26 13:45:13,189][123091] Updated weights for policy 0, policy_version 1773134 (0.0006) [2023-12-26 13:45:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17661.4). Total num frames: 904790016. Throughput: 0: 8624.2, 1: 8827.5. Samples: 904787640. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:13,784][121949] Avg episode reward: [(0, '6271.745'), (1, '5450.254')] [2023-12-26 13:45:13,895][123091] Updated weights for policy 0, policy_version 1773144 (0.0007) [2023-12-26 13:45:13,907][123090] Updated weights for policy 1, policy_version 1761186 (0.0009) [2023-12-26 13:45:13,960][123091] Updated weights for policy 0, policy_version 1773154 (0.0009) [2023-12-26 13:45:13,962][123090] Updated weights for policy 1, policy_version 1761196 (0.0008) [2023-12-26 13:45:14,021][123091] Updated weights for policy 0, policy_version 1773164 (0.0010) [2023-12-26 13:45:14,022][123090] Updated weights for policy 1, policy_version 1761206 (0.0009) [2023-12-26 13:45:14,075][123090] Updated weights for policy 1, policy_version 1761216 (0.0008) [2023-12-26 13:45:14,826][123091] Updated weights for policy 0, policy_version 1773174 (0.0009) [2023-12-26 13:45:14,893][123091] Updated weights for policy 0, policy_version 1773184 (0.0009) [2023-12-26 13:45:14,923][123090] Updated weights for policy 1, policy_version 1761226 (0.0009) [2023-12-26 13:45:14,961][123091] Updated weights for policy 0, policy_version 1773194 (0.0007) [2023-12-26 13:45:14,981][123090] Updated weights for policy 1, policy_version 1761236 (0.0009) [2023-12-26 13:45:15,038][123090] Updated weights for policy 1, policy_version 1761246 (0.0010) [2023-12-26 13:45:15,648][123091] Updated weights for policy 0, policy_version 1773204 (0.0007) [2023-12-26 13:45:15,699][123091] Updated weights for policy 0, policy_version 1773214 (0.0007) [2023-12-26 13:45:15,743][123091] Updated weights for policy 0, policy_version 1773224 (0.0010) [2023-12-26 13:45:15,974][123090] Updated weights for policy 1, policy_version 1761256 (0.0009) [2023-12-26 13:45:16,043][123090] Updated weights for policy 1, policy_version 1761266 (0.0010) [2023-12-26 13:45:16,106][123090] Updated weights for policy 1, policy_version 1761276 (0.0009) [2023-12-26 13:45:16,413][123091] Updated weights for policy 0, policy_version 1773234 (0.0010) [2023-12-26 13:45:16,464][123091] Updated weights for policy 0, policy_version 1773244 (0.0010) [2023-12-26 13:45:16,517][123091] Updated weights for policy 0, policy_version 1773254 (0.0011) [2023-12-26 13:45:16,583][123091] Updated weights for policy 0, policy_version 1773264 (0.0010) [2023-12-26 13:45:16,967][123090] Updated weights for policy 1, policy_version 1761286 (0.0007) [2023-12-26 13:45:17,045][123090] Updated weights for policy 1, policy_version 1761296 (0.0005) [2023-12-26 13:45:17,103][123090] Updated weights for policy 1, policy_version 1761306 (0.0005) [2023-12-26 13:45:17,331][123091] Updated weights for policy 0, policy_version 1773274 (0.0009) [2023-12-26 13:45:17,378][123091] Updated weights for policy 0, policy_version 1773284 (0.0010) [2023-12-26 13:45:17,425][123091] Updated weights for policy 0, policy_version 1773294 (0.0010) [2023-12-26 13:45:17,854][123090] Updated weights for policy 1, policy_version 1761316 (0.0007) [2023-12-26 13:45:17,915][123090] Updated weights for policy 1, policy_version 1761326 (0.0005) [2023-12-26 13:45:17,961][123090] Updated weights for policy 1, policy_version 1761336 (0.0005) [2023-12-26 13:45:18,132][123091] Updated weights for policy 0, policy_version 1773304 (0.0010) [2023-12-26 13:45:18,185][123091] Updated weights for policy 0, policy_version 1773314 (0.0010) [2023-12-26 13:45:18,244][123091] Updated weights for policy 0, policy_version 1773324 (0.0009) [2023-12-26 13:45:18,731][123090] Updated weights for policy 1, policy_version 1761346 (0.0006) [2023-12-26 13:45:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 904880128. Throughput: 0: 8681.0, 1: 8814.7. Samples: 904894300. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:18,785][121949] Avg episode reward: [(0, '6367.288'), (1, '5367.236')] [2023-12-26 13:45:18,792][123090] Updated weights for policy 1, policy_version 1761356 (0.0009) [2023-12-26 13:45:18,848][123090] Updated weights for policy 1, policy_version 1761366 (0.0009) [2023-12-26 13:45:18,908][123090] Updated weights for policy 1, policy_version 1761376 (0.0008) [2023-12-26 13:45:19,093][123091] Updated weights for policy 0, policy_version 1773334 (0.0010) [2023-12-26 13:45:19,155][123091] Updated weights for policy 0, policy_version 1773344 (0.0010) [2023-12-26 13:45:19,234][123091] Updated weights for policy 0, policy_version 1773354 (0.0010) [2023-12-26 13:45:19,776][123090] Updated weights for policy 1, policy_version 1761386 (0.0010) [2023-12-26 13:45:19,853][123090] Updated weights for policy 1, policy_version 1761396 (0.0009) [2023-12-26 13:45:19,916][123090] Updated weights for policy 1, policy_version 1761406 (0.0008) [2023-12-26 13:45:20,102][123091] Updated weights for policy 0, policy_version 1773364 (0.0008) [2023-12-26 13:45:20,171][123091] Updated weights for policy 0, policy_version 1773374 (0.0010) [2023-12-26 13:45:20,240][123091] Updated weights for policy 0, policy_version 1773384 (0.0009) [2023-12-26 13:45:20,726][123090] Updated weights for policy 1, policy_version 1761416 (0.0010) [2023-12-26 13:45:20,789][123090] Updated weights for policy 1, policy_version 1761426 (0.0010) [2023-12-26 13:45:20,862][123090] Updated weights for policy 1, policy_version 1761436 (0.0009) [2023-12-26 13:45:21,095][123091] Updated weights for policy 0, policy_version 1773394 (0.0010) [2023-12-26 13:45:21,160][123091] Updated weights for policy 0, policy_version 1773404 (0.0010) [2023-12-26 13:45:21,218][123091] Updated weights for policy 0, policy_version 1773414 (0.0008) [2023-12-26 13:45:21,281][123091] Updated weights for policy 0, policy_version 1773424 (0.0007) [2023-12-26 13:45:21,724][123090] Updated weights for policy 1, policy_version 1761446 (0.0009) [2023-12-26 13:45:21,793][123090] Updated weights for policy 1, policy_version 1761456 (0.0010) [2023-12-26 13:45:21,849][123090] Updated weights for policy 1, policy_version 1761466 (0.0009) [2023-12-26 13:45:22,152][123091] Updated weights for policy 0, policy_version 1773434 (0.0009) [2023-12-26 13:45:22,202][123091] Updated weights for policy 0, policy_version 1773445 (0.0010) [2023-12-26 13:45:22,265][123091] Updated weights for policy 0, policy_version 1773455 (0.0009) [2023-12-26 13:45:22,697][123090] Updated weights for policy 1, policy_version 1761476 (0.0010) [2023-12-26 13:45:22,759][123090] Updated weights for policy 1, policy_version 1761486 (0.0009) [2023-12-26 13:45:22,816][123090] Updated weights for policy 1, policy_version 1761496 (0.0009) [2023-12-26 13:45:23,121][123091] Updated weights for policy 0, policy_version 1773465 (0.0010) [2023-12-26 13:45:23,181][123091] Updated weights for policy 0, policy_version 1773475 (0.0009) [2023-12-26 13:45:23,248][123091] Updated weights for policy 0, policy_version 1773485 (0.0009) [2023-12-26 13:45:23,659][123090] Updated weights for policy 1, policy_version 1761506 (0.0009) [2023-12-26 13:45:23,720][123090] Updated weights for policy 1, policy_version 1761516 (0.0009) [2023-12-26 13:45:23,776][123090] Updated weights for policy 1, policy_version 1761526 (0.0008) [2023-12-26 13:45:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 904962048. Throughput: 0: 8674.8, 1: 8775.9. Samples: 904944024. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:23,785][121949] Avg episode reward: [(0, '6355.610'), (1, '5575.503')] [2023-12-26 13:45:23,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001773488_454017024.pth... [2023-12-26 13:45:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001772464_453754880.pth [2023-12-26 13:45:23,837][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001761536_450953216.pth... [2023-12-26 13:45:23,838][123090] Updated weights for policy 1, policy_version 1761536 (0.0008) [2023-12-26 13:45:23,841][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001760512_450691072.pth [2023-12-26 13:45:24,052][123091] Updated weights for policy 0, policy_version 1773495 (0.0009) [2023-12-26 13:45:24,118][123091] Updated weights for policy 0, policy_version 1773505 (0.0010) [2023-12-26 13:45:24,176][123091] Updated weights for policy 0, policy_version 1773515 (0.0009) [2023-12-26 13:45:24,676][123090] Updated weights for policy 1, policy_version 1761546 (0.0010) [2023-12-26 13:45:24,741][123090] Updated weights for policy 1, policy_version 1761556 (0.0010) [2023-12-26 13:45:24,804][123090] Updated weights for policy 1, policy_version 1761566 (0.0010) [2023-12-26 13:45:24,923][123091] Updated weights for policy 0, policy_version 1773525 (0.0007) [2023-12-26 13:45:24,978][123091] Updated weights for policy 0, policy_version 1773535 (0.0005) [2023-12-26 13:45:25,031][123091] Updated weights for policy 0, policy_version 1773545 (0.0005) [2023-12-26 13:45:25,692][123090] Updated weights for policy 1, policy_version 1761576 (0.0009) [2023-12-26 13:45:25,702][123091] Updated weights for policy 0, policy_version 1773555 (0.0007) [2023-12-26 13:45:25,752][123091] Updated weights for policy 0, policy_version 1773565 (0.0009) [2023-12-26 13:45:25,755][123090] Updated weights for policy 1, policy_version 1761586 (0.0008) [2023-12-26 13:45:25,808][123090] Updated weights for policy 1, policy_version 1761596 (0.0008) [2023-12-26 13:45:25,817][123091] Updated weights for policy 0, policy_version 1773575 (0.0008) [2023-12-26 13:45:26,619][123090] Updated weights for policy 1, policy_version 1761606 (0.0006) [2023-12-26 13:45:26,663][123091] Updated weights for policy 0, policy_version 1773585 (0.0010) [2023-12-26 13:45:26,671][123090] Updated weights for policy 1, policy_version 1761616 (0.0005) [2023-12-26 13:45:26,715][123091] Updated weights for policy 0, policy_version 1773595 (0.0007) [2023-12-26 13:45:26,730][123090] Updated weights for policy 1, policy_version 1761626 (0.0008) [2023-12-26 13:45:26,769][123091] Updated weights for policy 0, policy_version 1773605 (0.0005) [2023-12-26 13:45:26,838][123091] Updated weights for policy 0, policy_version 1773615 (0.0009) [2023-12-26 13:45:27,516][123090] Updated weights for policy 1, policy_version 1761636 (0.0009) [2023-12-26 13:45:27,567][123090] Updated weights for policy 1, policy_version 1761646 (0.0008) [2023-12-26 13:45:27,613][123090] Updated weights for policy 1, policy_version 1761656 (0.0008) [2023-12-26 13:45:27,639][123091] Updated weights for policy 0, policy_version 1773625 (0.0009) [2023-12-26 13:45:27,696][123091] Updated weights for policy 0, policy_version 1773635 (0.0010) [2023-12-26 13:45:27,753][123091] Updated weights for policy 0, policy_version 1773645 (0.0010) [2023-12-26 13:45:28,344][123090] Updated weights for policy 1, policy_version 1761666 (0.0008) [2023-12-26 13:45:28,408][123090] Updated weights for policy 1, policy_version 1761676 (0.0009) [2023-12-26 13:45:28,475][123090] Updated weights for policy 1, policy_version 1761686 (0.0008) [2023-12-26 13:45:28,542][123090] Updated weights for policy 1, policy_version 1761696 (0.0010) [2023-12-26 13:45:28,624][123091] Updated weights for policy 0, policy_version 1773655 (0.0010) [2023-12-26 13:45:28,691][123091] Updated weights for policy 0, policy_version 1773665 (0.0009) [2023-12-26 13:45:28,751][123091] Updated weights for policy 0, policy_version 1773675 (0.0010) [2023-12-26 13:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 905060352. Throughput: 0: 8761.6, 1: 8747.1. Samples: 905047644. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:28,785][121949] Avg episode reward: [(0, '6337.441'), (1, '5499.353')] [2023-12-26 13:45:29,396][123090] Updated weights for policy 1, policy_version 1761706 (0.0010) [2023-12-26 13:45:29,452][123090] Updated weights for policy 1, policy_version 1761716 (0.0009) [2023-12-26 13:45:29,503][123090] Updated weights for policy 1, policy_version 1761726 (0.0009) [2023-12-26 13:45:29,595][123091] Updated weights for policy 0, policy_version 1773685 (0.0009) [2023-12-26 13:45:29,649][123091] Updated weights for policy 0, policy_version 1773695 (0.0008) [2023-12-26 13:45:29,714][123091] Updated weights for policy 0, policy_version 1773705 (0.0008) [2023-12-26 13:45:30,382][123090] Updated weights for policy 1, policy_version 1761736 (0.0009) [2023-12-26 13:45:30,452][123090] Updated weights for policy 1, policy_version 1761746 (0.0009) [2023-12-26 13:45:30,485][123091] Updated weights for policy 0, policy_version 1773715 (0.0008) [2023-12-26 13:45:30,505][123090] Updated weights for policy 1, policy_version 1761756 (0.0009) [2023-12-26 13:45:30,538][123091] Updated weights for policy 0, policy_version 1773725 (0.0011) [2023-12-26 13:45:30,603][123091] Updated weights for policy 0, policy_version 1773735 (0.0011) [2023-12-26 13:45:31,331][123091] Updated weights for policy 0, policy_version 1773745 (0.0009) [2023-12-26 13:45:31,400][123091] Updated weights for policy 0, policy_version 1773755 (0.0010) [2023-12-26 13:45:31,400][123090] Updated weights for policy 1, policy_version 1761766 (0.0006) [2023-12-26 13:45:31,463][123090] Updated weights for policy 1, policy_version 1761776 (0.0007) [2023-12-26 13:45:31,468][123091] Updated weights for policy 0, policy_version 1773765 (0.0011) [2023-12-26 13:45:31,520][123090] Updated weights for policy 1, policy_version 1761786 (0.0007) [2023-12-26 13:45:31,528][123091] Updated weights for policy 0, policy_version 1773775 (0.0010) [2023-12-26 13:45:32,359][123091] Updated weights for policy 0, policy_version 1773785 (0.0011) [2023-12-26 13:45:32,362][123090] Updated weights for policy 1, policy_version 1761796 (0.0006) [2023-12-26 13:45:32,427][123091] Updated weights for policy 0, policy_version 1773795 (0.0011) [2023-12-26 13:45:32,438][123090] Updated weights for policy 1, policy_version 1761806 (0.0007) [2023-12-26 13:45:32,483][123091] Updated weights for policy 0, policy_version 1773805 (0.0011) [2023-12-26 13:45:32,503][123090] Updated weights for policy 1, policy_version 1761816 (0.0006) [2023-12-26 13:45:33,281][123091] Updated weights for policy 0, policy_version 1773815 (0.0010) [2023-12-26 13:45:33,335][123091] Updated weights for policy 0, policy_version 1773825 (0.0010) [2023-12-26 13:45:33,357][123090] Updated weights for policy 1, policy_version 1761826 (0.0009) [2023-12-26 13:45:33,386][123091] Updated weights for policy 0, policy_version 1773835 (0.0010) [2023-12-26 13:45:33,402][123090] Updated weights for policy 1, policy_version 1761836 (0.0005) [2023-12-26 13:45:33,457][123090] Updated weights for policy 1, policy_version 1761846 (0.0008) [2023-12-26 13:45:33,517][123090] Updated weights for policy 1, policy_version 1761856 (0.0008) [2023-12-26 13:45:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 905142272. Throughput: 0: 8775.4, 1: 8687.0. Samples: 905149800. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:33,786][121949] Avg episode reward: [(0, '6216.771'), (1, '5456.625')] [2023-12-26 13:45:34,198][123091] Updated weights for policy 0, policy_version 1773845 (0.0009) [2023-12-26 13:45:34,271][123091] Updated weights for policy 0, policy_version 1773855 (0.0009) [2023-12-26 13:45:34,330][123091] Updated weights for policy 0, policy_version 1773865 (0.0009) [2023-12-26 13:45:34,446][123090] Updated weights for policy 1, policy_version 1761866 (0.0008) [2023-12-26 13:45:34,512][123090] Updated weights for policy 1, policy_version 1761876 (0.0008) [2023-12-26 13:45:34,582][123090] Updated weights for policy 1, policy_version 1761886 (0.0008) [2023-12-26 13:45:35,097][123091] Updated weights for policy 0, policy_version 1773875 (0.0009) [2023-12-26 13:45:35,167][123091] Updated weights for policy 0, policy_version 1773885 (0.0009) [2023-12-26 13:45:35,229][123091] Updated weights for policy 0, policy_version 1773895 (0.0009) [2023-12-26 13:45:35,460][123090] Updated weights for policy 1, policy_version 1761896 (0.0010) [2023-12-26 13:45:35,524][123090] Updated weights for policy 1, policy_version 1761906 (0.0011) [2023-12-26 13:45:35,581][123090] Updated weights for policy 1, policy_version 1761916 (0.0011) [2023-12-26 13:45:36,093][123091] Updated weights for policy 0, policy_version 1773905 (0.0009) [2023-12-26 13:45:36,167][123091] Updated weights for policy 0, policy_version 1773915 (0.0009) [2023-12-26 13:45:36,232][123091] Updated weights for policy 0, policy_version 1773925 (0.0009) [2023-12-26 13:45:36,294][123091] Updated weights for policy 0, policy_version 1773935 (0.0009) [2023-12-26 13:45:36,419][123090] Updated weights for policy 1, policy_version 1761926 (0.0011) [2023-12-26 13:45:36,479][123090] Updated weights for policy 1, policy_version 1761936 (0.0010) [2023-12-26 13:45:36,554][123090] Updated weights for policy 1, policy_version 1761946 (0.0011) [2023-12-26 13:45:37,127][123091] Updated weights for policy 0, policy_version 1773945 (0.0006) [2023-12-26 13:45:37,199][123091] Updated weights for policy 0, policy_version 1773955 (0.0007) [2023-12-26 13:45:37,251][123091] Updated weights for policy 0, policy_version 1773965 (0.0006) [2023-12-26 13:45:37,364][123090] Updated weights for policy 1, policy_version 1761956 (0.0009) [2023-12-26 13:45:37,435][123090] Updated weights for policy 1, policy_version 1761966 (0.0008) [2023-12-26 13:45:37,509][123090] Updated weights for policy 1, policy_version 1761976 (0.0010) [2023-12-26 13:45:37,993][123091] Updated weights for policy 0, policy_version 1773975 (0.0009) [2023-12-26 13:45:38,045][123091] Updated weights for policy 0, policy_version 1773985 (0.0010) [2023-12-26 13:45:38,094][123091] Updated weights for policy 0, policy_version 1773995 (0.0010) [2023-12-26 13:45:38,240][123090] Updated weights for policy 1, policy_version 1761986 (0.0010) [2023-12-26 13:45:38,294][123090] Updated weights for policy 1, policy_version 1761996 (0.0005) [2023-12-26 13:45:38,372][123090] Updated weights for policy 1, policy_version 1762006 (0.0008) [2023-12-26 13:45:38,433][123090] Updated weights for policy 1, policy_version 1762016 (0.0006) [2023-12-26 13:45:38,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 905224192. Throughput: 0: 8793.0, 1: 8648.4. Samples: 905200324. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:38,785][121949] Avg episode reward: [(0, '6168.003'), (1, '5361.389')] [2023-12-26 13:45:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001774000_454148096.pth... [2023-12-26 13:45:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001762016_451076096.pth... [2023-12-26 13:45:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001772976_453885952.pth [2023-12-26 13:45:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001761024_450822144.pth [2023-12-26 13:45:38,950][123091] Updated weights for policy 0, policy_version 1774005 (0.0010) [2023-12-26 13:45:39,015][123091] Updated weights for policy 0, policy_version 1774015 (0.0011) [2023-12-26 13:45:39,077][123091] Updated weights for policy 0, policy_version 1774025 (0.0010) [2023-12-26 13:45:39,172][123090] Updated weights for policy 1, policy_version 1762026 (0.0008) [2023-12-26 13:45:39,227][123090] Updated weights for policy 1, policy_version 1762036 (0.0009) [2023-12-26 13:45:39,292][123090] Updated weights for policy 1, policy_version 1762046 (0.0009) [2023-12-26 13:45:39,897][123091] Updated weights for policy 0, policy_version 1774035 (0.0010) [2023-12-26 13:45:39,966][123091] Updated weights for policy 0, policy_version 1774045 (0.0011) [2023-12-26 13:45:40,018][123091] Updated weights for policy 0, policy_version 1774055 (0.0010) [2023-12-26 13:45:40,126][123090] Updated weights for policy 1, policy_version 1762056 (0.0006) [2023-12-26 13:45:40,199][123090] Updated weights for policy 1, policy_version 1762066 (0.0005) [2023-12-26 13:45:40,262][123090] Updated weights for policy 1, policy_version 1762076 (0.0008) [2023-12-26 13:45:40,814][123091] Updated weights for policy 0, policy_version 1774065 (0.0010) [2023-12-26 13:45:40,880][123091] Updated weights for policy 0, policy_version 1774075 (0.0006) [2023-12-26 13:45:40,941][123090] Updated weights for policy 1, policy_version 1762086 (0.0008) [2023-12-26 13:45:40,942][123091] Updated weights for policy 0, policy_version 1774085 (0.0008) [2023-12-26 13:45:41,010][123090] Updated weights for policy 1, policy_version 1762096 (0.0006) [2023-12-26 13:45:41,012][123091] Updated weights for policy 0, policy_version 1774095 (0.0010) [2023-12-26 13:45:41,080][123090] Updated weights for policy 1, policy_version 1762106 (0.0009) [2023-12-26 13:45:41,847][123091] Updated weights for policy 0, policy_version 1774105 (0.0010) [2023-12-26 13:45:41,902][123091] Updated weights for policy 0, policy_version 1774115 (0.0010) [2023-12-26 13:45:41,946][123090] Updated weights for policy 1, policy_version 1762116 (0.0009) [2023-12-26 13:45:41,958][123091] Updated weights for policy 0, policy_version 1774125 (0.0008) [2023-12-26 13:45:41,997][123090] Updated weights for policy 1, policy_version 1762126 (0.0009) [2023-12-26 13:45:42,052][123090] Updated weights for policy 1, policy_version 1762136 (0.0010) [2023-12-26 13:45:42,828][123091] Updated weights for policy 0, policy_version 1774135 (0.0006) [2023-12-26 13:45:42,896][123091] Updated weights for policy 0, policy_version 1774145 (0.0006) [2023-12-26 13:45:42,954][123091] Updated weights for policy 0, policy_version 1774155 (0.0006) [2023-12-26 13:45:42,956][123090] Updated weights for policy 1, policy_version 1762146 (0.0009) [2023-12-26 13:45:43,019][123090] Updated weights for policy 1, policy_version 1762156 (0.0010) [2023-12-26 13:45:43,089][123090] Updated weights for policy 1, policy_version 1762166 (0.0010) [2023-12-26 13:45:43,146][123090] Updated weights for policy 1, policy_version 1762176 (0.0010) [2023-12-26 13:45:43,607][123091] Updated weights for policy 0, policy_version 1774165 (0.0007) [2023-12-26 13:45:43,662][123091] Updated weights for policy 0, policy_version 1774175 (0.0010) [2023-12-26 13:45:43,710][123091] Updated weights for policy 0, policy_version 1774185 (0.0010) [2023-12-26 13:45:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 905314304. Throughput: 0: 8703.5, 1: 8541.2. Samples: 905304484. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:43,785][121949] Avg episode reward: [(0, '6238.104'), (1, '5242.369')] [2023-12-26 13:45:44,031][123090] Updated weights for policy 1, policy_version 1762186 (0.0009) [2023-12-26 13:45:44,087][123090] Updated weights for policy 1, policy_version 1762196 (0.0009) [2023-12-26 13:45:44,147][123090] Updated weights for policy 1, policy_version 1762206 (0.0009) [2023-12-26 13:45:44,451][123091] Updated weights for policy 0, policy_version 1774195 (0.0010) [2023-12-26 13:45:44,513][123091] Updated weights for policy 0, policy_version 1774205 (0.0008) [2023-12-26 13:45:44,583][123091] Updated weights for policy 0, policy_version 1774215 (0.0005) [2023-12-26 13:45:45,061][123090] Updated weights for policy 1, policy_version 1762216 (0.0009) [2023-12-26 13:45:45,133][123090] Updated weights for policy 1, policy_version 1762226 (0.0009) [2023-12-26 13:45:45,202][123090] Updated weights for policy 1, policy_version 1762236 (0.0009) [2023-12-26 13:45:45,384][123091] Updated weights for policy 0, policy_version 1774225 (0.0009) [2023-12-26 13:45:45,451][123091] Updated weights for policy 0, policy_version 1774235 (0.0011) [2023-12-26 13:45:45,515][123091] Updated weights for policy 0, policy_version 1774245 (0.0011) [2023-12-26 13:45:45,582][123091] Updated weights for policy 0, policy_version 1774255 (0.0011) [2023-12-26 13:45:46,022][123090] Updated weights for policy 1, policy_version 1762246 (0.0009) [2023-12-26 13:45:46,082][123090] Updated weights for policy 1, policy_version 1762256 (0.0009) [2023-12-26 13:45:46,138][123090] Updated weights for policy 1, policy_version 1762266 (0.0008) [2023-12-26 13:45:46,388][123091] Updated weights for policy 0, policy_version 1774265 (0.0011) [2023-12-26 13:45:46,444][123091] Updated weights for policy 0, policy_version 1774275 (0.0011) [2023-12-26 13:45:46,503][123091] Updated weights for policy 0, policy_version 1774285 (0.0011) [2023-12-26 13:45:46,991][123090] Updated weights for policy 1, policy_version 1762276 (0.0010) [2023-12-26 13:45:47,042][123090] Updated weights for policy 1, policy_version 1762286 (0.0009) [2023-12-26 13:45:47,094][123090] Updated weights for policy 1, policy_version 1762296 (0.0005) [2023-12-26 13:45:47,282][123091] Updated weights for policy 0, policy_version 1774295 (0.0007) [2023-12-26 13:45:47,338][123091] Updated weights for policy 0, policy_version 1774305 (0.0005) [2023-12-26 13:45:47,390][123091] Updated weights for policy 0, policy_version 1774315 (0.0005) [2023-12-26 13:45:47,797][123090] Updated weights for policy 1, policy_version 1762306 (0.0005) [2023-12-26 13:45:47,849][123090] Updated weights for policy 1, policy_version 1762316 (0.0006) [2023-12-26 13:45:47,895][123090] Updated weights for policy 1, policy_version 1762326 (0.0005) [2023-12-26 13:45:47,947][123090] Updated weights for policy 1, policy_version 1762336 (0.0005) [2023-12-26 13:45:48,194][123091] Updated weights for policy 0, policy_version 1774325 (0.0011) [2023-12-26 13:45:48,263][123091] Updated weights for policy 0, policy_version 1774335 (0.0010) [2023-12-26 13:45:48,318][123091] Updated weights for policy 0, policy_version 1774345 (0.0010) [2023-12-26 13:45:48,678][123090] Updated weights for policy 1, policy_version 1762346 (0.0006) [2023-12-26 13:45:48,738][123090] Updated weights for policy 1, policy_version 1762356 (0.0006) [2023-12-26 13:45:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 905396224. Throughput: 0: 8774.8, 1: 8525.7. Samples: 905411488. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:48,785][121949] Avg episode reward: [(0, '6255.952'), (1, '5490.091')] [2023-12-26 13:45:48,799][123090] Updated weights for policy 1, policy_version 1762366 (0.0006) [2023-12-26 13:45:49,160][123091] Updated weights for policy 0, policy_version 1774355 (0.0010) [2023-12-26 13:45:49,223][123091] Updated weights for policy 0, policy_version 1774365 (0.0007) [2023-12-26 13:45:49,294][123091] Updated weights for policy 0, policy_version 1774375 (0.0010) [2023-12-26 13:45:49,556][123090] Updated weights for policy 1, policy_version 1762376 (0.0007) [2023-12-26 13:45:49,624][123090] Updated weights for policy 1, policy_version 1762386 (0.0008) [2023-12-26 13:45:49,698][123090] Updated weights for policy 1, policy_version 1762396 (0.0008) [2023-12-26 13:45:50,047][123091] Updated weights for policy 0, policy_version 1774385 (0.0009) [2023-12-26 13:45:50,116][123091] Updated weights for policy 0, policy_version 1774395 (0.0008) [2023-12-26 13:45:50,184][123091] Updated weights for policy 0, policy_version 1774406 (0.0008) [2023-12-26 13:45:50,257][123091] Updated weights for policy 0, policy_version 1774416 (0.0008) [2023-12-26 13:45:50,452][123090] Updated weights for policy 1, policy_version 1762406 (0.0007) [2023-12-26 13:45:50,504][123090] Updated weights for policy 1, policy_version 1762416 (0.0008) [2023-12-26 13:45:50,564][123090] Updated weights for policy 1, policy_version 1762426 (0.0009) [2023-12-26 13:45:50,957][123091] Updated weights for policy 0, policy_version 1774426 (0.0008) [2023-12-26 13:45:51,022][123091] Updated weights for policy 0, policy_version 1774436 (0.0010) [2023-12-26 13:45:51,089][123091] Updated weights for policy 0, policy_version 1774446 (0.0010) [2023-12-26 13:45:51,356][123090] Updated weights for policy 1, policy_version 1762436 (0.0009) [2023-12-26 13:45:51,433][123090] Updated weights for policy 1, policy_version 1762446 (0.0009) [2023-12-26 13:45:51,504][123090] Updated weights for policy 1, policy_version 1762456 (0.0011) [2023-12-26 13:45:51,897][123091] Updated weights for policy 0, policy_version 1774456 (0.0009) [2023-12-26 13:45:51,960][123091] Updated weights for policy 0, policy_version 1774466 (0.0007) [2023-12-26 13:45:52,038][123091] Updated weights for policy 0, policy_version 1774476 (0.0005) [2023-12-26 13:45:52,301][123090] Updated weights for policy 1, policy_version 1762466 (0.0011) [2023-12-26 13:45:52,373][123090] Updated weights for policy 1, policy_version 1762476 (0.0011) [2023-12-26 13:45:52,425][123090] Updated weights for policy 1, policy_version 1762486 (0.0010) [2023-12-26 13:45:52,489][123090] Updated weights for policy 1, policy_version 1762496 (0.0010) [2023-12-26 13:45:52,698][123091] Updated weights for policy 0, policy_version 1774486 (0.0006) [2023-12-26 13:45:52,746][123091] Updated weights for policy 0, policy_version 1774496 (0.0006) [2023-12-26 13:45:52,804][123091] Updated weights for policy 0, policy_version 1774506 (0.0005) [2023-12-26 13:45:53,286][123090] Updated weights for policy 1, policy_version 1762506 (0.0005) [2023-12-26 13:45:53,344][123090] Updated weights for policy 1, policy_version 1762516 (0.0005) [2023-12-26 13:45:53,410][123090] Updated weights for policy 1, policy_version 1762526 (0.0005) [2023-12-26 13:45:53,640][123091] Updated weights for policy 0, policy_version 1774516 (0.0009) [2023-12-26 13:45:53,700][123091] Updated weights for policy 0, policy_version 1774526 (0.0009) [2023-12-26 13:45:53,749][123091] Updated weights for policy 0, policy_version 1774536 (0.0009) [2023-12-26 13:45:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17606.0). Total num frames: 905486336. Throughput: 0: 8798.8, 1: 8519.6. Samples: 905466032. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:53,785][121949] Avg episode reward: [(0, '6396.371'), (1, '5498.376')] [2023-12-26 13:45:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001762528_451207168.pth... [2023-12-26 13:45:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001774544_454287360.pth... [2023-12-26 13:45:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001773488_454017024.pth [2023-12-26 13:45:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001761536_450953216.pth [2023-12-26 13:45:54,121][123090] Updated weights for policy 1, policy_version 1762536 (0.0005) [2023-12-26 13:45:54,180][123090] Updated weights for policy 1, policy_version 1762546 (0.0006) [2023-12-26 13:45:54,247][123090] Updated weights for policy 1, policy_version 1762556 (0.0006) [2023-12-26 13:45:54,650][123091] Updated weights for policy 0, policy_version 1774546 (0.0010) [2023-12-26 13:45:54,699][123091] Updated weights for policy 0, policy_version 1774556 (0.0009) [2023-12-26 13:45:54,749][123091] Updated weights for policy 0, policy_version 1774566 (0.0009) [2023-12-26 13:45:54,795][123091] Updated weights for policy 0, policy_version 1774576 (0.0009) [2023-12-26 13:45:54,965][123090] Updated weights for policy 1, policy_version 1762566 (0.0007) [2023-12-26 13:45:55,021][123090] Updated weights for policy 1, policy_version 1762576 (0.0009) [2023-12-26 13:45:55,075][123090] Updated weights for policy 1, policy_version 1762586 (0.0010) [2023-12-26 13:45:55,660][123091] Updated weights for policy 0, policy_version 1774586 (0.0009) [2023-12-26 13:45:55,723][123091] Updated weights for policy 0, policy_version 1774597 (0.0010) [2023-12-26 13:45:55,771][123091] Updated weights for policy 0, policy_version 1774607 (0.0009) [2023-12-26 13:45:55,900][123090] Updated weights for policy 1, policy_version 1762596 (0.0010) [2023-12-26 13:45:55,970][123090] Updated weights for policy 1, policy_version 1762606 (0.0010) [2023-12-26 13:45:56,041][123090] Updated weights for policy 1, policy_version 1762616 (0.0010) [2023-12-26 13:45:56,517][123091] Updated weights for policy 0, policy_version 1774617 (0.0006) [2023-12-26 13:45:56,577][123091] Updated weights for policy 0, policy_version 1774627 (0.0010) [2023-12-26 13:45:56,640][123091] Updated weights for policy 0, policy_version 1774637 (0.0009) [2023-12-26 13:45:56,864][123090] Updated weights for policy 1, policy_version 1762626 (0.0009) [2023-12-26 13:45:56,919][123090] Updated weights for policy 1, policy_version 1762636 (0.0010) [2023-12-26 13:45:56,972][123090] Updated weights for policy 1, policy_version 1762646 (0.0010) [2023-12-26 13:45:57,027][123090] Updated weights for policy 1, policy_version 1762656 (0.0008) [2023-12-26 13:45:57,381][123091] Updated weights for policy 0, policy_version 1774647 (0.0007) [2023-12-26 13:45:57,436][123091] Updated weights for policy 0, policy_version 1774657 (0.0005) [2023-12-26 13:45:57,492][123091] Updated weights for policy 0, policy_version 1774667 (0.0005) [2023-12-26 13:45:57,768][123090] Updated weights for policy 1, policy_version 1762666 (0.0005) [2023-12-26 13:45:57,818][123090] Updated weights for policy 1, policy_version 1762676 (0.0005) [2023-12-26 13:45:57,869][123090] Updated weights for policy 1, policy_version 1762686 (0.0006) [2023-12-26 13:45:58,192][123091] Updated weights for policy 0, policy_version 1774677 (0.0007) [2023-12-26 13:45:58,251][123091] Updated weights for policy 0, policy_version 1774687 (0.0008) [2023-12-26 13:45:58,319][123091] Updated weights for policy 0, policy_version 1774697 (0.0007) [2023-12-26 13:45:58,571][123090] Updated weights for policy 1, policy_version 1762696 (0.0009) [2023-12-26 13:45:58,635][123090] Updated weights for policy 1, policy_version 1762706 (0.0009) [2023-12-26 13:45:58,698][123090] Updated weights for policy 1, policy_version 1762716 (0.0010) [2023-12-26 13:45:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 905584640. Throughput: 0: 8884.4, 1: 8605.1. Samples: 905574672. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:45:58,785][121949] Avg episode reward: [(0, '6422.149'), (1, '5657.042')] [2023-12-26 13:45:59,195][123091] Updated weights for policy 0, policy_version 1774707 (0.0008) [2023-12-26 13:45:59,264][123091] Updated weights for policy 0, policy_version 1774717 (0.0010) [2023-12-26 13:45:59,317][123091] Updated weights for policy 0, policy_version 1774727 (0.0009) [2023-12-26 13:45:59,378][123090] Updated weights for policy 1, policy_version 1762726 (0.0010) [2023-12-26 13:45:59,436][123090] Updated weights for policy 1, policy_version 1762736 (0.0010) [2023-12-26 13:45:59,486][123090] Updated weights for policy 1, policy_version 1762746 (0.0009) [2023-12-26 13:46:00,127][123091] Updated weights for policy 0, policy_version 1774737 (0.0009) [2023-12-26 13:46:00,193][123091] Updated weights for policy 0, policy_version 1774747 (0.0010) [2023-12-26 13:46:00,251][123091] Updated weights for policy 0, policy_version 1774757 (0.0011) [2023-12-26 13:46:00,302][123091] Updated weights for policy 0, policy_version 1774767 (0.0011) [2023-12-26 13:46:00,385][123090] Updated weights for policy 1, policy_version 1762756 (0.0008) [2023-12-26 13:46:00,445][123090] Updated weights for policy 1, policy_version 1762766 (0.0005) [2023-12-26 13:46:00,494][123090] Updated weights for policy 1, policy_version 1762776 (0.0005) [2023-12-26 13:46:01,040][123091] Updated weights for policy 0, policy_version 1774777 (0.0008) [2023-12-26 13:46:01,098][123091] Updated weights for policy 0, policy_version 1774787 (0.0011) [2023-12-26 13:46:01,147][123090] Updated weights for policy 1, policy_version 1762786 (0.0006) [2023-12-26 13:46:01,154][123091] Updated weights for policy 0, policy_version 1774797 (0.0011) [2023-12-26 13:46:01,209][123090] Updated weights for policy 1, policy_version 1762796 (0.0008) [2023-12-26 13:46:01,270][123090] Updated weights for policy 1, policy_version 1762806 (0.0009) [2023-12-26 13:46:01,341][123090] Updated weights for policy 1, policy_version 1762816 (0.0009) [2023-12-26 13:46:01,892][123091] Updated weights for policy 0, policy_version 1774807 (0.0009) [2023-12-26 13:46:01,946][123091] Updated weights for policy 0, policy_version 1774817 (0.0009) [2023-12-26 13:46:01,999][123091] Updated weights for policy 0, policy_version 1774827 (0.0009) [2023-12-26 13:46:02,233][123090] Updated weights for policy 1, policy_version 1762826 (0.0009) [2023-12-26 13:46:02,301][123090] Updated weights for policy 1, policy_version 1762836 (0.0009) [2023-12-26 13:46:02,361][123090] Updated weights for policy 1, policy_version 1762846 (0.0008) [2023-12-26 13:46:02,869][123091] Updated weights for policy 0, policy_version 1774837 (0.0010) [2023-12-26 13:46:02,940][123091] Updated weights for policy 0, policy_version 1774847 (0.0011) [2023-12-26 13:46:03,000][123091] Updated weights for policy 0, policy_version 1774857 (0.0011) [2023-12-26 13:46:03,189][123090] Updated weights for policy 1, policy_version 1762856 (0.0009) [2023-12-26 13:46:03,243][123090] Updated weights for policy 1, policy_version 1762866 (0.0009) [2023-12-26 13:46:03,293][123090] Updated weights for policy 1, policy_version 1762876 (0.0009) [2023-12-26 13:46:03,654][123091] Updated weights for policy 0, policy_version 1774867 (0.0009) [2023-12-26 13:46:03,708][123091] Updated weights for policy 0, policy_version 1774877 (0.0005) [2023-12-26 13:46:03,782][123091] Updated weights for policy 0, policy_version 1774887 (0.0005) [2023-12-26 13:46:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17605.9). Total num frames: 905666560. Throughput: 0: 8827.0, 1: 8651.9. Samples: 905680852. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:46:03,785][121949] Avg episode reward: [(0, '6298.665'), (1, '5668.909')] [2023-12-26 13:46:04,195][123090] Updated weights for policy 1, policy_version 1762886 (0.0010) [2023-12-26 13:46:04,249][123090] Updated weights for policy 1, policy_version 1762896 (0.0010) [2023-12-26 13:46:04,311][123090] Updated weights for policy 1, policy_version 1762906 (0.0009) [2023-12-26 13:46:04,473][123091] Updated weights for policy 0, policy_version 1774897 (0.0009) [2023-12-26 13:46:04,535][123091] Updated weights for policy 0, policy_version 1774907 (0.0009) [2023-12-26 13:46:04,602][123091] Updated weights for policy 0, policy_version 1774917 (0.0008) [2023-12-26 13:46:04,669][123091] Updated weights for policy 0, policy_version 1774927 (0.0009) [2023-12-26 13:46:05,191][123090] Updated weights for policy 1, policy_version 1762916 (0.0009) [2023-12-26 13:46:05,244][123090] Updated weights for policy 1, policy_version 1762926 (0.0009) [2023-12-26 13:46:05,307][123090] Updated weights for policy 1, policy_version 1762936 (0.0009) [2023-12-26 13:46:05,475][123091] Updated weights for policy 0, policy_version 1774937 (0.0010) [2023-12-26 13:46:05,538][123091] Updated weights for policy 0, policy_version 1774947 (0.0011) [2023-12-26 13:46:05,606][123091] Updated weights for policy 0, policy_version 1774957 (0.0011) [2023-12-26 13:46:06,205][123090] Updated weights for policy 1, policy_version 1762946 (0.0010) [2023-12-26 13:46:06,258][123090] Updated weights for policy 1, policy_version 1762956 (0.0010) [2023-12-26 13:46:06,313][123090] Updated weights for policy 1, policy_version 1762966 (0.0010) [2023-12-26 13:46:06,370][123090] Updated weights for policy 1, policy_version 1762976 (0.0009) [2023-12-26 13:46:06,426][123091] Updated weights for policy 0, policy_version 1774967 (0.0009) [2023-12-26 13:46:06,491][123091] Updated weights for policy 0, policy_version 1774977 (0.0009) [2023-12-26 13:46:06,548][123091] Updated weights for policy 0, policy_version 1774987 (0.0009) [2023-12-26 13:46:07,225][123090] Updated weights for policy 1, policy_version 1762986 (0.0005) [2023-12-26 13:46:07,298][123090] Updated weights for policy 1, policy_version 1762996 (0.0005) [2023-12-26 13:46:07,358][123090] Updated weights for policy 1, policy_version 1763006 (0.0005) [2023-12-26 13:46:07,426][123091] Updated weights for policy 0, policy_version 1774997 (0.0010) [2023-12-26 13:46:07,508][123091] Updated weights for policy 0, policy_version 1775007 (0.0010) [2023-12-26 13:46:07,584][123091] Updated weights for policy 0, policy_version 1775017 (0.0010) [2023-12-26 13:46:08,027][123090] Updated weights for policy 1, policy_version 1763016 (0.0008) [2023-12-26 13:46:08,090][123090] Updated weights for policy 1, policy_version 1763026 (0.0009) [2023-12-26 13:46:08,147][123090] Updated weights for policy 1, policy_version 1763036 (0.0008) [2023-12-26 13:46:08,371][123091] Updated weights for policy 0, policy_version 1775027 (0.0010) [2023-12-26 13:46:08,436][123091] Updated weights for policy 0, policy_version 1775037 (0.0009) [2023-12-26 13:46:08,498][123091] Updated weights for policy 0, policy_version 1775047 (0.0009) [2023-12-26 13:46:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 905756672. Throughput: 0: 8858.5, 1: 8640.9. Samples: 905731496. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:46:08,785][121949] Avg episode reward: [(0, '6218.070'), (1, '5653.657')] [2023-12-26 13:46:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001775056_454418432.pth... [2023-12-26 13:46:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001763040_451338240.pth... [2023-12-26 13:46:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001762016_451076096.pth [2023-12-26 13:46:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001774000_454148096.pth [2023-12-26 13:46:08,870][123090] Updated weights for policy 1, policy_version 1763046 (0.0005) [2023-12-26 13:46:08,921][123090] Updated weights for policy 1, policy_version 1763056 (0.0005) [2023-12-26 13:46:08,979][123090] Updated weights for policy 1, policy_version 1763066 (0.0005) [2023-12-26 13:46:09,409][123091] Updated weights for policy 0, policy_version 1775057 (0.0009) [2023-12-26 13:46:09,482][123091] Updated weights for policy 0, policy_version 1775067 (0.0009) [2023-12-26 13:46:09,548][123091] Updated weights for policy 0, policy_version 1775077 (0.0009) [2023-12-26 13:46:09,625][123091] Updated weights for policy 0, policy_version 1775087 (0.0009) [2023-12-26 13:46:09,760][123090] Updated weights for policy 1, policy_version 1763076 (0.0008) [2023-12-26 13:46:09,831][123090] Updated weights for policy 1, policy_version 1763086 (0.0011) [2023-12-26 13:46:09,902][123090] Updated weights for policy 1, policy_version 1763096 (0.0010) [2023-12-26 13:46:10,565][123091] Updated weights for policy 0, policy_version 1775097 (0.0009) [2023-12-26 13:46:10,576][123090] Updated weights for policy 1, policy_version 1763106 (0.0009) [2023-12-26 13:46:10,625][123091] Updated weights for policy 0, policy_version 1775107 (0.0007) [2023-12-26 13:46:10,634][123090] Updated weights for policy 1, policy_version 1763116 (0.0009) [2023-12-26 13:46:10,691][123091] Updated weights for policy 0, policy_version 1775117 (0.0009) [2023-12-26 13:46:10,702][123090] Updated weights for policy 1, policy_version 1763126 (0.0008) [2023-12-26 13:46:10,774][123090] Updated weights for policy 1, policy_version 1763136 (0.0010) [2023-12-26 13:46:11,580][123091] Updated weights for policy 0, policy_version 1775127 (0.0010) [2023-12-26 13:46:11,623][123090] Updated weights for policy 1, policy_version 1763146 (0.0007) [2023-12-26 13:46:11,648][123091] Updated weights for policy 0, policy_version 1775137 (0.0009) [2023-12-26 13:46:11,691][123090] Updated weights for policy 1, policy_version 1763156 (0.0009) [2023-12-26 13:46:11,719][123091] Updated weights for policy 0, policy_version 1775147 (0.0008) [2023-12-26 13:46:11,755][123090] Updated weights for policy 1, policy_version 1763166 (0.0009) [2023-12-26 13:46:12,479][123091] Updated weights for policy 0, policy_version 1775157 (0.0007) [2023-12-26 13:46:12,542][123091] Updated weights for policy 0, policy_version 1775167 (0.0009) [2023-12-26 13:46:12,612][123091] Updated weights for policy 0, policy_version 1775177 (0.0009) [2023-12-26 13:46:12,632][123090] Updated weights for policy 1, policy_version 1763176 (0.0007) [2023-12-26 13:46:12,699][123090] Updated weights for policy 1, policy_version 1763186 (0.0009) [2023-12-26 13:46:12,767][123090] Updated weights for policy 1, policy_version 1763196 (0.0009) [2023-12-26 13:46:13,468][123090] Updated weights for policy 1, policy_version 1763206 (0.0007) [2023-12-26 13:46:13,485][123091] Updated weights for policy 0, policy_version 1775187 (0.0007) [2023-12-26 13:46:13,536][123090] Updated weights for policy 1, policy_version 1763216 (0.0007) [2023-12-26 13:46:13,546][123091] Updated weights for policy 0, policy_version 1775197 (0.0008) [2023-12-26 13:46:13,584][123090] Updated weights for policy 1, policy_version 1763226 (0.0007) [2023-12-26 13:46:13,604][123091] Updated weights for policy 0, policy_version 1775207 (0.0009) [2023-12-26 13:46:13,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 905846784. Throughput: 0: 8768.8, 1: 8738.5. Samples: 905835472. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:46:13,785][121949] Avg episode reward: [(0, '6256.194'), (1, '5594.339')] [2023-12-26 13:46:14,217][123090] Updated weights for policy 1, policy_version 1763236 (0.0006) [2023-12-26 13:46:14,275][123090] Updated weights for policy 1, policy_version 1763246 (0.0005) [2023-12-26 13:46:14,328][123090] Updated weights for policy 1, policy_version 1763256 (0.0006) [2023-12-26 13:46:14,468][123091] Updated weights for policy 0, policy_version 1775217 (0.0009) [2023-12-26 13:46:14,523][123091] Updated weights for policy 0, policy_version 1775227 (0.0007) [2023-12-26 13:46:14,589][123091] Updated weights for policy 0, policy_version 1775237 (0.0009) [2023-12-26 13:46:14,649][123091] Updated weights for policy 0, policy_version 1775247 (0.0005) [2023-12-26 13:46:15,104][123090] Updated weights for policy 1, policy_version 1763266 (0.0006) [2023-12-26 13:46:15,161][123090] Updated weights for policy 1, policy_version 1763276 (0.0010) [2023-12-26 13:46:15,214][123090] Updated weights for policy 1, policy_version 1763286 (0.0011) [2023-12-26 13:46:15,271][123090] Updated weights for policy 1, policy_version 1763296 (0.0011) [2023-12-26 13:46:15,379][123091] Updated weights for policy 0, policy_version 1775257 (0.0010) [2023-12-26 13:46:15,446][123091] Updated weights for policy 0, policy_version 1775267 (0.0010) [2023-12-26 13:46:15,512][123091] Updated weights for policy 0, policy_version 1775277 (0.0011) [2023-12-26 13:46:15,998][123090] Updated weights for policy 1, policy_version 1763306 (0.0005) [2023-12-26 13:46:16,050][123090] Updated weights for policy 1, policy_version 1763316 (0.0005) [2023-12-26 13:46:16,112][123090] Updated weights for policy 1, policy_version 1763326 (0.0005) [2023-12-26 13:46:16,329][123091] Updated weights for policy 0, policy_version 1775287 (0.0010) [2023-12-26 13:46:16,402][123091] Updated weights for policy 0, policy_version 1775297 (0.0010) [2023-12-26 13:46:16,463][123091] Updated weights for policy 0, policy_version 1775307 (0.0010) [2023-12-26 13:46:16,857][123090] Updated weights for policy 1, policy_version 1763336 (0.0009) [2023-12-26 13:46:16,915][123090] Updated weights for policy 1, policy_version 1763346 (0.0010) [2023-12-26 13:46:16,963][123090] Updated weights for policy 1, policy_version 1763356 (0.0010) [2023-12-26 13:46:17,210][123091] Updated weights for policy 0, policy_version 1775317 (0.0010) [2023-12-26 13:46:17,265][123091] Updated weights for policy 0, policy_version 1775327 (0.0010) [2023-12-26 13:46:17,312][123091] Updated weights for policy 0, policy_version 1775337 (0.0010) [2023-12-26 13:46:17,804][123090] Updated weights for policy 1, policy_version 1763366 (0.0010) [2023-12-26 13:46:17,875][123090] Updated weights for policy 1, policy_version 1763376 (0.0011) [2023-12-26 13:46:17,949][123090] Updated weights for policy 1, policy_version 1763386 (0.0011) [2023-12-26 13:46:18,062][123091] Updated weights for policy 0, policy_version 1775347 (0.0010) [2023-12-26 13:46:18,121][123091] Updated weights for policy 0, policy_version 1775357 (0.0011) [2023-12-26 13:46:18,185][123091] Updated weights for policy 0, policy_version 1775367 (0.0011) [2023-12-26 13:46:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 905928704. Throughput: 0: 8788.9, 1: 8865.7. Samples: 905944256. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:46:18,785][121949] Avg episode reward: [(0, '6363.989'), (1, '5709.960')] [2023-12-26 13:46:18,796][123090] Updated weights for policy 1, policy_version 1763396 (0.0011) [2023-12-26 13:46:18,848][123090] Updated weights for policy 1, policy_version 1763406 (0.0010) [2023-12-26 13:46:18,915][123090] Updated weights for policy 1, policy_version 1763416 (0.0010) [2023-12-26 13:46:18,988][123091] Updated weights for policy 0, policy_version 1775377 (0.0010) [2023-12-26 13:46:19,046][123091] Updated weights for policy 0, policy_version 1775387 (0.0006) [2023-12-26 13:46:19,097][123091] Updated weights for policy 0, policy_version 1775397 (0.0010) [2023-12-26 13:46:19,148][123091] Updated weights for policy 0, policy_version 1775407 (0.0010) [2023-12-26 13:46:19,724][123090] Updated weights for policy 1, policy_version 1763426 (0.0009) [2023-12-26 13:46:19,773][123090] Updated weights for policy 1, policy_version 1763436 (0.0005) [2023-12-26 13:46:19,841][123090] Updated weights for policy 1, policy_version 1763446 (0.0007) [2023-12-26 13:46:19,900][123090] Updated weights for policy 1, policy_version 1763456 (0.0008) [2023-12-26 13:46:19,940][123091] Updated weights for policy 0, policy_version 1775417 (0.0009) [2023-12-26 13:46:20,010][123091] Updated weights for policy 0, policy_version 1775427 (0.0009) [2023-12-26 13:46:20,073][123091] Updated weights for policy 0, policy_version 1775437 (0.0009) [2023-12-26 13:46:20,760][123090] Updated weights for policy 1, policy_version 1763466 (0.0006) [2023-12-26 13:46:20,820][123090] Updated weights for policy 1, policy_version 1763476 (0.0009) [2023-12-26 13:46:20,845][123091] Updated weights for policy 0, policy_version 1775447 (0.0006) [2023-12-26 13:46:20,875][123090] Updated weights for policy 1, policy_version 1763486 (0.0006) [2023-12-26 13:46:20,914][123091] Updated weights for policy 0, policy_version 1775457 (0.0009) [2023-12-26 13:46:20,985][123091] Updated weights for policy 0, policy_version 1775467 (0.0010) [2023-12-26 13:46:21,725][123090] Updated weights for policy 1, policy_version 1763496 (0.0009) [2023-12-26 13:46:21,796][123090] Updated weights for policy 1, policy_version 1763506 (0.0009) [2023-12-26 13:46:21,837][123091] Updated weights for policy 0, policy_version 1775477 (0.0008) [2023-12-26 13:46:21,858][123090] Updated weights for policy 1, policy_version 1763516 (0.0009) [2023-12-26 13:46:21,896][123091] Updated weights for policy 0, policy_version 1775487 (0.0009) [2023-12-26 13:46:21,957][123091] Updated weights for policy 0, policy_version 1775497 (0.0010) [2023-12-26 13:46:22,578][123090] Updated weights for policy 1, policy_version 1763526 (0.0008) [2023-12-26 13:46:22,638][123090] Updated weights for policy 1, policy_version 1763536 (0.0009) [2023-12-26 13:46:22,698][123090] Updated weights for policy 1, policy_version 1763546 (0.0009) [2023-12-26 13:46:22,843][123091] Updated weights for policy 0, policy_version 1775507 (0.0009) [2023-12-26 13:46:22,893][123091] Updated weights for policy 0, policy_version 1775517 (0.0008) [2023-12-26 13:46:22,948][123091] Updated weights for policy 0, policy_version 1775527 (0.0005) [2023-12-26 13:46:23,526][123090] Updated weights for policy 1, policy_version 1763556 (0.0010) [2023-12-26 13:46:23,592][123090] Updated weights for policy 1, policy_version 1763566 (0.0010) [2023-12-26 13:46:23,664][123090] Updated weights for policy 1, policy_version 1763576 (0.0010) [2023-12-26 13:46:23,690][123091] Updated weights for policy 0, policy_version 1775537 (0.0006) [2023-12-26 13:46:23,737][123091] Updated weights for policy 0, policy_version 1775547 (0.0007) [2023-12-26 13:46:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 906018816. Throughput: 0: 8792.0, 1: 8890.1. Samples: 905996020. Policy #0 lag: (min: 7.0, avg: 7.5, max: 27.0) [2023-12-26 13:46:23,785][121949] Avg episode reward: [(0, '6334.749'), (1, '5814.292')] [2023-12-26 13:46:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001763584_451477504.pth... [2023-12-26 13:46:23,792][123091] Updated weights for policy 0, policy_version 1775557 (0.0008) [2023-12-26 13:46:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001762528_451207168.pth [2023-12-26 13:46:23,851][123091] Updated weights for policy 0, policy_version 1775567 (0.0008) [2023-12-26 13:46:23,857][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001775568_454549504.pth... [2023-12-26 13:46:23,862][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001774544_454287360.pth [2023-12-26 13:46:24,439][123090] Updated weights for policy 1, policy_version 1763586 (0.0009) [2023-12-26 13:46:24,493][123090] Updated weights for policy 1, policy_version 1763596 (0.0005) [2023-12-26 13:46:24,561][123090] Updated weights for policy 1, policy_version 1763606 (0.0010) [2023-12-26 13:46:24,609][123090] Updated weights for policy 1, policy_version 1763616 (0.0010) [2023-12-26 13:46:24,712][123091] Updated weights for policy 0, policy_version 1775577 (0.0009) [2023-12-26 13:46:24,764][123091] Updated weights for policy 0, policy_version 1775587 (0.0009) [2023-12-26 13:46:24,818][123091] Updated weights for policy 0, policy_version 1775598 (0.0010) [2023-12-26 13:46:25,315][123090] Updated weights for policy 1, policy_version 1763626 (0.0009) [2023-12-26 13:46:25,366][123090] Updated weights for policy 1, policy_version 1763636 (0.0009) [2023-12-26 13:46:25,424][123090] Updated weights for policy 1, policy_version 1763646 (0.0009) [2023-12-26 13:46:25,672][123091] Updated weights for policy 0, policy_version 1775608 (0.0010) [2023-12-26 13:46:25,722][123091] Updated weights for policy 0, policy_version 1775618 (0.0009) [2023-12-26 13:46:25,770][123091] Updated weights for policy 0, policy_version 1775628 (0.0008) [2023-12-26 13:46:26,268][123090] Updated weights for policy 1, policy_version 1763656 (0.0009) [2023-12-26 13:46:26,324][123090] Updated weights for policy 1, policy_version 1763666 (0.0010) [2023-12-26 13:46:26,377][123090] Updated weights for policy 1, policy_version 1763676 (0.0009) [2023-12-26 13:46:26,644][123091] Updated weights for policy 0, policy_version 1775638 (0.0010) [2023-12-26 13:46:26,697][123091] Updated weights for policy 0, policy_version 1775648 (0.0010) [2023-12-26 13:46:26,750][123091] Updated weights for policy 0, policy_version 1775658 (0.0010) [2023-12-26 13:46:27,040][123090] Updated weights for policy 1, policy_version 1763686 (0.0007) [2023-12-26 13:46:27,095][123090] Updated weights for policy 1, policy_version 1763696 (0.0005) [2023-12-26 13:46:27,141][123090] Updated weights for policy 1, policy_version 1763706 (0.0005) [2023-12-26 13:46:27,523][123091] Updated weights for policy 0, policy_version 1775669 (0.0008) [2023-12-26 13:46:27,595][123091] Updated weights for policy 0, policy_version 1775679 (0.0005) [2023-12-26 13:46:27,661][123091] Updated weights for policy 0, policy_version 1775689 (0.0005) [2023-12-26 13:46:27,844][123090] Updated weights for policy 1, policy_version 1763716 (0.0005) [2023-12-26 13:46:27,900][123090] Updated weights for policy 1, policy_version 1763726 (0.0005) [2023-12-26 13:46:27,948][123090] Updated weights for policy 1, policy_version 1763736 (0.0005) [2023-12-26 13:46:28,328][123091] Updated weights for policy 0, policy_version 1775699 (0.0006) [2023-12-26 13:46:28,394][123091] Updated weights for policy 0, policy_version 1775709 (0.0007) [2023-12-26 13:46:28,461][123091] Updated weights for policy 0, policy_version 1775719 (0.0005) [2023-12-26 13:46:28,667][123090] Updated weights for policy 1, policy_version 1763746 (0.0006) [2023-12-26 13:46:28,739][123090] Updated weights for policy 1, policy_version 1763756 (0.0006) [2023-12-26 13:46:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 906108928. Throughput: 0: 8810.0, 1: 8930.9. Samples: 906102824. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:28,785][121949] Avg episode reward: [(0, '6306.229'), (1, '5703.120')] [2023-12-26 13:46:28,808][123090] Updated weights for policy 1, policy_version 1763766 (0.0007) [2023-12-26 13:46:28,865][123090] Updated weights for policy 1, policy_version 1763776 (0.0006) [2023-12-26 13:46:29,113][123091] Updated weights for policy 0, policy_version 1775729 (0.0006) [2023-12-26 13:46:29,168][123091] Updated weights for policy 0, policy_version 1775739 (0.0009) [2023-12-26 13:46:29,225][123091] Updated weights for policy 0, policy_version 1775749 (0.0009) [2023-12-26 13:46:29,288][123091] Updated weights for policy 0, policy_version 1775759 (0.0010) [2023-12-26 13:46:29,647][123090] Updated weights for policy 1, policy_version 1763786 (0.0005) [2023-12-26 13:46:29,712][123090] Updated weights for policy 1, policy_version 1763796 (0.0006) [2023-12-26 13:46:29,782][123090] Updated weights for policy 1, policy_version 1763806 (0.0005) [2023-12-26 13:46:30,198][123091] Updated weights for policy 0, policy_version 1775769 (0.0010) [2023-12-26 13:46:30,272][123091] Updated weights for policy 0, policy_version 1775779 (0.0010) [2023-12-26 13:46:30,334][123091] Updated weights for policy 0, policy_version 1775789 (0.0010) [2023-12-26 13:46:30,461][123090] Updated weights for policy 1, policy_version 1763816 (0.0008) [2023-12-26 13:46:30,522][123090] Updated weights for policy 1, policy_version 1763826 (0.0006) [2023-12-26 13:46:30,573][123090] Updated weights for policy 1, policy_version 1763836 (0.0005) [2023-12-26 13:46:31,124][123091] Updated weights for policy 0, policy_version 1775799 (0.0009) [2023-12-26 13:46:31,180][123091] Updated weights for policy 0, policy_version 1775809 (0.0010) [2023-12-26 13:46:31,241][123091] Updated weights for policy 0, policy_version 1775820 (0.0010) [2023-12-26 13:46:31,260][123090] Updated weights for policy 1, policy_version 1763846 (0.0006) [2023-12-26 13:46:31,314][123090] Updated weights for policy 1, policy_version 1763856 (0.0005) [2023-12-26 13:46:31,389][123090] Updated weights for policy 1, policy_version 1763866 (0.0009) [2023-12-26 13:46:32,130][123091] Updated weights for policy 0, policy_version 1775830 (0.0009) [2023-12-26 13:46:32,158][123090] Updated weights for policy 1, policy_version 1763876 (0.0008) [2023-12-26 13:46:32,187][123091] Updated weights for policy 0, policy_version 1775840 (0.0009) [2023-12-26 13:46:32,214][123090] Updated weights for policy 1, policy_version 1763886 (0.0005) [2023-12-26 13:46:32,244][123091] Updated weights for policy 0, policy_version 1775850 (0.0008) [2023-12-26 13:46:32,278][123090] Updated weights for policy 1, policy_version 1763896 (0.0007) [2023-12-26 13:46:33,050][123091] Updated weights for policy 0, policy_version 1775860 (0.0010) [2023-12-26 13:46:33,056][123090] Updated weights for policy 1, policy_version 1763906 (0.0010) [2023-12-26 13:46:33,104][123090] Updated weights for policy 1, policy_version 1763916 (0.0010) [2023-12-26 13:46:33,112][123091] Updated weights for policy 0, policy_version 1775870 (0.0010) [2023-12-26 13:46:33,158][123090] Updated weights for policy 1, policy_version 1763926 (0.0010) [2023-12-26 13:46:33,171][123091] Updated weights for policy 0, policy_version 1775880 (0.0011) [2023-12-26 13:46:33,206][123090] Updated weights for policy 1, policy_version 1763936 (0.0010) [2023-12-26 13:46:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 906199040. Throughput: 0: 8768.5, 1: 9035.6. Samples: 906212676. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:33,785][121949] Avg episode reward: [(0, '6347.225'), (1, '5815.536')] [2023-12-26 13:46:33,874][123091] Updated weights for policy 0, policy_version 1775890 (0.0009) [2023-12-26 13:46:33,925][123091] Updated weights for policy 0, policy_version 1775900 (0.0005) [2023-12-26 13:46:33,973][123091] Updated weights for policy 0, policy_version 1775910 (0.0005) [2023-12-26 13:46:34,020][123091] Updated weights for policy 0, policy_version 1775920 (0.0005) [2023-12-26 13:46:34,050][123090] Updated weights for policy 1, policy_version 1763946 (0.0010) [2023-12-26 13:46:34,106][123090] Updated weights for policy 1, policy_version 1763956 (0.0010) [2023-12-26 13:46:34,160][123090] Updated weights for policy 1, policy_version 1763966 (0.0010) [2023-12-26 13:46:34,781][123091] Updated weights for policy 0, policy_version 1775930 (0.0010) [2023-12-26 13:46:34,843][123091] Updated weights for policy 0, policy_version 1775940 (0.0011) [2023-12-26 13:46:34,908][123091] Updated weights for policy 0, policy_version 1775950 (0.0011) [2023-12-26 13:46:35,011][123090] Updated weights for policy 1, policy_version 1763976 (0.0010) [2023-12-26 13:46:35,080][123090] Updated weights for policy 1, policy_version 1763986 (0.0010) [2023-12-26 13:46:35,130][123090] Updated weights for policy 1, policy_version 1763996 (0.0008) [2023-12-26 13:46:35,698][123091] Updated weights for policy 0, policy_version 1775960 (0.0010) [2023-12-26 13:46:35,763][123091] Updated weights for policy 0, policy_version 1775970 (0.0010) [2023-12-26 13:46:35,825][123091] Updated weights for policy 0, policy_version 1775980 (0.0009) [2023-12-26 13:46:35,877][123090] Updated weights for policy 1, policy_version 1764006 (0.0008) [2023-12-26 13:46:35,935][123090] Updated weights for policy 1, policy_version 1764016 (0.0008) [2023-12-26 13:46:36,009][123090] Updated weights for policy 1, policy_version 1764026 (0.0007) [2023-12-26 13:46:36,640][123091] Updated weights for policy 0, policy_version 1775990 (0.0009) [2023-12-26 13:46:36,703][123091] Updated weights for policy 0, policy_version 1776000 (0.0008) [2023-12-26 13:46:36,769][123091] Updated weights for policy 0, policy_version 1776010 (0.0005) [2023-12-26 13:46:36,874][123090] Updated weights for policy 1, policy_version 1764036 (0.0009) [2023-12-26 13:46:36,936][123090] Updated weights for policy 1, policy_version 1764046 (0.0009) [2023-12-26 13:46:36,998][123090] Updated weights for policy 1, policy_version 1764056 (0.0010) [2023-12-26 13:46:37,497][123091] Updated weights for policy 0, policy_version 1776020 (0.0007) [2023-12-26 13:46:37,553][123091] Updated weights for policy 0, policy_version 1776030 (0.0009) [2023-12-26 13:46:37,606][123091] Updated weights for policy 0, policy_version 1776040 (0.0010) [2023-12-26 13:46:37,853][123090] Updated weights for policy 1, policy_version 1764066 (0.0010) [2023-12-26 13:46:37,926][123090] Updated weights for policy 1, policy_version 1764076 (0.0010) [2023-12-26 13:46:37,983][123090] Updated weights for policy 1, policy_version 1764086 (0.0006) [2023-12-26 13:46:38,053][123090] Updated weights for policy 1, policy_version 1764096 (0.0006) [2023-12-26 13:46:38,369][123091] Updated weights for policy 0, policy_version 1776050 (0.0007) [2023-12-26 13:46:38,442][123091] Updated weights for policy 0, policy_version 1776060 (0.0006) [2023-12-26 13:46:38,513][123091] Updated weights for policy 0, policy_version 1776070 (0.0009) [2023-12-26 13:46:38,581][123091] Updated weights for policy 0, policy_version 1776080 (0.0011) [2023-12-26 13:46:38,768][123090] Updated weights for policy 1, policy_version 1764106 (0.0005) [2023-12-26 13:46:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 906289152. Throughput: 0: 8769.2, 1: 9020.5. Samples: 906266568. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:38,785][121949] Avg episode reward: [(0, '6376.049'), (1, '5830.435')] [2023-12-26 13:46:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001776080_454680576.pth... [2023-12-26 13:46:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001775056_454418432.pth [2023-12-26 13:46:38,828][123090] Updated weights for policy 1, policy_version 1764116 (0.0008) [2023-12-26 13:46:38,888][123090] Updated weights for policy 1, policy_version 1764126 (0.0010) [2023-12-26 13:46:38,895][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001764128_451616768.pth... [2023-12-26 13:46:38,899][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001763040_451338240.pth [2023-12-26 13:46:39,332][123091] Updated weights for policy 0, policy_version 1776090 (0.0010) [2023-12-26 13:46:39,410][123091] Updated weights for policy 0, policy_version 1776100 (0.0009) [2023-12-26 13:46:39,475][123091] Updated weights for policy 0, policy_version 1776110 (0.0010) [2023-12-26 13:46:39,704][123090] Updated weights for policy 1, policy_version 1764136 (0.0009) [2023-12-26 13:46:39,767][123090] Updated weights for policy 1, policy_version 1764146 (0.0008) [2023-12-26 13:46:39,826][123090] Updated weights for policy 1, policy_version 1764156 (0.0008) [2023-12-26 13:46:40,313][123091] Updated weights for policy 0, policy_version 1776120 (0.0011) [2023-12-26 13:46:40,376][123091] Updated weights for policy 0, policy_version 1776130 (0.0011) [2023-12-26 13:46:40,436][123091] Updated weights for policy 0, policy_version 1776140 (0.0009) [2023-12-26 13:46:40,659][123090] Updated weights for policy 1, policy_version 1764166 (0.0010) [2023-12-26 13:46:40,711][123090] Updated weights for policy 1, policy_version 1764176 (0.0010) [2023-12-26 13:46:40,767][123090] Updated weights for policy 1, policy_version 1764186 (0.0010) [2023-12-26 13:46:41,125][123091] Updated weights for policy 0, policy_version 1776150 (0.0009) [2023-12-26 13:46:41,183][123091] Updated weights for policy 0, policy_version 1776160 (0.0007) [2023-12-26 13:46:41,253][123091] Updated weights for policy 0, policy_version 1776170 (0.0008) [2023-12-26 13:46:41,631][123090] Updated weights for policy 1, policy_version 1764196 (0.0009) [2023-12-26 13:46:41,709][123090] Updated weights for policy 1, policy_version 1764206 (0.0009) [2023-12-26 13:46:41,789][123090] Updated weights for policy 1, policy_version 1764216 (0.0009) [2023-12-26 13:46:42,067][123091] Updated weights for policy 0, policy_version 1776180 (0.0011) [2023-12-26 13:46:42,128][123091] Updated weights for policy 0, policy_version 1776190 (0.0011) [2023-12-26 13:46:42,191][123091] Updated weights for policy 0, policy_version 1776200 (0.0011) [2023-12-26 13:46:42,657][123090] Updated weights for policy 1, policy_version 1764226 (0.0009) [2023-12-26 13:46:42,721][123090] Updated weights for policy 1, policy_version 1764236 (0.0009) [2023-12-26 13:46:42,791][123090] Updated weights for policy 1, policy_version 1764246 (0.0009) [2023-12-26 13:46:42,855][123090] Updated weights for policy 1, policy_version 1764256 (0.0009) [2023-12-26 13:46:43,024][123091] Updated weights for policy 0, policy_version 1776210 (0.0011) [2023-12-26 13:46:43,082][123091] Updated weights for policy 0, policy_version 1776220 (0.0010) [2023-12-26 13:46:43,140][123091] Updated weights for policy 0, policy_version 1776230 (0.0010) [2023-12-26 13:46:43,194][123091] Updated weights for policy 0, policy_version 1776240 (0.0010) [2023-12-26 13:46:43,722][123090] Updated weights for policy 1, policy_version 1764266 (0.0010) [2023-12-26 13:46:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 906371072. Throughput: 0: 8758.1, 1: 8937.8. Samples: 906370988. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:43,785][121949] Avg episode reward: [(0, '6185.218'), (1, '5936.909')] [2023-12-26 13:46:43,796][123090] Updated weights for policy 1, policy_version 1764276 (0.0009) [2023-12-26 13:46:43,868][123090] Updated weights for policy 1, policy_version 1764286 (0.0008) [2023-12-26 13:46:43,915][123091] Updated weights for policy 0, policy_version 1776250 (0.0006) [2023-12-26 13:46:43,978][123091] Updated weights for policy 0, policy_version 1776260 (0.0008) [2023-12-26 13:46:44,029][123091] Updated weights for policy 0, policy_version 1776270 (0.0010) [2023-12-26 13:46:44,707][123090] Updated weights for policy 1, policy_version 1764296 (0.0010) [2023-12-26 13:46:44,785][123091] Updated weights for policy 0, policy_version 1776280 (0.0009) [2023-12-26 13:46:44,792][123090] Updated weights for policy 1, policy_version 1764306 (0.0008) [2023-12-26 13:46:44,850][123091] Updated weights for policy 0, policy_version 1776290 (0.0009) [2023-12-26 13:46:44,854][123090] Updated weights for policy 1, policy_version 1764316 (0.0007) [2023-12-26 13:46:44,916][123091] Updated weights for policy 0, policy_version 1776300 (0.0008) [2023-12-26 13:46:45,642][123091] Updated weights for policy 0, policy_version 1776310 (0.0009) [2023-12-26 13:46:45,705][123091] Updated weights for policy 0, policy_version 1776320 (0.0010) [2023-12-26 13:46:45,715][123090] Updated weights for policy 1, policy_version 1764326 (0.0010) [2023-12-26 13:46:45,770][123090] Updated weights for policy 1, policy_version 1764336 (0.0006) [2023-12-26 13:46:45,771][123091] Updated weights for policy 0, policy_version 1776330 (0.0010) [2023-12-26 13:46:45,830][123090] Updated weights for policy 1, policy_version 1764346 (0.0009) [2023-12-26 13:46:46,464][123091] Updated weights for policy 0, policy_version 1776340 (0.0008) [2023-12-26 13:46:46,518][123091] Updated weights for policy 0, policy_version 1776350 (0.0005) [2023-12-26 13:46:46,571][123091] Updated weights for policy 0, policy_version 1776360 (0.0005) [2023-12-26 13:46:46,763][123090] Updated weights for policy 1, policy_version 1764356 (0.0009) [2023-12-26 13:46:46,822][123090] Updated weights for policy 1, policy_version 1764366 (0.0010) [2023-12-26 13:46:46,877][123090] Updated weights for policy 1, policy_version 1764378 (0.0011) [2023-12-26 13:46:47,234][123091] Updated weights for policy 0, policy_version 1776370 (0.0005) [2023-12-26 13:46:47,280][123091] Updated weights for policy 0, policy_version 1776380 (0.0005) [2023-12-26 13:46:47,329][123091] Updated weights for policy 0, policy_version 1776390 (0.0005) [2023-12-26 13:46:47,401][123091] Updated weights for policy 0, policy_version 1776400 (0.0006) [2023-12-26 13:46:47,840][123090] Updated weights for policy 1, policy_version 1764389 (0.0009) [2023-12-26 13:46:47,900][123090] Updated weights for policy 1, policy_version 1764399 (0.0008) [2023-12-26 13:46:47,971][123090] Updated weights for policy 1, policy_version 1764409 (0.0009) [2023-12-26 13:46:48,050][123091] Updated weights for policy 0, policy_version 1776410 (0.0006) [2023-12-26 13:46:48,109][123091] Updated weights for policy 0, policy_version 1776420 (0.0006) [2023-12-26 13:46:48,180][123091] Updated weights for policy 0, policy_version 1776430 (0.0005) [2023-12-26 13:46:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 906461184. Throughput: 0: 8880.2, 1: 8818.1. Samples: 906477276. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:48,784][121949] Avg episode reward: [(0, '6182.770'), (1, '5890.507')] [2023-12-26 13:46:48,849][123090] Updated weights for policy 1, policy_version 1764419 (0.0009) [2023-12-26 13:46:48,916][123091] Updated weights for policy 0, policy_version 1776440 (0.0006) [2023-12-26 13:46:48,917][123090] Updated weights for policy 1, policy_version 1764429 (0.0008) [2023-12-26 13:46:48,968][123091] Updated weights for policy 0, policy_version 1776450 (0.0005) [2023-12-26 13:46:48,984][123090] Updated weights for policy 1, policy_version 1764439 (0.0008) [2023-12-26 13:46:49,017][123091] Updated weights for policy 0, policy_version 1776460 (0.0005) [2023-12-26 13:46:49,764][123091] Updated weights for policy 0, policy_version 1776470 (0.0009) [2023-12-26 13:46:49,836][123091] Updated weights for policy 0, policy_version 1776480 (0.0011) [2023-12-26 13:46:49,897][123090] Updated weights for policy 1, policy_version 1764449 (0.0008) [2023-12-26 13:46:49,907][123091] Updated weights for policy 0, policy_version 1776490 (0.0010) [2023-12-26 13:46:49,969][123090] Updated weights for policy 1, policy_version 1764459 (0.0008) [2023-12-26 13:46:50,029][123090] Updated weights for policy 1, policy_version 1764469 (0.0009) [2023-12-26 13:46:50,089][123090] Updated weights for policy 1, policy_version 1764479 (0.0009) [2023-12-26 13:46:50,625][123091] Updated weights for policy 0, policy_version 1776500 (0.0008) [2023-12-26 13:46:50,694][123091] Updated weights for policy 0, policy_version 1776510 (0.0008) [2023-12-26 13:46:50,761][123091] Updated weights for policy 0, policy_version 1776520 (0.0010) [2023-12-26 13:46:50,972][123090] Updated weights for policy 1, policy_version 1764489 (0.0009) [2023-12-26 13:46:51,041][123090] Updated weights for policy 1, policy_version 1764499 (0.0008) [2023-12-26 13:46:51,110][123090] Updated weights for policy 1, policy_version 1764509 (0.0010) [2023-12-26 13:46:51,513][123091] Updated weights for policy 0, policy_version 1776530 (0.0008) [2023-12-26 13:46:51,589][123091] Updated weights for policy 0, policy_version 1776540 (0.0009) [2023-12-26 13:46:51,660][123091] Updated weights for policy 0, policy_version 1776550 (0.0010) [2023-12-26 13:46:51,728][123091] Updated weights for policy 0, policy_version 1776560 (0.0012) [2023-12-26 13:46:51,962][123090] Updated weights for policy 1, policy_version 1764519 (0.0010) [2023-12-26 13:46:52,021][123090] Updated weights for policy 1, policy_version 1764529 (0.0009) [2023-12-26 13:46:52,085][123090] Updated weights for policy 1, policy_version 1764539 (0.0010) [2023-12-26 13:46:52,501][123091] Updated weights for policy 0, policy_version 1776570 (0.0008) [2023-12-26 13:46:52,553][123091] Updated weights for policy 0, policy_version 1776580 (0.0008) [2023-12-26 13:46:52,615][123091] Updated weights for policy 0, policy_version 1776590 (0.0008) [2023-12-26 13:46:52,939][123090] Updated weights for policy 1, policy_version 1764549 (0.0010) [2023-12-26 13:46:53,010][123090] Updated weights for policy 1, policy_version 1764559 (0.0011) [2023-12-26 13:46:53,073][123090] Updated weights for policy 1, policy_version 1764569 (0.0010) [2023-12-26 13:46:53,313][123091] Updated weights for policy 0, policy_version 1776600 (0.0006) [2023-12-26 13:46:53,358][123091] Updated weights for policy 0, policy_version 1776610 (0.0005) [2023-12-26 13:46:53,402][123091] Updated weights for policy 0, policy_version 1776620 (0.0005) [2023-12-26 13:46:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 906551296. Throughput: 0: 8915.1, 1: 8807.6. Samples: 906529016. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:53,785][121949] Avg episode reward: [(0, '6284.479'), (1, '5689.526')] [2023-12-26 13:46:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001776624_454819840.pth... [2023-12-26 13:46:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001764576_451731456.pth... [2023-12-26 13:46:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001775568_454549504.pth [2023-12-26 13:46:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001763584_451477504.pth [2023-12-26 13:46:53,888][123090] Updated weights for policy 1, policy_version 1764579 (0.0010) [2023-12-26 13:46:53,940][123090] Updated weights for policy 1, policy_version 1764589 (0.0010) [2023-12-26 13:46:53,995][123090] Updated weights for policy 1, policy_version 1764599 (0.0010) [2023-12-26 13:46:54,085][123091] Updated weights for policy 0, policy_version 1776630 (0.0005) [2023-12-26 13:46:54,137][123091] Updated weights for policy 0, policy_version 1776640 (0.0005) [2023-12-26 13:46:54,184][123091] Updated weights for policy 0, policy_version 1776650 (0.0005) [2023-12-26 13:46:54,826][123090] Updated weights for policy 1, policy_version 1764609 (0.0010) [2023-12-26 13:46:54,861][123091] Updated weights for policy 0, policy_version 1776660 (0.0005) [2023-12-26 13:46:54,889][123090] Updated weights for policy 1, policy_version 1764619 (0.0010) [2023-12-26 13:46:54,911][123091] Updated weights for policy 0, policy_version 1776670 (0.0005) [2023-12-26 13:46:54,954][123090] Updated weights for policy 1, policy_version 1764629 (0.0010) [2023-12-26 13:46:54,970][123091] Updated weights for policy 0, policy_version 1776680 (0.0009) [2023-12-26 13:46:55,019][123090] Updated weights for policy 1, policy_version 1764639 (0.0008) [2023-12-26 13:46:55,768][123091] Updated weights for policy 0, policy_version 1776690 (0.0010) [2023-12-26 13:46:55,834][123091] Updated weights for policy 0, policy_version 1776700 (0.0010) [2023-12-26 13:46:55,841][123090] Updated weights for policy 1, policy_version 1764649 (0.0010) [2023-12-26 13:46:55,885][123090] Updated weights for policy 1, policy_version 1764659 (0.0010) [2023-12-26 13:46:55,896][123091] Updated weights for policy 0, policy_version 1776710 (0.0010) [2023-12-26 13:46:55,932][123090] Updated weights for policy 1, policy_version 1764669 (0.0010) [2023-12-26 13:46:55,958][123091] Updated weights for policy 0, policy_version 1776720 (0.0010) [2023-12-26 13:46:56,690][123091] Updated weights for policy 0, policy_version 1776730 (0.0010) [2023-12-26 13:46:56,751][123091] Updated weights for policy 0, policy_version 1776740 (0.0010) [2023-12-26 13:46:56,784][123090] Updated weights for policy 1, policy_version 1764679 (0.0007) [2023-12-26 13:46:56,813][123091] Updated weights for policy 0, policy_version 1776750 (0.0010) [2023-12-26 13:46:56,850][123090] Updated weights for policy 1, policy_version 1764689 (0.0009) [2023-12-26 13:46:56,915][123090] Updated weights for policy 1, policy_version 1764699 (0.0010) [2023-12-26 13:46:57,499][123091] Updated weights for policy 0, policy_version 1776760 (0.0008) [2023-12-26 13:46:57,567][123091] Updated weights for policy 0, policy_version 1776770 (0.0009) [2023-12-26 13:46:57,641][123091] Updated weights for policy 0, policy_version 1776780 (0.0006) [2023-12-26 13:46:57,666][123090] Updated weights for policy 1, policy_version 1764709 (0.0008) [2023-12-26 13:46:57,729][123090] Updated weights for policy 1, policy_version 1764719 (0.0005) [2023-12-26 13:46:57,787][123090] Updated weights for policy 1, policy_version 1764729 (0.0005) [2023-12-26 13:46:58,261][123091] Updated weights for policy 0, policy_version 1776790 (0.0008) [2023-12-26 13:46:58,334][123091] Updated weights for policy 0, policy_version 1776800 (0.0007) [2023-12-26 13:46:58,404][123091] Updated weights for policy 0, policy_version 1776810 (0.0007) [2023-12-26 13:46:58,545][123090] Updated weights for policy 1, policy_version 1764739 (0.0006) [2023-12-26 13:46:58,613][123090] Updated weights for policy 1, policy_version 1764749 (0.0008) [2023-12-26 13:46:58,676][123090] Updated weights for policy 1, policy_version 1764759 (0.0008) [2023-12-26 13:46:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 906649600. Throughput: 0: 9131.5, 1: 8731.2. Samples: 906639292. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:46:58,785][121949] Avg episode reward: [(0, '6276.571'), (1, '5391.979')] [2023-12-26 13:46:59,185][123091] Updated weights for policy 0, policy_version 1776820 (0.0008) [2023-12-26 13:46:59,253][123091] Updated weights for policy 0, policy_version 1776830 (0.0008) [2023-12-26 13:46:59,326][123091] Updated weights for policy 0, policy_version 1776840 (0.0009) [2023-12-26 13:46:59,501][123090] Updated weights for policy 1, policy_version 1764769 (0.0008) [2023-12-26 13:46:59,557][123090] Updated weights for policy 1, policy_version 1764779 (0.0009) [2023-12-26 13:46:59,611][123090] Updated weights for policy 1, policy_version 1764790 (0.0009) [2023-12-26 13:46:59,663][123090] Updated weights for policy 1, policy_version 1764800 (0.0009) [2023-12-26 13:47:00,093][123091] Updated weights for policy 0, policy_version 1776850 (0.0009) [2023-12-26 13:47:00,159][123091] Updated weights for policy 0, policy_version 1776860 (0.0006) [2023-12-26 13:47:00,222][123091] Updated weights for policy 0, policy_version 1776870 (0.0006) [2023-12-26 13:47:00,286][123091] Updated weights for policy 0, policy_version 1776880 (0.0006) [2023-12-26 13:47:00,469][123090] Updated weights for policy 1, policy_version 1764810 (0.0008) [2023-12-26 13:47:00,516][123090] Updated weights for policy 1, policy_version 1764820 (0.0010) [2023-12-26 13:47:00,561][123090] Updated weights for policy 1, policy_version 1764830 (0.0007) [2023-12-26 13:47:00,889][123091] Updated weights for policy 0, policy_version 1776890 (0.0009) [2023-12-26 13:47:00,936][123091] Updated weights for policy 0, policy_version 1776900 (0.0010) [2023-12-26 13:47:00,994][123091] Updated weights for policy 0, policy_version 1776910 (0.0010) [2023-12-26 13:47:01,398][123090] Updated weights for policy 1, policy_version 1764840 (0.0009) [2023-12-26 13:47:01,451][123090] Updated weights for policy 1, policy_version 1764850 (0.0010) [2023-12-26 13:47:01,505][123090] Updated weights for policy 1, policy_version 1764860 (0.0009) [2023-12-26 13:47:01,838][123091] Updated weights for policy 0, policy_version 1776920 (0.0007) [2023-12-26 13:47:01,891][123091] Updated weights for policy 0, policy_version 1776930 (0.0007) [2023-12-26 13:47:01,945][123091] Updated weights for policy 0, policy_version 1776940 (0.0009) [2023-12-26 13:47:02,329][123090] Updated weights for policy 1, policy_version 1764870 (0.0010) [2023-12-26 13:47:02,389][123090] Updated weights for policy 1, policy_version 1764880 (0.0009) [2023-12-26 13:47:02,448][123090] Updated weights for policy 1, policy_version 1764890 (0.0005) [2023-12-26 13:47:02,659][123091] Updated weights for policy 0, policy_version 1776950 (0.0005) [2023-12-26 13:47:02,730][123091] Updated weights for policy 0, policy_version 1776960 (0.0006) [2023-12-26 13:47:02,797][123091] Updated weights for policy 0, policy_version 1776970 (0.0006) [2023-12-26 13:47:03,191][123090] Updated weights for policy 1, policy_version 1764900 (0.0006) [2023-12-26 13:47:03,243][123090] Updated weights for policy 1, policy_version 1764910 (0.0007) [2023-12-26 13:47:03,291][123090] Updated weights for policy 1, policy_version 1764920 (0.0010) [2023-12-26 13:47:03,396][123091] Updated weights for policy 0, policy_version 1776980 (0.0005) [2023-12-26 13:47:03,453][123091] Updated weights for policy 0, policy_version 1776990 (0.0005) [2023-12-26 13:47:03,511][123091] Updated weights for policy 0, policy_version 1777000 (0.0006) [2023-12-26 13:47:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 906739712. Throughput: 0: 9229.8, 1: 8690.2. Samples: 906750656. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:03,785][121949] Avg episode reward: [(0, '6312.558'), (1, '5583.824')] [2023-12-26 13:47:04,041][123090] Updated weights for policy 1, policy_version 1764930 (0.0010) [2023-12-26 13:47:04,108][123090] Updated weights for policy 1, policy_version 1764940 (0.0010) [2023-12-26 13:47:04,175][123090] Updated weights for policy 1, policy_version 1764950 (0.0010) [2023-12-26 13:47:04,242][123090] Updated weights for policy 1, policy_version 1764960 (0.0010) [2023-12-26 13:47:04,266][123091] Updated weights for policy 0, policy_version 1777010 (0.0009) [2023-12-26 13:47:04,333][123091] Updated weights for policy 0, policy_version 1777020 (0.0011) [2023-12-26 13:47:04,396][123091] Updated weights for policy 0, policy_version 1777030 (0.0010) [2023-12-26 13:47:04,451][123091] Updated weights for policy 0, policy_version 1777040 (0.0010) [2023-12-26 13:47:05,018][123090] Updated weights for policy 1, policy_version 1764970 (0.0010) [2023-12-26 13:47:05,089][123090] Updated weights for policy 1, policy_version 1764980 (0.0009) [2023-12-26 13:47:05,150][123090] Updated weights for policy 1, policy_version 1764990 (0.0007) [2023-12-26 13:47:05,282][123091] Updated weights for policy 0, policy_version 1777050 (0.0011) [2023-12-26 13:47:05,356][123091] Updated weights for policy 0, policy_version 1777060 (0.0011) [2023-12-26 13:47:05,418][123091] Updated weights for policy 0, policy_version 1777070 (0.0010) [2023-12-26 13:47:05,834][123090] Updated weights for policy 1, policy_version 1765000 (0.0010) [2023-12-26 13:47:05,896][123090] Updated weights for policy 1, policy_version 1765010 (0.0010) [2023-12-26 13:47:05,951][123090] Updated weights for policy 1, policy_version 1765020 (0.0010) [2023-12-26 13:47:06,215][123091] Updated weights for policy 0, policy_version 1777080 (0.0011) [2023-12-26 13:47:06,271][123091] Updated weights for policy 0, policy_version 1777090 (0.0011) [2023-12-26 13:47:06,333][123091] Updated weights for policy 0, policy_version 1777100 (0.0010) [2023-12-26 13:47:06,800][123090] Updated weights for policy 1, policy_version 1765030 (0.0011) [2023-12-26 13:47:06,852][123090] Updated weights for policy 1, policy_version 1765040 (0.0010) [2023-12-26 13:47:06,905][123090] Updated weights for policy 1, policy_version 1765050 (0.0011) [2023-12-26 13:47:07,154][123091] Updated weights for policy 0, policy_version 1777110 (0.0008) [2023-12-26 13:47:07,208][123091] Updated weights for policy 0, policy_version 1777120 (0.0006) [2023-12-26 13:47:07,255][123091] Updated weights for policy 0, policy_version 1777130 (0.0006) [2023-12-26 13:47:07,742][123090] Updated weights for policy 1, policy_version 1765060 (0.0011) [2023-12-26 13:47:07,790][123090] Updated weights for policy 1, policy_version 1765070 (0.0010) [2023-12-26 13:47:07,839][123090] Updated weights for policy 1, policy_version 1765080 (0.0010) [2023-12-26 13:47:07,997][123091] Updated weights for policy 0, policy_version 1777140 (0.0006) [2023-12-26 13:47:08,048][123091] Updated weights for policy 0, policy_version 1777150 (0.0008) [2023-12-26 13:47:08,100][123091] Updated weights for policy 0, policy_version 1777160 (0.0009) [2023-12-26 13:47:08,700][123090] Updated weights for policy 1, policy_version 1765090 (0.0010) [2023-12-26 13:47:08,764][123090] Updated weights for policy 1, policy_version 1765100 (0.0011) [2023-12-26 13:47:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 906821632. Throughput: 0: 9217.0, 1: 8724.6. Samples: 906803388. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:08,785][121949] Avg episode reward: [(0, '6166.576'), (1, '5779.592')] [2023-12-26 13:47:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001777168_454959104.pth... [2023-12-26 13:47:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001776080_454680576.pth [2023-12-26 13:47:08,823][123090] Updated weights for policy 1, policy_version 1765110 (0.0011) [2023-12-26 13:47:08,884][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001765120_451870720.pth... [2023-12-26 13:47:08,886][123090] Updated weights for policy 1, policy_version 1765120 (0.0011) [2023-12-26 13:47:08,889][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001764128_451616768.pth [2023-12-26 13:47:08,947][123091] Updated weights for policy 0, policy_version 1777170 (0.0009) [2023-12-26 13:47:09,011][123091] Updated weights for policy 0, policy_version 1777180 (0.0008) [2023-12-26 13:47:09,064][123091] Updated weights for policy 0, policy_version 1777190 (0.0009) [2023-12-26 13:47:09,111][123091] Updated weights for policy 0, policy_version 1777200 (0.0008) [2023-12-26 13:47:09,764][123090] Updated weights for policy 1, policy_version 1765130 (0.0011) [2023-12-26 13:47:09,841][123090] Updated weights for policy 1, policy_version 1765140 (0.0010) [2023-12-26 13:47:09,898][123090] Updated weights for policy 1, policy_version 1765150 (0.0011) [2023-12-26 13:47:09,988][123091] Updated weights for policy 0, policy_version 1777210 (0.0009) [2023-12-26 13:47:10,056][123091] Updated weights for policy 0, policy_version 1777220 (0.0010) [2023-12-26 13:47:10,126][123091] Updated weights for policy 0, policy_version 1777230 (0.0009) [2023-12-26 13:47:10,702][123090] Updated weights for policy 1, policy_version 1765160 (0.0006) [2023-12-26 13:47:10,765][123090] Updated weights for policy 1, policy_version 1765170 (0.0008) [2023-12-26 13:47:10,819][123090] Updated weights for policy 1, policy_version 1765180 (0.0010) [2023-12-26 13:47:10,995][123091] Updated weights for policy 0, policy_version 1777240 (0.0009) [2023-12-26 13:47:11,053][123091] Updated weights for policy 0, policy_version 1777250 (0.0010) [2023-12-26 13:47:11,109][123091] Updated weights for policy 0, policy_version 1777260 (0.0009) [2023-12-26 13:47:11,637][123090] Updated weights for policy 1, policy_version 1765190 (0.0010) [2023-12-26 13:47:11,702][123090] Updated weights for policy 1, policy_version 1765200 (0.0009) [2023-12-26 13:47:11,782][123090] Updated weights for policy 1, policy_version 1765210 (0.0010) [2023-12-26 13:47:11,915][123091] Updated weights for policy 0, policy_version 1777270 (0.0008) [2023-12-26 13:47:11,982][123091] Updated weights for policy 0, policy_version 1777280 (0.0010) [2023-12-26 13:47:12,050][123091] Updated weights for policy 0, policy_version 1777290 (0.0010) [2023-12-26 13:47:12,646][123090] Updated weights for policy 1, policy_version 1765220 (0.0010) [2023-12-26 13:47:12,711][123090] Updated weights for policy 1, policy_version 1765230 (0.0010) [2023-12-26 13:47:12,771][123090] Updated weights for policy 1, policy_version 1765240 (0.0010) [2023-12-26 13:47:12,907][123091] Updated weights for policy 0, policy_version 1777300 (0.0008) [2023-12-26 13:47:12,972][123091] Updated weights for policy 0, policy_version 1777310 (0.0009) [2023-12-26 13:47:13,033][123091] Updated weights for policy 0, policy_version 1777320 (0.0008) [2023-12-26 13:47:13,525][123090] Updated weights for policy 1, policy_version 1765250 (0.0008) [2023-12-26 13:47:13,586][123090] Updated weights for policy 1, policy_version 1765260 (0.0010) [2023-12-26 13:47:13,634][123090] Updated weights for policy 1, policy_version 1765270 (0.0009) [2023-12-26 13:47:13,683][123090] Updated weights for policy 1, policy_version 1765280 (0.0009) [2023-12-26 13:47:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 906911744. Throughput: 0: 9209.7, 1: 8628.8. Samples: 906905556. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:13,785][121949] Avg episode reward: [(0, '6216.473'), (1, '5768.653')] [2023-12-26 13:47:13,856][123091] Updated weights for policy 0, policy_version 1777330 (0.0010) [2023-12-26 13:47:13,909][123091] Updated weights for policy 0, policy_version 1777340 (0.0008) [2023-12-26 13:47:13,958][123091] Updated weights for policy 0, policy_version 1777350 (0.0009) [2023-12-26 13:47:14,011][123091] Updated weights for policy 0, policy_version 1777360 (0.0009) [2023-12-26 13:47:14,507][123090] Updated weights for policy 1, policy_version 1765290 (0.0005) [2023-12-26 13:47:14,561][123090] Updated weights for policy 1, policy_version 1765300 (0.0006) [2023-12-26 13:47:14,620][123090] Updated weights for policy 1, policy_version 1765310 (0.0005) [2023-12-26 13:47:14,813][123091] Updated weights for policy 0, policy_version 1777370 (0.0009) [2023-12-26 13:47:14,889][123091] Updated weights for policy 0, policy_version 1777380 (0.0006) [2023-12-26 13:47:14,963][123091] Updated weights for policy 0, policy_version 1777390 (0.0006) [2023-12-26 13:47:15,377][123090] Updated weights for policy 1, policy_version 1765320 (0.0010) [2023-12-26 13:47:15,445][123090] Updated weights for policy 1, policy_version 1765330 (0.0011) [2023-12-26 13:47:15,509][123090] Updated weights for policy 1, policy_version 1765340 (0.0011) [2023-12-26 13:47:15,688][123091] Updated weights for policy 0, policy_version 1777400 (0.0008) [2023-12-26 13:47:15,742][123091] Updated weights for policy 0, policy_version 1777410 (0.0009) [2023-12-26 13:47:15,795][123091] Updated weights for policy 0, policy_version 1777420 (0.0009) [2023-12-26 13:47:16,188][123090] Updated weights for policy 1, policy_version 1765350 (0.0007) [2023-12-26 13:47:16,237][123090] Updated weights for policy 1, policy_version 1765360 (0.0005) [2023-12-26 13:47:16,298][123090] Updated weights for policy 1, policy_version 1765370 (0.0010) [2023-12-26 13:47:16,645][123091] Updated weights for policy 0, policy_version 1777431 (0.0009) [2023-12-26 13:47:16,718][123091] Updated weights for policy 0, policy_version 1777441 (0.0006) [2023-12-26 13:47:16,782][123091] Updated weights for policy 0, policy_version 1777451 (0.0009) [2023-12-26 13:47:17,008][123090] Updated weights for policy 1, policy_version 1765380 (0.0010) [2023-12-26 13:47:17,067][123090] Updated weights for policy 1, policy_version 1765390 (0.0010) [2023-12-26 13:47:17,127][123090] Updated weights for policy 1, policy_version 1765400 (0.0011) [2023-12-26 13:47:17,573][123091] Updated weights for policy 0, policy_version 1777461 (0.0009) [2023-12-26 13:47:17,621][123091] Updated weights for policy 0, policy_version 1777471 (0.0008) [2023-12-26 13:47:17,666][123091] Updated weights for policy 0, policy_version 1777481 (0.0005) [2023-12-26 13:47:17,903][123090] Updated weights for policy 1, policy_version 1765410 (0.0010) [2023-12-26 13:47:17,973][123090] Updated weights for policy 1, policy_version 1765420 (0.0010) [2023-12-26 13:47:18,043][123090] Updated weights for policy 1, policy_version 1765430 (0.0010) [2023-12-26 13:47:18,121][123090] Updated weights for policy 1, policy_version 1765440 (0.0010) [2023-12-26 13:47:18,442][123091] Updated weights for policy 0, policy_version 1777491 (0.0006) [2023-12-26 13:47:18,503][123091] Updated weights for policy 0, policy_version 1777501 (0.0009) [2023-12-26 13:47:18,567][123091] Updated weights for policy 0, policy_version 1777511 (0.0008) [2023-12-26 13:47:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 907001856. Throughput: 0: 9205.0, 1: 8581.3. Samples: 907013060. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:18,785][121949] Avg episode reward: [(0, '6379.897'), (1, '5933.089')] [2023-12-26 13:47:18,952][123090] Updated weights for policy 1, policy_version 1765450 (0.0011) [2023-12-26 13:47:19,023][123090] Updated weights for policy 1, policy_version 1765460 (0.0011) [2023-12-26 13:47:19,095][123090] Updated weights for policy 1, policy_version 1765470 (0.0011) [2023-12-26 13:47:19,428][123091] Updated weights for policy 0, policy_version 1777521 (0.0008) [2023-12-26 13:47:19,492][123091] Updated weights for policy 0, policy_version 1777531 (0.0008) [2023-12-26 13:47:19,554][123091] Updated weights for policy 0, policy_version 1777541 (0.0007) [2023-12-26 13:47:19,622][123091] Updated weights for policy 0, policy_version 1777551 (0.0005) [2023-12-26 13:47:19,950][123090] Updated weights for policy 1, policy_version 1765480 (0.0009) [2023-12-26 13:47:20,020][123090] Updated weights for policy 1, policy_version 1765490 (0.0007) [2023-12-26 13:47:20,087][123090] Updated weights for policy 1, policy_version 1765500 (0.0009) [2023-12-26 13:47:20,319][123091] Updated weights for policy 0, policy_version 1777561 (0.0006) [2023-12-26 13:47:20,385][123091] Updated weights for policy 0, policy_version 1777571 (0.0006) [2023-12-26 13:47:20,442][123091] Updated weights for policy 0, policy_version 1777581 (0.0005) [2023-12-26 13:47:20,962][123090] Updated weights for policy 1, policy_version 1765510 (0.0010) [2023-12-26 13:47:21,029][123090] Updated weights for policy 1, policy_version 1765520 (0.0010) [2023-12-26 13:47:21,098][123090] Updated weights for policy 1, policy_version 1765530 (0.0008) [2023-12-26 13:47:21,170][123091] Updated weights for policy 0, policy_version 1777591 (0.0006) [2023-12-26 13:47:21,233][123091] Updated weights for policy 0, policy_version 1777601 (0.0006) [2023-12-26 13:47:21,305][123091] Updated weights for policy 0, policy_version 1777611 (0.0006) [2023-12-26 13:47:21,927][123090] Updated weights for policy 1, policy_version 1765540 (0.0009) [2023-12-26 13:47:21,996][123090] Updated weights for policy 1, policy_version 1765550 (0.0009) [2023-12-26 13:47:22,027][123091] Updated weights for policy 0, policy_version 1777621 (0.0007) [2023-12-26 13:47:22,066][123090] Updated weights for policy 1, policy_version 1765560 (0.0006) [2023-12-26 13:47:22,100][123091] Updated weights for policy 0, policy_version 1777631 (0.0007) [2023-12-26 13:47:22,165][123091] Updated weights for policy 0, policy_version 1777641 (0.0009) [2023-12-26 13:47:22,888][123090] Updated weights for policy 1, policy_version 1765570 (0.0010) [2023-12-26 13:47:22,954][123090] Updated weights for policy 1, policy_version 1765580 (0.0009) [2023-12-26 13:47:22,998][123091] Updated weights for policy 0, policy_version 1777651 (0.0010) [2023-12-26 13:47:23,017][123090] Updated weights for policy 1, policy_version 1765590 (0.0009) [2023-12-26 13:47:23,065][123091] Updated weights for policy 0, policy_version 1777661 (0.0011) [2023-12-26 13:47:23,077][123090] Updated weights for policy 1, policy_version 1765600 (0.0007) [2023-12-26 13:47:23,131][123091] Updated weights for policy 0, policy_version 1777671 (0.0010) [2023-12-26 13:47:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 907083776. Throughput: 0: 9206.9, 1: 8528.3. Samples: 907064656. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:23,785][121949] Avg episode reward: [(0, '6335.644'), (1, '5991.907')] [2023-12-26 13:47:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001777680_455090176.pth... [2023-12-26 13:47:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001765600_451993600.pth... [2023-12-26 13:47:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001776624_454819840.pth [2023-12-26 13:47:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001764576_451731456.pth [2023-12-26 13:47:23,904][123090] Updated weights for policy 1, policy_version 1765610 (0.0008) [2023-12-26 13:47:23,947][123091] Updated weights for policy 0, policy_version 1777681 (0.0010) [2023-12-26 13:47:23,968][123090] Updated weights for policy 1, policy_version 1765620 (0.0009) [2023-12-26 13:47:23,998][123091] Updated weights for policy 0, policy_version 1777691 (0.0006) [2023-12-26 13:47:24,018][123090] Updated weights for policy 1, policy_version 1765630 (0.0009) [2023-12-26 13:47:24,043][123091] Updated weights for policy 0, policy_version 1777701 (0.0005) [2023-12-26 13:47:24,091][123091] Updated weights for policy 0, policy_version 1777711 (0.0006) [2023-12-26 13:47:24,774][123091] Updated weights for policy 0, policy_version 1777721 (0.0005) [2023-12-26 13:47:24,839][123091] Updated weights for policy 0, policy_version 1777731 (0.0010) [2023-12-26 13:47:24,894][123091] Updated weights for policy 0, policy_version 1777742 (0.0010) [2023-12-26 13:47:24,916][123090] Updated weights for policy 1, policy_version 1765640 (0.0009) [2023-12-26 13:47:24,981][123090] Updated weights for policy 1, policy_version 1765650 (0.0009) [2023-12-26 13:47:25,048][123090] Updated weights for policy 1, policy_version 1765660 (0.0009) [2023-12-26 13:47:25,703][123091] Updated weights for policy 0, policy_version 1777752 (0.0006) [2023-12-26 13:47:25,763][123091] Updated weights for policy 0, policy_version 1777762 (0.0005) [2023-12-26 13:47:25,807][123090] Updated weights for policy 1, policy_version 1765670 (0.0009) [2023-12-26 13:47:25,818][123091] Updated weights for policy 0, policy_version 1777772 (0.0005) [2023-12-26 13:47:25,875][123090] Updated weights for policy 1, policy_version 1765680 (0.0010) [2023-12-26 13:47:25,923][123090] Updated weights for policy 1, policy_version 1765690 (0.0009) [2023-12-26 13:47:26,500][123091] Updated weights for policy 0, policy_version 1777782 (0.0005) [2023-12-26 13:47:26,547][123091] Updated weights for policy 0, policy_version 1777792 (0.0005) [2023-12-26 13:47:26,605][123091] Updated weights for policy 0, policy_version 1777802 (0.0005) [2023-12-26 13:47:26,832][123090] Updated weights for policy 1, policy_version 1765700 (0.0010) [2023-12-26 13:47:26,906][123090] Updated weights for policy 1, policy_version 1765710 (0.0009) [2023-12-26 13:47:26,970][123090] Updated weights for policy 1, policy_version 1765720 (0.0009) [2023-12-26 13:47:27,292][123091] Updated weights for policy 0, policy_version 1777812 (0.0007) [2023-12-26 13:47:27,356][123091] Updated weights for policy 0, policy_version 1777822 (0.0010) [2023-12-26 13:47:27,414][123091] Updated weights for policy 0, policy_version 1777832 (0.0010) [2023-12-26 13:47:27,798][123090] Updated weights for policy 1, policy_version 1765730 (0.0009) [2023-12-26 13:47:27,862][123090] Updated weights for policy 1, policy_version 1765740 (0.0005) [2023-12-26 13:47:27,910][123090] Updated weights for policy 1, policy_version 1765750 (0.0005) [2023-12-26 13:47:27,958][123090] Updated weights for policy 1, policy_version 1765760 (0.0005) [2023-12-26 13:47:28,138][123091] Updated weights for policy 0, policy_version 1777842 (0.0009) [2023-12-26 13:47:28,206][123091] Updated weights for policy 0, policy_version 1777852 (0.0005) [2023-12-26 13:47:28,277][123091] Updated weights for policy 0, policy_version 1777862 (0.0006) [2023-12-26 13:47:28,343][123091] Updated weights for policy 0, policy_version 1777872 (0.0009) [2023-12-26 13:47:28,722][123090] Updated weights for policy 1, policy_version 1765770 (0.0009) [2023-12-26 13:47:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 907173888. Throughput: 0: 9254.4, 1: 8508.8. Samples: 907170332. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:28,785][121949] Avg episode reward: [(0, '6269.416'), (1, '5797.352')] [2023-12-26 13:47:28,789][123090] Updated weights for policy 1, policy_version 1765780 (0.0008) [2023-12-26 13:47:28,853][123090] Updated weights for policy 1, policy_version 1765790 (0.0010) [2023-12-26 13:47:29,139][123091] Updated weights for policy 0, policy_version 1777882 (0.0009) [2023-12-26 13:47:29,197][123091] Updated weights for policy 0, policy_version 1777892 (0.0010) [2023-12-26 13:47:29,265][123091] Updated weights for policy 0, policy_version 1777902 (0.0009) [2023-12-26 13:47:29,596][123090] Updated weights for policy 1, policy_version 1765800 (0.0006) [2023-12-26 13:47:29,643][123090] Updated weights for policy 1, policy_version 1765810 (0.0005) [2023-12-26 13:47:29,691][123090] Updated weights for policy 1, policy_version 1765820 (0.0005) [2023-12-26 13:47:30,008][123091] Updated weights for policy 0, policy_version 1777912 (0.0006) [2023-12-26 13:47:30,078][123091] Updated weights for policy 0, policy_version 1777922 (0.0009) [2023-12-26 13:47:30,146][123091] Updated weights for policy 0, policy_version 1777932 (0.0010) [2023-12-26 13:47:30,446][123090] Updated weights for policy 1, policy_version 1765830 (0.0005) [2023-12-26 13:47:30,496][123090] Updated weights for policy 1, policy_version 1765840 (0.0005) [2023-12-26 13:47:30,542][123090] Updated weights for policy 1, policy_version 1765850 (0.0005) [2023-12-26 13:47:30,923][123091] Updated weights for policy 0, policy_version 1777942 (0.0009) [2023-12-26 13:47:30,974][123091] Updated weights for policy 0, policy_version 1777952 (0.0010) [2023-12-26 13:47:31,035][123091] Updated weights for policy 0, policy_version 1777962 (0.0009) [2023-12-26 13:47:31,307][123090] Updated weights for policy 1, policy_version 1765860 (0.0006) [2023-12-26 13:47:31,386][123090] Updated weights for policy 1, policy_version 1765870 (0.0009) [2023-12-26 13:47:31,442][123090] Updated weights for policy 1, policy_version 1765880 (0.0010) [2023-12-26 13:47:31,943][123091] Updated weights for policy 0, policy_version 1777972 (0.0009) [2023-12-26 13:47:32,003][123091] Updated weights for policy 0, policy_version 1777982 (0.0008) [2023-12-26 13:47:32,070][123091] Updated weights for policy 0, policy_version 1777992 (0.0010) [2023-12-26 13:47:32,197][123090] Updated weights for policy 1, policy_version 1765890 (0.0009) [2023-12-26 13:47:32,267][123090] Updated weights for policy 1, policy_version 1765900 (0.0010) [2023-12-26 13:47:32,333][123090] Updated weights for policy 1, policy_version 1765910 (0.0010) [2023-12-26 13:47:32,406][123090] Updated weights for policy 1, policy_version 1765920 (0.0008) [2023-12-26 13:47:32,890][123091] Updated weights for policy 0, policy_version 1778002 (0.0009) [2023-12-26 13:47:32,942][123091] Updated weights for policy 0, policy_version 1778012 (0.0010) [2023-12-26 13:47:32,995][123091] Updated weights for policy 0, policy_version 1778022 (0.0009) [2023-12-26 13:47:33,061][123091] Updated weights for policy 0, policy_version 1778032 (0.0010) [2023-12-26 13:47:33,175][123090] Updated weights for policy 1, policy_version 1765930 (0.0009) [2023-12-26 13:47:33,235][123090] Updated weights for policy 1, policy_version 1765940 (0.0010) [2023-12-26 13:47:33,295][123090] Updated weights for policy 1, policy_version 1765950 (0.0007) [2023-12-26 13:47:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 907264000. Throughput: 0: 9123.7, 1: 8681.6. Samples: 907278520. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:33,786][121949] Avg episode reward: [(0, '6304.209'), (1, '5676.714')] [2023-12-26 13:47:33,891][123091] Updated weights for policy 0, policy_version 1778042 (0.0010) [2023-12-26 13:47:33,943][123091] Updated weights for policy 0, policy_version 1778053 (0.0010) [2023-12-26 13:47:33,991][123091] Updated weights for policy 0, policy_version 1778063 (0.0008) [2023-12-26 13:47:34,001][123090] Updated weights for policy 1, policy_version 1765960 (0.0005) [2023-12-26 13:47:34,048][123090] Updated weights for policy 1, policy_version 1765970 (0.0005) [2023-12-26 13:47:34,109][123090] Updated weights for policy 1, policy_version 1765980 (0.0006) [2023-12-26 13:47:34,901][123090] Updated weights for policy 1, policy_version 1765990 (0.0008) [2023-12-26 13:47:34,903][123091] Updated weights for policy 0, policy_version 1778073 (0.0008) [2023-12-26 13:47:34,951][123091] Updated weights for policy 0, policy_version 1778083 (0.0010) [2023-12-26 13:47:34,957][123090] Updated weights for policy 1, policy_version 1766000 (0.0006) [2023-12-26 13:47:34,999][123091] Updated weights for policy 0, policy_version 1778093 (0.0010) [2023-12-26 13:47:35,018][123090] Updated weights for policy 1, policy_version 1766010 (0.0009) [2023-12-26 13:47:35,833][123090] Updated weights for policy 1, policy_version 1766020 (0.0007) [2023-12-26 13:47:35,836][123091] Updated weights for policy 0, policy_version 1778103 (0.0010) [2023-12-26 13:47:35,888][123091] Updated weights for policy 0, policy_version 1778113 (0.0010) [2023-12-26 13:47:35,888][123090] Updated weights for policy 1, policy_version 1766030 (0.0005) [2023-12-26 13:47:35,934][123090] Updated weights for policy 1, policy_version 1766040 (0.0005) [2023-12-26 13:47:35,940][123091] Updated weights for policy 0, policy_version 1778123 (0.0010) [2023-12-26 13:47:36,738][123090] Updated weights for policy 1, policy_version 1766050 (0.0007) [2023-12-26 13:47:36,798][123091] Updated weights for policy 0, policy_version 1778133 (0.0011) [2023-12-26 13:47:36,801][123090] Updated weights for policy 1, policy_version 1766060 (0.0008) [2023-12-26 13:47:36,850][123091] Updated weights for policy 0, policy_version 1778143 (0.0011) [2023-12-26 13:47:36,864][123090] Updated weights for policy 1, policy_version 1766070 (0.0007) [2023-12-26 13:47:36,902][123091] Updated weights for policy 0, policy_version 1778153 (0.0011) [2023-12-26 13:47:36,921][123090] Updated weights for policy 1, policy_version 1766080 (0.0009) [2023-12-26 13:47:37,760][123090] Updated weights for policy 1, policy_version 1766090 (0.0009) [2023-12-26 13:47:37,763][123091] Updated weights for policy 0, policy_version 1778163 (0.0011) [2023-12-26 13:47:37,826][123090] Updated weights for policy 1, policy_version 1766100 (0.0006) [2023-12-26 13:47:37,827][123091] Updated weights for policy 0, policy_version 1778173 (0.0011) [2023-12-26 13:47:37,876][123091] Updated weights for policy 0, policy_version 1778183 (0.0011) [2023-12-26 13:47:37,887][123090] Updated weights for policy 1, policy_version 1766110 (0.0006) [2023-12-26 13:47:38,678][123090] Updated weights for policy 1, policy_version 1766120 (0.0010) [2023-12-26 13:47:38,726][123091] Updated weights for policy 0, policy_version 1778193 (0.0011) [2023-12-26 13:47:38,730][123090] Updated weights for policy 1, policy_version 1766130 (0.0010) [2023-12-26 13:47:38,778][123090] Updated weights for policy 1, policy_version 1766140 (0.0010) [2023-12-26 13:47:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 907345920. Throughput: 0: 9063.4, 1: 8764.2. Samples: 907331256. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:38,785][121949] Avg episode reward: [(0, '6209.386'), (1, '5608.459')] [2023-12-26 13:47:38,789][123091] Updated weights for policy 0, policy_version 1778203 (0.0011) [2023-12-26 13:47:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001766144_452132864.pth... [2023-12-26 13:47:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001765120_451870720.pth [2023-12-26 13:47:38,856][123091] Updated weights for policy 0, policy_version 1778213 (0.0011) [2023-12-26 13:47:38,919][123091] Updated weights for policy 0, policy_version 1778223 (0.0011) [2023-12-26 13:47:38,925][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001778224_455229440.pth... [2023-12-26 13:47:38,930][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001777168_454959104.pth [2023-12-26 13:47:39,602][123090] Updated weights for policy 1, policy_version 1766150 (0.0009) [2023-12-26 13:47:39,670][123090] Updated weights for policy 1, policy_version 1766160 (0.0009) [2023-12-26 13:47:39,717][123091] Updated weights for policy 0, policy_version 1778233 (0.0008) [2023-12-26 13:47:39,730][123090] Updated weights for policy 1, policy_version 1766170 (0.0011) [2023-12-26 13:47:39,780][123091] Updated weights for policy 0, policy_version 1778243 (0.0008) [2023-12-26 13:47:39,850][123091] Updated weights for policy 0, policy_version 1778253 (0.0008) [2023-12-26 13:47:40,551][123090] Updated weights for policy 1, policy_version 1766180 (0.0010) [2023-12-26 13:47:40,566][123091] Updated weights for policy 0, policy_version 1778263 (0.0005) [2023-12-26 13:47:40,614][123091] Updated weights for policy 0, policy_version 1778273 (0.0005) [2023-12-26 13:47:40,619][123090] Updated weights for policy 1, policy_version 1766190 (0.0006) [2023-12-26 13:47:40,658][123091] Updated weights for policy 0, policy_version 1778283 (0.0005) [2023-12-26 13:47:40,673][123090] Updated weights for policy 1, policy_version 1766200 (0.0010) [2023-12-26 13:47:41,449][123091] Updated weights for policy 0, policy_version 1778293 (0.0007) [2023-12-26 13:47:41,503][123090] Updated weights for policy 1, policy_version 1766210 (0.0011) [2023-12-26 13:47:41,518][123091] Updated weights for policy 0, policy_version 1778303 (0.0009) [2023-12-26 13:47:41,571][123090] Updated weights for policy 1, policy_version 1766220 (0.0011) [2023-12-26 13:47:41,574][123091] Updated weights for policy 0, policy_version 1778313 (0.0006) [2023-12-26 13:47:41,640][123090] Updated weights for policy 1, policy_version 1766230 (0.0011) [2023-12-26 13:47:41,712][123090] Updated weights for policy 1, policy_version 1766240 (0.0011) [2023-12-26 13:47:42,435][123091] Updated weights for policy 0, policy_version 1778323 (0.0007) [2023-12-26 13:47:42,511][123091] Updated weights for policy 0, policy_version 1778333 (0.0006) [2023-12-26 13:47:42,556][123090] Updated weights for policy 1, policy_version 1766250 (0.0008) [2023-12-26 13:47:42,579][123091] Updated weights for policy 0, policy_version 1778343 (0.0008) [2023-12-26 13:47:42,631][123090] Updated weights for policy 1, policy_version 1766260 (0.0006) [2023-12-26 13:47:42,700][123090] Updated weights for policy 1, policy_version 1766270 (0.0008) [2023-12-26 13:47:43,286][123090] Updated weights for policy 1, policy_version 1766280 (0.0006) [2023-12-26 13:47:43,317][123091] Updated weights for policy 0, policy_version 1778353 (0.0008) [2023-12-26 13:47:43,354][123090] Updated weights for policy 1, policy_version 1766290 (0.0007) [2023-12-26 13:47:43,383][123091] Updated weights for policy 0, policy_version 1778363 (0.0008) [2023-12-26 13:47:43,418][123090] Updated weights for policy 1, policy_version 1766300 (0.0008) [2023-12-26 13:47:43,454][123091] Updated weights for policy 0, policy_version 1778373 (0.0009) [2023-12-26 13:47:43,519][123091] Updated weights for policy 0, policy_version 1778383 (0.0008) [2023-12-26 13:47:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 907444224. Throughput: 0: 8909.2, 1: 8763.1. Samples: 907434548. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:43,785][121949] Avg episode reward: [(0, '6146.386'), (1, '5769.383')] [2023-12-26 13:47:44,161][123090] Updated weights for policy 1, policy_version 1766310 (0.0007) [2023-12-26 13:47:44,212][123090] Updated weights for policy 1, policy_version 1766320 (0.0005) [2023-12-26 13:47:44,263][123091] Updated weights for policy 0, policy_version 1778393 (0.0006) [2023-12-26 13:47:44,267][123090] Updated weights for policy 1, policy_version 1766330 (0.0005) [2023-12-26 13:47:44,325][123091] Updated weights for policy 0, policy_version 1778403 (0.0006) [2023-12-26 13:47:44,397][123091] Updated weights for policy 0, policy_version 1778413 (0.0005) [2023-12-26 13:47:44,979][123090] Updated weights for policy 1, policy_version 1766340 (0.0005) [2023-12-26 13:47:45,048][123090] Updated weights for policy 1, policy_version 1766350 (0.0009) [2023-12-26 13:47:45,050][123091] Updated weights for policy 0, policy_version 1778423 (0.0007) [2023-12-26 13:47:45,108][123091] Updated weights for policy 0, policy_version 1778433 (0.0009) [2023-12-26 13:47:45,120][123090] Updated weights for policy 1, policy_version 1766360 (0.0005) [2023-12-26 13:47:45,161][123091] Updated weights for policy 0, policy_version 1778443 (0.0010) [2023-12-26 13:47:45,882][123091] Updated weights for policy 0, policy_version 1778453 (0.0009) [2023-12-26 13:47:45,890][123090] Updated weights for policy 1, policy_version 1766370 (0.0007) [2023-12-26 13:47:45,947][123090] Updated weights for policy 1, policy_version 1766380 (0.0011) [2023-12-26 13:47:45,949][123091] Updated weights for policy 0, policy_version 1778463 (0.0009) [2023-12-26 13:47:46,003][123091] Updated weights for policy 0, policy_version 1778473 (0.0006) [2023-12-26 13:47:46,007][123090] Updated weights for policy 1, policy_version 1766390 (0.0011) [2023-12-26 13:47:46,070][123090] Updated weights for policy 1, policy_version 1766400 (0.0011) [2023-12-26 13:47:46,687][123091] Updated weights for policy 0, policy_version 1778483 (0.0005) [2023-12-26 13:47:46,744][123091] Updated weights for policy 0, policy_version 1778493 (0.0005) [2023-12-26 13:47:46,805][123091] Updated weights for policy 0, policy_version 1778503 (0.0006) [2023-12-26 13:47:46,825][123090] Updated weights for policy 1, policy_version 1766410 (0.0005) [2023-12-26 13:47:46,881][123090] Updated weights for policy 1, policy_version 1766420 (0.0006) [2023-12-26 13:47:46,941][123090] Updated weights for policy 1, policy_version 1766430 (0.0005) [2023-12-26 13:47:47,586][123090] Updated weights for policy 1, policy_version 1766440 (0.0006) [2023-12-26 13:47:47,628][123091] Updated weights for policy 0, policy_version 1778513 (0.0010) [2023-12-26 13:47:47,641][123090] Updated weights for policy 1, policy_version 1766450 (0.0007) [2023-12-26 13:47:47,685][123091] Updated weights for policy 0, policy_version 1778523 (0.0005) [2023-12-26 13:47:47,700][123090] Updated weights for policy 1, policy_version 1766460 (0.0010) [2023-12-26 13:47:47,738][123091] Updated weights for policy 0, policy_version 1778533 (0.0009) [2023-12-26 13:47:47,787][123091] Updated weights for policy 0, policy_version 1778543 (0.0009) [2023-12-26 13:47:48,492][123090] Updated weights for policy 1, policy_version 1766470 (0.0008) [2023-12-26 13:47:48,565][123090] Updated weights for policy 1, policy_version 1766480 (0.0006) [2023-12-26 13:47:48,633][123091] Updated weights for policy 0, policy_version 1778553 (0.0008) [2023-12-26 13:47:48,642][123090] Updated weights for policy 1, policy_version 1766490 (0.0008) [2023-12-26 13:47:48,689][123091] Updated weights for policy 0, policy_version 1778563 (0.0007) [2023-12-26 13:47:48,741][123091] Updated weights for policy 0, policy_version 1778573 (0.0005) [2023-12-26 13:47:48,784][121949] Fps is (10 sec: 19660.3, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 907542528. Throughput: 0: 8880.6, 1: 8854.3. Samples: 907548728. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:48,786][121949] Avg episode reward: [(0, '6145.364'), (1, '5894.726')] [2023-12-26 13:47:49,364][123090] Updated weights for policy 1, policy_version 1766500 (0.0009) [2023-12-26 13:47:49,374][123091] Updated weights for policy 0, policy_version 1778583 (0.0008) [2023-12-26 13:47:49,429][123090] Updated weights for policy 1, policy_version 1766510 (0.0011) [2023-12-26 13:47:49,436][123091] Updated weights for policy 0, policy_version 1778593 (0.0007) [2023-12-26 13:47:49,493][123090] Updated weights for policy 1, policy_version 1766520 (0.0011) [2023-12-26 13:47:49,501][123091] Updated weights for policy 0, policy_version 1778603 (0.0006) [2023-12-26 13:47:50,248][123090] Updated weights for policy 1, policy_version 1766530 (0.0010) [2023-12-26 13:47:50,310][123090] Updated weights for policy 1, policy_version 1766540 (0.0006) [2023-12-26 13:47:50,369][123090] Updated weights for policy 1, policy_version 1766550 (0.0008) [2023-12-26 13:47:50,380][123091] Updated weights for policy 0, policy_version 1778613 (0.0007) [2023-12-26 13:47:50,434][123090] Updated weights for policy 1, policy_version 1766560 (0.0008) [2023-12-26 13:47:50,444][123091] Updated weights for policy 0, policy_version 1778623 (0.0008) [2023-12-26 13:47:50,507][123091] Updated weights for policy 0, policy_version 1778633 (0.0009) [2023-12-26 13:47:51,285][123090] Updated weights for policy 1, policy_version 1766570 (0.0008) [2023-12-26 13:47:51,318][123091] Updated weights for policy 0, policy_version 1778644 (0.0009) [2023-12-26 13:47:51,363][123090] Updated weights for policy 1, policy_version 1766580 (0.0009) [2023-12-26 13:47:51,387][123091] Updated weights for policy 0, policy_version 1778654 (0.0007) [2023-12-26 13:47:51,435][123090] Updated weights for policy 1, policy_version 1766590 (0.0010) [2023-12-26 13:47:51,448][123091] Updated weights for policy 0, policy_version 1778664 (0.0008) [2023-12-26 13:47:52,179][123090] Updated weights for policy 1, policy_version 1766600 (0.0010) [2023-12-26 13:47:52,230][123090] Updated weights for policy 1, policy_version 1766610 (0.0010) [2023-12-26 13:47:52,257][123091] Updated weights for policy 0, policy_version 1778674 (0.0010) [2023-12-26 13:47:52,294][123090] Updated weights for policy 1, policy_version 1766620 (0.0011) [2023-12-26 13:47:52,332][123091] Updated weights for policy 0, policy_version 1778684 (0.0007) [2023-12-26 13:47:52,402][123091] Updated weights for policy 0, policy_version 1778694 (0.0009) [2023-12-26 13:47:52,472][123091] Updated weights for policy 0, policy_version 1778704 (0.0009) [2023-12-26 13:47:53,130][123090] Updated weights for policy 1, policy_version 1766630 (0.0011) [2023-12-26 13:47:53,187][123090] Updated weights for policy 1, policy_version 1766640 (0.0010) [2023-12-26 13:47:53,224][123091] Updated weights for policy 0, policy_version 1778714 (0.0007) [2023-12-26 13:47:53,242][123090] Updated weights for policy 1, policy_version 1766650 (0.0010) [2023-12-26 13:47:53,275][123091] Updated weights for policy 0, policy_version 1778724 (0.0008) [2023-12-26 13:47:53,331][123091] Updated weights for policy 0, policy_version 1778734 (0.0005) [2023-12-26 13:47:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 907624448. Throughput: 0: 8907.7, 1: 8832.8. Samples: 907601716. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:53,785][121949] Avg episode reward: [(0, '6258.696'), (1, '5709.997')] [2023-12-26 13:47:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001778736_455360512.pth... [2023-12-26 13:47:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001766656_452263936.pth... [2023-12-26 13:47:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001777680_455090176.pth [2023-12-26 13:47:53,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001765600_451993600.pth [2023-12-26 13:47:54,014][123091] Updated weights for policy 0, policy_version 1778744 (0.0008) [2023-12-26 13:47:54,076][123091] Updated weights for policy 0, policy_version 1778754 (0.0009) [2023-12-26 13:47:54,087][123090] Updated weights for policy 1, policy_version 1766660 (0.0009) [2023-12-26 13:47:54,128][123091] Updated weights for policy 0, policy_version 1778764 (0.0006) [2023-12-26 13:47:54,142][123090] Updated weights for policy 1, policy_version 1766670 (0.0010) [2023-12-26 13:47:54,192][123090] Updated weights for policy 1, policy_version 1766680 (0.0009) [2023-12-26 13:47:54,928][123091] Updated weights for policy 0, policy_version 1778774 (0.0008) [2023-12-26 13:47:54,995][123091] Updated weights for policy 0, policy_version 1778784 (0.0009) [2023-12-26 13:47:54,996][123090] Updated weights for policy 1, policy_version 1766690 (0.0009) [2023-12-26 13:47:55,061][123091] Updated weights for policy 0, policy_version 1778794 (0.0010) [2023-12-26 13:47:55,063][123090] Updated weights for policy 1, policy_version 1766700 (0.0006) [2023-12-26 13:47:55,121][123090] Updated weights for policy 1, policy_version 1766710 (0.0009) [2023-12-26 13:47:55,181][123090] Updated weights for policy 1, policy_version 1766720 (0.0009) [2023-12-26 13:47:55,796][123091] Updated weights for policy 0, policy_version 1778804 (0.0009) [2023-12-26 13:47:55,852][123091] Updated weights for policy 0, policy_version 1778814 (0.0009) [2023-12-26 13:47:55,901][123091] Updated weights for policy 0, policy_version 1778824 (0.0008) [2023-12-26 13:47:55,941][123090] Updated weights for policy 1, policy_version 1766730 (0.0008) [2023-12-26 13:47:56,000][123090] Updated weights for policy 1, policy_version 1766740 (0.0009) [2023-12-26 13:47:56,064][123090] Updated weights for policy 1, policy_version 1766750 (0.0008) [2023-12-26 13:47:56,740][123091] Updated weights for policy 0, policy_version 1778834 (0.0008) [2023-12-26 13:47:56,802][123091] Updated weights for policy 0, policy_version 1778844 (0.0009) [2023-12-26 13:47:56,862][123091] Updated weights for policy 0, policy_version 1778854 (0.0009) [2023-12-26 13:47:56,882][123090] Updated weights for policy 1, policy_version 1766760 (0.0008) [2023-12-26 13:47:56,926][123091] Updated weights for policy 0, policy_version 1778864 (0.0009) [2023-12-26 13:47:56,942][123090] Updated weights for policy 1, policy_version 1766770 (0.0008) [2023-12-26 13:47:56,991][123090] Updated weights for policy 1, policy_version 1766780 (0.0009) [2023-12-26 13:47:57,748][123091] Updated weights for policy 0, policy_version 1778874 (0.0010) [2023-12-26 13:47:57,781][123090] Updated weights for policy 1, policy_version 1766790 (0.0008) [2023-12-26 13:47:57,801][123091] Updated weights for policy 0, policy_version 1778884 (0.0009) [2023-12-26 13:47:57,829][123090] Updated weights for policy 1, policy_version 1766800 (0.0008) [2023-12-26 13:47:57,850][123091] Updated weights for policy 0, policy_version 1778894 (0.0009) [2023-12-26 13:47:57,878][123090] Updated weights for policy 1, policy_version 1766810 (0.0007) [2023-12-26 13:47:58,752][123091] Updated weights for policy 0, policy_version 1778904 (0.0008) [2023-12-26 13:47:58,784][121949] Fps is (10 sec: 16384.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 907706368. Throughput: 0: 8965.0, 1: 8879.1. Samples: 907708540. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:47:58,784][121949] Avg episode reward: [(0, '6358.688'), (1, '5800.261')] [2023-12-26 13:47:58,807][123090] Updated weights for policy 1, policy_version 1766820 (0.0009) [2023-12-26 13:47:58,831][123091] Updated weights for policy 0, policy_version 1778914 (0.0009) [2023-12-26 13:47:58,866][123090] Updated weights for policy 1, policy_version 1766830 (0.0009) [2023-12-26 13:47:58,895][123091] Updated weights for policy 0, policy_version 1778924 (0.0006) [2023-12-26 13:47:58,938][123090] Updated weights for policy 1, policy_version 1766840 (0.0009) [2023-12-26 13:47:59,689][123091] Updated weights for policy 0, policy_version 1778934 (0.0007) [2023-12-26 13:47:59,757][123091] Updated weights for policy 0, policy_version 1778944 (0.0008) [2023-12-26 13:47:59,802][123090] Updated weights for policy 1, policy_version 1766850 (0.0009) [2023-12-26 13:47:59,827][123091] Updated weights for policy 0, policy_version 1778954 (0.0008) [2023-12-26 13:47:59,868][123090] Updated weights for policy 1, policy_version 1766860 (0.0009) [2023-12-26 13:47:59,931][123090] Updated weights for policy 1, policy_version 1766870 (0.0009) [2023-12-26 13:47:59,988][123090] Updated weights for policy 1, policy_version 1766880 (0.0009) [2023-12-26 13:48:00,539][123091] Updated weights for policy 0, policy_version 1778964 (0.0008) [2023-12-26 13:48:00,594][123091] Updated weights for policy 0, policy_version 1778974 (0.0008) [2023-12-26 13:48:00,649][123091] Updated weights for policy 0, policy_version 1778984 (0.0009) [2023-12-26 13:48:00,833][123090] Updated weights for policy 1, policy_version 1766890 (0.0010) [2023-12-26 13:48:00,889][123090] Updated weights for policy 1, policy_version 1766900 (0.0009) [2023-12-26 13:48:00,941][123090] Updated weights for policy 1, policy_version 1766910 (0.0009) [2023-12-26 13:48:01,490][123091] Updated weights for policy 0, policy_version 1778994 (0.0009) [2023-12-26 13:48:01,551][123091] Updated weights for policy 0, policy_version 1779004 (0.0009) [2023-12-26 13:48:01,609][123091] Updated weights for policy 0, policy_version 1779014 (0.0010) [2023-12-26 13:48:01,674][123091] Updated weights for policy 0, policy_version 1779024 (0.0010) [2023-12-26 13:48:01,810][123090] Updated weights for policy 1, policy_version 1766920 (0.0008) [2023-12-26 13:48:01,865][123090] Updated weights for policy 1, policy_version 1766930 (0.0008) [2023-12-26 13:48:01,922][123090] Updated weights for policy 1, policy_version 1766940 (0.0008) [2023-12-26 13:48:02,432][123091] Updated weights for policy 0, policy_version 1779034 (0.0008) [2023-12-26 13:48:02,490][123091] Updated weights for policy 0, policy_version 1779044 (0.0009) [2023-12-26 13:48:02,541][123091] Updated weights for policy 0, policy_version 1779054 (0.0009) [2023-12-26 13:48:02,765][123090] Updated weights for policy 1, policy_version 1766950 (0.0009) [2023-12-26 13:48:02,821][123090] Updated weights for policy 1, policy_version 1766960 (0.0009) [2023-12-26 13:48:02,888][123090] Updated weights for policy 1, policy_version 1766970 (0.0009) [2023-12-26 13:48:03,360][123091] Updated weights for policy 0, policy_version 1779064 (0.0009) [2023-12-26 13:48:03,418][123091] Updated weights for policy 0, policy_version 1779074 (0.0009) [2023-12-26 13:48:03,471][123091] Updated weights for policy 0, policy_version 1779084 (0.0010) [2023-12-26 13:48:03,681][123090] Updated weights for policy 1, policy_version 1766980 (0.0009) [2023-12-26 13:48:03,741][123090] Updated weights for policy 1, policy_version 1766990 (0.0009) [2023-12-26 13:48:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 907796480. Throughput: 0: 8931.4, 1: 8778.9. Samples: 907810024. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:48:03,785][121949] Avg episode reward: [(0, '6322.271'), (1, '5820.582')] [2023-12-26 13:48:03,797][123090] Updated weights for policy 1, policy_version 1767000 (0.0008) [2023-12-26 13:48:04,355][123091] Updated weights for policy 0, policy_version 1779094 (0.0009) [2023-12-26 13:48:04,418][123091] Updated weights for policy 0, policy_version 1779104 (0.0010) [2023-12-26 13:48:04,485][123091] Updated weights for policy 0, policy_version 1779114 (0.0011) [2023-12-26 13:48:04,657][123090] Updated weights for policy 1, policy_version 1767010 (0.0010) [2023-12-26 13:48:04,716][123090] Updated weights for policy 1, policy_version 1767020 (0.0010) [2023-12-26 13:48:04,785][123090] Updated weights for policy 1, policy_version 1767030 (0.0010) [2023-12-26 13:48:04,849][123090] Updated weights for policy 1, policy_version 1767040 (0.0009) [2023-12-26 13:48:05,265][123091] Updated weights for policy 0, policy_version 1779124 (0.0009) [2023-12-26 13:48:05,322][123091] Updated weights for policy 0, policy_version 1779134 (0.0005) [2023-12-26 13:48:05,370][123091] Updated weights for policy 0, policy_version 1779144 (0.0005) [2023-12-26 13:48:05,486][123090] Updated weights for policy 1, policy_version 1767050 (0.0005) [2023-12-26 13:48:05,558][123090] Updated weights for policy 1, policy_version 1767060 (0.0005) [2023-12-26 13:48:05,630][123090] Updated weights for policy 1, policy_version 1767070 (0.0006) [2023-12-26 13:48:06,161][123091] Updated weights for policy 0, policy_version 1779154 (0.0006) [2023-12-26 13:48:06,208][123090] Updated weights for policy 1, policy_version 1767080 (0.0009) [2023-12-26 13:48:06,223][123091] Updated weights for policy 0, policy_version 1779164 (0.0010) [2023-12-26 13:48:06,277][123090] Updated weights for policy 1, policy_version 1767090 (0.0011) [2023-12-26 13:48:06,284][123091] Updated weights for policy 0, policy_version 1779174 (0.0006) [2023-12-26 13:48:06,345][123090] Updated weights for policy 1, policy_version 1767100 (0.0011) [2023-12-26 13:48:06,348][123091] Updated weights for policy 0, policy_version 1779184 (0.0006) [2023-12-26 13:48:07,108][123090] Updated weights for policy 1, policy_version 1767110 (0.0010) [2023-12-26 13:48:07,118][123091] Updated weights for policy 0, policy_version 1779194 (0.0008) [2023-12-26 13:48:07,164][123090] Updated weights for policy 1, policy_version 1767120 (0.0010) [2023-12-26 13:48:07,174][123091] Updated weights for policy 0, policy_version 1779204 (0.0010) [2023-12-26 13:48:07,225][123090] Updated weights for policy 1, policy_version 1767130 (0.0010) [2023-12-26 13:48:07,226][123091] Updated weights for policy 0, policy_version 1779214 (0.0011) [2023-12-26 13:48:07,963][123090] Updated weights for policy 1, policy_version 1767140 (0.0008) [2023-12-26 13:48:08,017][123090] Updated weights for policy 1, policy_version 1767150 (0.0005) [2023-12-26 13:48:08,038][123091] Updated weights for policy 0, policy_version 1779224 (0.0009) [2023-12-26 13:48:08,075][123090] Updated weights for policy 1, policy_version 1767160 (0.0005) [2023-12-26 13:48:08,091][123091] Updated weights for policy 0, policy_version 1779234 (0.0009) [2023-12-26 13:48:08,140][123091] Updated weights for policy 0, policy_version 1779244 (0.0009) [2023-12-26 13:48:08,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.2, 300 sec: 17605.8). Total num frames: 907886592. Throughput: 0: 8913.8, 1: 8873.9. Samples: 907865100. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:48:08,785][121949] Avg episode reward: [(0, '6338.407'), (1, '5751.391')] [2023-12-26 13:48:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001779248_455491584.pth... [2023-12-26 13:48:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001767168_452395008.pth... [2023-12-26 13:48:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001778224_455229440.pth [2023-12-26 13:48:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001766144_452132864.pth [2023-12-26 13:48:08,831][123090] Updated weights for policy 1, policy_version 1767170 (0.0006) [2023-12-26 13:48:08,886][123090] Updated weights for policy 1, policy_version 1767180 (0.0005) [2023-12-26 13:48:08,938][123090] Updated weights for policy 1, policy_version 1767190 (0.0005) [2023-12-26 13:48:08,999][123090] Updated weights for policy 1, policy_version 1767200 (0.0007) [2023-12-26 13:48:09,019][123091] Updated weights for policy 0, policy_version 1779254 (0.0010) [2023-12-26 13:48:09,082][123091] Updated weights for policy 0, policy_version 1779264 (0.0011) [2023-12-26 13:48:09,145][123091] Updated weights for policy 0, policy_version 1779274 (0.0011) [2023-12-26 13:48:09,818][123090] Updated weights for policy 1, policy_version 1767210 (0.0006) [2023-12-26 13:48:09,889][123090] Updated weights for policy 1, policy_version 1767220 (0.0008) [2023-12-26 13:48:09,962][123090] Updated weights for policy 1, policy_version 1767230 (0.0008) [2023-12-26 13:48:09,977][123091] Updated weights for policy 0, policy_version 1779284 (0.0011) [2023-12-26 13:48:10,045][123091] Updated weights for policy 0, policy_version 1779294 (0.0011) [2023-12-26 13:48:10,111][123091] Updated weights for policy 0, policy_version 1779304 (0.0011) [2023-12-26 13:48:10,639][123090] Updated weights for policy 1, policy_version 1767240 (0.0006) [2023-12-26 13:48:10,687][123090] Updated weights for policy 1, policy_version 1767250 (0.0005) [2023-12-26 13:48:10,747][123090] Updated weights for policy 1, policy_version 1767260 (0.0005) [2023-12-26 13:48:10,847][123091] Updated weights for policy 0, policy_version 1779314 (0.0010) [2023-12-26 13:48:10,908][123091] Updated weights for policy 0, policy_version 1779324 (0.0005) [2023-12-26 13:48:10,967][123091] Updated weights for policy 0, policy_version 1779334 (0.0006) [2023-12-26 13:48:11,015][123091] Updated weights for policy 0, policy_version 1779344 (0.0005) [2023-12-26 13:48:11,507][123090] Updated weights for policy 1, policy_version 1767270 (0.0005) [2023-12-26 13:48:11,562][123090] Updated weights for policy 1, policy_version 1767280 (0.0006) [2023-12-26 13:48:11,625][123090] Updated weights for policy 1, policy_version 1767290 (0.0007) [2023-12-26 13:48:11,803][123091] Updated weights for policy 0, policy_version 1779354 (0.0009) [2023-12-26 13:48:11,857][123091] Updated weights for policy 0, policy_version 1779364 (0.0009) [2023-12-26 13:48:11,914][123091] Updated weights for policy 0, policy_version 1779374 (0.0006) [2023-12-26 13:48:12,418][123090] Updated weights for policy 1, policy_version 1767300 (0.0008) [2023-12-26 13:48:12,484][123090] Updated weights for policy 1, policy_version 1767310 (0.0009) [2023-12-26 13:48:12,548][123090] Updated weights for policy 1, policy_version 1767320 (0.0009) [2023-12-26 13:48:12,752][123091] Updated weights for policy 0, policy_version 1779384 (0.0009) [2023-12-26 13:48:12,815][123091] Updated weights for policy 0, policy_version 1779394 (0.0010) [2023-12-26 13:48:12,882][123091] Updated weights for policy 0, policy_version 1779404 (0.0009) [2023-12-26 13:48:13,365][123090] Updated weights for policy 1, policy_version 1767330 (0.0009) [2023-12-26 13:48:13,424][123090] Updated weights for policy 1, policy_version 1767340 (0.0007) [2023-12-26 13:48:13,480][123090] Updated weights for policy 1, policy_version 1767350 (0.0009) [2023-12-26 13:48:13,534][123090] Updated weights for policy 1, policy_version 1767360 (0.0010) [2023-12-26 13:48:13,583][123091] Updated weights for policy 0, policy_version 1779414 (0.0010) [2023-12-26 13:48:13,633][123091] Updated weights for policy 0, policy_version 1779424 (0.0009) [2023-12-26 13:48:13,683][123091] Updated weights for policy 0, policy_version 1779434 (0.0009) [2023-12-26 13:48:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 907984896. Throughput: 0: 8844.4, 1: 8991.8. Samples: 907972960. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:48:13,785][121949] Avg episode reward: [(0, '6341.055'), (1, '5750.615')] [2023-12-26 13:48:14,297][123090] Updated weights for policy 1, policy_version 1767370 (0.0009) [2023-12-26 13:48:14,358][123090] Updated weights for policy 1, policy_version 1767380 (0.0008) [2023-12-26 13:48:14,407][123090] Updated weights for policy 1, policy_version 1767390 (0.0010) [2023-12-26 13:48:14,596][123091] Updated weights for policy 0, policy_version 1779444 (0.0009) [2023-12-26 13:48:14,648][123091] Updated weights for policy 0, policy_version 1779454 (0.0009) [2023-12-26 13:48:14,714][123091] Updated weights for policy 0, policy_version 1779464 (0.0009) [2023-12-26 13:48:15,251][123090] Updated weights for policy 1, policy_version 1767400 (0.0010) [2023-12-26 13:48:15,308][123090] Updated weights for policy 1, policy_version 1767410 (0.0008) [2023-12-26 13:48:15,364][123090] Updated weights for policy 1, policy_version 1767420 (0.0010) [2023-12-26 13:48:15,568][123091] Updated weights for policy 0, policy_version 1779474 (0.0008) [2023-12-26 13:48:15,637][123091] Updated weights for policy 0, policy_version 1779484 (0.0009) [2023-12-26 13:48:15,689][123091] Updated weights for policy 0, policy_version 1779494 (0.0009) [2023-12-26 13:48:15,747][123091] Updated weights for policy 0, policy_version 1779504 (0.0008) [2023-12-26 13:48:16,129][123090] Updated weights for policy 1, policy_version 1767430 (0.0007) [2023-12-26 13:48:16,186][123090] Updated weights for policy 1, policy_version 1767440 (0.0005) [2023-12-26 13:48:16,243][123090] Updated weights for policy 1, policy_version 1767450 (0.0010) [2023-12-26 13:48:16,619][123091] Updated weights for policy 0, policy_version 1779514 (0.0006) [2023-12-26 13:48:16,671][123091] Updated weights for policy 0, policy_version 1779524 (0.0007) [2023-12-26 13:48:16,726][123091] Updated weights for policy 0, policy_version 1779534 (0.0006) [2023-12-26 13:48:16,952][123090] Updated weights for policy 1, policy_version 1767460 (0.0008) [2023-12-26 13:48:17,007][123090] Updated weights for policy 1, policy_version 1767470 (0.0005) [2023-12-26 13:48:17,065][123090] Updated weights for policy 1, policy_version 1767480 (0.0006) [2023-12-26 13:48:17,446][123091] Updated weights for policy 0, policy_version 1779544 (0.0006) [2023-12-26 13:48:17,505][123091] Updated weights for policy 0, policy_version 1779554 (0.0006) [2023-12-26 13:48:17,557][123091] Updated weights for policy 0, policy_version 1779564 (0.0006) [2023-12-26 13:48:17,837][123090] Updated weights for policy 1, policy_version 1767490 (0.0006) [2023-12-26 13:48:17,897][123090] Updated weights for policy 1, policy_version 1767500 (0.0010) [2023-12-26 13:48:17,974][123090] Updated weights for policy 1, policy_version 1767510 (0.0007) [2023-12-26 13:48:18,040][123090] Updated weights for policy 1, policy_version 1767520 (0.0006) [2023-12-26 13:48:18,142][123091] Updated weights for policy 0, policy_version 1779574 (0.0006) [2023-12-26 13:48:18,196][123091] Updated weights for policy 0, policy_version 1779584 (0.0006) [2023-12-26 13:48:18,243][123091] Updated weights for policy 0, policy_version 1779594 (0.0005) [2023-12-26 13:48:18,765][123090] Updated weights for policy 1, policy_version 1767530 (0.0010) [2023-12-26 13:48:18,784][121949] Fps is (10 sec: 18023.3, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 908066816. Throughput: 0: 8859.8, 1: 8993.2. Samples: 908081900. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:48:18,784][121949] Avg episode reward: [(0, '6219.820'), (1, '5826.250')] [2023-12-26 13:48:18,832][123090] Updated weights for policy 1, policy_version 1767540 (0.0010) [2023-12-26 13:48:18,891][123090] Updated weights for policy 1, policy_version 1767550 (0.0010) [2023-12-26 13:48:19,016][123091] Updated weights for policy 0, policy_version 1779604 (0.0005) [2023-12-26 13:48:19,086][123091] Updated weights for policy 0, policy_version 1779614 (0.0005) [2023-12-26 13:48:19,143][123091] Updated weights for policy 0, policy_version 1779624 (0.0005) [2023-12-26 13:48:19,715][123090] Updated weights for policy 1, policy_version 1767560 (0.0011) [2023-12-26 13:48:19,777][123090] Updated weights for policy 1, policy_version 1767570 (0.0011) [2023-12-26 13:48:19,853][123090] Updated weights for policy 1, policy_version 1767580 (0.0009) [2023-12-26 13:48:19,963][123091] Updated weights for policy 0, policy_version 1779634 (0.0006) [2023-12-26 13:48:20,025][123091] Updated weights for policy 0, policy_version 1779644 (0.0009) [2023-12-26 13:48:20,091][123091] Updated weights for policy 0, policy_version 1779654 (0.0009) [2023-12-26 13:48:20,162][123091] Updated weights for policy 0, policy_version 1779664 (0.0009) [2023-12-26 13:48:20,678][123090] Updated weights for policy 1, policy_version 1767590 (0.0009) [2023-12-26 13:48:20,751][123090] Updated weights for policy 1, policy_version 1767600 (0.0006) [2023-12-26 13:48:20,822][123090] Updated weights for policy 1, policy_version 1767610 (0.0010) [2023-12-26 13:48:20,948][123091] Updated weights for policy 0, policy_version 1779674 (0.0008) [2023-12-26 13:48:21,011][123091] Updated weights for policy 0, policy_version 1779684 (0.0008) [2023-12-26 13:48:21,083][123091] Updated weights for policy 0, policy_version 1779694 (0.0009) [2023-12-26 13:48:21,568][123090] Updated weights for policy 1, policy_version 1767620 (0.0010) [2023-12-26 13:48:21,636][123090] Updated weights for policy 1, policy_version 1767630 (0.0010) [2023-12-26 13:48:21,698][123090] Updated weights for policy 1, policy_version 1767640 (0.0010) [2023-12-26 13:48:21,837][123091] Updated weights for policy 0, policy_version 1779704 (0.0009) [2023-12-26 13:48:21,898][123091] Updated weights for policy 0, policy_version 1779714 (0.0010) [2023-12-26 13:48:21,953][123091] Updated weights for policy 0, policy_version 1779724 (0.0010) [2023-12-26 13:48:22,611][123090] Updated weights for policy 1, policy_version 1767650 (0.0010) [2023-12-26 13:48:22,678][123090] Updated weights for policy 1, policy_version 1767660 (0.0009) [2023-12-26 13:48:22,688][123091] Updated weights for policy 0, policy_version 1779734 (0.0008) [2023-12-26 13:48:22,739][123090] Updated weights for policy 1, policy_version 1767670 (0.0006) [2023-12-26 13:48:22,749][123091] Updated weights for policy 0, policy_version 1779744 (0.0010) [2023-12-26 13:48:22,805][123090] Updated weights for policy 1, policy_version 1767680 (0.0008) [2023-12-26 13:48:22,816][123091] Updated weights for policy 0, policy_version 1779754 (0.0007) [2023-12-26 13:48:23,623][123091] Updated weights for policy 0, policy_version 1779764 (0.0008) [2023-12-26 13:48:23,640][123090] Updated weights for policy 1, policy_version 1767690 (0.0008) [2023-12-26 13:48:23,686][123091] Updated weights for policy 0, policy_version 1779774 (0.0010) [2023-12-26 13:48:23,702][123090] Updated weights for policy 1, policy_version 1767700 (0.0009) [2023-12-26 13:48:23,752][123091] Updated weights for policy 0, policy_version 1779784 (0.0010) [2023-12-26 13:48:23,763][123090] Updated weights for policy 1, policy_version 1767710 (0.0008) [2023-12-26 13:48:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 908156928. Throughput: 0: 8890.0, 1: 8951.6. Samples: 908134132. Policy #0 lag: (min: 31.0, avg: 34.7, max: 63.0) [2023-12-26 13:48:23,785][121949] Avg episode reward: [(0, '6234.708'), (1, '5788.879')] [2023-12-26 13:48:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001767712_452534272.pth... [2023-12-26 13:48:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001766656_452263936.pth [2023-12-26 13:48:23,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001779792_455630848.pth... [2023-12-26 13:48:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001778736_455360512.pth [2023-12-26 13:48:24,564][123091] Updated weights for policy 0, policy_version 1779794 (0.0010) [2023-12-26 13:48:24,600][123090] Updated weights for policy 1, policy_version 1767720 (0.0008) [2023-12-26 13:48:24,625][123091] Updated weights for policy 0, policy_version 1779804 (0.0008) [2023-12-26 13:48:24,656][123090] Updated weights for policy 1, policy_version 1767730 (0.0008) [2023-12-26 13:48:24,685][123091] Updated weights for policy 0, policy_version 1779814 (0.0008) [2023-12-26 13:48:24,710][123090] Updated weights for policy 1, policy_version 1767740 (0.0008) [2023-12-26 13:48:24,745][123091] Updated weights for policy 0, policy_version 1779824 (0.0008) [2023-12-26 13:48:25,495][123091] Updated weights for policy 0, policy_version 1779834 (0.0009) [2023-12-26 13:48:25,504][123090] Updated weights for policy 1, policy_version 1767750 (0.0007) [2023-12-26 13:48:25,544][123091] Updated weights for policy 0, policy_version 1779844 (0.0008) [2023-12-26 13:48:25,563][123090] Updated weights for policy 1, policy_version 1767760 (0.0005) [2023-12-26 13:48:25,598][123091] Updated weights for policy 0, policy_version 1779854 (0.0009) [2023-12-26 13:48:25,627][123090] Updated weights for policy 1, policy_version 1767770 (0.0005) [2023-12-26 13:48:26,291][123090] Updated weights for policy 1, policy_version 1767780 (0.0005) [2023-12-26 13:48:26,355][123091] Updated weights for policy 0, policy_version 1779864 (0.0008) [2023-12-26 13:48:26,364][123090] Updated weights for policy 1, policy_version 1767790 (0.0007) [2023-12-26 13:48:26,403][123091] Updated weights for policy 0, policy_version 1779874 (0.0006) [2023-12-26 13:48:26,432][123090] Updated weights for policy 1, policy_version 1767800 (0.0009) [2023-12-26 13:48:26,454][123091] Updated weights for policy 0, policy_version 1779884 (0.0010) [2023-12-26 13:48:27,129][123091] Updated weights for policy 0, policy_version 1779894 (0.0007) [2023-12-26 13:48:27,172][123090] Updated weights for policy 1, policy_version 1767810 (0.0008) [2023-12-26 13:48:27,181][123091] Updated weights for policy 0, policy_version 1779904 (0.0005) [2023-12-26 13:48:27,237][123090] Updated weights for policy 1, policy_version 1767820 (0.0010) [2023-12-26 13:48:27,242][123091] Updated weights for policy 0, policy_version 1779914 (0.0005) [2023-12-26 13:48:27,303][123090] Updated weights for policy 1, policy_version 1767830 (0.0010) [2023-12-26 13:48:27,361][123090] Updated weights for policy 1, policy_version 1767840 (0.0007) [2023-12-26 13:48:27,879][123091] Updated weights for policy 0, policy_version 1779924 (0.0005) [2023-12-26 13:48:27,949][123091] Updated weights for policy 0, policy_version 1779934 (0.0005) [2023-12-26 13:48:27,952][123090] Updated weights for policy 1, policy_version 1767850 (0.0007) [2023-12-26 13:48:28,009][123091] Updated weights for policy 0, policy_version 1779944 (0.0005) [2023-12-26 13:48:28,011][123090] Updated weights for policy 1, policy_version 1767860 (0.0010) [2023-12-26 13:48:28,058][123090] Updated weights for policy 1, policy_version 1767870 (0.0010) [2023-12-26 13:48:28,584][123091] Updated weights for policy 0, policy_version 1779954 (0.0006) [2023-12-26 13:48:28,647][123091] Updated weights for policy 0, policy_version 1779964 (0.0011) [2023-12-26 13:48:28,717][123091] Updated weights for policy 0, policy_version 1779974 (0.0011) [2023-12-26 13:48:28,779][123091] Updated weights for policy 0, policy_version 1779984 (0.0010) [2023-12-26 13:48:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17633.6). Total num frames: 908255232. Throughput: 0: 8995.7, 1: 9011.8. Samples: 908244880. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:28,784][121949] Avg episode reward: [(0, '6384.814'), (1, '5898.098')] [2023-12-26 13:48:28,807][123090] Updated weights for policy 1, policy_version 1767880 (0.0006) [2023-12-26 13:48:28,872][123090] Updated weights for policy 1, policy_version 1767890 (0.0006) [2023-12-26 13:48:28,939][123090] Updated weights for policy 1, policy_version 1767900 (0.0006) [2023-12-26 13:48:29,608][123091] Updated weights for policy 0, policy_version 1779994 (0.0006) [2023-12-26 13:48:29,646][123090] Updated weights for policy 1, policy_version 1767910 (0.0005) [2023-12-26 13:48:29,681][123091] Updated weights for policy 0, policy_version 1780004 (0.0006) [2023-12-26 13:48:29,725][123090] Updated weights for policy 1, policy_version 1767920 (0.0006) [2023-12-26 13:48:29,750][123091] Updated weights for policy 0, policy_version 1780014 (0.0006) [2023-12-26 13:48:29,798][123090] Updated weights for policy 1, policy_version 1767930 (0.0005) [2023-12-26 13:48:30,500][123091] Updated weights for policy 0, policy_version 1780024 (0.0010) [2023-12-26 13:48:30,507][123090] Updated weights for policy 1, policy_version 1767940 (0.0008) [2023-12-26 13:48:30,551][123091] Updated weights for policy 0, policy_version 1780034 (0.0010) [2023-12-26 13:48:30,566][123090] Updated weights for policy 1, policy_version 1767950 (0.0007) [2023-12-26 13:48:30,598][123091] Updated weights for policy 0, policy_version 1780044 (0.0010) [2023-12-26 13:48:30,622][123090] Updated weights for policy 1, policy_version 1767960 (0.0006) [2023-12-26 13:48:31,373][123090] Updated weights for policy 1, policy_version 1767970 (0.0009) [2023-12-26 13:48:31,430][123090] Updated weights for policy 1, policy_version 1767980 (0.0009) [2023-12-26 13:48:31,453][123091] Updated weights for policy 0, policy_version 1780054 (0.0010) [2023-12-26 13:48:31,490][123090] Updated weights for policy 1, policy_version 1767990 (0.0006) [2023-12-26 13:48:31,501][123091] Updated weights for policy 0, policy_version 1780064 (0.0010) [2023-12-26 13:48:31,552][123091] Updated weights for policy 0, policy_version 1780074 (0.0010) [2023-12-26 13:48:31,554][123090] Updated weights for policy 1, policy_version 1768000 (0.0006) [2023-12-26 13:48:32,308][123090] Updated weights for policy 1, policy_version 1768010 (0.0010) [2023-12-26 13:48:32,379][123090] Updated weights for policy 1, policy_version 1768020 (0.0009) [2023-12-26 13:48:32,430][123091] Updated weights for policy 0, policy_version 1780084 (0.0011) [2023-12-26 13:48:32,439][123090] Updated weights for policy 1, policy_version 1768030 (0.0005) [2023-12-26 13:48:32,497][123091] Updated weights for policy 0, policy_version 1780094 (0.0011) [2023-12-26 13:48:32,572][123091] Updated weights for policy 0, policy_version 1780104 (0.0011) [2023-12-26 13:48:33,187][123090] Updated weights for policy 1, policy_version 1768040 (0.0008) [2023-12-26 13:48:33,238][123090] Updated weights for policy 1, policy_version 1768050 (0.0009) [2023-12-26 13:48:33,282][123091] Updated weights for policy 0, policy_version 1780114 (0.0009) [2023-12-26 13:48:33,289][123090] Updated weights for policy 1, policy_version 1768060 (0.0009) [2023-12-26 13:48:33,344][123091] Updated weights for policy 0, policy_version 1780124 (0.0005) [2023-12-26 13:48:33,413][123091] Updated weights for policy 0, policy_version 1780134 (0.0005) [2023-12-26 13:48:33,477][123091] Updated weights for policy 0, policy_version 1780144 (0.0005) [2023-12-26 13:48:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.5, 300 sec: 17661.4). Total num frames: 908345344. Throughput: 0: 8993.9, 1: 8968.9. Samples: 908357044. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:33,785][121949] Avg episode reward: [(0, '6392.686'), (1, '5899.489')] [2023-12-26 13:48:34,101][123090] Updated weights for policy 1, policy_version 1768070 (0.0010) [2023-12-26 13:48:34,157][123090] Updated weights for policy 1, policy_version 1768080 (0.0009) [2023-12-26 13:48:34,216][123090] Updated weights for policy 1, policy_version 1768090 (0.0009) [2023-12-26 13:48:34,219][123091] Updated weights for policy 0, policy_version 1780154 (0.0007) [2023-12-26 13:48:34,294][123091] Updated weights for policy 0, policy_version 1780164 (0.0006) [2023-12-26 13:48:34,371][123091] Updated weights for policy 0, policy_version 1780174 (0.0006) [2023-12-26 13:48:34,959][123090] Updated weights for policy 1, policy_version 1768100 (0.0010) [2023-12-26 13:48:34,960][123091] Updated weights for policy 0, policy_version 1780184 (0.0010) [2023-12-26 13:48:35,027][123090] Updated weights for policy 1, policy_version 1768110 (0.0011) [2023-12-26 13:48:35,033][123091] Updated weights for policy 0, policy_version 1780194 (0.0006) [2023-12-26 13:48:35,092][123090] Updated weights for policy 1, policy_version 1768120 (0.0011) [2023-12-26 13:48:35,095][123091] Updated weights for policy 0, policy_version 1780204 (0.0007) [2023-12-26 13:48:35,775][123091] Updated weights for policy 0, policy_version 1780214 (0.0008) [2023-12-26 13:48:35,805][123090] Updated weights for policy 1, policy_version 1768130 (0.0009) [2023-12-26 13:48:35,823][123091] Updated weights for policy 0, policy_version 1780224 (0.0010) [2023-12-26 13:48:35,859][123090] Updated weights for policy 1, policy_version 1768140 (0.0005) [2023-12-26 13:48:35,870][123091] Updated weights for policy 0, policy_version 1780234 (0.0010) [2023-12-26 13:48:35,912][123090] Updated weights for policy 1, policy_version 1768150 (0.0005) [2023-12-26 13:48:35,981][123090] Updated weights for policy 1, policy_version 1768160 (0.0006) [2023-12-26 13:48:36,683][123091] Updated weights for policy 0, policy_version 1780244 (0.0009) [2023-12-26 13:48:36,749][123091] Updated weights for policy 0, policy_version 1780254 (0.0008) [2023-12-26 13:48:36,770][123090] Updated weights for policy 1, policy_version 1768170 (0.0008) [2023-12-26 13:48:36,813][123091] Updated weights for policy 0, policy_version 1780264 (0.0011) [2023-12-26 13:48:36,826][123090] Updated weights for policy 1, policy_version 1768180 (0.0008) [2023-12-26 13:48:36,885][123090] Updated weights for policy 1, policy_version 1768190 (0.0007) [2023-12-26 13:48:37,577][123091] Updated weights for policy 0, policy_version 1780274 (0.0011) [2023-12-26 13:48:37,647][123091] Updated weights for policy 0, policy_version 1780284 (0.0011) [2023-12-26 13:48:37,721][123091] Updated weights for policy 0, policy_version 1780294 (0.0010) [2023-12-26 13:48:37,768][123091] Updated weights for policy 0, policy_version 1780304 (0.0010) [2023-12-26 13:48:37,775][123090] Updated weights for policy 1, policy_version 1768200 (0.0006) [2023-12-26 13:48:37,830][123090] Updated weights for policy 1, policy_version 1768210 (0.0009) [2023-12-26 13:48:37,890][123090] Updated weights for policy 1, policy_version 1768220 (0.0009) [2023-12-26 13:48:38,583][123091] Updated weights for policy 0, policy_version 1780314 (0.0006) [2023-12-26 13:48:38,649][123090] Updated weights for policy 1, policy_version 1768230 (0.0008) [2023-12-26 13:48:38,653][123091] Updated weights for policy 0, policy_version 1780324 (0.0007) [2023-12-26 13:48:38,708][123090] Updated weights for policy 1, policy_version 1768240 (0.0008) [2023-12-26 13:48:38,722][123091] Updated weights for policy 0, policy_version 1780334 (0.0007) [2023-12-26 13:48:38,775][123090] Updated weights for policy 1, policy_version 1768250 (0.0009) [2023-12-26 13:48:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17661.4). Total num frames: 908435456. Throughput: 0: 9030.9, 1: 9013.8. Samples: 908413724. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:38,784][121949] Avg episode reward: [(0, '6330.094'), (1, '5847.333')] [2023-12-26 13:48:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001780336_455770112.pth... [2023-12-26 13:48:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001779248_455491584.pth [2023-12-26 13:48:38,817][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001768256_452673536.pth... [2023-12-26 13:48:38,820][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001767168_452395008.pth [2023-12-26 13:48:39,491][123090] Updated weights for policy 1, policy_version 1768260 (0.0009) [2023-12-26 13:48:39,559][123090] Updated weights for policy 1, policy_version 1768270 (0.0010) [2023-12-26 13:48:39,591][123091] Updated weights for policy 0, policy_version 1780344 (0.0007) [2023-12-26 13:48:39,620][123090] Updated weights for policy 1, policy_version 1768280 (0.0008) [2023-12-26 13:48:39,656][123091] Updated weights for policy 0, policy_version 1780354 (0.0010) [2023-12-26 13:48:39,720][123091] Updated weights for policy 0, policy_version 1780364 (0.0010) [2023-12-26 13:48:40,413][123090] Updated weights for policy 1, policy_version 1768290 (0.0005) [2023-12-26 13:48:40,472][123090] Updated weights for policy 1, policy_version 1768300 (0.0005) [2023-12-26 13:48:40,527][123090] Updated weights for policy 1, policy_version 1768310 (0.0005) [2023-12-26 13:48:40,560][123091] Updated weights for policy 0, policy_version 1780374 (0.0009) [2023-12-26 13:48:40,592][123090] Updated weights for policy 1, policy_version 1768320 (0.0008) [2023-12-26 13:48:40,614][123091] Updated weights for policy 0, policy_version 1780384 (0.0008) [2023-12-26 13:48:40,662][123091] Updated weights for policy 0, policy_version 1780394 (0.0009) [2023-12-26 13:48:41,399][123090] Updated weights for policy 1, policy_version 1768330 (0.0008) [2023-12-26 13:48:41,474][123090] Updated weights for policy 1, policy_version 1768340 (0.0006) [2023-12-26 13:48:41,534][123090] Updated weights for policy 1, policy_version 1768350 (0.0009) [2023-12-26 13:48:41,549][123091] Updated weights for policy 0, policy_version 1780404 (0.0008) [2023-12-26 13:48:41,612][123091] Updated weights for policy 0, policy_version 1780414 (0.0010) [2023-12-26 13:48:41,686][123091] Updated weights for policy 0, policy_version 1780424 (0.0009) [2023-12-26 13:48:42,227][123090] Updated weights for policy 1, policy_version 1768360 (0.0006) [2023-12-26 13:48:42,287][123090] Updated weights for policy 1, policy_version 1768370 (0.0007) [2023-12-26 13:48:42,349][123090] Updated weights for policy 1, policy_version 1768380 (0.0007) [2023-12-26 13:48:42,553][123091] Updated weights for policy 0, policy_version 1780434 (0.0009) [2023-12-26 13:48:42,609][123091] Updated weights for policy 0, policy_version 1780444 (0.0006) [2023-12-26 13:48:42,680][123091] Updated weights for policy 0, policy_version 1780454 (0.0005) [2023-12-26 13:48:42,746][123091] Updated weights for policy 0, policy_version 1780464 (0.0005) [2023-12-26 13:48:43,149][123090] Updated weights for policy 1, policy_version 1768390 (0.0009) [2023-12-26 13:48:43,211][123090] Updated weights for policy 1, policy_version 1768400 (0.0009) [2023-12-26 13:48:43,271][123090] Updated weights for policy 1, policy_version 1768410 (0.0009) [2023-12-26 13:48:43,408][123091] Updated weights for policy 0, policy_version 1780474 (0.0006) [2023-12-26 13:48:43,473][123091] Updated weights for policy 0, policy_version 1780484 (0.0006) [2023-12-26 13:48:43,527][123091] Updated weights for policy 0, policy_version 1780494 (0.0005) [2023-12-26 13:48:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 908525568. Throughput: 0: 8937.8, 1: 9034.6. Samples: 908517296. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:43,785][121949] Avg episode reward: [(0, '6272.912'), (1, '5784.197')] [2023-12-26 13:48:44,191][123090] Updated weights for policy 1, policy_version 1768420 (0.0009) [2023-12-26 13:48:44,216][123091] Updated weights for policy 0, policy_version 1780504 (0.0005) [2023-12-26 13:48:44,263][123090] Updated weights for policy 1, policy_version 1768430 (0.0009) [2023-12-26 13:48:44,281][123091] Updated weights for policy 0, policy_version 1780514 (0.0007) [2023-12-26 13:48:44,334][123090] Updated weights for policy 1, policy_version 1768440 (0.0010) [2023-12-26 13:48:44,347][123091] Updated weights for policy 0, policy_version 1780524 (0.0010) [2023-12-26 13:48:45,114][123090] Updated weights for policy 1, policy_version 1768450 (0.0009) [2023-12-26 13:48:45,161][123091] Updated weights for policy 0, policy_version 1780534 (0.0010) [2023-12-26 13:48:45,170][123090] Updated weights for policy 1, policy_version 1768460 (0.0005) [2023-12-26 13:48:45,226][123091] Updated weights for policy 0, policy_version 1780544 (0.0008) [2023-12-26 13:48:45,240][123090] Updated weights for policy 1, policy_version 1768470 (0.0006) [2023-12-26 13:48:45,295][123091] Updated weights for policy 0, policy_version 1780554 (0.0008) [2023-12-26 13:48:45,316][123090] Updated weights for policy 1, policy_version 1768480 (0.0007) [2023-12-26 13:48:45,988][123091] Updated weights for policy 0, policy_version 1780564 (0.0006) [2023-12-26 13:48:46,019][123090] Updated weights for policy 1, policy_version 1768490 (0.0011) [2023-12-26 13:48:46,036][123091] Updated weights for policy 0, policy_version 1780574 (0.0008) [2023-12-26 13:48:46,070][123090] Updated weights for policy 1, policy_version 1768500 (0.0010) [2023-12-26 13:48:46,081][123091] Updated weights for policy 0, policy_version 1780584 (0.0008) [2023-12-26 13:48:46,118][123090] Updated weights for policy 1, policy_version 1768510 (0.0010) [2023-12-26 13:48:46,786][123090] Updated weights for policy 1, policy_version 1768520 (0.0006) [2023-12-26 13:48:46,836][123090] Updated weights for policy 1, policy_version 1768530 (0.0005) [2023-12-26 13:48:46,887][123090] Updated weights for policy 1, policy_version 1768540 (0.0005) [2023-12-26 13:48:46,981][123091] Updated weights for policy 0, policy_version 1780594 (0.0006) [2023-12-26 13:48:47,034][123091] Updated weights for policy 0, policy_version 1780604 (0.0010) [2023-12-26 13:48:47,091][123091] Updated weights for policy 0, policy_version 1780614 (0.0009) [2023-12-26 13:48:47,540][123090] Updated weights for policy 1, policy_version 1768550 (0.0005) [2023-12-26 13:48:47,607][123090] Updated weights for policy 1, policy_version 1768560 (0.0005) [2023-12-26 13:48:47,672][123090] Updated weights for policy 1, policy_version 1768570 (0.0005) [2023-12-26 13:48:47,984][123091] Updated weights for policy 0, policy_version 1780625 (0.0010) [2023-12-26 13:48:48,049][123091] Updated weights for policy 0, policy_version 1780635 (0.0005) [2023-12-26 13:48:48,107][123091] Updated weights for policy 0, policy_version 1780645 (0.0006) [2023-12-26 13:48:48,170][123091] Updated weights for policy 0, policy_version 1780655 (0.0008) [2023-12-26 13:48:48,343][123090] Updated weights for policy 1, policy_version 1768580 (0.0006) [2023-12-26 13:48:48,417][123090] Updated weights for policy 1, policy_version 1768590 (0.0006) [2023-12-26 13:48:48,486][123090] Updated weights for policy 1, policy_version 1768600 (0.0006) [2023-12-26 13:48:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 908615680. Throughput: 0: 8981.3, 1: 9169.9. Samples: 908626828. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:48,785][121949] Avg episode reward: [(0, '6330.825'), (1, '5561.663')] [2023-12-26 13:48:48,934][123091] Updated weights for policy 0, policy_version 1780665 (0.0008) [2023-12-26 13:48:48,982][123091] Updated weights for policy 0, policy_version 1780675 (0.0008) [2023-12-26 13:48:49,033][123091] Updated weights for policy 0, policy_version 1780685 (0.0008) [2023-12-26 13:48:49,290][123090] Updated weights for policy 1, policy_version 1768610 (0.0009) [2023-12-26 13:48:49,371][123090] Updated weights for policy 1, policy_version 1768620 (0.0013) [2023-12-26 13:48:49,431][123090] Updated weights for policy 1, policy_version 1768630 (0.0010) [2023-12-26 13:48:49,496][123090] Updated weights for policy 1, policy_version 1768640 (0.0010) [2023-12-26 13:48:49,848][123091] Updated weights for policy 0, policy_version 1780695 (0.0008) [2023-12-26 13:48:49,911][123091] Updated weights for policy 0, policy_version 1780705 (0.0007) [2023-12-26 13:48:49,980][123091] Updated weights for policy 0, policy_version 1780715 (0.0009) [2023-12-26 13:48:50,290][123090] Updated weights for policy 1, policy_version 1768650 (0.0008) [2023-12-26 13:48:50,365][123090] Updated weights for policy 1, policy_version 1768660 (0.0007) [2023-12-26 13:48:50,426][123090] Updated weights for policy 1, policy_version 1768670 (0.0008) [2023-12-26 13:48:50,798][123091] Updated weights for policy 0, policy_version 1780725 (0.0010) [2023-12-26 13:48:50,868][123091] Updated weights for policy 0, policy_version 1780735 (0.0007) [2023-12-26 13:48:50,923][123091] Updated weights for policy 0, policy_version 1780745 (0.0005) [2023-12-26 13:48:51,192][123090] Updated weights for policy 1, policy_version 1768680 (0.0009) [2023-12-26 13:48:51,260][123090] Updated weights for policy 1, policy_version 1768690 (0.0005) [2023-12-26 13:48:51,335][123090] Updated weights for policy 1, policy_version 1768700 (0.0007) [2023-12-26 13:48:51,774][123091] Updated weights for policy 0, policy_version 1780755 (0.0007) [2023-12-26 13:48:51,840][123091] Updated weights for policy 0, policy_version 1780765 (0.0009) [2023-12-26 13:48:51,895][123091] Updated weights for policy 0, policy_version 1780775 (0.0009) [2023-12-26 13:48:52,124][123090] Updated weights for policy 1, policy_version 1768710 (0.0007) [2023-12-26 13:48:52,191][123090] Updated weights for policy 1, policy_version 1768720 (0.0005) [2023-12-26 13:48:52,263][123090] Updated weights for policy 1, policy_version 1768730 (0.0007) [2023-12-26 13:48:52,759][123091] Updated weights for policy 0, policy_version 1780785 (0.0008) [2023-12-26 13:48:52,816][123091] Updated weights for policy 0, policy_version 1780796 (0.0009) [2023-12-26 13:48:52,882][123091] Updated weights for policy 0, policy_version 1780806 (0.0009) [2023-12-26 13:48:52,954][123091] Updated weights for policy 0, policy_version 1780816 (0.0009) [2023-12-26 13:48:53,020][123090] Updated weights for policy 1, policy_version 1768740 (0.0008) [2023-12-26 13:48:53,091][123090] Updated weights for policy 1, policy_version 1768750 (0.0006) [2023-12-26 13:48:53,143][123090] Updated weights for policy 1, policy_version 1768761 (0.0009) [2023-12-26 13:48:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 908697600. Throughput: 0: 8972.0, 1: 9120.7. Samples: 908679268. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:53,785][121949] Avg episode reward: [(0, '6254.728'), (1, '5509.958')] [2023-12-26 13:48:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001768768_452804608.pth... [2023-12-26 13:48:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001767712_452534272.pth [2023-12-26 13:48:53,825][123091] Updated weights for policy 0, policy_version 1780826 (0.0009) [2023-12-26 13:48:53,830][123090] Updated weights for policy 1, policy_version 1768771 (0.0008) [2023-12-26 13:48:53,891][123091] Updated weights for policy 0, policy_version 1780836 (0.0009) [2023-12-26 13:48:53,901][123090] Updated weights for policy 1, policy_version 1768781 (0.0005) [2023-12-26 13:48:53,946][123091] Updated weights for policy 0, policy_version 1780847 (0.0008) [2023-12-26 13:48:53,951][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001780848_455901184.pth... [2023-12-26 13:48:53,954][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001779792_455630848.pth [2023-12-26 13:48:53,966][123090] Updated weights for policy 1, policy_version 1768791 (0.0005) [2023-12-26 13:48:54,598][123090] Updated weights for policy 1, policy_version 1768801 (0.0005) [2023-12-26 13:48:54,646][123090] Updated weights for policy 1, policy_version 1768811 (0.0005) [2023-12-26 13:48:54,693][123090] Updated weights for policy 1, policy_version 1768821 (0.0005) [2023-12-26 13:48:54,744][123090] Updated weights for policy 1, policy_version 1768831 (0.0005) [2023-12-26 13:48:54,774][123091] Updated weights for policy 0, policy_version 1780857 (0.0007) [2023-12-26 13:48:54,836][123091] Updated weights for policy 0, policy_version 1780867 (0.0009) [2023-12-26 13:48:54,893][123091] Updated weights for policy 0, policy_version 1780877 (0.0009) [2023-12-26 13:48:55,396][123090] Updated weights for policy 1, policy_version 1768841 (0.0005) [2023-12-26 13:48:55,463][123090] Updated weights for policy 1, policy_version 1768851 (0.0006) [2023-12-26 13:48:55,516][123090] Updated weights for policy 1, policy_version 1768861 (0.0005) [2023-12-26 13:48:55,611][123091] Updated weights for policy 0, policy_version 1780887 (0.0007) [2023-12-26 13:48:55,678][123091] Updated weights for policy 0, policy_version 1780897 (0.0005) [2023-12-26 13:48:55,757][123091] Updated weights for policy 0, policy_version 1780907 (0.0008) [2023-12-26 13:48:56,148][123090] Updated weights for policy 1, policy_version 1768871 (0.0005) [2023-12-26 13:48:56,202][123090] Updated weights for policy 1, policy_version 1768881 (0.0005) [2023-12-26 13:48:56,271][123090] Updated weights for policy 1, policy_version 1768891 (0.0010) [2023-12-26 13:48:56,566][123091] Updated weights for policy 0, policy_version 1780917 (0.0007) [2023-12-26 13:48:56,615][123091] Updated weights for policy 0, policy_version 1780927 (0.0007) [2023-12-26 13:48:56,668][123091] Updated weights for policy 0, policy_version 1780937 (0.0009) [2023-12-26 13:48:56,997][123090] Updated weights for policy 1, policy_version 1768901 (0.0007) [2023-12-26 13:48:57,053][123090] Updated weights for policy 1, policy_version 1768911 (0.0005) [2023-12-26 13:48:57,106][123090] Updated weights for policy 1, policy_version 1768921 (0.0005) [2023-12-26 13:48:57,442][123091] Updated weights for policy 0, policy_version 1780947 (0.0006) [2023-12-26 13:48:57,491][123091] Updated weights for policy 0, policy_version 1780957 (0.0005) [2023-12-26 13:48:57,540][123091] Updated weights for policy 0, policy_version 1780967 (0.0005) [2023-12-26 13:48:57,778][123090] Updated weights for policy 1, policy_version 1768931 (0.0006) [2023-12-26 13:48:57,825][123090] Updated weights for policy 1, policy_version 1768941 (0.0009) [2023-12-26 13:48:57,879][123090] Updated weights for policy 1, policy_version 1768952 (0.0010) [2023-12-26 13:48:58,249][123091] Updated weights for policy 0, policy_version 1780977 (0.0006) [2023-12-26 13:48:58,319][123091] Updated weights for policy 0, policy_version 1780987 (0.0012) [2023-12-26 13:48:58,391][123091] Updated weights for policy 0, policy_version 1780997 (0.0009) [2023-12-26 13:48:58,461][123091] Updated weights for policy 0, policy_version 1781007 (0.0010) [2023-12-26 13:48:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 908795904. Throughput: 0: 8977.8, 1: 9227.5. Samples: 908792196. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:48:58,785][121949] Avg episode reward: [(0, '6245.459'), (1, '5821.484')] [2023-12-26 13:48:58,807][123090] Updated weights for policy 1, policy_version 1768962 (0.0009) [2023-12-26 13:48:58,874][123090] Updated weights for policy 1, policy_version 1768972 (0.0010) [2023-12-26 13:48:58,934][123090] Updated weights for policy 1, policy_version 1768982 (0.0010) [2023-12-26 13:48:59,297][123091] Updated weights for policy 0, policy_version 1781017 (0.0010) [2023-12-26 13:48:59,359][123091] Updated weights for policy 0, policy_version 1781027 (0.0009) [2023-12-26 13:48:59,419][123091] Updated weights for policy 0, policy_version 1781037 (0.0009) [2023-12-26 13:48:59,767][123090] Updated weights for policy 1, policy_version 1768993 (0.0010) [2023-12-26 13:48:59,838][123090] Updated weights for policy 1, policy_version 1769003 (0.0009) [2023-12-26 13:48:59,903][123090] Updated weights for policy 1, policy_version 1769013 (0.0006) [2023-12-26 13:48:59,975][123090] Updated weights for policy 1, policy_version 1769023 (0.0009) [2023-12-26 13:49:00,273][123091] Updated weights for policy 0, policy_version 1781047 (0.0009) [2023-12-26 13:49:00,321][123091] Updated weights for policy 0, policy_version 1781057 (0.0009) [2023-12-26 13:49:00,372][123091] Updated weights for policy 0, policy_version 1781067 (0.0009) [2023-12-26 13:49:00,753][123090] Updated weights for policy 1, policy_version 1769033 (0.0009) [2023-12-26 13:49:00,811][123090] Updated weights for policy 1, policy_version 1769043 (0.0009) [2023-12-26 13:49:00,874][123090] Updated weights for policy 1, policy_version 1769053 (0.0007) [2023-12-26 13:49:01,175][123091] Updated weights for policy 0, policy_version 1781077 (0.0008) [2023-12-26 13:49:01,237][123091] Updated weights for policy 0, policy_version 1781087 (0.0010) [2023-12-26 13:49:01,300][123091] Updated weights for policy 0, policy_version 1781097 (0.0009) [2023-12-26 13:49:01,644][123090] Updated weights for policy 1, policy_version 1769063 (0.0007) [2023-12-26 13:49:01,702][123090] Updated weights for policy 1, policy_version 1769073 (0.0006) [2023-12-26 13:49:01,773][123090] Updated weights for policy 1, policy_version 1769083 (0.0008) [2023-12-26 13:49:02,147][123091] Updated weights for policy 0, policy_version 1781107 (0.0008) [2023-12-26 13:49:02,199][123091] Updated weights for policy 0, policy_version 1781118 (0.0009) [2023-12-26 13:49:02,251][123091] Updated weights for policy 0, policy_version 1781128 (0.0009) [2023-12-26 13:49:02,460][123090] Updated weights for policy 1, policy_version 1769093 (0.0005) [2023-12-26 13:49:02,537][123090] Updated weights for policy 1, policy_version 1769103 (0.0008) [2023-12-26 13:49:02,595][123090] Updated weights for policy 1, policy_version 1769113 (0.0008) [2023-12-26 13:49:03,158][123091] Updated weights for policy 0, policy_version 1781138 (0.0009) [2023-12-26 13:49:03,218][123091] Updated weights for policy 0, policy_version 1781148 (0.0005) [2023-12-26 13:49:03,289][123091] Updated weights for policy 0, policy_version 1781158 (0.0005) [2023-12-26 13:49:03,311][123090] Updated weights for policy 1, policy_version 1769123 (0.0008) [2023-12-26 13:49:03,358][123091] Updated weights for policy 0, policy_version 1781168 (0.0005) [2023-12-26 13:49:03,376][123090] Updated weights for policy 1, policy_version 1769133 (0.0009) [2023-12-26 13:49:03,429][123090] Updated weights for policy 1, policy_version 1769143 (0.0009) [2023-12-26 13:49:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 908886016. Throughput: 0: 8951.9, 1: 9192.8. Samples: 908898416. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:03,785][121949] Avg episode reward: [(0, '6278.678'), (1, '6036.205')] [2023-12-26 13:49:03,923][123091] Updated weights for policy 0, policy_version 1781178 (0.0005) [2023-12-26 13:49:03,981][123091] Updated weights for policy 0, policy_version 1781188 (0.0008) [2023-12-26 13:49:04,047][123091] Updated weights for policy 0, policy_version 1781198 (0.0010) [2023-12-26 13:49:04,155][123090] Updated weights for policy 1, policy_version 1769153 (0.0006) [2023-12-26 13:49:04,220][123090] Updated weights for policy 1, policy_version 1769163 (0.0009) [2023-12-26 13:49:04,283][123090] Updated weights for policy 1, policy_version 1769173 (0.0008) [2023-12-26 13:49:04,345][123090] Updated weights for policy 1, policy_version 1769183 (0.0008) [2023-12-26 13:49:04,941][123091] Updated weights for policy 0, policy_version 1781208 (0.0010) [2023-12-26 13:49:05,001][123091] Updated weights for policy 0, policy_version 1781218 (0.0008) [2023-12-26 13:49:05,003][123090] Updated weights for policy 1, policy_version 1769193 (0.0006) [2023-12-26 13:49:05,061][123090] Updated weights for policy 1, policy_version 1769203 (0.0008) [2023-12-26 13:49:05,063][123091] Updated weights for policy 0, policy_version 1781228 (0.0007) [2023-12-26 13:49:05,126][123090] Updated weights for policy 1, policy_version 1769213 (0.0007) [2023-12-26 13:49:05,870][123090] Updated weights for policy 1, policy_version 1769223 (0.0009) [2023-12-26 13:49:05,882][123091] Updated weights for policy 0, policy_version 1781238 (0.0009) [2023-12-26 13:49:05,925][123090] Updated weights for policy 1, policy_version 1769233 (0.0007) [2023-12-26 13:49:05,948][123091] Updated weights for policy 0, policy_version 1781248 (0.0009) [2023-12-26 13:49:05,985][123090] Updated weights for policy 1, policy_version 1769243 (0.0006) [2023-12-26 13:49:06,011][123091] Updated weights for policy 0, policy_version 1781258 (0.0010) [2023-12-26 13:49:06,793][123090] Updated weights for policy 1, policy_version 1769253 (0.0007) [2023-12-26 13:49:06,819][123091] Updated weights for policy 0, policy_version 1781268 (0.0010) [2023-12-26 13:49:06,846][123090] Updated weights for policy 1, policy_version 1769263 (0.0005) [2023-12-26 13:49:06,879][123091] Updated weights for policy 0, policy_version 1781278 (0.0011) [2023-12-26 13:49:06,903][123090] Updated weights for policy 1, policy_version 1769273 (0.0006) [2023-12-26 13:49:06,947][123091] Updated weights for policy 0, policy_version 1781288 (0.0010) [2023-12-26 13:49:07,702][123090] Updated weights for policy 1, policy_version 1769283 (0.0009) [2023-12-26 13:49:07,769][123090] Updated weights for policy 1, policy_version 1769293 (0.0011) [2023-12-26 13:49:07,795][123091] Updated weights for policy 0, policy_version 1781298 (0.0010) [2023-12-26 13:49:07,828][123090] Updated weights for policy 1, policy_version 1769303 (0.0010) [2023-12-26 13:49:07,849][123091] Updated weights for policy 0, policy_version 1781308 (0.0005) [2023-12-26 13:49:07,901][123091] Updated weights for policy 0, policy_version 1781318 (0.0005) [2023-12-26 13:49:07,967][123091] Updated weights for policy 0, policy_version 1781328 (0.0005) [2023-12-26 13:49:08,579][123090] Updated weights for policy 1, policy_version 1769313 (0.0010) [2023-12-26 13:49:08,636][123090] Updated weights for policy 1, policy_version 1769323 (0.0010) [2023-12-26 13:49:08,643][123091] Updated weights for policy 0, policy_version 1781338 (0.0006) [2023-12-26 13:49:08,691][123090] Updated weights for policy 1, policy_version 1769333 (0.0010) [2023-12-26 13:49:08,692][123091] Updated weights for policy 0, policy_version 1781348 (0.0009) [2023-12-26 13:49:08,746][123091] Updated weights for policy 0, policy_version 1781358 (0.0007) [2023-12-26 13:49:08,751][123090] Updated weights for policy 1, policy_version 1769343 (0.0010) [2023-12-26 13:49:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18295.6, 300 sec: 17716.9). Total num frames: 908984320. Throughput: 0: 8942.0, 1: 9233.5. Samples: 908952028. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:08,785][121949] Avg episode reward: [(0, '6186.487'), (1, '5886.386')] [2023-12-26 13:49:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001781360_456032256.pth... [2023-12-26 13:49:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001769344_452952064.pth... [2023-12-26 13:49:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001768256_452673536.pth [2023-12-26 13:49:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001780336_455770112.pth [2023-12-26 13:49:09,535][123091] Updated weights for policy 0, policy_version 1781368 (0.0008) [2023-12-26 13:49:09,604][123091] Updated weights for policy 0, policy_version 1781378 (0.0009) [2023-12-26 13:49:09,649][123090] Updated weights for policy 1, policy_version 1769353 (0.0011) [2023-12-26 13:49:09,666][123091] Updated weights for policy 0, policy_version 1781388 (0.0009) [2023-12-26 13:49:09,709][123090] Updated weights for policy 1, policy_version 1769363 (0.0011) [2023-12-26 13:49:09,781][123090] Updated weights for policy 1, policy_version 1769373 (0.0007) [2023-12-26 13:49:10,481][123091] Updated weights for policy 0, policy_version 1781398 (0.0006) [2023-12-26 13:49:10,553][123091] Updated weights for policy 0, policy_version 1781408 (0.0006) [2023-12-26 13:49:10,595][123090] Updated weights for policy 1, policy_version 1769383 (0.0007) [2023-12-26 13:49:10,623][123091] Updated weights for policy 0, policy_version 1781418 (0.0006) [2023-12-26 13:49:10,656][123090] Updated weights for policy 1, policy_version 1769393 (0.0008) [2023-12-26 13:49:10,712][123090] Updated weights for policy 1, policy_version 1769403 (0.0008) [2023-12-26 13:49:11,217][123091] Updated weights for policy 0, policy_version 1781428 (0.0006) [2023-12-26 13:49:11,273][123091] Updated weights for policy 0, policy_version 1781438 (0.0007) [2023-12-26 13:49:11,340][123091] Updated weights for policy 0, policy_version 1781448 (0.0007) [2023-12-26 13:49:11,461][123090] Updated weights for policy 1, policy_version 1769413 (0.0009) [2023-12-26 13:49:11,517][123090] Updated weights for policy 1, policy_version 1769423 (0.0008) [2023-12-26 13:49:11,569][123090] Updated weights for policy 1, policy_version 1769433 (0.0008) [2023-12-26 13:49:12,195][123091] Updated weights for policy 0, policy_version 1781458 (0.0009) [2023-12-26 13:49:12,254][123091] Updated weights for policy 0, policy_version 1781468 (0.0009) [2023-12-26 13:49:12,323][123091] Updated weights for policy 0, policy_version 1781478 (0.0009) [2023-12-26 13:49:12,374][123090] Updated weights for policy 1, policy_version 1769443 (0.0008) [2023-12-26 13:49:12,392][123091] Updated weights for policy 0, policy_version 1781488 (0.0008) [2023-12-26 13:49:12,443][123090] Updated weights for policy 1, policy_version 1769453 (0.0010) [2023-12-26 13:49:12,504][123090] Updated weights for policy 1, policy_version 1769463 (0.0010) [2023-12-26 13:49:13,233][123090] Updated weights for policy 1, policy_version 1769473 (0.0009) [2023-12-26 13:49:13,237][123091] Updated weights for policy 0, policy_version 1781498 (0.0005) [2023-12-26 13:49:13,288][123091] Updated weights for policy 0, policy_version 1781508 (0.0005) [2023-12-26 13:49:13,305][123090] Updated weights for policy 1, policy_version 1769483 (0.0007) [2023-12-26 13:49:13,351][123091] Updated weights for policy 0, policy_version 1781518 (0.0005) [2023-12-26 13:49:13,364][123090] Updated weights for policy 1, policy_version 1769493 (0.0010) [2023-12-26 13:49:13,430][123090] Updated weights for policy 1, policy_version 1769503 (0.0010) [2023-12-26 13:49:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 909066240. Throughput: 0: 8877.0, 1: 9204.7. Samples: 909058564. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:13,785][121949] Avg episode reward: [(0, '6212.692'), (1, '5882.150')] [2023-12-26 13:49:14,069][123090] Updated weights for policy 1, policy_version 1769513 (0.0010) [2023-12-26 13:49:14,130][123090] Updated weights for policy 1, policy_version 1769523 (0.0009) [2023-12-26 13:49:14,131][123091] Updated weights for policy 0, policy_version 1781528 (0.0009) [2023-12-26 13:49:14,190][123090] Updated weights for policy 1, policy_version 1769533 (0.0011) [2023-12-26 13:49:14,195][123091] Updated weights for policy 0, policy_version 1781538 (0.0006) [2023-12-26 13:49:14,261][123091] Updated weights for policy 0, policy_version 1781548 (0.0006) [2023-12-26 13:49:14,972][123091] Updated weights for policy 0, policy_version 1781558 (0.0008) [2023-12-26 13:49:15,021][123090] Updated weights for policy 1, policy_version 1769543 (0.0008) [2023-12-26 13:49:15,048][123091] Updated weights for policy 0, policy_version 1781568 (0.0009) [2023-12-26 13:49:15,092][123090] Updated weights for policy 1, policy_version 1769553 (0.0007) [2023-12-26 13:49:15,120][123091] Updated weights for policy 0, policy_version 1781578 (0.0010) [2023-12-26 13:49:15,154][123090] Updated weights for policy 1, policy_version 1769563 (0.0006) [2023-12-26 13:49:15,896][123091] Updated weights for policy 0, policy_version 1781588 (0.0011) [2023-12-26 13:49:15,924][123090] Updated weights for policy 1, policy_version 1769573 (0.0008) [2023-12-26 13:49:15,956][123091] Updated weights for policy 0, policy_version 1781598 (0.0011) [2023-12-26 13:49:15,988][123090] Updated weights for policy 1, policy_version 1769583 (0.0006) [2023-12-26 13:49:16,018][123091] Updated weights for policy 0, policy_version 1781608 (0.0011) [2023-12-26 13:49:16,051][123090] Updated weights for policy 1, policy_version 1769593 (0.0010) [2023-12-26 13:49:16,769][123091] Updated weights for policy 0, policy_version 1781618 (0.0009) [2023-12-26 13:49:16,831][123091] Updated weights for policy 0, policy_version 1781628 (0.0005) [2023-12-26 13:49:16,885][123091] Updated weights for policy 0, policy_version 1781638 (0.0010) [2023-12-26 13:49:16,888][123090] Updated weights for policy 1, policy_version 1769603 (0.0009) [2023-12-26 13:49:16,944][123090] Updated weights for policy 1, policy_version 1769613 (0.0009) [2023-12-26 13:49:16,948][123091] Updated weights for policy 0, policy_version 1781648 (0.0010) [2023-12-26 13:49:17,007][123090] Updated weights for policy 1, policy_version 1769623 (0.0009) [2023-12-26 13:49:17,597][123091] Updated weights for policy 0, policy_version 1781658 (0.0005) [2023-12-26 13:49:17,664][123091] Updated weights for policy 0, policy_version 1781668 (0.0008) [2023-12-26 13:49:17,731][123091] Updated weights for policy 0, policy_version 1781678 (0.0011) [2023-12-26 13:49:17,734][123090] Updated weights for policy 1, policy_version 1769633 (0.0008) [2023-12-26 13:49:17,789][123090] Updated weights for policy 1, policy_version 1769643 (0.0005) [2023-12-26 13:49:17,838][123090] Updated weights for policy 1, policy_version 1769653 (0.0005) [2023-12-26 13:49:17,903][123090] Updated weights for policy 1, policy_version 1769663 (0.0005) [2023-12-26 13:49:18,381][123091] Updated weights for policy 0, policy_version 1781688 (0.0008) [2023-12-26 13:49:18,449][123091] Updated weights for policy 0, policy_version 1781698 (0.0006) [2023-12-26 13:49:18,523][123091] Updated weights for policy 0, policy_version 1781708 (0.0005) [2023-12-26 13:49:18,572][123090] Updated weights for policy 1, policy_version 1769673 (0.0006) [2023-12-26 13:49:18,640][123090] Updated weights for policy 1, policy_version 1769683 (0.0011) [2023-12-26 13:49:18,696][123090] Updated weights for policy 1, policy_version 1769693 (0.0010) [2023-12-26 13:49:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18295.4, 300 sec: 17772.5). Total num frames: 909164544. Throughput: 0: 8894.8, 1: 9202.2. Samples: 909171408. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:18,785][121949] Avg episode reward: [(0, '6297.869'), (1, '5842.034')] [2023-12-26 13:49:19,117][123091] Updated weights for policy 0, policy_version 1781718 (0.0005) [2023-12-26 13:49:19,195][123091] Updated weights for policy 0, policy_version 1781728 (0.0006) [2023-12-26 13:49:19,271][123091] Updated weights for policy 0, policy_version 1781738 (0.0007) [2023-12-26 13:49:19,417][123090] Updated weights for policy 1, policy_version 1769703 (0.0007) [2023-12-26 13:49:19,493][123090] Updated weights for policy 1, policy_version 1769713 (0.0008) [2023-12-26 13:49:19,566][123090] Updated weights for policy 1, policy_version 1769723 (0.0010) [2023-12-26 13:49:20,081][123091] Updated weights for policy 0, policy_version 1781748 (0.0008) [2023-12-26 13:49:20,141][123091] Updated weights for policy 0, policy_version 1781758 (0.0010) [2023-12-26 13:49:20,205][123091] Updated weights for policy 0, policy_version 1781768 (0.0010) [2023-12-26 13:49:20,420][123090] Updated weights for policy 1, policy_version 1769733 (0.0008) [2023-12-26 13:49:20,486][123090] Updated weights for policy 1, policy_version 1769743 (0.0009) [2023-12-26 13:49:20,544][123090] Updated weights for policy 1, policy_version 1769753 (0.0009) [2023-12-26 13:49:21,115][123091] Updated weights for policy 0, policy_version 1781778 (0.0008) [2023-12-26 13:49:21,206][123091] Updated weights for policy 0, policy_version 1781788 (0.0010) [2023-12-26 13:49:21,275][123091] Updated weights for policy 0, policy_version 1781798 (0.0009) [2023-12-26 13:49:21,343][123090] Updated weights for policy 1, policy_version 1769763 (0.0008) [2023-12-26 13:49:21,347][123091] Updated weights for policy 0, policy_version 1781808 (0.0009) [2023-12-26 13:49:21,424][123090] Updated weights for policy 1, policy_version 1769773 (0.0008) [2023-12-26 13:49:21,493][123090] Updated weights for policy 1, policy_version 1769783 (0.0006) [2023-12-26 13:49:22,131][123091] Updated weights for policy 0, policy_version 1781818 (0.0011) [2023-12-26 13:49:22,187][123091] Updated weights for policy 0, policy_version 1781828 (0.0010) [2023-12-26 13:49:22,242][123091] Updated weights for policy 0, policy_version 1781838 (0.0010) [2023-12-26 13:49:22,284][123090] Updated weights for policy 1, policy_version 1769793 (0.0007) [2023-12-26 13:49:22,357][123090] Updated weights for policy 1, policy_version 1769803 (0.0006) [2023-12-26 13:49:22,415][123090] Updated weights for policy 1, policy_version 1769813 (0.0008) [2023-12-26 13:49:22,469][123090] Updated weights for policy 1, policy_version 1769823 (0.0009) [2023-12-26 13:49:23,156][123091] Updated weights for policy 0, policy_version 1781848 (0.0010) [2023-12-26 13:49:23,224][123091] Updated weights for policy 0, policy_version 1781858 (0.0011) [2023-12-26 13:49:23,248][123090] Updated weights for policy 1, policy_version 1769833 (0.0007) [2023-12-26 13:49:23,280][123091] Updated weights for policy 0, policy_version 1781868 (0.0011) [2023-12-26 13:49:23,310][123090] Updated weights for policy 1, policy_version 1769843 (0.0008) [2023-12-26 13:49:23,380][123090] Updated weights for policy 1, policy_version 1769853 (0.0009) [2023-12-26 13:49:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18158.9, 300 sec: 17744.7). Total num frames: 909246464. Throughput: 0: 8842.1, 1: 9168.1. Samples: 909224184. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:23,785][121949] Avg episode reward: [(0, '6320.616'), (1, '5818.972')] [2023-12-26 13:49:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001781872_456163328.pth... [2023-12-26 13:49:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001769856_453083136.pth... [2023-12-26 13:49:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001780848_455901184.pth [2023-12-26 13:49:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001768768_452804608.pth [2023-12-26 13:49:24,089][123090] Updated weights for policy 1, policy_version 1769863 (0.0006) [2023-12-26 13:49:24,107][123091] Updated weights for policy 0, policy_version 1781878 (0.0010) [2023-12-26 13:49:24,138][123090] Updated weights for policy 1, policy_version 1769873 (0.0006) [2023-12-26 13:49:24,167][123091] Updated weights for policy 0, policy_version 1781888 (0.0010) [2023-12-26 13:49:24,199][123090] Updated weights for policy 1, policy_version 1769883 (0.0006) [2023-12-26 13:49:24,218][123091] Updated weights for policy 0, policy_version 1781898 (0.0010) [2023-12-26 13:49:25,011][123090] Updated weights for policy 1, policy_version 1769893 (0.0009) [2023-12-26 13:49:25,042][123091] Updated weights for policy 0, policy_version 1781908 (0.0010) [2023-12-26 13:49:25,072][123090] Updated weights for policy 1, policy_version 1769903 (0.0011) [2023-12-26 13:49:25,101][123091] Updated weights for policy 0, policy_version 1781918 (0.0011) [2023-12-26 13:49:25,136][123090] Updated weights for policy 1, policy_version 1769913 (0.0011) [2023-12-26 13:49:25,156][123091] Updated weights for policy 0, policy_version 1781928 (0.0010) [2023-12-26 13:49:25,947][123090] Updated weights for policy 1, policy_version 1769923 (0.0009) [2023-12-26 13:49:25,972][123091] Updated weights for policy 0, policy_version 1781938 (0.0010) [2023-12-26 13:49:26,001][123090] Updated weights for policy 1, policy_version 1769933 (0.0006) [2023-12-26 13:49:26,038][123091] Updated weights for policy 0, policy_version 1781948 (0.0010) [2023-12-26 13:49:26,053][123090] Updated weights for policy 1, policy_version 1769943 (0.0005) [2023-12-26 13:49:26,082][123091] Updated weights for policy 0, policy_version 1781958 (0.0010) [2023-12-26 13:49:26,129][123091] Updated weights for policy 0, policy_version 1781968 (0.0010) [2023-12-26 13:49:26,804][123090] Updated weights for policy 1, policy_version 1769953 (0.0007) [2023-12-26 13:49:26,868][123090] Updated weights for policy 1, policy_version 1769963 (0.0005) [2023-12-26 13:49:26,924][123090] Updated weights for policy 1, policy_version 1769973 (0.0005) [2023-12-26 13:49:26,960][123091] Updated weights for policy 0, policy_version 1781978 (0.0005) [2023-12-26 13:49:26,979][123090] Updated weights for policy 1, policy_version 1769983 (0.0005) [2023-12-26 13:49:27,010][123091] Updated weights for policy 0, policy_version 1781988 (0.0005) [2023-12-26 13:49:27,054][123091] Updated weights for policy 0, policy_version 1781998 (0.0005) [2023-12-26 13:49:27,651][123091] Updated weights for policy 0, policy_version 1782008 (0.0009) [2023-12-26 13:49:27,709][123091] Updated weights for policy 0, policy_version 1782018 (0.0010) [2023-12-26 13:49:27,715][123090] Updated weights for policy 1, policy_version 1769993 (0.0007) [2023-12-26 13:49:27,767][123091] Updated weights for policy 0, policy_version 1782028 (0.0010) [2023-12-26 13:49:27,767][123090] Updated weights for policy 1, policy_version 1770003 (0.0006) [2023-12-26 13:49:27,833][123090] Updated weights for policy 1, policy_version 1770013 (0.0009) [2023-12-26 13:49:28,585][123091] Updated weights for policy 0, policy_version 1782038 (0.0010) [2023-12-26 13:49:28,635][123090] Updated weights for policy 1, policy_version 1770023 (0.0007) [2023-12-26 13:49:28,646][123091] Updated weights for policy 0, policy_version 1782048 (0.0010) [2023-12-26 13:49:28,689][123090] Updated weights for policy 1, policy_version 1770033 (0.0006) [2023-12-26 13:49:28,705][123091] Updated weights for policy 0, policy_version 1782058 (0.0009) [2023-12-26 13:49:28,747][123090] Updated weights for policy 1, policy_version 1770043 (0.0006) [2023-12-26 13:49:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18158.9, 300 sec: 17800.2). Total num frames: 909344768. Throughput: 0: 8914.8, 1: 9186.3. Samples: 909331848. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:28,785][121949] Avg episode reward: [(0, '6294.959'), (1, '5870.466')] [2023-12-26 13:49:29,544][123091] Updated weights for policy 0, policy_version 1782068 (0.0008) [2023-12-26 13:49:29,567][123090] Updated weights for policy 1, policy_version 1770053 (0.0007) [2023-12-26 13:49:29,599][123091] Updated weights for policy 0, policy_version 1782078 (0.0007) [2023-12-26 13:49:29,626][123090] Updated weights for policy 1, policy_version 1770063 (0.0008) [2023-12-26 13:49:29,666][123091] Updated weights for policy 0, policy_version 1782088 (0.0006) [2023-12-26 13:49:29,690][123090] Updated weights for policy 1, policy_version 1770073 (0.0008) [2023-12-26 13:49:30,409][123091] Updated weights for policy 0, policy_version 1782098 (0.0007) [2023-12-26 13:49:30,460][123091] Updated weights for policy 0, policy_version 1782108 (0.0009) [2023-12-26 13:49:30,465][123090] Updated weights for policy 1, policy_version 1770083 (0.0008) [2023-12-26 13:49:30,515][123090] Updated weights for policy 1, policy_version 1770093 (0.0006) [2023-12-26 13:49:30,518][123091] Updated weights for policy 0, policy_version 1782118 (0.0009) [2023-12-26 13:49:30,568][123090] Updated weights for policy 1, policy_version 1770103 (0.0005) [2023-12-26 13:49:30,579][123091] Updated weights for policy 0, policy_version 1782128 (0.0005) [2023-12-26 13:49:31,215][123091] Updated weights for policy 0, policy_version 1782138 (0.0006) [2023-12-26 13:49:31,248][123090] Updated weights for policy 1, policy_version 1770113 (0.0006) [2023-12-26 13:49:31,291][123091] Updated weights for policy 0, policy_version 1782148 (0.0007) [2023-12-26 13:49:31,313][123090] Updated weights for policy 1, policy_version 1770123 (0.0007) [2023-12-26 13:49:31,353][123091] Updated weights for policy 0, policy_version 1782158 (0.0009) [2023-12-26 13:49:31,376][123090] Updated weights for policy 1, policy_version 1770133 (0.0008) [2023-12-26 13:49:31,439][123090] Updated weights for policy 1, policy_version 1770143 (0.0009) [2023-12-26 13:49:32,190][123091] Updated weights for policy 0, policy_version 1782168 (0.0010) [2023-12-26 13:49:32,226][123090] Updated weights for policy 1, policy_version 1770153 (0.0010) [2023-12-26 13:49:32,247][123091] Updated weights for policy 0, policy_version 1782178 (0.0007) [2023-12-26 13:49:32,284][123090] Updated weights for policy 1, policy_version 1770163 (0.0008) [2023-12-26 13:49:32,312][123091] Updated weights for policy 0, policy_version 1782188 (0.0009) [2023-12-26 13:49:32,350][123090] Updated weights for policy 1, policy_version 1770173 (0.0007) [2023-12-26 13:49:33,154][123090] Updated weights for policy 1, policy_version 1770183 (0.0008) [2023-12-26 13:49:33,156][123091] Updated weights for policy 0, policy_version 1782198 (0.0009) [2023-12-26 13:49:33,205][123091] Updated weights for policy 0, policy_version 1782208 (0.0007) [2023-12-26 13:49:33,206][123090] Updated weights for policy 1, policy_version 1770193 (0.0009) [2023-12-26 13:49:33,261][123091] Updated weights for policy 0, policy_version 1782218 (0.0006) [2023-12-26 13:49:33,265][123090] Updated weights for policy 1, policy_version 1770203 (0.0010) [2023-12-26 13:49:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 909426688. Throughput: 0: 8905.9, 1: 9134.5. Samples: 909438644. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:33,785][121949] Avg episode reward: [(0, '6271.880'), (1, '5857.298')] [2023-12-26 13:49:34,093][123091] Updated weights for policy 0, policy_version 1782228 (0.0008) [2023-12-26 13:49:34,097][123090] Updated weights for policy 1, policy_version 1770213 (0.0009) [2023-12-26 13:49:34,149][123091] Updated weights for policy 0, policy_version 1782238 (0.0009) [2023-12-26 13:49:34,156][123090] Updated weights for policy 1, policy_version 1770223 (0.0008) [2023-12-26 13:49:34,216][123091] Updated weights for policy 0, policy_version 1782248 (0.0010) [2023-12-26 13:49:34,218][123090] Updated weights for policy 1, policy_version 1770233 (0.0006) [2023-12-26 13:49:35,045][123091] Updated weights for policy 0, policy_version 1782258 (0.0008) [2023-12-26 13:49:35,061][123090] Updated weights for policy 1, policy_version 1770243 (0.0008) [2023-12-26 13:49:35,098][123091] Updated weights for policy 0, policy_version 1782268 (0.0005) [2023-12-26 13:49:35,134][123090] Updated weights for policy 1, policy_version 1770253 (0.0009) [2023-12-26 13:49:35,156][123091] Updated weights for policy 0, policy_version 1782278 (0.0005) [2023-12-26 13:49:35,192][123090] Updated weights for policy 1, policy_version 1770263 (0.0009) [2023-12-26 13:49:35,202][123091] Updated weights for policy 0, policy_version 1782288 (0.0005) [2023-12-26 13:49:35,942][123091] Updated weights for policy 0, policy_version 1782298 (0.0008) [2023-12-26 13:49:35,999][123091] Updated weights for policy 0, policy_version 1782308 (0.0009) [2023-12-26 13:49:36,056][123090] Updated weights for policy 1, policy_version 1770273 (0.0008) [2023-12-26 13:49:36,059][123091] Updated weights for policy 0, policy_version 1782318 (0.0009) [2023-12-26 13:49:36,126][123090] Updated weights for policy 1, policy_version 1770283 (0.0007) [2023-12-26 13:49:36,192][123090] Updated weights for policy 1, policy_version 1770293 (0.0010) [2023-12-26 13:49:36,255][123090] Updated weights for policy 1, policy_version 1770303 (0.0009) [2023-12-26 13:49:36,913][123091] Updated weights for policy 0, policy_version 1782328 (0.0009) [2023-12-26 13:49:36,981][123091] Updated weights for policy 0, policy_version 1782338 (0.0010) [2023-12-26 13:49:37,047][123091] Updated weights for policy 0, policy_version 1782348 (0.0010) [2023-12-26 13:49:37,079][123090] Updated weights for policy 1, policy_version 1770313 (0.0006) [2023-12-26 13:49:37,149][123090] Updated weights for policy 1, policy_version 1770323 (0.0006) [2023-12-26 13:49:37,219][123090] Updated weights for policy 1, policy_version 1770333 (0.0006) [2023-12-26 13:49:37,943][123091] Updated weights for policy 0, policy_version 1782358 (0.0009) [2023-12-26 13:49:37,991][123091] Updated weights for policy 0, policy_version 1782368 (0.0009) [2023-12-26 13:49:37,992][123090] Updated weights for policy 1, policy_version 1770343 (0.0006) [2023-12-26 13:49:38,042][123091] Updated weights for policy 0, policy_version 1782378 (0.0008) [2023-12-26 13:49:38,059][123090] Updated weights for policy 1, policy_version 1770353 (0.0007) [2023-12-26 13:49:38,123][123090] Updated weights for policy 1, policy_version 1770363 (0.0005) [2023-12-26 13:49:38,753][123090] Updated weights for policy 1, policy_version 1770373 (0.0005) [2023-12-26 13:49:38,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 909508608. Throughput: 0: 8919.9, 1: 9118.2. Samples: 909490980. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:38,785][121949] Avg episode reward: [(0, '6286.514'), (1, '5952.230')] [2023-12-26 13:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001782384_456294400.pth... [2023-12-26 13:49:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001781360_456032256.pth [2023-12-26 13:49:38,814][123090] Updated weights for policy 1, policy_version 1770383 (0.0008) [2023-12-26 13:49:38,867][123090] Updated weights for policy 1, policy_version 1770393 (0.0009) [2023-12-26 13:49:38,912][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001770400_453222400.pth... [2023-12-26 13:49:38,917][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001769344_452952064.pth [2023-12-26 13:49:38,971][123091] Updated weights for policy 0, policy_version 1782388 (0.0010) [2023-12-26 13:49:39,035][123091] Updated weights for policy 0, policy_version 1782398 (0.0010) [2023-12-26 13:49:39,101][123091] Updated weights for policy 0, policy_version 1782408 (0.0010) [2023-12-26 13:49:39,749][123090] Updated weights for policy 1, policy_version 1770403 (0.0009) [2023-12-26 13:49:39,825][123090] Updated weights for policy 1, policy_version 1770413 (0.0009) [2023-12-26 13:49:39,892][123090] Updated weights for policy 1, policy_version 1770423 (0.0008) [2023-12-26 13:49:39,976][123091] Updated weights for policy 0, policy_version 1782418 (0.0009) [2023-12-26 13:49:40,036][123091] Updated weights for policy 0, policy_version 1782428 (0.0007) [2023-12-26 13:49:40,093][123091] Updated weights for policy 0, policy_version 1782438 (0.0008) [2023-12-26 13:49:40,159][123091] Updated weights for policy 0, policy_version 1782448 (0.0010) [2023-12-26 13:49:40,680][123090] Updated weights for policy 1, policy_version 1770433 (0.0009) [2023-12-26 13:49:40,732][123090] Updated weights for policy 1, policy_version 1770443 (0.0011) [2023-12-26 13:49:40,780][123090] Updated weights for policy 1, policy_version 1770453 (0.0010) [2023-12-26 13:49:40,828][123090] Updated weights for policy 1, policy_version 1770463 (0.0010) [2023-12-26 13:49:41,003][123091] Updated weights for policy 0, policy_version 1782458 (0.0009) [2023-12-26 13:49:41,074][123091] Updated weights for policy 0, policy_version 1782468 (0.0010) [2023-12-26 13:49:41,136][123091] Updated weights for policy 0, policy_version 1782478 (0.0010) [2023-12-26 13:49:41,707][123090] Updated weights for policy 1, policy_version 1770473 (0.0009) [2023-12-26 13:49:41,782][123090] Updated weights for policy 1, policy_version 1770483 (0.0006) [2023-12-26 13:49:41,839][123090] Updated weights for policy 1, policy_version 1770493 (0.0006) [2023-12-26 13:49:42,050][123091] Updated weights for policy 0, policy_version 1782488 (0.0008) [2023-12-26 13:49:42,122][123091] Updated weights for policy 0, policy_version 1782498 (0.0009) [2023-12-26 13:49:42,192][123091] Updated weights for policy 0, policy_version 1782508 (0.0009) [2023-12-26 13:49:42,594][123090] Updated weights for policy 1, policy_version 1770503 (0.0008) [2023-12-26 13:49:42,654][123090] Updated weights for policy 1, policy_version 1770513 (0.0010) [2023-12-26 13:49:42,710][123090] Updated weights for policy 1, policy_version 1770523 (0.0009) [2023-12-26 13:49:43,006][123091] Updated weights for policy 0, policy_version 1782518 (0.0008) [2023-12-26 13:49:43,067][123091] Updated weights for policy 0, policy_version 1782528 (0.0009) [2023-12-26 13:49:43,134][123091] Updated weights for policy 0, policy_version 1782538 (0.0009) [2023-12-26 13:49:43,486][123090] Updated weights for policy 1, policy_version 1770533 (0.0010) [2023-12-26 13:49:43,549][123090] Updated weights for policy 1, policy_version 1770543 (0.0008) [2023-12-26 13:49:43,621][123090] Updated weights for policy 1, policy_version 1770553 (0.0009) [2023-12-26 13:49:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 909598720. Throughput: 0: 8806.4, 1: 8973.4. Samples: 909592288. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:43,785][121949] Avg episode reward: [(0, '6231.604'), (1, '6034.535')] [2023-12-26 13:49:43,954][123091] Updated weights for policy 0, policy_version 1782548 (0.0010) [2023-12-26 13:49:44,008][123091] Updated weights for policy 0, policy_version 1782558 (0.0008) [2023-12-26 13:49:44,064][123091] Updated weights for policy 0, policy_version 1782568 (0.0009) [2023-12-26 13:49:44,371][123090] Updated weights for policy 1, policy_version 1770563 (0.0010) [2023-12-26 13:49:44,424][123090] Updated weights for policy 1, policy_version 1770573 (0.0009) [2023-12-26 13:49:44,481][123090] Updated weights for policy 1, policy_version 1770583 (0.0009) [2023-12-26 13:49:44,924][123091] Updated weights for policy 0, policy_version 1782578 (0.0010) [2023-12-26 13:49:44,994][123091] Updated weights for policy 0, policy_version 1782588 (0.0010) [2023-12-26 13:49:45,062][123091] Updated weights for policy 0, policy_version 1782598 (0.0010) [2023-12-26 13:49:45,130][123091] Updated weights for policy 0, policy_version 1782608 (0.0009) [2023-12-26 13:49:45,335][123090] Updated weights for policy 1, policy_version 1770593 (0.0009) [2023-12-26 13:49:45,392][123090] Updated weights for policy 1, policy_version 1770603 (0.0009) [2023-12-26 13:49:45,447][123090] Updated weights for policy 1, policy_version 1770613 (0.0010) [2023-12-26 13:49:45,504][123090] Updated weights for policy 1, policy_version 1770623 (0.0009) [2023-12-26 13:49:45,963][123091] Updated weights for policy 0, policy_version 1782618 (0.0009) [2023-12-26 13:49:46,025][123091] Updated weights for policy 0, policy_version 1782628 (0.0006) [2023-12-26 13:49:46,093][123091] Updated weights for policy 0, policy_version 1782638 (0.0009) [2023-12-26 13:49:46,348][123090] Updated weights for policy 1, policy_version 1770633 (0.0006) [2023-12-26 13:49:46,402][123090] Updated weights for policy 1, policy_version 1770643 (0.0006) [2023-12-26 13:49:46,451][123090] Updated weights for policy 1, policy_version 1770653 (0.0008) [2023-12-26 13:49:46,885][123091] Updated weights for policy 0, policy_version 1782648 (0.0010) [2023-12-26 13:49:46,959][123091] Updated weights for policy 0, policy_version 1782658 (0.0011) [2023-12-26 13:49:47,027][123091] Updated weights for policy 0, policy_version 1782668 (0.0006) [2023-12-26 13:49:47,142][123090] Updated weights for policy 1, policy_version 1770663 (0.0005) [2023-12-26 13:49:47,193][123090] Updated weights for policy 1, policy_version 1770673 (0.0005) [2023-12-26 13:49:47,259][123090] Updated weights for policy 1, policy_version 1770683 (0.0005) [2023-12-26 13:49:47,761][123091] Updated weights for policy 0, policy_version 1782678 (0.0007) [2023-12-26 13:49:47,829][123091] Updated weights for policy 0, policy_version 1782688 (0.0008) [2023-12-26 13:49:47,892][123091] Updated weights for policy 0, policy_version 1782698 (0.0011) [2023-12-26 13:49:47,900][123090] Updated weights for policy 1, policy_version 1770693 (0.0005) [2023-12-26 13:49:47,964][123090] Updated weights for policy 1, policy_version 1770703 (0.0005) [2023-12-26 13:49:48,024][123090] Updated weights for policy 1, policy_version 1770713 (0.0006) [2023-12-26 13:49:48,684][123090] Updated weights for policy 1, policy_version 1770723 (0.0005) [2023-12-26 13:49:48,731][123091] Updated weights for policy 0, policy_version 1782708 (0.0010) [2023-12-26 13:49:48,743][123090] Updated weights for policy 1, policy_version 1770733 (0.0006) [2023-12-26 13:49:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 909680640. Throughput: 0: 8789.6, 1: 9020.3. Samples: 909699860. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:48,785][121949] Avg episode reward: [(0, '6141.798'), (1, '6038.834')] [2023-12-26 13:49:48,793][123091] Updated weights for policy 0, policy_version 1782718 (0.0010) [2023-12-26 13:49:48,814][123090] Updated weights for policy 1, policy_version 1770743 (0.0005) [2023-12-26 13:49:48,856][123091] Updated weights for policy 0, policy_version 1782728 (0.0010) [2023-12-26 13:49:49,555][123090] Updated weights for policy 1, policy_version 1770753 (0.0010) [2023-12-26 13:49:49,616][123090] Updated weights for policy 1, policy_version 1770763 (0.0009) [2023-12-26 13:49:49,677][123090] Updated weights for policy 1, policy_version 1770773 (0.0008) [2023-12-26 13:49:49,698][123091] Updated weights for policy 0, policy_version 1782738 (0.0011) [2023-12-26 13:49:49,743][123090] Updated weights for policy 1, policy_version 1770783 (0.0010) [2023-12-26 13:49:49,760][123091] Updated weights for policy 0, policy_version 1782748 (0.0011) [2023-12-26 13:49:49,828][123091] Updated weights for policy 0, policy_version 1782758 (0.0011) [2023-12-26 13:49:49,896][123091] Updated weights for policy 0, policy_version 1782768 (0.0011) [2023-12-26 13:49:50,568][123090] Updated weights for policy 1, policy_version 1770793 (0.0009) [2023-12-26 13:49:50,634][123090] Updated weights for policy 1, policy_version 1770803 (0.0008) [2023-12-26 13:49:50,664][123091] Updated weights for policy 0, policy_version 1782778 (0.0007) [2023-12-26 13:49:50,698][123090] Updated weights for policy 1, policy_version 1770813 (0.0007) [2023-12-26 13:49:50,731][123091] Updated weights for policy 0, policy_version 1782788 (0.0011) [2023-12-26 13:49:50,804][123091] Updated weights for policy 0, policy_version 1782798 (0.0010) [2023-12-26 13:49:51,529][123090] Updated weights for policy 1, policy_version 1770823 (0.0009) [2023-12-26 13:49:51,585][123090] Updated weights for policy 1, policy_version 1770833 (0.0009) [2023-12-26 13:49:51,646][123090] Updated weights for policy 1, policy_version 1770843 (0.0009) [2023-12-26 13:49:51,656][123091] Updated weights for policy 0, policy_version 1782808 (0.0009) [2023-12-26 13:49:51,721][123091] Updated weights for policy 0, policy_version 1782818 (0.0010) [2023-12-26 13:49:51,784][123091] Updated weights for policy 0, policy_version 1782828 (0.0010) [2023-12-26 13:49:52,523][123090] Updated weights for policy 1, policy_version 1770853 (0.0007) [2023-12-26 13:49:52,597][123090] Updated weights for policy 1, policy_version 1770863 (0.0009) [2023-12-26 13:49:52,639][123091] Updated weights for policy 0, policy_version 1782838 (0.0008) [2023-12-26 13:49:52,667][123090] Updated weights for policy 1, policy_version 1770873 (0.0009) [2023-12-26 13:49:52,704][123091] Updated weights for policy 0, policy_version 1782848 (0.0008) [2023-12-26 13:49:52,775][123091] Updated weights for policy 0, policy_version 1782858 (0.0009) [2023-12-26 13:49:53,403][123090] Updated weights for policy 1, policy_version 1770883 (0.0006) [2023-12-26 13:49:53,469][123090] Updated weights for policy 1, policy_version 1770893 (0.0005) [2023-12-26 13:49:53,520][123090] Updated weights for policy 1, policy_version 1770903 (0.0007) [2023-12-26 13:49:53,623][123091] Updated weights for policy 0, policy_version 1782868 (0.0010) [2023-12-26 13:49:53,684][123091] Updated weights for policy 0, policy_version 1782878 (0.0010) [2023-12-26 13:49:53,732][123091] Updated weights for policy 0, policy_version 1782888 (0.0009) [2023-12-26 13:49:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 909778944. Throughput: 0: 8778.8, 1: 8981.6. Samples: 909751252. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:53,785][121949] Avg episode reward: [(0, '6214.254'), (1, '5943.311')] [2023-12-26 13:49:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001782896_456425472.pth... [2023-12-26 13:49:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001770912_453353472.pth... [2023-12-26 13:49:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001781872_456163328.pth [2023-12-26 13:49:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001769856_453083136.pth [2023-12-26 13:49:54,300][123090] Updated weights for policy 1, policy_version 1770913 (0.0009) [2023-12-26 13:49:54,353][123090] Updated weights for policy 1, policy_version 1770923 (0.0009) [2023-12-26 13:49:54,416][123090] Updated weights for policy 1, policy_version 1770933 (0.0008) [2023-12-26 13:49:54,475][123090] Updated weights for policy 1, policy_version 1770943 (0.0010) [2023-12-26 13:49:54,582][123091] Updated weights for policy 0, policy_version 1782898 (0.0009) [2023-12-26 13:49:54,640][123091] Updated weights for policy 0, policy_version 1782908 (0.0009) [2023-12-26 13:49:54,692][123091] Updated weights for policy 0, policy_version 1782918 (0.0009) [2023-12-26 13:49:54,753][123091] Updated weights for policy 0, policy_version 1782928 (0.0009) [2023-12-26 13:49:55,336][123090] Updated weights for policy 1, policy_version 1770953 (0.0010) [2023-12-26 13:49:55,395][123090] Updated weights for policy 1, policy_version 1770963 (0.0009) [2023-12-26 13:49:55,463][123090] Updated weights for policy 1, policy_version 1770973 (0.0009) [2023-12-26 13:49:55,541][123091] Updated weights for policy 0, policy_version 1782938 (0.0009) [2023-12-26 13:49:55,603][123091] Updated weights for policy 0, policy_version 1782948 (0.0009) [2023-12-26 13:49:55,671][123091] Updated weights for policy 0, policy_version 1782958 (0.0010) [2023-12-26 13:49:56,322][123090] Updated weights for policy 1, policy_version 1770983 (0.0009) [2023-12-26 13:49:56,379][123090] Updated weights for policy 1, policy_version 1770993 (0.0009) [2023-12-26 13:49:56,440][123090] Updated weights for policy 1, policy_version 1771003 (0.0006) [2023-12-26 13:49:56,471][123091] Updated weights for policy 0, policy_version 1782968 (0.0010) [2023-12-26 13:49:56,541][123091] Updated weights for policy 0, policy_version 1782978 (0.0010) [2023-12-26 13:49:56,599][123091] Updated weights for policy 0, policy_version 1782988 (0.0010) [2023-12-26 13:49:57,260][123090] Updated weights for policy 1, policy_version 1771013 (0.0007) [2023-12-26 13:49:57,317][123091] Updated weights for policy 0, policy_version 1782998 (0.0008) [2023-12-26 13:49:57,327][123090] Updated weights for policy 1, policy_version 1771023 (0.0008) [2023-12-26 13:49:57,382][123091] Updated weights for policy 0, policy_version 1783008 (0.0008) [2023-12-26 13:49:57,384][123090] Updated weights for policy 1, policy_version 1771034 (0.0010) [2023-12-26 13:49:57,445][123091] Updated weights for policy 0, policy_version 1783018 (0.0008) [2023-12-26 13:49:58,065][123091] Updated weights for policy 0, policy_version 1783028 (0.0008) [2023-12-26 13:49:58,125][123091] Updated weights for policy 0, policy_version 1783038 (0.0010) [2023-12-26 13:49:58,184][123091] Updated weights for policy 0, policy_version 1783048 (0.0010) [2023-12-26 13:49:58,286][123090] Updated weights for policy 1, policy_version 1771044 (0.0008) [2023-12-26 13:49:58,355][123090] Updated weights for policy 1, policy_version 1771054 (0.0008) [2023-12-26 13:49:58,425][123090] Updated weights for policy 1, policy_version 1771064 (0.0007) [2023-12-26 13:49:58,786][121949] Fps is (10 sec: 18018.9, 60 sec: 17748.8, 300 sec: 17744.6). Total num frames: 909860864. Throughput: 0: 8753.2, 1: 8954.6. Samples: 909855444. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:49:58,787][121949] Avg episode reward: [(0, '6350.495'), (1, '6032.123')] [2023-12-26 13:49:59,122][123091] Updated weights for policy 0, policy_version 1783058 (0.0010) [2023-12-26 13:49:59,186][123091] Updated weights for policy 0, policy_version 1783068 (0.0008) [2023-12-26 13:49:59,255][123091] Updated weights for policy 0, policy_version 1783078 (0.0008) [2023-12-26 13:49:59,285][123090] Updated weights for policy 1, policy_version 1771074 (0.0006) [2023-12-26 13:49:59,321][123091] Updated weights for policy 0, policy_version 1783088 (0.0008) [2023-12-26 13:49:59,354][123090] Updated weights for policy 1, policy_version 1771084 (0.0009) [2023-12-26 13:49:59,411][123090] Updated weights for policy 1, policy_version 1771094 (0.0005) [2023-12-26 13:49:59,460][123090] Updated weights for policy 1, policy_version 1771104 (0.0005) [2023-12-26 13:50:00,051][123091] Updated weights for policy 0, policy_version 1783098 (0.0008) [2023-12-26 13:50:00,110][123091] Updated weights for policy 0, policy_version 1783108 (0.0008) [2023-12-26 13:50:00,162][123091] Updated weights for policy 0, policy_version 1783118 (0.0008) [2023-12-26 13:50:00,241][123090] Updated weights for policy 1, policy_version 1771114 (0.0010) [2023-12-26 13:50:00,303][123090] Updated weights for policy 1, policy_version 1771124 (0.0009) [2023-12-26 13:50:00,368][123090] Updated weights for policy 1, policy_version 1771134 (0.0009) [2023-12-26 13:50:00,983][123091] Updated weights for policy 0, policy_version 1783128 (0.0009) [2023-12-26 13:50:01,054][123091] Updated weights for policy 0, policy_version 1783138 (0.0009) [2023-12-26 13:50:01,118][123091] Updated weights for policy 0, policy_version 1783148 (0.0009) [2023-12-26 13:50:01,196][123090] Updated weights for policy 1, policy_version 1771144 (0.0010) [2023-12-26 13:50:01,256][123090] Updated weights for policy 1, policy_version 1771154 (0.0008) [2023-12-26 13:50:01,316][123090] Updated weights for policy 1, policy_version 1771164 (0.0007) [2023-12-26 13:50:01,991][123091] Updated weights for policy 0, policy_version 1783158 (0.0010) [2023-12-26 13:50:02,035][123090] Updated weights for policy 1, policy_version 1771174 (0.0009) [2023-12-26 13:50:02,055][123091] Updated weights for policy 0, policy_version 1783168 (0.0008) [2023-12-26 13:50:02,085][123090] Updated weights for policy 1, policy_version 1771184 (0.0009) [2023-12-26 13:50:02,119][123091] Updated weights for policy 0, policy_version 1783178 (0.0008) [2023-12-26 13:50:02,139][123090] Updated weights for policy 1, policy_version 1771194 (0.0007) [2023-12-26 13:50:02,910][123090] Updated weights for policy 1, policy_version 1771204 (0.0007) [2023-12-26 13:50:02,954][123091] Updated weights for policy 0, policy_version 1783188 (0.0008) [2023-12-26 13:50:02,969][123090] Updated weights for policy 1, policy_version 1771214 (0.0008) [2023-12-26 13:50:03,010][123091] Updated weights for policy 0, policy_version 1783198 (0.0009) [2023-12-26 13:50:03,024][123090] Updated weights for policy 1, policy_version 1771224 (0.0007) [2023-12-26 13:50:03,061][123091] Updated weights for policy 0, policy_version 1783208 (0.0008) [2023-12-26 13:50:03,775][123090] Updated weights for policy 1, policy_version 1771234 (0.0007) [2023-12-26 13:50:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 909942784. Throughput: 0: 8647.5, 1: 8890.5. Samples: 909960620. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:50:03,785][121949] Avg episode reward: [(0, '6345.511'), (1, '6084.362')] [2023-12-26 13:50:03,831][123090] Updated weights for policy 1, policy_version 1771244 (0.0005) [2023-12-26 13:50:03,906][123090] Updated weights for policy 1, policy_version 1771254 (0.0006) [2023-12-26 13:50:03,924][123091] Updated weights for policy 0, policy_version 1783218 (0.0009) [2023-12-26 13:50:03,972][123090] Updated weights for policy 1, policy_version 1771264 (0.0008) [2023-12-26 13:50:03,992][123091] Updated weights for policy 0, policy_version 1783228 (0.0009) [2023-12-26 13:50:04,054][123091] Updated weights for policy 0, policy_version 1783238 (0.0009) [2023-12-26 13:50:04,110][123091] Updated weights for policy 0, policy_version 1783248 (0.0010) [2023-12-26 13:50:04,726][123090] Updated weights for policy 1, policy_version 1771274 (0.0009) [2023-12-26 13:50:04,778][123090] Updated weights for policy 1, policy_version 1771284 (0.0008) [2023-12-26 13:50:04,828][123090] Updated weights for policy 1, policy_version 1771294 (0.0006) [2023-12-26 13:50:04,969][123091] Updated weights for policy 0, policy_version 1783258 (0.0010) [2023-12-26 13:50:05,028][123091] Updated weights for policy 0, policy_version 1783268 (0.0010) [2023-12-26 13:50:05,087][123091] Updated weights for policy 0, policy_version 1783278 (0.0008) [2023-12-26 13:50:05,552][123090] Updated weights for policy 1, policy_version 1771304 (0.0009) [2023-12-26 13:50:05,609][123090] Updated weights for policy 1, policy_version 1771314 (0.0010) [2023-12-26 13:50:05,676][123090] Updated weights for policy 1, policy_version 1771324 (0.0009) [2023-12-26 13:50:05,782][123091] Updated weights for policy 0, policy_version 1783288 (0.0009) [2023-12-26 13:50:05,846][123091] Updated weights for policy 0, policy_version 1783298 (0.0009) [2023-12-26 13:50:05,905][123091] Updated weights for policy 0, policy_version 1783309 (0.0010) [2023-12-26 13:50:06,498][123090] Updated weights for policy 1, policy_version 1771334 (0.0010) [2023-12-26 13:50:06,557][123090] Updated weights for policy 1, policy_version 1771344 (0.0010) [2023-12-26 13:50:06,613][123090] Updated weights for policy 1, policy_version 1771354 (0.0010) [2023-12-26 13:50:06,662][123091] Updated weights for policy 0, policy_version 1783319 (0.0009) [2023-12-26 13:50:06,726][123091] Updated weights for policy 0, policy_version 1783329 (0.0010) [2023-12-26 13:50:06,795][123091] Updated weights for policy 0, policy_version 1783339 (0.0009) [2023-12-26 13:50:07,392][123090] Updated weights for policy 1, policy_version 1771364 (0.0007) [2023-12-26 13:50:07,462][123090] Updated weights for policy 1, policy_version 1771374 (0.0007) [2023-12-26 13:50:07,535][123090] Updated weights for policy 1, policy_version 1771384 (0.0007) [2023-12-26 13:50:07,645][123091] Updated weights for policy 0, policy_version 1783349 (0.0010) [2023-12-26 13:50:07,704][123091] Updated weights for policy 0, policy_version 1783359 (0.0009) [2023-12-26 13:50:07,771][123091] Updated weights for policy 0, policy_version 1783369 (0.0009) [2023-12-26 13:50:08,274][123090] Updated weights for policy 1, policy_version 1771394 (0.0009) [2023-12-26 13:50:08,339][123090] Updated weights for policy 1, policy_version 1771404 (0.0009) [2023-12-26 13:50:08,400][123090] Updated weights for policy 1, policy_version 1771414 (0.0011) [2023-12-26 13:50:08,463][123090] Updated weights for policy 1, policy_version 1771424 (0.0010) [2023-12-26 13:50:08,522][123091] Updated weights for policy 0, policy_version 1783379 (0.0008) [2023-12-26 13:50:08,595][123091] Updated weights for policy 0, policy_version 1783389 (0.0006) [2023-12-26 13:50:08,659][123091] Updated weights for policy 0, policy_version 1783399 (0.0009) [2023-12-26 13:50:08,784][121949] Fps is (10 sec: 18025.5, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 910041088. Throughput: 0: 8659.9, 1: 8897.6. Samples: 910014272. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:50:08,785][121949] Avg episode reward: [(0, '6419.335'), (1, '5934.339')] [2023-12-26 13:50:08,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001783408_456556544.pth... [2023-12-26 13:50:08,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001771424_453484544.pth... [2023-12-26 13:50:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001782384_456294400.pth [2023-12-26 13:50:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001770400_453222400.pth [2023-12-26 13:50:09,263][123090] Updated weights for policy 1, policy_version 1771434 (0.0008) [2023-12-26 13:50:09,325][123090] Updated weights for policy 1, policy_version 1771444 (0.0010) [2023-12-26 13:50:09,408][123090] Updated weights for policy 1, policy_version 1771454 (0.0013) [2023-12-26 13:50:09,444][123091] Updated weights for policy 0, policy_version 1783409 (0.0010) [2023-12-26 13:50:09,509][123091] Updated weights for policy 0, policy_version 1783419 (0.0009) [2023-12-26 13:50:09,565][123091] Updated weights for policy 0, policy_version 1783429 (0.0009) [2023-12-26 13:50:09,617][123091] Updated weights for policy 0, policy_version 1783439 (0.0010) [2023-12-26 13:50:10,193][123090] Updated weights for policy 1, policy_version 1771464 (0.0011) [2023-12-26 13:50:10,262][123090] Updated weights for policy 1, policy_version 1771474 (0.0008) [2023-12-26 13:50:10,327][123090] Updated weights for policy 1, policy_version 1771484 (0.0010) [2023-12-26 13:50:10,492][123091] Updated weights for policy 0, policy_version 1783449 (0.0006) [2023-12-26 13:50:10,567][123091] Updated weights for policy 0, policy_version 1783459 (0.0006) [2023-12-26 13:50:10,632][123091] Updated weights for policy 0, policy_version 1783469 (0.0006) [2023-12-26 13:50:11,090][123090] Updated weights for policy 1, policy_version 1771494 (0.0011) [2023-12-26 13:50:11,158][123090] Updated weights for policy 1, policy_version 1771504 (0.0010) [2023-12-26 13:50:11,235][123090] Updated weights for policy 1, policy_version 1771514 (0.0013) [2023-12-26 13:50:11,386][123091] Updated weights for policy 0, policy_version 1783479 (0.0009) [2023-12-26 13:50:11,462][123091] Updated weights for policy 0, policy_version 1783489 (0.0009) [2023-12-26 13:50:11,521][123091] Updated weights for policy 0, policy_version 1783499 (0.0009) [2023-12-26 13:50:12,127][123090] Updated weights for policy 1, policy_version 1771524 (0.0011) [2023-12-26 13:50:12,182][123090] Updated weights for policy 1, policy_version 1771534 (0.0010) [2023-12-26 13:50:12,238][123090] Updated weights for policy 1, policy_version 1771544 (0.0010) [2023-12-26 13:50:12,358][123091] Updated weights for policy 0, policy_version 1783509 (0.0010) [2023-12-26 13:50:12,436][123091] Updated weights for policy 0, policy_version 1783519 (0.0008) [2023-12-26 13:50:12,495][123091] Updated weights for policy 0, policy_version 1783529 (0.0008) [2023-12-26 13:50:13,099][123090] Updated weights for policy 1, policy_version 1771554 (0.0010) [2023-12-26 13:50:13,152][123090] Updated weights for policy 1, policy_version 1771564 (0.0009) [2023-12-26 13:50:13,204][123090] Updated weights for policy 1, policy_version 1771574 (0.0009) [2023-12-26 13:50:13,259][123090] Updated weights for policy 1, policy_version 1771584 (0.0009) [2023-12-26 13:50:13,292][123091] Updated weights for policy 0, policy_version 1783539 (0.0009) [2023-12-26 13:50:13,351][123091] Updated weights for policy 0, policy_version 1783549 (0.0009) [2023-12-26 13:50:13,418][123091] Updated weights for policy 0, policy_version 1783559 (0.0008) [2023-12-26 13:50:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 910123008. Throughput: 0: 8616.6, 1: 8849.8. Samples: 910117840. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:50:13,785][121949] Avg episode reward: [(0, '6328.637'), (1, '5720.780')] [2023-12-26 13:50:14,006][123090] Updated weights for policy 1, policy_version 1771594 (0.0005) [2023-12-26 13:50:14,078][123090] Updated weights for policy 1, policy_version 1771604 (0.0007) [2023-12-26 13:50:14,133][123090] Updated weights for policy 1, policy_version 1771614 (0.0010) [2023-12-26 13:50:14,177][123091] Updated weights for policy 0, policy_version 1783569 (0.0009) [2023-12-26 13:50:14,242][123091] Updated weights for policy 0, policy_version 1783579 (0.0010) [2023-12-26 13:50:14,302][123091] Updated weights for policy 0, policy_version 1783589 (0.0010) [2023-12-26 13:50:14,352][123091] Updated weights for policy 0, policy_version 1783599 (0.0009) [2023-12-26 13:50:14,835][123090] Updated weights for policy 1, policy_version 1771624 (0.0008) [2023-12-26 13:50:14,908][123090] Updated weights for policy 1, policy_version 1771634 (0.0005) [2023-12-26 13:50:14,980][123090] Updated weights for policy 1, policy_version 1771644 (0.0006) [2023-12-26 13:50:15,231][123091] Updated weights for policy 0, policy_version 1783609 (0.0010) [2023-12-26 13:50:15,311][123091] Updated weights for policy 0, policy_version 1783619 (0.0011) [2023-12-26 13:50:15,379][123091] Updated weights for policy 0, policy_version 1783629 (0.0011) [2023-12-26 13:50:15,735][123090] Updated weights for policy 1, policy_version 1771654 (0.0009) [2023-12-26 13:50:15,802][123090] Updated weights for policy 1, policy_version 1771664 (0.0010) [2023-12-26 13:50:15,858][123090] Updated weights for policy 1, policy_version 1771674 (0.0010) [2023-12-26 13:50:16,174][123091] Updated weights for policy 0, policy_version 1783639 (0.0010) [2023-12-26 13:50:16,245][123091] Updated weights for policy 0, policy_version 1783649 (0.0009) [2023-12-26 13:50:16,313][123091] Updated weights for policy 0, policy_version 1783659 (0.0011) [2023-12-26 13:50:16,627][123090] Updated weights for policy 1, policy_version 1771684 (0.0008) [2023-12-26 13:50:16,696][123090] Updated weights for policy 1, policy_version 1771694 (0.0005) [2023-12-26 13:50:16,751][123090] Updated weights for policy 1, policy_version 1771704 (0.0007) [2023-12-26 13:50:17,031][123091] Updated weights for policy 0, policy_version 1783669 (0.0011) [2023-12-26 13:50:17,078][123091] Updated weights for policy 0, policy_version 1783679 (0.0010) [2023-12-26 13:50:17,126][123091] Updated weights for policy 0, policy_version 1783689 (0.0010) [2023-12-26 13:50:17,480][123090] Updated weights for policy 1, policy_version 1771714 (0.0006) [2023-12-26 13:50:17,533][123090] Updated weights for policy 1, policy_version 1771724 (0.0009) [2023-12-26 13:50:17,586][123090] Updated weights for policy 1, policy_version 1771734 (0.0010) [2023-12-26 13:50:17,642][123090] Updated weights for policy 1, policy_version 1771744 (0.0009) [2023-12-26 13:50:17,765][123091] Updated weights for policy 0, policy_version 1783699 (0.0009) [2023-12-26 13:50:17,813][123091] Updated weights for policy 0, policy_version 1783709 (0.0006) [2023-12-26 13:50:17,866][123091] Updated weights for policy 0, policy_version 1783719 (0.0005) [2023-12-26 13:50:18,416][123090] Updated weights for policy 1, policy_version 1771754 (0.0009) [2023-12-26 13:50:18,485][123090] Updated weights for policy 1, policy_version 1771764 (0.0007) [2023-12-26 13:50:18,538][123090] Updated weights for policy 1, policy_version 1771774 (0.0010) [2023-12-26 13:50:18,579][123091] Updated weights for policy 0, policy_version 1783729 (0.0006) [2023-12-26 13:50:18,647][123091] Updated weights for policy 0, policy_version 1783739 (0.0011) [2023-12-26 13:50:18,710][123091] Updated weights for policy 0, policy_version 1783749 (0.0011) [2023-12-26 13:50:18,781][123091] Updated weights for policy 0, policy_version 1783759 (0.0011) [2023-12-26 13:50:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 910221312. Throughput: 0: 8655.5, 1: 8893.8. Samples: 910228360. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:50:18,785][121949] Avg episode reward: [(0, '6264.599'), (1, '5870.286')] [2023-12-26 13:50:19,271][123090] Updated weights for policy 1, policy_version 1771784 (0.0011) [2023-12-26 13:50:19,346][123090] Updated weights for policy 1, policy_version 1771794 (0.0010) [2023-12-26 13:50:19,414][123090] Updated weights for policy 1, policy_version 1771804 (0.0013) [2023-12-26 13:50:19,621][123091] Updated weights for policy 0, policy_version 1783769 (0.0009) [2023-12-26 13:50:19,672][123091] Updated weights for policy 0, policy_version 1783779 (0.0009) [2023-12-26 13:50:19,722][123091] Updated weights for policy 0, policy_version 1783789 (0.0009) [2023-12-26 13:50:20,203][123090] Updated weights for policy 1, policy_version 1771814 (0.0010) [2023-12-26 13:50:20,270][123090] Updated weights for policy 1, policy_version 1771824 (0.0011) [2023-12-26 13:50:20,335][123090] Updated weights for policy 1, policy_version 1771834 (0.0011) [2023-12-26 13:50:20,614][123091] Updated weights for policy 0, policy_version 1783799 (0.0010) [2023-12-26 13:50:20,674][123091] Updated weights for policy 0, policy_version 1783809 (0.0011) [2023-12-26 13:50:20,731][123091] Updated weights for policy 0, policy_version 1783819 (0.0011) [2023-12-26 13:50:21,141][123090] Updated weights for policy 1, policy_version 1771844 (0.0010) [2023-12-26 13:50:21,217][123090] Updated weights for policy 1, policy_version 1771854 (0.0009) [2023-12-26 13:50:21,290][123090] Updated weights for policy 1, policy_version 1771864 (0.0009) [2023-12-26 13:50:21,670][123091] Updated weights for policy 0, policy_version 1783829 (0.0009) [2023-12-26 13:50:21,749][123091] Updated weights for policy 0, policy_version 1783839 (0.0008) [2023-12-26 13:50:21,821][123091] Updated weights for policy 0, policy_version 1783849 (0.0009) [2023-12-26 13:50:22,129][123090] Updated weights for policy 1, policy_version 1771874 (0.0009) [2023-12-26 13:50:22,194][123090] Updated weights for policy 1, policy_version 1771884 (0.0009) [2023-12-26 13:50:22,251][123090] Updated weights for policy 1, policy_version 1771894 (0.0010) [2023-12-26 13:50:22,313][123090] Updated weights for policy 1, policy_version 1771904 (0.0009) [2023-12-26 13:50:22,547][123091] Updated weights for policy 0, policy_version 1783859 (0.0009) [2023-12-26 13:50:22,612][123091] Updated weights for policy 0, policy_version 1783869 (0.0007) [2023-12-26 13:50:22,683][123091] Updated weights for policy 0, policy_version 1783879 (0.0007) [2023-12-26 13:50:23,180][123090] Updated weights for policy 1, policy_version 1771914 (0.0005) [2023-12-26 13:50:23,245][123090] Updated weights for policy 1, policy_version 1771924 (0.0006) [2023-12-26 13:50:23,312][123090] Updated weights for policy 1, policy_version 1771934 (0.0007) [2023-12-26 13:50:23,337][123091] Updated weights for policy 0, policy_version 1783889 (0.0008) [2023-12-26 13:50:23,407][123091] Updated weights for policy 0, policy_version 1783899 (0.0009) [2023-12-26 13:50:23,470][123091] Updated weights for policy 0, policy_version 1783909 (0.0010) [2023-12-26 13:50:23,524][123091] Updated weights for policy 0, policy_version 1783919 (0.0010) [2023-12-26 13:50:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 910303232. Throughput: 0: 8602.3, 1: 8901.0. Samples: 910278628. Policy #0 lag: (min: 4.0, avg: 5.7, max: 36.0) [2023-12-26 13:50:23,785][121949] Avg episode reward: [(0, '6270.061'), (1, '5935.447')] [2023-12-26 13:50:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001783920_456687616.pth... [2023-12-26 13:50:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001771936_453615616.pth... [2023-12-26 13:50:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001782896_456425472.pth [2023-12-26 13:50:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001770912_453353472.pth [2023-12-26 13:50:23,997][123090] Updated weights for policy 1, policy_version 1771944 (0.0010) [2023-12-26 13:50:24,046][123090] Updated weights for policy 1, policy_version 1771954 (0.0010) [2023-12-26 13:50:24,097][123090] Updated weights for policy 1, policy_version 1771964 (0.0010) [2023-12-26 13:50:24,328][123091] Updated weights for policy 0, policy_version 1783929 (0.0010) [2023-12-26 13:50:24,381][123091] Updated weights for policy 0, policy_version 1783939 (0.0010) [2023-12-26 13:50:24,433][123091] Updated weights for policy 0, policy_version 1783949 (0.0010) [2023-12-26 13:50:24,812][123090] Updated weights for policy 1, policy_version 1771974 (0.0010) [2023-12-26 13:50:24,860][123090] Updated weights for policy 1, policy_version 1771984 (0.0009) [2023-12-26 13:50:24,916][123090] Updated weights for policy 1, policy_version 1771994 (0.0009) [2023-12-26 13:50:25,327][123091] Updated weights for policy 0, policy_version 1783959 (0.0008) [2023-12-26 13:50:25,382][123091] Updated weights for policy 0, policy_version 1783970 (0.0010) [2023-12-26 13:50:25,433][123091] Updated weights for policy 0, policy_version 1783980 (0.0008) [2023-12-26 13:50:25,623][123090] Updated weights for policy 1, policy_version 1772004 (0.0009) [2023-12-26 13:50:25,676][123090] Updated weights for policy 1, policy_version 1772014 (0.0005) [2023-12-26 13:50:25,738][123090] Updated weights for policy 1, policy_version 1772025 (0.0010) [2023-12-26 13:50:26,282][123091] Updated weights for policy 0, policy_version 1783990 (0.0009) [2023-12-26 13:50:26,329][123091] Updated weights for policy 0, policy_version 1784000 (0.0008) [2023-12-26 13:50:26,378][123091] Updated weights for policy 0, policy_version 1784010 (0.0009) [2023-12-26 13:50:26,564][123090] Updated weights for policy 1, policy_version 1772035 (0.0009) [2023-12-26 13:50:26,613][123090] Updated weights for policy 1, policy_version 1772045 (0.0009) [2023-12-26 13:50:26,659][123090] Updated weights for policy 1, policy_version 1772055 (0.0009) [2023-12-26 13:50:27,234][123091] Updated weights for policy 0, policy_version 1784021 (0.0010) [2023-12-26 13:50:27,301][123091] Updated weights for policy 0, policy_version 1784031 (0.0009) [2023-12-26 13:50:27,358][123091] Updated weights for policy 0, policy_version 1784041 (0.0009) [2023-12-26 13:50:27,492][123090] Updated weights for policy 1, policy_version 1772065 (0.0009) [2023-12-26 13:50:27,556][123090] Updated weights for policy 1, policy_version 1772075 (0.0009) [2023-12-26 13:50:27,619][123090] Updated weights for policy 1, policy_version 1772085 (0.0009) [2023-12-26 13:50:27,679][123090] Updated weights for policy 1, policy_version 1772095 (0.0009) [2023-12-26 13:50:28,151][123091] Updated weights for policy 0, policy_version 1784051 (0.0009) [2023-12-26 13:50:28,215][123091] Updated weights for policy 0, policy_version 1784061 (0.0009) [2023-12-26 13:50:28,279][123091] Updated weights for policy 0, policy_version 1784071 (0.0009) [2023-12-26 13:50:28,506][123090] Updated weights for policy 1, policy_version 1772105 (0.0010) [2023-12-26 13:50:28,559][123090] Updated weights for policy 1, policy_version 1772115 (0.0010) [2023-12-26 13:50:28,611][123090] Updated weights for policy 1, policy_version 1772126 (0.0010) [2023-12-26 13:50:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 910393344. Throughput: 0: 8696.6, 1: 8920.2. Samples: 910385044. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:28,785][121949] Avg episode reward: [(0, '6241.785'), (1, '5792.324')] [2023-12-26 13:50:29,080][123091] Updated weights for policy 0, policy_version 1784081 (0.0009) [2023-12-26 13:50:29,153][123091] Updated weights for policy 0, policy_version 1784091 (0.0008) [2023-12-26 13:50:29,203][123091] Updated weights for policy 0, policy_version 1784102 (0.0010) [2023-12-26 13:50:29,264][123091] Updated weights for policy 0, policy_version 1784112 (0.0008) [2023-12-26 13:50:29,501][123090] Updated weights for policy 1, policy_version 1772136 (0.0009) [2023-12-26 13:50:29,561][123090] Updated weights for policy 1, policy_version 1772146 (0.0009) [2023-12-26 13:50:29,622][123090] Updated weights for policy 1, policy_version 1772156 (0.0010) [2023-12-26 13:50:30,050][123091] Updated weights for policy 0, policy_version 1784122 (0.0010) [2023-12-26 13:50:30,109][123091] Updated weights for policy 0, policy_version 1784132 (0.0009) [2023-12-26 13:50:30,168][123091] Updated weights for policy 0, policy_version 1784142 (0.0009) [2023-12-26 13:50:30,447][123090] Updated weights for policy 1, policy_version 1772166 (0.0009) [2023-12-26 13:50:30,521][123090] Updated weights for policy 1, policy_version 1772176 (0.0010) [2023-12-26 13:50:30,582][123090] Updated weights for policy 1, policy_version 1772186 (0.0010) [2023-12-26 13:50:30,993][123091] Updated weights for policy 0, policy_version 1784152 (0.0010) [2023-12-26 13:50:31,066][123091] Updated weights for policy 0, policy_version 1784162 (0.0009) [2023-12-26 13:50:31,135][123091] Updated weights for policy 0, policy_version 1784172 (0.0010) [2023-12-26 13:50:31,420][123090] Updated weights for policy 1, policy_version 1772196 (0.0009) [2023-12-26 13:50:31,478][123090] Updated weights for policy 1, policy_version 1772206 (0.0008) [2023-12-26 13:50:31,541][123090] Updated weights for policy 1, policy_version 1772216 (0.0009) [2023-12-26 13:50:31,944][123091] Updated weights for policy 0, policy_version 1784182 (0.0008) [2023-12-26 13:50:32,002][123091] Updated weights for policy 0, policy_version 1784192 (0.0005) [2023-12-26 13:50:32,050][123091] Updated weights for policy 0, policy_version 1784202 (0.0009) [2023-12-26 13:50:32,389][123090] Updated weights for policy 1, policy_version 1772226 (0.0008) [2023-12-26 13:50:32,453][123090] Updated weights for policy 1, policy_version 1772236 (0.0009) [2023-12-26 13:50:32,510][123090] Updated weights for policy 1, policy_version 1772246 (0.0009) [2023-12-26 13:50:32,562][123090] Updated weights for policy 1, policy_version 1772256 (0.0009) [2023-12-26 13:50:32,845][123091] Updated weights for policy 0, policy_version 1784212 (0.0007) [2023-12-26 13:50:32,907][123091] Updated weights for policy 0, policy_version 1784222 (0.0010) [2023-12-26 13:50:32,961][123091] Updated weights for policy 0, policy_version 1784232 (0.0010) [2023-12-26 13:50:33,402][123090] Updated weights for policy 1, policy_version 1772266 (0.0010) [2023-12-26 13:50:33,468][123090] Updated weights for policy 1, policy_version 1772276 (0.0010) [2023-12-26 13:50:33,530][123090] Updated weights for policy 1, policy_version 1772286 (0.0010) [2023-12-26 13:50:33,673][123091] Updated weights for policy 0, policy_version 1784242 (0.0010) [2023-12-26 13:50:33,727][123091] Updated weights for policy 0, policy_version 1784252 (0.0010) [2023-12-26 13:50:33,777][123091] Updated weights for policy 0, policy_version 1784262 (0.0010) [2023-12-26 13:50:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 910475264. Throughput: 0: 8744.3, 1: 8806.2. Samples: 910489636. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:33,785][121949] Avg episode reward: [(0, '6157.839'), (1, '5837.861')] [2023-12-26 13:50:33,835][123091] Updated weights for policy 0, policy_version 1784272 (0.0010) [2023-12-26 13:50:34,226][123090] Updated weights for policy 1, policy_version 1772296 (0.0007) [2023-12-26 13:50:34,295][123090] Updated weights for policy 1, policy_version 1772306 (0.0006) [2023-12-26 13:50:34,367][123090] Updated weights for policy 1, policy_version 1772316 (0.0005) [2023-12-26 13:50:34,665][123091] Updated weights for policy 0, policy_version 1784282 (0.0005) [2023-12-26 13:50:34,724][123091] Updated weights for policy 0, policy_version 1784292 (0.0006) [2023-12-26 13:50:34,788][123091] Updated weights for policy 0, policy_version 1784302 (0.0007) [2023-12-26 13:50:35,086][123090] Updated weights for policy 1, policy_version 1772326 (0.0005) [2023-12-26 13:50:35,159][123090] Updated weights for policy 1, policy_version 1772336 (0.0005) [2023-12-26 13:50:35,233][123090] Updated weights for policy 1, policy_version 1772346 (0.0005) [2023-12-26 13:50:35,558][123091] Updated weights for policy 0, policy_version 1784312 (0.0010) [2023-12-26 13:50:35,620][123091] Updated weights for policy 0, policy_version 1784322 (0.0010) [2023-12-26 13:50:35,675][123091] Updated weights for policy 0, policy_version 1784332 (0.0010) [2023-12-26 13:50:35,888][123090] Updated weights for policy 1, policy_version 1772356 (0.0005) [2023-12-26 13:50:35,943][123090] Updated weights for policy 1, policy_version 1772366 (0.0005) [2023-12-26 13:50:36,000][123090] Updated weights for policy 1, policy_version 1772376 (0.0005) [2023-12-26 13:50:36,396][123091] Updated weights for policy 0, policy_version 1784342 (0.0009) [2023-12-26 13:50:36,458][123091] Updated weights for policy 0, policy_version 1784352 (0.0007) [2023-12-26 13:50:36,522][123091] Updated weights for policy 0, policy_version 1784362 (0.0011) [2023-12-26 13:50:36,728][123090] Updated weights for policy 1, policy_version 1772386 (0.0005) [2023-12-26 13:50:36,805][123090] Updated weights for policy 1, policy_version 1772396 (0.0006) [2023-12-26 13:50:36,884][123090] Updated weights for policy 1, policy_version 1772406 (0.0008) [2023-12-26 13:50:36,949][123090] Updated weights for policy 1, policy_version 1772416 (0.0009) [2023-12-26 13:50:37,228][123091] Updated weights for policy 0, policy_version 1784372 (0.0009) [2023-12-26 13:50:37,283][123091] Updated weights for policy 0, policy_version 1784382 (0.0005) [2023-12-26 13:50:37,351][123091] Updated weights for policy 0, policy_version 1784392 (0.0005) [2023-12-26 13:50:37,723][123090] Updated weights for policy 1, policy_version 1772426 (0.0011) [2023-12-26 13:50:37,794][123090] Updated weights for policy 1, policy_version 1772436 (0.0011) [2023-12-26 13:50:37,864][123090] Updated weights for policy 1, policy_version 1772446 (0.0011) [2023-12-26 13:50:38,009][123091] Updated weights for policy 0, policy_version 1784402 (0.0005) [2023-12-26 13:50:38,073][123091] Updated weights for policy 0, policy_version 1784412 (0.0007) [2023-12-26 13:50:38,140][123091] Updated weights for policy 0, policy_version 1784422 (0.0011) [2023-12-26 13:50:38,208][123091] Updated weights for policy 0, policy_version 1784432 (0.0011) [2023-12-26 13:50:38,632][123090] Updated weights for policy 1, policy_version 1772456 (0.0007) [2023-12-26 13:50:38,704][123090] Updated weights for policy 1, policy_version 1772466 (0.0005) [2023-12-26 13:50:38,778][123090] Updated weights for policy 1, policy_version 1772476 (0.0005) [2023-12-26 13:50:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17800.2). Total num frames: 910565376. Throughput: 0: 8787.4, 1: 8880.4. Samples: 910546300. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:38,786][121949] Avg episode reward: [(0, '6142.381'), (1, '5836.427')] [2023-12-26 13:50:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001784432_456818688.pth... [2023-12-26 13:50:38,798][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001772480_453754880.pth... [2023-12-26 13:50:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001783408_456556544.pth [2023-12-26 13:50:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001771424_453484544.pth [2023-12-26 13:50:38,981][123091] Updated weights for policy 0, policy_version 1784442 (0.0005) [2023-12-26 13:50:39,046][123091] Updated weights for policy 0, policy_version 1784452 (0.0005) [2023-12-26 13:50:39,116][123091] Updated weights for policy 0, policy_version 1784462 (0.0006) [2023-12-26 13:50:39,517][123090] Updated weights for policy 1, policy_version 1772486 (0.0007) [2023-12-26 13:50:39,581][123090] Updated weights for policy 1, policy_version 1772496 (0.0008) [2023-12-26 13:50:39,649][123090] Updated weights for policy 1, policy_version 1772506 (0.0008) [2023-12-26 13:50:39,853][123091] Updated weights for policy 0, policy_version 1784472 (0.0010) [2023-12-26 13:50:39,908][123091] Updated weights for policy 0, policy_version 1784482 (0.0009) [2023-12-26 13:50:39,985][123091] Updated weights for policy 0, policy_version 1784492 (0.0008) [2023-12-26 13:50:40,420][123090] Updated weights for policy 1, policy_version 1772516 (0.0007) [2023-12-26 13:50:40,472][123090] Updated weights for policy 1, policy_version 1772526 (0.0007) [2023-12-26 13:50:40,526][123090] Updated weights for policy 1, policy_version 1772536 (0.0010) [2023-12-26 13:50:40,742][123091] Updated weights for policy 0, policy_version 1784502 (0.0009) [2023-12-26 13:50:40,798][123091] Updated weights for policy 0, policy_version 1784512 (0.0010) [2023-12-26 13:50:40,867][123091] Updated weights for policy 0, policy_version 1784522 (0.0010) [2023-12-26 13:50:41,345][123090] Updated weights for policy 1, policy_version 1772546 (0.0009) [2023-12-26 13:50:41,424][123090] Updated weights for policy 1, policy_version 1772556 (0.0009) [2023-12-26 13:50:41,480][123090] Updated weights for policy 1, policy_version 1772566 (0.0009) [2023-12-26 13:50:41,535][123090] Updated weights for policy 1, policy_version 1772576 (0.0009) [2023-12-26 13:50:41,755][123091] Updated weights for policy 0, policy_version 1784532 (0.0010) [2023-12-26 13:50:41,820][123091] Updated weights for policy 0, policy_version 1784542 (0.0010) [2023-12-26 13:50:41,882][123091] Updated weights for policy 0, policy_version 1784552 (0.0009) [2023-12-26 13:50:42,369][123090] Updated weights for policy 1, policy_version 1772586 (0.0009) [2023-12-26 13:50:42,439][123090] Updated weights for policy 1, policy_version 1772596 (0.0009) [2023-12-26 13:50:42,511][123090] Updated weights for policy 1, policy_version 1772606 (0.0006) [2023-12-26 13:50:42,748][123091] Updated weights for policy 0, policy_version 1784562 (0.0009) [2023-12-26 13:50:42,815][123091] Updated weights for policy 0, policy_version 1784572 (0.0010) [2023-12-26 13:50:42,881][123091] Updated weights for policy 0, policy_version 1784582 (0.0009) [2023-12-26 13:50:42,940][123091] Updated weights for policy 0, policy_version 1784592 (0.0011) [2023-12-26 13:50:43,317][123090] Updated weights for policy 1, policy_version 1772616 (0.0009) [2023-12-26 13:50:43,379][123090] Updated weights for policy 1, policy_version 1772627 (0.0010) [2023-12-26 13:50:43,442][123090] Updated weights for policy 1, policy_version 1772637 (0.0009) [2023-12-26 13:50:43,618][123091] Updated weights for policy 0, policy_version 1784602 (0.0005) [2023-12-26 13:50:43,682][123091] Updated weights for policy 0, policy_version 1784612 (0.0005) [2023-12-26 13:50:43,745][123091] Updated weights for policy 0, policy_version 1784622 (0.0005) [2023-12-26 13:50:43,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 910663680. Throughput: 0: 8797.7, 1: 8920.6. Samples: 910652736. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:43,785][121949] Avg episode reward: [(0, '6262.132'), (1, '5738.811')] [2023-12-26 13:50:44,350][123090] Updated weights for policy 1, policy_version 1772647 (0.0007) [2023-12-26 13:50:44,412][123091] Updated weights for policy 0, policy_version 1784632 (0.0009) [2023-12-26 13:50:44,414][123090] Updated weights for policy 1, policy_version 1772657 (0.0005) [2023-12-26 13:50:44,481][123091] Updated weights for policy 0, policy_version 1784642 (0.0006) [2023-12-26 13:50:44,486][123090] Updated weights for policy 1, policy_version 1772667 (0.0006) [2023-12-26 13:50:44,549][123091] Updated weights for policy 0, policy_version 1784652 (0.0006) [2023-12-26 13:50:45,241][123090] Updated weights for policy 1, policy_version 1772677 (0.0007) [2023-12-26 13:50:45,304][123090] Updated weights for policy 1, policy_version 1772687 (0.0007) [2023-12-26 13:50:45,306][123091] Updated weights for policy 0, policy_version 1784662 (0.0007) [2023-12-26 13:50:45,371][123091] Updated weights for policy 0, policy_version 1784672 (0.0008) [2023-12-26 13:50:45,374][123090] Updated weights for policy 1, policy_version 1772697 (0.0006) [2023-12-26 13:50:45,424][123091] Updated weights for policy 0, policy_version 1784682 (0.0011) [2023-12-26 13:50:46,202][123090] Updated weights for policy 1, policy_version 1772707 (0.0008) [2023-12-26 13:50:46,253][123091] Updated weights for policy 0, policy_version 1784692 (0.0011) [2023-12-26 13:50:46,263][123090] Updated weights for policy 1, policy_version 1772717 (0.0010) [2023-12-26 13:50:46,309][123091] Updated weights for policy 0, policy_version 1784702 (0.0011) [2023-12-26 13:50:46,334][123090] Updated weights for policy 1, policy_version 1772727 (0.0009) [2023-12-26 13:50:46,364][123091] Updated weights for policy 0, policy_version 1784712 (0.0010) [2023-12-26 13:50:47,118][123090] Updated weights for policy 1, policy_version 1772737 (0.0009) [2023-12-26 13:50:47,178][123090] Updated weights for policy 1, policy_version 1772747 (0.0006) [2023-12-26 13:50:47,213][123091] Updated weights for policy 0, policy_version 1784722 (0.0011) [2023-12-26 13:50:47,228][123090] Updated weights for policy 1, policy_version 1772757 (0.0006) [2023-12-26 13:50:47,257][123091] Updated weights for policy 0, policy_version 1784732 (0.0010) [2023-12-26 13:50:47,278][123090] Updated weights for policy 1, policy_version 1772767 (0.0005) [2023-12-26 13:50:47,308][123091] Updated weights for policy 0, policy_version 1784742 (0.0010) [2023-12-26 13:50:47,382][123091] Updated weights for policy 0, policy_version 1784752 (0.0011) [2023-12-26 13:50:47,981][123090] Updated weights for policy 1, policy_version 1772777 (0.0005) [2023-12-26 13:50:48,031][123090] Updated weights for policy 1, policy_version 1772787 (0.0009) [2023-12-26 13:50:48,079][123090] Updated weights for policy 1, policy_version 1772797 (0.0010) [2023-12-26 13:50:48,219][123091] Updated weights for policy 0, policy_version 1784762 (0.0011) [2023-12-26 13:50:48,271][123091] Updated weights for policy 0, policy_version 1784772 (0.0011) [2023-12-26 13:50:48,326][123091] Updated weights for policy 0, policy_version 1784782 (0.0011) [2023-12-26 13:50:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 910745600. Throughput: 0: 8848.3, 1: 8908.3. Samples: 910759664. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:48,785][121949] Avg episode reward: [(0, '6243.575'), (1, '5893.108')] [2023-12-26 13:50:48,845][123090] Updated weights for policy 1, policy_version 1772807 (0.0007) [2023-12-26 13:50:48,908][123090] Updated weights for policy 1, policy_version 1772817 (0.0005) [2023-12-26 13:50:48,976][123090] Updated weights for policy 1, policy_version 1772827 (0.0009) [2023-12-26 13:50:49,161][123091] Updated weights for policy 0, policy_version 1784792 (0.0011) [2023-12-26 13:50:49,232][123091] Updated weights for policy 0, policy_version 1784802 (0.0010) [2023-12-26 13:50:49,305][123091] Updated weights for policy 0, policy_version 1784812 (0.0007) [2023-12-26 13:50:49,683][123090] Updated weights for policy 1, policy_version 1772837 (0.0007) [2023-12-26 13:50:49,750][123090] Updated weights for policy 1, policy_version 1772847 (0.0011) [2023-12-26 13:50:49,818][123090] Updated weights for policy 1, policy_version 1772857 (0.0011) [2023-12-26 13:50:50,159][123091] Updated weights for policy 0, policy_version 1784822 (0.0011) [2023-12-26 13:50:50,234][123091] Updated weights for policy 0, policy_version 1784832 (0.0011) [2023-12-26 13:50:50,295][123091] Updated weights for policy 0, policy_version 1784842 (0.0011) [2023-12-26 13:50:50,578][123090] Updated weights for policy 1, policy_version 1772867 (0.0010) [2023-12-26 13:50:50,645][123090] Updated weights for policy 1, policy_version 1772877 (0.0007) [2023-12-26 13:50:50,718][123090] Updated weights for policy 1, policy_version 1772887 (0.0006) [2023-12-26 13:50:51,118][123091] Updated weights for policy 0, policy_version 1784852 (0.0011) [2023-12-26 13:50:51,181][123091] Updated weights for policy 0, policy_version 1784862 (0.0011) [2023-12-26 13:50:51,246][123091] Updated weights for policy 0, policy_version 1784872 (0.0009) [2023-12-26 13:50:51,513][123090] Updated weights for policy 1, policy_version 1772897 (0.0006) [2023-12-26 13:50:51,565][123090] Updated weights for policy 1, policy_version 1772907 (0.0008) [2023-12-26 13:50:51,634][123090] Updated weights for policy 1, policy_version 1772917 (0.0009) [2023-12-26 13:50:51,702][123090] Updated weights for policy 1, policy_version 1772927 (0.0009) [2023-12-26 13:50:52,001][123091] Updated weights for policy 0, policy_version 1784882 (0.0009) [2023-12-26 13:50:52,071][123091] Updated weights for policy 0, policy_version 1784892 (0.0005) [2023-12-26 13:50:52,146][123091] Updated weights for policy 0, policy_version 1784902 (0.0007) [2023-12-26 13:50:52,216][123091] Updated weights for policy 0, policy_version 1784912 (0.0009) [2023-12-26 13:50:52,435][123090] Updated weights for policy 1, policy_version 1772937 (0.0009) [2023-12-26 13:50:52,504][123090] Updated weights for policy 1, policy_version 1772947 (0.0009) [2023-12-26 13:50:52,576][123090] Updated weights for policy 1, policy_version 1772957 (0.0009) [2023-12-26 13:50:52,923][123091] Updated weights for policy 0, policy_version 1784922 (0.0006) [2023-12-26 13:50:52,986][123091] Updated weights for policy 0, policy_version 1784932 (0.0005) [2023-12-26 13:50:53,056][123091] Updated weights for policy 0, policy_version 1784942 (0.0006) [2023-12-26 13:50:53,504][123090] Updated weights for policy 1, policy_version 1772967 (0.0009) [2023-12-26 13:50:53,577][123090] Updated weights for policy 1, policy_version 1772977 (0.0009) [2023-12-26 13:50:53,640][123090] Updated weights for policy 1, policy_version 1772987 (0.0010) [2023-12-26 13:50:53,654][123091] Updated weights for policy 0, policy_version 1784952 (0.0006) [2023-12-26 13:50:53,704][123091] Updated weights for policy 0, policy_version 1784962 (0.0005) [2023-12-26 13:50:53,758][123091] Updated weights for policy 0, policy_version 1784972 (0.0005) [2023-12-26 13:50:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 910843904. Throughput: 0: 8824.3, 1: 8926.6. Samples: 910813060. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:53,785][121949] Avg episode reward: [(0, '6182.453'), (1, '5946.792')] [2023-12-26 13:50:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001784976_456957952.pth... [2023-12-26 13:50:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001772992_453885952.pth... [2023-12-26 13:50:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001783920_456687616.pth [2023-12-26 13:50:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001771936_453615616.pth [2023-12-26 13:50:54,380][123090] Updated weights for policy 1, policy_version 1772997 (0.0007) [2023-12-26 13:50:54,430][123091] Updated weights for policy 0, policy_version 1784982 (0.0008) [2023-12-26 13:50:54,440][123090] Updated weights for policy 1, policy_version 1773007 (0.0009) [2023-12-26 13:50:54,488][123091] Updated weights for policy 0, policy_version 1784992 (0.0008) [2023-12-26 13:50:54,513][123090] Updated weights for policy 1, policy_version 1773017 (0.0007) [2023-12-26 13:50:54,550][123091] Updated weights for policy 0, policy_version 1785002 (0.0009) [2023-12-26 13:50:55,273][123091] Updated weights for policy 0, policy_version 1785012 (0.0009) [2023-12-26 13:50:55,333][123091] Updated weights for policy 0, policy_version 1785022 (0.0010) [2023-12-26 13:50:55,383][123090] Updated weights for policy 1, policy_version 1773027 (0.0010) [2023-12-26 13:50:55,397][123091] Updated weights for policy 0, policy_version 1785032 (0.0009) [2023-12-26 13:50:55,443][123090] Updated weights for policy 1, policy_version 1773037 (0.0007) [2023-12-26 13:50:55,503][123090] Updated weights for policy 1, policy_version 1773047 (0.0009) [2023-12-26 13:50:56,122][123091] Updated weights for policy 0, policy_version 1785042 (0.0008) [2023-12-26 13:50:56,173][123090] Updated weights for policy 1, policy_version 1773057 (0.0008) [2023-12-26 13:50:56,181][123091] Updated weights for policy 0, policy_version 1785052 (0.0005) [2023-12-26 13:50:56,232][123091] Updated weights for policy 0, policy_version 1785062 (0.0005) [2023-12-26 13:50:56,236][123090] Updated weights for policy 1, policy_version 1773067 (0.0009) [2023-12-26 13:50:56,294][123091] Updated weights for policy 0, policy_version 1785072 (0.0007) [2023-12-26 13:50:56,306][123090] Updated weights for policy 1, policy_version 1773077 (0.0008) [2023-12-26 13:50:56,367][123090] Updated weights for policy 1, policy_version 1773087 (0.0009) [2023-12-26 13:50:57,018][123091] Updated weights for policy 0, policy_version 1785082 (0.0005) [2023-12-26 13:50:57,077][123090] Updated weights for policy 1, policy_version 1773097 (0.0006) [2023-12-26 13:50:57,078][123091] Updated weights for policy 0, policy_version 1785092 (0.0005) [2023-12-26 13:50:57,125][123091] Updated weights for policy 0, policy_version 1785102 (0.0006) [2023-12-26 13:50:57,128][123090] Updated weights for policy 1, policy_version 1773107 (0.0007) [2023-12-26 13:50:57,175][123090] Updated weights for policy 1, policy_version 1773117 (0.0005) [2023-12-26 13:50:57,813][123091] Updated weights for policy 0, policy_version 1785112 (0.0006) [2023-12-26 13:50:57,868][123091] Updated weights for policy 0, policy_version 1785122 (0.0005) [2023-12-26 13:50:57,900][123090] Updated weights for policy 1, policy_version 1773127 (0.0009) [2023-12-26 13:50:57,930][123091] Updated weights for policy 0, policy_version 1785132 (0.0006) [2023-12-26 13:50:57,974][123090] Updated weights for policy 1, policy_version 1773137 (0.0010) [2023-12-26 13:50:58,039][123090] Updated weights for policy 1, policy_version 1773147 (0.0010) [2023-12-26 13:50:58,654][123091] Updated weights for policy 0, policy_version 1785142 (0.0007) [2023-12-26 13:50:58,730][123091] Updated weights for policy 0, policy_version 1785152 (0.0008) [2023-12-26 13:50:58,785][121949] Fps is (10 sec: 18021.4, 60 sec: 17749.7, 300 sec: 17828.0). Total num frames: 910925824. Throughput: 0: 9023.7, 1: 8952.4. Samples: 910926768. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:50:58,785][121949] Avg episode reward: [(0, '6194.000'), (1, '5680.924')] [2023-12-26 13:50:58,806][123091] Updated weights for policy 0, policy_version 1785162 (0.0009) [2023-12-26 13:50:58,816][123090] Updated weights for policy 1, policy_version 1773157 (0.0007) [2023-12-26 13:50:58,882][123090] Updated weights for policy 1, policy_version 1773167 (0.0006) [2023-12-26 13:50:58,944][123090] Updated weights for policy 1, policy_version 1773177 (0.0008) [2023-12-26 13:50:59,677][123091] Updated weights for policy 0, policy_version 1785172 (0.0008) [2023-12-26 13:50:59,728][123091] Updated weights for policy 0, policy_version 1785182 (0.0009) [2023-12-26 13:50:59,765][123090] Updated weights for policy 1, policy_version 1773187 (0.0008) [2023-12-26 13:50:59,775][123091] Updated weights for policy 0, policy_version 1785193 (0.0008) [2023-12-26 13:50:59,833][123090] Updated weights for policy 1, policy_version 1773197 (0.0007) [2023-12-26 13:50:59,899][123090] Updated weights for policy 1, policy_version 1773207 (0.0007) [2023-12-26 13:51:00,573][123090] Updated weights for policy 1, policy_version 1773217 (0.0006) [2023-12-26 13:51:00,649][123090] Updated weights for policy 1, policy_version 1773227 (0.0007) [2023-12-26 13:51:00,679][123091] Updated weights for policy 0, policy_version 1785203 (0.0009) [2023-12-26 13:51:00,699][123090] Updated weights for policy 1, policy_version 1773237 (0.0005) [2023-12-26 13:51:00,735][123091] Updated weights for policy 0, policy_version 1785213 (0.0008) [2023-12-26 13:51:00,755][123090] Updated weights for policy 1, policy_version 1773247 (0.0005) [2023-12-26 13:51:00,792][123091] Updated weights for policy 0, policy_version 1785223 (0.0009) [2023-12-26 13:51:01,493][123090] Updated weights for policy 1, policy_version 1773257 (0.0006) [2023-12-26 13:51:01,552][123090] Updated weights for policy 1, policy_version 1773267 (0.0005) [2023-12-26 13:51:01,598][123091] Updated weights for policy 0, policy_version 1785233 (0.0010) [2023-12-26 13:51:01,601][123090] Updated weights for policy 1, policy_version 1773277 (0.0007) [2023-12-26 13:51:01,668][123091] Updated weights for policy 0, policy_version 1785243 (0.0010) [2023-12-26 13:51:01,737][123091] Updated weights for policy 0, policy_version 1785253 (0.0010) [2023-12-26 13:51:01,808][123091] Updated weights for policy 0, policy_version 1785263 (0.0009) [2023-12-26 13:51:02,415][123090] Updated weights for policy 1, policy_version 1773287 (0.0010) [2023-12-26 13:51:02,465][123090] Updated weights for policy 1, policy_version 1773297 (0.0009) [2023-12-26 13:51:02,520][123090] Updated weights for policy 1, policy_version 1773307 (0.0008) [2023-12-26 13:51:02,547][123091] Updated weights for policy 0, policy_version 1785273 (0.0009) [2023-12-26 13:51:02,607][123091] Updated weights for policy 0, policy_version 1785283 (0.0009) [2023-12-26 13:51:02,667][123091] Updated weights for policy 0, policy_version 1785294 (0.0009) [2023-12-26 13:51:03,292][123090] Updated weights for policy 1, policy_version 1773317 (0.0009) [2023-12-26 13:51:03,347][123090] Updated weights for policy 1, policy_version 1773327 (0.0010) [2023-12-26 13:51:03,413][123090] Updated weights for policy 1, policy_version 1773337 (0.0010) [2023-12-26 13:51:03,525][123091] Updated weights for policy 0, policy_version 1785304 (0.0009) [2023-12-26 13:51:03,595][123091] Updated weights for policy 0, policy_version 1785314 (0.0009) [2023-12-26 13:51:03,653][123091] Updated weights for policy 0, policy_version 1785324 (0.0009) [2023-12-26 13:51:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 911024128. Throughput: 0: 8942.2, 1: 8930.5. Samples: 911032632. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:03,785][121949] Avg episode reward: [(0, '6321.926'), (1, '5664.228')] [2023-12-26 13:51:04,143][123090] Updated weights for policy 1, policy_version 1773347 (0.0011) [2023-12-26 13:51:04,207][123090] Updated weights for policy 1, policy_version 1773357 (0.0011) [2023-12-26 13:51:04,274][123090] Updated weights for policy 1, policy_version 1773367 (0.0010) [2023-12-26 13:51:04,494][123091] Updated weights for policy 0, policy_version 1785334 (0.0009) [2023-12-26 13:51:04,549][123091] Updated weights for policy 0, policy_version 1785344 (0.0009) [2023-12-26 13:51:04,607][123091] Updated weights for policy 0, policy_version 1785354 (0.0009) [2023-12-26 13:51:05,099][123090] Updated weights for policy 1, policy_version 1773377 (0.0010) [2023-12-26 13:51:05,157][123090] Updated weights for policy 1, policy_version 1773387 (0.0010) [2023-12-26 13:51:05,219][123090] Updated weights for policy 1, policy_version 1773397 (0.0010) [2023-12-26 13:51:05,288][123090] Updated weights for policy 1, policy_version 1773407 (0.0010) [2023-12-26 13:51:05,471][123091] Updated weights for policy 0, policy_version 1785364 (0.0009) [2023-12-26 13:51:05,527][123091] Updated weights for policy 0, policy_version 1785374 (0.0008) [2023-12-26 13:51:05,580][123091] Updated weights for policy 0, policy_version 1785384 (0.0009) [2023-12-26 13:51:06,092][123090] Updated weights for policy 1, policy_version 1773417 (0.0010) [2023-12-26 13:51:06,162][123090] Updated weights for policy 1, policy_version 1773427 (0.0010) [2023-12-26 13:51:06,218][123090] Updated weights for policy 1, policy_version 1773437 (0.0010) [2023-12-26 13:51:06,441][123091] Updated weights for policy 0, policy_version 1785394 (0.0009) [2023-12-26 13:51:06,511][123091] Updated weights for policy 0, policy_version 1785404 (0.0009) [2023-12-26 13:51:06,579][123091] Updated weights for policy 0, policy_version 1785414 (0.0009) [2023-12-26 13:51:06,637][123091] Updated weights for policy 0, policy_version 1785424 (0.0009) [2023-12-26 13:51:07,064][123090] Updated weights for policy 1, policy_version 1773447 (0.0010) [2023-12-26 13:51:07,117][123090] Updated weights for policy 1, policy_version 1773457 (0.0010) [2023-12-26 13:51:07,180][123090] Updated weights for policy 1, policy_version 1773467 (0.0011) [2023-12-26 13:51:07,468][123091] Updated weights for policy 0, policy_version 1785434 (0.0006) [2023-12-26 13:51:07,516][123091] Updated weights for policy 0, policy_version 1785444 (0.0005) [2023-12-26 13:51:07,569][123091] Updated weights for policy 0, policy_version 1785454 (0.0010) [2023-12-26 13:51:08,037][123090] Updated weights for policy 1, policy_version 1773477 (0.0010) [2023-12-26 13:51:08,093][123090] Updated weights for policy 1, policy_version 1773487 (0.0011) [2023-12-26 13:51:08,160][123090] Updated weights for policy 1, policy_version 1773497 (0.0008) [2023-12-26 13:51:08,318][123091] Updated weights for policy 0, policy_version 1785464 (0.0008) [2023-12-26 13:51:08,380][123091] Updated weights for policy 0, policy_version 1785474 (0.0008) [2023-12-26 13:51:08,436][123091] Updated weights for policy 0, policy_version 1785484 (0.0011) [2023-12-26 13:51:08,784][121949] Fps is (10 sec: 18023.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 911106048. Throughput: 0: 8947.9, 1: 8936.8. Samples: 911083440. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:08,785][121949] Avg episode reward: [(0, '6381.887'), (1, '5778.567')] [2023-12-26 13:51:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001785488_457089024.pth... [2023-12-26 13:51:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001773504_454017024.pth... [2023-12-26 13:51:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001784432_456818688.pth [2023-12-26 13:51:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001772480_453754880.pth [2023-12-26 13:51:09,008][123090] Updated weights for policy 1, policy_version 1773507 (0.0011) [2023-12-26 13:51:09,078][123090] Updated weights for policy 1, policy_version 1773517 (0.0010) [2023-12-26 13:51:09,149][123090] Updated weights for policy 1, policy_version 1773527 (0.0010) [2023-12-26 13:51:09,261][123091] Updated weights for policy 0, policy_version 1785494 (0.0010) [2023-12-26 13:51:09,312][123091] Updated weights for policy 0, policy_version 1785504 (0.0009) [2023-12-26 13:51:09,373][123091] Updated weights for policy 0, policy_version 1785514 (0.0009) [2023-12-26 13:51:09,894][123090] Updated weights for policy 1, policy_version 1773537 (0.0011) [2023-12-26 13:51:09,967][123090] Updated weights for policy 1, policy_version 1773547 (0.0009) [2023-12-26 13:51:10,036][123090] Updated weights for policy 1, policy_version 1773557 (0.0009) [2023-12-26 13:51:10,103][123090] Updated weights for policy 1, policy_version 1773567 (0.0009) [2023-12-26 13:51:10,252][123091] Updated weights for policy 0, policy_version 1785524 (0.0009) [2023-12-26 13:51:10,318][123091] Updated weights for policy 0, policy_version 1785534 (0.0006) [2023-12-26 13:51:10,389][123091] Updated weights for policy 0, policy_version 1785544 (0.0008) [2023-12-26 13:51:10,963][123090] Updated weights for policy 1, policy_version 1773577 (0.0010) [2023-12-26 13:51:11,021][123090] Updated weights for policy 1, policy_version 1773587 (0.0008) [2023-12-26 13:51:11,091][123090] Updated weights for policy 1, policy_version 1773597 (0.0009) [2023-12-26 13:51:11,125][123091] Updated weights for policy 0, policy_version 1785554 (0.0007) [2023-12-26 13:51:11,194][123091] Updated weights for policy 0, policy_version 1785564 (0.0010) [2023-12-26 13:51:11,266][123091] Updated weights for policy 0, policy_version 1785574 (0.0010) [2023-12-26 13:51:11,336][123091] Updated weights for policy 0, policy_version 1785584 (0.0009) [2023-12-26 13:51:11,927][123090] Updated weights for policy 1, policy_version 1773607 (0.0007) [2023-12-26 13:51:11,995][123090] Updated weights for policy 1, policy_version 1773617 (0.0007) [2023-12-26 13:51:12,063][123090] Updated weights for policy 1, policy_version 1773627 (0.0009) [2023-12-26 13:51:12,209][123091] Updated weights for policy 0, policy_version 1785594 (0.0009) [2023-12-26 13:51:12,272][123091] Updated weights for policy 0, policy_version 1785604 (0.0009) [2023-12-26 13:51:12,343][123091] Updated weights for policy 0, policy_version 1785614 (0.0009) [2023-12-26 13:51:12,820][123090] Updated weights for policy 1, policy_version 1773637 (0.0007) [2023-12-26 13:51:12,869][123090] Updated weights for policy 1, policy_version 1773647 (0.0005) [2023-12-26 13:51:12,926][123090] Updated weights for policy 1, policy_version 1773657 (0.0005) [2023-12-26 13:51:13,126][123091] Updated weights for policy 0, policy_version 1785624 (0.0006) [2023-12-26 13:51:13,197][123091] Updated weights for policy 0, policy_version 1785634 (0.0005) [2023-12-26 13:51:13,272][123091] Updated weights for policy 0, policy_version 1785644 (0.0005) [2023-12-26 13:51:13,647][123090] Updated weights for policy 1, policy_version 1773667 (0.0005) [2023-12-26 13:51:13,699][123090] Updated weights for policy 1, policy_version 1773677 (0.0005) [2023-12-26 13:51:13,750][123090] Updated weights for policy 1, policy_version 1773687 (0.0005) [2023-12-26 13:51:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 911187968. Throughput: 0: 8917.8, 1: 8870.6. Samples: 911185520. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:13,784][121949] Avg episode reward: [(0, '6298.170'), (1, '5758.190')] [2023-12-26 13:51:13,913][123091] Updated weights for policy 0, policy_version 1785654 (0.0008) [2023-12-26 13:51:13,968][123091] Updated weights for policy 0, policy_version 1785664 (0.0010) [2023-12-26 13:51:14,020][123091] Updated weights for policy 0, policy_version 1785674 (0.0010) [2023-12-26 13:51:14,450][123090] Updated weights for policy 1, policy_version 1773697 (0.0006) [2023-12-26 13:51:14,508][123090] Updated weights for policy 1, policy_version 1773707 (0.0010) [2023-12-26 13:51:14,579][123090] Updated weights for policy 1, policy_version 1773717 (0.0011) [2023-12-26 13:51:14,644][123090] Updated weights for policy 1, policy_version 1773727 (0.0010) [2023-12-26 13:51:14,839][123091] Updated weights for policy 0, policy_version 1785684 (0.0010) [2023-12-26 13:51:14,912][123091] Updated weights for policy 0, policy_version 1785694 (0.0006) [2023-12-26 13:51:14,984][123091] Updated weights for policy 0, policy_version 1785704 (0.0005) [2023-12-26 13:51:15,452][123090] Updated weights for policy 1, policy_version 1773737 (0.0010) [2023-12-26 13:51:15,496][123090] Updated weights for policy 1, policy_version 1773747 (0.0010) [2023-12-26 13:51:15,545][123090] Updated weights for policy 1, policy_version 1773757 (0.0010) [2023-12-26 13:51:15,759][123091] Updated weights for policy 0, policy_version 1785714 (0.0007) [2023-12-26 13:51:15,824][123091] Updated weights for policy 0, policy_version 1785724 (0.0010) [2023-12-26 13:51:15,882][123091] Updated weights for policy 0, policy_version 1785734 (0.0010) [2023-12-26 13:51:16,410][123090] Updated weights for policy 1, policy_version 1773767 (0.0010) [2023-12-26 13:51:16,460][123090] Updated weights for policy 1, policy_version 1773777 (0.0010) [2023-12-26 13:51:16,512][123090] Updated weights for policy 1, policy_version 1773787 (0.0010) [2023-12-26 13:51:16,713][123091] Updated weights for policy 0, policy_version 1785745 (0.0009) [2023-12-26 13:51:16,766][123091] Updated weights for policy 0, policy_version 1785755 (0.0009) [2023-12-26 13:51:16,824][123091] Updated weights for policy 0, policy_version 1785765 (0.0009) [2023-12-26 13:51:16,873][123091] Updated weights for policy 0, policy_version 1785775 (0.0009) [2023-12-26 13:51:17,339][123090] Updated weights for policy 1, policy_version 1773797 (0.0010) [2023-12-26 13:51:17,387][123090] Updated weights for policy 1, policy_version 1773807 (0.0010) [2023-12-26 13:51:17,455][123090] Updated weights for policy 1, policy_version 1773817 (0.0011) [2023-12-26 13:51:17,717][123091] Updated weights for policy 0, policy_version 1785785 (0.0006) [2023-12-26 13:51:17,775][123091] Updated weights for policy 0, policy_version 1785795 (0.0010) [2023-12-26 13:51:17,834][123091] Updated weights for policy 0, policy_version 1785805 (0.0011) [2023-12-26 13:51:18,298][123090] Updated weights for policy 1, policy_version 1773827 (0.0009) [2023-12-26 13:51:18,366][123090] Updated weights for policy 1, policy_version 1773837 (0.0007) [2023-12-26 13:51:18,437][123090] Updated weights for policy 1, policy_version 1773847 (0.0008) [2023-12-26 13:51:18,657][123091] Updated weights for policy 0, policy_version 1785815 (0.0009) [2023-12-26 13:51:18,725][123091] Updated weights for policy 0, policy_version 1785825 (0.0009) [2023-12-26 13:51:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 911278080. Throughput: 0: 8903.9, 1: 8942.3. Samples: 911292708. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:18,785][121949] Avg episode reward: [(0, '6225.114'), (1, '5812.636')] [2023-12-26 13:51:18,786][123091] Updated weights for policy 0, policy_version 1785835 (0.0009) [2023-12-26 13:51:19,187][123090] Updated weights for policy 1, policy_version 1773857 (0.0010) [2023-12-26 13:51:19,248][123090] Updated weights for policy 1, policy_version 1773867 (0.0007) [2023-12-26 13:51:19,313][123090] Updated weights for policy 1, policy_version 1773877 (0.0009) [2023-12-26 13:51:19,384][123090] Updated weights for policy 1, policy_version 1773887 (0.0009) [2023-12-26 13:51:19,573][123091] Updated weights for policy 0, policy_version 1785845 (0.0009) [2023-12-26 13:51:19,623][123091] Updated weights for policy 0, policy_version 1785855 (0.0010) [2023-12-26 13:51:19,679][123091] Updated weights for policy 0, policy_version 1785865 (0.0010) [2023-12-26 13:51:20,179][123090] Updated weights for policy 1, policy_version 1773897 (0.0009) [2023-12-26 13:51:20,244][123090] Updated weights for policy 1, policy_version 1773907 (0.0008) [2023-12-26 13:51:20,308][123090] Updated weights for policy 1, policy_version 1773917 (0.0009) [2023-12-26 13:51:20,609][123091] Updated weights for policy 0, policy_version 1785875 (0.0011) [2023-12-26 13:51:20,677][123091] Updated weights for policy 0, policy_version 1785885 (0.0011) [2023-12-26 13:51:20,751][123091] Updated weights for policy 0, policy_version 1785895 (0.0011) [2023-12-26 13:51:21,085][123090] Updated weights for policy 1, policy_version 1773927 (0.0007) [2023-12-26 13:51:21,152][123090] Updated weights for policy 1, policy_version 1773937 (0.0007) [2023-12-26 13:51:21,208][123090] Updated weights for policy 1, policy_version 1773947 (0.0009) [2023-12-26 13:51:21,601][123091] Updated weights for policy 0, policy_version 1785905 (0.0009) [2023-12-26 13:51:21,672][123091] Updated weights for policy 0, policy_version 1785915 (0.0010) [2023-12-26 13:51:21,740][123091] Updated weights for policy 0, policy_version 1785925 (0.0009) [2023-12-26 13:51:21,816][123091] Updated weights for policy 0, policy_version 1785935 (0.0006) [2023-12-26 13:51:22,066][123090] Updated weights for policy 1, policy_version 1773957 (0.0008) [2023-12-26 13:51:22,141][123090] Updated weights for policy 1, policy_version 1773967 (0.0006) [2023-12-26 13:51:22,216][123090] Updated weights for policy 1, policy_version 1773977 (0.0006) [2023-12-26 13:51:22,590][123091] Updated weights for policy 0, policy_version 1785945 (0.0006) [2023-12-26 13:51:22,657][123091] Updated weights for policy 0, policy_version 1785955 (0.0007) [2023-12-26 13:51:22,731][123091] Updated weights for policy 0, policy_version 1785965 (0.0006) [2023-12-26 13:51:23,009][123090] Updated weights for policy 1, policy_version 1773987 (0.0008) [2023-12-26 13:51:23,079][123090] Updated weights for policy 1, policy_version 1773997 (0.0010) [2023-12-26 13:51:23,141][123090] Updated weights for policy 1, policy_version 1774007 (0.0009) [2023-12-26 13:51:23,445][123091] Updated weights for policy 0, policy_version 1785975 (0.0006) [2023-12-26 13:51:23,507][123091] Updated weights for policy 0, policy_version 1785985 (0.0010) [2023-12-26 13:51:23,568][123091] Updated weights for policy 0, policy_version 1785995 (0.0009) [2023-12-26 13:51:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 911368192. Throughput: 0: 8850.8, 1: 8877.1. Samples: 911344052. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:23,785][121949] Avg episode reward: [(0, '6238.703'), (1, '5973.013')] [2023-12-26 13:51:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001786000_457220096.pth... [2023-12-26 13:51:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001774016_454148096.pth... [2023-12-26 13:51:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001784976_456957952.pth [2023-12-26 13:51:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001772992_453885952.pth [2023-12-26 13:51:24,013][123090] Updated weights for policy 1, policy_version 1774017 (0.0009) [2023-12-26 13:51:24,080][123090] Updated weights for policy 1, policy_version 1774027 (0.0009) [2023-12-26 13:51:24,144][123090] Updated weights for policy 1, policy_version 1774037 (0.0009) [2023-12-26 13:51:24,211][123090] Updated weights for policy 1, policy_version 1774047 (0.0009) [2023-12-26 13:51:24,368][123091] Updated weights for policy 0, policy_version 1786005 (0.0010) [2023-12-26 13:51:24,426][123091] Updated weights for policy 0, policy_version 1786015 (0.0009) [2023-12-26 13:51:24,493][123091] Updated weights for policy 0, policy_version 1786025 (0.0009) [2023-12-26 13:51:25,015][123090] Updated weights for policy 1, policy_version 1774057 (0.0006) [2023-12-26 13:51:25,069][123090] Updated weights for policy 1, policy_version 1774067 (0.0005) [2023-12-26 13:51:25,127][123090] Updated weights for policy 1, policy_version 1774077 (0.0008) [2023-12-26 13:51:25,149][123091] Updated weights for policy 0, policy_version 1786035 (0.0008) [2023-12-26 13:51:25,196][123091] Updated weights for policy 0, policy_version 1786045 (0.0005) [2023-12-26 13:51:25,262][123091] Updated weights for policy 0, policy_version 1786055 (0.0005) [2023-12-26 13:51:25,927][123091] Updated weights for policy 0, policy_version 1786065 (0.0005) [2023-12-26 13:51:25,935][123090] Updated weights for policy 1, policy_version 1774087 (0.0010) [2023-12-26 13:51:25,982][123091] Updated weights for policy 0, policy_version 1786075 (0.0010) [2023-12-26 13:51:25,991][123090] Updated weights for policy 1, policy_version 1774097 (0.0010) [2023-12-26 13:51:26,040][123091] Updated weights for policy 0, policy_version 1786085 (0.0007) [2023-12-26 13:51:26,047][123090] Updated weights for policy 1, policy_version 1774107 (0.0010) [2023-12-26 13:51:26,089][123091] Updated weights for policy 0, policy_version 1786095 (0.0005) [2023-12-26 13:51:26,774][123091] Updated weights for policy 0, policy_version 1786105 (0.0008) [2023-12-26 13:51:26,836][123091] Updated weights for policy 0, policy_version 1786115 (0.0010) [2023-12-26 13:51:26,890][123090] Updated weights for policy 1, policy_version 1774117 (0.0010) [2023-12-26 13:51:26,902][123091] Updated weights for policy 0, policy_version 1786125 (0.0010) [2023-12-26 13:51:26,952][123090] Updated weights for policy 1, policy_version 1774127 (0.0010) [2023-12-26 13:51:27,000][123090] Updated weights for policy 1, policy_version 1774137 (0.0010) [2023-12-26 13:51:27,588][123091] Updated weights for policy 0, policy_version 1786135 (0.0007) [2023-12-26 13:51:27,635][123091] Updated weights for policy 0, policy_version 1786145 (0.0005) [2023-12-26 13:51:27,682][123091] Updated weights for policy 0, policy_version 1786155 (0.0005) [2023-12-26 13:51:27,811][123090] Updated weights for policy 1, policy_version 1774147 (0.0010) [2023-12-26 13:51:27,857][123090] Updated weights for policy 1, policy_version 1774157 (0.0010) [2023-12-26 13:51:27,908][123090] Updated weights for policy 1, policy_version 1774167 (0.0010) [2023-12-26 13:51:28,461][123091] Updated weights for policy 0, policy_version 1786165 (0.0009) [2023-12-26 13:51:28,508][123091] Updated weights for policy 0, policy_version 1786175 (0.0010) [2023-12-26 13:51:28,560][123091] Updated weights for policy 0, policy_version 1786185 (0.0010) [2023-12-26 13:51:28,615][123090] Updated weights for policy 1, policy_version 1774177 (0.0010) [2023-12-26 13:51:28,665][123090] Updated weights for policy 1, policy_version 1774187 (0.0005) [2023-12-26 13:51:28,713][123090] Updated weights for policy 1, policy_version 1774197 (0.0005) [2023-12-26 13:51:28,772][123090] Updated weights for policy 1, policy_version 1774207 (0.0005) [2023-12-26 13:51:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 911466496. Throughput: 0: 8950.8, 1: 8825.5. Samples: 911452664. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:28,785][121949] Avg episode reward: [(0, '6329.961'), (1, '5937.322')] [2023-12-26 13:51:29,405][123091] Updated weights for policy 0, policy_version 1786195 (0.0009) [2023-12-26 13:51:29,474][123091] Updated weights for policy 0, policy_version 1786205 (0.0005) [2023-12-26 13:51:29,504][123090] Updated weights for policy 1, policy_version 1774217 (0.0007) [2023-12-26 13:51:29,536][123091] Updated weights for policy 0, policy_version 1786215 (0.0007) [2023-12-26 13:51:29,552][123090] Updated weights for policy 1, policy_version 1774227 (0.0006) [2023-12-26 13:51:29,609][123090] Updated weights for policy 1, policy_version 1774237 (0.0006) [2023-12-26 13:51:30,331][123091] Updated weights for policy 0, policy_version 1786225 (0.0009) [2023-12-26 13:51:30,386][123091] Updated weights for policy 0, policy_version 1786235 (0.0010) [2023-12-26 13:51:30,416][123090] Updated weights for policy 1, policy_version 1774247 (0.0006) [2023-12-26 13:51:30,443][123091] Updated weights for policy 0, policy_version 1786245 (0.0010) [2023-12-26 13:51:30,464][123090] Updated weights for policy 1, policy_version 1774257 (0.0005) [2023-12-26 13:51:30,491][123091] Updated weights for policy 0, policy_version 1786255 (0.0010) [2023-12-26 13:51:30,521][123090] Updated weights for policy 1, policy_version 1774267 (0.0005) [2023-12-26 13:51:31,157][123090] Updated weights for policy 1, policy_version 1774277 (0.0007) [2023-12-26 13:51:31,239][123090] Updated weights for policy 1, policy_version 1774287 (0.0005) [2023-12-26 13:51:31,270][123091] Updated weights for policy 0, policy_version 1786265 (0.0007) [2023-12-26 13:51:31,314][123090] Updated weights for policy 1, policy_version 1774297 (0.0006) [2023-12-26 13:51:31,322][123091] Updated weights for policy 0, policy_version 1786275 (0.0008) [2023-12-26 13:51:31,385][123091] Updated weights for policy 0, policy_version 1786285 (0.0007) [2023-12-26 13:51:31,902][123090] Updated weights for policy 1, policy_version 1774307 (0.0007) [2023-12-26 13:51:31,963][123090] Updated weights for policy 1, policy_version 1774317 (0.0005) [2023-12-26 13:51:32,019][123090] Updated weights for policy 1, policy_version 1774327 (0.0006) [2023-12-26 13:51:32,238][123091] Updated weights for policy 0, policy_version 1786295 (0.0009) [2023-12-26 13:51:32,300][123091] Updated weights for policy 0, policy_version 1786305 (0.0009) [2023-12-26 13:51:32,369][123091] Updated weights for policy 0, policy_version 1786315 (0.0010) [2023-12-26 13:51:32,711][123090] Updated weights for policy 1, policy_version 1774337 (0.0006) [2023-12-26 13:51:32,765][123090] Updated weights for policy 1, policy_version 1774347 (0.0010) [2023-12-26 13:51:32,823][123090] Updated weights for policy 1, policy_version 1774357 (0.0006) [2023-12-26 13:51:32,888][123090] Updated weights for policy 1, policy_version 1774367 (0.0005) [2023-12-26 13:51:33,195][123091] Updated weights for policy 0, policy_version 1786325 (0.0008) [2023-12-26 13:51:33,248][123091] Updated weights for policy 0, policy_version 1786335 (0.0006) [2023-12-26 13:51:33,306][123091] Updated weights for policy 0, policy_version 1786345 (0.0006) [2023-12-26 13:51:33,652][123090] Updated weights for policy 1, policy_version 1774377 (0.0005) [2023-12-26 13:51:33,709][123090] Updated weights for policy 1, policy_version 1774387 (0.0005) [2023-12-26 13:51:33,757][123090] Updated weights for policy 1, policy_version 1774397 (0.0005) [2023-12-26 13:51:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 911556608. Throughput: 0: 8928.0, 1: 8946.5. Samples: 911564016. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:33,785][121949] Avg episode reward: [(0, '6347.035'), (1, '5854.565')] [2023-12-26 13:51:33,998][123091] Updated weights for policy 0, policy_version 1786355 (0.0007) [2023-12-26 13:51:34,052][123091] Updated weights for policy 0, policy_version 1786366 (0.0006) [2023-12-26 13:51:34,113][123091] Updated weights for policy 0, policy_version 1786376 (0.0006) [2023-12-26 13:51:34,438][123090] Updated weights for policy 1, policy_version 1774407 (0.0008) [2023-12-26 13:51:34,503][123090] Updated weights for policy 1, policy_version 1774417 (0.0009) [2023-12-26 13:51:34,563][123090] Updated weights for policy 1, policy_version 1774427 (0.0008) [2023-12-26 13:51:34,934][123091] Updated weights for policy 0, policy_version 1786386 (0.0009) [2023-12-26 13:51:34,985][123091] Updated weights for policy 0, policy_version 1786396 (0.0011) [2023-12-26 13:51:35,034][123091] Updated weights for policy 0, policy_version 1786406 (0.0011) [2023-12-26 13:51:35,092][123091] Updated weights for policy 0, policy_version 1786416 (0.0010) [2023-12-26 13:51:35,409][123090] Updated weights for policy 1, policy_version 1774437 (0.0009) [2023-12-26 13:51:35,459][123090] Updated weights for policy 1, policy_version 1774447 (0.0007) [2023-12-26 13:51:35,515][123090] Updated weights for policy 1, policy_version 1774457 (0.0010) [2023-12-26 13:51:35,842][123091] Updated weights for policy 0, policy_version 1786426 (0.0005) [2023-12-26 13:51:35,901][123091] Updated weights for policy 0, policy_version 1786436 (0.0005) [2023-12-26 13:51:35,964][123091] Updated weights for policy 0, policy_version 1786446 (0.0005) [2023-12-26 13:51:36,340][123090] Updated weights for policy 1, policy_version 1774467 (0.0010) [2023-12-26 13:51:36,414][123090] Updated weights for policy 1, policy_version 1774477 (0.0010) [2023-12-26 13:51:36,473][123090] Updated weights for policy 1, policy_version 1774487 (0.0010) [2023-12-26 13:51:36,646][123091] Updated weights for policy 0, policy_version 1786456 (0.0010) [2023-12-26 13:51:36,697][123091] Updated weights for policy 0, policy_version 1786466 (0.0010) [2023-12-26 13:51:36,745][123091] Updated weights for policy 0, policy_version 1786476 (0.0010) [2023-12-26 13:51:37,256][123090] Updated weights for policy 1, policy_version 1774497 (0.0010) [2023-12-26 13:51:37,308][123090] Updated weights for policy 1, policy_version 1774507 (0.0009) [2023-12-26 13:51:37,360][123090] Updated weights for policy 1, policy_version 1774517 (0.0010) [2023-12-26 13:51:37,404][123090] Updated weights for policy 1, policy_version 1774527 (0.0010) [2023-12-26 13:51:37,599][123091] Updated weights for policy 0, policy_version 1786486 (0.0007) [2023-12-26 13:51:37,673][123091] Updated weights for policy 0, policy_version 1786496 (0.0005) [2023-12-26 13:51:37,743][123091] Updated weights for policy 0, policy_version 1786506 (0.0006) [2023-12-26 13:51:38,167][123090] Updated weights for policy 1, policy_version 1774537 (0.0006) [2023-12-26 13:51:38,240][123090] Updated weights for policy 1, policy_version 1774547 (0.0007) [2023-12-26 13:51:38,308][123090] Updated weights for policy 1, policy_version 1774557 (0.0005) [2023-12-26 13:51:38,549][123091] Updated weights for policy 0, policy_version 1786516 (0.0008) [2023-12-26 13:51:38,605][123091] Updated weights for policy 0, policy_version 1786526 (0.0009) [2023-12-26 13:51:38,662][123091] Updated weights for policy 0, policy_version 1786536 (0.0009) [2023-12-26 13:51:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.5, 300 sec: 17883.6). Total num frames: 911646720. Throughput: 0: 9001.0, 1: 8924.7. Samples: 911619712. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:38,785][121949] Avg episode reward: [(0, '6328.512'), (1, '5899.912')] [2023-12-26 13:51:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001786544_457359360.pth... [2023-12-26 13:51:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001774560_454287360.pth... [2023-12-26 13:51:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001785488_457089024.pth [2023-12-26 13:51:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001773504_454017024.pth [2023-12-26 13:51:39,091][123090] Updated weights for policy 1, policy_version 1774567 (0.0010) [2023-12-26 13:51:39,162][123090] Updated weights for policy 1, policy_version 1774577 (0.0010) [2023-12-26 13:51:39,232][123090] Updated weights for policy 1, policy_version 1774587 (0.0011) [2023-12-26 13:51:39,457][123091] Updated weights for policy 0, policy_version 1786546 (0.0009) [2023-12-26 13:51:39,517][123091] Updated weights for policy 0, policy_version 1786556 (0.0009) [2023-12-26 13:51:39,575][123091] Updated weights for policy 0, policy_version 1786566 (0.0009) [2023-12-26 13:51:39,636][123091] Updated weights for policy 0, policy_version 1786576 (0.0008) [2023-12-26 13:51:40,054][123090] Updated weights for policy 1, policy_version 1774597 (0.0010) [2023-12-26 13:51:40,118][123090] Updated weights for policy 1, policy_version 1774607 (0.0010) [2023-12-26 13:51:40,185][123090] Updated weights for policy 1, policy_version 1774617 (0.0010) [2023-12-26 13:51:40,490][123091] Updated weights for policy 0, policy_version 1786586 (0.0009) [2023-12-26 13:51:40,549][123091] Updated weights for policy 0, policy_version 1786596 (0.0009) [2023-12-26 13:51:40,615][123091] Updated weights for policy 0, policy_version 1786606 (0.0009) [2023-12-26 13:51:40,959][123090] Updated weights for policy 1, policy_version 1774627 (0.0011) [2023-12-26 13:51:41,029][123090] Updated weights for policy 1, policy_version 1774637 (0.0010) [2023-12-26 13:51:41,093][123090] Updated weights for policy 1, policy_version 1774647 (0.0008) [2023-12-26 13:51:41,468][123091] Updated weights for policy 0, policy_version 1786616 (0.0006) [2023-12-26 13:51:41,534][123091] Updated weights for policy 0, policy_version 1786626 (0.0006) [2023-12-26 13:51:41,598][123091] Updated weights for policy 0, policy_version 1786636 (0.0007) [2023-12-26 13:51:41,926][123090] Updated weights for policy 1, policy_version 1774657 (0.0008) [2023-12-26 13:51:41,991][123090] Updated weights for policy 1, policy_version 1774667 (0.0011) [2023-12-26 13:51:42,055][123090] Updated weights for policy 1, policy_version 1774677 (0.0011) [2023-12-26 13:51:42,127][123090] Updated weights for policy 1, policy_version 1774687 (0.0011) [2023-12-26 13:51:42,379][123091] Updated weights for policy 0, policy_version 1786646 (0.0010) [2023-12-26 13:51:42,445][123091] Updated weights for policy 0, policy_version 1786656 (0.0009) [2023-12-26 13:51:42,510][123091] Updated weights for policy 0, policy_version 1786666 (0.0009) [2023-12-26 13:51:42,958][123090] Updated weights for policy 1, policy_version 1774697 (0.0010) [2023-12-26 13:51:43,018][123090] Updated weights for policy 1, policy_version 1774707 (0.0011) [2023-12-26 13:51:43,064][123090] Updated weights for policy 1, policy_version 1774717 (0.0007) [2023-12-26 13:51:43,406][123091] Updated weights for policy 0, policy_version 1786676 (0.0009) [2023-12-26 13:51:43,459][123091] Updated weights for policy 0, policy_version 1786686 (0.0010) [2023-12-26 13:51:43,512][123091] Updated weights for policy 0, policy_version 1786696 (0.0010) [2023-12-26 13:51:43,763][123090] Updated weights for policy 1, policy_version 1774727 (0.0008) [2023-12-26 13:51:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 911728640. Throughput: 0: 8794.8, 1: 8906.6. Samples: 911723320. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:43,784][121949] Avg episode reward: [(0, '6360.181'), (1, '5838.342')] [2023-12-26 13:51:43,816][123090] Updated weights for policy 1, policy_version 1774737 (0.0009) [2023-12-26 13:51:43,884][123090] Updated weights for policy 1, policy_version 1774748 (0.0006) [2023-12-26 13:51:44,287][123091] Updated weights for policy 0, policy_version 1786706 (0.0009) [2023-12-26 13:51:44,350][123091] Updated weights for policy 0, policy_version 1786716 (0.0005) [2023-12-26 13:51:44,405][123091] Updated weights for policy 0, policy_version 1786726 (0.0005) [2023-12-26 13:51:44,470][123091] Updated weights for policy 0, policy_version 1786736 (0.0005) [2023-12-26 13:51:44,563][123090] Updated weights for policy 1, policy_version 1774758 (0.0005) [2023-12-26 13:51:44,617][123090] Updated weights for policy 1, policy_version 1774768 (0.0005) [2023-12-26 13:51:44,673][123090] Updated weights for policy 1, policy_version 1774778 (0.0005) [2023-12-26 13:51:45,320][123090] Updated weights for policy 1, policy_version 1774788 (0.0006) [2023-12-26 13:51:45,334][123091] Updated weights for policy 0, policy_version 1786746 (0.0009) [2023-12-26 13:51:45,371][123090] Updated weights for policy 1, policy_version 1774798 (0.0009) [2023-12-26 13:51:45,400][123091] Updated weights for policy 0, policy_version 1786756 (0.0009) [2023-12-26 13:51:45,428][123090] Updated weights for policy 1, policy_version 1774808 (0.0007) [2023-12-26 13:51:45,461][123091] Updated weights for policy 0, policy_version 1786766 (0.0009) [2023-12-26 13:51:46,218][123091] Updated weights for policy 0, policy_version 1786776 (0.0006) [2023-12-26 13:51:46,253][123090] Updated weights for policy 1, policy_version 1774818 (0.0005) [2023-12-26 13:51:46,283][123091] Updated weights for policy 0, policy_version 1786786 (0.0005) [2023-12-26 13:51:46,318][123090] Updated weights for policy 1, policy_version 1774828 (0.0005) [2023-12-26 13:51:46,333][123091] Updated weights for policy 0, policy_version 1786796 (0.0007) [2023-12-26 13:51:46,380][123090] Updated weights for policy 1, policy_version 1774838 (0.0005) [2023-12-26 13:51:46,432][123090] Updated weights for policy 1, policy_version 1774848 (0.0005) [2023-12-26 13:51:47,004][123091] Updated weights for policy 0, policy_version 1786806 (0.0006) [2023-12-26 13:51:47,046][123090] Updated weights for policy 1, policy_version 1774858 (0.0008) [2023-12-26 13:51:47,061][123091] Updated weights for policy 0, policy_version 1786816 (0.0007) [2023-12-26 13:51:47,108][123090] Updated weights for policy 1, policy_version 1774868 (0.0009) [2023-12-26 13:51:47,110][123091] Updated weights for policy 0, policy_version 1786826 (0.0006) [2023-12-26 13:51:47,165][123090] Updated weights for policy 1, policy_version 1774878 (0.0008) [2023-12-26 13:51:47,802][123091] Updated weights for policy 0, policy_version 1786836 (0.0006) [2023-12-26 13:51:47,857][123091] Updated weights for policy 0, policy_version 1786846 (0.0005) [2023-12-26 13:51:47,914][123091] Updated weights for policy 0, policy_version 1786856 (0.0005) [2023-12-26 13:51:48,053][123090] Updated weights for policy 1, policy_version 1774888 (0.0009) [2023-12-26 13:51:48,111][123090] Updated weights for policy 1, policy_version 1774898 (0.0009) [2023-12-26 13:51:48,166][123090] Updated weights for policy 1, policy_version 1774908 (0.0010) [2023-12-26 13:51:48,550][123091] Updated weights for policy 0, policy_version 1786866 (0.0005) [2023-12-26 13:51:48,622][123091] Updated weights for policy 0, policy_version 1786876 (0.0007) [2023-12-26 13:51:48,690][123091] Updated weights for policy 0, policy_version 1786886 (0.0005) [2023-12-26 13:51:48,747][123091] Updated weights for policy 0, policy_version 1786896 (0.0005) [2023-12-26 13:51:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 911826944. Throughput: 0: 8902.0, 1: 8942.2. Samples: 911835620. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:48,785][121949] Avg episode reward: [(0, '6395.793'), (1, '5792.794')] [2023-12-26 13:51:49,034][123090] Updated weights for policy 1, policy_version 1774918 (0.0009) [2023-12-26 13:51:49,088][123090] Updated weights for policy 1, policy_version 1774928 (0.0009) [2023-12-26 13:51:49,142][123090] Updated weights for policy 1, policy_version 1774938 (0.0009) [2023-12-26 13:51:49,513][123091] Updated weights for policy 0, policy_version 1786906 (0.0006) [2023-12-26 13:51:49,572][123091] Updated weights for policy 0, policy_version 1786916 (0.0005) [2023-12-26 13:51:49,643][123091] Updated weights for policy 0, policy_version 1786926 (0.0006) [2023-12-26 13:51:50,031][123090] Updated weights for policy 1, policy_version 1774948 (0.0008) [2023-12-26 13:51:50,095][123090] Updated weights for policy 1, policy_version 1774958 (0.0006) [2023-12-26 13:51:50,145][123090] Updated weights for policy 1, policy_version 1774968 (0.0008) [2023-12-26 13:51:50,418][123091] Updated weights for policy 0, policy_version 1786936 (0.0010) [2023-12-26 13:51:50,477][123091] Updated weights for policy 0, policy_version 1786946 (0.0010) [2023-12-26 13:51:50,535][123091] Updated weights for policy 0, policy_version 1786956 (0.0010) [2023-12-26 13:51:50,835][123090] Updated weights for policy 1, policy_version 1774978 (0.0009) [2023-12-26 13:51:50,893][123090] Updated weights for policy 1, policy_version 1774988 (0.0007) [2023-12-26 13:51:50,942][123090] Updated weights for policy 1, policy_version 1774998 (0.0009) [2023-12-26 13:51:51,005][123090] Updated weights for policy 1, policy_version 1775008 (0.0006) [2023-12-26 13:51:51,444][123091] Updated weights for policy 0, policy_version 1786966 (0.0009) [2023-12-26 13:51:51,511][123091] Updated weights for policy 0, policy_version 1786976 (0.0008) [2023-12-26 13:51:51,569][123091] Updated weights for policy 0, policy_version 1786986 (0.0010) [2023-12-26 13:51:51,883][123090] Updated weights for policy 1, policy_version 1775018 (0.0009) [2023-12-26 13:51:51,947][123090] Updated weights for policy 1, policy_version 1775028 (0.0010) [2023-12-26 13:51:52,014][123090] Updated weights for policy 1, policy_version 1775038 (0.0010) [2023-12-26 13:51:52,421][123091] Updated weights for policy 0, policy_version 1786996 (0.0007) [2023-12-26 13:51:52,485][123091] Updated weights for policy 0, policy_version 1787006 (0.0008) [2023-12-26 13:51:52,542][123091] Updated weights for policy 0, policy_version 1787016 (0.0007) [2023-12-26 13:51:52,876][123090] Updated weights for policy 1, policy_version 1775048 (0.0010) [2023-12-26 13:51:52,927][123090] Updated weights for policy 1, policy_version 1775058 (0.0010) [2023-12-26 13:51:52,998][123090] Updated weights for policy 1, policy_version 1775068 (0.0010) [2023-12-26 13:51:53,248][123091] Updated weights for policy 0, policy_version 1787026 (0.0006) [2023-12-26 13:51:53,316][123091] Updated weights for policy 0, policy_version 1787036 (0.0009) [2023-12-26 13:51:53,385][123091] Updated weights for policy 0, policy_version 1787046 (0.0008) [2023-12-26 13:51:53,456][123091] Updated weights for policy 0, policy_version 1787056 (0.0007) [2023-12-26 13:51:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 911908864. Throughput: 0: 8926.2, 1: 8953.4. Samples: 911888032. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:53,785][121949] Avg episode reward: [(0, '6329.334'), (1, '5876.522')] [2023-12-26 13:51:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001787056_457490432.pth... [2023-12-26 13:51:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001786000_457220096.pth [2023-12-26 13:51:53,840][123090] Updated weights for policy 1, policy_version 1775078 (0.0011) [2023-12-26 13:51:53,907][123090] Updated weights for policy 1, policy_version 1775088 (0.0011) [2023-12-26 13:51:53,982][123090] Updated weights for policy 1, policy_version 1775098 (0.0011) [2023-12-26 13:51:54,013][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001775104_454426624.pth... [2023-12-26 13:51:54,017][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001774016_454148096.pth [2023-12-26 13:51:54,131][123091] Updated weights for policy 0, policy_version 1787066 (0.0006) [2023-12-26 13:51:54,195][123091] Updated weights for policy 0, policy_version 1787076 (0.0007) [2023-12-26 13:51:54,262][123091] Updated weights for policy 0, policy_version 1787086 (0.0009) [2023-12-26 13:51:54,775][123090] Updated weights for policy 1, policy_version 1775108 (0.0010) [2023-12-26 13:51:54,819][123090] Updated weights for policy 1, policy_version 1775118 (0.0010) [2023-12-26 13:51:54,873][123090] Updated weights for policy 1, policy_version 1775128 (0.0010) [2023-12-26 13:51:55,026][123091] Updated weights for policy 0, policy_version 1787096 (0.0009) [2023-12-26 13:51:55,083][123091] Updated weights for policy 0, policy_version 1787107 (0.0009) [2023-12-26 13:51:55,137][123091] Updated weights for policy 0, policy_version 1787117 (0.0009) [2023-12-26 13:51:55,719][123090] Updated weights for policy 1, policy_version 1775138 (0.0010) [2023-12-26 13:51:55,762][123090] Updated weights for policy 1, policy_version 1775148 (0.0010) [2023-12-26 13:51:55,809][123090] Updated weights for policy 1, policy_version 1775158 (0.0010) [2023-12-26 13:51:55,855][123091] Updated weights for policy 0, policy_version 1787127 (0.0006) [2023-12-26 13:51:55,868][123090] Updated weights for policy 1, policy_version 1775168 (0.0010) [2023-12-26 13:51:55,918][123091] Updated weights for policy 0, policy_version 1787137 (0.0009) [2023-12-26 13:51:55,977][123091] Updated weights for policy 0, policy_version 1787147 (0.0009) [2023-12-26 13:51:56,657][123090] Updated weights for policy 1, policy_version 1775178 (0.0005) [2023-12-26 13:51:56,682][123091] Updated weights for policy 0, policy_version 1787157 (0.0009) [2023-12-26 13:51:56,712][123090] Updated weights for policy 1, policy_version 1775188 (0.0005) [2023-12-26 13:51:56,740][123091] Updated weights for policy 0, policy_version 1787167 (0.0010) [2023-12-26 13:51:56,772][123090] Updated weights for policy 1, policy_version 1775198 (0.0005) [2023-12-26 13:51:56,802][123091] Updated weights for policy 0, policy_version 1787177 (0.0011) [2023-12-26 13:51:57,452][123090] Updated weights for policy 1, policy_version 1775208 (0.0006) [2023-12-26 13:51:57,517][123090] Updated weights for policy 1, policy_version 1775218 (0.0005) [2023-12-26 13:51:57,576][123090] Updated weights for policy 1, policy_version 1775228 (0.0005) [2023-12-26 13:51:57,590][123091] Updated weights for policy 0, policy_version 1787187 (0.0010) [2023-12-26 13:51:57,650][123091] Updated weights for policy 0, policy_version 1787197 (0.0005) [2023-12-26 13:51:57,722][123091] Updated weights for policy 0, policy_version 1787207 (0.0009) [2023-12-26 13:51:58,322][123090] Updated weights for policy 1, policy_version 1775238 (0.0009) [2023-12-26 13:51:58,399][123090] Updated weights for policy 1, policy_version 1775248 (0.0009) [2023-12-26 13:51:58,462][123090] Updated weights for policy 1, policy_version 1775258 (0.0007) [2023-12-26 13:51:58,572][123091] Updated weights for policy 0, policy_version 1787217 (0.0009) [2023-12-26 13:51:58,631][123091] Updated weights for policy 0, policy_version 1787227 (0.0010) [2023-12-26 13:51:58,696][123091] Updated weights for policy 0, policy_version 1787237 (0.0009) [2023-12-26 13:51:58,762][123091] Updated weights for policy 0, policy_version 1787247 (0.0010) [2023-12-26 13:51:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.6, 300 sec: 17855.8). Total num frames: 912007168. Throughput: 0: 9032.4, 1: 8994.1. Samples: 911996716. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:51:58,785][121949] Avg episode reward: [(0, '6341.051'), (1, '5776.944')] [2023-12-26 13:51:59,215][123090] Updated weights for policy 1, policy_version 1775268 (0.0007) [2023-12-26 13:51:59,288][123090] Updated weights for policy 1, policy_version 1775278 (0.0008) [2023-12-26 13:51:59,355][123090] Updated weights for policy 1, policy_version 1775288 (0.0008) [2023-12-26 13:51:59,665][123091] Updated weights for policy 0, policy_version 1787257 (0.0009) [2023-12-26 13:51:59,728][123091] Updated weights for policy 0, policy_version 1787267 (0.0008) [2023-12-26 13:51:59,789][123091] Updated weights for policy 0, policy_version 1787277 (0.0009) [2023-12-26 13:52:00,128][123090] Updated weights for policy 1, policy_version 1775298 (0.0009) [2023-12-26 13:52:00,190][123090] Updated weights for policy 1, policy_version 1775308 (0.0010) [2023-12-26 13:52:00,255][123090] Updated weights for policy 1, policy_version 1775318 (0.0008) [2023-12-26 13:52:00,322][123090] Updated weights for policy 1, policy_version 1775328 (0.0005) [2023-12-26 13:52:00,684][123091] Updated weights for policy 0, policy_version 1787287 (0.0009) [2023-12-26 13:52:00,743][123091] Updated weights for policy 0, policy_version 1787297 (0.0008) [2023-12-26 13:52:00,806][123091] Updated weights for policy 0, policy_version 1787307 (0.0009) [2023-12-26 13:52:01,042][123090] Updated weights for policy 1, policy_version 1775338 (0.0006) [2023-12-26 13:52:01,104][123090] Updated weights for policy 1, policy_version 1775348 (0.0006) [2023-12-26 13:52:01,170][123090] Updated weights for policy 1, policy_version 1775358 (0.0012) [2023-12-26 13:52:01,648][123091] Updated weights for policy 0, policy_version 1787317 (0.0007) [2023-12-26 13:52:01,714][123091] Updated weights for policy 0, policy_version 1787327 (0.0009) [2023-12-26 13:52:01,784][123091] Updated weights for policy 0, policy_version 1787337 (0.0009) [2023-12-26 13:52:01,941][123090] Updated weights for policy 1, policy_version 1775368 (0.0008) [2023-12-26 13:52:02,004][123090] Updated weights for policy 1, policy_version 1775378 (0.0009) [2023-12-26 13:52:02,066][123090] Updated weights for policy 1, policy_version 1775388 (0.0010) [2023-12-26 13:52:02,637][123091] Updated weights for policy 0, policy_version 1787347 (0.0009) [2023-12-26 13:52:02,702][123091] Updated weights for policy 0, policy_version 1787357 (0.0009) [2023-12-26 13:52:02,763][123091] Updated weights for policy 0, policy_version 1787367 (0.0009) [2023-12-26 13:52:02,868][123090] Updated weights for policy 1, policy_version 1775398 (0.0010) [2023-12-26 13:52:02,927][123090] Updated weights for policy 1, policy_version 1775408 (0.0010) [2023-12-26 13:52:02,989][123090] Updated weights for policy 1, policy_version 1775418 (0.0010) [2023-12-26 13:52:03,587][123091] Updated weights for policy 0, policy_version 1787377 (0.0009) [2023-12-26 13:52:03,646][123091] Updated weights for policy 0, policy_version 1787387 (0.0008) [2023-12-26 13:52:03,705][123091] Updated weights for policy 0, policy_version 1787397 (0.0009) [2023-12-26 13:52:03,775][123091] Updated weights for policy 0, policy_version 1787407 (0.0008) [2023-12-26 13:52:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 912089088. Throughput: 0: 8947.4, 1: 8995.0. Samples: 912100116. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:03,784][121949] Avg episode reward: [(0, '6412.924'), (1, '5757.940')] [2023-12-26 13:52:03,803][123090] Updated weights for policy 1, policy_version 1775428 (0.0010) [2023-12-26 13:52:03,876][123090] Updated weights for policy 1, policy_version 1775438 (0.0009) [2023-12-26 13:52:03,926][123090] Updated weights for policy 1, policy_version 1775448 (0.0006) [2023-12-26 13:52:04,599][123091] Updated weights for policy 0, policy_version 1787417 (0.0009) [2023-12-26 13:52:04,663][123091] Updated weights for policy 0, policy_version 1787427 (0.0008) [2023-12-26 13:52:04,664][123090] Updated weights for policy 1, policy_version 1775458 (0.0008) [2023-12-26 13:52:04,720][123091] Updated weights for policy 0, policy_version 1787437 (0.0008) [2023-12-26 13:52:04,725][123090] Updated weights for policy 1, policy_version 1775468 (0.0010) [2023-12-26 13:52:04,793][123090] Updated weights for policy 1, policy_version 1775478 (0.0010) [2023-12-26 13:52:04,860][123090] Updated weights for policy 1, policy_version 1775488 (0.0008) [2023-12-26 13:52:05,518][123090] Updated weights for policy 1, policy_version 1775498 (0.0009) [2023-12-26 13:52:05,575][123090] Updated weights for policy 1, policy_version 1775508 (0.0008) [2023-12-26 13:52:05,578][123091] Updated weights for policy 0, policy_version 1787447 (0.0008) [2023-12-26 13:52:05,632][123091] Updated weights for policy 0, policy_version 1787457 (0.0009) [2023-12-26 13:52:05,634][123090] Updated weights for policy 1, policy_version 1775518 (0.0007) [2023-12-26 13:52:05,693][123091] Updated weights for policy 0, policy_version 1787467 (0.0009) [2023-12-26 13:52:06,466][123090] Updated weights for policy 1, policy_version 1775528 (0.0008) [2023-12-26 13:52:06,517][123091] Updated weights for policy 0, policy_version 1787477 (0.0009) [2023-12-26 13:52:06,536][123090] Updated weights for policy 1, policy_version 1775538 (0.0005) [2023-12-26 13:52:06,580][123091] Updated weights for policy 0, policy_version 1787487 (0.0009) [2023-12-26 13:52:06,600][123090] Updated weights for policy 1, policy_version 1775548 (0.0007) [2023-12-26 13:52:06,638][123091] Updated weights for policy 0, policy_version 1787497 (0.0009) [2023-12-26 13:52:07,414][123090] Updated weights for policy 1, policy_version 1775558 (0.0009) [2023-12-26 13:52:07,473][123090] Updated weights for policy 1, policy_version 1775568 (0.0009) [2023-12-26 13:52:07,478][123091] Updated weights for policy 0, policy_version 1787507 (0.0010) [2023-12-26 13:52:07,534][123091] Updated weights for policy 0, policy_version 1787517 (0.0010) [2023-12-26 13:52:07,544][123090] Updated weights for policy 1, policy_version 1775578 (0.0007) [2023-12-26 13:52:07,583][123091] Updated weights for policy 0, policy_version 1787527 (0.0006) [2023-12-26 13:52:08,395][123090] Updated weights for policy 1, policy_version 1775588 (0.0009) [2023-12-26 13:52:08,413][123091] Updated weights for policy 0, policy_version 1787537 (0.0005) [2023-12-26 13:52:08,463][123090] Updated weights for policy 1, policy_version 1775598 (0.0010) [2023-12-26 13:52:08,472][123091] Updated weights for policy 0, policy_version 1787547 (0.0006) [2023-12-26 13:52:08,526][123090] Updated weights for policy 1, policy_version 1775608 (0.0008) [2023-12-26 13:52:08,541][123091] Updated weights for policy 0, policy_version 1787557 (0.0008) [2023-12-26 13:52:08,606][123091] Updated weights for policy 0, policy_version 1787567 (0.0008) [2023-12-26 13:52:08,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 912179200. Throughput: 0: 8950.2, 1: 9006.7. Samples: 912152116. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:08,786][121949] Avg episode reward: [(0, '6278.685'), (1, '5856.045')] [2023-12-26 13:52:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001787568_457621504.pth... [2023-12-26 13:52:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001775616_454557696.pth... [2023-12-26 13:52:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001786544_457359360.pth [2023-12-26 13:52:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001774560_454287360.pth [2023-12-26 13:52:09,269][123090] Updated weights for policy 1, policy_version 1775618 (0.0009) [2023-12-26 13:52:09,333][123090] Updated weights for policy 1, policy_version 1775628 (0.0010) [2023-12-26 13:52:09,400][123090] Updated weights for policy 1, policy_version 1775638 (0.0009) [2023-12-26 13:52:09,461][123090] Updated weights for policy 1, policy_version 1775648 (0.0009) [2023-12-26 13:52:09,487][123091] Updated weights for policy 0, policy_version 1787577 (0.0008) [2023-12-26 13:52:09,548][123091] Updated weights for policy 0, policy_version 1787587 (0.0009) [2023-12-26 13:52:09,599][123091] Updated weights for policy 0, policy_version 1787597 (0.0009) [2023-12-26 13:52:10,346][123090] Updated weights for policy 1, policy_version 1775658 (0.0009) [2023-12-26 13:52:10,424][123090] Updated weights for policy 1, policy_version 1775668 (0.0009) [2023-12-26 13:52:10,463][123091] Updated weights for policy 0, policy_version 1787607 (0.0009) [2023-12-26 13:52:10,489][123090] Updated weights for policy 1, policy_version 1775678 (0.0009) [2023-12-26 13:52:10,515][123091] Updated weights for policy 0, policy_version 1787617 (0.0009) [2023-12-26 13:52:10,570][123091] Updated weights for policy 0, policy_version 1787627 (0.0009) [2023-12-26 13:52:11,277][123090] Updated weights for policy 1, policy_version 1775688 (0.0008) [2023-12-26 13:52:11,339][123090] Updated weights for policy 1, policy_version 1775698 (0.0010) [2023-12-26 13:52:11,414][123090] Updated weights for policy 1, policy_version 1775708 (0.0009) [2023-12-26 13:52:11,468][123091] Updated weights for policy 0, policy_version 1787637 (0.0009) [2023-12-26 13:52:11,530][123091] Updated weights for policy 0, policy_version 1787647 (0.0010) [2023-12-26 13:52:11,580][123091] Updated weights for policy 0, policy_version 1787657 (0.0006) [2023-12-26 13:52:12,247][123090] Updated weights for policy 1, policy_version 1775718 (0.0009) [2023-12-26 13:52:12,315][123090] Updated weights for policy 1, policy_version 1775728 (0.0009) [2023-12-26 13:52:12,392][123090] Updated weights for policy 1, policy_version 1775738 (0.0009) [2023-12-26 13:52:12,417][123091] Updated weights for policy 0, policy_version 1787667 (0.0008) [2023-12-26 13:52:12,474][123091] Updated weights for policy 0, policy_version 1787677 (0.0011) [2023-12-26 13:52:12,538][123091] Updated weights for policy 0, policy_version 1787687 (0.0007) [2023-12-26 13:52:13,139][123090] Updated weights for policy 1, policy_version 1775748 (0.0008) [2023-12-26 13:52:13,193][123090] Updated weights for policy 1, policy_version 1775758 (0.0007) [2023-12-26 13:52:13,246][123090] Updated weights for policy 1, policy_version 1775768 (0.0006) [2023-12-26 13:52:13,246][123091] Updated weights for policy 0, policy_version 1787697 (0.0007) [2023-12-26 13:52:13,311][123091] Updated weights for policy 0, policy_version 1787707 (0.0009) [2023-12-26 13:52:13,360][123091] Updated weights for policy 0, policy_version 1787717 (0.0009) [2023-12-26 13:52:13,410][123091] Updated weights for policy 0, policy_version 1787727 (0.0009) [2023-12-26 13:52:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 912261120. Throughput: 0: 8790.1, 1: 9009.3. Samples: 912253640. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:13,785][121949] Avg episode reward: [(0, '6193.768'), (1, '5926.286')] [2023-12-26 13:52:13,921][123090] Updated weights for policy 1, policy_version 1775778 (0.0006) [2023-12-26 13:52:13,992][123090] Updated weights for policy 1, policy_version 1775788 (0.0010) [2023-12-26 13:52:14,062][123090] Updated weights for policy 1, policy_version 1775798 (0.0010) [2023-12-26 13:52:14,126][123090] Updated weights for policy 1, policy_version 1775808 (0.0010) [2023-12-26 13:52:14,162][123091] Updated weights for policy 0, policy_version 1787737 (0.0006) [2023-12-26 13:52:14,213][123091] Updated weights for policy 0, policy_version 1787747 (0.0005) [2023-12-26 13:52:14,266][123091] Updated weights for policy 0, policy_version 1787757 (0.0006) [2023-12-26 13:52:14,876][123090] Updated weights for policy 1, policy_version 1775818 (0.0011) [2023-12-26 13:52:14,917][123091] Updated weights for policy 0, policy_version 1787767 (0.0005) [2023-12-26 13:52:14,941][123090] Updated weights for policy 1, policy_version 1775828 (0.0010) [2023-12-26 13:52:14,982][123091] Updated weights for policy 0, policy_version 1787777 (0.0007) [2023-12-26 13:52:15,006][123090] Updated weights for policy 1, policy_version 1775838 (0.0011) [2023-12-26 13:52:15,036][123091] Updated weights for policy 0, policy_version 1787787 (0.0008) [2023-12-26 13:52:15,720][123091] Updated weights for policy 0, policy_version 1787797 (0.0008) [2023-12-26 13:52:15,775][123091] Updated weights for policy 0, policy_version 1787807 (0.0009) [2023-12-26 13:52:15,824][123091] Updated weights for policy 0, policy_version 1787817 (0.0008) [2023-12-26 13:52:15,824][123090] Updated weights for policy 1, policy_version 1775848 (0.0011) [2023-12-26 13:52:15,875][123090] Updated weights for policy 1, policy_version 1775858 (0.0010) [2023-12-26 13:52:15,931][123090] Updated weights for policy 1, policy_version 1775868 (0.0010) [2023-12-26 13:52:16,680][123091] Updated weights for policy 0, policy_version 1787827 (0.0007) [2023-12-26 13:52:16,712][123090] Updated weights for policy 1, policy_version 1775878 (0.0008) [2023-12-26 13:52:16,739][123091] Updated weights for policy 0, policy_version 1787837 (0.0010) [2023-12-26 13:52:16,783][123090] Updated weights for policy 1, policy_version 1775888 (0.0005) [2023-12-26 13:52:16,796][123091] Updated weights for policy 0, policy_version 1787847 (0.0008) [2023-12-26 13:52:16,852][123090] Updated weights for policy 1, policy_version 1775898 (0.0005) [2023-12-26 13:52:17,552][123090] Updated weights for policy 1, policy_version 1775908 (0.0007) [2023-12-26 13:52:17,617][123090] Updated weights for policy 1, policy_version 1775918 (0.0009) [2023-12-26 13:52:17,648][123091] Updated weights for policy 0, policy_version 1787857 (0.0009) [2023-12-26 13:52:17,685][123090] Updated weights for policy 1, policy_version 1775928 (0.0006) [2023-12-26 13:52:17,704][123091] Updated weights for policy 0, policy_version 1787867 (0.0011) [2023-12-26 13:52:17,764][123091] Updated weights for policy 0, policy_version 1787877 (0.0011) [2023-12-26 13:52:17,819][123091] Updated weights for policy 0, policy_version 1787887 (0.0011) [2023-12-26 13:52:18,508][123091] Updated weights for policy 0, policy_version 1787897 (0.0009) [2023-12-26 13:52:18,514][123090] Updated weights for policy 1, policy_version 1775938 (0.0007) [2023-12-26 13:52:18,570][123091] Updated weights for policy 0, policy_version 1787907 (0.0009) [2023-12-26 13:52:18,578][123090] Updated weights for policy 1, policy_version 1775948 (0.0009) [2023-12-26 13:52:18,641][123091] Updated weights for policy 0, policy_version 1787917 (0.0009) [2023-12-26 13:52:18,644][123090] Updated weights for policy 1, policy_version 1775958 (0.0005) [2023-12-26 13:52:18,713][123090] Updated weights for policy 1, policy_version 1775968 (0.0009) [2023-12-26 13:52:18,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 912359424. Throughput: 0: 8862.2, 1: 8932.3. Samples: 912364768. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:18,784][121949] Avg episode reward: [(0, '6272.733'), (1, '5936.485')] [2023-12-26 13:52:19,352][123091] Updated weights for policy 0, policy_version 1787927 (0.0010) [2023-12-26 13:52:19,407][123091] Updated weights for policy 0, policy_version 1787937 (0.0010) [2023-12-26 13:52:19,462][123091] Updated weights for policy 0, policy_version 1787947 (0.0010) [2023-12-26 13:52:19,551][123090] Updated weights for policy 1, policy_version 1775978 (0.0011) [2023-12-26 13:52:19,616][123090] Updated weights for policy 1, policy_version 1775988 (0.0011) [2023-12-26 13:52:19,688][123090] Updated weights for policy 1, policy_version 1775998 (0.0011) [2023-12-26 13:52:20,254][123091] Updated weights for policy 0, policy_version 1787957 (0.0011) [2023-12-26 13:52:20,317][123091] Updated weights for policy 0, policy_version 1787967 (0.0011) [2023-12-26 13:52:20,392][123091] Updated weights for policy 0, policy_version 1787977 (0.0011) [2023-12-26 13:52:20,498][123090] Updated weights for policy 1, policy_version 1776008 (0.0008) [2023-12-26 13:52:20,554][123090] Updated weights for policy 1, policy_version 1776018 (0.0010) [2023-12-26 13:52:20,622][123090] Updated weights for policy 1, policy_version 1776028 (0.0011) [2023-12-26 13:52:21,189][123091] Updated weights for policy 0, policy_version 1787987 (0.0010) [2023-12-26 13:52:21,244][123091] Updated weights for policy 0, policy_version 1787997 (0.0008) [2023-12-26 13:52:21,315][123091] Updated weights for policy 0, policy_version 1788007 (0.0009) [2023-12-26 13:52:21,476][123090] Updated weights for policy 1, policy_version 1776038 (0.0007) [2023-12-26 13:52:21,547][123090] Updated weights for policy 1, policy_version 1776048 (0.0006) [2023-12-26 13:52:21,606][123090] Updated weights for policy 1, policy_version 1776058 (0.0009) [2023-12-26 13:52:22,076][123091] Updated weights for policy 0, policy_version 1788017 (0.0009) [2023-12-26 13:52:22,149][123091] Updated weights for policy 0, policy_version 1788027 (0.0005) [2023-12-26 13:52:22,204][123091] Updated weights for policy 0, policy_version 1788037 (0.0006) [2023-12-26 13:52:22,267][123091] Updated weights for policy 0, policy_version 1788047 (0.0007) [2023-12-26 13:52:22,342][123090] Updated weights for policy 1, policy_version 1776068 (0.0007) [2023-12-26 13:52:22,409][123090] Updated weights for policy 1, policy_version 1776078 (0.0011) [2023-12-26 13:52:22,481][123090] Updated weights for policy 1, policy_version 1776088 (0.0011) [2023-12-26 13:52:23,014][123091] Updated weights for policy 0, policy_version 1788057 (0.0009) [2023-12-26 13:52:23,084][123091] Updated weights for policy 0, policy_version 1788067 (0.0006) [2023-12-26 13:52:23,167][123091] Updated weights for policy 0, policy_version 1788077 (0.0006) [2023-12-26 13:52:23,326][123090] Updated weights for policy 1, policy_version 1776098 (0.0011) [2023-12-26 13:52:23,400][123090] Updated weights for policy 1, policy_version 1776108 (0.0009) [2023-12-26 13:52:23,454][123090] Updated weights for policy 1, policy_version 1776118 (0.0005) [2023-12-26 13:52:23,518][123090] Updated weights for policy 1, policy_version 1776128 (0.0005) [2023-12-26 13:52:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 912441344. Throughput: 0: 8817.7, 1: 8904.1. Samples: 912417192. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:23,785][121949] Avg episode reward: [(0, '6340.013'), (1, '5997.675')] [2023-12-26 13:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001776128_454688768.pth... [2023-12-26 13:52:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001775104_454426624.pth [2023-12-26 13:52:23,803][123091] Updated weights for policy 0, policy_version 1788087 (0.0009) [2023-12-26 13:52:23,870][123091] Updated weights for policy 0, policy_version 1788097 (0.0010) [2023-12-26 13:52:23,940][123091] Updated weights for policy 0, policy_version 1788107 (0.0011) [2023-12-26 13:52:23,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001788112_457760768.pth... [2023-12-26 13:52:23,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001787056_457490432.pth [2023-12-26 13:52:24,274][123090] Updated weights for policy 1, policy_version 1776138 (0.0006) [2023-12-26 13:52:24,339][123090] Updated weights for policy 1, policy_version 1776148 (0.0009) [2023-12-26 13:52:24,411][123090] Updated weights for policy 1, policy_version 1776158 (0.0010) [2023-12-26 13:52:24,658][123091] Updated weights for policy 0, policy_version 1788117 (0.0009) [2023-12-26 13:52:24,710][123091] Updated weights for policy 0, policy_version 1788127 (0.0010) [2023-12-26 13:52:24,760][123091] Updated weights for policy 0, policy_version 1788137 (0.0008) [2023-12-26 13:52:25,232][123090] Updated weights for policy 1, policy_version 1776168 (0.0009) [2023-12-26 13:52:25,294][123090] Updated weights for policy 1, policy_version 1776178 (0.0006) [2023-12-26 13:52:25,345][123090] Updated weights for policy 1, policy_version 1776188 (0.0005) [2023-12-26 13:52:25,536][123091] Updated weights for policy 0, policy_version 1788147 (0.0008) [2023-12-26 13:52:25,600][123091] Updated weights for policy 0, policy_version 1788157 (0.0010) [2023-12-26 13:52:25,654][123091] Updated weights for policy 0, policy_version 1788167 (0.0008) [2023-12-26 13:52:26,084][123090] Updated weights for policy 1, policy_version 1776198 (0.0007) [2023-12-26 13:52:26,136][123090] Updated weights for policy 1, policy_version 1776208 (0.0009) [2023-12-26 13:52:26,191][123090] Updated weights for policy 1, policy_version 1776218 (0.0009) [2023-12-26 13:52:26,506][123091] Updated weights for policy 0, policy_version 1788177 (0.0007) [2023-12-26 13:52:26,561][123091] Updated weights for policy 0, policy_version 1788187 (0.0011) [2023-12-26 13:52:26,604][123091] Updated weights for policy 0, policy_version 1788197 (0.0010) [2023-12-26 13:52:26,658][123091] Updated weights for policy 0, policy_version 1788207 (0.0010) [2023-12-26 13:52:27,020][123090] Updated weights for policy 1, policy_version 1776228 (0.0008) [2023-12-26 13:52:27,084][123090] Updated weights for policy 1, policy_version 1776238 (0.0008) [2023-12-26 13:52:27,138][123090] Updated weights for policy 1, policy_version 1776248 (0.0010) [2023-12-26 13:52:27,398][123091] Updated weights for policy 0, policy_version 1788217 (0.0006) [2023-12-26 13:52:27,471][123091] Updated weights for policy 0, policy_version 1788227 (0.0005) [2023-12-26 13:52:27,545][123091] Updated weights for policy 0, policy_version 1788237 (0.0006) [2023-12-26 13:52:27,935][123090] Updated weights for policy 1, policy_version 1776258 (0.0010) [2023-12-26 13:52:27,990][123090] Updated weights for policy 1, policy_version 1776268 (0.0008) [2023-12-26 13:52:28,052][123090] Updated weights for policy 1, policy_version 1776278 (0.0007) [2023-12-26 13:52:28,109][123090] Updated weights for policy 1, policy_version 1776288 (0.0005) [2023-12-26 13:52:28,203][123091] Updated weights for policy 0, policy_version 1788247 (0.0005) [2023-12-26 13:52:28,258][123091] Updated weights for policy 0, policy_version 1788257 (0.0009) [2023-12-26 13:52:28,307][123091] Updated weights for policy 0, policy_version 1788267 (0.0009) [2023-12-26 13:52:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 912531456. Throughput: 0: 8926.7, 1: 8919.4. Samples: 912526396. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 13:52:28,785][121949] Avg episode reward: [(0, '6356.111'), (1, '5928.430')] [2023-12-26 13:52:28,794][123090] Updated weights for policy 1, policy_version 1776298 (0.0005) [2023-12-26 13:52:28,847][123090] Updated weights for policy 1, policy_version 1776308 (0.0005) [2023-12-26 13:52:28,906][123090] Updated weights for policy 1, policy_version 1776318 (0.0005) [2023-12-26 13:52:29,202][123091] Updated weights for policy 0, policy_version 1788277 (0.0009) [2023-12-26 13:52:29,263][123091] Updated weights for policy 0, policy_version 1788287 (0.0008) [2023-12-26 13:52:29,318][123091] Updated weights for policy 0, policy_version 1788297 (0.0008) [2023-12-26 13:52:29,619][123090] Updated weights for policy 1, policy_version 1776328 (0.0005) [2023-12-26 13:52:29,683][123090] Updated weights for policy 1, policy_version 1776338 (0.0006) [2023-12-26 13:52:29,751][123090] Updated weights for policy 1, policy_version 1776348 (0.0006) [2023-12-26 13:52:30,126][123091] Updated weights for policy 0, policy_version 1788307 (0.0007) [2023-12-26 13:52:30,184][123091] Updated weights for policy 0, policy_version 1788317 (0.0006) [2023-12-26 13:52:30,240][123091] Updated weights for policy 0, policy_version 1788327 (0.0006) [2023-12-26 13:52:30,475][123090] Updated weights for policy 1, policy_version 1776358 (0.0007) [2023-12-26 13:52:30,542][123090] Updated weights for policy 1, policy_version 1776368 (0.0005) [2023-12-26 13:52:30,603][123090] Updated weights for policy 1, policy_version 1776378 (0.0005) [2023-12-26 13:52:30,976][123091] Updated weights for policy 0, policy_version 1788337 (0.0006) [2023-12-26 13:52:31,054][123091] Updated weights for policy 0, policy_version 1788347 (0.0008) [2023-12-26 13:52:31,117][123091] Updated weights for policy 0, policy_version 1788357 (0.0010) [2023-12-26 13:52:31,176][123091] Updated weights for policy 0, policy_version 1788367 (0.0010) [2023-12-26 13:52:31,210][123090] Updated weights for policy 1, policy_version 1776388 (0.0007) [2023-12-26 13:52:31,262][123090] Updated weights for policy 1, policy_version 1776398 (0.0009) [2023-12-26 13:52:31,314][123090] Updated weights for policy 1, policy_version 1776408 (0.0009) [2023-12-26 13:52:31,950][123091] Updated weights for policy 0, policy_version 1788377 (0.0006) [2023-12-26 13:52:31,997][123091] Updated weights for policy 0, policy_version 1788387 (0.0007) [2023-12-26 13:52:32,054][123091] Updated weights for policy 0, policy_version 1788397 (0.0007) [2023-12-26 13:52:32,157][123090] Updated weights for policy 1, policy_version 1776418 (0.0007) [2023-12-26 13:52:32,224][123090] Updated weights for policy 1, policy_version 1776428 (0.0006) [2023-12-26 13:52:32,280][123090] Updated weights for policy 1, policy_version 1776438 (0.0008) [2023-12-26 13:52:32,334][123090] Updated weights for policy 1, policy_version 1776448 (0.0009) [2023-12-26 13:52:32,855][123091] Updated weights for policy 0, policy_version 1788407 (0.0009) [2023-12-26 13:52:32,919][123091] Updated weights for policy 0, policy_version 1788417 (0.0006) [2023-12-26 13:52:32,988][123091] Updated weights for policy 0, policy_version 1788427 (0.0007) [2023-12-26 13:52:33,064][123090] Updated weights for policy 1, policy_version 1776458 (0.0007) [2023-12-26 13:52:33,120][123090] Updated weights for policy 1, policy_version 1776468 (0.0005) [2023-12-26 13:52:33,171][123090] Updated weights for policy 1, policy_version 1776478 (0.0005) [2023-12-26 13:52:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 912621568. Throughput: 0: 8873.7, 1: 8952.0. Samples: 912637776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:33,785][121949] Avg episode reward: [(0, '6317.821'), (1, '5793.764')] [2023-12-26 13:52:33,795][123091] Updated weights for policy 0, policy_version 1788437 (0.0009) [2023-12-26 13:52:33,863][123091] Updated weights for policy 0, policy_version 1788447 (0.0009) [2023-12-26 13:52:33,921][123091] Updated weights for policy 0, policy_version 1788457 (0.0009) [2023-12-26 13:52:33,923][123090] Updated weights for policy 1, policy_version 1776488 (0.0008) [2023-12-26 13:52:33,988][123090] Updated weights for policy 1, policy_version 1776498 (0.0008) [2023-12-26 13:52:34,048][123090] Updated weights for policy 1, policy_version 1776508 (0.0005) [2023-12-26 13:52:34,750][123091] Updated weights for policy 0, policy_version 1788467 (0.0008) [2023-12-26 13:52:34,805][123091] Updated weights for policy 0, policy_version 1788477 (0.0010) [2023-12-26 13:52:34,812][123090] Updated weights for policy 1, policy_version 1776518 (0.0005) [2023-12-26 13:52:34,853][123091] Updated weights for policy 0, policy_version 1788487 (0.0010) [2023-12-26 13:52:34,870][123090] Updated weights for policy 1, policy_version 1776528 (0.0005) [2023-12-26 13:52:34,937][123090] Updated weights for policy 1, policy_version 1776538 (0.0007) [2023-12-26 13:52:35,682][123091] Updated weights for policy 0, policy_version 1788497 (0.0010) [2023-12-26 13:52:35,687][123090] Updated weights for policy 1, policy_version 1776548 (0.0008) [2023-12-26 13:52:35,741][123091] Updated weights for policy 0, policy_version 1788507 (0.0010) [2023-12-26 13:52:35,755][123090] Updated weights for policy 1, policy_version 1776558 (0.0008) [2023-12-26 13:52:35,792][123091] Updated weights for policy 0, policy_version 1788517 (0.0010) [2023-12-26 13:52:35,824][123090] Updated weights for policy 1, policy_version 1776568 (0.0007) [2023-12-26 13:52:35,836][123091] Updated weights for policy 0, policy_version 1788527 (0.0010) [2023-12-26 13:52:36,546][123090] Updated weights for policy 1, policy_version 1776578 (0.0007) [2023-12-26 13:52:36,614][123090] Updated weights for policy 1, policy_version 1776588 (0.0010) [2023-12-26 13:52:36,683][123090] Updated weights for policy 1, policy_version 1776598 (0.0009) [2023-12-26 13:52:36,733][123091] Updated weights for policy 0, policy_version 1788537 (0.0006) [2023-12-26 13:52:36,752][123090] Updated weights for policy 1, policy_version 1776608 (0.0008) [2023-12-26 13:52:36,805][123091] Updated weights for policy 0, policy_version 1788547 (0.0007) [2023-12-26 13:52:36,864][123091] Updated weights for policy 0, policy_version 1788557 (0.0009) [2023-12-26 13:52:37,416][123090] Updated weights for policy 1, policy_version 1776618 (0.0009) [2023-12-26 13:52:37,480][123090] Updated weights for policy 1, policy_version 1776628 (0.0009) [2023-12-26 13:52:37,543][123090] Updated weights for policy 1, policy_version 1776638 (0.0009) [2023-12-26 13:52:37,601][123091] Updated weights for policy 0, policy_version 1788567 (0.0010) [2023-12-26 13:52:37,653][123091] Updated weights for policy 0, policy_version 1788577 (0.0009) [2023-12-26 13:52:37,722][123091] Updated weights for policy 0, policy_version 1788587 (0.0009) [2023-12-26 13:52:38,324][123090] Updated weights for policy 1, policy_version 1776648 (0.0008) [2023-12-26 13:52:38,393][123090] Updated weights for policy 1, policy_version 1776658 (0.0007) [2023-12-26 13:52:38,463][123090] Updated weights for policy 1, policy_version 1776668 (0.0008) [2023-12-26 13:52:38,552][123091] Updated weights for policy 0, policy_version 1788597 (0.0009) [2023-12-26 13:52:38,610][123091] Updated weights for policy 0, policy_version 1788607 (0.0009) [2023-12-26 13:52:38,683][123091] Updated weights for policy 0, policy_version 1788617 (0.0009) [2023-12-26 13:52:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 912719872. Throughput: 0: 8866.9, 1: 8982.6. Samples: 912691252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:38,785][121949] Avg episode reward: [(0, '6338.075'), (1, '5863.623')] [2023-12-26 13:52:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001788624_457891840.pth... [2023-12-26 13:52:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001776672_454828032.pth... [2023-12-26 13:52:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001787568_457621504.pth [2023-12-26 13:52:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001775616_454557696.pth [2023-12-26 13:52:39,281][123090] Updated weights for policy 1, policy_version 1776678 (0.0010) [2023-12-26 13:52:39,349][123090] Updated weights for policy 1, policy_version 1776688 (0.0010) [2023-12-26 13:52:39,417][123090] Updated weights for policy 1, policy_version 1776698 (0.0009) [2023-12-26 13:52:39,529][123091] Updated weights for policy 0, policy_version 1788627 (0.0008) [2023-12-26 13:52:39,599][123091] Updated weights for policy 0, policy_version 1788637 (0.0005) [2023-12-26 13:52:39,661][123091] Updated weights for policy 0, policy_version 1788647 (0.0005) [2023-12-26 13:52:40,317][123090] Updated weights for policy 1, policy_version 1776708 (0.0008) [2023-12-26 13:52:40,382][123090] Updated weights for policy 1, policy_version 1776718 (0.0005) [2023-12-26 13:52:40,436][123090] Updated weights for policy 1, policy_version 1776728 (0.0005) [2023-12-26 13:52:40,463][123091] Updated weights for policy 0, policy_version 1788658 (0.0009) [2023-12-26 13:52:40,539][123091] Updated weights for policy 0, policy_version 1788668 (0.0009) [2023-12-26 13:52:40,617][123091] Updated weights for policy 0, policy_version 1788678 (0.0010) [2023-12-26 13:52:40,695][123091] Updated weights for policy 0, policy_version 1788688 (0.0010) [2023-12-26 13:52:41,108][123090] Updated weights for policy 1, policy_version 1776738 (0.0006) [2023-12-26 13:52:41,184][123090] Updated weights for policy 1, policy_version 1776748 (0.0010) [2023-12-26 13:52:41,254][123090] Updated weights for policy 1, policy_version 1776758 (0.0009) [2023-12-26 13:52:41,325][123090] Updated weights for policy 1, policy_version 1776768 (0.0009) [2023-12-26 13:52:41,529][123091] Updated weights for policy 0, policy_version 1788698 (0.0010) [2023-12-26 13:52:41,593][123091] Updated weights for policy 0, policy_version 1788708 (0.0009) [2023-12-26 13:52:41,668][123091] Updated weights for policy 0, policy_version 1788718 (0.0008) [2023-12-26 13:52:42,171][123090] Updated weights for policy 1, policy_version 1776778 (0.0009) [2023-12-26 13:52:42,220][123090] Updated weights for policy 1, policy_version 1776788 (0.0009) [2023-12-26 13:52:42,271][123090] Updated weights for policy 1, policy_version 1776798 (0.0008) [2023-12-26 13:52:42,517][123091] Updated weights for policy 0, policy_version 1788728 (0.0009) [2023-12-26 13:52:42,576][123091] Updated weights for policy 0, policy_version 1788738 (0.0009) [2023-12-26 13:52:42,634][123091] Updated weights for policy 0, policy_version 1788748 (0.0010) [2023-12-26 13:52:43,134][123090] Updated weights for policy 1, policy_version 1776808 (0.0009) [2023-12-26 13:52:43,200][123090] Updated weights for policy 1, policy_version 1776818 (0.0009) [2023-12-26 13:52:43,265][123090] Updated weights for policy 1, policy_version 1776828 (0.0009) [2023-12-26 13:52:43,484][123091] Updated weights for policy 0, policy_version 1788758 (0.0009) [2023-12-26 13:52:43,542][123091] Updated weights for policy 0, policy_version 1788768 (0.0009) [2023-12-26 13:52:43,595][123091] Updated weights for policy 0, policy_version 1788778 (0.0010) [2023-12-26 13:52:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 912801792. Throughput: 0: 8758.3, 1: 8971.8. Samples: 912794568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:43,784][121949] Avg episode reward: [(0, '6264.960'), (1, '6024.467')] [2023-12-26 13:52:43,950][123090] Updated weights for policy 1, policy_version 1776838 (0.0010) [2023-12-26 13:52:44,012][123090] Updated weights for policy 1, policy_version 1776848 (0.0010) [2023-12-26 13:52:44,078][123090] Updated weights for policy 1, policy_version 1776858 (0.0010) [2023-12-26 13:52:44,396][123091] Updated weights for policy 0, policy_version 1788788 (0.0008) [2023-12-26 13:52:44,470][123091] Updated weights for policy 0, policy_version 1788798 (0.0005) [2023-12-26 13:52:44,543][123091] Updated weights for policy 0, policy_version 1788808 (0.0005) [2023-12-26 13:52:44,965][123090] Updated weights for policy 1, policy_version 1776868 (0.0010) [2023-12-26 13:52:45,031][123090] Updated weights for policy 1, policy_version 1776878 (0.0009) [2023-12-26 13:52:45,096][123090] Updated weights for policy 1, policy_version 1776888 (0.0010) [2023-12-26 13:52:45,277][123091] Updated weights for policy 0, policy_version 1788818 (0.0008) [2023-12-26 13:52:45,343][123091] Updated weights for policy 0, policy_version 1788828 (0.0009) [2023-12-26 13:52:45,407][123091] Updated weights for policy 0, policy_version 1788838 (0.0010) [2023-12-26 13:52:45,478][123091] Updated weights for policy 0, policy_version 1788848 (0.0009) [2023-12-26 13:52:45,845][123090] Updated weights for policy 1, policy_version 1776898 (0.0009) [2023-12-26 13:52:45,898][123090] Updated weights for policy 1, policy_version 1776908 (0.0009) [2023-12-26 13:52:45,954][123090] Updated weights for policy 1, policy_version 1776918 (0.0006) [2023-12-26 13:52:46,011][123090] Updated weights for policy 1, policy_version 1776928 (0.0009) [2023-12-26 13:52:46,291][123091] Updated weights for policy 0, policy_version 1788858 (0.0009) [2023-12-26 13:52:46,346][123091] Updated weights for policy 0, policy_version 1788868 (0.0010) [2023-12-26 13:52:46,394][123091] Updated weights for policy 0, policy_version 1788878 (0.0008) [2023-12-26 13:52:46,800][123090] Updated weights for policy 1, policy_version 1776938 (0.0009) [2023-12-26 13:52:46,853][123090] Updated weights for policy 1, policy_version 1776948 (0.0005) [2023-12-26 13:52:46,902][123090] Updated weights for policy 1, policy_version 1776958 (0.0005) [2023-12-26 13:52:47,264][123091] Updated weights for policy 0, policy_version 1788888 (0.0010) [2023-12-26 13:52:47,320][123091] Updated weights for policy 0, policy_version 1788898 (0.0009) [2023-12-26 13:52:47,376][123091] Updated weights for policy 0, policy_version 1788908 (0.0009) [2023-12-26 13:52:47,645][123090] Updated weights for policy 1, policy_version 1776968 (0.0005) [2023-12-26 13:52:47,706][123090] Updated weights for policy 1, policy_version 1776978 (0.0005) [2023-12-26 13:52:47,770][123090] Updated weights for policy 1, policy_version 1776988 (0.0005) [2023-12-26 13:52:48,250][123091] Updated weights for policy 0, policy_version 1788918 (0.0010) [2023-12-26 13:52:48,309][123091] Updated weights for policy 0, policy_version 1788928 (0.0009) [2023-12-26 13:52:48,373][123091] Updated weights for policy 0, policy_version 1788938 (0.0009) [2023-12-26 13:52:48,452][123090] Updated weights for policy 1, policy_version 1776998 (0.0007) [2023-12-26 13:52:48,506][123090] Updated weights for policy 1, policy_version 1777008 (0.0009) [2023-12-26 13:52:48,565][123090] Updated weights for policy 1, policy_version 1777018 (0.0010) [2023-12-26 13:52:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 912891904. Throughput: 0: 8800.2, 1: 8992.3. Samples: 912900776. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:48,785][121949] Avg episode reward: [(0, '6200.409'), (1, '6057.881')] [2023-12-26 13:52:49,222][123091] Updated weights for policy 0, policy_version 1788948 (0.0010) [2023-12-26 13:52:49,299][123091] Updated weights for policy 0, policy_version 1788958 (0.0010) [2023-12-26 13:52:49,371][123091] Updated weights for policy 0, policy_version 1788968 (0.0010) [2023-12-26 13:52:49,421][123090] Updated weights for policy 1, policy_version 1777028 (0.0008) [2023-12-26 13:52:49,484][123090] Updated weights for policy 1, policy_version 1777038 (0.0009) [2023-12-26 13:52:49,539][123090] Updated weights for policy 1, policy_version 1777048 (0.0009) [2023-12-26 13:52:50,235][123090] Updated weights for policy 1, policy_version 1777058 (0.0006) [2023-12-26 13:52:50,249][123091] Updated weights for policy 0, policy_version 1788978 (0.0009) [2023-12-26 13:52:50,302][123090] Updated weights for policy 1, policy_version 1777068 (0.0009) [2023-12-26 13:52:50,313][123091] Updated weights for policy 0, policy_version 1788988 (0.0005) [2023-12-26 13:52:50,358][123090] Updated weights for policy 1, policy_version 1777078 (0.0008) [2023-12-26 13:52:50,377][123091] Updated weights for policy 0, policy_version 1788998 (0.0008) [2023-12-26 13:52:50,427][123090] Updated weights for policy 1, policy_version 1777088 (0.0008) [2023-12-26 13:52:50,446][123091] Updated weights for policy 0, policy_version 1789008 (0.0008) [2023-12-26 13:52:51,155][123090] Updated weights for policy 1, policy_version 1777098 (0.0009) [2023-12-26 13:52:51,203][123090] Updated weights for policy 1, policy_version 1777108 (0.0009) [2023-12-26 13:52:51,263][123090] Updated weights for policy 1, policy_version 1777118 (0.0010) [2023-12-26 13:52:51,286][123091] Updated weights for policy 0, policy_version 1789018 (0.0008) [2023-12-26 13:52:51,355][123091] Updated weights for policy 0, policy_version 1789028 (0.0007) [2023-12-26 13:52:51,418][123091] Updated weights for policy 0, policy_version 1789038 (0.0007) [2023-12-26 13:52:52,039][123090] Updated weights for policy 1, policy_version 1777128 (0.0010) [2023-12-26 13:52:52,106][123090] Updated weights for policy 1, policy_version 1777138 (0.0011) [2023-12-26 13:52:52,139][123091] Updated weights for policy 0, policy_version 1789048 (0.0006) [2023-12-26 13:52:52,166][123090] Updated weights for policy 1, policy_version 1777148 (0.0011) [2023-12-26 13:52:52,196][123091] Updated weights for policy 0, policy_version 1789058 (0.0007) [2023-12-26 13:52:52,256][123091] Updated weights for policy 0, policy_version 1789068 (0.0006) [2023-12-26 13:52:52,892][123090] Updated weights for policy 1, policy_version 1777158 (0.0010) [2023-12-26 13:52:52,954][123090] Updated weights for policy 1, policy_version 1777168 (0.0010) [2023-12-26 13:52:53,011][123090] Updated weights for policy 1, policy_version 1777178 (0.0009) [2023-12-26 13:52:53,098][123091] Updated weights for policy 0, policy_version 1789078 (0.0009) [2023-12-26 13:52:53,173][123091] Updated weights for policy 0, policy_version 1789088 (0.0009) [2023-12-26 13:52:53,231][123091] Updated weights for policy 0, policy_version 1789098 (0.0010) [2023-12-26 13:52:53,738][123090] Updated weights for policy 1, policy_version 1777188 (0.0009) [2023-12-26 13:52:53,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 912973824. Throughput: 0: 8793.0, 1: 9010.5. Samples: 912953272. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:53,785][121949] Avg episode reward: [(0, '6241.639'), (1, '6018.272')] [2023-12-26 13:52:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001789104_458014720.pth... [2023-12-26 13:52:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001788112_457760768.pth [2023-12-26 13:52:53,798][123090] Updated weights for policy 1, policy_version 1777198 (0.0010) [2023-12-26 13:52:53,850][123090] Updated weights for policy 1, policy_version 1777208 (0.0009) [2023-12-26 13:52:53,900][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001777216_454967296.pth... [2023-12-26 13:52:53,903][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001776128_454688768.pth [2023-12-26 13:52:54,080][123091] Updated weights for policy 0, policy_version 1789108 (0.0009) [2023-12-26 13:52:54,142][123091] Updated weights for policy 0, policy_version 1789118 (0.0009) [2023-12-26 13:52:54,200][123091] Updated weights for policy 0, policy_version 1789128 (0.0006) [2023-12-26 13:52:54,685][123090] Updated weights for policy 1, policy_version 1777218 (0.0011) [2023-12-26 13:52:54,737][123090] Updated weights for policy 1, policy_version 1777228 (0.0010) [2023-12-26 13:52:54,807][123090] Updated weights for policy 1, policy_version 1777238 (0.0010) [2023-12-26 13:52:54,870][123090] Updated weights for policy 1, policy_version 1777248 (0.0009) [2023-12-26 13:52:54,902][123091] Updated weights for policy 0, policy_version 1789138 (0.0007) [2023-12-26 13:52:54,974][123091] Updated weights for policy 0, policy_version 1789148 (0.0011) [2023-12-26 13:52:55,038][123091] Updated weights for policy 0, policy_version 1789158 (0.0010) [2023-12-26 13:52:55,100][123091] Updated weights for policy 0, policy_version 1789168 (0.0009) [2023-12-26 13:52:55,597][123090] Updated weights for policy 1, policy_version 1777258 (0.0006) [2023-12-26 13:52:55,664][123090] Updated weights for policy 1, policy_version 1777268 (0.0007) [2023-12-26 13:52:55,717][123090] Updated weights for policy 1, policy_version 1777278 (0.0005) [2023-12-26 13:52:55,830][123091] Updated weights for policy 0, policy_version 1789178 (0.0007) [2023-12-26 13:52:55,879][123091] Updated weights for policy 0, policy_version 1789188 (0.0006) [2023-12-26 13:52:55,935][123091] Updated weights for policy 0, policy_version 1789198 (0.0006) [2023-12-26 13:52:56,478][123090] Updated weights for policy 1, policy_version 1777288 (0.0009) [2023-12-26 13:52:56,525][123090] Updated weights for policy 1, policy_version 1777298 (0.0010) [2023-12-26 13:52:56,577][123090] Updated weights for policy 1, policy_version 1777308 (0.0006) [2023-12-26 13:52:56,710][123091] Updated weights for policy 0, policy_version 1789208 (0.0010) [2023-12-26 13:52:56,765][123091] Updated weights for policy 0, policy_version 1789219 (0.0010) [2023-12-26 13:52:56,824][123091] Updated weights for policy 0, policy_version 1789230 (0.0010) [2023-12-26 13:52:57,252][123090] Updated weights for policy 1, policy_version 1777318 (0.0005) [2023-12-26 13:52:57,319][123090] Updated weights for policy 1, policy_version 1777328 (0.0007) [2023-12-26 13:52:57,381][123090] Updated weights for policy 1, policy_version 1777338 (0.0010) [2023-12-26 13:52:57,587][123091] Updated weights for policy 0, policy_version 1789240 (0.0006) [2023-12-26 13:52:57,639][123091] Updated weights for policy 0, policy_version 1789250 (0.0005) [2023-12-26 13:52:57,691][123091] Updated weights for policy 0, policy_version 1789260 (0.0005) [2023-12-26 13:52:58,177][123090] Updated weights for policy 1, policy_version 1777348 (0.0010) [2023-12-26 13:52:58,244][123090] Updated weights for policy 1, policy_version 1777358 (0.0010) [2023-12-26 13:52:58,313][123090] Updated weights for policy 1, policy_version 1777368 (0.0010) [2023-12-26 13:52:58,487][123091] Updated weights for policy 0, policy_version 1789270 (0.0007) [2023-12-26 13:52:58,555][123091] Updated weights for policy 0, policy_version 1789280 (0.0009) [2023-12-26 13:52:58,619][123091] Updated weights for policy 0, policy_version 1789290 (0.0009) [2023-12-26 13:52:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 913072128. Throughput: 0: 8874.2, 1: 9128.1. Samples: 913063744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:52:58,785][121949] Avg episode reward: [(0, '6182.748'), (1, '5973.833')] [2023-12-26 13:52:59,190][123090] Updated weights for policy 1, policy_version 1777378 (0.0011) [2023-12-26 13:52:59,285][123090] Updated weights for policy 1, policy_version 1777388 (0.0013) [2023-12-26 13:52:59,353][123090] Updated weights for policy 1, policy_version 1777398 (0.0010) [2023-12-26 13:52:59,422][123090] Updated weights for policy 1, policy_version 1777408 (0.0013) [2023-12-26 13:52:59,481][123091] Updated weights for policy 0, policy_version 1789300 (0.0007) [2023-12-26 13:52:59,541][123091] Updated weights for policy 0, policy_version 1789310 (0.0006) [2023-12-26 13:52:59,606][123091] Updated weights for policy 0, policy_version 1789320 (0.0006) [2023-12-26 13:53:00,168][123090] Updated weights for policy 1, policy_version 1777418 (0.0008) [2023-12-26 13:53:00,221][123090] Updated weights for policy 1, policy_version 1777428 (0.0010) [2023-12-26 13:53:00,281][123090] Updated weights for policy 1, policy_version 1777438 (0.0007) [2023-12-26 13:53:00,354][123091] Updated weights for policy 0, policy_version 1789330 (0.0006) [2023-12-26 13:53:00,404][123091] Updated weights for policy 0, policy_version 1789340 (0.0006) [2023-12-26 13:53:00,470][123091] Updated weights for policy 0, policy_version 1789350 (0.0005) [2023-12-26 13:53:00,538][123091] Updated weights for policy 0, policy_version 1789360 (0.0006) [2023-12-26 13:53:01,027][123090] Updated weights for policy 1, policy_version 1777448 (0.0005) [2023-12-26 13:53:01,096][123090] Updated weights for policy 1, policy_version 1777458 (0.0007) [2023-12-26 13:53:01,164][123090] Updated weights for policy 1, policy_version 1777468 (0.0009) [2023-12-26 13:53:01,336][123091] Updated weights for policy 0, policy_version 1789370 (0.0010) [2023-12-26 13:53:01,412][123091] Updated weights for policy 0, policy_version 1789380 (0.0009) [2023-12-26 13:53:01,468][123091] Updated weights for policy 0, policy_version 1789390 (0.0010) [2023-12-26 13:53:01,836][123090] Updated weights for policy 1, policy_version 1777478 (0.0008) [2023-12-26 13:53:01,897][123090] Updated weights for policy 1, policy_version 1777488 (0.0008) [2023-12-26 13:53:01,958][123090] Updated weights for policy 1, policy_version 1777498 (0.0007) [2023-12-26 13:53:02,374][123091] Updated weights for policy 0, policy_version 1789400 (0.0009) [2023-12-26 13:53:02,433][123091] Updated weights for policy 0, policy_version 1789410 (0.0009) [2023-12-26 13:53:02,495][123091] Updated weights for policy 0, policy_version 1789420 (0.0010) [2023-12-26 13:53:02,649][123090] Updated weights for policy 1, policy_version 1777508 (0.0006) [2023-12-26 13:53:02,711][123090] Updated weights for policy 1, policy_version 1777518 (0.0009) [2023-12-26 13:53:02,773][123090] Updated weights for policy 1, policy_version 1777528 (0.0010) [2023-12-26 13:53:03,422][123091] Updated weights for policy 0, policy_version 1789431 (0.0010) [2023-12-26 13:53:03,454][123090] Updated weights for policy 1, policy_version 1777538 (0.0008) [2023-12-26 13:53:03,471][123091] Updated weights for policy 0, policy_version 1789441 (0.0009) [2023-12-26 13:53:03,517][123090] Updated weights for policy 1, policy_version 1777548 (0.0008) [2023-12-26 13:53:03,520][123091] Updated weights for policy 0, policy_version 1789451 (0.0008) [2023-12-26 13:53:03,570][123090] Updated weights for policy 1, policy_version 1777558 (0.0010) [2023-12-26 13:53:03,627][123090] Updated weights for policy 1, policy_version 1777568 (0.0008) [2023-12-26 13:53:03,784][121949] Fps is (10 sec: 18842.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 913162240. Throughput: 0: 8746.5, 1: 9136.5. Samples: 913169504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:03,785][121949] Avg episode reward: [(0, '6269.681'), (1, '5979.697')] [2023-12-26 13:53:04,402][123090] Updated weights for policy 1, policy_version 1777578 (0.0010) [2023-12-26 13:53:04,418][123091] Updated weights for policy 0, policy_version 1789461 (0.0006) [2023-12-26 13:53:04,465][123090] Updated weights for policy 1, policy_version 1777588 (0.0010) [2023-12-26 13:53:04,476][123091] Updated weights for policy 0, policy_version 1789471 (0.0008) [2023-12-26 13:53:04,536][123090] Updated weights for policy 1, policy_version 1777598 (0.0010) [2023-12-26 13:53:04,538][123091] Updated weights for policy 0, policy_version 1789481 (0.0006) [2023-12-26 13:53:05,180][123091] Updated weights for policy 0, policy_version 1789491 (0.0005) [2023-12-26 13:53:05,236][123091] Updated weights for policy 0, policy_version 1789501 (0.0005) [2023-12-26 13:53:05,289][123090] Updated weights for policy 1, policy_version 1777608 (0.0009) [2023-12-26 13:53:05,294][123091] Updated weights for policy 0, policy_version 1789511 (0.0006) [2023-12-26 13:53:05,348][123090] Updated weights for policy 1, policy_version 1777618 (0.0009) [2023-12-26 13:53:05,419][123090] Updated weights for policy 1, policy_version 1777628 (0.0010) [2023-12-26 13:53:05,892][123091] Updated weights for policy 0, policy_version 1789521 (0.0005) [2023-12-26 13:53:05,942][123091] Updated weights for policy 0, policy_version 1789531 (0.0005) [2023-12-26 13:53:05,992][123091] Updated weights for policy 0, policy_version 1789541 (0.0005) [2023-12-26 13:53:06,061][123091] Updated weights for policy 0, policy_version 1789551 (0.0005) [2023-12-26 13:53:06,333][123090] Updated weights for policy 1, policy_version 1777638 (0.0009) [2023-12-26 13:53:06,395][123090] Updated weights for policy 1, policy_version 1777648 (0.0008) [2023-12-26 13:53:06,467][123090] Updated weights for policy 1, policy_version 1777658 (0.0007) [2023-12-26 13:53:06,717][123091] Updated weights for policy 0, policy_version 1789561 (0.0007) [2023-12-26 13:53:06,772][123091] Updated weights for policy 0, policy_version 1789571 (0.0010) [2023-12-26 13:53:06,837][123091] Updated weights for policy 0, policy_version 1789581 (0.0010) [2023-12-26 13:53:07,253][123090] Updated weights for policy 1, policy_version 1777668 (0.0008) [2023-12-26 13:53:07,318][123090] Updated weights for policy 1, policy_version 1777678 (0.0008) [2023-12-26 13:53:07,371][123090] Updated weights for policy 1, policy_version 1777688 (0.0009) [2023-12-26 13:53:07,684][123091] Updated weights for policy 0, policy_version 1789591 (0.0009) [2023-12-26 13:53:07,742][123091] Updated weights for policy 0, policy_version 1789601 (0.0010) [2023-12-26 13:53:07,792][123091] Updated weights for policy 0, policy_version 1789611 (0.0007) [2023-12-26 13:53:08,225][123090] Updated weights for policy 1, policy_version 1777698 (0.0009) [2023-12-26 13:53:08,285][123090] Updated weights for policy 1, policy_version 1777708 (0.0009) [2023-12-26 13:53:08,343][123090] Updated weights for policy 1, policy_version 1777718 (0.0009) [2023-12-26 13:53:08,410][123090] Updated weights for policy 1, policy_version 1777728 (0.0010) [2023-12-26 13:53:08,480][123091] Updated weights for policy 0, policy_version 1789621 (0.0005) [2023-12-26 13:53:08,552][123091] Updated weights for policy 0, policy_version 1789631 (0.0006) [2023-12-26 13:53:08,615][123091] Updated weights for policy 0, policy_version 1789641 (0.0006) [2023-12-26 13:53:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 913252352. Throughput: 0: 8833.0, 1: 9146.4. Samples: 913226264. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:08,785][121949] Avg episode reward: [(0, '6327.436'), (1, '5992.684')] [2023-12-26 13:53:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001789648_458153984.pth... [2023-12-26 13:53:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001777728_455098368.pth... [2023-12-26 13:53:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001788624_457891840.pth [2023-12-26 13:53:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001776672_454828032.pth [2023-12-26 13:53:09,151][123090] Updated weights for policy 1, policy_version 1777738 (0.0010) [2023-12-26 13:53:09,207][123090] Updated weights for policy 1, policy_version 1777748 (0.0010) [2023-12-26 13:53:09,294][123090] Updated weights for policy 1, policy_version 1777758 (0.0010) [2023-12-26 13:53:09,442][123091] Updated weights for policy 0, policy_version 1789651 (0.0009) [2023-12-26 13:53:09,497][123091] Updated weights for policy 0, policy_version 1789661 (0.0009) [2023-12-26 13:53:09,549][123091] Updated weights for policy 0, policy_version 1789671 (0.0008) [2023-12-26 13:53:10,066][123090] Updated weights for policy 1, policy_version 1777768 (0.0008) [2023-12-26 13:53:10,135][123090] Updated weights for policy 1, policy_version 1777778 (0.0009) [2023-12-26 13:53:10,207][123090] Updated weights for policy 1, policy_version 1777788 (0.0011) [2023-12-26 13:53:10,395][123091] Updated weights for policy 0, policy_version 1789681 (0.0008) [2023-12-26 13:53:10,463][123091] Updated weights for policy 0, policy_version 1789691 (0.0011) [2023-12-26 13:53:10,527][123091] Updated weights for policy 0, policy_version 1789701 (0.0011) [2023-12-26 13:53:10,590][123091] Updated weights for policy 0, policy_version 1789711 (0.0011) [2023-12-26 13:53:10,966][123090] Updated weights for policy 1, policy_version 1777798 (0.0007) [2023-12-26 13:53:11,036][123090] Updated weights for policy 1, policy_version 1777808 (0.0006) [2023-12-26 13:53:11,097][123090] Updated weights for policy 1, policy_version 1777818 (0.0008) [2023-12-26 13:53:11,403][123091] Updated weights for policy 0, policy_version 1789721 (0.0010) [2023-12-26 13:53:11,468][123091] Updated weights for policy 0, policy_version 1789731 (0.0011) [2023-12-26 13:53:11,528][123091] Updated weights for policy 0, policy_version 1789741 (0.0011) [2023-12-26 13:53:11,877][123090] Updated weights for policy 1, policy_version 1777828 (0.0010) [2023-12-26 13:53:11,937][123090] Updated weights for policy 1, policy_version 1777838 (0.0009) [2023-12-26 13:53:11,992][123090] Updated weights for policy 1, policy_version 1777848 (0.0008) [2023-12-26 13:53:12,375][123091] Updated weights for policy 0, policy_version 1789751 (0.0010) [2023-12-26 13:53:12,446][123091] Updated weights for policy 0, policy_version 1789761 (0.0010) [2023-12-26 13:53:12,515][123091] Updated weights for policy 0, policy_version 1789771 (0.0010) [2023-12-26 13:53:12,846][123090] Updated weights for policy 1, policy_version 1777858 (0.0010) [2023-12-26 13:53:12,903][123090] Updated weights for policy 1, policy_version 1777868 (0.0009) [2023-12-26 13:53:12,971][123090] Updated weights for policy 1, policy_version 1777878 (0.0010) [2023-12-26 13:53:13,035][123090] Updated weights for policy 1, policy_version 1777888 (0.0010) [2023-12-26 13:53:13,358][123091] Updated weights for policy 0, policy_version 1789781 (0.0010) [2023-12-26 13:53:13,424][123091] Updated weights for policy 0, policy_version 1789791 (0.0010) [2023-12-26 13:53:13,490][123091] Updated weights for policy 0, policy_version 1789801 (0.0010) [2023-12-26 13:53:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 913334272. Throughput: 0: 8738.6, 1: 9122.1. Samples: 913330128. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:13,785][121949] Avg episode reward: [(0, '6328.955'), (1, '5783.999')] [2023-12-26 13:53:13,808][123090] Updated weights for policy 1, policy_version 1777898 (0.0005) [2023-12-26 13:53:13,878][123090] Updated weights for policy 1, policy_version 1777908 (0.0006) [2023-12-26 13:53:13,945][123090] Updated weights for policy 1, policy_version 1777918 (0.0009) [2023-12-26 13:53:14,164][123091] Updated weights for policy 0, policy_version 1789812 (0.0007) [2023-12-26 13:53:14,216][123091] Updated weights for policy 0, policy_version 1789822 (0.0005) [2023-12-26 13:53:14,264][123091] Updated weights for policy 0, policy_version 1789832 (0.0005) [2023-12-26 13:53:14,772][123090] Updated weights for policy 1, policy_version 1777928 (0.0008) [2023-12-26 13:53:14,834][123090] Updated weights for policy 1, policy_version 1777938 (0.0008) [2023-12-26 13:53:14,890][123090] Updated weights for policy 1, policy_version 1777948 (0.0010) [2023-12-26 13:53:14,955][123091] Updated weights for policy 0, policy_version 1789842 (0.0006) [2023-12-26 13:53:15,025][123091] Updated weights for policy 0, policy_version 1789852 (0.0008) [2023-12-26 13:53:15,097][123091] Updated weights for policy 0, policy_version 1789862 (0.0008) [2023-12-26 13:53:15,164][123091] Updated weights for policy 0, policy_version 1789872 (0.0008) [2023-12-26 13:53:15,780][123090] Updated weights for policy 1, policy_version 1777958 (0.0010) [2023-12-26 13:53:15,851][123090] Updated weights for policy 1, policy_version 1777968 (0.0010) [2023-12-26 13:53:15,914][123090] Updated weights for policy 1, policy_version 1777978 (0.0009) [2023-12-26 13:53:15,921][123091] Updated weights for policy 0, policy_version 1789882 (0.0006) [2023-12-26 13:53:15,983][123091] Updated weights for policy 0, policy_version 1789892 (0.0009) [2023-12-26 13:53:16,049][123091] Updated weights for policy 0, policy_version 1789902 (0.0009) [2023-12-26 13:53:16,729][123090] Updated weights for policy 1, policy_version 1777988 (0.0007) [2023-12-26 13:53:16,788][123090] Updated weights for policy 1, policy_version 1777998 (0.0005) [2023-12-26 13:53:16,840][123090] Updated weights for policy 1, policy_version 1778008 (0.0005) [2023-12-26 13:53:16,877][123091] Updated weights for policy 0, policy_version 1789912 (0.0006) [2023-12-26 13:53:16,950][123091] Updated weights for policy 0, policy_version 1789922 (0.0005) [2023-12-26 13:53:17,021][123091] Updated weights for policy 0, policy_version 1789932 (0.0005) [2023-12-26 13:53:17,527][123090] Updated weights for policy 1, policy_version 1778018 (0.0005) [2023-12-26 13:53:17,579][123090] Updated weights for policy 1, policy_version 1778028 (0.0006) [2023-12-26 13:53:17,635][123090] Updated weights for policy 1, policy_version 1778038 (0.0005) [2023-12-26 13:53:17,695][123090] Updated weights for policy 1, policy_version 1778048 (0.0007) [2023-12-26 13:53:17,713][123091] Updated weights for policy 0, policy_version 1789942 (0.0007) [2023-12-26 13:53:17,765][123091] Updated weights for policy 0, policy_version 1789952 (0.0009) [2023-12-26 13:53:17,815][123091] Updated weights for policy 0, policy_version 1789962 (0.0009) [2023-12-26 13:53:18,527][123090] Updated weights for policy 1, policy_version 1778058 (0.0009) [2023-12-26 13:53:18,587][123090] Updated weights for policy 1, policy_version 1778068 (0.0009) [2023-12-26 13:53:18,637][123091] Updated weights for policy 0, policy_version 1789972 (0.0009) [2023-12-26 13:53:18,654][123090] Updated weights for policy 1, policy_version 1778078 (0.0008) [2023-12-26 13:53:18,688][123091] Updated weights for policy 0, policy_version 1789982 (0.0009) [2023-12-26 13:53:18,736][123091] Updated weights for policy 0, policy_version 1789992 (0.0009) [2023-12-26 13:53:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 913424384. Throughput: 0: 8782.9, 1: 9015.8. Samples: 913438720. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:18,785][121949] Avg episode reward: [(0, '6215.248'), (1, '5863.013')] [2023-12-26 13:53:19,512][123090] Updated weights for policy 1, policy_version 1778088 (0.0008) [2023-12-26 13:53:19,583][123090] Updated weights for policy 1, policy_version 1778098 (0.0008) [2023-12-26 13:53:19,583][123091] Updated weights for policy 0, policy_version 1790002 (0.0010) [2023-12-26 13:53:19,646][123090] Updated weights for policy 1, policy_version 1778108 (0.0008) [2023-12-26 13:53:19,649][123091] Updated weights for policy 0, policy_version 1790012 (0.0006) [2023-12-26 13:53:19,711][123091] Updated weights for policy 0, policy_version 1790022 (0.0007) [2023-12-26 13:53:19,769][123091] Updated weights for policy 0, policy_version 1790032 (0.0010) [2023-12-26 13:53:20,362][123090] Updated weights for policy 1, policy_version 1778118 (0.0009) [2023-12-26 13:53:20,423][123090] Updated weights for policy 1, policy_version 1778128 (0.0011) [2023-12-26 13:53:20,479][123090] Updated weights for policy 1, policy_version 1778138 (0.0011) [2023-12-26 13:53:20,692][123091] Updated weights for policy 0, policy_version 1790042 (0.0006) [2023-12-26 13:53:20,754][123091] Updated weights for policy 0, policy_version 1790052 (0.0006) [2023-12-26 13:53:20,825][123091] Updated weights for policy 0, policy_version 1790062 (0.0008) [2023-12-26 13:53:21,283][123090] Updated weights for policy 1, policy_version 1778148 (0.0011) [2023-12-26 13:53:21,355][123090] Updated weights for policy 1, policy_version 1778158 (0.0011) [2023-12-26 13:53:21,422][123090] Updated weights for policy 1, policy_version 1778168 (0.0011) [2023-12-26 13:53:21,665][123091] Updated weights for policy 0, policy_version 1790072 (0.0009) [2023-12-26 13:53:21,726][123091] Updated weights for policy 0, policy_version 1790082 (0.0009) [2023-12-26 13:53:21,800][123091] Updated weights for policy 0, policy_version 1790092 (0.0008) [2023-12-26 13:53:22,120][123090] Updated weights for policy 1, policy_version 1778178 (0.0010) [2023-12-26 13:53:22,184][123090] Updated weights for policy 1, policy_version 1778188 (0.0005) [2023-12-26 13:53:22,257][123090] Updated weights for policy 1, policy_version 1778198 (0.0006) [2023-12-26 13:53:22,311][123090] Updated weights for policy 1, policy_version 1778208 (0.0009) [2023-12-26 13:53:22,651][123091] Updated weights for policy 0, policy_version 1790102 (0.0007) [2023-12-26 13:53:22,713][123091] Updated weights for policy 0, policy_version 1790112 (0.0005) [2023-12-26 13:53:22,763][123091] Updated weights for policy 0, policy_version 1790122 (0.0005) [2023-12-26 13:53:23,075][123090] Updated weights for policy 1, policy_version 1778218 (0.0011) [2023-12-26 13:53:23,147][123090] Updated weights for policy 1, policy_version 1778228 (0.0007) [2023-12-26 13:53:23,224][123090] Updated weights for policy 1, policy_version 1778238 (0.0006) [2023-12-26 13:53:23,414][123091] Updated weights for policy 0, policy_version 1790132 (0.0007) [2023-12-26 13:53:23,473][123091] Updated weights for policy 0, policy_version 1790142 (0.0008) [2023-12-26 13:53:23,532][123091] Updated weights for policy 0, policy_version 1790152 (0.0009) [2023-12-26 13:53:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 913514496. Throughput: 0: 8769.8, 1: 8977.8. Samples: 913489896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:23,785][121949] Avg episode reward: [(0, '6088.880'), (1, '6104.800')] [2023-12-26 13:53:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001778240_455229440.pth... [2023-12-26 13:53:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001790160_458285056.pth... [2023-12-26 13:53:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001777216_454967296.pth [2023-12-26 13:53:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001789104_458014720.pth [2023-12-26 13:53:23,916][123090] Updated weights for policy 1, policy_version 1778248 (0.0006) [2023-12-26 13:53:23,985][123090] Updated weights for policy 1, policy_version 1778258 (0.0005) [2023-12-26 13:53:24,051][123090] Updated weights for policy 1, policy_version 1778268 (0.0005) [2023-12-26 13:53:24,329][123091] Updated weights for policy 0, policy_version 1790162 (0.0009) [2023-12-26 13:53:24,389][123091] Updated weights for policy 0, policy_version 1790172 (0.0011) [2023-12-26 13:53:24,458][123091] Updated weights for policy 0, policy_version 1790182 (0.0009) [2023-12-26 13:53:24,525][123091] Updated weights for policy 0, policy_version 1790192 (0.0005) [2023-12-26 13:53:24,878][123090] Updated weights for policy 1, policy_version 1778278 (0.0008) [2023-12-26 13:53:24,937][123090] Updated weights for policy 1, policy_version 1778288 (0.0009) [2023-12-26 13:53:24,985][123090] Updated weights for policy 1, policy_version 1778298 (0.0009) [2023-12-26 13:53:25,194][123091] Updated weights for policy 0, policy_version 1790202 (0.0010) [2023-12-26 13:53:25,258][123091] Updated weights for policy 0, policy_version 1790212 (0.0010) [2023-12-26 13:53:25,302][123091] Updated weights for policy 0, policy_version 1790222 (0.0010) [2023-12-26 13:53:25,711][123090] Updated weights for policy 1, policy_version 1778308 (0.0007) [2023-12-26 13:53:25,765][123090] Updated weights for policy 1, policy_version 1778318 (0.0005) [2023-12-26 13:53:25,814][123090] Updated weights for policy 1, policy_version 1778328 (0.0005) [2023-12-26 13:53:25,969][123091] Updated weights for policy 0, policy_version 1790232 (0.0007) [2023-12-26 13:53:26,017][123091] Updated weights for policy 0, policy_version 1790242 (0.0010) [2023-12-26 13:53:26,072][123091] Updated weights for policy 0, policy_version 1790252 (0.0010) [2023-12-26 13:53:26,470][123090] Updated weights for policy 1, policy_version 1778338 (0.0006) [2023-12-26 13:53:26,521][123090] Updated weights for policy 1, policy_version 1778348 (0.0009) [2023-12-26 13:53:26,573][123090] Updated weights for policy 1, policy_version 1778358 (0.0008) [2023-12-26 13:53:26,625][123090] Updated weights for policy 1, policy_version 1778368 (0.0009) [2023-12-26 13:53:26,888][123091] Updated weights for policy 0, policy_version 1790262 (0.0010) [2023-12-26 13:53:26,946][123091] Updated weights for policy 0, policy_version 1790272 (0.0009) [2023-12-26 13:53:27,000][123091] Updated weights for policy 0, policy_version 1790282 (0.0010) [2023-12-26 13:53:27,476][123090] Updated weights for policy 1, policy_version 1778378 (0.0010) [2023-12-26 13:53:27,530][123090] Updated weights for policy 1, policy_version 1778388 (0.0010) [2023-12-26 13:53:27,584][123090] Updated weights for policy 1, policy_version 1778398 (0.0010) [2023-12-26 13:53:27,693][123091] Updated weights for policy 0, policy_version 1790292 (0.0008) [2023-12-26 13:53:27,751][123091] Updated weights for policy 0, policy_version 1790302 (0.0006) [2023-12-26 13:53:27,808][123091] Updated weights for policy 0, policy_version 1790312 (0.0005) [2023-12-26 13:53:28,412][123090] Updated weights for policy 1, policy_version 1778408 (0.0011) [2023-12-26 13:53:28,466][123090] Updated weights for policy 1, policy_version 1778418 (0.0010) [2023-12-26 13:53:28,494][123091] Updated weights for policy 0, policy_version 1790322 (0.0005) [2023-12-26 13:53:28,517][123090] Updated weights for policy 1, policy_version 1778428 (0.0010) [2023-12-26 13:53:28,559][123091] Updated weights for policy 0, policy_version 1790332 (0.0008) [2023-12-26 13:53:28,622][123091] Updated weights for policy 0, policy_version 1790342 (0.0008) [2023-12-26 13:53:28,691][123091] Updated weights for policy 0, policy_version 1790352 (0.0005) [2023-12-26 13:53:28,784][121949] Fps is (10 sec: 18841.3, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 913612800. Throughput: 0: 8862.8, 1: 9044.5. Samples: 913600400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:28,785][121949] Avg episode reward: [(0, '6078.875'), (1, '6125.710')] [2023-12-26 13:53:29,247][123090] Updated weights for policy 1, policy_version 1778438 (0.0009) [2023-12-26 13:53:29,315][123090] Updated weights for policy 1, policy_version 1778448 (0.0007) [2023-12-26 13:53:29,379][123090] Updated weights for policy 1, policy_version 1778458 (0.0009) [2023-12-26 13:53:29,454][123091] Updated weights for policy 0, policy_version 1790362 (0.0009) [2023-12-26 13:53:29,506][123091] Updated weights for policy 0, policy_version 1790372 (0.0009) [2023-12-26 13:53:29,564][123091] Updated weights for policy 0, policy_version 1790382 (0.0007) [2023-12-26 13:53:30,149][123090] Updated weights for policy 1, policy_version 1778468 (0.0007) [2023-12-26 13:53:30,217][123090] Updated weights for policy 1, policy_version 1778478 (0.0005) [2023-12-26 13:53:30,279][123090] Updated weights for policy 1, policy_version 1778488 (0.0005) [2023-12-26 13:53:30,367][123091] Updated weights for policy 0, policy_version 1790392 (0.0006) [2023-12-26 13:53:30,441][123091] Updated weights for policy 0, policy_version 1790402 (0.0005) [2023-12-26 13:53:30,516][123091] Updated weights for policy 0, policy_version 1790412 (0.0009) [2023-12-26 13:53:30,871][123090] Updated weights for policy 1, policy_version 1778498 (0.0005) [2023-12-26 13:53:30,931][123090] Updated weights for policy 1, policy_version 1778508 (0.0007) [2023-12-26 13:53:30,983][123090] Updated weights for policy 1, policy_version 1778519 (0.0008) [2023-12-26 13:53:31,174][123091] Updated weights for policy 0, policy_version 1790422 (0.0010) [2023-12-26 13:53:31,239][123091] Updated weights for policy 0, policy_version 1790432 (0.0006) [2023-12-26 13:53:31,304][123091] Updated weights for policy 0, policy_version 1790442 (0.0006) [2023-12-26 13:53:31,826][123090] Updated weights for policy 1, policy_version 1778530 (0.0010) [2023-12-26 13:53:31,885][123090] Updated weights for policy 1, policy_version 1778540 (0.0010) [2023-12-26 13:53:31,951][123090] Updated weights for policy 1, policy_version 1778550 (0.0008) [2023-12-26 13:53:32,014][123091] Updated weights for policy 0, policy_version 1790452 (0.0009) [2023-12-26 13:53:32,025][123090] Updated weights for policy 1, policy_version 1778560 (0.0005) [2023-12-26 13:53:32,070][123091] Updated weights for policy 0, policy_version 1790462 (0.0006) [2023-12-26 13:53:32,123][123091] Updated weights for policy 0, policy_version 1790472 (0.0005) [2023-12-26 13:53:32,840][123090] Updated weights for policy 1, policy_version 1778570 (0.0006) [2023-12-26 13:53:32,914][123090] Updated weights for policy 1, policy_version 1778580 (0.0005) [2023-12-26 13:53:32,930][123091] Updated weights for policy 0, policy_version 1790482 (0.0005) [2023-12-26 13:53:32,975][123090] Updated weights for policy 1, policy_version 1778590 (0.0005) [2023-12-26 13:53:32,990][123091] Updated weights for policy 0, policy_version 1790492 (0.0005) [2023-12-26 13:53:33,043][123091] Updated weights for policy 0, policy_version 1790502 (0.0005) [2023-12-26 13:53:33,114][123091] Updated weights for policy 0, policy_version 1790512 (0.0011) [2023-12-26 13:53:33,669][123090] Updated weights for policy 1, policy_version 1778600 (0.0008) [2023-12-26 13:53:33,711][123091] Updated weights for policy 0, policy_version 1790522 (0.0010) [2023-12-26 13:53:33,720][123090] Updated weights for policy 1, policy_version 1778610 (0.0010) [2023-12-26 13:53:33,770][123091] Updated weights for policy 0, policy_version 1790532 (0.0010) [2023-12-26 13:53:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 913694720. Throughput: 0: 9018.0, 1: 9057.5. Samples: 913714172. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:33,784][121949] Avg episode reward: [(0, '6235.971'), (1, '6046.562')] [2023-12-26 13:53:33,785][123090] Updated weights for policy 1, policy_version 1778620 (0.0010) [2023-12-26 13:53:33,825][123091] Updated weights for policy 0, policy_version 1790542 (0.0010) [2023-12-26 13:53:34,625][123090] Updated weights for policy 1, policy_version 1778630 (0.0011) [2023-12-26 13:53:34,664][123091] Updated weights for policy 0, policy_version 1790552 (0.0011) [2023-12-26 13:53:34,681][123090] Updated weights for policy 1, policy_version 1778640 (0.0010) [2023-12-26 13:53:34,728][123091] Updated weights for policy 0, policy_version 1790562 (0.0011) [2023-12-26 13:53:34,737][123090] Updated weights for policy 1, policy_version 1778650 (0.0010) [2023-12-26 13:53:34,787][123091] Updated weights for policy 0, policy_version 1790572 (0.0011) [2023-12-26 13:53:35,550][123090] Updated weights for policy 1, policy_version 1778660 (0.0008) [2023-12-26 13:53:35,600][123090] Updated weights for policy 1, policy_version 1778670 (0.0005) [2023-12-26 13:53:35,607][123091] Updated weights for policy 0, policy_version 1790582 (0.0011) [2023-12-26 13:53:35,650][123090] Updated weights for policy 1, policy_version 1778680 (0.0005) [2023-12-26 13:53:35,669][123091] Updated weights for policy 0, policy_version 1790592 (0.0010) [2023-12-26 13:53:35,727][123091] Updated weights for policy 0, policy_version 1790602 (0.0010) [2023-12-26 13:53:36,333][123090] Updated weights for policy 1, policy_version 1778690 (0.0007) [2023-12-26 13:53:36,400][123090] Updated weights for policy 1, policy_version 1778700 (0.0005) [2023-12-26 13:53:36,453][123090] Updated weights for policy 1, policy_version 1778710 (0.0009) [2023-12-26 13:53:36,514][123090] Updated weights for policy 1, policy_version 1778720 (0.0008) [2023-12-26 13:53:36,599][123091] Updated weights for policy 0, policy_version 1790612 (0.0011) [2023-12-26 13:53:36,663][123091] Updated weights for policy 0, policy_version 1790622 (0.0011) [2023-12-26 13:53:36,726][123091] Updated weights for policy 0, policy_version 1790632 (0.0011) [2023-12-26 13:53:37,360][123090] Updated weights for policy 1, policy_version 1778730 (0.0009) [2023-12-26 13:53:37,421][123090] Updated weights for policy 1, policy_version 1778740 (0.0009) [2023-12-26 13:53:37,456][123091] Updated weights for policy 0, policy_version 1790642 (0.0010) [2023-12-26 13:53:37,480][123090] Updated weights for policy 1, policy_version 1778750 (0.0009) [2023-12-26 13:53:37,512][123091] Updated weights for policy 0, policy_version 1790652 (0.0009) [2023-12-26 13:53:37,561][123091] Updated weights for policy 0, policy_version 1790662 (0.0009) [2023-12-26 13:53:37,619][123091] Updated weights for policy 0, policy_version 1790672 (0.0009) [2023-12-26 13:53:38,319][123090] Updated weights for policy 1, policy_version 1778760 (0.0008) [2023-12-26 13:53:38,364][123091] Updated weights for policy 0, policy_version 1790682 (0.0009) [2023-12-26 13:53:38,384][123090] Updated weights for policy 1, policy_version 1778770 (0.0007) [2023-12-26 13:53:38,418][123091] Updated weights for policy 0, policy_version 1790692 (0.0008) [2023-12-26 13:53:38,448][123090] Updated weights for policy 1, policy_version 1778780 (0.0006) [2023-12-26 13:53:38,478][123091] Updated weights for policy 0, policy_version 1790702 (0.0010) [2023-12-26 13:53:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 913793024. Throughput: 0: 9033.7, 1: 9044.9. Samples: 913766808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:38,785][121949] Avg episode reward: [(0, '6226.161'), (1, '5831.846')] [2023-12-26 13:53:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001790704_458424320.pth... [2023-12-26 13:53:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001778784_455368704.pth... [2023-12-26 13:53:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001789648_458153984.pth [2023-12-26 13:53:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001777728_455098368.pth [2023-12-26 13:53:39,130][123090] Updated weights for policy 1, policy_version 1778790 (0.0007) [2023-12-26 13:53:39,179][123090] Updated weights for policy 1, policy_version 1778800 (0.0008) [2023-12-26 13:53:39,247][123090] Updated weights for policy 1, policy_version 1778810 (0.0009) [2023-12-26 13:53:39,360][123091] Updated weights for policy 0, policy_version 1790712 (0.0009) [2023-12-26 13:53:39,432][123091] Updated weights for policy 0, policy_version 1790722 (0.0010) [2023-12-26 13:53:39,500][123091] Updated weights for policy 0, policy_version 1790732 (0.0010) [2023-12-26 13:53:40,063][123090] Updated weights for policy 1, policy_version 1778820 (0.0010) [2023-12-26 13:53:40,128][123090] Updated weights for policy 1, policy_version 1778830 (0.0010) [2023-12-26 13:53:40,190][123090] Updated weights for policy 1, policy_version 1778840 (0.0010) [2023-12-26 13:53:40,349][123091] Updated weights for policy 0, policy_version 1790742 (0.0009) [2023-12-26 13:53:40,400][123091] Updated weights for policy 0, policy_version 1790752 (0.0010) [2023-12-26 13:53:40,453][123091] Updated weights for policy 0, policy_version 1790762 (0.0010) [2023-12-26 13:53:40,958][123090] Updated weights for policy 1, policy_version 1778850 (0.0009) [2023-12-26 13:53:41,007][123090] Updated weights for policy 1, policy_version 1778860 (0.0009) [2023-12-26 13:53:41,088][123090] Updated weights for policy 1, policy_version 1778870 (0.0008) [2023-12-26 13:53:41,162][123090] Updated weights for policy 1, policy_version 1778880 (0.0007) [2023-12-26 13:53:41,371][123091] Updated weights for policy 0, policy_version 1790772 (0.0009) [2023-12-26 13:53:41,450][123091] Updated weights for policy 0, policy_version 1790782 (0.0009) [2023-12-26 13:53:41,518][123091] Updated weights for policy 0, policy_version 1790792 (0.0010) [2023-12-26 13:53:41,962][123090] Updated weights for policy 1, policy_version 1778890 (0.0008) [2023-12-26 13:53:42,025][123090] Updated weights for policy 1, policy_version 1778900 (0.0008) [2023-12-26 13:53:42,097][123090] Updated weights for policy 1, policy_version 1778910 (0.0008) [2023-12-26 13:53:42,340][123091] Updated weights for policy 0, policy_version 1790802 (0.0009) [2023-12-26 13:53:42,413][123091] Updated weights for policy 0, policy_version 1790812 (0.0011) [2023-12-26 13:53:42,488][123091] Updated weights for policy 0, policy_version 1790822 (0.0011) [2023-12-26 13:53:42,552][123091] Updated weights for policy 0, policy_version 1790832 (0.0011) [2023-12-26 13:53:42,790][123090] Updated weights for policy 1, policy_version 1778920 (0.0006) [2023-12-26 13:53:42,866][123090] Updated weights for policy 1, policy_version 1778930 (0.0005) [2023-12-26 13:53:42,940][123090] Updated weights for policy 1, policy_version 1778940 (0.0005) [2023-12-26 13:53:43,305][123091] Updated weights for policy 0, policy_version 1790842 (0.0010) [2023-12-26 13:53:43,360][123091] Updated weights for policy 0, policy_version 1790852 (0.0010) [2023-12-26 13:53:43,412][123091] Updated weights for policy 0, policy_version 1790862 (0.0010) [2023-12-26 13:53:43,714][123090] Updated weights for policy 1, policy_version 1778950 (0.0006) [2023-12-26 13:53:43,764][123090] Updated weights for policy 1, policy_version 1778960 (0.0005) [2023-12-26 13:53:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 913874944. Throughput: 0: 8966.8, 1: 8974.9. Samples: 913871116. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:43,785][121949] Avg episode reward: [(0, '6154.217'), (1, '5879.274')] [2023-12-26 13:53:43,813][123090] Updated weights for policy 1, policy_version 1778970 (0.0005) [2023-12-26 13:53:44,257][123091] Updated weights for policy 0, policy_version 1790872 (0.0010) [2023-12-26 13:53:44,334][123091] Updated weights for policy 0, policy_version 1790882 (0.0011) [2023-12-26 13:53:44,399][123091] Updated weights for policy 0, policy_version 1790892 (0.0011) [2023-12-26 13:53:44,519][123090] Updated weights for policy 1, policy_version 1778980 (0.0005) [2023-12-26 13:53:44,575][123090] Updated weights for policy 1, policy_version 1778990 (0.0005) [2023-12-26 13:53:44,635][123090] Updated weights for policy 1, policy_version 1779000 (0.0005) [2023-12-26 13:53:45,199][123091] Updated weights for policy 0, policy_version 1790902 (0.0011) [2023-12-26 13:53:45,270][123091] Updated weights for policy 0, policy_version 1790912 (0.0011) [2023-12-26 13:53:45,335][123091] Updated weights for policy 0, policy_version 1790922 (0.0011) [2023-12-26 13:53:45,365][123090] Updated weights for policy 1, policy_version 1779010 (0.0006) [2023-12-26 13:53:45,422][123090] Updated weights for policy 1, policy_version 1779020 (0.0009) [2023-12-26 13:53:45,480][123090] Updated weights for policy 1, policy_version 1779030 (0.0009) [2023-12-26 13:53:45,550][123090] Updated weights for policy 1, policy_version 1779040 (0.0009) [2023-12-26 13:53:46,192][123091] Updated weights for policy 0, policy_version 1790932 (0.0011) [2023-12-26 13:53:46,248][123091] Updated weights for policy 0, policy_version 1790942 (0.0011) [2023-12-26 13:53:46,302][123091] Updated weights for policy 0, policy_version 1790952 (0.0010) [2023-12-26 13:53:46,387][123090] Updated weights for policy 1, policy_version 1779050 (0.0007) [2023-12-26 13:53:46,439][123090] Updated weights for policy 1, policy_version 1779060 (0.0008) [2023-12-26 13:53:46,490][123090] Updated weights for policy 1, policy_version 1779070 (0.0008) [2023-12-26 13:53:47,133][123091] Updated weights for policy 0, policy_version 1790962 (0.0011) [2023-12-26 13:53:47,182][123091] Updated weights for policy 0, policy_version 1790972 (0.0009) [2023-12-26 13:53:47,242][123091] Updated weights for policy 0, policy_version 1790982 (0.0009) [2023-12-26 13:53:47,309][123091] Updated weights for policy 0, policy_version 1790992 (0.0010) [2023-12-26 13:53:47,337][123090] Updated weights for policy 1, policy_version 1779080 (0.0008) [2023-12-26 13:53:47,391][123090] Updated weights for policy 1, policy_version 1779090 (0.0009) [2023-12-26 13:53:47,444][123090] Updated weights for policy 1, policy_version 1779100 (0.0007) [2023-12-26 13:53:48,095][123091] Updated weights for policy 0, policy_version 1791002 (0.0005) [2023-12-26 13:53:48,146][123091] Updated weights for policy 0, policy_version 1791012 (0.0005) [2023-12-26 13:53:48,159][123090] Updated weights for policy 1, policy_version 1779110 (0.0006) [2023-12-26 13:53:48,202][123091] Updated weights for policy 0, policy_version 1791022 (0.0005) [2023-12-26 13:53:48,216][123090] Updated weights for policy 1, policy_version 1779120 (0.0005) [2023-12-26 13:53:48,276][123090] Updated weights for policy 1, policy_version 1779130 (0.0005) [2023-12-26 13:53:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 913965056. Throughput: 0: 9023.1, 1: 8993.5. Samples: 913980252. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:48,785][121949] Avg episode reward: [(0, '6092.300'), (1, '5892.034')] [2023-12-26 13:53:48,920][123091] Updated weights for policy 0, policy_version 1791032 (0.0006) [2023-12-26 13:53:48,982][123091] Updated weights for policy 0, policy_version 1791042 (0.0008) [2023-12-26 13:53:49,035][123090] Updated weights for policy 1, policy_version 1779140 (0.0006) [2023-12-26 13:53:49,049][123091] Updated weights for policy 0, policy_version 1791052 (0.0009) [2023-12-26 13:53:49,092][123090] Updated weights for policy 1, policy_version 1779150 (0.0008) [2023-12-26 13:53:49,140][123090] Updated weights for policy 1, policy_version 1779160 (0.0009) [2023-12-26 13:53:49,830][123091] Updated weights for policy 0, policy_version 1791062 (0.0007) [2023-12-26 13:53:49,899][123091] Updated weights for policy 0, policy_version 1791072 (0.0006) [2023-12-26 13:53:49,974][123091] Updated weights for policy 0, policy_version 1791082 (0.0009) [2023-12-26 13:53:50,029][123090] Updated weights for policy 1, policy_version 1779170 (0.0009) [2023-12-26 13:53:50,095][123090] Updated weights for policy 1, policy_version 1779180 (0.0010) [2023-12-26 13:53:50,159][123090] Updated weights for policy 1, policy_version 1779190 (0.0010) [2023-12-26 13:53:50,221][123090] Updated weights for policy 1, policy_version 1779200 (0.0010) [2023-12-26 13:53:50,704][123091] Updated weights for policy 0, policy_version 1791092 (0.0010) [2023-12-26 13:53:50,765][123091] Updated weights for policy 0, policy_version 1791102 (0.0008) [2023-12-26 13:53:50,819][123091] Updated weights for policy 0, policy_version 1791112 (0.0011) [2023-12-26 13:53:51,088][123090] Updated weights for policy 1, policy_version 1779210 (0.0009) [2023-12-26 13:53:51,148][123090] Updated weights for policy 1, policy_version 1779220 (0.0010) [2023-12-26 13:53:51,200][123090] Updated weights for policy 1, policy_version 1779230 (0.0011) [2023-12-26 13:53:51,715][123091] Updated weights for policy 0, policy_version 1791122 (0.0010) [2023-12-26 13:53:51,776][123091] Updated weights for policy 0, policy_version 1791132 (0.0008) [2023-12-26 13:53:51,824][123091] Updated weights for policy 0, policy_version 1791142 (0.0008) [2023-12-26 13:53:51,869][123091] Updated weights for policy 0, policy_version 1791152 (0.0007) [2023-12-26 13:53:52,052][123090] Updated weights for policy 1, policy_version 1779240 (0.0011) [2023-12-26 13:53:52,109][123090] Updated weights for policy 1, policy_version 1779250 (0.0011) [2023-12-26 13:53:52,173][123090] Updated weights for policy 1, policy_version 1779260 (0.0011) [2023-12-26 13:53:52,628][123091] Updated weights for policy 0, policy_version 1791162 (0.0011) [2023-12-26 13:53:52,696][123091] Updated weights for policy 0, policy_version 1791172 (0.0011) [2023-12-26 13:53:52,757][123091] Updated weights for policy 0, policy_version 1791182 (0.0006) [2023-12-26 13:53:53,026][123090] Updated weights for policy 1, policy_version 1779270 (0.0011) [2023-12-26 13:53:53,079][123090] Updated weights for policy 1, policy_version 1779280 (0.0011) [2023-12-26 13:53:53,131][123090] Updated weights for policy 1, policy_version 1779290 (0.0010) [2023-12-26 13:53:53,488][123091] Updated weights for policy 0, policy_version 1791192 (0.0009) [2023-12-26 13:53:53,543][123091] Updated weights for policy 0, policy_version 1791202 (0.0011) [2023-12-26 13:53:53,595][123091] Updated weights for policy 0, policy_version 1791212 (0.0010) [2023-12-26 13:53:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 914055168. Throughput: 0: 8924.7, 1: 8958.5. Samples: 914031016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:53,786][121949] Avg episode reward: [(0, '6142.594'), (1, '5853.921')] [2023-12-26 13:53:53,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001791216_458555392.pth... [2023-12-26 13:53:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001779296_455499776.pth... [2023-12-26 13:53:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001790160_458285056.pth [2023-12-26 13:53:53,800][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001791216_458555392.pth [2023-12-26 13:53:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001778240_455229440.pth [2023-12-26 13:53:53,802][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001779296_455499776.pth [2023-12-26 13:53:53,975][123090] Updated weights for policy 1, policy_version 1779300 (0.0010) [2023-12-26 13:53:54,023][123090] Updated weights for policy 1, policy_version 1779310 (0.0010) [2023-12-26 13:53:54,073][123090] Updated weights for policy 1, policy_version 1779320 (0.0010) [2023-12-26 13:53:54,464][123091] Updated weights for policy 0, policy_version 1791222 (0.0010) [2023-12-26 13:53:54,543][123091] Updated weights for policy 0, policy_version 1791232 (0.0010) [2023-12-26 13:53:54,622][123091] Updated weights for policy 0, policy_version 1791242 (0.0011) [2023-12-26 13:53:54,865][123090] Updated weights for policy 1, policy_version 1779330 (0.0010) [2023-12-26 13:53:54,934][123090] Updated weights for policy 1, policy_version 1779340 (0.0006) [2023-12-26 13:53:55,007][123090] Updated weights for policy 1, policy_version 1779350 (0.0010) [2023-12-26 13:53:55,074][123090] Updated weights for policy 1, policy_version 1779360 (0.0011) [2023-12-26 13:53:55,434][123091] Updated weights for policy 0, policy_version 1791252 (0.0011) [2023-12-26 13:53:55,493][123091] Updated weights for policy 0, policy_version 1791262 (0.0011) [2023-12-26 13:53:55,544][123091] Updated weights for policy 0, policy_version 1791272 (0.0010) [2023-12-26 13:53:55,717][123090] Updated weights for policy 1, policy_version 1779370 (0.0005) [2023-12-26 13:53:55,793][123090] Updated weights for policy 1, policy_version 1779380 (0.0005) [2023-12-26 13:53:55,872][123090] Updated weights for policy 1, policy_version 1779390 (0.0005) [2023-12-26 13:53:56,373][123091] Updated weights for policy 0, policy_version 1791282 (0.0010) [2023-12-26 13:53:56,436][123091] Updated weights for policy 0, policy_version 1791292 (0.0011) [2023-12-26 13:53:56,468][123090] Updated weights for policy 1, policy_version 1779400 (0.0009) [2023-12-26 13:53:56,499][123091] Updated weights for policy 0, policy_version 1791302 (0.0011) [2023-12-26 13:53:56,527][123090] Updated weights for policy 1, policy_version 1779410 (0.0010) [2023-12-26 13:53:56,557][123091] Updated weights for policy 0, policy_version 1791312 (0.0010) [2023-12-26 13:53:56,581][123090] Updated weights for policy 1, policy_version 1779420 (0.0007) [2023-12-26 13:53:57,168][123090] Updated weights for policy 1, policy_version 1779430 (0.0008) [2023-12-26 13:53:57,216][123090] Updated weights for policy 1, policy_version 1779440 (0.0010) [2023-12-26 13:53:57,271][123090] Updated weights for policy 1, policy_version 1779450 (0.0010) [2023-12-26 13:53:57,364][123091] Updated weights for policy 0, policy_version 1791322 (0.0006) [2023-12-26 13:53:57,429][123091] Updated weights for policy 0, policy_version 1791332 (0.0007) [2023-12-26 13:53:57,498][123091] Updated weights for policy 0, policy_version 1791342 (0.0010) [2023-12-26 13:53:57,978][123090] Updated weights for policy 1, policy_version 1779460 (0.0008) [2023-12-26 13:53:58,025][123090] Updated weights for policy 1, policy_version 1779470 (0.0005) [2023-12-26 13:53:58,089][123090] Updated weights for policy 1, policy_version 1779480 (0.0007) [2023-12-26 13:53:58,317][123091] Updated weights for policy 0, policy_version 1791352 (0.0008) [2023-12-26 13:53:58,388][123091] Updated weights for policy 0, policy_version 1791362 (0.0008) [2023-12-26 13:53:58,458][123091] Updated weights for policy 0, policy_version 1791372 (0.0008) [2023-12-26 13:53:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 914145280. Throughput: 0: 8951.3, 1: 9052.2. Samples: 914140284. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:53:58,785][121949] Avg episode reward: [(0, '6261.102'), (1, '5882.277')] [2023-12-26 13:53:59,058][123090] Updated weights for policy 1, policy_version 1779490 (0.0009) [2023-12-26 13:53:59,122][123090] Updated weights for policy 1, policy_version 1779500 (0.0010) [2023-12-26 13:53:59,176][123090] Updated weights for policy 1, policy_version 1779510 (0.0010) [2023-12-26 13:53:59,247][123090] Updated weights for policy 1, policy_version 1779520 (0.0010) [2023-12-26 13:53:59,294][123091] Updated weights for policy 0, policy_version 1791382 (0.0007) [2023-12-26 13:53:59,357][123091] Updated weights for policy 0, policy_version 1791392 (0.0008) [2023-12-26 13:53:59,427][123091] Updated weights for policy 0, policy_version 1791402 (0.0010) [2023-12-26 13:54:00,099][123090] Updated weights for policy 1, policy_version 1779530 (0.0010) [2023-12-26 13:54:00,163][123090] Updated weights for policy 1, policy_version 1779540 (0.0010) [2023-12-26 13:54:00,214][123091] Updated weights for policy 0, policy_version 1791412 (0.0009) [2023-12-26 13:54:00,231][123090] Updated weights for policy 1, policy_version 1779550 (0.0007) [2023-12-26 13:54:00,282][123091] Updated weights for policy 0, policy_version 1791422 (0.0010) [2023-12-26 13:54:00,348][123091] Updated weights for policy 0, policy_version 1791432 (0.0010) [2023-12-26 13:54:01,026][123091] Updated weights for policy 0, policy_version 1791442 (0.0009) [2023-12-26 13:54:01,091][123090] Updated weights for policy 1, policy_version 1779560 (0.0010) [2023-12-26 13:54:01,093][123091] Updated weights for policy 0, policy_version 1791452 (0.0007) [2023-12-26 13:54:01,154][123090] Updated weights for policy 1, policy_version 1779570 (0.0008) [2023-12-26 13:54:01,156][123091] Updated weights for policy 0, policy_version 1791462 (0.0008) [2023-12-26 13:54:01,215][123091] Updated weights for policy 0, policy_version 1791472 (0.0009) [2023-12-26 13:54:01,216][123090] Updated weights for policy 1, policy_version 1779580 (0.0008) [2023-12-26 13:54:01,996][123090] Updated weights for policy 1, policy_version 1779590 (0.0008) [2023-12-26 13:54:02,047][123090] Updated weights for policy 1, policy_version 1779600 (0.0008) [2023-12-26 13:54:02,088][123091] Updated weights for policy 0, policy_version 1791482 (0.0006) [2023-12-26 13:54:02,102][123090] Updated weights for policy 1, policy_version 1779610 (0.0008) [2023-12-26 13:54:02,141][123091] Updated weights for policy 0, policy_version 1791492 (0.0008) [2023-12-26 13:54:02,206][123091] Updated weights for policy 0, policy_version 1791502 (0.0009) [2023-12-26 13:54:02,896][123090] Updated weights for policy 1, policy_version 1779620 (0.0008) [2023-12-26 13:54:02,950][123090] Updated weights for policy 1, policy_version 1779630 (0.0010) [2023-12-26 13:54:03,018][123090] Updated weights for policy 1, policy_version 1779640 (0.0010) [2023-12-26 13:54:03,020][123091] Updated weights for policy 0, policy_version 1791512 (0.0007) [2023-12-26 13:54:03,082][123091] Updated weights for policy 0, policy_version 1791522 (0.0008) [2023-12-26 13:54:03,147][123091] Updated weights for policy 0, policy_version 1791532 (0.0009) [2023-12-26 13:54:03,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 914227200. Throughput: 0: 8851.3, 1: 9008.8. Samples: 914242424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:03,785][121949] Avg episode reward: [(0, '6309.409'), (1, '5860.253')] [2023-12-26 13:54:03,866][123090] Updated weights for policy 1, policy_version 1779650 (0.0008) [2023-12-26 13:54:03,884][123091] Updated weights for policy 0, policy_version 1791542 (0.0009) [2023-12-26 13:54:03,928][123090] Updated weights for policy 1, policy_version 1779660 (0.0008) [2023-12-26 13:54:03,946][123091] Updated weights for policy 0, policy_version 1791552 (0.0008) [2023-12-26 13:54:03,989][123090] Updated weights for policy 1, policy_version 1779670 (0.0010) [2023-12-26 13:54:04,009][123091] Updated weights for policy 0, policy_version 1791562 (0.0008) [2023-12-26 13:54:04,051][123090] Updated weights for policy 1, policy_version 1779680 (0.0007) [2023-12-26 13:54:04,843][123091] Updated weights for policy 0, policy_version 1791572 (0.0007) [2023-12-26 13:54:04,899][123091] Updated weights for policy 0, policy_version 1791582 (0.0006) [2023-12-26 13:54:04,902][123090] Updated weights for policy 1, policy_version 1779690 (0.0010) [2023-12-26 13:54:04,958][123090] Updated weights for policy 1, policy_version 1779700 (0.0008) [2023-12-26 13:54:04,959][123091] Updated weights for policy 0, policy_version 1791592 (0.0008) [2023-12-26 13:54:05,013][123090] Updated weights for policy 1, policy_version 1779710 (0.0008) [2023-12-26 13:54:05,743][123091] Updated weights for policy 0, policy_version 1791602 (0.0009) [2023-12-26 13:54:05,801][123091] Updated weights for policy 0, policy_version 1791612 (0.0010) [2023-12-26 13:54:05,844][123090] Updated weights for policy 1, policy_version 1779720 (0.0008) [2023-12-26 13:54:05,851][123091] Updated weights for policy 0, policy_version 1791622 (0.0008) [2023-12-26 13:54:05,893][123090] Updated weights for policy 1, policy_version 1779730 (0.0008) [2023-12-26 13:54:05,905][123091] Updated weights for policy 0, policy_version 1791632 (0.0007) [2023-12-26 13:54:05,941][123090] Updated weights for policy 1, policy_version 1779740 (0.0009) [2023-12-26 13:54:06,769][123091] Updated weights for policy 0, policy_version 1791642 (0.0010) [2023-12-26 13:54:06,820][123091] Updated weights for policy 0, policy_version 1791652 (0.0009) [2023-12-26 13:54:06,827][123090] Updated weights for policy 1, policy_version 1779750 (0.0007) [2023-12-26 13:54:06,883][123091] Updated weights for policy 0, policy_version 1791662 (0.0010) [2023-12-26 13:54:06,891][123090] Updated weights for policy 1, policy_version 1779760 (0.0008) [2023-12-26 13:54:06,956][123090] Updated weights for policy 1, policy_version 1779770 (0.0009) [2023-12-26 13:54:07,723][123091] Updated weights for policy 0, policy_version 1791673 (0.0010) [2023-12-26 13:54:07,760][123090] Updated weights for policy 1, policy_version 1779780 (0.0010) [2023-12-26 13:54:07,776][123091] Updated weights for policy 0, policy_version 1791683 (0.0009) [2023-12-26 13:54:07,834][123091] Updated weights for policy 0, policy_version 1791693 (0.0009) [2023-12-26 13:54:07,834][123090] Updated weights for policy 1, policy_version 1779790 (0.0008) [2023-12-26 13:54:07,898][123090] Updated weights for policy 1, policy_version 1779800 (0.0009) [2023-12-26 13:54:08,619][123090] Updated weights for policy 1, policy_version 1779810 (0.0010) [2023-12-26 13:54:08,672][123090] Updated weights for policy 1, policy_version 1779820 (0.0009) [2023-12-26 13:54:08,726][123090] Updated weights for policy 1, policy_version 1779830 (0.0009) [2023-12-26 13:54:08,751][123091] Updated weights for policy 0, policy_version 1791703 (0.0008) [2023-12-26 13:54:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 914309120. Throughput: 0: 8877.0, 1: 8983.6. Samples: 914293620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:08,785][121949] Avg episode reward: [(0, '6340.435'), (1, '5995.935')] [2023-12-26 13:54:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001779840_455639040.pth... [2023-12-26 13:54:08,790][123090] Updated weights for policy 1, policy_version 1779840 (0.0008) [2023-12-26 13:54:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001778784_455368704.pth [2023-12-26 13:54:08,818][123091] Updated weights for policy 0, policy_version 1791713 (0.0009) [2023-12-26 13:54:08,879][123091] Updated weights for policy 0, policy_version 1791723 (0.0009) [2023-12-26 13:54:08,907][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001791728_458686464.pth... [2023-12-26 13:54:08,912][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001790704_458424320.pth [2023-12-26 13:54:09,559][123090] Updated weights for policy 1, policy_version 1779850 (0.0009) [2023-12-26 13:54:09,630][123090] Updated weights for policy 1, policy_version 1779860 (0.0009) [2023-12-26 13:54:09,690][123090] Updated weights for policy 1, policy_version 1779870 (0.0007) [2023-12-26 13:54:09,758][123091] Updated weights for policy 0, policy_version 1791733 (0.0009) [2023-12-26 13:54:09,827][123091] Updated weights for policy 0, policy_version 1791743 (0.0010) [2023-12-26 13:54:09,899][123091] Updated weights for policy 0, policy_version 1791753 (0.0008) [2023-12-26 13:54:10,478][123090] Updated weights for policy 1, policy_version 1779880 (0.0010) [2023-12-26 13:54:10,547][123090] Updated weights for policy 1, policy_version 1779890 (0.0010) [2023-12-26 13:54:10,609][123090] Updated weights for policy 1, policy_version 1779900 (0.0009) [2023-12-26 13:54:10,656][123091] Updated weights for policy 0, policy_version 1791763 (0.0007) [2023-12-26 13:54:10,715][123091] Updated weights for policy 0, policy_version 1791773 (0.0010) [2023-12-26 13:54:10,769][123091] Updated weights for policy 0, policy_version 1791783 (0.0009) [2023-12-26 13:54:11,418][123090] Updated weights for policy 1, policy_version 1779910 (0.0009) [2023-12-26 13:54:11,491][123090] Updated weights for policy 1, policy_version 1779920 (0.0010) [2023-12-26 13:54:11,559][123090] Updated weights for policy 1, policy_version 1779930 (0.0008) [2023-12-26 13:54:11,695][123091] Updated weights for policy 0, policy_version 1791794 (0.0010) [2023-12-26 13:54:11,765][123091] Updated weights for policy 0, policy_version 1791804 (0.0009) [2023-12-26 13:54:11,819][123091] Updated weights for policy 0, policy_version 1791814 (0.0009) [2023-12-26 13:54:11,885][123091] Updated weights for policy 0, policy_version 1791824 (0.0010) [2023-12-26 13:54:12,390][123090] Updated weights for policy 1, policy_version 1779940 (0.0009) [2023-12-26 13:54:12,453][123090] Updated weights for policy 1, policy_version 1779950 (0.0008) [2023-12-26 13:54:12,512][123090] Updated weights for policy 1, policy_version 1779960 (0.0008) [2023-12-26 13:54:12,738][123091] Updated weights for policy 0, policy_version 1791834 (0.0010) [2023-12-26 13:54:12,789][123091] Updated weights for policy 0, policy_version 1791844 (0.0010) [2023-12-26 13:54:12,849][123091] Updated weights for policy 0, policy_version 1791855 (0.0009) [2023-12-26 13:54:13,316][123090] Updated weights for policy 1, policy_version 1779970 (0.0008) [2023-12-26 13:54:13,385][123090] Updated weights for policy 1, policy_version 1779980 (0.0008) [2023-12-26 13:54:13,448][123090] Updated weights for policy 1, policy_version 1779990 (0.0009) [2023-12-26 13:54:13,497][123090] Updated weights for policy 1, policy_version 1780000 (0.0009) [2023-12-26 13:54:13,722][123091] Updated weights for policy 0, policy_version 1791865 (0.0010) [2023-12-26 13:54:13,780][123091] Updated weights for policy 0, policy_version 1791875 (0.0010) [2023-12-26 13:54:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 914399232. Throughput: 0: 8761.9, 1: 8929.0. Samples: 914396488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:13,784][121949] Avg episode reward: [(0, '6267.446'), (1, '5941.619')] [2023-12-26 13:54:13,839][123091] Updated weights for policy 0, policy_version 1791885 (0.0010) [2023-12-26 13:54:14,220][123090] Updated weights for policy 1, policy_version 1780010 (0.0005) [2023-12-26 13:54:14,282][123090] Updated weights for policy 1, policy_version 1780020 (0.0005) [2023-12-26 13:54:14,345][123090] Updated weights for policy 1, policy_version 1780030 (0.0009) [2023-12-26 13:54:14,704][123091] Updated weights for policy 0, policy_version 1791895 (0.0010) [2023-12-26 13:54:14,768][123091] Updated weights for policy 0, policy_version 1791905 (0.0010) [2023-12-26 13:54:14,837][123091] Updated weights for policy 0, policy_version 1791915 (0.0006) [2023-12-26 13:54:15,085][123090] Updated weights for policy 1, policy_version 1780040 (0.0009) [2023-12-26 13:54:15,163][123090] Updated weights for policy 1, policy_version 1780050 (0.0007) [2023-12-26 13:54:15,227][123090] Updated weights for policy 1, policy_version 1780060 (0.0009) [2023-12-26 13:54:15,487][123091] Updated weights for policy 0, policy_version 1791925 (0.0007) [2023-12-26 13:54:15,552][123091] Updated weights for policy 0, policy_version 1791935 (0.0009) [2023-12-26 13:54:15,608][123091] Updated weights for policy 0, policy_version 1791945 (0.0009) [2023-12-26 13:54:16,031][123090] Updated weights for policy 1, policy_version 1780070 (0.0009) [2023-12-26 13:54:16,095][123090] Updated weights for policy 1, policy_version 1780080 (0.0010) [2023-12-26 13:54:16,151][123090] Updated weights for policy 1, policy_version 1780090 (0.0009) [2023-12-26 13:54:16,428][123091] Updated weights for policy 0, policy_version 1791955 (0.0009) [2023-12-26 13:54:16,492][123091] Updated weights for policy 0, policy_version 1791965 (0.0009) [2023-12-26 13:54:16,556][123091] Updated weights for policy 0, policy_version 1791975 (0.0009) [2023-12-26 13:54:17,011][123090] Updated weights for policy 1, policy_version 1780100 (0.0008) [2023-12-26 13:54:17,066][123090] Updated weights for policy 1, policy_version 1780110 (0.0005) [2023-12-26 13:54:17,114][123090] Updated weights for policy 1, policy_version 1780120 (0.0005) [2023-12-26 13:54:17,226][123091] Updated weights for policy 0, policy_version 1791985 (0.0009) [2023-12-26 13:54:17,281][123091] Updated weights for policy 0, policy_version 1791995 (0.0005) [2023-12-26 13:54:17,327][123091] Updated weights for policy 0, policy_version 1792005 (0.0006) [2023-12-26 13:54:17,398][123091] Updated weights for policy 0, policy_version 1792015 (0.0006) [2023-12-26 13:54:17,806][123090] Updated weights for policy 1, policy_version 1780130 (0.0005) [2023-12-26 13:54:17,870][123090] Updated weights for policy 1, policy_version 1780140 (0.0006) [2023-12-26 13:54:17,944][123090] Updated weights for policy 1, policy_version 1780150 (0.0005) [2023-12-26 13:54:18,009][123090] Updated weights for policy 1, policy_version 1780160 (0.0006) [2023-12-26 13:54:18,031][123091] Updated weights for policy 0, policy_version 1792025 (0.0006) [2023-12-26 13:54:18,096][123091] Updated weights for policy 0, policy_version 1792035 (0.0005) [2023-12-26 13:54:18,169][123091] Updated weights for policy 0, policy_version 1792045 (0.0005) [2023-12-26 13:54:18,704][123090] Updated weights for policy 1, policy_version 1780170 (0.0005) [2023-12-26 13:54:18,759][123090] Updated weights for policy 1, policy_version 1780180 (0.0005) [2023-12-26 13:54:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 914489344. Throughput: 0: 8691.8, 1: 8929.0. Samples: 914507112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:18,785][121949] Avg episode reward: [(0, '6292.785'), (1, '5832.498')] [2023-12-26 13:54:18,819][123090] Updated weights for policy 1, policy_version 1780190 (0.0006) [2023-12-26 13:54:18,887][123091] Updated weights for policy 0, policy_version 1792055 (0.0009) [2023-12-26 13:54:18,944][123091] Updated weights for policy 0, policy_version 1792065 (0.0009) [2023-12-26 13:54:19,000][123091] Updated weights for policy 0, policy_version 1792075 (0.0010) [2023-12-26 13:54:19,544][123090] Updated weights for policy 1, policy_version 1780200 (0.0007) [2023-12-26 13:54:19,610][123090] Updated weights for policy 1, policy_version 1780210 (0.0009) [2023-12-26 13:54:19,677][123090] Updated weights for policy 1, policy_version 1780220 (0.0008) [2023-12-26 13:54:19,807][123091] Updated weights for policy 0, policy_version 1792085 (0.0010) [2023-12-26 13:54:19,873][123091] Updated weights for policy 0, policy_version 1792095 (0.0010) [2023-12-26 13:54:19,942][123091] Updated weights for policy 0, policy_version 1792105 (0.0009) [2023-12-26 13:54:20,390][123090] Updated weights for policy 1, policy_version 1780230 (0.0009) [2023-12-26 13:54:20,454][123090] Updated weights for policy 1, policy_version 1780240 (0.0011) [2023-12-26 13:54:20,525][123090] Updated weights for policy 1, policy_version 1780250 (0.0011) [2023-12-26 13:54:20,828][123091] Updated weights for policy 0, policy_version 1792115 (0.0010) [2023-12-26 13:54:20,900][123091] Updated weights for policy 0, policy_version 1792125 (0.0009) [2023-12-26 13:54:20,965][123091] Updated weights for policy 0, policy_version 1792135 (0.0009) [2023-12-26 13:54:21,388][123090] Updated weights for policy 1, policy_version 1780260 (0.0010) [2023-12-26 13:54:21,460][123090] Updated weights for policy 1, policy_version 1780270 (0.0010) [2023-12-26 13:54:21,533][123090] Updated weights for policy 1, policy_version 1780280 (0.0009) [2023-12-26 13:54:21,860][123091] Updated weights for policy 0, policy_version 1792145 (0.0009) [2023-12-26 13:54:21,921][123091] Updated weights for policy 0, policy_version 1792155 (0.0009) [2023-12-26 13:54:21,979][123091] Updated weights for policy 0, policy_version 1792165 (0.0009) [2023-12-26 13:54:22,028][123091] Updated weights for policy 0, policy_version 1792175 (0.0009) [2023-12-26 13:54:22,264][123090] Updated weights for policy 1, policy_version 1780290 (0.0006) [2023-12-26 13:54:22,320][123090] Updated weights for policy 1, policy_version 1780300 (0.0011) [2023-12-26 13:54:22,391][123090] Updated weights for policy 1, policy_version 1780310 (0.0011) [2023-12-26 13:54:22,462][123090] Updated weights for policy 1, policy_version 1780320 (0.0011) [2023-12-26 13:54:22,855][123091] Updated weights for policy 0, policy_version 1792185 (0.0007) [2023-12-26 13:54:22,922][123091] Updated weights for policy 0, policy_version 1792195 (0.0006) [2023-12-26 13:54:22,972][123091] Updated weights for policy 0, policy_version 1792205 (0.0005) [2023-12-26 13:54:23,302][123090] Updated weights for policy 1, policy_version 1780330 (0.0010) [2023-12-26 13:54:23,349][123090] Updated weights for policy 1, policy_version 1780340 (0.0008) [2023-12-26 13:54:23,409][123090] Updated weights for policy 1, policy_version 1780350 (0.0005) [2023-12-26 13:54:23,730][123091] Updated weights for policy 0, policy_version 1792215 (0.0006) [2023-12-26 13:54:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 914579456. Throughput: 0: 8674.7, 1: 8920.3. Samples: 914558580. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:23,784][121949] Avg episode reward: [(0, '6264.723'), (1, '5791.521')] [2023-12-26 13:54:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001780352_455770112.pth... [2023-12-26 13:54:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001779296_455499776.pth [2023-12-26 13:54:23,805][123091] Updated weights for policy 0, policy_version 1792225 (0.0005) [2023-12-26 13:54:23,873][123091] Updated weights for policy 0, policy_version 1792235 (0.0008) [2023-12-26 13:54:23,901][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001792240_458817536.pth... [2023-12-26 13:54:23,906][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001791216_458555392.pth [2023-12-26 13:54:24,136][123090] Updated weights for policy 1, policy_version 1780360 (0.0009) [2023-12-26 13:54:24,206][123090] Updated weights for policy 1, policy_version 1780370 (0.0011) [2023-12-26 13:54:24,281][123090] Updated weights for policy 1, policy_version 1780380 (0.0011) [2023-12-26 13:54:24,614][123091] Updated weights for policy 0, policy_version 1792245 (0.0008) [2023-12-26 13:54:24,680][123091] Updated weights for policy 0, policy_version 1792255 (0.0010) [2023-12-26 13:54:24,750][123091] Updated weights for policy 0, policy_version 1792265 (0.0011) [2023-12-26 13:54:25,072][123090] Updated weights for policy 1, policy_version 1780390 (0.0010) [2023-12-26 13:54:25,119][123090] Updated weights for policy 1, policy_version 1780400 (0.0010) [2023-12-26 13:54:25,192][123090] Updated weights for policy 1, policy_version 1780410 (0.0010) [2023-12-26 13:54:25,526][123091] Updated weights for policy 0, policy_version 1792275 (0.0009) [2023-12-26 13:54:25,580][123091] Updated weights for policy 0, policy_version 1792285 (0.0005) [2023-12-26 13:54:25,626][123091] Updated weights for policy 0, policy_version 1792295 (0.0005) [2023-12-26 13:54:25,999][123090] Updated weights for policy 1, policy_version 1780420 (0.0010) [2023-12-26 13:54:26,053][123090] Updated weights for policy 1, policy_version 1780430 (0.0010) [2023-12-26 13:54:26,108][123090] Updated weights for policy 1, policy_version 1780440 (0.0010) [2023-12-26 13:54:26,285][123091] Updated weights for policy 0, policy_version 1792305 (0.0005) [2023-12-26 13:54:26,338][123091] Updated weights for policy 0, policy_version 1792315 (0.0005) [2023-12-26 13:54:26,390][123091] Updated weights for policy 0, policy_version 1792325 (0.0008) [2023-12-26 13:54:26,436][123091] Updated weights for policy 0, policy_version 1792335 (0.0010) [2023-12-26 13:54:26,880][123090] Updated weights for policy 1, policy_version 1780450 (0.0009) [2023-12-26 13:54:26,931][123090] Updated weights for policy 1, policy_version 1780460 (0.0005) [2023-12-26 13:54:26,985][123090] Updated weights for policy 1, policy_version 1780470 (0.0005) [2023-12-26 13:54:27,040][123090] Updated weights for policy 1, policy_version 1780480 (0.0010) [2023-12-26 13:54:27,073][123091] Updated weights for policy 0, policy_version 1792345 (0.0006) [2023-12-26 13:54:27,123][123091] Updated weights for policy 0, policy_version 1792355 (0.0008) [2023-12-26 13:54:27,171][123091] Updated weights for policy 0, policy_version 1792365 (0.0008) [2023-12-26 13:54:27,769][123090] Updated weights for policy 1, policy_version 1780490 (0.0005) [2023-12-26 13:54:27,823][123090] Updated weights for policy 1, policy_version 1780500 (0.0005) [2023-12-26 13:54:27,837][123091] Updated weights for policy 0, policy_version 1792375 (0.0006) [2023-12-26 13:54:27,880][123090] Updated weights for policy 1, policy_version 1780510 (0.0005) [2023-12-26 13:54:27,894][123091] Updated weights for policy 0, policy_version 1792385 (0.0007) [2023-12-26 13:54:27,948][123091] Updated weights for policy 0, policy_version 1792396 (0.0010) [2023-12-26 13:54:28,543][123090] Updated weights for policy 1, policy_version 1780520 (0.0006) [2023-12-26 13:54:28,594][123090] Updated weights for policy 1, policy_version 1780530 (0.0006) [2023-12-26 13:54:28,645][123090] Updated weights for policy 1, policy_version 1780540 (0.0010) [2023-12-26 13:54:28,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 914677760. Throughput: 0: 8807.8, 1: 8954.6. Samples: 914670424. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:54:28,785][121949] Avg episode reward: [(0, '6290.547'), (1, '5845.490')] [2023-12-26 13:54:28,880][123091] Updated weights for policy 0, policy_version 1792406 (0.0009) [2023-12-26 13:54:28,930][123091] Updated weights for policy 0, policy_version 1792416 (0.0009) [2023-12-26 13:54:28,984][123091] Updated weights for policy 0, policy_version 1792426 (0.0009) [2023-12-26 13:54:29,411][123090] Updated weights for policy 1, policy_version 1780550 (0.0010) [2023-12-26 13:54:29,472][123090] Updated weights for policy 1, policy_version 1780560 (0.0010) [2023-12-26 13:54:29,535][123090] Updated weights for policy 1, policy_version 1780570 (0.0008) [2023-12-26 13:54:29,829][123091] Updated weights for policy 0, policy_version 1792436 (0.0008) [2023-12-26 13:54:29,897][123091] Updated weights for policy 0, policy_version 1792446 (0.0008) [2023-12-26 13:54:29,958][123091] Updated weights for policy 0, policy_version 1792456 (0.0007) [2023-12-26 13:54:30,368][123090] Updated weights for policy 1, policy_version 1780580 (0.0008) [2023-12-26 13:54:30,423][123090] Updated weights for policy 1, policy_version 1780590 (0.0009) [2023-12-26 13:54:30,473][123090] Updated weights for policy 1, policy_version 1780600 (0.0009) [2023-12-26 13:54:30,691][123091] Updated weights for policy 0, policy_version 1792466 (0.0005) [2023-12-26 13:54:30,745][123091] Updated weights for policy 0, policy_version 1792476 (0.0005) [2023-12-26 13:54:30,791][123091] Updated weights for policy 0, policy_version 1792486 (0.0005) [2023-12-26 13:54:30,840][123091] Updated weights for policy 0, policy_version 1792496 (0.0006) [2023-12-26 13:54:31,272][123090] Updated weights for policy 1, policy_version 1780610 (0.0009) [2023-12-26 13:54:31,345][123090] Updated weights for policy 1, policy_version 1780620 (0.0006) [2023-12-26 13:54:31,417][123090] Updated weights for policy 1, policy_version 1780630 (0.0010) [2023-12-26 13:54:31,480][123090] Updated weights for policy 1, policy_version 1780640 (0.0009) [2023-12-26 13:54:31,674][123091] Updated weights for policy 0, policy_version 1792506 (0.0007) [2023-12-26 13:54:31,740][123091] Updated weights for policy 0, policy_version 1792516 (0.0007) [2023-12-26 13:54:31,800][123091] Updated weights for policy 0, policy_version 1792526 (0.0008) [2023-12-26 13:54:32,231][123090] Updated weights for policy 1, policy_version 1780650 (0.0006) [2023-12-26 13:54:32,305][123090] Updated weights for policy 1, policy_version 1780660 (0.0008) [2023-12-26 13:54:32,377][123090] Updated weights for policy 1, policy_version 1780670 (0.0009) [2023-12-26 13:54:32,593][123091] Updated weights for policy 0, policy_version 1792536 (0.0009) [2023-12-26 13:54:32,646][123091] Updated weights for policy 0, policy_version 1792546 (0.0009) [2023-12-26 13:54:32,699][123091] Updated weights for policy 0, policy_version 1792556 (0.0009) [2023-12-26 13:54:33,057][123090] Updated weights for policy 1, policy_version 1780680 (0.0005) [2023-12-26 13:54:33,101][123090] Updated weights for policy 1, policy_version 1780690 (0.0005) [2023-12-26 13:54:33,149][123090] Updated weights for policy 1, policy_version 1780700 (0.0005) [2023-12-26 13:54:33,651][123091] Updated weights for policy 0, policy_version 1792566 (0.0009) [2023-12-26 13:54:33,713][123091] Updated weights for policy 0, policy_version 1792576 (0.0010) [2023-12-26 13:54:33,766][123091] Updated weights for policy 0, policy_version 1792586 (0.0010) [2023-12-26 13:54:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 914759680. Throughput: 0: 8779.1, 1: 8946.5. Samples: 914777904. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:33,785][121949] Avg episode reward: [(0, '6405.202'), (1, '5940.437')] [2023-12-26 13:54:33,845][123090] Updated weights for policy 1, policy_version 1780710 (0.0005) [2023-12-26 13:54:33,890][123090] Updated weights for policy 1, policy_version 1780720 (0.0005) [2023-12-26 13:54:33,938][123090] Updated weights for policy 1, policy_version 1780730 (0.0005) [2023-12-26 13:54:34,625][123090] Updated weights for policy 1, policy_version 1780740 (0.0005) [2023-12-26 13:54:34,682][123090] Updated weights for policy 1, policy_version 1780750 (0.0006) [2023-12-26 13:54:34,706][123091] Updated weights for policy 0, policy_version 1792596 (0.0009) [2023-12-26 13:54:34,745][123090] Updated weights for policy 1, policy_version 1780760 (0.0009) [2023-12-26 13:54:34,769][123091] Updated weights for policy 0, policy_version 1792606 (0.0007) [2023-12-26 13:54:34,832][123091] Updated weights for policy 0, policy_version 1792616 (0.0007) [2023-12-26 13:54:35,453][123090] Updated weights for policy 1, policy_version 1780770 (0.0010) [2023-12-26 13:54:35,517][123090] Updated weights for policy 1, policy_version 1780780 (0.0010) [2023-12-26 13:54:35,568][123091] Updated weights for policy 0, policy_version 1792626 (0.0009) [2023-12-26 13:54:35,579][123090] Updated weights for policy 1, policy_version 1780790 (0.0010) [2023-12-26 13:54:35,622][123091] Updated weights for policy 0, policy_version 1792636 (0.0008) [2023-12-26 13:54:35,637][123090] Updated weights for policy 1, policy_version 1780800 (0.0006) [2023-12-26 13:54:35,680][123091] Updated weights for policy 0, policy_version 1792648 (0.0010) [2023-12-26 13:54:36,318][123090] Updated weights for policy 1, policy_version 1780810 (0.0011) [2023-12-26 13:54:36,393][123090] Updated weights for policy 1, policy_version 1780820 (0.0011) [2023-12-26 13:54:36,457][123090] Updated weights for policy 1, policy_version 1780830 (0.0011) [2023-12-26 13:54:36,604][123091] Updated weights for policy 0, policy_version 1792659 (0.0010) [2023-12-26 13:54:36,665][123091] Updated weights for policy 0, policy_version 1792669 (0.0009) [2023-12-26 13:54:36,735][123091] Updated weights for policy 0, policy_version 1792679 (0.0009) [2023-12-26 13:54:37,271][123090] Updated weights for policy 1, policy_version 1780840 (0.0011) [2023-12-26 13:54:37,335][123090] Updated weights for policy 1, policy_version 1780850 (0.0011) [2023-12-26 13:54:37,401][123090] Updated weights for policy 1, policy_version 1780860 (0.0010) [2023-12-26 13:54:37,575][123091] Updated weights for policy 0, policy_version 1792689 (0.0009) [2023-12-26 13:54:37,627][123091] Updated weights for policy 0, policy_version 1792699 (0.0008) [2023-12-26 13:54:37,691][123091] Updated weights for policy 0, policy_version 1792709 (0.0010) [2023-12-26 13:54:37,760][123091] Updated weights for policy 0, policy_version 1792719 (0.0009) [2023-12-26 13:54:38,080][123090] Updated weights for policy 1, policy_version 1780870 (0.0007) [2023-12-26 13:54:38,130][123090] Updated weights for policy 1, policy_version 1780880 (0.0005) [2023-12-26 13:54:38,177][123090] Updated weights for policy 1, policy_version 1780890 (0.0005) [2023-12-26 13:54:38,668][123091] Updated weights for policy 0, policy_version 1792729 (0.0010) [2023-12-26 13:54:38,732][123091] Updated weights for policy 0, policy_version 1792739 (0.0010) [2023-12-26 13:54:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 914849792. Throughput: 0: 8746.7, 1: 9059.4. Samples: 914832280. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:38,784][121949] Avg episode reward: [(0, '6365.631'), (1, '5993.333')] [2023-12-26 13:54:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001780896_455909376.pth... [2023-12-26 13:54:38,790][123091] Updated weights for policy 0, policy_version 1792749 (0.0010) [2023-12-26 13:54:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001779840_455639040.pth [2023-12-26 13:54:38,810][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001792752_458948608.pth... [2023-12-26 13:54:38,816][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001791728_458686464.pth [2023-12-26 13:54:38,909][123090] Updated weights for policy 1, policy_version 1780900 (0.0005) [2023-12-26 13:54:38,970][123090] Updated weights for policy 1, policy_version 1780910 (0.0005) [2023-12-26 13:54:39,027][123090] Updated weights for policy 1, policy_version 1780920 (0.0007) [2023-12-26 13:54:39,685][123091] Updated weights for policy 0, policy_version 1792759 (0.0009) [2023-12-26 13:54:39,752][123091] Updated weights for policy 0, policy_version 1792769 (0.0009) [2023-12-26 13:54:39,820][123091] Updated weights for policy 0, policy_version 1792779 (0.0010) [2023-12-26 13:54:39,847][123090] Updated weights for policy 1, policy_version 1780930 (0.0009) [2023-12-26 13:54:39,921][123090] Updated weights for policy 1, policy_version 1780940 (0.0010) [2023-12-26 13:54:39,989][123090] Updated weights for policy 1, policy_version 1780950 (0.0010) [2023-12-26 13:54:40,051][123090] Updated weights for policy 1, policy_version 1780960 (0.0010) [2023-12-26 13:54:40,663][123091] Updated weights for policy 0, policy_version 1792789 (0.0009) [2023-12-26 13:54:40,729][123091] Updated weights for policy 0, policy_version 1792799 (0.0008) [2023-12-26 13:54:40,782][123091] Updated weights for policy 0, policy_version 1792809 (0.0009) [2023-12-26 13:54:40,886][123090] Updated weights for policy 1, policy_version 1780970 (0.0010) [2023-12-26 13:54:40,938][123090] Updated weights for policy 1, policy_version 1780980 (0.0009) [2023-12-26 13:54:40,988][123090] Updated weights for policy 1, policy_version 1780990 (0.0010) [2023-12-26 13:54:41,662][123091] Updated weights for policy 0, policy_version 1792819 (0.0009) [2023-12-26 13:54:41,737][123091] Updated weights for policy 0, policy_version 1792829 (0.0010) [2023-12-26 13:54:41,794][123091] Updated weights for policy 0, policy_version 1792839 (0.0009) [2023-12-26 13:54:41,882][123090] Updated weights for policy 1, policy_version 1781000 (0.0009) [2023-12-26 13:54:41,947][123090] Updated weights for policy 1, policy_version 1781010 (0.0010) [2023-12-26 13:54:42,015][123090] Updated weights for policy 1, policy_version 1781020 (0.0010) [2023-12-26 13:54:42,601][123091] Updated weights for policy 0, policy_version 1792849 (0.0009) [2023-12-26 13:54:42,661][123091] Updated weights for policy 0, policy_version 1792859 (0.0008) [2023-12-26 13:54:42,730][123091] Updated weights for policy 0, policy_version 1792869 (0.0006) [2023-12-26 13:54:42,795][123091] Updated weights for policy 0, policy_version 1792879 (0.0006) [2023-12-26 13:54:42,881][123090] Updated weights for policy 1, policy_version 1781030 (0.0009) [2023-12-26 13:54:42,960][123090] Updated weights for policy 1, policy_version 1781040 (0.0010) [2023-12-26 13:54:43,029][123090] Updated weights for policy 1, policy_version 1781050 (0.0010) [2023-12-26 13:54:43,562][123091] Updated weights for policy 0, policy_version 1792889 (0.0010) [2023-12-26 13:54:43,629][123091] Updated weights for policy 0, policy_version 1792899 (0.0009) [2023-12-26 13:54:43,706][123091] Updated weights for policy 0, policy_version 1792909 (0.0009) [2023-12-26 13:54:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 914939904. Throughput: 0: 8659.7, 1: 8955.2. Samples: 914932952. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:43,784][121949] Avg episode reward: [(0, '6238.478'), (1, '5967.288')] [2023-12-26 13:54:43,812][123090] Updated weights for policy 1, policy_version 1781060 (0.0008) [2023-12-26 13:54:43,869][123090] Updated weights for policy 1, policy_version 1781070 (0.0006) [2023-12-26 13:54:43,933][123090] Updated weights for policy 1, policy_version 1781080 (0.0005) [2023-12-26 13:54:44,525][123091] Updated weights for policy 0, policy_version 1792919 (0.0008) [2023-12-26 13:54:44,573][123091] Updated weights for policy 0, policy_version 1792929 (0.0009) [2023-12-26 13:54:44,629][123091] Updated weights for policy 0, policy_version 1792939 (0.0009) [2023-12-26 13:54:44,705][123090] Updated weights for policy 1, policy_version 1781090 (0.0007) [2023-12-26 13:54:44,769][123090] Updated weights for policy 1, policy_version 1781100 (0.0010) [2023-12-26 13:54:44,829][123090] Updated weights for policy 1, policy_version 1781110 (0.0006) [2023-12-26 13:54:44,895][123090] Updated weights for policy 1, policy_version 1781120 (0.0006) [2023-12-26 13:54:45,512][123091] Updated weights for policy 0, policy_version 1792949 (0.0008) [2023-12-26 13:54:45,575][123091] Updated weights for policy 0, policy_version 1792959 (0.0007) [2023-12-26 13:54:45,635][123090] Updated weights for policy 1, policy_version 1781130 (0.0006) [2023-12-26 13:54:45,640][123091] Updated weights for policy 0, policy_version 1792969 (0.0010) [2023-12-26 13:54:45,696][123090] Updated weights for policy 1, policy_version 1781140 (0.0006) [2023-12-26 13:54:45,756][123090] Updated weights for policy 1, policy_version 1781150 (0.0006) [2023-12-26 13:54:46,294][123090] Updated weights for policy 1, policy_version 1781160 (0.0005) [2023-12-26 13:54:46,371][123090] Updated weights for policy 1, policy_version 1781170 (0.0005) [2023-12-26 13:54:46,439][123090] Updated weights for policy 1, policy_version 1781180 (0.0005) [2023-12-26 13:54:46,478][123091] Updated weights for policy 0, policy_version 1792979 (0.0009) [2023-12-26 13:54:46,531][123091] Updated weights for policy 0, policy_version 1792989 (0.0010) [2023-12-26 13:54:46,593][123091] Updated weights for policy 0, policy_version 1792999 (0.0010) [2023-12-26 13:54:47,063][123090] Updated weights for policy 1, policy_version 1781190 (0.0008) [2023-12-26 13:54:47,114][123090] Updated weights for policy 1, policy_version 1781200 (0.0010) [2023-12-26 13:54:47,176][123090] Updated weights for policy 1, policy_version 1781210 (0.0010) [2023-12-26 13:54:47,498][123091] Updated weights for policy 0, policy_version 1793009 (0.0009) [2023-12-26 13:54:47,556][123091] Updated weights for policy 0, policy_version 1793019 (0.0009) [2023-12-26 13:54:47,614][123091] Updated weights for policy 0, policy_version 1793029 (0.0010) [2023-12-26 13:54:47,672][123091] Updated weights for policy 0, policy_version 1793039 (0.0010) [2023-12-26 13:54:47,898][123090] Updated weights for policy 1, policy_version 1781220 (0.0008) [2023-12-26 13:54:47,958][123090] Updated weights for policy 1, policy_version 1781230 (0.0006) [2023-12-26 13:54:48,023][123090] Updated weights for policy 1, policy_version 1781240 (0.0006) [2023-12-26 13:54:48,638][123091] Updated weights for policy 0, policy_version 1793049 (0.0010) [2023-12-26 13:54:48,703][123091] Updated weights for policy 0, policy_version 1793059 (0.0009) [2023-12-26 13:54:48,736][123090] Updated weights for policy 1, policy_version 1781250 (0.0010) [2023-12-26 13:54:48,764][123091] Updated weights for policy 0, policy_version 1793069 (0.0007) [2023-12-26 13:54:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 915030016. Throughput: 0: 8624.8, 1: 9133.1. Samples: 915041528. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:48,784][121949] Avg episode reward: [(0, '6213.998'), (1, '5880.965')] [2023-12-26 13:54:48,806][123090] Updated weights for policy 1, policy_version 1781260 (0.0008) [2023-12-26 13:54:48,872][123090] Updated weights for policy 1, policy_version 1781270 (0.0008) [2023-12-26 13:54:48,942][123090] Updated weights for policy 1, policy_version 1781280 (0.0007) [2023-12-26 13:54:49,610][123091] Updated weights for policy 0, policy_version 1793079 (0.0006) [2023-12-26 13:54:49,660][123091] Updated weights for policy 0, policy_version 1793089 (0.0005) [2023-12-26 13:54:49,677][123090] Updated weights for policy 1, policy_version 1781290 (0.0008) [2023-12-26 13:54:49,721][123091] Updated weights for policy 0, policy_version 1793099 (0.0005) [2023-12-26 13:54:49,741][123090] Updated weights for policy 1, policy_version 1781300 (0.0009) [2023-12-26 13:54:49,790][123090] Updated weights for policy 1, policy_version 1781310 (0.0009) [2023-12-26 13:54:50,512][123091] Updated weights for policy 0, policy_version 1793109 (0.0008) [2023-12-26 13:54:50,571][123091] Updated weights for policy 0, policy_version 1793119 (0.0009) [2023-12-26 13:54:50,638][123091] Updated weights for policy 0, policy_version 1793129 (0.0008) [2023-12-26 13:54:50,657][123090] Updated weights for policy 1, policy_version 1781320 (0.0010) [2023-12-26 13:54:50,730][123090] Updated weights for policy 1, policy_version 1781330 (0.0011) [2023-12-26 13:54:50,795][123090] Updated weights for policy 1, policy_version 1781340 (0.0011) [2023-12-26 13:54:51,452][123091] Updated weights for policy 0, policy_version 1793139 (0.0007) [2023-12-26 13:54:51,518][123091] Updated weights for policy 0, policy_version 1793149 (0.0011) [2023-12-26 13:54:51,582][123091] Updated weights for policy 0, policy_version 1793159 (0.0011) [2023-12-26 13:54:51,657][123090] Updated weights for policy 1, policy_version 1781351 (0.0009) [2023-12-26 13:54:51,726][123090] Updated weights for policy 1, policy_version 1781361 (0.0009) [2023-12-26 13:54:51,791][123090] Updated weights for policy 1, policy_version 1781371 (0.0009) [2023-12-26 13:54:52,353][123091] Updated weights for policy 0, policy_version 1793169 (0.0010) [2023-12-26 13:54:52,413][123091] Updated weights for policy 0, policy_version 1793179 (0.0010) [2023-12-26 13:54:52,477][123091] Updated weights for policy 0, policy_version 1793189 (0.0010) [2023-12-26 13:54:52,534][123091] Updated weights for policy 0, policy_version 1793199 (0.0010) [2023-12-26 13:54:52,626][123090] Updated weights for policy 1, policy_version 1781381 (0.0008) [2023-12-26 13:54:52,680][123090] Updated weights for policy 1, policy_version 1781391 (0.0009) [2023-12-26 13:54:52,737][123090] Updated weights for policy 1, policy_version 1781401 (0.0009) [2023-12-26 13:54:53,382][123091] Updated weights for policy 0, policy_version 1793209 (0.0010) [2023-12-26 13:54:53,429][123091] Updated weights for policy 0, policy_version 1793219 (0.0010) [2023-12-26 13:54:53,477][123091] Updated weights for policy 0, policy_version 1793229 (0.0010) [2023-12-26 13:54:53,542][123090] Updated weights for policy 1, policy_version 1781411 (0.0008) [2023-12-26 13:54:53,588][123090] Updated weights for policy 1, policy_version 1781421 (0.0005) [2023-12-26 13:54:53,640][123090] Updated weights for policy 1, policy_version 1781431 (0.0005) [2023-12-26 13:54:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17828.1). Total num frames: 915120128. Throughput: 0: 8608.4, 1: 9145.8. Samples: 915092564. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:53,785][121949] Avg episode reward: [(0, '6199.344'), (1, '5700.490')] [2023-12-26 13:54:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001793232_459071488.pth... [2023-12-26 13:54:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001781440_456048640.pth... [2023-12-26 13:54:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001780352_455770112.pth [2023-12-26 13:54:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001792240_458817536.pth [2023-12-26 13:54:54,278][123091] Updated weights for policy 0, policy_version 1793239 (0.0007) [2023-12-26 13:54:54,281][123090] Updated weights for policy 1, policy_version 1781441 (0.0005) [2023-12-26 13:54:54,344][123091] Updated weights for policy 0, policy_version 1793249 (0.0007) [2023-12-26 13:54:54,347][123090] Updated weights for policy 1, policy_version 1781451 (0.0006) [2023-12-26 13:54:54,402][123091] Updated weights for policy 0, policy_version 1793259 (0.0008) [2023-12-26 13:54:54,419][123090] Updated weights for policy 1, policy_version 1781461 (0.0005) [2023-12-26 13:54:54,491][123090] Updated weights for policy 1, policy_version 1781471 (0.0007) [2023-12-26 13:54:55,233][123091] Updated weights for policy 0, policy_version 1793269 (0.0007) [2023-12-26 13:54:55,280][123090] Updated weights for policy 1, policy_version 1781481 (0.0006) [2023-12-26 13:54:55,315][123091] Updated weights for policy 0, policy_version 1793279 (0.0006) [2023-12-26 13:54:55,347][123090] Updated weights for policy 1, policy_version 1781491 (0.0008) [2023-12-26 13:54:55,370][123091] Updated weights for policy 0, policy_version 1793289 (0.0006) [2023-12-26 13:54:55,410][123090] Updated weights for policy 1, policy_version 1781501 (0.0010) [2023-12-26 13:54:56,038][123091] Updated weights for policy 0, policy_version 1793299 (0.0007) [2023-12-26 13:54:56,081][123090] Updated weights for policy 1, policy_version 1781511 (0.0007) [2023-12-26 13:54:56,100][123091] Updated weights for policy 0, policy_version 1793310 (0.0009) [2023-12-26 13:54:56,141][123090] Updated weights for policy 1, policy_version 1781521 (0.0005) [2023-12-26 13:54:56,153][123091] Updated weights for policy 0, policy_version 1793320 (0.0009) [2023-12-26 13:54:56,207][123090] Updated weights for policy 1, policy_version 1781531 (0.0005) [2023-12-26 13:54:56,937][123090] Updated weights for policy 1, policy_version 1781541 (0.0007) [2023-12-26 13:54:56,991][123091] Updated weights for policy 0, policy_version 1793330 (0.0008) [2023-12-26 13:54:56,996][123090] Updated weights for policy 1, policy_version 1781551 (0.0005) [2023-12-26 13:54:57,063][123091] Updated weights for policy 0, policy_version 1793340 (0.0005) [2023-12-26 13:54:57,067][123090] Updated weights for policy 1, policy_version 1781561 (0.0006) [2023-12-26 13:54:57,125][123091] Updated weights for policy 0, policy_version 1793350 (0.0009) [2023-12-26 13:54:57,180][123091] Updated weights for policy 0, policy_version 1793360 (0.0010) [2023-12-26 13:54:57,790][123090] Updated weights for policy 1, policy_version 1781571 (0.0008) [2023-12-26 13:54:57,877][123090] Updated weights for policy 1, policy_version 1781581 (0.0005) [2023-12-26 13:54:57,916][123091] Updated weights for policy 0, policy_version 1793370 (0.0006) [2023-12-26 13:54:57,926][123090] Updated weights for policy 1, policy_version 1781591 (0.0005) [2023-12-26 13:54:57,977][123091] Updated weights for policy 0, policy_version 1793380 (0.0009) [2023-12-26 13:54:58,043][123091] Updated weights for policy 0, policy_version 1793390 (0.0010) [2023-12-26 13:54:58,684][123090] Updated weights for policy 1, policy_version 1781601 (0.0006) [2023-12-26 13:54:58,753][123090] Updated weights for policy 1, policy_version 1781611 (0.0010) [2023-12-26 13:54:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 915202048. Throughput: 0: 8698.6, 1: 9203.5. Samples: 915202088. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:54:58,785][121949] Avg episode reward: [(0, '6248.800'), (1, '5650.291')] [2023-12-26 13:54:58,819][123090] Updated weights for policy 1, policy_version 1781621 (0.0009) [2023-12-26 13:54:58,843][123091] Updated weights for policy 0, policy_version 1793400 (0.0009) [2023-12-26 13:54:58,893][123090] Updated weights for policy 1, policy_version 1781631 (0.0010) [2023-12-26 13:54:58,905][123091] Updated weights for policy 0, policy_version 1793410 (0.0007) [2023-12-26 13:54:58,965][123091] Updated weights for policy 0, policy_version 1793420 (0.0009) [2023-12-26 13:54:59,687][123091] Updated weights for policy 0, policy_version 1793430 (0.0007) [2023-12-26 13:54:59,744][123091] Updated weights for policy 0, policy_version 1793440 (0.0005) [2023-12-26 13:54:59,767][123090] Updated weights for policy 1, policy_version 1781641 (0.0009) [2023-12-26 13:54:59,802][123091] Updated weights for policy 0, policy_version 1793450 (0.0006) [2023-12-26 13:54:59,821][123090] Updated weights for policy 1, policy_version 1781651 (0.0008) [2023-12-26 13:54:59,885][123090] Updated weights for policy 1, policy_version 1781661 (0.0008) [2023-12-26 13:55:00,574][123091] Updated weights for policy 0, policy_version 1793460 (0.0008) [2023-12-26 13:55:00,635][123091] Updated weights for policy 0, policy_version 1793470 (0.0009) [2023-12-26 13:55:00,663][123090] Updated weights for policy 1, policy_version 1781671 (0.0007) [2023-12-26 13:55:00,701][123091] Updated weights for policy 0, policy_version 1793480 (0.0010) [2023-12-26 13:55:00,728][123090] Updated weights for policy 1, policy_version 1781681 (0.0006) [2023-12-26 13:55:00,792][123090] Updated weights for policy 1, policy_version 1781691 (0.0006) [2023-12-26 13:55:01,508][123091] Updated weights for policy 0, policy_version 1793490 (0.0010) [2023-12-26 13:55:01,569][123091] Updated weights for policy 0, policy_version 1793500 (0.0008) [2023-12-26 13:55:01,637][123091] Updated weights for policy 0, policy_version 1793510 (0.0008) [2023-12-26 13:55:01,682][123090] Updated weights for policy 1, policy_version 1781701 (0.0008) [2023-12-26 13:55:01,709][123091] Updated weights for policy 0, policy_version 1793520 (0.0008) [2023-12-26 13:55:01,761][123090] Updated weights for policy 1, policy_version 1781711 (0.0009) [2023-12-26 13:55:01,833][123090] Updated weights for policy 1, policy_version 1781721 (0.0009) [2023-12-26 13:55:02,446][123091] Updated weights for policy 0, policy_version 1793530 (0.0005) [2023-12-26 13:55:02,507][123091] Updated weights for policy 0, policy_version 1793540 (0.0006) [2023-12-26 13:55:02,566][123091] Updated weights for policy 0, policy_version 1793550 (0.0006) [2023-12-26 13:55:02,657][123090] Updated weights for policy 1, policy_version 1781731 (0.0010) [2023-12-26 13:55:02,725][123090] Updated weights for policy 1, policy_version 1781741 (0.0011) [2023-12-26 13:55:02,795][123090] Updated weights for policy 1, policy_version 1781751 (0.0008) [2023-12-26 13:55:03,386][123090] Updated weights for policy 1, policy_version 1781761 (0.0005) [2023-12-26 13:55:03,395][123091] Updated weights for policy 0, policy_version 1793560 (0.0009) [2023-12-26 13:55:03,447][123090] Updated weights for policy 1, policy_version 1781771 (0.0009) [2023-12-26 13:55:03,451][123091] Updated weights for policy 0, policy_version 1793570 (0.0007) [2023-12-26 13:55:03,509][123091] Updated weights for policy 0, policy_version 1793580 (0.0009) [2023-12-26 13:55:03,513][123090] Updated weights for policy 1, policy_version 1781781 (0.0005) [2023-12-26 13:55:03,568][123090] Updated weights for policy 1, policy_version 1781791 (0.0009) [2023-12-26 13:55:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 915300352. Throughput: 0: 8657.8, 1: 9135.4. Samples: 915307804. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:03,785][121949] Avg episode reward: [(0, '6166.098'), (1, '5682.500')] [2023-12-26 13:55:04,291][123090] Updated weights for policy 1, policy_version 1781801 (0.0010) [2023-12-26 13:55:04,351][123090] Updated weights for policy 1, policy_version 1781811 (0.0010) [2023-12-26 13:55:04,375][123091] Updated weights for policy 0, policy_version 1793590 (0.0007) [2023-12-26 13:55:04,415][123090] Updated weights for policy 1, policy_version 1781821 (0.0011) [2023-12-26 13:55:04,435][123091] Updated weights for policy 0, policy_version 1793600 (0.0006) [2023-12-26 13:55:04,497][123091] Updated weights for policy 0, policy_version 1793610 (0.0009) [2023-12-26 13:55:05,181][123090] Updated weights for policy 1, policy_version 1781831 (0.0010) [2023-12-26 13:55:05,240][123090] Updated weights for policy 1, policy_version 1781841 (0.0010) [2023-12-26 13:55:05,284][123091] Updated weights for policy 0, policy_version 1793620 (0.0007) [2023-12-26 13:55:05,299][123090] Updated weights for policy 1, policy_version 1781851 (0.0010) [2023-12-26 13:55:05,332][123091] Updated weights for policy 0, policy_version 1793630 (0.0005) [2023-12-26 13:55:05,378][123091] Updated weights for policy 0, policy_version 1793640 (0.0008) [2023-12-26 13:55:06,050][123090] Updated weights for policy 1, policy_version 1781861 (0.0008) [2023-12-26 13:55:06,109][123091] Updated weights for policy 0, policy_version 1793650 (0.0006) [2023-12-26 13:55:06,116][123090] Updated weights for policy 1, policy_version 1781871 (0.0006) [2023-12-26 13:55:06,163][123091] Updated weights for policy 0, policy_version 1793660 (0.0007) [2023-12-26 13:55:06,179][123090] Updated weights for policy 1, policy_version 1781881 (0.0008) [2023-12-26 13:55:06,227][123091] Updated weights for policy 0, policy_version 1793670 (0.0008) [2023-12-26 13:55:06,297][123091] Updated weights for policy 0, policy_version 1793680 (0.0011) [2023-12-26 13:55:06,969][123090] Updated weights for policy 1, policy_version 1781891 (0.0009) [2023-12-26 13:55:07,039][123090] Updated weights for policy 1, policy_version 1781901 (0.0010) [2023-12-26 13:55:07,082][123091] Updated weights for policy 0, policy_version 1793690 (0.0010) [2023-12-26 13:55:07,099][123090] Updated weights for policy 1, policy_version 1781911 (0.0010) [2023-12-26 13:55:07,147][123091] Updated weights for policy 0, policy_version 1793700 (0.0010) [2023-12-26 13:55:07,216][123091] Updated weights for policy 0, policy_version 1793710 (0.0010) [2023-12-26 13:55:07,916][123090] Updated weights for policy 1, policy_version 1781921 (0.0010) [2023-12-26 13:55:07,974][123090] Updated weights for policy 1, policy_version 1781931 (0.0010) [2023-12-26 13:55:08,016][123091] Updated weights for policy 0, policy_version 1793720 (0.0009) [2023-12-26 13:55:08,037][123090] Updated weights for policy 1, policy_version 1781941 (0.0010) [2023-12-26 13:55:08,069][123091] Updated weights for policy 0, policy_version 1793730 (0.0009) [2023-12-26 13:55:08,092][123090] Updated weights for policy 1, policy_version 1781951 (0.0010) [2023-12-26 13:55:08,115][123091] Updated weights for policy 0, policy_version 1793740 (0.0008) [2023-12-26 13:55:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 915382272. Throughput: 0: 8718.2, 1: 9176.0. Samples: 915363820. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:08,785][121949] Avg episode reward: [(0, '6068.811'), (1, '5665.982')] [2023-12-26 13:55:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001781952_456179712.pth... [2023-12-26 13:55:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001793744_459202560.pth... [2023-12-26 13:55:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001780896_455909376.pth [2023-12-26 13:55:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001792752_458948608.pth [2023-12-26 13:55:08,898][123091] Updated weights for policy 0, policy_version 1793750 (0.0010) [2023-12-26 13:55:08,918][123090] Updated weights for policy 1, policy_version 1781961 (0.0011) [2023-12-26 13:55:08,965][123091] Updated weights for policy 0, policy_version 1793760 (0.0010) [2023-12-26 13:55:08,986][123090] Updated weights for policy 1, policy_version 1781971 (0.0011) [2023-12-26 13:55:09,021][123091] Updated weights for policy 0, policy_version 1793770 (0.0010) [2023-12-26 13:55:09,038][123090] Updated weights for policy 1, policy_version 1781981 (0.0010) [2023-12-26 13:55:09,837][123091] Updated weights for policy 0, policy_version 1793780 (0.0010) [2023-12-26 13:55:09,905][123091] Updated weights for policy 0, policy_version 1793790 (0.0008) [2023-12-26 13:55:09,912][123090] Updated weights for policy 1, policy_version 1781991 (0.0010) [2023-12-26 13:55:09,976][123090] Updated weights for policy 1, policy_version 1782001 (0.0009) [2023-12-26 13:55:09,981][123091] Updated weights for policy 0, policy_version 1793800 (0.0007) [2023-12-26 13:55:10,035][123090] Updated weights for policy 1, policy_version 1782011 (0.0007) [2023-12-26 13:55:10,783][123091] Updated weights for policy 0, policy_version 1793810 (0.0010) [2023-12-26 13:55:10,834][123091] Updated weights for policy 0, policy_version 1793820 (0.0009) [2023-12-26 13:55:10,887][123091] Updated weights for policy 0, policy_version 1793830 (0.0009) [2023-12-26 13:55:10,889][123090] Updated weights for policy 1, policy_version 1782021 (0.0008) [2023-12-26 13:55:10,949][123091] Updated weights for policy 0, policy_version 1793840 (0.0009) [2023-12-26 13:55:10,960][123090] Updated weights for policy 1, policy_version 1782031 (0.0007) [2023-12-26 13:55:11,035][123090] Updated weights for policy 1, policy_version 1782041 (0.0007) [2023-12-26 13:55:11,838][123091] Updated weights for policy 0, policy_version 1793850 (0.0009) [2023-12-26 13:55:11,854][123090] Updated weights for policy 1, policy_version 1782051 (0.0010) [2023-12-26 13:55:11,890][123091] Updated weights for policy 0, policy_version 1793860 (0.0008) [2023-12-26 13:55:11,921][123090] Updated weights for policy 1, policy_version 1782061 (0.0009) [2023-12-26 13:55:11,944][123091] Updated weights for policy 0, policy_version 1793870 (0.0005) [2023-12-26 13:55:11,976][123090] Updated weights for policy 1, policy_version 1782071 (0.0009) [2023-12-26 13:55:12,751][123091] Updated weights for policy 0, policy_version 1793880 (0.0008) [2023-12-26 13:55:12,821][123091] Updated weights for policy 0, policy_version 1793890 (0.0010) [2023-12-26 13:55:12,846][123090] Updated weights for policy 1, policy_version 1782081 (0.0008) [2023-12-26 13:55:12,883][123091] Updated weights for policy 0, policy_version 1793900 (0.0008) [2023-12-26 13:55:12,898][123090] Updated weights for policy 1, policy_version 1782091 (0.0008) [2023-12-26 13:55:12,953][123090] Updated weights for policy 1, policy_version 1782102 (0.0010) [2023-12-26 13:55:13,001][123090] Updated weights for policy 1, policy_version 1782112 (0.0009) [2023-12-26 13:55:13,724][123091] Updated weights for policy 0, policy_version 1793910 (0.0008) [2023-12-26 13:55:13,779][123091] Updated weights for policy 0, policy_version 1793920 (0.0009) [2023-12-26 13:55:13,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 915464192. Throughput: 0: 8600.6, 1: 9067.2. Samples: 915465476. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:13,785][121949] Avg episode reward: [(0, '6148.625'), (1, '5715.418')] [2023-12-26 13:55:13,799][123090] Updated weights for policy 1, policy_version 1782122 (0.0006) [2023-12-26 13:55:13,829][123091] Updated weights for policy 0, policy_version 1793930 (0.0008) [2023-12-26 13:55:13,856][123090] Updated weights for policy 1, policy_version 1782132 (0.0010) [2023-12-26 13:55:13,924][123090] Updated weights for policy 1, policy_version 1782142 (0.0005) [2023-12-26 13:55:14,548][123090] Updated weights for policy 1, policy_version 1782152 (0.0005) [2023-12-26 13:55:14,612][123090] Updated weights for policy 1, policy_version 1782162 (0.0006) [2023-12-26 13:55:14,683][123090] Updated weights for policy 1, policy_version 1782172 (0.0008) [2023-12-26 13:55:14,732][123091] Updated weights for policy 0, policy_version 1793940 (0.0009) [2023-12-26 13:55:14,801][123091] Updated weights for policy 0, policy_version 1793950 (0.0009) [2023-12-26 13:55:14,863][123091] Updated weights for policy 0, policy_version 1793960 (0.0010) [2023-12-26 13:55:15,381][123090] Updated weights for policy 1, policy_version 1782182 (0.0008) [2023-12-26 13:55:15,445][123090] Updated weights for policy 1, policy_version 1782192 (0.0010) [2023-12-26 13:55:15,516][123090] Updated weights for policy 1, policy_version 1782202 (0.0010) [2023-12-26 13:55:15,765][123091] Updated weights for policy 0, policy_version 1793970 (0.0009) [2023-12-26 13:55:15,830][123091] Updated weights for policy 0, policy_version 1793980 (0.0010) [2023-12-26 13:55:15,883][123091] Updated weights for policy 0, policy_version 1793991 (0.0009) [2023-12-26 13:55:16,232][123090] Updated weights for policy 1, policy_version 1782212 (0.0009) [2023-12-26 13:55:16,278][123090] Updated weights for policy 1, policy_version 1782222 (0.0005) [2023-12-26 13:55:16,327][123090] Updated weights for policy 1, policy_version 1782232 (0.0005) [2023-12-26 13:55:16,812][123091] Updated weights for policy 0, policy_version 1794001 (0.0009) [2023-12-26 13:55:16,875][123091] Updated weights for policy 0, policy_version 1794011 (0.0009) [2023-12-26 13:55:16,936][123091] Updated weights for policy 0, policy_version 1794021 (0.0009) [2023-12-26 13:55:16,997][123091] Updated weights for policy 0, policy_version 1794031 (0.0010) [2023-12-26 13:55:17,035][123090] Updated weights for policy 1, policy_version 1782242 (0.0005) [2023-12-26 13:55:17,098][123090] Updated weights for policy 1, policy_version 1782252 (0.0008) [2023-12-26 13:55:17,172][123090] Updated weights for policy 1, policy_version 1782262 (0.0006) [2023-12-26 13:55:17,243][123090] Updated weights for policy 1, policy_version 1782272 (0.0006) [2023-12-26 13:55:17,842][123091] Updated weights for policy 0, policy_version 1794041 (0.0010) [2023-12-26 13:55:17,899][123091] Updated weights for policy 0, policy_version 1794051 (0.0008) [2023-12-26 13:55:17,963][123091] Updated weights for policy 0, policy_version 1794061 (0.0011) [2023-12-26 13:55:17,980][123090] Updated weights for policy 1, policy_version 1782282 (0.0007) [2023-12-26 13:55:18,045][123090] Updated weights for policy 1, policy_version 1782292 (0.0007) [2023-12-26 13:55:18,116][123090] Updated weights for policy 1, policy_version 1782302 (0.0009) [2023-12-26 13:55:18,743][123090] Updated weights for policy 1, policy_version 1782312 (0.0005) [2023-12-26 13:55:18,776][123091] Updated weights for policy 0, policy_version 1794071 (0.0010) [2023-12-26 13:55:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 915554304. Throughput: 0: 8529.7, 1: 9136.3. Samples: 915572872. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:18,785][121949] Avg episode reward: [(0, '6261.807'), (1, '5582.479')] [2023-12-26 13:55:18,804][123090] Updated weights for policy 1, policy_version 1782322 (0.0006) [2023-12-26 13:55:18,828][123091] Updated weights for policy 0, policy_version 1794081 (0.0011) [2023-12-26 13:55:18,866][123090] Updated weights for policy 1, policy_version 1782332 (0.0006) [2023-12-26 13:55:18,883][123091] Updated weights for policy 0, policy_version 1794091 (0.0011) [2023-12-26 13:55:19,704][123091] Updated weights for policy 0, policy_version 1794101 (0.0011) [2023-12-26 13:55:19,719][123090] Updated weights for policy 1, policy_version 1782342 (0.0006) [2023-12-26 13:55:19,773][123091] Updated weights for policy 0, policy_version 1794111 (0.0009) [2023-12-26 13:55:19,790][123090] Updated weights for policy 1, policy_version 1782352 (0.0006) [2023-12-26 13:55:19,844][123091] Updated weights for policy 0, policy_version 1794121 (0.0009) [2023-12-26 13:55:19,852][123090] Updated weights for policy 1, policy_version 1782362 (0.0009) [2023-12-26 13:55:20,657][123090] Updated weights for policy 1, policy_version 1782372 (0.0008) [2023-12-26 13:55:20,680][123091] Updated weights for policy 0, policy_version 1794131 (0.0010) [2023-12-26 13:55:20,727][123090] Updated weights for policy 1, policy_version 1782382 (0.0009) [2023-12-26 13:55:20,746][123091] Updated weights for policy 0, policy_version 1794141 (0.0009) [2023-12-26 13:55:20,788][123090] Updated weights for policy 1, policy_version 1782392 (0.0008) [2023-12-26 13:55:20,802][123091] Updated weights for policy 0, policy_version 1794151 (0.0009) [2023-12-26 13:55:21,586][123091] Updated weights for policy 0, policy_version 1794161 (0.0010) [2023-12-26 13:55:21,654][123091] Updated weights for policy 0, policy_version 1794171 (0.0011) [2023-12-26 13:55:21,661][123090] Updated weights for policy 1, policy_version 1782402 (0.0008) [2023-12-26 13:55:21,723][123091] Updated weights for policy 0, policy_version 1794181 (0.0014) [2023-12-26 13:55:21,738][123090] Updated weights for policy 1, policy_version 1782412 (0.0009) [2023-12-26 13:55:21,784][123091] Updated weights for policy 0, policy_version 1794191 (0.0011) [2023-12-26 13:55:21,798][123090] Updated weights for policy 1, policy_version 1782422 (0.0009) [2023-12-26 13:55:21,857][123090] Updated weights for policy 1, policy_version 1782432 (0.0009) [2023-12-26 13:55:22,632][123091] Updated weights for policy 0, policy_version 1794201 (0.0011) [2023-12-26 13:55:22,643][123090] Updated weights for policy 1, policy_version 1782442 (0.0009) [2023-12-26 13:55:22,684][123091] Updated weights for policy 0, policy_version 1794211 (0.0011) [2023-12-26 13:55:22,693][123090] Updated weights for policy 1, policy_version 1782452 (0.0008) [2023-12-26 13:55:22,740][123091] Updated weights for policy 0, policy_version 1794221 (0.0011) [2023-12-26 13:55:22,751][123090] Updated weights for policy 1, policy_version 1782462 (0.0008) [2023-12-26 13:55:23,595][123090] Updated weights for policy 1, policy_version 1782472 (0.0008) [2023-12-26 13:55:23,596][123091] Updated weights for policy 0, policy_version 1794231 (0.0011) [2023-12-26 13:55:23,643][123090] Updated weights for policy 1, policy_version 1782482 (0.0008) [2023-12-26 13:55:23,652][123091] Updated weights for policy 0, policy_version 1794241 (0.0011) [2023-12-26 13:55:23,691][123090] Updated weights for policy 1, policy_version 1782492 (0.0010) [2023-12-26 13:55:23,711][123091] Updated weights for policy 0, policy_version 1794251 (0.0010) [2023-12-26 13:55:23,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 915652608. Throughput: 0: 8557.1, 1: 9035.1. Samples: 915623932. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:23,785][121949] Avg episode reward: [(0, '6204.898'), (1, '5518.795')] [2023-12-26 13:55:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001794256_459333632.pth... [2023-12-26 13:55:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001782496_456318976.pth... [2023-12-26 13:55:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001781440_456048640.pth [2023-12-26 13:55:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001793232_459071488.pth [2023-12-26 13:55:24,544][123091] Updated weights for policy 0, policy_version 1794261 (0.0011) [2023-12-26 13:55:24,559][123090] Updated weights for policy 1, policy_version 1782502 (0.0006) [2023-12-26 13:55:24,599][123091] Updated weights for policy 0, policy_version 1794271 (0.0010) [2023-12-26 13:55:24,616][123090] Updated weights for policy 1, policy_version 1782512 (0.0007) [2023-12-26 13:55:24,660][123091] Updated weights for policy 0, policy_version 1794281 (0.0011) [2023-12-26 13:55:24,670][123090] Updated weights for policy 1, policy_version 1782522 (0.0009) [2023-12-26 13:55:25,494][123091] Updated weights for policy 0, policy_version 1794291 (0.0011) [2023-12-26 13:55:25,521][123090] Updated weights for policy 1, policy_version 1782532 (0.0007) [2023-12-26 13:55:25,553][123091] Updated weights for policy 0, policy_version 1794301 (0.0011) [2023-12-26 13:55:25,583][123090] Updated weights for policy 1, policy_version 1782542 (0.0006) [2023-12-26 13:55:25,612][123091] Updated weights for policy 0, policy_version 1794311 (0.0011) [2023-12-26 13:55:25,648][123090] Updated weights for policy 1, policy_version 1782552 (0.0006) [2023-12-26 13:55:26,423][123091] Updated weights for policy 0, policy_version 1794321 (0.0011) [2023-12-26 13:55:26,459][123090] Updated weights for policy 1, policy_version 1782562 (0.0007) [2023-12-26 13:55:26,482][123091] Updated weights for policy 0, policy_version 1794331 (0.0011) [2023-12-26 13:55:26,519][123090] Updated weights for policy 1, policy_version 1782572 (0.0006) [2023-12-26 13:55:26,533][123091] Updated weights for policy 0, policy_version 1794341 (0.0010) [2023-12-26 13:55:26,581][123091] Updated weights for policy 0, policy_version 1794351 (0.0010) [2023-12-26 13:55:26,583][123090] Updated weights for policy 1, policy_version 1782582 (0.0006) [2023-12-26 13:55:26,637][123090] Updated weights for policy 1, policy_version 1782592 (0.0009) [2023-12-26 13:55:27,427][123091] Updated weights for policy 0, policy_version 1794361 (0.0009) [2023-12-26 13:55:27,462][123090] Updated weights for policy 1, policy_version 1782602 (0.0009) [2023-12-26 13:55:27,472][123091] Updated weights for policy 0, policy_version 1794371 (0.0005) [2023-12-26 13:55:27,512][123090] Updated weights for policy 1, policy_version 1782612 (0.0009) [2023-12-26 13:55:27,516][123091] Updated weights for policy 0, policy_version 1794381 (0.0005) [2023-12-26 13:55:27,564][123090] Updated weights for policy 1, policy_version 1782623 (0.0010) [2023-12-26 13:55:28,231][123091] Updated weights for policy 0, policy_version 1794391 (0.0006) [2023-12-26 13:55:28,292][123091] Updated weights for policy 0, policy_version 1794401 (0.0006) [2023-12-26 13:55:28,343][123091] Updated weights for policy 0, policy_version 1794411 (0.0006) [2023-12-26 13:55:28,376][123090] Updated weights for policy 1, policy_version 1782633 (0.0008) [2023-12-26 13:55:28,435][123090] Updated weights for policy 1, policy_version 1782643 (0.0009) [2023-12-26 13:55:28,490][123090] Updated weights for policy 1, policy_version 1782653 (0.0005) [2023-12-26 13:55:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 915734528. Throughput: 0: 8608.4, 1: 9012.3. Samples: 915725884. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:28,784][121949] Avg episode reward: [(0, '6161.169'), (1, '5811.360')] [2023-12-26 13:55:29,056][123091] Updated weights for policy 0, policy_version 1794421 (0.0007) [2023-12-26 13:55:29,111][123091] Updated weights for policy 0, policy_version 1794431 (0.0010) [2023-12-26 13:55:29,162][123090] Updated weights for policy 1, policy_version 1782663 (0.0007) [2023-12-26 13:55:29,163][123091] Updated weights for policy 0, policy_version 1794441 (0.0009) [2023-12-26 13:55:29,220][123090] Updated weights for policy 1, policy_version 1782673 (0.0006) [2023-12-26 13:55:29,283][123090] Updated weights for policy 1, policy_version 1782683 (0.0008) [2023-12-26 13:55:29,987][123091] Updated weights for policy 0, policy_version 1794451 (0.0009) [2023-12-26 13:55:30,044][123091] Updated weights for policy 0, policy_version 1794461 (0.0009) [2023-12-26 13:55:30,105][123090] Updated weights for policy 1, policy_version 1782693 (0.0009) [2023-12-26 13:55:30,111][123091] Updated weights for policy 0, policy_version 1794471 (0.0009) [2023-12-26 13:55:30,164][123090] Updated weights for policy 1, policy_version 1782703 (0.0008) [2023-12-26 13:55:30,239][123090] Updated weights for policy 1, policy_version 1782713 (0.0009) [2023-12-26 13:55:30,875][123091] Updated weights for policy 0, policy_version 1794481 (0.0008) [2023-12-26 13:55:30,883][123090] Updated weights for policy 1, policy_version 1782723 (0.0007) [2023-12-26 13:55:30,925][123091] Updated weights for policy 0, policy_version 1794491 (0.0010) [2023-12-26 13:55:30,928][123090] Updated weights for policy 1, policy_version 1782733 (0.0008) [2023-12-26 13:55:30,987][123091] Updated weights for policy 0, policy_version 1794501 (0.0010) [2023-12-26 13:55:30,990][123090] Updated weights for policy 1, policy_version 1782743 (0.0006) [2023-12-26 13:55:31,042][123091] Updated weights for policy 0, policy_version 1794511 (0.0010) [2023-12-26 13:55:31,780][123090] Updated weights for policy 1, policy_version 1782753 (0.0007) [2023-12-26 13:55:31,841][123090] Updated weights for policy 1, policy_version 1782763 (0.0009) [2023-12-26 13:55:31,909][123090] Updated weights for policy 1, policy_version 1782773 (0.0010) [2023-12-26 13:55:31,924][123091] Updated weights for policy 0, policy_version 1794521 (0.0007) [2023-12-26 13:55:31,969][123090] Updated weights for policy 1, policy_version 1782783 (0.0009) [2023-12-26 13:55:31,977][123091] Updated weights for policy 0, policy_version 1794531 (0.0007) [2023-12-26 13:55:32,035][123091] Updated weights for policy 0, policy_version 1794541 (0.0009) [2023-12-26 13:55:32,750][123090] Updated weights for policy 1, policy_version 1782793 (0.0006) [2023-12-26 13:55:32,762][123091] Updated weights for policy 0, policy_version 1794551 (0.0007) [2023-12-26 13:55:32,801][123090] Updated weights for policy 1, policy_version 1782803 (0.0005) [2023-12-26 13:55:32,831][123091] Updated weights for policy 0, policy_version 1794561 (0.0005) [2023-12-26 13:55:32,850][123090] Updated weights for policy 1, policy_version 1782813 (0.0007) [2023-12-26 13:55:32,890][123091] Updated weights for policy 0, policy_version 1794571 (0.0006) [2023-12-26 13:55:33,535][123090] Updated weights for policy 1, policy_version 1782823 (0.0007) [2023-12-26 13:55:33,546][123091] Updated weights for policy 0, policy_version 1794581 (0.0006) [2023-12-26 13:55:33,604][123090] Updated weights for policy 1, policy_version 1782833 (0.0005) [2023-12-26 13:55:33,608][123091] Updated weights for policy 0, policy_version 1794591 (0.0005) [2023-12-26 13:55:33,660][123091] Updated weights for policy 0, policy_version 1794601 (0.0005) [2023-12-26 13:55:33,665][123090] Updated weights for policy 1, policy_version 1782843 (0.0005) [2023-12-26 13:55:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 915832832. Throughput: 0: 8742.1, 1: 8963.1. Samples: 915838264. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:33,785][121949] Avg episode reward: [(0, '6203.747'), (1, '5876.266')] [2023-12-26 13:55:34,398][123090] Updated weights for policy 1, policy_version 1782853 (0.0008) [2023-12-26 13:55:34,411][123091] Updated weights for policy 0, policy_version 1794611 (0.0006) [2023-12-26 13:55:34,459][123090] Updated weights for policy 1, policy_version 1782863 (0.0011) [2023-12-26 13:55:34,475][123091] Updated weights for policy 0, policy_version 1794621 (0.0006) [2023-12-26 13:55:34,520][123090] Updated weights for policy 1, policy_version 1782873 (0.0011) [2023-12-26 13:55:34,539][123091] Updated weights for policy 0, policy_version 1794631 (0.0006) [2023-12-26 13:55:35,350][123090] Updated weights for policy 1, policy_version 1782883 (0.0011) [2023-12-26 13:55:35,384][123091] Updated weights for policy 0, policy_version 1794641 (0.0008) [2023-12-26 13:55:35,409][123090] Updated weights for policy 1, policy_version 1782893 (0.0010) [2023-12-26 13:55:35,447][123091] Updated weights for policy 0, policy_version 1794651 (0.0010) [2023-12-26 13:55:35,468][123090] Updated weights for policy 1, policy_version 1782903 (0.0011) [2023-12-26 13:55:35,509][123091] Updated weights for policy 0, policy_version 1794661 (0.0006) [2023-12-26 13:55:35,575][123091] Updated weights for policy 0, policy_version 1794671 (0.0008) [2023-12-26 13:55:36,207][123090] Updated weights for policy 1, policy_version 1782913 (0.0010) [2023-12-26 13:55:36,276][123090] Updated weights for policy 1, policy_version 1782923 (0.0009) [2023-12-26 13:55:36,328][123091] Updated weights for policy 0, policy_version 1794681 (0.0008) [2023-12-26 13:55:36,344][123090] Updated weights for policy 1, policy_version 1782933 (0.0011) [2023-12-26 13:55:36,385][123091] Updated weights for policy 0, policy_version 1794691 (0.0006) [2023-12-26 13:55:36,408][123090] Updated weights for policy 1, policy_version 1782943 (0.0011) [2023-12-26 13:55:36,454][123091] Updated weights for policy 0, policy_version 1794701 (0.0006) [2023-12-26 13:55:37,117][123091] Updated weights for policy 0, policy_version 1794711 (0.0008) [2023-12-26 13:55:37,165][123091] Updated weights for policy 0, policy_version 1794721 (0.0008) [2023-12-26 13:55:37,218][123091] Updated weights for policy 0, policy_version 1794731 (0.0006) [2023-12-26 13:55:37,219][123090] Updated weights for policy 1, policy_version 1782953 (0.0011) [2023-12-26 13:55:37,267][123090] Updated weights for policy 1, policy_version 1782963 (0.0010) [2023-12-26 13:55:37,331][123090] Updated weights for policy 1, policy_version 1782973 (0.0011) [2023-12-26 13:55:38,030][123091] Updated weights for policy 0, policy_version 1794741 (0.0008) [2023-12-26 13:55:38,086][123091] Updated weights for policy 0, policy_version 1794751 (0.0008) [2023-12-26 13:55:38,151][123091] Updated weights for policy 0, policy_version 1794761 (0.0009) [2023-12-26 13:55:38,175][123090] Updated weights for policy 1, policy_version 1782983 (0.0011) [2023-12-26 13:55:38,235][123090] Updated weights for policy 1, policy_version 1782993 (0.0011) [2023-12-26 13:55:38,288][123090] Updated weights for policy 1, policy_version 1783003 (0.0011) [2023-12-26 13:55:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 915914752. Throughput: 0: 8775.8, 1: 8994.5. Samples: 915892224. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:38,785][121949] Avg episode reward: [(0, '6232.597'), (1, '5801.826')] [2023-12-26 13:55:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001783008_456450048.pth... [2023-12-26 13:55:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001794768_459464704.pth... [2023-12-26 13:55:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001781952_456179712.pth [2023-12-26 13:55:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001793744_459202560.pth [2023-12-26 13:55:39,001][123091] Updated weights for policy 0, policy_version 1794771 (0.0007) [2023-12-26 13:55:39,058][123091] Updated weights for policy 0, policy_version 1794781 (0.0010) [2023-12-26 13:55:39,074][123090] Updated weights for policy 1, policy_version 1783013 (0.0008) [2023-12-26 13:55:39,116][123091] Updated weights for policy 0, policy_version 1794791 (0.0009) [2023-12-26 13:55:39,125][123090] Updated weights for policy 1, policy_version 1783023 (0.0010) [2023-12-26 13:55:39,180][123090] Updated weights for policy 1, policy_version 1783033 (0.0010) [2023-12-26 13:55:39,895][123091] Updated weights for policy 0, policy_version 1794801 (0.0006) [2023-12-26 13:55:39,951][123091] Updated weights for policy 0, policy_version 1794811 (0.0009) [2023-12-26 13:55:40,014][123091] Updated weights for policy 0, policy_version 1794821 (0.0010) [2023-12-26 13:55:40,072][123091] Updated weights for policy 0, policy_version 1794831 (0.0009) [2023-12-26 13:55:40,118][123090] Updated weights for policy 1, policy_version 1783043 (0.0010) [2023-12-26 13:55:40,172][123090] Updated weights for policy 1, policy_version 1783053 (0.0009) [2023-12-26 13:55:40,227][123090] Updated weights for policy 1, policy_version 1783063 (0.0009) [2023-12-26 13:55:40,899][123091] Updated weights for policy 0, policy_version 1794841 (0.0009) [2023-12-26 13:55:40,955][123091] Updated weights for policy 0, policy_version 1794851 (0.0009) [2023-12-26 13:55:41,019][123091] Updated weights for policy 0, policy_version 1794861 (0.0009) [2023-12-26 13:55:41,088][123090] Updated weights for policy 1, policy_version 1783073 (0.0009) [2023-12-26 13:55:41,154][123090] Updated weights for policy 1, policy_version 1783083 (0.0009) [2023-12-26 13:55:41,225][123090] Updated weights for policy 1, policy_version 1783093 (0.0008) [2023-12-26 13:55:41,297][123090] Updated weights for policy 1, policy_version 1783103 (0.0010) [2023-12-26 13:55:41,900][123091] Updated weights for policy 0, policy_version 1794871 (0.0007) [2023-12-26 13:55:41,972][123091] Updated weights for policy 0, policy_version 1794881 (0.0008) [2023-12-26 13:55:42,034][123091] Updated weights for policy 0, policy_version 1794891 (0.0010) [2023-12-26 13:55:42,191][123090] Updated weights for policy 1, policy_version 1783113 (0.0008) [2023-12-26 13:55:42,258][123090] Updated weights for policy 1, policy_version 1783123 (0.0009) [2023-12-26 13:55:42,331][123090] Updated weights for policy 1, policy_version 1783133 (0.0010) [2023-12-26 13:55:42,809][123091] Updated weights for policy 0, policy_version 1794901 (0.0008) [2023-12-26 13:55:42,868][123091] Updated weights for policy 0, policy_version 1794911 (0.0008) [2023-12-26 13:55:42,923][123091] Updated weights for policy 0, policy_version 1794921 (0.0008) [2023-12-26 13:55:43,087][123090] Updated weights for policy 1, policy_version 1783143 (0.0009) [2023-12-26 13:55:43,160][123090] Updated weights for policy 1, policy_version 1783153 (0.0010) [2023-12-26 13:55:43,228][123090] Updated weights for policy 1, policy_version 1783163 (0.0007) [2023-12-26 13:55:43,774][123091] Updated weights for policy 0, policy_version 1794931 (0.0010) [2023-12-26 13:55:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 915996672. Throughput: 0: 8754.3, 1: 8867.4. Samples: 915995064. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:43,785][121949] Avg episode reward: [(0, '6145.491'), (1, '5695.986')] [2023-12-26 13:55:43,833][123091] Updated weights for policy 0, policy_version 1794941 (0.0010) [2023-12-26 13:55:43,882][123091] Updated weights for policy 0, policy_version 1794951 (0.0009) [2023-12-26 13:55:43,970][123090] Updated weights for policy 1, policy_version 1783173 (0.0007) [2023-12-26 13:55:44,031][123090] Updated weights for policy 1, policy_version 1783183 (0.0005) [2023-12-26 13:55:44,092][123090] Updated weights for policy 1, policy_version 1783193 (0.0005) [2023-12-26 13:55:44,774][123091] Updated weights for policy 0, policy_version 1794961 (0.0007) [2023-12-26 13:55:44,817][123090] Updated weights for policy 1, policy_version 1783203 (0.0007) [2023-12-26 13:55:44,842][123091] Updated weights for policy 0, policy_version 1794971 (0.0009) [2023-12-26 13:55:44,885][123090] Updated weights for policy 1, policy_version 1783213 (0.0011) [2023-12-26 13:55:44,897][123091] Updated weights for policy 0, policy_version 1794981 (0.0007) [2023-12-26 13:55:44,953][123090] Updated weights for policy 1, policy_version 1783223 (0.0011) [2023-12-26 13:55:44,964][123091] Updated weights for policy 0, policy_version 1794991 (0.0008) [2023-12-26 13:55:45,649][123090] Updated weights for policy 1, policy_version 1783233 (0.0009) [2023-12-26 13:55:45,716][123090] Updated weights for policy 1, policy_version 1783243 (0.0005) [2023-12-26 13:55:45,783][123090] Updated weights for policy 1, policy_version 1783253 (0.0005) [2023-12-26 13:55:45,824][123091] Updated weights for policy 0, policy_version 1795001 (0.0009) [2023-12-26 13:55:45,842][123090] Updated weights for policy 1, policy_version 1783263 (0.0005) [2023-12-26 13:55:45,874][123091] Updated weights for policy 0, policy_version 1795011 (0.0009) [2023-12-26 13:55:45,931][123091] Updated weights for policy 0, policy_version 1795021 (0.0009) [2023-12-26 13:55:46,593][123090] Updated weights for policy 1, policy_version 1783273 (0.0010) [2023-12-26 13:55:46,616][123091] Updated weights for policy 0, policy_version 1795031 (0.0005) [2023-12-26 13:55:46,649][123090] Updated weights for policy 1, policy_version 1783283 (0.0010) [2023-12-26 13:55:46,662][123091] Updated weights for policy 0, policy_version 1795041 (0.0005) [2023-12-26 13:55:46,697][123090] Updated weights for policy 1, policy_version 1783293 (0.0010) [2023-12-26 13:55:46,714][123091] Updated weights for policy 0, policy_version 1795051 (0.0005) [2023-12-26 13:55:47,431][123091] Updated weights for policy 0, policy_version 1795061 (0.0006) [2023-12-26 13:55:47,481][123091] Updated weights for policy 0, policy_version 1795071 (0.0005) [2023-12-26 13:55:47,549][123090] Updated weights for policy 1, policy_version 1783303 (0.0010) [2023-12-26 13:55:47,551][123091] Updated weights for policy 0, policy_version 1795081 (0.0008) [2023-12-26 13:55:47,608][123090] Updated weights for policy 1, policy_version 1783313 (0.0010) [2023-12-26 13:55:47,664][123090] Updated weights for policy 1, policy_version 1783323 (0.0010) [2023-12-26 13:55:48,219][123091] Updated weights for policy 0, policy_version 1795091 (0.0005) [2023-12-26 13:55:48,266][123091] Updated weights for policy 0, policy_version 1795101 (0.0005) [2023-12-26 13:55:48,315][123091] Updated weights for policy 0, policy_version 1795111 (0.0010) [2023-12-26 13:55:48,510][123090] Updated weights for policy 1, policy_version 1783333 (0.0010) [2023-12-26 13:55:48,570][123090] Updated weights for policy 1, policy_version 1783343 (0.0010) [2023-12-26 13:55:48,634][123090] Updated weights for policy 1, policy_version 1783353 (0.0010) [2023-12-26 13:55:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 916094976. Throughput: 0: 8783.3, 1: 8915.3. Samples: 916104236. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:48,785][121949] Avg episode reward: [(0, '6201.532'), (1, '5827.840')] [2023-12-26 13:55:49,069][123091] Updated weights for policy 0, policy_version 1795121 (0.0010) [2023-12-26 13:55:49,120][123091] Updated weights for policy 0, policy_version 1795131 (0.0008) [2023-12-26 13:55:49,165][123091] Updated weights for policy 0, policy_version 1795141 (0.0007) [2023-12-26 13:55:49,216][123091] Updated weights for policy 0, policy_version 1795151 (0.0005) [2023-12-26 13:55:49,456][123090] Updated weights for policy 1, policy_version 1783363 (0.0010) [2023-12-26 13:55:49,516][123090] Updated weights for policy 1, policy_version 1783373 (0.0010) [2023-12-26 13:55:49,583][123090] Updated weights for policy 1, policy_version 1783383 (0.0010) [2023-12-26 13:55:49,927][123091] Updated weights for policy 0, policy_version 1795161 (0.0008) [2023-12-26 13:55:50,000][123091] Updated weights for policy 0, policy_version 1795171 (0.0009) [2023-12-26 13:55:50,061][123091] Updated weights for policy 0, policy_version 1795181 (0.0009) [2023-12-26 13:55:50,354][123090] Updated weights for policy 1, policy_version 1783393 (0.0010) [2023-12-26 13:55:50,409][123090] Updated weights for policy 1, policy_version 1783403 (0.0010) [2023-12-26 13:55:50,480][123090] Updated weights for policy 1, policy_version 1783413 (0.0010) [2023-12-26 13:55:50,544][123090] Updated weights for policy 1, policy_version 1783423 (0.0010) [2023-12-26 13:55:50,799][123091] Updated weights for policy 0, policy_version 1795191 (0.0009) [2023-12-26 13:55:50,864][123091] Updated weights for policy 0, policy_version 1795201 (0.0009) [2023-12-26 13:55:50,933][123091] Updated weights for policy 0, policy_version 1795211 (0.0010) [2023-12-26 13:55:51,349][123090] Updated weights for policy 1, policy_version 1783433 (0.0009) [2023-12-26 13:55:51,416][123090] Updated weights for policy 1, policy_version 1783443 (0.0007) [2023-12-26 13:55:51,490][123090] Updated weights for policy 1, policy_version 1783453 (0.0005) [2023-12-26 13:55:51,758][123091] Updated weights for policy 0, policy_version 1795221 (0.0009) [2023-12-26 13:55:51,823][123091] Updated weights for policy 0, policy_version 1795231 (0.0008) [2023-12-26 13:55:51,881][123091] Updated weights for policy 0, policy_version 1795241 (0.0007) [2023-12-26 13:55:52,223][123090] Updated weights for policy 1, policy_version 1783463 (0.0005) [2023-12-26 13:55:52,289][123090] Updated weights for policy 1, policy_version 1783473 (0.0007) [2023-12-26 13:55:52,347][123090] Updated weights for policy 1, policy_version 1783483 (0.0007) [2023-12-26 13:55:52,666][123091] Updated weights for policy 0, policy_version 1795251 (0.0005) [2023-12-26 13:55:52,732][123091] Updated weights for policy 0, policy_version 1795261 (0.0005) [2023-12-26 13:55:52,795][123091] Updated weights for policy 0, policy_version 1795271 (0.0006) [2023-12-26 13:55:53,157][123090] Updated weights for policy 1, policy_version 1783493 (0.0008) [2023-12-26 13:55:53,226][123090] Updated weights for policy 1, policy_version 1783503 (0.0009) [2023-12-26 13:55:53,293][123090] Updated weights for policy 1, policy_version 1783513 (0.0007) [2023-12-26 13:55:53,479][123091] Updated weights for policy 0, policy_version 1795281 (0.0008) [2023-12-26 13:55:53,546][123091] Updated weights for policy 0, policy_version 1795291 (0.0010) [2023-12-26 13:55:53,609][123091] Updated weights for policy 0, policy_version 1795301 (0.0011) [2023-12-26 13:55:53,672][123091] Updated weights for policy 0, policy_version 1795311 (0.0010) [2023-12-26 13:55:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 916185088. Throughput: 0: 8790.8, 1: 8856.5. Samples: 916157952. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:53,785][121949] Avg episode reward: [(0, '6103.210'), (1, '5972.794')] [2023-12-26 13:55:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001783520_456581120.pth... [2023-12-26 13:55:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001795312_459603968.pth... [2023-12-26 13:55:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001782496_456318976.pth [2023-12-26 13:55:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001794256_459333632.pth [2023-12-26 13:55:54,069][123090] Updated weights for policy 1, policy_version 1783523 (0.0006) [2023-12-26 13:55:54,132][123090] Updated weights for policy 1, policy_version 1783533 (0.0006) [2023-12-26 13:55:54,201][123090] Updated weights for policy 1, policy_version 1783543 (0.0007) [2023-12-26 13:55:54,437][123091] Updated weights for policy 0, policy_version 1795321 (0.0006) [2023-12-26 13:55:54,490][123091] Updated weights for policy 0, policy_version 1795331 (0.0005) [2023-12-26 13:55:54,557][123091] Updated weights for policy 0, policy_version 1795341 (0.0006) [2023-12-26 13:55:54,901][123090] Updated weights for policy 1, policy_version 1783553 (0.0006) [2023-12-26 13:55:54,980][123090] Updated weights for policy 1, policy_version 1783563 (0.0011) [2023-12-26 13:55:55,036][123090] Updated weights for policy 1, policy_version 1783573 (0.0010) [2023-12-26 13:55:55,092][123090] Updated weights for policy 1, policy_version 1783583 (0.0010) [2023-12-26 13:55:55,285][123091] Updated weights for policy 0, policy_version 1795351 (0.0005) [2023-12-26 13:55:55,333][123091] Updated weights for policy 0, policy_version 1795361 (0.0005) [2023-12-26 13:55:55,378][123091] Updated weights for policy 0, policy_version 1795371 (0.0005) [2023-12-26 13:55:55,871][123090] Updated weights for policy 1, policy_version 1783593 (0.0006) [2023-12-26 13:55:55,943][123090] Updated weights for policy 1, policy_version 1783603 (0.0005) [2023-12-26 13:55:56,021][123090] Updated weights for policy 1, policy_version 1783613 (0.0006) [2023-12-26 13:55:56,069][123091] Updated weights for policy 0, policy_version 1795381 (0.0009) [2023-12-26 13:55:56,121][123091] Updated weights for policy 0, policy_version 1795391 (0.0010) [2023-12-26 13:55:56,176][123091] Updated weights for policy 0, policy_version 1795401 (0.0010) [2023-12-26 13:55:56,737][123090] Updated weights for policy 1, policy_version 1783623 (0.0007) [2023-12-26 13:55:56,788][123090] Updated weights for policy 1, policy_version 1783633 (0.0005) [2023-12-26 13:55:56,853][123090] Updated weights for policy 1, policy_version 1783643 (0.0005) [2023-12-26 13:55:56,854][123091] Updated weights for policy 0, policy_version 1795411 (0.0011) [2023-12-26 13:55:56,909][123091] Updated weights for policy 0, policy_version 1795421 (0.0010) [2023-12-26 13:55:56,963][123091] Updated weights for policy 0, policy_version 1795431 (0.0010) [2023-12-26 13:55:57,487][123090] Updated weights for policy 1, policy_version 1783653 (0.0005) [2023-12-26 13:55:57,547][123090] Updated weights for policy 1, policy_version 1783663 (0.0005) [2023-12-26 13:55:57,606][123090] Updated weights for policy 1, policy_version 1783673 (0.0005) [2023-12-26 13:55:57,764][123091] Updated weights for policy 0, policy_version 1795441 (0.0010) [2023-12-26 13:55:57,818][123091] Updated weights for policy 0, policy_version 1795451 (0.0010) [2023-12-26 13:55:57,870][123091] Updated weights for policy 0, policy_version 1795461 (0.0010) [2023-12-26 13:55:57,917][123091] Updated weights for policy 0, policy_version 1795471 (0.0010) [2023-12-26 13:55:58,220][123090] Updated weights for policy 1, policy_version 1783683 (0.0006) [2023-12-26 13:55:58,278][123090] Updated weights for policy 1, policy_version 1783693 (0.0006) [2023-12-26 13:55:58,369][123090] Updated weights for policy 1, policy_version 1783703 (0.0008) [2023-12-26 13:55:58,776][123091] Updated weights for policy 0, policy_version 1795481 (0.0010) [2023-12-26 13:55:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 916275200. Throughput: 0: 8907.5, 1: 8999.7. Samples: 916271300. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:55:58,785][121949] Avg episode reward: [(0, '6113.583'), (1, '6055.168')] [2023-12-26 13:55:58,849][123091] Updated weights for policy 0, policy_version 1795491 (0.0009) [2023-12-26 13:55:58,918][123091] Updated weights for policy 0, policy_version 1795501 (0.0010) [2023-12-26 13:55:59,161][123090] Updated weights for policy 1, policy_version 1783713 (0.0008) [2023-12-26 13:55:59,236][123090] Updated weights for policy 1, policy_version 1783723 (0.0007) [2023-12-26 13:55:59,319][123090] Updated weights for policy 1, policy_version 1783735 (0.0008) [2023-12-26 13:55:59,811][123091] Updated weights for policy 0, policy_version 1795511 (0.0008) [2023-12-26 13:55:59,877][123091] Updated weights for policy 0, policy_version 1795521 (0.0009) [2023-12-26 13:55:59,950][123091] Updated weights for policy 0, policy_version 1795531 (0.0010) [2023-12-26 13:56:00,168][123090] Updated weights for policy 1, policy_version 1783745 (0.0009) [2023-12-26 13:56:00,224][123090] Updated weights for policy 1, policy_version 1783755 (0.0005) [2023-12-26 13:56:00,272][123090] Updated weights for policy 1, policy_version 1783765 (0.0005) [2023-12-26 13:56:00,327][123090] Updated weights for policy 1, policy_version 1783775 (0.0005) [2023-12-26 13:56:00,763][123091] Updated weights for policy 0, policy_version 1795541 (0.0007) [2023-12-26 13:56:00,832][123091] Updated weights for policy 0, policy_version 1795551 (0.0005) [2023-12-26 13:56:00,904][123091] Updated weights for policy 0, policy_version 1795561 (0.0005) [2023-12-26 13:56:01,006][123090] Updated weights for policy 1, policy_version 1783785 (0.0010) [2023-12-26 13:56:01,072][123090] Updated weights for policy 1, policy_version 1783795 (0.0010) [2023-12-26 13:56:01,145][123090] Updated weights for policy 1, policy_version 1783805 (0.0007) [2023-12-26 13:56:01,621][123091] Updated weights for policy 0, policy_version 1795571 (0.0007) [2023-12-26 13:56:01,696][123091] Updated weights for policy 0, policy_version 1795581 (0.0011) [2023-12-26 13:56:01,768][123091] Updated weights for policy 0, policy_version 1795591 (0.0011) [2023-12-26 13:56:01,887][123090] Updated weights for policy 1, policy_version 1783815 (0.0006) [2023-12-26 13:56:01,939][123090] Updated weights for policy 1, policy_version 1783825 (0.0005) [2023-12-26 13:56:01,988][123090] Updated weights for policy 1, policy_version 1783835 (0.0006) [2023-12-26 13:56:02,464][123091] Updated weights for policy 0, policy_version 1795601 (0.0010) [2023-12-26 13:56:02,529][123091] Updated weights for policy 0, policy_version 1795611 (0.0009) [2023-12-26 13:56:02,591][123091] Updated weights for policy 0, policy_version 1795621 (0.0009) [2023-12-26 13:56:02,651][123091] Updated weights for policy 0, policy_version 1795631 (0.0009) [2023-12-26 13:56:02,804][123090] Updated weights for policy 1, policy_version 1783845 (0.0010) [2023-12-26 13:56:02,863][123090] Updated weights for policy 1, policy_version 1783855 (0.0010) [2023-12-26 13:56:02,925][123090] Updated weights for policy 1, policy_version 1783865 (0.0010) [2023-12-26 13:56:03,381][123091] Updated weights for policy 0, policy_version 1795641 (0.0007) [2023-12-26 13:56:03,446][123091] Updated weights for policy 0, policy_version 1795651 (0.0007) [2023-12-26 13:56:03,504][123091] Updated weights for policy 0, policy_version 1795661 (0.0008) [2023-12-26 13:56:03,752][123090] Updated weights for policy 1, policy_version 1783875 (0.0011) [2023-12-26 13:56:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 916365312. Throughput: 0: 8985.1, 1: 8905.4. Samples: 916377944. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:03,784][121949] Avg episode reward: [(0, '6227.466'), (1, '6013.356')] [2023-12-26 13:56:03,799][123090] Updated weights for policy 1, policy_version 1783885 (0.0010) [2023-12-26 13:56:03,857][123090] Updated weights for policy 1, policy_version 1783895 (0.0010) [2023-12-26 13:56:04,303][123091] Updated weights for policy 0, policy_version 1795671 (0.0010) [2023-12-26 13:56:04,370][123091] Updated weights for policy 0, policy_version 1795681 (0.0011) [2023-12-26 13:56:04,433][123091] Updated weights for policy 0, policy_version 1795691 (0.0011) [2023-12-26 13:56:04,708][123090] Updated weights for policy 1, policy_version 1783905 (0.0008) [2023-12-26 13:56:04,765][123090] Updated weights for policy 1, policy_version 1783915 (0.0009) [2023-12-26 13:56:04,830][123090] Updated weights for policy 1, policy_version 1783925 (0.0007) [2023-12-26 13:56:04,893][123090] Updated weights for policy 1, policy_version 1783935 (0.0007) [2023-12-26 13:56:05,262][123091] Updated weights for policy 0, policy_version 1795701 (0.0011) [2023-12-26 13:56:05,319][123091] Updated weights for policy 0, policy_version 1795711 (0.0010) [2023-12-26 13:56:05,370][123091] Updated weights for policy 0, policy_version 1795721 (0.0008) [2023-12-26 13:56:05,719][123090] Updated weights for policy 1, policy_version 1783945 (0.0011) [2023-12-26 13:56:05,783][123090] Updated weights for policy 1, policy_version 1783955 (0.0011) [2023-12-26 13:56:05,854][123090] Updated weights for policy 1, policy_version 1783965 (0.0010) [2023-12-26 13:56:06,245][123091] Updated weights for policy 0, policy_version 1795731 (0.0009) [2023-12-26 13:56:06,311][123091] Updated weights for policy 0, policy_version 1795741 (0.0008) [2023-12-26 13:56:06,382][123091] Updated weights for policy 0, policy_version 1795751 (0.0009) [2023-12-26 13:56:06,612][123090] Updated weights for policy 1, policy_version 1783975 (0.0007) [2023-12-26 13:56:06,672][123090] Updated weights for policy 1, policy_version 1783985 (0.0007) [2023-12-26 13:56:06,728][123090] Updated weights for policy 1, policy_version 1783995 (0.0011) [2023-12-26 13:56:07,219][123091] Updated weights for policy 0, policy_version 1795761 (0.0008) [2023-12-26 13:56:07,277][123091] Updated weights for policy 0, policy_version 1795771 (0.0006) [2023-12-26 13:56:07,342][123091] Updated weights for policy 0, policy_version 1795781 (0.0008) [2023-12-26 13:56:07,403][123091] Updated weights for policy 0, policy_version 1795791 (0.0008) [2023-12-26 13:56:07,546][123090] Updated weights for policy 1, policy_version 1784005 (0.0008) [2023-12-26 13:56:07,609][123090] Updated weights for policy 1, policy_version 1784015 (0.0005) [2023-12-26 13:56:07,662][123090] Updated weights for policy 1, policy_version 1784025 (0.0006) [2023-12-26 13:56:08,232][123091] Updated weights for policy 0, policy_version 1795801 (0.0006) [2023-12-26 13:56:08,301][123091] Updated weights for policy 0, policy_version 1795811 (0.0005) [2023-12-26 13:56:08,366][123091] Updated weights for policy 0, policy_version 1795821 (0.0009) [2023-12-26 13:56:08,417][123090] Updated weights for policy 1, policy_version 1784035 (0.0007) [2023-12-26 13:56:08,483][123090] Updated weights for policy 1, policy_version 1784045 (0.0008) [2023-12-26 13:56:08,553][123090] Updated weights for policy 1, policy_version 1784055 (0.0007) [2023-12-26 13:56:08,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 916455424. Throughput: 0: 8960.1, 1: 8932.0. Samples: 916429080. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:08,786][121949] Avg episode reward: [(0, '6379.456'), (1, '5870.748')] [2023-12-26 13:56:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001795824_459735040.pth... [2023-12-26 13:56:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001784064_456720384.pth... [2023-12-26 13:56:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001794768_459464704.pth [2023-12-26 13:56:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001783008_456450048.pth [2023-12-26 13:56:09,172][123091] Updated weights for policy 0, policy_version 1795831 (0.0009) [2023-12-26 13:56:09,231][123091] Updated weights for policy 0, policy_version 1795841 (0.0010) [2023-12-26 13:56:09,283][123091] Updated weights for policy 0, policy_version 1795851 (0.0010) [2023-12-26 13:56:09,353][123090] Updated weights for policy 1, policy_version 1784065 (0.0009) [2023-12-26 13:56:09,423][123090] Updated weights for policy 1, policy_version 1784075 (0.0011) [2023-12-26 13:56:09,483][123090] Updated weights for policy 1, policy_version 1784085 (0.0011) [2023-12-26 13:56:09,550][123090] Updated weights for policy 1, policy_version 1784095 (0.0011) [2023-12-26 13:56:10,179][123091] Updated weights for policy 0, policy_version 1795861 (0.0010) [2023-12-26 13:56:10,233][123091] Updated weights for policy 0, policy_version 1795871 (0.0010) [2023-12-26 13:56:10,294][123091] Updated weights for policy 0, policy_version 1795881 (0.0008) [2023-12-26 13:56:10,405][123090] Updated weights for policy 1, policy_version 1784105 (0.0010) [2023-12-26 13:56:10,461][123090] Updated weights for policy 1, policy_version 1784115 (0.0010) [2023-12-26 13:56:10,515][123090] Updated weights for policy 1, policy_version 1784125 (0.0008) [2023-12-26 13:56:11,032][123091] Updated weights for policy 0, policy_version 1795891 (0.0006) [2023-12-26 13:56:11,096][123091] Updated weights for policy 0, policy_version 1795901 (0.0009) [2023-12-26 13:56:11,161][123091] Updated weights for policy 0, policy_version 1795911 (0.0009) [2023-12-26 13:56:11,359][123090] Updated weights for policy 1, policy_version 1784135 (0.0011) [2023-12-26 13:56:11,435][123090] Updated weights for policy 1, policy_version 1784146 (0.0010) [2023-12-26 13:56:11,497][123090] Updated weights for policy 1, policy_version 1784156 (0.0009) [2023-12-26 13:56:11,956][123091] Updated weights for policy 0, policy_version 1795921 (0.0010) [2023-12-26 13:56:12,017][123091] Updated weights for policy 0, policy_version 1795931 (0.0010) [2023-12-26 13:56:12,070][123091] Updated weights for policy 0, policy_version 1795941 (0.0009) [2023-12-26 13:56:12,120][123091] Updated weights for policy 0, policy_version 1795951 (0.0009) [2023-12-26 13:56:12,282][123090] Updated weights for policy 1, policy_version 1784166 (0.0010) [2023-12-26 13:56:12,350][123090] Updated weights for policy 1, policy_version 1784176 (0.0009) [2023-12-26 13:56:12,408][123090] Updated weights for policy 1, policy_version 1784186 (0.0009) [2023-12-26 13:56:12,992][123091] Updated weights for policy 0, policy_version 1795961 (0.0009) [2023-12-26 13:56:13,052][123091] Updated weights for policy 0, policy_version 1795971 (0.0009) [2023-12-26 13:56:13,111][123091] Updated weights for policy 0, policy_version 1795981 (0.0008) [2023-12-26 13:56:13,266][123090] Updated weights for policy 1, policy_version 1784196 (0.0008) [2023-12-26 13:56:13,337][123090] Updated weights for policy 1, policy_version 1784206 (0.0008) [2023-12-26 13:56:13,390][123090] Updated weights for policy 1, policy_version 1784216 (0.0008) [2023-12-26 13:56:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 916537344. Throughput: 0: 8983.2, 1: 8946.5. Samples: 916532720. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:13,785][121949] Avg episode reward: [(0, '6310.960'), (1, '5775.703')] [2023-12-26 13:56:13,824][123091] Updated weights for policy 0, policy_version 1795991 (0.0007) [2023-12-26 13:56:13,887][123091] Updated weights for policy 0, policy_version 1796001 (0.0006) [2023-12-26 13:56:13,952][123091] Updated weights for policy 0, policy_version 1796011 (0.0005) [2023-12-26 13:56:14,238][123090] Updated weights for policy 1, policy_version 1784226 (0.0009) [2023-12-26 13:56:14,298][123090] Updated weights for policy 1, policy_version 1784236 (0.0010) [2023-12-26 13:56:14,353][123090] Updated weights for policy 1, policy_version 1784246 (0.0007) [2023-12-26 13:56:14,414][123090] Updated weights for policy 1, policy_version 1784256 (0.0007) [2023-12-26 13:56:14,610][123091] Updated weights for policy 0, policy_version 1796021 (0.0007) [2023-12-26 13:56:14,662][123091] Updated weights for policy 0, policy_version 1796031 (0.0009) [2023-12-26 13:56:14,705][123091] Updated weights for policy 0, policy_version 1796041 (0.0006) [2023-12-26 13:56:15,206][123090] Updated weights for policy 1, policy_version 1784266 (0.0011) [2023-12-26 13:56:15,272][123090] Updated weights for policy 1, policy_version 1784276 (0.0011) [2023-12-26 13:56:15,337][123090] Updated weights for policy 1, policy_version 1784286 (0.0011) [2023-12-26 13:56:15,488][123091] Updated weights for policy 0, policy_version 1796051 (0.0006) [2023-12-26 13:56:15,541][123091] Updated weights for policy 0, policy_version 1796061 (0.0008) [2023-12-26 13:56:15,593][123091] Updated weights for policy 0, policy_version 1796071 (0.0005) [2023-12-26 13:56:16,176][123090] Updated weights for policy 1, policy_version 1784296 (0.0010) [2023-12-26 13:56:16,231][123090] Updated weights for policy 1, policy_version 1784307 (0.0010) [2023-12-26 13:56:16,250][123091] Updated weights for policy 0, policy_version 1796081 (0.0005) [2023-12-26 13:56:16,285][123090] Updated weights for policy 1, policy_version 1784317 (0.0009) [2023-12-26 13:56:16,301][123091] Updated weights for policy 0, policy_version 1796091 (0.0005) [2023-12-26 13:56:16,358][123091] Updated weights for policy 0, policy_version 1796101 (0.0005) [2023-12-26 13:56:16,434][123091] Updated weights for policy 0, policy_version 1796111 (0.0006) [2023-12-26 13:56:16,972][123090] Updated weights for policy 1, policy_version 1784327 (0.0006) [2023-12-26 13:56:17,019][123090] Updated weights for policy 1, policy_version 1784337 (0.0005) [2023-12-26 13:56:17,079][123090] Updated weights for policy 1, policy_version 1784347 (0.0005) [2023-12-26 13:56:17,086][123091] Updated weights for policy 0, policy_version 1796121 (0.0006) [2023-12-26 13:56:17,131][123091] Updated weights for policy 0, policy_version 1796131 (0.0006) [2023-12-26 13:56:17,182][123091] Updated weights for policy 0, policy_version 1796141 (0.0005) [2023-12-26 13:56:17,757][123090] Updated weights for policy 1, policy_version 1784357 (0.0005) [2023-12-26 13:56:17,821][123090] Updated weights for policy 1, policy_version 1784367 (0.0005) [2023-12-26 13:56:17,877][123091] Updated weights for policy 0, policy_version 1796151 (0.0005) [2023-12-26 13:56:17,886][123090] Updated weights for policy 1, policy_version 1784377 (0.0005) [2023-12-26 13:56:17,928][123091] Updated weights for policy 0, policy_version 1796161 (0.0005) [2023-12-26 13:56:17,977][123091] Updated weights for policy 0, policy_version 1796171 (0.0006) [2023-12-26 13:56:18,542][123090] Updated weights for policy 1, policy_version 1784387 (0.0007) [2023-12-26 13:56:18,596][123090] Updated weights for policy 1, policy_version 1784397 (0.0010) [2023-12-26 13:56:18,657][123090] Updated weights for policy 1, policy_version 1784407 (0.0010) [2023-12-26 13:56:18,688][123091] Updated weights for policy 0, policy_version 1796181 (0.0006) [2023-12-26 13:56:18,749][123091] Updated weights for policy 0, policy_version 1796191 (0.0008) [2023-12-26 13:56:18,784][121949] Fps is (10 sec: 18023.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 916635648. Throughput: 0: 9064.3, 1: 8923.1. Samples: 916647692. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:18,784][121949] Avg episode reward: [(0, '6203.782'), (1, '5925.298')] [2023-12-26 13:56:18,817][123091] Updated weights for policy 0, policy_version 1796201 (0.0009) [2023-12-26 13:56:19,514][123091] Updated weights for policy 0, policy_version 1796211 (0.0007) [2023-12-26 13:56:19,550][123090] Updated weights for policy 1, policy_version 1784417 (0.0009) [2023-12-26 13:56:19,577][123091] Updated weights for policy 0, policy_version 1796221 (0.0010) [2023-12-26 13:56:19,610][123090] Updated weights for policy 1, policy_version 1784427 (0.0011) [2023-12-26 13:56:19,637][123091] Updated weights for policy 0, policy_version 1796231 (0.0011) [2023-12-26 13:56:19,676][123090] Updated weights for policy 1, policy_version 1784437 (0.0011) [2023-12-26 13:56:19,743][123090] Updated weights for policy 1, policy_version 1784447 (0.0011) [2023-12-26 13:56:20,407][123091] Updated weights for policy 0, policy_version 1796241 (0.0010) [2023-12-26 13:56:20,483][123091] Updated weights for policy 0, policy_version 1796251 (0.0008) [2023-12-26 13:56:20,545][123091] Updated weights for policy 0, policy_version 1796261 (0.0009) [2023-12-26 13:56:20,573][123090] Updated weights for policy 1, policy_version 1784457 (0.0009) [2023-12-26 13:56:20,616][123091] Updated weights for policy 0, policy_version 1796271 (0.0007) [2023-12-26 13:56:20,647][123090] Updated weights for policy 1, policy_version 1784467 (0.0007) [2023-12-26 13:56:20,709][123090] Updated weights for policy 1, policy_version 1784477 (0.0009) [2023-12-26 13:56:21,358][123091] Updated weights for policy 0, policy_version 1796281 (0.0010) [2023-12-26 13:56:21,424][123091] Updated weights for policy 0, policy_version 1796291 (0.0009) [2023-12-26 13:56:21,470][123090] Updated weights for policy 1, policy_version 1784487 (0.0008) [2023-12-26 13:56:21,494][123091] Updated weights for policy 0, policy_version 1796301 (0.0006) [2023-12-26 13:56:21,542][123090] Updated weights for policy 1, policy_version 1784497 (0.0006) [2023-12-26 13:56:21,624][123090] Updated weights for policy 1, policy_version 1784507 (0.0006) [2023-12-26 13:56:22,293][123091] Updated weights for policy 0, policy_version 1796311 (0.0009) [2023-12-26 13:56:22,338][123090] Updated weights for policy 1, policy_version 1784517 (0.0008) [2023-12-26 13:56:22,353][123091] Updated weights for policy 0, policy_version 1796321 (0.0011) [2023-12-26 13:56:22,410][123090] Updated weights for policy 1, policy_version 1784527 (0.0007) [2023-12-26 13:56:22,427][123091] Updated weights for policy 0, policy_version 1796332 (0.0008) [2023-12-26 13:56:22,466][123090] Updated weights for policy 1, policy_version 1784537 (0.0008) [2023-12-26 13:56:23,131][123091] Updated weights for policy 0, policy_version 1796342 (0.0006) [2023-12-26 13:56:23,178][123091] Updated weights for policy 0, policy_version 1796352 (0.0005) [2023-12-26 13:56:23,229][123091] Updated weights for policy 0, policy_version 1796362 (0.0009) [2023-12-26 13:56:23,363][123090] Updated weights for policy 1, policy_version 1784547 (0.0008) [2023-12-26 13:56:23,413][123090] Updated weights for policy 1, policy_version 1784557 (0.0005) [2023-12-26 13:56:23,476][123090] Updated weights for policy 1, policy_version 1784567 (0.0005) [2023-12-26 13:56:23,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 916725760. Throughput: 0: 9070.8, 1: 8871.5. Samples: 916699628. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:23,785][121949] Avg episode reward: [(0, '6296.217'), (1, '6018.257')] [2023-12-26 13:56:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001796368_459874304.pth... [2023-12-26 13:56:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001784576_456851456.pth... [2023-12-26 13:56:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001795312_459603968.pth [2023-12-26 13:56:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001783520_456581120.pth [2023-12-26 13:56:24,070][123091] Updated weights for policy 0, policy_version 1796372 (0.0010) [2023-12-26 13:56:24,121][123091] Updated weights for policy 0, policy_version 1796382 (0.0009) [2023-12-26 13:56:24,153][123090] Updated weights for policy 1, policy_version 1784577 (0.0006) [2023-12-26 13:56:24,180][123091] Updated weights for policy 0, policy_version 1796392 (0.0008) [2023-12-26 13:56:24,203][123090] Updated weights for policy 1, policy_version 1784587 (0.0010) [2023-12-26 13:56:24,252][123090] Updated weights for policy 1, policy_version 1784597 (0.0009) [2023-12-26 13:56:24,307][123090] Updated weights for policy 1, policy_version 1784608 (0.0010) [2023-12-26 13:56:25,022][123091] Updated weights for policy 0, policy_version 1796402 (0.0007) [2023-12-26 13:56:25,074][123091] Updated weights for policy 0, policy_version 1796412 (0.0010) [2023-12-26 13:56:25,075][123090] Updated weights for policy 1, policy_version 1784618 (0.0010) [2023-12-26 13:56:25,137][123091] Updated weights for policy 0, policy_version 1796422 (0.0011) [2023-12-26 13:56:25,138][123090] Updated weights for policy 1, policy_version 1784628 (0.0007) [2023-12-26 13:56:25,200][123091] Updated weights for policy 0, policy_version 1796432 (0.0010) [2023-12-26 13:56:25,203][123090] Updated weights for policy 1, policy_version 1784638 (0.0008) [2023-12-26 13:56:25,984][123091] Updated weights for policy 0, policy_version 1796442 (0.0009) [2023-12-26 13:56:26,013][123090] Updated weights for policy 1, policy_version 1784648 (0.0006) [2023-12-26 13:56:26,046][123091] Updated weights for policy 0, policy_version 1796452 (0.0010) [2023-12-26 13:56:26,087][123090] Updated weights for policy 1, policy_version 1784658 (0.0006) [2023-12-26 13:56:26,111][123091] Updated weights for policy 0, policy_version 1796462 (0.0008) [2023-12-26 13:56:26,146][123090] Updated weights for policy 1, policy_version 1784668 (0.0006) [2023-12-26 13:56:26,872][123090] Updated weights for policy 1, policy_version 1784678 (0.0008) [2023-12-26 13:56:26,919][123090] Updated weights for policy 1, policy_version 1784688 (0.0008) [2023-12-26 13:56:26,958][123091] Updated weights for policy 0, policy_version 1796472 (0.0009) [2023-12-26 13:56:26,986][123090] Updated weights for policy 1, policy_version 1784698 (0.0005) [2023-12-26 13:56:27,014][123091] Updated weights for policy 0, policy_version 1796482 (0.0009) [2023-12-26 13:56:27,068][123091] Updated weights for policy 0, policy_version 1796492 (0.0009) [2023-12-26 13:56:27,729][123090] Updated weights for policy 1, policy_version 1784708 (0.0008) [2023-12-26 13:56:27,793][123090] Updated weights for policy 1, policy_version 1784718 (0.0011) [2023-12-26 13:56:27,844][123090] Updated weights for policy 1, policy_version 1784728 (0.0006) [2023-12-26 13:56:27,881][123091] Updated weights for policy 0, policy_version 1796502 (0.0007) [2023-12-26 13:56:27,947][123091] Updated weights for policy 0, policy_version 1796512 (0.0007) [2023-12-26 13:56:28,007][123091] Updated weights for policy 0, policy_version 1796522 (0.0009) [2023-12-26 13:56:28,618][123090] Updated weights for policy 1, policy_version 1784738 (0.0006) [2023-12-26 13:56:28,668][123090] Updated weights for policy 1, policy_version 1784748 (0.0009) [2023-12-26 13:56:28,729][123090] Updated weights for policy 1, policy_version 1784758 (0.0009) [2023-12-26 13:56:28,780][123091] Updated weights for policy 0, policy_version 1796532 (0.0009) [2023-12-26 13:56:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 916807680. Throughput: 0: 9069.4, 1: 8984.6. Samples: 916807496. Policy #0 lag: (min: 16.0, avg: 36.9, max: 48.0) [2023-12-26 13:56:28,785][121949] Avg episode reward: [(0, '6252.475'), (1, '5990.300')] [2023-12-26 13:56:28,792][123090] Updated weights for policy 1, policy_version 1784768 (0.0009) [2023-12-26 13:56:28,855][123091] Updated weights for policy 0, policy_version 1796542 (0.0005) [2023-12-26 13:56:28,923][123091] Updated weights for policy 0, policy_version 1796552 (0.0008) [2023-12-26 13:56:29,593][123090] Updated weights for policy 1, policy_version 1784778 (0.0006) [2023-12-26 13:56:29,647][123091] Updated weights for policy 0, policy_version 1796562 (0.0008) [2023-12-26 13:56:29,661][123090] Updated weights for policy 1, policy_version 1784788 (0.0005) [2023-12-26 13:56:29,713][123091] Updated weights for policy 0, policy_version 1796572 (0.0008) [2023-12-26 13:56:29,724][123090] Updated weights for policy 1, policy_version 1784798 (0.0005) [2023-12-26 13:56:29,771][123091] Updated weights for policy 0, policy_version 1796582 (0.0010) [2023-12-26 13:56:29,838][123091] Updated weights for policy 0, policy_version 1796592 (0.0010) [2023-12-26 13:56:30,390][123090] Updated weights for policy 1, policy_version 1784808 (0.0006) [2023-12-26 13:56:30,462][123090] Updated weights for policy 1, policy_version 1784818 (0.0005) [2023-12-26 13:56:30,532][123090] Updated weights for policy 1, policy_version 1784828 (0.0005) [2023-12-26 13:56:30,702][123091] Updated weights for policy 0, policy_version 1796602 (0.0006) [2023-12-26 13:56:30,771][123091] Updated weights for policy 0, policy_version 1796612 (0.0005) [2023-12-26 13:56:30,842][123091] Updated weights for policy 0, policy_version 1796622 (0.0005) [2023-12-26 13:56:31,230][123090] Updated weights for policy 1, policy_version 1784838 (0.0008) [2023-12-26 13:56:31,302][123090] Updated weights for policy 1, policy_version 1784848 (0.0010) [2023-12-26 13:56:31,371][123090] Updated weights for policy 1, policy_version 1784858 (0.0009) [2023-12-26 13:56:31,557][123091] Updated weights for policy 0, policy_version 1796632 (0.0009) [2023-12-26 13:56:31,608][123091] Updated weights for policy 0, policy_version 1796642 (0.0006) [2023-12-26 13:56:31,679][123091] Updated weights for policy 0, policy_version 1796652 (0.0007) [2023-12-26 13:56:32,267][123090] Updated weights for policy 1, policy_version 1784868 (0.0009) [2023-12-26 13:56:32,282][123091] Updated weights for policy 0, policy_version 1796662 (0.0008) [2023-12-26 13:56:32,323][123090] Updated weights for policy 1, policy_version 1784878 (0.0009) [2023-12-26 13:56:32,346][123091] Updated weights for policy 0, policy_version 1796672 (0.0008) [2023-12-26 13:56:32,390][123090] Updated weights for policy 1, policy_version 1784888 (0.0008) [2023-12-26 13:56:32,407][123091] Updated weights for policy 0, policy_version 1796682 (0.0009) [2023-12-26 13:56:33,189][123090] Updated weights for policy 1, policy_version 1784898 (0.0007) [2023-12-26 13:56:33,221][123091] Updated weights for policy 0, policy_version 1796692 (0.0009) [2023-12-26 13:56:33,256][123090] Updated weights for policy 1, policy_version 1784908 (0.0007) [2023-12-26 13:56:33,283][123091] Updated weights for policy 0, policy_version 1796702 (0.0007) [2023-12-26 13:56:33,313][123090] Updated weights for policy 1, policy_version 1784918 (0.0007) [2023-12-26 13:56:33,335][123091] Updated weights for policy 0, policy_version 1796712 (0.0010) [2023-12-26 13:56:33,376][123090] Updated weights for policy 1, policy_version 1784928 (0.0008) [2023-12-26 13:56:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 916905984. Throughput: 0: 9084.0, 1: 8965.7. Samples: 916916472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:33,785][121949] Avg episode reward: [(0, '6204.337'), (1, '5993.021')] [2023-12-26 13:56:34,142][123091] Updated weights for policy 0, policy_version 1796722 (0.0009) [2023-12-26 13:56:34,204][123090] Updated weights for policy 1, policy_version 1784938 (0.0009) [2023-12-26 13:56:34,211][123091] Updated weights for policy 0, policy_version 1796732 (0.0010) [2023-12-26 13:56:34,260][123090] Updated weights for policy 1, policy_version 1784948 (0.0009) [2023-12-26 13:56:34,266][123091] Updated weights for policy 0, policy_version 1796742 (0.0011) [2023-12-26 13:56:34,315][123090] Updated weights for policy 1, policy_version 1784958 (0.0009) [2023-12-26 13:56:34,330][123091] Updated weights for policy 0, policy_version 1796752 (0.0011) [2023-12-26 13:56:35,152][123090] Updated weights for policy 1, policy_version 1784968 (0.0007) [2023-12-26 13:56:35,166][123091] Updated weights for policy 0, policy_version 1796762 (0.0010) [2023-12-26 13:56:35,215][123090] Updated weights for policy 1, policy_version 1784978 (0.0006) [2023-12-26 13:56:35,228][123091] Updated weights for policy 0, policy_version 1796772 (0.0010) [2023-12-26 13:56:35,274][123090] Updated weights for policy 1, policy_version 1784988 (0.0007) [2023-12-26 13:56:35,275][123091] Updated weights for policy 0, policy_version 1796782 (0.0010) [2023-12-26 13:56:36,056][123090] Updated weights for policy 1, policy_version 1784998 (0.0008) [2023-12-26 13:56:36,102][123091] Updated weights for policy 0, policy_version 1796792 (0.0010) [2023-12-26 13:56:36,124][123090] Updated weights for policy 1, policy_version 1785008 (0.0008) [2023-12-26 13:56:36,165][123091] Updated weights for policy 0, policy_version 1796802 (0.0011) [2023-12-26 13:56:36,189][123090] Updated weights for policy 1, policy_version 1785018 (0.0008) [2023-12-26 13:56:36,224][123091] Updated weights for policy 0, policy_version 1796812 (0.0011) [2023-12-26 13:56:37,032][123090] Updated weights for policy 1, policy_version 1785028 (0.0008) [2023-12-26 13:56:37,034][123091] Updated weights for policy 0, policy_version 1796822 (0.0010) [2023-12-26 13:56:37,090][123090] Updated weights for policy 1, policy_version 1785038 (0.0008) [2023-12-26 13:56:37,098][123091] Updated weights for policy 0, policy_version 1796832 (0.0011) [2023-12-26 13:56:37,151][123090] Updated weights for policy 1, policy_version 1785048 (0.0006) [2023-12-26 13:56:37,157][123091] Updated weights for policy 0, policy_version 1796842 (0.0011) [2023-12-26 13:56:37,988][123091] Updated weights for policy 0, policy_version 1796852 (0.0011) [2023-12-26 13:56:38,003][123090] Updated weights for policy 1, policy_version 1785058 (0.0008) [2023-12-26 13:56:38,055][123091] Updated weights for policy 0, policy_version 1796862 (0.0008) [2023-12-26 13:56:38,064][123090] Updated weights for policy 1, policy_version 1785068 (0.0009) [2023-12-26 13:56:38,121][123091] Updated weights for policy 0, policy_version 1796872 (0.0006) [2023-12-26 13:56:38,124][123090] Updated weights for policy 1, policy_version 1785078 (0.0009) [2023-12-26 13:56:38,186][123090] Updated weights for policy 1, policy_version 1785088 (0.0008) [2023-12-26 13:56:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 916987904. Throughput: 0: 9044.3, 1: 8956.2. Samples: 916967972. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:38,785][121949] Avg episode reward: [(0, '6099.473'), (1, '6076.440')] [2023-12-26 13:56:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001796880_460005376.pth... [2023-12-26 13:56:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001785088_456982528.pth... [2023-12-26 13:56:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001795824_459735040.pth [2023-12-26 13:56:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001784064_456720384.pth [2023-12-26 13:56:38,970][123091] Updated weights for policy 0, policy_version 1796882 (0.0010) [2023-12-26 13:56:39,033][123091] Updated weights for policy 0, policy_version 1796892 (0.0010) [2023-12-26 13:56:39,037][123090] Updated weights for policy 1, policy_version 1785098 (0.0008) [2023-12-26 13:56:39,088][123090] Updated weights for policy 1, policy_version 1785108 (0.0008) [2023-12-26 13:56:39,092][123091] Updated weights for policy 0, policy_version 1796902 (0.0011) [2023-12-26 13:56:39,137][123090] Updated weights for policy 1, policy_version 1785118 (0.0008) [2023-12-26 13:56:39,154][123091] Updated weights for policy 0, policy_version 1796912 (0.0010) [2023-12-26 13:56:39,972][123091] Updated weights for policy 0, policy_version 1796922 (0.0010) [2023-12-26 13:56:40,035][123091] Updated weights for policy 0, policy_version 1796932 (0.0009) [2023-12-26 13:56:40,100][123090] Updated weights for policy 1, policy_version 1785128 (0.0010) [2023-12-26 13:56:40,100][123091] Updated weights for policy 0, policy_version 1796942 (0.0008) [2023-12-26 13:56:40,171][123090] Updated weights for policy 1, policy_version 1785138 (0.0010) [2023-12-26 13:56:40,244][123090] Updated weights for policy 1, policy_version 1785148 (0.0009) [2023-12-26 13:56:40,937][123091] Updated weights for policy 0, policy_version 1796952 (0.0010) [2023-12-26 13:56:41,010][123091] Updated weights for policy 0, policy_version 1796962 (0.0010) [2023-12-26 13:56:41,054][123090] Updated weights for policy 1, policy_version 1785158 (0.0008) [2023-12-26 13:56:41,071][123091] Updated weights for policy 0, policy_version 1796972 (0.0010) [2023-12-26 13:56:41,117][123090] Updated weights for policy 1, policy_version 1785168 (0.0006) [2023-12-26 13:56:41,181][123090] Updated weights for policy 1, policy_version 1785178 (0.0008) [2023-12-26 13:56:41,925][123091] Updated weights for policy 0, policy_version 1796982 (0.0009) [2023-12-26 13:56:41,990][123091] Updated weights for policy 0, policy_version 1796992 (0.0009) [2023-12-26 13:56:42,019][123090] Updated weights for policy 1, policy_version 1785188 (0.0006) [2023-12-26 13:56:42,051][123091] Updated weights for policy 0, policy_version 1797002 (0.0006) [2023-12-26 13:56:42,092][123090] Updated weights for policy 1, policy_version 1785198 (0.0011) [2023-12-26 13:56:42,151][123090] Updated weights for policy 1, policy_version 1785208 (0.0010) [2023-12-26 13:56:42,782][123091] Updated weights for policy 0, policy_version 1797012 (0.0007) [2023-12-26 13:56:42,865][123091] Updated weights for policy 0, policy_version 1797022 (0.0010) [2023-12-26 13:56:42,944][123091] Updated weights for policy 0, policy_version 1797032 (0.0010) [2023-12-26 13:56:42,964][123090] Updated weights for policy 1, policy_version 1785218 (0.0008) [2023-12-26 13:56:43,020][123090] Updated weights for policy 1, policy_version 1785228 (0.0011) [2023-12-26 13:56:43,083][123090] Updated weights for policy 1, policy_version 1785238 (0.0010) [2023-12-26 13:56:43,156][123090] Updated weights for policy 1, policy_version 1785248 (0.0010) [2023-12-26 13:56:43,606][123091] Updated weights for policy 0, policy_version 1797042 (0.0009) [2023-12-26 13:56:43,653][123091] Updated weights for policy 0, policy_version 1797052 (0.0005) [2023-12-26 13:56:43,698][123091] Updated weights for policy 0, policy_version 1797062 (0.0005) [2023-12-26 13:56:43,745][123091] Updated weights for policy 0, policy_version 1797072 (0.0005) [2023-12-26 13:56:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 917078016. Throughput: 0: 8916.5, 1: 8807.3. Samples: 917068872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:43,785][121949] Avg episode reward: [(0, '6175.565'), (1, '5993.296')] [2023-12-26 13:56:43,955][123090] Updated weights for policy 1, policy_version 1785258 (0.0010) [2023-12-26 13:56:44,015][123090] Updated weights for policy 1, policy_version 1785268 (0.0010) [2023-12-26 13:56:44,078][123090] Updated weights for policy 1, policy_version 1785278 (0.0010) [2023-12-26 13:56:44,454][123091] Updated weights for policy 0, policy_version 1797082 (0.0010) [2023-12-26 13:56:44,506][123091] Updated weights for policy 0, policy_version 1797092 (0.0010) [2023-12-26 13:56:44,556][123091] Updated weights for policy 0, policy_version 1797102 (0.0010) [2023-12-26 13:56:44,804][123090] Updated weights for policy 1, policy_version 1785288 (0.0011) [2023-12-26 13:56:44,873][123090] Updated weights for policy 1, policy_version 1785298 (0.0007) [2023-12-26 13:56:44,944][123090] Updated weights for policy 1, policy_version 1785308 (0.0006) [2023-12-26 13:56:45,406][123091] Updated weights for policy 0, policy_version 1797112 (0.0010) [2023-12-26 13:56:45,476][123091] Updated weights for policy 0, policy_version 1797122 (0.0010) [2023-12-26 13:56:45,543][123091] Updated weights for policy 0, policy_version 1797132 (0.0011) [2023-12-26 13:56:45,731][123090] Updated weights for policy 1, policy_version 1785318 (0.0006) [2023-12-26 13:56:45,780][123090] Updated weights for policy 1, policy_version 1785328 (0.0005) [2023-12-26 13:56:45,827][123090] Updated weights for policy 1, policy_version 1785338 (0.0005) [2023-12-26 13:56:46,359][123091] Updated weights for policy 0, policy_version 1797142 (0.0010) [2023-12-26 13:56:46,421][123091] Updated weights for policy 0, policy_version 1797152 (0.0010) [2023-12-26 13:56:46,465][123090] Updated weights for policy 1, policy_version 1785348 (0.0005) [2023-12-26 13:56:46,483][123091] Updated weights for policy 0, policy_version 1797162 (0.0010) [2023-12-26 13:56:46,533][123090] Updated weights for policy 1, policy_version 1785358 (0.0005) [2023-12-26 13:56:46,605][123090] Updated weights for policy 1, policy_version 1785368 (0.0005) [2023-12-26 13:56:47,207][123090] Updated weights for policy 1, policy_version 1785378 (0.0005) [2023-12-26 13:56:47,260][123090] Updated weights for policy 1, policy_version 1785388 (0.0007) [2023-12-26 13:56:47,295][123091] Updated weights for policy 0, policy_version 1797172 (0.0010) [2023-12-26 13:56:47,316][123090] Updated weights for policy 1, policy_version 1785398 (0.0010) [2023-12-26 13:56:47,350][123091] Updated weights for policy 0, policy_version 1797182 (0.0010) [2023-12-26 13:56:47,372][123090] Updated weights for policy 1, policy_version 1785408 (0.0010) [2023-12-26 13:56:47,411][123091] Updated weights for policy 0, policy_version 1797192 (0.0010) [2023-12-26 13:56:48,107][123090] Updated weights for policy 1, policy_version 1785418 (0.0005) [2023-12-26 13:56:48,156][123091] Updated weights for policy 0, policy_version 1797202 (0.0010) [2023-12-26 13:56:48,166][123090] Updated weights for policy 1, policy_version 1785428 (0.0006) [2023-12-26 13:56:48,206][123091] Updated weights for policy 0, policy_version 1797212 (0.0009) [2023-12-26 13:56:48,229][123090] Updated weights for policy 1, policy_version 1785438 (0.0008) [2023-12-26 13:56:48,263][123091] Updated weights for policy 0, policy_version 1797222 (0.0006) [2023-12-26 13:56:48,322][123091] Updated weights for policy 0, policy_version 1797232 (0.0009) [2023-12-26 13:56:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 917168128. Throughput: 0: 8948.5, 1: 8864.3. Samples: 917179524. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:48,785][121949] Avg episode reward: [(0, '6170.047'), (1, '5933.100')] [2023-12-26 13:56:48,944][123090] Updated weights for policy 1, policy_version 1785448 (0.0006) [2023-12-26 13:56:48,998][123090] Updated weights for policy 1, policy_version 1785458 (0.0005) [2023-12-26 13:56:49,054][123090] Updated weights for policy 1, policy_version 1785468 (0.0005) [2023-12-26 13:56:49,214][123091] Updated weights for policy 0, policy_version 1797242 (0.0009) [2023-12-26 13:56:49,281][123091] Updated weights for policy 0, policy_version 1797252 (0.0010) [2023-12-26 13:56:49,348][123091] Updated weights for policy 0, policy_version 1797262 (0.0011) [2023-12-26 13:56:49,767][123090] Updated weights for policy 1, policy_version 1785478 (0.0007) [2023-12-26 13:56:49,827][123090] Updated weights for policy 1, policy_version 1785488 (0.0006) [2023-12-26 13:56:49,896][123090] Updated weights for policy 1, policy_version 1785498 (0.0009) [2023-12-26 13:56:50,147][123091] Updated weights for policy 0, policy_version 1797272 (0.0008) [2023-12-26 13:56:50,206][123091] Updated weights for policy 0, policy_version 1797282 (0.0008) [2023-12-26 13:56:50,287][123091] Updated weights for policy 0, policy_version 1797292 (0.0008) [2023-12-26 13:56:50,699][123090] Updated weights for policy 1, policy_version 1785508 (0.0008) [2023-12-26 13:56:50,765][123090] Updated weights for policy 1, policy_version 1785518 (0.0008) [2023-12-26 13:56:50,830][123090] Updated weights for policy 1, policy_version 1785528 (0.0008) [2023-12-26 13:56:51,035][123091] Updated weights for policy 0, policy_version 1797302 (0.0007) [2023-12-26 13:56:51,098][123091] Updated weights for policy 0, policy_version 1797312 (0.0007) [2023-12-26 13:56:51,168][123091] Updated weights for policy 0, policy_version 1797322 (0.0006) [2023-12-26 13:56:51,615][123090] Updated weights for policy 1, policy_version 1785538 (0.0009) [2023-12-26 13:56:51,677][123090] Updated weights for policy 1, policy_version 1785548 (0.0010) [2023-12-26 13:56:51,738][123090] Updated weights for policy 1, policy_version 1785558 (0.0010) [2023-12-26 13:56:51,803][123090] Updated weights for policy 1, policy_version 1785568 (0.0007) [2023-12-26 13:56:51,947][123091] Updated weights for policy 0, policy_version 1797332 (0.0008) [2023-12-26 13:56:52,002][123091] Updated weights for policy 0, policy_version 1797342 (0.0010) [2023-12-26 13:56:52,060][123091] Updated weights for policy 0, policy_version 1797352 (0.0010) [2023-12-26 13:56:52,565][123090] Updated weights for policy 1, policy_version 1785578 (0.0009) [2023-12-26 13:56:52,624][123090] Updated weights for policy 1, policy_version 1785588 (0.0009) [2023-12-26 13:56:52,683][123090] Updated weights for policy 1, policy_version 1785598 (0.0009) [2023-12-26 13:56:52,847][123091] Updated weights for policy 0, policy_version 1797362 (0.0010) [2023-12-26 13:56:52,901][123091] Updated weights for policy 0, policy_version 1797372 (0.0010) [2023-12-26 13:56:52,961][123091] Updated weights for policy 0, policy_version 1797382 (0.0009) [2023-12-26 13:56:53,012][123091] Updated weights for policy 0, policy_version 1797392 (0.0009) [2023-12-26 13:56:53,494][123090] Updated weights for policy 1, policy_version 1785608 (0.0006) [2023-12-26 13:56:53,544][123090] Updated weights for policy 1, policy_version 1785618 (0.0005) [2023-12-26 13:56:53,598][123090] Updated weights for policy 1, policy_version 1785628 (0.0006) [2023-12-26 13:56:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 917258240. Throughput: 0: 8977.1, 1: 8901.0. Samples: 917233588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:53,785][121949] Avg episode reward: [(0, '6138.214'), (1, '5960.596')] [2023-12-26 13:56:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001785632_457121792.pth... [2023-12-26 13:56:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001784576_456851456.pth [2023-12-26 13:56:53,806][123091] Updated weights for policy 0, policy_version 1797402 (0.0005) [2023-12-26 13:56:53,863][123091] Updated weights for policy 0, policy_version 1797412 (0.0006) [2023-12-26 13:56:53,931][123091] Updated weights for policy 0, policy_version 1797422 (0.0009) [2023-12-26 13:56:53,942][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001797424_460144640.pth... [2023-12-26 13:56:53,947][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001796368_459874304.pth [2023-12-26 13:56:54,390][123090] Updated weights for policy 1, policy_version 1785638 (0.0007) [2023-12-26 13:56:54,438][123090] Updated weights for policy 1, policy_version 1785648 (0.0005) [2023-12-26 13:56:54,488][123090] Updated weights for policy 1, policy_version 1785658 (0.0005) [2023-12-26 13:56:54,662][123091] Updated weights for policy 0, policy_version 1797432 (0.0007) [2023-12-26 13:56:54,713][123091] Updated weights for policy 0, policy_version 1797442 (0.0010) [2023-12-26 13:56:54,771][123091] Updated weights for policy 0, policy_version 1797452 (0.0010) [2023-12-26 13:56:55,230][123090] Updated weights for policy 1, policy_version 1785668 (0.0005) [2023-12-26 13:56:55,299][123090] Updated weights for policy 1, policy_version 1785678 (0.0005) [2023-12-26 13:56:55,353][123090] Updated weights for policy 1, policy_version 1785688 (0.0005) [2023-12-26 13:56:55,516][123091] Updated weights for policy 0, policy_version 1797462 (0.0010) [2023-12-26 13:56:55,571][123091] Updated weights for policy 0, policy_version 1797472 (0.0010) [2023-12-26 13:56:55,634][123091] Updated weights for policy 0, policy_version 1797482 (0.0007) [2023-12-26 13:56:55,970][123090] Updated weights for policy 1, policy_version 1785698 (0.0006) [2023-12-26 13:56:56,022][123090] Updated weights for policy 1, policy_version 1785708 (0.0010) [2023-12-26 13:56:56,081][123090] Updated weights for policy 1, policy_version 1785718 (0.0009) [2023-12-26 13:56:56,142][123090] Updated weights for policy 1, policy_version 1785728 (0.0007) [2023-12-26 13:56:56,379][123091] Updated weights for policy 0, policy_version 1797492 (0.0008) [2023-12-26 13:56:56,438][123091] Updated weights for policy 0, policy_version 1797502 (0.0011) [2023-12-26 13:56:56,501][123091] Updated weights for policy 0, policy_version 1797512 (0.0011) [2023-12-26 13:56:56,941][123090] Updated weights for policy 1, policy_version 1785738 (0.0009) [2023-12-26 13:56:57,000][123090] Updated weights for policy 1, policy_version 1785748 (0.0008) [2023-12-26 13:56:57,071][123090] Updated weights for policy 1, policy_version 1785758 (0.0009) [2023-12-26 13:56:57,239][123091] Updated weights for policy 0, policy_version 1797522 (0.0011) [2023-12-26 13:56:57,297][123091] Updated weights for policy 0, policy_version 1797532 (0.0010) [2023-12-26 13:56:57,352][123091] Updated weights for policy 0, policy_version 1797542 (0.0010) [2023-12-26 13:56:57,406][123091] Updated weights for policy 0, policy_version 1797552 (0.0010) [2023-12-26 13:56:57,811][123090] Updated weights for policy 1, policy_version 1785768 (0.0006) [2023-12-26 13:56:57,864][123090] Updated weights for policy 1, policy_version 1785778 (0.0005) [2023-12-26 13:56:57,912][123090] Updated weights for policy 1, policy_version 1785788 (0.0005) [2023-12-26 13:56:58,128][123091] Updated weights for policy 0, policy_version 1797562 (0.0008) [2023-12-26 13:56:58,197][123091] Updated weights for policy 0, policy_version 1797572 (0.0008) [2023-12-26 13:56:58,249][123091] Updated weights for policy 0, policy_version 1797582 (0.0008) [2023-12-26 13:56:58,694][123090] Updated weights for policy 1, policy_version 1785798 (0.0008) [2023-12-26 13:56:58,766][123090] Updated weights for policy 1, policy_version 1785808 (0.0010) [2023-12-26 13:56:58,786][121949] Fps is (10 sec: 18019.6, 60 sec: 17885.3, 300 sec: 17827.9). Total num frames: 917348352. Throughput: 0: 9043.6, 1: 9003.8. Samples: 917344888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:56:58,786][121949] Avg episode reward: [(0, '6313.605'), (1, '5916.034')] [2023-12-26 13:56:58,838][123090] Updated weights for policy 1, policy_version 1785818 (0.0009) [2023-12-26 13:56:59,135][123091] Updated weights for policy 0, policy_version 1797592 (0.0009) [2023-12-26 13:56:59,204][123091] Updated weights for policy 0, policy_version 1797602 (0.0008) [2023-12-26 13:56:59,273][123091] Updated weights for policy 0, policy_version 1797612 (0.0009) [2023-12-26 13:56:59,749][123090] Updated weights for policy 1, policy_version 1785828 (0.0010) [2023-12-26 13:56:59,818][123090] Updated weights for policy 1, policy_version 1785838 (0.0010) [2023-12-26 13:56:59,880][123090] Updated weights for policy 1, policy_version 1785848 (0.0007) [2023-12-26 13:57:00,126][123091] Updated weights for policy 0, policy_version 1797622 (0.0010) [2023-12-26 13:57:00,180][123091] Updated weights for policy 0, policy_version 1797632 (0.0009) [2023-12-26 13:57:00,250][123091] Updated weights for policy 0, policy_version 1797642 (0.0008) [2023-12-26 13:57:00,583][123090] Updated weights for policy 1, policy_version 1785858 (0.0005) [2023-12-26 13:57:00,642][123090] Updated weights for policy 1, policy_version 1785868 (0.0007) [2023-12-26 13:57:00,708][123090] Updated weights for policy 1, policy_version 1785878 (0.0005) [2023-12-26 13:57:00,759][123090] Updated weights for policy 1, policy_version 1785888 (0.0005) [2023-12-26 13:57:00,971][123091] Updated weights for policy 0, policy_version 1797652 (0.0006) [2023-12-26 13:57:01,036][123091] Updated weights for policy 0, policy_version 1797662 (0.0006) [2023-12-26 13:57:01,097][123091] Updated weights for policy 0, policy_version 1797672 (0.0009) [2023-12-26 13:57:01,465][123090] Updated weights for policy 1, policy_version 1785898 (0.0011) [2023-12-26 13:57:01,521][123090] Updated weights for policy 1, policy_version 1785908 (0.0010) [2023-12-26 13:57:01,577][123090] Updated weights for policy 1, policy_version 1785918 (0.0010) [2023-12-26 13:57:01,869][123091] Updated weights for policy 0, policy_version 1797682 (0.0010) [2023-12-26 13:57:01,936][123091] Updated weights for policy 0, policy_version 1797692 (0.0010) [2023-12-26 13:57:02,006][123091] Updated weights for policy 0, policy_version 1797702 (0.0010) [2023-12-26 13:57:02,071][123091] Updated weights for policy 0, policy_version 1797712 (0.0008) [2023-12-26 13:57:02,301][123090] Updated weights for policy 1, policy_version 1785928 (0.0010) [2023-12-26 13:57:02,367][123090] Updated weights for policy 1, policy_version 1785938 (0.0010) [2023-12-26 13:57:02,430][123090] Updated weights for policy 1, policy_version 1785948 (0.0010) [2023-12-26 13:57:02,896][123091] Updated weights for policy 0, policy_version 1797722 (0.0010) [2023-12-26 13:57:02,961][123091] Updated weights for policy 0, policy_version 1797732 (0.0009) [2023-12-26 13:57:03,024][123091] Updated weights for policy 0, policy_version 1797742 (0.0009) [2023-12-26 13:57:03,163][123090] Updated weights for policy 1, policy_version 1785958 (0.0010) [2023-12-26 13:57:03,224][123090] Updated weights for policy 1, policy_version 1785968 (0.0010) [2023-12-26 13:57:03,287][123090] Updated weights for policy 1, policy_version 1785978 (0.0010) [2023-12-26 13:57:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 917438464. Throughput: 0: 8908.0, 1: 8986.0. Samples: 917452924. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:03,785][121949] Avg episode reward: [(0, '6303.701'), (1, '5817.795')] [2023-12-26 13:57:03,859][123091] Updated weights for policy 0, policy_version 1797753 (0.0010) [2023-12-26 13:57:03,917][123091] Updated weights for policy 0, policy_version 1797763 (0.0010) [2023-12-26 13:57:03,974][123091] Updated weights for policy 0, policy_version 1797773 (0.0009) [2023-12-26 13:57:04,076][123090] Updated weights for policy 1, policy_version 1785988 (0.0010) [2023-12-26 13:57:04,131][123090] Updated weights for policy 1, policy_version 1785998 (0.0009) [2023-12-26 13:57:04,208][123090] Updated weights for policy 1, policy_version 1786008 (0.0009) [2023-12-26 13:57:04,811][123091] Updated weights for policy 0, policy_version 1797783 (0.0008) [2023-12-26 13:57:04,872][123091] Updated weights for policy 0, policy_version 1797793 (0.0009) [2023-12-26 13:57:04,939][123091] Updated weights for policy 0, policy_version 1797803 (0.0010) [2023-12-26 13:57:04,995][123090] Updated weights for policy 1, policy_version 1786018 (0.0009) [2023-12-26 13:57:05,056][123090] Updated weights for policy 1, policy_version 1786028 (0.0005) [2023-12-26 13:57:05,126][123090] Updated weights for policy 1, policy_version 1786038 (0.0006) [2023-12-26 13:57:05,196][123090] Updated weights for policy 1, policy_version 1786048 (0.0005) [2023-12-26 13:57:05,809][123091] Updated weights for policy 0, policy_version 1797813 (0.0008) [2023-12-26 13:57:05,853][123090] Updated weights for policy 1, policy_version 1786058 (0.0005) [2023-12-26 13:57:05,858][123091] Updated weights for policy 0, policy_version 1797823 (0.0009) [2023-12-26 13:57:05,908][123091] Updated weights for policy 0, policy_version 1797833 (0.0009) [2023-12-26 13:57:05,911][123090] Updated weights for policy 1, policy_version 1786068 (0.0005) [2023-12-26 13:57:05,972][123090] Updated weights for policy 1, policy_version 1786078 (0.0005) [2023-12-26 13:57:06,649][123090] Updated weights for policy 1, policy_version 1786088 (0.0005) [2023-12-26 13:57:06,718][123090] Updated weights for policy 1, policy_version 1786098 (0.0008) [2023-12-26 13:57:06,770][123090] Updated weights for policy 1, policy_version 1786108 (0.0009) [2023-12-26 13:57:06,807][123091] Updated weights for policy 0, policy_version 1797843 (0.0008) [2023-12-26 13:57:06,858][123091] Updated weights for policy 0, policy_version 1797853 (0.0009) [2023-12-26 13:57:06,908][123091] Updated weights for policy 0, policy_version 1797863 (0.0009) [2023-12-26 13:57:07,568][123090] Updated weights for policy 1, policy_version 1786118 (0.0007) [2023-12-26 13:57:07,622][123090] Updated weights for policy 1, policy_version 1786128 (0.0005) [2023-12-26 13:57:07,679][123090] Updated weights for policy 1, policy_version 1786138 (0.0005) [2023-12-26 13:57:07,811][123091] Updated weights for policy 0, policy_version 1797873 (0.0010) [2023-12-26 13:57:07,867][123091] Updated weights for policy 0, policy_version 1797883 (0.0010) [2023-12-26 13:57:07,919][123091] Updated weights for policy 0, policy_version 1797893 (0.0009) [2023-12-26 13:57:07,975][123091] Updated weights for policy 0, policy_version 1797903 (0.0010) [2023-12-26 13:57:08,437][123090] Updated weights for policy 1, policy_version 1786148 (0.0007) [2023-12-26 13:57:08,491][123090] Updated weights for policy 1, policy_version 1786158 (0.0009) [2023-12-26 13:57:08,548][123090] Updated weights for policy 1, policy_version 1786168 (0.0009) [2023-12-26 13:57:08,784][121949] Fps is (10 sec: 18025.6, 60 sec: 17886.0, 300 sec: 17855.8). Total num frames: 917528576. Throughput: 0: 8852.4, 1: 9085.1. Samples: 917506816. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:08,785][121949] Avg episode reward: [(0, '6159.278'), (1, '5782.587')] [2023-12-26 13:57:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001797904_460267520.pth... [2023-12-26 13:57:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001786176_457261056.pth... [2023-12-26 13:57:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001796880_460005376.pth [2023-12-26 13:57:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001785088_456982528.pth [2023-12-26 13:57:08,862][123091] Updated weights for policy 0, policy_version 1797913 (0.0009) [2023-12-26 13:57:08,922][123091] Updated weights for policy 0, policy_version 1797923 (0.0009) [2023-12-26 13:57:08,986][123091] Updated weights for policy 0, policy_version 1797934 (0.0009) [2023-12-26 13:57:09,421][123090] Updated weights for policy 1, policy_version 1786178 (0.0010) [2023-12-26 13:57:09,488][123090] Updated weights for policy 1, policy_version 1786188 (0.0008) [2023-12-26 13:57:09,541][123090] Updated weights for policy 1, policy_version 1786198 (0.0008) [2023-12-26 13:57:09,602][123090] Updated weights for policy 1, policy_version 1786208 (0.0008) [2023-12-26 13:57:09,892][123091] Updated weights for policy 0, policy_version 1797944 (0.0010) [2023-12-26 13:57:09,959][123091] Updated weights for policy 0, policy_version 1797954 (0.0009) [2023-12-26 13:57:10,032][123091] Updated weights for policy 0, policy_version 1797964 (0.0009) [2023-12-26 13:57:10,431][123090] Updated weights for policy 1, policy_version 1786218 (0.0011) [2023-12-26 13:57:10,503][123090] Updated weights for policy 1, policy_version 1786228 (0.0011) [2023-12-26 13:57:10,568][123090] Updated weights for policy 1, policy_version 1786238 (0.0011) [2023-12-26 13:57:10,839][123091] Updated weights for policy 0, policy_version 1797974 (0.0009) [2023-12-26 13:57:10,889][123091] Updated weights for policy 0, policy_version 1797984 (0.0009) [2023-12-26 13:57:10,940][123091] Updated weights for policy 0, policy_version 1797994 (0.0009) [2023-12-26 13:57:11,386][123090] Updated weights for policy 1, policy_version 1786248 (0.0009) [2023-12-26 13:57:11,453][123090] Updated weights for policy 1, policy_version 1786258 (0.0009) [2023-12-26 13:57:11,515][123090] Updated weights for policy 1, policy_version 1786268 (0.0009) [2023-12-26 13:57:11,846][123091] Updated weights for policy 0, policy_version 1798005 (0.0009) [2023-12-26 13:57:11,913][123091] Updated weights for policy 0, policy_version 1798015 (0.0010) [2023-12-26 13:57:11,976][123091] Updated weights for policy 0, policy_version 1798025 (0.0007) [2023-12-26 13:57:12,318][123090] Updated weights for policy 1, policy_version 1786278 (0.0007) [2023-12-26 13:57:12,395][123090] Updated weights for policy 1, policy_version 1786288 (0.0009) [2023-12-26 13:57:12,449][123090] Updated weights for policy 1, policy_version 1786298 (0.0008) [2023-12-26 13:57:12,748][123091] Updated weights for policy 0, policy_version 1798035 (0.0008) [2023-12-26 13:57:12,813][123091] Updated weights for policy 0, policy_version 1798045 (0.0006) [2023-12-26 13:57:12,879][123091] Updated weights for policy 0, policy_version 1798055 (0.0008) [2023-12-26 13:57:13,170][123090] Updated weights for policy 1, policy_version 1786308 (0.0006) [2023-12-26 13:57:13,231][123090] Updated weights for policy 1, policy_version 1786318 (0.0005) [2023-12-26 13:57:13,286][123090] Updated weights for policy 1, policy_version 1786328 (0.0005) [2023-12-26 13:57:13,498][123091] Updated weights for policy 0, policy_version 1798065 (0.0010) [2023-12-26 13:57:13,550][123091] Updated weights for policy 0, policy_version 1798075 (0.0007) [2023-12-26 13:57:13,596][123091] Updated weights for policy 0, policy_version 1798085 (0.0006) [2023-12-26 13:57:13,642][123091] Updated weights for policy 0, policy_version 1798095 (0.0005) [2023-12-26 13:57:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 917618688. Throughput: 0: 8787.9, 1: 9017.3. Samples: 917608732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:13,785][121949] Avg episode reward: [(0, '6079.968'), (1, '5933.087')] [2023-12-26 13:57:13,992][123090] Updated weights for policy 1, policy_version 1786338 (0.0006) [2023-12-26 13:57:14,046][123090] Updated weights for policy 1, policy_version 1786348 (0.0010) [2023-12-26 13:57:14,106][123090] Updated weights for policy 1, policy_version 1786358 (0.0010) [2023-12-26 13:57:14,304][123091] Updated weights for policy 0, policy_version 1798105 (0.0005) [2023-12-26 13:57:14,351][123091] Updated weights for policy 0, policy_version 1798115 (0.0006) [2023-12-26 13:57:14,395][123091] Updated weights for policy 0, policy_version 1798125 (0.0005) [2023-12-26 13:57:14,986][123090] Updated weights for policy 1, policy_version 1786369 (0.0010) [2023-12-26 13:57:15,048][123090] Updated weights for policy 1, policy_version 1786379 (0.0008) [2023-12-26 13:57:15,097][123090] Updated weights for policy 1, policy_version 1786389 (0.0009) [2023-12-26 13:57:15,150][123090] Updated weights for policy 1, policy_version 1786399 (0.0010) [2023-12-26 13:57:15,228][123091] Updated weights for policy 0, policy_version 1798135 (0.0005) [2023-12-26 13:57:15,285][123091] Updated weights for policy 0, policy_version 1798145 (0.0009) [2023-12-26 13:57:15,345][123091] Updated weights for policy 0, policy_version 1798155 (0.0009) [2023-12-26 13:57:15,834][123090] Updated weights for policy 1, policy_version 1786409 (0.0009) [2023-12-26 13:57:15,899][123090] Updated weights for policy 1, policy_version 1786419 (0.0009) [2023-12-26 13:57:15,971][123090] Updated weights for policy 1, policy_version 1786429 (0.0009) [2023-12-26 13:57:16,087][123091] Updated weights for policy 0, policy_version 1798165 (0.0010) [2023-12-26 13:57:16,138][123091] Updated weights for policy 0, policy_version 1798175 (0.0009) [2023-12-26 13:57:16,188][123091] Updated weights for policy 0, policy_version 1798185 (0.0010) [2023-12-26 13:57:16,718][123090] Updated weights for policy 1, policy_version 1786439 (0.0009) [2023-12-26 13:57:16,783][123090] Updated weights for policy 1, policy_version 1786449 (0.0009) [2023-12-26 13:57:16,843][123090] Updated weights for policy 1, policy_version 1786459 (0.0009) [2023-12-26 13:57:16,934][123091] Updated weights for policy 0, policy_version 1798195 (0.0008) [2023-12-26 13:57:17,002][123091] Updated weights for policy 0, policy_version 1798205 (0.0007) [2023-12-26 13:57:17,071][123091] Updated weights for policy 0, policy_version 1798215 (0.0010) [2023-12-26 13:57:17,640][123090] Updated weights for policy 1, policy_version 1786469 (0.0009) [2023-12-26 13:57:17,688][123090] Updated weights for policy 1, policy_version 1786479 (0.0009) [2023-12-26 13:57:17,745][123090] Updated weights for policy 1, policy_version 1786489 (0.0009) [2023-12-26 13:57:17,746][123091] Updated weights for policy 0, policy_version 1798225 (0.0010) [2023-12-26 13:57:17,808][123091] Updated weights for policy 0, policy_version 1798235 (0.0006) [2023-12-26 13:57:17,870][123091] Updated weights for policy 0, policy_version 1798245 (0.0009) [2023-12-26 13:57:17,920][123091] Updated weights for policy 0, policy_version 1798255 (0.0009) [2023-12-26 13:57:18,629][123091] Updated weights for policy 0, policy_version 1798265 (0.0006) [2023-12-26 13:57:18,670][123090] Updated weights for policy 1, policy_version 1786499 (0.0008) [2023-12-26 13:57:18,687][123091] Updated weights for policy 0, policy_version 1798275 (0.0005) [2023-12-26 13:57:18,734][123090] Updated weights for policy 1, policy_version 1786509 (0.0009) [2023-12-26 13:57:18,749][123091] Updated weights for policy 0, policy_version 1798285 (0.0006) [2023-12-26 13:57:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 917708800. Throughput: 0: 8856.6, 1: 9015.0. Samples: 917720696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:18,785][121949] Avg episode reward: [(0, '6077.935'), (1, '6080.208')] [2023-12-26 13:57:18,803][123090] Updated weights for policy 1, policy_version 1786519 (0.0007) [2023-12-26 13:57:19,514][123091] Updated weights for policy 0, policy_version 1798295 (0.0009) [2023-12-26 13:57:19,580][123091] Updated weights for policy 0, policy_version 1798305 (0.0011) [2023-12-26 13:57:19,613][123090] Updated weights for policy 1, policy_version 1786529 (0.0009) [2023-12-26 13:57:19,644][123091] Updated weights for policy 0, policy_version 1798315 (0.0011) [2023-12-26 13:57:19,683][123090] Updated weights for policy 1, policy_version 1786539 (0.0006) [2023-12-26 13:57:19,754][123090] Updated weights for policy 1, policy_version 1786549 (0.0005) [2023-12-26 13:57:19,819][123090] Updated weights for policy 1, policy_version 1786559 (0.0008) [2023-12-26 13:57:20,478][123091] Updated weights for policy 0, policy_version 1798325 (0.0008) [2023-12-26 13:57:20,535][123091] Updated weights for policy 0, policy_version 1798335 (0.0005) [2023-12-26 13:57:20,596][123091] Updated weights for policy 0, policy_version 1798345 (0.0007) [2023-12-26 13:57:20,627][123090] Updated weights for policy 1, policy_version 1786569 (0.0008) [2023-12-26 13:57:20,693][123090] Updated weights for policy 1, policy_version 1786579 (0.0009) [2023-12-26 13:57:20,760][123090] Updated weights for policy 1, policy_version 1786589 (0.0009) [2023-12-26 13:57:21,399][123091] Updated weights for policy 0, policy_version 1798355 (0.0008) [2023-12-26 13:57:21,454][123091] Updated weights for policy 0, policy_version 1798366 (0.0009) [2023-12-26 13:57:21,508][123091] Updated weights for policy 0, policy_version 1798376 (0.0010) [2023-12-26 13:57:21,637][123090] Updated weights for policy 1, policy_version 1786599 (0.0009) [2023-12-26 13:57:21,706][123090] Updated weights for policy 1, policy_version 1786609 (0.0009) [2023-12-26 13:57:21,772][123090] Updated weights for policy 1, policy_version 1786619 (0.0010) [2023-12-26 13:57:22,306][123091] Updated weights for policy 0, policy_version 1798386 (0.0008) [2023-12-26 13:57:22,379][123091] Updated weights for policy 0, policy_version 1798396 (0.0008) [2023-12-26 13:57:22,441][123091] Updated weights for policy 0, policy_version 1798406 (0.0008) [2023-12-26 13:57:22,496][123091] Updated weights for policy 0, policy_version 1798416 (0.0008) [2023-12-26 13:57:22,674][123090] Updated weights for policy 1, policy_version 1786629 (0.0009) [2023-12-26 13:57:22,745][123090] Updated weights for policy 1, policy_version 1786639 (0.0010) [2023-12-26 13:57:22,816][123090] Updated weights for policy 1, policy_version 1786649 (0.0010) [2023-12-26 13:57:23,283][123091] Updated weights for policy 0, policy_version 1798426 (0.0010) [2023-12-26 13:57:23,345][123091] Updated weights for policy 0, policy_version 1798436 (0.0010) [2023-12-26 13:57:23,405][123091] Updated weights for policy 0, policy_version 1798446 (0.0009) [2023-12-26 13:57:23,633][123090] Updated weights for policy 1, policy_version 1786659 (0.0008) [2023-12-26 13:57:23,690][123090] Updated weights for policy 1, policy_version 1786669 (0.0006) [2023-12-26 13:57:23,744][123090] Updated weights for policy 1, policy_version 1786679 (0.0009) [2023-12-26 13:57:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 917790720. Throughput: 0: 8855.1, 1: 9007.0. Samples: 917771768. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:23,785][121949] Avg episode reward: [(0, '6230.875'), (1, '5983.979')] [2023-12-26 13:57:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001798448_460406784.pth... [2023-12-26 13:57:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001786688_457392128.pth... [2023-12-26 13:57:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001797424_460144640.pth [2023-12-26 13:57:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001785632_457121792.pth [2023-12-26 13:57:24,283][123091] Updated weights for policy 0, policy_version 1798456 (0.0009) [2023-12-26 13:57:24,355][123091] Updated weights for policy 0, policy_version 1798466 (0.0010) [2023-12-26 13:57:24,408][123091] Updated weights for policy 0, policy_version 1798476 (0.0010) [2023-12-26 13:57:24,462][123090] Updated weights for policy 1, policy_version 1786690 (0.0008) [2023-12-26 13:57:24,510][123090] Updated weights for policy 1, policy_version 1786700 (0.0008) [2023-12-26 13:57:24,557][123090] Updated weights for policy 1, policy_version 1786710 (0.0007) [2023-12-26 13:57:24,618][123090] Updated weights for policy 1, policy_version 1786720 (0.0005) [2023-12-26 13:57:25,210][123090] Updated weights for policy 1, policy_version 1786730 (0.0005) [2023-12-26 13:57:25,260][123090] Updated weights for policy 1, policy_version 1786740 (0.0006) [2023-12-26 13:57:25,285][123091] Updated weights for policy 0, policy_version 1798486 (0.0007) [2023-12-26 13:57:25,318][123090] Updated weights for policy 1, policy_version 1786750 (0.0007) [2023-12-26 13:57:25,342][123091] Updated weights for policy 0, policy_version 1798496 (0.0009) [2023-12-26 13:57:25,397][123091] Updated weights for policy 0, policy_version 1798506 (0.0009) [2023-12-26 13:57:26,089][123090] Updated weights for policy 1, policy_version 1786760 (0.0005) [2023-12-26 13:57:26,159][123090] Updated weights for policy 1, policy_version 1786770 (0.0005) [2023-12-26 13:57:26,190][123091] Updated weights for policy 0, policy_version 1798516 (0.0007) [2023-12-26 13:57:26,227][123090] Updated weights for policy 1, policy_version 1786780 (0.0008) [2023-12-26 13:57:26,262][123091] Updated weights for policy 0, policy_version 1798526 (0.0007) [2023-12-26 13:57:26,327][123091] Updated weights for policy 0, policy_version 1798536 (0.0006) [2023-12-26 13:57:26,919][123090] Updated weights for policy 1, policy_version 1786790 (0.0007) [2023-12-26 13:57:26,992][123091] Updated weights for policy 0, policy_version 1798546 (0.0006) [2023-12-26 13:57:26,996][123090] Updated weights for policy 1, policy_version 1786800 (0.0005) [2023-12-26 13:57:27,038][123091] Updated weights for policy 0, policy_version 1798556 (0.0007) [2023-12-26 13:57:27,073][123090] Updated weights for policy 1, policy_version 1786810 (0.0005) [2023-12-26 13:57:27,094][123091] Updated weights for policy 0, policy_version 1798566 (0.0009) [2023-12-26 13:57:27,143][123091] Updated weights for policy 0, policy_version 1798576 (0.0009) [2023-12-26 13:57:27,685][123090] Updated weights for policy 1, policy_version 1786820 (0.0007) [2023-12-26 13:57:27,733][123090] Updated weights for policy 1, policy_version 1786830 (0.0009) [2023-12-26 13:57:27,781][123090] Updated weights for policy 1, policy_version 1786840 (0.0009) [2023-12-26 13:57:28,028][123091] Updated weights for policy 0, policy_version 1798586 (0.0010) [2023-12-26 13:57:28,091][123091] Updated weights for policy 0, policy_version 1798596 (0.0008) [2023-12-26 13:57:28,148][123091] Updated weights for policy 0, policy_version 1798606 (0.0007) [2023-12-26 13:57:28,579][123090] Updated weights for policy 1, policy_version 1786850 (0.0009) [2023-12-26 13:57:28,640][123090] Updated weights for policy 1, policy_version 1786860 (0.0005) [2023-12-26 13:57:28,697][123090] Updated weights for policy 1, policy_version 1786870 (0.0006) [2023-12-26 13:57:28,751][123090] Updated weights for policy 1, policy_version 1786880 (0.0005) [2023-12-26 13:57:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 917889024. Throughput: 0: 8885.7, 1: 9153.7. Samples: 917880644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:28,784][121949] Avg episode reward: [(0, '6309.276'), (1, '5980.447')] [2023-12-26 13:57:29,053][123091] Updated weights for policy 0, policy_version 1798616 (0.0009) [2023-12-26 13:57:29,118][123091] Updated weights for policy 0, policy_version 1798626 (0.0009) [2023-12-26 13:57:29,197][123091] Updated weights for policy 0, policy_version 1798636 (0.0009) [2023-12-26 13:57:29,460][123090] Updated weights for policy 1, policy_version 1786890 (0.0011) [2023-12-26 13:57:29,523][123090] Updated weights for policy 1, policy_version 1786900 (0.0008) [2023-12-26 13:57:29,598][123090] Updated weights for policy 1, policy_version 1786910 (0.0008) [2023-12-26 13:57:30,075][123091] Updated weights for policy 0, policy_version 1798646 (0.0008) [2023-12-26 13:57:30,142][123091] Updated weights for policy 0, policy_version 1798656 (0.0009) [2023-12-26 13:57:30,190][123091] Updated weights for policy 0, policy_version 1798666 (0.0009) [2023-12-26 13:57:30,308][123090] Updated weights for policy 1, policy_version 1786920 (0.0010) [2023-12-26 13:57:30,375][123090] Updated weights for policy 1, policy_version 1786930 (0.0010) [2023-12-26 13:57:30,436][123090] Updated weights for policy 1, policy_version 1786940 (0.0010) [2023-12-26 13:57:30,962][123091] Updated weights for policy 0, policy_version 1798676 (0.0007) [2023-12-26 13:57:31,016][123091] Updated weights for policy 0, policy_version 1798686 (0.0005) [2023-12-26 13:57:31,084][123091] Updated weights for policy 0, policy_version 1798696 (0.0009) [2023-12-26 13:57:31,247][123090] Updated weights for policy 1, policy_version 1786950 (0.0010) [2023-12-26 13:57:31,310][123090] Updated weights for policy 1, policy_version 1786960 (0.0008) [2023-12-26 13:57:31,370][123090] Updated weights for policy 1, policy_version 1786970 (0.0008) [2023-12-26 13:57:31,893][123091] Updated weights for policy 0, policy_version 1798706 (0.0011) [2023-12-26 13:57:31,948][123091] Updated weights for policy 0, policy_version 1798716 (0.0011) [2023-12-26 13:57:31,999][123091] Updated weights for policy 0, policy_version 1798726 (0.0010) [2023-12-26 13:57:32,054][123091] Updated weights for policy 0, policy_version 1798736 (0.0010) [2023-12-26 13:57:32,150][123090] Updated weights for policy 1, policy_version 1786980 (0.0007) [2023-12-26 13:57:32,215][123090] Updated weights for policy 1, policy_version 1786990 (0.0006) [2023-12-26 13:57:32,279][123090] Updated weights for policy 1, policy_version 1787000 (0.0006) [2023-12-26 13:57:32,911][123091] Updated weights for policy 0, policy_version 1798746 (0.0011) [2023-12-26 13:57:32,975][123091] Updated weights for policy 0, policy_version 1798756 (0.0010) [2023-12-26 13:57:33,033][123091] Updated weights for policy 0, policy_version 1798766 (0.0010) [2023-12-26 13:57:33,098][123090] Updated weights for policy 1, policy_version 1787010 (0.0006) [2023-12-26 13:57:33,161][123090] Updated weights for policy 1, policy_version 1787020 (0.0009) [2023-12-26 13:57:33,222][123090] Updated weights for policy 1, policy_version 1787030 (0.0007) [2023-12-26 13:57:33,291][123090] Updated weights for policy 1, policy_version 1787040 (0.0005) [2023-12-26 13:57:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 917970944. Throughput: 0: 8831.2, 1: 9116.8. Samples: 917987184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:33,785][121949] Avg episode reward: [(0, '6276.281'), (1, '5833.766')] [2023-12-26 13:57:33,816][123091] Updated weights for policy 0, policy_version 1798776 (0.0010) [2023-12-26 13:57:33,860][123091] Updated weights for policy 0, policy_version 1798786 (0.0010) [2023-12-26 13:57:33,900][123090] Updated weights for policy 1, policy_version 1787050 (0.0009) [2023-12-26 13:57:33,910][123091] Updated weights for policy 0, policy_version 1798796 (0.0010) [2023-12-26 13:57:33,945][123090] Updated weights for policy 1, policy_version 1787060 (0.0009) [2023-12-26 13:57:33,992][123090] Updated weights for policy 1, policy_version 1787070 (0.0005) [2023-12-26 13:57:34,689][123091] Updated weights for policy 0, policy_version 1798806 (0.0011) [2023-12-26 13:57:34,749][123091] Updated weights for policy 0, policy_version 1798816 (0.0011) [2023-12-26 13:57:34,818][123091] Updated weights for policy 0, policy_version 1798826 (0.0009) [2023-12-26 13:57:34,857][123090] Updated weights for policy 1, policy_version 1787080 (0.0009) [2023-12-26 13:57:34,915][123090] Updated weights for policy 1, policy_version 1787090 (0.0010) [2023-12-26 13:57:34,963][123090] Updated weights for policy 1, policy_version 1787100 (0.0010) [2023-12-26 13:57:35,545][123091] Updated weights for policy 0, policy_version 1798836 (0.0007) [2023-12-26 13:57:35,593][123091] Updated weights for policy 0, policy_version 1798846 (0.0008) [2023-12-26 13:57:35,655][123091] Updated weights for policy 0, policy_version 1798856 (0.0010) [2023-12-26 13:57:35,710][123090] Updated weights for policy 1, policy_version 1787110 (0.0011) [2023-12-26 13:57:35,772][123090] Updated weights for policy 1, policy_version 1787120 (0.0010) [2023-12-26 13:57:35,823][123090] Updated weights for policy 1, policy_version 1787130 (0.0010) [2023-12-26 13:57:36,474][123091] Updated weights for policy 0, policy_version 1798866 (0.0010) [2023-12-26 13:57:36,523][123091] Updated weights for policy 0, policy_version 1798876 (0.0009) [2023-12-26 13:57:36,586][123091] Updated weights for policy 0, policy_version 1798886 (0.0009) [2023-12-26 13:57:36,649][123090] Updated weights for policy 1, policy_version 1787140 (0.0010) [2023-12-26 13:57:36,651][123091] Updated weights for policy 0, policy_version 1798896 (0.0009) [2023-12-26 13:57:36,712][123090] Updated weights for policy 1, policy_version 1787150 (0.0008) [2023-12-26 13:57:36,791][123090] Updated weights for policy 1, policy_version 1787160 (0.0005) [2023-12-26 13:57:37,477][123091] Updated weights for policy 0, policy_version 1798906 (0.0006) [2023-12-26 13:57:37,532][123091] Updated weights for policy 0, policy_version 1798916 (0.0005) [2023-12-26 13:57:37,568][123090] Updated weights for policy 1, policy_version 1787170 (0.0009) [2023-12-26 13:57:37,577][123091] Updated weights for policy 0, policy_version 1798926 (0.0005) [2023-12-26 13:57:37,635][123090] Updated weights for policy 1, policy_version 1787180 (0.0011) [2023-12-26 13:57:37,694][123090] Updated weights for policy 1, policy_version 1787190 (0.0011) [2023-12-26 13:57:37,756][123090] Updated weights for policy 1, policy_version 1787200 (0.0010) [2023-12-26 13:57:38,310][123091] Updated weights for policy 0, policy_version 1798936 (0.0009) [2023-12-26 13:57:38,380][123091] Updated weights for policy 0, policy_version 1798946 (0.0009) [2023-12-26 13:57:38,434][123091] Updated weights for policy 0, policy_version 1798956 (0.0010) [2023-12-26 13:57:38,567][123090] Updated weights for policy 1, policy_version 1787210 (0.0010) [2023-12-26 13:57:38,623][123090] Updated weights for policy 1, policy_version 1787220 (0.0009) [2023-12-26 13:57:38,690][123090] Updated weights for policy 1, policy_version 1787230 (0.0008) [2023-12-26 13:57:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 918069248. Throughput: 0: 8848.8, 1: 9100.2. Samples: 918041296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:38,785][121949] Avg episode reward: [(0, '6367.174'), (1, '5734.142')] [2023-12-26 13:57:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001798960_460537856.pth... [2023-12-26 13:57:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001787232_457531392.pth... [2023-12-26 13:57:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001797904_460267520.pth [2023-12-26 13:57:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001786176_457261056.pth [2023-12-26 13:57:39,259][123091] Updated weights for policy 0, policy_version 1798966 (0.0009) [2023-12-26 13:57:39,311][123091] Updated weights for policy 0, policy_version 1798976 (0.0010) [2023-12-26 13:57:39,376][123091] Updated weights for policy 0, policy_version 1798986 (0.0009) [2023-12-26 13:57:39,567][123090] Updated weights for policy 1, policy_version 1787240 (0.0010) [2023-12-26 13:57:39,634][123090] Updated weights for policy 1, policy_version 1787250 (0.0009) [2023-12-26 13:57:39,705][123090] Updated weights for policy 1, policy_version 1787260 (0.0009) [2023-12-26 13:57:40,292][123091] Updated weights for policy 0, policy_version 1798996 (0.0009) [2023-12-26 13:57:40,342][123091] Updated weights for policy 0, policy_version 1799006 (0.0008) [2023-12-26 13:57:40,391][123091] Updated weights for policy 0, policy_version 1799016 (0.0006) [2023-12-26 13:57:40,502][123090] Updated weights for policy 1, policy_version 1787270 (0.0007) [2023-12-26 13:57:40,561][123090] Updated weights for policy 1, policy_version 1787280 (0.0008) [2023-12-26 13:57:40,627][123090] Updated weights for policy 1, policy_version 1787290 (0.0008) [2023-12-26 13:57:41,082][123091] Updated weights for policy 0, policy_version 1799026 (0.0006) [2023-12-26 13:57:41,146][123091] Updated weights for policy 0, policy_version 1799036 (0.0008) [2023-12-26 13:57:41,219][123091] Updated weights for policy 0, policy_version 1799046 (0.0008) [2023-12-26 13:57:41,292][123091] Updated weights for policy 0, policy_version 1799056 (0.0008) [2023-12-26 13:57:41,370][123090] Updated weights for policy 1, policy_version 1787300 (0.0008) [2023-12-26 13:57:41,451][123090] Updated weights for policy 1, policy_version 1787310 (0.0009) [2023-12-26 13:57:41,518][123090] Updated weights for policy 1, policy_version 1787320 (0.0008) [2023-12-26 13:57:42,051][123091] Updated weights for policy 0, policy_version 1799066 (0.0008) [2023-12-26 13:57:42,123][123091] Updated weights for policy 0, policy_version 1799076 (0.0011) [2023-12-26 13:57:42,193][123091] Updated weights for policy 0, policy_version 1799086 (0.0010) [2023-12-26 13:57:42,305][123090] Updated weights for policy 1, policy_version 1787330 (0.0008) [2023-12-26 13:57:42,381][123090] Updated weights for policy 1, policy_version 1787340 (0.0010) [2023-12-26 13:57:42,446][123090] Updated weights for policy 1, policy_version 1787350 (0.0011) [2023-12-26 13:57:42,498][123090] Updated weights for policy 1, policy_version 1787360 (0.0011) [2023-12-26 13:57:42,957][123091] Updated weights for policy 0, policy_version 1799096 (0.0007) [2023-12-26 13:57:43,017][123091] Updated weights for policy 0, policy_version 1799106 (0.0005) [2023-12-26 13:57:43,085][123091] Updated weights for policy 0, policy_version 1799116 (0.0010) [2023-12-26 13:57:43,314][123090] Updated weights for policy 1, policy_version 1787370 (0.0008) [2023-12-26 13:57:43,369][123090] Updated weights for policy 1, policy_version 1787380 (0.0007) [2023-12-26 13:57:43,416][123090] Updated weights for policy 1, policy_version 1787390 (0.0008) [2023-12-26 13:57:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 918151168. Throughput: 0: 8804.1, 1: 9002.2. Samples: 918146140. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:43,785][121949] Avg episode reward: [(0, '6398.662'), (1, '5824.800')] [2023-12-26 13:57:43,830][123091] Updated weights for policy 0, policy_version 1799126 (0.0006) [2023-12-26 13:57:43,883][123091] Updated weights for policy 0, policy_version 1799136 (0.0005) [2023-12-26 13:57:43,929][123091] Updated weights for policy 0, policy_version 1799146 (0.0006) [2023-12-26 13:57:44,356][123090] Updated weights for policy 1, policy_version 1787400 (0.0009) [2023-12-26 13:57:44,410][123090] Updated weights for policy 1, policy_version 1787410 (0.0010) [2023-12-26 13:57:44,464][123090] Updated weights for policy 1, policy_version 1787421 (0.0009) [2023-12-26 13:57:44,608][123091] Updated weights for policy 0, policy_version 1799156 (0.0005) [2023-12-26 13:57:44,656][123091] Updated weights for policy 0, policy_version 1799166 (0.0005) [2023-12-26 13:57:44,705][123091] Updated weights for policy 0, policy_version 1799176 (0.0005) [2023-12-26 13:57:45,289][123090] Updated weights for policy 1, policy_version 1787431 (0.0010) [2023-12-26 13:57:45,345][123090] Updated weights for policy 1, policy_version 1787441 (0.0011) [2023-12-26 13:57:45,402][123090] Updated weights for policy 1, policy_version 1787451 (0.0011) [2023-12-26 13:57:45,452][123091] Updated weights for policy 0, policy_version 1799186 (0.0006) [2023-12-26 13:57:45,515][123091] Updated weights for policy 0, policy_version 1799196 (0.0011) [2023-12-26 13:57:45,581][123091] Updated weights for policy 0, policy_version 1799206 (0.0008) [2023-12-26 13:57:45,641][123091] Updated weights for policy 0, policy_version 1799216 (0.0005) [2023-12-26 13:57:46,249][123090] Updated weights for policy 1, policy_version 1787461 (0.0011) [2023-12-26 13:57:46,303][123091] Updated weights for policy 0, policy_version 1799226 (0.0006) [2023-12-26 13:57:46,316][123090] Updated weights for policy 1, policy_version 1787471 (0.0010) [2023-12-26 13:57:46,360][123091] Updated weights for policy 0, policy_version 1799236 (0.0006) [2023-12-26 13:57:46,371][123090] Updated weights for policy 1, policy_version 1787481 (0.0010) [2023-12-26 13:57:46,420][123091] Updated weights for policy 0, policy_version 1799246 (0.0005) [2023-12-26 13:57:47,174][123091] Updated weights for policy 0, policy_version 1799256 (0.0009) [2023-12-26 13:57:47,188][123090] Updated weights for policy 1, policy_version 1787491 (0.0010) [2023-12-26 13:57:47,255][123090] Updated weights for policy 1, policy_version 1787501 (0.0010) [2023-12-26 13:57:47,261][123091] Updated weights for policy 0, policy_version 1799266 (0.0006) [2023-12-26 13:57:47,312][123091] Updated weights for policy 0, policy_version 1799276 (0.0010) [2023-12-26 13:57:47,312][123090] Updated weights for policy 1, policy_version 1787511 (0.0008) [2023-12-26 13:57:48,007][123090] Updated weights for policy 1, policy_version 1787521 (0.0005) [2023-12-26 13:57:48,071][123090] Updated weights for policy 1, policy_version 1787531 (0.0005) [2023-12-26 13:57:48,083][123091] Updated weights for policy 0, policy_version 1799286 (0.0010) [2023-12-26 13:57:48,126][123090] Updated weights for policy 1, policy_version 1787541 (0.0005) [2023-12-26 13:57:48,149][123091] Updated weights for policy 0, policy_version 1799296 (0.0010) [2023-12-26 13:57:48,176][123090] Updated weights for policy 1, policy_version 1787551 (0.0006) [2023-12-26 13:57:48,214][123091] Updated weights for policy 0, policy_version 1799306 (0.0010) [2023-12-26 13:57:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 918241280. Throughput: 0: 8888.0, 1: 8972.6. Samples: 918256652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:48,785][121949] Avg episode reward: [(0, '6364.393'), (1, '5928.064')] [2023-12-26 13:57:48,939][123090] Updated weights for policy 1, policy_version 1787561 (0.0008) [2023-12-26 13:57:48,977][123091] Updated weights for policy 0, policy_version 1799316 (0.0010) [2023-12-26 13:57:48,999][123090] Updated weights for policy 1, policy_version 1787571 (0.0007) [2023-12-26 13:57:49,036][123091] Updated weights for policy 0, policy_version 1799326 (0.0007) [2023-12-26 13:57:49,065][123090] Updated weights for policy 1, policy_version 1787581 (0.0007) [2023-12-26 13:57:49,105][123091] Updated weights for policy 0, policy_version 1799336 (0.0005) [2023-12-26 13:57:49,794][123091] Updated weights for policy 0, policy_version 1799346 (0.0006) [2023-12-26 13:57:49,851][123090] Updated weights for policy 1, policy_version 1787592 (0.0008) [2023-12-26 13:57:49,864][123091] Updated weights for policy 0, policy_version 1799356 (0.0007) [2023-12-26 13:57:49,916][123090] Updated weights for policy 1, policy_version 1787602 (0.0010) [2023-12-26 13:57:49,927][123091] Updated weights for policy 0, policy_version 1799366 (0.0007) [2023-12-26 13:57:49,986][123090] Updated weights for policy 1, policy_version 1787612 (0.0008) [2023-12-26 13:57:49,989][123091] Updated weights for policy 0, policy_version 1799376 (0.0008) [2023-12-26 13:57:50,682][123091] Updated weights for policy 0, policy_version 1799386 (0.0010) [2023-12-26 13:57:50,744][123091] Updated weights for policy 0, policy_version 1799396 (0.0009) [2023-12-26 13:57:50,809][123091] Updated weights for policy 0, policy_version 1799406 (0.0010) [2023-12-26 13:57:50,856][123090] Updated weights for policy 1, policy_version 1787622 (0.0009) [2023-12-26 13:57:50,911][123090] Updated weights for policy 1, policy_version 1787632 (0.0008) [2023-12-26 13:57:50,972][123090] Updated weights for policy 1, policy_version 1787642 (0.0009) [2023-12-26 13:57:51,690][123091] Updated weights for policy 0, policy_version 1799416 (0.0010) [2023-12-26 13:57:51,754][123091] Updated weights for policy 0, policy_version 1799426 (0.0009) [2023-12-26 13:57:51,784][123090] Updated weights for policy 1, policy_version 1787652 (0.0008) [2023-12-26 13:57:51,818][123091] Updated weights for policy 0, policy_version 1799436 (0.0009) [2023-12-26 13:57:51,852][123090] Updated weights for policy 1, policy_version 1787662 (0.0007) [2023-12-26 13:57:51,920][123090] Updated weights for policy 1, policy_version 1787672 (0.0010) [2023-12-26 13:57:52,651][123091] Updated weights for policy 0, policy_version 1799446 (0.0010) [2023-12-26 13:57:52,717][123091] Updated weights for policy 0, policy_version 1799456 (0.0009) [2023-12-26 13:57:52,744][123090] Updated weights for policy 1, policy_version 1787682 (0.0009) [2023-12-26 13:57:52,772][123091] Updated weights for policy 0, policy_version 1799466 (0.0009) [2023-12-26 13:57:52,802][123090] Updated weights for policy 1, policy_version 1787692 (0.0007) [2023-12-26 13:57:52,858][123090] Updated weights for policy 1, policy_version 1787702 (0.0009) [2023-12-26 13:57:52,916][123090] Updated weights for policy 1, policy_version 1787712 (0.0010) [2023-12-26 13:57:53,485][123091] Updated weights for policy 0, policy_version 1799476 (0.0010) [2023-12-26 13:57:53,544][123091] Updated weights for policy 0, policy_version 1799486 (0.0010) [2023-12-26 13:57:53,605][123091] Updated weights for policy 0, policy_version 1799496 (0.0009) [2023-12-26 13:57:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 918331392. Throughput: 0: 8946.9, 1: 8893.2. Samples: 918309624. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:53,785][121949] Avg episode reward: [(0, '6331.837'), (1, '5969.197')] [2023-12-26 13:57:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001799504_460677120.pth... [2023-12-26 13:57:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001798448_460406784.pth [2023-12-26 13:57:53,807][123090] Updated weights for policy 1, policy_version 1787722 (0.0009) [2023-12-26 13:57:53,862][123090] Updated weights for policy 1, policy_version 1787732 (0.0008) [2023-12-26 13:57:53,914][123090] Updated weights for policy 1, policy_version 1787742 (0.0009) [2023-12-26 13:57:53,922][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001787744_457662464.pth... [2023-12-26 13:57:53,924][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001786688_457392128.pth [2023-12-26 13:57:54,350][123091] Updated weights for policy 0, policy_version 1799506 (0.0008) [2023-12-26 13:57:54,424][123091] Updated weights for policy 0, policy_version 1799516 (0.0005) [2023-12-26 13:57:54,493][123091] Updated weights for policy 0, policy_version 1799526 (0.0006) [2023-12-26 13:57:54,553][123091] Updated weights for policy 0, policy_version 1799536 (0.0008) [2023-12-26 13:57:54,844][123090] Updated weights for policy 1, policy_version 1787752 (0.0007) [2023-12-26 13:57:54,922][123090] Updated weights for policy 1, policy_version 1787762 (0.0009) [2023-12-26 13:57:54,987][123090] Updated weights for policy 1, policy_version 1787772 (0.0010) [2023-12-26 13:57:55,195][123091] Updated weights for policy 0, policy_version 1799546 (0.0010) [2023-12-26 13:57:55,263][123091] Updated weights for policy 0, policy_version 1799556 (0.0009) [2023-12-26 13:57:55,333][123091] Updated weights for policy 0, policy_version 1799566 (0.0009) [2023-12-26 13:57:55,774][123090] Updated weights for policy 1, policy_version 1787782 (0.0010) [2023-12-26 13:57:55,839][123090] Updated weights for policy 1, policy_version 1787792 (0.0010) [2023-12-26 13:57:55,905][123090] Updated weights for policy 1, policy_version 1787802 (0.0009) [2023-12-26 13:57:56,159][123091] Updated weights for policy 0, policy_version 1799576 (0.0010) [2023-12-26 13:57:56,229][123091] Updated weights for policy 0, policy_version 1799586 (0.0009) [2023-12-26 13:57:56,291][123091] Updated weights for policy 0, policy_version 1799596 (0.0009) [2023-12-26 13:57:56,715][123090] Updated weights for policy 1, policy_version 1787812 (0.0009) [2023-12-26 13:57:56,772][123090] Updated weights for policy 1, policy_version 1787822 (0.0009) [2023-12-26 13:57:56,824][123090] Updated weights for policy 1, policy_version 1787832 (0.0008) [2023-12-26 13:57:57,116][123091] Updated weights for policy 0, policy_version 1799606 (0.0010) [2023-12-26 13:57:57,167][123091] Updated weights for policy 0, policy_version 1799616 (0.0010) [2023-12-26 13:57:57,214][123091] Updated weights for policy 0, policy_version 1799626 (0.0010) [2023-12-26 13:57:57,697][123090] Updated weights for policy 1, policy_version 1787842 (0.0009) [2023-12-26 13:57:57,752][123090] Updated weights for policy 1, policy_version 1787852 (0.0010) [2023-12-26 13:57:57,802][123090] Updated weights for policy 1, policy_version 1787863 (0.0009) [2023-12-26 13:57:57,926][123091] Updated weights for policy 0, policy_version 1799636 (0.0008) [2023-12-26 13:57:57,973][123091] Updated weights for policy 0, policy_version 1799646 (0.0005) [2023-12-26 13:57:58,021][123091] Updated weights for policy 0, policy_version 1799656 (0.0007) [2023-12-26 13:57:58,649][123090] Updated weights for policy 1, policy_version 1787873 (0.0010) [2023-12-26 13:57:58,709][123090] Updated weights for policy 1, policy_version 1787883 (0.0009) [2023-12-26 13:57:58,774][123090] Updated weights for policy 1, policy_version 1787893 (0.0009) [2023-12-26 13:57:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.9, 300 sec: 17800.2). Total num frames: 918413312. Throughput: 0: 9044.2, 1: 8845.2. Samples: 918413756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:57:58,785][121949] Avg episode reward: [(0, '6226.487'), (1, '5789.672')] [2023-12-26 13:57:58,804][123091] Updated weights for policy 0, policy_version 1799666 (0.0008) [2023-12-26 13:57:58,840][123090] Updated weights for policy 1, policy_version 1787903 (0.0009) [2023-12-26 13:57:58,868][123091] Updated weights for policy 0, policy_version 1799676 (0.0007) [2023-12-26 13:57:58,927][123091] Updated weights for policy 0, policy_version 1799686 (0.0006) [2023-12-26 13:57:58,977][123091] Updated weights for policy 0, policy_version 1799696 (0.0005) [2023-12-26 13:57:59,638][123090] Updated weights for policy 1, policy_version 1787913 (0.0006) [2023-12-26 13:57:59,703][123090] Updated weights for policy 1, policy_version 1787923 (0.0005) [2023-12-26 13:57:59,733][123091] Updated weights for policy 0, policy_version 1799706 (0.0008) [2023-12-26 13:57:59,769][123090] Updated weights for policy 1, policy_version 1787933 (0.0006) [2023-12-26 13:57:59,800][123091] Updated weights for policy 0, policy_version 1799716 (0.0009) [2023-12-26 13:57:59,867][123091] Updated weights for policy 0, policy_version 1799726 (0.0008) [2023-12-26 13:58:00,440][123090] Updated weights for policy 1, policy_version 1787943 (0.0009) [2023-12-26 13:58:00,501][123090] Updated weights for policy 1, policy_version 1787953 (0.0008) [2023-12-26 13:58:00,563][123090] Updated weights for policy 1, policy_version 1787963 (0.0008) [2023-12-26 13:58:00,573][123091] Updated weights for policy 0, policy_version 1799736 (0.0006) [2023-12-26 13:58:00,630][123091] Updated weights for policy 0, policy_version 1799746 (0.0005) [2023-12-26 13:58:00,695][123091] Updated weights for policy 0, policy_version 1799756 (0.0005) [2023-12-26 13:58:01,303][123090] Updated weights for policy 1, policy_version 1787973 (0.0007) [2023-12-26 13:58:01,381][123090] Updated weights for policy 1, policy_version 1787983 (0.0006) [2023-12-26 13:58:01,401][123091] Updated weights for policy 0, policy_version 1799766 (0.0008) [2023-12-26 13:58:01,445][123090] Updated weights for policy 1, policy_version 1787993 (0.0010) [2023-12-26 13:58:01,451][123091] Updated weights for policy 0, policy_version 1799776 (0.0007) [2023-12-26 13:58:01,497][123091] Updated weights for policy 0, policy_version 1799786 (0.0005) [2023-12-26 13:58:02,256][123090] Updated weights for policy 1, policy_version 1788003 (0.0010) [2023-12-26 13:58:02,298][123091] Updated weights for policy 0, policy_version 1799796 (0.0006) [2023-12-26 13:58:02,317][123090] Updated weights for policy 1, policy_version 1788013 (0.0010) [2023-12-26 13:58:02,355][123091] Updated weights for policy 0, policy_version 1799806 (0.0006) [2023-12-26 13:58:02,374][123090] Updated weights for policy 1, policy_version 1788023 (0.0010) [2023-12-26 13:58:02,424][123091] Updated weights for policy 0, policy_version 1799816 (0.0010) [2023-12-26 13:58:03,103][123090] Updated weights for policy 1, policy_version 1788033 (0.0010) [2023-12-26 13:58:03,153][123090] Updated weights for policy 1, policy_version 1788043 (0.0010) [2023-12-26 13:58:03,204][123090] Updated weights for policy 1, policy_version 1788053 (0.0010) [2023-12-26 13:58:03,262][123090] Updated weights for policy 1, policy_version 1788063 (0.0010) [2023-12-26 13:58:03,304][123091] Updated weights for policy 0, policy_version 1799826 (0.0009) [2023-12-26 13:58:03,356][123091] Updated weights for policy 0, policy_version 1799836 (0.0009) [2023-12-26 13:58:03,406][123091] Updated weights for policy 0, policy_version 1799846 (0.0009) [2023-12-26 13:58:03,463][123091] Updated weights for policy 0, policy_version 1799856 (0.0010) [2023-12-26 13:58:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 918511616. Throughput: 0: 8964.6, 1: 8856.3. Samples: 918522640. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:03,786][121949] Avg episode reward: [(0, '6040.719'), (1, '5683.732')] [2023-12-26 13:58:03,907][123090] Updated weights for policy 1, policy_version 1788073 (0.0007) [2023-12-26 13:58:03,966][123090] Updated weights for policy 1, policy_version 1788083 (0.0009) [2023-12-26 13:58:04,010][123090] Updated weights for policy 1, policy_version 1788093 (0.0010) [2023-12-26 13:58:04,382][123091] Updated weights for policy 0, policy_version 1799866 (0.0009) [2023-12-26 13:58:04,454][123091] Updated weights for policy 0, policy_version 1799876 (0.0009) [2023-12-26 13:58:04,528][123091] Updated weights for policy 0, policy_version 1799886 (0.0009) [2023-12-26 13:58:04,831][123090] Updated weights for policy 1, policy_version 1788103 (0.0007) [2023-12-26 13:58:04,894][123090] Updated weights for policy 1, policy_version 1788113 (0.0006) [2023-12-26 13:58:04,951][123090] Updated weights for policy 1, policy_version 1788123 (0.0005) [2023-12-26 13:58:05,408][123091] Updated weights for policy 0, policy_version 1799896 (0.0010) [2023-12-26 13:58:05,471][123091] Updated weights for policy 0, policy_version 1799906 (0.0010) [2023-12-26 13:58:05,534][123091] Updated weights for policy 0, policy_version 1799916 (0.0010) [2023-12-26 13:58:05,613][123090] Updated weights for policy 1, policy_version 1788133 (0.0005) [2023-12-26 13:58:05,691][123090] Updated weights for policy 1, policy_version 1788143 (0.0006) [2023-12-26 13:58:05,744][123090] Updated weights for policy 1, policy_version 1788153 (0.0005) [2023-12-26 13:58:06,330][123091] Updated weights for policy 0, policy_version 1799926 (0.0009) [2023-12-26 13:58:06,404][123091] Updated weights for policy 0, policy_version 1799936 (0.0010) [2023-12-26 13:58:06,452][123090] Updated weights for policy 1, policy_version 1788163 (0.0008) [2023-12-26 13:58:06,469][123091] Updated weights for policy 0, policy_version 1799946 (0.0011) [2023-12-26 13:58:06,520][123090] Updated weights for policy 1, policy_version 1788173 (0.0011) [2023-12-26 13:58:06,593][123090] Updated weights for policy 1, policy_version 1788183 (0.0011) [2023-12-26 13:58:07,240][123091] Updated weights for policy 0, policy_version 1799956 (0.0009) [2023-12-26 13:58:07,259][123090] Updated weights for policy 1, policy_version 1788193 (0.0010) [2023-12-26 13:58:07,297][123091] Updated weights for policy 0, policy_version 1799966 (0.0010) [2023-12-26 13:58:07,310][123090] Updated weights for policy 1, policy_version 1788203 (0.0005) [2023-12-26 13:58:07,360][123091] Updated weights for policy 0, policy_version 1799976 (0.0011) [2023-12-26 13:58:07,371][123090] Updated weights for policy 1, policy_version 1788213 (0.0006) [2023-12-26 13:58:07,422][123090] Updated weights for policy 1, policy_version 1788223 (0.0005) [2023-12-26 13:58:08,168][123090] Updated weights for policy 1, policy_version 1788233 (0.0010) [2023-12-26 13:58:08,177][123091] Updated weights for policy 0, policy_version 1799986 (0.0011) [2023-12-26 13:58:08,213][123090] Updated weights for policy 1, policy_version 1788243 (0.0010) [2023-12-26 13:58:08,224][123091] Updated weights for policy 0, policy_version 1799996 (0.0010) [2023-12-26 13:58:08,268][123090] Updated weights for policy 1, policy_version 1788253 (0.0010) [2023-12-26 13:58:08,279][123091] Updated weights for policy 0, policy_version 1800006 (0.0010) [2023-12-26 13:58:08,337][123091] Updated weights for policy 0, policy_version 1800016 (0.0011) [2023-12-26 13:58:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 918601728. Throughput: 0: 8945.1, 1: 8940.1. Samples: 918576600. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:08,785][121949] Avg episode reward: [(0, '6203.446'), (1, '5810.293')] [2023-12-26 13:58:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001800016_460808192.pth... [2023-12-26 13:58:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001788256_457793536.pth... [2023-12-26 13:58:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001798960_460537856.pth [2023-12-26 13:58:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001787232_457531392.pth [2023-12-26 13:58:09,086][123090] Updated weights for policy 1, policy_version 1788263 (0.0010) [2023-12-26 13:58:09,152][123090] Updated weights for policy 1, policy_version 1788273 (0.0011) [2023-12-26 13:58:09,163][123091] Updated weights for policy 0, policy_version 1800026 (0.0011) [2023-12-26 13:58:09,215][123091] Updated weights for policy 0, policy_version 1800036 (0.0011) [2023-12-26 13:58:09,220][123090] Updated weights for policy 1, policy_version 1788283 (0.0011) [2023-12-26 13:58:09,280][123091] Updated weights for policy 0, policy_version 1800046 (0.0008) [2023-12-26 13:58:10,048][123090] Updated weights for policy 1, policy_version 1788293 (0.0010) [2023-12-26 13:58:10,113][123090] Updated weights for policy 1, policy_version 1788303 (0.0010) [2023-12-26 13:58:10,172][123090] Updated weights for policy 1, policy_version 1788313 (0.0007) [2023-12-26 13:58:10,174][123091] Updated weights for policy 0, policy_version 1800056 (0.0010) [2023-12-26 13:58:10,242][123091] Updated weights for policy 0, policy_version 1800066 (0.0009) [2023-12-26 13:58:10,307][123091] Updated weights for policy 0, policy_version 1800076 (0.0010) [2023-12-26 13:58:10,968][123090] Updated weights for policy 1, policy_version 1788323 (0.0008) [2023-12-26 13:58:11,033][123090] Updated weights for policy 1, policy_version 1788333 (0.0009) [2023-12-26 13:58:11,103][123090] Updated weights for policy 1, policy_version 1788343 (0.0009) [2023-12-26 13:58:11,170][123091] Updated weights for policy 0, policy_version 1800086 (0.0008) [2023-12-26 13:58:11,222][123091] Updated weights for policy 0, policy_version 1800096 (0.0006) [2023-12-26 13:58:11,287][123091] Updated weights for policy 0, policy_version 1800106 (0.0007) [2023-12-26 13:58:11,968][123090] Updated weights for policy 1, policy_version 1788353 (0.0009) [2023-12-26 13:58:12,025][123090] Updated weights for policy 1, policy_version 1788363 (0.0007) [2023-12-26 13:58:12,078][123091] Updated weights for policy 0, policy_version 1800116 (0.0007) [2023-12-26 13:58:12,084][123090] Updated weights for policy 1, policy_version 1788373 (0.0008) [2023-12-26 13:58:12,136][123090] Updated weights for policy 1, policy_version 1788383 (0.0010) [2023-12-26 13:58:12,144][123091] Updated weights for policy 0, policy_version 1800126 (0.0009) [2023-12-26 13:58:12,204][123091] Updated weights for policy 0, policy_version 1800136 (0.0009) [2023-12-26 13:58:12,959][123090] Updated weights for policy 1, policy_version 1788393 (0.0010) [2023-12-26 13:58:12,983][123091] Updated weights for policy 0, policy_version 1800146 (0.0009) [2023-12-26 13:58:13,021][123090] Updated weights for policy 1, policy_version 1788403 (0.0011) [2023-12-26 13:58:13,041][123091] Updated weights for policy 0, policy_version 1800156 (0.0009) [2023-12-26 13:58:13,069][123090] Updated weights for policy 1, policy_version 1788413 (0.0010) [2023-12-26 13:58:13,102][123091] Updated weights for policy 0, policy_version 1800166 (0.0007) [2023-12-26 13:58:13,172][123091] Updated weights for policy 0, policy_version 1800176 (0.0009) [2023-12-26 13:58:13,777][123090] Updated weights for policy 1, policy_version 1788423 (0.0006) [2023-12-26 13:58:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 918683648. Throughput: 0: 8913.6, 1: 8872.7. Samples: 918681028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:13,785][121949] Avg episode reward: [(0, '6341.122'), (1, '5921.170')] [2023-12-26 13:58:13,826][123090] Updated weights for policy 1, policy_version 1788433 (0.0005) [2023-12-26 13:58:13,881][123090] Updated weights for policy 1, policy_version 1788443 (0.0005) [2023-12-26 13:58:13,997][123091] Updated weights for policy 0, policy_version 1800186 (0.0006) [2023-12-26 13:58:14,052][123091] Updated weights for policy 0, policy_version 1800196 (0.0008) [2023-12-26 13:58:14,111][123091] Updated weights for policy 0, policy_version 1800206 (0.0008) [2023-12-26 13:58:14,626][123090] Updated weights for policy 1, policy_version 1788453 (0.0007) [2023-12-26 13:58:14,677][123090] Updated weights for policy 1, policy_version 1788463 (0.0009) [2023-12-26 13:58:14,728][123090] Updated weights for policy 1, policy_version 1788473 (0.0009) [2023-12-26 13:58:14,939][123091] Updated weights for policy 0, policy_version 1800216 (0.0009) [2023-12-26 13:58:15,007][123091] Updated weights for policy 0, policy_version 1800226 (0.0009) [2023-12-26 13:58:15,067][123091] Updated weights for policy 0, policy_version 1800236 (0.0007) [2023-12-26 13:58:15,605][123090] Updated weights for policy 1, policy_version 1788483 (0.0008) [2023-12-26 13:58:15,678][123090] Updated weights for policy 1, policy_version 1788493 (0.0010) [2023-12-26 13:58:15,756][123090] Updated weights for policy 1, policy_version 1788503 (0.0009) [2023-12-26 13:58:15,835][123091] Updated weights for policy 0, policy_version 1800246 (0.0008) [2023-12-26 13:58:15,887][123091] Updated weights for policy 0, policy_version 1800256 (0.0007) [2023-12-26 13:58:15,958][123091] Updated weights for policy 0, policy_version 1800266 (0.0007) [2023-12-26 13:58:16,595][123090] Updated weights for policy 1, policy_version 1788513 (0.0009) [2023-12-26 13:58:16,642][123090] Updated weights for policy 1, policy_version 1788523 (0.0005) [2023-12-26 13:58:16,696][123090] Updated weights for policy 1, policy_version 1788533 (0.0006) [2023-12-26 13:58:16,724][123091] Updated weights for policy 0, policy_version 1800276 (0.0006) [2023-12-26 13:58:16,746][123090] Updated weights for policy 1, policy_version 1788543 (0.0009) [2023-12-26 13:58:16,775][123091] Updated weights for policy 0, policy_version 1800286 (0.0005) [2023-12-26 13:58:16,834][123091] Updated weights for policy 0, policy_version 1800296 (0.0005) [2023-12-26 13:58:17,544][123091] Updated weights for policy 0, policy_version 1800306 (0.0006) [2023-12-26 13:58:17,598][123090] Updated weights for policy 1, policy_version 1788553 (0.0006) [2023-12-26 13:58:17,600][123091] Updated weights for policy 0, policy_version 1800316 (0.0009) [2023-12-26 13:58:17,653][123091] Updated weights for policy 0, policy_version 1800326 (0.0009) [2023-12-26 13:58:17,662][123090] Updated weights for policy 1, policy_version 1788563 (0.0005) [2023-12-26 13:58:17,701][123091] Updated weights for policy 0, policy_version 1800336 (0.0009) [2023-12-26 13:58:17,729][123090] Updated weights for policy 1, policy_version 1788573 (0.0005) [2023-12-26 13:58:18,354][123090] Updated weights for policy 1, policy_version 1788583 (0.0007) [2023-12-26 13:58:18,420][123090] Updated weights for policy 1, policy_version 1788593 (0.0008) [2023-12-26 13:58:18,489][123090] Updated weights for policy 1, policy_version 1788603 (0.0008) [2023-12-26 13:58:18,599][123091] Updated weights for policy 0, policy_version 1800346 (0.0006) [2023-12-26 13:58:18,664][123091] Updated weights for policy 0, policy_version 1800356 (0.0005) [2023-12-26 13:58:18,728][123091] Updated weights for policy 0, policy_version 1800366 (0.0005) [2023-12-26 13:58:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 918781952. Throughput: 0: 8961.1, 1: 8857.1. Samples: 918789008. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:18,785][121949] Avg episode reward: [(0, '6297.616'), (1, '5880.092')] [2023-12-26 13:58:19,252][123090] Updated weights for policy 1, policy_version 1788613 (0.0008) [2023-12-26 13:58:19,319][123090] Updated weights for policy 1, policy_version 1788623 (0.0006) [2023-12-26 13:58:19,388][123090] Updated weights for policy 1, policy_version 1788633 (0.0011) [2023-12-26 13:58:19,518][123091] Updated weights for policy 0, policy_version 1800376 (0.0008) [2023-12-26 13:58:19,586][123091] Updated weights for policy 0, policy_version 1800386 (0.0010) [2023-12-26 13:58:19,654][123091] Updated weights for policy 0, policy_version 1800396 (0.0010) [2023-12-26 13:58:20,205][123090] Updated weights for policy 1, policy_version 1788643 (0.0010) [2023-12-26 13:58:20,279][123090] Updated weights for policy 1, policy_version 1788653 (0.0009) [2023-12-26 13:58:20,350][123090] Updated weights for policy 1, policy_version 1788663 (0.0006) [2023-12-26 13:58:20,502][123091] Updated weights for policy 0, policy_version 1800406 (0.0009) [2023-12-26 13:58:20,575][123091] Updated weights for policy 0, policy_version 1800416 (0.0008) [2023-12-26 13:58:20,648][123091] Updated weights for policy 0, policy_version 1800426 (0.0010) [2023-12-26 13:58:21,113][123090] Updated weights for policy 1, policy_version 1788673 (0.0006) [2023-12-26 13:58:21,181][123090] Updated weights for policy 1, policy_version 1788683 (0.0010) [2023-12-26 13:58:21,250][123090] Updated weights for policy 1, policy_version 1788693 (0.0009) [2023-12-26 13:58:21,309][123090] Updated weights for policy 1, policy_version 1788703 (0.0009) [2023-12-26 13:58:21,513][123091] Updated weights for policy 0, policy_version 1800436 (0.0010) [2023-12-26 13:58:21,585][123091] Updated weights for policy 0, policy_version 1800446 (0.0008) [2023-12-26 13:58:21,655][123091] Updated weights for policy 0, policy_version 1800456 (0.0009) [2023-12-26 13:58:22,158][123090] Updated weights for policy 1, policy_version 1788713 (0.0006) [2023-12-26 13:58:22,225][123090] Updated weights for policy 1, policy_version 1788723 (0.0009) [2023-12-26 13:58:22,295][123090] Updated weights for policy 1, policy_version 1788733 (0.0010) [2023-12-26 13:58:22,537][123091] Updated weights for policy 0, policy_version 1800466 (0.0009) [2023-12-26 13:58:22,587][123091] Updated weights for policy 0, policy_version 1800476 (0.0009) [2023-12-26 13:58:22,646][123091] Updated weights for policy 0, policy_version 1800486 (0.0008) [2023-12-26 13:58:22,702][123091] Updated weights for policy 0, policy_version 1800496 (0.0008) [2023-12-26 13:58:23,076][123090] Updated weights for policy 1, policy_version 1788743 (0.0008) [2023-12-26 13:58:23,138][123090] Updated weights for policy 1, policy_version 1788753 (0.0005) [2023-12-26 13:58:23,205][123090] Updated weights for policy 1, policy_version 1788763 (0.0009) [2023-12-26 13:58:23,515][123091] Updated weights for policy 0, policy_version 1800506 (0.0011) [2023-12-26 13:58:23,574][123091] Updated weights for policy 0, policy_version 1800516 (0.0011) [2023-12-26 13:58:23,627][123091] Updated weights for policy 0, policy_version 1800526 (0.0007) [2023-12-26 13:58:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 918863872. Throughput: 0: 8913.4, 1: 8835.8. Samples: 918840012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:23,785][121949] Avg episode reward: [(0, '6271.049'), (1, '5879.368')] [2023-12-26 13:58:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001800528_460939264.pth... [2023-12-26 13:58:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001788768_457924608.pth... [2023-12-26 13:58:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001799504_460677120.pth [2023-12-26 13:58:23,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001787744_457662464.pth [2023-12-26 13:58:24,027][123090] Updated weights for policy 1, policy_version 1788773 (0.0009) [2023-12-26 13:58:24,075][123090] Updated weights for policy 1, policy_version 1788783 (0.0009) [2023-12-26 13:58:24,143][123090] Updated weights for policy 1, policy_version 1788793 (0.0009) [2023-12-26 13:58:24,382][123091] Updated weights for policy 0, policy_version 1800536 (0.0010) [2023-12-26 13:58:24,444][123091] Updated weights for policy 0, policy_version 1800546 (0.0010) [2023-12-26 13:58:24,496][123091] Updated weights for policy 0, policy_version 1800556 (0.0008) [2023-12-26 13:58:24,953][123090] Updated weights for policy 1, policy_version 1788803 (0.0009) [2023-12-26 13:58:25,002][123090] Updated weights for policy 1, policy_version 1788813 (0.0008) [2023-12-26 13:58:25,055][123090] Updated weights for policy 1, policy_version 1788823 (0.0009) [2023-12-26 13:58:25,248][123091] Updated weights for policy 0, policy_version 1800566 (0.0009) [2023-12-26 13:58:25,310][123091] Updated weights for policy 0, policy_version 1800576 (0.0011) [2023-12-26 13:58:25,375][123091] Updated weights for policy 0, policy_version 1800586 (0.0010) [2023-12-26 13:58:25,898][123090] Updated weights for policy 1, policy_version 1788833 (0.0010) [2023-12-26 13:58:25,949][123090] Updated weights for policy 1, policy_version 1788843 (0.0009) [2023-12-26 13:58:25,998][123090] Updated weights for policy 1, policy_version 1788853 (0.0009) [2023-12-26 13:58:26,046][123090] Updated weights for policy 1, policy_version 1788863 (0.0008) [2023-12-26 13:58:26,143][123091] Updated weights for policy 0, policy_version 1800596 (0.0009) [2023-12-26 13:58:26,202][123091] Updated weights for policy 0, policy_version 1800606 (0.0006) [2023-12-26 13:58:26,264][123091] Updated weights for policy 0, policy_version 1800616 (0.0005) [2023-12-26 13:58:26,853][123091] Updated weights for policy 0, policy_version 1800626 (0.0006) [2023-12-26 13:58:26,905][123091] Updated weights for policy 0, policy_version 1800636 (0.0008) [2023-12-26 13:58:26,971][123091] Updated weights for policy 0, policy_version 1800646 (0.0008) [2023-12-26 13:58:26,992][123090] Updated weights for policy 1, policy_version 1788873 (0.0008) [2023-12-26 13:58:27,038][123091] Updated weights for policy 0, policy_version 1800656 (0.0009) [2023-12-26 13:58:27,050][123090] Updated weights for policy 1, policy_version 1788883 (0.0008) [2023-12-26 13:58:27,103][123090] Updated weights for policy 1, policy_version 1788893 (0.0009) [2023-12-26 13:58:27,841][123090] Updated weights for policy 1, policy_version 1788903 (0.0009) [2023-12-26 13:58:27,844][123091] Updated weights for policy 0, policy_version 1800666 (0.0007) [2023-12-26 13:58:27,892][123091] Updated weights for policy 0, policy_version 1800676 (0.0009) [2023-12-26 13:58:27,896][123090] Updated weights for policy 1, policy_version 1788913 (0.0010) [2023-12-26 13:58:27,941][123091] Updated weights for policy 0, policy_version 1800686 (0.0008) [2023-12-26 13:58:27,962][123090] Updated weights for policy 1, policy_version 1788923 (0.0010) [2023-12-26 13:58:28,658][123090] Updated weights for policy 1, policy_version 1788933 (0.0008) [2023-12-26 13:58:28,709][123090] Updated weights for policy 1, policy_version 1788943 (0.0007) [2023-12-26 13:58:28,756][123090] Updated weights for policy 1, policy_version 1788953 (0.0008) [2023-12-26 13:58:28,784][121949] Fps is (10 sec: 16384.4, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 918945792. Throughput: 0: 8933.9, 1: 8832.2. Samples: 918945612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 13:58:28,785][121949] Avg episode reward: [(0, '6333.728'), (1, '5944.386')] [2023-12-26 13:58:28,827][123091] Updated weights for policy 0, policy_version 1800696 (0.0008) [2023-12-26 13:58:28,883][123091] Updated weights for policy 0, policy_version 1800707 (0.0010) [2023-12-26 13:58:28,939][123091] Updated weights for policy 0, policy_version 1800717 (0.0009) [2023-12-26 13:58:29,566][123090] Updated weights for policy 1, policy_version 1788963 (0.0007) [2023-12-26 13:58:29,627][123090] Updated weights for policy 1, policy_version 1788973 (0.0008) [2023-12-26 13:58:29,688][123090] Updated weights for policy 1, policy_version 1788983 (0.0006) [2023-12-26 13:58:29,750][123091] Updated weights for policy 0, policy_version 1800727 (0.0007) [2023-12-26 13:58:29,817][123091] Updated weights for policy 0, policy_version 1800737 (0.0007) [2023-12-26 13:58:29,885][123091] Updated weights for policy 0, policy_version 1800747 (0.0008) [2023-12-26 13:58:30,339][123090] Updated weights for policy 1, policy_version 1788993 (0.0006) [2023-12-26 13:58:30,409][123090] Updated weights for policy 1, policy_version 1789003 (0.0005) [2023-12-26 13:58:30,457][123090] Updated weights for policy 1, policy_version 1789013 (0.0005) [2023-12-26 13:58:30,507][123090] Updated weights for policy 1, policy_version 1789023 (0.0005) [2023-12-26 13:58:30,673][123091] Updated weights for policy 0, policy_version 1800757 (0.0007) [2023-12-26 13:58:30,721][123091] Updated weights for policy 0, policy_version 1800767 (0.0005) [2023-12-26 13:58:30,773][123091] Updated weights for policy 0, policy_version 1800777 (0.0005) [2023-12-26 13:58:31,194][123090] Updated weights for policy 1, policy_version 1789033 (0.0008) [2023-12-26 13:58:31,260][123090] Updated weights for policy 1, policy_version 1789043 (0.0010) [2023-12-26 13:58:31,321][123090] Updated weights for policy 1, policy_version 1789053 (0.0009) [2023-12-26 13:58:31,565][123091] Updated weights for policy 0, policy_version 1800787 (0.0006) [2023-12-26 13:58:31,625][123091] Updated weights for policy 0, policy_version 1800797 (0.0010) [2023-12-26 13:58:31,691][123091] Updated weights for policy 0, policy_version 1800807 (0.0010) [2023-12-26 13:58:32,077][123090] Updated weights for policy 1, policy_version 1789063 (0.0009) [2023-12-26 13:58:32,141][123090] Updated weights for policy 1, policy_version 1789073 (0.0005) [2023-12-26 13:58:32,206][123090] Updated weights for policy 1, policy_version 1789083 (0.0007) [2023-12-26 13:58:32,533][123091] Updated weights for policy 0, policy_version 1800817 (0.0009) [2023-12-26 13:58:32,592][123091] Updated weights for policy 0, policy_version 1800827 (0.0010) [2023-12-26 13:58:32,649][123091] Updated weights for policy 0, policy_version 1800837 (0.0009) [2023-12-26 13:58:32,704][123091] Updated weights for policy 0, policy_version 1800847 (0.0009) [2023-12-26 13:58:32,951][123090] Updated weights for policy 1, policy_version 1789093 (0.0009) [2023-12-26 13:58:33,002][123090] Updated weights for policy 1, policy_version 1789103 (0.0008) [2023-12-26 13:58:33,051][123090] Updated weights for policy 1, policy_version 1789113 (0.0009) [2023-12-26 13:58:33,540][123091] Updated weights for policy 0, policy_version 1800857 (0.0006) [2023-12-26 13:58:33,600][123091] Updated weights for policy 0, policy_version 1800867 (0.0008) [2023-12-26 13:58:33,648][123091] Updated weights for policy 0, policy_version 1800877 (0.0010) [2023-12-26 13:58:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 919044096. Throughput: 0: 8817.7, 1: 8911.8. Samples: 919054480. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:33,785][121949] Avg episode reward: [(0, '6260.635'), (1, '5952.772')] [2023-12-26 13:58:33,807][123090] Updated weights for policy 1, policy_version 1789123 (0.0008) [2023-12-26 13:58:33,853][123090] Updated weights for policy 1, policy_version 1789133 (0.0005) [2023-12-26 13:58:33,896][123090] Updated weights for policy 1, policy_version 1789143 (0.0005) [2023-12-26 13:58:34,407][123091] Updated weights for policy 0, policy_version 1800887 (0.0011) [2023-12-26 13:58:34,478][123091] Updated weights for policy 0, policy_version 1800897 (0.0011) [2023-12-26 13:58:34,549][123091] Updated weights for policy 0, policy_version 1800907 (0.0011) [2023-12-26 13:58:34,606][123090] Updated weights for policy 1, policy_version 1789153 (0.0005) [2023-12-26 13:58:34,672][123090] Updated weights for policy 1, policy_version 1789163 (0.0006) [2023-12-26 13:58:34,728][123090] Updated weights for policy 1, policy_version 1789173 (0.0006) [2023-12-26 13:58:34,790][123090] Updated weights for policy 1, policy_version 1789183 (0.0006) [2023-12-26 13:58:35,351][123091] Updated weights for policy 0, policy_version 1800917 (0.0008) [2023-12-26 13:58:35,386][123090] Updated weights for policy 1, policy_version 1789193 (0.0009) [2023-12-26 13:58:35,404][123091] Updated weights for policy 0, policy_version 1800927 (0.0005) [2023-12-26 13:58:35,454][123090] Updated weights for policy 1, policy_version 1789203 (0.0011) [2023-12-26 13:58:35,472][123091] Updated weights for policy 0, policy_version 1800937 (0.0008) [2023-12-26 13:58:35,507][123090] Updated weights for policy 1, policy_version 1789213 (0.0010) [2023-12-26 13:58:36,160][123091] Updated weights for policy 0, policy_version 1800947 (0.0009) [2023-12-26 13:58:36,223][123091] Updated weights for policy 0, policy_version 1800957 (0.0008) [2023-12-26 13:58:36,295][123091] Updated weights for policy 0, policy_version 1800967 (0.0011) [2023-12-26 13:58:36,324][123090] Updated weights for policy 1, policy_version 1789223 (0.0007) [2023-12-26 13:58:36,384][123090] Updated weights for policy 1, policy_version 1789233 (0.0005) [2023-12-26 13:58:36,445][123090] Updated weights for policy 1, policy_version 1789243 (0.0006) [2023-12-26 13:58:37,053][123091] Updated weights for policy 0, policy_version 1800977 (0.0009) [2023-12-26 13:58:37,110][123091] Updated weights for policy 0, policy_version 1800987 (0.0009) [2023-12-26 13:58:37,169][123091] Updated weights for policy 0, policy_version 1800997 (0.0009) [2023-12-26 13:58:37,233][123090] Updated weights for policy 1, policy_version 1789253 (0.0011) [2023-12-26 13:58:37,240][123091] Updated weights for policy 0, policy_version 1801007 (0.0005) [2023-12-26 13:58:37,302][123090] Updated weights for policy 1, policy_version 1789263 (0.0010) [2023-12-26 13:58:37,358][123090] Updated weights for policy 1, policy_version 1789273 (0.0010) [2023-12-26 13:58:38,008][123091] Updated weights for policy 0, policy_version 1801017 (0.0009) [2023-12-26 13:58:38,072][123091] Updated weights for policy 0, policy_version 1801027 (0.0010) [2023-12-26 13:58:38,128][123091] Updated weights for policy 0, policy_version 1801037 (0.0010) [2023-12-26 13:58:38,151][123090] Updated weights for policy 1, policy_version 1789283 (0.0011) [2023-12-26 13:58:38,223][123090] Updated weights for policy 1, policy_version 1789293 (0.0011) [2023-12-26 13:58:38,289][123090] Updated weights for policy 1, policy_version 1789303 (0.0010) [2023-12-26 13:58:38,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 919134208. Throughput: 0: 8829.9, 1: 8989.9. Samples: 919111516. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:38,785][121949] Avg episode reward: [(0, '6174.239'), (1, '5925.776')] [2023-12-26 13:58:38,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001801040_461070336.pth... [2023-12-26 13:58:38,797][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001789312_458063872.pth... [2023-12-26 13:58:38,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001800016_460808192.pth [2023-12-26 13:58:38,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001788256_457793536.pth [2023-12-26 13:58:39,005][123091] Updated weights for policy 0, policy_version 1801047 (0.0009) [2023-12-26 13:58:39,062][123091] Updated weights for policy 0, policy_version 1801057 (0.0010) [2023-12-26 13:58:39,075][123090] Updated weights for policy 1, policy_version 1789313 (0.0009) [2023-12-26 13:58:39,124][123091] Updated weights for policy 0, policy_version 1801067 (0.0009) [2023-12-26 13:58:39,135][123090] Updated weights for policy 1, policy_version 1789323 (0.0005) [2023-12-26 13:58:39,194][123090] Updated weights for policy 1, policy_version 1789333 (0.0006) [2023-12-26 13:58:39,276][123090] Updated weights for policy 1, policy_version 1789344 (0.0009) [2023-12-26 13:58:40,057][123090] Updated weights for policy 1, policy_version 1789354 (0.0010) [2023-12-26 13:58:40,076][123091] Updated weights for policy 0, policy_version 1801077 (0.0008) [2023-12-26 13:58:40,121][123090] Updated weights for policy 1, policy_version 1789364 (0.0011) [2023-12-26 13:58:40,137][123091] Updated weights for policy 0, policy_version 1801087 (0.0006) [2023-12-26 13:58:40,194][123090] Updated weights for policy 1, policy_version 1789374 (0.0011) [2023-12-26 13:58:40,197][123091] Updated weights for policy 0, policy_version 1801097 (0.0006) [2023-12-26 13:58:40,947][123090] Updated weights for policy 1, policy_version 1789384 (0.0009) [2023-12-26 13:58:41,015][123090] Updated weights for policy 1, policy_version 1789394 (0.0011) [2023-12-26 13:58:41,059][123091] Updated weights for policy 0, policy_version 1801107 (0.0008) [2023-12-26 13:58:41,083][123090] Updated weights for policy 1, policy_version 1789404 (0.0010) [2023-12-26 13:58:41,121][123091] Updated weights for policy 0, policy_version 1801117 (0.0008) [2023-12-26 13:58:41,190][123091] Updated weights for policy 0, policy_version 1801127 (0.0009) [2023-12-26 13:58:41,899][123090] Updated weights for policy 1, policy_version 1789414 (0.0009) [2023-12-26 13:58:41,967][123090] Updated weights for policy 1, policy_version 1789424 (0.0008) [2023-12-26 13:58:42,025][123090] Updated weights for policy 1, policy_version 1789434 (0.0008) [2023-12-26 13:58:42,081][123091] Updated weights for policy 0, policy_version 1801137 (0.0009) [2023-12-26 13:58:42,149][123091] Updated weights for policy 0, policy_version 1801147 (0.0010) [2023-12-26 13:58:42,214][123091] Updated weights for policy 0, policy_version 1801157 (0.0009) [2023-12-26 13:58:42,271][123091] Updated weights for policy 0, policy_version 1801167 (0.0010) [2023-12-26 13:58:42,868][123090] Updated weights for policy 1, policy_version 1789444 (0.0009) [2023-12-26 13:58:42,923][123090] Updated weights for policy 1, policy_version 1789454 (0.0010) [2023-12-26 13:58:42,989][123090] Updated weights for policy 1, policy_version 1789464 (0.0010) [2023-12-26 13:58:43,022][123091] Updated weights for policy 0, policy_version 1801177 (0.0008) [2023-12-26 13:58:43,074][123091] Updated weights for policy 0, policy_version 1801187 (0.0008) [2023-12-26 13:58:43,135][123091] Updated weights for policy 0, policy_version 1801197 (0.0007) [2023-12-26 13:58:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 919216128. Throughput: 0: 8730.4, 1: 9063.6. Samples: 919214484. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:43,784][121949] Avg episode reward: [(0, '6184.549'), (1, '5831.728')] [2023-12-26 13:58:43,804][123090] Updated weights for policy 1, policy_version 1789474 (0.0009) [2023-12-26 13:58:43,862][123091] Updated weights for policy 0, policy_version 1801207 (0.0006) [2023-12-26 13:58:43,869][123090] Updated weights for policy 1, policy_version 1789484 (0.0006) [2023-12-26 13:58:43,915][123091] Updated weights for policy 0, policy_version 1801217 (0.0005) [2023-12-26 13:58:43,921][123090] Updated weights for policy 1, policy_version 1789494 (0.0010) [2023-12-26 13:58:43,960][123091] Updated weights for policy 0, policy_version 1801227 (0.0006) [2023-12-26 13:58:43,980][123090] Updated weights for policy 1, policy_version 1789504 (0.0010) [2023-12-26 13:58:44,787][123091] Updated weights for policy 0, policy_version 1801237 (0.0007) [2023-12-26 13:58:44,802][123090] Updated weights for policy 1, policy_version 1789514 (0.0011) [2023-12-26 13:58:44,845][123091] Updated weights for policy 0, policy_version 1801247 (0.0007) [2023-12-26 13:58:44,867][123090] Updated weights for policy 1, policy_version 1789524 (0.0011) [2023-12-26 13:58:44,913][123091] Updated weights for policy 0, policy_version 1801257 (0.0007) [2023-12-26 13:58:44,935][123090] Updated weights for policy 1, policy_version 1789534 (0.0011) [2023-12-26 13:58:45,733][123091] Updated weights for policy 0, policy_version 1801267 (0.0007) [2023-12-26 13:58:45,751][123090] Updated weights for policy 1, policy_version 1789544 (0.0010) [2023-12-26 13:58:45,781][123091] Updated weights for policy 0, policy_version 1801277 (0.0006) [2023-12-26 13:58:45,800][123090] Updated weights for policy 1, policy_version 1789554 (0.0010) [2023-12-26 13:58:45,832][123091] Updated weights for policy 0, policy_version 1801287 (0.0006) [2023-12-26 13:58:45,862][123090] Updated weights for policy 1, policy_version 1789564 (0.0010) [2023-12-26 13:58:46,683][123091] Updated weights for policy 0, policy_version 1801297 (0.0009) [2023-12-26 13:58:46,697][123090] Updated weights for policy 1, policy_version 1789574 (0.0010) [2023-12-26 13:58:46,746][123091] Updated weights for policy 0, policy_version 1801307 (0.0006) [2023-12-26 13:58:46,752][123090] Updated weights for policy 1, policy_version 1789584 (0.0010) [2023-12-26 13:58:46,804][123091] Updated weights for policy 0, policy_version 1801317 (0.0005) [2023-12-26 13:58:46,814][123090] Updated weights for policy 1, policy_version 1789594 (0.0010) [2023-12-26 13:58:46,868][123091] Updated weights for policy 0, policy_version 1801327 (0.0008) [2023-12-26 13:58:47,635][123090] Updated weights for policy 1, policy_version 1789604 (0.0010) [2023-12-26 13:58:47,641][123091] Updated weights for policy 0, policy_version 1801337 (0.0010) [2023-12-26 13:58:47,687][123091] Updated weights for policy 0, policy_version 1801347 (0.0008) [2023-12-26 13:58:47,698][123090] Updated weights for policy 1, policy_version 1789614 (0.0010) [2023-12-26 13:58:47,748][123091] Updated weights for policy 0, policy_version 1801357 (0.0008) [2023-12-26 13:58:47,761][123090] Updated weights for policy 1, policy_version 1789624 (0.0010) [2023-12-26 13:58:48,561][123091] Updated weights for policy 0, policy_version 1801367 (0.0010) [2023-12-26 13:58:48,571][123090] Updated weights for policy 1, policy_version 1789634 (0.0010) [2023-12-26 13:58:48,614][123091] Updated weights for policy 0, policy_version 1801377 (0.0010) [2023-12-26 13:58:48,627][123090] Updated weights for policy 1, policy_version 1789644 (0.0010) [2023-12-26 13:58:48,670][123091] Updated weights for policy 0, policy_version 1801387 (0.0010) [2023-12-26 13:58:48,683][123090] Updated weights for policy 1, policy_version 1789654 (0.0010) [2023-12-26 13:58:48,755][123090] Updated weights for policy 1, policy_version 1789664 (0.0011) [2023-12-26 13:58:48,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 919314432. Throughput: 0: 8700.4, 1: 9007.6. Samples: 919319496. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:48,785][121949] Avg episode reward: [(0, '6182.081'), (1, '5779.939')] [2023-12-26 13:58:49,411][123091] Updated weights for policy 0, policy_version 1801397 (0.0008) [2023-12-26 13:58:49,475][123091] Updated weights for policy 0, policy_version 1801407 (0.0006) [2023-12-26 13:58:49,537][123091] Updated weights for policy 0, policy_version 1801417 (0.0008) [2023-12-26 13:58:49,538][123090] Updated weights for policy 1, policy_version 1789674 (0.0011) [2023-12-26 13:58:49,600][123090] Updated weights for policy 1, policy_version 1789684 (0.0010) [2023-12-26 13:58:49,664][123090] Updated weights for policy 1, policy_version 1789694 (0.0011) [2023-12-26 13:58:50,332][123091] Updated weights for policy 0, policy_version 1801427 (0.0010) [2023-12-26 13:58:50,391][123091] Updated weights for policy 0, policy_version 1801437 (0.0010) [2023-12-26 13:58:50,461][123091] Updated weights for policy 0, policy_version 1801447 (0.0010) [2023-12-26 13:58:50,491][123090] Updated weights for policy 1, policy_version 1789704 (0.0010) [2023-12-26 13:58:50,562][123090] Updated weights for policy 1, policy_version 1789714 (0.0010) [2023-12-26 13:58:50,627][123090] Updated weights for policy 1, policy_version 1789724 (0.0009) [2023-12-26 13:58:51,268][123091] Updated weights for policy 0, policy_version 1801457 (0.0006) [2023-12-26 13:58:51,328][123091] Updated weights for policy 0, policy_version 1801467 (0.0009) [2023-12-26 13:58:51,400][123091] Updated weights for policy 0, policy_version 1801477 (0.0010) [2023-12-26 13:58:51,448][123090] Updated weights for policy 1, policy_version 1789734 (0.0009) [2023-12-26 13:58:51,454][123091] Updated weights for policy 0, policy_version 1801488 (0.0009) [2023-12-26 13:58:51,519][123090] Updated weights for policy 1, policy_version 1789744 (0.0009) [2023-12-26 13:58:51,592][123090] Updated weights for policy 1, policy_version 1789754 (0.0008) [2023-12-26 13:58:52,232][123091] Updated weights for policy 0, policy_version 1801498 (0.0010) [2023-12-26 13:58:52,297][123091] Updated weights for policy 0, policy_version 1801508 (0.0008) [2023-12-26 13:58:52,374][123091] Updated weights for policy 0, policy_version 1801518 (0.0009) [2023-12-26 13:58:52,423][123090] Updated weights for policy 1, policy_version 1789764 (0.0010) [2023-12-26 13:58:52,482][123090] Updated weights for policy 1, policy_version 1789774 (0.0009) [2023-12-26 13:58:52,551][123090] Updated weights for policy 1, policy_version 1789784 (0.0007) [2023-12-26 13:58:53,174][123091] Updated weights for policy 0, policy_version 1801528 (0.0010) [2023-12-26 13:58:53,228][123091] Updated weights for policy 0, policy_version 1801538 (0.0009) [2023-12-26 13:58:53,230][123090] Updated weights for policy 1, policy_version 1789794 (0.0006) [2023-12-26 13:58:53,280][123090] Updated weights for policy 1, policy_version 1789804 (0.0009) [2023-12-26 13:58:53,294][123091] Updated weights for policy 0, policy_version 1801548 (0.0006) [2023-12-26 13:58:53,327][123090] Updated weights for policy 1, policy_version 1789814 (0.0008) [2023-12-26 13:58:53,376][123090] Updated weights for policy 1, policy_version 1789824 (0.0009) [2023-12-26 13:58:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 919396352. Throughput: 0: 8739.9, 1: 8934.7. Samples: 919371956. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:53,785][121949] Avg episode reward: [(0, '6238.637'), (1, '5881.565')] [2023-12-26 13:58:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001801552_461201408.pth... [2023-12-26 13:58:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001789824_458194944.pth... [2023-12-26 13:58:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001800528_460939264.pth [2023-12-26 13:58:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001788768_457924608.pth [2023-12-26 13:58:54,084][123090] Updated weights for policy 1, policy_version 1789834 (0.0010) [2023-12-26 13:58:54,139][123090] Updated weights for policy 1, policy_version 1789844 (0.0009) [2023-12-26 13:58:54,178][123091] Updated weights for policy 0, policy_version 1801558 (0.0008) [2023-12-26 13:58:54,198][123090] Updated weights for policy 1, policy_version 1789854 (0.0008) [2023-12-26 13:58:54,238][123091] Updated weights for policy 0, policy_version 1801568 (0.0009) [2023-12-26 13:58:54,299][123091] Updated weights for policy 0, policy_version 1801578 (0.0009) [2023-12-26 13:58:55,017][123090] Updated weights for policy 1, policy_version 1789864 (0.0007) [2023-12-26 13:58:55,087][123090] Updated weights for policy 1, policy_version 1789874 (0.0005) [2023-12-26 13:58:55,160][123090] Updated weights for policy 1, policy_version 1789884 (0.0007) [2023-12-26 13:58:55,167][123091] Updated weights for policy 0, policy_version 1801588 (0.0009) [2023-12-26 13:58:55,231][123091] Updated weights for policy 0, policy_version 1801598 (0.0010) [2023-12-26 13:58:55,283][123091] Updated weights for policy 0, policy_version 1801609 (0.0010) [2023-12-26 13:58:55,851][123090] Updated weights for policy 1, policy_version 1789894 (0.0005) [2023-12-26 13:58:55,900][123090] Updated weights for policy 1, policy_version 1789904 (0.0005) [2023-12-26 13:58:55,953][123090] Updated weights for policy 1, policy_version 1789914 (0.0005) [2023-12-26 13:58:56,077][123091] Updated weights for policy 0, policy_version 1801620 (0.0009) [2023-12-26 13:58:56,132][123091] Updated weights for policy 0, policy_version 1801631 (0.0010) [2023-12-26 13:58:56,188][123091] Updated weights for policy 0, policy_version 1801642 (0.0010) [2023-12-26 13:58:56,725][123090] Updated weights for policy 1, policy_version 1789924 (0.0007) [2023-12-26 13:58:56,793][123090] Updated weights for policy 1, policy_version 1789934 (0.0010) [2023-12-26 13:58:56,844][123090] Updated weights for policy 1, policy_version 1789944 (0.0009) [2023-12-26 13:58:57,072][123091] Updated weights for policy 0, policy_version 1801652 (0.0009) [2023-12-26 13:58:57,136][123091] Updated weights for policy 0, policy_version 1801662 (0.0010) [2023-12-26 13:58:57,195][123091] Updated weights for policy 0, policy_version 1801672 (0.0010) [2023-12-26 13:58:57,617][123090] Updated weights for policy 1, policy_version 1789954 (0.0008) [2023-12-26 13:58:57,683][123090] Updated weights for policy 1, policy_version 1789964 (0.0009) [2023-12-26 13:58:57,748][123090] Updated weights for policy 1, policy_version 1789974 (0.0010) [2023-12-26 13:58:57,815][123090] Updated weights for policy 1, policy_version 1789984 (0.0010) [2023-12-26 13:58:58,035][123091] Updated weights for policy 0, policy_version 1801682 (0.0009) [2023-12-26 13:58:58,106][123091] Updated weights for policy 0, policy_version 1801692 (0.0008) [2023-12-26 13:58:58,173][123091] Updated weights for policy 0, policy_version 1801702 (0.0007) [2023-12-26 13:58:58,225][123091] Updated weights for policy 0, policy_version 1801712 (0.0005) [2023-12-26 13:58:58,624][123090] Updated weights for policy 1, policy_version 1789994 (0.0008) [2023-12-26 13:58:58,683][123090] Updated weights for policy 1, policy_version 1790004 (0.0008) [2023-12-26 13:58:58,738][123090] Updated weights for policy 1, policy_version 1790014 (0.0008) [2023-12-26 13:58:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 919486464. Throughput: 0: 8733.5, 1: 9013.7. Samples: 919479652. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:58:58,785][121949] Avg episode reward: [(0, '6219.561'), (1, '5985.576')] [2023-12-26 13:58:59,050][123091] Updated weights for policy 0, policy_version 1801722 (0.0008) [2023-12-26 13:58:59,117][123091] Updated weights for policy 0, policy_version 1801732 (0.0010) [2023-12-26 13:58:59,176][123091] Updated weights for policy 0, policy_version 1801742 (0.0010) [2023-12-26 13:58:59,668][123090] Updated weights for policy 1, policy_version 1790024 (0.0009) [2023-12-26 13:58:59,735][123090] Updated weights for policy 1, policy_version 1790034 (0.0011) [2023-12-26 13:58:59,797][123090] Updated weights for policy 1, policy_version 1790044 (0.0010) [2023-12-26 13:58:59,972][123091] Updated weights for policy 0, policy_version 1801752 (0.0010) [2023-12-26 13:59:00,029][123091] Updated weights for policy 0, policy_version 1801762 (0.0009) [2023-12-26 13:59:00,077][123091] Updated weights for policy 0, policy_version 1801772 (0.0008) [2023-12-26 13:59:00,476][123090] Updated weights for policy 1, policy_version 1790054 (0.0008) [2023-12-26 13:59:00,531][123090] Updated weights for policy 1, policy_version 1790064 (0.0005) [2023-12-26 13:59:00,585][123090] Updated weights for policy 1, policy_version 1790074 (0.0005) [2023-12-26 13:59:00,869][123091] Updated weights for policy 0, policy_version 1801782 (0.0007) [2023-12-26 13:59:00,923][123091] Updated weights for policy 0, policy_version 1801792 (0.0005) [2023-12-26 13:59:00,975][123091] Updated weights for policy 0, policy_version 1801802 (0.0009) [2023-12-26 13:59:01,324][123090] Updated weights for policy 1, policy_version 1790084 (0.0005) [2023-12-26 13:59:01,397][123090] Updated weights for policy 1, policy_version 1790094 (0.0007) [2023-12-26 13:59:01,470][123090] Updated weights for policy 1, policy_version 1790104 (0.0007) [2023-12-26 13:59:01,741][123091] Updated weights for policy 0, policy_version 1801812 (0.0009) [2023-12-26 13:59:01,796][123091] Updated weights for policy 0, policy_version 1801822 (0.0005) [2023-12-26 13:59:01,845][123091] Updated weights for policy 0, policy_version 1801832 (0.0005) [2023-12-26 13:59:02,189][123090] Updated weights for policy 1, policy_version 1790114 (0.0007) [2023-12-26 13:59:02,243][123090] Updated weights for policy 1, policy_version 1790124 (0.0010) [2023-12-26 13:59:02,307][123090] Updated weights for policy 1, policy_version 1790134 (0.0010) [2023-12-26 13:59:02,371][123090] Updated weights for policy 1, policy_version 1790144 (0.0009) [2023-12-26 13:59:02,536][123091] Updated weights for policy 0, policy_version 1801842 (0.0006) [2023-12-26 13:59:02,601][123091] Updated weights for policy 0, policy_version 1801852 (0.0008) [2023-12-26 13:59:02,662][123091] Updated weights for policy 0, policy_version 1801862 (0.0008) [2023-12-26 13:59:02,730][123091] Updated weights for policy 0, policy_version 1801872 (0.0008) [2023-12-26 13:59:03,149][123090] Updated weights for policy 1, policy_version 1790154 (0.0009) [2023-12-26 13:59:03,204][123090] Updated weights for policy 1, policy_version 1790164 (0.0009) [2023-12-26 13:59:03,264][123090] Updated weights for policy 1, policy_version 1790174 (0.0010) [2023-12-26 13:59:03,407][123091] Updated weights for policy 0, policy_version 1801882 (0.0010) [2023-12-26 13:59:03,454][123091] Updated weights for policy 0, policy_version 1801892 (0.0010) [2023-12-26 13:59:03,504][123091] Updated weights for policy 0, policy_version 1801902 (0.0010) [2023-12-26 13:59:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 919576576. Throughput: 0: 8769.4, 1: 8962.7. Samples: 919586952. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:03,785][121949] Avg episode reward: [(0, '6287.342'), (1, '6037.725')] [2023-12-26 13:59:04,125][123090] Updated weights for policy 1, policy_version 1790184 (0.0009) [2023-12-26 13:59:04,194][123090] Updated weights for policy 1, policy_version 1790194 (0.0009) [2023-12-26 13:59:04,256][123090] Updated weights for policy 1, policy_version 1790204 (0.0009) [2023-12-26 13:59:04,370][123091] Updated weights for policy 0, policy_version 1801912 (0.0011) [2023-12-26 13:59:04,426][123091] Updated weights for policy 0, policy_version 1801922 (0.0011) [2023-12-26 13:59:04,493][123091] Updated weights for policy 0, policy_version 1801932 (0.0011) [2023-12-26 13:59:05,113][123090] Updated weights for policy 1, policy_version 1790214 (0.0010) [2023-12-26 13:59:05,165][123090] Updated weights for policy 1, policy_version 1790224 (0.0010) [2023-12-26 13:59:05,205][123091] Updated weights for policy 0, policy_version 1801942 (0.0010) [2023-12-26 13:59:05,216][123090] Updated weights for policy 1, policy_version 1790234 (0.0008) [2023-12-26 13:59:05,271][123091] Updated weights for policy 0, policy_version 1801952 (0.0011) [2023-12-26 13:59:05,322][123091] Updated weights for policy 0, policy_version 1801962 (0.0006) [2023-12-26 13:59:05,990][123091] Updated weights for policy 0, policy_version 1801972 (0.0005) [2023-12-26 13:59:05,990][123090] Updated weights for policy 1, policy_version 1790244 (0.0007) [2023-12-26 13:59:06,050][123090] Updated weights for policy 1, policy_version 1790254 (0.0010) [2023-12-26 13:59:06,055][123091] Updated weights for policy 0, policy_version 1801982 (0.0009) [2023-12-26 13:59:06,105][123090] Updated weights for policy 1, policy_version 1790264 (0.0010) [2023-12-26 13:59:06,141][123091] Updated weights for policy 0, policy_version 1801992 (0.0011) [2023-12-26 13:59:06,853][123091] Updated weights for policy 0, policy_version 1802002 (0.0008) [2023-12-26 13:59:06,903][123091] Updated weights for policy 0, policy_version 1802012 (0.0005) [2023-12-26 13:59:06,946][123090] Updated weights for policy 1, policy_version 1790274 (0.0010) [2023-12-26 13:59:06,962][123091] Updated weights for policy 0, policy_version 1802022 (0.0007) [2023-12-26 13:59:07,008][123090] Updated weights for policy 1, policy_version 1790284 (0.0008) [2023-12-26 13:59:07,022][123091] Updated weights for policy 0, policy_version 1802032 (0.0011) [2023-12-26 13:59:07,075][123090] Updated weights for policy 1, policy_version 1790294 (0.0008) [2023-12-26 13:59:07,136][123090] Updated weights for policy 1, policy_version 1790304 (0.0008) [2023-12-26 13:59:07,806][123091] Updated weights for policy 0, policy_version 1802042 (0.0009) [2023-12-26 13:59:07,867][123090] Updated weights for policy 1, policy_version 1790314 (0.0009) [2023-12-26 13:59:07,868][123091] Updated weights for policy 0, policy_version 1802052 (0.0006) [2023-12-26 13:59:07,919][123091] Updated weights for policy 0, policy_version 1802062 (0.0010) [2023-12-26 13:59:07,924][123090] Updated weights for policy 1, policy_version 1790324 (0.0005) [2023-12-26 13:59:07,982][123090] Updated weights for policy 1, policy_version 1790334 (0.0005) [2023-12-26 13:59:08,653][123090] Updated weights for policy 1, policy_version 1790344 (0.0005) [2023-12-26 13:59:08,716][123090] Updated weights for policy 1, policy_version 1790354 (0.0007) [2023-12-26 13:59:08,739][123091] Updated weights for policy 0, policy_version 1802072 (0.0006) [2023-12-26 13:59:08,776][123090] Updated weights for policy 1, policy_version 1790364 (0.0006) [2023-12-26 13:59:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 919658496. Throughput: 0: 8853.6, 1: 8956.5. Samples: 919641460. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:08,785][121949] Avg episode reward: [(0, '6356.086'), (1, '5810.978')] [2023-12-26 13:59:08,799][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001790368_458334208.pth... [2023-12-26 13:59:08,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001789312_458063872.pth [2023-12-26 13:59:08,807][123091] Updated weights for policy 0, policy_version 1802082 (0.0006) [2023-12-26 13:59:08,869][123091] Updated weights for policy 0, policy_version 1802092 (0.0008) [2023-12-26 13:59:08,889][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001802096_461340672.pth... [2023-12-26 13:59:08,894][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001801040_461070336.pth [2023-12-26 13:59:09,506][123090] Updated weights for policy 1, policy_version 1790374 (0.0009) [2023-12-26 13:59:09,567][123090] Updated weights for policy 1, policy_version 1790384 (0.0010) [2023-12-26 13:59:09,621][123090] Updated weights for policy 1, policy_version 1790394 (0.0009) [2023-12-26 13:59:09,762][123091] Updated weights for policy 0, policy_version 1802102 (0.0009) [2023-12-26 13:59:09,816][123091] Updated weights for policy 0, policy_version 1802112 (0.0010) [2023-12-26 13:59:09,886][123091] Updated weights for policy 0, policy_version 1802122 (0.0009) [2023-12-26 13:59:10,477][123090] Updated weights for policy 1, policy_version 1790404 (0.0013) [2023-12-26 13:59:10,524][123090] Updated weights for policy 1, policy_version 1790414 (0.0010) [2023-12-26 13:59:10,573][123090] Updated weights for policy 1, policy_version 1790424 (0.0010) [2023-12-26 13:59:10,725][123091] Updated weights for policy 0, policy_version 1802132 (0.0008) [2023-12-26 13:59:10,791][123091] Updated weights for policy 0, policy_version 1802142 (0.0006) [2023-12-26 13:59:10,862][123091] Updated weights for policy 0, policy_version 1802152 (0.0005) [2023-12-26 13:59:11,378][123090] Updated weights for policy 1, policy_version 1790434 (0.0010) [2023-12-26 13:59:11,455][123090] Updated weights for policy 1, policy_version 1790444 (0.0009) [2023-12-26 13:59:11,519][123090] Updated weights for policy 1, policy_version 1790454 (0.0011) [2023-12-26 13:59:11,571][123091] Updated weights for policy 0, policy_version 1802162 (0.0009) [2023-12-26 13:59:11,575][123090] Updated weights for policy 1, policy_version 1790464 (0.0011) [2023-12-26 13:59:11,662][123091] Updated weights for policy 0, policy_version 1802172 (0.0008) [2023-12-26 13:59:11,735][123091] Updated weights for policy 0, policy_version 1802182 (0.0008) [2023-12-26 13:59:11,804][123091] Updated weights for policy 0, policy_version 1802192 (0.0006) [2023-12-26 13:59:12,403][123090] Updated weights for policy 1, policy_version 1790474 (0.0014) [2023-12-26 13:59:12,472][123090] Updated weights for policy 1, policy_version 1790484 (0.0011) [2023-12-26 13:59:12,538][123090] Updated weights for policy 1, policy_version 1790494 (0.0011) [2023-12-26 13:59:12,549][123091] Updated weights for policy 0, policy_version 1802202 (0.0006) [2023-12-26 13:59:12,615][123091] Updated weights for policy 0, policy_version 1802212 (0.0008) [2023-12-26 13:59:12,680][123091] Updated weights for policy 0, policy_version 1802222 (0.0009) [2023-12-26 13:59:13,342][123090] Updated weights for policy 1, policy_version 1790504 (0.0006) [2023-12-26 13:59:13,396][123090] Updated weights for policy 1, policy_version 1790514 (0.0007) [2023-12-26 13:59:13,443][123091] Updated weights for policy 0, policy_version 1802232 (0.0006) [2023-12-26 13:59:13,453][123090] Updated weights for policy 1, policy_version 1790524 (0.0008) [2023-12-26 13:59:13,497][123091] Updated weights for policy 0, policy_version 1802242 (0.0010) [2023-12-26 13:59:13,545][123091] Updated weights for policy 0, policy_version 1802252 (0.0010) [2023-12-26 13:59:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 919756800. Throughput: 0: 8810.3, 1: 9021.8. Samples: 919748060. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:13,785][121949] Avg episode reward: [(0, '6313.308'), (1, '5906.901')] [2023-12-26 13:59:14,283][123090] Updated weights for policy 1, policy_version 1790534 (0.0006) [2023-12-26 13:59:14,342][123090] Updated weights for policy 1, policy_version 1790544 (0.0005) [2023-12-26 13:59:14,377][123091] Updated weights for policy 0, policy_version 1802262 (0.0008) [2023-12-26 13:59:14,396][123090] Updated weights for policy 1, policy_version 1790554 (0.0006) [2023-12-26 13:59:14,429][123091] Updated weights for policy 0, policy_version 1802272 (0.0007) [2023-12-26 13:59:14,485][123091] Updated weights for policy 0, policy_version 1802282 (0.0010) [2023-12-26 13:59:15,159][123090] Updated weights for policy 1, policy_version 1790564 (0.0007) [2023-12-26 13:59:15,224][123090] Updated weights for policy 1, policy_version 1790574 (0.0008) [2023-12-26 13:59:15,239][123091] Updated weights for policy 0, policy_version 1802292 (0.0011) [2023-12-26 13:59:15,286][123090] Updated weights for policy 1, policy_version 1790584 (0.0007) [2023-12-26 13:59:15,308][123091] Updated weights for policy 0, policy_version 1802302 (0.0011) [2023-12-26 13:59:15,373][123091] Updated weights for policy 0, policy_version 1802312 (0.0011) [2023-12-26 13:59:16,135][123090] Updated weights for policy 1, policy_version 1790594 (0.0009) [2023-12-26 13:59:16,171][123091] Updated weights for policy 0, policy_version 1802322 (0.0011) [2023-12-26 13:59:16,203][123090] Updated weights for policy 1, policy_version 1790604 (0.0011) [2023-12-26 13:59:16,233][123091] Updated weights for policy 0, policy_version 1802332 (0.0011) [2023-12-26 13:59:16,266][123090] Updated weights for policy 1, policy_version 1790614 (0.0010) [2023-12-26 13:59:16,296][123091] Updated weights for policy 0, policy_version 1802342 (0.0011) [2023-12-26 13:59:16,329][123090] Updated weights for policy 1, policy_version 1790624 (0.0010) [2023-12-26 13:59:16,361][123091] Updated weights for policy 0, policy_version 1802352 (0.0011) [2023-12-26 13:59:17,006][123090] Updated weights for policy 1, policy_version 1790634 (0.0005) [2023-12-26 13:59:17,054][123090] Updated weights for policy 1, policy_version 1790644 (0.0009) [2023-12-26 13:59:17,098][123090] Updated weights for policy 1, policy_version 1790654 (0.0010) [2023-12-26 13:59:17,169][123091] Updated weights for policy 0, policy_version 1802362 (0.0010) [2023-12-26 13:59:17,219][123091] Updated weights for policy 0, policy_version 1802372 (0.0010) [2023-12-26 13:59:17,281][123091] Updated weights for policy 0, policy_version 1802382 (0.0010) [2023-12-26 13:59:17,814][123090] Updated weights for policy 1, policy_version 1790664 (0.0010) [2023-12-26 13:59:17,860][123090] Updated weights for policy 1, policy_version 1790674 (0.0009) [2023-12-26 13:59:17,916][123090] Updated weights for policy 1, policy_version 1790684 (0.0005) [2023-12-26 13:59:18,105][123091] Updated weights for policy 0, policy_version 1802392 (0.0010) [2023-12-26 13:59:18,154][123091] Updated weights for policy 0, policy_version 1802402 (0.0010) [2023-12-26 13:59:18,216][123091] Updated weights for policy 0, policy_version 1802412 (0.0011) [2023-12-26 13:59:18,592][123090] Updated weights for policy 1, policy_version 1790694 (0.0008) [2023-12-26 13:59:18,643][123090] Updated weights for policy 1, policy_version 1790704 (0.0010) [2023-12-26 13:59:18,694][123090] Updated weights for policy 1, policy_version 1790714 (0.0010) [2023-12-26 13:59:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 919846912. Throughput: 0: 8828.7, 1: 8984.3. Samples: 919856064. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:18,785][121949] Avg episode reward: [(0, '6207.010'), (1, '6017.556')] [2023-12-26 13:59:19,063][123091] Updated weights for policy 0, policy_version 1802422 (0.0010) [2023-12-26 13:59:19,117][123091] Updated weights for policy 0, policy_version 1802432 (0.0010) [2023-12-26 13:59:19,168][123091] Updated weights for policy 0, policy_version 1802442 (0.0010) [2023-12-26 13:59:19,543][123090] Updated weights for policy 1, policy_version 1790724 (0.0010) [2023-12-26 13:59:19,610][123090] Updated weights for policy 1, policy_version 1790734 (0.0011) [2023-12-26 13:59:19,677][123090] Updated weights for policy 1, policy_version 1790744 (0.0011) [2023-12-26 13:59:19,979][123091] Updated weights for policy 0, policy_version 1802452 (0.0010) [2023-12-26 13:59:20,038][123091] Updated weights for policy 0, policy_version 1802462 (0.0008) [2023-12-26 13:59:20,101][123091] Updated weights for policy 0, policy_version 1802472 (0.0008) [2023-12-26 13:59:20,497][123090] Updated weights for policy 1, policy_version 1790754 (0.0011) [2023-12-26 13:59:20,569][123090] Updated weights for policy 1, policy_version 1790764 (0.0011) [2023-12-26 13:59:20,638][123090] Updated weights for policy 1, policy_version 1790774 (0.0011) [2023-12-26 13:59:20,709][123090] Updated weights for policy 1, policy_version 1790784 (0.0011) [2023-12-26 13:59:20,919][123091] Updated weights for policy 0, policy_version 1802482 (0.0008) [2023-12-26 13:59:20,980][123091] Updated weights for policy 0, policy_version 1802492 (0.0009) [2023-12-26 13:59:21,047][123091] Updated weights for policy 0, policy_version 1802502 (0.0009) [2023-12-26 13:59:21,107][123091] Updated weights for policy 0, policy_version 1802512 (0.0009) [2023-12-26 13:59:21,577][123090] Updated weights for policy 1, policy_version 1790794 (0.0009) [2023-12-26 13:59:21,640][123090] Updated weights for policy 1, policy_version 1790804 (0.0009) [2023-12-26 13:59:21,697][123090] Updated weights for policy 1, policy_version 1790814 (0.0009) [2023-12-26 13:59:22,000][123091] Updated weights for policy 0, policy_version 1802522 (0.0009) [2023-12-26 13:59:22,064][123091] Updated weights for policy 0, policy_version 1802532 (0.0008) [2023-12-26 13:59:22,135][123091] Updated weights for policy 0, policy_version 1802542 (0.0008) [2023-12-26 13:59:22,576][123090] Updated weights for policy 1, policy_version 1790824 (0.0006) [2023-12-26 13:59:22,649][123090] Updated weights for policy 1, policy_version 1790834 (0.0005) [2023-12-26 13:59:22,719][123090] Updated weights for policy 1, policy_version 1790844 (0.0005) [2023-12-26 13:59:22,959][123091] Updated weights for policy 0, policy_version 1802552 (0.0009) [2023-12-26 13:59:23,011][123091] Updated weights for policy 0, policy_version 1802562 (0.0009) [2023-12-26 13:59:23,069][123091] Updated weights for policy 0, policy_version 1802572 (0.0010) [2023-12-26 13:59:23,370][123090] Updated weights for policy 1, policy_version 1790854 (0.0008) [2023-12-26 13:59:23,431][123090] Updated weights for policy 1, policy_version 1790864 (0.0010) [2023-12-26 13:59:23,499][123090] Updated weights for policy 1, policy_version 1790874 (0.0009) [2023-12-26 13:59:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 919928832. Throughput: 0: 8773.7, 1: 8890.1. Samples: 919906388. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:23,785][121949] Avg episode reward: [(0, '6259.432'), (1, '5967.415')] [2023-12-26 13:59:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001790880_458465280.pth... [2023-12-26 13:59:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001802576_461463552.pth... [2023-12-26 13:59:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001789824_458194944.pth [2023-12-26 13:59:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001801552_461201408.pth [2023-12-26 13:59:23,957][123091] Updated weights for policy 0, policy_version 1802582 (0.0009) [2023-12-26 13:59:24,015][123091] Updated weights for policy 0, policy_version 1802592 (0.0009) [2023-12-26 13:59:24,070][123091] Updated weights for policy 0, policy_version 1802602 (0.0010) [2023-12-26 13:59:24,196][123090] Updated weights for policy 1, policy_version 1790884 (0.0008) [2023-12-26 13:59:24,257][123090] Updated weights for policy 1, policy_version 1790894 (0.0010) [2023-12-26 13:59:24,310][123090] Updated weights for policy 1, policy_version 1790904 (0.0009) [2023-12-26 13:59:24,835][123091] Updated weights for policy 0, policy_version 1802612 (0.0010) [2023-12-26 13:59:24,889][123091] Updated weights for policy 0, policy_version 1802622 (0.0009) [2023-12-26 13:59:24,939][123091] Updated weights for policy 0, policy_version 1802633 (0.0010) [2023-12-26 13:59:25,198][123090] Updated weights for policy 1, policy_version 1790914 (0.0009) [2023-12-26 13:59:25,260][123090] Updated weights for policy 1, policy_version 1790924 (0.0008) [2023-12-26 13:59:25,324][123090] Updated weights for policy 1, policy_version 1790934 (0.0009) [2023-12-26 13:59:25,401][123090] Updated weights for policy 1, policy_version 1790944 (0.0009) [2023-12-26 13:59:25,710][123091] Updated weights for policy 0, policy_version 1802643 (0.0008) [2023-12-26 13:59:25,761][123091] Updated weights for policy 0, policy_version 1802653 (0.0005) [2023-12-26 13:59:25,812][123091] Updated weights for policy 0, policy_version 1802663 (0.0008) [2023-12-26 13:59:26,163][123090] Updated weights for policy 1, policy_version 1790954 (0.0010) [2023-12-26 13:59:26,222][123090] Updated weights for policy 1, policy_version 1790964 (0.0010) [2023-12-26 13:59:26,281][123090] Updated weights for policy 1, policy_version 1790974 (0.0010) [2023-12-26 13:59:26,453][123091] Updated weights for policy 0, policy_version 1802673 (0.0007) [2023-12-26 13:59:26,517][123091] Updated weights for policy 0, policy_version 1802683 (0.0006) [2023-12-26 13:59:26,585][123091] Updated weights for policy 0, policy_version 1802693 (0.0008) [2023-12-26 13:59:26,650][123091] Updated weights for policy 0, policy_version 1802703 (0.0008) [2023-12-26 13:59:26,946][123090] Updated weights for policy 1, policy_version 1790984 (0.0006) [2023-12-26 13:59:26,992][123090] Updated weights for policy 1, policy_version 1790994 (0.0005) [2023-12-26 13:59:27,042][123090] Updated weights for policy 1, policy_version 1791004 (0.0005) [2023-12-26 13:59:27,251][123091] Updated weights for policy 0, policy_version 1802713 (0.0008) [2023-12-26 13:59:27,324][123091] Updated weights for policy 0, policy_version 1802723 (0.0008) [2023-12-26 13:59:27,397][123091] Updated weights for policy 0, policy_version 1802733 (0.0007) [2023-12-26 13:59:27,765][123090] Updated weights for policy 1, policy_version 1791014 (0.0006) [2023-12-26 13:59:27,825][123090] Updated weights for policy 1, policy_version 1791024 (0.0005) [2023-12-26 13:59:27,885][123090] Updated weights for policy 1, policy_version 1791034 (0.0005) [2023-12-26 13:59:28,063][123091] Updated weights for policy 0, policy_version 1802743 (0.0009) [2023-12-26 13:59:28,125][123091] Updated weights for policy 0, policy_version 1802753 (0.0007) [2023-12-26 13:59:28,188][123091] Updated weights for policy 0, policy_version 1802763 (0.0006) [2023-12-26 13:59:28,592][123090] Updated weights for policy 1, policy_version 1791044 (0.0007) [2023-12-26 13:59:28,655][123090] Updated weights for policy 1, policy_version 1791054 (0.0010) [2023-12-26 13:59:28,712][123090] Updated weights for policy 1, policy_version 1791064 (0.0010) [2023-12-26 13:59:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 920027136. Throughput: 0: 8900.1, 1: 8928.6. Samples: 920016776. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:28,785][121949] Avg episode reward: [(0, '6158.475'), (1, '6010.896')] [2023-12-26 13:59:28,989][123091] Updated weights for policy 0, policy_version 1802773 (0.0009) [2023-12-26 13:59:29,035][123091] Updated weights for policy 0, policy_version 1802783 (0.0008) [2023-12-26 13:59:29,082][123091] Updated weights for policy 0, policy_version 1802793 (0.0008) [2023-12-26 13:59:29,507][123090] Updated weights for policy 1, policy_version 1791074 (0.0009) [2023-12-26 13:59:29,573][123090] Updated weights for policy 1, policy_version 1791084 (0.0008) [2023-12-26 13:59:29,636][123090] Updated weights for policy 1, policy_version 1791094 (0.0009) [2023-12-26 13:59:29,699][123090] Updated weights for policy 1, policy_version 1791104 (0.0007) [2023-12-26 13:59:29,829][123091] Updated weights for policy 0, policy_version 1802803 (0.0008) [2023-12-26 13:59:29,889][123091] Updated weights for policy 0, policy_version 1802813 (0.0008) [2023-12-26 13:59:29,954][123091] Updated weights for policy 0, policy_version 1802823 (0.0008) [2023-12-26 13:59:30,523][123090] Updated weights for policy 1, policy_version 1791114 (0.0010) [2023-12-26 13:59:30,581][123090] Updated weights for policy 1, policy_version 1791124 (0.0009) [2023-12-26 13:59:30,634][123090] Updated weights for policy 1, policy_version 1791134 (0.0010) [2023-12-26 13:59:30,635][123091] Updated weights for policy 0, policy_version 1802833 (0.0006) [2023-12-26 13:59:30,682][123091] Updated weights for policy 0, policy_version 1802843 (0.0005) [2023-12-26 13:59:30,735][123091] Updated weights for policy 0, policy_version 1802853 (0.0005) [2023-12-26 13:59:30,780][123091] Updated weights for policy 0, policy_version 1802863 (0.0005) [2023-12-26 13:59:31,492][123090] Updated weights for policy 1, policy_version 1791144 (0.0009) [2023-12-26 13:59:31,535][123091] Updated weights for policy 0, policy_version 1802873 (0.0006) [2023-12-26 13:59:31,560][123090] Updated weights for policy 1, policy_version 1791154 (0.0008) [2023-12-26 13:59:31,599][123091] Updated weights for policy 0, policy_version 1802883 (0.0008) [2023-12-26 13:59:31,625][123090] Updated weights for policy 1, policy_version 1791164 (0.0009) [2023-12-26 13:59:31,664][123091] Updated weights for policy 0, policy_version 1802893 (0.0008) [2023-12-26 13:59:32,382][123091] Updated weights for policy 0, policy_version 1802903 (0.0009) [2023-12-26 13:59:32,447][123091] Updated weights for policy 0, policy_version 1802913 (0.0010) [2023-12-26 13:59:32,485][123090] Updated weights for policy 1, policy_version 1791174 (0.0008) [2023-12-26 13:59:32,510][123091] Updated weights for policy 0, policy_version 1802923 (0.0010) [2023-12-26 13:59:32,548][123090] Updated weights for policy 1, policy_version 1791184 (0.0009) [2023-12-26 13:59:32,606][123090] Updated weights for policy 1, policy_version 1791194 (0.0009) [2023-12-26 13:59:33,211][123091] Updated weights for policy 0, policy_version 1802933 (0.0009) [2023-12-26 13:59:33,264][123091] Updated weights for policy 0, policy_version 1802943 (0.0010) [2023-12-26 13:59:33,315][123091] Updated weights for policy 0, policy_version 1802954 (0.0010) [2023-12-26 13:59:33,348][123090] Updated weights for policy 1, policy_version 1791204 (0.0008) [2023-12-26 13:59:33,412][123090] Updated weights for policy 1, policy_version 1791214 (0.0005) [2023-12-26 13:59:33,482][123090] Updated weights for policy 1, policy_version 1791224 (0.0005) [2023-12-26 13:59:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 920117248. Throughput: 0: 8980.9, 1: 8969.0. Samples: 920127240. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:33,785][121949] Avg episode reward: [(0, '6126.221'), (1, '6016.800')] [2023-12-26 13:59:34,111][123090] Updated weights for policy 1, policy_version 1791234 (0.0005) [2023-12-26 13:59:34,118][123091] Updated weights for policy 0, policy_version 1802964 (0.0008) [2023-12-26 13:59:34,179][123090] Updated weights for policy 1, policy_version 1791244 (0.0010) [2023-12-26 13:59:34,183][123091] Updated weights for policy 0, policy_version 1802974 (0.0009) [2023-12-26 13:59:34,242][123090] Updated weights for policy 1, policy_version 1791254 (0.0009) [2023-12-26 13:59:34,245][123091] Updated weights for policy 0, policy_version 1802984 (0.0008) [2023-12-26 13:59:34,314][123090] Updated weights for policy 1, policy_version 1791264 (0.0010) [2023-12-26 13:59:35,044][123091] Updated weights for policy 0, policy_version 1802994 (0.0007) [2023-12-26 13:59:35,092][123091] Updated weights for policy 0, policy_version 1803004 (0.0009) [2023-12-26 13:59:35,138][123091] Updated weights for policy 0, policy_version 1803014 (0.0008) [2023-12-26 13:59:35,140][123090] Updated weights for policy 1, policy_version 1791274 (0.0011) [2023-12-26 13:59:35,186][123091] Updated weights for policy 0, policy_version 1803024 (0.0006) [2023-12-26 13:59:35,191][123090] Updated weights for policy 1, policy_version 1791284 (0.0010) [2023-12-26 13:59:35,246][123090] Updated weights for policy 1, policy_version 1791294 (0.0010) [2023-12-26 13:59:36,044][123091] Updated weights for policy 0, policy_version 1803034 (0.0009) [2023-12-26 13:59:36,086][123090] Updated weights for policy 1, policy_version 1791304 (0.0010) [2023-12-26 13:59:36,097][123091] Updated weights for policy 0, policy_version 1803044 (0.0007) [2023-12-26 13:59:36,152][123090] Updated weights for policy 1, policy_version 1791314 (0.0010) [2023-12-26 13:59:36,163][123091] Updated weights for policy 0, policy_version 1803054 (0.0009) [2023-12-26 13:59:36,204][123090] Updated weights for policy 1, policy_version 1791324 (0.0010) [2023-12-26 13:59:37,041][123091] Updated weights for policy 0, policy_version 1803064 (0.0008) [2023-12-26 13:59:37,067][123090] Updated weights for policy 1, policy_version 1791334 (0.0011) [2023-12-26 13:59:37,105][123091] Updated weights for policy 0, policy_version 1803074 (0.0008) [2023-12-26 13:59:37,127][123090] Updated weights for policy 1, policy_version 1791344 (0.0011) [2023-12-26 13:59:37,168][123091] Updated weights for policy 0, policy_version 1803084 (0.0008) [2023-12-26 13:59:37,186][123090] Updated weights for policy 1, policy_version 1791354 (0.0010) [2023-12-26 13:59:37,923][123090] Updated weights for policy 1, policy_version 1791364 (0.0010) [2023-12-26 13:59:37,982][123090] Updated weights for policy 1, policy_version 1791374 (0.0010) [2023-12-26 13:59:38,010][123091] Updated weights for policy 0, policy_version 1803094 (0.0006) [2023-12-26 13:59:38,046][123090] Updated weights for policy 1, policy_version 1791384 (0.0011) [2023-12-26 13:59:38,081][123091] Updated weights for policy 0, policy_version 1803104 (0.0005) [2023-12-26 13:59:38,159][123091] Updated weights for policy 0, policy_version 1803114 (0.0006) [2023-12-26 13:59:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 920199168. Throughput: 0: 8962.6, 1: 8978.0. Samples: 920179284. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:38,785][121949] Avg episode reward: [(0, '6211.958'), (1, '6036.157')] [2023-12-26 13:59:38,789][123091] Updated weights for policy 0, policy_version 1803124 (0.0007) [2023-12-26 13:59:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001791392_458596352.pth... [2023-12-26 13:59:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001790368_458334208.pth [2023-12-26 13:59:38,850][123091] Updated weights for policy 0, policy_version 1803134 (0.0011) [2023-12-26 13:59:38,867][123090] Updated weights for policy 1, policy_version 1791394 (0.0010) [2023-12-26 13:59:38,914][123091] Updated weights for policy 0, policy_version 1803144 (0.0011) [2023-12-26 13:59:38,935][123090] Updated weights for policy 1, policy_version 1791404 (0.0011) [2023-12-26 13:59:38,962][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001803152_461611008.pth... [2023-12-26 13:59:38,967][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001802096_461340672.pth [2023-12-26 13:59:38,994][123090] Updated weights for policy 1, policy_version 1791414 (0.0010) [2023-12-26 13:59:39,056][123090] Updated weights for policy 1, policy_version 1791424 (0.0010) [2023-12-26 13:59:39,732][123091] Updated weights for policy 0, policy_version 1803154 (0.0011) [2023-12-26 13:59:39,795][123091] Updated weights for policy 0, policy_version 1803164 (0.0011) [2023-12-26 13:59:39,864][123091] Updated weights for policy 0, policy_version 1803174 (0.0011) [2023-12-26 13:59:39,867][123090] Updated weights for policy 1, policy_version 1791434 (0.0009) [2023-12-26 13:59:39,929][123091] Updated weights for policy 0, policy_version 1803184 (0.0011) [2023-12-26 13:59:39,936][123090] Updated weights for policy 1, policy_version 1791444 (0.0006) [2023-12-26 13:59:40,007][123090] Updated weights for policy 1, policy_version 1791454 (0.0008) [2023-12-26 13:59:40,766][123091] Updated weights for policy 0, policy_version 1803194 (0.0011) [2023-12-26 13:59:40,826][123091] Updated weights for policy 0, policy_version 1803204 (0.0011) [2023-12-26 13:59:40,833][123090] Updated weights for policy 1, policy_version 1791464 (0.0006) [2023-12-26 13:59:40,892][123090] Updated weights for policy 1, policy_version 1791474 (0.0006) [2023-12-26 13:59:40,894][123091] Updated weights for policy 0, policy_version 1803214 (0.0011) [2023-12-26 13:59:40,956][123090] Updated weights for policy 1, policy_version 1791484 (0.0005) [2023-12-26 13:59:41,755][123090] Updated weights for policy 1, policy_version 1791494 (0.0008) [2023-12-26 13:59:41,789][123091] Updated weights for policy 0, policy_version 1803224 (0.0007) [2023-12-26 13:59:41,820][123090] Updated weights for policy 1, policy_version 1791504 (0.0009) [2023-12-26 13:59:41,849][123091] Updated weights for policy 0, policy_version 1803234 (0.0008) [2023-12-26 13:59:41,881][123090] Updated weights for policy 1, policy_version 1791514 (0.0011) [2023-12-26 13:59:41,909][123091] Updated weights for policy 0, policy_version 1803244 (0.0007) [2023-12-26 13:59:42,722][123091] Updated weights for policy 0, policy_version 1803254 (0.0007) [2023-12-26 13:59:42,744][123090] Updated weights for policy 1, policy_version 1791524 (0.0010) [2023-12-26 13:59:42,786][123091] Updated weights for policy 0, policy_version 1803264 (0.0007) [2023-12-26 13:59:42,801][123090] Updated weights for policy 1, policy_version 1791534 (0.0010) [2023-12-26 13:59:42,854][123091] Updated weights for policy 0, policy_version 1803274 (0.0006) [2023-12-26 13:59:42,860][123090] Updated weights for policy 1, policy_version 1791544 (0.0010) [2023-12-26 13:59:43,500][123091] Updated weights for policy 0, policy_version 1803284 (0.0006) [2023-12-26 13:59:43,548][123091] Updated weights for policy 0, policy_version 1803294 (0.0005) [2023-12-26 13:59:43,585][123090] Updated weights for policy 1, policy_version 1791554 (0.0010) [2023-12-26 13:59:43,602][123091] Updated weights for policy 0, policy_version 1803304 (0.0005) [2023-12-26 13:59:43,635][123090] Updated weights for policy 1, policy_version 1791564 (0.0010) [2023-12-26 13:59:43,690][123090] Updated weights for policy 1, policy_version 1791574 (0.0010) [2023-12-26 13:59:43,747][123090] Updated weights for policy 1, policy_version 1791584 (0.0009) [2023-12-26 13:59:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 920297472. Throughput: 0: 8982.4, 1: 8875.1. Samples: 920283240. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:43,785][121949] Avg episode reward: [(0, '6229.072'), (1, '6033.542')] [2023-12-26 13:59:44,275][123091] Updated weights for policy 0, policy_version 1803314 (0.0008) [2023-12-26 13:59:44,326][123091] Updated weights for policy 0, policy_version 1803324 (0.0005) [2023-12-26 13:59:44,377][123091] Updated weights for policy 0, policy_version 1803334 (0.0008) [2023-12-26 13:59:44,435][123091] Updated weights for policy 0, policy_version 1803344 (0.0009) [2023-12-26 13:59:44,538][123090] Updated weights for policy 1, policy_version 1791594 (0.0005) [2023-12-26 13:59:44,590][123090] Updated weights for policy 1, policy_version 1791604 (0.0005) [2023-12-26 13:59:44,640][123090] Updated weights for policy 1, policy_version 1791614 (0.0005) [2023-12-26 13:59:45,267][123091] Updated weights for policy 0, policy_version 1803354 (0.0006) [2023-12-26 13:59:45,315][123090] Updated weights for policy 1, policy_version 1791624 (0.0010) [2023-12-26 13:59:45,319][123091] Updated weights for policy 0, policy_version 1803364 (0.0008) [2023-12-26 13:59:45,380][123090] Updated weights for policy 1, policy_version 1791634 (0.0011) [2023-12-26 13:59:45,380][123091] Updated weights for policy 0, policy_version 1803374 (0.0006) [2023-12-26 13:59:45,452][123090] Updated weights for policy 1, policy_version 1791644 (0.0011) [2023-12-26 13:59:46,080][123091] Updated weights for policy 0, policy_version 1803384 (0.0005) [2023-12-26 13:59:46,153][123091] Updated weights for policy 0, policy_version 1803394 (0.0005) [2023-12-26 13:59:46,224][123090] Updated weights for policy 1, policy_version 1791654 (0.0010) [2023-12-26 13:59:46,226][123091] Updated weights for policy 0, policy_version 1803404 (0.0006) [2023-12-26 13:59:46,283][123090] Updated weights for policy 1, policy_version 1791664 (0.0010) [2023-12-26 13:59:46,344][123090] Updated weights for policy 1, policy_version 1791674 (0.0010) [2023-12-26 13:59:46,939][123091] Updated weights for policy 0, policy_version 1803414 (0.0010) [2023-12-26 13:59:47,002][123091] Updated weights for policy 0, policy_version 1803424 (0.0009) [2023-12-26 13:59:47,068][123091] Updated weights for policy 0, policy_version 1803434 (0.0009) [2023-12-26 13:59:47,084][123090] Updated weights for policy 1, policy_version 1791684 (0.0006) [2023-12-26 13:59:47,141][123090] Updated weights for policy 1, policy_version 1791694 (0.0008) [2023-12-26 13:59:47,206][123090] Updated weights for policy 1, policy_version 1791704 (0.0009) [2023-12-26 13:59:47,900][123091] Updated weights for policy 0, policy_version 1803444 (0.0010) [2023-12-26 13:59:47,956][123091] Updated weights for policy 0, policy_version 1803454 (0.0011) [2023-12-26 13:59:48,008][123091] Updated weights for policy 0, policy_version 1803464 (0.0009) [2023-12-26 13:59:48,013][123090] Updated weights for policy 1, policy_version 1791714 (0.0008) [2023-12-26 13:59:48,071][123090] Updated weights for policy 1, policy_version 1791724 (0.0006) [2023-12-26 13:59:48,131][123090] Updated weights for policy 1, policy_version 1791735 (0.0006) [2023-12-26 13:59:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 920379392. Throughput: 0: 8991.6, 1: 8953.1. Samples: 920394460. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:48,785][121949] Avg episode reward: [(0, '6274.279'), (1, '5982.589')] [2023-12-26 13:59:48,881][123090] Updated weights for policy 1, policy_version 1791745 (0.0006) [2023-12-26 13:59:48,918][123091] Updated weights for policy 0, policy_version 1803474 (0.0009) [2023-12-26 13:59:48,945][123090] Updated weights for policy 1, policy_version 1791755 (0.0009) [2023-12-26 13:59:48,982][123091] Updated weights for policy 0, policy_version 1803484 (0.0008) [2023-12-26 13:59:49,000][123090] Updated weights for policy 1, policy_version 1791765 (0.0010) [2023-12-26 13:59:49,033][123091] Updated weights for policy 0, policy_version 1803494 (0.0007) [2023-12-26 13:59:49,055][123090] Updated weights for policy 1, policy_version 1791775 (0.0010) [2023-12-26 13:59:49,091][123091] Updated weights for policy 0, policy_version 1803504 (0.0007) [2023-12-26 13:59:49,851][123090] Updated weights for policy 1, policy_version 1791785 (0.0009) [2023-12-26 13:59:49,916][123090] Updated weights for policy 1, policy_version 1791795 (0.0009) [2023-12-26 13:59:49,947][123091] Updated weights for policy 0, policy_version 1803514 (0.0008) [2023-12-26 13:59:49,986][123090] Updated weights for policy 1, policy_version 1791805 (0.0007) [2023-12-26 13:59:50,007][123091] Updated weights for policy 0, policy_version 1803524 (0.0009) [2023-12-26 13:59:50,064][123091] Updated weights for policy 0, policy_version 1803534 (0.0010) [2023-12-26 13:59:50,700][123090] Updated weights for policy 1, policy_version 1791815 (0.0009) [2023-12-26 13:59:50,754][123090] Updated weights for policy 1, policy_version 1791825 (0.0009) [2023-12-26 13:59:50,811][123090] Updated weights for policy 1, policy_version 1791835 (0.0009) [2023-12-26 13:59:50,868][123091] Updated weights for policy 0, policy_version 1803544 (0.0006) [2023-12-26 13:59:50,928][123091] Updated weights for policy 0, policy_version 1803554 (0.0006) [2023-12-26 13:59:50,988][123091] Updated weights for policy 0, policy_version 1803564 (0.0009) [2023-12-26 13:59:51,626][123090] Updated weights for policy 1, policy_version 1791845 (0.0008) [2023-12-26 13:59:51,699][123090] Updated weights for policy 1, policy_version 1791855 (0.0009) [2023-12-26 13:59:51,769][123090] Updated weights for policy 1, policy_version 1791865 (0.0010) [2023-12-26 13:59:51,821][123091] Updated weights for policy 0, policy_version 1803574 (0.0009) [2023-12-26 13:59:51,879][123091] Updated weights for policy 0, policy_version 1803584 (0.0007) [2023-12-26 13:59:51,932][123091] Updated weights for policy 0, policy_version 1803594 (0.0007) [2023-12-26 13:59:52,607][123090] Updated weights for policy 1, policy_version 1791875 (0.0009) [2023-12-26 13:59:52,660][123090] Updated weights for policy 1, policy_version 1791886 (0.0010) [2023-12-26 13:59:52,711][123091] Updated weights for policy 0, policy_version 1803604 (0.0007) [2023-12-26 13:59:52,717][123090] Updated weights for policy 1, policy_version 1791896 (0.0010) [2023-12-26 13:59:52,772][123091] Updated weights for policy 0, policy_version 1803614 (0.0008) [2023-12-26 13:59:52,828][123091] Updated weights for policy 0, policy_version 1803624 (0.0008) [2023-12-26 13:59:53,498][123090] Updated weights for policy 1, policy_version 1791906 (0.0007) [2023-12-26 13:59:53,566][123090] Updated weights for policy 1, policy_version 1791916 (0.0005) [2023-12-26 13:59:53,568][123091] Updated weights for policy 0, policy_version 1803634 (0.0008) [2023-12-26 13:59:53,628][123090] Updated weights for policy 1, policy_version 1791926 (0.0010) [2023-12-26 13:59:53,633][123091] Updated weights for policy 0, policy_version 1803644 (0.0005) [2023-12-26 13:59:53,688][123091] Updated weights for policy 0, policy_version 1803654 (0.0005) [2023-12-26 13:59:53,695][123090] Updated weights for policy 1, policy_version 1791936 (0.0011) [2023-12-26 13:59:53,753][123091] Updated weights for policy 0, policy_version 1803664 (0.0006) [2023-12-26 13:59:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17883.5). Total num frames: 920477696. Throughput: 0: 8916.6, 1: 8981.4. Samples: 920446872. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:53,785][121949] Avg episode reward: [(0, '6308.167'), (1, '5935.244')] [2023-12-26 13:59:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001803664_461742080.pth... [2023-12-26 13:59:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001791936_458735616.pth... [2023-12-26 13:59:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001802576_461463552.pth [2023-12-26 13:59:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001790880_458465280.pth [2023-12-26 13:59:54,401][123091] Updated weights for policy 0, policy_version 1803674 (0.0005) [2023-12-26 13:59:54,461][123091] Updated weights for policy 0, policy_version 1803684 (0.0008) [2023-12-26 13:59:54,498][123090] Updated weights for policy 1, policy_version 1791946 (0.0009) [2023-12-26 13:59:54,509][123091] Updated weights for policy 0, policy_version 1803695 (0.0009) [2023-12-26 13:59:54,563][123090] Updated weights for policy 1, policy_version 1791956 (0.0009) [2023-12-26 13:59:54,638][123090] Updated weights for policy 1, policy_version 1791966 (0.0010) [2023-12-26 13:59:55,295][123090] Updated weights for policy 1, policy_version 1791976 (0.0007) [2023-12-26 13:59:55,336][123091] Updated weights for policy 0, policy_version 1803705 (0.0008) [2023-12-26 13:59:55,341][123090] Updated weights for policy 1, policy_version 1791986 (0.0005) [2023-12-26 13:59:55,385][123091] Updated weights for policy 0, policy_version 1803715 (0.0008) [2023-12-26 13:59:55,389][123090] Updated weights for policy 1, policy_version 1791996 (0.0005) [2023-12-26 13:59:55,437][123091] Updated weights for policy 0, policy_version 1803725 (0.0009) [2023-12-26 13:59:56,150][123090] Updated weights for policy 1, policy_version 1792006 (0.0008) [2023-12-26 13:59:56,206][123090] Updated weights for policy 1, policy_version 1792016 (0.0009) [2023-12-26 13:59:56,271][123091] Updated weights for policy 0, policy_version 1803735 (0.0007) [2023-12-26 13:59:56,271][123090] Updated weights for policy 1, policy_version 1792026 (0.0010) [2023-12-26 13:59:56,319][123091] Updated weights for policy 0, policy_version 1803745 (0.0005) [2023-12-26 13:59:56,374][123091] Updated weights for policy 0, policy_version 1803755 (0.0005) [2023-12-26 13:59:56,987][123091] Updated weights for policy 0, policy_version 1803765 (0.0006) [2023-12-26 13:59:57,058][123091] Updated weights for policy 0, policy_version 1803775 (0.0005) [2023-12-26 13:59:57,128][123091] Updated weights for policy 0, policy_version 1803785 (0.0005) [2023-12-26 13:59:57,139][123090] Updated weights for policy 1, policy_version 1792036 (0.0008) [2023-12-26 13:59:57,193][123090] Updated weights for policy 1, policy_version 1792046 (0.0010) [2023-12-26 13:59:57,235][123090] Updated weights for policy 1, policy_version 1792056 (0.0010) [2023-12-26 13:59:57,815][123091] Updated weights for policy 0, policy_version 1803795 (0.0008) [2023-12-26 13:59:57,872][123091] Updated weights for policy 0, policy_version 1803805 (0.0006) [2023-12-26 13:59:57,942][123091] Updated weights for policy 0, policy_version 1803815 (0.0005) [2023-12-26 13:59:58,043][123090] Updated weights for policy 1, policy_version 1792066 (0.0005) [2023-12-26 13:59:58,116][123090] Updated weights for policy 1, policy_version 1792076 (0.0010) [2023-12-26 13:59:58,184][123090] Updated weights for policy 1, policy_version 1792086 (0.0010) [2023-12-26 13:59:58,250][123090] Updated weights for policy 1, policy_version 1792096 (0.0010) [2023-12-26 13:59:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 920559616. Throughput: 0: 9027.6, 1: 8945.5. Samples: 920556848. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 13:59:58,785][121949] Avg episode reward: [(0, '6126.239'), (1, '6003.900')] [2023-12-26 13:59:58,820][123091] Updated weights for policy 0, policy_version 1803825 (0.0009) [2023-12-26 13:59:58,901][123091] Updated weights for policy 0, policy_version 1803835 (0.0009) [2023-12-26 13:59:58,973][123091] Updated weights for policy 0, policy_version 1803845 (0.0011) [2023-12-26 13:59:59,045][123091] Updated weights for policy 0, policy_version 1803855 (0.0011) [2023-12-26 13:59:59,103][123090] Updated weights for policy 1, policy_version 1792106 (0.0008) [2023-12-26 13:59:59,172][123090] Updated weights for policy 1, policy_version 1792116 (0.0009) [2023-12-26 13:59:59,246][123090] Updated weights for policy 1, policy_version 1792126 (0.0008) [2023-12-26 13:59:59,894][123091] Updated weights for policy 0, policy_version 1803865 (0.0009) [2023-12-26 13:59:59,963][123091] Updated weights for policy 0, policy_version 1803875 (0.0007) [2023-12-26 13:59:59,980][123090] Updated weights for policy 1, policy_version 1792136 (0.0007) [2023-12-26 14:00:00,029][123091] Updated weights for policy 0, policy_version 1803885 (0.0008) [2023-12-26 14:00:00,045][123090] Updated weights for policy 1, policy_version 1792146 (0.0007) [2023-12-26 14:00:00,094][123090] Updated weights for policy 1, policy_version 1792156 (0.0007) [2023-12-26 14:00:00,772][123090] Updated weights for policy 1, policy_version 1792166 (0.0005) [2023-12-26 14:00:00,834][123090] Updated weights for policy 1, policy_version 1792176 (0.0008) [2023-12-26 14:00:00,887][123090] Updated weights for policy 1, policy_version 1792186 (0.0010) [2023-12-26 14:00:00,889][123091] Updated weights for policy 0, policy_version 1803895 (0.0007) [2023-12-26 14:00:00,943][123091] Updated weights for policy 0, policy_version 1803905 (0.0009) [2023-12-26 14:00:01,009][123091] Updated weights for policy 0, policy_version 1803915 (0.0010) [2023-12-26 14:00:01,649][123090] Updated weights for policy 1, policy_version 1792196 (0.0007) [2023-12-26 14:00:01,707][123090] Updated weights for policy 1, policy_version 1792206 (0.0010) [2023-12-26 14:00:01,772][123090] Updated weights for policy 1, policy_version 1792216 (0.0010) [2023-12-26 14:00:01,856][123091] Updated weights for policy 0, policy_version 1803925 (0.0009) [2023-12-26 14:00:01,904][123091] Updated weights for policy 0, policy_version 1803935 (0.0009) [2023-12-26 14:00:01,956][123091] Updated weights for policy 0, policy_version 1803945 (0.0009) [2023-12-26 14:00:02,599][123090] Updated weights for policy 1, policy_version 1792226 (0.0010) [2023-12-26 14:00:02,663][123090] Updated weights for policy 1, policy_version 1792236 (0.0010) [2023-12-26 14:00:02,726][123090] Updated weights for policy 1, policy_version 1792246 (0.0010) [2023-12-26 14:00:02,787][123090] Updated weights for policy 1, policy_version 1792256 (0.0009) [2023-12-26 14:00:02,806][123091] Updated weights for policy 0, policy_version 1803955 (0.0009) [2023-12-26 14:00:02,857][123091] Updated weights for policy 0, policy_version 1803965 (0.0009) [2023-12-26 14:00:02,924][123091] Updated weights for policy 0, policy_version 1803975 (0.0008) [2023-12-26 14:00:03,575][123090] Updated weights for policy 1, policy_version 1792266 (0.0005) [2023-12-26 14:00:03,623][123090] Updated weights for policy 1, policy_version 1792276 (0.0007) [2023-12-26 14:00:03,678][123090] Updated weights for policy 1, policy_version 1792286 (0.0010) [2023-12-26 14:00:03,729][123091] Updated weights for policy 0, policy_version 1803985 (0.0009) [2023-12-26 14:00:03,778][123091] Updated weights for policy 0, policy_version 1803995 (0.0005) [2023-12-26 14:00:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 920649728. Throughput: 0: 8969.0, 1: 8920.3. Samples: 920661088. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:03,785][121949] Avg episode reward: [(0, '6048.370'), (1, '6021.630')] [2023-12-26 14:00:03,835][123091] Updated weights for policy 0, policy_version 1804005 (0.0010) [2023-12-26 14:00:03,900][123091] Updated weights for policy 0, policy_version 1804015 (0.0010) [2023-12-26 14:00:04,365][123090] Updated weights for policy 1, policy_version 1792296 (0.0007) [2023-12-26 14:00:04,415][123090] Updated weights for policy 1, policy_version 1792306 (0.0009) [2023-12-26 14:00:04,463][123090] Updated weights for policy 1, policy_version 1792316 (0.0005) [2023-12-26 14:00:04,817][123091] Updated weights for policy 0, policy_version 1804025 (0.0009) [2023-12-26 14:00:04,875][123091] Updated weights for policy 0, policy_version 1804035 (0.0009) [2023-12-26 14:00:04,934][123091] Updated weights for policy 0, policy_version 1804045 (0.0009) [2023-12-26 14:00:05,241][123090] Updated weights for policy 1, policy_version 1792326 (0.0008) [2023-12-26 14:00:05,310][123090] Updated weights for policy 1, policy_version 1792336 (0.0010) [2023-12-26 14:00:05,381][123090] Updated weights for policy 1, policy_version 1792346 (0.0010) [2023-12-26 14:00:05,793][123091] Updated weights for policy 0, policy_version 1804055 (0.0009) [2023-12-26 14:00:05,847][123091] Updated weights for policy 0, policy_version 1804065 (0.0010) [2023-12-26 14:00:05,901][123091] Updated weights for policy 0, policy_version 1804075 (0.0010) [2023-12-26 14:00:06,073][123090] Updated weights for policy 1, policy_version 1792356 (0.0008) [2023-12-26 14:00:06,137][123090] Updated weights for policy 1, policy_version 1792366 (0.0007) [2023-12-26 14:00:06,198][123090] Updated weights for policy 1, policy_version 1792376 (0.0006) [2023-12-26 14:00:06,759][123091] Updated weights for policy 0, policy_version 1804085 (0.0008) [2023-12-26 14:00:06,809][123091] Updated weights for policy 0, policy_version 1804095 (0.0005) [2023-12-26 14:00:06,864][123091] Updated weights for policy 0, policy_version 1804105 (0.0005) [2023-12-26 14:00:06,972][123090] Updated weights for policy 1, policy_version 1792386 (0.0005) [2023-12-26 14:00:07,033][123090] Updated weights for policy 1, policy_version 1792396 (0.0005) [2023-12-26 14:00:07,086][123090] Updated weights for policy 1, policy_version 1792406 (0.0006) [2023-12-26 14:00:07,133][123090] Updated weights for policy 1, policy_version 1792416 (0.0005) [2023-12-26 14:00:07,510][123091] Updated weights for policy 0, policy_version 1804115 (0.0007) [2023-12-26 14:00:07,565][123091] Updated weights for policy 0, policy_version 1804125 (0.0009) [2023-12-26 14:00:07,633][123091] Updated weights for policy 0, policy_version 1804135 (0.0009) [2023-12-26 14:00:07,867][123090] Updated weights for policy 1, policy_version 1792427 (0.0009) [2023-12-26 14:00:07,922][123090] Updated weights for policy 1, policy_version 1792437 (0.0009) [2023-12-26 14:00:07,982][123090] Updated weights for policy 1, policy_version 1792447 (0.0005) [2023-12-26 14:00:08,510][123091] Updated weights for policy 0, policy_version 1804145 (0.0010) [2023-12-26 14:00:08,579][123091] Updated weights for policy 0, policy_version 1804155 (0.0010) [2023-12-26 14:00:08,648][123091] Updated weights for policy 0, policy_version 1804165 (0.0009) [2023-12-26 14:00:08,709][123091] Updated weights for policy 0, policy_version 1804175 (0.0009) [2023-12-26 14:00:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 920739840. Throughput: 0: 8960.4, 1: 9000.6. Samples: 920714632. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:08,785][121949] Avg episode reward: [(0, '6118.009'), (1, '6000.792')] [2023-12-26 14:00:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001804176_461873152.pth... [2023-12-26 14:00:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001803152_461611008.pth [2023-12-26 14:00:08,816][123090] Updated weights for policy 1, policy_version 1792457 (0.0009) [2023-12-26 14:00:08,869][123090] Updated weights for policy 1, policy_version 1792467 (0.0010) [2023-12-26 14:00:08,926][123090] Updated weights for policy 1, policy_version 1792477 (0.0009) [2023-12-26 14:00:08,944][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001792480_458874880.pth... [2023-12-26 14:00:08,948][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001791392_458596352.pth [2023-12-26 14:00:09,502][123091] Updated weights for policy 0, policy_version 1804185 (0.0007) [2023-12-26 14:00:09,556][123091] Updated weights for policy 0, policy_version 1804195 (0.0005) [2023-12-26 14:00:09,619][123091] Updated weights for policy 0, policy_version 1804205 (0.0005) [2023-12-26 14:00:09,720][123090] Updated weights for policy 1, policy_version 1792487 (0.0010) [2023-12-26 14:00:09,776][123090] Updated weights for policy 1, policy_version 1792497 (0.0010) [2023-12-26 14:00:09,847][123090] Updated weights for policy 1, policy_version 1792507 (0.0010) [2023-12-26 14:00:10,386][123091] Updated weights for policy 0, policy_version 1804215 (0.0011) [2023-12-26 14:00:10,447][123091] Updated weights for policy 0, policy_version 1804225 (0.0010) [2023-12-26 14:00:10,524][123091] Updated weights for policy 0, policy_version 1804235 (0.0010) [2023-12-26 14:00:10,646][123090] Updated weights for policy 1, policy_version 1792517 (0.0007) [2023-12-26 14:00:10,713][123090] Updated weights for policy 1, policy_version 1792527 (0.0005) [2023-12-26 14:00:10,760][123090] Updated weights for policy 1, policy_version 1792537 (0.0007) [2023-12-26 14:00:11,270][123091] Updated weights for policy 0, policy_version 1804245 (0.0010) [2023-12-26 14:00:11,337][123091] Updated weights for policy 0, policy_version 1804255 (0.0009) [2023-12-26 14:00:11,411][123091] Updated weights for policy 0, policy_version 1804265 (0.0010) [2023-12-26 14:00:11,572][123090] Updated weights for policy 1, policy_version 1792547 (0.0010) [2023-12-26 14:00:11,636][123090] Updated weights for policy 1, policy_version 1792557 (0.0011) [2023-12-26 14:00:11,707][123090] Updated weights for policy 1, policy_version 1792567 (0.0011) [2023-12-26 14:00:12,230][123091] Updated weights for policy 0, policy_version 1804275 (0.0009) [2023-12-26 14:00:12,299][123091] Updated weights for policy 0, policy_version 1804285 (0.0009) [2023-12-26 14:00:12,381][123091] Updated weights for policy 0, policy_version 1804295 (0.0008) [2023-12-26 14:00:12,549][123090] Updated weights for policy 1, policy_version 1792577 (0.0010) [2023-12-26 14:00:12,614][123090] Updated weights for policy 1, policy_version 1792587 (0.0011) [2023-12-26 14:00:12,685][123090] Updated weights for policy 1, policy_version 1792597 (0.0011) [2023-12-26 14:00:12,753][123090] Updated weights for policy 1, policy_version 1792607 (0.0011) [2023-12-26 14:00:13,208][123091] Updated weights for policy 0, policy_version 1804305 (0.0008) [2023-12-26 14:00:13,266][123091] Updated weights for policy 0, policy_version 1804315 (0.0006) [2023-12-26 14:00:13,319][123091] Updated weights for policy 0, policy_version 1804325 (0.0005) [2023-12-26 14:00:13,367][123091] Updated weights for policy 0, policy_version 1804335 (0.0005) [2023-12-26 14:00:13,485][123090] Updated weights for policy 1, policy_version 1792617 (0.0007) [2023-12-26 14:00:13,542][123090] Updated weights for policy 1, policy_version 1792627 (0.0005) [2023-12-26 14:00:13,605][123090] Updated weights for policy 1, policy_version 1792637 (0.0006) [2023-12-26 14:00:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.5). Total num frames: 920829952. Throughput: 0: 8911.9, 1: 8970.0. Samples: 920821464. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:13,785][121949] Avg episode reward: [(0, '5996.994'), (1, '6006.763')] [2023-12-26 14:00:14,064][123091] Updated weights for policy 0, policy_version 1804345 (0.0006) [2023-12-26 14:00:14,119][123091] Updated weights for policy 0, policy_version 1804355 (0.0006) [2023-12-26 14:00:14,184][123091] Updated weights for policy 0, policy_version 1804365 (0.0009) [2023-12-26 14:00:14,394][123090] Updated weights for policy 1, policy_version 1792647 (0.0007) [2023-12-26 14:00:14,449][123090] Updated weights for policy 1, policy_version 1792657 (0.0007) [2023-12-26 14:00:14,502][123090] Updated weights for policy 1, policy_version 1792667 (0.0007) [2023-12-26 14:00:14,997][123091] Updated weights for policy 0, policy_version 1804375 (0.0007) [2023-12-26 14:00:15,059][123091] Updated weights for policy 0, policy_version 1804385 (0.0008) [2023-12-26 14:00:15,123][123091] Updated weights for policy 0, policy_version 1804395 (0.0010) [2023-12-26 14:00:15,245][123090] Updated weights for policy 1, policy_version 1792677 (0.0007) [2023-12-26 14:00:15,303][123090] Updated weights for policy 1, policy_version 1792687 (0.0009) [2023-12-26 14:00:15,357][123090] Updated weights for policy 1, policy_version 1792697 (0.0010) [2023-12-26 14:00:15,798][123091] Updated weights for policy 0, policy_version 1804405 (0.0007) [2023-12-26 14:00:15,864][123091] Updated weights for policy 0, policy_version 1804415 (0.0011) [2023-12-26 14:00:15,931][123091] Updated weights for policy 0, policy_version 1804425 (0.0011) [2023-12-26 14:00:16,190][123090] Updated weights for policy 1, policy_version 1792707 (0.0010) [2023-12-26 14:00:16,247][123090] Updated weights for policy 1, policy_version 1792717 (0.0009) [2023-12-26 14:00:16,295][123090] Updated weights for policy 1, policy_version 1792727 (0.0010) [2023-12-26 14:00:16,566][123091] Updated weights for policy 0, policy_version 1804435 (0.0008) [2023-12-26 14:00:16,610][123091] Updated weights for policy 0, policy_version 1804445 (0.0005) [2023-12-26 14:00:16,658][123091] Updated weights for policy 0, policy_version 1804455 (0.0005) [2023-12-26 14:00:17,131][123090] Updated weights for policy 1, policy_version 1792737 (0.0010) [2023-12-26 14:00:17,182][123090] Updated weights for policy 1, policy_version 1792747 (0.0010) [2023-12-26 14:00:17,228][123090] Updated weights for policy 1, policy_version 1792757 (0.0010) [2023-12-26 14:00:17,280][123090] Updated weights for policy 1, policy_version 1792767 (0.0011) [2023-12-26 14:00:17,360][123091] Updated weights for policy 0, policy_version 1804465 (0.0006) [2023-12-26 14:00:17,410][123091] Updated weights for policy 0, policy_version 1804475 (0.0010) [2023-12-26 14:00:17,454][123091] Updated weights for policy 0, policy_version 1804485 (0.0010) [2023-12-26 14:00:17,500][123091] Updated weights for policy 0, policy_version 1804495 (0.0006) [2023-12-26 14:00:18,130][123090] Updated weights for policy 1, policy_version 1792777 (0.0010) [2023-12-26 14:00:18,143][123091] Updated weights for policy 0, policy_version 1804505 (0.0010) [2023-12-26 14:00:18,193][123090] Updated weights for policy 1, policy_version 1792787 (0.0010) [2023-12-26 14:00:18,205][123091] Updated weights for policy 0, policy_version 1804515 (0.0010) [2023-12-26 14:00:18,259][123090] Updated weights for policy 1, policy_version 1792797 (0.0010) [2023-12-26 14:00:18,267][123091] Updated weights for policy 0, policy_version 1804525 (0.0011) [2023-12-26 14:00:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 920920064. Throughput: 0: 8924.9, 1: 8954.5. Samples: 920931812. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:18,785][121949] Avg episode reward: [(0, '6050.006'), (1, '6016.310')] [2023-12-26 14:00:19,068][123090] Updated weights for policy 1, policy_version 1792807 (0.0010) [2023-12-26 14:00:19,123][123091] Updated weights for policy 0, policy_version 1804535 (0.0011) [2023-12-26 14:00:19,131][123090] Updated weights for policy 1, policy_version 1792817 (0.0010) [2023-12-26 14:00:19,179][123091] Updated weights for policy 0, policy_version 1804545 (0.0011) [2023-12-26 14:00:19,191][123090] Updated weights for policy 1, policy_version 1792827 (0.0011) [2023-12-26 14:00:19,239][123091] Updated weights for policy 0, policy_version 1804555 (0.0010) [2023-12-26 14:00:20,081][123090] Updated weights for policy 1, policy_version 1792837 (0.0010) [2023-12-26 14:00:20,091][123091] Updated weights for policy 0, policy_version 1804565 (0.0008) [2023-12-26 14:00:20,151][123090] Updated weights for policy 1, policy_version 1792847 (0.0011) [2023-12-26 14:00:20,163][123091] Updated weights for policy 0, policy_version 1804575 (0.0008) [2023-12-26 14:00:20,216][123090] Updated weights for policy 1, policy_version 1792857 (0.0010) [2023-12-26 14:00:20,223][123091] Updated weights for policy 0, policy_version 1804585 (0.0009) [2023-12-26 14:00:21,047][123090] Updated weights for policy 1, policy_version 1792867 (0.0009) [2023-12-26 14:00:21,048][123091] Updated weights for policy 0, policy_version 1804595 (0.0009) [2023-12-26 14:00:21,111][123091] Updated weights for policy 0, policy_version 1804605 (0.0010) [2023-12-26 14:00:21,113][123090] Updated weights for policy 1, policy_version 1792877 (0.0007) [2023-12-26 14:00:21,172][123091] Updated weights for policy 0, policy_version 1804615 (0.0011) [2023-12-26 14:00:21,181][123090] Updated weights for policy 1, policy_version 1792887 (0.0011) [2023-12-26 14:00:21,992][123090] Updated weights for policy 1, policy_version 1792897 (0.0007) [2023-12-26 14:00:22,048][123091] Updated weights for policy 0, policy_version 1804625 (0.0011) [2023-12-26 14:00:22,056][123090] Updated weights for policy 1, policy_version 1792907 (0.0006) [2023-12-26 14:00:22,104][123091] Updated weights for policy 0, policy_version 1804635 (0.0010) [2023-12-26 14:00:22,121][123090] Updated weights for policy 1, policy_version 1792917 (0.0009) [2023-12-26 14:00:22,164][123091] Updated weights for policy 0, policy_version 1804645 (0.0011) [2023-12-26 14:00:22,182][123090] Updated weights for policy 1, policy_version 1792927 (0.0010) [2023-12-26 14:00:22,228][123091] Updated weights for policy 0, policy_version 1804655 (0.0011) [2023-12-26 14:00:23,012][123090] Updated weights for policy 1, policy_version 1792937 (0.0009) [2023-12-26 14:00:23,067][123091] Updated weights for policy 0, policy_version 1804665 (0.0011) [2023-12-26 14:00:23,074][123090] Updated weights for policy 1, policy_version 1792947 (0.0007) [2023-12-26 14:00:23,130][123091] Updated weights for policy 0, policy_version 1804675 (0.0011) [2023-12-26 14:00:23,134][123090] Updated weights for policy 1, policy_version 1792957 (0.0007) [2023-12-26 14:00:23,194][123091] Updated weights for policy 0, policy_version 1804685 (0.0009) [2023-12-26 14:00:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 921001984. Throughput: 0: 8908.8, 1: 8929.7. Samples: 920982016. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:23,785][121949] Avg episode reward: [(0, '6128.817'), (1, '6009.547')] [2023-12-26 14:00:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001804688_462004224.pth... [2023-12-26 14:00:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001792960_458997760.pth... [2023-12-26 14:00:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001803664_461742080.pth [2023-12-26 14:00:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001791936_458735616.pth [2023-12-26 14:00:23,883][123091] Updated weights for policy 0, policy_version 1804695 (0.0006) [2023-12-26 14:00:23,960][123091] Updated weights for policy 0, policy_version 1804705 (0.0007) [2023-12-26 14:00:24,020][123091] Updated weights for policy 0, policy_version 1804715 (0.0011) [2023-12-26 14:00:24,047][123090] Updated weights for policy 1, policy_version 1792967 (0.0009) [2023-12-26 14:00:24,109][123090] Updated weights for policy 1, policy_version 1792977 (0.0009) [2023-12-26 14:00:24,171][123090] Updated weights for policy 1, policy_version 1792987 (0.0009) [2023-12-26 14:00:24,799][123091] Updated weights for policy 0, policy_version 1804725 (0.0010) [2023-12-26 14:00:24,860][123091] Updated weights for policy 0, policy_version 1804735 (0.0009) [2023-12-26 14:00:24,933][123091] Updated weights for policy 0, policy_version 1804745 (0.0010) [2023-12-26 14:00:25,018][123090] Updated weights for policy 1, policy_version 1792997 (0.0009) [2023-12-26 14:00:25,076][123090] Updated weights for policy 1, policy_version 1793007 (0.0008) [2023-12-26 14:00:25,128][123090] Updated weights for policy 1, policy_version 1793017 (0.0009) [2023-12-26 14:00:25,665][123091] Updated weights for policy 0, policy_version 1804755 (0.0007) [2023-12-26 14:00:25,735][123091] Updated weights for policy 0, policy_version 1804765 (0.0005) [2023-12-26 14:00:25,801][123091] Updated weights for policy 0, policy_version 1804775 (0.0005) [2023-12-26 14:00:25,992][123090] Updated weights for policy 1, policy_version 1793027 (0.0009) [2023-12-26 14:00:26,047][123090] Updated weights for policy 1, policy_version 1793037 (0.0010) [2023-12-26 14:00:26,106][123090] Updated weights for policy 1, policy_version 1793047 (0.0010) [2023-12-26 14:00:26,517][123091] Updated weights for policy 0, policy_version 1804785 (0.0006) [2023-12-26 14:00:26,571][123091] Updated weights for policy 0, policy_version 1804795 (0.0010) [2023-12-26 14:00:26,629][123091] Updated weights for policy 0, policy_version 1804805 (0.0010) [2023-12-26 14:00:26,676][123091] Updated weights for policy 0, policy_version 1804815 (0.0010) [2023-12-26 14:00:26,859][123090] Updated weights for policy 1, policy_version 1793057 (0.0010) [2023-12-26 14:00:26,914][123090] Updated weights for policy 1, policy_version 1793067 (0.0005) [2023-12-26 14:00:26,962][123090] Updated weights for policy 1, policy_version 1793077 (0.0005) [2023-12-26 14:00:27,007][123090] Updated weights for policy 1, policy_version 1793087 (0.0005) [2023-12-26 14:00:27,516][123091] Updated weights for policy 0, policy_version 1804825 (0.0011) [2023-12-26 14:00:27,576][123091] Updated weights for policy 0, policy_version 1804835 (0.0011) [2023-12-26 14:00:27,629][123091] Updated weights for policy 0, policy_version 1804845 (0.0010) [2023-12-26 14:00:27,689][123090] Updated weights for policy 1, policy_version 1793097 (0.0005) [2023-12-26 14:00:27,754][123090] Updated weights for policy 1, policy_version 1793107 (0.0010) [2023-12-26 14:00:27,822][123090] Updated weights for policy 1, policy_version 1793117 (0.0010) [2023-12-26 14:00:28,519][123091] Updated weights for policy 0, policy_version 1804855 (0.0010) [2023-12-26 14:00:28,567][123090] Updated weights for policy 1, policy_version 1793127 (0.0007) [2023-12-26 14:00:28,579][123091] Updated weights for policy 0, policy_version 1804865 (0.0009) [2023-12-26 14:00:28,621][123090] Updated weights for policy 1, policy_version 1793137 (0.0010) [2023-12-26 14:00:28,641][123091] Updated weights for policy 0, policy_version 1804875 (0.0006) [2023-12-26 14:00:28,687][123090] Updated weights for policy 1, policy_version 1793147 (0.0011) [2023-12-26 14:00:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 921100288. Throughput: 0: 8939.4, 1: 8930.5. Samples: 921087384. Policy #0 lag: (min: 29.0, avg: 29.0, max: 29.0) [2023-12-26 14:00:28,785][121949] Avg episode reward: [(0, '6114.521'), (1, '5984.175')] [2023-12-26 14:00:29,428][123091] Updated weights for policy 0, policy_version 1804885 (0.0008) [2023-12-26 14:00:29,490][123090] Updated weights for policy 1, policy_version 1793157 (0.0009) [2023-12-26 14:00:29,493][123091] Updated weights for policy 0, policy_version 1804895 (0.0009) [2023-12-26 14:00:29,556][123090] Updated weights for policy 1, policy_version 1793167 (0.0008) [2023-12-26 14:00:29,558][123091] Updated weights for policy 0, policy_version 1804905 (0.0008) [2023-12-26 14:00:29,615][123090] Updated weights for policy 1, policy_version 1793177 (0.0008) [2023-12-26 14:00:30,391][123091] Updated weights for policy 0, policy_version 1804915 (0.0008) [2023-12-26 14:00:30,436][123090] Updated weights for policy 1, policy_version 1793187 (0.0007) [2023-12-26 14:00:30,458][123091] Updated weights for policy 0, policy_version 1804925 (0.0008) [2023-12-26 14:00:30,494][123090] Updated weights for policy 1, policy_version 1793197 (0.0010) [2023-12-26 14:00:30,521][123091] Updated weights for policy 0, policy_version 1804935 (0.0010) [2023-12-26 14:00:30,550][123090] Updated weights for policy 1, policy_version 1793207 (0.0008) [2023-12-26 14:00:31,389][123091] Updated weights for policy 0, policy_version 1804945 (0.0010) [2023-12-26 14:00:31,393][123090] Updated weights for policy 1, policy_version 1793217 (0.0008) [2023-12-26 14:00:31,452][123091] Updated weights for policy 0, policy_version 1804955 (0.0011) [2023-12-26 14:00:31,455][123090] Updated weights for policy 1, policy_version 1793227 (0.0006) [2023-12-26 14:00:31,508][123091] Updated weights for policy 0, policy_version 1804965 (0.0010) [2023-12-26 14:00:31,512][123090] Updated weights for policy 1, policy_version 1793237 (0.0008) [2023-12-26 14:00:31,560][123091] Updated weights for policy 0, policy_version 1804975 (0.0010) [2023-12-26 14:00:31,571][123090] Updated weights for policy 1, policy_version 1793247 (0.0006) [2023-12-26 14:00:32,397][123091] Updated weights for policy 0, policy_version 1804985 (0.0008) [2023-12-26 14:00:32,443][123090] Updated weights for policy 1, policy_version 1793257 (0.0011) [2023-12-26 14:00:32,465][123091] Updated weights for policy 0, policy_version 1804995 (0.0011) [2023-12-26 14:00:32,498][123090] Updated weights for policy 1, policy_version 1793267 (0.0010) [2023-12-26 14:00:32,532][123091] Updated weights for policy 0, policy_version 1805005 (0.0011) [2023-12-26 14:00:32,557][123090] Updated weights for policy 1, policy_version 1793277 (0.0007) [2023-12-26 14:00:33,228][123091] Updated weights for policy 0, policy_version 1805015 (0.0007) [2023-12-26 14:00:33,291][123090] Updated weights for policy 1, policy_version 1793287 (0.0005) [2023-12-26 14:00:33,294][123091] Updated weights for policy 0, policy_version 1805025 (0.0009) [2023-12-26 14:00:33,346][123091] Updated weights for policy 0, policy_version 1805035 (0.0011) [2023-12-26 14:00:33,347][123090] Updated weights for policy 1, policy_version 1793297 (0.0005) [2023-12-26 14:00:33,394][123090] Updated weights for policy 1, policy_version 1793307 (0.0008) [2023-12-26 14:00:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 921182208. Throughput: 0: 8865.7, 1: 8871.3. Samples: 921192624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:33,785][121949] Avg episode reward: [(0, '6168.885'), (1, '5759.737')] [2023-12-26 14:00:34,033][123091] Updated weights for policy 0, policy_version 1805045 (0.0008) [2023-12-26 14:00:34,083][123091] Updated weights for policy 0, policy_version 1805055 (0.0006) [2023-12-26 14:00:34,129][123091] Updated weights for policy 0, policy_version 1805065 (0.0005) [2023-12-26 14:00:34,160][123090] Updated weights for policy 1, policy_version 1793317 (0.0008) [2023-12-26 14:00:34,232][123090] Updated weights for policy 1, policy_version 1793327 (0.0013) [2023-12-26 14:00:34,308][123090] Updated weights for policy 1, policy_version 1793337 (0.0011) [2023-12-26 14:00:34,950][123091] Updated weights for policy 0, policy_version 1805077 (0.0009) [2023-12-26 14:00:35,016][123091] Updated weights for policy 0, policy_version 1805087 (0.0010) [2023-12-26 14:00:35,075][123091] Updated weights for policy 0, policy_version 1805097 (0.0011) [2023-12-26 14:00:35,132][123090] Updated weights for policy 1, policy_version 1793347 (0.0011) [2023-12-26 14:00:35,195][123090] Updated weights for policy 1, policy_version 1793357 (0.0010) [2023-12-26 14:00:35,264][123090] Updated weights for policy 1, policy_version 1793367 (0.0008) [2023-12-26 14:00:35,894][123091] Updated weights for policy 0, policy_version 1805107 (0.0011) [2023-12-26 14:00:35,945][123091] Updated weights for policy 0, policy_version 1805117 (0.0010) [2023-12-26 14:00:36,005][123091] Updated weights for policy 0, policy_version 1805127 (0.0011) [2023-12-26 14:00:36,012][123090] Updated weights for policy 1, policy_version 1793377 (0.0010) [2023-12-26 14:00:36,074][123090] Updated weights for policy 1, policy_version 1793387 (0.0007) [2023-12-26 14:00:36,151][123090] Updated weights for policy 1, policy_version 1793397 (0.0009) [2023-12-26 14:00:36,211][123090] Updated weights for policy 1, policy_version 1793407 (0.0009) [2023-12-26 14:00:36,864][123091] Updated weights for policy 0, policy_version 1805137 (0.0011) [2023-12-26 14:00:36,929][123091] Updated weights for policy 0, policy_version 1805147 (0.0009) [2023-12-26 14:00:36,998][123091] Updated weights for policy 0, policy_version 1805157 (0.0008) [2023-12-26 14:00:37,052][123091] Updated weights for policy 0, policy_version 1805167 (0.0007) [2023-12-26 14:00:37,065][123090] Updated weights for policy 1, policy_version 1793417 (0.0010) [2023-12-26 14:00:37,126][123090] Updated weights for policy 1, policy_version 1793427 (0.0011) [2023-12-26 14:00:37,182][123090] Updated weights for policy 1, policy_version 1793437 (0.0010) [2023-12-26 14:00:37,786][123091] Updated weights for policy 0, policy_version 1805177 (0.0005) [2023-12-26 14:00:37,851][123091] Updated weights for policy 0, policy_version 1805187 (0.0008) [2023-12-26 14:00:37,915][123091] Updated weights for policy 0, policy_version 1805197 (0.0011) [2023-12-26 14:00:38,041][123090] Updated weights for policy 1, policy_version 1793447 (0.0011) [2023-12-26 14:00:38,099][123090] Updated weights for policy 1, policy_version 1793457 (0.0011) [2023-12-26 14:00:38,156][123090] Updated weights for policy 1, policy_version 1793467 (0.0011) [2023-12-26 14:00:38,687][123091] Updated weights for policy 0, policy_version 1805207 (0.0010) [2023-12-26 14:00:38,735][123091] Updated weights for policy 0, policy_version 1805217 (0.0010) [2023-12-26 14:00:38,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 921264128. Throughput: 0: 8900.6, 1: 8846.5. Samples: 921245488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:38,785][121949] Avg episode reward: [(0, '6325.188'), (1, '5633.625')] [2023-12-26 14:00:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001793472_459128832.pth... [2023-12-26 14:00:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001792480_458874880.pth [2023-12-26 14:00:38,796][123091] Updated weights for policy 0, policy_version 1805227 (0.0011) [2023-12-26 14:00:38,828][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001805232_462143488.pth... [2023-12-26 14:00:38,833][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001804176_461873152.pth [2023-12-26 14:00:38,997][123090] Updated weights for policy 1, policy_version 1793477 (0.0011) [2023-12-26 14:00:39,062][123090] Updated weights for policy 1, policy_version 1793487 (0.0009) [2023-12-26 14:00:39,121][123090] Updated weights for policy 1, policy_version 1793497 (0.0010) [2023-12-26 14:00:39,625][123091] Updated weights for policy 0, policy_version 1805237 (0.0011) [2023-12-26 14:00:39,680][123091] Updated weights for policy 0, policy_version 1805247 (0.0011) [2023-12-26 14:00:39,731][123091] Updated weights for policy 0, policy_version 1805257 (0.0009) [2023-12-26 14:00:39,927][123090] Updated weights for policy 1, policy_version 1793507 (0.0009) [2023-12-26 14:00:39,992][123090] Updated weights for policy 1, policy_version 1793517 (0.0011) [2023-12-26 14:00:40,057][123090] Updated weights for policy 1, policy_version 1793527 (0.0011) [2023-12-26 14:00:40,583][123091] Updated weights for policy 0, policy_version 1805267 (0.0011) [2023-12-26 14:00:40,638][123091] Updated weights for policy 0, policy_version 1805277 (0.0011) [2023-12-26 14:00:40,691][123091] Updated weights for policy 0, policy_version 1805287 (0.0011) [2023-12-26 14:00:40,831][123090] Updated weights for policy 1, policy_version 1793537 (0.0011) [2023-12-26 14:00:40,916][123090] Updated weights for policy 1, policy_version 1793547 (0.0010) [2023-12-26 14:00:40,976][123090] Updated weights for policy 1, policy_version 1793557 (0.0010) [2023-12-26 14:00:41,046][123090] Updated weights for policy 1, policy_version 1793567 (0.0011) [2023-12-26 14:00:41,520][123091] Updated weights for policy 0, policy_version 1805297 (0.0010) [2023-12-26 14:00:41,582][123091] Updated weights for policy 0, policy_version 1805307 (0.0008) [2023-12-26 14:00:41,650][123091] Updated weights for policy 0, policy_version 1805317 (0.0009) [2023-12-26 14:00:41,709][123091] Updated weights for policy 0, policy_version 1805327 (0.0009) [2023-12-26 14:00:41,873][123090] Updated weights for policy 1, policy_version 1793577 (0.0009) [2023-12-26 14:00:41,928][123090] Updated weights for policy 1, policy_version 1793587 (0.0008) [2023-12-26 14:00:41,988][123090] Updated weights for policy 1, policy_version 1793597 (0.0010) [2023-12-26 14:00:42,598][123091] Updated weights for policy 0, policy_version 1805337 (0.0009) [2023-12-26 14:00:42,659][123091] Updated weights for policy 0, policy_version 1805347 (0.0009) [2023-12-26 14:00:42,713][123091] Updated weights for policy 0, policy_version 1805357 (0.0010) [2023-12-26 14:00:42,820][123090] Updated weights for policy 1, policy_version 1793607 (0.0009) [2023-12-26 14:00:42,884][123090] Updated weights for policy 1, policy_version 1793617 (0.0010) [2023-12-26 14:00:42,946][123090] Updated weights for policy 1, policy_version 1793627 (0.0008) [2023-12-26 14:00:43,560][123091] Updated weights for policy 0, policy_version 1805367 (0.0009) [2023-12-26 14:00:43,621][123091] Updated weights for policy 0, policy_version 1805377 (0.0009) [2023-12-26 14:00:43,688][123091] Updated weights for policy 0, policy_version 1805387 (0.0010) [2023-12-26 14:00:43,762][123090] Updated weights for policy 1, policy_version 1793637 (0.0008) [2023-12-26 14:00:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 921354240. Throughput: 0: 8792.7, 1: 8811.0. Samples: 921349012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:43,784][121949] Avg episode reward: [(0, '6423.229'), (1, '5769.080')] [2023-12-26 14:00:43,816][123090] Updated weights for policy 1, policy_version 1793647 (0.0006) [2023-12-26 14:00:43,872][123090] Updated weights for policy 1, policy_version 1793657 (0.0009) [2023-12-26 14:00:44,567][123091] Updated weights for policy 0, policy_version 1805397 (0.0009) [2023-12-26 14:00:44,618][123091] Updated weights for policy 0, policy_version 1805408 (0.0010) [2023-12-26 14:00:44,661][123091] Updated weights for policy 0, policy_version 1805418 (0.0006) [2023-12-26 14:00:44,662][123090] Updated weights for policy 1, policy_version 1793667 (0.0009) [2023-12-26 14:00:44,720][123090] Updated weights for policy 1, policy_version 1793677 (0.0005) [2023-12-26 14:00:44,791][123090] Updated weights for policy 1, policy_version 1793687 (0.0007) [2023-12-26 14:00:45,402][123091] Updated weights for policy 0, policy_version 1805428 (0.0007) [2023-12-26 14:00:45,471][123091] Updated weights for policy 0, policy_version 1805438 (0.0010) [2023-12-26 14:00:45,536][123091] Updated weights for policy 0, policy_version 1805448 (0.0009) [2023-12-26 14:00:45,652][123090] Updated weights for policy 1, policy_version 1793697 (0.0010) [2023-12-26 14:00:45,720][123090] Updated weights for policy 1, policy_version 1793707 (0.0011) [2023-12-26 14:00:45,785][123090] Updated weights for policy 1, policy_version 1793717 (0.0009) [2023-12-26 14:00:45,850][123090] Updated weights for policy 1, policy_version 1793727 (0.0010) [2023-12-26 14:00:46,375][123091] Updated weights for policy 0, policy_version 1805458 (0.0008) [2023-12-26 14:00:46,445][123091] Updated weights for policy 0, policy_version 1805468 (0.0008) [2023-12-26 14:00:46,506][123091] Updated weights for policy 0, policy_version 1805478 (0.0008) [2023-12-26 14:00:46,571][123091] Updated weights for policy 0, policy_version 1805488 (0.0008) [2023-12-26 14:00:46,626][123090] Updated weights for policy 1, policy_version 1793737 (0.0008) [2023-12-26 14:00:46,682][123090] Updated weights for policy 1, policy_version 1793747 (0.0009) [2023-12-26 14:00:46,743][123090] Updated weights for policy 1, policy_version 1793757 (0.0005) [2023-12-26 14:00:47,228][123091] Updated weights for policy 0, policy_version 1805498 (0.0008) [2023-12-26 14:00:47,287][123091] Updated weights for policy 0, policy_version 1805508 (0.0011) [2023-12-26 14:00:47,342][123091] Updated weights for policy 0, policy_version 1805518 (0.0008) [2023-12-26 14:00:47,394][123090] Updated weights for policy 1, policy_version 1793767 (0.0008) [2023-12-26 14:00:47,442][123090] Updated weights for policy 1, policy_version 1793777 (0.0009) [2023-12-26 14:00:47,493][123090] Updated weights for policy 1, policy_version 1793787 (0.0010) [2023-12-26 14:00:48,081][123091] Updated weights for policy 0, policy_version 1805528 (0.0008) [2023-12-26 14:00:48,144][123091] Updated weights for policy 0, policy_version 1805538 (0.0005) [2023-12-26 14:00:48,194][123091] Updated weights for policy 0, policy_version 1805548 (0.0006) [2023-12-26 14:00:48,204][123090] Updated weights for policy 1, policy_version 1793797 (0.0009) [2023-12-26 14:00:48,274][123090] Updated weights for policy 1, policy_version 1793807 (0.0008) [2023-12-26 14:00:48,341][123090] Updated weights for policy 1, policy_version 1793817 (0.0011) [2023-12-26 14:00:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 921444352. Throughput: 0: 8904.9, 1: 8803.4. Samples: 921457960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:48,785][121949] Avg episode reward: [(0, '6340.127'), (1, '5782.165')] [2023-12-26 14:00:48,913][123091] Updated weights for policy 0, policy_version 1805558 (0.0009) [2023-12-26 14:00:48,983][123091] Updated weights for policy 0, policy_version 1805568 (0.0011) [2023-12-26 14:00:49,008][123090] Updated weights for policy 1, policy_version 1793827 (0.0009) [2023-12-26 14:00:49,050][123091] Updated weights for policy 0, policy_version 1805578 (0.0009) [2023-12-26 14:00:49,072][123090] Updated weights for policy 1, policy_version 1793837 (0.0008) [2023-12-26 14:00:49,145][123090] Updated weights for policy 1, policy_version 1793847 (0.0006) [2023-12-26 14:00:49,798][123091] Updated weights for policy 0, policy_version 1805588 (0.0005) [2023-12-26 14:00:49,881][123091] Updated weights for policy 0, policy_version 1805598 (0.0008) [2023-12-26 14:00:49,941][123091] Updated weights for policy 0, policy_version 1805608 (0.0011) [2023-12-26 14:00:50,006][123090] Updated weights for policy 1, policy_version 1793857 (0.0010) [2023-12-26 14:00:50,072][123090] Updated weights for policy 1, policy_version 1793867 (0.0007) [2023-12-26 14:00:50,131][123090] Updated weights for policy 1, policy_version 1793877 (0.0006) [2023-12-26 14:00:50,188][123090] Updated weights for policy 1, policy_version 1793887 (0.0005) [2023-12-26 14:00:50,592][123091] Updated weights for policy 0, policy_version 1805618 (0.0010) [2023-12-26 14:00:50,654][123091] Updated weights for policy 0, policy_version 1805628 (0.0007) [2023-12-26 14:00:50,725][123091] Updated weights for policy 0, policy_version 1805638 (0.0010) [2023-12-26 14:00:50,789][123091] Updated weights for policy 0, policy_version 1805648 (0.0011) [2023-12-26 14:00:50,996][123090] Updated weights for policy 1, policy_version 1793897 (0.0008) [2023-12-26 14:00:51,068][123090] Updated weights for policy 1, policy_version 1793907 (0.0007) [2023-12-26 14:00:51,142][123090] Updated weights for policy 1, policy_version 1793917 (0.0008) [2023-12-26 14:00:51,616][123091] Updated weights for policy 0, policy_version 1805658 (0.0008) [2023-12-26 14:00:51,680][123091] Updated weights for policy 0, policy_version 1805668 (0.0009) [2023-12-26 14:00:51,757][123091] Updated weights for policy 0, policy_version 1805678 (0.0010) [2023-12-26 14:00:51,900][123090] Updated weights for policy 1, policy_version 1793927 (0.0009) [2023-12-26 14:00:51,951][123090] Updated weights for policy 1, policy_version 1793937 (0.0009) [2023-12-26 14:00:52,005][123090] Updated weights for policy 1, policy_version 1793947 (0.0010) [2023-12-26 14:00:52,590][123091] Updated weights for policy 0, policy_version 1805688 (0.0006) [2023-12-26 14:00:52,645][123091] Updated weights for policy 0, policy_version 1805698 (0.0005) [2023-12-26 14:00:52,691][123091] Updated weights for policy 0, policy_version 1805708 (0.0006) [2023-12-26 14:00:52,721][123090] Updated weights for policy 1, policy_version 1793957 (0.0010) [2023-12-26 14:00:52,779][123090] Updated weights for policy 1, policy_version 1793967 (0.0005) [2023-12-26 14:00:52,848][123090] Updated weights for policy 1, policy_version 1793977 (0.0009) [2023-12-26 14:00:53,468][123091] Updated weights for policy 0, policy_version 1805718 (0.0006) [2023-12-26 14:00:53,548][123091] Updated weights for policy 0, policy_version 1805728 (0.0006) [2023-12-26 14:00:53,612][123091] Updated weights for policy 0, policy_version 1805738 (0.0005) [2023-12-26 14:00:53,689][123090] Updated weights for policy 1, policy_version 1793987 (0.0010) [2023-12-26 14:00:53,744][123090] Updated weights for policy 1, policy_version 1793997 (0.0010) [2023-12-26 14:00:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 921534464. Throughput: 0: 8960.5, 1: 8777.2. Samples: 921512828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:53,785][121949] Avg episode reward: [(0, '6304.318'), (1, '5747.731')] [2023-12-26 14:00:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001805744_462274560.pth... [2023-12-26 14:00:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001804688_462004224.pth [2023-12-26 14:00:53,802][123090] Updated weights for policy 1, policy_version 1794007 (0.0010) [2023-12-26 14:00:53,852][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001794016_459268096.pth... [2023-12-26 14:00:53,856][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001792960_458997760.pth [2023-12-26 14:00:54,230][123091] Updated weights for policy 0, policy_version 1805748 (0.0005) [2023-12-26 14:00:54,294][123091] Updated weights for policy 0, policy_version 1805758 (0.0008) [2023-12-26 14:00:54,366][123091] Updated weights for policy 0, policy_version 1805768 (0.0006) [2023-12-26 14:00:54,722][123090] Updated weights for policy 1, policy_version 1794017 (0.0010) [2023-12-26 14:00:54,770][123090] Updated weights for policy 1, policy_version 1794027 (0.0009) [2023-12-26 14:00:54,818][123090] Updated weights for policy 1, policy_version 1794037 (0.0008) [2023-12-26 14:00:54,872][123090] Updated weights for policy 1, policy_version 1794047 (0.0005) [2023-12-26 14:00:55,097][123091] Updated weights for policy 0, policy_version 1805778 (0.0006) [2023-12-26 14:00:55,150][123091] Updated weights for policy 0, policy_version 1805788 (0.0005) [2023-12-26 14:00:55,209][123091] Updated weights for policy 0, policy_version 1805798 (0.0007) [2023-12-26 14:00:55,263][123091] Updated weights for policy 0, policy_version 1805808 (0.0010) [2023-12-26 14:00:55,672][123090] Updated weights for policy 1, policy_version 1794057 (0.0005) [2023-12-26 14:00:55,735][123090] Updated weights for policy 1, policy_version 1794067 (0.0006) [2023-12-26 14:00:55,795][123090] Updated weights for policy 1, policy_version 1794077 (0.0005) [2023-12-26 14:00:56,091][123091] Updated weights for policy 0, policy_version 1805818 (0.0011) [2023-12-26 14:00:56,142][123091] Updated weights for policy 0, policy_version 1805828 (0.0010) [2023-12-26 14:00:56,201][123091] Updated weights for policy 0, policy_version 1805838 (0.0010) [2023-12-26 14:00:56,574][123090] Updated weights for policy 1, policy_version 1794087 (0.0008) [2023-12-26 14:00:56,627][123090] Updated weights for policy 1, policy_version 1794097 (0.0009) [2023-12-26 14:00:56,679][123090] Updated weights for policy 1, policy_version 1794107 (0.0009) [2023-12-26 14:00:57,023][123091] Updated weights for policy 0, policy_version 1805848 (0.0006) [2023-12-26 14:00:57,068][123091] Updated weights for policy 0, policy_version 1805858 (0.0005) [2023-12-26 14:00:57,114][123091] Updated weights for policy 0, policy_version 1805868 (0.0005) [2023-12-26 14:00:57,526][123090] Updated weights for policy 1, policy_version 1794117 (0.0007) [2023-12-26 14:00:57,581][123090] Updated weights for policy 1, policy_version 1794127 (0.0005) [2023-12-26 14:00:57,643][123090] Updated weights for policy 1, policy_version 1794137 (0.0005) [2023-12-26 14:00:57,821][123091] Updated weights for policy 0, policy_version 1805878 (0.0005) [2023-12-26 14:00:57,881][123091] Updated weights for policy 0, policy_version 1805888 (0.0005) [2023-12-26 14:00:57,928][123091] Updated weights for policy 0, policy_version 1805898 (0.0005) [2023-12-26 14:00:58,388][123090] Updated weights for policy 1, policy_version 1794147 (0.0006) [2023-12-26 14:00:58,457][123090] Updated weights for policy 1, policy_version 1794157 (0.0008) [2023-12-26 14:00:58,522][123090] Updated weights for policy 1, policy_version 1794167 (0.0008) [2023-12-26 14:00:58,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 921624576. Throughput: 0: 8999.8, 1: 8757.4. Samples: 921620536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:00:58,784][121949] Avg episode reward: [(0, '6314.597'), (1, '5811.561')] [2023-12-26 14:00:58,791][123091] Updated weights for policy 0, policy_version 1805908 (0.0006) [2023-12-26 14:00:58,858][123091] Updated weights for policy 0, policy_version 1805918 (0.0010) [2023-12-26 14:00:58,924][123091] Updated weights for policy 0, policy_version 1805928 (0.0010) [2023-12-26 14:00:59,286][123090] Updated weights for policy 1, policy_version 1794177 (0.0010) [2023-12-26 14:00:59,355][123090] Updated weights for policy 1, policy_version 1794187 (0.0010) [2023-12-26 14:00:59,412][123090] Updated weights for policy 1, policy_version 1794197 (0.0008) [2023-12-26 14:00:59,465][123090] Updated weights for policy 1, policy_version 1794207 (0.0008) [2023-12-26 14:00:59,771][123091] Updated weights for policy 0, policy_version 1805938 (0.0010) [2023-12-26 14:00:59,835][123091] Updated weights for policy 0, policy_version 1805948 (0.0011) [2023-12-26 14:00:59,905][123091] Updated weights for policy 0, policy_version 1805958 (0.0011) [2023-12-26 14:00:59,973][123091] Updated weights for policy 0, policy_version 1805968 (0.0011) [2023-12-26 14:01:00,264][123090] Updated weights for policy 1, policy_version 1794217 (0.0009) [2023-12-26 14:01:00,328][123090] Updated weights for policy 1, policy_version 1794227 (0.0009) [2023-12-26 14:01:00,388][123090] Updated weights for policy 1, policy_version 1794237 (0.0009) [2023-12-26 14:01:00,771][123091] Updated weights for policy 0, policy_version 1805978 (0.0010) [2023-12-26 14:01:00,817][123091] Updated weights for policy 0, policy_version 1805988 (0.0010) [2023-12-26 14:01:00,868][123091] Updated weights for policy 0, policy_version 1805998 (0.0007) [2023-12-26 14:01:01,263][123090] Updated weights for policy 1, policy_version 1794247 (0.0010) [2023-12-26 14:01:01,317][123090] Updated weights for policy 1, policy_version 1794257 (0.0010) [2023-12-26 14:01:01,383][123090] Updated weights for policy 1, policy_version 1794267 (0.0010) [2023-12-26 14:01:01,632][123091] Updated weights for policy 0, policy_version 1806008 (0.0009) [2023-12-26 14:01:01,702][123091] Updated weights for policy 0, policy_version 1806018 (0.0011) [2023-12-26 14:01:01,763][123091] Updated weights for policy 0, policy_version 1806028 (0.0010) [2023-12-26 14:01:02,190][123090] Updated weights for policy 1, policy_version 1794277 (0.0007) [2023-12-26 14:01:02,242][123090] Updated weights for policy 1, policy_version 1794287 (0.0005) [2023-12-26 14:01:02,313][123090] Updated weights for policy 1, policy_version 1794297 (0.0006) [2023-12-26 14:01:02,497][123091] Updated weights for policy 0, policy_version 1806038 (0.0011) [2023-12-26 14:01:02,548][123091] Updated weights for policy 0, policy_version 1806048 (0.0010) [2023-12-26 14:01:02,599][123091] Updated weights for policy 0, policy_version 1806058 (0.0010) [2023-12-26 14:01:03,084][123090] Updated weights for policy 1, policy_version 1794307 (0.0007) [2023-12-26 14:01:03,133][123090] Updated weights for policy 1, policy_version 1794317 (0.0009) [2023-12-26 14:01:03,186][123090] Updated weights for policy 1, policy_version 1794327 (0.0009) [2023-12-26 14:01:03,383][123091] Updated weights for policy 0, policy_version 1806068 (0.0009) [2023-12-26 14:01:03,433][123091] Updated weights for policy 0, policy_version 1806078 (0.0006) [2023-12-26 14:01:03,495][123091] Updated weights for policy 0, policy_version 1806088 (0.0008) [2023-12-26 14:01:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 921714688. Throughput: 0: 8893.4, 1: 8749.0. Samples: 921725720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:03,785][121949] Avg episode reward: [(0, '6245.750'), (1, '5795.687')] [2023-12-26 14:01:03,918][123090] Updated weights for policy 1, policy_version 1794337 (0.0007) [2023-12-26 14:01:03,982][123090] Updated weights for policy 1, policy_version 1794347 (0.0010) [2023-12-26 14:01:04,045][123090] Updated weights for policy 1, policy_version 1794357 (0.0010) [2023-12-26 14:01:04,106][123090] Updated weights for policy 1, policy_version 1794367 (0.0010) [2023-12-26 14:01:04,217][123091] Updated weights for policy 0, policy_version 1806098 (0.0006) [2023-12-26 14:01:04,280][123091] Updated weights for policy 0, policy_version 1806108 (0.0009) [2023-12-26 14:01:04,338][123091] Updated weights for policy 0, policy_version 1806118 (0.0009) [2023-12-26 14:01:04,391][123091] Updated weights for policy 0, policy_version 1806128 (0.0009) [2023-12-26 14:01:04,937][123090] Updated weights for policy 1, policy_version 1794377 (0.0010) [2023-12-26 14:01:04,995][123090] Updated weights for policy 1, policy_version 1794387 (0.0010) [2023-12-26 14:01:05,058][123090] Updated weights for policy 1, policy_version 1794397 (0.0010) [2023-12-26 14:01:05,231][123091] Updated weights for policy 0, policy_version 1806138 (0.0005) [2023-12-26 14:01:05,279][123091] Updated weights for policy 0, policy_version 1806148 (0.0008) [2023-12-26 14:01:05,325][123091] Updated weights for policy 0, policy_version 1806158 (0.0009) [2023-12-26 14:01:05,958][123090] Updated weights for policy 1, policy_version 1794407 (0.0010) [2023-12-26 14:01:06,005][123090] Updated weights for policy 1, policy_version 1794417 (0.0010) [2023-12-26 14:01:06,054][123090] Updated weights for policy 1, policy_version 1794427 (0.0007) [2023-12-26 14:01:06,066][123091] Updated weights for policy 0, policy_version 1806168 (0.0008) [2023-12-26 14:01:06,128][123091] Updated weights for policy 0, policy_version 1806178 (0.0009) [2023-12-26 14:01:06,191][123091] Updated weights for policy 0, policy_version 1806188 (0.0011) [2023-12-26 14:01:06,933][123090] Updated weights for policy 1, policy_version 1794437 (0.0009) [2023-12-26 14:01:06,998][123091] Updated weights for policy 0, policy_version 1806198 (0.0009) [2023-12-26 14:01:07,005][123090] Updated weights for policy 1, policy_version 1794447 (0.0011) [2023-12-26 14:01:07,053][123091] Updated weights for policy 0, policy_version 1806208 (0.0010) [2023-12-26 14:01:07,068][123090] Updated weights for policy 1, policy_version 1794457 (0.0010) [2023-12-26 14:01:07,105][123091] Updated weights for policy 0, policy_version 1806218 (0.0008) [2023-12-26 14:01:07,813][123090] Updated weights for policy 1, policy_version 1794467 (0.0009) [2023-12-26 14:01:07,867][123090] Updated weights for policy 1, policy_version 1794477 (0.0006) [2023-12-26 14:01:07,911][123091] Updated weights for policy 0, policy_version 1806228 (0.0010) [2023-12-26 14:01:07,923][123090] Updated weights for policy 1, policy_version 1794487 (0.0007) [2023-12-26 14:01:07,978][123091] Updated weights for policy 0, policy_version 1806238 (0.0011) [2023-12-26 14:01:08,044][123091] Updated weights for policy 0, policy_version 1806248 (0.0011) [2023-12-26 14:01:08,566][123090] Updated weights for policy 1, policy_version 1794497 (0.0008) [2023-12-26 14:01:08,635][123090] Updated weights for policy 1, policy_version 1794507 (0.0006) [2023-12-26 14:01:08,703][123090] Updated weights for policy 1, policy_version 1794517 (0.0006) [2023-12-26 14:01:08,781][123090] Updated weights for policy 1, policy_version 1794527 (0.0006) [2023-12-26 14:01:08,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 921796608. Throughput: 0: 8935.0, 1: 8768.0. Samples: 921778656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:08,785][121949] Avg episode reward: [(0, '6179.750'), (1, '5740.322')] [2023-12-26 14:01:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001806256_462405632.pth... [2023-12-26 14:01:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001794528_459399168.pth... [2023-12-26 14:01:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001805232_462143488.pth [2023-12-26 14:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001793472_459128832.pth [2023-12-26 14:01:08,843][123091] Updated weights for policy 0, policy_version 1806258 (0.0010) [2023-12-26 14:01:08,907][123091] Updated weights for policy 0, policy_version 1806268 (0.0006) [2023-12-26 14:01:08,963][123091] Updated weights for policy 0, policy_version 1806278 (0.0006) [2023-12-26 14:01:09,026][123091] Updated weights for policy 0, policy_version 1806288 (0.0005) [2023-12-26 14:01:09,417][123090] Updated weights for policy 1, policy_version 1794537 (0.0007) [2023-12-26 14:01:09,477][123090] Updated weights for policy 1, policy_version 1794547 (0.0006) [2023-12-26 14:01:09,546][123090] Updated weights for policy 1, policy_version 1794557 (0.0006) [2023-12-26 14:01:09,766][123091] Updated weights for policy 0, policy_version 1806298 (0.0010) [2023-12-26 14:01:09,821][123091] Updated weights for policy 0, policy_version 1806308 (0.0010) [2023-12-26 14:01:09,886][123091] Updated weights for policy 0, policy_version 1806318 (0.0009) [2023-12-26 14:01:10,278][123090] Updated weights for policy 1, policy_version 1794567 (0.0009) [2023-12-26 14:01:10,340][123090] Updated weights for policy 1, policy_version 1794577 (0.0011) [2023-12-26 14:01:10,407][123090] Updated weights for policy 1, policy_version 1794587 (0.0010) [2023-12-26 14:01:10,767][123091] Updated weights for policy 0, policy_version 1806328 (0.0011) [2023-12-26 14:01:10,831][123091] Updated weights for policy 0, policy_version 1806338 (0.0009) [2023-12-26 14:01:10,885][123091] Updated weights for policy 0, policy_version 1806348 (0.0007) [2023-12-26 14:01:11,249][123090] Updated weights for policy 1, policy_version 1794597 (0.0010) [2023-12-26 14:01:11,314][123090] Updated weights for policy 1, policy_version 1794607 (0.0009) [2023-12-26 14:01:11,381][123090] Updated weights for policy 1, policy_version 1794617 (0.0009) [2023-12-26 14:01:11,705][123091] Updated weights for policy 0, policy_version 1806358 (0.0008) [2023-12-26 14:01:11,776][123091] Updated weights for policy 0, policy_version 1806368 (0.0010) [2023-12-26 14:01:11,840][123091] Updated weights for policy 0, policy_version 1806378 (0.0010) [2023-12-26 14:01:12,186][123090] Updated weights for policy 1, policy_version 1794627 (0.0008) [2023-12-26 14:01:12,246][123090] Updated weights for policy 1, policy_version 1794637 (0.0008) [2023-12-26 14:01:12,307][123090] Updated weights for policy 1, policy_version 1794647 (0.0008) [2023-12-26 14:01:12,715][123091] Updated weights for policy 0, policy_version 1806388 (0.0010) [2023-12-26 14:01:12,773][123091] Updated weights for policy 0, policy_version 1806398 (0.0008) [2023-12-26 14:01:12,838][123091] Updated weights for policy 0, policy_version 1806408 (0.0005) [2023-12-26 14:01:13,094][123090] Updated weights for policy 1, policy_version 1794657 (0.0009) [2023-12-26 14:01:13,147][123090] Updated weights for policy 1, policy_version 1794667 (0.0008) [2023-12-26 14:01:13,195][123090] Updated weights for policy 1, policy_version 1794677 (0.0009) [2023-12-26 14:01:13,249][123090] Updated weights for policy 1, policy_version 1794687 (0.0009) [2023-12-26 14:01:13,611][123091] Updated weights for policy 0, policy_version 1806418 (0.0007) [2023-12-26 14:01:13,675][123091] Updated weights for policy 0, policy_version 1806428 (0.0010) [2023-12-26 14:01:13,737][123091] Updated weights for policy 0, policy_version 1806438 (0.0010) [2023-12-26 14:01:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 921886720. Throughput: 0: 8895.7, 1: 8824.9. Samples: 921884812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:13,785][121949] Avg episode reward: [(0, '6179.228'), (1, '5557.275')] [2023-12-26 14:01:13,797][123091] Updated weights for policy 0, policy_version 1806448 (0.0009) [2023-12-26 14:01:14,143][123090] Updated weights for policy 1, policy_version 1794697 (0.0010) [2023-12-26 14:01:14,195][123090] Updated weights for policy 1, policy_version 1794707 (0.0009) [2023-12-26 14:01:14,248][123090] Updated weights for policy 1, policy_version 1794717 (0.0009) [2023-12-26 14:01:14,573][123091] Updated weights for policy 0, policy_version 1806458 (0.0005) [2023-12-26 14:01:14,627][123091] Updated weights for policy 0, policy_version 1806468 (0.0007) [2023-12-26 14:01:14,676][123091] Updated weights for policy 0, policy_version 1806479 (0.0010) [2023-12-26 14:01:15,150][123090] Updated weights for policy 1, policy_version 1794727 (0.0009) [2023-12-26 14:01:15,220][123090] Updated weights for policy 1, policy_version 1794737 (0.0009) [2023-12-26 14:01:15,287][123090] Updated weights for policy 1, policy_version 1794747 (0.0010) [2023-12-26 14:01:15,476][123091] Updated weights for policy 0, policy_version 1806489 (0.0009) [2023-12-26 14:01:15,529][123091] Updated weights for policy 0, policy_version 1806499 (0.0010) [2023-12-26 14:01:15,582][123091] Updated weights for policy 0, policy_version 1806510 (0.0009) [2023-12-26 14:01:16,034][123090] Updated weights for policy 1, policy_version 1794757 (0.0008) [2023-12-26 14:01:16,108][123090] Updated weights for policy 1, policy_version 1794767 (0.0005) [2023-12-26 14:01:16,173][123090] Updated weights for policy 1, policy_version 1794777 (0.0005) [2023-12-26 14:01:16,476][123091] Updated weights for policy 0, policy_version 1806520 (0.0009) [2023-12-26 14:01:16,536][123091] Updated weights for policy 0, policy_version 1806532 (0.0011) [2023-12-26 14:01:16,594][123091] Updated weights for policy 0, policy_version 1806542 (0.0010) [2023-12-26 14:01:16,835][123090] Updated weights for policy 1, policy_version 1794787 (0.0007) [2023-12-26 14:01:16,911][123090] Updated weights for policy 1, policy_version 1794797 (0.0009) [2023-12-26 14:01:16,963][123090] Updated weights for policy 1, policy_version 1794807 (0.0006) [2023-12-26 14:01:17,494][123091] Updated weights for policy 0, policy_version 1806552 (0.0010) [2023-12-26 14:01:17,547][123091] Updated weights for policy 0, policy_version 1806563 (0.0009) [2023-12-26 14:01:17,601][123091] Updated weights for policy 0, policy_version 1806574 (0.0010) [2023-12-26 14:01:17,665][123090] Updated weights for policy 1, policy_version 1794817 (0.0009) [2023-12-26 14:01:17,729][123090] Updated weights for policy 1, policy_version 1794827 (0.0005) [2023-12-26 14:01:17,789][123090] Updated weights for policy 1, policy_version 1794837 (0.0005) [2023-12-26 14:01:17,847][123090] Updated weights for policy 1, policy_version 1794847 (0.0005) [2023-12-26 14:01:18,523][123090] Updated weights for policy 1, policy_version 1794857 (0.0008) [2023-12-26 14:01:18,571][123090] Updated weights for policy 1, policy_version 1794867 (0.0008) [2023-12-26 14:01:18,579][123091] Updated weights for policy 0, policy_version 1806584 (0.0007) [2023-12-26 14:01:18,631][123090] Updated weights for policy 1, policy_version 1794877 (0.0007) [2023-12-26 14:01:18,643][123091] Updated weights for policy 0, policy_version 1806594 (0.0009) [2023-12-26 14:01:18,714][123091] Updated weights for policy 0, policy_version 1806604 (0.0010) [2023-12-26 14:01:18,784][121949] Fps is (10 sec: 18842.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 921985024. Throughput: 0: 8875.1, 1: 8865.5. Samples: 921990952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:18,785][121949] Avg episode reward: [(0, '6249.538'), (1, '5595.860')] [2023-12-26 14:01:19,443][123090] Updated weights for policy 1, policy_version 1794887 (0.0010) [2023-12-26 14:01:19,504][123090] Updated weights for policy 1, policy_version 1794897 (0.0011) [2023-12-26 14:01:19,564][123090] Updated weights for policy 1, policy_version 1794907 (0.0011) [2023-12-26 14:01:19,567][123091] Updated weights for policy 0, policy_version 1806614 (0.0007) [2023-12-26 14:01:19,630][123091] Updated weights for policy 0, policy_version 1806624 (0.0008) [2023-12-26 14:01:19,699][123091] Updated weights for policy 0, policy_version 1806634 (0.0009) [2023-12-26 14:01:20,419][123090] Updated weights for policy 1, policy_version 1794917 (0.0011) [2023-12-26 14:01:20,476][123090] Updated weights for policy 1, policy_version 1794927 (0.0011) [2023-12-26 14:01:20,528][123090] Updated weights for policy 1, policy_version 1794937 (0.0010) [2023-12-26 14:01:20,535][123091] Updated weights for policy 0, policy_version 1806644 (0.0009) [2023-12-26 14:01:20,602][123091] Updated weights for policy 0, policy_version 1806654 (0.0007) [2023-12-26 14:01:20,657][123091] Updated weights for policy 0, policy_version 1806664 (0.0009) [2023-12-26 14:01:21,395][123090] Updated weights for policy 1, policy_version 1794947 (0.0009) [2023-12-26 14:01:21,474][123090] Updated weights for policy 1, policy_version 1794957 (0.0007) [2023-12-26 14:01:21,544][123091] Updated weights for policy 0, policy_version 1806674 (0.0010) [2023-12-26 14:01:21,546][123090] Updated weights for policy 1, policy_version 1794967 (0.0008) [2023-12-26 14:01:21,606][123091] Updated weights for policy 0, policy_version 1806684 (0.0006) [2023-12-26 14:01:21,672][123091] Updated weights for policy 0, policy_version 1806694 (0.0010) [2023-12-26 14:01:21,739][123091] Updated weights for policy 0, policy_version 1806704 (0.0010) [2023-12-26 14:01:22,290][123090] Updated weights for policy 1, policy_version 1794977 (0.0009) [2023-12-26 14:01:22,357][123090] Updated weights for policy 1, policy_version 1794987 (0.0009) [2023-12-26 14:01:22,424][123090] Updated weights for policy 1, policy_version 1794997 (0.0008) [2023-12-26 14:01:22,492][123090] Updated weights for policy 1, policy_version 1795007 (0.0009) [2023-12-26 14:01:22,546][123091] Updated weights for policy 0, policy_version 1806714 (0.0010) [2023-12-26 14:01:22,617][123091] Updated weights for policy 0, policy_version 1806724 (0.0010) [2023-12-26 14:01:22,691][123091] Updated weights for policy 0, policy_version 1806734 (0.0009) [2023-12-26 14:01:23,337][123090] Updated weights for policy 1, policy_version 1795017 (0.0006) [2023-12-26 14:01:23,410][123090] Updated weights for policy 1, policy_version 1795027 (0.0005) [2023-12-26 14:01:23,467][123090] Updated weights for policy 1, policy_version 1795037 (0.0005) [2023-12-26 14:01:23,478][123091] Updated weights for policy 0, policy_version 1806744 (0.0009) [2023-12-26 14:01:23,537][123091] Updated weights for policy 0, policy_version 1806754 (0.0010) [2023-12-26 14:01:23,597][123091] Updated weights for policy 0, policy_version 1806764 (0.0010) [2023-12-26 14:01:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 922066944. Throughput: 0: 8815.6, 1: 8853.3. Samples: 922040592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:23,785][121949] Avg episode reward: [(0, '6292.524'), (1, '5513.854')] [2023-12-26 14:01:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001806768_462536704.pth... [2023-12-26 14:01:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001795040_459530240.pth... [2023-12-26 14:01:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001805744_462274560.pth [2023-12-26 14:01:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001794016_459268096.pth [2023-12-26 14:01:24,133][123090] Updated weights for policy 1, policy_version 1795047 (0.0006) [2023-12-26 14:01:24,204][123090] Updated weights for policy 1, policy_version 1795057 (0.0006) [2023-12-26 14:01:24,258][123090] Updated weights for policy 1, policy_version 1795067 (0.0006) [2023-12-26 14:01:24,529][123091] Updated weights for policy 0, policy_version 1806774 (0.0007) [2023-12-26 14:01:24,577][123091] Updated weights for policy 0, policy_version 1806784 (0.0005) [2023-12-26 14:01:24,625][123091] Updated weights for policy 0, policy_version 1806794 (0.0005) [2023-12-26 14:01:24,968][123090] Updated weights for policy 1, policy_version 1795077 (0.0007) [2023-12-26 14:01:25,028][123090] Updated weights for policy 1, policy_version 1795087 (0.0007) [2023-12-26 14:01:25,088][123090] Updated weights for policy 1, policy_version 1795097 (0.0005) [2023-12-26 14:01:25,442][123091] Updated weights for policy 0, policy_version 1806804 (0.0006) [2023-12-26 14:01:25,512][123091] Updated weights for policy 0, policy_version 1806814 (0.0005) [2023-12-26 14:01:25,584][123091] Updated weights for policy 0, policy_version 1806824 (0.0006) [2023-12-26 14:01:25,786][123090] Updated weights for policy 1, policy_version 1795107 (0.0007) [2023-12-26 14:01:25,838][123090] Updated weights for policy 1, policy_version 1795117 (0.0009) [2023-12-26 14:01:25,888][123090] Updated weights for policy 1, policy_version 1795127 (0.0009) [2023-12-26 14:01:26,246][123091] Updated weights for policy 0, policy_version 1806834 (0.0006) [2023-12-26 14:01:26,291][123091] Updated weights for policy 0, policy_version 1806844 (0.0005) [2023-12-26 14:01:26,349][123091] Updated weights for policy 0, policy_version 1806854 (0.0005) [2023-12-26 14:01:26,422][123091] Updated weights for policy 0, policy_version 1806864 (0.0005) [2023-12-26 14:01:26,812][123090] Updated weights for policy 1, policy_version 1795137 (0.0009) [2023-12-26 14:01:26,871][123090] Updated weights for policy 1, policy_version 1795147 (0.0010) [2023-12-26 14:01:26,922][123090] Updated weights for policy 1, policy_version 1795157 (0.0008) [2023-12-26 14:01:26,978][123090] Updated weights for policy 1, policy_version 1795167 (0.0009) [2023-12-26 14:01:26,994][123091] Updated weights for policy 0, policy_version 1806874 (0.0007) [2023-12-26 14:01:27,043][123091] Updated weights for policy 0, policy_version 1806884 (0.0009) [2023-12-26 14:01:27,092][123091] Updated weights for policy 0, policy_version 1806894 (0.0008) [2023-12-26 14:01:27,782][123090] Updated weights for policy 1, policy_version 1795177 (0.0006) [2023-12-26 14:01:27,831][123091] Updated weights for policy 0, policy_version 1806904 (0.0011) [2023-12-26 14:01:27,847][123090] Updated weights for policy 1, policy_version 1795187 (0.0005) [2023-12-26 14:01:27,878][123091] Updated weights for policy 0, policy_version 1806914 (0.0010) [2023-12-26 14:01:27,904][123090] Updated weights for policy 1, policy_version 1795197 (0.0005) [2023-12-26 14:01:27,926][123091] Updated weights for policy 0, policy_version 1806924 (0.0010) [2023-12-26 14:01:28,557][123090] Updated weights for policy 1, policy_version 1795207 (0.0006) [2023-12-26 14:01:28,630][123090] Updated weights for policy 1, policy_version 1795217 (0.0006) [2023-12-26 14:01:28,701][123090] Updated weights for policy 1, policy_version 1795227 (0.0007) [2023-12-26 14:01:28,774][123091] Updated weights for policy 0, policy_version 1806934 (0.0009) [2023-12-26 14:01:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 922157056. Throughput: 0: 8865.3, 1: 8919.0. Samples: 922149308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:28,785][121949] Avg episode reward: [(0, '6317.096'), (1, '5755.509')] [2023-12-26 14:01:28,831][123091] Updated weights for policy 0, policy_version 1806944 (0.0009) [2023-12-26 14:01:28,895][123091] Updated weights for policy 0, policy_version 1806954 (0.0009) [2023-12-26 14:01:29,469][123090] Updated weights for policy 1, policy_version 1795237 (0.0011) [2023-12-26 14:01:29,537][123090] Updated weights for policy 1, policy_version 1795247 (0.0011) [2023-12-26 14:01:29,604][123090] Updated weights for policy 1, policy_version 1795257 (0.0011) [2023-12-26 14:01:29,743][123091] Updated weights for policy 0, policy_version 1806964 (0.0009) [2023-12-26 14:01:29,803][123091] Updated weights for policy 0, policy_version 1806974 (0.0009) [2023-12-26 14:01:29,871][123091] Updated weights for policy 0, policy_version 1806984 (0.0010) [2023-12-26 14:01:30,426][123090] Updated weights for policy 1, policy_version 1795267 (0.0011) [2023-12-26 14:01:30,489][123090] Updated weights for policy 1, policy_version 1795277 (0.0010) [2023-12-26 14:01:30,560][123090] Updated weights for policy 1, policy_version 1795287 (0.0011) [2023-12-26 14:01:30,701][123091] Updated weights for policy 0, policy_version 1806994 (0.0009) [2023-12-26 14:01:30,760][123091] Updated weights for policy 0, policy_version 1807004 (0.0006) [2023-12-26 14:01:30,813][123091] Updated weights for policy 0, policy_version 1807014 (0.0006) [2023-12-26 14:01:30,869][123091] Updated weights for policy 0, policy_version 1807024 (0.0006) [2023-12-26 14:01:31,379][123090] Updated weights for policy 1, policy_version 1795297 (0.0010) [2023-12-26 14:01:31,432][123090] Updated weights for policy 1, policy_version 1795307 (0.0009) [2023-12-26 14:01:31,498][123090] Updated weights for policy 1, policy_version 1795317 (0.0009) [2023-12-26 14:01:31,556][123090] Updated weights for policy 1, policy_version 1795327 (0.0009) [2023-12-26 14:01:31,599][123091] Updated weights for policy 0, policy_version 1807034 (0.0008) [2023-12-26 14:01:31,667][123091] Updated weights for policy 0, policy_version 1807044 (0.0009) [2023-12-26 14:01:31,737][123091] Updated weights for policy 0, policy_version 1807054 (0.0008) [2023-12-26 14:01:32,427][123090] Updated weights for policy 1, policy_version 1795337 (0.0011) [2023-12-26 14:01:32,497][123090] Updated weights for policy 1, policy_version 1795347 (0.0011) [2023-12-26 14:01:32,565][123091] Updated weights for policy 0, policy_version 1807064 (0.0009) [2023-12-26 14:01:32,565][123090] Updated weights for policy 1, policy_version 1795357 (0.0011) [2023-12-26 14:01:32,615][123091] Updated weights for policy 0, policy_version 1807074 (0.0009) [2023-12-26 14:01:32,666][123091] Updated weights for policy 0, policy_version 1807084 (0.0009) [2023-12-26 14:01:33,375][123090] Updated weights for policy 1, policy_version 1795367 (0.0010) [2023-12-26 14:01:33,437][123090] Updated weights for policy 1, policy_version 1795377 (0.0008) [2023-12-26 14:01:33,488][123090] Updated weights for policy 1, policy_version 1795387 (0.0009) [2023-12-26 14:01:33,522][123091] Updated weights for policy 0, policy_version 1807094 (0.0009) [2023-12-26 14:01:33,582][123091] Updated weights for policy 0, policy_version 1807104 (0.0010) [2023-12-26 14:01:33,655][123091] Updated weights for policy 0, policy_version 1807114 (0.0008) [2023-12-26 14:01:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.2, 300 sec: 17828.0). Total num frames: 922247168. Throughput: 0: 8785.7, 1: 8888.8. Samples: 922253312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:33,785][121949] Avg episode reward: [(0, '6313.871'), (1, '5508.252')] [2023-12-26 14:01:34,277][123090] Updated weights for policy 1, policy_version 1795397 (0.0007) [2023-12-26 14:01:34,345][123090] Updated weights for policy 1, policy_version 1795407 (0.0009) [2023-12-26 14:01:34,416][123090] Updated weights for policy 1, policy_version 1795417 (0.0009) [2023-12-26 14:01:34,504][123091] Updated weights for policy 0, policy_version 1807124 (0.0009) [2023-12-26 14:01:34,570][123091] Updated weights for policy 0, policy_version 1807134 (0.0010) [2023-12-26 14:01:34,634][123091] Updated weights for policy 0, policy_version 1807144 (0.0010) [2023-12-26 14:01:35,205][123090] Updated weights for policy 1, policy_version 1795427 (0.0009) [2023-12-26 14:01:35,267][123090] Updated weights for policy 1, policy_version 1795437 (0.0010) [2023-12-26 14:01:35,330][123090] Updated weights for policy 1, policy_version 1795447 (0.0009) [2023-12-26 14:01:35,339][123091] Updated weights for policy 0, policy_version 1807154 (0.0009) [2023-12-26 14:01:35,403][123091] Updated weights for policy 0, policy_version 1807164 (0.0005) [2023-12-26 14:01:35,463][123091] Updated weights for policy 0, policy_version 1807174 (0.0005) [2023-12-26 14:01:35,517][123091] Updated weights for policy 0, policy_version 1807184 (0.0005) [2023-12-26 14:01:36,192][123090] Updated weights for policy 1, policy_version 1795457 (0.0007) [2023-12-26 14:01:36,211][123091] Updated weights for policy 0, policy_version 1807194 (0.0010) [2023-12-26 14:01:36,256][123090] Updated weights for policy 1, policy_version 1795467 (0.0009) [2023-12-26 14:01:36,275][123091] Updated weights for policy 0, policy_version 1807204 (0.0007) [2023-12-26 14:01:36,317][123090] Updated weights for policy 1, policy_version 1795477 (0.0007) [2023-12-26 14:01:36,339][123091] Updated weights for policy 0, policy_version 1807214 (0.0009) [2023-12-26 14:01:36,380][123090] Updated weights for policy 1, policy_version 1795487 (0.0010) [2023-12-26 14:01:37,157][123091] Updated weights for policy 0, policy_version 1807224 (0.0010) [2023-12-26 14:01:37,207][123091] Updated weights for policy 0, policy_version 1807234 (0.0009) [2023-12-26 14:01:37,245][123090] Updated weights for policy 1, policy_version 1795497 (0.0010) [2023-12-26 14:01:37,270][123091] Updated weights for policy 0, policy_version 1807244 (0.0009) [2023-12-26 14:01:37,308][123090] Updated weights for policy 1, policy_version 1795507 (0.0009) [2023-12-26 14:01:37,375][123090] Updated weights for policy 1, policy_version 1795517 (0.0009) [2023-12-26 14:01:38,112][123091] Updated weights for policy 0, policy_version 1807254 (0.0009) [2023-12-26 14:01:38,165][123091] Updated weights for policy 0, policy_version 1807264 (0.0009) [2023-12-26 14:01:38,189][123090] Updated weights for policy 1, policy_version 1795527 (0.0009) [2023-12-26 14:01:38,216][123091] Updated weights for policy 0, policy_version 1807274 (0.0008) [2023-12-26 14:01:38,237][123090] Updated weights for policy 1, policy_version 1795537 (0.0007) [2023-12-26 14:01:38,287][123090] Updated weights for policy 1, policy_version 1795547 (0.0009) [2023-12-26 14:01:38,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 922329088. Throughput: 0: 8793.0, 1: 8851.8. Samples: 922306848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:38,785][121949] Avg episode reward: [(0, '6342.123'), (1, '5399.847')] [2023-12-26 14:01:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001807280_462667776.pth... [2023-12-26 14:01:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001795552_459661312.pth... [2023-12-26 14:01:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001794528_459399168.pth [2023-12-26 14:01:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001806256_462405632.pth [2023-12-26 14:01:39,087][123090] Updated weights for policy 1, policy_version 1795557 (0.0007) [2023-12-26 14:01:39,093][123091] Updated weights for policy 0, policy_version 1807284 (0.0009) [2023-12-26 14:01:39,151][123090] Updated weights for policy 1, policy_version 1795567 (0.0005) [2023-12-26 14:01:39,157][123091] Updated weights for policy 0, policy_version 1807294 (0.0009) [2023-12-26 14:01:39,213][123090] Updated weights for policy 1, policy_version 1795577 (0.0009) [2023-12-26 14:01:39,220][123091] Updated weights for policy 0, policy_version 1807304 (0.0009) [2023-12-26 14:01:40,028][123090] Updated weights for policy 1, policy_version 1795587 (0.0008) [2023-12-26 14:01:40,092][123090] Updated weights for policy 1, policy_version 1795597 (0.0011) [2023-12-26 14:01:40,117][123091] Updated weights for policy 0, policy_version 1807314 (0.0009) [2023-12-26 14:01:40,155][123090] Updated weights for policy 1, policy_version 1795607 (0.0011) [2023-12-26 14:01:40,171][123091] Updated weights for policy 0, policy_version 1807324 (0.0008) [2023-12-26 14:01:40,227][123091] Updated weights for policy 0, policy_version 1807334 (0.0006) [2023-12-26 14:01:40,290][123091] Updated weights for policy 0, policy_version 1807344 (0.0005) [2023-12-26 14:01:40,939][123090] Updated weights for policy 1, policy_version 1795617 (0.0010) [2023-12-26 14:01:41,000][123090] Updated weights for policy 1, policy_version 1795627 (0.0005) [2023-12-26 14:01:41,065][123090] Updated weights for policy 1, policy_version 1795637 (0.0010) [2023-12-26 14:01:41,116][123090] Updated weights for policy 1, policy_version 1795647 (0.0007) [2023-12-26 14:01:41,153][123091] Updated weights for policy 0, policy_version 1807354 (0.0007) [2023-12-26 14:01:41,221][123091] Updated weights for policy 0, policy_version 1807364 (0.0011) [2023-12-26 14:01:41,292][123091] Updated weights for policy 0, policy_version 1807374 (0.0010) [2023-12-26 14:01:41,903][123090] Updated weights for policy 1, policy_version 1795657 (0.0006) [2023-12-26 14:01:41,962][123090] Updated weights for policy 1, policy_version 1795667 (0.0006) [2023-12-26 14:01:42,026][123090] Updated weights for policy 1, policy_version 1795677 (0.0010) [2023-12-26 14:01:42,165][123091] Updated weights for policy 0, policy_version 1807384 (0.0009) [2023-12-26 14:01:42,235][123091] Updated weights for policy 0, policy_version 1807394 (0.0009) [2023-12-26 14:01:42,313][123091] Updated weights for policy 0, policy_version 1807404 (0.0010) [2023-12-26 14:01:42,843][123090] Updated weights for policy 1, policy_version 1795687 (0.0011) [2023-12-26 14:01:42,914][123090] Updated weights for policy 1, policy_version 1795697 (0.0010) [2023-12-26 14:01:42,978][123090] Updated weights for policy 1, policy_version 1795707 (0.0010) [2023-12-26 14:01:43,128][123091] Updated weights for policy 0, policy_version 1807414 (0.0009) [2023-12-26 14:01:43,190][123091] Updated weights for policy 0, policy_version 1807424 (0.0009) [2023-12-26 14:01:43,238][123091] Updated weights for policy 0, policy_version 1807434 (0.0008) [2023-12-26 14:01:43,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 922411008. Throughput: 0: 8672.1, 1: 8851.3. Samples: 922409088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:43,785][121949] Avg episode reward: [(0, '6296.435'), (1, '5408.040')] [2023-12-26 14:01:43,802][123090] Updated weights for policy 1, policy_version 1795717 (0.0011) [2023-12-26 14:01:43,862][123090] Updated weights for policy 1, policy_version 1795727 (0.0006) [2023-12-26 14:01:43,928][123090] Updated weights for policy 1, policy_version 1795737 (0.0010) [2023-12-26 14:01:44,066][123091] Updated weights for policy 0, policy_version 1807444 (0.0009) [2023-12-26 14:01:44,128][123091] Updated weights for policy 0, policy_version 1807454 (0.0011) [2023-12-26 14:01:44,177][123091] Updated weights for policy 0, policy_version 1807464 (0.0011) [2023-12-26 14:01:44,614][123090] Updated weights for policy 1, policy_version 1795747 (0.0009) [2023-12-26 14:01:44,667][123090] Updated weights for policy 1, policy_version 1795757 (0.0005) [2023-12-26 14:01:44,714][123090] Updated weights for policy 1, policy_version 1795767 (0.0005) [2023-12-26 14:01:44,979][123091] Updated weights for policy 0, policy_version 1807474 (0.0010) [2023-12-26 14:01:45,038][123091] Updated weights for policy 0, policy_version 1807484 (0.0010) [2023-12-26 14:01:45,090][123091] Updated weights for policy 0, policy_version 1807494 (0.0010) [2023-12-26 14:01:45,143][123091] Updated weights for policy 0, policy_version 1807504 (0.0009) [2023-12-26 14:01:45,521][123090] Updated weights for policy 1, policy_version 1795777 (0.0006) [2023-12-26 14:01:45,583][123090] Updated weights for policy 1, policy_version 1795787 (0.0009) [2023-12-26 14:01:45,643][123090] Updated weights for policy 1, policy_version 1795797 (0.0010) [2023-12-26 14:01:45,695][123090] Updated weights for policy 1, policy_version 1795807 (0.0009) [2023-12-26 14:01:45,982][123091] Updated weights for policy 0, policy_version 1807514 (0.0005) [2023-12-26 14:01:46,052][123091] Updated weights for policy 0, policy_version 1807524 (0.0006) [2023-12-26 14:01:46,112][123091] Updated weights for policy 0, policy_version 1807534 (0.0007) [2023-12-26 14:01:46,420][123090] Updated weights for policy 1, policy_version 1795817 (0.0009) [2023-12-26 14:01:46,468][123090] Updated weights for policy 1, policy_version 1795827 (0.0009) [2023-12-26 14:01:46,528][123090] Updated weights for policy 1, policy_version 1795837 (0.0008) [2023-12-26 14:01:46,862][123091] Updated weights for policy 0, policy_version 1807544 (0.0010) [2023-12-26 14:01:46,921][123091] Updated weights for policy 0, policy_version 1807554 (0.0011) [2023-12-26 14:01:46,979][123091] Updated weights for policy 0, policy_version 1807565 (0.0010) [2023-12-26 14:01:47,308][123090] Updated weights for policy 1, policy_version 1795847 (0.0009) [2023-12-26 14:01:47,356][123090] Updated weights for policy 1, policy_version 1795857 (0.0009) [2023-12-26 14:01:47,411][123090] Updated weights for policy 1, policy_version 1795867 (0.0008) [2023-12-26 14:01:47,849][123091] Updated weights for policy 0, policy_version 1807576 (0.0011) [2023-12-26 14:01:47,923][123091] Updated weights for policy 0, policy_version 1807586 (0.0011) [2023-12-26 14:01:47,986][123091] Updated weights for policy 0, policy_version 1807596 (0.0008) [2023-12-26 14:01:48,292][123090] Updated weights for policy 1, policy_version 1795877 (0.0009) [2023-12-26 14:01:48,362][123090] Updated weights for policy 1, policy_version 1795887 (0.0009) [2023-12-26 14:01:48,426][123090] Updated weights for policy 1, policy_version 1795897 (0.0009) [2023-12-26 14:01:48,756][123091] Updated weights for policy 0, policy_version 1807606 (0.0010) [2023-12-26 14:01:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 922501120. Throughput: 0: 8662.6, 1: 8873.2. Samples: 922514828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:48,785][121949] Avg episode reward: [(0, '6272.391'), (1, '5544.667')] [2023-12-26 14:01:48,817][123091] Updated weights for policy 0, policy_version 1807616 (0.0009) [2023-12-26 14:01:48,876][123091] Updated weights for policy 0, policy_version 1807626 (0.0009) [2023-12-26 14:01:49,184][123090] Updated weights for policy 1, policy_version 1795907 (0.0008) [2023-12-26 14:01:49,254][123090] Updated weights for policy 1, policy_version 1795917 (0.0008) [2023-12-26 14:01:49,318][123090] Updated weights for policy 1, policy_version 1795927 (0.0010) [2023-12-26 14:01:49,780][123091] Updated weights for policy 0, policy_version 1807636 (0.0010) [2023-12-26 14:01:49,844][123091] Updated weights for policy 0, policy_version 1807646 (0.0009) [2023-12-26 14:01:49,912][123091] Updated weights for policy 0, policy_version 1807656 (0.0009) [2023-12-26 14:01:50,054][123090] Updated weights for policy 1, policy_version 1795937 (0.0009) [2023-12-26 14:01:50,105][123090] Updated weights for policy 1, policy_version 1795947 (0.0005) [2023-12-26 14:01:50,170][123090] Updated weights for policy 1, policy_version 1795957 (0.0009) [2023-12-26 14:01:50,223][123090] Updated weights for policy 1, policy_version 1795967 (0.0009) [2023-12-26 14:01:50,804][123091] Updated weights for policy 0, policy_version 1807666 (0.0010) [2023-12-26 14:01:50,869][123091] Updated weights for policy 0, policy_version 1807676 (0.0009) [2023-12-26 14:01:50,934][123091] Updated weights for policy 0, policy_version 1807686 (0.0009) [2023-12-26 14:01:50,991][123091] Updated weights for policy 0, policy_version 1807696 (0.0009) [2023-12-26 14:01:51,031][123090] Updated weights for policy 1, policy_version 1795977 (0.0010) [2023-12-26 14:01:51,101][123090] Updated weights for policy 1, policy_version 1795987 (0.0010) [2023-12-26 14:01:51,167][123090] Updated weights for policy 1, policy_version 1795997 (0.0009) [2023-12-26 14:01:51,759][123091] Updated weights for policy 0, policy_version 1807706 (0.0010) [2023-12-26 14:01:51,814][123091] Updated weights for policy 0, policy_version 1807716 (0.0009) [2023-12-26 14:01:51,869][123091] Updated weights for policy 0, policy_version 1807726 (0.0010) [2023-12-26 14:01:52,018][123090] Updated weights for policy 1, policy_version 1796007 (0.0009) [2023-12-26 14:01:52,078][123090] Updated weights for policy 1, policy_version 1796017 (0.0009) [2023-12-26 14:01:52,145][123090] Updated weights for policy 1, policy_version 1796027 (0.0010) [2023-12-26 14:01:52,751][123091] Updated weights for policy 0, policy_version 1807736 (0.0009) [2023-12-26 14:01:52,816][123091] Updated weights for policy 0, policy_version 1807746 (0.0009) [2023-12-26 14:01:52,884][123091] Updated weights for policy 0, policy_version 1807756 (0.0009) [2023-12-26 14:01:52,899][123090] Updated weights for policy 1, policy_version 1796037 (0.0010) [2023-12-26 14:01:52,970][123090] Updated weights for policy 1, policy_version 1796047 (0.0011) [2023-12-26 14:01:53,034][123090] Updated weights for policy 1, policy_version 1796057 (0.0010) [2023-12-26 14:01:53,665][123091] Updated weights for policy 0, policy_version 1807766 (0.0007) [2023-12-26 14:01:53,733][123091] Updated weights for policy 0, policy_version 1807776 (0.0007) [2023-12-26 14:01:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17744.8). Total num frames: 922583040. Throughput: 0: 8608.9, 1: 8889.2. Samples: 922566068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:53,785][121949] Avg episode reward: [(0, '6321.454'), (1, '5677.697')] [2023-12-26 14:01:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001796064_459792384.pth... [2023-12-26 14:01:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001795040_459530240.pth [2023-12-26 14:01:53,795][123091] Updated weights for policy 0, policy_version 1807786 (0.0010) [2023-12-26 14:01:53,824][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001807792_462798848.pth... [2023-12-26 14:01:53,829][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001806768_462536704.pth [2023-12-26 14:01:53,856][123090] Updated weights for policy 1, policy_version 1796067 (0.0010) [2023-12-26 14:01:53,915][123090] Updated weights for policy 1, policy_version 1796077 (0.0010) [2023-12-26 14:01:53,977][123090] Updated weights for policy 1, policy_version 1796087 (0.0006) [2023-12-26 14:01:54,583][123091] Updated weights for policy 0, policy_version 1807796 (0.0010) [2023-12-26 14:01:54,640][123091] Updated weights for policy 0, policy_version 1807806 (0.0011) [2023-12-26 14:01:54,697][123091] Updated weights for policy 0, policy_version 1807816 (0.0010) [2023-12-26 14:01:54,778][123090] Updated weights for policy 1, policy_version 1796097 (0.0006) [2023-12-26 14:01:54,827][123090] Updated weights for policy 1, policy_version 1796107 (0.0009) [2023-12-26 14:01:54,895][123090] Updated weights for policy 1, policy_version 1796117 (0.0009) [2023-12-26 14:01:54,963][123090] Updated weights for policy 1, policy_version 1796127 (0.0009) [2023-12-26 14:01:55,507][123091] Updated weights for policy 0, policy_version 1807826 (0.0009) [2023-12-26 14:01:55,564][123091] Updated weights for policy 0, policy_version 1807836 (0.0008) [2023-12-26 14:01:55,621][123091] Updated weights for policy 0, policy_version 1807846 (0.0009) [2023-12-26 14:01:55,676][123091] Updated weights for policy 0, policy_version 1807856 (0.0008) [2023-12-26 14:01:55,815][123090] Updated weights for policy 1, policy_version 1796137 (0.0007) [2023-12-26 14:01:55,866][123090] Updated weights for policy 1, policy_version 1796147 (0.0009) [2023-12-26 14:01:55,913][123090] Updated weights for policy 1, policy_version 1796157 (0.0008) [2023-12-26 14:01:56,457][123091] Updated weights for policy 0, policy_version 1807866 (0.0005) [2023-12-26 14:01:56,506][123091] Updated weights for policy 0, policy_version 1807876 (0.0005) [2023-12-26 14:01:56,562][123091] Updated weights for policy 0, policy_version 1807886 (0.0005) [2023-12-26 14:01:56,667][123090] Updated weights for policy 1, policy_version 1796167 (0.0008) [2023-12-26 14:01:56,719][123090] Updated weights for policy 1, policy_version 1796177 (0.0006) [2023-12-26 14:01:56,786][123090] Updated weights for policy 1, policy_version 1796187 (0.0009) [2023-12-26 14:01:57,263][123091] Updated weights for policy 0, policy_version 1807896 (0.0009) [2023-12-26 14:01:57,321][123091] Updated weights for policy 0, policy_version 1807906 (0.0008) [2023-12-26 14:01:57,391][123091] Updated weights for policy 0, policy_version 1807916 (0.0007) [2023-12-26 14:01:57,470][123090] Updated weights for policy 1, policy_version 1796197 (0.0007) [2023-12-26 14:01:57,539][123090] Updated weights for policy 1, policy_version 1796207 (0.0005) [2023-12-26 14:01:57,612][123090] Updated weights for policy 1, policy_version 1796217 (0.0005) [2023-12-26 14:01:58,047][123091] Updated weights for policy 0, policy_version 1807926 (0.0008) [2023-12-26 14:01:58,111][123091] Updated weights for policy 0, policy_version 1807936 (0.0010) [2023-12-26 14:01:58,170][123091] Updated weights for policy 0, policy_version 1807946 (0.0010) [2023-12-26 14:01:58,311][123090] Updated weights for policy 1, policy_version 1796227 (0.0007) [2023-12-26 14:01:58,388][123090] Updated weights for policy 1, policy_version 1796237 (0.0010) [2023-12-26 14:01:58,448][123090] Updated weights for policy 1, policy_version 1796247 (0.0011) [2023-12-26 14:01:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 922681344. Throughput: 0: 8656.3, 1: 8876.6. Samples: 922673792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:01:58,785][121949] Avg episode reward: [(0, '6275.607'), (1, '5313.314')] [2023-12-26 14:01:59,082][123091] Updated weights for policy 0, policy_version 1807956 (0.0009) [2023-12-26 14:01:59,150][123091] Updated weights for policy 0, policy_version 1807966 (0.0007) [2023-12-26 14:01:59,211][123091] Updated weights for policy 0, policy_version 1807976 (0.0008) [2023-12-26 14:01:59,316][123090] Updated weights for policy 1, policy_version 1796257 (0.0010) [2023-12-26 14:01:59,391][123090] Updated weights for policy 1, policy_version 1796267 (0.0009) [2023-12-26 14:01:59,449][123090] Updated weights for policy 1, policy_version 1796277 (0.0009) [2023-12-26 14:01:59,512][123090] Updated weights for policy 1, policy_version 1796287 (0.0010) [2023-12-26 14:01:59,989][123091] Updated weights for policy 0, policy_version 1807986 (0.0007) [2023-12-26 14:02:00,054][123091] Updated weights for policy 0, policy_version 1807996 (0.0010) [2023-12-26 14:02:00,112][123091] Updated weights for policy 0, policy_version 1808006 (0.0010) [2023-12-26 14:02:00,162][123091] Updated weights for policy 0, policy_version 1808016 (0.0010) [2023-12-26 14:02:00,419][123090] Updated weights for policy 1, policy_version 1796297 (0.0009) [2023-12-26 14:02:00,477][123090] Updated weights for policy 1, policy_version 1796308 (0.0010) [2023-12-26 14:02:00,535][123090] Updated weights for policy 1, policy_version 1796318 (0.0009) [2023-12-26 14:02:00,845][123091] Updated weights for policy 0, policy_version 1808026 (0.0008) [2023-12-26 14:02:00,907][123091] Updated weights for policy 0, policy_version 1808036 (0.0009) [2023-12-26 14:02:00,976][123091] Updated weights for policy 0, policy_version 1808046 (0.0010) [2023-12-26 14:02:01,463][123090] Updated weights for policy 1, policy_version 1796328 (0.0009) [2023-12-26 14:02:01,524][123090] Updated weights for policy 1, policy_version 1796338 (0.0009) [2023-12-26 14:02:01,580][123090] Updated weights for policy 1, policy_version 1796348 (0.0009) [2023-12-26 14:02:01,777][123091] Updated weights for policy 0, policy_version 1808056 (0.0010) [2023-12-26 14:02:01,840][123091] Updated weights for policy 0, policy_version 1808066 (0.0009) [2023-12-26 14:02:01,901][123091] Updated weights for policy 0, policy_version 1808076 (0.0009) [2023-12-26 14:02:02,358][123090] Updated weights for policy 1, policy_version 1796358 (0.0010) [2023-12-26 14:02:02,426][123090] Updated weights for policy 1, policy_version 1796368 (0.0007) [2023-12-26 14:02:02,484][123090] Updated weights for policy 1, policy_version 1796378 (0.0006) [2023-12-26 14:02:02,748][123091] Updated weights for policy 0, policy_version 1808086 (0.0007) [2023-12-26 14:02:02,804][123091] Updated weights for policy 0, policy_version 1808096 (0.0006) [2023-12-26 14:02:02,857][123091] Updated weights for policy 0, policy_version 1808107 (0.0008) [2023-12-26 14:02:03,349][123090] Updated weights for policy 1, policy_version 1796388 (0.0008) [2023-12-26 14:02:03,401][123090] Updated weights for policy 1, policy_version 1796398 (0.0009) [2023-12-26 14:02:03,446][123091] Updated weights for policy 0, policy_version 1808117 (0.0007) [2023-12-26 14:02:03,450][123090] Updated weights for policy 1, policy_version 1796408 (0.0009) [2023-12-26 14:02:03,496][123091] Updated weights for policy 0, policy_version 1808127 (0.0007) [2023-12-26 14:02:03,557][123091] Updated weights for policy 0, policy_version 1808137 (0.0009) [2023-12-26 14:02:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 922771456. Throughput: 0: 8740.1, 1: 8766.6. Samples: 922778760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:03,785][121949] Avg episode reward: [(0, '6188.041'), (1, '5216.988')] [2023-12-26 14:02:04,302][123090] Updated weights for policy 1, policy_version 1796418 (0.0008) [2023-12-26 14:02:04,341][123091] Updated weights for policy 0, policy_version 1808147 (0.0009) [2023-12-26 14:02:04,370][123090] Updated weights for policy 1, policy_version 1796428 (0.0010) [2023-12-26 14:02:04,407][123091] Updated weights for policy 0, policy_version 1808157 (0.0008) [2023-12-26 14:02:04,435][123090] Updated weights for policy 1, policy_version 1796438 (0.0009) [2023-12-26 14:02:04,465][123091] Updated weights for policy 0, policy_version 1808167 (0.0007) [2023-12-26 14:02:04,494][123090] Updated weights for policy 1, policy_version 1796448 (0.0009) [2023-12-26 14:02:05,279][123091] Updated weights for policy 0, policy_version 1808177 (0.0007) [2023-12-26 14:02:05,307][123090] Updated weights for policy 1, policy_version 1796458 (0.0009) [2023-12-26 14:02:05,332][123091] Updated weights for policy 0, policy_version 1808187 (0.0007) [2023-12-26 14:02:05,369][123090] Updated weights for policy 1, policy_version 1796468 (0.0009) [2023-12-26 14:02:05,385][123091] Updated weights for policy 0, policy_version 1808197 (0.0009) [2023-12-26 14:02:05,433][123091] Updated weights for policy 0, policy_version 1808207 (0.0009) [2023-12-26 14:02:05,437][123090] Updated weights for policy 1, policy_version 1796478 (0.0007) [2023-12-26 14:02:06,190][123090] Updated weights for policy 1, policy_version 1796488 (0.0009) [2023-12-26 14:02:06,245][123090] Updated weights for policy 1, policy_version 1796498 (0.0009) [2023-12-26 14:02:06,293][123091] Updated weights for policy 0, policy_version 1808217 (0.0009) [2023-12-26 14:02:06,303][123090] Updated weights for policy 1, policy_version 1796508 (0.0008) [2023-12-26 14:02:06,348][123091] Updated weights for policy 0, policy_version 1808227 (0.0009) [2023-12-26 14:02:06,406][123091] Updated weights for policy 0, policy_version 1808237 (0.0009) [2023-12-26 14:02:07,162][123090] Updated weights for policy 1, policy_version 1796518 (0.0009) [2023-12-26 14:02:07,217][123090] Updated weights for policy 1, policy_version 1796528 (0.0009) [2023-12-26 14:02:07,232][123091] Updated weights for policy 0, policy_version 1808247 (0.0009) [2023-12-26 14:02:07,278][123090] Updated weights for policy 1, policy_version 1796538 (0.0006) [2023-12-26 14:02:07,280][123091] Updated weights for policy 0, policy_version 1808257 (0.0010) [2023-12-26 14:02:07,328][123091] Updated weights for policy 0, policy_version 1808267 (0.0010) [2023-12-26 14:02:08,065][123091] Updated weights for policy 0, policy_version 1808277 (0.0008) [2023-12-26 14:02:08,134][123091] Updated weights for policy 0, policy_version 1808287 (0.0007) [2023-12-26 14:02:08,190][123090] Updated weights for policy 1, policy_version 1796548 (0.0006) [2023-12-26 14:02:08,196][123091] Updated weights for policy 0, policy_version 1808297 (0.0011) [2023-12-26 14:02:08,249][123090] Updated weights for policy 1, policy_version 1796558 (0.0008) [2023-12-26 14:02:08,303][123090] Updated weights for policy 1, policy_version 1796568 (0.0010) [2023-12-26 14:02:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 922853376. Throughput: 0: 8774.0, 1: 8784.4. Samples: 922830716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:08,785][121949] Avg episode reward: [(0, '6195.550'), (1, '5501.303')] [2023-12-26 14:02:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001808304_462929920.pth... [2023-12-26 14:02:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001796576_459923456.pth... [2023-12-26 14:02:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001795552_459661312.pth [2023-12-26 14:02:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001807280_462667776.pth [2023-12-26 14:02:08,921][123091] Updated weights for policy 0, policy_version 1808307 (0.0007) [2023-12-26 14:02:08,977][123091] Updated weights for policy 0, policy_version 1808317 (0.0006) [2023-12-26 14:02:09,040][123091] Updated weights for policy 0, policy_version 1808327 (0.0005) [2023-12-26 14:02:09,232][123090] Updated weights for policy 1, policy_version 1796578 (0.0009) [2023-12-26 14:02:09,299][123090] Updated weights for policy 1, policy_version 1796588 (0.0009) [2023-12-26 14:02:09,366][123090] Updated weights for policy 1, policy_version 1796598 (0.0009) [2023-12-26 14:02:09,433][123090] Updated weights for policy 1, policy_version 1796608 (0.0010) [2023-12-26 14:02:09,753][123091] Updated weights for policy 0, policy_version 1808337 (0.0006) [2023-12-26 14:02:09,811][123091] Updated weights for policy 0, policy_version 1808347 (0.0010) [2023-12-26 14:02:09,888][123091] Updated weights for policy 0, policy_version 1808357 (0.0009) [2023-12-26 14:02:09,957][123091] Updated weights for policy 0, policy_version 1808367 (0.0008) [2023-12-26 14:02:10,322][123090] Updated weights for policy 1, policy_version 1796618 (0.0010) [2023-12-26 14:02:10,390][123090] Updated weights for policy 1, policy_version 1796628 (0.0007) [2023-12-26 14:02:10,456][123090] Updated weights for policy 1, policy_version 1796638 (0.0006) [2023-12-26 14:02:10,750][123091] Updated weights for policy 0, policy_version 1808377 (0.0009) [2023-12-26 14:02:10,807][123091] Updated weights for policy 0, policy_version 1808387 (0.0010) [2023-12-26 14:02:10,867][123091] Updated weights for policy 0, policy_version 1808397 (0.0010) [2023-12-26 14:02:11,040][123090] Updated weights for policy 1, policy_version 1796648 (0.0008) [2023-12-26 14:02:11,111][123090] Updated weights for policy 1, policy_version 1796658 (0.0010) [2023-12-26 14:02:11,180][123090] Updated weights for policy 1, policy_version 1796668 (0.0011) [2023-12-26 14:02:11,755][123091] Updated weights for policy 0, policy_version 1808407 (0.0010) [2023-12-26 14:02:11,826][123091] Updated weights for policy 0, policy_version 1808417 (0.0007) [2023-12-26 14:02:11,889][123091] Updated weights for policy 0, policy_version 1808427 (0.0008) [2023-12-26 14:02:11,947][123090] Updated weights for policy 1, policy_version 1796678 (0.0011) [2023-12-26 14:02:12,015][123090] Updated weights for policy 1, policy_version 1796688 (0.0011) [2023-12-26 14:02:12,083][123090] Updated weights for policy 1, policy_version 1796698 (0.0010) [2023-12-26 14:02:12,632][123091] Updated weights for policy 0, policy_version 1808437 (0.0006) [2023-12-26 14:02:12,703][123091] Updated weights for policy 0, policy_version 1808447 (0.0005) [2023-12-26 14:02:12,764][123091] Updated weights for policy 0, policy_version 1808457 (0.0005) [2023-12-26 14:02:12,880][123090] Updated weights for policy 1, policy_version 1796708 (0.0008) [2023-12-26 14:02:12,929][123090] Updated weights for policy 1, policy_version 1796718 (0.0008) [2023-12-26 14:02:12,979][123090] Updated weights for policy 1, policy_version 1796728 (0.0009) [2023-12-26 14:02:13,410][123091] Updated weights for policy 0, policy_version 1808467 (0.0007) [2023-12-26 14:02:13,461][123091] Updated weights for policy 0, policy_version 1808477 (0.0010) [2023-12-26 14:02:13,507][123091] Updated weights for policy 0, policy_version 1808487 (0.0010) [2023-12-26 14:02:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 922943488. Throughput: 0: 8786.5, 1: 8708.2. Samples: 922936568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:13,784][121949] Avg episode reward: [(0, '6299.658'), (1, '5568.173')] [2023-12-26 14:02:13,806][123090] Updated weights for policy 1, policy_version 1796738 (0.0010) [2023-12-26 14:02:13,873][123090] Updated weights for policy 1, policy_version 1796748 (0.0010) [2023-12-26 14:02:13,940][123090] Updated weights for policy 1, policy_version 1796758 (0.0011) [2023-12-26 14:02:14,012][123090] Updated weights for policy 1, policy_version 1796768 (0.0011) [2023-12-26 14:02:14,248][123091] Updated weights for policy 0, policy_version 1808497 (0.0005) [2023-12-26 14:02:14,311][123091] Updated weights for policy 0, policy_version 1808507 (0.0006) [2023-12-26 14:02:14,364][123091] Updated weights for policy 0, policy_version 1808517 (0.0005) [2023-12-26 14:02:14,432][123091] Updated weights for policy 0, policy_version 1808527 (0.0008) [2023-12-26 14:02:14,823][123090] Updated weights for policy 1, policy_version 1796778 (0.0011) [2023-12-26 14:02:14,883][123090] Updated weights for policy 1, policy_version 1796788 (0.0010) [2023-12-26 14:02:14,946][123090] Updated weights for policy 1, policy_version 1796798 (0.0010) [2023-12-26 14:02:15,235][123091] Updated weights for policy 0, policy_version 1808537 (0.0011) [2023-12-26 14:02:15,303][123091] Updated weights for policy 0, policy_version 1808547 (0.0011) [2023-12-26 14:02:15,368][123091] Updated weights for policy 0, policy_version 1808557 (0.0011) [2023-12-26 14:02:15,800][123090] Updated weights for policy 1, policy_version 1796808 (0.0010) [2023-12-26 14:02:15,856][123090] Updated weights for policy 1, policy_version 1796818 (0.0010) [2023-12-26 14:02:15,924][123090] Updated weights for policy 1, policy_version 1796828 (0.0011) [2023-12-26 14:02:16,173][123091] Updated weights for policy 0, policy_version 1808567 (0.0011) [2023-12-26 14:02:16,217][123091] Updated weights for policy 0, policy_version 1808577 (0.0010) [2023-12-26 14:02:16,261][123091] Updated weights for policy 0, policy_version 1808587 (0.0010) [2023-12-26 14:02:16,741][123090] Updated weights for policy 1, policy_version 1796838 (0.0010) [2023-12-26 14:02:16,807][123090] Updated weights for policy 1, policy_version 1796848 (0.0010) [2023-12-26 14:02:16,858][123090] Updated weights for policy 1, policy_version 1796858 (0.0010) [2023-12-26 14:02:16,995][123091] Updated weights for policy 0, policy_version 1808597 (0.0008) [2023-12-26 14:02:17,062][123091] Updated weights for policy 0, policy_version 1808607 (0.0006) [2023-12-26 14:02:17,123][123091] Updated weights for policy 0, policy_version 1808617 (0.0005) [2023-12-26 14:02:17,670][123090] Updated weights for policy 1, policy_version 1796868 (0.0010) [2023-12-26 14:02:17,726][123090] Updated weights for policy 1, policy_version 1796878 (0.0010) [2023-12-26 14:02:17,747][123091] Updated weights for policy 0, policy_version 1808627 (0.0005) [2023-12-26 14:02:17,792][123090] Updated weights for policy 1, policy_version 1796888 (0.0010) [2023-12-26 14:02:17,803][123091] Updated weights for policy 0, policy_version 1808637 (0.0005) [2023-12-26 14:02:17,866][123091] Updated weights for policy 0, policy_version 1808647 (0.0005) [2023-12-26 14:02:18,559][123091] Updated weights for policy 0, policy_version 1808657 (0.0005) [2023-12-26 14:02:18,618][123090] Updated weights for policy 1, policy_version 1796898 (0.0010) [2023-12-26 14:02:18,619][123091] Updated weights for policy 0, policy_version 1808667 (0.0006) [2023-12-26 14:02:18,675][123091] Updated weights for policy 0, policy_version 1808677 (0.0005) [2023-12-26 14:02:18,677][123090] Updated weights for policy 1, policy_version 1796908 (0.0008) [2023-12-26 14:02:18,734][123091] Updated weights for policy 0, policy_version 1808687 (0.0007) [2023-12-26 14:02:18,744][123090] Updated weights for policy 1, policy_version 1796918 (0.0011) [2023-12-26 14:02:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 923033600. Throughput: 0: 8923.5, 1: 8678.8. Samples: 923045412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:18,784][121949] Avg episode reward: [(0, '6193.470'), (1, '5741.462')] [2023-12-26 14:02:18,796][123090] Updated weights for policy 1, policy_version 1796928 (0.0010) [2023-12-26 14:02:19,531][123091] Updated weights for policy 0, policy_version 1808697 (0.0010) [2023-12-26 14:02:19,595][123091] Updated weights for policy 0, policy_version 1808707 (0.0007) [2023-12-26 14:02:19,625][123090] Updated weights for policy 1, policy_version 1796938 (0.0009) [2023-12-26 14:02:19,651][123091] Updated weights for policy 0, policy_version 1808717 (0.0006) [2023-12-26 14:02:19,694][123090] Updated weights for policy 1, policy_version 1796948 (0.0009) [2023-12-26 14:02:19,757][123090] Updated weights for policy 1, policy_version 1796958 (0.0009) [2023-12-26 14:02:20,451][123091] Updated weights for policy 0, policy_version 1808727 (0.0009) [2023-12-26 14:02:20,531][123091] Updated weights for policy 0, policy_version 1808737 (0.0011) [2023-12-26 14:02:20,568][123090] Updated weights for policy 1, policy_version 1796968 (0.0009) [2023-12-26 14:02:20,602][123091] Updated weights for policy 0, policy_version 1808747 (0.0011) [2023-12-26 14:02:20,637][123090] Updated weights for policy 1, policy_version 1796978 (0.0007) [2023-12-26 14:02:20,707][123090] Updated weights for policy 1, policy_version 1796988 (0.0007) [2023-12-26 14:02:21,433][123091] Updated weights for policy 0, policy_version 1808757 (0.0011) [2023-12-26 14:02:21,508][123091] Updated weights for policy 0, policy_version 1808767 (0.0011) [2023-12-26 14:02:21,554][123090] Updated weights for policy 1, policy_version 1796998 (0.0008) [2023-12-26 14:02:21,575][123091] Updated weights for policy 0, policy_version 1808777 (0.0011) [2023-12-26 14:02:21,625][123090] Updated weights for policy 1, policy_version 1797008 (0.0008) [2023-12-26 14:02:21,691][123090] Updated weights for policy 1, policy_version 1797018 (0.0011) [2023-12-26 14:02:22,434][123091] Updated weights for policy 0, policy_version 1808787 (0.0011) [2023-12-26 14:02:22,493][123091] Updated weights for policy 0, policy_version 1808797 (0.0010) [2023-12-26 14:02:22,508][123090] Updated weights for policy 1, policy_version 1797028 (0.0008) [2023-12-26 14:02:22,549][123091] Updated weights for policy 0, policy_version 1808807 (0.0010) [2023-12-26 14:02:22,570][123090] Updated weights for policy 1, policy_version 1797038 (0.0006) [2023-12-26 14:02:22,632][123090] Updated weights for policy 1, policy_version 1797048 (0.0009) [2023-12-26 14:02:23,330][123091] Updated weights for policy 0, policy_version 1808817 (0.0011) [2023-12-26 14:02:23,382][123091] Updated weights for policy 0, policy_version 1808827 (0.0009) [2023-12-26 14:02:23,384][123090] Updated weights for policy 1, policy_version 1797058 (0.0009) [2023-12-26 14:02:23,444][123091] Updated weights for policy 0, policy_version 1808837 (0.0005) [2023-12-26 14:02:23,448][123090] Updated weights for policy 1, policy_version 1797068 (0.0008) [2023-12-26 14:02:23,498][123091] Updated weights for policy 0, policy_version 1808847 (0.0005) [2023-12-26 14:02:23,510][123090] Updated weights for policy 1, policy_version 1797078 (0.0010) [2023-12-26 14:02:23,582][123090] Updated weights for policy 1, policy_version 1797088 (0.0010) [2023-12-26 14:02:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 923123712. Throughput: 0: 8873.8, 1: 8677.2. Samples: 923096644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:23,785][121949] Avg episode reward: [(0, '6282.699'), (1, '5284.639')] [2023-12-26 14:02:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001808848_463069184.pth... [2023-12-26 14:02:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001797088_460054528.pth... [2023-12-26 14:02:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001807792_462798848.pth [2023-12-26 14:02:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001796064_459792384.pth [2023-12-26 14:02:24,157][123091] Updated weights for policy 0, policy_version 1808857 (0.0006) [2023-12-26 14:02:24,211][123091] Updated weights for policy 0, policy_version 1808867 (0.0005) [2023-12-26 14:02:24,265][123091] Updated weights for policy 0, policy_version 1808877 (0.0005) [2023-12-26 14:02:24,510][123090] Updated weights for policy 1, policy_version 1797098 (0.0009) [2023-12-26 14:02:24,577][123090] Updated weights for policy 1, policy_version 1797108 (0.0009) [2023-12-26 14:02:24,634][123090] Updated weights for policy 1, policy_version 1797118 (0.0009) [2023-12-26 14:02:24,979][123091] Updated weights for policy 0, policy_version 1808887 (0.0006) [2023-12-26 14:02:25,033][123091] Updated weights for policy 0, policy_version 1808897 (0.0005) [2023-12-26 14:02:25,079][123091] Updated weights for policy 0, policy_version 1808907 (0.0005) [2023-12-26 14:02:25,534][123090] Updated weights for policy 1, policy_version 1797128 (0.0009) [2023-12-26 14:02:25,595][123090] Updated weights for policy 1, policy_version 1797138 (0.0009) [2023-12-26 14:02:25,660][123090] Updated weights for policy 1, policy_version 1797148 (0.0010) [2023-12-26 14:02:25,833][123091] Updated weights for policy 0, policy_version 1808917 (0.0008) [2023-12-26 14:02:25,888][123091] Updated weights for policy 0, policy_version 1808927 (0.0009) [2023-12-26 14:02:25,939][123091] Updated weights for policy 0, policy_version 1808937 (0.0010) [2023-12-26 14:02:26,494][123090] Updated weights for policy 1, policy_version 1797158 (0.0007) [2023-12-26 14:02:26,547][123090] Updated weights for policy 1, policy_version 1797168 (0.0005) [2023-12-26 14:02:26,599][123090] Updated weights for policy 1, policy_version 1797178 (0.0005) [2023-12-26 14:02:26,803][123091] Updated weights for policy 0, policy_version 1808947 (0.0009) [2023-12-26 14:02:26,884][123091] Updated weights for policy 0, policy_version 1808957 (0.0006) [2023-12-26 14:02:26,952][123091] Updated weights for policy 0, policy_version 1808967 (0.0006) [2023-12-26 14:02:27,308][123090] Updated weights for policy 1, policy_version 1797188 (0.0007) [2023-12-26 14:02:27,367][123090] Updated weights for policy 1, policy_version 1797198 (0.0005) [2023-12-26 14:02:27,452][123090] Updated weights for policy 1, policy_version 1797208 (0.0005) [2023-12-26 14:02:27,587][123091] Updated weights for policy 0, policy_version 1808977 (0.0005) [2023-12-26 14:02:27,641][123091] Updated weights for policy 0, policy_version 1808987 (0.0005) [2023-12-26 14:02:27,700][123091] Updated weights for policy 0, policy_version 1808997 (0.0005) [2023-12-26 14:02:27,778][123091] Updated weights for policy 0, policy_version 1809007 (0.0005) [2023-12-26 14:02:28,026][123090] Updated weights for policy 1, policy_version 1797218 (0.0005) [2023-12-26 14:02:28,082][123090] Updated weights for policy 1, policy_version 1797228 (0.0005) [2023-12-26 14:02:28,138][123090] Updated weights for policy 1, policy_version 1797238 (0.0005) [2023-12-26 14:02:28,193][123090] Updated weights for policy 1, policy_version 1797248 (0.0005) [2023-12-26 14:02:28,480][123091] Updated weights for policy 0, policy_version 1809017 (0.0010) [2023-12-26 14:02:28,535][123091] Updated weights for policy 0, policy_version 1809027 (0.0010) [2023-12-26 14:02:28,589][123091] Updated weights for policy 0, policy_version 1809037 (0.0010) [2023-12-26 14:02:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 923213824. Throughput: 0: 9029.4, 1: 8678.8. Samples: 923205952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-12-26 14:02:28,784][121949] Avg episode reward: [(0, '6351.854'), (1, '5382.987')] [2023-12-26 14:02:28,930][123090] Updated weights for policy 1, policy_version 1797258 (0.0009) [2023-12-26 14:02:28,983][123090] Updated weights for policy 1, policy_version 1797268 (0.0009) [2023-12-26 14:02:29,032][123090] Updated weights for policy 1, policy_version 1797278 (0.0009) [2023-12-26 14:02:29,416][123091] Updated weights for policy 0, policy_version 1809047 (0.0009) [2023-12-26 14:02:29,465][123091] Updated weights for policy 0, policy_version 1809057 (0.0009) [2023-12-26 14:02:29,512][123091] Updated weights for policy 0, policy_version 1809067 (0.0006) [2023-12-26 14:02:29,910][123090] Updated weights for policy 1, policy_version 1797288 (0.0010) [2023-12-26 14:02:29,975][123090] Updated weights for policy 1, policy_version 1797298 (0.0010) [2023-12-26 14:02:30,030][123090] Updated weights for policy 1, policy_version 1797308 (0.0010) [2023-12-26 14:02:30,324][123091] Updated weights for policy 0, policy_version 1809077 (0.0007) [2023-12-26 14:02:30,378][123091] Updated weights for policy 0, policy_version 1809087 (0.0010) [2023-12-26 14:02:30,436][123091] Updated weights for policy 0, policy_version 1809097 (0.0010) [2023-12-26 14:02:30,713][123090] Updated weights for policy 1, policy_version 1797318 (0.0007) [2023-12-26 14:02:30,762][123090] Updated weights for policy 1, policy_version 1797328 (0.0005) [2023-12-26 14:02:30,839][123090] Updated weights for policy 1, policy_version 1797338 (0.0005) [2023-12-26 14:02:31,154][123091] Updated weights for policy 0, policy_version 1809107 (0.0010) [2023-12-26 14:02:31,226][123091] Updated weights for policy 0, policy_version 1809117 (0.0011) [2023-12-26 14:02:31,292][123091] Updated weights for policy 0, policy_version 1809127 (0.0010) [2023-12-26 14:02:31,530][123090] Updated weights for policy 1, policy_version 1797348 (0.0007) [2023-12-26 14:02:31,598][123090] Updated weights for policy 1, policy_version 1797358 (0.0008) [2023-12-26 14:02:31,674][123090] Updated weights for policy 1, policy_version 1797368 (0.0008) [2023-12-26 14:02:32,120][123091] Updated weights for policy 0, policy_version 1809137 (0.0010) [2023-12-26 14:02:32,171][123091] Updated weights for policy 0, policy_version 1809147 (0.0009) [2023-12-26 14:02:32,223][123091] Updated weights for policy 0, policy_version 1809157 (0.0006) [2023-12-26 14:02:32,272][123091] Updated weights for policy 0, policy_version 1809167 (0.0009) [2023-12-26 14:02:32,485][123090] Updated weights for policy 1, policy_version 1797378 (0.0009) [2023-12-26 14:02:32,544][123090] Updated weights for policy 1, policy_version 1797388 (0.0005) [2023-12-26 14:02:32,612][123090] Updated weights for policy 1, policy_version 1797398 (0.0006) [2023-12-26 14:02:32,676][123090] Updated weights for policy 1, policy_version 1797408 (0.0008) [2023-12-26 14:02:33,185][123091] Updated weights for policy 0, policy_version 1809177 (0.0009) [2023-12-26 14:02:33,244][123091] Updated weights for policy 0, policy_version 1809187 (0.0010) [2023-12-26 14:02:33,281][123090] Updated weights for policy 1, policy_version 1797418 (0.0006) [2023-12-26 14:02:33,304][123091] Updated weights for policy 0, policy_version 1809197 (0.0009) [2023-12-26 14:02:33,329][123090] Updated weights for policy 1, policy_version 1797428 (0.0005) [2023-12-26 14:02:33,378][123090] Updated weights for policy 1, policy_version 1797438 (0.0005) [2023-12-26 14:02:33,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 923303936. Throughput: 0: 9031.6, 1: 8771.6. Samples: 923315968. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:33,784][121949] Avg episode reward: [(0, '6294.790'), (1, '5596.632')] [2023-12-26 14:02:34,039][123090] Updated weights for policy 1, policy_version 1797448 (0.0005) [2023-12-26 14:02:34,082][123090] Updated weights for policy 1, policy_version 1797458 (0.0005) [2023-12-26 14:02:34,134][123090] Updated weights for policy 1, policy_version 1797468 (0.0008) [2023-12-26 14:02:34,215][123091] Updated weights for policy 0, policy_version 1809207 (0.0007) [2023-12-26 14:02:34,279][123091] Updated weights for policy 0, policy_version 1809217 (0.0006) [2023-12-26 14:02:34,338][123091] Updated weights for policy 0, policy_version 1809227 (0.0008) [2023-12-26 14:02:34,875][123090] Updated weights for policy 1, policy_version 1797478 (0.0006) [2023-12-26 14:02:34,935][123090] Updated weights for policy 1, policy_version 1797488 (0.0005) [2023-12-26 14:02:35,007][123090] Updated weights for policy 1, policy_version 1797498 (0.0008) [2023-12-26 14:02:35,197][123091] Updated weights for policy 0, policy_version 1809237 (0.0008) [2023-12-26 14:02:35,245][123091] Updated weights for policy 0, policy_version 1809247 (0.0008) [2023-12-26 14:02:35,302][123091] Updated weights for policy 0, policy_version 1809257 (0.0009) [2023-12-26 14:02:35,677][123090] Updated weights for policy 1, policy_version 1797508 (0.0007) [2023-12-26 14:02:35,740][123090] Updated weights for policy 1, policy_version 1797518 (0.0010) [2023-12-26 14:02:35,783][123090] Updated weights for policy 1, policy_version 1797528 (0.0010) [2023-12-26 14:02:36,172][123091] Updated weights for policy 0, policy_version 1809267 (0.0009) [2023-12-26 14:02:36,239][123091] Updated weights for policy 0, policy_version 1809277 (0.0008) [2023-12-26 14:02:36,303][123091] Updated weights for policy 0, policy_version 1809287 (0.0009) [2023-12-26 14:02:36,516][123090] Updated weights for policy 1, policy_version 1797538 (0.0010) [2023-12-26 14:02:36,585][123090] Updated weights for policy 1, policy_version 1797548 (0.0011) [2023-12-26 14:02:36,658][123090] Updated weights for policy 1, policy_version 1797558 (0.0011) [2023-12-26 14:02:36,727][123090] Updated weights for policy 1, policy_version 1797568 (0.0011) [2023-12-26 14:02:37,089][123091] Updated weights for policy 0, policy_version 1809297 (0.0010) [2023-12-26 14:02:37,147][123091] Updated weights for policy 0, policy_version 1809307 (0.0010) [2023-12-26 14:02:37,209][123091] Updated weights for policy 0, policy_version 1809317 (0.0009) [2023-12-26 14:02:37,278][123091] Updated weights for policy 0, policy_version 1809327 (0.0010) [2023-12-26 14:02:37,436][123090] Updated weights for policy 1, policy_version 1797578 (0.0005) [2023-12-26 14:02:37,508][123090] Updated weights for policy 1, policy_version 1797588 (0.0005) [2023-12-26 14:02:37,578][123090] Updated weights for policy 1, policy_version 1797598 (0.0005) [2023-12-26 14:02:38,187][123091] Updated weights for policy 0, policy_version 1809337 (0.0010) [2023-12-26 14:02:38,225][123090] Updated weights for policy 1, policy_version 1797608 (0.0006) [2023-12-26 14:02:38,239][123091] Updated weights for policy 0, policy_version 1809347 (0.0009) [2023-12-26 14:02:38,289][123090] Updated weights for policy 1, policy_version 1797618 (0.0010) [2023-12-26 14:02:38,301][123091] Updated weights for policy 0, policy_version 1809357 (0.0007) [2023-12-26 14:02:38,359][123090] Updated weights for policy 1, policy_version 1797628 (0.0008) [2023-12-26 14:02:38,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 923394048. Throughput: 0: 9024.1, 1: 8823.3. Samples: 923369208. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:38,785][121949] Avg episode reward: [(0, '6199.400'), (1, '5306.538')] [2023-12-26 14:02:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001809360_463200256.pth... [2023-12-26 14:02:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001797632_460193792.pth... [2023-12-26 14:02:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001808304_462929920.pth [2023-12-26 14:02:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001796576_459923456.pth [2023-12-26 14:02:39,047][123090] Updated weights for policy 1, policy_version 1797638 (0.0007) [2023-12-26 14:02:39,061][123091] Updated weights for policy 0, policy_version 1809367 (0.0011) [2023-12-26 14:02:39,102][123090] Updated weights for policy 1, policy_version 1797648 (0.0006) [2023-12-26 14:02:39,121][123091] Updated weights for policy 0, policy_version 1809377 (0.0011) [2023-12-26 14:02:39,170][123090] Updated weights for policy 1, policy_version 1797658 (0.0009) [2023-12-26 14:02:39,185][123091] Updated weights for policy 0, policy_version 1809387 (0.0011) [2023-12-26 14:02:39,935][123090] Updated weights for policy 1, policy_version 1797668 (0.0010) [2023-12-26 14:02:39,966][123091] Updated weights for policy 0, policy_version 1809397 (0.0010) [2023-12-26 14:02:40,000][123090] Updated weights for policy 1, policy_version 1797678 (0.0009) [2023-12-26 14:02:40,020][123091] Updated weights for policy 0, policy_version 1809407 (0.0009) [2023-12-26 14:02:40,067][123090] Updated weights for policy 1, policy_version 1797688 (0.0009) [2023-12-26 14:02:40,078][123091] Updated weights for policy 0, policy_version 1809417 (0.0009) [2023-12-26 14:02:40,934][123090] Updated weights for policy 1, policy_version 1797698 (0.0009) [2023-12-26 14:02:40,959][123091] Updated weights for policy 0, policy_version 1809427 (0.0008) [2023-12-26 14:02:40,993][123090] Updated weights for policy 1, policy_version 1797708 (0.0009) [2023-12-26 14:02:41,033][123091] Updated weights for policy 0, policy_version 1809437 (0.0006) [2023-12-26 14:02:41,064][123090] Updated weights for policy 1, policy_version 1797718 (0.0007) [2023-12-26 14:02:41,101][123091] Updated weights for policy 0, policy_version 1809447 (0.0008) [2023-12-26 14:02:41,132][123090] Updated weights for policy 1, policy_version 1797728 (0.0007) [2023-12-26 14:02:41,890][123091] Updated weights for policy 0, policy_version 1809457 (0.0008) [2023-12-26 14:02:41,946][123091] Updated weights for policy 0, policy_version 1809467 (0.0011) [2023-12-26 14:02:41,975][123090] Updated weights for policy 1, policy_version 1797738 (0.0006) [2023-12-26 14:02:42,010][123091] Updated weights for policy 0, policy_version 1809477 (0.0011) [2023-12-26 14:02:42,034][123090] Updated weights for policy 1, policy_version 1797748 (0.0008) [2023-12-26 14:02:42,074][123091] Updated weights for policy 0, policy_version 1809487 (0.0011) [2023-12-26 14:02:42,097][123090] Updated weights for policy 1, policy_version 1797758 (0.0007) [2023-12-26 14:02:42,891][123091] Updated weights for policy 0, policy_version 1809497 (0.0011) [2023-12-26 14:02:42,925][123090] Updated weights for policy 1, policy_version 1797768 (0.0006) [2023-12-26 14:02:42,957][123091] Updated weights for policy 0, policy_version 1809507 (0.0010) [2023-12-26 14:02:42,984][123090] Updated weights for policy 1, policy_version 1797778 (0.0005) [2023-12-26 14:02:43,024][123091] Updated weights for policy 0, policy_version 1809517 (0.0010) [2023-12-26 14:02:43,042][123090] Updated weights for policy 1, policy_version 1797788 (0.0005) [2023-12-26 14:02:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 923475968. Throughput: 0: 8971.8, 1: 8826.9. Samples: 923474732. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:43,784][121949] Avg episode reward: [(0, '6199.003'), (1, '5184.515')] [2023-12-26 14:02:43,815][123091] Updated weights for policy 0, policy_version 1809527 (0.0008) [2023-12-26 14:02:43,820][123090] Updated weights for policy 1, policy_version 1797798 (0.0008) [2023-12-26 14:02:43,867][123091] Updated weights for policy 0, policy_version 1809537 (0.0007) [2023-12-26 14:02:43,882][123090] Updated weights for policy 1, policy_version 1797808 (0.0009) [2023-12-26 14:02:43,914][123091] Updated weights for policy 0, policy_version 1809547 (0.0009) [2023-12-26 14:02:43,948][123090] Updated weights for policy 1, policy_version 1797818 (0.0007) [2023-12-26 14:02:44,758][123090] Updated weights for policy 1, policy_version 1797828 (0.0008) [2023-12-26 14:02:44,783][123091] Updated weights for policy 0, policy_version 1809557 (0.0009) [2023-12-26 14:02:44,830][123090] Updated weights for policy 1, policy_version 1797838 (0.0009) [2023-12-26 14:02:44,846][123091] Updated weights for policy 0, policy_version 1809567 (0.0008) [2023-12-26 14:02:44,892][123090] Updated weights for policy 1, policy_version 1797848 (0.0008) [2023-12-26 14:02:44,909][123091] Updated weights for policy 0, policy_version 1809577 (0.0008) [2023-12-26 14:02:45,670][123091] Updated weights for policy 0, policy_version 1809587 (0.0010) [2023-12-26 14:02:45,721][123091] Updated weights for policy 0, policy_version 1809597 (0.0009) [2023-12-26 14:02:45,751][123090] Updated weights for policy 1, policy_version 1797858 (0.0009) [2023-12-26 14:02:45,772][123091] Updated weights for policy 0, policy_version 1809607 (0.0008) [2023-12-26 14:02:45,796][123090] Updated weights for policy 1, policy_version 1797868 (0.0009) [2023-12-26 14:02:45,844][123090] Updated weights for policy 1, policy_version 1797878 (0.0008) [2023-12-26 14:02:45,894][123090] Updated weights for policy 1, policy_version 1797888 (0.0009) [2023-12-26 14:02:46,542][123091] Updated weights for policy 0, policy_version 1809617 (0.0007) [2023-12-26 14:02:46,589][123091] Updated weights for policy 0, policy_version 1809627 (0.0005) [2023-12-26 14:02:46,654][123091] Updated weights for policy 0, policy_version 1809637 (0.0006) [2023-12-26 14:02:46,713][123091] Updated weights for policy 0, policy_version 1809647 (0.0010) [2023-12-26 14:02:46,779][123090] Updated weights for policy 1, policy_version 1797898 (0.0008) [2023-12-26 14:02:46,833][123090] Updated weights for policy 1, policy_version 1797909 (0.0009) [2023-12-26 14:02:46,881][123090] Updated weights for policy 1, policy_version 1797919 (0.0009) [2023-12-26 14:02:47,512][123091] Updated weights for policy 0, policy_version 1809657 (0.0010) [2023-12-26 14:02:47,582][123091] Updated weights for policy 0, policy_version 1809667 (0.0011) [2023-12-26 14:02:47,653][123091] Updated weights for policy 0, policy_version 1809677 (0.0010) [2023-12-26 14:02:47,760][123090] Updated weights for policy 1, policy_version 1797929 (0.0009) [2023-12-26 14:02:47,809][123090] Updated weights for policy 1, policy_version 1797939 (0.0009) [2023-12-26 14:02:47,857][123090] Updated weights for policy 1, policy_version 1797949 (0.0009) [2023-12-26 14:02:48,426][123091] Updated weights for policy 0, policy_version 1809687 (0.0007) [2023-12-26 14:02:48,487][123091] Updated weights for policy 0, policy_version 1809697 (0.0005) [2023-12-26 14:02:48,552][123091] Updated weights for policy 0, policy_version 1809707 (0.0005) [2023-12-26 14:02:48,781][123090] Updated weights for policy 1, policy_version 1797959 (0.0009) [2023-12-26 14:02:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 923566080. Throughput: 0: 8938.9, 1: 8842.2. Samples: 923578904. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:48,785][121949] Avg episode reward: [(0, '6218.348'), (1, '5350.821')] [2023-12-26 14:02:48,848][123090] Updated weights for policy 1, policy_version 1797969 (0.0010) [2023-12-26 14:02:48,911][123090] Updated weights for policy 1, policy_version 1797979 (0.0010) [2023-12-26 14:02:49,237][123091] Updated weights for policy 0, policy_version 1809717 (0.0007) [2023-12-26 14:02:49,308][123091] Updated weights for policy 0, policy_version 1809727 (0.0010) [2023-12-26 14:02:49,376][123091] Updated weights for policy 0, policy_version 1809737 (0.0009) [2023-12-26 14:02:49,747][123090] Updated weights for policy 1, policy_version 1797989 (0.0009) [2023-12-26 14:02:49,801][123090] Updated weights for policy 1, policy_version 1797999 (0.0006) [2023-12-26 14:02:49,866][123090] Updated weights for policy 1, policy_version 1798009 (0.0007) [2023-12-26 14:02:50,111][123091] Updated weights for policy 0, policy_version 1809747 (0.0007) [2023-12-26 14:02:50,183][123091] Updated weights for policy 0, policy_version 1809757 (0.0006) [2023-12-26 14:02:50,253][123091] Updated weights for policy 0, policy_version 1809767 (0.0006) [2023-12-26 14:02:50,698][123090] Updated weights for policy 1, policy_version 1798019 (0.0008) [2023-12-26 14:02:50,770][123090] Updated weights for policy 1, policy_version 1798029 (0.0010) [2023-12-26 14:02:50,841][123090] Updated weights for policy 1, policy_version 1798039 (0.0009) [2023-12-26 14:02:50,955][123091] Updated weights for policy 0, policy_version 1809777 (0.0006) [2023-12-26 14:02:51,022][123091] Updated weights for policy 0, policy_version 1809787 (0.0006) [2023-12-26 14:02:51,091][123091] Updated weights for policy 0, policy_version 1809797 (0.0009) [2023-12-26 14:02:51,158][123091] Updated weights for policy 0, policy_version 1809807 (0.0009) [2023-12-26 14:02:51,700][123090] Updated weights for policy 1, policy_version 1798049 (0.0009) [2023-12-26 14:02:51,772][123090] Updated weights for policy 1, policy_version 1798059 (0.0009) [2023-12-26 14:02:51,841][123090] Updated weights for policy 1, policy_version 1798069 (0.0010) [2023-12-26 14:02:51,911][123090] Updated weights for policy 1, policy_version 1798079 (0.0008) [2023-12-26 14:02:51,955][123091] Updated weights for policy 0, policy_version 1809817 (0.0010) [2023-12-26 14:02:52,012][123091] Updated weights for policy 0, policy_version 1809827 (0.0010) [2023-12-26 14:02:52,064][123091] Updated weights for policy 0, policy_version 1809837 (0.0009) [2023-12-26 14:02:52,797][123090] Updated weights for policy 1, policy_version 1798089 (0.0010) [2023-12-26 14:02:52,834][123091] Updated weights for policy 0, policy_version 1809847 (0.0006) [2023-12-26 14:02:52,862][123090] Updated weights for policy 1, policy_version 1798099 (0.0008) [2023-12-26 14:02:52,886][123091] Updated weights for policy 0, policy_version 1809857 (0.0005) [2023-12-26 14:02:52,916][123090] Updated weights for policy 1, policy_version 1798109 (0.0009) [2023-12-26 14:02:52,950][123091] Updated weights for policy 0, policy_version 1809867 (0.0005) [2023-12-26 14:02:53,588][123091] Updated weights for policy 0, policy_version 1809877 (0.0005) [2023-12-26 14:02:53,639][123091] Updated weights for policy 0, policy_version 1809887 (0.0005) [2023-12-26 14:02:53,705][123091] Updated weights for policy 0, policy_version 1809897 (0.0005) [2023-12-26 14:02:53,761][123090] Updated weights for policy 1, policy_version 1798119 (0.0009) [2023-12-26 14:02:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 923656192. Throughput: 0: 8993.8, 1: 8817.5. Samples: 923632224. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:53,785][121949] Avg episode reward: [(0, '6164.203'), (1, '5426.301')] [2023-12-26 14:02:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001809904_463339520.pth... [2023-12-26 14:02:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001808848_463069184.pth [2023-12-26 14:02:53,818][123090] Updated weights for policy 1, policy_version 1798129 (0.0011) [2023-12-26 14:02:53,879][123090] Updated weights for policy 1, policy_version 1798140 (0.0006) [2023-12-26 14:02:53,905][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001798144_460324864.pth... [2023-12-26 14:02:53,909][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001797088_460054528.pth [2023-12-26 14:02:54,382][123091] Updated weights for policy 0, policy_version 1809907 (0.0005) [2023-12-26 14:02:54,430][123091] Updated weights for policy 0, policy_version 1809917 (0.0005) [2023-12-26 14:02:54,479][123091] Updated weights for policy 0, policy_version 1809927 (0.0005) [2023-12-26 14:02:54,657][123090] Updated weights for policy 1, policy_version 1798150 (0.0008) [2023-12-26 14:02:54,710][123090] Updated weights for policy 1, policy_version 1798160 (0.0010) [2023-12-26 14:02:54,780][123090] Updated weights for policy 1, policy_version 1798170 (0.0007) [2023-12-26 14:02:55,203][123091] Updated weights for policy 0, policy_version 1809937 (0.0006) [2023-12-26 14:02:55,261][123091] Updated weights for policy 0, policy_version 1809948 (0.0010) [2023-12-26 14:02:55,314][123091] Updated weights for policy 0, policy_version 1809958 (0.0009) [2023-12-26 14:02:55,358][123091] Updated weights for policy 0, policy_version 1809968 (0.0008) [2023-12-26 14:02:55,523][123090] Updated weights for policy 1, policy_version 1798180 (0.0006) [2023-12-26 14:02:55,578][123090] Updated weights for policy 1, policy_version 1798190 (0.0009) [2023-12-26 14:02:55,652][123090] Updated weights for policy 1, policy_version 1798200 (0.0009) [2023-12-26 14:02:56,236][123091] Updated weights for policy 0, policy_version 1809979 (0.0010) [2023-12-26 14:02:56,292][123091] Updated weights for policy 0, policy_version 1809989 (0.0008) [2023-12-26 14:02:56,363][123091] Updated weights for policy 0, policy_version 1809999 (0.0005) [2023-12-26 14:02:56,410][123090] Updated weights for policy 1, policy_version 1798210 (0.0007) [2023-12-26 14:02:56,466][123090] Updated weights for policy 1, policy_version 1798220 (0.0010) [2023-12-26 14:02:56,512][123090] Updated weights for policy 1, policy_version 1798230 (0.0010) [2023-12-26 14:02:56,559][123090] Updated weights for policy 1, policy_version 1798240 (0.0010) [2023-12-26 14:02:57,158][123091] Updated weights for policy 0, policy_version 1810009 (0.0009) [2023-12-26 14:02:57,206][123091] Updated weights for policy 0, policy_version 1810019 (0.0009) [2023-12-26 14:02:57,253][123091] Updated weights for policy 0, policy_version 1810029 (0.0009) [2023-12-26 14:02:57,391][123090] Updated weights for policy 1, policy_version 1798250 (0.0005) [2023-12-26 14:02:57,452][123090] Updated weights for policy 1, policy_version 1798260 (0.0006) [2023-12-26 14:02:57,518][123090] Updated weights for policy 1, policy_version 1798270 (0.0006) [2023-12-26 14:02:58,008][123091] Updated weights for policy 0, policy_version 1810039 (0.0007) [2023-12-26 14:02:58,068][123091] Updated weights for policy 0, policy_version 1810049 (0.0007) [2023-12-26 14:02:58,139][123091] Updated weights for policy 0, policy_version 1810059 (0.0010) [2023-12-26 14:02:58,167][123090] Updated weights for policy 1, policy_version 1798280 (0.0007) [2023-12-26 14:02:58,233][123090] Updated weights for policy 1, policy_version 1798290 (0.0008) [2023-12-26 14:02:58,297][123090] Updated weights for policy 1, policy_version 1798300 (0.0008) [2023-12-26 14:02:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 923746304. Throughput: 0: 9030.5, 1: 8869.5. Samples: 923742068. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:02:58,785][121949] Avg episode reward: [(0, '6191.791'), (1, '5436.341')] [2023-12-26 14:02:59,022][123091] Updated weights for policy 0, policy_version 1810069 (0.0010) [2023-12-26 14:02:59,086][123091] Updated weights for policy 0, policy_version 1810079 (0.0009) [2023-12-26 14:02:59,109][123090] Updated weights for policy 1, policy_version 1798310 (0.0008) [2023-12-26 14:02:59,148][123091] Updated weights for policy 0, policy_version 1810089 (0.0008) [2023-12-26 14:02:59,177][123090] Updated weights for policy 1, policy_version 1798320 (0.0009) [2023-12-26 14:02:59,252][123090] Updated weights for policy 1, policy_version 1798330 (0.0008) [2023-12-26 14:02:59,920][123091] Updated weights for policy 0, policy_version 1810099 (0.0007) [2023-12-26 14:02:59,989][123091] Updated weights for policy 0, policy_version 1810109 (0.0007) [2023-12-26 14:03:00,018][123090] Updated weights for policy 1, policy_version 1798340 (0.0007) [2023-12-26 14:03:00,055][123091] Updated weights for policy 0, policy_version 1810119 (0.0008) [2023-12-26 14:03:00,074][123090] Updated weights for policy 1, policy_version 1798350 (0.0008) [2023-12-26 14:03:00,132][123090] Updated weights for policy 1, policy_version 1798360 (0.0008) [2023-12-26 14:03:00,733][123091] Updated weights for policy 0, policy_version 1810129 (0.0009) [2023-12-26 14:03:00,794][123091] Updated weights for policy 0, policy_version 1810139 (0.0010) [2023-12-26 14:03:00,855][123091] Updated weights for policy 0, policy_version 1810149 (0.0010) [2023-12-26 14:03:00,916][123091] Updated weights for policy 0, policy_version 1810159 (0.0010) [2023-12-26 14:03:00,970][123090] Updated weights for policy 1, policy_version 1798370 (0.0008) [2023-12-26 14:03:01,021][123090] Updated weights for policy 1, policy_version 1798380 (0.0008) [2023-12-26 14:03:01,089][123090] Updated weights for policy 1, policy_version 1798390 (0.0010) [2023-12-26 14:03:01,154][123090] Updated weights for policy 1, policy_version 1798400 (0.0010) [2023-12-26 14:03:01,622][123091] Updated weights for policy 0, policy_version 1810169 (0.0009) [2023-12-26 14:03:01,686][123091] Updated weights for policy 0, policy_version 1810179 (0.0007) [2023-12-26 14:03:01,749][123091] Updated weights for policy 0, policy_version 1810189 (0.0011) [2023-12-26 14:03:01,951][123090] Updated weights for policy 1, policy_version 1798410 (0.0008) [2023-12-26 14:03:02,010][123090] Updated weights for policy 1, policy_version 1798420 (0.0010) [2023-12-26 14:03:02,068][123090] Updated weights for policy 1, policy_version 1798430 (0.0010) [2023-12-26 14:03:02,491][123091] Updated weights for policy 0, policy_version 1810199 (0.0011) [2023-12-26 14:03:02,556][123091] Updated weights for policy 0, policy_version 1810209 (0.0011) [2023-12-26 14:03:02,619][123091] Updated weights for policy 0, policy_version 1810219 (0.0010) [2023-12-26 14:03:02,952][123090] Updated weights for policy 1, policy_version 1798440 (0.0010) [2023-12-26 14:03:03,008][123090] Updated weights for policy 1, policy_version 1798450 (0.0011) [2023-12-26 14:03:03,073][123090] Updated weights for policy 1, policy_version 1798460 (0.0010) [2023-12-26 14:03:03,399][123091] Updated weights for policy 0, policy_version 1810229 (0.0008) [2023-12-26 14:03:03,450][123091] Updated weights for policy 0, policy_version 1810239 (0.0006) [2023-12-26 14:03:03,513][123091] Updated weights for policy 0, policy_version 1810249 (0.0006) [2023-12-26 14:03:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 923836416. Throughput: 0: 8974.2, 1: 8893.2. Samples: 923849448. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:03,785][121949] Avg episode reward: [(0, '6127.105'), (1, '5502.633')] [2023-12-26 14:03:03,811][123090] Updated weights for policy 1, policy_version 1798470 (0.0011) [2023-12-26 14:03:03,873][123090] Updated weights for policy 1, policy_version 1798480 (0.0009) [2023-12-26 14:03:03,934][123090] Updated weights for policy 1, policy_version 1798490 (0.0006) [2023-12-26 14:03:04,154][123091] Updated weights for policy 0, policy_version 1810259 (0.0007) [2023-12-26 14:03:04,212][123091] Updated weights for policy 0, policy_version 1810269 (0.0007) [2023-12-26 14:03:04,282][123091] Updated weights for policy 0, policy_version 1810279 (0.0006) [2023-12-26 14:03:04,730][123090] Updated weights for policy 1, policy_version 1798500 (0.0008) [2023-12-26 14:03:04,793][123090] Updated weights for policy 1, policy_version 1798510 (0.0010) [2023-12-26 14:03:04,856][123090] Updated weights for policy 1, policy_version 1798520 (0.0010) [2023-12-26 14:03:04,977][123091] Updated weights for policy 0, policy_version 1810289 (0.0005) [2023-12-26 14:03:05,048][123091] Updated weights for policy 0, policy_version 1810299 (0.0008) [2023-12-26 14:03:05,112][123091] Updated weights for policy 0, policy_version 1810309 (0.0010) [2023-12-26 14:03:05,170][123091] Updated weights for policy 0, policy_version 1810319 (0.0010) [2023-12-26 14:03:05,497][123090] Updated weights for policy 1, policy_version 1798530 (0.0008) [2023-12-26 14:03:05,548][123090] Updated weights for policy 1, policy_version 1798540 (0.0010) [2023-12-26 14:03:05,600][123090] Updated weights for policy 1, policy_version 1798550 (0.0010) [2023-12-26 14:03:05,656][123090] Updated weights for policy 1, policy_version 1798560 (0.0010) [2023-12-26 14:03:05,938][123091] Updated weights for policy 0, policy_version 1810329 (0.0006) [2023-12-26 14:03:06,002][123091] Updated weights for policy 0, policy_version 1810339 (0.0005) [2023-12-26 14:03:06,065][123091] Updated weights for policy 0, policy_version 1810349 (0.0006) [2023-12-26 14:03:06,500][123090] Updated weights for policy 1, policy_version 1798570 (0.0009) [2023-12-26 14:03:06,560][123090] Updated weights for policy 1, policy_version 1798580 (0.0009) [2023-12-26 14:03:06,632][123090] Updated weights for policy 1, policy_version 1798590 (0.0010) [2023-12-26 14:03:06,753][123091] Updated weights for policy 0, policy_version 1810359 (0.0006) [2023-12-26 14:03:06,809][123091] Updated weights for policy 0, policy_version 1810369 (0.0011) [2023-12-26 14:03:06,862][123091] Updated weights for policy 0, policy_version 1810379 (0.0009) [2023-12-26 14:03:07,443][123091] Updated weights for policy 0, policy_version 1810389 (0.0007) [2023-12-26 14:03:07,493][123091] Updated weights for policy 0, policy_version 1810399 (0.0005) [2023-12-26 14:03:07,502][123090] Updated weights for policy 1, policy_version 1798600 (0.0006) [2023-12-26 14:03:07,556][123091] Updated weights for policy 0, policy_version 1810409 (0.0006) [2023-12-26 14:03:07,571][123090] Updated weights for policy 1, policy_version 1798610 (0.0006) [2023-12-26 14:03:07,640][123090] Updated weights for policy 1, policy_version 1798620 (0.0008) [2023-12-26 14:03:08,234][123091] Updated weights for policy 0, policy_version 1810419 (0.0007) [2023-12-26 14:03:08,287][123091] Updated weights for policy 0, policy_version 1810429 (0.0009) [2023-12-26 14:03:08,344][123091] Updated weights for policy 0, policy_version 1810439 (0.0010) [2023-12-26 14:03:08,385][123090] Updated weights for policy 1, policy_version 1798630 (0.0010) [2023-12-26 14:03:08,454][123090] Updated weights for policy 1, policy_version 1798640 (0.0008) [2023-12-26 14:03:08,516][123090] Updated weights for policy 1, policy_version 1798650 (0.0010) [2023-12-26 14:03:08,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 923934720. Throughput: 0: 9058.4, 1: 8921.6. Samples: 923905736. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:08,785][121949] Avg episode reward: [(0, '6166.123'), (1, '5599.466')] [2023-12-26 14:03:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001810448_463478784.pth... [2023-12-26 14:03:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001798656_460455936.pth... [2023-12-26 14:03:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001797632_460193792.pth [2023-12-26 14:03:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001809360_463200256.pth [2023-12-26 14:03:09,203][123091] Updated weights for policy 0, policy_version 1810449 (0.0008) [2023-12-26 14:03:09,265][123091] Updated weights for policy 0, policy_version 1810459 (0.0008) [2023-12-26 14:03:09,333][123091] Updated weights for policy 0, policy_version 1810469 (0.0009) [2023-12-26 14:03:09,339][123090] Updated weights for policy 1, policy_version 1798660 (0.0009) [2023-12-26 14:03:09,398][123091] Updated weights for policy 0, policy_version 1810479 (0.0008) [2023-12-26 14:03:09,404][123090] Updated weights for policy 1, policy_version 1798670 (0.0008) [2023-12-26 14:03:09,473][123090] Updated weights for policy 1, policy_version 1798680 (0.0008) [2023-12-26 14:03:10,237][123091] Updated weights for policy 0, policy_version 1810489 (0.0010) [2023-12-26 14:03:10,276][123090] Updated weights for policy 1, policy_version 1798690 (0.0008) [2023-12-26 14:03:10,303][123091] Updated weights for policy 0, policy_version 1810499 (0.0010) [2023-12-26 14:03:10,335][123090] Updated weights for policy 1, policy_version 1798700 (0.0006) [2023-12-26 14:03:10,356][123091] Updated weights for policy 0, policy_version 1810509 (0.0009) [2023-12-26 14:03:10,398][123090] Updated weights for policy 1, policy_version 1798710 (0.0007) [2023-12-26 14:03:10,453][123090] Updated weights for policy 1, policy_version 1798720 (0.0005) [2023-12-26 14:03:11,082][123091] Updated weights for policy 0, policy_version 1810519 (0.0009) [2023-12-26 14:03:11,152][123091] Updated weights for policy 0, policy_version 1810529 (0.0009) [2023-12-26 14:03:11,182][123090] Updated weights for policy 1, policy_version 1798730 (0.0009) [2023-12-26 14:03:11,215][123091] Updated weights for policy 0, policy_version 1810539 (0.0009) [2023-12-26 14:03:11,240][123090] Updated weights for policy 1, policy_version 1798740 (0.0008) [2023-12-26 14:03:11,309][123090] Updated weights for policy 1, policy_version 1798750 (0.0010) [2023-12-26 14:03:12,054][123090] Updated weights for policy 1, policy_version 1798760 (0.0011) [2023-12-26 14:03:12,107][123090] Updated weights for policy 1, policy_version 1798770 (0.0011) [2023-12-26 14:03:12,122][123091] Updated weights for policy 0, policy_version 1810549 (0.0007) [2023-12-26 14:03:12,167][123090] Updated weights for policy 1, policy_version 1798780 (0.0011) [2023-12-26 14:03:12,179][123091] Updated weights for policy 0, policy_version 1810559 (0.0006) [2023-12-26 14:03:12,233][123091] Updated weights for policy 0, policy_version 1810569 (0.0008) [2023-12-26 14:03:13,013][123090] Updated weights for policy 1, policy_version 1798790 (0.0010) [2023-12-26 14:03:13,077][123091] Updated weights for policy 0, policy_version 1810579 (0.0008) [2023-12-26 14:03:13,081][123090] Updated weights for policy 1, policy_version 1798800 (0.0009) [2023-12-26 14:03:13,141][123091] Updated weights for policy 0, policy_version 1810589 (0.0008) [2023-12-26 14:03:13,148][123090] Updated weights for policy 1, policy_version 1798810 (0.0008) [2023-12-26 14:03:13,203][123091] Updated weights for policy 0, policy_version 1810599 (0.0008) [2023-12-26 14:03:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 924016640. Throughput: 0: 8988.3, 1: 8929.1. Samples: 924012240. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:13,785][121949] Avg episode reward: [(0, '6209.921'), (1, '5671.158')] [2023-12-26 14:03:13,952][123090] Updated weights for policy 1, policy_version 1798820 (0.0007) [2023-12-26 14:03:14,005][123091] Updated weights for policy 0, policy_version 1810609 (0.0007) [2023-12-26 14:03:14,022][123090] Updated weights for policy 1, policy_version 1798830 (0.0005) [2023-12-26 14:03:14,058][123091] Updated weights for policy 0, policy_version 1810619 (0.0009) [2023-12-26 14:03:14,077][123090] Updated weights for policy 1, policy_version 1798840 (0.0008) [2023-12-26 14:03:14,121][123091] Updated weights for policy 0, policy_version 1810629 (0.0008) [2023-12-26 14:03:14,181][123091] Updated weights for policy 0, policy_version 1810639 (0.0010) [2023-12-26 14:03:14,817][123090] Updated weights for policy 1, policy_version 1798850 (0.0008) [2023-12-26 14:03:14,880][123090] Updated weights for policy 1, policy_version 1798860 (0.0010) [2023-12-26 14:03:14,943][123090] Updated weights for policy 1, policy_version 1798870 (0.0009) [2023-12-26 14:03:15,009][123090] Updated weights for policy 1, policy_version 1798880 (0.0009) [2023-12-26 14:03:15,040][123091] Updated weights for policy 0, policy_version 1810649 (0.0007) [2023-12-26 14:03:15,089][123091] Updated weights for policy 0, policy_version 1810659 (0.0010) [2023-12-26 14:03:15,139][123091] Updated weights for policy 0, policy_version 1810669 (0.0009) [2023-12-26 14:03:15,895][123091] Updated weights for policy 0, policy_version 1810679 (0.0008) [2023-12-26 14:03:15,896][123090] Updated weights for policy 1, policy_version 1798890 (0.0010) [2023-12-26 14:03:15,946][123091] Updated weights for policy 0, policy_version 1810689 (0.0006) [2023-12-26 14:03:15,949][123090] Updated weights for policy 1, policy_version 1798900 (0.0009) [2023-12-26 14:03:15,993][123091] Updated weights for policy 0, policy_version 1810699 (0.0005) [2023-12-26 14:03:16,002][123090] Updated weights for policy 1, policy_version 1798910 (0.0009) [2023-12-26 14:03:16,787][123090] Updated weights for policy 1, policy_version 1798920 (0.0006) [2023-12-26 14:03:16,831][123091] Updated weights for policy 0, policy_version 1810709 (0.0008) [2023-12-26 14:03:16,835][123090] Updated weights for policy 1, policy_version 1798930 (0.0005) [2023-12-26 14:03:16,882][123091] Updated weights for policy 0, policy_version 1810719 (0.0008) [2023-12-26 14:03:16,888][123090] Updated weights for policy 1, policy_version 1798940 (0.0008) [2023-12-26 14:03:16,933][123091] Updated weights for policy 0, policy_version 1810729 (0.0007) [2023-12-26 14:03:17,653][123090] Updated weights for policy 1, policy_version 1798950 (0.0010) [2023-12-26 14:03:17,720][123090] Updated weights for policy 1, policy_version 1798960 (0.0010) [2023-12-26 14:03:17,777][123090] Updated weights for policy 1, policy_version 1798970 (0.0009) [2023-12-26 14:03:17,781][123091] Updated weights for policy 0, policy_version 1810739 (0.0008) [2023-12-26 14:03:17,837][123091] Updated weights for policy 0, policy_version 1810749 (0.0005) [2023-12-26 14:03:17,889][123091] Updated weights for policy 0, policy_version 1810759 (0.0005) [2023-12-26 14:03:18,657][123091] Updated weights for policy 0, policy_version 1810769 (0.0008) [2023-12-26 14:03:18,665][123090] Updated weights for policy 1, policy_version 1798980 (0.0009) [2023-12-26 14:03:18,717][123091] Updated weights for policy 0, policy_version 1810779 (0.0008) [2023-12-26 14:03:18,723][123090] Updated weights for policy 1, policy_version 1798990 (0.0009) [2023-12-26 14:03:18,780][123091] Updated weights for policy 0, policy_version 1810789 (0.0010) [2023-12-26 14:03:18,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 924098560. Throughput: 0: 9004.1, 1: 8811.6. Samples: 924117676. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:18,785][121949] Avg episode reward: [(0, '6274.455'), (1, '5730.419')] [2023-12-26 14:03:18,788][123090] Updated weights for policy 1, policy_version 1799000 (0.0007) [2023-12-26 14:03:18,837][123091] Updated weights for policy 0, policy_version 1810799 (0.0008) [2023-12-26 14:03:19,573][123090] Updated weights for policy 1, policy_version 1799010 (0.0009) [2023-12-26 14:03:19,642][123090] Updated weights for policy 1, policy_version 1799020 (0.0009) [2023-12-26 14:03:19,705][123090] Updated weights for policy 1, policy_version 1799030 (0.0008) [2023-12-26 14:03:19,707][123091] Updated weights for policy 0, policy_version 1810809 (0.0009) [2023-12-26 14:03:19,767][123090] Updated weights for policy 1, policy_version 1799040 (0.0008) [2023-12-26 14:03:19,777][123091] Updated weights for policy 0, policy_version 1810819 (0.0009) [2023-12-26 14:03:19,850][123091] Updated weights for policy 0, policy_version 1810829 (0.0009) [2023-12-26 14:03:20,618][123090] Updated weights for policy 1, policy_version 1799050 (0.0010) [2023-12-26 14:03:20,677][123091] Updated weights for policy 0, policy_version 1810839 (0.0008) [2023-12-26 14:03:20,679][123090] Updated weights for policy 1, policy_version 1799060 (0.0007) [2023-12-26 14:03:20,726][123091] Updated weights for policy 0, policy_version 1810849 (0.0007) [2023-12-26 14:03:20,741][123090] Updated weights for policy 1, policy_version 1799070 (0.0010) [2023-12-26 14:03:20,785][123091] Updated weights for policy 0, policy_version 1810859 (0.0008) [2023-12-26 14:03:21,609][123090] Updated weights for policy 1, policy_version 1799080 (0.0009) [2023-12-26 14:03:21,654][123091] Updated weights for policy 0, policy_version 1810869 (0.0009) [2023-12-26 14:03:21,679][123090] Updated weights for policy 1, policy_version 1799090 (0.0008) [2023-12-26 14:03:21,724][123091] Updated weights for policy 0, policy_version 1810879 (0.0008) [2023-12-26 14:03:21,749][123090] Updated weights for policy 1, policy_version 1799100 (0.0009) [2023-12-26 14:03:21,795][123091] Updated weights for policy 0, policy_version 1810889 (0.0010) [2023-12-26 14:03:22,588][123090] Updated weights for policy 1, policy_version 1799110 (0.0009) [2023-12-26 14:03:22,640][123091] Updated weights for policy 0, policy_version 1810899 (0.0009) [2023-12-26 14:03:22,655][123090] Updated weights for policy 1, policy_version 1799120 (0.0009) [2023-12-26 14:03:22,695][123091] Updated weights for policy 0, policy_version 1810909 (0.0009) [2023-12-26 14:03:22,719][123090] Updated weights for policy 1, policy_version 1799130 (0.0009) [2023-12-26 14:03:22,752][123091] Updated weights for policy 0, policy_version 1810919 (0.0008) [2023-12-26 14:03:23,527][123090] Updated weights for policy 1, policy_version 1799140 (0.0009) [2023-12-26 14:03:23,580][123090] Updated weights for policy 1, policy_version 1799150 (0.0009) [2023-12-26 14:03:23,593][123091] Updated weights for policy 0, policy_version 1810929 (0.0010) [2023-12-26 14:03:23,635][123090] Updated weights for policy 1, policy_version 1799160 (0.0009) [2023-12-26 14:03:23,656][123091] Updated weights for policy 0, policy_version 1810939 (0.0008) [2023-12-26 14:03:23,715][123091] Updated weights for policy 0, policy_version 1810949 (0.0009) [2023-12-26 14:03:23,778][123091] Updated weights for policy 0, policy_version 1810959 (0.0009) [2023-12-26 14:03:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 924196864. Throughput: 0: 9010.3, 1: 8730.8. Samples: 924167552. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:23,785][121949] Avg episode reward: [(0, '6156.425'), (1, '5781.939')] [2023-12-26 14:03:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001810960_463609856.pth... [2023-12-26 14:03:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001799168_460587008.pth... [2023-12-26 14:03:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001809904_463339520.pth [2023-12-26 14:03:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001798144_460324864.pth [2023-12-26 14:03:24,440][123090] Updated weights for policy 1, policy_version 1799170 (0.0009) [2023-12-26 14:03:24,499][123090] Updated weights for policy 1, policy_version 1799180 (0.0009) [2023-12-26 14:03:24,551][123090] Updated weights for policy 1, policy_version 1799190 (0.0009) [2023-12-26 14:03:24,590][123091] Updated weights for policy 0, policy_version 1810969 (0.0008) [2023-12-26 14:03:24,602][123090] Updated weights for policy 1, policy_version 1799200 (0.0008) [2023-12-26 14:03:24,647][123091] Updated weights for policy 0, policy_version 1810979 (0.0009) [2023-12-26 14:03:24,699][123091] Updated weights for policy 0, policy_version 1810989 (0.0009) [2023-12-26 14:03:25,365][123090] Updated weights for policy 1, policy_version 1799210 (0.0007) [2023-12-26 14:03:25,425][123090] Updated weights for policy 1, policy_version 1799222 (0.0009) [2023-12-26 14:03:25,574][123091] Updated weights for policy 0, policy_version 1810999 (0.0009) [2023-12-26 14:03:25,638][123091] Updated weights for policy 0, policy_version 1811009 (0.0010) [2023-12-26 14:03:25,699][123091] Updated weights for policy 0, policy_version 1811019 (0.0010) [2023-12-26 14:03:26,268][123090] Updated weights for policy 1, policy_version 1799233 (0.0009) [2023-12-26 14:03:26,333][123090] Updated weights for policy 1, policy_version 1799243 (0.0009) [2023-12-26 14:03:26,403][123090] Updated weights for policy 1, policy_version 1799253 (0.0009) [2023-12-26 14:03:26,480][123090] Updated weights for policy 1, policy_version 1799263 (0.0010) [2023-12-26 14:03:26,484][123091] Updated weights for policy 0, policy_version 1811029 (0.0007) [2023-12-26 14:03:26,548][123091] Updated weights for policy 0, policy_version 1811039 (0.0008) [2023-12-26 14:03:26,604][123091] Updated weights for policy 0, policy_version 1811049 (0.0009) [2023-12-26 14:03:27,281][123091] Updated weights for policy 0, policy_version 1811059 (0.0007) [2023-12-26 14:03:27,346][123091] Updated weights for policy 0, policy_version 1811070 (0.0007) [2023-12-26 14:03:27,365][123090] Updated weights for policy 1, policy_version 1799273 (0.0009) [2023-12-26 14:03:27,396][123091] Updated weights for policy 0, policy_version 1811080 (0.0006) [2023-12-26 14:03:27,425][123090] Updated weights for policy 1, policy_version 1799283 (0.0008) [2023-12-26 14:03:27,481][123090] Updated weights for policy 1, policy_version 1799293 (0.0009) [2023-12-26 14:03:28,159][123091] Updated weights for policy 0, policy_version 1811090 (0.0008) [2023-12-26 14:03:28,221][123091] Updated weights for policy 0, policy_version 1811100 (0.0009) [2023-12-26 14:03:28,281][123091] Updated weights for policy 0, policy_version 1811110 (0.0009) [2023-12-26 14:03:28,337][123090] Updated weights for policy 1, policy_version 1799303 (0.0008) [2023-12-26 14:03:28,348][123091] Updated weights for policy 0, policy_version 1811120 (0.0009) [2023-12-26 14:03:28,407][123090] Updated weights for policy 1, policy_version 1799313 (0.0009) [2023-12-26 14:03:28,467][123090] Updated weights for policy 1, policy_version 1799323 (0.0006) [2023-12-26 14:03:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 924278784. Throughput: 0: 9041.3, 1: 8666.7. Samples: 924271596. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:28,785][121949] Avg episode reward: [(0, '6187.096'), (1, '5775.357')] [2023-12-26 14:03:29,158][123091] Updated weights for policy 0, policy_version 1811130 (0.0009) [2023-12-26 14:03:29,213][123091] Updated weights for policy 0, policy_version 1811140 (0.0010) [2023-12-26 14:03:29,241][123090] Updated weights for policy 1, policy_version 1799333 (0.0006) [2023-12-26 14:03:29,277][123091] Updated weights for policy 0, policy_version 1811150 (0.0006) [2023-12-26 14:03:29,311][123090] Updated weights for policy 1, policy_version 1799343 (0.0008) [2023-12-26 14:03:29,389][123090] Updated weights for policy 1, policy_version 1799353 (0.0008) [2023-12-26 14:03:30,021][123091] Updated weights for policy 0, policy_version 1811160 (0.0010) [2023-12-26 14:03:30,077][123091] Updated weights for policy 0, policy_version 1811170 (0.0009) [2023-12-26 14:03:30,145][123091] Updated weights for policy 0, policy_version 1811180 (0.0010) [2023-12-26 14:03:30,194][123090] Updated weights for policy 1, policy_version 1799363 (0.0008) [2023-12-26 14:03:30,250][123090] Updated weights for policy 1, policy_version 1799373 (0.0010) [2023-12-26 14:03:30,314][123090] Updated weights for policy 1, policy_version 1799383 (0.0010) [2023-12-26 14:03:30,973][123091] Updated weights for policy 0, policy_version 1811190 (0.0009) [2023-12-26 14:03:31,020][123091] Updated weights for policy 0, policy_version 1811200 (0.0008) [2023-12-26 14:03:31,088][123091] Updated weights for policy 0, policy_version 1811210 (0.0010) [2023-12-26 14:03:31,143][123090] Updated weights for policy 1, policy_version 1799393 (0.0010) [2023-12-26 14:03:31,200][123090] Updated weights for policy 1, policy_version 1799403 (0.0009) [2023-12-26 14:03:31,261][123090] Updated weights for policy 1, policy_version 1799413 (0.0009) [2023-12-26 14:03:31,329][123090] Updated weights for policy 1, policy_version 1799423 (0.0009) [2023-12-26 14:03:31,943][123091] Updated weights for policy 0, policy_version 1811220 (0.0008) [2023-12-26 14:03:32,001][123091] Updated weights for policy 0, policy_version 1811230 (0.0008) [2023-12-26 14:03:32,056][123091] Updated weights for policy 0, policy_version 1811240 (0.0008) [2023-12-26 14:03:32,057][123090] Updated weights for policy 1, policy_version 1799433 (0.0009) [2023-12-26 14:03:32,114][123090] Updated weights for policy 1, policy_version 1799443 (0.0006) [2023-12-26 14:03:32,171][123090] Updated weights for policy 1, policy_version 1799453 (0.0005) [2023-12-26 14:03:32,894][123091] Updated weights for policy 0, policy_version 1811250 (0.0008) [2023-12-26 14:03:32,921][123090] Updated weights for policy 1, policy_version 1799463 (0.0006) [2023-12-26 14:03:32,953][123091] Updated weights for policy 0, policy_version 1811260 (0.0009) [2023-12-26 14:03:32,977][123090] Updated weights for policy 1, policy_version 1799473 (0.0008) [2023-12-26 14:03:33,006][123091] Updated weights for policy 0, policy_version 1811270 (0.0006) [2023-12-26 14:03:33,031][123090] Updated weights for policy 1, policy_version 1799483 (0.0006) [2023-12-26 14:03:33,071][123091] Updated weights for policy 0, policy_version 1811280 (0.0009) [2023-12-26 14:03:33,735][123090] Updated weights for policy 1, policy_version 1799493 (0.0005) [2023-12-26 14:03:33,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 924360704. Throughput: 0: 9005.9, 1: 8728.8. Samples: 924376968. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:33,785][121949] Avg episode reward: [(0, '6236.181'), (1, '5818.494')] [2023-12-26 14:03:33,790][123090] Updated weights for policy 1, policy_version 1799503 (0.0005) [2023-12-26 14:03:33,848][123090] Updated weights for policy 1, policy_version 1799513 (0.0005) [2023-12-26 14:03:33,969][123091] Updated weights for policy 0, policy_version 1811290 (0.0010) [2023-12-26 14:03:34,017][123091] Updated weights for policy 0, policy_version 1811300 (0.0010) [2023-12-26 14:03:34,066][123091] Updated weights for policy 0, policy_version 1811310 (0.0009) [2023-12-26 14:03:34,521][123090] Updated weights for policy 1, policy_version 1799523 (0.0006) [2023-12-26 14:03:34,604][123090] Updated weights for policy 1, policy_version 1799533 (0.0006) [2023-12-26 14:03:34,671][123090] Updated weights for policy 1, policy_version 1799543 (0.0010) [2023-12-26 14:03:34,791][123091] Updated weights for policy 0, policy_version 1811320 (0.0009) [2023-12-26 14:03:34,851][123091] Updated weights for policy 0, policy_version 1811330 (0.0011) [2023-12-26 14:03:34,899][123091] Updated weights for policy 0, policy_version 1811340 (0.0010) [2023-12-26 14:03:35,329][123090] Updated weights for policy 1, policy_version 1799553 (0.0010) [2023-12-26 14:03:35,397][123090] Updated weights for policy 1, policy_version 1799563 (0.0007) [2023-12-26 14:03:35,456][123090] Updated weights for policy 1, policy_version 1799573 (0.0010) [2023-12-26 14:03:35,529][123090] Updated weights for policy 1, policy_version 1799583 (0.0010) [2023-12-26 14:03:35,713][123091] Updated weights for policy 0, policy_version 1811350 (0.0010) [2023-12-26 14:03:35,775][123091] Updated weights for policy 0, policy_version 1811360 (0.0009) [2023-12-26 14:03:35,818][123091] Updated weights for policy 0, policy_version 1811370 (0.0006) [2023-12-26 14:03:36,235][123090] Updated weights for policy 1, policy_version 1799593 (0.0011) [2023-12-26 14:03:36,304][123090] Updated weights for policy 1, policy_version 1799603 (0.0009) [2023-12-26 14:03:36,381][123090] Updated weights for policy 1, policy_version 1799613 (0.0007) [2023-12-26 14:03:36,632][123091] Updated weights for policy 0, policy_version 1811380 (0.0007) [2023-12-26 14:03:36,701][123091] Updated weights for policy 0, policy_version 1811390 (0.0006) [2023-12-26 14:03:36,774][123091] Updated weights for policy 0, policy_version 1811400 (0.0006) [2023-12-26 14:03:37,149][123090] Updated weights for policy 1, policy_version 1799623 (0.0011) [2023-12-26 14:03:37,209][123090] Updated weights for policy 1, policy_version 1799633 (0.0010) [2023-12-26 14:03:37,264][123090] Updated weights for policy 1, policy_version 1799643 (0.0010) [2023-12-26 14:03:37,468][123091] Updated weights for policy 0, policy_version 1811410 (0.0005) [2023-12-26 14:03:37,525][123091] Updated weights for policy 0, policy_version 1811420 (0.0007) [2023-12-26 14:03:37,586][123091] Updated weights for policy 0, policy_version 1811430 (0.0006) [2023-12-26 14:03:37,639][123091] Updated weights for policy 0, policy_version 1811440 (0.0006) [2023-12-26 14:03:38,018][123090] Updated weights for policy 1, policy_version 1799653 (0.0008) [2023-12-26 14:03:38,090][123090] Updated weights for policy 1, policy_version 1799663 (0.0005) [2023-12-26 14:03:38,154][123090] Updated weights for policy 1, policy_version 1799673 (0.0010) [2023-12-26 14:03:38,405][123091] Updated weights for policy 0, policy_version 1811450 (0.0006) [2023-12-26 14:03:38,476][123091] Updated weights for policy 0, policy_version 1811460 (0.0006) [2023-12-26 14:03:38,551][123091] Updated weights for policy 0, policy_version 1811470 (0.0008) [2023-12-26 14:03:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 924459008. Throughput: 0: 8980.8, 1: 8814.5. Samples: 924433012. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:38,785][121949] Avg episode reward: [(0, '6192.502'), (1, '5898.639')] [2023-12-26 14:03:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001811472_463740928.pth... [2023-12-26 14:03:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001799680_460718080.pth... [2023-12-26 14:03:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001810448_463478784.pth [2023-12-26 14:03:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001798656_460455936.pth [2023-12-26 14:03:38,887][123090] Updated weights for policy 1, policy_version 1799683 (0.0009) [2023-12-26 14:03:38,957][123090] Updated weights for policy 1, policy_version 1799693 (0.0006) [2023-12-26 14:03:39,019][123090] Updated weights for policy 1, policy_version 1799703 (0.0006) [2023-12-26 14:03:39,304][123091] Updated weights for policy 0, policy_version 1811480 (0.0011) [2023-12-26 14:03:39,378][123091] Updated weights for policy 0, policy_version 1811490 (0.0009) [2023-12-26 14:03:39,448][123091] Updated weights for policy 0, policy_version 1811500 (0.0008) [2023-12-26 14:03:39,779][123090] Updated weights for policy 1, policy_version 1799713 (0.0006) [2023-12-26 14:03:39,838][123090] Updated weights for policy 1, policy_version 1799723 (0.0011) [2023-12-26 14:03:39,905][123090] Updated weights for policy 1, policy_version 1799733 (0.0008) [2023-12-26 14:03:39,980][123090] Updated weights for policy 1, policy_version 1799743 (0.0008) [2023-12-26 14:03:40,292][123091] Updated weights for policy 0, policy_version 1811510 (0.0010) [2023-12-26 14:03:40,355][123091] Updated weights for policy 0, policy_version 1811520 (0.0011) [2023-12-26 14:03:40,419][123091] Updated weights for policy 0, policy_version 1811530 (0.0011) [2023-12-26 14:03:40,724][123090] Updated weights for policy 1, policy_version 1799753 (0.0006) [2023-12-26 14:03:40,771][123090] Updated weights for policy 1, policy_version 1799763 (0.0006) [2023-12-26 14:03:40,828][123090] Updated weights for policy 1, policy_version 1799773 (0.0008) [2023-12-26 14:03:41,247][123091] Updated weights for policy 0, policy_version 1811540 (0.0011) [2023-12-26 14:03:41,317][123091] Updated weights for policy 0, policy_version 1811550 (0.0010) [2023-12-26 14:03:41,387][123091] Updated weights for policy 0, policy_version 1811560 (0.0010) [2023-12-26 14:03:41,665][123090] Updated weights for policy 1, policy_version 1799783 (0.0009) [2023-12-26 14:03:41,752][123090] Updated weights for policy 1, policy_version 1799793 (0.0008) [2023-12-26 14:03:41,826][123090] Updated weights for policy 1, policy_version 1799803 (0.0010) [2023-12-26 14:03:42,226][123091] Updated weights for policy 0, policy_version 1811570 (0.0009) [2023-12-26 14:03:42,288][123091] Updated weights for policy 0, policy_version 1811580 (0.0010) [2023-12-26 14:03:42,346][123091] Updated weights for policy 0, policy_version 1811590 (0.0010) [2023-12-26 14:03:42,409][123091] Updated weights for policy 0, policy_version 1811600 (0.0007) [2023-12-26 14:03:42,642][123090] Updated weights for policy 1, policy_version 1799813 (0.0009) [2023-12-26 14:03:42,702][123090] Updated weights for policy 1, policy_version 1799823 (0.0009) [2023-12-26 14:03:42,756][123090] Updated weights for policy 1, policy_version 1799833 (0.0009) [2023-12-26 14:03:43,258][123091] Updated weights for policy 0, policy_version 1811610 (0.0009) [2023-12-26 14:03:43,307][123091] Updated weights for policy 0, policy_version 1811620 (0.0009) [2023-12-26 14:03:43,358][123091] Updated weights for policy 0, policy_version 1811630 (0.0008) [2023-12-26 14:03:43,605][123090] Updated weights for policy 1, policy_version 1799843 (0.0010) [2023-12-26 14:03:43,655][123090] Updated weights for policy 1, policy_version 1799853 (0.0009) [2023-12-26 14:03:43,706][123090] Updated weights for policy 1, policy_version 1799863 (0.0009) [2023-12-26 14:03:43,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 924549120. Throughput: 0: 8882.4, 1: 8837.2. Samples: 924539452. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:43,785][121949] Avg episode reward: [(0, '6193.014'), (1, '5676.794')] [2023-12-26 14:03:44,201][123091] Updated weights for policy 0, policy_version 1811640 (0.0010) [2023-12-26 14:03:44,262][123091] Updated weights for policy 0, policy_version 1811650 (0.0008) [2023-12-26 14:03:44,318][123091] Updated weights for policy 0, policy_version 1811660 (0.0010) [2023-12-26 14:03:44,523][123090] Updated weights for policy 1, policy_version 1799873 (0.0008) [2023-12-26 14:03:44,591][123090] Updated weights for policy 1, policy_version 1799883 (0.0007) [2023-12-26 14:03:44,659][123090] Updated weights for policy 1, policy_version 1799893 (0.0006) [2023-12-26 14:03:44,727][123090] Updated weights for policy 1, policy_version 1799903 (0.0005) [2023-12-26 14:03:45,107][123091] Updated weights for policy 0, policy_version 1811670 (0.0009) [2023-12-26 14:03:45,168][123091] Updated weights for policy 0, policy_version 1811680 (0.0010) [2023-12-26 14:03:45,236][123091] Updated weights for policy 0, policy_version 1811690 (0.0010) [2023-12-26 14:03:45,458][123090] Updated weights for policy 1, policy_version 1799913 (0.0007) [2023-12-26 14:03:45,518][123090] Updated weights for policy 1, policy_version 1799923 (0.0009) [2023-12-26 14:03:45,564][123090] Updated weights for policy 1, policy_version 1799933 (0.0009) [2023-12-26 14:03:46,148][123091] Updated weights for policy 0, policy_version 1811700 (0.0009) [2023-12-26 14:03:46,223][123091] Updated weights for policy 0, policy_version 1811710 (0.0010) [2023-12-26 14:03:46,246][123090] Updated weights for policy 1, policy_version 1799943 (0.0007) [2023-12-26 14:03:46,276][123091] Updated weights for policy 0, policy_version 1811720 (0.0009) [2023-12-26 14:03:46,304][123090] Updated weights for policy 1, policy_version 1799953 (0.0005) [2023-12-26 14:03:46,367][123090] Updated weights for policy 1, policy_version 1799963 (0.0005) [2023-12-26 14:03:46,939][123091] Updated weights for policy 0, policy_version 1811730 (0.0008) [2023-12-26 14:03:47,009][123091] Updated weights for policy 0, policy_version 1811740 (0.0005) [2023-12-26 14:03:47,077][123091] Updated weights for policy 0, policy_version 1811750 (0.0006) [2023-12-26 14:03:47,089][123090] Updated weights for policy 1, policy_version 1799973 (0.0005) [2023-12-26 14:03:47,136][123091] Updated weights for policy 0, policy_version 1811760 (0.0009) [2023-12-26 14:03:47,153][123090] Updated weights for policy 1, policy_version 1799983 (0.0008) [2023-12-26 14:03:47,214][123090] Updated weights for policy 1, policy_version 1799993 (0.0009) [2023-12-26 14:03:47,934][123091] Updated weights for policy 0, policy_version 1811770 (0.0010) [2023-12-26 14:03:47,966][123090] Updated weights for policy 1, policy_version 1800003 (0.0009) [2023-12-26 14:03:47,983][123091] Updated weights for policy 0, policy_version 1811780 (0.0007) [2023-12-26 14:03:48,024][123090] Updated weights for policy 1, policy_version 1800013 (0.0010) [2023-12-26 14:03:48,042][123091] Updated weights for policy 0, policy_version 1811790 (0.0008) [2023-12-26 14:03:48,073][123090] Updated weights for policy 1, policy_version 1800023 (0.0008) [2023-12-26 14:03:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 924631040. Throughput: 0: 8808.0, 1: 8913.0. Samples: 924646892. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:48,785][121949] Avg episode reward: [(0, '6218.000'), (1, '5714.870')] [2023-12-26 14:03:48,889][123091] Updated weights for policy 0, policy_version 1811800 (0.0010) [2023-12-26 14:03:48,915][123090] Updated weights for policy 1, policy_version 1800033 (0.0008) [2023-12-26 14:03:48,945][123091] Updated weights for policy 0, policy_version 1811810 (0.0009) [2023-12-26 14:03:48,981][123090] Updated weights for policy 1, policy_version 1800043 (0.0010) [2023-12-26 14:03:49,001][123091] Updated weights for policy 0, policy_version 1811820 (0.0006) [2023-12-26 14:03:49,042][123090] Updated weights for policy 1, policy_version 1800053 (0.0009) [2023-12-26 14:03:49,095][123090] Updated weights for policy 1, policy_version 1800063 (0.0009) [2023-12-26 14:03:49,839][123091] Updated weights for policy 0, policy_version 1811830 (0.0008) [2023-12-26 14:03:49,906][123091] Updated weights for policy 0, policy_version 1811840 (0.0008) [2023-12-26 14:03:49,914][123090] Updated weights for policy 1, policy_version 1800073 (0.0007) [2023-12-26 14:03:49,974][123091] Updated weights for policy 0, policy_version 1811850 (0.0009) [2023-12-26 14:03:49,990][123090] Updated weights for policy 1, policy_version 1800083 (0.0008) [2023-12-26 14:03:50,057][123090] Updated weights for policy 1, policy_version 1800093 (0.0009) [2023-12-26 14:03:50,808][123091] Updated weights for policy 0, policy_version 1811860 (0.0007) [2023-12-26 14:03:50,877][123091] Updated weights for policy 0, policy_version 1811870 (0.0008) [2023-12-26 14:03:50,883][123090] Updated weights for policy 1, policy_version 1800103 (0.0010) [2023-12-26 14:03:50,942][123091] Updated weights for policy 0, policy_version 1811880 (0.0009) [2023-12-26 14:03:50,945][123090] Updated weights for policy 1, policy_version 1800113 (0.0009) [2023-12-26 14:03:51,002][123090] Updated weights for policy 1, policy_version 1800123 (0.0008) [2023-12-26 14:03:51,713][123091] Updated weights for policy 0, policy_version 1811890 (0.0008) [2023-12-26 14:03:51,785][123091] Updated weights for policy 0, policy_version 1811900 (0.0010) [2023-12-26 14:03:51,818][123090] Updated weights for policy 1, policy_version 1800133 (0.0010) [2023-12-26 14:03:51,844][123091] Updated weights for policy 0, policy_version 1811910 (0.0011) [2023-12-26 14:03:51,874][123090] Updated weights for policy 1, policy_version 1800143 (0.0010) [2023-12-26 14:03:51,903][123091] Updated weights for policy 0, policy_version 1811920 (0.0011) [2023-12-26 14:03:51,937][123090] Updated weights for policy 1, policy_version 1800153 (0.0010) [2023-12-26 14:03:52,747][123091] Updated weights for policy 0, policy_version 1811930 (0.0011) [2023-12-26 14:03:52,790][123090] Updated weights for policy 1, policy_version 1800163 (0.0011) [2023-12-26 14:03:52,810][123091] Updated weights for policy 0, policy_version 1811940 (0.0011) [2023-12-26 14:03:52,847][123090] Updated weights for policy 1, policy_version 1800173 (0.0010) [2023-12-26 14:03:52,862][123091] Updated weights for policy 0, policy_version 1811950 (0.0010) [2023-12-26 14:03:52,910][123090] Updated weights for policy 1, policy_version 1800183 (0.0010) [2023-12-26 14:03:53,635][123091] Updated weights for policy 0, policy_version 1811960 (0.0010) [2023-12-26 14:03:53,685][123091] Updated weights for policy 0, policy_version 1811970 (0.0010) [2023-12-26 14:03:53,734][123090] Updated weights for policy 1, policy_version 1800193 (0.0010) [2023-12-26 14:03:53,736][123091] Updated weights for policy 0, policy_version 1811980 (0.0010) [2023-12-26 14:03:53,782][123090] Updated weights for policy 1, policy_version 1800203 (0.0010) [2023-12-26 14:03:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 924721152. Throughput: 0: 8724.4, 1: 8887.1. Samples: 924698252. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:53,785][121949] Avg episode reward: [(0, '6290.775'), (1, '5794.961')] [2023-12-26 14:03:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001811984_463872000.pth... [2023-12-26 14:03:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001810960_463609856.pth [2023-12-26 14:03:53,838][123090] Updated weights for policy 1, policy_version 1800213 (0.0009) [2023-12-26 14:03:53,886][123090] Updated weights for policy 1, policy_version 1800223 (0.0010) [2023-12-26 14:03:53,891][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001800224_460857344.pth... [2023-12-26 14:03:53,894][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001799168_460587008.pth [2023-12-26 14:03:54,579][123091] Updated weights for policy 0, policy_version 1811990 (0.0010) [2023-12-26 14:03:54,627][123090] Updated weights for policy 1, policy_version 1800233 (0.0007) [2023-12-26 14:03:54,633][123091] Updated weights for policy 0, policy_version 1812000 (0.0009) [2023-12-26 14:03:54,682][123090] Updated weights for policy 1, policy_version 1800243 (0.0007) [2023-12-26 14:03:54,691][123091] Updated weights for policy 0, policy_version 1812010 (0.0010) [2023-12-26 14:03:54,742][123090] Updated weights for policy 1, policy_version 1800253 (0.0008) [2023-12-26 14:03:55,526][123091] Updated weights for policy 0, policy_version 1812020 (0.0009) [2023-12-26 14:03:55,568][123090] Updated weights for policy 1, policy_version 1800263 (0.0008) [2023-12-26 14:03:55,576][123091] Updated weights for policy 0, policy_version 1812030 (0.0008) [2023-12-26 14:03:55,626][123090] Updated weights for policy 1, policy_version 1800273 (0.0008) [2023-12-26 14:03:55,629][123091] Updated weights for policy 0, policy_version 1812040 (0.0009) [2023-12-26 14:03:55,679][123090] Updated weights for policy 1, policy_version 1800283 (0.0009) [2023-12-26 14:03:56,382][123090] Updated weights for policy 1, policy_version 1800293 (0.0010) [2023-12-26 14:03:56,438][123090] Updated weights for policy 1, policy_version 1800303 (0.0010) [2023-12-26 14:03:56,475][123091] Updated weights for policy 0, policy_version 1812050 (0.0008) [2023-12-26 14:03:56,493][123090] Updated weights for policy 1, policy_version 1800313 (0.0010) [2023-12-26 14:03:56,534][123091] Updated weights for policy 0, policy_version 1812060 (0.0005) [2023-12-26 14:03:56,588][123091] Updated weights for policy 0, policy_version 1812070 (0.0008) [2023-12-26 14:03:56,639][123091] Updated weights for policy 0, policy_version 1812080 (0.0010) [2023-12-26 14:03:57,328][123090] Updated weights for policy 1, policy_version 1800323 (0.0009) [2023-12-26 14:03:57,383][123091] Updated weights for policy 0, policy_version 1812090 (0.0007) [2023-12-26 14:03:57,385][123090] Updated weights for policy 1, policy_version 1800333 (0.0007) [2023-12-26 14:03:57,438][123090] Updated weights for policy 1, policy_version 1800343 (0.0007) [2023-12-26 14:03:57,460][123091] Updated weights for policy 0, policy_version 1812100 (0.0005) [2023-12-26 14:03:57,528][123091] Updated weights for policy 0, policy_version 1812110 (0.0009) [2023-12-26 14:03:58,136][123090] Updated weights for policy 1, policy_version 1800353 (0.0006) [2023-12-26 14:03:58,156][123091] Updated weights for policy 0, policy_version 1812120 (0.0011) [2023-12-26 14:03:58,203][123090] Updated weights for policy 1, policy_version 1800363 (0.0007) [2023-12-26 14:03:58,223][123091] Updated weights for policy 0, policy_version 1812130 (0.0011) [2023-12-26 14:03:58,269][123090] Updated weights for policy 1, policy_version 1800373 (0.0006) [2023-12-26 14:03:58,285][123091] Updated weights for policy 0, policy_version 1812140 (0.0010) [2023-12-26 14:03:58,337][123090] Updated weights for policy 1, policy_version 1800383 (0.0009) [2023-12-26 14:03:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 924811264. Throughput: 0: 8710.0, 1: 8885.1. Samples: 924804020. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:03:58,785][121949] Avg episode reward: [(0, '6225.111'), (1, '5632.868')] [2023-12-26 14:03:59,126][123091] Updated weights for policy 0, policy_version 1812150 (0.0010) [2023-12-26 14:03:59,143][123090] Updated weights for policy 1, policy_version 1800393 (0.0006) [2023-12-26 14:03:59,188][123091] Updated weights for policy 0, policy_version 1812160 (0.0010) [2023-12-26 14:03:59,189][123090] Updated weights for policy 1, policy_version 1800403 (0.0005) [2023-12-26 14:03:59,248][123091] Updated weights for policy 0, policy_version 1812170 (0.0011) [2023-12-26 14:03:59,249][123090] Updated weights for policy 1, policy_version 1800413 (0.0007) [2023-12-26 14:04:00,000][123090] Updated weights for policy 1, policy_version 1800423 (0.0006) [2023-12-26 14:04:00,053][123091] Updated weights for policy 0, policy_version 1812180 (0.0008) [2023-12-26 14:04:00,055][123090] Updated weights for policy 1, policy_version 1800433 (0.0006) [2023-12-26 14:04:00,114][123090] Updated weights for policy 1, policy_version 1800443 (0.0007) [2023-12-26 14:04:00,118][123091] Updated weights for policy 0, policy_version 1812190 (0.0010) [2023-12-26 14:04:00,169][123091] Updated weights for policy 0, policy_version 1812200 (0.0010) [2023-12-26 14:04:00,886][123090] Updated weights for policy 1, policy_version 1800453 (0.0008) [2023-12-26 14:04:00,955][123090] Updated weights for policy 1, policy_version 1800463 (0.0005) [2023-12-26 14:04:00,978][123091] Updated weights for policy 0, policy_version 1812210 (0.0010) [2023-12-26 14:04:01,014][123090] Updated weights for policy 1, policy_version 1800473 (0.0008) [2023-12-26 14:04:01,039][123091] Updated weights for policy 0, policy_version 1812220 (0.0011) [2023-12-26 14:04:01,107][123091] Updated weights for policy 0, policy_version 1812230 (0.0011) [2023-12-26 14:04:01,175][123091] Updated weights for policy 0, policy_version 1812240 (0.0011) [2023-12-26 14:04:01,830][123090] Updated weights for policy 1, policy_version 1800483 (0.0007) [2023-12-26 14:04:01,891][123090] Updated weights for policy 1, policy_version 1800493 (0.0005) [2023-12-26 14:04:01,965][123090] Updated weights for policy 1, policy_version 1800503 (0.0007) [2023-12-26 14:04:02,049][123091] Updated weights for policy 0, policy_version 1812250 (0.0008) [2023-12-26 14:04:02,102][123091] Updated weights for policy 0, policy_version 1812260 (0.0010) [2023-12-26 14:04:02,154][123091] Updated weights for policy 0, policy_version 1812270 (0.0009) [2023-12-26 14:04:02,651][123090] Updated weights for policy 1, policy_version 1800513 (0.0009) [2023-12-26 14:04:02,697][123090] Updated weights for policy 1, policy_version 1800523 (0.0005) [2023-12-26 14:04:02,749][123090] Updated weights for policy 1, policy_version 1800533 (0.0005) [2023-12-26 14:04:02,809][123090] Updated weights for policy 1, policy_version 1800543 (0.0007) [2023-12-26 14:04:02,990][123091] Updated weights for policy 0, policy_version 1812280 (0.0006) [2023-12-26 14:04:03,057][123091] Updated weights for policy 0, policy_version 1812290 (0.0005) [2023-12-26 14:04:03,111][123091] Updated weights for policy 0, policy_version 1812300 (0.0005) [2023-12-26 14:04:03,478][123090] Updated weights for policy 1, policy_version 1800553 (0.0006) [2023-12-26 14:04:03,540][123090] Updated weights for policy 1, policy_version 1800563 (0.0005) [2023-12-26 14:04:03,597][123090] Updated weights for policy 1, policy_version 1800573 (0.0005) [2023-12-26 14:04:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 924901376. Throughput: 0: 8713.9, 1: 8960.9. Samples: 924913040. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:03,784][121949] Avg episode reward: [(0, '6187.535'), (1, '5706.951')] [2023-12-26 14:04:03,809][123091] Updated weights for policy 0, policy_version 1812310 (0.0008) [2023-12-26 14:04:03,877][123091] Updated weights for policy 0, policy_version 1812320 (0.0009) [2023-12-26 14:04:03,935][123091] Updated weights for policy 0, policy_version 1812330 (0.0009) [2023-12-26 14:04:04,340][123090] Updated weights for policy 1, policy_version 1800583 (0.0009) [2023-12-26 14:04:04,398][123090] Updated weights for policy 1, policy_version 1800593 (0.0010) [2023-12-26 14:04:04,469][123090] Updated weights for policy 1, policy_version 1800603 (0.0011) [2023-12-26 14:04:04,794][123091] Updated weights for policy 0, policy_version 1812340 (0.0009) [2023-12-26 14:04:04,873][123091] Updated weights for policy 0, policy_version 1812350 (0.0009) [2023-12-26 14:04:04,930][123091] Updated weights for policy 0, policy_version 1812361 (0.0010) [2023-12-26 14:04:05,188][123090] Updated weights for policy 1, policy_version 1800613 (0.0010) [2023-12-26 14:04:05,237][123090] Updated weights for policy 1, policy_version 1800623 (0.0009) [2023-12-26 14:04:05,293][123090] Updated weights for policy 1, policy_version 1800634 (0.0010) [2023-12-26 14:04:05,801][123091] Updated weights for policy 0, policy_version 1812371 (0.0010) [2023-12-26 14:04:05,854][123091] Updated weights for policy 0, policy_version 1812381 (0.0010) [2023-12-26 14:04:05,902][123091] Updated weights for policy 0, policy_version 1812392 (0.0009) [2023-12-26 14:04:06,090][123090] Updated weights for policy 1, policy_version 1800644 (0.0009) [2023-12-26 14:04:06,159][123090] Updated weights for policy 1, policy_version 1800655 (0.0008) [2023-12-26 14:04:06,225][123090] Updated weights for policy 1, policy_version 1800665 (0.0009) [2023-12-26 14:04:06,773][123091] Updated weights for policy 0, policy_version 1812403 (0.0010) [2023-12-26 14:04:06,845][123091] Updated weights for policy 0, policy_version 1812413 (0.0007) [2023-12-26 14:04:06,921][123091] Updated weights for policy 0, policy_version 1812423 (0.0005) [2023-12-26 14:04:07,078][123090] Updated weights for policy 1, policy_version 1800675 (0.0008) [2023-12-26 14:04:07,143][123090] Updated weights for policy 1, policy_version 1800685 (0.0008) [2023-12-26 14:04:07,208][123090] Updated weights for policy 1, policy_version 1800695 (0.0008) [2023-12-26 14:04:07,600][123091] Updated weights for policy 0, policy_version 1812433 (0.0005) [2023-12-26 14:04:07,650][123091] Updated weights for policy 0, policy_version 1812443 (0.0005) [2023-12-26 14:04:07,704][123091] Updated weights for policy 0, policy_version 1812453 (0.0006) [2023-12-26 14:04:07,770][123091] Updated weights for policy 0, policy_version 1812463 (0.0009) [2023-12-26 14:04:07,932][123090] Updated weights for policy 1, policy_version 1800705 (0.0009) [2023-12-26 14:04:07,982][123090] Updated weights for policy 1, policy_version 1800715 (0.0009) [2023-12-26 14:04:08,055][123090] Updated weights for policy 1, policy_version 1800725 (0.0006) [2023-12-26 14:04:08,133][123090] Updated weights for policy 1, policy_version 1800735 (0.0006) [2023-12-26 14:04:08,596][123091] Updated weights for policy 0, policy_version 1812473 (0.0010) [2023-12-26 14:04:08,648][123091] Updated weights for policy 0, policy_version 1812483 (0.0010) [2023-12-26 14:04:08,696][123091] Updated weights for policy 0, policy_version 1812493 (0.0010) [2023-12-26 14:04:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 924991488. Throughput: 0: 8713.6, 1: 9005.9. Samples: 924964928. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:08,785][121949] Avg episode reward: [(0, '6242.958'), (1, '5871.214')] [2023-12-26 14:04:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001812496_464003072.pth... [2023-12-26 14:04:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001811472_463740928.pth [2023-12-26 14:04:08,854][123090] Updated weights for policy 1, policy_version 1800745 (0.0008) [2023-12-26 14:04:08,917][123090] Updated weights for policy 1, policy_version 1800755 (0.0008) [2023-12-26 14:04:08,980][123090] Updated weights for policy 1, policy_version 1800765 (0.0009) [2023-12-26 14:04:08,993][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001800768_460996608.pth... [2023-12-26 14:04:08,996][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001799680_460718080.pth [2023-12-26 14:04:09,563][123091] Updated weights for policy 0, policy_version 1812503 (0.0007) [2023-12-26 14:04:09,625][123091] Updated weights for policy 0, policy_version 1812513 (0.0006) [2023-12-26 14:04:09,685][123091] Updated weights for policy 0, policy_version 1812523 (0.0006) [2023-12-26 14:04:09,854][123090] Updated weights for policy 1, policy_version 1800775 (0.0009) [2023-12-26 14:04:09,919][123090] Updated weights for policy 1, policy_version 1800785 (0.0009) [2023-12-26 14:04:09,973][123090] Updated weights for policy 1, policy_version 1800795 (0.0009) [2023-12-26 14:04:10,473][123091] Updated weights for policy 0, policy_version 1812533 (0.0007) [2023-12-26 14:04:10,536][123091] Updated weights for policy 0, policy_version 1812543 (0.0011) [2023-12-26 14:04:10,593][123091] Updated weights for policy 0, policy_version 1812553 (0.0008) [2023-12-26 14:04:10,844][123090] Updated weights for policy 1, policy_version 1800805 (0.0009) [2023-12-26 14:04:10,913][123090] Updated weights for policy 1, policy_version 1800815 (0.0009) [2023-12-26 14:04:10,977][123090] Updated weights for policy 1, policy_version 1800825 (0.0009) [2023-12-26 14:04:11,399][123091] Updated weights for policy 0, policy_version 1812563 (0.0006) [2023-12-26 14:04:11,463][123091] Updated weights for policy 0, policy_version 1812573 (0.0009) [2023-12-26 14:04:11,538][123091] Updated weights for policy 0, policy_version 1812583 (0.0006) [2023-12-26 14:04:11,817][123090] Updated weights for policy 1, policy_version 1800835 (0.0009) [2023-12-26 14:04:11,886][123090] Updated weights for policy 1, policy_version 1800845 (0.0009) [2023-12-26 14:04:11,960][123090] Updated weights for policy 1, policy_version 1800855 (0.0010) [2023-12-26 14:04:12,333][123091] Updated weights for policy 0, policy_version 1812593 (0.0007) [2023-12-26 14:04:12,406][123091] Updated weights for policy 0, policy_version 1812603 (0.0008) [2023-12-26 14:04:12,469][123091] Updated weights for policy 0, policy_version 1812613 (0.0010) [2023-12-26 14:04:12,538][123091] Updated weights for policy 0, policy_version 1812623 (0.0010) [2023-12-26 14:04:12,774][123090] Updated weights for policy 1, policy_version 1800865 (0.0010) [2023-12-26 14:04:12,833][123090] Updated weights for policy 1, policy_version 1800875 (0.0009) [2023-12-26 14:04:12,895][123090] Updated weights for policy 1, policy_version 1800885 (0.0009) [2023-12-26 14:04:12,959][123090] Updated weights for policy 1, policy_version 1800895 (0.0009) [2023-12-26 14:04:13,314][123091] Updated weights for policy 0, policy_version 1812633 (0.0010) [2023-12-26 14:04:13,379][123091] Updated weights for policy 0, policy_version 1812643 (0.0008) [2023-12-26 14:04:13,440][123091] Updated weights for policy 0, policy_version 1812653 (0.0010) [2023-12-26 14:04:13,763][123090] Updated weights for policy 1, policy_version 1800905 (0.0006) [2023-12-26 14:04:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 925073408. Throughput: 0: 8715.1, 1: 9008.6. Samples: 925069160. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:13,784][121949] Avg episode reward: [(0, '6223.871'), (1, '5585.225')] [2023-12-26 14:04:13,826][123090] Updated weights for policy 1, policy_version 1800915 (0.0005) [2023-12-26 14:04:13,890][123090] Updated weights for policy 1, policy_version 1800925 (0.0006) [2023-12-26 14:04:14,342][123091] Updated weights for policy 0, policy_version 1812663 (0.0009) [2023-12-26 14:04:14,403][123091] Updated weights for policy 0, policy_version 1812673 (0.0010) [2023-12-26 14:04:14,465][123091] Updated weights for policy 0, policy_version 1812683 (0.0009) [2023-12-26 14:04:14,567][123090] Updated weights for policy 1, policy_version 1800935 (0.0008) [2023-12-26 14:04:14,620][123090] Updated weights for policy 1, policy_version 1800945 (0.0009) [2023-12-26 14:04:14,667][123090] Updated weights for policy 1, policy_version 1800955 (0.0006) [2023-12-26 14:04:15,314][123091] Updated weights for policy 0, policy_version 1812693 (0.0010) [2023-12-26 14:04:15,373][123091] Updated weights for policy 0, policy_version 1812703 (0.0010) [2023-12-26 14:04:15,438][123091] Updated weights for policy 0, policy_version 1812713 (0.0010) [2023-12-26 14:04:15,489][123090] Updated weights for policy 1, policy_version 1800965 (0.0006) [2023-12-26 14:04:15,543][123090] Updated weights for policy 1, policy_version 1800975 (0.0010) [2023-12-26 14:04:15,593][123090] Updated weights for policy 1, policy_version 1800985 (0.0009) [2023-12-26 14:04:16,275][123091] Updated weights for policy 0, policy_version 1812723 (0.0009) [2023-12-26 14:04:16,327][123091] Updated weights for policy 0, policy_version 1812733 (0.0009) [2023-12-26 14:04:16,382][123091] Updated weights for policy 0, policy_version 1812743 (0.0008) [2023-12-26 14:04:16,444][123090] Updated weights for policy 1, policy_version 1800995 (0.0007) [2023-12-26 14:04:16,503][123090] Updated weights for policy 1, policy_version 1801005 (0.0005) [2023-12-26 14:04:16,553][123090] Updated weights for policy 1, policy_version 1801015 (0.0006) [2023-12-26 14:04:17,191][123091] Updated weights for policy 0, policy_version 1812753 (0.0009) [2023-12-26 14:04:17,265][123091] Updated weights for policy 0, policy_version 1812763 (0.0006) [2023-12-26 14:04:17,311][123091] Updated weights for policy 0, policy_version 1812773 (0.0005) [2023-12-26 14:04:17,358][123091] Updated weights for policy 0, policy_version 1812783 (0.0005) [2023-12-26 14:04:17,369][123090] Updated weights for policy 1, policy_version 1801025 (0.0009) [2023-12-26 14:04:17,424][123090] Updated weights for policy 1, policy_version 1801035 (0.0010) [2023-12-26 14:04:17,478][123090] Updated weights for policy 1, policy_version 1801045 (0.0009) [2023-12-26 14:04:17,533][123090] Updated weights for policy 1, policy_version 1801055 (0.0009) [2023-12-26 14:04:17,972][123091] Updated weights for policy 0, policy_version 1812793 (0.0005) [2023-12-26 14:04:18,019][123091] Updated weights for policy 0, policy_version 1812803 (0.0006) [2023-12-26 14:04:18,067][123091] Updated weights for policy 0, policy_version 1812813 (0.0005) [2023-12-26 14:04:18,461][123090] Updated weights for policy 1, policy_version 1801066 (0.0011) [2023-12-26 14:04:18,520][123090] Updated weights for policy 1, policy_version 1801076 (0.0010) [2023-12-26 14:04:18,583][123090] Updated weights for policy 1, policy_version 1801086 (0.0009) [2023-12-26 14:04:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 925163520. Throughput: 0: 8762.2, 1: 8986.3. Samples: 925175652. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:18,785][121949] Avg episode reward: [(0, '6316.428'), (1, '5795.949')] [2023-12-26 14:04:18,812][123091] Updated weights for policy 0, policy_version 1812823 (0.0009) [2023-12-26 14:04:18,870][123091] Updated weights for policy 0, policy_version 1812833 (0.0010) [2023-12-26 14:04:18,936][123091] Updated weights for policy 0, policy_version 1812843 (0.0011) [2023-12-26 14:04:19,511][123090] Updated weights for policy 1, policy_version 1801096 (0.0010) [2023-12-26 14:04:19,579][123090] Updated weights for policy 1, policy_version 1801106 (0.0008) [2023-12-26 14:04:19,644][123090] Updated weights for policy 1, policy_version 1801116 (0.0009) [2023-12-26 14:04:19,737][123091] Updated weights for policy 0, policy_version 1812853 (0.0010) [2023-12-26 14:04:19,801][123091] Updated weights for policy 0, policy_version 1812863 (0.0011) [2023-12-26 14:04:19,864][123091] Updated weights for policy 0, policy_version 1812873 (0.0008) [2023-12-26 14:04:20,414][123090] Updated weights for policy 1, policy_version 1801126 (0.0009) [2023-12-26 14:04:20,473][123090] Updated weights for policy 1, policy_version 1801136 (0.0010) [2023-12-26 14:04:20,533][123090] Updated weights for policy 1, policy_version 1801146 (0.0010) [2023-12-26 14:04:20,649][123091] Updated weights for policy 0, policy_version 1812883 (0.0009) [2023-12-26 14:04:20,720][123091] Updated weights for policy 0, policy_version 1812893 (0.0010) [2023-12-26 14:04:20,782][123091] Updated weights for policy 0, policy_version 1812903 (0.0010) [2023-12-26 14:04:21,475][123090] Updated weights for policy 1, policy_version 1801156 (0.0010) [2023-12-26 14:04:21,530][123090] Updated weights for policy 1, policy_version 1801166 (0.0010) [2023-12-26 14:04:21,577][123091] Updated weights for policy 0, policy_version 1812913 (0.0009) [2023-12-26 14:04:21,579][123090] Updated weights for policy 1, policy_version 1801176 (0.0009) [2023-12-26 14:04:21,644][123091] Updated weights for policy 0, policy_version 1812923 (0.0009) [2023-12-26 14:04:21,709][123091] Updated weights for policy 0, policy_version 1812933 (0.0011) [2023-12-26 14:04:21,769][123091] Updated weights for policy 0, policy_version 1812943 (0.0010) [2023-12-26 14:04:22,430][123090] Updated weights for policy 1, policy_version 1801187 (0.0009) [2023-12-26 14:04:22,491][123090] Updated weights for policy 1, policy_version 1801197 (0.0009) [2023-12-26 14:04:22,552][123090] Updated weights for policy 1, policy_version 1801207 (0.0009) [2023-12-26 14:04:22,620][123091] Updated weights for policy 0, policy_version 1812953 (0.0010) [2023-12-26 14:04:22,672][123091] Updated weights for policy 0, policy_version 1812963 (0.0011) [2023-12-26 14:04:22,736][123091] Updated weights for policy 0, policy_version 1812973 (0.0011) [2023-12-26 14:04:23,426][123090] Updated weights for policy 1, policy_version 1801217 (0.0008) [2023-12-26 14:04:23,498][123090] Updated weights for policy 1, policy_version 1801227 (0.0009) [2023-12-26 14:04:23,526][123091] Updated weights for policy 0, policy_version 1812983 (0.0007) [2023-12-26 14:04:23,551][123090] Updated weights for policy 1, policy_version 1801237 (0.0009) [2023-12-26 14:04:23,593][123091] Updated weights for policy 0, policy_version 1812993 (0.0006) [2023-12-26 14:04:23,617][123090] Updated weights for policy 1, policy_version 1801247 (0.0008) [2023-12-26 14:04:23,655][123091] Updated weights for policy 0, policy_version 1813003 (0.0006) [2023-12-26 14:04:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 925253632. Throughput: 0: 8751.3, 1: 8888.6. Samples: 925226812. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:23,785][121949] Avg episode reward: [(0, '6282.378'), (1, '5912.742')] [2023-12-26 14:04:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001801248_461119488.pth... [2023-12-26 14:04:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001813008_464134144.pth... [2023-12-26 14:04:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001800224_460857344.pth [2023-12-26 14:04:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001811984_463872000.pth [2023-12-26 14:04:24,294][123091] Updated weights for policy 0, policy_version 1813013 (0.0008) [2023-12-26 14:04:24,352][123091] Updated weights for policy 0, policy_version 1813023 (0.0010) [2023-12-26 14:04:24,415][123091] Updated weights for policy 0, policy_version 1813033 (0.0010) [2023-12-26 14:04:24,477][123090] Updated weights for policy 1, policy_version 1801257 (0.0006) [2023-12-26 14:04:24,530][123090] Updated weights for policy 1, policy_version 1801267 (0.0006) [2023-12-26 14:04:24,579][123090] Updated weights for policy 1, policy_version 1801277 (0.0007) [2023-12-26 14:04:25,110][123091] Updated weights for policy 0, policy_version 1813043 (0.0006) [2023-12-26 14:04:25,171][123091] Updated weights for policy 0, policy_version 1813053 (0.0005) [2023-12-26 14:04:25,231][123091] Updated weights for policy 0, policy_version 1813063 (0.0005) [2023-12-26 14:04:25,453][123090] Updated weights for policy 1, policy_version 1801287 (0.0008) [2023-12-26 14:04:25,523][123090] Updated weights for policy 1, policy_version 1801297 (0.0010) [2023-12-26 14:04:25,584][123090] Updated weights for policy 1, policy_version 1801307 (0.0010) [2023-12-26 14:04:25,827][123091] Updated weights for policy 0, policy_version 1813073 (0.0005) [2023-12-26 14:04:25,883][123091] Updated weights for policy 0, policy_version 1813083 (0.0005) [2023-12-26 14:04:25,935][123091] Updated weights for policy 0, policy_version 1813093 (0.0005) [2023-12-26 14:04:25,983][123091] Updated weights for policy 0, policy_version 1813103 (0.0006) [2023-12-26 14:04:26,395][123090] Updated weights for policy 1, policy_version 1801317 (0.0007) [2023-12-26 14:04:26,452][123090] Updated weights for policy 1, policy_version 1801327 (0.0005) [2023-12-26 14:04:26,499][123090] Updated weights for policy 1, policy_version 1801337 (0.0005) [2023-12-26 14:04:26,725][123091] Updated weights for policy 0, policy_version 1813113 (0.0005) [2023-12-26 14:04:26,778][123091] Updated weights for policy 0, policy_version 1813123 (0.0005) [2023-12-26 14:04:26,836][123091] Updated weights for policy 0, policy_version 1813133 (0.0005) [2023-12-26 14:04:27,307][123090] Updated weights for policy 1, policy_version 1801347 (0.0006) [2023-12-26 14:04:27,369][123090] Updated weights for policy 1, policy_version 1801357 (0.0007) [2023-12-26 14:04:27,417][123090] Updated weights for policy 1, policy_version 1801367 (0.0005) [2023-12-26 14:04:27,470][123091] Updated weights for policy 0, policy_version 1813143 (0.0011) [2023-12-26 14:04:27,535][123091] Updated weights for policy 0, policy_version 1813153 (0.0010) [2023-12-26 14:04:27,586][123091] Updated weights for policy 0, policy_version 1813163 (0.0010) [2023-12-26 14:04:28,172][123090] Updated weights for policy 1, policy_version 1801377 (0.0006) [2023-12-26 14:04:28,224][123090] Updated weights for policy 1, policy_version 1801387 (0.0010) [2023-12-26 14:04:28,287][123090] Updated weights for policy 1, policy_version 1801398 (0.0010) [2023-12-26 14:04:28,346][123090] Updated weights for policy 1, policy_version 1801408 (0.0009) [2023-12-26 14:04:28,376][123091] Updated weights for policy 0, policy_version 1813173 (0.0009) [2023-12-26 14:04:28,444][123091] Updated weights for policy 0, policy_version 1813183 (0.0010) [2023-12-26 14:04:28,491][123091] Updated weights for policy 0, policy_version 1813193 (0.0010) [2023-12-26 14:04:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 925343744. Throughput: 0: 8879.2, 1: 8829.3. Samples: 925336328. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:28,785][121949] Avg episode reward: [(0, '6054.334'), (1, '5846.751')] [2023-12-26 14:04:29,164][123090] Updated weights for policy 1, policy_version 1801418 (0.0010) [2023-12-26 14:04:29,246][123090] Updated weights for policy 1, policy_version 1801428 (0.0009) [2023-12-26 14:04:29,276][123091] Updated weights for policy 0, policy_version 1813203 (0.0009) [2023-12-26 14:04:29,315][123090] Updated weights for policy 1, policy_version 1801438 (0.0009) [2023-12-26 14:04:29,347][123091] Updated weights for policy 0, policy_version 1813213 (0.0009) [2023-12-26 14:04:29,412][123091] Updated weights for policy 0, policy_version 1813223 (0.0009) [2023-12-26 14:04:30,117][123090] Updated weights for policy 1, policy_version 1801448 (0.0008) [2023-12-26 14:04:30,169][123090] Updated weights for policy 1, policy_version 1801458 (0.0008) [2023-12-26 14:04:30,221][123090] Updated weights for policy 1, policy_version 1801468 (0.0008) [2023-12-26 14:04:30,238][123091] Updated weights for policy 0, policy_version 1813233 (0.0010) [2023-12-26 14:04:30,297][123091] Updated weights for policy 0, policy_version 1813243 (0.0010) [2023-12-26 14:04:30,356][123091] Updated weights for policy 0, policy_version 1813253 (0.0006) [2023-12-26 14:04:30,414][123091] Updated weights for policy 0, policy_version 1813263 (0.0005) [2023-12-26 14:04:31,082][123090] Updated weights for policy 1, policy_version 1801478 (0.0009) [2023-12-26 14:04:31,144][123090] Updated weights for policy 1, policy_version 1801488 (0.0009) [2023-12-26 14:04:31,157][123091] Updated weights for policy 0, policy_version 1813273 (0.0009) [2023-12-26 14:04:31,207][123090] Updated weights for policy 1, policy_version 1801498 (0.0006) [2023-12-26 14:04:31,221][123091] Updated weights for policy 0, policy_version 1813283 (0.0011) [2023-12-26 14:04:31,278][123091] Updated weights for policy 0, policy_version 1813293 (0.0011) [2023-12-26 14:04:31,990][123090] Updated weights for policy 1, policy_version 1801508 (0.0007) [2023-12-26 14:04:32,019][123091] Updated weights for policy 0, policy_version 1813303 (0.0009) [2023-12-26 14:04:32,048][123090] Updated weights for policy 1, policy_version 1801518 (0.0007) [2023-12-26 14:04:32,080][123091] Updated weights for policy 0, policy_version 1813313 (0.0009) [2023-12-26 14:04:32,107][123090] Updated weights for policy 1, policy_version 1801528 (0.0009) [2023-12-26 14:04:32,138][123091] Updated weights for policy 0, policy_version 1813323 (0.0006) [2023-12-26 14:04:32,891][123091] Updated weights for policy 0, policy_version 1813333 (0.0007) [2023-12-26 14:04:32,948][123090] Updated weights for policy 1, policy_version 1801538 (0.0010) [2023-12-26 14:04:32,951][123091] Updated weights for policy 0, policy_version 1813343 (0.0008) [2023-12-26 14:04:32,997][123090] Updated weights for policy 1, policy_version 1801548 (0.0010) [2023-12-26 14:04:33,012][123091] Updated weights for policy 0, policy_version 1813353 (0.0006) [2023-12-26 14:04:33,053][123090] Updated weights for policy 1, policy_version 1801558 (0.0011) [2023-12-26 14:04:33,105][123090] Updated weights for policy 1, policy_version 1801568 (0.0010) [2023-12-26 14:04:33,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 925425664. Throughput: 0: 8939.1, 1: 8749.2. Samples: 925442864. Policy #0 lag: (min: 31.0, avg: 40.5, max: 63.0) [2023-12-26 14:04:33,785][121949] Avg episode reward: [(0, '6134.206'), (1, '5735.478')] [2023-12-26 14:04:33,800][123090] Updated weights for policy 1, policy_version 1801578 (0.0006) [2023-12-26 14:04:33,846][123091] Updated weights for policy 0, policy_version 1813363 (0.0006) [2023-12-26 14:04:33,861][123090] Updated weights for policy 1, policy_version 1801588 (0.0006) [2023-12-26 14:04:33,905][123091] Updated weights for policy 0, policy_version 1813373 (0.0008) [2023-12-26 14:04:33,912][123090] Updated weights for policy 1, policy_version 1801598 (0.0006) [2023-12-26 14:04:33,964][123091] Updated weights for policy 0, policy_version 1813383 (0.0010) [2023-12-26 14:04:34,667][123090] Updated weights for policy 1, policy_version 1801608 (0.0006) [2023-12-26 14:04:34,745][123090] Updated weights for policy 1, policy_version 1801618 (0.0006) [2023-12-26 14:04:34,773][123091] Updated weights for policy 0, policy_version 1813393 (0.0010) [2023-12-26 14:04:34,810][123090] Updated weights for policy 1, policy_version 1801628 (0.0007) [2023-12-26 14:04:34,834][123091] Updated weights for policy 0, policy_version 1813403 (0.0006) [2023-12-26 14:04:34,896][123091] Updated weights for policy 0, policy_version 1813413 (0.0009) [2023-12-26 14:04:34,960][123091] Updated weights for policy 0, policy_version 1813423 (0.0006) [2023-12-26 14:04:35,577][123090] Updated weights for policy 1, policy_version 1801638 (0.0008) [2023-12-26 14:04:35,627][123090] Updated weights for policy 1, policy_version 1801648 (0.0006) [2023-12-26 14:04:35,664][123091] Updated weights for policy 0, policy_version 1813433 (0.0010) [2023-12-26 14:04:35,683][123090] Updated weights for policy 1, policy_version 1801658 (0.0006) [2023-12-26 14:04:35,723][123091] Updated weights for policy 0, policy_version 1813443 (0.0010) [2023-12-26 14:04:35,784][123091] Updated weights for policy 0, policy_version 1813453 (0.0010) [2023-12-26 14:04:36,417][123090] Updated weights for policy 1, policy_version 1801668 (0.0009) [2023-12-26 14:04:36,479][123090] Updated weights for policy 1, policy_version 1801678 (0.0006) [2023-12-26 14:04:36,547][123090] Updated weights for policy 1, policy_version 1801688 (0.0006) [2023-12-26 14:04:36,628][123091] Updated weights for policy 0, policy_version 1813463 (0.0007) [2023-12-26 14:04:36,684][123091] Updated weights for policy 0, policy_version 1813473 (0.0005) [2023-12-26 14:04:36,739][123091] Updated weights for policy 0, policy_version 1813483 (0.0005) [2023-12-26 14:04:37,327][123090] Updated weights for policy 1, policy_version 1801698 (0.0010) [2023-12-26 14:04:37,389][123090] Updated weights for policy 1, policy_version 1801708 (0.0010) [2023-12-26 14:04:37,437][123090] Updated weights for policy 1, policy_version 1801718 (0.0010) [2023-12-26 14:04:37,489][123090] Updated weights for policy 1, policy_version 1801728 (0.0010) [2023-12-26 14:04:37,519][123091] Updated weights for policy 0, policy_version 1813493 (0.0009) [2023-12-26 14:04:37,573][123091] Updated weights for policy 0, policy_version 1813503 (0.0005) [2023-12-26 14:04:37,628][123091] Updated weights for policy 0, policy_version 1813513 (0.0006) [2023-12-26 14:04:38,306][123091] Updated weights for policy 0, policy_version 1813523 (0.0005) [2023-12-26 14:04:38,353][123090] Updated weights for policy 1, policy_version 1801738 (0.0011) [2023-12-26 14:04:38,382][123091] Updated weights for policy 0, policy_version 1813533 (0.0008) [2023-12-26 14:04:38,423][123090] Updated weights for policy 1, policy_version 1801748 (0.0010) [2023-12-26 14:04:38,442][123091] Updated weights for policy 0, policy_version 1813543 (0.0006) [2023-12-26 14:04:38,491][123090] Updated weights for policy 1, policy_version 1801758 (0.0011) [2023-12-26 14:04:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 925523968. Throughput: 0: 8956.9, 1: 8796.4. Samples: 925497148. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:04:38,785][121949] Avg episode reward: [(0, '6244.095'), (1, '5851.681')] [2023-12-26 14:04:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001813552_464273408.pth... [2023-12-26 14:04:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001801760_461250560.pth... [2023-12-26 14:04:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001800768_460996608.pth [2023-12-26 14:04:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001812496_464003072.pth [2023-12-26 14:04:39,191][123091] Updated weights for policy 0, policy_version 1813553 (0.0007) [2023-12-26 14:04:39,259][123091] Updated weights for policy 0, policy_version 1813563 (0.0011) [2023-12-26 14:04:39,317][123091] Updated weights for policy 0, policy_version 1813573 (0.0009) [2023-12-26 14:04:39,341][123090] Updated weights for policy 1, policy_version 1801768 (0.0008) [2023-12-26 14:04:39,384][123091] Updated weights for policy 0, policy_version 1813583 (0.0009) [2023-12-26 14:04:39,424][123090] Updated weights for policy 1, policy_version 1801779 (0.0010) [2023-12-26 14:04:39,494][123090] Updated weights for policy 1, policy_version 1801789 (0.0006) [2023-12-26 14:04:40,227][123091] Updated weights for policy 0, policy_version 1813593 (0.0007) [2023-12-26 14:04:40,228][123090] Updated weights for policy 1, policy_version 1801799 (0.0005) [2023-12-26 14:04:40,293][123091] Updated weights for policy 0, policy_version 1813603 (0.0007) [2023-12-26 14:04:40,298][123090] Updated weights for policy 1, policy_version 1801809 (0.0009) [2023-12-26 14:04:40,352][123090] Updated weights for policy 1, policy_version 1801819 (0.0009) [2023-12-26 14:04:40,356][123091] Updated weights for policy 0, policy_version 1813613 (0.0008) [2023-12-26 14:04:41,148][123091] Updated weights for policy 0, policy_version 1813623 (0.0008) [2023-12-26 14:04:41,157][123090] Updated weights for policy 1, policy_version 1801829 (0.0008) [2023-12-26 14:04:41,216][123091] Updated weights for policy 0, policy_version 1813633 (0.0008) [2023-12-26 14:04:41,219][123090] Updated weights for policy 1, policy_version 1801839 (0.0008) [2023-12-26 14:04:41,281][123091] Updated weights for policy 0, policy_version 1813643 (0.0007) [2023-12-26 14:04:41,283][123090] Updated weights for policy 1, policy_version 1801849 (0.0010) [2023-12-26 14:04:42,122][123091] Updated weights for policy 0, policy_version 1813653 (0.0009) [2023-12-26 14:04:42,169][123090] Updated weights for policy 1, policy_version 1801859 (0.0009) [2023-12-26 14:04:42,189][123091] Updated weights for policy 0, policy_version 1813663 (0.0008) [2023-12-26 14:04:42,227][123090] Updated weights for policy 1, policy_version 1801869 (0.0007) [2023-12-26 14:04:42,242][123091] Updated weights for policy 0, policy_version 1813673 (0.0009) [2023-12-26 14:04:42,294][123090] Updated weights for policy 1, policy_version 1801879 (0.0008) [2023-12-26 14:04:43,067][123091] Updated weights for policy 0, policy_version 1813683 (0.0010) [2023-12-26 14:04:43,069][123090] Updated weights for policy 1, policy_version 1801889 (0.0008) [2023-12-26 14:04:43,130][123091] Updated weights for policy 0, policy_version 1813693 (0.0007) [2023-12-26 14:04:43,135][123090] Updated weights for policy 1, policy_version 1801899 (0.0008) [2023-12-26 14:04:43,187][123090] Updated weights for policy 1, policy_version 1801909 (0.0008) [2023-12-26 14:04:43,191][123091] Updated weights for policy 0, policy_version 1813703 (0.0007) [2023-12-26 14:04:43,242][123090] Updated weights for policy 1, policy_version 1801919 (0.0008) [2023-12-26 14:04:43,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 925605888. Throughput: 0: 8967.3, 1: 8759.9. Samples: 925601744. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:04:43,785][121949] Avg episode reward: [(0, '6270.348'), (1, '5814.993')] [2023-12-26 14:04:43,999][123091] Updated weights for policy 0, policy_version 1813713 (0.0005) [2023-12-26 14:04:44,050][123091] Updated weights for policy 0, policy_version 1813723 (0.0005) [2023-12-26 14:04:44,082][123090] Updated weights for policy 1, policy_version 1801929 (0.0009) [2023-12-26 14:04:44,102][123091] Updated weights for policy 0, policy_version 1813733 (0.0005) [2023-12-26 14:04:44,145][123090] Updated weights for policy 1, policy_version 1801939 (0.0008) [2023-12-26 14:04:44,167][123091] Updated weights for policy 0, policy_version 1813743 (0.0006) [2023-12-26 14:04:44,204][123090] Updated weights for policy 1, policy_version 1801949 (0.0010) [2023-12-26 14:04:44,898][123091] Updated weights for policy 0, policy_version 1813753 (0.0010) [2023-12-26 14:04:44,965][123091] Updated weights for policy 0, policy_version 1813763 (0.0011) [2023-12-26 14:04:45,050][123091] Updated weights for policy 0, policy_version 1813773 (0.0011) [2023-12-26 14:04:45,055][123090] Updated weights for policy 1, policy_version 1801959 (0.0010) [2023-12-26 14:04:45,121][123090] Updated weights for policy 1, policy_version 1801969 (0.0010) [2023-12-26 14:04:45,180][123090] Updated weights for policy 1, policy_version 1801979 (0.0010) [2023-12-26 14:04:45,753][123091] Updated weights for policy 0, policy_version 1813783 (0.0007) [2023-12-26 14:04:45,820][123091] Updated weights for policy 0, policy_version 1813793 (0.0009) [2023-12-26 14:04:45,880][123091] Updated weights for policy 0, policy_version 1813803 (0.0009) [2023-12-26 14:04:46,084][123090] Updated weights for policy 1, policy_version 1801989 (0.0010) [2023-12-26 14:04:46,131][123090] Updated weights for policy 1, policy_version 1801999 (0.0008) [2023-12-26 14:04:46,179][123090] Updated weights for policy 1, policy_version 1802009 (0.0008) [2023-12-26 14:04:46,648][123091] Updated weights for policy 0, policy_version 1813813 (0.0010) [2023-12-26 14:04:46,700][123091] Updated weights for policy 0, policy_version 1813823 (0.0010) [2023-12-26 14:04:46,762][123091] Updated weights for policy 0, policy_version 1813833 (0.0010) [2023-12-26 14:04:47,063][123090] Updated weights for policy 1, policy_version 1802019 (0.0009) [2023-12-26 14:04:47,118][123090] Updated weights for policy 1, policy_version 1802030 (0.0010) [2023-12-26 14:04:47,175][123090] Updated weights for policy 1, policy_version 1802040 (0.0010) [2023-12-26 14:04:47,488][123091] Updated weights for policy 0, policy_version 1813843 (0.0009) [2023-12-26 14:04:47,545][123091] Updated weights for policy 0, policy_version 1813853 (0.0005) [2023-12-26 14:04:47,598][123091] Updated weights for policy 0, policy_version 1813863 (0.0005) [2023-12-26 14:04:48,130][123090] Updated weights for policy 1, policy_version 1802050 (0.0009) [2023-12-26 14:04:48,169][123091] Updated weights for policy 0, policy_version 1813873 (0.0005) [2023-12-26 14:04:48,198][123090] Updated weights for policy 1, policy_version 1802060 (0.0009) [2023-12-26 14:04:48,228][123091] Updated weights for policy 0, policy_version 1813883 (0.0008) [2023-12-26 14:04:48,260][123090] Updated weights for policy 1, policy_version 1802070 (0.0005) [2023-12-26 14:04:48,279][123091] Updated weights for policy 0, policy_version 1813893 (0.0010) [2023-12-26 14:04:48,317][123090] Updated weights for policy 1, policy_version 1802080 (0.0006) [2023-12-26 14:04:48,327][123091] Updated weights for policy 0, policy_version 1813903 (0.0010) [2023-12-26 14:04:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 925696000. Throughput: 0: 9032.6, 1: 8615.1. Samples: 925707188. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:04:48,785][121949] Avg episode reward: [(0, '6337.544'), (1, '5601.611')] [2023-12-26 14:04:49,134][123091] Updated weights for policy 0, policy_version 1813913 (0.0010) [2023-12-26 14:04:49,196][123091] Updated weights for policy 0, policy_version 1813923 (0.0009) [2023-12-26 14:04:49,205][123090] Updated weights for policy 1, policy_version 1802090 (0.0009) [2023-12-26 14:04:49,261][123091] Updated weights for policy 0, policy_version 1813933 (0.0009) [2023-12-26 14:04:49,274][123090] Updated weights for policy 1, policy_version 1802100 (0.0007) [2023-12-26 14:04:49,342][123090] Updated weights for policy 1, policy_version 1802110 (0.0008) [2023-12-26 14:04:50,120][123091] Updated weights for policy 0, policy_version 1813943 (0.0009) [2023-12-26 14:04:50,127][123090] Updated weights for policy 1, policy_version 1802120 (0.0008) [2023-12-26 14:04:50,179][123090] Updated weights for policy 1, policy_version 1802130 (0.0006) [2023-12-26 14:04:50,183][123091] Updated weights for policy 0, policy_version 1813953 (0.0009) [2023-12-26 14:04:50,232][123090] Updated weights for policy 1, policy_version 1802140 (0.0008) [2023-12-26 14:04:50,240][123091] Updated weights for policy 0, policy_version 1813963 (0.0008) [2023-12-26 14:04:51,016][123091] Updated weights for policy 0, policy_version 1813973 (0.0008) [2023-12-26 14:04:51,083][123091] Updated weights for policy 0, policy_version 1813983 (0.0006) [2023-12-26 14:04:51,116][123090] Updated weights for policy 1, policy_version 1802150 (0.0007) [2023-12-26 14:04:51,153][123091] Updated weights for policy 0, policy_version 1813993 (0.0007) [2023-12-26 14:04:51,184][123090] Updated weights for policy 1, policy_version 1802160 (0.0009) [2023-12-26 14:04:51,254][123090] Updated weights for policy 1, policy_version 1802170 (0.0010) [2023-12-26 14:04:51,960][123091] Updated weights for policy 0, policy_version 1814003 (0.0008) [2023-12-26 14:04:52,027][123091] Updated weights for policy 0, policy_version 1814013 (0.0011) [2023-12-26 14:04:52,095][123091] Updated weights for policy 0, policy_version 1814023 (0.0011) [2023-12-26 14:04:52,115][123090] Updated weights for policy 1, policy_version 1802180 (0.0008) [2023-12-26 14:04:52,180][123090] Updated weights for policy 1, policy_version 1802190 (0.0007) [2023-12-26 14:04:52,249][123090] Updated weights for policy 1, policy_version 1802200 (0.0009) [2023-12-26 14:04:52,940][123091] Updated weights for policy 0, policy_version 1814033 (0.0011) [2023-12-26 14:04:52,991][123091] Updated weights for policy 0, policy_version 1814043 (0.0010) [2023-12-26 14:04:53,051][123091] Updated weights for policy 0, policy_version 1814053 (0.0011) [2023-12-26 14:04:53,082][123090] Updated weights for policy 1, policy_version 1802210 (0.0008) [2023-12-26 14:04:53,113][123091] Updated weights for policy 0, policy_version 1814063 (0.0011) [2023-12-26 14:04:53,142][123090] Updated weights for policy 1, policy_version 1802220 (0.0006) [2023-12-26 14:04:53,194][123090] Updated weights for policy 1, policy_version 1802230 (0.0008) [2023-12-26 14:04:53,243][123090] Updated weights for policy 1, policy_version 1802240 (0.0009) [2023-12-26 14:04:53,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 925777920. Throughput: 0: 9076.0, 1: 8554.3. Samples: 925758292. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:04:53,785][121949] Avg episode reward: [(0, '6334.728'), (1, '5307.140')] [2023-12-26 14:04:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001814064_464404480.pth... [2023-12-26 14:04:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001802240_461373440.pth... [2023-12-26 14:04:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001801248_461119488.pth [2023-12-26 14:04:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001813008_464134144.pth [2023-12-26 14:04:53,901][123091] Updated weights for policy 0, policy_version 1814073 (0.0010) [2023-12-26 14:04:53,944][123091] Updated weights for policy 0, policy_version 1814083 (0.0010) [2023-12-26 14:04:53,996][123091] Updated weights for policy 0, policy_version 1814093 (0.0010) [2023-12-26 14:04:54,110][123090] Updated weights for policy 1, policy_version 1802250 (0.0009) [2023-12-26 14:04:54,174][123090] Updated weights for policy 1, policy_version 1802260 (0.0009) [2023-12-26 14:04:54,235][123090] Updated weights for policy 1, policy_version 1802271 (0.0010) [2023-12-26 14:04:54,759][123091] Updated weights for policy 0, policy_version 1814103 (0.0010) [2023-12-26 14:04:54,828][123091] Updated weights for policy 0, policy_version 1814113 (0.0007) [2023-12-26 14:04:54,896][123091] Updated weights for policy 0, policy_version 1814123 (0.0005) [2023-12-26 14:04:55,129][123090] Updated weights for policy 1, policy_version 1802281 (0.0006) [2023-12-26 14:04:55,178][123090] Updated weights for policy 1, policy_version 1802291 (0.0005) [2023-12-26 14:04:55,246][123090] Updated weights for policy 1, policy_version 1802301 (0.0005) [2023-12-26 14:04:55,511][123091] Updated weights for policy 0, policy_version 1814133 (0.0006) [2023-12-26 14:04:55,579][123091] Updated weights for policy 0, policy_version 1814143 (0.0006) [2023-12-26 14:04:55,641][123091] Updated weights for policy 0, policy_version 1814153 (0.0006) [2023-12-26 14:04:55,941][123090] Updated weights for policy 1, policy_version 1802311 (0.0005) [2023-12-26 14:04:55,997][123090] Updated weights for policy 1, policy_version 1802321 (0.0005) [2023-12-26 14:04:56,048][123090] Updated weights for policy 1, policy_version 1802331 (0.0005) [2023-12-26 14:04:56,405][123091] Updated weights for policy 0, policy_version 1814163 (0.0006) [2023-12-26 14:04:56,455][123091] Updated weights for policy 0, policy_version 1814173 (0.0005) [2023-12-26 14:04:56,511][123091] Updated weights for policy 0, policy_version 1814183 (0.0005) [2023-12-26 14:04:56,763][123090] Updated weights for policy 1, policy_version 1802341 (0.0008) [2023-12-26 14:04:56,815][123090] Updated weights for policy 1, policy_version 1802351 (0.0010) [2023-12-26 14:04:56,874][123090] Updated weights for policy 1, policy_version 1802361 (0.0010) [2023-12-26 14:04:57,200][123091] Updated weights for policy 0, policy_version 1814193 (0.0006) [2023-12-26 14:04:57,248][123091] Updated weights for policy 0, policy_version 1814203 (0.0008) [2023-12-26 14:04:57,300][123091] Updated weights for policy 0, policy_version 1814213 (0.0008) [2023-12-26 14:04:57,365][123091] Updated weights for policy 0, policy_version 1814223 (0.0008) [2023-12-26 14:04:57,645][123090] Updated weights for policy 1, policy_version 1802371 (0.0009) [2023-12-26 14:04:57,696][123090] Updated weights for policy 1, policy_version 1802381 (0.0005) [2023-12-26 14:04:57,761][123090] Updated weights for policy 1, policy_version 1802391 (0.0005) [2023-12-26 14:04:58,221][123091] Updated weights for policy 0, policy_version 1814233 (0.0010) [2023-12-26 14:04:58,281][123091] Updated weights for policy 0, policy_version 1814243 (0.0009) [2023-12-26 14:04:58,347][123091] Updated weights for policy 0, policy_version 1814253 (0.0009) [2023-12-26 14:04:58,512][123090] Updated weights for policy 1, policy_version 1802401 (0.0007) [2023-12-26 14:04:58,582][123090] Updated weights for policy 1, policy_version 1802411 (0.0010) [2023-12-26 14:04:58,656][123090] Updated weights for policy 1, policy_version 1802421 (0.0010) [2023-12-26 14:04:58,731][123090] Updated weights for policy 1, policy_version 1802431 (0.0009) [2023-12-26 14:04:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 925876224. Throughput: 0: 9131.7, 1: 8608.4. Samples: 925867464. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:04:58,785][121949] Avg episode reward: [(0, '6175.067'), (1, '5429.357')] [2023-12-26 14:04:59,313][123091] Updated weights for policy 0, policy_version 1814263 (0.0009) [2023-12-26 14:04:59,390][123091] Updated weights for policy 0, policy_version 1814273 (0.0009) [2023-12-26 14:04:59,452][123091] Updated weights for policy 0, policy_version 1814283 (0.0006) [2023-12-26 14:04:59,658][123090] Updated weights for policy 1, policy_version 1802441 (0.0006) [2023-12-26 14:04:59,727][123090] Updated weights for policy 1, policy_version 1802451 (0.0006) [2023-12-26 14:04:59,792][123090] Updated weights for policy 1, policy_version 1802461 (0.0010) [2023-12-26 14:05:00,253][123091] Updated weights for policy 0, policy_version 1814293 (0.0007) [2023-12-26 14:05:00,316][123091] Updated weights for policy 0, policy_version 1814303 (0.0010) [2023-12-26 14:05:00,371][123091] Updated weights for policy 0, policy_version 1814313 (0.0009) [2023-12-26 14:05:00,544][123090] Updated weights for policy 1, policy_version 1802471 (0.0009) [2023-12-26 14:05:00,599][123090] Updated weights for policy 1, policy_version 1802481 (0.0009) [2023-12-26 14:05:00,648][123090] Updated weights for policy 1, policy_version 1802491 (0.0009) [2023-12-26 14:05:01,211][123091] Updated weights for policy 0, policy_version 1814323 (0.0009) [2023-12-26 14:05:01,266][123091] Updated weights for policy 0, policy_version 1814333 (0.0010) [2023-12-26 14:05:01,319][123091] Updated weights for policy 0, policy_version 1814343 (0.0010) [2023-12-26 14:05:01,387][123090] Updated weights for policy 1, policy_version 1802501 (0.0007) [2023-12-26 14:05:01,454][123090] Updated weights for policy 1, policy_version 1802511 (0.0009) [2023-12-26 14:05:01,507][123090] Updated weights for policy 1, policy_version 1802521 (0.0009) [2023-12-26 14:05:02,188][123091] Updated weights for policy 0, policy_version 1814353 (0.0009) [2023-12-26 14:05:02,253][123091] Updated weights for policy 0, policy_version 1814363 (0.0007) [2023-12-26 14:05:02,323][123091] Updated weights for policy 0, policy_version 1814373 (0.0009) [2023-12-26 14:05:02,355][123090] Updated weights for policy 1, policy_version 1802531 (0.0009) [2023-12-26 14:05:02,388][123091] Updated weights for policy 0, policy_version 1814383 (0.0010) [2023-12-26 14:05:02,414][123090] Updated weights for policy 1, policy_version 1802541 (0.0008) [2023-12-26 14:05:02,479][123090] Updated weights for policy 1, policy_version 1802551 (0.0009) [2023-12-26 14:05:03,144][123091] Updated weights for policy 0, policy_version 1814393 (0.0009) [2023-12-26 14:05:03,202][123090] Updated weights for policy 1, policy_version 1802561 (0.0010) [2023-12-26 14:05:03,205][123091] Updated weights for policy 0, policy_version 1814404 (0.0009) [2023-12-26 14:05:03,260][123090] Updated weights for policy 1, policy_version 1802571 (0.0007) [2023-12-26 14:05:03,264][123091] Updated weights for policy 0, policy_version 1814414 (0.0009) [2023-12-26 14:05:03,315][123090] Updated weights for policy 1, policy_version 1802581 (0.0006) [2023-12-26 14:05:03,378][123090] Updated weights for policy 1, policy_version 1802591 (0.0006) [2023-12-26 14:05:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 925958144. Throughput: 0: 9042.4, 1: 8613.0. Samples: 925970144. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:03,785][121949] Avg episode reward: [(0, '6070.346'), (1, '5615.697')] [2023-12-26 14:05:04,083][123091] Updated weights for policy 0, policy_version 1814424 (0.0010) [2023-12-26 14:05:04,150][123091] Updated weights for policy 0, policy_version 1814434 (0.0011) [2023-12-26 14:05:04,187][123090] Updated weights for policy 1, policy_version 1802601 (0.0007) [2023-12-26 14:05:04,218][123091] Updated weights for policy 0, policy_version 1814444 (0.0010) [2023-12-26 14:05:04,260][123090] Updated weights for policy 1, policy_version 1802611 (0.0009) [2023-12-26 14:05:04,322][123090] Updated weights for policy 1, policy_version 1802621 (0.0009) [2023-12-26 14:05:05,011][123090] Updated weights for policy 1, policy_version 1802631 (0.0009) [2023-12-26 14:05:05,023][123091] Updated weights for policy 0, policy_version 1814454 (0.0010) [2023-12-26 14:05:05,078][123090] Updated weights for policy 1, policy_version 1802641 (0.0006) [2023-12-26 14:05:05,087][123091] Updated weights for policy 0, policy_version 1814464 (0.0011) [2023-12-26 14:05:05,138][123090] Updated weights for policy 1, policy_version 1802651 (0.0008) [2023-12-26 14:05:05,150][123091] Updated weights for policy 0, policy_version 1814474 (0.0011) [2023-12-26 14:05:05,917][123091] Updated weights for policy 0, policy_version 1814484 (0.0011) [2023-12-26 14:05:05,944][123090] Updated weights for policy 1, policy_version 1802661 (0.0007) [2023-12-26 14:05:05,968][123091] Updated weights for policy 0, policy_version 1814494 (0.0010) [2023-12-26 14:05:05,993][123090] Updated weights for policy 1, policy_version 1802671 (0.0005) [2023-12-26 14:05:06,028][123091] Updated weights for policy 0, policy_version 1814504 (0.0010) [2023-12-26 14:05:06,047][123090] Updated weights for policy 1, policy_version 1802681 (0.0007) [2023-12-26 14:05:06,850][123090] Updated weights for policy 1, policy_version 1802691 (0.0011) [2023-12-26 14:05:06,882][123091] Updated weights for policy 0, policy_version 1814514 (0.0010) [2023-12-26 14:05:06,914][123090] Updated weights for policy 1, policy_version 1802701 (0.0005) [2023-12-26 14:05:06,942][123091] Updated weights for policy 0, policy_version 1814524 (0.0011) [2023-12-26 14:05:06,981][123090] Updated weights for policy 1, policy_version 1802711 (0.0005) [2023-12-26 14:05:06,994][123091] Updated weights for policy 0, policy_version 1814534 (0.0010) [2023-12-26 14:05:07,043][123091] Updated weights for policy 0, policy_version 1814544 (0.0010) [2023-12-26 14:05:07,718][123090] Updated weights for policy 1, policy_version 1802721 (0.0010) [2023-12-26 14:05:07,776][123090] Updated weights for policy 1, policy_version 1802731 (0.0007) [2023-12-26 14:05:07,843][123090] Updated weights for policy 1, policy_version 1802741 (0.0006) [2023-12-26 14:05:07,860][123091] Updated weights for policy 0, policy_version 1814554 (0.0005) [2023-12-26 14:05:07,910][123090] Updated weights for policy 1, policy_version 1802751 (0.0006) [2023-12-26 14:05:07,932][123091] Updated weights for policy 0, policy_version 1814564 (0.0007) [2023-12-26 14:05:07,994][123091] Updated weights for policy 0, policy_version 1814574 (0.0010) [2023-12-26 14:05:08,704][123090] Updated weights for policy 1, policy_version 1802761 (0.0010) [2023-12-26 14:05:08,772][123090] Updated weights for policy 1, policy_version 1802771 (0.0008) [2023-12-26 14:05:08,782][123091] Updated weights for policy 0, policy_version 1814584 (0.0011) [2023-12-26 14:05:08,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 926040064. Throughput: 0: 9046.7, 1: 8647.3. Samples: 926023040. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:08,784][121949] Avg episode reward: [(0, '6141.980'), (1, '5692.213')] [2023-12-26 14:05:08,833][123090] Updated weights for policy 1, policy_version 1802781 (0.0006) [2023-12-26 14:05:08,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001802784_461512704.pth... [2023-12-26 14:05:08,851][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001801760_461250560.pth [2023-12-26 14:05:08,853][123091] Updated weights for policy 0, policy_version 1814594 (0.0010) [2023-12-26 14:05:08,916][123091] Updated weights for policy 0, policy_version 1814604 (0.0011) [2023-12-26 14:05:08,939][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001814608_464543744.pth... [2023-12-26 14:05:08,944][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001813552_464273408.pth [2023-12-26 14:05:09,574][123090] Updated weights for policy 1, policy_version 1802791 (0.0008) [2023-12-26 14:05:09,642][123090] Updated weights for policy 1, policy_version 1802801 (0.0008) [2023-12-26 14:05:09,711][123090] Updated weights for policy 1, policy_version 1802811 (0.0008) [2023-12-26 14:05:09,746][123091] Updated weights for policy 0, policy_version 1814614 (0.0009) [2023-12-26 14:05:09,808][123091] Updated weights for policy 0, policy_version 1814624 (0.0010) [2023-12-26 14:05:09,878][123091] Updated weights for policy 0, policy_version 1814634 (0.0008) [2023-12-26 14:05:10,483][123090] Updated weights for policy 1, policy_version 1802821 (0.0008) [2023-12-26 14:05:10,553][123090] Updated weights for policy 1, policy_version 1802831 (0.0008) [2023-12-26 14:05:10,608][123090] Updated weights for policy 1, policy_version 1802841 (0.0009) [2023-12-26 14:05:10,651][123091] Updated weights for policy 0, policy_version 1814644 (0.0006) [2023-12-26 14:05:10,698][123091] Updated weights for policy 0, policy_version 1814654 (0.0005) [2023-12-26 14:05:10,747][123091] Updated weights for policy 0, policy_version 1814664 (0.0005) [2023-12-26 14:05:11,377][123090] Updated weights for policy 1, policy_version 1802851 (0.0009) [2023-12-26 14:05:11,444][123091] Updated weights for policy 0, policy_version 1814674 (0.0005) [2023-12-26 14:05:11,456][123090] Updated weights for policy 1, policy_version 1802861 (0.0009) [2023-12-26 14:05:11,510][123091] Updated weights for policy 0, policy_version 1814684 (0.0006) [2023-12-26 14:05:11,526][123090] Updated weights for policy 1, policy_version 1802871 (0.0009) [2023-12-26 14:05:11,571][123091] Updated weights for policy 0, policy_version 1814694 (0.0007) [2023-12-26 14:05:11,639][123091] Updated weights for policy 0, policy_version 1814704 (0.0008) [2023-12-26 14:05:12,366][123090] Updated weights for policy 1, policy_version 1802881 (0.0009) [2023-12-26 14:05:12,377][123091] Updated weights for policy 0, policy_version 1814714 (0.0009) [2023-12-26 14:05:12,432][123090] Updated weights for policy 1, policy_version 1802891 (0.0009) [2023-12-26 14:05:12,443][123091] Updated weights for policy 0, policy_version 1814724 (0.0008) [2023-12-26 14:05:12,497][123090] Updated weights for policy 1, policy_version 1802901 (0.0008) [2023-12-26 14:05:12,504][123091] Updated weights for policy 0, policy_version 1814734 (0.0007) [2023-12-26 14:05:12,560][123090] Updated weights for policy 1, policy_version 1802911 (0.0009) [2023-12-26 14:05:13,173][123091] Updated weights for policy 0, policy_version 1814744 (0.0006) [2023-12-26 14:05:13,218][123091] Updated weights for policy 0, policy_version 1814754 (0.0005) [2023-12-26 14:05:13,276][123091] Updated weights for policy 0, policy_version 1814764 (0.0005) [2023-12-26 14:05:13,436][123090] Updated weights for policy 1, policy_version 1802921 (0.0010) [2023-12-26 14:05:13,497][123090] Updated weights for policy 1, policy_version 1802931 (0.0009) [2023-12-26 14:05:13,571][123090] Updated weights for policy 1, policy_version 1802941 (0.0006) [2023-12-26 14:05:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 926138368. Throughput: 0: 8938.8, 1: 8696.0. Samples: 926129896. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:13,785][121949] Avg episode reward: [(0, '6165.916'), (1, '5546.375')] [2023-12-26 14:05:14,029][123091] Updated weights for policy 0, policy_version 1814774 (0.0010) [2023-12-26 14:05:14,076][123091] Updated weights for policy 0, policy_version 1814784 (0.0009) [2023-12-26 14:05:14,134][123091] Updated weights for policy 0, policy_version 1814794 (0.0009) [2023-12-26 14:05:14,247][123090] Updated weights for policy 1, policy_version 1802951 (0.0006) [2023-12-26 14:05:14,313][123090] Updated weights for policy 1, policy_version 1802961 (0.0005) [2023-12-26 14:05:14,372][123090] Updated weights for policy 1, policy_version 1802971 (0.0006) [2023-12-26 14:05:15,035][123091] Updated weights for policy 0, policy_version 1814804 (0.0010) [2023-12-26 14:05:15,096][123091] Updated weights for policy 0, policy_version 1814814 (0.0009) [2023-12-26 14:05:15,147][123090] Updated weights for policy 1, policy_version 1802981 (0.0006) [2023-12-26 14:05:15,160][123091] Updated weights for policy 0, policy_version 1814824 (0.0009) [2023-12-26 14:05:15,219][123090] Updated weights for policy 1, policy_version 1802991 (0.0006) [2023-12-26 14:05:15,287][123090] Updated weights for policy 1, policy_version 1803001 (0.0007) [2023-12-26 14:05:16,003][123090] Updated weights for policy 1, policy_version 1803011 (0.0007) [2023-12-26 14:05:16,045][123091] Updated weights for policy 0, policy_version 1814834 (0.0008) [2023-12-26 14:05:16,071][123090] Updated weights for policy 1, policy_version 1803021 (0.0008) [2023-12-26 14:05:16,098][123091] Updated weights for policy 0, policy_version 1814844 (0.0005) [2023-12-26 14:05:16,133][123090] Updated weights for policy 1, policy_version 1803031 (0.0009) [2023-12-26 14:05:16,156][123091] Updated weights for policy 0, policy_version 1814854 (0.0006) [2023-12-26 14:05:16,226][123091] Updated weights for policy 0, policy_version 1814864 (0.0006) [2023-12-26 14:05:16,904][123090] Updated weights for policy 1, policy_version 1803041 (0.0009) [2023-12-26 14:05:16,964][123091] Updated weights for policy 0, policy_version 1814874 (0.0005) [2023-12-26 14:05:16,966][123090] Updated weights for policy 1, policy_version 1803051 (0.0005) [2023-12-26 14:05:17,015][123090] Updated weights for policy 1, policy_version 1803061 (0.0006) [2023-12-26 14:05:17,015][123091] Updated weights for policy 0, policy_version 1814884 (0.0005) [2023-12-26 14:05:17,062][123090] Updated weights for policy 1, policy_version 1803071 (0.0005) [2023-12-26 14:05:17,065][123091] Updated weights for policy 0, policy_version 1814894 (0.0005) [2023-12-26 14:05:17,753][123091] Updated weights for policy 0, policy_version 1814904 (0.0008) [2023-12-26 14:05:17,773][123090] Updated weights for policy 1, policy_version 1803081 (0.0006) [2023-12-26 14:05:17,821][123091] Updated weights for policy 0, policy_version 1814914 (0.0009) [2023-12-26 14:05:17,832][123090] Updated weights for policy 1, policy_version 1803091 (0.0006) [2023-12-26 14:05:17,865][123091] Updated weights for policy 0, policy_version 1814924 (0.0008) [2023-12-26 14:05:17,887][123090] Updated weights for policy 1, policy_version 1803101 (0.0006) [2023-12-26 14:05:18,516][123090] Updated weights for policy 1, policy_version 1803111 (0.0006) [2023-12-26 14:05:18,589][123090] Updated weights for policy 1, policy_version 1803121 (0.0005) [2023-12-26 14:05:18,653][123090] Updated weights for policy 1, policy_version 1803131 (0.0008) [2023-12-26 14:05:18,763][123091] Updated weights for policy 0, policy_version 1814934 (0.0008) [2023-12-26 14:05:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 926228480. Throughput: 0: 8929.1, 1: 8788.2. Samples: 926240140. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:18,785][121949] Avg episode reward: [(0, '6204.044'), (1, '5632.929')] [2023-12-26 14:05:18,824][123091] Updated weights for policy 0, policy_version 1814944 (0.0009) [2023-12-26 14:05:18,898][123091] Updated weights for policy 0, policy_version 1814954 (0.0009) [2023-12-26 14:05:19,453][123090] Updated weights for policy 1, policy_version 1803141 (0.0010) [2023-12-26 14:05:19,520][123090] Updated weights for policy 1, policy_version 1803151 (0.0010) [2023-12-26 14:05:19,584][123090] Updated weights for policy 1, policy_version 1803161 (0.0011) [2023-12-26 14:05:19,690][123091] Updated weights for policy 0, policy_version 1814964 (0.0009) [2023-12-26 14:05:19,759][123091] Updated weights for policy 0, policy_version 1814974 (0.0009) [2023-12-26 14:05:19,833][123091] Updated weights for policy 0, policy_version 1814984 (0.0009) [2023-12-26 14:05:20,416][123090] Updated weights for policy 1, policy_version 1803171 (0.0009) [2023-12-26 14:05:20,476][123090] Updated weights for policy 1, policy_version 1803181 (0.0008) [2023-12-26 14:05:20,542][123090] Updated weights for policy 1, policy_version 1803191 (0.0009) [2023-12-26 14:05:20,694][123091] Updated weights for policy 0, policy_version 1814994 (0.0009) [2023-12-26 14:05:20,755][123091] Updated weights for policy 0, policy_version 1815004 (0.0006) [2023-12-26 14:05:20,822][123091] Updated weights for policy 0, policy_version 1815014 (0.0006) [2023-12-26 14:05:20,888][123091] Updated weights for policy 0, policy_version 1815024 (0.0006) [2023-12-26 14:05:21,348][123090] Updated weights for policy 1, policy_version 1803201 (0.0010) [2023-12-26 14:05:21,418][123090] Updated weights for policy 1, policy_version 1803211 (0.0008) [2023-12-26 14:05:21,481][123090] Updated weights for policy 1, policy_version 1803221 (0.0008) [2023-12-26 14:05:21,543][123090] Updated weights for policy 1, policy_version 1803231 (0.0008) [2023-12-26 14:05:21,616][123091] Updated weights for policy 0, policy_version 1815034 (0.0006) [2023-12-26 14:05:21,684][123091] Updated weights for policy 0, policy_version 1815044 (0.0008) [2023-12-26 14:05:21,765][123091] Updated weights for policy 0, policy_version 1815054 (0.0008) [2023-12-26 14:05:22,315][123090] Updated weights for policy 1, policy_version 1803241 (0.0009) [2023-12-26 14:05:22,406][123090] Updated weights for policy 1, policy_version 1803251 (0.0011) [2023-12-26 14:05:22,449][123091] Updated weights for policy 0, policy_version 1815064 (0.0008) [2023-12-26 14:05:22,475][123090] Updated weights for policy 1, policy_version 1803261 (0.0009) [2023-12-26 14:05:22,516][123091] Updated weights for policy 0, policy_version 1815074 (0.0006) [2023-12-26 14:05:22,575][123091] Updated weights for policy 0, policy_version 1815084 (0.0006) [2023-12-26 14:05:23,077][123090] Updated weights for policy 1, policy_version 1803271 (0.0009) [2023-12-26 14:05:23,140][123090] Updated weights for policy 1, policy_version 1803281 (0.0010) [2023-12-26 14:05:23,204][123090] Updated weights for policy 1, policy_version 1803291 (0.0010) [2023-12-26 14:05:23,304][123091] Updated weights for policy 0, policy_version 1815094 (0.0008) [2023-12-26 14:05:23,359][123091] Updated weights for policy 0, policy_version 1815104 (0.0010) [2023-12-26 14:05:23,411][123091] Updated weights for policy 0, policy_version 1815114 (0.0009) [2023-12-26 14:05:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 926318592. Throughput: 0: 8923.4, 1: 8735.3. Samples: 926291796. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:23,785][121949] Avg episode reward: [(0, '6331.198'), (1, '5847.057')] [2023-12-26 14:05:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001815120_464674816.pth... [2023-12-26 14:05:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001803296_461643776.pth... [2023-12-26 14:05:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001802240_461373440.pth [2023-12-26 14:05:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001814064_464404480.pth [2023-12-26 14:05:24,042][123090] Updated weights for policy 1, policy_version 1803301 (0.0010) [2023-12-26 14:05:24,097][123090] Updated weights for policy 1, policy_version 1803311 (0.0010) [2023-12-26 14:05:24,167][123090] Updated weights for policy 1, policy_version 1803321 (0.0007) [2023-12-26 14:05:24,185][123091] Updated weights for policy 0, policy_version 1815124 (0.0007) [2023-12-26 14:05:24,248][123091] Updated weights for policy 0, policy_version 1815134 (0.0006) [2023-12-26 14:05:24,311][123091] Updated weights for policy 0, policy_version 1815144 (0.0008) [2023-12-26 14:05:24,954][123090] Updated weights for policy 1, policy_version 1803331 (0.0008) [2023-12-26 14:05:24,988][123091] Updated weights for policy 0, policy_version 1815154 (0.0007) [2023-12-26 14:05:25,005][123090] Updated weights for policy 1, policy_version 1803341 (0.0010) [2023-12-26 14:05:25,041][123091] Updated weights for policy 0, policy_version 1815164 (0.0010) [2023-12-26 14:05:25,057][123090] Updated weights for policy 1, policy_version 1803351 (0.0010) [2023-12-26 14:05:25,093][123091] Updated weights for policy 0, policy_version 1815174 (0.0009) [2023-12-26 14:05:25,143][123091] Updated weights for policy 0, policy_version 1815184 (0.0010) [2023-12-26 14:05:25,910][123090] Updated weights for policy 1, policy_version 1803361 (0.0010) [2023-12-26 14:05:25,970][123091] Updated weights for policy 0, policy_version 1815194 (0.0009) [2023-12-26 14:05:25,972][123090] Updated weights for policy 1, policy_version 1803371 (0.0007) [2023-12-26 14:05:26,024][123091] Updated weights for policy 0, policy_version 1815204 (0.0007) [2023-12-26 14:05:26,030][123090] Updated weights for policy 1, policy_version 1803381 (0.0008) [2023-12-26 14:05:26,073][123091] Updated weights for policy 0, policy_version 1815214 (0.0006) [2023-12-26 14:05:26,083][123090] Updated weights for policy 1, policy_version 1803391 (0.0010) [2023-12-26 14:05:26,867][123090] Updated weights for policy 1, policy_version 1803401 (0.0005) [2023-12-26 14:05:26,877][123091] Updated weights for policy 0, policy_version 1815224 (0.0006) [2023-12-26 14:05:26,931][123090] Updated weights for policy 1, policy_version 1803411 (0.0005) [2023-12-26 14:05:26,938][123091] Updated weights for policy 0, policy_version 1815234 (0.0007) [2023-12-26 14:05:26,991][123091] Updated weights for policy 0, policy_version 1815244 (0.0006) [2023-12-26 14:05:26,993][123090] Updated weights for policy 1, policy_version 1803421 (0.0005) [2023-12-26 14:05:27,650][123090] Updated weights for policy 1, policy_version 1803431 (0.0005) [2023-12-26 14:05:27,694][123090] Updated weights for policy 1, policy_version 1803441 (0.0005) [2023-12-26 14:05:27,742][123090] Updated weights for policy 1, policy_version 1803451 (0.0005) [2023-12-26 14:05:27,742][123091] Updated weights for policy 0, policy_version 1815254 (0.0007) [2023-12-26 14:05:27,797][123091] Updated weights for policy 0, policy_version 1815264 (0.0009) [2023-12-26 14:05:27,851][123091] Updated weights for policy 0, policy_version 1815274 (0.0010) [2023-12-26 14:05:28,385][123090] Updated weights for policy 1, policy_version 1803461 (0.0007) [2023-12-26 14:05:28,451][123090] Updated weights for policy 1, policy_version 1803471 (0.0008) [2023-12-26 14:05:28,518][123090] Updated weights for policy 1, policy_version 1803481 (0.0009) [2023-12-26 14:05:28,647][123091] Updated weights for policy 0, policy_version 1815285 (0.0010) [2023-12-26 14:05:28,703][123091] Updated weights for policy 0, policy_version 1815295 (0.0008) [2023-12-26 14:05:28,766][123091] Updated weights for policy 0, policy_version 1815305 (0.0009) [2023-12-26 14:05:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 926408704. Throughput: 0: 8992.4, 1: 8834.5. Samples: 926403952. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:28,785][121949] Avg episode reward: [(0, '6213.226'), (1, '5823.765')] [2023-12-26 14:05:29,301][123090] Updated weights for policy 1, policy_version 1803491 (0.0009) [2023-12-26 14:05:29,371][123090] Updated weights for policy 1, policy_version 1803501 (0.0007) [2023-12-26 14:05:29,436][123090] Updated weights for policy 1, policy_version 1803511 (0.0007) [2023-12-26 14:05:29,637][123091] Updated weights for policy 0, policy_version 1815315 (0.0009) [2023-12-26 14:05:29,707][123091] Updated weights for policy 0, policy_version 1815325 (0.0010) [2023-12-26 14:05:29,788][123091] Updated weights for policy 0, policy_version 1815335 (0.0010) [2023-12-26 14:05:30,202][123090] Updated weights for policy 1, policy_version 1803521 (0.0009) [2023-12-26 14:05:30,268][123090] Updated weights for policy 1, policy_version 1803531 (0.0008) [2023-12-26 14:05:30,337][123090] Updated weights for policy 1, policy_version 1803541 (0.0005) [2023-12-26 14:05:30,401][123090] Updated weights for policy 1, policy_version 1803551 (0.0009) [2023-12-26 14:05:30,642][123091] Updated weights for policy 0, policy_version 1815345 (0.0010) [2023-12-26 14:05:30,699][123091] Updated weights for policy 0, policy_version 1815355 (0.0009) [2023-12-26 14:05:30,757][123091] Updated weights for policy 0, policy_version 1815365 (0.0008) [2023-12-26 14:05:30,811][123091] Updated weights for policy 0, policy_version 1815375 (0.0010) [2023-12-26 14:05:31,236][123090] Updated weights for policy 1, policy_version 1803561 (0.0010) [2023-12-26 14:05:31,298][123090] Updated weights for policy 1, policy_version 1803571 (0.0009) [2023-12-26 14:05:31,366][123090] Updated weights for policy 1, policy_version 1803582 (0.0010) [2023-12-26 14:05:31,604][123091] Updated weights for policy 0, policy_version 1815385 (0.0007) [2023-12-26 14:05:31,670][123091] Updated weights for policy 0, policy_version 1815395 (0.0009) [2023-12-26 14:05:31,738][123091] Updated weights for policy 0, policy_version 1815405 (0.0009) [2023-12-26 14:05:32,224][123090] Updated weights for policy 1, policy_version 1803592 (0.0007) [2023-12-26 14:05:32,293][123090] Updated weights for policy 1, policy_version 1803602 (0.0006) [2023-12-26 14:05:32,366][123090] Updated weights for policy 1, policy_version 1803612 (0.0006) [2023-12-26 14:05:32,487][123091] Updated weights for policy 0, policy_version 1815415 (0.0010) [2023-12-26 14:05:32,554][123091] Updated weights for policy 0, policy_version 1815425 (0.0008) [2023-12-26 14:05:32,616][123091] Updated weights for policy 0, policy_version 1815435 (0.0005) [2023-12-26 14:05:33,115][123090] Updated weights for policy 1, policy_version 1803622 (0.0008) [2023-12-26 14:05:33,172][123090] Updated weights for policy 1, policy_version 1803632 (0.0008) [2023-12-26 14:05:33,218][123090] Updated weights for policy 1, policy_version 1803642 (0.0008) [2023-12-26 14:05:33,220][123091] Updated weights for policy 0, policy_version 1815445 (0.0008) [2023-12-26 14:05:33,270][123091] Updated weights for policy 0, policy_version 1815455 (0.0010) [2023-12-26 14:05:33,324][123091] Updated weights for policy 0, policy_version 1815465 (0.0007) [2023-12-26 14:05:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 926498816. Throughput: 0: 8917.7, 1: 8930.5. Samples: 926510356. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:33,786][121949] Avg episode reward: [(0, '6262.267'), (1, '5735.474')] [2023-12-26 14:05:34,040][123090] Updated weights for policy 1, policy_version 1803652 (0.0008) [2023-12-26 14:05:34,087][123090] Updated weights for policy 1, policy_version 1803662 (0.0010) [2023-12-26 14:05:34,122][123091] Updated weights for policy 0, policy_version 1815475 (0.0009) [2023-12-26 14:05:34,153][123090] Updated weights for policy 1, policy_version 1803672 (0.0010) [2023-12-26 14:05:34,197][123091] Updated weights for policy 0, policy_version 1815486 (0.0010) [2023-12-26 14:05:34,260][123091] Updated weights for policy 0, policy_version 1815496 (0.0011) [2023-12-26 14:05:34,985][123090] Updated weights for policy 1, policy_version 1803682 (0.0011) [2023-12-26 14:05:35,000][123091] Updated weights for policy 0, policy_version 1815506 (0.0010) [2023-12-26 14:05:35,041][123090] Updated weights for policy 1, policy_version 1803692 (0.0010) [2023-12-26 14:05:35,059][123091] Updated weights for policy 0, policy_version 1815516 (0.0010) [2023-12-26 14:05:35,107][123090] Updated weights for policy 1, policy_version 1803702 (0.0011) [2023-12-26 14:05:35,124][123091] Updated weights for policy 0, policy_version 1815526 (0.0010) [2023-12-26 14:05:35,160][123090] Updated weights for policy 1, policy_version 1803712 (0.0008) [2023-12-26 14:05:35,183][123091] Updated weights for policy 0, policy_version 1815536 (0.0010) [2023-12-26 14:05:35,855][123090] Updated weights for policy 1, policy_version 1803722 (0.0006) [2023-12-26 14:05:35,914][123090] Updated weights for policy 1, policy_version 1803732 (0.0006) [2023-12-26 14:05:35,977][123090] Updated weights for policy 1, policy_version 1803742 (0.0006) [2023-12-26 14:05:35,990][123091] Updated weights for policy 0, policy_version 1815546 (0.0006) [2023-12-26 14:05:36,054][123091] Updated weights for policy 0, policy_version 1815556 (0.0006) [2023-12-26 14:05:36,126][123091] Updated weights for policy 0, policy_version 1815566 (0.0007) [2023-12-26 14:05:36,786][123090] Updated weights for policy 1, policy_version 1803752 (0.0010) [2023-12-26 14:05:36,850][123090] Updated weights for policy 1, policy_version 1803762 (0.0011) [2023-12-26 14:05:36,898][123091] Updated weights for policy 0, policy_version 1815576 (0.0008) [2023-12-26 14:05:36,920][123090] Updated weights for policy 1, policy_version 1803772 (0.0009) [2023-12-26 14:05:36,963][123091] Updated weights for policy 0, policy_version 1815586 (0.0008) [2023-12-26 14:05:37,024][123091] Updated weights for policy 0, policy_version 1815596 (0.0009) [2023-12-26 14:05:37,723][123090] Updated weights for policy 1, policy_version 1803782 (0.0010) [2023-12-26 14:05:37,780][123090] Updated weights for policy 1, policy_version 1803792 (0.0005) [2023-12-26 14:05:37,806][123091] Updated weights for policy 0, policy_version 1815606 (0.0006) [2023-12-26 14:05:37,843][123090] Updated weights for policy 1, policy_version 1803802 (0.0005) [2023-12-26 14:05:37,872][123091] Updated weights for policy 0, policy_version 1815616 (0.0007) [2023-12-26 14:05:37,940][123091] Updated weights for policy 0, policy_version 1815626 (0.0006) [2023-12-26 14:05:38,570][123090] Updated weights for policy 1, policy_version 1803812 (0.0006) [2023-12-26 14:05:38,637][123090] Updated weights for policy 1, policy_version 1803822 (0.0005) [2023-12-26 14:05:38,699][123091] Updated weights for policy 0, policy_version 1815636 (0.0007) [2023-12-26 14:05:38,708][123090] Updated weights for policy 1, policy_version 1803832 (0.0006) [2023-12-26 14:05:38,766][123091] Updated weights for policy 0, policy_version 1815646 (0.0011) [2023-12-26 14:05:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 926588928. Throughput: 0: 8933.9, 1: 9002.7. Samples: 926565444. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:38,785][121949] Avg episode reward: [(0, '6297.766'), (1, '5504.969')] [2023-12-26 14:05:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001803840_461783040.pth... [2023-12-26 14:05:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001802784_461512704.pth [2023-12-26 14:05:38,833][123091] Updated weights for policy 0, policy_version 1815656 (0.0011) [2023-12-26 14:05:38,880][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001815664_464814080.pth... [2023-12-26 14:05:38,883][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001814608_464543744.pth [2023-12-26 14:05:39,501][123090] Updated weights for policy 1, policy_version 1803842 (0.0006) [2023-12-26 14:05:39,565][123090] Updated weights for policy 1, policy_version 1803852 (0.0008) [2023-12-26 14:05:39,566][123091] Updated weights for policy 0, policy_version 1815666 (0.0008) [2023-12-26 14:05:39,632][123091] Updated weights for policy 0, policy_version 1815676 (0.0009) [2023-12-26 14:05:39,634][123090] Updated weights for policy 1, policy_version 1803862 (0.0007) [2023-12-26 14:05:39,695][123091] Updated weights for policy 0, policy_version 1815686 (0.0009) [2023-12-26 14:05:39,697][123090] Updated weights for policy 1, policy_version 1803872 (0.0008) [2023-12-26 14:05:39,747][123091] Updated weights for policy 0, policy_version 1815696 (0.0009) [2023-12-26 14:05:40,514][123090] Updated weights for policy 1, policy_version 1803882 (0.0009) [2023-12-26 14:05:40,573][123090] Updated weights for policy 1, policy_version 1803892 (0.0008) [2023-12-26 14:05:40,589][123091] Updated weights for policy 0, policy_version 1815706 (0.0009) [2023-12-26 14:05:40,641][123090] Updated weights for policy 1, policy_version 1803902 (0.0007) [2023-12-26 14:05:40,644][123091] Updated weights for policy 0, policy_version 1815716 (0.0009) [2023-12-26 14:05:40,697][123091] Updated weights for policy 0, policy_version 1815726 (0.0009) [2023-12-26 14:05:41,470][123090] Updated weights for policy 1, policy_version 1803912 (0.0010) [2023-12-26 14:05:41,532][123090] Updated weights for policy 1, policy_version 1803922 (0.0010) [2023-12-26 14:05:41,575][123091] Updated weights for policy 0, policy_version 1815736 (0.0009) [2023-12-26 14:05:41,600][123090] Updated weights for policy 1, policy_version 1803932 (0.0008) [2023-12-26 14:05:41,646][123091] Updated weights for policy 0, policy_version 1815746 (0.0009) [2023-12-26 14:05:41,705][123091] Updated weights for policy 0, policy_version 1815756 (0.0010) [2023-12-26 14:05:42,422][123090] Updated weights for policy 1, policy_version 1803942 (0.0010) [2023-12-26 14:05:42,477][123090] Updated weights for policy 1, policy_version 1803952 (0.0009) [2023-12-26 14:05:42,539][123090] Updated weights for policy 1, policy_version 1803962 (0.0009) [2023-12-26 14:05:42,578][123091] Updated weights for policy 0, policy_version 1815766 (0.0010) [2023-12-26 14:05:42,643][123091] Updated weights for policy 0, policy_version 1815776 (0.0009) [2023-12-26 14:05:42,714][123091] Updated weights for policy 0, policy_version 1815786 (0.0010) [2023-12-26 14:05:43,330][123090] Updated weights for policy 1, policy_version 1803972 (0.0009) [2023-12-26 14:05:43,391][123090] Updated weights for policy 1, policy_version 1803982 (0.0005) [2023-12-26 14:05:43,439][123090] Updated weights for policy 1, policy_version 1803992 (0.0005) [2023-12-26 14:05:43,557][123091] Updated weights for policy 0, policy_version 1815796 (0.0010) [2023-12-26 14:05:43,611][123091] Updated weights for policy 0, policy_version 1815806 (0.0010) [2023-12-26 14:05:43,665][123091] Updated weights for policy 0, policy_version 1815816 (0.0010) [2023-12-26 14:05:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 926679040. Throughput: 0: 8871.1, 1: 8947.6. Samples: 926669304. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:43,785][121949] Avg episode reward: [(0, '6282.206'), (1, '5435.422')] [2023-12-26 14:05:44,120][123090] Updated weights for policy 1, policy_version 1804002 (0.0005) [2023-12-26 14:05:44,192][123090] Updated weights for policy 1, policy_version 1804012 (0.0006) [2023-12-26 14:05:44,255][123090] Updated weights for policy 1, policy_version 1804022 (0.0006) [2023-12-26 14:05:44,303][123090] Updated weights for policy 1, policy_version 1804032 (0.0005) [2023-12-26 14:05:44,403][123091] Updated weights for policy 0, policy_version 1815826 (0.0009) [2023-12-26 14:05:44,467][123091] Updated weights for policy 0, policy_version 1815836 (0.0005) [2023-12-26 14:05:44,531][123091] Updated weights for policy 0, policy_version 1815846 (0.0005) [2023-12-26 14:05:44,604][123091] Updated weights for policy 0, policy_version 1815856 (0.0005) [2023-12-26 14:05:44,908][123090] Updated weights for policy 1, policy_version 1804042 (0.0006) [2023-12-26 14:05:44,977][123090] Updated weights for policy 1, policy_version 1804052 (0.0006) [2023-12-26 14:05:45,039][123090] Updated weights for policy 1, policy_version 1804062 (0.0006) [2023-12-26 14:05:45,243][123091] Updated weights for policy 0, policy_version 1815866 (0.0009) [2023-12-26 14:05:45,305][123091] Updated weights for policy 0, policy_version 1815876 (0.0009) [2023-12-26 14:05:45,374][123091] Updated weights for policy 0, policy_version 1815886 (0.0009) [2023-12-26 14:05:45,813][123090] Updated weights for policy 1, policy_version 1804072 (0.0006) [2023-12-26 14:05:45,880][123090] Updated weights for policy 1, policy_version 1804082 (0.0008) [2023-12-26 14:05:45,942][123090] Updated weights for policy 1, policy_version 1804092 (0.0010) [2023-12-26 14:05:46,207][123091] Updated weights for policy 0, policy_version 1815896 (0.0010) [2023-12-26 14:05:46,270][123091] Updated weights for policy 0, policy_version 1815906 (0.0010) [2023-12-26 14:05:46,326][123091] Updated weights for policy 0, policy_version 1815916 (0.0010) [2023-12-26 14:05:46,658][123090] Updated weights for policy 1, policy_version 1804102 (0.0007) [2023-12-26 14:05:46,713][123090] Updated weights for policy 1, policy_version 1804113 (0.0008) [2023-12-26 14:05:46,776][123090] Updated weights for policy 1, policy_version 1804123 (0.0009) [2023-12-26 14:05:47,172][123091] Updated weights for policy 0, policy_version 1815926 (0.0008) [2023-12-26 14:05:47,234][123091] Updated weights for policy 0, policy_version 1815936 (0.0009) [2023-12-26 14:05:47,291][123091] Updated weights for policy 0, policy_version 1815946 (0.0009) [2023-12-26 14:05:47,613][123090] Updated weights for policy 1, policy_version 1804133 (0.0010) [2023-12-26 14:05:47,670][123090] Updated weights for policy 1, policy_version 1804143 (0.0010) [2023-12-26 14:05:47,725][123090] Updated weights for policy 1, policy_version 1804153 (0.0010) [2023-12-26 14:05:47,965][123091] Updated weights for policy 0, policy_version 1815956 (0.0008) [2023-12-26 14:05:48,014][123091] Updated weights for policy 0, policy_version 1815966 (0.0009) [2023-12-26 14:05:48,071][123091] Updated weights for policy 0, policy_version 1815976 (0.0010) [2023-12-26 14:05:48,522][123090] Updated weights for policy 1, policy_version 1804163 (0.0010) [2023-12-26 14:05:48,578][123090] Updated weights for policy 1, policy_version 1804173 (0.0010) [2023-12-26 14:05:48,634][123090] Updated weights for policy 1, policy_version 1804183 (0.0010) [2023-12-26 14:05:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 926769152. Throughput: 0: 8932.1, 1: 9036.1. Samples: 926778712. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:48,785][121949] Avg episode reward: [(0, '6305.091'), (1, '5772.696')] [2023-12-26 14:05:48,933][123091] Updated weights for policy 0, policy_version 1815986 (0.0010) [2023-12-26 14:05:49,006][123091] Updated weights for policy 0, policy_version 1815996 (0.0007) [2023-12-26 14:05:49,071][123091] Updated weights for policy 0, policy_version 1816006 (0.0007) [2023-12-26 14:05:49,135][123091] Updated weights for policy 0, policy_version 1816016 (0.0008) [2023-12-26 14:05:49,436][123090] Updated weights for policy 1, policy_version 1804193 (0.0010) [2023-12-26 14:05:49,497][123090] Updated weights for policy 1, policy_version 1804203 (0.0007) [2023-12-26 14:05:49,548][123090] Updated weights for policy 1, policy_version 1804213 (0.0008) [2023-12-26 14:05:49,607][123090] Updated weights for policy 1, policy_version 1804223 (0.0010) [2023-12-26 14:05:49,930][123091] Updated weights for policy 0, policy_version 1816026 (0.0009) [2023-12-26 14:05:49,985][123091] Updated weights for policy 0, policy_version 1816036 (0.0008) [2023-12-26 14:05:50,046][123091] Updated weights for policy 0, policy_version 1816046 (0.0009) [2023-12-26 14:05:50,403][123090] Updated weights for policy 1, policy_version 1804233 (0.0011) [2023-12-26 14:05:50,469][123090] Updated weights for policy 1, policy_version 1804243 (0.0010) [2023-12-26 14:05:50,532][123090] Updated weights for policy 1, policy_version 1804253 (0.0005) [2023-12-26 14:05:50,864][123091] Updated weights for policy 0, policy_version 1816056 (0.0009) [2023-12-26 14:05:50,927][123091] Updated weights for policy 0, policy_version 1816066 (0.0006) [2023-12-26 14:05:50,978][123091] Updated weights for policy 0, policy_version 1816076 (0.0006) [2023-12-26 14:05:51,230][123090] Updated weights for policy 1, policy_version 1804263 (0.0009) [2023-12-26 14:05:51,292][123090] Updated weights for policy 1, policy_version 1804273 (0.0009) [2023-12-26 14:05:51,365][123090] Updated weights for policy 1, policy_version 1804283 (0.0011) [2023-12-26 14:05:51,832][123091] Updated weights for policy 0, policy_version 1816086 (0.0008) [2023-12-26 14:05:51,889][123091] Updated weights for policy 0, policy_version 1816096 (0.0009) [2023-12-26 14:05:51,942][123091] Updated weights for policy 0, policy_version 1816106 (0.0009) [2023-12-26 14:05:52,228][123090] Updated weights for policy 1, policy_version 1804293 (0.0009) [2023-12-26 14:05:52,290][123090] Updated weights for policy 1, policy_version 1804303 (0.0009) [2023-12-26 14:05:52,360][123090] Updated weights for policy 1, policy_version 1804313 (0.0009) [2023-12-26 14:05:52,795][123091] Updated weights for policy 0, policy_version 1816116 (0.0008) [2023-12-26 14:05:52,863][123091] Updated weights for policy 0, policy_version 1816126 (0.0009) [2023-12-26 14:05:52,924][123091] Updated weights for policy 0, policy_version 1816136 (0.0010) [2023-12-26 14:05:53,178][123090] Updated weights for policy 1, policy_version 1804323 (0.0009) [2023-12-26 14:05:53,225][123090] Updated weights for policy 1, policy_version 1804333 (0.0008) [2023-12-26 14:05:53,271][123090] Updated weights for policy 1, policy_version 1804343 (0.0009) [2023-12-26 14:05:53,697][123091] Updated weights for policy 0, policy_version 1816146 (0.0008) [2023-12-26 14:05:53,762][123091] Updated weights for policy 0, policy_version 1816156 (0.0008) [2023-12-26 14:05:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 926851072. Throughput: 0: 8919.5, 1: 9045.7. Samples: 926831472. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:53,785][121949] Avg episode reward: [(0, '6275.697'), (1, '5783.837')] [2023-12-26 14:05:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001804352_461914112.pth... [2023-12-26 14:05:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001803296_461643776.pth [2023-12-26 14:05:53,824][123091] Updated weights for policy 0, policy_version 1816166 (0.0010) [2023-12-26 14:05:53,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001816176_464945152.pth... [2023-12-26 14:05:53,889][123091] Updated weights for policy 0, policy_version 1816176 (0.0011) [2023-12-26 14:05:53,892][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001815120_464674816.pth [2023-12-26 14:05:54,096][123090] Updated weights for policy 1, policy_version 1804353 (0.0010) [2023-12-26 14:05:54,159][123090] Updated weights for policy 1, policy_version 1804363 (0.0010) [2023-12-26 14:05:54,222][123090] Updated weights for policy 1, policy_version 1804373 (0.0010) [2023-12-26 14:05:54,288][123090] Updated weights for policy 1, policy_version 1804383 (0.0010) [2023-12-26 14:05:54,660][123091] Updated weights for policy 0, policy_version 1816186 (0.0006) [2023-12-26 14:05:54,723][123091] Updated weights for policy 0, policy_version 1816196 (0.0005) [2023-12-26 14:05:54,791][123091] Updated weights for policy 0, policy_version 1816206 (0.0006) [2023-12-26 14:05:55,142][123090] Updated weights for policy 1, policy_version 1804393 (0.0010) [2023-12-26 14:05:55,190][123090] Updated weights for policy 1, policy_version 1804403 (0.0007) [2023-12-26 14:05:55,251][123090] Updated weights for policy 1, policy_version 1804413 (0.0010) [2023-12-26 14:05:55,475][123091] Updated weights for policy 0, policy_version 1816216 (0.0005) [2023-12-26 14:05:55,542][123091] Updated weights for policy 0, policy_version 1816226 (0.0005) [2023-12-26 14:05:55,586][123091] Updated weights for policy 0, policy_version 1816236 (0.0005) [2023-12-26 14:05:55,950][123090] Updated weights for policy 1, policy_version 1804423 (0.0007) [2023-12-26 14:05:56,005][123090] Updated weights for policy 1, policy_version 1804433 (0.0005) [2023-12-26 14:05:56,062][123090] Updated weights for policy 1, policy_version 1804443 (0.0005) [2023-12-26 14:05:56,209][123091] Updated weights for policy 0, policy_version 1816246 (0.0008) [2023-12-26 14:05:56,271][123091] Updated weights for policy 0, policy_version 1816256 (0.0011) [2023-12-26 14:05:56,331][123091] Updated weights for policy 0, policy_version 1816266 (0.0010) [2023-12-26 14:05:56,737][123090] Updated weights for policy 1, policy_version 1804453 (0.0005) [2023-12-26 14:05:56,799][123090] Updated weights for policy 1, policy_version 1804463 (0.0005) [2023-12-26 14:05:56,858][123090] Updated weights for policy 1, policy_version 1804473 (0.0005) [2023-12-26 14:05:57,084][123091] Updated weights for policy 0, policy_version 1816276 (0.0005) [2023-12-26 14:05:57,134][123091] Updated weights for policy 0, policy_version 1816286 (0.0005) [2023-12-26 14:05:57,187][123091] Updated weights for policy 0, policy_version 1816296 (0.0005) [2023-12-26 14:05:57,480][123090] Updated weights for policy 1, policy_version 1804483 (0.0005) [2023-12-26 14:05:57,535][123090] Updated weights for policy 1, policy_version 1804493 (0.0005) [2023-12-26 14:05:57,584][123090] Updated weights for policy 1, policy_version 1804503 (0.0005) [2023-12-26 14:05:57,973][123091] Updated weights for policy 0, policy_version 1816306 (0.0009) [2023-12-26 14:05:58,033][123091] Updated weights for policy 0, policy_version 1816316 (0.0006) [2023-12-26 14:05:58,109][123091] Updated weights for policy 0, policy_version 1816326 (0.0007) [2023-12-26 14:05:58,173][123091] Updated weights for policy 0, policy_version 1816336 (0.0008) [2023-12-26 14:05:58,335][123090] Updated weights for policy 1, policy_version 1804513 (0.0006) [2023-12-26 14:05:58,404][123090] Updated weights for policy 1, policy_version 1804523 (0.0008) [2023-12-26 14:05:58,481][123090] Updated weights for policy 1, policy_version 1804533 (0.0009) [2023-12-26 14:05:58,552][123090] Updated weights for policy 1, policy_version 1804543 (0.0008) [2023-12-26 14:05:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 926949376. Throughput: 0: 8958.3, 1: 9098.6. Samples: 926942456. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:05:58,785][121949] Avg episode reward: [(0, '6279.122'), (1, '5612.662')] [2023-12-26 14:05:58,990][123091] Updated weights for policy 0, policy_version 1816346 (0.0009) [2023-12-26 14:05:59,046][123091] Updated weights for policy 0, policy_version 1816356 (0.0009) [2023-12-26 14:05:59,104][123091] Updated weights for policy 0, policy_version 1816366 (0.0010) [2023-12-26 14:05:59,401][123090] Updated weights for policy 1, policy_version 1804553 (0.0008) [2023-12-26 14:05:59,457][123090] Updated weights for policy 1, policy_version 1804563 (0.0010) [2023-12-26 14:05:59,512][123090] Updated weights for policy 1, policy_version 1804573 (0.0010) [2023-12-26 14:05:59,986][123091] Updated weights for policy 0, policy_version 1816376 (0.0007) [2023-12-26 14:06:00,066][123091] Updated weights for policy 0, policy_version 1816386 (0.0006) [2023-12-26 14:06:00,119][123091] Updated weights for policy 0, policy_version 1816396 (0.0006) [2023-12-26 14:06:00,376][123090] Updated weights for policy 1, policy_version 1804583 (0.0010) [2023-12-26 14:06:00,423][123090] Updated weights for policy 1, policy_version 1804593 (0.0010) [2023-12-26 14:06:00,466][123090] Updated weights for policy 1, policy_version 1804603 (0.0010) [2023-12-26 14:06:00,799][123091] Updated weights for policy 0, policy_version 1816406 (0.0009) [2023-12-26 14:06:00,862][123091] Updated weights for policy 0, policy_version 1816416 (0.0011) [2023-12-26 14:06:00,917][123091] Updated weights for policy 0, policy_version 1816426 (0.0010) [2023-12-26 14:06:01,270][123090] Updated weights for policy 1, policy_version 1804613 (0.0010) [2023-12-26 14:06:01,321][123090] Updated weights for policy 1, policy_version 1804623 (0.0010) [2023-12-26 14:06:01,386][123090] Updated weights for policy 1, policy_version 1804633 (0.0011) [2023-12-26 14:06:01,694][123091] Updated weights for policy 0, policy_version 1816436 (0.0011) [2023-12-26 14:06:01,758][123091] Updated weights for policy 0, policy_version 1816446 (0.0008) [2023-12-26 14:06:01,818][123091] Updated weights for policy 0, policy_version 1816456 (0.0005) [2023-12-26 14:06:02,084][123090] Updated weights for policy 1, policy_version 1804643 (0.0007) [2023-12-26 14:06:02,138][123090] Updated weights for policy 1, policy_version 1804653 (0.0006) [2023-12-26 14:06:02,207][123090] Updated weights for policy 1, policy_version 1804663 (0.0005) [2023-12-26 14:06:02,555][123091] Updated weights for policy 0, policy_version 1816466 (0.0006) [2023-12-26 14:06:02,614][123091] Updated weights for policy 0, policy_version 1816476 (0.0010) [2023-12-26 14:06:02,664][123091] Updated weights for policy 0, policy_version 1816486 (0.0010) [2023-12-26 14:06:02,712][123091] Updated weights for policy 0, policy_version 1816496 (0.0010) [2023-12-26 14:06:02,906][123090] Updated weights for policy 1, policy_version 1804673 (0.0007) [2023-12-26 14:06:02,981][123090] Updated weights for policy 1, policy_version 1804683 (0.0011) [2023-12-26 14:06:03,033][123090] Updated weights for policy 1, policy_version 1804693 (0.0010) [2023-12-26 14:06:03,085][123090] Updated weights for policy 1, policy_version 1804703 (0.0007) [2023-12-26 14:06:03,521][123091] Updated weights for policy 0, policy_version 1816506 (0.0010) [2023-12-26 14:06:03,572][123091] Updated weights for policy 0, policy_version 1816516 (0.0010) [2023-12-26 14:06:03,631][123091] Updated weights for policy 0, policy_version 1816526 (0.0010) [2023-12-26 14:06:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 927039488. Throughput: 0: 8962.8, 1: 9062.2. Samples: 927051264. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:03,784][121949] Avg episode reward: [(0, '6282.986'), (1, '5583.238')] [2023-12-26 14:06:03,787][123090] Updated weights for policy 1, policy_version 1804713 (0.0005) [2023-12-26 14:06:03,858][123090] Updated weights for policy 1, policy_version 1804723 (0.0007) [2023-12-26 14:06:03,921][123090] Updated weights for policy 1, policy_version 1804733 (0.0010) [2023-12-26 14:06:04,401][123091] Updated weights for policy 0, policy_version 1816536 (0.0011) [2023-12-26 14:06:04,463][123091] Updated weights for policy 0, policy_version 1816546 (0.0007) [2023-12-26 14:06:04,523][123091] Updated weights for policy 0, policy_version 1816556 (0.0006) [2023-12-26 14:06:04,743][123090] Updated weights for policy 1, policy_version 1804743 (0.0011) [2023-12-26 14:06:04,807][123090] Updated weights for policy 1, policy_version 1804753 (0.0011) [2023-12-26 14:06:04,873][123090] Updated weights for policy 1, policy_version 1804763 (0.0010) [2023-12-26 14:06:05,202][123091] Updated weights for policy 0, policy_version 1816566 (0.0009) [2023-12-26 14:06:05,259][123091] Updated weights for policy 0, policy_version 1816576 (0.0010) [2023-12-26 14:06:05,312][123091] Updated weights for policy 0, policy_version 1816586 (0.0009) [2023-12-26 14:06:05,688][123090] Updated weights for policy 1, policy_version 1804773 (0.0010) [2023-12-26 14:06:05,743][123090] Updated weights for policy 1, policy_version 1804783 (0.0010) [2023-12-26 14:06:05,790][123090] Updated weights for policy 1, policy_version 1804793 (0.0010) [2023-12-26 14:06:06,150][123091] Updated weights for policy 0, policy_version 1816596 (0.0009) [2023-12-26 14:06:06,211][123091] Updated weights for policy 0, policy_version 1816606 (0.0009) [2023-12-26 14:06:06,277][123091] Updated weights for policy 0, policy_version 1816616 (0.0009) [2023-12-26 14:06:06,641][123090] Updated weights for policy 1, policy_version 1804803 (0.0010) [2023-12-26 14:06:06,698][123090] Updated weights for policy 1, policy_version 1804813 (0.0011) [2023-12-26 14:06:06,754][123090] Updated weights for policy 1, policy_version 1804823 (0.0011) [2023-12-26 14:06:07,117][123091] Updated weights for policy 0, policy_version 1816626 (0.0009) [2023-12-26 14:06:07,164][123091] Updated weights for policy 0, policy_version 1816636 (0.0010) [2023-12-26 14:06:07,216][123091] Updated weights for policy 0, policy_version 1816646 (0.0010) [2023-12-26 14:06:07,264][123091] Updated weights for policy 0, policy_version 1816656 (0.0010) [2023-12-26 14:06:07,590][123090] Updated weights for policy 1, policy_version 1804833 (0.0010) [2023-12-26 14:06:07,654][123090] Updated weights for policy 1, policy_version 1804843 (0.0011) [2023-12-26 14:06:07,706][123090] Updated weights for policy 1, policy_version 1804853 (0.0010) [2023-12-26 14:06:07,761][123090] Updated weights for policy 1, policy_version 1804863 (0.0010) [2023-12-26 14:06:08,130][123091] Updated weights for policy 0, policy_version 1816666 (0.0011) [2023-12-26 14:06:08,194][123091] Updated weights for policy 0, policy_version 1816676 (0.0011) [2023-12-26 14:06:08,246][123091] Updated weights for policy 0, policy_version 1816686 (0.0011) [2023-12-26 14:06:08,619][123090] Updated weights for policy 1, policy_version 1804873 (0.0010) [2023-12-26 14:06:08,678][123090] Updated weights for policy 1, policy_version 1804883 (0.0010) [2023-12-26 14:06:08,733][123090] Updated weights for policy 1, policy_version 1804893 (0.0010) [2023-12-26 14:06:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17772.5). Total num frames: 927129600. Throughput: 0: 8982.0, 1: 9074.3. Samples: 927104328. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:08,785][121949] Avg episode reward: [(0, '6206.991'), (1, '5489.442')] [2023-12-26 14:06:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001816688_465076224.pth... [2023-12-26 14:06:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001804896_462053376.pth... [2023-12-26 14:06:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001815664_464814080.pth [2023-12-26 14:06:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001803840_461783040.pth [2023-12-26 14:06:09,035][123091] Updated weights for policy 0, policy_version 1816696 (0.0006) [2023-12-26 14:06:09,102][123091] Updated weights for policy 0, policy_version 1816706 (0.0006) [2023-12-26 14:06:09,161][123091] Updated weights for policy 0, policy_version 1816716 (0.0011) [2023-12-26 14:06:09,541][123090] Updated weights for policy 1, policy_version 1804903 (0.0007) [2023-12-26 14:06:09,592][123090] Updated weights for policy 1, policy_version 1804913 (0.0005) [2023-12-26 14:06:09,648][123090] Updated weights for policy 1, policy_version 1804923 (0.0005) [2023-12-26 14:06:10,086][123091] Updated weights for policy 0, policy_version 1816726 (0.0009) [2023-12-26 14:06:10,158][123091] Updated weights for policy 0, policy_version 1816736 (0.0006) [2023-12-26 14:06:10,235][123091] Updated weights for policy 0, policy_version 1816746 (0.0005) [2023-12-26 14:06:10,471][123090] Updated weights for policy 1, policy_version 1804933 (0.0007) [2023-12-26 14:06:10,542][123090] Updated weights for policy 1, policy_version 1804943 (0.0005) [2023-12-26 14:06:10,620][123090] Updated weights for policy 1, policy_version 1804953 (0.0005) [2023-12-26 14:06:10,889][123091] Updated weights for policy 0, policy_version 1816756 (0.0007) [2023-12-26 14:06:10,953][123091] Updated weights for policy 0, policy_version 1816766 (0.0006) [2023-12-26 14:06:11,015][123091] Updated weights for policy 0, policy_version 1816776 (0.0010) [2023-12-26 14:06:11,370][123090] Updated weights for policy 1, policy_version 1804963 (0.0007) [2023-12-26 14:06:11,433][123090] Updated weights for policy 1, policy_version 1804973 (0.0008) [2023-12-26 14:06:11,481][123090] Updated weights for policy 1, policy_version 1804983 (0.0009) [2023-12-26 14:06:11,782][123091] Updated weights for policy 0, policy_version 1816786 (0.0011) [2023-12-26 14:06:11,849][123091] Updated weights for policy 0, policy_version 1816796 (0.0010) [2023-12-26 14:06:11,901][123091] Updated weights for policy 0, policy_version 1816806 (0.0010) [2023-12-26 14:06:11,960][123091] Updated weights for policy 0, policy_version 1816816 (0.0010) [2023-12-26 14:06:12,345][123090] Updated weights for policy 1, policy_version 1804993 (0.0010) [2023-12-26 14:06:12,411][123090] Updated weights for policy 1, policy_version 1805003 (0.0008) [2023-12-26 14:06:12,474][123090] Updated weights for policy 1, policy_version 1805013 (0.0008) [2023-12-26 14:06:12,542][123090] Updated weights for policy 1, policy_version 1805023 (0.0008) [2023-12-26 14:06:12,813][123091] Updated weights for policy 0, policy_version 1816826 (0.0009) [2023-12-26 14:06:12,872][123091] Updated weights for policy 0, policy_version 1816836 (0.0010) [2023-12-26 14:06:12,928][123091] Updated weights for policy 0, policy_version 1816846 (0.0009) [2023-12-26 14:06:13,281][123090] Updated weights for policy 1, policy_version 1805033 (0.0010) [2023-12-26 14:06:13,347][123090] Updated weights for policy 1, policy_version 1805043 (0.0010) [2023-12-26 14:06:13,416][123090] Updated weights for policy 1, policy_version 1805053 (0.0010) [2023-12-26 14:06:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 927211520. Throughput: 0: 8899.1, 1: 8971.4. Samples: 927208124. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:13,785][121949] Avg episode reward: [(0, '6205.087'), (1, '5231.874')] [2023-12-26 14:06:13,813][123091] Updated weights for policy 0, policy_version 1816856 (0.0010) [2023-12-26 14:06:13,867][123091] Updated weights for policy 0, policy_version 1816866 (0.0010) [2023-12-26 14:06:13,930][123091] Updated weights for policy 0, policy_version 1816876 (0.0010) [2023-12-26 14:06:14,181][123090] Updated weights for policy 1, policy_version 1805063 (0.0007) [2023-12-26 14:06:14,242][123090] Updated weights for policy 1, policy_version 1805073 (0.0007) [2023-12-26 14:06:14,306][123090] Updated weights for policy 1, policy_version 1805083 (0.0006) [2023-12-26 14:06:14,733][123091] Updated weights for policy 0, policy_version 1816886 (0.0010) [2023-12-26 14:06:14,804][123091] Updated weights for policy 0, policy_version 1816896 (0.0008) [2023-12-26 14:06:14,870][123091] Updated weights for policy 0, policy_version 1816906 (0.0010) [2023-12-26 14:06:15,107][123090] Updated weights for policy 1, policy_version 1805093 (0.0009) [2023-12-26 14:06:15,171][123090] Updated weights for policy 1, policy_version 1805103 (0.0009) [2023-12-26 14:06:15,233][123090] Updated weights for policy 1, policy_version 1805113 (0.0009) [2023-12-26 14:06:15,650][123091] Updated weights for policy 0, policy_version 1816916 (0.0008) [2023-12-26 14:06:15,696][123091] Updated weights for policy 0, policy_version 1816926 (0.0005) [2023-12-26 14:06:15,751][123091] Updated weights for policy 0, policy_version 1816936 (0.0005) [2023-12-26 14:06:15,884][123090] Updated weights for policy 1, policy_version 1805123 (0.0007) [2023-12-26 14:06:15,948][123090] Updated weights for policy 1, policy_version 1805133 (0.0009) [2023-12-26 14:06:16,011][123090] Updated weights for policy 1, policy_version 1805143 (0.0010) [2023-12-26 14:06:16,516][123091] Updated weights for policy 0, policy_version 1816946 (0.0008) [2023-12-26 14:06:16,571][123091] Updated weights for policy 0, policy_version 1816956 (0.0010) [2023-12-26 14:06:16,625][123091] Updated weights for policy 0, policy_version 1816966 (0.0010) [2023-12-26 14:06:16,676][123091] Updated weights for policy 0, policy_version 1816976 (0.0010) [2023-12-26 14:06:16,869][123090] Updated weights for policy 1, policy_version 1805153 (0.0010) [2023-12-26 14:06:16,936][123090] Updated weights for policy 1, policy_version 1805163 (0.0010) [2023-12-26 14:06:16,987][123090] Updated weights for policy 1, policy_version 1805173 (0.0010) [2023-12-26 14:06:17,045][123090] Updated weights for policy 1, policy_version 1805183 (0.0010) [2023-12-26 14:06:17,424][123091] Updated weights for policy 0, policy_version 1816986 (0.0005) [2023-12-26 14:06:17,486][123091] Updated weights for policy 0, policy_version 1816996 (0.0008) [2023-12-26 14:06:17,534][123091] Updated weights for policy 0, policy_version 1817006 (0.0008) [2023-12-26 14:06:17,868][123090] Updated weights for policy 1, policy_version 1805193 (0.0009) [2023-12-26 14:06:17,931][123090] Updated weights for policy 1, policy_version 1805203 (0.0009) [2023-12-26 14:06:17,983][123090] Updated weights for policy 1, policy_version 1805213 (0.0009) [2023-12-26 14:06:18,349][123091] Updated weights for policy 0, policy_version 1817016 (0.0009) [2023-12-26 14:06:18,414][123091] Updated weights for policy 0, policy_version 1817026 (0.0009) [2023-12-26 14:06:18,480][123091] Updated weights for policy 0, policy_version 1817036 (0.0009) [2023-12-26 14:06:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 927301632. Throughput: 0: 8891.4, 1: 8981.9. Samples: 927314652. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:18,784][121949] Avg episode reward: [(0, '6295.114'), (1, '5449.943')] [2023-12-26 14:06:18,818][123090] Updated weights for policy 1, policy_version 1805224 (0.0010) [2023-12-26 14:06:18,892][123090] Updated weights for policy 1, policy_version 1805234 (0.0009) [2023-12-26 14:06:18,953][123090] Updated weights for policy 1, policy_version 1805244 (0.0009) [2023-12-26 14:06:19,250][123091] Updated weights for policy 0, policy_version 1817046 (0.0008) [2023-12-26 14:06:19,305][123091] Updated weights for policy 0, policy_version 1817056 (0.0010) [2023-12-26 14:06:19,373][123091] Updated weights for policy 0, policy_version 1817066 (0.0009) [2023-12-26 14:06:19,771][123090] Updated weights for policy 1, policy_version 1805254 (0.0008) [2023-12-26 14:06:19,848][123090] Updated weights for policy 1, policy_version 1805264 (0.0008) [2023-12-26 14:06:19,921][123090] Updated weights for policy 1, policy_version 1805274 (0.0007) [2023-12-26 14:06:20,228][123091] Updated weights for policy 0, policy_version 1817076 (0.0010) [2023-12-26 14:06:20,299][123091] Updated weights for policy 0, policy_version 1817086 (0.0009) [2023-12-26 14:06:20,366][123091] Updated weights for policy 0, policy_version 1817096 (0.0010) [2023-12-26 14:06:20,705][123090] Updated weights for policy 1, policy_version 1805284 (0.0008) [2023-12-26 14:06:20,781][123090] Updated weights for policy 1, policy_version 1805294 (0.0009) [2023-12-26 14:06:20,852][123090] Updated weights for policy 1, policy_version 1805304 (0.0010) [2023-12-26 14:06:21,257][123091] Updated weights for policy 0, policy_version 1817106 (0.0010) [2023-12-26 14:06:21,323][123091] Updated weights for policy 0, policy_version 1817116 (0.0009) [2023-12-26 14:06:21,394][123091] Updated weights for policy 0, policy_version 1817126 (0.0009) [2023-12-26 14:06:21,461][123091] Updated weights for policy 0, policy_version 1817136 (0.0008) [2023-12-26 14:06:21,678][123090] Updated weights for policy 1, policy_version 1805314 (0.0009) [2023-12-26 14:06:21,750][123090] Updated weights for policy 1, policy_version 1805324 (0.0010) [2023-12-26 14:06:21,817][123090] Updated weights for policy 1, policy_version 1805334 (0.0009) [2023-12-26 14:06:21,877][123090] Updated weights for policy 1, policy_version 1805344 (0.0010) [2023-12-26 14:06:22,232][123091] Updated weights for policy 0, policy_version 1817146 (0.0008) [2023-12-26 14:06:22,296][123091] Updated weights for policy 0, policy_version 1817156 (0.0008) [2023-12-26 14:06:22,358][123091] Updated weights for policy 0, policy_version 1817166 (0.0008) [2023-12-26 14:06:22,755][123090] Updated weights for policy 1, policy_version 1805354 (0.0009) [2023-12-26 14:06:22,821][123090] Updated weights for policy 1, policy_version 1805364 (0.0010) [2023-12-26 14:06:22,887][123090] Updated weights for policy 1, policy_version 1805374 (0.0009) [2023-12-26 14:06:23,089][123091] Updated weights for policy 0, policy_version 1817176 (0.0010) [2023-12-26 14:06:23,142][123091] Updated weights for policy 0, policy_version 1817186 (0.0009) [2023-12-26 14:06:23,195][123091] Updated weights for policy 0, policy_version 1817196 (0.0009) [2023-12-26 14:06:23,703][123090] Updated weights for policy 1, policy_version 1805384 (0.0010) [2023-12-26 14:06:23,750][123090] Updated weights for policy 1, policy_version 1805394 (0.0010) [2023-12-26 14:06:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 927383552. Throughput: 0: 8843.7, 1: 8933.8. Samples: 927365436. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:23,785][121949] Avg episode reward: [(0, '6352.623'), (1, '5405.216')] [2023-12-26 14:06:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001817200_465207296.pth... [2023-12-26 14:06:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001816176_464945152.pth [2023-12-26 14:06:23,797][123090] Updated weights for policy 1, policy_version 1805404 (0.0010) [2023-12-26 14:06:23,813][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001805408_462184448.pth... [2023-12-26 14:06:23,816][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001804352_461914112.pth [2023-12-26 14:06:24,042][123091] Updated weights for policy 0, policy_version 1817206 (0.0009) [2023-12-26 14:06:24,112][123091] Updated weights for policy 0, policy_version 1817216 (0.0008) [2023-12-26 14:06:24,187][123091] Updated weights for policy 0, policy_version 1817226 (0.0007) [2023-12-26 14:06:24,631][123090] Updated weights for policy 1, policy_version 1805414 (0.0010) [2023-12-26 14:06:24,682][123090] Updated weights for policy 1, policy_version 1805424 (0.0010) [2023-12-26 14:06:24,732][123090] Updated weights for policy 1, policy_version 1805434 (0.0008) [2023-12-26 14:06:24,818][123091] Updated weights for policy 0, policy_version 1817236 (0.0005) [2023-12-26 14:06:24,884][123091] Updated weights for policy 0, policy_version 1817246 (0.0006) [2023-12-26 14:06:24,941][123091] Updated weights for policy 0, policy_version 1817256 (0.0005) [2023-12-26 14:06:25,530][123090] Updated weights for policy 1, policy_version 1805444 (0.0007) [2023-12-26 14:06:25,593][123090] Updated weights for policy 1, policy_version 1805454 (0.0010) [2023-12-26 14:06:25,621][123091] Updated weights for policy 0, policy_version 1817266 (0.0005) [2023-12-26 14:06:25,663][123090] Updated weights for policy 1, policy_version 1805464 (0.0010) [2023-12-26 14:06:25,687][123091] Updated weights for policy 0, policy_version 1817276 (0.0006) [2023-12-26 14:06:25,749][123091] Updated weights for policy 0, policy_version 1817286 (0.0009) [2023-12-26 14:06:25,814][123091] Updated weights for policy 0, policy_version 1817296 (0.0007) [2023-12-26 14:06:26,466][123090] Updated weights for policy 1, policy_version 1805474 (0.0010) [2023-12-26 14:06:26,517][123090] Updated weights for policy 1, policy_version 1805484 (0.0008) [2023-12-26 14:06:26,561][123091] Updated weights for policy 0, policy_version 1817306 (0.0010) [2023-12-26 14:06:26,568][123090] Updated weights for policy 1, policy_version 1805494 (0.0005) [2023-12-26 14:06:26,605][123091] Updated weights for policy 0, policy_version 1817316 (0.0010) [2023-12-26 14:06:26,624][123090] Updated weights for policy 1, policy_version 1805504 (0.0006) [2023-12-26 14:06:26,666][123091] Updated weights for policy 0, policy_version 1817326 (0.0010) [2023-12-26 14:06:27,487][123090] Updated weights for policy 1, policy_version 1805514 (0.0006) [2023-12-26 14:06:27,495][123091] Updated weights for policy 0, policy_version 1817336 (0.0005) [2023-12-26 14:06:27,545][123090] Updated weights for policy 1, policy_version 1805524 (0.0010) [2023-12-26 14:06:27,551][123091] Updated weights for policy 0, policy_version 1817346 (0.0005) [2023-12-26 14:06:27,600][123090] Updated weights for policy 1, policy_version 1805534 (0.0010) [2023-12-26 14:06:27,602][123091] Updated weights for policy 0, policy_version 1817356 (0.0005) [2023-12-26 14:06:28,205][123090] Updated weights for policy 1, policy_version 1805544 (0.0006) [2023-12-26 14:06:28,258][123090] Updated weights for policy 1, policy_version 1805554 (0.0006) [2023-12-26 14:06:28,281][123091] Updated weights for policy 0, policy_version 1817366 (0.0008) [2023-12-26 14:06:28,311][123090] Updated weights for policy 1, policy_version 1805564 (0.0005) [2023-12-26 14:06:28,348][123091] Updated weights for policy 0, policy_version 1817376 (0.0009) [2023-12-26 14:06:28,413][123091] Updated weights for policy 0, policy_version 1817386 (0.0008) [2023-12-26 14:06:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 927481856. Throughput: 0: 8932.9, 1: 8934.6. Samples: 927473340. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:28,784][121949] Avg episode reward: [(0, '6331.497'), (1, '5274.566')] [2023-12-26 14:06:29,078][123090] Updated weights for policy 1, policy_version 1805574 (0.0009) [2023-12-26 14:06:29,128][123090] Updated weights for policy 1, policy_version 1805584 (0.0010) [2023-12-26 14:06:29,175][123090] Updated weights for policy 1, policy_version 1805594 (0.0010) [2023-12-26 14:06:29,221][123091] Updated weights for policy 0, policy_version 1817396 (0.0009) [2023-12-26 14:06:29,295][123091] Updated weights for policy 0, policy_version 1817406 (0.0008) [2023-12-26 14:06:29,359][123091] Updated weights for policy 0, policy_version 1817416 (0.0007) [2023-12-26 14:06:30,069][123090] Updated weights for policy 1, policy_version 1805604 (0.0010) [2023-12-26 14:06:30,103][123091] Updated weights for policy 0, policy_version 1817426 (0.0008) [2023-12-26 14:06:30,132][123090] Updated weights for policy 1, policy_version 1805614 (0.0009) [2023-12-26 14:06:30,164][123091] Updated weights for policy 0, policy_version 1817436 (0.0009) [2023-12-26 14:06:30,196][123090] Updated weights for policy 1, policy_version 1805624 (0.0007) [2023-12-26 14:06:30,225][123091] Updated weights for policy 0, policy_version 1817446 (0.0008) [2023-12-26 14:06:30,287][123091] Updated weights for policy 0, policy_version 1817456 (0.0006) [2023-12-26 14:06:30,897][123090] Updated weights for policy 1, policy_version 1805634 (0.0008) [2023-12-26 14:06:30,979][123091] Updated weights for policy 0, policy_version 1817466 (0.0006) [2023-12-26 14:06:30,987][123090] Updated weights for policy 1, policy_version 1805644 (0.0007) [2023-12-26 14:06:31,043][123090] Updated weights for policy 1, policy_version 1805654 (0.0009) [2023-12-26 14:06:31,045][123091] Updated weights for policy 0, policy_version 1817476 (0.0007) [2023-12-26 14:06:31,107][123091] Updated weights for policy 0, policy_version 1817486 (0.0007) [2023-12-26 14:06:31,113][123090] Updated weights for policy 1, policy_version 1805664 (0.0009) [2023-12-26 14:06:31,758][123091] Updated weights for policy 0, policy_version 1817496 (0.0009) [2023-12-26 14:06:31,819][123091] Updated weights for policy 0, policy_version 1817506 (0.0009) [2023-12-26 14:06:31,883][123091] Updated weights for policy 0, policy_version 1817516 (0.0011) [2023-12-26 14:06:31,940][123090] Updated weights for policy 1, policy_version 1805674 (0.0008) [2023-12-26 14:06:32,000][123090] Updated weights for policy 1, policy_version 1805684 (0.0008) [2023-12-26 14:06:32,052][123090] Updated weights for policy 1, policy_version 1805694 (0.0010) [2023-12-26 14:06:32,606][123091] Updated weights for policy 0, policy_version 1817526 (0.0007) [2023-12-26 14:06:32,666][123091] Updated weights for policy 0, policy_version 1817536 (0.0005) [2023-12-26 14:06:32,713][123091] Updated weights for policy 0, policy_version 1817546 (0.0005) [2023-12-26 14:06:33,008][123090] Updated weights for policy 1, policy_version 1805704 (0.0010) [2023-12-26 14:06:33,069][123090] Updated weights for policy 1, policy_version 1805714 (0.0009) [2023-12-26 14:06:33,121][123090] Updated weights for policy 1, policy_version 1805724 (0.0009) [2023-12-26 14:06:33,365][123091] Updated weights for policy 0, policy_version 1817556 (0.0005) [2023-12-26 14:06:33,422][123091] Updated weights for policy 0, policy_version 1817566 (0.0005) [2023-12-26 14:06:33,475][123091] Updated weights for policy 0, policy_version 1817576 (0.0005) [2023-12-26 14:06:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 927571968. Throughput: 0: 9048.1, 1: 8830.5. Samples: 927583252. Policy #0 lag: (min: 31.0, avg: 37.3, max: 63.0) [2023-12-26 14:06:33,785][121949] Avg episode reward: [(0, '6126.871'), (1, '5463.148')] [2023-12-26 14:06:34,051][123090] Updated weights for policy 1, policy_version 1805734 (0.0010) [2023-12-26 14:06:34,102][123090] Updated weights for policy 1, policy_version 1805744 (0.0009) [2023-12-26 14:06:34,125][123091] Updated weights for policy 0, policy_version 1817586 (0.0006) [2023-12-26 14:06:34,169][123090] Updated weights for policy 1, policy_version 1805754 (0.0009) [2023-12-26 14:06:34,189][123091] Updated weights for policy 0, policy_version 1817596 (0.0008) [2023-12-26 14:06:34,243][123091] Updated weights for policy 0, policy_version 1817606 (0.0006) [2023-12-26 14:06:34,293][123091] Updated weights for policy 0, policy_version 1817616 (0.0005) [2023-12-26 14:06:35,045][123090] Updated weights for policy 1, policy_version 1805764 (0.0007) [2023-12-26 14:06:35,050][123091] Updated weights for policy 0, policy_version 1817626 (0.0011) [2023-12-26 14:06:35,095][123090] Updated weights for policy 1, policy_version 1805774 (0.0008) [2023-12-26 14:06:35,108][123091] Updated weights for policy 0, policy_version 1817636 (0.0010) [2023-12-26 14:06:35,154][123090] Updated weights for policy 1, policy_version 1805784 (0.0006) [2023-12-26 14:06:35,159][123091] Updated weights for policy 0, policy_version 1817646 (0.0010) [2023-12-26 14:06:35,836][123091] Updated weights for policy 0, policy_version 1817656 (0.0006) [2023-12-26 14:06:35,879][123090] Updated weights for policy 1, policy_version 1805794 (0.0007) [2023-12-26 14:06:35,899][123091] Updated weights for policy 0, policy_version 1817666 (0.0006) [2023-12-26 14:06:35,949][123090] Updated weights for policy 1, policy_version 1805804 (0.0005) [2023-12-26 14:06:35,969][123091] Updated weights for policy 0, policy_version 1817676 (0.0005) [2023-12-26 14:06:36,022][123090] Updated weights for policy 1, policy_version 1805814 (0.0008) [2023-12-26 14:06:36,090][123090] Updated weights for policy 1, policy_version 1805824 (0.0009) [2023-12-26 14:06:36,715][123091] Updated weights for policy 0, policy_version 1817686 (0.0006) [2023-12-26 14:06:36,794][123091] Updated weights for policy 0, policy_version 1817696 (0.0006) [2023-12-26 14:06:36,835][123090] Updated weights for policy 1, policy_version 1805834 (0.0008) [2023-12-26 14:06:36,846][123091] Updated weights for policy 0, policy_version 1817706 (0.0006) [2023-12-26 14:06:36,902][123090] Updated weights for policy 1, policy_version 1805844 (0.0009) [2023-12-26 14:06:36,968][123090] Updated weights for policy 1, policy_version 1805854 (0.0009) [2023-12-26 14:06:37,559][123091] Updated weights for policy 0, policy_version 1817716 (0.0007) [2023-12-26 14:06:37,606][123091] Updated weights for policy 0, policy_version 1817726 (0.0009) [2023-12-26 14:06:37,662][123091] Updated weights for policy 0, policy_version 1817737 (0.0010) [2023-12-26 14:06:37,830][123090] Updated weights for policy 1, policy_version 1805864 (0.0009) [2023-12-26 14:06:37,884][123090] Updated weights for policy 1, policy_version 1805874 (0.0009) [2023-12-26 14:06:37,939][123090] Updated weights for policy 1, policy_version 1805884 (0.0009) [2023-12-26 14:06:38,530][123091] Updated weights for policy 0, policy_version 1817747 (0.0009) [2023-12-26 14:06:38,590][123091] Updated weights for policy 0, policy_version 1817757 (0.0010) [2023-12-26 14:06:38,642][123091] Updated weights for policy 0, policy_version 1817767 (0.0009) [2023-12-26 14:06:38,758][123090] Updated weights for policy 1, policy_version 1805894 (0.0007) [2023-12-26 14:06:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 927662080. Throughput: 0: 9118.6, 1: 8814.3. Samples: 927638452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:06:38,785][121949] Avg episode reward: [(0, '6139.533'), (1, '5335.801')] [2023-12-26 14:06:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001817776_465354752.pth... [2023-12-26 14:06:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001816688_465076224.pth [2023-12-26 14:06:38,820][123090] Updated weights for policy 1, policy_version 1805904 (0.0006) [2023-12-26 14:06:38,881][123090] Updated weights for policy 1, policy_version 1805914 (0.0005) [2023-12-26 14:06:38,910][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001805920_462315520.pth... [2023-12-26 14:06:38,914][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001804896_462053376.pth [2023-12-26 14:06:39,562][123091] Updated weights for policy 0, policy_version 1817777 (0.0009) [2023-12-26 14:06:39,611][123090] Updated weights for policy 1, policy_version 1805924 (0.0007) [2023-12-26 14:06:39,619][123091] Updated weights for policy 0, policy_version 1817787 (0.0005) [2023-12-26 14:06:39,670][123090] Updated weights for policy 1, policy_version 1805934 (0.0008) [2023-12-26 14:06:39,681][123091] Updated weights for policy 0, policy_version 1817797 (0.0008) [2023-12-26 14:06:39,734][123090] Updated weights for policy 1, policy_version 1805944 (0.0008) [2023-12-26 14:06:39,746][123091] Updated weights for policy 0, policy_version 1817807 (0.0008) [2023-12-26 14:06:40,535][123090] Updated weights for policy 1, policy_version 1805954 (0.0009) [2023-12-26 14:06:40,569][123091] Updated weights for policy 0, policy_version 1817817 (0.0009) [2023-12-26 14:06:40,597][123090] Updated weights for policy 1, policy_version 1805964 (0.0008) [2023-12-26 14:06:40,626][123091] Updated weights for policy 0, policy_version 1817827 (0.0008) [2023-12-26 14:06:40,664][123090] Updated weights for policy 1, policy_version 1805974 (0.0007) [2023-12-26 14:06:40,673][123091] Updated weights for policy 0, policy_version 1817837 (0.0009) [2023-12-26 14:06:40,733][123090] Updated weights for policy 1, policy_version 1805984 (0.0010) [2023-12-26 14:06:41,538][123090] Updated weights for policy 1, policy_version 1805994 (0.0009) [2023-12-26 14:06:41,558][123091] Updated weights for policy 0, policy_version 1817847 (0.0008) [2023-12-26 14:06:41,600][123090] Updated weights for policy 1, policy_version 1806004 (0.0008) [2023-12-26 14:06:41,615][123091] Updated weights for policy 0, policy_version 1817857 (0.0007) [2023-12-26 14:06:41,676][123090] Updated weights for policy 1, policy_version 1806014 (0.0009) [2023-12-26 14:06:41,688][123091] Updated weights for policy 0, policy_version 1817867 (0.0007) [2023-12-26 14:06:42,487][123090] Updated weights for policy 1, policy_version 1806024 (0.0009) [2023-12-26 14:06:42,536][123090] Updated weights for policy 1, policy_version 1806034 (0.0009) [2023-12-26 14:06:42,538][123091] Updated weights for policy 0, policy_version 1817877 (0.0008) [2023-12-26 14:06:42,592][123090] Updated weights for policy 1, policy_version 1806044 (0.0009) [2023-12-26 14:06:42,601][123091] Updated weights for policy 0, policy_version 1817887 (0.0008) [2023-12-26 14:06:42,662][123091] Updated weights for policy 0, policy_version 1817897 (0.0010) [2023-12-26 14:06:43,458][123091] Updated weights for policy 0, policy_version 1817907 (0.0007) [2023-12-26 14:06:43,462][123090] Updated weights for policy 1, policy_version 1806054 (0.0009) [2023-12-26 14:06:43,521][123091] Updated weights for policy 0, policy_version 1817917 (0.0007) [2023-12-26 14:06:43,524][123090] Updated weights for policy 1, policy_version 1806064 (0.0009) [2023-12-26 14:06:43,582][123090] Updated weights for policy 1, policy_version 1806074 (0.0008) [2023-12-26 14:06:43,584][123091] Updated weights for policy 0, policy_version 1817927 (0.0007) [2023-12-26 14:06:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 927752192. Throughput: 0: 9023.9, 1: 8721.8. Samples: 927741012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:06:43,785][121949] Avg episode reward: [(0, '6241.089'), (1, '5397.694')] [2023-12-26 14:06:44,268][123091] Updated weights for policy 0, policy_version 1817937 (0.0007) [2023-12-26 14:06:44,332][123091] Updated weights for policy 0, policy_version 1817947 (0.0005) [2023-12-26 14:06:44,381][123091] Updated weights for policy 0, policy_version 1817957 (0.0005) [2023-12-26 14:06:44,430][123091] Updated weights for policy 0, policy_version 1817967 (0.0005) [2023-12-26 14:06:44,507][123090] Updated weights for policy 1, policy_version 1806084 (0.0009) [2023-12-26 14:06:44,568][123090] Updated weights for policy 1, policy_version 1806094 (0.0009) [2023-12-26 14:06:44,632][123090] Updated weights for policy 1, policy_version 1806104 (0.0010) [2023-12-26 14:06:45,171][123091] Updated weights for policy 0, policy_version 1817977 (0.0010) [2023-12-26 14:06:45,235][123091] Updated weights for policy 0, policy_version 1817987 (0.0011) [2023-12-26 14:06:45,303][123091] Updated weights for policy 0, policy_version 1817997 (0.0011) [2023-12-26 14:06:45,471][123090] Updated weights for policy 1, policy_version 1806114 (0.0009) [2023-12-26 14:06:45,530][123090] Updated weights for policy 1, policy_version 1806124 (0.0009) [2023-12-26 14:06:45,580][123090] Updated weights for policy 1, policy_version 1806134 (0.0009) [2023-12-26 14:06:45,640][123090] Updated weights for policy 1, policy_version 1806144 (0.0008) [2023-12-26 14:06:46,121][123091] Updated weights for policy 0, policy_version 1818007 (0.0009) [2023-12-26 14:06:46,179][123091] Updated weights for policy 0, policy_version 1818017 (0.0006) [2023-12-26 14:06:46,234][123091] Updated weights for policy 0, policy_version 1818027 (0.0005) [2023-12-26 14:06:46,506][123090] Updated weights for policy 1, policy_version 1806154 (0.0011) [2023-12-26 14:06:46,573][123090] Updated weights for policy 1, policy_version 1806164 (0.0011) [2023-12-26 14:06:46,629][123090] Updated weights for policy 1, policy_version 1806174 (0.0010) [2023-12-26 14:06:46,979][123091] Updated weights for policy 0, policy_version 1818037 (0.0006) [2023-12-26 14:06:47,031][123091] Updated weights for policy 0, policy_version 1818047 (0.0007) [2023-12-26 14:06:47,078][123091] Updated weights for policy 0, policy_version 1818057 (0.0006) [2023-12-26 14:06:47,456][123090] Updated weights for policy 1, policy_version 1806184 (0.0010) [2023-12-26 14:06:47,517][123090] Updated weights for policy 1, policy_version 1806194 (0.0010) [2023-12-26 14:06:47,581][123090] Updated weights for policy 1, policy_version 1806204 (0.0010) [2023-12-26 14:06:47,743][123091] Updated weights for policy 0, policy_version 1818067 (0.0006) [2023-12-26 14:06:47,803][123091] Updated weights for policy 0, policy_version 1818077 (0.0006) [2023-12-26 14:06:47,856][123091] Updated weights for policy 0, policy_version 1818087 (0.0006) [2023-12-26 14:06:48,392][123090] Updated weights for policy 1, policy_version 1806214 (0.0010) [2023-12-26 14:06:48,457][123090] Updated weights for policy 1, policy_version 1806224 (0.0009) [2023-12-26 14:06:48,510][123090] Updated weights for policy 1, policy_version 1806234 (0.0007) [2023-12-26 14:06:48,647][123091] Updated weights for policy 0, policy_version 1818097 (0.0008) [2023-12-26 14:06:48,701][123091] Updated weights for policy 0, policy_version 1818107 (0.0010) [2023-12-26 14:06:48,760][123091] Updated weights for policy 0, policy_version 1818117 (0.0010) [2023-12-26 14:06:48,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 927834112. Throughput: 0: 9078.3, 1: 8616.5. Samples: 927847532. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:06:48,784][121949] Avg episode reward: [(0, '6083.641'), (1, '5351.209')] [2023-12-26 14:06:48,819][123091] Updated weights for policy 0, policy_version 1818127 (0.0010) [2023-12-26 14:06:49,338][123090] Updated weights for policy 1, policy_version 1806244 (0.0007) [2023-12-26 14:06:49,409][123090] Updated weights for policy 1, policy_version 1806254 (0.0007) [2023-12-26 14:06:49,470][123090] Updated weights for policy 1, policy_version 1806264 (0.0009) [2023-12-26 14:06:49,629][123091] Updated weights for policy 0, policy_version 1818137 (0.0011) [2023-12-26 14:06:49,680][123091] Updated weights for policy 0, policy_version 1818147 (0.0010) [2023-12-26 14:06:49,731][123091] Updated weights for policy 0, policy_version 1818157 (0.0010) [2023-12-26 14:06:50,285][123090] Updated weights for policy 1, policy_version 1806274 (0.0007) [2023-12-26 14:06:50,350][123090] Updated weights for policy 1, policy_version 1806284 (0.0010) [2023-12-26 14:06:50,405][123090] Updated weights for policy 1, policy_version 1806294 (0.0010) [2023-12-26 14:06:50,463][123090] Updated weights for policy 1, policy_version 1806304 (0.0010) [2023-12-26 14:06:50,545][123091] Updated weights for policy 0, policy_version 1818167 (0.0006) [2023-12-26 14:06:50,614][123091] Updated weights for policy 0, policy_version 1818177 (0.0007) [2023-12-26 14:06:50,683][123091] Updated weights for policy 0, policy_version 1818187 (0.0009) [2023-12-26 14:06:51,416][123090] Updated weights for policy 1, policy_version 1806314 (0.0007) [2023-12-26 14:06:51,430][123091] Updated weights for policy 0, policy_version 1818197 (0.0009) [2023-12-26 14:06:51,484][123090] Updated weights for policy 1, policy_version 1806324 (0.0007) [2023-12-26 14:06:51,492][123091] Updated weights for policy 0, policy_version 1818207 (0.0008) [2023-12-26 14:06:51,557][123090] Updated weights for policy 1, policy_version 1806334 (0.0007) [2023-12-26 14:06:51,567][123091] Updated weights for policy 0, policy_version 1818217 (0.0008) [2023-12-26 14:06:52,341][123091] Updated weights for policy 0, policy_version 1818227 (0.0008) [2023-12-26 14:06:52,354][123090] Updated weights for policy 1, policy_version 1806344 (0.0007) [2023-12-26 14:06:52,407][123091] Updated weights for policy 0, policy_version 1818237 (0.0010) [2023-12-26 14:06:52,410][123090] Updated weights for policy 1, policy_version 1806354 (0.0006) [2023-12-26 14:06:52,466][123090] Updated weights for policy 1, policy_version 1806364 (0.0007) [2023-12-26 14:06:52,471][123091] Updated weights for policy 0, policy_version 1818247 (0.0010) [2023-12-26 14:06:53,151][123090] Updated weights for policy 1, policy_version 1806374 (0.0006) [2023-12-26 14:06:53,217][123090] Updated weights for policy 1, policy_version 1806384 (0.0010) [2023-12-26 14:06:53,221][123091] Updated weights for policy 0, policy_version 1818257 (0.0009) [2023-12-26 14:06:53,273][123091] Updated weights for policy 0, policy_version 1818267 (0.0008) [2023-12-26 14:06:53,275][123090] Updated weights for policy 1, policy_version 1806394 (0.0010) [2023-12-26 14:06:53,326][123091] Updated weights for policy 0, policy_version 1818277 (0.0007) [2023-12-26 14:06:53,377][123091] Updated weights for policy 0, policy_version 1818287 (0.0009) [2023-12-26 14:06:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 927924224. Throughput: 0: 9068.2, 1: 8587.4. Samples: 927898828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:06:53,785][121949] Avg episode reward: [(0, '6057.137'), (1, '5397.673')] [2023-12-26 14:06:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001818288_465485824.pth... [2023-12-26 14:06:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001806400_462438400.pth... [2023-12-26 14:06:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001817200_465207296.pth [2023-12-26 14:06:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001805408_462184448.pth [2023-12-26 14:06:54,062][123090] Updated weights for policy 1, policy_version 1806404 (0.0010) [2023-12-26 14:06:54,085][123091] Updated weights for policy 0, policy_version 1818297 (0.0006) [2023-12-26 14:06:54,123][123090] Updated weights for policy 1, policy_version 1806414 (0.0008) [2023-12-26 14:06:54,137][123091] Updated weights for policy 0, policy_version 1818307 (0.0005) [2023-12-26 14:06:54,176][123090] Updated weights for policy 1, policy_version 1806424 (0.0008) [2023-12-26 14:06:54,197][123091] Updated weights for policy 0, policy_version 1818317 (0.0006) [2023-12-26 14:06:54,917][123090] Updated weights for policy 1, policy_version 1806434 (0.0008) [2023-12-26 14:06:54,981][123090] Updated weights for policy 1, policy_version 1806444 (0.0009) [2023-12-26 14:06:55,004][123091] Updated weights for policy 0, policy_version 1818327 (0.0010) [2023-12-26 14:06:55,040][123090] Updated weights for policy 1, policy_version 1806454 (0.0006) [2023-12-26 14:06:55,063][123091] Updated weights for policy 0, policy_version 1818337 (0.0011) [2023-12-26 14:06:55,096][123090] Updated weights for policy 1, policy_version 1806464 (0.0007) [2023-12-26 14:06:55,114][123091] Updated weights for policy 0, policy_version 1818347 (0.0010) [2023-12-26 14:06:55,920][123090] Updated weights for policy 1, policy_version 1806474 (0.0010) [2023-12-26 14:06:55,949][123091] Updated weights for policy 0, policy_version 1818357 (0.0009) [2023-12-26 14:06:55,981][123090] Updated weights for policy 1, policy_version 1806484 (0.0009) [2023-12-26 14:06:56,009][123091] Updated weights for policy 0, policy_version 1818367 (0.0008) [2023-12-26 14:06:56,050][123090] Updated weights for policy 1, policy_version 1806494 (0.0007) [2023-12-26 14:06:56,060][123091] Updated weights for policy 0, policy_version 1818377 (0.0009) [2023-12-26 14:06:56,759][123091] Updated weights for policy 0, policy_version 1818387 (0.0007) [2023-12-26 14:06:56,802][123091] Updated weights for policy 0, policy_version 1818397 (0.0008) [2023-12-26 14:06:56,849][123091] Updated weights for policy 0, policy_version 1818408 (0.0007) [2023-12-26 14:06:56,936][123090] Updated weights for policy 1, policy_version 1806504 (0.0008) [2023-12-26 14:06:56,991][123090] Updated weights for policy 1, policy_version 1806514 (0.0009) [2023-12-26 14:06:57,046][123090] Updated weights for policy 1, policy_version 1806524 (0.0006) [2023-12-26 14:06:57,684][123091] Updated weights for policy 0, policy_version 1818418 (0.0006) [2023-12-26 14:06:57,748][123091] Updated weights for policy 0, policy_version 1818428 (0.0009) [2023-12-26 14:06:57,795][123090] Updated weights for policy 1, policy_version 1806534 (0.0008) [2023-12-26 14:06:57,815][123091] Updated weights for policy 0, policy_version 1818438 (0.0005) [2023-12-26 14:06:57,856][123090] Updated weights for policy 1, policy_version 1806544 (0.0009) [2023-12-26 14:06:57,874][123091] Updated weights for policy 0, policy_version 1818448 (0.0009) [2023-12-26 14:06:57,917][123090] Updated weights for policy 1, policy_version 1806554 (0.0008) [2023-12-26 14:06:58,691][123090] Updated weights for policy 1, policy_version 1806564 (0.0008) [2023-12-26 14:06:58,709][123091] Updated weights for policy 0, policy_version 1818458 (0.0010) [2023-12-26 14:06:58,758][123090] Updated weights for policy 1, policy_version 1806574 (0.0007) [2023-12-26 14:06:58,775][123091] Updated weights for policy 0, policy_version 1818468 (0.0011) [2023-12-26 14:06:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 928006144. Throughput: 0: 9128.0, 1: 8653.7. Samples: 928008300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:06:58,785][121949] Avg episode reward: [(0, '6160.800'), (1, '5833.998')] [2023-12-26 14:06:58,827][123090] Updated weights for policy 1, policy_version 1806584 (0.0008) [2023-12-26 14:06:58,839][123091] Updated weights for policy 0, policy_version 1818478 (0.0011) [2023-12-26 14:06:59,543][123091] Updated weights for policy 0, policy_version 1818488 (0.0007) [2023-12-26 14:06:59,608][123091] Updated weights for policy 0, policy_version 1818498 (0.0005) [2023-12-26 14:06:59,673][123091] Updated weights for policy 0, policy_version 1818508 (0.0005) [2023-12-26 14:06:59,713][123090] Updated weights for policy 1, policy_version 1806594 (0.0008) [2023-12-26 14:06:59,770][123090] Updated weights for policy 1, policy_version 1806604 (0.0009) [2023-12-26 14:06:59,832][123090] Updated weights for policy 1, policy_version 1806614 (0.0008) [2023-12-26 14:06:59,892][123090] Updated weights for policy 1, policy_version 1806624 (0.0010) [2023-12-26 14:07:00,284][123091] Updated weights for policy 0, policy_version 1818518 (0.0005) [2023-12-26 14:07:00,346][123091] Updated weights for policy 0, policy_version 1818528 (0.0006) [2023-12-26 14:07:00,416][123091] Updated weights for policy 0, policy_version 1818538 (0.0009) [2023-12-26 14:07:00,668][123090] Updated weights for policy 1, policy_version 1806634 (0.0010) [2023-12-26 14:07:00,720][123090] Updated weights for policy 1, policy_version 1806644 (0.0009) [2023-12-26 14:07:00,786][123090] Updated weights for policy 1, policy_version 1806654 (0.0009) [2023-12-26 14:07:01,087][123091] Updated weights for policy 0, policy_version 1818548 (0.0009) [2023-12-26 14:07:01,173][123091] Updated weights for policy 0, policy_version 1818558 (0.0009) [2023-12-26 14:07:01,232][123091] Updated weights for policy 0, policy_version 1818568 (0.0011) [2023-12-26 14:07:01,719][123090] Updated weights for policy 1, policy_version 1806664 (0.0009) [2023-12-26 14:07:01,793][123090] Updated weights for policy 1, policy_version 1806674 (0.0009) [2023-12-26 14:07:01,852][123090] Updated weights for policy 1, policy_version 1806684 (0.0009) [2023-12-26 14:07:01,973][123091] Updated weights for policy 0, policy_version 1818578 (0.0010) [2023-12-26 14:07:02,042][123091] Updated weights for policy 0, policy_version 1818588 (0.0010) [2023-12-26 14:07:02,109][123091] Updated weights for policy 0, policy_version 1818598 (0.0010) [2023-12-26 14:07:02,182][123091] Updated weights for policy 0, policy_version 1818608 (0.0011) [2023-12-26 14:07:02,556][123090] Updated weights for policy 1, policy_version 1806694 (0.0007) [2023-12-26 14:07:02,617][123090] Updated weights for policy 1, policy_version 1806704 (0.0005) [2023-12-26 14:07:02,665][123090] Updated weights for policy 1, policy_version 1806714 (0.0005) [2023-12-26 14:07:02,985][123091] Updated weights for policy 0, policy_version 1818618 (0.0009) [2023-12-26 14:07:03,040][123091] Updated weights for policy 0, policy_version 1818628 (0.0009) [2023-12-26 14:07:03,093][123091] Updated weights for policy 0, policy_version 1818638 (0.0009) [2023-12-26 14:07:03,383][123090] Updated weights for policy 1, policy_version 1806724 (0.0006) [2023-12-26 14:07:03,440][123090] Updated weights for policy 1, policy_version 1806734 (0.0005) [2023-12-26 14:07:03,502][123090] Updated weights for policy 1, policy_version 1806744 (0.0005) [2023-12-26 14:07:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 928104448. Throughput: 0: 9175.5, 1: 8647.3. Samples: 928116684. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:03,785][121949] Avg episode reward: [(0, '6250.381'), (1, '5851.610')] [2023-12-26 14:07:03,917][123091] Updated weights for policy 0, policy_version 1818648 (0.0007) [2023-12-26 14:07:03,977][123091] Updated weights for policy 0, policy_version 1818658 (0.0008) [2023-12-26 14:07:04,039][123091] Updated weights for policy 0, policy_version 1818668 (0.0011) [2023-12-26 14:07:04,156][123090] Updated weights for policy 1, policy_version 1806754 (0.0007) [2023-12-26 14:07:04,224][123090] Updated weights for policy 1, policy_version 1806764 (0.0008) [2023-12-26 14:07:04,296][123090] Updated weights for policy 1, policy_version 1806774 (0.0005) [2023-12-26 14:07:04,363][123090] Updated weights for policy 1, policy_version 1806784 (0.0005) [2023-12-26 14:07:04,796][123091] Updated weights for policy 0, policy_version 1818678 (0.0008) [2023-12-26 14:07:04,867][123091] Updated weights for policy 0, policy_version 1818688 (0.0006) [2023-12-26 14:07:04,939][123091] Updated weights for policy 0, policy_version 1818698 (0.0005) [2023-12-26 14:07:05,120][123090] Updated weights for policy 1, policy_version 1806794 (0.0010) [2023-12-26 14:07:05,178][123090] Updated weights for policy 1, policy_version 1806805 (0.0010) [2023-12-26 14:07:05,231][123090] Updated weights for policy 1, policy_version 1806815 (0.0010) [2023-12-26 14:07:05,536][123091] Updated weights for policy 0, policy_version 1818708 (0.0006) [2023-12-26 14:07:05,602][123091] Updated weights for policy 0, policy_version 1818718 (0.0010) [2023-12-26 14:07:05,664][123091] Updated weights for policy 0, policy_version 1818728 (0.0010) [2023-12-26 14:07:06,121][123090] Updated weights for policy 1, policy_version 1806825 (0.0009) [2023-12-26 14:07:06,190][123090] Updated weights for policy 1, policy_version 1806835 (0.0009) [2023-12-26 14:07:06,264][123090] Updated weights for policy 1, policy_version 1806845 (0.0009) [2023-12-26 14:07:06,349][123091] Updated weights for policy 0, policy_version 1818738 (0.0010) [2023-12-26 14:07:06,445][123091] Updated weights for policy 0, policy_version 1818748 (0.0010) [2023-12-26 14:07:06,512][123091] Updated weights for policy 0, policy_version 1818758 (0.0006) [2023-12-26 14:07:06,585][123091] Updated weights for policy 0, policy_version 1818768 (0.0006) [2023-12-26 14:07:07,021][123090] Updated weights for policy 1, policy_version 1806855 (0.0010) [2023-12-26 14:07:07,085][123090] Updated weights for policy 1, policy_version 1806865 (0.0009) [2023-12-26 14:07:07,144][123090] Updated weights for policy 1, policy_version 1806875 (0.0009) [2023-12-26 14:07:07,164][123091] Updated weights for policy 0, policy_version 1818778 (0.0006) [2023-12-26 14:07:07,222][123091] Updated weights for policy 0, policy_version 1818788 (0.0005) [2023-12-26 14:07:07,276][123091] Updated weights for policy 0, policy_version 1818798 (0.0006) [2023-12-26 14:07:08,010][123090] Updated weights for policy 1, policy_version 1806885 (0.0008) [2023-12-26 14:07:08,038][123091] Updated weights for policy 0, policy_version 1818808 (0.0009) [2023-12-26 14:07:08,072][123090] Updated weights for policy 1, policy_version 1806895 (0.0008) [2023-12-26 14:07:08,088][123091] Updated weights for policy 0, policy_version 1818818 (0.0008) [2023-12-26 14:07:08,125][123090] Updated weights for policy 1, policy_version 1806905 (0.0008) [2023-12-26 14:07:08,147][123091] Updated weights for policy 0, policy_version 1818828 (0.0009) [2023-12-26 14:07:08,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 928194560. Throughput: 0: 9275.4, 1: 8647.4. Samples: 928171960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:08,785][121949] Avg episode reward: [(0, '6161.806'), (1, '5486.259')] [2023-12-26 14:07:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001806912_462569472.pth... [2023-12-26 14:07:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001818832_465625088.pth... [2023-12-26 14:07:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001805920_462315520.pth [2023-12-26 14:07:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001817776_465354752.pth [2023-12-26 14:07:08,837][123090] Updated weights for policy 1, policy_version 1806915 (0.0008) [2023-12-26 14:07:08,891][123090] Updated weights for policy 1, policy_version 1806925 (0.0005) [2023-12-26 14:07:08,959][123090] Updated weights for policy 1, policy_version 1806935 (0.0005) [2023-12-26 14:07:09,053][123091] Updated weights for policy 0, policy_version 1818838 (0.0008) [2023-12-26 14:07:09,114][123091] Updated weights for policy 0, policy_version 1818848 (0.0010) [2023-12-26 14:07:09,179][123091] Updated weights for policy 0, policy_version 1818858 (0.0010) [2023-12-26 14:07:09,688][123090] Updated weights for policy 1, policy_version 1806945 (0.0006) [2023-12-26 14:07:09,758][123090] Updated weights for policy 1, policy_version 1806955 (0.0009) [2023-12-26 14:07:09,825][123090] Updated weights for policy 1, policy_version 1806966 (0.0010) [2023-12-26 14:07:09,899][123090] Updated weights for policy 1, policy_version 1806976 (0.0009) [2023-12-26 14:07:10,026][123091] Updated weights for policy 0, policy_version 1818868 (0.0010) [2023-12-26 14:07:10,089][123091] Updated weights for policy 0, policy_version 1818878 (0.0010) [2023-12-26 14:07:10,151][123091] Updated weights for policy 0, policy_version 1818888 (0.0010) [2023-12-26 14:07:10,679][123090] Updated weights for policy 1, policy_version 1806986 (0.0005) [2023-12-26 14:07:10,741][123090] Updated weights for policy 1, policy_version 1806996 (0.0005) [2023-12-26 14:07:10,803][123090] Updated weights for policy 1, policy_version 1807006 (0.0006) [2023-12-26 14:07:11,065][123091] Updated weights for policy 0, policy_version 1818898 (0.0009) [2023-12-26 14:07:11,131][123091] Updated weights for policy 0, policy_version 1818908 (0.0010) [2023-12-26 14:07:11,204][123091] Updated weights for policy 0, policy_version 1818918 (0.0009) [2023-12-26 14:07:11,261][123091] Updated weights for policy 0, policy_version 1818928 (0.0010) [2023-12-26 14:07:11,670][123090] Updated weights for policy 1, policy_version 1807016 (0.0009) [2023-12-26 14:07:11,743][123090] Updated weights for policy 1, policy_version 1807026 (0.0010) [2023-12-26 14:07:11,815][123090] Updated weights for policy 1, policy_version 1807036 (0.0009) [2023-12-26 14:07:12,154][123091] Updated weights for policy 0, policy_version 1818938 (0.0009) [2023-12-26 14:07:12,224][123091] Updated weights for policy 0, policy_version 1818948 (0.0009) [2023-12-26 14:07:12,298][123091] Updated weights for policy 0, policy_version 1818958 (0.0008) [2023-12-26 14:07:12,623][123090] Updated weights for policy 1, policy_version 1807046 (0.0008) [2023-12-26 14:07:12,683][123090] Updated weights for policy 1, policy_version 1807056 (0.0009) [2023-12-26 14:07:12,737][123090] Updated weights for policy 1, policy_version 1807066 (0.0010) [2023-12-26 14:07:13,086][123091] Updated weights for policy 0, policy_version 1818968 (0.0009) [2023-12-26 14:07:13,139][123091] Updated weights for policy 0, policy_version 1818978 (0.0009) [2023-12-26 14:07:13,200][123091] Updated weights for policy 0, policy_version 1818988 (0.0010) [2023-12-26 14:07:13,588][123090] Updated weights for policy 1, policy_version 1807076 (0.0008) [2023-12-26 14:07:13,657][123090] Updated weights for policy 1, policy_version 1807086 (0.0005) [2023-12-26 14:07:13,726][123090] Updated weights for policy 1, policy_version 1807096 (0.0006) [2023-12-26 14:07:13,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 928284672. Throughput: 0: 9139.2, 1: 8706.5. Samples: 928276396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:13,785][121949] Avg episode reward: [(0, '6133.863'), (1, '5430.725')] [2023-12-26 14:07:13,974][123091] Updated weights for policy 0, policy_version 1818998 (0.0008) [2023-12-26 14:07:14,039][123091] Updated weights for policy 0, policy_version 1819008 (0.0009) [2023-12-26 14:07:14,101][123091] Updated weights for policy 0, policy_version 1819018 (0.0008) [2023-12-26 14:07:14,543][123090] Updated weights for policy 1, policy_version 1807106 (0.0008) [2023-12-26 14:07:14,596][123090] Updated weights for policy 1, policy_version 1807116 (0.0010) [2023-12-26 14:07:14,659][123090] Updated weights for policy 1, policy_version 1807126 (0.0010) [2023-12-26 14:07:14,724][123090] Updated weights for policy 1, policy_version 1807136 (0.0010) [2023-12-26 14:07:14,772][123091] Updated weights for policy 0, policy_version 1819028 (0.0008) [2023-12-26 14:07:14,843][123091] Updated weights for policy 0, policy_version 1819038 (0.0010) [2023-12-26 14:07:14,916][123091] Updated weights for policy 0, policy_version 1819048 (0.0010) [2023-12-26 14:07:15,536][123090] Updated weights for policy 1, policy_version 1807146 (0.0006) [2023-12-26 14:07:15,611][123090] Updated weights for policy 1, policy_version 1807156 (0.0005) [2023-12-26 14:07:15,682][123090] Updated weights for policy 1, policy_version 1807166 (0.0005) [2023-12-26 14:07:15,760][123091] Updated weights for policy 0, policy_version 1819058 (0.0010) [2023-12-26 14:07:15,825][123091] Updated weights for policy 0, policy_version 1819068 (0.0009) [2023-12-26 14:07:15,889][123091] Updated weights for policy 0, policy_version 1819078 (0.0009) [2023-12-26 14:07:15,965][123091] Updated weights for policy 0, policy_version 1819088 (0.0009) [2023-12-26 14:07:16,333][123090] Updated weights for policy 1, policy_version 1807176 (0.0008) [2023-12-26 14:07:16,404][123090] Updated weights for policy 1, policy_version 1807186 (0.0009) [2023-12-26 14:07:16,472][123090] Updated weights for policy 1, policy_version 1807196 (0.0009) [2023-12-26 14:07:16,823][123091] Updated weights for policy 0, policy_version 1819098 (0.0009) [2023-12-26 14:07:16,885][123091] Updated weights for policy 0, policy_version 1819108 (0.0009) [2023-12-26 14:07:16,958][123091] Updated weights for policy 0, policy_version 1819118 (0.0009) [2023-12-26 14:07:17,223][123090] Updated weights for policy 1, policy_version 1807206 (0.0007) [2023-12-26 14:07:17,299][123090] Updated weights for policy 1, policy_version 1807216 (0.0005) [2023-12-26 14:07:17,356][123090] Updated weights for policy 1, policy_version 1807226 (0.0005) [2023-12-26 14:07:17,844][123091] Updated weights for policy 0, policy_version 1819128 (0.0010) [2023-12-26 14:07:17,880][123090] Updated weights for policy 1, policy_version 1807236 (0.0006) [2023-12-26 14:07:17,907][123091] Updated weights for policy 0, policy_version 1819138 (0.0008) [2023-12-26 14:07:17,937][123090] Updated weights for policy 1, policy_version 1807246 (0.0005) [2023-12-26 14:07:17,956][123091] Updated weights for policy 0, policy_version 1819148 (0.0008) [2023-12-26 14:07:18,001][123090] Updated weights for policy 1, policy_version 1807256 (0.0005) [2023-12-26 14:07:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 928366592. Throughput: 0: 9015.0, 1: 8761.9. Samples: 928383208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:18,785][121949] Avg episode reward: [(0, '6246.339'), (1, '5739.363')] [2023-12-26 14:07:18,821][123091] Updated weights for policy 0, policy_version 1819158 (0.0009) [2023-12-26 14:07:18,836][123090] Updated weights for policy 1, policy_version 1807266 (0.0009) [2023-12-26 14:07:18,876][123091] Updated weights for policy 0, policy_version 1819168 (0.0010) [2023-12-26 14:07:18,900][123090] Updated weights for policy 1, policy_version 1807276 (0.0006) [2023-12-26 14:07:18,924][123091] Updated weights for policy 0, policy_version 1819178 (0.0010) [2023-12-26 14:07:18,969][123090] Updated weights for policy 1, policy_version 1807286 (0.0008) [2023-12-26 14:07:19,032][123090] Updated weights for policy 1, policy_version 1807296 (0.0010) [2023-12-26 14:07:19,707][123091] Updated weights for policy 0, policy_version 1819188 (0.0006) [2023-12-26 14:07:19,772][123091] Updated weights for policy 0, policy_version 1819198 (0.0006) [2023-12-26 14:07:19,833][123091] Updated weights for policy 0, policy_version 1819208 (0.0011) [2023-12-26 14:07:19,882][123090] Updated weights for policy 1, policy_version 1807306 (0.0011) [2023-12-26 14:07:19,948][123090] Updated weights for policy 1, policy_version 1807316 (0.0011) [2023-12-26 14:07:20,024][123090] Updated weights for policy 1, policy_version 1807326 (0.0010) [2023-12-26 14:07:20,647][123091] Updated weights for policy 0, policy_version 1819218 (0.0011) [2023-12-26 14:07:20,702][123091] Updated weights for policy 0, policy_version 1819228 (0.0011) [2023-12-26 14:07:20,763][123091] Updated weights for policy 0, policy_version 1819238 (0.0011) [2023-12-26 14:07:20,775][123090] Updated weights for policy 1, policy_version 1807336 (0.0011) [2023-12-26 14:07:20,823][123091] Updated weights for policy 0, policy_version 1819248 (0.0011) [2023-12-26 14:07:20,830][123090] Updated weights for policy 1, policy_version 1807346 (0.0006) [2023-12-26 14:07:20,894][123090] Updated weights for policy 1, policy_version 1807356 (0.0010) [2023-12-26 14:07:21,726][123091] Updated weights for policy 0, policy_version 1819258 (0.0011) [2023-12-26 14:07:21,734][123090] Updated weights for policy 1, policy_version 1807366 (0.0011) [2023-12-26 14:07:21,795][123091] Updated weights for policy 0, policy_version 1819268 (0.0008) [2023-12-26 14:07:21,812][123090] Updated weights for policy 1, policy_version 1807377 (0.0009) [2023-12-26 14:07:21,859][123091] Updated weights for policy 0, policy_version 1819278 (0.0008) [2023-12-26 14:07:21,867][123090] Updated weights for policy 1, policy_version 1807387 (0.0008) [2023-12-26 14:07:22,696][123090] Updated weights for policy 1, policy_version 1807397 (0.0008) [2023-12-26 14:07:22,714][123091] Updated weights for policy 0, policy_version 1819288 (0.0009) [2023-12-26 14:07:22,748][123090] Updated weights for policy 1, policy_version 1807407 (0.0007) [2023-12-26 14:07:22,773][123091] Updated weights for policy 0, policy_version 1819298 (0.0010) [2023-12-26 14:07:22,808][123090] Updated weights for policy 1, policy_version 1807417 (0.0007) [2023-12-26 14:07:22,838][123091] Updated weights for policy 0, policy_version 1819308 (0.0010) [2023-12-26 14:07:23,525][123091] Updated weights for policy 0, policy_version 1819318 (0.0008) [2023-12-26 14:07:23,582][123091] Updated weights for policy 0, policy_version 1819328 (0.0009) [2023-12-26 14:07:23,642][123091] Updated weights for policy 0, policy_version 1819338 (0.0009) [2023-12-26 14:07:23,667][123090] Updated weights for policy 1, policy_version 1807427 (0.0010) [2023-12-26 14:07:23,729][123090] Updated weights for policy 1, policy_version 1807437 (0.0010) [2023-12-26 14:07:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 928456704. Throughput: 0: 8938.2, 1: 8752.6. Samples: 928434540. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:23,785][121949] Avg episode reward: [(0, '6349.612'), (1, '5736.308')] [2023-12-26 14:07:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001819344_465756160.pth... [2023-12-26 14:07:23,794][123090] Updated weights for policy 1, policy_version 1807447 (0.0010) [2023-12-26 14:07:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001818288_465485824.pth [2023-12-26 14:07:23,849][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001807456_462708736.pth... [2023-12-26 14:07:23,854][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001806400_462438400.pth [2023-12-26 14:07:24,512][123091] Updated weights for policy 0, policy_version 1819348 (0.0009) [2023-12-26 14:07:24,545][123090] Updated weights for policy 1, policy_version 1807457 (0.0010) [2023-12-26 14:07:24,579][123091] Updated weights for policy 0, policy_version 1819358 (0.0007) [2023-12-26 14:07:24,604][123090] Updated weights for policy 1, policy_version 1807467 (0.0007) [2023-12-26 14:07:24,639][123091] Updated weights for policy 0, policy_version 1819368 (0.0008) [2023-12-26 14:07:24,670][123090] Updated weights for policy 1, policy_version 1807477 (0.0005) [2023-12-26 14:07:24,741][123090] Updated weights for policy 1, policy_version 1807487 (0.0008) [2023-12-26 14:07:25,357][123091] Updated weights for policy 0, policy_version 1819378 (0.0009) [2023-12-26 14:07:25,427][123090] Updated weights for policy 1, policy_version 1807497 (0.0008) [2023-12-26 14:07:25,429][123091] Updated weights for policy 0, policy_version 1819388 (0.0005) [2023-12-26 14:07:25,470][123090] Updated weights for policy 1, policy_version 1807507 (0.0007) [2023-12-26 14:07:25,498][123091] Updated weights for policy 0, policy_version 1819398 (0.0007) [2023-12-26 14:07:25,517][123090] Updated weights for policy 1, policy_version 1807517 (0.0006) [2023-12-26 14:07:25,560][123091] Updated weights for policy 0, policy_version 1819408 (0.0010) [2023-12-26 14:07:26,290][123090] Updated weights for policy 1, policy_version 1807527 (0.0009) [2023-12-26 14:07:26,317][123091] Updated weights for policy 0, policy_version 1819418 (0.0005) [2023-12-26 14:07:26,352][123090] Updated weights for policy 1, policy_version 1807537 (0.0009) [2023-12-26 14:07:26,366][123091] Updated weights for policy 0, policy_version 1819428 (0.0005) [2023-12-26 14:07:26,411][123090] Updated weights for policy 1, policy_version 1807547 (0.0007) [2023-12-26 14:07:26,412][123091] Updated weights for policy 0, policy_version 1819438 (0.0005) [2023-12-26 14:07:27,157][123091] Updated weights for policy 0, policy_version 1819448 (0.0005) [2023-12-26 14:07:27,215][123091] Updated weights for policy 0, policy_version 1819458 (0.0005) [2023-12-26 14:07:27,228][123090] Updated weights for policy 1, policy_version 1807557 (0.0010) [2023-12-26 14:07:27,274][123091] Updated weights for policy 0, policy_version 1819468 (0.0005) [2023-12-26 14:07:27,276][123090] Updated weights for policy 1, policy_version 1807567 (0.0008) [2023-12-26 14:07:27,335][123090] Updated weights for policy 1, policy_version 1807577 (0.0009) [2023-12-26 14:07:28,033][123091] Updated weights for policy 0, policy_version 1819478 (0.0008) [2023-12-26 14:07:28,055][123090] Updated weights for policy 1, policy_version 1807587 (0.0009) [2023-12-26 14:07:28,091][123091] Updated weights for policy 0, policy_version 1819488 (0.0007) [2023-12-26 14:07:28,121][123090] Updated weights for policy 1, policy_version 1807597 (0.0007) [2023-12-26 14:07:28,146][123091] Updated weights for policy 0, policy_version 1819498 (0.0008) [2023-12-26 14:07:28,183][123090] Updated weights for policy 1, policy_version 1807607 (0.0007) [2023-12-26 14:07:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 928546816. Throughput: 0: 9017.2, 1: 8802.3. Samples: 928542888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:28,785][121949] Avg episode reward: [(0, '6201.109'), (1, '5475.701')] [2023-12-26 14:07:28,886][123090] Updated weights for policy 1, policy_version 1807617 (0.0007) [2023-12-26 14:07:28,950][123090] Updated weights for policy 1, policy_version 1807627 (0.0005) [2023-12-26 14:07:29,005][123090] Updated weights for policy 1, policy_version 1807637 (0.0005) [2023-12-26 14:07:29,012][123091] Updated weights for policy 0, policy_version 1819508 (0.0009) [2023-12-26 14:07:29,066][123090] Updated weights for policy 1, policy_version 1807647 (0.0005) [2023-12-26 14:07:29,070][123091] Updated weights for policy 0, policy_version 1819518 (0.0009) [2023-12-26 14:07:29,134][123091] Updated weights for policy 0, policy_version 1819528 (0.0009) [2023-12-26 14:07:29,791][123090] Updated weights for policy 1, policy_version 1807657 (0.0009) [2023-12-26 14:07:29,867][123090] Updated weights for policy 1, policy_version 1807667 (0.0009) [2023-12-26 14:07:29,885][123091] Updated weights for policy 0, policy_version 1819538 (0.0009) [2023-12-26 14:07:29,942][123090] Updated weights for policy 1, policy_version 1807677 (0.0009) [2023-12-26 14:07:29,953][123091] Updated weights for policy 0, policy_version 1819548 (0.0006) [2023-12-26 14:07:30,021][123091] Updated weights for policy 0, policy_version 1819558 (0.0010) [2023-12-26 14:07:30,073][123091] Updated weights for policy 0, policy_version 1819568 (0.0010) [2023-12-26 14:07:30,782][123090] Updated weights for policy 1, policy_version 1807687 (0.0009) [2023-12-26 14:07:30,801][123091] Updated weights for policy 0, policy_version 1819578 (0.0009) [2023-12-26 14:07:30,830][123090] Updated weights for policy 1, policy_version 1807697 (0.0007) [2023-12-26 14:07:30,854][123091] Updated weights for policy 0, policy_version 1819588 (0.0008) [2023-12-26 14:07:30,883][123090] Updated weights for policy 1, policy_version 1807707 (0.0008) [2023-12-26 14:07:30,909][123091] Updated weights for policy 0, policy_version 1819598 (0.0005) [2023-12-26 14:07:31,750][123091] Updated weights for policy 0, policy_version 1819608 (0.0008) [2023-12-26 14:07:31,772][123090] Updated weights for policy 1, policy_version 1807717 (0.0008) [2023-12-26 14:07:31,813][123091] Updated weights for policy 0, policy_version 1819618 (0.0007) [2023-12-26 14:07:31,838][123090] Updated weights for policy 1, policy_version 1807727 (0.0008) [2023-12-26 14:07:31,874][123091] Updated weights for policy 0, policy_version 1819628 (0.0009) [2023-12-26 14:07:31,902][123090] Updated weights for policy 1, policy_version 1807737 (0.0008) [2023-12-26 14:07:32,615][123091] Updated weights for policy 0, policy_version 1819638 (0.0006) [2023-12-26 14:07:32,679][123091] Updated weights for policy 0, policy_version 1819648 (0.0010) [2023-12-26 14:07:32,749][123091] Updated weights for policy 0, policy_version 1819658 (0.0010) [2023-12-26 14:07:32,759][123090] Updated weights for policy 1, policy_version 1807747 (0.0009) [2023-12-26 14:07:32,827][123090] Updated weights for policy 1, policy_version 1807757 (0.0010) [2023-12-26 14:07:32,893][123090] Updated weights for policy 1, policy_version 1807767 (0.0010) [2023-12-26 14:07:33,542][123090] Updated weights for policy 1, policy_version 1807777 (0.0008) [2023-12-26 14:07:33,593][123090] Updated weights for policy 1, policy_version 1807787 (0.0005) [2023-12-26 14:07:33,623][123091] Updated weights for policy 0, policy_version 1819668 (0.0009) [2023-12-26 14:07:33,654][123090] Updated weights for policy 1, policy_version 1807797 (0.0009) [2023-12-26 14:07:33,674][123091] Updated weights for policy 0, policy_version 1819678 (0.0008) [2023-12-26 14:07:33,702][123090] Updated weights for policy 1, policy_version 1807807 (0.0008) [2023-12-26 14:07:33,737][123091] Updated weights for policy 0, policy_version 1819688 (0.0008) [2023-12-26 14:07:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 928645120. Throughput: 0: 8946.0, 1: 8892.3. Samples: 928650260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:33,785][121949] Avg episode reward: [(0, '6205.781'), (1, '5419.391')] [2023-12-26 14:07:34,524][123090] Updated weights for policy 1, policy_version 1807817 (0.0009) [2023-12-26 14:07:34,583][123091] Updated weights for policy 0, policy_version 1819698 (0.0009) [2023-12-26 14:07:34,590][123090] Updated weights for policy 1, policy_version 1807827 (0.0008) [2023-12-26 14:07:34,641][123091] Updated weights for policy 0, policy_version 1819708 (0.0009) [2023-12-26 14:07:34,656][123090] Updated weights for policy 1, policy_version 1807837 (0.0007) [2023-12-26 14:07:34,708][123091] Updated weights for policy 0, policy_version 1819718 (0.0008) [2023-12-26 14:07:34,777][123091] Updated weights for policy 0, policy_version 1819728 (0.0008) [2023-12-26 14:07:35,415][123090] Updated weights for policy 1, policy_version 1807847 (0.0007) [2023-12-26 14:07:35,468][123090] Updated weights for policy 1, policy_version 1807857 (0.0005) [2023-12-26 14:07:35,523][123090] Updated weights for policy 1, policy_version 1807867 (0.0005) [2023-12-26 14:07:35,640][123091] Updated weights for policy 0, policy_version 1819738 (0.0010) [2023-12-26 14:07:35,695][123091] Updated weights for policy 0, policy_version 1819748 (0.0009) [2023-12-26 14:07:35,752][123091] Updated weights for policy 0, policy_version 1819759 (0.0009) [2023-12-26 14:07:36,233][123090] Updated weights for policy 1, policy_version 1807877 (0.0007) [2023-12-26 14:07:36,294][123090] Updated weights for policy 1, policy_version 1807887 (0.0009) [2023-12-26 14:07:36,367][123090] Updated weights for policy 1, policy_version 1807897 (0.0008) [2023-12-26 14:07:36,631][123091] Updated weights for policy 0, policy_version 1819769 (0.0006) [2023-12-26 14:07:36,705][123091] Updated weights for policy 0, policy_version 1819779 (0.0006) [2023-12-26 14:07:36,775][123091] Updated weights for policy 0, policy_version 1819789 (0.0006) [2023-12-26 14:07:37,210][123090] Updated weights for policy 1, policy_version 1807907 (0.0010) [2023-12-26 14:07:37,274][123090] Updated weights for policy 1, policy_version 1807917 (0.0009) [2023-12-26 14:07:37,328][123090] Updated weights for policy 1, policy_version 1807927 (0.0009) [2023-12-26 14:07:37,521][123091] Updated weights for policy 0, policy_version 1819799 (0.0008) [2023-12-26 14:07:37,581][123091] Updated weights for policy 0, policy_version 1819809 (0.0009) [2023-12-26 14:07:37,642][123091] Updated weights for policy 0, policy_version 1819819 (0.0009) [2023-12-26 14:07:38,191][123090] Updated weights for policy 1, policy_version 1807937 (0.0010) [2023-12-26 14:07:38,256][123090] Updated weights for policy 1, policy_version 1807947 (0.0010) [2023-12-26 14:07:38,320][123090] Updated weights for policy 1, policy_version 1807957 (0.0009) [2023-12-26 14:07:38,389][123090] Updated weights for policy 1, policy_version 1807967 (0.0009) [2023-12-26 14:07:38,463][123091] Updated weights for policy 0, policy_version 1819829 (0.0010) [2023-12-26 14:07:38,526][123091] Updated weights for policy 0, policy_version 1819839 (0.0008) [2023-12-26 14:07:38,593][123091] Updated weights for policy 0, policy_version 1819849 (0.0005) [2023-12-26 14:07:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 928727040. Throughput: 0: 8916.7, 1: 8948.0. Samples: 928702736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:38,785][121949] Avg episode reward: [(0, '6220.953'), (1, '5697.199')] [2023-12-26 14:07:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001807968_462839808.pth... [2023-12-26 14:07:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001819856_465887232.pth... [2023-12-26 14:07:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001818832_465625088.pth [2023-12-26 14:07:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001806912_462569472.pth [2023-12-26 14:07:39,242][123091] Updated weights for policy 0, policy_version 1819859 (0.0009) [2023-12-26 14:07:39,272][123090] Updated weights for policy 1, policy_version 1807977 (0.0008) [2023-12-26 14:07:39,302][123091] Updated weights for policy 0, policy_version 1819869 (0.0009) [2023-12-26 14:07:39,337][123090] Updated weights for policy 1, policy_version 1807987 (0.0009) [2023-12-26 14:07:39,369][123091] Updated weights for policy 0, policy_version 1819879 (0.0008) [2023-12-26 14:07:39,403][123090] Updated weights for policy 1, policy_version 1807997 (0.0008) [2023-12-26 14:07:40,211][123090] Updated weights for policy 1, policy_version 1808007 (0.0006) [2023-12-26 14:07:40,233][123091] Updated weights for policy 0, policy_version 1819889 (0.0009) [2023-12-26 14:07:40,270][123090] Updated weights for policy 1, policy_version 1808017 (0.0006) [2023-12-26 14:07:40,295][123091] Updated weights for policy 0, policy_version 1819899 (0.0010) [2023-12-26 14:07:40,338][123090] Updated weights for policy 1, policy_version 1808027 (0.0006) [2023-12-26 14:07:40,358][123091] Updated weights for policy 0, policy_version 1819909 (0.0008) [2023-12-26 14:07:40,424][123091] Updated weights for policy 0, policy_version 1819919 (0.0010) [2023-12-26 14:07:41,137][123090] Updated weights for policy 1, policy_version 1808037 (0.0008) [2023-12-26 14:07:41,198][123090] Updated weights for policy 1, policy_version 1808047 (0.0006) [2023-12-26 14:07:41,256][123090] Updated weights for policy 1, policy_version 1808057 (0.0006) [2023-12-26 14:07:41,275][123091] Updated weights for policy 0, policy_version 1819929 (0.0008) [2023-12-26 14:07:41,338][123091] Updated weights for policy 0, policy_version 1819939 (0.0008) [2023-12-26 14:07:41,415][123091] Updated weights for policy 0, policy_version 1819949 (0.0009) [2023-12-26 14:07:42,109][123090] Updated weights for policy 1, policy_version 1808067 (0.0007) [2023-12-26 14:07:42,162][123090] Updated weights for policy 1, policy_version 1808077 (0.0010) [2023-12-26 14:07:42,225][123090] Updated weights for policy 1, policy_version 1808087 (0.0010) [2023-12-26 14:07:42,259][123091] Updated weights for policy 0, policy_version 1819959 (0.0008) [2023-12-26 14:07:42,328][123091] Updated weights for policy 0, policy_version 1819969 (0.0010) [2023-12-26 14:07:42,400][123091] Updated weights for policy 0, policy_version 1819979 (0.0010) [2023-12-26 14:07:43,097][123090] Updated weights for policy 1, policy_version 1808097 (0.0010) [2023-12-26 14:07:43,161][123090] Updated weights for policy 1, policy_version 1808107 (0.0010) [2023-12-26 14:07:43,218][123091] Updated weights for policy 0, policy_version 1819989 (0.0008) [2023-12-26 14:07:43,233][123090] Updated weights for policy 1, policy_version 1808117 (0.0009) [2023-12-26 14:07:43,283][123091] Updated weights for policy 0, policy_version 1819999 (0.0008) [2023-12-26 14:07:43,289][123090] Updated weights for policy 1, policy_version 1808127 (0.0008) [2023-12-26 14:07:43,349][123091] Updated weights for policy 0, policy_version 1820009 (0.0009) [2023-12-26 14:07:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 928808960. Throughput: 0: 8808.4, 1: 8863.2. Samples: 928803520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:43,784][121949] Avg episode reward: [(0, '6197.985'), (1, '5762.694')] [2023-12-26 14:07:43,991][123091] Updated weights for policy 0, policy_version 1820019 (0.0009) [2023-12-26 14:07:44,043][123091] Updated weights for policy 0, policy_version 1820029 (0.0010) [2023-12-26 14:07:44,111][123091] Updated weights for policy 0, policy_version 1820039 (0.0008) [2023-12-26 14:07:44,124][123090] Updated weights for policy 1, policy_version 1808137 (0.0006) [2023-12-26 14:07:44,180][123090] Updated weights for policy 1, policy_version 1808147 (0.0007) [2023-12-26 14:07:44,229][123090] Updated weights for policy 1, policy_version 1808157 (0.0007) [2023-12-26 14:07:44,919][123091] Updated weights for policy 0, policy_version 1820049 (0.0009) [2023-12-26 14:07:44,945][123090] Updated weights for policy 1, policy_version 1808167 (0.0007) [2023-12-26 14:07:44,974][123091] Updated weights for policy 0, policy_version 1820059 (0.0008) [2023-12-26 14:07:45,014][123090] Updated weights for policy 1, policy_version 1808177 (0.0007) [2023-12-26 14:07:45,041][123091] Updated weights for policy 0, policy_version 1820069 (0.0008) [2023-12-26 14:07:45,076][123090] Updated weights for policy 1, policy_version 1808187 (0.0009) [2023-12-26 14:07:45,108][123091] Updated weights for policy 0, policy_version 1820079 (0.0008) [2023-12-26 14:07:45,910][123091] Updated weights for policy 0, policy_version 1820089 (0.0006) [2023-12-26 14:07:45,912][123090] Updated weights for policy 1, policy_version 1808197 (0.0007) [2023-12-26 14:07:45,973][123090] Updated weights for policy 1, policy_version 1808207 (0.0011) [2023-12-26 14:07:45,983][123091] Updated weights for policy 0, policy_version 1820099 (0.0005) [2023-12-26 14:07:46,033][123090] Updated weights for policy 1, policy_version 1808217 (0.0011) [2023-12-26 14:07:46,058][123091] Updated weights for policy 0, policy_version 1820109 (0.0006) [2023-12-26 14:07:46,795][123090] Updated weights for policy 1, policy_version 1808227 (0.0009) [2023-12-26 14:07:46,809][123091] Updated weights for policy 0, policy_version 1820119 (0.0009) [2023-12-26 14:07:46,858][123090] Updated weights for policy 1, policy_version 1808237 (0.0007) [2023-12-26 14:07:46,874][123091] Updated weights for policy 0, policy_version 1820129 (0.0009) [2023-12-26 14:07:46,915][123090] Updated weights for policy 1, policy_version 1808247 (0.0006) [2023-12-26 14:07:46,946][123091] Updated weights for policy 0, policy_version 1820139 (0.0010) [2023-12-26 14:07:47,633][123090] Updated weights for policy 1, policy_version 1808257 (0.0007) [2023-12-26 14:07:47,698][123090] Updated weights for policy 1, policy_version 1808267 (0.0009) [2023-12-26 14:07:47,759][123090] Updated weights for policy 1, policy_version 1808277 (0.0010) [2023-12-26 14:07:47,810][123090] Updated weights for policy 1, policy_version 1808287 (0.0010) [2023-12-26 14:07:47,818][123091] Updated weights for policy 0, policy_version 1820149 (0.0008) [2023-12-26 14:07:47,885][123091] Updated weights for policy 0, policy_version 1820159 (0.0010) [2023-12-26 14:07:47,947][123091] Updated weights for policy 0, policy_version 1820169 (0.0010) [2023-12-26 14:07:48,664][123090] Updated weights for policy 1, policy_version 1808297 (0.0010) [2023-12-26 14:07:48,732][123090] Updated weights for policy 1, policy_version 1808307 (0.0009) [2023-12-26 14:07:48,749][123091] Updated weights for policy 0, policy_version 1820179 (0.0009) [2023-12-26 14:07:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 928890880. Throughput: 0: 8776.7, 1: 8853.1. Samples: 928910020. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:48,784][121949] Avg episode reward: [(0, '6048.530'), (1, '5517.229')] [2023-12-26 14:07:48,795][123090] Updated weights for policy 1, policy_version 1808317 (0.0008) [2023-12-26 14:07:48,814][123091] Updated weights for policy 0, policy_version 1820189 (0.0009) [2023-12-26 14:07:48,873][123091] Updated weights for policy 0, policy_version 1820199 (0.0010) [2023-12-26 14:07:49,626][123090] Updated weights for policy 1, policy_version 1808327 (0.0006) [2023-12-26 14:07:49,693][123090] Updated weights for policy 1, policy_version 1808337 (0.0009) [2023-12-26 14:07:49,708][123091] Updated weights for policy 0, policy_version 1820209 (0.0009) [2023-12-26 14:07:49,755][123090] Updated weights for policy 1, policy_version 1808347 (0.0010) [2023-12-26 14:07:49,769][123091] Updated weights for policy 0, policy_version 1820219 (0.0010) [2023-12-26 14:07:49,824][123091] Updated weights for policy 0, policy_version 1820229 (0.0011) [2023-12-26 14:07:49,892][123091] Updated weights for policy 0, policy_version 1820239 (0.0011) [2023-12-26 14:07:50,453][123090] Updated weights for policy 1, policy_version 1808357 (0.0007) [2023-12-26 14:07:50,517][123090] Updated weights for policy 1, policy_version 1808367 (0.0008) [2023-12-26 14:07:50,589][123090] Updated weights for policy 1, policy_version 1808377 (0.0008) [2023-12-26 14:07:50,693][123091] Updated weights for policy 0, policy_version 1820249 (0.0011) [2023-12-26 14:07:50,742][123091] Updated weights for policy 0, policy_version 1820259 (0.0011) [2023-12-26 14:07:50,787][123091] Updated weights for policy 0, policy_version 1820269 (0.0010) [2023-12-26 14:07:51,337][123090] Updated weights for policy 1, policy_version 1808387 (0.0006) [2023-12-26 14:07:51,419][123090] Updated weights for policy 1, policy_version 1808397 (0.0008) [2023-12-26 14:07:51,480][123090] Updated weights for policy 1, policy_version 1808407 (0.0008) [2023-12-26 14:07:51,665][123091] Updated weights for policy 0, policy_version 1820279 (0.0008) [2023-12-26 14:07:51,738][123091] Updated weights for policy 0, policy_version 1820289 (0.0009) [2023-12-26 14:07:51,812][123091] Updated weights for policy 0, policy_version 1820299 (0.0011) [2023-12-26 14:07:52,292][123090] Updated weights for policy 1, policy_version 1808417 (0.0008) [2023-12-26 14:07:52,351][123090] Updated weights for policy 1, policy_version 1808427 (0.0008) [2023-12-26 14:07:52,412][123090] Updated weights for policy 1, policy_version 1808437 (0.0008) [2023-12-26 14:07:52,483][123090] Updated weights for policy 1, policy_version 1808447 (0.0005) [2023-12-26 14:07:52,591][123091] Updated weights for policy 0, policy_version 1820309 (0.0010) [2023-12-26 14:07:52,645][123091] Updated weights for policy 0, policy_version 1820319 (0.0010) [2023-12-26 14:07:52,710][123091] Updated weights for policy 0, policy_version 1820329 (0.0009) [2023-12-26 14:07:53,250][123090] Updated weights for policy 1, policy_version 1808457 (0.0009) [2023-12-26 14:07:53,303][123090] Updated weights for policy 1, policy_version 1808467 (0.0009) [2023-12-26 14:07:53,359][123090] Updated weights for policy 1, policy_version 1808477 (0.0009) [2023-12-26 14:07:53,552][123091] Updated weights for policy 0, policy_version 1820339 (0.0010) [2023-12-26 14:07:53,620][123091] Updated weights for policy 0, policy_version 1820349 (0.0010) [2023-12-26 14:07:53,672][123091] Updated weights for policy 0, policy_version 1820359 (0.0008) [2023-12-26 14:07:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 928989184. Throughput: 0: 8682.8, 1: 8870.6. Samples: 928961864. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:53,785][121949] Avg episode reward: [(0, '6106.545'), (1, '5546.609')] [2023-12-26 14:07:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001820368_466018304.pth... [2023-12-26 14:07:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001808480_462970880.pth... [2023-12-26 14:07:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001819344_465756160.pth [2023-12-26 14:07:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001807456_462708736.pth [2023-12-26 14:07:54,256][123090] Updated weights for policy 1, policy_version 1808487 (0.0008) [2023-12-26 14:07:54,312][123090] Updated weights for policy 1, policy_version 1808497 (0.0008) [2023-12-26 14:07:54,353][123091] Updated weights for policy 0, policy_version 1820369 (0.0006) [2023-12-26 14:07:54,372][123090] Updated weights for policy 1, policy_version 1808507 (0.0008) [2023-12-26 14:07:54,415][123091] Updated weights for policy 0, policy_version 1820379 (0.0011) [2023-12-26 14:07:54,473][123091] Updated weights for policy 0, policy_version 1820389 (0.0010) [2023-12-26 14:07:54,532][123091] Updated weights for policy 0, policy_version 1820399 (0.0010) [2023-12-26 14:07:55,114][123090] Updated weights for policy 1, policy_version 1808517 (0.0009) [2023-12-26 14:07:55,165][123090] Updated weights for policy 1, policy_version 1808527 (0.0010) [2023-12-26 14:07:55,224][123090] Updated weights for policy 1, policy_version 1808537 (0.0010) [2023-12-26 14:07:55,336][123091] Updated weights for policy 0, policy_version 1820409 (0.0010) [2023-12-26 14:07:55,402][123091] Updated weights for policy 0, policy_version 1820419 (0.0010) [2023-12-26 14:07:55,453][123091] Updated weights for policy 0, policy_version 1820429 (0.0010) [2023-12-26 14:07:56,046][123090] Updated weights for policy 1, policy_version 1808547 (0.0010) [2023-12-26 14:07:56,105][123090] Updated weights for policy 1, policy_version 1808557 (0.0010) [2023-12-26 14:07:56,152][123090] Updated weights for policy 1, policy_version 1808567 (0.0008) [2023-12-26 14:07:56,268][123091] Updated weights for policy 0, policy_version 1820439 (0.0011) [2023-12-26 14:07:56,330][123091] Updated weights for policy 0, policy_version 1820449 (0.0011) [2023-12-26 14:07:56,392][123091] Updated weights for policy 0, policy_version 1820459 (0.0011) [2023-12-26 14:07:56,918][123090] Updated weights for policy 1, policy_version 1808577 (0.0007) [2023-12-26 14:07:56,983][123090] Updated weights for policy 1, policy_version 1808587 (0.0005) [2023-12-26 14:07:57,052][123090] Updated weights for policy 1, policy_version 1808597 (0.0005) [2023-12-26 14:07:57,116][123090] Updated weights for policy 1, policy_version 1808607 (0.0005) [2023-12-26 14:07:57,202][123091] Updated weights for policy 0, policy_version 1820469 (0.0010) [2023-12-26 14:07:57,256][123091] Updated weights for policy 0, policy_version 1820479 (0.0010) [2023-12-26 14:07:57,315][123091] Updated weights for policy 0, policy_version 1820489 (0.0009) [2023-12-26 14:07:57,834][123090] Updated weights for policy 1, policy_version 1808617 (0.0010) [2023-12-26 14:07:57,891][123090] Updated weights for policy 1, policy_version 1808627 (0.0005) [2023-12-26 14:07:57,950][123090] Updated weights for policy 1, policy_version 1808637 (0.0008) [2023-12-26 14:07:58,109][123091] Updated weights for policy 0, policy_version 1820499 (0.0009) [2023-12-26 14:07:58,180][123091] Updated weights for policy 0, policy_version 1820509 (0.0011) [2023-12-26 14:07:58,249][123091] Updated weights for policy 0, policy_version 1820519 (0.0011) [2023-12-26 14:07:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 929071104. Throughput: 0: 8745.6, 1: 8867.6. Samples: 929068992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:07:58,785][121949] Avg episode reward: [(0, '6257.598'), (1, '5647.122')] [2023-12-26 14:07:58,797][123090] Updated weights for policy 1, policy_version 1808647 (0.0007) [2023-12-26 14:07:58,873][123090] Updated weights for policy 1, policy_version 1808657 (0.0008) [2023-12-26 14:07:58,934][123090] Updated weights for policy 1, policy_version 1808667 (0.0009) [2023-12-26 14:07:59,137][123091] Updated weights for policy 0, policy_version 1820529 (0.0010) [2023-12-26 14:07:59,228][123091] Updated weights for policy 0, policy_version 1820539 (0.0008) [2023-12-26 14:07:59,289][123091] Updated weights for policy 0, policy_version 1820549 (0.0010) [2023-12-26 14:07:59,357][123091] Updated weights for policy 0, policy_version 1820559 (0.0013) [2023-12-26 14:07:59,834][123090] Updated weights for policy 1, policy_version 1808677 (0.0008) [2023-12-26 14:07:59,902][123090] Updated weights for policy 1, policy_version 1808687 (0.0007) [2023-12-26 14:07:59,967][123090] Updated weights for policy 1, policy_version 1808697 (0.0009) [2023-12-26 14:08:00,217][123091] Updated weights for policy 0, policy_version 1820569 (0.0011) [2023-12-26 14:08:00,273][123091] Updated weights for policy 0, policy_version 1820579 (0.0010) [2023-12-26 14:08:00,327][123091] Updated weights for policy 0, policy_version 1820590 (0.0010) [2023-12-26 14:08:00,735][123090] Updated weights for policy 1, policy_version 1808707 (0.0010) [2023-12-26 14:08:00,782][123090] Updated weights for policy 1, policy_version 1808717 (0.0010) [2023-12-26 14:08:00,829][123090] Updated weights for policy 1, policy_version 1808727 (0.0010) [2023-12-26 14:08:01,066][123091] Updated weights for policy 0, policy_version 1820600 (0.0008) [2023-12-26 14:08:01,128][123091] Updated weights for policy 0, policy_version 1820610 (0.0006) [2023-12-26 14:08:01,188][123091] Updated weights for policy 0, policy_version 1820620 (0.0010) [2023-12-26 14:08:01,639][123090] Updated weights for policy 1, policy_version 1808737 (0.0010) [2023-12-26 14:08:01,697][123090] Updated weights for policy 1, policy_version 1808747 (0.0008) [2023-12-26 14:08:01,764][123090] Updated weights for policy 1, policy_version 1808757 (0.0008) [2023-12-26 14:08:01,823][123090] Updated weights for policy 1, policy_version 1808767 (0.0008) [2023-12-26 14:08:02,005][123091] Updated weights for policy 0, policy_version 1820630 (0.0009) [2023-12-26 14:08:02,073][123091] Updated weights for policy 0, policy_version 1820640 (0.0010) [2023-12-26 14:08:02,136][123091] Updated weights for policy 0, policy_version 1820650 (0.0011) [2023-12-26 14:08:02,645][123090] Updated weights for policy 1, policy_version 1808777 (0.0010) [2023-12-26 14:08:02,698][123090] Updated weights for policy 1, policy_version 1808787 (0.0007) [2023-12-26 14:08:02,758][123090] Updated weights for policy 1, policy_version 1808797 (0.0005) [2023-12-26 14:08:02,854][123091] Updated weights for policy 0, policy_version 1820660 (0.0008) [2023-12-26 14:08:02,909][123091] Updated weights for policy 0, policy_version 1820670 (0.0008) [2023-12-26 14:08:02,955][123091] Updated weights for policy 0, policy_version 1820680 (0.0010) [2023-12-26 14:08:03,510][123090] Updated weights for policy 1, policy_version 1808807 (0.0009) [2023-12-26 14:08:03,565][123090] Updated weights for policy 1, policy_version 1808817 (0.0010) [2023-12-26 14:08:03,617][123090] Updated weights for policy 1, policy_version 1808827 (0.0010) [2023-12-26 14:08:03,768][123091] Updated weights for policy 0, policy_version 1820690 (0.0010) [2023-12-26 14:08:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 929161216. Throughput: 0: 8743.6, 1: 8814.6. Samples: 929173324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:03,785][121949] Avg episode reward: [(0, '6268.802'), (1, '5556.632')] [2023-12-26 14:08:03,828][123091] Updated weights for policy 0, policy_version 1820700 (0.0011) [2023-12-26 14:08:03,896][123091] Updated weights for policy 0, policy_version 1820710 (0.0011) [2023-12-26 14:08:03,960][123091] Updated weights for policy 0, policy_version 1820720 (0.0011) [2023-12-26 14:08:04,512][123090] Updated weights for policy 1, policy_version 1808837 (0.0010) [2023-12-26 14:08:04,575][123090] Updated weights for policy 1, policy_version 1808847 (0.0009) [2023-12-26 14:08:04,642][123090] Updated weights for policy 1, policy_version 1808857 (0.0008) [2023-12-26 14:08:04,697][123091] Updated weights for policy 0, policy_version 1820730 (0.0011) [2023-12-26 14:08:04,770][123091] Updated weights for policy 0, policy_version 1820740 (0.0011) [2023-12-26 14:08:04,836][123091] Updated weights for policy 0, policy_version 1820750 (0.0010) [2023-12-26 14:08:05,452][123090] Updated weights for policy 1, policy_version 1808867 (0.0010) [2023-12-26 14:08:05,503][123090] Updated weights for policy 1, policy_version 1808877 (0.0009) [2023-12-26 14:08:05,570][123090] Updated weights for policy 1, policy_version 1808887 (0.0009) [2023-12-26 14:08:05,631][123091] Updated weights for policy 0, policy_version 1820760 (0.0009) [2023-12-26 14:08:05,693][123091] Updated weights for policy 0, policy_version 1820770 (0.0009) [2023-12-26 14:08:05,749][123091] Updated weights for policy 0, policy_version 1820780 (0.0008) [2023-12-26 14:08:06,341][123090] Updated weights for policy 1, policy_version 1808897 (0.0007) [2023-12-26 14:08:06,407][123090] Updated weights for policy 1, policy_version 1808907 (0.0007) [2023-12-26 14:08:06,487][123090] Updated weights for policy 1, policy_version 1808917 (0.0005) [2023-12-26 14:08:06,553][123091] Updated weights for policy 0, policy_version 1820790 (0.0007) [2023-12-26 14:08:06,555][123090] Updated weights for policy 1, policy_version 1808927 (0.0006) [2023-12-26 14:08:06,617][123091] Updated weights for policy 0, policy_version 1820800 (0.0005) [2023-12-26 14:08:06,672][123091] Updated weights for policy 0, policy_version 1820810 (0.0009) [2023-12-26 14:08:07,320][123091] Updated weights for policy 0, policy_version 1820820 (0.0009) [2023-12-26 14:08:07,327][123090] Updated weights for policy 1, policy_version 1808937 (0.0009) [2023-12-26 14:08:07,370][123091] Updated weights for policy 0, policy_version 1820830 (0.0009) [2023-12-26 14:08:07,373][123090] Updated weights for policy 1, policy_version 1808947 (0.0008) [2023-12-26 14:08:07,419][123091] Updated weights for policy 0, policy_version 1820840 (0.0007) [2023-12-26 14:08:07,426][123090] Updated weights for policy 1, policy_version 1808957 (0.0008) [2023-12-26 14:08:08,155][123091] Updated weights for policy 0, policy_version 1820850 (0.0008) [2023-12-26 14:08:08,222][123091] Updated weights for policy 0, policy_version 1820860 (0.0006) [2023-12-26 14:08:08,282][123091] Updated weights for policy 0, policy_version 1820870 (0.0008) [2023-12-26 14:08:08,315][123090] Updated weights for policy 1, policy_version 1808967 (0.0007) [2023-12-26 14:08:08,347][123091] Updated weights for policy 0, policy_version 1820880 (0.0007) [2023-12-26 14:08:08,380][123090] Updated weights for policy 1, policy_version 1808977 (0.0009) [2023-12-26 14:08:08,442][123090] Updated weights for policy 1, policy_version 1808987 (0.0010) [2023-12-26 14:08:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 929251328. Throughput: 0: 8758.4, 1: 8821.1. Samples: 929225616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:08,784][121949] Avg episode reward: [(0, '6199.756'), (1, '5453.865')] [2023-12-26 14:08:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001820880_466149376.pth... [2023-12-26 14:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001808992_463101952.pth... [2023-12-26 14:08:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001819856_465887232.pth [2023-12-26 14:08:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001807968_462839808.pth [2023-12-26 14:08:09,055][123091] Updated weights for policy 0, policy_version 1820890 (0.0010) [2023-12-26 14:08:09,119][123091] Updated weights for policy 0, policy_version 1820900 (0.0010) [2023-12-26 14:08:09,182][123091] Updated weights for policy 0, policy_version 1820910 (0.0009) [2023-12-26 14:08:09,258][123090] Updated weights for policy 1, policy_version 1808997 (0.0009) [2023-12-26 14:08:09,319][123090] Updated weights for policy 1, policy_version 1809007 (0.0010) [2023-12-26 14:08:09,385][123090] Updated weights for policy 1, policy_version 1809017 (0.0010) [2023-12-26 14:08:10,045][123091] Updated weights for policy 0, policy_version 1820920 (0.0010) [2023-12-26 14:08:10,110][123091] Updated weights for policy 0, policy_version 1820930 (0.0009) [2023-12-26 14:08:10,177][123091] Updated weights for policy 0, policy_version 1820940 (0.0010) [2023-12-26 14:08:10,272][123090] Updated weights for policy 1, policy_version 1809027 (0.0007) [2023-12-26 14:08:10,337][123090] Updated weights for policy 1, policy_version 1809037 (0.0006) [2023-12-26 14:08:10,403][123090] Updated weights for policy 1, policy_version 1809047 (0.0006) [2023-12-26 14:08:10,919][123091] Updated weights for policy 0, policy_version 1820950 (0.0008) [2023-12-26 14:08:10,976][123091] Updated weights for policy 0, policy_version 1820960 (0.0006) [2023-12-26 14:08:11,033][123091] Updated weights for policy 0, policy_version 1820970 (0.0006) [2023-12-26 14:08:11,063][123090] Updated weights for policy 1, policy_version 1809057 (0.0008) [2023-12-26 14:08:11,131][123090] Updated weights for policy 1, policy_version 1809067 (0.0006) [2023-12-26 14:08:11,213][123090] Updated weights for policy 1, policy_version 1809077 (0.0009) [2023-12-26 14:08:11,288][123090] Updated weights for policy 1, policy_version 1809087 (0.0009) [2023-12-26 14:08:11,813][123091] Updated weights for policy 0, policy_version 1820980 (0.0007) [2023-12-26 14:08:11,869][123091] Updated weights for policy 0, policy_version 1820990 (0.0005) [2023-12-26 14:08:11,931][123091] Updated weights for policy 0, policy_version 1821000 (0.0008) [2023-12-26 14:08:12,171][123090] Updated weights for policy 1, policy_version 1809097 (0.0009) [2023-12-26 14:08:12,238][123090] Updated weights for policy 1, policy_version 1809107 (0.0010) [2023-12-26 14:08:12,310][123090] Updated weights for policy 1, policy_version 1809117 (0.0009) [2023-12-26 14:08:12,644][123091] Updated weights for policy 0, policy_version 1821010 (0.0006) [2023-12-26 14:08:12,713][123091] Updated weights for policy 0, policy_version 1821020 (0.0006) [2023-12-26 14:08:12,781][123091] Updated weights for policy 0, policy_version 1821030 (0.0009) [2023-12-26 14:08:12,831][123091] Updated weights for policy 0, policy_version 1821040 (0.0010) [2023-12-26 14:08:13,133][123090] Updated weights for policy 1, policy_version 1809127 (0.0008) [2023-12-26 14:08:13,198][123090] Updated weights for policy 1, policy_version 1809137 (0.0008) [2023-12-26 14:08:13,260][123090] Updated weights for policy 1, policy_version 1809147 (0.0006) [2023-12-26 14:08:13,586][123091] Updated weights for policy 0, policy_version 1821050 (0.0010) [2023-12-26 14:08:13,644][123091] Updated weights for policy 0, policy_version 1821060 (0.0009) [2023-12-26 14:08:13,697][123091] Updated weights for policy 0, policy_version 1821070 (0.0009) [2023-12-26 14:08:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 929341440. Throughput: 0: 8804.8, 1: 8751.0. Samples: 929332900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:13,785][121949] Avg episode reward: [(0, '6125.611'), (1, '5285.385')] [2023-12-26 14:08:13,959][123090] Updated weights for policy 1, policy_version 1809157 (0.0008) [2023-12-26 14:08:14,023][123090] Updated weights for policy 1, policy_version 1809167 (0.0011) [2023-12-26 14:08:14,093][123090] Updated weights for policy 1, policy_version 1809177 (0.0011) [2023-12-26 14:08:14,475][123091] Updated weights for policy 0, policy_version 1821080 (0.0006) [2023-12-26 14:08:14,535][123091] Updated weights for policy 0, policy_version 1821090 (0.0007) [2023-12-26 14:08:14,590][123091] Updated weights for policy 0, policy_version 1821100 (0.0009) [2023-12-26 14:08:14,810][123090] Updated weights for policy 1, policy_version 1809187 (0.0010) [2023-12-26 14:08:14,873][123090] Updated weights for policy 1, policy_version 1809197 (0.0008) [2023-12-26 14:08:14,940][123090] Updated weights for policy 1, policy_version 1809207 (0.0008) [2023-12-26 14:08:15,412][123091] Updated weights for policy 0, policy_version 1821110 (0.0008) [2023-12-26 14:08:15,477][123091] Updated weights for policy 0, policy_version 1821120 (0.0005) [2023-12-26 14:08:15,546][123091] Updated weights for policy 0, policy_version 1821130 (0.0005) [2023-12-26 14:08:15,718][123090] Updated weights for policy 1, policy_version 1809217 (0.0008) [2023-12-26 14:08:15,771][123090] Updated weights for policy 1, policy_version 1809227 (0.0005) [2023-12-26 14:08:15,829][123090] Updated weights for policy 1, policy_version 1809237 (0.0005) [2023-12-26 14:08:15,881][123090] Updated weights for policy 1, policy_version 1809247 (0.0005) [2023-12-26 14:08:16,307][123091] Updated weights for policy 0, policy_version 1821140 (0.0007) [2023-12-26 14:08:16,371][123091] Updated weights for policy 0, policy_version 1821150 (0.0007) [2023-12-26 14:08:16,423][123091] Updated weights for policy 0, policy_version 1821160 (0.0006) [2023-12-26 14:08:16,525][123090] Updated weights for policy 1, policy_version 1809257 (0.0009) [2023-12-26 14:08:16,603][123090] Updated weights for policy 1, policy_version 1809267 (0.0005) [2023-12-26 14:08:16,672][123090] Updated weights for policy 1, policy_version 1809277 (0.0005) [2023-12-26 14:08:17,126][123091] Updated weights for policy 0, policy_version 1821170 (0.0007) [2023-12-26 14:08:17,185][123091] Updated weights for policy 0, policy_version 1821180 (0.0010) [2023-12-26 14:08:17,255][123091] Updated weights for policy 0, policy_version 1821190 (0.0011) [2023-12-26 14:08:17,314][123091] Updated weights for policy 0, policy_version 1821200 (0.0010) [2023-12-26 14:08:17,337][123090] Updated weights for policy 1, policy_version 1809287 (0.0007) [2023-12-26 14:08:17,397][123090] Updated weights for policy 1, policy_version 1809297 (0.0009) [2023-12-26 14:08:17,457][123090] Updated weights for policy 1, policy_version 1809307 (0.0009) [2023-12-26 14:08:18,110][123091] Updated weights for policy 0, policy_version 1821210 (0.0009) [2023-12-26 14:08:18,168][123091] Updated weights for policy 0, policy_version 1821220 (0.0009) [2023-12-26 14:08:18,219][123091] Updated weights for policy 0, policy_version 1821230 (0.0009) [2023-12-26 14:08:18,263][123090] Updated weights for policy 1, policy_version 1809317 (0.0008) [2023-12-26 14:08:18,315][123090] Updated weights for policy 1, policy_version 1809327 (0.0009) [2023-12-26 14:08:18,376][123090] Updated weights for policy 1, policy_version 1809337 (0.0008) [2023-12-26 14:08:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 929431552. Throughput: 0: 8805.9, 1: 8805.8. Samples: 929442784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:18,784][121949] Avg episode reward: [(0, '6134.435'), (1, '5407.590')] [2023-12-26 14:08:19,061][123091] Updated weights for policy 0, policy_version 1821240 (0.0009) [2023-12-26 14:08:19,118][123091] Updated weights for policy 0, policy_version 1821250 (0.0009) [2023-12-26 14:08:19,122][123090] Updated weights for policy 1, policy_version 1809347 (0.0006) [2023-12-26 14:08:19,184][123091] Updated weights for policy 0, policy_version 1821260 (0.0007) [2023-12-26 14:08:19,188][123090] Updated weights for policy 1, policy_version 1809357 (0.0005) [2023-12-26 14:08:19,257][123090] Updated weights for policy 1, policy_version 1809367 (0.0008) [2023-12-26 14:08:20,044][123090] Updated weights for policy 1, policy_version 1809377 (0.0006) [2023-12-26 14:08:20,103][123091] Updated weights for policy 0, policy_version 1821270 (0.0008) [2023-12-26 14:08:20,103][123090] Updated weights for policy 1, policy_version 1809387 (0.0009) [2023-12-26 14:08:20,169][123090] Updated weights for policy 1, policy_version 1809397 (0.0009) [2023-12-26 14:08:20,169][123091] Updated weights for policy 0, policy_version 1821280 (0.0009) [2023-12-26 14:08:20,224][123090] Updated weights for policy 1, policy_version 1809407 (0.0009) [2023-12-26 14:08:20,237][123091] Updated weights for policy 0, policy_version 1821290 (0.0008) [2023-12-26 14:08:21,032][123091] Updated weights for policy 0, policy_version 1821300 (0.0009) [2023-12-26 14:08:21,096][123091] Updated weights for policy 0, policy_version 1821310 (0.0010) [2023-12-26 14:08:21,157][123090] Updated weights for policy 1, policy_version 1809417 (0.0008) [2023-12-26 14:08:21,160][123091] Updated weights for policy 0, policy_version 1821320 (0.0008) [2023-12-26 14:08:21,223][123090] Updated weights for policy 1, policy_version 1809427 (0.0008) [2023-12-26 14:08:21,297][123090] Updated weights for policy 1, policy_version 1809437 (0.0007) [2023-12-26 14:08:21,932][123091] Updated weights for policy 0, policy_version 1821330 (0.0008) [2023-12-26 14:08:21,990][123091] Updated weights for policy 0, policy_version 1821340 (0.0005) [2023-12-26 14:08:22,050][123091] Updated weights for policy 0, policy_version 1821350 (0.0008) [2023-12-26 14:08:22,113][123091] Updated weights for policy 0, policy_version 1821360 (0.0008) [2023-12-26 14:08:22,148][123090] Updated weights for policy 1, policy_version 1809447 (0.0009) [2023-12-26 14:08:22,214][123090] Updated weights for policy 1, policy_version 1809457 (0.0008) [2023-12-26 14:08:22,271][123090] Updated weights for policy 1, policy_version 1809467 (0.0009) [2023-12-26 14:08:22,902][123091] Updated weights for policy 0, policy_version 1821370 (0.0009) [2023-12-26 14:08:22,975][123091] Updated weights for policy 0, policy_version 1821380 (0.0009) [2023-12-26 14:08:23,039][123091] Updated weights for policy 0, policy_version 1821390 (0.0010) [2023-12-26 14:08:23,109][123090] Updated weights for policy 1, policy_version 1809477 (0.0009) [2023-12-26 14:08:23,178][123090] Updated weights for policy 1, policy_version 1809487 (0.0010) [2023-12-26 14:08:23,242][123090] Updated weights for policy 1, policy_version 1809498 (0.0009) [2023-12-26 14:08:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 929513472. Throughput: 0: 8809.4, 1: 8770.0. Samples: 929493804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:23,785][121949] Avg episode reward: [(0, '6210.020'), (1, '5399.350')] [2023-12-26 14:08:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001809504_463233024.pth... [2023-12-26 14:08:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001808480_462970880.pth [2023-12-26 14:08:23,816][123091] Updated weights for policy 0, policy_version 1821400 (0.0010) [2023-12-26 14:08:23,866][123091] Updated weights for policy 0, policy_version 1821410 (0.0010) [2023-12-26 14:08:23,918][123091] Updated weights for policy 0, policy_version 1821420 (0.0009) [2023-12-26 14:08:23,934][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001821424_466288640.pth... [2023-12-26 14:08:23,937][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001820368_466018304.pth [2023-12-26 14:08:24,076][123090] Updated weights for policy 1, policy_version 1809508 (0.0010) [2023-12-26 14:08:24,129][123090] Updated weights for policy 1, policy_version 1809518 (0.0009) [2023-12-26 14:08:24,185][123090] Updated weights for policy 1, policy_version 1809528 (0.0009) [2023-12-26 14:08:24,759][123091] Updated weights for policy 0, policy_version 1821430 (0.0006) [2023-12-26 14:08:24,807][123091] Updated weights for policy 0, policy_version 1821440 (0.0005) [2023-12-26 14:08:24,854][123091] Updated weights for policy 0, policy_version 1821450 (0.0007) [2023-12-26 14:08:24,938][123090] Updated weights for policy 1, policy_version 1809538 (0.0009) [2023-12-26 14:08:24,985][123090] Updated weights for policy 1, policy_version 1809548 (0.0005) [2023-12-26 14:08:25,041][123090] Updated weights for policy 1, policy_version 1809558 (0.0007) [2023-12-26 14:08:25,092][123090] Updated weights for policy 1, policy_version 1809568 (0.0010) [2023-12-26 14:08:25,583][123091] Updated weights for policy 0, policy_version 1821461 (0.0010) [2023-12-26 14:08:25,639][123091] Updated weights for policy 0, policy_version 1821471 (0.0011) [2023-12-26 14:08:25,683][123091] Updated weights for policy 0, policy_version 1821481 (0.0010) [2023-12-26 14:08:25,816][123090] Updated weights for policy 1, policy_version 1809578 (0.0009) [2023-12-26 14:08:25,867][123090] Updated weights for policy 1, policy_version 1809588 (0.0008) [2023-12-26 14:08:25,929][123090] Updated weights for policy 1, policy_version 1809598 (0.0010) [2023-12-26 14:08:26,503][123091] Updated weights for policy 0, policy_version 1821491 (0.0010) [2023-12-26 14:08:26,565][123091] Updated weights for policy 0, policy_version 1821501 (0.0010) [2023-12-26 14:08:26,625][123091] Updated weights for policy 0, policy_version 1821511 (0.0009) [2023-12-26 14:08:26,674][123090] Updated weights for policy 1, policy_version 1809608 (0.0007) [2023-12-26 14:08:26,729][123090] Updated weights for policy 1, policy_version 1809618 (0.0008) [2023-12-26 14:08:26,784][123090] Updated weights for policy 1, policy_version 1809628 (0.0008) [2023-12-26 14:08:27,444][123091] Updated weights for policy 0, policy_version 1821521 (0.0009) [2023-12-26 14:08:27,504][123091] Updated weights for policy 0, policy_version 1821532 (0.0010) [2023-12-26 14:08:27,550][123090] Updated weights for policy 1, policy_version 1809638 (0.0007) [2023-12-26 14:08:27,569][123091] Updated weights for policy 0, policy_version 1821542 (0.0009) [2023-12-26 14:08:27,605][123090] Updated weights for policy 1, policy_version 1809648 (0.0006) [2023-12-26 14:08:27,620][123091] Updated weights for policy 0, policy_version 1821552 (0.0009) [2023-12-26 14:08:27,671][123090] Updated weights for policy 1, policy_version 1809658 (0.0005) [2023-12-26 14:08:28,236][123090] Updated weights for policy 1, policy_version 1809668 (0.0005) [2023-12-26 14:08:28,292][123090] Updated weights for policy 1, policy_version 1809678 (0.0007) [2023-12-26 14:08:28,376][123090] Updated weights for policy 1, policy_version 1809688 (0.0007) [2023-12-26 14:08:28,516][123091] Updated weights for policy 0, policy_version 1821562 (0.0010) [2023-12-26 14:08:28,578][123091] Updated weights for policy 0, policy_version 1821572 (0.0009) [2023-12-26 14:08:28,640][123091] Updated weights for policy 0, policy_version 1821582 (0.0008) [2023-12-26 14:08:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 929611776. Throughput: 0: 8869.2, 1: 8854.6. Samples: 929601092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:28,785][121949] Avg episode reward: [(0, '6262.157'), (1, '5141.889')] [2023-12-26 14:08:29,040][123090] Updated weights for policy 1, policy_version 1809698 (0.0005) [2023-12-26 14:08:29,097][123090] Updated weights for policy 1, policy_version 1809708 (0.0006) [2023-12-26 14:08:29,165][123090] Updated weights for policy 1, policy_version 1809718 (0.0006) [2023-12-26 14:08:29,234][123090] Updated weights for policy 1, policy_version 1809728 (0.0008) [2023-12-26 14:08:29,475][123091] Updated weights for policy 0, policy_version 1821592 (0.0010) [2023-12-26 14:08:29,528][123091] Updated weights for policy 0, policy_version 1821602 (0.0010) [2023-12-26 14:08:29,582][123091] Updated weights for policy 0, policy_version 1821612 (0.0010) [2023-12-26 14:08:29,995][123090] Updated weights for policy 1, policy_version 1809738 (0.0008) [2023-12-26 14:08:30,062][123090] Updated weights for policy 1, policy_version 1809748 (0.0006) [2023-12-26 14:08:30,130][123090] Updated weights for policy 1, policy_version 1809758 (0.0009) [2023-12-26 14:08:30,456][123091] Updated weights for policy 0, policy_version 1821622 (0.0010) [2023-12-26 14:08:30,504][123091] Updated weights for policy 0, policy_version 1821632 (0.0009) [2023-12-26 14:08:30,563][123091] Updated weights for policy 0, policy_version 1821642 (0.0009) [2023-12-26 14:08:30,884][123090] Updated weights for policy 1, policy_version 1809768 (0.0007) [2023-12-26 14:08:30,953][123090] Updated weights for policy 1, policy_version 1809778 (0.0009) [2023-12-26 14:08:31,011][123090] Updated weights for policy 1, policy_version 1809788 (0.0009) [2023-12-26 14:08:31,444][123091] Updated weights for policy 0, policy_version 1821652 (0.0008) [2023-12-26 14:08:31,517][123091] Updated weights for policy 0, policy_version 1821662 (0.0005) [2023-12-26 14:08:31,591][123091] Updated weights for policy 0, policy_version 1821672 (0.0005) [2023-12-26 14:08:31,833][123090] Updated weights for policy 1, policy_version 1809798 (0.0009) [2023-12-26 14:08:31,886][123090] Updated weights for policy 1, policy_version 1809808 (0.0009) [2023-12-26 14:08:31,947][123090] Updated weights for policy 1, policy_version 1809819 (0.0009) [2023-12-26 14:08:32,251][123091] Updated weights for policy 0, policy_version 1821682 (0.0007) [2023-12-26 14:08:32,320][123091] Updated weights for policy 0, policy_version 1821692 (0.0009) [2023-12-26 14:08:32,382][123091] Updated weights for policy 0, policy_version 1821702 (0.0009) [2023-12-26 14:08:32,444][123091] Updated weights for policy 0, policy_version 1821712 (0.0010) [2023-12-26 14:08:32,845][123090] Updated weights for policy 1, policy_version 1809829 (0.0008) [2023-12-26 14:08:32,907][123090] Updated weights for policy 1, policy_version 1809839 (0.0009) [2023-12-26 14:08:32,970][123090] Updated weights for policy 1, policy_version 1809849 (0.0009) [2023-12-26 14:08:33,277][123091] Updated weights for policy 0, policy_version 1821722 (0.0009) [2023-12-26 14:08:33,342][123091] Updated weights for policy 0, policy_version 1821732 (0.0009) [2023-12-26 14:08:33,412][123091] Updated weights for policy 0, policy_version 1821742 (0.0010) [2023-12-26 14:08:33,673][123090] Updated weights for policy 1, policy_version 1809859 (0.0007) [2023-12-26 14:08:33,722][123090] Updated weights for policy 1, policy_version 1809869 (0.0005) [2023-12-26 14:08:33,779][123090] Updated weights for policy 1, policy_version 1809879 (0.0006) [2023-12-26 14:08:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 929693696. Throughput: 0: 8816.4, 1: 8897.4. Samples: 929707144. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:08:33,785][121949] Avg episode reward: [(0, '6260.399'), (1, '5224.267')] [2023-12-26 14:08:34,297][123091] Updated weights for policy 0, policy_version 1821752 (0.0010) [2023-12-26 14:08:34,366][123091] Updated weights for policy 0, policy_version 1821762 (0.0010) [2023-12-26 14:08:34,435][123091] Updated weights for policy 0, policy_version 1821772 (0.0010) [2023-12-26 14:08:34,498][123090] Updated weights for policy 1, policy_version 1809889 (0.0006) [2023-12-26 14:08:34,563][123090] Updated weights for policy 1, policy_version 1809899 (0.0009) [2023-12-26 14:08:34,627][123090] Updated weights for policy 1, policy_version 1809909 (0.0009) [2023-12-26 14:08:34,695][123090] Updated weights for policy 1, policy_version 1809919 (0.0009) [2023-12-26 14:08:35,193][123091] Updated weights for policy 0, policy_version 1821782 (0.0007) [2023-12-26 14:08:35,242][123091] Updated weights for policy 0, policy_version 1821792 (0.0005) [2023-12-26 14:08:35,295][123091] Updated weights for policy 0, policy_version 1821802 (0.0005) [2023-12-26 14:08:35,437][123090] Updated weights for policy 1, policy_version 1809929 (0.0006) [2023-12-26 14:08:35,503][123090] Updated weights for policy 1, policy_version 1809939 (0.0005) [2023-12-26 14:08:35,552][123090] Updated weights for policy 1, policy_version 1809949 (0.0005) [2023-12-26 14:08:36,151][123091] Updated weights for policy 0, policy_version 1821812 (0.0007) [2023-12-26 14:08:36,214][123091] Updated weights for policy 0, policy_version 1821822 (0.0010) [2023-12-26 14:08:36,231][123090] Updated weights for policy 1, policy_version 1809959 (0.0007) [2023-12-26 14:08:36,274][123091] Updated weights for policy 0, policy_version 1821832 (0.0009) [2023-12-26 14:08:36,299][123090] Updated weights for policy 1, policy_version 1809969 (0.0009) [2023-12-26 14:08:36,360][123090] Updated weights for policy 1, policy_version 1809979 (0.0008) [2023-12-26 14:08:37,100][123091] Updated weights for policy 0, policy_version 1821842 (0.0008) [2023-12-26 14:08:37,154][123091] Updated weights for policy 0, policy_version 1821852 (0.0009) [2023-12-26 14:08:37,203][123091] Updated weights for policy 0, policy_version 1821862 (0.0009) [2023-12-26 14:08:37,212][123090] Updated weights for policy 1, policy_version 1809989 (0.0009) [2023-12-26 14:08:37,251][123091] Updated weights for policy 0, policy_version 1821872 (0.0009) [2023-12-26 14:08:37,280][123090] Updated weights for policy 1, policy_version 1809999 (0.0009) [2023-12-26 14:08:37,340][123090] Updated weights for policy 1, policy_version 1810009 (0.0009) [2023-12-26 14:08:38,130][123090] Updated weights for policy 1, policy_version 1810019 (0.0009) [2023-12-26 14:08:38,133][123091] Updated weights for policy 0, policy_version 1821882 (0.0009) [2023-12-26 14:08:38,193][123091] Updated weights for policy 0, policy_version 1821892 (0.0008) [2023-12-26 14:08:38,195][123090] Updated weights for policy 1, policy_version 1810029 (0.0008) [2023-12-26 14:08:38,253][123091] Updated weights for policy 0, policy_version 1821902 (0.0008) [2023-12-26 14:08:38,259][123090] Updated weights for policy 1, policy_version 1810039 (0.0007) [2023-12-26 14:08:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 929783808. Throughput: 0: 8823.4, 1: 8956.6. Samples: 929761964. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:08:38,785][121949] Avg episode reward: [(0, '6183.132'), (1, '5516.752')] [2023-12-26 14:08:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001810048_463372288.pth... [2023-12-26 14:08:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001821904_466411520.pth... [2023-12-26 14:08:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001808992_463101952.pth [2023-12-26 14:08:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001820880_466149376.pth [2023-12-26 14:08:39,049][123090] Updated weights for policy 1, policy_version 1810049 (0.0008) [2023-12-26 14:08:39,100][123090] Updated weights for policy 1, policy_version 1810059 (0.0008) [2023-12-26 14:08:39,101][123091] Updated weights for policy 0, policy_version 1821912 (0.0008) [2023-12-26 14:08:39,152][123090] Updated weights for policy 1, policy_version 1810069 (0.0006) [2023-12-26 14:08:39,158][123091] Updated weights for policy 0, policy_version 1821922 (0.0009) [2023-12-26 14:08:39,212][123090] Updated weights for policy 1, policy_version 1810079 (0.0006) [2023-12-26 14:08:39,225][123091] Updated weights for policy 0, policy_version 1821932 (0.0010) [2023-12-26 14:08:40,101][123091] Updated weights for policy 0, policy_version 1821942 (0.0007) [2023-12-26 14:08:40,106][123090] Updated weights for policy 1, policy_version 1810089 (0.0009) [2023-12-26 14:08:40,153][123091] Updated weights for policy 0, policy_version 1821952 (0.0007) [2023-12-26 14:08:40,165][123090] Updated weights for policy 1, policy_version 1810099 (0.0007) [2023-12-26 14:08:40,205][123091] Updated weights for policy 0, policy_version 1821962 (0.0008) [2023-12-26 14:08:40,232][123090] Updated weights for policy 1, policy_version 1810109 (0.0005) [2023-12-26 14:08:40,979][123090] Updated weights for policy 1, policy_version 1810119 (0.0007) [2023-12-26 14:08:40,982][123091] Updated weights for policy 0, policy_version 1821972 (0.0008) [2023-12-26 14:08:41,042][123090] Updated weights for policy 1, policy_version 1810129 (0.0007) [2023-12-26 14:08:41,051][123091] Updated weights for policy 0, policy_version 1821982 (0.0008) [2023-12-26 14:08:41,107][123090] Updated weights for policy 1, policy_version 1810139 (0.0007) [2023-12-26 14:08:41,118][123091] Updated weights for policy 0, policy_version 1821992 (0.0009) [2023-12-26 14:08:41,985][123090] Updated weights for policy 1, policy_version 1810149 (0.0009) [2023-12-26 14:08:41,992][123091] Updated weights for policy 0, policy_version 1822002 (0.0008) [2023-12-26 14:08:42,045][123090] Updated weights for policy 1, policy_version 1810159 (0.0008) [2023-12-26 14:08:42,056][123091] Updated weights for policy 0, policy_version 1822012 (0.0007) [2023-12-26 14:08:42,114][123090] Updated weights for policy 1, policy_version 1810169 (0.0009) [2023-12-26 14:08:42,124][123091] Updated weights for policy 0, policy_version 1822022 (0.0010) [2023-12-26 14:08:42,180][123091] Updated weights for policy 0, policy_version 1822032 (0.0009) [2023-12-26 14:08:42,927][123090] Updated weights for policy 1, policy_version 1810179 (0.0008) [2023-12-26 14:08:42,930][123091] Updated weights for policy 0, policy_version 1822042 (0.0008) [2023-12-26 14:08:42,975][123090] Updated weights for policy 1, policy_version 1810189 (0.0005) [2023-12-26 14:08:42,999][123091] Updated weights for policy 0, policy_version 1822052 (0.0006) [2023-12-26 14:08:43,022][123090] Updated weights for policy 1, policy_version 1810199 (0.0005) [2023-12-26 14:08:43,072][123091] Updated weights for policy 0, policy_version 1822062 (0.0006) [2023-12-26 14:08:43,682][123091] Updated weights for policy 0, policy_version 1822072 (0.0005) [2023-12-26 14:08:43,717][123090] Updated weights for policy 1, policy_version 1810209 (0.0006) [2023-12-26 14:08:43,728][123091] Updated weights for policy 0, policy_version 1822082 (0.0005) [2023-12-26 14:08:43,765][123090] Updated weights for policy 1, policy_version 1810219 (0.0005) [2023-12-26 14:08:43,780][123091] Updated weights for policy 0, policy_version 1822092 (0.0009) [2023-12-26 14:08:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 929865728. Throughput: 0: 8777.3, 1: 8897.6. Samples: 929864360. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:08:43,785][121949] Avg episode reward: [(0, '6107.465'), (1, '5327.429')] [2023-12-26 14:08:43,814][123090] Updated weights for policy 1, policy_version 1810229 (0.0005) [2023-12-26 14:08:43,871][123090] Updated weights for policy 1, policy_version 1810239 (0.0006) [2023-12-26 14:08:44,501][123091] Updated weights for policy 0, policy_version 1822102 (0.0007) [2023-12-26 14:08:44,556][123091] Updated weights for policy 0, policy_version 1822112 (0.0005) [2023-12-26 14:08:44,569][123090] Updated weights for policy 1, policy_version 1810249 (0.0010) [2023-12-26 14:08:44,610][123091] Updated weights for policy 0, policy_version 1822122 (0.0005) [2023-12-26 14:08:44,633][123090] Updated weights for policy 1, policy_version 1810259 (0.0009) [2023-12-26 14:08:44,687][123090] Updated weights for policy 1, policy_version 1810269 (0.0006) [2023-12-26 14:08:45,416][123091] Updated weights for policy 0, policy_version 1822132 (0.0008) [2023-12-26 14:08:45,430][123090] Updated weights for policy 1, policy_version 1810279 (0.0005) [2023-12-26 14:08:45,484][123091] Updated weights for policy 0, policy_version 1822142 (0.0011) [2023-12-26 14:08:45,496][123090] Updated weights for policy 1, policy_version 1810289 (0.0008) [2023-12-26 14:08:45,550][123091] Updated weights for policy 0, policy_version 1822152 (0.0007) [2023-12-26 14:08:45,571][123090] Updated weights for policy 1, policy_version 1810299 (0.0009) [2023-12-26 14:08:46,206][123090] Updated weights for policy 1, policy_version 1810309 (0.0006) [2023-12-26 14:08:46,241][123091] Updated weights for policy 0, policy_version 1822162 (0.0005) [2023-12-26 14:08:46,281][123090] Updated weights for policy 1, policy_version 1810319 (0.0006) [2023-12-26 14:08:46,314][123091] Updated weights for policy 0, policy_version 1822172 (0.0006) [2023-12-26 14:08:46,356][123090] Updated weights for policy 1, policy_version 1810329 (0.0005) [2023-12-26 14:08:46,373][123091] Updated weights for policy 0, policy_version 1822182 (0.0007) [2023-12-26 14:08:46,423][123091] Updated weights for policy 0, policy_version 1822192 (0.0007) [2023-12-26 14:08:46,953][123090] Updated weights for policy 1, policy_version 1810339 (0.0005) [2023-12-26 14:08:47,028][123090] Updated weights for policy 1, policy_version 1810349 (0.0005) [2023-12-26 14:08:47,090][123090] Updated weights for policy 1, policy_version 1810359 (0.0007) [2023-12-26 14:08:47,117][123091] Updated weights for policy 0, policy_version 1822202 (0.0008) [2023-12-26 14:08:47,180][123091] Updated weights for policy 0, policy_version 1822212 (0.0006) [2023-12-26 14:08:47,243][123091] Updated weights for policy 0, policy_version 1822222 (0.0009) [2023-12-26 14:08:47,816][123090] Updated weights for policy 1, policy_version 1810369 (0.0008) [2023-12-26 14:08:47,876][123090] Updated weights for policy 1, policy_version 1810379 (0.0005) [2023-12-26 14:08:47,933][123090] Updated weights for policy 1, policy_version 1810389 (0.0007) [2023-12-26 14:08:47,935][123091] Updated weights for policy 0, policy_version 1822232 (0.0008) [2023-12-26 14:08:47,992][123091] Updated weights for policy 0, policy_version 1822242 (0.0008) [2023-12-26 14:08:47,999][123090] Updated weights for policy 1, policy_version 1810399 (0.0006) [2023-12-26 14:08:48,051][123091] Updated weights for policy 0, policy_version 1822252 (0.0009) [2023-12-26 14:08:48,764][123090] Updated weights for policy 1, policy_version 1810409 (0.0009) [2023-12-26 14:08:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 929964032. Throughput: 0: 8901.9, 1: 9035.8. Samples: 929980524. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:08:48,785][121949] Avg episode reward: [(0, '6143.050'), (1, '5455.872')] [2023-12-26 14:08:48,831][123090] Updated weights for policy 1, policy_version 1810419 (0.0009) [2023-12-26 14:08:48,856][123091] Updated weights for policy 0, policy_version 1822262 (0.0008) [2023-12-26 14:08:48,894][123090] Updated weights for policy 1, policy_version 1810429 (0.0009) [2023-12-26 14:08:48,923][123091] Updated weights for policy 0, policy_version 1822272 (0.0009) [2023-12-26 14:08:48,993][123091] Updated weights for policy 0, policy_version 1822282 (0.0010) [2023-12-26 14:08:49,712][123090] Updated weights for policy 1, policy_version 1810439 (0.0010) [2023-12-26 14:08:49,761][123090] Updated weights for policy 1, policy_version 1810449 (0.0009) [2023-12-26 14:08:49,763][123091] Updated weights for policy 0, policy_version 1822292 (0.0008) [2023-12-26 14:08:49,819][123090] Updated weights for policy 1, policy_version 1810459 (0.0008) [2023-12-26 14:08:49,829][123091] Updated weights for policy 0, policy_version 1822302 (0.0007) [2023-12-26 14:08:49,892][123091] Updated weights for policy 0, policy_version 1822312 (0.0007) [2023-12-26 14:08:50,685][123091] Updated weights for policy 0, policy_version 1822322 (0.0007) [2023-12-26 14:08:50,702][123090] Updated weights for policy 1, policy_version 1810469 (0.0010) [2023-12-26 14:08:50,752][123091] Updated weights for policy 0, policy_version 1822332 (0.0006) [2023-12-26 14:08:50,763][123090] Updated weights for policy 1, policy_version 1810479 (0.0011) [2023-12-26 14:08:50,813][123091] Updated weights for policy 0, policy_version 1822342 (0.0006) [2023-12-26 14:08:50,819][123090] Updated weights for policy 1, policy_version 1810489 (0.0011) [2023-12-26 14:08:50,876][123091] Updated weights for policy 0, policy_version 1822352 (0.0007) [2023-12-26 14:08:51,643][123090] Updated weights for policy 1, policy_version 1810499 (0.0010) [2023-12-26 14:08:51,701][123091] Updated weights for policy 0, policy_version 1822362 (0.0008) [2023-12-26 14:08:51,707][123090] Updated weights for policy 1, policy_version 1810509 (0.0010) [2023-12-26 14:08:51,771][123091] Updated weights for policy 0, policy_version 1822372 (0.0009) [2023-12-26 14:08:51,774][123090] Updated weights for policy 1, policy_version 1810519 (0.0010) [2023-12-26 14:08:51,824][123091] Updated weights for policy 0, policy_version 1822382 (0.0006) [2023-12-26 14:08:52,605][123090] Updated weights for policy 1, policy_version 1810529 (0.0010) [2023-12-26 14:08:52,671][123090] Updated weights for policy 1, policy_version 1810539 (0.0007) [2023-12-26 14:08:52,672][123091] Updated weights for policy 0, policy_version 1822392 (0.0010) [2023-12-26 14:08:52,731][123090] Updated weights for policy 1, policy_version 1810549 (0.0006) [2023-12-26 14:08:52,735][123091] Updated weights for policy 0, policy_version 1822402 (0.0009) [2023-12-26 14:08:52,796][123090] Updated weights for policy 1, policy_version 1810559 (0.0006) [2023-12-26 14:08:52,800][123091] Updated weights for policy 0, policy_version 1822412 (0.0009) [2023-12-26 14:08:53,598][123090] Updated weights for policy 1, policy_version 1810569 (0.0009) [2023-12-26 14:08:53,646][123091] Updated weights for policy 0, policy_version 1822422 (0.0007) [2023-12-26 14:08:53,662][123090] Updated weights for policy 1, policy_version 1810579 (0.0010) [2023-12-26 14:08:53,713][123091] Updated weights for policy 0, policy_version 1822432 (0.0008) [2023-12-26 14:08:53,728][123090] Updated weights for policy 1, policy_version 1810589 (0.0008) [2023-12-26 14:08:53,776][123091] Updated weights for policy 0, policy_version 1822442 (0.0008) [2023-12-26 14:08:53,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 930054144. Throughput: 0: 8899.7, 1: 9025.2. Samples: 930032240. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:08:53,785][121949] Avg episode reward: [(0, '6300.971'), (1, '5766.071')] [2023-12-26 14:08:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001810592_463511552.pth... [2023-12-26 14:08:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001809504_463233024.pth [2023-12-26 14:08:53,815][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001822448_466550784.pth... [2023-12-26 14:08:53,819][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001821424_466288640.pth [2023-12-26 14:08:54,467][123090] Updated weights for policy 1, policy_version 1810599 (0.0007) [2023-12-26 14:08:54,539][123090] Updated weights for policy 1, policy_version 1810609 (0.0006) [2023-12-26 14:08:54,607][123090] Updated weights for policy 1, policy_version 1810619 (0.0006) [2023-12-26 14:08:54,620][123091] Updated weights for policy 0, policy_version 1822452 (0.0009) [2023-12-26 14:08:54,680][123091] Updated weights for policy 0, policy_version 1822462 (0.0009) [2023-12-26 14:08:54,743][123091] Updated weights for policy 0, policy_version 1822472 (0.0009) [2023-12-26 14:08:55,298][123090] Updated weights for policy 1, policy_version 1810629 (0.0008) [2023-12-26 14:08:55,363][123090] Updated weights for policy 1, policy_version 1810639 (0.0010) [2023-12-26 14:08:55,432][123090] Updated weights for policy 1, policy_version 1810649 (0.0010) [2023-12-26 14:08:55,592][123091] Updated weights for policy 0, policy_version 1822482 (0.0009) [2023-12-26 14:08:55,657][123091] Updated weights for policy 0, policy_version 1822492 (0.0009) [2023-12-26 14:08:55,716][123091] Updated weights for policy 0, policy_version 1822502 (0.0009) [2023-12-26 14:08:55,781][123091] Updated weights for policy 0, policy_version 1822512 (0.0010) [2023-12-26 14:08:56,144][123090] Updated weights for policy 1, policy_version 1810659 (0.0009) [2023-12-26 14:08:56,205][123090] Updated weights for policy 1, policy_version 1810669 (0.0005) [2023-12-26 14:08:56,266][123090] Updated weights for policy 1, policy_version 1810679 (0.0005) [2023-12-26 14:08:56,626][123091] Updated weights for policy 0, policy_version 1822522 (0.0005) [2023-12-26 14:08:56,672][123091] Updated weights for policy 0, policy_version 1822532 (0.0008) [2023-12-26 14:08:56,721][123091] Updated weights for policy 0, policy_version 1822542 (0.0008) [2023-12-26 14:08:56,936][123090] Updated weights for policy 1, policy_version 1810689 (0.0006) [2023-12-26 14:08:57,002][123090] Updated weights for policy 1, policy_version 1810699 (0.0005) [2023-12-26 14:08:57,070][123090] Updated weights for policy 1, policy_version 1810709 (0.0005) [2023-12-26 14:08:57,136][123090] Updated weights for policy 1, policy_version 1810719 (0.0005) [2023-12-26 14:08:57,306][123091] Updated weights for policy 0, policy_version 1822552 (0.0008) [2023-12-26 14:08:57,359][123091] Updated weights for policy 0, policy_version 1822562 (0.0010) [2023-12-26 14:08:57,415][123091] Updated weights for policy 0, policy_version 1822572 (0.0005) [2023-12-26 14:08:57,765][123090] Updated weights for policy 1, policy_version 1810729 (0.0005) [2023-12-26 14:08:57,812][123090] Updated weights for policy 1, policy_version 1810739 (0.0005) [2023-12-26 14:08:57,865][123090] Updated weights for policy 1, policy_version 1810749 (0.0005) [2023-12-26 14:08:58,108][123091] Updated weights for policy 0, policy_version 1822582 (0.0009) [2023-12-26 14:08:58,167][123091] Updated weights for policy 0, policy_version 1822592 (0.0011) [2023-12-26 14:08:58,218][123091] Updated weights for policy 0, policy_version 1822602 (0.0010) [2023-12-26 14:08:58,742][123090] Updated weights for policy 1, policy_version 1810759 (0.0009) [2023-12-26 14:08:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 930144256. Throughput: 0: 8804.5, 1: 9160.6. Samples: 930141324. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:08:58,785][121949] Avg episode reward: [(0, '6293.864'), (1, '5771.355')] [2023-12-26 14:08:58,817][123090] Updated weights for policy 1, policy_version 1810769 (0.0008) [2023-12-26 14:08:58,888][123090] Updated weights for policy 1, policy_version 1810779 (0.0006) [2023-12-26 14:08:59,097][123091] Updated weights for policy 0, policy_version 1822612 (0.0011) [2023-12-26 14:08:59,155][123091] Updated weights for policy 0, policy_version 1822622 (0.0010) [2023-12-26 14:08:59,207][123091] Updated weights for policy 0, policy_version 1822632 (0.0010) [2023-12-26 14:08:59,633][123090] Updated weights for policy 1, policy_version 1810789 (0.0009) [2023-12-26 14:08:59,694][123090] Updated weights for policy 1, policy_version 1810799 (0.0009) [2023-12-26 14:08:59,753][123090] Updated weights for policy 1, policy_version 1810809 (0.0009) [2023-12-26 14:09:00,052][123091] Updated weights for policy 0, policy_version 1822642 (0.0008) [2023-12-26 14:09:00,116][123091] Updated weights for policy 0, policy_version 1822652 (0.0009) [2023-12-26 14:09:00,166][123091] Updated weights for policy 0, policy_version 1822663 (0.0010) [2023-12-26 14:09:00,538][123090] Updated weights for policy 1, policy_version 1810819 (0.0008) [2023-12-26 14:09:00,596][123090] Updated weights for policy 1, policy_version 1810829 (0.0008) [2023-12-26 14:09:00,654][123090] Updated weights for policy 1, policy_version 1810839 (0.0005) [2023-12-26 14:09:01,035][123091] Updated weights for policy 0, policy_version 1822673 (0.0009) [2023-12-26 14:09:01,094][123091] Updated weights for policy 0, policy_version 1822683 (0.0008) [2023-12-26 14:09:01,158][123091] Updated weights for policy 0, policy_version 1822693 (0.0008) [2023-12-26 14:09:01,220][123091] Updated weights for policy 0, policy_version 1822703 (0.0008) [2023-12-26 14:09:01,310][123090] Updated weights for policy 1, policy_version 1810849 (0.0005) [2023-12-26 14:09:01,377][123090] Updated weights for policy 1, policy_version 1810859 (0.0007) [2023-12-26 14:09:01,434][123090] Updated weights for policy 1, policy_version 1810869 (0.0010) [2023-12-26 14:09:01,494][123090] Updated weights for policy 1, policy_version 1810880 (0.0009) [2023-12-26 14:09:02,073][123091] Updated weights for policy 0, policy_version 1822713 (0.0006) [2023-12-26 14:09:02,142][123091] Updated weights for policy 0, policy_version 1822723 (0.0009) [2023-12-26 14:09:02,208][123091] Updated weights for policy 0, policy_version 1822733 (0.0010) [2023-12-26 14:09:02,319][123090] Updated weights for policy 1, policy_version 1810890 (0.0009) [2023-12-26 14:09:02,379][123090] Updated weights for policy 1, policy_version 1810900 (0.0010) [2023-12-26 14:09:02,445][123090] Updated weights for policy 1, policy_version 1810910 (0.0008) [2023-12-26 14:09:03,018][123091] Updated weights for policy 0, policy_version 1822743 (0.0008) [2023-12-26 14:09:03,083][123091] Updated weights for policy 0, policy_version 1822753 (0.0005) [2023-12-26 14:09:03,147][123091] Updated weights for policy 0, policy_version 1822763 (0.0009) [2023-12-26 14:09:03,288][123090] Updated weights for policy 1, policy_version 1810920 (0.0009) [2023-12-26 14:09:03,352][123090] Updated weights for policy 1, policy_version 1810930 (0.0009) [2023-12-26 14:09:03,416][123090] Updated weights for policy 1, policy_version 1810940 (0.0010) [2023-12-26 14:09:03,777][123091] Updated weights for policy 0, policy_version 1822773 (0.0009) [2023-12-26 14:09:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 930234368. Throughput: 0: 8788.4, 1: 9090.6. Samples: 930247340. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:03,784][121949] Avg episode reward: [(0, '6221.782'), (1, '5561.544')] [2023-12-26 14:09:03,872][123091] Updated weights for policy 0, policy_version 1822783 (0.0010) [2023-12-26 14:09:03,938][123091] Updated weights for policy 0, policy_version 1822793 (0.0010) [2023-12-26 14:09:04,281][123090] Updated weights for policy 1, policy_version 1810950 (0.0010) [2023-12-26 14:09:04,345][123090] Updated weights for policy 1, policy_version 1810960 (0.0010) [2023-12-26 14:09:04,409][123090] Updated weights for policy 1, policy_version 1810970 (0.0008) [2023-12-26 14:09:04,747][123091] Updated weights for policy 0, policy_version 1822803 (0.0010) [2023-12-26 14:09:04,819][123091] Updated weights for policy 0, policy_version 1822813 (0.0009) [2023-12-26 14:09:04,881][123091] Updated weights for policy 0, policy_version 1822823 (0.0009) [2023-12-26 14:09:05,230][123090] Updated weights for policy 1, policy_version 1810980 (0.0009) [2023-12-26 14:09:05,296][123090] Updated weights for policy 1, policy_version 1810990 (0.0009) [2023-12-26 14:09:05,351][123090] Updated weights for policy 1, policy_version 1811000 (0.0009) [2023-12-26 14:09:05,618][123091] Updated weights for policy 0, policy_version 1822833 (0.0009) [2023-12-26 14:09:05,679][123091] Updated weights for policy 0, policy_version 1822843 (0.0010) [2023-12-26 14:09:05,739][123091] Updated weights for policy 0, policy_version 1822853 (0.0009) [2023-12-26 14:09:05,794][123091] Updated weights for policy 0, policy_version 1822863 (0.0009) [2023-12-26 14:09:06,204][123090] Updated weights for policy 1, policy_version 1811010 (0.0010) [2023-12-26 14:09:06,267][123090] Updated weights for policy 1, policy_version 1811020 (0.0010) [2023-12-26 14:09:06,330][123090] Updated weights for policy 1, policy_version 1811030 (0.0009) [2023-12-26 14:09:06,391][123090] Updated weights for policy 1, policy_version 1811040 (0.0009) [2023-12-26 14:09:06,595][123091] Updated weights for policy 0, policy_version 1822873 (0.0010) [2023-12-26 14:09:06,654][123091] Updated weights for policy 0, policy_version 1822883 (0.0009) [2023-12-26 14:09:06,713][123091] Updated weights for policy 0, policy_version 1822893 (0.0009) [2023-12-26 14:09:07,268][123090] Updated weights for policy 1, policy_version 1811050 (0.0009) [2023-12-26 14:09:07,316][123090] Updated weights for policy 1, policy_version 1811060 (0.0009) [2023-12-26 14:09:07,366][123090] Updated weights for policy 1, policy_version 1811070 (0.0009) [2023-12-26 14:09:07,505][123091] Updated weights for policy 0, policy_version 1822903 (0.0009) [2023-12-26 14:09:07,553][123091] Updated weights for policy 0, policy_version 1822913 (0.0009) [2023-12-26 14:09:07,612][123091] Updated weights for policy 0, policy_version 1822923 (0.0009) [2023-12-26 14:09:08,184][123090] Updated weights for policy 1, policy_version 1811080 (0.0010) [2023-12-26 14:09:08,236][123090] Updated weights for policy 1, policy_version 1811091 (0.0007) [2023-12-26 14:09:08,283][123090] Updated weights for policy 1, policy_version 1811101 (0.0005) [2023-12-26 14:09:08,503][123091] Updated weights for policy 0, policy_version 1822933 (0.0010) [2023-12-26 14:09:08,555][123091] Updated weights for policy 0, policy_version 1822943 (0.0010) [2023-12-26 14:09:08,611][123091] Updated weights for policy 0, policy_version 1822953 (0.0010) [2023-12-26 14:09:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 930324480. Throughput: 0: 8810.9, 1: 9080.4. Samples: 930298912. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:08,785][121949] Avg episode reward: [(0, '6309.399'), (1, '5458.848')] [2023-12-26 14:09:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001811104_463642624.pth... [2023-12-26 14:09:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001822960_466681856.pth... [2023-12-26 14:09:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001810048_463372288.pth [2023-12-26 14:09:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001821904_466411520.pth [2023-12-26 14:09:09,003][123090] Updated weights for policy 1, policy_version 1811111 (0.0008) [2023-12-26 14:09:09,059][123090] Updated weights for policy 1, policy_version 1811121 (0.0009) [2023-12-26 14:09:09,107][123090] Updated weights for policy 1, policy_version 1811131 (0.0009) [2023-12-26 14:09:09,438][123091] Updated weights for policy 0, policy_version 1822963 (0.0006) [2023-12-26 14:09:09,503][123091] Updated weights for policy 0, policy_version 1822973 (0.0008) [2023-12-26 14:09:09,572][123091] Updated weights for policy 0, policy_version 1822983 (0.0009) [2023-12-26 14:09:09,971][123090] Updated weights for policy 1, policy_version 1811141 (0.0009) [2023-12-26 14:09:10,039][123090] Updated weights for policy 1, policy_version 1811151 (0.0009) [2023-12-26 14:09:10,109][123090] Updated weights for policy 1, policy_version 1811161 (0.0006) [2023-12-26 14:09:10,404][123091] Updated weights for policy 0, policy_version 1822993 (0.0010) [2023-12-26 14:09:10,478][123091] Updated weights for policy 0, policy_version 1823003 (0.0009) [2023-12-26 14:09:10,534][123091] Updated weights for policy 0, policy_version 1823013 (0.0009) [2023-12-26 14:09:10,591][123091] Updated weights for policy 0, policy_version 1823023 (0.0009) [2023-12-26 14:09:10,923][123090] Updated weights for policy 1, policy_version 1811171 (0.0007) [2023-12-26 14:09:10,976][123090] Updated weights for policy 1, policy_version 1811181 (0.0010) [2023-12-26 14:09:11,024][123090] Updated weights for policy 1, policy_version 1811191 (0.0010) [2023-12-26 14:09:11,504][123091] Updated weights for policy 0, policy_version 1823033 (0.0010) [2023-12-26 14:09:11,566][123091] Updated weights for policy 0, policy_version 1823043 (0.0009) [2023-12-26 14:09:11,628][123091] Updated weights for policy 0, policy_version 1823053 (0.0009) [2023-12-26 14:09:11,917][123090] Updated weights for policy 1, policy_version 1811201 (0.0011) [2023-12-26 14:09:11,993][123090] Updated weights for policy 1, policy_version 1811211 (0.0011) [2023-12-26 14:09:12,059][123090] Updated weights for policy 1, policy_version 1811221 (0.0011) [2023-12-26 14:09:12,127][123090] Updated weights for policy 1, policy_version 1811231 (0.0011) [2023-12-26 14:09:12,520][123091] Updated weights for policy 0, policy_version 1823063 (0.0009) [2023-12-26 14:09:12,580][123091] Updated weights for policy 0, policy_version 1823073 (0.0009) [2023-12-26 14:09:12,650][123091] Updated weights for policy 0, policy_version 1823083 (0.0008) [2023-12-26 14:09:12,912][123090] Updated weights for policy 1, policy_version 1811241 (0.0009) [2023-12-26 14:09:12,971][123090] Updated weights for policy 1, policy_version 1811251 (0.0009) [2023-12-26 14:09:13,022][123090] Updated weights for policy 1, policy_version 1811261 (0.0009) [2023-12-26 14:09:13,480][123091] Updated weights for policy 0, policy_version 1823093 (0.0010) [2023-12-26 14:09:13,531][123091] Updated weights for policy 0, policy_version 1823103 (0.0011) [2023-12-26 14:09:13,582][123091] Updated weights for policy 0, policy_version 1823113 (0.0007) [2023-12-26 14:09:13,779][123090] Updated weights for policy 1, policy_version 1811271 (0.0006) [2023-12-26 14:09:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 930406400. Throughput: 0: 8738.8, 1: 9025.5. Samples: 930400488. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:13,785][121949] Avg episode reward: [(0, '6277.821'), (1, '5435.245')] [2023-12-26 14:09:13,835][123090] Updated weights for policy 1, policy_version 1811281 (0.0005) [2023-12-26 14:09:13,896][123090] Updated weights for policy 1, policy_version 1811291 (0.0005) [2023-12-26 14:09:14,345][123091] Updated weights for policy 0, policy_version 1823123 (0.0007) [2023-12-26 14:09:14,388][123091] Updated weights for policy 0, policy_version 1823133 (0.0010) [2023-12-26 14:09:14,443][123091] Updated weights for policy 0, policy_version 1823143 (0.0010) [2023-12-26 14:09:14,633][123090] Updated weights for policy 1, policy_version 1811301 (0.0007) [2023-12-26 14:09:14,707][123090] Updated weights for policy 1, policy_version 1811311 (0.0010) [2023-12-26 14:09:14,780][123090] Updated weights for policy 1, policy_version 1811321 (0.0010) [2023-12-26 14:09:15,192][123091] Updated weights for policy 0, policy_version 1823153 (0.0009) [2023-12-26 14:09:15,257][123091] Updated weights for policy 0, policy_version 1823163 (0.0009) [2023-12-26 14:09:15,309][123091] Updated weights for policy 0, policy_version 1823173 (0.0009) [2023-12-26 14:09:15,373][123091] Updated weights for policy 0, policy_version 1823183 (0.0006) [2023-12-26 14:09:15,636][123090] Updated weights for policy 1, policy_version 1811331 (0.0010) [2023-12-26 14:09:15,684][123090] Updated weights for policy 1, policy_version 1811341 (0.0009) [2023-12-26 14:09:15,733][123090] Updated weights for policy 1, policy_version 1811351 (0.0009) [2023-12-26 14:09:16,075][123091] Updated weights for policy 0, policy_version 1823193 (0.0008) [2023-12-26 14:09:16,130][123091] Updated weights for policy 0, policy_version 1823203 (0.0009) [2023-12-26 14:09:16,177][123091] Updated weights for policy 0, policy_version 1823213 (0.0008) [2023-12-26 14:09:16,622][123090] Updated weights for policy 1, policy_version 1811361 (0.0008) [2023-12-26 14:09:16,678][123090] Updated weights for policy 1, policy_version 1811371 (0.0009) [2023-12-26 14:09:16,730][123090] Updated weights for policy 1, policy_version 1811381 (0.0010) [2023-12-26 14:09:16,785][123090] Updated weights for policy 1, policy_version 1811391 (0.0010) [2023-12-26 14:09:16,851][123091] Updated weights for policy 0, policy_version 1823223 (0.0008) [2023-12-26 14:09:16,918][123091] Updated weights for policy 0, policy_version 1823233 (0.0011) [2023-12-26 14:09:16,984][123091] Updated weights for policy 0, policy_version 1823243 (0.0010) [2023-12-26 14:09:17,581][123090] Updated weights for policy 1, policy_version 1811401 (0.0011) [2023-12-26 14:09:17,649][123090] Updated weights for policy 1, policy_version 1811411 (0.0011) [2023-12-26 14:09:17,718][123090] Updated weights for policy 1, policy_version 1811421 (0.0011) [2023-12-26 14:09:17,789][123091] Updated weights for policy 0, policy_version 1823253 (0.0011) [2023-12-26 14:09:17,848][123091] Updated weights for policy 0, policy_version 1823263 (0.0011) [2023-12-26 14:09:17,910][123091] Updated weights for policy 0, policy_version 1823273 (0.0011) [2023-12-26 14:09:18,484][123090] Updated weights for policy 1, policy_version 1811431 (0.0011) [2023-12-26 14:09:18,548][123090] Updated weights for policy 1, policy_version 1811441 (0.0011) [2023-12-26 14:09:18,617][123090] Updated weights for policy 1, policy_version 1811451 (0.0009) [2023-12-26 14:09:18,738][123091] Updated weights for policy 0, policy_version 1823283 (0.0011) [2023-12-26 14:09:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 930496512. Throughput: 0: 8835.7, 1: 8965.1. Samples: 930508180. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:18,785][121949] Avg episode reward: [(0, '6290.134'), (1, '5598.294')] [2023-12-26 14:09:18,805][123091] Updated weights for policy 0, policy_version 1823293 (0.0011) [2023-12-26 14:09:18,868][123091] Updated weights for policy 0, policy_version 1823303 (0.0011) [2023-12-26 14:09:19,383][123090] Updated weights for policy 1, policy_version 1811461 (0.0009) [2023-12-26 14:09:19,446][123090] Updated weights for policy 1, policy_version 1811471 (0.0010) [2023-12-26 14:09:19,516][123090] Updated weights for policy 1, policy_version 1811481 (0.0011) [2023-12-26 14:09:19,700][123091] Updated weights for policy 0, policy_version 1823313 (0.0011) [2023-12-26 14:09:19,758][123091] Updated weights for policy 0, policy_version 1823323 (0.0006) [2023-12-26 14:09:19,807][123091] Updated weights for policy 0, policy_version 1823333 (0.0005) [2023-12-26 14:09:19,873][123091] Updated weights for policy 0, policy_version 1823343 (0.0007) [2023-12-26 14:09:20,361][123090] Updated weights for policy 1, policy_version 1811491 (0.0011) [2023-12-26 14:09:20,436][123090] Updated weights for policy 1, policy_version 1811501 (0.0010) [2023-12-26 14:09:20,487][123090] Updated weights for policy 1, policy_version 1811511 (0.0009) [2023-12-26 14:09:20,613][123091] Updated weights for policy 0, policy_version 1823353 (0.0008) [2023-12-26 14:09:20,674][123091] Updated weights for policy 0, policy_version 1823363 (0.0010) [2023-12-26 14:09:20,741][123091] Updated weights for policy 0, policy_version 1823373 (0.0009) [2023-12-26 14:09:21,328][123090] Updated weights for policy 1, policy_version 1811521 (0.0010) [2023-12-26 14:09:21,403][123090] Updated weights for policy 1, policy_version 1811531 (0.0009) [2023-12-26 14:09:21,469][123090] Updated weights for policy 1, policy_version 1811541 (0.0007) [2023-12-26 14:09:21,542][123090] Updated weights for policy 1, policy_version 1811551 (0.0006) [2023-12-26 14:09:21,658][123091] Updated weights for policy 0, policy_version 1823383 (0.0007) [2023-12-26 14:09:21,731][123091] Updated weights for policy 0, policy_version 1823393 (0.0007) [2023-12-26 14:09:21,796][123091] Updated weights for policy 0, policy_version 1823403 (0.0006) [2023-12-26 14:09:22,350][123090] Updated weights for policy 1, policy_version 1811561 (0.0009) [2023-12-26 14:09:22,424][123090] Updated weights for policy 1, policy_version 1811571 (0.0010) [2023-12-26 14:09:22,497][123090] Updated weights for policy 1, policy_version 1811581 (0.0008) [2023-12-26 14:09:22,602][123091] Updated weights for policy 0, policy_version 1823413 (0.0009) [2023-12-26 14:09:22,667][123091] Updated weights for policy 0, policy_version 1823423 (0.0009) [2023-12-26 14:09:22,730][123091] Updated weights for policy 0, policy_version 1823433 (0.0010) [2023-12-26 14:09:23,283][123090] Updated weights for policy 1, policy_version 1811591 (0.0009) [2023-12-26 14:09:23,341][123090] Updated weights for policy 1, policy_version 1811601 (0.0009) [2023-12-26 14:09:23,413][123090] Updated weights for policy 1, policy_version 1811611 (0.0006) [2023-12-26 14:09:23,597][123091] Updated weights for policy 0, policy_version 1823443 (0.0010) [2023-12-26 14:09:23,652][123091] Updated weights for policy 0, policy_version 1823453 (0.0009) [2023-12-26 14:09:23,715][123091] Updated weights for policy 0, policy_version 1823463 (0.0009) [2023-12-26 14:09:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 930586624. Throughput: 0: 8830.6, 1: 8892.9. Samples: 930559520. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:23,785][121949] Avg episode reward: [(0, '6368.303'), (1, '5727.643')] [2023-12-26 14:09:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001811616_463773696.pth... [2023-12-26 14:09:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001823472_466812928.pth... [2023-12-26 14:09:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001810592_463511552.pth [2023-12-26 14:09:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001822448_466550784.pth [2023-12-26 14:09:24,116][123090] Updated weights for policy 1, policy_version 1811621 (0.0005) [2023-12-26 14:09:24,173][123090] Updated weights for policy 1, policy_version 1811631 (0.0007) [2023-12-26 14:09:24,223][123090] Updated weights for policy 1, policy_version 1811641 (0.0006) [2023-12-26 14:09:24,606][123091] Updated weights for policy 0, policy_version 1823473 (0.0009) [2023-12-26 14:09:24,665][123091] Updated weights for policy 0, policy_version 1823483 (0.0009) [2023-12-26 14:09:24,714][123091] Updated weights for policy 0, policy_version 1823493 (0.0009) [2023-12-26 14:09:24,766][123091] Updated weights for policy 0, policy_version 1823503 (0.0009) [2023-12-26 14:09:24,859][123090] Updated weights for policy 1, policy_version 1811651 (0.0007) [2023-12-26 14:09:24,909][123090] Updated weights for policy 1, policy_version 1811661 (0.0009) [2023-12-26 14:09:24,960][123090] Updated weights for policy 1, policy_version 1811671 (0.0009) [2023-12-26 14:09:25,559][123091] Updated weights for policy 0, policy_version 1823513 (0.0009) [2023-12-26 14:09:25,607][123091] Updated weights for policy 0, policy_version 1823523 (0.0008) [2023-12-26 14:09:25,660][123091] Updated weights for policy 0, policy_version 1823533 (0.0008) [2023-12-26 14:09:25,807][123090] Updated weights for policy 1, policy_version 1811681 (0.0008) [2023-12-26 14:09:25,882][123090] Updated weights for policy 1, policy_version 1811691 (0.0006) [2023-12-26 14:09:25,954][123090] Updated weights for policy 1, policy_version 1811701 (0.0005) [2023-12-26 14:09:26,024][123090] Updated weights for policy 1, policy_version 1811711 (0.0005) [2023-12-26 14:09:26,523][123091] Updated weights for policy 0, policy_version 1823543 (0.0009) [2023-12-26 14:09:26,584][123091] Updated weights for policy 0, policy_version 1823553 (0.0010) [2023-12-26 14:09:26,637][123091] Updated weights for policy 0, policy_version 1823563 (0.0009) [2023-12-26 14:09:26,686][123090] Updated weights for policy 1, policy_version 1811721 (0.0008) [2023-12-26 14:09:26,735][123090] Updated weights for policy 1, policy_version 1811731 (0.0005) [2023-12-26 14:09:26,781][123090] Updated weights for policy 1, policy_version 1811741 (0.0005) [2023-12-26 14:09:27,363][123091] Updated weights for policy 0, policy_version 1823573 (0.0010) [2023-12-26 14:09:27,424][123091] Updated weights for policy 0, policy_version 1823583 (0.0010) [2023-12-26 14:09:27,478][123091] Updated weights for policy 0, policy_version 1823593 (0.0006) [2023-12-26 14:09:27,530][123090] Updated weights for policy 1, policy_version 1811751 (0.0008) [2023-12-26 14:09:27,591][123090] Updated weights for policy 1, policy_version 1811762 (0.0010) [2023-12-26 14:09:27,648][123090] Updated weights for policy 1, policy_version 1811772 (0.0010) [2023-12-26 14:09:28,154][123091] Updated weights for policy 0, policy_version 1823603 (0.0007) [2023-12-26 14:09:28,224][123091] Updated weights for policy 0, policy_version 1823613 (0.0010) [2023-12-26 14:09:28,274][123091] Updated weights for policy 0, policy_version 1823623 (0.0010) [2023-12-26 14:09:28,430][123090] Updated weights for policy 1, policy_version 1811782 (0.0010) [2023-12-26 14:09:28,492][123090] Updated weights for policy 1, policy_version 1811792 (0.0010) [2023-12-26 14:09:28,555][123090] Updated weights for policy 1, policy_version 1811802 (0.0009) [2023-12-26 14:09:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 930676736. Throughput: 0: 8845.9, 1: 8983.5. Samples: 930666688. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:28,785][121949] Avg episode reward: [(0, '6237.766'), (1, '5810.718')] [2023-12-26 14:09:29,059][123091] Updated weights for policy 0, policy_version 1823633 (0.0010) [2023-12-26 14:09:29,127][123091] Updated weights for policy 0, policy_version 1823643 (0.0007) [2023-12-26 14:09:29,183][123091] Updated weights for policy 0, policy_version 1823653 (0.0006) [2023-12-26 14:09:29,243][123091] Updated weights for policy 0, policy_version 1823663 (0.0008) [2023-12-26 14:09:29,386][123090] Updated weights for policy 1, policy_version 1811812 (0.0007) [2023-12-26 14:09:29,437][123090] Updated weights for policy 1, policy_version 1811822 (0.0009) [2023-12-26 14:09:29,484][123090] Updated weights for policy 1, policy_version 1811832 (0.0010) [2023-12-26 14:09:29,889][123091] Updated weights for policy 0, policy_version 1823673 (0.0008) [2023-12-26 14:09:29,958][123091] Updated weights for policy 0, policy_version 1823683 (0.0009) [2023-12-26 14:09:30,018][123091] Updated weights for policy 0, policy_version 1823693 (0.0009) [2023-12-26 14:09:30,339][123090] Updated weights for policy 1, policy_version 1811842 (0.0010) [2023-12-26 14:09:30,390][123090] Updated weights for policy 1, policy_version 1811852 (0.0010) [2023-12-26 14:09:30,448][123090] Updated weights for policy 1, policy_version 1811862 (0.0010) [2023-12-26 14:09:30,510][123090] Updated weights for policy 1, policy_version 1811872 (0.0010) [2023-12-26 14:09:30,801][123091] Updated weights for policy 0, policy_version 1823703 (0.0009) [2023-12-26 14:09:30,853][123091] Updated weights for policy 0, policy_version 1823713 (0.0006) [2023-12-26 14:09:30,922][123091] Updated weights for policy 0, policy_version 1823723 (0.0005) [2023-12-26 14:09:31,345][123090] Updated weights for policy 1, policy_version 1811882 (0.0009) [2023-12-26 14:09:31,406][123090] Updated weights for policy 1, policy_version 1811892 (0.0009) [2023-12-26 14:09:31,477][123090] Updated weights for policy 1, policy_version 1811902 (0.0008) [2023-12-26 14:09:31,669][123091] Updated weights for policy 0, policy_version 1823733 (0.0008) [2023-12-26 14:09:31,741][123091] Updated weights for policy 0, policy_version 1823743 (0.0011) [2023-12-26 14:09:31,804][123091] Updated weights for policy 0, policy_version 1823753 (0.0010) [2023-12-26 14:09:32,268][123090] Updated weights for policy 1, policy_version 1811912 (0.0006) [2023-12-26 14:09:32,338][123090] Updated weights for policy 1, policy_version 1811922 (0.0008) [2023-12-26 14:09:32,407][123090] Updated weights for policy 1, policy_version 1811932 (0.0008) [2023-12-26 14:09:32,537][123091] Updated weights for policy 0, policy_version 1823763 (0.0010) [2023-12-26 14:09:32,605][123091] Updated weights for policy 0, policy_version 1823773 (0.0009) [2023-12-26 14:09:32,670][123091] Updated weights for policy 0, policy_version 1823783 (0.0008) [2023-12-26 14:09:33,173][123090] Updated weights for policy 1, policy_version 1811942 (0.0009) [2023-12-26 14:09:33,228][123090] Updated weights for policy 1, policy_version 1811952 (0.0010) [2023-12-26 14:09:33,283][123090] Updated weights for policy 1, policy_version 1811962 (0.0010) [2023-12-26 14:09:33,334][123091] Updated weights for policy 0, policy_version 1823793 (0.0007) [2023-12-26 14:09:33,388][123091] Updated weights for policy 0, policy_version 1823803 (0.0007) [2023-12-26 14:09:33,448][123091] Updated weights for policy 0, policy_version 1823813 (0.0010) [2023-12-26 14:09:33,509][123091] Updated weights for policy 0, policy_version 1823823 (0.0010) [2023-12-26 14:09:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 930766848. Throughput: 0: 8837.2, 1: 8855.2. Samples: 930776680. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:33,785][121949] Avg episode reward: [(0, '6159.096'), (1, '5803.761')] [2023-12-26 14:09:34,031][123090] Updated weights for policy 1, policy_version 1811972 (0.0008) [2023-12-26 14:09:34,076][123090] Updated weights for policy 1, policy_version 1811982 (0.0005) [2023-12-26 14:09:34,129][123090] Updated weights for policy 1, policy_version 1811992 (0.0006) [2023-12-26 14:09:34,237][123091] Updated weights for policy 0, policy_version 1823833 (0.0008) [2023-12-26 14:09:34,307][123091] Updated weights for policy 0, policy_version 1823843 (0.0009) [2023-12-26 14:09:34,370][123091] Updated weights for policy 0, policy_version 1823853 (0.0010) [2023-12-26 14:09:34,919][123090] Updated weights for policy 1, policy_version 1812002 (0.0008) [2023-12-26 14:09:34,992][123090] Updated weights for policy 1, policy_version 1812012 (0.0009) [2023-12-26 14:09:35,044][123091] Updated weights for policy 0, policy_version 1823863 (0.0008) [2023-12-26 14:09:35,057][123090] Updated weights for policy 1, policy_version 1812022 (0.0008) [2023-12-26 14:09:35,104][123091] Updated weights for policy 0, policy_version 1823873 (0.0009) [2023-12-26 14:09:35,125][123090] Updated weights for policy 1, policy_version 1812032 (0.0008) [2023-12-26 14:09:35,167][123091] Updated weights for policy 0, policy_version 1823883 (0.0010) [2023-12-26 14:09:35,938][123091] Updated weights for policy 0, policy_version 1823893 (0.0009) [2023-12-26 14:09:35,949][123090] Updated weights for policy 1, policy_version 1812042 (0.0009) [2023-12-26 14:09:35,987][123091] Updated weights for policy 0, policy_version 1823903 (0.0008) [2023-12-26 14:09:36,004][123090] Updated weights for policy 1, policy_version 1812052 (0.0007) [2023-12-26 14:09:36,036][123091] Updated weights for policy 0, policy_version 1823913 (0.0009) [2023-12-26 14:09:36,061][123090] Updated weights for policy 1, policy_version 1812062 (0.0008) [2023-12-26 14:09:36,892][123091] Updated weights for policy 0, policy_version 1823923 (0.0009) [2023-12-26 14:09:36,921][123090] Updated weights for policy 1, policy_version 1812072 (0.0009) [2023-12-26 14:09:36,954][123091] Updated weights for policy 0, policy_version 1823933 (0.0008) [2023-12-26 14:09:36,987][123090] Updated weights for policy 1, policy_version 1812082 (0.0009) [2023-12-26 14:09:37,011][123091] Updated weights for policy 0, policy_version 1823943 (0.0007) [2023-12-26 14:09:37,048][123090] Updated weights for policy 1, policy_version 1812092 (0.0008) [2023-12-26 14:09:37,847][123091] Updated weights for policy 0, policy_version 1823953 (0.0008) [2023-12-26 14:09:37,877][123090] Updated weights for policy 1, policy_version 1812102 (0.0006) [2023-12-26 14:09:37,919][123091] Updated weights for policy 0, policy_version 1823963 (0.0008) [2023-12-26 14:09:37,935][123090] Updated weights for policy 1, policy_version 1812112 (0.0008) [2023-12-26 14:09:37,976][123091] Updated weights for policy 0, policy_version 1823973 (0.0007) [2023-12-26 14:09:38,001][123090] Updated weights for policy 1, policy_version 1812122 (0.0010) [2023-12-26 14:09:38,043][123091] Updated weights for policy 0, policy_version 1823983 (0.0005) [2023-12-26 14:09:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 930848768. Throughput: 0: 8865.1, 1: 8880.7. Samples: 930830800. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:38,785][121949] Avg episode reward: [(0, '6195.087'), (1, '5563.070')] [2023-12-26 14:09:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001812128_463904768.pth... [2023-12-26 14:09:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001811104_463642624.pth [2023-12-26 14:09:38,800][123091] Updated weights for policy 0, policy_version 1823993 (0.0009) [2023-12-26 14:09:38,832][123090] Updated weights for policy 1, policy_version 1812132 (0.0006) [2023-12-26 14:09:38,864][123091] Updated weights for policy 0, policy_version 1824003 (0.0008) [2023-12-26 14:09:38,894][123090] Updated weights for policy 1, policy_version 1812142 (0.0010) [2023-12-26 14:09:38,930][123091] Updated weights for policy 0, policy_version 1824013 (0.0007) [2023-12-26 14:09:38,943][123090] Updated weights for policy 1, policy_version 1812152 (0.0008) [2023-12-26 14:09:38,946][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001824016_466952192.pth... [2023-12-26 14:09:38,951][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001822960_466681856.pth [2023-12-26 14:09:39,774][123090] Updated weights for policy 1, policy_version 1812162 (0.0009) [2023-12-26 14:09:39,780][123091] Updated weights for policy 0, policy_version 1824023 (0.0009) [2023-12-26 14:09:39,838][123090] Updated weights for policy 1, policy_version 1812172 (0.0009) [2023-12-26 14:09:39,839][123091] Updated weights for policy 0, policy_version 1824033 (0.0008) [2023-12-26 14:09:39,897][123091] Updated weights for policy 0, policy_version 1824043 (0.0007) [2023-12-26 14:09:39,908][123090] Updated weights for policy 1, policy_version 1812182 (0.0011) [2023-12-26 14:09:39,973][123090] Updated weights for policy 1, policy_version 1812192 (0.0011) [2023-12-26 14:09:40,749][123091] Updated weights for policy 0, policy_version 1824053 (0.0009) [2023-12-26 14:09:40,794][123090] Updated weights for policy 1, policy_version 1812202 (0.0010) [2023-12-26 14:09:40,797][123091] Updated weights for policy 0, policy_version 1824063 (0.0006) [2023-12-26 14:09:40,851][123090] Updated weights for policy 1, policy_version 1812212 (0.0011) [2023-12-26 14:09:40,862][123091] Updated weights for policy 0, policy_version 1824073 (0.0006) [2023-12-26 14:09:40,911][123090] Updated weights for policy 1, policy_version 1812222 (0.0010) [2023-12-26 14:09:41,675][123091] Updated weights for policy 0, policy_version 1824083 (0.0007) [2023-12-26 14:09:41,745][123091] Updated weights for policy 0, policy_version 1824093 (0.0010) [2023-12-26 14:09:41,807][123091] Updated weights for policy 0, policy_version 1824103 (0.0009) [2023-12-26 14:09:41,879][123090] Updated weights for policy 1, policy_version 1812232 (0.0007) [2023-12-26 14:09:41,942][123090] Updated weights for policy 1, policy_version 1812242 (0.0008) [2023-12-26 14:09:42,011][123090] Updated weights for policy 1, policy_version 1812252 (0.0009) [2023-12-26 14:09:42,667][123091] Updated weights for policy 0, policy_version 1824113 (0.0009) [2023-12-26 14:09:42,701][123090] Updated weights for policy 1, policy_version 1812262 (0.0007) [2023-12-26 14:09:42,720][123091] Updated weights for policy 0, policy_version 1824123 (0.0009) [2023-12-26 14:09:42,765][123091] Updated weights for policy 0, policy_version 1824133 (0.0005) [2023-12-26 14:09:42,771][123090] Updated weights for policy 1, policy_version 1812272 (0.0006) [2023-12-26 14:09:42,816][123091] Updated weights for policy 0, policy_version 1824143 (0.0008) [2023-12-26 14:09:42,830][123090] Updated weights for policy 1, policy_version 1812282 (0.0005) [2023-12-26 14:09:43,522][123090] Updated weights for policy 1, policy_version 1812292 (0.0007) [2023-12-26 14:09:43,574][123090] Updated weights for policy 1, policy_version 1812302 (0.0009) [2023-12-26 14:09:43,625][123090] Updated weights for policy 1, policy_version 1812312 (0.0009) [2023-12-26 14:09:43,715][123091] Updated weights for policy 0, policy_version 1824153 (0.0009) [2023-12-26 14:09:43,771][123091] Updated weights for policy 0, policy_version 1824163 (0.0010) [2023-12-26 14:09:43,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 930938880. Throughput: 0: 8840.7, 1: 8739.2. Samples: 930932420. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:43,785][121949] Avg episode reward: [(0, '6331.947'), (1, '5481.306')] [2023-12-26 14:09:43,825][123091] Updated weights for policy 0, policy_version 1824174 (0.0010) [2023-12-26 14:09:44,377][123090] Updated weights for policy 1, policy_version 1812322 (0.0008) [2023-12-26 14:09:44,437][123090] Updated weights for policy 1, policy_version 1812332 (0.0005) [2023-12-26 14:09:44,501][123090] Updated weights for policy 1, policy_version 1812342 (0.0005) [2023-12-26 14:09:44,554][123090] Updated weights for policy 1, policy_version 1812352 (0.0007) [2023-12-26 14:09:44,579][123091] Updated weights for policy 0, policy_version 1824184 (0.0006) [2023-12-26 14:09:44,641][123091] Updated weights for policy 0, policy_version 1824194 (0.0006) [2023-12-26 14:09:44,702][123091] Updated weights for policy 0, policy_version 1824204 (0.0005) [2023-12-26 14:09:45,310][123090] Updated weights for policy 1, policy_version 1812362 (0.0009) [2023-12-26 14:09:45,375][123090] Updated weights for policy 1, policy_version 1812372 (0.0009) [2023-12-26 14:09:45,440][123090] Updated weights for policy 1, policy_version 1812382 (0.0009) [2023-12-26 14:09:45,507][123091] Updated weights for policy 0, policy_version 1824214 (0.0009) [2023-12-26 14:09:45,560][123091] Updated weights for policy 0, policy_version 1824224 (0.0011) [2023-12-26 14:09:45,609][123091] Updated weights for policy 0, policy_version 1824234 (0.0011) [2023-12-26 14:09:46,210][123090] Updated weights for policy 1, policy_version 1812392 (0.0009) [2023-12-26 14:09:46,277][123090] Updated weights for policy 1, policy_version 1812402 (0.0009) [2023-12-26 14:09:46,343][123090] Updated weights for policy 1, policy_version 1812412 (0.0007) [2023-12-26 14:09:46,386][123091] Updated weights for policy 0, policy_version 1824244 (0.0008) [2023-12-26 14:09:46,447][123091] Updated weights for policy 0, policy_version 1824254 (0.0005) [2023-12-26 14:09:46,511][123091] Updated weights for policy 0, policy_version 1824264 (0.0005) [2023-12-26 14:09:47,017][123090] Updated weights for policy 1, policy_version 1812422 (0.0006) [2023-12-26 14:09:47,068][123090] Updated weights for policy 1, policy_version 1812432 (0.0005) [2023-12-26 14:09:47,128][123090] Updated weights for policy 1, policy_version 1812442 (0.0005) [2023-12-26 14:09:47,168][123091] Updated weights for policy 0, policy_version 1824274 (0.0005) [2023-12-26 14:09:47,234][123091] Updated weights for policy 0, policy_version 1824284 (0.0006) [2023-12-26 14:09:47,296][123091] Updated weights for policy 0, policy_version 1824294 (0.0006) [2023-12-26 14:09:47,358][123091] Updated weights for policy 0, policy_version 1824304 (0.0009) [2023-12-26 14:09:47,918][123090] Updated weights for policy 1, policy_version 1812453 (0.0009) [2023-12-26 14:09:47,977][123090] Updated weights for policy 1, policy_version 1812463 (0.0008) [2023-12-26 14:09:48,040][123090] Updated weights for policy 1, policy_version 1812473 (0.0010) [2023-12-26 14:09:48,147][123091] Updated weights for policy 0, policy_version 1824314 (0.0010) [2023-12-26 14:09:48,215][123091] Updated weights for policy 0, policy_version 1824324 (0.0010) [2023-12-26 14:09:48,284][123091] Updated weights for policy 0, policy_version 1824334 (0.0008) [2023-12-26 14:09:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 931028992. Throughput: 0: 8873.1, 1: 8800.4. Samples: 931042648. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:48,785][121949] Avg episode reward: [(0, '6170.857'), (1, '5469.615')] [2023-12-26 14:09:48,864][123090] Updated weights for policy 1, policy_version 1812483 (0.0008) [2023-12-26 14:09:48,917][123090] Updated weights for policy 1, policy_version 1812493 (0.0005) [2023-12-26 14:09:48,979][123090] Updated weights for policy 1, policy_version 1812503 (0.0007) [2023-12-26 14:09:49,108][123091] Updated weights for policy 0, policy_version 1824344 (0.0009) [2023-12-26 14:09:49,173][123091] Updated weights for policy 0, policy_version 1824354 (0.0005) [2023-12-26 14:09:49,243][123091] Updated weights for policy 0, policy_version 1824364 (0.0006) [2023-12-26 14:09:49,661][123090] Updated weights for policy 1, policy_version 1812513 (0.0008) [2023-12-26 14:09:49,715][123090] Updated weights for policy 1, policy_version 1812523 (0.0009) [2023-12-26 14:09:49,787][123090] Updated weights for policy 1, policy_version 1812533 (0.0006) [2023-12-26 14:09:49,868][123090] Updated weights for policy 1, policy_version 1812543 (0.0007) [2023-12-26 14:09:50,091][123091] Updated weights for policy 0, policy_version 1824374 (0.0007) [2023-12-26 14:09:50,154][123091] Updated weights for policy 0, policy_version 1824384 (0.0008) [2023-12-26 14:09:50,213][123091] Updated weights for policy 0, policy_version 1824394 (0.0006) [2023-12-26 14:09:50,694][123090] Updated weights for policy 1, policy_version 1812553 (0.0010) [2023-12-26 14:09:50,761][123090] Updated weights for policy 1, policy_version 1812563 (0.0008) [2023-12-26 14:09:50,817][123090] Updated weights for policy 1, policy_version 1812573 (0.0006) [2023-12-26 14:09:50,910][123091] Updated weights for policy 0, policy_version 1824404 (0.0007) [2023-12-26 14:09:50,980][123091] Updated weights for policy 0, policy_version 1824414 (0.0008) [2023-12-26 14:09:51,042][123091] Updated weights for policy 0, policy_version 1824424 (0.0010) [2023-12-26 14:09:51,553][123090] Updated weights for policy 1, policy_version 1812583 (0.0008) [2023-12-26 14:09:51,613][123090] Updated weights for policy 1, policy_version 1812593 (0.0007) [2023-12-26 14:09:51,680][123090] Updated weights for policy 1, policy_version 1812603 (0.0008) [2023-12-26 14:09:51,866][123091] Updated weights for policy 0, policy_version 1824434 (0.0007) [2023-12-26 14:09:51,925][123091] Updated weights for policy 0, policy_version 1824444 (0.0008) [2023-12-26 14:09:51,983][123091] Updated weights for policy 0, policy_version 1824454 (0.0008) [2023-12-26 14:09:52,041][123091] Updated weights for policy 0, policy_version 1824464 (0.0010) [2023-12-26 14:09:52,522][123090] Updated weights for policy 1, policy_version 1812613 (0.0009) [2023-12-26 14:09:52,588][123090] Updated weights for policy 1, policy_version 1812623 (0.0009) [2023-12-26 14:09:52,649][123090] Updated weights for policy 1, policy_version 1812633 (0.0005) [2023-12-26 14:09:52,896][123091] Updated weights for policy 0, policy_version 1824474 (0.0009) [2023-12-26 14:09:52,956][123091] Updated weights for policy 0, policy_version 1824484 (0.0008) [2023-12-26 14:09:53,023][123091] Updated weights for policy 0, policy_version 1824494 (0.0009) [2023-12-26 14:09:53,456][123090] Updated weights for policy 1, policy_version 1812643 (0.0008) [2023-12-26 14:09:53,512][123090] Updated weights for policy 1, policy_version 1812653 (0.0009) [2023-12-26 14:09:53,576][123090] Updated weights for policy 1, policy_version 1812663 (0.0010) [2023-12-26 14:09:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 931119104. Throughput: 0: 8876.9, 1: 8842.7. Samples: 931096296. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:53,785][121949] Avg episode reward: [(0, '5934.771'), (1, '5411.571')] [2023-12-26 14:09:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001812672_464044032.pth... [2023-12-26 14:09:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001811616_463773696.pth [2023-12-26 14:09:53,838][123091] Updated weights for policy 0, policy_version 1824504 (0.0009) [2023-12-26 14:09:53,898][123091] Updated weights for policy 0, policy_version 1824514 (0.0009) [2023-12-26 14:09:53,947][123091] Updated weights for policy 0, policy_version 1824524 (0.0009) [2023-12-26 14:09:53,968][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001824528_467083264.pth... [2023-12-26 14:09:53,974][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001823472_466812928.pth [2023-12-26 14:09:54,397][123090] Updated weights for policy 1, policy_version 1812673 (0.0009) [2023-12-26 14:09:54,462][123090] Updated weights for policy 1, policy_version 1812683 (0.0009) [2023-12-26 14:09:54,512][123090] Updated weights for policy 1, policy_version 1812693 (0.0008) [2023-12-26 14:09:54,568][123090] Updated weights for policy 1, policy_version 1812703 (0.0009) [2023-12-26 14:09:54,804][123091] Updated weights for policy 0, policy_version 1824534 (0.0009) [2023-12-26 14:09:54,868][123091] Updated weights for policy 0, policy_version 1824544 (0.0010) [2023-12-26 14:09:54,924][123091] Updated weights for policy 0, policy_version 1824554 (0.0010) [2023-12-26 14:09:55,370][123090] Updated weights for policy 1, policy_version 1812713 (0.0010) [2023-12-26 14:09:55,432][123090] Updated weights for policy 1, policy_version 1812723 (0.0009) [2023-12-26 14:09:55,496][123090] Updated weights for policy 1, policy_version 1812733 (0.0010) [2023-12-26 14:09:55,795][123091] Updated weights for policy 0, policy_version 1824564 (0.0010) [2023-12-26 14:09:55,848][123091] Updated weights for policy 0, policy_version 1824574 (0.0010) [2023-12-26 14:09:55,898][123091] Updated weights for policy 0, policy_version 1824585 (0.0010) [2023-12-26 14:09:56,177][123090] Updated weights for policy 1, policy_version 1812743 (0.0007) [2023-12-26 14:09:56,226][123090] Updated weights for policy 1, policy_version 1812753 (0.0006) [2023-12-26 14:09:56,274][123090] Updated weights for policy 1, policy_version 1812763 (0.0009) [2023-12-26 14:09:56,807][123091] Updated weights for policy 0, policy_version 1824595 (0.0009) [2023-12-26 14:09:56,872][123091] Updated weights for policy 0, policy_version 1824605 (0.0010) [2023-12-26 14:09:56,937][123091] Updated weights for policy 0, policy_version 1824615 (0.0010) [2023-12-26 14:09:57,080][123090] Updated weights for policy 1, policy_version 1812773 (0.0009) [2023-12-26 14:09:57,129][123090] Updated weights for policy 1, policy_version 1812783 (0.0009) [2023-12-26 14:09:57,178][123090] Updated weights for policy 1, policy_version 1812793 (0.0005) [2023-12-26 14:09:57,787][123091] Updated weights for policy 0, policy_version 1824625 (0.0009) [2023-12-26 14:09:57,845][123091] Updated weights for policy 0, policy_version 1824635 (0.0010) [2023-12-26 14:09:57,903][123091] Updated weights for policy 0, policy_version 1824645 (0.0009) [2023-12-26 14:09:57,928][123090] Updated weights for policy 1, policy_version 1812803 (0.0005) [2023-12-26 14:09:57,956][123091] Updated weights for policy 0, policy_version 1824655 (0.0009) [2023-12-26 14:09:57,983][123090] Updated weights for policy 1, policy_version 1812813 (0.0005) [2023-12-26 14:09:58,035][123090] Updated weights for policy 1, policy_version 1812823 (0.0005) [2023-12-26 14:09:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 931201024. Throughput: 0: 8879.0, 1: 8909.2. Samples: 931200952. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:09:58,785][121949] Avg episode reward: [(0, '6105.521'), (1, '5447.875')] [2023-12-26 14:09:58,869][123090] Updated weights for policy 1, policy_version 1812833 (0.0007) [2023-12-26 14:09:58,907][123091] Updated weights for policy 0, policy_version 1824665 (0.0009) [2023-12-26 14:09:58,928][123090] Updated weights for policy 1, policy_version 1812843 (0.0007) [2023-12-26 14:09:58,971][123091] Updated weights for policy 0, policy_version 1824675 (0.0007) [2023-12-26 14:09:58,992][123090] Updated weights for policy 1, policy_version 1812853 (0.0008) [2023-12-26 14:09:59,031][123091] Updated weights for policy 0, policy_version 1824685 (0.0010) [2023-12-26 14:09:59,055][123090] Updated weights for policy 1, policy_version 1812863 (0.0006) [2023-12-26 14:09:59,863][123090] Updated weights for policy 1, policy_version 1812873 (0.0008) [2023-12-26 14:09:59,903][123091] Updated weights for policy 0, policy_version 1824695 (0.0007) [2023-12-26 14:09:59,923][123090] Updated weights for policy 1, policy_version 1812883 (0.0009) [2023-12-26 14:09:59,975][123091] Updated weights for policy 0, policy_version 1824705 (0.0008) [2023-12-26 14:09:59,984][123090] Updated weights for policy 1, policy_version 1812893 (0.0007) [2023-12-26 14:10:00,035][123091] Updated weights for policy 0, policy_version 1824715 (0.0009) [2023-12-26 14:10:00,803][123090] Updated weights for policy 1, policy_version 1812903 (0.0010) [2023-12-26 14:10:00,807][123091] Updated weights for policy 0, policy_version 1824725 (0.0010) [2023-12-26 14:10:00,856][123090] Updated weights for policy 1, policy_version 1812913 (0.0009) [2023-12-26 14:10:00,872][123091] Updated weights for policy 0, policy_version 1824735 (0.0005) [2023-12-26 14:10:00,911][123090] Updated weights for policy 1, policy_version 1812923 (0.0010) [2023-12-26 14:10:00,962][123091] Updated weights for policy 0, policy_version 1824745 (0.0005) [2023-12-26 14:10:01,673][123091] Updated weights for policy 0, policy_version 1824755 (0.0007) [2023-12-26 14:10:01,736][123091] Updated weights for policy 0, policy_version 1824765 (0.0009) [2023-12-26 14:10:01,791][123091] Updated weights for policy 0, policy_version 1824775 (0.0006) [2023-12-26 14:10:01,805][123090] Updated weights for policy 1, policy_version 1812933 (0.0008) [2023-12-26 14:10:01,871][123090] Updated weights for policy 1, policy_version 1812943 (0.0009) [2023-12-26 14:10:01,936][123090] Updated weights for policy 1, policy_version 1812953 (0.0008) [2023-12-26 14:10:02,512][123091] Updated weights for policy 0, policy_version 1824785 (0.0006) [2023-12-26 14:10:02,573][123091] Updated weights for policy 0, policy_version 1824795 (0.0005) [2023-12-26 14:10:02,635][123091] Updated weights for policy 0, policy_version 1824805 (0.0006) [2023-12-26 14:10:02,700][123091] Updated weights for policy 0, policy_version 1824815 (0.0008) [2023-12-26 14:10:02,835][123090] Updated weights for policy 1, policy_version 1812963 (0.0008) [2023-12-26 14:10:02,894][123090] Updated weights for policy 1, policy_version 1812973 (0.0010) [2023-12-26 14:10:02,947][123090] Updated weights for policy 1, policy_version 1812983 (0.0010) [2023-12-26 14:10:03,350][123091] Updated weights for policy 0, policy_version 1824825 (0.0006) [2023-12-26 14:10:03,404][123091] Updated weights for policy 0, policy_version 1824835 (0.0005) [2023-12-26 14:10:03,458][123091] Updated weights for policy 0, policy_version 1824845 (0.0005) [2023-12-26 14:10:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 931291136. Throughput: 0: 8858.2, 1: 8857.5. Samples: 931305388. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:03,785][121949] Avg episode reward: [(0, '6211.938'), (1, '5486.319')] [2023-12-26 14:10:03,800][123090] Updated weights for policy 1, policy_version 1812993 (0.0009) [2023-12-26 14:10:03,864][123090] Updated weights for policy 1, policy_version 1813003 (0.0007) [2023-12-26 14:10:03,933][123090] Updated weights for policy 1, policy_version 1813013 (0.0008) [2023-12-26 14:10:04,005][123090] Updated weights for policy 1, policy_version 1813023 (0.0009) [2023-12-26 14:10:04,132][123091] Updated weights for policy 0, policy_version 1824855 (0.0009) [2023-12-26 14:10:04,199][123091] Updated weights for policy 0, policy_version 1824865 (0.0011) [2023-12-26 14:10:04,262][123091] Updated weights for policy 0, policy_version 1824875 (0.0011) [2023-12-26 14:10:04,863][123090] Updated weights for policy 1, policy_version 1813033 (0.0010) [2023-12-26 14:10:04,921][123090] Updated weights for policy 1, policy_version 1813043 (0.0009) [2023-12-26 14:10:04,952][123091] Updated weights for policy 0, policy_version 1824885 (0.0008) [2023-12-26 14:10:04,976][123090] Updated weights for policy 1, policy_version 1813053 (0.0009) [2023-12-26 14:10:05,006][123091] Updated weights for policy 0, policy_version 1824895 (0.0005) [2023-12-26 14:10:05,064][123091] Updated weights for policy 0, policy_version 1824905 (0.0005) [2023-12-26 14:10:05,800][123091] Updated weights for policy 0, policy_version 1824915 (0.0007) [2023-12-26 14:10:05,860][123091] Updated weights for policy 0, policy_version 1824925 (0.0011) [2023-12-26 14:10:05,867][123090] Updated weights for policy 1, policy_version 1813063 (0.0008) [2023-12-26 14:10:05,923][123091] Updated weights for policy 0, policy_version 1824935 (0.0011) [2023-12-26 14:10:05,935][123090] Updated weights for policy 1, policy_version 1813073 (0.0006) [2023-12-26 14:10:06,001][123090] Updated weights for policy 1, policy_version 1813083 (0.0008) [2023-12-26 14:10:06,767][123091] Updated weights for policy 0, policy_version 1824945 (0.0011) [2023-12-26 14:10:06,834][123091] Updated weights for policy 0, policy_version 1824955 (0.0011) [2023-12-26 14:10:06,845][123090] Updated weights for policy 1, policy_version 1813093 (0.0007) [2023-12-26 14:10:06,894][123091] Updated weights for policy 0, policy_version 1824965 (0.0010) [2023-12-26 14:10:06,906][123090] Updated weights for policy 1, policy_version 1813103 (0.0007) [2023-12-26 14:10:06,946][123091] Updated weights for policy 0, policy_version 1824975 (0.0010) [2023-12-26 14:10:06,971][123090] Updated weights for policy 1, policy_version 1813113 (0.0006) [2023-12-26 14:10:07,650][123091] Updated weights for policy 0, policy_version 1824985 (0.0006) [2023-12-26 14:10:07,695][123091] Updated weights for policy 0, policy_version 1824995 (0.0005) [2023-12-26 14:10:07,743][123091] Updated weights for policy 0, policy_version 1825005 (0.0005) [2023-12-26 14:10:07,851][123090] Updated weights for policy 1, policy_version 1813123 (0.0008) [2023-12-26 14:10:07,910][123090] Updated weights for policy 1, policy_version 1813134 (0.0010) [2023-12-26 14:10:07,966][123090] Updated weights for policy 1, policy_version 1813146 (0.0010) [2023-12-26 14:10:08,377][123091] Updated weights for policy 0, policy_version 1825015 (0.0005) [2023-12-26 14:10:08,434][123091] Updated weights for policy 0, policy_version 1825025 (0.0006) [2023-12-26 14:10:08,497][123091] Updated weights for policy 0, policy_version 1825035 (0.0006) [2023-12-26 14:10:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 931381248. Throughput: 0: 8896.7, 1: 8839.5. Samples: 931357652. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:08,785][121949] Avg episode reward: [(0, '6299.431'), (1, '5531.442')] [2023-12-26 14:10:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001825040_467214336.pth... [2023-12-26 14:10:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001813152_464166912.pth... [2023-12-26 14:10:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001824016_466952192.pth [2023-12-26 14:10:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001812128_463904768.pth [2023-12-26 14:10:08,920][123090] Updated weights for policy 1, policy_version 1813157 (0.0010) [2023-12-26 14:10:08,978][123090] Updated weights for policy 1, policy_version 1813167 (0.0009) [2023-12-26 14:10:09,034][123090] Updated weights for policy 1, policy_version 1813177 (0.0008) [2023-12-26 14:10:09,236][123091] Updated weights for policy 0, policy_version 1825045 (0.0008) [2023-12-26 14:10:09,298][123091] Updated weights for policy 0, policy_version 1825055 (0.0010) [2023-12-26 14:10:09,369][123091] Updated weights for policy 0, policy_version 1825065 (0.0011) [2023-12-26 14:10:09,928][123090] Updated weights for policy 1, policy_version 1813187 (0.0009) [2023-12-26 14:10:09,990][123090] Updated weights for policy 1, policy_version 1813197 (0.0009) [2023-12-26 14:10:10,052][123090] Updated weights for policy 1, policy_version 1813207 (0.0009) [2023-12-26 14:10:10,198][123091] Updated weights for policy 0, policy_version 1825075 (0.0010) [2023-12-26 14:10:10,254][123091] Updated weights for policy 0, policy_version 1825085 (0.0008) [2023-12-26 14:10:10,312][123091] Updated weights for policy 0, policy_version 1825095 (0.0006) [2023-12-26 14:10:10,899][123090] Updated weights for policy 1, policy_version 1813217 (0.0009) [2023-12-26 14:10:10,952][123090] Updated weights for policy 1, policy_version 1813227 (0.0009) [2023-12-26 14:10:11,011][123090] Updated weights for policy 1, policy_version 1813237 (0.0010) [2023-12-26 14:10:11,073][123091] Updated weights for policy 0, policy_version 1825105 (0.0007) [2023-12-26 14:10:11,075][123090] Updated weights for policy 1, policy_version 1813247 (0.0009) [2023-12-26 14:10:11,149][123091] Updated weights for policy 0, policy_version 1825115 (0.0008) [2023-12-26 14:10:11,216][123091] Updated weights for policy 0, policy_version 1825125 (0.0008) [2023-12-26 14:10:11,287][123091] Updated weights for policy 0, policy_version 1825135 (0.0008) [2023-12-26 14:10:11,954][123090] Updated weights for policy 1, policy_version 1813257 (0.0009) [2023-12-26 14:10:12,029][123090] Updated weights for policy 1, policy_version 1813267 (0.0007) [2023-12-26 14:10:12,090][123090] Updated weights for policy 1, policy_version 1813277 (0.0008) [2023-12-26 14:10:12,136][123091] Updated weights for policy 0, policy_version 1825145 (0.0006) [2023-12-26 14:10:12,209][123091] Updated weights for policy 0, policy_version 1825155 (0.0005) [2023-12-26 14:10:12,284][123091] Updated weights for policy 0, policy_version 1825165 (0.0009) [2023-12-26 14:10:12,830][123090] Updated weights for policy 1, policy_version 1813287 (0.0006) [2023-12-26 14:10:12,885][123090] Updated weights for policy 1, policy_version 1813297 (0.0005) [2023-12-26 14:10:12,943][123090] Updated weights for policy 1, policy_version 1813307 (0.0005) [2023-12-26 14:10:13,092][123091] Updated weights for policy 0, policy_version 1825175 (0.0010) [2023-12-26 14:10:13,163][123091] Updated weights for policy 0, policy_version 1825185 (0.0010) [2023-12-26 14:10:13,221][123091] Updated weights for policy 0, policy_version 1825195 (0.0010) [2023-12-26 14:10:13,637][123090] Updated weights for policy 1, policy_version 1813317 (0.0007) [2023-12-26 14:10:13,701][123090] Updated weights for policy 1, policy_version 1813327 (0.0009) [2023-12-26 14:10:13,768][123090] Updated weights for policy 1, policy_version 1813337 (0.0009) [2023-12-26 14:10:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 931463168. Throughput: 0: 8945.7, 1: 8692.6. Samples: 931460412. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:13,784][121949] Avg episode reward: [(0, '6209.573'), (1, '5822.760')] [2023-12-26 14:10:13,901][123091] Updated weights for policy 0, policy_version 1825205 (0.0007) [2023-12-26 14:10:13,967][123091] Updated weights for policy 0, policy_version 1825215 (0.0008) [2023-12-26 14:10:14,032][123091] Updated weights for policy 0, policy_version 1825225 (0.0006) [2023-12-26 14:10:14,624][123090] Updated weights for policy 1, policy_version 1813347 (0.0010) [2023-12-26 14:10:14,672][123090] Updated weights for policy 1, policy_version 1813357 (0.0009) [2023-12-26 14:10:14,720][123090] Updated weights for policy 1, policy_version 1813367 (0.0009) [2023-12-26 14:10:14,805][123091] Updated weights for policy 0, policy_version 1825235 (0.0006) [2023-12-26 14:10:14,864][123091] Updated weights for policy 0, policy_version 1825245 (0.0011) [2023-12-26 14:10:14,917][123091] Updated weights for policy 0, policy_version 1825255 (0.0011) [2023-12-26 14:10:15,624][123090] Updated weights for policy 1, policy_version 1813377 (0.0008) [2023-12-26 14:10:15,680][123090] Updated weights for policy 1, policy_version 1813387 (0.0009) [2023-12-26 14:10:15,729][123090] Updated weights for policy 1, policy_version 1813397 (0.0009) [2023-12-26 14:10:15,760][123091] Updated weights for policy 0, policy_version 1825265 (0.0011) [2023-12-26 14:10:15,783][123090] Updated weights for policy 1, policy_version 1813407 (0.0008) [2023-12-26 14:10:15,819][123091] Updated weights for policy 0, policy_version 1825275 (0.0010) [2023-12-26 14:10:15,888][123091] Updated weights for policy 0, policy_version 1825285 (0.0010) [2023-12-26 14:10:15,954][123091] Updated weights for policy 0, policy_version 1825295 (0.0007) [2023-12-26 14:10:16,639][123090] Updated weights for policy 1, policy_version 1813417 (0.0009) [2023-12-26 14:10:16,696][123090] Updated weights for policy 1, policy_version 1813427 (0.0009) [2023-12-26 14:10:16,719][123091] Updated weights for policy 0, policy_version 1825305 (0.0010) [2023-12-26 14:10:16,741][123090] Updated weights for policy 1, policy_version 1813437 (0.0009) [2023-12-26 14:10:16,778][123091] Updated weights for policy 0, policy_version 1825315 (0.0011) [2023-12-26 14:10:16,838][123091] Updated weights for policy 0, policy_version 1825325 (0.0010) [2023-12-26 14:10:17,576][123090] Updated weights for policy 1, policy_version 1813447 (0.0010) [2023-12-26 14:10:17,624][123090] Updated weights for policy 1, policy_version 1813457 (0.0008) [2023-12-26 14:10:17,672][123091] Updated weights for policy 0, policy_version 1825335 (0.0007) [2023-12-26 14:10:17,676][123090] Updated weights for policy 1, policy_version 1813468 (0.0009) [2023-12-26 14:10:17,731][123091] Updated weights for policy 0, policy_version 1825345 (0.0005) [2023-12-26 14:10:17,796][123091] Updated weights for policy 0, policy_version 1825355 (0.0005) [2023-12-26 14:10:18,495][123091] Updated weights for policy 0, policy_version 1825365 (0.0008) [2023-12-26 14:10:18,570][123091] Updated weights for policy 0, policy_version 1825375 (0.0011) [2023-12-26 14:10:18,596][123090] Updated weights for policy 1, policy_version 1813478 (0.0008) [2023-12-26 14:10:18,628][123091] Updated weights for policy 0, policy_version 1825385 (0.0011) [2023-12-26 14:10:18,661][123090] Updated weights for policy 1, policy_version 1813488 (0.0006) [2023-12-26 14:10:18,727][123090] Updated weights for policy 1, policy_version 1813498 (0.0009) [2023-12-26 14:10:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 931561472. Throughput: 0: 8885.5, 1: 8676.9. Samples: 931566988. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:18,785][121949] Avg episode reward: [(0, '6184.388'), (1, '5798.060')] [2023-12-26 14:10:19,436][123091] Updated weights for policy 0, policy_version 1825395 (0.0009) [2023-12-26 14:10:19,503][123091] Updated weights for policy 0, policy_version 1825405 (0.0007) [2023-12-26 14:10:19,558][123090] Updated weights for policy 1, policy_version 1813508 (0.0009) [2023-12-26 14:10:19,568][123091] Updated weights for policy 0, policy_version 1825415 (0.0009) [2023-12-26 14:10:19,630][123090] Updated weights for policy 1, policy_version 1813518 (0.0009) [2023-12-26 14:10:19,710][123090] Updated weights for policy 1, policy_version 1813528 (0.0010) [2023-12-26 14:10:20,295][123091] Updated weights for policy 0, policy_version 1825425 (0.0006) [2023-12-26 14:10:20,359][123091] Updated weights for policy 0, policy_version 1825435 (0.0010) [2023-12-26 14:10:20,423][123091] Updated weights for policy 0, policy_version 1825445 (0.0009) [2023-12-26 14:10:20,488][123091] Updated weights for policy 0, policy_version 1825455 (0.0010) [2023-12-26 14:10:20,550][123090] Updated weights for policy 1, policy_version 1813538 (0.0009) [2023-12-26 14:10:20,633][123090] Updated weights for policy 1, policy_version 1813548 (0.0008) [2023-12-26 14:10:20,702][123090] Updated weights for policy 1, policy_version 1813558 (0.0006) [2023-12-26 14:10:20,780][123090] Updated weights for policy 1, policy_version 1813568 (0.0006) [2023-12-26 14:10:21,379][123091] Updated weights for policy 0, policy_version 1825465 (0.0010) [2023-12-26 14:10:21,444][123091] Updated weights for policy 0, policy_version 1825475 (0.0008) [2023-12-26 14:10:21,512][123091] Updated weights for policy 0, policy_version 1825485 (0.0006) [2023-12-26 14:10:21,594][123090] Updated weights for policy 1, policy_version 1813578 (0.0010) [2023-12-26 14:10:21,667][123090] Updated weights for policy 1, policy_version 1813588 (0.0010) [2023-12-26 14:10:21,732][123090] Updated weights for policy 1, policy_version 1813598 (0.0010) [2023-12-26 14:10:22,316][123091] Updated weights for policy 0, policy_version 1825495 (0.0009) [2023-12-26 14:10:22,379][123091] Updated weights for policy 0, policy_version 1825505 (0.0010) [2023-12-26 14:10:22,437][123091] Updated weights for policy 0, policy_version 1825515 (0.0009) [2023-12-26 14:10:22,642][123090] Updated weights for policy 1, policy_version 1813608 (0.0009) [2023-12-26 14:10:22,712][123090] Updated weights for policy 1, policy_version 1813618 (0.0009) [2023-12-26 14:10:22,780][123090] Updated weights for policy 1, policy_version 1813628 (0.0007) [2023-12-26 14:10:23,268][123091] Updated weights for policy 0, policy_version 1825525 (0.0008) [2023-12-26 14:10:23,323][123091] Updated weights for policy 0, policy_version 1825535 (0.0010) [2023-12-26 14:10:23,385][123091] Updated weights for policy 0, policy_version 1825545 (0.0010) [2023-12-26 14:10:23,632][123090] Updated weights for policy 1, policy_version 1813638 (0.0007) [2023-12-26 14:10:23,696][123090] Updated weights for policy 1, policy_version 1813648 (0.0007) [2023-12-26 14:10:23,759][123090] Updated weights for policy 1, policy_version 1813658 (0.0009) [2023-12-26 14:10:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 931635200. Throughput: 0: 8842.5, 1: 8631.8. Samples: 931617144. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:23,784][121949] Avg episode reward: [(0, '6214.322'), (1, '5688.732')] [2023-12-26 14:10:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001825552_467345408.pth... [2023-12-26 14:10:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001813664_464297984.pth... [2023-12-26 14:10:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001824528_467083264.pth [2023-12-26 14:10:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001812672_464044032.pth [2023-12-26 14:10:24,198][123091] Updated weights for policy 0, policy_version 1825555 (0.0011) [2023-12-26 14:10:24,268][123091] Updated weights for policy 0, policy_version 1825565 (0.0011) [2023-12-26 14:10:24,322][123091] Updated weights for policy 0, policy_version 1825575 (0.0010) [2023-12-26 14:10:24,586][123090] Updated weights for policy 1, policy_version 1813668 (0.0009) [2023-12-26 14:10:24,658][123090] Updated weights for policy 1, policy_version 1813678 (0.0006) [2023-12-26 14:10:24,710][123090] Updated weights for policy 1, policy_version 1813688 (0.0005) [2023-12-26 14:10:25,034][123091] Updated weights for policy 0, policy_version 1825585 (0.0006) [2023-12-26 14:10:25,097][123091] Updated weights for policy 0, policy_version 1825595 (0.0005) [2023-12-26 14:10:25,174][123091] Updated weights for policy 0, policy_version 1825605 (0.0005) [2023-12-26 14:10:25,247][123091] Updated weights for policy 0, policy_version 1825615 (0.0005) [2023-12-26 14:10:25,335][123090] Updated weights for policy 1, policy_version 1813698 (0.0005) [2023-12-26 14:10:25,396][123090] Updated weights for policy 1, policy_version 1813708 (0.0005) [2023-12-26 14:10:25,453][123090] Updated weights for policy 1, policy_version 1813718 (0.0005) [2023-12-26 14:10:25,514][123090] Updated weights for policy 1, policy_version 1813728 (0.0005) [2023-12-26 14:10:25,886][123091] Updated weights for policy 0, policy_version 1825625 (0.0005) [2023-12-26 14:10:25,945][123091] Updated weights for policy 0, policy_version 1825635 (0.0007) [2023-12-26 14:10:26,004][123091] Updated weights for policy 0, policy_version 1825645 (0.0008) [2023-12-26 14:10:26,184][123090] Updated weights for policy 1, policy_version 1813738 (0.0006) [2023-12-26 14:10:26,258][123090] Updated weights for policy 1, policy_version 1813748 (0.0005) [2023-12-26 14:10:26,326][123090] Updated weights for policy 1, policy_version 1813758 (0.0006) [2023-12-26 14:10:26,674][123091] Updated weights for policy 0, policy_version 1825655 (0.0008) [2023-12-26 14:10:26,724][123091] Updated weights for policy 0, policy_version 1825665 (0.0005) [2023-12-26 14:10:26,786][123091] Updated weights for policy 0, policy_version 1825675 (0.0005) [2023-12-26 14:10:27,027][123090] Updated weights for policy 1, policy_version 1813768 (0.0009) [2023-12-26 14:10:27,079][123090] Updated weights for policy 1, policy_version 1813778 (0.0005) [2023-12-26 14:10:27,160][123090] Updated weights for policy 1, policy_version 1813788 (0.0005) [2023-12-26 14:10:27,464][123091] Updated weights for policy 0, policy_version 1825685 (0.0005) [2023-12-26 14:10:27,519][123091] Updated weights for policy 0, policy_version 1825695 (0.0006) [2023-12-26 14:10:27,579][123091] Updated weights for policy 0, policy_version 1825705 (0.0009) [2023-12-26 14:10:27,844][123090] Updated weights for policy 1, policy_version 1813798 (0.0005) [2023-12-26 14:10:27,910][123090] Updated weights for policy 1, policy_version 1813808 (0.0007) [2023-12-26 14:10:27,976][123090] Updated weights for policy 1, policy_version 1813819 (0.0009) [2023-12-26 14:10:28,424][123091] Updated weights for policy 0, policy_version 1825715 (0.0009) [2023-12-26 14:10:28,486][123091] Updated weights for policy 0, policy_version 1825725 (0.0006) [2023-12-26 14:10:28,544][123091] Updated weights for policy 0, policy_version 1825735 (0.0010) [2023-12-26 14:10:28,658][123090] Updated weights for policy 1, policy_version 1813829 (0.0009) [2023-12-26 14:10:28,716][123090] Updated weights for policy 1, policy_version 1813839 (0.0008) [2023-12-26 14:10:28,781][123090] Updated weights for policy 1, policy_version 1813849 (0.0008) [2023-12-26 14:10:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 931733504. Throughput: 0: 8985.1, 1: 8699.4. Samples: 931728220. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:28,785][121949] Avg episode reward: [(0, '6182.342'), (1, '5617.844')] [2023-12-26 14:10:29,332][123091] Updated weights for policy 0, policy_version 1825745 (0.0009) [2023-12-26 14:10:29,407][123091] Updated weights for policy 0, policy_version 1825755 (0.0008) [2023-12-26 14:10:29,478][123091] Updated weights for policy 0, policy_version 1825765 (0.0008) [2023-12-26 14:10:29,537][123091] Updated weights for policy 0, policy_version 1825775 (0.0009) [2023-12-26 14:10:29,587][123090] Updated weights for policy 1, policy_version 1813859 (0.0009) [2023-12-26 14:10:29,646][123090] Updated weights for policy 1, policy_version 1813869 (0.0010) [2023-12-26 14:10:29,693][123090] Updated weights for policy 1, policy_version 1813879 (0.0010) [2023-12-26 14:10:30,370][123091] Updated weights for policy 0, policy_version 1825785 (0.0009) [2023-12-26 14:10:30,418][123091] Updated weights for policy 0, policy_version 1825795 (0.0009) [2023-12-26 14:10:30,465][123091] Updated weights for policy 0, policy_version 1825805 (0.0009) [2023-12-26 14:10:30,530][123090] Updated weights for policy 1, policy_version 1813889 (0.0010) [2023-12-26 14:10:30,588][123090] Updated weights for policy 1, policy_version 1813899 (0.0010) [2023-12-26 14:10:30,643][123090] Updated weights for policy 1, policy_version 1813909 (0.0010) [2023-12-26 14:10:30,697][123090] Updated weights for policy 1, policy_version 1813919 (0.0010) [2023-12-26 14:10:31,246][123091] Updated weights for policy 0, policy_version 1825815 (0.0009) [2023-12-26 14:10:31,305][123091] Updated weights for policy 0, policy_version 1825825 (0.0009) [2023-12-26 14:10:31,361][123091] Updated weights for policy 0, policy_version 1825835 (0.0008) [2023-12-26 14:10:31,556][123090] Updated weights for policy 1, policy_version 1813929 (0.0010) [2023-12-26 14:10:31,608][123090] Updated weights for policy 1, policy_version 1813939 (0.0010) [2023-12-26 14:10:31,679][123090] Updated weights for policy 1, policy_version 1813949 (0.0010) [2023-12-26 14:10:32,174][123091] Updated weights for policy 0, policy_version 1825845 (0.0008) [2023-12-26 14:10:32,226][123091] Updated weights for policy 0, policy_version 1825855 (0.0009) [2023-12-26 14:10:32,286][123091] Updated weights for policy 0, policy_version 1825865 (0.0009) [2023-12-26 14:10:32,495][123090] Updated weights for policy 1, policy_version 1813959 (0.0011) [2023-12-26 14:10:32,566][123090] Updated weights for policy 1, policy_version 1813969 (0.0011) [2023-12-26 14:10:32,631][123090] Updated weights for policy 1, policy_version 1813979 (0.0011) [2023-12-26 14:10:32,996][123091] Updated weights for policy 0, policy_version 1825875 (0.0009) [2023-12-26 14:10:33,070][123091] Updated weights for policy 0, policy_version 1825885 (0.0008) [2023-12-26 14:10:33,132][123091] Updated weights for policy 0, policy_version 1825895 (0.0006) [2023-12-26 14:10:33,376][123090] Updated weights for policy 1, policy_version 1813989 (0.0009) [2023-12-26 14:10:33,440][123090] Updated weights for policy 1, policy_version 1813999 (0.0007) [2023-12-26 14:10:33,505][123090] Updated weights for policy 1, policy_version 1814009 (0.0010) [2023-12-26 14:10:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 931823616. Throughput: 0: 8974.8, 1: 8643.7. Samples: 931835484. Policy #0 lag: (min: 12.0, avg: 27.3, max: 44.0) [2023-12-26 14:10:33,785][121949] Avg episode reward: [(0, '6175.285'), (1, '5724.166')] [2023-12-26 14:10:33,799][123091] Updated weights for policy 0, policy_version 1825905 (0.0005) [2023-12-26 14:10:33,862][123091] Updated weights for policy 0, policy_version 1825915 (0.0005) [2023-12-26 14:10:33,921][123091] Updated weights for policy 0, policy_version 1825925 (0.0005) [2023-12-26 14:10:33,983][123091] Updated weights for policy 0, policy_version 1825935 (0.0006) [2023-12-26 14:10:34,286][123090] Updated weights for policy 1, policy_version 1814019 (0.0008) [2023-12-26 14:10:34,348][123090] Updated weights for policy 1, policy_version 1814029 (0.0009) [2023-12-26 14:10:34,410][123090] Updated weights for policy 1, policy_version 1814039 (0.0010) [2023-12-26 14:10:34,616][123091] Updated weights for policy 0, policy_version 1825945 (0.0010) [2023-12-26 14:10:34,679][123091] Updated weights for policy 0, policy_version 1825955 (0.0011) [2023-12-26 14:10:34,739][123091] Updated weights for policy 0, policy_version 1825965 (0.0006) [2023-12-26 14:10:35,305][123090] Updated weights for policy 1, policy_version 1814049 (0.0010) [2023-12-26 14:10:35,361][123090] Updated weights for policy 1, policy_version 1814059 (0.0009) [2023-12-26 14:10:35,415][123091] Updated weights for policy 0, policy_version 1825975 (0.0006) [2023-12-26 14:10:35,417][123090] Updated weights for policy 1, policy_version 1814069 (0.0009) [2023-12-26 14:10:35,468][123091] Updated weights for policy 0, policy_version 1825985 (0.0005) [2023-12-26 14:10:35,475][123090] Updated weights for policy 1, policy_version 1814079 (0.0010) [2023-12-26 14:10:35,520][123091] Updated weights for policy 0, policy_version 1825995 (0.0005) [2023-12-26 14:10:36,241][123091] Updated weights for policy 0, policy_version 1826005 (0.0007) [2023-12-26 14:10:36,271][123090] Updated weights for policy 1, policy_version 1814089 (0.0006) [2023-12-26 14:10:36,308][123091] Updated weights for policy 0, policy_version 1826015 (0.0009) [2023-12-26 14:10:36,339][123090] Updated weights for policy 1, policy_version 1814099 (0.0006) [2023-12-26 14:10:36,373][123091] Updated weights for policy 0, policy_version 1826025 (0.0006) [2023-12-26 14:10:36,409][123090] Updated weights for policy 1, policy_version 1814109 (0.0006) [2023-12-26 14:10:36,988][123091] Updated weights for policy 0, policy_version 1826035 (0.0006) [2023-12-26 14:10:37,047][123091] Updated weights for policy 0, policy_version 1826045 (0.0007) [2023-12-26 14:10:37,110][123091] Updated weights for policy 0, policy_version 1826055 (0.0007) [2023-12-26 14:10:37,144][123090] Updated weights for policy 1, policy_version 1814119 (0.0007) [2023-12-26 14:10:37,211][123090] Updated weights for policy 1, policy_version 1814129 (0.0009) [2023-12-26 14:10:37,285][123090] Updated weights for policy 1, policy_version 1814139 (0.0008) [2023-12-26 14:10:37,834][123091] Updated weights for policy 0, policy_version 1826065 (0.0008) [2023-12-26 14:10:37,894][123091] Updated weights for policy 0, policy_version 1826075 (0.0010) [2023-12-26 14:10:37,937][123090] Updated weights for policy 1, policy_version 1814149 (0.0008) [2023-12-26 14:10:37,953][123091] Updated weights for policy 0, policy_version 1826085 (0.0010) [2023-12-26 14:10:37,990][123090] Updated weights for policy 1, policy_version 1814159 (0.0007) [2023-12-26 14:10:38,012][123091] Updated weights for policy 0, policy_version 1826095 (0.0011) [2023-12-26 14:10:38,049][123090] Updated weights for policy 1, policy_version 1814169 (0.0009) [2023-12-26 14:10:38,764][123091] Updated weights for policy 0, policy_version 1826105 (0.0007) [2023-12-26 14:10:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 931913728. Throughput: 0: 9050.1, 1: 8624.6. Samples: 931891656. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:10:38,785][121949] Avg episode reward: [(0, '6188.215'), (1, '5817.194')] [2023-12-26 14:10:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001814176_464429056.pth... [2023-12-26 14:10:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001813152_464166912.pth [2023-12-26 14:10:38,820][123091] Updated weights for policy 0, policy_version 1826115 (0.0005) [2023-12-26 14:10:38,869][123091] Updated weights for policy 0, policy_version 1826125 (0.0005) [2023-12-26 14:10:38,885][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001826128_467492864.pth... [2023-12-26 14:10:38,889][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001825040_467214336.pth [2023-12-26 14:10:38,894][123090] Updated weights for policy 1, policy_version 1814179 (0.0009) [2023-12-26 14:10:38,953][123090] Updated weights for policy 1, policy_version 1814189 (0.0010) [2023-12-26 14:10:39,007][123090] Updated weights for policy 1, policy_version 1814201 (0.0010) [2023-12-26 14:10:39,669][123091] Updated weights for policy 0, policy_version 1826135 (0.0009) [2023-12-26 14:10:39,732][123091] Updated weights for policy 0, policy_version 1826145 (0.0011) [2023-12-26 14:10:39,799][123091] Updated weights for policy 0, policy_version 1826155 (0.0011) [2023-12-26 14:10:39,902][123090] Updated weights for policy 1, policy_version 1814211 (0.0008) [2023-12-26 14:10:39,972][123090] Updated weights for policy 1, policy_version 1814221 (0.0009) [2023-12-26 14:10:40,040][123090] Updated weights for policy 1, policy_version 1814231 (0.0009) [2023-12-26 14:10:40,606][123091] Updated weights for policy 0, policy_version 1826165 (0.0012) [2023-12-26 14:10:40,656][123091] Updated weights for policy 0, policy_version 1826175 (0.0010) [2023-12-26 14:10:40,713][123091] Updated weights for policy 0, policy_version 1826185 (0.0009) [2023-12-26 14:10:40,856][123090] Updated weights for policy 1, policy_version 1814241 (0.0009) [2023-12-26 14:10:40,920][123090] Updated weights for policy 1, policy_version 1814251 (0.0009) [2023-12-26 14:10:40,975][123090] Updated weights for policy 1, policy_version 1814261 (0.0008) [2023-12-26 14:10:41,041][123090] Updated weights for policy 1, policy_version 1814271 (0.0009) [2023-12-26 14:10:41,614][123091] Updated weights for policy 0, policy_version 1826195 (0.0010) [2023-12-26 14:10:41,684][123091] Updated weights for policy 0, policy_version 1826205 (0.0008) [2023-12-26 14:10:41,761][123091] Updated weights for policy 0, policy_version 1826215 (0.0010) [2023-12-26 14:10:41,892][123090] Updated weights for policy 1, policy_version 1814281 (0.0007) [2023-12-26 14:10:41,964][123090] Updated weights for policy 1, policy_version 1814291 (0.0006) [2023-12-26 14:10:42,036][123090] Updated weights for policy 1, policy_version 1814301 (0.0007) [2023-12-26 14:10:42,631][123091] Updated weights for policy 0, policy_version 1826225 (0.0009) [2023-12-26 14:10:42,702][123091] Updated weights for policy 0, policy_version 1826235 (0.0007) [2023-12-26 14:10:42,770][123091] Updated weights for policy 0, policy_version 1826245 (0.0007) [2023-12-26 14:10:42,817][123090] Updated weights for policy 1, policy_version 1814311 (0.0006) [2023-12-26 14:10:42,839][123091] Updated weights for policy 0, policy_version 1826255 (0.0007) [2023-12-26 14:10:42,884][123090] Updated weights for policy 1, policy_version 1814321 (0.0005) [2023-12-26 14:10:42,965][123090] Updated weights for policy 1, policy_version 1814331 (0.0008) [2023-12-26 14:10:43,510][123091] Updated weights for policy 0, policy_version 1826265 (0.0009) [2023-12-26 14:10:43,564][123091] Updated weights for policy 0, policy_version 1826275 (0.0009) [2023-12-26 14:10:43,625][123091] Updated weights for policy 0, policy_version 1826285 (0.0010) [2023-12-26 14:10:43,746][123090] Updated weights for policy 1, policy_version 1814341 (0.0010) [2023-12-26 14:10:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 932003840. Throughput: 0: 9112.7, 1: 8565.5. Samples: 931996472. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:10:43,785][121949] Avg episode reward: [(0, '6222.804'), (1, '5821.142')] [2023-12-26 14:10:43,807][123090] Updated weights for policy 1, policy_version 1814351 (0.0008) [2023-12-26 14:10:43,863][123090] Updated weights for policy 1, policy_version 1814361 (0.0009) [2023-12-26 14:10:44,376][123091] Updated weights for policy 0, policy_version 1826295 (0.0009) [2023-12-26 14:10:44,432][123091] Updated weights for policy 0, policy_version 1826305 (0.0009) [2023-12-26 14:10:44,494][123091] Updated weights for policy 0, policy_version 1826315 (0.0009) [2023-12-26 14:10:44,730][123090] Updated weights for policy 1, policy_version 1814371 (0.0008) [2023-12-26 14:10:44,788][123090] Updated weights for policy 1, policy_version 1814381 (0.0006) [2023-12-26 14:10:44,859][123090] Updated weights for policy 1, policy_version 1814391 (0.0007) [2023-12-26 14:10:45,285][123091] Updated weights for policy 0, policy_version 1826325 (0.0007) [2023-12-26 14:10:45,347][123091] Updated weights for policy 0, policy_version 1826335 (0.0006) [2023-12-26 14:10:45,410][123091] Updated weights for policy 0, policy_version 1826345 (0.0005) [2023-12-26 14:10:45,545][123090] Updated weights for policy 1, policy_version 1814401 (0.0010) [2023-12-26 14:10:45,615][123090] Updated weights for policy 1, policy_version 1814411 (0.0008) [2023-12-26 14:10:45,685][123090] Updated weights for policy 1, policy_version 1814421 (0.0007) [2023-12-26 14:10:45,751][123090] Updated weights for policy 1, policy_version 1814431 (0.0006) [2023-12-26 14:10:46,148][123091] Updated weights for policy 0, policy_version 1826355 (0.0007) [2023-12-26 14:10:46,198][123091] Updated weights for policy 0, policy_version 1826365 (0.0010) [2023-12-26 14:10:46,247][123091] Updated weights for policy 0, policy_version 1826375 (0.0009) [2023-12-26 14:10:46,497][123090] Updated weights for policy 1, policy_version 1814441 (0.0009) [2023-12-26 14:10:46,547][123090] Updated weights for policy 1, policy_version 1814451 (0.0009) [2023-12-26 14:10:46,603][123090] Updated weights for policy 1, policy_version 1814461 (0.0009) [2023-12-26 14:10:47,104][123091] Updated weights for policy 0, policy_version 1826385 (0.0009) [2023-12-26 14:10:47,148][123091] Updated weights for policy 0, policy_version 1826395 (0.0005) [2023-12-26 14:10:47,193][123091] Updated weights for policy 0, policy_version 1826405 (0.0005) [2023-12-26 14:10:47,240][123091] Updated weights for policy 0, policy_version 1826415 (0.0005) [2023-12-26 14:10:47,493][123090] Updated weights for policy 1, policy_version 1814471 (0.0010) [2023-12-26 14:10:47,549][123090] Updated weights for policy 1, policy_version 1814481 (0.0009) [2023-12-26 14:10:47,600][123090] Updated weights for policy 1, policy_version 1814491 (0.0009) [2023-12-26 14:10:48,002][123091] Updated weights for policy 0, policy_version 1826425 (0.0009) [2023-12-26 14:10:48,058][123091] Updated weights for policy 0, policy_version 1826435 (0.0009) [2023-12-26 14:10:48,111][123091] Updated weights for policy 0, policy_version 1826445 (0.0009) [2023-12-26 14:10:48,450][123090] Updated weights for policy 1, policy_version 1814501 (0.0009) [2023-12-26 14:10:48,520][123090] Updated weights for policy 1, policy_version 1814511 (0.0009) [2023-12-26 14:10:48,587][123090] Updated weights for policy 1, policy_version 1814521 (0.0009) [2023-12-26 14:10:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 932093952. Throughput: 0: 9128.6, 1: 8609.6. Samples: 932103608. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:10:48,785][121949] Avg episode reward: [(0, '6291.394'), (1, '5725.134')] [2023-12-26 14:10:48,971][123091] Updated weights for policy 0, policy_version 1826455 (0.0009) [2023-12-26 14:10:49,039][123091] Updated weights for policy 0, policy_version 1826465 (0.0009) [2023-12-26 14:10:49,095][123091] Updated weights for policy 0, policy_version 1826475 (0.0010) [2023-12-26 14:10:49,428][123090] Updated weights for policy 1, policy_version 1814531 (0.0009) [2023-12-26 14:10:49,489][123090] Updated weights for policy 1, policy_version 1814541 (0.0009) [2023-12-26 14:10:49,569][123090] Updated weights for policy 1, policy_version 1814551 (0.0009) [2023-12-26 14:10:49,918][123091] Updated weights for policy 0, policy_version 1826485 (0.0009) [2023-12-26 14:10:49,986][123091] Updated weights for policy 0, policy_version 1826495 (0.0010) [2023-12-26 14:10:50,047][123091] Updated weights for policy 0, policy_version 1826505 (0.0009) [2023-12-26 14:10:50,394][123090] Updated weights for policy 1, policy_version 1814561 (0.0010) [2023-12-26 14:10:50,450][123090] Updated weights for policy 1, policy_version 1814571 (0.0009) [2023-12-26 14:10:50,505][123090] Updated weights for policy 1, policy_version 1814581 (0.0008) [2023-12-26 14:10:50,559][123090] Updated weights for policy 1, policy_version 1814591 (0.0009) [2023-12-26 14:10:50,887][123091] Updated weights for policy 0, policy_version 1826515 (0.0010) [2023-12-26 14:10:50,949][123091] Updated weights for policy 0, policy_version 1826525 (0.0009) [2023-12-26 14:10:51,003][123091] Updated weights for policy 0, policy_version 1826535 (0.0009) [2023-12-26 14:10:51,440][123090] Updated weights for policy 1, policy_version 1814601 (0.0006) [2023-12-26 14:10:51,495][123090] Updated weights for policy 1, policy_version 1814611 (0.0007) [2023-12-26 14:10:51,551][123090] Updated weights for policy 1, policy_version 1814621 (0.0009) [2023-12-26 14:10:51,863][123091] Updated weights for policy 0, policy_version 1826545 (0.0009) [2023-12-26 14:10:51,928][123091] Updated weights for policy 0, policy_version 1826555 (0.0008) [2023-12-26 14:10:51,991][123091] Updated weights for policy 0, policy_version 1826565 (0.0011) [2023-12-26 14:10:52,054][123091] Updated weights for policy 0, policy_version 1826575 (0.0011) [2023-12-26 14:10:52,378][123090] Updated weights for policy 1, policy_version 1814631 (0.0009) [2023-12-26 14:10:52,442][123090] Updated weights for policy 1, policy_version 1814641 (0.0009) [2023-12-26 14:10:52,489][123090] Updated weights for policy 1, policy_version 1814651 (0.0008) [2023-12-26 14:10:52,889][123091] Updated weights for policy 0, policy_version 1826585 (0.0010) [2023-12-26 14:10:52,953][123091] Updated weights for policy 0, policy_version 1826595 (0.0010) [2023-12-26 14:10:53,018][123091] Updated weights for policy 0, policy_version 1826605 (0.0009) [2023-12-26 14:10:53,311][123090] Updated weights for policy 1, policy_version 1814661 (0.0010) [2023-12-26 14:10:53,374][123090] Updated weights for policy 1, policy_version 1814671 (0.0010) [2023-12-26 14:10:53,429][123090] Updated weights for policy 1, policy_version 1814681 (0.0010) [2023-12-26 14:10:53,743][123091] Updated weights for policy 0, policy_version 1826615 (0.0005) [2023-12-26 14:10:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 932175872. Throughput: 0: 9084.5, 1: 8611.4. Samples: 932153968. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:10:53,785][121949] Avg episode reward: [(0, '6289.817'), (1, '5620.021')] [2023-12-26 14:10:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001814688_464560128.pth... [2023-12-26 14:10:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001813664_464297984.pth [2023-12-26 14:10:53,796][123091] Updated weights for policy 0, policy_version 1826625 (0.0005) [2023-12-26 14:10:53,851][123091] Updated weights for policy 0, policy_version 1826635 (0.0005) [2023-12-26 14:10:53,876][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001826640_467623936.pth... [2023-12-26 14:10:53,879][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001825552_467345408.pth [2023-12-26 14:10:54,144][123090] Updated weights for policy 1, policy_version 1814691 (0.0009) [2023-12-26 14:10:54,210][123090] Updated weights for policy 1, policy_version 1814701 (0.0005) [2023-12-26 14:10:54,283][123090] Updated weights for policy 1, policy_version 1814711 (0.0005) [2023-12-26 14:10:54,449][123091] Updated weights for policy 0, policy_version 1826645 (0.0005) [2023-12-26 14:10:54,515][123091] Updated weights for policy 0, policy_version 1826655 (0.0005) [2023-12-26 14:10:54,574][123091] Updated weights for policy 0, policy_version 1826665 (0.0005) [2023-12-26 14:10:54,962][123090] Updated weights for policy 1, policy_version 1814721 (0.0008) [2023-12-26 14:10:55,022][123090] Updated weights for policy 1, policy_version 1814731 (0.0011) [2023-12-26 14:10:55,075][123090] Updated weights for policy 1, policy_version 1814741 (0.0010) [2023-12-26 14:10:55,138][123090] Updated weights for policy 1, policy_version 1814751 (0.0007) [2023-12-26 14:10:55,251][123091] Updated weights for policy 0, policy_version 1826675 (0.0006) [2023-12-26 14:10:55,307][123091] Updated weights for policy 0, policy_version 1826685 (0.0006) [2023-12-26 14:10:55,363][123091] Updated weights for policy 0, policy_version 1826695 (0.0006) [2023-12-26 14:10:55,834][123090] Updated weights for policy 1, policy_version 1814761 (0.0005) [2023-12-26 14:10:55,882][123090] Updated weights for policy 1, policy_version 1814771 (0.0005) [2023-12-26 14:10:55,934][123090] Updated weights for policy 1, policy_version 1814781 (0.0008) [2023-12-26 14:10:55,994][123091] Updated weights for policy 0, policy_version 1826705 (0.0006) [2023-12-26 14:10:56,056][123091] Updated weights for policy 0, policy_version 1826715 (0.0006) [2023-12-26 14:10:56,101][123091] Updated weights for policy 0, policy_version 1826725 (0.0005) [2023-12-26 14:10:56,162][123091] Updated weights for policy 0, policy_version 1826735 (0.0006) [2023-12-26 14:10:56,620][123090] Updated weights for policy 1, policy_version 1814791 (0.0005) [2023-12-26 14:10:56,677][123090] Updated weights for policy 1, policy_version 1814801 (0.0007) [2023-12-26 14:10:56,720][123090] Updated weights for policy 1, policy_version 1814811 (0.0010) [2023-12-26 14:10:56,849][123091] Updated weights for policy 0, policy_version 1826745 (0.0009) [2023-12-26 14:10:56,896][123091] Updated weights for policy 0, policy_version 1826755 (0.0008) [2023-12-26 14:10:56,944][123091] Updated weights for policy 0, policy_version 1826765 (0.0009) [2023-12-26 14:10:57,525][123090] Updated weights for policy 1, policy_version 1814821 (0.0010) [2023-12-26 14:10:57,576][123090] Updated weights for policy 1, policy_version 1814831 (0.0010) [2023-12-26 14:10:57,631][123090] Updated weights for policy 1, policy_version 1814841 (0.0010) [2023-12-26 14:10:57,808][123091] Updated weights for policy 0, policy_version 1826775 (0.0009) [2023-12-26 14:10:57,866][123091] Updated weights for policy 0, policy_version 1826785 (0.0008) [2023-12-26 14:10:57,914][123091] Updated weights for policy 0, policy_version 1826795 (0.0009) [2023-12-26 14:10:58,461][123090] Updated weights for policy 1, policy_version 1814851 (0.0009) [2023-12-26 14:10:58,534][123090] Updated weights for policy 1, policy_version 1814861 (0.0013) [2023-12-26 14:10:58,596][123090] Updated weights for policy 1, policy_version 1814871 (0.0009) [2023-12-26 14:10:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 932274176. Throughput: 0: 9169.7, 1: 8796.8. Samples: 932268904. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:10:58,785][121949] Avg episode reward: [(0, '6330.083'), (1, '5624.395')] [2023-12-26 14:10:58,832][123091] Updated weights for policy 0, policy_version 1826805 (0.0009) [2023-12-26 14:10:58,894][123091] Updated weights for policy 0, policy_version 1826815 (0.0009) [2023-12-26 14:10:58,964][123091] Updated weights for policy 0, policy_version 1826825 (0.0010) [2023-12-26 14:10:59,484][123090] Updated weights for policy 1, policy_version 1814881 (0.0009) [2023-12-26 14:10:59,548][123090] Updated weights for policy 1, policy_version 1814891 (0.0010) [2023-12-26 14:10:59,597][123090] Updated weights for policy 1, policy_version 1814901 (0.0008) [2023-12-26 14:10:59,657][123090] Updated weights for policy 1, policy_version 1814911 (0.0009) [2023-12-26 14:10:59,805][123091] Updated weights for policy 0, policy_version 1826835 (0.0009) [2023-12-26 14:10:59,870][123091] Updated weights for policy 0, policy_version 1826845 (0.0009) [2023-12-26 14:10:59,931][123091] Updated weights for policy 0, policy_version 1826855 (0.0008) [2023-12-26 14:11:00,506][123090] Updated weights for policy 1, policy_version 1814921 (0.0009) [2023-12-26 14:11:00,566][123090] Updated weights for policy 1, policy_version 1814931 (0.0009) [2023-12-26 14:11:00,625][123090] Updated weights for policy 1, policy_version 1814941 (0.0009) [2023-12-26 14:11:00,744][123091] Updated weights for policy 0, policy_version 1826865 (0.0010) [2023-12-26 14:11:00,796][123091] Updated weights for policy 0, policy_version 1826875 (0.0009) [2023-12-26 14:11:00,846][123091] Updated weights for policy 0, policy_version 1826885 (0.0005) [2023-12-26 14:11:00,895][123091] Updated weights for policy 0, policy_version 1826895 (0.0005) [2023-12-26 14:11:01,440][123090] Updated weights for policy 1, policy_version 1814951 (0.0007) [2023-12-26 14:11:01,490][123090] Updated weights for policy 1, policy_version 1814961 (0.0008) [2023-12-26 14:11:01,541][123090] Updated weights for policy 1, policy_version 1814971 (0.0009) [2023-12-26 14:11:01,677][123091] Updated weights for policy 0, policy_version 1826905 (0.0010) [2023-12-26 14:11:01,737][123091] Updated weights for policy 0, policy_version 1826915 (0.0011) [2023-12-26 14:11:01,805][123091] Updated weights for policy 0, policy_version 1826925 (0.0011) [2023-12-26 14:11:02,402][123090] Updated weights for policy 1, policy_version 1814981 (0.0009) [2023-12-26 14:11:02,469][123090] Updated weights for policy 1, policy_version 1814991 (0.0008) [2023-12-26 14:11:02,538][123090] Updated weights for policy 1, policy_version 1815001 (0.0009) [2023-12-26 14:11:02,629][123091] Updated weights for policy 0, policy_version 1826935 (0.0011) [2023-12-26 14:11:02,690][123091] Updated weights for policy 0, policy_version 1826945 (0.0010) [2023-12-26 14:11:02,753][123091] Updated weights for policy 0, policy_version 1826955 (0.0010) [2023-12-26 14:11:03,275][123090] Updated weights for policy 1, policy_version 1815011 (0.0009) [2023-12-26 14:11:03,336][123090] Updated weights for policy 1, policy_version 1815021 (0.0010) [2023-12-26 14:11:03,394][123090] Updated weights for policy 1, policy_version 1815031 (0.0009) [2023-12-26 14:11:03,550][123091] Updated weights for policy 0, policy_version 1826965 (0.0011) [2023-12-26 14:11:03,614][123091] Updated weights for policy 0, policy_version 1826975 (0.0011) [2023-12-26 14:11:03,677][123091] Updated weights for policy 0, policy_version 1826985 (0.0011) [2023-12-26 14:11:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 932364288. Throughput: 0: 9096.7, 1: 8758.0. Samples: 932370448. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:03,784][121949] Avg episode reward: [(0, '6433.618'), (1, '5310.411')] [2023-12-26 14:11:04,299][123090] Updated weights for policy 1, policy_version 1815041 (0.0008) [2023-12-26 14:11:04,365][123090] Updated weights for policy 1, policy_version 1815051 (0.0009) [2023-12-26 14:11:04,426][123090] Updated weights for policy 1, policy_version 1815061 (0.0009) [2023-12-26 14:11:04,466][123091] Updated weights for policy 0, policy_version 1826995 (0.0011) [2023-12-26 14:11:04,490][123090] Updated weights for policy 1, policy_version 1815071 (0.0008) [2023-12-26 14:11:04,522][123091] Updated weights for policy 0, policy_version 1827005 (0.0011) [2023-12-26 14:11:04,578][123091] Updated weights for policy 0, policy_version 1827015 (0.0011) [2023-12-26 14:11:05,257][123090] Updated weights for policy 1, policy_version 1815081 (0.0006) [2023-12-26 14:11:05,317][123090] Updated weights for policy 1, policy_version 1815091 (0.0005) [2023-12-26 14:11:05,370][123090] Updated weights for policy 1, policy_version 1815101 (0.0007) [2023-12-26 14:11:05,422][123091] Updated weights for policy 0, policy_version 1827025 (0.0011) [2023-12-26 14:11:05,487][123091] Updated weights for policy 0, policy_version 1827035 (0.0007) [2023-12-26 14:11:05,544][123091] Updated weights for policy 0, policy_version 1827045 (0.0005) [2023-12-26 14:11:05,593][123091] Updated weights for policy 0, policy_version 1827055 (0.0007) [2023-12-26 14:11:06,155][123090] Updated weights for policy 1, policy_version 1815111 (0.0008) [2023-12-26 14:11:06,228][123090] Updated weights for policy 1, policy_version 1815121 (0.0008) [2023-12-26 14:11:06,298][123090] Updated weights for policy 1, policy_version 1815131 (0.0008) [2023-12-26 14:11:06,446][123091] Updated weights for policy 0, policy_version 1827065 (0.0009) [2023-12-26 14:11:06,508][123091] Updated weights for policy 0, policy_version 1827075 (0.0010) [2023-12-26 14:11:06,567][123091] Updated weights for policy 0, policy_version 1827085 (0.0010) [2023-12-26 14:11:07,037][123090] Updated weights for policy 1, policy_version 1815141 (0.0006) [2023-12-26 14:11:07,089][123090] Updated weights for policy 1, policy_version 1815151 (0.0005) [2023-12-26 14:11:07,145][123090] Updated weights for policy 1, policy_version 1815161 (0.0009) [2023-12-26 14:11:07,412][123091] Updated weights for policy 0, policy_version 1827095 (0.0008) [2023-12-26 14:11:07,483][123091] Updated weights for policy 0, policy_version 1827105 (0.0008) [2023-12-26 14:11:07,542][123091] Updated weights for policy 0, policy_version 1827115 (0.0010) [2023-12-26 14:11:07,989][123090] Updated weights for policy 1, policy_version 1815171 (0.0009) [2023-12-26 14:11:08,050][123090] Updated weights for policy 1, policy_version 1815181 (0.0009) [2023-12-26 14:11:08,117][123090] Updated weights for policy 1, policy_version 1815191 (0.0010) [2023-12-26 14:11:08,316][123091] Updated weights for policy 0, policy_version 1827125 (0.0009) [2023-12-26 14:11:08,388][123091] Updated weights for policy 0, policy_version 1827135 (0.0010) [2023-12-26 14:11:08,458][123091] Updated weights for policy 0, policy_version 1827145 (0.0010) [2023-12-26 14:11:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 932446208. Throughput: 0: 9100.2, 1: 8812.7. Samples: 932423224. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:08,784][121949] Avg episode reward: [(0, '6416.402'), (1, '5188.601')] [2023-12-26 14:11:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001827152_467755008.pth... [2023-12-26 14:11:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001815200_464691200.pth... [2023-12-26 14:11:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001826128_467492864.pth [2023-12-26 14:11:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001814176_464429056.pth [2023-12-26 14:11:08,988][123090] Updated weights for policy 1, policy_version 1815201 (0.0010) [2023-12-26 14:11:09,055][123090] Updated weights for policy 1, policy_version 1815211 (0.0010) [2023-12-26 14:11:09,119][123090] Updated weights for policy 1, policy_version 1815221 (0.0009) [2023-12-26 14:11:09,178][123090] Updated weights for policy 1, policy_version 1815231 (0.0008) [2023-12-26 14:11:09,247][123091] Updated weights for policy 0, policy_version 1827155 (0.0009) [2023-12-26 14:11:09,300][123091] Updated weights for policy 0, policy_version 1827165 (0.0010) [2023-12-26 14:11:09,372][123091] Updated weights for policy 0, policy_version 1827175 (0.0010) [2023-12-26 14:11:10,076][123090] Updated weights for policy 1, policy_version 1815241 (0.0006) [2023-12-26 14:11:10,132][123090] Updated weights for policy 1, policy_version 1815251 (0.0009) [2023-12-26 14:11:10,201][123090] Updated weights for policy 1, policy_version 1815261 (0.0009) [2023-12-26 14:11:10,230][123091] Updated weights for policy 0, policy_version 1827185 (0.0010) [2023-12-26 14:11:10,299][123091] Updated weights for policy 0, policy_version 1827195 (0.0010) [2023-12-26 14:11:10,367][123091] Updated weights for policy 0, policy_version 1827205 (0.0009) [2023-12-26 14:11:10,426][123091] Updated weights for policy 0, policy_version 1827215 (0.0009) [2023-12-26 14:11:10,916][123090] Updated weights for policy 1, policy_version 1815271 (0.0007) [2023-12-26 14:11:10,983][123090] Updated weights for policy 1, policy_version 1815281 (0.0005) [2023-12-26 14:11:11,045][123090] Updated weights for policy 1, policy_version 1815291 (0.0006) [2023-12-26 14:11:11,317][123091] Updated weights for policy 0, policy_version 1827225 (0.0009) [2023-12-26 14:11:11,382][123091] Updated weights for policy 0, policy_version 1827235 (0.0009) [2023-12-26 14:11:11,447][123091] Updated weights for policy 0, policy_version 1827245 (0.0010) [2023-12-26 14:11:11,867][123090] Updated weights for policy 1, policy_version 1815301 (0.0007) [2023-12-26 14:11:11,923][123090] Updated weights for policy 1, policy_version 1815311 (0.0010) [2023-12-26 14:11:11,980][123090] Updated weights for policy 1, policy_version 1815321 (0.0010) [2023-12-26 14:11:12,306][123091] Updated weights for policy 0, policy_version 1827255 (0.0008) [2023-12-26 14:11:12,379][123091] Updated weights for policy 0, policy_version 1827265 (0.0008) [2023-12-26 14:11:12,447][123091] Updated weights for policy 0, policy_version 1827275 (0.0010) [2023-12-26 14:11:12,827][123090] Updated weights for policy 1, policy_version 1815331 (0.0009) [2023-12-26 14:11:12,897][123090] Updated weights for policy 1, policy_version 1815341 (0.0008) [2023-12-26 14:11:12,967][123090] Updated weights for policy 1, policy_version 1815351 (0.0005) [2023-12-26 14:11:13,278][123091] Updated weights for policy 0, policy_version 1827285 (0.0009) [2023-12-26 14:11:13,340][123091] Updated weights for policy 0, policy_version 1827295 (0.0010) [2023-12-26 14:11:13,398][123091] Updated weights for policy 0, policy_version 1827305 (0.0010) [2023-12-26 14:11:13,615][123090] Updated weights for policy 1, policy_version 1815361 (0.0007) [2023-12-26 14:11:13,669][123090] Updated weights for policy 1, policy_version 1815371 (0.0010) [2023-12-26 14:11:13,724][123090] Updated weights for policy 1, policy_version 1815381 (0.0010) [2023-12-26 14:11:13,782][123090] Updated weights for policy 1, policy_version 1815391 (0.0010) [2023-12-26 14:11:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 932528128. Throughput: 0: 8938.8, 1: 8768.9. Samples: 932525064. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:13,784][121949] Avg episode reward: [(0, '6301.911'), (1, '5446.644')] [2023-12-26 14:11:14,215][123091] Updated weights for policy 0, policy_version 1827315 (0.0009) [2023-12-26 14:11:14,261][123091] Updated weights for policy 0, policy_version 1827325 (0.0005) [2023-12-26 14:11:14,307][123091] Updated weights for policy 0, policy_version 1827335 (0.0005) [2023-12-26 14:11:14,519][123090] Updated weights for policy 1, policy_version 1815401 (0.0007) [2023-12-26 14:11:14,587][123090] Updated weights for policy 1, policy_version 1815411 (0.0006) [2023-12-26 14:11:14,651][123090] Updated weights for policy 1, policy_version 1815421 (0.0005) [2023-12-26 14:11:15,114][123091] Updated weights for policy 0, policy_version 1827345 (0.0006) [2023-12-26 14:11:15,177][123091] Updated weights for policy 0, policy_version 1827355 (0.0011) [2023-12-26 14:11:15,245][123091] Updated weights for policy 0, policy_version 1827365 (0.0011) [2023-12-26 14:11:15,307][123091] Updated weights for policy 0, policy_version 1827375 (0.0011) [2023-12-26 14:11:15,424][123090] Updated weights for policy 1, policy_version 1815431 (0.0009) [2023-12-26 14:11:15,491][123090] Updated weights for policy 1, policy_version 1815441 (0.0010) [2023-12-26 14:11:15,545][123090] Updated weights for policy 1, policy_version 1815451 (0.0010) [2023-12-26 14:11:15,978][123091] Updated weights for policy 0, policy_version 1827385 (0.0008) [2023-12-26 14:11:16,028][123091] Updated weights for policy 0, policy_version 1827395 (0.0010) [2023-12-26 14:11:16,090][123091] Updated weights for policy 0, policy_version 1827405 (0.0010) [2023-12-26 14:11:16,363][123090] Updated weights for policy 1, policy_version 1815461 (0.0008) [2023-12-26 14:11:16,428][123090] Updated weights for policy 1, policy_version 1815471 (0.0010) [2023-12-26 14:11:16,492][123090] Updated weights for policy 1, policy_version 1815481 (0.0006) [2023-12-26 14:11:16,843][123091] Updated weights for policy 0, policy_version 1827415 (0.0007) [2023-12-26 14:11:16,904][123091] Updated weights for policy 0, policy_version 1827425 (0.0006) [2023-12-26 14:11:16,959][123091] Updated weights for policy 0, policy_version 1827435 (0.0010) [2023-12-26 14:11:17,226][123090] Updated weights for policy 1, policy_version 1815491 (0.0007) [2023-12-26 14:11:17,287][123090] Updated weights for policy 1, policy_version 1815501 (0.0006) [2023-12-26 14:11:17,345][123090] Updated weights for policy 1, policy_version 1815511 (0.0006) [2023-12-26 14:11:17,755][123091] Updated weights for policy 0, policy_version 1827445 (0.0010) [2023-12-26 14:11:17,813][123091] Updated weights for policy 0, policy_version 1827455 (0.0010) [2023-12-26 14:11:17,861][123091] Updated weights for policy 0, policy_version 1827465 (0.0010) [2023-12-26 14:11:18,105][123090] Updated weights for policy 1, policy_version 1815521 (0.0006) [2023-12-26 14:11:18,154][123090] Updated weights for policy 1, policy_version 1815531 (0.0008) [2023-12-26 14:11:18,198][123090] Updated weights for policy 1, policy_version 1815541 (0.0007) [2023-12-26 14:11:18,242][123090] Updated weights for policy 1, policy_version 1815551 (0.0005) [2023-12-26 14:11:18,721][123091] Updated weights for policy 0, policy_version 1827475 (0.0011) [2023-12-26 14:11:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 932618240. Throughput: 0: 8937.2, 1: 8819.1. Samples: 932634520. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:18,785][121949] Avg episode reward: [(0, '6350.531'), (1, '5475.536')] [2023-12-26 14:11:18,792][123091] Updated weights for policy 0, policy_version 1827485 (0.0011) [2023-12-26 14:11:18,866][123091] Updated weights for policy 0, policy_version 1827495 (0.0011) [2023-12-26 14:11:19,000][123090] Updated weights for policy 1, policy_version 1815561 (0.0005) [2023-12-26 14:11:19,070][123090] Updated weights for policy 1, policy_version 1815571 (0.0006) [2023-12-26 14:11:19,122][123090] Updated weights for policy 1, policy_version 1815581 (0.0006) [2023-12-26 14:11:19,676][123091] Updated weights for policy 0, policy_version 1827505 (0.0011) [2023-12-26 14:11:19,736][123091] Updated weights for policy 0, policy_version 1827515 (0.0011) [2023-12-26 14:11:19,801][123091] Updated weights for policy 0, policy_version 1827525 (0.0011) [2023-12-26 14:11:19,861][123091] Updated weights for policy 0, policy_version 1827535 (0.0011) [2023-12-26 14:11:19,977][123090] Updated weights for policy 1, policy_version 1815591 (0.0008) [2023-12-26 14:11:20,050][123090] Updated weights for policy 1, policy_version 1815601 (0.0008) [2023-12-26 14:11:20,124][123090] Updated weights for policy 1, policy_version 1815611 (0.0006) [2023-12-26 14:11:20,661][123091] Updated weights for policy 0, policy_version 1827545 (0.0008) [2023-12-26 14:11:20,722][123091] Updated weights for policy 0, policy_version 1827555 (0.0011) [2023-12-26 14:11:20,791][123091] Updated weights for policy 0, policy_version 1827565 (0.0011) [2023-12-26 14:11:20,947][123090] Updated weights for policy 1, policy_version 1815621 (0.0007) [2023-12-26 14:11:21,008][123090] Updated weights for policy 1, policy_version 1815631 (0.0009) [2023-12-26 14:11:21,083][123090] Updated weights for policy 1, policy_version 1815641 (0.0009) [2023-12-26 14:11:21,613][123091] Updated weights for policy 0, policy_version 1827575 (0.0008) [2023-12-26 14:11:21,688][123091] Updated weights for policy 0, policy_version 1827585 (0.0011) [2023-12-26 14:11:21,766][123091] Updated weights for policy 0, policy_version 1827595 (0.0008) [2023-12-26 14:11:21,959][123090] Updated weights for policy 1, policy_version 1815651 (0.0007) [2023-12-26 14:11:22,024][123090] Updated weights for policy 1, policy_version 1815661 (0.0008) [2023-12-26 14:11:22,078][123090] Updated weights for policy 1, policy_version 1815671 (0.0008) [2023-12-26 14:11:22,520][123091] Updated weights for policy 0, policy_version 1827605 (0.0011) [2023-12-26 14:11:22,591][123091] Updated weights for policy 0, policy_version 1827615 (0.0011) [2023-12-26 14:11:22,665][123091] Updated weights for policy 0, policy_version 1827625 (0.0011) [2023-12-26 14:11:22,877][123090] Updated weights for policy 1, policy_version 1815681 (0.0009) [2023-12-26 14:11:22,938][123090] Updated weights for policy 1, policy_version 1815691 (0.0006) [2023-12-26 14:11:23,006][123090] Updated weights for policy 1, policy_version 1815701 (0.0006) [2023-12-26 14:11:23,063][123090] Updated weights for policy 1, policy_version 1815711 (0.0006) [2023-12-26 14:11:23,395][123091] Updated weights for policy 0, policy_version 1827635 (0.0009) [2023-12-26 14:11:23,457][123091] Updated weights for policy 0, policy_version 1827645 (0.0005) [2023-12-26 14:11:23,512][123091] Updated weights for policy 0, policy_version 1827655 (0.0005) [2023-12-26 14:11:23,651][123090] Updated weights for policy 1, policy_version 1815721 (0.0010) [2023-12-26 14:11:23,711][123090] Updated weights for policy 1, policy_version 1815731 (0.0010) [2023-12-26 14:11:23,770][123090] Updated weights for policy 1, policy_version 1815741 (0.0010) [2023-12-26 14:11:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 932708352. Throughput: 0: 8845.9, 1: 8800.9. Samples: 932685768. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:23,785][121949] Avg episode reward: [(0, '6226.886'), (1, '5392.412')] [2023-12-26 14:11:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001827664_467886080.pth... [2023-12-26 14:11:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001815744_464830464.pth... [2023-12-26 14:11:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001814688_464560128.pth [2023-12-26 14:11:23,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001826640_467623936.pth [2023-12-26 14:11:24,204][123091] Updated weights for policy 0, policy_version 1827665 (0.0006) [2023-12-26 14:11:24,252][123091] Updated weights for policy 0, policy_version 1827675 (0.0010) [2023-12-26 14:11:24,300][123091] Updated weights for policy 0, policy_version 1827685 (0.0010) [2023-12-26 14:11:24,371][123091] Updated weights for policy 0, policy_version 1827695 (0.0011) [2023-12-26 14:11:24,592][123090] Updated weights for policy 1, policy_version 1815751 (0.0010) [2023-12-26 14:11:24,666][123090] Updated weights for policy 1, policy_version 1815761 (0.0010) [2023-12-26 14:11:24,733][123090] Updated weights for policy 1, policy_version 1815771 (0.0010) [2023-12-26 14:11:25,093][123091] Updated weights for policy 0, policy_version 1827705 (0.0009) [2023-12-26 14:11:25,163][123091] Updated weights for policy 0, policy_version 1827715 (0.0008) [2023-12-26 14:11:25,235][123091] Updated weights for policy 0, policy_version 1827725 (0.0008) [2023-12-26 14:11:25,540][123090] Updated weights for policy 1, policy_version 1815781 (0.0010) [2023-12-26 14:11:25,599][123090] Updated weights for policy 1, policy_version 1815791 (0.0010) [2023-12-26 14:11:25,647][123090] Updated weights for policy 1, policy_version 1815801 (0.0010) [2023-12-26 14:11:25,931][123091] Updated weights for policy 0, policy_version 1827735 (0.0008) [2023-12-26 14:11:25,994][123091] Updated weights for policy 0, policy_version 1827745 (0.0009) [2023-12-26 14:11:26,047][123091] Updated weights for policy 0, policy_version 1827755 (0.0010) [2023-12-26 14:11:26,424][123090] Updated weights for policy 1, policy_version 1815811 (0.0009) [2023-12-26 14:11:26,491][123090] Updated weights for policy 1, policy_version 1815821 (0.0005) [2023-12-26 14:11:26,558][123090] Updated weights for policy 1, policy_version 1815831 (0.0005) [2023-12-26 14:11:26,728][123091] Updated weights for policy 0, policy_version 1827765 (0.0008) [2023-12-26 14:11:26,783][123091] Updated weights for policy 0, policy_version 1827775 (0.0005) [2023-12-26 14:11:26,842][123091] Updated weights for policy 0, policy_version 1827785 (0.0008) [2023-12-26 14:11:27,198][123090] Updated weights for policy 1, policy_version 1815841 (0.0005) [2023-12-26 14:11:27,251][123090] Updated weights for policy 1, policy_version 1815851 (0.0005) [2023-12-26 14:11:27,307][123090] Updated weights for policy 1, policy_version 1815861 (0.0005) [2023-12-26 14:11:27,384][123090] Updated weights for policy 1, policy_version 1815871 (0.0005) [2023-12-26 14:11:27,508][123091] Updated weights for policy 0, policy_version 1827795 (0.0005) [2023-12-26 14:11:27,557][123091] Updated weights for policy 0, policy_version 1827805 (0.0005) [2023-12-26 14:11:27,636][123091] Updated weights for policy 0, policy_version 1827815 (0.0008) [2023-12-26 14:11:28,030][123090] Updated weights for policy 1, policy_version 1815881 (0.0008) [2023-12-26 14:11:28,092][123090] Updated weights for policy 1, policy_version 1815891 (0.0005) [2023-12-26 14:11:28,154][123090] Updated weights for policy 1, policy_version 1815901 (0.0005) [2023-12-26 14:11:28,300][123091] Updated weights for policy 0, policy_version 1827825 (0.0008) [2023-12-26 14:11:28,368][123091] Updated weights for policy 0, policy_version 1827835 (0.0007) [2023-12-26 14:11:28,422][123091] Updated weights for policy 0, policy_version 1827845 (0.0006) [2023-12-26 14:11:28,477][123091] Updated weights for policy 0, policy_version 1827855 (0.0005) [2023-12-26 14:11:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 932806656. Throughput: 0: 8956.9, 1: 8865.0. Samples: 932798456. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:28,785][121949] Avg episode reward: [(0, '6180.648'), (1, '5522.833')] [2023-12-26 14:11:28,820][123090] Updated weights for policy 1, policy_version 1815911 (0.0005) [2023-12-26 14:11:28,872][123090] Updated weights for policy 1, policy_version 1815921 (0.0005) [2023-12-26 14:11:28,933][123090] Updated weights for policy 1, policy_version 1815931 (0.0005) [2023-12-26 14:11:29,114][123091] Updated weights for policy 0, policy_version 1827865 (0.0005) [2023-12-26 14:11:29,164][123091] Updated weights for policy 0, policy_version 1827875 (0.0005) [2023-12-26 14:11:29,232][123091] Updated weights for policy 0, policy_version 1827885 (0.0006) [2023-12-26 14:11:29,684][123090] Updated weights for policy 1, policy_version 1815941 (0.0005) [2023-12-26 14:11:29,753][123090] Updated weights for policy 1, policy_version 1815951 (0.0007) [2023-12-26 14:11:29,814][123090] Updated weights for policy 1, policy_version 1815961 (0.0008) [2023-12-26 14:11:29,982][123091] Updated weights for policy 0, policy_version 1827895 (0.0007) [2023-12-26 14:11:30,035][123091] Updated weights for policy 0, policy_version 1827905 (0.0006) [2023-12-26 14:11:30,088][123091] Updated weights for policy 0, policy_version 1827915 (0.0006) [2023-12-26 14:11:30,595][123090] Updated weights for policy 1, policy_version 1815971 (0.0009) [2023-12-26 14:11:30,650][123090] Updated weights for policy 1, policy_version 1815981 (0.0010) [2023-12-26 14:11:30,706][123090] Updated weights for policy 1, policy_version 1815991 (0.0010) [2023-12-26 14:11:30,783][123091] Updated weights for policy 0, policy_version 1827925 (0.0008) [2023-12-26 14:11:30,844][123091] Updated weights for policy 0, policy_version 1827935 (0.0010) [2023-12-26 14:11:30,897][123091] Updated weights for policy 0, policy_version 1827945 (0.0008) [2023-12-26 14:11:31,522][123090] Updated weights for policy 1, policy_version 1816001 (0.0010) [2023-12-26 14:11:31,590][123090] Updated weights for policy 1, policy_version 1816011 (0.0008) [2023-12-26 14:11:31,661][123090] Updated weights for policy 1, policy_version 1816021 (0.0008) [2023-12-26 14:11:31,709][123090] Updated weights for policy 1, policy_version 1816031 (0.0008) [2023-12-26 14:11:31,755][123091] Updated weights for policy 0, policy_version 1827955 (0.0010) [2023-12-26 14:11:31,820][123091] Updated weights for policy 0, policy_version 1827965 (0.0009) [2023-12-26 14:11:31,881][123091] Updated weights for policy 0, policy_version 1827975 (0.0010) [2023-12-26 14:11:32,538][123090] Updated weights for policy 1, policy_version 1816041 (0.0009) [2023-12-26 14:11:32,571][123091] Updated weights for policy 0, policy_version 1827985 (0.0007) [2023-12-26 14:11:32,600][123090] Updated weights for policy 1, policy_version 1816051 (0.0009) [2023-12-26 14:11:32,628][123091] Updated weights for policy 0, policy_version 1827995 (0.0006) [2023-12-26 14:11:32,651][123090] Updated weights for policy 1, policy_version 1816061 (0.0008) [2023-12-26 14:11:32,673][123091] Updated weights for policy 0, policy_version 1828005 (0.0005) [2023-12-26 14:11:32,725][123091] Updated weights for policy 0, policy_version 1828015 (0.0005) [2023-12-26 14:11:33,463][123090] Updated weights for policy 1, policy_version 1816071 (0.0007) [2023-12-26 14:11:33,527][123090] Updated weights for policy 1, policy_version 1816081 (0.0008) [2023-12-26 14:11:33,575][123091] Updated weights for policy 0, policy_version 1828025 (0.0008) [2023-12-26 14:11:33,586][123090] Updated weights for policy 1, policy_version 1816091 (0.0006) [2023-12-26 14:11:33,631][123091] Updated weights for policy 0, policy_version 1828035 (0.0008) [2023-12-26 14:11:33,677][123091] Updated weights for policy 0, policy_version 1828045 (0.0008) [2023-12-26 14:11:33,784][121949] Fps is (10 sec: 19661.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 932904960. Throughput: 0: 9006.5, 1: 8952.8. Samples: 932911776. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:33,785][121949] Avg episode reward: [(0, '6382.629'), (1, '5674.278')] [2023-12-26 14:11:34,436][123090] Updated weights for policy 1, policy_version 1816101 (0.0008) [2023-12-26 14:11:34,491][123090] Updated weights for policy 1, policy_version 1816111 (0.0009) [2023-12-26 14:11:34,530][123091] Updated weights for policy 0, policy_version 1828055 (0.0007) [2023-12-26 14:11:34,545][123090] Updated weights for policy 1, policy_version 1816121 (0.0009) [2023-12-26 14:11:34,583][123091] Updated weights for policy 0, policy_version 1828065 (0.0007) [2023-12-26 14:11:34,639][123091] Updated weights for policy 0, policy_version 1828075 (0.0006) [2023-12-26 14:11:35,372][123091] Updated weights for policy 0, policy_version 1828085 (0.0008) [2023-12-26 14:11:35,429][123091] Updated weights for policy 0, policy_version 1828095 (0.0010) [2023-12-26 14:11:35,436][123090] Updated weights for policy 1, policy_version 1816131 (0.0009) [2023-12-26 14:11:35,475][123091] Updated weights for policy 0, policy_version 1828105 (0.0007) [2023-12-26 14:11:35,485][123090] Updated weights for policy 1, policy_version 1816141 (0.0007) [2023-12-26 14:11:35,532][123090] Updated weights for policy 1, policy_version 1816151 (0.0008) [2023-12-26 14:11:36,286][123091] Updated weights for policy 0, policy_version 1828115 (0.0008) [2023-12-26 14:11:36,351][123091] Updated weights for policy 0, policy_version 1828125 (0.0006) [2023-12-26 14:11:36,371][123090] Updated weights for policy 1, policy_version 1816161 (0.0009) [2023-12-26 14:11:36,404][123091] Updated weights for policy 0, policy_version 1828135 (0.0005) [2023-12-26 14:11:36,439][123090] Updated weights for policy 1, policy_version 1816171 (0.0008) [2023-12-26 14:11:36,513][123090] Updated weights for policy 1, policy_version 1816181 (0.0008) [2023-12-26 14:11:36,577][123090] Updated weights for policy 1, policy_version 1816191 (0.0009) [2023-12-26 14:11:37,089][123091] Updated weights for policy 0, policy_version 1828145 (0.0008) [2023-12-26 14:11:37,165][123091] Updated weights for policy 0, policy_version 1828155 (0.0009) [2023-12-26 14:11:37,228][123091] Updated weights for policy 0, policy_version 1828165 (0.0009) [2023-12-26 14:11:37,282][123091] Updated weights for policy 0, policy_version 1828175 (0.0010) [2023-12-26 14:11:37,366][123090] Updated weights for policy 1, policy_version 1816201 (0.0006) [2023-12-26 14:11:37,424][123090] Updated weights for policy 1, policy_version 1816211 (0.0005) [2023-12-26 14:11:37,487][123090] Updated weights for policy 1, policy_version 1816221 (0.0005) [2023-12-26 14:11:37,973][123091] Updated weights for policy 0, policy_version 1828185 (0.0006) [2023-12-26 14:11:38,027][123091] Updated weights for policy 0, policy_version 1828195 (0.0005) [2023-12-26 14:11:38,091][123091] Updated weights for policy 0, policy_version 1828205 (0.0009) [2023-12-26 14:11:38,218][123090] Updated weights for policy 1, policy_version 1816231 (0.0008) [2023-12-26 14:11:38,277][123090] Updated weights for policy 1, policy_version 1816241 (0.0010) [2023-12-26 14:11:38,341][123090] Updated weights for policy 1, policy_version 1816251 (0.0010) [2023-12-26 14:11:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 932986880. Throughput: 0: 9046.3, 1: 8946.2. Samples: 932963628. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:38,785][121949] Avg episode reward: [(0, '6359.877'), (1, '5708.724')] [2023-12-26 14:11:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001816256_464961536.pth... [2023-12-26 14:11:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001815200_464691200.pth [2023-12-26 14:11:38,814][123091] Updated weights for policy 0, policy_version 1828215 (0.0007) [2023-12-26 14:11:38,873][123091] Updated weights for policy 0, policy_version 1828225 (0.0006) [2023-12-26 14:11:38,923][123091] Updated weights for policy 0, policy_version 1828235 (0.0005) [2023-12-26 14:11:38,946][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001828240_468033536.pth... [2023-12-26 14:11:38,949][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001827152_467755008.pth [2023-12-26 14:11:39,199][123090] Updated weights for policy 1, policy_version 1816261 (0.0010) [2023-12-26 14:11:39,264][123090] Updated weights for policy 1, policy_version 1816271 (0.0007) [2023-12-26 14:11:39,321][123090] Updated weights for policy 1, policy_version 1816281 (0.0008) [2023-12-26 14:11:39,700][123091] Updated weights for policy 0, policy_version 1828245 (0.0007) [2023-12-26 14:11:39,748][123091] Updated weights for policy 0, policy_version 1828255 (0.0009) [2023-12-26 14:11:39,805][123091] Updated weights for policy 0, policy_version 1828265 (0.0005) [2023-12-26 14:11:40,211][123090] Updated weights for policy 1, policy_version 1816291 (0.0010) [2023-12-26 14:11:40,274][123090] Updated weights for policy 1, policy_version 1816301 (0.0009) [2023-12-26 14:11:40,339][123090] Updated weights for policy 1, policy_version 1816311 (0.0011) [2023-12-26 14:11:40,604][123091] Updated weights for policy 0, policy_version 1828275 (0.0008) [2023-12-26 14:11:40,657][123091] Updated weights for policy 0, policy_version 1828285 (0.0009) [2023-12-26 14:11:40,725][123091] Updated weights for policy 0, policy_version 1828295 (0.0009) [2023-12-26 14:11:41,177][123090] Updated weights for policy 1, policy_version 1816321 (0.0010) [2023-12-26 14:11:41,242][123090] Updated weights for policy 1, policy_version 1816331 (0.0008) [2023-12-26 14:11:41,315][123090] Updated weights for policy 1, policy_version 1816341 (0.0009) [2023-12-26 14:11:41,387][123090] Updated weights for policy 1, policy_version 1816351 (0.0010) [2023-12-26 14:11:41,593][123091] Updated weights for policy 0, policy_version 1828305 (0.0009) [2023-12-26 14:11:41,658][123091] Updated weights for policy 0, policy_version 1828315 (0.0011) [2023-12-26 14:11:41,729][123091] Updated weights for policy 0, policy_version 1828325 (0.0010) [2023-12-26 14:11:41,781][123091] Updated weights for policy 0, policy_version 1828335 (0.0011) [2023-12-26 14:11:42,223][123090] Updated weights for policy 1, policy_version 1816361 (0.0009) [2023-12-26 14:11:42,282][123090] Updated weights for policy 1, policy_version 1816371 (0.0009) [2023-12-26 14:11:42,351][123090] Updated weights for policy 1, policy_version 1816381 (0.0009) [2023-12-26 14:11:42,605][123091] Updated weights for policy 0, policy_version 1828345 (0.0009) [2023-12-26 14:11:42,664][123091] Updated weights for policy 0, policy_version 1828355 (0.0010) [2023-12-26 14:11:42,718][123091] Updated weights for policy 0, policy_version 1828365 (0.0009) [2023-12-26 14:11:43,262][123090] Updated weights for policy 1, policy_version 1816391 (0.0008) [2023-12-26 14:11:43,317][123090] Updated weights for policy 1, policy_version 1816401 (0.0009) [2023-12-26 14:11:43,391][123090] Updated weights for policy 1, policy_version 1816411 (0.0009) [2023-12-26 14:11:43,479][123091] Updated weights for policy 0, policy_version 1828376 (0.0010) [2023-12-26 14:11:43,533][123091] Updated weights for policy 0, policy_version 1828386 (0.0010) [2023-12-26 14:11:43,580][123091] Updated weights for policy 0, policy_version 1828397 (0.0008) [2023-12-26 14:11:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 933076992. Throughput: 0: 8964.1, 1: 8799.6. Samples: 933068268. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:43,784][121949] Avg episode reward: [(0, '6249.628'), (1, '5591.419')] [2023-12-26 14:11:44,234][123090] Updated weights for policy 1, policy_version 1816421 (0.0010) [2023-12-26 14:11:44,299][123090] Updated weights for policy 1, policy_version 1816431 (0.0009) [2023-12-26 14:11:44,360][123090] Updated weights for policy 1, policy_version 1816441 (0.0009) [2023-12-26 14:11:44,451][123091] Updated weights for policy 0, policy_version 1828407 (0.0009) [2023-12-26 14:11:44,503][123091] Updated weights for policy 0, policy_version 1828417 (0.0009) [2023-12-26 14:11:44,563][123091] Updated weights for policy 0, policy_version 1828427 (0.0009) [2023-12-26 14:11:45,157][123090] Updated weights for policy 1, policy_version 1816451 (0.0008) [2023-12-26 14:11:45,218][123090] Updated weights for policy 1, policy_version 1816461 (0.0006) [2023-12-26 14:11:45,279][123090] Updated weights for policy 1, policy_version 1816471 (0.0006) [2023-12-26 14:11:45,476][123091] Updated weights for policy 0, policy_version 1828437 (0.0009) [2023-12-26 14:11:45,543][123091] Updated weights for policy 0, policy_version 1828447 (0.0010) [2023-12-26 14:11:45,596][123091] Updated weights for policy 0, policy_version 1828457 (0.0009) [2023-12-26 14:11:46,023][123090] Updated weights for policy 1, policy_version 1816481 (0.0010) [2023-12-26 14:11:46,088][123090] Updated weights for policy 1, policy_version 1816491 (0.0008) [2023-12-26 14:11:46,141][123090] Updated weights for policy 1, policy_version 1816501 (0.0009) [2023-12-26 14:11:46,206][123090] Updated weights for policy 1, policy_version 1816511 (0.0009) [2023-12-26 14:11:46,447][123091] Updated weights for policy 0, policy_version 1828467 (0.0011) [2023-12-26 14:11:46,496][123091] Updated weights for policy 0, policy_version 1828477 (0.0009) [2023-12-26 14:11:46,552][123091] Updated weights for policy 0, policy_version 1828487 (0.0009) [2023-12-26 14:11:46,995][123090] Updated weights for policy 1, policy_version 1816521 (0.0009) [2023-12-26 14:11:47,063][123090] Updated weights for policy 1, policy_version 1816531 (0.0008) [2023-12-26 14:11:47,132][123090] Updated weights for policy 1, policy_version 1816541 (0.0008) [2023-12-26 14:11:47,436][123091] Updated weights for policy 0, policy_version 1828497 (0.0010) [2023-12-26 14:11:47,488][123091] Updated weights for policy 0, policy_version 1828507 (0.0009) [2023-12-26 14:11:47,541][123091] Updated weights for policy 0, policy_version 1828517 (0.0009) [2023-12-26 14:11:47,589][123091] Updated weights for policy 0, policy_version 1828527 (0.0009) [2023-12-26 14:11:47,828][123090] Updated weights for policy 1, policy_version 1816551 (0.0006) [2023-12-26 14:11:47,875][123090] Updated weights for policy 1, policy_version 1816561 (0.0005) [2023-12-26 14:11:47,942][123090] Updated weights for policy 1, policy_version 1816571 (0.0006) [2023-12-26 14:11:48,514][123091] Updated weights for policy 0, policy_version 1828537 (0.0009) [2023-12-26 14:11:48,572][123091] Updated weights for policy 0, policy_version 1828547 (0.0009) [2023-12-26 14:11:48,645][123091] Updated weights for policy 0, policy_version 1828557 (0.0009) [2023-12-26 14:11:48,711][123090] Updated weights for policy 1, policy_version 1816581 (0.0008) [2023-12-26 14:11:48,776][123090] Updated weights for policy 1, policy_version 1816591 (0.0008) [2023-12-26 14:11:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 933158912. Throughput: 0: 8935.0, 1: 8876.3. Samples: 933171956. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:48,785][121949] Avg episode reward: [(0, '6256.454'), (1, '5665.167')] [2023-12-26 14:11:48,843][123090] Updated weights for policy 1, policy_version 1816601 (0.0006) [2023-12-26 14:11:49,464][123090] Updated weights for policy 1, policy_version 1816611 (0.0006) [2023-12-26 14:11:49,537][123090] Updated weights for policy 1, policy_version 1816621 (0.0006) [2023-12-26 14:11:49,559][123091] Updated weights for policy 0, policy_version 1828567 (0.0009) [2023-12-26 14:11:49,607][123090] Updated weights for policy 1, policy_version 1816631 (0.0007) [2023-12-26 14:11:49,608][123091] Updated weights for policy 0, policy_version 1828577 (0.0009) [2023-12-26 14:11:49,658][123091] Updated weights for policy 0, policy_version 1828587 (0.0009) [2023-12-26 14:11:50,318][123090] Updated weights for policy 1, policy_version 1816641 (0.0006) [2023-12-26 14:11:50,387][123090] Updated weights for policy 1, policy_version 1816651 (0.0010) [2023-12-26 14:11:50,457][123090] Updated weights for policy 1, policy_version 1816661 (0.0010) [2023-12-26 14:11:50,523][123090] Updated weights for policy 1, policy_version 1816671 (0.0010) [2023-12-26 14:11:50,580][123091] Updated weights for policy 0, policy_version 1828597 (0.0009) [2023-12-26 14:11:50,637][123091] Updated weights for policy 0, policy_version 1828608 (0.0010) [2023-12-26 14:11:50,690][123091] Updated weights for policy 0, policy_version 1828618 (0.0009) [2023-12-26 14:11:51,309][123090] Updated weights for policy 1, policy_version 1816681 (0.0010) [2023-12-26 14:11:51,377][123090] Updated weights for policy 1, policy_version 1816691 (0.0010) [2023-12-26 14:11:51,453][123090] Updated weights for policy 1, policy_version 1816701 (0.0009) [2023-12-26 14:11:51,551][123091] Updated weights for policy 0, policy_version 1828628 (0.0008) [2023-12-26 14:11:51,608][123091] Updated weights for policy 0, policy_version 1828638 (0.0007) [2023-12-26 14:11:51,676][123091] Updated weights for policy 0, policy_version 1828648 (0.0007) [2023-12-26 14:11:52,234][123090] Updated weights for policy 1, policy_version 1816711 (0.0010) [2023-12-26 14:11:52,297][123090] Updated weights for policy 1, policy_version 1816721 (0.0010) [2023-12-26 14:11:52,367][123090] Updated weights for policy 1, policy_version 1816731 (0.0009) [2023-12-26 14:11:52,479][123091] Updated weights for policy 0, policy_version 1828658 (0.0008) [2023-12-26 14:11:52,542][123091] Updated weights for policy 0, policy_version 1828668 (0.0009) [2023-12-26 14:11:52,598][123091] Updated weights for policy 0, policy_version 1828678 (0.0009) [2023-12-26 14:11:52,657][123091] Updated weights for policy 0, policy_version 1828688 (0.0010) [2023-12-26 14:11:53,203][123090] Updated weights for policy 1, policy_version 1816741 (0.0009) [2023-12-26 14:11:53,270][123090] Updated weights for policy 1, policy_version 1816751 (0.0010) [2023-12-26 14:11:53,319][123090] Updated weights for policy 1, policy_version 1816761 (0.0009) [2023-12-26 14:11:53,514][123091] Updated weights for policy 0, policy_version 1828698 (0.0010) [2023-12-26 14:11:53,569][123091] Updated weights for policy 0, policy_version 1828708 (0.0010) [2023-12-26 14:11:53,617][123091] Updated weights for policy 0, policy_version 1828718 (0.0009) [2023-12-26 14:11:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 933249024. Throughput: 0: 8901.1, 1: 8893.9. Samples: 933224004. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:53,785][121949] Avg episode reward: [(0, '6292.385'), (1, '5610.480')] [2023-12-26 14:11:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001828720_468156416.pth... [2023-12-26 14:11:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001816768_465092608.pth... [2023-12-26 14:11:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001815744_464830464.pth [2023-12-26 14:11:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001827664_467886080.pth [2023-12-26 14:11:54,154][123090] Updated weights for policy 1, policy_version 1816771 (0.0009) [2023-12-26 14:11:54,207][123090] Updated weights for policy 1, policy_version 1816781 (0.0009) [2023-12-26 14:11:54,258][123090] Updated weights for policy 1, policy_version 1816791 (0.0010) [2023-12-26 14:11:54,456][123091] Updated weights for policy 0, policy_version 1828728 (0.0010) [2023-12-26 14:11:54,509][123091] Updated weights for policy 0, policy_version 1828738 (0.0009) [2023-12-26 14:11:54,578][123091] Updated weights for policy 0, policy_version 1828748 (0.0010) [2023-12-26 14:11:55,101][123090] Updated weights for policy 1, policy_version 1816801 (0.0008) [2023-12-26 14:11:55,162][123090] Updated weights for policy 1, policy_version 1816811 (0.0005) [2023-12-26 14:11:55,210][123090] Updated weights for policy 1, policy_version 1816821 (0.0005) [2023-12-26 14:11:55,259][123090] Updated weights for policy 1, policy_version 1816831 (0.0005) [2023-12-26 14:11:55,397][123091] Updated weights for policy 0, policy_version 1828758 (0.0007) [2023-12-26 14:11:55,459][123091] Updated weights for policy 0, policy_version 1828768 (0.0005) [2023-12-26 14:11:55,508][123091] Updated weights for policy 0, policy_version 1828778 (0.0005) [2023-12-26 14:11:56,074][123090] Updated weights for policy 1, policy_version 1816841 (0.0009) [2023-12-26 14:11:56,136][123090] Updated weights for policy 1, policy_version 1816851 (0.0009) [2023-12-26 14:11:56,198][123091] Updated weights for policy 0, policy_version 1828788 (0.0005) [2023-12-26 14:11:56,202][123090] Updated weights for policy 1, policy_version 1816861 (0.0009) [2023-12-26 14:11:56,255][123091] Updated weights for policy 0, policy_version 1828798 (0.0006) [2023-12-26 14:11:56,313][123091] Updated weights for policy 0, policy_version 1828808 (0.0009) [2023-12-26 14:11:56,983][123090] Updated weights for policy 1, policy_version 1816871 (0.0007) [2023-12-26 14:11:57,045][123090] Updated weights for policy 1, policy_version 1816881 (0.0005) [2023-12-26 14:11:57,107][123090] Updated weights for policy 1, policy_version 1816891 (0.0007) [2023-12-26 14:11:57,127][123091] Updated weights for policy 0, policy_version 1828818 (0.0009) [2023-12-26 14:11:57,182][123091] Updated weights for policy 0, policy_version 1828828 (0.0008) [2023-12-26 14:11:57,234][123091] Updated weights for policy 0, policy_version 1828838 (0.0009) [2023-12-26 14:11:57,297][123091] Updated weights for policy 0, policy_version 1828848 (0.0008) [2023-12-26 14:11:57,801][123090] Updated weights for policy 1, policy_version 1816901 (0.0008) [2023-12-26 14:11:57,854][123090] Updated weights for policy 1, policy_version 1816911 (0.0005) [2023-12-26 14:11:57,915][123090] Updated weights for policy 1, policy_version 1816921 (0.0005) [2023-12-26 14:11:58,011][123091] Updated weights for policy 0, policy_version 1828858 (0.0010) [2023-12-26 14:11:58,072][123091] Updated weights for policy 0, policy_version 1828868 (0.0010) [2023-12-26 14:11:58,129][123091] Updated weights for policy 0, policy_version 1828878 (0.0007) [2023-12-26 14:11:58,622][123090] Updated weights for policy 1, policy_version 1816931 (0.0006) [2023-12-26 14:11:58,688][123090] Updated weights for policy 1, policy_version 1816941 (0.0008) [2023-12-26 14:11:58,754][123090] Updated weights for policy 1, policy_version 1816951 (0.0008) [2023-12-26 14:11:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 933330944. Throughput: 0: 8962.5, 1: 8911.3. Samples: 933329384. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:11:58,785][121949] Avg episode reward: [(0, '6334.078'), (1, '5630.826')] [2023-12-26 14:11:59,050][123091] Updated weights for policy 0, policy_version 1828888 (0.0009) [2023-12-26 14:11:59,123][123091] Updated weights for policy 0, policy_version 1828898 (0.0006) [2023-12-26 14:11:59,189][123091] Updated weights for policy 0, policy_version 1828908 (0.0007) [2023-12-26 14:11:59,546][123090] Updated weights for policy 1, policy_version 1816961 (0.0008) [2023-12-26 14:11:59,612][123090] Updated weights for policy 1, policy_version 1816971 (0.0005) [2023-12-26 14:11:59,681][123090] Updated weights for policy 1, policy_version 1816981 (0.0006) [2023-12-26 14:11:59,741][123090] Updated weights for policy 1, policy_version 1816991 (0.0009) [2023-12-26 14:11:59,809][123091] Updated weights for policy 0, policy_version 1828918 (0.0008) [2023-12-26 14:11:59,875][123091] Updated weights for policy 0, policy_version 1828928 (0.0010) [2023-12-26 14:11:59,946][123091] Updated weights for policy 0, policy_version 1828938 (0.0010) [2023-12-26 14:12:00,524][123090] Updated weights for policy 1, policy_version 1817001 (0.0009) [2023-12-26 14:12:00,590][123090] Updated weights for policy 1, policy_version 1817011 (0.0007) [2023-12-26 14:12:00,643][123090] Updated weights for policy 1, policy_version 1817021 (0.0010) [2023-12-26 14:12:00,729][123091] Updated weights for policy 0, policy_version 1828948 (0.0010) [2023-12-26 14:12:00,789][123091] Updated weights for policy 0, policy_version 1828958 (0.0009) [2023-12-26 14:12:00,854][123091] Updated weights for policy 0, policy_version 1828968 (0.0006) [2023-12-26 14:12:01,496][123090] Updated weights for policy 1, policy_version 1817031 (0.0009) [2023-12-26 14:12:01,560][123090] Updated weights for policy 1, policy_version 1817041 (0.0009) [2023-12-26 14:12:01,612][123090] Updated weights for policy 1, policy_version 1817051 (0.0009) [2023-12-26 14:12:01,641][123091] Updated weights for policy 0, policy_version 1828978 (0.0006) [2023-12-26 14:12:01,706][123091] Updated weights for policy 0, policy_version 1828988 (0.0009) [2023-12-26 14:12:01,775][123091] Updated weights for policy 0, policy_version 1828998 (0.0009) [2023-12-26 14:12:01,839][123091] Updated weights for policy 0, policy_version 1829008 (0.0009) [2023-12-26 14:12:02,470][123090] Updated weights for policy 1, policy_version 1817061 (0.0009) [2023-12-26 14:12:02,543][123090] Updated weights for policy 1, policy_version 1817071 (0.0010) [2023-12-26 14:12:02,604][123090] Updated weights for policy 1, policy_version 1817081 (0.0008) [2023-12-26 14:12:02,634][123091] Updated weights for policy 0, policy_version 1829018 (0.0006) [2023-12-26 14:12:02,704][123091] Updated weights for policy 0, policy_version 1829028 (0.0006) [2023-12-26 14:12:02,764][123091] Updated weights for policy 0, policy_version 1829038 (0.0005) [2023-12-26 14:12:03,441][123090] Updated weights for policy 1, policy_version 1817091 (0.0008) [2023-12-26 14:12:03,443][123091] Updated weights for policy 0, policy_version 1829048 (0.0008) [2023-12-26 14:12:03,499][123090] Updated weights for policy 1, policy_version 1817101 (0.0005) [2023-12-26 14:12:03,503][123091] Updated weights for policy 0, policy_version 1829058 (0.0009) [2023-12-26 14:12:03,559][123090] Updated weights for policy 1, policy_version 1817111 (0.0005) [2023-12-26 14:12:03,569][123091] Updated weights for policy 0, policy_version 1829068 (0.0006) [2023-12-26 14:12:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 933429248. Throughput: 0: 8969.8, 1: 8844.0. Samples: 933436140. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:03,785][121949] Avg episode reward: [(0, '6323.114'), (1, '5838.695')] [2023-12-26 14:12:04,347][123090] Updated weights for policy 1, policy_version 1817121 (0.0006) [2023-12-26 14:12:04,398][123090] Updated weights for policy 1, policy_version 1817131 (0.0007) [2023-12-26 14:12:04,427][123091] Updated weights for policy 0, policy_version 1829078 (0.0010) [2023-12-26 14:12:04,457][123090] Updated weights for policy 1, policy_version 1817141 (0.0007) [2023-12-26 14:12:04,495][123091] Updated weights for policy 0, policy_version 1829088 (0.0011) [2023-12-26 14:12:04,517][123090] Updated weights for policy 1, policy_version 1817151 (0.0007) [2023-12-26 14:12:04,562][123091] Updated weights for policy 0, policy_version 1829098 (0.0011) [2023-12-26 14:12:05,174][123090] Updated weights for policy 1, policy_version 1817161 (0.0008) [2023-12-26 14:12:05,248][123090] Updated weights for policy 1, policy_version 1817171 (0.0008) [2023-12-26 14:12:05,315][123090] Updated weights for policy 1, policy_version 1817181 (0.0008) [2023-12-26 14:12:05,363][123091] Updated weights for policy 0, policy_version 1829108 (0.0010) [2023-12-26 14:12:05,414][123091] Updated weights for policy 0, policy_version 1829118 (0.0010) [2023-12-26 14:12:05,472][123091] Updated weights for policy 0, policy_version 1829128 (0.0010) [2023-12-26 14:12:06,052][123090] Updated weights for policy 1, policy_version 1817191 (0.0006) [2023-12-26 14:12:06,116][123090] Updated weights for policy 1, policy_version 1817201 (0.0007) [2023-12-26 14:12:06,172][123090] Updated weights for policy 1, policy_version 1817211 (0.0009) [2023-12-26 14:12:06,236][123091] Updated weights for policy 0, policy_version 1829138 (0.0011) [2023-12-26 14:12:06,308][123091] Updated weights for policy 0, policy_version 1829148 (0.0010) [2023-12-26 14:12:06,375][123091] Updated weights for policy 0, policy_version 1829158 (0.0011) [2023-12-26 14:12:06,440][123091] Updated weights for policy 0, policy_version 1829168 (0.0010) [2023-12-26 14:12:06,984][123090] Updated weights for policy 1, policy_version 1817221 (0.0009) [2023-12-26 14:12:07,049][123090] Updated weights for policy 1, policy_version 1817231 (0.0009) [2023-12-26 14:12:07,117][123090] Updated weights for policy 1, policy_version 1817241 (0.0009) [2023-12-26 14:12:07,171][123091] Updated weights for policy 0, policy_version 1829178 (0.0009) [2023-12-26 14:12:07,237][123091] Updated weights for policy 0, policy_version 1829188 (0.0010) [2023-12-26 14:12:07,302][123091] Updated weights for policy 0, policy_version 1829198 (0.0010) [2023-12-26 14:12:07,875][123090] Updated weights for policy 1, policy_version 1817251 (0.0007) [2023-12-26 14:12:07,925][123090] Updated weights for policy 1, policy_version 1817261 (0.0009) [2023-12-26 14:12:07,973][123090] Updated weights for policy 1, policy_version 1817271 (0.0008) [2023-12-26 14:12:08,143][123091] Updated weights for policy 0, policy_version 1829208 (0.0006) [2023-12-26 14:12:08,192][123091] Updated weights for policy 0, policy_version 1829218 (0.0005) [2023-12-26 14:12:08,255][123091] Updated weights for policy 0, policy_version 1829228 (0.0005) [2023-12-26 14:12:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 933511168. Throughput: 0: 8980.9, 1: 8894.8. Samples: 933490172. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:08,785][121949] Avg episode reward: [(0, '6275.093'), (1, '5948.157')] [2023-12-26 14:12:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001829232_468287488.pth... [2023-12-26 14:12:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001817280_465223680.pth... [2023-12-26 14:12:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001828240_468033536.pth [2023-12-26 14:12:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001816256_464961536.pth [2023-12-26 14:12:08,884][123090] Updated weights for policy 1, policy_version 1817281 (0.0010) [2023-12-26 14:12:08,952][123090] Updated weights for policy 1, policy_version 1817291 (0.0011) [2023-12-26 14:12:09,012][123090] Updated weights for policy 1, policy_version 1817301 (0.0009) [2023-12-26 14:12:09,066][123090] Updated weights for policy 1, policy_version 1817311 (0.0008) [2023-12-26 14:12:09,080][123091] Updated weights for policy 0, policy_version 1829238 (0.0007) [2023-12-26 14:12:09,137][123091] Updated weights for policy 0, policy_version 1829248 (0.0009) [2023-12-26 14:12:09,188][123091] Updated weights for policy 0, policy_version 1829258 (0.0009) [2023-12-26 14:12:09,862][123090] Updated weights for policy 1, policy_version 1817321 (0.0007) [2023-12-26 14:12:09,940][123090] Updated weights for policy 1, policy_version 1817331 (0.0006) [2023-12-26 14:12:10,003][123090] Updated weights for policy 1, policy_version 1817341 (0.0011) [2023-12-26 14:12:10,166][123091] Updated weights for policy 0, policy_version 1829268 (0.0009) [2023-12-26 14:12:10,219][123091] Updated weights for policy 0, policy_version 1829278 (0.0010) [2023-12-26 14:12:10,272][123091] Updated weights for policy 0, policy_version 1829288 (0.0008) [2023-12-26 14:12:10,743][123090] Updated weights for policy 1, policy_version 1817351 (0.0011) [2023-12-26 14:12:10,806][123090] Updated weights for policy 1, policy_version 1817361 (0.0010) [2023-12-26 14:12:10,869][123090] Updated weights for policy 1, policy_version 1817371 (0.0010) [2023-12-26 14:12:11,009][123091] Updated weights for policy 0, policy_version 1829298 (0.0006) [2023-12-26 14:12:11,079][123091] Updated weights for policy 0, policy_version 1829308 (0.0007) [2023-12-26 14:12:11,149][123091] Updated weights for policy 0, policy_version 1829318 (0.0007) [2023-12-26 14:12:11,213][123091] Updated weights for policy 0, policy_version 1829328 (0.0006) [2023-12-26 14:12:11,705][123090] Updated weights for policy 1, policy_version 1817381 (0.0011) [2023-12-26 14:12:11,773][123090] Updated weights for policy 1, policy_version 1817391 (0.0011) [2023-12-26 14:12:11,841][123090] Updated weights for policy 1, policy_version 1817401 (0.0011) [2023-12-26 14:12:11,944][123091] Updated weights for policy 0, policy_version 1829338 (0.0009) [2023-12-26 14:12:11,996][123091] Updated weights for policy 0, policy_version 1829348 (0.0009) [2023-12-26 14:12:12,053][123091] Updated weights for policy 0, policy_version 1829358 (0.0009) [2023-12-26 14:12:12,653][123090] Updated weights for policy 1, policy_version 1817411 (0.0009) [2023-12-26 14:12:12,724][123090] Updated weights for policy 1, policy_version 1817421 (0.0006) [2023-12-26 14:12:12,793][123090] Updated weights for policy 1, policy_version 1817431 (0.0005) [2023-12-26 14:12:12,927][123091] Updated weights for policy 0, policy_version 1829368 (0.0009) [2023-12-26 14:12:12,988][123091] Updated weights for policy 0, policy_version 1829378 (0.0009) [2023-12-26 14:12:13,047][123091] Updated weights for policy 0, policy_version 1829388 (0.0008) [2023-12-26 14:12:13,547][123090] Updated weights for policy 1, policy_version 1817441 (0.0009) [2023-12-26 14:12:13,603][123090] Updated weights for policy 1, policy_version 1817451 (0.0005) [2023-12-26 14:12:13,651][123090] Updated weights for policy 1, policy_version 1817461 (0.0005) [2023-12-26 14:12:13,708][123090] Updated weights for policy 1, policy_version 1817471 (0.0005) [2023-12-26 14:12:13,728][123091] Updated weights for policy 0, policy_version 1829398 (0.0005) [2023-12-26 14:12:13,777][123091] Updated weights for policy 0, policy_version 1829408 (0.0005) [2023-12-26 14:12:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 933601280. Throughput: 0: 8842.8, 1: 8839.1. Samples: 933594144. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:13,785][121949] Avg episode reward: [(0, '6206.002'), (1, '5768.521')] [2023-12-26 14:12:13,836][123091] Updated weights for policy 0, policy_version 1829418 (0.0005) [2023-12-26 14:12:14,348][123090] Updated weights for policy 1, policy_version 1817481 (0.0005) [2023-12-26 14:12:14,426][123090] Updated weights for policy 1, policy_version 1817491 (0.0005) [2023-12-26 14:12:14,487][123090] Updated weights for policy 1, policy_version 1817501 (0.0006) [2023-12-26 14:12:14,497][123091] Updated weights for policy 0, policy_version 1829428 (0.0007) [2023-12-26 14:12:14,561][123091] Updated weights for policy 0, policy_version 1829438 (0.0010) [2023-12-26 14:12:14,622][123091] Updated weights for policy 0, policy_version 1829448 (0.0010) [2023-12-26 14:12:15,180][123090] Updated weights for policy 1, policy_version 1817511 (0.0008) [2023-12-26 14:12:15,241][123090] Updated weights for policy 1, policy_version 1817521 (0.0010) [2023-12-26 14:12:15,298][123090] Updated weights for policy 1, policy_version 1817531 (0.0010) [2023-12-26 14:12:15,428][123091] Updated weights for policy 0, policy_version 1829458 (0.0009) [2023-12-26 14:12:15,480][123091] Updated weights for policy 0, policy_version 1829468 (0.0009) [2023-12-26 14:12:15,532][123091] Updated weights for policy 0, policy_version 1829478 (0.0011) [2023-12-26 14:12:15,579][123091] Updated weights for policy 0, policy_version 1829488 (0.0011) [2023-12-26 14:12:16,126][123090] Updated weights for policy 1, policy_version 1817541 (0.0010) [2023-12-26 14:12:16,173][123090] Updated weights for policy 1, policy_version 1817551 (0.0010) [2023-12-26 14:12:16,218][123090] Updated weights for policy 1, policy_version 1817561 (0.0009) [2023-12-26 14:12:16,340][123091] Updated weights for policy 0, policy_version 1829498 (0.0007) [2023-12-26 14:12:16,392][123091] Updated weights for policy 0, policy_version 1829508 (0.0010) [2023-12-26 14:12:16,448][123091] Updated weights for policy 0, policy_version 1829518 (0.0010) [2023-12-26 14:12:17,075][123090] Updated weights for policy 1, policy_version 1817571 (0.0010) [2023-12-26 14:12:17,131][123090] Updated weights for policy 1, policy_version 1817581 (0.0010) [2023-12-26 14:12:17,135][123091] Updated weights for policy 0, policy_version 1829528 (0.0010) [2023-12-26 14:12:17,190][123090] Updated weights for policy 1, policy_version 1817591 (0.0010) [2023-12-26 14:12:17,194][123091] Updated weights for policy 0, policy_version 1829538 (0.0011) [2023-12-26 14:12:17,256][123091] Updated weights for policy 0, policy_version 1829548 (0.0010) [2023-12-26 14:12:18,014][123090] Updated weights for policy 1, policy_version 1817601 (0.0010) [2023-12-26 14:12:18,049][123091] Updated weights for policy 0, policy_version 1829558 (0.0009) [2023-12-26 14:12:18,069][123090] Updated weights for policy 1, policy_version 1817611 (0.0010) [2023-12-26 14:12:18,098][123091] Updated weights for policy 0, policy_version 1829568 (0.0006) [2023-12-26 14:12:18,132][123090] Updated weights for policy 1, policy_version 1817621 (0.0010) [2023-12-26 14:12:18,149][123091] Updated weights for policy 0, policy_version 1829578 (0.0005) [2023-12-26 14:12:18,196][123090] Updated weights for policy 1, policy_version 1817631 (0.0011) [2023-12-26 14:12:18,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 933691392. Throughput: 0: 8835.8, 1: 8806.2. Samples: 933705664. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:18,785][121949] Avg episode reward: [(0, '6315.774'), (1, '5689.241')] [2023-12-26 14:12:18,950][123091] Updated weights for policy 0, policy_version 1829588 (0.0007) [2023-12-26 14:12:18,991][123090] Updated weights for policy 1, policy_version 1817641 (0.0008) [2023-12-26 14:12:19,014][123091] Updated weights for policy 0, policy_version 1829598 (0.0011) [2023-12-26 14:12:19,043][123090] Updated weights for policy 1, policy_version 1817651 (0.0011) [2023-12-26 14:12:19,074][123091] Updated weights for policy 0, policy_version 1829608 (0.0010) [2023-12-26 14:12:19,091][123090] Updated weights for policy 1, policy_version 1817661 (0.0010) [2023-12-26 14:12:19,867][123091] Updated weights for policy 0, policy_version 1829618 (0.0007) [2023-12-26 14:12:19,930][123090] Updated weights for policy 1, policy_version 1817671 (0.0010) [2023-12-26 14:12:19,932][123091] Updated weights for policy 0, policy_version 1829628 (0.0014) [2023-12-26 14:12:19,992][123091] Updated weights for policy 0, policy_version 1829638 (0.0010) [2023-12-26 14:12:19,992][123090] Updated weights for policy 1, policy_version 1817681 (0.0011) [2023-12-26 14:12:20,044][123091] Updated weights for policy 0, policy_version 1829648 (0.0010) [2023-12-26 14:12:20,049][123090] Updated weights for policy 1, policy_version 1817691 (0.0010) [2023-12-26 14:12:20,889][123091] Updated weights for policy 0, policy_version 1829658 (0.0011) [2023-12-26 14:12:20,895][123090] Updated weights for policy 1, policy_version 1817701 (0.0011) [2023-12-26 14:12:20,959][123090] Updated weights for policy 1, policy_version 1817711 (0.0011) [2023-12-26 14:12:20,960][123091] Updated weights for policy 0, policy_version 1829668 (0.0011) [2023-12-26 14:12:21,028][123091] Updated weights for policy 0, policy_version 1829678 (0.0011) [2023-12-26 14:12:21,032][123090] Updated weights for policy 1, policy_version 1817721 (0.0011) [2023-12-26 14:12:21,875][123090] Updated weights for policy 1, policy_version 1817731 (0.0009) [2023-12-26 14:12:21,893][123091] Updated weights for policy 0, policy_version 1829688 (0.0009) [2023-12-26 14:12:21,934][123090] Updated weights for policy 1, policy_version 1817741 (0.0006) [2023-12-26 14:12:21,948][123091] Updated weights for policy 0, policy_version 1829698 (0.0010) [2023-12-26 14:12:21,989][123090] Updated weights for policy 1, policy_version 1817751 (0.0010) [2023-12-26 14:12:22,013][123091] Updated weights for policy 0, policy_version 1829708 (0.0009) [2023-12-26 14:12:22,814][123090] Updated weights for policy 1, policy_version 1817761 (0.0009) [2023-12-26 14:12:22,864][123091] Updated weights for policy 0, policy_version 1829718 (0.0008) [2023-12-26 14:12:22,876][123090] Updated weights for policy 1, policy_version 1817771 (0.0008) [2023-12-26 14:12:22,931][123091] Updated weights for policy 0, policy_version 1829728 (0.0007) [2023-12-26 14:12:22,937][123090] Updated weights for policy 1, policy_version 1817781 (0.0011) [2023-12-26 14:12:22,991][123091] Updated weights for policy 0, policy_version 1829738 (0.0009) [2023-12-26 14:12:23,002][123090] Updated weights for policy 1, policy_version 1817791 (0.0010) [2023-12-26 14:12:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 933773312. Throughput: 0: 8793.8, 1: 8822.4. Samples: 933756356. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:23,785][121949] Avg episode reward: [(0, '6283.362'), (1, '5775.081')] [2023-12-26 14:12:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001829744_468418560.pth... [2023-12-26 14:12:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001828720_468156416.pth [2023-12-26 14:12:23,831][123090] Updated weights for policy 1, policy_version 1817801 (0.0010) [2023-12-26 14:12:23,842][123091] Updated weights for policy 0, policy_version 1829748 (0.0009) [2023-12-26 14:12:23,897][123090] Updated weights for policy 1, policy_version 1817811 (0.0010) [2023-12-26 14:12:23,897][123091] Updated weights for policy 0, policy_version 1829758 (0.0007) [2023-12-26 14:12:23,951][123091] Updated weights for policy 0, policy_version 1829768 (0.0006) [2023-12-26 14:12:23,952][123090] Updated weights for policy 1, policy_version 1817821 (0.0010) [2023-12-26 14:12:23,964][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001817824_465362944.pth... [2023-12-26 14:12:23,968][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001816768_465092608.pth [2023-12-26 14:12:24,775][123090] Updated weights for policy 1, policy_version 1817831 (0.0009) [2023-12-26 14:12:24,790][123091] Updated weights for policy 0, policy_version 1829778 (0.0008) [2023-12-26 14:12:24,834][123090] Updated weights for policy 1, policy_version 1817841 (0.0010) [2023-12-26 14:12:24,845][123091] Updated weights for policy 0, policy_version 1829788 (0.0006) [2023-12-26 14:12:24,892][123090] Updated weights for policy 1, policy_version 1817851 (0.0010) [2023-12-26 14:12:24,907][123091] Updated weights for policy 0, policy_version 1829798 (0.0007) [2023-12-26 14:12:24,969][123091] Updated weights for policy 0, policy_version 1829808 (0.0009) [2023-12-26 14:12:25,609][123090] Updated weights for policy 1, policy_version 1817861 (0.0008) [2023-12-26 14:12:25,665][123090] Updated weights for policy 1, policy_version 1817871 (0.0006) [2023-12-26 14:12:25,726][123090] Updated weights for policy 1, policy_version 1817881 (0.0009) [2023-12-26 14:12:25,852][123091] Updated weights for policy 0, policy_version 1829818 (0.0010) [2023-12-26 14:12:25,912][123091] Updated weights for policy 0, policy_version 1829828 (0.0009) [2023-12-26 14:12:25,979][123091] Updated weights for policy 0, policy_version 1829838 (0.0009) [2023-12-26 14:12:26,563][123090] Updated weights for policy 1, policy_version 1817891 (0.0011) [2023-12-26 14:12:26,621][123090] Updated weights for policy 1, policy_version 1817902 (0.0009) [2023-12-26 14:12:26,670][123090] Updated weights for policy 1, policy_version 1817912 (0.0009) [2023-12-26 14:12:26,728][123091] Updated weights for policy 0, policy_version 1829848 (0.0008) [2023-12-26 14:12:26,789][123091] Updated weights for policy 0, policy_version 1829858 (0.0010) [2023-12-26 14:12:26,838][123091] Updated weights for policy 0, policy_version 1829868 (0.0009) [2023-12-26 14:12:27,487][123090] Updated weights for policy 1, policy_version 1817922 (0.0008) [2023-12-26 14:12:27,551][123090] Updated weights for policy 1, policy_version 1817932 (0.0008) [2023-12-26 14:12:27,615][123090] Updated weights for policy 1, policy_version 1817942 (0.0009) [2023-12-26 14:12:27,673][123090] Updated weights for policy 1, policy_version 1817952 (0.0007) [2023-12-26 14:12:27,679][123091] Updated weights for policy 0, policy_version 1829878 (0.0010) [2023-12-26 14:12:27,726][123091] Updated weights for policy 0, policy_version 1829888 (0.0010) [2023-12-26 14:12:27,794][123091] Updated weights for policy 0, policy_version 1829898 (0.0010) [2023-12-26 14:12:28,419][123090] Updated weights for policy 1, policy_version 1817962 (0.0006) [2023-12-26 14:12:28,476][123090] Updated weights for policy 1, policy_version 1817972 (0.0005) [2023-12-26 14:12:28,523][123090] Updated weights for policy 1, policy_version 1817982 (0.0005) [2023-12-26 14:12:28,632][123091] Updated weights for policy 0, policy_version 1829908 (0.0010) [2023-12-26 14:12:28,708][123091] Updated weights for policy 0, policy_version 1829918 (0.0010) [2023-12-26 14:12:28,782][123091] Updated weights for policy 0, policy_version 1829928 (0.0011) [2023-12-26 14:12:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 933863424. Throughput: 0: 8718.3, 1: 8871.6. Samples: 933859812. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:28,784][121949] Avg episode reward: [(0, '6283.078'), (1, '5734.031')] [2023-12-26 14:12:29,234][123090] Updated weights for policy 1, policy_version 1817992 (0.0008) [2023-12-26 14:12:29,305][123090] Updated weights for policy 1, policy_version 1818002 (0.0009) [2023-12-26 14:12:29,371][123090] Updated weights for policy 1, policy_version 1818012 (0.0009) [2023-12-26 14:12:29,535][123091] Updated weights for policy 0, policy_version 1829938 (0.0010) [2023-12-26 14:12:29,591][123091] Updated weights for policy 0, policy_version 1829948 (0.0010) [2023-12-26 14:12:29,647][123091] Updated weights for policy 0, policy_version 1829958 (0.0009) [2023-12-26 14:12:29,697][123091] Updated weights for policy 0, policy_version 1829968 (0.0009) [2023-12-26 14:12:30,192][123090] Updated weights for policy 1, policy_version 1818022 (0.0010) [2023-12-26 14:12:30,254][123090] Updated weights for policy 1, policy_version 1818032 (0.0010) [2023-12-26 14:12:30,306][123090] Updated weights for policy 1, policy_version 1818042 (0.0010) [2023-12-26 14:12:30,552][123091] Updated weights for policy 0, policy_version 1829978 (0.0010) [2023-12-26 14:12:30,604][123091] Updated weights for policy 0, policy_version 1829988 (0.0010) [2023-12-26 14:12:30,654][123091] Updated weights for policy 0, policy_version 1829998 (0.0010) [2023-12-26 14:12:31,149][123090] Updated weights for policy 1, policy_version 1818052 (0.0010) [2023-12-26 14:12:31,213][123090] Updated weights for policy 1, policy_version 1818062 (0.0008) [2023-12-26 14:12:31,279][123090] Updated weights for policy 1, policy_version 1818072 (0.0008) [2023-12-26 14:12:31,480][123091] Updated weights for policy 0, policy_version 1830008 (0.0010) [2023-12-26 14:12:31,531][123091] Updated weights for policy 0, policy_version 1830018 (0.0010) [2023-12-26 14:12:31,578][123091] Updated weights for policy 0, policy_version 1830028 (0.0010) [2023-12-26 14:12:32,063][123090] Updated weights for policy 1, policy_version 1818082 (0.0007) [2023-12-26 14:12:32,122][123090] Updated weights for policy 1, policy_version 1818092 (0.0005) [2023-12-26 14:12:32,170][123090] Updated weights for policy 1, policy_version 1818102 (0.0005) [2023-12-26 14:12:32,223][123090] Updated weights for policy 1, policy_version 1818112 (0.0005) [2023-12-26 14:12:32,292][123091] Updated weights for policy 0, policy_version 1830038 (0.0010) [2023-12-26 14:12:32,344][123091] Updated weights for policy 0, policy_version 1830048 (0.0010) [2023-12-26 14:12:32,406][123091] Updated weights for policy 0, policy_version 1830058 (0.0010) [2023-12-26 14:12:32,940][123090] Updated weights for policy 1, policy_version 1818122 (0.0008) [2023-12-26 14:12:33,009][123090] Updated weights for policy 1, policy_version 1818132 (0.0009) [2023-12-26 14:12:33,065][123090] Updated weights for policy 1, policy_version 1818142 (0.0009) [2023-12-26 14:12:33,187][123091] Updated weights for policy 0, policy_version 1830068 (0.0008) [2023-12-26 14:12:33,247][123091] Updated weights for policy 0, policy_version 1830078 (0.0005) [2023-12-26 14:12:33,301][123091] Updated weights for policy 0, policy_version 1830088 (0.0005) [2023-12-26 14:12:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 933953536. Throughput: 0: 8795.8, 1: 8894.7. Samples: 933968024. Policy #0 lag: (min: 29.0, avg: 29.6, max: 47.0) [2023-12-26 14:12:33,785][121949] Avg episode reward: [(0, '6242.217'), (1, '5642.571')] [2023-12-26 14:12:33,796][123090] Updated weights for policy 1, policy_version 1818152 (0.0009) [2023-12-26 14:12:33,858][123090] Updated weights for policy 1, policy_version 1818162 (0.0009) [2023-12-26 14:12:33,909][123090] Updated weights for policy 1, policy_version 1818172 (0.0005) [2023-12-26 14:12:34,095][123091] Updated weights for policy 0, policy_version 1830098 (0.0008) [2023-12-26 14:12:34,165][123091] Updated weights for policy 0, policy_version 1830108 (0.0009) [2023-12-26 14:12:34,236][123091] Updated weights for policy 0, policy_version 1830118 (0.0011) [2023-12-26 14:12:34,299][123091] Updated weights for policy 0, policy_version 1830128 (0.0011) [2023-12-26 14:12:34,739][123090] Updated weights for policy 1, policy_version 1818182 (0.0007) [2023-12-26 14:12:34,806][123090] Updated weights for policy 1, policy_version 1818192 (0.0009) [2023-12-26 14:12:34,878][123090] Updated weights for policy 1, policy_version 1818202 (0.0009) [2023-12-26 14:12:35,082][123091] Updated weights for policy 0, policy_version 1830138 (0.0011) [2023-12-26 14:12:35,151][123091] Updated weights for policy 0, policy_version 1830148 (0.0010) [2023-12-26 14:12:35,217][123091] Updated weights for policy 0, policy_version 1830158 (0.0011) [2023-12-26 14:12:35,674][123090] Updated weights for policy 1, policy_version 1818212 (0.0007) [2023-12-26 14:12:35,725][123090] Updated weights for policy 1, policy_version 1818222 (0.0006) [2023-12-26 14:12:35,784][123090] Updated weights for policy 1, policy_version 1818232 (0.0005) [2023-12-26 14:12:35,943][123091] Updated weights for policy 0, policy_version 1830168 (0.0006) [2023-12-26 14:12:36,011][123091] Updated weights for policy 0, policy_version 1830178 (0.0005) [2023-12-26 14:12:36,079][123091] Updated weights for policy 0, policy_version 1830188 (0.0005) [2023-12-26 14:12:36,469][123090] Updated weights for policy 1, policy_version 1818242 (0.0006) [2023-12-26 14:12:36,534][123090] Updated weights for policy 1, policy_version 1818252 (0.0010) [2023-12-26 14:12:36,599][123090] Updated weights for policy 1, policy_version 1818262 (0.0010) [2023-12-26 14:12:36,661][123090] Updated weights for policy 1, policy_version 1818272 (0.0009) [2023-12-26 14:12:36,729][123091] Updated weights for policy 0, policy_version 1830198 (0.0006) [2023-12-26 14:12:36,795][123091] Updated weights for policy 0, policy_version 1830208 (0.0006) [2023-12-26 14:12:36,865][123091] Updated weights for policy 0, policy_version 1830218 (0.0005) [2023-12-26 14:12:37,412][123090] Updated weights for policy 1, policy_version 1818282 (0.0006) [2023-12-26 14:12:37,479][123090] Updated weights for policy 1, policy_version 1818292 (0.0005) [2023-12-26 14:12:37,544][123090] Updated weights for policy 1, policy_version 1818302 (0.0005) [2023-12-26 14:12:37,676][123091] Updated weights for policy 0, policy_version 1830228 (0.0007) [2023-12-26 14:12:37,732][123091] Updated weights for policy 0, policy_version 1830238 (0.0008) [2023-12-26 14:12:37,801][123091] Updated weights for policy 0, policy_version 1830248 (0.0010) [2023-12-26 14:12:38,228][123090] Updated weights for policy 1, policy_version 1818312 (0.0006) [2023-12-26 14:12:38,295][123090] Updated weights for policy 1, policy_version 1818322 (0.0005) [2023-12-26 14:12:38,367][123090] Updated weights for policy 1, policy_version 1818332 (0.0007) [2023-12-26 14:12:38,647][123091] Updated weights for policy 0, policy_version 1830258 (0.0010) [2023-12-26 14:12:38,701][123091] Updated weights for policy 0, policy_version 1830268 (0.0010) [2023-12-26 14:12:38,759][123091] Updated weights for policy 0, policy_version 1830278 (0.0006) [2023-12-26 14:12:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 934043648. Throughput: 0: 8871.4, 1: 8879.8. Samples: 934022804. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:12:38,785][121949] Avg episode reward: [(0, '6257.393'), (1, '5678.229')] [2023-12-26 14:12:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001818336_465494016.pth... [2023-12-26 14:12:38,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001817280_465223680.pth [2023-12-26 14:12:38,822][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001830288_468557824.pth... [2023-12-26 14:12:38,823][123091] Updated weights for policy 0, policy_version 1830288 (0.0006) [2023-12-26 14:12:38,825][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001829232_468287488.pth [2023-12-26 14:12:39,090][123090] Updated weights for policy 1, policy_version 1818342 (0.0007) [2023-12-26 14:12:39,158][123090] Updated weights for policy 1, policy_version 1818352 (0.0005) [2023-12-26 14:12:39,233][123090] Updated weights for policy 1, policy_version 1818362 (0.0006) [2023-12-26 14:12:39,673][123091] Updated weights for policy 0, policy_version 1830298 (0.0009) [2023-12-26 14:12:39,733][123091] Updated weights for policy 0, policy_version 1830308 (0.0009) [2023-12-26 14:12:39,799][123091] Updated weights for policy 0, policy_version 1830318 (0.0009) [2023-12-26 14:12:40,036][123090] Updated weights for policy 1, policy_version 1818372 (0.0009) [2023-12-26 14:12:40,096][123090] Updated weights for policy 1, policy_version 1818382 (0.0011) [2023-12-26 14:12:40,163][123090] Updated weights for policy 1, policy_version 1818392 (0.0011) [2023-12-26 14:12:40,605][123091] Updated weights for policy 0, policy_version 1830328 (0.0010) [2023-12-26 14:12:40,653][123091] Updated weights for policy 0, policy_version 1830338 (0.0010) [2023-12-26 14:12:40,701][123091] Updated weights for policy 0, policy_version 1830348 (0.0010) [2023-12-26 14:12:40,856][123090] Updated weights for policy 1, policy_version 1818402 (0.0010) [2023-12-26 14:12:40,912][123090] Updated weights for policy 1, policy_version 1818412 (0.0009) [2023-12-26 14:12:40,964][123090] Updated weights for policy 1, policy_version 1818422 (0.0009) [2023-12-26 14:12:41,021][123090] Updated weights for policy 1, policy_version 1818432 (0.0006) [2023-12-26 14:12:41,596][123091] Updated weights for policy 0, policy_version 1830358 (0.0009) [2023-12-26 14:12:41,663][123091] Updated weights for policy 0, policy_version 1830368 (0.0009) [2023-12-26 14:12:41,715][123091] Updated weights for policy 0, policy_version 1830378 (0.0005) [2023-12-26 14:12:41,860][123090] Updated weights for policy 1, policy_version 1818442 (0.0010) [2023-12-26 14:12:41,910][123090] Updated weights for policy 1, policy_version 1818452 (0.0009) [2023-12-26 14:12:41,964][123090] Updated weights for policy 1, policy_version 1818462 (0.0009) [2023-12-26 14:12:42,456][123091] Updated weights for policy 0, policy_version 1830388 (0.0008) [2023-12-26 14:12:42,518][123091] Updated weights for policy 0, policy_version 1830398 (0.0009) [2023-12-26 14:12:42,588][123091] Updated weights for policy 0, policy_version 1830408 (0.0006) [2023-12-26 14:12:42,944][123090] Updated weights for policy 1, policy_version 1818472 (0.0009) [2023-12-26 14:12:43,005][123090] Updated weights for policy 1, policy_version 1818482 (0.0009) [2023-12-26 14:12:43,055][123090] Updated weights for policy 1, policy_version 1818492 (0.0009) [2023-12-26 14:12:43,295][123091] Updated weights for policy 0, policy_version 1830418 (0.0007) [2023-12-26 14:12:43,343][123091] Updated weights for policy 0, policy_version 1830428 (0.0010) [2023-12-26 14:12:43,397][123091] Updated weights for policy 0, policy_version 1830438 (0.0010) [2023-12-26 14:12:43,458][123091] Updated weights for policy 0, policy_version 1830448 (0.0010) [2023-12-26 14:12:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 934133760. Throughput: 0: 8848.3, 1: 8918.4. Samples: 934128884. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:12:43,785][121949] Avg episode reward: [(0, '6267.893'), (1, '5833.793')] [2023-12-26 14:12:43,828][123090] Updated weights for policy 1, policy_version 1818502 (0.0006) [2023-12-26 14:12:43,880][123090] Updated weights for policy 1, policy_version 1818512 (0.0005) [2023-12-26 14:12:43,926][123090] Updated weights for policy 1, policy_version 1818522 (0.0005) [2023-12-26 14:12:44,298][123091] Updated weights for policy 0, policy_version 1830458 (0.0010) [2023-12-26 14:12:44,351][123091] Updated weights for policy 0, policy_version 1830468 (0.0009) [2023-12-26 14:12:44,414][123091] Updated weights for policy 0, policy_version 1830478 (0.0005) [2023-12-26 14:12:44,606][123090] Updated weights for policy 1, policy_version 1818532 (0.0005) [2023-12-26 14:12:44,668][123090] Updated weights for policy 1, policy_version 1818542 (0.0008) [2023-12-26 14:12:44,725][123090] Updated weights for policy 1, policy_version 1818552 (0.0010) [2023-12-26 14:12:45,215][123091] Updated weights for policy 0, policy_version 1830488 (0.0008) [2023-12-26 14:12:45,285][123091] Updated weights for policy 0, policy_version 1830498 (0.0009) [2023-12-26 14:12:45,346][123091] Updated weights for policy 0, policy_version 1830508 (0.0009) [2023-12-26 14:12:45,581][123090] Updated weights for policy 1, policy_version 1818562 (0.0010) [2023-12-26 14:12:45,642][123090] Updated weights for policy 1, policy_version 1818572 (0.0010) [2023-12-26 14:12:45,704][123090] Updated weights for policy 1, policy_version 1818582 (0.0010) [2023-12-26 14:12:45,769][123090] Updated weights for policy 1, policy_version 1818592 (0.0010) [2023-12-26 14:12:46,208][123091] Updated weights for policy 0, policy_version 1830518 (0.0009) [2023-12-26 14:12:46,277][123091] Updated weights for policy 0, policy_version 1830528 (0.0009) [2023-12-26 14:12:46,336][123091] Updated weights for policy 0, policy_version 1830538 (0.0010) [2023-12-26 14:12:46,493][123090] Updated weights for policy 1, policy_version 1818602 (0.0005) [2023-12-26 14:12:46,551][123090] Updated weights for policy 1, policy_version 1818612 (0.0005) [2023-12-26 14:12:46,603][123090] Updated weights for policy 1, policy_version 1818622 (0.0005) [2023-12-26 14:12:47,054][123091] Updated weights for policy 0, policy_version 1830548 (0.0007) [2023-12-26 14:12:47,110][123091] Updated weights for policy 0, policy_version 1830558 (0.0006) [2023-12-26 14:12:47,175][123091] Updated weights for policy 0, policy_version 1830568 (0.0005) [2023-12-26 14:12:47,217][123090] Updated weights for policy 1, policy_version 1818632 (0.0006) [2023-12-26 14:12:47,292][123090] Updated weights for policy 1, policy_version 1818643 (0.0008) [2023-12-26 14:12:47,358][123090] Updated weights for policy 1, policy_version 1818653 (0.0009) [2023-12-26 14:12:47,700][123091] Updated weights for policy 0, policy_version 1830578 (0.0006) [2023-12-26 14:12:47,753][123091] Updated weights for policy 0, policy_version 1830588 (0.0010) [2023-12-26 14:12:47,811][123091] Updated weights for policy 0, policy_version 1830599 (0.0009) [2023-12-26 14:12:48,214][123090] Updated weights for policy 1, policy_version 1818663 (0.0007) [2023-12-26 14:12:48,271][123090] Updated weights for policy 1, policy_version 1818673 (0.0005) [2023-12-26 14:12:48,337][123090] Updated weights for policy 1, policy_version 1818683 (0.0006) [2023-12-26 14:12:48,592][123091] Updated weights for policy 0, policy_version 1830609 (0.0007) [2023-12-26 14:12:48,655][123091] Updated weights for policy 0, policy_version 1830619 (0.0009) [2023-12-26 14:12:48,716][123091] Updated weights for policy 0, policy_version 1830629 (0.0009) [2023-12-26 14:12:48,764][123091] Updated weights for policy 0, policy_version 1830639 (0.0009) [2023-12-26 14:12:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 934232064. Throughput: 0: 8882.2, 1: 8966.3. Samples: 934239320. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:12:48,784][121949] Avg episode reward: [(0, '6311.717'), (1, '5818.350')] [2023-12-26 14:12:49,137][123090] Updated weights for policy 1, policy_version 1818693 (0.0010) [2023-12-26 14:12:49,201][123090] Updated weights for policy 1, policy_version 1818703 (0.0009) [2023-12-26 14:12:49,273][123090] Updated weights for policy 1, policy_version 1818713 (0.0009) [2023-12-26 14:12:49,555][123091] Updated weights for policy 0, policy_version 1830649 (0.0010) [2023-12-26 14:12:49,608][123091] Updated weights for policy 0, policy_version 1830659 (0.0009) [2023-12-26 14:12:49,675][123091] Updated weights for policy 0, policy_version 1830669 (0.0009) [2023-12-26 14:12:50,129][123090] Updated weights for policy 1, policy_version 1818723 (0.0010) [2023-12-26 14:12:50,198][123090] Updated weights for policy 1, policy_version 1818733 (0.0010) [2023-12-26 14:12:50,272][123090] Updated weights for policy 1, policy_version 1818743 (0.0009) [2023-12-26 14:12:50,471][123091] Updated weights for policy 0, policy_version 1830679 (0.0010) [2023-12-26 14:12:50,541][123091] Updated weights for policy 0, policy_version 1830689 (0.0009) [2023-12-26 14:12:50,603][123091] Updated weights for policy 0, policy_version 1830699 (0.0009) [2023-12-26 14:12:51,114][123090] Updated weights for policy 1, policy_version 1818753 (0.0009) [2023-12-26 14:12:51,188][123090] Updated weights for policy 1, policy_version 1818763 (0.0010) [2023-12-26 14:12:51,242][123090] Updated weights for policy 1, policy_version 1818773 (0.0008) [2023-12-26 14:12:51,314][123090] Updated weights for policy 1, policy_version 1818783 (0.0006) [2023-12-26 14:12:51,380][123091] Updated weights for policy 0, policy_version 1830709 (0.0008) [2023-12-26 14:12:51,442][123091] Updated weights for policy 0, policy_version 1830719 (0.0008) [2023-12-26 14:12:51,532][123091] Updated weights for policy 0, policy_version 1830729 (0.0009) [2023-12-26 14:12:52,179][123090] Updated weights for policy 1, policy_version 1818793 (0.0009) [2023-12-26 14:12:52,234][123090] Updated weights for policy 1, policy_version 1818803 (0.0008) [2023-12-26 14:12:52,306][123090] Updated weights for policy 1, policy_version 1818813 (0.0010) [2023-12-26 14:12:52,324][123091] Updated weights for policy 0, policy_version 1830739 (0.0008) [2023-12-26 14:12:52,402][123091] Updated weights for policy 0, policy_version 1830749 (0.0006) [2023-12-26 14:12:52,449][123091] Updated weights for policy 0, policy_version 1830759 (0.0005) [2023-12-26 14:12:53,148][123090] Updated weights for policy 1, policy_version 1818823 (0.0008) [2023-12-26 14:12:53,204][123090] Updated weights for policy 1, policy_version 1818833 (0.0005) [2023-12-26 14:12:53,253][123091] Updated weights for policy 0, policy_version 1830769 (0.0010) [2023-12-26 14:12:53,259][123090] Updated weights for policy 1, policy_version 1818843 (0.0007) [2023-12-26 14:12:53,308][123091] Updated weights for policy 0, policy_version 1830779 (0.0008) [2023-12-26 14:12:53,364][123091] Updated weights for policy 0, policy_version 1830789 (0.0006) [2023-12-26 14:12:53,425][123091] Updated weights for policy 0, policy_version 1830799 (0.0007) [2023-12-26 14:12:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 934313984. Throughput: 0: 8880.0, 1: 8905.3. Samples: 934290512. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:12:53,785][121949] Avg episode reward: [(0, '6325.763'), (1, '5832.310')] [2023-12-26 14:12:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001830800_468688896.pth... [2023-12-26 14:12:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001818848_465625088.pth... [2023-12-26 14:12:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001829744_468418560.pth [2023-12-26 14:12:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001817824_465362944.pth [2023-12-26 14:12:54,073][123090] Updated weights for policy 1, policy_version 1818853 (0.0008) [2023-12-26 14:12:54,130][123090] Updated weights for policy 1, policy_version 1818863 (0.0010) [2023-12-26 14:12:54,174][123091] Updated weights for policy 0, policy_version 1830809 (0.0008) [2023-12-26 14:12:54,180][123090] Updated weights for policy 1, policy_version 1818873 (0.0008) [2023-12-26 14:12:54,229][123091] Updated weights for policy 0, policy_version 1830819 (0.0008) [2023-12-26 14:12:54,283][123091] Updated weights for policy 0, policy_version 1830829 (0.0010) [2023-12-26 14:12:55,031][123090] Updated weights for policy 1, policy_version 1818883 (0.0009) [2023-12-26 14:12:55,070][123091] Updated weights for policy 0, policy_version 1830839 (0.0006) [2023-12-26 14:12:55,080][123090] Updated weights for policy 1, policy_version 1818893 (0.0009) [2023-12-26 14:12:55,125][123091] Updated weights for policy 0, policy_version 1830849 (0.0006) [2023-12-26 14:12:55,138][123090] Updated weights for policy 1, policy_version 1818903 (0.0009) [2023-12-26 14:12:55,183][123091] Updated weights for policy 0, policy_version 1830859 (0.0005) [2023-12-26 14:12:55,881][123091] Updated weights for policy 0, policy_version 1830869 (0.0005) [2023-12-26 14:12:55,943][123091] Updated weights for policy 0, policy_version 1830879 (0.0006) [2023-12-26 14:12:55,996][123091] Updated weights for policy 0, policy_version 1830889 (0.0010) [2023-12-26 14:12:56,036][123090] Updated weights for policy 1, policy_version 1818913 (0.0007) [2023-12-26 14:12:56,086][123090] Updated weights for policy 1, policy_version 1818923 (0.0009) [2023-12-26 14:12:56,135][123090] Updated weights for policy 1, policy_version 1818933 (0.0009) [2023-12-26 14:12:56,181][123090] Updated weights for policy 1, policy_version 1818943 (0.0008) [2023-12-26 14:12:56,804][123091] Updated weights for policy 0, policy_version 1830899 (0.0009) [2023-12-26 14:12:56,866][123091] Updated weights for policy 0, policy_version 1830909 (0.0010) [2023-12-26 14:12:56,927][123091] Updated weights for policy 0, policy_version 1830919 (0.0010) [2023-12-26 14:12:57,040][123090] Updated weights for policy 1, policy_version 1818953 (0.0008) [2023-12-26 14:12:57,092][123090] Updated weights for policy 1, policy_version 1818963 (0.0009) [2023-12-26 14:12:57,142][123090] Updated weights for policy 1, policy_version 1818973 (0.0009) [2023-12-26 14:12:57,678][123091] Updated weights for policy 0, policy_version 1830929 (0.0010) [2023-12-26 14:12:57,740][123091] Updated weights for policy 0, policy_version 1830939 (0.0005) [2023-12-26 14:12:57,794][123091] Updated weights for policy 0, policy_version 1830949 (0.0005) [2023-12-26 14:12:57,839][123091] Updated weights for policy 0, policy_version 1830959 (0.0005) [2023-12-26 14:12:58,065][123090] Updated weights for policy 1, policy_version 1818983 (0.0009) [2023-12-26 14:12:58,125][123090] Updated weights for policy 1, policy_version 1818993 (0.0010) [2023-12-26 14:12:58,192][123090] Updated weights for policy 1, policy_version 1819003 (0.0011) [2023-12-26 14:12:58,516][123091] Updated weights for policy 0, policy_version 1830969 (0.0008) [2023-12-26 14:12:58,584][123091] Updated weights for policy 0, policy_version 1830979 (0.0008) [2023-12-26 14:12:58,654][123091] Updated weights for policy 0, policy_version 1830989 (0.0008) [2023-12-26 14:12:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 934404096. Throughput: 0: 8968.3, 1: 8854.1. Samples: 934396148. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:12:58,785][121949] Avg episode reward: [(0, '6283.018'), (1, '5810.147')] [2023-12-26 14:12:59,003][123090] Updated weights for policy 1, policy_version 1819013 (0.0008) [2023-12-26 14:12:59,074][123090] Updated weights for policy 1, policy_version 1819023 (0.0006) [2023-12-26 14:12:59,152][123090] Updated weights for policy 1, policy_version 1819033 (0.0006) [2023-12-26 14:12:59,419][123091] Updated weights for policy 0, policy_version 1830999 (0.0008) [2023-12-26 14:12:59,488][123091] Updated weights for policy 0, policy_version 1831009 (0.0008) [2023-12-26 14:12:59,552][123091] Updated weights for policy 0, policy_version 1831019 (0.0008) [2023-12-26 14:12:59,912][123090] Updated weights for policy 1, policy_version 1819043 (0.0007) [2023-12-26 14:12:59,979][123090] Updated weights for policy 1, policy_version 1819053 (0.0009) [2023-12-26 14:13:00,041][123090] Updated weights for policy 1, policy_version 1819063 (0.0009) [2023-12-26 14:13:00,329][123091] Updated weights for policy 0, policy_version 1831029 (0.0010) [2023-12-26 14:13:00,387][123091] Updated weights for policy 0, policy_version 1831039 (0.0009) [2023-12-26 14:13:00,440][123091] Updated weights for policy 0, policy_version 1831050 (0.0009) [2023-12-26 14:13:00,818][123090] Updated weights for policy 1, policy_version 1819073 (0.0010) [2023-12-26 14:13:00,880][123090] Updated weights for policy 1, policy_version 1819083 (0.0009) [2023-12-26 14:13:00,933][123090] Updated weights for policy 1, policy_version 1819093 (0.0007) [2023-12-26 14:13:00,988][123090] Updated weights for policy 1, policy_version 1819103 (0.0007) [2023-12-26 14:13:01,225][123091] Updated weights for policy 0, policy_version 1831060 (0.0007) [2023-12-26 14:13:01,284][123091] Updated weights for policy 0, policy_version 1831070 (0.0008) [2023-12-26 14:13:01,344][123091] Updated weights for policy 0, policy_version 1831080 (0.0009) [2023-12-26 14:13:01,776][123090] Updated weights for policy 1, policy_version 1819114 (0.0008) [2023-12-26 14:13:01,830][123090] Updated weights for policy 1, policy_version 1819124 (0.0008) [2023-12-26 14:13:01,889][123090] Updated weights for policy 1, policy_version 1819134 (0.0008) [2023-12-26 14:13:02,211][123091] Updated weights for policy 0, policy_version 1831090 (0.0010) [2023-12-26 14:13:02,271][123091] Updated weights for policy 0, policy_version 1831100 (0.0011) [2023-12-26 14:13:02,333][123091] Updated weights for policy 0, policy_version 1831110 (0.0010) [2023-12-26 14:13:02,396][123091] Updated weights for policy 0, policy_version 1831120 (0.0009) [2023-12-26 14:13:02,639][123090] Updated weights for policy 1, policy_version 1819144 (0.0006) [2023-12-26 14:13:02,700][123090] Updated weights for policy 1, policy_version 1819154 (0.0005) [2023-12-26 14:13:02,766][123090] Updated weights for policy 1, policy_version 1819164 (0.0005) [2023-12-26 14:13:03,191][123091] Updated weights for policy 0, policy_version 1831130 (0.0010) [2023-12-26 14:13:03,235][123091] Updated weights for policy 0, policy_version 1831140 (0.0010) [2023-12-26 14:13:03,281][123091] Updated weights for policy 0, policy_version 1831150 (0.0010) [2023-12-26 14:13:03,457][123090] Updated weights for policy 1, policy_version 1819174 (0.0005) [2023-12-26 14:13:03,504][123090] Updated weights for policy 1, policy_version 1819184 (0.0005) [2023-12-26 14:13:03,552][123090] Updated weights for policy 1, policy_version 1819194 (0.0005) [2023-12-26 14:13:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 934494208. Throughput: 0: 8880.3, 1: 8861.7. Samples: 934504052. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:03,785][121949] Avg episode reward: [(0, '6333.985'), (1, '5984.312')] [2023-12-26 14:13:04,145][123091] Updated weights for policy 0, policy_version 1831160 (0.0010) [2023-12-26 14:13:04,214][123091] Updated weights for policy 0, policy_version 1831170 (0.0007) [2023-12-26 14:13:04,268][123090] Updated weights for policy 1, policy_version 1819204 (0.0007) [2023-12-26 14:13:04,274][123091] Updated weights for policy 0, policy_version 1831180 (0.0005) [2023-12-26 14:13:04,323][123090] Updated weights for policy 1, policy_version 1819214 (0.0009) [2023-12-26 14:13:04,382][123090] Updated weights for policy 1, policy_version 1819224 (0.0009) [2023-12-26 14:13:05,116][123091] Updated weights for policy 0, policy_version 1831190 (0.0005) [2023-12-26 14:13:05,179][123091] Updated weights for policy 0, policy_version 1831200 (0.0009) [2023-12-26 14:13:05,219][123090] Updated weights for policy 1, policy_version 1819234 (0.0008) [2023-12-26 14:13:05,226][123091] Updated weights for policy 0, policy_version 1831210 (0.0007) [2023-12-26 14:13:05,271][123090] Updated weights for policy 1, policy_version 1819244 (0.0011) [2023-12-26 14:13:05,314][123090] Updated weights for policy 1, policy_version 1819254 (0.0010) [2023-12-26 14:13:05,363][123090] Updated weights for policy 1, policy_version 1819264 (0.0006) [2023-12-26 14:13:05,960][123091] Updated weights for policy 0, policy_version 1831220 (0.0009) [2023-12-26 14:13:05,996][123090] Updated weights for policy 1, policy_version 1819274 (0.0005) [2023-12-26 14:13:06,018][123091] Updated weights for policy 0, policy_version 1831231 (0.0010) [2023-12-26 14:13:06,051][123090] Updated weights for policy 1, policy_version 1819284 (0.0005) [2023-12-26 14:13:06,076][123091] Updated weights for policy 0, policy_version 1831241 (0.0009) [2023-12-26 14:13:06,116][123090] Updated weights for policy 1, policy_version 1819294 (0.0006) [2023-12-26 14:13:06,698][123090] Updated weights for policy 1, policy_version 1819304 (0.0010) [2023-12-26 14:13:06,762][123090] Updated weights for policy 1, policy_version 1819314 (0.0011) [2023-12-26 14:13:06,826][123090] Updated weights for policy 1, policy_version 1819324 (0.0011) [2023-12-26 14:13:07,021][123091] Updated weights for policy 0, policy_version 1831251 (0.0007) [2023-12-26 14:13:07,077][123091] Updated weights for policy 0, policy_version 1831261 (0.0006) [2023-12-26 14:13:07,127][123091] Updated weights for policy 0, policy_version 1831271 (0.0005) [2023-12-26 14:13:07,536][123090] Updated weights for policy 1, policy_version 1819334 (0.0007) [2023-12-26 14:13:07,612][123090] Updated weights for policy 1, policy_version 1819344 (0.0006) [2023-12-26 14:13:07,690][123090] Updated weights for policy 1, policy_version 1819354 (0.0005) [2023-12-26 14:13:07,925][123091] Updated weights for policy 0, policy_version 1831281 (0.0005) [2023-12-26 14:13:07,979][123091] Updated weights for policy 0, policy_version 1831291 (0.0005) [2023-12-26 14:13:08,036][123091] Updated weights for policy 0, policy_version 1831301 (0.0005) [2023-12-26 14:13:08,084][123091] Updated weights for policy 0, policy_version 1831311 (0.0005) [2023-12-26 14:13:08,355][123090] Updated weights for policy 1, policy_version 1819364 (0.0007) [2023-12-26 14:13:08,419][123090] Updated weights for policy 1, policy_version 1819374 (0.0009) [2023-12-26 14:13:08,476][123090] Updated weights for policy 1, policy_version 1819384 (0.0010) [2023-12-26 14:13:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 934584320. Throughput: 0: 8890.5, 1: 8933.6. Samples: 934558440. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:08,785][121949] Avg episode reward: [(0, '6343.996'), (1, '5971.994')] [2023-12-26 14:13:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001819392_465764352.pth... [2023-12-26 14:13:08,793][123091] Updated weights for policy 0, policy_version 1831321 (0.0008) [2023-12-26 14:13:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001818336_465494016.pth [2023-12-26 14:13:08,847][123091] Updated weights for policy 0, policy_version 1831331 (0.0010) [2023-12-26 14:13:08,904][123091] Updated weights for policy 0, policy_version 1831341 (0.0009) [2023-12-26 14:13:08,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001831344_468828160.pth... [2023-12-26 14:13:08,921][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001830288_468557824.pth [2023-12-26 14:13:09,234][123090] Updated weights for policy 1, policy_version 1819394 (0.0009) [2023-12-26 14:13:09,288][123090] Updated weights for policy 1, policy_version 1819404 (0.0010) [2023-12-26 14:13:09,346][123090] Updated weights for policy 1, policy_version 1819414 (0.0009) [2023-12-26 14:13:09,436][123090] Updated weights for policy 1, policy_version 1819424 (0.0009) [2023-12-26 14:13:09,781][123091] Updated weights for policy 0, policy_version 1831351 (0.0007) [2023-12-26 14:13:09,860][123091] Updated weights for policy 0, policy_version 1831361 (0.0007) [2023-12-26 14:13:09,932][123091] Updated weights for policy 0, policy_version 1831371 (0.0009) [2023-12-26 14:13:10,300][123090] Updated weights for policy 1, policy_version 1819434 (0.0010) [2023-12-26 14:13:10,358][123090] Updated weights for policy 1, policy_version 1819444 (0.0009) [2023-12-26 14:13:10,414][123090] Updated weights for policy 1, policy_version 1819454 (0.0010) [2023-12-26 14:13:10,672][123091] Updated weights for policy 0, policy_version 1831381 (0.0008) [2023-12-26 14:13:10,729][123091] Updated weights for policy 0, policy_version 1831391 (0.0010) [2023-12-26 14:13:10,780][123091] Updated weights for policy 0, policy_version 1831401 (0.0009) [2023-12-26 14:13:11,317][123090] Updated weights for policy 1, policy_version 1819464 (0.0010) [2023-12-26 14:13:11,389][123090] Updated weights for policy 1, policy_version 1819474 (0.0009) [2023-12-26 14:13:11,458][123090] Updated weights for policy 1, policy_version 1819484 (0.0009) [2023-12-26 14:13:11,708][123091] Updated weights for policy 0, policy_version 1831411 (0.0009) [2023-12-26 14:13:11,776][123091] Updated weights for policy 0, policy_version 1831421 (0.0007) [2023-12-26 14:13:11,844][123091] Updated weights for policy 0, policy_version 1831431 (0.0007) [2023-12-26 14:13:12,257][123090] Updated weights for policy 1, policy_version 1819494 (0.0007) [2023-12-26 14:13:12,325][123090] Updated weights for policy 1, policy_version 1819504 (0.0008) [2023-12-26 14:13:12,400][123090] Updated weights for policy 1, policy_version 1819514 (0.0008) [2023-12-26 14:13:12,690][123091] Updated weights for policy 0, policy_version 1831441 (0.0009) [2023-12-26 14:13:12,751][123091] Updated weights for policy 0, policy_version 1831451 (0.0009) [2023-12-26 14:13:12,815][123091] Updated weights for policy 0, policy_version 1831461 (0.0009) [2023-12-26 14:13:12,875][123091] Updated weights for policy 0, policy_version 1831471 (0.0010) [2023-12-26 14:13:13,113][123090] Updated weights for policy 1, policy_version 1819524 (0.0007) [2023-12-26 14:13:13,162][123090] Updated weights for policy 1, policy_version 1819534 (0.0005) [2023-12-26 14:13:13,214][123090] Updated weights for policy 1, policy_version 1819544 (0.0005) [2023-12-26 14:13:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 934666240. Throughput: 0: 8928.1, 1: 8958.9. Samples: 934664728. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:13,785][121949] Avg episode reward: [(0, '6360.418'), (1, '5741.039')] [2023-12-26 14:13:13,823][123091] Updated weights for policy 0, policy_version 1831481 (0.0010) [2023-12-26 14:13:13,829][123090] Updated weights for policy 1, policy_version 1819554 (0.0005) [2023-12-26 14:13:13,875][123090] Updated weights for policy 1, policy_version 1819564 (0.0005) [2023-12-26 14:13:13,881][123091] Updated weights for policy 0, policy_version 1831491 (0.0009) [2023-12-26 14:13:13,928][123090] Updated weights for policy 1, policy_version 1819574 (0.0005) [2023-12-26 14:13:13,938][123091] Updated weights for policy 0, policy_version 1831501 (0.0009) [2023-12-26 14:13:13,976][123090] Updated weights for policy 1, policy_version 1819584 (0.0005) [2023-12-26 14:13:14,756][123090] Updated weights for policy 1, policy_version 1819594 (0.0006) [2023-12-26 14:13:14,827][123090] Updated weights for policy 1, policy_version 1819604 (0.0008) [2023-12-26 14:13:14,835][123091] Updated weights for policy 0, policy_version 1831511 (0.0010) [2023-12-26 14:13:14,884][123090] Updated weights for policy 1, policy_version 1819614 (0.0007) [2023-12-26 14:13:14,900][123091] Updated weights for policy 0, policy_version 1831521 (0.0007) [2023-12-26 14:13:14,968][123091] Updated weights for policy 0, policy_version 1831531 (0.0009) [2023-12-26 14:13:15,658][123090] Updated weights for policy 1, policy_version 1819624 (0.0010) [2023-12-26 14:13:15,730][123090] Updated weights for policy 1, policy_version 1819634 (0.0009) [2023-12-26 14:13:15,770][123091] Updated weights for policy 0, policy_version 1831541 (0.0007) [2023-12-26 14:13:15,797][123090] Updated weights for policy 1, policy_version 1819644 (0.0010) [2023-12-26 14:13:15,837][123091] Updated weights for policy 0, policy_version 1831551 (0.0008) [2023-12-26 14:13:15,906][123091] Updated weights for policy 0, policy_version 1831561 (0.0010) [2023-12-26 14:13:16,548][123090] Updated weights for policy 1, policy_version 1819654 (0.0007) [2023-12-26 14:13:16,621][123090] Updated weights for policy 1, policy_version 1819664 (0.0005) [2023-12-26 14:13:16,688][123090] Updated weights for policy 1, policy_version 1819674 (0.0006) [2023-12-26 14:13:16,800][123091] Updated weights for policy 0, policy_version 1831571 (0.0010) [2023-12-26 14:13:16,859][123091] Updated weights for policy 0, policy_version 1831581 (0.0010) [2023-12-26 14:13:16,915][123091] Updated weights for policy 0, policy_version 1831591 (0.0010) [2023-12-26 14:13:17,408][123090] Updated weights for policy 1, policy_version 1819684 (0.0007) [2023-12-26 14:13:17,469][123090] Updated weights for policy 1, policy_version 1819694 (0.0010) [2023-12-26 14:13:17,535][123090] Updated weights for policy 1, policy_version 1819704 (0.0010) [2023-12-26 14:13:17,763][123091] Updated weights for policy 0, policy_version 1831601 (0.0009) [2023-12-26 14:13:17,818][123091] Updated weights for policy 0, policy_version 1831611 (0.0011) [2023-12-26 14:13:17,873][123091] Updated weights for policy 0, policy_version 1831623 (0.0011) [2023-12-26 14:13:18,203][123090] Updated weights for policy 1, policy_version 1819714 (0.0010) [2023-12-26 14:13:18,247][123090] Updated weights for policy 1, policy_version 1819724 (0.0010) [2023-12-26 14:13:18,302][123090] Updated weights for policy 1, policy_version 1819734 (0.0010) [2023-12-26 14:13:18,358][123090] Updated weights for policy 1, policy_version 1819744 (0.0010) [2023-12-26 14:13:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 934756352. Throughput: 0: 8810.0, 1: 9023.8. Samples: 934770548. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:18,785][121949] Avg episode reward: [(0, '6307.529'), (1, '5854.955')] [2023-12-26 14:13:18,792][123091] Updated weights for policy 0, policy_version 1831633 (0.0010) [2023-12-26 14:13:18,852][123091] Updated weights for policy 0, policy_version 1831643 (0.0010) [2023-12-26 14:13:18,907][123091] Updated weights for policy 0, policy_version 1831653 (0.0010) [2023-12-26 14:13:18,967][123091] Updated weights for policy 0, policy_version 1831663 (0.0011) [2023-12-26 14:13:19,153][123090] Updated weights for policy 1, policy_version 1819754 (0.0006) [2023-12-26 14:13:19,208][123090] Updated weights for policy 1, policy_version 1819764 (0.0010) [2023-12-26 14:13:19,276][123090] Updated weights for policy 1, policy_version 1819774 (0.0011) [2023-12-26 14:13:19,844][123091] Updated weights for policy 0, policy_version 1831673 (0.0010) [2023-12-26 14:13:19,909][123091] Updated weights for policy 0, policy_version 1831683 (0.0010) [2023-12-26 14:13:19,980][123091] Updated weights for policy 0, policy_version 1831693 (0.0010) [2023-12-26 14:13:20,097][123090] Updated weights for policy 1, policy_version 1819784 (0.0009) [2023-12-26 14:13:20,156][123090] Updated weights for policy 1, policy_version 1819794 (0.0009) [2023-12-26 14:13:20,218][123090] Updated weights for policy 1, policy_version 1819804 (0.0009) [2023-12-26 14:13:20,689][123091] Updated weights for policy 0, policy_version 1831703 (0.0007) [2023-12-26 14:13:20,755][123091] Updated weights for policy 0, policy_version 1831713 (0.0006) [2023-12-26 14:13:20,810][123091] Updated weights for policy 0, policy_version 1831723 (0.0006) [2023-12-26 14:13:21,146][123090] Updated weights for policy 1, policy_version 1819815 (0.0010) [2023-12-26 14:13:21,209][123090] Updated weights for policy 1, policy_version 1819825 (0.0010) [2023-12-26 14:13:21,269][123090] Updated weights for policy 1, policy_version 1819835 (0.0009) [2023-12-26 14:13:21,589][123091] Updated weights for policy 0, policy_version 1831733 (0.0009) [2023-12-26 14:13:21,658][123091] Updated weights for policy 0, policy_version 1831743 (0.0009) [2023-12-26 14:13:21,724][123091] Updated weights for policy 0, policy_version 1831753 (0.0008) [2023-12-26 14:13:22,196][123090] Updated weights for policy 1, policy_version 1819845 (0.0010) [2023-12-26 14:13:22,272][123090] Updated weights for policy 1, policy_version 1819855 (0.0011) [2023-12-26 14:13:22,340][123090] Updated weights for policy 1, policy_version 1819865 (0.0011) [2023-12-26 14:13:22,569][123091] Updated weights for policy 0, policy_version 1831763 (0.0009) [2023-12-26 14:13:22,639][123091] Updated weights for policy 0, policy_version 1831773 (0.0009) [2023-12-26 14:13:22,707][123091] Updated weights for policy 0, policy_version 1831783 (0.0009) [2023-12-26 14:13:23,161][123090] Updated weights for policy 1, policy_version 1819875 (0.0011) [2023-12-26 14:13:23,216][123090] Updated weights for policy 1, policy_version 1819885 (0.0010) [2023-12-26 14:13:23,271][123090] Updated weights for policy 1, policy_version 1819895 (0.0010) [2023-12-26 14:13:23,532][123091] Updated weights for policy 0, policy_version 1831793 (0.0009) [2023-12-26 14:13:23,592][123091] Updated weights for policy 0, policy_version 1831803 (0.0009) [2023-12-26 14:13:23,640][123091] Updated weights for policy 0, policy_version 1831813 (0.0009) [2023-12-26 14:13:23,692][123091] Updated weights for policy 0, policy_version 1831823 (0.0009) [2023-12-26 14:13:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 934846464. Throughput: 0: 8778.8, 1: 8974.0. Samples: 934821680. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:23,784][121949] Avg episode reward: [(0, '6293.408'), (1, '6004.465')] [2023-12-26 14:13:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001831824_468951040.pth... [2023-12-26 14:13:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001819904_465895424.pth... [2023-12-26 14:13:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001818848_465625088.pth [2023-12-26 14:13:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001830800_468688896.pth [2023-12-26 14:13:24,114][123090] Updated weights for policy 1, policy_version 1819905 (0.0010) [2023-12-26 14:13:24,177][123090] Updated weights for policy 1, policy_version 1819915 (0.0011) [2023-12-26 14:13:24,241][123090] Updated weights for policy 1, policy_version 1819925 (0.0011) [2023-12-26 14:13:24,303][123090] Updated weights for policy 1, policy_version 1819935 (0.0006) [2023-12-26 14:13:24,496][123091] Updated weights for policy 0, policy_version 1831833 (0.0006) [2023-12-26 14:13:24,569][123091] Updated weights for policy 0, policy_version 1831843 (0.0006) [2023-12-26 14:13:24,646][123091] Updated weights for policy 0, policy_version 1831853 (0.0005) [2023-12-26 14:13:25,031][123090] Updated weights for policy 1, policy_version 1819945 (0.0010) [2023-12-26 14:13:25,090][123090] Updated weights for policy 1, policy_version 1819955 (0.0010) [2023-12-26 14:13:25,141][123090] Updated weights for policy 1, policy_version 1819965 (0.0010) [2023-12-26 14:13:25,413][123091] Updated weights for policy 0, policy_version 1831863 (0.0009) [2023-12-26 14:13:25,461][123091] Updated weights for policy 0, policy_version 1831873 (0.0010) [2023-12-26 14:13:25,519][123091] Updated weights for policy 0, policy_version 1831883 (0.0010) [2023-12-26 14:13:25,946][123090] Updated weights for policy 1, policy_version 1819975 (0.0010) [2023-12-26 14:13:25,997][123090] Updated weights for policy 1, policy_version 1819985 (0.0010) [2023-12-26 14:13:26,052][123090] Updated weights for policy 1, policy_version 1819995 (0.0010) [2023-12-26 14:13:26,356][123091] Updated weights for policy 0, policy_version 1831893 (0.0010) [2023-12-26 14:13:26,426][123091] Updated weights for policy 0, policy_version 1831903 (0.0011) [2023-12-26 14:13:26,484][123091] Updated weights for policy 0, policy_version 1831913 (0.0010) [2023-12-26 14:13:26,810][123090] Updated weights for policy 1, policy_version 1820005 (0.0008) [2023-12-26 14:13:26,860][123090] Updated weights for policy 1, policy_version 1820015 (0.0005) [2023-12-26 14:13:26,907][123090] Updated weights for policy 1, policy_version 1820025 (0.0005) [2023-12-26 14:13:27,264][123091] Updated weights for policy 0, policy_version 1831923 (0.0009) [2023-12-26 14:13:27,321][123091] Updated weights for policy 0, policy_version 1831933 (0.0005) [2023-12-26 14:13:27,369][123091] Updated weights for policy 0, policy_version 1831943 (0.0005) [2023-12-26 14:13:27,564][123090] Updated weights for policy 1, policy_version 1820035 (0.0007) [2023-12-26 14:13:27,620][123090] Updated weights for policy 1, policy_version 1820045 (0.0010) [2023-12-26 14:13:27,666][123090] Updated weights for policy 1, policy_version 1820055 (0.0010) [2023-12-26 14:13:28,114][123091] Updated weights for policy 0, policy_version 1831953 (0.0006) [2023-12-26 14:13:28,169][123091] Updated weights for policy 0, policy_version 1831963 (0.0009) [2023-12-26 14:13:28,228][123091] Updated weights for policy 0, policy_version 1831973 (0.0005) [2023-12-26 14:13:28,288][123091] Updated weights for policy 0, policy_version 1831983 (0.0007) [2023-12-26 14:13:28,385][123090] Updated weights for policy 1, policy_version 1820065 (0.0010) [2023-12-26 14:13:28,454][123090] Updated weights for policy 1, policy_version 1820075 (0.0010) [2023-12-26 14:13:28,511][123090] Updated weights for policy 1, policy_version 1820085 (0.0011) [2023-12-26 14:13:28,572][123090] Updated weights for policy 1, policy_version 1820095 (0.0010) [2023-12-26 14:13:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 934936576. Throughput: 0: 8801.9, 1: 8975.9. Samples: 934928888. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:28,785][121949] Avg episode reward: [(0, '6305.275'), (1, '5822.877')] [2023-12-26 14:13:29,108][123091] Updated weights for policy 0, policy_version 1831993 (0.0010) [2023-12-26 14:13:29,165][123091] Updated weights for policy 0, policy_version 1832003 (0.0005) [2023-12-26 14:13:29,216][123091] Updated weights for policy 0, policy_version 1832013 (0.0006) [2023-12-26 14:13:29,402][123090] Updated weights for policy 1, policy_version 1820105 (0.0007) [2023-12-26 14:13:29,466][123090] Updated weights for policy 1, policy_version 1820115 (0.0005) [2023-12-26 14:13:29,533][123090] Updated weights for policy 1, policy_version 1820125 (0.0009) [2023-12-26 14:13:29,982][123091] Updated weights for policy 0, policy_version 1832023 (0.0010) [2023-12-26 14:13:30,041][123091] Updated weights for policy 0, policy_version 1832033 (0.0010) [2023-12-26 14:13:30,116][123091] Updated weights for policy 0, policy_version 1832043 (0.0011) [2023-12-26 14:13:30,332][123090] Updated weights for policy 1, policy_version 1820135 (0.0009) [2023-12-26 14:13:30,385][123090] Updated weights for policy 1, policy_version 1820145 (0.0009) [2023-12-26 14:13:30,438][123090] Updated weights for policy 1, policy_version 1820155 (0.0009) [2023-12-26 14:13:30,931][123091] Updated weights for policy 0, policy_version 1832053 (0.0010) [2023-12-26 14:13:30,999][123091] Updated weights for policy 0, policy_version 1832063 (0.0010) [2023-12-26 14:13:31,066][123091] Updated weights for policy 0, policy_version 1832073 (0.0011) [2023-12-26 14:13:31,290][123090] Updated weights for policy 1, policy_version 1820165 (0.0007) [2023-12-26 14:13:31,341][123090] Updated weights for policy 1, policy_version 1820175 (0.0006) [2023-12-26 14:13:31,410][123090] Updated weights for policy 1, policy_version 1820185 (0.0009) [2023-12-26 14:13:31,948][123091] Updated weights for policy 0, policy_version 1832083 (0.0011) [2023-12-26 14:13:32,010][123091] Updated weights for policy 0, policy_version 1832093 (0.0011) [2023-12-26 14:13:32,062][123091] Updated weights for policy 0, policy_version 1832103 (0.0010) [2023-12-26 14:13:32,271][123090] Updated weights for policy 1, policy_version 1820195 (0.0009) [2023-12-26 14:13:32,329][123090] Updated weights for policy 1, policy_version 1820205 (0.0010) [2023-12-26 14:13:32,401][123090] Updated weights for policy 1, policy_version 1820215 (0.0008) [2023-12-26 14:13:32,845][123091] Updated weights for policy 0, policy_version 1832113 (0.0010) [2023-12-26 14:13:32,900][123091] Updated weights for policy 0, policy_version 1832123 (0.0007) [2023-12-26 14:13:32,951][123091] Updated weights for policy 0, policy_version 1832133 (0.0010) [2023-12-26 14:13:33,005][123091] Updated weights for policy 0, policy_version 1832143 (0.0010) [2023-12-26 14:13:33,162][123090] Updated weights for policy 1, policy_version 1820225 (0.0008) [2023-12-26 14:13:33,209][123090] Updated weights for policy 1, policy_version 1820235 (0.0005) [2023-12-26 14:13:33,255][123090] Updated weights for policy 1, policy_version 1820245 (0.0005) [2023-12-26 14:13:33,300][123090] Updated weights for policy 1, policy_version 1820255 (0.0005) [2023-12-26 14:13:33,777][123091] Updated weights for policy 0, policy_version 1832153 (0.0010) [2023-12-26 14:13:33,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935018496. Throughput: 0: 8743.9, 1: 8936.2. Samples: 935034928. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:33,785][121949] Avg episode reward: [(0, '6325.828'), (1, '5685.143')] [2023-12-26 14:13:33,828][123091] Updated weights for policy 0, policy_version 1832163 (0.0010) [2023-12-26 14:13:33,874][123091] Updated weights for policy 0, policy_version 1832173 (0.0010) [2023-12-26 14:13:33,984][123090] Updated weights for policy 1, policy_version 1820265 (0.0005) [2023-12-26 14:13:34,039][123090] Updated weights for policy 1, policy_version 1820275 (0.0005) [2023-12-26 14:13:34,100][123090] Updated weights for policy 1, policy_version 1820285 (0.0005) [2023-12-26 14:13:34,726][123091] Updated weights for policy 0, policy_version 1832183 (0.0008) [2023-12-26 14:13:34,792][123091] Updated weights for policy 0, policy_version 1832193 (0.0010) [2023-12-26 14:13:34,859][123091] Updated weights for policy 0, policy_version 1832203 (0.0010) [2023-12-26 14:13:34,874][123090] Updated weights for policy 1, policy_version 1820295 (0.0007) [2023-12-26 14:13:34,937][123090] Updated weights for policy 1, policy_version 1820305 (0.0009) [2023-12-26 14:13:35,004][123090] Updated weights for policy 1, policy_version 1820315 (0.0009) [2023-12-26 14:13:35,530][123091] Updated weights for policy 0, policy_version 1832213 (0.0008) [2023-12-26 14:13:35,579][123091] Updated weights for policy 0, policy_version 1832223 (0.0010) [2023-12-26 14:13:35,623][123091] Updated weights for policy 0, policy_version 1832233 (0.0010) [2023-12-26 14:13:35,723][123090] Updated weights for policy 1, policy_version 1820325 (0.0009) [2023-12-26 14:13:35,784][123090] Updated weights for policy 1, policy_version 1820335 (0.0010) [2023-12-26 14:13:35,847][123090] Updated weights for policy 1, policy_version 1820345 (0.0009) [2023-12-26 14:13:36,470][123091] Updated weights for policy 0, policy_version 1832243 (0.0010) [2023-12-26 14:13:36,512][123090] Updated weights for policy 1, policy_version 1820355 (0.0006) [2023-12-26 14:13:36,538][123091] Updated weights for policy 0, policy_version 1832253 (0.0008) [2023-12-26 14:13:36,572][123090] Updated weights for policy 1, policy_version 1820365 (0.0006) [2023-12-26 14:13:36,609][123091] Updated weights for policy 0, policy_version 1832263 (0.0006) [2023-12-26 14:13:36,640][123090] Updated weights for policy 1, policy_version 1820375 (0.0006) [2023-12-26 14:13:37,200][123091] Updated weights for policy 0, policy_version 1832273 (0.0005) [2023-12-26 14:13:37,265][123091] Updated weights for policy 0, policy_version 1832283 (0.0007) [2023-12-26 14:13:37,330][123091] Updated weights for policy 0, policy_version 1832293 (0.0008) [2023-12-26 14:13:37,351][123090] Updated weights for policy 1, policy_version 1820385 (0.0007) [2023-12-26 14:13:37,395][123091] Updated weights for policy 0, policy_version 1832303 (0.0008) [2023-12-26 14:13:37,419][123090] Updated weights for policy 1, policy_version 1820395 (0.0011) [2023-12-26 14:13:37,497][123090] Updated weights for policy 1, policy_version 1820405 (0.0011) [2023-12-26 14:13:37,569][123090] Updated weights for policy 1, policy_version 1820415 (0.0011) [2023-12-26 14:13:38,160][123091] Updated weights for policy 0, policy_version 1832313 (0.0005) [2023-12-26 14:13:38,222][123090] Updated weights for policy 1, policy_version 1820425 (0.0006) [2023-12-26 14:13:38,227][123091] Updated weights for policy 0, policy_version 1832323 (0.0006) [2023-12-26 14:13:38,274][123091] Updated weights for policy 0, policy_version 1832333 (0.0010) [2023-12-26 14:13:38,283][123090] Updated weights for policy 1, policy_version 1820435 (0.0005) [2023-12-26 14:13:38,356][123090] Updated weights for policy 1, policy_version 1820445 (0.0007) [2023-12-26 14:13:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 935116800. Throughput: 0: 8753.0, 1: 9029.4. Samples: 935090716. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:38,785][121949] Avg episode reward: [(0, '6341.317'), (1, '5591.269')] [2023-12-26 14:13:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001832336_469082112.pth... [2023-12-26 14:13:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001820448_466034688.pth... [2023-12-26 14:13:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001831344_468828160.pth [2023-12-26 14:13:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001819392_465764352.pth [2023-12-26 14:13:39,029][123090] Updated weights for policy 1, policy_version 1820455 (0.0009) [2023-12-26 14:13:39,045][123091] Updated weights for policy 0, policy_version 1832343 (0.0010) [2023-12-26 14:13:39,093][123090] Updated weights for policy 1, policy_version 1820465 (0.0005) [2023-12-26 14:13:39,107][123091] Updated weights for policy 0, policy_version 1832353 (0.0010) [2023-12-26 14:13:39,158][123090] Updated weights for policy 1, policy_version 1820475 (0.0010) [2023-12-26 14:13:39,158][123091] Updated weights for policy 0, policy_version 1832363 (0.0010) [2023-12-26 14:13:40,002][123090] Updated weights for policy 1, policy_version 1820485 (0.0009) [2023-12-26 14:13:40,037][123091] Updated weights for policy 0, policy_version 1832373 (0.0009) [2023-12-26 14:13:40,058][123090] Updated weights for policy 1, policy_version 1820495 (0.0008) [2023-12-26 14:13:40,102][123091] Updated weights for policy 0, policy_version 1832383 (0.0009) [2023-12-26 14:13:40,113][123090] Updated weights for policy 1, policy_version 1820505 (0.0009) [2023-12-26 14:13:40,164][123091] Updated weights for policy 0, policy_version 1832393 (0.0007) [2023-12-26 14:13:40,908][123090] Updated weights for policy 1, policy_version 1820515 (0.0009) [2023-12-26 14:13:40,981][123090] Updated weights for policy 1, policy_version 1820525 (0.0006) [2023-12-26 14:13:41,006][123091] Updated weights for policy 0, policy_version 1832403 (0.0010) [2023-12-26 14:13:41,054][123090] Updated weights for policy 1, policy_version 1820535 (0.0007) [2023-12-26 14:13:41,078][123091] Updated weights for policy 0, policy_version 1832413 (0.0011) [2023-12-26 14:13:41,149][123091] Updated weights for policy 0, policy_version 1832423 (0.0010) [2023-12-26 14:13:41,881][123090] Updated weights for policy 1, policy_version 1820545 (0.0007) [2023-12-26 14:13:41,949][123090] Updated weights for policy 1, policy_version 1820555 (0.0009) [2023-12-26 14:13:41,991][123091] Updated weights for policy 0, policy_version 1832433 (0.0009) [2023-12-26 14:13:42,013][123090] Updated weights for policy 1, policy_version 1820565 (0.0008) [2023-12-26 14:13:42,057][123091] Updated weights for policy 0, policy_version 1832443 (0.0011) [2023-12-26 14:13:42,070][123090] Updated weights for policy 1, policy_version 1820575 (0.0009) [2023-12-26 14:13:42,127][123091] Updated weights for policy 0, policy_version 1832453 (0.0010) [2023-12-26 14:13:42,193][123091] Updated weights for policy 0, policy_version 1832463 (0.0009) [2023-12-26 14:13:42,806][123090] Updated weights for policy 1, policy_version 1820585 (0.0006) [2023-12-26 14:13:42,871][123090] Updated weights for policy 1, policy_version 1820595 (0.0009) [2023-12-26 14:13:42,929][123090] Updated weights for policy 1, policy_version 1820605 (0.0009) [2023-12-26 14:13:43,061][123091] Updated weights for policy 0, policy_version 1832473 (0.0009) [2023-12-26 14:13:43,112][123091] Updated weights for policy 0, policy_version 1832483 (0.0007) [2023-12-26 14:13:43,173][123091] Updated weights for policy 0, policy_version 1832493 (0.0008) [2023-12-26 14:13:43,664][123090] Updated weights for policy 1, policy_version 1820615 (0.0006) [2023-12-26 14:13:43,711][123090] Updated weights for policy 1, policy_version 1820625 (0.0005) [2023-12-26 14:13:43,773][123090] Updated weights for policy 1, policy_version 1820635 (0.0006) [2023-12-26 14:13:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935198720. Throughput: 0: 8677.6, 1: 9128.1. Samples: 935197404. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:43,785][121949] Avg episode reward: [(0, '6265.721'), (1, '5496.585')] [2023-12-26 14:13:44,039][123091] Updated weights for policy 0, policy_version 1832503 (0.0009) [2023-12-26 14:13:44,090][123091] Updated weights for policy 0, policy_version 1832513 (0.0008) [2023-12-26 14:13:44,143][123091] Updated weights for policy 0, policy_version 1832523 (0.0009) [2023-12-26 14:13:44,505][123090] Updated weights for policy 1, policy_version 1820645 (0.0005) [2023-12-26 14:13:44,563][123090] Updated weights for policy 1, policy_version 1820655 (0.0010) [2023-12-26 14:13:44,625][123090] Updated weights for policy 1, policy_version 1820665 (0.0010) [2023-12-26 14:13:45,019][123091] Updated weights for policy 0, policy_version 1832533 (0.0008) [2023-12-26 14:13:45,069][123091] Updated weights for policy 0, policy_version 1832543 (0.0009) [2023-12-26 14:13:45,118][123091] Updated weights for policy 0, policy_version 1832553 (0.0009) [2023-12-26 14:13:45,464][123090] Updated weights for policy 1, policy_version 1820675 (0.0009) [2023-12-26 14:13:45,530][123090] Updated weights for policy 1, policy_version 1820685 (0.0005) [2023-12-26 14:13:45,598][123090] Updated weights for policy 1, policy_version 1820695 (0.0009) [2023-12-26 14:13:45,872][123091] Updated weights for policy 0, policy_version 1832563 (0.0008) [2023-12-26 14:13:45,931][123091] Updated weights for policy 0, policy_version 1832573 (0.0006) [2023-12-26 14:13:45,987][123091] Updated weights for policy 0, policy_version 1832583 (0.0006) [2023-12-26 14:13:46,389][123090] Updated weights for policy 1, policy_version 1820705 (0.0010) [2023-12-26 14:13:46,444][123090] Updated weights for policy 1, policy_version 1820715 (0.0010) [2023-12-26 14:13:46,510][123090] Updated weights for policy 1, policy_version 1820725 (0.0010) [2023-12-26 14:13:46,579][123090] Updated weights for policy 1, policy_version 1820735 (0.0010) [2023-12-26 14:13:46,692][123091] Updated weights for policy 0, policy_version 1832593 (0.0006) [2023-12-26 14:13:46,744][123091] Updated weights for policy 0, policy_version 1832603 (0.0010) [2023-12-26 14:13:46,800][123091] Updated weights for policy 0, policy_version 1832613 (0.0010) [2023-12-26 14:13:46,856][123091] Updated weights for policy 0, policy_version 1832623 (0.0010) [2023-12-26 14:13:47,406][123090] Updated weights for policy 1, policy_version 1820745 (0.0010) [2023-12-26 14:13:47,468][123090] Updated weights for policy 1, policy_version 1820755 (0.0010) [2023-12-26 14:13:47,529][123090] Updated weights for policy 1, policy_version 1820765 (0.0010) [2023-12-26 14:13:47,687][123091] Updated weights for policy 0, policy_version 1832633 (0.0009) [2023-12-26 14:13:47,740][123091] Updated weights for policy 0, policy_version 1832643 (0.0008) [2023-12-26 14:13:47,789][123091] Updated weights for policy 0, policy_version 1832653 (0.0009) [2023-12-26 14:13:48,325][123090] Updated weights for policy 1, policy_version 1820775 (0.0009) [2023-12-26 14:13:48,393][123090] Updated weights for policy 1, policy_version 1820785 (0.0006) [2023-12-26 14:13:48,453][123090] Updated weights for policy 1, policy_version 1820795 (0.0007) [2023-12-26 14:13:48,693][123091] Updated weights for policy 0, policy_version 1832663 (0.0010) [2023-12-26 14:13:48,768][123091] Updated weights for policy 0, policy_version 1832673 (0.0010) [2023-12-26 14:13:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 935288832. Throughput: 0: 8655.4, 1: 9114.3. Samples: 935303692. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:48,785][121949] Avg episode reward: [(0, '6270.804'), (1, '5620.327')] [2023-12-26 14:13:48,840][123091] Updated weights for policy 0, policy_version 1832683 (0.0010) [2023-12-26 14:13:49,069][123090] Updated weights for policy 1, policy_version 1820805 (0.0008) [2023-12-26 14:13:49,115][123090] Updated weights for policy 1, policy_version 1820815 (0.0005) [2023-12-26 14:13:49,165][123090] Updated weights for policy 1, policy_version 1820825 (0.0005) [2023-12-26 14:13:49,673][123091] Updated weights for policy 0, policy_version 1832693 (0.0009) [2023-12-26 14:13:49,738][123091] Updated weights for policy 0, policy_version 1832703 (0.0008) [2023-12-26 14:13:49,809][123091] Updated weights for policy 0, policy_version 1832713 (0.0006) [2023-12-26 14:13:49,981][123090] Updated weights for policy 1, policy_version 1820835 (0.0006) [2023-12-26 14:13:50,045][123090] Updated weights for policy 1, policy_version 1820845 (0.0009) [2023-12-26 14:13:50,105][123090] Updated weights for policy 1, policy_version 1820855 (0.0009) [2023-12-26 14:13:50,612][123091] Updated weights for policy 0, policy_version 1832723 (0.0009) [2023-12-26 14:13:50,670][123091] Updated weights for policy 0, policy_version 1832733 (0.0006) [2023-12-26 14:13:50,730][123091] Updated weights for policy 0, policy_version 1832743 (0.0006) [2023-12-26 14:13:50,917][123090] Updated weights for policy 1, policy_version 1820865 (0.0008) [2023-12-26 14:13:50,979][123090] Updated weights for policy 1, policy_version 1820875 (0.0010) [2023-12-26 14:13:51,050][123090] Updated weights for policy 1, policy_version 1820885 (0.0008) [2023-12-26 14:13:51,116][123090] Updated weights for policy 1, policy_version 1820895 (0.0010) [2023-12-26 14:13:51,523][123091] Updated weights for policy 0, policy_version 1832753 (0.0007) [2023-12-26 14:13:51,577][123091] Updated weights for policy 0, policy_version 1832763 (0.0010) [2023-12-26 14:13:51,634][123091] Updated weights for policy 0, policy_version 1832773 (0.0010) [2023-12-26 14:13:51,697][123091] Updated weights for policy 0, policy_version 1832783 (0.0010) [2023-12-26 14:13:51,958][123090] Updated weights for policy 1, policy_version 1820905 (0.0009) [2023-12-26 14:13:52,024][123090] Updated weights for policy 1, policy_version 1820915 (0.0010) [2023-12-26 14:13:52,082][123090] Updated weights for policy 1, policy_version 1820925 (0.0009) [2023-12-26 14:13:52,488][123091] Updated weights for policy 0, policy_version 1832793 (0.0011) [2023-12-26 14:13:52,547][123091] Updated weights for policy 0, policy_version 1832803 (0.0011) [2023-12-26 14:13:52,611][123091] Updated weights for policy 0, policy_version 1832813 (0.0011) [2023-12-26 14:13:52,910][123090] Updated weights for policy 1, policy_version 1820935 (0.0008) [2023-12-26 14:13:52,977][123090] Updated weights for policy 1, policy_version 1820945 (0.0008) [2023-12-26 14:13:53,033][123090] Updated weights for policy 1, policy_version 1820955 (0.0009) [2023-12-26 14:13:53,411][123091] Updated weights for policy 0, policy_version 1832823 (0.0011) [2023-12-26 14:13:53,474][123091] Updated weights for policy 0, policy_version 1832833 (0.0011) [2023-12-26 14:13:53,537][123091] Updated weights for policy 0, policy_version 1832843 (0.0011) [2023-12-26 14:13:53,762][123090] Updated weights for policy 1, policy_version 1820966 (0.0007) [2023-12-26 14:13:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935378944. Throughput: 0: 8649.3, 1: 9075.1. Samples: 935356040. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:53,786][121949] Avg episode reward: [(0, '6239.270'), (1, '5801.553')] [2023-12-26 14:13:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001832848_469213184.pth... [2023-12-26 14:13:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001831824_468951040.pth [2023-12-26 14:13:53,798][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001832848_469213184.pth [2023-12-26 14:13:53,829][123090] Updated weights for policy 1, policy_version 1820976 (0.0005) [2023-12-26 14:13:53,894][123090] Updated weights for policy 1, policy_version 1820986 (0.0007) [2023-12-26 14:13:53,926][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001820992_466173952.pth... [2023-12-26 14:13:53,929][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001819904_465895424.pth [2023-12-26 14:13:53,929][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001820992_466173952.pth [2023-12-26 14:13:54,203][123091] Updated weights for policy 0, policy_version 1832853 (0.0008) [2023-12-26 14:13:54,263][123091] Updated weights for policy 0, policy_version 1832863 (0.0005) [2023-12-26 14:13:54,313][123091] Updated weights for policy 0, policy_version 1832873 (0.0005) [2023-12-26 14:13:54,589][123090] Updated weights for policy 1, policy_version 1820996 (0.0008) [2023-12-26 14:13:54,641][123090] Updated weights for policy 1, policy_version 1821006 (0.0010) [2023-12-26 14:13:54,694][123090] Updated weights for policy 1, policy_version 1821016 (0.0007) [2023-12-26 14:13:54,965][123091] Updated weights for policy 0, policy_version 1832883 (0.0007) [2023-12-26 14:13:55,029][123091] Updated weights for policy 0, policy_version 1832893 (0.0010) [2023-12-26 14:13:55,081][123091] Updated weights for policy 0, policy_version 1832903 (0.0011) [2023-12-26 14:13:55,447][123090] Updated weights for policy 1, policy_version 1821026 (0.0006) [2023-12-26 14:13:55,508][123090] Updated weights for policy 1, policy_version 1821036 (0.0010) [2023-12-26 14:13:55,559][123090] Updated weights for policy 1, policy_version 1821046 (0.0010) [2023-12-26 14:13:55,613][123090] Updated weights for policy 1, policy_version 1821056 (0.0010) [2023-12-26 14:13:55,908][123091] Updated weights for policy 0, policy_version 1832913 (0.0010) [2023-12-26 14:13:55,957][123091] Updated weights for policy 0, policy_version 1832923 (0.0005) [2023-12-26 14:13:56,016][123091] Updated weights for policy 0, policy_version 1832933 (0.0006) [2023-12-26 14:13:56,073][123091] Updated weights for policy 0, policy_version 1832943 (0.0005) [2023-12-26 14:13:56,402][123090] Updated weights for policy 1, policy_version 1821066 (0.0006) [2023-12-26 14:13:56,470][123090] Updated weights for policy 1, policy_version 1821076 (0.0005) [2023-12-26 14:13:56,544][123090] Updated weights for policy 1, policy_version 1821086 (0.0006) [2023-12-26 14:13:56,844][123091] Updated weights for policy 0, policy_version 1832953 (0.0010) [2023-12-26 14:13:56,892][123091] Updated weights for policy 0, policy_version 1832963 (0.0010) [2023-12-26 14:13:56,938][123091] Updated weights for policy 0, policy_version 1832973 (0.0010) [2023-12-26 14:13:57,175][123090] Updated weights for policy 1, policy_version 1821096 (0.0008) [2023-12-26 14:13:57,234][123090] Updated weights for policy 1, policy_version 1821106 (0.0009) [2023-12-26 14:13:57,294][123090] Updated weights for policy 1, policy_version 1821116 (0.0010) [2023-12-26 14:13:57,760][123091] Updated weights for policy 0, policy_version 1832983 (0.0010) [2023-12-26 14:13:57,802][123091] Updated weights for policy 0, policy_version 1832993 (0.0006) [2023-12-26 14:13:57,847][123091] Updated weights for policy 0, policy_version 1833003 (0.0005) [2023-12-26 14:13:58,090][123090] Updated weights for policy 1, policy_version 1821127 (0.0010) [2023-12-26 14:13:58,153][123090] Updated weights for policy 1, policy_version 1821137 (0.0011) [2023-12-26 14:13:58,209][123090] Updated weights for policy 1, policy_version 1821147 (0.0010) [2023-12-26 14:13:58,660][123091] Updated weights for policy 0, policy_version 1833013 (0.0008) [2023-12-26 14:13:58,730][123091] Updated weights for policy 0, policy_version 1833023 (0.0010) [2023-12-26 14:13:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935469056. Throughput: 0: 8708.3, 1: 9125.7. Samples: 935467256. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:13:58,785][121949] Avg episode reward: [(0, '6243.826'), (1, '5643.289')] [2023-12-26 14:13:58,805][123091] Updated weights for policy 0, policy_version 1833033 (0.0011) [2023-12-26 14:13:59,089][123090] Updated weights for policy 1, policy_version 1821157 (0.0008) [2023-12-26 14:13:59,143][123090] Updated weights for policy 1, policy_version 1821167 (0.0005) [2023-12-26 14:13:59,212][123090] Updated weights for policy 1, policy_version 1821177 (0.0007) [2023-12-26 14:13:59,561][123091] Updated weights for policy 0, policy_version 1833043 (0.0010) [2023-12-26 14:13:59,607][123091] Updated weights for policy 0, policy_version 1833053 (0.0008) [2023-12-26 14:13:59,666][123091] Updated weights for policy 0, policy_version 1833063 (0.0010) [2023-12-26 14:13:59,937][123090] Updated weights for policy 1, policy_version 1821187 (0.0011) [2023-12-26 14:14:00,006][123090] Updated weights for policy 1, policy_version 1821197 (0.0011) [2023-12-26 14:14:00,066][123090] Updated weights for policy 1, policy_version 1821207 (0.0010) [2023-12-26 14:14:00,496][123091] Updated weights for policy 0, policy_version 1833073 (0.0009) [2023-12-26 14:14:00,549][123091] Updated weights for policy 0, policy_version 1833083 (0.0006) [2023-12-26 14:14:00,603][123091] Updated weights for policy 0, policy_version 1833093 (0.0008) [2023-12-26 14:14:00,662][123091] Updated weights for policy 0, policy_version 1833103 (0.0008) [2023-12-26 14:14:00,899][123090] Updated weights for policy 1, policy_version 1821217 (0.0011) [2023-12-26 14:14:00,949][123090] Updated weights for policy 1, policy_version 1821227 (0.0010) [2023-12-26 14:14:01,000][123090] Updated weights for policy 1, policy_version 1821237 (0.0010) [2023-12-26 14:14:01,068][123090] Updated weights for policy 1, policy_version 1821247 (0.0011) [2023-12-26 14:14:01,479][123091] Updated weights for policy 0, policy_version 1833113 (0.0008) [2023-12-26 14:14:01,524][123091] Updated weights for policy 0, policy_version 1833123 (0.0006) [2023-12-26 14:14:01,574][123091] Updated weights for policy 0, policy_version 1833133 (0.0005) [2023-12-26 14:14:01,923][123090] Updated weights for policy 1, policy_version 1821257 (0.0010) [2023-12-26 14:14:01,983][123090] Updated weights for policy 1, policy_version 1821267 (0.0009) [2023-12-26 14:14:02,037][123090] Updated weights for policy 1, policy_version 1821277 (0.0009) [2023-12-26 14:14:02,399][123091] Updated weights for policy 0, policy_version 1833143 (0.0008) [2023-12-26 14:14:02,447][123091] Updated weights for policy 0, policy_version 1833153 (0.0009) [2023-12-26 14:14:02,501][123091] Updated weights for policy 0, policy_version 1833164 (0.0011) [2023-12-26 14:14:02,869][123090] Updated weights for policy 1, policy_version 1821287 (0.0010) [2023-12-26 14:14:02,943][123090] Updated weights for policy 1, policy_version 1821297 (0.0009) [2023-12-26 14:14:03,012][123090] Updated weights for policy 1, policy_version 1821307 (0.0009) [2023-12-26 14:14:03,351][123091] Updated weights for policy 0, policy_version 1833174 (0.0009) [2023-12-26 14:14:03,405][123091] Updated weights for policy 0, policy_version 1833184 (0.0010) [2023-12-26 14:14:03,453][123091] Updated weights for policy 0, policy_version 1833194 (0.0009) [2023-12-26 14:14:03,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935559168. Throughput: 0: 8815.6, 1: 9002.4. Samples: 935572356. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:03,784][121949] Avg episode reward: [(0, '6249.049'), (1, '5588.588')] [2023-12-26 14:14:03,813][123090] Updated weights for policy 1, policy_version 1821317 (0.0010) [2023-12-26 14:14:03,879][123090] Updated weights for policy 1, policy_version 1821327 (0.0009) [2023-12-26 14:14:03,951][123090] Updated weights for policy 1, policy_version 1821338 (0.0009) [2023-12-26 14:14:04,306][123091] Updated weights for policy 0, policy_version 1833204 (0.0009) [2023-12-26 14:14:04,355][123091] Updated weights for policy 0, policy_version 1833214 (0.0009) [2023-12-26 14:14:04,405][123091] Updated weights for policy 0, policy_version 1833224 (0.0009) [2023-12-26 14:14:04,802][123090] Updated weights for policy 1, policy_version 1821348 (0.0009) [2023-12-26 14:14:04,861][123090] Updated weights for policy 1, policy_version 1821358 (0.0010) [2023-12-26 14:14:04,932][123090] Updated weights for policy 1, policy_version 1821368 (0.0009) [2023-12-26 14:14:05,256][123091] Updated weights for policy 0, policy_version 1833234 (0.0010) [2023-12-26 14:14:05,317][123091] Updated weights for policy 0, policy_version 1833244 (0.0009) [2023-12-26 14:14:05,373][123091] Updated weights for policy 0, policy_version 1833254 (0.0009) [2023-12-26 14:14:05,431][123091] Updated weights for policy 0, policy_version 1833264 (0.0009) [2023-12-26 14:14:05,769][123090] Updated weights for policy 1, policy_version 1821378 (0.0010) [2023-12-26 14:14:05,833][123090] Updated weights for policy 1, policy_version 1821388 (0.0009) [2023-12-26 14:14:05,882][123090] Updated weights for policy 1, policy_version 1821398 (0.0008) [2023-12-26 14:14:05,944][123090] Updated weights for policy 1, policy_version 1821408 (0.0007) [2023-12-26 14:14:06,281][123091] Updated weights for policy 0, policy_version 1833274 (0.0008) [2023-12-26 14:14:06,347][123091] Updated weights for policy 0, policy_version 1833284 (0.0008) [2023-12-26 14:14:06,416][123091] Updated weights for policy 0, policy_version 1833294 (0.0008) [2023-12-26 14:14:06,816][123090] Updated weights for policy 1, policy_version 1821418 (0.0009) [2023-12-26 14:14:06,877][123090] Updated weights for policy 1, policy_version 1821428 (0.0010) [2023-12-26 14:14:06,944][123090] Updated weights for policy 1, policy_version 1821438 (0.0010) [2023-12-26 14:14:07,144][123091] Updated weights for policy 0, policy_version 1833304 (0.0005) [2023-12-26 14:14:07,197][123091] Updated weights for policy 0, policy_version 1833314 (0.0005) [2023-12-26 14:14:07,261][123091] Updated weights for policy 0, policy_version 1833324 (0.0005) [2023-12-26 14:14:07,798][123090] Updated weights for policy 1, policy_version 1821448 (0.0009) [2023-12-26 14:14:07,856][123090] Updated weights for policy 1, policy_version 1821458 (0.0009) [2023-12-26 14:14:07,920][123090] Updated weights for policy 1, policy_version 1821468 (0.0009) [2023-12-26 14:14:08,050][123091] Updated weights for policy 0, policy_version 1833334 (0.0008) [2023-12-26 14:14:08,107][123091] Updated weights for policy 0, policy_version 1833344 (0.0008) [2023-12-26 14:14:08,161][123091] Updated weights for policy 0, policy_version 1833354 (0.0008) [2023-12-26 14:14:08,623][123090] Updated weights for policy 1, policy_version 1821478 (0.0007) [2023-12-26 14:14:08,682][123090] Updated weights for policy 1, policy_version 1821488 (0.0008) [2023-12-26 14:14:08,752][123090] Updated weights for policy 1, policy_version 1821498 (0.0008) [2023-12-26 14:14:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 935641088. Throughput: 0: 8807.6, 1: 9015.4. Samples: 935623716. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:08,785][121949] Avg episode reward: [(0, '6315.966'), (1, '5857.062')] [2023-12-26 14:14:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001833360_469344256.pth... [2023-12-26 14:14:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001821504_466305024.pth... [2023-12-26 14:14:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001832336_469082112.pth [2023-12-26 14:14:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001820448_466034688.pth [2023-12-26 14:14:09,017][123091] Updated weights for policy 0, policy_version 1833364 (0.0010) [2023-12-26 14:14:09,070][123091] Updated weights for policy 0, policy_version 1833374 (0.0009) [2023-12-26 14:14:09,125][123091] Updated weights for policy 0, policy_version 1833384 (0.0009) [2023-12-26 14:14:09,463][123090] Updated weights for policy 1, policy_version 1821508 (0.0008) [2023-12-26 14:14:09,538][123090] Updated weights for policy 1, policy_version 1821518 (0.0006) [2023-12-26 14:14:09,608][123090] Updated weights for policy 1, policy_version 1821528 (0.0006) [2023-12-26 14:14:10,045][123091] Updated weights for policy 0, policy_version 1833394 (0.0009) [2023-12-26 14:14:10,104][123091] Updated weights for policy 0, policy_version 1833404 (0.0008) [2023-12-26 14:14:10,166][123091] Updated weights for policy 0, policy_version 1833414 (0.0008) [2023-12-26 14:14:10,239][123091] Updated weights for policy 0, policy_version 1833424 (0.0008) [2023-12-26 14:14:10,331][123090] Updated weights for policy 1, policy_version 1821538 (0.0007) [2023-12-26 14:14:10,390][123090] Updated weights for policy 1, policy_version 1821548 (0.0011) [2023-12-26 14:14:10,446][123090] Updated weights for policy 1, policy_version 1821558 (0.0010) [2023-12-26 14:14:10,502][123090] Updated weights for policy 1, policy_version 1821568 (0.0011) [2023-12-26 14:14:11,058][123091] Updated weights for policy 0, policy_version 1833434 (0.0009) [2023-12-26 14:14:11,118][123091] Updated weights for policy 0, policy_version 1833444 (0.0009) [2023-12-26 14:14:11,186][123091] Updated weights for policy 0, policy_version 1833454 (0.0009) [2023-12-26 14:14:11,319][123090] Updated weights for policy 1, policy_version 1821578 (0.0008) [2023-12-26 14:14:11,390][123090] Updated weights for policy 1, policy_version 1821588 (0.0008) [2023-12-26 14:14:11,451][123090] Updated weights for policy 1, policy_version 1821598 (0.0008) [2023-12-26 14:14:12,080][123091] Updated weights for policy 0, policy_version 1833464 (0.0010) [2023-12-26 14:14:12,135][123091] Updated weights for policy 0, policy_version 1833474 (0.0007) [2023-12-26 14:14:12,200][123091] Updated weights for policy 0, policy_version 1833484 (0.0007) [2023-12-26 14:14:12,218][123090] Updated weights for policy 1, policy_version 1821608 (0.0009) [2023-12-26 14:14:12,286][123090] Updated weights for policy 1, policy_version 1821618 (0.0009) [2023-12-26 14:14:12,362][123090] Updated weights for policy 1, policy_version 1821628 (0.0009) [2023-12-26 14:14:12,911][123091] Updated weights for policy 0, policy_version 1833494 (0.0008) [2023-12-26 14:14:12,967][123091] Updated weights for policy 0, policy_version 1833504 (0.0008) [2023-12-26 14:14:13,034][123091] Updated weights for policy 0, policy_version 1833514 (0.0009) [2023-12-26 14:14:13,190][123090] Updated weights for policy 1, policy_version 1821638 (0.0010) [2023-12-26 14:14:13,246][123090] Updated weights for policy 1, policy_version 1821648 (0.0009) [2023-12-26 14:14:13,298][123090] Updated weights for policy 1, policy_version 1821658 (0.0009) [2023-12-26 14:14:13,736][123091] Updated weights for policy 0, policy_version 1833524 (0.0009) [2023-12-26 14:14:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 935731200. Throughput: 0: 8777.8, 1: 8987.8. Samples: 935728340. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:13,785][121949] Avg episode reward: [(0, '6405.910'), (1, '5862.229')] [2023-12-26 14:14:13,787][123091] Updated weights for policy 0, policy_version 1833534 (0.0010) [2023-12-26 14:14:13,834][123091] Updated weights for policy 0, policy_version 1833544 (0.0010) [2023-12-26 14:14:13,982][123090] Updated weights for policy 1, policy_version 1821668 (0.0008) [2023-12-26 14:14:14,039][123090] Updated weights for policy 1, policy_version 1821678 (0.0005) [2023-12-26 14:14:14,104][123090] Updated weights for policy 1, policy_version 1821688 (0.0005) [2023-12-26 14:14:14,593][123091] Updated weights for policy 0, policy_version 1833554 (0.0010) [2023-12-26 14:14:14,659][123091] Updated weights for policy 0, policy_version 1833564 (0.0011) [2023-12-26 14:14:14,725][123090] Updated weights for policy 1, policy_version 1821698 (0.0006) [2023-12-26 14:14:14,733][123091] Updated weights for policy 0, policy_version 1833574 (0.0011) [2023-12-26 14:14:14,800][123090] Updated weights for policy 1, policy_version 1821708 (0.0009) [2023-12-26 14:14:14,802][123091] Updated weights for policy 0, policy_version 1833584 (0.0009) [2023-12-26 14:14:14,864][123090] Updated weights for policy 1, policy_version 1821718 (0.0008) [2023-12-26 14:14:14,935][123090] Updated weights for policy 1, policy_version 1821728 (0.0009) [2023-12-26 14:14:15,604][123090] Updated weights for policy 1, policy_version 1821738 (0.0006) [2023-12-26 14:14:15,622][123091] Updated weights for policy 0, policy_version 1833594 (0.0009) [2023-12-26 14:14:15,670][123090] Updated weights for policy 1, policy_version 1821748 (0.0006) [2023-12-26 14:14:15,677][123091] Updated weights for policy 0, policy_version 1833604 (0.0009) [2023-12-26 14:14:15,732][123090] Updated weights for policy 1, policy_version 1821758 (0.0007) [2023-12-26 14:14:15,741][123091] Updated weights for policy 0, policy_version 1833614 (0.0007) [2023-12-26 14:14:16,405][123090] Updated weights for policy 1, policy_version 1821768 (0.0009) [2023-12-26 14:14:16,471][123090] Updated weights for policy 1, policy_version 1821778 (0.0010) [2023-12-26 14:14:16,540][123090] Updated weights for policy 1, policy_version 1821788 (0.0010) [2023-12-26 14:14:16,653][123091] Updated weights for policy 0, policy_version 1833624 (0.0009) [2023-12-26 14:14:16,715][123091] Updated weights for policy 0, policy_version 1833634 (0.0008) [2023-12-26 14:14:16,787][123091] Updated weights for policy 0, policy_version 1833644 (0.0007) [2023-12-26 14:14:17,340][123090] Updated weights for policy 1, policy_version 1821798 (0.0010) [2023-12-26 14:14:17,390][123090] Updated weights for policy 1, policy_version 1821808 (0.0009) [2023-12-26 14:14:17,450][123090] Updated weights for policy 1, policy_version 1821818 (0.0009) [2023-12-26 14:14:17,557][123091] Updated weights for policy 0, policy_version 1833654 (0.0008) [2023-12-26 14:14:17,609][123091] Updated weights for policy 0, policy_version 1833664 (0.0005) [2023-12-26 14:14:17,667][123091] Updated weights for policy 0, policy_version 1833674 (0.0005) [2023-12-26 14:14:18,195][123090] Updated weights for policy 1, policy_version 1821828 (0.0007) [2023-12-26 14:14:18,247][123090] Updated weights for policy 1, policy_version 1821838 (0.0008) [2023-12-26 14:14:18,307][123090] Updated weights for policy 1, policy_version 1821848 (0.0008) [2023-12-26 14:14:18,493][123091] Updated weights for policy 0, policy_version 1833684 (0.0007) [2023-12-26 14:14:18,545][123091] Updated weights for policy 0, policy_version 1833694 (0.0009) [2023-12-26 14:14:18,599][123091] Updated weights for policy 0, policy_version 1833704 (0.0010) [2023-12-26 14:14:18,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 935829504. Throughput: 0: 8764.3, 1: 9089.7. Samples: 935838360. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:18,785][121949] Avg episode reward: [(0, '6269.493'), (1, '5758.392')] [2023-12-26 14:14:19,009][123090] Updated weights for policy 1, policy_version 1821858 (0.0008) [2023-12-26 14:14:19,068][123090] Updated weights for policy 1, policy_version 1821868 (0.0006) [2023-12-26 14:14:19,125][123090] Updated weights for policy 1, policy_version 1821878 (0.0005) [2023-12-26 14:14:19,180][123090] Updated weights for policy 1, policy_version 1821888 (0.0005) [2023-12-26 14:14:19,532][123091] Updated weights for policy 0, policy_version 1833714 (0.0010) [2023-12-26 14:14:19,596][123091] Updated weights for policy 0, policy_version 1833724 (0.0007) [2023-12-26 14:14:19,671][123091] Updated weights for policy 0, policy_version 1833734 (0.0006) [2023-12-26 14:14:19,735][123091] Updated weights for policy 0, policy_version 1833744 (0.0005) [2023-12-26 14:14:19,944][123090] Updated weights for policy 1, policy_version 1821898 (0.0010) [2023-12-26 14:14:20,012][123090] Updated weights for policy 1, policy_version 1821908 (0.0010) [2023-12-26 14:14:20,084][123090] Updated weights for policy 1, policy_version 1821918 (0.0009) [2023-12-26 14:14:20,484][123091] Updated weights for policy 0, policy_version 1833754 (0.0006) [2023-12-26 14:14:20,540][123091] Updated weights for policy 0, policy_version 1833764 (0.0005) [2023-12-26 14:14:20,606][123091] Updated weights for policy 0, policy_version 1833774 (0.0009) [2023-12-26 14:14:20,900][123090] Updated weights for policy 1, policy_version 1821928 (0.0010) [2023-12-26 14:14:20,967][123090] Updated weights for policy 1, policy_version 1821938 (0.0010) [2023-12-26 14:14:21,028][123090] Updated weights for policy 1, policy_version 1821948 (0.0009) [2023-12-26 14:14:21,450][123091] Updated weights for policy 0, policy_version 1833784 (0.0009) [2023-12-26 14:14:21,507][123091] Updated weights for policy 0, policy_version 1833794 (0.0005) [2023-12-26 14:14:21,564][123091] Updated weights for policy 0, policy_version 1833804 (0.0007) [2023-12-26 14:14:21,954][123090] Updated weights for policy 1, policy_version 1821958 (0.0010) [2023-12-26 14:14:22,021][123090] Updated weights for policy 1, policy_version 1821968 (0.0009) [2023-12-26 14:14:22,083][123090] Updated weights for policy 1, policy_version 1821978 (0.0010) [2023-12-26 14:14:22,310][123091] Updated weights for policy 0, policy_version 1833814 (0.0008) [2023-12-26 14:14:22,387][123091] Updated weights for policy 0, policy_version 1833824 (0.0010) [2023-12-26 14:14:22,454][123091] Updated weights for policy 0, policy_version 1833834 (0.0009) [2023-12-26 14:14:22,970][123090] Updated weights for policy 1, policy_version 1821988 (0.0009) [2023-12-26 14:14:23,039][123090] Updated weights for policy 1, policy_version 1821998 (0.0008) [2023-12-26 14:14:23,098][123090] Updated weights for policy 1, policy_version 1822008 (0.0010) [2023-12-26 14:14:23,286][123091] Updated weights for policy 0, policy_version 1833844 (0.0010) [2023-12-26 14:14:23,340][123091] Updated weights for policy 0, policy_version 1833854 (0.0009) [2023-12-26 14:14:23,402][123091] Updated weights for policy 0, policy_version 1833864 (0.0009) [2023-12-26 14:14:23,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 935911424. Throughput: 0: 8745.4, 1: 9031.6. Samples: 935890684. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:23,785][121949] Avg episode reward: [(0, '6213.951'), (1, '5774.924')] [2023-12-26 14:14:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001822016_466436096.pth... [2023-12-26 14:14:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001833872_469475328.pth... [2023-12-26 14:14:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001820992_466173952.pth [2023-12-26 14:14:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001832848_469213184.pth [2023-12-26 14:14:23,930][123090] Updated weights for policy 1, policy_version 1822018 (0.0009) [2023-12-26 14:14:23,997][123090] Updated weights for policy 1, policy_version 1822028 (0.0010) [2023-12-26 14:14:24,061][123090] Updated weights for policy 1, policy_version 1822038 (0.0009) [2023-12-26 14:14:24,130][123090] Updated weights for policy 1, policy_version 1822048 (0.0009) [2023-12-26 14:14:24,183][123091] Updated weights for policy 0, policy_version 1833874 (0.0009) [2023-12-26 14:14:24,232][123091] Updated weights for policy 0, policy_version 1833884 (0.0006) [2023-12-26 14:14:24,280][123091] Updated weights for policy 0, policy_version 1833894 (0.0005) [2023-12-26 14:14:24,327][123091] Updated weights for policy 0, policy_version 1833904 (0.0005) [2023-12-26 14:14:25,002][123091] Updated weights for policy 0, policy_version 1833914 (0.0005) [2023-12-26 14:14:25,006][123090] Updated weights for policy 1, policy_version 1822058 (0.0008) [2023-12-26 14:14:25,059][123091] Updated weights for policy 0, policy_version 1833924 (0.0005) [2023-12-26 14:14:25,070][123090] Updated weights for policy 1, policy_version 1822068 (0.0010) [2023-12-26 14:14:25,122][123091] Updated weights for policy 0, policy_version 1833934 (0.0009) [2023-12-26 14:14:25,122][123090] Updated weights for policy 1, policy_version 1822078 (0.0010) [2023-12-26 14:14:25,817][123090] Updated weights for policy 1, policy_version 1822088 (0.0009) [2023-12-26 14:14:25,860][123091] Updated weights for policy 0, policy_version 1833944 (0.0010) [2023-12-26 14:14:25,886][123090] Updated weights for policy 1, policy_version 1822098 (0.0006) [2023-12-26 14:14:25,911][123091] Updated weights for policy 0, policy_version 1833954 (0.0010) [2023-12-26 14:14:25,956][123090] Updated weights for policy 1, policy_version 1822108 (0.0005) [2023-12-26 14:14:25,969][123091] Updated weights for policy 0, policy_version 1833964 (0.0008) [2023-12-26 14:14:26,564][123090] Updated weights for policy 1, policy_version 1822118 (0.0006) [2023-12-26 14:14:26,635][123090] Updated weights for policy 1, policy_version 1822128 (0.0005) [2023-12-26 14:14:26,696][123090] Updated weights for policy 1, policy_version 1822138 (0.0007) [2023-12-26 14:14:26,733][123091] Updated weights for policy 0, policy_version 1833974 (0.0010) [2023-12-26 14:14:26,784][123091] Updated weights for policy 0, policy_version 1833984 (0.0010) [2023-12-26 14:14:26,836][123091] Updated weights for policy 0, policy_version 1833994 (0.0010) [2023-12-26 14:14:27,379][123090] Updated weights for policy 1, policy_version 1822148 (0.0005) [2023-12-26 14:14:27,433][123090] Updated weights for policy 1, policy_version 1822158 (0.0006) [2023-12-26 14:14:27,491][123090] Updated weights for policy 1, policy_version 1822168 (0.0005) [2023-12-26 14:14:27,554][123091] Updated weights for policy 0, policy_version 1834004 (0.0008) [2023-12-26 14:14:27,600][123091] Updated weights for policy 0, policy_version 1834014 (0.0005) [2023-12-26 14:14:27,656][123091] Updated weights for policy 0, policy_version 1834024 (0.0007) [2023-12-26 14:14:28,146][123090] Updated weights for policy 1, policy_version 1822178 (0.0005) [2023-12-26 14:14:28,210][123090] Updated weights for policy 1, policy_version 1822188 (0.0005) [2023-12-26 14:14:28,279][123090] Updated weights for policy 1, policy_version 1822198 (0.0006) [2023-12-26 14:14:28,318][123091] Updated weights for policy 0, policy_version 1834034 (0.0006) [2023-12-26 14:14:28,344][123090] Updated weights for policy 1, policy_version 1822208 (0.0006) [2023-12-26 14:14:28,378][123091] Updated weights for policy 0, policy_version 1834044 (0.0011) [2023-12-26 14:14:28,441][123091] Updated weights for policy 0, policy_version 1834054 (0.0010) [2023-12-26 14:14:28,500][123091] Updated weights for policy 0, policy_version 1834064 (0.0010) [2023-12-26 14:14:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 936009728. Throughput: 0: 8829.6, 1: 9025.5. Samples: 936000884. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:28,785][121949] Avg episode reward: [(0, '6277.731'), (1, '5768.396')] [2023-12-26 14:14:29,032][123090] Updated weights for policy 1, policy_version 1822218 (0.0008) [2023-12-26 14:14:29,095][123090] Updated weights for policy 1, policy_version 1822228 (0.0009) [2023-12-26 14:14:29,150][123090] Updated weights for policy 1, policy_version 1822238 (0.0009) [2023-12-26 14:14:29,323][123091] Updated weights for policy 0, policy_version 1834074 (0.0011) [2023-12-26 14:14:29,388][123091] Updated weights for policy 0, policy_version 1834084 (0.0008) [2023-12-26 14:14:29,436][123091] Updated weights for policy 0, policy_version 1834094 (0.0005) [2023-12-26 14:14:29,975][123090] Updated weights for policy 1, policy_version 1822248 (0.0008) [2023-12-26 14:14:30,034][123090] Updated weights for policy 1, policy_version 1822258 (0.0005) [2023-12-26 14:14:30,084][123090] Updated weights for policy 1, policy_version 1822268 (0.0006) [2023-12-26 14:14:30,198][123091] Updated weights for policy 0, policy_version 1834104 (0.0008) [2023-12-26 14:14:30,266][123091] Updated weights for policy 0, policy_version 1834114 (0.0010) [2023-12-26 14:14:30,329][123091] Updated weights for policy 0, policy_version 1834124 (0.0009) [2023-12-26 14:14:30,862][123090] Updated weights for policy 1, policy_version 1822278 (0.0007) [2023-12-26 14:14:30,940][123090] Updated weights for policy 1, policy_version 1822288 (0.0005) [2023-12-26 14:14:31,003][123090] Updated weights for policy 1, policy_version 1822298 (0.0010) [2023-12-26 14:14:31,117][123091] Updated weights for policy 0, policy_version 1834134 (0.0009) [2023-12-26 14:14:31,185][123091] Updated weights for policy 0, policy_version 1834144 (0.0009) [2023-12-26 14:14:31,238][123091] Updated weights for policy 0, policy_version 1834154 (0.0009) [2023-12-26 14:14:31,750][123090] Updated weights for policy 1, policy_version 1822308 (0.0008) [2023-12-26 14:14:31,818][123090] Updated weights for policy 1, policy_version 1822318 (0.0005) [2023-12-26 14:14:31,884][123090] Updated weights for policy 1, policy_version 1822328 (0.0005) [2023-12-26 14:14:32,113][123091] Updated weights for policy 0, policy_version 1834164 (0.0008) [2023-12-26 14:14:32,186][123091] Updated weights for policy 0, policy_version 1834174 (0.0010) [2023-12-26 14:14:32,244][123091] Updated weights for policy 0, policy_version 1834184 (0.0009) [2023-12-26 14:14:32,568][123090] Updated weights for policy 1, policy_version 1822338 (0.0006) [2023-12-26 14:14:32,616][123090] Updated weights for policy 1, policy_version 1822348 (0.0008) [2023-12-26 14:14:32,677][123090] Updated weights for policy 1, policy_version 1822358 (0.0006) [2023-12-26 14:14:32,738][123090] Updated weights for policy 1, policy_version 1822368 (0.0009) [2023-12-26 14:14:33,086][123091] Updated weights for policy 0, policy_version 1834194 (0.0008) [2023-12-26 14:14:33,158][123091] Updated weights for policy 0, policy_version 1834204 (0.0006) [2023-12-26 14:14:33,218][123091] Updated weights for policy 0, policy_version 1834214 (0.0009) [2023-12-26 14:14:33,521][123090] Updated weights for policy 1, policy_version 1822378 (0.0010) [2023-12-26 14:14:33,595][123090] Updated weights for policy 1, policy_version 1822388 (0.0010) [2023-12-26 14:14:33,656][123090] Updated weights for policy 1, policy_version 1822398 (0.0009) [2023-12-26 14:14:33,784][121949] Fps is (10 sec: 18842.0, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 936099840. Throughput: 0: 8857.5, 1: 9068.5. Samples: 936110364. Policy #0 lag: (min: 10.0, avg: 21.4, max: 42.0) [2023-12-26 14:14:33,785][121949] Avg episode reward: [(0, '6280.604'), (1, '5639.853')] [2023-12-26 14:14:33,998][123091] Updated weights for policy 0, policy_version 1834225 (0.0008) [2023-12-26 14:14:34,065][123091] Updated weights for policy 0, policy_version 1834235 (0.0010) [2023-12-26 14:14:34,130][123091] Updated weights for policy 0, policy_version 1834245 (0.0007) [2023-12-26 14:14:34,199][123091] Updated weights for policy 0, policy_version 1834255 (0.0008) [2023-12-26 14:14:34,474][123090] Updated weights for policy 1, policy_version 1822408 (0.0010) [2023-12-26 14:14:34,542][123090] Updated weights for policy 1, policy_version 1822418 (0.0008) [2023-12-26 14:14:34,611][123090] Updated weights for policy 1, policy_version 1822428 (0.0010) [2023-12-26 14:14:35,016][123091] Updated weights for policy 0, policy_version 1834265 (0.0008) [2023-12-26 14:14:35,064][123091] Updated weights for policy 0, policy_version 1834275 (0.0005) [2023-12-26 14:14:35,109][123091] Updated weights for policy 0, policy_version 1834285 (0.0005) [2023-12-26 14:14:35,420][123090] Updated weights for policy 1, policy_version 1822438 (0.0010) [2023-12-26 14:14:35,474][123090] Updated weights for policy 1, policy_version 1822448 (0.0010) [2023-12-26 14:14:35,534][123090] Updated weights for policy 1, policy_version 1822458 (0.0009) [2023-12-26 14:14:35,837][123091] Updated weights for policy 0, policy_version 1834295 (0.0008) [2023-12-26 14:14:35,900][123091] Updated weights for policy 0, policy_version 1834305 (0.0008) [2023-12-26 14:14:35,962][123091] Updated weights for policy 0, policy_version 1834315 (0.0008) [2023-12-26 14:14:36,398][123090] Updated weights for policy 1, policy_version 1822468 (0.0009) [2023-12-26 14:14:36,466][123090] Updated weights for policy 1, policy_version 1822478 (0.0006) [2023-12-26 14:14:36,542][123090] Updated weights for policy 1, policy_version 1822488 (0.0007) [2023-12-26 14:14:36,635][123091] Updated weights for policy 0, policy_version 1834325 (0.0008) [2023-12-26 14:14:36,704][123091] Updated weights for policy 0, policy_version 1834335 (0.0009) [2023-12-26 14:14:36,774][123091] Updated weights for policy 0, policy_version 1834345 (0.0008) [2023-12-26 14:14:37,235][123090] Updated weights for policy 1, policy_version 1822498 (0.0008) [2023-12-26 14:14:37,306][123090] Updated weights for policy 1, policy_version 1822508 (0.0005) [2023-12-26 14:14:37,375][123090] Updated weights for policy 1, policy_version 1822518 (0.0006) [2023-12-26 14:14:37,380][123091] Updated weights for policy 0, policy_version 1834355 (0.0007) [2023-12-26 14:14:37,446][123090] Updated weights for policy 1, policy_version 1822528 (0.0005) [2023-12-26 14:14:37,449][123091] Updated weights for policy 0, policy_version 1834365 (0.0005) [2023-12-26 14:14:37,523][123091] Updated weights for policy 0, policy_version 1834375 (0.0008) [2023-12-26 14:14:38,112][123090] Updated weights for policy 1, policy_version 1822538 (0.0009) [2023-12-26 14:14:38,160][123090] Updated weights for policy 1, policy_version 1822548 (0.0009) [2023-12-26 14:14:38,213][123090] Updated weights for policy 1, policy_version 1822558 (0.0009) [2023-12-26 14:14:38,358][123091] Updated weights for policy 0, policy_version 1834385 (0.0009) [2023-12-26 14:14:38,426][123091] Updated weights for policy 0, policy_version 1834395 (0.0008) [2023-12-26 14:14:38,483][123091] Updated weights for policy 0, policy_version 1834405 (0.0009) [2023-12-26 14:14:38,535][123091] Updated weights for policy 0, policy_version 1834415 (0.0009) [2023-12-26 14:14:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 936189952. Throughput: 0: 8910.7, 1: 9031.0. Samples: 936163412. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:14:38,785][121949] Avg episode reward: [(0, '6230.294'), (1, '5671.482')] [2023-12-26 14:14:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001822560_466575360.pth... [2023-12-26 14:14:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001834416_469614592.pth... [2023-12-26 14:14:38,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001821504_466305024.pth [2023-12-26 14:14:38,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001833360_469344256.pth [2023-12-26 14:14:39,089][123090] Updated weights for policy 1, policy_version 1822568 (0.0009) [2023-12-26 14:14:39,152][123090] Updated weights for policy 1, policy_version 1822578 (0.0010) [2023-12-26 14:14:39,209][123090] Updated weights for policy 1, policy_version 1822588 (0.0010) [2023-12-26 14:14:39,383][123091] Updated weights for policy 0, policy_version 1834425 (0.0008) [2023-12-26 14:14:39,455][123091] Updated weights for policy 0, policy_version 1834435 (0.0007) [2023-12-26 14:14:39,514][123091] Updated weights for policy 0, policy_version 1834445 (0.0006) [2023-12-26 14:14:40,036][123090] Updated weights for policy 1, policy_version 1822598 (0.0007) [2023-12-26 14:14:40,105][123090] Updated weights for policy 1, policy_version 1822608 (0.0006) [2023-12-26 14:14:40,172][123090] Updated weights for policy 1, policy_version 1822618 (0.0006) [2023-12-26 14:14:40,251][123091] Updated weights for policy 0, policy_version 1834455 (0.0006) [2023-12-26 14:14:40,305][123091] Updated weights for policy 0, policy_version 1834465 (0.0005) [2023-12-26 14:14:40,377][123091] Updated weights for policy 0, policy_version 1834475 (0.0006) [2023-12-26 14:14:40,845][123090] Updated weights for policy 1, policy_version 1822628 (0.0008) [2023-12-26 14:14:40,898][123090] Updated weights for policy 1, policy_version 1822638 (0.0009) [2023-12-26 14:14:40,960][123090] Updated weights for policy 1, policy_version 1822648 (0.0010) [2023-12-26 14:14:41,140][123091] Updated weights for policy 0, policy_version 1834485 (0.0010) [2023-12-26 14:14:41,207][123091] Updated weights for policy 0, policy_version 1834495 (0.0009) [2023-12-26 14:14:41,279][123091] Updated weights for policy 0, policy_version 1834505 (0.0009) [2023-12-26 14:14:41,803][123090] Updated weights for policy 1, policy_version 1822658 (0.0009) [2023-12-26 14:14:41,862][123090] Updated weights for policy 1, policy_version 1822668 (0.0010) [2023-12-26 14:14:41,917][123090] Updated weights for policy 1, policy_version 1822678 (0.0010) [2023-12-26 14:14:41,970][123090] Updated weights for policy 1, policy_version 1822688 (0.0010) [2023-12-26 14:14:42,100][123091] Updated weights for policy 0, policy_version 1834515 (0.0008) [2023-12-26 14:14:42,172][123091] Updated weights for policy 0, policy_version 1834525 (0.0006) [2023-12-26 14:14:42,240][123091] Updated weights for policy 0, policy_version 1834535 (0.0009) [2023-12-26 14:14:42,885][123090] Updated weights for policy 1, policy_version 1822698 (0.0009) [2023-12-26 14:14:42,959][123090] Updated weights for policy 1, policy_version 1822708 (0.0010) [2023-12-26 14:14:43,002][123091] Updated weights for policy 0, policy_version 1834545 (0.0009) [2023-12-26 14:14:43,022][123090] Updated weights for policy 1, policy_version 1822718 (0.0009) [2023-12-26 14:14:43,049][123091] Updated weights for policy 0, policy_version 1834555 (0.0007) [2023-12-26 14:14:43,107][123091] Updated weights for policy 0, policy_version 1834565 (0.0009) [2023-12-26 14:14:43,168][123091] Updated weights for policy 0, policy_version 1834575 (0.0009) [2023-12-26 14:14:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 936271872. Throughput: 0: 8878.8, 1: 8973.0. Samples: 936270584. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:14:43,784][121949] Avg episode reward: [(0, '6313.490'), (1, '5845.722')] [2023-12-26 14:14:43,835][123090] Updated weights for policy 1, policy_version 1822728 (0.0008) [2023-12-26 14:14:43,889][123090] Updated weights for policy 1, policy_version 1822738 (0.0009) [2023-12-26 14:14:43,952][123090] Updated weights for policy 1, policy_version 1822748 (0.0009) [2023-12-26 14:14:43,995][123091] Updated weights for policy 0, policy_version 1834585 (0.0008) [2023-12-26 14:14:44,050][123091] Updated weights for policy 0, policy_version 1834595 (0.0010) [2023-12-26 14:14:44,112][123091] Updated weights for policy 0, policy_version 1834605 (0.0010) [2023-12-26 14:14:44,792][123090] Updated weights for policy 1, policy_version 1822758 (0.0008) [2023-12-26 14:14:44,862][123090] Updated weights for policy 1, policy_version 1822768 (0.0009) [2023-12-26 14:14:44,931][123090] Updated weights for policy 1, policy_version 1822778 (0.0009) [2023-12-26 14:14:44,966][123091] Updated weights for policy 0, policy_version 1834615 (0.0009) [2023-12-26 14:14:45,033][123091] Updated weights for policy 0, policy_version 1834625 (0.0010) [2023-12-26 14:14:45,084][123091] Updated weights for policy 0, policy_version 1834635 (0.0009) [2023-12-26 14:14:45,783][123090] Updated weights for policy 1, policy_version 1822788 (0.0009) [2023-12-26 14:14:45,837][123090] Updated weights for policy 1, policy_version 1822798 (0.0010) [2023-12-26 14:14:45,907][123090] Updated weights for policy 1, policy_version 1822808 (0.0010) [2023-12-26 14:14:45,935][123091] Updated weights for policy 0, policy_version 1834645 (0.0008) [2023-12-26 14:14:45,990][123091] Updated weights for policy 0, policy_version 1834655 (0.0008) [2023-12-26 14:14:46,056][123091] Updated weights for policy 0, policy_version 1834665 (0.0010) [2023-12-26 14:14:46,750][123090] Updated weights for policy 1, policy_version 1822818 (0.0009) [2023-12-26 14:14:46,799][123090] Updated weights for policy 1, policy_version 1822828 (0.0009) [2023-12-26 14:14:46,853][123090] Updated weights for policy 1, policy_version 1822838 (0.0010) [2023-12-26 14:14:46,882][123091] Updated weights for policy 0, policy_version 1834675 (0.0008) [2023-12-26 14:14:46,905][123090] Updated weights for policy 1, policy_version 1822848 (0.0009) [2023-12-26 14:14:46,944][123091] Updated weights for policy 0, policy_version 1834685 (0.0008) [2023-12-26 14:14:47,010][123091] Updated weights for policy 0, policy_version 1834695 (0.0009) [2023-12-26 14:14:47,772][123090] Updated weights for policy 1, policy_version 1822858 (0.0009) [2023-12-26 14:14:47,823][123090] Updated weights for policy 1, policy_version 1822868 (0.0008) [2023-12-26 14:14:47,834][123091] Updated weights for policy 0, policy_version 1834705 (0.0010) [2023-12-26 14:14:47,883][123090] Updated weights for policy 1, policy_version 1822878 (0.0007) [2023-12-26 14:14:47,892][123091] Updated weights for policy 0, policy_version 1834715 (0.0009) [2023-12-26 14:14:47,951][123091] Updated weights for policy 0, policy_version 1834725 (0.0009) [2023-12-26 14:14:48,023][123091] Updated weights for policy 0, policy_version 1834735 (0.0010) [2023-12-26 14:14:48,644][123090] Updated weights for policy 1, policy_version 1822888 (0.0006) [2023-12-26 14:14:48,721][123090] Updated weights for policy 1, policy_version 1822898 (0.0005) [2023-12-26 14:14:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 936353792. Throughput: 0: 8828.8, 1: 8952.6. Samples: 936372520. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:14:48,784][121949] Avg episode reward: [(0, '6399.061'), (1, '5874.308')] [2023-12-26 14:14:48,796][123090] Updated weights for policy 1, policy_version 1822908 (0.0005) [2023-12-26 14:14:48,896][123091] Updated weights for policy 0, policy_version 1834745 (0.0010) [2023-12-26 14:14:48,972][123091] Updated weights for policy 0, policy_version 1834755 (0.0009) [2023-12-26 14:14:49,033][123091] Updated weights for policy 0, policy_version 1834765 (0.0010) [2023-12-26 14:14:49,474][123090] Updated weights for policy 1, policy_version 1822918 (0.0007) [2023-12-26 14:14:49,532][123090] Updated weights for policy 1, policy_version 1822928 (0.0006) [2023-12-26 14:14:49,592][123090] Updated weights for policy 1, policy_version 1822938 (0.0007) [2023-12-26 14:14:49,877][123091] Updated weights for policy 0, policy_version 1834775 (0.0009) [2023-12-26 14:14:49,945][123091] Updated weights for policy 0, policy_version 1834785 (0.0009) [2023-12-26 14:14:50,016][123091] Updated weights for policy 0, policy_version 1834795 (0.0010) [2023-12-26 14:14:50,427][123090] Updated weights for policy 1, policy_version 1822948 (0.0009) [2023-12-26 14:14:50,496][123090] Updated weights for policy 1, policy_version 1822958 (0.0009) [2023-12-26 14:14:50,566][123090] Updated weights for policy 1, policy_version 1822968 (0.0010) [2023-12-26 14:14:50,875][123091] Updated weights for policy 0, policy_version 1834805 (0.0009) [2023-12-26 14:14:50,940][123091] Updated weights for policy 0, policy_version 1834815 (0.0009) [2023-12-26 14:14:51,009][123091] Updated weights for policy 0, policy_version 1834825 (0.0010) [2023-12-26 14:14:51,282][123090] Updated weights for policy 1, policy_version 1822978 (0.0009) [2023-12-26 14:14:51,351][123090] Updated weights for policy 1, policy_version 1822988 (0.0007) [2023-12-26 14:14:51,424][123090] Updated weights for policy 1, policy_version 1822998 (0.0010) [2023-12-26 14:14:51,486][123090] Updated weights for policy 1, policy_version 1823008 (0.0010) [2023-12-26 14:14:51,831][123091] Updated weights for policy 0, policy_version 1834835 (0.0010) [2023-12-26 14:14:51,892][123091] Updated weights for policy 0, policy_version 1834845 (0.0008) [2023-12-26 14:14:51,956][123091] Updated weights for policy 0, policy_version 1834855 (0.0008) [2023-12-26 14:14:52,320][123090] Updated weights for policy 1, policy_version 1823018 (0.0006) [2023-12-26 14:14:52,390][123090] Updated weights for policy 1, policy_version 1823028 (0.0009) [2023-12-26 14:14:52,455][123090] Updated weights for policy 1, policy_version 1823038 (0.0009) [2023-12-26 14:14:52,795][123091] Updated weights for policy 0, policy_version 1834865 (0.0010) [2023-12-26 14:14:52,864][123091] Updated weights for policy 0, policy_version 1834875 (0.0010) [2023-12-26 14:14:52,933][123091] Updated weights for policy 0, policy_version 1834885 (0.0009) [2023-12-26 14:14:52,999][123091] Updated weights for policy 0, policy_version 1834895 (0.0010) [2023-12-26 14:14:53,190][123090] Updated weights for policy 1, policy_version 1823048 (0.0007) [2023-12-26 14:14:53,248][123090] Updated weights for policy 1, policy_version 1823058 (0.0010) [2023-12-26 14:14:53,323][123090] Updated weights for policy 1, policy_version 1823068 (0.0008) [2023-12-26 14:14:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 936443904. Throughput: 0: 8801.7, 1: 8988.4. Samples: 936424268. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:14:53,785][121949] Avg episode reward: [(0, '6358.192'), (1, '5761.469')] [2023-12-26 14:14:53,787][123091] Updated weights for policy 0, policy_version 1834905 (0.0009) [2023-12-26 14:14:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001823072_466706432.pth... [2023-12-26 14:14:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001822016_466436096.pth [2023-12-26 14:14:53,836][123091] Updated weights for policy 0, policy_version 1834915 (0.0009) [2023-12-26 14:14:53,890][123091] Updated weights for policy 0, policy_version 1834925 (0.0009) [2023-12-26 14:14:53,902][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001834928_469745664.pth... [2023-12-26 14:14:53,905][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001833872_469475328.pth [2023-12-26 14:14:54,131][123090] Updated weights for policy 1, policy_version 1823078 (0.0009) [2023-12-26 14:14:54,196][123090] Updated weights for policy 1, policy_version 1823088 (0.0010) [2023-12-26 14:14:54,245][123090] Updated weights for policy 1, policy_version 1823098 (0.0009) [2023-12-26 14:14:54,754][123091] Updated weights for policy 0, policy_version 1834935 (0.0009) [2023-12-26 14:14:54,805][123091] Updated weights for policy 0, policy_version 1834945 (0.0010) [2023-12-26 14:14:54,857][123091] Updated weights for policy 0, policy_version 1834955 (0.0009) [2023-12-26 14:14:55,067][123090] Updated weights for policy 1, policy_version 1823108 (0.0009) [2023-12-26 14:14:55,119][123090] Updated weights for policy 1, policy_version 1823118 (0.0007) [2023-12-26 14:14:55,166][123090] Updated weights for policy 1, policy_version 1823128 (0.0005) [2023-12-26 14:14:55,746][123091] Updated weights for policy 0, policy_version 1834965 (0.0009) [2023-12-26 14:14:55,808][123091] Updated weights for policy 0, policy_version 1834975 (0.0007) [2023-12-26 14:14:55,865][123091] Updated weights for policy 0, policy_version 1834985 (0.0010) [2023-12-26 14:14:55,916][123090] Updated weights for policy 1, policy_version 1823138 (0.0009) [2023-12-26 14:14:55,971][123090] Updated weights for policy 1, policy_version 1823148 (0.0008) [2023-12-26 14:14:56,028][123090] Updated weights for policy 1, policy_version 1823158 (0.0009) [2023-12-26 14:14:56,090][123090] Updated weights for policy 1, policy_version 1823168 (0.0009) [2023-12-26 14:14:56,665][123091] Updated weights for policy 0, policy_version 1834995 (0.0010) [2023-12-26 14:14:56,720][123091] Updated weights for policy 0, policy_version 1835005 (0.0009) [2023-12-26 14:14:56,768][123091] Updated weights for policy 0, policy_version 1835015 (0.0009) [2023-12-26 14:14:56,960][123090] Updated weights for policy 1, policy_version 1823178 (0.0005) [2023-12-26 14:14:57,022][123090] Updated weights for policy 1, policy_version 1823188 (0.0005) [2023-12-26 14:14:57,084][123090] Updated weights for policy 1, policy_version 1823198 (0.0010) [2023-12-26 14:14:57,611][123091] Updated weights for policy 0, policy_version 1835026 (0.0009) [2023-12-26 14:14:57,670][123091] Updated weights for policy 0, policy_version 1835036 (0.0010) [2023-12-26 14:14:57,717][123091] Updated weights for policy 0, policy_version 1835046 (0.0009) [2023-12-26 14:14:57,765][123091] Updated weights for policy 0, policy_version 1835056 (0.0009) [2023-12-26 14:14:57,803][123090] Updated weights for policy 1, policy_version 1823208 (0.0008) [2023-12-26 14:14:57,859][123090] Updated weights for policy 1, policy_version 1823218 (0.0009) [2023-12-26 14:14:57,911][123090] Updated weights for policy 1, policy_version 1823228 (0.0009) [2023-12-26 14:14:58,679][123091] Updated weights for policy 0, policy_version 1835066 (0.0008) [2023-12-26 14:14:58,746][123091] Updated weights for policy 0, policy_version 1835076 (0.0008) [2023-12-26 14:14:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 936525824. Throughput: 0: 8792.6, 1: 8991.6. Samples: 936528632. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:14:58,784][121949] Avg episode reward: [(0, '6333.230'), (1, '5816.554')] [2023-12-26 14:14:58,810][123091] Updated weights for policy 0, policy_version 1835086 (0.0007) [2023-12-26 14:14:58,847][123090] Updated weights for policy 1, policy_version 1823238 (0.0009) [2023-12-26 14:14:58,903][123090] Updated weights for policy 1, policy_version 1823248 (0.0011) [2023-12-26 14:14:58,959][123090] Updated weights for policy 1, policy_version 1823258 (0.0011) [2023-12-26 14:14:59,531][123091] Updated weights for policy 0, policy_version 1835096 (0.0010) [2023-12-26 14:14:59,593][123091] Updated weights for policy 0, policy_version 1835106 (0.0010) [2023-12-26 14:14:59,650][123091] Updated weights for policy 0, policy_version 1835116 (0.0009) [2023-12-26 14:14:59,762][123090] Updated weights for policy 1, policy_version 1823268 (0.0010) [2023-12-26 14:14:59,828][123090] Updated weights for policy 1, policy_version 1823278 (0.0010) [2023-12-26 14:14:59,893][123090] Updated weights for policy 1, policy_version 1823288 (0.0010) [2023-12-26 14:15:00,525][123091] Updated weights for policy 0, policy_version 1835126 (0.0009) [2023-12-26 14:15:00,576][123090] Updated weights for policy 1, policy_version 1823298 (0.0008) [2023-12-26 14:15:00,582][123091] Updated weights for policy 0, policy_version 1835136 (0.0009) [2023-12-26 14:15:00,636][123091] Updated weights for policy 0, policy_version 1835146 (0.0008) [2023-12-26 14:15:00,637][123090] Updated weights for policy 1, policy_version 1823308 (0.0007) [2023-12-26 14:15:00,694][123090] Updated weights for policy 1, policy_version 1823318 (0.0009) [2023-12-26 14:15:00,751][123090] Updated weights for policy 1, policy_version 1823328 (0.0009) [2023-12-26 14:15:01,442][123091] Updated weights for policy 0, policy_version 1835156 (0.0006) [2023-12-26 14:15:01,514][123091] Updated weights for policy 0, policy_version 1835166 (0.0011) [2023-12-26 14:15:01,585][123091] Updated weights for policy 0, policy_version 1835176 (0.0011) [2023-12-26 14:15:01,657][123090] Updated weights for policy 1, policy_version 1823338 (0.0008) [2023-12-26 14:15:01,721][123090] Updated weights for policy 1, policy_version 1823348 (0.0009) [2023-12-26 14:15:01,786][123090] Updated weights for policy 1, policy_version 1823358 (0.0009) [2023-12-26 14:15:02,307][123091] Updated weights for policy 0, policy_version 1835186 (0.0010) [2023-12-26 14:15:02,375][123091] Updated weights for policy 0, policy_version 1835196 (0.0011) [2023-12-26 14:15:02,439][123091] Updated weights for policy 0, policy_version 1835206 (0.0010) [2023-12-26 14:15:02,510][123091] Updated weights for policy 0, policy_version 1835216 (0.0011) [2023-12-26 14:15:02,676][123090] Updated weights for policy 1, policy_version 1823368 (0.0009) [2023-12-26 14:15:02,737][123090] Updated weights for policy 1, policy_version 1823378 (0.0009) [2023-12-26 14:15:02,808][123090] Updated weights for policy 1, policy_version 1823388 (0.0009) [2023-12-26 14:15:03,319][123091] Updated weights for policy 0, policy_version 1835226 (0.0010) [2023-12-26 14:15:03,377][123091] Updated weights for policy 0, policy_version 1835236 (0.0010) [2023-12-26 14:15:03,428][123091] Updated weights for policy 0, policy_version 1835246 (0.0010) [2023-12-26 14:15:03,483][123090] Updated weights for policy 1, policy_version 1823398 (0.0009) [2023-12-26 14:15:03,531][123090] Updated weights for policy 1, policy_version 1823408 (0.0008) [2023-12-26 14:15:03,578][123090] Updated weights for policy 1, policy_version 1823418 (0.0008) [2023-12-26 14:15:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 936624128. Throughput: 0: 8790.9, 1: 8862.5. Samples: 936632760. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:03,785][121949] Avg episode reward: [(0, '6198.538'), (1, '5945.437')] [2023-12-26 14:15:04,207][123091] Updated weights for policy 0, policy_version 1835256 (0.0011) [2023-12-26 14:15:04,279][123091] Updated weights for policy 0, policy_version 1835266 (0.0011) [2023-12-26 14:15:04,342][123091] Updated weights for policy 0, policy_version 1835276 (0.0011) [2023-12-26 14:15:04,396][123090] Updated weights for policy 1, policy_version 1823429 (0.0008) [2023-12-26 14:15:04,464][123090] Updated weights for policy 1, policy_version 1823439 (0.0009) [2023-12-26 14:15:04,523][123090] Updated weights for policy 1, policy_version 1823449 (0.0009) [2023-12-26 14:15:05,065][123091] Updated weights for policy 0, policy_version 1835286 (0.0008) [2023-12-26 14:15:05,113][123091] Updated weights for policy 0, policy_version 1835296 (0.0005) [2023-12-26 14:15:05,160][123091] Updated weights for policy 0, policy_version 1835306 (0.0005) [2023-12-26 14:15:05,195][123090] Updated weights for policy 1, policy_version 1823459 (0.0006) [2023-12-26 14:15:05,263][123090] Updated weights for policy 1, policy_version 1823469 (0.0007) [2023-12-26 14:15:05,359][123090] Updated weights for policy 1, policy_version 1823479 (0.0006) [2023-12-26 14:15:05,850][123091] Updated weights for policy 0, policy_version 1835316 (0.0005) [2023-12-26 14:15:05,927][123091] Updated weights for policy 0, policy_version 1835326 (0.0006) [2023-12-26 14:15:05,980][123090] Updated weights for policy 1, policy_version 1823489 (0.0008) [2023-12-26 14:15:06,004][123091] Updated weights for policy 0, policy_version 1835336 (0.0005) [2023-12-26 14:15:06,054][123090] Updated weights for policy 1, policy_version 1823499 (0.0006) [2023-12-26 14:15:06,127][123090] Updated weights for policy 1, policy_version 1823509 (0.0009) [2023-12-26 14:15:06,195][123090] Updated weights for policy 1, policy_version 1823519 (0.0008) [2023-12-26 14:15:06,648][123091] Updated weights for policy 0, policy_version 1835346 (0.0006) [2023-12-26 14:15:06,709][123091] Updated weights for policy 0, policy_version 1835356 (0.0005) [2023-12-26 14:15:06,784][123091] Updated weights for policy 0, policy_version 1835366 (0.0005) [2023-12-26 14:15:06,857][123091] Updated weights for policy 0, policy_version 1835376 (0.0007) [2023-12-26 14:15:06,952][123090] Updated weights for policy 1, policy_version 1823529 (0.0006) [2023-12-26 14:15:07,013][123090] Updated weights for policy 1, policy_version 1823539 (0.0005) [2023-12-26 14:15:07,066][123090] Updated weights for policy 1, policy_version 1823549 (0.0007) [2023-12-26 14:15:07,562][123091] Updated weights for policy 0, policy_version 1835386 (0.0010) [2023-12-26 14:15:07,613][123091] Updated weights for policy 0, policy_version 1835396 (0.0010) [2023-12-26 14:15:07,666][123091] Updated weights for policy 0, policy_version 1835406 (0.0010) [2023-12-26 14:15:07,807][123090] Updated weights for policy 1, policy_version 1823559 (0.0010) [2023-12-26 14:15:07,862][123090] Updated weights for policy 1, policy_version 1823569 (0.0010) [2023-12-26 14:15:07,917][123090] Updated weights for policy 1, policy_version 1823579 (0.0010) [2023-12-26 14:15:08,401][123091] Updated weights for policy 0, policy_version 1835416 (0.0009) [2023-12-26 14:15:08,471][123091] Updated weights for policy 0, policy_version 1835426 (0.0009) [2023-12-26 14:15:08,536][123091] Updated weights for policy 0, policy_version 1835436 (0.0009) [2023-12-26 14:15:08,702][123090] Updated weights for policy 1, policy_version 1823589 (0.0010) [2023-12-26 14:15:08,754][123090] Updated weights for policy 1, policy_version 1823599 (0.0010) [2023-12-26 14:15:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 936714240. Throughput: 0: 8855.3, 1: 8911.6. Samples: 936690192. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:08,785][121949] Avg episode reward: [(0, '6151.735'), (1, '5907.166')] [2023-12-26 14:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001835440_469876736.pth... [2023-12-26 14:15:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001834416_469614592.pth [2023-12-26 14:15:08,806][123090] Updated weights for policy 1, policy_version 1823609 (0.0010) [2023-12-26 14:15:08,838][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001823616_466845696.pth... [2023-12-26 14:15:08,841][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001822560_466575360.pth [2023-12-26 14:15:09,311][123091] Updated weights for policy 0, policy_version 1835446 (0.0009) [2023-12-26 14:15:09,378][123091] Updated weights for policy 0, policy_version 1835456 (0.0009) [2023-12-26 14:15:09,441][123091] Updated weights for policy 0, policy_version 1835466 (0.0009) [2023-12-26 14:15:09,641][123090] Updated weights for policy 1, policy_version 1823619 (0.0010) [2023-12-26 14:15:09,690][123090] Updated weights for policy 1, policy_version 1823629 (0.0010) [2023-12-26 14:15:09,750][123090] Updated weights for policy 1, policy_version 1823639 (0.0011) [2023-12-26 14:15:10,257][123091] Updated weights for policy 0, policy_version 1835476 (0.0010) [2023-12-26 14:15:10,321][123091] Updated weights for policy 0, policy_version 1835486 (0.0010) [2023-12-26 14:15:10,377][123091] Updated weights for policy 0, policy_version 1835496 (0.0007) [2023-12-26 14:15:10,505][123090] Updated weights for policy 1, policy_version 1823649 (0.0009) [2023-12-26 14:15:10,587][123090] Updated weights for policy 1, policy_version 1823659 (0.0005) [2023-12-26 14:15:10,666][123090] Updated weights for policy 1, policy_version 1823669 (0.0005) [2023-12-26 14:15:10,745][123090] Updated weights for policy 1, policy_version 1823679 (0.0006) [2023-12-26 14:15:11,012][123091] Updated weights for policy 0, policy_version 1835506 (0.0006) [2023-12-26 14:15:11,075][123091] Updated weights for policy 0, policy_version 1835516 (0.0009) [2023-12-26 14:15:11,147][123091] Updated weights for policy 0, policy_version 1835526 (0.0009) [2023-12-26 14:15:11,208][123091] Updated weights for policy 0, policy_version 1835536 (0.0009) [2023-12-26 14:15:11,381][123090] Updated weights for policy 1, policy_version 1823689 (0.0008) [2023-12-26 14:15:11,441][123090] Updated weights for policy 1, policy_version 1823699 (0.0006) [2023-12-26 14:15:11,489][123090] Updated weights for policy 1, policy_version 1823709 (0.0005) [2023-12-26 14:15:12,137][123091] Updated weights for policy 0, policy_version 1835546 (0.0010) [2023-12-26 14:15:12,206][123091] Updated weights for policy 0, policy_version 1835556 (0.0009) [2023-12-26 14:15:12,271][123091] Updated weights for policy 0, policy_version 1835566 (0.0008) [2023-12-26 14:15:12,284][123090] Updated weights for policy 1, policy_version 1823719 (0.0008) [2023-12-26 14:15:12,360][123090] Updated weights for policy 1, policy_version 1823729 (0.0008) [2023-12-26 14:15:12,440][123090] Updated weights for policy 1, policy_version 1823739 (0.0008) [2023-12-26 14:15:13,092][123091] Updated weights for policy 0, policy_version 1835576 (0.0009) [2023-12-26 14:15:13,162][123091] Updated weights for policy 0, policy_version 1835586 (0.0010) [2023-12-26 14:15:13,203][123090] Updated weights for policy 1, policy_version 1823749 (0.0007) [2023-12-26 14:15:13,235][123091] Updated weights for policy 0, policy_version 1835596 (0.0009) [2023-12-26 14:15:13,274][123090] Updated weights for policy 1, policy_version 1823759 (0.0005) [2023-12-26 14:15:13,337][123090] Updated weights for policy 1, policy_version 1823769 (0.0007) [2023-12-26 14:15:13,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 936804352. Throughput: 0: 8801.7, 1: 8923.9. Samples: 936798540. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:13,785][121949] Avg episode reward: [(0, '6233.067'), (1, '5678.836')] [2023-12-26 14:15:13,967][123090] Updated weights for policy 1, policy_version 1823779 (0.0008) [2023-12-26 14:15:14,002][123091] Updated weights for policy 0, policy_version 1835606 (0.0007) [2023-12-26 14:15:14,022][123090] Updated weights for policy 1, policy_version 1823789 (0.0008) [2023-12-26 14:15:14,054][123091] Updated weights for policy 0, policy_version 1835616 (0.0006) [2023-12-26 14:15:14,075][123090] Updated weights for policy 1, policy_version 1823799 (0.0010) [2023-12-26 14:15:14,118][123091] Updated weights for policy 0, policy_version 1835626 (0.0007) [2023-12-26 14:15:14,824][123091] Updated weights for policy 0, policy_version 1835636 (0.0007) [2023-12-26 14:15:14,871][123090] Updated weights for policy 1, policy_version 1823809 (0.0010) [2023-12-26 14:15:14,879][123091] Updated weights for policy 0, policy_version 1835646 (0.0008) [2023-12-26 14:15:14,927][123090] Updated weights for policy 1, policy_version 1823819 (0.0008) [2023-12-26 14:15:14,930][123091] Updated weights for policy 0, policy_version 1835656 (0.0006) [2023-12-26 14:15:14,997][123090] Updated weights for policy 1, policy_version 1823829 (0.0006) [2023-12-26 14:15:15,051][123090] Updated weights for policy 1, policy_version 1823839 (0.0008) [2023-12-26 14:15:15,675][123091] Updated weights for policy 0, policy_version 1835666 (0.0007) [2023-12-26 14:15:15,744][123091] Updated weights for policy 0, policy_version 1835676 (0.0005) [2023-12-26 14:15:15,794][123090] Updated weights for policy 1, policy_version 1823849 (0.0010) [2023-12-26 14:15:15,807][123091] Updated weights for policy 0, policy_version 1835686 (0.0005) [2023-12-26 14:15:15,850][123090] Updated weights for policy 1, policy_version 1823859 (0.0010) [2023-12-26 14:15:15,873][123091] Updated weights for policy 0, policy_version 1835696 (0.0005) [2023-12-26 14:15:15,904][123090] Updated weights for policy 1, policy_version 1823869 (0.0010) [2023-12-26 14:15:16,558][123091] Updated weights for policy 0, policy_version 1835706 (0.0011) [2023-12-26 14:15:16,609][123091] Updated weights for policy 0, policy_version 1835716 (0.0010) [2023-12-26 14:15:16,619][123090] Updated weights for policy 1, policy_version 1823879 (0.0007) [2023-12-26 14:15:16,661][123091] Updated weights for policy 0, policy_version 1835726 (0.0010) [2023-12-26 14:15:16,681][123090] Updated weights for policy 1, policy_version 1823889 (0.0005) [2023-12-26 14:15:16,743][123090] Updated weights for policy 1, policy_version 1823899 (0.0005) [2023-12-26 14:15:17,348][123091] Updated weights for policy 0, policy_version 1835736 (0.0006) [2023-12-26 14:15:17,394][123091] Updated weights for policy 0, policy_version 1835746 (0.0005) [2023-12-26 14:15:17,442][123091] Updated weights for policy 0, policy_version 1835756 (0.0007) [2023-12-26 14:15:17,452][123090] Updated weights for policy 1, policy_version 1823909 (0.0007) [2023-12-26 14:15:17,514][123090] Updated weights for policy 1, policy_version 1823919 (0.0008) [2023-12-26 14:15:17,568][123090] Updated weights for policy 1, policy_version 1823929 (0.0009) [2023-12-26 14:15:18,240][123091] Updated weights for policy 0, policy_version 1835766 (0.0009) [2023-12-26 14:15:18,318][123091] Updated weights for policy 0, policy_version 1835776 (0.0009) [2023-12-26 14:15:18,332][123090] Updated weights for policy 1, policy_version 1823939 (0.0009) [2023-12-26 14:15:18,390][123091] Updated weights for policy 0, policy_version 1835786 (0.0009) [2023-12-26 14:15:18,408][123090] Updated weights for policy 1, policy_version 1823949 (0.0007) [2023-12-26 14:15:18,470][123090] Updated weights for policy 1, policy_version 1823959 (0.0006) [2023-12-26 14:15:18,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 936902656. Throughput: 0: 8858.8, 1: 8935.9. Samples: 936911132. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:18,785][121949] Avg episode reward: [(0, '6320.201'), (1, '5743.064')] [2023-12-26 14:15:19,153][123090] Updated weights for policy 1, policy_version 1823969 (0.0008) [2023-12-26 14:15:19,158][123091] Updated weights for policy 0, policy_version 1835796 (0.0008) [2023-12-26 14:15:19,216][123091] Updated weights for policy 0, policy_version 1835806 (0.0006) [2023-12-26 14:15:19,219][123090] Updated weights for policy 1, policy_version 1823979 (0.0008) [2023-12-26 14:15:19,279][123091] Updated weights for policy 0, policy_version 1835816 (0.0009) [2023-12-26 14:15:19,282][123090] Updated weights for policy 1, policy_version 1823989 (0.0010) [2023-12-26 14:15:19,338][123090] Updated weights for policy 1, policy_version 1823999 (0.0008) [2023-12-26 14:15:20,084][123091] Updated weights for policy 0, policy_version 1835826 (0.0010) [2023-12-26 14:15:20,149][123090] Updated weights for policy 1, policy_version 1824009 (0.0010) [2023-12-26 14:15:20,151][123091] Updated weights for policy 0, policy_version 1835836 (0.0008) [2023-12-26 14:15:20,212][123091] Updated weights for policy 0, policy_version 1835846 (0.0006) [2023-12-26 14:15:20,225][123090] Updated weights for policy 1, policy_version 1824019 (0.0009) [2023-12-26 14:15:20,278][123091] Updated weights for policy 0, policy_version 1835856 (0.0006) [2023-12-26 14:15:20,296][123090] Updated weights for policy 1, policy_version 1824029 (0.0009) [2023-12-26 14:15:21,084][123091] Updated weights for policy 0, policy_version 1835866 (0.0009) [2023-12-26 14:15:21,158][123091] Updated weights for policy 0, policy_version 1835876 (0.0008) [2023-12-26 14:15:21,160][123090] Updated weights for policy 1, policy_version 1824039 (0.0009) [2023-12-26 14:15:21,221][123091] Updated weights for policy 0, policy_version 1835886 (0.0008) [2023-12-26 14:15:21,235][123090] Updated weights for policy 1, policy_version 1824049 (0.0009) [2023-12-26 14:15:21,306][123090] Updated weights for policy 1, policy_version 1824059 (0.0009) [2023-12-26 14:15:22,015][123091] Updated weights for policy 0, policy_version 1835896 (0.0009) [2023-12-26 14:15:22,078][123091] Updated weights for policy 0, policy_version 1835906 (0.0010) [2023-12-26 14:15:22,132][123090] Updated weights for policy 1, policy_version 1824069 (0.0010) [2023-12-26 14:15:22,138][123091] Updated weights for policy 0, policy_version 1835916 (0.0009) [2023-12-26 14:15:22,196][123090] Updated weights for policy 1, policy_version 1824079 (0.0008) [2023-12-26 14:15:22,245][123090] Updated weights for policy 1, policy_version 1824089 (0.0009) [2023-12-26 14:15:22,974][123091] Updated weights for policy 0, policy_version 1835926 (0.0010) [2023-12-26 14:15:23,037][123091] Updated weights for policy 0, policy_version 1835936 (0.0009) [2023-12-26 14:15:23,103][123091] Updated weights for policy 0, policy_version 1835946 (0.0009) [2023-12-26 14:15:23,116][123090] Updated weights for policy 1, policy_version 1824099 (0.0010) [2023-12-26 14:15:23,182][123090] Updated weights for policy 1, policy_version 1824109 (0.0010) [2023-12-26 14:15:23,242][123090] Updated weights for policy 1, policy_version 1824119 (0.0009) [2023-12-26 14:15:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 936984576. Throughput: 0: 8833.9, 1: 8948.4. Samples: 936963612. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:23,785][121949] Avg episode reward: [(0, '6339.637'), (1, '5714.461')] [2023-12-26 14:15:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001824128_466976768.pth... [2023-12-26 14:15:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001835952_470007808.pth... [2023-12-26 14:15:23,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001823072_466706432.pth [2023-12-26 14:15:23,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001834928_469745664.pth [2023-12-26 14:15:23,953][123091] Updated weights for policy 0, policy_version 1835956 (0.0009) [2023-12-26 14:15:24,001][123091] Updated weights for policy 0, policy_version 1835966 (0.0009) [2023-12-26 14:15:24,012][123090] Updated weights for policy 1, policy_version 1824129 (0.0010) [2023-12-26 14:15:24,051][123091] Updated weights for policy 0, policy_version 1835976 (0.0007) [2023-12-26 14:15:24,058][123090] Updated weights for policy 1, policy_version 1824139 (0.0008) [2023-12-26 14:15:24,113][123090] Updated weights for policy 1, policy_version 1824149 (0.0007) [2023-12-26 14:15:24,178][123090] Updated weights for policy 1, policy_version 1824159 (0.0008) [2023-12-26 14:15:24,919][123091] Updated weights for policy 0, policy_version 1835986 (0.0007) [2023-12-26 14:15:24,932][123090] Updated weights for policy 1, policy_version 1824169 (0.0005) [2023-12-26 14:15:24,973][123091] Updated weights for policy 0, policy_version 1835996 (0.0006) [2023-12-26 14:15:24,986][123090] Updated weights for policy 1, policy_version 1824179 (0.0005) [2023-12-26 14:15:25,024][123091] Updated weights for policy 0, policy_version 1836006 (0.0006) [2023-12-26 14:15:25,049][123090] Updated weights for policy 1, policy_version 1824189 (0.0006) [2023-12-26 14:15:25,075][123091] Updated weights for policy 0, policy_version 1836016 (0.0005) [2023-12-26 14:15:25,731][123090] Updated weights for policy 1, policy_version 1824199 (0.0005) [2023-12-26 14:15:25,779][123091] Updated weights for policy 0, policy_version 1836026 (0.0006) [2023-12-26 14:15:25,784][123090] Updated weights for policy 1, policy_version 1824209 (0.0005) [2023-12-26 14:15:25,833][123091] Updated weights for policy 0, policy_version 1836036 (0.0005) [2023-12-26 14:15:25,838][123090] Updated weights for policy 1, policy_version 1824219 (0.0005) [2023-12-26 14:15:25,887][123091] Updated weights for policy 0, policy_version 1836046 (0.0005) [2023-12-26 14:15:26,499][123090] Updated weights for policy 1, policy_version 1824229 (0.0005) [2023-12-26 14:15:26,577][123090] Updated weights for policy 1, policy_version 1824239 (0.0005) [2023-12-26 14:15:26,593][123091] Updated weights for policy 0, policy_version 1836056 (0.0007) [2023-12-26 14:15:26,638][123090] Updated weights for policy 1, policy_version 1824249 (0.0006) [2023-12-26 14:15:26,649][123091] Updated weights for policy 0, policy_version 1836066 (0.0008) [2023-12-26 14:15:26,710][123091] Updated weights for policy 0, policy_version 1836076 (0.0008) [2023-12-26 14:15:27,320][123090] Updated weights for policy 1, policy_version 1824259 (0.0009) [2023-12-26 14:15:27,379][123090] Updated weights for policy 1, policy_version 1824269 (0.0006) [2023-12-26 14:15:27,443][123090] Updated weights for policy 1, policy_version 1824279 (0.0007) [2023-12-26 14:15:27,531][123091] Updated weights for policy 0, policy_version 1836086 (0.0009) [2023-12-26 14:15:27,586][123091] Updated weights for policy 0, policy_version 1836096 (0.0005) [2023-12-26 14:15:27,639][123091] Updated weights for policy 0, policy_version 1836106 (0.0005) [2023-12-26 14:15:28,288][123090] Updated weights for policy 1, policy_version 1824289 (0.0009) [2023-12-26 14:15:28,336][123091] Updated weights for policy 0, policy_version 1836116 (0.0007) [2023-12-26 14:15:28,347][123090] Updated weights for policy 1, policy_version 1824299 (0.0009) [2023-12-26 14:15:28,401][123091] Updated weights for policy 0, policy_version 1836126 (0.0008) [2023-12-26 14:15:28,416][123090] Updated weights for policy 1, policy_version 1824309 (0.0006) [2023-12-26 14:15:28,467][123091] Updated weights for policy 0, policy_version 1836136 (0.0009) [2023-12-26 14:15:28,479][123090] Updated weights for policy 1, policy_version 1824319 (0.0008) [2023-12-26 14:15:28,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 937082880. Throughput: 0: 8853.0, 1: 9006.3. Samples: 937074252. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:28,785][121949] Avg episode reward: [(0, '6337.947'), (1, '5690.763')] [2023-12-26 14:15:29,231][123090] Updated weights for policy 1, policy_version 1824329 (0.0009) [2023-12-26 14:15:29,304][123090] Updated weights for policy 1, policy_version 1824339 (0.0009) [2023-12-26 14:15:29,317][123091] Updated weights for policy 0, policy_version 1836146 (0.0006) [2023-12-26 14:15:29,380][123090] Updated weights for policy 1, policy_version 1824349 (0.0009) [2023-12-26 14:15:29,388][123091] Updated weights for policy 0, policy_version 1836156 (0.0009) [2023-12-26 14:15:29,452][123091] Updated weights for policy 0, policy_version 1836166 (0.0008) [2023-12-26 14:15:29,511][123091] Updated weights for policy 0, policy_version 1836176 (0.0010) [2023-12-26 14:15:30,225][123090] Updated weights for policy 1, policy_version 1824359 (0.0008) [2023-12-26 14:15:30,282][123090] Updated weights for policy 1, policy_version 1824369 (0.0009) [2023-12-26 14:15:30,343][123090] Updated weights for policy 1, policy_version 1824379 (0.0010) [2023-12-26 14:15:30,359][123091] Updated weights for policy 0, policy_version 1836186 (0.0008) [2023-12-26 14:15:30,414][123091] Updated weights for policy 0, policy_version 1836196 (0.0008) [2023-12-26 14:15:30,475][123091] Updated weights for policy 0, policy_version 1836206 (0.0009) [2023-12-26 14:15:31,162][123090] Updated weights for policy 1, policy_version 1824389 (0.0010) [2023-12-26 14:15:31,227][123090] Updated weights for policy 1, policy_version 1824399 (0.0009) [2023-12-26 14:15:31,295][123090] Updated weights for policy 1, policy_version 1824409 (0.0009) [2023-12-26 14:15:31,350][123091] Updated weights for policy 0, policy_version 1836216 (0.0009) [2023-12-26 14:15:31,419][123091] Updated weights for policy 0, policy_version 1836226 (0.0011) [2023-12-26 14:15:31,481][123091] Updated weights for policy 0, policy_version 1836236 (0.0011) [2023-12-26 14:15:32,141][123090] Updated weights for policy 1, policy_version 1824419 (0.0010) [2023-12-26 14:15:32,197][123090] Updated weights for policy 1, policy_version 1824429 (0.0010) [2023-12-26 14:15:32,253][123090] Updated weights for policy 1, policy_version 1824439 (0.0010) [2023-12-26 14:15:32,313][123091] Updated weights for policy 0, policy_version 1836246 (0.0009) [2023-12-26 14:15:32,386][123091] Updated weights for policy 0, policy_version 1836256 (0.0010) [2023-12-26 14:15:32,455][123091] Updated weights for policy 0, policy_version 1836266 (0.0009) [2023-12-26 14:15:33,118][123090] Updated weights for policy 1, policy_version 1824449 (0.0010) [2023-12-26 14:15:33,187][123090] Updated weights for policy 1, policy_version 1824459 (0.0010) [2023-12-26 14:15:33,242][123091] Updated weights for policy 0, policy_version 1836276 (0.0009) [2023-12-26 14:15:33,249][123090] Updated weights for policy 1, policy_version 1824469 (0.0010) [2023-12-26 14:15:33,299][123091] Updated weights for policy 0, policy_version 1836286 (0.0008) [2023-12-26 14:15:33,310][123090] Updated weights for policy 1, policy_version 1824479 (0.0005) [2023-12-26 14:15:33,348][123091] Updated weights for policy 0, policy_version 1836296 (0.0009) [2023-12-26 14:15:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 937164800. Throughput: 0: 8872.7, 1: 9016.9. Samples: 937177552. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:33,785][121949] Avg episode reward: [(0, '6341.137'), (1, '5706.033')] [2023-12-26 14:15:34,010][123091] Updated weights for policy 0, policy_version 1836307 (0.0010) [2023-12-26 14:15:34,069][123090] Updated weights for policy 1, policy_version 1824489 (0.0007) [2023-12-26 14:15:34,076][123091] Updated weights for policy 0, policy_version 1836317 (0.0009) [2023-12-26 14:15:34,132][123090] Updated weights for policy 1, policy_version 1824499 (0.0007) [2023-12-26 14:15:34,134][123091] Updated weights for policy 0, policy_version 1836327 (0.0009) [2023-12-26 14:15:34,211][123090] Updated weights for policy 1, policy_version 1824509 (0.0008) [2023-12-26 14:15:34,951][123090] Updated weights for policy 1, policy_version 1824519 (0.0009) [2023-12-26 14:15:34,984][123091] Updated weights for policy 0, policy_version 1836337 (0.0009) [2023-12-26 14:15:35,014][123090] Updated weights for policy 1, policy_version 1824529 (0.0008) [2023-12-26 14:15:35,043][123091] Updated weights for policy 0, policy_version 1836347 (0.0009) [2023-12-26 14:15:35,081][123090] Updated weights for policy 1, policy_version 1824539 (0.0008) [2023-12-26 14:15:35,106][123091] Updated weights for policy 0, policy_version 1836357 (0.0009) [2023-12-26 14:15:35,169][123091] Updated weights for policy 0, policy_version 1836367 (0.0010) [2023-12-26 14:15:35,908][123090] Updated weights for policy 1, policy_version 1824549 (0.0009) [2023-12-26 14:15:35,967][123090] Updated weights for policy 1, policy_version 1824559 (0.0008) [2023-12-26 14:15:36,014][123091] Updated weights for policy 0, policy_version 1836377 (0.0007) [2023-12-26 14:15:36,032][123090] Updated weights for policy 1, policy_version 1824569 (0.0010) [2023-12-26 14:15:36,079][123091] Updated weights for policy 0, policy_version 1836387 (0.0009) [2023-12-26 14:15:36,149][123091] Updated weights for policy 0, policy_version 1836397 (0.0008) [2023-12-26 14:15:36,882][123090] Updated weights for policy 1, policy_version 1824579 (0.0008) [2023-12-26 14:15:36,945][123090] Updated weights for policy 1, policy_version 1824589 (0.0010) [2023-12-26 14:15:36,993][123091] Updated weights for policy 0, policy_version 1836407 (0.0008) [2023-12-26 14:15:37,003][123090] Updated weights for policy 1, policy_version 1824599 (0.0009) [2023-12-26 14:15:37,043][123091] Updated weights for policy 0, policy_version 1836417 (0.0007) [2023-12-26 14:15:37,101][123091] Updated weights for policy 0, policy_version 1836427 (0.0009) [2023-12-26 14:15:37,837][123090] Updated weights for policy 1, policy_version 1824609 (0.0008) [2023-12-26 14:15:37,899][123090] Updated weights for policy 1, policy_version 1824619 (0.0009) [2023-12-26 14:15:37,914][123091] Updated weights for policy 0, policy_version 1836437 (0.0010) [2023-12-26 14:15:37,956][123090] Updated weights for policy 1, policy_version 1824629 (0.0006) [2023-12-26 14:15:37,971][123091] Updated weights for policy 0, policy_version 1836447 (0.0008) [2023-12-26 14:15:38,014][123090] Updated weights for policy 1, policy_version 1824639 (0.0008) [2023-12-26 14:15:38,035][123091] Updated weights for policy 0, policy_version 1836457 (0.0007) [2023-12-26 14:15:38,784][121949] Fps is (10 sec: 16383.4, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 937246720. Throughput: 0: 8900.2, 1: 8992.1. Samples: 937229428. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:38,785][121949] Avg episode reward: [(0, '6250.805'), (1, '5625.965')] [2023-12-26 14:15:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001836464_470138880.pth... [2023-12-26 14:15:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001824640_467107840.pth... [2023-12-26 14:15:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001823616_466845696.pth [2023-12-26 14:15:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001835440_469876736.pth [2023-12-26 14:15:38,857][123091] Updated weights for policy 0, policy_version 1836467 (0.0009) [2023-12-26 14:15:38,888][123090] Updated weights for policy 1, policy_version 1824649 (0.0008) [2023-12-26 14:15:38,904][123091] Updated weights for policy 0, policy_version 1836477 (0.0009) [2023-12-26 14:15:38,960][123090] Updated weights for policy 1, policy_version 1824659 (0.0006) [2023-12-26 14:15:38,967][123091] Updated weights for policy 0, policy_version 1836487 (0.0009) [2023-12-26 14:15:39,027][123090] Updated weights for policy 1, policy_version 1824669 (0.0006) [2023-12-26 14:15:39,820][123090] Updated weights for policy 1, policy_version 1824679 (0.0008) [2023-12-26 14:15:39,821][123091] Updated weights for policy 0, policy_version 1836497 (0.0009) [2023-12-26 14:15:39,890][123090] Updated weights for policy 1, policy_version 1824689 (0.0009) [2023-12-26 14:15:39,891][123091] Updated weights for policy 0, policy_version 1836507 (0.0011) [2023-12-26 14:15:39,955][123090] Updated weights for policy 1, policy_version 1824699 (0.0008) [2023-12-26 14:15:39,957][123091] Updated weights for policy 0, policy_version 1836517 (0.0010) [2023-12-26 14:15:40,024][123091] Updated weights for policy 0, policy_version 1836527 (0.0011) [2023-12-26 14:15:40,823][123090] Updated weights for policy 1, policy_version 1824709 (0.0006) [2023-12-26 14:15:40,833][123091] Updated weights for policy 0, policy_version 1836537 (0.0010) [2023-12-26 14:15:40,872][123090] Updated weights for policy 1, policy_version 1824719 (0.0008) [2023-12-26 14:15:40,892][123091] Updated weights for policy 0, policy_version 1836547 (0.0010) [2023-12-26 14:15:40,925][123090] Updated weights for policy 1, policy_version 1824729 (0.0006) [2023-12-26 14:15:40,955][123091] Updated weights for policy 0, policy_version 1836557 (0.0010) [2023-12-26 14:15:41,805][123091] Updated weights for policy 0, policy_version 1836567 (0.0011) [2023-12-26 14:15:41,824][123090] Updated weights for policy 1, policy_version 1824739 (0.0007) [2023-12-26 14:15:41,864][123091] Updated weights for policy 0, policy_version 1836577 (0.0011) [2023-12-26 14:15:41,884][123090] Updated weights for policy 1, policy_version 1824749 (0.0006) [2023-12-26 14:15:41,931][123091] Updated weights for policy 0, policy_version 1836587 (0.0011) [2023-12-26 14:15:41,945][123090] Updated weights for policy 1, policy_version 1824759 (0.0010) [2023-12-26 14:15:42,750][123091] Updated weights for policy 0, policy_version 1836597 (0.0010) [2023-12-26 14:15:42,798][123090] Updated weights for policy 1, policy_version 1824769 (0.0008) [2023-12-26 14:15:42,813][123091] Updated weights for policy 0, policy_version 1836607 (0.0010) [2023-12-26 14:15:42,854][123090] Updated weights for policy 1, policy_version 1824779 (0.0007) [2023-12-26 14:15:42,875][123091] Updated weights for policy 0, policy_version 1836617 (0.0010) [2023-12-26 14:15:42,917][123090] Updated weights for policy 1, policy_version 1824789 (0.0009) [2023-12-26 14:15:42,982][123090] Updated weights for policy 1, policy_version 1824799 (0.0009) [2023-12-26 14:15:43,655][123091] Updated weights for policy 0, policy_version 1836627 (0.0009) [2023-12-26 14:15:43,727][123091] Updated weights for policy 0, policy_version 1836637 (0.0006) [2023-12-26 14:15:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 937328640. Throughput: 0: 8892.3, 1: 8919.1. Samples: 937330148. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:43,785][121949] Avg episode reward: [(0, '6132.509'), (1, '5757.034')] [2023-12-26 14:15:43,793][123091] Updated weights for policy 0, policy_version 1836647 (0.0006) [2023-12-26 14:15:43,842][123090] Updated weights for policy 1, policy_version 1824809 (0.0009) [2023-12-26 14:15:43,900][123090] Updated weights for policy 1, policy_version 1824819 (0.0010) [2023-12-26 14:15:43,953][123090] Updated weights for policy 1, policy_version 1824829 (0.0011) [2023-12-26 14:15:44,556][123091] Updated weights for policy 0, policy_version 1836657 (0.0006) [2023-12-26 14:15:44,622][123091] Updated weights for policy 0, policy_version 1836667 (0.0010) [2023-12-26 14:15:44,694][123091] Updated weights for policy 0, policy_version 1836677 (0.0011) [2023-12-26 14:15:44,760][123091] Updated weights for policy 0, policy_version 1836687 (0.0010) [2023-12-26 14:15:44,823][123090] Updated weights for policy 1, policy_version 1824839 (0.0010) [2023-12-26 14:15:44,893][123090] Updated weights for policy 1, policy_version 1824849 (0.0011) [2023-12-26 14:15:44,969][123090] Updated weights for policy 1, policy_version 1824859 (0.0011) [2023-12-26 14:15:45,607][123091] Updated weights for policy 0, policy_version 1836697 (0.0010) [2023-12-26 14:15:45,676][123091] Updated weights for policy 0, policy_version 1836707 (0.0010) [2023-12-26 14:15:45,750][123091] Updated weights for policy 0, policy_version 1836717 (0.0010) [2023-12-26 14:15:45,794][123090] Updated weights for policy 1, policy_version 1824869 (0.0010) [2023-12-26 14:15:45,847][123090] Updated weights for policy 1, policy_version 1824879 (0.0008) [2023-12-26 14:15:45,903][123090] Updated weights for policy 1, policy_version 1824889 (0.0009) [2023-12-26 14:15:46,425][123091] Updated weights for policy 0, policy_version 1836727 (0.0010) [2023-12-26 14:15:46,488][123091] Updated weights for policy 0, policy_version 1836737 (0.0009) [2023-12-26 14:15:46,551][123091] Updated weights for policy 0, policy_version 1836747 (0.0008) [2023-12-26 14:15:46,759][123090] Updated weights for policy 1, policy_version 1824899 (0.0009) [2023-12-26 14:15:46,809][123090] Updated weights for policy 1, policy_version 1824909 (0.0005) [2023-12-26 14:15:46,867][123090] Updated weights for policy 1, policy_version 1824919 (0.0005) [2023-12-26 14:15:47,312][123091] Updated weights for policy 0, policy_version 1836757 (0.0007) [2023-12-26 14:15:47,376][123091] Updated weights for policy 0, policy_version 1836767 (0.0005) [2023-12-26 14:15:47,453][123091] Updated weights for policy 0, policy_version 1836777 (0.0005) [2023-12-26 14:15:47,658][123090] Updated weights for policy 1, policy_version 1824929 (0.0006) [2023-12-26 14:15:47,713][123090] Updated weights for policy 1, policy_version 1824939 (0.0005) [2023-12-26 14:15:47,777][123090] Updated weights for policy 1, policy_version 1824949 (0.0008) [2023-12-26 14:15:47,832][123090] Updated weights for policy 1, policy_version 1824959 (0.0010) [2023-12-26 14:15:48,139][123091] Updated weights for policy 0, policy_version 1836787 (0.0006) [2023-12-26 14:15:48,205][123091] Updated weights for policy 0, policy_version 1836797 (0.0008) [2023-12-26 14:15:48,253][123091] Updated weights for policy 0, policy_version 1836807 (0.0009) [2023-12-26 14:15:48,665][123090] Updated weights for policy 1, policy_version 1824969 (0.0010) [2023-12-26 14:15:48,732][123090] Updated weights for policy 1, policy_version 1824979 (0.0011) [2023-12-26 14:15:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 937418752. Throughput: 0: 8934.3, 1: 8896.6. Samples: 937435152. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:48,785][121949] Avg episode reward: [(0, '6227.810'), (1, '5764.163')] [2023-12-26 14:15:48,798][123090] Updated weights for policy 1, policy_version 1824989 (0.0010) [2023-12-26 14:15:49,115][123091] Updated weights for policy 0, policy_version 1836817 (0.0009) [2023-12-26 14:15:49,163][123091] Updated weights for policy 0, policy_version 1836827 (0.0009) [2023-12-26 14:15:49,212][123091] Updated weights for policy 0, policy_version 1836838 (0.0009) [2023-12-26 14:15:49,281][123091] Updated weights for policy 0, policy_version 1836848 (0.0009) [2023-12-26 14:15:49,628][123090] Updated weights for policy 1, policy_version 1824999 (0.0010) [2023-12-26 14:15:49,699][123090] Updated weights for policy 1, policy_version 1825009 (0.0011) [2023-12-26 14:15:49,770][123090] Updated weights for policy 1, policy_version 1825019 (0.0009) [2023-12-26 14:15:50,161][123091] Updated weights for policy 0, policy_version 1836858 (0.0009) [2023-12-26 14:15:50,227][123091] Updated weights for policy 0, policy_version 1836868 (0.0009) [2023-12-26 14:15:50,290][123091] Updated weights for policy 0, policy_version 1836878 (0.0008) [2023-12-26 14:15:50,565][123090] Updated weights for policy 1, policy_version 1825029 (0.0008) [2023-12-26 14:15:50,635][123090] Updated weights for policy 1, policy_version 1825039 (0.0011) [2023-12-26 14:15:50,703][123090] Updated weights for policy 1, policy_version 1825049 (0.0011) [2023-12-26 14:15:51,060][123091] Updated weights for policy 0, policy_version 1836888 (0.0008) [2023-12-26 14:15:51,135][123091] Updated weights for policy 0, policy_version 1836898 (0.0008) [2023-12-26 14:15:51,206][123091] Updated weights for policy 0, policy_version 1836908 (0.0007) [2023-12-26 14:15:51,467][123090] Updated weights for policy 1, policy_version 1825059 (0.0010) [2023-12-26 14:15:51,527][123090] Updated weights for policy 1, policy_version 1825069 (0.0009) [2023-12-26 14:15:51,589][123090] Updated weights for policy 1, policy_version 1825079 (0.0010) [2023-12-26 14:15:52,038][123091] Updated weights for policy 0, policy_version 1836918 (0.0009) [2023-12-26 14:15:52,096][123091] Updated weights for policy 0, policy_version 1836928 (0.0010) [2023-12-26 14:15:52,155][123091] Updated weights for policy 0, policy_version 1836938 (0.0010) [2023-12-26 14:15:52,374][123090] Updated weights for policy 1, policy_version 1825089 (0.0009) [2023-12-26 14:15:52,430][123090] Updated weights for policy 1, policy_version 1825099 (0.0009) [2023-12-26 14:15:52,486][123090] Updated weights for policy 1, policy_version 1825109 (0.0010) [2023-12-26 14:15:52,546][123090] Updated weights for policy 1, policy_version 1825119 (0.0010) [2023-12-26 14:15:53,031][123091] Updated weights for policy 0, policy_version 1836948 (0.0010) [2023-12-26 14:15:53,101][123091] Updated weights for policy 0, policy_version 1836958 (0.0009) [2023-12-26 14:15:53,164][123091] Updated weights for policy 0, policy_version 1836968 (0.0010) [2023-12-26 14:15:53,357][123090] Updated weights for policy 1, policy_version 1825129 (0.0009) [2023-12-26 14:15:53,412][123090] Updated weights for policy 1, policy_version 1825139 (0.0009) [2023-12-26 14:15:53,473][123090] Updated weights for policy 1, policy_version 1825149 (0.0010) [2023-12-26 14:15:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 937508864. Throughput: 0: 8867.5, 1: 8826.5. Samples: 937486420. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:53,785][121949] Avg episode reward: [(0, '6328.521'), (1, '5798.679')] [2023-12-26 14:15:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001836976_470269952.pth... [2023-12-26 14:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001825152_467238912.pth... [2023-12-26 14:15:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001835952_470007808.pth [2023-12-26 14:15:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001824128_466976768.pth [2023-12-26 14:15:53,988][123091] Updated weights for policy 0, policy_version 1836978 (0.0009) [2023-12-26 14:15:54,052][123091] Updated weights for policy 0, policy_version 1836988 (0.0006) [2023-12-26 14:15:54,108][123091] Updated weights for policy 0, policy_version 1836999 (0.0009) [2023-12-26 14:15:54,326][123090] Updated weights for policy 1, policy_version 1825159 (0.0010) [2023-12-26 14:15:54,374][123090] Updated weights for policy 1, policy_version 1825170 (0.0007) [2023-12-26 14:15:54,446][123090] Updated weights for policy 1, policy_version 1825180 (0.0010) [2023-12-26 14:15:54,887][123091] Updated weights for policy 0, policy_version 1837009 (0.0009) [2023-12-26 14:15:54,958][123091] Updated weights for policy 0, policy_version 1837019 (0.0006) [2023-12-26 14:15:55,018][123091] Updated weights for policy 0, policy_version 1837029 (0.0009) [2023-12-26 14:15:55,079][123091] Updated weights for policy 0, policy_version 1837039 (0.0009) [2023-12-26 14:15:55,193][123090] Updated weights for policy 1, policy_version 1825190 (0.0009) [2023-12-26 14:15:55,259][123090] Updated weights for policy 1, policy_version 1825200 (0.0006) [2023-12-26 14:15:55,317][123090] Updated weights for policy 1, policy_version 1825210 (0.0005) [2023-12-26 14:15:55,887][123091] Updated weights for policy 0, policy_version 1837049 (0.0009) [2023-12-26 14:15:55,954][123091] Updated weights for policy 0, policy_version 1837059 (0.0009) [2023-12-26 14:15:56,020][123091] Updated weights for policy 0, policy_version 1837069 (0.0010) [2023-12-26 14:15:56,054][123090] Updated weights for policy 1, policy_version 1825220 (0.0008) [2023-12-26 14:15:56,124][123090] Updated weights for policy 1, policy_version 1825230 (0.0009) [2023-12-26 14:15:56,186][123090] Updated weights for policy 1, policy_version 1825240 (0.0008) [2023-12-26 14:15:56,836][123091] Updated weights for policy 0, policy_version 1837079 (0.0010) [2023-12-26 14:15:56,900][123091] Updated weights for policy 0, policy_version 1837089 (0.0008) [2023-12-26 14:15:56,952][123090] Updated weights for policy 1, policy_version 1825250 (0.0008) [2023-12-26 14:15:56,962][123091] Updated weights for policy 0, policy_version 1837099 (0.0009) [2023-12-26 14:15:57,003][123090] Updated weights for policy 1, policy_version 1825260 (0.0007) [2023-12-26 14:15:57,057][123090] Updated weights for policy 1, policy_version 1825270 (0.0009) [2023-12-26 14:15:57,106][123090] Updated weights for policy 1, policy_version 1825280 (0.0009) [2023-12-26 14:15:57,800][123091] Updated weights for policy 0, policy_version 1837109 (0.0010) [2023-12-26 14:15:57,873][123091] Updated weights for policy 0, policy_version 1837119 (0.0010) [2023-12-26 14:15:57,917][123090] Updated weights for policy 1, policy_version 1825290 (0.0005) [2023-12-26 14:15:57,942][123091] Updated weights for policy 0, policy_version 1837129 (0.0009) [2023-12-26 14:15:57,962][123090] Updated weights for policy 1, policy_version 1825300 (0.0005) [2023-12-26 14:15:58,012][123090] Updated weights for policy 1, policy_version 1825310 (0.0005) [2023-12-26 14:15:58,764][123091] Updated weights for policy 0, policy_version 1837139 (0.0009) [2023-12-26 14:15:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 937590784. Throughput: 0: 8809.4, 1: 8807.0. Samples: 937591272. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:15:58,785][121949] Avg episode reward: [(0, '6302.752'), (1, '5576.933')] [2023-12-26 14:15:58,835][123091] Updated weights for policy 0, policy_version 1837149 (0.0011) [2023-12-26 14:15:58,878][123090] Updated weights for policy 1, policy_version 1825320 (0.0007) [2023-12-26 14:15:58,894][123091] Updated weights for policy 0, policy_version 1837159 (0.0011) [2023-12-26 14:15:58,945][123090] Updated weights for policy 1, policy_version 1825330 (0.0007) [2023-12-26 14:15:59,015][123090] Updated weights for policy 1, policy_version 1825340 (0.0007) [2023-12-26 14:15:59,635][123091] Updated weights for policy 0, policy_version 1837169 (0.0009) [2023-12-26 14:15:59,696][123091] Updated weights for policy 0, policy_version 1837179 (0.0008) [2023-12-26 14:15:59,766][123091] Updated weights for policy 0, policy_version 1837189 (0.0005) [2023-12-26 14:15:59,838][123091] Updated weights for policy 0, policy_version 1837199 (0.0007) [2023-12-26 14:15:59,870][123090] Updated weights for policy 1, policy_version 1825350 (0.0009) [2023-12-26 14:15:59,923][123090] Updated weights for policy 1, policy_version 1825360 (0.0009) [2023-12-26 14:15:59,985][123090] Updated weights for policy 1, policy_version 1825370 (0.0008) [2023-12-26 14:16:00,577][123091] Updated weights for policy 0, policy_version 1837209 (0.0006) [2023-12-26 14:16:00,634][123091] Updated weights for policy 0, policy_version 1837219 (0.0006) [2023-12-26 14:16:00,688][123091] Updated weights for policy 0, policy_version 1837229 (0.0006) [2023-12-26 14:16:00,858][123090] Updated weights for policy 1, policy_version 1825380 (0.0007) [2023-12-26 14:16:00,912][123090] Updated weights for policy 1, policy_version 1825390 (0.0005) [2023-12-26 14:16:00,974][123090] Updated weights for policy 1, policy_version 1825400 (0.0005) [2023-12-26 14:16:01,480][123091] Updated weights for policy 0, policy_version 1837239 (0.0009) [2023-12-26 14:16:01,546][123091] Updated weights for policy 0, policy_version 1837249 (0.0011) [2023-12-26 14:16:01,606][123091] Updated weights for policy 0, policy_version 1837259 (0.0010) [2023-12-26 14:16:01,703][123090] Updated weights for policy 1, policy_version 1825410 (0.0007) [2023-12-26 14:16:01,762][123090] Updated weights for policy 1, policy_version 1825420 (0.0009) [2023-12-26 14:16:01,831][123090] Updated weights for policy 1, policy_version 1825430 (0.0005) [2023-12-26 14:16:01,899][123090] Updated weights for policy 1, policy_version 1825440 (0.0005) [2023-12-26 14:16:02,396][123091] Updated weights for policy 0, policy_version 1837269 (0.0011) [2023-12-26 14:16:02,470][123091] Updated weights for policy 0, policy_version 1837279 (0.0007) [2023-12-26 14:16:02,541][123091] Updated weights for policy 0, policy_version 1837289 (0.0009) [2023-12-26 14:16:02,683][123090] Updated weights for policy 1, policy_version 1825450 (0.0006) [2023-12-26 14:16:02,750][123090] Updated weights for policy 1, policy_version 1825460 (0.0006) [2023-12-26 14:16:02,823][123090] Updated weights for policy 1, policy_version 1825470 (0.0008) [2023-12-26 14:16:03,301][123091] Updated weights for policy 0, policy_version 1837299 (0.0009) [2023-12-26 14:16:03,356][123091] Updated weights for policy 0, policy_version 1837309 (0.0006) [2023-12-26 14:16:03,418][123091] Updated weights for policy 0, policy_version 1837319 (0.0006) [2023-12-26 14:16:03,547][123090] Updated weights for policy 1, policy_version 1825480 (0.0006) [2023-12-26 14:16:03,604][123090] Updated weights for policy 1, policy_version 1825490 (0.0005) [2023-12-26 14:16:03,654][123090] Updated weights for policy 1, policy_version 1825500 (0.0005) [2023-12-26 14:16:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 937689088. Throughput: 0: 8757.4, 1: 8723.0. Samples: 937697748. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:03,785][121949] Avg episode reward: [(0, '6296.795'), (1, '5674.996')] [2023-12-26 14:16:04,188][123091] Updated weights for policy 0, policy_version 1837329 (0.0006) [2023-12-26 14:16:04,238][123091] Updated weights for policy 0, policy_version 1837339 (0.0006) [2023-12-26 14:16:04,294][123091] Updated weights for policy 0, policy_version 1837349 (0.0009) [2023-12-26 14:16:04,316][123090] Updated weights for policy 1, policy_version 1825510 (0.0005) [2023-12-26 14:16:04,350][123091] Updated weights for policy 0, policy_version 1837359 (0.0011) [2023-12-26 14:16:04,378][123090] Updated weights for policy 1, policy_version 1825520 (0.0006) [2023-12-26 14:16:04,447][123090] Updated weights for policy 1, policy_version 1825530 (0.0010) [2023-12-26 14:16:05,106][123091] Updated weights for policy 0, policy_version 1837369 (0.0009) [2023-12-26 14:16:05,166][123091] Updated weights for policy 0, policy_version 1837379 (0.0006) [2023-12-26 14:16:05,222][123091] Updated weights for policy 0, policy_version 1837389 (0.0008) [2023-12-26 14:16:05,262][123090] Updated weights for policy 1, policy_version 1825540 (0.0010) [2023-12-26 14:16:05,332][123090] Updated weights for policy 1, policy_version 1825550 (0.0007) [2023-12-26 14:16:05,398][123090] Updated weights for policy 1, policy_version 1825560 (0.0008) [2023-12-26 14:16:05,874][123091] Updated weights for policy 0, policy_version 1837399 (0.0009) [2023-12-26 14:16:05,925][123091] Updated weights for policy 0, policy_version 1837409 (0.0011) [2023-12-26 14:16:05,984][123091] Updated weights for policy 0, policy_version 1837419 (0.0011) [2023-12-26 14:16:06,028][123090] Updated weights for policy 1, policy_version 1825570 (0.0008) [2023-12-26 14:16:06,105][123090] Updated weights for policy 1, policy_version 1825580 (0.0006) [2023-12-26 14:16:06,167][123090] Updated weights for policy 1, policy_version 1825590 (0.0007) [2023-12-26 14:16:06,221][123090] Updated weights for policy 1, policy_version 1825600 (0.0007) [2023-12-26 14:16:06,846][123091] Updated weights for policy 0, policy_version 1837429 (0.0011) [2023-12-26 14:16:06,897][123091] Updated weights for policy 0, policy_version 1837439 (0.0010) [2023-12-26 14:16:06,952][123091] Updated weights for policy 0, policy_version 1837449 (0.0010) [2023-12-26 14:16:07,032][123090] Updated weights for policy 1, policy_version 1825610 (0.0008) [2023-12-26 14:16:07,093][123090] Updated weights for policy 1, policy_version 1825620 (0.0009) [2023-12-26 14:16:07,154][123090] Updated weights for policy 1, policy_version 1825630 (0.0009) [2023-12-26 14:16:07,727][123091] Updated weights for policy 0, policy_version 1837459 (0.0009) [2023-12-26 14:16:07,774][123091] Updated weights for policy 0, policy_version 1837469 (0.0005) [2023-12-26 14:16:07,828][123091] Updated weights for policy 0, policy_version 1837479 (0.0005) [2023-12-26 14:16:07,924][123090] Updated weights for policy 1, policy_version 1825640 (0.0006) [2023-12-26 14:16:07,973][123090] Updated weights for policy 1, policy_version 1825650 (0.0005) [2023-12-26 14:16:08,028][123090] Updated weights for policy 1, policy_version 1825660 (0.0007) [2023-12-26 14:16:08,641][123091] Updated weights for policy 0, policy_version 1837489 (0.0006) [2023-12-26 14:16:08,709][123091] Updated weights for policy 0, policy_version 1837499 (0.0010) [2023-12-26 14:16:08,763][123090] Updated weights for policy 1, policy_version 1825670 (0.0007) [2023-12-26 14:16:08,772][123091] Updated weights for policy 0, policy_version 1837509 (0.0009) [2023-12-26 14:16:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 937771008. Throughput: 0: 8777.9, 1: 8765.0. Samples: 937753040. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:08,785][121949] Avg episode reward: [(0, '6336.467'), (1, '5711.822')] [2023-12-26 14:16:08,820][123090] Updated weights for policy 1, policy_version 1825680 (0.0007) [2023-12-26 14:16:08,831][123091] Updated weights for policy 0, policy_version 1837519 (0.0010) [2023-12-26 14:16:08,834][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001837520_470409216.pth... [2023-12-26 14:16:08,839][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001836464_470138880.pth [2023-12-26 14:16:08,891][123090] Updated weights for policy 1, policy_version 1825690 (0.0010) [2023-12-26 14:16:08,927][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001825696_467378176.pth... [2023-12-26 14:16:08,931][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001824640_467107840.pth [2023-12-26 14:16:09,712][123091] Updated weights for policy 0, policy_version 1837529 (0.0010) [2023-12-26 14:16:09,752][123090] Updated weights for policy 1, policy_version 1825700 (0.0007) [2023-12-26 14:16:09,779][123091] Updated weights for policy 0, policy_version 1837539 (0.0011) [2023-12-26 14:16:09,817][123090] Updated weights for policy 1, policy_version 1825710 (0.0007) [2023-12-26 14:16:09,844][123091] Updated weights for policy 0, policy_version 1837549 (0.0010) [2023-12-26 14:16:09,890][123090] Updated weights for policy 1, policy_version 1825720 (0.0009) [2023-12-26 14:16:10,673][123091] Updated weights for policy 0, policy_version 1837559 (0.0011) [2023-12-26 14:16:10,739][123091] Updated weights for policy 0, policy_version 1837569 (0.0011) [2023-12-26 14:16:10,746][123090] Updated weights for policy 1, policy_version 1825730 (0.0009) [2023-12-26 14:16:10,796][123091] Updated weights for policy 0, policy_version 1837579 (0.0008) [2023-12-26 14:16:10,802][123090] Updated weights for policy 1, policy_version 1825740 (0.0009) [2023-12-26 14:16:10,856][123090] Updated weights for policy 1, policy_version 1825750 (0.0008) [2023-12-26 14:16:10,911][123090] Updated weights for policy 1, policy_version 1825760 (0.0009) [2023-12-26 14:16:11,624][123091] Updated weights for policy 0, policy_version 1837589 (0.0010) [2023-12-26 14:16:11,690][123091] Updated weights for policy 0, policy_version 1837599 (0.0010) [2023-12-26 14:16:11,758][123091] Updated weights for policy 0, policy_version 1837609 (0.0009) [2023-12-26 14:16:11,783][123090] Updated weights for policy 1, policy_version 1825770 (0.0007) [2023-12-26 14:16:11,846][123090] Updated weights for policy 1, policy_version 1825780 (0.0009) [2023-12-26 14:16:11,909][123090] Updated weights for policy 1, policy_version 1825790 (0.0010) [2023-12-26 14:16:12,617][123091] Updated weights for policy 0, policy_version 1837619 (0.0009) [2023-12-26 14:16:12,667][123091] Updated weights for policy 0, policy_version 1837629 (0.0010) [2023-12-26 14:16:12,713][123091] Updated weights for policy 0, policy_version 1837639 (0.0009) [2023-12-26 14:16:12,725][123090] Updated weights for policy 1, policy_version 1825800 (0.0008) [2023-12-26 14:16:12,786][123090] Updated weights for policy 1, policy_version 1825810 (0.0007) [2023-12-26 14:16:12,841][123090] Updated weights for policy 1, policy_version 1825820 (0.0009) [2023-12-26 14:16:13,503][123091] Updated weights for policy 0, policy_version 1837649 (0.0010) [2023-12-26 14:16:13,560][123091] Updated weights for policy 0, policy_version 1837659 (0.0009) [2023-12-26 14:16:13,632][123091] Updated weights for policy 0, policy_version 1837669 (0.0010) [2023-12-26 14:16:13,677][123090] Updated weights for policy 1, policy_version 1825830 (0.0010) [2023-12-26 14:16:13,687][123091] Updated weights for policy 0, policy_version 1837679 (0.0010) [2023-12-26 14:16:13,736][123090] Updated weights for policy 1, policy_version 1825840 (0.0010) [2023-12-26 14:16:13,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 937861120. Throughput: 0: 8703.6, 1: 8678.4. Samples: 937856444. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:13,784][121949] Avg episode reward: [(0, '6346.531'), (1, '5464.861')] [2023-12-26 14:16:13,796][123090] Updated weights for policy 1, policy_version 1825850 (0.0010) [2023-12-26 14:16:14,511][123091] Updated weights for policy 0, policy_version 1837689 (0.0009) [2023-12-26 14:16:14,569][123091] Updated weights for policy 0, policy_version 1837699 (0.0010) [2023-12-26 14:16:14,620][123090] Updated weights for policy 1, policy_version 1825860 (0.0008) [2023-12-26 14:16:14,627][123091] Updated weights for policy 0, policy_version 1837709 (0.0009) [2023-12-26 14:16:14,686][123090] Updated weights for policy 1, policy_version 1825870 (0.0006) [2023-12-26 14:16:14,758][123090] Updated weights for policy 1, policy_version 1825880 (0.0007) [2023-12-26 14:16:15,493][123090] Updated weights for policy 1, policy_version 1825890 (0.0010) [2023-12-26 14:16:15,522][123091] Updated weights for policy 0, policy_version 1837719 (0.0009) [2023-12-26 14:16:15,553][123090] Updated weights for policy 1, policy_version 1825900 (0.0011) [2023-12-26 14:16:15,587][123091] Updated weights for policy 0, policy_version 1837729 (0.0006) [2023-12-26 14:16:15,618][123090] Updated weights for policy 1, policy_version 1825910 (0.0011) [2023-12-26 14:16:15,650][123091] Updated weights for policy 0, policy_version 1837739 (0.0006) [2023-12-26 14:16:15,682][123090] Updated weights for policy 1, policy_version 1825920 (0.0011) [2023-12-26 14:16:16,336][123090] Updated weights for policy 1, policy_version 1825930 (0.0005) [2023-12-26 14:16:16,398][123090] Updated weights for policy 1, policy_version 1825940 (0.0008) [2023-12-26 14:16:16,455][123090] Updated weights for policy 1, policy_version 1825950 (0.0011) [2023-12-26 14:16:16,485][123091] Updated weights for policy 0, policy_version 1837749 (0.0007) [2023-12-26 14:16:16,534][123091] Updated weights for policy 0, policy_version 1837759 (0.0008) [2023-12-26 14:16:16,595][123091] Updated weights for policy 0, policy_version 1837769 (0.0009) [2023-12-26 14:16:17,074][123090] Updated weights for policy 1, policy_version 1825960 (0.0006) [2023-12-26 14:16:17,126][123090] Updated weights for policy 1, policy_version 1825970 (0.0008) [2023-12-26 14:16:17,181][123090] Updated weights for policy 1, policy_version 1825980 (0.0010) [2023-12-26 14:16:17,496][123091] Updated weights for policy 0, policy_version 1837779 (0.0009) [2023-12-26 14:16:17,552][123091] Updated weights for policy 0, policy_version 1837789 (0.0009) [2023-12-26 14:16:17,611][123091] Updated weights for policy 0, policy_version 1837799 (0.0009) [2023-12-26 14:16:17,885][123090] Updated weights for policy 1, policy_version 1825990 (0.0008) [2023-12-26 14:16:17,947][123090] Updated weights for policy 1, policy_version 1826000 (0.0006) [2023-12-26 14:16:18,012][123090] Updated weights for policy 1, policy_version 1826010 (0.0006) [2023-12-26 14:16:18,535][123091] Updated weights for policy 0, policy_version 1837809 (0.0010) [2023-12-26 14:16:18,600][123091] Updated weights for policy 0, policy_version 1837819 (0.0009) [2023-12-26 14:16:18,660][123091] Updated weights for policy 0, policy_version 1837829 (0.0008) [2023-12-26 14:16:18,724][123091] Updated weights for policy 0, policy_version 1837839 (0.0008) [2023-12-26 14:16:18,759][123090] Updated weights for policy 1, policy_version 1826020 (0.0008) [2023-12-26 14:16:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17772.5). Total num frames: 937951232. Throughput: 0: 8655.6, 1: 8782.6. Samples: 937962268. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:18,784][121949] Avg episode reward: [(0, '6374.418'), (1, '5531.590')] [2023-12-26 14:16:18,827][123090] Updated weights for policy 1, policy_version 1826030 (0.0011) [2023-12-26 14:16:18,894][123090] Updated weights for policy 1, policy_version 1826040 (0.0011) [2023-12-26 14:16:19,581][123091] Updated weights for policy 0, policy_version 1837849 (0.0009) [2023-12-26 14:16:19,639][123091] Updated weights for policy 0, policy_version 1837859 (0.0007) [2023-12-26 14:16:19,684][123090] Updated weights for policy 1, policy_version 1826050 (0.0010) [2023-12-26 14:16:19,690][123091] Updated weights for policy 0, policy_version 1837869 (0.0005) [2023-12-26 14:16:19,744][123090] Updated weights for policy 1, policy_version 1826060 (0.0010) [2023-12-26 14:16:19,805][123090] Updated weights for policy 1, policy_version 1826070 (0.0009) [2023-12-26 14:16:19,872][123090] Updated weights for policy 1, policy_version 1826080 (0.0010) [2023-12-26 14:16:20,528][123091] Updated weights for policy 0, policy_version 1837879 (0.0008) [2023-12-26 14:16:20,596][123091] Updated weights for policy 0, policy_version 1837889 (0.0009) [2023-12-26 14:16:20,666][123091] Updated weights for policy 0, policy_version 1837899 (0.0009) [2023-12-26 14:16:20,713][123090] Updated weights for policy 1, policy_version 1826090 (0.0010) [2023-12-26 14:16:20,769][123090] Updated weights for policy 1, policy_version 1826100 (0.0009) [2023-12-26 14:16:20,831][123090] Updated weights for policy 1, policy_version 1826110 (0.0009) [2023-12-26 14:16:21,466][123091] Updated weights for policy 0, policy_version 1837909 (0.0009) [2023-12-26 14:16:21,526][123091] Updated weights for policy 0, policy_version 1837919 (0.0009) [2023-12-26 14:16:21,590][123091] Updated weights for policy 0, policy_version 1837929 (0.0009) [2023-12-26 14:16:21,713][123090] Updated weights for policy 1, policy_version 1826120 (0.0008) [2023-12-26 14:16:21,781][123090] Updated weights for policy 1, policy_version 1826130 (0.0008) [2023-12-26 14:16:21,844][123090] Updated weights for policy 1, policy_version 1826140 (0.0008) [2023-12-26 14:16:22,522][123091] Updated weights for policy 0, policy_version 1837939 (0.0010) [2023-12-26 14:16:22,581][123091] Updated weights for policy 0, policy_version 1837949 (0.0008) [2023-12-26 14:16:22,632][123090] Updated weights for policy 1, policy_version 1826150 (0.0008) [2023-12-26 14:16:22,634][123091] Updated weights for policy 0, policy_version 1837959 (0.0010) [2023-12-26 14:16:22,686][123090] Updated weights for policy 1, policy_version 1826160 (0.0009) [2023-12-26 14:16:22,736][123090] Updated weights for policy 1, policy_version 1826170 (0.0009) [2023-12-26 14:16:23,383][123091] Updated weights for policy 0, policy_version 1837969 (0.0007) [2023-12-26 14:16:23,443][123091] Updated weights for policy 0, policy_version 1837979 (0.0009) [2023-12-26 14:16:23,490][123091] Updated weights for policy 0, policy_version 1837989 (0.0009) [2023-12-26 14:16:23,550][123091] Updated weights for policy 0, policy_version 1837999 (0.0010) [2023-12-26 14:16:23,624][123090] Updated weights for policy 1, policy_version 1826180 (0.0007) [2023-12-26 14:16:23,672][123090] Updated weights for policy 1, policy_version 1826190 (0.0005) [2023-12-26 14:16:23,721][123090] Updated weights for policy 1, policy_version 1826200 (0.0005) [2023-12-26 14:16:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 938041344. Throughput: 0: 8629.2, 1: 8766.9. Samples: 938012248. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:23,784][121949] Avg episode reward: [(0, '6390.381'), (1, '5761.552')] [2023-12-26 14:16:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001826208_467509248.pth... [2023-12-26 14:16:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001838000_470532096.pth... [2023-12-26 14:16:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001825152_467238912.pth [2023-12-26 14:16:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001836976_470269952.pth [2023-12-26 14:16:24,432][123090] Updated weights for policy 1, policy_version 1826210 (0.0005) [2023-12-26 14:16:24,434][123091] Updated weights for policy 0, policy_version 1838009 (0.0009) [2023-12-26 14:16:24,492][123090] Updated weights for policy 1, policy_version 1826220 (0.0007) [2023-12-26 14:16:24,493][123091] Updated weights for policy 0, policy_version 1838019 (0.0009) [2023-12-26 14:16:24,544][123090] Updated weights for policy 1, policy_version 1826230 (0.0007) [2023-12-26 14:16:24,547][123091] Updated weights for policy 0, policy_version 1838029 (0.0009) [2023-12-26 14:16:24,600][123090] Updated weights for policy 1, policy_version 1826240 (0.0008) [2023-12-26 14:16:25,278][123091] Updated weights for policy 0, policy_version 1838039 (0.0008) [2023-12-26 14:16:25,343][123091] Updated weights for policy 0, policy_version 1838049 (0.0009) [2023-12-26 14:16:25,394][123090] Updated weights for policy 1, policy_version 1826250 (0.0010) [2023-12-26 14:16:25,401][123091] Updated weights for policy 0, policy_version 1838059 (0.0008) [2023-12-26 14:16:25,447][123090] Updated weights for policy 1, policy_version 1826260 (0.0007) [2023-12-26 14:16:25,521][123090] Updated weights for policy 1, policy_version 1826270 (0.0009) [2023-12-26 14:16:26,224][123091] Updated weights for policy 0, policy_version 1838069 (0.0010) [2023-12-26 14:16:26,252][123090] Updated weights for policy 1, policy_version 1826280 (0.0007) [2023-12-26 14:16:26,287][123091] Updated weights for policy 0, policy_version 1838079 (0.0009) [2023-12-26 14:16:26,312][123090] Updated weights for policy 1, policy_version 1826290 (0.0007) [2023-12-26 14:16:26,346][123091] Updated weights for policy 0, policy_version 1838089 (0.0008) [2023-12-26 14:16:26,367][123090] Updated weights for policy 1, policy_version 1826300 (0.0008) [2023-12-26 14:16:27,174][123091] Updated weights for policy 0, policy_version 1838099 (0.0010) [2023-12-26 14:16:27,193][123090] Updated weights for policy 1, policy_version 1826310 (0.0007) [2023-12-26 14:16:27,221][123091] Updated weights for policy 0, policy_version 1838109 (0.0010) [2023-12-26 14:16:27,253][123090] Updated weights for policy 1, policy_version 1826320 (0.0006) [2023-12-26 14:16:27,268][123091] Updated weights for policy 0, policy_version 1838119 (0.0010) [2023-12-26 14:16:27,301][123090] Updated weights for policy 1, policy_version 1826330 (0.0007) [2023-12-26 14:16:28,058][123091] Updated weights for policy 0, policy_version 1838129 (0.0010) [2023-12-26 14:16:28,066][123090] Updated weights for policy 1, policy_version 1826340 (0.0007) [2023-12-26 14:16:28,111][123091] Updated weights for policy 0, policy_version 1838139 (0.0006) [2023-12-26 14:16:28,121][123090] Updated weights for policy 1, policy_version 1826350 (0.0005) [2023-12-26 14:16:28,164][123091] Updated weights for policy 0, policy_version 1838149 (0.0006) [2023-12-26 14:16:28,186][123090] Updated weights for policy 1, policy_version 1826360 (0.0005) [2023-12-26 14:16:28,210][123091] Updated weights for policy 0, policy_version 1838159 (0.0005) [2023-12-26 14:16:28,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17689.2). Total num frames: 938123264. Throughput: 0: 8649.9, 1: 8857.7. Samples: 938117988. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:28,785][121949] Avg episode reward: [(0, '6339.523'), (1, '5687.758')] [2023-12-26 14:16:28,859][123090] Updated weights for policy 1, policy_version 1826370 (0.0005) [2023-12-26 14:16:28,915][123091] Updated weights for policy 0, policy_version 1838169 (0.0009) [2023-12-26 14:16:28,921][123090] Updated weights for policy 1, policy_version 1826380 (0.0007) [2023-12-26 14:16:28,967][123090] Updated weights for policy 1, policy_version 1826390 (0.0007) [2023-12-26 14:16:28,977][123091] Updated weights for policy 0, policy_version 1838179 (0.0010) [2023-12-26 14:16:29,020][123090] Updated weights for policy 1, policy_version 1826400 (0.0006) [2023-12-26 14:16:29,039][123091] Updated weights for policy 0, policy_version 1838189 (0.0011) [2023-12-26 14:16:29,740][123090] Updated weights for policy 1, policy_version 1826410 (0.0005) [2023-12-26 14:16:29,811][123090] Updated weights for policy 1, policy_version 1826420 (0.0005) [2023-12-26 14:16:29,814][123091] Updated weights for policy 0, policy_version 1838199 (0.0010) [2023-12-26 14:16:29,879][123091] Updated weights for policy 0, policy_version 1838209 (0.0011) [2023-12-26 14:16:29,883][123090] Updated weights for policy 1, policy_version 1826430 (0.0007) [2023-12-26 14:16:29,947][123091] Updated weights for policy 0, policy_version 1838219 (0.0010) [2023-12-26 14:16:30,628][123090] Updated weights for policy 1, policy_version 1826440 (0.0008) [2023-12-26 14:16:30,677][123090] Updated weights for policy 1, policy_version 1826450 (0.0009) [2023-12-26 14:16:30,732][123090] Updated weights for policy 1, policy_version 1826460 (0.0008) [2023-12-26 14:16:30,768][123091] Updated weights for policy 0, policy_version 1838229 (0.0010) [2023-12-26 14:16:30,819][123091] Updated weights for policy 0, policy_version 1838239 (0.0010) [2023-12-26 14:16:30,865][123091] Updated weights for policy 0, policy_version 1838249 (0.0010) [2023-12-26 14:16:31,598][123090] Updated weights for policy 1, policy_version 1826470 (0.0008) [2023-12-26 14:16:31,664][123090] Updated weights for policy 1, policy_version 1826480 (0.0008) [2023-12-26 14:16:31,733][123090] Updated weights for policy 1, policy_version 1826490 (0.0008) [2023-12-26 14:16:31,738][123091] Updated weights for policy 0, policy_version 1838259 (0.0009) [2023-12-26 14:16:31,784][123091] Updated weights for policy 0, policy_version 1838269 (0.0006) [2023-12-26 14:16:31,844][123091] Updated weights for policy 0, policy_version 1838279 (0.0005) [2023-12-26 14:16:32,564][123090] Updated weights for policy 1, policy_version 1826500 (0.0011) [2023-12-26 14:16:32,627][123090] Updated weights for policy 1, policy_version 1826510 (0.0010) [2023-12-26 14:16:32,664][123091] Updated weights for policy 0, policy_version 1838289 (0.0007) [2023-12-26 14:16:32,686][123090] Updated weights for policy 1, policy_version 1826520 (0.0010) [2023-12-26 14:16:32,723][123091] Updated weights for policy 0, policy_version 1838299 (0.0007) [2023-12-26 14:16:32,783][123091] Updated weights for policy 0, policy_version 1838309 (0.0009) [2023-12-26 14:16:32,854][123091] Updated weights for policy 0, policy_version 1838319 (0.0007) [2023-12-26 14:16:33,424][123090] Updated weights for policy 1, policy_version 1826530 (0.0009) [2023-12-26 14:16:33,485][123090] Updated weights for policy 1, policy_version 1826540 (0.0005) [2023-12-26 14:16:33,525][123091] Updated weights for policy 0, policy_version 1838329 (0.0005) [2023-12-26 14:16:33,536][123090] Updated weights for policy 1, policy_version 1826550 (0.0005) [2023-12-26 14:16:33,570][123091] Updated weights for policy 0, policy_version 1838339 (0.0005) [2023-12-26 14:16:33,596][123090] Updated weights for policy 1, policy_version 1826560 (0.0008) [2023-12-26 14:16:33,618][123091] Updated weights for policy 0, policy_version 1838349 (0.0005) [2023-12-26 14:16:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 938221568. Throughput: 0: 8681.3, 1: 8951.5. Samples: 938228628. Policy #0 lag: (min: 31.0, avg: 36.9, max: 63.0) [2023-12-26 14:16:33,784][121949] Avg episode reward: [(0, '6335.772'), (1, '5682.444')] [2023-12-26 14:16:34,309][123091] Updated weights for policy 0, policy_version 1838359 (0.0006) [2023-12-26 14:16:34,372][123091] Updated weights for policy 0, policy_version 1838369 (0.0007) [2023-12-26 14:16:34,390][123090] Updated weights for policy 1, policy_version 1826570 (0.0011) [2023-12-26 14:16:34,432][123091] Updated weights for policy 0, policy_version 1838379 (0.0008) [2023-12-26 14:16:34,458][123090] Updated weights for policy 1, policy_version 1826580 (0.0011) [2023-12-26 14:16:34,530][123090] Updated weights for policy 1, policy_version 1826590 (0.0011) [2023-12-26 14:16:35,224][123091] Updated weights for policy 0, policy_version 1838389 (0.0009) [2023-12-26 14:16:35,271][123091] Updated weights for policy 0, policy_version 1838399 (0.0007) [2023-12-26 14:16:35,327][123091] Updated weights for policy 0, policy_version 1838409 (0.0008) [2023-12-26 14:16:35,354][123090] Updated weights for policy 1, policy_version 1826600 (0.0011) [2023-12-26 14:16:35,412][123090] Updated weights for policy 1, policy_version 1826610 (0.0010) [2023-12-26 14:16:35,483][123090] Updated weights for policy 1, policy_version 1826620 (0.0007) [2023-12-26 14:16:36,143][123090] Updated weights for policy 1, policy_version 1826630 (0.0007) [2023-12-26 14:16:36,193][123091] Updated weights for policy 0, policy_version 1838419 (0.0008) [2023-12-26 14:16:36,211][123090] Updated weights for policy 1, policy_version 1826640 (0.0006) [2023-12-26 14:16:36,260][123091] Updated weights for policy 0, policy_version 1838429 (0.0010) [2023-12-26 14:16:36,275][123090] Updated weights for policy 1, policy_version 1826650 (0.0010) [2023-12-26 14:16:36,320][123091] Updated weights for policy 0, policy_version 1838439 (0.0009) [2023-12-26 14:16:37,045][123090] Updated weights for policy 1, policy_version 1826660 (0.0008) [2023-12-26 14:16:37,097][123090] Updated weights for policy 1, policy_version 1826670 (0.0005) [2023-12-26 14:16:37,158][123091] Updated weights for policy 0, policy_version 1838449 (0.0009) [2023-12-26 14:16:37,159][123090] Updated weights for policy 1, policy_version 1826680 (0.0006) [2023-12-26 14:16:37,214][123091] Updated weights for policy 0, policy_version 1838459 (0.0011) [2023-12-26 14:16:37,281][123091] Updated weights for policy 0, policy_version 1838469 (0.0011) [2023-12-26 14:16:37,351][123091] Updated weights for policy 0, policy_version 1838479 (0.0011) [2023-12-26 14:16:37,867][123090] Updated weights for policy 1, policy_version 1826690 (0.0006) [2023-12-26 14:16:37,922][123090] Updated weights for policy 1, policy_version 1826700 (0.0005) [2023-12-26 14:16:37,980][123090] Updated weights for policy 1, policy_version 1826710 (0.0006) [2023-12-26 14:16:38,045][123090] Updated weights for policy 1, policy_version 1826720 (0.0007) [2023-12-26 14:16:38,073][123091] Updated weights for policy 0, policy_version 1838489 (0.0007) [2023-12-26 14:16:38,144][123091] Updated weights for policy 0, policy_version 1838499 (0.0006) [2023-12-26 14:16:38,209][123091] Updated weights for policy 0, policy_version 1838509 (0.0008) [2023-12-26 14:16:38,757][123090] Updated weights for policy 1, policy_version 1826730 (0.0005) [2023-12-26 14:16:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 938303488. Throughput: 0: 8705.7, 1: 8986.5. Samples: 938282568. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:16:38,785][121949] Avg episode reward: [(0, '6333.868'), (1, '5762.065')] [2023-12-26 14:16:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001838512_470663168.pth... [2023-12-26 14:16:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001837520_470409216.pth [2023-12-26 14:16:38,807][123090] Updated weights for policy 1, policy_version 1826740 (0.0006) [2023-12-26 14:16:38,864][123090] Updated weights for policy 1, policy_version 1826750 (0.0006) [2023-12-26 14:16:38,873][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001826752_467648512.pth... [2023-12-26 14:16:38,877][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001825696_467378176.pth [2023-12-26 14:16:38,878][123091] Updated weights for policy 0, policy_version 1838519 (0.0010) [2023-12-26 14:16:38,930][123091] Updated weights for policy 0, policy_version 1838529 (0.0011) [2023-12-26 14:16:39,001][123091] Updated weights for policy 0, policy_version 1838539 (0.0011) [2023-12-26 14:16:39,639][123090] Updated weights for policy 1, policy_version 1826760 (0.0006) [2023-12-26 14:16:39,698][123090] Updated weights for policy 1, policy_version 1826770 (0.0007) [2023-12-26 14:16:39,750][123090] Updated weights for policy 1, policy_version 1826780 (0.0009) [2023-12-26 14:16:39,849][123091] Updated weights for policy 0, policy_version 1838549 (0.0011) [2023-12-26 14:16:39,920][123091] Updated weights for policy 0, policy_version 1838559 (0.0011) [2023-12-26 14:16:39,985][123091] Updated weights for policy 0, policy_version 1838569 (0.0011) [2023-12-26 14:16:40,619][123090] Updated weights for policy 1, policy_version 1826790 (0.0008) [2023-12-26 14:16:40,674][123090] Updated weights for policy 1, policy_version 1826800 (0.0007) [2023-12-26 14:16:40,736][123090] Updated weights for policy 1, policy_version 1826810 (0.0009) [2023-12-26 14:16:40,791][123091] Updated weights for policy 0, policy_version 1838579 (0.0011) [2023-12-26 14:16:40,847][123091] Updated weights for policy 0, policy_version 1838589 (0.0011) [2023-12-26 14:16:40,899][123091] Updated weights for policy 0, policy_version 1838599 (0.0011) [2023-12-26 14:16:41,596][123090] Updated weights for policy 1, policy_version 1826820 (0.0009) [2023-12-26 14:16:41,667][123090] Updated weights for policy 1, policy_version 1826830 (0.0010) [2023-12-26 14:16:41,738][123090] Updated weights for policy 1, policy_version 1826840 (0.0009) [2023-12-26 14:16:41,788][123091] Updated weights for policy 0, policy_version 1838609 (0.0009) [2023-12-26 14:16:41,840][123091] Updated weights for policy 0, policy_version 1838619 (0.0009) [2023-12-26 14:16:41,897][123091] Updated weights for policy 0, policy_version 1838629 (0.0006) [2023-12-26 14:16:41,952][123091] Updated weights for policy 0, policy_version 1838639 (0.0009) [2023-12-26 14:16:42,525][123090] Updated weights for policy 1, policy_version 1826850 (0.0009) [2023-12-26 14:16:42,600][123090] Updated weights for policy 1, policy_version 1826860 (0.0007) [2023-12-26 14:16:42,675][123090] Updated weights for policy 1, policy_version 1826870 (0.0007) [2023-12-26 14:16:42,742][123090] Updated weights for policy 1, policy_version 1826880 (0.0007) [2023-12-26 14:16:42,752][123091] Updated weights for policy 0, policy_version 1838649 (0.0009) [2023-12-26 14:16:42,815][123091] Updated weights for policy 0, policy_version 1838659 (0.0010) [2023-12-26 14:16:42,875][123091] Updated weights for policy 0, policy_version 1838669 (0.0010) [2023-12-26 14:16:43,439][123090] Updated weights for policy 1, policy_version 1826890 (0.0007) [2023-12-26 14:16:43,495][123090] Updated weights for policy 1, policy_version 1826900 (0.0005) [2023-12-26 14:16:43,548][123090] Updated weights for policy 1, policy_version 1826910 (0.0005) [2023-12-26 14:16:43,778][123091] Updated weights for policy 0, policy_version 1838679 (0.0010) [2023-12-26 14:16:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 938393600. Throughput: 0: 8752.5, 1: 8985.3. Samples: 938389476. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:16:43,785][121949] Avg episode reward: [(0, '6282.670'), (1, '5829.456')] [2023-12-26 14:16:43,835][123091] Updated weights for policy 0, policy_version 1838689 (0.0007) [2023-12-26 14:16:43,896][123091] Updated weights for policy 0, policy_version 1838699 (0.0006) [2023-12-26 14:16:44,230][123090] Updated weights for policy 1, policy_version 1826920 (0.0008) [2023-12-26 14:16:44,290][123090] Updated weights for policy 1, policy_version 1826930 (0.0009) [2023-12-26 14:16:44,356][123090] Updated weights for policy 1, policy_version 1826940 (0.0010) [2023-12-26 14:16:44,749][123091] Updated weights for policy 0, policy_version 1838709 (0.0010) [2023-12-26 14:16:44,817][123091] Updated weights for policy 0, policy_version 1838719 (0.0008) [2023-12-26 14:16:44,877][123091] Updated weights for policy 0, policy_version 1838729 (0.0008) [2023-12-26 14:16:45,141][123090] Updated weights for policy 1, policy_version 1826950 (0.0008) [2023-12-26 14:16:45,202][123090] Updated weights for policy 1, policy_version 1826960 (0.0010) [2023-12-26 14:16:45,270][123090] Updated weights for policy 1, policy_version 1826970 (0.0009) [2023-12-26 14:16:45,762][123091] Updated weights for policy 0, policy_version 1838739 (0.0010) [2023-12-26 14:16:45,820][123091] Updated weights for policy 0, policy_version 1838749 (0.0009) [2023-12-26 14:16:45,872][123091] Updated weights for policy 0, policy_version 1838759 (0.0009) [2023-12-26 14:16:45,992][123090] Updated weights for policy 1, policy_version 1826980 (0.0008) [2023-12-26 14:16:46,044][123090] Updated weights for policy 1, policy_version 1826990 (0.0008) [2023-12-26 14:16:46,107][123090] Updated weights for policy 1, policy_version 1827000 (0.0010) [2023-12-26 14:16:46,758][123090] Updated weights for policy 1, policy_version 1827010 (0.0010) [2023-12-26 14:16:46,781][123091] Updated weights for policy 0, policy_version 1838769 (0.0009) [2023-12-26 14:16:46,821][123090] Updated weights for policy 1, policy_version 1827020 (0.0010) [2023-12-26 14:16:46,830][123091] Updated weights for policy 0, policy_version 1838779 (0.0008) [2023-12-26 14:16:46,882][123091] Updated weights for policy 0, policy_version 1838789 (0.0006) [2023-12-26 14:16:46,883][123090] Updated weights for policy 1, policy_version 1827030 (0.0011) [2023-12-26 14:16:46,944][123091] Updated weights for policy 0, policy_version 1838799 (0.0008) [2023-12-26 14:16:46,949][123090] Updated weights for policy 1, policy_version 1827040 (0.0010) [2023-12-26 14:16:47,642][123090] Updated weights for policy 1, policy_version 1827050 (0.0008) [2023-12-26 14:16:47,709][123090] Updated weights for policy 1, policy_version 1827060 (0.0010) [2023-12-26 14:16:47,771][123090] Updated weights for policy 1, policy_version 1827070 (0.0010) [2023-12-26 14:16:47,802][123091] Updated weights for policy 0, policy_version 1838809 (0.0008) [2023-12-26 14:16:47,851][123091] Updated weights for policy 0, policy_version 1838819 (0.0009) [2023-12-26 14:16:47,900][123091] Updated weights for policy 0, policy_version 1838830 (0.0010) [2023-12-26 14:16:48,561][123090] Updated weights for policy 1, policy_version 1827080 (0.0009) [2023-12-26 14:16:48,622][123090] Updated weights for policy 1, policy_version 1827090 (0.0009) [2023-12-26 14:16:48,680][123090] Updated weights for policy 1, policy_version 1827100 (0.0009) [2023-12-26 14:16:48,745][123091] Updated weights for policy 0, policy_version 1838840 (0.0009) [2023-12-26 14:16:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 938483712. Throughput: 0: 8655.9, 1: 9071.9. Samples: 938495492. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:16:48,785][121949] Avg episode reward: [(0, '6327.562'), (1, '5871.331')] [2023-12-26 14:16:48,818][123091] Updated weights for policy 0, policy_version 1838850 (0.0010) [2023-12-26 14:16:48,889][123091] Updated weights for policy 0, policy_version 1838860 (0.0010) [2023-12-26 14:16:49,494][123090] Updated weights for policy 1, policy_version 1827110 (0.0008) [2023-12-26 14:16:49,562][123090] Updated weights for policy 1, policy_version 1827120 (0.0005) [2023-12-26 14:16:49,635][123090] Updated weights for policy 1, policy_version 1827130 (0.0005) [2023-12-26 14:16:49,754][123091] Updated weights for policy 0, policy_version 1838870 (0.0010) [2023-12-26 14:16:49,823][123091] Updated weights for policy 0, policy_version 1838880 (0.0010) [2023-12-26 14:16:49,895][123091] Updated weights for policy 0, policy_version 1838890 (0.0007) [2023-12-26 14:16:50,448][123090] Updated weights for policy 1, policy_version 1827140 (0.0005) [2023-12-26 14:16:50,510][123090] Updated weights for policy 1, policy_version 1827150 (0.0009) [2023-12-26 14:16:50,574][123090] Updated weights for policy 1, policy_version 1827160 (0.0008) [2023-12-26 14:16:50,723][123091] Updated weights for policy 0, policy_version 1838900 (0.0010) [2023-12-26 14:16:50,790][123091] Updated weights for policy 0, policy_version 1838910 (0.0010) [2023-12-26 14:16:50,849][123091] Updated weights for policy 0, policy_version 1838920 (0.0008) [2023-12-26 14:16:51,286][123090] Updated weights for policy 1, policy_version 1827170 (0.0008) [2023-12-26 14:16:51,362][123090] Updated weights for policy 1, policy_version 1827180 (0.0006) [2023-12-26 14:16:51,430][123090] Updated weights for policy 1, policy_version 1827190 (0.0009) [2023-12-26 14:16:51,500][123090] Updated weights for policy 1, policy_version 1827200 (0.0008) [2023-12-26 14:16:51,764][123091] Updated weights for policy 0, policy_version 1838930 (0.0009) [2023-12-26 14:16:51,833][123091] Updated weights for policy 0, policy_version 1838940 (0.0009) [2023-12-26 14:16:51,899][123091] Updated weights for policy 0, policy_version 1838950 (0.0010) [2023-12-26 14:16:51,957][123091] Updated weights for policy 0, policy_version 1838960 (0.0009) [2023-12-26 14:16:52,222][123090] Updated weights for policy 1, policy_version 1827210 (0.0008) [2023-12-26 14:16:52,282][123090] Updated weights for policy 1, policy_version 1827220 (0.0008) [2023-12-26 14:16:52,346][123090] Updated weights for policy 1, policy_version 1827230 (0.0008) [2023-12-26 14:16:52,850][123091] Updated weights for policy 0, policy_version 1838970 (0.0010) [2023-12-26 14:16:52,900][123091] Updated weights for policy 0, policy_version 1838980 (0.0009) [2023-12-26 14:16:52,955][123091] Updated weights for policy 0, policy_version 1838990 (0.0010) [2023-12-26 14:16:53,093][123090] Updated weights for policy 1, policy_version 1827240 (0.0009) [2023-12-26 14:16:53,156][123090] Updated weights for policy 1, policy_version 1827250 (0.0008) [2023-12-26 14:16:53,219][123090] Updated weights for policy 1, policy_version 1827260 (0.0009) [2023-12-26 14:16:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 938565632. Throughput: 0: 8578.7, 1: 9060.2. Samples: 938546792. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:16:53,785][121949] Avg episode reward: [(0, '6284.954'), (1, '5852.939')] [2023-12-26 14:16:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001827264_467779584.pth... [2023-12-26 14:16:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001826208_467509248.pth [2023-12-26 14:16:53,827][123091] Updated weights for policy 0, policy_version 1839000 (0.0010) [2023-12-26 14:16:53,879][123091] Updated weights for policy 0, policy_version 1839011 (0.0010) [2023-12-26 14:16:53,927][123090] Updated weights for policy 1, policy_version 1827270 (0.0009) [2023-12-26 14:16:53,935][123091] Updated weights for policy 0, policy_version 1839022 (0.0007) [2023-12-26 14:16:53,945][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001839024_470794240.pth... [2023-12-26 14:16:53,948][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001838000_470532096.pth [2023-12-26 14:16:53,978][123090] Updated weights for policy 1, policy_version 1827280 (0.0008) [2023-12-26 14:16:54,044][123090] Updated weights for policy 1, policy_version 1827290 (0.0009) [2023-12-26 14:16:54,789][123091] Updated weights for policy 0, policy_version 1839032 (0.0009) [2023-12-26 14:16:54,841][123091] Updated weights for policy 0, policy_version 1839042 (0.0009) [2023-12-26 14:16:54,857][123090] Updated weights for policy 1, policy_version 1827300 (0.0008) [2023-12-26 14:16:54,894][123091] Updated weights for policy 0, policy_version 1839052 (0.0007) [2023-12-26 14:16:54,910][123090] Updated weights for policy 1, policy_version 1827310 (0.0008) [2023-12-26 14:16:54,962][123090] Updated weights for policy 1, policy_version 1827320 (0.0009) [2023-12-26 14:16:55,710][123090] Updated weights for policy 1, policy_version 1827330 (0.0009) [2023-12-26 14:16:55,750][123091] Updated weights for policy 0, policy_version 1839062 (0.0006) [2023-12-26 14:16:55,761][123090] Updated weights for policy 1, policy_version 1827340 (0.0009) [2023-12-26 14:16:55,802][123091] Updated weights for policy 0, policy_version 1839072 (0.0008) [2023-12-26 14:16:55,809][123090] Updated weights for policy 1, policy_version 1827350 (0.0008) [2023-12-26 14:16:55,859][123090] Updated weights for policy 1, policy_version 1827360 (0.0007) [2023-12-26 14:16:55,864][123091] Updated weights for policy 0, policy_version 1839082 (0.0009) [2023-12-26 14:16:56,667][123090] Updated weights for policy 1, policy_version 1827370 (0.0008) [2023-12-26 14:16:56,706][123091] Updated weights for policy 0, policy_version 1839092 (0.0009) [2023-12-26 14:16:56,718][123090] Updated weights for policy 1, policy_version 1827380 (0.0008) [2023-12-26 14:16:56,754][123091] Updated weights for policy 0, policy_version 1839102 (0.0009) [2023-12-26 14:16:56,770][123090] Updated weights for policy 1, policy_version 1827390 (0.0008) [2023-12-26 14:16:56,806][123091] Updated weights for policy 0, policy_version 1839112 (0.0008) [2023-12-26 14:16:57,575][123090] Updated weights for policy 1, policy_version 1827400 (0.0006) [2023-12-26 14:16:57,638][123090] Updated weights for policy 1, policy_version 1827410 (0.0005) [2023-12-26 14:16:57,661][123091] Updated weights for policy 0, policy_version 1839122 (0.0009) [2023-12-26 14:16:57,695][123090] Updated weights for policy 1, policy_version 1827420 (0.0005) [2023-12-26 14:16:57,714][123091] Updated weights for policy 0, policy_version 1839132 (0.0009) [2023-12-26 14:16:57,765][123091] Updated weights for policy 0, policy_version 1839142 (0.0009) [2023-12-26 14:16:57,819][123091] Updated weights for policy 0, policy_version 1839152 (0.0010) [2023-12-26 14:16:58,428][123090] Updated weights for policy 1, policy_version 1827430 (0.0009) [2023-12-26 14:16:58,500][123090] Updated weights for policy 1, policy_version 1827440 (0.0010) [2023-12-26 14:16:58,565][123090] Updated weights for policy 1, policy_version 1827450 (0.0010) [2023-12-26 14:16:58,678][123091] Updated weights for policy 0, policy_version 1839162 (0.0012) [2023-12-26 14:16:58,750][123091] Updated weights for policy 0, policy_version 1839172 (0.0009) [2023-12-26 14:16:58,784][121949] Fps is (10 sec: 17202.5, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 938655744. Throughput: 0: 8544.7, 1: 9124.2. Samples: 938651552. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:16:58,785][121949] Avg episode reward: [(0, '6227.612'), (1, '5793.439')] [2023-12-26 14:16:58,831][123091] Updated weights for policy 0, policy_version 1839182 (0.0009) [2023-12-26 14:16:59,529][123090] Updated weights for policy 1, policy_version 1827460 (0.0009) [2023-12-26 14:16:59,591][123090] Updated weights for policy 1, policy_version 1827470 (0.0009) [2023-12-26 14:16:59,654][123090] Updated weights for policy 1, policy_version 1827480 (0.0006) [2023-12-26 14:16:59,768][123091] Updated weights for policy 0, policy_version 1839192 (0.0010) [2023-12-26 14:16:59,822][123091] Updated weights for policy 0, policy_version 1839202 (0.0010) [2023-12-26 14:16:59,881][123091] Updated weights for policy 0, policy_version 1839212 (0.0007) [2023-12-26 14:17:00,465][123090] Updated weights for policy 1, policy_version 1827490 (0.0006) [2023-12-26 14:17:00,512][123090] Updated weights for policy 1, policy_version 1827500 (0.0008) [2023-12-26 14:17:00,562][123090] Updated weights for policy 1, policy_version 1827510 (0.0009) [2023-12-26 14:17:00,724][123091] Updated weights for policy 0, policy_version 1839222 (0.0008) [2023-12-26 14:17:00,777][123091] Updated weights for policy 0, policy_version 1839232 (0.0009) [2023-12-26 14:17:00,830][123091] Updated weights for policy 0, policy_version 1839242 (0.0010) [2023-12-26 14:17:01,413][123090] Updated weights for policy 1, policy_version 1827521 (0.0010) [2023-12-26 14:17:01,462][123090] Updated weights for policy 1, policy_version 1827531 (0.0009) [2023-12-26 14:17:01,520][123090] Updated weights for policy 1, policy_version 1827541 (0.0008) [2023-12-26 14:17:01,571][123090] Updated weights for policy 1, policy_version 1827551 (0.0009) [2023-12-26 14:17:01,701][123091] Updated weights for policy 0, policy_version 1839252 (0.0009) [2023-12-26 14:17:01,767][123091] Updated weights for policy 0, policy_version 1839262 (0.0010) [2023-12-26 14:17:01,834][123091] Updated weights for policy 0, policy_version 1839272 (0.0009) [2023-12-26 14:17:02,415][123090] Updated weights for policy 1, policy_version 1827561 (0.0010) [2023-12-26 14:17:02,473][123090] Updated weights for policy 1, policy_version 1827571 (0.0010) [2023-12-26 14:17:02,537][123090] Updated weights for policy 1, policy_version 1827581 (0.0010) [2023-12-26 14:17:02,631][123091] Updated weights for policy 0, policy_version 1839282 (0.0010) [2023-12-26 14:17:02,696][123091] Updated weights for policy 0, policy_version 1839292 (0.0009) [2023-12-26 14:17:02,758][123091] Updated weights for policy 0, policy_version 1839302 (0.0010) [2023-12-26 14:17:02,824][123091] Updated weights for policy 0, policy_version 1839312 (0.0010) [2023-12-26 14:17:03,301][123090] Updated weights for policy 1, policy_version 1827591 (0.0006) [2023-12-26 14:17:03,347][123090] Updated weights for policy 1, policy_version 1827601 (0.0005) [2023-12-26 14:17:03,396][123090] Updated weights for policy 1, policy_version 1827611 (0.0007) [2023-12-26 14:17:03,652][123091] Updated weights for policy 0, policy_version 1839322 (0.0010) [2023-12-26 14:17:03,703][123091] Updated weights for policy 0, policy_version 1839332 (0.0010) [2023-12-26 14:17:03,776][123091] Updated weights for policy 0, policy_version 1839342 (0.0010) [2023-12-26 14:17:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 938737664. Throughput: 0: 8558.2, 1: 9016.5. Samples: 938753132. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:03,784][121949] Avg episode reward: [(0, '6236.459'), (1, '5670.534')] [2023-12-26 14:17:04,164][123090] Updated weights for policy 1, policy_version 1827622 (0.0009) [2023-12-26 14:17:04,218][123090] Updated weights for policy 1, policy_version 1827632 (0.0009) [2023-12-26 14:17:04,273][123090] Updated weights for policy 1, policy_version 1827642 (0.0009) [2023-12-26 14:17:04,564][123091] Updated weights for policy 0, policy_version 1839352 (0.0011) [2023-12-26 14:17:04,633][123091] Updated weights for policy 0, policy_version 1839362 (0.0007) [2023-12-26 14:17:04,700][123091] Updated weights for policy 0, policy_version 1839372 (0.0006) [2023-12-26 14:17:05,175][123090] Updated weights for policy 1, policy_version 1827652 (0.0009) [2023-12-26 14:17:05,237][123090] Updated weights for policy 1, policy_version 1827662 (0.0010) [2023-12-26 14:17:05,269][123091] Updated weights for policy 0, policy_version 1839382 (0.0006) [2023-12-26 14:17:05,294][123090] Updated weights for policy 1, policy_version 1827672 (0.0009) [2023-12-26 14:17:05,320][123091] Updated weights for policy 0, policy_version 1839392 (0.0010) [2023-12-26 14:17:05,376][123091] Updated weights for policy 0, policy_version 1839402 (0.0010) [2023-12-26 14:17:06,148][123090] Updated weights for policy 1, policy_version 1827682 (0.0007) [2023-12-26 14:17:06,190][123091] Updated weights for policy 0, policy_version 1839412 (0.0011) [2023-12-26 14:17:06,214][123090] Updated weights for policy 1, policy_version 1827692 (0.0007) [2023-12-26 14:17:06,246][123091] Updated weights for policy 0, policy_version 1839422 (0.0011) [2023-12-26 14:17:06,275][123090] Updated weights for policy 1, policy_version 1827702 (0.0006) [2023-12-26 14:17:06,302][123091] Updated weights for policy 0, policy_version 1839432 (0.0010) [2023-12-26 14:17:06,341][123090] Updated weights for policy 1, policy_version 1827712 (0.0007) [2023-12-26 14:17:07,144][123091] Updated weights for policy 0, policy_version 1839442 (0.0011) [2023-12-26 14:17:07,185][123090] Updated weights for policy 1, policy_version 1827722 (0.0006) [2023-12-26 14:17:07,198][123091] Updated weights for policy 0, policy_version 1839452 (0.0011) [2023-12-26 14:17:07,248][123090] Updated weights for policy 1, policy_version 1827732 (0.0007) [2023-12-26 14:17:07,258][123091] Updated weights for policy 0, policy_version 1839462 (0.0011) [2023-12-26 14:17:07,312][123090] Updated weights for policy 1, policy_version 1827742 (0.0006) [2023-12-26 14:17:07,313][123091] Updated weights for policy 0, policy_version 1839472 (0.0010) [2023-12-26 14:17:08,136][123090] Updated weights for policy 1, policy_version 1827752 (0.0009) [2023-12-26 14:17:08,147][123091] Updated weights for policy 0, policy_version 1839482 (0.0010) [2023-12-26 14:17:08,196][123090] Updated weights for policy 1, policy_version 1827762 (0.0006) [2023-12-26 14:17:08,209][123091] Updated weights for policy 0, policy_version 1839492 (0.0010) [2023-12-26 14:17:08,244][123090] Updated weights for policy 1, policy_version 1827772 (0.0008) [2023-12-26 14:17:08,263][123091] Updated weights for policy 0, policy_version 1839502 (0.0010) [2023-12-26 14:17:08,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 938827776. Throughput: 0: 8605.4, 1: 9007.3. Samples: 938804820. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:08,784][121949] Avg episode reward: [(0, '6325.672'), (1, '5847.625')] [2023-12-26 14:17:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001839504_470917120.pth... [2023-12-26 14:17:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001827776_467910656.pth... [2023-12-26 14:17:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001826752_467648512.pth [2023-12-26 14:17:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001838512_470663168.pth [2023-12-26 14:17:09,018][123091] Updated weights for policy 0, policy_version 1839512 (0.0007) [2023-12-26 14:17:09,076][123091] Updated weights for policy 0, policy_version 1839522 (0.0005) [2023-12-26 14:17:09,114][123090] Updated weights for policy 1, policy_version 1827782 (0.0007) [2023-12-26 14:17:09,132][123091] Updated weights for policy 0, policy_version 1839532 (0.0005) [2023-12-26 14:17:09,167][123090] Updated weights for policy 1, policy_version 1827792 (0.0009) [2023-12-26 14:17:09,237][123090] Updated weights for policy 1, policy_version 1827803 (0.0010) [2023-12-26 14:17:09,928][123091] Updated weights for policy 0, policy_version 1839542 (0.0007) [2023-12-26 14:17:09,984][123091] Updated weights for policy 0, policy_version 1839552 (0.0008) [2023-12-26 14:17:10,039][123091] Updated weights for policy 0, policy_version 1839562 (0.0008) [2023-12-26 14:17:10,158][123090] Updated weights for policy 1, policy_version 1827813 (0.0009) [2023-12-26 14:17:10,210][123090] Updated weights for policy 1, policy_version 1827823 (0.0010) [2023-12-26 14:17:10,273][123090] Updated weights for policy 1, policy_version 1827833 (0.0009) [2023-12-26 14:17:10,812][123091] Updated weights for policy 0, policy_version 1839572 (0.0007) [2023-12-26 14:17:10,873][123091] Updated weights for policy 0, policy_version 1839582 (0.0006) [2023-12-26 14:17:10,933][123091] Updated weights for policy 0, policy_version 1839592 (0.0009) [2023-12-26 14:17:11,144][123090] Updated weights for policy 1, policy_version 1827843 (0.0009) [2023-12-26 14:17:11,208][123090] Updated weights for policy 1, policy_version 1827853 (0.0008) [2023-12-26 14:17:11,268][123090] Updated weights for policy 1, policy_version 1827863 (0.0009) [2023-12-26 14:17:11,790][123091] Updated weights for policy 0, policy_version 1839602 (0.0010) [2023-12-26 14:17:11,854][123091] Updated weights for policy 0, policy_version 1839612 (0.0009) [2023-12-26 14:17:11,917][123091] Updated weights for policy 0, policy_version 1839622 (0.0009) [2023-12-26 14:17:11,982][123091] Updated weights for policy 0, policy_version 1839632 (0.0010) [2023-12-26 14:17:12,147][123090] Updated weights for policy 1, policy_version 1827873 (0.0009) [2023-12-26 14:17:12,218][123090] Updated weights for policy 1, policy_version 1827883 (0.0010) [2023-12-26 14:17:12,283][123090] Updated weights for policy 1, policy_version 1827893 (0.0009) [2023-12-26 14:17:12,347][123090] Updated weights for policy 1, policy_version 1827903 (0.0008) [2023-12-26 14:17:12,836][123091] Updated weights for policy 0, policy_version 1839642 (0.0010) [2023-12-26 14:17:12,899][123091] Updated weights for policy 0, policy_version 1839652 (0.0010) [2023-12-26 14:17:12,964][123091] Updated weights for policy 0, policy_version 1839662 (0.0009) [2023-12-26 14:17:13,151][123090] Updated weights for policy 1, policy_version 1827913 (0.0006) [2023-12-26 14:17:13,206][123090] Updated weights for policy 1, policy_version 1827923 (0.0006) [2023-12-26 14:17:13,267][123090] Updated weights for policy 1, policy_version 1827933 (0.0009) [2023-12-26 14:17:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 938909696. Throughput: 0: 8620.2, 1: 8897.2. Samples: 938906272. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:13,785][121949] Avg episode reward: [(0, '6377.357'), (1, '5766.689')] [2023-12-26 14:17:13,857][123091] Updated weights for policy 0, policy_version 1839672 (0.0009) [2023-12-26 14:17:13,916][123091] Updated weights for policy 0, policy_version 1839683 (0.0010) [2023-12-26 14:17:13,961][123090] Updated weights for policy 1, policy_version 1827943 (0.0008) [2023-12-26 14:17:13,967][123091] Updated weights for policy 0, policy_version 1839693 (0.0008) [2023-12-26 14:17:14,029][123090] Updated weights for policy 1, policy_version 1827953 (0.0008) [2023-12-26 14:17:14,098][123090] Updated weights for policy 1, policy_version 1827963 (0.0006) [2023-12-26 14:17:14,800][123091] Updated weights for policy 0, policy_version 1839703 (0.0009) [2023-12-26 14:17:14,858][123090] Updated weights for policy 1, policy_version 1827973 (0.0010) [2023-12-26 14:17:14,864][123091] Updated weights for policy 0, policy_version 1839713 (0.0008) [2023-12-26 14:17:14,923][123090] Updated weights for policy 1, policy_version 1827983 (0.0011) [2023-12-26 14:17:14,934][123091] Updated weights for policy 0, policy_version 1839723 (0.0008) [2023-12-26 14:17:14,993][123090] Updated weights for policy 1, policy_version 1827993 (0.0010) [2023-12-26 14:17:15,758][123091] Updated weights for policy 0, policy_version 1839733 (0.0008) [2023-12-26 14:17:15,822][123091] Updated weights for policy 0, policy_version 1839743 (0.0008) [2023-12-26 14:17:15,823][123090] Updated weights for policy 1, policy_version 1828003 (0.0011) [2023-12-26 14:17:15,871][123091] Updated weights for policy 0, policy_version 1839753 (0.0008) [2023-12-26 14:17:15,890][123090] Updated weights for policy 1, policy_version 1828013 (0.0010) [2023-12-26 14:17:15,945][123090] Updated weights for policy 1, policy_version 1828023 (0.0010) [2023-12-26 14:17:16,733][123091] Updated weights for policy 0, policy_version 1839763 (0.0009) [2023-12-26 14:17:16,749][123090] Updated weights for policy 1, policy_version 1828033 (0.0010) [2023-12-26 14:17:16,790][123091] Updated weights for policy 0, policy_version 1839773 (0.0009) [2023-12-26 14:17:16,809][123090] Updated weights for policy 1, policy_version 1828043 (0.0007) [2023-12-26 14:17:16,851][123091] Updated weights for policy 0, policy_version 1839783 (0.0007) [2023-12-26 14:17:16,871][123090] Updated weights for policy 1, policy_version 1828053 (0.0008) [2023-12-26 14:17:16,925][123090] Updated weights for policy 1, policy_version 1828063 (0.0009) [2023-12-26 14:17:17,681][123090] Updated weights for policy 1, policy_version 1828073 (0.0006) [2023-12-26 14:17:17,688][123091] Updated weights for policy 0, policy_version 1839793 (0.0006) [2023-12-26 14:17:17,741][123090] Updated weights for policy 1, policy_version 1828083 (0.0009) [2023-12-26 14:17:17,751][123091] Updated weights for policy 0, policy_version 1839803 (0.0008) [2023-12-26 14:17:17,798][123090] Updated weights for policy 1, policy_version 1828093 (0.0009) [2023-12-26 14:17:17,810][123091] Updated weights for policy 0, policy_version 1839813 (0.0009) [2023-12-26 14:17:17,873][123091] Updated weights for policy 0, policy_version 1839823 (0.0010) [2023-12-26 14:17:18,595][123090] Updated weights for policy 1, policy_version 1828103 (0.0010) [2023-12-26 14:17:18,656][123090] Updated weights for policy 1, policy_version 1828113 (0.0009) [2023-12-26 14:17:18,723][123090] Updated weights for policy 1, policy_version 1828123 (0.0006) [2023-12-26 14:17:18,737][123091] Updated weights for policy 0, policy_version 1839833 (0.0009) [2023-12-26 14:17:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 938999808. Throughput: 0: 8497.9, 1: 8875.6. Samples: 939010436. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:18,785][121949] Avg episode reward: [(0, '6337.616'), (1, '5629.585')] [2023-12-26 14:17:18,798][123091] Updated weights for policy 0, policy_version 1839843 (0.0008) [2023-12-26 14:17:18,851][123091] Updated weights for policy 0, policy_version 1839853 (0.0009) [2023-12-26 14:17:19,466][123090] Updated weights for policy 1, policy_version 1828133 (0.0009) [2023-12-26 14:17:19,537][123090] Updated weights for policy 1, policy_version 1828143 (0.0009) [2023-12-26 14:17:19,608][123090] Updated weights for policy 1, policy_version 1828153 (0.0010) [2023-12-26 14:17:19,740][123091] Updated weights for policy 0, policy_version 1839863 (0.0009) [2023-12-26 14:17:19,789][123091] Updated weights for policy 0, policy_version 1839873 (0.0009) [2023-12-26 14:17:19,857][123091] Updated weights for policy 0, policy_version 1839883 (0.0009) [2023-12-26 14:17:20,427][123090] Updated weights for policy 1, policy_version 1828163 (0.0009) [2023-12-26 14:17:20,498][123090] Updated weights for policy 1, policy_version 1828173 (0.0009) [2023-12-26 14:17:20,574][123090] Updated weights for policy 1, policy_version 1828183 (0.0009) [2023-12-26 14:17:20,763][123091] Updated weights for policy 0, policy_version 1839893 (0.0007) [2023-12-26 14:17:20,811][123091] Updated weights for policy 0, policy_version 1839903 (0.0006) [2023-12-26 14:17:20,871][123091] Updated weights for policy 0, policy_version 1839913 (0.0008) [2023-12-26 14:17:21,396][123090] Updated weights for policy 1, policy_version 1828193 (0.0010) [2023-12-26 14:17:21,464][123090] Updated weights for policy 1, policy_version 1828203 (0.0009) [2023-12-26 14:17:21,521][123090] Updated weights for policy 1, policy_version 1828213 (0.0010) [2023-12-26 14:17:21,588][123090] Updated weights for policy 1, policy_version 1828223 (0.0010) [2023-12-26 14:17:21,627][123091] Updated weights for policy 0, policy_version 1839923 (0.0007) [2023-12-26 14:17:21,700][123091] Updated weights for policy 0, policy_version 1839933 (0.0009) [2023-12-26 14:17:21,763][123091] Updated weights for policy 0, policy_version 1839943 (0.0009) [2023-12-26 14:17:22,379][123090] Updated weights for policy 1, policy_version 1828233 (0.0011) [2023-12-26 14:17:22,450][123090] Updated weights for policy 1, policy_version 1828243 (0.0011) [2023-12-26 14:17:22,525][123090] Updated weights for policy 1, policy_version 1828253 (0.0011) [2023-12-26 14:17:22,531][123091] Updated weights for policy 0, policy_version 1839953 (0.0008) [2023-12-26 14:17:22,594][123091] Updated weights for policy 0, policy_version 1839963 (0.0011) [2023-12-26 14:17:22,657][123091] Updated weights for policy 0, policy_version 1839973 (0.0011) [2023-12-26 14:17:22,726][123091] Updated weights for policy 0, policy_version 1839983 (0.0010) [2023-12-26 14:17:23,302][123090] Updated weights for policy 1, policy_version 1828263 (0.0011) [2023-12-26 14:17:23,365][123090] Updated weights for policy 1, policy_version 1828273 (0.0010) [2023-12-26 14:17:23,427][123090] Updated weights for policy 1, policy_version 1828283 (0.0010) [2023-12-26 14:17:23,452][123091] Updated weights for policy 0, policy_version 1839993 (0.0006) [2023-12-26 14:17:23,512][123091] Updated weights for policy 0, policy_version 1840003 (0.0006) [2023-12-26 14:17:23,580][123091] Updated weights for policy 0, policy_version 1840013 (0.0007) [2023-12-26 14:17:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 939089920. Throughput: 0: 8455.3, 1: 8855.7. Samples: 939061564. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:23,785][121949] Avg episode reward: [(0, '6244.172'), (1, '5646.355')] [2023-12-26 14:17:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001840016_471048192.pth... [2023-12-26 14:17:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001828288_468041728.pth... [2023-12-26 14:17:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001827264_467779584.pth [2023-12-26 14:17:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001839024_470794240.pth [2023-12-26 14:17:24,218][123090] Updated weights for policy 1, policy_version 1828293 (0.0009) [2023-12-26 14:17:24,276][123090] Updated weights for policy 1, policy_version 1828303 (0.0009) [2023-12-26 14:17:24,279][123091] Updated weights for policy 0, policy_version 1840023 (0.0009) [2023-12-26 14:17:24,325][123090] Updated weights for policy 1, policy_version 1828313 (0.0006) [2023-12-26 14:17:24,338][123091] Updated weights for policy 0, policy_version 1840033 (0.0009) [2023-12-26 14:17:24,397][123091] Updated weights for policy 0, policy_version 1840043 (0.0009) [2023-12-26 14:17:24,999][123090] Updated weights for policy 1, policy_version 1828323 (0.0005) [2023-12-26 14:17:25,052][123090] Updated weights for policy 1, policy_version 1828333 (0.0009) [2023-12-26 14:17:25,104][123090] Updated weights for policy 1, policy_version 1828343 (0.0009) [2023-12-26 14:17:25,193][123091] Updated weights for policy 0, policy_version 1840053 (0.0006) [2023-12-26 14:17:25,246][123091] Updated weights for policy 0, policy_version 1840063 (0.0007) [2023-12-26 14:17:25,300][123091] Updated weights for policy 0, policy_version 1840073 (0.0005) [2023-12-26 14:17:25,953][123091] Updated weights for policy 0, policy_version 1840083 (0.0005) [2023-12-26 14:17:26,007][123091] Updated weights for policy 0, policy_version 1840093 (0.0005) [2023-12-26 14:17:26,013][123090] Updated weights for policy 1, policy_version 1828353 (0.0009) [2023-12-26 14:17:26,069][123091] Updated weights for policy 0, policy_version 1840103 (0.0005) [2023-12-26 14:17:26,075][123090] Updated weights for policy 1, policy_version 1828363 (0.0009) [2023-12-26 14:17:26,132][123090] Updated weights for policy 1, policy_version 1828373 (0.0009) [2023-12-26 14:17:26,193][123090] Updated weights for policy 1, policy_version 1828383 (0.0009) [2023-12-26 14:17:26,641][123091] Updated weights for policy 0, policy_version 1840113 (0.0006) [2023-12-26 14:17:26,717][123091] Updated weights for policy 0, policy_version 1840123 (0.0010) [2023-12-26 14:17:26,767][123091] Updated weights for policy 0, policy_version 1840133 (0.0010) [2023-12-26 14:17:26,812][123091] Updated weights for policy 0, policy_version 1840143 (0.0007) [2023-12-26 14:17:27,106][123090] Updated weights for policy 1, policy_version 1828393 (0.0009) [2023-12-26 14:17:27,160][123090] Updated weights for policy 1, policy_version 1828403 (0.0008) [2023-12-26 14:17:27,211][123090] Updated weights for policy 1, policy_version 1828413 (0.0009) [2023-12-26 14:17:27,538][123091] Updated weights for policy 0, policy_version 1840153 (0.0005) [2023-12-26 14:17:27,604][123091] Updated weights for policy 0, policy_version 1840163 (0.0005) [2023-12-26 14:17:27,655][123091] Updated weights for policy 0, policy_version 1840173 (0.0005) [2023-12-26 14:17:28,006][123090] Updated weights for policy 1, policy_version 1828424 (0.0006) [2023-12-26 14:17:28,054][123090] Updated weights for policy 1, policy_version 1828434 (0.0005) [2023-12-26 14:17:28,100][123090] Updated weights for policy 1, policy_version 1828444 (0.0005) [2023-12-26 14:17:28,252][123091] Updated weights for policy 0, policy_version 1840183 (0.0009) [2023-12-26 14:17:28,317][123091] Updated weights for policy 0, policy_version 1840193 (0.0010) [2023-12-26 14:17:28,388][123091] Updated weights for policy 0, policy_version 1840203 (0.0011) [2023-12-26 14:17:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 939180032. Throughput: 0: 8600.0, 1: 8814.4. Samples: 939173124. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:28,785][121949] Avg episode reward: [(0, '6280.851'), (1, '5614.483')] [2023-12-26 14:17:28,829][123090] Updated weights for policy 1, policy_version 1828454 (0.0008) [2023-12-26 14:17:28,893][123090] Updated weights for policy 1, policy_version 1828464 (0.0011) [2023-12-26 14:17:28,953][123090] Updated weights for policy 1, policy_version 1828474 (0.0010) [2023-12-26 14:17:29,157][123091] Updated weights for policy 0, policy_version 1840213 (0.0008) [2023-12-26 14:17:29,216][123091] Updated weights for policy 0, policy_version 1840223 (0.0006) [2023-12-26 14:17:29,279][123091] Updated weights for policy 0, policy_version 1840233 (0.0008) [2023-12-26 14:17:29,734][123090] Updated weights for policy 1, policy_version 1828484 (0.0007) [2023-12-26 14:17:29,788][123090] Updated weights for policy 1, policy_version 1828494 (0.0005) [2023-12-26 14:17:29,840][123090] Updated weights for policy 1, policy_version 1828504 (0.0006) [2023-12-26 14:17:30,032][123091] Updated weights for policy 0, policy_version 1840243 (0.0009) [2023-12-26 14:17:30,088][123091] Updated weights for policy 0, policy_version 1840253 (0.0009) [2023-12-26 14:17:30,146][123091] Updated weights for policy 0, policy_version 1840263 (0.0010) [2023-12-26 14:17:30,554][123090] Updated weights for policy 1, policy_version 1828514 (0.0008) [2023-12-26 14:17:30,618][123090] Updated weights for policy 1, policy_version 1828524 (0.0005) [2023-12-26 14:17:30,682][123090] Updated weights for policy 1, policy_version 1828534 (0.0005) [2023-12-26 14:17:30,741][123090] Updated weights for policy 1, policy_version 1828544 (0.0006) [2023-12-26 14:17:30,964][123091] Updated weights for policy 0, policy_version 1840273 (0.0010) [2023-12-26 14:17:31,018][123091] Updated weights for policy 0, policy_version 1840283 (0.0009) [2023-12-26 14:17:31,072][123091] Updated weights for policy 0, policy_version 1840293 (0.0009) [2023-12-26 14:17:31,139][123091] Updated weights for policy 0, policy_version 1840303 (0.0009) [2023-12-26 14:17:31,468][123090] Updated weights for policy 1, policy_version 1828554 (0.0010) [2023-12-26 14:17:31,521][123090] Updated weights for policy 1, policy_version 1828564 (0.0009) [2023-12-26 14:17:31,572][123090] Updated weights for policy 1, policy_version 1828574 (0.0009) [2023-12-26 14:17:32,001][123091] Updated weights for policy 0, policy_version 1840313 (0.0010) [2023-12-26 14:17:32,069][123091] Updated weights for policy 0, policy_version 1840323 (0.0009) [2023-12-26 14:17:32,126][123091] Updated weights for policy 0, policy_version 1840333 (0.0006) [2023-12-26 14:17:32,386][123090] Updated weights for policy 1, policy_version 1828584 (0.0009) [2023-12-26 14:17:32,443][123090] Updated weights for policy 1, policy_version 1828594 (0.0008) [2023-12-26 14:17:32,508][123090] Updated weights for policy 1, policy_version 1828604 (0.0007) [2023-12-26 14:17:32,906][123091] Updated weights for policy 0, policy_version 1840343 (0.0009) [2023-12-26 14:17:32,956][123091] Updated weights for policy 0, policy_version 1840353 (0.0010) [2023-12-26 14:17:33,008][123091] Updated weights for policy 0, policy_version 1840363 (0.0010) [2023-12-26 14:17:33,223][123090] Updated weights for policy 1, policy_version 1828614 (0.0007) [2023-12-26 14:17:33,270][123090] Updated weights for policy 1, policy_version 1828624 (0.0008) [2023-12-26 14:17:33,327][123090] Updated weights for policy 1, policy_version 1828634 (0.0008) [2023-12-26 14:17:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 939270144. Throughput: 0: 8706.4, 1: 8801.5. Samples: 939283348. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:33,785][121949] Avg episode reward: [(0, '6266.891'), (1, '5701.557')] [2023-12-26 14:17:33,855][123091] Updated weights for policy 0, policy_version 1840373 (0.0011) [2023-12-26 14:17:33,916][123091] Updated weights for policy 0, policy_version 1840383 (0.0010) [2023-12-26 14:17:33,982][123091] Updated weights for policy 0, policy_version 1840393 (0.0010) [2023-12-26 14:17:34,197][123090] Updated weights for policy 1, policy_version 1828644 (0.0009) [2023-12-26 14:17:34,257][123090] Updated weights for policy 1, policy_version 1828654 (0.0010) [2023-12-26 14:17:34,331][123090] Updated weights for policy 1, policy_version 1828664 (0.0009) [2023-12-26 14:17:34,804][123091] Updated weights for policy 0, policy_version 1840403 (0.0010) [2023-12-26 14:17:34,848][123091] Updated weights for policy 0, policy_version 1840413 (0.0010) [2023-12-26 14:17:34,906][123091] Updated weights for policy 0, policy_version 1840423 (0.0010) [2023-12-26 14:17:35,147][123090] Updated weights for policy 1, policy_version 1828674 (0.0010) [2023-12-26 14:17:35,202][123090] Updated weights for policy 1, policy_version 1828684 (0.0010) [2023-12-26 14:17:35,250][123090] Updated weights for policy 1, policy_version 1828694 (0.0010) [2023-12-26 14:17:35,304][123090] Updated weights for policy 1, policy_version 1828704 (0.0010) [2023-12-26 14:17:35,742][123091] Updated weights for policy 0, policy_version 1840433 (0.0010) [2023-12-26 14:17:35,808][123091] Updated weights for policy 0, policy_version 1840443 (0.0009) [2023-12-26 14:17:35,872][123091] Updated weights for policy 0, policy_version 1840453 (0.0008) [2023-12-26 14:17:35,934][123091] Updated weights for policy 0, policy_version 1840463 (0.0008) [2023-12-26 14:17:36,162][123090] Updated weights for policy 1, policy_version 1828714 (0.0010) [2023-12-26 14:17:36,216][123090] Updated weights for policy 1, policy_version 1828724 (0.0009) [2023-12-26 14:17:36,271][123090] Updated weights for policy 1, policy_version 1828734 (0.0008) [2023-12-26 14:17:36,764][123091] Updated weights for policy 0, policy_version 1840473 (0.0010) [2023-12-26 14:17:36,834][123091] Updated weights for policy 0, policy_version 1840483 (0.0008) [2023-12-26 14:17:36,900][123091] Updated weights for policy 0, policy_version 1840493 (0.0009) [2023-12-26 14:17:37,083][123090] Updated weights for policy 1, policy_version 1828744 (0.0008) [2023-12-26 14:17:37,150][123090] Updated weights for policy 1, policy_version 1828754 (0.0009) [2023-12-26 14:17:37,224][123090] Updated weights for policy 1, policy_version 1828764 (0.0009) [2023-12-26 14:17:37,664][123091] Updated weights for policy 0, policy_version 1840503 (0.0009) [2023-12-26 14:17:37,733][123091] Updated weights for policy 0, policy_version 1840513 (0.0008) [2023-12-26 14:17:37,798][123091] Updated weights for policy 0, policy_version 1840523 (0.0007) [2023-12-26 14:17:38,018][123090] Updated weights for policy 1, policy_version 1828774 (0.0008) [2023-12-26 14:17:38,084][123090] Updated weights for policy 1, policy_version 1828784 (0.0009) [2023-12-26 14:17:38,154][123090] Updated weights for policy 1, policy_version 1828795 (0.0010) [2023-12-26 14:17:38,554][123091] Updated weights for policy 0, policy_version 1840533 (0.0008) [2023-12-26 14:17:38,613][123091] Updated weights for policy 0, policy_version 1840543 (0.0009) [2023-12-26 14:17:38,692][123091] Updated weights for policy 0, policy_version 1840553 (0.0010) [2023-12-26 14:17:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 939360256. Throughput: 0: 8742.0, 1: 8780.4. Samples: 939335296. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:38,785][121949] Avg episode reward: [(0, '6381.362'), (1, '5856.201')] [2023-12-26 14:17:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001828800_468172800.pth... [2023-12-26 14:17:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001840560_471187456.pth... [2023-12-26 14:17:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001827776_467910656.pth [2023-12-26 14:17:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001839504_470917120.pth [2023-12-26 14:17:38,849][123090] Updated weights for policy 1, policy_version 1828805 (0.0007) [2023-12-26 14:17:38,920][123090] Updated weights for policy 1, policy_version 1828815 (0.0005) [2023-12-26 14:17:38,984][123090] Updated weights for policy 1, policy_version 1828825 (0.0005) [2023-12-26 14:17:39,555][123091] Updated weights for policy 0, policy_version 1840563 (0.0009) [2023-12-26 14:17:39,616][123091] Updated weights for policy 0, policy_version 1840573 (0.0005) [2023-12-26 14:17:39,689][123091] Updated weights for policy 0, policy_version 1840583 (0.0006) [2023-12-26 14:17:39,764][123090] Updated weights for policy 1, policy_version 1828835 (0.0006) [2023-12-26 14:17:39,821][123090] Updated weights for policy 1, policy_version 1828845 (0.0009) [2023-12-26 14:17:39,884][123090] Updated weights for policy 1, policy_version 1828855 (0.0010) [2023-12-26 14:17:40,424][123091] Updated weights for policy 0, policy_version 1840593 (0.0009) [2023-12-26 14:17:40,488][123091] Updated weights for policy 0, policy_version 1840603 (0.0009) [2023-12-26 14:17:40,543][123091] Updated weights for policy 0, policy_version 1840613 (0.0010) [2023-12-26 14:17:40,600][123091] Updated weights for policy 0, policy_version 1840623 (0.0009) [2023-12-26 14:17:40,738][123090] Updated weights for policy 1, policy_version 1828865 (0.0010) [2023-12-26 14:17:40,789][123090] Updated weights for policy 1, policy_version 1828875 (0.0009) [2023-12-26 14:17:40,844][123090] Updated weights for policy 1, policy_version 1828885 (0.0009) [2023-12-26 14:17:40,889][123090] Updated weights for policy 1, policy_version 1828895 (0.0010) [2023-12-26 14:17:41,470][123091] Updated weights for policy 0, policy_version 1840633 (0.0009) [2023-12-26 14:17:41,539][123091] Updated weights for policy 0, policy_version 1840643 (0.0009) [2023-12-26 14:17:41,605][123091] Updated weights for policy 0, policy_version 1840653 (0.0009) [2023-12-26 14:17:41,815][123090] Updated weights for policy 1, policy_version 1828905 (0.0008) [2023-12-26 14:17:41,882][123090] Updated weights for policy 1, policy_version 1828915 (0.0008) [2023-12-26 14:17:41,949][123090] Updated weights for policy 1, policy_version 1828925 (0.0009) [2023-12-26 14:17:42,460][123091] Updated weights for policy 0, policy_version 1840663 (0.0006) [2023-12-26 14:17:42,532][123091] Updated weights for policy 0, policy_version 1840673 (0.0007) [2023-12-26 14:17:42,598][123091] Updated weights for policy 0, policy_version 1840683 (0.0009) [2023-12-26 14:17:42,791][123090] Updated weights for policy 1, policy_version 1828935 (0.0009) [2023-12-26 14:17:42,846][123090] Updated weights for policy 1, policy_version 1828945 (0.0009) [2023-12-26 14:17:42,909][123090] Updated weights for policy 1, policy_version 1828955 (0.0009) [2023-12-26 14:17:43,399][123091] Updated weights for policy 0, policy_version 1840693 (0.0010) [2023-12-26 14:17:43,448][123091] Updated weights for policy 0, policy_version 1840703 (0.0009) [2023-12-26 14:17:43,499][123091] Updated weights for policy 0, policy_version 1840713 (0.0009) [2023-12-26 14:17:43,752][123090] Updated weights for policy 1, policy_version 1828965 (0.0009) [2023-12-26 14:17:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 939442176. Throughput: 0: 8779.5, 1: 8697.9. Samples: 939438028. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:43,785][121949] Avg episode reward: [(0, '6419.620'), (1, '5959.603')] [2023-12-26 14:17:43,820][123090] Updated weights for policy 1, policy_version 1828975 (0.0009) [2023-12-26 14:17:43,886][123090] Updated weights for policy 1, policy_version 1828985 (0.0010) [2023-12-26 14:17:44,289][123091] Updated weights for policy 0, policy_version 1840723 (0.0008) [2023-12-26 14:17:44,348][123091] Updated weights for policy 0, policy_version 1840733 (0.0006) [2023-12-26 14:17:44,419][123091] Updated weights for policy 0, policy_version 1840743 (0.0005) [2023-12-26 14:17:44,619][123090] Updated weights for policy 1, policy_version 1828995 (0.0009) [2023-12-26 14:17:44,675][123090] Updated weights for policy 1, policy_version 1829005 (0.0009) [2023-12-26 14:17:44,726][123090] Updated weights for policy 1, policy_version 1829015 (0.0008) [2023-12-26 14:17:45,173][123091] Updated weights for policy 0, policy_version 1840753 (0.0006) [2023-12-26 14:17:45,238][123091] Updated weights for policy 0, policy_version 1840763 (0.0009) [2023-12-26 14:17:45,302][123091] Updated weights for policy 0, policy_version 1840773 (0.0009) [2023-12-26 14:17:45,367][123091] Updated weights for policy 0, policy_version 1840783 (0.0009) [2023-12-26 14:17:45,553][123090] Updated weights for policy 1, policy_version 1829025 (0.0009) [2023-12-26 14:17:45,603][123090] Updated weights for policy 1, policy_version 1829035 (0.0011) [2023-12-26 14:17:45,661][123090] Updated weights for policy 1, policy_version 1829045 (0.0011) [2023-12-26 14:17:45,725][123090] Updated weights for policy 1, policy_version 1829055 (0.0011) [2023-12-26 14:17:46,185][123091] Updated weights for policy 0, policy_version 1840793 (0.0009) [2023-12-26 14:17:46,233][123091] Updated weights for policy 0, policy_version 1840803 (0.0009) [2023-12-26 14:17:46,281][123091] Updated weights for policy 0, policy_version 1840813 (0.0009) [2023-12-26 14:17:46,569][123090] Updated weights for policy 1, policy_version 1829065 (0.0009) [2023-12-26 14:17:46,627][123090] Updated weights for policy 1, policy_version 1829075 (0.0009) [2023-12-26 14:17:46,679][123090] Updated weights for policy 1, policy_version 1829085 (0.0008) [2023-12-26 14:17:47,166][123091] Updated weights for policy 0, policy_version 1840824 (0.0010) [2023-12-26 14:17:47,227][123091] Updated weights for policy 0, policy_version 1840834 (0.0010) [2023-12-26 14:17:47,280][123091] Updated weights for policy 0, policy_version 1840844 (0.0009) [2023-12-26 14:17:47,416][123090] Updated weights for policy 1, policy_version 1829095 (0.0008) [2023-12-26 14:17:47,485][123090] Updated weights for policy 1, policy_version 1829105 (0.0010) [2023-12-26 14:17:47,555][123090] Updated weights for policy 1, policy_version 1829115 (0.0010) [2023-12-26 14:17:48,154][123091] Updated weights for policy 0, policy_version 1840854 (0.0007) [2023-12-26 14:17:48,222][123091] Updated weights for policy 0, policy_version 1840864 (0.0005) [2023-12-26 14:17:48,294][123090] Updated weights for policy 1, policy_version 1829126 (0.0010) [2023-12-26 14:17:48,298][123091] Updated weights for policy 0, policy_version 1840874 (0.0005) [2023-12-26 14:17:48,357][123090] Updated weights for policy 1, policy_version 1829136 (0.0010) [2023-12-26 14:17:48,412][123090] Updated weights for policy 1, policy_version 1829146 (0.0010) [2023-12-26 14:17:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 939532288. Throughput: 0: 8844.6, 1: 8728.9. Samples: 939543940. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:48,785][121949] Avg episode reward: [(0, '6413.891'), (1, '5885.936')] [2023-12-26 14:17:48,964][123091] Updated weights for policy 0, policy_version 1840884 (0.0007) [2023-12-26 14:17:49,029][123091] Updated weights for policy 0, policy_version 1840894 (0.0005) [2023-12-26 14:17:49,089][123091] Updated weights for policy 0, policy_version 1840904 (0.0005) [2023-12-26 14:17:49,272][123090] Updated weights for policy 1, policy_version 1829156 (0.0010) [2023-12-26 14:17:49,343][123090] Updated weights for policy 1, policy_version 1829166 (0.0009) [2023-12-26 14:17:49,416][123090] Updated weights for policy 1, policy_version 1829176 (0.0009) [2023-12-26 14:17:49,757][123091] Updated weights for policy 0, policy_version 1840914 (0.0006) [2023-12-26 14:17:49,836][123091] Updated weights for policy 0, policy_version 1840924 (0.0007) [2023-12-26 14:17:49,900][123091] Updated weights for policy 0, policy_version 1840934 (0.0009) [2023-12-26 14:17:49,965][123091] Updated weights for policy 0, policy_version 1840944 (0.0011) [2023-12-26 14:17:50,183][123090] Updated weights for policy 1, policy_version 1829186 (0.0010) [2023-12-26 14:17:50,234][123090] Updated weights for policy 1, policy_version 1829196 (0.0009) [2023-12-26 14:17:50,288][123090] Updated weights for policy 1, policy_version 1829206 (0.0009) [2023-12-26 14:17:50,356][123090] Updated weights for policy 1, policy_version 1829216 (0.0009) [2023-12-26 14:17:50,790][123091] Updated weights for policy 0, policy_version 1840954 (0.0009) [2023-12-26 14:17:50,852][123091] Updated weights for policy 0, policy_version 1840964 (0.0010) [2023-12-26 14:17:50,912][123091] Updated weights for policy 0, policy_version 1840974 (0.0008) [2023-12-26 14:17:51,218][123090] Updated weights for policy 1, policy_version 1829226 (0.0011) [2023-12-26 14:17:51,289][123090] Updated weights for policy 1, policy_version 1829236 (0.0011) [2023-12-26 14:17:51,350][123090] Updated weights for policy 1, policy_version 1829246 (0.0011) [2023-12-26 14:17:51,700][123091] Updated weights for policy 0, policy_version 1840984 (0.0007) [2023-12-26 14:17:51,770][123091] Updated weights for policy 0, policy_version 1840994 (0.0010) [2023-12-26 14:17:51,829][123091] Updated weights for policy 0, policy_version 1841004 (0.0009) [2023-12-26 14:17:52,146][123090] Updated weights for policy 1, policy_version 1829256 (0.0009) [2023-12-26 14:17:52,223][123090] Updated weights for policy 1, policy_version 1829266 (0.0005) [2023-12-26 14:17:52,287][123090] Updated weights for policy 1, policy_version 1829276 (0.0006) [2023-12-26 14:17:52,591][123091] Updated weights for policy 0, policy_version 1841014 (0.0009) [2023-12-26 14:17:52,659][123091] Updated weights for policy 0, policy_version 1841024 (0.0010) [2023-12-26 14:17:52,724][123091] Updated weights for policy 0, policy_version 1841034 (0.0007) [2023-12-26 14:17:53,113][123090] Updated weights for policy 1, policy_version 1829286 (0.0005) [2023-12-26 14:17:53,173][123090] Updated weights for policy 1, policy_version 1829296 (0.0005) [2023-12-26 14:17:53,244][123090] Updated weights for policy 1, policy_version 1829306 (0.0007) [2023-12-26 14:17:53,392][123091] Updated weights for policy 0, policy_version 1841044 (0.0007) [2023-12-26 14:17:53,461][123091] Updated weights for policy 0, policy_version 1841054 (0.0008) [2023-12-26 14:17:53,533][123091] Updated weights for policy 0, policy_version 1841064 (0.0005) [2023-12-26 14:17:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17689.1). Total num frames: 939622400. Throughput: 0: 8864.6, 1: 8754.2. Samples: 939597676. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:53,785][121949] Avg episode reward: [(0, '6350.907'), (1, '5827.154')] [2023-12-26 14:17:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001841072_471318528.pth... [2023-12-26 14:17:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001829312_468303872.pth... [2023-12-26 14:17:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001828288_468041728.pth [2023-12-26 14:17:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001840016_471048192.pth [2023-12-26 14:17:53,841][123090] Updated weights for policy 1, policy_version 1829316 (0.0006) [2023-12-26 14:17:53,890][123090] Updated weights for policy 1, policy_version 1829326 (0.0005) [2023-12-26 14:17:53,944][123090] Updated weights for policy 1, policy_version 1829336 (0.0005) [2023-12-26 14:17:54,178][123091] Updated weights for policy 0, policy_version 1841074 (0.0005) [2023-12-26 14:17:54,241][123091] Updated weights for policy 0, policy_version 1841084 (0.0005) [2023-12-26 14:17:54,298][123091] Updated weights for policy 0, policy_version 1841094 (0.0005) [2023-12-26 14:17:54,366][123091] Updated weights for policy 0, policy_version 1841104 (0.0006) [2023-12-26 14:17:54,712][123090] Updated weights for policy 1, policy_version 1829346 (0.0005) [2023-12-26 14:17:54,781][123090] Updated weights for policy 1, policy_version 1829356 (0.0005) [2023-12-26 14:17:54,847][123090] Updated weights for policy 1, policy_version 1829366 (0.0005) [2023-12-26 14:17:54,915][123090] Updated weights for policy 1, policy_version 1829376 (0.0005) [2023-12-26 14:17:55,037][123091] Updated weights for policy 0, policy_version 1841114 (0.0011) [2023-12-26 14:17:55,089][123091] Updated weights for policy 0, policy_version 1841124 (0.0010) [2023-12-26 14:17:55,144][123091] Updated weights for policy 0, policy_version 1841134 (0.0010) [2023-12-26 14:17:55,615][123090] Updated weights for policy 1, policy_version 1829386 (0.0010) [2023-12-26 14:17:55,662][123090] Updated weights for policy 1, policy_version 1829396 (0.0010) [2023-12-26 14:17:55,725][123090] Updated weights for policy 1, policy_version 1829406 (0.0010) [2023-12-26 14:17:55,978][123091] Updated weights for policy 0, policy_version 1841144 (0.0010) [2023-12-26 14:17:56,025][123091] Updated weights for policy 0, policy_version 1841154 (0.0010) [2023-12-26 14:17:56,072][123091] Updated weights for policy 0, policy_version 1841164 (0.0010) [2023-12-26 14:17:56,507][123090] Updated weights for policy 1, policy_version 1829416 (0.0006) [2023-12-26 14:17:56,558][123090] Updated weights for policy 1, policy_version 1829426 (0.0009) [2023-12-26 14:17:56,617][123090] Updated weights for policy 1, policy_version 1829436 (0.0010) [2023-12-26 14:17:56,935][123091] Updated weights for policy 0, policy_version 1841174 (0.0010) [2023-12-26 14:17:56,985][123091] Updated weights for policy 0, policy_version 1841184 (0.0010) [2023-12-26 14:17:57,041][123091] Updated weights for policy 0, policy_version 1841194 (0.0010) [2023-12-26 14:17:57,419][123090] Updated weights for policy 1, policy_version 1829446 (0.0007) [2023-12-26 14:17:57,498][123090] Updated weights for policy 1, policy_version 1829456 (0.0005) [2023-12-26 14:17:57,560][123090] Updated weights for policy 1, policy_version 1829466 (0.0005) [2023-12-26 14:17:57,767][123091] Updated weights for policy 0, policy_version 1841204 (0.0008) [2023-12-26 14:17:57,817][123091] Updated weights for policy 0, policy_version 1841214 (0.0009) [2023-12-26 14:17:57,872][123091] Updated weights for policy 0, policy_version 1841224 (0.0010) [2023-12-26 14:17:58,170][123090] Updated weights for policy 1, policy_version 1829476 (0.0006) [2023-12-26 14:17:58,229][123090] Updated weights for policy 1, policy_version 1829486 (0.0009) [2023-12-26 14:17:58,283][123090] Updated weights for policy 1, policy_version 1829496 (0.0010) [2023-12-26 14:17:58,655][123091] Updated weights for policy 0, policy_version 1841234 (0.0009) [2023-12-26 14:17:58,720][123091] Updated weights for policy 0, policy_version 1841244 (0.0006) [2023-12-26 14:17:58,775][123091] Updated weights for policy 0, policy_version 1841254 (0.0006) [2023-12-26 14:17:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 939712512. Throughput: 0: 8944.2, 1: 8914.0. Samples: 939709888. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:17:58,785][121949] Avg episode reward: [(0, '6244.398'), (1, '5742.411')] [2023-12-26 14:17:58,839][123091] Updated weights for policy 0, policy_version 1841264 (0.0008) [2023-12-26 14:17:59,110][123090] Updated weights for policy 1, policy_version 1829506 (0.0009) [2023-12-26 14:17:59,172][123090] Updated weights for policy 1, policy_version 1829516 (0.0005) [2023-12-26 14:17:59,239][123090] Updated weights for policy 1, policy_version 1829526 (0.0007) [2023-12-26 14:17:59,305][123090] Updated weights for policy 1, policy_version 1829536 (0.0010) [2023-12-26 14:17:59,632][123091] Updated weights for policy 0, policy_version 1841274 (0.0010) [2023-12-26 14:17:59,683][123091] Updated weights for policy 0, policy_version 1841284 (0.0010) [2023-12-26 14:17:59,737][123091] Updated weights for policy 0, policy_version 1841294 (0.0010) [2023-12-26 14:18:00,019][123090] Updated weights for policy 1, policy_version 1829546 (0.0009) [2023-12-26 14:18:00,092][123090] Updated weights for policy 1, policy_version 1829556 (0.0006) [2023-12-26 14:18:00,155][123090] Updated weights for policy 1, policy_version 1829566 (0.0010) [2023-12-26 14:18:00,590][123091] Updated weights for policy 0, policy_version 1841304 (0.0009) [2023-12-26 14:18:00,651][123091] Updated weights for policy 0, policy_version 1841314 (0.0009) [2023-12-26 14:18:00,702][123091] Updated weights for policy 0, policy_version 1841324 (0.0008) [2023-12-26 14:18:00,936][123090] Updated weights for policy 1, policy_version 1829576 (0.0010) [2023-12-26 14:18:01,009][123090] Updated weights for policy 1, policy_version 1829586 (0.0010) [2023-12-26 14:18:01,080][123090] Updated weights for policy 1, policy_version 1829597 (0.0010) [2023-12-26 14:18:01,445][123091] Updated weights for policy 0, policy_version 1841334 (0.0007) [2023-12-26 14:18:01,511][123091] Updated weights for policy 0, policy_version 1841344 (0.0006) [2023-12-26 14:18:01,565][123091] Updated weights for policy 0, policy_version 1841354 (0.0005) [2023-12-26 14:18:01,894][123090] Updated weights for policy 1, policy_version 1829607 (0.0009) [2023-12-26 14:18:01,953][123090] Updated weights for policy 1, policy_version 1829617 (0.0009) [2023-12-26 14:18:02,003][123090] Updated weights for policy 1, policy_version 1829627 (0.0008) [2023-12-26 14:18:02,296][123091] Updated weights for policy 0, policy_version 1841364 (0.0006) [2023-12-26 14:18:02,367][123091] Updated weights for policy 0, policy_version 1841374 (0.0009) [2023-12-26 14:18:02,435][123091] Updated weights for policy 0, policy_version 1841384 (0.0011) [2023-12-26 14:18:02,923][123090] Updated weights for policy 1, policy_version 1829637 (0.0009) [2023-12-26 14:18:02,975][123090] Updated weights for policy 1, policy_version 1829647 (0.0009) [2023-12-26 14:18:03,028][123090] Updated weights for policy 1, policy_version 1829658 (0.0009) [2023-12-26 14:18:03,092][123091] Updated weights for policy 0, policy_version 1841394 (0.0009) [2023-12-26 14:18:03,147][123091] Updated weights for policy 0, policy_version 1841404 (0.0005) [2023-12-26 14:18:03,202][123091] Updated weights for policy 0, policy_version 1841414 (0.0005) [2023-12-26 14:18:03,267][123091] Updated weights for policy 0, policy_version 1841424 (0.0005) [2023-12-26 14:18:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 939802624. Throughput: 0: 9075.6, 1: 8862.5. Samples: 939817652. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:03,785][121949] Avg episode reward: [(0, '6215.957'), (1, '5809.679')] [2023-12-26 14:18:03,939][123091] Updated weights for policy 0, policy_version 1841434 (0.0008) [2023-12-26 14:18:03,955][123090] Updated weights for policy 1, policy_version 1829669 (0.0008) [2023-12-26 14:18:04,001][123091] Updated weights for policy 0, policy_version 1841444 (0.0008) [2023-12-26 14:18:04,012][123090] Updated weights for policy 1, policy_version 1829679 (0.0009) [2023-12-26 14:18:04,060][123091] Updated weights for policy 0, policy_version 1841454 (0.0008) [2023-12-26 14:18:04,073][123090] Updated weights for policy 1, policy_version 1829689 (0.0006) [2023-12-26 14:18:04,827][123091] Updated weights for policy 0, policy_version 1841464 (0.0006) [2023-12-26 14:18:04,876][123091] Updated weights for policy 0, policy_version 1841474 (0.0005) [2023-12-26 14:18:04,923][123090] Updated weights for policy 1, policy_version 1829699 (0.0008) [2023-12-26 14:18:04,936][123091] Updated weights for policy 0, policy_version 1841484 (0.0005) [2023-12-26 14:18:04,988][123090] Updated weights for policy 1, policy_version 1829709 (0.0005) [2023-12-26 14:18:05,039][123090] Updated weights for policy 1, policy_version 1829719 (0.0005) [2023-12-26 14:18:05,521][123091] Updated weights for policy 0, policy_version 1841494 (0.0005) [2023-12-26 14:18:05,569][123091] Updated weights for policy 0, policy_version 1841504 (0.0005) [2023-12-26 14:18:05,620][123091] Updated weights for policy 0, policy_version 1841514 (0.0005) [2023-12-26 14:18:05,772][123090] Updated weights for policy 1, policy_version 1829729 (0.0006) [2023-12-26 14:18:05,839][123090] Updated weights for policy 1, policy_version 1829739 (0.0009) [2023-12-26 14:18:05,889][123090] Updated weights for policy 1, policy_version 1829750 (0.0010) [2023-12-26 14:18:05,940][123090] Updated weights for policy 1, policy_version 1829760 (0.0009) [2023-12-26 14:18:06,415][123091] Updated weights for policy 0, policy_version 1841524 (0.0007) [2023-12-26 14:18:06,486][123091] Updated weights for policy 0, policy_version 1841534 (0.0011) [2023-12-26 14:18:06,561][123091] Updated weights for policy 0, policy_version 1841544 (0.0011) [2023-12-26 14:18:06,823][123090] Updated weights for policy 1, policy_version 1829770 (0.0008) [2023-12-26 14:18:06,868][123090] Updated weights for policy 1, policy_version 1829780 (0.0010) [2023-12-26 14:18:06,914][123090] Updated weights for policy 1, policy_version 1829790 (0.0009) [2023-12-26 14:18:07,350][123091] Updated weights for policy 0, policy_version 1841554 (0.0010) [2023-12-26 14:18:07,406][123091] Updated weights for policy 0, policy_version 1841564 (0.0009) [2023-12-26 14:18:07,472][123091] Updated weights for policy 0, policy_version 1841574 (0.0009) [2023-12-26 14:18:07,538][123091] Updated weights for policy 0, policy_version 1841584 (0.0010) [2023-12-26 14:18:07,694][123090] Updated weights for policy 1, policy_version 1829800 (0.0009) [2023-12-26 14:18:07,761][123090] Updated weights for policy 1, policy_version 1829810 (0.0011) [2023-12-26 14:18:07,827][123090] Updated weights for policy 1, policy_version 1829820 (0.0009) [2023-12-26 14:18:08,433][123091] Updated weights for policy 0, policy_version 1841594 (0.0011) [2023-12-26 14:18:08,482][123091] Updated weights for policy 0, policy_version 1841604 (0.0010) [2023-12-26 14:18:08,533][123091] Updated weights for policy 0, policy_version 1841614 (0.0008) [2023-12-26 14:18:08,554][123090] Updated weights for policy 1, policy_version 1829830 (0.0007) [2023-12-26 14:18:08,621][123090] Updated weights for policy 1, policy_version 1829840 (0.0009) [2023-12-26 14:18:08,687][123090] Updated weights for policy 1, policy_version 1829850 (0.0010) [2023-12-26 14:18:08,784][121949] Fps is (10 sec: 18841.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 939900928. Throughput: 0: 9155.1, 1: 8862.1. Samples: 939872340. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:08,785][121949] Avg episode reward: [(0, '6277.960'), (1, '5923.716')] [2023-12-26 14:18:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001841616_471457792.pth... [2023-12-26 14:18:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001829856_468443136.pth... [2023-12-26 14:18:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001840560_471187456.pth [2023-12-26 14:18:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001828800_468172800.pth [2023-12-26 14:18:09,405][123091] Updated weights for policy 0, policy_version 1841624 (0.0010) [2023-12-26 14:18:09,467][123091] Updated weights for policy 0, policy_version 1841634 (0.0010) [2023-12-26 14:18:09,473][123090] Updated weights for policy 1, policy_version 1829860 (0.0009) [2023-12-26 14:18:09,520][123091] Updated weights for policy 0, policy_version 1841644 (0.0007) [2023-12-26 14:18:09,527][123090] Updated weights for policy 1, policy_version 1829870 (0.0009) [2023-12-26 14:18:09,583][123090] Updated weights for policy 1, policy_version 1829880 (0.0008) [2023-12-26 14:18:10,405][123091] Updated weights for policy 0, policy_version 1841654 (0.0009) [2023-12-26 14:18:10,421][123090] Updated weights for policy 1, policy_version 1829890 (0.0010) [2023-12-26 14:18:10,467][123091] Updated weights for policy 0, policy_version 1841664 (0.0007) [2023-12-26 14:18:10,473][123090] Updated weights for policy 1, policy_version 1829900 (0.0010) [2023-12-26 14:18:10,525][123090] Updated weights for policy 1, policy_version 1829910 (0.0010) [2023-12-26 14:18:10,528][123091] Updated weights for policy 0, policy_version 1841674 (0.0006) [2023-12-26 14:18:10,581][123090] Updated weights for policy 1, policy_version 1829920 (0.0010) [2023-12-26 14:18:11,332][123091] Updated weights for policy 0, policy_version 1841684 (0.0006) [2023-12-26 14:18:11,401][123091] Updated weights for policy 0, policy_version 1841694 (0.0008) [2023-12-26 14:18:11,460][123090] Updated weights for policy 1, policy_version 1829930 (0.0009) [2023-12-26 14:18:11,469][123091] Updated weights for policy 0, policy_version 1841704 (0.0008) [2023-12-26 14:18:11,524][123090] Updated weights for policy 1, policy_version 1829940 (0.0011) [2023-12-26 14:18:11,594][123090] Updated weights for policy 1, policy_version 1829950 (0.0011) [2023-12-26 14:18:12,287][123091] Updated weights for policy 0, policy_version 1841714 (0.0007) [2023-12-26 14:18:12,357][123091] Updated weights for policy 0, policy_version 1841724 (0.0010) [2023-12-26 14:18:12,404][123090] Updated weights for policy 1, policy_version 1829960 (0.0009) [2023-12-26 14:18:12,419][123091] Updated weights for policy 0, policy_version 1841734 (0.0009) [2023-12-26 14:18:12,470][123090] Updated weights for policy 1, policy_version 1829970 (0.0007) [2023-12-26 14:18:12,480][123091] Updated weights for policy 0, policy_version 1841744 (0.0008) [2023-12-26 14:18:12,531][123090] Updated weights for policy 1, policy_version 1829980 (0.0006) [2023-12-26 14:18:13,238][123090] Updated weights for policy 1, policy_version 1829990 (0.0005) [2023-12-26 14:18:13,288][123090] Updated weights for policy 1, policy_version 1830000 (0.0006) [2023-12-26 14:18:13,318][123091] Updated weights for policy 0, policy_version 1841754 (0.0009) [2023-12-26 14:18:13,337][123090] Updated weights for policy 1, policy_version 1830010 (0.0008) [2023-12-26 14:18:13,370][123091] Updated weights for policy 0, policy_version 1841764 (0.0009) [2023-12-26 14:18:13,423][123091] Updated weights for policy 0, policy_version 1841774 (0.0009) [2023-12-26 14:18:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 939982848. Throughput: 0: 8943.6, 1: 8875.8. Samples: 939974996. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:13,785][121949] Avg episode reward: [(0, '6259.676'), (1, '5895.393')] [2023-12-26 14:18:14,052][123090] Updated weights for policy 1, policy_version 1830020 (0.0006) [2023-12-26 14:18:14,117][123090] Updated weights for policy 1, policy_version 1830030 (0.0006) [2023-12-26 14:18:14,148][123091] Updated weights for policy 0, policy_version 1841784 (0.0009) [2023-12-26 14:18:14,168][123090] Updated weights for policy 1, policy_version 1830040 (0.0009) [2023-12-26 14:18:14,207][123091] Updated weights for policy 0, policy_version 1841794 (0.0007) [2023-12-26 14:18:14,270][123091] Updated weights for policy 0, policy_version 1841804 (0.0008) [2023-12-26 14:18:14,949][123090] Updated weights for policy 1, policy_version 1830050 (0.0009) [2023-12-26 14:18:15,011][123090] Updated weights for policy 1, policy_version 1830060 (0.0009) [2023-12-26 14:18:15,073][123090] Updated weights for policy 1, policy_version 1830070 (0.0009) [2023-12-26 14:18:15,123][123091] Updated weights for policy 0, policy_version 1841815 (0.0011) [2023-12-26 14:18:15,132][123090] Updated weights for policy 1, policy_version 1830080 (0.0009) [2023-12-26 14:18:15,188][123091] Updated weights for policy 0, policy_version 1841825 (0.0011) [2023-12-26 14:18:15,255][123091] Updated weights for policy 0, policy_version 1841835 (0.0011) [2023-12-26 14:18:15,943][123090] Updated weights for policy 1, policy_version 1830090 (0.0005) [2023-12-26 14:18:16,010][123090] Updated weights for policy 1, policy_version 1830100 (0.0007) [2023-12-26 14:18:16,073][123090] Updated weights for policy 1, policy_version 1830110 (0.0007) [2023-12-26 14:18:16,076][123091] Updated weights for policy 0, policy_version 1841845 (0.0009) [2023-12-26 14:18:16,143][123091] Updated weights for policy 0, policy_version 1841855 (0.0009) [2023-12-26 14:18:16,207][123091] Updated weights for policy 0, policy_version 1841865 (0.0009) [2023-12-26 14:18:16,768][123090] Updated weights for policy 1, policy_version 1830120 (0.0006) [2023-12-26 14:18:16,830][123090] Updated weights for policy 1, policy_version 1830130 (0.0006) [2023-12-26 14:18:16,891][123090] Updated weights for policy 1, policy_version 1830140 (0.0010) [2023-12-26 14:18:16,898][123091] Updated weights for policy 0, policy_version 1841875 (0.0007) [2023-12-26 14:18:16,961][123091] Updated weights for policy 0, policy_version 1841885 (0.0009) [2023-12-26 14:18:17,018][123091] Updated weights for policy 0, policy_version 1841895 (0.0010) [2023-12-26 14:18:17,597][123090] Updated weights for policy 1, policy_version 1830150 (0.0009) [2023-12-26 14:18:17,647][123090] Updated weights for policy 1, policy_version 1830160 (0.0009) [2023-12-26 14:18:17,699][123090] Updated weights for policy 1, policy_version 1830171 (0.0007) [2023-12-26 14:18:17,777][123091] Updated weights for policy 0, policy_version 1841906 (0.0010) [2023-12-26 14:18:17,833][123091] Updated weights for policy 0, policy_version 1841916 (0.0005) [2023-12-26 14:18:17,879][123091] Updated weights for policy 0, policy_version 1841926 (0.0005) [2023-12-26 14:18:17,931][123091] Updated weights for policy 0, policy_version 1841936 (0.0005) [2023-12-26 14:18:18,502][123090] Updated weights for policy 1, policy_version 1830181 (0.0008) [2023-12-26 14:18:18,555][123090] Updated weights for policy 1, policy_version 1830191 (0.0009) [2023-12-26 14:18:18,606][123090] Updated weights for policy 1, policy_version 1830201 (0.0010) [2023-12-26 14:18:18,755][123091] Updated weights for policy 0, policy_version 1841946 (0.0010) [2023-12-26 14:18:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 940072960. Throughput: 0: 8959.4, 1: 8857.3. Samples: 940085096. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:18,784][121949] Avg episode reward: [(0, '6254.826'), (1, '5869.420')] [2023-12-26 14:18:18,831][123091] Updated weights for policy 0, policy_version 1841956 (0.0010) [2023-12-26 14:18:18,897][123091] Updated weights for policy 0, policy_version 1841966 (0.0010) [2023-12-26 14:18:19,461][123090] Updated weights for policy 1, policy_version 1830211 (0.0008) [2023-12-26 14:18:19,534][123090] Updated weights for policy 1, policy_version 1830221 (0.0008) [2023-12-26 14:18:19,567][123091] Updated weights for policy 0, policy_version 1841976 (0.0010) [2023-12-26 14:18:19,601][123090] Updated weights for policy 1, policy_version 1830231 (0.0011) [2023-12-26 14:18:19,631][123091] Updated weights for policy 0, policy_version 1841986 (0.0011) [2023-12-26 14:18:19,699][123091] Updated weights for policy 0, policy_version 1841996 (0.0011) [2023-12-26 14:18:20,368][123090] Updated weights for policy 1, policy_version 1830241 (0.0010) [2023-12-26 14:18:20,442][123090] Updated weights for policy 1, policy_version 1830251 (0.0007) [2023-12-26 14:18:20,508][123090] Updated weights for policy 1, policy_version 1830261 (0.0009) [2023-12-26 14:18:20,513][123091] Updated weights for policy 0, policy_version 1842006 (0.0009) [2023-12-26 14:18:20,567][123090] Updated weights for policy 1, policy_version 1830271 (0.0008) [2023-12-26 14:18:20,573][123091] Updated weights for policy 0, policy_version 1842016 (0.0008) [2023-12-26 14:18:20,636][123091] Updated weights for policy 0, policy_version 1842026 (0.0008) [2023-12-26 14:18:21,438][123090] Updated weights for policy 1, policy_version 1830281 (0.0011) [2023-12-26 14:18:21,471][123091] Updated weights for policy 0, policy_version 1842036 (0.0009) [2023-12-26 14:18:21,502][123090] Updated weights for policy 1, policy_version 1830291 (0.0011) [2023-12-26 14:18:21,534][123091] Updated weights for policy 0, policy_version 1842046 (0.0007) [2023-12-26 14:18:21,569][123090] Updated weights for policy 1, policy_version 1830301 (0.0009) [2023-12-26 14:18:21,599][123091] Updated weights for policy 0, policy_version 1842056 (0.0009) [2023-12-26 14:18:22,376][123090] Updated weights for policy 1, policy_version 1830311 (0.0011) [2023-12-26 14:18:22,429][123090] Updated weights for policy 1, policy_version 1830321 (0.0010) [2023-12-26 14:18:22,481][123090] Updated weights for policy 1, policy_version 1830331 (0.0010) [2023-12-26 14:18:22,498][123091] Updated weights for policy 0, policy_version 1842066 (0.0009) [2023-12-26 14:18:22,566][123091] Updated weights for policy 0, policy_version 1842076 (0.0008) [2023-12-26 14:18:22,630][123091] Updated weights for policy 0, policy_version 1842086 (0.0010) [2023-12-26 14:18:22,699][123091] Updated weights for policy 0, policy_version 1842096 (0.0009) [2023-12-26 14:18:23,372][123090] Updated weights for policy 1, policy_version 1830342 (0.0010) [2023-12-26 14:18:23,438][123090] Updated weights for policy 1, policy_version 1830352 (0.0008) [2023-12-26 14:18:23,441][123091] Updated weights for policy 0, policy_version 1842106 (0.0006) [2023-12-26 14:18:23,502][123090] Updated weights for policy 1, policy_version 1830362 (0.0008) [2023-12-26 14:18:23,509][123091] Updated weights for policy 0, policy_version 1842116 (0.0009) [2023-12-26 14:18:23,568][123091] Updated weights for policy 0, policy_version 1842126 (0.0009) [2023-12-26 14:18:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 940163072. Throughput: 0: 8954.3, 1: 8839.4. Samples: 940136012. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:23,785][121949] Avg episode reward: [(0, '6302.457'), (1, '5954.993')] [2023-12-26 14:18:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001830368_468574208.pth... [2023-12-26 14:18:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001842128_471588864.pth... [2023-12-26 14:18:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001829312_468303872.pth [2023-12-26 14:18:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001841072_471318528.pth [2023-12-26 14:18:24,298][123091] Updated weights for policy 0, policy_version 1842136 (0.0007) [2023-12-26 14:18:24,357][123091] Updated weights for policy 0, policy_version 1842146 (0.0005) [2023-12-26 14:18:24,401][123090] Updated weights for policy 1, policy_version 1830372 (0.0009) [2023-12-26 14:18:24,419][123091] Updated weights for policy 0, policy_version 1842156 (0.0006) [2023-12-26 14:18:24,457][123090] Updated weights for policy 1, policy_version 1830382 (0.0009) [2023-12-26 14:18:24,515][123090] Updated weights for policy 1, policy_version 1830392 (0.0010) [2023-12-26 14:18:25,101][123091] Updated weights for policy 0, policy_version 1842166 (0.0009) [2023-12-26 14:18:25,158][123091] Updated weights for policy 0, policy_version 1842176 (0.0010) [2023-12-26 14:18:25,220][123091] Updated weights for policy 0, policy_version 1842186 (0.0010) [2023-12-26 14:18:25,413][123090] Updated weights for policy 1, policy_version 1830402 (0.0009) [2023-12-26 14:18:25,462][123090] Updated weights for policy 1, policy_version 1830412 (0.0009) [2023-12-26 14:18:25,511][123090] Updated weights for policy 1, policy_version 1830422 (0.0008) [2023-12-26 14:18:25,558][123090] Updated weights for policy 1, policy_version 1830432 (0.0008) [2023-12-26 14:18:25,995][123091] Updated weights for policy 0, policy_version 1842196 (0.0008) [2023-12-26 14:18:26,064][123091] Updated weights for policy 0, policy_version 1842206 (0.0006) [2023-12-26 14:18:26,135][123091] Updated weights for policy 0, policy_version 1842216 (0.0010) [2023-12-26 14:18:26,384][123090] Updated weights for policy 1, policy_version 1830442 (0.0005) [2023-12-26 14:18:26,453][123090] Updated weights for policy 1, policy_version 1830452 (0.0005) [2023-12-26 14:18:26,521][123090] Updated weights for policy 1, policy_version 1830462 (0.0009) [2023-12-26 14:18:26,919][123091] Updated weights for policy 0, policy_version 1842226 (0.0009) [2023-12-26 14:18:26,976][123091] Updated weights for policy 0, policy_version 1842236 (0.0006) [2023-12-26 14:18:27,043][123091] Updated weights for policy 0, policy_version 1842246 (0.0005) [2023-12-26 14:18:27,110][123091] Updated weights for policy 0, policy_version 1842256 (0.0005) [2023-12-26 14:18:27,233][123090] Updated weights for policy 1, policy_version 1830472 (0.0006) [2023-12-26 14:18:27,284][123090] Updated weights for policy 1, policy_version 1830482 (0.0005) [2023-12-26 14:18:27,351][123090] Updated weights for policy 1, policy_version 1830492 (0.0005) [2023-12-26 14:18:27,820][123091] Updated weights for policy 0, policy_version 1842266 (0.0006) [2023-12-26 14:18:27,884][123091] Updated weights for policy 0, policy_version 1842276 (0.0010) [2023-12-26 14:18:27,953][123091] Updated weights for policy 0, policy_version 1842286 (0.0010) [2023-12-26 14:18:28,119][123090] Updated weights for policy 1, policy_version 1830502 (0.0010) [2023-12-26 14:18:28,166][123090] Updated weights for policy 1, policy_version 1830512 (0.0010) [2023-12-26 14:18:28,221][123090] Updated weights for policy 1, policy_version 1830522 (0.0010) [2023-12-26 14:18:28,638][123091] Updated weights for policy 0, policy_version 1842296 (0.0006) [2023-12-26 14:18:28,709][123091] Updated weights for policy 0, policy_version 1842306 (0.0005) [2023-12-26 14:18:28,782][123091] Updated weights for policy 0, policy_version 1842316 (0.0005) [2023-12-26 14:18:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 940244992. Throughput: 0: 9038.2, 1: 8844.9. Samples: 940242768. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:28,785][121949] Avg episode reward: [(0, '6276.576'), (1, '5895.896')] [2023-12-26 14:18:29,098][123090] Updated weights for policy 1, policy_version 1830532 (0.0010) [2023-12-26 14:18:29,165][123090] Updated weights for policy 1, policy_version 1830542 (0.0010) [2023-12-26 14:18:29,240][123090] Updated weights for policy 1, policy_version 1830552 (0.0009) [2023-12-26 14:18:29,466][123091] Updated weights for policy 0, policy_version 1842326 (0.0009) [2023-12-26 14:18:29,528][123091] Updated weights for policy 0, policy_version 1842336 (0.0010) [2023-12-26 14:18:29,590][123091] Updated weights for policy 0, policy_version 1842346 (0.0010) [2023-12-26 14:18:30,074][123090] Updated weights for policy 1, policy_version 1830562 (0.0008) [2023-12-26 14:18:30,152][123090] Updated weights for policy 1, policy_version 1830572 (0.0008) [2023-12-26 14:18:30,227][123090] Updated weights for policy 1, policy_version 1830582 (0.0011) [2023-12-26 14:18:30,288][123090] Updated weights for policy 1, policy_version 1830592 (0.0011) [2023-12-26 14:18:30,391][123091] Updated weights for policy 0, policy_version 1842356 (0.0009) [2023-12-26 14:18:30,456][123091] Updated weights for policy 0, policy_version 1842366 (0.0010) [2023-12-26 14:18:30,519][123091] Updated weights for policy 0, policy_version 1842376 (0.0010) [2023-12-26 14:18:31,094][123090] Updated weights for policy 1, policy_version 1830602 (0.0010) [2023-12-26 14:18:31,153][123090] Updated weights for policy 1, policy_version 1830612 (0.0011) [2023-12-26 14:18:31,200][123091] Updated weights for policy 0, policy_version 1842386 (0.0010) [2023-12-26 14:18:31,225][123090] Updated weights for policy 1, policy_version 1830622 (0.0011) [2023-12-26 14:18:31,263][123091] Updated weights for policy 0, policy_version 1842396 (0.0008) [2023-12-26 14:18:31,326][123091] Updated weights for policy 0, policy_version 1842406 (0.0008) [2023-12-26 14:18:31,397][123091] Updated weights for policy 0, policy_version 1842416 (0.0008) [2023-12-26 14:18:32,080][123090] Updated weights for policy 1, policy_version 1830632 (0.0007) [2023-12-26 14:18:32,131][123090] Updated weights for policy 1, policy_version 1830642 (0.0007) [2023-12-26 14:18:32,134][123091] Updated weights for policy 0, policy_version 1842426 (0.0008) [2023-12-26 14:18:32,180][123090] Updated weights for policy 1, policy_version 1830652 (0.0006) [2023-12-26 14:18:32,193][123091] Updated weights for policy 0, policy_version 1842436 (0.0006) [2023-12-26 14:18:32,254][123091] Updated weights for policy 0, policy_version 1842446 (0.0007) [2023-12-26 14:18:32,916][123090] Updated weights for policy 1, policy_version 1830662 (0.0005) [2023-12-26 14:18:32,977][123090] Updated weights for policy 1, policy_version 1830672 (0.0005) [2023-12-26 14:18:33,033][123090] Updated weights for policy 1, policy_version 1830682 (0.0005) [2023-12-26 14:18:33,078][123091] Updated weights for policy 0, policy_version 1842456 (0.0009) [2023-12-26 14:18:33,134][123091] Updated weights for policy 0, policy_version 1842466 (0.0010) [2023-12-26 14:18:33,189][123091] Updated weights for policy 0, policy_version 1842476 (0.0009) [2023-12-26 14:18:33,600][123090] Updated weights for policy 1, policy_version 1830692 (0.0005) [2023-12-26 14:18:33,646][123090] Updated weights for policy 1, policy_version 1830702 (0.0005) [2023-12-26 14:18:33,691][123090] Updated weights for policy 1, policy_version 1830712 (0.0005) [2023-12-26 14:18:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 940343296. Throughput: 0: 9079.6, 1: 8866.6. Samples: 940351524. Policy #0 lag: (min: 11.0, avg: 23.7, max: 43.0) [2023-12-26 14:18:33,785][121949] Avg episode reward: [(0, '6312.696'), (1, '5890.462')] [2023-12-26 14:18:34,099][123091] Updated weights for policy 0, policy_version 1842486 (0.0010) [2023-12-26 14:18:34,162][123091] Updated weights for policy 0, policy_version 1842496 (0.0008) [2023-12-26 14:18:34,222][123091] Updated weights for policy 0, policy_version 1842506 (0.0006) [2023-12-26 14:18:34,433][123090] Updated weights for policy 1, policy_version 1830722 (0.0005) [2023-12-26 14:18:34,501][123090] Updated weights for policy 1, policy_version 1830732 (0.0006) [2023-12-26 14:18:34,552][123090] Updated weights for policy 1, policy_version 1830742 (0.0005) [2023-12-26 14:18:34,617][123090] Updated weights for policy 1, policy_version 1830752 (0.0006) [2023-12-26 14:18:35,114][123091] Updated weights for policy 0, policy_version 1842516 (0.0009) [2023-12-26 14:18:35,170][123091] Updated weights for policy 0, policy_version 1842526 (0.0009) [2023-12-26 14:18:35,225][123091] Updated weights for policy 0, policy_version 1842536 (0.0008) [2023-12-26 14:18:35,319][123090] Updated weights for policy 1, policy_version 1830762 (0.0008) [2023-12-26 14:18:35,383][123090] Updated weights for policy 1, policy_version 1830772 (0.0011) [2023-12-26 14:18:35,444][123090] Updated weights for policy 1, policy_version 1830782 (0.0010) [2023-12-26 14:18:36,076][123091] Updated weights for policy 0, policy_version 1842546 (0.0009) [2023-12-26 14:18:36,139][123091] Updated weights for policy 0, policy_version 1842556 (0.0008) [2023-12-26 14:18:36,208][123091] Updated weights for policy 0, policy_version 1842566 (0.0008) [2023-12-26 14:18:36,237][123090] Updated weights for policy 1, policy_version 1830792 (0.0011) [2023-12-26 14:18:36,270][123091] Updated weights for policy 0, policy_version 1842576 (0.0007) [2023-12-26 14:18:36,302][123090] Updated weights for policy 1, policy_version 1830802 (0.0011) [2023-12-26 14:18:36,374][123090] Updated weights for policy 1, policy_version 1830812 (0.0011) [2023-12-26 14:18:37,084][123091] Updated weights for policy 0, policy_version 1842586 (0.0008) [2023-12-26 14:18:37,151][123091] Updated weights for policy 0, policy_version 1842596 (0.0008) [2023-12-26 14:18:37,208][123090] Updated weights for policy 1, policy_version 1830822 (0.0011) [2023-12-26 14:18:37,221][123091] Updated weights for policy 0, policy_version 1842606 (0.0006) [2023-12-26 14:18:37,274][123090] Updated weights for policy 1, policy_version 1830832 (0.0010) [2023-12-26 14:18:37,342][123090] Updated weights for policy 1, policy_version 1830842 (0.0010) [2023-12-26 14:18:38,042][123091] Updated weights for policy 0, policy_version 1842616 (0.0006) [2023-12-26 14:18:38,096][123091] Updated weights for policy 0, policy_version 1842626 (0.0005) [2023-12-26 14:18:38,148][123091] Updated weights for policy 0, policy_version 1842636 (0.0006) [2023-12-26 14:18:38,208][123090] Updated weights for policy 1, policy_version 1830852 (0.0010) [2023-12-26 14:18:38,263][123090] Updated weights for policy 1, policy_version 1830863 (0.0010) [2023-12-26 14:18:38,314][123090] Updated weights for policy 1, policy_version 1830873 (0.0009) [2023-12-26 14:18:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 940425216. Throughput: 0: 9004.7, 1: 8910.6. Samples: 940403864. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:18:38,785][121949] Avg episode reward: [(0, '6397.374'), (1, '5945.704')] [2023-12-26 14:18:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001842640_471719936.pth... [2023-12-26 14:18:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001830880_468705280.pth... [2023-12-26 14:18:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001841616_471457792.pth [2023-12-26 14:18:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001829856_468443136.pth [2023-12-26 14:18:38,950][123091] Updated weights for policy 0, policy_version 1842646 (0.0008) [2023-12-26 14:18:39,011][123091] Updated weights for policy 0, policy_version 1842656 (0.0010) [2023-12-26 14:18:39,068][123091] Updated weights for policy 0, policy_version 1842666 (0.0009) [2023-12-26 14:18:39,202][123090] Updated weights for policy 1, policy_version 1830883 (0.0009) [2023-12-26 14:18:39,268][123090] Updated weights for policy 1, policy_version 1830893 (0.0008) [2023-12-26 14:18:39,335][123090] Updated weights for policy 1, policy_version 1830903 (0.0011) [2023-12-26 14:18:40,033][123091] Updated weights for policy 0, policy_version 1842676 (0.0009) [2023-12-26 14:18:40,050][123090] Updated weights for policy 1, policy_version 1830913 (0.0009) [2023-12-26 14:18:40,095][123091] Updated weights for policy 0, policy_version 1842686 (0.0009) [2023-12-26 14:18:40,114][123090] Updated weights for policy 1, policy_version 1830923 (0.0007) [2023-12-26 14:18:40,150][123091] Updated weights for policy 0, policy_version 1842696 (0.0008) [2023-12-26 14:18:40,180][123090] Updated weights for policy 1, policy_version 1830933 (0.0009) [2023-12-26 14:18:40,233][123090] Updated weights for policy 1, policy_version 1830943 (0.0009) [2023-12-26 14:18:40,986][123091] Updated weights for policy 0, policy_version 1842706 (0.0009) [2023-12-26 14:18:41,044][123091] Updated weights for policy 0, policy_version 1842716 (0.0008) [2023-12-26 14:18:41,103][123091] Updated weights for policy 0, policy_version 1842726 (0.0008) [2023-12-26 14:18:41,105][123090] Updated weights for policy 1, policy_version 1830953 (0.0009) [2023-12-26 14:18:41,176][123090] Updated weights for policy 1, policy_version 1830963 (0.0008) [2023-12-26 14:18:41,178][123091] Updated weights for policy 0, policy_version 1842736 (0.0008) [2023-12-26 14:18:41,243][123090] Updated weights for policy 1, policy_version 1830973 (0.0009) [2023-12-26 14:18:42,122][123091] Updated weights for policy 0, policy_version 1842746 (0.0010) [2023-12-26 14:18:42,124][123090] Updated weights for policy 1, policy_version 1830983 (0.0008) [2023-12-26 14:18:42,179][123090] Updated weights for policy 1, policy_version 1830993 (0.0007) [2023-12-26 14:18:42,185][123091] Updated weights for policy 0, policy_version 1842756 (0.0010) [2023-12-26 14:18:42,239][123091] Updated weights for policy 0, policy_version 1842766 (0.0009) [2023-12-26 14:18:42,246][123090] Updated weights for policy 1, policy_version 1831003 (0.0007) [2023-12-26 14:18:43,064][123090] Updated weights for policy 1, policy_version 1831013 (0.0009) [2023-12-26 14:18:43,105][123091] Updated weights for policy 0, policy_version 1842776 (0.0009) [2023-12-26 14:18:43,115][123090] Updated weights for policy 1, policy_version 1831023 (0.0010) [2023-12-26 14:18:43,165][123091] Updated weights for policy 0, policy_version 1842786 (0.0005) [2023-12-26 14:18:43,171][123090] Updated weights for policy 1, policy_version 1831033 (0.0010) [2023-12-26 14:18:43,230][123091] Updated weights for policy 0, policy_version 1842796 (0.0007) [2023-12-26 14:18:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 940507136. Throughput: 0: 8869.8, 1: 8767.4. Samples: 940503560. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:18:43,785][121949] Avg episode reward: [(0, '6357.969'), (1, '5995.931')] [2023-12-26 14:18:44,007][123090] Updated weights for policy 1, policy_version 1831043 (0.0010) [2023-12-26 14:18:44,063][123091] Updated weights for policy 0, policy_version 1842807 (0.0008) [2023-12-26 14:18:44,067][123090] Updated weights for policy 1, policy_version 1831053 (0.0010) [2023-12-26 14:18:44,121][123091] Updated weights for policy 0, policy_version 1842817 (0.0007) [2023-12-26 14:18:44,122][123090] Updated weights for policy 1, policy_version 1831063 (0.0010) [2023-12-26 14:18:44,181][123091] Updated weights for policy 0, policy_version 1842827 (0.0006) [2023-12-26 14:18:44,959][123090] Updated weights for policy 1, policy_version 1831073 (0.0011) [2023-12-26 14:18:45,019][123090] Updated weights for policy 1, policy_version 1831083 (0.0011) [2023-12-26 14:18:45,031][123091] Updated weights for policy 0, policy_version 1842837 (0.0009) [2023-12-26 14:18:45,083][123091] Updated weights for policy 0, policy_version 1842847 (0.0008) [2023-12-26 14:18:45,083][123090] Updated weights for policy 1, policy_version 1831093 (0.0011) [2023-12-26 14:18:45,136][123091] Updated weights for policy 0, policy_version 1842857 (0.0010) [2023-12-26 14:18:45,140][123090] Updated weights for policy 1, policy_version 1831103 (0.0011) [2023-12-26 14:18:45,976][123090] Updated weights for policy 1, policy_version 1831113 (0.0010) [2023-12-26 14:18:46,013][123091] Updated weights for policy 0, policy_version 1842867 (0.0008) [2023-12-26 14:18:46,039][123090] Updated weights for policy 1, policy_version 1831123 (0.0010) [2023-12-26 14:18:46,076][123091] Updated weights for policy 0, policy_version 1842877 (0.0006) [2023-12-26 14:18:46,090][123090] Updated weights for policy 1, policy_version 1831133 (0.0010) [2023-12-26 14:18:46,142][123091] Updated weights for policy 0, policy_version 1842887 (0.0007) [2023-12-26 14:18:46,931][123090] Updated weights for policy 1, policy_version 1831143 (0.0011) [2023-12-26 14:18:46,975][123091] Updated weights for policy 0, policy_version 1842897 (0.0009) [2023-12-26 14:18:46,987][123090] Updated weights for policy 1, policy_version 1831153 (0.0011) [2023-12-26 14:18:47,030][123091] Updated weights for policy 0, policy_version 1842907 (0.0008) [2023-12-26 14:18:47,041][123090] Updated weights for policy 1, policy_version 1831163 (0.0011) [2023-12-26 14:18:47,080][123091] Updated weights for policy 0, policy_version 1842917 (0.0006) [2023-12-26 14:18:47,130][123091] Updated weights for policy 0, policy_version 1842927 (0.0009) [2023-12-26 14:18:47,887][123090] Updated weights for policy 1, policy_version 1831173 (0.0011) [2023-12-26 14:18:47,931][123090] Updated weights for policy 1, policy_version 1831183 (0.0010) [2023-12-26 14:18:47,990][123090] Updated weights for policy 1, policy_version 1831193 (0.0010) [2023-12-26 14:18:47,994][123091] Updated weights for policy 0, policy_version 1842937 (0.0007) [2023-12-26 14:18:48,051][123091] Updated weights for policy 0, policy_version 1842947 (0.0009) [2023-12-26 14:18:48,111][123091] Updated weights for policy 0, policy_version 1842957 (0.0008) [2023-12-26 14:18:48,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 940589056. Throughput: 0: 8746.9, 1: 8756.6. Samples: 940605312. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:18:48,785][121949] Avg episode reward: [(0, '6313.841'), (1, '5829.060')] [2023-12-26 14:18:48,837][123090] Updated weights for policy 1, policy_version 1831203 (0.0010) [2023-12-26 14:18:48,893][123090] Updated weights for policy 1, policy_version 1831213 (0.0010) [2023-12-26 14:18:48,948][123090] Updated weights for policy 1, policy_version 1831223 (0.0010) [2023-12-26 14:18:48,960][123091] Updated weights for policy 0, policy_version 1842967 (0.0007) [2023-12-26 14:18:49,014][123091] Updated weights for policy 0, policy_version 1842977 (0.0009) [2023-12-26 14:18:49,068][123091] Updated weights for policy 0, policy_version 1842987 (0.0009) [2023-12-26 14:18:49,794][123090] Updated weights for policy 1, policy_version 1831233 (0.0010) [2023-12-26 14:18:49,863][123090] Updated weights for policy 1, policy_version 1831243 (0.0011) [2023-12-26 14:18:49,924][123090] Updated weights for policy 1, policy_version 1831253 (0.0011) [2023-12-26 14:18:49,956][123091] Updated weights for policy 0, policy_version 1842997 (0.0009) [2023-12-26 14:18:49,985][123090] Updated weights for policy 1, policy_version 1831263 (0.0011) [2023-12-26 14:18:50,020][123091] Updated weights for policy 0, policy_version 1843007 (0.0007) [2023-12-26 14:18:50,070][123091] Updated weights for policy 0, policy_version 1843017 (0.0009) [2023-12-26 14:18:50,835][123090] Updated weights for policy 1, policy_version 1831273 (0.0010) [2023-12-26 14:18:50,902][123090] Updated weights for policy 1, policy_version 1831283 (0.0011) [2023-12-26 14:18:50,926][123091] Updated weights for policy 0, policy_version 1843027 (0.0008) [2023-12-26 14:18:50,965][123090] Updated weights for policy 1, policy_version 1831293 (0.0010) [2023-12-26 14:18:50,986][123091] Updated weights for policy 0, policy_version 1843037 (0.0007) [2023-12-26 14:18:51,051][123091] Updated weights for policy 0, policy_version 1843047 (0.0009) [2023-12-26 14:18:51,814][123090] Updated weights for policy 1, policy_version 1831303 (0.0010) [2023-12-26 14:18:51,882][123090] Updated weights for policy 1, policy_version 1831313 (0.0008) [2023-12-26 14:18:51,915][123091] Updated weights for policy 0, policy_version 1843057 (0.0009) [2023-12-26 14:18:51,948][123090] Updated weights for policy 1, policy_version 1831323 (0.0007) [2023-12-26 14:18:51,981][123091] Updated weights for policy 0, policy_version 1843067 (0.0008) [2023-12-26 14:18:52,050][123091] Updated weights for policy 0, policy_version 1843077 (0.0008) [2023-12-26 14:18:52,110][123091] Updated weights for policy 0, policy_version 1843087 (0.0007) [2023-12-26 14:18:52,828][123090] Updated weights for policy 1, policy_version 1831333 (0.0008) [2023-12-26 14:18:52,857][123091] Updated weights for policy 0, policy_version 1843097 (0.0008) [2023-12-26 14:18:52,895][123090] Updated weights for policy 1, policy_version 1831343 (0.0006) [2023-12-26 14:18:52,921][123091] Updated weights for policy 0, policy_version 1843107 (0.0005) [2023-12-26 14:18:52,955][123090] Updated weights for policy 1, policy_version 1831353 (0.0007) [2023-12-26 14:18:52,993][123091] Updated weights for policy 0, policy_version 1843117 (0.0006) [2023-12-26 14:18:53,649][123090] Updated weights for policy 1, policy_version 1831363 (0.0007) [2023-12-26 14:18:53,709][123090] Updated weights for policy 1, policy_version 1831373 (0.0009) [2023-12-26 14:18:53,750][123091] Updated weights for policy 0, policy_version 1843127 (0.0009) [2023-12-26 14:18:53,769][123090] Updated weights for policy 1, policy_version 1831383 (0.0006) [2023-12-26 14:18:53,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 940670976. Throughput: 0: 8667.8, 1: 8733.9. Samples: 940655412. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:18:53,785][121949] Avg episode reward: [(0, '6265.040'), (1, '5490.745')] [2023-12-26 14:18:53,809][123091] Updated weights for policy 0, policy_version 1843137 (0.0010) [2023-12-26 14:18:53,815][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001831392_468836352.pth... [2023-12-26 14:18:53,818][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001830368_468574208.pth [2023-12-26 14:18:53,860][123091] Updated weights for policy 0, policy_version 1843147 (0.0010) [2023-12-26 14:18:53,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001843152_471851008.pth... [2023-12-26 14:18:53,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001842128_471588864.pth [2023-12-26 14:18:54,471][123090] Updated weights for policy 1, policy_version 1831393 (0.0006) [2023-12-26 14:18:54,534][123090] Updated weights for policy 1, policy_version 1831403 (0.0005) [2023-12-26 14:18:54,609][123090] Updated weights for policy 1, policy_version 1831413 (0.0005) [2023-12-26 14:18:54,669][123091] Updated weights for policy 0, policy_version 1843157 (0.0009) [2023-12-26 14:18:54,676][123090] Updated weights for policy 1, policy_version 1831423 (0.0006) [2023-12-26 14:18:54,724][123091] Updated weights for policy 0, policy_version 1843167 (0.0010) [2023-12-26 14:18:54,772][123091] Updated weights for policy 0, policy_version 1843177 (0.0010) [2023-12-26 14:18:55,270][123090] Updated weights for policy 1, policy_version 1831433 (0.0006) [2023-12-26 14:18:55,331][123090] Updated weights for policy 1, policy_version 1831443 (0.0006) [2023-12-26 14:18:55,396][123090] Updated weights for policy 1, policy_version 1831453 (0.0006) [2023-12-26 14:18:55,556][123091] Updated weights for policy 0, policy_version 1843187 (0.0010) [2023-12-26 14:18:55,618][123091] Updated weights for policy 0, policy_version 1843197 (0.0010) [2023-12-26 14:18:55,665][123091] Updated weights for policy 0, policy_version 1843207 (0.0010) [2023-12-26 14:18:56,070][123090] Updated weights for policy 1, policy_version 1831463 (0.0005) [2023-12-26 14:18:56,127][123090] Updated weights for policy 1, policy_version 1831473 (0.0005) [2023-12-26 14:18:56,175][123090] Updated weights for policy 1, policy_version 1831483 (0.0005) [2023-12-26 14:18:56,448][123091] Updated weights for policy 0, policy_version 1843217 (0.0010) [2023-12-26 14:18:56,522][123091] Updated weights for policy 0, policy_version 1843227 (0.0011) [2023-12-26 14:18:56,587][123091] Updated weights for policy 0, policy_version 1843237 (0.0010) [2023-12-26 14:18:56,656][123091] Updated weights for policy 0, policy_version 1843247 (0.0010) [2023-12-26 14:18:56,865][123090] Updated weights for policy 1, policy_version 1831493 (0.0005) [2023-12-26 14:18:56,910][123090] Updated weights for policy 1, policy_version 1831503 (0.0005) [2023-12-26 14:18:56,955][123090] Updated weights for policy 1, policy_version 1831513 (0.0005) [2023-12-26 14:18:57,372][123091] Updated weights for policy 0, policy_version 1843257 (0.0006) [2023-12-26 14:18:57,433][123091] Updated weights for policy 0, policy_version 1843267 (0.0009) [2023-12-26 14:18:57,495][123091] Updated weights for policy 0, policy_version 1843277 (0.0009) [2023-12-26 14:18:57,674][123090] Updated weights for policy 1, policy_version 1831523 (0.0007) [2023-12-26 14:18:57,720][123090] Updated weights for policy 1, policy_version 1831533 (0.0007) [2023-12-26 14:18:57,765][123090] Updated weights for policy 1, policy_version 1831543 (0.0005) [2023-12-26 14:18:58,211][123091] Updated weights for policy 0, policy_version 1843287 (0.0007) [2023-12-26 14:18:58,282][123091] Updated weights for policy 0, policy_version 1843297 (0.0007) [2023-12-26 14:18:58,353][123091] Updated weights for policy 0, policy_version 1843307 (0.0008) [2023-12-26 14:18:58,613][123090] Updated weights for policy 1, policy_version 1831553 (0.0007) [2023-12-26 14:18:58,686][123090] Updated weights for policy 1, policy_version 1831563 (0.0008) [2023-12-26 14:18:58,765][123090] Updated weights for policy 1, policy_version 1831573 (0.0007) [2023-12-26 14:18:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 940769280. Throughput: 0: 8771.6, 1: 8867.9. Samples: 940768772. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:18:58,785][121949] Avg episode reward: [(0, '6181.346'), (1, '5554.052')] [2023-12-26 14:18:58,838][123090] Updated weights for policy 1, policy_version 1831583 (0.0009) [2023-12-26 14:18:59,224][123091] Updated weights for policy 0, policy_version 1843317 (0.0009) [2023-12-26 14:18:59,290][123091] Updated weights for policy 0, policy_version 1843327 (0.0008) [2023-12-26 14:18:59,358][123091] Updated weights for policy 0, policy_version 1843337 (0.0009) [2023-12-26 14:18:59,745][123090] Updated weights for policy 1, policy_version 1831593 (0.0009) [2023-12-26 14:18:59,808][123090] Updated weights for policy 1, policy_version 1831603 (0.0006) [2023-12-26 14:18:59,880][123090] Updated weights for policy 1, policy_version 1831613 (0.0008) [2023-12-26 14:19:00,189][123091] Updated weights for policy 0, policy_version 1843347 (0.0008) [2023-12-26 14:19:00,261][123091] Updated weights for policy 0, policy_version 1843357 (0.0010) [2023-12-26 14:19:00,333][123091] Updated weights for policy 0, policy_version 1843367 (0.0010) [2023-12-26 14:19:00,550][123090] Updated weights for policy 1, policy_version 1831623 (0.0006) [2023-12-26 14:19:00,615][123090] Updated weights for policy 1, policy_version 1831633 (0.0008) [2023-12-26 14:19:00,679][123090] Updated weights for policy 1, policy_version 1831643 (0.0009) [2023-12-26 14:19:01,126][123091] Updated weights for policy 0, policy_version 1843377 (0.0010) [2023-12-26 14:19:01,192][123091] Updated weights for policy 0, policy_version 1843387 (0.0008) [2023-12-26 14:19:01,255][123091] Updated weights for policy 0, policy_version 1843397 (0.0008) [2023-12-26 14:19:01,320][123091] Updated weights for policy 0, policy_version 1843407 (0.0005) [2023-12-26 14:19:01,463][123090] Updated weights for policy 1, policy_version 1831653 (0.0008) [2023-12-26 14:19:01,524][123090] Updated weights for policy 1, policy_version 1831663 (0.0009) [2023-12-26 14:19:01,591][123090] Updated weights for policy 1, policy_version 1831673 (0.0009) [2023-12-26 14:19:02,057][123091] Updated weights for policy 0, policy_version 1843417 (0.0010) [2023-12-26 14:19:02,112][123091] Updated weights for policy 0, policy_version 1843427 (0.0010) [2023-12-26 14:19:02,167][123091] Updated weights for policy 0, policy_version 1843437 (0.0010) [2023-12-26 14:19:02,439][123090] Updated weights for policy 1, policy_version 1831683 (0.0010) [2023-12-26 14:19:02,516][123090] Updated weights for policy 1, policy_version 1831693 (0.0010) [2023-12-26 14:19:02,588][123090] Updated weights for policy 1, policy_version 1831703 (0.0010) [2023-12-26 14:19:02,895][123091] Updated weights for policy 0, policy_version 1843447 (0.0008) [2023-12-26 14:19:02,944][123091] Updated weights for policy 0, policy_version 1843457 (0.0009) [2023-12-26 14:19:02,994][123091] Updated weights for policy 0, policy_version 1843467 (0.0009) [2023-12-26 14:19:03,453][123090] Updated weights for policy 1, policy_version 1831713 (0.0010) [2023-12-26 14:19:03,523][123090] Updated weights for policy 1, policy_version 1831723 (0.0008) [2023-12-26 14:19:03,573][123090] Updated weights for policy 1, policy_version 1831733 (0.0005) [2023-12-26 14:19:03,618][123090] Updated weights for policy 1, policy_version 1831743 (0.0005) [2023-12-26 14:19:03,743][123091] Updated weights for policy 0, policy_version 1843477 (0.0007) [2023-12-26 14:19:03,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 940859392. Throughput: 0: 8733.6, 1: 8773.3. Samples: 940872908. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:03,785][121949] Avg episode reward: [(0, '6242.569'), (1, '5840.862')] [2023-12-26 14:19:03,788][123091] Updated weights for policy 0, policy_version 1843487 (0.0005) [2023-12-26 14:19:03,841][123091] Updated weights for policy 0, policy_version 1843497 (0.0006) [2023-12-26 14:19:04,355][123090] Updated weights for policy 1, policy_version 1831753 (0.0009) [2023-12-26 14:19:04,417][123090] Updated weights for policy 1, policy_version 1831763 (0.0009) [2023-12-26 14:19:04,474][123090] Updated weights for policy 1, policy_version 1831773 (0.0006) [2023-12-26 14:19:04,611][123091] Updated weights for policy 0, policy_version 1843507 (0.0009) [2023-12-26 14:19:04,666][123091] Updated weights for policy 0, policy_version 1843517 (0.0010) [2023-12-26 14:19:04,720][123091] Updated weights for policy 0, policy_version 1843527 (0.0009) [2023-12-26 14:19:05,220][123090] Updated weights for policy 1, policy_version 1831783 (0.0010) [2023-12-26 14:19:05,283][123090] Updated weights for policy 1, policy_version 1831793 (0.0010) [2023-12-26 14:19:05,344][123090] Updated weights for policy 1, policy_version 1831803 (0.0009) [2023-12-26 14:19:05,564][123091] Updated weights for policy 0, policy_version 1843537 (0.0009) [2023-12-26 14:19:05,629][123091] Updated weights for policy 0, policy_version 1843547 (0.0010) [2023-12-26 14:19:05,692][123091] Updated weights for policy 0, policy_version 1843557 (0.0011) [2023-12-26 14:19:05,747][123091] Updated weights for policy 0, policy_version 1843567 (0.0010) [2023-12-26 14:19:06,100][123090] Updated weights for policy 1, policy_version 1831813 (0.0008) [2023-12-26 14:19:06,183][123090] Updated weights for policy 1, policy_version 1831823 (0.0009) [2023-12-26 14:19:06,242][123090] Updated weights for policy 1, policy_version 1831833 (0.0009) [2023-12-26 14:19:06,588][123091] Updated weights for policy 0, policy_version 1843577 (0.0008) [2023-12-26 14:19:06,660][123091] Updated weights for policy 0, policy_version 1843587 (0.0009) [2023-12-26 14:19:06,724][123091] Updated weights for policy 0, policy_version 1843597 (0.0010) [2023-12-26 14:19:07,056][123090] Updated weights for policy 1, policy_version 1831843 (0.0010) [2023-12-26 14:19:07,121][123090] Updated weights for policy 1, policy_version 1831853 (0.0008) [2023-12-26 14:19:07,184][123090] Updated weights for policy 1, policy_version 1831863 (0.0008) [2023-12-26 14:19:07,419][123091] Updated weights for policy 0, policy_version 1843607 (0.0006) [2023-12-26 14:19:07,482][123091] Updated weights for policy 0, policy_version 1843617 (0.0006) [2023-12-26 14:19:07,541][123091] Updated weights for policy 0, policy_version 1843627 (0.0008) [2023-12-26 14:19:07,854][123090] Updated weights for policy 1, policy_version 1831873 (0.0008) [2023-12-26 14:19:07,926][123090] Updated weights for policy 1, policy_version 1831883 (0.0006) [2023-12-26 14:19:07,985][123090] Updated weights for policy 1, policy_version 1831893 (0.0005) [2023-12-26 14:19:08,038][123090] Updated weights for policy 1, policy_version 1831903 (0.0006) [2023-12-26 14:19:08,211][123091] Updated weights for policy 0, policy_version 1843637 (0.0006) [2023-12-26 14:19:08,278][123091] Updated weights for policy 0, policy_version 1843647 (0.0010) [2023-12-26 14:19:08,335][123091] Updated weights for policy 0, policy_version 1843657 (0.0010) [2023-12-26 14:19:08,775][123090] Updated weights for policy 1, policy_version 1831913 (0.0006) [2023-12-26 14:19:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 940949504. Throughput: 0: 8742.5, 1: 8822.8. Samples: 940926452. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:08,785][121949] Avg episode reward: [(0, '6339.730'), (1, '5935.765')] [2023-12-26 14:19:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001843664_471982080.pth... [2023-12-26 14:19:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001842640_471719936.pth [2023-12-26 14:19:08,843][123090] Updated weights for policy 1, policy_version 1831923 (0.0005) [2023-12-26 14:19:08,914][123090] Updated weights for policy 1, policy_version 1831933 (0.0007) [2023-12-26 14:19:08,932][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001831936_468975616.pth... [2023-12-26 14:19:08,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001830880_468705280.pth [2023-12-26 14:19:08,982][123091] Updated weights for policy 0, policy_version 1843667 (0.0008) [2023-12-26 14:19:09,042][123091] Updated weights for policy 0, policy_version 1843677 (0.0010) [2023-12-26 14:19:09,094][123091] Updated weights for policy 0, policy_version 1843687 (0.0010) [2023-12-26 14:19:09,684][123090] Updated weights for policy 1, policy_version 1831943 (0.0009) [2023-12-26 14:19:09,754][123090] Updated weights for policy 1, policy_version 1831953 (0.0010) [2023-12-26 14:19:09,815][123090] Updated weights for policy 1, policy_version 1831963 (0.0010) [2023-12-26 14:19:09,966][123091] Updated weights for policy 0, policy_version 1843697 (0.0010) [2023-12-26 14:19:10,030][123091] Updated weights for policy 0, policy_version 1843707 (0.0007) [2023-12-26 14:19:10,103][123091] Updated weights for policy 0, policy_version 1843717 (0.0006) [2023-12-26 14:19:10,171][123091] Updated weights for policy 0, policy_version 1843727 (0.0007) [2023-12-26 14:19:10,666][123090] Updated weights for policy 1, policy_version 1831973 (0.0009) [2023-12-26 14:19:10,727][123090] Updated weights for policy 1, policy_version 1831983 (0.0009) [2023-12-26 14:19:10,786][123090] Updated weights for policy 1, policy_version 1831993 (0.0010) [2023-12-26 14:19:10,940][123091] Updated weights for policy 0, policy_version 1843737 (0.0010) [2023-12-26 14:19:11,007][123091] Updated weights for policy 0, policy_version 1843747 (0.0010) [2023-12-26 14:19:11,078][123091] Updated weights for policy 0, policy_version 1843757 (0.0010) [2023-12-26 14:19:11,661][123090] Updated weights for policy 1, policy_version 1832003 (0.0009) [2023-12-26 14:19:11,731][123090] Updated weights for policy 1, policy_version 1832013 (0.0010) [2023-12-26 14:19:11,803][123090] Updated weights for policy 1, policy_version 1832023 (0.0009) [2023-12-26 14:19:11,978][123091] Updated weights for policy 0, policy_version 1843767 (0.0009) [2023-12-26 14:19:12,036][123091] Updated weights for policy 0, policy_version 1843777 (0.0009) [2023-12-26 14:19:12,105][123091] Updated weights for policy 0, policy_version 1843787 (0.0009) [2023-12-26 14:19:12,684][123090] Updated weights for policy 1, policy_version 1832033 (0.0009) [2023-12-26 14:19:12,746][123090] Updated weights for policy 1, policy_version 1832043 (0.0009) [2023-12-26 14:19:12,807][123090] Updated weights for policy 1, policy_version 1832053 (0.0009) [2023-12-26 14:19:12,870][123090] Updated weights for policy 1, policy_version 1832063 (0.0008) [2023-12-26 14:19:12,929][123091] Updated weights for policy 0, policy_version 1843797 (0.0010) [2023-12-26 14:19:12,987][123091] Updated weights for policy 0, policy_version 1843807 (0.0009) [2023-12-26 14:19:13,046][123091] Updated weights for policy 0, policy_version 1843817 (0.0010) [2023-12-26 14:19:13,690][123090] Updated weights for policy 1, policy_version 1832073 (0.0009) [2023-12-26 14:19:13,754][123090] Updated weights for policy 1, policy_version 1832083 (0.0009) [2023-12-26 14:19:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 941031424. Throughput: 0: 8715.0, 1: 8842.2. Samples: 941032844. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:13,785][121949] Avg episode reward: [(0, '6313.778'), (1, '5830.822')] [2023-12-26 14:19:13,820][123091] Updated weights for policy 0, policy_version 1843827 (0.0010) [2023-12-26 14:19:13,820][123090] Updated weights for policy 1, policy_version 1832093 (0.0009) [2023-12-26 14:19:13,878][123091] Updated weights for policy 0, policy_version 1843837 (0.0010) [2023-12-26 14:19:13,950][123091] Updated weights for policy 0, policy_version 1843847 (0.0010) [2023-12-26 14:19:14,627][123090] Updated weights for policy 1, policy_version 1832103 (0.0008) [2023-12-26 14:19:14,700][123090] Updated weights for policy 1, policy_version 1832113 (0.0009) [2023-12-26 14:19:14,758][123090] Updated weights for policy 1, policy_version 1832123 (0.0009) [2023-12-26 14:19:14,773][123091] Updated weights for policy 0, policy_version 1843857 (0.0010) [2023-12-26 14:19:14,831][123091] Updated weights for policy 0, policy_version 1843867 (0.0009) [2023-12-26 14:19:14,881][123091] Updated weights for policy 0, policy_version 1843877 (0.0009) [2023-12-26 14:19:14,936][123091] Updated weights for policy 0, policy_version 1843887 (0.0009) [2023-12-26 14:19:15,538][123090] Updated weights for policy 1, policy_version 1832133 (0.0009) [2023-12-26 14:19:15,609][123090] Updated weights for policy 1, policy_version 1832143 (0.0007) [2023-12-26 14:19:15,676][123090] Updated weights for policy 1, policy_version 1832153 (0.0006) [2023-12-26 14:19:15,846][123091] Updated weights for policy 0, policy_version 1843897 (0.0006) [2023-12-26 14:19:15,908][123091] Updated weights for policy 0, policy_version 1843907 (0.0006) [2023-12-26 14:19:15,975][123091] Updated weights for policy 0, policy_version 1843917 (0.0010) [2023-12-26 14:19:16,489][123090] Updated weights for policy 1, policy_version 1832163 (0.0009) [2023-12-26 14:19:16,545][123090] Updated weights for policy 1, policy_version 1832173 (0.0009) [2023-12-26 14:19:16,593][123090] Updated weights for policy 1, policy_version 1832183 (0.0008) [2023-12-26 14:19:16,743][123091] Updated weights for policy 0, policy_version 1843927 (0.0009) [2023-12-26 14:19:16,790][123091] Updated weights for policy 0, policy_version 1843937 (0.0009) [2023-12-26 14:19:16,845][123091] Updated weights for policy 0, policy_version 1843948 (0.0011) [2023-12-26 14:19:17,289][123090] Updated weights for policy 1, policy_version 1832194 (0.0009) [2023-12-26 14:19:17,350][123090] Updated weights for policy 1, policy_version 1832204 (0.0005) [2023-12-26 14:19:17,411][123090] Updated weights for policy 1, policy_version 1832214 (0.0005) [2023-12-26 14:19:17,482][123090] Updated weights for policy 1, policy_version 1832224 (0.0005) [2023-12-26 14:19:17,691][123091] Updated weights for policy 0, policy_version 1843959 (0.0008) [2023-12-26 14:19:17,750][123091] Updated weights for policy 0, policy_version 1843969 (0.0010) [2023-12-26 14:19:17,802][123091] Updated weights for policy 0, policy_version 1843979 (0.0011) [2023-12-26 14:19:18,187][123090] Updated weights for policy 1, policy_version 1832234 (0.0008) [2023-12-26 14:19:18,241][123090] Updated weights for policy 1, policy_version 1832244 (0.0009) [2023-12-26 14:19:18,305][123090] Updated weights for policy 1, policy_version 1832254 (0.0006) [2023-12-26 14:19:18,612][123091] Updated weights for policy 0, policy_version 1843989 (0.0011) [2023-12-26 14:19:18,687][123091] Updated weights for policy 0, policy_version 1843999 (0.0010) [2023-12-26 14:19:18,765][123091] Updated weights for policy 0, policy_version 1844009 (0.0010) [2023-12-26 14:19:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 941121536. Throughput: 0: 8657.2, 1: 8834.0. Samples: 941138632. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:18,785][121949] Avg episode reward: [(0, '6361.185'), (1, '5945.598')] [2023-12-26 14:19:19,057][123090] Updated weights for policy 1, policy_version 1832264 (0.0005) [2023-12-26 14:19:19,132][123090] Updated weights for policy 1, policy_version 1832274 (0.0005) [2023-12-26 14:19:19,208][123090] Updated weights for policy 1, policy_version 1832284 (0.0005) [2023-12-26 14:19:19,587][123091] Updated weights for policy 0, policy_version 1844019 (0.0008) [2023-12-26 14:19:19,659][123091] Updated weights for policy 0, policy_version 1844029 (0.0006) [2023-12-26 14:19:19,732][123091] Updated weights for policy 0, policy_version 1844039 (0.0006) [2023-12-26 14:19:19,929][123090] Updated weights for policy 1, policy_version 1832294 (0.0009) [2023-12-26 14:19:19,985][123090] Updated weights for policy 1, policy_version 1832304 (0.0009) [2023-12-26 14:19:20,044][123090] Updated weights for policy 1, policy_version 1832314 (0.0008) [2023-12-26 14:19:20,453][123091] Updated weights for policy 0, policy_version 1844049 (0.0006) [2023-12-26 14:19:20,515][123091] Updated weights for policy 0, policy_version 1844059 (0.0008) [2023-12-26 14:19:20,576][123091] Updated weights for policy 0, policy_version 1844069 (0.0008) [2023-12-26 14:19:20,644][123091] Updated weights for policy 0, policy_version 1844079 (0.0008) [2023-12-26 14:19:20,946][123090] Updated weights for policy 1, policy_version 1832324 (0.0009) [2023-12-26 14:19:20,996][123090] Updated weights for policy 1, policy_version 1832334 (0.0009) [2023-12-26 14:19:21,065][123090] Updated weights for policy 1, policy_version 1832344 (0.0008) [2023-12-26 14:19:21,443][123091] Updated weights for policy 0, policy_version 1844089 (0.0009) [2023-12-26 14:19:21,516][123091] Updated weights for policy 0, policy_version 1844099 (0.0010) [2023-12-26 14:19:21,578][123091] Updated weights for policy 0, policy_version 1844109 (0.0010) [2023-12-26 14:19:21,931][123090] Updated weights for policy 1, policy_version 1832354 (0.0009) [2023-12-26 14:19:21,979][123090] Updated weights for policy 1, policy_version 1832364 (0.0008) [2023-12-26 14:19:22,049][123090] Updated weights for policy 1, policy_version 1832374 (0.0005) [2023-12-26 14:19:22,126][123090] Updated weights for policy 1, policy_version 1832384 (0.0005) [2023-12-26 14:19:22,389][123091] Updated weights for policy 0, policy_version 1844119 (0.0008) [2023-12-26 14:19:22,453][123091] Updated weights for policy 0, policy_version 1844129 (0.0010) [2023-12-26 14:19:22,521][123091] Updated weights for policy 0, policy_version 1844139 (0.0009) [2023-12-26 14:19:22,828][123090] Updated weights for policy 1, policy_version 1832394 (0.0011) [2023-12-26 14:19:22,892][123090] Updated weights for policy 1, policy_version 1832404 (0.0011) [2023-12-26 14:19:22,961][123090] Updated weights for policy 1, policy_version 1832414 (0.0011) [2023-12-26 14:19:23,379][123091] Updated weights for policy 0, policy_version 1844149 (0.0009) [2023-12-26 14:19:23,453][123091] Updated weights for policy 0, policy_version 1844159 (0.0009) [2023-12-26 14:19:23,520][123091] Updated weights for policy 0, policy_version 1844169 (0.0009) [2023-12-26 14:19:23,714][123090] Updated weights for policy 1, policy_version 1832424 (0.0006) [2023-12-26 14:19:23,775][123090] Updated weights for policy 1, policy_version 1832434 (0.0005) [2023-12-26 14:19:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 941211648. Throughput: 0: 8684.3, 1: 8782.8. Samples: 941189884. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:23,785][121949] Avg episode reward: [(0, '6378.451'), (1, '5987.106')] [2023-12-26 14:19:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001844176_472113152.pth... [2023-12-26 14:19:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001843152_471851008.pth [2023-12-26 14:19:23,850][123090] Updated weights for policy 1, policy_version 1832444 (0.0005) [2023-12-26 14:19:23,877][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001832448_469106688.pth... [2023-12-26 14:19:23,881][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001831392_468836352.pth [2023-12-26 14:19:24,370][123091] Updated weights for policy 0, policy_version 1844179 (0.0009) [2023-12-26 14:19:24,429][123091] Updated weights for policy 0, policy_version 1844189 (0.0009) [2023-12-26 14:19:24,481][123091] Updated weights for policy 0, policy_version 1844200 (0.0010) [2023-12-26 14:19:24,561][123090] Updated weights for policy 1, policy_version 1832454 (0.0008) [2023-12-26 14:19:24,618][123090] Updated weights for policy 1, policy_version 1832464 (0.0009) [2023-12-26 14:19:24,675][123090] Updated weights for policy 1, policy_version 1832474 (0.0009) [2023-12-26 14:19:25,281][123091] Updated weights for policy 0, policy_version 1844210 (0.0008) [2023-12-26 14:19:25,364][123091] Updated weights for policy 0, policy_version 1844220 (0.0007) [2023-12-26 14:19:25,427][123090] Updated weights for policy 1, policy_version 1832484 (0.0008) [2023-12-26 14:19:25,437][123091] Updated weights for policy 0, policy_version 1844230 (0.0011) [2023-12-26 14:19:25,491][123090] Updated weights for policy 1, policy_version 1832494 (0.0005) [2023-12-26 14:19:25,493][123091] Updated weights for policy 0, policy_version 1844240 (0.0010) [2023-12-26 14:19:25,550][123090] Updated weights for policy 1, policy_version 1832504 (0.0005) [2023-12-26 14:19:26,271][123090] Updated weights for policy 1, policy_version 1832514 (0.0005) [2023-12-26 14:19:26,271][123091] Updated weights for policy 0, policy_version 1844250 (0.0011) [2023-12-26 14:19:26,331][123091] Updated weights for policy 0, policy_version 1844260 (0.0011) [2023-12-26 14:19:26,336][123090] Updated weights for policy 1, policy_version 1832524 (0.0005) [2023-12-26 14:19:26,395][123091] Updated weights for policy 0, policy_version 1844270 (0.0011) [2023-12-26 14:19:26,398][123090] Updated weights for policy 1, policy_version 1832534 (0.0005) [2023-12-26 14:19:26,460][123090] Updated weights for policy 1, policy_version 1832544 (0.0009) [2023-12-26 14:19:27,176][123090] Updated weights for policy 1, policy_version 1832554 (0.0009) [2023-12-26 14:19:27,178][123091] Updated weights for policy 0, policy_version 1844280 (0.0008) [2023-12-26 14:19:27,243][123091] Updated weights for policy 0, policy_version 1844290 (0.0008) [2023-12-26 14:19:27,243][123090] Updated weights for policy 1, policy_version 1832564 (0.0008) [2023-12-26 14:19:27,300][123090] Updated weights for policy 1, policy_version 1832574 (0.0009) [2023-12-26 14:19:27,302][123091] Updated weights for policy 0, policy_version 1844300 (0.0005) [2023-12-26 14:19:27,997][123090] Updated weights for policy 1, policy_version 1832584 (0.0006) [2023-12-26 14:19:28,053][123090] Updated weights for policy 1, policy_version 1832594 (0.0005) [2023-12-26 14:19:28,082][123091] Updated weights for policy 0, policy_version 1844310 (0.0009) [2023-12-26 14:19:28,118][123090] Updated weights for policy 1, policy_version 1832604 (0.0007) [2023-12-26 14:19:28,138][123091] Updated weights for policy 0, policy_version 1844320 (0.0010) [2023-12-26 14:19:28,191][123091] Updated weights for policy 0, policy_version 1844330 (0.0010) [2023-12-26 14:19:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 941301760. Throughput: 0: 8734.9, 1: 8926.5. Samples: 941298324. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:28,785][121949] Avg episode reward: [(0, '6311.573'), (1, '5900.960')] [2023-12-26 14:19:28,848][123090] Updated weights for policy 1, policy_version 1832614 (0.0008) [2023-12-26 14:19:28,915][123090] Updated weights for policy 1, policy_version 1832624 (0.0006) [2023-12-26 14:19:28,937][123091] Updated weights for policy 0, policy_version 1844340 (0.0008) [2023-12-26 14:19:28,969][123090] Updated weights for policy 1, policy_version 1832634 (0.0007) [2023-12-26 14:19:28,992][123091] Updated weights for policy 0, policy_version 1844350 (0.0005) [2023-12-26 14:19:29,050][123091] Updated weights for policy 0, policy_version 1844360 (0.0005) [2023-12-26 14:19:29,649][123090] Updated weights for policy 1, policy_version 1832644 (0.0008) [2023-12-26 14:19:29,710][123090] Updated weights for policy 1, policy_version 1832654 (0.0009) [2023-12-26 14:19:29,751][123091] Updated weights for policy 0, policy_version 1844370 (0.0006) [2023-12-26 14:19:29,761][123090] Updated weights for policy 1, policy_version 1832664 (0.0009) [2023-12-26 14:19:29,810][123091] Updated weights for policy 0, policy_version 1844380 (0.0010) [2023-12-26 14:19:29,873][123091] Updated weights for policy 0, policy_version 1844390 (0.0011) [2023-12-26 14:19:29,936][123091] Updated weights for policy 0, policy_version 1844400 (0.0011) [2023-12-26 14:19:30,538][123090] Updated weights for policy 1, policy_version 1832674 (0.0007) [2023-12-26 14:19:30,617][123090] Updated weights for policy 1, policy_version 1832684 (0.0006) [2023-12-26 14:19:30,695][123090] Updated weights for policy 1, policy_version 1832694 (0.0010) [2023-12-26 14:19:30,733][123091] Updated weights for policy 0, policy_version 1844410 (0.0007) [2023-12-26 14:19:30,760][123090] Updated weights for policy 1, policy_version 1832704 (0.0006) [2023-12-26 14:19:30,786][123091] Updated weights for policy 0, policy_version 1844420 (0.0010) [2023-12-26 14:19:30,846][123091] Updated weights for policy 0, policy_version 1844430 (0.0009) [2023-12-26 14:19:31,422][123090] Updated weights for policy 1, policy_version 1832714 (0.0008) [2023-12-26 14:19:31,493][123090] Updated weights for policy 1, policy_version 1832724 (0.0005) [2023-12-26 14:19:31,574][123090] Updated weights for policy 1, policy_version 1832734 (0.0005) [2023-12-26 14:19:31,691][123091] Updated weights for policy 0, policy_version 1844440 (0.0009) [2023-12-26 14:19:31,756][123091] Updated weights for policy 0, policy_version 1844450 (0.0010) [2023-12-26 14:19:31,824][123091] Updated weights for policy 0, policy_version 1844460 (0.0009) [2023-12-26 14:19:32,349][123090] Updated weights for policy 1, policy_version 1832744 (0.0010) [2023-12-26 14:19:32,419][123090] Updated weights for policy 1, policy_version 1832754 (0.0011) [2023-12-26 14:19:32,471][123090] Updated weights for policy 1, policy_version 1832764 (0.0010) [2023-12-26 14:19:32,661][123091] Updated weights for policy 0, policy_version 1844470 (0.0009) [2023-12-26 14:19:32,721][123091] Updated weights for policy 0, policy_version 1844480 (0.0009) [2023-12-26 14:19:32,785][123091] Updated weights for policy 0, policy_version 1844490 (0.0008) [2023-12-26 14:19:33,234][123090] Updated weights for policy 1, policy_version 1832774 (0.0007) [2023-12-26 14:19:33,304][123090] Updated weights for policy 1, policy_version 1832784 (0.0005) [2023-12-26 14:19:33,373][123090] Updated weights for policy 1, policy_version 1832794 (0.0005) [2023-12-26 14:19:33,523][123091] Updated weights for policy 0, policy_version 1844500 (0.0008) [2023-12-26 14:19:33,569][123091] Updated weights for policy 0, policy_version 1844510 (0.0005) [2023-12-26 14:19:33,615][123091] Updated weights for policy 0, policy_version 1844520 (0.0005) [2023-12-26 14:19:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 941400064. Throughput: 0: 8815.9, 1: 9068.6. Samples: 941410116. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:33,785][121949] Avg episode reward: [(0, '6245.935'), (1, '5760.736')] [2023-12-26 14:19:34,059][123090] Updated weights for policy 1, policy_version 1832804 (0.0007) [2023-12-26 14:19:34,121][123090] Updated weights for policy 1, policy_version 1832814 (0.0010) [2023-12-26 14:19:34,185][123090] Updated weights for policy 1, policy_version 1832824 (0.0008) [2023-12-26 14:19:34,235][123091] Updated weights for policy 0, policy_version 1844530 (0.0006) [2023-12-26 14:19:34,306][123091] Updated weights for policy 0, policy_version 1844540 (0.0010) [2023-12-26 14:19:34,368][123091] Updated weights for policy 0, policy_version 1844550 (0.0009) [2023-12-26 14:19:34,431][123091] Updated weights for policy 0, policy_version 1844560 (0.0009) [2023-12-26 14:19:35,003][123090] Updated weights for policy 1, policy_version 1832834 (0.0008) [2023-12-26 14:19:35,064][123090] Updated weights for policy 1, policy_version 1832844 (0.0010) [2023-12-26 14:19:35,130][123090] Updated weights for policy 1, policy_version 1832854 (0.0009) [2023-12-26 14:19:35,197][123090] Updated weights for policy 1, policy_version 1832864 (0.0009) [2023-12-26 14:19:35,246][123091] Updated weights for policy 0, policy_version 1844570 (0.0005) [2023-12-26 14:19:35,304][123091] Updated weights for policy 0, policy_version 1844580 (0.0008) [2023-12-26 14:19:35,361][123091] Updated weights for policy 0, policy_version 1844590 (0.0010) [2023-12-26 14:19:35,891][123090] Updated weights for policy 1, policy_version 1832874 (0.0005) [2023-12-26 14:19:35,951][123090] Updated weights for policy 1, policy_version 1832884 (0.0005) [2023-12-26 14:19:35,997][123090] Updated weights for policy 1, policy_version 1832894 (0.0005) [2023-12-26 14:19:36,275][123091] Updated weights for policy 0, policy_version 1844600 (0.0008) [2023-12-26 14:19:36,335][123091] Updated weights for policy 0, policy_version 1844610 (0.0009) [2023-12-26 14:19:36,392][123091] Updated weights for policy 0, policy_version 1844620 (0.0009) [2023-12-26 14:19:36,746][123090] Updated weights for policy 1, policy_version 1832904 (0.0009) [2023-12-26 14:19:36,813][123090] Updated weights for policy 1, policy_version 1832914 (0.0010) [2023-12-26 14:19:36,877][123090] Updated weights for policy 1, policy_version 1832924 (0.0011) [2023-12-26 14:19:37,239][123091] Updated weights for policy 0, policy_version 1844630 (0.0008) [2023-12-26 14:19:37,295][123091] Updated weights for policy 0, policy_version 1844640 (0.0009) [2023-12-26 14:19:37,359][123091] Updated weights for policy 0, policy_version 1844650 (0.0009) [2023-12-26 14:19:37,698][123090] Updated weights for policy 1, policy_version 1832934 (0.0011) [2023-12-26 14:19:37,765][123090] Updated weights for policy 1, policy_version 1832944 (0.0010) [2023-12-26 14:19:37,837][123090] Updated weights for policy 1, policy_version 1832954 (0.0011) [2023-12-26 14:19:38,242][123091] Updated weights for policy 0, policy_version 1844660 (0.0009) [2023-12-26 14:19:38,303][123091] Updated weights for policy 0, policy_version 1844670 (0.0009) [2023-12-26 14:19:38,374][123091] Updated weights for policy 0, policy_version 1844680 (0.0009) [2023-12-26 14:19:38,602][123090] Updated weights for policy 1, policy_version 1832964 (0.0010) [2023-12-26 14:19:38,668][123090] Updated weights for policy 1, policy_version 1832974 (0.0010) [2023-12-26 14:19:38,736][123090] Updated weights for policy 1, policy_version 1832984 (0.0007) [2023-12-26 14:19:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 941481984. Throughput: 0: 8838.8, 1: 9124.6. Samples: 941463764. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:38,785][121949] Avg episode reward: [(0, '6322.514'), (1, '5712.226')] [2023-12-26 14:19:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001844688_472244224.pth... [2023-12-26 14:19:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001843664_471982080.pth [2023-12-26 14:19:38,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001832992_469245952.pth... [2023-12-26 14:19:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001831936_468975616.pth [2023-12-26 14:19:39,231][123091] Updated weights for policy 0, policy_version 1844690 (0.0009) [2023-12-26 14:19:39,286][123091] Updated weights for policy 0, policy_version 1844700 (0.0010) [2023-12-26 14:19:39,347][123091] Updated weights for policy 0, policy_version 1844710 (0.0010) [2023-12-26 14:19:39,420][123091] Updated weights for policy 0, policy_version 1844720 (0.0009) [2023-12-26 14:19:39,495][123090] Updated weights for policy 1, policy_version 1832994 (0.0006) [2023-12-26 14:19:39,556][123090] Updated weights for policy 1, policy_version 1833004 (0.0006) [2023-12-26 14:19:39,613][123090] Updated weights for policy 1, policy_version 1833015 (0.0007) [2023-12-26 14:19:40,285][123091] Updated weights for policy 0, policy_version 1844730 (0.0009) [2023-12-26 14:19:40,350][123091] Updated weights for policy 0, policy_version 1844740 (0.0008) [2023-12-26 14:19:40,414][123091] Updated weights for policy 0, policy_version 1844750 (0.0010) [2023-12-26 14:19:40,454][123090] Updated weights for policy 1, policy_version 1833025 (0.0009) [2023-12-26 14:19:40,520][123090] Updated weights for policy 1, policy_version 1833035 (0.0009) [2023-12-26 14:19:40,586][123090] Updated weights for policy 1, policy_version 1833045 (0.0009) [2023-12-26 14:19:40,650][123090] Updated weights for policy 1, policy_version 1833055 (0.0009) [2023-12-26 14:19:41,283][123091] Updated weights for policy 0, policy_version 1844760 (0.0009) [2023-12-26 14:19:41,353][123091] Updated weights for policy 0, policy_version 1844770 (0.0007) [2023-12-26 14:19:41,425][123091] Updated weights for policy 0, policy_version 1844780 (0.0010) [2023-12-26 14:19:41,472][123090] Updated weights for policy 1, policy_version 1833065 (0.0009) [2023-12-26 14:19:41,536][123090] Updated weights for policy 1, policy_version 1833075 (0.0010) [2023-12-26 14:19:41,604][123090] Updated weights for policy 1, policy_version 1833085 (0.0010) [2023-12-26 14:19:42,163][123091] Updated weights for policy 0, policy_version 1844790 (0.0009) [2023-12-26 14:19:42,230][123091] Updated weights for policy 0, policy_version 1844800 (0.0009) [2023-12-26 14:19:42,302][123091] Updated weights for policy 0, policy_version 1844810 (0.0009) [2023-12-26 14:19:42,472][123090] Updated weights for policy 1, policy_version 1833095 (0.0010) [2023-12-26 14:19:42,532][123090] Updated weights for policy 1, policy_version 1833105 (0.0011) [2023-12-26 14:19:42,597][123090] Updated weights for policy 1, policy_version 1833115 (0.0011) [2023-12-26 14:19:43,133][123091] Updated weights for policy 0, policy_version 1844820 (0.0009) [2023-12-26 14:19:43,196][123091] Updated weights for policy 0, policy_version 1844830 (0.0009) [2023-12-26 14:19:43,259][123091] Updated weights for policy 0, policy_version 1844840 (0.0009) [2023-12-26 14:19:43,410][123090] Updated weights for policy 1, policy_version 1833125 (0.0008) [2023-12-26 14:19:43,465][123090] Updated weights for policy 1, policy_version 1833135 (0.0005) [2023-12-26 14:19:43,515][123090] Updated weights for policy 1, policy_version 1833145 (0.0005) [2023-12-26 14:19:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 941572096. Throughput: 0: 8733.9, 1: 8963.7. Samples: 941565168. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:43,785][121949] Avg episode reward: [(0, '6284.503'), (1, '5731.604')] [2023-12-26 14:19:44,035][123091] Updated weights for policy 0, policy_version 1844850 (0.0008) [2023-12-26 14:19:44,098][123091] Updated weights for policy 0, policy_version 1844860 (0.0005) [2023-12-26 14:19:44,159][123091] Updated weights for policy 0, policy_version 1844870 (0.0005) [2023-12-26 14:19:44,217][123091] Updated weights for policy 0, policy_version 1844880 (0.0005) [2023-12-26 14:19:44,245][123090] Updated weights for policy 1, policy_version 1833155 (0.0008) [2023-12-26 14:19:44,302][123090] Updated weights for policy 1, policy_version 1833165 (0.0005) [2023-12-26 14:19:44,351][123090] Updated weights for policy 1, policy_version 1833175 (0.0005) [2023-12-26 14:19:44,836][123091] Updated weights for policy 0, policy_version 1844890 (0.0007) [2023-12-26 14:19:44,907][123091] Updated weights for policy 0, policy_version 1844900 (0.0005) [2023-12-26 14:19:44,977][123091] Updated weights for policy 0, policy_version 1844910 (0.0008) [2023-12-26 14:19:45,085][123090] Updated weights for policy 1, policy_version 1833185 (0.0005) [2023-12-26 14:19:45,152][123090] Updated weights for policy 1, policy_version 1833195 (0.0007) [2023-12-26 14:19:45,214][123090] Updated weights for policy 1, policy_version 1833205 (0.0007) [2023-12-26 14:19:45,279][123090] Updated weights for policy 1, policy_version 1833215 (0.0008) [2023-12-26 14:19:45,794][123091] Updated weights for policy 0, policy_version 1844920 (0.0010) [2023-12-26 14:19:45,847][123091] Updated weights for policy 0, policy_version 1844930 (0.0009) [2023-12-26 14:19:45,895][123091] Updated weights for policy 0, policy_version 1844940 (0.0009) [2023-12-26 14:19:45,967][123090] Updated weights for policy 1, policy_version 1833225 (0.0010) [2023-12-26 14:19:46,026][123090] Updated weights for policy 1, policy_version 1833235 (0.0010) [2023-12-26 14:19:46,081][123090] Updated weights for policy 1, policy_version 1833245 (0.0009) [2023-12-26 14:19:46,750][123091] Updated weights for policy 0, policy_version 1844950 (0.0009) [2023-12-26 14:19:46,819][123091] Updated weights for policy 0, policy_version 1844960 (0.0008) [2023-12-26 14:19:46,883][123091] Updated weights for policy 0, policy_version 1844970 (0.0009) [2023-12-26 14:19:46,885][123090] Updated weights for policy 1, policy_version 1833255 (0.0007) [2023-12-26 14:19:46,950][123090] Updated weights for policy 1, policy_version 1833265 (0.0010) [2023-12-26 14:19:47,005][123090] Updated weights for policy 1, policy_version 1833275 (0.0007) [2023-12-26 14:19:47,622][123091] Updated weights for policy 0, policy_version 1844980 (0.0006) [2023-12-26 14:19:47,673][123091] Updated weights for policy 0, policy_version 1844990 (0.0009) [2023-12-26 14:19:47,732][123091] Updated weights for policy 0, policy_version 1845000 (0.0009) [2023-12-26 14:19:47,848][123090] Updated weights for policy 1, policy_version 1833285 (0.0008) [2023-12-26 14:19:47,907][123090] Updated weights for policy 1, policy_version 1833295 (0.0010) [2023-12-26 14:19:47,975][123090] Updated weights for policy 1, policy_version 1833305 (0.0010) [2023-12-26 14:19:48,538][123091] Updated weights for policy 0, policy_version 1845010 (0.0009) [2023-12-26 14:19:48,599][123091] Updated weights for policy 0, policy_version 1845020 (0.0009) [2023-12-26 14:19:48,660][123091] Updated weights for policy 0, policy_version 1845031 (0.0009) [2023-12-26 14:19:48,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17689.2). Total num frames: 941662208. Throughput: 0: 8775.2, 1: 9037.3. Samples: 941674476. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:48,785][121949] Avg episode reward: [(0, '6234.315'), (1, '5720.031')] [2023-12-26 14:19:48,831][123090] Updated weights for policy 1, policy_version 1833315 (0.0010) [2023-12-26 14:19:48,882][123090] Updated weights for policy 1, policy_version 1833325 (0.0010) [2023-12-26 14:19:48,934][123090] Updated weights for policy 1, policy_version 1833335 (0.0009) [2023-12-26 14:19:49,490][123091] Updated weights for policy 0, policy_version 1845041 (0.0009) [2023-12-26 14:19:49,552][123091] Updated weights for policy 0, policy_version 1845051 (0.0008) [2023-12-26 14:19:49,617][123091] Updated weights for policy 0, policy_version 1845061 (0.0008) [2023-12-26 14:19:49,679][123091] Updated weights for policy 0, policy_version 1845071 (0.0008) [2023-12-26 14:19:49,797][123090] Updated weights for policy 1, policy_version 1833345 (0.0009) [2023-12-26 14:19:49,860][123090] Updated weights for policy 1, policy_version 1833355 (0.0009) [2023-12-26 14:19:49,921][123090] Updated weights for policy 1, policy_version 1833365 (0.0010) [2023-12-26 14:19:49,983][123090] Updated weights for policy 1, policy_version 1833375 (0.0009) [2023-12-26 14:19:50,504][123091] Updated weights for policy 0, policy_version 1845081 (0.0010) [2023-12-26 14:19:50,558][123091] Updated weights for policy 0, policy_version 1845091 (0.0009) [2023-12-26 14:19:50,623][123091] Updated weights for policy 0, policy_version 1845101 (0.0009) [2023-12-26 14:19:50,858][123090] Updated weights for policy 1, policy_version 1833385 (0.0010) [2023-12-26 14:19:50,922][123090] Updated weights for policy 1, policy_version 1833395 (0.0010) [2023-12-26 14:19:50,992][123090] Updated weights for policy 1, policy_version 1833406 (0.0009) [2023-12-26 14:19:51,452][123091] Updated weights for policy 0, policy_version 1845111 (0.0010) [2023-12-26 14:19:51,510][123091] Updated weights for policy 0, policy_version 1845121 (0.0007) [2023-12-26 14:19:51,572][123091] Updated weights for policy 0, policy_version 1845131 (0.0005) [2023-12-26 14:19:51,853][123090] Updated weights for policy 1, policy_version 1833416 (0.0009) [2023-12-26 14:19:51,918][123090] Updated weights for policy 1, policy_version 1833426 (0.0010) [2023-12-26 14:19:51,979][123090] Updated weights for policy 1, policy_version 1833436 (0.0009) [2023-12-26 14:19:52,381][123091] Updated weights for policy 0, policy_version 1845141 (0.0008) [2023-12-26 14:19:52,449][123091] Updated weights for policy 0, policy_version 1845151 (0.0009) [2023-12-26 14:19:52,515][123091] Updated weights for policy 0, policy_version 1845161 (0.0008) [2023-12-26 14:19:52,850][123090] Updated weights for policy 1, policy_version 1833446 (0.0010) [2023-12-26 14:19:52,916][123090] Updated weights for policy 1, policy_version 1833456 (0.0009) [2023-12-26 14:19:52,965][123090] Updated weights for policy 1, policy_version 1833466 (0.0009) [2023-12-26 14:19:53,199][123091] Updated weights for policy 0, policy_version 1845171 (0.0007) [2023-12-26 14:19:53,263][123091] Updated weights for policy 0, policy_version 1845181 (0.0011) [2023-12-26 14:19:53,327][123091] Updated weights for policy 0, policy_version 1845191 (0.0011) [2023-12-26 14:19:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 941744128. Throughput: 0: 8767.1, 1: 8970.5. Samples: 941724644. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:53,785][121949] Avg episode reward: [(0, '6191.841'), (1, '5806.659')] [2023-12-26 14:19:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001845200_472375296.pth... [2023-12-26 14:19:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001844176_472113152.pth [2023-12-26 14:19:53,808][123090] Updated weights for policy 1, policy_version 1833476 (0.0009) [2023-12-26 14:19:53,873][123090] Updated weights for policy 1, policy_version 1833486 (0.0009) [2023-12-26 14:19:53,934][123090] Updated weights for policy 1, policy_version 1833496 (0.0009) [2023-12-26 14:19:53,975][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001833504_469377024.pth... [2023-12-26 14:19:53,978][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001832448_469106688.pth [2023-12-26 14:19:54,156][123091] Updated weights for policy 0, policy_version 1845201 (0.0011) [2023-12-26 14:19:54,218][123091] Updated weights for policy 0, policy_version 1845211 (0.0009) [2023-12-26 14:19:54,289][123091] Updated weights for policy 0, policy_version 1845221 (0.0006) [2023-12-26 14:19:54,354][123091] Updated weights for policy 0, policy_version 1845231 (0.0006) [2023-12-26 14:19:54,826][123090] Updated weights for policy 1, policy_version 1833506 (0.0009) [2023-12-26 14:19:54,884][123090] Updated weights for policy 1, policy_version 1833516 (0.0010) [2023-12-26 14:19:54,942][123090] Updated weights for policy 1, policy_version 1833526 (0.0009) [2023-12-26 14:19:54,986][123091] Updated weights for policy 0, policy_version 1845241 (0.0006) [2023-12-26 14:19:54,998][123090] Updated weights for policy 1, policy_version 1833536 (0.0008) [2023-12-26 14:19:55,049][123091] Updated weights for policy 0, policy_version 1845251 (0.0006) [2023-12-26 14:19:55,113][123091] Updated weights for policy 0, policy_version 1845261 (0.0005) [2023-12-26 14:19:55,709][123090] Updated weights for policy 1, policy_version 1833546 (0.0005) [2023-12-26 14:19:55,738][123091] Updated weights for policy 0, policy_version 1845271 (0.0005) [2023-12-26 14:19:55,757][123090] Updated weights for policy 1, policy_version 1833556 (0.0005) [2023-12-26 14:19:55,793][123091] Updated weights for policy 0, policy_version 1845281 (0.0005) [2023-12-26 14:19:55,816][123090] Updated weights for policy 1, policy_version 1833566 (0.0005) [2023-12-26 14:19:55,847][123091] Updated weights for policy 0, policy_version 1845291 (0.0005) [2023-12-26 14:19:56,533][123091] Updated weights for policy 0, policy_version 1845301 (0.0008) [2023-12-26 14:19:56,548][123090] Updated weights for policy 1, policy_version 1833576 (0.0008) [2023-12-26 14:19:56,594][123091] Updated weights for policy 0, policy_version 1845311 (0.0006) [2023-12-26 14:19:56,609][123090] Updated weights for policy 1, policy_version 1833586 (0.0010) [2023-12-26 14:19:56,658][123091] Updated weights for policy 0, policy_version 1845321 (0.0008) [2023-12-26 14:19:56,671][123090] Updated weights for policy 1, policy_version 1833596 (0.0008) [2023-12-26 14:19:57,310][123091] Updated weights for policy 0, policy_version 1845331 (0.0005) [2023-12-26 14:19:57,363][123091] Updated weights for policy 0, policy_version 1845341 (0.0008) [2023-12-26 14:19:57,410][123091] Updated weights for policy 0, policy_version 1845351 (0.0010) [2023-12-26 14:19:57,474][123090] Updated weights for policy 1, policy_version 1833606 (0.0007) [2023-12-26 14:19:57,543][123090] Updated weights for policy 1, policy_version 1833616 (0.0005) [2023-12-26 14:19:57,609][123090] Updated weights for policy 1, policy_version 1833626 (0.0005) [2023-12-26 14:19:58,238][123091] Updated weights for policy 0, policy_version 1845361 (0.0010) [2023-12-26 14:19:58,261][123090] Updated weights for policy 1, policy_version 1833636 (0.0006) [2023-12-26 14:19:58,305][123091] Updated weights for policy 0, policy_version 1845371 (0.0010) [2023-12-26 14:19:58,331][123090] Updated weights for policy 1, policy_version 1833646 (0.0009) [2023-12-26 14:19:58,377][123091] Updated weights for policy 0, policy_version 1845381 (0.0008) [2023-12-26 14:19:58,405][123090] Updated weights for policy 1, policy_version 1833656 (0.0011) [2023-12-26 14:19:58,446][123091] Updated weights for policy 0, policy_version 1845391 (0.0009) [2023-12-26 14:19:58,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 941842432. Throughput: 0: 8843.4, 1: 8964.6. Samples: 941834200. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:19:58,785][121949] Avg episode reward: [(0, '6265.594'), (1, '5780.101')] [2023-12-26 14:19:59,277][123091] Updated weights for policy 0, policy_version 1845401 (0.0009) [2023-12-26 14:19:59,311][123090] Updated weights for policy 1, policy_version 1833666 (0.0010) [2023-12-26 14:19:59,341][123091] Updated weights for policy 0, policy_version 1845411 (0.0008) [2023-12-26 14:19:59,381][123090] Updated weights for policy 1, policy_version 1833676 (0.0009) [2023-12-26 14:19:59,407][123091] Updated weights for policy 0, policy_version 1845421 (0.0009) [2023-12-26 14:19:59,443][123090] Updated weights for policy 1, policy_version 1833686 (0.0010) [2023-12-26 14:19:59,501][123090] Updated weights for policy 1, policy_version 1833696 (0.0009) [2023-12-26 14:20:00,233][123091] Updated weights for policy 0, policy_version 1845431 (0.0010) [2023-12-26 14:20:00,291][123090] Updated weights for policy 1, policy_version 1833706 (0.0006) [2023-12-26 14:20:00,296][123091] Updated weights for policy 0, policy_version 1845441 (0.0010) [2023-12-26 14:20:00,343][123090] Updated weights for policy 1, policy_version 1833716 (0.0007) [2023-12-26 14:20:00,349][123091] Updated weights for policy 0, policy_version 1845451 (0.0010) [2023-12-26 14:20:00,395][123090] Updated weights for policy 1, policy_version 1833726 (0.0009) [2023-12-26 14:20:01,147][123091] Updated weights for policy 0, policy_version 1845461 (0.0007) [2023-12-26 14:20:01,215][123091] Updated weights for policy 0, policy_version 1845471 (0.0007) [2023-12-26 14:20:01,273][123090] Updated weights for policy 1, policy_version 1833736 (0.0009) [2023-12-26 14:20:01,275][123091] Updated weights for policy 0, policy_version 1845481 (0.0007) [2023-12-26 14:20:01,339][123090] Updated weights for policy 1, policy_version 1833746 (0.0009) [2023-12-26 14:20:01,412][123090] Updated weights for policy 1, policy_version 1833756 (0.0009) [2023-12-26 14:20:02,002][123091] Updated weights for policy 0, policy_version 1845491 (0.0008) [2023-12-26 14:20:02,056][123091] Updated weights for policy 0, policy_version 1845501 (0.0006) [2023-12-26 14:20:02,116][123091] Updated weights for policy 0, policy_version 1845511 (0.0008) [2023-12-26 14:20:02,286][123090] Updated weights for policy 1, policy_version 1833766 (0.0007) [2023-12-26 14:20:02,365][123090] Updated weights for policy 1, policy_version 1833776 (0.0008) [2023-12-26 14:20:02,426][123090] Updated weights for policy 1, policy_version 1833786 (0.0010) [2023-12-26 14:20:02,859][123091] Updated weights for policy 0, policy_version 1845521 (0.0006) [2023-12-26 14:20:02,913][123091] Updated weights for policy 0, policy_version 1845531 (0.0010) [2023-12-26 14:20:02,964][123091] Updated weights for policy 0, policy_version 1845541 (0.0005) [2023-12-26 14:20:03,012][123091] Updated weights for policy 0, policy_version 1845551 (0.0005) [2023-12-26 14:20:03,028][123090] Updated weights for policy 1, policy_version 1833796 (0.0007) [2023-12-26 14:20:03,080][123090] Updated weights for policy 1, policy_version 1833806 (0.0007) [2023-12-26 14:20:03,127][123090] Updated weights for policy 1, policy_version 1833816 (0.0010) [2023-12-26 14:20:03,677][123091] Updated weights for policy 0, policy_version 1845561 (0.0005) [2023-12-26 14:20:03,726][123091] Updated weights for policy 0, policy_version 1845571 (0.0005) [2023-12-26 14:20:03,779][123091] Updated weights for policy 0, policy_version 1845581 (0.0005) [2023-12-26 14:20:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 941924352. Throughput: 0: 8894.0, 1: 8953.8. Samples: 941941784. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:03,785][121949] Avg episode reward: [(0, '6361.659'), (1, '5682.772')] [2023-12-26 14:20:03,847][123090] Updated weights for policy 1, policy_version 1833826 (0.0006) [2023-12-26 14:20:03,913][123090] Updated weights for policy 1, policy_version 1833836 (0.0011) [2023-12-26 14:20:03,970][123090] Updated weights for policy 1, policy_version 1833846 (0.0010) [2023-12-26 14:20:04,025][123090] Updated weights for policy 1, policy_version 1833856 (0.0010) [2023-12-26 14:20:04,614][123091] Updated weights for policy 0, policy_version 1845591 (0.0007) [2023-12-26 14:20:04,674][123091] Updated weights for policy 0, policy_version 1845601 (0.0010) [2023-12-26 14:20:04,733][123091] Updated weights for policy 0, policy_version 1845611 (0.0010) [2023-12-26 14:20:04,743][123090] Updated weights for policy 1, policy_version 1833866 (0.0006) [2023-12-26 14:20:04,803][123090] Updated weights for policy 1, policy_version 1833876 (0.0006) [2023-12-26 14:20:04,867][123090] Updated weights for policy 1, policy_version 1833886 (0.0005) [2023-12-26 14:20:05,487][123091] Updated weights for policy 0, policy_version 1845621 (0.0008) [2023-12-26 14:20:05,540][123090] Updated weights for policy 1, policy_version 1833896 (0.0007) [2023-12-26 14:20:05,542][123091] Updated weights for policy 0, policy_version 1845631 (0.0005) [2023-12-26 14:20:05,592][123091] Updated weights for policy 0, policy_version 1845641 (0.0008) [2023-12-26 14:20:05,597][123090] Updated weights for policy 1, policy_version 1833906 (0.0008) [2023-12-26 14:20:05,657][123090] Updated weights for policy 1, policy_version 1833916 (0.0008) [2023-12-26 14:20:06,346][123090] Updated weights for policy 1, policy_version 1833926 (0.0006) [2023-12-26 14:20:06,417][123090] Updated weights for policy 1, policy_version 1833936 (0.0005) [2023-12-26 14:20:06,479][123091] Updated weights for policy 0, policy_version 1845651 (0.0008) [2023-12-26 14:20:06,484][123090] Updated weights for policy 1, policy_version 1833946 (0.0005) [2023-12-26 14:20:06,545][123091] Updated weights for policy 0, policy_version 1845661 (0.0008) [2023-12-26 14:20:06,613][123091] Updated weights for policy 0, policy_version 1845671 (0.0009) [2023-12-26 14:20:07,161][123090] Updated weights for policy 1, policy_version 1833956 (0.0006) [2023-12-26 14:20:07,233][123090] Updated weights for policy 1, policy_version 1833966 (0.0005) [2023-12-26 14:20:07,307][123090] Updated weights for policy 1, policy_version 1833976 (0.0006) [2023-12-26 14:20:07,421][123091] Updated weights for policy 0, policy_version 1845681 (0.0009) [2023-12-26 14:20:07,500][123091] Updated weights for policy 0, policy_version 1845691 (0.0005) [2023-12-26 14:20:07,560][123091] Updated weights for policy 0, policy_version 1845701 (0.0006) [2023-12-26 14:20:07,627][123091] Updated weights for policy 0, policy_version 1845711 (0.0006) [2023-12-26 14:20:07,849][123090] Updated weights for policy 1, policy_version 1833986 (0.0006) [2023-12-26 14:20:07,909][123090] Updated weights for policy 1, policy_version 1833996 (0.0010) [2023-12-26 14:20:07,972][123090] Updated weights for policy 1, policy_version 1834006 (0.0010) [2023-12-26 14:20:08,044][123090] Updated weights for policy 1, policy_version 1834016 (0.0010) [2023-12-26 14:20:08,409][123091] Updated weights for policy 0, policy_version 1845721 (0.0010) [2023-12-26 14:20:08,465][123091] Updated weights for policy 0, policy_version 1845731 (0.0010) [2023-12-26 14:20:08,535][123091] Updated weights for policy 0, policy_version 1845741 (0.0011) [2023-12-26 14:20:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 942022656. Throughput: 0: 8899.5, 1: 9050.7. Samples: 941997640. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:08,785][121949] Avg episode reward: [(0, '6312.354'), (1, '5716.551')] [2023-12-26 14:20:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001845744_472514560.pth... [2023-12-26 14:20:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001844688_472244224.pth [2023-12-26 14:20:08,852][123090] Updated weights for policy 1, policy_version 1834026 (0.0011) [2023-12-26 14:20:08,922][123090] Updated weights for policy 1, policy_version 1834036 (0.0010) [2023-12-26 14:20:08,981][123090] Updated weights for policy 1, policy_version 1834046 (0.0010) [2023-12-26 14:20:08,987][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001834048_469516288.pth... [2023-12-26 14:20:08,990][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001832992_469245952.pth [2023-12-26 14:20:09,398][123091] Updated weights for policy 0, policy_version 1845751 (0.0009) [2023-12-26 14:20:09,458][123091] Updated weights for policy 0, policy_version 1845761 (0.0008) [2023-12-26 14:20:09,514][123091] Updated weights for policy 0, policy_version 1845771 (0.0008) [2023-12-26 14:20:09,842][123090] Updated weights for policy 1, policy_version 1834056 (0.0009) [2023-12-26 14:20:09,911][123090] Updated weights for policy 1, policy_version 1834066 (0.0007) [2023-12-26 14:20:09,979][123090] Updated weights for policy 1, policy_version 1834076 (0.0009) [2023-12-26 14:20:10,351][123091] Updated weights for policy 0, policy_version 1845781 (0.0007) [2023-12-26 14:20:10,425][123091] Updated weights for policy 0, policy_version 1845791 (0.0007) [2023-12-26 14:20:10,485][123091] Updated weights for policy 0, policy_version 1845801 (0.0011) [2023-12-26 14:20:10,728][123090] Updated weights for policy 1, policy_version 1834086 (0.0007) [2023-12-26 14:20:10,792][123090] Updated weights for policy 1, policy_version 1834096 (0.0006) [2023-12-26 14:20:10,846][123090] Updated weights for policy 1, policy_version 1834106 (0.0005) [2023-12-26 14:20:11,228][123091] Updated weights for policy 0, policy_version 1845811 (0.0007) [2023-12-26 14:20:11,304][123091] Updated weights for policy 0, policy_version 1845821 (0.0008) [2023-12-26 14:20:11,378][123091] Updated weights for policy 0, policy_version 1845831 (0.0008) [2023-12-26 14:20:11,638][123090] Updated weights for policy 1, policy_version 1834116 (0.0007) [2023-12-26 14:20:11,703][123090] Updated weights for policy 1, policy_version 1834126 (0.0006) [2023-12-26 14:20:11,772][123090] Updated weights for policy 1, policy_version 1834136 (0.0009) [2023-12-26 14:20:12,243][123091] Updated weights for policy 0, policy_version 1845841 (0.0010) [2023-12-26 14:20:12,312][123091] Updated weights for policy 0, policy_version 1845851 (0.0008) [2023-12-26 14:20:12,380][123091] Updated weights for policy 0, policy_version 1845861 (0.0008) [2023-12-26 14:20:12,445][123091] Updated weights for policy 0, policy_version 1845871 (0.0010) [2023-12-26 14:20:12,504][123090] Updated weights for policy 1, policy_version 1834146 (0.0009) [2023-12-26 14:20:12,560][123090] Updated weights for policy 1, policy_version 1834156 (0.0010) [2023-12-26 14:20:12,626][123090] Updated weights for policy 1, policy_version 1834167 (0.0010) [2023-12-26 14:20:13,287][123091] Updated weights for policy 0, policy_version 1845881 (0.0010) [2023-12-26 14:20:13,351][123091] Updated weights for policy 0, policy_version 1845891 (0.0009) [2023-12-26 14:20:13,411][123091] Updated weights for policy 0, policy_version 1845901 (0.0009) [2023-12-26 14:20:13,449][123090] Updated weights for policy 1, policy_version 1834177 (0.0009) [2023-12-26 14:20:13,506][123090] Updated weights for policy 1, policy_version 1834187 (0.0005) [2023-12-26 14:20:13,554][123090] Updated weights for policy 1, policy_version 1834197 (0.0005) [2023-12-26 14:20:13,605][123090] Updated weights for policy 1, policy_version 1834207 (0.0005) [2023-12-26 14:20:13,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 942112768. Throughput: 0: 8880.8, 1: 9019.2. Samples: 942103824. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:13,785][121949] Avg episode reward: [(0, '6255.060'), (1, '5843.484')] [2023-12-26 14:20:14,148][123091] Updated weights for policy 0, policy_version 1845911 (0.0009) [2023-12-26 14:20:14,211][123091] Updated weights for policy 0, policy_version 1845921 (0.0006) [2023-12-26 14:20:14,276][123091] Updated weights for policy 0, policy_version 1845931 (0.0009) [2023-12-26 14:20:14,298][123090] Updated weights for policy 1, policy_version 1834217 (0.0008) [2023-12-26 14:20:14,348][123090] Updated weights for policy 1, policy_version 1834227 (0.0008) [2023-12-26 14:20:14,405][123090] Updated weights for policy 1, policy_version 1834237 (0.0010) [2023-12-26 14:20:15,000][123091] Updated weights for policy 0, policy_version 1845941 (0.0008) [2023-12-26 14:20:15,063][123091] Updated weights for policy 0, policy_version 1845951 (0.0005) [2023-12-26 14:20:15,125][123091] Updated weights for policy 0, policy_version 1845961 (0.0006) [2023-12-26 14:20:15,263][123090] Updated weights for policy 1, policy_version 1834247 (0.0010) [2023-12-26 14:20:15,330][123090] Updated weights for policy 1, policy_version 1834257 (0.0009) [2023-12-26 14:20:15,393][123090] Updated weights for policy 1, policy_version 1834267 (0.0010) [2023-12-26 14:20:15,858][123091] Updated weights for policy 0, policy_version 1845971 (0.0007) [2023-12-26 14:20:15,908][123091] Updated weights for policy 0, policy_version 1845981 (0.0010) [2023-12-26 14:20:15,959][123091] Updated weights for policy 0, policy_version 1845991 (0.0010) [2023-12-26 14:20:16,191][123090] Updated weights for policy 1, policy_version 1834277 (0.0008) [2023-12-26 14:20:16,239][123090] Updated weights for policy 1, policy_version 1834287 (0.0005) [2023-12-26 14:20:16,296][123090] Updated weights for policy 1, policy_version 1834297 (0.0006) [2023-12-26 14:20:16,721][123091] Updated weights for policy 0, policy_version 1846001 (0.0006) [2023-12-26 14:20:16,782][123091] Updated weights for policy 0, policy_version 1846011 (0.0010) [2023-12-26 14:20:16,832][123091] Updated weights for policy 0, policy_version 1846021 (0.0010) [2023-12-26 14:20:16,886][123091] Updated weights for policy 0, policy_version 1846031 (0.0010) [2023-12-26 14:20:17,017][123090] Updated weights for policy 1, policy_version 1834307 (0.0006) [2023-12-26 14:20:17,069][123090] Updated weights for policy 1, policy_version 1834317 (0.0006) [2023-12-26 14:20:17,119][123090] Updated weights for policy 1, policy_version 1834327 (0.0005) [2023-12-26 14:20:17,688][123091] Updated weights for policy 0, policy_version 1846041 (0.0011) [2023-12-26 14:20:17,750][123091] Updated weights for policy 0, policy_version 1846051 (0.0011) [2023-12-26 14:20:17,809][123091] Updated weights for policy 0, policy_version 1846061 (0.0010) [2023-12-26 14:20:17,810][123090] Updated weights for policy 1, policy_version 1834337 (0.0005) [2023-12-26 14:20:17,868][123090] Updated weights for policy 1, policy_version 1834347 (0.0005) [2023-12-26 14:20:17,922][123090] Updated weights for policy 1, policy_version 1834357 (0.0008) [2023-12-26 14:20:17,978][123090] Updated weights for policy 1, policy_version 1834367 (0.0009) [2023-12-26 14:20:18,627][123091] Updated weights for policy 0, policy_version 1846071 (0.0011) [2023-12-26 14:20:18,699][123091] Updated weights for policy 0, policy_version 1846081 (0.0011) [2023-12-26 14:20:18,752][123090] Updated weights for policy 1, policy_version 1834377 (0.0006) [2023-12-26 14:20:18,762][123091] Updated weights for policy 0, policy_version 1846091 (0.0007) [2023-12-26 14:20:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 942194688. Throughput: 0: 8891.6, 1: 8984.3. Samples: 942214528. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:18,785][121949] Avg episode reward: [(0, '6302.520'), (1, '5899.801')] [2023-12-26 14:20:18,822][123090] Updated weights for policy 1, policy_version 1834387 (0.0009) [2023-12-26 14:20:18,887][123090] Updated weights for policy 1, policy_version 1834397 (0.0010) [2023-12-26 14:20:19,450][123091] Updated weights for policy 0, policy_version 1846101 (0.0006) [2023-12-26 14:20:19,512][123091] Updated weights for policy 0, policy_version 1846111 (0.0009) [2023-12-26 14:20:19,567][123091] Updated weights for policy 0, policy_version 1846121 (0.0011) [2023-12-26 14:20:19,650][123090] Updated weights for policy 1, policy_version 1834407 (0.0008) [2023-12-26 14:20:19,712][123090] Updated weights for policy 1, policy_version 1834417 (0.0009) [2023-12-26 14:20:19,770][123090] Updated weights for policy 1, policy_version 1834427 (0.0009) [2023-12-26 14:20:20,400][123091] Updated weights for policy 0, policy_version 1846131 (0.0011) [2023-12-26 14:20:20,452][123091] Updated weights for policy 0, policy_version 1846141 (0.0011) [2023-12-26 14:20:20,500][123091] Updated weights for policy 0, policy_version 1846151 (0.0009) [2023-12-26 14:20:20,631][123090] Updated weights for policy 1, policy_version 1834437 (0.0009) [2023-12-26 14:20:20,697][123090] Updated weights for policy 1, policy_version 1834447 (0.0009) [2023-12-26 14:20:20,768][123090] Updated weights for policy 1, policy_version 1834457 (0.0009) [2023-12-26 14:20:21,360][123091] Updated weights for policy 0, policy_version 1846161 (0.0010) [2023-12-26 14:20:21,434][123091] Updated weights for policy 0, policy_version 1846171 (0.0012) [2023-12-26 14:20:21,503][123091] Updated weights for policy 0, policy_version 1846181 (0.0011) [2023-12-26 14:20:21,568][123091] Updated weights for policy 0, policy_version 1846191 (0.0011) [2023-12-26 14:20:21,615][123090] Updated weights for policy 1, policy_version 1834467 (0.0008) [2023-12-26 14:20:21,690][123090] Updated weights for policy 1, policy_version 1834477 (0.0010) [2023-12-26 14:20:21,761][123090] Updated weights for policy 1, policy_version 1834487 (0.0010) [2023-12-26 14:20:22,435][123091] Updated weights for policy 0, policy_version 1846201 (0.0011) [2023-12-26 14:20:22,503][123091] Updated weights for policy 0, policy_version 1846211 (0.0011) [2023-12-26 14:20:22,571][123091] Updated weights for policy 0, policy_version 1846221 (0.0011) [2023-12-26 14:20:22,580][123090] Updated weights for policy 1, policy_version 1834497 (0.0008) [2023-12-26 14:20:22,649][123090] Updated weights for policy 1, policy_version 1834507 (0.0010) [2023-12-26 14:20:22,725][123090] Updated weights for policy 1, policy_version 1834517 (0.0006) [2023-12-26 14:20:22,791][123090] Updated weights for policy 1, policy_version 1834527 (0.0006) [2023-12-26 14:20:23,374][123091] Updated weights for policy 0, policy_version 1846231 (0.0009) [2023-12-26 14:20:23,443][123091] Updated weights for policy 0, policy_version 1846241 (0.0007) [2023-12-26 14:20:23,513][123091] Updated weights for policy 0, policy_version 1846251 (0.0008) [2023-12-26 14:20:23,568][123090] Updated weights for policy 1, policy_version 1834537 (0.0009) [2023-12-26 14:20:23,629][123090] Updated weights for policy 1, policy_version 1834547 (0.0009) [2023-12-26 14:20:23,697][123090] Updated weights for policy 1, policy_version 1834557 (0.0009) [2023-12-26 14:20:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 942292992. Throughput: 0: 8891.5, 1: 8934.9. Samples: 942265956. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:23,785][121949] Avg episode reward: [(0, '6241.926'), (1, '6012.467')] [2023-12-26 14:20:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001846256_472645632.pth... [2023-12-26 14:20:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001834560_469647360.pth... [2023-12-26 14:20:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001833504_469377024.pth [2023-12-26 14:20:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001845200_472375296.pth [2023-12-26 14:20:24,268][123091] Updated weights for policy 0, policy_version 1846261 (0.0008) [2023-12-26 14:20:24,324][123091] Updated weights for policy 0, policy_version 1846271 (0.0010) [2023-12-26 14:20:24,391][123091] Updated weights for policy 0, policy_version 1846281 (0.0010) [2023-12-26 14:20:24,520][123090] Updated weights for policy 1, policy_version 1834567 (0.0008) [2023-12-26 14:20:24,576][123090] Updated weights for policy 1, policy_version 1834577 (0.0009) [2023-12-26 14:20:24,626][123090] Updated weights for policy 1, policy_version 1834587 (0.0008) [2023-12-26 14:20:25,063][123091] Updated weights for policy 0, policy_version 1846291 (0.0008) [2023-12-26 14:20:25,116][123091] Updated weights for policy 0, policy_version 1846301 (0.0006) [2023-12-26 14:20:25,166][123091] Updated weights for policy 0, policy_version 1846311 (0.0009) [2023-12-26 14:20:25,432][123090] Updated weights for policy 1, policy_version 1834597 (0.0008) [2023-12-26 14:20:25,494][123090] Updated weights for policy 1, policy_version 1834607 (0.0005) [2023-12-26 14:20:25,561][123090] Updated weights for policy 1, policy_version 1834617 (0.0005) [2023-12-26 14:20:26,031][123091] Updated weights for policy 0, policy_version 1846321 (0.0009) [2023-12-26 14:20:26,087][123091] Updated weights for policy 0, policy_version 1846331 (0.0010) [2023-12-26 14:20:26,144][123091] Updated weights for policy 0, policy_version 1846341 (0.0011) [2023-12-26 14:20:26,209][123091] Updated weights for policy 0, policy_version 1846351 (0.0009) [2023-12-26 14:20:26,231][123090] Updated weights for policy 1, policy_version 1834627 (0.0005) [2023-12-26 14:20:26,289][123090] Updated weights for policy 1, policy_version 1834637 (0.0005) [2023-12-26 14:20:26,349][123090] Updated weights for policy 1, policy_version 1834647 (0.0005) [2023-12-26 14:20:26,891][123090] Updated weights for policy 1, policy_version 1834657 (0.0005) [2023-12-26 14:20:26,936][123090] Updated weights for policy 1, policy_version 1834667 (0.0005) [2023-12-26 14:20:26,993][123090] Updated weights for policy 1, policy_version 1834677 (0.0005) [2023-12-26 14:20:27,038][123090] Updated weights for policy 1, policy_version 1834687 (0.0005) [2023-12-26 14:20:27,101][123091] Updated weights for policy 0, policy_version 1846361 (0.0009) [2023-12-26 14:20:27,154][123091] Updated weights for policy 0, policy_version 1846371 (0.0010) [2023-12-26 14:20:27,204][123091] Updated weights for policy 0, policy_version 1846381 (0.0007) [2023-12-26 14:20:27,759][123090] Updated weights for policy 1, policy_version 1834697 (0.0005) [2023-12-26 14:20:27,811][123090] Updated weights for policy 1, policy_version 1834707 (0.0005) [2023-12-26 14:20:27,871][123090] Updated weights for policy 1, policy_version 1834717 (0.0005) [2023-12-26 14:20:27,880][123091] Updated weights for policy 0, policy_version 1846391 (0.0005) [2023-12-26 14:20:27,934][123091] Updated weights for policy 0, policy_version 1846401 (0.0005) [2023-12-26 14:20:27,991][123091] Updated weights for policy 0, policy_version 1846412 (0.0010) [2023-12-26 14:20:28,596][123090] Updated weights for policy 1, policy_version 1834727 (0.0008) [2023-12-26 14:20:28,659][123090] Updated weights for policy 1, policy_version 1834737 (0.0009) [2023-12-26 14:20:28,717][123090] Updated weights for policy 1, policy_version 1834747 (0.0009) [2023-12-26 14:20:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 942383104. Throughput: 0: 8955.5, 1: 9045.3. Samples: 942375200. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:28,785][121949] Avg episode reward: [(0, '6226.169'), (1, '5925.825')] [2023-12-26 14:20:28,792][123091] Updated weights for policy 0, policy_version 1846422 (0.0010) [2023-12-26 14:20:28,858][123091] Updated weights for policy 0, policy_version 1846433 (0.0009) [2023-12-26 14:20:28,908][123091] Updated weights for policy 0, policy_version 1846443 (0.0008) [2023-12-26 14:20:29,496][123090] Updated weights for policy 1, policy_version 1834757 (0.0010) [2023-12-26 14:20:29,552][123090] Updated weights for policy 1, policy_version 1834767 (0.0009) [2023-12-26 14:20:29,611][123090] Updated weights for policy 1, policy_version 1834777 (0.0006) [2023-12-26 14:20:29,746][123091] Updated weights for policy 0, policy_version 1846453 (0.0007) [2023-12-26 14:20:29,807][123091] Updated weights for policy 0, policy_version 1846463 (0.0010) [2023-12-26 14:20:29,874][123091] Updated weights for policy 0, policy_version 1846473 (0.0010) [2023-12-26 14:20:30,280][123090] Updated weights for policy 1, policy_version 1834787 (0.0005) [2023-12-26 14:20:30,338][123090] Updated weights for policy 1, policy_version 1834797 (0.0006) [2023-12-26 14:20:30,400][123090] Updated weights for policy 1, policy_version 1834807 (0.0007) [2023-12-26 14:20:30,698][123091] Updated weights for policy 0, policy_version 1846483 (0.0010) [2023-12-26 14:20:30,764][123091] Updated weights for policy 0, policy_version 1846493 (0.0007) [2023-12-26 14:20:30,828][123091] Updated weights for policy 0, policy_version 1846503 (0.0005) [2023-12-26 14:20:31,065][123090] Updated weights for policy 1, policy_version 1834817 (0.0008) [2023-12-26 14:20:31,130][123090] Updated weights for policy 1, policy_version 1834827 (0.0007) [2023-12-26 14:20:31,189][123090] Updated weights for policy 1, policy_version 1834837 (0.0006) [2023-12-26 14:20:31,248][123090] Updated weights for policy 1, policy_version 1834847 (0.0006) [2023-12-26 14:20:31,570][123091] Updated weights for policy 0, policy_version 1846513 (0.0006) [2023-12-26 14:20:31,634][123091] Updated weights for policy 0, policy_version 1846523 (0.0009) [2023-12-26 14:20:31,706][123091] Updated weights for policy 0, policy_version 1846533 (0.0010) [2023-12-26 14:20:31,772][123091] Updated weights for policy 0, policy_version 1846543 (0.0009) [2023-12-26 14:20:31,965][123090] Updated weights for policy 1, policy_version 1834857 (0.0009) [2023-12-26 14:20:32,029][123090] Updated weights for policy 1, policy_version 1834867 (0.0009) [2023-12-26 14:20:32,091][123090] Updated weights for policy 1, policy_version 1834877 (0.0010) [2023-12-26 14:20:32,584][123091] Updated weights for policy 0, policy_version 1846553 (0.0006) [2023-12-26 14:20:32,647][123091] Updated weights for policy 0, policy_version 1846563 (0.0006) [2023-12-26 14:20:32,706][123091] Updated weights for policy 0, policy_version 1846573 (0.0006) [2023-12-26 14:20:32,884][123090] Updated weights for policy 1, policy_version 1834887 (0.0006) [2023-12-26 14:20:32,943][123090] Updated weights for policy 1, policy_version 1834897 (0.0005) [2023-12-26 14:20:32,991][123090] Updated weights for policy 1, policy_version 1834907 (0.0006) [2023-12-26 14:20:33,412][123091] Updated weights for policy 0, policy_version 1846583 (0.0008) [2023-12-26 14:20:33,470][123091] Updated weights for policy 0, policy_version 1846594 (0.0007) [2023-12-26 14:20:33,526][123091] Updated weights for policy 0, policy_version 1846604 (0.0005) [2023-12-26 14:20:33,685][123090] Updated weights for policy 1, policy_version 1834917 (0.0005) [2023-12-26 14:20:33,739][123090] Updated weights for policy 1, policy_version 1834927 (0.0009) [2023-12-26 14:20:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 942473216. Throughput: 0: 8939.1, 1: 9110.2. Samples: 942486688. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:33,784][121949] Avg episode reward: [(0, '6188.760'), (1, '5653.418')] [2023-12-26 14:20:33,786][123090] Updated weights for policy 1, policy_version 1834937 (0.0010) [2023-12-26 14:20:34,208][123091] Updated weights for policy 0, policy_version 1846614 (0.0008) [2023-12-26 14:20:34,259][123091] Updated weights for policy 0, policy_version 1846624 (0.0010) [2023-12-26 14:20:34,312][123091] Updated weights for policy 0, policy_version 1846634 (0.0009) [2023-12-26 14:20:34,615][123090] Updated weights for policy 1, policy_version 1834947 (0.0010) [2023-12-26 14:20:34,663][123090] Updated weights for policy 1, policy_version 1834957 (0.0008) [2023-12-26 14:20:34,712][123090] Updated weights for policy 1, policy_version 1834967 (0.0008) [2023-12-26 14:20:35,177][123091] Updated weights for policy 0, policy_version 1846644 (0.0009) [2023-12-26 14:20:35,242][123091] Updated weights for policy 0, policy_version 1846654 (0.0010) [2023-12-26 14:20:35,305][123091] Updated weights for policy 0, policy_version 1846664 (0.0010) [2023-12-26 14:20:35,563][123090] Updated weights for policy 1, policy_version 1834977 (0.0009) [2023-12-26 14:20:35,629][123090] Updated weights for policy 1, policy_version 1834987 (0.0009) [2023-12-26 14:20:35,688][123090] Updated weights for policy 1, policy_version 1834997 (0.0008) [2023-12-26 14:20:35,750][123090] Updated weights for policy 1, policy_version 1835007 (0.0009) [2023-12-26 14:20:36,100][123091] Updated weights for policy 0, policy_version 1846674 (0.0010) [2023-12-26 14:20:36,162][123091] Updated weights for policy 0, policy_version 1846684 (0.0009) [2023-12-26 14:20:36,215][123091] Updated weights for policy 0, policy_version 1846694 (0.0009) [2023-12-26 14:20:36,265][123091] Updated weights for policy 0, policy_version 1846704 (0.0010) [2023-12-26 14:20:36,579][123090] Updated weights for policy 1, policy_version 1835017 (0.0009) [2023-12-26 14:20:36,643][123090] Updated weights for policy 1, policy_version 1835027 (0.0010) [2023-12-26 14:20:36,706][123090] Updated weights for policy 1, policy_version 1835037 (0.0009) [2023-12-26 14:20:37,124][123091] Updated weights for policy 0, policy_version 1846714 (0.0010) [2023-12-26 14:20:37,185][123091] Updated weights for policy 0, policy_version 1846724 (0.0010) [2023-12-26 14:20:37,255][123091] Updated weights for policy 0, policy_version 1846734 (0.0009) [2023-12-26 14:20:37,571][123090] Updated weights for policy 1, policy_version 1835047 (0.0010) [2023-12-26 14:20:37,629][123090] Updated weights for policy 1, policy_version 1835057 (0.0010) [2023-12-26 14:20:37,693][123090] Updated weights for policy 1, policy_version 1835067 (0.0010) [2023-12-26 14:20:38,054][123091] Updated weights for policy 0, policy_version 1846744 (0.0009) [2023-12-26 14:20:38,118][123091] Updated weights for policy 0, policy_version 1846754 (0.0009) [2023-12-26 14:20:38,178][123091] Updated weights for policy 0, policy_version 1846764 (0.0007) [2023-12-26 14:20:38,535][123090] Updated weights for policy 1, policy_version 1835077 (0.0011) [2023-12-26 14:20:38,587][123090] Updated weights for policy 1, policy_version 1835087 (0.0010) [2023-12-26 14:20:38,640][123090] Updated weights for policy 1, policy_version 1835097 (0.0010) [2023-12-26 14:20:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 942563328. Throughput: 0: 8961.3, 1: 9131.8. Samples: 942538828. Policy #0 lag: (min: 21.0, avg: 27.4, max: 53.0) [2023-12-26 14:20:38,784][121949] Avg episode reward: [(0, '6219.994'), (1, '5690.317')] [2023-12-26 14:20:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001846768_472776704.pth... [2023-12-26 14:20:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001835104_469786624.pth... [2023-12-26 14:20:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001834048_469516288.pth [2023-12-26 14:20:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001845744_472514560.pth [2023-12-26 14:20:38,989][123091] Updated weights for policy 0, policy_version 1846774 (0.0009) [2023-12-26 14:20:39,054][123091] Updated weights for policy 0, policy_version 1846784 (0.0009) [2023-12-26 14:20:39,115][123091] Updated weights for policy 0, policy_version 1846794 (0.0008) [2023-12-26 14:20:39,489][123090] Updated weights for policy 1, policy_version 1835107 (0.0011) [2023-12-26 14:20:39,541][123090] Updated weights for policy 1, policy_version 1835117 (0.0010) [2023-12-26 14:20:39,590][123090] Updated weights for policy 1, policy_version 1835127 (0.0010) [2023-12-26 14:20:39,962][123091] Updated weights for policy 0, policy_version 1846804 (0.0009) [2023-12-26 14:20:40,033][123091] Updated weights for policy 0, policy_version 1846814 (0.0006) [2023-12-26 14:20:40,101][123091] Updated weights for policy 0, policy_version 1846824 (0.0005) [2023-12-26 14:20:40,450][123090] Updated weights for policy 1, policy_version 1835137 (0.0011) [2023-12-26 14:20:40,506][123090] Updated weights for policy 1, policy_version 1835147 (0.0011) [2023-12-26 14:20:40,569][123090] Updated weights for policy 1, policy_version 1835157 (0.0010) [2023-12-26 14:20:40,632][123090] Updated weights for policy 1, policy_version 1835167 (0.0010) [2023-12-26 14:20:40,795][123091] Updated weights for policy 0, policy_version 1846834 (0.0006) [2023-12-26 14:20:40,866][123091] Updated weights for policy 0, policy_version 1846844 (0.0006) [2023-12-26 14:20:40,939][123091] Updated weights for policy 0, policy_version 1846854 (0.0006) [2023-12-26 14:20:41,016][123091] Updated weights for policy 0, policy_version 1846864 (0.0006) [2023-12-26 14:20:41,478][123090] Updated weights for policy 1, policy_version 1835177 (0.0011) [2023-12-26 14:20:41,541][123090] Updated weights for policy 1, policy_version 1835187 (0.0010) [2023-12-26 14:20:41,607][123090] Updated weights for policy 1, policy_version 1835197 (0.0008) [2023-12-26 14:20:41,794][123091] Updated weights for policy 0, policy_version 1846874 (0.0006) [2023-12-26 14:20:41,864][123091] Updated weights for policy 0, policy_version 1846884 (0.0005) [2023-12-26 14:20:41,940][123091] Updated weights for policy 0, policy_version 1846894 (0.0005) [2023-12-26 14:20:42,431][123090] Updated weights for policy 1, policy_version 1835207 (0.0008) [2023-12-26 14:20:42,491][123090] Updated weights for policy 1, policy_version 1835217 (0.0007) [2023-12-26 14:20:42,567][123090] Updated weights for policy 1, policy_version 1835227 (0.0006) [2023-12-26 14:20:42,776][123091] Updated weights for policy 0, policy_version 1846904 (0.0008) [2023-12-26 14:20:42,843][123091] Updated weights for policy 0, policy_version 1846914 (0.0009) [2023-12-26 14:20:42,904][123091] Updated weights for policy 0, policy_version 1846924 (0.0009) [2023-12-26 14:20:43,330][123090] Updated weights for policy 1, policy_version 1835237 (0.0008) [2023-12-26 14:20:43,382][123090] Updated weights for policy 1, policy_version 1835247 (0.0010) [2023-12-26 14:20:43,438][123090] Updated weights for policy 1, policy_version 1835257 (0.0010) [2023-12-26 14:20:43,762][123091] Updated weights for policy 0, policy_version 1846934 (0.0010) [2023-12-26 14:20:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 942645248. Throughput: 0: 8851.0, 1: 9101.2. Samples: 942642048. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:20:43,784][121949] Avg episode reward: [(0, '6354.063'), (1, '5761.225')] [2023-12-26 14:20:43,833][123091] Updated weights for policy 0, policy_version 1846944 (0.0010) [2023-12-26 14:20:43,886][123091] Updated weights for policy 0, policy_version 1846954 (0.0010) [2023-12-26 14:20:44,127][123090] Updated weights for policy 1, policy_version 1835267 (0.0009) [2023-12-26 14:20:44,197][123090] Updated weights for policy 1, policy_version 1835277 (0.0005) [2023-12-26 14:20:44,274][123090] Updated weights for policy 1, policy_version 1835287 (0.0005) [2023-12-26 14:20:44,767][123091] Updated weights for policy 0, policy_version 1846964 (0.0009) [2023-12-26 14:20:44,830][123091] Updated weights for policy 0, policy_version 1846974 (0.0007) [2023-12-26 14:20:44,894][123091] Updated weights for policy 0, policy_version 1846984 (0.0006) [2023-12-26 14:20:45,028][123090] Updated weights for policy 1, policy_version 1835297 (0.0008) [2023-12-26 14:20:45,108][123090] Updated weights for policy 1, policy_version 1835307 (0.0006) [2023-12-26 14:20:45,166][123090] Updated weights for policy 1, policy_version 1835317 (0.0008) [2023-12-26 14:20:45,230][123090] Updated weights for policy 1, policy_version 1835327 (0.0010) [2023-12-26 14:20:45,627][123091] Updated weights for policy 0, policy_version 1846994 (0.0006) [2023-12-26 14:20:45,692][123091] Updated weights for policy 0, policy_version 1847004 (0.0009) [2023-12-26 14:20:45,749][123091] Updated weights for policy 0, policy_version 1847014 (0.0009) [2023-12-26 14:20:45,811][123091] Updated weights for policy 0, policy_version 1847024 (0.0009) [2023-12-26 14:20:46,037][123090] Updated weights for policy 1, policy_version 1835337 (0.0011) [2023-12-26 14:20:46,104][123090] Updated weights for policy 1, policy_version 1835347 (0.0011) [2023-12-26 14:20:46,179][123090] Updated weights for policy 1, policy_version 1835357 (0.0011) [2023-12-26 14:20:46,536][123091] Updated weights for policy 0, policy_version 1847034 (0.0006) [2023-12-26 14:20:46,581][123091] Updated weights for policy 0, policy_version 1847044 (0.0007) [2023-12-26 14:20:46,625][123091] Updated weights for policy 0, policy_version 1847054 (0.0005) [2023-12-26 14:20:46,957][123090] Updated weights for policy 1, policy_version 1835367 (0.0007) [2023-12-26 14:20:47,016][123090] Updated weights for policy 1, policy_version 1835377 (0.0005) [2023-12-26 14:20:47,075][123090] Updated weights for policy 1, policy_version 1835387 (0.0005) [2023-12-26 14:20:47,384][123091] Updated weights for policy 0, policy_version 1847064 (0.0009) [2023-12-26 14:20:47,439][123091] Updated weights for policy 0, policy_version 1847075 (0.0010) [2023-12-26 14:20:47,492][123091] Updated weights for policy 0, policy_version 1847085 (0.0010) [2023-12-26 14:20:47,743][123090] Updated weights for policy 1, policy_version 1835397 (0.0008) [2023-12-26 14:20:47,795][123090] Updated weights for policy 1, policy_version 1835407 (0.0010) [2023-12-26 14:20:47,853][123090] Updated weights for policy 1, policy_version 1835417 (0.0010) [2023-12-26 14:20:48,397][123091] Updated weights for policy 0, policy_version 1847095 (0.0009) [2023-12-26 14:20:48,461][123091] Updated weights for policy 0, policy_version 1847105 (0.0008) [2023-12-26 14:20:48,520][123091] Updated weights for policy 0, policy_version 1847115 (0.0008) [2023-12-26 14:20:48,627][123090] Updated weights for policy 1, policy_version 1835427 (0.0010) [2023-12-26 14:20:48,681][123090] Updated weights for policy 1, policy_version 1835437 (0.0009) [2023-12-26 14:20:48,770][123090] Updated weights for policy 1, policy_version 1835447 (0.0009) [2023-12-26 14:20:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 942735360. Throughput: 0: 8795.8, 1: 9170.6. Samples: 942750272. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:20:48,785][121949] Avg episode reward: [(0, '6269.355'), (1, '5865.571')] [2023-12-26 14:20:49,342][123091] Updated weights for policy 0, policy_version 1847125 (0.0009) [2023-12-26 14:20:49,408][123091] Updated weights for policy 0, policy_version 1847135 (0.0010) [2023-12-26 14:20:49,466][123091] Updated weights for policy 0, policy_version 1847145 (0.0009) [2023-12-26 14:20:49,597][123090] Updated weights for policy 1, policy_version 1835457 (0.0010) [2023-12-26 14:20:49,649][123090] Updated weights for policy 1, policy_version 1835467 (0.0010) [2023-12-26 14:20:49,699][123090] Updated weights for policy 1, policy_version 1835477 (0.0009) [2023-12-26 14:20:49,760][123090] Updated weights for policy 1, policy_version 1835487 (0.0007) [2023-12-26 14:20:50,397][123091] Updated weights for policy 0, policy_version 1847155 (0.0009) [2023-12-26 14:20:50,450][123091] Updated weights for policy 0, policy_version 1847165 (0.0009) [2023-12-26 14:20:50,502][123091] Updated weights for policy 0, policy_version 1847175 (0.0009) [2023-12-26 14:20:50,513][123090] Updated weights for policy 1, policy_version 1835497 (0.0009) [2023-12-26 14:20:50,584][123090] Updated weights for policy 1, policy_version 1835507 (0.0011) [2023-12-26 14:20:50,640][123090] Updated weights for policy 1, policy_version 1835517 (0.0011) [2023-12-26 14:20:51,408][123091] Updated weights for policy 0, policy_version 1847185 (0.0009) [2023-12-26 14:20:51,470][123091] Updated weights for policy 0, policy_version 1847195 (0.0008) [2023-12-26 14:20:51,509][123090] Updated weights for policy 1, policy_version 1835527 (0.0008) [2023-12-26 14:20:51,527][123091] Updated weights for policy 0, policy_version 1847205 (0.0007) [2023-12-26 14:20:51,575][123090] Updated weights for policy 1, policy_version 1835537 (0.0008) [2023-12-26 14:20:51,593][123091] Updated weights for policy 0, policy_version 1847215 (0.0008) [2023-12-26 14:20:51,645][123090] Updated weights for policy 1, policy_version 1835547 (0.0010) [2023-12-26 14:20:52,459][123090] Updated weights for policy 1, policy_version 1835557 (0.0008) [2023-12-26 14:20:52,462][123091] Updated weights for policy 0, policy_version 1847225 (0.0009) [2023-12-26 14:20:52,524][123090] Updated weights for policy 1, policy_version 1835567 (0.0009) [2023-12-26 14:20:52,526][123091] Updated weights for policy 0, policy_version 1847235 (0.0007) [2023-12-26 14:20:52,580][123091] Updated weights for policy 0, policy_version 1847245 (0.0009) [2023-12-26 14:20:52,587][123090] Updated weights for policy 1, policy_version 1835577 (0.0008) [2023-12-26 14:20:53,300][123090] Updated weights for policy 1, policy_version 1835587 (0.0008) [2023-12-26 14:20:53,369][123090] Updated weights for policy 1, policy_version 1835597 (0.0009) [2023-12-26 14:20:53,431][123090] Updated weights for policy 1, policy_version 1835608 (0.0013) [2023-12-26 14:20:53,481][123091] Updated weights for policy 0, policy_version 1847255 (0.0007) [2023-12-26 14:20:53,550][123091] Updated weights for policy 0, policy_version 1847265 (0.0006) [2023-12-26 14:20:53,622][123091] Updated weights for policy 0, policy_version 1847275 (0.0006) [2023-12-26 14:20:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 942825472. Throughput: 0: 8766.1, 1: 9074.6. Samples: 942800476. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:20:53,785][121949] Avg episode reward: [(0, '6263.081'), (1, '5877.128')] [2023-12-26 14:20:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001847280_472907776.pth... [2023-12-26 14:20:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001835616_469917696.pth... [2023-12-26 14:20:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001834560_469647360.pth [2023-12-26 14:20:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001846256_472645632.pth [2023-12-26 14:20:54,155][123090] Updated weights for policy 1, policy_version 1835618 (0.0007) [2023-12-26 14:20:54,213][123090] Updated weights for policy 1, policy_version 1835628 (0.0008) [2023-12-26 14:20:54,265][123090] Updated weights for policy 1, policy_version 1835638 (0.0009) [2023-12-26 14:20:54,338][123090] Updated weights for policy 1, policy_version 1835648 (0.0008) [2023-12-26 14:20:54,413][123091] Updated weights for policy 0, policy_version 1847285 (0.0009) [2023-12-26 14:20:54,472][123091] Updated weights for policy 0, policy_version 1847295 (0.0011) [2023-12-26 14:20:54,524][123091] Updated weights for policy 0, policy_version 1847305 (0.0010) [2023-12-26 14:20:55,044][123090] Updated weights for policy 1, policy_version 1835658 (0.0006) [2023-12-26 14:20:55,104][123090] Updated weights for policy 1, policy_version 1835668 (0.0006) [2023-12-26 14:20:55,157][123090] Updated weights for policy 1, policy_version 1835678 (0.0006) [2023-12-26 14:20:55,225][123091] Updated weights for policy 0, policy_version 1847315 (0.0008) [2023-12-26 14:20:55,280][123091] Updated weights for policy 0, policy_version 1847325 (0.0005) [2023-12-26 14:20:55,342][123091] Updated weights for policy 0, policy_version 1847335 (0.0005) [2023-12-26 14:20:55,799][123090] Updated weights for policy 1, policy_version 1835688 (0.0006) [2023-12-26 14:20:55,853][123090] Updated weights for policy 1, policy_version 1835698 (0.0009) [2023-12-26 14:20:55,908][123090] Updated weights for policy 1, policy_version 1835708 (0.0010) [2023-12-26 14:20:56,098][123091] Updated weights for policy 0, policy_version 1847345 (0.0006) [2023-12-26 14:20:56,157][123091] Updated weights for policy 0, policy_version 1847355 (0.0010) [2023-12-26 14:20:56,226][123091] Updated weights for policy 0, policy_version 1847365 (0.0011) [2023-12-26 14:20:56,292][123091] Updated weights for policy 0, policy_version 1847375 (0.0009) [2023-12-26 14:20:56,719][123090] Updated weights for policy 1, policy_version 1835718 (0.0009) [2023-12-26 14:20:56,777][123090] Updated weights for policy 1, policy_version 1835728 (0.0009) [2023-12-26 14:20:56,829][123090] Updated weights for policy 1, policy_version 1835738 (0.0009) [2023-12-26 14:20:57,108][123091] Updated weights for policy 0, policy_version 1847385 (0.0011) [2023-12-26 14:20:57,166][123091] Updated weights for policy 0, policy_version 1847395 (0.0010) [2023-12-26 14:20:57,227][123091] Updated weights for policy 0, policy_version 1847405 (0.0010) [2023-12-26 14:20:57,613][123090] Updated weights for policy 1, policy_version 1835748 (0.0007) [2023-12-26 14:20:57,684][123090] Updated weights for policy 1, policy_version 1835758 (0.0005) [2023-12-26 14:20:57,737][123090] Updated weights for policy 1, policy_version 1835768 (0.0005) [2023-12-26 14:20:57,915][123091] Updated weights for policy 0, policy_version 1847415 (0.0011) [2023-12-26 14:20:57,973][123091] Updated weights for policy 0, policy_version 1847425 (0.0010) [2023-12-26 14:20:58,042][123091] Updated weights for policy 0, policy_version 1847435 (0.0011) [2023-12-26 14:20:58,447][123090] Updated weights for policy 1, policy_version 1835778 (0.0005) [2023-12-26 14:20:58,517][123090] Updated weights for policy 1, policy_version 1835788 (0.0006) [2023-12-26 14:20:58,590][123090] Updated weights for policy 1, policy_version 1835798 (0.0007) [2023-12-26 14:20:58,665][123090] Updated weights for policy 1, policy_version 1835808 (0.0008) [2023-12-26 14:20:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 942915584. Throughput: 0: 8795.2, 1: 9108.3. Samples: 942909480. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:20:58,785][121949] Avg episode reward: [(0, '6333.289'), (1, '5884.724')] [2023-12-26 14:20:58,990][123091] Updated weights for policy 0, policy_version 1847445 (0.0009) [2023-12-26 14:20:59,044][123091] Updated weights for policy 0, policy_version 1847455 (0.0009) [2023-12-26 14:20:59,118][123091] Updated weights for policy 0, policy_version 1847465 (0.0010) [2023-12-26 14:20:59,509][123090] Updated weights for policy 1, policy_version 1835818 (0.0006) [2023-12-26 14:20:59,577][123090] Updated weights for policy 1, policy_version 1835828 (0.0005) [2023-12-26 14:20:59,648][123090] Updated weights for policy 1, policy_version 1835838 (0.0005) [2023-12-26 14:21:00,058][123091] Updated weights for policy 0, policy_version 1847475 (0.0010) [2023-12-26 14:21:00,119][123091] Updated weights for policy 0, policy_version 1847485 (0.0009) [2023-12-26 14:21:00,185][123091] Updated weights for policy 0, policy_version 1847495 (0.0009) [2023-12-26 14:21:00,329][123090] Updated weights for policy 1, policy_version 1835848 (0.0005) [2023-12-26 14:21:00,397][123090] Updated weights for policy 1, policy_version 1835858 (0.0007) [2023-12-26 14:21:00,471][123090] Updated weights for policy 1, policy_version 1835868 (0.0005) [2023-12-26 14:21:01,032][123090] Updated weights for policy 1, policy_version 1835878 (0.0006) [2023-12-26 14:21:01,070][123091] Updated weights for policy 0, policy_version 1847505 (0.0008) [2023-12-26 14:21:01,094][123090] Updated weights for policy 1, policy_version 1835888 (0.0008) [2023-12-26 14:21:01,136][123091] Updated weights for policy 0, policy_version 1847515 (0.0009) [2023-12-26 14:21:01,166][123090] Updated weights for policy 1, policy_version 1835898 (0.0011) [2023-12-26 14:21:01,195][123091] Updated weights for policy 0, policy_version 1847525 (0.0008) [2023-12-26 14:21:01,244][123091] Updated weights for policy 0, policy_version 1847535 (0.0008) [2023-12-26 14:21:01,987][123090] Updated weights for policy 1, policy_version 1835908 (0.0010) [2023-12-26 14:21:02,048][123090] Updated weights for policy 1, policy_version 1835918 (0.0010) [2023-12-26 14:21:02,055][123091] Updated weights for policy 0, policy_version 1847545 (0.0008) [2023-12-26 14:21:02,107][123090] Updated weights for policy 1, policy_version 1835928 (0.0010) [2023-12-26 14:21:02,115][123091] Updated weights for policy 0, policy_version 1847555 (0.0011) [2023-12-26 14:21:02,177][123091] Updated weights for policy 0, policy_version 1847565 (0.0005) [2023-12-26 14:21:02,887][123090] Updated weights for policy 1, policy_version 1835938 (0.0009) [2023-12-26 14:21:02,948][123090] Updated weights for policy 1, policy_version 1835948 (0.0005) [2023-12-26 14:21:02,959][123091] Updated weights for policy 0, policy_version 1847575 (0.0006) [2023-12-26 14:21:03,001][123090] Updated weights for policy 1, policy_version 1835958 (0.0006) [2023-12-26 14:21:03,016][123091] Updated weights for policy 0, policy_version 1847585 (0.0007) [2023-12-26 14:21:03,065][123090] Updated weights for policy 1, policy_version 1835968 (0.0005) [2023-12-26 14:21:03,078][123091] Updated weights for policy 0, policy_version 1847595 (0.0009) [2023-12-26 14:21:03,780][123091] Updated weights for policy 0, policy_version 1847605 (0.0007) [2023-12-26 14:21:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 942997504. Throughput: 0: 8707.7, 1: 9095.0. Samples: 943015652. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:03,785][121949] Avg episode reward: [(0, '6331.199'), (1, '5773.260')] [2023-12-26 14:21:03,838][123091] Updated weights for policy 0, policy_version 1847615 (0.0007) [2023-12-26 14:21:03,896][123090] Updated weights for policy 1, policy_version 1835978 (0.0008) [2023-12-26 14:21:03,906][123091] Updated weights for policy 0, policy_version 1847625 (0.0008) [2023-12-26 14:21:03,953][123090] Updated weights for policy 1, policy_version 1835988 (0.0006) [2023-12-26 14:21:04,009][123090] Updated weights for policy 1, policy_version 1835998 (0.0010) [2023-12-26 14:21:04,715][123091] Updated weights for policy 0, policy_version 1847635 (0.0010) [2023-12-26 14:21:04,778][123091] Updated weights for policy 0, policy_version 1847645 (0.0010) [2023-12-26 14:21:04,842][123091] Updated weights for policy 0, policy_version 1847655 (0.0010) [2023-12-26 14:21:04,846][123090] Updated weights for policy 1, policy_version 1836008 (0.0008) [2023-12-26 14:21:04,913][123090] Updated weights for policy 1, policy_version 1836018 (0.0009) [2023-12-26 14:21:04,981][123090] Updated weights for policy 1, policy_version 1836028 (0.0009) [2023-12-26 14:21:05,646][123091] Updated weights for policy 0, policy_version 1847665 (0.0009) [2023-12-26 14:21:05,699][123091] Updated weights for policy 0, policy_version 1847675 (0.0010) [2023-12-26 14:21:05,762][123091] Updated weights for policy 0, policy_version 1847685 (0.0009) [2023-12-26 14:21:05,807][123090] Updated weights for policy 1, policy_version 1836038 (0.0009) [2023-12-26 14:21:05,812][123091] Updated weights for policy 0, policy_version 1847695 (0.0006) [2023-12-26 14:21:05,870][123090] Updated weights for policy 1, policy_version 1836048 (0.0009) [2023-12-26 14:21:05,931][123090] Updated weights for policy 1, policy_version 1836058 (0.0010) [2023-12-26 14:21:06,498][123091] Updated weights for policy 0, policy_version 1847705 (0.0009) [2023-12-26 14:21:06,569][123091] Updated weights for policy 0, policy_version 1847715 (0.0009) [2023-12-26 14:21:06,632][123091] Updated weights for policy 0, policy_version 1847725 (0.0008) [2023-12-26 14:21:06,784][123090] Updated weights for policy 1, policy_version 1836068 (0.0009) [2023-12-26 14:21:06,847][123090] Updated weights for policy 1, policy_version 1836078 (0.0009) [2023-12-26 14:21:06,917][123090] Updated weights for policy 1, policy_version 1836088 (0.0009) [2023-12-26 14:21:07,338][123091] Updated weights for policy 0, policy_version 1847735 (0.0009) [2023-12-26 14:21:07,392][123091] Updated weights for policy 0, policy_version 1847745 (0.0010) [2023-12-26 14:21:07,454][123091] Updated weights for policy 0, policy_version 1847755 (0.0010) [2023-12-26 14:21:07,629][123090] Updated weights for policy 1, policy_version 1836098 (0.0007) [2023-12-26 14:21:07,694][123090] Updated weights for policy 1, policy_version 1836108 (0.0007) [2023-12-26 14:21:07,766][123090] Updated weights for policy 1, policy_version 1836118 (0.0008) [2023-12-26 14:21:07,826][123090] Updated weights for policy 1, policy_version 1836128 (0.0005) [2023-12-26 14:21:08,230][123091] Updated weights for policy 0, policy_version 1847765 (0.0007) [2023-12-26 14:21:08,296][123091] Updated weights for policy 0, policy_version 1847775 (0.0005) [2023-12-26 14:21:08,363][123091] Updated weights for policy 0, policy_version 1847785 (0.0006) [2023-12-26 14:21:08,575][123090] Updated weights for policy 1, policy_version 1836138 (0.0009) [2023-12-26 14:21:08,648][123090] Updated weights for policy 1, policy_version 1836148 (0.0006) [2023-12-26 14:21:08,720][123090] Updated weights for policy 1, policy_version 1836158 (0.0006) [2023-12-26 14:21:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 943095808. Throughput: 0: 8729.3, 1: 9083.0. Samples: 943067512. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:08,785][121949] Avg episode reward: [(0, '6281.103'), (1, '5928.344')] [2023-12-26 14:21:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001836160_470056960.pth... [2023-12-26 14:21:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001847792_473038848.pth... [2023-12-26 14:21:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001835104_469786624.pth [2023-12-26 14:21:08,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001846768_472776704.pth [2023-12-26 14:21:09,110][123091] Updated weights for policy 0, policy_version 1847795 (0.0007) [2023-12-26 14:21:09,177][123091] Updated weights for policy 0, policy_version 1847805 (0.0010) [2023-12-26 14:21:09,248][123091] Updated weights for policy 0, policy_version 1847815 (0.0011) [2023-12-26 14:21:09,367][123090] Updated weights for policy 1, policy_version 1836168 (0.0008) [2023-12-26 14:21:09,437][123090] Updated weights for policy 1, policy_version 1836178 (0.0008) [2023-12-26 14:21:09,504][123090] Updated weights for policy 1, policy_version 1836188 (0.0008) [2023-12-26 14:21:10,117][123091] Updated weights for policy 0, policy_version 1847825 (0.0011) [2023-12-26 14:21:10,185][123091] Updated weights for policy 0, policy_version 1847835 (0.0010) [2023-12-26 14:21:10,251][123091] Updated weights for policy 0, policy_version 1847845 (0.0009) [2023-12-26 14:21:10,323][123091] Updated weights for policy 0, policy_version 1847855 (0.0009) [2023-12-26 14:21:10,342][123090] Updated weights for policy 1, policy_version 1836198 (0.0009) [2023-12-26 14:21:10,409][123090] Updated weights for policy 1, policy_version 1836208 (0.0010) [2023-12-26 14:21:10,481][123090] Updated weights for policy 1, policy_version 1836218 (0.0009) [2023-12-26 14:21:11,166][123091] Updated weights for policy 0, policy_version 1847865 (0.0010) [2023-12-26 14:21:11,235][123091] Updated weights for policy 0, policy_version 1847875 (0.0010) [2023-12-26 14:21:11,304][123091] Updated weights for policy 0, policy_version 1847885 (0.0009) [2023-12-26 14:21:11,306][123090] Updated weights for policy 1, policy_version 1836228 (0.0010) [2023-12-26 14:21:11,371][123090] Updated weights for policy 1, policy_version 1836238 (0.0008) [2023-12-26 14:21:11,440][123090] Updated weights for policy 1, policy_version 1836248 (0.0010) [2023-12-26 14:21:12,179][123091] Updated weights for policy 0, policy_version 1847895 (0.0009) [2023-12-26 14:21:12,245][123091] Updated weights for policy 0, policy_version 1847905 (0.0009) [2023-12-26 14:21:12,294][123090] Updated weights for policy 1, policy_version 1836258 (0.0008) [2023-12-26 14:21:12,309][123091] Updated weights for policy 0, policy_version 1847915 (0.0010) [2023-12-26 14:21:12,371][123090] Updated weights for policy 1, policy_version 1836268 (0.0008) [2023-12-26 14:21:12,431][123090] Updated weights for policy 1, policy_version 1836278 (0.0009) [2023-12-26 14:21:12,495][123090] Updated weights for policy 1, policy_version 1836288 (0.0009) [2023-12-26 14:21:13,123][123091] Updated weights for policy 0, policy_version 1847925 (0.0006) [2023-12-26 14:21:13,178][123091] Updated weights for policy 0, policy_version 1847935 (0.0006) [2023-12-26 14:21:13,242][123090] Updated weights for policy 1, policy_version 1836298 (0.0005) [2023-12-26 14:21:13,246][123091] Updated weights for policy 0, policy_version 1847945 (0.0008) [2023-12-26 14:21:13,291][123090] Updated weights for policy 1, policy_version 1836308 (0.0005) [2023-12-26 14:21:13,338][123090] Updated weights for policy 1, policy_version 1836318 (0.0005) [2023-12-26 14:21:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 943177728. Throughput: 0: 8702.8, 1: 8997.1. Samples: 943171692. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:13,785][121949] Avg episode reward: [(0, '6288.547'), (1, '5951.871')] [2023-12-26 14:21:13,913][123091] Updated weights for policy 0, policy_version 1847955 (0.0008) [2023-12-26 14:21:13,983][123091] Updated weights for policy 0, policy_version 1847965 (0.0007) [2023-12-26 14:21:13,983][123090] Updated weights for policy 1, policy_version 1836328 (0.0005) [2023-12-26 14:21:14,056][123091] Updated weights for policy 0, policy_version 1847975 (0.0006) [2023-12-26 14:21:14,059][123090] Updated weights for policy 1, policy_version 1836338 (0.0005) [2023-12-26 14:21:14,140][123090] Updated weights for policy 1, policy_version 1836348 (0.0006) [2023-12-26 14:21:14,699][123091] Updated weights for policy 0, policy_version 1847985 (0.0007) [2023-12-26 14:21:14,725][123090] Updated weights for policy 1, policy_version 1836358 (0.0008) [2023-12-26 14:21:14,750][123091] Updated weights for policy 0, policy_version 1847995 (0.0010) [2023-12-26 14:21:14,789][123090] Updated weights for policy 1, policy_version 1836368 (0.0009) [2023-12-26 14:21:14,815][123091] Updated weights for policy 0, policy_version 1848005 (0.0010) [2023-12-26 14:21:14,860][123090] Updated weights for policy 1, policy_version 1836378 (0.0008) [2023-12-26 14:21:14,881][123091] Updated weights for policy 0, policy_version 1848015 (0.0006) [2023-12-26 14:21:15,659][123091] Updated weights for policy 0, policy_version 1848025 (0.0010) [2023-12-26 14:21:15,679][123090] Updated weights for policy 1, policy_version 1836388 (0.0008) [2023-12-26 14:21:15,722][123091] Updated weights for policy 0, policy_version 1848035 (0.0009) [2023-12-26 14:21:15,745][123090] Updated weights for policy 1, policy_version 1836398 (0.0009) [2023-12-26 14:21:15,791][123091] Updated weights for policy 0, policy_version 1848045 (0.0007) [2023-12-26 14:21:15,812][123090] Updated weights for policy 1, policy_version 1836408 (0.0009) [2023-12-26 14:21:16,482][123091] Updated weights for policy 0, policy_version 1848055 (0.0006) [2023-12-26 14:21:16,541][123091] Updated weights for policy 0, policy_version 1848065 (0.0005) [2023-12-26 14:21:16,589][123091] Updated weights for policy 0, policy_version 1848075 (0.0005) [2023-12-26 14:21:16,603][123090] Updated weights for policy 1, policy_version 1836418 (0.0010) [2023-12-26 14:21:16,670][123090] Updated weights for policy 1, policy_version 1836428 (0.0010) [2023-12-26 14:21:16,736][123090] Updated weights for policy 1, policy_version 1836438 (0.0010) [2023-12-26 14:21:16,797][123090] Updated weights for policy 1, policy_version 1836448 (0.0010) [2023-12-26 14:21:17,296][123091] Updated weights for policy 0, policy_version 1848085 (0.0005) [2023-12-26 14:21:17,358][123091] Updated weights for policy 0, policy_version 1848095 (0.0005) [2023-12-26 14:21:17,420][123091] Updated weights for policy 0, policy_version 1848105 (0.0009) [2023-12-26 14:21:17,543][123090] Updated weights for policy 1, policy_version 1836458 (0.0009) [2023-12-26 14:21:17,607][123090] Updated weights for policy 1, policy_version 1836468 (0.0009) [2023-12-26 14:21:17,668][123090] Updated weights for policy 1, policy_version 1836478 (0.0009) [2023-12-26 14:21:18,114][123091] Updated weights for policy 0, policy_version 1848115 (0.0009) [2023-12-26 14:21:18,171][123091] Updated weights for policy 0, policy_version 1848125 (0.0005) [2023-12-26 14:21:18,231][123091] Updated weights for policy 0, policy_version 1848135 (0.0005) [2023-12-26 14:21:18,396][123090] Updated weights for policy 1, policy_version 1836488 (0.0007) [2023-12-26 14:21:18,454][123090] Updated weights for policy 1, policy_version 1836498 (0.0006) [2023-12-26 14:21:18,514][123090] Updated weights for policy 1, policy_version 1836508 (0.0005) [2023-12-26 14:21:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 943276032. Throughput: 0: 8803.4, 1: 8987.3. Samples: 943287272. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:18,785][121949] Avg episode reward: [(0, '6268.288'), (1, '5823.610')] [2023-12-26 14:21:18,914][123091] Updated weights for policy 0, policy_version 1848145 (0.0006) [2023-12-26 14:21:18,979][123091] Updated weights for policy 0, policy_version 1848155 (0.0005) [2023-12-26 14:21:19,036][123091] Updated weights for policy 0, policy_version 1848165 (0.0005) [2023-12-26 14:21:19,088][123091] Updated weights for policy 0, policy_version 1848175 (0.0005) [2023-12-26 14:21:19,167][123090] Updated weights for policy 1, policy_version 1836518 (0.0005) [2023-12-26 14:21:19,228][123090] Updated weights for policy 1, policy_version 1836528 (0.0006) [2023-12-26 14:21:19,292][123090] Updated weights for policy 1, policy_version 1836538 (0.0006) [2023-12-26 14:21:19,868][123091] Updated weights for policy 0, policy_version 1848185 (0.0009) [2023-12-26 14:21:19,943][123091] Updated weights for policy 0, policy_version 1848195 (0.0009) [2023-12-26 14:21:19,999][123091] Updated weights for policy 0, policy_version 1848206 (0.0009) [2023-12-26 14:21:20,032][123090] Updated weights for policy 1, policy_version 1836548 (0.0008) [2023-12-26 14:21:20,104][123090] Updated weights for policy 1, policy_version 1836558 (0.0010) [2023-12-26 14:21:20,166][123090] Updated weights for policy 1, policy_version 1836568 (0.0008) [2023-12-26 14:21:20,817][123091] Updated weights for policy 0, policy_version 1848216 (0.0010) [2023-12-26 14:21:20,881][123091] Updated weights for policy 0, policy_version 1848226 (0.0009) [2023-12-26 14:21:20,937][123091] Updated weights for policy 0, policy_version 1848236 (0.0006) [2023-12-26 14:21:20,942][123090] Updated weights for policy 1, policy_version 1836578 (0.0006) [2023-12-26 14:21:21,003][123090] Updated weights for policy 1, policy_version 1836588 (0.0010) [2023-12-26 14:21:21,071][123090] Updated weights for policy 1, policy_version 1836598 (0.0008) [2023-12-26 14:21:21,142][123090] Updated weights for policy 1, policy_version 1836608 (0.0007) [2023-12-26 14:21:21,763][123091] Updated weights for policy 0, policy_version 1848246 (0.0008) [2023-12-26 14:21:21,820][123091] Updated weights for policy 0, policy_version 1848256 (0.0010) [2023-12-26 14:21:21,877][123091] Updated weights for policy 0, policy_version 1848266 (0.0008) [2023-12-26 14:21:21,973][123090] Updated weights for policy 1, policy_version 1836618 (0.0007) [2023-12-26 14:21:22,050][123090] Updated weights for policy 1, policy_version 1836628 (0.0007) [2023-12-26 14:21:22,114][123090] Updated weights for policy 1, policy_version 1836638 (0.0009) [2023-12-26 14:21:22,731][123091] Updated weights for policy 0, policy_version 1848276 (0.0010) [2023-12-26 14:21:22,787][123091] Updated weights for policy 0, policy_version 1848286 (0.0010) [2023-12-26 14:21:22,838][123091] Updated weights for policy 0, policy_version 1848296 (0.0010) [2023-12-26 14:21:22,916][123090] Updated weights for policy 1, policy_version 1836648 (0.0009) [2023-12-26 14:21:22,980][123090] Updated weights for policy 1, policy_version 1836658 (0.0010) [2023-12-26 14:21:23,041][123090] Updated weights for policy 1, policy_version 1836668 (0.0009) [2023-12-26 14:21:23,720][123091] Updated weights for policy 0, policy_version 1848306 (0.0009) [2023-12-26 14:21:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 943357952. Throughput: 0: 8803.2, 1: 9034.2. Samples: 943341512. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:23,785][121949] Avg episode reward: [(0, '6301.811'), (1, '5914.721')] [2023-12-26 14:21:23,786][123091] Updated weights for policy 0, policy_version 1848316 (0.0009) [2023-12-26 14:21:23,807][123090] Updated weights for policy 1, policy_version 1836678 (0.0008) [2023-12-26 14:21:23,847][123091] Updated weights for policy 0, policy_version 1848326 (0.0008) [2023-12-26 14:21:23,863][123090] Updated weights for policy 1, policy_version 1836688 (0.0008) [2023-12-26 14:21:23,899][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001848336_473178112.pth... [2023-12-26 14:21:23,901][123091] Updated weights for policy 0, policy_version 1848336 (0.0008) [2023-12-26 14:21:23,903][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001847280_472907776.pth [2023-12-26 14:21:23,920][123090] Updated weights for policy 1, policy_version 1836698 (0.0010) [2023-12-26 14:21:23,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001836704_470196224.pth... [2023-12-26 14:21:23,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001835616_469917696.pth [2023-12-26 14:21:24,746][123091] Updated weights for policy 0, policy_version 1848346 (0.0009) [2023-12-26 14:21:24,766][123090] Updated weights for policy 1, policy_version 1836708 (0.0010) [2023-12-26 14:21:24,798][123091] Updated weights for policy 0, policy_version 1848356 (0.0006) [2023-12-26 14:21:24,818][123090] Updated weights for policy 1, policy_version 1836718 (0.0011) [2023-12-26 14:21:24,863][123091] Updated weights for policy 0, policy_version 1848366 (0.0008) [2023-12-26 14:21:24,879][123090] Updated weights for policy 1, policy_version 1836728 (0.0011) [2023-12-26 14:21:25,660][123091] Updated weights for policy 0, policy_version 1848376 (0.0008) [2023-12-26 14:21:25,698][123090] Updated weights for policy 1, policy_version 1836738 (0.0010) [2023-12-26 14:21:25,722][123091] Updated weights for policy 0, policy_version 1848386 (0.0009) [2023-12-26 14:21:25,759][123090] Updated weights for policy 1, policy_version 1836748 (0.0007) [2023-12-26 14:21:25,786][123091] Updated weights for policy 0, policy_version 1848396 (0.0006) [2023-12-26 14:21:25,823][123090] Updated weights for policy 1, policy_version 1836758 (0.0010) [2023-12-26 14:21:25,881][123090] Updated weights for policy 1, policy_version 1836768 (0.0010) [2023-12-26 14:21:26,490][123091] Updated weights for policy 0, policy_version 1848406 (0.0005) [2023-12-26 14:21:26,535][123091] Updated weights for policy 0, policy_version 1848416 (0.0005) [2023-12-26 14:21:26,592][123091] Updated weights for policy 0, policy_version 1848426 (0.0005) [2023-12-26 14:21:26,616][123090] Updated weights for policy 1, policy_version 1836778 (0.0005) [2023-12-26 14:21:26,666][123090] Updated weights for policy 1, policy_version 1836788 (0.0007) [2023-12-26 14:21:26,719][123090] Updated weights for policy 1, policy_version 1836798 (0.0005) [2023-12-26 14:21:27,353][123091] Updated weights for policy 0, policy_version 1848436 (0.0006) [2023-12-26 14:21:27,411][123091] Updated weights for policy 0, policy_version 1848446 (0.0008) [2023-12-26 14:21:27,467][123091] Updated weights for policy 0, policy_version 1848456 (0.0009) [2023-12-26 14:21:27,503][123090] Updated weights for policy 1, policy_version 1836808 (0.0006) [2023-12-26 14:21:27,552][123090] Updated weights for policy 1, policy_version 1836818 (0.0005) [2023-12-26 14:21:27,617][123090] Updated weights for policy 1, policy_version 1836828 (0.0006) [2023-12-26 14:21:28,209][123091] Updated weights for policy 0, policy_version 1848466 (0.0007) [2023-12-26 14:21:28,253][123090] Updated weights for policy 1, policy_version 1836838 (0.0007) [2023-12-26 14:21:28,259][123091] Updated weights for policy 0, policy_version 1848476 (0.0010) [2023-12-26 14:21:28,316][123090] Updated weights for policy 1, policy_version 1836848 (0.0006) [2023-12-26 14:21:28,318][123091] Updated weights for policy 0, policy_version 1848486 (0.0011) [2023-12-26 14:21:28,380][123090] Updated weights for policy 1, policy_version 1836858 (0.0007) [2023-12-26 14:21:28,385][123091] Updated weights for policy 0, policy_version 1848496 (0.0011) [2023-12-26 14:21:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 943456256. Throughput: 0: 8817.7, 1: 9083.3. Samples: 943447592. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:28,785][121949] Avg episode reward: [(0, '6326.707'), (1, '6056.835')] [2023-12-26 14:21:29,094][123090] Updated weights for policy 1, policy_version 1836868 (0.0008) [2023-12-26 14:21:29,131][123091] Updated weights for policy 0, policy_version 1848506 (0.0005) [2023-12-26 14:21:29,159][123090] Updated weights for policy 1, policy_version 1836878 (0.0009) [2023-12-26 14:21:29,177][123091] Updated weights for policy 0, policy_version 1848516 (0.0005) [2023-12-26 14:21:29,223][123090] Updated weights for policy 1, policy_version 1836888 (0.0007) [2023-12-26 14:21:29,246][123091] Updated weights for policy 0, policy_version 1848526 (0.0007) [2023-12-26 14:21:29,963][123091] Updated weights for policy 0, policy_version 1848536 (0.0009) [2023-12-26 14:21:30,028][123091] Updated weights for policy 0, policy_version 1848546 (0.0008) [2023-12-26 14:21:30,051][123090] Updated weights for policy 1, policy_version 1836898 (0.0007) [2023-12-26 14:21:30,090][123091] Updated weights for policy 0, policy_version 1848556 (0.0008) [2023-12-26 14:21:30,114][123090] Updated weights for policy 1, policy_version 1836908 (0.0007) [2023-12-26 14:21:30,167][123090] Updated weights for policy 1, policy_version 1836918 (0.0010) [2023-12-26 14:21:30,222][123090] Updated weights for policy 1, policy_version 1836928 (0.0010) [2023-12-26 14:21:30,807][123091] Updated weights for policy 0, policy_version 1848566 (0.0006) [2023-12-26 14:21:30,858][123091] Updated weights for policy 0, policy_version 1848576 (0.0005) [2023-12-26 14:21:30,910][123091] Updated weights for policy 0, policy_version 1848586 (0.0006) [2023-12-26 14:21:31,089][123090] Updated weights for policy 1, policy_version 1836938 (0.0009) [2023-12-26 14:21:31,157][123090] Updated weights for policy 1, policy_version 1836948 (0.0008) [2023-12-26 14:21:31,221][123090] Updated weights for policy 1, policy_version 1836958 (0.0009) [2023-12-26 14:21:31,670][123091] Updated weights for policy 0, policy_version 1848596 (0.0007) [2023-12-26 14:21:31,742][123091] Updated weights for policy 0, policy_version 1848606 (0.0009) [2023-12-26 14:21:31,812][123091] Updated weights for policy 0, policy_version 1848616 (0.0006) [2023-12-26 14:21:31,952][123090] Updated weights for policy 1, policy_version 1836968 (0.0008) [2023-12-26 14:21:32,021][123090] Updated weights for policy 1, policy_version 1836978 (0.0007) [2023-12-26 14:21:32,094][123090] Updated weights for policy 1, policy_version 1836988 (0.0007) [2023-12-26 14:21:32,595][123091] Updated weights for policy 0, policy_version 1848626 (0.0008) [2023-12-26 14:21:32,656][123091] Updated weights for policy 0, policy_version 1848636 (0.0009) [2023-12-26 14:21:32,718][123091] Updated weights for policy 0, policy_version 1848646 (0.0010) [2023-12-26 14:21:32,779][123091] Updated weights for policy 0, policy_version 1848656 (0.0008) [2023-12-26 14:21:32,811][123090] Updated weights for policy 1, policy_version 1836998 (0.0009) [2023-12-26 14:21:32,854][123090] Updated weights for policy 1, policy_version 1837008 (0.0010) [2023-12-26 14:21:32,905][123090] Updated weights for policy 1, policy_version 1837018 (0.0006) [2023-12-26 14:21:33,541][123091] Updated weights for policy 0, policy_version 1848666 (0.0009) [2023-12-26 14:21:33,591][123091] Updated weights for policy 0, policy_version 1848676 (0.0009) [2023-12-26 14:21:33,649][123091] Updated weights for policy 0, policy_version 1848686 (0.0005) [2023-12-26 14:21:33,676][123090] Updated weights for policy 1, policy_version 1837028 (0.0006) [2023-12-26 14:21:33,745][123090] Updated weights for policy 1, policy_version 1837038 (0.0010) [2023-12-26 14:21:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 943546368. Throughput: 0: 8896.9, 1: 9065.2. Samples: 943558564. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:33,784][121949] Avg episode reward: [(0, '6271.458'), (1, '5981.947')] [2023-12-26 14:21:33,809][123090] Updated weights for policy 1, policy_version 1837048 (0.0005) [2023-12-26 14:21:34,395][123091] Updated weights for policy 0, policy_version 1848696 (0.0009) [2023-12-26 14:21:34,454][123091] Updated weights for policy 0, policy_version 1848706 (0.0011) [2023-12-26 14:21:34,499][123091] Updated weights for policy 0, policy_version 1848716 (0.0010) [2023-12-26 14:21:34,527][123090] Updated weights for policy 1, policy_version 1837058 (0.0006) [2023-12-26 14:21:34,594][123090] Updated weights for policy 1, policy_version 1837068 (0.0010) [2023-12-26 14:21:34,661][123090] Updated weights for policy 1, policy_version 1837078 (0.0011) [2023-12-26 14:21:34,724][123090] Updated weights for policy 1, policy_version 1837088 (0.0010) [2023-12-26 14:21:35,359][123091] Updated weights for policy 0, policy_version 1848726 (0.0007) [2023-12-26 14:21:35,424][123091] Updated weights for policy 0, policy_version 1848736 (0.0005) [2023-12-26 14:21:35,456][123090] Updated weights for policy 1, policy_version 1837098 (0.0006) [2023-12-26 14:21:35,476][123091] Updated weights for policy 0, policy_version 1848746 (0.0005) [2023-12-26 14:21:35,501][123090] Updated weights for policy 1, policy_version 1837108 (0.0007) [2023-12-26 14:21:35,556][123090] Updated weights for policy 1, policy_version 1837118 (0.0005) [2023-12-26 14:21:36,181][123090] Updated weights for policy 1, policy_version 1837128 (0.0008) [2023-12-26 14:21:36,249][123090] Updated weights for policy 1, policy_version 1837138 (0.0008) [2023-12-26 14:21:36,264][123091] Updated weights for policy 0, policy_version 1848756 (0.0008) [2023-12-26 14:21:36,307][123090] Updated weights for policy 1, policy_version 1837148 (0.0007) [2023-12-26 14:21:36,323][123091] Updated weights for policy 0, policy_version 1848766 (0.0011) [2023-12-26 14:21:36,390][123091] Updated weights for policy 0, policy_version 1848776 (0.0011) [2023-12-26 14:21:37,086][123090] Updated weights for policy 1, policy_version 1837158 (0.0007) [2023-12-26 14:21:37,133][123090] Updated weights for policy 1, policy_version 1837168 (0.0005) [2023-12-26 14:21:37,196][123090] Updated weights for policy 1, policy_version 1837178 (0.0005) [2023-12-26 14:21:37,218][123091] Updated weights for policy 0, policy_version 1848786 (0.0011) [2023-12-26 14:21:37,289][123091] Updated weights for policy 0, policy_version 1848796 (0.0011) [2023-12-26 14:21:37,362][123091] Updated weights for policy 0, policy_version 1848806 (0.0011) [2023-12-26 14:21:37,432][123091] Updated weights for policy 0, policy_version 1848816 (0.0010) [2023-12-26 14:21:37,889][123090] Updated weights for policy 1, policy_version 1837188 (0.0007) [2023-12-26 14:21:37,948][123090] Updated weights for policy 1, policy_version 1837198 (0.0008) [2023-12-26 14:21:38,000][123090] Updated weights for policy 1, policy_version 1837208 (0.0005) [2023-12-26 14:21:38,249][123091] Updated weights for policy 0, policy_version 1848826 (0.0011) [2023-12-26 14:21:38,300][123091] Updated weights for policy 0, policy_version 1848836 (0.0010) [2023-12-26 14:21:38,358][123091] Updated weights for policy 0, policy_version 1848846 (0.0011) [2023-12-26 14:21:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 943636480. Throughput: 0: 8948.5, 1: 9134.5. Samples: 943614208. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:38,785][121949] Avg episode reward: [(0, '6215.335'), (1, '5932.251')] [2023-12-26 14:21:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001848848_473309184.pth... [2023-12-26 14:21:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001847792_473038848.pth [2023-12-26 14:21:38,796][123090] Updated weights for policy 1, policy_version 1837218 (0.0006) [2023-12-26 14:21:38,864][123090] Updated weights for policy 1, policy_version 1837228 (0.0009) [2023-12-26 14:21:38,914][123090] Updated weights for policy 1, policy_version 1837238 (0.0006) [2023-12-26 14:21:38,968][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001837248_470335488.pth... [2023-12-26 14:21:38,969][123090] Updated weights for policy 1, policy_version 1837248 (0.0005) [2023-12-26 14:21:38,973][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001836160_470056960.pth [2023-12-26 14:21:39,135][123091] Updated weights for policy 0, policy_version 1848856 (0.0009) [2023-12-26 14:21:39,207][123091] Updated weights for policy 0, policy_version 1848866 (0.0010) [2023-12-26 14:21:39,286][123091] Updated weights for policy 0, policy_version 1848876 (0.0010) [2023-12-26 14:21:39,861][123090] Updated weights for policy 1, policy_version 1837258 (0.0010) [2023-12-26 14:21:39,933][123090] Updated weights for policy 1, policy_version 1837268 (0.0010) [2023-12-26 14:21:40,004][123090] Updated weights for policy 1, policy_version 1837278 (0.0009) [2023-12-26 14:21:40,029][123091] Updated weights for policy 0, policy_version 1848886 (0.0009) [2023-12-26 14:21:40,090][123091] Updated weights for policy 0, policy_version 1848896 (0.0009) [2023-12-26 14:21:40,148][123091] Updated weights for policy 0, policy_version 1848906 (0.0009) [2023-12-26 14:21:40,850][123090] Updated weights for policy 1, policy_version 1837288 (0.0009) [2023-12-26 14:21:40,916][123090] Updated weights for policy 1, policy_version 1837298 (0.0009) [2023-12-26 14:21:40,984][123090] Updated weights for policy 1, policy_version 1837308 (0.0009) [2023-12-26 14:21:40,991][123091] Updated weights for policy 0, policy_version 1848916 (0.0009) [2023-12-26 14:21:41,059][123091] Updated weights for policy 0, policy_version 1848926 (0.0008) [2023-12-26 14:21:41,116][123091] Updated weights for policy 0, policy_version 1848936 (0.0009) [2023-12-26 14:21:41,842][123090] Updated weights for policy 1, policy_version 1837318 (0.0009) [2023-12-26 14:21:41,900][123090] Updated weights for policy 1, policy_version 1837328 (0.0010) [2023-12-26 14:21:41,970][123090] Updated weights for policy 1, policy_version 1837338 (0.0006) [2023-12-26 14:21:41,995][123091] Updated weights for policy 0, policy_version 1848946 (0.0010) [2023-12-26 14:21:42,059][123091] Updated weights for policy 0, policy_version 1848956 (0.0009) [2023-12-26 14:21:42,122][123091] Updated weights for policy 0, policy_version 1848966 (0.0009) [2023-12-26 14:21:42,191][123091] Updated weights for policy 0, policy_version 1848976 (0.0009) [2023-12-26 14:21:42,689][123090] Updated weights for policy 1, policy_version 1837348 (0.0007) [2023-12-26 14:21:42,753][123090] Updated weights for policy 1, policy_version 1837358 (0.0009) [2023-12-26 14:21:42,806][123090] Updated weights for policy 1, policy_version 1837368 (0.0009) [2023-12-26 14:21:43,040][123091] Updated weights for policy 0, policy_version 1848986 (0.0009) [2023-12-26 14:21:43,092][123091] Updated weights for policy 0, policy_version 1848996 (0.0011) [2023-12-26 14:21:43,144][123091] Updated weights for policy 0, policy_version 1849006 (0.0010) [2023-12-26 14:21:43,678][123090] Updated weights for policy 1, policy_version 1837378 (0.0009) [2023-12-26 14:21:43,726][123090] Updated weights for policy 1, policy_version 1837388 (0.0008) [2023-12-26 14:21:43,774][123090] Updated weights for policy 1, policy_version 1837398 (0.0008) [2023-12-26 14:21:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 943718400. Throughput: 0: 8910.6, 1: 9064.0. Samples: 943718336. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:43,785][121949] Avg episode reward: [(0, '6186.440'), (1, '5833.942')] [2023-12-26 14:21:43,823][123090] Updated weights for policy 1, policy_version 1837408 (0.0008) [2023-12-26 14:21:43,947][123091] Updated weights for policy 0, policy_version 1849016 (0.0010) [2023-12-26 14:21:43,995][123091] Updated weights for policy 0, policy_version 1849026 (0.0010) [2023-12-26 14:21:44,046][123091] Updated weights for policy 0, policy_version 1849036 (0.0011) [2023-12-26 14:21:44,670][123090] Updated weights for policy 1, policy_version 1837418 (0.0009) [2023-12-26 14:21:44,725][123090] Updated weights for policy 1, policy_version 1837428 (0.0008) [2023-12-26 14:21:44,782][123090] Updated weights for policy 1, policy_version 1837438 (0.0008) [2023-12-26 14:21:44,910][123091] Updated weights for policy 0, policy_version 1849046 (0.0011) [2023-12-26 14:21:44,969][123091] Updated weights for policy 0, policy_version 1849056 (0.0011) [2023-12-26 14:21:45,037][123091] Updated weights for policy 0, policy_version 1849066 (0.0011) [2023-12-26 14:21:45,657][123090] Updated weights for policy 1, policy_version 1837449 (0.0009) [2023-12-26 14:21:45,721][123090] Updated weights for policy 1, policy_version 1837459 (0.0009) [2023-12-26 14:21:45,778][123090] Updated weights for policy 1, policy_version 1837469 (0.0009) [2023-12-26 14:21:45,850][123091] Updated weights for policy 0, policy_version 1849076 (0.0011) [2023-12-26 14:21:45,908][123091] Updated weights for policy 0, policy_version 1849086 (0.0010) [2023-12-26 14:21:45,964][123091] Updated weights for policy 0, policy_version 1849096 (0.0010) [2023-12-26 14:21:46,635][123090] Updated weights for policy 1, policy_version 1837479 (0.0009) [2023-12-26 14:21:46,683][123090] Updated weights for policy 1, policy_version 1837489 (0.0009) [2023-12-26 14:21:46,750][123090] Updated weights for policy 1, policy_version 1837499 (0.0008) [2023-12-26 14:21:46,795][123091] Updated weights for policy 0, policy_version 1849106 (0.0010) [2023-12-26 14:21:46,857][123091] Updated weights for policy 0, policy_version 1849116 (0.0010) [2023-12-26 14:21:46,918][123091] Updated weights for policy 0, policy_version 1849126 (0.0009) [2023-12-26 14:21:46,986][123091] Updated weights for policy 0, policy_version 1849136 (0.0009) [2023-12-26 14:21:47,539][123090] Updated weights for policy 1, policy_version 1837509 (0.0007) [2023-12-26 14:21:47,591][123090] Updated weights for policy 1, policy_version 1837519 (0.0009) [2023-12-26 14:21:47,661][123090] Updated weights for policy 1, policy_version 1837529 (0.0007) [2023-12-26 14:21:47,777][123091] Updated weights for policy 0, policy_version 1849146 (0.0010) [2023-12-26 14:21:47,846][123091] Updated weights for policy 0, policy_version 1849156 (0.0011) [2023-12-26 14:21:47,894][123091] Updated weights for policy 0, policy_version 1849166 (0.0010) [2023-12-26 14:21:48,353][123090] Updated weights for policy 1, policy_version 1837539 (0.0008) [2023-12-26 14:21:48,423][123090] Updated weights for policy 1, policy_version 1837549 (0.0008) [2023-12-26 14:21:48,489][123090] Updated weights for policy 1, policy_version 1837559 (0.0008) [2023-12-26 14:21:48,660][123091] Updated weights for policy 0, policy_version 1849176 (0.0006) [2023-12-26 14:21:48,720][123091] Updated weights for policy 0, policy_version 1849186 (0.0007) [2023-12-26 14:21:48,782][123091] Updated weights for policy 0, policy_version 1849196 (0.0009) [2023-12-26 14:21:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 943808512. Throughput: 0: 8944.3, 1: 8991.2. Samples: 943822748. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:48,784][121949] Avg episode reward: [(0, '6094.171'), (1, '5782.251')] [2023-12-26 14:21:49,290][123090] Updated weights for policy 1, policy_version 1837569 (0.0008) [2023-12-26 14:21:49,364][123090] Updated weights for policy 1, policy_version 1837579 (0.0009) [2023-12-26 14:21:49,427][123090] Updated weights for policy 1, policy_version 1837589 (0.0010) [2023-12-26 14:21:49,493][123090] Updated weights for policy 1, policy_version 1837599 (0.0009) [2023-12-26 14:21:49,497][123091] Updated weights for policy 0, policy_version 1849206 (0.0010) [2023-12-26 14:21:49,563][123091] Updated weights for policy 0, policy_version 1849216 (0.0011) [2023-12-26 14:21:49,629][123091] Updated weights for policy 0, policy_version 1849226 (0.0011) [2023-12-26 14:21:50,311][123090] Updated weights for policy 1, policy_version 1837609 (0.0008) [2023-12-26 14:21:50,346][123091] Updated weights for policy 0, policy_version 1849236 (0.0010) [2023-12-26 14:21:50,375][123090] Updated weights for policy 1, policy_version 1837619 (0.0009) [2023-12-26 14:21:50,404][123091] Updated weights for policy 0, policy_version 1849246 (0.0008) [2023-12-26 14:21:50,432][123090] Updated weights for policy 1, policy_version 1837629 (0.0007) [2023-12-26 14:21:50,465][123091] Updated weights for policy 0, policy_version 1849256 (0.0009) [2023-12-26 14:21:51,278][123090] Updated weights for policy 1, policy_version 1837639 (0.0010) [2023-12-26 14:21:51,320][123091] Updated weights for policy 0, policy_version 1849266 (0.0009) [2023-12-26 14:21:51,345][123090] Updated weights for policy 1, policy_version 1837649 (0.0007) [2023-12-26 14:21:51,385][123091] Updated weights for policy 0, policy_version 1849276 (0.0007) [2023-12-26 14:21:51,421][123090] Updated weights for policy 1, policy_version 1837659 (0.0011) [2023-12-26 14:21:51,446][123091] Updated weights for policy 0, policy_version 1849286 (0.0006) [2023-12-26 14:21:51,509][123091] Updated weights for policy 0, policy_version 1849296 (0.0009) [2023-12-26 14:21:52,240][123090] Updated weights for policy 1, policy_version 1837669 (0.0010) [2023-12-26 14:21:52,304][123090] Updated weights for policy 1, policy_version 1837679 (0.0010) [2023-12-26 14:21:52,361][123091] Updated weights for policy 0, policy_version 1849306 (0.0007) [2023-12-26 14:21:52,368][123090] Updated weights for policy 1, policy_version 1837689 (0.0010) [2023-12-26 14:21:52,426][123091] Updated weights for policy 0, policy_version 1849316 (0.0007) [2023-12-26 14:21:52,478][123091] Updated weights for policy 0, policy_version 1849326 (0.0009) [2023-12-26 14:21:53,192][123090] Updated weights for policy 1, policy_version 1837699 (0.0011) [2023-12-26 14:21:53,248][123090] Updated weights for policy 1, policy_version 1837709 (0.0010) [2023-12-26 14:21:53,250][123091] Updated weights for policy 0, policy_version 1849336 (0.0006) [2023-12-26 14:21:53,299][123090] Updated weights for policy 1, policy_version 1837719 (0.0010) [2023-12-26 14:21:53,306][123091] Updated weights for policy 0, policy_version 1849346 (0.0006) [2023-12-26 14:21:53,365][123091] Updated weights for policy 0, policy_version 1849356 (0.0006) [2023-12-26 14:21:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 943898624. Throughput: 0: 8935.1, 1: 9001.8. Samples: 943874672. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:53,785][121949] Avg episode reward: [(0, '6183.940'), (1, '5813.449')] [2023-12-26 14:21:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001849360_473440256.pth... [2023-12-26 14:21:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001837728_470458368.pth... [2023-12-26 14:21:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001848336_473178112.pth [2023-12-26 14:21:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001836704_470196224.pth [2023-12-26 14:21:54,141][123090] Updated weights for policy 1, policy_version 1837729 (0.0010) [2023-12-26 14:21:54,199][123090] Updated weights for policy 1, policy_version 1837739 (0.0007) [2023-12-26 14:21:54,200][123091] Updated weights for policy 0, policy_version 1849366 (0.0009) [2023-12-26 14:21:54,264][123091] Updated weights for policy 0, policy_version 1849376 (0.0008) [2023-12-26 14:21:54,269][123090] Updated weights for policy 1, policy_version 1837749 (0.0006) [2023-12-26 14:21:54,329][123091] Updated weights for policy 0, policy_version 1849386 (0.0009) [2023-12-26 14:21:54,333][123090] Updated weights for policy 1, policy_version 1837759 (0.0006) [2023-12-26 14:21:55,015][123090] Updated weights for policy 1, policy_version 1837769 (0.0007) [2023-12-26 14:21:55,091][123090] Updated weights for policy 1, policy_version 1837779 (0.0007) [2023-12-26 14:21:55,141][123091] Updated weights for policy 0, policy_version 1849396 (0.0009) [2023-12-26 14:21:55,152][123090] Updated weights for policy 1, policy_version 1837789 (0.0008) [2023-12-26 14:21:55,212][123091] Updated weights for policy 0, policy_version 1849406 (0.0007) [2023-12-26 14:21:55,287][123091] Updated weights for policy 0, policy_version 1849416 (0.0009) [2023-12-26 14:21:55,884][123090] Updated weights for policy 1, policy_version 1837799 (0.0009) [2023-12-26 14:21:55,940][123090] Updated weights for policy 1, policy_version 1837809 (0.0009) [2023-12-26 14:21:55,947][123091] Updated weights for policy 0, policy_version 1849426 (0.0007) [2023-12-26 14:21:55,989][123090] Updated weights for policy 1, policy_version 1837819 (0.0008) [2023-12-26 14:21:55,991][123091] Updated weights for policy 0, policy_version 1849436 (0.0007) [2023-12-26 14:21:56,044][123091] Updated weights for policy 0, policy_version 1849446 (0.0009) [2023-12-26 14:21:56,102][123091] Updated weights for policy 0, policy_version 1849456 (0.0009) [2023-12-26 14:21:56,718][123090] Updated weights for policy 1, policy_version 1837829 (0.0008) [2023-12-26 14:21:56,770][123090] Updated weights for policy 1, policy_version 1837839 (0.0008) [2023-12-26 14:21:56,827][123090] Updated weights for policy 1, policy_version 1837849 (0.0005) [2023-12-26 14:21:57,034][123091] Updated weights for policy 0, policy_version 1849466 (0.0005) [2023-12-26 14:21:57,098][123091] Updated weights for policy 0, policy_version 1849476 (0.0005) [2023-12-26 14:21:57,153][123091] Updated weights for policy 0, policy_version 1849486 (0.0006) [2023-12-26 14:21:57,491][123090] Updated weights for policy 1, policy_version 1837859 (0.0005) [2023-12-26 14:21:57,546][123090] Updated weights for policy 1, policy_version 1837869 (0.0006) [2023-12-26 14:21:57,596][123090] Updated weights for policy 1, policy_version 1837879 (0.0009) [2023-12-26 14:21:57,859][123091] Updated weights for policy 0, policy_version 1849496 (0.0005) [2023-12-26 14:21:57,919][123091] Updated weights for policy 0, policy_version 1849506 (0.0005) [2023-12-26 14:21:57,991][123091] Updated weights for policy 0, policy_version 1849516 (0.0005) [2023-12-26 14:21:58,478][123090] Updated weights for policy 1, policy_version 1837890 (0.0010) [2023-12-26 14:21:58,547][123090] Updated weights for policy 1, policy_version 1837900 (0.0008) [2023-12-26 14:21:58,625][123090] Updated weights for policy 1, policy_version 1837910 (0.0008) [2023-12-26 14:21:58,700][123090] Updated weights for policy 1, policy_version 1837920 (0.0007) [2023-12-26 14:21:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 943988736. Throughput: 0: 8961.0, 1: 9058.5. Samples: 943982572. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:21:58,785][121949] Avg episode reward: [(0, '6310.711'), (1, '5786.799')] [2023-12-26 14:21:58,852][123091] Updated weights for policy 0, policy_version 1849526 (0.0007) [2023-12-26 14:21:58,905][123091] Updated weights for policy 0, policy_version 1849536 (0.0007) [2023-12-26 14:21:58,980][123091] Updated weights for policy 0, policy_version 1849546 (0.0006) [2023-12-26 14:21:59,527][123090] Updated weights for policy 1, policy_version 1837930 (0.0009) [2023-12-26 14:21:59,584][123090] Updated weights for policy 1, policy_version 1837940 (0.0010) [2023-12-26 14:21:59,646][123090] Updated weights for policy 1, policy_version 1837950 (0.0010) [2023-12-26 14:21:59,823][123091] Updated weights for policy 0, policy_version 1849556 (0.0009) [2023-12-26 14:21:59,878][123091] Updated weights for policy 0, policy_version 1849566 (0.0007) [2023-12-26 14:21:59,936][123091] Updated weights for policy 0, policy_version 1849576 (0.0007) [2023-12-26 14:22:00,464][123090] Updated weights for policy 1, policy_version 1837960 (0.0009) [2023-12-26 14:22:00,520][123090] Updated weights for policy 1, policy_version 1837970 (0.0005) [2023-12-26 14:22:00,591][123090] Updated weights for policy 1, policy_version 1837980 (0.0005) [2023-12-26 14:22:00,744][123091] Updated weights for policy 0, policy_version 1849586 (0.0010) [2023-12-26 14:22:00,801][123091] Updated weights for policy 0, policy_version 1849596 (0.0006) [2023-12-26 14:22:00,853][123091] Updated weights for policy 0, policy_version 1849606 (0.0005) [2023-12-26 14:22:00,899][123091] Updated weights for policy 0, policy_version 1849616 (0.0005) [2023-12-26 14:22:01,290][123090] Updated weights for policy 1, policy_version 1837990 (0.0008) [2023-12-26 14:22:01,351][123090] Updated weights for policy 1, policy_version 1838000 (0.0010) [2023-12-26 14:22:01,424][123090] Updated weights for policy 1, policy_version 1838010 (0.0009) [2023-12-26 14:22:01,627][123091] Updated weights for policy 0, policy_version 1849626 (0.0011) [2023-12-26 14:22:01,695][123091] Updated weights for policy 0, policy_version 1849636 (0.0011) [2023-12-26 14:22:01,760][123091] Updated weights for policy 0, policy_version 1849646 (0.0011) [2023-12-26 14:22:02,238][123090] Updated weights for policy 1, policy_version 1838020 (0.0010) [2023-12-26 14:22:02,295][123090] Updated weights for policy 1, policy_version 1838030 (0.0010) [2023-12-26 14:22:02,350][123090] Updated weights for policy 1, policy_version 1838040 (0.0010) [2023-12-26 14:22:02,562][123091] Updated weights for policy 0, policy_version 1849656 (0.0010) [2023-12-26 14:22:02,615][123091] Updated weights for policy 0, policy_version 1849666 (0.0009) [2023-12-26 14:22:02,670][123091] Updated weights for policy 0, policy_version 1849676 (0.0010) [2023-12-26 14:22:03,179][123090] Updated weights for policy 1, policy_version 1838050 (0.0008) [2023-12-26 14:22:03,242][123090] Updated weights for policy 1, policy_version 1838060 (0.0005) [2023-12-26 14:22:03,311][123090] Updated weights for policy 1, policy_version 1838070 (0.0005) [2023-12-26 14:22:03,368][123090] Updated weights for policy 1, policy_version 1838080 (0.0005) [2023-12-26 14:22:03,505][123091] Updated weights for policy 0, policy_version 1849686 (0.0010) [2023-12-26 14:22:03,571][123091] Updated weights for policy 0, policy_version 1849696 (0.0010) [2023-12-26 14:22:03,628][123091] Updated weights for policy 0, policy_version 1849706 (0.0009) [2023-12-26 14:22:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 944078848. Throughput: 0: 8823.8, 1: 8953.4. Samples: 944087240. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:03,784][121949] Avg episode reward: [(0, '6362.913'), (1, '5876.479')] [2023-12-26 14:22:04,142][123090] Updated weights for policy 1, policy_version 1838090 (0.0009) [2023-12-26 14:22:04,208][123090] Updated weights for policy 1, policy_version 1838100 (0.0010) [2023-12-26 14:22:04,271][123090] Updated weights for policy 1, policy_version 1838110 (0.0010) [2023-12-26 14:22:04,391][123091] Updated weights for policy 0, policy_version 1849716 (0.0009) [2023-12-26 14:22:04,453][123091] Updated weights for policy 0, policy_version 1849726 (0.0010) [2023-12-26 14:22:04,525][123091] Updated weights for policy 0, policy_version 1849736 (0.0010) [2023-12-26 14:22:05,108][123090] Updated weights for policy 1, policy_version 1838120 (0.0010) [2023-12-26 14:22:05,161][123090] Updated weights for policy 1, policy_version 1838131 (0.0010) [2023-12-26 14:22:05,221][123090] Updated weights for policy 1, policy_version 1838141 (0.0009) [2023-12-26 14:22:05,230][123091] Updated weights for policy 0, policy_version 1849746 (0.0010) [2023-12-26 14:22:05,279][123091] Updated weights for policy 0, policy_version 1849756 (0.0006) [2023-12-26 14:22:05,330][123091] Updated weights for policy 0, policy_version 1849766 (0.0006) [2023-12-26 14:22:05,379][123091] Updated weights for policy 0, policy_version 1849776 (0.0006) [2023-12-26 14:22:06,023][123091] Updated weights for policy 0, policy_version 1849786 (0.0009) [2023-12-26 14:22:06,043][123090] Updated weights for policy 1, policy_version 1838151 (0.0006) [2023-12-26 14:22:06,086][123091] Updated weights for policy 0, policy_version 1849796 (0.0011) [2023-12-26 14:22:06,115][123090] Updated weights for policy 1, policy_version 1838161 (0.0006) [2023-12-26 14:22:06,154][123091] Updated weights for policy 0, policy_version 1849806 (0.0009) [2023-12-26 14:22:06,181][123090] Updated weights for policy 1, policy_version 1838171 (0.0006) [2023-12-26 14:22:06,793][123090] Updated weights for policy 1, policy_version 1838181 (0.0007) [2023-12-26 14:22:06,860][123090] Updated weights for policy 1, policy_version 1838191 (0.0006) [2023-12-26 14:22:06,889][123091] Updated weights for policy 0, policy_version 1849816 (0.0010) [2023-12-26 14:22:06,927][123090] Updated weights for policy 1, policy_version 1838201 (0.0006) [2023-12-26 14:22:06,944][123091] Updated weights for policy 0, policy_version 1849826 (0.0011) [2023-12-26 14:22:07,011][123091] Updated weights for policy 0, policy_version 1849836 (0.0011) [2023-12-26 14:22:07,641][123090] Updated weights for policy 1, policy_version 1838211 (0.0005) [2023-12-26 14:22:07,695][123090] Updated weights for policy 1, policy_version 1838221 (0.0005) [2023-12-26 14:22:07,765][123090] Updated weights for policy 1, policy_version 1838231 (0.0005) [2023-12-26 14:22:07,891][123091] Updated weights for policy 0, policy_version 1849846 (0.0010) [2023-12-26 14:22:07,958][123091] Updated weights for policy 0, policy_version 1849856 (0.0009) [2023-12-26 14:22:08,026][123091] Updated weights for policy 0, policy_version 1849866 (0.0010) [2023-12-26 14:22:08,483][123090] Updated weights for policy 1, policy_version 1838241 (0.0005) [2023-12-26 14:22:08,555][123090] Updated weights for policy 1, policy_version 1838251 (0.0005) [2023-12-26 14:22:08,610][123090] Updated weights for policy 1, policy_version 1838261 (0.0005) [2023-12-26 14:22:08,668][123090] Updated weights for policy 1, policy_version 1838271 (0.0005) [2023-12-26 14:22:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 944168960. Throughput: 0: 8884.5, 1: 8925.5. Samples: 944142964. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:08,785][121949] Avg episode reward: [(0, '6316.098'), (1, '5723.307')] [2023-12-26 14:22:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001838272_470597632.pth... [2023-12-26 14:22:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001837248_470335488.pth [2023-12-26 14:22:08,825][123091] Updated weights for policy 0, policy_version 1849877 (0.0010) [2023-12-26 14:22:08,898][123091] Updated weights for policy 0, policy_version 1849887 (0.0009) [2023-12-26 14:22:08,974][123091] Updated weights for policy 0, policy_version 1849897 (0.0009) [2023-12-26 14:22:09,026][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001849904_473579520.pth... [2023-12-26 14:22:09,031][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001848848_473309184.pth [2023-12-26 14:22:09,288][123090] Updated weights for policy 1, policy_version 1838281 (0.0009) [2023-12-26 14:22:09,361][123090] Updated weights for policy 1, policy_version 1838291 (0.0007) [2023-12-26 14:22:09,429][123090] Updated weights for policy 1, policy_version 1838301 (0.0006) [2023-12-26 14:22:09,800][123091] Updated weights for policy 0, policy_version 1849907 (0.0009) [2023-12-26 14:22:09,877][123091] Updated weights for policy 0, policy_version 1849917 (0.0008) [2023-12-26 14:22:09,946][123091] Updated weights for policy 0, policy_version 1849927 (0.0008) [2023-12-26 14:22:10,135][123090] Updated weights for policy 1, policy_version 1838311 (0.0005) [2023-12-26 14:22:10,186][123090] Updated weights for policy 1, policy_version 1838321 (0.0005) [2023-12-26 14:22:10,249][123090] Updated weights for policy 1, policy_version 1838331 (0.0005) [2023-12-26 14:22:10,654][123091] Updated weights for policy 0, policy_version 1849937 (0.0011) [2023-12-26 14:22:10,700][123091] Updated weights for policy 0, policy_version 1849947 (0.0007) [2023-12-26 14:22:10,756][123091] Updated weights for policy 0, policy_version 1849957 (0.0006) [2023-12-26 14:22:10,823][123091] Updated weights for policy 0, policy_version 1849967 (0.0005) [2023-12-26 14:22:11,019][123090] Updated weights for policy 1, policy_version 1838341 (0.0006) [2023-12-26 14:22:11,095][123090] Updated weights for policy 1, policy_version 1838351 (0.0010) [2023-12-26 14:22:11,174][123090] Updated weights for policy 1, policy_version 1838361 (0.0008) [2023-12-26 14:22:11,610][123091] Updated weights for policy 0, policy_version 1849977 (0.0010) [2023-12-26 14:22:11,677][123091] Updated weights for policy 0, policy_version 1849987 (0.0010) [2023-12-26 14:22:11,744][123091] Updated weights for policy 0, policy_version 1849997 (0.0007) [2023-12-26 14:22:12,003][123090] Updated weights for policy 1, policy_version 1838371 (0.0008) [2023-12-26 14:22:12,078][123090] Updated weights for policy 1, policy_version 1838381 (0.0006) [2023-12-26 14:22:12,142][123090] Updated weights for policy 1, policy_version 1838391 (0.0009) [2023-12-26 14:22:12,512][123091] Updated weights for policy 0, policy_version 1850007 (0.0010) [2023-12-26 14:22:12,562][123091] Updated weights for policy 0, policy_version 1850017 (0.0009) [2023-12-26 14:22:12,615][123091] Updated weights for policy 0, policy_version 1850027 (0.0008) [2023-12-26 14:22:12,932][123090] Updated weights for policy 1, policy_version 1838401 (0.0010) [2023-12-26 14:22:12,996][123090] Updated weights for policy 1, policy_version 1838411 (0.0009) [2023-12-26 14:22:13,058][123090] Updated weights for policy 1, policy_version 1838421 (0.0010) [2023-12-26 14:22:13,115][123090] Updated weights for policy 1, policy_version 1838431 (0.0009) [2023-12-26 14:22:13,416][123091] Updated weights for policy 0, policy_version 1850037 (0.0007) [2023-12-26 14:22:13,462][123091] Updated weights for policy 0, policy_version 1850047 (0.0005) [2023-12-26 14:22:13,511][123091] Updated weights for policy 0, policy_version 1850058 (0.0006) [2023-12-26 14:22:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 944259072. Throughput: 0: 8874.6, 1: 9022.3. Samples: 944252952. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:13,784][121949] Avg episode reward: [(0, '6199.770'), (1, '5748.529')] [2023-12-26 14:22:13,986][123090] Updated weights for policy 1, policy_version 1838441 (0.0010) [2023-12-26 14:22:14,038][123090] Updated weights for policy 1, policy_version 1838451 (0.0008) [2023-12-26 14:22:14,099][123090] Updated weights for policy 1, policy_version 1838461 (0.0009) [2023-12-26 14:22:14,320][123091] Updated weights for policy 0, policy_version 1850068 (0.0009) [2023-12-26 14:22:14,376][123091] Updated weights for policy 0, policy_version 1850078 (0.0009) [2023-12-26 14:22:14,435][123091] Updated weights for policy 0, policy_version 1850088 (0.0009) [2023-12-26 14:22:14,933][123090] Updated weights for policy 1, policy_version 1838471 (0.0009) [2023-12-26 14:22:14,992][123090] Updated weights for policy 1, policy_version 1838481 (0.0007) [2023-12-26 14:22:15,052][123090] Updated weights for policy 1, policy_version 1838491 (0.0006) [2023-12-26 14:22:15,253][123091] Updated weights for policy 0, policy_version 1850098 (0.0009) [2023-12-26 14:22:15,306][123091] Updated weights for policy 0, policy_version 1850108 (0.0006) [2023-12-26 14:22:15,368][123091] Updated weights for policy 0, policy_version 1850118 (0.0009) [2023-12-26 14:22:15,420][123091] Updated weights for policy 0, policy_version 1850128 (0.0010) [2023-12-26 14:22:15,801][123090] Updated weights for policy 1, policy_version 1838501 (0.0009) [2023-12-26 14:22:15,858][123090] Updated weights for policy 1, policy_version 1838511 (0.0010) [2023-12-26 14:22:15,911][123090] Updated weights for policy 1, policy_version 1838521 (0.0009) [2023-12-26 14:22:16,255][123091] Updated weights for policy 0, policy_version 1850138 (0.0005) [2023-12-26 14:22:16,305][123091] Updated weights for policy 0, policy_version 1850148 (0.0005) [2023-12-26 14:22:16,360][123091] Updated weights for policy 0, policy_version 1850158 (0.0005) [2023-12-26 14:22:16,623][123090] Updated weights for policy 1, policy_version 1838531 (0.0008) [2023-12-26 14:22:16,682][123090] Updated weights for policy 1, policy_version 1838541 (0.0009) [2023-12-26 14:22:16,752][123090] Updated weights for policy 1, policy_version 1838551 (0.0006) [2023-12-26 14:22:17,108][123091] Updated weights for policy 0, policy_version 1850168 (0.0008) [2023-12-26 14:22:17,171][123091] Updated weights for policy 0, policy_version 1850178 (0.0009) [2023-12-26 14:22:17,235][123091] Updated weights for policy 0, policy_version 1850188 (0.0009) [2023-12-26 14:22:17,424][123090] Updated weights for policy 1, policy_version 1838561 (0.0006) [2023-12-26 14:22:17,479][123090] Updated weights for policy 1, policy_version 1838571 (0.0010) [2023-12-26 14:22:17,538][123090] Updated weights for policy 1, policy_version 1838581 (0.0010) [2023-12-26 14:22:17,608][123090] Updated weights for policy 1, policy_version 1838591 (0.0010) [2023-12-26 14:22:18,049][123091] Updated weights for policy 0, policy_version 1850198 (0.0009) [2023-12-26 14:22:18,123][123091] Updated weights for policy 0, policy_version 1850208 (0.0009) [2023-12-26 14:22:18,182][123091] Updated weights for policy 0, policy_version 1850218 (0.0009) [2023-12-26 14:22:18,439][123090] Updated weights for policy 1, policy_version 1838601 (0.0010) [2023-12-26 14:22:18,502][123090] Updated weights for policy 1, policy_version 1838611 (0.0010) [2023-12-26 14:22:18,563][123090] Updated weights for policy 1, policy_version 1838621 (0.0010) [2023-12-26 14:22:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 944349184. Throughput: 0: 8816.4, 1: 8978.2. Samples: 944359324. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:18,785][121949] Avg episode reward: [(0, '6244.445'), (1, '5822.527')] [2023-12-26 14:22:18,967][123091] Updated weights for policy 0, policy_version 1850228 (0.0008) [2023-12-26 14:22:19,031][123091] Updated weights for policy 0, policy_version 1850238 (0.0011) [2023-12-26 14:22:19,083][123091] Updated weights for policy 0, policy_version 1850248 (0.0010) [2023-12-26 14:22:19,417][123090] Updated weights for policy 1, policy_version 1838631 (0.0010) [2023-12-26 14:22:19,466][123090] Updated weights for policy 1, policy_version 1838641 (0.0010) [2023-12-26 14:22:19,532][123090] Updated weights for policy 1, policy_version 1838651 (0.0010) [2023-12-26 14:22:19,964][123091] Updated weights for policy 0, policy_version 1850258 (0.0011) [2023-12-26 14:22:20,028][123091] Updated weights for policy 0, policy_version 1850268 (0.0011) [2023-12-26 14:22:20,095][123091] Updated weights for policy 0, policy_version 1850278 (0.0011) [2023-12-26 14:22:20,162][123091] Updated weights for policy 0, policy_version 1850288 (0.0011) [2023-12-26 14:22:20,376][123090] Updated weights for policy 1, policy_version 1838661 (0.0010) [2023-12-26 14:22:20,449][123090] Updated weights for policy 1, policy_version 1838671 (0.0009) [2023-12-26 14:22:20,522][123090] Updated weights for policy 1, policy_version 1838681 (0.0010) [2023-12-26 14:22:20,943][123091] Updated weights for policy 0, policy_version 1850298 (0.0011) [2023-12-26 14:22:21,013][123091] Updated weights for policy 0, policy_version 1850308 (0.0009) [2023-12-26 14:22:21,085][123091] Updated weights for policy 0, policy_version 1850318 (0.0010) [2023-12-26 14:22:21,382][123090] Updated weights for policy 1, policy_version 1838691 (0.0010) [2023-12-26 14:22:21,439][123090] Updated weights for policy 1, policy_version 1838701 (0.0011) [2023-12-26 14:22:21,500][123090] Updated weights for policy 1, policy_version 1838711 (0.0011) [2023-12-26 14:22:21,930][123091] Updated weights for policy 0, policy_version 1850328 (0.0006) [2023-12-26 14:22:21,977][123091] Updated weights for policy 0, policy_version 1850338 (0.0006) [2023-12-26 14:22:22,033][123091] Updated weights for policy 0, policy_version 1850348 (0.0006) [2023-12-26 14:22:22,333][123090] Updated weights for policy 1, policy_version 1838721 (0.0010) [2023-12-26 14:22:22,400][123090] Updated weights for policy 1, policy_version 1838731 (0.0008) [2023-12-26 14:22:22,467][123090] Updated weights for policy 1, policy_version 1838741 (0.0008) [2023-12-26 14:22:22,533][123090] Updated weights for policy 1, policy_version 1838751 (0.0008) [2023-12-26 14:22:22,808][123091] Updated weights for policy 0, policy_version 1850358 (0.0009) [2023-12-26 14:22:22,871][123091] Updated weights for policy 0, policy_version 1850368 (0.0011) [2023-12-26 14:22:22,918][123091] Updated weights for policy 0, policy_version 1850378 (0.0010) [2023-12-26 14:22:23,364][123090] Updated weights for policy 1, policy_version 1838761 (0.0005) [2023-12-26 14:22:23,410][123090] Updated weights for policy 1, policy_version 1838771 (0.0005) [2023-12-26 14:22:23,456][123090] Updated weights for policy 1, policy_version 1838781 (0.0005) [2023-12-26 14:22:23,664][123091] Updated weights for policy 0, policy_version 1850388 (0.0008) [2023-12-26 14:22:23,711][123091] Updated weights for policy 0, policy_version 1850398 (0.0005) [2023-12-26 14:22:23,761][123091] Updated weights for policy 0, policy_version 1850408 (0.0006) [2023-12-26 14:22:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 944431104. Throughput: 0: 8790.3, 1: 8879.7. Samples: 944409360. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:23,785][121949] Avg episode reward: [(0, '6398.277'), (1, '6030.149')] [2023-12-26 14:22:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001838784_470728704.pth... [2023-12-26 14:22:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001837728_470458368.pth [2023-12-26 14:22:23,807][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001850416_473710592.pth... [2023-12-26 14:22:23,810][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001849360_473440256.pth [2023-12-26 14:22:24,164][123090] Updated weights for policy 1, policy_version 1838791 (0.0005) [2023-12-26 14:22:24,233][123090] Updated weights for policy 1, policy_version 1838801 (0.0005) [2023-12-26 14:22:24,301][123090] Updated weights for policy 1, policy_version 1838811 (0.0007) [2023-12-26 14:22:24,533][123091] Updated weights for policy 0, policy_version 1850418 (0.0007) [2023-12-26 14:22:24,612][123091] Updated weights for policy 0, policy_version 1850428 (0.0011) [2023-12-26 14:22:24,673][123091] Updated weights for policy 0, policy_version 1850438 (0.0011) [2023-12-26 14:22:24,732][123091] Updated weights for policy 0, policy_version 1850448 (0.0011) [2023-12-26 14:22:24,942][123090] Updated weights for policy 1, policy_version 1838821 (0.0007) [2023-12-26 14:22:25,000][123090] Updated weights for policy 1, policy_version 1838831 (0.0006) [2023-12-26 14:22:25,078][123090] Updated weights for policy 1, policy_version 1838841 (0.0006) [2023-12-26 14:22:25,555][123091] Updated weights for policy 0, policy_version 1850458 (0.0011) [2023-12-26 14:22:25,599][123091] Updated weights for policy 0, policy_version 1850468 (0.0010) [2023-12-26 14:22:25,647][123091] Updated weights for policy 0, policy_version 1850478 (0.0010) [2023-12-26 14:22:25,843][123090] Updated weights for policy 1, policy_version 1838851 (0.0010) [2023-12-26 14:22:25,901][123090] Updated weights for policy 1, policy_version 1838861 (0.0009) [2023-12-26 14:22:25,956][123090] Updated weights for policy 1, policy_version 1838871 (0.0008) [2023-12-26 14:22:26,426][123091] Updated weights for policy 0, policy_version 1850488 (0.0007) [2023-12-26 14:22:26,490][123091] Updated weights for policy 0, policy_version 1850498 (0.0006) [2023-12-26 14:22:26,541][123091] Updated weights for policy 0, policy_version 1850508 (0.0005) [2023-12-26 14:22:26,812][123090] Updated weights for policy 1, policy_version 1838881 (0.0010) [2023-12-26 14:22:26,860][123090] Updated weights for policy 1, policy_version 1838891 (0.0010) [2023-12-26 14:22:26,908][123090] Updated weights for policy 1, policy_version 1838901 (0.0010) [2023-12-26 14:22:26,956][123090] Updated weights for policy 1, policy_version 1838911 (0.0010) [2023-12-26 14:22:27,276][123091] Updated weights for policy 0, policy_version 1850518 (0.0007) [2023-12-26 14:22:27,333][123091] Updated weights for policy 0, policy_version 1850528 (0.0009) [2023-12-26 14:22:27,391][123091] Updated weights for policy 0, policy_version 1850538 (0.0009) [2023-12-26 14:22:27,798][123090] Updated weights for policy 1, policy_version 1838921 (0.0010) [2023-12-26 14:22:27,850][123090] Updated weights for policy 1, policy_version 1838931 (0.0010) [2023-12-26 14:22:27,896][123090] Updated weights for policy 1, policy_version 1838941 (0.0010) [2023-12-26 14:22:28,212][123091] Updated weights for policy 0, policy_version 1850548 (0.0009) [2023-12-26 14:22:28,267][123091] Updated weights for policy 0, policy_version 1850558 (0.0010) [2023-12-26 14:22:28,323][123091] Updated weights for policy 0, policy_version 1850568 (0.0011) [2023-12-26 14:22:28,773][123090] Updated weights for policy 1, policy_version 1838951 (0.0009) [2023-12-26 14:22:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 944521216. Throughput: 0: 8868.4, 1: 8915.0. Samples: 944518588. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:28,785][121949] Avg episode reward: [(0, '6412.920'), (1, '5993.387')] [2023-12-26 14:22:28,853][123090] Updated weights for policy 1, policy_version 1838961 (0.0005) [2023-12-26 14:22:28,930][123090] Updated weights for policy 1, policy_version 1838971 (0.0006) [2023-12-26 14:22:29,078][123091] Updated weights for policy 0, policy_version 1850578 (0.0010) [2023-12-26 14:22:29,130][123091] Updated weights for policy 0, policy_version 1850588 (0.0005) [2023-12-26 14:22:29,174][123091] Updated weights for policy 0, policy_version 1850598 (0.0005) [2023-12-26 14:22:29,224][123091] Updated weights for policy 0, policy_version 1850608 (0.0006) [2023-12-26 14:22:29,638][123090] Updated weights for policy 1, policy_version 1838981 (0.0005) [2023-12-26 14:22:29,719][123090] Updated weights for policy 1, policy_version 1838991 (0.0006) [2023-12-26 14:22:29,800][123090] Updated weights for policy 1, policy_version 1839001 (0.0006) [2023-12-26 14:22:29,996][123091] Updated weights for policy 0, policy_version 1850618 (0.0010) [2023-12-26 14:22:30,057][123091] Updated weights for policy 0, policy_version 1850628 (0.0007) [2023-12-26 14:22:30,120][123091] Updated weights for policy 0, policy_version 1850638 (0.0005) [2023-12-26 14:22:30,620][123090] Updated weights for policy 1, policy_version 1839011 (0.0008) [2023-12-26 14:22:30,679][123090] Updated weights for policy 1, policy_version 1839021 (0.0010) [2023-12-26 14:22:30,733][123090] Updated weights for policy 1, policy_version 1839031 (0.0010) [2023-12-26 14:22:30,814][123091] Updated weights for policy 0, policy_version 1850648 (0.0005) [2023-12-26 14:22:30,886][123091] Updated weights for policy 0, policy_version 1850658 (0.0005) [2023-12-26 14:22:30,948][123091] Updated weights for policy 0, policy_version 1850668 (0.0005) [2023-12-26 14:22:31,604][123090] Updated weights for policy 1, policy_version 1839041 (0.0009) [2023-12-26 14:22:31,620][123091] Updated weights for policy 0, policy_version 1850678 (0.0009) [2023-12-26 14:22:31,669][123090] Updated weights for policy 1, policy_version 1839051 (0.0008) [2023-12-26 14:22:31,686][123091] Updated weights for policy 0, policy_version 1850688 (0.0009) [2023-12-26 14:22:31,738][123090] Updated weights for policy 1, policy_version 1839061 (0.0008) [2023-12-26 14:22:31,758][123091] Updated weights for policy 0, policy_version 1850698 (0.0009) [2023-12-26 14:22:31,795][123090] Updated weights for policy 1, policy_version 1839071 (0.0005) [2023-12-26 14:22:32,569][123091] Updated weights for policy 0, policy_version 1850708 (0.0009) [2023-12-26 14:22:32,644][123091] Updated weights for policy 0, policy_version 1850718 (0.0009) [2023-12-26 14:22:32,664][123090] Updated weights for policy 1, policy_version 1839081 (0.0007) [2023-12-26 14:22:32,710][123091] Updated weights for policy 0, policy_version 1850728 (0.0009) [2023-12-26 14:22:32,727][123090] Updated weights for policy 1, policy_version 1839091 (0.0005) [2023-12-26 14:22:32,793][123090] Updated weights for policy 1, policy_version 1839101 (0.0006) [2023-12-26 14:22:33,388][123091] Updated weights for policy 0, policy_version 1850738 (0.0009) [2023-12-26 14:22:33,446][123091] Updated weights for policy 0, policy_version 1850748 (0.0008) [2023-12-26 14:22:33,507][123091] Updated weights for policy 0, policy_version 1850758 (0.0007) [2023-12-26 14:22:33,507][123090] Updated weights for policy 1, policy_version 1839111 (0.0010) [2023-12-26 14:22:33,557][123091] Updated weights for policy 0, policy_version 1850768 (0.0008) [2023-12-26 14:22:33,569][123090] Updated weights for policy 1, policy_version 1839121 (0.0010) [2023-12-26 14:22:33,631][123090] Updated weights for policy 1, policy_version 1839131 (0.0010) [2023-12-26 14:22:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 944619520. Throughput: 0: 8968.1, 1: 8908.0. Samples: 944627172. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:33,785][121949] Avg episode reward: [(0, '6349.785'), (1, '5841.880')] [2023-12-26 14:22:34,302][123090] Updated weights for policy 1, policy_version 1839141 (0.0006) [2023-12-26 14:22:34,360][123090] Updated weights for policy 1, policy_version 1839151 (0.0006) [2023-12-26 14:22:34,420][123091] Updated weights for policy 0, policy_version 1850778 (0.0009) [2023-12-26 14:22:34,432][123090] Updated weights for policy 1, policy_version 1839161 (0.0008) [2023-12-26 14:22:34,489][123091] Updated weights for policy 0, policy_version 1850788 (0.0009) [2023-12-26 14:22:34,560][123091] Updated weights for policy 0, policy_version 1850798 (0.0009) [2023-12-26 14:22:35,201][123090] Updated weights for policy 1, policy_version 1839171 (0.0008) [2023-12-26 14:22:35,265][123090] Updated weights for policy 1, policy_version 1839181 (0.0010) [2023-12-26 14:22:35,318][123090] Updated weights for policy 1, policy_version 1839191 (0.0010) [2023-12-26 14:22:35,378][123091] Updated weights for policy 0, policy_version 1850808 (0.0006) [2023-12-26 14:22:35,446][123091] Updated weights for policy 0, policy_version 1850818 (0.0005) [2023-12-26 14:22:35,510][123091] Updated weights for policy 0, policy_version 1850828 (0.0005) [2023-12-26 14:22:36,027][123091] Updated weights for policy 0, policy_version 1850838 (0.0005) [2023-12-26 14:22:36,078][123091] Updated weights for policy 0, policy_version 1850848 (0.0005) [2023-12-26 14:22:36,137][123091] Updated weights for policy 0, policy_version 1850858 (0.0008) [2023-12-26 14:22:36,248][123090] Updated weights for policy 1, policy_version 1839201 (0.0009) [2023-12-26 14:22:36,316][123090] Updated weights for policy 1, policy_version 1839211 (0.0009) [2023-12-26 14:22:36,380][123090] Updated weights for policy 1, policy_version 1839221 (0.0010) [2023-12-26 14:22:36,450][123090] Updated weights for policy 1, policy_version 1839231 (0.0009) [2023-12-26 14:22:36,996][123091] Updated weights for policy 0, policy_version 1850868 (0.0009) [2023-12-26 14:22:37,051][123091] Updated weights for policy 0, policy_version 1850878 (0.0009) [2023-12-26 14:22:37,115][123091] Updated weights for policy 0, policy_version 1850888 (0.0008) [2023-12-26 14:22:37,260][123090] Updated weights for policy 1, policy_version 1839241 (0.0009) [2023-12-26 14:22:37,334][123090] Updated weights for policy 1, policy_version 1839251 (0.0009) [2023-12-26 14:22:37,396][123090] Updated weights for policy 1, policy_version 1839261 (0.0010) [2023-12-26 14:22:37,954][123091] Updated weights for policy 0, policy_version 1850898 (0.0010) [2023-12-26 14:22:38,004][123091] Updated weights for policy 0, policy_version 1850908 (0.0010) [2023-12-26 14:22:38,053][123091] Updated weights for policy 0, policy_version 1850918 (0.0009) [2023-12-26 14:22:38,103][123091] Updated weights for policy 0, policy_version 1850928 (0.0009) [2023-12-26 14:22:38,194][123090] Updated weights for policy 1, policy_version 1839271 (0.0010) [2023-12-26 14:22:38,251][123090] Updated weights for policy 1, policy_version 1839281 (0.0010) [2023-12-26 14:22:38,320][123090] Updated weights for policy 1, policy_version 1839291 (0.0009) [2023-12-26 14:22:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 944701440. Throughput: 0: 8983.5, 1: 8929.2. Samples: 944680744. Policy #0 lag: (min: 17.0, avg: 32.9, max: 49.0) [2023-12-26 14:22:38,785][121949] Avg episode reward: [(0, '6417.076'), (1, '5835.556')] [2023-12-26 14:22:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001850928_473841664.pth... [2023-12-26 14:22:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001839296_470859776.pth... [2023-12-26 14:22:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001838272_470597632.pth [2023-12-26 14:22:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001849904_473579520.pth [2023-12-26 14:22:39,027][123091] Updated weights for policy 0, policy_version 1850938 (0.0010) [2023-12-26 14:22:39,075][123090] Updated weights for policy 1, policy_version 1839301 (0.0008) [2023-12-26 14:22:39,082][123091] Updated weights for policy 0, policy_version 1850948 (0.0009) [2023-12-26 14:22:39,121][123090] Updated weights for policy 1, policy_version 1839311 (0.0008) [2023-12-26 14:22:39,147][123091] Updated weights for policy 0, policy_version 1850958 (0.0007) [2023-12-26 14:22:39,169][123090] Updated weights for policy 1, policy_version 1839321 (0.0009) [2023-12-26 14:22:39,997][123090] Updated weights for policy 1, policy_version 1839331 (0.0008) [2023-12-26 14:22:40,025][123091] Updated weights for policy 0, policy_version 1850968 (0.0009) [2023-12-26 14:22:40,063][123090] Updated weights for policy 1, policy_version 1839341 (0.0009) [2023-12-26 14:22:40,075][123091] Updated weights for policy 0, policy_version 1850978 (0.0008) [2023-12-26 14:22:40,131][123090] Updated weights for policy 1, policy_version 1839351 (0.0010) [2023-12-26 14:22:40,133][123091] Updated weights for policy 0, policy_version 1850988 (0.0009) [2023-12-26 14:22:40,954][123090] Updated weights for policy 1, policy_version 1839361 (0.0008) [2023-12-26 14:22:40,979][123091] Updated weights for policy 0, policy_version 1850998 (0.0008) [2023-12-26 14:22:41,011][123090] Updated weights for policy 1, policy_version 1839371 (0.0006) [2023-12-26 14:22:41,058][123091] Updated weights for policy 0, policy_version 1851008 (0.0008) [2023-12-26 14:22:41,081][123090] Updated weights for policy 1, policy_version 1839381 (0.0008) [2023-12-26 14:22:41,127][123091] Updated weights for policy 0, policy_version 1851018 (0.0008) [2023-12-26 14:22:41,150][123090] Updated weights for policy 1, policy_version 1839391 (0.0008) [2023-12-26 14:22:41,996][123091] Updated weights for policy 0, policy_version 1851028 (0.0008) [2023-12-26 14:22:42,015][123090] Updated weights for policy 1, policy_version 1839401 (0.0008) [2023-12-26 14:22:42,061][123091] Updated weights for policy 0, policy_version 1851038 (0.0009) [2023-12-26 14:22:42,086][123090] Updated weights for policy 1, policy_version 1839411 (0.0007) [2023-12-26 14:22:42,127][123091] Updated weights for policy 0, policy_version 1851048 (0.0011) [2023-12-26 14:22:42,151][123090] Updated weights for policy 1, policy_version 1839421 (0.0007) [2023-12-26 14:22:42,955][123091] Updated weights for policy 0, policy_version 1851058 (0.0010) [2023-12-26 14:22:42,975][123090] Updated weights for policy 1, policy_version 1839431 (0.0008) [2023-12-26 14:22:43,017][123091] Updated weights for policy 0, policy_version 1851068 (0.0009) [2023-12-26 14:22:43,040][123090] Updated weights for policy 1, policy_version 1839441 (0.0009) [2023-12-26 14:22:43,077][123091] Updated weights for policy 0, policy_version 1851078 (0.0006) [2023-12-26 14:22:43,102][123090] Updated weights for policy 1, policy_version 1839451 (0.0010) [2023-12-26 14:22:43,139][123091] Updated weights for policy 0, policy_version 1851088 (0.0007) [2023-12-26 14:22:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 944783360. Throughput: 0: 8908.7, 1: 8853.8. Samples: 944781888. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:22:43,785][121949] Avg episode reward: [(0, '6380.366'), (1, '5979.382')] [2023-12-26 14:22:43,870][123091] Updated weights for policy 0, policy_version 1851098 (0.0005) [2023-12-26 14:22:43,872][123090] Updated weights for policy 1, policy_version 1839461 (0.0008) [2023-12-26 14:22:43,924][123091] Updated weights for policy 0, policy_version 1851108 (0.0005) [2023-12-26 14:22:43,940][123090] Updated weights for policy 1, policy_version 1839471 (0.0008) [2023-12-26 14:22:43,981][123091] Updated weights for policy 0, policy_version 1851118 (0.0005) [2023-12-26 14:22:43,998][123090] Updated weights for policy 1, policy_version 1839481 (0.0010) [2023-12-26 14:22:44,694][123091] Updated weights for policy 0, policy_version 1851128 (0.0009) [2023-12-26 14:22:44,758][123090] Updated weights for policy 1, policy_version 1839491 (0.0009) [2023-12-26 14:22:44,761][123091] Updated weights for policy 0, policy_version 1851138 (0.0009) [2023-12-26 14:22:44,815][123091] Updated weights for policy 0, policy_version 1851148 (0.0009) [2023-12-26 14:22:44,819][123090] Updated weights for policy 1, policy_version 1839501 (0.0007) [2023-12-26 14:22:44,881][123090] Updated weights for policy 1, policy_version 1839511 (0.0010) [2023-12-26 14:22:45,664][123090] Updated weights for policy 1, policy_version 1839521 (0.0010) [2023-12-26 14:22:45,714][123091] Updated weights for policy 0, policy_version 1851158 (0.0008) [2023-12-26 14:22:45,718][123090] Updated weights for policy 1, policy_version 1839531 (0.0005) [2023-12-26 14:22:45,770][123091] Updated weights for policy 0, policy_version 1851168 (0.0009) [2023-12-26 14:22:45,773][123090] Updated weights for policy 1, policy_version 1839541 (0.0007) [2023-12-26 14:22:45,822][123091] Updated weights for policy 0, policy_version 1851178 (0.0006) [2023-12-26 14:22:45,825][123090] Updated weights for policy 1, policy_version 1839551 (0.0010) [2023-12-26 14:22:46,529][123091] Updated weights for policy 0, policy_version 1851188 (0.0007) [2023-12-26 14:22:46,585][123091] Updated weights for policy 0, policy_version 1851198 (0.0009) [2023-12-26 14:22:46,654][123091] Updated weights for policy 0, policy_version 1851208 (0.0010) [2023-12-26 14:22:46,662][123090] Updated weights for policy 1, policy_version 1839561 (0.0010) [2023-12-26 14:22:46,727][123090] Updated weights for policy 1, policy_version 1839571 (0.0008) [2023-12-26 14:22:46,796][123090] Updated weights for policy 1, policy_version 1839581 (0.0005) [2023-12-26 14:22:47,367][123091] Updated weights for policy 0, policy_version 1851218 (0.0010) [2023-12-26 14:22:47,422][123091] Updated weights for policy 0, policy_version 1851228 (0.0010) [2023-12-26 14:22:47,422][123090] Updated weights for policy 1, policy_version 1839591 (0.0005) [2023-12-26 14:22:47,467][123091] Updated weights for policy 0, policy_version 1851238 (0.0010) [2023-12-26 14:22:47,489][123090] Updated weights for policy 1, policy_version 1839601 (0.0005) [2023-12-26 14:22:47,511][123091] Updated weights for policy 0, policy_version 1851248 (0.0010) [2023-12-26 14:22:47,555][123090] Updated weights for policy 1, policy_version 1839611 (0.0005) [2023-12-26 14:22:48,155][123091] Updated weights for policy 0, policy_version 1851258 (0.0007) [2023-12-26 14:22:48,221][123091] Updated weights for policy 0, policy_version 1851268 (0.0008) [2023-12-26 14:22:48,283][123091] Updated weights for policy 0, policy_version 1851278 (0.0008) [2023-12-26 14:22:48,284][123090] Updated weights for policy 1, policy_version 1839621 (0.0008) [2023-12-26 14:22:48,346][123090] Updated weights for policy 1, policy_version 1839631 (0.0010) [2023-12-26 14:22:48,407][123090] Updated weights for policy 1, policy_version 1839641 (0.0011) [2023-12-26 14:22:48,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 944881664. Throughput: 0: 9019.4, 1: 8916.6. Samples: 944894364. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:22:48,785][121949] Avg episode reward: [(0, '6374.290'), (1, '5872.816')] [2023-12-26 14:22:48,959][123091] Updated weights for policy 0, policy_version 1851288 (0.0006) [2023-12-26 14:22:49,010][123091] Updated weights for policy 0, policy_version 1851298 (0.0005) [2023-12-26 14:22:49,067][123091] Updated weights for policy 0, policy_version 1851308 (0.0005) [2023-12-26 14:22:49,242][123090] Updated weights for policy 1, policy_version 1839651 (0.0010) [2023-12-26 14:22:49,312][123090] Updated weights for policy 1, policy_version 1839661 (0.0011) [2023-12-26 14:22:49,379][123090] Updated weights for policy 1, policy_version 1839671 (0.0010) [2023-12-26 14:22:49,803][123091] Updated weights for policy 0, policy_version 1851318 (0.0008) [2023-12-26 14:22:49,867][123091] Updated weights for policy 0, policy_version 1851328 (0.0008) [2023-12-26 14:22:49,941][123091] Updated weights for policy 0, policy_version 1851338 (0.0009) [2023-12-26 14:22:50,180][123090] Updated weights for policy 1, policy_version 1839681 (0.0010) [2023-12-26 14:22:50,251][123090] Updated weights for policy 1, policy_version 1839691 (0.0010) [2023-12-26 14:22:50,318][123090] Updated weights for policy 1, policy_version 1839701 (0.0010) [2023-12-26 14:22:50,381][123090] Updated weights for policy 1, policy_version 1839711 (0.0010) [2023-12-26 14:22:50,685][123091] Updated weights for policy 0, policy_version 1851348 (0.0007) [2023-12-26 14:22:50,739][123091] Updated weights for policy 0, policy_version 1851358 (0.0008) [2023-12-26 14:22:50,788][123091] Updated weights for policy 0, policy_version 1851368 (0.0008) [2023-12-26 14:22:51,178][123090] Updated weights for policy 1, policy_version 1839721 (0.0010) [2023-12-26 14:22:51,226][123090] Updated weights for policy 1, policy_version 1839731 (0.0010) [2023-12-26 14:22:51,287][123090] Updated weights for policy 1, policy_version 1839741 (0.0011) [2023-12-26 14:22:51,569][123091] Updated weights for policy 0, policy_version 1851378 (0.0008) [2023-12-26 14:22:51,643][123091] Updated weights for policy 0, policy_version 1851388 (0.0009) [2023-12-26 14:22:51,706][123091] Updated weights for policy 0, policy_version 1851398 (0.0008) [2023-12-26 14:22:51,775][123091] Updated weights for policy 0, policy_version 1851408 (0.0009) [2023-12-26 14:22:52,158][123090] Updated weights for policy 1, policy_version 1839751 (0.0010) [2023-12-26 14:22:52,213][123090] Updated weights for policy 1, policy_version 1839761 (0.0010) [2023-12-26 14:22:52,276][123090] Updated weights for policy 1, policy_version 1839771 (0.0010) [2023-12-26 14:22:52,586][123091] Updated weights for policy 0, policy_version 1851418 (0.0010) [2023-12-26 14:22:52,652][123091] Updated weights for policy 0, policy_version 1851428 (0.0010) [2023-12-26 14:22:52,719][123091] Updated weights for policy 0, policy_version 1851438 (0.0009) [2023-12-26 14:22:53,129][123090] Updated weights for policy 1, policy_version 1839781 (0.0010) [2023-12-26 14:22:53,176][123090] Updated weights for policy 1, policy_version 1839791 (0.0010) [2023-12-26 14:22:53,228][123090] Updated weights for policy 1, policy_version 1839801 (0.0010) [2023-12-26 14:22:53,505][123091] Updated weights for policy 0, policy_version 1851448 (0.0006) [2023-12-26 14:22:53,555][123091] Updated weights for policy 0, policy_version 1851458 (0.0005) [2023-12-26 14:22:53,602][123091] Updated weights for policy 0, policy_version 1851468 (0.0005) [2023-12-26 14:22:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 944971776. Throughput: 0: 8994.0, 1: 8887.9. Samples: 944947652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:22:53,785][121949] Avg episode reward: [(0, '6265.196'), (1, '5855.649')] [2023-12-26 14:22:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001851472_473980928.pth... [2023-12-26 14:22:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001839808_470990848.pth... [2023-12-26 14:22:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001850416_473710592.pth [2023-12-26 14:22:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001838784_470728704.pth [2023-12-26 14:22:53,931][123090] Updated weights for policy 1, policy_version 1839811 (0.0009) [2023-12-26 14:22:53,980][123090] Updated weights for policy 1, policy_version 1839821 (0.0005) [2023-12-26 14:22:54,030][123090] Updated weights for policy 1, policy_version 1839831 (0.0005) [2023-12-26 14:22:54,236][123091] Updated weights for policy 0, policy_version 1851478 (0.0008) [2023-12-26 14:22:54,310][123091] Updated weights for policy 0, policy_version 1851488 (0.0010) [2023-12-26 14:22:54,373][123091] Updated weights for policy 0, policy_version 1851498 (0.0009) [2023-12-26 14:22:54,875][123090] Updated weights for policy 1, policy_version 1839841 (0.0008) [2023-12-26 14:22:54,941][123090] Updated weights for policy 1, policy_version 1839851 (0.0010) [2023-12-26 14:22:55,007][123090] Updated weights for policy 1, policy_version 1839861 (0.0009) [2023-12-26 14:22:55,072][123090] Updated weights for policy 1, policy_version 1839871 (0.0010) [2023-12-26 14:22:55,090][123091] Updated weights for policy 0, policy_version 1851509 (0.0008) [2023-12-26 14:22:55,138][123091] Updated weights for policy 0, policy_version 1851519 (0.0010) [2023-12-26 14:22:55,189][123091] Updated weights for policy 0, policy_version 1851529 (0.0010) [2023-12-26 14:22:55,832][123091] Updated weights for policy 0, policy_version 1851539 (0.0009) [2023-12-26 14:22:55,858][123090] Updated weights for policy 1, policy_version 1839881 (0.0007) [2023-12-26 14:22:55,887][123091] Updated weights for policy 0, policy_version 1851549 (0.0007) [2023-12-26 14:22:55,924][123090] Updated weights for policy 1, policy_version 1839891 (0.0010) [2023-12-26 14:22:55,950][123091] Updated weights for policy 0, policy_version 1851559 (0.0006) [2023-12-26 14:22:55,980][123090] Updated weights for policy 1, policy_version 1839901 (0.0010) [2023-12-26 14:22:56,611][123091] Updated weights for policy 0, policy_version 1851569 (0.0005) [2023-12-26 14:22:56,661][123091] Updated weights for policy 0, policy_version 1851579 (0.0005) [2023-12-26 14:22:56,710][123091] Updated weights for policy 0, policy_version 1851589 (0.0005) [2023-12-26 14:22:56,719][123090] Updated weights for policy 1, policy_version 1839911 (0.0010) [2023-12-26 14:22:56,763][123090] Updated weights for policy 1, policy_version 1839921 (0.0010) [2023-12-26 14:22:56,766][123091] Updated weights for policy 0, policy_version 1851599 (0.0005) [2023-12-26 14:22:56,819][123090] Updated weights for policy 1, policy_version 1839931 (0.0010) [2023-12-26 14:22:57,546][123091] Updated weights for policy 0, policy_version 1851609 (0.0005) [2023-12-26 14:22:57,608][123091] Updated weights for policy 0, policy_version 1851619 (0.0007) [2023-12-26 14:22:57,667][123090] Updated weights for policy 1, policy_version 1839941 (0.0011) [2023-12-26 14:22:57,673][123091] Updated weights for policy 0, policy_version 1851629 (0.0009) [2023-12-26 14:22:57,729][123090] Updated weights for policy 1, policy_version 1839951 (0.0010) [2023-12-26 14:22:57,805][123090] Updated weights for policy 1, policy_version 1839961 (0.0010) [2023-12-26 14:22:58,351][123091] Updated weights for policy 0, policy_version 1851639 (0.0009) [2023-12-26 14:22:58,412][123091] Updated weights for policy 0, policy_version 1851649 (0.0011) [2023-12-26 14:22:58,479][123091] Updated weights for policy 0, policy_version 1851659 (0.0011) [2023-12-26 14:22:58,582][123090] Updated weights for policy 1, policy_version 1839971 (0.0010) [2023-12-26 14:22:58,648][123090] Updated weights for policy 1, policy_version 1839981 (0.0008) [2023-12-26 14:22:58,711][123090] Updated weights for policy 1, policy_version 1839991 (0.0008) [2023-12-26 14:22:58,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 945070080. Throughput: 0: 9104.4, 1: 8795.5. Samples: 945058452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:22:58,785][121949] Avg episode reward: [(0, '6251.857'), (1, '5908.321')] [2023-12-26 14:22:59,384][123091] Updated weights for policy 0, policy_version 1851669 (0.0010) [2023-12-26 14:22:59,452][123091] Updated weights for policy 0, policy_version 1851679 (0.0010) [2023-12-26 14:22:59,514][123091] Updated weights for policy 0, policy_version 1851689 (0.0009) [2023-12-26 14:22:59,621][123090] Updated weights for policy 1, policy_version 1840001 (0.0007) [2023-12-26 14:22:59,673][123090] Updated weights for policy 1, policy_version 1840011 (0.0009) [2023-12-26 14:22:59,722][123090] Updated weights for policy 1, policy_version 1840021 (0.0009) [2023-12-26 14:22:59,776][123090] Updated weights for policy 1, policy_version 1840031 (0.0010) [2023-12-26 14:23:00,255][123091] Updated weights for policy 0, policy_version 1851699 (0.0008) [2023-12-26 14:23:00,314][123091] Updated weights for policy 0, policy_version 1851709 (0.0005) [2023-12-26 14:23:00,379][123091] Updated weights for policy 0, policy_version 1851719 (0.0009) [2023-12-26 14:23:00,672][123090] Updated weights for policy 1, policy_version 1840041 (0.0010) [2023-12-26 14:23:00,717][123090] Updated weights for policy 1, policy_version 1840051 (0.0010) [2023-12-26 14:23:00,769][123090] Updated weights for policy 1, policy_version 1840061 (0.0010) [2023-12-26 14:23:01,143][123091] Updated weights for policy 0, policy_version 1851729 (0.0007) [2023-12-26 14:23:01,206][123091] Updated weights for policy 0, policy_version 1851739 (0.0010) [2023-12-26 14:23:01,266][123091] Updated weights for policy 0, policy_version 1851749 (0.0009) [2023-12-26 14:23:01,327][123091] Updated weights for policy 0, policy_version 1851759 (0.0009) [2023-12-26 14:23:01,557][123090] Updated weights for policy 1, policy_version 1840071 (0.0010) [2023-12-26 14:23:01,625][123090] Updated weights for policy 1, policy_version 1840081 (0.0011) [2023-12-26 14:23:01,697][123090] Updated weights for policy 1, policy_version 1840091 (0.0013) [2023-12-26 14:23:02,146][123091] Updated weights for policy 0, policy_version 1851769 (0.0009) [2023-12-26 14:23:02,210][123091] Updated weights for policy 0, policy_version 1851779 (0.0010) [2023-12-26 14:23:02,276][123091] Updated weights for policy 0, policy_version 1851789 (0.0010) [2023-12-26 14:23:02,493][123090] Updated weights for policy 1, policy_version 1840101 (0.0009) [2023-12-26 14:23:02,562][123090] Updated weights for policy 1, policy_version 1840111 (0.0009) [2023-12-26 14:23:02,633][123090] Updated weights for policy 1, policy_version 1840121 (0.0009) [2023-12-26 14:23:03,114][123091] Updated weights for policy 0, policy_version 1851799 (0.0010) [2023-12-26 14:23:03,166][123091] Updated weights for policy 0, policy_version 1851810 (0.0010) [2023-12-26 14:23:03,222][123091] Updated weights for policy 0, policy_version 1851820 (0.0009) [2023-12-26 14:23:03,327][123090] Updated weights for policy 1, policy_version 1840131 (0.0008) [2023-12-26 14:23:03,400][123090] Updated weights for policy 1, policy_version 1840141 (0.0005) [2023-12-26 14:23:03,470][123090] Updated weights for policy 1, policy_version 1840151 (0.0010) [2023-12-26 14:23:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 945152000. Throughput: 0: 9092.7, 1: 8756.7. Samples: 945162548. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:03,785][121949] Avg episode reward: [(0, '6290.357'), (1, '6020.856')] [2023-12-26 14:23:04,015][123091] Updated weights for policy 0, policy_version 1851830 (0.0009) [2023-12-26 14:23:04,075][123091] Updated weights for policy 0, policy_version 1851840 (0.0009) [2023-12-26 14:23:04,140][123091] Updated weights for policy 0, policy_version 1851850 (0.0009) [2023-12-26 14:23:04,221][123090] Updated weights for policy 1, policy_version 1840161 (0.0010) [2023-12-26 14:23:04,290][123090] Updated weights for policy 1, policy_version 1840171 (0.0006) [2023-12-26 14:23:04,363][123090] Updated weights for policy 1, policy_version 1840181 (0.0007) [2023-12-26 14:23:04,431][123090] Updated weights for policy 1, policy_version 1840191 (0.0005) [2023-12-26 14:23:05,016][123091] Updated weights for policy 0, policy_version 1851860 (0.0010) [2023-12-26 14:23:05,068][123091] Updated weights for policy 0, policy_version 1851870 (0.0009) [2023-12-26 14:23:05,118][123091] Updated weights for policy 0, policy_version 1851880 (0.0009) [2023-12-26 14:23:05,126][123090] Updated weights for policy 1, policy_version 1840201 (0.0005) [2023-12-26 14:23:05,188][123090] Updated weights for policy 1, policy_version 1840211 (0.0005) [2023-12-26 14:23:05,244][123090] Updated weights for policy 1, policy_version 1840221 (0.0005) [2023-12-26 14:23:05,844][123091] Updated weights for policy 0, policy_version 1851890 (0.0008) [2023-12-26 14:23:05,871][123090] Updated weights for policy 1, policy_version 1840231 (0.0005) [2023-12-26 14:23:05,889][123091] Updated weights for policy 0, policy_version 1851900 (0.0005) [2023-12-26 14:23:05,920][123090] Updated weights for policy 1, policy_version 1840241 (0.0005) [2023-12-26 14:23:05,943][123091] Updated weights for policy 0, policy_version 1851910 (0.0005) [2023-12-26 14:23:05,971][123090] Updated weights for policy 1, policy_version 1840251 (0.0006) [2023-12-26 14:23:05,987][123091] Updated weights for policy 0, policy_version 1851920 (0.0005) [2023-12-26 14:23:06,808][123091] Updated weights for policy 0, policy_version 1851930 (0.0006) [2023-12-26 14:23:06,820][123090] Updated weights for policy 1, policy_version 1840261 (0.0008) [2023-12-26 14:23:06,874][123090] Updated weights for policy 1, policy_version 1840271 (0.0005) [2023-12-26 14:23:06,874][123091] Updated weights for policy 0, policy_version 1851940 (0.0009) [2023-12-26 14:23:06,943][123091] Updated weights for policy 0, policy_version 1851950 (0.0008) [2023-12-26 14:23:06,946][123090] Updated weights for policy 1, policy_version 1840281 (0.0005) [2023-12-26 14:23:07,694][123090] Updated weights for policy 1, policy_version 1840291 (0.0007) [2023-12-26 14:23:07,749][123090] Updated weights for policy 1, policy_version 1840301 (0.0010) [2023-12-26 14:23:07,768][123091] Updated weights for policy 0, policy_version 1851960 (0.0006) [2023-12-26 14:23:07,807][123090] Updated weights for policy 1, policy_version 1840311 (0.0010) [2023-12-26 14:23:07,827][123091] Updated weights for policy 0, policy_version 1851970 (0.0006) [2023-12-26 14:23:07,880][123091] Updated weights for policy 0, policy_version 1851980 (0.0009) [2023-12-26 14:23:08,638][123090] Updated weights for policy 1, policy_version 1840321 (0.0010) [2023-12-26 14:23:08,704][123090] Updated weights for policy 1, policy_version 1840331 (0.0011) [2023-12-26 14:23:08,720][123091] Updated weights for policy 0, policy_version 1851990 (0.0008) [2023-12-26 14:23:08,764][123090] Updated weights for policy 1, policy_version 1840341 (0.0010) [2023-12-26 14:23:08,784][123091] Updated weights for policy 0, policy_version 1852000 (0.0006) [2023-12-26 14:23:08,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 945233920. Throughput: 0: 9125.2, 1: 8838.4. Samples: 945217724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:08,785][121949] Avg episode reward: [(0, '6309.919'), (1, '5979.223')] [2023-12-26 14:23:08,824][123090] Updated weights for policy 1, policy_version 1840351 (0.0010) [2023-12-26 14:23:08,828][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001840352_471130112.pth... [2023-12-26 14:23:08,833][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001839296_470859776.pth [2023-12-26 14:23:08,840][123091] Updated weights for policy 0, policy_version 1852010 (0.0006) [2023-12-26 14:23:08,867][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001852016_474120192.pth... [2023-12-26 14:23:08,870][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001850928_473841664.pth [2023-12-26 14:23:09,679][123090] Updated weights for policy 1, policy_version 1840361 (0.0011) [2023-12-26 14:23:09,694][123091] Updated weights for policy 0, policy_version 1852020 (0.0008) [2023-12-26 14:23:09,740][123090] Updated weights for policy 1, policy_version 1840371 (0.0011) [2023-12-26 14:23:09,748][123091] Updated weights for policy 0, policy_version 1852030 (0.0007) [2023-12-26 14:23:09,804][123090] Updated weights for policy 1, policy_version 1840381 (0.0011) [2023-12-26 14:23:09,806][123091] Updated weights for policy 0, policy_version 1852040 (0.0010) [2023-12-26 14:23:10,605][123090] Updated weights for policy 1, policy_version 1840391 (0.0010) [2023-12-26 14:23:10,632][123091] Updated weights for policy 0, policy_version 1852050 (0.0009) [2023-12-26 14:23:10,664][123090] Updated weights for policy 1, policy_version 1840401 (0.0011) [2023-12-26 14:23:10,696][123091] Updated weights for policy 0, policy_version 1852060 (0.0005) [2023-12-26 14:23:10,727][123090] Updated weights for policy 1, policy_version 1840411 (0.0010) [2023-12-26 14:23:10,763][123091] Updated weights for policy 0, policy_version 1852070 (0.0006) [2023-12-26 14:23:10,816][123091] Updated weights for policy 0, policy_version 1852080 (0.0009) [2023-12-26 14:23:11,574][123090] Updated weights for policy 1, policy_version 1840421 (0.0010) [2023-12-26 14:23:11,639][123090] Updated weights for policy 1, policy_version 1840431 (0.0009) [2023-12-26 14:23:11,682][123091] Updated weights for policy 0, policy_version 1852090 (0.0007) [2023-12-26 14:23:11,717][123090] Updated weights for policy 1, policy_version 1840441 (0.0008) [2023-12-26 14:23:11,753][123091] Updated weights for policy 0, policy_version 1852100 (0.0007) [2023-12-26 14:23:11,825][123091] Updated weights for policy 0, policy_version 1852110 (0.0006) [2023-12-26 14:23:12,523][123091] Updated weights for policy 0, policy_version 1852120 (0.0009) [2023-12-26 14:23:12,543][123090] Updated weights for policy 1, policy_version 1840451 (0.0009) [2023-12-26 14:23:12,576][123091] Updated weights for policy 0, policy_version 1852130 (0.0008) [2023-12-26 14:23:12,600][123090] Updated weights for policy 1, policy_version 1840461 (0.0005) [2023-12-26 14:23:12,631][123091] Updated weights for policy 0, policy_version 1852140 (0.0009) [2023-12-26 14:23:12,658][123090] Updated weights for policy 1, policy_version 1840471 (0.0006) [2023-12-26 14:23:13,399][123090] Updated weights for policy 1, policy_version 1840481 (0.0010) [2023-12-26 14:23:13,463][123090] Updated weights for policy 1, policy_version 1840491 (0.0007) [2023-12-26 14:23:13,501][123091] Updated weights for policy 0, policy_version 1852150 (0.0010) [2023-12-26 14:23:13,517][123090] Updated weights for policy 1, policy_version 1840501 (0.0005) [2023-12-26 14:23:13,563][123091] Updated weights for policy 0, policy_version 1852160 (0.0006) [2023-12-26 14:23:13,570][123090] Updated weights for policy 1, policy_version 1840511 (0.0010) [2023-12-26 14:23:13,614][123091] Updated weights for policy 0, policy_version 1852170 (0.0008) [2023-12-26 14:23:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 945332224. Throughput: 0: 9056.9, 1: 8776.6. Samples: 945321096. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:13,785][121949] Avg episode reward: [(0, '6302.937'), (1, '5820.377')] [2023-12-26 14:23:14,370][123090] Updated weights for policy 1, policy_version 1840521 (0.0008) [2023-12-26 14:23:14,435][123090] Updated weights for policy 1, policy_version 1840531 (0.0009) [2023-12-26 14:23:14,461][123091] Updated weights for policy 0, policy_version 1852180 (0.0008) [2023-12-26 14:23:14,486][123090] Updated weights for policy 1, policy_version 1840541 (0.0005) [2023-12-26 14:23:14,521][123091] Updated weights for policy 0, policy_version 1852190 (0.0009) [2023-12-26 14:23:14,599][123091] Updated weights for policy 0, policy_version 1852200 (0.0008) [2023-12-26 14:23:15,219][123090] Updated weights for policy 1, policy_version 1840551 (0.0008) [2023-12-26 14:23:15,281][123090] Updated weights for policy 1, policy_version 1840561 (0.0008) [2023-12-26 14:23:15,341][123091] Updated weights for policy 0, policy_version 1852210 (0.0006) [2023-12-26 14:23:15,343][123090] Updated weights for policy 1, policy_version 1840571 (0.0010) [2023-12-26 14:23:15,401][123091] Updated weights for policy 0, policy_version 1852220 (0.0008) [2023-12-26 14:23:15,453][123091] Updated weights for policy 0, policy_version 1852230 (0.0009) [2023-12-26 14:23:15,510][123091] Updated weights for policy 0, policy_version 1852240 (0.0010) [2023-12-26 14:23:16,078][123090] Updated weights for policy 1, policy_version 1840581 (0.0008) [2023-12-26 14:23:16,136][123090] Updated weights for policy 1, policy_version 1840591 (0.0005) [2023-12-26 14:23:16,205][123090] Updated weights for policy 1, policy_version 1840601 (0.0005) [2023-12-26 14:23:16,264][123091] Updated weights for policy 0, policy_version 1852250 (0.0006) [2023-12-26 14:23:16,329][123091] Updated weights for policy 0, policy_version 1852260 (0.0006) [2023-12-26 14:23:16,395][123091] Updated weights for policy 0, policy_version 1852270 (0.0005) [2023-12-26 14:23:16,842][123090] Updated weights for policy 1, policy_version 1840611 (0.0006) [2023-12-26 14:23:16,891][123090] Updated weights for policy 1, policy_version 1840621 (0.0005) [2023-12-26 14:23:16,939][123090] Updated weights for policy 1, policy_version 1840631 (0.0005) [2023-12-26 14:23:17,093][123091] Updated weights for policy 0, policy_version 1852280 (0.0007) [2023-12-26 14:23:17,162][123091] Updated weights for policy 0, policy_version 1852290 (0.0007) [2023-12-26 14:23:17,219][123091] Updated weights for policy 0, policy_version 1852300 (0.0005) [2023-12-26 14:23:17,642][123090] Updated weights for policy 1, policy_version 1840641 (0.0005) [2023-12-26 14:23:17,720][123090] Updated weights for policy 1, policy_version 1840651 (0.0005) [2023-12-26 14:23:17,797][123090] Updated weights for policy 1, policy_version 1840661 (0.0005) [2023-12-26 14:23:17,830][123091] Updated weights for policy 0, policy_version 1852310 (0.0006) [2023-12-26 14:23:17,875][123090] Updated weights for policy 1, policy_version 1840671 (0.0005) [2023-12-26 14:23:17,885][123091] Updated weights for policy 0, policy_version 1852320 (0.0006) [2023-12-26 14:23:17,943][123091] Updated weights for policy 0, policy_version 1852330 (0.0005) [2023-12-26 14:23:18,457][123090] Updated weights for policy 1, policy_version 1840681 (0.0007) [2023-12-26 14:23:18,514][123090] Updated weights for policy 1, policy_version 1840691 (0.0008) [2023-12-26 14:23:18,567][123090] Updated weights for policy 1, policy_version 1840701 (0.0009) [2023-12-26 14:23:18,732][123091] Updated weights for policy 0, policy_version 1852340 (0.0007) [2023-12-26 14:23:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 945422336. Throughput: 0: 9038.0, 1: 8922.6. Samples: 945435396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:18,785][121949] Avg episode reward: [(0, '6226.233'), (1, '5833.886')] [2023-12-26 14:23:18,802][123091] Updated weights for policy 0, policy_version 1852350 (0.0010) [2023-12-26 14:23:18,865][123091] Updated weights for policy 0, policy_version 1852360 (0.0010) [2023-12-26 14:23:19,392][123090] Updated weights for policy 1, policy_version 1840711 (0.0009) [2023-12-26 14:23:19,451][123090] Updated weights for policy 1, policy_version 1840721 (0.0005) [2023-12-26 14:23:19,523][123090] Updated weights for policy 1, policy_version 1840731 (0.0008) [2023-12-26 14:23:19,678][123091] Updated weights for policy 0, policy_version 1852370 (0.0010) [2023-12-26 14:23:19,747][123091] Updated weights for policy 0, policy_version 1852380 (0.0009) [2023-12-26 14:23:19,810][123091] Updated weights for policy 0, policy_version 1852390 (0.0008) [2023-12-26 14:23:19,872][123091] Updated weights for policy 0, policy_version 1852400 (0.0009) [2023-12-26 14:23:20,353][123090] Updated weights for policy 1, policy_version 1840741 (0.0010) [2023-12-26 14:23:20,410][123090] Updated weights for policy 1, policy_version 1840751 (0.0009) [2023-12-26 14:23:20,473][123090] Updated weights for policy 1, policy_version 1840761 (0.0010) [2023-12-26 14:23:20,629][123091] Updated weights for policy 0, policy_version 1852410 (0.0009) [2023-12-26 14:23:20,699][123091] Updated weights for policy 0, policy_version 1852420 (0.0010) [2023-12-26 14:23:20,769][123091] Updated weights for policy 0, policy_version 1852430 (0.0010) [2023-12-26 14:23:21,360][123090] Updated weights for policy 1, policy_version 1840771 (0.0009) [2023-12-26 14:23:21,435][123090] Updated weights for policy 1, policy_version 1840781 (0.0006) [2023-12-26 14:23:21,499][123090] Updated weights for policy 1, policy_version 1840791 (0.0005) [2023-12-26 14:23:21,553][123091] Updated weights for policy 0, policy_version 1852440 (0.0010) [2023-12-26 14:23:21,619][123091] Updated weights for policy 0, policy_version 1852450 (0.0007) [2023-12-26 14:23:21,688][123091] Updated weights for policy 0, policy_version 1852460 (0.0007) [2023-12-26 14:23:22,294][123090] Updated weights for policy 1, policy_version 1840801 (0.0006) [2023-12-26 14:23:22,364][123090] Updated weights for policy 1, policy_version 1840811 (0.0009) [2023-12-26 14:23:22,383][123091] Updated weights for policy 0, policy_version 1852470 (0.0008) [2023-12-26 14:23:22,437][123090] Updated weights for policy 1, policy_version 1840821 (0.0008) [2023-12-26 14:23:22,441][123091] Updated weights for policy 0, policy_version 1852480 (0.0008) [2023-12-26 14:23:22,501][123090] Updated weights for policy 1, policy_version 1840831 (0.0010) [2023-12-26 14:23:22,505][123091] Updated weights for policy 0, policy_version 1852490 (0.0008) [2023-12-26 14:23:23,242][123090] Updated weights for policy 1, policy_version 1840841 (0.0008) [2023-12-26 14:23:23,302][123090] Updated weights for policy 1, policy_version 1840851 (0.0010) [2023-12-26 14:23:23,364][123091] Updated weights for policy 0, policy_version 1852500 (0.0007) [2023-12-26 14:23:23,369][123090] Updated weights for policy 1, policy_version 1840861 (0.0010) [2023-12-26 14:23:23,426][123091] Updated weights for policy 0, policy_version 1852510 (0.0008) [2023-12-26 14:23:23,489][123091] Updated weights for policy 0, policy_version 1852520 (0.0009) [2023-12-26 14:23:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 945512448. Throughput: 0: 9021.5, 1: 8904.4. Samples: 945487408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:23,785][121949] Avg episode reward: [(0, '6239.933'), (1, '5907.046')] [2023-12-26 14:23:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001840864_471261184.pth... [2023-12-26 14:23:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001852528_474251264.pth... [2023-12-26 14:23:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001839808_470990848.pth [2023-12-26 14:23:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001851472_473980928.pth [2023-12-26 14:23:24,039][123090] Updated weights for policy 1, policy_version 1840871 (0.0007) [2023-12-26 14:23:24,107][123090] Updated weights for policy 1, policy_version 1840881 (0.0005) [2023-12-26 14:23:24,169][123090] Updated weights for policy 1, policy_version 1840891 (0.0005) [2023-12-26 14:23:24,405][123091] Updated weights for policy 0, policy_version 1852530 (0.0008) [2023-12-26 14:23:24,460][123091] Updated weights for policy 0, policy_version 1852540 (0.0009) [2023-12-26 14:23:24,513][123091] Updated weights for policy 0, policy_version 1852550 (0.0010) [2023-12-26 14:23:24,565][123091] Updated weights for policy 0, policy_version 1852560 (0.0010) [2023-12-26 14:23:24,849][123090] Updated weights for policy 1, policy_version 1840901 (0.0007) [2023-12-26 14:23:24,907][123090] Updated weights for policy 1, policy_version 1840911 (0.0009) [2023-12-26 14:23:24,966][123090] Updated weights for policy 1, policy_version 1840921 (0.0010) [2023-12-26 14:23:25,406][123091] Updated weights for policy 0, policy_version 1852570 (0.0009) [2023-12-26 14:23:25,464][123091] Updated weights for policy 0, policy_version 1852580 (0.0009) [2023-12-26 14:23:25,516][123091] Updated weights for policy 0, policy_version 1852590 (0.0009) [2023-12-26 14:23:25,824][123090] Updated weights for policy 1, policy_version 1840932 (0.0010) [2023-12-26 14:23:25,880][123090] Updated weights for policy 1, policy_version 1840942 (0.0009) [2023-12-26 14:23:25,932][123090] Updated weights for policy 1, policy_version 1840952 (0.0009) [2023-12-26 14:23:26,320][123091] Updated weights for policy 0, policy_version 1852600 (0.0009) [2023-12-26 14:23:26,371][123091] Updated weights for policy 0, policy_version 1852610 (0.0009) [2023-12-26 14:23:26,434][123091] Updated weights for policy 0, policy_version 1852620 (0.0008) [2023-12-26 14:23:26,724][123090] Updated weights for policy 1, policy_version 1840962 (0.0008) [2023-12-26 14:23:26,772][123090] Updated weights for policy 1, policy_version 1840972 (0.0005) [2023-12-26 14:23:26,820][123090] Updated weights for policy 1, policy_version 1840982 (0.0009) [2023-12-26 14:23:26,875][123090] Updated weights for policy 1, policy_version 1840992 (0.0010) [2023-12-26 14:23:27,209][123091] Updated weights for policy 0, policy_version 1852630 (0.0008) [2023-12-26 14:23:27,256][123091] Updated weights for policy 0, policy_version 1852640 (0.0008) [2023-12-26 14:23:27,305][123091] Updated weights for policy 0, policy_version 1852650 (0.0009) [2023-12-26 14:23:27,684][123090] Updated weights for policy 1, policy_version 1841002 (0.0010) [2023-12-26 14:23:27,743][123090] Updated weights for policy 1, policy_version 1841012 (0.0010) [2023-12-26 14:23:27,790][123090] Updated weights for policy 1, policy_version 1841022 (0.0010) [2023-12-26 14:23:28,162][123091] Updated weights for policy 0, policy_version 1852660 (0.0009) [2023-12-26 14:23:28,208][123091] Updated weights for policy 0, policy_version 1852670 (0.0008) [2023-12-26 14:23:28,259][123091] Updated weights for policy 0, policy_version 1852680 (0.0008) [2023-12-26 14:23:28,642][123090] Updated weights for policy 1, policy_version 1841032 (0.0010) [2023-12-26 14:23:28,693][123090] Updated weights for policy 1, policy_version 1841042 (0.0010) [2023-12-26 14:23:28,748][123090] Updated weights for policy 1, policy_version 1841052 (0.0010) [2023-12-26 14:23:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 945602560. Throughput: 0: 9072.2, 1: 8969.4. Samples: 945593756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:28,785][121949] Avg episode reward: [(0, '6192.601'), (1, '6044.012')] [2023-12-26 14:23:29,103][123091] Updated weights for policy 0, policy_version 1852690 (0.0009) [2023-12-26 14:23:29,169][123091] Updated weights for policy 0, policy_version 1852700 (0.0009) [2023-12-26 14:23:29,236][123091] Updated weights for policy 0, policy_version 1852710 (0.0009) [2023-12-26 14:23:29,296][123091] Updated weights for policy 0, policy_version 1852720 (0.0009) [2023-12-26 14:23:29,607][123090] Updated weights for policy 1, policy_version 1841062 (0.0010) [2023-12-26 14:23:29,674][123090] Updated weights for policy 1, policy_version 1841072 (0.0010) [2023-12-26 14:23:29,728][123090] Updated weights for policy 1, policy_version 1841082 (0.0009) [2023-12-26 14:23:30,149][123091] Updated weights for policy 0, policy_version 1852730 (0.0010) [2023-12-26 14:23:30,210][123091] Updated weights for policy 0, policy_version 1852740 (0.0010) [2023-12-26 14:23:30,276][123091] Updated weights for policy 0, policy_version 1852750 (0.0008) [2023-12-26 14:23:30,550][123090] Updated weights for policy 1, policy_version 1841092 (0.0010) [2023-12-26 14:23:30,600][123090] Updated weights for policy 1, policy_version 1841103 (0.0009) [2023-12-26 14:23:30,649][123090] Updated weights for policy 1, policy_version 1841113 (0.0009) [2023-12-26 14:23:31,107][123091] Updated weights for policy 0, policy_version 1852760 (0.0010) [2023-12-26 14:23:31,177][123091] Updated weights for policy 0, policy_version 1852770 (0.0009) [2023-12-26 14:23:31,240][123091] Updated weights for policy 0, policy_version 1852780 (0.0010) [2023-12-26 14:23:31,457][123090] Updated weights for policy 1, policy_version 1841124 (0.0010) [2023-12-26 14:23:31,509][123090] Updated weights for policy 1, policy_version 1841134 (0.0009) [2023-12-26 14:23:31,559][123090] Updated weights for policy 1, policy_version 1841144 (0.0008) [2023-12-26 14:23:32,068][123091] Updated weights for policy 0, policy_version 1852790 (0.0010) [2023-12-26 14:23:32,119][123091] Updated weights for policy 0, policy_version 1852800 (0.0010) [2023-12-26 14:23:32,169][123091] Updated weights for policy 0, policy_version 1852810 (0.0009) [2023-12-26 14:23:32,476][123090] Updated weights for policy 1, policy_version 1841154 (0.0010) [2023-12-26 14:23:32,540][123090] Updated weights for policy 1, policy_version 1841164 (0.0009) [2023-12-26 14:23:32,605][123090] Updated weights for policy 1, policy_version 1841174 (0.0009) [2023-12-26 14:23:32,667][123090] Updated weights for policy 1, policy_version 1841184 (0.0009) [2023-12-26 14:23:32,994][123091] Updated weights for policy 0, policy_version 1852820 (0.0009) [2023-12-26 14:23:33,044][123091] Updated weights for policy 0, policy_version 1852830 (0.0009) [2023-12-26 14:23:33,094][123091] Updated weights for policy 0, policy_version 1852840 (0.0009) [2023-12-26 14:23:33,495][123090] Updated weights for policy 1, policy_version 1841194 (0.0005) [2023-12-26 14:23:33,558][123090] Updated weights for policy 1, policy_version 1841204 (0.0005) [2023-12-26 14:23:33,610][123090] Updated weights for policy 1, policy_version 1841214 (0.0006) [2023-12-26 14:23:33,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 945684480. Throughput: 0: 8932.7, 1: 8886.5. Samples: 945696224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:33,785][121949] Avg episode reward: [(0, '6252.394'), (1, '6083.289')] [2023-12-26 14:23:33,953][123091] Updated weights for policy 0, policy_version 1852850 (0.0009) [2023-12-26 14:23:34,010][123091] Updated weights for policy 0, policy_version 1852860 (0.0009) [2023-12-26 14:23:34,073][123091] Updated weights for policy 0, policy_version 1852870 (0.0009) [2023-12-26 14:23:34,131][123091] Updated weights for policy 0, policy_version 1852880 (0.0009) [2023-12-26 14:23:34,362][123090] Updated weights for policy 1, policy_version 1841224 (0.0008) [2023-12-26 14:23:34,428][123090] Updated weights for policy 1, policy_version 1841234 (0.0008) [2023-12-26 14:23:34,488][123090] Updated weights for policy 1, policy_version 1841244 (0.0008) [2023-12-26 14:23:34,941][123091] Updated weights for policy 0, policy_version 1852890 (0.0009) [2023-12-26 14:23:35,001][123091] Updated weights for policy 0, policy_version 1852900 (0.0010) [2023-12-26 14:23:35,069][123091] Updated weights for policy 0, policy_version 1852910 (0.0009) [2023-12-26 14:23:35,294][123090] Updated weights for policy 1, policy_version 1841254 (0.0009) [2023-12-26 14:23:35,351][123090] Updated weights for policy 1, policy_version 1841264 (0.0008) [2023-12-26 14:23:35,422][123090] Updated weights for policy 1, policy_version 1841274 (0.0005) [2023-12-26 14:23:35,726][123091] Updated weights for policy 0, policy_version 1852920 (0.0006) [2023-12-26 14:23:35,783][123091] Updated weights for policy 0, policy_version 1852930 (0.0005) [2023-12-26 14:23:35,854][123091] Updated weights for policy 0, policy_version 1852940 (0.0005) [2023-12-26 14:23:36,159][123090] Updated weights for policy 1, policy_version 1841284 (0.0008) [2023-12-26 14:23:36,229][123090] Updated weights for policy 1, policy_version 1841294 (0.0009) [2023-12-26 14:23:36,303][123090] Updated weights for policy 1, policy_version 1841304 (0.0009) [2023-12-26 14:23:36,558][123091] Updated weights for policy 0, policy_version 1852950 (0.0006) [2023-12-26 14:23:36,628][123091] Updated weights for policy 0, policy_version 1852960 (0.0006) [2023-12-26 14:23:36,708][123091] Updated weights for policy 0, policy_version 1852970 (0.0005) [2023-12-26 14:23:37,082][123090] Updated weights for policy 1, policy_version 1841314 (0.0009) [2023-12-26 14:23:37,154][123090] Updated weights for policy 1, policy_version 1841324 (0.0006) [2023-12-26 14:23:37,213][123090] Updated weights for policy 1, policy_version 1841334 (0.0008) [2023-12-26 14:23:37,276][123090] Updated weights for policy 1, policy_version 1841344 (0.0009) [2023-12-26 14:23:37,363][123091] Updated weights for policy 0, policy_version 1852980 (0.0007) [2023-12-26 14:23:37,420][123091] Updated weights for policy 0, policy_version 1852990 (0.0010) [2023-12-26 14:23:37,479][123091] Updated weights for policy 0, policy_version 1853000 (0.0010) [2023-12-26 14:23:37,982][123090] Updated weights for policy 1, policy_version 1841354 (0.0005) [2023-12-26 14:23:38,041][123090] Updated weights for policy 1, policy_version 1841364 (0.0006) [2023-12-26 14:23:38,094][123090] Updated weights for policy 1, policy_version 1841374 (0.0005) [2023-12-26 14:23:38,233][123091] Updated weights for policy 0, policy_version 1853010 (0.0009) [2023-12-26 14:23:38,285][123091] Updated weights for policy 0, policy_version 1853020 (0.0005) [2023-12-26 14:23:38,354][123091] Updated weights for policy 0, policy_version 1853030 (0.0007) [2023-12-26 14:23:38,410][123091] Updated weights for policy 0, policy_version 1853040 (0.0010) [2023-12-26 14:23:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 945774592. Throughput: 0: 8932.7, 1: 8913.5. Samples: 945750728. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:38,785][121949] Avg episode reward: [(0, '6304.710'), (1, '5982.697')] [2023-12-26 14:23:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001853040_474382336.pth... [2023-12-26 14:23:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001852016_474120192.pth [2023-12-26 14:23:38,811][123090] Updated weights for policy 1, policy_version 1841384 (0.0010) [2023-12-26 14:23:38,866][123090] Updated weights for policy 1, policy_version 1841394 (0.0010) [2023-12-26 14:23:38,926][123090] Updated weights for policy 1, policy_version 1841404 (0.0010) [2023-12-26 14:23:38,947][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001841408_471400448.pth... [2023-12-26 14:23:38,950][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001840352_471130112.pth [2023-12-26 14:23:39,212][123091] Updated weights for policy 0, policy_version 1853050 (0.0009) [2023-12-26 14:23:39,277][123091] Updated weights for policy 0, policy_version 1853060 (0.0009) [2023-12-26 14:23:39,342][123091] Updated weights for policy 0, policy_version 1853070 (0.0009) [2023-12-26 14:23:39,756][123090] Updated weights for policy 1, policy_version 1841414 (0.0010) [2023-12-26 14:23:39,820][123090] Updated weights for policy 1, policy_version 1841424 (0.0011) [2023-12-26 14:23:39,915][123090] Updated weights for policy 1, policy_version 1841434 (0.0010) [2023-12-26 14:23:40,199][123091] Updated weights for policy 0, policy_version 1853080 (0.0008) [2023-12-26 14:23:40,269][123091] Updated weights for policy 0, policy_version 1853090 (0.0006) [2023-12-26 14:23:40,338][123091] Updated weights for policy 0, policy_version 1853100 (0.0009) [2023-12-26 14:23:40,678][123090] Updated weights for policy 1, policy_version 1841444 (0.0008) [2023-12-26 14:23:40,736][123090] Updated weights for policy 1, policy_version 1841454 (0.0007) [2023-12-26 14:23:40,796][123090] Updated weights for policy 1, policy_version 1841464 (0.0009) [2023-12-26 14:23:40,989][123091] Updated weights for policy 0, policy_version 1853110 (0.0009) [2023-12-26 14:23:41,055][123091] Updated weights for policy 0, policy_version 1853120 (0.0011) [2023-12-26 14:23:41,121][123091] Updated weights for policy 0, policy_version 1853130 (0.0011) [2023-12-26 14:23:41,610][123090] Updated weights for policy 1, policy_version 1841474 (0.0010) [2023-12-26 14:23:41,683][123090] Updated weights for policy 1, policy_version 1841484 (0.0007) [2023-12-26 14:23:41,762][123090] Updated weights for policy 1, policy_version 1841494 (0.0008) [2023-12-26 14:23:41,829][123090] Updated weights for policy 1, policy_version 1841504 (0.0009) [2023-12-26 14:23:41,958][123091] Updated weights for policy 0, policy_version 1853140 (0.0011) [2023-12-26 14:23:42,014][123091] Updated weights for policy 0, policy_version 1853150 (0.0010) [2023-12-26 14:23:42,067][123091] Updated weights for policy 0, policy_version 1853160 (0.0009) [2023-12-26 14:23:42,648][123090] Updated weights for policy 1, policy_version 1841514 (0.0006) [2023-12-26 14:23:42,718][123090] Updated weights for policy 1, policy_version 1841524 (0.0008) [2023-12-26 14:23:42,786][123090] Updated weights for policy 1, policy_version 1841534 (0.0011) [2023-12-26 14:23:42,926][123091] Updated weights for policy 0, policy_version 1853170 (0.0010) [2023-12-26 14:23:42,991][123091] Updated weights for policy 0, policy_version 1853180 (0.0009) [2023-12-26 14:23:43,058][123091] Updated weights for policy 0, policy_version 1853190 (0.0009) [2023-12-26 14:23:43,140][123091] Updated weights for policy 0, policy_version 1853200 (0.0010) [2023-12-26 14:23:43,506][123090] Updated weights for policy 1, policy_version 1841544 (0.0010) [2023-12-26 14:23:43,565][123090] Updated weights for policy 1, policy_version 1841554 (0.0009) [2023-12-26 14:23:43,618][123090] Updated weights for policy 1, policy_version 1841564 (0.0007) [2023-12-26 14:23:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17883.5). Total num frames: 945864704. Throughput: 0: 8815.5, 1: 8931.1. Samples: 945857052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:43,785][121949] Avg episode reward: [(0, '6329.205'), (1, '6023.442')] [2023-12-26 14:23:43,940][123091] Updated weights for policy 0, policy_version 1853210 (0.0010) [2023-12-26 14:23:44,008][123091] Updated weights for policy 0, policy_version 1853220 (0.0009) [2023-12-26 14:23:44,075][123091] Updated weights for policy 0, policy_version 1853230 (0.0010) [2023-12-26 14:23:44,329][123090] Updated weights for policy 1, policy_version 1841574 (0.0005) [2023-12-26 14:23:44,385][123090] Updated weights for policy 1, policy_version 1841584 (0.0005) [2023-12-26 14:23:44,432][123090] Updated weights for policy 1, policy_version 1841594 (0.0005) [2023-12-26 14:23:44,952][123091] Updated weights for policy 0, policy_version 1853240 (0.0010) [2023-12-26 14:23:45,015][123091] Updated weights for policy 0, policy_version 1853250 (0.0009) [2023-12-26 14:23:45,083][123091] Updated weights for policy 0, policy_version 1853260 (0.0007) [2023-12-26 14:23:45,153][123090] Updated weights for policy 1, policy_version 1841604 (0.0007) [2023-12-26 14:23:45,209][123090] Updated weights for policy 1, policy_version 1841614 (0.0005) [2023-12-26 14:23:45,275][123090] Updated weights for policy 1, policy_version 1841624 (0.0007) [2023-12-26 14:23:45,924][123091] Updated weights for policy 0, policy_version 1853270 (0.0010) [2023-12-26 14:23:45,974][123091] Updated weights for policy 0, policy_version 1853280 (0.0009) [2023-12-26 14:23:46,026][123090] Updated weights for policy 1, policy_version 1841634 (0.0009) [2023-12-26 14:23:46,032][123091] Updated weights for policy 0, policy_version 1853290 (0.0009) [2023-12-26 14:23:46,091][123090] Updated weights for policy 1, policy_version 1841644 (0.0009) [2023-12-26 14:23:46,154][123090] Updated weights for policy 1, policy_version 1841654 (0.0010) [2023-12-26 14:23:46,215][123090] Updated weights for policy 1, policy_version 1841664 (0.0010) [2023-12-26 14:23:46,867][123091] Updated weights for policy 0, policy_version 1853300 (0.0008) [2023-12-26 14:23:46,917][123091] Updated weights for policy 0, policy_version 1853310 (0.0009) [2023-12-26 14:23:46,970][123091] Updated weights for policy 0, policy_version 1853320 (0.0009) [2023-12-26 14:23:47,055][123090] Updated weights for policy 1, policy_version 1841674 (0.0009) [2023-12-26 14:23:47,122][123090] Updated weights for policy 1, policy_version 1841684 (0.0009) [2023-12-26 14:23:47,189][123090] Updated weights for policy 1, policy_version 1841694 (0.0009) [2023-12-26 14:23:47,781][123091] Updated weights for policy 0, policy_version 1853331 (0.0010) [2023-12-26 14:23:47,855][123091] Updated weights for policy 0, policy_version 1853341 (0.0010) [2023-12-26 14:23:47,921][123091] Updated weights for policy 0, policy_version 1853351 (0.0010) [2023-12-26 14:23:47,924][123090] Updated weights for policy 1, policy_version 1841704 (0.0007) [2023-12-26 14:23:47,977][123090] Updated weights for policy 1, policy_version 1841714 (0.0008) [2023-12-26 14:23:48,024][123090] Updated weights for policy 1, policy_version 1841724 (0.0005) [2023-12-26 14:23:48,648][123091] Updated weights for policy 0, policy_version 1853361 (0.0010) [2023-12-26 14:23:48,717][123091] Updated weights for policy 0, policy_version 1853371 (0.0006) [2023-12-26 14:23:48,775][123091] Updated weights for policy 0, policy_version 1853381 (0.0010) [2023-12-26 14:23:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 945946624. Throughput: 0: 8811.2, 1: 9006.2. Samples: 945964332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:48,784][121949] Avg episode reward: [(0, '6243.611'), (1, '6042.985')] [2023-12-26 14:23:48,830][123090] Updated weights for policy 1, policy_version 1841734 (0.0008) [2023-12-26 14:23:48,844][123091] Updated weights for policy 0, policy_version 1853391 (0.0006) [2023-12-26 14:23:48,887][123090] Updated weights for policy 1, policy_version 1841744 (0.0009) [2023-12-26 14:23:48,944][123090] Updated weights for policy 1, policy_version 1841754 (0.0009) [2023-12-26 14:23:49,540][123091] Updated weights for policy 0, policy_version 1853401 (0.0005) [2023-12-26 14:23:49,599][123091] Updated weights for policy 0, policy_version 1853411 (0.0005) [2023-12-26 14:23:49,670][123091] Updated weights for policy 0, policy_version 1853421 (0.0006) [2023-12-26 14:23:49,710][123090] Updated weights for policy 1, policy_version 1841764 (0.0007) [2023-12-26 14:23:49,761][123090] Updated weights for policy 1, policy_version 1841774 (0.0008) [2023-12-26 14:23:49,810][123090] Updated weights for policy 1, policy_version 1841784 (0.0009) [2023-12-26 14:23:50,450][123091] Updated weights for policy 0, policy_version 1853431 (0.0011) [2023-12-26 14:23:50,509][123091] Updated weights for policy 0, policy_version 1853441 (0.0010) [2023-12-26 14:23:50,581][123091] Updated weights for policy 0, policy_version 1853451 (0.0010) [2023-12-26 14:23:50,665][123090] Updated weights for policy 1, policy_version 1841794 (0.0009) [2023-12-26 14:23:50,729][123090] Updated weights for policy 1, policy_version 1841804 (0.0008) [2023-12-26 14:23:50,803][123090] Updated weights for policy 1, policy_version 1841814 (0.0008) [2023-12-26 14:23:50,875][123090] Updated weights for policy 1, policy_version 1841824 (0.0008) [2023-12-26 14:23:51,423][123091] Updated weights for policy 0, policy_version 1853461 (0.0010) [2023-12-26 14:23:51,481][123091] Updated weights for policy 0, policy_version 1853471 (0.0009) [2023-12-26 14:23:51,527][123091] Updated weights for policy 0, policy_version 1853481 (0.0006) [2023-12-26 14:23:51,620][123090] Updated weights for policy 1, policy_version 1841834 (0.0006) [2023-12-26 14:23:51,688][123090] Updated weights for policy 1, policy_version 1841844 (0.0007) [2023-12-26 14:23:51,757][123090] Updated weights for policy 1, policy_version 1841854 (0.0007) [2023-12-26 14:23:52,283][123091] Updated weights for policy 0, policy_version 1853491 (0.0006) [2023-12-26 14:23:52,339][123091] Updated weights for policy 0, policy_version 1853501 (0.0011) [2023-12-26 14:23:52,401][123091] Updated weights for policy 0, policy_version 1853511 (0.0009) [2023-12-26 14:23:52,499][123090] Updated weights for policy 1, policy_version 1841864 (0.0009) [2023-12-26 14:23:52,562][123090] Updated weights for policy 1, policy_version 1841874 (0.0010) [2023-12-26 14:23:52,628][123090] Updated weights for policy 1, policy_version 1841884 (0.0009) [2023-12-26 14:23:53,268][123091] Updated weights for policy 0, policy_version 1853521 (0.0008) [2023-12-26 14:23:53,323][123091] Updated weights for policy 0, policy_version 1853531 (0.0009) [2023-12-26 14:23:53,351][123090] Updated weights for policy 1, policy_version 1841894 (0.0009) [2023-12-26 14:23:53,384][123091] Updated weights for policy 0, policy_version 1853541 (0.0009) [2023-12-26 14:23:53,411][123090] Updated weights for policy 1, policy_version 1841904 (0.0008) [2023-12-26 14:23:53,435][123091] Updated weights for policy 0, policy_version 1853551 (0.0008) [2023-12-26 14:23:53,461][123090] Updated weights for policy 1, policy_version 1841914 (0.0009) [2023-12-26 14:23:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 946044928. Throughput: 0: 8809.6, 1: 8975.6. Samples: 946018064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:53,786][121949] Avg episode reward: [(0, '6171.848'), (1, '5995.049')] [2023-12-26 14:23:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001853552_474513408.pth... [2023-12-26 14:23:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001841920_471531520.pth... [2023-12-26 14:23:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001840864_471261184.pth [2023-12-26 14:23:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001852528_474251264.pth [2023-12-26 14:23:54,269][123091] Updated weights for policy 0, policy_version 1853561 (0.0009) [2023-12-26 14:23:54,318][123090] Updated weights for policy 1, policy_version 1841924 (0.0008) [2023-12-26 14:23:54,334][123091] Updated weights for policy 0, policy_version 1853571 (0.0010) [2023-12-26 14:23:54,368][123090] Updated weights for policy 1, policy_version 1841934 (0.0008) [2023-12-26 14:23:54,383][123091] Updated weights for policy 0, policy_version 1853581 (0.0008) [2023-12-26 14:23:54,425][123090] Updated weights for policy 1, policy_version 1841944 (0.0008) [2023-12-26 14:23:55,186][123091] Updated weights for policy 0, policy_version 1853591 (0.0007) [2023-12-26 14:23:55,251][123091] Updated weights for policy 0, policy_version 1853601 (0.0008) [2023-12-26 14:23:55,302][123091] Updated weights for policy 0, policy_version 1853611 (0.0005) [2023-12-26 14:23:55,331][123090] Updated weights for policy 1, policy_version 1841954 (0.0009) [2023-12-26 14:23:55,384][123090] Updated weights for policy 1, policy_version 1841964 (0.0009) [2023-12-26 14:23:55,452][123090] Updated weights for policy 1, policy_version 1841974 (0.0009) [2023-12-26 14:23:55,502][123090] Updated weights for policy 1, policy_version 1841984 (0.0009) [2023-12-26 14:23:55,960][123091] Updated weights for policy 0, policy_version 1853621 (0.0006) [2023-12-26 14:23:56,019][123091] Updated weights for policy 0, policy_version 1853631 (0.0005) [2023-12-26 14:23:56,081][123091] Updated weights for policy 0, policy_version 1853641 (0.0005) [2023-12-26 14:23:56,314][123090] Updated weights for policy 1, policy_version 1841994 (0.0010) [2023-12-26 14:23:56,373][123090] Updated weights for policy 1, policy_version 1842004 (0.0009) [2023-12-26 14:23:56,432][123090] Updated weights for policy 1, policy_version 1842014 (0.0010) [2023-12-26 14:23:56,763][123091] Updated weights for policy 0, policy_version 1853651 (0.0007) [2023-12-26 14:23:56,839][123091] Updated weights for policy 0, policy_version 1853661 (0.0009) [2023-12-26 14:23:56,900][123091] Updated weights for policy 0, policy_version 1853671 (0.0009) [2023-12-26 14:23:57,247][123090] Updated weights for policy 1, policy_version 1842024 (0.0006) [2023-12-26 14:23:57,309][123090] Updated weights for policy 1, policy_version 1842034 (0.0007) [2023-12-26 14:23:57,368][123090] Updated weights for policy 1, policy_version 1842044 (0.0009) [2023-12-26 14:23:57,709][123091] Updated weights for policy 0, policy_version 1853681 (0.0009) [2023-12-26 14:23:57,755][123091] Updated weights for policy 0, policy_version 1853691 (0.0008) [2023-12-26 14:23:57,802][123091] Updated weights for policy 0, policy_version 1853701 (0.0009) [2023-12-26 14:23:57,854][123091] Updated weights for policy 0, policy_version 1853712 (0.0010) [2023-12-26 14:23:58,142][123090] Updated weights for policy 1, policy_version 1842054 (0.0009) [2023-12-26 14:23:58,207][123090] Updated weights for policy 1, policy_version 1842064 (0.0010) [2023-12-26 14:23:58,279][123090] Updated weights for policy 1, policy_version 1842074 (0.0007) [2023-12-26 14:23:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 946126848. Throughput: 0: 8893.2, 1: 8981.8. Samples: 946125468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:23:58,785][121949] Avg episode reward: [(0, '6259.274'), (1, '5948.041')] [2023-12-26 14:23:58,792][123091] Updated weights for policy 0, policy_version 1853722 (0.0008) [2023-12-26 14:23:58,868][123091] Updated weights for policy 0, policy_version 1853732 (0.0008) [2023-12-26 14:23:58,940][123091] Updated weights for policy 0, policy_version 1853742 (0.0008) [2023-12-26 14:23:59,272][123090] Updated weights for policy 1, policy_version 1842084 (0.0007) [2023-12-26 14:23:59,338][123090] Updated weights for policy 1, policy_version 1842094 (0.0009) [2023-12-26 14:23:59,396][123090] Updated weights for policy 1, policy_version 1842104 (0.0009) [2023-12-26 14:23:59,666][123091] Updated weights for policy 0, policy_version 1853752 (0.0010) [2023-12-26 14:23:59,722][123091] Updated weights for policy 0, policy_version 1853762 (0.0008) [2023-12-26 14:23:59,784][123091] Updated weights for policy 0, policy_version 1853772 (0.0010) [2023-12-26 14:24:00,215][123090] Updated weights for policy 1, policy_version 1842114 (0.0010) [2023-12-26 14:24:00,270][123090] Updated weights for policy 1, policy_version 1842124 (0.0010) [2023-12-26 14:24:00,321][123090] Updated weights for policy 1, policy_version 1842134 (0.0010) [2023-12-26 14:24:00,377][123090] Updated weights for policy 1, policy_version 1842144 (0.0010) [2023-12-26 14:24:00,574][123091] Updated weights for policy 0, policy_version 1853782 (0.0008) [2023-12-26 14:24:00,623][123091] Updated weights for policy 0, policy_version 1853793 (0.0009) [2023-12-26 14:24:00,670][123091] Updated weights for policy 0, policy_version 1853803 (0.0008) [2023-12-26 14:24:01,221][123090] Updated weights for policy 1, policy_version 1842154 (0.0007) [2023-12-26 14:24:01,287][123090] Updated weights for policy 1, policy_version 1842164 (0.0011) [2023-12-26 14:24:01,349][123090] Updated weights for policy 1, policy_version 1842174 (0.0009) [2023-12-26 14:24:01,559][123091] Updated weights for policy 0, policy_version 1853813 (0.0009) [2023-12-26 14:24:01,628][123091] Updated weights for policy 0, policy_version 1853823 (0.0010) [2023-12-26 14:24:01,681][123091] Updated weights for policy 0, policy_version 1853833 (0.0010) [2023-12-26 14:24:02,135][123090] Updated weights for policy 1, policy_version 1842184 (0.0009) [2023-12-26 14:24:02,197][123090] Updated weights for policy 1, policy_version 1842194 (0.0009) [2023-12-26 14:24:02,260][123090] Updated weights for policy 1, policy_version 1842204 (0.0007) [2023-12-26 14:24:02,504][123091] Updated weights for policy 0, policy_version 1853843 (0.0010) [2023-12-26 14:24:02,557][123091] Updated weights for policy 0, policy_version 1853854 (0.0010) [2023-12-26 14:24:02,612][123091] Updated weights for policy 0, policy_version 1853864 (0.0010) [2023-12-26 14:24:03,058][123090] Updated weights for policy 1, policy_version 1842214 (0.0009) [2023-12-26 14:24:03,107][123090] Updated weights for policy 1, policy_version 1842224 (0.0009) [2023-12-26 14:24:03,174][123090] Updated weights for policy 1, policy_version 1842234 (0.0008) [2023-12-26 14:24:03,497][123091] Updated weights for policy 0, policy_version 1853874 (0.0010) [2023-12-26 14:24:03,556][123091] Updated weights for policy 0, policy_version 1853884 (0.0009) [2023-12-26 14:24:03,611][123091] Updated weights for policy 0, policy_version 1853894 (0.0010) [2023-12-26 14:24:03,681][123091] Updated weights for policy 0, policy_version 1853904 (0.0011) [2023-12-26 14:24:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 946216960. Throughput: 0: 8769.0, 1: 8810.7. Samples: 946226480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:03,785][121949] Avg episode reward: [(0, '6241.533'), (1, '5892.540')] [2023-12-26 14:24:03,998][123090] Updated weights for policy 1, policy_version 1842244 (0.0008) [2023-12-26 14:24:04,056][123090] Updated weights for policy 1, policy_version 1842254 (0.0006) [2023-12-26 14:24:04,117][123090] Updated weights for policy 1, policy_version 1842264 (0.0005) [2023-12-26 14:24:04,496][123091] Updated weights for policy 0, policy_version 1853914 (0.0011) [2023-12-26 14:24:04,554][123091] Updated weights for policy 0, policy_version 1853924 (0.0007) [2023-12-26 14:24:04,623][123091] Updated weights for policy 0, policy_version 1853934 (0.0005) [2023-12-26 14:24:04,823][123090] Updated weights for policy 1, policy_version 1842274 (0.0005) [2023-12-26 14:24:04,880][123090] Updated weights for policy 1, policy_version 1842284 (0.0005) [2023-12-26 14:24:04,945][123090] Updated weights for policy 1, policy_version 1842294 (0.0010) [2023-12-26 14:24:05,003][123090] Updated weights for policy 1, policy_version 1842304 (0.0010) [2023-12-26 14:24:05,362][123091] Updated weights for policy 0, policy_version 1853944 (0.0006) [2023-12-26 14:24:05,427][123091] Updated weights for policy 0, policy_version 1853954 (0.0005) [2023-12-26 14:24:05,481][123091] Updated weights for policy 0, policy_version 1853964 (0.0005) [2023-12-26 14:24:05,748][123090] Updated weights for policy 1, policy_version 1842314 (0.0006) [2023-12-26 14:24:05,811][123090] Updated weights for policy 1, policy_version 1842324 (0.0005) [2023-12-26 14:24:05,873][123090] Updated weights for policy 1, policy_version 1842334 (0.0005) [2023-12-26 14:24:06,183][123091] Updated weights for policy 0, policy_version 1853974 (0.0005) [2023-12-26 14:24:06,257][123091] Updated weights for policy 0, policy_version 1853984 (0.0006) [2023-12-26 14:24:06,320][123091] Updated weights for policy 0, policy_version 1853994 (0.0010) [2023-12-26 14:24:06,535][123090] Updated weights for policy 1, policy_version 1842344 (0.0010) [2023-12-26 14:24:06,606][123090] Updated weights for policy 1, policy_version 1842354 (0.0011) [2023-12-26 14:24:06,677][123090] Updated weights for policy 1, policy_version 1842364 (0.0009) [2023-12-26 14:24:07,082][123091] Updated weights for policy 0, policy_version 1854004 (0.0006) [2023-12-26 14:24:07,155][123091] Updated weights for policy 0, policy_version 1854014 (0.0005) [2023-12-26 14:24:07,214][123091] Updated weights for policy 0, policy_version 1854024 (0.0009) [2023-12-26 14:24:07,485][123090] Updated weights for policy 1, policy_version 1842374 (0.0010) [2023-12-26 14:24:07,547][123090] Updated weights for policy 1, policy_version 1842384 (0.0009) [2023-12-26 14:24:07,604][123090] Updated weights for policy 1, policy_version 1842394 (0.0010) [2023-12-26 14:24:07,982][123091] Updated weights for policy 0, policy_version 1854034 (0.0008) [2023-12-26 14:24:08,039][123091] Updated weights for policy 0, policy_version 1854044 (0.0010) [2023-12-26 14:24:08,105][123091] Updated weights for policy 0, policy_version 1854054 (0.0011) [2023-12-26 14:24:08,159][123091] Updated weights for policy 0, policy_version 1854064 (0.0010) [2023-12-26 14:24:08,433][123090] Updated weights for policy 1, policy_version 1842404 (0.0007) [2023-12-26 14:24:08,494][123090] Updated weights for policy 1, policy_version 1842414 (0.0005) [2023-12-26 14:24:08,551][123090] Updated weights for policy 1, policy_version 1842424 (0.0008) [2023-12-26 14:24:08,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 946307072. Throughput: 0: 8802.6, 1: 8873.6. Samples: 946282844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:08,785][121949] Avg episode reward: [(0, '6225.794'), (1, '5985.589')] [2023-12-26 14:24:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001854064_474644480.pth... [2023-12-26 14:24:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001842432_471662592.pth... [2023-12-26 14:24:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001853040_474382336.pth [2023-12-26 14:24:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001841408_471400448.pth [2023-12-26 14:24:08,994][123091] Updated weights for policy 0, policy_version 1854074 (0.0005) [2023-12-26 14:24:09,061][123091] Updated weights for policy 0, policy_version 1854084 (0.0006) [2023-12-26 14:24:09,122][123091] Updated weights for policy 0, policy_version 1854094 (0.0006) [2023-12-26 14:24:09,493][123090] Updated weights for policy 1, policy_version 1842434 (0.0008) [2023-12-26 14:24:09,555][123090] Updated weights for policy 1, policy_version 1842444 (0.0009) [2023-12-26 14:24:09,613][123090] Updated weights for policy 1, policy_version 1842454 (0.0009) [2023-12-26 14:24:09,686][123090] Updated weights for policy 1, policy_version 1842464 (0.0009) [2023-12-26 14:24:09,873][123091] Updated weights for policy 0, policy_version 1854104 (0.0010) [2023-12-26 14:24:09,941][123091] Updated weights for policy 0, policy_version 1854114 (0.0011) [2023-12-26 14:24:10,008][123091] Updated weights for policy 0, policy_version 1854124 (0.0011) [2023-12-26 14:24:10,544][123090] Updated weights for policy 1, policy_version 1842474 (0.0009) [2023-12-26 14:24:10,594][123090] Updated weights for policy 1, policy_version 1842484 (0.0009) [2023-12-26 14:24:10,655][123090] Updated weights for policy 1, policy_version 1842494 (0.0009) [2023-12-26 14:24:10,843][123091] Updated weights for policy 0, policy_version 1854134 (0.0011) [2023-12-26 14:24:10,898][123091] Updated weights for policy 0, policy_version 1854144 (0.0011) [2023-12-26 14:24:10,949][123091] Updated weights for policy 0, policy_version 1854154 (0.0010) [2023-12-26 14:24:11,487][123090] Updated weights for policy 1, policy_version 1842504 (0.0006) [2023-12-26 14:24:11,548][123090] Updated weights for policy 1, policy_version 1842514 (0.0005) [2023-12-26 14:24:11,613][123090] Updated weights for policy 1, policy_version 1842524 (0.0006) [2023-12-26 14:24:11,789][123091] Updated weights for policy 0, policy_version 1854164 (0.0009) [2023-12-26 14:24:11,845][123091] Updated weights for policy 0, policy_version 1854174 (0.0009) [2023-12-26 14:24:11,918][123091] Updated weights for policy 0, policy_version 1854184 (0.0010) [2023-12-26 14:24:12,394][123090] Updated weights for policy 1, policy_version 1842534 (0.0008) [2023-12-26 14:24:12,469][123090] Updated weights for policy 1, policy_version 1842544 (0.0006) [2023-12-26 14:24:12,534][123090] Updated weights for policy 1, policy_version 1842554 (0.0007) [2023-12-26 14:24:12,727][123091] Updated weights for policy 0, policy_version 1854194 (0.0008) [2023-12-26 14:24:12,803][123091] Updated weights for policy 0, policy_version 1854204 (0.0005) [2023-12-26 14:24:12,877][123091] Updated weights for policy 0, policy_version 1854214 (0.0005) [2023-12-26 14:24:12,945][123091] Updated weights for policy 0, policy_version 1854224 (0.0006) [2023-12-26 14:24:13,299][123090] Updated weights for policy 1, policy_version 1842564 (0.0007) [2023-12-26 14:24:13,349][123090] Updated weights for policy 1, policy_version 1842574 (0.0009) [2023-12-26 14:24:13,408][123090] Updated weights for policy 1, policy_version 1842584 (0.0010) [2023-12-26 14:24:13,656][123091] Updated weights for policy 0, policy_version 1854234 (0.0009) [2023-12-26 14:24:13,719][123091] Updated weights for policy 0, policy_version 1854244 (0.0006) [2023-12-26 14:24:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 946388992. Throughput: 0: 8808.4, 1: 8791.7. Samples: 946385764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:13,785][121949] Avg episode reward: [(0, '6289.994'), (1, '6029.744')] [2023-12-26 14:24:13,797][123091] Updated weights for policy 0, policy_version 1854254 (0.0006) [2023-12-26 14:24:14,311][123090] Updated weights for policy 1, policy_version 1842595 (0.0010) [2023-12-26 14:24:14,358][123090] Updated weights for policy 1, policy_version 1842605 (0.0009) [2023-12-26 14:24:14,414][123090] Updated weights for policy 1, policy_version 1842615 (0.0009) [2023-12-26 14:24:14,495][123091] Updated weights for policy 0, policy_version 1854264 (0.0009) [2023-12-26 14:24:14,546][123091] Updated weights for policy 0, policy_version 1854274 (0.0009) [2023-12-26 14:24:14,603][123091] Updated weights for policy 0, policy_version 1854284 (0.0010) [2023-12-26 14:24:15,290][123090] Updated weights for policy 1, policy_version 1842625 (0.0008) [2023-12-26 14:24:15,354][123091] Updated weights for policy 0, policy_version 1854294 (0.0009) [2023-12-26 14:24:15,357][123090] Updated weights for policy 1, policy_version 1842635 (0.0008) [2023-12-26 14:24:15,417][123091] Updated weights for policy 0, policy_version 1854304 (0.0009) [2023-12-26 14:24:15,421][123090] Updated weights for policy 1, policy_version 1842645 (0.0007) [2023-12-26 14:24:15,471][123091] Updated weights for policy 0, policy_version 1854314 (0.0010) [2023-12-26 14:24:15,475][123090] Updated weights for policy 1, policy_version 1842655 (0.0005) [2023-12-26 14:24:16,240][123091] Updated weights for policy 0, policy_version 1854324 (0.0009) [2023-12-26 14:24:16,292][123091] Updated weights for policy 0, policy_version 1854334 (0.0009) [2023-12-26 14:24:16,318][123090] Updated weights for policy 1, policy_version 1842665 (0.0008) [2023-12-26 14:24:16,347][123091] Updated weights for policy 0, policy_version 1854344 (0.0007) [2023-12-26 14:24:16,371][123090] Updated weights for policy 1, policy_version 1842675 (0.0008) [2023-12-26 14:24:16,421][123090] Updated weights for policy 1, policy_version 1842685 (0.0009) [2023-12-26 14:24:17,093][123091] Updated weights for policy 0, policy_version 1854354 (0.0006) [2023-12-26 14:24:17,150][123090] Updated weights for policy 1, policy_version 1842695 (0.0009) [2023-12-26 14:24:17,151][123091] Updated weights for policy 0, policy_version 1854364 (0.0008) [2023-12-26 14:24:17,197][123090] Updated weights for policy 1, policy_version 1842705 (0.0008) [2023-12-26 14:24:17,203][123091] Updated weights for policy 0, policy_version 1854374 (0.0009) [2023-12-26 14:24:17,246][123090] Updated weights for policy 1, policy_version 1842715 (0.0008) [2023-12-26 14:24:17,251][123091] Updated weights for policy 0, policy_version 1854384 (0.0008) [2023-12-26 14:24:18,072][123091] Updated weights for policy 0, policy_version 1854394 (0.0010) [2023-12-26 14:24:18,114][123090] Updated weights for policy 1, policy_version 1842725 (0.0009) [2023-12-26 14:24:18,130][123091] Updated weights for policy 0, policy_version 1854404 (0.0007) [2023-12-26 14:24:18,178][123090] Updated weights for policy 1, policy_version 1842735 (0.0010) [2023-12-26 14:24:18,185][123091] Updated weights for policy 0, policy_version 1854414 (0.0008) [2023-12-26 14:24:18,235][123090] Updated weights for policy 1, policy_version 1842745 (0.0009) [2023-12-26 14:24:18,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 946479104. Throughput: 0: 8887.8, 1: 8784.4. Samples: 946491476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:18,785][121949] Avg episode reward: [(0, '6333.399'), (1, '6028.698')] [2023-12-26 14:24:19,036][123091] Updated weights for policy 0, policy_version 1854424 (0.0009) [2023-12-26 14:24:19,049][123090] Updated weights for policy 1, policy_version 1842755 (0.0008) [2023-12-26 14:24:19,094][123091] Updated weights for policy 0, policy_version 1854434 (0.0009) [2023-12-26 14:24:19,106][123090] Updated weights for policy 1, policy_version 1842765 (0.0007) [2023-12-26 14:24:19,158][123091] Updated weights for policy 0, policy_version 1854444 (0.0008) [2023-12-26 14:24:19,161][123090] Updated weights for policy 1, policy_version 1842775 (0.0008) [2023-12-26 14:24:19,985][123091] Updated weights for policy 0, policy_version 1854454 (0.0008) [2023-12-26 14:24:20,024][123090] Updated weights for policy 1, policy_version 1842785 (0.0009) [2023-12-26 14:24:20,048][123091] Updated weights for policy 0, policy_version 1854464 (0.0008) [2023-12-26 14:24:20,087][123090] Updated weights for policy 1, policy_version 1842795 (0.0009) [2023-12-26 14:24:20,122][123091] Updated weights for policy 0, policy_version 1854474 (0.0007) [2023-12-26 14:24:20,154][123090] Updated weights for policy 1, policy_version 1842805 (0.0009) [2023-12-26 14:24:20,216][123090] Updated weights for policy 1, policy_version 1842815 (0.0009) [2023-12-26 14:24:20,919][123091] Updated weights for policy 0, policy_version 1854484 (0.0010) [2023-12-26 14:24:20,980][123091] Updated weights for policy 0, policy_version 1854494 (0.0011) [2023-12-26 14:24:21,041][123091] Updated weights for policy 0, policy_version 1854504 (0.0010) [2023-12-26 14:24:21,081][123090] Updated weights for policy 1, policy_version 1842825 (0.0007) [2023-12-26 14:24:21,154][123090] Updated weights for policy 1, policy_version 1842835 (0.0009) [2023-12-26 14:24:21,217][123090] Updated weights for policy 1, policy_version 1842845 (0.0010) [2023-12-26 14:24:21,873][123091] Updated weights for policy 0, policy_version 1854514 (0.0008) [2023-12-26 14:24:21,922][123091] Updated weights for policy 0, policy_version 1854524 (0.0009) [2023-12-26 14:24:21,975][123091] Updated weights for policy 0, policy_version 1854534 (0.0009) [2023-12-26 14:24:22,042][123091] Updated weights for policy 0, policy_version 1854544 (0.0009) [2023-12-26 14:24:22,096][123090] Updated weights for policy 1, policy_version 1842855 (0.0010) [2023-12-26 14:24:22,164][123090] Updated weights for policy 1, policy_version 1842865 (0.0009) [2023-12-26 14:24:22,225][123090] Updated weights for policy 1, policy_version 1842875 (0.0010) [2023-12-26 14:24:22,895][123091] Updated weights for policy 0, policy_version 1854554 (0.0009) [2023-12-26 14:24:22,959][123091] Updated weights for policy 0, policy_version 1854564 (0.0009) [2023-12-26 14:24:23,028][123091] Updated weights for policy 0, policy_version 1854574 (0.0009) [2023-12-26 14:24:23,077][123090] Updated weights for policy 1, policy_version 1842885 (0.0010) [2023-12-26 14:24:23,126][123090] Updated weights for policy 1, policy_version 1842895 (0.0009) [2023-12-26 14:24:23,174][123090] Updated weights for policy 1, policy_version 1842905 (0.0009) [2023-12-26 14:24:23,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 946561024. Throughput: 0: 8845.9, 1: 8745.0. Samples: 946542320. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:23,785][121949] Avg episode reward: [(0, '6207.835'), (1, '6017.391')] [2023-12-26 14:24:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001842912_471785472.pth... [2023-12-26 14:24:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001854576_474775552.pth... [2023-12-26 14:24:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001841920_471531520.pth [2023-12-26 14:24:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001853552_474513408.pth [2023-12-26 14:24:23,899][123090] Updated weights for policy 1, policy_version 1842915 (0.0007) [2023-12-26 14:24:23,927][123091] Updated weights for policy 0, policy_version 1854585 (0.0009) [2023-12-26 14:24:23,952][123090] Updated weights for policy 1, policy_version 1842925 (0.0005) [2023-12-26 14:24:23,982][123091] Updated weights for policy 0, policy_version 1854595 (0.0008) [2023-12-26 14:24:23,998][123090] Updated weights for policy 1, policy_version 1842935 (0.0008) [2023-12-26 14:24:24,034][123091] Updated weights for policy 0, policy_version 1854605 (0.0007) [2023-12-26 14:24:24,837][123090] Updated weights for policy 1, policy_version 1842945 (0.0007) [2023-12-26 14:24:24,894][123091] Updated weights for policy 0, policy_version 1854615 (0.0008) [2023-12-26 14:24:24,898][123090] Updated weights for policy 1, policy_version 1842956 (0.0008) [2023-12-26 14:24:24,949][123090] Updated weights for policy 1, policy_version 1842966 (0.0009) [2023-12-26 14:24:24,953][123091] Updated weights for policy 0, policy_version 1854625 (0.0009) [2023-12-26 14:24:25,000][123090] Updated weights for policy 1, policy_version 1842976 (0.0009) [2023-12-26 14:24:25,013][123091] Updated weights for policy 0, policy_version 1854635 (0.0009) [2023-12-26 14:24:25,785][123090] Updated weights for policy 1, policy_version 1842986 (0.0008) [2023-12-26 14:24:25,845][123090] Updated weights for policy 1, policy_version 1842996 (0.0010) [2023-12-26 14:24:25,898][123090] Updated weights for policy 1, policy_version 1843006 (0.0011) [2023-12-26 14:24:25,902][123091] Updated weights for policy 0, policy_version 1854645 (0.0010) [2023-12-26 14:24:25,952][123091] Updated weights for policy 0, policy_version 1854655 (0.0008) [2023-12-26 14:24:26,001][123091] Updated weights for policy 0, policy_version 1854665 (0.0009) [2023-12-26 14:24:26,738][123090] Updated weights for policy 1, policy_version 1843016 (0.0010) [2023-12-26 14:24:26,795][123091] Updated weights for policy 0, policy_version 1854675 (0.0007) [2023-12-26 14:24:26,797][123090] Updated weights for policy 1, policy_version 1843026 (0.0010) [2023-12-26 14:24:26,851][123090] Updated weights for policy 1, policy_version 1843036 (0.0010) [2023-12-26 14:24:26,887][123091] Updated weights for policy 0, policy_version 1854685 (0.0006) [2023-12-26 14:24:26,934][123091] Updated weights for policy 0, policy_version 1854695 (0.0008) [2023-12-26 14:24:27,635][123090] Updated weights for policy 1, policy_version 1843046 (0.0007) [2023-12-26 14:24:27,680][123090] Updated weights for policy 1, policy_version 1843056 (0.0005) [2023-12-26 14:24:27,731][123090] Updated weights for policy 1, policy_version 1843066 (0.0005) [2023-12-26 14:24:27,775][123091] Updated weights for policy 0, policy_version 1854705 (0.0009) [2023-12-26 14:24:27,841][123091] Updated weights for policy 0, policy_version 1854715 (0.0009) [2023-12-26 14:24:27,901][123091] Updated weights for policy 0, policy_version 1854725 (0.0009) [2023-12-26 14:24:27,949][123091] Updated weights for policy 0, policy_version 1854735 (0.0009) [2023-12-26 14:24:28,487][123090] Updated weights for policy 1, policy_version 1843076 (0.0006) [2023-12-26 14:24:28,546][123090] Updated weights for policy 1, policy_version 1843086 (0.0005) [2023-12-26 14:24:28,615][123090] Updated weights for policy 1, policy_version 1843096 (0.0008) [2023-12-26 14:24:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 946651136. Throughput: 0: 8803.3, 1: 8730.5. Samples: 946646072. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:28,785][121949] Avg episode reward: [(0, '6230.748'), (1, '5913.458')] [2023-12-26 14:24:28,822][123091] Updated weights for policy 0, policy_version 1854745 (0.0009) [2023-12-26 14:24:28,892][123091] Updated weights for policy 0, policy_version 1854755 (0.0009) [2023-12-26 14:24:28,950][123091] Updated weights for policy 0, policy_version 1854765 (0.0009) [2023-12-26 14:24:29,367][123090] Updated weights for policy 1, policy_version 1843106 (0.0009) [2023-12-26 14:24:29,433][123090] Updated weights for policy 1, policy_version 1843116 (0.0008) [2023-12-26 14:24:29,501][123090] Updated weights for policy 1, policy_version 1843126 (0.0008) [2023-12-26 14:24:29,566][123090] Updated weights for policy 1, policy_version 1843136 (0.0008) [2023-12-26 14:24:29,741][123091] Updated weights for policy 0, policy_version 1854775 (0.0006) [2023-12-26 14:24:29,797][123091] Updated weights for policy 0, policy_version 1854785 (0.0006) [2023-12-26 14:24:29,863][123091] Updated weights for policy 0, policy_version 1854795 (0.0008) [2023-12-26 14:24:30,370][123090] Updated weights for policy 1, policy_version 1843146 (0.0005) [2023-12-26 14:24:30,417][123090] Updated weights for policy 1, policy_version 1843156 (0.0005) [2023-12-26 14:24:30,465][123090] Updated weights for policy 1, policy_version 1843166 (0.0005) [2023-12-26 14:24:30,641][123091] Updated weights for policy 0, policy_version 1854805 (0.0008) [2023-12-26 14:24:30,703][123091] Updated weights for policy 0, policy_version 1854815 (0.0011) [2023-12-26 14:24:30,758][123091] Updated weights for policy 0, policy_version 1854825 (0.0010) [2023-12-26 14:24:31,222][123090] Updated weights for policy 1, policy_version 1843176 (0.0007) [2023-12-26 14:24:31,287][123090] Updated weights for policy 1, policy_version 1843186 (0.0006) [2023-12-26 14:24:31,350][123090] Updated weights for policy 1, policy_version 1843196 (0.0006) [2023-12-26 14:24:31,575][123091] Updated weights for policy 0, policy_version 1854835 (0.0009) [2023-12-26 14:24:31,639][123091] Updated weights for policy 0, policy_version 1854845 (0.0009) [2023-12-26 14:24:31,704][123091] Updated weights for policy 0, policy_version 1854855 (0.0010) [2023-12-26 14:24:32,136][123090] Updated weights for policy 1, policy_version 1843206 (0.0009) [2023-12-26 14:24:32,199][123090] Updated weights for policy 1, policy_version 1843216 (0.0010) [2023-12-26 14:24:32,262][123090] Updated weights for policy 1, policy_version 1843226 (0.0010) [2023-12-26 14:24:32,483][123091] Updated weights for policy 0, policy_version 1854865 (0.0009) [2023-12-26 14:24:32,547][123091] Updated weights for policy 0, policy_version 1854875 (0.0005) [2023-12-26 14:24:32,604][123091] Updated weights for policy 0, policy_version 1854885 (0.0005) [2023-12-26 14:24:32,669][123091] Updated weights for policy 0, policy_version 1854895 (0.0005) [2023-12-26 14:24:32,996][123090] Updated weights for policy 1, policy_version 1843236 (0.0005) [2023-12-26 14:24:33,069][123090] Updated weights for policy 1, policy_version 1843246 (0.0005) [2023-12-26 14:24:33,121][123090] Updated weights for policy 1, policy_version 1843256 (0.0005) [2023-12-26 14:24:33,245][123091] Updated weights for policy 0, policy_version 1854905 (0.0005) [2023-12-26 14:24:33,294][123091] Updated weights for policy 0, policy_version 1854915 (0.0007) [2023-12-26 14:24:33,342][123091] Updated weights for policy 0, policy_version 1854926 (0.0010) [2023-12-26 14:24:33,710][123090] Updated weights for policy 1, policy_version 1843266 (0.0006) [2023-12-26 14:24:33,758][123090] Updated weights for policy 1, policy_version 1843276 (0.0005) [2023-12-26 14:24:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 946741248. Throughput: 0: 8831.5, 1: 8733.3. Samples: 946754744. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:33,784][121949] Avg episode reward: [(0, '6291.007'), (1, '5909.459')] [2023-12-26 14:24:33,809][123090] Updated weights for policy 1, policy_version 1843286 (0.0005) [2023-12-26 14:24:33,887][123090] Updated weights for policy 1, policy_version 1843296 (0.0005) [2023-12-26 14:24:34,064][123091] Updated weights for policy 0, policy_version 1854936 (0.0005) [2023-12-26 14:24:34,116][123091] Updated weights for policy 0, policy_version 1854946 (0.0008) [2023-12-26 14:24:34,188][123091] Updated weights for policy 0, policy_version 1854956 (0.0010) [2023-12-26 14:24:34,636][123090] Updated weights for policy 1, policy_version 1843306 (0.0009) [2023-12-26 14:24:34,697][123090] Updated weights for policy 1, policy_version 1843316 (0.0010) [2023-12-26 14:24:34,750][123090] Updated weights for policy 1, policy_version 1843326 (0.0009) [2023-12-26 14:24:34,997][123091] Updated weights for policy 0, policy_version 1854966 (0.0007) [2023-12-26 14:24:35,069][123091] Updated weights for policy 0, policy_version 1854976 (0.0005) [2023-12-26 14:24:35,125][123091] Updated weights for policy 0, policy_version 1854986 (0.0005) [2023-12-26 14:24:35,612][123090] Updated weights for policy 1, policy_version 1843336 (0.0010) [2023-12-26 14:24:35,671][123090] Updated weights for policy 1, policy_version 1843346 (0.0010) [2023-12-26 14:24:35,722][123090] Updated weights for policy 1, policy_version 1843356 (0.0008) [2023-12-26 14:24:35,792][123091] Updated weights for policy 0, policy_version 1854996 (0.0009) [2023-12-26 14:24:35,844][123091] Updated weights for policy 0, policy_version 1855006 (0.0009) [2023-12-26 14:24:35,906][123091] Updated weights for policy 0, policy_version 1855016 (0.0010) [2023-12-26 14:24:36,543][123090] Updated weights for policy 1, policy_version 1843366 (0.0007) [2023-12-26 14:24:36,598][123090] Updated weights for policy 1, policy_version 1843376 (0.0009) [2023-12-26 14:24:36,655][123090] Updated weights for policy 1, policy_version 1843386 (0.0009) [2023-12-26 14:24:36,734][123091] Updated weights for policy 0, policy_version 1855026 (0.0010) [2023-12-26 14:24:36,797][123091] Updated weights for policy 0, policy_version 1855036 (0.0011) [2023-12-26 14:24:36,865][123091] Updated weights for policy 0, policy_version 1855046 (0.0011) [2023-12-26 14:24:36,929][123091] Updated weights for policy 0, policy_version 1855056 (0.0011) [2023-12-26 14:24:37,504][123090] Updated weights for policy 1, policy_version 1843396 (0.0009) [2023-12-26 14:24:37,567][123090] Updated weights for policy 1, policy_version 1843406 (0.0010) [2023-12-26 14:24:37,631][123090] Updated weights for policy 1, policy_version 1843416 (0.0009) [2023-12-26 14:24:37,668][123091] Updated weights for policy 0, policy_version 1855066 (0.0009) [2023-12-26 14:24:37,723][123091] Updated weights for policy 0, policy_version 1855076 (0.0006) [2023-12-26 14:24:37,779][123091] Updated weights for policy 0, policy_version 1855086 (0.0005) [2023-12-26 14:24:38,392][123091] Updated weights for policy 0, policy_version 1855096 (0.0008) [2023-12-26 14:24:38,445][123091] Updated weights for policy 0, policy_version 1855106 (0.0011) [2023-12-26 14:24:38,455][123090] Updated weights for policy 1, policy_version 1843426 (0.0006) [2023-12-26 14:24:38,510][123091] Updated weights for policy 0, policy_version 1855116 (0.0011) [2023-12-26 14:24:38,517][123090] Updated weights for policy 1, policy_version 1843436 (0.0006) [2023-12-26 14:24:38,569][123090] Updated weights for policy 1, policy_version 1843446 (0.0009) [2023-12-26 14:24:38,622][123090] Updated weights for policy 1, policy_version 1843456 (0.0009) [2023-12-26 14:24:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 946839552. Throughput: 0: 8854.5, 1: 8734.6. Samples: 946809568. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:24:38,785][121949] Avg episode reward: [(0, '6281.557'), (1, '5986.194')] [2023-12-26 14:24:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001855120_474914816.pth... [2023-12-26 14:24:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001843456_471924736.pth... [2023-12-26 14:24:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001854064_474644480.pth [2023-12-26 14:24:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001842432_471662592.pth [2023-12-26 14:24:39,349][123091] Updated weights for policy 0, policy_version 1855126 (0.0009) [2023-12-26 14:24:39,426][123091] Updated weights for policy 0, policy_version 1855136 (0.0011) [2023-12-26 14:24:39,476][123090] Updated weights for policy 1, policy_version 1843466 (0.0007) [2023-12-26 14:24:39,487][123091] Updated weights for policy 0, policy_version 1855146 (0.0011) [2023-12-26 14:24:39,534][123090] Updated weights for policy 1, policy_version 1843476 (0.0006) [2023-12-26 14:24:39,593][123090] Updated weights for policy 1, policy_version 1843486 (0.0006) [2023-12-26 14:24:40,375][123091] Updated weights for policy 0, policy_version 1855156 (0.0010) [2023-12-26 14:24:40,403][123090] Updated weights for policy 1, policy_version 1843496 (0.0007) [2023-12-26 14:24:40,447][123091] Updated weights for policy 0, policy_version 1855166 (0.0011) [2023-12-26 14:24:40,471][123090] Updated weights for policy 1, policy_version 1843506 (0.0008) [2023-12-26 14:24:40,504][123091] Updated weights for policy 0, policy_version 1855176 (0.0011) [2023-12-26 14:24:40,529][123090] Updated weights for policy 1, policy_version 1843516 (0.0006) [2023-12-26 14:24:41,167][123090] Updated weights for policy 1, policy_version 1843526 (0.0008) [2023-12-26 14:24:41,246][123090] Updated weights for policy 1, policy_version 1843536 (0.0010) [2023-12-26 14:24:41,294][123091] Updated weights for policy 0, policy_version 1855186 (0.0010) [2023-12-26 14:24:41,316][123090] Updated weights for policy 1, policy_version 1843546 (0.0009) [2023-12-26 14:24:41,360][123091] Updated weights for policy 0, policy_version 1855196 (0.0006) [2023-12-26 14:24:41,436][123091] Updated weights for policy 0, policy_version 1855206 (0.0007) [2023-12-26 14:24:41,492][123091] Updated weights for policy 0, policy_version 1855216 (0.0008) [2023-12-26 14:24:42,167][123090] Updated weights for policy 1, policy_version 1843556 (0.0009) [2023-12-26 14:24:42,226][123091] Updated weights for policy 0, policy_version 1855226 (0.0009) [2023-12-26 14:24:42,234][123090] Updated weights for policy 1, policy_version 1843566 (0.0007) [2023-12-26 14:24:42,295][123091] Updated weights for policy 0, policy_version 1855236 (0.0008) [2023-12-26 14:24:42,298][123090] Updated weights for policy 1, policy_version 1843576 (0.0008) [2023-12-26 14:24:42,364][123091] Updated weights for policy 0, policy_version 1855246 (0.0010) [2023-12-26 14:24:43,081][123091] Updated weights for policy 0, policy_version 1855256 (0.0008) [2023-12-26 14:24:43,112][123090] Updated weights for policy 1, policy_version 1843586 (0.0008) [2023-12-26 14:24:43,137][123091] Updated weights for policy 0, policy_version 1855266 (0.0009) [2023-12-26 14:24:43,171][123090] Updated weights for policy 1, policy_version 1843596 (0.0006) [2023-12-26 14:24:43,195][123091] Updated weights for policy 0, policy_version 1855276 (0.0010) [2023-12-26 14:24:43,228][123090] Updated weights for policy 1, policy_version 1843606 (0.0007) [2023-12-26 14:24:43,284][123090] Updated weights for policy 1, policy_version 1843616 (0.0009) [2023-12-26 14:24:43,784][121949] Fps is (10 sec: 18021.6, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 946921472. Throughput: 0: 8813.9, 1: 8746.3. Samples: 946915684. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:24:43,785][121949] Avg episode reward: [(0, '6133.531'), (1, '5710.958')] [2023-12-26 14:24:43,921][123091] Updated weights for policy 0, policy_version 1855286 (0.0006) [2023-12-26 14:24:43,981][123091] Updated weights for policy 0, policy_version 1855296 (0.0009) [2023-12-26 14:24:44,028][123091] Updated weights for policy 0, policy_version 1855306 (0.0009) [2023-12-26 14:24:44,047][123090] Updated weights for policy 1, policy_version 1843626 (0.0008) [2023-12-26 14:24:44,107][123090] Updated weights for policy 1, policy_version 1843636 (0.0009) [2023-12-26 14:24:44,177][123090] Updated weights for policy 1, policy_version 1843646 (0.0009) [2023-12-26 14:24:44,849][123090] Updated weights for policy 1, policy_version 1843656 (0.0006) [2023-12-26 14:24:44,905][123090] Updated weights for policy 1, policy_version 1843666 (0.0010) [2023-12-26 14:24:44,929][123091] Updated weights for policy 0, policy_version 1855316 (0.0007) [2023-12-26 14:24:44,969][123090] Updated weights for policy 1, policy_version 1843676 (0.0011) [2023-12-26 14:24:44,985][123091] Updated weights for policy 0, policy_version 1855326 (0.0006) [2023-12-26 14:24:45,048][123091] Updated weights for policy 0, policy_version 1855336 (0.0008) [2023-12-26 14:24:45,819][123090] Updated weights for policy 1, policy_version 1843686 (0.0011) [2023-12-26 14:24:45,828][123091] Updated weights for policy 0, policy_version 1855346 (0.0009) [2023-12-26 14:24:45,870][123090] Updated weights for policy 1, policy_version 1843696 (0.0010) [2023-12-26 14:24:45,885][123091] Updated weights for policy 0, policy_version 1855356 (0.0009) [2023-12-26 14:24:45,925][123090] Updated weights for policy 1, policy_version 1843706 (0.0010) [2023-12-26 14:24:45,945][123091] Updated weights for policy 0, policy_version 1855366 (0.0007) [2023-12-26 14:24:46,003][123091] Updated weights for policy 0, policy_version 1855376 (0.0008) [2023-12-26 14:24:46,561][123090] Updated weights for policy 1, policy_version 1843716 (0.0010) [2023-12-26 14:24:46,634][123090] Updated weights for policy 1, policy_version 1843726 (0.0009) [2023-12-26 14:24:46,703][123090] Updated weights for policy 1, policy_version 1843736 (0.0008) [2023-12-26 14:24:46,859][123091] Updated weights for policy 0, policy_version 1855386 (0.0009) [2023-12-26 14:24:46,918][123091] Updated weights for policy 0, policy_version 1855396 (0.0009) [2023-12-26 14:24:46,973][123091] Updated weights for policy 0, policy_version 1855406 (0.0009) [2023-12-26 14:24:47,453][123090] Updated weights for policy 1, policy_version 1843746 (0.0008) [2023-12-26 14:24:47,504][123090] Updated weights for policy 1, policy_version 1843756 (0.0010) [2023-12-26 14:24:47,551][123090] Updated weights for policy 1, policy_version 1843766 (0.0009) [2023-12-26 14:24:47,608][123090] Updated weights for policy 1, policy_version 1843776 (0.0008) [2023-12-26 14:24:47,829][123091] Updated weights for policy 0, policy_version 1855416 (0.0010) [2023-12-26 14:24:47,897][123091] Updated weights for policy 0, policy_version 1855426 (0.0009) [2023-12-26 14:24:47,962][123091] Updated weights for policy 0, policy_version 1855436 (0.0009) [2023-12-26 14:24:48,385][123090] Updated weights for policy 1, policy_version 1843786 (0.0010) [2023-12-26 14:24:48,451][123090] Updated weights for policy 1, policy_version 1843796 (0.0009) [2023-12-26 14:24:48,523][123090] Updated weights for policy 1, policy_version 1843806 (0.0009) [2023-12-26 14:24:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 947011584. Throughput: 0: 8867.4, 1: 8855.4. Samples: 947024004. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:24:48,785][121949] Avg episode reward: [(0, '6128.275'), (1, '5710.554')] [2023-12-26 14:24:48,818][123091] Updated weights for policy 0, policy_version 1855446 (0.0010) [2023-12-26 14:24:48,869][123091] Updated weights for policy 0, policy_version 1855456 (0.0010) [2023-12-26 14:24:48,922][123091] Updated weights for policy 0, policy_version 1855466 (0.0010) [2023-12-26 14:24:49,300][123090] Updated weights for policy 1, policy_version 1843816 (0.0010) [2023-12-26 14:24:49,373][123090] Updated weights for policy 1, policy_version 1843826 (0.0010) [2023-12-26 14:24:49,434][123090] Updated weights for policy 1, policy_version 1843836 (0.0009) [2023-12-26 14:24:49,766][123091] Updated weights for policy 0, policy_version 1855476 (0.0008) [2023-12-26 14:24:49,836][123091] Updated weights for policy 0, policy_version 1855486 (0.0010) [2023-12-26 14:24:49,886][123091] Updated weights for policy 0, policy_version 1855496 (0.0009) [2023-12-26 14:24:50,331][123090] Updated weights for policy 1, policy_version 1843846 (0.0009) [2023-12-26 14:24:50,412][123090] Updated weights for policy 1, policy_version 1843856 (0.0009) [2023-12-26 14:24:50,477][123090] Updated weights for policy 1, policy_version 1843866 (0.0010) [2023-12-26 14:24:50,581][123091] Updated weights for policy 0, policy_version 1855506 (0.0010) [2023-12-26 14:24:50,649][123091] Updated weights for policy 0, policy_version 1855516 (0.0009) [2023-12-26 14:24:50,721][123091] Updated weights for policy 0, policy_version 1855526 (0.0009) [2023-12-26 14:24:50,781][123091] Updated weights for policy 0, policy_version 1855536 (0.0009) [2023-12-26 14:24:51,355][123090] Updated weights for policy 1, policy_version 1843876 (0.0009) [2023-12-26 14:24:51,424][123090] Updated weights for policy 1, policy_version 1843886 (0.0011) [2023-12-26 14:24:51,489][123090] Updated weights for policy 1, policy_version 1843896 (0.0011) [2023-12-26 14:24:51,533][123091] Updated weights for policy 0, policy_version 1855546 (0.0010) [2023-12-26 14:24:51,599][123091] Updated weights for policy 0, policy_version 1855556 (0.0011) [2023-12-26 14:24:51,667][123091] Updated weights for policy 0, policy_version 1855566 (0.0010) [2023-12-26 14:24:52,291][123090] Updated weights for policy 1, policy_version 1843906 (0.0011) [2023-12-26 14:24:52,363][123090] Updated weights for policy 1, policy_version 1843916 (0.0011) [2023-12-26 14:24:52,397][123091] Updated weights for policy 0, policy_version 1855576 (0.0010) [2023-12-26 14:24:52,428][123090] Updated weights for policy 1, policy_version 1843926 (0.0010) [2023-12-26 14:24:52,456][123091] Updated weights for policy 0, policy_version 1855586 (0.0011) [2023-12-26 14:24:52,496][123090] Updated weights for policy 1, policy_version 1843936 (0.0011) [2023-12-26 14:24:52,518][123091] Updated weights for policy 0, policy_version 1855596 (0.0010) [2023-12-26 14:24:53,234][123091] Updated weights for policy 0, policy_version 1855606 (0.0005) [2023-12-26 14:24:53,302][123090] Updated weights for policy 1, policy_version 1843946 (0.0010) [2023-12-26 14:24:53,309][123091] Updated weights for policy 0, policy_version 1855616 (0.0005) [2023-12-26 14:24:53,358][123090] Updated weights for policy 1, policy_version 1843956 (0.0010) [2023-12-26 14:24:53,374][123091] Updated weights for policy 0, policy_version 1855626 (0.0006) [2023-12-26 14:24:53,402][123090] Updated weights for policy 1, policy_version 1843966 (0.0010) [2023-12-26 14:24:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 947101696. Throughput: 0: 8847.2, 1: 8777.1. Samples: 947075936. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:24:53,785][121949] Avg episode reward: [(0, '6188.035'), (1, '5855.286')] [2023-12-26 14:24:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001843968_472055808.pth... [2023-12-26 14:24:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001855632_475045888.pth... [2023-12-26 14:24:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001854576_474775552.pth [2023-12-26 14:24:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001842912_471785472.pth [2023-12-26 14:24:54,058][123091] Updated weights for policy 0, policy_version 1855636 (0.0010) [2023-12-26 14:24:54,122][123091] Updated weights for policy 0, policy_version 1855646 (0.0011) [2023-12-26 14:24:54,177][123090] Updated weights for policy 1, policy_version 1843976 (0.0008) [2023-12-26 14:24:54,182][123091] Updated weights for policy 0, policy_version 1855656 (0.0011) [2023-12-26 14:24:54,229][123090] Updated weights for policy 1, policy_version 1843986 (0.0010) [2023-12-26 14:24:54,284][123090] Updated weights for policy 1, policy_version 1843996 (0.0005) [2023-12-26 14:24:54,985][123090] Updated weights for policy 1, policy_version 1844006 (0.0006) [2023-12-26 14:24:54,995][123091] Updated weights for policy 0, policy_version 1855666 (0.0011) [2023-12-26 14:24:55,043][123091] Updated weights for policy 0, policy_version 1855676 (0.0006) [2023-12-26 14:24:55,047][123090] Updated weights for policy 1, policy_version 1844016 (0.0008) [2023-12-26 14:24:55,099][123091] Updated weights for policy 0, policy_version 1855686 (0.0005) [2023-12-26 14:24:55,110][123090] Updated weights for policy 1, policy_version 1844026 (0.0009) [2023-12-26 14:24:55,158][123091] Updated weights for policy 0, policy_version 1855696 (0.0005) [2023-12-26 14:24:55,848][123090] Updated weights for policy 1, policy_version 1844036 (0.0009) [2023-12-26 14:24:55,907][123091] Updated weights for policy 0, policy_version 1855706 (0.0010) [2023-12-26 14:24:55,918][123090] Updated weights for policy 1, policy_version 1844046 (0.0006) [2023-12-26 14:24:55,970][123091] Updated weights for policy 0, policy_version 1855716 (0.0007) [2023-12-26 14:24:55,989][123090] Updated weights for policy 1, policy_version 1844056 (0.0010) [2023-12-26 14:24:56,037][123091] Updated weights for policy 0, policy_version 1855726 (0.0007) [2023-12-26 14:24:56,658][123090] Updated weights for policy 1, policy_version 1844066 (0.0006) [2023-12-26 14:24:56,722][123090] Updated weights for policy 1, policy_version 1844076 (0.0005) [2023-12-26 14:24:56,791][123090] Updated weights for policy 1, policy_version 1844086 (0.0006) [2023-12-26 14:24:56,814][123091] Updated weights for policy 0, policy_version 1855736 (0.0010) [2023-12-26 14:24:56,852][123090] Updated weights for policy 1, policy_version 1844096 (0.0010) [2023-12-26 14:24:56,874][123091] Updated weights for policy 0, policy_version 1855746 (0.0010) [2023-12-26 14:24:56,935][123091] Updated weights for policy 0, policy_version 1855756 (0.0010) [2023-12-26 14:24:57,569][123090] Updated weights for policy 1, policy_version 1844106 (0.0008) [2023-12-26 14:24:57,628][123090] Updated weights for policy 1, policy_version 1844116 (0.0008) [2023-12-26 14:24:57,653][123091] Updated weights for policy 0, policy_version 1855766 (0.0010) [2023-12-26 14:24:57,692][123090] Updated weights for policy 1, policy_version 1844126 (0.0008) [2023-12-26 14:24:57,716][123091] Updated weights for policy 0, policy_version 1855776 (0.0009) [2023-12-26 14:24:57,772][123091] Updated weights for policy 0, policy_version 1855786 (0.0009) [2023-12-26 14:24:58,412][123090] Updated weights for policy 1, policy_version 1844136 (0.0008) [2023-12-26 14:24:58,477][123090] Updated weights for policy 1, policy_version 1844146 (0.0009) [2023-12-26 14:24:58,545][123090] Updated weights for policy 1, policy_version 1844156 (0.0009) [2023-12-26 14:24:58,589][123091] Updated weights for policy 0, policy_version 1855796 (0.0010) [2023-12-26 14:24:58,666][123091] Updated weights for policy 0, policy_version 1855806 (0.0011) [2023-12-26 14:24:58,738][123091] Updated weights for policy 0, policy_version 1855816 (0.0010) [2023-12-26 14:24:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 947191808. Throughput: 0: 8937.2, 1: 8890.3. Samples: 947188000. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:24:58,785][121949] Avg episode reward: [(0, '6354.111'), (1, '5894.487')] [2023-12-26 14:24:59,488][123090] Updated weights for policy 1, policy_version 1844166 (0.0009) [2023-12-26 14:24:59,552][123090] Updated weights for policy 1, policy_version 1844176 (0.0011) [2023-12-26 14:24:59,569][123091] Updated weights for policy 0, policy_version 1855826 (0.0009) [2023-12-26 14:24:59,617][123090] Updated weights for policy 1, policy_version 1844186 (0.0011) [2023-12-26 14:24:59,633][123091] Updated weights for policy 0, policy_version 1855836 (0.0007) [2023-12-26 14:24:59,701][123091] Updated weights for policy 0, policy_version 1855846 (0.0007) [2023-12-26 14:24:59,752][123091] Updated weights for policy 0, policy_version 1855856 (0.0009) [2023-12-26 14:25:00,409][123090] Updated weights for policy 1, policy_version 1844196 (0.0011) [2023-12-26 14:25:00,476][123090] Updated weights for policy 1, policy_version 1844206 (0.0010) [2023-12-26 14:25:00,535][123090] Updated weights for policy 1, policy_version 1844216 (0.0008) [2023-12-26 14:25:00,552][123091] Updated weights for policy 0, policy_version 1855866 (0.0010) [2023-12-26 14:25:00,614][123091] Updated weights for policy 0, policy_version 1855876 (0.0009) [2023-12-26 14:25:00,675][123091] Updated weights for policy 0, policy_version 1855886 (0.0010) [2023-12-26 14:25:01,292][123090] Updated weights for policy 1, policy_version 1844226 (0.0008) [2023-12-26 14:25:01,360][123090] Updated weights for policy 1, policy_version 1844236 (0.0011) [2023-12-26 14:25:01,435][123090] Updated weights for policy 1, policy_version 1844247 (0.0010) [2023-12-26 14:25:01,461][123091] Updated weights for policy 0, policy_version 1855896 (0.0006) [2023-12-26 14:25:01,514][123091] Updated weights for policy 0, policy_version 1855906 (0.0005) [2023-12-26 14:25:01,571][123091] Updated weights for policy 0, policy_version 1855916 (0.0005) [2023-12-26 14:25:02,191][123090] Updated weights for policy 1, policy_version 1844257 (0.0009) [2023-12-26 14:25:02,246][123090] Updated weights for policy 1, policy_version 1844267 (0.0009) [2023-12-26 14:25:02,305][123090] Updated weights for policy 1, policy_version 1844277 (0.0010) [2023-12-26 14:25:02,368][123090] Updated weights for policy 1, policy_version 1844287 (0.0009) [2023-12-26 14:25:02,389][123091] Updated weights for policy 0, policy_version 1855926 (0.0006) [2023-12-26 14:25:02,454][123091] Updated weights for policy 0, policy_version 1855936 (0.0005) [2023-12-26 14:25:02,523][123091] Updated weights for policy 0, policy_version 1855946 (0.0005) [2023-12-26 14:25:02,996][123090] Updated weights for policy 1, policy_version 1844297 (0.0006) [2023-12-26 14:25:03,054][123090] Updated weights for policy 1, policy_version 1844307 (0.0005) [2023-12-26 14:25:03,102][123090] Updated weights for policy 1, policy_version 1844317 (0.0005) [2023-12-26 14:25:03,384][123091] Updated weights for policy 0, policy_version 1855957 (0.0009) [2023-12-26 14:25:03,438][123091] Updated weights for policy 0, policy_version 1855967 (0.0009) [2023-12-26 14:25:03,494][123091] Updated weights for policy 0, policy_version 1855977 (0.0009) [2023-12-26 14:25:03,671][123090] Updated weights for policy 1, policy_version 1844327 (0.0005) [2023-12-26 14:25:03,717][123090] Updated weights for policy 1, policy_version 1844337 (0.0005) [2023-12-26 14:25:03,771][123090] Updated weights for policy 1, policy_version 1844347 (0.0006) [2023-12-26 14:25:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 947281920. Throughput: 0: 8860.8, 1: 8990.8. Samples: 947294800. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:03,785][121949] Avg episode reward: [(0, '6299.287'), (1, '5996.862')] [2023-12-26 14:25:04,308][123091] Updated weights for policy 0, policy_version 1855987 (0.0009) [2023-12-26 14:25:04,369][123091] Updated weights for policy 0, policy_version 1855997 (0.0009) [2023-12-26 14:25:04,429][123091] Updated weights for policy 0, policy_version 1856007 (0.0009) [2023-12-26 14:25:04,579][123090] Updated weights for policy 1, policy_version 1844357 (0.0010) [2023-12-26 14:25:04,628][123090] Updated weights for policy 1, policy_version 1844367 (0.0009) [2023-12-26 14:25:04,681][123090] Updated weights for policy 1, policy_version 1844377 (0.0007) [2023-12-26 14:25:05,146][123091] Updated weights for policy 0, policy_version 1856017 (0.0009) [2023-12-26 14:25:05,201][123091] Updated weights for policy 0, policy_version 1856027 (0.0010) [2023-12-26 14:25:05,263][123091] Updated weights for policy 0, policy_version 1856038 (0.0010) [2023-12-26 14:25:05,322][123091] Updated weights for policy 0, policy_version 1856048 (0.0010) [2023-12-26 14:25:05,426][123090] Updated weights for policy 1, policy_version 1844387 (0.0006) [2023-12-26 14:25:05,485][123090] Updated weights for policy 1, policy_version 1844397 (0.0005) [2023-12-26 14:25:05,551][123090] Updated weights for policy 1, policy_version 1844407 (0.0008) [2023-12-26 14:25:06,125][123091] Updated weights for policy 0, policy_version 1856058 (0.0010) [2023-12-26 14:25:06,190][123091] Updated weights for policy 0, policy_version 1856068 (0.0009) [2023-12-26 14:25:06,251][123091] Updated weights for policy 0, policy_version 1856078 (0.0009) [2023-12-26 14:25:06,307][123090] Updated weights for policy 1, policy_version 1844417 (0.0010) [2023-12-26 14:25:06,371][123090] Updated weights for policy 1, policy_version 1844427 (0.0011) [2023-12-26 14:25:06,439][123090] Updated weights for policy 1, policy_version 1844437 (0.0010) [2023-12-26 14:25:06,504][123090] Updated weights for policy 1, policy_version 1844447 (0.0009) [2023-12-26 14:25:07,086][123091] Updated weights for policy 0, policy_version 1856088 (0.0006) [2023-12-26 14:25:07,137][123091] Updated weights for policy 0, policy_version 1856098 (0.0005) [2023-12-26 14:25:07,194][123091] Updated weights for policy 0, policy_version 1856108 (0.0006) [2023-12-26 14:25:07,321][123090] Updated weights for policy 1, policy_version 1844457 (0.0006) [2023-12-26 14:25:07,392][123090] Updated weights for policy 1, policy_version 1844467 (0.0006) [2023-12-26 14:25:07,469][123090] Updated weights for policy 1, policy_version 1844477 (0.0006) [2023-12-26 14:25:07,946][123091] Updated weights for policy 0, policy_version 1856118 (0.0006) [2023-12-26 14:25:08,020][123091] Updated weights for policy 0, policy_version 1856128 (0.0007) [2023-12-26 14:25:08,087][123091] Updated weights for policy 0, policy_version 1856138 (0.0007) [2023-12-26 14:25:08,161][123090] Updated weights for policy 1, policy_version 1844487 (0.0011) [2023-12-26 14:25:08,229][123090] Updated weights for policy 1, policy_version 1844497 (0.0011) [2023-12-26 14:25:08,293][123090] Updated weights for policy 1, policy_version 1844507 (0.0011) [2023-12-26 14:25:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 947372032. Throughput: 0: 8881.9, 1: 9066.6. Samples: 947350000. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:08,785][121949] Avg episode reward: [(0, '6292.014'), (1, '6038.003')] [2023-12-26 14:25:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001844512_472195072.pth... [2023-12-26 14:25:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001843456_471924736.pth [2023-12-26 14:25:08,801][123091] Updated weights for policy 0, policy_version 1856148 (0.0009) [2023-12-26 14:25:08,865][123091] Updated weights for policy 0, policy_version 1856158 (0.0011) [2023-12-26 14:25:08,925][123091] Updated weights for policy 0, policy_version 1856168 (0.0011) [2023-12-26 14:25:08,974][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001856176_475185152.pth... [2023-12-26 14:25:08,979][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001855120_474914816.pth [2023-12-26 14:25:09,047][123090] Updated weights for policy 1, policy_version 1844517 (0.0008) [2023-12-26 14:25:09,095][123090] Updated weights for policy 1, policy_version 1844527 (0.0006) [2023-12-26 14:25:09,142][123090] Updated weights for policy 1, policy_version 1844537 (0.0005) [2023-12-26 14:25:09,704][123091] Updated weights for policy 0, policy_version 1856178 (0.0011) [2023-12-26 14:25:09,767][123091] Updated weights for policy 0, policy_version 1856188 (0.0011) [2023-12-26 14:25:09,834][123091] Updated weights for policy 0, policy_version 1856198 (0.0010) [2023-12-26 14:25:09,907][123091] Updated weights for policy 0, policy_version 1856208 (0.0007) [2023-12-26 14:25:09,951][123090] Updated weights for policy 1, policy_version 1844547 (0.0008) [2023-12-26 14:25:10,018][123090] Updated weights for policy 1, policy_version 1844557 (0.0009) [2023-12-26 14:25:10,074][123090] Updated weights for policy 1, policy_version 1844567 (0.0009) [2023-12-26 14:25:10,708][123091] Updated weights for policy 0, policy_version 1856218 (0.0011) [2023-12-26 14:25:10,768][123091] Updated weights for policy 0, policy_version 1856228 (0.0011) [2023-12-26 14:25:10,819][123091] Updated weights for policy 0, policy_version 1856238 (0.0010) [2023-12-26 14:25:10,934][123090] Updated weights for policy 1, policy_version 1844577 (0.0010) [2023-12-26 14:25:10,992][123090] Updated weights for policy 1, policy_version 1844587 (0.0009) [2023-12-26 14:25:11,065][123090] Updated weights for policy 1, policy_version 1844597 (0.0009) [2023-12-26 14:25:11,122][123090] Updated weights for policy 1, policy_version 1844607 (0.0009) [2023-12-26 14:25:11,693][123091] Updated weights for policy 0, policy_version 1856248 (0.0011) [2023-12-26 14:25:11,756][123091] Updated weights for policy 0, policy_version 1856258 (0.0013) [2023-12-26 14:25:11,811][123091] Updated weights for policy 0, policy_version 1856268 (0.0009) [2023-12-26 14:25:11,997][123090] Updated weights for policy 1, policy_version 1844617 (0.0010) [2023-12-26 14:25:12,053][123090] Updated weights for policy 1, policy_version 1844627 (0.0010) [2023-12-26 14:25:12,107][123090] Updated weights for policy 1, policy_version 1844637 (0.0011) [2023-12-26 14:25:12,672][123091] Updated weights for policy 0, policy_version 1856278 (0.0009) [2023-12-26 14:25:12,734][123091] Updated weights for policy 0, policy_version 1856288 (0.0009) [2023-12-26 14:25:12,800][123091] Updated weights for policy 0, policy_version 1856298 (0.0009) [2023-12-26 14:25:12,966][123090] Updated weights for policy 1, policy_version 1844647 (0.0011) [2023-12-26 14:25:13,034][123090] Updated weights for policy 1, policy_version 1844657 (0.0011) [2023-12-26 14:25:13,100][123090] Updated weights for policy 1, policy_version 1844667 (0.0010) [2023-12-26 14:25:13,571][123091] Updated weights for policy 0, policy_version 1856308 (0.0008) [2023-12-26 14:25:13,634][123091] Updated weights for policy 0, policy_version 1856318 (0.0005) [2023-12-26 14:25:13,702][123091] Updated weights for policy 0, policy_version 1856328 (0.0006) [2023-12-26 14:25:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 947462144. Throughput: 0: 8938.1, 1: 9027.9. Samples: 947454544. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:13,785][121949] Avg episode reward: [(0, '6325.088'), (1, '6088.054')] [2023-12-26 14:25:13,863][123090] Updated weights for policy 1, policy_version 1844677 (0.0010) [2023-12-26 14:25:13,920][123090] Updated weights for policy 1, policy_version 1844687 (0.0010) [2023-12-26 14:25:13,979][123090] Updated weights for policy 1, policy_version 1844697 (0.0010) [2023-12-26 14:25:14,510][123091] Updated weights for policy 0, policy_version 1856338 (0.0009) [2023-12-26 14:25:14,564][123091] Updated weights for policy 0, policy_version 1856348 (0.0009) [2023-12-26 14:25:14,616][123091] Updated weights for policy 0, policy_version 1856358 (0.0008) [2023-12-26 14:25:14,680][123091] Updated weights for policy 0, policy_version 1856368 (0.0009) [2023-12-26 14:25:14,793][123090] Updated weights for policy 1, policy_version 1844707 (0.0011) [2023-12-26 14:25:14,860][123090] Updated weights for policy 1, policy_version 1844717 (0.0011) [2023-12-26 14:25:14,919][123090] Updated weights for policy 1, policy_version 1844727 (0.0011) [2023-12-26 14:25:15,495][123091] Updated weights for policy 0, policy_version 1856378 (0.0009) [2023-12-26 14:25:15,553][123091] Updated weights for policy 0, policy_version 1856388 (0.0009) [2023-12-26 14:25:15,613][123091] Updated weights for policy 0, policy_version 1856398 (0.0009) [2023-12-26 14:25:15,694][123090] Updated weights for policy 1, policy_version 1844737 (0.0010) [2023-12-26 14:25:15,751][123090] Updated weights for policy 1, policy_version 1844747 (0.0005) [2023-12-26 14:25:15,808][123090] Updated weights for policy 1, policy_version 1844757 (0.0005) [2023-12-26 14:25:15,863][123090] Updated weights for policy 1, policy_version 1844767 (0.0005) [2023-12-26 14:25:16,488][123090] Updated weights for policy 1, policy_version 1844777 (0.0010) [2023-12-26 14:25:16,529][123091] Updated weights for policy 0, policy_version 1856408 (0.0007) [2023-12-26 14:25:16,544][123090] Updated weights for policy 1, policy_version 1844787 (0.0011) [2023-12-26 14:25:16,581][123091] Updated weights for policy 0, policy_version 1856418 (0.0006) [2023-12-26 14:25:16,591][123090] Updated weights for policy 1, policy_version 1844797 (0.0010) [2023-12-26 14:25:16,626][123091] Updated weights for policy 0, policy_version 1856428 (0.0007) [2023-12-26 14:25:17,382][123091] Updated weights for policy 0, policy_version 1856438 (0.0007) [2023-12-26 14:25:17,428][123091] Updated weights for policy 0, policy_version 1856448 (0.0005) [2023-12-26 14:25:17,429][123090] Updated weights for policy 1, policy_version 1844807 (0.0010) [2023-12-26 14:25:17,474][123091] Updated weights for policy 0, policy_version 1856458 (0.0005) [2023-12-26 14:25:17,495][123090] Updated weights for policy 1, policy_version 1844817 (0.0010) [2023-12-26 14:25:17,566][123090] Updated weights for policy 1, policy_version 1844827 (0.0011) [2023-12-26 14:25:18,162][123091] Updated weights for policy 0, policy_version 1856468 (0.0007) [2023-12-26 14:25:18,233][123091] Updated weights for policy 0, policy_version 1856478 (0.0009) [2023-12-26 14:25:18,278][123090] Updated weights for policy 1, policy_version 1844837 (0.0008) [2023-12-26 14:25:18,290][123091] Updated weights for policy 0, policy_version 1856488 (0.0008) [2023-12-26 14:25:18,345][123090] Updated weights for policy 1, policy_version 1844847 (0.0010) [2023-12-26 14:25:18,415][123090] Updated weights for policy 1, policy_version 1844857 (0.0011) [2023-12-26 14:25:18,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 947552256. Throughput: 0: 8935.1, 1: 9023.1. Samples: 947562864. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:18,785][121949] Avg episode reward: [(0, '6375.278'), (1, '6039.670')] [2023-12-26 14:25:19,117][123091] Updated weights for policy 0, policy_version 1856498 (0.0008) [2023-12-26 14:25:19,172][123091] Updated weights for policy 0, policy_version 1856508 (0.0005) [2023-12-26 14:25:19,181][123090] Updated weights for policy 1, policy_version 1844867 (0.0009) [2023-12-26 14:25:19,230][123091] Updated weights for policy 0, policy_version 1856518 (0.0006) [2023-12-26 14:25:19,244][123090] Updated weights for policy 1, policy_version 1844877 (0.0007) [2023-12-26 14:25:19,292][123091] Updated weights for policy 0, policy_version 1856528 (0.0007) [2023-12-26 14:25:19,317][123090] Updated weights for policy 1, policy_version 1844887 (0.0006) [2023-12-26 14:25:20,033][123091] Updated weights for policy 0, policy_version 1856538 (0.0008) [2023-12-26 14:25:20,081][123091] Updated weights for policy 0, policy_version 1856548 (0.0008) [2023-12-26 14:25:20,082][123090] Updated weights for policy 1, policy_version 1844897 (0.0008) [2023-12-26 14:25:20,138][123090] Updated weights for policy 1, policy_version 1844907 (0.0008) [2023-12-26 14:25:20,144][123091] Updated weights for policy 0, policy_version 1856558 (0.0008) [2023-12-26 14:25:20,190][123090] Updated weights for policy 1, policy_version 1844917 (0.0008) [2023-12-26 14:25:20,245][123090] Updated weights for policy 1, policy_version 1844927 (0.0008) [2023-12-26 14:25:21,026][123091] Updated weights for policy 0, policy_version 1856568 (0.0008) [2023-12-26 14:25:21,070][123090] Updated weights for policy 1, policy_version 1844937 (0.0008) [2023-12-26 14:25:21,097][123091] Updated weights for policy 0, policy_version 1856578 (0.0008) [2023-12-26 14:25:21,142][123090] Updated weights for policy 1, policy_version 1844947 (0.0010) [2023-12-26 14:25:21,165][123091] Updated weights for policy 0, policy_version 1856588 (0.0007) [2023-12-26 14:25:21,205][123090] Updated weights for policy 1, policy_version 1844957 (0.0009) [2023-12-26 14:25:21,955][123091] Updated weights for policy 0, policy_version 1856598 (0.0007) [2023-12-26 14:25:22,027][123091] Updated weights for policy 0, policy_version 1856608 (0.0006) [2023-12-26 14:25:22,086][123090] Updated weights for policy 1, policy_version 1844967 (0.0008) [2023-12-26 14:25:22,088][123091] Updated weights for policy 0, policy_version 1856618 (0.0008) [2023-12-26 14:25:22,152][123090] Updated weights for policy 1, policy_version 1844977 (0.0009) [2023-12-26 14:25:22,216][123090] Updated weights for policy 1, policy_version 1844987 (0.0009) [2023-12-26 14:25:22,832][123091] Updated weights for policy 0, policy_version 1856628 (0.0007) [2023-12-26 14:25:22,900][123091] Updated weights for policy 0, policy_version 1856638 (0.0007) [2023-12-26 14:25:22,955][123091] Updated weights for policy 0, policy_version 1856648 (0.0009) [2023-12-26 14:25:23,037][123090] Updated weights for policy 1, policy_version 1844997 (0.0009) [2023-12-26 14:25:23,104][123090] Updated weights for policy 1, policy_version 1845007 (0.0010) [2023-12-26 14:25:23,171][123090] Updated weights for policy 1, policy_version 1845017 (0.0009) [2023-12-26 14:25:23,763][123091] Updated weights for policy 0, policy_version 1856658 (0.0010) [2023-12-26 14:25:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 947634176. Throughput: 0: 8888.4, 1: 9014.4. Samples: 947615196. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:23,785][121949] Avg episode reward: [(0, '6386.891'), (1, '5951.542')] [2023-12-26 14:25:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001845024_472326144.pth... [2023-12-26 14:25:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001843968_472055808.pth [2023-12-26 14:25:23,820][123091] Updated weights for policy 0, policy_version 1856668 (0.0009) [2023-12-26 14:25:23,877][123091] Updated weights for policy 0, policy_version 1856678 (0.0008) [2023-12-26 14:25:23,926][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001856688_475316224.pth... [2023-12-26 14:25:23,928][123091] Updated weights for policy 0, policy_version 1856688 (0.0008) [2023-12-26 14:25:23,933][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001855632_475045888.pth [2023-12-26 14:25:24,001][123090] Updated weights for policy 1, policy_version 1845027 (0.0009) [2023-12-26 14:25:24,073][123090] Updated weights for policy 1, policy_version 1845037 (0.0009) [2023-12-26 14:25:24,131][123090] Updated weights for policy 1, policy_version 1845047 (0.0010) [2023-12-26 14:25:24,778][123091] Updated weights for policy 0, policy_version 1856698 (0.0009) [2023-12-26 14:25:24,848][123091] Updated weights for policy 0, policy_version 1856708 (0.0009) [2023-12-26 14:25:24,913][123091] Updated weights for policy 0, policy_version 1856718 (0.0010) [2023-12-26 14:25:24,964][123090] Updated weights for policy 1, policy_version 1845057 (0.0009) [2023-12-26 14:25:25,026][123090] Updated weights for policy 1, policy_version 1845067 (0.0008) [2023-12-26 14:25:25,081][123090] Updated weights for policy 1, policy_version 1845077 (0.0010) [2023-12-26 14:25:25,148][123090] Updated weights for policy 1, policy_version 1845087 (0.0009) [2023-12-26 14:25:25,670][123091] Updated weights for policy 0, policy_version 1856728 (0.0007) [2023-12-26 14:25:25,718][123091] Updated weights for policy 0, policy_version 1856738 (0.0006) [2023-12-26 14:25:25,778][123091] Updated weights for policy 0, policy_version 1856748 (0.0008) [2023-12-26 14:25:26,023][123090] Updated weights for policy 1, policy_version 1845097 (0.0009) [2023-12-26 14:25:26,095][123090] Updated weights for policy 1, policy_version 1845107 (0.0010) [2023-12-26 14:25:26,167][123090] Updated weights for policy 1, policy_version 1845117 (0.0010) [2023-12-26 14:25:26,592][123091] Updated weights for policy 0, policy_version 1856758 (0.0011) [2023-12-26 14:25:26,646][123091] Updated weights for policy 0, policy_version 1856768 (0.0010) [2023-12-26 14:25:26,709][123091] Updated weights for policy 0, policy_version 1856778 (0.0009) [2023-12-26 14:25:26,979][123090] Updated weights for policy 1, policy_version 1845127 (0.0009) [2023-12-26 14:25:27,042][123090] Updated weights for policy 1, policy_version 1845137 (0.0010) [2023-12-26 14:25:27,108][123090] Updated weights for policy 1, policy_version 1845148 (0.0009) [2023-12-26 14:25:27,522][123091] Updated weights for policy 0, policy_version 1856788 (0.0009) [2023-12-26 14:25:27,575][123091] Updated weights for policy 0, policy_version 1856798 (0.0009) [2023-12-26 14:25:27,631][123091] Updated weights for policy 0, policy_version 1856808 (0.0009) [2023-12-26 14:25:27,910][123090] Updated weights for policy 1, policy_version 1845158 (0.0007) [2023-12-26 14:25:27,972][123090] Updated weights for policy 1, policy_version 1845168 (0.0005) [2023-12-26 14:25:28,042][123090] Updated weights for policy 1, policy_version 1845178 (0.0007) [2023-12-26 14:25:28,476][123091] Updated weights for policy 0, policy_version 1856818 (0.0010) [2023-12-26 14:25:28,550][123091] Updated weights for policy 0, policy_version 1856828 (0.0010) [2023-12-26 14:25:28,623][123091] Updated weights for policy 0, policy_version 1856838 (0.0010) [2023-12-26 14:25:28,691][123091] Updated weights for policy 0, policy_version 1856848 (0.0009) [2023-12-26 14:25:28,783][123090] Updated weights for policy 1, policy_version 1845188 (0.0009) [2023-12-26 14:25:28,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 947724288. Throughput: 0: 8886.6, 1: 8952.7. Samples: 947718444. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:28,785][121949] Avg episode reward: [(0, '6323.595'), (1, '5856.388')] [2023-12-26 14:25:28,850][123090] Updated weights for policy 1, policy_version 1845198 (0.0009) [2023-12-26 14:25:28,914][123090] Updated weights for policy 1, policy_version 1845208 (0.0009) [2023-12-26 14:25:29,477][123091] Updated weights for policy 0, policy_version 1856858 (0.0010) [2023-12-26 14:25:29,532][123091] Updated weights for policy 0, policy_version 1856868 (0.0010) [2023-12-26 14:25:29,577][123090] Updated weights for policy 1, policy_version 1845218 (0.0008) [2023-12-26 14:25:29,588][123091] Updated weights for policy 0, policy_version 1856878 (0.0010) [2023-12-26 14:25:29,654][123090] Updated weights for policy 1, policy_version 1845228 (0.0005) [2023-12-26 14:25:29,732][123090] Updated weights for policy 1, policy_version 1845238 (0.0005) [2023-12-26 14:25:29,810][123090] Updated weights for policy 1, policy_version 1845248 (0.0005) [2023-12-26 14:25:30,364][123091] Updated weights for policy 0, policy_version 1856888 (0.0007) [2023-12-26 14:25:30,415][123091] Updated weights for policy 0, policy_version 1856898 (0.0005) [2023-12-26 14:25:30,433][123090] Updated weights for policy 1, policy_version 1845258 (0.0008) [2023-12-26 14:25:30,468][123091] Updated weights for policy 0, policy_version 1856908 (0.0005) [2023-12-26 14:25:30,486][123090] Updated weights for policy 1, policy_version 1845268 (0.0008) [2023-12-26 14:25:30,543][123090] Updated weights for policy 1, policy_version 1845278 (0.0009) [2023-12-26 14:25:31,125][123091] Updated weights for policy 0, policy_version 1856918 (0.0007) [2023-12-26 14:25:31,185][123091] Updated weights for policy 0, policy_version 1856928 (0.0006) [2023-12-26 14:25:31,257][123091] Updated weights for policy 0, policy_version 1856938 (0.0007) [2023-12-26 14:25:31,470][123090] Updated weights for policy 1, policy_version 1845288 (0.0009) [2023-12-26 14:25:31,532][123090] Updated weights for policy 1, policy_version 1845298 (0.0008) [2023-12-26 14:25:31,598][123090] Updated weights for policy 1, policy_version 1845308 (0.0009) [2023-12-26 14:25:32,021][123091] Updated weights for policy 0, policy_version 1856948 (0.0008) [2023-12-26 14:25:32,079][123091] Updated weights for policy 0, policy_version 1856958 (0.0009) [2023-12-26 14:25:32,132][123091] Updated weights for policy 0, policy_version 1856968 (0.0009) [2023-12-26 14:25:32,443][123090] Updated weights for policy 1, policy_version 1845318 (0.0009) [2023-12-26 14:25:32,491][123090] Updated weights for policy 1, policy_version 1845328 (0.0009) [2023-12-26 14:25:32,541][123090] Updated weights for policy 1, policy_version 1845338 (0.0009) [2023-12-26 14:25:32,881][123091] Updated weights for policy 0, policy_version 1856978 (0.0006) [2023-12-26 14:25:32,932][123091] Updated weights for policy 0, policy_version 1856988 (0.0008) [2023-12-26 14:25:32,986][123091] Updated weights for policy 0, policy_version 1856998 (0.0010) [2023-12-26 14:25:33,032][123091] Updated weights for policy 0, policy_version 1857008 (0.0008) [2023-12-26 14:25:33,436][123090] Updated weights for policy 1, policy_version 1845348 (0.0007) [2023-12-26 14:25:33,493][123090] Updated weights for policy 1, policy_version 1845358 (0.0005) [2023-12-26 14:25:33,553][123090] Updated weights for policy 1, policy_version 1845368 (0.0005) [2023-12-26 14:25:33,722][123091] Updated weights for policy 0, policy_version 1857018 (0.0005) [2023-12-26 14:25:33,768][123091] Updated weights for policy 0, policy_version 1857028 (0.0005) [2023-12-26 14:25:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 947814400. Throughput: 0: 8956.6, 1: 8906.8. Samples: 947827856. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:33,785][121949] Avg episode reward: [(0, '6254.042'), (1, '5906.875')] [2023-12-26 14:25:33,828][123091] Updated weights for policy 0, policy_version 1857038 (0.0009) [2023-12-26 14:25:34,208][123090] Updated weights for policy 1, policy_version 1845378 (0.0005) [2023-12-26 14:25:34,283][123090] Updated weights for policy 1, policy_version 1845388 (0.0007) [2023-12-26 14:25:34,353][123090] Updated weights for policy 1, policy_version 1845398 (0.0007) [2023-12-26 14:25:34,423][123090] Updated weights for policy 1, policy_version 1845408 (0.0006) [2023-12-26 14:25:34,516][123091] Updated weights for policy 0, policy_version 1857048 (0.0010) [2023-12-26 14:25:34,580][123091] Updated weights for policy 0, policy_version 1857058 (0.0010) [2023-12-26 14:25:34,653][123091] Updated weights for policy 0, policy_version 1857068 (0.0008) [2023-12-26 14:25:35,172][123090] Updated weights for policy 1, policy_version 1845418 (0.0009) [2023-12-26 14:25:35,240][123090] Updated weights for policy 1, policy_version 1845428 (0.0010) [2023-12-26 14:25:35,310][123090] Updated weights for policy 1, policy_version 1845438 (0.0008) [2023-12-26 14:25:35,403][123091] Updated weights for policy 0, policy_version 1857078 (0.0007) [2023-12-26 14:25:35,471][123091] Updated weights for policy 0, policy_version 1857088 (0.0010) [2023-12-26 14:25:35,535][123091] Updated weights for policy 0, policy_version 1857098 (0.0007) [2023-12-26 14:25:36,159][123090] Updated weights for policy 1, policy_version 1845448 (0.0010) [2023-12-26 14:25:36,234][123090] Updated weights for policy 1, policy_version 1845458 (0.0009) [2023-12-26 14:25:36,264][123091] Updated weights for policy 0, policy_version 1857108 (0.0005) [2023-12-26 14:25:36,303][123090] Updated weights for policy 1, policy_version 1845468 (0.0010) [2023-12-26 14:25:36,310][123091] Updated weights for policy 0, policy_version 1857118 (0.0008) [2023-12-26 14:25:36,361][123091] Updated weights for policy 0, policy_version 1857128 (0.0010) [2023-12-26 14:25:37,123][123090] Updated weights for policy 1, policy_version 1845478 (0.0010) [2023-12-26 14:25:37,192][123090] Updated weights for policy 1, policy_version 1845488 (0.0009) [2023-12-26 14:25:37,238][123091] Updated weights for policy 0, policy_version 1857138 (0.0010) [2023-12-26 14:25:37,258][123090] Updated weights for policy 1, policy_version 1845498 (0.0008) [2023-12-26 14:25:37,293][123091] Updated weights for policy 0, policy_version 1857148 (0.0009) [2023-12-26 14:25:37,344][123091] Updated weights for policy 0, policy_version 1857158 (0.0009) [2023-12-26 14:25:37,394][123091] Updated weights for policy 0, policy_version 1857168 (0.0009) [2023-12-26 14:25:38,058][123090] Updated weights for policy 1, policy_version 1845508 (0.0009) [2023-12-26 14:25:38,116][123090] Updated weights for policy 1, policy_version 1845518 (0.0010) [2023-12-26 14:25:38,188][123090] Updated weights for policy 1, policy_version 1845528 (0.0009) [2023-12-26 14:25:38,272][123091] Updated weights for policy 0, policy_version 1857178 (0.0006) [2023-12-26 14:25:38,334][123091] Updated weights for policy 0, policy_version 1857188 (0.0006) [2023-12-26 14:25:38,406][123091] Updated weights for policy 0, policy_version 1857198 (0.0009) [2023-12-26 14:25:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 947904512. Throughput: 0: 8971.9, 1: 8949.6. Samples: 947882400. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:38,785][121949] Avg episode reward: [(0, '6173.651'), (1, '5917.522')] [2023-12-26 14:25:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001857200_475447296.pth... [2023-12-26 14:25:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001845536_472457216.pth... [2023-12-26 14:25:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001844512_472195072.pth [2023-12-26 14:25:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001856176_475185152.pth [2023-12-26 14:25:39,039][123090] Updated weights for policy 1, policy_version 1845538 (0.0009) [2023-12-26 14:25:39,090][123090] Updated weights for policy 1, policy_version 1845548 (0.0009) [2023-12-26 14:25:39,138][123090] Updated weights for policy 1, policy_version 1845558 (0.0009) [2023-12-26 14:25:39,191][123090] Updated weights for policy 1, policy_version 1845568 (0.0008) [2023-12-26 14:25:39,202][123091] Updated weights for policy 0, policy_version 1857208 (0.0009) [2023-12-26 14:25:39,272][123091] Updated weights for policy 0, policy_version 1857218 (0.0009) [2023-12-26 14:25:39,342][123091] Updated weights for policy 0, policy_version 1857228 (0.0006) [2023-12-26 14:25:40,122][123090] Updated weights for policy 1, policy_version 1845578 (0.0009) [2023-12-26 14:25:40,163][123091] Updated weights for policy 0, policy_version 1857238 (0.0007) [2023-12-26 14:25:40,192][123090] Updated weights for policy 1, policy_version 1845588 (0.0008) [2023-12-26 14:25:40,220][123091] Updated weights for policy 0, policy_version 1857248 (0.0006) [2023-12-26 14:25:40,255][123090] Updated weights for policy 1, policy_version 1845598 (0.0007) [2023-12-26 14:25:40,285][123091] Updated weights for policy 0, policy_version 1857258 (0.0006) [2023-12-26 14:25:41,075][123090] Updated weights for policy 1, policy_version 1845608 (0.0009) [2023-12-26 14:25:41,119][123091] Updated weights for policy 0, policy_version 1857268 (0.0009) [2023-12-26 14:25:41,134][123090] Updated weights for policy 1, policy_version 1845618 (0.0009) [2023-12-26 14:25:41,179][123091] Updated weights for policy 0, policy_version 1857278 (0.0008) [2023-12-26 14:25:41,181][123090] Updated weights for policy 1, policy_version 1845628 (0.0008) [2023-12-26 14:25:41,250][123091] Updated weights for policy 0, policy_version 1857288 (0.0010) [2023-12-26 14:25:42,069][123090] Updated weights for policy 1, policy_version 1845638 (0.0008) [2023-12-26 14:25:42,099][123091] Updated weights for policy 0, policy_version 1857298 (0.0010) [2023-12-26 14:25:42,138][123090] Updated weights for policy 1, policy_version 1845648 (0.0009) [2023-12-26 14:25:42,164][123091] Updated weights for policy 0, policy_version 1857308 (0.0007) [2023-12-26 14:25:42,211][123090] Updated weights for policy 1, policy_version 1845658 (0.0009) [2023-12-26 14:25:42,223][123091] Updated weights for policy 0, policy_version 1857318 (0.0007) [2023-12-26 14:25:42,288][123091] Updated weights for policy 0, policy_version 1857328 (0.0006) [2023-12-26 14:25:43,029][123091] Updated weights for policy 0, policy_version 1857338 (0.0011) [2023-12-26 14:25:43,072][123090] Updated weights for policy 1, policy_version 1845668 (0.0009) [2023-12-26 14:25:43,085][123091] Updated weights for policy 0, policy_version 1857348 (0.0008) [2023-12-26 14:25:43,135][123090] Updated weights for policy 1, policy_version 1845678 (0.0010) [2023-12-26 14:25:43,146][123091] Updated weights for policy 0, policy_version 1857358 (0.0005) [2023-12-26 14:25:43,195][123090] Updated weights for policy 1, policy_version 1845688 (0.0011) [2023-12-26 14:25:43,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 947986432. Throughput: 0: 8859.6, 1: 8807.7. Samples: 947983032. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:43,785][121949] Avg episode reward: [(0, '6177.956'), (1, '5908.099')] [2023-12-26 14:25:43,791][123091] Updated weights for policy 0, policy_version 1857368 (0.0005) [2023-12-26 14:25:43,842][123091] Updated weights for policy 0, policy_version 1857378 (0.0005) [2023-12-26 14:25:43,899][123091] Updated weights for policy 0, policy_version 1857388 (0.0005) [2023-12-26 14:25:43,962][123090] Updated weights for policy 1, policy_version 1845698 (0.0006) [2023-12-26 14:25:44,016][123090] Updated weights for policy 1, policy_version 1845708 (0.0007) [2023-12-26 14:25:44,061][123090] Updated weights for policy 1, policy_version 1845718 (0.0009) [2023-12-26 14:25:44,122][123090] Updated weights for policy 1, policy_version 1845728 (0.0008) [2023-12-26 14:25:44,555][123091] Updated weights for policy 0, policy_version 1857398 (0.0005) [2023-12-26 14:25:44,608][123091] Updated weights for policy 0, policy_version 1857408 (0.0005) [2023-12-26 14:25:44,669][123091] Updated weights for policy 0, policy_version 1857418 (0.0005) [2023-12-26 14:25:44,957][123090] Updated weights for policy 1, policy_version 1845738 (0.0009) [2023-12-26 14:25:45,018][123090] Updated weights for policy 1, policy_version 1845748 (0.0009) [2023-12-26 14:25:45,075][123090] Updated weights for policy 1, policy_version 1845758 (0.0009) [2023-12-26 14:25:45,395][123091] Updated weights for policy 0, policy_version 1857428 (0.0005) [2023-12-26 14:25:45,440][123091] Updated weights for policy 0, policy_version 1857438 (0.0005) [2023-12-26 14:25:45,488][123091] Updated weights for policy 0, policy_version 1857448 (0.0005) [2023-12-26 14:25:45,792][123090] Updated weights for policy 1, policy_version 1845768 (0.0006) [2023-12-26 14:25:45,844][123090] Updated weights for policy 1, policy_version 1845778 (0.0005) [2023-12-26 14:25:45,910][123090] Updated weights for policy 1, policy_version 1845788 (0.0008) [2023-12-26 14:25:46,310][123091] Updated weights for policy 0, policy_version 1857458 (0.0007) [2023-12-26 14:25:46,372][123091] Updated weights for policy 0, policy_version 1857468 (0.0010) [2023-12-26 14:25:46,441][123091] Updated weights for policy 0, policy_version 1857478 (0.0011) [2023-12-26 14:25:46,510][123091] Updated weights for policy 0, policy_version 1857488 (0.0011) [2023-12-26 14:25:46,636][123090] Updated weights for policy 1, policy_version 1845798 (0.0005) [2023-12-26 14:25:46,711][123090] Updated weights for policy 1, policy_version 1845808 (0.0005) [2023-12-26 14:25:46,787][123090] Updated weights for policy 1, policy_version 1845818 (0.0005) [2023-12-26 14:25:47,197][123091] Updated weights for policy 0, policy_version 1857498 (0.0011) [2023-12-26 14:25:47,249][123091] Updated weights for policy 0, policy_version 1857508 (0.0010) [2023-12-26 14:25:47,297][123091] Updated weights for policy 0, policy_version 1857518 (0.0010) [2023-12-26 14:25:47,417][123090] Updated weights for policy 1, policy_version 1845828 (0.0006) [2023-12-26 14:25:47,486][123090] Updated weights for policy 1, policy_version 1845838 (0.0010) [2023-12-26 14:25:47,558][123090] Updated weights for policy 1, policy_version 1845848 (0.0005) [2023-12-26 14:25:48,082][123091] Updated weights for policy 0, policy_version 1857528 (0.0006) [2023-12-26 14:25:48,131][123091] Updated weights for policy 0, policy_version 1857538 (0.0005) [2023-12-26 14:25:48,177][123091] Updated weights for policy 0, policy_version 1857548 (0.0006) [2023-12-26 14:25:48,352][123090] Updated weights for policy 1, policy_version 1845858 (0.0007) [2023-12-26 14:25:48,418][123090] Updated weights for policy 1, policy_version 1845868 (0.0007) [2023-12-26 14:25:48,479][123090] Updated weights for policy 1, policy_version 1845878 (0.0006) [2023-12-26 14:25:48,546][123090] Updated weights for policy 1, policy_version 1845888 (0.0007) [2023-12-26 14:25:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 948084736. Throughput: 0: 9019.0, 1: 8820.1. Samples: 948097560. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:48,785][121949] Avg episode reward: [(0, '6157.233'), (1, '5932.483')] [2023-12-26 14:25:48,946][123091] Updated weights for policy 0, policy_version 1857558 (0.0009) [2023-12-26 14:25:48,998][123091] Updated weights for policy 0, policy_version 1857568 (0.0010) [2023-12-26 14:25:49,048][123091] Updated weights for policy 0, policy_version 1857578 (0.0010) [2023-12-26 14:25:49,297][123090] Updated weights for policy 1, policy_version 1845898 (0.0011) [2023-12-26 14:25:49,369][123090] Updated weights for policy 1, policy_version 1845908 (0.0011) [2023-12-26 14:25:49,418][123090] Updated weights for policy 1, policy_version 1845918 (0.0011) [2023-12-26 14:25:49,817][123091] Updated weights for policy 0, policy_version 1857588 (0.0009) [2023-12-26 14:25:49,883][123091] Updated weights for policy 0, policy_version 1857598 (0.0010) [2023-12-26 14:25:49,950][123091] Updated weights for policy 0, policy_version 1857608 (0.0009) [2023-12-26 14:25:50,272][123090] Updated weights for policy 1, policy_version 1845928 (0.0010) [2023-12-26 14:25:50,338][123090] Updated weights for policy 1, policy_version 1845938 (0.0009) [2023-12-26 14:25:50,395][123090] Updated weights for policy 1, policy_version 1845948 (0.0009) [2023-12-26 14:25:50,709][123091] Updated weights for policy 0, policy_version 1857618 (0.0006) [2023-12-26 14:25:50,774][123091] Updated weights for policy 0, policy_version 1857628 (0.0007) [2023-12-26 14:25:50,830][123091] Updated weights for policy 0, policy_version 1857638 (0.0006) [2023-12-26 14:25:50,884][123091] Updated weights for policy 0, policy_version 1857648 (0.0009) [2023-12-26 14:25:51,291][123090] Updated weights for policy 1, policy_version 1845958 (0.0007) [2023-12-26 14:25:51,367][123090] Updated weights for policy 1, policy_version 1845968 (0.0009) [2023-12-26 14:25:51,435][123090] Updated weights for policy 1, policy_version 1845978 (0.0009) [2023-12-26 14:25:51,694][123091] Updated weights for policy 0, policy_version 1857658 (0.0010) [2023-12-26 14:25:51,758][123091] Updated weights for policy 0, policy_version 1857668 (0.0009) [2023-12-26 14:25:51,820][123091] Updated weights for policy 0, policy_version 1857678 (0.0010) [2023-12-26 14:25:52,269][123090] Updated weights for policy 1, policy_version 1845988 (0.0009) [2023-12-26 14:25:52,336][123090] Updated weights for policy 1, policy_version 1845998 (0.0005) [2023-12-26 14:25:52,410][123090] Updated weights for policy 1, policy_version 1846008 (0.0008) [2023-12-26 14:25:52,644][123091] Updated weights for policy 0, policy_version 1857688 (0.0011) [2023-12-26 14:25:52,714][123091] Updated weights for policy 0, policy_version 1857698 (0.0011) [2023-12-26 14:25:52,788][123091] Updated weights for policy 0, policy_version 1857708 (0.0011) [2023-12-26 14:25:53,112][123090] Updated weights for policy 1, policy_version 1846018 (0.0010) [2023-12-26 14:25:53,178][123090] Updated weights for policy 1, policy_version 1846028 (0.0008) [2023-12-26 14:25:53,234][123090] Updated weights for policy 1, policy_version 1846038 (0.0006) [2023-12-26 14:25:53,304][123090] Updated weights for policy 1, policy_version 1846048 (0.0005) [2023-12-26 14:25:53,598][123091] Updated weights for policy 0, policy_version 1857718 (0.0011) [2023-12-26 14:25:53,668][123091] Updated weights for policy 0, policy_version 1857728 (0.0011) [2023-12-26 14:25:53,742][123091] Updated weights for policy 0, policy_version 1857738 (0.0011) [2023-12-26 14:25:53,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 948174848. Throughput: 0: 9021.4, 1: 8747.5. Samples: 948149600. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:53,784][121949] Avg episode reward: [(0, '6206.701'), (1, '5778.250')] [2023-12-26 14:25:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001857744_475586560.pth... [2023-12-26 14:25:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001846048_472588288.pth... [2023-12-26 14:25:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001856688_475316224.pth [2023-12-26 14:25:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001845024_472326144.pth [2023-12-26 14:25:53,947][123090] Updated weights for policy 1, policy_version 1846058 (0.0005) [2023-12-26 14:25:53,998][123090] Updated weights for policy 1, policy_version 1846068 (0.0005) [2023-12-26 14:25:54,056][123090] Updated weights for policy 1, policy_version 1846078 (0.0007) [2023-12-26 14:25:54,463][123091] Updated weights for policy 0, policy_version 1857748 (0.0009) [2023-12-26 14:25:54,514][123091] Updated weights for policy 0, policy_version 1857758 (0.0009) [2023-12-26 14:25:54,574][123091] Updated weights for policy 0, policy_version 1857768 (0.0010) [2023-12-26 14:25:54,863][123090] Updated weights for policy 1, policy_version 1846088 (0.0009) [2023-12-26 14:25:54,918][123090] Updated weights for policy 1, policy_version 1846098 (0.0010) [2023-12-26 14:25:54,978][123090] Updated weights for policy 1, policy_version 1846108 (0.0010) [2023-12-26 14:25:55,293][123091] Updated weights for policy 0, policy_version 1857778 (0.0009) [2023-12-26 14:25:55,345][123091] Updated weights for policy 0, policy_version 1857788 (0.0005) [2023-12-26 14:25:55,397][123091] Updated weights for policy 0, policy_version 1857798 (0.0005) [2023-12-26 14:25:55,446][123091] Updated weights for policy 0, policy_version 1857808 (0.0005) [2023-12-26 14:25:55,899][123090] Updated weights for policy 1, policy_version 1846118 (0.0007) [2023-12-26 14:25:55,954][123090] Updated weights for policy 1, policy_version 1846128 (0.0007) [2023-12-26 14:25:56,015][123090] Updated weights for policy 1, policy_version 1846139 (0.0010) [2023-12-26 14:25:56,140][123091] Updated weights for policy 0, policy_version 1857818 (0.0006) [2023-12-26 14:25:56,207][123091] Updated weights for policy 0, policy_version 1857828 (0.0008) [2023-12-26 14:25:56,277][123091] Updated weights for policy 0, policy_version 1857838 (0.0008) [2023-12-26 14:25:56,891][123091] Updated weights for policy 0, policy_version 1857848 (0.0006) [2023-12-26 14:25:56,904][123090] Updated weights for policy 1, policy_version 1846149 (0.0009) [2023-12-26 14:25:56,946][123091] Updated weights for policy 0, policy_version 1857858 (0.0005) [2023-12-26 14:25:56,964][123090] Updated weights for policy 1, policy_version 1846159 (0.0008) [2023-12-26 14:25:57,003][123091] Updated weights for policy 0, policy_version 1857868 (0.0005) [2023-12-26 14:25:57,028][123090] Updated weights for policy 1, policy_version 1846169 (0.0009) [2023-12-26 14:25:57,632][123091] Updated weights for policy 0, policy_version 1857878 (0.0007) [2023-12-26 14:25:57,686][123091] Updated weights for policy 0, policy_version 1857888 (0.0010) [2023-12-26 14:25:57,745][123091] Updated weights for policy 0, policy_version 1857898 (0.0009) [2023-12-26 14:25:57,902][123090] Updated weights for policy 1, policy_version 1846179 (0.0009) [2023-12-26 14:25:57,955][123090] Updated weights for policy 1, policy_version 1846189 (0.0009) [2023-12-26 14:25:58,006][123090] Updated weights for policy 1, policy_version 1846199 (0.0009) [2023-12-26 14:25:58,615][123091] Updated weights for policy 0, policy_version 1857908 (0.0009) [2023-12-26 14:25:58,684][123091] Updated weights for policy 0, policy_version 1857918 (0.0009) [2023-12-26 14:25:58,750][123091] Updated weights for policy 0, policy_version 1857928 (0.0009) [2023-12-26 14:25:58,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 948256768. Throughput: 0: 9090.6, 1: 8755.6. Samples: 948257620. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:25:58,785][121949] Avg episode reward: [(0, '6315.479'), (1, '5717.663')] [2023-12-26 14:25:58,891][123090] Updated weights for policy 1, policy_version 1846209 (0.0009) [2023-12-26 14:25:58,957][123090] Updated weights for policy 1, policy_version 1846219 (0.0009) [2023-12-26 14:25:59,010][123090] Updated weights for policy 1, policy_version 1846229 (0.0009) [2023-12-26 14:25:59,059][123090] Updated weights for policy 1, policy_version 1846239 (0.0009) [2023-12-26 14:25:59,539][123091] Updated weights for policy 0, policy_version 1857938 (0.0007) [2023-12-26 14:25:59,591][123091] Updated weights for policy 0, policy_version 1857948 (0.0005) [2023-12-26 14:25:59,636][123091] Updated weights for policy 0, policy_version 1857958 (0.0005) [2023-12-26 14:25:59,682][123091] Updated weights for policy 0, policy_version 1857968 (0.0005) [2023-12-26 14:25:59,935][123090] Updated weights for policy 1, policy_version 1846249 (0.0011) [2023-12-26 14:25:59,991][123090] Updated weights for policy 1, policy_version 1846259 (0.0010) [2023-12-26 14:26:00,046][123090] Updated weights for policy 1, policy_version 1846269 (0.0006) [2023-12-26 14:26:00,507][123091] Updated weights for policy 0, policy_version 1857978 (0.0006) [2023-12-26 14:26:00,561][123091] Updated weights for policy 0, policy_version 1857988 (0.0005) [2023-12-26 14:26:00,612][123091] Updated weights for policy 0, policy_version 1857998 (0.0008) [2023-12-26 14:26:00,750][123090] Updated weights for policy 1, policy_version 1846279 (0.0006) [2023-12-26 14:26:00,820][123090] Updated weights for policy 1, policy_version 1846289 (0.0005) [2023-12-26 14:26:00,876][123090] Updated weights for policy 1, policy_version 1846299 (0.0006) [2023-12-26 14:26:01,428][123091] Updated weights for policy 0, policy_version 1858008 (0.0008) [2023-12-26 14:26:01,479][123091] Updated weights for policy 0, policy_version 1858018 (0.0008) [2023-12-26 14:26:01,532][123091] Updated weights for policy 0, policy_version 1858028 (0.0006) [2023-12-26 14:26:01,648][123090] Updated weights for policy 1, policy_version 1846309 (0.0009) [2023-12-26 14:26:01,707][123090] Updated weights for policy 1, policy_version 1846319 (0.0010) [2023-12-26 14:26:01,776][123090] Updated weights for policy 1, policy_version 1846329 (0.0009) [2023-12-26 14:26:02,385][123091] Updated weights for policy 0, policy_version 1858038 (0.0010) [2023-12-26 14:26:02,445][123091] Updated weights for policy 0, policy_version 1858048 (0.0009) [2023-12-26 14:26:02,500][123091] Updated weights for policy 0, policy_version 1858058 (0.0009) [2023-12-26 14:26:02,611][123090] Updated weights for policy 1, policy_version 1846339 (0.0010) [2023-12-26 14:26:02,674][123090] Updated weights for policy 1, policy_version 1846349 (0.0010) [2023-12-26 14:26:02,725][123090] Updated weights for policy 1, policy_version 1846359 (0.0010) [2023-12-26 14:26:03,392][123091] Updated weights for policy 0, policy_version 1858068 (0.0009) [2023-12-26 14:26:03,423][123090] Updated weights for policy 1, policy_version 1846369 (0.0010) [2023-12-26 14:26:03,441][123091] Updated weights for policy 0, policy_version 1858078 (0.0009) [2023-12-26 14:26:03,478][123090] Updated weights for policy 1, policy_version 1846379 (0.0006) [2023-12-26 14:26:03,493][123091] Updated weights for policy 0, policy_version 1858088 (0.0009) [2023-12-26 14:26:03,537][123090] Updated weights for policy 1, policy_version 1846389 (0.0005) [2023-12-26 14:26:03,592][123090] Updated weights for policy 1, policy_version 1846399 (0.0005) [2023-12-26 14:26:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 948355072. Throughput: 0: 9038.4, 1: 8723.9. Samples: 948362168. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:03,785][121949] Avg episode reward: [(0, '6307.359'), (1, '5747.196')] [2023-12-26 14:26:04,185][123090] Updated weights for policy 1, policy_version 1846409 (0.0010) [2023-12-26 14:26:04,250][123090] Updated weights for policy 1, policy_version 1846419 (0.0011) [2023-12-26 14:26:04,299][123090] Updated weights for policy 1, policy_version 1846429 (0.0006) [2023-12-26 14:26:04,401][123091] Updated weights for policy 0, policy_version 1858098 (0.0010) [2023-12-26 14:26:04,476][123091] Updated weights for policy 0, policy_version 1858108 (0.0009) [2023-12-26 14:26:04,545][123091] Updated weights for policy 0, policy_version 1858118 (0.0010) [2023-12-26 14:26:04,609][123091] Updated weights for policy 0, policy_version 1858128 (0.0010) [2023-12-26 14:26:05,013][123090] Updated weights for policy 1, policy_version 1846439 (0.0005) [2023-12-26 14:26:05,077][123090] Updated weights for policy 1, policy_version 1846449 (0.0007) [2023-12-26 14:26:05,135][123090] Updated weights for policy 1, policy_version 1846459 (0.0007) [2023-12-26 14:26:05,520][123091] Updated weights for policy 0, policy_version 1858138 (0.0006) [2023-12-26 14:26:05,582][123091] Updated weights for policy 0, policy_version 1858148 (0.0008) [2023-12-26 14:26:05,644][123091] Updated weights for policy 0, policy_version 1858158 (0.0008) [2023-12-26 14:26:05,811][123090] Updated weights for policy 1, policy_version 1846469 (0.0008) [2023-12-26 14:26:05,875][123090] Updated weights for policy 1, policy_version 1846479 (0.0009) [2023-12-26 14:26:05,918][123090] Updated weights for policy 1, policy_version 1846489 (0.0005) [2023-12-26 14:26:06,411][123091] Updated weights for policy 0, policy_version 1858168 (0.0006) [2023-12-26 14:26:06,486][123091] Updated weights for policy 0, policy_version 1858178 (0.0009) [2023-12-26 14:26:06,555][123091] Updated weights for policy 0, policy_version 1858188 (0.0009) [2023-12-26 14:26:06,621][123090] Updated weights for policy 1, policy_version 1846499 (0.0007) [2023-12-26 14:26:06,691][123090] Updated weights for policy 1, policy_version 1846509 (0.0008) [2023-12-26 14:26:06,759][123090] Updated weights for policy 1, policy_version 1846519 (0.0008) [2023-12-26 14:26:07,309][123091] Updated weights for policy 0, policy_version 1858198 (0.0006) [2023-12-26 14:26:07,384][123091] Updated weights for policy 0, policy_version 1858208 (0.0006) [2023-12-26 14:26:07,452][123091] Updated weights for policy 0, policy_version 1858218 (0.0006) [2023-12-26 14:26:07,571][123090] Updated weights for policy 1, policy_version 1846529 (0.0007) [2023-12-26 14:26:07,640][123090] Updated weights for policy 1, policy_version 1846539 (0.0005) [2023-12-26 14:26:07,717][123090] Updated weights for policy 1, policy_version 1846549 (0.0005) [2023-12-26 14:26:07,780][123090] Updated weights for policy 1, policy_version 1846559 (0.0007) [2023-12-26 14:26:08,185][123091] Updated weights for policy 0, policy_version 1858228 (0.0010) [2023-12-26 14:26:08,244][123091] Updated weights for policy 0, policy_version 1858238 (0.0010) [2023-12-26 14:26:08,302][123091] Updated weights for policy 0, policy_version 1858248 (0.0010) [2023-12-26 14:26:08,435][123090] Updated weights for policy 1, policy_version 1846569 (0.0009) [2023-12-26 14:26:08,499][123090] Updated weights for policy 1, policy_version 1846579 (0.0010) [2023-12-26 14:26:08,560][123090] Updated weights for policy 1, policy_version 1846589 (0.0010) [2023-12-26 14:26:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 948445184. Throughput: 0: 9013.6, 1: 8812.2. Samples: 948417360. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:08,785][121949] Avg episode reward: [(0, '6380.556'), (1, '5807.967')] [2023-12-26 14:26:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001858256_475717632.pth... [2023-12-26 14:26:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001846592_472727552.pth... [2023-12-26 14:26:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001857200_475447296.pth [2023-12-26 14:26:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001845536_472457216.pth [2023-12-26 14:26:09,074][123091] Updated weights for policy 0, policy_version 1858258 (0.0007) [2023-12-26 14:26:09,143][123091] Updated weights for policy 0, policy_version 1858268 (0.0006) [2023-12-26 14:26:09,220][123091] Updated weights for policy 0, policy_version 1858278 (0.0006) [2023-12-26 14:26:09,291][123091] Updated weights for policy 0, policy_version 1858288 (0.0010) [2023-12-26 14:26:09,481][123090] Updated weights for policy 1, policy_version 1846599 (0.0011) [2023-12-26 14:26:09,542][123090] Updated weights for policy 1, policy_version 1846609 (0.0011) [2023-12-26 14:26:09,593][123090] Updated weights for policy 1, policy_version 1846619 (0.0010) [2023-12-26 14:26:10,144][123091] Updated weights for policy 0, policy_version 1858298 (0.0010) [2023-12-26 14:26:10,208][123091] Updated weights for policy 0, policy_version 1858308 (0.0009) [2023-12-26 14:26:10,257][123091] Updated weights for policy 0, policy_version 1858318 (0.0009) [2023-12-26 14:26:10,458][123090] Updated weights for policy 1, policy_version 1846629 (0.0011) [2023-12-26 14:26:10,526][123090] Updated weights for policy 1, policy_version 1846639 (0.0011) [2023-12-26 14:26:10,593][123090] Updated weights for policy 1, policy_version 1846649 (0.0011) [2023-12-26 14:26:11,096][123091] Updated weights for policy 0, policy_version 1858328 (0.0009) [2023-12-26 14:26:11,168][123091] Updated weights for policy 0, policy_version 1858338 (0.0010) [2023-12-26 14:26:11,236][123091] Updated weights for policy 0, policy_version 1858348 (0.0009) [2023-12-26 14:26:11,448][123090] Updated weights for policy 1, policy_version 1846659 (0.0011) [2023-12-26 14:26:11,509][123090] Updated weights for policy 1, policy_version 1846669 (0.0011) [2023-12-26 14:26:11,574][123090] Updated weights for policy 1, policy_version 1846679 (0.0011) [2023-12-26 14:26:12,098][123091] Updated weights for policy 0, policy_version 1858358 (0.0009) [2023-12-26 14:26:12,152][123091] Updated weights for policy 0, policy_version 1858368 (0.0009) [2023-12-26 14:26:12,205][123091] Updated weights for policy 0, policy_version 1858378 (0.0009) [2023-12-26 14:26:12,406][123090] Updated weights for policy 1, policy_version 1846689 (0.0011) [2023-12-26 14:26:12,467][123090] Updated weights for policy 1, policy_version 1846699 (0.0011) [2023-12-26 14:26:12,527][123090] Updated weights for policy 1, policy_version 1846709 (0.0011) [2023-12-26 14:26:12,583][123090] Updated weights for policy 1, policy_version 1846719 (0.0010) [2023-12-26 14:26:13,070][123091] Updated weights for policy 0, policy_version 1858388 (0.0009) [2023-12-26 14:26:13,137][123091] Updated weights for policy 0, policy_version 1858398 (0.0008) [2023-12-26 14:26:13,208][123091] Updated weights for policy 0, policy_version 1858408 (0.0009) [2023-12-26 14:26:13,411][123090] Updated weights for policy 1, policy_version 1846729 (0.0011) [2023-12-26 14:26:13,463][123090] Updated weights for policy 1, policy_version 1846739 (0.0011) [2023-12-26 14:26:13,515][123090] Updated weights for policy 1, policy_version 1846749 (0.0010) [2023-12-26 14:26:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 948527104. Throughput: 0: 8987.4, 1: 8829.1. Samples: 948520188. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:13,785][121949] Avg episode reward: [(0, '6315.311'), (1, '5869.203')] [2023-12-26 14:26:13,978][123091] Updated weights for policy 0, policy_version 1858418 (0.0009) [2023-12-26 14:26:14,027][123091] Updated weights for policy 0, policy_version 1858429 (0.0006) [2023-12-26 14:26:14,088][123091] Updated weights for policy 0, policy_version 1858439 (0.0006) [2023-12-26 14:26:14,304][123090] Updated weights for policy 1, policy_version 1846759 (0.0007) [2023-12-26 14:26:14,357][123090] Updated weights for policy 1, policy_version 1846769 (0.0009) [2023-12-26 14:26:14,417][123090] Updated weights for policy 1, policy_version 1846779 (0.0009) [2023-12-26 14:26:14,878][123091] Updated weights for policy 0, policy_version 1858449 (0.0007) [2023-12-26 14:26:14,942][123091] Updated weights for policy 0, policy_version 1858459 (0.0006) [2023-12-26 14:26:15,006][123091] Updated weights for policy 0, policy_version 1858470 (0.0011) [2023-12-26 14:26:15,067][123091] Updated weights for policy 0, policy_version 1858480 (0.0009) [2023-12-26 14:26:15,234][123090] Updated weights for policy 1, policy_version 1846789 (0.0007) [2023-12-26 14:26:15,310][123090] Updated weights for policy 1, policy_version 1846799 (0.0005) [2023-12-26 14:26:15,383][123090] Updated weights for policy 1, policy_version 1846809 (0.0005) [2023-12-26 14:26:15,904][123091] Updated weights for policy 0, policy_version 1858490 (0.0009) [2023-12-26 14:26:15,963][123091] Updated weights for policy 0, policy_version 1858500 (0.0010) [2023-12-26 14:26:16,018][123091] Updated weights for policy 0, policy_version 1858510 (0.0009) [2023-12-26 14:26:16,031][123090] Updated weights for policy 1, policy_version 1846819 (0.0007) [2023-12-26 14:26:16,080][123090] Updated weights for policy 1, policy_version 1846829 (0.0009) [2023-12-26 14:26:16,137][123090] Updated weights for policy 1, policy_version 1846839 (0.0009) [2023-12-26 14:26:16,877][123090] Updated weights for policy 1, policy_version 1846849 (0.0009) [2023-12-26 14:26:16,895][123091] Updated weights for policy 0, policy_version 1858520 (0.0009) [2023-12-26 14:26:16,929][123090] Updated weights for policy 1, policy_version 1846859 (0.0005) [2023-12-26 14:26:16,946][123091] Updated weights for policy 0, policy_version 1858530 (0.0009) [2023-12-26 14:26:16,987][123090] Updated weights for policy 1, policy_version 1846869 (0.0005) [2023-12-26 14:26:17,002][123091] Updated weights for policy 0, policy_version 1858540 (0.0009) [2023-12-26 14:26:17,041][123090] Updated weights for policy 1, policy_version 1846879 (0.0005) [2023-12-26 14:26:17,656][123090] Updated weights for policy 1, policy_version 1846889 (0.0005) [2023-12-26 14:26:17,723][123090] Updated weights for policy 1, policy_version 1846899 (0.0006) [2023-12-26 14:26:17,792][123090] Updated weights for policy 1, policy_version 1846909 (0.0009) [2023-12-26 14:26:17,919][123091] Updated weights for policy 0, policy_version 1858550 (0.0010) [2023-12-26 14:26:17,968][123091] Updated weights for policy 0, policy_version 1858560 (0.0009) [2023-12-26 14:26:18,020][123091] Updated weights for policy 0, policy_version 1858570 (0.0009) [2023-12-26 14:26:18,583][123090] Updated weights for policy 1, policy_version 1846919 (0.0009) [2023-12-26 14:26:18,645][123090] Updated weights for policy 1, policy_version 1846929 (0.0009) [2023-12-26 14:26:18,706][123090] Updated weights for policy 1, policy_version 1846939 (0.0009) [2023-12-26 14:26:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 948617216. Throughput: 0: 8889.7, 1: 8888.8. Samples: 948627888. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:18,785][121949] Avg episode reward: [(0, '6281.422'), (1, '5972.266')] [2023-12-26 14:26:18,869][123091] Updated weights for policy 0, policy_version 1858580 (0.0009) [2023-12-26 14:26:18,924][123091] Updated weights for policy 0, policy_version 1858590 (0.0010) [2023-12-26 14:26:18,980][123091] Updated weights for policy 0, policy_version 1858600 (0.0010) [2023-12-26 14:26:19,460][123090] Updated weights for policy 1, policy_version 1846949 (0.0010) [2023-12-26 14:26:19,521][123090] Updated weights for policy 1, policy_version 1846959 (0.0010) [2023-12-26 14:26:19,581][123090] Updated weights for policy 1, policy_version 1846969 (0.0010) [2023-12-26 14:26:19,898][123091] Updated weights for policy 0, policy_version 1858610 (0.0011) [2023-12-26 14:26:19,953][123091] Updated weights for policy 0, policy_version 1858620 (0.0010) [2023-12-26 14:26:20,006][123091] Updated weights for policy 0, policy_version 1858630 (0.0010) [2023-12-26 14:26:20,059][123091] Updated weights for policy 0, policy_version 1858640 (0.0010) [2023-12-26 14:26:20,347][123090] Updated weights for policy 1, policy_version 1846979 (0.0009) [2023-12-26 14:26:20,413][123090] Updated weights for policy 1, policy_version 1846989 (0.0010) [2023-12-26 14:26:20,471][123090] Updated weights for policy 1, policy_version 1846999 (0.0008) [2023-12-26 14:26:20,926][123091] Updated weights for policy 0, policy_version 1858650 (0.0010) [2023-12-26 14:26:20,986][123091] Updated weights for policy 0, policy_version 1858660 (0.0010) [2023-12-26 14:26:21,056][123091] Updated weights for policy 0, policy_version 1858670 (0.0010) [2023-12-26 14:26:21,322][123090] Updated weights for policy 1, policy_version 1847009 (0.0009) [2023-12-26 14:26:21,392][123090] Updated weights for policy 1, policy_version 1847019 (0.0008) [2023-12-26 14:26:21,464][123090] Updated weights for policy 1, policy_version 1847029 (0.0009) [2023-12-26 14:26:21,520][123090] Updated weights for policy 1, policy_version 1847039 (0.0010) [2023-12-26 14:26:21,928][123091] Updated weights for policy 0, policy_version 1858680 (0.0009) [2023-12-26 14:26:21,983][123091] Updated weights for policy 0, policy_version 1858690 (0.0010) [2023-12-26 14:26:22,039][123091] Updated weights for policy 0, policy_version 1858700 (0.0009) [2023-12-26 14:26:22,368][123090] Updated weights for policy 1, policy_version 1847049 (0.0009) [2023-12-26 14:26:22,423][123090] Updated weights for policy 1, policy_version 1847059 (0.0009) [2023-12-26 14:26:22,486][123090] Updated weights for policy 1, policy_version 1847069 (0.0009) [2023-12-26 14:26:22,837][123091] Updated weights for policy 0, policy_version 1858710 (0.0008) [2023-12-26 14:26:22,911][123091] Updated weights for policy 0, policy_version 1858720 (0.0006) [2023-12-26 14:26:22,976][123091] Updated weights for policy 0, policy_version 1858730 (0.0008) [2023-12-26 14:26:23,366][123090] Updated weights for policy 1, policy_version 1847079 (0.0009) [2023-12-26 14:26:23,418][123090] Updated weights for policy 1, policy_version 1847089 (0.0009) [2023-12-26 14:26:23,467][123090] Updated weights for policy 1, policy_version 1847099 (0.0006) [2023-12-26 14:26:23,596][123091] Updated weights for policy 0, policy_version 1858740 (0.0008) [2023-12-26 14:26:23,656][123091] Updated weights for policy 0, policy_version 1858750 (0.0008) [2023-12-26 14:26:23,718][123091] Updated weights for policy 0, policy_version 1858760 (0.0009) [2023-12-26 14:26:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 948707328. Throughput: 0: 8815.8, 1: 8876.7. Samples: 948678564. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:23,785][121949] Avg episode reward: [(0, '6310.480'), (1, '5999.179')] [2023-12-26 14:26:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001858768_475848704.pth... [2023-12-26 14:26:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001847104_472858624.pth... [2023-12-26 14:26:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001846048_472588288.pth [2023-12-26 14:26:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001857744_475586560.pth [2023-12-26 14:26:24,273][123090] Updated weights for policy 1, policy_version 1847109 (0.0009) [2023-12-26 14:26:24,321][123090] Updated weights for policy 1, policy_version 1847119 (0.0010) [2023-12-26 14:26:24,370][123090] Updated weights for policy 1, policy_version 1847129 (0.0010) [2023-12-26 14:26:24,502][123091] Updated weights for policy 0, policy_version 1858770 (0.0008) [2023-12-26 14:26:24,577][123091] Updated weights for policy 0, policy_version 1858780 (0.0005) [2023-12-26 14:26:24,645][123091] Updated weights for policy 0, policy_version 1858790 (0.0006) [2023-12-26 14:26:24,700][123091] Updated weights for policy 0, policy_version 1858800 (0.0006) [2023-12-26 14:26:25,082][123090] Updated weights for policy 1, policy_version 1847139 (0.0007) [2023-12-26 14:26:25,141][123090] Updated weights for policy 1, policy_version 1847149 (0.0006) [2023-12-26 14:26:25,191][123090] Updated weights for policy 1, policy_version 1847159 (0.0010) [2023-12-26 14:26:25,442][123091] Updated weights for policy 0, policy_version 1858810 (0.0006) [2023-12-26 14:26:25,499][123091] Updated weights for policy 0, policy_version 1858820 (0.0006) [2023-12-26 14:26:25,557][123091] Updated weights for policy 0, policy_version 1858830 (0.0006) [2023-12-26 14:26:26,006][123090] Updated weights for policy 1, policy_version 1847169 (0.0010) [2023-12-26 14:26:26,086][123090] Updated weights for policy 1, policy_version 1847179 (0.0010) [2023-12-26 14:26:26,163][123090] Updated weights for policy 1, policy_version 1847189 (0.0009) [2023-12-26 14:26:26,204][123091] Updated weights for policy 0, policy_version 1858840 (0.0005) [2023-12-26 14:26:26,237][123090] Updated weights for policy 1, policy_version 1847199 (0.0006) [2023-12-26 14:26:26,253][123091] Updated weights for policy 0, policy_version 1858850 (0.0005) [2023-12-26 14:26:26,300][123091] Updated weights for policy 0, policy_version 1858860 (0.0005) [2023-12-26 14:26:26,937][123090] Updated weights for policy 1, policy_version 1847209 (0.0005) [2023-12-26 14:26:26,989][123090] Updated weights for policy 1, policy_version 1847219 (0.0005) [2023-12-26 14:26:27,002][123091] Updated weights for policy 0, policy_version 1858870 (0.0008) [2023-12-26 14:26:27,043][123090] Updated weights for policy 1, policy_version 1847229 (0.0005) [2023-12-26 14:26:27,056][123091] Updated weights for policy 0, policy_version 1858881 (0.0010) [2023-12-26 14:26:27,111][123091] Updated weights for policy 0, policy_version 1858891 (0.0010) [2023-12-26 14:26:27,794][123090] Updated weights for policy 1, policy_version 1847239 (0.0009) [2023-12-26 14:26:27,841][123090] Updated weights for policy 1, policy_version 1847249 (0.0010) [2023-12-26 14:26:27,884][123090] Updated weights for policy 1, policy_version 1847259 (0.0010) [2023-12-26 14:26:27,903][123091] Updated weights for policy 0, policy_version 1858902 (0.0010) [2023-12-26 14:26:27,963][123091] Updated weights for policy 0, policy_version 1858912 (0.0010) [2023-12-26 14:26:28,036][123091] Updated weights for policy 0, policy_version 1858922 (0.0010) [2023-12-26 14:26:28,743][123090] Updated weights for policy 1, policy_version 1847269 (0.0010) [2023-12-26 14:26:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 948789248. Throughput: 0: 8921.0, 1: 8971.1. Samples: 948788176. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:28,785][121949] Avg episode reward: [(0, '6300.889'), (1, '6041.690')] [2023-12-26 14:26:28,798][123090] Updated weights for policy 1, policy_version 1847279 (0.0010) [2023-12-26 14:26:28,831][123091] Updated weights for policy 0, policy_version 1858932 (0.0010) [2023-12-26 14:26:28,849][123090] Updated weights for policy 1, policy_version 1847289 (0.0010) [2023-12-26 14:26:28,889][123091] Updated weights for policy 0, policy_version 1858942 (0.0010) [2023-12-26 14:26:28,950][123091] Updated weights for policy 0, policy_version 1858952 (0.0010) [2023-12-26 14:26:29,693][123090] Updated weights for policy 1, policy_version 1847299 (0.0010) [2023-12-26 14:26:29,755][123090] Updated weights for policy 1, policy_version 1847309 (0.0010) [2023-12-26 14:26:29,770][123091] Updated weights for policy 0, policy_version 1858962 (0.0009) [2023-12-26 14:26:29,815][123090] Updated weights for policy 1, policy_version 1847319 (0.0010) [2023-12-26 14:26:29,835][123091] Updated weights for policy 0, policy_version 1858972 (0.0006) [2023-12-26 14:26:29,900][123091] Updated weights for policy 0, policy_version 1858982 (0.0008) [2023-12-26 14:26:29,967][123091] Updated weights for policy 0, policy_version 1858992 (0.0008) [2023-12-26 14:26:30,584][123090] Updated weights for policy 1, policy_version 1847329 (0.0010) [2023-12-26 14:26:30,645][123090] Updated weights for policy 1, policy_version 1847339 (0.0010) [2023-12-26 14:26:30,653][123091] Updated weights for policy 0, policy_version 1859002 (0.0005) [2023-12-26 14:26:30,706][123090] Updated weights for policy 1, policy_version 1847349 (0.0009) [2023-12-26 14:26:30,708][123091] Updated weights for policy 0, policy_version 1859012 (0.0005) [2023-12-26 14:26:30,760][123091] Updated weights for policy 0, policy_version 1859022 (0.0005) [2023-12-26 14:26:30,772][123090] Updated weights for policy 1, policy_version 1847359 (0.0005) [2023-12-26 14:26:31,478][123091] Updated weights for policy 0, policy_version 1859032 (0.0008) [2023-12-26 14:26:31,498][123090] Updated weights for policy 1, policy_version 1847369 (0.0010) [2023-12-26 14:26:31,539][123091] Updated weights for policy 0, policy_version 1859042 (0.0005) [2023-12-26 14:26:31,561][123090] Updated weights for policy 1, policy_version 1847379 (0.0010) [2023-12-26 14:26:31,598][123091] Updated weights for policy 0, policy_version 1859052 (0.0006) [2023-12-26 14:26:31,625][123090] Updated weights for policy 1, policy_version 1847389 (0.0010) [2023-12-26 14:26:32,438][123091] Updated weights for policy 0, policy_version 1859062 (0.0007) [2023-12-26 14:26:32,458][123090] Updated weights for policy 1, policy_version 1847399 (0.0006) [2023-12-26 14:26:32,490][123091] Updated weights for policy 0, policy_version 1859072 (0.0006) [2023-12-26 14:26:32,524][123090] Updated weights for policy 1, policy_version 1847409 (0.0005) [2023-12-26 14:26:32,552][123091] Updated weights for policy 0, policy_version 1859082 (0.0006) [2023-12-26 14:26:32,629][123090] Updated weights for policy 1, policy_version 1847419 (0.0006) [2023-12-26 14:26:33,228][123091] Updated weights for policy 0, policy_version 1859092 (0.0006) [2023-12-26 14:26:33,251][123090] Updated weights for policy 1, policy_version 1847429 (0.0010) [2023-12-26 14:26:33,278][123091] Updated weights for policy 0, policy_version 1859102 (0.0005) [2023-12-26 14:26:33,318][123090] Updated weights for policy 1, policy_version 1847439 (0.0010) [2023-12-26 14:26:33,331][123091] Updated weights for policy 0, policy_version 1859112 (0.0006) [2023-12-26 14:26:33,372][123090] Updated weights for policy 1, policy_version 1847449 (0.0010) [2023-12-26 14:26:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 948887552. Throughput: 0: 8857.3, 1: 8928.6. Samples: 948897928. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:33,785][121949] Avg episode reward: [(0, '6316.114'), (1, '6127.921')] [2023-12-26 14:26:33,996][123091] Updated weights for policy 0, policy_version 1859122 (0.0007) [2023-12-26 14:26:34,052][123091] Updated weights for policy 0, policy_version 1859132 (0.0005) [2023-12-26 14:26:34,108][123091] Updated weights for policy 0, policy_version 1859142 (0.0005) [2023-12-26 14:26:34,110][123090] Updated weights for policy 1, policy_version 1847459 (0.0009) [2023-12-26 14:26:34,173][123091] Updated weights for policy 0, policy_version 1859152 (0.0007) [2023-12-26 14:26:34,181][123090] Updated weights for policy 1, policy_version 1847469 (0.0009) [2023-12-26 14:26:34,235][123090] Updated weights for policy 1, policy_version 1847479 (0.0008) [2023-12-26 14:26:34,960][123091] Updated weights for policy 0, policy_version 1859162 (0.0009) [2023-12-26 14:26:34,963][123090] Updated weights for policy 1, policy_version 1847489 (0.0008) [2023-12-26 14:26:35,018][123091] Updated weights for policy 0, policy_version 1859172 (0.0007) [2023-12-26 14:26:35,018][123090] Updated weights for policy 1, policy_version 1847499 (0.0009) [2023-12-26 14:26:35,071][123091] Updated weights for policy 0, policy_version 1859182 (0.0009) [2023-12-26 14:26:35,075][123090] Updated weights for policy 1, policy_version 1847509 (0.0008) [2023-12-26 14:26:35,126][123090] Updated weights for policy 1, policy_version 1847519 (0.0007) [2023-12-26 14:26:35,898][123091] Updated weights for policy 0, policy_version 1859192 (0.0008) [2023-12-26 14:26:35,933][123090] Updated weights for policy 1, policy_version 1847529 (0.0008) [2023-12-26 14:26:35,959][123091] Updated weights for policy 0, policy_version 1859202 (0.0008) [2023-12-26 14:26:35,983][123090] Updated weights for policy 1, policy_version 1847539 (0.0007) [2023-12-26 14:26:36,021][123091] Updated weights for policy 0, policy_version 1859212 (0.0010) [2023-12-26 14:26:36,046][123090] Updated weights for policy 1, policy_version 1847549 (0.0009) [2023-12-26 14:26:36,834][123090] Updated weights for policy 1, policy_version 1847559 (0.0010) [2023-12-26 14:26:36,886][123090] Updated weights for policy 1, policy_version 1847569 (0.0009) [2023-12-26 14:26:36,888][123091] Updated weights for policy 0, policy_version 1859222 (0.0009) [2023-12-26 14:26:36,942][123091] Updated weights for policy 0, policy_version 1859232 (0.0008) [2023-12-26 14:26:36,956][123090] Updated weights for policy 1, policy_version 1847579 (0.0009) [2023-12-26 14:26:37,007][123091] Updated weights for policy 0, policy_version 1859243 (0.0008) [2023-12-26 14:26:37,751][123090] Updated weights for policy 1, policy_version 1847589 (0.0008) [2023-12-26 14:26:37,808][123090] Updated weights for policy 1, policy_version 1847599 (0.0010) [2023-12-26 14:26:37,856][123091] Updated weights for policy 0, policy_version 1859253 (0.0009) [2023-12-26 14:26:37,867][123090] Updated weights for policy 1, policy_version 1847609 (0.0008) [2023-12-26 14:26:37,923][123091] Updated weights for policy 0, policy_version 1859263 (0.0009) [2023-12-26 14:26:37,985][123091] Updated weights for policy 0, policy_version 1859273 (0.0009) [2023-12-26 14:26:38,726][123090] Updated weights for policy 1, policy_version 1847619 (0.0010) [2023-12-26 14:26:38,775][123090] Updated weights for policy 1, policy_version 1847629 (0.0009) [2023-12-26 14:26:38,785][121949] Fps is (10 sec: 18021.6, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 948969472. Throughput: 0: 8843.9, 1: 9004.7. Samples: 948952796. Policy #0 lag: (min: 26.0, avg: 40.7, max: 58.0) [2023-12-26 14:26:38,786][121949] Avg episode reward: [(0, '6342.062'), (1, '6028.418')] [2023-12-26 14:26:38,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001859280_475979776.pth... [2023-12-26 14:26:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001858256_475717632.pth [2023-12-26 14:26:38,834][123091] Updated weights for policy 0, policy_version 1859283 (0.0009) [2023-12-26 14:26:38,836][123090] Updated weights for policy 1, policy_version 1847639 (0.0010) [2023-12-26 14:26:38,893][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001847648_472997888.pth... [2023-12-26 14:26:38,896][123091] Updated weights for policy 0, policy_version 1859293 (0.0007) [2023-12-26 14:26:38,898][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001846592_472727552.pth [2023-12-26 14:26:38,950][123091] Updated weights for policy 0, policy_version 1859303 (0.0009) [2023-12-26 14:26:39,685][123090] Updated weights for policy 1, policy_version 1847649 (0.0008) [2023-12-26 14:26:39,750][123090] Updated weights for policy 1, policy_version 1847659 (0.0009) [2023-12-26 14:26:39,819][123090] Updated weights for policy 1, policy_version 1847669 (0.0009) [2023-12-26 14:26:39,833][123091] Updated weights for policy 0, policy_version 1859313 (0.0010) [2023-12-26 14:26:39,898][123090] Updated weights for policy 1, policy_version 1847680 (0.0009) [2023-12-26 14:26:39,899][123091] Updated weights for policy 0, policy_version 1859323 (0.0009) [2023-12-26 14:26:39,967][123091] Updated weights for policy 0, policy_version 1859333 (0.0010) [2023-12-26 14:26:40,032][123091] Updated weights for policy 0, policy_version 1859343 (0.0010) [2023-12-26 14:26:40,765][123090] Updated weights for policy 1, policy_version 1847690 (0.0009) [2023-12-26 14:26:40,826][123090] Updated weights for policy 1, policy_version 1847700 (0.0008) [2023-12-26 14:26:40,847][123091] Updated weights for policy 0, policy_version 1859353 (0.0009) [2023-12-26 14:26:40,903][123090] Updated weights for policy 1, policy_version 1847710 (0.0009) [2023-12-26 14:26:40,913][123091] Updated weights for policy 0, policy_version 1859363 (0.0009) [2023-12-26 14:26:40,968][123091] Updated weights for policy 0, policy_version 1859373 (0.0009) [2023-12-26 14:26:41,697][123090] Updated weights for policy 1, policy_version 1847720 (0.0009) [2023-12-26 14:26:41,771][123090] Updated weights for policy 1, policy_version 1847730 (0.0009) [2023-12-26 14:26:41,838][123090] Updated weights for policy 1, policy_version 1847740 (0.0009) [2023-12-26 14:26:41,859][123091] Updated weights for policy 0, policy_version 1859383 (0.0009) [2023-12-26 14:26:41,930][123091] Updated weights for policy 0, policy_version 1859393 (0.0010) [2023-12-26 14:26:42,000][123091] Updated weights for policy 0, policy_version 1859403 (0.0009) [2023-12-26 14:26:42,632][123090] Updated weights for policy 1, policy_version 1847750 (0.0009) [2023-12-26 14:26:42,690][123090] Updated weights for policy 1, policy_version 1847760 (0.0010) [2023-12-26 14:26:42,763][123090] Updated weights for policy 1, policy_version 1847770 (0.0009) [2023-12-26 14:26:42,767][123091] Updated weights for policy 0, policy_version 1859413 (0.0009) [2023-12-26 14:26:42,823][123091] Updated weights for policy 0, policy_version 1859423 (0.0008) [2023-12-26 14:26:42,887][123091] Updated weights for policy 0, policy_version 1859433 (0.0009) [2023-12-26 14:26:43,637][123090] Updated weights for policy 1, policy_version 1847780 (0.0010) [2023-12-26 14:26:43,667][123091] Updated weights for policy 0, policy_version 1859443 (0.0009) [2023-12-26 14:26:43,699][123090] Updated weights for policy 1, policy_version 1847790 (0.0008) [2023-12-26 14:26:43,732][123091] Updated weights for policy 0, policy_version 1859453 (0.0007) [2023-12-26 14:26:43,760][123090] Updated weights for policy 1, policy_version 1847800 (0.0008) [2023-12-26 14:26:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 949051392. Throughput: 0: 8721.0, 1: 8970.2. Samples: 949053728. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:26:43,785][121949] Avg episode reward: [(0, '6343.080'), (1, '5921.652')] [2023-12-26 14:26:43,801][123091] Updated weights for policy 0, policy_version 1859463 (0.0006) [2023-12-26 14:26:44,523][123091] Updated weights for policy 0, policy_version 1859473 (0.0006) [2023-12-26 14:26:44,579][123091] Updated weights for policy 0, policy_version 1859483 (0.0006) [2023-12-26 14:26:44,614][123090] Updated weights for policy 1, policy_version 1847810 (0.0008) [2023-12-26 14:26:44,641][123091] Updated weights for policy 0, policy_version 1859493 (0.0011) [2023-12-26 14:26:44,674][123090] Updated weights for policy 1, policy_version 1847820 (0.0007) [2023-12-26 14:26:44,705][123091] Updated weights for policy 0, policy_version 1859503 (0.0011) [2023-12-26 14:26:44,738][123090] Updated weights for policy 1, policy_version 1847830 (0.0008) [2023-12-26 14:26:44,800][123090] Updated weights for policy 1, policy_version 1847840 (0.0009) [2023-12-26 14:26:45,516][123091] Updated weights for policy 0, policy_version 1859513 (0.0009) [2023-12-26 14:26:45,573][123091] Updated weights for policy 0, policy_version 1859523 (0.0010) [2023-12-26 14:26:45,632][123091] Updated weights for policy 0, policy_version 1859533 (0.0009) [2023-12-26 14:26:45,645][123090] Updated weights for policy 1, policy_version 1847850 (0.0009) [2023-12-26 14:26:45,708][123090] Updated weights for policy 1, policy_version 1847860 (0.0010) [2023-12-26 14:26:45,777][123090] Updated weights for policy 1, policy_version 1847870 (0.0010) [2023-12-26 14:26:46,369][123091] Updated weights for policy 0, policy_version 1859543 (0.0007) [2023-12-26 14:26:46,432][123091] Updated weights for policy 0, policy_version 1859553 (0.0005) [2023-12-26 14:26:46,497][123091] Updated weights for policy 0, policy_version 1859563 (0.0005) [2023-12-26 14:26:46,608][123090] Updated weights for policy 1, policy_version 1847880 (0.0010) [2023-12-26 14:26:46,662][123090] Updated weights for policy 1, policy_version 1847890 (0.0010) [2023-12-26 14:26:46,713][123090] Updated weights for policy 1, policy_version 1847900 (0.0007) [2023-12-26 14:26:47,168][123091] Updated weights for policy 0, policy_version 1859573 (0.0008) [2023-12-26 14:26:47,221][123091] Updated weights for policy 0, policy_version 1859584 (0.0010) [2023-12-26 14:26:47,274][123091] Updated weights for policy 0, policy_version 1859594 (0.0010) [2023-12-26 14:26:47,426][123090] Updated weights for policy 1, policy_version 1847910 (0.0007) [2023-12-26 14:26:47,475][123090] Updated weights for policy 1, policy_version 1847920 (0.0005) [2023-12-26 14:26:47,531][123090] Updated weights for policy 1, policy_version 1847930 (0.0006) [2023-12-26 14:26:48,200][123091] Updated weights for policy 0, policy_version 1859604 (0.0010) [2023-12-26 14:26:48,212][123090] Updated weights for policy 1, policy_version 1847940 (0.0006) [2023-12-26 14:26:48,251][123091] Updated weights for policy 0, policy_version 1859614 (0.0010) [2023-12-26 14:26:48,262][123090] Updated weights for policy 1, policy_version 1847950 (0.0005) [2023-12-26 14:26:48,299][123091] Updated weights for policy 0, policy_version 1859624 (0.0010) [2023-12-26 14:26:48,313][123090] Updated weights for policy 1, policy_version 1847960 (0.0006) [2023-12-26 14:26:48,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 949149696. Throughput: 0: 8783.3, 1: 8967.7. Samples: 949160964. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:26:48,785][121949] Avg episode reward: [(0, '6354.818'), (1, '5939.897')] [2023-12-26 14:26:49,101][123091] Updated weights for policy 0, policy_version 1859634 (0.0010) [2023-12-26 14:26:49,112][123090] Updated weights for policy 1, policy_version 1847970 (0.0011) [2023-12-26 14:26:49,155][123091] Updated weights for policy 0, policy_version 1859644 (0.0007) [2023-12-26 14:26:49,182][123090] Updated weights for policy 1, policy_version 1847980 (0.0010) [2023-12-26 14:26:49,218][123091] Updated weights for policy 0, policy_version 1859654 (0.0008) [2023-12-26 14:26:49,258][123090] Updated weights for policy 1, policy_version 1847990 (0.0008) [2023-12-26 14:26:49,287][123091] Updated weights for policy 0, policy_version 1859664 (0.0008) [2023-12-26 14:26:49,323][123090] Updated weights for policy 1, policy_version 1848000 (0.0008) [2023-12-26 14:26:50,092][123090] Updated weights for policy 1, policy_version 1848010 (0.0009) [2023-12-26 14:26:50,136][123091] Updated weights for policy 0, policy_version 1859674 (0.0009) [2023-12-26 14:26:50,144][123090] Updated weights for policy 1, policy_version 1848020 (0.0007) [2023-12-26 14:26:50,196][123091] Updated weights for policy 0, policy_version 1859684 (0.0010) [2023-12-26 14:26:50,199][123090] Updated weights for policy 1, policy_version 1848030 (0.0009) [2023-12-26 14:26:50,265][123091] Updated weights for policy 0, policy_version 1859694 (0.0009) [2023-12-26 14:26:51,039][123090] Updated weights for policy 1, policy_version 1848040 (0.0010) [2023-12-26 14:26:51,055][123091] Updated weights for policy 0, policy_version 1859704 (0.0008) [2023-12-26 14:26:51,102][123090] Updated weights for policy 1, policy_version 1848050 (0.0011) [2023-12-26 14:26:51,118][123091] Updated weights for policy 0, policy_version 1859714 (0.0006) [2023-12-26 14:26:51,174][123090] Updated weights for policy 1, policy_version 1848060 (0.0011) [2023-12-26 14:26:51,191][123091] Updated weights for policy 0, policy_version 1859724 (0.0006) [2023-12-26 14:26:51,925][123090] Updated weights for policy 1, policy_version 1848070 (0.0010) [2023-12-26 14:26:51,928][123091] Updated weights for policy 0, policy_version 1859734 (0.0006) [2023-12-26 14:26:51,981][123090] Updated weights for policy 1, policy_version 1848080 (0.0010) [2023-12-26 14:26:51,991][123091] Updated weights for policy 0, policy_version 1859744 (0.0007) [2023-12-26 14:26:52,038][123090] Updated weights for policy 1, policy_version 1848090 (0.0010) [2023-12-26 14:26:52,049][123091] Updated weights for policy 0, policy_version 1859754 (0.0006) [2023-12-26 14:26:52,762][123091] Updated weights for policy 0, policy_version 1859764 (0.0006) [2023-12-26 14:26:52,810][123090] Updated weights for policy 1, policy_version 1848100 (0.0008) [2023-12-26 14:26:52,814][123091] Updated weights for policy 0, policy_version 1859774 (0.0007) [2023-12-26 14:26:52,867][123091] Updated weights for policy 0, policy_version 1859784 (0.0009) [2023-12-26 14:26:52,883][123090] Updated weights for policy 1, policy_version 1848110 (0.0005) [2023-12-26 14:26:52,949][123090] Updated weights for policy 1, policy_version 1848120 (0.0009) [2023-12-26 14:26:53,675][123091] Updated weights for policy 0, policy_version 1859794 (0.0007) [2023-12-26 14:26:53,743][123091] Updated weights for policy 0, policy_version 1859804 (0.0005) [2023-12-26 14:26:53,747][123090] Updated weights for policy 1, policy_version 1848130 (0.0011) [2023-12-26 14:26:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 949231616. Throughput: 0: 8834.2, 1: 8891.4. Samples: 949215012. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:26:53,785][121949] Avg episode reward: [(0, '6390.160'), (1, '5791.882')] [2023-12-26 14:26:53,796][123091] Updated weights for policy 0, policy_version 1859814 (0.0005) [2023-12-26 14:26:53,806][123090] Updated weights for policy 1, policy_version 1848140 (0.0010) [2023-12-26 14:26:53,842][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001859824_476119040.pth... [2023-12-26 14:26:53,843][123091] Updated weights for policy 0, policy_version 1859824 (0.0007) [2023-12-26 14:26:53,847][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001858768_475848704.pth [2023-12-26 14:26:53,854][123090] Updated weights for policy 1, policy_version 1848150 (0.0010) [2023-12-26 14:26:53,907][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001848160_473128960.pth... [2023-12-26 14:26:53,910][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001847104_472858624.pth [2023-12-26 14:26:53,910][123090] Updated weights for policy 1, policy_version 1848160 (0.0010) [2023-12-26 14:26:54,630][123091] Updated weights for policy 0, policy_version 1859834 (0.0010) [2023-12-26 14:26:54,693][123091] Updated weights for policy 0, policy_version 1859844 (0.0008) [2023-12-26 14:26:54,713][123090] Updated weights for policy 1, policy_version 1848170 (0.0006) [2023-12-26 14:26:54,749][123091] Updated weights for policy 0, policy_version 1859854 (0.0008) [2023-12-26 14:26:54,779][123090] Updated weights for policy 1, policy_version 1848180 (0.0009) [2023-12-26 14:26:54,838][123090] Updated weights for policy 1, policy_version 1848190 (0.0010) [2023-12-26 14:26:55,487][123090] Updated weights for policy 1, policy_version 1848200 (0.0006) [2023-12-26 14:26:55,550][123090] Updated weights for policy 1, policy_version 1848210 (0.0006) [2023-12-26 14:26:55,566][123091] Updated weights for policy 0, policy_version 1859864 (0.0006) [2023-12-26 14:26:55,605][123090] Updated weights for policy 1, policy_version 1848220 (0.0010) [2023-12-26 14:26:55,625][123091] Updated weights for policy 0, policy_version 1859874 (0.0005) [2023-12-26 14:26:55,689][123091] Updated weights for policy 0, policy_version 1859884 (0.0007) [2023-12-26 14:26:56,350][123090] Updated weights for policy 1, policy_version 1848230 (0.0011) [2023-12-26 14:26:56,405][123090] Updated weights for policy 1, policy_version 1848240 (0.0010) [2023-12-26 14:26:56,464][123090] Updated weights for policy 1, policy_version 1848250 (0.0010) [2023-12-26 14:26:56,479][123091] Updated weights for policy 0, policy_version 1859894 (0.0007) [2023-12-26 14:26:56,537][123091] Updated weights for policy 0, policy_version 1859904 (0.0008) [2023-12-26 14:26:56,600][123091] Updated weights for policy 0, policy_version 1859914 (0.0009) [2023-12-26 14:26:57,326][123090] Updated weights for policy 1, policy_version 1848260 (0.0010) [2023-12-26 14:26:57,387][123090] Updated weights for policy 1, policy_version 1848270 (0.0010) [2023-12-26 14:26:57,411][123091] Updated weights for policy 0, policy_version 1859924 (0.0008) [2023-12-26 14:26:57,450][123090] Updated weights for policy 1, policy_version 1848280 (0.0010) [2023-12-26 14:26:57,474][123091] Updated weights for policy 0, policy_version 1859934 (0.0005) [2023-12-26 14:26:57,534][123091] Updated weights for policy 0, policy_version 1859944 (0.0007) [2023-12-26 14:26:58,203][123090] Updated weights for policy 1, policy_version 1848290 (0.0010) [2023-12-26 14:26:58,266][123090] Updated weights for policy 1, policy_version 1848300 (0.0009) [2023-12-26 14:26:58,347][123090] Updated weights for policy 1, policy_version 1848310 (0.0008) [2023-12-26 14:26:58,384][123091] Updated weights for policy 0, policy_version 1859954 (0.0009) [2023-12-26 14:26:58,415][123090] Updated weights for policy 1, policy_version 1848320 (0.0007) [2023-12-26 14:26:58,434][123091] Updated weights for policy 0, policy_version 1859964 (0.0010) [2023-12-26 14:26:58,505][123091] Updated weights for policy 0, policy_version 1859974 (0.0009) [2023-12-26 14:26:58,576][123091] Updated weights for policy 0, policy_version 1859984 (0.0010) [2023-12-26 14:26:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 949329920. Throughput: 0: 8869.1, 1: 8957.4. Samples: 949322384. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:26:58,785][121949] Avg episode reward: [(0, '6326.746'), (1, '5755.201')] [2023-12-26 14:26:59,227][123090] Updated weights for policy 1, policy_version 1848330 (0.0009) [2023-12-26 14:26:59,290][123090] Updated weights for policy 1, policy_version 1848340 (0.0008) [2023-12-26 14:26:59,356][123090] Updated weights for policy 1, policy_version 1848350 (0.0009) [2023-12-26 14:26:59,472][123091] Updated weights for policy 0, policy_version 1859994 (0.0008) [2023-12-26 14:26:59,520][123091] Updated weights for policy 0, policy_version 1860004 (0.0008) [2023-12-26 14:26:59,574][123091] Updated weights for policy 0, policy_version 1860014 (0.0008) [2023-12-26 14:27:00,175][123090] Updated weights for policy 1, policy_version 1848360 (0.0006) [2023-12-26 14:27:00,241][123090] Updated weights for policy 1, policy_version 1848370 (0.0005) [2023-12-26 14:27:00,310][123090] Updated weights for policy 1, policy_version 1848380 (0.0005) [2023-12-26 14:27:00,370][123091] Updated weights for policy 0, policy_version 1860024 (0.0009) [2023-12-26 14:27:00,422][123091] Updated weights for policy 0, policy_version 1860034 (0.0009) [2023-12-26 14:27:00,470][123091] Updated weights for policy 0, policy_version 1860044 (0.0008) [2023-12-26 14:27:01,068][123090] Updated weights for policy 1, policy_version 1848390 (0.0008) [2023-12-26 14:27:01,140][123090] Updated weights for policy 1, policy_version 1848400 (0.0006) [2023-12-26 14:27:01,215][123090] Updated weights for policy 1, policy_version 1848410 (0.0008) [2023-12-26 14:27:01,314][123091] Updated weights for policy 0, policy_version 1860054 (0.0008) [2023-12-26 14:27:01,385][123091] Updated weights for policy 0, policy_version 1860064 (0.0008) [2023-12-26 14:27:01,448][123091] Updated weights for policy 0, policy_version 1860074 (0.0008) [2023-12-26 14:27:02,021][123090] Updated weights for policy 1, policy_version 1848420 (0.0009) [2023-12-26 14:27:02,089][123090] Updated weights for policy 1, policy_version 1848430 (0.0009) [2023-12-26 14:27:02,158][123090] Updated weights for policy 1, policy_version 1848440 (0.0010) [2023-12-26 14:27:02,237][123091] Updated weights for policy 0, policy_version 1860084 (0.0009) [2023-12-26 14:27:02,301][123091] Updated weights for policy 0, policy_version 1860094 (0.0006) [2023-12-26 14:27:02,373][123091] Updated weights for policy 0, policy_version 1860104 (0.0009) [2023-12-26 14:27:02,918][123090] Updated weights for policy 1, policy_version 1848450 (0.0009) [2023-12-26 14:27:02,976][123090] Updated weights for policy 1, policy_version 1848460 (0.0007) [2023-12-26 14:27:03,032][123090] Updated weights for policy 1, policy_version 1848470 (0.0006) [2023-12-26 14:27:03,088][123090] Updated weights for policy 1, policy_version 1848480 (0.0006) [2023-12-26 14:27:03,208][123091] Updated weights for policy 0, policy_version 1860114 (0.0009) [2023-12-26 14:27:03,265][123091] Updated weights for policy 0, policy_version 1860124 (0.0009) [2023-12-26 14:27:03,317][123091] Updated weights for policy 0, policy_version 1860134 (0.0010) [2023-12-26 14:27:03,371][123091] Updated weights for policy 0, policy_version 1860144 (0.0009) [2023-12-26 14:27:03,747][123090] Updated weights for policy 1, policy_version 1848490 (0.0009) [2023-12-26 14:27:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 949411840. Throughput: 0: 8850.9, 1: 8911.9. Samples: 949427212. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:03,785][121949] Avg episode reward: [(0, '6307.888'), (1, '5973.373')] [2023-12-26 14:27:03,800][123090] Updated weights for policy 1, policy_version 1848500 (0.0008) [2023-12-26 14:27:03,867][123090] Updated weights for policy 1, policy_version 1848510 (0.0007) [2023-12-26 14:27:04,292][123091] Updated weights for policy 0, policy_version 1860154 (0.0010) [2023-12-26 14:27:04,364][123091] Updated weights for policy 0, policy_version 1860164 (0.0008) [2023-12-26 14:27:04,437][123091] Updated weights for policy 0, policy_version 1860174 (0.0009) [2023-12-26 14:27:04,543][123090] Updated weights for policy 1, policy_version 1848520 (0.0009) [2023-12-26 14:27:04,600][123090] Updated weights for policy 1, policy_version 1848530 (0.0009) [2023-12-26 14:27:04,663][123090] Updated weights for policy 1, policy_version 1848540 (0.0008) [2023-12-26 14:27:05,154][123091] Updated weights for policy 0, policy_version 1860184 (0.0006) [2023-12-26 14:27:05,217][123091] Updated weights for policy 0, policy_version 1860194 (0.0005) [2023-12-26 14:27:05,284][123091] Updated weights for policy 0, policy_version 1860204 (0.0005) [2023-12-26 14:27:05,590][123090] Updated weights for policy 1, policy_version 1848550 (0.0009) [2023-12-26 14:27:05,643][123090] Updated weights for policy 1, policy_version 1848560 (0.0009) [2023-12-26 14:27:05,697][123090] Updated weights for policy 1, policy_version 1848570 (0.0010) [2023-12-26 14:27:05,835][123091] Updated weights for policy 0, policy_version 1860214 (0.0005) [2023-12-26 14:27:05,882][123091] Updated weights for policy 0, policy_version 1860224 (0.0005) [2023-12-26 14:27:05,947][123091] Updated weights for policy 0, policy_version 1860234 (0.0008) [2023-12-26 14:27:06,677][123090] Updated weights for policy 1, policy_version 1848581 (0.0010) [2023-12-26 14:27:06,699][123091] Updated weights for policy 0, policy_version 1860244 (0.0011) [2023-12-26 14:27:06,736][123090] Updated weights for policy 1, policy_version 1848591 (0.0008) [2023-12-26 14:27:06,755][123091] Updated weights for policy 0, policy_version 1860254 (0.0011) [2023-12-26 14:27:06,801][123090] Updated weights for policy 1, policy_version 1848601 (0.0006) [2023-12-26 14:27:06,820][123091] Updated weights for policy 0, policy_version 1860264 (0.0011) [2023-12-26 14:27:07,493][123091] Updated weights for policy 0, policy_version 1860274 (0.0006) [2023-12-26 14:27:07,516][123090] Updated weights for policy 1, policy_version 1848611 (0.0008) [2023-12-26 14:27:07,564][123091] Updated weights for policy 0, policy_version 1860284 (0.0008) [2023-12-26 14:27:07,572][123090] Updated weights for policy 1, policy_version 1848621 (0.0009) [2023-12-26 14:27:07,624][123091] Updated weights for policy 0, policy_version 1860294 (0.0007) [2023-12-26 14:27:07,635][123090] Updated weights for policy 1, policy_version 1848631 (0.0009) [2023-12-26 14:27:07,673][123091] Updated weights for policy 0, policy_version 1860304 (0.0005) [2023-12-26 14:27:08,326][123091] Updated weights for policy 0, policy_version 1860314 (0.0009) [2023-12-26 14:27:08,396][123091] Updated weights for policy 0, policy_version 1860324 (0.0011) [2023-12-26 14:27:08,455][123091] Updated weights for policy 0, policy_version 1860334 (0.0010) [2023-12-26 14:27:08,534][123090] Updated weights for policy 1, policy_version 1848641 (0.0009) [2023-12-26 14:27:08,586][123090] Updated weights for policy 1, policy_version 1848651 (0.0009) [2023-12-26 14:27:08,647][123090] Updated weights for policy 1, policy_version 1848661 (0.0009) [2023-12-26 14:27:08,712][123090] Updated weights for policy 1, policy_version 1848671 (0.0010) [2023-12-26 14:27:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 949510144. Throughput: 0: 8938.6, 1: 8885.8. Samples: 949480660. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:08,785][121949] Avg episode reward: [(0, '6329.834'), (1, '5987.409')] [2023-12-26 14:27:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001860336_476250112.pth... [2023-12-26 14:27:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001848672_473260032.pth... [2023-12-26 14:27:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001859280_475979776.pth [2023-12-26 14:27:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001847648_472997888.pth [2023-12-26 14:27:09,271][123091] Updated weights for policy 0, policy_version 1860344 (0.0011) [2023-12-26 14:27:09,338][123091] Updated weights for policy 0, policy_version 1860354 (0.0010) [2023-12-26 14:27:09,415][123091] Updated weights for policy 0, policy_version 1860364 (0.0011) [2023-12-26 14:27:09,509][123090] Updated weights for policy 1, policy_version 1848681 (0.0005) [2023-12-26 14:27:09,572][123090] Updated weights for policy 1, policy_version 1848691 (0.0006) [2023-12-26 14:27:09,624][123090] Updated weights for policy 1, policy_version 1848701 (0.0005) [2023-12-26 14:27:10,236][123091] Updated weights for policy 0, policy_version 1860374 (0.0012) [2023-12-26 14:27:10,311][123091] Updated weights for policy 0, policy_version 1860384 (0.0010) [2023-12-26 14:27:10,361][123090] Updated weights for policy 1, policy_version 1848711 (0.0007) [2023-12-26 14:27:10,374][123091] Updated weights for policy 0, policy_version 1860394 (0.0010) [2023-12-26 14:27:10,434][123090] Updated weights for policy 1, policy_version 1848721 (0.0011) [2023-12-26 14:27:10,510][123090] Updated weights for policy 1, policy_version 1848731 (0.0011) [2023-12-26 14:27:11,205][123090] Updated weights for policy 1, policy_version 1848741 (0.0008) [2023-12-26 14:27:11,270][123091] Updated weights for policy 0, policy_version 1860404 (0.0009) [2023-12-26 14:27:11,276][123090] Updated weights for policy 1, policy_version 1848751 (0.0011) [2023-12-26 14:27:11,323][123091] Updated weights for policy 0, policy_version 1860414 (0.0008) [2023-12-26 14:27:11,337][123090] Updated weights for policy 1, policy_version 1848761 (0.0008) [2023-12-26 14:27:11,392][123091] Updated weights for policy 0, policy_version 1860424 (0.0008) [2023-12-26 14:27:12,171][123091] Updated weights for policy 0, policy_version 1860434 (0.0006) [2023-12-26 14:27:12,176][123090] Updated weights for policy 1, policy_version 1848771 (0.0010) [2023-12-26 14:27:12,221][123091] Updated weights for policy 0, policy_version 1860444 (0.0009) [2023-12-26 14:27:12,247][123090] Updated weights for policy 1, policy_version 1848781 (0.0006) [2023-12-26 14:27:12,274][123091] Updated weights for policy 0, policy_version 1860454 (0.0009) [2023-12-26 14:27:12,315][123090] Updated weights for policy 1, policy_version 1848791 (0.0008) [2023-12-26 14:27:12,341][123091] Updated weights for policy 0, policy_version 1860464 (0.0009) [2023-12-26 14:27:13,080][123090] Updated weights for policy 1, policy_version 1848802 (0.0008) [2023-12-26 14:27:13,146][123090] Updated weights for policy 1, policy_version 1848812 (0.0006) [2023-12-26 14:27:13,217][123090] Updated weights for policy 1, policy_version 1848822 (0.0005) [2023-12-26 14:27:13,238][123091] Updated weights for policy 0, policy_version 1860474 (0.0010) [2023-12-26 14:27:13,290][123090] Updated weights for policy 1, policy_version 1848832 (0.0005) [2023-12-26 14:27:13,308][123091] Updated weights for policy 0, policy_version 1860484 (0.0009) [2023-12-26 14:27:13,378][123091] Updated weights for policy 0, policy_version 1860494 (0.0007) [2023-12-26 14:27:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 949592064. Throughput: 0: 8877.1, 1: 8862.1. Samples: 949586436. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:13,785][121949] Avg episode reward: [(0, '6418.355'), (1, '5918.493')] [2023-12-26 14:27:13,914][123090] Updated weights for policy 1, policy_version 1848842 (0.0007) [2023-12-26 14:27:13,980][123090] Updated weights for policy 1, policy_version 1848852 (0.0009) [2023-12-26 14:27:14,039][123090] Updated weights for policy 1, policy_version 1848862 (0.0009) [2023-12-26 14:27:14,144][123091] Updated weights for policy 0, policy_version 1860504 (0.0009) [2023-12-26 14:27:14,192][123091] Updated weights for policy 0, policy_version 1860514 (0.0009) [2023-12-26 14:27:14,245][123091] Updated weights for policy 0, policy_version 1860524 (0.0008) [2023-12-26 14:27:14,823][123090] Updated weights for policy 1, policy_version 1848872 (0.0008) [2023-12-26 14:27:14,879][123090] Updated weights for policy 1, policy_version 1848882 (0.0005) [2023-12-26 14:27:14,941][123090] Updated weights for policy 1, policy_version 1848892 (0.0006) [2023-12-26 14:27:15,112][123091] Updated weights for policy 0, policy_version 1860534 (0.0007) [2023-12-26 14:27:15,180][123091] Updated weights for policy 0, policy_version 1860544 (0.0006) [2023-12-26 14:27:15,240][123091] Updated weights for policy 0, policy_version 1860554 (0.0006) [2023-12-26 14:27:15,652][123090] Updated weights for policy 1, policy_version 1848902 (0.0006) [2023-12-26 14:27:15,704][123090] Updated weights for policy 1, policy_version 1848912 (0.0006) [2023-12-26 14:27:15,755][123090] Updated weights for policy 1, policy_version 1848922 (0.0006) [2023-12-26 14:27:15,881][123091] Updated weights for policy 0, policy_version 1860564 (0.0007) [2023-12-26 14:27:15,943][123091] Updated weights for policy 0, policy_version 1860574 (0.0008) [2023-12-26 14:27:15,997][123091] Updated weights for policy 0, policy_version 1860584 (0.0005) [2023-12-26 14:27:16,577][123090] Updated weights for policy 1, policy_version 1848932 (0.0010) [2023-12-26 14:27:16,631][123090] Updated weights for policy 1, policy_version 1848942 (0.0010) [2023-12-26 14:27:16,680][123090] Updated weights for policy 1, policy_version 1848952 (0.0010) [2023-12-26 14:27:16,776][123091] Updated weights for policy 0, policy_version 1860594 (0.0005) [2023-12-26 14:27:16,830][123091] Updated weights for policy 0, policy_version 1860604 (0.0005) [2023-12-26 14:27:16,879][123091] Updated weights for policy 0, policy_version 1860614 (0.0005) [2023-12-26 14:27:16,924][123091] Updated weights for policy 0, policy_version 1860624 (0.0005) [2023-12-26 14:27:17,469][123090] Updated weights for policy 1, policy_version 1848962 (0.0010) [2023-12-26 14:27:17,531][123090] Updated weights for policy 1, policy_version 1848972 (0.0009) [2023-12-26 14:27:17,584][123090] Updated weights for policy 1, policy_version 1848982 (0.0005) [2023-12-26 14:27:17,610][123091] Updated weights for policy 0, policy_version 1860634 (0.0005) [2023-12-26 14:27:17,638][123090] Updated weights for policy 1, policy_version 1848992 (0.0007) [2023-12-26 14:27:17,663][123091] Updated weights for policy 0, policy_version 1860644 (0.0005) [2023-12-26 14:27:17,718][123091] Updated weights for policy 0, policy_version 1860654 (0.0005) [2023-12-26 14:27:18,399][123091] Updated weights for policy 0, policy_version 1860664 (0.0007) [2023-12-26 14:27:18,422][123090] Updated weights for policy 1, policy_version 1849002 (0.0009) [2023-12-26 14:27:18,486][123090] Updated weights for policy 1, policy_version 1849012 (0.0010) [2023-12-26 14:27:18,496][123091] Updated weights for policy 0, policy_version 1860674 (0.0007) [2023-12-26 14:27:18,548][123090] Updated weights for policy 1, policy_version 1849022 (0.0007) [2023-12-26 14:27:18,557][123091] Updated weights for policy 0, policy_version 1860684 (0.0009) [2023-12-26 14:27:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 949690368. Throughput: 0: 8898.3, 1: 8908.2. Samples: 949699220. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:18,785][121949] Avg episode reward: [(0, '6376.520'), (1, '5949.157')] [2023-12-26 14:27:19,301][123091] Updated weights for policy 0, policy_version 1860694 (0.0010) [2023-12-26 14:27:19,365][123091] Updated weights for policy 0, policy_version 1860704 (0.0009) [2023-12-26 14:27:19,405][123090] Updated weights for policy 1, policy_version 1849032 (0.0008) [2023-12-26 14:27:19,436][123091] Updated weights for policy 0, policy_version 1860714 (0.0008) [2023-12-26 14:27:19,471][123090] Updated weights for policy 1, policy_version 1849042 (0.0006) [2023-12-26 14:27:19,538][123090] Updated weights for policy 1, policy_version 1849052 (0.0007) [2023-12-26 14:27:20,244][123090] Updated weights for policy 1, policy_version 1849062 (0.0008) [2023-12-26 14:27:20,279][123091] Updated weights for policy 0, policy_version 1860724 (0.0008) [2023-12-26 14:27:20,303][123090] Updated weights for policy 1, policy_version 1849072 (0.0008) [2023-12-26 14:27:20,340][123091] Updated weights for policy 0, policy_version 1860734 (0.0008) [2023-12-26 14:27:20,363][123090] Updated weights for policy 1, policy_version 1849082 (0.0008) [2023-12-26 14:27:20,409][123091] Updated weights for policy 0, policy_version 1860744 (0.0010) [2023-12-26 14:27:21,174][123091] Updated weights for policy 0, policy_version 1860754 (0.0010) [2023-12-26 14:27:21,246][123091] Updated weights for policy 0, policy_version 1860764 (0.0007) [2023-12-26 14:27:21,252][123090] Updated weights for policy 1, policy_version 1849092 (0.0007) [2023-12-26 14:27:21,312][123091] Updated weights for policy 0, policy_version 1860774 (0.0006) [2023-12-26 14:27:21,322][123090] Updated weights for policy 1, policy_version 1849102 (0.0008) [2023-12-26 14:27:21,381][123091] Updated weights for policy 0, policy_version 1860784 (0.0009) [2023-12-26 14:27:21,395][123090] Updated weights for policy 1, policy_version 1849112 (0.0008) [2023-12-26 14:27:22,198][123091] Updated weights for policy 0, policy_version 1860794 (0.0010) [2023-12-26 14:27:22,228][123090] Updated weights for policy 1, policy_version 1849122 (0.0009) [2023-12-26 14:27:22,259][123091] Updated weights for policy 0, policy_version 1860804 (0.0009) [2023-12-26 14:27:22,296][123090] Updated weights for policy 1, policy_version 1849132 (0.0008) [2023-12-26 14:27:22,328][123091] Updated weights for policy 0, policy_version 1860814 (0.0008) [2023-12-26 14:27:22,366][123090] Updated weights for policy 1, policy_version 1849142 (0.0008) [2023-12-26 14:27:22,441][123090] Updated weights for policy 1, policy_version 1849152 (0.0010) [2023-12-26 14:27:23,162][123091] Updated weights for policy 0, policy_version 1860824 (0.0006) [2023-12-26 14:27:23,228][123091] Updated weights for policy 0, policy_version 1860834 (0.0005) [2023-12-26 14:27:23,262][123090] Updated weights for policy 1, policy_version 1849162 (0.0006) [2023-12-26 14:27:23,303][123091] Updated weights for policy 0, policy_version 1860844 (0.0005) [2023-12-26 14:27:23,332][123090] Updated weights for policy 1, policy_version 1849172 (0.0005) [2023-12-26 14:27:23,404][123090] Updated weights for policy 1, policy_version 1849182 (0.0005) [2023-12-26 14:27:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 949772288. Throughput: 0: 8891.8, 1: 8848.0. Samples: 949751080. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:23,785][121949] Avg episode reward: [(0, '6285.266'), (1, '5850.324')] [2023-12-26 14:27:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001860848_476381184.pth... [2023-12-26 14:27:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001849184_473391104.pth... [2023-12-26 14:27:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001859824_476119040.pth [2023-12-26 14:27:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001848160_473128960.pth [2023-12-26 14:27:23,998][123091] Updated weights for policy 0, policy_version 1860854 (0.0005) [2023-12-26 14:27:24,022][123090] Updated weights for policy 1, policy_version 1849192 (0.0005) [2023-12-26 14:27:24,062][123091] Updated weights for policy 0, policy_version 1860864 (0.0005) [2023-12-26 14:27:24,080][123090] Updated weights for policy 1, policy_version 1849202 (0.0006) [2023-12-26 14:27:24,113][123091] Updated weights for policy 0, policy_version 1860874 (0.0007) [2023-12-26 14:27:24,141][123090] Updated weights for policy 1, policy_version 1849212 (0.0006) [2023-12-26 14:27:24,743][123091] Updated weights for policy 0, policy_version 1860884 (0.0008) [2023-12-26 14:27:24,805][123091] Updated weights for policy 0, policy_version 1860894 (0.0005) [2023-12-26 14:27:24,852][123090] Updated weights for policy 1, policy_version 1849222 (0.0007) [2023-12-26 14:27:24,856][123091] Updated weights for policy 0, policy_version 1860904 (0.0005) [2023-12-26 14:27:24,901][123090] Updated weights for policy 1, policy_version 1849232 (0.0005) [2023-12-26 14:27:24,950][123090] Updated weights for policy 1, policy_version 1849242 (0.0009) [2023-12-26 14:27:25,530][123091] Updated weights for policy 0, policy_version 1860915 (0.0007) [2023-12-26 14:27:25,582][123091] Updated weights for policy 0, policy_version 1860925 (0.0009) [2023-12-26 14:27:25,637][123091] Updated weights for policy 0, policy_version 1860935 (0.0010) [2023-12-26 14:27:25,682][123090] Updated weights for policy 1, policy_version 1849252 (0.0010) [2023-12-26 14:27:25,736][123090] Updated weights for policy 1, policy_version 1849262 (0.0007) [2023-12-26 14:27:25,790][123090] Updated weights for policy 1, policy_version 1849272 (0.0005) [2023-12-26 14:27:26,381][123090] Updated weights for policy 1, policy_version 1849282 (0.0006) [2023-12-26 14:27:26,436][123090] Updated weights for policy 1, policy_version 1849292 (0.0010) [2023-12-26 14:27:26,491][123090] Updated weights for policy 1, policy_version 1849302 (0.0010) [2023-12-26 14:27:26,546][123090] Updated weights for policy 1, policy_version 1849312 (0.0010) [2023-12-26 14:27:26,559][123091] Updated weights for policy 0, policy_version 1860945 (0.0009) [2023-12-26 14:27:26,609][123091] Updated weights for policy 0, policy_version 1860955 (0.0006) [2023-12-26 14:27:26,671][123091] Updated weights for policy 0, policy_version 1860965 (0.0007) [2023-12-26 14:27:26,731][123091] Updated weights for policy 0, policy_version 1860975 (0.0005) [2023-12-26 14:27:27,386][123090] Updated weights for policy 1, policy_version 1849322 (0.0011) [2023-12-26 14:27:27,448][123090] Updated weights for policy 1, policy_version 1849332 (0.0010) [2023-12-26 14:27:27,455][123091] Updated weights for policy 0, policy_version 1860985 (0.0008) [2023-12-26 14:27:27,501][123091] Updated weights for policy 0, policy_version 1860995 (0.0006) [2023-12-26 14:27:27,510][123090] Updated weights for policy 1, policy_version 1849342 (0.0010) [2023-12-26 14:27:27,547][123091] Updated weights for policy 0, policy_version 1861005 (0.0009) [2023-12-26 14:27:28,342][123090] Updated weights for policy 1, policy_version 1849352 (0.0010) [2023-12-26 14:27:28,397][123091] Updated weights for policy 0, policy_version 1861015 (0.0007) [2023-12-26 14:27:28,408][123090] Updated weights for policy 1, policy_version 1849362 (0.0011) [2023-12-26 14:27:28,466][123091] Updated weights for policy 0, policy_version 1861025 (0.0008) [2023-12-26 14:27:28,470][123090] Updated weights for policy 1, policy_version 1849372 (0.0006) [2023-12-26 14:27:28,522][123091] Updated weights for policy 0, policy_version 1861035 (0.0009) [2023-12-26 14:27:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 949870592. Throughput: 0: 8990.6, 1: 8966.0. Samples: 949861772. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:28,785][121949] Avg episode reward: [(0, '6144.291'), (1, '5845.154')] [2023-12-26 14:27:29,197][123090] Updated weights for policy 1, policy_version 1849382 (0.0008) [2023-12-26 14:27:29,274][123090] Updated weights for policy 1, policy_version 1849392 (0.0008) [2023-12-26 14:27:29,343][123090] Updated weights for policy 1, policy_version 1849402 (0.0009) [2023-12-26 14:27:29,401][123091] Updated weights for policy 0, policy_version 1861045 (0.0009) [2023-12-26 14:27:29,462][123091] Updated weights for policy 0, policy_version 1861055 (0.0009) [2023-12-26 14:27:29,515][123091] Updated weights for policy 0, policy_version 1861065 (0.0010) [2023-12-26 14:27:30,163][123090] Updated weights for policy 1, policy_version 1849412 (0.0009) [2023-12-26 14:27:30,226][123090] Updated weights for policy 1, policy_version 1849422 (0.0009) [2023-12-26 14:27:30,279][123090] Updated weights for policy 1, policy_version 1849432 (0.0009) [2023-12-26 14:27:30,289][123091] Updated weights for policy 0, policy_version 1861075 (0.0009) [2023-12-26 14:27:30,345][123091] Updated weights for policy 0, policy_version 1861085 (0.0009) [2023-12-26 14:27:30,399][123091] Updated weights for policy 0, policy_version 1861095 (0.0009) [2023-12-26 14:27:31,141][123090] Updated weights for policy 1, policy_version 1849442 (0.0007) [2023-12-26 14:27:31,172][123091] Updated weights for policy 0, policy_version 1861105 (0.0009) [2023-12-26 14:27:31,201][123090] Updated weights for policy 1, policy_version 1849452 (0.0008) [2023-12-26 14:27:31,229][123091] Updated weights for policy 0, policy_version 1861115 (0.0009) [2023-12-26 14:27:31,262][123090] Updated weights for policy 1, policy_version 1849462 (0.0009) [2023-12-26 14:27:31,290][123091] Updated weights for policy 0, policy_version 1861125 (0.0006) [2023-12-26 14:27:31,314][123090] Updated weights for policy 1, policy_version 1849472 (0.0008) [2023-12-26 14:27:31,353][123091] Updated weights for policy 0, policy_version 1861135 (0.0006) [2023-12-26 14:27:32,088][123090] Updated weights for policy 1, policy_version 1849482 (0.0009) [2023-12-26 14:27:32,141][123090] Updated weights for policy 1, policy_version 1849492 (0.0009) [2023-12-26 14:27:32,189][123091] Updated weights for policy 0, policy_version 1861145 (0.0008) [2023-12-26 14:27:32,192][123090] Updated weights for policy 1, policy_version 1849502 (0.0009) [2023-12-26 14:27:32,237][123091] Updated weights for policy 0, policy_version 1861155 (0.0009) [2023-12-26 14:27:32,294][123091] Updated weights for policy 0, policy_version 1861165 (0.0010) [2023-12-26 14:27:33,036][123090] Updated weights for policy 1, policy_version 1849512 (0.0009) [2023-12-26 14:27:33,093][123090] Updated weights for policy 1, policy_version 1849522 (0.0009) [2023-12-26 14:27:33,105][123091] Updated weights for policy 0, policy_version 1861176 (0.0009) [2023-12-26 14:27:33,147][123090] Updated weights for policy 1, policy_version 1849532 (0.0008) [2023-12-26 14:27:33,150][123091] Updated weights for policy 0, policy_version 1861186 (0.0007) [2023-12-26 14:27:33,200][123091] Updated weights for policy 0, policy_version 1861196 (0.0005) [2023-12-26 14:27:33,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 949952512. Throughput: 0: 8986.9, 1: 8927.1. Samples: 949967100. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:33,786][121949] Avg episode reward: [(0, '6148.842'), (1, '5939.561')] [2023-12-26 14:27:33,826][123091] Updated weights for policy 0, policy_version 1861206 (0.0005) [2023-12-26 14:27:33,877][123091] Updated weights for policy 0, policy_version 1861216 (0.0005) [2023-12-26 14:27:33,932][123091] Updated weights for policy 0, policy_version 1861226 (0.0005) [2023-12-26 14:27:34,006][123090] Updated weights for policy 1, policy_version 1849542 (0.0007) [2023-12-26 14:27:34,073][123090] Updated weights for policy 1, policy_version 1849552 (0.0005) [2023-12-26 14:27:34,135][123090] Updated weights for policy 1, policy_version 1849562 (0.0006) [2023-12-26 14:27:34,689][123091] Updated weights for policy 0, policy_version 1861236 (0.0007) [2023-12-26 14:27:34,761][123091] Updated weights for policy 0, policy_version 1861246 (0.0009) [2023-12-26 14:27:34,824][123091] Updated weights for policy 0, policy_version 1861256 (0.0009) [2023-12-26 14:27:34,892][123090] Updated weights for policy 1, policy_version 1849572 (0.0008) [2023-12-26 14:27:34,952][123090] Updated weights for policy 1, policy_version 1849582 (0.0009) [2023-12-26 14:27:35,003][123090] Updated weights for policy 1, policy_version 1849592 (0.0008) [2023-12-26 14:27:35,563][123091] Updated weights for policy 0, policy_version 1861266 (0.0007) [2023-12-26 14:27:35,618][123091] Updated weights for policy 0, policy_version 1861276 (0.0005) [2023-12-26 14:27:35,674][123091] Updated weights for policy 0, policy_version 1861287 (0.0006) [2023-12-26 14:27:35,878][123090] Updated weights for policy 1, policy_version 1849602 (0.0010) [2023-12-26 14:27:35,932][123090] Updated weights for policy 1, policy_version 1849612 (0.0010) [2023-12-26 14:27:36,004][123090] Updated weights for policy 1, policy_version 1849622 (0.0010) [2023-12-26 14:27:36,066][123090] Updated weights for policy 1, policy_version 1849632 (0.0010) [2023-12-26 14:27:36,385][123091] Updated weights for policy 0, policy_version 1861297 (0.0006) [2023-12-26 14:27:36,448][123091] Updated weights for policy 0, policy_version 1861307 (0.0009) [2023-12-26 14:27:36,516][123091] Updated weights for policy 0, policy_version 1861317 (0.0009) [2023-12-26 14:27:36,569][123091] Updated weights for policy 0, policy_version 1861327 (0.0009) [2023-12-26 14:27:36,926][123090] Updated weights for policy 1, policy_version 1849642 (0.0009) [2023-12-26 14:27:36,975][123090] Updated weights for policy 1, policy_version 1849652 (0.0009) [2023-12-26 14:27:37,038][123090] Updated weights for policy 1, policy_version 1849662 (0.0009) [2023-12-26 14:27:37,427][123091] Updated weights for policy 0, policy_version 1861337 (0.0010) [2023-12-26 14:27:37,479][123091] Updated weights for policy 0, policy_version 1861347 (0.0010) [2023-12-26 14:27:37,531][123091] Updated weights for policy 0, policy_version 1861357 (0.0010) [2023-12-26 14:27:37,911][123090] Updated weights for policy 1, policy_version 1849672 (0.0009) [2023-12-26 14:27:37,959][123090] Updated weights for policy 1, policy_version 1849682 (0.0009) [2023-12-26 14:27:38,008][123090] Updated weights for policy 1, policy_version 1849692 (0.0009) [2023-12-26 14:27:38,377][123091] Updated weights for policy 0, policy_version 1861367 (0.0010) [2023-12-26 14:27:38,439][123091] Updated weights for policy 0, policy_version 1861377 (0.0010) [2023-12-26 14:27:38,500][123091] Updated weights for policy 0, policy_version 1861387 (0.0009) [2023-12-26 14:27:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 950042624. Throughput: 0: 9001.2, 1: 8900.8. Samples: 950020604. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:38,785][121949] Avg episode reward: [(0, '6257.905'), (1, '5954.164')] [2023-12-26 14:27:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001861392_476520448.pth... [2023-12-26 14:27:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001849696_473522176.pth... [2023-12-26 14:27:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001860336_476250112.pth [2023-12-26 14:27:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001848672_473260032.pth [2023-12-26 14:27:38,858][123090] Updated weights for policy 1, policy_version 1849702 (0.0007) [2023-12-26 14:27:38,930][123090] Updated weights for policy 1, policy_version 1849712 (0.0006) [2023-12-26 14:27:38,997][123090] Updated weights for policy 1, policy_version 1849722 (0.0006) [2023-12-26 14:27:39,313][123091] Updated weights for policy 0, policy_version 1861397 (0.0009) [2023-12-26 14:27:39,376][123091] Updated weights for policy 0, policy_version 1861407 (0.0010) [2023-12-26 14:27:39,447][123091] Updated weights for policy 0, policy_version 1861417 (0.0011) [2023-12-26 14:27:39,770][123090] Updated weights for policy 1, policy_version 1849732 (0.0007) [2023-12-26 14:27:39,830][123090] Updated weights for policy 1, policy_version 1849742 (0.0009) [2023-12-26 14:27:39,896][123090] Updated weights for policy 1, policy_version 1849752 (0.0009) [2023-12-26 14:27:40,262][123091] Updated weights for policy 0, policy_version 1861427 (0.0011) [2023-12-26 14:27:40,318][123091] Updated weights for policy 0, policy_version 1861437 (0.0011) [2023-12-26 14:27:40,373][123091] Updated weights for policy 0, policy_version 1861447 (0.0011) [2023-12-26 14:27:40,772][123090] Updated weights for policy 1, policy_version 1849762 (0.0009) [2023-12-26 14:27:40,827][123090] Updated weights for policy 1, policy_version 1849772 (0.0010) [2023-12-26 14:27:40,894][123090] Updated weights for policy 1, policy_version 1849782 (0.0011) [2023-12-26 14:27:40,950][123090] Updated weights for policy 1, policy_version 1849792 (0.0006) [2023-12-26 14:27:41,028][123091] Updated weights for policy 0, policy_version 1861457 (0.0009) [2023-12-26 14:27:41,098][123091] Updated weights for policy 0, policy_version 1861467 (0.0008) [2023-12-26 14:27:41,173][123091] Updated weights for policy 0, policy_version 1861477 (0.0010) [2023-12-26 14:27:41,243][123091] Updated weights for policy 0, policy_version 1861487 (0.0013) [2023-12-26 14:27:41,826][123090] Updated weights for policy 1, policy_version 1849802 (0.0009) [2023-12-26 14:27:41,880][123090] Updated weights for policy 1, policy_version 1849812 (0.0009) [2023-12-26 14:27:41,950][123090] Updated weights for policy 1, policy_version 1849822 (0.0009) [2023-12-26 14:27:42,095][123091] Updated weights for policy 0, policy_version 1861497 (0.0009) [2023-12-26 14:27:42,155][123091] Updated weights for policy 0, policy_version 1861507 (0.0005) [2023-12-26 14:27:42,219][123091] Updated weights for policy 0, policy_version 1861517 (0.0006) [2023-12-26 14:27:42,832][123090] Updated weights for policy 1, policy_version 1849832 (0.0010) [2023-12-26 14:27:42,884][123090] Updated weights for policy 1, policy_version 1849842 (0.0009) [2023-12-26 14:27:42,894][123091] Updated weights for policy 0, policy_version 1861527 (0.0006) [2023-12-26 14:27:42,942][123091] Updated weights for policy 0, policy_version 1861537 (0.0005) [2023-12-26 14:27:42,945][123090] Updated weights for policy 1, policy_version 1849852 (0.0009) [2023-12-26 14:27:42,998][123091] Updated weights for policy 0, policy_version 1861547 (0.0005) [2023-12-26 14:27:43,677][123090] Updated weights for policy 1, policy_version 1849862 (0.0007) [2023-12-26 14:27:43,722][123091] Updated weights for policy 0, policy_version 1861557 (0.0008) [2023-12-26 14:27:43,744][123090] Updated weights for policy 1, policy_version 1849872 (0.0006) [2023-12-26 14:27:43,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 950124544. Throughput: 0: 8980.4, 1: 8823.8. Samples: 950123568. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:43,785][121949] Avg episode reward: [(0, '6291.757'), (1, '6009.672')] [2023-12-26 14:27:43,785][123091] Updated weights for policy 0, policy_version 1861567 (0.0011) [2023-12-26 14:27:43,808][123090] Updated weights for policy 1, policy_version 1849882 (0.0006) [2023-12-26 14:27:43,838][123091] Updated weights for policy 0, policy_version 1861577 (0.0011) [2023-12-26 14:27:44,607][123091] Updated weights for policy 0, policy_version 1861587 (0.0011) [2023-12-26 14:27:44,638][123090] Updated weights for policy 1, policy_version 1849892 (0.0007) [2023-12-26 14:27:44,666][123091] Updated weights for policy 0, policy_version 1861597 (0.0010) [2023-12-26 14:27:44,696][123090] Updated weights for policy 1, policy_version 1849902 (0.0006) [2023-12-26 14:27:44,728][123091] Updated weights for policy 0, policy_version 1861607 (0.0011) [2023-12-26 14:27:44,770][123090] Updated weights for policy 1, policy_version 1849912 (0.0006) [2023-12-26 14:27:45,455][123091] Updated weights for policy 0, policy_version 1861617 (0.0009) [2023-12-26 14:27:45,526][123091] Updated weights for policy 0, policy_version 1861627 (0.0005) [2023-12-26 14:27:45,582][123090] Updated weights for policy 1, policy_version 1849922 (0.0008) [2023-12-26 14:27:45,587][123091] Updated weights for policy 0, policy_version 1861637 (0.0008) [2023-12-26 14:27:45,642][123090] Updated weights for policy 1, policy_version 1849932 (0.0006) [2023-12-26 14:27:45,652][123091] Updated weights for policy 0, policy_version 1861647 (0.0011) [2023-12-26 14:27:45,710][123090] Updated weights for policy 1, policy_version 1849942 (0.0009) [2023-12-26 14:27:45,767][123090] Updated weights for policy 1, policy_version 1849952 (0.0009) [2023-12-26 14:27:46,417][123091] Updated weights for policy 0, policy_version 1861657 (0.0011) [2023-12-26 14:27:46,478][123091] Updated weights for policy 0, policy_version 1861667 (0.0008) [2023-12-26 14:27:46,547][123091] Updated weights for policy 0, policy_version 1861677 (0.0005) [2023-12-26 14:27:46,609][123090] Updated weights for policy 1, policy_version 1849962 (0.0010) [2023-12-26 14:27:46,663][123090] Updated weights for policy 1, policy_version 1849972 (0.0010) [2023-12-26 14:27:46,726][123090] Updated weights for policy 1, policy_version 1849982 (0.0010) [2023-12-26 14:27:47,209][123091] Updated weights for policy 0, policy_version 1861687 (0.0006) [2023-12-26 14:27:47,268][123091] Updated weights for policy 0, policy_version 1861697 (0.0006) [2023-12-26 14:27:47,330][123091] Updated weights for policy 0, policy_version 1861707 (0.0006) [2023-12-26 14:27:47,678][123090] Updated weights for policy 1, policy_version 1849993 (0.0010) [2023-12-26 14:27:47,737][123090] Updated weights for policy 1, policy_version 1850003 (0.0010) [2023-12-26 14:27:47,793][123090] Updated weights for policy 1, policy_version 1850014 (0.0011) [2023-12-26 14:27:47,910][123091] Updated weights for policy 0, policy_version 1861717 (0.0005) [2023-12-26 14:27:47,974][123091] Updated weights for policy 0, policy_version 1861727 (0.0005) [2023-12-26 14:27:48,042][123091] Updated weights for policy 0, policy_version 1861737 (0.0008) [2023-12-26 14:27:48,565][123090] Updated weights for policy 1, policy_version 1850025 (0.0009) [2023-12-26 14:27:48,626][123090] Updated weights for policy 1, policy_version 1850035 (0.0009) [2023-12-26 14:27:48,682][123090] Updated weights for policy 1, policy_version 1850045 (0.0008) [2023-12-26 14:27:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 950222848. Throughput: 0: 9161.2, 1: 8756.8. Samples: 950233524. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:48,785][121949] Avg episode reward: [(0, '6316.923'), (1, '6083.580')] [2023-12-26 14:27:48,819][123091] Updated weights for policy 0, policy_version 1861747 (0.0011) [2023-12-26 14:27:48,872][123091] Updated weights for policy 0, policy_version 1861757 (0.0011) [2023-12-26 14:27:48,920][123091] Updated weights for policy 0, policy_version 1861767 (0.0011) [2023-12-26 14:27:49,567][123090] Updated weights for policy 1, policy_version 1850055 (0.0009) [2023-12-26 14:27:49,635][123090] Updated weights for policy 1, policy_version 1850065 (0.0009) [2023-12-26 14:27:49,698][123090] Updated weights for policy 1, policy_version 1850075 (0.0009) [2023-12-26 14:27:49,750][123091] Updated weights for policy 0, policy_version 1861777 (0.0010) [2023-12-26 14:27:49,818][123091] Updated weights for policy 0, policy_version 1861787 (0.0009) [2023-12-26 14:27:49,874][123091] Updated weights for policy 0, policy_version 1861797 (0.0009) [2023-12-26 14:27:49,941][123091] Updated weights for policy 0, policy_version 1861807 (0.0008) [2023-12-26 14:27:50,473][123090] Updated weights for policy 1, policy_version 1850085 (0.0009) [2023-12-26 14:27:50,532][123090] Updated weights for policy 1, policy_version 1850095 (0.0005) [2023-12-26 14:27:50,598][123090] Updated weights for policy 1, policy_version 1850105 (0.0007) [2023-12-26 14:27:50,644][123091] Updated weights for policy 0, policy_version 1861817 (0.0006) [2023-12-26 14:27:50,722][123091] Updated weights for policy 0, policy_version 1861827 (0.0006) [2023-12-26 14:27:50,806][123091] Updated weights for policy 0, policy_version 1861837 (0.0007) [2023-12-26 14:27:51,391][123090] Updated weights for policy 1, policy_version 1850115 (0.0006) [2023-12-26 14:27:51,448][123090] Updated weights for policy 1, policy_version 1850125 (0.0010) [2023-12-26 14:27:51,505][123090] Updated weights for policy 1, policy_version 1850135 (0.0010) [2023-12-26 14:27:51,518][123091] Updated weights for policy 0, policy_version 1861847 (0.0007) [2023-12-26 14:27:51,584][123091] Updated weights for policy 0, policy_version 1861857 (0.0005) [2023-12-26 14:27:51,652][123091] Updated weights for policy 0, policy_version 1861867 (0.0008) [2023-12-26 14:27:52,310][123090] Updated weights for policy 1, policy_version 1850145 (0.0009) [2023-12-26 14:27:52,378][123090] Updated weights for policy 1, policy_version 1850155 (0.0009) [2023-12-26 14:27:52,444][123090] Updated weights for policy 1, policy_version 1850165 (0.0009) [2023-12-26 14:27:52,471][123091] Updated weights for policy 0, policy_version 1861877 (0.0008) [2023-12-26 14:27:52,500][123090] Updated weights for policy 1, policy_version 1850175 (0.0009) [2023-12-26 14:27:52,523][123091] Updated weights for policy 0, policy_version 1861887 (0.0008) [2023-12-26 14:27:52,576][123091] Updated weights for policy 0, policy_version 1861897 (0.0009) [2023-12-26 14:27:53,332][123090] Updated weights for policy 1, policy_version 1850185 (0.0006) [2023-12-26 14:27:53,371][123091] Updated weights for policy 0, policy_version 1861907 (0.0009) [2023-12-26 14:27:53,389][123090] Updated weights for policy 1, policy_version 1850195 (0.0005) [2023-12-26 14:27:53,425][123091] Updated weights for policy 0, policy_version 1861917 (0.0009) [2023-12-26 14:27:53,442][123090] Updated weights for policy 1, policy_version 1850205 (0.0005) [2023-12-26 14:27:53,480][123091] Updated weights for policy 0, policy_version 1861927 (0.0009) [2023-12-26 14:27:53,784][121949] Fps is (10 sec: 18841.1, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 950312960. Throughput: 0: 9153.1, 1: 8763.0. Samples: 950286892. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:53,785][121949] Avg episode reward: [(0, '6315.707'), (1, '6094.704')] [2023-12-26 14:27:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001861936_476659712.pth... [2023-12-26 14:27:53,798][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001850208_473653248.pth... [2023-12-26 14:27:53,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001860848_476381184.pth [2023-12-26 14:27:53,803][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001849184_473391104.pth [2023-12-26 14:27:54,124][123090] Updated weights for policy 1, policy_version 1850215 (0.0007) [2023-12-26 14:27:54,175][123090] Updated weights for policy 1, policy_version 1850225 (0.0008) [2023-12-26 14:27:54,225][123090] Updated weights for policy 1, policy_version 1850235 (0.0008) [2023-12-26 14:27:54,233][123091] Updated weights for policy 0, policy_version 1861937 (0.0007) [2023-12-26 14:27:54,289][123091] Updated weights for policy 0, policy_version 1861947 (0.0006) [2023-12-26 14:27:54,341][123091] Updated weights for policy 0, policy_version 1861957 (0.0010) [2023-12-26 14:27:54,400][123091] Updated weights for policy 0, policy_version 1861968 (0.0010) [2023-12-26 14:27:54,933][123090] Updated weights for policy 1, policy_version 1850245 (0.0007) [2023-12-26 14:27:55,001][123090] Updated weights for policy 1, policy_version 1850255 (0.0006) [2023-12-26 14:27:55,065][123090] Updated weights for policy 1, policy_version 1850265 (0.0010) [2023-12-26 14:27:55,309][123091] Updated weights for policy 0, policy_version 1861978 (0.0009) [2023-12-26 14:27:55,361][123091] Updated weights for policy 0, policy_version 1861989 (0.0010) [2023-12-26 14:27:55,414][123091] Updated weights for policy 0, policy_version 1862000 (0.0010) [2023-12-26 14:27:55,667][123090] Updated weights for policy 1, policy_version 1850275 (0.0010) [2023-12-26 14:27:55,722][123090] Updated weights for policy 1, policy_version 1850285 (0.0010) [2023-12-26 14:27:55,781][123090] Updated weights for policy 1, policy_version 1850295 (0.0010) [2023-12-26 14:27:56,234][123091] Updated weights for policy 0, policy_version 1862010 (0.0009) [2023-12-26 14:27:56,282][123091] Updated weights for policy 0, policy_version 1862020 (0.0009) [2023-12-26 14:27:56,332][123091] Updated weights for policy 0, policy_version 1862030 (0.0009) [2023-12-26 14:27:56,597][123090] Updated weights for policy 1, policy_version 1850305 (0.0010) [2023-12-26 14:27:56,651][123090] Updated weights for policy 1, policy_version 1850315 (0.0010) [2023-12-26 14:27:56,713][123090] Updated weights for policy 1, policy_version 1850325 (0.0010) [2023-12-26 14:27:56,780][123090] Updated weights for policy 1, policy_version 1850335 (0.0009) [2023-12-26 14:27:57,135][123091] Updated weights for policy 0, policy_version 1862040 (0.0008) [2023-12-26 14:27:57,184][123091] Updated weights for policy 0, policy_version 1862050 (0.0006) [2023-12-26 14:27:57,233][123091] Updated weights for policy 0, policy_version 1862060 (0.0008) [2023-12-26 14:27:57,652][123090] Updated weights for policy 1, policy_version 1850345 (0.0010) [2023-12-26 14:27:57,713][123090] Updated weights for policy 1, policy_version 1850355 (0.0009) [2023-12-26 14:27:57,769][123090] Updated weights for policy 1, policy_version 1850365 (0.0009) [2023-12-26 14:27:57,913][123091] Updated weights for policy 0, policy_version 1862070 (0.0005) [2023-12-26 14:27:57,958][123091] Updated weights for policy 0, policy_version 1862080 (0.0005) [2023-12-26 14:27:58,005][123091] Updated weights for policy 0, policy_version 1862090 (0.0005) [2023-12-26 14:27:58,559][123090] Updated weights for policy 1, policy_version 1850375 (0.0009) [2023-12-26 14:27:58,629][123090] Updated weights for policy 1, policy_version 1850385 (0.0008) [2023-12-26 14:27:58,708][123090] Updated weights for policy 1, policy_version 1850395 (0.0007) [2023-12-26 14:27:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 950403072. Throughput: 0: 9149.0, 1: 8826.1. Samples: 950395320. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:27:58,785][121949] Avg episode reward: [(0, '6221.506'), (1, '5944.212')] [2023-12-26 14:27:58,829][123091] Updated weights for policy 0, policy_version 1862100 (0.0006) [2023-12-26 14:27:58,915][123091] Updated weights for policy 0, policy_version 1862110 (0.0007) [2023-12-26 14:27:58,986][123091] Updated weights for policy 0, policy_version 1862120 (0.0006) [2023-12-26 14:27:59,573][123090] Updated weights for policy 1, policy_version 1850405 (0.0008) [2023-12-26 14:27:59,637][123090] Updated weights for policy 1, policy_version 1850415 (0.0008) [2023-12-26 14:27:59,700][123090] Updated weights for policy 1, policy_version 1850425 (0.0008) [2023-12-26 14:27:59,753][123091] Updated weights for policy 0, policy_version 1862130 (0.0007) [2023-12-26 14:27:59,813][123091] Updated weights for policy 0, policy_version 1862140 (0.0006) [2023-12-26 14:27:59,881][123091] Updated weights for policy 0, policy_version 1862150 (0.0008) [2023-12-26 14:27:59,950][123091] Updated weights for policy 0, policy_version 1862160 (0.0008) [2023-12-26 14:28:00,517][123090] Updated weights for policy 1, policy_version 1850435 (0.0008) [2023-12-26 14:28:00,569][123090] Updated weights for policy 1, policy_version 1850445 (0.0009) [2023-12-26 14:28:00,610][123091] Updated weights for policy 0, policy_version 1862170 (0.0005) [2023-12-26 14:28:00,632][123090] Updated weights for policy 1, policy_version 1850455 (0.0008) [2023-12-26 14:28:00,666][123091] Updated weights for policy 0, policy_version 1862180 (0.0005) [2023-12-26 14:28:00,735][123091] Updated weights for policy 0, policy_version 1862190 (0.0007) [2023-12-26 14:28:01,443][123091] Updated weights for policy 0, policy_version 1862200 (0.0009) [2023-12-26 14:28:01,484][123090] Updated weights for policy 1, policy_version 1850465 (0.0006) [2023-12-26 14:28:01,494][123091] Updated weights for policy 0, policy_version 1862210 (0.0009) [2023-12-26 14:28:01,552][123090] Updated weights for policy 1, policy_version 1850475 (0.0008) [2023-12-26 14:28:01,558][123091] Updated weights for policy 0, policy_version 1862220 (0.0008) [2023-12-26 14:28:01,619][123090] Updated weights for policy 1, policy_version 1850485 (0.0008) [2023-12-26 14:28:01,685][123090] Updated weights for policy 1, policy_version 1850495 (0.0009) [2023-12-26 14:28:02,280][123091] Updated weights for policy 0, policy_version 1862230 (0.0008) [2023-12-26 14:28:02,354][123091] Updated weights for policy 0, policy_version 1862240 (0.0006) [2023-12-26 14:28:02,426][123091] Updated weights for policy 0, policy_version 1862250 (0.0006) [2023-12-26 14:28:02,477][123090] Updated weights for policy 1, policy_version 1850505 (0.0006) [2023-12-26 14:28:02,536][123090] Updated weights for policy 1, policy_version 1850515 (0.0008) [2023-12-26 14:28:02,596][123090] Updated weights for policy 1, policy_version 1850525 (0.0008) [2023-12-26 14:28:03,135][123091] Updated weights for policy 0, policy_version 1862260 (0.0007) [2023-12-26 14:28:03,202][123091] Updated weights for policy 0, policy_version 1862270 (0.0006) [2023-12-26 14:28:03,255][123091] Updated weights for policy 0, policy_version 1862280 (0.0006) [2023-12-26 14:28:03,426][123090] Updated weights for policy 1, policy_version 1850535 (0.0009) [2023-12-26 14:28:03,478][123090] Updated weights for policy 1, policy_version 1850545 (0.0008) [2023-12-26 14:28:03,533][123090] Updated weights for policy 1, policy_version 1850555 (0.0009) [2023-12-26 14:28:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 950493184. Throughput: 0: 9151.0, 1: 8708.1. Samples: 950502880. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:03,785][121949] Avg episode reward: [(0, '6214.560'), (1, '5995.035')] [2023-12-26 14:28:03,953][123091] Updated weights for policy 0, policy_version 1862290 (0.0009) [2023-12-26 14:28:04,011][123091] Updated weights for policy 0, policy_version 1862300 (0.0006) [2023-12-26 14:28:04,077][123091] Updated weights for policy 0, policy_version 1862310 (0.0008) [2023-12-26 14:28:04,145][123091] Updated weights for policy 0, policy_version 1862320 (0.0009) [2023-12-26 14:28:04,408][123090] Updated weights for policy 1, policy_version 1850565 (0.0008) [2023-12-26 14:28:04,472][123090] Updated weights for policy 1, policy_version 1850575 (0.0009) [2023-12-26 14:28:04,533][123090] Updated weights for policy 1, policy_version 1850586 (0.0010) [2023-12-26 14:28:04,956][123091] Updated weights for policy 0, policy_version 1862330 (0.0009) [2023-12-26 14:28:05,017][123091] Updated weights for policy 0, policy_version 1862340 (0.0008) [2023-12-26 14:28:05,071][123091] Updated weights for policy 0, policy_version 1862350 (0.0005) [2023-12-26 14:28:05,321][123090] Updated weights for policy 1, policy_version 1850596 (0.0008) [2023-12-26 14:28:05,388][123090] Updated weights for policy 1, policy_version 1850606 (0.0005) [2023-12-26 14:28:05,462][123090] Updated weights for policy 1, policy_version 1850616 (0.0008) [2023-12-26 14:28:05,723][123091] Updated weights for policy 0, policy_version 1862360 (0.0006) [2023-12-26 14:28:05,769][123091] Updated weights for policy 0, policy_version 1862370 (0.0005) [2023-12-26 14:28:05,819][123091] Updated weights for policy 0, policy_version 1862380 (0.0005) [2023-12-26 14:28:06,122][123090] Updated weights for policy 1, policy_version 1850626 (0.0009) [2023-12-26 14:28:06,192][123090] Updated weights for policy 1, policy_version 1850636 (0.0006) [2023-12-26 14:28:06,260][123090] Updated weights for policy 1, policy_version 1850646 (0.0008) [2023-12-26 14:28:06,322][123090] Updated weights for policy 1, policy_version 1850656 (0.0008) [2023-12-26 14:28:06,577][123091] Updated weights for policy 0, policy_version 1862390 (0.0006) [2023-12-26 14:28:06,648][123091] Updated weights for policy 0, policy_version 1862400 (0.0006) [2023-12-26 14:28:06,719][123091] Updated weights for policy 0, policy_version 1862410 (0.0007) [2023-12-26 14:28:07,152][123090] Updated weights for policy 1, policy_version 1850666 (0.0011) [2023-12-26 14:28:07,215][123090] Updated weights for policy 1, policy_version 1850676 (0.0010) [2023-12-26 14:28:07,274][123090] Updated weights for policy 1, policy_version 1850686 (0.0010) [2023-12-26 14:28:07,494][123091] Updated weights for policy 0, policy_version 1862420 (0.0009) [2023-12-26 14:28:07,553][123091] Updated weights for policy 0, policy_version 1862430 (0.0009) [2023-12-26 14:28:07,605][123091] Updated weights for policy 0, policy_version 1862440 (0.0009) [2023-12-26 14:28:08,054][123090] Updated weights for policy 1, policy_version 1850696 (0.0010) [2023-12-26 14:28:08,117][123090] Updated weights for policy 1, policy_version 1850706 (0.0010) [2023-12-26 14:28:08,168][123090] Updated weights for policy 1, policy_version 1850716 (0.0010) [2023-12-26 14:28:08,330][123091] Updated weights for policy 0, policy_version 1862451 (0.0010) [2023-12-26 14:28:08,390][123091] Updated weights for policy 0, policy_version 1862461 (0.0007) [2023-12-26 14:28:08,453][123091] Updated weights for policy 0, policy_version 1862471 (0.0005) [2023-12-26 14:28:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 950583296. Throughput: 0: 9211.7, 1: 8744.9. Samples: 950559128. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:08,785][121949] Avg episode reward: [(0, '6298.500'), (1, '6054.957')] [2023-12-26 14:28:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001862480_476798976.pth... [2023-12-26 14:28:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001850720_473784320.pth... [2023-12-26 14:28:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001861392_476520448.pth [2023-12-26 14:28:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001849696_473522176.pth [2023-12-26 14:28:08,963][123090] Updated weights for policy 1, policy_version 1850726 (0.0007) [2023-12-26 14:28:09,018][123090] Updated weights for policy 1, policy_version 1850736 (0.0005) [2023-12-26 14:28:09,077][123090] Updated weights for policy 1, policy_version 1850747 (0.0007) [2023-12-26 14:28:09,104][123091] Updated weights for policy 0, policy_version 1862481 (0.0005) [2023-12-26 14:28:09,168][123091] Updated weights for policy 0, policy_version 1862491 (0.0008) [2023-12-26 14:28:09,237][123091] Updated weights for policy 0, policy_version 1862501 (0.0009) [2023-12-26 14:28:09,311][123091] Updated weights for policy 0, policy_version 1862511 (0.0006) [2023-12-26 14:28:09,837][123090] Updated weights for policy 1, policy_version 1850757 (0.0008) [2023-12-26 14:28:09,894][123090] Updated weights for policy 1, policy_version 1850767 (0.0011) [2023-12-26 14:28:09,965][123090] Updated weights for policy 1, policy_version 1850777 (0.0011) [2023-12-26 14:28:09,990][123091] Updated weights for policy 0, policy_version 1862521 (0.0007) [2023-12-26 14:28:10,054][123091] Updated weights for policy 0, policy_version 1862531 (0.0008) [2023-12-26 14:28:10,115][123091] Updated weights for policy 0, policy_version 1862541 (0.0009) [2023-12-26 14:28:10,796][123091] Updated weights for policy 0, policy_version 1862551 (0.0009) [2023-12-26 14:28:10,815][123090] Updated weights for policy 1, policy_version 1850787 (0.0011) [2023-12-26 14:28:10,844][123091] Updated weights for policy 0, policy_version 1862561 (0.0010) [2023-12-26 14:28:10,869][123090] Updated weights for policy 1, policy_version 1850797 (0.0008) [2023-12-26 14:28:10,910][123091] Updated weights for policy 0, policy_version 1862571 (0.0006) [2023-12-26 14:28:10,933][123090] Updated weights for policy 1, policy_version 1850807 (0.0007) [2023-12-26 14:28:11,760][123090] Updated weights for policy 1, policy_version 1850817 (0.0006) [2023-12-26 14:28:11,791][123091] Updated weights for policy 0, policy_version 1862581 (0.0007) [2023-12-26 14:28:11,830][123090] Updated weights for policy 1, policy_version 1850827 (0.0008) [2023-12-26 14:28:11,855][123091] Updated weights for policy 0, policy_version 1862591 (0.0008) [2023-12-26 14:28:11,895][123090] Updated weights for policy 1, policy_version 1850837 (0.0011) [2023-12-26 14:28:11,910][123091] Updated weights for policy 0, policy_version 1862601 (0.0008) [2023-12-26 14:28:11,959][123090] Updated weights for policy 1, policy_version 1850847 (0.0011) [2023-12-26 14:28:12,707][123091] Updated weights for policy 0, policy_version 1862611 (0.0007) [2023-12-26 14:28:12,757][123091] Updated weights for policy 0, policy_version 1862621 (0.0005) [2023-12-26 14:28:12,769][123090] Updated weights for policy 1, policy_version 1850857 (0.0009) [2023-12-26 14:28:12,822][123091] Updated weights for policy 0, policy_version 1862631 (0.0006) [2023-12-26 14:28:12,841][123090] Updated weights for policy 1, policy_version 1850867 (0.0010) [2023-12-26 14:28:12,912][123090] Updated weights for policy 1, policy_version 1850877 (0.0011) [2023-12-26 14:28:13,491][123091] Updated weights for policy 0, policy_version 1862641 (0.0005) [2023-12-26 14:28:13,540][123091] Updated weights for policy 0, policy_version 1862651 (0.0005) [2023-12-26 14:28:13,588][123091] Updated weights for policy 0, policy_version 1862661 (0.0005) [2023-12-26 14:28:13,645][123091] Updated weights for policy 0, policy_version 1862671 (0.0005) [2023-12-26 14:28:13,729][123090] Updated weights for policy 1, policy_version 1850887 (0.0010) [2023-12-26 14:28:13,775][123090] Updated weights for policy 1, policy_version 1850897 (0.0010) [2023-12-26 14:28:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.3, 300 sec: 17800.2). Total num frames: 950673408. Throughput: 0: 9210.4, 1: 8667.8. Samples: 950666292. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:13,785][121949] Avg episode reward: [(0, '6323.542'), (1, '6028.899')] [2023-12-26 14:28:13,830][123090] Updated weights for policy 1, policy_version 1850907 (0.0010) [2023-12-26 14:28:14,337][123091] Updated weights for policy 0, policy_version 1862681 (0.0005) [2023-12-26 14:28:14,400][123091] Updated weights for policy 0, policy_version 1862691 (0.0005) [2023-12-26 14:28:14,465][123091] Updated weights for policy 0, policy_version 1862701 (0.0010) [2023-12-26 14:28:14,677][123090] Updated weights for policy 1, policy_version 1850917 (0.0010) [2023-12-26 14:28:14,732][123090] Updated weights for policy 1, policy_version 1850927 (0.0010) [2023-12-26 14:28:14,812][123090] Updated weights for policy 1, policy_version 1850937 (0.0011) [2023-12-26 14:28:15,130][123091] Updated weights for policy 0, policy_version 1862711 (0.0007) [2023-12-26 14:28:15,205][123091] Updated weights for policy 0, policy_version 1862721 (0.0009) [2023-12-26 14:28:15,269][123091] Updated weights for policy 0, policy_version 1862731 (0.0011) [2023-12-26 14:28:15,640][123090] Updated weights for policy 1, policy_version 1850947 (0.0011) [2023-12-26 14:28:15,696][123090] Updated weights for policy 1, policy_version 1850957 (0.0011) [2023-12-26 14:28:15,763][123090] Updated weights for policy 1, policy_version 1850967 (0.0011) [2023-12-26 14:28:15,936][123091] Updated weights for policy 0, policy_version 1862741 (0.0008) [2023-12-26 14:28:16,000][123091] Updated weights for policy 0, policy_version 1862751 (0.0005) [2023-12-26 14:28:16,069][123091] Updated weights for policy 0, policy_version 1862761 (0.0005) [2023-12-26 14:28:16,520][123090] Updated weights for policy 1, policy_version 1850977 (0.0011) [2023-12-26 14:28:16,584][123090] Updated weights for policy 1, policy_version 1850987 (0.0008) [2023-12-26 14:28:16,642][123090] Updated weights for policy 1, policy_version 1850997 (0.0009) [2023-12-26 14:28:16,699][123090] Updated weights for policy 1, policy_version 1851007 (0.0009) [2023-12-26 14:28:16,783][123091] Updated weights for policy 0, policy_version 1862771 (0.0006) [2023-12-26 14:28:16,828][123091] Updated weights for policy 0, policy_version 1862781 (0.0005) [2023-12-26 14:28:16,874][123091] Updated weights for policy 0, policy_version 1862791 (0.0005) [2023-12-26 14:28:17,575][123090] Updated weights for policy 1, policy_version 1851017 (0.0010) [2023-12-26 14:28:17,636][123090] Updated weights for policy 1, policy_version 1851027 (0.0009) [2023-12-26 14:28:17,688][123091] Updated weights for policy 0, policy_version 1862801 (0.0005) [2023-12-26 14:28:17,697][123090] Updated weights for policy 1, policy_version 1851037 (0.0009) [2023-12-26 14:28:17,746][123091] Updated weights for policy 0, policy_version 1862811 (0.0005) [2023-12-26 14:28:17,812][123091] Updated weights for policy 0, policy_version 1862821 (0.0005) [2023-12-26 14:28:17,869][123091] Updated weights for policy 0, policy_version 1862831 (0.0005) [2023-12-26 14:28:18,459][123090] Updated weights for policy 1, policy_version 1851047 (0.0010) [2023-12-26 14:28:18,513][123090] Updated weights for policy 1, policy_version 1851057 (0.0010) [2023-12-26 14:28:18,571][123090] Updated weights for policy 1, policy_version 1851067 (0.0010) [2023-12-26 14:28:18,603][123091] Updated weights for policy 0, policy_version 1862841 (0.0005) [2023-12-26 14:28:18,664][123091] Updated weights for policy 0, policy_version 1862851 (0.0005) [2023-12-26 14:28:18,737][123091] Updated weights for policy 0, policy_version 1862861 (0.0006) [2023-12-26 14:28:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 950771712. Throughput: 0: 9331.1, 1: 8668.5. Samples: 950777076. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:18,785][121949] Avg episode reward: [(0, '6306.482'), (1, '5962.254')] [2023-12-26 14:28:19,462][123090] Updated weights for policy 1, policy_version 1851077 (0.0009) [2023-12-26 14:28:19,536][123090] Updated weights for policy 1, policy_version 1851087 (0.0010) [2023-12-26 14:28:19,557][123091] Updated weights for policy 0, policy_version 1862871 (0.0009) [2023-12-26 14:28:19,597][123090] Updated weights for policy 1, policy_version 1851097 (0.0010) [2023-12-26 14:28:19,623][123091] Updated weights for policy 0, policy_version 1862881 (0.0007) [2023-12-26 14:28:19,687][123091] Updated weights for policy 0, policy_version 1862891 (0.0009) [2023-12-26 14:28:20,428][123090] Updated weights for policy 1, policy_version 1851107 (0.0010) [2023-12-26 14:28:20,497][123090] Updated weights for policy 1, policy_version 1851117 (0.0011) [2023-12-26 14:28:20,532][123091] Updated weights for policy 0, policy_version 1862901 (0.0009) [2023-12-26 14:28:20,570][123090] Updated weights for policy 1, policy_version 1851127 (0.0007) [2023-12-26 14:28:20,605][123091] Updated weights for policy 0, policy_version 1862911 (0.0009) [2023-12-26 14:28:20,668][123091] Updated weights for policy 0, policy_version 1862921 (0.0010) [2023-12-26 14:28:21,351][123090] Updated weights for policy 1, policy_version 1851137 (0.0009) [2023-12-26 14:28:21,425][123090] Updated weights for policy 1, policy_version 1851147 (0.0011) [2023-12-26 14:28:21,477][123090] Updated weights for policy 1, policy_version 1851157 (0.0009) [2023-12-26 14:28:21,494][123091] Updated weights for policy 0, policy_version 1862931 (0.0009) [2023-12-26 14:28:21,539][123090] Updated weights for policy 1, policy_version 1851167 (0.0010) [2023-12-26 14:28:21,555][123091] Updated weights for policy 0, policy_version 1862941 (0.0006) [2023-12-26 14:28:21,617][123091] Updated weights for policy 0, policy_version 1862951 (0.0009) [2023-12-26 14:28:22,305][123090] Updated weights for policy 1, policy_version 1851177 (0.0009) [2023-12-26 14:28:22,384][123090] Updated weights for policy 1, policy_version 1851188 (0.0013) [2023-12-26 14:28:22,451][123090] Updated weights for policy 1, policy_version 1851198 (0.0008) [2023-12-26 14:28:22,525][123091] Updated weights for policy 0, policy_version 1862961 (0.0010) [2023-12-26 14:28:22,586][123091] Updated weights for policy 0, policy_version 1862971 (0.0009) [2023-12-26 14:28:22,635][123091] Updated weights for policy 0, policy_version 1862981 (0.0009) [2023-12-26 14:28:22,692][123091] Updated weights for policy 0, policy_version 1862991 (0.0009) [2023-12-26 14:28:23,259][123090] Updated weights for policy 1, policy_version 1851208 (0.0010) [2023-12-26 14:28:23,330][123090] Updated weights for policy 1, policy_version 1851218 (0.0011) [2023-12-26 14:28:23,400][123090] Updated weights for policy 1, policy_version 1851228 (0.0011) [2023-12-26 14:28:23,553][123091] Updated weights for policy 0, policy_version 1863001 (0.0009) [2023-12-26 14:28:23,614][123091] Updated weights for policy 0, policy_version 1863011 (0.0009) [2023-12-26 14:28:23,673][123091] Updated weights for policy 0, policy_version 1863021 (0.0009) [2023-12-26 14:28:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 950853632. Throughput: 0: 9264.5, 1: 8661.8. Samples: 950827284. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:23,784][121949] Avg episode reward: [(0, '6318.245'), (1, '5899.964')] [2023-12-26 14:28:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001863024_476938240.pth... [2023-12-26 14:28:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001851232_473915392.pth... [2023-12-26 14:28:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001861936_476659712.pth [2023-12-26 14:28:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001850208_473653248.pth [2023-12-26 14:28:24,201][123090] Updated weights for policy 1, policy_version 1851238 (0.0010) [2023-12-26 14:28:24,270][123090] Updated weights for policy 1, policy_version 1851248 (0.0010) [2023-12-26 14:28:24,333][123090] Updated weights for policy 1, policy_version 1851258 (0.0010) [2023-12-26 14:28:24,498][123091] Updated weights for policy 0, policy_version 1863031 (0.0009) [2023-12-26 14:28:24,554][123091] Updated weights for policy 0, policy_version 1863041 (0.0008) [2023-12-26 14:28:24,622][123091] Updated weights for policy 0, policy_version 1863051 (0.0009) [2023-12-26 14:28:25,152][123090] Updated weights for policy 1, policy_version 1851268 (0.0010) [2023-12-26 14:28:25,199][123090] Updated weights for policy 1, policy_version 1851278 (0.0010) [2023-12-26 14:28:25,246][123090] Updated weights for policy 1, policy_version 1851288 (0.0010) [2023-12-26 14:28:25,450][123091] Updated weights for policy 0, policy_version 1863061 (0.0009) [2023-12-26 14:28:25,497][123091] Updated weights for policy 0, policy_version 1863071 (0.0008) [2023-12-26 14:28:25,552][123091] Updated weights for policy 0, policy_version 1863081 (0.0009) [2023-12-26 14:28:26,087][123090] Updated weights for policy 1, policy_version 1851298 (0.0010) [2023-12-26 14:28:26,130][123090] Updated weights for policy 1, policy_version 1851308 (0.0010) [2023-12-26 14:28:26,181][123090] Updated weights for policy 1, policy_version 1851318 (0.0010) [2023-12-26 14:28:26,243][123090] Updated weights for policy 1, policy_version 1851328 (0.0010) [2023-12-26 14:28:26,398][123091] Updated weights for policy 0, policy_version 1863091 (0.0009) [2023-12-26 14:28:26,446][123091] Updated weights for policy 0, policy_version 1863101 (0.0009) [2023-12-26 14:28:26,498][123091] Updated weights for policy 0, policy_version 1863111 (0.0009) [2023-12-26 14:28:27,059][123090] Updated weights for policy 1, policy_version 1851338 (0.0005) [2023-12-26 14:28:27,111][123090] Updated weights for policy 1, policy_version 1851348 (0.0005) [2023-12-26 14:28:27,165][123090] Updated weights for policy 1, policy_version 1851358 (0.0005) [2023-12-26 14:28:27,308][123091] Updated weights for policy 0, policy_version 1863121 (0.0008) [2023-12-26 14:28:27,384][123091] Updated weights for policy 0, policy_version 1863131 (0.0007) [2023-12-26 14:28:27,457][123091] Updated weights for policy 0, policy_version 1863141 (0.0007) [2023-12-26 14:28:27,516][123091] Updated weights for policy 0, policy_version 1863151 (0.0010) [2023-12-26 14:28:27,868][123090] Updated weights for policy 1, policy_version 1851368 (0.0005) [2023-12-26 14:28:27,932][123090] Updated weights for policy 1, policy_version 1851378 (0.0005) [2023-12-26 14:28:27,996][123090] Updated weights for policy 1, policy_version 1851388 (0.0008) [2023-12-26 14:28:28,153][123091] Updated weights for policy 0, policy_version 1863161 (0.0006) [2023-12-26 14:28:28,216][123091] Updated weights for policy 0, policy_version 1863171 (0.0006) [2023-12-26 14:28:28,285][123091] Updated weights for policy 0, policy_version 1863181 (0.0005) [2023-12-26 14:28:28,709][123090] Updated weights for policy 1, policy_version 1851398 (0.0010) [2023-12-26 14:28:28,761][123090] Updated weights for policy 1, policy_version 1851408 (0.0010) [2023-12-26 14:28:28,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 950935552. Throughput: 0: 9226.2, 1: 8724.4. Samples: 950931344. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:28,784][121949] Avg episode reward: [(0, '6368.241'), (1, '5932.330')] [2023-12-26 14:28:28,832][123090] Updated weights for policy 1, policy_version 1851418 (0.0010) [2023-12-26 14:28:29,004][123091] Updated weights for policy 0, policy_version 1863191 (0.0008) [2023-12-26 14:28:29,051][123091] Updated weights for policy 0, policy_version 1863201 (0.0008) [2023-12-26 14:28:29,100][123091] Updated weights for policy 0, policy_version 1863211 (0.0009) [2023-12-26 14:28:29,651][123090] Updated weights for policy 1, policy_version 1851428 (0.0010) [2023-12-26 14:28:29,723][123090] Updated weights for policy 1, policy_version 1851438 (0.0010) [2023-12-26 14:28:29,778][123090] Updated weights for policy 1, policy_version 1851448 (0.0010) [2023-12-26 14:28:29,964][123091] Updated weights for policy 0, policy_version 1863221 (0.0009) [2023-12-26 14:28:30,027][123091] Updated weights for policy 0, policy_version 1863231 (0.0009) [2023-12-26 14:28:30,090][123091] Updated weights for policy 0, policy_version 1863241 (0.0008) [2023-12-26 14:28:30,595][123090] Updated weights for policy 1, policy_version 1851458 (0.0010) [2023-12-26 14:28:30,653][123090] Updated weights for policy 1, policy_version 1851468 (0.0010) [2023-12-26 14:28:30,719][123090] Updated weights for policy 1, policy_version 1851478 (0.0010) [2023-12-26 14:28:30,784][123090] Updated weights for policy 1, policy_version 1851488 (0.0010) [2023-12-26 14:28:30,817][123091] Updated weights for policy 0, policy_version 1863251 (0.0006) [2023-12-26 14:28:30,880][123091] Updated weights for policy 0, policy_version 1863261 (0.0009) [2023-12-26 14:28:30,927][123091] Updated weights for policy 0, policy_version 1863271 (0.0008) [2023-12-26 14:28:31,573][123090] Updated weights for policy 1, policy_version 1851498 (0.0005) [2023-12-26 14:28:31,640][123090] Updated weights for policy 1, policy_version 1851508 (0.0007) [2023-12-26 14:28:31,700][123090] Updated weights for policy 1, policy_version 1851518 (0.0010) [2023-12-26 14:28:31,777][123091] Updated weights for policy 0, policy_version 1863281 (0.0009) [2023-12-26 14:28:31,838][123091] Updated weights for policy 0, policy_version 1863291 (0.0009) [2023-12-26 14:28:31,901][123091] Updated weights for policy 0, policy_version 1863301 (0.0009) [2023-12-26 14:28:31,964][123091] Updated weights for policy 0, policy_version 1863311 (0.0009) [2023-12-26 14:28:32,507][123090] Updated weights for policy 1, policy_version 1851528 (0.0010) [2023-12-26 14:28:32,554][123090] Updated weights for policy 1, policy_version 1851538 (0.0010) [2023-12-26 14:28:32,598][123090] Updated weights for policy 1, policy_version 1851548 (0.0010) [2023-12-26 14:28:32,771][123091] Updated weights for policy 0, policy_version 1863321 (0.0009) [2023-12-26 14:28:32,833][123091] Updated weights for policy 0, policy_version 1863331 (0.0009) [2023-12-26 14:28:32,885][123091] Updated weights for policy 0, policy_version 1863341 (0.0009) [2023-12-26 14:28:33,346][123090] Updated weights for policy 1, policy_version 1851558 (0.0008) [2023-12-26 14:28:33,411][123090] Updated weights for policy 1, policy_version 1851568 (0.0005) [2023-12-26 14:28:33,476][123090] Updated weights for policy 1, policy_version 1851578 (0.0009) [2023-12-26 14:28:33,749][123091] Updated weights for policy 0, policy_version 1863351 (0.0009) [2023-12-26 14:28:33,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 951025664. Throughput: 0: 9122.6, 1: 8759.0. Samples: 951038196. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:33,785][121949] Avg episode reward: [(0, '6337.511'), (1, '5939.848')] [2023-12-26 14:28:33,805][123091] Updated weights for policy 0, policy_version 1863361 (0.0008) [2023-12-26 14:28:33,857][123091] Updated weights for policy 0, policy_version 1863371 (0.0008) [2023-12-26 14:28:34,269][123090] Updated weights for policy 1, policy_version 1851588 (0.0008) [2023-12-26 14:28:34,338][123090] Updated weights for policy 1, policy_version 1851598 (0.0005) [2023-12-26 14:28:34,403][123090] Updated weights for policy 1, policy_version 1851608 (0.0005) [2023-12-26 14:28:34,769][123091] Updated weights for policy 0, policy_version 1863381 (0.0009) [2023-12-26 14:28:34,838][123091] Updated weights for policy 0, policy_version 1863391 (0.0010) [2023-12-26 14:28:34,891][123091] Updated weights for policy 0, policy_version 1863401 (0.0009) [2023-12-26 14:28:35,083][123090] Updated weights for policy 1, policy_version 1851618 (0.0005) [2023-12-26 14:28:35,148][123090] Updated weights for policy 1, policy_version 1851628 (0.0005) [2023-12-26 14:28:35,216][123090] Updated weights for policy 1, policy_version 1851638 (0.0006) [2023-12-26 14:28:35,267][123090] Updated weights for policy 1, policy_version 1851648 (0.0010) [2023-12-26 14:28:35,804][123091] Updated weights for policy 0, policy_version 1863411 (0.0009) [2023-12-26 14:28:35,863][123091] Updated weights for policy 0, policy_version 1863421 (0.0009) [2023-12-26 14:28:35,916][123091] Updated weights for policy 0, policy_version 1863431 (0.0005) [2023-12-26 14:28:35,973][123090] Updated weights for policy 1, policy_version 1851658 (0.0006) [2023-12-26 14:28:36,034][123090] Updated weights for policy 1, policy_version 1851668 (0.0005) [2023-12-26 14:28:36,099][123090] Updated weights for policy 1, policy_version 1851678 (0.0006) [2023-12-26 14:28:36,695][123091] Updated weights for policy 0, policy_version 1863441 (0.0006) [2023-12-26 14:28:36,760][123091] Updated weights for policy 0, policy_version 1863451 (0.0010) [2023-12-26 14:28:36,816][123091] Updated weights for policy 0, policy_version 1863461 (0.0009) [2023-12-26 14:28:36,880][123091] Updated weights for policy 0, policy_version 1863471 (0.0005) [2023-12-26 14:28:36,903][123090] Updated weights for policy 1, policy_version 1851688 (0.0008) [2023-12-26 14:28:36,970][123090] Updated weights for policy 1, policy_version 1851698 (0.0010) [2023-12-26 14:28:37,025][123090] Updated weights for policy 1, policy_version 1851708 (0.0010) [2023-12-26 14:28:37,674][123091] Updated weights for policy 0, policy_version 1863481 (0.0009) [2023-12-26 14:28:37,734][123091] Updated weights for policy 0, policy_version 1863491 (0.0009) [2023-12-26 14:28:37,798][123091] Updated weights for policy 0, policy_version 1863501 (0.0008) [2023-12-26 14:28:37,829][123090] Updated weights for policy 1, policy_version 1851718 (0.0008) [2023-12-26 14:28:37,895][123090] Updated weights for policy 1, policy_version 1851728 (0.0006) [2023-12-26 14:28:37,969][123090] Updated weights for policy 1, policy_version 1851738 (0.0007) [2023-12-26 14:28:38,605][123090] Updated weights for policy 1, policy_version 1851748 (0.0006) [2023-12-26 14:28:38,673][123090] Updated weights for policy 1, policy_version 1851758 (0.0006) [2023-12-26 14:28:38,677][123091] Updated weights for policy 0, policy_version 1863511 (0.0008) [2023-12-26 14:28:38,735][123091] Updated weights for policy 0, policy_version 1863521 (0.0008) [2023-12-26 14:28:38,737][123090] Updated weights for policy 1, policy_version 1851768 (0.0008) [2023-12-26 14:28:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 951107584. Throughput: 0: 9047.3, 1: 8846.6. Samples: 951092116. Policy #0 lag: (min: 8.0, avg: 35.6, max: 40.0) [2023-12-26 14:28:38,785][121949] Avg episode reward: [(0, '6237.693'), (1, '5833.620')] [2023-12-26 14:28:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001851776_474054656.pth... [2023-12-26 14:28:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001850720_473784320.pth [2023-12-26 14:28:38,800][123091] Updated weights for policy 0, policy_version 1863531 (0.0008) [2023-12-26 14:28:38,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001863536_477069312.pth... [2023-12-26 14:28:38,836][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001862480_476798976.pth [2023-12-26 14:28:39,494][123090] Updated weights for policy 1, policy_version 1851778 (0.0009) [2023-12-26 14:28:39,565][123090] Updated weights for policy 1, policy_version 1851788 (0.0005) [2023-12-26 14:28:39,637][123090] Updated weights for policy 1, policy_version 1851798 (0.0007) [2023-12-26 14:28:39,638][123091] Updated weights for policy 0, policy_version 1863541 (0.0009) [2023-12-26 14:28:39,700][123090] Updated weights for policy 1, policy_version 1851808 (0.0008) [2023-12-26 14:28:39,704][123091] Updated weights for policy 0, policy_version 1863551 (0.0008) [2023-12-26 14:28:39,770][123091] Updated weights for policy 0, policy_version 1863561 (0.0008) [2023-12-26 14:28:40,530][123090] Updated weights for policy 1, policy_version 1851818 (0.0009) [2023-12-26 14:28:40,561][123091] Updated weights for policy 0, policy_version 1863571 (0.0008) [2023-12-26 14:28:40,590][123090] Updated weights for policy 1, policy_version 1851828 (0.0006) [2023-12-26 14:28:40,611][123091] Updated weights for policy 0, policy_version 1863581 (0.0009) [2023-12-26 14:28:40,651][123090] Updated weights for policy 1, policy_version 1851838 (0.0008) [2023-12-26 14:28:40,666][123091] Updated weights for policy 0, policy_version 1863591 (0.0008) [2023-12-26 14:28:41,456][123090] Updated weights for policy 1, policy_version 1851848 (0.0009) [2023-12-26 14:28:41,480][123091] Updated weights for policy 0, policy_version 1863601 (0.0010) [2023-12-26 14:28:41,526][123090] Updated weights for policy 1, policy_version 1851858 (0.0007) [2023-12-26 14:28:41,543][123091] Updated weights for policy 0, policy_version 1863611 (0.0007) [2023-12-26 14:28:41,598][123090] Updated weights for policy 1, policy_version 1851868 (0.0006) [2023-12-26 14:28:41,613][123091] Updated weights for policy 0, policy_version 1863621 (0.0008) [2023-12-26 14:28:41,682][123091] Updated weights for policy 0, policy_version 1863631 (0.0010) [2023-12-26 14:28:42,282][123090] Updated weights for policy 1, policy_version 1851878 (0.0008) [2023-12-26 14:28:42,348][123090] Updated weights for policy 1, policy_version 1851888 (0.0008) [2023-12-26 14:28:42,431][123090] Updated weights for policy 1, policy_version 1851898 (0.0008) [2023-12-26 14:28:42,510][123091] Updated weights for policy 0, policy_version 1863641 (0.0009) [2023-12-26 14:28:42,574][123091] Updated weights for policy 0, policy_version 1863651 (0.0009) [2023-12-26 14:28:42,636][123091] Updated weights for policy 0, policy_version 1863661 (0.0009) [2023-12-26 14:28:43,161][123090] Updated weights for policy 1, policy_version 1851908 (0.0008) [2023-12-26 14:28:43,227][123090] Updated weights for policy 1, policy_version 1851918 (0.0008) [2023-12-26 14:28:43,294][123090] Updated weights for policy 1, policy_version 1851928 (0.0008) [2023-12-26 14:28:43,425][123091] Updated weights for policy 0, policy_version 1863671 (0.0008) [2023-12-26 14:28:43,482][123091] Updated weights for policy 0, policy_version 1863681 (0.0007) [2023-12-26 14:28:43,544][123091] Updated weights for policy 0, policy_version 1863691 (0.0008) [2023-12-26 14:28:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 951205888. Throughput: 0: 9003.6, 1: 8806.1. Samples: 951196752. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:28:43,785][121949] Avg episode reward: [(0, '6218.024'), (1, '5933.676')] [2023-12-26 14:28:44,000][123090] Updated weights for policy 1, policy_version 1851938 (0.0006) [2023-12-26 14:28:44,058][123090] Updated weights for policy 1, policy_version 1851948 (0.0005) [2023-12-26 14:28:44,120][123090] Updated weights for policy 1, policy_version 1851958 (0.0005) [2023-12-26 14:28:44,182][123090] Updated weights for policy 1, policy_version 1851968 (0.0007) [2023-12-26 14:28:44,290][123091] Updated weights for policy 0, policy_version 1863701 (0.0005) [2023-12-26 14:28:44,343][123091] Updated weights for policy 0, policy_version 1863711 (0.0006) [2023-12-26 14:28:44,407][123091] Updated weights for policy 0, policy_version 1863721 (0.0008) [2023-12-26 14:28:44,973][123090] Updated weights for policy 1, policy_version 1851978 (0.0009) [2023-12-26 14:28:45,038][123090] Updated weights for policy 1, policy_version 1851988 (0.0009) [2023-12-26 14:28:45,102][123090] Updated weights for policy 1, policy_version 1851998 (0.0008) [2023-12-26 14:28:45,230][123091] Updated weights for policy 0, policy_version 1863731 (0.0009) [2023-12-26 14:28:45,290][123091] Updated weights for policy 0, policy_version 1863741 (0.0011) [2023-12-26 14:28:45,357][123091] Updated weights for policy 0, policy_version 1863751 (0.0011) [2023-12-26 14:28:45,860][123090] Updated weights for policy 1, policy_version 1852008 (0.0006) [2023-12-26 14:28:45,920][123090] Updated weights for policy 1, policy_version 1852018 (0.0005) [2023-12-26 14:28:45,982][123090] Updated weights for policy 1, policy_version 1852028 (0.0005) [2023-12-26 14:28:46,127][123091] Updated weights for policy 0, policy_version 1863761 (0.0010) [2023-12-26 14:28:46,178][123091] Updated weights for policy 0, policy_version 1863771 (0.0008) [2023-12-26 14:28:46,247][123091] Updated weights for policy 0, policy_version 1863781 (0.0009) [2023-12-26 14:28:46,301][123091] Updated weights for policy 0, policy_version 1863791 (0.0009) [2023-12-26 14:28:46,769][123090] Updated weights for policy 1, policy_version 1852038 (0.0005) [2023-12-26 14:28:46,825][123090] Updated weights for policy 1, policy_version 1852048 (0.0006) [2023-12-26 14:28:46,881][123090] Updated weights for policy 1, policy_version 1852058 (0.0010) [2023-12-26 14:28:47,046][123091] Updated weights for policy 0, policy_version 1863801 (0.0009) [2023-12-26 14:28:47,111][123091] Updated weights for policy 0, policy_version 1863811 (0.0009) [2023-12-26 14:28:47,168][123091] Updated weights for policy 0, policy_version 1863821 (0.0009) [2023-12-26 14:28:47,700][123090] Updated weights for policy 1, policy_version 1852068 (0.0009) [2023-12-26 14:28:47,765][123090] Updated weights for policy 1, policy_version 1852078 (0.0011) [2023-12-26 14:28:47,827][123090] Updated weights for policy 1, policy_version 1852088 (0.0010) [2023-12-26 14:28:48,043][123091] Updated weights for policy 0, policy_version 1863831 (0.0010) [2023-12-26 14:28:48,112][123091] Updated weights for policy 0, policy_version 1863841 (0.0010) [2023-12-26 14:28:48,182][123091] Updated weights for policy 0, policy_version 1863851 (0.0011) [2023-12-26 14:28:48,568][123090] Updated weights for policy 1, policy_version 1852098 (0.0010) [2023-12-26 14:28:48,636][123090] Updated weights for policy 1, policy_version 1852108 (0.0006) [2023-12-26 14:28:48,696][123090] Updated weights for policy 1, policy_version 1852118 (0.0006) [2023-12-26 14:28:48,769][123090] Updated weights for policy 1, policy_version 1852128 (0.0009) [2023-12-26 14:28:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 951296000. Throughput: 0: 8935.0, 1: 8922.1. Samples: 951306444. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:28:48,785][121949] Avg episode reward: [(0, '6247.785'), (1, '5982.479')] [2023-12-26 14:28:48,904][123091] Updated weights for policy 0, policy_version 1863861 (0.0008) [2023-12-26 14:28:48,973][123091] Updated weights for policy 0, policy_version 1863871 (0.0006) [2023-12-26 14:28:49,041][123091] Updated weights for policy 0, policy_version 1863881 (0.0006) [2023-12-26 14:28:49,513][123090] Updated weights for policy 1, policy_version 1852138 (0.0009) [2023-12-26 14:28:49,576][123090] Updated weights for policy 1, policy_version 1852148 (0.0009) [2023-12-26 14:28:49,637][123090] Updated weights for policy 1, policy_version 1852158 (0.0010) [2023-12-26 14:28:49,728][123091] Updated weights for policy 0, policy_version 1863891 (0.0006) [2023-12-26 14:28:49,793][123091] Updated weights for policy 0, policy_version 1863901 (0.0008) [2023-12-26 14:28:49,865][123091] Updated weights for policy 0, policy_version 1863911 (0.0009) [2023-12-26 14:28:50,464][123090] Updated weights for policy 1, policy_version 1852168 (0.0010) [2023-12-26 14:28:50,512][123090] Updated weights for policy 1, policy_version 1852178 (0.0010) [2023-12-26 14:28:50,575][123090] Updated weights for policy 1, policy_version 1852188 (0.0010) [2023-12-26 14:28:50,627][123091] Updated weights for policy 0, policy_version 1863921 (0.0009) [2023-12-26 14:28:50,693][123091] Updated weights for policy 0, policy_version 1863931 (0.0006) [2023-12-26 14:28:50,761][123091] Updated weights for policy 0, policy_version 1863941 (0.0010) [2023-12-26 14:28:50,832][123091] Updated weights for policy 0, policy_version 1863951 (0.0011) [2023-12-26 14:28:51,413][123090] Updated weights for policy 1, policy_version 1852198 (0.0011) [2023-12-26 14:28:51,473][123090] Updated weights for policy 1, policy_version 1852208 (0.0010) [2023-12-26 14:28:51,529][123090] Updated weights for policy 1, policy_version 1852218 (0.0007) [2023-12-26 14:28:51,593][123091] Updated weights for policy 0, policy_version 1863961 (0.0011) [2023-12-26 14:28:51,658][123091] Updated weights for policy 0, policy_version 1863971 (0.0011) [2023-12-26 14:28:51,722][123091] Updated weights for policy 0, policy_version 1863981 (0.0011) [2023-12-26 14:28:52,378][123090] Updated weights for policy 1, policy_version 1852228 (0.0011) [2023-12-26 14:28:52,442][123090] Updated weights for policy 1, policy_version 1852238 (0.0011) [2023-12-26 14:28:52,507][123090] Updated weights for policy 1, policy_version 1852248 (0.0011) [2023-12-26 14:28:52,564][123091] Updated weights for policy 0, policy_version 1863991 (0.0011) [2023-12-26 14:28:52,628][123091] Updated weights for policy 0, policy_version 1864001 (0.0011) [2023-12-26 14:28:52,684][123091] Updated weights for policy 0, policy_version 1864011 (0.0011) [2023-12-26 14:28:53,330][123090] Updated weights for policy 1, policy_version 1852258 (0.0011) [2023-12-26 14:28:53,390][123090] Updated weights for policy 1, policy_version 1852268 (0.0009) [2023-12-26 14:28:53,458][123090] Updated weights for policy 1, policy_version 1852278 (0.0007) [2023-12-26 14:28:53,511][123091] Updated weights for policy 0, policy_version 1864021 (0.0011) [2023-12-26 14:28:53,526][123090] Updated weights for policy 1, policy_version 1852288 (0.0009) [2023-12-26 14:28:53,563][123091] Updated weights for policy 0, policy_version 1864031 (0.0011) [2023-12-26 14:28:53,610][123091] Updated weights for policy 0, policy_version 1864041 (0.0010) [2023-12-26 14:28:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 951386112. Throughput: 0: 8908.4, 1: 8888.8. Samples: 951360004. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:28:53,785][121949] Avg episode reward: [(0, '6334.607'), (1, '5760.929')] [2023-12-26 14:28:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001852288_474185728.pth... [2023-12-26 14:28:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001864048_477200384.pth... [2023-12-26 14:28:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001851232_473915392.pth [2023-12-26 14:28:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001863024_476938240.pth [2023-12-26 14:28:54,282][123090] Updated weights for policy 1, policy_version 1852298 (0.0009) [2023-12-26 14:28:54,343][123090] Updated weights for policy 1, policy_version 1852308 (0.0006) [2023-12-26 14:28:54,409][123090] Updated weights for policy 1, policy_version 1852318 (0.0006) [2023-12-26 14:28:54,448][123091] Updated weights for policy 0, policy_version 1864051 (0.0011) [2023-12-26 14:28:54,511][123091] Updated weights for policy 0, policy_version 1864061 (0.0011) [2023-12-26 14:28:54,577][123091] Updated weights for policy 0, policy_version 1864071 (0.0011) [2023-12-26 14:28:55,138][123090] Updated weights for policy 1, policy_version 1852328 (0.0006) [2023-12-26 14:28:55,202][123090] Updated weights for policy 1, policy_version 1852338 (0.0005) [2023-12-26 14:28:55,268][123090] Updated weights for policy 1, policy_version 1852348 (0.0005) [2023-12-26 14:28:55,404][123091] Updated weights for policy 0, policy_version 1864081 (0.0010) [2023-12-26 14:28:55,470][123091] Updated weights for policy 0, policy_version 1864091 (0.0011) [2023-12-26 14:28:55,517][123091] Updated weights for policy 0, policy_version 1864101 (0.0010) [2023-12-26 14:28:55,577][123091] Updated weights for policy 0, policy_version 1864111 (0.0009) [2023-12-26 14:28:55,879][123090] Updated weights for policy 1, policy_version 1852358 (0.0005) [2023-12-26 14:28:55,934][123090] Updated weights for policy 1, policy_version 1852368 (0.0006) [2023-12-26 14:28:55,995][123090] Updated weights for policy 1, policy_version 1852378 (0.0005) [2023-12-26 14:28:56,395][123091] Updated weights for policy 0, policy_version 1864121 (0.0010) [2023-12-26 14:28:56,443][123091] Updated weights for policy 0, policy_version 1864131 (0.0010) [2023-12-26 14:28:56,498][123091] Updated weights for policy 0, policy_version 1864141 (0.0010) [2023-12-26 14:28:56,710][123090] Updated weights for policy 1, policy_version 1852388 (0.0007) [2023-12-26 14:28:56,769][123090] Updated weights for policy 1, policy_version 1852398 (0.0005) [2023-12-26 14:28:56,829][123090] Updated weights for policy 1, policy_version 1852408 (0.0005) [2023-12-26 14:28:57,345][123091] Updated weights for policy 0, policy_version 1864151 (0.0007) [2023-12-26 14:28:57,400][123091] Updated weights for policy 0, policy_version 1864161 (0.0005) [2023-12-26 14:28:57,423][123090] Updated weights for policy 1, policy_version 1852418 (0.0005) [2023-12-26 14:28:57,444][123091] Updated weights for policy 0, policy_version 1864171 (0.0010) [2023-12-26 14:28:57,477][123090] Updated weights for policy 1, policy_version 1852428 (0.0005) [2023-12-26 14:28:57,537][123090] Updated weights for policy 1, policy_version 1852438 (0.0005) [2023-12-26 14:28:57,602][123090] Updated weights for policy 1, policy_version 1852448 (0.0008) [2023-12-26 14:28:58,294][123091] Updated weights for policy 0, policy_version 1864181 (0.0010) [2023-12-26 14:28:58,365][123091] Updated weights for policy 0, policy_version 1864191 (0.0011) [2023-12-26 14:28:58,406][123090] Updated weights for policy 1, policy_version 1852458 (0.0009) [2023-12-26 14:28:58,432][123091] Updated weights for policy 0, policy_version 1864201 (0.0009) [2023-12-26 14:28:58,470][123090] Updated weights for policy 1, policy_version 1852468 (0.0009) [2023-12-26 14:28:58,541][123090] Updated weights for policy 1, policy_version 1852478 (0.0007) [2023-12-26 14:28:58,785][121949] Fps is (10 sec: 18020.7, 60 sec: 17885.6, 300 sec: 17828.0). Total num frames: 951476224. Throughput: 0: 8829.8, 1: 8996.5. Samples: 951468488. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:28:58,786][121949] Avg episode reward: [(0, '6293.729'), (1, '5841.560')] [2023-12-26 14:28:59,266][123090] Updated weights for policy 1, policy_version 1852488 (0.0008) [2023-12-26 14:28:59,279][123091] Updated weights for policy 0, policy_version 1864211 (0.0009) [2023-12-26 14:28:59,335][123090] Updated weights for policy 1, policy_version 1852498 (0.0009) [2023-12-26 14:28:59,345][123091] Updated weights for policy 0, policy_version 1864221 (0.0007) [2023-12-26 14:28:59,404][123090] Updated weights for policy 1, policy_version 1852508 (0.0009) [2023-12-26 14:28:59,419][123091] Updated weights for policy 0, policy_version 1864231 (0.0006) [2023-12-26 14:29:00,128][123090] Updated weights for policy 1, policy_version 1852518 (0.0009) [2023-12-26 14:29:00,130][123091] Updated weights for policy 0, policy_version 1864241 (0.0005) [2023-12-26 14:29:00,189][123091] Updated weights for policy 0, policy_version 1864251 (0.0008) [2023-12-26 14:29:00,195][123090] Updated weights for policy 1, policy_version 1852528 (0.0009) [2023-12-26 14:29:00,253][123091] Updated weights for policy 0, policy_version 1864261 (0.0006) [2023-12-26 14:29:00,259][123090] Updated weights for policy 1, policy_version 1852538 (0.0010) [2023-12-26 14:29:00,314][123091] Updated weights for policy 0, policy_version 1864271 (0.0007) [2023-12-26 14:29:00,949][123090] Updated weights for policy 1, policy_version 1852548 (0.0008) [2023-12-26 14:29:01,009][123090] Updated weights for policy 1, policy_version 1852558 (0.0006) [2023-12-26 14:29:01,070][123090] Updated weights for policy 1, policy_version 1852568 (0.0009) [2023-12-26 14:29:01,185][123091] Updated weights for policy 0, policy_version 1864281 (0.0008) [2023-12-26 14:29:01,240][123091] Updated weights for policy 0, policy_version 1864291 (0.0008) [2023-12-26 14:29:01,299][123091] Updated weights for policy 0, policy_version 1864301 (0.0008) [2023-12-26 14:29:01,918][123090] Updated weights for policy 1, policy_version 1852578 (0.0009) [2023-12-26 14:29:01,975][123090] Updated weights for policy 1, policy_version 1852588 (0.0009) [2023-12-26 14:29:02,028][123091] Updated weights for policy 0, policy_version 1864311 (0.0007) [2023-12-26 14:29:02,031][123090] Updated weights for policy 1, policy_version 1852598 (0.0008) [2023-12-26 14:29:02,093][123091] Updated weights for policy 0, policy_version 1864321 (0.0006) [2023-12-26 14:29:02,101][123090] Updated weights for policy 1, policy_version 1852608 (0.0007) [2023-12-26 14:29:02,151][123091] Updated weights for policy 0, policy_version 1864331 (0.0005) [2023-12-26 14:29:02,894][123090] Updated weights for policy 1, policy_version 1852618 (0.0010) [2023-12-26 14:29:02,922][123091] Updated weights for policy 0, policy_version 1864341 (0.0008) [2023-12-26 14:29:02,946][123090] Updated weights for policy 1, policy_version 1852628 (0.0010) [2023-12-26 14:29:02,971][123091] Updated weights for policy 0, policy_version 1864351 (0.0006) [2023-12-26 14:29:03,009][123090] Updated weights for policy 1, policy_version 1852638 (0.0010) [2023-12-26 14:29:03,024][123091] Updated weights for policy 0, policy_version 1864361 (0.0008) [2023-12-26 14:29:03,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 951558144. Throughput: 0: 8695.9, 1: 9042.0. Samples: 951575280. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:03,785][121949] Avg episode reward: [(0, '6285.636'), (1, '6023.002')] [2023-12-26 14:29:03,792][123091] Updated weights for policy 0, policy_version 1864371 (0.0006) [2023-12-26 14:29:03,816][123090] Updated weights for policy 1, policy_version 1852648 (0.0006) [2023-12-26 14:29:03,864][123091] Updated weights for policy 0, policy_version 1864381 (0.0007) [2023-12-26 14:29:03,880][123090] Updated weights for policy 1, policy_version 1852658 (0.0008) [2023-12-26 14:29:03,919][123091] Updated weights for policy 0, policy_version 1864391 (0.0010) [2023-12-26 14:29:03,940][123090] Updated weights for policy 1, policy_version 1852668 (0.0008) [2023-12-26 14:29:04,693][123090] Updated weights for policy 1, policy_version 1852678 (0.0009) [2023-12-26 14:29:04,755][123090] Updated weights for policy 1, policy_version 1852688 (0.0010) [2023-12-26 14:29:04,767][123091] Updated weights for policy 0, policy_version 1864401 (0.0008) [2023-12-26 14:29:04,810][123090] Updated weights for policy 1, policy_version 1852698 (0.0010) [2023-12-26 14:29:04,828][123091] Updated weights for policy 0, policy_version 1864411 (0.0010) [2023-12-26 14:29:04,884][123091] Updated weights for policy 0, policy_version 1864421 (0.0009) [2023-12-26 14:29:04,943][123091] Updated weights for policy 0, policy_version 1864431 (0.0009) [2023-12-26 14:29:05,576][123090] Updated weights for policy 1, policy_version 1852708 (0.0010) [2023-12-26 14:29:05,619][123090] Updated weights for policy 1, policy_version 1852718 (0.0010) [2023-12-26 14:29:05,677][123090] Updated weights for policy 1, policy_version 1852728 (0.0010) [2023-12-26 14:29:05,740][123091] Updated weights for policy 0, policy_version 1864441 (0.0010) [2023-12-26 14:29:05,783][123091] Updated weights for policy 0, policy_version 1864451 (0.0010) [2023-12-26 14:29:05,834][123091] Updated weights for policy 0, policy_version 1864461 (0.0010) [2023-12-26 14:29:06,458][123090] Updated weights for policy 1, policy_version 1852738 (0.0010) [2023-12-26 14:29:06,518][123090] Updated weights for policy 1, policy_version 1852748 (0.0011) [2023-12-26 14:29:06,586][123090] Updated weights for policy 1, policy_version 1852758 (0.0011) [2023-12-26 14:29:06,591][123091] Updated weights for policy 0, policy_version 1864471 (0.0007) [2023-12-26 14:29:06,655][123090] Updated weights for policy 1, policy_version 1852768 (0.0011) [2023-12-26 14:29:06,656][123091] Updated weights for policy 0, policy_version 1864481 (0.0006) [2023-12-26 14:29:06,716][123091] Updated weights for policy 0, policy_version 1864491 (0.0005) [2023-12-26 14:29:07,275][123091] Updated weights for policy 0, policy_version 1864501 (0.0007) [2023-12-26 14:29:07,338][123091] Updated weights for policy 0, policy_version 1864511 (0.0008) [2023-12-26 14:29:07,395][123091] Updated weights for policy 0, policy_version 1864521 (0.0009) [2023-12-26 14:29:07,460][123090] Updated weights for policy 1, policy_version 1852778 (0.0010) [2023-12-26 14:29:07,512][123090] Updated weights for policy 1, policy_version 1852788 (0.0010) [2023-12-26 14:29:07,567][123090] Updated weights for policy 1, policy_version 1852798 (0.0011) [2023-12-26 14:29:08,120][123091] Updated weights for policy 0, policy_version 1864531 (0.0009) [2023-12-26 14:29:08,179][123091] Updated weights for policy 0, policy_version 1864541 (0.0006) [2023-12-26 14:29:08,256][123091] Updated weights for policy 0, policy_version 1864551 (0.0005) [2023-12-26 14:29:08,352][123090] Updated weights for policy 1, policy_version 1852808 (0.0007) [2023-12-26 14:29:08,414][123090] Updated weights for policy 1, policy_version 1852818 (0.0007) [2023-12-26 14:29:08,473][123090] Updated weights for policy 1, policy_version 1852828 (0.0010) [2023-12-26 14:29:08,784][121949] Fps is (10 sec: 18024.2, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 951656448. Throughput: 0: 8745.9, 1: 9092.7. Samples: 951630020. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:08,785][121949] Avg episode reward: [(0, '6292.166'), (1, '5888.228')] [2023-12-26 14:29:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001864560_477331456.pth... [2023-12-26 14:29:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001852832_474324992.pth... [2023-12-26 14:29:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001851776_474054656.pth [2023-12-26 14:29:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001863536_477069312.pth [2023-12-26 14:29:08,985][123091] Updated weights for policy 0, policy_version 1864561 (0.0007) [2023-12-26 14:29:09,050][123091] Updated weights for policy 0, policy_version 1864571 (0.0009) [2023-12-26 14:29:09,105][123091] Updated weights for policy 0, policy_version 1864581 (0.0010) [2023-12-26 14:29:09,156][123091] Updated weights for policy 0, policy_version 1864591 (0.0010) [2023-12-26 14:29:09,279][123090] Updated weights for policy 1, policy_version 1852838 (0.0009) [2023-12-26 14:29:09,335][123090] Updated weights for policy 1, policy_version 1852848 (0.0011) [2023-12-26 14:29:09,408][123090] Updated weights for policy 1, policy_version 1852858 (0.0010) [2023-12-26 14:29:09,999][123091] Updated weights for policy 0, policy_version 1864601 (0.0009) [2023-12-26 14:29:10,065][123091] Updated weights for policy 0, policy_version 1864611 (0.0009) [2023-12-26 14:29:10,125][123091] Updated weights for policy 0, policy_version 1864621 (0.0009) [2023-12-26 14:29:10,269][123090] Updated weights for policy 1, policy_version 1852868 (0.0009) [2023-12-26 14:29:10,336][123090] Updated weights for policy 1, policy_version 1852878 (0.0011) [2023-12-26 14:29:10,405][123090] Updated weights for policy 1, policy_version 1852888 (0.0010) [2023-12-26 14:29:10,977][123091] Updated weights for policy 0, policy_version 1864631 (0.0009) [2023-12-26 14:29:11,025][123091] Updated weights for policy 0, policy_version 1864641 (0.0009) [2023-12-26 14:29:11,094][123091] Updated weights for policy 0, policy_version 1864651 (0.0008) [2023-12-26 14:29:11,205][123090] Updated weights for policy 1, policy_version 1852898 (0.0011) [2023-12-26 14:29:11,281][123090] Updated weights for policy 1, policy_version 1852908 (0.0009) [2023-12-26 14:29:11,337][123090] Updated weights for policy 1, policy_version 1852918 (0.0010) [2023-12-26 14:29:11,408][123090] Updated weights for policy 1, policy_version 1852928 (0.0009) [2023-12-26 14:29:11,957][123091] Updated weights for policy 0, policy_version 1864661 (0.0009) [2023-12-26 14:29:12,024][123091] Updated weights for policy 0, policy_version 1864671 (0.0011) [2023-12-26 14:29:12,079][123091] Updated weights for policy 0, policy_version 1864681 (0.0009) [2023-12-26 14:29:12,191][123090] Updated weights for policy 1, policy_version 1852938 (0.0008) [2023-12-26 14:29:12,262][123090] Updated weights for policy 1, policy_version 1852948 (0.0008) [2023-12-26 14:29:12,334][123090] Updated weights for policy 1, policy_version 1852958 (0.0008) [2023-12-26 14:29:12,808][123091] Updated weights for policy 0, policy_version 1864691 (0.0006) [2023-12-26 14:29:12,870][123091] Updated weights for policy 0, policy_version 1864701 (0.0006) [2023-12-26 14:29:12,932][123091] Updated weights for policy 0, policy_version 1864711 (0.0008) [2023-12-26 14:29:13,062][123090] Updated weights for policy 1, policy_version 1852968 (0.0009) [2023-12-26 14:29:13,122][123090] Updated weights for policy 1, policy_version 1852978 (0.0007) [2023-12-26 14:29:13,179][123090] Updated weights for policy 1, policy_version 1852988 (0.0005) [2023-12-26 14:29:13,744][123091] Updated weights for policy 0, policy_version 1864721 (0.0011) [2023-12-26 14:29:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 951738368. Throughput: 0: 8831.7, 1: 9080.3. Samples: 951737384. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:13,784][121949] Avg episode reward: [(0, '6158.466'), (1, '5952.885')] [2023-12-26 14:29:13,805][123091] Updated weights for policy 0, policy_version 1864731 (0.0009) [2023-12-26 14:29:13,860][123091] Updated weights for policy 0, policy_version 1864741 (0.0010) [2023-12-26 14:29:13,890][123090] Updated weights for policy 1, policy_version 1852998 (0.0008) [2023-12-26 14:29:13,920][123091] Updated weights for policy 0, policy_version 1864751 (0.0008) [2023-12-26 14:29:13,941][123090] Updated weights for policy 1, policy_version 1853008 (0.0010) [2023-12-26 14:29:13,993][123090] Updated weights for policy 1, policy_version 1853018 (0.0009) [2023-12-26 14:29:14,749][123090] Updated weights for policy 1, policy_version 1853028 (0.0010) [2023-12-26 14:29:14,778][123091] Updated weights for policy 0, policy_version 1864761 (0.0011) [2023-12-26 14:29:14,816][123090] Updated weights for policy 1, policy_version 1853038 (0.0008) [2023-12-26 14:29:14,839][123091] Updated weights for policy 0, policy_version 1864771 (0.0008) [2023-12-26 14:29:14,882][123090] Updated weights for policy 1, policy_version 1853048 (0.0009) [2023-12-26 14:29:14,905][123091] Updated weights for policy 0, policy_version 1864781 (0.0007) [2023-12-26 14:29:15,621][123091] Updated weights for policy 0, policy_version 1864791 (0.0006) [2023-12-26 14:29:15,631][123090] Updated weights for policy 1, policy_version 1853058 (0.0009) [2023-12-26 14:29:15,680][123090] Updated weights for policy 1, policy_version 1853068 (0.0006) [2023-12-26 14:29:15,682][123091] Updated weights for policy 0, policy_version 1864801 (0.0006) [2023-12-26 14:29:15,729][123090] Updated weights for policy 1, policy_version 1853078 (0.0006) [2023-12-26 14:29:15,740][123091] Updated weights for policy 0, policy_version 1864811 (0.0007) [2023-12-26 14:29:15,805][123090] Updated weights for policy 1, policy_version 1853088 (0.0006) [2023-12-26 14:29:16,472][123090] Updated weights for policy 1, policy_version 1853098 (0.0006) [2023-12-26 14:29:16,513][123091] Updated weights for policy 0, policy_version 1864821 (0.0010) [2023-12-26 14:29:16,537][123090] Updated weights for policy 1, policy_version 1853108 (0.0005) [2023-12-26 14:29:16,570][123091] Updated weights for policy 0, policy_version 1864831 (0.0008) [2023-12-26 14:29:16,593][123090] Updated weights for policy 1, policy_version 1853118 (0.0009) [2023-12-26 14:29:16,623][123091] Updated weights for policy 0, policy_version 1864841 (0.0005) [2023-12-26 14:29:17,325][123090] Updated weights for policy 1, policy_version 1853128 (0.0006) [2023-12-26 14:29:17,381][123090] Updated weights for policy 1, policy_version 1853138 (0.0005) [2023-12-26 14:29:17,421][123091] Updated weights for policy 0, policy_version 1864851 (0.0007) [2023-12-26 14:29:17,438][123090] Updated weights for policy 1, policy_version 1853148 (0.0005) [2023-12-26 14:29:17,485][123091] Updated weights for policy 0, policy_version 1864861 (0.0008) [2023-12-26 14:29:17,555][123091] Updated weights for policy 0, policy_version 1864871 (0.0005) [2023-12-26 14:29:18,167][123090] Updated weights for policy 1, policy_version 1853158 (0.0009) [2023-12-26 14:29:18,226][123090] Updated weights for policy 1, policy_version 1853168 (0.0011) [2023-12-26 14:29:18,289][123090] Updated weights for policy 1, policy_version 1853178 (0.0011) [2023-12-26 14:29:18,318][123091] Updated weights for policy 0, policy_version 1864881 (0.0006) [2023-12-26 14:29:18,386][123091] Updated weights for policy 0, policy_version 1864891 (0.0011) [2023-12-26 14:29:18,454][123091] Updated weights for policy 0, policy_version 1864901 (0.0011) [2023-12-26 14:29:18,523][123091] Updated weights for policy 0, policy_version 1864911 (0.0011) [2023-12-26 14:29:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 951836672. Throughput: 0: 8816.4, 1: 9167.8. Samples: 951847480. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:18,785][121949] Avg episode reward: [(0, '6258.929'), (1, '5954.594')] [2023-12-26 14:29:19,105][123090] Updated weights for policy 1, policy_version 1853188 (0.0009) [2023-12-26 14:29:19,172][123090] Updated weights for policy 1, policy_version 1853198 (0.0006) [2023-12-26 14:29:19,243][123090] Updated weights for policy 1, policy_version 1853208 (0.0007) [2023-12-26 14:29:19,259][123091] Updated weights for policy 0, policy_version 1864921 (0.0009) [2023-12-26 14:29:19,319][123091] Updated weights for policy 0, policy_version 1864931 (0.0009) [2023-12-26 14:29:19,377][123091] Updated weights for policy 0, policy_version 1864941 (0.0009) [2023-12-26 14:29:20,058][123090] Updated weights for policy 1, policy_version 1853218 (0.0008) [2023-12-26 14:29:20,123][123090] Updated weights for policy 1, policy_version 1853228 (0.0008) [2023-12-26 14:29:20,139][123091] Updated weights for policy 0, policy_version 1864951 (0.0007) [2023-12-26 14:29:20,188][123090] Updated weights for policy 1, policy_version 1853238 (0.0006) [2023-12-26 14:29:20,203][123091] Updated weights for policy 0, policy_version 1864961 (0.0008) [2023-12-26 14:29:20,242][123090] Updated weights for policy 1, policy_version 1853248 (0.0007) [2023-12-26 14:29:20,262][123091] Updated weights for policy 0, policy_version 1864971 (0.0009) [2023-12-26 14:29:21,043][123091] Updated weights for policy 0, policy_version 1864981 (0.0009) [2023-12-26 14:29:21,109][123091] Updated weights for policy 0, policy_version 1864991 (0.0008) [2023-12-26 14:29:21,133][123090] Updated weights for policy 1, policy_version 1853258 (0.0009) [2023-12-26 14:29:21,180][123091] Updated weights for policy 0, policy_version 1865001 (0.0010) [2023-12-26 14:29:21,197][123090] Updated weights for policy 1, policy_version 1853268 (0.0008) [2023-12-26 14:29:21,261][123090] Updated weights for policy 1, policy_version 1853278 (0.0007) [2023-12-26 14:29:22,022][123090] Updated weights for policy 1, policy_version 1853288 (0.0007) [2023-12-26 14:29:22,048][123091] Updated weights for policy 0, policy_version 1865011 (0.0008) [2023-12-26 14:29:22,073][123090] Updated weights for policy 1, policy_version 1853298 (0.0006) [2023-12-26 14:29:22,103][123091] Updated weights for policy 0, policy_version 1865021 (0.0008) [2023-12-26 14:29:22,143][123090] Updated weights for policy 1, policy_version 1853308 (0.0005) [2023-12-26 14:29:22,163][123091] Updated weights for policy 0, policy_version 1865031 (0.0008) [2023-12-26 14:29:22,734][123090] Updated weights for policy 1, policy_version 1853318 (0.0006) [2023-12-26 14:29:22,784][123090] Updated weights for policy 1, policy_version 1853328 (0.0010) [2023-12-26 14:29:22,831][123090] Updated weights for policy 1, policy_version 1853338 (0.0006) [2023-12-26 14:29:23,074][123091] Updated weights for policy 0, policy_version 1865041 (0.0010) [2023-12-26 14:29:23,126][123091] Updated weights for policy 0, policy_version 1865051 (0.0009) [2023-12-26 14:29:23,182][123091] Updated weights for policy 0, policy_version 1865061 (0.0009) [2023-12-26 14:29:23,234][123091] Updated weights for policy 0, policy_version 1865071 (0.0009) [2023-12-26 14:29:23,611][123090] Updated weights for policy 1, policy_version 1853348 (0.0007) [2023-12-26 14:29:23,666][123090] Updated weights for policy 1, policy_version 1853358 (0.0010) [2023-12-26 14:29:23,717][123090] Updated weights for policy 1, policy_version 1853368 (0.0010) [2023-12-26 14:29:23,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 951926784. Throughput: 0: 8864.5, 1: 9076.4. Samples: 951899460. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:23,785][121949] Avg episode reward: [(0, '6345.125'), (1, '5904.276')] [2023-12-26 14:29:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001853376_474464256.pth... [2023-12-26 14:29:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001865072_477462528.pth... [2023-12-26 14:29:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001852288_474185728.pth [2023-12-26 14:29:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001864048_477200384.pth [2023-12-26 14:29:24,100][123091] Updated weights for policy 0, policy_version 1865081 (0.0010) [2023-12-26 14:29:24,160][123091] Updated weights for policy 0, policy_version 1865091 (0.0009) [2023-12-26 14:29:24,226][123091] Updated weights for policy 0, policy_version 1865101 (0.0009) [2023-12-26 14:29:24,518][123090] Updated weights for policy 1, policy_version 1853378 (0.0010) [2023-12-26 14:29:24,594][123090] Updated weights for policy 1, policy_version 1853388 (0.0011) [2023-12-26 14:29:24,681][123090] Updated weights for policy 1, policy_version 1853398 (0.0010) [2023-12-26 14:29:24,742][123090] Updated weights for policy 1, policy_version 1853408 (0.0005) [2023-12-26 14:29:25,090][123091] Updated weights for policy 0, policy_version 1865111 (0.0007) [2023-12-26 14:29:25,152][123091] Updated weights for policy 0, policy_version 1865121 (0.0005) [2023-12-26 14:29:25,217][123091] Updated weights for policy 0, policy_version 1865131 (0.0005) [2023-12-26 14:29:25,398][123090] Updated weights for policy 1, policy_version 1853418 (0.0009) [2023-12-26 14:29:25,467][123090] Updated weights for policy 1, policy_version 1853428 (0.0010) [2023-12-26 14:29:25,528][123090] Updated weights for policy 1, policy_version 1853438 (0.0010) [2023-12-26 14:29:25,930][123091] Updated weights for policy 0, policy_version 1865141 (0.0007) [2023-12-26 14:29:25,977][123091] Updated weights for policy 0, policy_version 1865151 (0.0009) [2023-12-26 14:29:26,033][123091] Updated weights for policy 0, policy_version 1865161 (0.0008) [2023-12-26 14:29:26,305][123090] Updated weights for policy 1, policy_version 1853448 (0.0010) [2023-12-26 14:29:26,352][123090] Updated weights for policy 1, policy_version 1853458 (0.0010) [2023-12-26 14:29:26,399][123090] Updated weights for policy 1, policy_version 1853468 (0.0010) [2023-12-26 14:29:26,885][123091] Updated weights for policy 0, policy_version 1865171 (0.0009) [2023-12-26 14:29:26,944][123091] Updated weights for policy 0, policy_version 1865181 (0.0009) [2023-12-26 14:29:26,990][123091] Updated weights for policy 0, policy_version 1865191 (0.0009) [2023-12-26 14:29:27,256][123090] Updated weights for policy 1, policy_version 1853478 (0.0010) [2023-12-26 14:29:27,314][123090] Updated weights for policy 1, policy_version 1853488 (0.0010) [2023-12-26 14:29:27,367][123090] Updated weights for policy 1, policy_version 1853498 (0.0010) [2023-12-26 14:29:27,826][123091] Updated weights for policy 0, policy_version 1865201 (0.0009) [2023-12-26 14:29:27,877][123091] Updated weights for policy 0, policy_version 1865211 (0.0008) [2023-12-26 14:29:27,929][123091] Updated weights for policy 0, policy_version 1865221 (0.0009) [2023-12-26 14:29:27,992][123091] Updated weights for policy 0, policy_version 1865231 (0.0009) [2023-12-26 14:29:28,174][123090] Updated weights for policy 1, policy_version 1853508 (0.0010) [2023-12-26 14:29:28,221][123090] Updated weights for policy 1, policy_version 1853518 (0.0010) [2023-12-26 14:29:28,269][123090] Updated weights for policy 1, policy_version 1853528 (0.0010) [2023-12-26 14:29:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 952008704. Throughput: 0: 8859.9, 1: 9117.7. Samples: 952005744. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:28,784][121949] Avg episode reward: [(0, '6364.714'), (1, '5997.893')] [2023-12-26 14:29:28,819][123091] Updated weights for policy 0, policy_version 1865241 (0.0010) [2023-12-26 14:29:28,882][123091] Updated weights for policy 0, policy_version 1865251 (0.0011) [2023-12-26 14:29:28,929][123091] Updated weights for policy 0, policy_version 1865261 (0.0010) [2023-12-26 14:29:29,108][123090] Updated weights for policy 1, policy_version 1853538 (0.0010) [2023-12-26 14:29:29,169][123090] Updated weights for policy 1, policy_version 1853548 (0.0010) [2023-12-26 14:29:29,236][123090] Updated weights for policy 1, policy_version 1853558 (0.0010) [2023-12-26 14:29:29,291][123090] Updated weights for policy 1, policy_version 1853568 (0.0011) [2023-12-26 14:29:29,716][123091] Updated weights for policy 0, policy_version 1865271 (0.0008) [2023-12-26 14:29:29,780][123091] Updated weights for policy 0, policy_version 1865281 (0.0009) [2023-12-26 14:29:29,847][123091] Updated weights for policy 0, policy_version 1865291 (0.0009) [2023-12-26 14:29:30,095][123090] Updated weights for policy 1, policy_version 1853578 (0.0011) [2023-12-26 14:29:30,150][123090] Updated weights for policy 1, policy_version 1853588 (0.0010) [2023-12-26 14:29:30,210][123090] Updated weights for policy 1, policy_version 1853598 (0.0010) [2023-12-26 14:29:30,626][123091] Updated weights for policy 0, policy_version 1865301 (0.0008) [2023-12-26 14:29:30,688][123091] Updated weights for policy 0, policy_version 1865311 (0.0007) [2023-12-26 14:29:30,750][123091] Updated weights for policy 0, policy_version 1865321 (0.0005) [2023-12-26 14:29:31,017][123090] Updated weights for policy 1, policy_version 1853608 (0.0010) [2023-12-26 14:29:31,079][123090] Updated weights for policy 1, policy_version 1853618 (0.0010) [2023-12-26 14:29:31,153][123090] Updated weights for policy 1, policy_version 1853628 (0.0010) [2023-12-26 14:29:31,504][123091] Updated weights for policy 0, policy_version 1865331 (0.0007) [2023-12-26 14:29:31,564][123091] Updated weights for policy 0, policy_version 1865341 (0.0009) [2023-12-26 14:29:31,630][123091] Updated weights for policy 0, policy_version 1865351 (0.0011) [2023-12-26 14:29:31,977][123090] Updated weights for policy 1, policy_version 1853638 (0.0010) [2023-12-26 14:29:32,039][123090] Updated weights for policy 1, policy_version 1853648 (0.0010) [2023-12-26 14:29:32,102][123090] Updated weights for policy 1, policy_version 1853658 (0.0010) [2023-12-26 14:29:32,407][123091] Updated weights for policy 0, policy_version 1865361 (0.0011) [2023-12-26 14:29:32,474][123091] Updated weights for policy 0, policy_version 1865371 (0.0010) [2023-12-26 14:29:32,536][123091] Updated weights for policy 0, policy_version 1865381 (0.0010) [2023-12-26 14:29:32,590][123091] Updated weights for policy 0, policy_version 1865391 (0.0010) [2023-12-26 14:29:32,858][123090] Updated weights for policy 1, policy_version 1853668 (0.0008) [2023-12-26 14:29:32,916][123090] Updated weights for policy 1, policy_version 1853678 (0.0005) [2023-12-26 14:29:32,970][123090] Updated weights for policy 1, policy_version 1853688 (0.0005) [2023-12-26 14:29:33,509][123091] Updated weights for policy 0, policy_version 1865401 (0.0008) [2023-12-26 14:29:33,562][123091] Updated weights for policy 0, policy_version 1865411 (0.0005) [2023-12-26 14:29:33,619][123091] Updated weights for policy 0, policy_version 1865421 (0.0005) [2023-12-26 14:29:33,677][123090] Updated weights for policy 1, policy_version 1853698 (0.0005) [2023-12-26 14:29:33,725][123090] Updated weights for policy 1, policy_version 1853708 (0.0005) [2023-12-26 14:29:33,772][123090] Updated weights for policy 1, policy_version 1853718 (0.0005) [2023-12-26 14:29:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 952098816. Throughput: 0: 8832.3, 1: 9064.1. Samples: 952111780. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:33,785][121949] Avg episode reward: [(0, '6337.826'), (1, '6072.030')] [2023-12-26 14:29:33,819][123090] Updated weights for policy 1, policy_version 1853728 (0.0005) [2023-12-26 14:29:34,336][123091] Updated weights for policy 0, policy_version 1865431 (0.0006) [2023-12-26 14:29:34,397][123091] Updated weights for policy 0, policy_version 1865441 (0.0006) [2023-12-26 14:29:34,454][123091] Updated weights for policy 0, policy_version 1865451 (0.0006) [2023-12-26 14:29:34,565][123090] Updated weights for policy 1, policy_version 1853738 (0.0009) [2023-12-26 14:29:34,630][123090] Updated weights for policy 1, policy_version 1853748 (0.0010) [2023-12-26 14:29:34,693][123090] Updated weights for policy 1, policy_version 1853758 (0.0010) [2023-12-26 14:29:35,169][123091] Updated weights for policy 0, policy_version 1865461 (0.0008) [2023-12-26 14:29:35,231][123091] Updated weights for policy 0, policy_version 1865471 (0.0008) [2023-12-26 14:29:35,296][123091] Updated weights for policy 0, policy_version 1865481 (0.0007) [2023-12-26 14:29:35,565][123090] Updated weights for policy 1, policy_version 1853768 (0.0010) [2023-12-26 14:29:35,613][123090] Updated weights for policy 1, policy_version 1853778 (0.0009) [2023-12-26 14:29:35,662][123090] Updated weights for policy 1, policy_version 1853788 (0.0009) [2023-12-26 14:29:36,091][123091] Updated weights for policy 0, policy_version 1865491 (0.0007) [2023-12-26 14:29:36,158][123091] Updated weights for policy 0, policy_version 1865501 (0.0006) [2023-12-26 14:29:36,226][123091] Updated weights for policy 0, policy_version 1865511 (0.0005) [2023-12-26 14:29:36,541][123090] Updated weights for policy 1, policy_version 1853798 (0.0008) [2023-12-26 14:29:36,606][123090] Updated weights for policy 1, policy_version 1853808 (0.0011) [2023-12-26 14:29:36,669][123090] Updated weights for policy 1, policy_version 1853818 (0.0010) [2023-12-26 14:29:36,976][123091] Updated weights for policy 0, policy_version 1865521 (0.0006) [2023-12-26 14:29:37,038][123091] Updated weights for policy 0, policy_version 1865531 (0.0010) [2023-12-26 14:29:37,101][123091] Updated weights for policy 0, policy_version 1865541 (0.0010) [2023-12-26 14:29:37,159][123091] Updated weights for policy 0, policy_version 1865551 (0.0010) [2023-12-26 14:29:37,411][123090] Updated weights for policy 1, policy_version 1853828 (0.0009) [2023-12-26 14:29:37,480][123090] Updated weights for policy 1, policy_version 1853838 (0.0008) [2023-12-26 14:29:37,544][123090] Updated weights for policy 1, policy_version 1853848 (0.0010) [2023-12-26 14:29:37,967][123091] Updated weights for policy 0, policy_version 1865561 (0.0005) [2023-12-26 14:29:38,032][123091] Updated weights for policy 0, policy_version 1865571 (0.0008) [2023-12-26 14:29:38,091][123091] Updated weights for policy 0, policy_version 1865581 (0.0010) [2023-12-26 14:29:38,238][123090] Updated weights for policy 1, policy_version 1853858 (0.0010) [2023-12-26 14:29:38,305][123090] Updated weights for policy 1, policy_version 1853868 (0.0007) [2023-12-26 14:29:38,377][123090] Updated weights for policy 1, policy_version 1853878 (0.0008) [2023-12-26 14:29:38,449][123090] Updated weights for policy 1, policy_version 1853888 (0.0005) [2023-12-26 14:29:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 952188928. Throughput: 0: 8844.9, 1: 9077.6. Samples: 952166516. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:38,785][121949] Avg episode reward: [(0, '6350.426'), (1, '6071.783')] [2023-12-26 14:29:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001865584_477593600.pth... [2023-12-26 14:29:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001853888_474595328.pth... [2023-12-26 14:29:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001864560_477331456.pth [2023-12-26 14:29:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001852832_474324992.pth [2023-12-26 14:29:38,940][123091] Updated weights for policy 0, policy_version 1865591 (0.0010) [2023-12-26 14:29:39,003][123091] Updated weights for policy 0, policy_version 1865601 (0.0010) [2023-12-26 14:29:39,064][123091] Updated weights for policy 0, policy_version 1865611 (0.0009) [2023-12-26 14:29:39,174][123090] Updated weights for policy 1, policy_version 1853898 (0.0006) [2023-12-26 14:29:39,249][123090] Updated weights for policy 1, policy_version 1853908 (0.0007) [2023-12-26 14:29:39,323][123090] Updated weights for policy 1, policy_version 1853918 (0.0008) [2023-12-26 14:29:39,905][123091] Updated weights for policy 0, policy_version 1865621 (0.0010) [2023-12-26 14:29:39,976][123091] Updated weights for policy 0, policy_version 1865632 (0.0010) [2023-12-26 14:29:40,036][123091] Updated weights for policy 0, policy_version 1865642 (0.0011) [2023-12-26 14:29:40,120][123090] Updated weights for policy 1, policy_version 1853928 (0.0006) [2023-12-26 14:29:40,192][123090] Updated weights for policy 1, policy_version 1853938 (0.0006) [2023-12-26 14:29:40,263][123090] Updated weights for policy 1, policy_version 1853948 (0.0008) [2023-12-26 14:29:40,821][123091] Updated weights for policy 0, policy_version 1865652 (0.0010) [2023-12-26 14:29:40,889][123091] Updated weights for policy 0, policy_version 1865662 (0.0008) [2023-12-26 14:29:40,952][123091] Updated weights for policy 0, policy_version 1865672 (0.0007) [2023-12-26 14:29:41,070][123090] Updated weights for policy 1, policy_version 1853958 (0.0008) [2023-12-26 14:29:41,134][123090] Updated weights for policy 1, policy_version 1853968 (0.0010) [2023-12-26 14:29:41,199][123090] Updated weights for policy 1, policy_version 1853978 (0.0009) [2023-12-26 14:29:41,678][123091] Updated weights for policy 0, policy_version 1865682 (0.0008) [2023-12-26 14:29:41,751][123091] Updated weights for policy 0, policy_version 1865692 (0.0009) [2023-12-26 14:29:41,814][123091] Updated weights for policy 0, policy_version 1865702 (0.0008) [2023-12-26 14:29:41,870][123091] Updated weights for policy 0, policy_version 1865712 (0.0008) [2023-12-26 14:29:42,085][123090] Updated weights for policy 1, policy_version 1853988 (0.0008) [2023-12-26 14:29:42,149][123090] Updated weights for policy 1, policy_version 1853998 (0.0006) [2023-12-26 14:29:42,223][123090] Updated weights for policy 1, policy_version 1854008 (0.0008) [2023-12-26 14:29:42,612][123091] Updated weights for policy 0, policy_version 1865722 (0.0007) [2023-12-26 14:29:42,678][123091] Updated weights for policy 0, policy_version 1865732 (0.0011) [2023-12-26 14:29:42,741][123091] Updated weights for policy 0, policy_version 1865742 (0.0010) [2023-12-26 14:29:43,064][123090] Updated weights for policy 1, policy_version 1854018 (0.0009) [2023-12-26 14:29:43,126][123090] Updated weights for policy 1, policy_version 1854028 (0.0007) [2023-12-26 14:29:43,196][123090] Updated weights for policy 1, policy_version 1854038 (0.0007) [2023-12-26 14:29:43,272][123090] Updated weights for policy 1, policy_version 1854048 (0.0007) [2023-12-26 14:29:43,484][123091] Updated weights for policy 0, policy_version 1865752 (0.0009) [2023-12-26 14:29:43,549][123091] Updated weights for policy 0, policy_version 1865762 (0.0008) [2023-12-26 14:29:43,623][123091] Updated weights for policy 0, policy_version 1865772 (0.0008) [2023-12-26 14:29:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 952279040. Throughput: 0: 8880.9, 1: 8988.6. Samples: 952272596. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:43,784][121949] Avg episode reward: [(0, '6305.288'), (1, '5983.692')] [2023-12-26 14:29:43,896][123090] Updated weights for policy 1, policy_version 1854058 (0.0005) [2023-12-26 14:29:43,953][123090] Updated weights for policy 1, policy_version 1854068 (0.0008) [2023-12-26 14:29:44,014][123090] Updated weights for policy 1, policy_version 1854078 (0.0010) [2023-12-26 14:29:44,427][123091] Updated weights for policy 0, policy_version 1865782 (0.0009) [2023-12-26 14:29:44,489][123091] Updated weights for policy 0, policy_version 1865792 (0.0010) [2023-12-26 14:29:44,544][123091] Updated weights for policy 0, policy_version 1865802 (0.0007) [2023-12-26 14:29:44,791][123090] Updated weights for policy 1, policy_version 1854088 (0.0008) [2023-12-26 14:29:44,854][123090] Updated weights for policy 1, policy_version 1854098 (0.0006) [2023-12-26 14:29:44,915][123090] Updated weights for policy 1, policy_version 1854108 (0.0006) [2023-12-26 14:29:45,326][123091] Updated weights for policy 0, policy_version 1865812 (0.0007) [2023-12-26 14:29:45,390][123091] Updated weights for policy 0, policy_version 1865822 (0.0010) [2023-12-26 14:29:45,441][123091] Updated weights for policy 0, policy_version 1865832 (0.0008) [2023-12-26 14:29:45,684][123090] Updated weights for policy 1, policy_version 1854118 (0.0009) [2023-12-26 14:29:45,745][123090] Updated weights for policy 1, policy_version 1854128 (0.0009) [2023-12-26 14:29:45,794][123090] Updated weights for policy 1, policy_version 1854138 (0.0009) [2023-12-26 14:29:46,280][123091] Updated weights for policy 0, policy_version 1865842 (0.0009) [2023-12-26 14:29:46,340][123091] Updated weights for policy 0, policy_version 1865852 (0.0009) [2023-12-26 14:29:46,390][123091] Updated weights for policy 0, policy_version 1865862 (0.0009) [2023-12-26 14:29:46,446][123091] Updated weights for policy 0, policy_version 1865872 (0.0009) [2023-12-26 14:29:46,624][123090] Updated weights for policy 1, policy_version 1854148 (0.0009) [2023-12-26 14:29:46,690][123090] Updated weights for policy 1, policy_version 1854158 (0.0009) [2023-12-26 14:29:46,757][123090] Updated weights for policy 1, policy_version 1854168 (0.0010) [2023-12-26 14:29:47,290][123091] Updated weights for policy 0, policy_version 1865882 (0.0009) [2023-12-26 14:29:47,338][123091] Updated weights for policy 0, policy_version 1865893 (0.0009) [2023-12-26 14:29:47,404][123091] Updated weights for policy 0, policy_version 1865903 (0.0009) [2023-12-26 14:29:47,490][123090] Updated weights for policy 1, policy_version 1854178 (0.0010) [2023-12-26 14:29:47,549][123090] Updated weights for policy 1, policy_version 1854188 (0.0009) [2023-12-26 14:29:47,597][123090] Updated weights for policy 1, policy_version 1854198 (0.0010) [2023-12-26 14:29:47,652][123090] Updated weights for policy 1, policy_version 1854208 (0.0010) [2023-12-26 14:29:48,171][123091] Updated weights for policy 0, policy_version 1865913 (0.0009) [2023-12-26 14:29:48,239][123091] Updated weights for policy 0, policy_version 1865923 (0.0009) [2023-12-26 14:29:48,307][123091] Updated weights for policy 0, policy_version 1865933 (0.0009) [2023-12-26 14:29:48,472][123090] Updated weights for policy 1, policy_version 1854218 (0.0011) [2023-12-26 14:29:48,536][123090] Updated weights for policy 1, policy_version 1854228 (0.0011) [2023-12-26 14:29:48,604][123090] Updated weights for policy 1, policy_version 1854238 (0.0011) [2023-12-26 14:29:48,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 952369152. Throughput: 0: 8875.0, 1: 8983.9. Samples: 952378932. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:48,785][121949] Avg episode reward: [(0, '6206.101'), (1, '5816.524')] [2023-12-26 14:29:49,163][123091] Updated weights for policy 0, policy_version 1865943 (0.0010) [2023-12-26 14:29:49,230][123091] Updated weights for policy 0, policy_version 1865953 (0.0010) [2023-12-26 14:29:49,272][123090] Updated weights for policy 1, policy_version 1854248 (0.0010) [2023-12-26 14:29:49,293][123091] Updated weights for policy 0, policy_version 1865963 (0.0007) [2023-12-26 14:29:49,325][123090] Updated weights for policy 1, policy_version 1854258 (0.0011) [2023-12-26 14:29:49,399][123090] Updated weights for policy 1, policy_version 1854268 (0.0011) [2023-12-26 14:29:50,102][123091] Updated weights for policy 0, policy_version 1865973 (0.0007) [2023-12-26 14:29:50,167][123091] Updated weights for policy 0, policy_version 1865983 (0.0008) [2023-12-26 14:29:50,231][123091] Updated weights for policy 0, policy_version 1865993 (0.0008) [2023-12-26 14:29:50,266][123090] Updated weights for policy 1, policy_version 1854278 (0.0011) [2023-12-26 14:29:50,336][123090] Updated weights for policy 1, policy_version 1854288 (0.0011) [2023-12-26 14:29:50,408][123090] Updated weights for policy 1, policy_version 1854298 (0.0011) [2023-12-26 14:29:50,969][123091] Updated weights for policy 0, policy_version 1866003 (0.0008) [2023-12-26 14:29:51,039][123091] Updated weights for policy 0, policy_version 1866013 (0.0008) [2023-12-26 14:29:51,109][123091] Updated weights for policy 0, policy_version 1866023 (0.0009) [2023-12-26 14:29:51,156][123090] Updated weights for policy 1, policy_version 1854308 (0.0008) [2023-12-26 14:29:51,212][123090] Updated weights for policy 1, policy_version 1854318 (0.0008) [2023-12-26 14:29:51,280][123090] Updated weights for policy 1, policy_version 1854328 (0.0010) [2023-12-26 14:29:51,968][123091] Updated weights for policy 0, policy_version 1866033 (0.0009) [2023-12-26 14:29:52,036][123091] Updated weights for policy 0, policy_version 1866043 (0.0007) [2023-12-26 14:29:52,101][123091] Updated weights for policy 0, policy_version 1866053 (0.0008) [2023-12-26 14:29:52,102][123090] Updated weights for policy 1, policy_version 1854338 (0.0011) [2023-12-26 14:29:52,161][123090] Updated weights for policy 1, policy_version 1854348 (0.0010) [2023-12-26 14:29:52,164][123091] Updated weights for policy 0, policy_version 1866063 (0.0006) [2023-12-26 14:29:52,227][123090] Updated weights for policy 1, policy_version 1854358 (0.0010) [2023-12-26 14:29:52,291][123090] Updated weights for policy 1, policy_version 1854368 (0.0010) [2023-12-26 14:29:52,992][123091] Updated weights for policy 0, policy_version 1866073 (0.0010) [2023-12-26 14:29:53,055][123091] Updated weights for policy 0, policy_version 1866083 (0.0010) [2023-12-26 14:29:53,058][123090] Updated weights for policy 1, policy_version 1854378 (0.0009) [2023-12-26 14:29:53,115][123091] Updated weights for policy 0, policy_version 1866093 (0.0008) [2023-12-26 14:29:53,117][123090] Updated weights for policy 1, policy_version 1854388 (0.0010) [2023-12-26 14:29:53,171][123090] Updated weights for policy 1, policy_version 1854398 (0.0010) [2023-12-26 14:29:53,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 952451072. Throughput: 0: 8847.1, 1: 8964.5. Samples: 952431548. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:53,785][121949] Avg episode reward: [(0, '6087.884'), (1, '5765.353')] [2023-12-26 14:29:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001854400_474726400.pth... [2023-12-26 14:29:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001866096_477724672.pth... [2023-12-26 14:29:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001853376_474464256.pth [2023-12-26 14:29:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001865072_477462528.pth [2023-12-26 14:29:53,853][123091] Updated weights for policy 0, policy_version 1866103 (0.0008) [2023-12-26 14:29:53,913][123091] Updated weights for policy 0, policy_version 1866113 (0.0009) [2023-12-26 14:29:53,968][123091] Updated weights for policy 0, policy_version 1866123 (0.0008) [2023-12-26 14:29:53,978][123090] Updated weights for policy 1, policy_version 1854408 (0.0010) [2023-12-26 14:29:54,040][123090] Updated weights for policy 1, policy_version 1854418 (0.0010) [2023-12-26 14:29:54,091][123090] Updated weights for policy 1, policy_version 1854428 (0.0010) [2023-12-26 14:29:54,847][123091] Updated weights for policy 0, policy_version 1866133 (0.0007) [2023-12-26 14:29:54,860][123090] Updated weights for policy 1, policy_version 1854438 (0.0010) [2023-12-26 14:29:54,910][123091] Updated weights for policy 0, policy_version 1866143 (0.0008) [2023-12-26 14:29:54,915][123090] Updated weights for policy 1, policy_version 1854448 (0.0010) [2023-12-26 14:29:54,973][123091] Updated weights for policy 0, policy_version 1866153 (0.0008) [2023-12-26 14:29:54,975][123090] Updated weights for policy 1, policy_version 1854458 (0.0010) [2023-12-26 14:29:55,793][123090] Updated weights for policy 1, policy_version 1854468 (0.0010) [2023-12-26 14:29:55,808][123091] Updated weights for policy 0, policy_version 1866163 (0.0008) [2023-12-26 14:29:55,845][123090] Updated weights for policy 1, policy_version 1854478 (0.0010) [2023-12-26 14:29:55,872][123091] Updated weights for policy 0, policy_version 1866173 (0.0006) [2023-12-26 14:29:55,914][123090] Updated weights for policy 1, policy_version 1854488 (0.0010) [2023-12-26 14:29:55,933][123091] Updated weights for policy 0, policy_version 1866183 (0.0008) [2023-12-26 14:29:56,742][123090] Updated weights for policy 1, policy_version 1854498 (0.0010) [2023-12-26 14:29:56,766][123091] Updated weights for policy 0, policy_version 1866193 (0.0008) [2023-12-26 14:29:56,792][123090] Updated weights for policy 1, policy_version 1854508 (0.0010) [2023-12-26 14:29:56,825][123091] Updated weights for policy 0, policy_version 1866203 (0.0006) [2023-12-26 14:29:56,843][123090] Updated weights for policy 1, policy_version 1854518 (0.0010) [2023-12-26 14:29:56,873][123091] Updated weights for policy 0, policy_version 1866213 (0.0009) [2023-12-26 14:29:56,890][123090] Updated weights for policy 1, policy_version 1854528 (0.0010) [2023-12-26 14:29:56,924][123091] Updated weights for policy 0, policy_version 1866223 (0.0008) [2023-12-26 14:29:57,726][123090] Updated weights for policy 1, policy_version 1854538 (0.0010) [2023-12-26 14:29:57,762][123091] Updated weights for policy 0, policy_version 1866233 (0.0008) [2023-12-26 14:29:57,780][123090] Updated weights for policy 1, policy_version 1854548 (0.0010) [2023-12-26 14:29:57,814][123091] Updated weights for policy 0, policy_version 1866243 (0.0008) [2023-12-26 14:29:57,830][123090] Updated weights for policy 1, policy_version 1854558 (0.0010) [2023-12-26 14:29:57,867][123091] Updated weights for policy 0, policy_version 1866253 (0.0008) [2023-12-26 14:29:58,721][123090] Updated weights for policy 1, policy_version 1854568 (0.0010) [2023-12-26 14:29:58,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17613.0, 300 sec: 17800.2). Total num frames: 952532992. Throughput: 0: 8773.7, 1: 8974.5. Samples: 952536060. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:29:58,785][121949] Avg episode reward: [(0, '6092.399'), (1, '5807.115')] [2023-12-26 14:29:58,794][123090] Updated weights for policy 1, policy_version 1854578 (0.0009) [2023-12-26 14:29:58,795][123091] Updated weights for policy 0, policy_version 1866263 (0.0009) [2023-12-26 14:29:58,864][123091] Updated weights for policy 0, policy_version 1866273 (0.0008) [2023-12-26 14:29:58,871][123090] Updated weights for policy 1, policy_version 1854588 (0.0010) [2023-12-26 14:29:58,928][123091] Updated weights for policy 0, policy_version 1866283 (0.0008) [2023-12-26 14:29:59,637][123090] Updated weights for policy 1, policy_version 1854598 (0.0008) [2023-12-26 14:29:59,712][123090] Updated weights for policy 1, policy_version 1854608 (0.0005) [2023-12-26 14:29:59,724][123091] Updated weights for policy 0, policy_version 1866293 (0.0007) [2023-12-26 14:29:59,773][123091] Updated weights for policy 0, policy_version 1866303 (0.0005) [2023-12-26 14:29:59,788][123090] Updated weights for policy 1, policy_version 1854618 (0.0008) [2023-12-26 14:29:59,837][123091] Updated weights for policy 0, policy_version 1866313 (0.0007) [2023-12-26 14:30:00,510][123090] Updated weights for policy 1, policy_version 1854628 (0.0009) [2023-12-26 14:30:00,580][123090] Updated weights for policy 1, policy_version 1854638 (0.0006) [2023-12-26 14:30:00,633][123091] Updated weights for policy 0, policy_version 1866323 (0.0008) [2023-12-26 14:30:00,646][123090] Updated weights for policy 1, policy_version 1854648 (0.0007) [2023-12-26 14:30:00,698][123091] Updated weights for policy 0, policy_version 1866333 (0.0011) [2023-12-26 14:30:00,763][123091] Updated weights for policy 0, policy_version 1866343 (0.0010) [2023-12-26 14:30:01,411][123090] Updated weights for policy 1, policy_version 1854658 (0.0010) [2023-12-26 14:30:01,465][123090] Updated weights for policy 1, policy_version 1854668 (0.0010) [2023-12-26 14:30:01,519][123090] Updated weights for policy 1, policy_version 1854679 (0.0010) [2023-12-26 14:30:01,535][123091] Updated weights for policy 0, policy_version 1866353 (0.0010) [2023-12-26 14:30:01,600][123091] Updated weights for policy 0, policy_version 1866363 (0.0006) [2023-12-26 14:30:01,667][123091] Updated weights for policy 0, policy_version 1866373 (0.0007) [2023-12-26 14:30:01,735][123091] Updated weights for policy 0, policy_version 1866383 (0.0010) [2023-12-26 14:30:02,279][123090] Updated weights for policy 1, policy_version 1854689 (0.0010) [2023-12-26 14:30:02,350][123090] Updated weights for policy 1, policy_version 1854699 (0.0008) [2023-12-26 14:30:02,412][123090] Updated weights for policy 1, policy_version 1854709 (0.0009) [2023-12-26 14:30:02,470][123090] Updated weights for policy 1, policy_version 1854719 (0.0008) [2023-12-26 14:30:02,521][123091] Updated weights for policy 0, policy_version 1866393 (0.0008) [2023-12-26 14:30:02,583][123091] Updated weights for policy 0, policy_version 1866403 (0.0008) [2023-12-26 14:30:02,644][123091] Updated weights for policy 0, policy_version 1866413 (0.0008) [2023-12-26 14:30:03,243][123090] Updated weights for policy 1, policy_version 1854729 (0.0005) [2023-12-26 14:30:03,310][123090] Updated weights for policy 1, policy_version 1854739 (0.0005) [2023-12-26 14:30:03,380][123090] Updated weights for policy 1, policy_version 1854749 (0.0005) [2023-12-26 14:30:03,407][123091] Updated weights for policy 0, policy_version 1866423 (0.0008) [2023-12-26 14:30:03,464][123091] Updated weights for policy 0, policy_version 1866433 (0.0010) [2023-12-26 14:30:03,517][123091] Updated weights for policy 0, policy_version 1866443 (0.0010) [2023-12-26 14:30:03,784][121949] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 952631296. Throughput: 0: 8729.3, 1: 8917.4. Samples: 952641576. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:03,785][121949] Avg episode reward: [(0, '6086.596'), (1, '5884.980')] [2023-12-26 14:30:04,076][123090] Updated weights for policy 1, policy_version 1854759 (0.0006) [2023-12-26 14:30:04,144][123090] Updated weights for policy 1, policy_version 1854769 (0.0009) [2023-12-26 14:30:04,207][123090] Updated weights for policy 1, policy_version 1854779 (0.0009) [2023-12-26 14:30:04,377][123091] Updated weights for policy 0, policy_version 1866453 (0.0008) [2023-12-26 14:30:04,444][123091] Updated weights for policy 0, policy_version 1866463 (0.0009) [2023-12-26 14:30:04,514][123091] Updated weights for policy 0, policy_version 1866473 (0.0007) [2023-12-26 14:30:05,055][123090] Updated weights for policy 1, policy_version 1854789 (0.0009) [2023-12-26 14:30:05,119][123090] Updated weights for policy 1, policy_version 1854799 (0.0005) [2023-12-26 14:30:05,174][123090] Updated weights for policy 1, policy_version 1854809 (0.0005) [2023-12-26 14:30:05,233][123091] Updated weights for policy 0, policy_version 1866483 (0.0007) [2023-12-26 14:30:05,287][123091] Updated weights for policy 0, policy_version 1866493 (0.0005) [2023-12-26 14:30:05,332][123091] Updated weights for policy 0, policy_version 1866503 (0.0005) [2023-12-26 14:30:05,851][123090] Updated weights for policy 1, policy_version 1854819 (0.0006) [2023-12-26 14:30:05,902][123090] Updated weights for policy 1, policy_version 1854829 (0.0005) [2023-12-26 14:30:05,951][123090] Updated weights for policy 1, policy_version 1854839 (0.0005) [2023-12-26 14:30:06,041][123091] Updated weights for policy 0, policy_version 1866513 (0.0006) [2023-12-26 14:30:06,093][123091] Updated weights for policy 0, policy_version 1866523 (0.0010) [2023-12-26 14:30:06,161][123091] Updated weights for policy 0, policy_version 1866533 (0.0010) [2023-12-26 14:30:06,231][123091] Updated weights for policy 0, policy_version 1866543 (0.0009) [2023-12-26 14:30:06,742][123090] Updated weights for policy 1, policy_version 1854849 (0.0006) [2023-12-26 14:30:06,806][123090] Updated weights for policy 1, policy_version 1854859 (0.0010) [2023-12-26 14:30:06,877][123090] Updated weights for policy 1, policy_version 1854869 (0.0010) [2023-12-26 14:30:06,944][123090] Updated weights for policy 1, policy_version 1854879 (0.0009) [2023-12-26 14:30:06,957][123091] Updated weights for policy 0, policy_version 1866553 (0.0007) [2023-12-26 14:30:07,026][123091] Updated weights for policy 0, policy_version 1866563 (0.0008) [2023-12-26 14:30:07,105][123091] Updated weights for policy 0, policy_version 1866573 (0.0005) [2023-12-26 14:30:07,765][123091] Updated weights for policy 0, policy_version 1866583 (0.0005) [2023-12-26 14:30:07,782][123090] Updated weights for policy 1, policy_version 1854889 (0.0005) [2023-12-26 14:30:07,827][123091] Updated weights for policy 0, policy_version 1866593 (0.0008) [2023-12-26 14:30:07,829][123090] Updated weights for policy 1, policy_version 1854899 (0.0007) [2023-12-26 14:30:07,878][123091] Updated weights for policy 0, policy_version 1866603 (0.0010) [2023-12-26 14:30:07,885][123090] Updated weights for policy 1, policy_version 1854909 (0.0006) [2023-12-26 14:30:08,675][123091] Updated weights for policy 0, policy_version 1866613 (0.0011) [2023-12-26 14:30:08,721][123090] Updated weights for policy 1, policy_version 1854919 (0.0009) [2023-12-26 14:30:08,731][123091] Updated weights for policy 0, policy_version 1866623 (0.0011) [2023-12-26 14:30:08,775][123090] Updated weights for policy 1, policy_version 1854929 (0.0010) [2023-12-26 14:30:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 952713216. Throughput: 0: 8754.1, 1: 8966.8. Samples: 952696896. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:08,785][121949] Avg episode reward: [(0, '6225.822'), (1, '5917.590')] [2023-12-26 14:30:08,790][123091] Updated weights for policy 0, policy_version 1866633 (0.0011) [2023-12-26 14:30:08,830][123090] Updated weights for policy 1, policy_version 1854939 (0.0010) [2023-12-26 14:30:08,832][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001866640_477863936.pth... [2023-12-26 14:30:08,836][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001865584_477593600.pth [2023-12-26 14:30:08,853][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001854944_474865664.pth... [2023-12-26 14:30:08,857][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001853888_474595328.pth [2023-12-26 14:30:09,631][123091] Updated weights for policy 0, policy_version 1866643 (0.0009) [2023-12-26 14:30:09,663][123090] Updated weights for policy 1, policy_version 1854949 (0.0010) [2023-12-26 14:30:09,720][123091] Updated weights for policy 0, policy_version 1866653 (0.0006) [2023-12-26 14:30:09,743][123090] Updated weights for policy 1, policy_version 1854959 (0.0009) [2023-12-26 14:30:09,786][123091] Updated weights for policy 0, policy_version 1866663 (0.0008) [2023-12-26 14:30:09,798][123090] Updated weights for policy 1, policy_version 1854969 (0.0008) [2023-12-26 14:30:10,445][123091] Updated weights for policy 0, policy_version 1866673 (0.0009) [2023-12-26 14:30:10,509][123091] Updated weights for policy 0, policy_version 1866683 (0.0010) [2023-12-26 14:30:10,577][123091] Updated weights for policy 0, policy_version 1866693 (0.0009) [2023-12-26 14:30:10,631][123091] Updated weights for policy 0, policy_version 1866703 (0.0009) [2023-12-26 14:30:10,692][123090] Updated weights for policy 1, policy_version 1854979 (0.0009) [2023-12-26 14:30:10,760][123090] Updated weights for policy 1, policy_version 1854989 (0.0010) [2023-12-26 14:30:10,830][123090] Updated weights for policy 1, policy_version 1854999 (0.0009) [2023-12-26 14:30:11,477][123091] Updated weights for policy 0, policy_version 1866713 (0.0010) [2023-12-26 14:30:11,553][123091] Updated weights for policy 0, policy_version 1866723 (0.0009) [2023-12-26 14:30:11,632][123091] Updated weights for policy 0, policy_version 1866733 (0.0009) [2023-12-26 14:30:11,659][123090] Updated weights for policy 1, policy_version 1855009 (0.0009) [2023-12-26 14:30:11,730][123090] Updated weights for policy 1, policy_version 1855019 (0.0008) [2023-12-26 14:30:11,796][123090] Updated weights for policy 1, policy_version 1855029 (0.0008) [2023-12-26 14:30:11,851][123090] Updated weights for policy 1, policy_version 1855039 (0.0006) [2023-12-26 14:30:12,540][123091] Updated weights for policy 0, policy_version 1866743 (0.0009) [2023-12-26 14:30:12,594][123091] Updated weights for policy 0, policy_version 1866754 (0.0011) [2023-12-26 14:30:12,616][123090] Updated weights for policy 1, policy_version 1855049 (0.0007) [2023-12-26 14:30:12,654][123091] Updated weights for policy 0, policy_version 1866764 (0.0010) [2023-12-26 14:30:12,680][123090] Updated weights for policy 1, policy_version 1855059 (0.0007) [2023-12-26 14:30:12,745][123090] Updated weights for policy 1, policy_version 1855069 (0.0009) [2023-12-26 14:30:13,512][123091] Updated weights for policy 0, policy_version 1866774 (0.0008) [2023-12-26 14:30:13,575][123091] Updated weights for policy 0, policy_version 1866784 (0.0009) [2023-12-26 14:30:13,576][123090] Updated weights for policy 1, policy_version 1855079 (0.0007) [2023-12-26 14:30:13,637][123091] Updated weights for policy 0, policy_version 1866794 (0.0007) [2023-12-26 14:30:13,641][123090] Updated weights for policy 1, policy_version 1855089 (0.0005) [2023-12-26 14:30:13,711][123090] Updated weights for policy 1, policy_version 1855099 (0.0008) [2023-12-26 14:30:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 952811520. Throughput: 0: 8802.6, 1: 8859.4. Samples: 952800536. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:13,785][121949] Avg episode reward: [(0, '6244.629'), (1, '6032.302')] [2023-12-26 14:30:14,388][123091] Updated weights for policy 0, policy_version 1866804 (0.0008) [2023-12-26 14:30:14,395][123090] Updated weights for policy 1, policy_version 1855109 (0.0008) [2023-12-26 14:30:14,442][123091] Updated weights for policy 0, policy_version 1866814 (0.0009) [2023-12-26 14:30:14,458][123090] Updated weights for policy 1, policy_version 1855119 (0.0005) [2023-12-26 14:30:14,497][123091] Updated weights for policy 0, policy_version 1866825 (0.0010) [2023-12-26 14:30:14,504][123090] Updated weights for policy 1, policy_version 1855129 (0.0005) [2023-12-26 14:30:15,311][123090] Updated weights for policy 1, policy_version 1855139 (0.0007) [2023-12-26 14:30:15,364][123091] Updated weights for policy 0, policy_version 1866835 (0.0010) [2023-12-26 14:30:15,367][123090] Updated weights for policy 1, policy_version 1855149 (0.0010) [2023-12-26 14:30:15,430][123091] Updated weights for policy 0, policy_version 1866845 (0.0008) [2023-12-26 14:30:15,431][123090] Updated weights for policy 1, policy_version 1855159 (0.0009) [2023-12-26 14:30:15,501][123091] Updated weights for policy 0, policy_version 1866855 (0.0006) [2023-12-26 14:30:16,098][123091] Updated weights for policy 0, policy_version 1866865 (0.0006) [2023-12-26 14:30:16,170][123091] Updated weights for policy 0, policy_version 1866875 (0.0005) [2023-12-26 14:30:16,186][123090] Updated weights for policy 1, policy_version 1855169 (0.0006) [2023-12-26 14:30:16,234][123091] Updated weights for policy 0, policy_version 1866885 (0.0006) [2023-12-26 14:30:16,241][123090] Updated weights for policy 1, policy_version 1855179 (0.0010) [2023-12-26 14:30:16,289][123090] Updated weights for policy 1, policy_version 1855189 (0.0010) [2023-12-26 14:30:16,293][123091] Updated weights for policy 0, policy_version 1866895 (0.0010) [2023-12-26 14:30:16,348][123090] Updated weights for policy 1, policy_version 1855199 (0.0010) [2023-12-26 14:30:17,037][123090] Updated weights for policy 1, policy_version 1855209 (0.0009) [2023-12-26 14:30:17,078][123091] Updated weights for policy 0, policy_version 1866905 (0.0006) [2023-12-26 14:30:17,089][123090] Updated weights for policy 1, policy_version 1855219 (0.0010) [2023-12-26 14:30:17,142][123090] Updated weights for policy 1, policy_version 1855229 (0.0009) [2023-12-26 14:30:17,142][123091] Updated weights for policy 0, policy_version 1866915 (0.0007) [2023-12-26 14:30:17,207][123091] Updated weights for policy 0, policy_version 1866925 (0.0010) [2023-12-26 14:30:17,841][123090] Updated weights for policy 1, policy_version 1855239 (0.0009) [2023-12-26 14:30:17,901][123090] Updated weights for policy 1, policy_version 1855249 (0.0010) [2023-12-26 14:30:17,943][123091] Updated weights for policy 0, policy_version 1866935 (0.0007) [2023-12-26 14:30:17,949][123090] Updated weights for policy 1, policy_version 1855259 (0.0010) [2023-12-26 14:30:18,009][123091] Updated weights for policy 0, policy_version 1866945 (0.0005) [2023-12-26 14:30:18,058][123091] Updated weights for policy 0, policy_version 1866955 (0.0005) [2023-12-26 14:30:18,682][123090] Updated weights for policy 1, policy_version 1855269 (0.0010) [2023-12-26 14:30:18,757][123090] Updated weights for policy 1, policy_version 1855279 (0.0006) [2023-12-26 14:30:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 952893440. Throughput: 0: 8845.5, 1: 8910.2. Samples: 952910788. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:18,785][121949] Avg episode reward: [(0, '6274.172'), (1, '6027.266')] [2023-12-26 14:30:18,821][123090] Updated weights for policy 1, policy_version 1855289 (0.0005) [2023-12-26 14:30:18,869][123091] Updated weights for policy 0, policy_version 1866965 (0.0008) [2023-12-26 14:30:18,931][123091] Updated weights for policy 0, policy_version 1866975 (0.0009) [2023-12-26 14:30:19,005][123091] Updated weights for policy 0, policy_version 1866985 (0.0009) [2023-12-26 14:30:19,599][123090] Updated weights for policy 1, policy_version 1855299 (0.0007) [2023-12-26 14:30:19,662][123090] Updated weights for policy 1, policy_version 1855309 (0.0009) [2023-12-26 14:30:19,714][123090] Updated weights for policy 1, policy_version 1855319 (0.0010) [2023-12-26 14:30:19,846][123091] Updated weights for policy 0, policy_version 1866995 (0.0009) [2023-12-26 14:30:19,913][123091] Updated weights for policy 0, policy_version 1867005 (0.0008) [2023-12-26 14:30:19,984][123091] Updated weights for policy 0, policy_version 1867015 (0.0010) [2023-12-26 14:30:20,565][123090] Updated weights for policy 1, policy_version 1855329 (0.0010) [2023-12-26 14:30:20,634][123090] Updated weights for policy 1, policy_version 1855339 (0.0009) [2023-12-26 14:30:20,703][123090] Updated weights for policy 1, policy_version 1855349 (0.0011) [2023-12-26 14:30:20,767][123090] Updated weights for policy 1, policy_version 1855359 (0.0009) [2023-12-26 14:30:20,804][123091] Updated weights for policy 0, policy_version 1867025 (0.0010) [2023-12-26 14:30:20,876][123091] Updated weights for policy 0, policy_version 1867035 (0.0010) [2023-12-26 14:30:20,934][123091] Updated weights for policy 0, policy_version 1867045 (0.0009) [2023-12-26 14:30:20,989][123091] Updated weights for policy 0, policy_version 1867056 (0.0011) [2023-12-26 14:30:21,618][123090] Updated weights for policy 1, policy_version 1855369 (0.0009) [2023-12-26 14:30:21,689][123090] Updated weights for policy 1, policy_version 1855379 (0.0010) [2023-12-26 14:30:21,761][123090] Updated weights for policy 1, policy_version 1855389 (0.0009) [2023-12-26 14:30:21,890][123091] Updated weights for policy 0, policy_version 1867066 (0.0009) [2023-12-26 14:30:21,956][123091] Updated weights for policy 0, policy_version 1867076 (0.0010) [2023-12-26 14:30:22,021][123091] Updated weights for policy 0, policy_version 1867086 (0.0010) [2023-12-26 14:30:22,628][123090] Updated weights for policy 1, policy_version 1855399 (0.0010) [2023-12-26 14:30:22,691][123090] Updated weights for policy 1, policy_version 1855409 (0.0010) [2023-12-26 14:30:22,752][123090] Updated weights for policy 1, policy_version 1855419 (0.0010) [2023-12-26 14:30:22,894][123091] Updated weights for policy 0, policy_version 1867096 (0.0010) [2023-12-26 14:30:22,966][123091] Updated weights for policy 0, policy_version 1867106 (0.0009) [2023-12-26 14:30:23,029][123091] Updated weights for policy 0, policy_version 1867116 (0.0006) [2023-12-26 14:30:23,531][123090] Updated weights for policy 1, policy_version 1855429 (0.0007) [2023-12-26 14:30:23,579][123090] Updated weights for policy 1, policy_version 1855439 (0.0005) [2023-12-26 14:30:23,625][123090] Updated weights for policy 1, policy_version 1855449 (0.0005) [2023-12-26 14:30:23,689][123091] Updated weights for policy 0, policy_version 1867126 (0.0005) [2023-12-26 14:30:23,751][123091] Updated weights for policy 0, policy_version 1867136 (0.0005) [2023-12-26 14:30:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 952983552. Throughput: 0: 8761.1, 1: 8895.3. Samples: 952961060. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:23,785][121949] Avg episode reward: [(0, '6291.928'), (1, '5826.532')] [2023-12-26 14:30:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001855456_474996736.pth... [2023-12-26 14:30:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001854400_474726400.pth [2023-12-26 14:30:23,819][123091] Updated weights for policy 0, policy_version 1867146 (0.0005) [2023-12-26 14:30:23,852][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001867152_477995008.pth... [2023-12-26 14:30:23,855][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001866096_477724672.pth [2023-12-26 14:30:24,350][123090] Updated weights for policy 1, policy_version 1855459 (0.0005) [2023-12-26 14:30:24,421][123090] Updated weights for policy 1, policy_version 1855469 (0.0006) [2023-12-26 14:30:24,458][123091] Updated weights for policy 0, policy_version 1867156 (0.0005) [2023-12-26 14:30:24,489][123090] Updated weights for policy 1, policy_version 1855479 (0.0011) [2023-12-26 14:30:24,508][123091] Updated weights for policy 0, policy_version 1867166 (0.0006) [2023-12-26 14:30:24,565][123091] Updated weights for policy 0, policy_version 1867176 (0.0005) [2023-12-26 14:30:25,210][123090] Updated weights for policy 1, policy_version 1855489 (0.0009) [2023-12-26 14:30:25,259][123091] Updated weights for policy 0, policy_version 1867186 (0.0006) [2023-12-26 14:30:25,283][123090] Updated weights for policy 1, policy_version 1855499 (0.0007) [2023-12-26 14:30:25,307][123091] Updated weights for policy 0, policy_version 1867196 (0.0010) [2023-12-26 14:30:25,330][123090] Updated weights for policy 1, policy_version 1855509 (0.0010) [2023-12-26 14:30:25,354][123091] Updated weights for policy 0, policy_version 1867206 (0.0010) [2023-12-26 14:30:25,378][123090] Updated weights for policy 1, policy_version 1855519 (0.0010) [2023-12-26 14:30:25,398][123091] Updated weights for policy 0, policy_version 1867216 (0.0010) [2023-12-26 14:30:26,182][123090] Updated weights for policy 1, policy_version 1855529 (0.0010) [2023-12-26 14:30:26,236][123091] Updated weights for policy 0, policy_version 1867226 (0.0008) [2023-12-26 14:30:26,244][123090] Updated weights for policy 1, policy_version 1855539 (0.0010) [2023-12-26 14:30:26,288][123091] Updated weights for policy 0, policy_version 1867236 (0.0010) [2023-12-26 14:30:26,307][123090] Updated weights for policy 1, policy_version 1855549 (0.0010) [2023-12-26 14:30:26,339][123091] Updated weights for policy 0, policy_version 1867246 (0.0008) [2023-12-26 14:30:27,016][123090] Updated weights for policy 1, policy_version 1855559 (0.0008) [2023-12-26 14:30:27,069][123090] Updated weights for policy 1, policy_version 1855569 (0.0005) [2023-12-26 14:30:27,138][123091] Updated weights for policy 0, policy_version 1867256 (0.0006) [2023-12-26 14:30:27,138][123090] Updated weights for policy 1, policy_version 1855579 (0.0008) [2023-12-26 14:30:27,202][123091] Updated weights for policy 0, policy_version 1867266 (0.0007) [2023-12-26 14:30:27,258][123091] Updated weights for policy 0, policy_version 1867276 (0.0010) [2023-12-26 14:30:27,908][123090] Updated weights for policy 1, policy_version 1855589 (0.0008) [2023-12-26 14:30:27,964][123090] Updated weights for policy 1, policy_version 1855599 (0.0006) [2023-12-26 14:30:28,012][123091] Updated weights for policy 0, policy_version 1867286 (0.0008) [2023-12-26 14:30:28,017][123090] Updated weights for policy 1, policy_version 1855609 (0.0005) [2023-12-26 14:30:28,069][123091] Updated weights for policy 0, policy_version 1867296 (0.0010) [2023-12-26 14:30:28,135][123091] Updated weights for policy 0, policy_version 1867306 (0.0011) [2023-12-26 14:30:28,745][123090] Updated weights for policy 1, policy_version 1855619 (0.0007) [2023-12-26 14:30:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 953073664. Throughput: 0: 8823.8, 1: 8920.5. Samples: 953071092. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:28,785][121949] Avg episode reward: [(0, '6243.644'), (1, '5932.794')] [2023-12-26 14:30:28,816][123090] Updated weights for policy 1, policy_version 1855629 (0.0011) [2023-12-26 14:30:28,879][123090] Updated weights for policy 1, policy_version 1855639 (0.0010) [2023-12-26 14:30:28,977][123091] Updated weights for policy 0, policy_version 1867316 (0.0011) [2023-12-26 14:30:29,044][123091] Updated weights for policy 0, policy_version 1867326 (0.0011) [2023-12-26 14:30:29,107][123091] Updated weights for policy 0, policy_version 1867336 (0.0011) [2023-12-26 14:30:29,671][123090] Updated weights for policy 1, policy_version 1855649 (0.0010) [2023-12-26 14:30:29,742][123090] Updated weights for policy 1, policy_version 1855659 (0.0008) [2023-12-26 14:30:29,806][123090] Updated weights for policy 1, policy_version 1855669 (0.0008) [2023-12-26 14:30:29,869][123091] Updated weights for policy 0, policy_version 1867346 (0.0010) [2023-12-26 14:30:29,881][123090] Updated weights for policy 1, policy_version 1855679 (0.0008) [2023-12-26 14:30:29,937][123091] Updated weights for policy 0, policy_version 1867356 (0.0011) [2023-12-26 14:30:29,996][123091] Updated weights for policy 0, policy_version 1867366 (0.0007) [2023-12-26 14:30:30,059][123091] Updated weights for policy 0, policy_version 1867376 (0.0009) [2023-12-26 14:30:30,663][123090] Updated weights for policy 1, policy_version 1855689 (0.0009) [2023-12-26 14:30:30,729][123090] Updated weights for policy 1, policy_version 1855699 (0.0009) [2023-12-26 14:30:30,797][123090] Updated weights for policy 1, policy_version 1855709 (0.0009) [2023-12-26 14:30:30,874][123091] Updated weights for policy 0, policy_version 1867386 (0.0010) [2023-12-26 14:30:30,942][123091] Updated weights for policy 0, policy_version 1867396 (0.0010) [2023-12-26 14:30:31,008][123091] Updated weights for policy 0, policy_version 1867406 (0.0009) [2023-12-26 14:30:31,657][123090] Updated weights for policy 1, policy_version 1855719 (0.0009) [2023-12-26 14:30:31,720][123090] Updated weights for policy 1, policy_version 1855729 (0.0010) [2023-12-26 14:30:31,789][123090] Updated weights for policy 1, policy_version 1855739 (0.0009) [2023-12-26 14:30:31,870][123091] Updated weights for policy 0, policy_version 1867416 (0.0010) [2023-12-26 14:30:31,939][123091] Updated weights for policy 0, policy_version 1867426 (0.0009) [2023-12-26 14:30:31,994][123091] Updated weights for policy 0, policy_version 1867436 (0.0008) [2023-12-26 14:30:32,615][123090] Updated weights for policy 1, policy_version 1855749 (0.0009) [2023-12-26 14:30:32,675][123090] Updated weights for policy 1, policy_version 1855759 (0.0008) [2023-12-26 14:30:32,729][123090] Updated weights for policy 1, policy_version 1855769 (0.0009) [2023-12-26 14:30:32,845][123091] Updated weights for policy 0, policy_version 1867446 (0.0010) [2023-12-26 14:30:32,899][123091] Updated weights for policy 0, policy_version 1867457 (0.0011) [2023-12-26 14:30:32,955][123091] Updated weights for policy 0, policy_version 1867467 (0.0010) [2023-12-26 14:30:33,476][123090] Updated weights for policy 1, policy_version 1855779 (0.0008) [2023-12-26 14:30:33,536][123090] Updated weights for policy 1, policy_version 1855789 (0.0010) [2023-12-26 14:30:33,582][123090] Updated weights for policy 1, policy_version 1855799 (0.0008) [2023-12-26 14:30:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 953163776. Throughput: 0: 8784.6, 1: 8910.7. Samples: 953175220. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:33,785][121949] Avg episode reward: [(0, '6268.381'), (1, '6070.316')] [2023-12-26 14:30:33,814][123091] Updated weights for policy 0, policy_version 1867477 (0.0008) [2023-12-26 14:30:33,866][123091] Updated weights for policy 0, policy_version 1867487 (0.0006) [2023-12-26 14:30:33,928][123091] Updated weights for policy 0, policy_version 1867497 (0.0006) [2023-12-26 14:30:34,445][123090] Updated weights for policy 1, policy_version 1855809 (0.0009) [2023-12-26 14:30:34,508][123090] Updated weights for policy 1, policy_version 1855819 (0.0011) [2023-12-26 14:30:34,576][123090] Updated weights for policy 1, policy_version 1855829 (0.0011) [2023-12-26 14:30:34,645][123090] Updated weights for policy 1, policy_version 1855839 (0.0011) [2023-12-26 14:30:34,656][123091] Updated weights for policy 0, policy_version 1867507 (0.0006) [2023-12-26 14:30:34,717][123091] Updated weights for policy 0, policy_version 1867517 (0.0009) [2023-12-26 14:30:34,782][123091] Updated weights for policy 0, policy_version 1867527 (0.0009) [2023-12-26 14:30:35,467][123090] Updated weights for policy 1, policy_version 1855849 (0.0010) [2023-12-26 14:30:35,520][123090] Updated weights for policy 1, policy_version 1855859 (0.0009) [2023-12-26 14:30:35,574][123091] Updated weights for policy 0, policy_version 1867537 (0.0009) [2023-12-26 14:30:35,582][123090] Updated weights for policy 1, policy_version 1855869 (0.0009) [2023-12-26 14:30:35,636][123091] Updated weights for policy 0, policy_version 1867547 (0.0010) [2023-12-26 14:30:35,704][123091] Updated weights for policy 0, policy_version 1867557 (0.0009) [2023-12-26 14:30:35,777][123091] Updated weights for policy 0, policy_version 1867567 (0.0009) [2023-12-26 14:30:36,427][123090] Updated weights for policy 1, policy_version 1855879 (0.0008) [2023-12-26 14:30:36,494][123090] Updated weights for policy 1, policy_version 1855889 (0.0010) [2023-12-26 14:30:36,564][123090] Updated weights for policy 1, policy_version 1855899 (0.0010) [2023-12-26 14:30:36,595][123091] Updated weights for policy 0, policy_version 1867577 (0.0008) [2023-12-26 14:30:36,658][123091] Updated weights for policy 0, policy_version 1867587 (0.0010) [2023-12-26 14:30:36,727][123091] Updated weights for policy 0, policy_version 1867597 (0.0010) [2023-12-26 14:30:37,359][123090] Updated weights for policy 1, policy_version 1855909 (0.0007) [2023-12-26 14:30:37,416][123090] Updated weights for policy 1, policy_version 1855919 (0.0005) [2023-12-26 14:30:37,476][123090] Updated weights for policy 1, policy_version 1855929 (0.0005) [2023-12-26 14:30:37,589][123091] Updated weights for policy 0, policy_version 1867607 (0.0010) [2023-12-26 14:30:37,648][123091] Updated weights for policy 0, policy_version 1867617 (0.0010) [2023-12-26 14:30:37,704][123091] Updated weights for policy 0, policy_version 1867627 (0.0009) [2023-12-26 14:30:38,174][123090] Updated weights for policy 1, policy_version 1855939 (0.0007) [2023-12-26 14:30:38,235][123090] Updated weights for policy 1, policy_version 1855949 (0.0009) [2023-12-26 14:30:38,293][123090] Updated weights for policy 1, policy_version 1855959 (0.0009) [2023-12-26 14:30:38,535][123091] Updated weights for policy 0, policy_version 1867637 (0.0009) [2023-12-26 14:30:38,592][123091] Updated weights for policy 0, policy_version 1867647 (0.0009) [2023-12-26 14:30:38,663][123091] Updated weights for policy 0, policy_version 1867657 (0.0009) [2023-12-26 14:30:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 953253888. Throughput: 0: 8795.1, 1: 8877.8. Samples: 953226824. Policy #0 lag: (min: 31.0, avg: 43.0, max: 63.0) [2023-12-26 14:30:38,785][121949] Avg episode reward: [(0, '6234.541'), (1, '6067.720')] [2023-12-26 14:30:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001867664_478126080.pth... [2023-12-26 14:30:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001855968_475127808.pth... [2023-12-26 14:30:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001866640_477863936.pth [2023-12-26 14:30:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001854944_474865664.pth [2023-12-26 14:30:39,068][123090] Updated weights for policy 1, policy_version 1855969 (0.0009) [2023-12-26 14:30:39,122][123090] Updated weights for policy 1, policy_version 1855979 (0.0009) [2023-12-26 14:30:39,175][123090] Updated weights for policy 1, policy_version 1855990 (0.0009) [2023-12-26 14:30:39,234][123090] Updated weights for policy 1, policy_version 1856000 (0.0009) [2023-12-26 14:30:39,534][123091] Updated weights for policy 0, policy_version 1867667 (0.0009) [2023-12-26 14:30:39,605][123091] Updated weights for policy 0, policy_version 1867677 (0.0009) [2023-12-26 14:30:39,673][123091] Updated weights for policy 0, policy_version 1867687 (0.0010) [2023-12-26 14:30:40,093][123090] Updated weights for policy 1, policy_version 1856010 (0.0008) [2023-12-26 14:30:40,141][123090] Updated weights for policy 1, policy_version 1856020 (0.0008) [2023-12-26 14:30:40,199][123090] Updated weights for policy 1, policy_version 1856030 (0.0009) [2023-12-26 14:30:40,535][123091] Updated weights for policy 0, policy_version 1867697 (0.0010) [2023-12-26 14:30:40,594][123091] Updated weights for policy 0, policy_version 1867707 (0.0009) [2023-12-26 14:30:40,653][123091] Updated weights for policy 0, policy_version 1867717 (0.0010) [2023-12-26 14:30:40,710][123091] Updated weights for policy 0, policy_version 1867727 (0.0010) [2023-12-26 14:30:41,010][123090] Updated weights for policy 1, policy_version 1856040 (0.0006) [2023-12-26 14:30:41,078][123090] Updated weights for policy 1, policy_version 1856050 (0.0008) [2023-12-26 14:30:41,131][123090] Updated weights for policy 1, policy_version 1856060 (0.0010) [2023-12-26 14:30:41,592][123091] Updated weights for policy 0, policy_version 1867737 (0.0009) [2023-12-26 14:30:41,676][123091] Updated weights for policy 0, policy_version 1867747 (0.0010) [2023-12-26 14:30:41,737][123091] Updated weights for policy 0, policy_version 1867757 (0.0009) [2023-12-26 14:30:42,022][123090] Updated weights for policy 1, policy_version 1856070 (0.0010) [2023-12-26 14:30:42,089][123090] Updated weights for policy 1, policy_version 1856080 (0.0010) [2023-12-26 14:30:42,147][123090] Updated weights for policy 1, policy_version 1856090 (0.0010) [2023-12-26 14:30:42,574][123091] Updated weights for policy 0, policy_version 1867767 (0.0009) [2023-12-26 14:30:42,642][123091] Updated weights for policy 0, policy_version 1867777 (0.0009) [2023-12-26 14:30:42,709][123091] Updated weights for policy 0, policy_version 1867787 (0.0009) [2023-12-26 14:30:42,998][123090] Updated weights for policy 1, policy_version 1856100 (0.0010) [2023-12-26 14:30:43,045][123090] Updated weights for policy 1, policy_version 1856110 (0.0010) [2023-12-26 14:30:43,097][123090] Updated weights for policy 1, policy_version 1856120 (0.0010) [2023-12-26 14:30:43,503][123091] Updated weights for policy 0, policy_version 1867797 (0.0007) [2023-12-26 14:30:43,570][123091] Updated weights for policy 0, policy_version 1867807 (0.0006) [2023-12-26 14:30:43,630][123091] Updated weights for policy 0, policy_version 1867817 (0.0007) [2023-12-26 14:30:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17800.3). Total num frames: 953335808. Throughput: 0: 8750.9, 1: 8868.5. Samples: 953328928. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:30:43,785][121949] Avg episode reward: [(0, '6267.533'), (1, '6083.419')] [2023-12-26 14:30:43,957][123090] Updated weights for policy 1, policy_version 1856130 (0.0010) [2023-12-26 14:30:44,027][123090] Updated weights for policy 1, policy_version 1856140 (0.0011) [2023-12-26 14:30:44,093][123090] Updated weights for policy 1, policy_version 1856150 (0.0010) [2023-12-26 14:30:44,164][123090] Updated weights for policy 1, policy_version 1856160 (0.0011) [2023-12-26 14:30:44,390][123091] Updated weights for policy 0, policy_version 1867827 (0.0007) [2023-12-26 14:30:44,449][123091] Updated weights for policy 0, policy_version 1867837 (0.0006) [2023-12-26 14:30:44,518][123091] Updated weights for policy 0, policy_version 1867847 (0.0009) [2023-12-26 14:30:45,005][123090] Updated weights for policy 1, policy_version 1856170 (0.0010) [2023-12-26 14:30:45,069][123090] Updated weights for policy 1, policy_version 1856180 (0.0011) [2023-12-26 14:30:45,127][123090] Updated weights for policy 1, policy_version 1856190 (0.0009) [2023-12-26 14:30:45,236][123091] Updated weights for policy 0, policy_version 1867857 (0.0007) [2023-12-26 14:30:45,298][123091] Updated weights for policy 0, policy_version 1867867 (0.0010) [2023-12-26 14:30:45,363][123091] Updated weights for policy 0, policy_version 1867877 (0.0009) [2023-12-26 14:30:45,427][123091] Updated weights for policy 0, policy_version 1867887 (0.0009) [2023-12-26 14:30:45,938][123090] Updated weights for policy 1, policy_version 1856200 (0.0009) [2023-12-26 14:30:45,998][123090] Updated weights for policy 1, policy_version 1856210 (0.0006) [2023-12-26 14:30:46,050][123090] Updated weights for policy 1, policy_version 1856220 (0.0005) [2023-12-26 14:30:46,281][123091] Updated weights for policy 0, policy_version 1867897 (0.0010) [2023-12-26 14:30:46,342][123091] Updated weights for policy 0, policy_version 1867907 (0.0010) [2023-12-26 14:30:46,411][123091] Updated weights for policy 0, policy_version 1867917 (0.0010) [2023-12-26 14:30:46,755][123090] Updated weights for policy 1, policy_version 1856230 (0.0008) [2023-12-26 14:30:46,815][123090] Updated weights for policy 1, policy_version 1856240 (0.0009) [2023-12-26 14:30:46,873][123090] Updated weights for policy 1, policy_version 1856250 (0.0009) [2023-12-26 14:30:47,245][123091] Updated weights for policy 0, policy_version 1867927 (0.0009) [2023-12-26 14:30:47,295][123091] Updated weights for policy 0, policy_version 1867938 (0.0009) [2023-12-26 14:30:47,345][123091] Updated weights for policy 0, policy_version 1867949 (0.0009) [2023-12-26 14:30:47,701][123090] Updated weights for policy 1, policy_version 1856260 (0.0009) [2023-12-26 14:30:47,772][123090] Updated weights for policy 1, policy_version 1856270 (0.0010) [2023-12-26 14:30:47,835][123090] Updated weights for policy 1, policy_version 1856280 (0.0009) [2023-12-26 14:30:48,197][123091] Updated weights for policy 0, policy_version 1867959 (0.0010) [2023-12-26 14:30:48,246][123091] Updated weights for policy 0, policy_version 1867970 (0.0010) [2023-12-26 14:30:48,302][123091] Updated weights for policy 0, policy_version 1867981 (0.0010) [2023-12-26 14:30:48,657][123090] Updated weights for policy 1, policy_version 1856290 (0.0009) [2023-12-26 14:30:48,713][123090] Updated weights for policy 1, policy_version 1856300 (0.0009) [2023-12-26 14:30:48,771][123090] Updated weights for policy 1, policy_version 1856310 (0.0009) [2023-12-26 14:30:48,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 953417728. Throughput: 0: 8777.9, 1: 8819.1. Samples: 953433444. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:30:48,785][121949] Avg episode reward: [(0, '6282.295'), (1, '5989.812')] [2023-12-26 14:30:48,823][123090] Updated weights for policy 1, policy_version 1856320 (0.0009) [2023-12-26 14:30:49,180][123091] Updated weights for policy 0, policy_version 1867991 (0.0010) [2023-12-26 14:30:49,243][123091] Updated weights for policy 0, policy_version 1868001 (0.0009) [2023-12-26 14:30:49,303][123091] Updated weights for policy 0, policy_version 1868011 (0.0010) [2023-12-26 14:30:49,694][123090] Updated weights for policy 1, policy_version 1856330 (0.0008) [2023-12-26 14:30:49,766][123090] Updated weights for policy 1, policy_version 1856340 (0.0006) [2023-12-26 14:30:49,859][123090] Updated weights for policy 1, policy_version 1856350 (0.0007) [2023-12-26 14:30:50,185][123091] Updated weights for policy 0, policy_version 1868021 (0.0007) [2023-12-26 14:30:50,255][123091] Updated weights for policy 0, policy_version 1868031 (0.0006) [2023-12-26 14:30:50,321][123091] Updated weights for policy 0, policy_version 1868041 (0.0006) [2023-12-26 14:30:50,570][123090] Updated weights for policy 1, policy_version 1856360 (0.0009) [2023-12-26 14:30:50,622][123090] Updated weights for policy 1, policy_version 1856370 (0.0010) [2023-12-26 14:30:50,685][123090] Updated weights for policy 1, policy_version 1856380 (0.0010) [2023-12-26 14:30:50,947][123091] Updated weights for policy 0, policy_version 1868051 (0.0007) [2023-12-26 14:30:51,010][123091] Updated weights for policy 0, policy_version 1868061 (0.0007) [2023-12-26 14:30:51,080][123091] Updated weights for policy 0, policy_version 1868071 (0.0008) [2023-12-26 14:30:51,539][123090] Updated weights for policy 1, policy_version 1856390 (0.0009) [2023-12-26 14:30:51,598][123090] Updated weights for policy 1, policy_version 1856400 (0.0008) [2023-12-26 14:30:51,666][123090] Updated weights for policy 1, policy_version 1856410 (0.0008) [2023-12-26 14:30:51,882][123091] Updated weights for policy 0, policy_version 1868081 (0.0009) [2023-12-26 14:30:51,937][123091] Updated weights for policy 0, policy_version 1868091 (0.0009) [2023-12-26 14:30:51,999][123091] Updated weights for policy 0, policy_version 1868101 (0.0008) [2023-12-26 14:30:52,060][123091] Updated weights for policy 0, policy_version 1868111 (0.0009) [2023-12-26 14:30:52,497][123090] Updated weights for policy 1, policy_version 1856420 (0.0007) [2023-12-26 14:30:52,573][123090] Updated weights for policy 1, policy_version 1856430 (0.0007) [2023-12-26 14:30:52,635][123090] Updated weights for policy 1, policy_version 1856440 (0.0008) [2023-12-26 14:30:52,937][123091] Updated weights for policy 0, policy_version 1868121 (0.0010) [2023-12-26 14:30:53,004][123091] Updated weights for policy 0, policy_version 1868131 (0.0009) [2023-12-26 14:30:53,074][123091] Updated weights for policy 0, policy_version 1868141 (0.0010) [2023-12-26 14:30:53,472][123090] Updated weights for policy 1, policy_version 1856450 (0.0010) [2023-12-26 14:30:53,541][123090] Updated weights for policy 1, policy_version 1856461 (0.0010) [2023-12-26 14:30:53,602][123090] Updated weights for policy 1, policy_version 1856472 (0.0010) [2023-12-26 14:30:53,766][123091] Updated weights for policy 0, policy_version 1868151 (0.0009) [2023-12-26 14:30:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17800.2). Total num frames: 953507840. Throughput: 0: 8749.2, 1: 8781.3. Samples: 953485768. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:30:53,785][121949] Avg episode reward: [(0, '6235.388'), (1, '5950.690')] [2023-12-26 14:30:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001856480_475258880.pth... [2023-12-26 14:30:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001855456_474996736.pth [2023-12-26 14:30:53,834][123091] Updated weights for policy 0, policy_version 1868161 (0.0008) [2023-12-26 14:30:53,898][123091] Updated weights for policy 0, policy_version 1868171 (0.0010) [2023-12-26 14:30:53,924][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001868176_478257152.pth... [2023-12-26 14:30:53,929][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001867152_477995008.pth [2023-12-26 14:30:54,478][123090] Updated weights for policy 1, policy_version 1856482 (0.0008) [2023-12-26 14:30:54,547][123090] Updated weights for policy 1, policy_version 1856492 (0.0009) [2023-12-26 14:30:54,618][123090] Updated weights for policy 1, policy_version 1856502 (0.0008) [2023-12-26 14:30:54,632][123091] Updated weights for policy 0, policy_version 1868181 (0.0007) [2023-12-26 14:30:54,671][123090] Updated weights for policy 1, policy_version 1856512 (0.0009) [2023-12-26 14:30:54,695][123091] Updated weights for policy 0, policy_version 1868191 (0.0006) [2023-12-26 14:30:54,762][123091] Updated weights for policy 0, policy_version 1868201 (0.0005) [2023-12-26 14:30:55,480][123091] Updated weights for policy 0, policy_version 1868211 (0.0006) [2023-12-26 14:30:55,532][123091] Updated weights for policy 0, policy_version 1868221 (0.0006) [2023-12-26 14:30:55,541][123090] Updated weights for policy 1, policy_version 1856522 (0.0008) [2023-12-26 14:30:55,588][123091] Updated weights for policy 0, policy_version 1868231 (0.0007) [2023-12-26 14:30:55,600][123090] Updated weights for policy 1, policy_version 1856532 (0.0008) [2023-12-26 14:30:55,646][123090] Updated weights for policy 1, policy_version 1856542 (0.0008) [2023-12-26 14:30:56,343][123090] Updated weights for policy 1, policy_version 1856552 (0.0006) [2023-12-26 14:30:56,395][123091] Updated weights for policy 0, policy_version 1868241 (0.0008) [2023-12-26 14:30:56,405][123090] Updated weights for policy 1, policy_version 1856562 (0.0005) [2023-12-26 14:30:56,452][123091] Updated weights for policy 0, policy_version 1868251 (0.0009) [2023-12-26 14:30:56,466][123090] Updated weights for policy 1, policy_version 1856572 (0.0006) [2023-12-26 14:30:56,509][123091] Updated weights for policy 0, policy_version 1868261 (0.0007) [2023-12-26 14:30:56,558][123091] Updated weights for policy 0, policy_version 1868271 (0.0009) [2023-12-26 14:30:57,138][123090] Updated weights for policy 1, policy_version 1856582 (0.0007) [2023-12-26 14:30:57,191][123090] Updated weights for policy 1, policy_version 1856592 (0.0005) [2023-12-26 14:30:57,244][123090] Updated weights for policy 1, policy_version 1856602 (0.0005) [2023-12-26 14:30:57,470][123091] Updated weights for policy 0, policy_version 1868281 (0.0009) [2023-12-26 14:30:57,518][123091] Updated weights for policy 0, policy_version 1868291 (0.0009) [2023-12-26 14:30:57,570][123091] Updated weights for policy 0, policy_version 1868301 (0.0009) [2023-12-26 14:30:57,888][123090] Updated weights for policy 1, policy_version 1856612 (0.0005) [2023-12-26 14:30:57,936][123090] Updated weights for policy 1, policy_version 1856622 (0.0005) [2023-12-26 14:30:57,992][123090] Updated weights for policy 1, policy_version 1856632 (0.0005) [2023-12-26 14:30:58,480][123091] Updated weights for policy 0, policy_version 1868311 (0.0008) [2023-12-26 14:30:58,551][123091] Updated weights for policy 0, policy_version 1868321 (0.0008) [2023-12-26 14:30:58,621][123091] Updated weights for policy 0, policy_version 1868331 (0.0007) [2023-12-26 14:30:58,766][123090] Updated weights for policy 1, policy_version 1856642 (0.0006) [2023-12-26 14:30:58,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 953597952. Throughput: 0: 8760.8, 1: 8842.4. Samples: 953592688. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:30:58,785][121949] Avg episode reward: [(0, '6286.018'), (1, '5832.891')] [2023-12-26 14:30:58,847][123090] Updated weights for policy 1, policy_version 1856652 (0.0009) [2023-12-26 14:30:58,918][123090] Updated weights for policy 1, policy_version 1856662 (0.0010) [2023-12-26 14:30:58,986][123090] Updated weights for policy 1, policy_version 1856672 (0.0010) [2023-12-26 14:30:59,506][123091] Updated weights for policy 0, policy_version 1868341 (0.0006) [2023-12-26 14:30:59,556][123091] Updated weights for policy 0, policy_version 1868351 (0.0005) [2023-12-26 14:30:59,609][123091] Updated weights for policy 0, policy_version 1868361 (0.0005) [2023-12-26 14:30:59,854][123090] Updated weights for policy 1, policy_version 1856682 (0.0010) [2023-12-26 14:30:59,923][123090] Updated weights for policy 1, policy_version 1856692 (0.0009) [2023-12-26 14:30:59,980][123090] Updated weights for policy 1, policy_version 1856703 (0.0010) [2023-12-26 14:31:00,362][123091] Updated weights for policy 0, policy_version 1868371 (0.0005) [2023-12-26 14:31:00,418][123091] Updated weights for policy 0, policy_version 1868381 (0.0007) [2023-12-26 14:31:00,469][123091] Updated weights for policy 0, policy_version 1868391 (0.0010) [2023-12-26 14:31:00,824][123090] Updated weights for policy 1, policy_version 1856713 (0.0006) [2023-12-26 14:31:00,879][123090] Updated weights for policy 1, policy_version 1856723 (0.0005) [2023-12-26 14:31:00,927][123090] Updated weights for policy 1, policy_version 1856733 (0.0005) [2023-12-26 14:31:01,180][123091] Updated weights for policy 0, policy_version 1868401 (0.0011) [2023-12-26 14:31:01,245][123091] Updated weights for policy 0, policy_version 1868411 (0.0013) [2023-12-26 14:31:01,311][123091] Updated weights for policy 0, policy_version 1868421 (0.0010) [2023-12-26 14:31:01,376][123091] Updated weights for policy 0, policy_version 1868431 (0.0010) [2023-12-26 14:31:01,644][123090] Updated weights for policy 1, policy_version 1856743 (0.0007) [2023-12-26 14:31:01,700][123090] Updated weights for policy 1, policy_version 1856753 (0.0007) [2023-12-26 14:31:01,766][123090] Updated weights for policy 1, policy_version 1856763 (0.0009) [2023-12-26 14:31:02,123][123091] Updated weights for policy 0, policy_version 1868441 (0.0009) [2023-12-26 14:31:02,175][123091] Updated weights for policy 0, policy_version 1868451 (0.0010) [2023-12-26 14:31:02,241][123091] Updated weights for policy 0, policy_version 1868461 (0.0010) [2023-12-26 14:31:02,513][123090] Updated weights for policy 1, policy_version 1856773 (0.0008) [2023-12-26 14:31:02,575][123090] Updated weights for policy 1, policy_version 1856783 (0.0009) [2023-12-26 14:31:02,634][123090] Updated weights for policy 1, policy_version 1856793 (0.0009) [2023-12-26 14:31:03,046][123091] Updated weights for policy 0, policy_version 1868471 (0.0006) [2023-12-26 14:31:03,123][123091] Updated weights for policy 0, policy_version 1868481 (0.0007) [2023-12-26 14:31:03,185][123091] Updated weights for policy 0, policy_version 1868491 (0.0010) [2023-12-26 14:31:03,399][123090] Updated weights for policy 1, policy_version 1856803 (0.0008) [2023-12-26 14:31:03,456][123090] Updated weights for policy 1, policy_version 1856813 (0.0006) [2023-12-26 14:31:03,521][123090] Updated weights for policy 1, policy_version 1856823 (0.0006) [2023-12-26 14:31:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 953688064. Throughput: 0: 8728.8, 1: 8790.9. Samples: 953699176. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:03,785][121949] Avg episode reward: [(0, '6337.300'), (1, '5814.478')] [2023-12-26 14:31:03,978][123091] Updated weights for policy 0, policy_version 1868501 (0.0010) [2023-12-26 14:31:04,035][123091] Updated weights for policy 0, policy_version 1868511 (0.0009) [2023-12-26 14:31:04,084][123091] Updated weights for policy 0, policy_version 1868521 (0.0009) [2023-12-26 14:31:04,335][123090] Updated weights for policy 1, policy_version 1856833 (0.0009) [2023-12-26 14:31:04,411][123090] Updated weights for policy 1, policy_version 1856843 (0.0011) [2023-12-26 14:31:04,483][123090] Updated weights for policy 1, policy_version 1856853 (0.0011) [2023-12-26 14:31:04,554][123090] Updated weights for policy 1, policy_version 1856863 (0.0011) [2023-12-26 14:31:04,867][123091] Updated weights for policy 0, policy_version 1868531 (0.0009) [2023-12-26 14:31:04,923][123091] Updated weights for policy 0, policy_version 1868541 (0.0009) [2023-12-26 14:31:04,986][123091] Updated weights for policy 0, policy_version 1868551 (0.0009) [2023-12-26 14:31:05,346][123090] Updated weights for policy 1, policy_version 1856873 (0.0011) [2023-12-26 14:31:05,408][123090] Updated weights for policy 1, policy_version 1856883 (0.0010) [2023-12-26 14:31:05,467][123090] Updated weights for policy 1, policy_version 1856893 (0.0010) [2023-12-26 14:31:05,819][123091] Updated weights for policy 0, policy_version 1868561 (0.0009) [2023-12-26 14:31:05,871][123091] Updated weights for policy 0, policy_version 1868571 (0.0009) [2023-12-26 14:31:05,919][123091] Updated weights for policy 0, policy_version 1868581 (0.0008) [2023-12-26 14:31:05,983][123091] Updated weights for policy 0, policy_version 1868591 (0.0006) [2023-12-26 14:31:06,299][123090] Updated weights for policy 1, policy_version 1856903 (0.0007) [2023-12-26 14:31:06,373][123090] Updated weights for policy 1, policy_version 1856913 (0.0006) [2023-12-26 14:31:06,446][123090] Updated weights for policy 1, policy_version 1856923 (0.0005) [2023-12-26 14:31:06,851][123091] Updated weights for policy 0, policy_version 1868601 (0.0009) [2023-12-26 14:31:06,910][123091] Updated weights for policy 0, policy_version 1868611 (0.0010) [2023-12-26 14:31:06,981][123091] Updated weights for policy 0, policy_version 1868621 (0.0010) [2023-12-26 14:31:07,134][123090] Updated weights for policy 1, policy_version 1856933 (0.0005) [2023-12-26 14:31:07,204][123090] Updated weights for policy 1, policy_version 1856943 (0.0006) [2023-12-26 14:31:07,273][123090] Updated weights for policy 1, policy_version 1856953 (0.0011) [2023-12-26 14:31:07,887][123091] Updated weights for policy 0, policy_version 1868631 (0.0009) [2023-12-26 14:31:07,946][123091] Updated weights for policy 0, policy_version 1868641 (0.0010) [2023-12-26 14:31:07,991][123090] Updated weights for policy 1, policy_version 1856963 (0.0009) [2023-12-26 14:31:08,002][123091] Updated weights for policy 0, policy_version 1868651 (0.0007) [2023-12-26 14:31:08,058][123090] Updated weights for policy 1, policy_version 1856973 (0.0005) [2023-12-26 14:31:08,128][123090] Updated weights for policy 1, policy_version 1856983 (0.0009) [2023-12-26 14:31:08,727][123091] Updated weights for policy 0, policy_version 1868661 (0.0005) [2023-12-26 14:31:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 953769984. Throughput: 0: 8756.8, 1: 8799.2. Samples: 953751080. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:08,785][121949] Avg episode reward: [(0, '6297.416'), (1, '5819.577')] [2023-12-26 14:31:08,794][123091] Updated weights for policy 0, policy_version 1868671 (0.0005) [2023-12-26 14:31:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001856992_475389952.pth... [2023-12-26 14:31:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001855968_475127808.pth [2023-12-26 14:31:08,857][123091] Updated weights for policy 0, policy_version 1868681 (0.0005) [2023-12-26 14:31:08,888][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001868688_478388224.pth... [2023-12-26 14:31:08,891][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001867664_478126080.pth [2023-12-26 14:31:08,910][123090] Updated weights for policy 1, policy_version 1856993 (0.0008) [2023-12-26 14:31:08,977][123090] Updated weights for policy 1, policy_version 1857003 (0.0010) [2023-12-26 14:31:09,043][123090] Updated weights for policy 1, policy_version 1857013 (0.0010) [2023-12-26 14:31:09,106][123090] Updated weights for policy 1, policy_version 1857023 (0.0010) [2023-12-26 14:31:09,607][123091] Updated weights for policy 0, policy_version 1868691 (0.0007) [2023-12-26 14:31:09,668][123091] Updated weights for policy 0, policy_version 1868701 (0.0008) [2023-12-26 14:31:09,735][123091] Updated weights for policy 0, policy_version 1868711 (0.0008) [2023-12-26 14:31:09,953][123090] Updated weights for policy 1, policy_version 1857033 (0.0010) [2023-12-26 14:31:10,022][123090] Updated weights for policy 1, policy_version 1857043 (0.0010) [2023-12-26 14:31:10,090][123090] Updated weights for policy 1, policy_version 1857053 (0.0010) [2023-12-26 14:31:10,516][123091] Updated weights for policy 0, policy_version 1868721 (0.0009) [2023-12-26 14:31:10,572][123091] Updated weights for policy 0, policy_version 1868731 (0.0009) [2023-12-26 14:31:10,636][123091] Updated weights for policy 0, policy_version 1868741 (0.0009) [2023-12-26 14:31:10,704][123091] Updated weights for policy 0, policy_version 1868751 (0.0009) [2023-12-26 14:31:10,899][123090] Updated weights for policy 1, policy_version 1857063 (0.0010) [2023-12-26 14:31:10,947][123090] Updated weights for policy 1, policy_version 1857073 (0.0010) [2023-12-26 14:31:10,995][123090] Updated weights for policy 1, policy_version 1857083 (0.0010) [2023-12-26 14:31:11,553][123091] Updated weights for policy 0, policy_version 1868761 (0.0008) [2023-12-26 14:31:11,617][123091] Updated weights for policy 0, policy_version 1868771 (0.0011) [2023-12-26 14:31:11,691][123091] Updated weights for policy 0, policy_version 1868781 (0.0010) [2023-12-26 14:31:11,949][123090] Updated weights for policy 1, policy_version 1857093 (0.0009) [2023-12-26 14:31:12,001][123090] Updated weights for policy 1, policy_version 1857103 (0.0009) [2023-12-26 14:31:12,079][123090] Updated weights for policy 1, policy_version 1857113 (0.0010) [2023-12-26 14:31:12,454][123091] Updated weights for policy 0, policy_version 1868791 (0.0008) [2023-12-26 14:31:12,510][123091] Updated weights for policy 0, policy_version 1868801 (0.0006) [2023-12-26 14:31:12,579][123091] Updated weights for policy 0, policy_version 1868811 (0.0007) [2023-12-26 14:31:12,973][123090] Updated weights for policy 1, policy_version 1857123 (0.0010) [2023-12-26 14:31:13,032][123090] Updated weights for policy 1, policy_version 1857133 (0.0010) [2023-12-26 14:31:13,091][123090] Updated weights for policy 1, policy_version 1857143 (0.0010) [2023-12-26 14:31:13,302][123091] Updated weights for policy 0, policy_version 1868821 (0.0007) [2023-12-26 14:31:13,361][123091] Updated weights for policy 0, policy_version 1868831 (0.0005) [2023-12-26 14:31:13,416][123091] Updated weights for policy 0, policy_version 1868841 (0.0005) [2023-12-26 14:31:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 953860096. Throughput: 0: 8679.2, 1: 8748.3. Samples: 953855328. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:13,785][121949] Avg episode reward: [(0, '6209.340'), (1, '5841.473')] [2023-12-26 14:31:13,907][123090] Updated weights for policy 1, policy_version 1857153 (0.0010) [2023-12-26 14:31:13,975][123090] Updated weights for policy 1, policy_version 1857163 (0.0007) [2023-12-26 14:31:14,040][123090] Updated weights for policy 1, policy_version 1857173 (0.0009) [2023-12-26 14:31:14,106][123090] Updated weights for policy 1, policy_version 1857183 (0.0009) [2023-12-26 14:31:14,159][123091] Updated weights for policy 0, policy_version 1868851 (0.0005) [2023-12-26 14:31:14,220][123091] Updated weights for policy 0, policy_version 1868861 (0.0008) [2023-12-26 14:31:14,286][123091] Updated weights for policy 0, policy_version 1868871 (0.0009) [2023-12-26 14:31:14,966][123090] Updated weights for policy 1, policy_version 1857193 (0.0009) [2023-12-26 14:31:14,978][123091] Updated weights for policy 0, policy_version 1868881 (0.0009) [2023-12-26 14:31:15,023][123090] Updated weights for policy 1, policy_version 1857203 (0.0010) [2023-12-26 14:31:15,045][123091] Updated weights for policy 0, policy_version 1868891 (0.0006) [2023-12-26 14:31:15,091][123090] Updated weights for policy 1, policy_version 1857213 (0.0009) [2023-12-26 14:31:15,112][123091] Updated weights for policy 0, policy_version 1868901 (0.0008) [2023-12-26 14:31:15,180][123091] Updated weights for policy 0, policy_version 1868911 (0.0010) [2023-12-26 14:31:15,922][123090] Updated weights for policy 1, policy_version 1857223 (0.0007) [2023-12-26 14:31:15,973][123091] Updated weights for policy 0, policy_version 1868921 (0.0008) [2023-12-26 14:31:15,975][123090] Updated weights for policy 1, policy_version 1857233 (0.0005) [2023-12-26 14:31:16,032][123090] Updated weights for policy 1, policy_version 1857243 (0.0005) [2023-12-26 14:31:16,033][123091] Updated weights for policy 0, policy_version 1868931 (0.0009) [2023-12-26 14:31:16,084][123091] Updated weights for policy 0, policy_version 1868941 (0.0010) [2023-12-26 14:31:16,693][123090] Updated weights for policy 1, policy_version 1857253 (0.0005) [2023-12-26 14:31:16,755][123090] Updated weights for policy 1, policy_version 1857263 (0.0005) [2023-12-26 14:31:16,803][123090] Updated weights for policy 1, policy_version 1857273 (0.0005) [2023-12-26 14:31:16,957][123091] Updated weights for policy 0, policy_version 1868952 (0.0010) [2023-12-26 14:31:17,015][123091] Updated weights for policy 0, policy_version 1868962 (0.0010) [2023-12-26 14:31:17,058][123091] Updated weights for policy 0, policy_version 1868972 (0.0010) [2023-12-26 14:31:17,523][123090] Updated weights for policy 1, policy_version 1857283 (0.0006) [2023-12-26 14:31:17,580][123090] Updated weights for policy 1, policy_version 1857293 (0.0010) [2023-12-26 14:31:17,640][123090] Updated weights for policy 1, policy_version 1857303 (0.0009) [2023-12-26 14:31:17,717][123091] Updated weights for policy 0, policy_version 1868982 (0.0006) [2023-12-26 14:31:17,766][123091] Updated weights for policy 0, policy_version 1868992 (0.0008) [2023-12-26 14:31:17,823][123091] Updated weights for policy 0, policy_version 1869003 (0.0010) [2023-12-26 14:31:18,465][123090] Updated weights for policy 1, policy_version 1857313 (0.0008) [2023-12-26 14:31:18,532][123090] Updated weights for policy 1, policy_version 1857323 (0.0005) [2023-12-26 14:31:18,595][123090] Updated weights for policy 1, policy_version 1857333 (0.0006) [2023-12-26 14:31:18,670][123090] Updated weights for policy 1, policy_version 1857343 (0.0006) [2023-12-26 14:31:18,675][123091] Updated weights for policy 0, policy_version 1869013 (0.0010) [2023-12-26 14:31:18,755][123091] Updated weights for policy 0, policy_version 1869023 (0.0009) [2023-12-26 14:31:18,784][121949] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 953950208. Throughput: 0: 8770.1, 1: 8746.2. Samples: 953963452. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:18,784][121949] Avg episode reward: [(0, '6269.331'), (1, '5837.725')] [2023-12-26 14:31:18,826][123091] Updated weights for policy 0, policy_version 1869033 (0.0010) [2023-12-26 14:31:19,296][123090] Updated weights for policy 1, policy_version 1857353 (0.0006) [2023-12-26 14:31:19,365][123090] Updated weights for policy 1, policy_version 1857363 (0.0010) [2023-12-26 14:31:19,432][123090] Updated weights for policy 1, policy_version 1857373 (0.0006) [2023-12-26 14:31:19,633][123091] Updated weights for policy 0, policy_version 1869043 (0.0009) [2023-12-26 14:31:19,703][123091] Updated weights for policy 0, policy_version 1869053 (0.0008) [2023-12-26 14:31:19,754][123091] Updated weights for policy 0, policy_version 1869063 (0.0008) [2023-12-26 14:31:20,174][123090] Updated weights for policy 1, policy_version 1857383 (0.0008) [2023-12-26 14:31:20,232][123090] Updated weights for policy 1, policy_version 1857393 (0.0009) [2023-12-26 14:31:20,289][123090] Updated weights for policy 1, policy_version 1857403 (0.0009) [2023-12-26 14:31:20,613][123091] Updated weights for policy 0, policy_version 1869073 (0.0008) [2023-12-26 14:31:20,678][123091] Updated weights for policy 0, policy_version 1869083 (0.0009) [2023-12-26 14:31:20,745][123091] Updated weights for policy 0, policy_version 1869093 (0.0010) [2023-12-26 14:31:20,808][123091] Updated weights for policy 0, policy_version 1869103 (0.0010) [2023-12-26 14:31:21,112][123090] Updated weights for policy 1, policy_version 1857413 (0.0009) [2023-12-26 14:31:21,183][123090] Updated weights for policy 1, policy_version 1857423 (0.0009) [2023-12-26 14:31:21,252][123090] Updated weights for policy 1, policy_version 1857433 (0.0010) [2023-12-26 14:31:21,674][123091] Updated weights for policy 0, policy_version 1869113 (0.0009) [2023-12-26 14:31:21,746][123091] Updated weights for policy 0, policy_version 1869123 (0.0009) [2023-12-26 14:31:21,804][123091] Updated weights for policy 0, policy_version 1869133 (0.0009) [2023-12-26 14:31:22,080][123090] Updated weights for policy 1, policy_version 1857443 (0.0010) [2023-12-26 14:31:22,136][123090] Updated weights for policy 1, policy_version 1857453 (0.0009) [2023-12-26 14:31:22,196][123090] Updated weights for policy 1, policy_version 1857463 (0.0009) [2023-12-26 14:31:22,681][123091] Updated weights for policy 0, policy_version 1869143 (0.0010) [2023-12-26 14:31:22,744][123091] Updated weights for policy 0, policy_version 1869153 (0.0010) [2023-12-26 14:31:22,806][123091] Updated weights for policy 0, policy_version 1869163 (0.0009) [2023-12-26 14:31:23,008][123090] Updated weights for policy 1, policy_version 1857473 (0.0009) [2023-12-26 14:31:23,075][123090] Updated weights for policy 1, policy_version 1857483 (0.0010) [2023-12-26 14:31:23,125][123090] Updated weights for policy 1, policy_version 1857493 (0.0009) [2023-12-26 14:31:23,186][123090] Updated weights for policy 1, policy_version 1857503 (0.0008) [2023-12-26 14:31:23,659][123091] Updated weights for policy 0, policy_version 1869173 (0.0010) [2023-12-26 14:31:23,707][123091] Updated weights for policy 0, policy_version 1869183 (0.0009) [2023-12-26 14:31:23,760][123091] Updated weights for policy 0, policy_version 1869193 (0.0009) [2023-12-26 14:31:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 954032128. Throughput: 0: 8732.9, 1: 8785.3. Samples: 954015140. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:23,785][121949] Avg episode reward: [(0, '6280.749'), (1, '5841.319')] [2023-12-26 14:31:23,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001857504_475521024.pth... [2023-12-26 14:31:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001856480_475258880.pth [2023-12-26 14:31:23,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001869200_478519296.pth... [2023-12-26 14:31:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001868176_478257152.pth [2023-12-26 14:31:24,007][123090] Updated weights for policy 1, policy_version 1857513 (0.0010) [2023-12-26 14:31:24,059][123090] Updated weights for policy 1, policy_version 1857523 (0.0008) [2023-12-26 14:31:24,113][123090] Updated weights for policy 1, policy_version 1857533 (0.0010) [2023-12-26 14:31:24,613][123091] Updated weights for policy 0, policy_version 1869203 (0.0009) [2023-12-26 14:31:24,678][123091] Updated weights for policy 0, policy_version 1869213 (0.0010) [2023-12-26 14:31:24,734][123091] Updated weights for policy 0, policy_version 1869223 (0.0009) [2023-12-26 14:31:24,934][123090] Updated weights for policy 1, policy_version 1857543 (0.0009) [2023-12-26 14:31:24,996][123090] Updated weights for policy 1, policy_version 1857553 (0.0010) [2023-12-26 14:31:25,064][123090] Updated weights for policy 1, policy_version 1857563 (0.0009) [2023-12-26 14:31:25,579][123091] Updated weights for policy 0, policy_version 1869233 (0.0010) [2023-12-26 14:31:25,642][123091] Updated weights for policy 0, policy_version 1869243 (0.0010) [2023-12-26 14:31:25,699][123091] Updated weights for policy 0, policy_version 1869253 (0.0009) [2023-12-26 14:31:25,746][123091] Updated weights for policy 0, policy_version 1869263 (0.0009) [2023-12-26 14:31:25,902][123090] Updated weights for policy 1, policy_version 1857573 (0.0008) [2023-12-26 14:31:25,955][123090] Updated weights for policy 1, policy_version 1857583 (0.0005) [2023-12-26 14:31:26,013][123090] Updated weights for policy 1, policy_version 1857593 (0.0005) [2023-12-26 14:31:26,655][123091] Updated weights for policy 0, policy_version 1869273 (0.0010) [2023-12-26 14:31:26,709][123091] Updated weights for policy 0, policy_version 1869283 (0.0009) [2023-12-26 14:31:26,737][123090] Updated weights for policy 1, policy_version 1857603 (0.0007) [2023-12-26 14:31:26,755][123091] Updated weights for policy 0, policy_version 1869293 (0.0009) [2023-12-26 14:31:26,795][123090] Updated weights for policy 1, policy_version 1857613 (0.0009) [2023-12-26 14:31:26,862][123090] Updated weights for policy 1, policy_version 1857623 (0.0009) [2023-12-26 14:31:27,570][123090] Updated weights for policy 1, policy_version 1857633 (0.0007) [2023-12-26 14:31:27,602][123091] Updated weights for policy 0, policy_version 1869303 (0.0009) [2023-12-26 14:31:27,629][123090] Updated weights for policy 1, policy_version 1857643 (0.0007) [2023-12-26 14:31:27,660][123091] Updated weights for policy 0, policy_version 1869313 (0.0009) [2023-12-26 14:31:27,685][123090] Updated weights for policy 1, policy_version 1857653 (0.0007) [2023-12-26 14:31:27,722][123091] Updated weights for policy 0, policy_version 1869323 (0.0008) [2023-12-26 14:31:27,739][123090] Updated weights for policy 1, policy_version 1857663 (0.0010) [2023-12-26 14:31:28,404][123090] Updated weights for policy 1, policy_version 1857673 (0.0007) [2023-12-26 14:31:28,475][123090] Updated weights for policy 1, policy_version 1857683 (0.0006) [2023-12-26 14:31:28,543][123090] Updated weights for policy 1, policy_version 1857693 (0.0005) [2023-12-26 14:31:28,612][123091] Updated weights for policy 0, policy_version 1869333 (0.0009) [2023-12-26 14:31:28,677][123091] Updated weights for policy 0, policy_version 1869343 (0.0010) [2023-12-26 14:31:28,737][123091] Updated weights for policy 0, policy_version 1869353 (0.0010) [2023-12-26 14:31:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 954130432. Throughput: 0: 8739.4, 1: 8810.6. Samples: 954118676. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:28,784][121949] Avg episode reward: [(0, '6271.332'), (1, '5674.892')] [2023-12-26 14:31:29,286][123090] Updated weights for policy 1, policy_version 1857703 (0.0008) [2023-12-26 14:31:29,356][123090] Updated weights for policy 1, policy_version 1857713 (0.0009) [2023-12-26 14:31:29,409][123090] Updated weights for policy 1, policy_version 1857723 (0.0009) [2023-12-26 14:31:29,558][123091] Updated weights for policy 0, policy_version 1869363 (0.0010) [2023-12-26 14:31:29,622][123091] Updated weights for policy 0, policy_version 1869373 (0.0010) [2023-12-26 14:31:29,686][123091] Updated weights for policy 0, policy_version 1869383 (0.0010) [2023-12-26 14:31:30,260][123090] Updated weights for policy 1, policy_version 1857733 (0.0009) [2023-12-26 14:31:30,320][123090] Updated weights for policy 1, policy_version 1857743 (0.0009) [2023-12-26 14:31:30,384][123090] Updated weights for policy 1, policy_version 1857753 (0.0009) [2023-12-26 14:31:30,514][123091] Updated weights for policy 0, policy_version 1869393 (0.0009) [2023-12-26 14:31:30,576][123091] Updated weights for policy 0, policy_version 1869403 (0.0009) [2023-12-26 14:31:30,639][123091] Updated weights for policy 0, policy_version 1869413 (0.0005) [2023-12-26 14:31:30,696][123091] Updated weights for policy 0, policy_version 1869423 (0.0005) [2023-12-26 14:31:31,233][123090] Updated weights for policy 1, policy_version 1857763 (0.0009) [2023-12-26 14:31:31,290][123090] Updated weights for policy 1, policy_version 1857773 (0.0009) [2023-12-26 14:31:31,355][123090] Updated weights for policy 1, policy_version 1857783 (0.0009) [2023-12-26 14:31:31,451][123091] Updated weights for policy 0, policy_version 1869433 (0.0010) [2023-12-26 14:31:31,508][123091] Updated weights for policy 0, policy_version 1869443 (0.0009) [2023-12-26 14:31:31,557][123091] Updated weights for policy 0, policy_version 1869453 (0.0007) [2023-12-26 14:31:32,135][123090] Updated weights for policy 1, policy_version 1857793 (0.0010) [2023-12-26 14:31:32,190][123090] Updated weights for policy 1, policy_version 1857803 (0.0005) [2023-12-26 14:31:32,242][123090] Updated weights for policy 1, policy_version 1857813 (0.0005) [2023-12-26 14:31:32,310][123090] Updated weights for policy 1, policy_version 1857823 (0.0009) [2023-12-26 14:31:32,312][123091] Updated weights for policy 0, policy_version 1869463 (0.0006) [2023-12-26 14:31:32,391][123091] Updated weights for policy 0, policy_version 1869473 (0.0007) [2023-12-26 14:31:32,454][123091] Updated weights for policy 0, policy_version 1869483 (0.0006) [2023-12-26 14:31:33,022][123090] Updated weights for policy 1, policy_version 1857833 (0.0006) [2023-12-26 14:31:33,088][123090] Updated weights for policy 1, policy_version 1857843 (0.0005) [2023-12-26 14:31:33,138][123091] Updated weights for policy 0, policy_version 1869493 (0.0005) [2023-12-26 14:31:33,157][123090] Updated weights for policy 1, policy_version 1857853 (0.0005) [2023-12-26 14:31:33,192][123091] Updated weights for policy 0, policy_version 1869503 (0.0007) [2023-12-26 14:31:33,250][123091] Updated weights for policy 0, policy_version 1869513 (0.0006) [2023-12-26 14:31:33,769][123090] Updated weights for policy 1, policy_version 1857863 (0.0008) [2023-12-26 14:31:33,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 954212352. Throughput: 0: 8769.1, 1: 8884.4. Samples: 954227848. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:33,785][121949] Avg episode reward: [(0, '6348.789'), (1, '5706.692')] [2023-12-26 14:31:33,822][123090] Updated weights for policy 1, policy_version 1857873 (0.0009) [2023-12-26 14:31:33,875][123090] Updated weights for policy 1, policy_version 1857883 (0.0009) [2023-12-26 14:31:33,929][123091] Updated weights for policy 0, policy_version 1869523 (0.0005) [2023-12-26 14:31:33,993][123091] Updated weights for policy 0, policy_version 1869533 (0.0006) [2023-12-26 14:31:34,050][123091] Updated weights for policy 0, policy_version 1869543 (0.0006) [2023-12-26 14:31:34,689][123090] Updated weights for policy 1, policy_version 1857893 (0.0007) [2023-12-26 14:31:34,752][123090] Updated weights for policy 1, policy_version 1857903 (0.0007) [2023-12-26 14:31:34,764][123091] Updated weights for policy 0, policy_version 1869553 (0.0005) [2023-12-26 14:31:34,813][123090] Updated weights for policy 1, policy_version 1857913 (0.0006) [2023-12-26 14:31:34,831][123091] Updated weights for policy 0, policy_version 1869563 (0.0006) [2023-12-26 14:31:34,893][123091] Updated weights for policy 0, policy_version 1869573 (0.0006) [2023-12-26 14:31:34,953][123091] Updated weights for policy 0, policy_version 1869583 (0.0005) [2023-12-26 14:31:35,446][123090] Updated weights for policy 1, policy_version 1857923 (0.0006) [2023-12-26 14:31:35,514][123090] Updated weights for policy 1, policy_version 1857933 (0.0005) [2023-12-26 14:31:35,587][123090] Updated weights for policy 1, policy_version 1857943 (0.0005) [2023-12-26 14:31:35,636][123091] Updated weights for policy 0, policy_version 1869593 (0.0006) [2023-12-26 14:31:35,699][123091] Updated weights for policy 0, policy_version 1869603 (0.0005) [2023-12-26 14:31:35,768][123091] Updated weights for policy 0, policy_version 1869613 (0.0005) [2023-12-26 14:31:36,339][123090] Updated weights for policy 1, policy_version 1857953 (0.0007) [2023-12-26 14:31:36,410][123090] Updated weights for policy 1, policy_version 1857963 (0.0011) [2023-12-26 14:31:36,473][123091] Updated weights for policy 0, policy_version 1869623 (0.0009) [2023-12-26 14:31:36,478][123090] Updated weights for policy 1, policy_version 1857973 (0.0011) [2023-12-26 14:31:36,527][123091] Updated weights for policy 0, policy_version 1869633 (0.0013) [2023-12-26 14:31:36,534][123090] Updated weights for policy 1, policy_version 1857983 (0.0011) [2023-12-26 14:31:36,587][123091] Updated weights for policy 0, policy_version 1869643 (0.0011) [2023-12-26 14:31:37,353][123090] Updated weights for policy 1, policy_version 1857993 (0.0011) [2023-12-26 14:31:37,370][123091] Updated weights for policy 0, policy_version 1869653 (0.0008) [2023-12-26 14:31:37,414][123090] Updated weights for policy 1, policy_version 1858003 (0.0011) [2023-12-26 14:31:37,436][123091] Updated weights for policy 0, policy_version 1869663 (0.0011) [2023-12-26 14:31:37,482][123090] Updated weights for policy 1, policy_version 1858013 (0.0008) [2023-12-26 14:31:37,507][123091] Updated weights for policy 0, policy_version 1869673 (0.0011) [2023-12-26 14:31:38,247][123091] Updated weights for policy 0, policy_version 1869683 (0.0009) [2023-12-26 14:31:38,295][123090] Updated weights for policy 1, policy_version 1858023 (0.0007) [2023-12-26 14:31:38,316][123091] Updated weights for policy 0, policy_version 1869693 (0.0006) [2023-12-26 14:31:38,365][123090] Updated weights for policy 1, policy_version 1858033 (0.0008) [2023-12-26 14:31:38,389][123091] Updated weights for policy 0, policy_version 1869703 (0.0010) [2023-12-26 14:31:38,427][123090] Updated weights for policy 1, policy_version 1858043 (0.0008) [2023-12-26 14:31:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 954310656. Throughput: 0: 8829.5, 1: 8928.1. Samples: 954284860. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:38,785][121949] Avg episode reward: [(0, '6372.852'), (1, '5915.293')] [2023-12-26 14:31:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001858048_475660288.pth... [2023-12-26 14:31:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001869712_478650368.pth... [2023-12-26 14:31:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001856992_475389952.pth [2023-12-26 14:31:38,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001868688_478388224.pth [2023-12-26 14:31:39,133][123090] Updated weights for policy 1, policy_version 1858053 (0.0007) [2023-12-26 14:31:39,142][123091] Updated weights for policy 0, policy_version 1869713 (0.0011) [2023-12-26 14:31:39,192][123090] Updated weights for policy 1, policy_version 1858063 (0.0008) [2023-12-26 14:31:39,209][123091] Updated weights for policy 0, policy_version 1869723 (0.0010) [2023-12-26 14:31:39,258][123090] Updated weights for policy 1, policy_version 1858073 (0.0008) [2023-12-26 14:31:39,277][123091] Updated weights for policy 0, policy_version 1869733 (0.0010) [2023-12-26 14:31:39,340][123091] Updated weights for policy 0, policy_version 1869743 (0.0010) [2023-12-26 14:31:40,025][123091] Updated weights for policy 0, policy_version 1869753 (0.0007) [2023-12-26 14:31:40,077][123091] Updated weights for policy 0, policy_version 1869763 (0.0011) [2023-12-26 14:31:40,129][123091] Updated weights for policy 0, policy_version 1869773 (0.0011) [2023-12-26 14:31:40,195][123090] Updated weights for policy 1, policy_version 1858083 (0.0010) [2023-12-26 14:31:40,261][123090] Updated weights for policy 1, policy_version 1858093 (0.0009) [2023-12-26 14:31:40,318][123090] Updated weights for policy 1, policy_version 1858103 (0.0009) [2023-12-26 14:31:40,978][123091] Updated weights for policy 0, policy_version 1869783 (0.0010) [2023-12-26 14:31:41,044][123091] Updated weights for policy 0, policy_version 1869793 (0.0010) [2023-12-26 14:31:41,108][123091] Updated weights for policy 0, policy_version 1869803 (0.0009) [2023-12-26 14:31:41,178][123090] Updated weights for policy 1, policy_version 1858113 (0.0009) [2023-12-26 14:31:41,255][123090] Updated weights for policy 1, policy_version 1858123 (0.0009) [2023-12-26 14:31:41,322][123090] Updated weights for policy 1, policy_version 1858133 (0.0009) [2023-12-26 14:31:41,400][123090] Updated weights for policy 1, policy_version 1858143 (0.0008) [2023-12-26 14:31:41,987][123091] Updated weights for policy 0, policy_version 1869813 (0.0008) [2023-12-26 14:31:42,045][123091] Updated weights for policy 0, policy_version 1869823 (0.0010) [2023-12-26 14:31:42,105][123091] Updated weights for policy 0, policy_version 1869833 (0.0010) [2023-12-26 14:31:42,165][123090] Updated weights for policy 1, policy_version 1858153 (0.0006) [2023-12-26 14:31:42,211][123090] Updated weights for policy 1, policy_version 1858163 (0.0006) [2023-12-26 14:31:42,259][123090] Updated weights for policy 1, policy_version 1858173 (0.0008) [2023-12-26 14:31:42,969][123091] Updated weights for policy 0, policy_version 1869843 (0.0009) [2023-12-26 14:31:43,025][123091] Updated weights for policy 0, policy_version 1869853 (0.0009) [2023-12-26 14:31:43,076][123091] Updated weights for policy 0, policy_version 1869863 (0.0009) [2023-12-26 14:31:43,108][123090] Updated weights for policy 1, policy_version 1858183 (0.0009) [2023-12-26 14:31:43,169][123090] Updated weights for policy 1, policy_version 1858193 (0.0009) [2023-12-26 14:31:43,230][123090] Updated weights for policy 1, policy_version 1858203 (0.0009) [2023-12-26 14:31:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 954392576. Throughput: 0: 8807.4, 1: 8882.6. Samples: 954388728. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:43,785][121949] Avg episode reward: [(0, '6294.616'), (1, '5861.373')] [2023-12-26 14:31:43,915][123091] Updated weights for policy 0, policy_version 1869873 (0.0006) [2023-12-26 14:31:43,975][123091] Updated weights for policy 0, policy_version 1869883 (0.0008) [2023-12-26 14:31:44,031][123090] Updated weights for policy 1, policy_version 1858213 (0.0009) [2023-12-26 14:31:44,033][123091] Updated weights for policy 0, policy_version 1869893 (0.0008) [2023-12-26 14:31:44,081][123091] Updated weights for policy 0, policy_version 1869903 (0.0006) [2023-12-26 14:31:44,082][123090] Updated weights for policy 1, policy_version 1858223 (0.0010) [2023-12-26 14:31:44,137][123090] Updated weights for policy 1, policy_version 1858233 (0.0010) [2023-12-26 14:31:44,892][123091] Updated weights for policy 0, policy_version 1869913 (0.0008) [2023-12-26 14:31:44,959][123091] Updated weights for policy 0, policy_version 1869923 (0.0011) [2023-12-26 14:31:44,992][123090] Updated weights for policy 1, policy_version 1858243 (0.0009) [2023-12-26 14:31:45,027][123091] Updated weights for policy 0, policy_version 1869933 (0.0011) [2023-12-26 14:31:45,060][123090] Updated weights for policy 1, policy_version 1858253 (0.0011) [2023-12-26 14:31:45,127][123090] Updated weights for policy 1, policy_version 1858263 (0.0010) [2023-12-26 14:31:45,803][123091] Updated weights for policy 0, policy_version 1869943 (0.0011) [2023-12-26 14:31:45,866][123091] Updated weights for policy 0, policy_version 1869953 (0.0011) [2023-12-26 14:31:45,930][123090] Updated weights for policy 1, policy_version 1858273 (0.0010) [2023-12-26 14:31:45,934][123091] Updated weights for policy 0, policy_version 1869963 (0.0011) [2023-12-26 14:31:45,998][123090] Updated weights for policy 1, policy_version 1858283 (0.0006) [2023-12-26 14:31:46,071][123090] Updated weights for policy 1, policy_version 1858293 (0.0006) [2023-12-26 14:31:46,142][123090] Updated weights for policy 1, policy_version 1858303 (0.0007) [2023-12-26 14:31:46,730][123091] Updated weights for policy 0, policy_version 1869973 (0.0011) [2023-12-26 14:31:46,793][123091] Updated weights for policy 0, policy_version 1869983 (0.0008) [2023-12-26 14:31:46,823][123090] Updated weights for policy 1, policy_version 1858313 (0.0006) [2023-12-26 14:31:46,862][123091] Updated weights for policy 0, policy_version 1869993 (0.0006) [2023-12-26 14:31:46,900][123090] Updated weights for policy 1, policy_version 1858323 (0.0005) [2023-12-26 14:31:46,978][123090] Updated weights for policy 1, policy_version 1858333 (0.0006) [2023-12-26 14:31:47,550][123091] Updated weights for policy 0, policy_version 1870003 (0.0006) [2023-12-26 14:31:47,609][123091] Updated weights for policy 0, policy_version 1870013 (0.0008) [2023-12-26 14:31:47,673][123091] Updated weights for policy 0, policy_version 1870023 (0.0008) [2023-12-26 14:31:47,716][123090] Updated weights for policy 1, policy_version 1858343 (0.0008) [2023-12-26 14:31:47,775][123090] Updated weights for policy 1, policy_version 1858353 (0.0009) [2023-12-26 14:31:47,834][123090] Updated weights for policy 1, policy_version 1858363 (0.0008) [2023-12-26 14:31:48,370][123091] Updated weights for policy 0, policy_version 1870033 (0.0008) [2023-12-26 14:31:48,438][123091] Updated weights for policy 0, policy_version 1870043 (0.0009) [2023-12-26 14:31:48,503][123091] Updated weights for policy 0, policy_version 1870053 (0.0009) [2023-12-26 14:31:48,554][123091] Updated weights for policy 0, policy_version 1870063 (0.0009) [2023-12-26 14:31:48,577][123090] Updated weights for policy 1, policy_version 1858373 (0.0008) [2023-12-26 14:31:48,628][123090] Updated weights for policy 1, policy_version 1858383 (0.0005) [2023-12-26 14:31:48,683][123090] Updated weights for policy 1, policy_version 1858393 (0.0006) [2023-12-26 14:31:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 954490880. Throughput: 0: 8831.7, 1: 8887.0. Samples: 954496512. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:48,784][121949] Avg episode reward: [(0, '6304.081'), (1, '6035.136')] [2023-12-26 14:31:49,377][123091] Updated weights for policy 0, policy_version 1870073 (0.0010) [2023-12-26 14:31:49,434][123091] Updated weights for policy 0, policy_version 1870083 (0.0010) [2023-12-26 14:31:49,489][123091] Updated weights for policy 0, policy_version 1870094 (0.0011) [2023-12-26 14:31:49,504][123090] Updated weights for policy 1, policy_version 1858403 (0.0008) [2023-12-26 14:31:49,565][123090] Updated weights for policy 1, policy_version 1858413 (0.0005) [2023-12-26 14:31:49,626][123090] Updated weights for policy 1, policy_version 1858423 (0.0006) [2023-12-26 14:31:50,385][123091] Updated weights for policy 0, policy_version 1870104 (0.0009) [2023-12-26 14:31:50,392][123090] Updated weights for policy 1, policy_version 1858433 (0.0007) [2023-12-26 14:31:50,446][123091] Updated weights for policy 0, policy_version 1870114 (0.0010) [2023-12-26 14:31:50,454][123090] Updated weights for policy 1, policy_version 1858443 (0.0007) [2023-12-26 14:31:50,503][123091] Updated weights for policy 0, policy_version 1870124 (0.0009) [2023-12-26 14:31:50,512][123090] Updated weights for policy 1, policy_version 1858453 (0.0009) [2023-12-26 14:31:50,579][123090] Updated weights for policy 1, policy_version 1858463 (0.0008) [2023-12-26 14:31:51,295][123091] Updated weights for policy 0, policy_version 1870134 (0.0010) [2023-12-26 14:31:51,345][123091] Updated weights for policy 0, policy_version 1870144 (0.0009) [2023-12-26 14:31:51,416][123091] Updated weights for policy 0, policy_version 1870154 (0.0008) [2023-12-26 14:31:51,417][123090] Updated weights for policy 1, policy_version 1858473 (0.0009) [2023-12-26 14:31:51,481][123090] Updated weights for policy 1, policy_version 1858483 (0.0009) [2023-12-26 14:31:51,547][123090] Updated weights for policy 1, policy_version 1858493 (0.0009) [2023-12-26 14:31:52,273][123091] Updated weights for policy 0, policy_version 1870164 (0.0008) [2023-12-26 14:31:52,332][123091] Updated weights for policy 0, policy_version 1870174 (0.0011) [2023-12-26 14:31:52,393][123090] Updated weights for policy 1, policy_version 1858503 (0.0008) [2023-12-26 14:31:52,399][123091] Updated weights for policy 0, policy_version 1870184 (0.0011) [2023-12-26 14:31:52,463][123090] Updated weights for policy 1, policy_version 1858513 (0.0008) [2023-12-26 14:31:52,521][123090] Updated weights for policy 1, policy_version 1858523 (0.0009) [2023-12-26 14:31:53,199][123091] Updated weights for policy 0, policy_version 1870194 (0.0011) [2023-12-26 14:31:53,261][123091] Updated weights for policy 0, policy_version 1870204 (0.0010) [2023-12-26 14:31:53,326][123091] Updated weights for policy 0, policy_version 1870214 (0.0006) [2023-12-26 14:31:53,356][123090] Updated weights for policy 1, policy_version 1858533 (0.0009) [2023-12-26 14:31:53,381][123091] Updated weights for policy 0, policy_version 1870224 (0.0006) [2023-12-26 14:31:53,414][123090] Updated weights for policy 1, policy_version 1858543 (0.0009) [2023-12-26 14:31:53,467][123090] Updated weights for policy 1, policy_version 1858553 (0.0010) [2023-12-26 14:31:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 954572800. Throughput: 0: 8821.6, 1: 8886.4. Samples: 954547940. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:53,785][121949] Avg episode reward: [(0, '6347.379'), (1, '6026.001')] [2023-12-26 14:31:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001858560_475791360.pth... [2023-12-26 14:31:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001870224_478781440.pth... [2023-12-26 14:31:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001857504_475521024.pth [2023-12-26 14:31:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001869200_478519296.pth [2023-12-26 14:31:54,012][123091] Updated weights for policy 0, policy_version 1870234 (0.0007) [2023-12-26 14:31:54,063][123091] Updated weights for policy 0, policy_version 1870244 (0.0010) [2023-12-26 14:31:54,114][123091] Updated weights for policy 0, policy_version 1870254 (0.0010) [2023-12-26 14:31:54,290][123090] Updated weights for policy 1, policy_version 1858563 (0.0009) [2023-12-26 14:31:54,354][123090] Updated weights for policy 1, policy_version 1858573 (0.0009) [2023-12-26 14:31:54,417][123090] Updated weights for policy 1, policy_version 1858583 (0.0009) [2023-12-26 14:31:54,925][123091] Updated weights for policy 0, policy_version 1870264 (0.0011) [2023-12-26 14:31:54,989][123091] Updated weights for policy 0, policy_version 1870274 (0.0011) [2023-12-26 14:31:55,052][123091] Updated weights for policy 0, policy_version 1870284 (0.0011) [2023-12-26 14:31:55,263][123090] Updated weights for policy 1, policy_version 1858593 (0.0009) [2023-12-26 14:31:55,332][123090] Updated weights for policy 1, policy_version 1858603 (0.0008) [2023-12-26 14:31:55,395][123090] Updated weights for policy 1, policy_version 1858613 (0.0009) [2023-12-26 14:31:55,462][123090] Updated weights for policy 1, policy_version 1858623 (0.0009) [2023-12-26 14:31:55,834][123091] Updated weights for policy 0, policy_version 1870294 (0.0008) [2023-12-26 14:31:55,884][123091] Updated weights for policy 0, policy_version 1870304 (0.0005) [2023-12-26 14:31:55,933][123091] Updated weights for policy 0, policy_version 1870314 (0.0006) [2023-12-26 14:31:56,243][123090] Updated weights for policy 1, policy_version 1858633 (0.0008) [2023-12-26 14:31:56,305][123090] Updated weights for policy 1, policy_version 1858643 (0.0009) [2023-12-26 14:31:56,373][123090] Updated weights for policy 1, policy_version 1858653 (0.0008) [2023-12-26 14:31:56,580][123091] Updated weights for policy 0, policy_version 1870324 (0.0005) [2023-12-26 14:31:56,628][123091] Updated weights for policy 0, policy_version 1870334 (0.0006) [2023-12-26 14:31:56,679][123091] Updated weights for policy 0, policy_version 1870344 (0.0006) [2023-12-26 14:31:57,033][123090] Updated weights for policy 1, policy_version 1858663 (0.0006) [2023-12-26 14:31:57,089][123090] Updated weights for policy 1, policy_version 1858673 (0.0005) [2023-12-26 14:31:57,150][123090] Updated weights for policy 1, policy_version 1858683 (0.0005) [2023-12-26 14:31:57,502][123091] Updated weights for policy 0, policy_version 1870354 (0.0006) [2023-12-26 14:31:57,567][123091] Updated weights for policy 0, policy_version 1870364 (0.0011) [2023-12-26 14:31:57,641][123091] Updated weights for policy 0, policy_version 1870374 (0.0010) [2023-12-26 14:31:57,700][123091] Updated weights for policy 0, policy_version 1870384 (0.0007) [2023-12-26 14:31:57,824][123090] Updated weights for policy 1, policy_version 1858693 (0.0005) [2023-12-26 14:31:57,872][123090] Updated weights for policy 1, policy_version 1858703 (0.0005) [2023-12-26 14:31:57,928][123090] Updated weights for policy 1, policy_version 1858713 (0.0005) [2023-12-26 14:31:58,413][123091] Updated weights for policy 0, policy_version 1870394 (0.0010) [2023-12-26 14:31:58,481][123091] Updated weights for policy 0, policy_version 1870404 (0.0012) [2023-12-26 14:31:58,549][123091] Updated weights for policy 0, policy_version 1870414 (0.0010) [2023-12-26 14:31:58,672][123090] Updated weights for policy 1, policy_version 1858723 (0.0006) [2023-12-26 14:31:58,746][123090] Updated weights for policy 1, policy_version 1858733 (0.0007) [2023-12-26 14:31:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 954662912. Throughput: 0: 8896.0, 1: 8923.5. Samples: 954657204. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:31:58,785][121949] Avg episode reward: [(0, '6386.270'), (1, '6037.268')] [2023-12-26 14:31:58,813][123090] Updated weights for policy 1, policy_version 1858743 (0.0008) [2023-12-26 14:31:59,363][123091] Updated weights for policy 0, policy_version 1870424 (0.0009) [2023-12-26 14:31:59,432][123091] Updated weights for policy 0, policy_version 1870434 (0.0011) [2023-12-26 14:31:59,497][123091] Updated weights for policy 0, policy_version 1870444 (0.0005) [2023-12-26 14:31:59,568][123090] Updated weights for policy 1, policy_version 1858753 (0.0007) [2023-12-26 14:31:59,631][123090] Updated weights for policy 1, policy_version 1858763 (0.0005) [2023-12-26 14:31:59,689][123090] Updated weights for policy 1, policy_version 1858773 (0.0005) [2023-12-26 14:31:59,746][123090] Updated weights for policy 1, policy_version 1858783 (0.0005) [2023-12-26 14:32:00,268][123091] Updated weights for policy 0, policy_version 1870454 (0.0008) [2023-12-26 14:32:00,326][123091] Updated weights for policy 0, policy_version 1870464 (0.0010) [2023-12-26 14:32:00,387][123091] Updated weights for policy 0, policy_version 1870474 (0.0009) [2023-12-26 14:32:00,414][123090] Updated weights for policy 1, policy_version 1858793 (0.0006) [2023-12-26 14:32:00,481][123090] Updated weights for policy 1, policy_version 1858803 (0.0005) [2023-12-26 14:32:00,536][123090] Updated weights for policy 1, policy_version 1858813 (0.0005) [2023-12-26 14:32:01,226][123090] Updated weights for policy 1, policy_version 1858823 (0.0008) [2023-12-26 14:32:01,252][123091] Updated weights for policy 0, policy_version 1870484 (0.0008) [2023-12-26 14:32:01,294][123090] Updated weights for policy 1, policy_version 1858833 (0.0008) [2023-12-26 14:32:01,312][123091] Updated weights for policy 0, policy_version 1870494 (0.0007) [2023-12-26 14:32:01,359][123090] Updated weights for policy 1, policy_version 1858843 (0.0009) [2023-12-26 14:32:01,374][123091] Updated weights for policy 0, policy_version 1870504 (0.0007) [2023-12-26 14:32:02,114][123091] Updated weights for policy 0, policy_version 1870514 (0.0008) [2023-12-26 14:32:02,178][123091] Updated weights for policy 0, policy_version 1870524 (0.0008) [2023-12-26 14:32:02,222][123090] Updated weights for policy 1, policy_version 1858853 (0.0008) [2023-12-26 14:32:02,241][123091] Updated weights for policy 0, policy_version 1870534 (0.0008) [2023-12-26 14:32:02,288][123090] Updated weights for policy 1, policy_version 1858863 (0.0008) [2023-12-26 14:32:02,304][123091] Updated weights for policy 0, policy_version 1870544 (0.0007) [2023-12-26 14:32:02,360][123090] Updated weights for policy 1, policy_version 1858873 (0.0009) [2023-12-26 14:32:03,035][123091] Updated weights for policy 0, policy_version 1870554 (0.0009) [2023-12-26 14:32:03,094][123091] Updated weights for policy 0, policy_version 1870564 (0.0009) [2023-12-26 14:32:03,145][123091] Updated weights for policy 0, policy_version 1870574 (0.0008) [2023-12-26 14:32:03,210][123090] Updated weights for policy 1, policy_version 1858883 (0.0008) [2023-12-26 14:32:03,257][123090] Updated weights for policy 1, policy_version 1858893 (0.0009) [2023-12-26 14:32:03,305][123090] Updated weights for policy 1, policy_version 1858903 (0.0008) [2023-12-26 14:32:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 954753024. Throughput: 0: 8851.5, 1: 8957.2. Samples: 954764844. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:03,784][121949] Avg episode reward: [(0, '6222.473'), (1, '6031.067')] [2023-12-26 14:32:03,960][123091] Updated weights for policy 0, policy_version 1870584 (0.0009) [2023-12-26 14:32:04,023][123091] Updated weights for policy 0, policy_version 1870594 (0.0010) [2023-12-26 14:32:04,080][123091] Updated weights for policy 0, policy_version 1870604 (0.0009) [2023-12-26 14:32:04,118][123090] Updated weights for policy 1, policy_version 1858913 (0.0009) [2023-12-26 14:32:04,188][123090] Updated weights for policy 1, policy_version 1858923 (0.0007) [2023-12-26 14:32:04,251][123090] Updated weights for policy 1, policy_version 1858933 (0.0010) [2023-12-26 14:32:04,302][123090] Updated weights for policy 1, policy_version 1858943 (0.0011) [2023-12-26 14:32:04,946][123091] Updated weights for policy 0, policy_version 1870614 (0.0009) [2023-12-26 14:32:04,998][123091] Updated weights for policy 0, policy_version 1870624 (0.0007) [2023-12-26 14:32:05,048][123091] Updated weights for policy 0, policy_version 1870634 (0.0009) [2023-12-26 14:32:05,094][123090] Updated weights for policy 1, policy_version 1858953 (0.0011) [2023-12-26 14:32:05,146][123090] Updated weights for policy 1, policy_version 1858963 (0.0010) [2023-12-26 14:32:05,189][123090] Updated weights for policy 1, policy_version 1858973 (0.0010) [2023-12-26 14:32:05,916][123091] Updated weights for policy 0, policy_version 1870644 (0.0007) [2023-12-26 14:32:05,948][123090] Updated weights for policy 1, policy_version 1858983 (0.0009) [2023-12-26 14:32:05,977][123091] Updated weights for policy 0, policy_version 1870654 (0.0007) [2023-12-26 14:32:06,002][123090] Updated weights for policy 1, policy_version 1858993 (0.0009) [2023-12-26 14:32:06,041][123091] Updated weights for policy 0, policy_version 1870664 (0.0008) [2023-12-26 14:32:06,052][123090] Updated weights for policy 1, policy_version 1859003 (0.0008) [2023-12-26 14:32:06,785][123091] Updated weights for policy 0, policy_version 1870674 (0.0010) [2023-12-26 14:32:06,844][123091] Updated weights for policy 0, policy_version 1870684 (0.0010) [2023-12-26 14:32:06,903][123091] Updated weights for policy 0, policy_version 1870694 (0.0009) [2023-12-26 14:32:06,914][123090] Updated weights for policy 1, policy_version 1859013 (0.0006) [2023-12-26 14:32:06,968][123091] Updated weights for policy 0, policy_version 1870704 (0.0006) [2023-12-26 14:32:06,980][123090] Updated weights for policy 1, policy_version 1859023 (0.0009) [2023-12-26 14:32:07,050][123090] Updated weights for policy 1, policy_version 1859033 (0.0010) [2023-12-26 14:32:07,765][123091] Updated weights for policy 0, policy_version 1870714 (0.0010) [2023-12-26 14:32:07,833][123091] Updated weights for policy 0, policy_version 1870724 (0.0010) [2023-12-26 14:32:07,867][123090] Updated weights for policy 1, policy_version 1859043 (0.0008) [2023-12-26 14:32:07,895][123091] Updated weights for policy 0, policy_version 1870734 (0.0006) [2023-12-26 14:32:07,918][123090] Updated weights for policy 1, policy_version 1859053 (0.0005) [2023-12-26 14:32:07,971][123090] Updated weights for policy 1, policy_version 1859063 (0.0005) [2023-12-26 14:32:08,735][123091] Updated weights for policy 0, policy_version 1870744 (0.0009) [2023-12-26 14:32:08,774][123090] Updated weights for policy 1, policy_version 1859073 (0.0005) [2023-12-26 14:32:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 954834944. Throughput: 0: 8878.3, 1: 8960.5. Samples: 954817888. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:08,785][121949] Avg episode reward: [(0, '6187.817'), (1, '5935.379')] [2023-12-26 14:32:08,794][123091] Updated weights for policy 0, policy_version 1870754 (0.0008) [2023-12-26 14:32:08,831][123090] Updated weights for policy 1, policy_version 1859083 (0.0008) [2023-12-26 14:32:08,855][123091] Updated weights for policy 0, policy_version 1870764 (0.0009) [2023-12-26 14:32:08,877][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001870768_478920704.pth... [2023-12-26 14:32:08,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001869712_478650368.pth [2023-12-26 14:32:08,884][123090] Updated weights for policy 1, policy_version 1859093 (0.0007) [2023-12-26 14:32:08,936][123090] Updated weights for policy 1, policy_version 1859103 (0.0010) [2023-12-26 14:32:08,940][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001859104_475930624.pth... [2023-12-26 14:32:08,943][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001858048_475660288.pth [2023-12-26 14:32:09,682][123091] Updated weights for policy 0, policy_version 1870774 (0.0009) [2023-12-26 14:32:09,745][123091] Updated weights for policy 0, policy_version 1870784 (0.0008) [2023-12-26 14:32:09,804][123090] Updated weights for policy 1, policy_version 1859113 (0.0008) [2023-12-26 14:32:09,808][123091] Updated weights for policy 0, policy_version 1870794 (0.0008) [2023-12-26 14:32:09,878][123090] Updated weights for policy 1, policy_version 1859123 (0.0008) [2023-12-26 14:32:09,948][123090] Updated weights for policy 1, policy_version 1859133 (0.0009) [2023-12-26 14:32:10,579][123091] Updated weights for policy 0, policy_version 1870804 (0.0007) [2023-12-26 14:32:10,644][123091] Updated weights for policy 0, policy_version 1870814 (0.0007) [2023-12-26 14:32:10,699][123091] Updated weights for policy 0, policy_version 1870824 (0.0009) [2023-12-26 14:32:10,816][123090] Updated weights for policy 1, policy_version 1859143 (0.0010) [2023-12-26 14:32:10,881][123090] Updated weights for policy 1, policy_version 1859153 (0.0009) [2023-12-26 14:32:10,943][123090] Updated weights for policy 1, policy_version 1859163 (0.0008) [2023-12-26 14:32:11,539][123091] Updated weights for policy 0, policy_version 1870834 (0.0009) [2023-12-26 14:32:11,598][123091] Updated weights for policy 0, policy_version 1870844 (0.0008) [2023-12-26 14:32:11,674][123091] Updated weights for policy 0, policy_version 1870854 (0.0007) [2023-12-26 14:32:11,741][123091] Updated weights for policy 0, policy_version 1870864 (0.0008) [2023-12-26 14:32:11,813][123090] Updated weights for policy 1, policy_version 1859173 (0.0009) [2023-12-26 14:32:11,880][123090] Updated weights for policy 1, policy_version 1859183 (0.0010) [2023-12-26 14:32:11,938][123090] Updated weights for policy 1, policy_version 1859193 (0.0009) [2023-12-26 14:32:12,531][123091] Updated weights for policy 0, policy_version 1870874 (0.0010) [2023-12-26 14:32:12,595][123091] Updated weights for policy 0, policy_version 1870884 (0.0009) [2023-12-26 14:32:12,659][123091] Updated weights for policy 0, policy_version 1870894 (0.0009) [2023-12-26 14:32:12,805][123090] Updated weights for policy 1, policy_version 1859203 (0.0010) [2023-12-26 14:32:12,859][123090] Updated weights for policy 1, policy_version 1859213 (0.0009) [2023-12-26 14:32:12,919][123090] Updated weights for policy 1, policy_version 1859223 (0.0010) [2023-12-26 14:32:13,433][123091] Updated weights for policy 0, policy_version 1870904 (0.0009) [2023-12-26 14:32:13,487][123091] Updated weights for policy 0, policy_version 1870914 (0.0009) [2023-12-26 14:32:13,561][123091] Updated weights for policy 0, policy_version 1870925 (0.0007) [2023-12-26 14:32:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 954925056. Throughput: 0: 8927.4, 1: 8883.2. Samples: 954920156. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:13,785][121949] Avg episode reward: [(0, '6265.290'), (1, '5930.223')] [2023-12-26 14:32:13,797][123090] Updated weights for policy 1, policy_version 1859233 (0.0009) [2023-12-26 14:32:13,856][123090] Updated weights for policy 1, policy_version 1859243 (0.0010) [2023-12-26 14:32:13,913][123090] Updated weights for policy 1, policy_version 1859253 (0.0010) [2023-12-26 14:32:13,964][123090] Updated weights for policy 1, policy_version 1859263 (0.0009) [2023-12-26 14:32:14,206][123091] Updated weights for policy 0, policy_version 1870935 (0.0008) [2023-12-26 14:32:14,259][123091] Updated weights for policy 0, policy_version 1870945 (0.0010) [2023-12-26 14:32:14,311][123091] Updated weights for policy 0, policy_version 1870955 (0.0009) [2023-12-26 14:32:14,827][123090] Updated weights for policy 1, policy_version 1859273 (0.0009) [2023-12-26 14:32:14,891][123090] Updated weights for policy 1, policy_version 1859283 (0.0009) [2023-12-26 14:32:14,955][123090] Updated weights for policy 1, policy_version 1859293 (0.0010) [2023-12-26 14:32:15,157][123091] Updated weights for policy 0, policy_version 1870965 (0.0009) [2023-12-26 14:32:15,220][123091] Updated weights for policy 0, policy_version 1870975 (0.0009) [2023-12-26 14:32:15,286][123091] Updated weights for policy 0, policy_version 1870985 (0.0009) [2023-12-26 14:32:15,781][123090] Updated weights for policy 1, policy_version 1859303 (0.0009) [2023-12-26 14:32:15,837][123090] Updated weights for policy 1, policy_version 1859313 (0.0010) [2023-12-26 14:32:15,893][123090] Updated weights for policy 1, policy_version 1859324 (0.0009) [2023-12-26 14:32:16,104][123091] Updated weights for policy 0, policy_version 1870995 (0.0009) [2023-12-26 14:32:16,165][123091] Updated weights for policy 0, policy_version 1871005 (0.0010) [2023-12-26 14:32:16,235][123091] Updated weights for policy 0, policy_version 1871015 (0.0006) [2023-12-26 14:32:16,754][123090] Updated weights for policy 1, policy_version 1859334 (0.0010) [2023-12-26 14:32:16,824][123090] Updated weights for policy 1, policy_version 1859344 (0.0008) [2023-12-26 14:32:16,894][123090] Updated weights for policy 1, policy_version 1859354 (0.0010) [2023-12-26 14:32:16,998][123091] Updated weights for policy 0, policy_version 1871025 (0.0006) [2023-12-26 14:32:17,055][123091] Updated weights for policy 0, policy_version 1871035 (0.0005) [2023-12-26 14:32:17,116][123091] Updated weights for policy 0, policy_version 1871045 (0.0005) [2023-12-26 14:32:17,178][123091] Updated weights for policy 0, policy_version 1871055 (0.0005) [2023-12-26 14:32:17,721][123090] Updated weights for policy 1, policy_version 1859364 (0.0009) [2023-12-26 14:32:17,781][123090] Updated weights for policy 1, policy_version 1859374 (0.0006) [2023-12-26 14:32:17,827][123090] Updated weights for policy 1, policy_version 1859384 (0.0010) [2023-12-26 14:32:17,910][123091] Updated weights for policy 0, policy_version 1871065 (0.0008) [2023-12-26 14:32:17,961][123091] Updated weights for policy 0, policy_version 1871075 (0.0009) [2023-12-26 14:32:18,016][123091] Updated weights for policy 0, policy_version 1871086 (0.0010) [2023-12-26 14:32:18,587][123090] Updated weights for policy 1, policy_version 1859394 (0.0009) [2023-12-26 14:32:18,643][123090] Updated weights for policy 1, policy_version 1859404 (0.0005) [2023-12-26 14:32:18,696][123090] Updated weights for policy 1, policy_version 1859414 (0.0006) [2023-12-26 14:32:18,758][123090] Updated weights for policy 1, policy_version 1859424 (0.0006) [2023-12-26 14:32:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 955015168. Throughput: 0: 8938.4, 1: 8790.6. Samples: 955025652. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:18,785][121949] Avg episode reward: [(0, '6402.734'), (1, '5896.448')] [2023-12-26 14:32:18,869][123091] Updated weights for policy 0, policy_version 1871096 (0.0010) [2023-12-26 14:32:18,932][123091] Updated weights for policy 0, policy_version 1871106 (0.0007) [2023-12-26 14:32:18,982][123091] Updated weights for policy 0, policy_version 1871116 (0.0005) [2023-12-26 14:32:19,540][123090] Updated weights for policy 1, policy_version 1859434 (0.0009) [2023-12-26 14:32:19,601][123090] Updated weights for policy 1, policy_version 1859444 (0.0009) [2023-12-26 14:32:19,655][123090] Updated weights for policy 1, policy_version 1859454 (0.0009) [2023-12-26 14:32:19,741][123091] Updated weights for policy 0, policy_version 1871126 (0.0008) [2023-12-26 14:32:19,799][123091] Updated weights for policy 0, policy_version 1871136 (0.0010) [2023-12-26 14:32:19,858][123091] Updated weights for policy 0, policy_version 1871146 (0.0010) [2023-12-26 14:32:20,425][123090] Updated weights for policy 1, policy_version 1859464 (0.0010) [2023-12-26 14:32:20,481][123090] Updated weights for policy 1, policy_version 1859474 (0.0010) [2023-12-26 14:32:20,534][123090] Updated weights for policy 1, policy_version 1859484 (0.0010) [2023-12-26 14:32:20,693][123091] Updated weights for policy 0, policy_version 1871156 (0.0009) [2023-12-26 14:32:20,763][123091] Updated weights for policy 0, policy_version 1871166 (0.0009) [2023-12-26 14:32:20,830][123091] Updated weights for policy 0, policy_version 1871176 (0.0009) [2023-12-26 14:32:21,377][123090] Updated weights for policy 1, policy_version 1859494 (0.0009) [2023-12-26 14:32:21,445][123090] Updated weights for policy 1, policy_version 1859504 (0.0006) [2023-12-26 14:32:21,515][123090] Updated weights for policy 1, policy_version 1859514 (0.0007) [2023-12-26 14:32:21,605][123091] Updated weights for policy 0, policy_version 1871186 (0.0007) [2023-12-26 14:32:21,675][123091] Updated weights for policy 0, policy_version 1871196 (0.0010) [2023-12-26 14:32:21,738][123091] Updated weights for policy 0, policy_version 1871206 (0.0010) [2023-12-26 14:32:21,809][123091] Updated weights for policy 0, policy_version 1871216 (0.0010) [2023-12-26 14:32:22,291][123090] Updated weights for policy 1, policy_version 1859524 (0.0009) [2023-12-26 14:32:22,354][123090] Updated weights for policy 1, policy_version 1859534 (0.0010) [2023-12-26 14:32:22,419][123090] Updated weights for policy 1, policy_version 1859544 (0.0011) [2023-12-26 14:32:22,691][123091] Updated weights for policy 0, policy_version 1871226 (0.0009) [2023-12-26 14:32:22,752][123091] Updated weights for policy 0, policy_version 1871236 (0.0009) [2023-12-26 14:32:22,816][123091] Updated weights for policy 0, policy_version 1871246 (0.0009) [2023-12-26 14:32:23,223][123090] Updated weights for policy 1, policy_version 1859554 (0.0009) [2023-12-26 14:32:23,270][123090] Updated weights for policy 1, policy_version 1859564 (0.0005) [2023-12-26 14:32:23,320][123090] Updated weights for policy 1, policy_version 1859574 (0.0005) [2023-12-26 14:32:23,370][123090] Updated weights for policy 1, policy_version 1859584 (0.0005) [2023-12-26 14:32:23,655][123091] Updated weights for policy 0, policy_version 1871256 (0.0009) [2023-12-26 14:32:23,713][123091] Updated weights for policy 0, policy_version 1871266 (0.0006) [2023-12-26 14:32:23,775][123091] Updated weights for policy 0, policy_version 1871276 (0.0007) [2023-12-26 14:32:23,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 955097088. Throughput: 0: 8873.5, 1: 8756.8. Samples: 955078224. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:23,785][121949] Avg episode reward: [(0, '6314.546'), (1, '5870.924')] [2023-12-26 14:32:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001859584_476053504.pth... [2023-12-26 14:32:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001858560_475791360.pth [2023-12-26 14:32:23,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001871280_479051776.pth... [2023-12-26 14:32:23,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001870224_478781440.pth [2023-12-26 14:32:24,215][123090] Updated weights for policy 1, policy_version 1859594 (0.0011) [2023-12-26 14:32:24,278][123090] Updated weights for policy 1, policy_version 1859604 (0.0010) [2023-12-26 14:32:24,333][123090] Updated weights for policy 1, policy_version 1859614 (0.0010) [2023-12-26 14:32:24,568][123091] Updated weights for policy 0, policy_version 1871286 (0.0009) [2023-12-26 14:32:24,627][123091] Updated weights for policy 0, policy_version 1871296 (0.0010) [2023-12-26 14:32:24,685][123091] Updated weights for policy 0, policy_version 1871306 (0.0010) [2023-12-26 14:32:25,147][123090] Updated weights for policy 1, policy_version 1859624 (0.0010) [2023-12-26 14:32:25,200][123090] Updated weights for policy 1, policy_version 1859634 (0.0006) [2023-12-26 14:32:25,257][123090] Updated weights for policy 1, policy_version 1859644 (0.0005) [2023-12-26 14:32:25,502][123091] Updated weights for policy 0, policy_version 1871316 (0.0010) [2023-12-26 14:32:25,560][123091] Updated weights for policy 0, policy_version 1871326 (0.0010) [2023-12-26 14:32:25,619][123091] Updated weights for policy 0, policy_version 1871336 (0.0011) [2023-12-26 14:32:25,909][123090] Updated weights for policy 1, policy_version 1859654 (0.0005) [2023-12-26 14:32:25,972][123090] Updated weights for policy 1, policy_version 1859664 (0.0005) [2023-12-26 14:32:26,033][123090] Updated weights for policy 1, policy_version 1859674 (0.0005) [2023-12-26 14:32:26,449][123091] Updated weights for policy 0, policy_version 1871346 (0.0011) [2023-12-26 14:32:26,499][123091] Updated weights for policy 0, policy_version 1871356 (0.0010) [2023-12-26 14:32:26,551][123091] Updated weights for policy 0, policy_version 1871366 (0.0009) [2023-12-26 14:32:26,606][123091] Updated weights for policy 0, policy_version 1871376 (0.0010) [2023-12-26 14:32:26,638][123090] Updated weights for policy 1, policy_version 1859684 (0.0005) [2023-12-26 14:32:26,690][123090] Updated weights for policy 1, policy_version 1859694 (0.0005) [2023-12-26 14:32:26,747][123090] Updated weights for policy 1, policy_version 1859704 (0.0007) [2023-12-26 14:32:27,426][123091] Updated weights for policy 0, policy_version 1871386 (0.0010) [2023-12-26 14:32:27,476][123091] Updated weights for policy 0, policy_version 1871396 (0.0010) [2023-12-26 14:32:27,523][123091] Updated weights for policy 0, policy_version 1871406 (0.0010) [2023-12-26 14:32:27,549][123090] Updated weights for policy 1, policy_version 1859714 (0.0010) [2023-12-26 14:32:27,601][123090] Updated weights for policy 1, policy_version 1859724 (0.0010) [2023-12-26 14:32:27,663][123090] Updated weights for policy 1, policy_version 1859734 (0.0008) [2023-12-26 14:32:27,726][123090] Updated weights for policy 1, policy_version 1859744 (0.0007) [2023-12-26 14:32:28,264][123091] Updated weights for policy 0, policy_version 1871416 (0.0006) [2023-12-26 14:32:28,337][123091] Updated weights for policy 0, policy_version 1871426 (0.0006) [2023-12-26 14:32:28,394][123091] Updated weights for policy 0, policy_version 1871436 (0.0009) [2023-12-26 14:32:28,412][123090] Updated weights for policy 1, policy_version 1859754 (0.0006) [2023-12-26 14:32:28,468][123090] Updated weights for policy 1, policy_version 1859764 (0.0006) [2023-12-26 14:32:28,522][123090] Updated weights for policy 1, policy_version 1859774 (0.0005) [2023-12-26 14:32:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 955195392. Throughput: 0: 8850.5, 1: 8850.6. Samples: 955185276. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:28,785][121949] Avg episode reward: [(0, '6272.182'), (1, '5990.489')] [2023-12-26 14:32:29,226][123090] Updated weights for policy 1, policy_version 1859784 (0.0009) [2023-12-26 14:32:29,275][123091] Updated weights for policy 0, policy_version 1871446 (0.0008) [2023-12-26 14:32:29,290][123090] Updated weights for policy 1, policy_version 1859794 (0.0009) [2023-12-26 14:32:29,341][123091] Updated weights for policy 0, policy_version 1871456 (0.0008) [2023-12-26 14:32:29,357][123090] Updated weights for policy 1, policy_version 1859804 (0.0009) [2023-12-26 14:32:29,410][123091] Updated weights for policy 0, policy_version 1871466 (0.0009) [2023-12-26 14:32:30,153][123090] Updated weights for policy 1, policy_version 1859814 (0.0008) [2023-12-26 14:32:30,207][123091] Updated weights for policy 0, policy_version 1871476 (0.0009) [2023-12-26 14:32:30,209][123090] Updated weights for policy 1, policy_version 1859824 (0.0009) [2023-12-26 14:32:30,261][123091] Updated weights for policy 0, policy_version 1871486 (0.0008) [2023-12-26 14:32:30,264][123090] Updated weights for policy 1, policy_version 1859834 (0.0008) [2023-12-26 14:32:30,322][123091] Updated weights for policy 0, policy_version 1871496 (0.0010) [2023-12-26 14:32:31,066][123091] Updated weights for policy 0, policy_version 1871506 (0.0009) [2023-12-26 14:32:31,111][123090] Updated weights for policy 1, policy_version 1859844 (0.0007) [2023-12-26 14:32:31,128][123091] Updated weights for policy 0, policy_version 1871516 (0.0010) [2023-12-26 14:32:31,178][123090] Updated weights for policy 1, policy_version 1859854 (0.0007) [2023-12-26 14:32:31,193][123091] Updated weights for policy 0, policy_version 1871526 (0.0009) [2023-12-26 14:32:31,243][123090] Updated weights for policy 1, policy_version 1859864 (0.0006) [2023-12-26 14:32:31,260][123091] Updated weights for policy 0, policy_version 1871536 (0.0008) [2023-12-26 14:32:32,065][123091] Updated weights for policy 0, policy_version 1871546 (0.0010) [2023-12-26 14:32:32,109][123090] Updated weights for policy 1, policy_version 1859874 (0.0009) [2023-12-26 14:32:32,130][123091] Updated weights for policy 0, policy_version 1871556 (0.0010) [2023-12-26 14:32:32,165][123090] Updated weights for policy 1, policy_version 1859884 (0.0011) [2023-12-26 14:32:32,186][123091] Updated weights for policy 0, policy_version 1871566 (0.0010) [2023-12-26 14:32:32,224][123090] Updated weights for policy 1, policy_version 1859894 (0.0010) [2023-12-26 14:32:32,279][123090] Updated weights for policy 1, policy_version 1859904 (0.0010) [2023-12-26 14:32:33,001][123091] Updated weights for policy 0, policy_version 1871576 (0.0010) [2023-12-26 14:32:33,068][123091] Updated weights for policy 0, policy_version 1871586 (0.0011) [2023-12-26 14:32:33,083][123090] Updated weights for policy 1, policy_version 1859914 (0.0005) [2023-12-26 14:32:33,130][123091] Updated weights for policy 0, policy_version 1871596 (0.0011) [2023-12-26 14:32:33,143][123090] Updated weights for policy 1, policy_version 1859924 (0.0005) [2023-12-26 14:32:33,194][123090] Updated weights for policy 1, policy_version 1859934 (0.0005) [2023-12-26 14:32:33,693][123091] Updated weights for policy 0, policy_version 1871606 (0.0007) [2023-12-26 14:32:33,763][123091] Updated weights for policy 0, policy_version 1871616 (0.0006) [2023-12-26 14:32:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 955277312. Throughput: 0: 8861.6, 1: 8878.5. Samples: 955294824. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:33,785][121949] Avg episode reward: [(0, '6200.048'), (1, '5973.116')] [2023-12-26 14:32:33,824][123091] Updated weights for policy 0, policy_version 1871626 (0.0010) [2023-12-26 14:32:33,903][123090] Updated weights for policy 1, policy_version 1859944 (0.0005) [2023-12-26 14:32:33,963][123090] Updated weights for policy 1, policy_version 1859954 (0.0005) [2023-12-26 14:32:34,012][123090] Updated weights for policy 1, policy_version 1859964 (0.0005) [2023-12-26 14:32:34,586][123091] Updated weights for policy 0, policy_version 1871636 (0.0011) [2023-12-26 14:32:34,635][123091] Updated weights for policy 0, policy_version 1871646 (0.0010) [2023-12-26 14:32:34,694][123091] Updated weights for policy 0, policy_version 1871656 (0.0011) [2023-12-26 14:32:34,714][123090] Updated weights for policy 1, policy_version 1859974 (0.0005) [2023-12-26 14:32:34,782][123090] Updated weights for policy 1, policy_version 1859984 (0.0006) [2023-12-26 14:32:34,842][123090] Updated weights for policy 1, policy_version 1859994 (0.0006) [2023-12-26 14:32:35,373][123091] Updated weights for policy 0, policy_version 1871666 (0.0010) [2023-12-26 14:32:35,415][123090] Updated weights for policy 1, policy_version 1860004 (0.0006) [2023-12-26 14:32:35,438][123091] Updated weights for policy 0, policy_version 1871676 (0.0010) [2023-12-26 14:32:35,474][123090] Updated weights for policy 1, policy_version 1860014 (0.0005) [2023-12-26 14:32:35,487][123091] Updated weights for policy 0, policy_version 1871686 (0.0011) [2023-12-26 14:32:35,535][123091] Updated weights for policy 0, policy_version 1871696 (0.0010) [2023-12-26 14:32:35,538][123090] Updated weights for policy 1, policy_version 1860024 (0.0005) [2023-12-26 14:32:36,186][123090] Updated weights for policy 1, policy_version 1860034 (0.0005) [2023-12-26 14:32:36,253][123090] Updated weights for policy 1, policy_version 1860044 (0.0006) [2023-12-26 14:32:36,279][123091] Updated weights for policy 0, policy_version 1871706 (0.0008) [2023-12-26 14:32:36,318][123090] Updated weights for policy 1, policy_version 1860054 (0.0006) [2023-12-26 14:32:36,339][123091] Updated weights for policy 0, policy_version 1871716 (0.0007) [2023-12-26 14:32:36,384][123090] Updated weights for policy 1, policy_version 1860064 (0.0006) [2023-12-26 14:32:36,406][123091] Updated weights for policy 0, policy_version 1871726 (0.0007) [2023-12-26 14:32:37,145][123091] Updated weights for policy 0, policy_version 1871736 (0.0006) [2023-12-26 14:32:37,149][123090] Updated weights for policy 1, policy_version 1860074 (0.0011) [2023-12-26 14:32:37,205][123091] Updated weights for policy 0, policy_version 1871746 (0.0005) [2023-12-26 14:32:37,208][123090] Updated weights for policy 1, policy_version 1860084 (0.0010) [2023-12-26 14:32:37,265][123091] Updated weights for policy 0, policy_version 1871756 (0.0006) [2023-12-26 14:32:37,274][123090] Updated weights for policy 1, policy_version 1860094 (0.0011) [2023-12-26 14:32:37,915][123091] Updated weights for policy 0, policy_version 1871766 (0.0005) [2023-12-26 14:32:37,974][123091] Updated weights for policy 0, policy_version 1871776 (0.0006) [2023-12-26 14:32:38,038][123091] Updated weights for policy 0, policy_version 1871786 (0.0007) [2023-12-26 14:32:38,104][123090] Updated weights for policy 1, policy_version 1860104 (0.0011) [2023-12-26 14:32:38,160][123090] Updated weights for policy 1, policy_version 1860114 (0.0011) [2023-12-26 14:32:38,212][123090] Updated weights for policy 1, policy_version 1860124 (0.0011) [2023-12-26 14:32:38,747][123091] Updated weights for policy 0, policy_version 1871796 (0.0008) [2023-12-26 14:32:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 955375616. Throughput: 0: 8925.0, 1: 8981.2. Samples: 955353716. Policy #0 lag: (min: 17.0, avg: 42.7, max: 49.0) [2023-12-26 14:32:38,785][121949] Avg episode reward: [(0, '6156.451'), (1, '5867.302')] [2023-12-26 14:32:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001860128_476192768.pth... [2023-12-26 14:32:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001859104_475930624.pth [2023-12-26 14:32:38,801][123091] Updated weights for policy 0, policy_version 1871806 (0.0009) [2023-12-26 14:32:38,862][123091] Updated weights for policy 0, policy_version 1871816 (0.0009) [2023-12-26 14:32:38,912][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001871824_479191040.pth... [2023-12-26 14:32:38,918][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001870768_478920704.pth [2023-12-26 14:32:39,069][123090] Updated weights for policy 1, policy_version 1860134 (0.0011) [2023-12-26 14:32:39,132][123090] Updated weights for policy 1, policy_version 1860144 (0.0011) [2023-12-26 14:32:39,198][123090] Updated weights for policy 1, policy_version 1860154 (0.0010) [2023-12-26 14:32:39,796][123091] Updated weights for policy 0, policy_version 1871826 (0.0008) [2023-12-26 14:32:39,862][123091] Updated weights for policy 0, policy_version 1871836 (0.0009) [2023-12-26 14:32:39,929][123091] Updated weights for policy 0, policy_version 1871846 (0.0009) [2023-12-26 14:32:39,987][123091] Updated weights for policy 0, policy_version 1871856 (0.0009) [2023-12-26 14:32:40,014][123090] Updated weights for policy 1, policy_version 1860164 (0.0008) [2023-12-26 14:32:40,085][123090] Updated weights for policy 1, policy_version 1860174 (0.0009) [2023-12-26 14:32:40,147][123090] Updated weights for policy 1, policy_version 1860184 (0.0009) [2023-12-26 14:32:40,849][123091] Updated weights for policy 0, policy_version 1871866 (0.0006) [2023-12-26 14:32:40,917][123091] Updated weights for policy 0, policy_version 1871876 (0.0006) [2023-12-26 14:32:40,983][123091] Updated weights for policy 0, policy_version 1871886 (0.0007) [2023-12-26 14:32:40,996][123090] Updated weights for policy 1, policy_version 1860194 (0.0009) [2023-12-26 14:32:41,063][123090] Updated weights for policy 1, policy_version 1860204 (0.0011) [2023-12-26 14:32:41,133][123090] Updated weights for policy 1, policy_version 1860214 (0.0011) [2023-12-26 14:32:41,190][123090] Updated weights for policy 1, policy_version 1860224 (0.0007) [2023-12-26 14:32:41,757][123091] Updated weights for policy 0, policy_version 1871896 (0.0008) [2023-12-26 14:32:41,823][123091] Updated weights for policy 0, policy_version 1871906 (0.0009) [2023-12-26 14:32:41,883][123091] Updated weights for policy 0, policy_version 1871916 (0.0009) [2023-12-26 14:32:42,061][123090] Updated weights for policy 1, policy_version 1860234 (0.0011) [2023-12-26 14:32:42,128][123090] Updated weights for policy 1, policy_version 1860244 (0.0011) [2023-12-26 14:32:42,200][123090] Updated weights for policy 1, policy_version 1860254 (0.0011) [2023-12-26 14:32:42,694][123091] Updated weights for policy 0, policy_version 1871926 (0.0008) [2023-12-26 14:32:42,756][123091] Updated weights for policy 0, policy_version 1871936 (0.0007) [2023-12-26 14:32:42,825][123091] Updated weights for policy 0, policy_version 1871946 (0.0009) [2023-12-26 14:32:43,033][123090] Updated weights for policy 1, policy_version 1860264 (0.0010) [2023-12-26 14:32:43,097][123090] Updated weights for policy 1, policy_version 1860274 (0.0011) [2023-12-26 14:32:43,145][123090] Updated weights for policy 1, policy_version 1860284 (0.0010) [2023-12-26 14:32:43,614][123091] Updated weights for policy 0, policy_version 1871956 (0.0009) [2023-12-26 14:32:43,666][123091] Updated weights for policy 0, policy_version 1871966 (0.0008) [2023-12-26 14:32:43,718][123091] Updated weights for policy 0, policy_version 1871976 (0.0008) [2023-12-26 14:32:43,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 955465728. Throughput: 0: 8876.4, 1: 8905.7. Samples: 955457396. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:32:43,785][121949] Avg episode reward: [(0, '6188.114'), (1, '5786.524')] [2023-12-26 14:32:43,981][123090] Updated weights for policy 1, policy_version 1860294 (0.0010) [2023-12-26 14:32:44,039][123090] Updated weights for policy 1, policy_version 1860304 (0.0010) [2023-12-26 14:32:44,103][123090] Updated weights for policy 1, policy_version 1860314 (0.0011) [2023-12-26 14:32:44,487][123091] Updated weights for policy 0, policy_version 1871986 (0.0009) [2023-12-26 14:32:44,549][123091] Updated weights for policy 0, policy_version 1871996 (0.0009) [2023-12-26 14:32:44,598][123091] Updated weights for policy 0, policy_version 1872006 (0.0009) [2023-12-26 14:32:44,656][123091] Updated weights for policy 0, policy_version 1872016 (0.0009) [2023-12-26 14:32:44,939][123090] Updated weights for policy 1, policy_version 1860324 (0.0010) [2023-12-26 14:32:45,007][123090] Updated weights for policy 1, policy_version 1860334 (0.0011) [2023-12-26 14:32:45,067][123090] Updated weights for policy 1, policy_version 1860344 (0.0011) [2023-12-26 14:32:45,473][123091] Updated weights for policy 0, policy_version 1872026 (0.0009) [2023-12-26 14:32:45,522][123091] Updated weights for policy 0, policy_version 1872036 (0.0008) [2023-12-26 14:32:45,570][123091] Updated weights for policy 0, policy_version 1872046 (0.0009) [2023-12-26 14:32:45,897][123090] Updated weights for policy 1, policy_version 1860354 (0.0011) [2023-12-26 14:32:45,981][123090] Updated weights for policy 1, policy_version 1860364 (0.0010) [2023-12-26 14:32:46,032][123090] Updated weights for policy 1, policy_version 1860374 (0.0010) [2023-12-26 14:32:46,084][123090] Updated weights for policy 1, policy_version 1860384 (0.0010) [2023-12-26 14:32:46,340][123091] Updated weights for policy 0, policy_version 1872056 (0.0009) [2023-12-26 14:32:46,389][123091] Updated weights for policy 0, policy_version 1872066 (0.0009) [2023-12-26 14:32:46,437][123091] Updated weights for policy 0, policy_version 1872076 (0.0009) [2023-12-26 14:32:46,896][123090] Updated weights for policy 1, policy_version 1860394 (0.0010) [2023-12-26 14:32:46,951][123090] Updated weights for policy 1, policy_version 1860404 (0.0010) [2023-12-26 14:32:47,005][123090] Updated weights for policy 1, policy_version 1860414 (0.0010) [2023-12-26 14:32:47,205][123091] Updated weights for policy 0, policy_version 1872086 (0.0006) [2023-12-26 14:32:47,254][123091] Updated weights for policy 0, policy_version 1872096 (0.0006) [2023-12-26 14:32:47,313][123091] Updated weights for policy 0, policy_version 1872106 (0.0005) [2023-12-26 14:32:47,844][123090] Updated weights for policy 1, policy_version 1860424 (0.0010) [2023-12-26 14:32:47,895][123090] Updated weights for policy 1, policy_version 1860434 (0.0010) [2023-12-26 14:32:47,947][123090] Updated weights for policy 1, policy_version 1860444 (0.0010) [2023-12-26 14:32:47,989][123091] Updated weights for policy 0, policy_version 1872116 (0.0005) [2023-12-26 14:32:48,042][123091] Updated weights for policy 0, policy_version 1872126 (0.0005) [2023-12-26 14:32:48,099][123091] Updated weights for policy 0, policy_version 1872136 (0.0005) [2023-12-26 14:32:48,689][123090] Updated weights for policy 1, policy_version 1860454 (0.0007) [2023-12-26 14:32:48,739][123091] Updated weights for policy 0, policy_version 1872146 (0.0006) [2023-12-26 14:32:48,746][123090] Updated weights for policy 1, policy_version 1860464 (0.0006) [2023-12-26 14:32:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 955547648. Throughput: 0: 8966.9, 1: 8834.7. Samples: 955565920. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:32:48,785][121949] Avg episode reward: [(0, '6218.522'), (1, '5751.374')] [2023-12-26 14:32:48,798][123091] Updated weights for policy 0, policy_version 1872156 (0.0009) [2023-12-26 14:32:48,806][123090] Updated weights for policy 1, policy_version 1860474 (0.0005) [2023-12-26 14:32:48,856][123091] Updated weights for policy 0, policy_version 1872166 (0.0005) [2023-12-26 14:32:48,911][123091] Updated weights for policy 0, policy_version 1872176 (0.0005) [2023-12-26 14:32:49,457][123090] Updated weights for policy 1, policy_version 1860484 (0.0007) [2023-12-26 14:32:49,509][123090] Updated weights for policy 1, policy_version 1860494 (0.0009) [2023-12-26 14:32:49,561][123090] Updated weights for policy 1, policy_version 1860505 (0.0009) [2023-12-26 14:32:49,715][123091] Updated weights for policy 0, policy_version 1872186 (0.0006) [2023-12-26 14:32:49,784][123091] Updated weights for policy 0, policy_version 1872196 (0.0005) [2023-12-26 14:32:49,861][123091] Updated weights for policy 0, policy_version 1872206 (0.0006) [2023-12-26 14:32:50,471][123090] Updated weights for policy 1, policy_version 1860515 (0.0008) [2023-12-26 14:32:50,521][123090] Updated weights for policy 1, policy_version 1860525 (0.0008) [2023-12-26 14:32:50,590][123090] Updated weights for policy 1, policy_version 1860535 (0.0008) [2023-12-26 14:32:50,598][123091] Updated weights for policy 0, policy_version 1872216 (0.0007) [2023-12-26 14:32:50,668][123091] Updated weights for policy 0, policy_version 1872226 (0.0006) [2023-12-26 14:32:50,736][123091] Updated weights for policy 0, policy_version 1872236 (0.0009) [2023-12-26 14:32:51,412][123090] Updated weights for policy 1, policy_version 1860545 (0.0008) [2023-12-26 14:32:51,475][123090] Updated weights for policy 1, policy_version 1860555 (0.0010) [2023-12-26 14:32:51,532][123091] Updated weights for policy 0, policy_version 1872246 (0.0007) [2023-12-26 14:32:51,546][123090] Updated weights for policy 1, policy_version 1860565 (0.0010) [2023-12-26 14:32:51,598][123091] Updated weights for policy 0, policy_version 1872256 (0.0007) [2023-12-26 14:32:51,610][123090] Updated weights for policy 1, policy_version 1860575 (0.0010) [2023-12-26 14:32:51,665][123091] Updated weights for policy 0, policy_version 1872266 (0.0008) [2023-12-26 14:32:52,400][123091] Updated weights for policy 0, policy_version 1872276 (0.0008) [2023-12-26 14:32:52,440][123090] Updated weights for policy 1, policy_version 1860585 (0.0008) [2023-12-26 14:32:52,467][123091] Updated weights for policy 0, policy_version 1872286 (0.0009) [2023-12-26 14:32:52,510][123090] Updated weights for policy 1, policy_version 1860595 (0.0007) [2023-12-26 14:32:52,530][123091] Updated weights for policy 0, policy_version 1872296 (0.0009) [2023-12-26 14:32:52,578][123090] Updated weights for policy 1, policy_version 1860605 (0.0008) [2023-12-26 14:32:53,262][123091] Updated weights for policy 0, policy_version 1872306 (0.0010) [2023-12-26 14:32:53,318][123091] Updated weights for policy 0, policy_version 1872316 (0.0006) [2023-12-26 14:32:53,377][123091] Updated weights for policy 0, policy_version 1872326 (0.0006) [2023-12-26 14:32:53,390][123090] Updated weights for policy 1, policy_version 1860615 (0.0006) [2023-12-26 14:32:53,438][123091] Updated weights for policy 0, policy_version 1872336 (0.0006) [2023-12-26 14:32:53,451][123090] Updated weights for policy 1, policy_version 1860625 (0.0005) [2023-12-26 14:32:53,497][123090] Updated weights for policy 1, policy_version 1860635 (0.0009) [2023-12-26 14:32:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 955645952. Throughput: 0: 8995.4, 1: 8812.4. Samples: 955619236. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:32:53,784][121949] Avg episode reward: [(0, '6204.068'), (1, '5838.968')] [2023-12-26 14:32:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001860640_476323840.pth... [2023-12-26 14:32:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001872336_479322112.pth... [2023-12-26 14:32:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001859584_476053504.pth [2023-12-26 14:32:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001871280_479051776.pth [2023-12-26 14:32:54,123][123091] Updated weights for policy 0, policy_version 1872347 (0.0007) [2023-12-26 14:32:54,187][123091] Updated weights for policy 0, policy_version 1872357 (0.0006) [2023-12-26 14:32:54,237][123090] Updated weights for policy 1, policy_version 1860645 (0.0008) [2023-12-26 14:32:54,251][123091] Updated weights for policy 0, policy_version 1872367 (0.0006) [2023-12-26 14:32:54,310][123090] Updated weights for policy 1, policy_version 1860655 (0.0005) [2023-12-26 14:32:54,372][123090] Updated weights for policy 1, policy_version 1860665 (0.0005) [2023-12-26 14:32:55,078][123091] Updated weights for policy 0, policy_version 1872377 (0.0010) [2023-12-26 14:32:55,106][123090] Updated weights for policy 1, policy_version 1860675 (0.0009) [2023-12-26 14:32:55,137][123091] Updated weights for policy 0, policy_version 1872387 (0.0009) [2023-12-26 14:32:55,172][123090] Updated weights for policy 1, policy_version 1860685 (0.0005) [2023-12-26 14:32:55,188][123091] Updated weights for policy 0, policy_version 1872397 (0.0009) [2023-12-26 14:32:55,237][123090] Updated weights for policy 1, policy_version 1860695 (0.0009) [2023-12-26 14:32:55,950][123091] Updated weights for policy 0, policy_version 1872407 (0.0006) [2023-12-26 14:32:56,007][123091] Updated weights for policy 0, policy_version 1872417 (0.0005) [2023-12-26 14:32:56,022][123090] Updated weights for policy 1, policy_version 1860705 (0.0010) [2023-12-26 14:32:56,060][123091] Updated weights for policy 0, policy_version 1872427 (0.0005) [2023-12-26 14:32:56,071][123090] Updated weights for policy 1, policy_version 1860715 (0.0009) [2023-12-26 14:32:56,131][123090] Updated weights for policy 1, policy_version 1860725 (0.0009) [2023-12-26 14:32:56,194][123090] Updated weights for policy 1, policy_version 1860735 (0.0009) [2023-12-26 14:32:56,722][123091] Updated weights for policy 0, policy_version 1872437 (0.0007) [2023-12-26 14:32:56,781][123091] Updated weights for policy 0, policy_version 1872447 (0.0009) [2023-12-26 14:32:56,840][123091] Updated weights for policy 0, policy_version 1872457 (0.0009) [2023-12-26 14:32:57,009][123090] Updated weights for policy 1, policy_version 1860745 (0.0009) [2023-12-26 14:32:57,069][123090] Updated weights for policy 1, policy_version 1860756 (0.0009) [2023-12-26 14:32:57,122][123090] Updated weights for policy 1, policy_version 1860766 (0.0009) [2023-12-26 14:32:57,687][123091] Updated weights for policy 0, policy_version 1872467 (0.0009) [2023-12-26 14:32:57,742][123091] Updated weights for policy 0, policy_version 1872477 (0.0010) [2023-12-26 14:32:57,792][123091] Updated weights for policy 0, policy_version 1872488 (0.0010) [2023-12-26 14:32:57,898][123090] Updated weights for policy 1, policy_version 1860776 (0.0006) [2023-12-26 14:32:57,951][123090] Updated weights for policy 1, policy_version 1860786 (0.0005) [2023-12-26 14:32:58,009][123090] Updated weights for policy 1, policy_version 1860796 (0.0005) [2023-12-26 14:32:58,643][123091] Updated weights for policy 0, policy_version 1872498 (0.0009) [2023-12-26 14:32:58,712][123091] Updated weights for policy 0, policy_version 1872508 (0.0008) [2023-12-26 14:32:58,773][123091] Updated weights for policy 0, policy_version 1872518 (0.0009) [2023-12-26 14:32:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 955727872. Throughput: 0: 9068.1, 1: 8887.5. Samples: 955728156. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:32:58,785][121949] Avg episode reward: [(0, '6262.057'), (1, '5841.609')] [2023-12-26 14:32:58,840][123091] Updated weights for policy 0, policy_version 1872528 (0.0008) [2023-12-26 14:32:58,847][123090] Updated weights for policy 1, policy_version 1860806 (0.0008) [2023-12-26 14:32:58,912][123090] Updated weights for policy 1, policy_version 1860816 (0.0010) [2023-12-26 14:32:58,970][123090] Updated weights for policy 1, policy_version 1860826 (0.0010) [2023-12-26 14:32:59,624][123091] Updated weights for policy 0, policy_version 1872538 (0.0006) [2023-12-26 14:32:59,677][123091] Updated weights for policy 0, policy_version 1872548 (0.0007) [2023-12-26 14:32:59,730][123091] Updated weights for policy 0, policy_version 1872558 (0.0009) [2023-12-26 14:32:59,759][123090] Updated weights for policy 1, policy_version 1860836 (0.0010) [2023-12-26 14:32:59,830][123090] Updated weights for policy 1, policy_version 1860846 (0.0010) [2023-12-26 14:32:59,900][123090] Updated weights for policy 1, policy_version 1860856 (0.0009) [2023-12-26 14:33:00,543][123091] Updated weights for policy 0, policy_version 1872568 (0.0010) [2023-12-26 14:33:00,609][123091] Updated weights for policy 0, policy_version 1872578 (0.0010) [2023-12-26 14:33:00,674][123091] Updated weights for policy 0, policy_version 1872588 (0.0009) [2023-12-26 14:33:00,726][123090] Updated weights for policy 1, policy_version 1860866 (0.0009) [2023-12-26 14:33:00,783][123090] Updated weights for policy 1, policy_version 1860876 (0.0009) [2023-12-26 14:33:00,837][123090] Updated weights for policy 1, policy_version 1860886 (0.0008) [2023-12-26 14:33:00,886][123090] Updated weights for policy 1, policy_version 1860896 (0.0008) [2023-12-26 14:33:01,504][123091] Updated weights for policy 0, policy_version 1872598 (0.0010) [2023-12-26 14:33:01,570][123091] Updated weights for policy 0, policy_version 1872608 (0.0011) [2023-12-26 14:33:01,634][123091] Updated weights for policy 0, policy_version 1872618 (0.0011) [2023-12-26 14:33:01,749][123090] Updated weights for policy 1, policy_version 1860906 (0.0008) [2023-12-26 14:33:01,831][123090] Updated weights for policy 1, policy_version 1860916 (0.0005) [2023-12-26 14:33:01,888][123090] Updated weights for policy 1, policy_version 1860926 (0.0005) [2023-12-26 14:33:02,298][123091] Updated weights for policy 0, policy_version 1872628 (0.0010) [2023-12-26 14:33:02,363][123091] Updated weights for policy 0, policy_version 1872638 (0.0010) [2023-12-26 14:33:02,447][123091] Updated weights for policy 0, policy_version 1872648 (0.0011) [2023-12-26 14:33:02,567][123090] Updated weights for policy 1, policy_version 1860936 (0.0008) [2023-12-26 14:33:02,614][123090] Updated weights for policy 1, policy_version 1860946 (0.0008) [2023-12-26 14:33:02,671][123090] Updated weights for policy 1, policy_version 1860956 (0.0009) [2023-12-26 14:33:03,245][123091] Updated weights for policy 0, policy_version 1872658 (0.0011) [2023-12-26 14:33:03,292][123091] Updated weights for policy 0, policy_version 1872668 (0.0010) [2023-12-26 14:33:03,353][123091] Updated weights for policy 0, policy_version 1872678 (0.0010) [2023-12-26 14:33:03,423][123091] Updated weights for policy 0, policy_version 1872688 (0.0011) [2023-12-26 14:33:03,523][123090] Updated weights for policy 1, policy_version 1860966 (0.0009) [2023-12-26 14:33:03,583][123090] Updated weights for policy 1, policy_version 1860976 (0.0009) [2023-12-26 14:33:03,635][123090] Updated weights for policy 1, policy_version 1860986 (0.0008) [2023-12-26 14:33:03,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 955826176. Throughput: 0: 9031.9, 1: 8927.9. Samples: 955833844. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:03,785][121949] Avg episode reward: [(0, '6305.436'), (1, '6006.198')] [2023-12-26 14:33:04,258][123091] Updated weights for policy 0, policy_version 1872698 (0.0010) [2023-12-26 14:33:04,326][123091] Updated weights for policy 0, policy_version 1872708 (0.0011) [2023-12-26 14:33:04,385][123091] Updated weights for policy 0, policy_version 1872718 (0.0011) [2023-12-26 14:33:04,503][123090] Updated weights for policy 1, policy_version 1860996 (0.0009) [2023-12-26 14:33:04,566][123090] Updated weights for policy 1, policy_version 1861006 (0.0008) [2023-12-26 14:33:04,628][123090] Updated weights for policy 1, policy_version 1861016 (0.0009) [2023-12-26 14:33:05,206][123091] Updated weights for policy 0, policy_version 1872728 (0.0011) [2023-12-26 14:33:05,253][123091] Updated weights for policy 0, policy_version 1872738 (0.0010) [2023-12-26 14:33:05,312][123091] Updated weights for policy 0, policy_version 1872748 (0.0010) [2023-12-26 14:33:05,463][123090] Updated weights for policy 1, policy_version 1861026 (0.0009) [2023-12-26 14:33:05,510][123090] Updated weights for policy 1, policy_version 1861036 (0.0008) [2023-12-26 14:33:05,566][123090] Updated weights for policy 1, policy_version 1861046 (0.0009) [2023-12-26 14:33:05,621][123090] Updated weights for policy 1, policy_version 1861056 (0.0009) [2023-12-26 14:33:06,153][123091] Updated weights for policy 0, policy_version 1872758 (0.0010) [2023-12-26 14:33:06,225][123091] Updated weights for policy 0, policy_version 1872768 (0.0011) [2023-12-26 14:33:06,285][123091] Updated weights for policy 0, policy_version 1872778 (0.0011) [2023-12-26 14:33:06,497][123090] Updated weights for policy 1, policy_version 1861066 (0.0011) [2023-12-26 14:33:06,569][123090] Updated weights for policy 1, policy_version 1861076 (0.0011) [2023-12-26 14:33:06,634][123090] Updated weights for policy 1, policy_version 1861086 (0.0011) [2023-12-26 14:33:07,115][123091] Updated weights for policy 0, policy_version 1872788 (0.0011) [2023-12-26 14:33:07,167][123091] Updated weights for policy 0, policy_version 1872798 (0.0011) [2023-12-26 14:33:07,215][123091] Updated weights for policy 0, policy_version 1872808 (0.0011) [2023-12-26 14:33:07,353][123090] Updated weights for policy 1, policy_version 1861096 (0.0006) [2023-12-26 14:33:07,406][123090] Updated weights for policy 1, policy_version 1861106 (0.0005) [2023-12-26 14:33:07,465][123090] Updated weights for policy 1, policy_version 1861116 (0.0005) [2023-12-26 14:33:08,052][123091] Updated weights for policy 0, policy_version 1872818 (0.0011) [2023-12-26 14:33:08,086][123090] Updated weights for policy 1, policy_version 1861126 (0.0008) [2023-12-26 14:33:08,111][123091] Updated weights for policy 0, policy_version 1872828 (0.0010) [2023-12-26 14:33:08,138][123090] Updated weights for policy 1, policy_version 1861136 (0.0010) [2023-12-26 14:33:08,163][123091] Updated weights for policy 0, policy_version 1872838 (0.0010) [2023-12-26 14:33:08,197][123090] Updated weights for policy 1, policy_version 1861146 (0.0007) [2023-12-26 14:33:08,233][123091] Updated weights for policy 0, policy_version 1872848 (0.0011) [2023-12-26 14:33:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 955908096. Throughput: 0: 9010.7, 1: 8906.6. Samples: 955884500. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:08,785][121949] Avg episode reward: [(0, '6338.815'), (1, '6100.145')] [2023-12-26 14:33:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001872848_479453184.pth... [2023-12-26 14:33:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001861152_476454912.pth... [2023-12-26 14:33:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001871824_479191040.pth [2023-12-26 14:33:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001860128_476192768.pth [2023-12-26 14:33:08,898][123090] Updated weights for policy 1, policy_version 1861156 (0.0005) [2023-12-26 14:33:08,956][123090] Updated weights for policy 1, policy_version 1861166 (0.0006) [2023-12-26 14:33:09,018][123090] Updated weights for policy 1, policy_version 1861176 (0.0008) [2023-12-26 14:33:09,049][123091] Updated weights for policy 0, policy_version 1872858 (0.0007) [2023-12-26 14:33:09,106][123091] Updated weights for policy 0, policy_version 1872868 (0.0007) [2023-12-26 14:33:09,162][123091] Updated weights for policy 0, policy_version 1872878 (0.0006) [2023-12-26 14:33:09,810][123090] Updated weights for policy 1, policy_version 1861186 (0.0009) [2023-12-26 14:33:09,881][123090] Updated weights for policy 1, policy_version 1861196 (0.0009) [2023-12-26 14:33:09,955][123090] Updated weights for policy 1, policy_version 1861206 (0.0008) [2023-12-26 14:33:09,979][123091] Updated weights for policy 0, policy_version 1872888 (0.0008) [2023-12-26 14:33:10,025][123090] Updated weights for policy 1, policy_version 1861216 (0.0008) [2023-12-26 14:33:10,043][123091] Updated weights for policy 0, policy_version 1872898 (0.0008) [2023-12-26 14:33:10,107][123091] Updated weights for policy 0, policy_version 1872908 (0.0009) [2023-12-26 14:33:10,859][123090] Updated weights for policy 1, policy_version 1861226 (0.0008) [2023-12-26 14:33:10,921][123090] Updated weights for policy 1, policy_version 1861236 (0.0010) [2023-12-26 14:33:10,965][123091] Updated weights for policy 0, policy_version 1872918 (0.0009) [2023-12-26 14:33:10,973][123090] Updated weights for policy 1, policy_version 1861246 (0.0008) [2023-12-26 14:33:11,043][123091] Updated weights for policy 0, policy_version 1872928 (0.0019) [2023-12-26 14:33:11,104][123091] Updated weights for policy 0, policy_version 1872938 (0.0009) [2023-12-26 14:33:11,820][123090] Updated weights for policy 1, policy_version 1861256 (0.0008) [2023-12-26 14:33:11,881][123090] Updated weights for policy 1, policy_version 1861266 (0.0005) [2023-12-26 14:33:11,953][123090] Updated weights for policy 1, policy_version 1861276 (0.0005) [2023-12-26 14:33:12,016][123091] Updated weights for policy 0, policy_version 1872948 (0.0009) [2023-12-26 14:33:12,085][123091] Updated weights for policy 0, policy_version 1872958 (0.0006) [2023-12-26 14:33:12,139][123091] Updated weights for policy 0, policy_version 1872968 (0.0010) [2023-12-26 14:33:12,647][123090] Updated weights for policy 1, policy_version 1861286 (0.0008) [2023-12-26 14:33:12,713][123090] Updated weights for policy 1, policy_version 1861296 (0.0008) [2023-12-26 14:33:12,779][123090] Updated weights for policy 1, policy_version 1861306 (0.0009) [2023-12-26 14:33:12,970][123091] Updated weights for policy 0, policy_version 1872978 (0.0009) [2023-12-26 14:33:13,038][123091] Updated weights for policy 0, policy_version 1872988 (0.0010) [2023-12-26 14:33:13,103][123091] Updated weights for policy 0, policy_version 1872998 (0.0009) [2023-12-26 14:33:13,167][123091] Updated weights for policy 0, policy_version 1873008 (0.0010) [2023-12-26 14:33:13,568][123090] Updated weights for policy 1, policy_version 1861316 (0.0009) [2023-12-26 14:33:13,628][123090] Updated weights for policy 1, policy_version 1861326 (0.0009) [2023-12-26 14:33:13,683][123090] Updated weights for policy 1, policy_version 1861336 (0.0009) [2023-12-26 14:33:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 955998208. Throughput: 0: 8991.9, 1: 8899.0. Samples: 955990368. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:13,785][121949] Avg episode reward: [(0, '6243.139'), (1, '6091.125')] [2023-12-26 14:33:13,964][123091] Updated weights for policy 0, policy_version 1873018 (0.0005) [2023-12-26 14:33:14,024][123091] Updated weights for policy 0, policy_version 1873028 (0.0005) [2023-12-26 14:33:14,075][123091] Updated weights for policy 0, policy_version 1873038 (0.0006) [2023-12-26 14:33:14,451][123090] Updated weights for policy 1, policy_version 1861346 (0.0009) [2023-12-26 14:33:14,505][123090] Updated weights for policy 1, policy_version 1861356 (0.0010) [2023-12-26 14:33:14,560][123090] Updated weights for policy 1, policy_version 1861367 (0.0010) [2023-12-26 14:33:14,746][123091] Updated weights for policy 0, policy_version 1873048 (0.0005) [2023-12-26 14:33:14,808][123091] Updated weights for policy 0, policy_version 1873058 (0.0006) [2023-12-26 14:33:14,873][123091] Updated weights for policy 0, policy_version 1873068 (0.0006) [2023-12-26 14:33:15,453][123091] Updated weights for policy 0, policy_version 1873078 (0.0007) [2023-12-26 14:33:15,522][123090] Updated weights for policy 1, policy_version 1861377 (0.0010) [2023-12-26 14:33:15,526][123091] Updated weights for policy 0, policy_version 1873088 (0.0009) [2023-12-26 14:33:15,572][123090] Updated weights for policy 1, policy_version 1861387 (0.0007) [2023-12-26 14:33:15,582][123091] Updated weights for policy 0, policy_version 1873098 (0.0011) [2023-12-26 14:33:15,627][123090] Updated weights for policy 1, policy_version 1861397 (0.0009) [2023-12-26 14:33:15,678][123090] Updated weights for policy 1, policy_version 1861407 (0.0009) [2023-12-26 14:33:16,361][123091] Updated weights for policy 0, policy_version 1873108 (0.0010) [2023-12-26 14:33:16,426][123091] Updated weights for policy 0, policy_version 1873118 (0.0009) [2023-12-26 14:33:16,488][123091] Updated weights for policy 0, policy_version 1873128 (0.0009) [2023-12-26 14:33:16,526][123090] Updated weights for policy 1, policy_version 1861417 (0.0009) [2023-12-26 14:33:16,589][123090] Updated weights for policy 1, policy_version 1861427 (0.0009) [2023-12-26 14:33:16,650][123090] Updated weights for policy 1, policy_version 1861437 (0.0009) [2023-12-26 14:33:17,283][123091] Updated weights for policy 0, policy_version 1873138 (0.0008) [2023-12-26 14:33:17,350][123091] Updated weights for policy 0, policy_version 1873148 (0.0009) [2023-12-26 14:33:17,418][123091] Updated weights for policy 0, policy_version 1873158 (0.0009) [2023-12-26 14:33:17,483][123091] Updated weights for policy 0, policy_version 1873168 (0.0009) [2023-12-26 14:33:17,530][123090] Updated weights for policy 1, policy_version 1861447 (0.0010) [2023-12-26 14:33:17,584][123090] Updated weights for policy 1, policy_version 1861457 (0.0009) [2023-12-26 14:33:17,649][123090] Updated weights for policy 1, policy_version 1861467 (0.0010) [2023-12-26 14:33:18,318][123091] Updated weights for policy 0, policy_version 1873178 (0.0010) [2023-12-26 14:33:18,385][123091] Updated weights for policy 0, policy_version 1873188 (0.0009) [2023-12-26 14:33:18,446][123091] Updated weights for policy 0, policy_version 1873198 (0.0010) [2023-12-26 14:33:18,454][123090] Updated weights for policy 1, policy_version 1861477 (0.0008) [2023-12-26 14:33:18,508][123090] Updated weights for policy 1, policy_version 1861487 (0.0009) [2023-12-26 14:33:18,566][123090] Updated weights for policy 1, policy_version 1861497 (0.0009) [2023-12-26 14:33:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 956088320. Throughput: 0: 9011.8, 1: 8786.4. Samples: 956095744. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:18,785][121949] Avg episode reward: [(0, '6251.465'), (1, '6080.333')] [2023-12-26 14:33:19,329][123091] Updated weights for policy 0, policy_version 1873208 (0.0008) [2023-12-26 14:33:19,388][123090] Updated weights for policy 1, policy_version 1861507 (0.0009) [2023-12-26 14:33:19,395][123091] Updated weights for policy 0, policy_version 1873218 (0.0009) [2023-12-26 14:33:19,448][123090] Updated weights for policy 1, policy_version 1861517 (0.0010) [2023-12-26 14:33:19,455][123091] Updated weights for policy 0, policy_version 1873228 (0.0007) [2023-12-26 14:33:19,509][123090] Updated weights for policy 1, policy_version 1861527 (0.0010) [2023-12-26 14:33:20,312][123091] Updated weights for policy 0, policy_version 1873238 (0.0009) [2023-12-26 14:33:20,358][123090] Updated weights for policy 1, policy_version 1861537 (0.0009) [2023-12-26 14:33:20,385][123091] Updated weights for policy 0, policy_version 1873248 (0.0010) [2023-12-26 14:33:20,422][123090] Updated weights for policy 1, policy_version 1861547 (0.0009) [2023-12-26 14:33:20,446][123091] Updated weights for policy 0, policy_version 1873258 (0.0008) [2023-12-26 14:33:20,484][123090] Updated weights for policy 1, policy_version 1861557 (0.0008) [2023-12-26 14:33:20,539][123090] Updated weights for policy 1, policy_version 1861567 (0.0010) [2023-12-26 14:33:21,207][123091] Updated weights for policy 0, policy_version 1873268 (0.0009) [2023-12-26 14:33:21,271][123091] Updated weights for policy 0, policy_version 1873278 (0.0010) [2023-12-26 14:33:21,335][123091] Updated weights for policy 0, policy_version 1873288 (0.0010) [2023-12-26 14:33:21,428][123090] Updated weights for policy 1, policy_version 1861577 (0.0008) [2023-12-26 14:33:21,483][123090] Updated weights for policy 1, policy_version 1861587 (0.0009) [2023-12-26 14:33:21,540][123090] Updated weights for policy 1, policy_version 1861597 (0.0010) [2023-12-26 14:33:22,094][123091] Updated weights for policy 0, policy_version 1873298 (0.0008) [2023-12-26 14:33:22,167][123091] Updated weights for policy 0, policy_version 1873308 (0.0006) [2023-12-26 14:33:22,228][123091] Updated weights for policy 0, policy_version 1873318 (0.0008) [2023-12-26 14:33:22,295][123091] Updated weights for policy 0, policy_version 1873328 (0.0010) [2023-12-26 14:33:22,421][123090] Updated weights for policy 1, policy_version 1861607 (0.0007) [2023-12-26 14:33:22,486][123090] Updated weights for policy 1, policy_version 1861617 (0.0008) [2023-12-26 14:33:22,553][123090] Updated weights for policy 1, policy_version 1861627 (0.0010) [2023-12-26 14:33:23,147][123091] Updated weights for policy 0, policy_version 1873338 (0.0006) [2023-12-26 14:33:23,206][123091] Updated weights for policy 0, policy_version 1873348 (0.0006) [2023-12-26 14:33:23,265][123091] Updated weights for policy 0, policy_version 1873358 (0.0009) [2023-12-26 14:33:23,366][123090] Updated weights for policy 1, policy_version 1861637 (0.0007) [2023-12-26 14:33:23,437][123090] Updated weights for policy 1, policy_version 1861647 (0.0005) [2023-12-26 14:33:23,506][123090] Updated weights for policy 1, policy_version 1861657 (0.0009) [2023-12-26 14:33:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 956170240. Throughput: 0: 8941.6, 1: 8664.7. Samples: 956146000. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:23,785][121949] Avg episode reward: [(0, '6310.651'), (1, '5964.170')] [2023-12-26 14:33:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001861664_476585984.pth... [2023-12-26 14:33:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001873360_479584256.pth... [2023-12-26 14:33:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001860640_476323840.pth [2023-12-26 14:33:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001872336_479322112.pth [2023-12-26 14:33:24,048][123091] Updated weights for policy 0, policy_version 1873368 (0.0008) [2023-12-26 14:33:24,107][123091] Updated weights for policy 0, policy_version 1873378 (0.0006) [2023-12-26 14:33:24,161][123091] Updated weights for policy 0, policy_version 1873388 (0.0006) [2023-12-26 14:33:24,325][123090] Updated weights for policy 1, policy_version 1861667 (0.0007) [2023-12-26 14:33:24,397][123090] Updated weights for policy 1, policy_version 1861677 (0.0005) [2023-12-26 14:33:24,460][123090] Updated weights for policy 1, policy_version 1861687 (0.0005) [2023-12-26 14:33:24,841][123091] Updated weights for policy 0, policy_version 1873398 (0.0009) [2023-12-26 14:33:24,896][123091] Updated weights for policy 0, policy_version 1873408 (0.0010) [2023-12-26 14:33:24,952][123091] Updated weights for policy 0, policy_version 1873418 (0.0006) [2023-12-26 14:33:25,103][123090] Updated weights for policy 1, policy_version 1861697 (0.0005) [2023-12-26 14:33:25,181][123090] Updated weights for policy 1, policy_version 1861707 (0.0005) [2023-12-26 14:33:25,261][123090] Updated weights for policy 1, policy_version 1861717 (0.0005) [2023-12-26 14:33:25,335][123090] Updated weights for policy 1, policy_version 1861727 (0.0006) [2023-12-26 14:33:25,639][123091] Updated weights for policy 0, policy_version 1873428 (0.0005) [2023-12-26 14:33:25,689][123091] Updated weights for policy 0, policy_version 1873438 (0.0005) [2023-12-26 14:33:25,743][123091] Updated weights for policy 0, policy_version 1873448 (0.0005) [2023-12-26 14:33:25,954][123090] Updated weights for policy 1, policy_version 1861737 (0.0009) [2023-12-26 14:33:26,007][123090] Updated weights for policy 1, policy_version 1861749 (0.0011) [2023-12-26 14:33:26,059][123090] Updated weights for policy 1, policy_version 1861759 (0.0009) [2023-12-26 14:33:26,253][123091] Updated weights for policy 0, policy_version 1873458 (0.0005) [2023-12-26 14:33:26,300][123091] Updated weights for policy 0, policy_version 1873468 (0.0005) [2023-12-26 14:33:26,347][123091] Updated weights for policy 0, policy_version 1873478 (0.0005) [2023-12-26 14:33:26,400][123091] Updated weights for policy 0, policy_version 1873488 (0.0005) [2023-12-26 14:33:26,852][123090] Updated weights for policy 1, policy_version 1861769 (0.0006) [2023-12-26 14:33:26,904][123090] Updated weights for policy 1, policy_version 1861779 (0.0005) [2023-12-26 14:33:26,961][123090] Updated weights for policy 1, policy_version 1861789 (0.0005) [2023-12-26 14:33:27,079][123091] Updated weights for policy 0, policy_version 1873498 (0.0011) [2023-12-26 14:33:27,138][123091] Updated weights for policy 0, policy_version 1873508 (0.0010) [2023-12-26 14:33:27,197][123091] Updated weights for policy 0, policy_version 1873518 (0.0010) [2023-12-26 14:33:27,675][123090] Updated weights for policy 1, policy_version 1861799 (0.0005) [2023-12-26 14:33:27,728][123090] Updated weights for policy 1, policy_version 1861809 (0.0005) [2023-12-26 14:33:27,779][123090] Updated weights for policy 1, policy_version 1861819 (0.0005) [2023-12-26 14:33:27,960][123091] Updated weights for policy 0, policy_version 1873528 (0.0010) [2023-12-26 14:33:28,011][123091] Updated weights for policy 0, policy_version 1873538 (0.0010) [2023-12-26 14:33:28,065][123091] Updated weights for policy 0, policy_version 1873548 (0.0010) [2023-12-26 14:33:28,479][123090] Updated weights for policy 1, policy_version 1861829 (0.0005) [2023-12-26 14:33:28,528][123090] Updated weights for policy 1, policy_version 1861839 (0.0005) [2023-12-26 14:33:28,583][123090] Updated weights for policy 1, policy_version 1861849 (0.0005) [2023-12-26 14:33:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 956268544. Throughput: 0: 9058.7, 1: 8784.3. Samples: 956260336. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:28,785][121949] Avg episode reward: [(0, '6320.773'), (1, '5939.060')] [2023-12-26 14:33:28,849][123091] Updated weights for policy 0, policy_version 1873558 (0.0010) [2023-12-26 14:33:28,914][123091] Updated weights for policy 0, policy_version 1873568 (0.0011) [2023-12-26 14:33:28,983][123091] Updated weights for policy 0, policy_version 1873578 (0.0011) [2023-12-26 14:33:29,357][123090] Updated weights for policy 1, policy_version 1861859 (0.0007) [2023-12-26 14:33:29,421][123090] Updated weights for policy 1, policy_version 1861869 (0.0008) [2023-12-26 14:33:29,472][123090] Updated weights for policy 1, policy_version 1861879 (0.0008) [2023-12-26 14:33:29,799][123091] Updated weights for policy 0, policy_version 1873588 (0.0011) [2023-12-26 14:33:29,861][123091] Updated weights for policy 0, policy_version 1873598 (0.0008) [2023-12-26 14:33:29,921][123091] Updated weights for policy 0, policy_version 1873608 (0.0012) [2023-12-26 14:33:30,277][123090] Updated weights for policy 1, policy_version 1861889 (0.0009) [2023-12-26 14:33:30,332][123090] Updated weights for policy 1, policy_version 1861899 (0.0008) [2023-12-26 14:33:30,379][123090] Updated weights for policy 1, policy_version 1861909 (0.0008) [2023-12-26 14:33:30,435][123090] Updated weights for policy 1, policy_version 1861919 (0.0008) [2023-12-26 14:33:30,639][123091] Updated weights for policy 0, policy_version 1873618 (0.0010) [2023-12-26 14:33:30,696][123091] Updated weights for policy 0, policy_version 1873628 (0.0005) [2023-12-26 14:33:30,747][123091] Updated weights for policy 0, policy_version 1873638 (0.0005) [2023-12-26 14:33:30,799][123091] Updated weights for policy 0, policy_version 1873648 (0.0005) [2023-12-26 14:33:31,141][123090] Updated weights for policy 1, policy_version 1861929 (0.0009) [2023-12-26 14:33:31,212][123090] Updated weights for policy 1, policy_version 1861939 (0.0011) [2023-12-26 14:33:31,285][123090] Updated weights for policy 1, policy_version 1861949 (0.0007) [2023-12-26 14:33:31,578][123091] Updated weights for policy 0, policy_version 1873658 (0.0008) [2023-12-26 14:33:31,647][123091] Updated weights for policy 0, policy_version 1873668 (0.0009) [2023-12-26 14:33:31,710][123091] Updated weights for policy 0, policy_version 1873678 (0.0008) [2023-12-26 14:33:32,009][123090] Updated weights for policy 1, policy_version 1861959 (0.0008) [2023-12-26 14:33:32,072][123090] Updated weights for policy 1, policy_version 1861969 (0.0010) [2023-12-26 14:33:32,126][123090] Updated weights for policy 1, policy_version 1861980 (0.0010) [2023-12-26 14:33:32,395][123091] Updated weights for policy 0, policy_version 1873688 (0.0009) [2023-12-26 14:33:32,450][123091] Updated weights for policy 0, policy_version 1873698 (0.0009) [2023-12-26 14:33:32,509][123091] Updated weights for policy 0, policy_version 1873708 (0.0010) [2023-12-26 14:33:32,963][123090] Updated weights for policy 1, policy_version 1861990 (0.0007) [2023-12-26 14:33:33,028][123090] Updated weights for policy 1, policy_version 1862000 (0.0005) [2023-12-26 14:33:33,080][123090] Updated weights for policy 1, policy_version 1862010 (0.0005) [2023-12-26 14:33:33,319][123091] Updated weights for policy 0, policy_version 1873718 (0.0010) [2023-12-26 14:33:33,381][123091] Updated weights for policy 0, policy_version 1873728 (0.0010) [2023-12-26 14:33:33,433][123091] Updated weights for policy 0, policy_version 1873738 (0.0009) [2023-12-26 14:33:33,728][123090] Updated weights for policy 1, policy_version 1862020 (0.0005) [2023-12-26 14:33:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 956358656. Throughput: 0: 8999.5, 1: 8920.5. Samples: 956372324. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:33,785][121949] Avg episode reward: [(0, '6248.014'), (1, '5988.345')] [2023-12-26 14:33:33,794][123090] Updated weights for policy 1, policy_version 1862030 (0.0005) [2023-12-26 14:33:33,853][123090] Updated weights for policy 1, policy_version 1862040 (0.0005) [2023-12-26 14:33:34,230][123091] Updated weights for policy 0, policy_version 1873748 (0.0010) [2023-12-26 14:33:34,284][123091] Updated weights for policy 0, policy_version 1873758 (0.0009) [2023-12-26 14:33:34,345][123091] Updated weights for policy 0, policy_version 1873768 (0.0009) [2023-12-26 14:33:34,534][123090] Updated weights for policy 1, policy_version 1862050 (0.0006) [2023-12-26 14:33:34,598][123090] Updated weights for policy 1, policy_version 1862060 (0.0010) [2023-12-26 14:33:34,663][123090] Updated weights for policy 1, policy_version 1862070 (0.0009) [2023-12-26 14:33:34,716][123090] Updated weights for policy 1, policy_version 1862080 (0.0009) [2023-12-26 14:33:35,178][123091] Updated weights for policy 0, policy_version 1873778 (0.0009) [2023-12-26 14:33:35,232][123091] Updated weights for policy 0, policy_version 1873788 (0.0009) [2023-12-26 14:33:35,287][123091] Updated weights for policy 0, policy_version 1873798 (0.0008) [2023-12-26 14:33:35,344][123091] Updated weights for policy 0, policy_version 1873808 (0.0006) [2023-12-26 14:33:35,578][123090] Updated weights for policy 1, policy_version 1862090 (0.0010) [2023-12-26 14:33:35,641][123090] Updated weights for policy 1, policy_version 1862100 (0.0009) [2023-12-26 14:33:35,693][123090] Updated weights for policy 1, policy_version 1862110 (0.0009) [2023-12-26 14:33:36,120][123091] Updated weights for policy 0, policy_version 1873818 (0.0009) [2023-12-26 14:33:36,180][123091] Updated weights for policy 0, policy_version 1873828 (0.0010) [2023-12-26 14:33:36,237][123091] Updated weights for policy 0, policy_version 1873838 (0.0010) [2023-12-26 14:33:36,514][123090] Updated weights for policy 1, policy_version 1862120 (0.0010) [2023-12-26 14:33:36,581][123090] Updated weights for policy 1, policy_version 1862130 (0.0010) [2023-12-26 14:33:36,647][123090] Updated weights for policy 1, policy_version 1862140 (0.0009) [2023-12-26 14:33:37,014][123091] Updated weights for policy 0, policy_version 1873848 (0.0006) [2023-12-26 14:33:37,070][123091] Updated weights for policy 0, policy_version 1873858 (0.0005) [2023-12-26 14:33:37,126][123091] Updated weights for policy 0, policy_version 1873868 (0.0006) [2023-12-26 14:33:37,445][123090] Updated weights for policy 1, policy_version 1862150 (0.0009) [2023-12-26 14:33:37,520][123090] Updated weights for policy 1, policy_version 1862160 (0.0009) [2023-12-26 14:33:37,590][123090] Updated weights for policy 1, policy_version 1862170 (0.0009) [2023-12-26 14:33:37,825][123091] Updated weights for policy 0, policy_version 1873878 (0.0009) [2023-12-26 14:33:37,888][123091] Updated weights for policy 0, policy_version 1873888 (0.0009) [2023-12-26 14:33:37,939][123091] Updated weights for policy 0, policy_version 1873898 (0.0010) [2023-12-26 14:33:38,422][123090] Updated weights for policy 1, policy_version 1862180 (0.0009) [2023-12-26 14:33:38,485][123090] Updated weights for policy 1, policy_version 1862190 (0.0010) [2023-12-26 14:33:38,550][123090] Updated weights for policy 1, policy_version 1862200 (0.0009) [2023-12-26 14:33:38,783][123091] Updated weights for policy 0, policy_version 1873908 (0.0009) [2023-12-26 14:33:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 956448768. Throughput: 0: 8990.6, 1: 8930.7. Samples: 956425692. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:38,785][121949] Avg episode reward: [(0, '6278.860'), (1, '6036.125')] [2023-12-26 14:33:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001862208_476725248.pth... [2023-12-26 14:33:38,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001861152_476454912.pth [2023-12-26 14:33:38,839][123091] Updated weights for policy 0, policy_version 1873918 (0.0010) [2023-12-26 14:33:38,895][123091] Updated weights for policy 0, policy_version 1873928 (0.0009) [2023-12-26 14:33:38,942][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001873936_479731712.pth... [2023-12-26 14:33:38,946][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001872848_479453184.pth [2023-12-26 14:33:39,381][123090] Updated weights for policy 1, policy_version 1862210 (0.0009) [2023-12-26 14:33:39,465][123090] Updated weights for policy 1, policy_version 1862220 (0.0010) [2023-12-26 14:33:39,527][123090] Updated weights for policy 1, policy_version 1862230 (0.0009) [2023-12-26 14:33:39,600][123090] Updated weights for policy 1, policy_version 1862240 (0.0010) [2023-12-26 14:33:39,705][123091] Updated weights for policy 0, policy_version 1873938 (0.0010) [2023-12-26 14:33:39,765][123091] Updated weights for policy 0, policy_version 1873948 (0.0010) [2023-12-26 14:33:39,824][123091] Updated weights for policy 0, policy_version 1873958 (0.0010) [2023-12-26 14:33:39,893][123091] Updated weights for policy 0, policy_version 1873968 (0.0010) [2023-12-26 14:33:40,465][123090] Updated weights for policy 1, policy_version 1862250 (0.0010) [2023-12-26 14:33:40,535][123090] Updated weights for policy 1, policy_version 1862260 (0.0009) [2023-12-26 14:33:40,604][123090] Updated weights for policy 1, policy_version 1862270 (0.0009) [2023-12-26 14:33:40,748][123091] Updated weights for policy 0, policy_version 1873978 (0.0009) [2023-12-26 14:33:40,807][123091] Updated weights for policy 0, policy_version 1873988 (0.0010) [2023-12-26 14:33:40,869][123091] Updated weights for policy 0, policy_version 1873998 (0.0009) [2023-12-26 14:33:41,430][123090] Updated weights for policy 1, policy_version 1862280 (0.0010) [2023-12-26 14:33:41,486][123090] Updated weights for policy 1, policy_version 1862290 (0.0010) [2023-12-26 14:33:41,554][123090] Updated weights for policy 1, policy_version 1862300 (0.0010) [2023-12-26 14:33:41,696][123091] Updated weights for policy 0, policy_version 1874008 (0.0008) [2023-12-26 14:33:41,770][123091] Updated weights for policy 0, policy_version 1874018 (0.0010) [2023-12-26 14:33:41,836][123091] Updated weights for policy 0, policy_version 1874028 (0.0008) [2023-12-26 14:33:42,436][123090] Updated weights for policy 1, policy_version 1862310 (0.0009) [2023-12-26 14:33:42,506][123090] Updated weights for policy 1, policy_version 1862320 (0.0009) [2023-12-26 14:33:42,572][123090] Updated weights for policy 1, policy_version 1862330 (0.0009) [2023-12-26 14:33:42,705][123091] Updated weights for policy 0, policy_version 1874038 (0.0010) [2023-12-26 14:33:42,756][123091] Updated weights for policy 0, policy_version 1874048 (0.0010) [2023-12-26 14:33:42,815][123091] Updated weights for policy 0, policy_version 1874058 (0.0009) [2023-12-26 14:33:43,393][123090] Updated weights for policy 1, policy_version 1862340 (0.0009) [2023-12-26 14:33:43,452][123090] Updated weights for policy 1, policy_version 1862350 (0.0009) [2023-12-26 14:33:43,519][123090] Updated weights for policy 1, policy_version 1862360 (0.0008) [2023-12-26 14:33:43,657][123091] Updated weights for policy 0, policy_version 1874068 (0.0009) [2023-12-26 14:33:43,709][123091] Updated weights for policy 0, policy_version 1874078 (0.0010) [2023-12-26 14:33:43,756][123091] Updated weights for policy 0, policy_version 1874088 (0.0010) [2023-12-26 14:33:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 956530688. Throughput: 0: 8914.4, 1: 8838.6. Samples: 956527040. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:43,785][121949] Avg episode reward: [(0, '6322.904'), (1, '6045.752')] [2023-12-26 14:33:44,354][123090] Updated weights for policy 1, policy_version 1862370 (0.0008) [2023-12-26 14:33:44,402][123090] Updated weights for policy 1, policy_version 1862380 (0.0009) [2023-12-26 14:33:44,454][123090] Updated weights for policy 1, policy_version 1862390 (0.0008) [2023-12-26 14:33:44,515][123090] Updated weights for policy 1, policy_version 1862400 (0.0009) [2023-12-26 14:33:44,594][123091] Updated weights for policy 0, policy_version 1874098 (0.0010) [2023-12-26 14:33:44,656][123091] Updated weights for policy 0, policy_version 1874108 (0.0010) [2023-12-26 14:33:44,715][123091] Updated weights for policy 0, policy_version 1874118 (0.0010) [2023-12-26 14:33:44,773][123091] Updated weights for policy 0, policy_version 1874128 (0.0010) [2023-12-26 14:33:45,375][123090] Updated weights for policy 1, policy_version 1862410 (0.0008) [2023-12-26 14:33:45,434][123090] Updated weights for policy 1, policy_version 1862420 (0.0008) [2023-12-26 14:33:45,501][123090] Updated weights for policy 1, policy_version 1862430 (0.0008) [2023-12-26 14:33:45,621][123091] Updated weights for policy 0, policy_version 1874138 (0.0009) [2023-12-26 14:33:45,692][123091] Updated weights for policy 0, policy_version 1874148 (0.0009) [2023-12-26 14:33:45,755][123091] Updated weights for policy 0, policy_version 1874158 (0.0010) [2023-12-26 14:33:46,291][123090] Updated weights for policy 1, policy_version 1862440 (0.0006) [2023-12-26 14:33:46,346][123090] Updated weights for policy 1, policy_version 1862450 (0.0005) [2023-12-26 14:33:46,392][123090] Updated weights for policy 1, policy_version 1862460 (0.0005) [2023-12-26 14:33:46,603][123091] Updated weights for policy 0, policy_version 1874168 (0.0009) [2023-12-26 14:33:46,665][123091] Updated weights for policy 0, policy_version 1874178 (0.0009) [2023-12-26 14:33:46,724][123091] Updated weights for policy 0, policy_version 1874188 (0.0010) [2023-12-26 14:33:47,140][123090] Updated weights for policy 1, policy_version 1862470 (0.0006) [2023-12-26 14:33:47,191][123090] Updated weights for policy 1, policy_version 1862480 (0.0005) [2023-12-26 14:33:47,238][123090] Updated weights for policy 1, policy_version 1862490 (0.0005) [2023-12-26 14:33:47,630][123091] Updated weights for policy 0, policy_version 1874198 (0.0010) [2023-12-26 14:33:47,695][123091] Updated weights for policy 0, policy_version 1874208 (0.0010) [2023-12-26 14:33:47,764][123091] Updated weights for policy 0, policy_version 1874218 (0.0009) [2023-12-26 14:33:47,950][123090] Updated weights for policy 1, policy_version 1862500 (0.0005) [2023-12-26 14:33:48,028][123090] Updated weights for policy 1, policy_version 1862510 (0.0006) [2023-12-26 14:33:48,100][123090] Updated weights for policy 1, policy_version 1862520 (0.0006) [2023-12-26 14:33:48,556][123091] Updated weights for policy 0, policy_version 1874228 (0.0008) [2023-12-26 14:33:48,626][123091] Updated weights for policy 0, policy_version 1874238 (0.0006) [2023-12-26 14:33:48,691][123091] Updated weights for policy 0, policy_version 1874248 (0.0006) [2023-12-26 14:33:48,722][123090] Updated weights for policy 1, policy_version 1862530 (0.0008) [2023-12-26 14:33:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 956620800. Throughput: 0: 8861.0, 1: 8882.9. Samples: 956632316. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:48,785][121949] Avg episode reward: [(0, '6328.946'), (1, '6020.549')] [2023-12-26 14:33:48,788][123090] Updated weights for policy 1, policy_version 1862540 (0.0007) [2023-12-26 14:33:48,861][123090] Updated weights for policy 1, policy_version 1862550 (0.0011) [2023-12-26 14:33:48,925][123090] Updated weights for policy 1, policy_version 1862560 (0.0010) [2023-12-26 14:33:49,459][123091] Updated weights for policy 0, policy_version 1874258 (0.0007) [2023-12-26 14:33:49,503][123091] Updated weights for policy 0, policy_version 1874268 (0.0010) [2023-12-26 14:33:49,555][123091] Updated weights for policy 0, policy_version 1874278 (0.0010) [2023-12-26 14:33:49,610][123091] Updated weights for policy 0, policy_version 1874288 (0.0010) [2023-12-26 14:33:49,645][123090] Updated weights for policy 1, policy_version 1862570 (0.0010) [2023-12-26 14:33:49,703][123090] Updated weights for policy 1, policy_version 1862580 (0.0009) [2023-12-26 14:33:49,770][123090] Updated weights for policy 1, policy_version 1862590 (0.0010) [2023-12-26 14:33:50,538][123091] Updated weights for policy 0, policy_version 1874298 (0.0009) [2023-12-26 14:33:50,562][123090] Updated weights for policy 1, policy_version 1862600 (0.0010) [2023-12-26 14:33:50,609][123091] Updated weights for policy 0, policy_version 1874308 (0.0008) [2023-12-26 14:33:50,629][123090] Updated weights for policy 1, policy_version 1862610 (0.0008) [2023-12-26 14:33:50,672][123091] Updated weights for policy 0, policy_version 1874318 (0.0008) [2023-12-26 14:33:50,684][123090] Updated weights for policy 1, policy_version 1862620 (0.0009) [2023-12-26 14:33:51,435][123091] Updated weights for policy 0, policy_version 1874328 (0.0009) [2023-12-26 14:33:51,502][123091] Updated weights for policy 0, policy_version 1874338 (0.0008) [2023-12-26 14:33:51,537][123090] Updated weights for policy 1, policy_version 1862630 (0.0007) [2023-12-26 14:33:51,562][123091] Updated weights for policy 0, policy_version 1874348 (0.0008) [2023-12-26 14:33:51,586][123090] Updated weights for policy 1, policy_version 1862640 (0.0009) [2023-12-26 14:33:51,651][123090] Updated weights for policy 1, policy_version 1862650 (0.0009) [2023-12-26 14:33:52,275][123091] Updated weights for policy 0, policy_version 1874358 (0.0008) [2023-12-26 14:33:52,326][123091] Updated weights for policy 0, policy_version 1874368 (0.0009) [2023-12-26 14:33:52,395][123091] Updated weights for policy 0, policy_version 1874378 (0.0010) [2023-12-26 14:33:52,531][123090] Updated weights for policy 1, policy_version 1862660 (0.0007) [2023-12-26 14:33:52,587][123090] Updated weights for policy 1, policy_version 1862670 (0.0008) [2023-12-26 14:33:52,655][123090] Updated weights for policy 1, policy_version 1862680 (0.0010) [2023-12-26 14:33:53,233][123091] Updated weights for policy 0, policy_version 1874388 (0.0009) [2023-12-26 14:33:53,297][123091] Updated weights for policy 0, policy_version 1874398 (0.0009) [2023-12-26 14:33:53,363][123091] Updated weights for policy 0, policy_version 1874409 (0.0010) [2023-12-26 14:33:53,494][123090] Updated weights for policy 1, policy_version 1862690 (0.0010) [2023-12-26 14:33:53,554][123090] Updated weights for policy 1, policy_version 1862700 (0.0009) [2023-12-26 14:33:53,613][123090] Updated weights for policy 1, policy_version 1862710 (0.0009) [2023-12-26 14:33:53,675][123090] Updated weights for policy 1, policy_version 1862720 (0.0009) [2023-12-26 14:33:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.8). Total num frames: 956710912. Throughput: 0: 8863.1, 1: 8920.2. Samples: 956684748. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:53,785][121949] Avg episode reward: [(0, '6347.999'), (1, '6129.658')] [2023-12-26 14:33:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001874416_479854592.pth... [2023-12-26 14:33:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001862720_476856320.pth... [2023-12-26 14:33:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001873360_479584256.pth [2023-12-26 14:33:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001861664_476585984.pth [2023-12-26 14:33:53,797][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001874416_479854592.pth [2023-12-26 14:33:53,798][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001862720_476856320.pth [2023-12-26 14:33:54,195][123091] Updated weights for policy 0, policy_version 1874419 (0.0010) [2023-12-26 14:33:54,248][123091] Updated weights for policy 0, policy_version 1874429 (0.0009) [2023-12-26 14:33:54,311][123091] Updated weights for policy 0, policy_version 1874439 (0.0009) [2023-12-26 14:33:54,499][123090] Updated weights for policy 1, policy_version 1862730 (0.0009) [2023-12-26 14:33:54,563][123090] Updated weights for policy 1, policy_version 1862740 (0.0009) [2023-12-26 14:33:54,620][123090] Updated weights for policy 1, policy_version 1862750 (0.0009) [2023-12-26 14:33:55,161][123091] Updated weights for policy 0, policy_version 1874449 (0.0010) [2023-12-26 14:33:55,225][123091] Updated weights for policy 0, policy_version 1874459 (0.0007) [2023-12-26 14:33:55,290][123091] Updated weights for policy 0, policy_version 1874469 (0.0008) [2023-12-26 14:33:55,354][123091] Updated weights for policy 0, policy_version 1874479 (0.0007) [2023-12-26 14:33:55,411][123090] Updated weights for policy 1, policy_version 1862760 (0.0009) [2023-12-26 14:33:55,464][123090] Updated weights for policy 1, policy_version 1862770 (0.0009) [2023-12-26 14:33:55,520][123090] Updated weights for policy 1, policy_version 1862780 (0.0009) [2023-12-26 14:33:56,095][123091] Updated weights for policy 0, policy_version 1874490 (0.0010) [2023-12-26 14:33:56,147][123091] Updated weights for policy 0, policy_version 1874500 (0.0008) [2023-12-26 14:33:56,195][123091] Updated weights for policy 0, policy_version 1874510 (0.0005) [2023-12-26 14:33:56,268][123090] Updated weights for policy 1, policy_version 1862790 (0.0009) [2023-12-26 14:33:56,322][123090] Updated weights for policy 1, policy_version 1862800 (0.0009) [2023-12-26 14:33:56,375][123090] Updated weights for policy 1, policy_version 1862810 (0.0010) [2023-12-26 14:33:56,949][123091] Updated weights for policy 0, policy_version 1874520 (0.0009) [2023-12-26 14:33:57,003][123091] Updated weights for policy 0, policy_version 1874530 (0.0010) [2023-12-26 14:33:57,050][123091] Updated weights for policy 0, policy_version 1874540 (0.0010) [2023-12-26 14:33:57,262][123090] Updated weights for policy 1, policy_version 1862820 (0.0008) [2023-12-26 14:33:57,331][123090] Updated weights for policy 1, policy_version 1862830 (0.0008) [2023-12-26 14:33:57,393][123090] Updated weights for policy 1, policy_version 1862840 (0.0006) [2023-12-26 14:33:57,803][123091] Updated weights for policy 0, policy_version 1874550 (0.0008) [2023-12-26 14:33:57,857][123091] Updated weights for policy 0, policy_version 1874560 (0.0006) [2023-12-26 14:33:57,912][123091] Updated weights for policy 0, policy_version 1874570 (0.0005) [2023-12-26 14:33:58,081][123090] Updated weights for policy 1, policy_version 1862850 (0.0006) [2023-12-26 14:33:58,140][123090] Updated weights for policy 1, policy_version 1862860 (0.0008) [2023-12-26 14:33:58,207][123090] Updated weights for policy 1, policy_version 1862870 (0.0009) [2023-12-26 14:33:58,275][123090] Updated weights for policy 1, policy_version 1862880 (0.0006) [2023-12-26 14:33:58,721][123091] Updated weights for policy 0, policy_version 1874580 (0.0007) [2023-12-26 14:33:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 956792832. Throughput: 0: 8954.3, 1: 8838.0. Samples: 956791024. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:33:58,785][121949] Avg episode reward: [(0, '6258.096'), (1, '6060.562')] [2023-12-26 14:33:58,791][123091] Updated weights for policy 0, policy_version 1874590 (0.0007) [2023-12-26 14:33:58,858][123091] Updated weights for policy 0, policy_version 1874600 (0.0008) [2023-12-26 14:33:59,181][123090] Updated weights for policy 1, policy_version 1862890 (0.0006) [2023-12-26 14:33:59,255][123090] Updated weights for policy 1, policy_version 1862900 (0.0008) [2023-12-26 14:33:59,326][123090] Updated weights for policy 1, policy_version 1862910 (0.0008) [2023-12-26 14:33:59,665][123091] Updated weights for policy 0, policy_version 1874610 (0.0008) [2023-12-26 14:33:59,711][123091] Updated weights for policy 0, policy_version 1874620 (0.0008) [2023-12-26 14:33:59,766][123091] Updated weights for policy 0, policy_version 1874630 (0.0009) [2023-12-26 14:33:59,831][123091] Updated weights for policy 0, policy_version 1874640 (0.0009) [2023-12-26 14:34:00,049][123090] Updated weights for policy 1, policy_version 1862920 (0.0009) [2023-12-26 14:34:00,104][123090] Updated weights for policy 1, policy_version 1862930 (0.0008) [2023-12-26 14:34:00,161][123090] Updated weights for policy 1, policy_version 1862940 (0.0010) [2023-12-26 14:34:00,654][123091] Updated weights for policy 0, policy_version 1874650 (0.0010) [2023-12-26 14:34:00,698][123091] Updated weights for policy 0, policy_version 1874660 (0.0011) [2023-12-26 14:34:00,753][123091] Updated weights for policy 0, policy_version 1874670 (0.0010) [2023-12-26 14:34:01,006][123090] Updated weights for policy 1, policy_version 1862950 (0.0009) [2023-12-26 14:34:01,066][123090] Updated weights for policy 1, policy_version 1862960 (0.0009) [2023-12-26 14:34:01,132][123090] Updated weights for policy 1, policy_version 1862970 (0.0009) [2023-12-26 14:34:01,566][123091] Updated weights for policy 0, policy_version 1874680 (0.0006) [2023-12-26 14:34:01,641][123091] Updated weights for policy 0, policy_version 1874690 (0.0008) [2023-12-26 14:34:01,689][123091] Updated weights for policy 0, policy_version 1874700 (0.0010) [2023-12-26 14:34:01,906][123090] Updated weights for policy 1, policy_version 1862980 (0.0009) [2023-12-26 14:34:01,979][123090] Updated weights for policy 1, policy_version 1862990 (0.0010) [2023-12-26 14:34:02,052][123090] Updated weights for policy 1, policy_version 1863000 (0.0010) [2023-12-26 14:34:02,484][123091] Updated weights for policy 0, policy_version 1874710 (0.0008) [2023-12-26 14:34:02,531][123091] Updated weights for policy 0, policy_version 1874720 (0.0005) [2023-12-26 14:34:02,579][123091] Updated weights for policy 0, policy_version 1874730 (0.0006) [2023-12-26 14:34:02,865][123090] Updated weights for policy 1, policy_version 1863010 (0.0011) [2023-12-26 14:34:02,920][123090] Updated weights for policy 1, policy_version 1863020 (0.0010) [2023-12-26 14:34:02,967][123090] Updated weights for policy 1, policy_version 1863030 (0.0010) [2023-12-26 14:34:03,019][123090] Updated weights for policy 1, policy_version 1863040 (0.0010) [2023-12-26 14:34:03,338][123091] Updated weights for policy 0, policy_version 1874740 (0.0007) [2023-12-26 14:34:03,396][123091] Updated weights for policy 0, policy_version 1874750 (0.0009) [2023-12-26 14:34:03,456][123091] Updated weights for policy 0, policy_version 1874760 (0.0010) [2023-12-26 14:34:03,676][123090] Updated weights for policy 1, policy_version 1863050 (0.0005) [2023-12-26 14:34:03,737][123090] Updated weights for policy 1, policy_version 1863060 (0.0005) [2023-12-26 14:34:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17716.9). Total num frames: 956882944. Throughput: 0: 8890.6, 1: 8901.7. Samples: 956896396. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:03,784][121949] Avg episode reward: [(0, '6181.611'), (1, '6017.859')] [2023-12-26 14:34:03,800][123090] Updated weights for policy 1, policy_version 1863070 (0.0005) [2023-12-26 14:34:04,333][123091] Updated weights for policy 0, policy_version 1874770 (0.0009) [2023-12-26 14:34:04,390][123091] Updated weights for policy 0, policy_version 1874780 (0.0009) [2023-12-26 14:34:04,439][123091] Updated weights for policy 0, policy_version 1874790 (0.0009) [2023-12-26 14:34:04,487][123091] Updated weights for policy 0, policy_version 1874800 (0.0009) [2023-12-26 14:34:04,611][123090] Updated weights for policy 1, policy_version 1863080 (0.0009) [2023-12-26 14:34:04,666][123090] Updated weights for policy 1, policy_version 1863090 (0.0010) [2023-12-26 14:34:04,729][123090] Updated weights for policy 1, policy_version 1863100 (0.0010) [2023-12-26 14:34:05,348][123091] Updated weights for policy 0, policy_version 1874810 (0.0006) [2023-12-26 14:34:05,411][123091] Updated weights for policy 0, policy_version 1874820 (0.0006) [2023-12-26 14:34:05,471][123091] Updated weights for policy 0, policy_version 1874830 (0.0009) [2023-12-26 14:34:05,509][123090] Updated weights for policy 1, policy_version 1863110 (0.0010) [2023-12-26 14:34:05,568][123090] Updated weights for policy 1, policy_version 1863120 (0.0010) [2023-12-26 14:34:05,612][123090] Updated weights for policy 1, policy_version 1863130 (0.0010) [2023-12-26 14:34:06,261][123091] Updated weights for policy 0, policy_version 1874840 (0.0009) [2023-12-26 14:34:06,319][123091] Updated weights for policy 0, policy_version 1874850 (0.0009) [2023-12-26 14:34:06,374][123091] Updated weights for policy 0, policy_version 1874860 (0.0009) [2023-12-26 14:34:06,453][123090] Updated weights for policy 1, policy_version 1863140 (0.0010) [2023-12-26 14:34:06,505][123090] Updated weights for policy 1, policy_version 1863150 (0.0010) [2023-12-26 14:34:06,564][123090] Updated weights for policy 1, policy_version 1863160 (0.0011) [2023-12-26 14:34:07,234][123091] Updated weights for policy 0, policy_version 1874870 (0.0010) [2023-12-26 14:34:07,291][123091] Updated weights for policy 0, policy_version 1874880 (0.0010) [2023-12-26 14:34:07,359][123090] Updated weights for policy 1, policy_version 1863170 (0.0009) [2023-12-26 14:34:07,360][123091] Updated weights for policy 0, policy_version 1874890 (0.0009) [2023-12-26 14:34:07,422][123090] Updated weights for policy 1, policy_version 1863180 (0.0006) [2023-12-26 14:34:07,481][123090] Updated weights for policy 1, policy_version 1863190 (0.0005) [2023-12-26 14:34:07,540][123090] Updated weights for policy 1, policy_version 1863200 (0.0006) [2023-12-26 14:34:08,218][123091] Updated weights for policy 0, policy_version 1874900 (0.0010) [2023-12-26 14:34:08,290][123091] Updated weights for policy 0, policy_version 1874910 (0.0008) [2023-12-26 14:34:08,299][123090] Updated weights for policy 1, policy_version 1863210 (0.0005) [2023-12-26 14:34:08,354][123091] Updated weights for policy 0, policy_version 1874920 (0.0010) [2023-12-26 14:34:08,358][123090] Updated weights for policy 1, policy_version 1863220 (0.0007) [2023-12-26 14:34:08,422][123090] Updated weights for policy 1, policy_version 1863230 (0.0009) [2023-12-26 14:34:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 956973056. Throughput: 0: 8905.2, 1: 8930.2. Samples: 956948588. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:08,785][121949] Avg episode reward: [(0, '6185.374'), (1, '6019.335')] [2023-12-26 14:34:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001874928_479985664.pth... [2023-12-26 14:34:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001863232_476987392.pth... [2023-12-26 14:34:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001862208_476725248.pth [2023-12-26 14:34:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001873936_479731712.pth [2023-12-26 14:34:09,133][123091] Updated weights for policy 0, policy_version 1874930 (0.0010) [2023-12-26 14:34:09,184][123090] Updated weights for policy 1, policy_version 1863240 (0.0008) [2023-12-26 14:34:09,185][123091] Updated weights for policy 0, policy_version 1874940 (0.0006) [2023-12-26 14:34:09,250][123091] Updated weights for policy 0, policy_version 1874950 (0.0009) [2023-12-26 14:34:09,253][123090] Updated weights for policy 1, policy_version 1863250 (0.0008) [2023-12-26 14:34:09,319][123091] Updated weights for policy 0, policy_version 1874960 (0.0010) [2023-12-26 14:34:09,321][123090] Updated weights for policy 1, policy_version 1863260 (0.0006) [2023-12-26 14:34:10,111][123090] Updated weights for policy 1, policy_version 1863270 (0.0009) [2023-12-26 14:34:10,175][123090] Updated weights for policy 1, policy_version 1863280 (0.0008) [2023-12-26 14:34:10,175][123091] Updated weights for policy 0, policy_version 1874970 (0.0008) [2023-12-26 14:34:10,228][123090] Updated weights for policy 1, policy_version 1863290 (0.0008) [2023-12-26 14:34:10,228][123091] Updated weights for policy 0, policy_version 1874980 (0.0010) [2023-12-26 14:34:10,288][123091] Updated weights for policy 0, policy_version 1874990 (0.0010) [2023-12-26 14:34:11,079][123090] Updated weights for policy 1, policy_version 1863300 (0.0009) [2023-12-26 14:34:11,149][123091] Updated weights for policy 0, policy_version 1875000 (0.0010) [2023-12-26 14:34:11,152][123090] Updated weights for policy 1, policy_version 1863310 (0.0009) [2023-12-26 14:34:11,205][123091] Updated weights for policy 0, policy_version 1875010 (0.0009) [2023-12-26 14:34:11,216][123090] Updated weights for policy 1, policy_version 1863320 (0.0011) [2023-12-26 14:34:11,267][123091] Updated weights for policy 0, policy_version 1875020 (0.0009) [2023-12-26 14:34:11,966][123090] Updated weights for policy 1, policy_version 1863330 (0.0010) [2023-12-26 14:34:12,018][123090] Updated weights for policy 1, policy_version 1863340 (0.0006) [2023-12-26 14:34:12,070][123090] Updated weights for policy 1, policy_version 1863350 (0.0005) [2023-12-26 14:34:12,126][123090] Updated weights for policy 1, policy_version 1863360 (0.0005) [2023-12-26 14:34:12,223][123091] Updated weights for policy 0, policy_version 1875030 (0.0009) [2023-12-26 14:34:12,273][123091] Updated weights for policy 0, policy_version 1875040 (0.0007) [2023-12-26 14:34:12,329][123091] Updated weights for policy 0, policy_version 1875050 (0.0008) [2023-12-26 14:34:12,842][123090] Updated weights for policy 1, policy_version 1863370 (0.0005) [2023-12-26 14:34:12,905][123090] Updated weights for policy 1, policy_version 1863380 (0.0008) [2023-12-26 14:34:12,972][123090] Updated weights for policy 1, policy_version 1863390 (0.0011) [2023-12-26 14:34:13,141][123091] Updated weights for policy 0, policy_version 1875060 (0.0009) [2023-12-26 14:34:13,191][123091] Updated weights for policy 0, policy_version 1875070 (0.0008) [2023-12-26 14:34:13,256][123091] Updated weights for policy 0, policy_version 1875080 (0.0009) [2023-12-26 14:34:13,776][123090] Updated weights for policy 1, policy_version 1863400 (0.0010) [2023-12-26 14:34:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 957054976. Throughput: 0: 8711.2, 1: 8890.6. Samples: 957052416. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:13,784][121949] Avg episode reward: [(0, '6186.670'), (1, '5849.082')] [2023-12-26 14:34:13,820][123090] Updated weights for policy 1, policy_version 1863410 (0.0010) [2023-12-26 14:34:13,874][123090] Updated weights for policy 1, policy_version 1863420 (0.0010) [2023-12-26 14:34:14,097][123091] Updated weights for policy 0, policy_version 1875090 (0.0009) [2023-12-26 14:34:14,147][123091] Updated weights for policy 0, policy_version 1875100 (0.0009) [2023-12-26 14:34:14,199][123091] Updated weights for policy 0, policy_version 1875110 (0.0009) [2023-12-26 14:34:14,721][123090] Updated weights for policy 1, policy_version 1863430 (0.0010) [2023-12-26 14:34:14,797][123090] Updated weights for policy 1, policy_version 1863440 (0.0011) [2023-12-26 14:34:14,861][123090] Updated weights for policy 1, policy_version 1863450 (0.0011) [2023-12-26 14:34:15,084][123091] Updated weights for policy 0, policy_version 1875121 (0.0009) [2023-12-26 14:34:15,138][123091] Updated weights for policy 0, policy_version 1875131 (0.0009) [2023-12-26 14:34:15,191][123091] Updated weights for policy 0, policy_version 1875141 (0.0009) [2023-12-26 14:34:15,244][123091] Updated weights for policy 0, policy_version 1875151 (0.0009) [2023-12-26 14:34:15,679][123090] Updated weights for policy 1, policy_version 1863460 (0.0011) [2023-12-26 14:34:15,735][123090] Updated weights for policy 1, policy_version 1863470 (0.0010) [2023-12-26 14:34:15,793][123090] Updated weights for policy 1, policy_version 1863480 (0.0010) [2023-12-26 14:34:16,137][123091] Updated weights for policy 0, policy_version 1875161 (0.0009) [2023-12-26 14:34:16,186][123091] Updated weights for policy 0, policy_version 1875171 (0.0009) [2023-12-26 14:34:16,234][123091] Updated weights for policy 0, policy_version 1875181 (0.0009) [2023-12-26 14:34:16,641][123090] Updated weights for policy 1, policy_version 1863490 (0.0011) [2023-12-26 14:34:16,696][123090] Updated weights for policy 1, policy_version 1863500 (0.0010) [2023-12-26 14:34:16,744][123090] Updated weights for policy 1, policy_version 1863510 (0.0010) [2023-12-26 14:34:16,791][123090] Updated weights for policy 1, policy_version 1863520 (0.0010) [2023-12-26 14:34:17,101][123091] Updated weights for policy 0, policy_version 1875191 (0.0009) [2023-12-26 14:34:17,149][123091] Updated weights for policy 0, policy_version 1875202 (0.0009) [2023-12-26 14:34:17,209][123091] Updated weights for policy 0, policy_version 1875212 (0.0009) [2023-12-26 14:34:17,642][123090] Updated weights for policy 1, policy_version 1863530 (0.0010) [2023-12-26 14:34:17,704][123090] Updated weights for policy 1, policy_version 1863540 (0.0010) [2023-12-26 14:34:17,766][123090] Updated weights for policy 1, policy_version 1863550 (0.0010) [2023-12-26 14:34:18,069][123091] Updated weights for policy 0, policy_version 1875222 (0.0009) [2023-12-26 14:34:18,118][123091] Updated weights for policy 0, policy_version 1875232 (0.0009) [2023-12-26 14:34:18,178][123091] Updated weights for policy 0, policy_version 1875242 (0.0008) [2023-12-26 14:34:18,578][123090] Updated weights for policy 1, policy_version 1863560 (0.0007) [2023-12-26 14:34:18,650][123090] Updated weights for policy 1, policy_version 1863570 (0.0005) [2023-12-26 14:34:18,711][123090] Updated weights for policy 1, policy_version 1863580 (0.0005) [2023-12-26 14:34:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 957145088. Throughput: 0: 8615.1, 1: 8765.4. Samples: 957154440. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:18,784][121949] Avg episode reward: [(0, '6261.968'), (1, '5936.753')] [2023-12-26 14:34:19,036][123091] Updated weights for policy 0, policy_version 1875252 (0.0009) [2023-12-26 14:34:19,102][123091] Updated weights for policy 0, policy_version 1875262 (0.0006) [2023-12-26 14:34:19,169][123091] Updated weights for policy 0, policy_version 1875272 (0.0005) [2023-12-26 14:34:19,397][123090] Updated weights for policy 1, policy_version 1863590 (0.0008) [2023-12-26 14:34:19,457][123090] Updated weights for policy 1, policy_version 1863600 (0.0008) [2023-12-26 14:34:19,520][123090] Updated weights for policy 1, policy_version 1863610 (0.0009) [2023-12-26 14:34:19,946][123091] Updated weights for policy 0, policy_version 1875282 (0.0007) [2023-12-26 14:34:20,019][123091] Updated weights for policy 0, policy_version 1875292 (0.0009) [2023-12-26 14:34:20,088][123091] Updated weights for policy 0, policy_version 1875302 (0.0010) [2023-12-26 14:34:20,158][123091] Updated weights for policy 0, policy_version 1875312 (0.0010) [2023-12-26 14:34:20,416][123090] Updated weights for policy 1, policy_version 1863620 (0.0010) [2023-12-26 14:34:20,481][123090] Updated weights for policy 1, policy_version 1863630 (0.0009) [2023-12-26 14:34:20,550][123090] Updated weights for policy 1, policy_version 1863640 (0.0009) [2023-12-26 14:34:21,035][123091] Updated weights for policy 0, policy_version 1875322 (0.0010) [2023-12-26 14:34:21,104][123091] Updated weights for policy 0, policy_version 1875332 (0.0008) [2023-12-26 14:34:21,174][123091] Updated weights for policy 0, policy_version 1875342 (0.0009) [2023-12-26 14:34:21,467][123090] Updated weights for policy 1, policy_version 1863650 (0.0010) [2023-12-26 14:34:21,530][123090] Updated weights for policy 1, policy_version 1863660 (0.0009) [2023-12-26 14:34:21,595][123090] Updated weights for policy 1, policy_version 1863670 (0.0008) [2023-12-26 14:34:21,667][123090] Updated weights for policy 1, policy_version 1863680 (0.0009) [2023-12-26 14:34:21,978][123091] Updated weights for policy 0, policy_version 1875352 (0.0007) [2023-12-26 14:34:22,036][123091] Updated weights for policy 0, policy_version 1875362 (0.0006) [2023-12-26 14:34:22,105][123091] Updated weights for policy 0, policy_version 1875372 (0.0006) [2023-12-26 14:34:22,504][123090] Updated weights for policy 1, policy_version 1863690 (0.0008) [2023-12-26 14:34:22,566][123090] Updated weights for policy 1, policy_version 1863700 (0.0007) [2023-12-26 14:34:22,630][123090] Updated weights for policy 1, policy_version 1863710 (0.0006) [2023-12-26 14:34:22,858][123091] Updated weights for policy 0, policy_version 1875382 (0.0008) [2023-12-26 14:34:22,929][123091] Updated weights for policy 0, policy_version 1875392 (0.0010) [2023-12-26 14:34:23,007][123091] Updated weights for policy 0, policy_version 1875402 (0.0010) [2023-12-26 14:34:23,295][123090] Updated weights for policy 1, policy_version 1863720 (0.0007) [2023-12-26 14:34:23,369][123090] Updated weights for policy 1, policy_version 1863730 (0.0006) [2023-12-26 14:34:23,442][123090] Updated weights for policy 1, policy_version 1863740 (0.0005) [2023-12-26 14:34:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 957227008. Throughput: 0: 8582.5, 1: 8740.4. Samples: 957205224. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:23,785][121949] Avg episode reward: [(0, '6334.918'), (1, '5932.136')] [2023-12-26 14:34:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001875408_480108544.pth... [2023-12-26 14:34:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001863744_477118464.pth... [2023-12-26 14:34:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001862720_476856320.pth [2023-12-26 14:34:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001874416_479854592.pth [2023-12-26 14:34:23,879][123091] Updated weights for policy 0, policy_version 1875412 (0.0009) [2023-12-26 14:34:23,941][123091] Updated weights for policy 0, policy_version 1875422 (0.0010) [2023-12-26 14:34:24,005][123091] Updated weights for policy 0, policy_version 1875432 (0.0008) [2023-12-26 14:34:24,047][123090] Updated weights for policy 1, policy_version 1863750 (0.0005) [2023-12-26 14:34:24,114][123090] Updated weights for policy 1, policy_version 1863760 (0.0005) [2023-12-26 14:34:24,175][123090] Updated weights for policy 1, policy_version 1863770 (0.0005) [2023-12-26 14:34:24,875][123091] Updated weights for policy 0, policy_version 1875442 (0.0009) [2023-12-26 14:34:24,914][123090] Updated weights for policy 1, policy_version 1863780 (0.0007) [2023-12-26 14:34:24,939][123091] Updated weights for policy 0, policy_version 1875452 (0.0009) [2023-12-26 14:34:24,974][123090] Updated weights for policy 1, policy_version 1863790 (0.0005) [2023-12-26 14:34:24,995][123091] Updated weights for policy 0, policy_version 1875462 (0.0009) [2023-12-26 14:34:25,037][123090] Updated weights for policy 1, policy_version 1863800 (0.0008) [2023-12-26 14:34:25,060][123091] Updated weights for policy 0, policy_version 1875472 (0.0009) [2023-12-26 14:34:25,766][123091] Updated weights for policy 0, policy_version 1875483 (0.0009) [2023-12-26 14:34:25,791][123090] Updated weights for policy 1, policy_version 1863810 (0.0009) [2023-12-26 14:34:25,823][123091] Updated weights for policy 0, policy_version 1875494 (0.0010) [2023-12-26 14:34:25,868][123090] Updated weights for policy 1, policy_version 1863820 (0.0005) [2023-12-26 14:34:25,882][123091] Updated weights for policy 0, policy_version 1875504 (0.0009) [2023-12-26 14:34:25,927][123090] Updated weights for policy 1, policy_version 1863830 (0.0005) [2023-12-26 14:34:25,990][123090] Updated weights for policy 1, policy_version 1863840 (0.0005) [2023-12-26 14:34:26,694][123091] Updated weights for policy 0, policy_version 1875514 (0.0006) [2023-12-26 14:34:26,707][123090] Updated weights for policy 1, policy_version 1863850 (0.0010) [2023-12-26 14:34:26,749][123091] Updated weights for policy 0, policy_version 1875524 (0.0005) [2023-12-26 14:34:26,756][123090] Updated weights for policy 1, policy_version 1863860 (0.0009) [2023-12-26 14:34:26,808][123091] Updated weights for policy 0, policy_version 1875534 (0.0006) [2023-12-26 14:34:26,811][123090] Updated weights for policy 1, policy_version 1863870 (0.0008) [2023-12-26 14:34:27,582][123091] Updated weights for policy 0, policy_version 1875544 (0.0009) [2023-12-26 14:34:27,645][123090] Updated weights for policy 1, policy_version 1863881 (0.0005) [2023-12-26 14:34:27,646][123091] Updated weights for policy 0, policy_version 1875554 (0.0009) [2023-12-26 14:34:27,704][123090] Updated weights for policy 1, policy_version 1863891 (0.0005) [2023-12-26 14:34:27,707][123091] Updated weights for policy 0, policy_version 1875564 (0.0008) [2023-12-26 14:34:27,756][123090] Updated weights for policy 1, policy_version 1863901 (0.0005) [2023-12-26 14:34:28,479][123091] Updated weights for policy 0, policy_version 1875574 (0.0008) [2023-12-26 14:34:28,520][123090] Updated weights for policy 1, policy_version 1863911 (0.0007) [2023-12-26 14:34:28,540][123091] Updated weights for policy 0, policy_version 1875584 (0.0008) [2023-12-26 14:34:28,588][123090] Updated weights for policy 1, policy_version 1863921 (0.0008) [2023-12-26 14:34:28,595][123091] Updated weights for policy 0, policy_version 1875594 (0.0005) [2023-12-26 14:34:28,644][123090] Updated weights for policy 1, policy_version 1863931 (0.0009) [2023-12-26 14:34:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 957325312. Throughput: 0: 8589.8, 1: 8875.8. Samples: 957312988. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:28,785][121949] Avg episode reward: [(0, '6356.479'), (1, '5932.692')] [2023-12-26 14:34:29,396][123091] Updated weights for policy 0, policy_version 1875604 (0.0008) [2023-12-26 14:34:29,452][123091] Updated weights for policy 0, policy_version 1875614 (0.0010) [2023-12-26 14:34:29,488][123090] Updated weights for policy 1, policy_version 1863941 (0.0008) [2023-12-26 14:34:29,507][123091] Updated weights for policy 0, policy_version 1875624 (0.0010) [2023-12-26 14:34:29,552][123090] Updated weights for policy 1, policy_version 1863951 (0.0007) [2023-12-26 14:34:29,619][123090] Updated weights for policy 1, policy_version 1863961 (0.0009) [2023-12-26 14:34:30,392][123091] Updated weights for policy 0, policy_version 1875634 (0.0010) [2023-12-26 14:34:30,454][123091] Updated weights for policy 0, policy_version 1875644 (0.0010) [2023-12-26 14:34:30,455][123090] Updated weights for policy 1, policy_version 1863971 (0.0008) [2023-12-26 14:34:30,507][123091] Updated weights for policy 0, policy_version 1875654 (0.0008) [2023-12-26 14:34:30,516][123090] Updated weights for policy 1, policy_version 1863981 (0.0005) [2023-12-26 14:34:30,575][123091] Updated weights for policy 0, policy_version 1875664 (0.0008) [2023-12-26 14:34:30,584][123090] Updated weights for policy 1, policy_version 1863991 (0.0009) [2023-12-26 14:34:31,315][123090] Updated weights for policy 1, policy_version 1864001 (0.0010) [2023-12-26 14:34:31,388][123090] Updated weights for policy 1, policy_version 1864011 (0.0008) [2023-12-26 14:34:31,448][123090] Updated weights for policy 1, policy_version 1864021 (0.0008) [2023-12-26 14:34:31,453][123091] Updated weights for policy 0, policy_version 1875674 (0.0007) [2023-12-26 14:34:31,512][123090] Updated weights for policy 1, policy_version 1864031 (0.0008) [2023-12-26 14:34:31,516][123091] Updated weights for policy 0, policy_version 1875684 (0.0008) [2023-12-26 14:34:31,567][123091] Updated weights for policy 0, policy_version 1875694 (0.0009) [2023-12-26 14:34:32,245][123091] Updated weights for policy 0, policy_version 1875704 (0.0006) [2023-12-26 14:34:32,302][123090] Updated weights for policy 1, policy_version 1864041 (0.0008) [2023-12-26 14:34:32,304][123091] Updated weights for policy 0, policy_version 1875714 (0.0008) [2023-12-26 14:34:32,363][123090] Updated weights for policy 1, policy_version 1864051 (0.0008) [2023-12-26 14:34:32,364][123091] Updated weights for policy 0, policy_version 1875724 (0.0008) [2023-12-26 14:34:32,419][123090] Updated weights for policy 1, policy_version 1864061 (0.0005) [2023-12-26 14:34:33,179][123091] Updated weights for policy 0, policy_version 1875734 (0.0010) [2023-12-26 14:34:33,208][123090] Updated weights for policy 1, policy_version 1864071 (0.0007) [2023-12-26 14:34:33,228][123091] Updated weights for policy 0, policy_version 1875744 (0.0009) [2023-12-26 14:34:33,272][123090] Updated weights for policy 1, policy_version 1864081 (0.0006) [2023-12-26 14:34:33,278][123091] Updated weights for policy 0, policy_version 1875754 (0.0006) [2023-12-26 14:34:33,318][123090] Updated weights for policy 1, policy_version 1864091 (0.0005) [2023-12-26 14:34:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 957407232. Throughput: 0: 8636.7, 1: 8838.1. Samples: 957418684. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:33,785][121949] Avg episode reward: [(0, '6363.324'), (1, '5980.819')] [2023-12-26 14:34:34,021][123091] Updated weights for policy 0, policy_version 1875764 (0.0005) [2023-12-26 14:34:34,065][123091] Updated weights for policy 0, policy_version 1875774 (0.0005) [2023-12-26 14:34:34,118][123091] Updated weights for policy 0, policy_version 1875784 (0.0005) [2023-12-26 14:34:34,194][123090] Updated weights for policy 1, policy_version 1864101 (0.0008) [2023-12-26 14:34:34,255][123090] Updated weights for policy 1, policy_version 1864111 (0.0010) [2023-12-26 14:34:34,305][123090] Updated weights for policy 1, policy_version 1864121 (0.0009) [2023-12-26 14:34:34,964][123091] Updated weights for policy 0, policy_version 1875794 (0.0008) [2023-12-26 14:34:35,018][123091] Updated weights for policy 0, policy_version 1875804 (0.0010) [2023-12-26 14:34:35,067][123091] Updated weights for policy 0, policy_version 1875814 (0.0009) [2023-12-26 14:34:35,114][123091] Updated weights for policy 0, policy_version 1875824 (0.0009) [2023-12-26 14:34:35,140][123090] Updated weights for policy 1, policy_version 1864131 (0.0010) [2023-12-26 14:34:35,188][123090] Updated weights for policy 1, policy_version 1864141 (0.0008) [2023-12-26 14:34:35,239][123090] Updated weights for policy 1, policy_version 1864152 (0.0010) [2023-12-26 14:34:35,979][123091] Updated weights for policy 0, policy_version 1875834 (0.0010) [2023-12-26 14:34:36,033][123091] Updated weights for policy 0, policy_version 1875844 (0.0009) [2023-12-26 14:34:36,089][123091] Updated weights for policy 0, policy_version 1875854 (0.0009) [2023-12-26 14:34:36,106][123090] Updated weights for policy 1, policy_version 1864162 (0.0008) [2023-12-26 14:34:36,170][123090] Updated weights for policy 1, policy_version 1864172 (0.0009) [2023-12-26 14:34:36,241][123090] Updated weights for policy 1, policy_version 1864182 (0.0009) [2023-12-26 14:34:36,307][123090] Updated weights for policy 1, policy_version 1864192 (0.0009) [2023-12-26 14:34:36,959][123091] Updated weights for policy 0, policy_version 1875864 (0.0009) [2023-12-26 14:34:37,009][123091] Updated weights for policy 0, policy_version 1875874 (0.0009) [2023-12-26 14:34:37,065][123091] Updated weights for policy 0, policy_version 1875884 (0.0009) [2023-12-26 14:34:37,117][123090] Updated weights for policy 1, policy_version 1864202 (0.0010) [2023-12-26 14:34:37,168][123090] Updated weights for policy 1, policy_version 1864212 (0.0010) [2023-12-26 14:34:37,212][123090] Updated weights for policy 1, policy_version 1864222 (0.0010) [2023-12-26 14:34:37,924][123091] Updated weights for policy 0, policy_version 1875895 (0.0010) [2023-12-26 14:34:37,982][123091] Updated weights for policy 0, policy_version 1875905 (0.0010) [2023-12-26 14:34:38,024][123090] Updated weights for policy 1, policy_version 1864232 (0.0010) [2023-12-26 14:34:38,044][123091] Updated weights for policy 0, policy_version 1875915 (0.0008) [2023-12-26 14:34:38,085][123090] Updated weights for policy 1, policy_version 1864242 (0.0010) [2023-12-26 14:34:38,140][123090] Updated weights for policy 1, policy_version 1864252 (0.0010) [2023-12-26 14:34:38,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17661.4). Total num frames: 957489152. Throughput: 0: 8649.2, 1: 8796.7. Samples: 957469816. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:38,785][121949] Avg episode reward: [(0, '6377.844'), (1, '6026.750')] [2023-12-26 14:34:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001875920_480239616.pth... [2023-12-26 14:34:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001864256_477249536.pth... [2023-12-26 14:34:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001874928_479985664.pth [2023-12-26 14:34:38,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001863232_476987392.pth [2023-12-26 14:34:38,913][123091] Updated weights for policy 0, policy_version 1875925 (0.0008) [2023-12-26 14:34:38,968][123090] Updated weights for policy 1, policy_version 1864262 (0.0010) [2023-12-26 14:34:38,988][123091] Updated weights for policy 0, policy_version 1875935 (0.0008) [2023-12-26 14:34:39,026][123090] Updated weights for policy 1, policy_version 1864272 (0.0010) [2023-12-26 14:34:39,055][123091] Updated weights for policy 0, policy_version 1875945 (0.0009) [2023-12-26 14:34:39,091][123090] Updated weights for policy 1, policy_version 1864282 (0.0010) [2023-12-26 14:34:39,871][123091] Updated weights for policy 0, policy_version 1875955 (0.0007) [2023-12-26 14:34:39,932][123091] Updated weights for policy 0, policy_version 1875965 (0.0009) [2023-12-26 14:34:39,954][123090] Updated weights for policy 1, policy_version 1864292 (0.0009) [2023-12-26 14:34:39,995][123091] Updated weights for policy 0, policy_version 1875975 (0.0008) [2023-12-26 14:34:40,016][123090] Updated weights for policy 1, policy_version 1864302 (0.0008) [2023-12-26 14:34:40,083][123090] Updated weights for policy 1, policy_version 1864312 (0.0008) [2023-12-26 14:34:40,812][123091] Updated weights for policy 0, policy_version 1875985 (0.0008) [2023-12-26 14:34:40,843][123090] Updated weights for policy 1, policy_version 1864322 (0.0010) [2023-12-26 14:34:40,883][123091] Updated weights for policy 0, policy_version 1875995 (0.0011) [2023-12-26 14:34:40,888][123090] Updated weights for policy 1, policy_version 1864332 (0.0007) [2023-12-26 14:34:40,939][123091] Updated weights for policy 0, policy_version 1876005 (0.0011) [2023-12-26 14:34:40,953][123090] Updated weights for policy 1, policy_version 1864342 (0.0006) [2023-12-26 14:34:41,008][123091] Updated weights for policy 0, policy_version 1876015 (0.0011) [2023-12-26 14:34:41,020][123090] Updated weights for policy 1, policy_version 1864352 (0.0006) [2023-12-26 14:34:41,893][123090] Updated weights for policy 1, policy_version 1864362 (0.0009) [2023-12-26 14:34:41,897][123091] Updated weights for policy 0, policy_version 1876025 (0.0010) [2023-12-26 14:34:41,950][123090] Updated weights for policy 1, policy_version 1864372 (0.0009) [2023-12-26 14:34:41,963][123091] Updated weights for policy 0, policy_version 1876035 (0.0009) [2023-12-26 14:34:42,023][123090] Updated weights for policy 1, policy_version 1864382 (0.0009) [2023-12-26 14:34:42,031][123091] Updated weights for policy 0, policy_version 1876045 (0.0007) [2023-12-26 14:34:42,789][123091] Updated weights for policy 0, policy_version 1876055 (0.0007) [2023-12-26 14:34:42,834][123090] Updated weights for policy 1, policy_version 1864392 (0.0009) [2023-12-26 14:34:42,859][123091] Updated weights for policy 0, policy_version 1876065 (0.0006) [2023-12-26 14:34:42,895][123090] Updated weights for policy 1, policy_version 1864402 (0.0008) [2023-12-26 14:34:42,920][123091] Updated weights for policy 0, policy_version 1876075 (0.0005) [2023-12-26 14:34:42,948][123090] Updated weights for policy 1, policy_version 1864413 (0.0007) [2023-12-26 14:34:43,646][123091] Updated weights for policy 0, policy_version 1876085 (0.0009) [2023-12-26 14:34:43,704][123091] Updated weights for policy 0, policy_version 1876095 (0.0011) [2023-12-26 14:34:43,767][123091] Updated weights for policy 0, policy_version 1876105 (0.0011) [2023-12-26 14:34:43,768][123090] Updated weights for policy 1, policy_version 1864423 (0.0009) [2023-12-26 14:34:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17633.6). Total num frames: 957571072. Throughput: 0: 8564.1, 1: 8801.8. Samples: 957572488. Policy #0 lag: (min: 31.0, avg: 38.4, max: 63.0) [2023-12-26 14:34:43,785][121949] Avg episode reward: [(0, '6314.869'), (1, '5829.834')] [2023-12-26 14:34:43,837][123090] Updated weights for policy 1, policy_version 1864433 (0.0009) [2023-12-26 14:34:43,894][123090] Updated weights for policy 1, policy_version 1864443 (0.0009) [2023-12-26 14:34:44,522][123091] Updated weights for policy 0, policy_version 1876115 (0.0009) [2023-12-26 14:34:44,589][123091] Updated weights for policy 0, policy_version 1876125 (0.0005) [2023-12-26 14:34:44,648][123091] Updated weights for policy 0, policy_version 1876135 (0.0005) [2023-12-26 14:34:44,781][123090] Updated weights for policy 1, policy_version 1864453 (0.0008) [2023-12-26 14:34:44,849][123090] Updated weights for policy 1, policy_version 1864463 (0.0009) [2023-12-26 14:34:44,912][123090] Updated weights for policy 1, policy_version 1864473 (0.0010) [2023-12-26 14:34:45,294][123091] Updated weights for policy 0, policy_version 1876145 (0.0006) [2023-12-26 14:34:45,357][123091] Updated weights for policy 0, policy_version 1876155 (0.0010) [2023-12-26 14:34:45,423][123091] Updated weights for policy 0, policy_version 1876165 (0.0009) [2023-12-26 14:34:45,484][123091] Updated weights for policy 0, policy_version 1876175 (0.0010) [2023-12-26 14:34:45,804][123090] Updated weights for policy 1, policy_version 1864483 (0.0010) [2023-12-26 14:34:45,855][123090] Updated weights for policy 1, policy_version 1864493 (0.0010) [2023-12-26 14:34:45,914][123090] Updated weights for policy 1, policy_version 1864503 (0.0010) [2023-12-26 14:34:46,338][123091] Updated weights for policy 0, policy_version 1876185 (0.0009) [2023-12-26 14:34:46,400][123091] Updated weights for policy 0, policy_version 1876195 (0.0010) [2023-12-26 14:34:46,453][123091] Updated weights for policy 0, policy_version 1876205 (0.0009) [2023-12-26 14:34:46,657][123090] Updated weights for policy 1, policy_version 1864513 (0.0008) [2023-12-26 14:34:46,708][123090] Updated weights for policy 1, policy_version 1864523 (0.0005) [2023-12-26 14:34:46,764][123090] Updated weights for policy 1, policy_version 1864533 (0.0005) [2023-12-26 14:34:46,820][123090] Updated weights for policy 1, policy_version 1864543 (0.0005) [2023-12-26 14:34:47,341][123091] Updated weights for policy 0, policy_version 1876216 (0.0010) [2023-12-26 14:34:47,390][123091] Updated weights for policy 0, policy_version 1876226 (0.0009) [2023-12-26 14:34:47,443][123091] Updated weights for policy 0, policy_version 1876236 (0.0009) [2023-12-26 14:34:47,510][123090] Updated weights for policy 1, policy_version 1864553 (0.0008) [2023-12-26 14:34:47,560][123090] Updated weights for policy 1, policy_version 1864563 (0.0009) [2023-12-26 14:34:47,614][123090] Updated weights for policy 1, policy_version 1864573 (0.0010) [2023-12-26 14:34:48,147][123091] Updated weights for policy 0, policy_version 1876246 (0.0007) [2023-12-26 14:34:48,212][123091] Updated weights for policy 0, policy_version 1876256 (0.0009) [2023-12-26 14:34:48,283][123091] Updated weights for policy 0, policy_version 1876266 (0.0006) [2023-12-26 14:34:48,503][123090] Updated weights for policy 1, policy_version 1864583 (0.0010) [2023-12-26 14:34:48,567][123090] Updated weights for policy 1, policy_version 1864593 (0.0011) [2023-12-26 14:34:48,624][123090] Updated weights for policy 1, policy_version 1864603 (0.0010) [2023-12-26 14:34:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 957669376. Throughput: 0: 8608.2, 1: 8761.9. Samples: 957678048. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:34:48,785][121949] Avg episode reward: [(0, '6321.904'), (1, '5811.503')] [2023-12-26 14:34:48,957][123091] Updated weights for policy 0, policy_version 1876276 (0.0006) [2023-12-26 14:34:49,023][123091] Updated weights for policy 0, policy_version 1876286 (0.0006) [2023-12-26 14:34:49,079][123091] Updated weights for policy 0, policy_version 1876296 (0.0005) [2023-12-26 14:34:49,467][123090] Updated weights for policy 1, policy_version 1864613 (0.0010) [2023-12-26 14:34:49,529][123090] Updated weights for policy 1, policy_version 1864623 (0.0010) [2023-12-26 14:34:49,596][123090] Updated weights for policy 1, policy_version 1864633 (0.0011) [2023-12-26 14:34:49,837][123091] Updated weights for policy 0, policy_version 1876306 (0.0006) [2023-12-26 14:34:49,907][123091] Updated weights for policy 0, policy_version 1876316 (0.0011) [2023-12-26 14:34:49,974][123091] Updated weights for policy 0, policy_version 1876327 (0.0011) [2023-12-26 14:34:50,387][123090] Updated weights for policy 1, policy_version 1864643 (0.0006) [2023-12-26 14:34:50,444][123090] Updated weights for policy 1, policy_version 1864653 (0.0005) [2023-12-26 14:34:50,492][123090] Updated weights for policy 1, policy_version 1864663 (0.0005) [2023-12-26 14:34:50,696][123091] Updated weights for policy 0, policy_version 1876337 (0.0010) [2023-12-26 14:34:50,759][123091] Updated weights for policy 0, policy_version 1876347 (0.0010) [2023-12-26 14:34:50,820][123091] Updated weights for policy 0, policy_version 1876357 (0.0009) [2023-12-26 14:34:50,876][123091] Updated weights for policy 0, policy_version 1876367 (0.0009) [2023-12-26 14:34:51,343][123090] Updated weights for policy 1, policy_version 1864673 (0.0006) [2023-12-26 14:34:51,416][123090] Updated weights for policy 1, policy_version 1864683 (0.0009) [2023-12-26 14:34:51,480][123090] Updated weights for policy 1, policy_version 1864693 (0.0009) [2023-12-26 14:34:51,544][123090] Updated weights for policy 1, policy_version 1864703 (0.0009) [2023-12-26 14:34:51,678][123091] Updated weights for policy 0, policy_version 1876377 (0.0011) [2023-12-26 14:34:51,743][123091] Updated weights for policy 0, policy_version 1876387 (0.0010) [2023-12-26 14:34:51,813][123091] Updated weights for policy 0, policy_version 1876397 (0.0010) [2023-12-26 14:34:52,321][123090] Updated weights for policy 1, policy_version 1864713 (0.0006) [2023-12-26 14:34:52,390][123090] Updated weights for policy 1, policy_version 1864723 (0.0010) [2023-12-26 14:34:52,459][123090] Updated weights for policy 1, policy_version 1864733 (0.0009) [2023-12-26 14:34:52,733][123091] Updated weights for policy 0, policy_version 1876407 (0.0006) [2023-12-26 14:34:52,794][123091] Updated weights for policy 0, policy_version 1876417 (0.0005) [2023-12-26 14:34:52,861][123091] Updated weights for policy 0, policy_version 1876427 (0.0008) [2023-12-26 14:34:53,254][123090] Updated weights for policy 1, policy_version 1864743 (0.0007) [2023-12-26 14:34:53,306][123090] Updated weights for policy 1, policy_version 1864753 (0.0005) [2023-12-26 14:34:53,360][123090] Updated weights for policy 1, policy_version 1864763 (0.0005) [2023-12-26 14:34:53,550][123091] Updated weights for policy 0, policy_version 1876437 (0.0008) [2023-12-26 14:34:53,606][123091] Updated weights for policy 0, policy_version 1876447 (0.0006) [2023-12-26 14:34:53,668][123091] Updated weights for policy 0, policy_version 1876457 (0.0005) [2023-12-26 14:34:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 957759488. Throughput: 0: 8646.9, 1: 8747.4. Samples: 957731328. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:34:53,785][121949] Avg episode reward: [(0, '6336.480'), (1, '5769.345')] [2023-12-26 14:34:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001864768_477380608.pth... [2023-12-26 14:34:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001876464_480378880.pth... [2023-12-26 14:34:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001863744_477118464.pth [2023-12-26 14:34:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001875408_480108544.pth [2023-12-26 14:34:54,100][123090] Updated weights for policy 1, policy_version 1864773 (0.0006) [2023-12-26 14:34:54,153][123090] Updated weights for policy 1, policy_version 1864783 (0.0005) [2023-12-26 14:34:54,214][123090] Updated weights for policy 1, policy_version 1864793 (0.0005) [2023-12-26 14:34:54,355][123091] Updated weights for policy 0, policy_version 1876467 (0.0007) [2023-12-26 14:34:54,404][123091] Updated weights for policy 0, policy_version 1876477 (0.0010) [2023-12-26 14:34:54,467][123091] Updated weights for policy 0, policy_version 1876487 (0.0011) [2023-12-26 14:34:54,996][123090] Updated weights for policy 1, policy_version 1864803 (0.0007) [2023-12-26 14:34:55,051][123090] Updated weights for policy 1, policy_version 1864813 (0.0010) [2023-12-26 14:34:55,106][123090] Updated weights for policy 1, policy_version 1864823 (0.0010) [2023-12-26 14:34:55,315][123091] Updated weights for policy 0, policy_version 1876497 (0.0010) [2023-12-26 14:34:55,367][123091] Updated weights for policy 0, policy_version 1876507 (0.0010) [2023-12-26 14:34:55,429][123091] Updated weights for policy 0, policy_version 1876517 (0.0008) [2023-12-26 14:34:55,492][123091] Updated weights for policy 0, policy_version 1876527 (0.0005) [2023-12-26 14:34:55,785][123090] Updated weights for policy 1, policy_version 1864833 (0.0007) [2023-12-26 14:34:55,857][123090] Updated weights for policy 1, policy_version 1864843 (0.0007) [2023-12-26 14:34:55,926][123090] Updated weights for policy 1, policy_version 1864853 (0.0010) [2023-12-26 14:34:55,998][123090] Updated weights for policy 1, policy_version 1864863 (0.0007) [2023-12-26 14:34:56,254][123091] Updated weights for policy 0, policy_version 1876537 (0.0006) [2023-12-26 14:34:56,298][123091] Updated weights for policy 0, policy_version 1876547 (0.0006) [2023-12-26 14:34:56,347][123091] Updated weights for policy 0, policy_version 1876557 (0.0005) [2023-12-26 14:34:56,727][123090] Updated weights for policy 1, policy_version 1864873 (0.0005) [2023-12-26 14:34:56,777][123090] Updated weights for policy 1, policy_version 1864883 (0.0005) [2023-12-26 14:34:56,841][123090] Updated weights for policy 1, policy_version 1864893 (0.0008) [2023-12-26 14:34:56,992][123091] Updated weights for policy 0, policy_version 1876567 (0.0008) [2023-12-26 14:34:57,044][123091] Updated weights for policy 0, policy_version 1876577 (0.0006) [2023-12-26 14:34:57,108][123091] Updated weights for policy 0, policy_version 1876587 (0.0005) [2023-12-26 14:34:57,532][123090] Updated weights for policy 1, policy_version 1864903 (0.0009) [2023-12-26 14:34:57,582][123090] Updated weights for policy 1, policy_version 1864913 (0.0010) [2023-12-26 14:34:57,638][123090] Updated weights for policy 1, policy_version 1864923 (0.0007) [2023-12-26 14:34:57,746][123091] Updated weights for policy 0, policy_version 1876597 (0.0005) [2023-12-26 14:34:57,791][123091] Updated weights for policy 0, policy_version 1876607 (0.0005) [2023-12-26 14:34:57,839][123091] Updated weights for policy 0, policy_version 1876617 (0.0005) [2023-12-26 14:34:58,405][123090] Updated weights for policy 1, policy_version 1864933 (0.0006) [2023-12-26 14:34:58,471][123090] Updated weights for policy 1, policy_version 1864943 (0.0007) [2023-12-26 14:34:58,544][123090] Updated weights for policy 1, policy_version 1864953 (0.0010) [2023-12-26 14:34:58,621][123091] Updated weights for policy 0, policy_version 1876627 (0.0007) [2023-12-26 14:34:58,691][123091] Updated weights for policy 0, policy_version 1876637 (0.0009) [2023-12-26 14:34:58,761][123091] Updated weights for policy 0, policy_version 1876647 (0.0010) [2023-12-26 14:34:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 957849600. Throughput: 0: 8797.1, 1: 8811.9. Samples: 957844820. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:34:58,785][121949] Avg episode reward: [(0, '6293.041'), (1, '5845.213')] [2023-12-26 14:34:59,531][123090] Updated weights for policy 1, policy_version 1864963 (0.0009) [2023-12-26 14:34:59,588][123090] Updated weights for policy 1, policy_version 1864973 (0.0009) [2023-12-26 14:34:59,591][123091] Updated weights for policy 0, policy_version 1876657 (0.0009) [2023-12-26 14:34:59,633][123090] Updated weights for policy 1, policy_version 1864983 (0.0009) [2023-12-26 14:34:59,655][123091] Updated weights for policy 0, policy_version 1876667 (0.0006) [2023-12-26 14:34:59,716][123091] Updated weights for policy 0, policy_version 1876677 (0.0008) [2023-12-26 14:34:59,765][123091] Updated weights for policy 0, policy_version 1876687 (0.0009) [2023-12-26 14:35:00,452][123090] Updated weights for policy 1, policy_version 1864993 (0.0009) [2023-12-26 14:35:00,503][123090] Updated weights for policy 1, policy_version 1865003 (0.0008) [2023-12-26 14:35:00,556][123090] Updated weights for policy 1, policy_version 1865013 (0.0008) [2023-12-26 14:35:00,606][123090] Updated weights for policy 1, policy_version 1865023 (0.0009) [2023-12-26 14:35:00,609][123091] Updated weights for policy 0, policy_version 1876697 (0.0006) [2023-12-26 14:35:00,674][123091] Updated weights for policy 0, policy_version 1876707 (0.0008) [2023-12-26 14:35:00,743][123091] Updated weights for policy 0, policy_version 1876717 (0.0005) [2023-12-26 14:35:01,420][123090] Updated weights for policy 1, policy_version 1865033 (0.0008) [2023-12-26 14:35:01,478][123090] Updated weights for policy 1, policy_version 1865043 (0.0010) [2023-12-26 14:35:01,529][123091] Updated weights for policy 0, policy_version 1876727 (0.0006) [2023-12-26 14:35:01,544][123090] Updated weights for policy 1, policy_version 1865053 (0.0009) [2023-12-26 14:35:01,591][123091] Updated weights for policy 0, policy_version 1876737 (0.0006) [2023-12-26 14:35:01,663][123091] Updated weights for policy 0, policy_version 1876747 (0.0007) [2023-12-26 14:35:02,292][123091] Updated weights for policy 0, policy_version 1876757 (0.0007) [2023-12-26 14:35:02,306][123090] Updated weights for policy 1, policy_version 1865063 (0.0008) [2023-12-26 14:35:02,364][123091] Updated weights for policy 0, policy_version 1876767 (0.0007) [2023-12-26 14:35:02,371][123090] Updated weights for policy 1, policy_version 1865073 (0.0008) [2023-12-26 14:35:02,422][123091] Updated weights for policy 0, policy_version 1876777 (0.0010) [2023-12-26 14:35:02,436][123090] Updated weights for policy 1, policy_version 1865083 (0.0008) [2023-12-26 14:35:03,200][123091] Updated weights for policy 0, policy_version 1876787 (0.0008) [2023-12-26 14:35:03,227][123090] Updated weights for policy 1, policy_version 1865093 (0.0007) [2023-12-26 14:35:03,248][123091] Updated weights for policy 0, policy_version 1876797 (0.0008) [2023-12-26 14:35:03,284][123090] Updated weights for policy 1, policy_version 1865103 (0.0005) [2023-12-26 14:35:03,308][123091] Updated weights for policy 0, policy_version 1876807 (0.0009) [2023-12-26 14:35:03,345][123090] Updated weights for policy 1, policy_version 1865113 (0.0005) [2023-12-26 14:35:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 957939712. Throughput: 0: 8863.8, 1: 8829.4. Samples: 957950636. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:03,785][121949] Avg episode reward: [(0, '6283.071'), (1, '5947.521')] [2023-12-26 14:35:03,999][123090] Updated weights for policy 1, policy_version 1865123 (0.0006) [2023-12-26 14:35:04,064][123090] Updated weights for policy 1, policy_version 1865133 (0.0008) [2023-12-26 14:35:04,134][123090] Updated weights for policy 1, policy_version 1865143 (0.0008) [2023-12-26 14:35:04,158][123091] Updated weights for policy 0, policy_version 1876817 (0.0009) [2023-12-26 14:35:04,229][123091] Updated weights for policy 0, policy_version 1876827 (0.0008) [2023-12-26 14:35:04,289][123091] Updated weights for policy 0, policy_version 1876837 (0.0006) [2023-12-26 14:35:04,353][123091] Updated weights for policy 0, policy_version 1876847 (0.0005) [2023-12-26 14:35:04,986][123090] Updated weights for policy 1, policy_version 1865153 (0.0008) [2023-12-26 14:35:05,001][123091] Updated weights for policy 0, policy_version 1876857 (0.0005) [2023-12-26 14:35:05,054][123091] Updated weights for policy 0, policy_version 1876867 (0.0005) [2023-12-26 14:35:05,055][123090] Updated weights for policy 1, policy_version 1865163 (0.0006) [2023-12-26 14:35:05,105][123091] Updated weights for policy 0, policy_version 1876877 (0.0009) [2023-12-26 14:35:05,113][123090] Updated weights for policy 1, policy_version 1865173 (0.0006) [2023-12-26 14:35:05,174][123090] Updated weights for policy 1, policy_version 1865183 (0.0009) [2023-12-26 14:35:05,868][123091] Updated weights for policy 0, policy_version 1876887 (0.0006) [2023-12-26 14:35:05,932][123091] Updated weights for policy 0, policy_version 1876897 (0.0005) [2023-12-26 14:35:05,992][123091] Updated weights for policy 0, policy_version 1876907 (0.0006) [2023-12-26 14:35:06,006][123090] Updated weights for policy 1, policy_version 1865193 (0.0008) [2023-12-26 14:35:06,078][123090] Updated weights for policy 1, policy_version 1865203 (0.0010) [2023-12-26 14:35:06,146][123090] Updated weights for policy 1, policy_version 1865213 (0.0009) [2023-12-26 14:35:06,739][123091] Updated weights for policy 0, policy_version 1876917 (0.0005) [2023-12-26 14:35:06,806][123091] Updated weights for policy 0, policy_version 1876927 (0.0006) [2023-12-26 14:35:06,875][123091] Updated weights for policy 0, policy_version 1876937 (0.0007) [2023-12-26 14:35:07,013][123090] Updated weights for policy 1, policy_version 1865223 (0.0009) [2023-12-26 14:35:07,077][123090] Updated weights for policy 1, policy_version 1865233 (0.0008) [2023-12-26 14:35:07,134][123090] Updated weights for policy 1, policy_version 1865243 (0.0008) [2023-12-26 14:35:07,667][123091] Updated weights for policy 0, policy_version 1876947 (0.0010) [2023-12-26 14:35:07,734][123091] Updated weights for policy 0, policy_version 1876957 (0.0009) [2023-12-26 14:35:07,795][123091] Updated weights for policy 0, policy_version 1876967 (0.0010) [2023-12-26 14:35:07,944][123090] Updated weights for policy 1, policy_version 1865253 (0.0009) [2023-12-26 14:35:08,014][123090] Updated weights for policy 1, policy_version 1865263 (0.0009) [2023-12-26 14:35:08,096][123090] Updated weights for policy 1, policy_version 1865273 (0.0010) [2023-12-26 14:35:08,401][123091] Updated weights for policy 0, policy_version 1876977 (0.0005) [2023-12-26 14:35:08,460][123091] Updated weights for policy 0, policy_version 1876987 (0.0005) [2023-12-26 14:35:08,522][123091] Updated weights for policy 0, policy_version 1876997 (0.0005) [2023-12-26 14:35:08,575][123091] Updated weights for policy 0, policy_version 1877007 (0.0005) [2023-12-26 14:35:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 958029824. Throughput: 0: 8952.7, 1: 8828.7. Samples: 958005388. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:08,785][121949] Avg episode reward: [(0, '6254.813'), (1, '5931.100')] [2023-12-26 14:35:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001877008_480518144.pth... [2023-12-26 14:35:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001865280_477511680.pth... [2023-12-26 14:35:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001875920_480239616.pth [2023-12-26 14:35:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001864256_477249536.pth [2023-12-26 14:35:08,978][123090] Updated weights for policy 1, policy_version 1865283 (0.0010) [2023-12-26 14:35:09,029][123090] Updated weights for policy 1, policy_version 1865293 (0.0009) [2023-12-26 14:35:09,079][123090] Updated weights for policy 1, policy_version 1865303 (0.0009) [2023-12-26 14:35:09,246][123091] Updated weights for policy 0, policy_version 1877017 (0.0008) [2023-12-26 14:35:09,309][123091] Updated weights for policy 0, policy_version 1877027 (0.0008) [2023-12-26 14:35:09,382][123091] Updated weights for policy 0, policy_version 1877037 (0.0009) [2023-12-26 14:35:09,979][123090] Updated weights for policy 1, policy_version 1865313 (0.0009) [2023-12-26 14:35:10,041][123090] Updated weights for policy 1, policy_version 1865323 (0.0009) [2023-12-26 14:35:10,110][123090] Updated weights for policy 1, policy_version 1865333 (0.0009) [2023-12-26 14:35:10,162][123090] Updated weights for policy 1, policy_version 1865343 (0.0010) [2023-12-26 14:35:10,184][123091] Updated weights for policy 0, policy_version 1877047 (0.0009) [2023-12-26 14:35:10,245][123091] Updated weights for policy 0, policy_version 1877057 (0.0009) [2023-12-26 14:35:10,309][123091] Updated weights for policy 0, policy_version 1877067 (0.0010) [2023-12-26 14:35:11,008][123090] Updated weights for policy 1, policy_version 1865353 (0.0009) [2023-12-26 14:35:11,084][123090] Updated weights for policy 1, policy_version 1865363 (0.0009) [2023-12-26 14:35:11,145][123091] Updated weights for policy 0, policy_version 1877077 (0.0008) [2023-12-26 14:35:11,154][123090] Updated weights for policy 1, policy_version 1865373 (0.0010) [2023-12-26 14:35:11,215][123091] Updated weights for policy 0, policy_version 1877087 (0.0008) [2023-12-26 14:35:11,277][123091] Updated weights for policy 0, policy_version 1877097 (0.0009) [2023-12-26 14:35:12,039][123091] Updated weights for policy 0, policy_version 1877107 (0.0010) [2023-12-26 14:35:12,045][123090] Updated weights for policy 1, policy_version 1865383 (0.0009) [2023-12-26 14:35:12,106][123091] Updated weights for policy 0, policy_version 1877117 (0.0009) [2023-12-26 14:35:12,116][123090] Updated weights for policy 1, policy_version 1865393 (0.0008) [2023-12-26 14:35:12,172][123091] Updated weights for policy 0, policy_version 1877127 (0.0007) [2023-12-26 14:35:12,183][123090] Updated weights for policy 1, policy_version 1865403 (0.0009) [2023-12-26 14:35:12,992][123090] Updated weights for policy 1, policy_version 1865413 (0.0009) [2023-12-26 14:35:13,030][123091] Updated weights for policy 0, policy_version 1877137 (0.0008) [2023-12-26 14:35:13,052][123090] Updated weights for policy 1, policy_version 1865423 (0.0011) [2023-12-26 14:35:13,082][123091] Updated weights for policy 0, policy_version 1877147 (0.0008) [2023-12-26 14:35:13,109][123090] Updated weights for policy 1, policy_version 1865433 (0.0010) [2023-12-26 14:35:13,138][123091] Updated weights for policy 0, policy_version 1877157 (0.0006) [2023-12-26 14:35:13,196][123091] Updated weights for policy 0, policy_version 1877167 (0.0008) [2023-12-26 14:35:13,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 958111744. Throughput: 0: 8984.5, 1: 8681.8. Samples: 958107976. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:13,785][121949] Avg episode reward: [(0, '6295.871'), (1, '5898.924')] [2023-12-26 14:35:13,952][123090] Updated weights for policy 1, policy_version 1865443 (0.0010) [2023-12-26 14:35:14,003][123090] Updated weights for policy 1, policy_version 1865453 (0.0010) [2023-12-26 14:35:14,013][123091] Updated weights for policy 0, policy_version 1877177 (0.0008) [2023-12-26 14:35:14,055][123090] Updated weights for policy 1, policy_version 1865463 (0.0010) [2023-12-26 14:35:14,066][123091] Updated weights for policy 0, policy_version 1877187 (0.0009) [2023-12-26 14:35:14,124][123091] Updated weights for policy 0, policy_version 1877197 (0.0007) [2023-12-26 14:35:14,857][123090] Updated weights for policy 1, policy_version 1865473 (0.0011) [2023-12-26 14:35:14,928][123090] Updated weights for policy 1, policy_version 1865483 (0.0009) [2023-12-26 14:35:14,956][123091] Updated weights for policy 0, policy_version 1877207 (0.0010) [2023-12-26 14:35:14,998][123090] Updated weights for policy 1, policy_version 1865493 (0.0011) [2023-12-26 14:35:15,018][123091] Updated weights for policy 0, policy_version 1877217 (0.0006) [2023-12-26 14:35:15,055][123090] Updated weights for policy 1, policy_version 1865503 (0.0011) [2023-12-26 14:35:15,089][123091] Updated weights for policy 0, policy_version 1877227 (0.0008) [2023-12-26 14:35:15,875][123090] Updated weights for policy 1, policy_version 1865513 (0.0010) [2023-12-26 14:35:15,919][123090] Updated weights for policy 1, policy_version 1865523 (0.0010) [2023-12-26 14:35:15,930][123091] Updated weights for policy 0, policy_version 1877237 (0.0008) [2023-12-26 14:35:15,977][123090] Updated weights for policy 1, policy_version 1865533 (0.0010) [2023-12-26 14:35:15,995][123091] Updated weights for policy 0, policy_version 1877247 (0.0008) [2023-12-26 14:35:16,056][123091] Updated weights for policy 0, policy_version 1877257 (0.0009) [2023-12-26 14:35:16,829][123091] Updated weights for policy 0, policy_version 1877267 (0.0008) [2023-12-26 14:35:16,833][123090] Updated weights for policy 1, policy_version 1865543 (0.0011) [2023-12-26 14:35:16,881][123091] Updated weights for policy 0, policy_version 1877277 (0.0005) [2023-12-26 14:35:16,899][123090] Updated weights for policy 1, policy_version 1865553 (0.0010) [2023-12-26 14:35:16,938][123091] Updated weights for policy 0, policy_version 1877287 (0.0005) [2023-12-26 14:35:16,965][123090] Updated weights for policy 1, policy_version 1865563 (0.0010) [2023-12-26 14:35:17,616][123091] Updated weights for policy 0, policy_version 1877297 (0.0006) [2023-12-26 14:35:17,682][123091] Updated weights for policy 0, policy_version 1877307 (0.0005) [2023-12-26 14:35:17,720][123090] Updated weights for policy 1, policy_version 1865573 (0.0008) [2023-12-26 14:35:17,753][123091] Updated weights for policy 0, policy_version 1877317 (0.0008) [2023-12-26 14:35:17,796][123090] Updated weights for policy 1, policy_version 1865583 (0.0006) [2023-12-26 14:35:17,826][123091] Updated weights for policy 0, policy_version 1877327 (0.0010) [2023-12-26 14:35:17,867][123090] Updated weights for policy 1, policy_version 1865593 (0.0009) [2023-12-26 14:35:18,557][123091] Updated weights for policy 0, policy_version 1877337 (0.0009) [2023-12-26 14:35:18,600][123090] Updated weights for policy 1, policy_version 1865603 (0.0009) [2023-12-26 14:35:18,612][123091] Updated weights for policy 0, policy_version 1877347 (0.0007) [2023-12-26 14:35:18,662][123091] Updated weights for policy 0, policy_version 1877357 (0.0008) [2023-12-26 14:35:18,664][123090] Updated weights for policy 1, policy_version 1865613 (0.0009) [2023-12-26 14:35:18,724][123090] Updated weights for policy 1, policy_version 1865623 (0.0007) [2023-12-26 14:35:18,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 958201856. Throughput: 0: 9022.0, 1: 8661.6. Samples: 958214444. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:18,784][121949] Avg episode reward: [(0, '6276.416'), (1, '5938.617')] [2023-12-26 14:35:19,473][123091] Updated weights for policy 0, policy_version 1877367 (0.0006) [2023-12-26 14:35:19,476][123090] Updated weights for policy 1, policy_version 1865633 (0.0006) [2023-12-26 14:35:19,542][123091] Updated weights for policy 0, policy_version 1877377 (0.0007) [2023-12-26 14:35:19,544][123090] Updated weights for policy 1, policy_version 1865643 (0.0009) [2023-12-26 14:35:19,607][123091] Updated weights for policy 0, policy_version 1877387 (0.0005) [2023-12-26 14:35:19,610][123090] Updated weights for policy 1, policy_version 1865653 (0.0009) [2023-12-26 14:35:19,661][123090] Updated weights for policy 1, policy_version 1865663 (0.0009) [2023-12-26 14:35:20,292][123091] Updated weights for policy 0, policy_version 1877397 (0.0006) [2023-12-26 14:35:20,355][123091] Updated weights for policy 0, policy_version 1877407 (0.0009) [2023-12-26 14:35:20,420][123091] Updated weights for policy 0, policy_version 1877417 (0.0009) [2023-12-26 14:35:20,488][123090] Updated weights for policy 1, policy_version 1865673 (0.0010) [2023-12-26 14:35:20,557][123090] Updated weights for policy 1, policy_version 1865683 (0.0011) [2023-12-26 14:35:20,635][123090] Updated weights for policy 1, policy_version 1865693 (0.0008) [2023-12-26 14:35:21,312][123091] Updated weights for policy 0, policy_version 1877427 (0.0010) [2023-12-26 14:35:21,385][123091] Updated weights for policy 0, policy_version 1877437 (0.0008) [2023-12-26 14:35:21,432][123090] Updated weights for policy 1, policy_version 1865703 (0.0006) [2023-12-26 14:35:21,454][123091] Updated weights for policy 0, policy_version 1877447 (0.0009) [2023-12-26 14:35:21,495][123090] Updated weights for policy 1, policy_version 1865713 (0.0010) [2023-12-26 14:35:21,566][123090] Updated weights for policy 1, policy_version 1865723 (0.0009) [2023-12-26 14:35:22,292][123090] Updated weights for policy 1, policy_version 1865733 (0.0008) [2023-12-26 14:35:22,346][123091] Updated weights for policy 0, policy_version 1877457 (0.0008) [2023-12-26 14:35:22,358][123090] Updated weights for policy 1, policy_version 1865743 (0.0010) [2023-12-26 14:35:22,412][123091] Updated weights for policy 0, policy_version 1877467 (0.0008) [2023-12-26 14:35:22,432][123090] Updated weights for policy 1, policy_version 1865753 (0.0010) [2023-12-26 14:35:22,471][123091] Updated weights for policy 0, policy_version 1877477 (0.0007) [2023-12-26 14:35:22,522][123091] Updated weights for policy 0, policy_version 1877487 (0.0009) [2023-12-26 14:35:23,247][123090] Updated weights for policy 1, policy_version 1865763 (0.0007) [2023-12-26 14:35:23,311][123090] Updated weights for policy 1, policy_version 1865773 (0.0006) [2023-12-26 14:35:23,368][123091] Updated weights for policy 0, policy_version 1877497 (0.0010) [2023-12-26 14:35:23,372][123090] Updated weights for policy 1, policy_version 1865783 (0.0005) [2023-12-26 14:35:23,432][123091] Updated weights for policy 0, policy_version 1877507 (0.0011) [2023-12-26 14:35:23,496][123091] Updated weights for policy 0, policy_version 1877517 (0.0011) [2023-12-26 14:35:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 958291968. Throughput: 0: 9025.9, 1: 8683.5. Samples: 958266736. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:23,785][121949] Avg episode reward: [(0, '6136.314'), (1, '5867.624')] [2023-12-26 14:35:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001865792_477642752.pth... [2023-12-26 14:35:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001877520_480649216.pth... [2023-12-26 14:35:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001876464_480378880.pth [2023-12-26 14:35:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001864768_477380608.pth [2023-12-26 14:35:24,112][123090] Updated weights for policy 1, policy_version 1865793 (0.0006) [2023-12-26 14:35:24,165][123090] Updated weights for policy 1, policy_version 1865803 (0.0009) [2023-12-26 14:35:24,221][123090] Updated weights for policy 1, policy_version 1865813 (0.0009) [2023-12-26 14:35:24,278][123090] Updated weights for policy 1, policy_version 1865824 (0.0010) [2023-12-26 14:35:24,305][123091] Updated weights for policy 0, policy_version 1877527 (0.0007) [2023-12-26 14:35:24,373][123091] Updated weights for policy 0, policy_version 1877537 (0.0008) [2023-12-26 14:35:24,434][123091] Updated weights for policy 0, policy_version 1877547 (0.0007) [2023-12-26 14:35:25,088][123091] Updated weights for policy 0, policy_version 1877557 (0.0006) [2023-12-26 14:35:25,134][123091] Updated weights for policy 0, policy_version 1877567 (0.0005) [2023-12-26 14:35:25,183][123091] Updated weights for policy 0, policy_version 1877577 (0.0005) [2023-12-26 14:35:25,205][123090] Updated weights for policy 1, policy_version 1865834 (0.0005) [2023-12-26 14:35:25,261][123090] Updated weights for policy 1, policy_version 1865844 (0.0007) [2023-12-26 14:35:25,311][123090] Updated weights for policy 1, policy_version 1865854 (0.0005) [2023-12-26 14:35:26,024][123090] Updated weights for policy 1, policy_version 1865864 (0.0006) [2023-12-26 14:35:26,039][123091] Updated weights for policy 0, policy_version 1877587 (0.0006) [2023-12-26 14:35:26,088][123090] Updated weights for policy 1, policy_version 1865874 (0.0008) [2023-12-26 14:35:26,099][123091] Updated weights for policy 0, policy_version 1877597 (0.0007) [2023-12-26 14:35:26,155][123090] Updated weights for policy 1, policy_version 1865884 (0.0011) [2023-12-26 14:35:26,158][123091] Updated weights for policy 0, policy_version 1877607 (0.0006) [2023-12-26 14:35:26,934][123090] Updated weights for policy 1, policy_version 1865894 (0.0010) [2023-12-26 14:35:26,989][123091] Updated weights for policy 0, policy_version 1877617 (0.0008) [2023-12-26 14:35:26,999][123090] Updated weights for policy 1, policy_version 1865904 (0.0010) [2023-12-26 14:35:27,050][123091] Updated weights for policy 0, policy_version 1877627 (0.0006) [2023-12-26 14:35:27,051][123090] Updated weights for policy 1, policy_version 1865914 (0.0010) [2023-12-26 14:35:27,104][123091] Updated weights for policy 0, policy_version 1877637 (0.0008) [2023-12-26 14:35:27,155][123091] Updated weights for policy 0, policy_version 1877647 (0.0009) [2023-12-26 14:35:27,836][123090] Updated weights for policy 1, policy_version 1865924 (0.0009) [2023-12-26 14:35:27,892][123090] Updated weights for policy 1, policy_version 1865934 (0.0009) [2023-12-26 14:35:27,942][123090] Updated weights for policy 1, policy_version 1865944 (0.0008) [2023-12-26 14:35:28,001][123091] Updated weights for policy 0, policy_version 1877657 (0.0009) [2023-12-26 14:35:28,049][123091] Updated weights for policy 0, policy_version 1877667 (0.0009) [2023-12-26 14:35:28,101][123091] Updated weights for policy 0, policy_version 1877677 (0.0009) [2023-12-26 14:35:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 958373888. Throughput: 0: 9065.2, 1: 8723.3. Samples: 958372968. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:28,785][121949] Avg episode reward: [(0, '6225.357'), (1, '5869.529')] [2023-12-26 14:35:28,791][123090] Updated weights for policy 1, policy_version 1865954 (0.0008) [2023-12-26 14:35:28,844][123090] Updated weights for policy 1, policy_version 1865964 (0.0010) [2023-12-26 14:35:28,893][123090] Updated weights for policy 1, policy_version 1865974 (0.0009) [2023-12-26 14:35:28,935][123091] Updated weights for policy 0, policy_version 1877687 (0.0009) [2023-12-26 14:35:28,946][123090] Updated weights for policy 1, policy_version 1865984 (0.0008) [2023-12-26 14:35:28,989][123091] Updated weights for policy 0, policy_version 1877697 (0.0010) [2023-12-26 14:35:29,036][123091] Updated weights for policy 0, policy_version 1877707 (0.0009) [2023-12-26 14:35:29,794][123090] Updated weights for policy 1, policy_version 1865994 (0.0009) [2023-12-26 14:35:29,866][123090] Updated weights for policy 1, policy_version 1866004 (0.0010) [2023-12-26 14:35:29,901][123091] Updated weights for policy 0, policy_version 1877717 (0.0009) [2023-12-26 14:35:29,935][123090] Updated weights for policy 1, policy_version 1866014 (0.0007) [2023-12-26 14:35:29,969][123091] Updated weights for policy 0, policy_version 1877727 (0.0010) [2023-12-26 14:35:30,028][123091] Updated weights for policy 0, policy_version 1877737 (0.0009) [2023-12-26 14:35:30,776][123090] Updated weights for policy 1, policy_version 1866024 (0.0009) [2023-12-26 14:35:30,828][123090] Updated weights for policy 1, policy_version 1866034 (0.0008) [2023-12-26 14:35:30,857][123091] Updated weights for policy 0, policy_version 1877747 (0.0009) [2023-12-26 14:35:30,887][123090] Updated weights for policy 1, policy_version 1866044 (0.0009) [2023-12-26 14:35:30,911][123091] Updated weights for policy 0, policy_version 1877757 (0.0009) [2023-12-26 14:35:30,972][123091] Updated weights for policy 0, policy_version 1877767 (0.0009) [2023-12-26 14:35:31,754][123090] Updated weights for policy 1, policy_version 1866054 (0.0008) [2023-12-26 14:35:31,804][123091] Updated weights for policy 0, policy_version 1877777 (0.0008) [2023-12-26 14:35:31,815][123090] Updated weights for policy 1, policy_version 1866064 (0.0008) [2023-12-26 14:35:31,859][123091] Updated weights for policy 0, policy_version 1877787 (0.0007) [2023-12-26 14:35:31,863][123090] Updated weights for policy 1, policy_version 1866074 (0.0008) [2023-12-26 14:35:31,922][123091] Updated weights for policy 0, policy_version 1877797 (0.0008) [2023-12-26 14:35:31,987][123091] Updated weights for policy 0, policy_version 1877807 (0.0010) [2023-12-26 14:35:32,719][123090] Updated weights for policy 1, policy_version 1866084 (0.0009) [2023-12-26 14:35:32,781][123090] Updated weights for policy 1, policy_version 1866094 (0.0009) [2023-12-26 14:35:32,782][123091] Updated weights for policy 0, policy_version 1877817 (0.0007) [2023-12-26 14:35:32,842][123090] Updated weights for policy 1, policy_version 1866104 (0.0009) [2023-12-26 14:35:32,843][123091] Updated weights for policy 0, policy_version 1877827 (0.0008) [2023-12-26 14:35:32,900][123091] Updated weights for policy 0, policy_version 1877837 (0.0008) [2023-12-26 14:35:33,653][123090] Updated weights for policy 1, policy_version 1866114 (0.0009) [2023-12-26 14:35:33,699][123091] Updated weights for policy 0, policy_version 1877847 (0.0010) [2023-12-26 14:35:33,702][123090] Updated weights for policy 1, policy_version 1866124 (0.0006) [2023-12-26 14:35:33,750][123091] Updated weights for policy 0, policy_version 1877857 (0.0008) [2023-12-26 14:35:33,762][123090] Updated weights for policy 1, policy_version 1866134 (0.0009) [2023-12-26 14:35:33,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17633.6). Total num frames: 958455808. Throughput: 0: 9000.3, 1: 8722.9. Samples: 958475596. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:33,785][121949] Avg episode reward: [(0, '6342.209'), (1, '6001.985')] [2023-12-26 14:35:33,797][123091] Updated weights for policy 0, policy_version 1877867 (0.0010) [2023-12-26 14:35:33,820][123090] Updated weights for policy 1, policy_version 1866144 (0.0006) [2023-12-26 14:35:34,647][123091] Updated weights for policy 0, policy_version 1877877 (0.0009) [2023-12-26 14:35:34,694][123090] Updated weights for policy 1, policy_version 1866154 (0.0008) [2023-12-26 14:35:34,710][123091] Updated weights for policy 0, policy_version 1877887 (0.0008) [2023-12-26 14:35:34,752][123090] Updated weights for policy 1, policy_version 1866164 (0.0008) [2023-12-26 14:35:34,777][123091] Updated weights for policy 0, policy_version 1877897 (0.0008) [2023-12-26 14:35:34,803][123090] Updated weights for policy 1, policy_version 1866174 (0.0009) [2023-12-26 14:35:35,536][123091] Updated weights for policy 0, policy_version 1877907 (0.0009) [2023-12-26 14:35:35,590][123091] Updated weights for policy 0, policy_version 1877917 (0.0009) [2023-12-26 14:35:35,604][123090] Updated weights for policy 1, policy_version 1866184 (0.0006) [2023-12-26 14:35:35,648][123091] Updated weights for policy 0, policy_version 1877927 (0.0008) [2023-12-26 14:35:35,658][123090] Updated weights for policy 1, policy_version 1866194 (0.0009) [2023-12-26 14:35:35,705][123090] Updated weights for policy 1, policy_version 1866204 (0.0010) [2023-12-26 14:35:36,342][123090] Updated weights for policy 1, policy_version 1866214 (0.0010) [2023-12-26 14:35:36,406][123090] Updated weights for policy 1, policy_version 1866224 (0.0010) [2023-12-26 14:35:36,470][123090] Updated weights for policy 1, policy_version 1866234 (0.0011) [2023-12-26 14:35:36,543][123091] Updated weights for policy 0, policy_version 1877937 (0.0007) [2023-12-26 14:35:36,611][123091] Updated weights for policy 0, policy_version 1877947 (0.0008) [2023-12-26 14:35:36,669][123091] Updated weights for policy 0, policy_version 1877957 (0.0009) [2023-12-26 14:35:36,730][123091] Updated weights for policy 0, policy_version 1877967 (0.0009) [2023-12-26 14:35:37,296][123090] Updated weights for policy 1, policy_version 1866244 (0.0010) [2023-12-26 14:35:37,354][123090] Updated weights for policy 1, policy_version 1866255 (0.0009) [2023-12-26 14:35:37,412][123090] Updated weights for policy 1, policy_version 1866265 (0.0010) [2023-12-26 14:35:37,584][123091] Updated weights for policy 0, policy_version 1877977 (0.0010) [2023-12-26 14:35:37,654][123091] Updated weights for policy 0, policy_version 1877987 (0.0010) [2023-12-26 14:35:37,722][123091] Updated weights for policy 0, policy_version 1877997 (0.0010) [2023-12-26 14:35:38,204][123090] Updated weights for policy 1, policy_version 1866275 (0.0009) [2023-12-26 14:35:38,254][123090] Updated weights for policy 1, policy_version 1866285 (0.0010) [2023-12-26 14:35:38,309][123090] Updated weights for policy 1, policy_version 1866295 (0.0010) [2023-12-26 14:35:38,483][123091] Updated weights for policy 0, policy_version 1878007 (0.0009) [2023-12-26 14:35:38,536][123091] Updated weights for policy 0, policy_version 1878017 (0.0009) [2023-12-26 14:35:38,598][123091] Updated weights for policy 0, policy_version 1878027 (0.0008) [2023-12-26 14:35:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 958554112. Throughput: 0: 8962.1, 1: 8749.8. Samples: 958528364. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:38,785][121949] Avg episode reward: [(0, '6280.275'), (1, '6101.456')] [2023-12-26 14:35:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001866304_477773824.pth... [2023-12-26 14:35:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001878032_480780288.pth... [2023-12-26 14:35:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001865280_477511680.pth [2023-12-26 14:35:38,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001877008_480518144.pth [2023-12-26 14:35:39,192][123090] Updated weights for policy 1, policy_version 1866305 (0.0009) [2023-12-26 14:35:39,265][123090] Updated weights for policy 1, policy_version 1866315 (0.0007) [2023-12-26 14:35:39,334][123090] Updated weights for policy 1, policy_version 1866325 (0.0009) [2023-12-26 14:35:39,392][123091] Updated weights for policy 0, policy_version 1878037 (0.0007) [2023-12-26 14:35:39,403][123090] Updated weights for policy 1, policy_version 1866335 (0.0010) [2023-12-26 14:35:39,456][123091] Updated weights for policy 0, policy_version 1878047 (0.0010) [2023-12-26 14:35:39,521][123091] Updated weights for policy 0, policy_version 1878057 (0.0009) [2023-12-26 14:35:40,186][123090] Updated weights for policy 1, policy_version 1866345 (0.0010) [2023-12-26 14:35:40,252][123090] Updated weights for policy 1, policy_version 1866355 (0.0008) [2023-12-26 14:35:40,320][123090] Updated weights for policy 1, policy_version 1866365 (0.0006) [2023-12-26 14:35:40,386][123091] Updated weights for policy 0, policy_version 1878067 (0.0010) [2023-12-26 14:35:40,442][123091] Updated weights for policy 0, policy_version 1878077 (0.0010) [2023-12-26 14:35:40,497][123091] Updated weights for policy 0, policy_version 1878087 (0.0009) [2023-12-26 14:35:41,065][123090] Updated weights for policy 1, policy_version 1866375 (0.0008) [2023-12-26 14:35:41,133][123090] Updated weights for policy 1, policy_version 1866385 (0.0008) [2023-12-26 14:35:41,198][123090] Updated weights for policy 1, policy_version 1866395 (0.0007) [2023-12-26 14:35:41,375][123091] Updated weights for policy 0, policy_version 1878097 (0.0010) [2023-12-26 14:35:41,445][123091] Updated weights for policy 0, policy_version 1878107 (0.0010) [2023-12-26 14:35:41,509][123091] Updated weights for policy 0, policy_version 1878117 (0.0010) [2023-12-26 14:35:41,564][123091] Updated weights for policy 0, policy_version 1878127 (0.0010) [2023-12-26 14:35:42,033][123090] Updated weights for policy 1, policy_version 1866405 (0.0007) [2023-12-26 14:35:42,106][123090] Updated weights for policy 1, policy_version 1866415 (0.0009) [2023-12-26 14:35:42,175][123090] Updated weights for policy 1, policy_version 1866425 (0.0009) [2023-12-26 14:35:42,420][123091] Updated weights for policy 0, policy_version 1878137 (0.0009) [2023-12-26 14:35:42,484][123091] Updated weights for policy 0, policy_version 1878147 (0.0010) [2023-12-26 14:35:42,556][123091] Updated weights for policy 0, policy_version 1878157 (0.0009) [2023-12-26 14:35:42,978][123090] Updated weights for policy 1, policy_version 1866435 (0.0010) [2023-12-26 14:35:43,033][123090] Updated weights for policy 1, policy_version 1866445 (0.0009) [2023-12-26 14:35:43,086][123090] Updated weights for policy 1, policy_version 1866455 (0.0010) [2023-12-26 14:35:43,391][123091] Updated weights for policy 0, policy_version 1878167 (0.0010) [2023-12-26 14:35:43,452][123091] Updated weights for policy 0, policy_version 1878177 (0.0009) [2023-12-26 14:35:43,505][123091] Updated weights for policy 0, policy_version 1878187 (0.0009) [2023-12-26 14:35:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 958636032. Throughput: 0: 8816.6, 1: 8641.2. Samples: 958630424. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:43,785][121949] Avg episode reward: [(0, '6209.158'), (1, '6111.893')] [2023-12-26 14:35:43,931][123090] Updated weights for policy 1, policy_version 1866465 (0.0009) [2023-12-26 14:35:44,004][123090] Updated weights for policy 1, policy_version 1866475 (0.0009) [2023-12-26 14:35:44,060][123090] Updated weights for policy 1, policy_version 1866485 (0.0010) [2023-12-26 14:35:44,116][123090] Updated weights for policy 1, policy_version 1866495 (0.0010) [2023-12-26 14:35:44,246][123091] Updated weights for policy 0, policy_version 1878197 (0.0010) [2023-12-26 14:35:44,296][123091] Updated weights for policy 0, policy_version 1878207 (0.0009) [2023-12-26 14:35:44,361][123091] Updated weights for policy 0, policy_version 1878217 (0.0009) [2023-12-26 14:35:44,900][123090] Updated weights for policy 1, policy_version 1866505 (0.0010) [2023-12-26 14:35:44,956][123090] Updated weights for policy 1, policy_version 1866515 (0.0010) [2023-12-26 14:35:45,013][123090] Updated weights for policy 1, policy_version 1866525 (0.0010) [2023-12-26 14:35:45,224][123091] Updated weights for policy 0, policy_version 1878227 (0.0009) [2023-12-26 14:35:45,286][123091] Updated weights for policy 0, policy_version 1878237 (0.0010) [2023-12-26 14:35:45,339][123091] Updated weights for policy 0, policy_version 1878247 (0.0009) [2023-12-26 14:35:45,870][123090] Updated weights for policy 1, policy_version 1866535 (0.0010) [2023-12-26 14:35:45,925][123090] Updated weights for policy 1, policy_version 1866545 (0.0009) [2023-12-26 14:35:45,985][123090] Updated weights for policy 1, policy_version 1866555 (0.0010) [2023-12-26 14:35:46,186][123091] Updated weights for policy 0, policy_version 1878257 (0.0010) [2023-12-26 14:35:46,245][123091] Updated weights for policy 0, policy_version 1878267 (0.0009) [2023-12-26 14:35:46,298][123091] Updated weights for policy 0, policy_version 1878277 (0.0009) [2023-12-26 14:35:46,347][123091] Updated weights for policy 0, policy_version 1878287 (0.0009) [2023-12-26 14:35:46,832][123090] Updated weights for policy 1, policy_version 1866565 (0.0007) [2023-12-26 14:35:46,882][123090] Updated weights for policy 1, policy_version 1866575 (0.0005) [2023-12-26 14:35:46,932][123090] Updated weights for policy 1, policy_version 1866585 (0.0005) [2023-12-26 14:35:47,236][123091] Updated weights for policy 0, policy_version 1878297 (0.0009) [2023-12-26 14:35:47,294][123091] Updated weights for policy 0, policy_version 1878307 (0.0007) [2023-12-26 14:35:47,366][123091] Updated weights for policy 0, policy_version 1878317 (0.0005) [2023-12-26 14:35:47,743][123090] Updated weights for policy 1, policy_version 1866595 (0.0009) [2023-12-26 14:35:47,804][123090] Updated weights for policy 1, policy_version 1866605 (0.0010) [2023-12-26 14:35:47,862][123090] Updated weights for policy 1, policy_version 1866615 (0.0009) [2023-12-26 14:35:48,097][123091] Updated weights for policy 0, policy_version 1878327 (0.0006) [2023-12-26 14:35:48,165][123091] Updated weights for policy 0, policy_version 1878337 (0.0010) [2023-12-26 14:35:48,232][123091] Updated weights for policy 0, policy_version 1878347 (0.0010) [2023-12-26 14:35:48,622][123090] Updated weights for policy 1, policy_version 1866625 (0.0009) [2023-12-26 14:35:48,685][123090] Updated weights for policy 1, policy_version 1866635 (0.0008) [2023-12-26 14:35:48,744][123090] Updated weights for policy 1, policy_version 1866645 (0.0009) [2023-12-26 14:35:48,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 958717952. Throughput: 0: 8791.2, 1: 8639.0. Samples: 958734996. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:48,785][121949] Avg episode reward: [(0, '6266.790'), (1, '5943.981')] [2023-12-26 14:35:48,809][123090] Updated weights for policy 1, policy_version 1866655 (0.0010) [2023-12-26 14:35:48,997][123091] Updated weights for policy 0, policy_version 1878357 (0.0008) [2023-12-26 14:35:49,046][123091] Updated weights for policy 0, policy_version 1878367 (0.0009) [2023-12-26 14:35:49,095][123091] Updated weights for policy 0, policy_version 1878377 (0.0010) [2023-12-26 14:35:49,702][123090] Updated weights for policy 1, policy_version 1866665 (0.0010) [2023-12-26 14:35:49,750][123090] Updated weights for policy 1, policy_version 1866676 (0.0010) [2023-12-26 14:35:49,813][123090] Updated weights for policy 1, policy_version 1866686 (0.0009) [2023-12-26 14:35:49,937][123091] Updated weights for policy 0, policy_version 1878387 (0.0009) [2023-12-26 14:35:50,001][123091] Updated weights for policy 0, policy_version 1878397 (0.0009) [2023-12-26 14:35:50,072][123091] Updated weights for policy 0, policy_version 1878407 (0.0010) [2023-12-26 14:35:50,659][123090] Updated weights for policy 1, policy_version 1866696 (0.0011) [2023-12-26 14:35:50,725][123090] Updated weights for policy 1, policy_version 1866706 (0.0007) [2023-12-26 14:35:50,785][123090] Updated weights for policy 1, policy_version 1866716 (0.0005) [2023-12-26 14:35:50,929][123091] Updated weights for policy 0, policy_version 1878417 (0.0010) [2023-12-26 14:35:51,000][123091] Updated weights for policy 0, policy_version 1878427 (0.0010) [2023-12-26 14:35:51,071][123091] Updated weights for policy 0, policy_version 1878437 (0.0010) [2023-12-26 14:35:51,138][123091] Updated weights for policy 0, policy_version 1878447 (0.0009) [2023-12-26 14:35:51,541][123090] Updated weights for policy 1, policy_version 1866726 (0.0009) [2023-12-26 14:35:51,603][123090] Updated weights for policy 1, policy_version 1866736 (0.0011) [2023-12-26 14:35:51,673][123090] Updated weights for policy 1, policy_version 1866746 (0.0010) [2023-12-26 14:35:51,902][123091] Updated weights for policy 0, policy_version 1878457 (0.0006) [2023-12-26 14:35:51,958][123091] Updated weights for policy 0, policy_version 1878467 (0.0005) [2023-12-26 14:35:52,025][123091] Updated weights for policy 0, policy_version 1878477 (0.0007) [2023-12-26 14:35:52,469][123090] Updated weights for policy 1, policy_version 1866756 (0.0009) [2023-12-26 14:35:52,525][123090] Updated weights for policy 1, policy_version 1866766 (0.0008) [2023-12-26 14:35:52,584][123090] Updated weights for policy 1, policy_version 1866776 (0.0008) [2023-12-26 14:35:52,835][123091] Updated weights for policy 0, policy_version 1878487 (0.0009) [2023-12-26 14:35:52,887][123091] Updated weights for policy 0, policy_version 1878497 (0.0009) [2023-12-26 14:35:52,944][123091] Updated weights for policy 0, policy_version 1878508 (0.0010) [2023-12-26 14:35:53,369][123090] Updated weights for policy 1, policy_version 1866786 (0.0008) [2023-12-26 14:35:53,440][123090] Updated weights for policy 1, policy_version 1866796 (0.0005) [2023-12-26 14:35:53,495][123090] Updated weights for policy 1, policy_version 1866806 (0.0005) [2023-12-26 14:35:53,543][123090] Updated weights for policy 1, policy_version 1866816 (0.0005) [2023-12-26 14:35:53,649][123091] Updated weights for policy 0, policy_version 1878518 (0.0010) [2023-12-26 14:35:53,704][123091] Updated weights for policy 0, policy_version 1878528 (0.0010) [2023-12-26 14:35:53,754][123091] Updated weights for policy 0, policy_version 1878538 (0.0010) [2023-12-26 14:35:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 958816256. Throughput: 0: 8711.7, 1: 8644.6. Samples: 958786416. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:53,784][121949] Avg episode reward: [(0, '6301.619'), (1, '5725.689')] [2023-12-26 14:35:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001866816_477904896.pth... [2023-12-26 14:35:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001878544_480911360.pth... [2023-12-26 14:35:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001865792_477642752.pth [2023-12-26 14:35:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001877520_480649216.pth [2023-12-26 14:35:54,181][123090] Updated weights for policy 1, policy_version 1866826 (0.0010) [2023-12-26 14:35:54,229][123090] Updated weights for policy 1, policy_version 1866836 (0.0010) [2023-12-26 14:35:54,279][123090] Updated weights for policy 1, policy_version 1866846 (0.0010) [2023-12-26 14:35:54,449][123091] Updated weights for policy 0, policy_version 1878548 (0.0009) [2023-12-26 14:35:54,502][123091] Updated weights for policy 0, policy_version 1878558 (0.0006) [2023-12-26 14:35:54,559][123091] Updated weights for policy 0, policy_version 1878568 (0.0005) [2023-12-26 14:35:55,078][123090] Updated weights for policy 1, policy_version 1866856 (0.0006) [2023-12-26 14:35:55,139][123090] Updated weights for policy 1, policy_version 1866866 (0.0005) [2023-12-26 14:35:55,201][123090] Updated weights for policy 1, policy_version 1866876 (0.0005) [2023-12-26 14:35:55,211][123091] Updated weights for policy 0, policy_version 1878578 (0.0008) [2023-12-26 14:35:55,288][123091] Updated weights for policy 0, policy_version 1878588 (0.0010) [2023-12-26 14:35:55,347][123091] Updated weights for policy 0, policy_version 1878598 (0.0010) [2023-12-26 14:35:55,410][123091] Updated weights for policy 0, policy_version 1878608 (0.0010) [2023-12-26 14:35:55,953][123090] Updated weights for policy 1, policy_version 1866886 (0.0008) [2023-12-26 14:35:56,012][123090] Updated weights for policy 1, policy_version 1866896 (0.0006) [2023-12-26 14:35:56,081][123090] Updated weights for policy 1, policy_version 1866906 (0.0006) [2023-12-26 14:35:56,108][123091] Updated weights for policy 0, policy_version 1878618 (0.0005) [2023-12-26 14:35:56,170][123091] Updated weights for policy 0, policy_version 1878628 (0.0005) [2023-12-26 14:35:56,259][123091] Updated weights for policy 0, policy_version 1878638 (0.0005) [2023-12-26 14:35:56,714][123090] Updated weights for policy 1, policy_version 1866916 (0.0007) [2023-12-26 14:35:56,765][123090] Updated weights for policy 1, policy_version 1866926 (0.0005) [2023-12-26 14:35:56,825][123090] Updated weights for policy 1, policy_version 1866936 (0.0006) [2023-12-26 14:35:57,036][123091] Updated weights for policy 0, policy_version 1878648 (0.0010) [2023-12-26 14:35:57,095][123091] Updated weights for policy 0, policy_version 1878658 (0.0010) [2023-12-26 14:35:57,141][123091] Updated weights for policy 0, policy_version 1878668 (0.0010) [2023-12-26 14:35:57,516][123090] Updated weights for policy 1, policy_version 1866946 (0.0005) [2023-12-26 14:35:57,570][123090] Updated weights for policy 1, policy_version 1866956 (0.0005) [2023-12-26 14:35:57,623][123090] Updated weights for policy 1, policy_version 1866966 (0.0008) [2023-12-26 14:35:57,678][123090] Updated weights for policy 1, policy_version 1866976 (0.0010) [2023-12-26 14:35:57,905][123091] Updated weights for policy 0, policy_version 1878678 (0.0007) [2023-12-26 14:35:57,953][123091] Updated weights for policy 0, policy_version 1878689 (0.0009) [2023-12-26 14:35:58,008][123091] Updated weights for policy 0, policy_version 1878699 (0.0008) [2023-12-26 14:35:58,512][123090] Updated weights for policy 1, policy_version 1866986 (0.0008) [2023-12-26 14:35:58,590][123090] Updated weights for policy 1, policy_version 1866996 (0.0008) [2023-12-26 14:35:58,664][123090] Updated weights for policy 1, policy_version 1867006 (0.0008) [2023-12-26 14:35:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 958906368. Throughput: 0: 8789.5, 1: 8834.0. Samples: 958901028. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:35:58,785][121949] Avg episode reward: [(0, '6206.215'), (1, '5771.354')] [2023-12-26 14:35:58,928][123091] Updated weights for policy 0, policy_version 1878709 (0.0008) [2023-12-26 14:35:58,990][123091] Updated weights for policy 0, policy_version 1878719 (0.0008) [2023-12-26 14:35:59,042][123091] Updated weights for policy 0, policy_version 1878729 (0.0010) [2023-12-26 14:35:59,589][123090] Updated weights for policy 1, policy_version 1867016 (0.0009) [2023-12-26 14:35:59,648][123090] Updated weights for policy 1, policy_version 1867026 (0.0009) [2023-12-26 14:35:59,701][123090] Updated weights for policy 1, policy_version 1867036 (0.0009) [2023-12-26 14:35:59,949][123091] Updated weights for policy 0, policy_version 1878739 (0.0010) [2023-12-26 14:36:00,013][123091] Updated weights for policy 0, policy_version 1878749 (0.0011) [2023-12-26 14:36:00,069][123091] Updated weights for policy 0, policy_version 1878759 (0.0010) [2023-12-26 14:36:00,434][123090] Updated weights for policy 1, policy_version 1867046 (0.0007) [2023-12-26 14:36:00,495][123090] Updated weights for policy 1, policy_version 1867056 (0.0009) [2023-12-26 14:36:00,553][123090] Updated weights for policy 1, policy_version 1867066 (0.0010) [2023-12-26 14:36:00,794][123091] Updated weights for policy 0, policy_version 1878769 (0.0010) [2023-12-26 14:36:00,850][123091] Updated weights for policy 0, policy_version 1878779 (0.0005) [2023-12-26 14:36:00,897][123091] Updated weights for policy 0, policy_version 1878789 (0.0010) [2023-12-26 14:36:00,959][123091] Updated weights for policy 0, policy_version 1878799 (0.0010) [2023-12-26 14:36:01,318][123090] Updated weights for policy 1, policy_version 1867076 (0.0009) [2023-12-26 14:36:01,384][123090] Updated weights for policy 1, policy_version 1867087 (0.0007) [2023-12-26 14:36:01,447][123090] Updated weights for policy 1, policy_version 1867097 (0.0006) [2023-12-26 14:36:01,846][123091] Updated weights for policy 0, policy_version 1878809 (0.0010) [2023-12-26 14:36:01,900][123091] Updated weights for policy 0, policy_version 1878819 (0.0006) [2023-12-26 14:36:01,960][123091] Updated weights for policy 0, policy_version 1878829 (0.0006) [2023-12-26 14:36:02,191][123090] Updated weights for policy 1, policy_version 1867107 (0.0005) [2023-12-26 14:36:02,267][123090] Updated weights for policy 1, policy_version 1867117 (0.0007) [2023-12-26 14:36:02,322][123090] Updated weights for policy 1, policy_version 1867127 (0.0006) [2023-12-26 14:36:02,622][123091] Updated weights for policy 0, policy_version 1878839 (0.0009) [2023-12-26 14:36:02,677][123091] Updated weights for policy 0, policy_version 1878849 (0.0010) [2023-12-26 14:36:02,732][123091] Updated weights for policy 0, policy_version 1878859 (0.0011) [2023-12-26 14:36:03,009][123090] Updated weights for policy 1, policy_version 1867137 (0.0007) [2023-12-26 14:36:03,062][123090] Updated weights for policy 1, policy_version 1867147 (0.0005) [2023-12-26 14:36:03,115][123090] Updated weights for policy 1, policy_version 1867157 (0.0006) [2023-12-26 14:36:03,162][123090] Updated weights for policy 1, policy_version 1867167 (0.0010) [2023-12-26 14:36:03,572][123091] Updated weights for policy 0, policy_version 1878869 (0.0008) [2023-12-26 14:36:03,646][123091] Updated weights for policy 0, policy_version 1878879 (0.0010) [2023-12-26 14:36:03,697][123091] Updated weights for policy 0, policy_version 1878889 (0.0008) [2023-12-26 14:36:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 958996480. Throughput: 0: 8741.0, 1: 8865.3. Samples: 959006732. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:03,785][121949] Avg episode reward: [(0, '6160.615'), (1, '5814.795')] [2023-12-26 14:36:03,904][123090] Updated weights for policy 1, policy_version 1867177 (0.0008) [2023-12-26 14:36:03,964][123090] Updated weights for policy 1, policy_version 1867187 (0.0011) [2023-12-26 14:36:04,032][123090] Updated weights for policy 1, policy_version 1867197 (0.0008) [2023-12-26 14:36:04,435][123091] Updated weights for policy 0, policy_version 1878899 (0.0006) [2023-12-26 14:36:04,507][123091] Updated weights for policy 0, policy_version 1878909 (0.0006) [2023-12-26 14:36:04,569][123091] Updated weights for policy 0, policy_version 1878919 (0.0011) [2023-12-26 14:36:04,785][123090] Updated weights for policy 1, policy_version 1867207 (0.0008) [2023-12-26 14:36:04,850][123090] Updated weights for policy 1, policy_version 1867217 (0.0006) [2023-12-26 14:36:04,906][123090] Updated weights for policy 1, policy_version 1867227 (0.0005) [2023-12-26 14:36:05,372][123091] Updated weights for policy 0, policy_version 1878929 (0.0011) [2023-12-26 14:36:05,437][123091] Updated weights for policy 0, policy_version 1878939 (0.0010) [2023-12-26 14:36:05,502][123091] Updated weights for policy 0, policy_version 1878949 (0.0010) [2023-12-26 14:36:05,548][123090] Updated weights for policy 1, policy_version 1867237 (0.0008) [2023-12-26 14:36:05,564][123091] Updated weights for policy 0, policy_version 1878959 (0.0010) [2023-12-26 14:36:05,610][123090] Updated weights for policy 1, policy_version 1867247 (0.0010) [2023-12-26 14:36:05,665][123090] Updated weights for policy 1, policy_version 1867257 (0.0009) [2023-12-26 14:36:06,277][123091] Updated weights for policy 0, policy_version 1878969 (0.0011) [2023-12-26 14:36:06,333][123091] Updated weights for policy 0, policy_version 1878979 (0.0010) [2023-12-26 14:36:06,377][123091] Updated weights for policy 0, policy_version 1878989 (0.0010) [2023-12-26 14:36:06,422][123090] Updated weights for policy 1, policy_version 1867267 (0.0006) [2023-12-26 14:36:06,490][123090] Updated weights for policy 1, policy_version 1867277 (0.0008) [2023-12-26 14:36:06,554][123090] Updated weights for policy 1, policy_version 1867287 (0.0009) [2023-12-26 14:36:07,100][123091] Updated weights for policy 0, policy_version 1878999 (0.0007) [2023-12-26 14:36:07,165][123091] Updated weights for policy 0, policy_version 1879009 (0.0006) [2023-12-26 14:36:07,228][123091] Updated weights for policy 0, policy_version 1879019 (0.0006) [2023-12-26 14:36:07,360][123090] Updated weights for policy 1, policy_version 1867297 (0.0009) [2023-12-26 14:36:07,413][123090] Updated weights for policy 1, policy_version 1867307 (0.0005) [2023-12-26 14:36:07,469][123090] Updated weights for policy 1, policy_version 1867317 (0.0006) [2023-12-26 14:36:07,536][123090] Updated weights for policy 1, policy_version 1867327 (0.0005) [2023-12-26 14:36:07,761][123091] Updated weights for policy 0, policy_version 1879029 (0.0006) [2023-12-26 14:36:07,809][123091] Updated weights for policy 0, policy_version 1879039 (0.0006) [2023-12-26 14:36:07,857][123091] Updated weights for policy 0, policy_version 1879049 (0.0005) [2023-12-26 14:36:08,270][123090] Updated weights for policy 1, policy_version 1867337 (0.0005) [2023-12-26 14:36:08,337][123090] Updated weights for policy 1, policy_version 1867347 (0.0006) [2023-12-26 14:36:08,397][123090] Updated weights for policy 1, policy_version 1867357 (0.0008) [2023-12-26 14:36:08,679][123091] Updated weights for policy 0, policy_version 1879059 (0.0007) [2023-12-26 14:36:08,732][123091] Updated weights for policy 0, policy_version 1879069 (0.0009) [2023-12-26 14:36:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 959086592. Throughput: 0: 8771.6, 1: 8919.7. Samples: 959062840. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:08,785][121949] Avg episode reward: [(0, '6233.659'), (1, '5897.496')] [2023-12-26 14:36:08,789][123091] Updated weights for policy 0, policy_version 1879079 (0.0008) [2023-12-26 14:36:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001867360_478044160.pth... [2023-12-26 14:36:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001866304_477773824.pth [2023-12-26 14:36:08,844][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001879088_481050624.pth... [2023-12-26 14:36:08,848][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001878032_480780288.pth [2023-12-26 14:36:09,194][123090] Updated weights for policy 1, policy_version 1867367 (0.0010) [2023-12-26 14:36:09,268][123090] Updated weights for policy 1, policy_version 1867377 (0.0010) [2023-12-26 14:36:09,326][123090] Updated weights for policy 1, policy_version 1867387 (0.0007) [2023-12-26 14:36:09,610][123091] Updated weights for policy 0, policy_version 1879089 (0.0009) [2023-12-26 14:36:09,682][123091] Updated weights for policy 0, policy_version 1879099 (0.0009) [2023-12-26 14:36:09,755][123091] Updated weights for policy 0, policy_version 1879109 (0.0009) [2023-12-26 14:36:09,826][123091] Updated weights for policy 0, policy_version 1879119 (0.0006) [2023-12-26 14:36:10,146][123090] Updated weights for policy 1, policy_version 1867397 (0.0009) [2023-12-26 14:36:10,206][123090] Updated weights for policy 1, policy_version 1867407 (0.0008) [2023-12-26 14:36:10,277][123090] Updated weights for policy 1, policy_version 1867417 (0.0008) [2023-12-26 14:36:10,610][123091] Updated weights for policy 0, policy_version 1879129 (0.0009) [2023-12-26 14:36:10,659][123091] Updated weights for policy 0, policy_version 1879139 (0.0007) [2023-12-26 14:36:10,714][123091] Updated weights for policy 0, policy_version 1879149 (0.0006) [2023-12-26 14:36:11,072][123090] Updated weights for policy 1, policy_version 1867427 (0.0009) [2023-12-26 14:36:11,145][123090] Updated weights for policy 1, policy_version 1867437 (0.0010) [2023-12-26 14:36:11,201][123090] Updated weights for policy 1, policy_version 1867447 (0.0009) [2023-12-26 14:36:11,520][123091] Updated weights for policy 0, policy_version 1879159 (0.0009) [2023-12-26 14:36:11,575][123091] Updated weights for policy 0, policy_version 1879169 (0.0009) [2023-12-26 14:36:11,640][123091] Updated weights for policy 0, policy_version 1879179 (0.0010) [2023-12-26 14:36:11,990][123090] Updated weights for policy 1, policy_version 1867457 (0.0010) [2023-12-26 14:36:12,066][123090] Updated weights for policy 1, policy_version 1867467 (0.0010) [2023-12-26 14:36:12,133][123090] Updated weights for policy 1, policy_version 1867477 (0.0010) [2023-12-26 14:36:12,205][123090] Updated weights for policy 1, policy_version 1867487 (0.0007) [2023-12-26 14:36:12,436][123091] Updated weights for policy 0, policy_version 1879189 (0.0007) [2023-12-26 14:36:12,500][123091] Updated weights for policy 0, policy_version 1879199 (0.0009) [2023-12-26 14:36:12,558][123091] Updated weights for policy 0, policy_version 1879209 (0.0010) [2023-12-26 14:36:12,971][123090] Updated weights for policy 1, policy_version 1867497 (0.0010) [2023-12-26 14:36:13,037][123090] Updated weights for policy 1, policy_version 1867507 (0.0010) [2023-12-26 14:36:13,096][123090] Updated weights for policy 1, policy_version 1867517 (0.0011) [2023-12-26 14:36:13,287][123091] Updated weights for policy 0, policy_version 1879219 (0.0009) [2023-12-26 14:36:13,346][123091] Updated weights for policy 0, policy_version 1879229 (0.0005) [2023-12-26 14:36:13,413][123091] Updated weights for policy 0, policy_version 1879239 (0.0005) [2023-12-26 14:36:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 959176704. Throughput: 0: 8820.1, 1: 8898.8. Samples: 959170320. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:13,785][121949] Avg episode reward: [(0, '6243.524'), (1, '5843.786')] [2023-12-26 14:36:13,904][123090] Updated weights for policy 1, policy_version 1867527 (0.0011) [2023-12-26 14:36:13,963][123090] Updated weights for policy 1, policy_version 1867537 (0.0010) [2023-12-26 14:36:14,026][123090] Updated weights for policy 1, policy_version 1867547 (0.0010) [2023-12-26 14:36:14,107][123091] Updated weights for policy 0, policy_version 1879249 (0.0010) [2023-12-26 14:36:14,172][123091] Updated weights for policy 0, policy_version 1879259 (0.0006) [2023-12-26 14:36:14,225][123091] Updated weights for policy 0, policy_version 1879269 (0.0005) [2023-12-26 14:36:14,293][123091] Updated weights for policy 0, policy_version 1879279 (0.0005) [2023-12-26 14:36:14,876][123090] Updated weights for policy 1, policy_version 1867557 (0.0010) [2023-12-26 14:36:14,928][123090] Updated weights for policy 1, policy_version 1867567 (0.0006) [2023-12-26 14:36:14,928][123091] Updated weights for policy 0, policy_version 1879289 (0.0006) [2023-12-26 14:36:14,990][123091] Updated weights for policy 0, policy_version 1879299 (0.0008) [2023-12-26 14:36:14,992][123090] Updated weights for policy 1, policy_version 1867577 (0.0006) [2023-12-26 14:36:15,058][123091] Updated weights for policy 0, policy_version 1879309 (0.0006) [2023-12-26 14:36:15,760][123091] Updated weights for policy 0, policy_version 1879319 (0.0006) [2023-12-26 14:36:15,822][123091] Updated weights for policy 0, policy_version 1879329 (0.0005) [2023-12-26 14:36:15,859][123090] Updated weights for policy 1, policy_version 1867587 (0.0007) [2023-12-26 14:36:15,877][123091] Updated weights for policy 0, policy_version 1879339 (0.0005) [2023-12-26 14:36:15,912][123090] Updated weights for policy 1, policy_version 1867597 (0.0006) [2023-12-26 14:36:15,964][123090] Updated weights for policy 1, policy_version 1867607 (0.0006) [2023-12-26 14:36:16,585][123091] Updated weights for policy 0, policy_version 1879349 (0.0008) [2023-12-26 14:36:16,647][123090] Updated weights for policy 1, policy_version 1867617 (0.0006) [2023-12-26 14:36:16,647][123091] Updated weights for policy 0, policy_version 1879359 (0.0009) [2023-12-26 14:36:16,713][123090] Updated weights for policy 1, policy_version 1867627 (0.0009) [2023-12-26 14:36:16,714][123091] Updated weights for policy 0, policy_version 1879369 (0.0009) [2023-12-26 14:36:16,775][123090] Updated weights for policy 1, policy_version 1867637 (0.0007) [2023-12-26 14:36:16,838][123090] Updated weights for policy 1, policy_version 1867647 (0.0009) [2023-12-26 14:36:17,547][123091] Updated weights for policy 0, policy_version 1879379 (0.0010) [2023-12-26 14:36:17,572][123090] Updated weights for policy 1, policy_version 1867657 (0.0006) [2023-12-26 14:36:17,601][123091] Updated weights for policy 0, policy_version 1879389 (0.0009) [2023-12-26 14:36:17,643][123090] Updated weights for policy 1, policy_version 1867667 (0.0005) [2023-12-26 14:36:17,657][123091] Updated weights for policy 0, policy_version 1879399 (0.0009) [2023-12-26 14:36:17,712][123090] Updated weights for policy 1, policy_version 1867677 (0.0006) [2023-12-26 14:36:18,381][123090] Updated weights for policy 1, policy_version 1867687 (0.0009) [2023-12-26 14:36:18,398][123091] Updated weights for policy 0, policy_version 1879409 (0.0006) [2023-12-26 14:36:18,439][123090] Updated weights for policy 1, policy_version 1867697 (0.0007) [2023-12-26 14:36:18,462][123091] Updated weights for policy 0, policy_version 1879419 (0.0010) [2023-12-26 14:36:18,498][123090] Updated weights for policy 1, policy_version 1867707 (0.0006) [2023-12-26 14:36:18,521][123091] Updated weights for policy 0, policy_version 1879429 (0.0010) [2023-12-26 14:36:18,584][123091] Updated weights for policy 0, policy_version 1879439 (0.0011) [2023-12-26 14:36:18,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 959275008. Throughput: 0: 8976.7, 1: 8969.6. Samples: 959283176. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:18,784][121949] Avg episode reward: [(0, '6277.847'), (1, '5871.811')] [2023-12-26 14:36:19,309][123090] Updated weights for policy 1, policy_version 1867717 (0.0006) [2023-12-26 14:36:19,315][123091] Updated weights for policy 0, policy_version 1879449 (0.0011) [2023-12-26 14:36:19,379][123090] Updated weights for policy 1, policy_version 1867727 (0.0009) [2023-12-26 14:36:19,384][123091] Updated weights for policy 0, policy_version 1879459 (0.0013) [2023-12-26 14:36:19,432][123090] Updated weights for policy 1, policy_version 1867737 (0.0008) [2023-12-26 14:36:19,441][123091] Updated weights for policy 0, policy_version 1879469 (0.0008) [2023-12-26 14:36:20,258][123090] Updated weights for policy 1, policy_version 1867747 (0.0008) [2023-12-26 14:36:20,306][123091] Updated weights for policy 0, policy_version 1879479 (0.0010) [2023-12-26 14:36:20,322][123090] Updated weights for policy 1, policy_version 1867757 (0.0009) [2023-12-26 14:36:20,363][123091] Updated weights for policy 0, policy_version 1879489 (0.0009) [2023-12-26 14:36:20,395][123090] Updated weights for policy 1, policy_version 1867767 (0.0006) [2023-12-26 14:36:20,421][123091] Updated weights for policy 0, policy_version 1879499 (0.0009) [2023-12-26 14:36:21,048][123090] Updated weights for policy 1, policy_version 1867777 (0.0006) [2023-12-26 14:36:21,114][123090] Updated weights for policy 1, policy_version 1867787 (0.0009) [2023-12-26 14:36:21,185][123090] Updated weights for policy 1, policy_version 1867797 (0.0010) [2023-12-26 14:36:21,258][123090] Updated weights for policy 1, policy_version 1867807 (0.0010) [2023-12-26 14:36:21,320][123091] Updated weights for policy 0, policy_version 1879509 (0.0010) [2023-12-26 14:36:21,401][123091] Updated weights for policy 0, policy_version 1879519 (0.0010) [2023-12-26 14:36:21,466][123091] Updated weights for policy 0, policy_version 1879529 (0.0010) [2023-12-26 14:36:22,142][123090] Updated weights for policy 1, policy_version 1867817 (0.0008) [2023-12-26 14:36:22,215][123090] Updated weights for policy 1, policy_version 1867827 (0.0009) [2023-12-26 14:36:22,284][123090] Updated weights for policy 1, policy_version 1867837 (0.0010) [2023-12-26 14:36:22,363][123091] Updated weights for policy 0, policy_version 1879539 (0.0009) [2023-12-26 14:36:22,442][123091] Updated weights for policy 0, policy_version 1879549 (0.0008) [2023-12-26 14:36:22,516][123091] Updated weights for policy 0, policy_version 1879559 (0.0006) [2023-12-26 14:36:23,045][123090] Updated weights for policy 1, policy_version 1867847 (0.0008) [2023-12-26 14:36:23,112][123090] Updated weights for policy 1, policy_version 1867857 (0.0006) [2023-12-26 14:36:23,182][123090] Updated weights for policy 1, policy_version 1867867 (0.0006) [2023-12-26 14:36:23,303][123091] Updated weights for policy 0, policy_version 1879569 (0.0006) [2023-12-26 14:36:23,352][123091] Updated weights for policy 0, policy_version 1879579 (0.0005) [2023-12-26 14:36:23,401][123091] Updated weights for policy 0, policy_version 1879589 (0.0005) [2023-12-26 14:36:23,454][123091] Updated weights for policy 0, policy_version 1879599 (0.0005) [2023-12-26 14:36:23,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 959356928. Throughput: 0: 8953.2, 1: 8953.4. Samples: 959334168. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:23,785][121949] Avg episode reward: [(0, '6302.114'), (1, '6071.959')] [2023-12-26 14:36:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001879600_481181696.pth... [2023-12-26 14:36:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001867872_478175232.pth... [2023-12-26 14:36:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001878544_480911360.pth [2023-12-26 14:36:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001866816_477904896.pth [2023-12-26 14:36:24,020][123090] Updated weights for policy 1, policy_version 1867877 (0.0007) [2023-12-26 14:36:24,087][123090] Updated weights for policy 1, policy_version 1867887 (0.0007) [2023-12-26 14:36:24,153][123090] Updated weights for policy 1, policy_version 1867897 (0.0011) [2023-12-26 14:36:24,205][123091] Updated weights for policy 0, policy_version 1879609 (0.0007) [2023-12-26 14:36:24,269][123091] Updated weights for policy 0, policy_version 1879619 (0.0009) [2023-12-26 14:36:24,334][123091] Updated weights for policy 0, policy_version 1879629 (0.0009) [2023-12-26 14:36:24,946][123090] Updated weights for policy 1, policy_version 1867907 (0.0009) [2023-12-26 14:36:25,013][123090] Updated weights for policy 1, policy_version 1867917 (0.0009) [2023-12-26 14:36:25,076][123090] Updated weights for policy 1, policy_version 1867927 (0.0010) [2023-12-26 14:36:25,188][123091] Updated weights for policy 0, policy_version 1879639 (0.0010) [2023-12-26 14:36:25,245][123091] Updated weights for policy 0, policy_version 1879649 (0.0009) [2023-12-26 14:36:25,294][123091] Updated weights for policy 0, policy_version 1879659 (0.0009) [2023-12-26 14:36:25,875][123090] Updated weights for policy 1, policy_version 1867937 (0.0009) [2023-12-26 14:36:25,941][123090] Updated weights for policy 1, policy_version 1867947 (0.0006) [2023-12-26 14:36:25,995][123090] Updated weights for policy 1, policy_version 1867957 (0.0005) [2023-12-26 14:36:26,056][123090] Updated weights for policy 1, policy_version 1867967 (0.0005) [2023-12-26 14:36:26,189][123091] Updated weights for policy 0, policy_version 1879669 (0.0010) [2023-12-26 14:36:26,238][123091] Updated weights for policy 0, policy_version 1879679 (0.0009) [2023-12-26 14:36:26,287][123091] Updated weights for policy 0, policy_version 1879689 (0.0009) [2023-12-26 14:36:26,799][123090] Updated weights for policy 1, policy_version 1867977 (0.0009) [2023-12-26 14:36:26,862][123090] Updated weights for policy 1, policy_version 1867987 (0.0007) [2023-12-26 14:36:26,922][123090] Updated weights for policy 1, policy_version 1867997 (0.0005) [2023-12-26 14:36:27,107][123091] Updated weights for policy 0, policy_version 1879699 (0.0009) [2023-12-26 14:36:27,174][123091] Updated weights for policy 0, policy_version 1879709 (0.0006) [2023-12-26 14:36:27,234][123091] Updated weights for policy 0, policy_version 1879719 (0.0005) [2023-12-26 14:36:27,663][123090] Updated weights for policy 1, policy_version 1868007 (0.0005) [2023-12-26 14:36:27,718][123090] Updated weights for policy 1, policy_version 1868017 (0.0005) [2023-12-26 14:36:27,766][123090] Updated weights for policy 1, policy_version 1868027 (0.0005) [2023-12-26 14:36:27,849][123091] Updated weights for policy 0, policy_version 1879729 (0.0006) [2023-12-26 14:36:27,901][123091] Updated weights for policy 0, policy_version 1879740 (0.0010) [2023-12-26 14:36:27,953][123091] Updated weights for policy 0, policy_version 1879752 (0.0010) [2023-12-26 14:36:28,538][123090] Updated weights for policy 1, policy_version 1868037 (0.0008) [2023-12-26 14:36:28,588][123090] Updated weights for policy 1, policy_version 1868047 (0.0010) [2023-12-26 14:36:28,640][123090] Updated weights for policy 1, policy_version 1868057 (0.0009) [2023-12-26 14:36:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 959447040. Throughput: 0: 8998.8, 1: 8981.9. Samples: 959439552. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:28,785][121949] Avg episode reward: [(0, '6237.414'), (1, '6052.993')] [2023-12-26 14:36:28,831][123091] Updated weights for policy 0, policy_version 1879762 (0.0009) [2023-12-26 14:36:28,895][123091] Updated weights for policy 0, policy_version 1879772 (0.0009) [2023-12-26 14:36:28,951][123091] Updated weights for policy 0, policy_version 1879782 (0.0009) [2023-12-26 14:36:29,006][123091] Updated weights for policy 0, policy_version 1879792 (0.0009) [2023-12-26 14:36:29,499][123090] Updated weights for policy 1, policy_version 1868067 (0.0010) [2023-12-26 14:36:29,549][123090] Updated weights for policy 1, policy_version 1868077 (0.0009) [2023-12-26 14:36:29,606][123090] Updated weights for policy 1, policy_version 1868087 (0.0009) [2023-12-26 14:36:29,833][123091] Updated weights for policy 0, policy_version 1879802 (0.0010) [2023-12-26 14:36:29,901][123091] Updated weights for policy 0, policy_version 1879812 (0.0010) [2023-12-26 14:36:29,963][123091] Updated weights for policy 0, policy_version 1879822 (0.0010) [2023-12-26 14:36:30,442][123090] Updated weights for policy 1, policy_version 1868097 (0.0009) [2023-12-26 14:36:30,525][123090] Updated weights for policy 1, policy_version 1868107 (0.0010) [2023-12-26 14:36:30,593][123090] Updated weights for policy 1, policy_version 1868117 (0.0007) [2023-12-26 14:36:30,661][123090] Updated weights for policy 1, policy_version 1868127 (0.0011) [2023-12-26 14:36:30,832][123091] Updated weights for policy 0, policy_version 1879832 (0.0009) [2023-12-26 14:36:30,899][123091] Updated weights for policy 0, policy_version 1879842 (0.0007) [2023-12-26 14:36:30,972][123091] Updated weights for policy 0, policy_version 1879852 (0.0007) [2023-12-26 14:36:31,425][123090] Updated weights for policy 1, policy_version 1868137 (0.0010) [2023-12-26 14:36:31,495][123090] Updated weights for policy 1, policy_version 1868147 (0.0009) [2023-12-26 14:36:31,567][123090] Updated weights for policy 1, policy_version 1868157 (0.0008) [2023-12-26 14:36:31,826][123091] Updated weights for policy 0, policy_version 1879862 (0.0007) [2023-12-26 14:36:31,885][123091] Updated weights for policy 0, policy_version 1879872 (0.0005) [2023-12-26 14:36:31,958][123091] Updated weights for policy 0, policy_version 1879882 (0.0005) [2023-12-26 14:36:32,406][123090] Updated weights for policy 1, policy_version 1868167 (0.0008) [2023-12-26 14:36:32,474][123090] Updated weights for policy 1, policy_version 1868177 (0.0010) [2023-12-26 14:36:32,534][123090] Updated weights for policy 1, policy_version 1868187 (0.0010) [2023-12-26 14:36:32,558][123091] Updated weights for policy 0, policy_version 1879892 (0.0008) [2023-12-26 14:36:32,618][123091] Updated weights for policy 0, policy_version 1879902 (0.0009) [2023-12-26 14:36:32,698][123091] Updated weights for policy 0, policy_version 1879912 (0.0009) [2023-12-26 14:36:33,147][123090] Updated weights for policy 1, policy_version 1868197 (0.0006) [2023-12-26 14:36:33,202][123090] Updated weights for policy 1, policy_version 1868207 (0.0005) [2023-12-26 14:36:33,258][123090] Updated weights for policy 1, policy_version 1868217 (0.0007) [2023-12-26 14:36:33,560][123091] Updated weights for policy 0, policy_version 1879922 (0.0010) [2023-12-26 14:36:33,634][123091] Updated weights for policy 0, policy_version 1879932 (0.0010) [2023-12-26 14:36:33,711][123091] Updated weights for policy 0, policy_version 1879942 (0.0010) [2023-12-26 14:36:33,775][123091] Updated weights for policy 0, policy_version 1879952 (0.0010) [2023-12-26 14:36:33,784][121949] Fps is (10 sec: 18023.5, 60 sec: 18022.5, 300 sec: 17716.9). Total num frames: 959537152. Throughput: 0: 8996.3, 1: 9007.6. Samples: 959545168. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:33,784][121949] Avg episode reward: [(0, '6164.612'), (1, '5831.976')] [2023-12-26 14:36:33,999][123090] Updated weights for policy 1, policy_version 1868227 (0.0009) [2023-12-26 14:36:34,071][123090] Updated weights for policy 1, policy_version 1868237 (0.0009) [2023-12-26 14:36:34,133][123090] Updated weights for policy 1, policy_version 1868247 (0.0010) [2023-12-26 14:36:34,570][123091] Updated weights for policy 0, policy_version 1879962 (0.0006) [2023-12-26 14:36:34,639][123091] Updated weights for policy 0, policy_version 1879972 (0.0007) [2023-12-26 14:36:34,701][123091] Updated weights for policy 0, policy_version 1879982 (0.0009) [2023-12-26 14:36:35,034][123090] Updated weights for policy 1, policy_version 1868257 (0.0010) [2023-12-26 14:36:35,095][123090] Updated weights for policy 1, policy_version 1868267 (0.0009) [2023-12-26 14:36:35,146][123090] Updated weights for policy 1, policy_version 1868277 (0.0009) [2023-12-26 14:36:35,206][123090] Updated weights for policy 1, policy_version 1868287 (0.0009) [2023-12-26 14:36:35,432][123091] Updated weights for policy 0, policy_version 1879993 (0.0009) [2023-12-26 14:36:35,480][123091] Updated weights for policy 0, policy_version 1880003 (0.0009) [2023-12-26 14:36:35,539][123091] Updated weights for policy 0, policy_version 1880013 (0.0009) [2023-12-26 14:36:36,114][123090] Updated weights for policy 1, policy_version 1868297 (0.0010) [2023-12-26 14:36:36,174][123090] Updated weights for policy 1, policy_version 1868307 (0.0009) [2023-12-26 14:36:36,235][123090] Updated weights for policy 1, policy_version 1868317 (0.0009) [2023-12-26 14:36:36,296][123091] Updated weights for policy 0, policy_version 1880023 (0.0007) [2023-12-26 14:36:36,366][123091] Updated weights for policy 0, policy_version 1880033 (0.0008) [2023-12-26 14:36:36,432][123091] Updated weights for policy 0, policy_version 1880043 (0.0009) [2023-12-26 14:36:37,110][123091] Updated weights for policy 0, policy_version 1880053 (0.0009) [2023-12-26 14:36:37,125][123090] Updated weights for policy 1, policy_version 1868327 (0.0008) [2023-12-26 14:36:37,167][123091] Updated weights for policy 0, policy_version 1880063 (0.0009) [2023-12-26 14:36:37,183][123090] Updated weights for policy 1, policy_version 1868337 (0.0008) [2023-12-26 14:36:37,225][123091] Updated weights for policy 0, policy_version 1880073 (0.0008) [2023-12-26 14:36:37,248][123090] Updated weights for policy 1, policy_version 1868347 (0.0008) [2023-12-26 14:36:37,977][123091] Updated weights for policy 0, policy_version 1880083 (0.0009) [2023-12-26 14:36:38,044][123091] Updated weights for policy 0, policy_version 1880093 (0.0011) [2023-12-26 14:36:38,062][123090] Updated weights for policy 1, policy_version 1868357 (0.0007) [2023-12-26 14:36:38,114][123091] Updated weights for policy 0, policy_version 1880103 (0.0011) [2023-12-26 14:36:38,141][123090] Updated weights for policy 1, policy_version 1868367 (0.0006) [2023-12-26 14:36:38,213][123090] Updated weights for policy 1, policy_version 1868377 (0.0005) [2023-12-26 14:36:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 959619072. Throughput: 0: 9031.9, 1: 8982.7. Samples: 959597072. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:38,785][121949] Avg episode reward: [(0, '6101.171'), (1, '5665.101')] [2023-12-26 14:36:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001880112_481312768.pth... [2023-12-26 14:36:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001868384_478306304.pth... [2023-12-26 14:36:38,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001867360_478044160.pth [2023-12-26 14:36:38,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001879088_481050624.pth [2023-12-26 14:36:38,921][123091] Updated weights for policy 0, policy_version 1880113 (0.0011) [2023-12-26 14:36:38,961][123090] Updated weights for policy 1, policy_version 1868387 (0.0005) [2023-12-26 14:36:38,980][123091] Updated weights for policy 0, policy_version 1880123 (0.0010) [2023-12-26 14:36:39,025][123090] Updated weights for policy 1, policy_version 1868397 (0.0006) [2023-12-26 14:36:39,039][123091] Updated weights for policy 0, policy_version 1880133 (0.0011) [2023-12-26 14:36:39,084][123090] Updated weights for policy 1, policy_version 1868407 (0.0006) [2023-12-26 14:36:39,098][123091] Updated weights for policy 0, policy_version 1880143 (0.0011) [2023-12-26 14:36:39,944][123090] Updated weights for policy 1, policy_version 1868417 (0.0009) [2023-12-26 14:36:39,985][123091] Updated weights for policy 0, policy_version 1880153 (0.0009) [2023-12-26 14:36:39,997][123090] Updated weights for policy 1, policy_version 1868427 (0.0008) [2023-12-26 14:36:40,040][123091] Updated weights for policy 0, policy_version 1880163 (0.0008) [2023-12-26 14:36:40,063][123090] Updated weights for policy 1, policy_version 1868437 (0.0009) [2023-12-26 14:36:40,094][123091] Updated weights for policy 0, policy_version 1880173 (0.0009) [2023-12-26 14:36:40,124][123090] Updated weights for policy 1, policy_version 1868447 (0.0009) [2023-12-26 14:36:40,929][123090] Updated weights for policy 1, policy_version 1868457 (0.0009) [2023-12-26 14:36:40,982][123091] Updated weights for policy 0, policy_version 1880183 (0.0009) [2023-12-26 14:36:40,997][123090] Updated weights for policy 1, policy_version 1868467 (0.0008) [2023-12-26 14:36:41,048][123091] Updated weights for policy 0, policy_version 1880193 (0.0009) [2023-12-26 14:36:41,066][123090] Updated weights for policy 1, policy_version 1868477 (0.0008) [2023-12-26 14:36:41,120][123091] Updated weights for policy 0, policy_version 1880203 (0.0007) [2023-12-26 14:36:41,936][123090] Updated weights for policy 1, policy_version 1868487 (0.0010) [2023-12-26 14:36:41,956][123091] Updated weights for policy 0, policy_version 1880213 (0.0008) [2023-12-26 14:36:42,000][123090] Updated weights for policy 1, policy_version 1868497 (0.0011) [2023-12-26 14:36:42,020][123091] Updated weights for policy 0, policy_version 1880223 (0.0007) [2023-12-26 14:36:42,064][123090] Updated weights for policy 1, policy_version 1868507 (0.0010) [2023-12-26 14:36:42,080][123091] Updated weights for policy 0, policy_version 1880233 (0.0007) [2023-12-26 14:36:42,874][123091] Updated weights for policy 0, policy_version 1880243 (0.0009) [2023-12-26 14:36:42,909][123090] Updated weights for policy 1, policy_version 1868517 (0.0009) [2023-12-26 14:36:42,935][123091] Updated weights for policy 0, policy_version 1880253 (0.0008) [2023-12-26 14:36:42,970][123090] Updated weights for policy 1, policy_version 1868527 (0.0011) [2023-12-26 14:36:42,997][123091] Updated weights for policy 0, policy_version 1880263 (0.0007) [2023-12-26 14:36:43,030][123090] Updated weights for policy 1, policy_version 1868537 (0.0011) [2023-12-26 14:36:43,774][123091] Updated weights for policy 0, policy_version 1880273 (0.0006) [2023-12-26 14:36:43,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 959700992. Throughput: 0: 8911.4, 1: 8831.8. Samples: 959699472. Policy #0 lag: (min: 21.0, avg: 26.3, max: 53.0) [2023-12-26 14:36:43,785][121949] Avg episode reward: [(0, '6214.732'), (1, '5627.310')] [2023-12-26 14:36:43,805][123090] Updated weights for policy 1, policy_version 1868547 (0.0009) [2023-12-26 14:36:43,836][123091] Updated weights for policy 0, policy_version 1880283 (0.0010) [2023-12-26 14:36:43,864][123090] Updated weights for policy 1, policy_version 1868557 (0.0008) [2023-12-26 14:36:43,889][123091] Updated weights for policy 0, policy_version 1880293 (0.0006) [2023-12-26 14:36:43,921][123090] Updated weights for policy 1, policy_version 1868567 (0.0008) [2023-12-26 14:36:43,946][123091] Updated weights for policy 0, policy_version 1880303 (0.0008) [2023-12-26 14:36:44,718][123090] Updated weights for policy 1, policy_version 1868577 (0.0006) [2023-12-26 14:36:44,800][123090] Updated weights for policy 1, policy_version 1868587 (0.0010) [2023-12-26 14:36:44,824][123091] Updated weights for policy 0, policy_version 1880313 (0.0007) [2023-12-26 14:36:44,864][123090] Updated weights for policy 1, policy_version 1868597 (0.0011) [2023-12-26 14:36:44,889][123091] Updated weights for policy 0, policy_version 1880323 (0.0006) [2023-12-26 14:36:44,928][123090] Updated weights for policy 1, policy_version 1868607 (0.0011) [2023-12-26 14:36:44,950][123091] Updated weights for policy 0, policy_version 1880333 (0.0007) [2023-12-26 14:36:45,706][123090] Updated weights for policy 1, policy_version 1868617 (0.0010) [2023-12-26 14:36:45,757][123090] Updated weights for policy 1, policy_version 1868627 (0.0010) [2023-12-26 14:36:45,760][123091] Updated weights for policy 0, policy_version 1880343 (0.0007) [2023-12-26 14:36:45,808][123091] Updated weights for policy 0, policy_version 1880353 (0.0006) [2023-12-26 14:36:45,810][123090] Updated weights for policy 1, policy_version 1868637 (0.0010) [2023-12-26 14:36:45,871][123091] Updated weights for policy 0, policy_version 1880363 (0.0008) [2023-12-26 14:36:46,612][123090] Updated weights for policy 1, policy_version 1868647 (0.0007) [2023-12-26 14:36:46,676][123090] Updated weights for policy 1, policy_version 1868657 (0.0008) [2023-12-26 14:36:46,731][123091] Updated weights for policy 0, policy_version 1880373 (0.0009) [2023-12-26 14:36:46,751][123090] Updated weights for policy 1, policy_version 1868667 (0.0007) [2023-12-26 14:36:46,787][123091] Updated weights for policy 0, policy_version 1880383 (0.0007) [2023-12-26 14:36:46,841][123091] Updated weights for policy 0, policy_version 1880393 (0.0009) [2023-12-26 14:36:47,483][123090] Updated weights for policy 1, policy_version 1868677 (0.0008) [2023-12-26 14:36:47,535][123090] Updated weights for policy 1, policy_version 1868687 (0.0005) [2023-12-26 14:36:47,580][123091] Updated weights for policy 0, policy_version 1880403 (0.0009) [2023-12-26 14:36:47,602][123090] Updated weights for policy 1, policy_version 1868697 (0.0005) [2023-12-26 14:36:47,629][123091] Updated weights for policy 0, policy_version 1880413 (0.0005) [2023-12-26 14:36:47,695][123091] Updated weights for policy 0, policy_version 1880423 (0.0007) [2023-12-26 14:36:48,378][123090] Updated weights for policy 1, policy_version 1868707 (0.0010) [2023-12-26 14:36:48,444][123090] Updated weights for policy 1, policy_version 1868717 (0.0010) [2023-12-26 14:36:48,509][123090] Updated weights for policy 1, policy_version 1868727 (0.0009) [2023-12-26 14:36:48,533][123091] Updated weights for policy 0, policy_version 1880433 (0.0010) [2023-12-26 14:36:48,603][123091] Updated weights for policy 0, policy_version 1880443 (0.0009) [2023-12-26 14:36:48,668][123091] Updated weights for policy 0, policy_version 1880453 (0.0010) [2023-12-26 14:36:48,723][123091] Updated weights for policy 0, policy_version 1880463 (0.0010) [2023-12-26 14:36:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 959799296. Throughput: 0: 8914.3, 1: 8828.4. Samples: 959805152. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:36:48,785][121949] Avg episode reward: [(0, '6304.848'), (1, '5676.596')] [2023-12-26 14:36:49,331][123090] Updated weights for policy 1, policy_version 1868737 (0.0009) [2023-12-26 14:36:49,396][123090] Updated weights for policy 1, policy_version 1868747 (0.0008) [2023-12-26 14:36:49,447][123090] Updated weights for policy 1, policy_version 1868757 (0.0007) [2023-12-26 14:36:49,499][123090] Updated weights for policy 1, policy_version 1868767 (0.0008) [2023-12-26 14:36:49,572][123091] Updated weights for policy 0, policy_version 1880473 (0.0010) [2023-12-26 14:36:49,637][123091] Updated weights for policy 0, policy_version 1880483 (0.0010) [2023-12-26 14:36:49,699][123091] Updated weights for policy 0, policy_version 1880493 (0.0010) [2023-12-26 14:36:50,408][123090] Updated weights for policy 1, policy_version 1868777 (0.0009) [2023-12-26 14:36:50,469][123091] Updated weights for policy 0, policy_version 1880503 (0.0009) [2023-12-26 14:36:50,476][123090] Updated weights for policy 1, policy_version 1868787 (0.0008) [2023-12-26 14:36:50,515][123091] Updated weights for policy 0, policy_version 1880513 (0.0006) [2023-12-26 14:36:50,529][123090] Updated weights for policy 1, policy_version 1868797 (0.0009) [2023-12-26 14:36:50,569][123091] Updated weights for policy 0, policy_version 1880523 (0.0006) [2023-12-26 14:36:51,347][123090] Updated weights for policy 1, policy_version 1868807 (0.0007) [2023-12-26 14:36:51,418][123090] Updated weights for policy 1, policy_version 1868817 (0.0011) [2023-12-26 14:36:51,420][123091] Updated weights for policy 0, policy_version 1880533 (0.0008) [2023-12-26 14:36:51,477][123091] Updated weights for policy 0, policy_version 1880543 (0.0009) [2023-12-26 14:36:51,479][123090] Updated weights for policy 1, policy_version 1868827 (0.0010) [2023-12-26 14:36:51,527][123091] Updated weights for policy 0, policy_version 1880553 (0.0007) [2023-12-26 14:36:52,259][123090] Updated weights for policy 1, policy_version 1868837 (0.0009) [2023-12-26 14:36:52,315][123090] Updated weights for policy 1, policy_version 1868847 (0.0011) [2023-12-26 14:36:52,386][123090] Updated weights for policy 1, policy_version 1868857 (0.0008) [2023-12-26 14:36:52,424][123091] Updated weights for policy 0, policy_version 1880563 (0.0009) [2023-12-26 14:36:52,493][123091] Updated weights for policy 0, policy_version 1880573 (0.0009) [2023-12-26 14:36:52,559][123091] Updated weights for policy 0, policy_version 1880583 (0.0010) [2023-12-26 14:36:53,066][123090] Updated weights for policy 1, policy_version 1868867 (0.0006) [2023-12-26 14:36:53,121][123090] Updated weights for policy 1, policy_version 1868877 (0.0005) [2023-12-26 14:36:53,177][123090] Updated weights for policy 1, policy_version 1868887 (0.0005) [2023-12-26 14:36:53,389][123091] Updated weights for policy 0, policy_version 1880593 (0.0009) [2023-12-26 14:36:53,441][123091] Updated weights for policy 0, policy_version 1880603 (0.0007) [2023-12-26 14:36:53,491][123091] Updated weights for policy 0, policy_version 1880613 (0.0010) [2023-12-26 14:36:53,541][123091] Updated weights for policy 0, policy_version 1880623 (0.0008) [2023-12-26 14:36:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 959881216. Throughput: 0: 8871.8, 1: 8760.0. Samples: 959856272. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:36:53,785][121949] Avg episode reward: [(0, '6263.386'), (1, '5635.687')] [2023-12-26 14:36:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001880624_481443840.pth... [2023-12-26 14:36:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001868896_478437376.pth... [2023-12-26 14:36:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001867872_478175232.pth [2023-12-26 14:36:53,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001879600_481181696.pth [2023-12-26 14:36:53,859][123090] Updated weights for policy 1, policy_version 1868897 (0.0005) [2023-12-26 14:36:53,911][123090] Updated weights for policy 1, policy_version 1868907 (0.0005) [2023-12-26 14:36:53,963][123090] Updated weights for policy 1, policy_version 1868917 (0.0005) [2023-12-26 14:36:54,018][123090] Updated weights for policy 1, policy_version 1868927 (0.0005) [2023-12-26 14:36:54,294][123091] Updated weights for policy 0, policy_version 1880633 (0.0005) [2023-12-26 14:36:54,344][123091] Updated weights for policy 0, policy_version 1880643 (0.0005) [2023-12-26 14:36:54,403][123091] Updated weights for policy 0, policy_version 1880653 (0.0006) [2023-12-26 14:36:54,745][123090] Updated weights for policy 1, policy_version 1868937 (0.0010) [2023-12-26 14:36:54,812][123090] Updated weights for policy 1, policy_version 1868947 (0.0009) [2023-12-26 14:36:54,868][123090] Updated weights for policy 1, policy_version 1868957 (0.0005) [2023-12-26 14:36:55,055][123091] Updated weights for policy 0, policy_version 1880663 (0.0007) [2023-12-26 14:36:55,109][123091] Updated weights for policy 0, policy_version 1880673 (0.0005) [2023-12-26 14:36:55,164][123091] Updated weights for policy 0, policy_version 1880683 (0.0005) [2023-12-26 14:36:55,511][123090] Updated weights for policy 1, policy_version 1868967 (0.0009) [2023-12-26 14:36:55,584][123090] Updated weights for policy 1, policy_version 1868977 (0.0008) [2023-12-26 14:36:55,649][123090] Updated weights for policy 1, policy_version 1868987 (0.0005) [2023-12-26 14:36:55,844][123091] Updated weights for policy 0, policy_version 1880693 (0.0007) [2023-12-26 14:36:55,909][123091] Updated weights for policy 0, policy_version 1880703 (0.0010) [2023-12-26 14:36:55,963][123091] Updated weights for policy 0, policy_version 1880713 (0.0008) [2023-12-26 14:36:56,249][123090] Updated weights for policy 1, policy_version 1868997 (0.0007) [2023-12-26 14:36:56,317][123090] Updated weights for policy 1, policy_version 1869007 (0.0009) [2023-12-26 14:36:56,381][123090] Updated weights for policy 1, policy_version 1869017 (0.0008) [2023-12-26 14:36:56,648][123091] Updated weights for policy 0, policy_version 1880723 (0.0006) [2023-12-26 14:36:56,697][123091] Updated weights for policy 0, policy_version 1880733 (0.0005) [2023-12-26 14:36:56,743][123091] Updated weights for policy 0, policy_version 1880743 (0.0005) [2023-12-26 14:36:57,115][123090] Updated weights for policy 1, policy_version 1869027 (0.0008) [2023-12-26 14:36:57,166][123090] Updated weights for policy 1, policy_version 1869037 (0.0010) [2023-12-26 14:36:57,220][123090] Updated weights for policy 1, policy_version 1869047 (0.0010) [2023-12-26 14:36:57,371][123091] Updated weights for policy 0, policy_version 1880753 (0.0006) [2023-12-26 14:36:57,432][123091] Updated weights for policy 0, policy_version 1880763 (0.0010) [2023-12-26 14:36:57,483][123091] Updated weights for policy 0, policy_version 1880773 (0.0010) [2023-12-26 14:36:57,537][123091] Updated weights for policy 0, policy_version 1880783 (0.0010) [2023-12-26 14:36:58,033][123090] Updated weights for policy 1, policy_version 1869057 (0.0010) [2023-12-26 14:36:58,105][123090] Updated weights for policy 1, policy_version 1869067 (0.0007) [2023-12-26 14:36:58,176][123090] Updated weights for policy 1, policy_version 1869077 (0.0008) [2023-12-26 14:36:58,231][123090] Updated weights for policy 1, policy_version 1869087 (0.0009) [2023-12-26 14:36:58,396][123091] Updated weights for policy 0, policy_version 1880793 (0.0010) [2023-12-26 14:36:58,455][123091] Updated weights for policy 0, policy_version 1880803 (0.0011) [2023-12-26 14:36:58,525][123091] Updated weights for policy 0, policy_version 1880814 (0.0009) [2023-12-26 14:36:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 959979520. Throughput: 0: 8940.4, 1: 8898.4. Samples: 959973068. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:36:58,785][121949] Avg episode reward: [(0, '6139.257'), (1, '5729.234')] [2023-12-26 14:36:59,136][123090] Updated weights for policy 1, policy_version 1869097 (0.0008) [2023-12-26 14:36:59,204][123090] Updated weights for policy 1, policy_version 1869107 (0.0006) [2023-12-26 14:36:59,279][123090] Updated weights for policy 1, policy_version 1869117 (0.0008) [2023-12-26 14:36:59,448][123091] Updated weights for policy 0, policy_version 1880824 (0.0009) [2023-12-26 14:36:59,517][123091] Updated weights for policy 0, policy_version 1880834 (0.0009) [2023-12-26 14:36:59,578][123091] Updated weights for policy 0, policy_version 1880844 (0.0010) [2023-12-26 14:36:59,993][123090] Updated weights for policy 1, policy_version 1869127 (0.0009) [2023-12-26 14:37:00,065][123090] Updated weights for policy 1, policy_version 1869137 (0.0010) [2023-12-26 14:37:00,143][123090] Updated weights for policy 1, policy_version 1869147 (0.0009) [2023-12-26 14:37:00,237][123091] Updated weights for policy 0, policy_version 1880854 (0.0010) [2023-12-26 14:37:00,289][123091] Updated weights for policy 0, policy_version 1880864 (0.0010) [2023-12-26 14:37:00,346][123091] Updated weights for policy 0, policy_version 1880874 (0.0009) [2023-12-26 14:37:00,971][123090] Updated weights for policy 1, policy_version 1869157 (0.0008) [2023-12-26 14:37:01,039][123090] Updated weights for policy 1, policy_version 1869167 (0.0008) [2023-12-26 14:37:01,095][123090] Updated weights for policy 1, policy_version 1869177 (0.0010) [2023-12-26 14:37:01,182][123091] Updated weights for policy 0, policy_version 1880884 (0.0010) [2023-12-26 14:37:01,242][123091] Updated weights for policy 0, policy_version 1880894 (0.0005) [2023-12-26 14:37:01,310][123091] Updated weights for policy 0, policy_version 1880904 (0.0007) [2023-12-26 14:37:01,827][123090] Updated weights for policy 1, policy_version 1869187 (0.0009) [2023-12-26 14:37:01,881][123090] Updated weights for policy 1, policy_version 1869197 (0.0008) [2023-12-26 14:37:01,946][123090] Updated weights for policy 1, policy_version 1869207 (0.0008) [2023-12-26 14:37:01,981][123091] Updated weights for policy 0, policy_version 1880914 (0.0007) [2023-12-26 14:37:02,032][123091] Updated weights for policy 0, policy_version 1880924 (0.0005) [2023-12-26 14:37:02,096][123091] Updated weights for policy 0, policy_version 1880934 (0.0006) [2023-12-26 14:37:02,166][123091] Updated weights for policy 0, policy_version 1880944 (0.0005) [2023-12-26 14:37:02,706][123090] Updated weights for policy 1, policy_version 1869217 (0.0008) [2023-12-26 14:37:02,760][123090] Updated weights for policy 1, policy_version 1869227 (0.0005) [2023-12-26 14:37:02,820][123090] Updated weights for policy 1, policy_version 1869237 (0.0006) [2023-12-26 14:37:02,880][123091] Updated weights for policy 0, policy_version 1880954 (0.0005) [2023-12-26 14:37:02,885][123090] Updated weights for policy 1, policy_version 1869247 (0.0005) [2023-12-26 14:37:02,929][123091] Updated weights for policy 0, policy_version 1880964 (0.0005) [2023-12-26 14:37:02,987][123091] Updated weights for policy 0, policy_version 1880974 (0.0005) [2023-12-26 14:37:03,464][123090] Updated weights for policy 1, policy_version 1869257 (0.0005) [2023-12-26 14:37:03,513][123090] Updated weights for policy 1, policy_version 1869267 (0.0005) [2023-12-26 14:37:03,572][123090] Updated weights for policy 1, policy_version 1869277 (0.0005) [2023-12-26 14:37:03,749][123091] Updated weights for policy 0, policy_version 1880984 (0.0005) [2023-12-26 14:37:03,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 960069632. Throughput: 0: 8841.2, 1: 8906.8. Samples: 960081836. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:03,785][121949] Avg episode reward: [(0, '6201.121'), (1, '5707.434')] [2023-12-26 14:37:03,812][123091] Updated weights for policy 0, policy_version 1880994 (0.0005) [2023-12-26 14:37:03,883][123091] Updated weights for policy 0, policy_version 1881004 (0.0008) [2023-12-26 14:37:04,351][123090] Updated weights for policy 1, policy_version 1869287 (0.0006) [2023-12-26 14:37:04,420][123090] Updated weights for policy 1, policy_version 1869297 (0.0005) [2023-12-26 14:37:04,493][123090] Updated weights for policy 1, policy_version 1869307 (0.0005) [2023-12-26 14:37:04,682][123091] Updated weights for policy 0, policy_version 1881014 (0.0011) [2023-12-26 14:37:04,751][123091] Updated weights for policy 0, policy_version 1881024 (0.0010) [2023-12-26 14:37:04,809][123091] Updated weights for policy 0, policy_version 1881034 (0.0010) [2023-12-26 14:37:05,129][123090] Updated weights for policy 1, policy_version 1869317 (0.0007) [2023-12-26 14:37:05,178][123090] Updated weights for policy 1, policy_version 1869327 (0.0009) [2023-12-26 14:37:05,239][123090] Updated weights for policy 1, policy_version 1869337 (0.0009) [2023-12-26 14:37:05,607][123091] Updated weights for policy 0, policy_version 1881044 (0.0010) [2023-12-26 14:37:05,654][123091] Updated weights for policy 0, policy_version 1881054 (0.0010) [2023-12-26 14:37:05,697][123091] Updated weights for policy 0, policy_version 1881064 (0.0010) [2023-12-26 14:37:06,016][123090] Updated weights for policy 1, policy_version 1869347 (0.0009) [2023-12-26 14:37:06,077][123090] Updated weights for policy 1, policy_version 1869357 (0.0009) [2023-12-26 14:37:06,148][123090] Updated weights for policy 1, policy_version 1869367 (0.0009) [2023-12-26 14:37:06,552][123091] Updated weights for policy 0, policy_version 1881074 (0.0010) [2023-12-26 14:37:06,616][123091] Updated weights for policy 0, policy_version 1881084 (0.0011) [2023-12-26 14:37:06,683][123091] Updated weights for policy 0, policy_version 1881094 (0.0011) [2023-12-26 14:37:06,753][123091] Updated weights for policy 0, policy_version 1881104 (0.0011) [2023-12-26 14:37:06,989][123090] Updated weights for policy 1, policy_version 1869377 (0.0008) [2023-12-26 14:37:07,041][123090] Updated weights for policy 1, policy_version 1869387 (0.0005) [2023-12-26 14:37:07,096][123090] Updated weights for policy 1, policy_version 1869397 (0.0008) [2023-12-26 14:37:07,145][123090] Updated weights for policy 1, policy_version 1869407 (0.0009) [2023-12-26 14:37:07,519][123091] Updated weights for policy 0, policy_version 1881114 (0.0011) [2023-12-26 14:37:07,568][123091] Updated weights for policy 0, policy_version 1881124 (0.0007) [2023-12-26 14:37:07,621][123091] Updated weights for policy 0, policy_version 1881134 (0.0005) [2023-12-26 14:37:08,029][123090] Updated weights for policy 1, policy_version 1869417 (0.0008) [2023-12-26 14:37:08,100][123090] Updated weights for policy 1, policy_version 1869427 (0.0008) [2023-12-26 14:37:08,166][123090] Updated weights for policy 1, policy_version 1869437 (0.0009) [2023-12-26 14:37:08,359][123091] Updated weights for policy 0, policy_version 1881144 (0.0009) [2023-12-26 14:37:08,426][123091] Updated weights for policy 0, policy_version 1881154 (0.0009) [2023-12-26 14:37:08,482][123091] Updated weights for policy 0, policy_version 1881164 (0.0009) [2023-12-26 14:37:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 960159744. Throughput: 0: 8872.0, 1: 8942.5. Samples: 960135812. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:08,785][121949] Avg episode reward: [(0, '6222.563'), (1, '5911.462')] [2023-12-26 14:37:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001869440_478576640.pth... [2023-12-26 14:37:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001881168_481583104.pth... [2023-12-26 14:37:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001868384_478306304.pth [2023-12-26 14:37:08,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001880112_481312768.pth [2023-12-26 14:37:08,987][123090] Updated weights for policy 1, policy_version 1869448 (0.0009) [2023-12-26 14:37:09,034][123090] Updated weights for policy 1, policy_version 1869458 (0.0009) [2023-12-26 14:37:09,091][123090] Updated weights for policy 1, policy_version 1869468 (0.0009) [2023-12-26 14:37:09,291][123091] Updated weights for policy 0, policy_version 1881174 (0.0009) [2023-12-26 14:37:09,355][123091] Updated weights for policy 0, policy_version 1881184 (0.0010) [2023-12-26 14:37:09,430][123091] Updated weights for policy 0, policy_version 1881194 (0.0009) [2023-12-26 14:37:10,046][123090] Updated weights for policy 1, policy_version 1869478 (0.0009) [2023-12-26 14:37:10,105][123090] Updated weights for policy 1, policy_version 1869488 (0.0008) [2023-12-26 14:37:10,157][123090] Updated weights for policy 1, policy_version 1869498 (0.0009) [2023-12-26 14:37:10,269][123091] Updated weights for policy 0, policy_version 1881204 (0.0009) [2023-12-26 14:37:10,326][123091] Updated weights for policy 0, policy_version 1881214 (0.0009) [2023-12-26 14:37:10,384][123091] Updated weights for policy 0, policy_version 1881224 (0.0010) [2023-12-26 14:37:10,930][123090] Updated weights for policy 1, policy_version 1869508 (0.0008) [2023-12-26 14:37:10,977][123090] Updated weights for policy 1, policy_version 1869518 (0.0005) [2023-12-26 14:37:11,031][123090] Updated weights for policy 1, policy_version 1869528 (0.0006) [2023-12-26 14:37:11,288][123091] Updated weights for policy 0, policy_version 1881234 (0.0010) [2023-12-26 14:37:11,359][123091] Updated weights for policy 0, policy_version 1881244 (0.0010) [2023-12-26 14:37:11,424][123091] Updated weights for policy 0, policy_version 1881254 (0.0010) [2023-12-26 14:37:11,487][123091] Updated weights for policy 0, policy_version 1881264 (0.0009) [2023-12-26 14:37:11,888][123090] Updated weights for policy 1, policy_version 1869538 (0.0009) [2023-12-26 14:37:11,961][123090] Updated weights for policy 1, policy_version 1869548 (0.0010) [2023-12-26 14:37:12,029][123090] Updated weights for policy 1, policy_version 1869558 (0.0010) [2023-12-26 14:37:12,099][123090] Updated weights for policy 1, policy_version 1869568 (0.0009) [2023-12-26 14:37:12,382][123091] Updated weights for policy 0, policy_version 1881274 (0.0009) [2023-12-26 14:37:12,439][123091] Updated weights for policy 0, policy_version 1881284 (0.0010) [2023-12-26 14:37:12,488][123091] Updated weights for policy 0, policy_version 1881294 (0.0009) [2023-12-26 14:37:12,903][123090] Updated weights for policy 1, policy_version 1869578 (0.0009) [2023-12-26 14:37:12,974][123090] Updated weights for policy 1, policy_version 1869588 (0.0009) [2023-12-26 14:37:13,034][123090] Updated weights for policy 1, policy_version 1869598 (0.0010) [2023-12-26 14:37:13,388][123091] Updated weights for policy 0, policy_version 1881304 (0.0006) [2023-12-26 14:37:13,449][123091] Updated weights for policy 0, policy_version 1881314 (0.0005) [2023-12-26 14:37:13,501][123091] Updated weights for policy 0, policy_version 1881324 (0.0005) [2023-12-26 14:37:13,699][123090] Updated weights for policy 1, policy_version 1869608 (0.0009) [2023-12-26 14:37:13,760][123090] Updated weights for policy 1, policy_version 1869619 (0.0007) [2023-12-26 14:37:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 960241664. Throughput: 0: 8840.1, 1: 8887.1. Samples: 960237276. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:13,785][121949] Avg episode reward: [(0, '6304.156'), (1, '6000.440')] [2023-12-26 14:37:13,816][123090] Updated weights for policy 1, policy_version 1869629 (0.0005) [2023-12-26 14:37:14,255][123091] Updated weights for policy 0, policy_version 1881334 (0.0007) [2023-12-26 14:37:14,316][123091] Updated weights for policy 0, policy_version 1881344 (0.0010) [2023-12-26 14:37:14,377][123091] Updated weights for policy 0, policy_version 1881354 (0.0009) [2023-12-26 14:37:14,429][123090] Updated weights for policy 1, policy_version 1869639 (0.0005) [2023-12-26 14:37:14,494][123090] Updated weights for policy 1, policy_version 1869649 (0.0008) [2023-12-26 14:37:14,556][123090] Updated weights for policy 1, policy_version 1869659 (0.0009) [2023-12-26 14:37:15,222][123091] Updated weights for policy 0, policy_version 1881364 (0.0010) [2023-12-26 14:37:15,291][123091] Updated weights for policy 0, policy_version 1881374 (0.0009) [2023-12-26 14:37:15,350][123091] Updated weights for policy 0, policy_version 1881384 (0.0009) [2023-12-26 14:37:15,392][123090] Updated weights for policy 1, policy_version 1869669 (0.0009) [2023-12-26 14:37:15,456][123090] Updated weights for policy 1, policy_version 1869679 (0.0009) [2023-12-26 14:37:15,528][123090] Updated weights for policy 1, policy_version 1869689 (0.0009) [2023-12-26 14:37:16,050][123091] Updated weights for policy 0, policy_version 1881394 (0.0011) [2023-12-26 14:37:16,113][123091] Updated weights for policy 0, policy_version 1881404 (0.0011) [2023-12-26 14:37:16,183][123091] Updated weights for policy 0, policy_version 1881414 (0.0011) [2023-12-26 14:37:16,246][123091] Updated weights for policy 0, policy_version 1881424 (0.0011) [2023-12-26 14:37:16,397][123090] Updated weights for policy 1, policy_version 1869699 (0.0008) [2023-12-26 14:37:16,461][123090] Updated weights for policy 1, policy_version 1869709 (0.0006) [2023-12-26 14:37:16,511][123090] Updated weights for policy 1, policy_version 1869719 (0.0006) [2023-12-26 14:37:16,949][123091] Updated weights for policy 0, policy_version 1881434 (0.0006) [2023-12-26 14:37:17,014][123091] Updated weights for policy 0, policy_version 1881444 (0.0007) [2023-12-26 14:37:17,078][123091] Updated weights for policy 0, policy_version 1881454 (0.0007) [2023-12-26 14:37:17,239][123090] Updated weights for policy 1, policy_version 1869729 (0.0007) [2023-12-26 14:37:17,297][123090] Updated weights for policy 1, policy_version 1869739 (0.0006) [2023-12-26 14:37:17,366][123090] Updated weights for policy 1, policy_version 1869749 (0.0005) [2023-12-26 14:37:17,438][123090] Updated weights for policy 1, policy_version 1869759 (0.0005) [2023-12-26 14:37:17,850][123091] Updated weights for policy 0, policy_version 1881464 (0.0006) [2023-12-26 14:37:17,897][123091] Updated weights for policy 0, policy_version 1881474 (0.0005) [2023-12-26 14:37:17,944][123091] Updated weights for policy 0, policy_version 1881484 (0.0005) [2023-12-26 14:37:18,143][123090] Updated weights for policy 1, policy_version 1869769 (0.0005) [2023-12-26 14:37:18,202][123090] Updated weights for policy 1, policy_version 1869779 (0.0005) [2023-12-26 14:37:18,258][123090] Updated weights for policy 1, policy_version 1869789 (0.0005) [2023-12-26 14:37:18,783][123091] Updated weights for policy 0, policy_version 1881494 (0.0008) [2023-12-26 14:37:18,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 960331776. Throughput: 0: 8888.5, 1: 8947.8. Samples: 960347804. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:18,785][121949] Avg episode reward: [(0, '6324.624'), (1, '5891.235')] [2023-12-26 14:37:18,845][123091] Updated weights for policy 0, policy_version 1881504 (0.0009) [2023-12-26 14:37:18,892][123090] Updated weights for policy 1, policy_version 1869799 (0.0009) [2023-12-26 14:37:18,908][123091] Updated weights for policy 0, policy_version 1881514 (0.0008) [2023-12-26 14:37:18,944][123090] Updated weights for policy 1, policy_version 1869809 (0.0008) [2023-12-26 14:37:19,002][123090] Updated weights for policy 1, policy_version 1869819 (0.0010) [2023-12-26 14:37:19,782][123091] Updated weights for policy 0, policy_version 1881524 (0.0008) [2023-12-26 14:37:19,836][123090] Updated weights for policy 1, policy_version 1869829 (0.0011) [2023-12-26 14:37:19,848][123091] Updated weights for policy 0, policy_version 1881534 (0.0008) [2023-12-26 14:37:19,901][123090] Updated weights for policy 1, policy_version 1869839 (0.0011) [2023-12-26 14:37:19,909][123091] Updated weights for policy 0, policy_version 1881544 (0.0006) [2023-12-26 14:37:19,971][123090] Updated weights for policy 1, policy_version 1869849 (0.0011) [2023-12-26 14:37:20,757][123091] Updated weights for policy 0, policy_version 1881554 (0.0008) [2023-12-26 14:37:20,799][123090] Updated weights for policy 1, policy_version 1869859 (0.0011) [2023-12-26 14:37:20,819][123091] Updated weights for policy 0, policy_version 1881564 (0.0008) [2023-12-26 14:37:20,856][123090] Updated weights for policy 1, policy_version 1869869 (0.0011) [2023-12-26 14:37:20,880][123091] Updated weights for policy 0, policy_version 1881574 (0.0006) [2023-12-26 14:37:20,908][123090] Updated weights for policy 1, policy_version 1869879 (0.0010) [2023-12-26 14:37:20,941][123091] Updated weights for policy 0, policy_version 1881584 (0.0006) [2023-12-26 14:37:21,757][123090] Updated weights for policy 1, policy_version 1869889 (0.0011) [2023-12-26 14:37:21,823][123091] Updated weights for policy 0, policy_version 1881594 (0.0008) [2023-12-26 14:37:21,825][123090] Updated weights for policy 1, policy_version 1869899 (0.0008) [2023-12-26 14:37:21,886][123091] Updated weights for policy 0, policy_version 1881604 (0.0008) [2023-12-26 14:37:21,896][123090] Updated weights for policy 1, policy_version 1869909 (0.0008) [2023-12-26 14:37:21,953][123090] Updated weights for policy 1, policy_version 1869919 (0.0009) [2023-12-26 14:37:21,956][123091] Updated weights for policy 0, policy_version 1881614 (0.0007) [2023-12-26 14:37:22,760][123091] Updated weights for policy 0, policy_version 1881624 (0.0008) [2023-12-26 14:37:22,808][123090] Updated weights for policy 1, policy_version 1869929 (0.0010) [2023-12-26 14:37:22,823][123091] Updated weights for policy 0, policy_version 1881634 (0.0006) [2023-12-26 14:37:22,872][123090] Updated weights for policy 1, policy_version 1869939 (0.0010) [2023-12-26 14:37:22,879][123091] Updated weights for policy 0, policy_version 1881644 (0.0007) [2023-12-26 14:37:22,932][123090] Updated weights for policy 1, policy_version 1869949 (0.0011) [2023-12-26 14:37:23,717][123091] Updated weights for policy 0, policy_version 1881654 (0.0008) [2023-12-26 14:37:23,722][123090] Updated weights for policy 1, policy_version 1869959 (0.0007) [2023-12-26 14:37:23,774][123091] Updated weights for policy 0, policy_version 1881664 (0.0008) [2023-12-26 14:37:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17689.2). Total num frames: 960413696. Throughput: 0: 8820.2, 1: 8977.2. Samples: 960397960. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:23,785][121949] Avg episode reward: [(0, '6258.786'), (1, '5823.337')] [2023-12-26 14:37:23,792][123090] Updated weights for policy 1, policy_version 1869969 (0.0005) [2023-12-26 14:37:23,825][123091] Updated weights for policy 0, policy_version 1881674 (0.0009) [2023-12-26 14:37:23,849][123090] Updated weights for policy 1, policy_version 1869979 (0.0005) [2023-12-26 14:37:23,854][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001881680_481714176.pth... [2023-12-26 14:37:23,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001880624_481443840.pth [2023-12-26 14:37:23,872][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001869984_478715904.pth... [2023-12-26 14:37:23,875][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001868896_478437376.pth [2023-12-26 14:37:24,561][123090] Updated weights for policy 1, policy_version 1869989 (0.0008) [2023-12-26 14:37:24,628][123090] Updated weights for policy 1, policy_version 1869999 (0.0007) [2023-12-26 14:37:24,700][123090] Updated weights for policy 1, policy_version 1870009 (0.0006) [2023-12-26 14:37:24,700][123091] Updated weights for policy 0, policy_version 1881684 (0.0007) [2023-12-26 14:37:24,760][123091] Updated weights for policy 0, policy_version 1881694 (0.0006) [2023-12-26 14:37:24,813][123091] Updated weights for policy 0, policy_version 1881704 (0.0005) [2023-12-26 14:37:25,380][123090] Updated weights for policy 1, policy_version 1870019 (0.0008) [2023-12-26 14:37:25,451][123090] Updated weights for policy 1, policy_version 1870029 (0.0005) [2023-12-26 14:37:25,521][123090] Updated weights for policy 1, policy_version 1870039 (0.0005) [2023-12-26 14:37:25,545][123091] Updated weights for policy 0, policy_version 1881714 (0.0006) [2023-12-26 14:37:25,595][123091] Updated weights for policy 0, policy_version 1881724 (0.0010) [2023-12-26 14:37:25,647][123091] Updated weights for policy 0, policy_version 1881736 (0.0010) [2023-12-26 14:37:26,055][123090] Updated weights for policy 1, policy_version 1870049 (0.0005) [2023-12-26 14:37:26,125][123090] Updated weights for policy 1, policy_version 1870059 (0.0006) [2023-12-26 14:37:26,183][123090] Updated weights for policy 1, policy_version 1870069 (0.0010) [2023-12-26 14:37:26,245][123090] Updated weights for policy 1, policy_version 1870079 (0.0010) [2023-12-26 14:37:26,536][123091] Updated weights for policy 0, policy_version 1881746 (0.0009) [2023-12-26 14:37:26,588][123091] Updated weights for policy 0, policy_version 1881756 (0.0009) [2023-12-26 14:37:26,638][123091] Updated weights for policy 0, policy_version 1881767 (0.0009) [2023-12-26 14:37:26,920][123090] Updated weights for policy 1, policy_version 1870089 (0.0006) [2023-12-26 14:37:26,972][123090] Updated weights for policy 1, policy_version 1870099 (0.0007) [2023-12-26 14:37:27,026][123090] Updated weights for policy 1, policy_version 1870109 (0.0005) [2023-12-26 14:37:27,366][123091] Updated weights for policy 0, policy_version 1881777 (0.0005) [2023-12-26 14:37:27,421][123091] Updated weights for policy 0, policy_version 1881787 (0.0009) [2023-12-26 14:37:27,472][123091] Updated weights for policy 0, policy_version 1881797 (0.0008) [2023-12-26 14:37:27,519][123091] Updated weights for policy 0, policy_version 1881807 (0.0009) [2023-12-26 14:37:27,754][123090] Updated weights for policy 1, policy_version 1870119 (0.0006) [2023-12-26 14:37:27,815][123090] Updated weights for policy 1, policy_version 1870129 (0.0009) [2023-12-26 14:37:27,873][123090] Updated weights for policy 1, policy_version 1870139 (0.0010) [2023-12-26 14:37:28,280][123091] Updated weights for policy 0, policy_version 1881817 (0.0006) [2023-12-26 14:37:28,330][123091] Updated weights for policy 0, policy_version 1881827 (0.0006) [2023-12-26 14:37:28,398][123091] Updated weights for policy 0, policy_version 1881837 (0.0009) [2023-12-26 14:37:28,669][123090] Updated weights for policy 1, policy_version 1870149 (0.0010) [2023-12-26 14:37:28,730][123090] Updated weights for policy 1, policy_version 1870159 (0.0008) [2023-12-26 14:37:28,781][123090] Updated weights for policy 1, policy_version 1870169 (0.0008) [2023-12-26 14:37:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 960512000. Throughput: 0: 8832.3, 1: 9118.9. Samples: 960507272. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:28,784][121949] Avg episode reward: [(0, '6200.946'), (1, '5761.787')] [2023-12-26 14:37:29,216][123091] Updated weights for policy 0, policy_version 1881847 (0.0007) [2023-12-26 14:37:29,280][123091] Updated weights for policy 0, policy_version 1881857 (0.0009) [2023-12-26 14:37:29,348][123091] Updated weights for policy 0, policy_version 1881867 (0.0009) [2023-12-26 14:37:29,641][123090] Updated weights for policy 1, policy_version 1870179 (0.0008) [2023-12-26 14:37:29,703][123090] Updated weights for policy 1, policy_version 1870189 (0.0005) [2023-12-26 14:37:29,765][123090] Updated weights for policy 1, policy_version 1870199 (0.0008) [2023-12-26 14:37:30,191][123091] Updated weights for policy 0, policy_version 1881877 (0.0009) [2023-12-26 14:37:30,256][123091] Updated weights for policy 0, policy_version 1881887 (0.0009) [2023-12-26 14:37:30,320][123091] Updated weights for policy 0, policy_version 1881897 (0.0009) [2023-12-26 14:37:30,569][123090] Updated weights for policy 1, policy_version 1870209 (0.0008) [2023-12-26 14:37:30,624][123090] Updated weights for policy 1, policy_version 1870219 (0.0006) [2023-12-26 14:37:30,673][123090] Updated weights for policy 1, policy_version 1870229 (0.0009) [2023-12-26 14:37:30,728][123090] Updated weights for policy 1, policy_version 1870239 (0.0007) [2023-12-26 14:37:31,180][123091] Updated weights for policy 0, policy_version 1881907 (0.0008) [2023-12-26 14:37:31,239][123091] Updated weights for policy 0, policy_version 1881917 (0.0008) [2023-12-26 14:37:31,312][123091] Updated weights for policy 0, policy_version 1881927 (0.0005) [2023-12-26 14:37:31,541][123090] Updated weights for policy 1, policy_version 1870249 (0.0010) [2023-12-26 14:37:31,604][123090] Updated weights for policy 1, policy_version 1870259 (0.0010) [2023-12-26 14:37:31,677][123090] Updated weights for policy 1, policy_version 1870269 (0.0010) [2023-12-26 14:37:32,042][123091] Updated weights for policy 0, policy_version 1881937 (0.0008) [2023-12-26 14:37:32,102][123091] Updated weights for policy 0, policy_version 1881947 (0.0005) [2023-12-26 14:37:32,165][123091] Updated weights for policy 0, policy_version 1881957 (0.0006) [2023-12-26 14:37:32,230][123091] Updated weights for policy 0, policy_version 1881967 (0.0005) [2023-12-26 14:37:32,468][123090] Updated weights for policy 1, policy_version 1870279 (0.0010) [2023-12-26 14:37:32,531][123090] Updated weights for policy 1, policy_version 1870289 (0.0010) [2023-12-26 14:37:32,592][123090] Updated weights for policy 1, policy_version 1870299 (0.0010) [2023-12-26 14:37:32,991][123091] Updated weights for policy 0, policy_version 1881977 (0.0005) [2023-12-26 14:37:33,038][123091] Updated weights for policy 0, policy_version 1881987 (0.0005) [2023-12-26 14:37:33,104][123091] Updated weights for policy 0, policy_version 1881997 (0.0006) [2023-12-26 14:37:33,314][123090] Updated weights for policy 1, policy_version 1870309 (0.0006) [2023-12-26 14:37:33,359][123090] Updated weights for policy 1, policy_version 1870319 (0.0005) [2023-12-26 14:37:33,406][123090] Updated weights for policy 1, policy_version 1870329 (0.0005) [2023-12-26 14:37:33,700][123091] Updated weights for policy 0, policy_version 1882007 (0.0006) [2023-12-26 14:37:33,763][123091] Updated weights for policy 0, policy_version 1882017 (0.0005) [2023-12-26 14:37:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 960602112. Throughput: 0: 8906.6, 1: 9145.2. Samples: 960617484. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:33,785][121949] Avg episode reward: [(0, '6248.072'), (1, '5505.280')] [2023-12-26 14:37:33,832][123091] Updated weights for policy 0, policy_version 1882027 (0.0005) [2023-12-26 14:37:34,081][123090] Updated weights for policy 1, policy_version 1870339 (0.0005) [2023-12-26 14:37:34,151][123090] Updated weights for policy 1, policy_version 1870349 (0.0007) [2023-12-26 14:37:34,217][123090] Updated weights for policy 1, policy_version 1870359 (0.0010) [2023-12-26 14:37:34,473][123091] Updated weights for policy 0, policy_version 1882037 (0.0006) [2023-12-26 14:37:34,552][123091] Updated weights for policy 0, policy_version 1882047 (0.0007) [2023-12-26 14:37:34,620][123091] Updated weights for policy 0, policy_version 1882057 (0.0008) [2023-12-26 14:37:35,065][123090] Updated weights for policy 1, policy_version 1870369 (0.0009) [2023-12-26 14:37:35,130][123090] Updated weights for policy 1, policy_version 1870379 (0.0010) [2023-12-26 14:37:35,183][123090] Updated weights for policy 1, policy_version 1870389 (0.0009) [2023-12-26 14:37:35,242][123090] Updated weights for policy 1, policy_version 1870399 (0.0008) [2023-12-26 14:37:35,301][123091] Updated weights for policy 0, policy_version 1882067 (0.0008) [2023-12-26 14:37:35,363][123091] Updated weights for policy 0, policy_version 1882077 (0.0006) [2023-12-26 14:37:35,426][123091] Updated weights for policy 0, policy_version 1882087 (0.0007) [2023-12-26 14:37:36,048][123090] Updated weights for policy 1, policy_version 1870409 (0.0010) [2023-12-26 14:37:36,102][123090] Updated weights for policy 1, policy_version 1870419 (0.0009) [2023-12-26 14:37:36,135][123091] Updated weights for policy 0, policy_version 1882097 (0.0008) [2023-12-26 14:37:36,169][123090] Updated weights for policy 1, policy_version 1870429 (0.0007) [2023-12-26 14:37:36,200][123091] Updated weights for policy 0, policy_version 1882107 (0.0010) [2023-12-26 14:37:36,257][123091] Updated weights for policy 0, policy_version 1882117 (0.0010) [2023-12-26 14:37:36,322][123091] Updated weights for policy 0, policy_version 1882127 (0.0010) [2023-12-26 14:37:36,916][123090] Updated weights for policy 1, policy_version 1870439 (0.0007) [2023-12-26 14:37:36,970][123090] Updated weights for policy 1, policy_version 1870449 (0.0008) [2023-12-26 14:37:37,032][123090] Updated weights for policy 1, policy_version 1870459 (0.0011) [2023-12-26 14:37:37,224][123091] Updated weights for policy 0, policy_version 1882137 (0.0010) [2023-12-26 14:37:37,300][123091] Updated weights for policy 0, policy_version 1882147 (0.0007) [2023-12-26 14:37:37,364][123091] Updated weights for policy 0, policy_version 1882157 (0.0006) [2023-12-26 14:37:37,746][123090] Updated weights for policy 1, policy_version 1870469 (0.0011) [2023-12-26 14:37:37,807][123090] Updated weights for policy 1, policy_version 1870479 (0.0011) [2023-12-26 14:37:37,869][123090] Updated weights for policy 1, policy_version 1870489 (0.0010) [2023-12-26 14:37:38,192][123091] Updated weights for policy 0, policy_version 1882167 (0.0006) [2023-12-26 14:37:38,256][123091] Updated weights for policy 0, policy_version 1882177 (0.0007) [2023-12-26 14:37:38,318][123091] Updated weights for policy 0, policy_version 1882187 (0.0008) [2023-12-26 14:37:38,640][123090] Updated weights for policy 1, policy_version 1870499 (0.0011) [2023-12-26 14:37:38,707][123090] Updated weights for policy 1, policy_version 1870509 (0.0011) [2023-12-26 14:37:38,770][123090] Updated weights for policy 1, policy_version 1870519 (0.0010) [2023-12-26 14:37:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 960692224. Throughput: 0: 8963.6, 1: 9175.6. Samples: 960672540. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:38,785][121949] Avg episode reward: [(0, '6317.604'), (1, '5667.356')] [2023-12-26 14:37:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001882192_481845248.pth... [2023-12-26 14:37:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001881168_481583104.pth [2023-12-26 14:37:38,831][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001870528_478855168.pth... [2023-12-26 14:37:38,835][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001869440_478576640.pth [2023-12-26 14:37:39,089][123091] Updated weights for policy 0, policy_version 1882197 (0.0011) [2023-12-26 14:37:39,147][123091] Updated weights for policy 0, policy_version 1882207 (0.0010) [2023-12-26 14:37:39,210][123091] Updated weights for policy 0, policy_version 1882217 (0.0010) [2023-12-26 14:37:39,487][123090] Updated weights for policy 1, policy_version 1870529 (0.0007) [2023-12-26 14:37:39,542][123090] Updated weights for policy 1, policy_version 1870539 (0.0006) [2023-12-26 14:37:39,604][123090] Updated weights for policy 1, policy_version 1870549 (0.0007) [2023-12-26 14:37:39,673][123090] Updated weights for policy 1, policy_version 1870559 (0.0011) [2023-12-26 14:37:40,047][123091] Updated weights for policy 0, policy_version 1882227 (0.0008) [2023-12-26 14:37:40,122][123091] Updated weights for policy 0, policy_version 1882237 (0.0006) [2023-12-26 14:37:40,196][123091] Updated weights for policy 0, policy_version 1882247 (0.0008) [2023-12-26 14:37:40,537][123090] Updated weights for policy 1, policy_version 1870569 (0.0007) [2023-12-26 14:37:40,609][123090] Updated weights for policy 1, policy_version 1870579 (0.0008) [2023-12-26 14:37:40,677][123090] Updated weights for policy 1, policy_version 1870589 (0.0010) [2023-12-26 14:37:40,935][123091] Updated weights for policy 0, policy_version 1882257 (0.0006) [2023-12-26 14:37:41,008][123091] Updated weights for policy 0, policy_version 1882267 (0.0007) [2023-12-26 14:37:41,080][123091] Updated weights for policy 0, policy_version 1882277 (0.0008) [2023-12-26 14:37:41,147][123091] Updated weights for policy 0, policy_version 1882287 (0.0009) [2023-12-26 14:37:41,555][123090] Updated weights for policy 1, policy_version 1870599 (0.0010) [2023-12-26 14:37:41,624][123090] Updated weights for policy 1, policy_version 1870609 (0.0010) [2023-12-26 14:37:41,690][123090] Updated weights for policy 1, policy_version 1870619 (0.0009) [2023-12-26 14:37:41,956][123091] Updated weights for policy 0, policy_version 1882297 (0.0008) [2023-12-26 14:37:42,022][123091] Updated weights for policy 0, policy_version 1882307 (0.0008) [2023-12-26 14:37:42,097][123091] Updated weights for policy 0, policy_version 1882317 (0.0006) [2023-12-26 14:37:42,577][123090] Updated weights for policy 1, policy_version 1870629 (0.0009) [2023-12-26 14:37:42,647][123090] Updated weights for policy 1, policy_version 1870639 (0.0009) [2023-12-26 14:37:42,709][123090] Updated weights for policy 1, policy_version 1870649 (0.0009) [2023-12-26 14:37:42,890][123091] Updated weights for policy 0, policy_version 1882327 (0.0008) [2023-12-26 14:37:42,938][123091] Updated weights for policy 0, policy_version 1882337 (0.0009) [2023-12-26 14:37:42,990][123091] Updated weights for policy 0, policy_version 1882348 (0.0008) [2023-12-26 14:37:43,593][123090] Updated weights for policy 1, policy_version 1870659 (0.0009) [2023-12-26 14:37:43,652][123090] Updated weights for policy 1, policy_version 1870669 (0.0008) [2023-12-26 14:37:43,708][123090] Updated weights for policy 1, policy_version 1870679 (0.0009) [2023-12-26 14:37:43,750][123091] Updated weights for policy 0, policy_version 1882358 (0.0007) [2023-12-26 14:37:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 960782336. Throughput: 0: 8838.2, 1: 9024.3. Samples: 960776880. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:43,785][121949] Avg episode reward: [(0, '6208.609'), (1, '5881.178')] [2023-12-26 14:37:43,801][123091] Updated weights for policy 0, policy_version 1882368 (0.0008) [2023-12-26 14:37:43,857][123091] Updated weights for policy 0, policy_version 1882378 (0.0009) [2023-12-26 14:37:44,545][123090] Updated weights for policy 1, policy_version 1870689 (0.0010) [2023-12-26 14:37:44,610][123090] Updated weights for policy 1, policy_version 1870699 (0.0009) [2023-12-26 14:37:44,681][123090] Updated weights for policy 1, policy_version 1870709 (0.0008) [2023-12-26 14:37:44,718][123091] Updated weights for policy 0, policy_version 1882388 (0.0009) [2023-12-26 14:37:44,733][123090] Updated weights for policy 1, policy_version 1870719 (0.0008) [2023-12-26 14:37:44,786][123091] Updated weights for policy 0, policy_version 1882398 (0.0007) [2023-12-26 14:37:44,853][123091] Updated weights for policy 0, policy_version 1882408 (0.0009) [2023-12-26 14:37:45,609][123090] Updated weights for policy 1, policy_version 1870729 (0.0009) [2023-12-26 14:37:45,668][123091] Updated weights for policy 0, policy_version 1882418 (0.0010) [2023-12-26 14:37:45,673][123090] Updated weights for policy 1, policy_version 1870739 (0.0009) [2023-12-26 14:37:45,728][123091] Updated weights for policy 0, policy_version 1882428 (0.0011) [2023-12-26 14:37:45,731][123090] Updated weights for policy 1, policy_version 1870749 (0.0008) [2023-12-26 14:37:45,787][123091] Updated weights for policy 0, policy_version 1882438 (0.0011) [2023-12-26 14:37:45,846][123091] Updated weights for policy 0, policy_version 1882448 (0.0011) [2023-12-26 14:37:46,572][123091] Updated weights for policy 0, policy_version 1882458 (0.0009) [2023-12-26 14:37:46,577][123090] Updated weights for policy 1, policy_version 1870759 (0.0007) [2023-12-26 14:37:46,634][123091] Updated weights for policy 0, policy_version 1882468 (0.0009) [2023-12-26 14:37:46,643][123090] Updated weights for policy 1, policy_version 1870769 (0.0009) [2023-12-26 14:37:46,697][123091] Updated weights for policy 0, policy_version 1882478 (0.0009) [2023-12-26 14:37:46,702][123090] Updated weights for policy 1, policy_version 1870779 (0.0010) [2023-12-26 14:37:47,307][123090] Updated weights for policy 1, policy_version 1870789 (0.0008) [2023-12-26 14:37:47,383][123090] Updated weights for policy 1, policy_version 1870799 (0.0006) [2023-12-26 14:37:47,461][123090] Updated weights for policy 1, policy_version 1870809 (0.0005) [2023-12-26 14:37:47,558][123091] Updated weights for policy 0, policy_version 1882488 (0.0006) [2023-12-26 14:37:47,635][123091] Updated weights for policy 0, policy_version 1882498 (0.0007) [2023-12-26 14:37:47,703][123091] Updated weights for policy 0, policy_version 1882508 (0.0010) [2023-12-26 14:37:48,159][123090] Updated weights for policy 1, policy_version 1870819 (0.0006) [2023-12-26 14:37:48,206][123090] Updated weights for policy 1, policy_version 1870829 (0.0005) [2023-12-26 14:37:48,263][123090] Updated weights for policy 1, policy_version 1870839 (0.0009) [2023-12-26 14:37:48,519][123091] Updated weights for policy 0, policy_version 1882518 (0.0010) [2023-12-26 14:37:48,576][123091] Updated weights for policy 0, policy_version 1882528 (0.0010) [2023-12-26 14:37:48,631][123091] Updated weights for policy 0, policy_version 1882539 (0.0010) [2023-12-26 14:37:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 960872448. Throughput: 0: 8798.3, 1: 8964.5. Samples: 960881160. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:48,784][121949] Avg episode reward: [(0, '6255.756'), (1, '5689.791')] [2023-12-26 14:37:49,060][123090] Updated weights for policy 1, policy_version 1870849 (0.0008) [2023-12-26 14:37:49,131][123090] Updated weights for policy 1, policy_version 1870859 (0.0010) [2023-12-26 14:37:49,205][123090] Updated weights for policy 1, policy_version 1870869 (0.0009) [2023-12-26 14:37:49,275][123090] Updated weights for policy 1, policy_version 1870879 (0.0010) [2023-12-26 14:37:49,485][123091] Updated weights for policy 0, policy_version 1882550 (0.0011) [2023-12-26 14:37:49,542][123091] Updated weights for policy 0, policy_version 1882560 (0.0010) [2023-12-26 14:37:49,591][123091] Updated weights for policy 0, policy_version 1882570 (0.0006) [2023-12-26 14:37:50,076][123090] Updated weights for policy 1, policy_version 1870889 (0.0010) [2023-12-26 14:37:50,150][123090] Updated weights for policy 1, policy_version 1870899 (0.0009) [2023-12-26 14:37:50,220][123090] Updated weights for policy 1, policy_version 1870909 (0.0009) [2023-12-26 14:37:50,379][123091] Updated weights for policy 0, policy_version 1882580 (0.0007) [2023-12-26 14:37:50,433][123091] Updated weights for policy 0, policy_version 1882590 (0.0005) [2023-12-26 14:37:50,489][123091] Updated weights for policy 0, policy_version 1882600 (0.0005) [2023-12-26 14:37:50,992][123090] Updated weights for policy 1, policy_version 1870919 (0.0009) [2023-12-26 14:37:51,062][123090] Updated weights for policy 1, policy_version 1870929 (0.0008) [2023-12-26 14:37:51,127][123090] Updated weights for policy 1, policy_version 1870939 (0.0007) [2023-12-26 14:37:51,312][123091] Updated weights for policy 0, policy_version 1882610 (0.0006) [2023-12-26 14:37:51,380][123091] Updated weights for policy 0, policy_version 1882620 (0.0010) [2023-12-26 14:37:51,446][123091] Updated weights for policy 0, policy_version 1882630 (0.0010) [2023-12-26 14:37:51,504][123091] Updated weights for policy 0, policy_version 1882640 (0.0009) [2023-12-26 14:37:51,887][123090] Updated weights for policy 1, policy_version 1870949 (0.0008) [2023-12-26 14:37:51,954][123090] Updated weights for policy 1, policy_version 1870959 (0.0009) [2023-12-26 14:37:52,024][123090] Updated weights for policy 1, policy_version 1870969 (0.0007) [2023-12-26 14:37:52,400][123091] Updated weights for policy 0, policy_version 1882650 (0.0009) [2023-12-26 14:37:52,453][123091] Updated weights for policy 0, policy_version 1882660 (0.0009) [2023-12-26 14:37:52,507][123091] Updated weights for policy 0, policy_version 1882670 (0.0006) [2023-12-26 14:37:52,815][123090] Updated weights for policy 1, policy_version 1870979 (0.0005) [2023-12-26 14:37:52,872][123090] Updated weights for policy 1, policy_version 1870989 (0.0005) [2023-12-26 14:37:52,930][123090] Updated weights for policy 1, policy_version 1870999 (0.0007) [2023-12-26 14:37:53,269][123091] Updated weights for policy 0, policy_version 1882680 (0.0009) [2023-12-26 14:37:53,327][123091] Updated weights for policy 0, policy_version 1882690 (0.0010) [2023-12-26 14:37:53,384][123091] Updated weights for policy 0, policy_version 1882700 (0.0010) [2023-12-26 14:37:53,565][123090] Updated weights for policy 1, policy_version 1871009 (0.0006) [2023-12-26 14:37:53,618][123090] Updated weights for policy 1, policy_version 1871019 (0.0009) [2023-12-26 14:37:53,687][123090] Updated weights for policy 1, policy_version 1871029 (0.0009) [2023-12-26 14:37:53,752][123090] Updated weights for policy 1, policy_version 1871040 (0.0010) [2023-12-26 14:37:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 960962560. Throughput: 0: 8785.7, 1: 8942.1. Samples: 960933568. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:53,785][121949] Avg episode reward: [(0, '6273.982'), (1, '5669.112')] [2023-12-26 14:37:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001882704_481976320.pth... [2023-12-26 14:37:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001871040_478986240.pth... [2023-12-26 14:37:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001881680_481714176.pth [2023-12-26 14:37:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001869984_478715904.pth [2023-12-26 14:37:54,187][123091] Updated weights for policy 0, policy_version 1882710 (0.0010) [2023-12-26 14:37:54,235][123091] Updated weights for policy 0, policy_version 1882720 (0.0010) [2023-12-26 14:37:54,290][123091] Updated weights for policy 0, policy_version 1882730 (0.0010) [2023-12-26 14:37:54,529][123090] Updated weights for policy 1, policy_version 1871050 (0.0010) [2023-12-26 14:37:54,595][123090] Updated weights for policy 1, policy_version 1871060 (0.0010) [2023-12-26 14:37:54,662][123090] Updated weights for policy 1, policy_version 1871070 (0.0009) [2023-12-26 14:37:55,048][123091] Updated weights for policy 0, policy_version 1882740 (0.0010) [2023-12-26 14:37:55,100][123091] Updated weights for policy 0, policy_version 1882750 (0.0010) [2023-12-26 14:37:55,151][123091] Updated weights for policy 0, policy_version 1882760 (0.0010) [2023-12-26 14:37:55,491][123090] Updated weights for policy 1, policy_version 1871080 (0.0006) [2023-12-26 14:37:55,543][123090] Updated weights for policy 1, policy_version 1871090 (0.0006) [2023-12-26 14:37:55,595][123090] Updated weights for policy 1, policy_version 1871100 (0.0005) [2023-12-26 14:37:55,833][123091] Updated weights for policy 0, policy_version 1882770 (0.0009) [2023-12-26 14:37:55,894][123091] Updated weights for policy 0, policy_version 1882780 (0.0005) [2023-12-26 14:37:55,955][123091] Updated weights for policy 0, policy_version 1882790 (0.0006) [2023-12-26 14:37:56,014][123091] Updated weights for policy 0, policy_version 1882800 (0.0005) [2023-12-26 14:37:56,356][123090] Updated weights for policy 1, policy_version 1871110 (0.0008) [2023-12-26 14:37:56,422][123090] Updated weights for policy 1, policy_version 1871120 (0.0010) [2023-12-26 14:37:56,491][123090] Updated weights for policy 1, policy_version 1871130 (0.0010) [2023-12-26 14:37:56,694][123091] Updated weights for policy 0, policy_version 1882810 (0.0007) [2023-12-26 14:37:56,741][123091] Updated weights for policy 0, policy_version 1882820 (0.0005) [2023-12-26 14:37:56,789][123091] Updated weights for policy 0, policy_version 1882830 (0.0005) [2023-12-26 14:37:57,287][123090] Updated weights for policy 1, policy_version 1871140 (0.0010) [2023-12-26 14:37:57,339][123090] Updated weights for policy 1, policy_version 1871150 (0.0007) [2023-12-26 14:37:57,392][123090] Updated weights for policy 1, policy_version 1871160 (0.0005) [2023-12-26 14:37:57,438][123091] Updated weights for policy 0, policy_version 1882840 (0.0005) [2023-12-26 14:37:57,514][123091] Updated weights for policy 0, policy_version 1882850 (0.0006) [2023-12-26 14:37:57,575][123091] Updated weights for policy 0, policy_version 1882860 (0.0008) [2023-12-26 14:37:58,135][123090] Updated weights for policy 1, policy_version 1871170 (0.0006) [2023-12-26 14:37:58,210][123090] Updated weights for policy 1, policy_version 1871180 (0.0008) [2023-12-26 14:37:58,274][123090] Updated weights for policy 1, policy_version 1871190 (0.0007) [2023-12-26 14:37:58,345][123090] Updated weights for policy 1, policy_version 1871200 (0.0006) [2023-12-26 14:37:58,354][123091] Updated weights for policy 0, policy_version 1882870 (0.0009) [2023-12-26 14:37:58,420][123091] Updated weights for policy 0, policy_version 1882880 (0.0011) [2023-12-26 14:37:58,493][123091] Updated weights for policy 0, policy_version 1882890 (0.0009) [2023-12-26 14:37:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 961052672. Throughput: 0: 8922.0, 1: 9022.4. Samples: 961044772. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:37:58,785][121949] Avg episode reward: [(0, '6326.593'), (1, '5670.534')] [2023-12-26 14:37:59,104][123090] Updated weights for policy 1, policy_version 1871211 (0.0010) [2023-12-26 14:37:59,157][123090] Updated weights for policy 1, policy_version 1871222 (0.0010) [2023-12-26 14:37:59,268][123091] Updated weights for policy 0, policy_version 1882900 (0.0008) [2023-12-26 14:37:59,335][123091] Updated weights for policy 0, policy_version 1882910 (0.0008) [2023-12-26 14:37:59,401][123091] Updated weights for policy 0, policy_version 1882920 (0.0009) [2023-12-26 14:38:00,039][123090] Updated weights for policy 1, policy_version 1871233 (0.0010) [2023-12-26 14:38:00,099][123090] Updated weights for policy 1, policy_version 1871243 (0.0009) [2023-12-26 14:38:00,158][123090] Updated weights for policy 1, policy_version 1871253 (0.0010) [2023-12-26 14:38:00,223][123090] Updated weights for policy 1, policy_version 1871263 (0.0006) [2023-12-26 14:38:00,255][123091] Updated weights for policy 0, policy_version 1882930 (0.0009) [2023-12-26 14:38:00,312][123091] Updated weights for policy 0, policy_version 1882941 (0.0010) [2023-12-26 14:38:00,375][123091] Updated weights for policy 0, policy_version 1882951 (0.0009) [2023-12-26 14:38:00,954][123090] Updated weights for policy 1, policy_version 1871273 (0.0006) [2023-12-26 14:38:01,027][123090] Updated weights for policy 1, policy_version 1871283 (0.0006) [2023-12-26 14:38:01,086][123090] Updated weights for policy 1, policy_version 1871293 (0.0007) [2023-12-26 14:38:01,101][123091] Updated weights for policy 0, policy_version 1882961 (0.0009) [2023-12-26 14:38:01,174][123091] Updated weights for policy 0, policy_version 1882971 (0.0008) [2023-12-26 14:38:01,242][123091] Updated weights for policy 0, policy_version 1882981 (0.0009) [2023-12-26 14:38:01,313][123091] Updated weights for policy 0, policy_version 1882991 (0.0010) [2023-12-26 14:38:01,765][123090] Updated weights for policy 1, policy_version 1871303 (0.0008) [2023-12-26 14:38:01,827][123090] Updated weights for policy 1, policy_version 1871313 (0.0008) [2023-12-26 14:38:01,883][123090] Updated weights for policy 1, policy_version 1871323 (0.0007) [2023-12-26 14:38:02,180][123091] Updated weights for policy 0, policy_version 1883001 (0.0010) [2023-12-26 14:38:02,234][123091] Updated weights for policy 0, policy_version 1883011 (0.0010) [2023-12-26 14:38:02,299][123091] Updated weights for policy 0, policy_version 1883021 (0.0009) [2023-12-26 14:38:02,660][123090] Updated weights for policy 1, policy_version 1871333 (0.0009) [2023-12-26 14:38:02,719][123090] Updated weights for policy 1, policy_version 1871343 (0.0006) [2023-12-26 14:38:02,788][123090] Updated weights for policy 1, policy_version 1871353 (0.0005) [2023-12-26 14:38:03,224][123091] Updated weights for policy 0, policy_version 1883031 (0.0009) [2023-12-26 14:38:03,287][123091] Updated weights for policy 0, policy_version 1883041 (0.0009) [2023-12-26 14:38:03,350][123091] Updated weights for policy 0, policy_version 1883051 (0.0010) [2023-12-26 14:38:03,511][123090] Updated weights for policy 1, policy_version 1871363 (0.0006) [2023-12-26 14:38:03,567][123090] Updated weights for policy 1, policy_version 1871373 (0.0008) [2023-12-26 14:38:03,621][123090] Updated weights for policy 1, policy_version 1871383 (0.0005) [2023-12-26 14:38:03,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 961142784. Throughput: 0: 8864.4, 1: 9002.6. Samples: 961151820. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:03,785][121949] Avg episode reward: [(0, '6276.983'), (1, '5851.704')] [2023-12-26 14:38:04,093][123091] Updated weights for policy 0, policy_version 1883061 (0.0007) [2023-12-26 14:38:04,158][123091] Updated weights for policy 0, policy_version 1883071 (0.0008) [2023-12-26 14:38:04,225][123091] Updated weights for policy 0, policy_version 1883081 (0.0011) [2023-12-26 14:38:04,362][123090] Updated weights for policy 1, policy_version 1871393 (0.0005) [2023-12-26 14:38:04,432][123090] Updated weights for policy 1, policy_version 1871403 (0.0005) [2023-12-26 14:38:04,501][123090] Updated weights for policy 1, policy_version 1871413 (0.0007) [2023-12-26 14:38:04,569][123090] Updated weights for policy 1, policy_version 1871423 (0.0005) [2023-12-26 14:38:05,037][123091] Updated weights for policy 0, policy_version 1883091 (0.0010) [2023-12-26 14:38:05,098][123091] Updated weights for policy 0, policy_version 1883101 (0.0009) [2023-12-26 14:38:05,153][123091] Updated weights for policy 0, policy_version 1883111 (0.0009) [2023-12-26 14:38:05,217][123090] Updated weights for policy 1, policy_version 1871433 (0.0010) [2023-12-26 14:38:05,282][123090] Updated weights for policy 1, policy_version 1871443 (0.0010) [2023-12-26 14:38:05,330][123090] Updated weights for policy 1, policy_version 1871453 (0.0010) [2023-12-26 14:38:05,857][123091] Updated weights for policy 0, policy_version 1883121 (0.0009) [2023-12-26 14:38:05,921][123091] Updated weights for policy 0, policy_version 1883131 (0.0007) [2023-12-26 14:38:05,979][123091] Updated weights for policy 0, policy_version 1883141 (0.0010) [2023-12-26 14:38:06,043][123091] Updated weights for policy 0, policy_version 1883151 (0.0005) [2023-12-26 14:38:06,167][123090] Updated weights for policy 1, policy_version 1871463 (0.0010) [2023-12-26 14:38:06,243][123090] Updated weights for policy 1, policy_version 1871473 (0.0010) [2023-12-26 14:38:06,321][123090] Updated weights for policy 1, policy_version 1871483 (0.0007) [2023-12-26 14:38:06,734][123091] Updated weights for policy 0, policy_version 1883161 (0.0005) [2023-12-26 14:38:06,791][123091] Updated weights for policy 0, policy_version 1883171 (0.0006) [2023-12-26 14:38:06,839][123091] Updated weights for policy 0, policy_version 1883181 (0.0010) [2023-12-26 14:38:07,110][123090] Updated weights for policy 1, policy_version 1871493 (0.0011) [2023-12-26 14:38:07,157][123090] Updated weights for policy 1, policy_version 1871503 (0.0010) [2023-12-26 14:38:07,213][123090] Updated weights for policy 1, policy_version 1871513 (0.0010) [2023-12-26 14:38:07,634][123091] Updated weights for policy 0, policy_version 1883191 (0.0007) [2023-12-26 14:38:07,695][123091] Updated weights for policy 0, policy_version 1883201 (0.0005) [2023-12-26 14:38:07,751][123091] Updated weights for policy 0, policy_version 1883211 (0.0010) [2023-12-26 14:38:08,062][123090] Updated weights for policy 1, policy_version 1871523 (0.0011) [2023-12-26 14:38:08,129][123090] Updated weights for policy 1, policy_version 1871533 (0.0010) [2023-12-26 14:38:08,188][123090] Updated weights for policy 1, policy_version 1871543 (0.0010) [2023-12-26 14:38:08,483][123091] Updated weights for policy 0, policy_version 1883221 (0.0010) [2023-12-26 14:38:08,545][123091] Updated weights for policy 0, policy_version 1883231 (0.0010) [2023-12-26 14:38:08,615][123091] Updated weights for policy 0, policy_version 1883241 (0.0009) [2023-12-26 14:38:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 961232896. Throughput: 0: 8941.1, 1: 9037.7. Samples: 961207004. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:08,785][121949] Avg episode reward: [(0, '6217.464'), (1, '5992.707')] [2023-12-26 14:38:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001883248_482115584.pth... [2023-12-26 14:38:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001871552_479117312.pth... [2023-12-26 14:38:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001882192_481845248.pth [2023-12-26 14:38:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001870528_478855168.pth [2023-12-26 14:38:09,003][123090] Updated weights for policy 1, policy_version 1871553 (0.0010) [2023-12-26 14:38:09,073][123090] Updated weights for policy 1, policy_version 1871563 (0.0011) [2023-12-26 14:38:09,140][123090] Updated weights for policy 1, policy_version 1871573 (0.0009) [2023-12-26 14:38:09,196][123090] Updated weights for policy 1, policy_version 1871583 (0.0009) [2023-12-26 14:38:09,479][123091] Updated weights for policy 0, policy_version 1883251 (0.0009) [2023-12-26 14:38:09,545][123091] Updated weights for policy 0, policy_version 1883261 (0.0010) [2023-12-26 14:38:09,605][123091] Updated weights for policy 0, policy_version 1883271 (0.0011) [2023-12-26 14:38:10,101][123090] Updated weights for policy 1, policy_version 1871593 (0.0009) [2023-12-26 14:38:10,159][123090] Updated weights for policy 1, policy_version 1871603 (0.0010) [2023-12-26 14:38:10,221][123090] Updated weights for policy 1, policy_version 1871613 (0.0009) [2023-12-26 14:38:10,339][123091] Updated weights for policy 0, policy_version 1883281 (0.0011) [2023-12-26 14:38:10,410][123091] Updated weights for policy 0, policy_version 1883291 (0.0011) [2023-12-26 14:38:10,473][123091] Updated weights for policy 0, policy_version 1883301 (0.0008) [2023-12-26 14:38:10,530][123091] Updated weights for policy 0, policy_version 1883311 (0.0005) [2023-12-26 14:38:11,073][123090] Updated weights for policy 1, policy_version 1871623 (0.0009) [2023-12-26 14:38:11,142][123090] Updated weights for policy 1, policy_version 1871633 (0.0009) [2023-12-26 14:38:11,198][123091] Updated weights for policy 0, policy_version 1883321 (0.0008) [2023-12-26 14:38:11,208][123090] Updated weights for policy 1, policy_version 1871643 (0.0011) [2023-12-26 14:38:11,261][123091] Updated weights for policy 0, policy_version 1883331 (0.0008) [2023-12-26 14:38:11,328][123091] Updated weights for policy 0, policy_version 1883341 (0.0008) [2023-12-26 14:38:12,061][123090] Updated weights for policy 1, policy_version 1871653 (0.0008) [2023-12-26 14:38:12,114][123091] Updated weights for policy 0, policy_version 1883351 (0.0007) [2023-12-26 14:38:12,126][123090] Updated weights for policy 1, policy_version 1871663 (0.0011) [2023-12-26 14:38:12,185][123091] Updated weights for policy 0, policy_version 1883361 (0.0007) [2023-12-26 14:38:12,198][123090] Updated weights for policy 1, policy_version 1871673 (0.0008) [2023-12-26 14:38:12,242][123091] Updated weights for policy 0, policy_version 1883371 (0.0010) [2023-12-26 14:38:12,956][123090] Updated weights for policy 1, policy_version 1871683 (0.0010) [2023-12-26 14:38:12,996][123091] Updated weights for policy 0, policy_version 1883381 (0.0008) [2023-12-26 14:38:13,016][123090] Updated weights for policy 1, policy_version 1871693 (0.0010) [2023-12-26 14:38:13,047][123091] Updated weights for policy 0, policy_version 1883391 (0.0005) [2023-12-26 14:38:13,076][123090] Updated weights for policy 1, policy_version 1871703 (0.0010) [2023-12-26 14:38:13,099][123091] Updated weights for policy 0, policy_version 1883401 (0.0007) [2023-12-26 14:38:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 961314816. Throughput: 0: 8993.3, 1: 8894.4. Samples: 961312220. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:13,785][121949] Avg episode reward: [(0, '6295.837'), (1, '5978.442')] [2023-12-26 14:38:13,830][123090] Updated weights for policy 1, policy_version 1871713 (0.0009) [2023-12-26 14:38:13,872][123091] Updated weights for policy 0, policy_version 1883411 (0.0010) [2023-12-26 14:38:13,893][123090] Updated weights for policy 1, policy_version 1871723 (0.0010) [2023-12-26 14:38:13,939][123091] Updated weights for policy 0, policy_version 1883421 (0.0008) [2023-12-26 14:38:13,956][123090] Updated weights for policy 1, policy_version 1871733 (0.0010) [2023-12-26 14:38:13,994][123091] Updated weights for policy 0, policy_version 1883431 (0.0006) [2023-12-26 14:38:14,020][123090] Updated weights for policy 1, policy_version 1871743 (0.0010) [2023-12-26 14:38:14,767][123091] Updated weights for policy 0, policy_version 1883441 (0.0006) [2023-12-26 14:38:14,790][123090] Updated weights for policy 1, policy_version 1871753 (0.0009) [2023-12-26 14:38:14,832][123091] Updated weights for policy 0, policy_version 1883451 (0.0009) [2023-12-26 14:38:14,850][123090] Updated weights for policy 1, policy_version 1871763 (0.0008) [2023-12-26 14:38:14,886][123091] Updated weights for policy 0, policy_version 1883461 (0.0010) [2023-12-26 14:38:14,914][123090] Updated weights for policy 1, policy_version 1871773 (0.0011) [2023-12-26 14:38:14,938][123091] Updated weights for policy 0, policy_version 1883471 (0.0006) [2023-12-26 14:38:15,697][123090] Updated weights for policy 1, policy_version 1871783 (0.0011) [2023-12-26 14:38:15,761][123090] Updated weights for policy 1, policy_version 1871793 (0.0011) [2023-12-26 14:38:15,806][123091] Updated weights for policy 0, policy_version 1883481 (0.0006) [2023-12-26 14:38:15,817][123090] Updated weights for policy 1, policy_version 1871803 (0.0010) [2023-12-26 14:38:15,866][123091] Updated weights for policy 0, policy_version 1883491 (0.0008) [2023-12-26 14:38:15,925][123091] Updated weights for policy 0, policy_version 1883501 (0.0008) [2023-12-26 14:38:16,635][123090] Updated weights for policy 1, policy_version 1871813 (0.0008) [2023-12-26 14:38:16,694][123090] Updated weights for policy 1, policy_version 1871823 (0.0005) [2023-12-26 14:38:16,707][123091] Updated weights for policy 0, policy_version 1883511 (0.0009) [2023-12-26 14:38:16,760][123091] Updated weights for policy 0, policy_version 1883522 (0.0009) [2023-12-26 14:38:16,760][123090] Updated weights for policy 1, policy_version 1871833 (0.0005) [2023-12-26 14:38:16,808][123091] Updated weights for policy 0, policy_version 1883532 (0.0009) [2023-12-26 14:38:17,342][123090] Updated weights for policy 1, policy_version 1871843 (0.0005) [2023-12-26 14:38:17,398][123090] Updated weights for policy 1, policy_version 1871853 (0.0009) [2023-12-26 14:38:17,477][123090] Updated weights for policy 1, policy_version 1871863 (0.0011) [2023-12-26 14:38:17,675][123091] Updated weights for policy 0, policy_version 1883542 (0.0009) [2023-12-26 14:38:17,726][123091] Updated weights for policy 0, policy_version 1883552 (0.0009) [2023-12-26 14:38:17,784][123091] Updated weights for policy 0, policy_version 1883562 (0.0010) [2023-12-26 14:38:18,207][123090] Updated weights for policy 1, policy_version 1871873 (0.0006) [2023-12-26 14:38:18,270][123090] Updated weights for policy 1, policy_version 1871883 (0.0006) [2023-12-26 14:38:18,342][123090] Updated weights for policy 1, policy_version 1871893 (0.0007) [2023-12-26 14:38:18,412][123090] Updated weights for policy 1, policy_version 1871903 (0.0008) [2023-12-26 14:38:18,699][123091] Updated weights for policy 0, policy_version 1883572 (0.0010) [2023-12-26 14:38:18,759][123091] Updated weights for policy 0, policy_version 1883582 (0.0011) [2023-12-26 14:38:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 961404928. Throughput: 0: 8918.8, 1: 8906.4. Samples: 961419620. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:18,785][121949] Avg episode reward: [(0, '6302.324'), (1, '5929.881')] [2023-12-26 14:38:18,815][123091] Updated weights for policy 0, policy_version 1883592 (0.0010) [2023-12-26 14:38:19,165][123090] Updated weights for policy 1, policy_version 1871913 (0.0010) [2023-12-26 14:38:19,233][123090] Updated weights for policy 1, policy_version 1871923 (0.0008) [2023-12-26 14:38:19,291][123090] Updated weights for policy 1, policy_version 1871933 (0.0009) [2023-12-26 14:38:19,559][123091] Updated weights for policy 0, policy_version 1883602 (0.0011) [2023-12-26 14:38:19,626][123091] Updated weights for policy 0, policy_version 1883612 (0.0011) [2023-12-26 14:38:19,692][123091] Updated weights for policy 0, policy_version 1883622 (0.0011) [2023-12-26 14:38:19,767][123091] Updated weights for policy 0, policy_version 1883632 (0.0011) [2023-12-26 14:38:20,079][123090] Updated weights for policy 1, policy_version 1871943 (0.0011) [2023-12-26 14:38:20,139][123090] Updated weights for policy 1, policy_version 1871953 (0.0011) [2023-12-26 14:38:20,188][123090] Updated weights for policy 1, policy_version 1871963 (0.0010) [2023-12-26 14:38:20,586][123091] Updated weights for policy 0, policy_version 1883642 (0.0007) [2023-12-26 14:38:20,639][123091] Updated weights for policy 0, policy_version 1883652 (0.0010) [2023-12-26 14:38:20,703][123091] Updated weights for policy 0, policy_version 1883662 (0.0011) [2023-12-26 14:38:21,068][123090] Updated weights for policy 1, policy_version 1871973 (0.0011) [2023-12-26 14:38:21,137][123090] Updated weights for policy 1, policy_version 1871983 (0.0010) [2023-12-26 14:38:21,213][123090] Updated weights for policy 1, policy_version 1871993 (0.0008) [2023-12-26 14:38:21,509][123091] Updated weights for policy 0, policy_version 1883672 (0.0008) [2023-12-26 14:38:21,582][123091] Updated weights for policy 0, policy_version 1883682 (0.0006) [2023-12-26 14:38:21,652][123091] Updated weights for policy 0, policy_version 1883692 (0.0010) [2023-12-26 14:38:22,057][123090] Updated weights for policy 1, policy_version 1872003 (0.0009) [2023-12-26 14:38:22,114][123090] Updated weights for policy 1, policy_version 1872013 (0.0005) [2023-12-26 14:38:22,181][123090] Updated weights for policy 1, policy_version 1872023 (0.0006) [2023-12-26 14:38:22,453][123091] Updated weights for policy 0, policy_version 1883702 (0.0010) [2023-12-26 14:38:22,510][123091] Updated weights for policy 0, policy_version 1883712 (0.0009) [2023-12-26 14:38:22,562][123091] Updated weights for policy 0, policy_version 1883722 (0.0009) [2023-12-26 14:38:22,915][123090] Updated weights for policy 1, policy_version 1872033 (0.0007) [2023-12-26 14:38:22,977][123090] Updated weights for policy 1, policy_version 1872043 (0.0005) [2023-12-26 14:38:23,040][123090] Updated weights for policy 1, policy_version 1872053 (0.0007) [2023-12-26 14:38:23,094][123090] Updated weights for policy 1, policy_version 1872063 (0.0008) [2023-12-26 14:38:23,451][123091] Updated weights for policy 0, policy_version 1883732 (0.0009) [2023-12-26 14:38:23,511][123091] Updated weights for policy 0, policy_version 1883742 (0.0009) [2023-12-26 14:38:23,578][123091] Updated weights for policy 0, policy_version 1883752 (0.0009) [2023-12-26 14:38:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17716.9). Total num frames: 961495040. Throughput: 0: 8864.0, 1: 8880.5. Samples: 961471040. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:23,785][121949] Avg episode reward: [(0, '6234.756'), (1, '5832.883')] [2023-12-26 14:38:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001872064_479248384.pth... [2023-12-26 14:38:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001883760_482246656.pth... [2023-12-26 14:38:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001871040_478986240.pth [2023-12-26 14:38:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001882704_481976320.pth [2023-12-26 14:38:23,902][123090] Updated weights for policy 1, policy_version 1872073 (0.0010) [2023-12-26 14:38:23,966][123090] Updated weights for policy 1, policy_version 1872083 (0.0009) [2023-12-26 14:38:24,033][123090] Updated weights for policy 1, policy_version 1872093 (0.0010) [2023-12-26 14:38:24,352][123091] Updated weights for policy 0, policy_version 1883762 (0.0009) [2023-12-26 14:38:24,418][123091] Updated weights for policy 0, policy_version 1883772 (0.0009) [2023-12-26 14:38:24,484][123091] Updated weights for policy 0, policy_version 1883782 (0.0009) [2023-12-26 14:38:24,541][123091] Updated weights for policy 0, policy_version 1883792 (0.0009) [2023-12-26 14:38:24,864][123090] Updated weights for policy 1, policy_version 1872103 (0.0009) [2023-12-26 14:38:24,917][123090] Updated weights for policy 1, policy_version 1872113 (0.0005) [2023-12-26 14:38:24,972][123090] Updated weights for policy 1, policy_version 1872123 (0.0005) [2023-12-26 14:38:25,374][123091] Updated weights for policy 0, policy_version 1883802 (0.0010) [2023-12-26 14:38:25,421][123091] Updated weights for policy 0, policy_version 1883812 (0.0010) [2023-12-26 14:38:25,469][123091] Updated weights for policy 0, policy_version 1883822 (0.0010) [2023-12-26 14:38:25,655][123090] Updated weights for policy 1, policy_version 1872133 (0.0005) [2023-12-26 14:38:25,707][123090] Updated weights for policy 1, policy_version 1872143 (0.0005) [2023-12-26 14:38:25,785][123090] Updated weights for policy 1, policy_version 1872153 (0.0005) [2023-12-26 14:38:26,240][123091] Updated weights for policy 0, policy_version 1883832 (0.0005) [2023-12-26 14:38:26,306][123091] Updated weights for policy 0, policy_version 1883842 (0.0005) [2023-12-26 14:38:26,364][123091] Updated weights for policy 0, policy_version 1883852 (0.0005) [2023-12-26 14:38:26,460][123090] Updated weights for policy 1, policy_version 1872163 (0.0007) [2023-12-26 14:38:26,523][123090] Updated weights for policy 1, policy_version 1872173 (0.0011) [2023-12-26 14:38:26,593][123090] Updated weights for policy 1, policy_version 1872183 (0.0010) [2023-12-26 14:38:27,038][123091] Updated weights for policy 0, policy_version 1883862 (0.0006) [2023-12-26 14:38:27,082][123091] Updated weights for policy 0, policy_version 1883872 (0.0005) [2023-12-26 14:38:27,132][123091] Updated weights for policy 0, policy_version 1883882 (0.0005) [2023-12-26 14:38:27,370][123090] Updated weights for policy 1, policy_version 1872193 (0.0010) [2023-12-26 14:38:27,436][123090] Updated weights for policy 1, policy_version 1872203 (0.0008) [2023-12-26 14:38:27,499][123090] Updated weights for policy 1, policy_version 1872213 (0.0005) [2023-12-26 14:38:27,559][123090] Updated weights for policy 1, policy_version 1872223 (0.0005) [2023-12-26 14:38:27,889][123091] Updated weights for policy 0, policy_version 1883892 (0.0005) [2023-12-26 14:38:27,960][123091] Updated weights for policy 0, policy_version 1883902 (0.0009) [2023-12-26 14:38:28,030][123091] Updated weights for policy 0, policy_version 1883912 (0.0009) [2023-12-26 14:38:28,111][123090] Updated weights for policy 1, policy_version 1872233 (0.0010) [2023-12-26 14:38:28,162][123090] Updated weights for policy 1, policy_version 1872243 (0.0010) [2023-12-26 14:38:28,212][123090] Updated weights for policy 1, policy_version 1872253 (0.0010) [2023-12-26 14:38:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 961585152. Throughput: 0: 8926.6, 1: 8973.6. Samples: 961582388. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:28,785][121949] Avg episode reward: [(0, '6247.121'), (1, '5759.631')] [2023-12-26 14:38:28,834][123091] Updated weights for policy 0, policy_version 1883922 (0.0008) [2023-12-26 14:38:28,887][123091] Updated weights for policy 0, policy_version 1883932 (0.0009) [2023-12-26 14:38:28,942][123091] Updated weights for policy 0, policy_version 1883942 (0.0009) [2023-12-26 14:38:28,999][123091] Updated weights for policy 0, policy_version 1883952 (0.0007) [2023-12-26 14:38:29,005][123090] Updated weights for policy 1, policy_version 1872263 (0.0010) [2023-12-26 14:38:29,048][123090] Updated weights for policy 1, policy_version 1872273 (0.0009) [2023-12-26 14:38:29,093][123090] Updated weights for policy 1, policy_version 1872283 (0.0005) [2023-12-26 14:38:29,780][123090] Updated weights for policy 1, policy_version 1872293 (0.0005) [2023-12-26 14:38:29,835][123090] Updated weights for policy 1, policy_version 1872303 (0.0006) [2023-12-26 14:38:29,897][123090] Updated weights for policy 1, policy_version 1872313 (0.0010) [2023-12-26 14:38:29,921][123091] Updated weights for policy 0, policy_version 1883962 (0.0008) [2023-12-26 14:38:29,994][123091] Updated weights for policy 0, policy_version 1883972 (0.0006) [2023-12-26 14:38:30,051][123091] Updated weights for policy 0, policy_version 1883982 (0.0007) [2023-12-26 14:38:30,727][123090] Updated weights for policy 1, policy_version 1872323 (0.0011) [2023-12-26 14:38:30,782][123091] Updated weights for policy 0, policy_version 1883992 (0.0010) [2023-12-26 14:38:30,792][123090] Updated weights for policy 1, policy_version 1872333 (0.0010) [2023-12-26 14:38:30,843][123091] Updated weights for policy 0, policy_version 1884002 (0.0010) [2023-12-26 14:38:30,854][123090] Updated weights for policy 1, policy_version 1872343 (0.0010) [2023-12-26 14:38:30,901][123091] Updated weights for policy 0, policy_version 1884012 (0.0010) [2023-12-26 14:38:31,657][123090] Updated weights for policy 1, policy_version 1872353 (0.0010) [2023-12-26 14:38:31,662][123091] Updated weights for policy 0, policy_version 1884022 (0.0011) [2023-12-26 14:38:31,720][123090] Updated weights for policy 1, policy_version 1872363 (0.0008) [2023-12-26 14:38:31,722][123091] Updated weights for policy 0, policy_version 1884032 (0.0010) [2023-12-26 14:38:31,789][123091] Updated weights for policy 0, policy_version 1884042 (0.0009) [2023-12-26 14:38:31,791][123090] Updated weights for policy 1, policy_version 1872373 (0.0008) [2023-12-26 14:38:31,854][123090] Updated weights for policy 1, policy_version 1872383 (0.0009) [2023-12-26 14:38:32,538][123091] Updated weights for policy 0, policy_version 1884052 (0.0008) [2023-12-26 14:38:32,597][123091] Updated weights for policy 0, policy_version 1884062 (0.0006) [2023-12-26 14:38:32,664][123091] Updated weights for policy 0, policy_version 1884072 (0.0005) [2023-12-26 14:38:32,704][123090] Updated weights for policy 1, policy_version 1872393 (0.0008) [2023-12-26 14:38:32,767][123090] Updated weights for policy 1, policy_version 1872403 (0.0009) [2023-12-26 14:38:32,828][123090] Updated weights for policy 1, policy_version 1872413 (0.0009) [2023-12-26 14:38:33,334][123091] Updated weights for policy 0, policy_version 1884082 (0.0007) [2023-12-26 14:38:33,384][123091] Updated weights for policy 0, policy_version 1884092 (0.0009) [2023-12-26 14:38:33,431][123091] Updated weights for policy 0, policy_version 1884102 (0.0009) [2023-12-26 14:38:33,480][123091] Updated weights for policy 0, policy_version 1884112 (0.0009) [2023-12-26 14:38:33,674][123090] Updated weights for policy 1, policy_version 1872423 (0.0009) [2023-12-26 14:38:33,731][123090] Updated weights for policy 1, policy_version 1872433 (0.0009) [2023-12-26 14:38:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 961675264. Throughput: 0: 8934.6, 1: 9023.7. Samples: 961689284. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:33,785][121949] Avg episode reward: [(0, '6314.607'), (1, '5887.541')] [2023-12-26 14:38:33,790][123090] Updated weights for policy 1, policy_version 1872443 (0.0009) [2023-12-26 14:38:34,271][123091] Updated weights for policy 0, policy_version 1884122 (0.0007) [2023-12-26 14:38:34,340][123091] Updated weights for policy 0, policy_version 1884132 (0.0007) [2023-12-26 14:38:34,413][123091] Updated weights for policy 0, policy_version 1884142 (0.0006) [2023-12-26 14:38:34,650][123090] Updated weights for policy 1, policy_version 1872453 (0.0010) [2023-12-26 14:38:34,709][123090] Updated weights for policy 1, policy_version 1872463 (0.0009) [2023-12-26 14:38:34,770][123090] Updated weights for policy 1, policy_version 1872473 (0.0008) [2023-12-26 14:38:35,117][123091] Updated weights for policy 0, policy_version 1884152 (0.0005) [2023-12-26 14:38:35,167][123091] Updated weights for policy 0, policy_version 1884162 (0.0005) [2023-12-26 14:38:35,214][123091] Updated weights for policy 0, policy_version 1884172 (0.0005) [2023-12-26 14:38:35,665][123090] Updated weights for policy 1, policy_version 1872483 (0.0009) [2023-12-26 14:38:35,713][123090] Updated weights for policy 1, policy_version 1872493 (0.0009) [2023-12-26 14:38:35,762][123090] Updated weights for policy 1, policy_version 1872503 (0.0009) [2023-12-26 14:38:35,925][123091] Updated weights for policy 0, policy_version 1884182 (0.0008) [2023-12-26 14:38:35,973][123091] Updated weights for policy 0, policy_version 1884192 (0.0009) [2023-12-26 14:38:36,037][123091] Updated weights for policy 0, policy_version 1884202 (0.0010) [2023-12-26 14:38:36,630][123090] Updated weights for policy 1, policy_version 1872513 (0.0009) [2023-12-26 14:38:36,693][123090] Updated weights for policy 1, policy_version 1872523 (0.0009) [2023-12-26 14:38:36,751][123090] Updated weights for policy 1, policy_version 1872533 (0.0010) [2023-12-26 14:38:36,822][123090] Updated weights for policy 1, policy_version 1872543 (0.0009) [2023-12-26 14:38:36,839][123091] Updated weights for policy 0, policy_version 1884212 (0.0009) [2023-12-26 14:38:36,894][123091] Updated weights for policy 0, policy_version 1884222 (0.0010) [2023-12-26 14:38:36,948][123091] Updated weights for policy 0, policy_version 1884232 (0.0007) [2023-12-26 14:38:37,675][123090] Updated weights for policy 1, policy_version 1872553 (0.0010) [2023-12-26 14:38:37,720][123091] Updated weights for policy 0, policy_version 1884242 (0.0006) [2023-12-26 14:38:37,731][123090] Updated weights for policy 1, policy_version 1872563 (0.0009) [2023-12-26 14:38:37,784][123091] Updated weights for policy 0, policy_version 1884252 (0.0008) [2023-12-26 14:38:37,799][123090] Updated weights for policy 1, policy_version 1872573 (0.0008) [2023-12-26 14:38:37,849][123091] Updated weights for policy 0, policy_version 1884262 (0.0009) [2023-12-26 14:38:37,907][123091] Updated weights for policy 0, policy_version 1884272 (0.0010) [2023-12-26 14:38:38,649][123090] Updated weights for policy 1, policy_version 1872583 (0.0009) [2023-12-26 14:38:38,706][123090] Updated weights for policy 1, policy_version 1872593 (0.0008) [2023-12-26 14:38:38,733][123091] Updated weights for policy 0, policy_version 1884282 (0.0009) [2023-12-26 14:38:38,762][123090] Updated weights for policy 1, policy_version 1872603 (0.0007) [2023-12-26 14:38:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 961757184. Throughput: 0: 8988.5, 1: 8974.9. Samples: 961741924. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:38,785][121949] Avg episode reward: [(0, '6312.479'), (1, '5955.594')] [2023-12-26 14:38:38,791][123091] Updated weights for policy 0, policy_version 1884292 (0.0008) [2023-12-26 14:38:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001872608_479387648.pth... [2023-12-26 14:38:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001871552_479117312.pth [2023-12-26 14:38:38,850][123091] Updated weights for policy 0, policy_version 1884302 (0.0009) [2023-12-26 14:38:38,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001884304_482385920.pth... [2023-12-26 14:38:38,867][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001883248_482115584.pth [2023-12-26 14:38:39,641][123091] Updated weights for policy 0, policy_version 1884312 (0.0008) [2023-12-26 14:38:39,650][123090] Updated weights for policy 1, policy_version 1872613 (0.0008) [2023-12-26 14:38:39,690][123091] Updated weights for policy 0, policy_version 1884322 (0.0005) [2023-12-26 14:38:39,711][123090] Updated weights for policy 1, policy_version 1872623 (0.0009) [2023-12-26 14:38:39,744][123091] Updated weights for policy 0, policy_version 1884332 (0.0006) [2023-12-26 14:38:39,776][123090] Updated weights for policy 1, policy_version 1872633 (0.0010) [2023-12-26 14:38:40,566][123091] Updated weights for policy 0, policy_version 1884342 (0.0010) [2023-12-26 14:38:40,577][123090] Updated weights for policy 1, policy_version 1872643 (0.0008) [2023-12-26 14:38:40,617][123091] Updated weights for policy 0, policy_version 1884352 (0.0010) [2023-12-26 14:38:40,625][123090] Updated weights for policy 1, policy_version 1872653 (0.0007) [2023-12-26 14:38:40,665][123091] Updated weights for policy 0, policy_version 1884362 (0.0010) [2023-12-26 14:38:40,676][123090] Updated weights for policy 1, policy_version 1872663 (0.0005) [2023-12-26 14:38:41,474][123091] Updated weights for policy 0, policy_version 1884372 (0.0011) [2023-12-26 14:38:41,546][123091] Updated weights for policy 0, policy_version 1884382 (0.0010) [2023-12-26 14:38:41,609][123091] Updated weights for policy 0, policy_version 1884392 (0.0010) [2023-12-26 14:38:41,609][123090] Updated weights for policy 1, policy_version 1872673 (0.0008) [2023-12-26 14:38:41,668][123090] Updated weights for policy 1, policy_version 1872683 (0.0008) [2023-12-26 14:38:41,721][123090] Updated weights for policy 1, policy_version 1872693 (0.0009) [2023-12-26 14:38:41,799][123090] Updated weights for policy 1, policy_version 1872703 (0.0007) [2023-12-26 14:38:42,472][123091] Updated weights for policy 0, policy_version 1884402 (0.0009) [2023-12-26 14:38:42,541][123091] Updated weights for policy 0, policy_version 1884412 (0.0011) [2023-12-26 14:38:42,579][123090] Updated weights for policy 1, policy_version 1872713 (0.0006) [2023-12-26 14:38:42,609][123091] Updated weights for policy 0, policy_version 1884422 (0.0011) [2023-12-26 14:38:42,645][123090] Updated weights for policy 1, policy_version 1872723 (0.0006) [2023-12-26 14:38:42,678][123091] Updated weights for policy 0, policy_version 1884432 (0.0011) [2023-12-26 14:38:42,711][123090] Updated weights for policy 1, policy_version 1872733 (0.0007) [2023-12-26 14:38:43,435][123091] Updated weights for policy 0, policy_version 1884442 (0.0010) [2023-12-26 14:38:43,462][123090] Updated weights for policy 1, policy_version 1872743 (0.0008) [2023-12-26 14:38:43,486][123091] Updated weights for policy 0, policy_version 1884452 (0.0008) [2023-12-26 14:38:43,523][123090] Updated weights for policy 1, policy_version 1872753 (0.0008) [2023-12-26 14:38:43,535][123091] Updated weights for policy 0, policy_version 1884462 (0.0008) [2023-12-26 14:38:43,590][123090] Updated weights for policy 1, policy_version 1872763 (0.0010) [2023-12-26 14:38:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 961855488. Throughput: 0: 8884.2, 1: 8874.3. Samples: 961843904. Policy #0 lag: (min: 31.0, avg: 37.4, max: 63.0) [2023-12-26 14:38:43,785][121949] Avg episode reward: [(0, '6373.053'), (1, '5755.034')] [2023-12-26 14:38:44,303][123091] Updated weights for policy 0, policy_version 1884472 (0.0009) [2023-12-26 14:38:44,361][123091] Updated weights for policy 0, policy_version 1884482 (0.0010) [2023-12-26 14:38:44,430][123091] Updated weights for policy 0, policy_version 1884492 (0.0009) [2023-12-26 14:38:44,430][123090] Updated weights for policy 1, policy_version 1872773 (0.0010) [2023-12-26 14:38:44,488][123090] Updated weights for policy 1, policy_version 1872783 (0.0008) [2023-12-26 14:38:44,541][123090] Updated weights for policy 1, policy_version 1872793 (0.0009) [2023-12-26 14:38:45,228][123091] Updated weights for policy 0, policy_version 1884502 (0.0010) [2023-12-26 14:38:45,289][123091] Updated weights for policy 0, policy_version 1884512 (0.0010) [2023-12-26 14:38:45,352][123091] Updated weights for policy 0, policy_version 1884522 (0.0009) [2023-12-26 14:38:45,363][123090] Updated weights for policy 1, policy_version 1872803 (0.0009) [2023-12-26 14:38:45,430][123090] Updated weights for policy 1, policy_version 1872813 (0.0010) [2023-12-26 14:38:45,481][123090] Updated weights for policy 1, policy_version 1872823 (0.0010) [2023-12-26 14:38:46,141][123091] Updated weights for policy 0, policy_version 1884532 (0.0008) [2023-12-26 14:38:46,208][123091] Updated weights for policy 0, policy_version 1884542 (0.0006) [2023-12-26 14:38:46,273][123091] Updated weights for policy 0, policy_version 1884552 (0.0006) [2023-12-26 14:38:46,352][123090] Updated weights for policy 1, policy_version 1872833 (0.0009) [2023-12-26 14:38:46,408][123090] Updated weights for policy 1, policy_version 1872843 (0.0009) [2023-12-26 14:38:46,466][123090] Updated weights for policy 1, policy_version 1872853 (0.0009) [2023-12-26 14:38:46,534][123090] Updated weights for policy 1, policy_version 1872863 (0.0010) [2023-12-26 14:38:46,916][123091] Updated weights for policy 0, policy_version 1884562 (0.0007) [2023-12-26 14:38:46,988][123091] Updated weights for policy 0, policy_version 1884572 (0.0006) [2023-12-26 14:38:47,051][123091] Updated weights for policy 0, policy_version 1884582 (0.0006) [2023-12-26 14:38:47,120][123091] Updated weights for policy 0, policy_version 1884592 (0.0005) [2023-12-26 14:38:47,459][123090] Updated weights for policy 1, policy_version 1872873 (0.0009) [2023-12-26 14:38:47,526][123090] Updated weights for policy 1, policy_version 1872883 (0.0009) [2023-12-26 14:38:47,582][123090] Updated weights for policy 1, policy_version 1872893 (0.0009) [2023-12-26 14:38:47,877][123091] Updated weights for policy 0, policy_version 1884602 (0.0011) [2023-12-26 14:38:47,948][123091] Updated weights for policy 0, policy_version 1884612 (0.0011) [2023-12-26 14:38:48,038][123091] Updated weights for policy 0, policy_version 1884622 (0.0011) [2023-12-26 14:38:48,417][123090] Updated weights for policy 1, policy_version 1872903 (0.0010) [2023-12-26 14:38:48,491][123090] Updated weights for policy 1, policy_version 1872913 (0.0010) [2023-12-26 14:38:48,559][123090] Updated weights for policy 1, policy_version 1872923 (0.0009) [2023-12-26 14:38:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 961937408. Throughput: 0: 8977.2, 1: 8755.8. Samples: 961949804. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:38:48,785][121949] Avg episode reward: [(0, '6245.846'), (1, '5800.047')] [2023-12-26 14:38:48,807][123091] Updated weights for policy 0, policy_version 1884632 (0.0010) [2023-12-26 14:38:48,858][123091] Updated weights for policy 0, policy_version 1884642 (0.0009) [2023-12-26 14:38:48,924][123091] Updated weights for policy 0, policy_version 1884652 (0.0009) [2023-12-26 14:38:49,385][123090] Updated weights for policy 1, policy_version 1872933 (0.0007) [2023-12-26 14:38:49,436][123090] Updated weights for policy 1, policy_version 1872943 (0.0009) [2023-12-26 14:38:49,502][123090] Updated weights for policy 1, policy_version 1872953 (0.0010) [2023-12-26 14:38:49,737][123091] Updated weights for policy 0, policy_version 1884662 (0.0010) [2023-12-26 14:38:49,808][123091] Updated weights for policy 0, policy_version 1884672 (0.0010) [2023-12-26 14:38:49,880][123091] Updated weights for policy 0, policy_version 1884682 (0.0010) [2023-12-26 14:38:50,349][123090] Updated weights for policy 1, policy_version 1872964 (0.0010) [2023-12-26 14:38:50,414][123090] Updated weights for policy 1, policy_version 1872974 (0.0010) [2023-12-26 14:38:50,483][123090] Updated weights for policy 1, policy_version 1872984 (0.0009) [2023-12-26 14:38:50,719][123091] Updated weights for policy 0, policy_version 1884692 (0.0009) [2023-12-26 14:38:50,789][123091] Updated weights for policy 0, policy_version 1884702 (0.0009) [2023-12-26 14:38:50,842][123091] Updated weights for policy 0, policy_version 1884712 (0.0010) [2023-12-26 14:38:51,351][123090] Updated weights for policy 1, policy_version 1872994 (0.0009) [2023-12-26 14:38:51,425][123090] Updated weights for policy 1, policy_version 1873004 (0.0009) [2023-12-26 14:38:51,494][123090] Updated weights for policy 1, policy_version 1873014 (0.0009) [2023-12-26 14:38:51,560][123090] Updated weights for policy 1, policy_version 1873024 (0.0009) [2023-12-26 14:38:51,641][123091] Updated weights for policy 0, policy_version 1884722 (0.0009) [2023-12-26 14:38:51,712][123091] Updated weights for policy 0, policy_version 1884732 (0.0008) [2023-12-26 14:38:51,775][123091] Updated weights for policy 0, policy_version 1884742 (0.0010) [2023-12-26 14:38:51,832][123091] Updated weights for policy 0, policy_version 1884752 (0.0008) [2023-12-26 14:38:52,349][123090] Updated weights for policy 1, policy_version 1873034 (0.0011) [2023-12-26 14:38:52,418][123090] Updated weights for policy 1, policy_version 1873044 (0.0009) [2023-12-26 14:38:52,485][123090] Updated weights for policy 1, policy_version 1873054 (0.0006) [2023-12-26 14:38:52,665][123091] Updated weights for policy 0, policy_version 1884762 (0.0009) [2023-12-26 14:38:52,732][123091] Updated weights for policy 0, policy_version 1884772 (0.0010) [2023-12-26 14:38:52,795][123091] Updated weights for policy 0, policy_version 1884782 (0.0009) [2023-12-26 14:38:53,229][123090] Updated weights for policy 1, policy_version 1873064 (0.0009) [2023-12-26 14:38:53,282][123090] Updated weights for policy 1, policy_version 1873074 (0.0009) [2023-12-26 14:38:53,338][123090] Updated weights for policy 1, policy_version 1873084 (0.0009) [2023-12-26 14:38:53,602][123091] Updated weights for policy 0, policy_version 1884792 (0.0007) [2023-12-26 14:38:53,661][123091] Updated weights for policy 0, policy_version 1884802 (0.0007) [2023-12-26 14:38:53,714][123091] Updated weights for policy 0, policy_version 1884812 (0.0008) [2023-12-26 14:38:53,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 962027520. Throughput: 0: 8933.2, 1: 8693.0. Samples: 962000180. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:38:53,785][121949] Avg episode reward: [(0, '6234.649'), (1, '5833.916')] [2023-12-26 14:38:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001873088_479510528.pth... [2023-12-26 14:38:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001884816_482516992.pth... [2023-12-26 14:38:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001872064_479248384.pth [2023-12-26 14:38:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001883760_482246656.pth [2023-12-26 14:38:54,224][123090] Updated weights for policy 1, policy_version 1873094 (0.0009) [2023-12-26 14:38:54,288][123090] Updated weights for policy 1, policy_version 1873104 (0.0009) [2023-12-26 14:38:54,351][123090] Updated weights for policy 1, policy_version 1873114 (0.0009) [2023-12-26 14:38:54,455][123091] Updated weights for policy 0, policy_version 1884822 (0.0010) [2023-12-26 14:38:54,507][123091] Updated weights for policy 0, policy_version 1884832 (0.0010) [2023-12-26 14:38:54,559][123091] Updated weights for policy 0, policy_version 1884842 (0.0010) [2023-12-26 14:38:55,171][123090] Updated weights for policy 1, policy_version 1873124 (0.0009) [2023-12-26 14:38:55,228][123090] Updated weights for policy 1, policy_version 1873134 (0.0009) [2023-12-26 14:38:55,294][123090] Updated weights for policy 1, policy_version 1873144 (0.0009) [2023-12-26 14:38:55,417][123091] Updated weights for policy 0, policy_version 1884852 (0.0011) [2023-12-26 14:38:55,485][123091] Updated weights for policy 0, policy_version 1884862 (0.0011) [2023-12-26 14:38:55,537][123091] Updated weights for policy 0, policy_version 1884872 (0.0010) [2023-12-26 14:38:56,130][123090] Updated weights for policy 1, policy_version 1873154 (0.0009) [2023-12-26 14:38:56,182][123090] Updated weights for policy 1, policy_version 1873164 (0.0009) [2023-12-26 14:38:56,238][123090] Updated weights for policy 1, policy_version 1873174 (0.0009) [2023-12-26 14:38:56,286][123090] Updated weights for policy 1, policy_version 1873184 (0.0009) [2023-12-26 14:38:56,355][123091] Updated weights for policy 0, policy_version 1884882 (0.0010) [2023-12-26 14:38:56,412][123091] Updated weights for policy 0, policy_version 1884892 (0.0010) [2023-12-26 14:38:56,463][123091] Updated weights for policy 0, policy_version 1884902 (0.0010) [2023-12-26 14:38:56,511][123091] Updated weights for policy 0, policy_version 1884912 (0.0010) [2023-12-26 14:38:57,139][123090] Updated weights for policy 1, policy_version 1873194 (0.0009) [2023-12-26 14:38:57,187][123090] Updated weights for policy 1, policy_version 1873204 (0.0009) [2023-12-26 14:38:57,239][123090] Updated weights for policy 1, policy_version 1873215 (0.0009) [2023-12-26 14:38:57,348][123091] Updated weights for policy 0, policy_version 1884922 (0.0011) [2023-12-26 14:38:57,395][123091] Updated weights for policy 0, policy_version 1884932 (0.0010) [2023-12-26 14:38:57,442][123091] Updated weights for policy 0, policy_version 1884942 (0.0010) [2023-12-26 14:38:58,088][123090] Updated weights for policy 1, policy_version 1873225 (0.0009) [2023-12-26 14:38:58,148][123090] Updated weights for policy 1, policy_version 1873235 (0.0009) [2023-12-26 14:38:58,212][123090] Updated weights for policy 1, policy_version 1873245 (0.0009) [2023-12-26 14:38:58,291][123091] Updated weights for policy 0, policy_version 1884952 (0.0010) [2023-12-26 14:38:58,364][123091] Updated weights for policy 0, policy_version 1884962 (0.0010) [2023-12-26 14:38:58,429][123091] Updated weights for policy 0, policy_version 1884972 (0.0013) [2023-12-26 14:38:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 962109440. Throughput: 0: 8867.0, 1: 8720.4. Samples: 962103652. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:38:58,785][121949] Avg episode reward: [(0, '6310.501'), (1, '5951.869')] [2023-12-26 14:38:59,015][123090] Updated weights for policy 1, policy_version 1873255 (0.0008) [2023-12-26 14:38:59,078][123090] Updated weights for policy 1, policy_version 1873265 (0.0008) [2023-12-26 14:38:59,128][123090] Updated weights for policy 1, policy_version 1873275 (0.0010) [2023-12-26 14:38:59,209][123091] Updated weights for policy 0, policy_version 1884982 (0.0007) [2023-12-26 14:38:59,269][123091] Updated weights for policy 0, policy_version 1884992 (0.0010) [2023-12-26 14:38:59,331][123091] Updated weights for policy 0, policy_version 1885002 (0.0009) [2023-12-26 14:38:59,870][123090] Updated weights for policy 1, policy_version 1873285 (0.0011) [2023-12-26 14:38:59,941][123090] Updated weights for policy 1, policy_version 1873295 (0.0007) [2023-12-26 14:39:00,008][123090] Updated weights for policy 1, policy_version 1873305 (0.0011) [2023-12-26 14:39:00,224][123091] Updated weights for policy 0, policy_version 1885012 (0.0008) [2023-12-26 14:39:00,293][123091] Updated weights for policy 0, policy_version 1885022 (0.0006) [2023-12-26 14:39:00,365][123091] Updated weights for policy 0, policy_version 1885032 (0.0005) [2023-12-26 14:39:00,747][123090] Updated weights for policy 1, policy_version 1873315 (0.0009) [2023-12-26 14:39:00,810][123090] Updated weights for policy 1, policy_version 1873325 (0.0009) [2023-12-26 14:39:00,857][123090] Updated weights for policy 1, policy_version 1873335 (0.0010) [2023-12-26 14:39:01,074][123091] Updated weights for policy 0, policy_version 1885042 (0.0006) [2023-12-26 14:39:01,137][123091] Updated weights for policy 0, policy_version 1885052 (0.0011) [2023-12-26 14:39:01,194][123091] Updated weights for policy 0, policy_version 1885062 (0.0010) [2023-12-26 14:39:01,245][123091] Updated weights for policy 0, policy_version 1885072 (0.0010) [2023-12-26 14:39:01,698][123090] Updated weights for policy 1, policy_version 1873345 (0.0010) [2023-12-26 14:39:01,765][123090] Updated weights for policy 1, policy_version 1873355 (0.0011) [2023-12-26 14:39:01,831][123090] Updated weights for policy 1, policy_version 1873365 (0.0011) [2023-12-26 14:39:01,898][123090] Updated weights for policy 1, policy_version 1873375 (0.0010) [2023-12-26 14:39:01,977][123091] Updated weights for policy 0, policy_version 1885082 (0.0006) [2023-12-26 14:39:02,032][123091] Updated weights for policy 0, policy_version 1885092 (0.0007) [2023-12-26 14:39:02,097][123091] Updated weights for policy 0, policy_version 1885102 (0.0007) [2023-12-26 14:39:02,708][123090] Updated weights for policy 1, policy_version 1873385 (0.0009) [2023-12-26 14:39:02,769][123090] Updated weights for policy 1, policy_version 1873395 (0.0009) [2023-12-26 14:39:02,822][123091] Updated weights for policy 0, policy_version 1885112 (0.0008) [2023-12-26 14:39:02,834][123090] Updated weights for policy 1, policy_version 1873405 (0.0008) [2023-12-26 14:39:02,892][123091] Updated weights for policy 0, policy_version 1885122 (0.0008) [2023-12-26 14:39:02,959][123091] Updated weights for policy 0, policy_version 1885132 (0.0011) [2023-12-26 14:39:03,677][123090] Updated weights for policy 1, policy_version 1873415 (0.0007) [2023-12-26 14:39:03,726][123090] Updated weights for policy 1, policy_version 1873425 (0.0005) [2023-12-26 14:39:03,730][123091] Updated weights for policy 0, policy_version 1885142 (0.0010) [2023-12-26 14:39:03,774][123090] Updated weights for policy 1, policy_version 1873435 (0.0005) [2023-12-26 14:39:03,779][123091] Updated weights for policy 0, policy_version 1885152 (0.0008) [2023-12-26 14:39:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 962191360. Throughput: 0: 8918.8, 1: 8655.0. Samples: 962210436. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:03,785][121949] Avg episode reward: [(0, '6322.743'), (1, '5747.025')] [2023-12-26 14:39:03,831][123091] Updated weights for policy 0, policy_version 1885162 (0.0009) [2023-12-26 14:39:04,589][123090] Updated weights for policy 1, policy_version 1873445 (0.0008) [2023-12-26 14:39:04,647][123090] Updated weights for policy 1, policy_version 1873455 (0.0009) [2023-12-26 14:39:04,713][123090] Updated weights for policy 1, policy_version 1873465 (0.0006) [2023-12-26 14:39:04,722][123091] Updated weights for policy 0, policy_version 1885172 (0.0009) [2023-12-26 14:39:04,778][123091] Updated weights for policy 0, policy_version 1885182 (0.0009) [2023-12-26 14:39:04,838][123091] Updated weights for policy 0, policy_version 1885192 (0.0009) [2023-12-26 14:39:05,561][123090] Updated weights for policy 1, policy_version 1873475 (0.0007) [2023-12-26 14:39:05,609][123091] Updated weights for policy 0, policy_version 1885202 (0.0010) [2023-12-26 14:39:05,616][123090] Updated weights for policy 1, policy_version 1873485 (0.0009) [2023-12-26 14:39:05,661][123091] Updated weights for policy 0, policy_version 1885212 (0.0008) [2023-12-26 14:39:05,668][123090] Updated weights for policy 1, policy_version 1873495 (0.0008) [2023-12-26 14:39:05,718][123091] Updated weights for policy 0, policy_version 1885222 (0.0009) [2023-12-26 14:39:05,775][123091] Updated weights for policy 0, policy_version 1885232 (0.0009) [2023-12-26 14:39:06,520][123090] Updated weights for policy 1, policy_version 1873505 (0.0009) [2023-12-26 14:39:06,594][123090] Updated weights for policy 1, policy_version 1873515 (0.0008) [2023-12-26 14:39:06,647][123091] Updated weights for policy 0, policy_version 1885242 (0.0007) [2023-12-26 14:39:06,663][123090] Updated weights for policy 1, policy_version 1873525 (0.0010) [2023-12-26 14:39:06,705][123091] Updated weights for policy 0, policy_version 1885252 (0.0006) [2023-12-26 14:39:06,731][123090] Updated weights for policy 1, policy_version 1873535 (0.0009) [2023-12-26 14:39:06,764][123091] Updated weights for policy 0, policy_version 1885262 (0.0005) [2023-12-26 14:39:07,467][123091] Updated weights for policy 0, policy_version 1885273 (0.0007) [2023-12-26 14:39:07,516][123091] Updated weights for policy 0, policy_version 1885283 (0.0007) [2023-12-26 14:39:07,553][123090] Updated weights for policy 1, policy_version 1873545 (0.0005) [2023-12-26 14:39:07,566][123091] Updated weights for policy 0, policy_version 1885293 (0.0009) [2023-12-26 14:39:07,611][123090] Updated weights for policy 1, policy_version 1873555 (0.0005) [2023-12-26 14:39:07,657][123090] Updated weights for policy 1, policy_version 1873565 (0.0005) [2023-12-26 14:39:08,252][123090] Updated weights for policy 1, policy_version 1873575 (0.0006) [2023-12-26 14:39:08,315][123090] Updated weights for policy 1, policy_version 1873585 (0.0008) [2023-12-26 14:39:08,337][123091] Updated weights for policy 0, policy_version 1885303 (0.0008) [2023-12-26 14:39:08,378][123090] Updated weights for policy 1, policy_version 1873595 (0.0007) [2023-12-26 14:39:08,401][123091] Updated weights for policy 0, policy_version 1885313 (0.0008) [2023-12-26 14:39:08,462][123091] Updated weights for policy 0, policy_version 1885323 (0.0005) [2023-12-26 14:39:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 962289664. Throughput: 0: 8911.4, 1: 8669.0. Samples: 962262164. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:08,785][121949] Avg episode reward: [(0, '6273.377'), (1, '5584.975')] [2023-12-26 14:39:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001885328_482648064.pth... [2023-12-26 14:39:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001873600_479641600.pth... [2023-12-26 14:39:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001884304_482385920.pth [2023-12-26 14:39:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001872608_479387648.pth [2023-12-26 14:39:09,130][123091] Updated weights for policy 0, policy_version 1885333 (0.0005) [2023-12-26 14:39:09,197][123091] Updated weights for policy 0, policy_version 1885343 (0.0005) [2023-12-26 14:39:09,260][123090] Updated weights for policy 1, policy_version 1873605 (0.0009) [2023-12-26 14:39:09,267][123091] Updated weights for policy 0, policy_version 1885353 (0.0008) [2023-12-26 14:39:09,329][123090] Updated weights for policy 1, policy_version 1873615 (0.0009) [2023-12-26 14:39:09,395][123090] Updated weights for policy 1, policy_version 1873625 (0.0009) [2023-12-26 14:39:09,961][123091] Updated weights for policy 0, policy_version 1885363 (0.0007) [2023-12-26 14:39:10,026][123091] Updated weights for policy 0, policy_version 1885373 (0.0010) [2023-12-26 14:39:10,091][123091] Updated weights for policy 0, policy_version 1885383 (0.0009) [2023-12-26 14:39:10,217][123090] Updated weights for policy 1, policy_version 1873635 (0.0008) [2023-12-26 14:39:10,292][123090] Updated weights for policy 1, policy_version 1873645 (0.0010) [2023-12-26 14:39:10,367][123090] Updated weights for policy 1, policy_version 1873655 (0.0009) [2023-12-26 14:39:10,891][123091] Updated weights for policy 0, policy_version 1885393 (0.0010) [2023-12-26 14:39:10,938][123091] Updated weights for policy 0, policy_version 1885403 (0.0006) [2023-12-26 14:39:10,996][123091] Updated weights for policy 0, policy_version 1885413 (0.0006) [2023-12-26 14:39:11,072][123091] Updated weights for policy 0, policy_version 1885423 (0.0009) [2023-12-26 14:39:11,165][123090] Updated weights for policy 1, policy_version 1873665 (0.0009) [2023-12-26 14:39:11,237][123090] Updated weights for policy 1, policy_version 1873675 (0.0009) [2023-12-26 14:39:11,311][123090] Updated weights for policy 1, policy_version 1873685 (0.0010) [2023-12-26 14:39:11,389][123090] Updated weights for policy 1, policy_version 1873695 (0.0009) [2023-12-26 14:39:11,871][123091] Updated weights for policy 0, policy_version 1885433 (0.0010) [2023-12-26 14:39:11,929][123091] Updated weights for policy 0, policy_version 1885443 (0.0010) [2023-12-26 14:39:11,998][123091] Updated weights for policy 0, policy_version 1885453 (0.0009) [2023-12-26 14:39:12,206][123090] Updated weights for policy 1, policy_version 1873705 (0.0007) [2023-12-26 14:39:12,273][123090] Updated weights for policy 1, policy_version 1873715 (0.0009) [2023-12-26 14:39:12,343][123090] Updated weights for policy 1, policy_version 1873726 (0.0010) [2023-12-26 14:39:12,833][123091] Updated weights for policy 0, policy_version 1885463 (0.0010) [2023-12-26 14:39:12,909][123091] Updated weights for policy 0, policy_version 1885473 (0.0010) [2023-12-26 14:39:12,981][123091] Updated weights for policy 0, policy_version 1885483 (0.0010) [2023-12-26 14:39:13,133][123090] Updated weights for policy 1, policy_version 1873736 (0.0006) [2023-12-26 14:39:13,189][123090] Updated weights for policy 1, policy_version 1873746 (0.0005) [2023-12-26 14:39:13,249][123090] Updated weights for policy 1, policy_version 1873756 (0.0005) [2023-12-26 14:39:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 962371584. Throughput: 0: 8923.4, 1: 8563.8. Samples: 962369312. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:13,784][121949] Avg episode reward: [(0, '6312.084'), (1, '5737.268')] [2023-12-26 14:39:13,806][123091] Updated weights for policy 0, policy_version 1885493 (0.0007) [2023-12-26 14:39:13,850][123091] Updated weights for policy 0, policy_version 1885503 (0.0005) [2023-12-26 14:39:13,898][123091] Updated weights for policy 0, policy_version 1885513 (0.0006) [2023-12-26 14:39:14,016][123090] Updated weights for policy 1, policy_version 1873766 (0.0007) [2023-12-26 14:39:14,075][123090] Updated weights for policy 1, policy_version 1873776 (0.0009) [2023-12-26 14:39:14,139][123090] Updated weights for policy 1, policy_version 1873786 (0.0010) [2023-12-26 14:39:14,677][123091] Updated weights for policy 0, policy_version 1885523 (0.0008) [2023-12-26 14:39:14,726][123091] Updated weights for policy 0, policy_version 1885533 (0.0008) [2023-12-26 14:39:14,784][123091] Updated weights for policy 0, policy_version 1885543 (0.0007) [2023-12-26 14:39:15,016][123090] Updated weights for policy 1, policy_version 1873796 (0.0009) [2023-12-26 14:39:15,087][123090] Updated weights for policy 1, policy_version 1873806 (0.0008) [2023-12-26 14:39:15,160][123090] Updated weights for policy 1, policy_version 1873816 (0.0010) [2023-12-26 14:39:15,541][123091] Updated weights for policy 0, policy_version 1885553 (0.0006) [2023-12-26 14:39:15,612][123091] Updated weights for policy 0, policy_version 1885563 (0.0008) [2023-12-26 14:39:15,673][123091] Updated weights for policy 0, policy_version 1885573 (0.0005) [2023-12-26 14:39:15,734][123091] Updated weights for policy 0, policy_version 1885583 (0.0010) [2023-12-26 14:39:16,016][123090] Updated weights for policy 1, policy_version 1873826 (0.0009) [2023-12-26 14:39:16,065][123090] Updated weights for policy 1, policy_version 1873836 (0.0009) [2023-12-26 14:39:16,120][123090] Updated weights for policy 1, policy_version 1873846 (0.0009) [2023-12-26 14:39:16,173][123090] Updated weights for policy 1, policy_version 1873856 (0.0010) [2023-12-26 14:39:16,476][123091] Updated weights for policy 0, policy_version 1885593 (0.0009) [2023-12-26 14:39:16,541][123091] Updated weights for policy 0, policy_version 1885603 (0.0009) [2023-12-26 14:39:16,601][123091] Updated weights for policy 0, policy_version 1885613 (0.0009) [2023-12-26 14:39:17,033][123090] Updated weights for policy 1, policy_version 1873866 (0.0010) [2023-12-26 14:39:17,106][123090] Updated weights for policy 1, policy_version 1873876 (0.0008) [2023-12-26 14:39:17,166][123090] Updated weights for policy 1, policy_version 1873886 (0.0010) [2023-12-26 14:39:17,331][123091] Updated weights for policy 0, policy_version 1885623 (0.0010) [2023-12-26 14:39:17,390][123091] Updated weights for policy 0, policy_version 1885633 (0.0009) [2023-12-26 14:39:17,441][123091] Updated weights for policy 0, policy_version 1885643 (0.0009) [2023-12-26 14:39:17,896][123090] Updated weights for policy 1, policy_version 1873896 (0.0006) [2023-12-26 14:39:17,945][123090] Updated weights for policy 1, policy_version 1873906 (0.0005) [2023-12-26 14:39:18,010][123090] Updated weights for policy 1, policy_version 1873916 (0.0007) [2023-12-26 14:39:18,281][123091] Updated weights for policy 0, policy_version 1885653 (0.0009) [2023-12-26 14:39:18,343][123091] Updated weights for policy 0, policy_version 1885663 (0.0008) [2023-12-26 14:39:18,408][123091] Updated weights for policy 0, policy_version 1885673 (0.0008) [2023-12-26 14:39:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 962461696. Throughput: 0: 8952.3, 1: 8522.0. Samples: 962475624. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:18,785][121949] Avg episode reward: [(0, '6447.791'), (1, '5869.710')] [2023-12-26 14:39:18,831][123090] Updated weights for policy 1, policy_version 1873926 (0.0006) [2023-12-26 14:39:18,902][123090] Updated weights for policy 1, policy_version 1873936 (0.0008) [2023-12-26 14:39:18,958][123090] Updated weights for policy 1, policy_version 1873946 (0.0010) [2023-12-26 14:39:19,189][123091] Updated weights for policy 0, policy_version 1885683 (0.0009) [2023-12-26 14:39:19,259][123091] Updated weights for policy 0, policy_version 1885693 (0.0010) [2023-12-26 14:39:19,310][123091] Updated weights for policy 0, policy_version 1885703 (0.0009) [2023-12-26 14:39:19,737][123090] Updated weights for policy 1, policy_version 1873956 (0.0010) [2023-12-26 14:39:19,797][123090] Updated weights for policy 1, policy_version 1873966 (0.0009) [2023-12-26 14:39:19,866][123090] Updated weights for policy 1, policy_version 1873976 (0.0007) [2023-12-26 14:39:20,116][123091] Updated weights for policy 0, policy_version 1885713 (0.0009) [2023-12-26 14:39:20,174][123091] Updated weights for policy 0, policy_version 1885723 (0.0006) [2023-12-26 14:39:20,228][123091] Updated weights for policy 0, policy_version 1885733 (0.0006) [2023-12-26 14:39:20,299][123091] Updated weights for policy 0, policy_version 1885743 (0.0009) [2023-12-26 14:39:20,739][123090] Updated weights for policy 1, policy_version 1873986 (0.0010) [2023-12-26 14:39:20,810][123090] Updated weights for policy 1, policy_version 1873996 (0.0009) [2023-12-26 14:39:20,876][123090] Updated weights for policy 1, policy_version 1874006 (0.0010) [2023-12-26 14:39:20,928][123090] Updated weights for policy 1, policy_version 1874016 (0.0007) [2023-12-26 14:39:21,078][123091] Updated weights for policy 0, policy_version 1885753 (0.0009) [2023-12-26 14:39:21,137][123091] Updated weights for policy 0, policy_version 1885763 (0.0010) [2023-12-26 14:39:21,197][123091] Updated weights for policy 0, policy_version 1885773 (0.0010) [2023-12-26 14:39:21,830][123090] Updated weights for policy 1, policy_version 1874026 (0.0008) [2023-12-26 14:39:21,889][123090] Updated weights for policy 1, policy_version 1874036 (0.0008) [2023-12-26 14:39:21,959][123090] Updated weights for policy 1, policy_version 1874046 (0.0007) [2023-12-26 14:39:22,050][123091] Updated weights for policy 0, policy_version 1885783 (0.0010) [2023-12-26 14:39:22,113][123091] Updated weights for policy 0, policy_version 1885793 (0.0010) [2023-12-26 14:39:22,174][123091] Updated weights for policy 0, policy_version 1885803 (0.0009) [2023-12-26 14:39:22,704][123090] Updated weights for policy 1, policy_version 1874056 (0.0009) [2023-12-26 14:39:22,775][123090] Updated weights for policy 1, policy_version 1874066 (0.0011) [2023-12-26 14:39:22,843][123090] Updated weights for policy 1, policy_version 1874076 (0.0011) [2023-12-26 14:39:23,048][123091] Updated weights for policy 0, policy_version 1885813 (0.0009) [2023-12-26 14:39:23,095][123091] Updated weights for policy 0, policy_version 1885823 (0.0008) [2023-12-26 14:39:23,145][123091] Updated weights for policy 0, policy_version 1885833 (0.0009) [2023-12-26 14:39:23,677][123090] Updated weights for policy 1, policy_version 1874086 (0.0010) [2023-12-26 14:39:23,733][123090] Updated weights for policy 1, policy_version 1874096 (0.0010) [2023-12-26 14:39:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 962543616. Throughput: 0: 8902.2, 1: 8524.3. Samples: 962526112. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:23,784][123090] Updated weights for policy 1, policy_version 1874106 (0.0010) [2023-12-26 14:39:23,785][121949] Avg episode reward: [(0, '6446.887'), (1, '5857.004')] [2023-12-26 14:39:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001885840_482779136.pth... [2023-12-26 14:39:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001884816_482516992.pth [2023-12-26 14:39:23,816][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001874112_479772672.pth... [2023-12-26 14:39:23,819][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001873088_479510528.pth [2023-12-26 14:39:24,004][123091] Updated weights for policy 0, policy_version 1885843 (0.0009) [2023-12-26 14:39:24,060][123091] Updated weights for policy 0, policy_version 1885853 (0.0009) [2023-12-26 14:39:24,107][123091] Updated weights for policy 0, policy_version 1885863 (0.0008) [2023-12-26 14:39:24,629][123090] Updated weights for policy 1, policy_version 1874116 (0.0010) [2023-12-26 14:39:24,673][123090] Updated weights for policy 1, policy_version 1874126 (0.0010) [2023-12-26 14:39:24,724][123090] Updated weights for policy 1, policy_version 1874136 (0.0010) [2023-12-26 14:39:24,961][123091] Updated weights for policy 0, policy_version 1885873 (0.0009) [2023-12-26 14:39:25,022][123091] Updated weights for policy 0, policy_version 1885883 (0.0009) [2023-12-26 14:39:25,077][123091] Updated weights for policy 0, policy_version 1885893 (0.0008) [2023-12-26 14:39:25,132][123091] Updated weights for policy 0, policy_version 1885903 (0.0009) [2023-12-26 14:39:25,560][123090] Updated weights for policy 1, policy_version 1874146 (0.0010) [2023-12-26 14:39:25,622][123090] Updated weights for policy 1, policy_version 1874156 (0.0010) [2023-12-26 14:39:25,677][123090] Updated weights for policy 1, policy_version 1874166 (0.0010) [2023-12-26 14:39:25,733][123090] Updated weights for policy 1, policy_version 1874176 (0.0010) [2023-12-26 14:39:25,979][123091] Updated weights for policy 0, policy_version 1885913 (0.0009) [2023-12-26 14:39:26,038][123091] Updated weights for policy 0, policy_version 1885923 (0.0009) [2023-12-26 14:39:26,102][123091] Updated weights for policy 0, policy_version 1885933 (0.0009) [2023-12-26 14:39:26,570][123090] Updated weights for policy 1, policy_version 1874186 (0.0010) [2023-12-26 14:39:26,633][123090] Updated weights for policy 1, policy_version 1874196 (0.0010) [2023-12-26 14:39:26,688][123090] Updated weights for policy 1, policy_version 1874206 (0.0010) [2023-12-26 14:39:26,927][123091] Updated weights for policy 0, policy_version 1885943 (0.0009) [2023-12-26 14:39:26,987][123091] Updated weights for policy 0, policy_version 1885953 (0.0009) [2023-12-26 14:39:27,049][123091] Updated weights for policy 0, policy_version 1885963 (0.0009) [2023-12-26 14:39:27,507][123090] Updated weights for policy 1, policy_version 1874216 (0.0006) [2023-12-26 14:39:27,561][123090] Updated weights for policy 1, policy_version 1874226 (0.0005) [2023-12-26 14:39:27,611][123090] Updated weights for policy 1, policy_version 1874236 (0.0005) [2023-12-26 14:39:27,950][123091] Updated weights for policy 0, policy_version 1885973 (0.0010) [2023-12-26 14:39:28,010][123091] Updated weights for policy 0, policy_version 1885984 (0.0009) [2023-12-26 14:39:28,074][123091] Updated weights for policy 0, policy_version 1885994 (0.0009) [2023-12-26 14:39:28,214][123090] Updated weights for policy 1, policy_version 1874246 (0.0005) [2023-12-26 14:39:28,279][123090] Updated weights for policy 1, policy_version 1874256 (0.0006) [2023-12-26 14:39:28,341][123090] Updated weights for policy 1, policy_version 1874266 (0.0005) [2023-12-26 14:39:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 962633728. Throughput: 0: 8861.2, 1: 8576.9. Samples: 962628616. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:28,785][121949] Avg episode reward: [(0, '6339.452'), (1, '5828.614')] [2023-12-26 14:39:28,950][123091] Updated weights for policy 0, policy_version 1886004 (0.0010) [2023-12-26 14:39:28,992][123090] Updated weights for policy 1, policy_version 1874276 (0.0006) [2023-12-26 14:39:29,016][123091] Updated weights for policy 0, policy_version 1886014 (0.0010) [2023-12-26 14:39:29,052][123090] Updated weights for policy 1, policy_version 1874286 (0.0005) [2023-12-26 14:39:29,075][123091] Updated weights for policy 0, policy_version 1886024 (0.0005) [2023-12-26 14:39:29,114][123090] Updated weights for policy 1, policy_version 1874296 (0.0005) [2023-12-26 14:39:29,794][123090] Updated weights for policy 1, policy_version 1874306 (0.0005) [2023-12-26 14:39:29,852][123091] Updated weights for policy 0, policy_version 1886034 (0.0007) [2023-12-26 14:39:29,859][123090] Updated weights for policy 1, policy_version 1874316 (0.0007) [2023-12-26 14:39:29,904][123091] Updated weights for policy 0, policy_version 1886044 (0.0011) [2023-12-26 14:39:29,917][123090] Updated weights for policy 1, policy_version 1874326 (0.0008) [2023-12-26 14:39:29,968][123091] Updated weights for policy 0, policy_version 1886054 (0.0010) [2023-12-26 14:39:29,981][123090] Updated weights for policy 1, policy_version 1874336 (0.0009) [2023-12-26 14:39:30,024][123091] Updated weights for policy 0, policy_version 1886064 (0.0010) [2023-12-26 14:39:30,773][123090] Updated weights for policy 1, policy_version 1874346 (0.0008) [2023-12-26 14:39:30,786][123091] Updated weights for policy 0, policy_version 1886074 (0.0010) [2023-12-26 14:39:30,823][123090] Updated weights for policy 1, policy_version 1874356 (0.0005) [2023-12-26 14:39:30,846][123091] Updated weights for policy 0, policy_version 1886084 (0.0009) [2023-12-26 14:39:30,872][123090] Updated weights for policy 1, policy_version 1874366 (0.0007) [2023-12-26 14:39:30,896][123091] Updated weights for policy 0, policy_version 1886094 (0.0005) [2023-12-26 14:39:31,592][123090] Updated weights for policy 1, policy_version 1874376 (0.0005) [2023-12-26 14:39:31,653][123091] Updated weights for policy 0, policy_version 1886104 (0.0009) [2023-12-26 14:39:31,664][123090] Updated weights for policy 1, policy_version 1874386 (0.0008) [2023-12-26 14:39:31,721][123091] Updated weights for policy 0, policy_version 1886114 (0.0011) [2023-12-26 14:39:31,725][123090] Updated weights for policy 1, policy_version 1874396 (0.0008) [2023-12-26 14:39:31,784][123091] Updated weights for policy 0, policy_version 1886124 (0.0010) [2023-12-26 14:39:32,526][123090] Updated weights for policy 1, policy_version 1874406 (0.0010) [2023-12-26 14:39:32,582][123091] Updated weights for policy 0, policy_version 1886134 (0.0009) [2023-12-26 14:39:32,589][123090] Updated weights for policy 1, policy_version 1874416 (0.0010) [2023-12-26 14:39:32,640][123091] Updated weights for policy 0, policy_version 1886144 (0.0010) [2023-12-26 14:39:32,647][123090] Updated weights for policy 1, policy_version 1874426 (0.0010) [2023-12-26 14:39:32,692][123091] Updated weights for policy 0, policy_version 1886154 (0.0010) [2023-12-26 14:39:33,434][123090] Updated weights for policy 1, policy_version 1874436 (0.0010) [2023-12-26 14:39:33,483][123090] Updated weights for policy 1, policy_version 1874446 (0.0008) [2023-12-26 14:39:33,488][123091] Updated weights for policy 0, policy_version 1886164 (0.0009) [2023-12-26 14:39:33,537][123090] Updated weights for policy 1, policy_version 1874456 (0.0009) [2023-12-26 14:39:33,544][123091] Updated weights for policy 0, policy_version 1886174 (0.0007) [2023-12-26 14:39:33,597][123091] Updated weights for policy 0, policy_version 1886184 (0.0008) [2023-12-26 14:39:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 962732032. Throughput: 0: 8793.7, 1: 8734.8. Samples: 962738584. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:33,784][121949] Avg episode reward: [(0, '6306.371'), (1, '5795.819')] [2023-12-26 14:39:34,337][123090] Updated weights for policy 1, policy_version 1874466 (0.0007) [2023-12-26 14:39:34,365][123091] Updated weights for policy 0, policy_version 1886194 (0.0010) [2023-12-26 14:39:34,385][123090] Updated weights for policy 1, policy_version 1874476 (0.0008) [2023-12-26 14:39:34,418][123091] Updated weights for policy 0, policy_version 1886204 (0.0008) [2023-12-26 14:39:34,433][123090] Updated weights for policy 1, policy_version 1874486 (0.0008) [2023-12-26 14:39:34,476][123091] Updated weights for policy 0, policy_version 1886214 (0.0008) [2023-12-26 14:39:34,482][123090] Updated weights for policy 1, policy_version 1874496 (0.0008) [2023-12-26 14:39:34,524][123091] Updated weights for policy 0, policy_version 1886224 (0.0007) [2023-12-26 14:39:35,249][123090] Updated weights for policy 1, policy_version 1874506 (0.0005) [2023-12-26 14:39:35,308][123090] Updated weights for policy 1, policy_version 1874516 (0.0005) [2023-12-26 14:39:35,337][123091] Updated weights for policy 0, policy_version 1886234 (0.0008) [2023-12-26 14:39:35,363][123090] Updated weights for policy 1, policy_version 1874526 (0.0005) [2023-12-26 14:39:35,401][123091] Updated weights for policy 0, policy_version 1886244 (0.0008) [2023-12-26 14:39:35,474][123091] Updated weights for policy 0, policy_version 1886254 (0.0007) [2023-12-26 14:39:36,091][123090] Updated weights for policy 1, policy_version 1874536 (0.0006) [2023-12-26 14:39:36,142][123091] Updated weights for policy 0, policy_version 1886264 (0.0007) [2023-12-26 14:39:36,167][123090] Updated weights for policy 1, policy_version 1874546 (0.0008) [2023-12-26 14:39:36,198][123091] Updated weights for policy 0, policy_version 1886274 (0.0007) [2023-12-26 14:39:36,225][123090] Updated weights for policy 1, policy_version 1874556 (0.0009) [2023-12-26 14:39:36,267][123091] Updated weights for policy 0, policy_version 1886284 (0.0006) [2023-12-26 14:39:37,067][123090] Updated weights for policy 1, policy_version 1874566 (0.0010) [2023-12-26 14:39:37,076][123091] Updated weights for policy 0, policy_version 1886294 (0.0006) [2023-12-26 14:39:37,116][123090] Updated weights for policy 1, policy_version 1874576 (0.0010) [2023-12-26 14:39:37,125][123091] Updated weights for policy 0, policy_version 1886304 (0.0010) [2023-12-26 14:39:37,165][123090] Updated weights for policy 1, policy_version 1874586 (0.0010) [2023-12-26 14:39:37,181][123091] Updated weights for policy 0, policy_version 1886314 (0.0006) [2023-12-26 14:39:37,998][123091] Updated weights for policy 0, policy_version 1886324 (0.0008) [2023-12-26 14:39:38,024][123090] Updated weights for policy 1, policy_version 1874596 (0.0010) [2023-12-26 14:39:38,048][123091] Updated weights for policy 0, policy_version 1886334 (0.0006) [2023-12-26 14:39:38,071][123090] Updated weights for policy 1, policy_version 1874606 (0.0010) [2023-12-26 14:39:38,108][123091] Updated weights for policy 0, policy_version 1886344 (0.0006) [2023-12-26 14:39:38,131][123090] Updated weights for policy 1, policy_version 1874616 (0.0011) [2023-12-26 14:39:38,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 962813952. Throughput: 0: 8841.1, 1: 8809.5. Samples: 962794456. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:38,785][121949] Avg episode reward: [(0, '6322.967'), (1, '5763.106')] [2023-12-26 14:39:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001886352_482910208.pth... [2023-12-26 14:39:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001874624_479903744.pth... [2023-12-26 14:39:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001885328_482648064.pth [2023-12-26 14:39:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001873600_479641600.pth [2023-12-26 14:39:38,928][123091] Updated weights for policy 0, policy_version 1886354 (0.0007) [2023-12-26 14:39:38,977][123090] Updated weights for policy 1, policy_version 1874626 (0.0011) [2023-12-26 14:39:38,991][123091] Updated weights for policy 0, policy_version 1886364 (0.0009) [2023-12-26 14:39:39,042][123090] Updated weights for policy 1, policy_version 1874636 (0.0009) [2023-12-26 14:39:39,046][123091] Updated weights for policy 0, policy_version 1886374 (0.0009) [2023-12-26 14:39:39,108][123090] Updated weights for policy 1, policy_version 1874646 (0.0005) [2023-12-26 14:39:39,179][123090] Updated weights for policy 1, policy_version 1874656 (0.0009) [2023-12-26 14:39:39,926][123091] Updated weights for policy 0, policy_version 1886385 (0.0010) [2023-12-26 14:39:39,994][123090] Updated weights for policy 1, policy_version 1874666 (0.0008) [2023-12-26 14:39:39,995][123091] Updated weights for policy 0, policy_version 1886395 (0.0011) [2023-12-26 14:39:40,062][123091] Updated weights for policy 0, policy_version 1886405 (0.0008) [2023-12-26 14:39:40,063][123090] Updated weights for policy 1, policy_version 1874676 (0.0009) [2023-12-26 14:39:40,132][123091] Updated weights for policy 0, policy_version 1886415 (0.0006) [2023-12-26 14:39:40,133][123090] Updated weights for policy 1, policy_version 1874686 (0.0010) [2023-12-26 14:39:40,765][123091] Updated weights for policy 0, policy_version 1886425 (0.0006) [2023-12-26 14:39:40,822][123091] Updated weights for policy 0, policy_version 1886435 (0.0006) [2023-12-26 14:39:40,896][123091] Updated weights for policy 0, policy_version 1886445 (0.0006) [2023-12-26 14:39:40,933][123090] Updated weights for policy 1, policy_version 1874696 (0.0006) [2023-12-26 14:39:41,002][123090] Updated weights for policy 1, policy_version 1874706 (0.0005) [2023-12-26 14:39:41,073][123090] Updated weights for policy 1, policy_version 1874716 (0.0008) [2023-12-26 14:39:41,682][123091] Updated weights for policy 0, policy_version 1886455 (0.0006) [2023-12-26 14:39:41,755][123091] Updated weights for policy 0, policy_version 1886465 (0.0009) [2023-12-26 14:39:41,808][123091] Updated weights for policy 0, policy_version 1886475 (0.0010) [2023-12-26 14:39:41,862][123090] Updated weights for policy 1, policy_version 1874726 (0.0010) [2023-12-26 14:39:41,926][123090] Updated weights for policy 1, policy_version 1874736 (0.0010) [2023-12-26 14:39:41,990][123090] Updated weights for policy 1, policy_version 1874746 (0.0005) [2023-12-26 14:39:42,681][123090] Updated weights for policy 1, policy_version 1874756 (0.0007) [2023-12-26 14:39:42,686][123091] Updated weights for policy 0, policy_version 1886485 (0.0010) [2023-12-26 14:39:42,752][123090] Updated weights for policy 1, policy_version 1874766 (0.0006) [2023-12-26 14:39:42,755][123091] Updated weights for policy 0, policy_version 1886495 (0.0011) [2023-12-26 14:39:42,818][123090] Updated weights for policy 1, policy_version 1874776 (0.0009) [2023-12-26 14:39:42,824][123091] Updated weights for policy 0, policy_version 1886505 (0.0011) [2023-12-26 14:39:43,597][123090] Updated weights for policy 1, policy_version 1874786 (0.0010) [2023-12-26 14:39:43,633][123091] Updated weights for policy 0, policy_version 1886515 (0.0011) [2023-12-26 14:39:43,650][123090] Updated weights for policy 1, policy_version 1874796 (0.0008) [2023-12-26 14:39:43,703][123091] Updated weights for policy 0, policy_version 1886525 (0.0011) [2023-12-26 14:39:43,706][123090] Updated weights for policy 1, policy_version 1874806 (0.0008) [2023-12-26 14:39:43,755][123090] Updated weights for policy 1, policy_version 1874816 (0.0008) [2023-12-26 14:39:43,761][123091] Updated weights for policy 0, policy_version 1886535 (0.0010) [2023-12-26 14:39:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 962904064. Throughput: 0: 8863.1, 1: 8805.8. Samples: 962898752. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:43,784][121949] Avg episode reward: [(0, '6310.578'), (1, '5782.792')] [2023-12-26 14:39:44,553][123091] Updated weights for policy 0, policy_version 1886545 (0.0010) [2023-12-26 14:39:44,608][123090] Updated weights for policy 1, policy_version 1874826 (0.0009) [2023-12-26 14:39:44,614][123091] Updated weights for policy 0, policy_version 1886555 (0.0007) [2023-12-26 14:39:44,653][123090] Updated weights for policy 1, policy_version 1874836 (0.0008) [2023-12-26 14:39:44,672][123091] Updated weights for policy 0, policy_version 1886565 (0.0010) [2023-12-26 14:39:44,697][123090] Updated weights for policy 1, policy_version 1874846 (0.0006) [2023-12-26 14:39:44,733][123091] Updated weights for policy 0, policy_version 1886575 (0.0010) [2023-12-26 14:39:45,439][123091] Updated weights for policy 0, policy_version 1886585 (0.0011) [2023-12-26 14:39:45,510][123091] Updated weights for policy 0, policy_version 1886595 (0.0011) [2023-12-26 14:39:45,577][123091] Updated weights for policy 0, policy_version 1886605 (0.0005) [2023-12-26 14:39:45,631][123090] Updated weights for policy 1, policy_version 1874856 (0.0009) [2023-12-26 14:39:45,691][123090] Updated weights for policy 1, policy_version 1874866 (0.0006) [2023-12-26 14:39:45,761][123090] Updated weights for policy 1, policy_version 1874876 (0.0008) [2023-12-26 14:39:46,304][123091] Updated weights for policy 0, policy_version 1886615 (0.0006) [2023-12-26 14:39:46,374][123091] Updated weights for policy 0, policy_version 1886625 (0.0006) [2023-12-26 14:39:46,436][123091] Updated weights for policy 0, policy_version 1886635 (0.0011) [2023-12-26 14:39:46,526][123090] Updated weights for policy 1, policy_version 1874886 (0.0011) [2023-12-26 14:39:46,585][123090] Updated weights for policy 1, policy_version 1874896 (0.0010) [2023-12-26 14:39:46,652][123090] Updated weights for policy 1, policy_version 1874906 (0.0010) [2023-12-26 14:39:47,016][123091] Updated weights for policy 0, policy_version 1886645 (0.0008) [2023-12-26 14:39:47,069][123091] Updated weights for policy 0, policy_version 1886655 (0.0005) [2023-12-26 14:39:47,118][123091] Updated weights for policy 0, policy_version 1886665 (0.0005) [2023-12-26 14:39:47,453][123090] Updated weights for policy 1, policy_version 1874916 (0.0010) [2023-12-26 14:39:47,508][123090] Updated weights for policy 1, policy_version 1874926 (0.0010) [2023-12-26 14:39:47,556][123090] Updated weights for policy 1, policy_version 1874936 (0.0010) [2023-12-26 14:39:47,788][123091] Updated weights for policy 0, policy_version 1886675 (0.0006) [2023-12-26 14:39:47,850][123091] Updated weights for policy 0, policy_version 1886685 (0.0008) [2023-12-26 14:39:47,909][123091] Updated weights for policy 0, policy_version 1886695 (0.0006) [2023-12-26 14:39:48,326][123090] Updated weights for policy 1, policy_version 1874946 (0.0010) [2023-12-26 14:39:48,406][123090] Updated weights for policy 1, policy_version 1874957 (0.0009) [2023-12-26 14:39:48,481][123090] Updated weights for policy 1, policy_version 1874967 (0.0009) [2023-12-26 14:39:48,645][123091] Updated weights for policy 0, policy_version 1886705 (0.0007) [2023-12-26 14:39:48,716][123091] Updated weights for policy 0, policy_version 1886715 (0.0011) [2023-12-26 14:39:48,768][123091] Updated weights for policy 0, policy_version 1886725 (0.0011) [2023-12-26 14:39:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 962994176. Throughput: 0: 8916.6, 1: 8795.8. Samples: 963007496. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:48,785][121949] Avg episode reward: [(0, '6347.622'), (1, '5912.938')] [2023-12-26 14:39:48,823][123091] Updated weights for policy 0, policy_version 1886735 (0.0011) [2023-12-26 14:39:49,330][123090] Updated weights for policy 1, policy_version 1874977 (0.0009) [2023-12-26 14:39:49,404][123090] Updated weights for policy 1, policy_version 1874987 (0.0009) [2023-12-26 14:39:49,469][123090] Updated weights for policy 1, policy_version 1874997 (0.0009) [2023-12-26 14:39:49,524][123090] Updated weights for policy 1, policy_version 1875007 (0.0008) [2023-12-26 14:39:49,649][123091] Updated weights for policy 0, policy_version 1886745 (0.0011) [2023-12-26 14:39:49,697][123091] Updated weights for policy 0, policy_version 1886755 (0.0011) [2023-12-26 14:39:49,746][123091] Updated weights for policy 0, policy_version 1886765 (0.0010) [2023-12-26 14:39:50,362][123090] Updated weights for policy 1, policy_version 1875017 (0.0008) [2023-12-26 14:39:50,416][123090] Updated weights for policy 1, policy_version 1875027 (0.0009) [2023-12-26 14:39:50,466][123090] Updated weights for policy 1, policy_version 1875037 (0.0009) [2023-12-26 14:39:50,615][123091] Updated weights for policy 0, policy_version 1886775 (0.0011) [2023-12-26 14:39:50,687][123091] Updated weights for policy 0, policy_version 1886785 (0.0011) [2023-12-26 14:39:50,757][123091] Updated weights for policy 0, policy_version 1886795 (0.0009) [2023-12-26 14:39:51,362][123090] Updated weights for policy 1, policy_version 1875047 (0.0009) [2023-12-26 14:39:51,440][123090] Updated weights for policy 1, policy_version 1875057 (0.0007) [2023-12-26 14:39:51,513][123090] Updated weights for policy 1, policy_version 1875067 (0.0006) [2023-12-26 14:39:51,577][123091] Updated weights for policy 0, policy_version 1886805 (0.0009) [2023-12-26 14:39:51,647][123091] Updated weights for policy 0, policy_version 1886815 (0.0008) [2023-12-26 14:39:51,718][123091] Updated weights for policy 0, policy_version 1886825 (0.0007) [2023-12-26 14:39:52,199][123090] Updated weights for policy 1, policy_version 1875077 (0.0009) [2023-12-26 14:39:52,270][123090] Updated weights for policy 1, policy_version 1875087 (0.0007) [2023-12-26 14:39:52,346][123090] Updated weights for policy 1, policy_version 1875097 (0.0006) [2023-12-26 14:39:52,562][123091] Updated weights for policy 0, policy_version 1886835 (0.0010) [2023-12-26 14:39:52,639][123091] Updated weights for policy 0, policy_version 1886845 (0.0011) [2023-12-26 14:39:52,713][123091] Updated weights for policy 0, policy_version 1886855 (0.0011) [2023-12-26 14:39:53,049][123090] Updated weights for policy 1, policy_version 1875107 (0.0007) [2023-12-26 14:39:53,101][123090] Updated weights for policy 1, policy_version 1875117 (0.0009) [2023-12-26 14:39:53,153][123090] Updated weights for policy 1, policy_version 1875127 (0.0008) [2023-12-26 14:39:53,501][123091] Updated weights for policy 0, policy_version 1886865 (0.0011) [2023-12-26 14:39:53,552][123091] Updated weights for policy 0, policy_version 1886875 (0.0011) [2023-12-26 14:39:53,604][123091] Updated weights for policy 0, policy_version 1886885 (0.0010) [2023-12-26 14:39:53,651][123091] Updated weights for policy 0, policy_version 1886895 (0.0010) [2023-12-26 14:39:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 963084288. Throughput: 0: 8909.8, 1: 8765.3. Samples: 963057544. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:53,785][121949] Avg episode reward: [(0, '6280.678'), (1, '5920.857')] [2023-12-26 14:39:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001886896_483049472.pth... [2023-12-26 14:39:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001875136_480034816.pth... [2023-12-26 14:39:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001885840_482779136.pth [2023-12-26 14:39:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001874112_479772672.pth [2023-12-26 14:39:53,985][123090] Updated weights for policy 1, policy_version 1875137 (0.0006) [2023-12-26 14:39:54,050][123090] Updated weights for policy 1, policy_version 1875147 (0.0007) [2023-12-26 14:39:54,109][123090] Updated weights for policy 1, policy_version 1875157 (0.0008) [2023-12-26 14:39:54,179][123090] Updated weights for policy 1, policy_version 1875167 (0.0006) [2023-12-26 14:39:54,358][123091] Updated weights for policy 0, policy_version 1886905 (0.0006) [2023-12-26 14:39:54,421][123091] Updated weights for policy 0, policy_version 1886915 (0.0005) [2023-12-26 14:39:54,475][123091] Updated weights for policy 0, policy_version 1886925 (0.0005) [2023-12-26 14:39:54,800][123090] Updated weights for policy 1, policy_version 1875177 (0.0009) [2023-12-26 14:39:54,860][123090] Updated weights for policy 1, policy_version 1875187 (0.0010) [2023-12-26 14:39:54,917][123090] Updated weights for policy 1, policy_version 1875197 (0.0008) [2023-12-26 14:39:55,177][123091] Updated weights for policy 0, policy_version 1886935 (0.0009) [2023-12-26 14:39:55,224][123091] Updated weights for policy 0, policy_version 1886945 (0.0010) [2023-12-26 14:39:55,286][123091] Updated weights for policy 0, policy_version 1886955 (0.0010) [2023-12-26 14:39:55,628][123090] Updated weights for policy 1, policy_version 1875207 (0.0008) [2023-12-26 14:39:55,693][123090] Updated weights for policy 1, policy_version 1875217 (0.0008) [2023-12-26 14:39:55,760][123090] Updated weights for policy 1, policy_version 1875227 (0.0008) [2023-12-26 14:39:56,086][123091] Updated weights for policy 0, policy_version 1886965 (0.0010) [2023-12-26 14:39:56,139][123091] Updated weights for policy 0, policy_version 1886975 (0.0009) [2023-12-26 14:39:56,204][123091] Updated weights for policy 0, policy_version 1886985 (0.0010) [2023-12-26 14:39:56,535][123090] Updated weights for policy 1, policy_version 1875237 (0.0010) [2023-12-26 14:39:56,601][123090] Updated weights for policy 1, policy_version 1875247 (0.0010) [2023-12-26 14:39:56,657][123090] Updated weights for policy 1, policy_version 1875257 (0.0010) [2023-12-26 14:39:56,921][123091] Updated weights for policy 0, policy_version 1886995 (0.0009) [2023-12-26 14:39:56,982][123091] Updated weights for policy 0, policy_version 1887005 (0.0009) [2023-12-26 14:39:57,034][123091] Updated weights for policy 0, policy_version 1887016 (0.0010) [2023-12-26 14:39:57,344][123090] Updated weights for policy 1, policy_version 1875267 (0.0009) [2023-12-26 14:39:57,398][123090] Updated weights for policy 1, policy_version 1875277 (0.0005) [2023-12-26 14:39:57,448][123090] Updated weights for policy 1, policy_version 1875288 (0.0006) [2023-12-26 14:39:57,740][123091] Updated weights for policy 0, policy_version 1887027 (0.0009) [2023-12-26 14:39:57,787][123091] Updated weights for policy 0, policy_version 1887037 (0.0005) [2023-12-26 14:39:57,833][123091] Updated weights for policy 0, policy_version 1887047 (0.0005) [2023-12-26 14:39:58,280][123090] Updated weights for policy 1, policy_version 1875299 (0.0009) [2023-12-26 14:39:58,345][123090] Updated weights for policy 1, policy_version 1875309 (0.0007) [2023-12-26 14:39:58,416][123090] Updated weights for policy 1, policy_version 1875319 (0.0009) [2023-12-26 14:39:58,633][123091] Updated weights for policy 0, policy_version 1887057 (0.0006) [2023-12-26 14:39:58,711][123091] Updated weights for policy 0, policy_version 1887067 (0.0008) [2023-12-26 14:39:58,777][123091] Updated weights for policy 0, policy_version 1887077 (0.0008) [2023-12-26 14:39:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 963174400. Throughput: 0: 8909.8, 1: 8890.1. Samples: 963170308. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:39:58,785][121949] Avg episode reward: [(0, '6198.407'), (1, '5962.616')] [2023-12-26 14:39:58,845][123091] Updated weights for policy 0, policy_version 1887087 (0.0008) [2023-12-26 14:39:59,422][123090] Updated weights for policy 1, policy_version 1875329 (0.0010) [2023-12-26 14:39:59,489][123090] Updated weights for policy 1, policy_version 1875339 (0.0007) [2023-12-26 14:39:59,555][123090] Updated weights for policy 1, policy_version 1875349 (0.0005) [2023-12-26 14:39:59,622][123090] Updated weights for policy 1, policy_version 1875359 (0.0006) [2023-12-26 14:39:59,655][123091] Updated weights for policy 0, policy_version 1887097 (0.0005) [2023-12-26 14:39:59,713][123091] Updated weights for policy 0, policy_version 1887107 (0.0005) [2023-12-26 14:39:59,772][123091] Updated weights for policy 0, policy_version 1887117 (0.0005) [2023-12-26 14:40:00,351][123090] Updated weights for policy 1, policy_version 1875369 (0.0007) [2023-12-26 14:40:00,401][123090] Updated weights for policy 1, policy_version 1875379 (0.0010) [2023-12-26 14:40:00,450][123090] Updated weights for policy 1, policy_version 1875389 (0.0009) [2023-12-26 14:40:00,486][123091] Updated weights for policy 0, policy_version 1887127 (0.0007) [2023-12-26 14:40:00,559][123091] Updated weights for policy 0, policy_version 1887137 (0.0005) [2023-12-26 14:40:00,626][123091] Updated weights for policy 0, policy_version 1887147 (0.0006) [2023-12-26 14:40:01,310][123090] Updated weights for policy 1, policy_version 1875399 (0.0009) [2023-12-26 14:40:01,367][123091] Updated weights for policy 0, policy_version 1887157 (0.0007) [2023-12-26 14:40:01,382][123090] Updated weights for policy 1, policy_version 1875409 (0.0009) [2023-12-26 14:40:01,420][123091] Updated weights for policy 0, policy_version 1887167 (0.0006) [2023-12-26 14:40:01,442][123090] Updated weights for policy 1, policy_version 1875419 (0.0010) [2023-12-26 14:40:01,480][123091] Updated weights for policy 0, policy_version 1887177 (0.0008) [2023-12-26 14:40:02,231][123090] Updated weights for policy 1, policy_version 1875429 (0.0009) [2023-12-26 14:40:02,294][123090] Updated weights for policy 1, policy_version 1875439 (0.0009) [2023-12-26 14:40:02,307][123091] Updated weights for policy 0, policy_version 1887187 (0.0009) [2023-12-26 14:40:02,366][123090] Updated weights for policy 1, policy_version 1875449 (0.0009) [2023-12-26 14:40:02,369][123091] Updated weights for policy 0, policy_version 1887197 (0.0010) [2023-12-26 14:40:02,427][123091] Updated weights for policy 0, policy_version 1887207 (0.0009) [2023-12-26 14:40:03,125][123090] Updated weights for policy 1, policy_version 1875459 (0.0007) [2023-12-26 14:40:03,174][123090] Updated weights for policy 1, policy_version 1875469 (0.0009) [2023-12-26 14:40:03,221][123091] Updated weights for policy 0, policy_version 1887217 (0.0009) [2023-12-26 14:40:03,229][123090] Updated weights for policy 1, policy_version 1875479 (0.0009) [2023-12-26 14:40:03,279][123091] Updated weights for policy 0, policy_version 1887227 (0.0005) [2023-12-26 14:40:03,330][123091] Updated weights for policy 0, policy_version 1887237 (0.0005) [2023-12-26 14:40:03,374][123091] Updated weights for policy 0, policy_version 1887247 (0.0005) [2023-12-26 14:40:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 963264512. Throughput: 0: 8915.4, 1: 8849.0. Samples: 963275020. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:03,785][121949] Avg episode reward: [(0, '6237.121'), (1, '6023.712')] [2023-12-26 14:40:04,080][123091] Updated weights for policy 0, policy_version 1887257 (0.0007) [2023-12-26 14:40:04,088][123090] Updated weights for policy 1, policy_version 1875489 (0.0009) [2023-12-26 14:40:04,148][123091] Updated weights for policy 0, policy_version 1887267 (0.0007) [2023-12-26 14:40:04,175][123090] Updated weights for policy 1, policy_version 1875499 (0.0009) [2023-12-26 14:40:04,201][123091] Updated weights for policy 0, policy_version 1887277 (0.0008) [2023-12-26 14:40:04,244][123090] Updated weights for policy 1, policy_version 1875509 (0.0009) [2023-12-26 14:40:04,313][123090] Updated weights for policy 1, policy_version 1875519 (0.0010) [2023-12-26 14:40:04,947][123091] Updated weights for policy 0, policy_version 1887287 (0.0009) [2023-12-26 14:40:05,014][123091] Updated weights for policy 0, policy_version 1887297 (0.0007) [2023-12-26 14:40:05,080][123091] Updated weights for policy 0, policy_version 1887307 (0.0008) [2023-12-26 14:40:05,139][123090] Updated weights for policy 1, policy_version 1875529 (0.0008) [2023-12-26 14:40:05,204][123090] Updated weights for policy 1, policy_version 1875539 (0.0008) [2023-12-26 14:40:05,266][123090] Updated weights for policy 1, policy_version 1875549 (0.0008) [2023-12-26 14:40:05,777][123091] Updated weights for policy 0, policy_version 1887317 (0.0006) [2023-12-26 14:40:05,834][123091] Updated weights for policy 0, policy_version 1887327 (0.0005) [2023-12-26 14:40:05,888][123091] Updated weights for policy 0, policy_version 1887337 (0.0005) [2023-12-26 14:40:05,968][123090] Updated weights for policy 1, policy_version 1875559 (0.0008) [2023-12-26 14:40:06,042][123090] Updated weights for policy 1, policy_version 1875569 (0.0010) [2023-12-26 14:40:06,102][123090] Updated weights for policy 1, policy_version 1875579 (0.0009) [2023-12-26 14:40:06,536][123091] Updated weights for policy 0, policy_version 1887347 (0.0005) [2023-12-26 14:40:06,609][123091] Updated weights for policy 0, policy_version 1887357 (0.0006) [2023-12-26 14:40:06,680][123091] Updated weights for policy 0, policy_version 1887367 (0.0007) [2023-12-26 14:40:06,904][123090] Updated weights for policy 1, policy_version 1875589 (0.0010) [2023-12-26 14:40:06,960][123090] Updated weights for policy 1, policy_version 1875599 (0.0010) [2023-12-26 14:40:07,017][123090] Updated weights for policy 1, policy_version 1875609 (0.0010) [2023-12-26 14:40:07,416][123091] Updated weights for policy 0, policy_version 1887377 (0.0010) [2023-12-26 14:40:07,475][123091] Updated weights for policy 0, policy_version 1887387 (0.0009) [2023-12-26 14:40:07,543][123091] Updated weights for policy 0, policy_version 1887397 (0.0010) [2023-12-26 14:40:07,608][123091] Updated weights for policy 0, policy_version 1887407 (0.0010) [2023-12-26 14:40:07,778][123090] Updated weights for policy 1, policy_version 1875619 (0.0010) [2023-12-26 14:40:07,839][123090] Updated weights for policy 1, policy_version 1875629 (0.0009) [2023-12-26 14:40:07,910][123090] Updated weights for policy 1, policy_version 1875639 (0.0009) [2023-12-26 14:40:08,431][123091] Updated weights for policy 0, policy_version 1887417 (0.0010) [2023-12-26 14:40:08,479][123091] Updated weights for policy 0, policy_version 1887427 (0.0009) [2023-12-26 14:40:08,527][123091] Updated weights for policy 0, policy_version 1887437 (0.0009) [2023-12-26 14:40:08,695][123090] Updated weights for policy 1, policy_version 1875649 (0.0010) [2023-12-26 14:40:08,760][123090] Updated weights for policy 1, policy_version 1875659 (0.0010) [2023-12-26 14:40:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 963354624. Throughput: 0: 9020.1, 1: 8895.6. Samples: 963332316. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:08,784][121949] Avg episode reward: [(0, '6263.641'), (1, '5874.625')] [2023-12-26 14:40:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001887440_483188736.pth... [2023-12-26 14:40:08,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001886352_482910208.pth [2023-12-26 14:40:08,816][123090] Updated weights for policy 1, policy_version 1875669 (0.0010) [2023-12-26 14:40:08,883][123090] Updated weights for policy 1, policy_version 1875679 (0.0010) [2023-12-26 14:40:08,886][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001875680_480174080.pth... [2023-12-26 14:40:08,890][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001874624_479903744.pth [2023-12-26 14:40:09,383][123091] Updated weights for policy 0, policy_version 1887447 (0.0008) [2023-12-26 14:40:09,460][123091] Updated weights for policy 0, policy_version 1887457 (0.0008) [2023-12-26 14:40:09,515][123091] Updated weights for policy 0, policy_version 1887467 (0.0008) [2023-12-26 14:40:09,739][123090] Updated weights for policy 1, policy_version 1875689 (0.0011) [2023-12-26 14:40:09,811][123090] Updated weights for policy 1, policy_version 1875699 (0.0011) [2023-12-26 14:40:09,881][123090] Updated weights for policy 1, policy_version 1875709 (0.0011) [2023-12-26 14:40:10,274][123091] Updated weights for policy 0, policy_version 1887477 (0.0009) [2023-12-26 14:40:10,323][123091] Updated weights for policy 0, policy_version 1887487 (0.0009) [2023-12-26 14:40:10,387][123091] Updated weights for policy 0, policy_version 1887497 (0.0008) [2023-12-26 14:40:10,712][123090] Updated weights for policy 1, policy_version 1875719 (0.0009) [2023-12-26 14:40:10,771][123090] Updated weights for policy 1, policy_version 1875729 (0.0006) [2023-12-26 14:40:10,832][123090] Updated weights for policy 1, policy_version 1875739 (0.0005) [2023-12-26 14:40:11,278][123091] Updated weights for policy 0, policy_version 1887507 (0.0008) [2023-12-26 14:40:11,345][123091] Updated weights for policy 0, policy_version 1887517 (0.0010) [2023-12-26 14:40:11,407][123091] Updated weights for policy 0, policy_version 1887527 (0.0010) [2023-12-26 14:40:11,631][123090] Updated weights for policy 1, policy_version 1875749 (0.0007) [2023-12-26 14:40:11,698][123090] Updated weights for policy 1, policy_version 1875759 (0.0006) [2023-12-26 14:40:11,777][123090] Updated weights for policy 1, policy_version 1875769 (0.0007) [2023-12-26 14:40:12,272][123091] Updated weights for policy 0, policy_version 1887537 (0.0009) [2023-12-26 14:40:12,336][123091] Updated weights for policy 0, policy_version 1887547 (0.0011) [2023-12-26 14:40:12,405][123091] Updated weights for policy 0, policy_version 1887557 (0.0010) [2023-12-26 14:40:12,472][123091] Updated weights for policy 0, policy_version 1887567 (0.0011) [2023-12-26 14:40:12,474][123090] Updated weights for policy 1, policy_version 1875779 (0.0006) [2023-12-26 14:40:12,542][123090] Updated weights for policy 1, policy_version 1875789 (0.0005) [2023-12-26 14:40:12,607][123090] Updated weights for policy 1, policy_version 1875799 (0.0005) [2023-12-26 14:40:13,225][123091] Updated weights for policy 0, policy_version 1887577 (0.0006) [2023-12-26 14:40:13,237][123090] Updated weights for policy 1, policy_version 1875809 (0.0006) [2023-12-26 14:40:13,276][123091] Updated weights for policy 0, policy_version 1887587 (0.0006) [2023-12-26 14:40:13,292][123090] Updated weights for policy 1, policy_version 1875819 (0.0005) [2023-12-26 14:40:13,344][123091] Updated weights for policy 0, policy_version 1887597 (0.0008) [2023-12-26 14:40:13,352][123090] Updated weights for policy 1, policy_version 1875829 (0.0005) [2023-12-26 14:40:13,423][123090] Updated weights for policy 1, policy_version 1875839 (0.0006) [2023-12-26 14:40:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 963444736. Throughput: 0: 9034.4, 1: 8897.6. Samples: 963435556. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:13,785][121949] Avg episode reward: [(0, '6229.294'), (1, '5867.062')] [2023-12-26 14:40:14,023][123091] Updated weights for policy 0, policy_version 1887607 (0.0010) [2023-12-26 14:40:14,075][123091] Updated weights for policy 0, policy_version 1887617 (0.0010) [2023-12-26 14:40:14,085][123090] Updated weights for policy 1, policy_version 1875849 (0.0006) [2023-12-26 14:40:14,125][123091] Updated weights for policy 0, policy_version 1887627 (0.0008) [2023-12-26 14:40:14,154][123090] Updated weights for policy 1, policy_version 1875859 (0.0005) [2023-12-26 14:40:14,216][123090] Updated weights for policy 1, policy_version 1875869 (0.0009) [2023-12-26 14:40:14,815][123091] Updated weights for policy 0, policy_version 1887637 (0.0007) [2023-12-26 14:40:14,875][123091] Updated weights for policy 0, policy_version 1887647 (0.0009) [2023-12-26 14:40:14,936][123091] Updated weights for policy 0, policy_version 1887657 (0.0010) [2023-12-26 14:40:14,975][123090] Updated weights for policy 1, policy_version 1875879 (0.0007) [2023-12-26 14:40:15,029][123090] Updated weights for policy 1, policy_version 1875889 (0.0006) [2023-12-26 14:40:15,079][123090] Updated weights for policy 1, policy_version 1875899 (0.0007) [2023-12-26 14:40:15,833][123090] Updated weights for policy 1, policy_version 1875909 (0.0009) [2023-12-26 14:40:15,860][123091] Updated weights for policy 0, policy_version 1887667 (0.0009) [2023-12-26 14:40:15,881][123090] Updated weights for policy 1, policy_version 1875919 (0.0007) [2023-12-26 14:40:15,910][123091] Updated weights for policy 0, policy_version 1887677 (0.0009) [2023-12-26 14:40:15,931][123090] Updated weights for policy 1, policy_version 1875929 (0.0007) [2023-12-26 14:40:15,967][123091] Updated weights for policy 0, policy_version 1887687 (0.0008) [2023-12-26 14:40:16,779][123090] Updated weights for policy 1, policy_version 1875939 (0.0007) [2023-12-26 14:40:16,796][123091] Updated weights for policy 0, policy_version 1887697 (0.0009) [2023-12-26 14:40:16,830][123090] Updated weights for policy 1, policy_version 1875949 (0.0005) [2023-12-26 14:40:16,845][123091] Updated weights for policy 0, policy_version 1887707 (0.0009) [2023-12-26 14:40:16,883][123090] Updated weights for policy 1, policy_version 1875959 (0.0005) [2023-12-26 14:40:16,902][123091] Updated weights for policy 0, policy_version 1887717 (0.0009) [2023-12-26 14:40:16,964][123091] Updated weights for policy 0, policy_version 1887727 (0.0009) [2023-12-26 14:40:17,502][123090] Updated weights for policy 1, policy_version 1875969 (0.0005) [2023-12-26 14:40:17,554][123090] Updated weights for policy 1, policy_version 1875979 (0.0005) [2023-12-26 14:40:17,610][123090] Updated weights for policy 1, policy_version 1875989 (0.0007) [2023-12-26 14:40:17,657][123090] Updated weights for policy 1, policy_version 1875999 (0.0010) [2023-12-26 14:40:17,859][123091] Updated weights for policy 0, policy_version 1887737 (0.0009) [2023-12-26 14:40:17,919][123091] Updated weights for policy 0, policy_version 1887747 (0.0009) [2023-12-26 14:40:17,982][123091] Updated weights for policy 0, policy_version 1887757 (0.0009) [2023-12-26 14:40:18,471][123090] Updated weights for policy 1, policy_version 1876009 (0.0010) [2023-12-26 14:40:18,534][123090] Updated weights for policy 1, policy_version 1876019 (0.0009) [2023-12-26 14:40:18,604][123090] Updated weights for policy 1, policy_version 1876029 (0.0010) [2023-12-26 14:40:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 963534848. Throughput: 0: 9043.8, 1: 8906.8. Samples: 963546360. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:18,785][121949] Avg episode reward: [(0, '6241.388'), (1, '5923.786')] [2023-12-26 14:40:18,833][123091] Updated weights for policy 0, policy_version 1887767 (0.0008) [2023-12-26 14:40:18,902][123091] Updated weights for policy 0, policy_version 1887777 (0.0006) [2023-12-26 14:40:18,961][123091] Updated weights for policy 0, policy_version 1887787 (0.0006) [2023-12-26 14:40:19,505][123090] Updated weights for policy 1, policy_version 1876039 (0.0010) [2023-12-26 14:40:19,561][123090] Updated weights for policy 1, policy_version 1876049 (0.0009) [2023-12-26 14:40:19,617][123090] Updated weights for policy 1, policy_version 1876059 (0.0009) [2023-12-26 14:40:19,665][123091] Updated weights for policy 0, policy_version 1887797 (0.0006) [2023-12-26 14:40:19,728][123091] Updated weights for policy 0, policy_version 1887807 (0.0006) [2023-12-26 14:40:19,794][123091] Updated weights for policy 0, policy_version 1887817 (0.0009) [2023-12-26 14:40:20,425][123090] Updated weights for policy 1, policy_version 1876069 (0.0009) [2023-12-26 14:40:20,482][123090] Updated weights for policy 1, policy_version 1876079 (0.0009) [2023-12-26 14:40:20,528][123091] Updated weights for policy 0, policy_version 1887827 (0.0009) [2023-12-26 14:40:20,540][123090] Updated weights for policy 1, policy_version 1876089 (0.0008) [2023-12-26 14:40:20,588][123091] Updated weights for policy 0, policy_version 1887837 (0.0009) [2023-12-26 14:40:20,650][123091] Updated weights for policy 0, policy_version 1887847 (0.0009) [2023-12-26 14:40:21,469][123090] Updated weights for policy 1, policy_version 1876099 (0.0008) [2023-12-26 14:40:21,477][123091] Updated weights for policy 0, policy_version 1887857 (0.0009) [2023-12-26 14:40:21,528][123090] Updated weights for policy 1, policy_version 1876109 (0.0006) [2023-12-26 14:40:21,544][123091] Updated weights for policy 0, policy_version 1887867 (0.0008) [2023-12-26 14:40:21,588][123090] Updated weights for policy 1, policy_version 1876119 (0.0008) [2023-12-26 14:40:21,604][123091] Updated weights for policy 0, policy_version 1887877 (0.0008) [2023-12-26 14:40:21,676][123091] Updated weights for policy 0, policy_version 1887887 (0.0008) [2023-12-26 14:40:22,483][123091] Updated weights for policy 0, policy_version 1887897 (0.0010) [2023-12-26 14:40:22,486][123090] Updated weights for policy 1, policy_version 1876129 (0.0008) [2023-12-26 14:40:22,548][123091] Updated weights for policy 0, policy_version 1887907 (0.0009) [2023-12-26 14:40:22,553][123090] Updated weights for policy 1, policy_version 1876139 (0.0008) [2023-12-26 14:40:22,616][123091] Updated weights for policy 0, policy_version 1887917 (0.0008) [2023-12-26 14:40:22,621][123090] Updated weights for policy 1, policy_version 1876149 (0.0007) [2023-12-26 14:40:22,695][123090] Updated weights for policy 1, policy_version 1876159 (0.0010) [2023-12-26 14:40:23,426][123090] Updated weights for policy 1, policy_version 1876169 (0.0006) [2023-12-26 14:40:23,465][123091] Updated weights for policy 0, policy_version 1887927 (0.0009) [2023-12-26 14:40:23,479][123090] Updated weights for policy 1, policy_version 1876179 (0.0010) [2023-12-26 14:40:23,510][123091] Updated weights for policy 0, policy_version 1887937 (0.0010) [2023-12-26 14:40:23,527][123090] Updated weights for policy 1, policy_version 1876189 (0.0008) [2023-12-26 14:40:23,565][123091] Updated weights for policy 0, policy_version 1887947 (0.0008) [2023-12-26 14:40:23,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 963624960. Throughput: 0: 9030.8, 1: 8833.3. Samples: 963598340. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:23,785][121949] Avg episode reward: [(0, '6277.719'), (1, '5893.519')] [2023-12-26 14:40:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001887952_483319808.pth... [2023-12-26 14:40:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001876192_480305152.pth... [2023-12-26 14:40:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001875136_480034816.pth [2023-12-26 14:40:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001886896_483049472.pth [2023-12-26 14:40:24,250][123090] Updated weights for policy 1, policy_version 1876199 (0.0006) [2023-12-26 14:40:24,296][123090] Updated weights for policy 1, policy_version 1876209 (0.0005) [2023-12-26 14:40:24,342][123090] Updated weights for policy 1, policy_version 1876219 (0.0005) [2023-12-26 14:40:24,424][123091] Updated weights for policy 0, policy_version 1887957 (0.0007) [2023-12-26 14:40:24,475][123091] Updated weights for policy 0, policy_version 1887967 (0.0009) [2023-12-26 14:40:24,525][123091] Updated weights for policy 0, policy_version 1887977 (0.0008) [2023-12-26 14:40:25,123][123090] Updated weights for policy 1, policy_version 1876229 (0.0007) [2023-12-26 14:40:25,191][123090] Updated weights for policy 1, policy_version 1876239 (0.0009) [2023-12-26 14:40:25,252][123090] Updated weights for policy 1, policy_version 1876249 (0.0010) [2023-12-26 14:40:25,372][123091] Updated weights for policy 0, policy_version 1887987 (0.0009) [2023-12-26 14:40:25,439][123091] Updated weights for policy 0, policy_version 1887997 (0.0009) [2023-12-26 14:40:25,495][123091] Updated weights for policy 0, policy_version 1888007 (0.0008) [2023-12-26 14:40:25,872][123090] Updated weights for policy 1, policy_version 1876259 (0.0008) [2023-12-26 14:40:25,947][123090] Updated weights for policy 1, policy_version 1876269 (0.0006) [2023-12-26 14:40:26,015][123090] Updated weights for policy 1, policy_version 1876279 (0.0009) [2023-12-26 14:40:26,334][123091] Updated weights for policy 0, policy_version 1888017 (0.0009) [2023-12-26 14:40:26,388][123091] Updated weights for policy 0, policy_version 1888027 (0.0009) [2023-12-26 14:40:26,440][123091] Updated weights for policy 0, policy_version 1888037 (0.0010) [2023-12-26 14:40:26,493][123091] Updated weights for policy 0, policy_version 1888048 (0.0009) [2023-12-26 14:40:26,758][123090] Updated weights for policy 1, policy_version 1876289 (0.0009) [2023-12-26 14:40:26,815][123090] Updated weights for policy 1, policy_version 1876299 (0.0006) [2023-12-26 14:40:26,885][123090] Updated weights for policy 1, policy_version 1876309 (0.0005) [2023-12-26 14:40:26,942][123090] Updated weights for policy 1, policy_version 1876319 (0.0009) [2023-12-26 14:40:27,432][123091] Updated weights for policy 0, policy_version 1888058 (0.0009) [2023-12-26 14:40:27,491][123091] Updated weights for policy 0, policy_version 1888068 (0.0010) [2023-12-26 14:40:27,538][123091] Updated weights for policy 0, policy_version 1888079 (0.0008) [2023-12-26 14:40:27,621][123090] Updated weights for policy 1, policy_version 1876329 (0.0010) [2023-12-26 14:40:27,682][123090] Updated weights for policy 1, policy_version 1876339 (0.0010) [2023-12-26 14:40:27,736][123090] Updated weights for policy 1, policy_version 1876349 (0.0010) [2023-12-26 14:40:28,420][123091] Updated weights for policy 0, policy_version 1888089 (0.0008) [2023-12-26 14:40:28,444][123090] Updated weights for policy 1, policy_version 1876359 (0.0010) [2023-12-26 14:40:28,482][123091] Updated weights for policy 0, policy_version 1888099 (0.0011) [2023-12-26 14:40:28,506][123090] Updated weights for policy 1, policy_version 1876369 (0.0010) [2023-12-26 14:40:28,537][123091] Updated weights for policy 0, policy_version 1888109 (0.0010) [2023-12-26 14:40:28,564][123090] Updated weights for policy 1, policy_version 1876379 (0.0010) [2023-12-26 14:40:28,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 963715072. Throughput: 0: 8968.9, 1: 8947.1. Samples: 963704972. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:28,785][121949] Avg episode reward: [(0, '6325.869'), (1, '5909.593')] [2023-12-26 14:40:29,341][123091] Updated weights for policy 0, policy_version 1888119 (0.0009) [2023-12-26 14:40:29,379][123090] Updated weights for policy 1, policy_version 1876389 (0.0009) [2023-12-26 14:40:29,403][123091] Updated weights for policy 0, policy_version 1888129 (0.0007) [2023-12-26 14:40:29,432][123090] Updated weights for policy 1, policy_version 1876399 (0.0005) [2023-12-26 14:40:29,467][123091] Updated weights for policy 0, policy_version 1888139 (0.0005) [2023-12-26 14:40:29,490][123090] Updated weights for policy 1, policy_version 1876409 (0.0009) [2023-12-26 14:40:30,173][123091] Updated weights for policy 0, policy_version 1888149 (0.0008) [2023-12-26 14:40:30,221][123091] Updated weights for policy 0, policy_version 1888159 (0.0009) [2023-12-26 14:40:30,273][123091] Updated weights for policy 0, policy_version 1888169 (0.0008) [2023-12-26 14:40:30,313][123090] Updated weights for policy 1, policy_version 1876419 (0.0010) [2023-12-26 14:40:30,369][123090] Updated weights for policy 1, policy_version 1876429 (0.0010) [2023-12-26 14:40:30,425][123090] Updated weights for policy 1, policy_version 1876439 (0.0010) [2023-12-26 14:40:31,114][123091] Updated weights for policy 0, policy_version 1888179 (0.0008) [2023-12-26 14:40:31,180][123091] Updated weights for policy 0, policy_version 1888189 (0.0008) [2023-12-26 14:40:31,231][123091] Updated weights for policy 0, policy_version 1888199 (0.0008) [2023-12-26 14:40:31,245][123090] Updated weights for policy 1, policy_version 1876449 (0.0010) [2023-12-26 14:40:31,304][123090] Updated weights for policy 1, policy_version 1876459 (0.0010) [2023-12-26 14:40:31,373][123090] Updated weights for policy 1, policy_version 1876469 (0.0010) [2023-12-26 14:40:31,438][123090] Updated weights for policy 1, policy_version 1876479 (0.0010) [2023-12-26 14:40:32,121][123091] Updated weights for policy 0, policy_version 1888209 (0.0007) [2023-12-26 14:40:32,177][123090] Updated weights for policy 1, policy_version 1876489 (0.0007) [2023-12-26 14:40:32,180][123091] Updated weights for policy 0, policy_version 1888219 (0.0009) [2023-12-26 14:40:32,237][123091] Updated weights for policy 0, policy_version 1888229 (0.0009) [2023-12-26 14:40:32,245][123090] Updated weights for policy 1, policy_version 1876499 (0.0005) [2023-12-26 14:40:32,301][123091] Updated weights for policy 0, policy_version 1888239 (0.0009) [2023-12-26 14:40:32,313][123090] Updated weights for policy 1, policy_version 1876509 (0.0006) [2023-12-26 14:40:32,978][123090] Updated weights for policy 1, policy_version 1876519 (0.0006) [2023-12-26 14:40:33,033][123090] Updated weights for policy 1, policy_version 1876529 (0.0005) [2023-12-26 14:40:33,105][123090] Updated weights for policy 1, policy_version 1876539 (0.0005) [2023-12-26 14:40:33,209][123091] Updated weights for policy 0, policy_version 1888249 (0.0009) [2023-12-26 14:40:33,267][123091] Updated weights for policy 0, policy_version 1888259 (0.0009) [2023-12-26 14:40:33,320][123091] Updated weights for policy 0, policy_version 1888269 (0.0010) [2023-12-26 14:40:33,758][123090] Updated weights for policy 1, policy_version 1876549 (0.0008) [2023-12-26 14:40:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 963796992. Throughput: 0: 8827.4, 1: 9038.1. Samples: 963811448. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:33,785][121949] Avg episode reward: [(0, '6294.879'), (1, '5940.137')] [2023-12-26 14:40:33,821][123090] Updated weights for policy 1, policy_version 1876559 (0.0010) [2023-12-26 14:40:33,875][123090] Updated weights for policy 1, policy_version 1876569 (0.0010) [2023-12-26 14:40:34,224][123091] Updated weights for policy 0, policy_version 1888279 (0.0009) [2023-12-26 14:40:34,284][123091] Updated weights for policy 0, policy_version 1888289 (0.0009) [2023-12-26 14:40:34,348][123091] Updated weights for policy 0, policy_version 1888299 (0.0008) [2023-12-26 14:40:34,720][123090] Updated weights for policy 1, policy_version 1876579 (0.0010) [2023-12-26 14:40:34,781][123090] Updated weights for policy 1, policy_version 1876589 (0.0010) [2023-12-26 14:40:34,839][123090] Updated weights for policy 1, policy_version 1876599 (0.0010) [2023-12-26 14:40:35,190][123091] Updated weights for policy 0, policy_version 1888309 (0.0009) [2023-12-26 14:40:35,246][123091] Updated weights for policy 0, policy_version 1888319 (0.0009) [2023-12-26 14:40:35,294][123091] Updated weights for policy 0, policy_version 1888329 (0.0009) [2023-12-26 14:40:35,653][123090] Updated weights for policy 1, policy_version 1876609 (0.0010) [2023-12-26 14:40:35,712][123090] Updated weights for policy 1, policy_version 1876619 (0.0010) [2023-12-26 14:40:35,778][123090] Updated weights for policy 1, policy_version 1876629 (0.0010) [2023-12-26 14:40:35,840][123090] Updated weights for policy 1, policy_version 1876639 (0.0010) [2023-12-26 14:40:36,164][123091] Updated weights for policy 0, policy_version 1888340 (0.0010) [2023-12-26 14:40:36,220][123091] Updated weights for policy 0, policy_version 1888350 (0.0010) [2023-12-26 14:40:36,275][123091] Updated weights for policy 0, policy_version 1888360 (0.0010) [2023-12-26 14:40:36,592][123090] Updated weights for policy 1, policy_version 1876649 (0.0008) [2023-12-26 14:40:36,659][123090] Updated weights for policy 1, policy_version 1876659 (0.0009) [2023-12-26 14:40:36,722][123090] Updated weights for policy 1, policy_version 1876669 (0.0010) [2023-12-26 14:40:37,168][123091] Updated weights for policy 0, policy_version 1888370 (0.0009) [2023-12-26 14:40:37,235][123091] Updated weights for policy 0, policy_version 1888380 (0.0009) [2023-12-26 14:40:37,299][123091] Updated weights for policy 0, policy_version 1888390 (0.0009) [2023-12-26 14:40:37,358][123091] Updated weights for policy 0, policy_version 1888400 (0.0009) [2023-12-26 14:40:37,505][123090] Updated weights for policy 1, policy_version 1876679 (0.0010) [2023-12-26 14:40:37,565][123090] Updated weights for policy 1, policy_version 1876689 (0.0010) [2023-12-26 14:40:37,619][123090] Updated weights for policy 1, policy_version 1876699 (0.0010) [2023-12-26 14:40:38,135][123091] Updated weights for policy 0, policy_version 1888410 (0.0009) [2023-12-26 14:40:38,193][123091] Updated weights for policy 0, policy_version 1888420 (0.0010) [2023-12-26 14:40:38,246][123091] Updated weights for policy 0, policy_version 1888431 (0.0010) [2023-12-26 14:40:38,424][123090] Updated weights for policy 1, policy_version 1876709 (0.0010) [2023-12-26 14:40:38,491][123090] Updated weights for policy 1, policy_version 1876719 (0.0011) [2023-12-26 14:40:38,542][123090] Updated weights for policy 1, policy_version 1876729 (0.0010) [2023-12-26 14:40:38,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 963887104. Throughput: 0: 8816.4, 1: 9080.8. Samples: 963862920. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:38,785][121949] Avg episode reward: [(0, '6201.428'), (1, '5828.385')] [2023-12-26 14:40:38,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001888432_483442688.pth... [2023-12-26 14:40:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001876736_480444416.pth... [2023-12-26 14:40:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001887440_483188736.pth [2023-12-26 14:40:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001875680_480174080.pth [2023-12-26 14:40:39,122][123091] Updated weights for policy 0, policy_version 1888441 (0.0009) [2023-12-26 14:40:39,183][123091] Updated weights for policy 0, policy_version 1888451 (0.0009) [2023-12-26 14:40:39,258][123091] Updated weights for policy 0, policy_version 1888461 (0.0009) [2023-12-26 14:40:39,344][123090] Updated weights for policy 1, policy_version 1876739 (0.0010) [2023-12-26 14:40:39,418][123090] Updated weights for policy 1, policy_version 1876749 (0.0010) [2023-12-26 14:40:39,480][123090] Updated weights for policy 1, policy_version 1876759 (0.0010) [2023-12-26 14:40:40,080][123091] Updated weights for policy 0, policy_version 1888471 (0.0010) [2023-12-26 14:40:40,159][123091] Updated weights for policy 0, policy_version 1888481 (0.0010) [2023-12-26 14:40:40,239][123091] Updated weights for policy 0, policy_version 1888491 (0.0008) [2023-12-26 14:40:40,301][123090] Updated weights for policy 1, policy_version 1876769 (0.0010) [2023-12-26 14:40:40,373][123090] Updated weights for policy 1, policy_version 1876779 (0.0011) [2023-12-26 14:40:40,429][123090] Updated weights for policy 1, policy_version 1876789 (0.0010) [2023-12-26 14:40:40,482][123090] Updated weights for policy 1, policy_version 1876799 (0.0010) [2023-12-26 14:40:40,932][123091] Updated weights for policy 0, policy_version 1888501 (0.0006) [2023-12-26 14:40:40,988][123091] Updated weights for policy 0, policy_version 1888511 (0.0005) [2023-12-26 14:40:41,054][123091] Updated weights for policy 0, policy_version 1888521 (0.0007) [2023-12-26 14:40:41,302][123090] Updated weights for policy 1, policy_version 1876809 (0.0009) [2023-12-26 14:40:41,379][123090] Updated weights for policy 1, policy_version 1876819 (0.0009) [2023-12-26 14:40:41,452][123090] Updated weights for policy 1, policy_version 1876829 (0.0009) [2023-12-26 14:40:41,895][123091] Updated weights for policy 0, policy_version 1888531 (0.0009) [2023-12-26 14:40:41,961][123091] Updated weights for policy 0, policy_version 1888541 (0.0010) [2023-12-26 14:40:42,031][123091] Updated weights for policy 0, policy_version 1888551 (0.0009) [2023-12-26 14:40:42,188][123090] Updated weights for policy 1, policy_version 1876839 (0.0006) [2023-12-26 14:40:42,243][123090] Updated weights for policy 1, policy_version 1876849 (0.0008) [2023-12-26 14:40:42,316][123090] Updated weights for policy 1, policy_version 1876859 (0.0006) [2023-12-26 14:40:42,875][123091] Updated weights for policy 0, policy_version 1888561 (0.0010) [2023-12-26 14:40:42,932][123091] Updated weights for policy 0, policy_version 1888571 (0.0008) [2023-12-26 14:40:42,983][123091] Updated weights for policy 0, policy_version 1888581 (0.0009) [2023-12-26 14:40:43,042][123091] Updated weights for policy 0, policy_version 1888591 (0.0008) [2023-12-26 14:40:43,138][123090] Updated weights for policy 1, policy_version 1876869 (0.0010) [2023-12-26 14:40:43,193][123090] Updated weights for policy 1, policy_version 1876879 (0.0010) [2023-12-26 14:40:43,248][123090] Updated weights for policy 1, policy_version 1876889 (0.0010) [2023-12-26 14:40:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 963969024. Throughput: 0: 8718.6, 1: 8962.9. Samples: 963965976. Policy #0 lag: (min: 31.0, avg: 35.3, max: 63.0) [2023-12-26 14:40:43,784][121949] Avg episode reward: [(0, '6203.416'), (1, '5916.331')] [2023-12-26 14:40:43,897][123091] Updated weights for policy 0, policy_version 1888601 (0.0007) [2023-12-26 14:40:43,956][123091] Updated weights for policy 0, policy_version 1888611 (0.0009) [2023-12-26 14:40:44,015][123091] Updated weights for policy 0, policy_version 1888621 (0.0010) [2023-12-26 14:40:44,076][123090] Updated weights for policy 1, policy_version 1876899 (0.0009) [2023-12-26 14:40:44,137][123090] Updated weights for policy 1, policy_version 1876909 (0.0005) [2023-12-26 14:40:44,198][123090] Updated weights for policy 1, policy_version 1876919 (0.0006) [2023-12-26 14:40:44,852][123091] Updated weights for policy 0, policy_version 1888631 (0.0010) [2023-12-26 14:40:44,917][123090] Updated weights for policy 1, policy_version 1876929 (0.0009) [2023-12-26 14:40:44,920][123091] Updated weights for policy 0, policy_version 1888641 (0.0009) [2023-12-26 14:40:44,978][123090] Updated weights for policy 1, policy_version 1876939 (0.0007) [2023-12-26 14:40:44,984][123091] Updated weights for policy 0, policy_version 1888651 (0.0010) [2023-12-26 14:40:45,040][123090] Updated weights for policy 1, policy_version 1876949 (0.0008) [2023-12-26 14:40:45,111][123090] Updated weights for policy 1, policy_version 1876959 (0.0008) [2023-12-26 14:40:45,849][123090] Updated weights for policy 1, policy_version 1876969 (0.0006) [2023-12-26 14:40:45,861][123091] Updated weights for policy 0, policy_version 1888661 (0.0009) [2023-12-26 14:40:45,909][123090] Updated weights for policy 1, policy_version 1876979 (0.0005) [2023-12-26 14:40:45,924][123091] Updated weights for policy 0, policy_version 1888671 (0.0009) [2023-12-26 14:40:45,963][123090] Updated weights for policy 1, policy_version 1876989 (0.0005) [2023-12-26 14:40:45,984][123091] Updated weights for policy 0, policy_version 1888681 (0.0009) [2023-12-26 14:40:46,736][123090] Updated weights for policy 1, policy_version 1876999 (0.0007) [2023-12-26 14:40:46,797][123090] Updated weights for policy 1, policy_version 1877009 (0.0005) [2023-12-26 14:40:46,832][123091] Updated weights for policy 0, policy_version 1888691 (0.0010) [2023-12-26 14:40:46,855][123090] Updated weights for policy 1, policy_version 1877019 (0.0009) [2023-12-26 14:40:46,888][123091] Updated weights for policy 0, policy_version 1888701 (0.0007) [2023-12-26 14:40:46,958][123091] Updated weights for policy 0, policy_version 1888711 (0.0010) [2023-12-26 14:40:47,656][123090] Updated weights for policy 1, policy_version 1877029 (0.0009) [2023-12-26 14:40:47,723][123090] Updated weights for policy 1, policy_version 1877039 (0.0009) [2023-12-26 14:40:47,730][123091] Updated weights for policy 0, policy_version 1888721 (0.0009) [2023-12-26 14:40:47,786][123091] Updated weights for policy 0, policy_version 1888731 (0.0010) [2023-12-26 14:40:47,793][123090] Updated weights for policy 1, policy_version 1877049 (0.0008) [2023-12-26 14:40:47,845][123091] Updated weights for policy 0, policy_version 1888741 (0.0011) [2023-12-26 14:40:47,904][123091] Updated weights for policy 0, policy_version 1888751 (0.0011) [2023-12-26 14:40:48,576][123091] Updated weights for policy 0, policy_version 1888761 (0.0006) [2023-12-26 14:40:48,636][123091] Updated weights for policy 0, policy_version 1888771 (0.0006) [2023-12-26 14:40:48,639][123090] Updated weights for policy 1, policy_version 1877059 (0.0007) [2023-12-26 14:40:48,691][123091] Updated weights for policy 0, policy_version 1888781 (0.0006) [2023-12-26 14:40:48,720][123090] Updated weights for policy 1, policy_version 1877069 (0.0006) [2023-12-26 14:40:48,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 964059136. Throughput: 0: 8685.7, 1: 9028.3. Samples: 964072148. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:40:48,785][121949] Avg episode reward: [(0, '6271.634'), (1, '6114.379')] [2023-12-26 14:40:48,798][123090] Updated weights for policy 1, policy_version 1877079 (0.0006) [2023-12-26 14:40:49,495][123091] Updated weights for policy 0, policy_version 1888791 (0.0008) [2023-12-26 14:40:49,526][123090] Updated weights for policy 1, policy_version 1877089 (0.0009) [2023-12-26 14:40:49,555][123091] Updated weights for policy 0, policy_version 1888801 (0.0009) [2023-12-26 14:40:49,582][123090] Updated weights for policy 1, policy_version 1877099 (0.0008) [2023-12-26 14:40:49,616][123091] Updated weights for policy 0, policy_version 1888811 (0.0008) [2023-12-26 14:40:49,644][123090] Updated weights for policy 1, policy_version 1877109 (0.0008) [2023-12-26 14:40:49,705][123090] Updated weights for policy 1, policy_version 1877119 (0.0009) [2023-12-26 14:40:50,333][123091] Updated weights for policy 0, policy_version 1888821 (0.0006) [2023-12-26 14:40:50,395][123091] Updated weights for policy 0, policy_version 1888831 (0.0005) [2023-12-26 14:40:50,463][123091] Updated weights for policy 0, policy_version 1888841 (0.0008) [2023-12-26 14:40:50,523][123090] Updated weights for policy 1, policy_version 1877129 (0.0010) [2023-12-26 14:40:50,575][123090] Updated weights for policy 1, policy_version 1877139 (0.0010) [2023-12-26 14:40:50,644][123090] Updated weights for policy 1, policy_version 1877149 (0.0011) [2023-12-26 14:40:51,215][123091] Updated weights for policy 0, policy_version 1888851 (0.0008) [2023-12-26 14:40:51,268][123091] Updated weights for policy 0, policy_version 1888861 (0.0006) [2023-12-26 14:40:51,337][123091] Updated weights for policy 0, policy_version 1888871 (0.0009) [2023-12-26 14:40:51,525][123090] Updated weights for policy 1, policy_version 1877159 (0.0009) [2023-12-26 14:40:51,590][123090] Updated weights for policy 1, policy_version 1877169 (0.0010) [2023-12-26 14:40:51,659][123090] Updated weights for policy 1, policy_version 1877179 (0.0009) [2023-12-26 14:40:52,089][123091] Updated weights for policy 0, policy_version 1888881 (0.0009) [2023-12-26 14:40:52,150][123091] Updated weights for policy 0, policy_version 1888891 (0.0009) [2023-12-26 14:40:52,207][123091] Updated weights for policy 0, policy_version 1888901 (0.0010) [2023-12-26 14:40:52,265][123091] Updated weights for policy 0, policy_version 1888911 (0.0009) [2023-12-26 14:40:52,392][123090] Updated weights for policy 1, policy_version 1877189 (0.0007) [2023-12-26 14:40:52,460][123090] Updated weights for policy 1, policy_version 1877199 (0.0007) [2023-12-26 14:40:52,529][123090] Updated weights for policy 1, policy_version 1877209 (0.0005) [2023-12-26 14:40:53,114][123090] Updated weights for policy 1, policy_version 1877219 (0.0007) [2023-12-26 14:40:53,172][123090] Updated weights for policy 1, policy_version 1877229 (0.0010) [2023-12-26 14:40:53,191][123091] Updated weights for policy 0, policy_version 1888921 (0.0006) [2023-12-26 14:40:53,231][123090] Updated weights for policy 1, policy_version 1877239 (0.0010) [2023-12-26 14:40:53,244][123091] Updated weights for policy 0, policy_version 1888931 (0.0009) [2023-12-26 14:40:53,297][123091] Updated weights for policy 0, policy_version 1888941 (0.0007) [2023-12-26 14:40:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17772.5). Total num frames: 964149248. Throughput: 0: 8620.1, 1: 9007.4. Samples: 964125556. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:40:53,785][121949] Avg episode reward: [(0, '6314.229'), (1, '5807.764')] [2023-12-26 14:40:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001888944_483573760.pth... [2023-12-26 14:40:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001877248_480575488.pth... [2023-12-26 14:40:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001876192_480305152.pth [2023-12-26 14:40:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001887952_483319808.pth [2023-12-26 14:40:54,045][123090] Updated weights for policy 1, policy_version 1877249 (0.0010) [2023-12-26 14:40:54,107][123090] Updated weights for policy 1, policy_version 1877259 (0.0009) [2023-12-26 14:40:54,143][123091] Updated weights for policy 0, policy_version 1888952 (0.0010) [2023-12-26 14:40:54,168][123090] Updated weights for policy 1, policy_version 1877269 (0.0009) [2023-12-26 14:40:54,205][123091] Updated weights for policy 0, policy_version 1888962 (0.0006) [2023-12-26 14:40:54,224][123090] Updated weights for policy 1, policy_version 1877279 (0.0010) [2023-12-26 14:40:54,268][123091] Updated weights for policy 0, policy_version 1888972 (0.0007) [2023-12-26 14:40:54,985][123090] Updated weights for policy 1, policy_version 1877289 (0.0006) [2023-12-26 14:40:55,055][123090] Updated weights for policy 1, policy_version 1877299 (0.0005) [2023-12-26 14:40:55,118][123090] Updated weights for policy 1, policy_version 1877309 (0.0006) [2023-12-26 14:40:55,147][123091] Updated weights for policy 0, policy_version 1888982 (0.0008) [2023-12-26 14:40:55,200][123091] Updated weights for policy 0, policy_version 1888992 (0.0010) [2023-12-26 14:40:55,262][123091] Updated weights for policy 0, policy_version 1889002 (0.0009) [2023-12-26 14:40:55,790][123090] Updated weights for policy 1, policy_version 1877319 (0.0006) [2023-12-26 14:40:55,839][123090] Updated weights for policy 1, policy_version 1877329 (0.0006) [2023-12-26 14:40:55,886][123090] Updated weights for policy 1, policy_version 1877339 (0.0006) [2023-12-26 14:40:56,195][123091] Updated weights for policy 0, policy_version 1889012 (0.0010) [2023-12-26 14:40:56,252][123091] Updated weights for policy 0, policy_version 1889022 (0.0009) [2023-12-26 14:40:56,306][123091] Updated weights for policy 0, policy_version 1889032 (0.0010) [2023-12-26 14:40:56,505][123090] Updated weights for policy 1, policy_version 1877349 (0.0005) [2023-12-26 14:40:56,558][123090] Updated weights for policy 1, policy_version 1877359 (0.0005) [2023-12-26 14:40:56,605][123090] Updated weights for policy 1, policy_version 1877369 (0.0005) [2023-12-26 14:40:57,221][123091] Updated weights for policy 0, policy_version 1889042 (0.0010) [2023-12-26 14:40:57,273][123091] Updated weights for policy 0, policy_version 1889052 (0.0009) [2023-12-26 14:40:57,328][123091] Updated weights for policy 0, policy_version 1889062 (0.0008) [2023-12-26 14:40:57,346][123090] Updated weights for policy 1, policy_version 1877379 (0.0007) [2023-12-26 14:40:57,387][123091] Updated weights for policy 0, policy_version 1889072 (0.0007) [2023-12-26 14:40:57,400][123090] Updated weights for policy 1, policy_version 1877389 (0.0010) [2023-12-26 14:40:57,450][123090] Updated weights for policy 1, policy_version 1877399 (0.0010) [2023-12-26 14:40:58,205][123091] Updated weights for policy 0, policy_version 1889082 (0.0009) [2023-12-26 14:40:58,254][123091] Updated weights for policy 0, policy_version 1889092 (0.0009) [2023-12-26 14:40:58,284][123090] Updated weights for policy 1, policy_version 1877409 (0.0010) [2023-12-26 14:40:58,309][123091] Updated weights for policy 0, policy_version 1889102 (0.0008) [2023-12-26 14:40:58,356][123090] Updated weights for policy 1, policy_version 1877419 (0.0010) [2023-12-26 14:40:58,429][123090] Updated weights for policy 1, policy_version 1877429 (0.0013) [2023-12-26 14:40:58,482][123090] Updated weights for policy 1, policy_version 1877439 (0.0007) [2023-12-26 14:40:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 964239360. Throughput: 0: 8570.3, 1: 9135.9. Samples: 964232336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:40:58,784][121949] Avg episode reward: [(0, '6370.562'), (1, '5739.604')] [2023-12-26 14:40:59,285][123091] Updated weights for policy 0, policy_version 1889112 (0.0010) [2023-12-26 14:40:59,315][123090] Updated weights for policy 1, policy_version 1877449 (0.0006) [2023-12-26 14:40:59,343][123091] Updated weights for policy 0, policy_version 1889122 (0.0009) [2023-12-26 14:40:59,373][123090] Updated weights for policy 1, policy_version 1877459 (0.0006) [2023-12-26 14:40:59,407][123091] Updated weights for policy 0, policy_version 1889132 (0.0008) [2023-12-26 14:40:59,443][123090] Updated weights for policy 1, policy_version 1877469 (0.0008) [2023-12-26 14:41:00,186][123090] Updated weights for policy 1, policy_version 1877479 (0.0009) [2023-12-26 14:41:00,250][123090] Updated weights for policy 1, policy_version 1877489 (0.0005) [2023-12-26 14:41:00,265][123091] Updated weights for policy 0, policy_version 1889142 (0.0010) [2023-12-26 14:41:00,315][123090] Updated weights for policy 1, policy_version 1877499 (0.0006) [2023-12-26 14:41:00,320][123091] Updated weights for policy 0, policy_version 1889152 (0.0011) [2023-12-26 14:41:00,379][123091] Updated weights for policy 0, policy_version 1889162 (0.0010) [2023-12-26 14:41:01,117][123090] Updated weights for policy 1, policy_version 1877509 (0.0006) [2023-12-26 14:41:01,177][123090] Updated weights for policy 1, policy_version 1877519 (0.0009) [2023-12-26 14:41:01,178][123091] Updated weights for policy 0, policy_version 1889172 (0.0010) [2023-12-26 14:41:01,227][123091] Updated weights for policy 0, policy_version 1889182 (0.0005) [2023-12-26 14:41:01,231][123090] Updated weights for policy 1, policy_version 1877529 (0.0009) [2023-12-26 14:41:01,285][123091] Updated weights for policy 0, policy_version 1889192 (0.0006) [2023-12-26 14:41:02,071][123090] Updated weights for policy 1, policy_version 1877539 (0.0009) [2023-12-26 14:41:02,108][123091] Updated weights for policy 0, policy_version 1889202 (0.0006) [2023-12-26 14:41:02,136][123090] Updated weights for policy 1, policy_version 1877549 (0.0010) [2023-12-26 14:41:02,169][123091] Updated weights for policy 0, policy_version 1889212 (0.0007) [2023-12-26 14:41:02,201][123090] Updated weights for policy 1, policy_version 1877559 (0.0009) [2023-12-26 14:41:02,230][123091] Updated weights for policy 0, policy_version 1889222 (0.0007) [2023-12-26 14:41:02,299][123091] Updated weights for policy 0, policy_version 1889232 (0.0008) [2023-12-26 14:41:03,019][123090] Updated weights for policy 1, policy_version 1877569 (0.0009) [2023-12-26 14:41:03,088][123090] Updated weights for policy 1, policy_version 1877579 (0.0008) [2023-12-26 14:41:03,100][123091] Updated weights for policy 0, policy_version 1889242 (0.0008) [2023-12-26 14:41:03,146][123090] Updated weights for policy 1, policy_version 1877589 (0.0009) [2023-12-26 14:41:03,151][123091] Updated weights for policy 0, policy_version 1889252 (0.0007) [2023-12-26 14:41:03,201][123091] Updated weights for policy 0, policy_version 1889262 (0.0007) [2023-12-26 14:41:03,210][123090] Updated weights for policy 1, policy_version 1877599 (0.0009) [2023-12-26 14:41:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 964321280. Throughput: 0: 8503.6, 1: 9010.2. Samples: 964334484. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:03,785][121949] Avg episode reward: [(0, '6346.101'), (1, '5832.905')] [2023-12-26 14:41:04,035][123090] Updated weights for policy 1, policy_version 1877609 (0.0009) [2023-12-26 14:41:04,049][123091] Updated weights for policy 0, policy_version 1889272 (0.0010) [2023-12-26 14:41:04,091][123090] Updated weights for policy 1, policy_version 1877619 (0.0009) [2023-12-26 14:41:04,112][123091] Updated weights for policy 0, policy_version 1889282 (0.0007) [2023-12-26 14:41:04,157][123090] Updated weights for policy 1, policy_version 1877629 (0.0010) [2023-12-26 14:41:04,172][123091] Updated weights for policy 0, policy_version 1889292 (0.0007) [2023-12-26 14:41:04,924][123091] Updated weights for policy 0, policy_version 1889302 (0.0008) [2023-12-26 14:41:04,974][123091] Updated weights for policy 0, policy_version 1889312 (0.0010) [2023-12-26 14:41:05,031][123091] Updated weights for policy 0, policy_version 1889322 (0.0009) [2023-12-26 14:41:05,043][123090] Updated weights for policy 1, policy_version 1877639 (0.0007) [2023-12-26 14:41:05,101][123090] Updated weights for policy 1, policy_version 1877649 (0.0008) [2023-12-26 14:41:05,167][123090] Updated weights for policy 1, policy_version 1877659 (0.0010) [2023-12-26 14:41:05,846][123091] Updated weights for policy 0, policy_version 1889332 (0.0008) [2023-12-26 14:41:05,899][123091] Updated weights for policy 0, policy_version 1889342 (0.0006) [2023-12-26 14:41:05,943][123091] Updated weights for policy 0, policy_version 1889352 (0.0005) [2023-12-26 14:41:06,013][123090] Updated weights for policy 1, policy_version 1877669 (0.0010) [2023-12-26 14:41:06,078][123090] Updated weights for policy 1, policy_version 1877679 (0.0010) [2023-12-26 14:41:06,148][123090] Updated weights for policy 1, policy_version 1877689 (0.0007) [2023-12-26 14:41:06,694][123091] Updated weights for policy 0, policy_version 1889362 (0.0006) [2023-12-26 14:41:06,760][123091] Updated weights for policy 0, policy_version 1889372 (0.0009) [2023-12-26 14:41:06,826][123091] Updated weights for policy 0, policy_version 1889382 (0.0009) [2023-12-26 14:41:06,895][123091] Updated weights for policy 0, policy_version 1889392 (0.0005) [2023-12-26 14:41:06,958][123090] Updated weights for policy 1, policy_version 1877699 (0.0007) [2023-12-26 14:41:07,024][123090] Updated weights for policy 1, policy_version 1877709 (0.0010) [2023-12-26 14:41:07,094][123090] Updated weights for policy 1, policy_version 1877719 (0.0010) [2023-12-26 14:41:07,581][123091] Updated weights for policy 0, policy_version 1889402 (0.0011) [2023-12-26 14:41:07,643][123091] Updated weights for policy 0, policy_version 1889412 (0.0010) [2023-12-26 14:41:07,701][123091] Updated weights for policy 0, policy_version 1889422 (0.0010) [2023-12-26 14:41:07,982][123090] Updated weights for policy 1, policy_version 1877729 (0.0010) [2023-12-26 14:41:08,040][123090] Updated weights for policy 1, policy_version 1877739 (0.0009) [2023-12-26 14:41:08,104][123090] Updated weights for policy 1, policy_version 1877749 (0.0009) [2023-12-26 14:41:08,174][123090] Updated weights for policy 1, policy_version 1877759 (0.0008) [2023-12-26 14:41:08,439][123091] Updated weights for policy 0, policy_version 1889432 (0.0010) [2023-12-26 14:41:08,505][123091] Updated weights for policy 0, policy_version 1889442 (0.0006) [2023-12-26 14:41:08,581][123091] Updated weights for policy 0, policy_version 1889452 (0.0008) [2023-12-26 14:41:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 964411392. Throughput: 0: 8506.8, 1: 9018.3. Samples: 964386968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:08,785][121949] Avg episode reward: [(0, '6362.035'), (1, '5701.005')] [2023-12-26 14:41:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001889456_483704832.pth... [2023-12-26 14:41:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001877760_480706560.pth... [2023-12-26 14:41:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001888432_483442688.pth [2023-12-26 14:41:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001876736_480444416.pth [2023-12-26 14:41:09,000][123090] Updated weights for policy 1, policy_version 1877769 (0.0009) [2023-12-26 14:41:09,054][123090] Updated weights for policy 1, policy_version 1877779 (0.0009) [2023-12-26 14:41:09,107][123090] Updated weights for policy 1, policy_version 1877789 (0.0009) [2023-12-26 14:41:09,375][123091] Updated weights for policy 0, policy_version 1889462 (0.0011) [2023-12-26 14:41:09,443][123091] Updated weights for policy 0, policy_version 1889472 (0.0006) [2023-12-26 14:41:09,509][123091] Updated weights for policy 0, policy_version 1889482 (0.0006) [2023-12-26 14:41:10,024][123090] Updated weights for policy 1, policy_version 1877799 (0.0009) [2023-12-26 14:41:10,084][123090] Updated weights for policy 1, policy_version 1877809 (0.0006) [2023-12-26 14:41:10,147][123090] Updated weights for policy 1, policy_version 1877819 (0.0005) [2023-12-26 14:41:10,267][123091] Updated weights for policy 0, policy_version 1889492 (0.0010) [2023-12-26 14:41:10,326][123091] Updated weights for policy 0, policy_version 1889502 (0.0010) [2023-12-26 14:41:10,381][123091] Updated weights for policy 0, policy_version 1889512 (0.0010) [2023-12-26 14:41:10,918][123090] Updated weights for policy 1, policy_version 1877829 (0.0005) [2023-12-26 14:41:10,983][123090] Updated weights for policy 1, policy_version 1877839 (0.0006) [2023-12-26 14:41:11,044][123090] Updated weights for policy 1, policy_version 1877849 (0.0006) [2023-12-26 14:41:11,224][123091] Updated weights for policy 0, policy_version 1889522 (0.0010) [2023-12-26 14:41:11,288][123091] Updated weights for policy 0, policy_version 1889532 (0.0008) [2023-12-26 14:41:11,357][123091] Updated weights for policy 0, policy_version 1889542 (0.0011) [2023-12-26 14:41:11,427][123091] Updated weights for policy 0, policy_version 1889552 (0.0010) [2023-12-26 14:41:11,855][123090] Updated weights for policy 1, policy_version 1877859 (0.0007) [2023-12-26 14:41:11,909][123090] Updated weights for policy 1, policy_version 1877869 (0.0009) [2023-12-26 14:41:11,973][123090] Updated weights for policy 1, policy_version 1877879 (0.0009) [2023-12-26 14:41:12,274][123091] Updated weights for policy 0, policy_version 1889562 (0.0009) [2023-12-26 14:41:12,339][123091] Updated weights for policy 0, policy_version 1889572 (0.0009) [2023-12-26 14:41:12,407][123091] Updated weights for policy 0, policy_version 1889582 (0.0008) [2023-12-26 14:41:12,832][123090] Updated weights for policy 1, policy_version 1877889 (0.0010) [2023-12-26 14:41:12,892][123090] Updated weights for policy 1, policy_version 1877899 (0.0007) [2023-12-26 14:41:12,952][123090] Updated weights for policy 1, policy_version 1877909 (0.0005) [2023-12-26 14:41:13,013][123090] Updated weights for policy 1, policy_version 1877919 (0.0006) [2023-12-26 14:41:13,262][123091] Updated weights for policy 0, policy_version 1889592 (0.0009) [2023-12-26 14:41:13,314][123091] Updated weights for policy 0, policy_version 1889602 (0.0009) [2023-12-26 14:41:13,367][123091] Updated weights for policy 0, policy_version 1889612 (0.0009) [2023-12-26 14:41:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17689.2). Total num frames: 964493312. Throughput: 0: 8576.2, 1: 8870.5. Samples: 964490076. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:13,785][121949] Avg episode reward: [(0, '6362.618'), (1, '5720.346')] [2023-12-26 14:41:13,801][123090] Updated weights for policy 1, policy_version 1877929 (0.0009) [2023-12-26 14:41:13,860][123090] Updated weights for policy 1, policy_version 1877939 (0.0010) [2023-12-26 14:41:13,913][123090] Updated weights for policy 1, policy_version 1877950 (0.0010) [2023-12-26 14:41:14,158][123091] Updated weights for policy 0, policy_version 1889622 (0.0010) [2023-12-26 14:41:14,210][123091] Updated weights for policy 0, policy_version 1889632 (0.0009) [2023-12-26 14:41:14,257][123091] Updated weights for policy 0, policy_version 1889642 (0.0009) [2023-12-26 14:41:14,798][123090] Updated weights for policy 1, policy_version 1877960 (0.0010) [2023-12-26 14:41:14,865][123090] Updated weights for policy 1, policy_version 1877970 (0.0009) [2023-12-26 14:41:14,936][123090] Updated weights for policy 1, policy_version 1877980 (0.0009) [2023-12-26 14:41:15,110][123091] Updated weights for policy 0, policy_version 1889652 (0.0010) [2023-12-26 14:41:15,161][123091] Updated weights for policy 0, policy_version 1889662 (0.0010) [2023-12-26 14:41:15,236][123091] Updated weights for policy 0, policy_version 1889672 (0.0006) [2023-12-26 14:41:15,808][123090] Updated weights for policy 1, policy_version 1877990 (0.0010) [2023-12-26 14:41:15,861][123091] Updated weights for policy 0, policy_version 1889682 (0.0006) [2023-12-26 14:41:15,865][123090] Updated weights for policy 1, policy_version 1878000 (0.0009) [2023-12-26 14:41:15,919][123091] Updated weights for policy 0, policy_version 1889692 (0.0006) [2023-12-26 14:41:15,924][123090] Updated weights for policy 1, policy_version 1878010 (0.0009) [2023-12-26 14:41:15,969][123091] Updated weights for policy 0, policy_version 1889702 (0.0009) [2023-12-26 14:41:16,021][123091] Updated weights for policy 0, policy_version 1889712 (0.0009) [2023-12-26 14:41:16,754][123090] Updated weights for policy 1, policy_version 1878020 (0.0008) [2023-12-26 14:41:16,818][123090] Updated weights for policy 1, policy_version 1878030 (0.0009) [2023-12-26 14:41:16,868][123091] Updated weights for policy 0, policy_version 1889722 (0.0008) [2023-12-26 14:41:16,879][123090] Updated weights for policy 1, policy_version 1878040 (0.0008) [2023-12-26 14:41:16,930][123091] Updated weights for policy 0, policy_version 1889732 (0.0009) [2023-12-26 14:41:17,004][123091] Updated weights for policy 0, policy_version 1889742 (0.0006) [2023-12-26 14:41:17,498][123090] Updated weights for policy 1, policy_version 1878050 (0.0007) [2023-12-26 14:41:17,558][123090] Updated weights for policy 1, policy_version 1878060 (0.0005) [2023-12-26 14:41:17,612][123090] Updated weights for policy 1, policy_version 1878070 (0.0005) [2023-12-26 14:41:17,649][123091] Updated weights for policy 0, policy_version 1889752 (0.0005) [2023-12-26 14:41:17,671][123090] Updated weights for policy 1, policy_version 1878080 (0.0005) [2023-12-26 14:41:17,703][123091] Updated weights for policy 0, policy_version 1889762 (0.0005) [2023-12-26 14:41:17,774][123091] Updated weights for policy 0, policy_version 1889772 (0.0005) [2023-12-26 14:41:18,360][123090] Updated weights for policy 1, policy_version 1878090 (0.0008) [2023-12-26 14:41:18,425][123090] Updated weights for policy 1, policy_version 1878100 (0.0010) [2023-12-26 14:41:18,486][123090] Updated weights for policy 1, policy_version 1878110 (0.0009) [2023-12-26 14:41:18,566][123091] Updated weights for policy 0, policy_version 1889782 (0.0006) [2023-12-26 14:41:18,635][123091] Updated weights for policy 0, policy_version 1889792 (0.0007) [2023-12-26 14:41:18,691][123091] Updated weights for policy 0, policy_version 1889802 (0.0011) [2023-12-26 14:41:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 964591616. Throughput: 0: 8678.4, 1: 8799.7. Samples: 964597960. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:18,784][121949] Avg episode reward: [(0, '6365.671'), (1, '5803.926')] [2023-12-26 14:41:19,336][123091] Updated weights for policy 0, policy_version 1889812 (0.0011) [2023-12-26 14:41:19,395][123090] Updated weights for policy 1, policy_version 1878120 (0.0008) [2023-12-26 14:41:19,397][123091] Updated weights for policy 0, policy_version 1889822 (0.0010) [2023-12-26 14:41:19,445][123091] Updated weights for policy 0, policy_version 1889832 (0.0010) [2023-12-26 14:41:19,460][123090] Updated weights for policy 1, policy_version 1878130 (0.0007) [2023-12-26 14:41:19,529][123090] Updated weights for policy 1, policy_version 1878140 (0.0009) [2023-12-26 14:41:20,350][123091] Updated weights for policy 0, policy_version 1889842 (0.0009) [2023-12-26 14:41:20,409][123091] Updated weights for policy 0, policy_version 1889852 (0.0011) [2023-12-26 14:41:20,416][123090] Updated weights for policy 1, policy_version 1878150 (0.0009) [2023-12-26 14:41:20,471][123091] Updated weights for policy 0, policy_version 1889862 (0.0007) [2023-12-26 14:41:20,472][123090] Updated weights for policy 1, policy_version 1878160 (0.0008) [2023-12-26 14:41:20,522][123090] Updated weights for policy 1, policy_version 1878170 (0.0009) [2023-12-26 14:41:20,540][123091] Updated weights for policy 0, policy_version 1889872 (0.0005) [2023-12-26 14:41:21,311][123091] Updated weights for policy 0, policy_version 1889882 (0.0011) [2023-12-26 14:41:21,396][123090] Updated weights for policy 1, policy_version 1878180 (0.0010) [2023-12-26 14:41:21,402][123091] Updated weights for policy 0, policy_version 1889892 (0.0010) [2023-12-26 14:41:21,453][123090] Updated weights for policy 1, policy_version 1878190 (0.0006) [2023-12-26 14:41:21,454][123091] Updated weights for policy 0, policy_version 1889902 (0.0011) [2023-12-26 14:41:21,516][123090] Updated weights for policy 1, policy_version 1878200 (0.0008) [2023-12-26 14:41:22,276][123091] Updated weights for policy 0, policy_version 1889912 (0.0009) [2023-12-26 14:41:22,348][123091] Updated weights for policy 0, policy_version 1889922 (0.0009) [2023-12-26 14:41:22,368][123090] Updated weights for policy 1, policy_version 1878210 (0.0009) [2023-12-26 14:41:22,406][123091] Updated weights for policy 0, policy_version 1889932 (0.0006) [2023-12-26 14:41:22,424][123090] Updated weights for policy 1, policy_version 1878220 (0.0011) [2023-12-26 14:41:22,485][123090] Updated weights for policy 1, policy_version 1878230 (0.0010) [2023-12-26 14:41:22,556][123090] Updated weights for policy 1, policy_version 1878240 (0.0011) [2023-12-26 14:41:23,169][123091] Updated weights for policy 0, policy_version 1889942 (0.0005) [2023-12-26 14:41:23,230][123091] Updated weights for policy 0, policy_version 1889952 (0.0008) [2023-12-26 14:41:23,301][123091] Updated weights for policy 0, policy_version 1889962 (0.0009) [2023-12-26 14:41:23,323][123090] Updated weights for policy 1, policy_version 1878250 (0.0006) [2023-12-26 14:41:23,377][123090] Updated weights for policy 1, policy_version 1878260 (0.0006) [2023-12-26 14:41:23,436][123090] Updated weights for policy 1, policy_version 1878270 (0.0007) [2023-12-26 14:41:23,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 964673536. Throughput: 0: 8716.3, 1: 8740.6. Samples: 964648476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:23,784][121949] Avg episode reward: [(0, '6248.877'), (1, '5967.216')] [2023-12-26 14:41:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001889968_483835904.pth... [2023-12-26 14:41:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001878272_480837632.pth... [2023-12-26 14:41:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001877248_480575488.pth [2023-12-26 14:41:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001888944_483573760.pth [2023-12-26 14:41:24,083][123091] Updated weights for policy 0, policy_version 1889972 (0.0009) [2023-12-26 14:41:24,149][123091] Updated weights for policy 0, policy_version 1889982 (0.0007) [2023-12-26 14:41:24,151][123090] Updated weights for policy 1, policy_version 1878280 (0.0007) [2023-12-26 14:41:24,202][123091] Updated weights for policy 0, policy_version 1889992 (0.0005) [2023-12-26 14:41:24,207][123090] Updated weights for policy 1, policy_version 1878290 (0.0005) [2023-12-26 14:41:24,275][123090] Updated weights for policy 1, policy_version 1878300 (0.0006) [2023-12-26 14:41:25,021][123091] Updated weights for policy 0, policy_version 1890002 (0.0006) [2023-12-26 14:41:25,027][123090] Updated weights for policy 1, policy_version 1878310 (0.0007) [2023-12-26 14:41:25,080][123090] Updated weights for policy 1, policy_version 1878320 (0.0006) [2023-12-26 14:41:25,087][123091] Updated weights for policy 0, policy_version 1890012 (0.0009) [2023-12-26 14:41:25,133][123090] Updated weights for policy 1, policy_version 1878330 (0.0007) [2023-12-26 14:41:25,157][123091] Updated weights for policy 0, policy_version 1890022 (0.0009) [2023-12-26 14:41:25,212][123091] Updated weights for policy 0, policy_version 1890032 (0.0010) [2023-12-26 14:41:25,835][123090] Updated weights for policy 1, policy_version 1878340 (0.0007) [2023-12-26 14:41:25,901][123090] Updated weights for policy 1, policy_version 1878350 (0.0005) [2023-12-26 14:41:25,965][123090] Updated weights for policy 1, policy_version 1878360 (0.0007) [2023-12-26 14:41:26,032][123091] Updated weights for policy 0, policy_version 1890042 (0.0010) [2023-12-26 14:41:26,092][123091] Updated weights for policy 0, policy_version 1890052 (0.0010) [2023-12-26 14:41:26,143][123091] Updated weights for policy 0, policy_version 1890062 (0.0010) [2023-12-26 14:41:26,706][123090] Updated weights for policy 1, policy_version 1878370 (0.0009) [2023-12-26 14:41:26,757][123090] Updated weights for policy 1, policy_version 1878380 (0.0009) [2023-12-26 14:41:26,807][123090] Updated weights for policy 1, policy_version 1878391 (0.0008) [2023-12-26 14:41:26,931][123091] Updated weights for policy 0, policy_version 1890072 (0.0006) [2023-12-26 14:41:26,987][123091] Updated weights for policy 0, policy_version 1890082 (0.0005) [2023-12-26 14:41:27,041][123091] Updated weights for policy 0, policy_version 1890092 (0.0005) [2023-12-26 14:41:27,617][123090] Updated weights for policy 1, policy_version 1878401 (0.0007) [2023-12-26 14:41:27,665][123090] Updated weights for policy 1, policy_version 1878411 (0.0009) [2023-12-26 14:41:27,713][123090] Updated weights for policy 1, policy_version 1878421 (0.0009) [2023-12-26 14:41:27,777][123090] Updated weights for policy 1, policy_version 1878431 (0.0009) [2023-12-26 14:41:27,797][123091] Updated weights for policy 0, policy_version 1890102 (0.0009) [2023-12-26 14:41:27,852][123091] Updated weights for policy 0, policy_version 1890112 (0.0005) [2023-12-26 14:41:27,906][123091] Updated weights for policy 0, policy_version 1890122 (0.0005) [2023-12-26 14:41:28,541][123090] Updated weights for policy 1, policy_version 1878441 (0.0009) [2023-12-26 14:41:28,605][123090] Updated weights for policy 1, policy_version 1878451 (0.0010) [2023-12-26 14:41:28,639][123091] Updated weights for policy 0, policy_version 1890132 (0.0007) [2023-12-26 14:41:28,673][123090] Updated weights for policy 1, policy_version 1878461 (0.0009) [2023-12-26 14:41:28,704][123091] Updated weights for policy 0, policy_version 1890142 (0.0010) [2023-12-26 14:41:28,778][123091] Updated weights for policy 0, policy_version 1890152 (0.0010) [2023-12-26 14:41:28,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 964763648. Throughput: 0: 8770.3, 1: 8817.0. Samples: 964757408. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:28,785][121949] Avg episode reward: [(0, '6161.089'), (1, '6035.260')] [2023-12-26 14:41:29,496][123090] Updated weights for policy 1, policy_version 1878471 (0.0010) [2023-12-26 14:41:29,557][123090] Updated weights for policy 1, policy_version 1878481 (0.0010) [2023-12-26 14:41:29,598][123091] Updated weights for policy 0, policy_version 1890162 (0.0009) [2023-12-26 14:41:29,614][123090] Updated weights for policy 1, policy_version 1878491 (0.0008) [2023-12-26 14:41:29,652][123091] Updated weights for policy 0, policy_version 1890172 (0.0008) [2023-12-26 14:41:29,707][123091] Updated weights for policy 0, policy_version 1890182 (0.0009) [2023-12-26 14:41:29,760][123091] Updated weights for policy 0, policy_version 1890192 (0.0010) [2023-12-26 14:41:30,447][123090] Updated weights for policy 1, policy_version 1878501 (0.0009) [2023-12-26 14:41:30,497][123090] Updated weights for policy 1, policy_version 1878511 (0.0009) [2023-12-26 14:41:30,550][123090] Updated weights for policy 1, policy_version 1878521 (0.0008) [2023-12-26 14:41:30,584][123091] Updated weights for policy 0, policy_version 1890202 (0.0008) [2023-12-26 14:41:30,641][123091] Updated weights for policy 0, policy_version 1890212 (0.0010) [2023-12-26 14:41:30,693][123091] Updated weights for policy 0, policy_version 1890222 (0.0009) [2023-12-26 14:41:31,416][123090] Updated weights for policy 1, policy_version 1878532 (0.0010) [2023-12-26 14:41:31,464][123090] Updated weights for policy 1, policy_version 1878542 (0.0009) [2023-12-26 14:41:31,515][123090] Updated weights for policy 1, policy_version 1878552 (0.0009) [2023-12-26 14:41:31,536][123091] Updated weights for policy 0, policy_version 1890232 (0.0008) [2023-12-26 14:41:31,589][123091] Updated weights for policy 0, policy_version 1890242 (0.0008) [2023-12-26 14:41:31,659][123091] Updated weights for policy 0, policy_version 1890252 (0.0009) [2023-12-26 14:41:32,338][123090] Updated weights for policy 1, policy_version 1878562 (0.0007) [2023-12-26 14:41:32,409][123090] Updated weights for policy 1, policy_version 1878572 (0.0007) [2023-12-26 14:41:32,471][123090] Updated weights for policy 1, policy_version 1878582 (0.0009) [2023-12-26 14:41:32,480][123091] Updated weights for policy 0, policy_version 1890262 (0.0009) [2023-12-26 14:41:32,530][123091] Updated weights for policy 0, policy_version 1890272 (0.0008) [2023-12-26 14:41:32,531][123090] Updated weights for policy 1, policy_version 1878592 (0.0008) [2023-12-26 14:41:32,580][123091] Updated weights for policy 0, policy_version 1890282 (0.0007) [2023-12-26 14:41:33,193][123091] Updated weights for policy 0, policy_version 1890292 (0.0007) [2023-12-26 14:41:33,251][123091] Updated weights for policy 0, policy_version 1890302 (0.0009) [2023-12-26 14:41:33,307][123091] Updated weights for policy 0, policy_version 1890312 (0.0008) [2023-12-26 14:41:33,381][123090] Updated weights for policy 1, policy_version 1878602 (0.0007) [2023-12-26 14:41:33,429][123090] Updated weights for policy 1, policy_version 1878612 (0.0009) [2023-12-26 14:41:33,475][123090] Updated weights for policy 1, policy_version 1878622 (0.0008) [2023-12-26 14:41:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 964853760. Throughput: 0: 8802.7, 1: 8776.7. Samples: 964863220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:33,785][121949] Avg episode reward: [(0, '6257.614'), (1, '5866.774')] [2023-12-26 14:41:34,095][123091] Updated weights for policy 0, policy_version 1890322 (0.0009) [2023-12-26 14:41:34,153][123091] Updated weights for policy 0, policy_version 1890332 (0.0010) [2023-12-26 14:41:34,217][123091] Updated weights for policy 0, policy_version 1890342 (0.0009) [2023-12-26 14:41:34,288][123091] Updated weights for policy 0, policy_version 1890352 (0.0008) [2023-12-26 14:41:34,350][123090] Updated weights for policy 1, policy_version 1878632 (0.0010) [2023-12-26 14:41:34,414][123090] Updated weights for policy 1, policy_version 1878642 (0.0010) [2023-12-26 14:41:34,473][123090] Updated weights for policy 1, policy_version 1878652 (0.0010) [2023-12-26 14:41:35,070][123091] Updated weights for policy 0, policy_version 1890362 (0.0010) [2023-12-26 14:41:35,126][123091] Updated weights for policy 0, policy_version 1890372 (0.0009) [2023-12-26 14:41:35,174][123091] Updated weights for policy 0, policy_version 1890382 (0.0008) [2023-12-26 14:41:35,308][123090] Updated weights for policy 1, policy_version 1878662 (0.0010) [2023-12-26 14:41:35,359][123090] Updated weights for policy 1, policy_version 1878672 (0.0010) [2023-12-26 14:41:35,421][123090] Updated weights for policy 1, policy_version 1878682 (0.0010) [2023-12-26 14:41:35,853][123091] Updated weights for policy 0, policy_version 1890392 (0.0006) [2023-12-26 14:41:35,901][123091] Updated weights for policy 0, policy_version 1890402 (0.0005) [2023-12-26 14:41:35,956][123091] Updated weights for policy 0, policy_version 1890412 (0.0005) [2023-12-26 14:41:36,357][123090] Updated weights for policy 1, policy_version 1878692 (0.0010) [2023-12-26 14:41:36,421][123090] Updated weights for policy 1, policy_version 1878702 (0.0010) [2023-12-26 14:41:36,490][123090] Updated weights for policy 1, policy_version 1878712 (0.0010) [2023-12-26 14:41:36,688][123091] Updated weights for policy 0, policy_version 1890422 (0.0007) [2023-12-26 14:41:36,747][123091] Updated weights for policy 0, policy_version 1890432 (0.0010) [2023-12-26 14:41:36,814][123091] Updated weights for policy 0, policy_version 1890442 (0.0009) [2023-12-26 14:41:37,259][123090] Updated weights for policy 1, policy_version 1878722 (0.0010) [2023-12-26 14:41:37,333][123090] Updated weights for policy 1, policy_version 1878732 (0.0009) [2023-12-26 14:41:37,408][123090] Updated weights for policy 1, policy_version 1878742 (0.0010) [2023-12-26 14:41:37,468][123090] Updated weights for policy 1, policy_version 1878752 (0.0010) [2023-12-26 14:41:37,629][123091] Updated weights for policy 0, policy_version 1890452 (0.0010) [2023-12-26 14:41:37,683][123091] Updated weights for policy 0, policy_version 1890462 (0.0006) [2023-12-26 14:41:37,753][123091] Updated weights for policy 0, policy_version 1890472 (0.0006) [2023-12-26 14:41:38,224][123090] Updated weights for policy 1, policy_version 1878762 (0.0011) [2023-12-26 14:41:38,292][123090] Updated weights for policy 1, policy_version 1878772 (0.0010) [2023-12-26 14:41:38,360][123090] Updated weights for policy 1, policy_version 1878782 (0.0011) [2023-12-26 14:41:38,545][123091] Updated weights for policy 0, policy_version 1890482 (0.0009) [2023-12-26 14:41:38,594][123091] Updated weights for policy 0, policy_version 1890492 (0.0009) [2023-12-26 14:41:38,643][123091] Updated weights for policy 0, policy_version 1890502 (0.0008) [2023-12-26 14:41:38,692][123091] Updated weights for policy 0, policy_version 1890512 (0.0009) [2023-12-26 14:41:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17772.5). Total num frames: 964943872. Throughput: 0: 8816.6, 1: 8740.2. Samples: 964915612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:38,785][121949] Avg episode reward: [(0, '6387.444'), (1, '5872.013')] [2023-12-26 14:41:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001890512_483975168.pth... [2023-12-26 14:41:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001878784_480968704.pth... [2023-12-26 14:41:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001877760_480706560.pth [2023-12-26 14:41:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001889456_483704832.pth [2023-12-26 14:41:39,175][123090] Updated weights for policy 1, policy_version 1878792 (0.0010) [2023-12-26 14:41:39,246][123090] Updated weights for policy 1, policy_version 1878802 (0.0009) [2023-12-26 14:41:39,312][123090] Updated weights for policy 1, policy_version 1878812 (0.0008) [2023-12-26 14:41:39,591][123091] Updated weights for policy 0, policy_version 1890522 (0.0010) [2023-12-26 14:41:39,652][123091] Updated weights for policy 0, policy_version 1890532 (0.0010) [2023-12-26 14:41:39,715][123091] Updated weights for policy 0, policy_version 1890542 (0.0010) [2023-12-26 14:41:40,134][123090] Updated weights for policy 1, policy_version 1878822 (0.0008) [2023-12-26 14:41:40,186][123090] Updated weights for policy 1, policy_version 1878832 (0.0006) [2023-12-26 14:41:40,245][123090] Updated weights for policy 1, policy_version 1878842 (0.0007) [2023-12-26 14:41:40,563][123091] Updated weights for policy 0, policy_version 1890552 (0.0008) [2023-12-26 14:41:40,639][123091] Updated weights for policy 0, policy_version 1890562 (0.0010) [2023-12-26 14:41:40,693][123091] Updated weights for policy 0, policy_version 1890572 (0.0009) [2023-12-26 14:41:40,969][123090] Updated weights for policy 1, policy_version 1878852 (0.0010) [2023-12-26 14:41:41,017][123090] Updated weights for policy 1, policy_version 1878862 (0.0009) [2023-12-26 14:41:41,109][123090] Updated weights for policy 1, policy_version 1878872 (0.0009) [2023-12-26 14:41:41,534][123091] Updated weights for policy 0, policy_version 1890582 (0.0010) [2023-12-26 14:41:41,587][123091] Updated weights for policy 0, policy_version 1890592 (0.0009) [2023-12-26 14:41:41,649][123091] Updated weights for policy 0, policy_version 1890602 (0.0009) [2023-12-26 14:41:41,967][123090] Updated weights for policy 1, policy_version 1878882 (0.0009) [2023-12-26 14:41:42,030][123090] Updated weights for policy 1, policy_version 1878892 (0.0009) [2023-12-26 14:41:42,094][123090] Updated weights for policy 1, policy_version 1878902 (0.0009) [2023-12-26 14:41:42,160][123090] Updated weights for policy 1, policy_version 1878912 (0.0010) [2023-12-26 14:41:42,445][123091] Updated weights for policy 0, policy_version 1890612 (0.0009) [2023-12-26 14:41:42,505][123091] Updated weights for policy 0, policy_version 1890622 (0.0010) [2023-12-26 14:41:42,557][123091] Updated weights for policy 0, policy_version 1890633 (0.0009) [2023-12-26 14:41:42,982][123090] Updated weights for policy 1, policy_version 1878922 (0.0007) [2023-12-26 14:41:43,029][123090] Updated weights for policy 1, policy_version 1878932 (0.0005) [2023-12-26 14:41:43,086][123090] Updated weights for policy 1, policy_version 1878942 (0.0005) [2023-12-26 14:41:43,411][123091] Updated weights for policy 0, policy_version 1890643 (0.0010) [2023-12-26 14:41:43,456][123091] Updated weights for policy 0, policy_version 1890653 (0.0007) [2023-12-26 14:41:43,509][123091] Updated weights for policy 0, policy_version 1890663 (0.0006) [2023-12-26 14:41:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 965025792. Throughput: 0: 8865.2, 1: 8620.1. Samples: 965019176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:43,784][121949] Avg episode reward: [(0, '6376.919'), (1, '5852.739')] [2023-12-26 14:41:43,901][123090] Updated weights for policy 1, policy_version 1878952 (0.0008) [2023-12-26 14:41:43,980][123090] Updated weights for policy 1, policy_version 1878962 (0.0010) [2023-12-26 14:41:44,050][123090] Updated weights for policy 1, policy_version 1878972 (0.0009) [2023-12-26 14:41:44,291][123091] Updated weights for policy 0, policy_version 1890673 (0.0005) [2023-12-26 14:41:44,340][123091] Updated weights for policy 0, policy_version 1890683 (0.0006) [2023-12-26 14:41:44,396][123091] Updated weights for policy 0, policy_version 1890693 (0.0005) [2023-12-26 14:41:44,457][123091] Updated weights for policy 0, policy_version 1890703 (0.0006) [2023-12-26 14:41:44,811][123090] Updated weights for policy 1, policy_version 1878982 (0.0008) [2023-12-26 14:41:44,873][123090] Updated weights for policy 1, policy_version 1878992 (0.0007) [2023-12-26 14:41:44,938][123090] Updated weights for policy 1, policy_version 1879002 (0.0009) [2023-12-26 14:41:45,170][123091] Updated weights for policy 0, policy_version 1890713 (0.0007) [2023-12-26 14:41:45,248][123091] Updated weights for policy 0, policy_version 1890723 (0.0007) [2023-12-26 14:41:45,312][123091] Updated weights for policy 0, policy_version 1890733 (0.0009) [2023-12-26 14:41:45,800][123090] Updated weights for policy 1, policy_version 1879012 (0.0010) [2023-12-26 14:41:45,856][123090] Updated weights for policy 1, policy_version 1879022 (0.0009) [2023-12-26 14:41:45,914][123090] Updated weights for policy 1, policy_version 1879032 (0.0010) [2023-12-26 14:41:45,969][123091] Updated weights for policy 0, policy_version 1890743 (0.0005) [2023-12-26 14:41:46,025][123091] Updated weights for policy 0, policy_version 1890753 (0.0005) [2023-12-26 14:41:46,074][123091] Updated weights for policy 0, policy_version 1890763 (0.0008) [2023-12-26 14:41:46,768][123090] Updated weights for policy 1, policy_version 1879042 (0.0010) [2023-12-26 14:41:46,771][123091] Updated weights for policy 0, policy_version 1890773 (0.0006) [2023-12-26 14:41:46,831][123090] Updated weights for policy 1, policy_version 1879052 (0.0010) [2023-12-26 14:41:46,835][123091] Updated weights for policy 0, policy_version 1890783 (0.0008) [2023-12-26 14:41:46,887][123090] Updated weights for policy 1, policy_version 1879062 (0.0010) [2023-12-26 14:41:46,894][123091] Updated weights for policy 0, policy_version 1890793 (0.0010) [2023-12-26 14:41:46,949][123090] Updated weights for policy 1, policy_version 1879072 (0.0006) [2023-12-26 14:41:47,485][123091] Updated weights for policy 0, policy_version 1890803 (0.0008) [2023-12-26 14:41:47,545][123091] Updated weights for policy 0, policy_version 1890813 (0.0005) [2023-12-26 14:41:47,608][123091] Updated weights for policy 0, policy_version 1890823 (0.0006) [2023-12-26 14:41:47,735][123090] Updated weights for policy 1, policy_version 1879082 (0.0009) [2023-12-26 14:41:47,789][123090] Updated weights for policy 1, policy_version 1879092 (0.0008) [2023-12-26 14:41:47,841][123090] Updated weights for policy 1, policy_version 1879102 (0.0010) [2023-12-26 14:41:48,356][123091] Updated weights for policy 0, policy_version 1890833 (0.0005) [2023-12-26 14:41:48,413][123091] Updated weights for policy 0, policy_version 1890843 (0.0007) [2023-12-26 14:41:48,464][123091] Updated weights for policy 0, policy_version 1890853 (0.0007) [2023-12-26 14:41:48,526][123091] Updated weights for policy 0, policy_version 1890863 (0.0009) [2023-12-26 14:41:48,697][123090] Updated weights for policy 1, policy_version 1879112 (0.0010) [2023-12-26 14:41:48,764][123090] Updated weights for policy 1, policy_version 1879122 (0.0010) [2023-12-26 14:41:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 965115904. Throughput: 0: 9050.9, 1: 8623.5. Samples: 965129828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:48,785][121949] Avg episode reward: [(0, '6364.166'), (1, '5830.344')] [2023-12-26 14:41:48,839][123090] Updated weights for policy 1, policy_version 1879132 (0.0011) [2023-12-26 14:41:49,370][123091] Updated weights for policy 0, policy_version 1890873 (0.0013) [2023-12-26 14:41:49,434][123091] Updated weights for policy 0, policy_version 1890883 (0.0009) [2023-12-26 14:41:49,502][123091] Updated weights for policy 0, policy_version 1890893 (0.0010) [2023-12-26 14:41:49,626][123090] Updated weights for policy 1, policy_version 1879142 (0.0010) [2023-12-26 14:41:49,698][123090] Updated weights for policy 1, policy_version 1879152 (0.0010) [2023-12-26 14:41:49,767][123090] Updated weights for policy 1, policy_version 1879162 (0.0009) [2023-12-26 14:41:50,319][123091] Updated weights for policy 0, policy_version 1890903 (0.0008) [2023-12-26 14:41:50,381][123091] Updated weights for policy 0, policy_version 1890913 (0.0010) [2023-12-26 14:41:50,442][123091] Updated weights for policy 0, policy_version 1890923 (0.0009) [2023-12-26 14:41:50,598][123090] Updated weights for policy 1, policy_version 1879172 (0.0008) [2023-12-26 14:41:50,666][123090] Updated weights for policy 1, policy_version 1879182 (0.0008) [2023-12-26 14:41:50,733][123090] Updated weights for policy 1, policy_version 1879192 (0.0006) [2023-12-26 14:41:51,343][123091] Updated weights for policy 0, policy_version 1890933 (0.0010) [2023-12-26 14:41:51,422][123091] Updated weights for policy 0, policy_version 1890943 (0.0010) [2023-12-26 14:41:51,485][123091] Updated weights for policy 0, policy_version 1890953 (0.0009) [2023-12-26 14:41:51,520][123090] Updated weights for policy 1, policy_version 1879202 (0.0008) [2023-12-26 14:41:51,574][123090] Updated weights for policy 1, policy_version 1879212 (0.0008) [2023-12-26 14:41:51,647][123090] Updated weights for policy 1, policy_version 1879222 (0.0007) [2023-12-26 14:41:51,706][123090] Updated weights for policy 1, policy_version 1879232 (0.0009) [2023-12-26 14:41:52,285][123091] Updated weights for policy 0, policy_version 1890963 (0.0008) [2023-12-26 14:41:52,344][123091] Updated weights for policy 0, policy_version 1890973 (0.0007) [2023-12-26 14:41:52,414][123091] Updated weights for policy 0, policy_version 1890983 (0.0009) [2023-12-26 14:41:52,511][123090] Updated weights for policy 1, policy_version 1879242 (0.0009) [2023-12-26 14:41:52,571][123090] Updated weights for policy 1, policy_version 1879252 (0.0009) [2023-12-26 14:41:52,624][123090] Updated weights for policy 1, policy_version 1879262 (0.0009) [2023-12-26 14:41:53,158][123091] Updated weights for policy 0, policy_version 1890993 (0.0007) [2023-12-26 14:41:53,208][123091] Updated weights for policy 0, policy_version 1891003 (0.0006) [2023-12-26 14:41:53,272][123091] Updated weights for policy 0, policy_version 1891013 (0.0006) [2023-12-26 14:41:53,343][123091] Updated weights for policy 0, policy_version 1891023 (0.0005) [2023-12-26 14:41:53,430][123090] Updated weights for policy 1, policy_version 1879272 (0.0007) [2023-12-26 14:41:53,491][123090] Updated weights for policy 1, policy_version 1879282 (0.0005) [2023-12-26 14:41:53,552][123090] Updated weights for policy 1, policy_version 1879292 (0.0008) [2023-12-26 14:41:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 965206016. Throughput: 0: 8987.0, 1: 8643.4. Samples: 965180336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:53,784][121949] Avg episode reward: [(0, '6350.758'), (1, '5782.234')] [2023-12-26 14:41:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001891024_484106240.pth... [2023-12-26 14:41:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001879296_481099776.pth... [2023-12-26 14:41:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001878272_480837632.pth [2023-12-26 14:41:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001889968_483835904.pth [2023-12-26 14:41:53,975][123091] Updated weights for policy 0, policy_version 1891033 (0.0009) [2023-12-26 14:41:54,028][123091] Updated weights for policy 0, policy_version 1891043 (0.0010) [2023-12-26 14:41:54,079][123091] Updated weights for policy 0, policy_version 1891054 (0.0010) [2023-12-26 14:41:54,272][123090] Updated weights for policy 1, policy_version 1879302 (0.0008) [2023-12-26 14:41:54,340][123090] Updated weights for policy 1, policy_version 1879312 (0.0009) [2023-12-26 14:41:54,406][123090] Updated weights for policy 1, policy_version 1879322 (0.0008) [2023-12-26 14:41:54,842][123091] Updated weights for policy 0, policy_version 1891064 (0.0008) [2023-12-26 14:41:54,911][123091] Updated weights for policy 0, policy_version 1891074 (0.0006) [2023-12-26 14:41:54,985][123091] Updated weights for policy 0, policy_version 1891084 (0.0006) [2023-12-26 14:41:55,233][123090] Updated weights for policy 1, policy_version 1879332 (0.0009) [2023-12-26 14:41:55,284][123090] Updated weights for policy 1, policy_version 1879342 (0.0010) [2023-12-26 14:41:55,331][123090] Updated weights for policy 1, policy_version 1879352 (0.0010) [2023-12-26 14:41:55,671][123091] Updated weights for policy 0, policy_version 1891094 (0.0005) [2023-12-26 14:41:55,725][123091] Updated weights for policy 0, policy_version 1891104 (0.0005) [2023-12-26 14:41:55,794][123091] Updated weights for policy 0, policy_version 1891114 (0.0008) [2023-12-26 14:41:56,191][123090] Updated weights for policy 1, policy_version 1879362 (0.0010) [2023-12-26 14:41:56,238][123090] Updated weights for policy 1, policy_version 1879372 (0.0010) [2023-12-26 14:41:56,298][123090] Updated weights for policy 1, policy_version 1879382 (0.0010) [2023-12-26 14:41:56,349][123090] Updated weights for policy 1, policy_version 1879392 (0.0010) [2023-12-26 14:41:56,582][123091] Updated weights for policy 0, policy_version 1891124 (0.0009) [2023-12-26 14:41:56,648][123091] Updated weights for policy 0, policy_version 1891134 (0.0010) [2023-12-26 14:41:56,707][123091] Updated weights for policy 0, policy_version 1891144 (0.0011) [2023-12-26 14:41:57,184][123090] Updated weights for policy 1, policy_version 1879402 (0.0007) [2023-12-26 14:41:57,236][123090] Updated weights for policy 1, policy_version 1879412 (0.0006) [2023-12-26 14:41:57,292][123090] Updated weights for policy 1, policy_version 1879423 (0.0010) [2023-12-26 14:41:57,433][123091] Updated weights for policy 0, policy_version 1891154 (0.0009) [2023-12-26 14:41:57,488][123091] Updated weights for policy 0, policy_version 1891164 (0.0007) [2023-12-26 14:41:57,547][123091] Updated weights for policy 0, policy_version 1891174 (0.0007) [2023-12-26 14:41:57,605][123091] Updated weights for policy 0, policy_version 1891184 (0.0008) [2023-12-26 14:41:58,062][123090] Updated weights for policy 1, policy_version 1879433 (0.0006) [2023-12-26 14:41:58,127][123090] Updated weights for policy 1, policy_version 1879443 (0.0007) [2023-12-26 14:41:58,196][123090] Updated weights for policy 1, policy_version 1879453 (0.0006) [2023-12-26 14:41:58,503][123091] Updated weights for policy 0, policy_version 1891195 (0.0007) [2023-12-26 14:41:58,577][123091] Updated weights for policy 0, policy_version 1891205 (0.0008) [2023-12-26 14:41:58,642][123091] Updated weights for policy 0, policy_version 1891215 (0.0008) [2023-12-26 14:41:58,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17716.9). Total num frames: 965296128. Throughput: 0: 9083.0, 1: 8701.9. Samples: 965290396. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:41:58,785][121949] Avg episode reward: [(0, '6178.754'), (1, '5962.032')] [2023-12-26 14:41:59,042][123090] Updated weights for policy 1, policy_version 1879463 (0.0007) [2023-12-26 14:41:59,113][123090] Updated weights for policy 1, policy_version 1879473 (0.0007) [2023-12-26 14:41:59,188][123090] Updated weights for policy 1, policy_version 1879483 (0.0007) [2023-12-26 14:41:59,621][123091] Updated weights for policy 0, policy_version 1891225 (0.0009) [2023-12-26 14:41:59,678][123091] Updated weights for policy 0, policy_version 1891235 (0.0010) [2023-12-26 14:41:59,745][123091] Updated weights for policy 0, policy_version 1891245 (0.0009) [2023-12-26 14:41:59,965][123090] Updated weights for policy 1, policy_version 1879493 (0.0011) [2023-12-26 14:42:00,036][123090] Updated weights for policy 1, policy_version 1879503 (0.0006) [2023-12-26 14:42:00,107][123090] Updated weights for policy 1, policy_version 1879513 (0.0007) [2023-12-26 14:42:00,625][123091] Updated weights for policy 0, policy_version 1891255 (0.0009) [2023-12-26 14:42:00,682][123091] Updated weights for policy 0, policy_version 1891265 (0.0008) [2023-12-26 14:42:00,756][123091] Updated weights for policy 0, policy_version 1891275 (0.0008) [2023-12-26 14:42:00,839][123090] Updated weights for policy 1, policy_version 1879523 (0.0009) [2023-12-26 14:42:00,898][123090] Updated weights for policy 1, policy_version 1879533 (0.0006) [2023-12-26 14:42:00,966][123090] Updated weights for policy 1, policy_version 1879543 (0.0005) [2023-12-26 14:42:01,554][123091] Updated weights for policy 0, policy_version 1891285 (0.0011) [2023-12-26 14:42:01,604][123091] Updated weights for policy 0, policy_version 1891295 (0.0010) [2023-12-26 14:42:01,660][123091] Updated weights for policy 0, policy_version 1891305 (0.0008) [2023-12-26 14:42:01,677][123090] Updated weights for policy 1, policy_version 1879553 (0.0006) [2023-12-26 14:42:01,746][123090] Updated weights for policy 1, policy_version 1879563 (0.0011) [2023-12-26 14:42:01,805][123090] Updated weights for policy 1, policy_version 1879573 (0.0010) [2023-12-26 14:42:01,863][123090] Updated weights for policy 1, policy_version 1879583 (0.0011) [2023-12-26 14:42:02,422][123091] Updated weights for policy 0, policy_version 1891315 (0.0008) [2023-12-26 14:42:02,496][123091] Updated weights for policy 0, policy_version 1891325 (0.0010) [2023-12-26 14:42:02,560][123091] Updated weights for policy 0, policy_version 1891335 (0.0009) [2023-12-26 14:42:02,669][123090] Updated weights for policy 1, policy_version 1879593 (0.0006) [2023-12-26 14:42:02,721][123090] Updated weights for policy 1, policy_version 1879603 (0.0005) [2023-12-26 14:42:02,768][123090] Updated weights for policy 1, policy_version 1879613 (0.0005) [2023-12-26 14:42:03,259][123091] Updated weights for policy 0, policy_version 1891345 (0.0008) [2023-12-26 14:42:03,316][123091] Updated weights for policy 0, policy_version 1891355 (0.0008) [2023-12-26 14:42:03,375][123091] Updated weights for policy 0, policy_version 1891365 (0.0010) [2023-12-26 14:42:03,436][123091] Updated weights for policy 0, policy_version 1891375 (0.0010) [2023-12-26 14:42:03,554][123090] Updated weights for policy 1, policy_version 1879623 (0.0005) [2023-12-26 14:42:03,605][123090] Updated weights for policy 1, policy_version 1879633 (0.0005) [2023-12-26 14:42:03,657][123090] Updated weights for policy 1, policy_version 1879643 (0.0005) [2023-12-26 14:42:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 965386240. Throughput: 0: 8987.8, 1: 8730.7. Samples: 965395296. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:03,785][121949] Avg episode reward: [(0, '6267.183'), (1, '5922.549')] [2023-12-26 14:42:04,206][123091] Updated weights for policy 0, policy_version 1891385 (0.0010) [2023-12-26 14:42:04,272][123091] Updated weights for policy 0, policy_version 1891395 (0.0010) [2023-12-26 14:42:04,335][123091] Updated weights for policy 0, policy_version 1891405 (0.0010) [2023-12-26 14:42:04,385][123090] Updated weights for policy 1, policy_version 1879653 (0.0008) [2023-12-26 14:42:04,451][123090] Updated weights for policy 1, policy_version 1879663 (0.0010) [2023-12-26 14:42:04,519][123090] Updated weights for policy 1, policy_version 1879673 (0.0009) [2023-12-26 14:42:04,998][123091] Updated weights for policy 0, policy_version 1891415 (0.0009) [2023-12-26 14:42:05,056][123091] Updated weights for policy 0, policy_version 1891425 (0.0009) [2023-12-26 14:42:05,114][123091] Updated weights for policy 0, policy_version 1891435 (0.0009) [2023-12-26 14:42:05,370][123090] Updated weights for policy 1, policy_version 1879683 (0.0008) [2023-12-26 14:42:05,421][123090] Updated weights for policy 1, policy_version 1879693 (0.0005) [2023-12-26 14:42:05,486][123090] Updated weights for policy 1, policy_version 1879703 (0.0005) [2023-12-26 14:42:06,007][123091] Updated weights for policy 0, policy_version 1891445 (0.0010) [2023-12-26 14:42:06,068][123091] Updated weights for policy 0, policy_version 1891455 (0.0009) [2023-12-26 14:42:06,140][123091] Updated weights for policy 0, policy_version 1891465 (0.0008) [2023-12-26 14:42:06,261][123090] Updated weights for policy 1, policy_version 1879713 (0.0007) [2023-12-26 14:42:06,330][123090] Updated weights for policy 1, policy_version 1879723 (0.0010) [2023-12-26 14:42:06,401][123090] Updated weights for policy 1, policy_version 1879733 (0.0010) [2023-12-26 14:42:06,472][123090] Updated weights for policy 1, policy_version 1879743 (0.0009) [2023-12-26 14:42:06,876][123091] Updated weights for policy 0, policy_version 1891475 (0.0009) [2023-12-26 14:42:06,930][123091] Updated weights for policy 0, policy_version 1891485 (0.0011) [2023-12-26 14:42:06,992][123091] Updated weights for policy 0, policy_version 1891495 (0.0006) [2023-12-26 14:42:07,282][123090] Updated weights for policy 1, policy_version 1879753 (0.0009) [2023-12-26 14:42:07,345][123090] Updated weights for policy 1, policy_version 1879763 (0.0010) [2023-12-26 14:42:07,403][123090] Updated weights for policy 1, policy_version 1879773 (0.0009) [2023-12-26 14:42:07,724][123091] Updated weights for policy 0, policy_version 1891505 (0.0005) [2023-12-26 14:42:07,785][123091] Updated weights for policy 0, policy_version 1891515 (0.0005) [2023-12-26 14:42:07,833][123091] Updated weights for policy 0, policy_version 1891525 (0.0007) [2023-12-26 14:42:07,887][123091] Updated weights for policy 0, policy_version 1891535 (0.0006) [2023-12-26 14:42:08,168][123090] Updated weights for policy 1, policy_version 1879783 (0.0007) [2023-12-26 14:42:08,216][123090] Updated weights for policy 1, policy_version 1879793 (0.0005) [2023-12-26 14:42:08,261][123090] Updated weights for policy 1, policy_version 1879803 (0.0005) [2023-12-26 14:42:08,692][123091] Updated weights for policy 0, policy_version 1891545 (0.0006) [2023-12-26 14:42:08,760][123091] Updated weights for policy 0, policy_version 1891555 (0.0005) [2023-12-26 14:42:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 965468160. Throughput: 0: 9001.0, 1: 8784.5. Samples: 965448828. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:08,785][121949] Avg episode reward: [(0, '6275.580'), (1, '5863.291')] [2023-12-26 14:42:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001879808_481230848.pth... [2023-12-26 14:42:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001878784_480968704.pth [2023-12-26 14:42:08,836][123091] Updated weights for policy 0, policy_version 1891565 (0.0005) [2023-12-26 14:42:08,856][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001891568_484245504.pth... [2023-12-26 14:42:08,860][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001890512_483975168.pth [2023-12-26 14:42:09,075][123090] Updated weights for policy 1, policy_version 1879813 (0.0008) [2023-12-26 14:42:09,143][123090] Updated weights for policy 1, policy_version 1879823 (0.0009) [2023-12-26 14:42:09,201][123090] Updated weights for policy 1, policy_version 1879833 (0.0009) [2023-12-26 14:42:09,574][123091] Updated weights for policy 0, policy_version 1891575 (0.0006) [2023-12-26 14:42:09,647][123091] Updated weights for policy 0, policy_version 1891585 (0.0005) [2023-12-26 14:42:09,713][123091] Updated weights for policy 0, policy_version 1891595 (0.0005) [2023-12-26 14:42:10,012][123090] Updated weights for policy 1, policy_version 1879843 (0.0009) [2023-12-26 14:42:10,081][123090] Updated weights for policy 1, policy_version 1879853 (0.0006) [2023-12-26 14:42:10,160][123090] Updated weights for policy 1, policy_version 1879863 (0.0006) [2023-12-26 14:42:10,494][123091] Updated weights for policy 0, policy_version 1891605 (0.0008) [2023-12-26 14:42:10,556][123091] Updated weights for policy 0, policy_version 1891615 (0.0010) [2023-12-26 14:42:10,626][123091] Updated weights for policy 0, policy_version 1891625 (0.0010) [2023-12-26 14:42:10,939][123090] Updated weights for policy 1, policy_version 1879873 (0.0010) [2023-12-26 14:42:11,003][123090] Updated weights for policy 1, policy_version 1879883 (0.0009) [2023-12-26 14:42:11,076][123090] Updated weights for policy 1, policy_version 1879893 (0.0009) [2023-12-26 14:42:11,141][123090] Updated weights for policy 1, policy_version 1879903 (0.0009) [2023-12-26 14:42:11,462][123091] Updated weights for policy 0, policy_version 1891635 (0.0009) [2023-12-26 14:42:11,528][123091] Updated weights for policy 0, policy_version 1891645 (0.0009) [2023-12-26 14:42:11,593][123091] Updated weights for policy 0, policy_version 1891655 (0.0009) [2023-12-26 14:42:12,018][123090] Updated weights for policy 1, policy_version 1879913 (0.0006) [2023-12-26 14:42:12,078][123090] Updated weights for policy 1, policy_version 1879923 (0.0010) [2023-12-26 14:42:12,145][123090] Updated weights for policy 1, policy_version 1879933 (0.0009) [2023-12-26 14:42:12,471][123091] Updated weights for policy 0, policy_version 1891665 (0.0009) [2023-12-26 14:42:12,535][123091] Updated weights for policy 0, policy_version 1891675 (0.0010) [2023-12-26 14:42:12,604][123091] Updated weights for policy 0, policy_version 1891685 (0.0010) [2023-12-26 14:42:12,656][123091] Updated weights for policy 0, policy_version 1891695 (0.0010) [2023-12-26 14:42:12,945][123090] Updated weights for policy 1, policy_version 1879943 (0.0007) [2023-12-26 14:42:13,007][123090] Updated weights for policy 1, policy_version 1879953 (0.0005) [2023-12-26 14:42:13,064][123090] Updated weights for policy 1, policy_version 1879963 (0.0005) [2023-12-26 14:42:13,544][123091] Updated weights for policy 0, policy_version 1891705 (0.0009) [2023-12-26 14:42:13,600][123091] Updated weights for policy 0, policy_version 1891715 (0.0009) [2023-12-26 14:42:13,659][123091] Updated weights for policy 0, policy_version 1891725 (0.0008) [2023-12-26 14:42:13,711][123090] Updated weights for policy 1, policy_version 1879973 (0.0007) [2023-12-26 14:42:13,772][123090] Updated weights for policy 1, policy_version 1879983 (0.0007) [2023-12-26 14:42:13,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 965558272. Throughput: 0: 8975.0, 1: 8698.4. Samples: 965552708. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:13,784][121949] Avg episode reward: [(0, '6243.308'), (1, '5756.438')] [2023-12-26 14:42:13,825][123090] Updated weights for policy 1, policy_version 1879993 (0.0005) [2023-12-26 14:42:14,486][123091] Updated weights for policy 0, policy_version 1891735 (0.0009) [2023-12-26 14:42:14,545][123091] Updated weights for policy 0, policy_version 1891745 (0.0010) [2023-12-26 14:42:14,566][123090] Updated weights for policy 1, policy_version 1880003 (0.0006) [2023-12-26 14:42:14,596][123091] Updated weights for policy 0, policy_version 1891755 (0.0008) [2023-12-26 14:42:14,623][123090] Updated weights for policy 1, policy_version 1880013 (0.0008) [2023-12-26 14:42:14,674][123090] Updated weights for policy 1, policy_version 1880023 (0.0010) [2023-12-26 14:42:15,391][123091] Updated weights for policy 0, policy_version 1891765 (0.0009) [2023-12-26 14:42:15,449][123091] Updated weights for policy 0, policy_version 1891775 (0.0009) [2023-12-26 14:42:15,512][123091] Updated weights for policy 0, policy_version 1891785 (0.0009) [2023-12-26 14:42:15,558][123090] Updated weights for policy 1, policy_version 1880033 (0.0009) [2023-12-26 14:42:15,627][123090] Updated weights for policy 1, policy_version 1880043 (0.0010) [2023-12-26 14:42:15,695][123090] Updated weights for policy 1, policy_version 1880053 (0.0008) [2023-12-26 14:42:15,770][123090] Updated weights for policy 1, policy_version 1880063 (0.0009) [2023-12-26 14:42:16,312][123091] Updated weights for policy 0, policy_version 1891795 (0.0007) [2023-12-26 14:42:16,374][123091] Updated weights for policy 0, policy_version 1891805 (0.0005) [2023-12-26 14:42:16,431][123091] Updated weights for policy 0, policy_version 1891815 (0.0005) [2023-12-26 14:42:16,610][123090] Updated weights for policy 1, policy_version 1880073 (0.0010) [2023-12-26 14:42:16,664][123090] Updated weights for policy 1, policy_version 1880084 (0.0010) [2023-12-26 14:42:16,723][123090] Updated weights for policy 1, policy_version 1880094 (0.0010) [2023-12-26 14:42:17,045][123091] Updated weights for policy 0, policy_version 1891825 (0.0005) [2023-12-26 14:42:17,113][123091] Updated weights for policy 0, policy_version 1891835 (0.0005) [2023-12-26 14:42:17,170][123091] Updated weights for policy 0, policy_version 1891845 (0.0007) [2023-12-26 14:42:17,225][123091] Updated weights for policy 0, policy_version 1891855 (0.0009) [2023-12-26 14:42:17,647][123090] Updated weights for policy 1, policy_version 1880104 (0.0009) [2023-12-26 14:42:17,699][123090] Updated weights for policy 1, policy_version 1880114 (0.0009) [2023-12-26 14:42:17,755][123090] Updated weights for policy 1, policy_version 1880124 (0.0009) [2023-12-26 14:42:17,937][123091] Updated weights for policy 0, policy_version 1891865 (0.0010) [2023-12-26 14:42:18,012][123091] Updated weights for policy 0, policy_version 1891875 (0.0009) [2023-12-26 14:42:18,075][123091] Updated weights for policy 0, policy_version 1891885 (0.0010) [2023-12-26 14:42:18,624][123090] Updated weights for policy 1, policy_version 1880134 (0.0009) [2023-12-26 14:42:18,688][123090] Updated weights for policy 1, policy_version 1880144 (0.0009) [2023-12-26 14:42:18,753][123090] Updated weights for policy 1, policy_version 1880154 (0.0008) [2023-12-26 14:42:18,773][123091] Updated weights for policy 0, policy_version 1891895 (0.0009) [2023-12-26 14:42:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 965640192. Throughput: 0: 8985.3, 1: 8692.1. Samples: 965658704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:18,784][121949] Avg episode reward: [(0, '6250.104'), (1, '5795.350')] [2023-12-26 14:42:18,840][123091] Updated weights for policy 0, policy_version 1891905 (0.0010) [2023-12-26 14:42:18,907][123091] Updated weights for policy 0, policy_version 1891915 (0.0009) [2023-12-26 14:42:19,651][123090] Updated weights for policy 1, policy_version 1880164 (0.0009) [2023-12-26 14:42:19,671][123091] Updated weights for policy 0, policy_version 1891925 (0.0008) [2023-12-26 14:42:19,711][123090] Updated weights for policy 1, policy_version 1880174 (0.0011) [2023-12-26 14:42:19,731][123091] Updated weights for policy 0, policy_version 1891935 (0.0007) [2023-12-26 14:42:19,759][123090] Updated weights for policy 1, policy_version 1880184 (0.0010) [2023-12-26 14:42:19,795][123091] Updated weights for policy 0, policy_version 1891945 (0.0006) [2023-12-26 14:42:20,622][123090] Updated weights for policy 1, policy_version 1880194 (0.0010) [2023-12-26 14:42:20,660][123091] Updated weights for policy 0, policy_version 1891955 (0.0008) [2023-12-26 14:42:20,689][123090] Updated weights for policy 1, policy_version 1880204 (0.0008) [2023-12-26 14:42:20,722][123091] Updated weights for policy 0, policy_version 1891965 (0.0008) [2023-12-26 14:42:20,753][123090] Updated weights for policy 1, policy_version 1880214 (0.0008) [2023-12-26 14:42:20,787][123091] Updated weights for policy 0, policy_version 1891975 (0.0007) [2023-12-26 14:42:20,815][123090] Updated weights for policy 1, policy_version 1880224 (0.0008) [2023-12-26 14:42:21,630][123091] Updated weights for policy 0, policy_version 1891985 (0.0009) [2023-12-26 14:42:21,643][123090] Updated weights for policy 1, policy_version 1880234 (0.0009) [2023-12-26 14:42:21,690][123091] Updated weights for policy 0, policy_version 1891995 (0.0009) [2023-12-26 14:42:21,709][123090] Updated weights for policy 1, policy_version 1880244 (0.0008) [2023-12-26 14:42:21,761][123091] Updated weights for policy 0, policy_version 1892005 (0.0008) [2023-12-26 14:42:21,777][123090] Updated weights for policy 1, policy_version 1880254 (0.0008) [2023-12-26 14:42:21,828][123091] Updated weights for policy 0, policy_version 1892015 (0.0008) [2023-12-26 14:42:22,577][123091] Updated weights for policy 0, policy_version 1892025 (0.0006) [2023-12-26 14:42:22,637][123091] Updated weights for policy 0, policy_version 1892035 (0.0005) [2023-12-26 14:42:22,664][123090] Updated weights for policy 1, policy_version 1880264 (0.0009) [2023-12-26 14:42:22,701][123091] Updated weights for policy 0, policy_version 1892045 (0.0010) [2023-12-26 14:42:22,727][123090] Updated weights for policy 1, policy_version 1880274 (0.0006) [2023-12-26 14:42:22,802][123090] Updated weights for policy 1, policy_version 1880284 (0.0007) [2023-12-26 14:42:23,488][123091] Updated weights for policy 0, policy_version 1892055 (0.0010) [2023-12-26 14:42:23,542][123091] Updated weights for policy 0, policy_version 1892065 (0.0008) [2023-12-26 14:42:23,594][123090] Updated weights for policy 1, policy_version 1880294 (0.0008) [2023-12-26 14:42:23,601][123091] Updated weights for policy 0, policy_version 1892075 (0.0008) [2023-12-26 14:42:23,665][123090] Updated weights for policy 1, policy_version 1880304 (0.0009) [2023-12-26 14:42:23,732][123090] Updated weights for policy 1, policy_version 1880314 (0.0009) [2023-12-26 14:42:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 965738496. Throughput: 0: 8918.3, 1: 8705.3. Samples: 965708676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:23,785][121949] Avg episode reward: [(0, '6259.132'), (1, '5743.221')] [2023-12-26 14:42:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001880320_481361920.pth... [2023-12-26 14:42:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001892080_484376576.pth... [2023-12-26 14:42:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001879296_481099776.pth [2023-12-26 14:42:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001891024_484106240.pth [2023-12-26 14:42:24,441][123091] Updated weights for policy 0, policy_version 1892085 (0.0009) [2023-12-26 14:42:24,516][123090] Updated weights for policy 1, policy_version 1880324 (0.0007) [2023-12-26 14:42:24,519][123091] Updated weights for policy 0, policy_version 1892095 (0.0008) [2023-12-26 14:42:24,577][123091] Updated weights for policy 0, policy_version 1892105 (0.0008) [2023-12-26 14:42:24,580][123090] Updated weights for policy 1, policy_version 1880334 (0.0005) [2023-12-26 14:42:24,627][123090] Updated weights for policy 1, policy_version 1880344 (0.0006) [2023-12-26 14:42:25,287][123090] Updated weights for policy 1, policy_version 1880354 (0.0008) [2023-12-26 14:42:25,337][123090] Updated weights for policy 1, policy_version 1880364 (0.0005) [2023-12-26 14:42:25,394][123090] Updated weights for policy 1, policy_version 1880374 (0.0006) [2023-12-26 14:42:25,410][123091] Updated weights for policy 0, policy_version 1892115 (0.0005) [2023-12-26 14:42:25,456][123091] Updated weights for policy 0, policy_version 1892125 (0.0008) [2023-12-26 14:42:25,457][123090] Updated weights for policy 1, policy_version 1880384 (0.0009) [2023-12-26 14:42:25,506][123091] Updated weights for policy 0, policy_version 1892136 (0.0009) [2023-12-26 14:42:26,148][123090] Updated weights for policy 1, policy_version 1880394 (0.0006) [2023-12-26 14:42:26,220][123090] Updated weights for policy 1, policy_version 1880404 (0.0005) [2023-12-26 14:42:26,272][123090] Updated weights for policy 1, policy_version 1880414 (0.0005) [2023-12-26 14:42:26,457][123091] Updated weights for policy 0, policy_version 1892147 (0.0010) [2023-12-26 14:42:26,516][123091] Updated weights for policy 0, policy_version 1892157 (0.0010) [2023-12-26 14:42:26,577][123091] Updated weights for policy 0, policy_version 1892167 (0.0009) [2023-12-26 14:42:26,873][123090] Updated weights for policy 1, policy_version 1880424 (0.0009) [2023-12-26 14:42:26,923][123090] Updated weights for policy 1, policy_version 1880434 (0.0010) [2023-12-26 14:42:26,974][123090] Updated weights for policy 1, policy_version 1880444 (0.0010) [2023-12-26 14:42:27,493][123091] Updated weights for policy 0, policy_version 1892177 (0.0010) [2023-12-26 14:42:27,554][123091] Updated weights for policy 0, policy_version 1892187 (0.0010) [2023-12-26 14:42:27,609][123091] Updated weights for policy 0, policy_version 1892198 (0.0010) [2023-12-26 14:42:27,650][123090] Updated weights for policy 1, policy_version 1880454 (0.0007) [2023-12-26 14:42:27,662][123091] Updated weights for policy 0, policy_version 1892208 (0.0009) [2023-12-26 14:42:27,700][123090] Updated weights for policy 1, policy_version 1880464 (0.0005) [2023-12-26 14:42:27,747][123090] Updated weights for policy 1, policy_version 1880474 (0.0005) [2023-12-26 14:42:28,467][123090] Updated weights for policy 1, policy_version 1880484 (0.0005) [2023-12-26 14:42:28,515][123090] Updated weights for policy 1, policy_version 1880494 (0.0005) [2023-12-26 14:42:28,567][123090] Updated weights for policy 1, policy_version 1880504 (0.0006) [2023-12-26 14:42:28,610][123091] Updated weights for policy 0, policy_version 1892218 (0.0006) [2023-12-26 14:42:28,689][123091] Updated weights for policy 0, policy_version 1892228 (0.0006) [2023-12-26 14:42:28,768][123091] Updated weights for policy 0, policy_version 1892238 (0.0006) [2023-12-26 14:42:28,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 965828608. Throughput: 0: 8901.1, 1: 8792.7. Samples: 965815400. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:28,785][121949] Avg episode reward: [(0, '6278.255'), (1, '5617.889')] [2023-12-26 14:42:29,233][123090] Updated weights for policy 1, policy_version 1880514 (0.0006) [2023-12-26 14:42:29,291][123090] Updated weights for policy 1, policy_version 1880524 (0.0009) [2023-12-26 14:42:29,356][123090] Updated weights for policy 1, policy_version 1880534 (0.0009) [2023-12-26 14:42:29,378][123091] Updated weights for policy 0, policy_version 1892248 (0.0009) [2023-12-26 14:42:29,423][123090] Updated weights for policy 1, policy_version 1880544 (0.0008) [2023-12-26 14:42:29,442][123091] Updated weights for policy 0, policy_version 1892258 (0.0009) [2023-12-26 14:42:29,502][123091] Updated weights for policy 0, policy_version 1892268 (0.0009) [2023-12-26 14:42:30,283][123090] Updated weights for policy 1, policy_version 1880554 (0.0010) [2023-12-26 14:42:30,330][123091] Updated weights for policy 0, policy_version 1892278 (0.0009) [2023-12-26 14:42:30,348][123090] Updated weights for policy 1, policy_version 1880564 (0.0009) [2023-12-26 14:42:30,382][123091] Updated weights for policy 0, policy_version 1892288 (0.0007) [2023-12-26 14:42:30,412][123090] Updated weights for policy 1, policy_version 1880574 (0.0009) [2023-12-26 14:42:30,443][123091] Updated weights for policy 0, policy_version 1892298 (0.0009) [2023-12-26 14:42:31,158][123090] Updated weights for policy 1, policy_version 1880584 (0.0007) [2023-12-26 14:42:31,232][123090] Updated weights for policy 1, policy_version 1880594 (0.0006) [2023-12-26 14:42:31,269][123091] Updated weights for policy 0, policy_version 1892308 (0.0010) [2023-12-26 14:42:31,293][123090] Updated weights for policy 1, policy_version 1880604 (0.0008) [2023-12-26 14:42:31,332][123091] Updated weights for policy 0, policy_version 1892318 (0.0010) [2023-12-26 14:42:31,396][123091] Updated weights for policy 0, policy_version 1892328 (0.0009) [2023-12-26 14:42:32,127][123090] Updated weights for policy 1, policy_version 1880614 (0.0008) [2023-12-26 14:42:32,188][123090] Updated weights for policy 1, policy_version 1880624 (0.0009) [2023-12-26 14:42:32,214][123091] Updated weights for policy 0, policy_version 1892338 (0.0011) [2023-12-26 14:42:32,250][123090] Updated weights for policy 1, policy_version 1880634 (0.0007) [2023-12-26 14:42:32,276][123091] Updated weights for policy 0, policy_version 1892348 (0.0011) [2023-12-26 14:42:32,320][123091] Updated weights for policy 0, policy_version 1892358 (0.0010) [2023-12-26 14:42:32,387][123091] Updated weights for policy 0, policy_version 1892368 (0.0011) [2023-12-26 14:42:33,091][123090] Updated weights for policy 1, policy_version 1880644 (0.0010) [2023-12-26 14:42:33,140][123090] Updated weights for policy 1, policy_version 1880654 (0.0009) [2023-12-26 14:42:33,188][123090] Updated weights for policy 1, policy_version 1880664 (0.0008) [2023-12-26 14:42:33,227][123091] Updated weights for policy 0, policy_version 1892378 (0.0010) [2023-12-26 14:42:33,284][123091] Updated weights for policy 0, policy_version 1892388 (0.0010) [2023-12-26 14:42:33,349][123091] Updated weights for policy 0, policy_version 1892398 (0.0010) [2023-12-26 14:42:33,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 965910528. Throughput: 0: 8757.6, 1: 8840.5. Samples: 965921740. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:33,784][121949] Avg episode reward: [(0, '6386.928'), (1, '5713.311')] [2023-12-26 14:42:34,061][123091] Updated weights for policy 0, policy_version 1892408 (0.0009) [2023-12-26 14:42:34,095][123090] Updated weights for policy 1, policy_version 1880674 (0.0008) [2023-12-26 14:42:34,118][123091] Updated weights for policy 0, policy_version 1892418 (0.0009) [2023-12-26 14:42:34,164][123090] Updated weights for policy 1, policy_version 1880684 (0.0009) [2023-12-26 14:42:34,186][123091] Updated weights for policy 0, policy_version 1892428 (0.0008) [2023-12-26 14:42:34,224][123090] Updated weights for policy 1, policy_version 1880694 (0.0008) [2023-12-26 14:42:34,301][123090] Updated weights for policy 1, policy_version 1880704 (0.0005) [2023-12-26 14:42:34,885][123091] Updated weights for policy 0, policy_version 1892438 (0.0006) [2023-12-26 14:42:34,935][123091] Updated weights for policy 0, policy_version 1892448 (0.0006) [2023-12-26 14:42:34,996][123091] Updated weights for policy 0, policy_version 1892458 (0.0007) [2023-12-26 14:42:35,000][123090] Updated weights for policy 1, policy_version 1880714 (0.0009) [2023-12-26 14:42:35,065][123090] Updated weights for policy 1, policy_version 1880724 (0.0008) [2023-12-26 14:42:35,129][123090] Updated weights for policy 1, policy_version 1880734 (0.0010) [2023-12-26 14:42:35,831][123091] Updated weights for policy 0, policy_version 1892468 (0.0011) [2023-12-26 14:42:35,883][123091] Updated weights for policy 0, policy_version 1892478 (0.0009) [2023-12-26 14:42:35,897][123090] Updated weights for policy 1, policy_version 1880744 (0.0008) [2023-12-26 14:42:35,937][123091] Updated weights for policy 0, policy_version 1892488 (0.0006) [2023-12-26 14:42:35,958][123090] Updated weights for policy 1, policy_version 1880754 (0.0008) [2023-12-26 14:42:36,033][123090] Updated weights for policy 1, policy_version 1880764 (0.0007) [2023-12-26 14:42:36,724][123091] Updated weights for policy 0, policy_version 1892498 (0.0007) [2023-12-26 14:42:36,784][123091] Updated weights for policy 0, policy_version 1892508 (0.0009) [2023-12-26 14:42:36,834][123091] Updated weights for policy 0, policy_version 1892518 (0.0009) [2023-12-26 14:42:36,880][123090] Updated weights for policy 1, policy_version 1880774 (0.0009) [2023-12-26 14:42:36,903][123091] Updated weights for policy 0, policy_version 1892528 (0.0006) [2023-12-26 14:42:36,949][123090] Updated weights for policy 1, policy_version 1880784 (0.0009) [2023-12-26 14:42:37,004][123090] Updated weights for policy 1, policy_version 1880794 (0.0009) [2023-12-26 14:42:37,684][123091] Updated weights for policy 0, policy_version 1892538 (0.0010) [2023-12-26 14:42:37,737][123091] Updated weights for policy 0, policy_version 1892548 (0.0010) [2023-12-26 14:42:37,792][123091] Updated weights for policy 0, policy_version 1892558 (0.0009) [2023-12-26 14:42:37,858][123090] Updated weights for policy 1, policy_version 1880804 (0.0008) [2023-12-26 14:42:37,925][123090] Updated weights for policy 1, policy_version 1880814 (0.0008) [2023-12-26 14:42:37,991][123090] Updated weights for policy 1, policy_version 1880824 (0.0010) [2023-12-26 14:42:38,610][123091] Updated weights for policy 0, policy_version 1892568 (0.0007) [2023-12-26 14:42:38,682][123091] Updated weights for policy 0, policy_version 1892578 (0.0008) [2023-12-26 14:42:38,747][123091] Updated weights for policy 0, policy_version 1892588 (0.0008) [2023-12-26 14:42:38,748][123090] Updated weights for policy 1, policy_version 1880834 (0.0010) [2023-12-26 14:42:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 966000640. Throughput: 0: 8848.8, 1: 8842.7. Samples: 965976452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:38,785][121949] Avg episode reward: [(0, '6405.000'), (1, '5684.909')] [2023-12-26 14:42:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001892592_484507648.pth... [2023-12-26 14:42:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001891568_484245504.pth [2023-12-26 14:42:38,818][123090] Updated weights for policy 1, policy_version 1880844 (0.0009) [2023-12-26 14:42:38,893][123090] Updated weights for policy 1, policy_version 1880854 (0.0010) [2023-12-26 14:42:38,951][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001880864_481501184.pth... [2023-12-26 14:42:38,953][123090] Updated weights for policy 1, policy_version 1880864 (0.0010) [2023-12-26 14:42:38,954][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001879808_481230848.pth [2023-12-26 14:42:39,517][123091] Updated weights for policy 0, policy_version 1892598 (0.0009) [2023-12-26 14:42:39,582][123091] Updated weights for policy 0, policy_version 1892608 (0.0009) [2023-12-26 14:42:39,651][123091] Updated weights for policy 0, policy_version 1892618 (0.0010) [2023-12-26 14:42:39,845][123090] Updated weights for policy 1, policy_version 1880874 (0.0009) [2023-12-26 14:42:39,910][123090] Updated weights for policy 1, policy_version 1880884 (0.0011) [2023-12-26 14:42:39,974][123090] Updated weights for policy 1, policy_version 1880894 (0.0011) [2023-12-26 14:42:40,545][123091] Updated weights for policy 0, policy_version 1892628 (0.0009) [2023-12-26 14:42:40,600][123091] Updated weights for policy 0, policy_version 1892639 (0.0010) [2023-12-26 14:42:40,654][123091] Updated weights for policy 0, policy_version 1892649 (0.0010) [2023-12-26 14:42:40,725][123090] Updated weights for policy 1, policy_version 1880904 (0.0007) [2023-12-26 14:42:40,779][123090] Updated weights for policy 1, policy_version 1880914 (0.0005) [2023-12-26 14:42:40,832][123090] Updated weights for policy 1, policy_version 1880924 (0.0008) [2023-12-26 14:42:41,598][123090] Updated weights for policy 1, policy_version 1880934 (0.0010) [2023-12-26 14:42:41,619][123091] Updated weights for policy 0, policy_version 1892659 (0.0009) [2023-12-26 14:42:41,666][123090] Updated weights for policy 1, policy_version 1880944 (0.0010) [2023-12-26 14:42:41,678][123091] Updated weights for policy 0, policy_version 1892669 (0.0008) [2023-12-26 14:42:41,733][123090] Updated weights for policy 1, policy_version 1880954 (0.0010) [2023-12-26 14:42:41,748][123091] Updated weights for policy 0, policy_version 1892679 (0.0009) [2023-12-26 14:42:42,543][123090] Updated weights for policy 1, policy_version 1880964 (0.0007) [2023-12-26 14:42:42,606][123090] Updated weights for policy 1, policy_version 1880974 (0.0008) [2023-12-26 14:42:42,623][123091] Updated weights for policy 0, policy_version 1892689 (0.0009) [2023-12-26 14:42:42,671][123090] Updated weights for policy 1, policy_version 1880984 (0.0008) [2023-12-26 14:42:42,687][123091] Updated weights for policy 0, policy_version 1892699 (0.0008) [2023-12-26 14:42:42,752][123091] Updated weights for policy 0, policy_version 1892709 (0.0005) [2023-12-26 14:42:42,819][123091] Updated weights for policy 0, policy_version 1892719 (0.0005) [2023-12-26 14:42:43,454][123090] Updated weights for policy 1, policy_version 1880994 (0.0011) [2023-12-26 14:42:43,506][123090] Updated weights for policy 1, policy_version 1881004 (0.0010) [2023-12-26 14:42:43,535][123091] Updated weights for policy 0, policy_version 1892729 (0.0006) [2023-12-26 14:42:43,557][123090] Updated weights for policy 1, policy_version 1881014 (0.0010) [2023-12-26 14:42:43,595][123091] Updated weights for policy 0, policy_version 1892739 (0.0008) [2023-12-26 14:42:43,609][123090] Updated weights for policy 1, policy_version 1881024 (0.0010) [2023-12-26 14:42:43,658][123091] Updated weights for policy 0, policy_version 1892749 (0.0009) [2023-12-26 14:42:43,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 966090752. Throughput: 0: 8687.0, 1: 8839.6. Samples: 966079092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:42:43,785][121949] Avg episode reward: [(0, '6343.509'), (1, '5701.561')] [2023-12-26 14:42:44,439][123091] Updated weights for policy 0, policy_version 1892759 (0.0006) [2023-12-26 14:42:44,448][123090] Updated weights for policy 1, policy_version 1881034 (0.0010) [2023-12-26 14:42:44,503][123090] Updated weights for policy 1, policy_version 1881044 (0.0010) [2023-12-26 14:42:44,510][123091] Updated weights for policy 0, policy_version 1892769 (0.0006) [2023-12-26 14:42:44,560][123090] Updated weights for policy 1, policy_version 1881054 (0.0009) [2023-12-26 14:42:44,567][123091] Updated weights for policy 0, policy_version 1892779 (0.0006) [2023-12-26 14:42:45,264][123091] Updated weights for policy 0, policy_version 1892789 (0.0009) [2023-12-26 14:42:45,332][123091] Updated weights for policy 0, policy_version 1892799 (0.0009) [2023-12-26 14:42:45,382][123091] Updated weights for policy 0, policy_version 1892809 (0.0009) [2023-12-26 14:42:45,454][123090] Updated weights for policy 1, policy_version 1881064 (0.0009) [2023-12-26 14:42:45,519][123090] Updated weights for policy 1, policy_version 1881074 (0.0009) [2023-12-26 14:42:45,571][123090] Updated weights for policy 1, policy_version 1881084 (0.0009) [2023-12-26 14:42:46,199][123091] Updated weights for policy 0, policy_version 1892819 (0.0009) [2023-12-26 14:42:46,265][123091] Updated weights for policy 0, policy_version 1892829 (0.0007) [2023-12-26 14:42:46,335][123091] Updated weights for policy 0, policy_version 1892839 (0.0005) [2023-12-26 14:42:46,363][123090] Updated weights for policy 1, policy_version 1881094 (0.0007) [2023-12-26 14:42:46,425][123090] Updated weights for policy 1, policy_version 1881104 (0.0006) [2023-12-26 14:42:46,493][123090] Updated weights for policy 1, policy_version 1881114 (0.0007) [2023-12-26 14:42:47,056][123091] Updated weights for policy 0, policy_version 1892849 (0.0006) [2023-12-26 14:42:47,113][123091] Updated weights for policy 0, policy_version 1892859 (0.0009) [2023-12-26 14:42:47,171][123090] Updated weights for policy 1, policy_version 1881124 (0.0010) [2023-12-26 14:42:47,179][123091] Updated weights for policy 0, policy_version 1892869 (0.0009) [2023-12-26 14:42:47,232][123091] Updated weights for policy 0, policy_version 1892879 (0.0010) [2023-12-26 14:42:47,236][123090] Updated weights for policy 1, policy_version 1881134 (0.0006) [2023-12-26 14:42:47,304][123090] Updated weights for policy 1, policy_version 1881144 (0.0006) [2023-12-26 14:42:47,957][123091] Updated weights for policy 0, policy_version 1892889 (0.0010) [2023-12-26 14:42:48,017][123091] Updated weights for policy 0, policy_version 1892899 (0.0011) [2023-12-26 14:42:48,044][123090] Updated weights for policy 1, policy_version 1881154 (0.0008) [2023-12-26 14:42:48,086][123091] Updated weights for policy 0, policy_version 1892909 (0.0011) [2023-12-26 14:42:48,106][123090] Updated weights for policy 1, policy_version 1881164 (0.0006) [2023-12-26 14:42:48,154][123090] Updated weights for policy 1, policy_version 1881174 (0.0008) [2023-12-26 14:42:48,206][123090] Updated weights for policy 1, policy_version 1881184 (0.0009) [2023-12-26 14:42:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966172672. Throughput: 0: 8789.1, 1: 8819.1. Samples: 966187660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:42:48,784][121949] Avg episode reward: [(0, '6094.045'), (1, '5878.597')] [2023-12-26 14:42:48,906][123091] Updated weights for policy 0, policy_version 1892919 (0.0010) [2023-12-26 14:42:48,976][123091] Updated weights for policy 0, policy_version 1892929 (0.0007) [2023-12-26 14:42:49,029][123090] Updated weights for policy 1, policy_version 1881194 (0.0005) [2023-12-26 14:42:49,037][123091] Updated weights for policy 0, policy_version 1892939 (0.0009) [2023-12-26 14:42:49,094][123090] Updated weights for policy 1, policy_version 1881204 (0.0005) [2023-12-26 14:42:49,159][123090] Updated weights for policy 1, policy_version 1881214 (0.0005) [2023-12-26 14:42:49,794][123091] Updated weights for policy 0, policy_version 1892949 (0.0008) [2023-12-26 14:42:49,852][123091] Updated weights for policy 0, policy_version 1892959 (0.0010) [2023-12-26 14:42:49,915][123090] Updated weights for policy 1, policy_version 1881224 (0.0009) [2023-12-26 14:42:49,922][123091] Updated weights for policy 0, policy_version 1892969 (0.0009) [2023-12-26 14:42:49,982][123090] Updated weights for policy 1, policy_version 1881234 (0.0007) [2023-12-26 14:42:50,036][123090] Updated weights for policy 1, policy_version 1881244 (0.0006) [2023-12-26 14:42:50,648][123091] Updated weights for policy 0, policy_version 1892979 (0.0007) [2023-12-26 14:42:50,706][123091] Updated weights for policy 0, policy_version 1892989 (0.0010) [2023-12-26 14:42:50,773][123091] Updated weights for policy 0, policy_version 1892999 (0.0010) [2023-12-26 14:42:50,887][123090] Updated weights for policy 1, policy_version 1881254 (0.0007) [2023-12-26 14:42:50,959][123090] Updated weights for policy 1, policy_version 1881264 (0.0006) [2023-12-26 14:42:51,040][123090] Updated weights for policy 1, policy_version 1881274 (0.0008) [2023-12-26 14:42:51,580][123091] Updated weights for policy 0, policy_version 1893009 (0.0009) [2023-12-26 14:42:51,646][123091] Updated weights for policy 0, policy_version 1893019 (0.0011) [2023-12-26 14:42:51,721][123091] Updated weights for policy 0, policy_version 1893029 (0.0011) [2023-12-26 14:42:51,785][123091] Updated weights for policy 0, policy_version 1893039 (0.0007) [2023-12-26 14:42:51,923][123090] Updated weights for policy 1, policy_version 1881284 (0.0009) [2023-12-26 14:42:51,980][123090] Updated weights for policy 1, policy_version 1881294 (0.0010) [2023-12-26 14:42:52,033][123090] Updated weights for policy 1, policy_version 1881304 (0.0009) [2023-12-26 14:42:52,550][123091] Updated weights for policy 0, policy_version 1893049 (0.0005) [2023-12-26 14:42:52,599][123091] Updated weights for policy 0, policy_version 1893059 (0.0005) [2023-12-26 14:42:52,651][123091] Updated weights for policy 0, policy_version 1893069 (0.0009) [2023-12-26 14:42:52,909][123090] Updated weights for policy 1, policy_version 1881314 (0.0009) [2023-12-26 14:42:52,989][123090] Updated weights for policy 1, policy_version 1881324 (0.0008) [2023-12-26 14:42:53,047][123090] Updated weights for policy 1, policy_version 1881334 (0.0009) [2023-12-26 14:42:53,116][123090] Updated weights for policy 1, policy_version 1881344 (0.0010) [2023-12-26 14:42:53,494][123091] Updated weights for policy 0, policy_version 1893079 (0.0008) [2023-12-26 14:42:53,556][123091] Updated weights for policy 0, policy_version 1893089 (0.0008) [2023-12-26 14:42:53,626][123091] Updated weights for policy 0, policy_version 1893099 (0.0008) [2023-12-26 14:42:53,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966262784. Throughput: 0: 8790.1, 1: 8796.5. Samples: 966240220. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:42:53,785][121949] Avg episode reward: [(0, '6092.337'), (1, '5983.611')] [2023-12-26 14:42:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001893104_484638720.pth... [2023-12-26 14:42:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001892080_484376576.pth [2023-12-26 14:42:53,830][123090] Updated weights for policy 1, policy_version 1881354 (0.0009) [2023-12-26 14:42:53,889][123090] Updated weights for policy 1, policy_version 1881364 (0.0010) [2023-12-26 14:42:53,944][123090] Updated weights for policy 1, policy_version 1881374 (0.0010) [2023-12-26 14:42:53,960][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001881376_481632256.pth... [2023-12-26 14:42:53,963][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001880320_481361920.pth [2023-12-26 14:42:54,219][123091] Updated weights for policy 0, policy_version 1893109 (0.0008) [2023-12-26 14:42:54,268][123091] Updated weights for policy 0, policy_version 1893119 (0.0006) [2023-12-26 14:42:54,318][123091] Updated weights for policy 0, policy_version 1893130 (0.0007) [2023-12-26 14:42:54,785][123090] Updated weights for policy 1, policy_version 1881384 (0.0010) [2023-12-26 14:42:54,840][123090] Updated weights for policy 1, policy_version 1881394 (0.0010) [2023-12-26 14:42:54,895][123090] Updated weights for policy 1, policy_version 1881404 (0.0010) [2023-12-26 14:42:55,135][123091] Updated weights for policy 0, policy_version 1893140 (0.0007) [2023-12-26 14:42:55,201][123091] Updated weights for policy 0, policy_version 1893150 (0.0011) [2023-12-26 14:42:55,263][123091] Updated weights for policy 0, policy_version 1893160 (0.0011) [2023-12-26 14:42:55,605][123090] Updated weights for policy 1, policy_version 1881414 (0.0010) [2023-12-26 14:42:55,654][123090] Updated weights for policy 1, policy_version 1881424 (0.0009) [2023-12-26 14:42:55,722][123090] Updated weights for policy 1, policy_version 1881434 (0.0005) [2023-12-26 14:42:56,066][123091] Updated weights for policy 0, policy_version 1893170 (0.0011) [2023-12-26 14:42:56,117][123091] Updated weights for policy 0, policy_version 1893180 (0.0010) [2023-12-26 14:42:56,186][123091] Updated weights for policy 0, policy_version 1893190 (0.0010) [2023-12-26 14:42:56,251][123091] Updated weights for policy 0, policy_version 1893200 (0.0011) [2023-12-26 14:42:56,485][123090] Updated weights for policy 1, policy_version 1881444 (0.0007) [2023-12-26 14:42:56,536][123090] Updated weights for policy 1, policy_version 1881454 (0.0010) [2023-12-26 14:42:56,586][123090] Updated weights for policy 1, policy_version 1881464 (0.0010) [2023-12-26 14:42:57,011][123091] Updated weights for policy 0, policy_version 1893210 (0.0007) [2023-12-26 14:42:57,062][123091] Updated weights for policy 0, policy_version 1893220 (0.0005) [2023-12-26 14:42:57,117][123091] Updated weights for policy 0, policy_version 1893230 (0.0005) [2023-12-26 14:42:57,338][123090] Updated weights for policy 1, policy_version 1881474 (0.0009) [2023-12-26 14:42:57,391][123090] Updated weights for policy 1, policy_version 1881484 (0.0005) [2023-12-26 14:42:57,464][123090] Updated weights for policy 1, policy_version 1881494 (0.0005) [2023-12-26 14:42:57,515][123090] Updated weights for policy 1, policy_version 1881504 (0.0005) [2023-12-26 14:42:57,939][123091] Updated weights for policy 0, policy_version 1893240 (0.0009) [2023-12-26 14:42:57,998][123091] Updated weights for policy 0, policy_version 1893251 (0.0010) [2023-12-26 14:42:58,056][123091] Updated weights for policy 0, policy_version 1893261 (0.0009) [2023-12-26 14:42:58,165][123090] Updated weights for policy 1, policy_version 1881514 (0.0008) [2023-12-26 14:42:58,232][123090] Updated weights for policy 1, policy_version 1881524 (0.0008) [2023-12-26 14:42:58,297][123090] Updated weights for policy 1, policy_version 1881534 (0.0008) [2023-12-26 14:42:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966352896. Throughput: 0: 8849.5, 1: 8864.1. Samples: 966349820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:42:58,785][121949] Avg episode reward: [(0, '6236.216'), (1, '5879.708')] [2023-12-26 14:42:59,015][123091] Updated weights for policy 0, policy_version 1893271 (0.0008) [2023-12-26 14:42:59,080][123091] Updated weights for policy 0, policy_version 1893281 (0.0008) [2023-12-26 14:42:59,144][123091] Updated weights for policy 0, policy_version 1893291 (0.0008) [2023-12-26 14:42:59,184][123090] Updated weights for policy 1, policy_version 1881544 (0.0009) [2023-12-26 14:42:59,258][123090] Updated weights for policy 1, policy_version 1881554 (0.0008) [2023-12-26 14:42:59,321][123090] Updated weights for policy 1, policy_version 1881564 (0.0010) [2023-12-26 14:42:59,884][123091] Updated weights for policy 0, policy_version 1893301 (0.0009) [2023-12-26 14:42:59,947][123091] Updated weights for policy 0, policy_version 1893311 (0.0009) [2023-12-26 14:43:00,006][123091] Updated weights for policy 0, policy_version 1893321 (0.0009) [2023-12-26 14:43:00,040][123090] Updated weights for policy 1, policy_version 1881574 (0.0008) [2023-12-26 14:43:00,103][123090] Updated weights for policy 1, policy_version 1881584 (0.0009) [2023-12-26 14:43:00,166][123090] Updated weights for policy 1, policy_version 1881594 (0.0008) [2023-12-26 14:43:00,852][123091] Updated weights for policy 0, policy_version 1893331 (0.0009) [2023-12-26 14:43:00,902][123091] Updated weights for policy 0, policy_version 1893341 (0.0006) [2023-12-26 14:43:00,949][123091] Updated weights for policy 0, policy_version 1893351 (0.0005) [2023-12-26 14:43:00,951][123090] Updated weights for policy 1, policy_version 1881604 (0.0008) [2023-12-26 14:43:01,007][123090] Updated weights for policy 1, policy_version 1881614 (0.0005) [2023-12-26 14:43:01,071][123090] Updated weights for policy 1, policy_version 1881624 (0.0009) [2023-12-26 14:43:01,771][123091] Updated weights for policy 0, policy_version 1893361 (0.0006) [2023-12-26 14:43:01,819][123091] Updated weights for policy 0, policy_version 1893371 (0.0008) [2023-12-26 14:43:01,872][123091] Updated weights for policy 0, policy_version 1893381 (0.0007) [2023-12-26 14:43:01,875][123090] Updated weights for policy 1, policy_version 1881634 (0.0010) [2023-12-26 14:43:01,925][123091] Updated weights for policy 0, policy_version 1893391 (0.0008) [2023-12-26 14:43:01,938][123090] Updated weights for policy 1, policy_version 1881644 (0.0010) [2023-12-26 14:43:02,000][123090] Updated weights for policy 1, policy_version 1881654 (0.0010) [2023-12-26 14:43:02,064][123090] Updated weights for policy 1, policy_version 1881664 (0.0010) [2023-12-26 14:43:02,703][123091] Updated weights for policy 0, policy_version 1893401 (0.0010) [2023-12-26 14:43:02,766][123091] Updated weights for policy 0, policy_version 1893411 (0.0011) [2023-12-26 14:43:02,824][123091] Updated weights for policy 0, policy_version 1893421 (0.0011) [2023-12-26 14:43:02,894][123090] Updated weights for policy 1, policy_version 1881674 (0.0010) [2023-12-26 14:43:02,938][123090] Updated weights for policy 1, policy_version 1881684 (0.0010) [2023-12-26 14:43:02,986][123090] Updated weights for policy 1, policy_version 1881694 (0.0010) [2023-12-26 14:43:03,643][123091] Updated weights for policy 0, policy_version 1893431 (0.0010) [2023-12-26 14:43:03,690][123091] Updated weights for policy 0, policy_version 1893441 (0.0008) [2023-12-26 14:43:03,742][123091] Updated weights for policy 0, policy_version 1893451 (0.0009) [2023-12-26 14:43:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966443008. Throughput: 0: 8774.2, 1: 8889.8. Samples: 966453588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:03,785][121949] Avg episode reward: [(0, '6409.496'), (1, '5783.100')] [2023-12-26 14:43:03,852][123090] Updated weights for policy 1, policy_version 1881704 (0.0011) [2023-12-26 14:43:03,921][123090] Updated weights for policy 1, policy_version 1881714 (0.0009) [2023-12-26 14:43:03,994][123090] Updated weights for policy 1, policy_version 1881724 (0.0007) [2023-12-26 14:43:04,545][123091] Updated weights for policy 0, policy_version 1893461 (0.0008) [2023-12-26 14:43:04,609][123091] Updated weights for policy 0, policy_version 1893471 (0.0008) [2023-12-26 14:43:04,672][123091] Updated weights for policy 0, policy_version 1893481 (0.0009) [2023-12-26 14:43:04,778][123090] Updated weights for policy 1, policy_version 1881734 (0.0010) [2023-12-26 14:43:04,848][123090] Updated weights for policy 1, policy_version 1881744 (0.0010) [2023-12-26 14:43:04,917][123090] Updated weights for policy 1, policy_version 1881754 (0.0010) [2023-12-26 14:43:05,502][123091] Updated weights for policy 0, policy_version 1893491 (0.0009) [2023-12-26 14:43:05,568][123091] Updated weights for policy 0, policy_version 1893501 (0.0010) [2023-12-26 14:43:05,623][123091] Updated weights for policy 0, policy_version 1893511 (0.0005) [2023-12-26 14:43:05,732][123090] Updated weights for policy 1, policy_version 1881764 (0.0010) [2023-12-26 14:43:05,804][123090] Updated weights for policy 1, policy_version 1881774 (0.0011) [2023-12-26 14:43:05,855][123090] Updated weights for policy 1, policy_version 1881784 (0.0010) [2023-12-26 14:43:06,333][123091] Updated weights for policy 0, policy_version 1893521 (0.0006) [2023-12-26 14:43:06,389][123091] Updated weights for policy 0, policy_version 1893531 (0.0011) [2023-12-26 14:43:06,450][123091] Updated weights for policy 0, policy_version 1893541 (0.0009) [2023-12-26 14:43:06,521][123091] Updated weights for policy 0, policy_version 1893551 (0.0005) [2023-12-26 14:43:06,691][123090] Updated weights for policy 1, policy_version 1881794 (0.0011) [2023-12-26 14:43:06,750][123090] Updated weights for policy 1, policy_version 1881804 (0.0011) [2023-12-26 14:43:06,822][123090] Updated weights for policy 1, policy_version 1881814 (0.0011) [2023-12-26 14:43:06,889][123090] Updated weights for policy 1, policy_version 1881824 (0.0011) [2023-12-26 14:43:07,235][123091] Updated weights for policy 0, policy_version 1893561 (0.0010) [2023-12-26 14:43:07,305][123091] Updated weights for policy 0, policy_version 1893571 (0.0010) [2023-12-26 14:43:07,375][123091] Updated weights for policy 0, policy_version 1893581 (0.0011) [2023-12-26 14:43:07,672][123090] Updated weights for policy 1, policy_version 1881834 (0.0011) [2023-12-26 14:43:07,724][123090] Updated weights for policy 1, policy_version 1881844 (0.0011) [2023-12-26 14:43:07,774][123090] Updated weights for policy 1, policy_version 1881854 (0.0010) [2023-12-26 14:43:08,095][123091] Updated weights for policy 0, policy_version 1893591 (0.0011) [2023-12-26 14:43:08,161][123091] Updated weights for policy 0, policy_version 1893601 (0.0010) [2023-12-26 14:43:08,234][123091] Updated weights for policy 0, policy_version 1893611 (0.0011) [2023-12-26 14:43:08,537][123090] Updated weights for policy 1, policy_version 1881864 (0.0009) [2023-12-26 14:43:08,602][123090] Updated weights for policy 1, policy_version 1881874 (0.0008) [2023-12-26 14:43:08,650][123090] Updated weights for policy 1, policy_version 1881884 (0.0010) [2023-12-26 14:43:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 966533120. Throughput: 0: 8821.3, 1: 8908.2. Samples: 966506504. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:08,785][121949] Avg episode reward: [(0, '6408.116'), (1, '5730.451')] [2023-12-26 14:43:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001893616_484769792.pth... [2023-12-26 14:43:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001881888_481763328.pth... [2023-12-26 14:43:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001892592_484507648.pth [2023-12-26 14:43:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001880864_481501184.pth [2023-12-26 14:43:08,933][123091] Updated weights for policy 0, policy_version 1893621 (0.0008) [2023-12-26 14:43:08,998][123091] Updated weights for policy 0, policy_version 1893631 (0.0007) [2023-12-26 14:43:09,060][123091] Updated weights for policy 0, policy_version 1893641 (0.0008) [2023-12-26 14:43:09,469][123090] Updated weights for policy 1, policy_version 1881894 (0.0009) [2023-12-26 14:43:09,536][123090] Updated weights for policy 1, policy_version 1881904 (0.0011) [2023-12-26 14:43:09,603][123090] Updated weights for policy 1, policy_version 1881914 (0.0011) [2023-12-26 14:43:09,866][123091] Updated weights for policy 0, policy_version 1893651 (0.0006) [2023-12-26 14:43:09,935][123091] Updated weights for policy 0, policy_version 1893661 (0.0009) [2023-12-26 14:43:09,992][123091] Updated weights for policy 0, policy_version 1893671 (0.0009) [2023-12-26 14:43:10,481][123090] Updated weights for policy 1, policy_version 1881924 (0.0010) [2023-12-26 14:43:10,542][123090] Updated weights for policy 1, policy_version 1881934 (0.0009) [2023-12-26 14:43:10,593][123090] Updated weights for policy 1, policy_version 1881944 (0.0007) [2023-12-26 14:43:10,796][123091] Updated weights for policy 0, policy_version 1893681 (0.0009) [2023-12-26 14:43:10,857][123091] Updated weights for policy 0, policy_version 1893691 (0.0010) [2023-12-26 14:43:10,921][123091] Updated weights for policy 0, policy_version 1893701 (0.0011) [2023-12-26 14:43:10,990][123091] Updated weights for policy 0, policy_version 1893711 (0.0010) [2023-12-26 14:43:11,420][123090] Updated weights for policy 1, policy_version 1881954 (0.0009) [2023-12-26 14:43:11,473][123090] Updated weights for policy 1, policy_version 1881964 (0.0009) [2023-12-26 14:43:11,526][123090] Updated weights for policy 1, policy_version 1881974 (0.0009) [2023-12-26 14:43:11,587][123090] Updated weights for policy 1, policy_version 1881984 (0.0009) [2023-12-26 14:43:11,839][123091] Updated weights for policy 0, policy_version 1893721 (0.0006) [2023-12-26 14:43:11,902][123091] Updated weights for policy 0, policy_version 1893731 (0.0007) [2023-12-26 14:43:11,972][123091] Updated weights for policy 0, policy_version 1893741 (0.0007) [2023-12-26 14:43:12,473][123090] Updated weights for policy 1, policy_version 1881994 (0.0010) [2023-12-26 14:43:12,540][123090] Updated weights for policy 1, policy_version 1882004 (0.0005) [2023-12-26 14:43:12,608][123090] Updated weights for policy 1, policy_version 1882014 (0.0007) [2023-12-26 14:43:12,778][123091] Updated weights for policy 0, policy_version 1893751 (0.0010) [2023-12-26 14:43:12,838][123091] Updated weights for policy 0, policy_version 1893761 (0.0009) [2023-12-26 14:43:12,897][123091] Updated weights for policy 0, policy_version 1893771 (0.0010) [2023-12-26 14:43:13,340][123090] Updated weights for policy 1, policy_version 1882024 (0.0010) [2023-12-26 14:43:13,404][123090] Updated weights for policy 1, policy_version 1882034 (0.0011) [2023-12-26 14:43:13,452][123090] Updated weights for policy 1, policy_version 1882044 (0.0010) [2023-12-26 14:43:13,747][123091] Updated weights for policy 0, policy_version 1893781 (0.0009) [2023-12-26 14:43:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966615040. Throughput: 0: 8896.4, 1: 8797.3. Samples: 966611620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:13,785][121949] Avg episode reward: [(0, '6296.737'), (1, '5687.448')] [2023-12-26 14:43:13,806][123091] Updated weights for policy 0, policy_version 1893791 (0.0008) [2023-12-26 14:43:13,861][123091] Updated weights for policy 0, policy_version 1893801 (0.0008) [2023-12-26 14:43:14,211][123090] Updated weights for policy 1, policy_version 1882054 (0.0009) [2023-12-26 14:43:14,267][123090] Updated weights for policy 1, policy_version 1882064 (0.0007) [2023-12-26 14:43:14,326][123090] Updated weights for policy 1, policy_version 1882074 (0.0005) [2023-12-26 14:43:14,758][123091] Updated weights for policy 0, policy_version 1893811 (0.0009) [2023-12-26 14:43:14,820][123091] Updated weights for policy 0, policy_version 1893821 (0.0009) [2023-12-26 14:43:14,880][123091] Updated weights for policy 0, policy_version 1893831 (0.0009) [2023-12-26 14:43:14,982][123090] Updated weights for policy 1, policy_version 1882084 (0.0006) [2023-12-26 14:43:15,053][123090] Updated weights for policy 1, policy_version 1882094 (0.0009) [2023-12-26 14:43:15,105][123090] Updated weights for policy 1, policy_version 1882104 (0.0011) [2023-12-26 14:43:15,732][123091] Updated weights for policy 0, policy_version 1893841 (0.0009) [2023-12-26 14:43:15,795][123091] Updated weights for policy 0, policy_version 1893851 (0.0008) [2023-12-26 14:43:15,857][123091] Updated weights for policy 0, policy_version 1893861 (0.0006) [2023-12-26 14:43:15,915][123091] Updated weights for policy 0, policy_version 1893871 (0.0009) [2023-12-26 14:43:15,940][123090] Updated weights for policy 1, policy_version 1882114 (0.0010) [2023-12-26 14:43:16,006][123090] Updated weights for policy 1, policy_version 1882124 (0.0011) [2023-12-26 14:43:16,072][123090] Updated weights for policy 1, policy_version 1882134 (0.0010) [2023-12-26 14:43:16,127][123090] Updated weights for policy 1, policy_version 1882144 (0.0010) [2023-12-26 14:43:16,741][123091] Updated weights for policy 0, policy_version 1893881 (0.0009) [2023-12-26 14:43:16,799][123091] Updated weights for policy 0, policy_version 1893891 (0.0008) [2023-12-26 14:43:16,873][123091] Updated weights for policy 0, policy_version 1893901 (0.0005) [2023-12-26 14:43:16,889][123090] Updated weights for policy 1, policy_version 1882154 (0.0011) [2023-12-26 14:43:16,955][123090] Updated weights for policy 1, policy_version 1882164 (0.0011) [2023-12-26 14:43:17,018][123090] Updated weights for policy 1, policy_version 1882174 (0.0010) [2023-12-26 14:43:17,602][123091] Updated weights for policy 0, policy_version 1893911 (0.0006) [2023-12-26 14:43:17,663][123091] Updated weights for policy 0, policy_version 1893921 (0.0005) [2023-12-26 14:43:17,726][123091] Updated weights for policy 0, policy_version 1893931 (0.0005) [2023-12-26 14:43:17,744][123090] Updated weights for policy 1, policy_version 1882184 (0.0007) [2023-12-26 14:43:17,794][123090] Updated weights for policy 1, policy_version 1882194 (0.0005) [2023-12-26 14:43:17,853][123090] Updated weights for policy 1, policy_version 1882204 (0.0006) [2023-12-26 14:43:18,444][123091] Updated weights for policy 0, policy_version 1893941 (0.0007) [2023-12-26 14:43:18,504][123091] Updated weights for policy 0, policy_version 1893951 (0.0008) [2023-12-26 14:43:18,556][123090] Updated weights for policy 1, policy_version 1882214 (0.0007) [2023-12-26 14:43:18,569][123091] Updated weights for policy 0, policy_version 1893961 (0.0010) [2023-12-26 14:43:18,609][123090] Updated weights for policy 1, policy_version 1882224 (0.0010) [2023-12-26 14:43:18,661][123090] Updated weights for policy 1, policy_version 1882234 (0.0008) [2023-12-26 14:43:18,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 966713344. Throughput: 0: 8894.3, 1: 8839.7. Samples: 966719772. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:18,785][121949] Avg episode reward: [(0, '6218.484'), (1, '5858.683')] [2023-12-26 14:43:19,344][123091] Updated weights for policy 0, policy_version 1893971 (0.0010) [2023-12-26 14:43:19,412][123091] Updated weights for policy 0, policy_version 1893981 (0.0008) [2023-12-26 14:43:19,475][123091] Updated weights for policy 0, policy_version 1893991 (0.0006) [2023-12-26 14:43:19,635][123090] Updated weights for policy 1, policy_version 1882244 (0.0009) [2023-12-26 14:43:19,698][123090] Updated weights for policy 1, policy_version 1882254 (0.0007) [2023-12-26 14:43:19,765][123090] Updated weights for policy 1, policy_version 1882264 (0.0005) [2023-12-26 14:43:20,319][123091] Updated weights for policy 0, policy_version 1894001 (0.0008) [2023-12-26 14:43:20,387][123091] Updated weights for policy 0, policy_version 1894011 (0.0010) [2023-12-26 14:43:20,454][123091] Updated weights for policy 0, policy_version 1894021 (0.0010) [2023-12-26 14:43:20,521][123091] Updated weights for policy 0, policy_version 1894031 (0.0010) [2023-12-26 14:43:20,541][123090] Updated weights for policy 1, policy_version 1882274 (0.0006) [2023-12-26 14:43:20,611][123090] Updated weights for policy 1, policy_version 1882284 (0.0007) [2023-12-26 14:43:20,680][123090] Updated weights for policy 1, policy_version 1882294 (0.0006) [2023-12-26 14:43:20,746][123090] Updated weights for policy 1, policy_version 1882304 (0.0009) [2023-12-26 14:43:21,311][123091] Updated weights for policy 0, policy_version 1894041 (0.0009) [2023-12-26 14:43:21,385][123091] Updated weights for policy 0, policy_version 1894051 (0.0009) [2023-12-26 14:43:21,449][123091] Updated weights for policy 0, policy_version 1894061 (0.0009) [2023-12-26 14:43:21,556][123090] Updated weights for policy 1, policy_version 1882314 (0.0009) [2023-12-26 14:43:21,632][123090] Updated weights for policy 1, policy_version 1882324 (0.0010) [2023-12-26 14:43:21,702][123090] Updated weights for policy 1, policy_version 1882334 (0.0009) [2023-12-26 14:43:22,245][123091] Updated weights for policy 0, policy_version 1894071 (0.0010) [2023-12-26 14:43:22,311][123091] Updated weights for policy 0, policy_version 1894081 (0.0009) [2023-12-26 14:43:22,378][123091] Updated weights for policy 0, policy_version 1894091 (0.0009) [2023-12-26 14:43:22,477][123090] Updated weights for policy 1, policy_version 1882344 (0.0009) [2023-12-26 14:43:22,538][123090] Updated weights for policy 1, policy_version 1882354 (0.0009) [2023-12-26 14:43:22,596][123090] Updated weights for policy 1, policy_version 1882364 (0.0010) [2023-12-26 14:43:23,272][123091] Updated weights for policy 0, policy_version 1894101 (0.0010) [2023-12-26 14:43:23,324][123091] Updated weights for policy 0, policy_version 1894112 (0.0010) [2023-12-26 14:43:23,338][123090] Updated weights for policy 1, policy_version 1882374 (0.0007) [2023-12-26 14:43:23,381][123091] Updated weights for policy 0, policy_version 1894122 (0.0009) [2023-12-26 14:43:23,398][123090] Updated weights for policy 1, policy_version 1882384 (0.0005) [2023-12-26 14:43:23,458][123090] Updated weights for policy 1, policy_version 1882394 (0.0005) [2023-12-26 14:43:23,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966795264. Throughput: 0: 8827.7, 1: 8830.9. Samples: 966771092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:23,785][121949] Avg episode reward: [(0, '6218.152'), (1, '5938.536')] [2023-12-26 14:43:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001894128_484900864.pth... [2023-12-26 14:43:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001882400_481894400.pth... [2023-12-26 14:43:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001893104_484638720.pth [2023-12-26 14:43:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001881376_481632256.pth [2023-12-26 14:43:24,072][123090] Updated weights for policy 1, policy_version 1882404 (0.0005) [2023-12-26 14:43:24,147][123090] Updated weights for policy 1, policy_version 1882414 (0.0005) [2023-12-26 14:43:24,216][123090] Updated weights for policy 1, policy_version 1882424 (0.0009) [2023-12-26 14:43:24,309][123091] Updated weights for policy 0, policy_version 1894132 (0.0009) [2023-12-26 14:43:24,364][123091] Updated weights for policy 0, policy_version 1894142 (0.0009) [2023-12-26 14:43:24,421][123091] Updated weights for policy 0, policy_version 1894152 (0.0010) [2023-12-26 14:43:24,938][123090] Updated weights for policy 1, policy_version 1882434 (0.0008) [2023-12-26 14:43:24,997][123090] Updated weights for policy 1, policy_version 1882444 (0.0005) [2023-12-26 14:43:25,055][123090] Updated weights for policy 1, policy_version 1882454 (0.0006) [2023-12-26 14:43:25,102][123090] Updated weights for policy 1, policy_version 1882464 (0.0006) [2023-12-26 14:43:25,331][123091] Updated weights for policy 0, policy_version 1894162 (0.0009) [2023-12-26 14:43:25,384][123091] Updated weights for policy 0, policy_version 1894172 (0.0010) [2023-12-26 14:43:25,437][123091] Updated weights for policy 0, policy_version 1894182 (0.0009) [2023-12-26 14:43:25,502][123091] Updated weights for policy 0, policy_version 1894192 (0.0010) [2023-12-26 14:43:25,723][123090] Updated weights for policy 1, policy_version 1882474 (0.0010) [2023-12-26 14:43:25,784][123090] Updated weights for policy 1, policy_version 1882484 (0.0010) [2023-12-26 14:43:25,850][123090] Updated weights for policy 1, policy_version 1882494 (0.0010) [2023-12-26 14:43:26,373][123091] Updated weights for policy 0, policy_version 1894202 (0.0009) [2023-12-26 14:43:26,429][123091] Updated weights for policy 0, policy_version 1894212 (0.0009) [2023-12-26 14:43:26,484][123091] Updated weights for policy 0, policy_version 1894222 (0.0008) [2023-12-26 14:43:26,648][123090] Updated weights for policy 1, policy_version 1882504 (0.0010) [2023-12-26 14:43:26,695][123090] Updated weights for policy 1, policy_version 1882514 (0.0010) [2023-12-26 14:43:26,748][123090] Updated weights for policy 1, policy_version 1882524 (0.0008) [2023-12-26 14:43:27,326][123091] Updated weights for policy 0, policy_version 1894232 (0.0009) [2023-12-26 14:43:27,380][123091] Updated weights for policy 0, policy_version 1894242 (0.0009) [2023-12-26 14:43:27,430][123091] Updated weights for policy 0, policy_version 1894252 (0.0009) [2023-12-26 14:43:27,539][123090] Updated weights for policy 1, policy_version 1882534 (0.0005) [2023-12-26 14:43:27,602][123090] Updated weights for policy 1, policy_version 1882544 (0.0006) [2023-12-26 14:43:27,663][123090] Updated weights for policy 1, policy_version 1882554 (0.0005) [2023-12-26 14:43:28,306][123090] Updated weights for policy 1, policy_version 1882564 (0.0006) [2023-12-26 14:43:28,351][123091] Updated weights for policy 0, policy_version 1894262 (0.0009) [2023-12-26 14:43:28,373][123090] Updated weights for policy 1, policy_version 1882574 (0.0010) [2023-12-26 14:43:28,406][123091] Updated weights for policy 0, policy_version 1894272 (0.0006) [2023-12-26 14:43:28,433][123090] Updated weights for policy 1, policy_version 1882584 (0.0010) [2023-12-26 14:43:28,465][123091] Updated weights for policy 0, policy_version 1894282 (0.0006) [2023-12-26 14:43:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966885376. Throughput: 0: 8800.7, 1: 8928.3. Samples: 966876896. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:28,784][121949] Avg episode reward: [(0, '6344.706'), (1, '5939.668')] [2023-12-26 14:43:29,251][123090] Updated weights for policy 1, policy_version 1882594 (0.0010) [2023-12-26 14:43:29,313][123091] Updated weights for policy 0, policy_version 1894292 (0.0007) [2023-12-26 14:43:29,319][123090] Updated weights for policy 1, policy_version 1882604 (0.0011) [2023-12-26 14:43:29,382][123091] Updated weights for policy 0, policy_version 1894302 (0.0009) [2023-12-26 14:43:29,388][123090] Updated weights for policy 1, policy_version 1882614 (0.0010) [2023-12-26 14:43:29,445][123091] Updated weights for policy 0, policy_version 1894312 (0.0006) [2023-12-26 14:43:29,447][123090] Updated weights for policy 1, policy_version 1882624 (0.0010) [2023-12-26 14:43:30,271][123091] Updated weights for policy 0, policy_version 1894322 (0.0008) [2023-12-26 14:43:30,277][123090] Updated weights for policy 1, policy_version 1882634 (0.0010) [2023-12-26 14:43:30,320][123091] Updated weights for policy 0, policy_version 1894332 (0.0008) [2023-12-26 14:43:30,339][123090] Updated weights for policy 1, policy_version 1882644 (0.0010) [2023-12-26 14:43:30,371][123091] Updated weights for policy 0, policy_version 1894342 (0.0008) [2023-12-26 14:43:30,406][123090] Updated weights for policy 1, policy_version 1882654 (0.0010) [2023-12-26 14:43:30,420][123091] Updated weights for policy 0, policy_version 1894352 (0.0009) [2023-12-26 14:43:31,223][123090] Updated weights for policy 1, policy_version 1882664 (0.0011) [2023-12-26 14:43:31,288][123090] Updated weights for policy 1, policy_version 1882674 (0.0011) [2023-12-26 14:43:31,300][123091] Updated weights for policy 0, policy_version 1894362 (0.0009) [2023-12-26 14:43:31,347][123090] Updated weights for policy 1, policy_version 1882684 (0.0011) [2023-12-26 14:43:31,355][123091] Updated weights for policy 0, policy_version 1894372 (0.0009) [2023-12-26 14:43:31,425][123091] Updated weights for policy 0, policy_version 1894382 (0.0010) [2023-12-26 14:43:32,187][123090] Updated weights for policy 1, policy_version 1882694 (0.0010) [2023-12-26 14:43:32,255][123090] Updated weights for policy 1, policy_version 1882704 (0.0009) [2023-12-26 14:43:32,294][123091] Updated weights for policy 0, policy_version 1894392 (0.0009) [2023-12-26 14:43:32,326][123090] Updated weights for policy 1, policy_version 1882714 (0.0010) [2023-12-26 14:43:32,369][123091] Updated weights for policy 0, policy_version 1894402 (0.0007) [2023-12-26 14:43:32,436][123091] Updated weights for policy 0, policy_version 1894412 (0.0009) [2023-12-26 14:43:33,058][123090] Updated weights for policy 1, policy_version 1882724 (0.0009) [2023-12-26 14:43:33,121][123090] Updated weights for policy 1, policy_version 1882734 (0.0010) [2023-12-26 14:43:33,159][123091] Updated weights for policy 0, policy_version 1894422 (0.0009) [2023-12-26 14:43:33,181][123090] Updated weights for policy 1, policy_version 1882744 (0.0011) [2023-12-26 14:43:33,212][123091] Updated weights for policy 0, policy_version 1894432 (0.0008) [2023-12-26 14:43:33,258][123091] Updated weights for policy 0, policy_version 1894442 (0.0009) [2023-12-26 14:43:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 966967296. Throughput: 0: 8692.6, 1: 8925.6. Samples: 966980480. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:33,785][121949] Avg episode reward: [(0, '6334.866'), (1, '5777.532')] [2023-12-26 14:43:33,836][123090] Updated weights for policy 1, policy_version 1882754 (0.0009) [2023-12-26 14:43:33,886][123090] Updated weights for policy 1, policy_version 1882764 (0.0005) [2023-12-26 14:43:33,931][123090] Updated weights for policy 1, policy_version 1882774 (0.0005) [2023-12-26 14:43:33,981][123090] Updated weights for policy 1, policy_version 1882784 (0.0005) [2023-12-26 14:43:34,169][123091] Updated weights for policy 0, policy_version 1894452 (0.0009) [2023-12-26 14:43:34,232][123091] Updated weights for policy 0, policy_version 1894462 (0.0010) [2023-12-26 14:43:34,299][123091] Updated weights for policy 0, policy_version 1894472 (0.0009) [2023-12-26 14:43:34,733][123090] Updated weights for policy 1, policy_version 1882794 (0.0005) [2023-12-26 14:43:34,801][123090] Updated weights for policy 1, policy_version 1882804 (0.0006) [2023-12-26 14:43:34,871][123090] Updated weights for policy 1, policy_version 1882814 (0.0009) [2023-12-26 14:43:35,096][123091] Updated weights for policy 0, policy_version 1894482 (0.0008) [2023-12-26 14:43:35,165][123091] Updated weights for policy 0, policy_version 1894492 (0.0006) [2023-12-26 14:43:35,232][123091] Updated weights for policy 0, policy_version 1894502 (0.0007) [2023-12-26 14:43:35,304][123091] Updated weights for policy 0, policy_version 1894512 (0.0007) [2023-12-26 14:43:35,613][123090] Updated weights for policy 1, policy_version 1882824 (0.0006) [2023-12-26 14:43:35,671][123090] Updated weights for policy 1, policy_version 1882834 (0.0005) [2023-12-26 14:43:35,718][123090] Updated weights for policy 1, policy_version 1882844 (0.0005) [2023-12-26 14:43:36,004][123091] Updated weights for policy 0, policy_version 1894522 (0.0005) [2023-12-26 14:43:36,068][123091] Updated weights for policy 0, policy_version 1894532 (0.0008) [2023-12-26 14:43:36,143][123091] Updated weights for policy 0, policy_version 1894542 (0.0008) [2023-12-26 14:43:36,427][123090] Updated weights for policy 1, policy_version 1882854 (0.0008) [2023-12-26 14:43:36,487][123090] Updated weights for policy 1, policy_version 1882864 (0.0011) [2023-12-26 14:43:36,554][123090] Updated weights for policy 1, policy_version 1882874 (0.0010) [2023-12-26 14:43:36,859][123091] Updated weights for policy 0, policy_version 1894552 (0.0005) [2023-12-26 14:43:36,924][123091] Updated weights for policy 0, policy_version 1894562 (0.0008) [2023-12-26 14:43:36,978][123091] Updated weights for policy 0, policy_version 1894572 (0.0010) [2023-12-26 14:43:37,200][123090] Updated weights for policy 1, policy_version 1882884 (0.0007) [2023-12-26 14:43:37,277][123090] Updated weights for policy 1, policy_version 1882894 (0.0005) [2023-12-26 14:43:37,350][123090] Updated weights for policy 1, policy_version 1882904 (0.0005) [2023-12-26 14:43:37,857][123091] Updated weights for policy 0, policy_version 1894582 (0.0009) [2023-12-26 14:43:37,904][123091] Updated weights for policy 0, policy_version 1894592 (0.0008) [2023-12-26 14:43:37,957][123091] Updated weights for policy 0, policy_version 1894602 (0.0009) [2023-12-26 14:43:38,039][123090] Updated weights for policy 1, policy_version 1882914 (0.0006) [2023-12-26 14:43:38,104][123090] Updated weights for policy 1, policy_version 1882924 (0.0010) [2023-12-26 14:43:38,156][123090] Updated weights for policy 1, policy_version 1882934 (0.0010) [2023-12-26 14:43:38,207][123090] Updated weights for policy 1, policy_version 1882944 (0.0010) [2023-12-26 14:43:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 967057408. Throughput: 0: 8677.8, 1: 9006.5. Samples: 967036012. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:38,785][121949] Avg episode reward: [(0, '6295.291'), (1, '5823.330')] [2023-12-26 14:43:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001882944_482033664.pth... [2023-12-26 14:43:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001881888_481763328.pth [2023-12-26 14:43:38,826][123091] Updated weights for policy 0, policy_version 1894612 (0.0010) [2023-12-26 14:43:38,881][123091] Updated weights for policy 0, policy_version 1894622 (0.0009) [2023-12-26 14:43:38,936][123091] Updated weights for policy 0, policy_version 1894632 (0.0009) [2023-12-26 14:43:38,986][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001894640_485031936.pth... [2023-12-26 14:43:38,990][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001893616_484769792.pth [2023-12-26 14:43:39,050][123090] Updated weights for policy 1, policy_version 1882954 (0.0009) [2023-12-26 14:43:39,108][123090] Updated weights for policy 1, policy_version 1882964 (0.0010) [2023-12-26 14:43:39,161][123090] Updated weights for policy 1, policy_version 1882974 (0.0010) [2023-12-26 14:43:39,847][123091] Updated weights for policy 0, policy_version 1894642 (0.0010) [2023-12-26 14:43:39,907][123091] Updated weights for policy 0, policy_version 1894652 (0.0010) [2023-12-26 14:43:39,977][123091] Updated weights for policy 0, policy_version 1894662 (0.0011) [2023-12-26 14:43:39,993][123090] Updated weights for policy 1, policy_version 1882984 (0.0010) [2023-12-26 14:43:40,034][123091] Updated weights for policy 0, policy_version 1894672 (0.0011) [2023-12-26 14:43:40,059][123090] Updated weights for policy 1, policy_version 1882994 (0.0009) [2023-12-26 14:43:40,117][123090] Updated weights for policy 1, policy_version 1883004 (0.0009) [2023-12-26 14:43:40,879][123091] Updated weights for policy 0, policy_version 1894682 (0.0011) [2023-12-26 14:43:40,931][123091] Updated weights for policy 0, policy_version 1894692 (0.0010) [2023-12-26 14:43:40,959][123090] Updated weights for policy 1, policy_version 1883014 (0.0008) [2023-12-26 14:43:40,986][123091] Updated weights for policy 0, policy_version 1894702 (0.0010) [2023-12-26 14:43:41,008][123090] Updated weights for policy 1, policy_version 1883024 (0.0006) [2023-12-26 14:43:41,074][123090] Updated weights for policy 1, policy_version 1883034 (0.0009) [2023-12-26 14:43:41,831][123091] Updated weights for policy 0, policy_version 1894712 (0.0010) [2023-12-26 14:43:41,891][123091] Updated weights for policy 0, policy_version 1894722 (0.0010) [2023-12-26 14:43:41,941][123090] Updated weights for policy 1, policy_version 1883044 (0.0007) [2023-12-26 14:43:41,957][123091] Updated weights for policy 0, policy_version 1894732 (0.0009) [2023-12-26 14:43:42,011][123090] Updated weights for policy 1, policy_version 1883054 (0.0009) [2023-12-26 14:43:42,073][123090] Updated weights for policy 1, policy_version 1883064 (0.0009) [2023-12-26 14:43:42,782][123091] Updated weights for policy 0, policy_version 1894742 (0.0011) [2023-12-26 14:43:42,842][123091] Updated weights for policy 0, policy_version 1894752 (0.0010) [2023-12-26 14:43:42,902][123091] Updated weights for policy 0, policy_version 1894762 (0.0009) [2023-12-26 14:43:42,928][123090] Updated weights for policy 1, policy_version 1883074 (0.0009) [2023-12-26 14:43:42,986][123090] Updated weights for policy 1, policy_version 1883084 (0.0010) [2023-12-26 14:43:43,054][123090] Updated weights for policy 1, policy_version 1883094 (0.0009) [2023-12-26 14:43:43,118][123090] Updated weights for policy 1, policy_version 1883104 (0.0009) [2023-12-26 14:43:43,647][123091] Updated weights for policy 0, policy_version 1894772 (0.0008) [2023-12-26 14:43:43,709][123091] Updated weights for policy 0, policy_version 1894782 (0.0006) [2023-12-26 14:43:43,758][123091] Updated weights for policy 0, policy_version 1894792 (0.0005) [2023-12-26 14:43:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 967139328. Throughput: 0: 8579.7, 1: 8965.5. Samples: 967139356. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:43,785][121949] Avg episode reward: [(0, '6322.656'), (1, '5821.972')] [2023-12-26 14:43:43,943][123090] Updated weights for policy 1, policy_version 1883114 (0.0009) [2023-12-26 14:43:44,005][123090] Updated weights for policy 1, policy_version 1883124 (0.0009) [2023-12-26 14:43:44,063][123090] Updated weights for policy 1, policy_version 1883134 (0.0008) [2023-12-26 14:43:44,458][123091] Updated weights for policy 0, policy_version 1894802 (0.0006) [2023-12-26 14:43:44,524][123091] Updated weights for policy 0, policy_version 1894812 (0.0011) [2023-12-26 14:43:44,579][123091] Updated weights for policy 0, policy_version 1894822 (0.0011) [2023-12-26 14:43:44,635][123091] Updated weights for policy 0, policy_version 1894832 (0.0010) [2023-12-26 14:43:44,886][123090] Updated weights for policy 1, policy_version 1883144 (0.0009) [2023-12-26 14:43:44,952][123090] Updated weights for policy 1, policy_version 1883154 (0.0009) [2023-12-26 14:43:45,013][123090] Updated weights for policy 1, policy_version 1883164 (0.0009) [2023-12-26 14:43:45,473][123091] Updated weights for policy 0, policy_version 1894842 (0.0010) [2023-12-26 14:43:45,533][123091] Updated weights for policy 0, policy_version 1894852 (0.0009) [2023-12-26 14:43:45,584][123091] Updated weights for policy 0, policy_version 1894862 (0.0009) [2023-12-26 14:43:45,846][123090] Updated weights for policy 1, policy_version 1883174 (0.0010) [2023-12-26 14:43:45,899][123090] Updated weights for policy 1, policy_version 1883184 (0.0010) [2023-12-26 14:43:45,963][123090] Updated weights for policy 1, policy_version 1883194 (0.0010) [2023-12-26 14:43:46,342][123091] Updated weights for policy 0, policy_version 1894872 (0.0009) [2023-12-26 14:43:46,404][123091] Updated weights for policy 0, policy_version 1894882 (0.0010) [2023-12-26 14:43:46,460][123091] Updated weights for policy 0, policy_version 1894892 (0.0010) [2023-12-26 14:43:46,737][123090] Updated weights for policy 1, policy_version 1883204 (0.0010) [2023-12-26 14:43:46,788][123090] Updated weights for policy 1, policy_version 1883214 (0.0008) [2023-12-26 14:43:46,837][123090] Updated weights for policy 1, policy_version 1883224 (0.0009) [2023-12-26 14:43:47,181][123091] Updated weights for policy 0, policy_version 1894902 (0.0007) [2023-12-26 14:43:47,228][123091] Updated weights for policy 0, policy_version 1894912 (0.0005) [2023-12-26 14:43:47,283][123091] Updated weights for policy 0, policy_version 1894922 (0.0007) [2023-12-26 14:43:47,789][123090] Updated weights for policy 1, policy_version 1883234 (0.0009) [2023-12-26 14:43:47,842][123090] Updated weights for policy 1, policy_version 1883244 (0.0008) [2023-12-26 14:43:47,908][123090] Updated weights for policy 1, policy_version 1883254 (0.0009) [2023-12-26 14:43:47,968][123090] Updated weights for policy 1, policy_version 1883264 (0.0008) [2023-12-26 14:43:48,001][123091] Updated weights for policy 0, policy_version 1894932 (0.0007) [2023-12-26 14:43:48,056][123091] Updated weights for policy 0, policy_version 1894942 (0.0010) [2023-12-26 14:43:48,104][123091] Updated weights for policy 0, policy_version 1894952 (0.0010) [2023-12-26 14:43:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 967229440. Throughput: 0: 8681.7, 1: 8919.6. Samples: 967245644. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:48,785][121949] Avg episode reward: [(0, '6367.786'), (1, '5802.406')] [2023-12-26 14:43:48,831][123091] Updated weights for policy 0, policy_version 1894962 (0.0010) [2023-12-26 14:43:48,887][123090] Updated weights for policy 1, policy_version 1883274 (0.0009) [2023-12-26 14:43:48,891][123091] Updated weights for policy 0, policy_version 1894972 (0.0006) [2023-12-26 14:43:48,949][123090] Updated weights for policy 1, policy_version 1883284 (0.0009) [2023-12-26 14:43:48,954][123091] Updated weights for policy 0, policy_version 1894982 (0.0005) [2023-12-26 14:43:49,010][123090] Updated weights for policy 1, policy_version 1883294 (0.0008) [2023-12-26 14:43:49,018][123091] Updated weights for policy 0, policy_version 1894992 (0.0005) [2023-12-26 14:43:49,721][123091] Updated weights for policy 0, policy_version 1895002 (0.0010) [2023-12-26 14:43:49,791][123091] Updated weights for policy 0, policy_version 1895012 (0.0010) [2023-12-26 14:43:49,845][123090] Updated weights for policy 1, policy_version 1883304 (0.0007) [2023-12-26 14:43:49,853][123091] Updated weights for policy 0, policy_version 1895022 (0.0009) [2023-12-26 14:43:49,914][123090] Updated weights for policy 1, policy_version 1883314 (0.0009) [2023-12-26 14:43:49,977][123090] Updated weights for policy 1, policy_version 1883324 (0.0008) [2023-12-26 14:43:50,718][123091] Updated weights for policy 0, policy_version 1895032 (0.0010) [2023-12-26 14:43:50,767][123091] Updated weights for policy 0, policy_version 1895042 (0.0010) [2023-12-26 14:43:50,799][123090] Updated weights for policy 1, policy_version 1883334 (0.0007) [2023-12-26 14:43:50,831][123091] Updated weights for policy 0, policy_version 1895052 (0.0009) [2023-12-26 14:43:50,867][123090] Updated weights for policy 1, policy_version 1883344 (0.0009) [2023-12-26 14:43:50,942][123090] Updated weights for policy 1, policy_version 1883354 (0.0009) [2023-12-26 14:43:51,609][123091] Updated weights for policy 0, policy_version 1895062 (0.0007) [2023-12-26 14:43:51,672][123091] Updated weights for policy 0, policy_version 1895072 (0.0010) [2023-12-26 14:43:51,745][123091] Updated weights for policy 0, policy_version 1895082 (0.0010) [2023-12-26 14:43:51,791][123090] Updated weights for policy 1, policy_version 1883364 (0.0010) [2023-12-26 14:43:51,845][123090] Updated weights for policy 1, policy_version 1883374 (0.0009) [2023-12-26 14:43:51,898][123090] Updated weights for policy 1, policy_version 1883384 (0.0009) [2023-12-26 14:43:52,611][123090] Updated weights for policy 1, policy_version 1883394 (0.0007) [2023-12-26 14:43:52,620][123091] Updated weights for policy 0, policy_version 1895092 (0.0007) [2023-12-26 14:43:52,660][123090] Updated weights for policy 1, policy_version 1883404 (0.0009) [2023-12-26 14:43:52,675][123091] Updated weights for policy 0, policy_version 1895102 (0.0005) [2023-12-26 14:43:52,715][123090] Updated weights for policy 1, policy_version 1883414 (0.0008) [2023-12-26 14:43:52,726][123091] Updated weights for policy 0, policy_version 1895112 (0.0010) [2023-12-26 14:43:52,767][123090] Updated weights for policy 1, policy_version 1883424 (0.0009) [2023-12-26 14:43:53,399][123091] Updated weights for policy 0, policy_version 1895122 (0.0007) [2023-12-26 14:43:53,464][123091] Updated weights for policy 0, policy_version 1895132 (0.0006) [2023-12-26 14:43:53,536][123091] Updated weights for policy 0, policy_version 1895142 (0.0007) [2023-12-26 14:43:53,598][123091] Updated weights for policy 0, policy_version 1895152 (0.0010) [2023-12-26 14:43:53,662][123090] Updated weights for policy 1, policy_version 1883434 (0.0009) [2023-12-26 14:43:53,733][123090] Updated weights for policy 1, policy_version 1883444 (0.0009) [2023-12-26 14:43:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 967319552. Throughput: 0: 8686.2, 1: 8907.4. Samples: 967298216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:53,784][121949] Avg episode reward: [(0, '6343.409'), (1, '5508.027')] [2023-12-26 14:43:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001895152_485163008.pth... [2023-12-26 14:43:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001894128_484900864.pth [2023-12-26 14:43:53,795][123090] Updated weights for policy 1, policy_version 1883454 (0.0009) [2023-12-26 14:43:53,811][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001883456_482164736.pth... [2023-12-26 14:43:53,814][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001882400_481894400.pth [2023-12-26 14:43:54,411][123091] Updated weights for policy 0, policy_version 1895162 (0.0009) [2023-12-26 14:43:54,464][123091] Updated weights for policy 0, policy_version 1895172 (0.0009) [2023-12-26 14:43:54,517][123091] Updated weights for policy 0, policy_version 1895182 (0.0010) [2023-12-26 14:43:54,557][123090] Updated weights for policy 1, policy_version 1883464 (0.0009) [2023-12-26 14:43:54,620][123090] Updated weights for policy 1, policy_version 1883475 (0.0010) [2023-12-26 14:43:54,678][123090] Updated weights for policy 1, policy_version 1883485 (0.0008) [2023-12-26 14:43:55,358][123091] Updated weights for policy 0, policy_version 1895192 (0.0010) [2023-12-26 14:43:55,412][123091] Updated weights for policy 0, policy_version 1895202 (0.0010) [2023-12-26 14:43:55,471][123091] Updated weights for policy 0, policy_version 1895212 (0.0010) [2023-12-26 14:43:55,507][123090] Updated weights for policy 1, policy_version 1883495 (0.0009) [2023-12-26 14:43:55,569][123090] Updated weights for policy 1, policy_version 1883505 (0.0009) [2023-12-26 14:43:55,632][123090] Updated weights for policy 1, policy_version 1883515 (0.0009) [2023-12-26 14:43:56,261][123091] Updated weights for policy 0, policy_version 1895222 (0.0007) [2023-12-26 14:43:56,320][123091] Updated weights for policy 0, policy_version 1895232 (0.0006) [2023-12-26 14:43:56,371][123091] Updated weights for policy 0, policy_version 1895242 (0.0009) [2023-12-26 14:43:56,521][123090] Updated weights for policy 1, policy_version 1883525 (0.0009) [2023-12-26 14:43:56,569][123090] Updated weights for policy 1, policy_version 1883535 (0.0009) [2023-12-26 14:43:56,626][123090] Updated weights for policy 1, policy_version 1883545 (0.0009) [2023-12-26 14:43:57,179][123091] Updated weights for policy 0, policy_version 1895252 (0.0010) [2023-12-26 14:43:57,232][123091] Updated weights for policy 0, policy_version 1895262 (0.0009) [2023-12-26 14:43:57,284][123091] Updated weights for policy 0, policy_version 1895272 (0.0009) [2023-12-26 14:43:57,496][123090] Updated weights for policy 1, policy_version 1883555 (0.0009) [2023-12-26 14:43:57,551][123090] Updated weights for policy 1, policy_version 1883565 (0.0010) [2023-12-26 14:43:57,618][123090] Updated weights for policy 1, policy_version 1883575 (0.0010) [2023-12-26 14:43:57,899][123091] Updated weights for policy 0, policy_version 1895282 (0.0006) [2023-12-26 14:43:57,955][123091] Updated weights for policy 0, policy_version 1895292 (0.0005) [2023-12-26 14:43:58,020][123091] Updated weights for policy 0, policy_version 1895302 (0.0006) [2023-12-26 14:43:58,083][123091] Updated weights for policy 0, policy_version 1895312 (0.0009) [2023-12-26 14:43:58,523][123090] Updated weights for policy 1, policy_version 1883585 (0.0010) [2023-12-26 14:43:58,588][123090] Updated weights for policy 1, policy_version 1883595 (0.0009) [2023-12-26 14:43:58,654][123090] Updated weights for policy 1, policy_version 1883605 (0.0009) [2023-12-26 14:43:58,719][123090] Updated weights for policy 1, policy_version 1883615 (0.0009) [2023-12-26 14:43:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 967409664. Throughput: 0: 8694.5, 1: 8899.2. Samples: 967403336. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:43:58,785][121949] Avg episode reward: [(0, '6346.874'), (1, '5470.058')] [2023-12-26 14:43:58,789][123091] Updated weights for policy 0, policy_version 1895322 (0.0010) [2023-12-26 14:43:58,857][123091] Updated weights for policy 0, policy_version 1895332 (0.0008) [2023-12-26 14:43:58,916][123091] Updated weights for policy 0, policy_version 1895342 (0.0006) [2023-12-26 14:43:59,543][123090] Updated weights for policy 1, policy_version 1883625 (0.0006) [2023-12-26 14:43:59,606][123090] Updated weights for policy 1, policy_version 1883635 (0.0007) [2023-12-26 14:43:59,678][123090] Updated weights for policy 1, policy_version 1883645 (0.0007) [2023-12-26 14:43:59,821][123091] Updated weights for policy 0, policy_version 1895352 (0.0006) [2023-12-26 14:43:59,887][123091] Updated weights for policy 0, policy_version 1895362 (0.0008) [2023-12-26 14:43:59,958][123091] Updated weights for policy 0, policy_version 1895372 (0.0009) [2023-12-26 14:44:00,338][123090] Updated weights for policy 1, policy_version 1883655 (0.0006) [2023-12-26 14:44:00,400][123090] Updated weights for policy 1, policy_version 1883665 (0.0005) [2023-12-26 14:44:00,458][123090] Updated weights for policy 1, policy_version 1883675 (0.0005) [2023-12-26 14:44:00,691][123091] Updated weights for policy 0, policy_version 1895382 (0.0007) [2023-12-26 14:44:00,754][123091] Updated weights for policy 0, policy_version 1895392 (0.0005) [2023-12-26 14:44:00,820][123091] Updated weights for policy 0, policy_version 1895402 (0.0005) [2023-12-26 14:44:01,153][123090] Updated weights for policy 1, policy_version 1883685 (0.0007) [2023-12-26 14:44:01,210][123090] Updated weights for policy 1, policy_version 1883695 (0.0006) [2023-12-26 14:44:01,270][123090] Updated weights for policy 1, policy_version 1883705 (0.0008) [2023-12-26 14:44:01,616][123091] Updated weights for policy 0, policy_version 1895412 (0.0007) [2023-12-26 14:44:01,686][123091] Updated weights for policy 0, policy_version 1895422 (0.0008) [2023-12-26 14:44:01,757][123091] Updated weights for policy 0, policy_version 1895432 (0.0009) [2023-12-26 14:44:02,090][123090] Updated weights for policy 1, policy_version 1883715 (0.0008) [2023-12-26 14:44:02,137][123090] Updated weights for policy 1, policy_version 1883725 (0.0005) [2023-12-26 14:44:02,185][123090] Updated weights for policy 1, policy_version 1883735 (0.0005) [2023-12-26 14:44:02,556][123091] Updated weights for policy 0, policy_version 1895442 (0.0010) [2023-12-26 14:44:02,622][123091] Updated weights for policy 0, policy_version 1895452 (0.0009) [2023-12-26 14:44:02,690][123091] Updated weights for policy 0, policy_version 1895462 (0.0010) [2023-12-26 14:44:02,766][123091] Updated weights for policy 0, policy_version 1895472 (0.0006) [2023-12-26 14:44:02,898][123090] Updated weights for policy 1, policy_version 1883745 (0.0007) [2023-12-26 14:44:02,961][123090] Updated weights for policy 1, policy_version 1883755 (0.0005) [2023-12-26 14:44:03,024][123090] Updated weights for policy 1, policy_version 1883765 (0.0005) [2023-12-26 14:44:03,077][123090] Updated weights for policy 1, policy_version 1883775 (0.0005) [2023-12-26 14:44:03,496][123091] Updated weights for policy 0, policy_version 1895482 (0.0009) [2023-12-26 14:44:03,559][123091] Updated weights for policy 0, policy_version 1895492 (0.0009) [2023-12-26 14:44:03,609][123091] Updated weights for policy 0, policy_version 1895502 (0.0009) [2023-12-26 14:44:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 967499776. Throughput: 0: 8716.5, 1: 8862.8. Samples: 967510844. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:03,785][121949] Avg episode reward: [(0, '6364.638'), (1, '5510.203')] [2023-12-26 14:44:03,846][123090] Updated weights for policy 1, policy_version 1883785 (0.0012) [2023-12-26 14:44:03,914][123090] Updated weights for policy 1, policy_version 1883795 (0.0008) [2023-12-26 14:44:03,977][123090] Updated weights for policy 1, policy_version 1883805 (0.0010) [2023-12-26 14:44:04,471][123091] Updated weights for policy 0, policy_version 1895512 (0.0007) [2023-12-26 14:44:04,546][123091] Updated weights for policy 0, policy_version 1895522 (0.0006) [2023-12-26 14:44:04,621][123091] Updated weights for policy 0, policy_version 1895532 (0.0010) [2023-12-26 14:44:04,730][123090] Updated weights for policy 1, policy_version 1883815 (0.0009) [2023-12-26 14:44:04,794][123090] Updated weights for policy 1, policy_version 1883825 (0.0009) [2023-12-26 14:44:04,857][123090] Updated weights for policy 1, policy_version 1883835 (0.0009) [2023-12-26 14:44:05,253][123091] Updated weights for policy 0, policy_version 1895542 (0.0006) [2023-12-26 14:44:05,314][123091] Updated weights for policy 0, policy_version 1895552 (0.0005) [2023-12-26 14:44:05,370][123091] Updated weights for policy 0, policy_version 1895562 (0.0005) [2023-12-26 14:44:05,761][123090] Updated weights for policy 1, policy_version 1883845 (0.0009) [2023-12-26 14:44:05,822][123090] Updated weights for policy 1, policy_version 1883855 (0.0009) [2023-12-26 14:44:05,894][123090] Updated weights for policy 1, policy_version 1883865 (0.0009) [2023-12-26 14:44:06,124][123091] Updated weights for policy 0, policy_version 1895572 (0.0008) [2023-12-26 14:44:06,188][123091] Updated weights for policy 0, policy_version 1895582 (0.0012) [2023-12-26 14:44:06,251][123091] Updated weights for policy 0, policy_version 1895592 (0.0011) [2023-12-26 14:44:06,721][123090] Updated weights for policy 1, policy_version 1883875 (0.0009) [2023-12-26 14:44:06,781][123090] Updated weights for policy 1, policy_version 1883885 (0.0010) [2023-12-26 14:44:06,841][123090] Updated weights for policy 1, policy_version 1883895 (0.0010) [2023-12-26 14:44:06,988][123091] Updated weights for policy 0, policy_version 1895602 (0.0010) [2023-12-26 14:44:07,048][123091] Updated weights for policy 0, policy_version 1895612 (0.0006) [2023-12-26 14:44:07,118][123091] Updated weights for policy 0, policy_version 1895622 (0.0007) [2023-12-26 14:44:07,190][123091] Updated weights for policy 0, policy_version 1895632 (0.0008) [2023-12-26 14:44:07,773][123091] Updated weights for policy 0, policy_version 1895642 (0.0010) [2023-12-26 14:44:07,788][123090] Updated weights for policy 1, policy_version 1883905 (0.0010) [2023-12-26 14:44:07,825][123091] Updated weights for policy 0, policy_version 1895652 (0.0011) [2023-12-26 14:44:07,844][123090] Updated weights for policy 1, policy_version 1883915 (0.0005) [2023-12-26 14:44:07,875][123091] Updated weights for policy 0, policy_version 1895662 (0.0010) [2023-12-26 14:44:07,897][123090] Updated weights for policy 1, policy_version 1883925 (0.0007) [2023-12-26 14:44:07,957][123090] Updated weights for policy 1, policy_version 1883935 (0.0009) [2023-12-26 14:44:08,685][123091] Updated weights for policy 0, policy_version 1895672 (0.0010) [2023-12-26 14:44:08,750][123091] Updated weights for policy 0, policy_version 1895682 (0.0009) [2023-12-26 14:44:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 967581696. Throughput: 0: 8755.0, 1: 8853.5. Samples: 967563468. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:08,785][121949] Avg episode reward: [(0, '6244.225'), (1, '5534.196')] [2023-12-26 14:44:08,803][123090] Updated weights for policy 1, policy_version 1883945 (0.0008) [2023-12-26 14:44:08,822][123091] Updated weights for policy 0, policy_version 1895692 (0.0010) [2023-12-26 14:44:08,848][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001895696_485302272.pth... [2023-12-26 14:44:08,852][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001894640_485031936.pth [2023-12-26 14:44:08,869][123090] Updated weights for policy 1, policy_version 1883955 (0.0007) [2023-12-26 14:44:08,934][123090] Updated weights for policy 1, policy_version 1883965 (0.0010) [2023-12-26 14:44:08,951][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001883968_482295808.pth... [2023-12-26 14:44:08,957][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001882944_482033664.pth [2023-12-26 14:44:09,578][123091] Updated weights for policy 0, policy_version 1895702 (0.0009) [2023-12-26 14:44:09,634][123091] Updated weights for policy 0, policy_version 1895712 (0.0008) [2023-12-26 14:44:09,706][123091] Updated weights for policy 0, policy_version 1895722 (0.0008) [2023-12-26 14:44:09,843][123090] Updated weights for policy 1, policy_version 1883975 (0.0009) [2023-12-26 14:44:09,913][123090] Updated weights for policy 1, policy_version 1883985 (0.0008) [2023-12-26 14:44:09,969][123090] Updated weights for policy 1, policy_version 1883995 (0.0008) [2023-12-26 14:44:10,443][123091] Updated weights for policy 0, policy_version 1895732 (0.0007) [2023-12-26 14:44:10,515][123091] Updated weights for policy 0, policy_version 1895742 (0.0010) [2023-12-26 14:44:10,580][123091] Updated weights for policy 0, policy_version 1895752 (0.0008) [2023-12-26 14:44:10,776][123090] Updated weights for policy 1, policy_version 1884005 (0.0007) [2023-12-26 14:44:10,829][123090] Updated weights for policy 1, policy_version 1884015 (0.0009) [2023-12-26 14:44:10,883][123090] Updated weights for policy 1, policy_version 1884025 (0.0009) [2023-12-26 14:44:11,398][123091] Updated weights for policy 0, policy_version 1895762 (0.0009) [2023-12-26 14:44:11,460][123091] Updated weights for policy 0, policy_version 1895772 (0.0009) [2023-12-26 14:44:11,517][123091] Updated weights for policy 0, policy_version 1895782 (0.0009) [2023-12-26 14:44:11,572][123091] Updated weights for policy 0, policy_version 1895792 (0.0009) [2023-12-26 14:44:11,730][123090] Updated weights for policy 1, policy_version 1884035 (0.0009) [2023-12-26 14:44:11,805][123090] Updated weights for policy 1, policy_version 1884045 (0.0008) [2023-12-26 14:44:11,882][123090] Updated weights for policy 1, policy_version 1884055 (0.0007) [2023-12-26 14:44:12,330][123091] Updated weights for policy 0, policy_version 1895802 (0.0009) [2023-12-26 14:44:12,402][123091] Updated weights for policy 0, policy_version 1895812 (0.0008) [2023-12-26 14:44:12,465][123091] Updated weights for policy 0, policy_version 1895822 (0.0008) [2023-12-26 14:44:12,693][123090] Updated weights for policy 1, policy_version 1884065 (0.0010) [2023-12-26 14:44:12,746][123090] Updated weights for policy 1, policy_version 1884076 (0.0009) [2023-12-26 14:44:12,800][123090] Updated weights for policy 1, policy_version 1884086 (0.0008) [2023-12-26 14:44:13,277][123091] Updated weights for policy 0, policy_version 1895832 (0.0009) [2023-12-26 14:44:13,335][123091] Updated weights for policy 0, policy_version 1895842 (0.0009) [2023-12-26 14:44:13,402][123091] Updated weights for policy 0, policy_version 1895852 (0.0010) [2023-12-26 14:44:13,631][123090] Updated weights for policy 1, policy_version 1884097 (0.0009) [2023-12-26 14:44:13,691][123090] Updated weights for policy 1, policy_version 1884107 (0.0009) [2023-12-26 14:44:13,760][123090] Updated weights for policy 1, policy_version 1884117 (0.0010) [2023-12-26 14:44:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 967671808. Throughput: 0: 8921.9, 1: 8685.5. Samples: 967669228. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:13,785][121949] Avg episode reward: [(0, '6253.058'), (1, '5764.692')] [2023-12-26 14:44:13,822][123090] Updated weights for policy 1, policy_version 1884127 (0.0010) [2023-12-26 14:44:14,245][123091] Updated weights for policy 0, policy_version 1895862 (0.0009) [2023-12-26 14:44:14,298][123091] Updated weights for policy 0, policy_version 1895872 (0.0009) [2023-12-26 14:44:14,354][123091] Updated weights for policy 0, policy_version 1895882 (0.0009) [2023-12-26 14:44:14,619][123090] Updated weights for policy 1, policy_version 1884137 (0.0010) [2023-12-26 14:44:14,674][123090] Updated weights for policy 1, policy_version 1884147 (0.0010) [2023-12-26 14:44:14,725][123090] Updated weights for policy 1, policy_version 1884157 (0.0010) [2023-12-26 14:44:15,179][123091] Updated weights for policy 0, policy_version 1895892 (0.0007) [2023-12-26 14:44:15,253][123091] Updated weights for policy 0, policy_version 1895902 (0.0006) [2023-12-26 14:44:15,319][123091] Updated weights for policy 0, policy_version 1895912 (0.0006) [2023-12-26 14:44:15,510][123090] Updated weights for policy 1, policy_version 1884167 (0.0009) [2023-12-26 14:44:15,578][123090] Updated weights for policy 1, policy_version 1884177 (0.0011) [2023-12-26 14:44:15,650][123090] Updated weights for policy 1, policy_version 1884187 (0.0011) [2023-12-26 14:44:15,963][123091] Updated weights for policy 0, policy_version 1895922 (0.0006) [2023-12-26 14:44:16,027][123091] Updated weights for policy 0, policy_version 1895932 (0.0006) [2023-12-26 14:44:16,095][123091] Updated weights for policy 0, policy_version 1895942 (0.0006) [2023-12-26 14:44:16,147][123091] Updated weights for policy 0, policy_version 1895952 (0.0005) [2023-12-26 14:44:16,309][123090] Updated weights for policy 1, policy_version 1884197 (0.0008) [2023-12-26 14:44:16,361][123090] Updated weights for policy 1, policy_version 1884207 (0.0005) [2023-12-26 14:44:16,408][123090] Updated weights for policy 1, policy_version 1884217 (0.0005) [2023-12-26 14:44:16,815][123091] Updated weights for policy 0, policy_version 1895962 (0.0006) [2023-12-26 14:44:16,891][123091] Updated weights for policy 0, policy_version 1895972 (0.0005) [2023-12-26 14:44:16,958][123091] Updated weights for policy 0, policy_version 1895982 (0.0006) [2023-12-26 14:44:17,120][123090] Updated weights for policy 1, policy_version 1884227 (0.0007) [2023-12-26 14:44:17,173][123090] Updated weights for policy 1, policy_version 1884237 (0.0005) [2023-12-26 14:44:17,225][123090] Updated weights for policy 1, policy_version 1884247 (0.0005) [2023-12-26 14:44:17,747][123091] Updated weights for policy 0, policy_version 1895992 (0.0009) [2023-12-26 14:44:17,811][123091] Updated weights for policy 0, policy_version 1896002 (0.0005) [2023-12-26 14:44:17,869][123091] Updated weights for policy 0, policy_version 1896012 (0.0006) [2023-12-26 14:44:17,918][123090] Updated weights for policy 1, policy_version 1884257 (0.0005) [2023-12-26 14:44:17,974][123090] Updated weights for policy 1, policy_version 1884267 (0.0010) [2023-12-26 14:44:18,033][123090] Updated weights for policy 1, policy_version 1884277 (0.0010) [2023-12-26 14:44:18,093][123090] Updated weights for policy 1, policy_version 1884287 (0.0011) [2023-12-26 14:44:18,573][123091] Updated weights for policy 0, policy_version 1896022 (0.0008) [2023-12-26 14:44:18,634][123091] Updated weights for policy 0, policy_version 1896032 (0.0009) [2023-12-26 14:44:18,693][123091] Updated weights for policy 0, policy_version 1896042 (0.0009) [2023-12-26 14:44:18,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 967770112. Throughput: 0: 9032.8, 1: 8762.3. Samples: 967781260. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:18,785][121949] Avg episode reward: [(0, '6305.783'), (1, '5803.545')] [2023-12-26 14:44:18,894][123090] Updated weights for policy 1, policy_version 1884297 (0.0006) [2023-12-26 14:44:18,971][123090] Updated weights for policy 1, policy_version 1884307 (0.0007) [2023-12-26 14:44:19,039][123090] Updated weights for policy 1, policy_version 1884317 (0.0007) [2023-12-26 14:44:19,625][123091] Updated weights for policy 0, policy_version 1896052 (0.0009) [2023-12-26 14:44:19,684][123091] Updated weights for policy 0, policy_version 1896062 (0.0009) [2023-12-26 14:44:19,709][123090] Updated weights for policy 1, policy_version 1884327 (0.0006) [2023-12-26 14:44:19,736][123091] Updated weights for policy 0, policy_version 1896072 (0.0006) [2023-12-26 14:44:19,770][123090] Updated weights for policy 1, policy_version 1884337 (0.0007) [2023-12-26 14:44:19,834][123090] Updated weights for policy 1, policy_version 1884347 (0.0007) [2023-12-26 14:44:20,473][123091] Updated weights for policy 0, policy_version 1896082 (0.0005) [2023-12-26 14:44:20,538][123091] Updated weights for policy 0, policy_version 1896092 (0.0006) [2023-12-26 14:44:20,612][123091] Updated weights for policy 0, policy_version 1896102 (0.0008) [2023-12-26 14:44:20,615][123090] Updated weights for policy 1, policy_version 1884357 (0.0007) [2023-12-26 14:44:20,674][123091] Updated weights for policy 0, policy_version 1896112 (0.0009) [2023-12-26 14:44:20,680][123090] Updated weights for policy 1, policy_version 1884367 (0.0011) [2023-12-26 14:44:20,745][123090] Updated weights for policy 1, policy_version 1884377 (0.0011) [2023-12-26 14:44:21,447][123090] Updated weights for policy 1, policy_version 1884387 (0.0010) [2023-12-26 14:44:21,520][123090] Updated weights for policy 1, policy_version 1884397 (0.0008) [2023-12-26 14:44:21,546][123091] Updated weights for policy 0, policy_version 1896122 (0.0008) [2023-12-26 14:44:21,594][123090] Updated weights for policy 1, policy_version 1884407 (0.0008) [2023-12-26 14:44:21,602][123091] Updated weights for policy 0, policy_version 1896132 (0.0008) [2023-12-26 14:44:21,675][123091] Updated weights for policy 0, policy_version 1896142 (0.0009) [2023-12-26 14:44:22,354][123090] Updated weights for policy 1, policy_version 1884417 (0.0008) [2023-12-26 14:44:22,415][123090] Updated weights for policy 1, policy_version 1884427 (0.0010) [2023-12-26 14:44:22,470][123090] Updated weights for policy 1, policy_version 1884437 (0.0010) [2023-12-26 14:44:22,525][123090] Updated weights for policy 1, policy_version 1884447 (0.0009) [2023-12-26 14:44:22,570][123091] Updated weights for policy 0, policy_version 1896152 (0.0009) [2023-12-26 14:44:22,637][123091] Updated weights for policy 0, policy_version 1896162 (0.0009) [2023-12-26 14:44:22,707][123091] Updated weights for policy 0, policy_version 1896172 (0.0009) [2023-12-26 14:44:23,381][123090] Updated weights for policy 1, policy_version 1884457 (0.0010) [2023-12-26 14:44:23,443][123090] Updated weights for policy 1, policy_version 1884467 (0.0009) [2023-12-26 14:44:23,512][123090] Updated weights for policy 1, policy_version 1884477 (0.0009) [2023-12-26 14:44:23,523][123091] Updated weights for policy 0, policy_version 1896182 (0.0009) [2023-12-26 14:44:23,584][123091] Updated weights for policy 0, policy_version 1896192 (0.0008) [2023-12-26 14:44:23,653][123091] Updated weights for policy 0, policy_version 1896202 (0.0009) [2023-12-26 14:44:23,784][121949] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 967860224. Throughput: 0: 8994.6, 1: 8726.6. Samples: 967833472. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:23,785][121949] Avg episode reward: [(0, '6336.915'), (1, '5777.498')] [2023-12-26 14:44:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001896208_485433344.pth... [2023-12-26 14:44:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001884480_482426880.pth... [2023-12-26 14:44:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001895152_485163008.pth [2023-12-26 14:44:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001883456_482164736.pth [2023-12-26 14:44:24,300][123090] Updated weights for policy 1, policy_version 1884488 (0.0010) [2023-12-26 14:44:24,362][123090] Updated weights for policy 1, policy_version 1884498 (0.0010) [2023-12-26 14:44:24,428][123090] Updated weights for policy 1, policy_version 1884508 (0.0010) [2023-12-26 14:44:24,478][123091] Updated weights for policy 0, policy_version 1896212 (0.0009) [2023-12-26 14:44:24,546][123091] Updated weights for policy 0, policy_version 1896222 (0.0008) [2023-12-26 14:44:24,599][123091] Updated weights for policy 0, policy_version 1896232 (0.0005) [2023-12-26 14:44:25,288][123090] Updated weights for policy 1, policy_version 1884518 (0.0009) [2023-12-26 14:44:25,336][123090] Updated weights for policy 1, policy_version 1884528 (0.0009) [2023-12-26 14:44:25,361][123091] Updated weights for policy 0, policy_version 1896242 (0.0006) [2023-12-26 14:44:25,397][123090] Updated weights for policy 1, policy_version 1884538 (0.0007) [2023-12-26 14:44:25,411][123091] Updated weights for policy 0, policy_version 1896252 (0.0010) [2023-12-26 14:44:25,458][123091] Updated weights for policy 0, policy_version 1896262 (0.0010) [2023-12-26 14:44:25,505][123091] Updated weights for policy 0, policy_version 1896272 (0.0010) [2023-12-26 14:44:26,250][123090] Updated weights for policy 1, policy_version 1884548 (0.0007) [2023-12-26 14:44:26,316][123090] Updated weights for policy 1, policy_version 1884558 (0.0007) [2023-12-26 14:44:26,354][123091] Updated weights for policy 0, policy_version 1896282 (0.0010) [2023-12-26 14:44:26,374][123090] Updated weights for policy 1, policy_version 1884568 (0.0006) [2023-12-26 14:44:26,401][123091] Updated weights for policy 0, policy_version 1896292 (0.0010) [2023-12-26 14:44:26,459][123091] Updated weights for policy 0, policy_version 1896302 (0.0010) [2023-12-26 14:44:27,191][123090] Updated weights for policy 1, policy_version 1884578 (0.0006) [2023-12-26 14:44:27,254][123090] Updated weights for policy 1, policy_version 1884588 (0.0005) [2023-12-26 14:44:27,277][123091] Updated weights for policy 0, policy_version 1896312 (0.0007) [2023-12-26 14:44:27,320][123090] Updated weights for policy 1, policy_version 1884598 (0.0008) [2023-12-26 14:44:27,341][123091] Updated weights for policy 0, policy_version 1896322 (0.0008) [2023-12-26 14:44:27,385][123090] Updated weights for policy 1, policy_version 1884608 (0.0007) [2023-12-26 14:44:27,411][123091] Updated weights for policy 0, policy_version 1896332 (0.0010) [2023-12-26 14:44:28,136][123090] Updated weights for policy 1, policy_version 1884618 (0.0008) [2023-12-26 14:44:28,153][123091] Updated weights for policy 0, policy_version 1896342 (0.0010) [2023-12-26 14:44:28,197][123090] Updated weights for policy 1, policy_version 1884628 (0.0009) [2023-12-26 14:44:28,208][123091] Updated weights for policy 0, policy_version 1896352 (0.0009) [2023-12-26 14:44:28,258][123090] Updated weights for policy 1, policy_version 1884638 (0.0005) [2023-12-26 14:44:28,267][123091] Updated weights for policy 0, policy_version 1896362 (0.0011) [2023-12-26 14:44:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 967942144. Throughput: 0: 9028.9, 1: 8700.7. Samples: 967937188. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:28,785][121949] Avg episode reward: [(0, '6273.034'), (1, '5664.159')] [2023-12-26 14:44:29,060][123091] Updated weights for policy 0, policy_version 1896372 (0.0008) [2023-12-26 14:44:29,098][123090] Updated weights for policy 1, policy_version 1884648 (0.0007) [2023-12-26 14:44:29,117][123091] Updated weights for policy 0, policy_version 1896382 (0.0006) [2023-12-26 14:44:29,151][123090] Updated weights for policy 1, policy_version 1884658 (0.0009) [2023-12-26 14:44:29,173][123091] Updated weights for policy 0, policy_version 1896392 (0.0007) [2023-12-26 14:44:29,200][123090] Updated weights for policy 1, policy_version 1884668 (0.0008) [2023-12-26 14:44:29,870][123091] Updated weights for policy 0, policy_version 1896402 (0.0007) [2023-12-26 14:44:29,934][123091] Updated weights for policy 0, policy_version 1896412 (0.0010) [2023-12-26 14:44:29,992][123091] Updated weights for policy 0, policy_version 1896422 (0.0006) [2023-12-26 14:44:30,055][123091] Updated weights for policy 0, policy_version 1896432 (0.0007) [2023-12-26 14:44:30,157][123090] Updated weights for policy 1, policy_version 1884678 (0.0009) [2023-12-26 14:44:30,205][123090] Updated weights for policy 1, policy_version 1884688 (0.0009) [2023-12-26 14:44:30,265][123090] Updated weights for policy 1, policy_version 1884698 (0.0010) [2023-12-26 14:44:30,773][123091] Updated weights for policy 0, policy_version 1896442 (0.0006) [2023-12-26 14:44:30,822][123091] Updated weights for policy 0, policy_version 1896452 (0.0006) [2023-12-26 14:44:30,868][123091] Updated weights for policy 0, policy_version 1896462 (0.0007) [2023-12-26 14:44:31,171][123090] Updated weights for policy 1, policy_version 1884708 (0.0009) [2023-12-26 14:44:31,229][123090] Updated weights for policy 1, policy_version 1884718 (0.0009) [2023-12-26 14:44:31,289][123090] Updated weights for policy 1, policy_version 1884728 (0.0009) [2023-12-26 14:44:31,585][123091] Updated weights for policy 0, policy_version 1896472 (0.0005) [2023-12-26 14:44:31,649][123091] Updated weights for policy 0, policy_version 1896482 (0.0008) [2023-12-26 14:44:31,713][123091] Updated weights for policy 0, policy_version 1896492 (0.0009) [2023-12-26 14:44:32,170][123090] Updated weights for policy 1, policy_version 1884738 (0.0009) [2023-12-26 14:44:32,230][123090] Updated weights for policy 1, policy_version 1884748 (0.0009) [2023-12-26 14:44:32,291][123090] Updated weights for policy 1, policy_version 1884758 (0.0009) [2023-12-26 14:44:32,352][123090] Updated weights for policy 1, policy_version 1884768 (0.0009) [2023-12-26 14:44:32,478][123091] Updated weights for policy 0, policy_version 1896502 (0.0010) [2023-12-26 14:44:32,526][123091] Updated weights for policy 0, policy_version 1896512 (0.0009) [2023-12-26 14:44:32,577][123091] Updated weights for policy 0, policy_version 1896522 (0.0009) [2023-12-26 14:44:33,184][123090] Updated weights for policy 1, policy_version 1884779 (0.0009) [2023-12-26 14:44:33,246][123090] Updated weights for policy 1, policy_version 1884789 (0.0009) [2023-12-26 14:44:33,307][123090] Updated weights for policy 1, policy_version 1884799 (0.0008) [2023-12-26 14:44:33,411][123091] Updated weights for policy 0, policy_version 1896533 (0.0009) [2023-12-26 14:44:33,463][123091] Updated weights for policy 0, policy_version 1896543 (0.0009) [2023-12-26 14:44:33,525][123091] Updated weights for policy 0, policy_version 1896553 (0.0009) [2023-12-26 14:44:33,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 968032256. Throughput: 0: 9012.7, 1: 8663.0. Samples: 968041044. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:33,784][121949] Avg episode reward: [(0, '6140.631'), (1, '5648.884')] [2023-12-26 14:44:34,110][123090] Updated weights for policy 1, policy_version 1884809 (0.0010) [2023-12-26 14:44:34,180][123090] Updated weights for policy 1, policy_version 1884819 (0.0009) [2023-12-26 14:44:34,254][123090] Updated weights for policy 1, policy_version 1884829 (0.0008) [2023-12-26 14:44:34,408][123091] Updated weights for policy 0, policy_version 1896563 (0.0009) [2023-12-26 14:44:34,480][123091] Updated weights for policy 0, policy_version 1896573 (0.0009) [2023-12-26 14:44:34,543][123091] Updated weights for policy 0, policy_version 1896583 (0.0009) [2023-12-26 14:44:35,105][123090] Updated weights for policy 1, policy_version 1884839 (0.0009) [2023-12-26 14:44:35,171][123090] Updated weights for policy 1, policy_version 1884849 (0.0009) [2023-12-26 14:44:35,270][123090] Updated weights for policy 1, policy_version 1884859 (0.0008) [2023-12-26 14:44:35,381][123091] Updated weights for policy 0, policy_version 1896593 (0.0009) [2023-12-26 14:44:35,434][123091] Updated weights for policy 0, policy_version 1896603 (0.0009) [2023-12-26 14:44:35,486][123091] Updated weights for policy 0, policy_version 1896614 (0.0010) [2023-12-26 14:44:35,538][123091] Updated weights for policy 0, policy_version 1896624 (0.0010) [2023-12-26 14:44:36,003][123090] Updated weights for policy 1, policy_version 1884869 (0.0008) [2023-12-26 14:44:36,078][123090] Updated weights for policy 1, policy_version 1884879 (0.0005) [2023-12-26 14:44:36,154][123090] Updated weights for policy 1, policy_version 1884889 (0.0009) [2023-12-26 14:44:36,359][123091] Updated weights for policy 0, policy_version 1896634 (0.0009) [2023-12-26 14:44:36,425][123091] Updated weights for policy 0, policy_version 1896644 (0.0009) [2023-12-26 14:44:36,491][123091] Updated weights for policy 0, policy_version 1896654 (0.0010) [2023-12-26 14:44:36,944][123090] Updated weights for policy 1, policy_version 1884899 (0.0009) [2023-12-26 14:44:36,999][123090] Updated weights for policy 1, policy_version 1884909 (0.0009) [2023-12-26 14:44:37,049][123090] Updated weights for policy 1, policy_version 1884919 (0.0009) [2023-12-26 14:44:37,315][123091] Updated weights for policy 0, policy_version 1896664 (0.0006) [2023-12-26 14:44:37,364][123091] Updated weights for policy 0, policy_version 1896674 (0.0005) [2023-12-26 14:44:37,420][123091] Updated weights for policy 0, policy_version 1896684 (0.0005) [2023-12-26 14:44:37,945][123090] Updated weights for policy 1, policy_version 1884929 (0.0009) [2023-12-26 14:44:38,011][123090] Updated weights for policy 1, policy_version 1884939 (0.0010) [2023-12-26 14:44:38,080][123090] Updated weights for policy 1, policy_version 1884949 (0.0010) [2023-12-26 14:44:38,138][123090] Updated weights for policy 1, policy_version 1884959 (0.0009) [2023-12-26 14:44:38,167][123091] Updated weights for policy 0, policy_version 1896694 (0.0008) [2023-12-26 14:44:38,219][123091] Updated weights for policy 0, policy_version 1896704 (0.0010) [2023-12-26 14:44:38,282][123091] Updated weights for policy 0, policy_version 1896714 (0.0006) [2023-12-26 14:44:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 968114176. Throughput: 0: 8967.3, 1: 8684.4. Samples: 968092544. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:38,785][121949] Avg episode reward: [(0, '6133.444'), (1, '5688.893')] [2023-12-26 14:44:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001896720_485564416.pth... [2023-12-26 14:44:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001884960_482549760.pth... [2023-12-26 14:44:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001883968_482295808.pth [2023-12-26 14:44:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001895696_485302272.pth [2023-12-26 14:44:39,020][123090] Updated weights for policy 1, policy_version 1884969 (0.0010) [2023-12-26 14:44:39,028][123091] Updated weights for policy 0, policy_version 1896724 (0.0008) [2023-12-26 14:44:39,077][123090] Updated weights for policy 1, policy_version 1884979 (0.0010) [2023-12-26 14:44:39,093][123091] Updated weights for policy 0, policy_version 1896734 (0.0007) [2023-12-26 14:44:39,145][123090] Updated weights for policy 1, policy_version 1884989 (0.0010) [2023-12-26 14:44:39,152][123091] Updated weights for policy 0, policy_version 1896744 (0.0006) [2023-12-26 14:44:39,935][123091] Updated weights for policy 0, policy_version 1896754 (0.0009) [2023-12-26 14:44:39,995][123091] Updated weights for policy 0, policy_version 1896764 (0.0009) [2023-12-26 14:44:40,059][123091] Updated weights for policy 0, policy_version 1896774 (0.0009) [2023-12-26 14:44:40,064][123090] Updated weights for policy 1, policy_version 1884999 (0.0008) [2023-12-26 14:44:40,122][123091] Updated weights for policy 0, policy_version 1896784 (0.0007) [2023-12-26 14:44:40,124][123090] Updated weights for policy 1, policy_version 1885009 (0.0009) [2023-12-26 14:44:40,192][123090] Updated weights for policy 1, policy_version 1885019 (0.0010) [2023-12-26 14:44:40,775][123091] Updated weights for policy 0, policy_version 1896794 (0.0009) [2023-12-26 14:44:40,826][123091] Updated weights for policy 0, policy_version 1896804 (0.0010) [2023-12-26 14:44:40,883][123091] Updated weights for policy 0, policy_version 1896814 (0.0009) [2023-12-26 14:44:41,093][123090] Updated weights for policy 1, policy_version 1885029 (0.0009) [2023-12-26 14:44:41,156][123090] Updated weights for policy 1, policy_version 1885039 (0.0010) [2023-12-26 14:44:41,221][123090] Updated weights for policy 1, policy_version 1885049 (0.0010) [2023-12-26 14:44:41,691][123091] Updated weights for policy 0, policy_version 1896824 (0.0010) [2023-12-26 14:44:41,754][123091] Updated weights for policy 0, policy_version 1896834 (0.0009) [2023-12-26 14:44:41,813][123091] Updated weights for policy 0, policy_version 1896844 (0.0010) [2023-12-26 14:44:42,097][123090] Updated weights for policy 1, policy_version 1885059 (0.0009) [2023-12-26 14:44:42,155][123090] Updated weights for policy 1, policy_version 1885069 (0.0009) [2023-12-26 14:44:42,214][123090] Updated weights for policy 1, policy_version 1885079 (0.0010) [2023-12-26 14:44:42,603][123091] Updated weights for policy 0, policy_version 1896854 (0.0010) [2023-12-26 14:44:42,666][123091] Updated weights for policy 0, policy_version 1896864 (0.0007) [2023-12-26 14:44:42,720][123091] Updated weights for policy 0, policy_version 1896874 (0.0009) [2023-12-26 14:44:43,117][123090] Updated weights for policy 1, policy_version 1885089 (0.0010) [2023-12-26 14:44:43,168][123090] Updated weights for policy 1, policy_version 1885099 (0.0009) [2023-12-26 14:44:43,227][123090] Updated weights for policy 1, policy_version 1885109 (0.0009) [2023-12-26 14:44:43,291][123090] Updated weights for policy 1, policy_version 1885119 (0.0009) [2023-12-26 14:44:43,432][123091] Updated weights for policy 0, policy_version 1896884 (0.0007) [2023-12-26 14:44:43,503][123091] Updated weights for policy 0, policy_version 1896894 (0.0005) [2023-12-26 14:44:43,577][123091] Updated weights for policy 0, policy_version 1896904 (0.0005) [2023-12-26 14:44:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 968204288. Throughput: 0: 8987.6, 1: 8608.6. Samples: 968195164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 33.0) [2023-12-26 14:44:43,785][121949] Avg episode reward: [(0, '6238.761'), (1, '5828.989')] [2023-12-26 14:44:44,168][123090] Updated weights for policy 1, policy_version 1885129 (0.0010) [2023-12-26 14:44:44,227][123090] Updated weights for policy 1, policy_version 1885139 (0.0010) [2023-12-26 14:44:44,283][123090] Updated weights for policy 1, policy_version 1885149 (0.0009) [2023-12-26 14:44:44,318][123091] Updated weights for policy 0, policy_version 1896914 (0.0006) [2023-12-26 14:44:44,370][123091] Updated weights for policy 0, policy_version 1896924 (0.0009) [2023-12-26 14:44:44,422][123091] Updated weights for policy 0, policy_version 1896934 (0.0009) [2023-12-26 14:44:44,476][123091] Updated weights for policy 0, policy_version 1896944 (0.0009) [2023-12-26 14:44:45,115][123090] Updated weights for policy 1, policy_version 1885159 (0.0011) [2023-12-26 14:44:45,174][123090] Updated weights for policy 1, policy_version 1885169 (0.0011) [2023-12-26 14:44:45,242][123090] Updated weights for policy 1, policy_version 1885179 (0.0011) [2023-12-26 14:44:45,354][123091] Updated weights for policy 0, policy_version 1896954 (0.0006) [2023-12-26 14:44:45,410][123091] Updated weights for policy 0, policy_version 1896964 (0.0010) [2023-12-26 14:44:45,472][123091] Updated weights for policy 0, policy_version 1896974 (0.0010) [2023-12-26 14:44:46,016][123090] Updated weights for policy 1, policy_version 1885189 (0.0010) [2023-12-26 14:44:46,063][123090] Updated weights for policy 1, policy_version 1885199 (0.0010) [2023-12-26 14:44:46,115][123090] Updated weights for policy 1, policy_version 1885209 (0.0010) [2023-12-26 14:44:46,235][123091] Updated weights for policy 0, policy_version 1896984 (0.0010) [2023-12-26 14:44:46,301][123091] Updated weights for policy 0, policy_version 1896994 (0.0010) [2023-12-26 14:44:46,359][123091] Updated weights for policy 0, policy_version 1897004 (0.0010) [2023-12-26 14:44:46,957][123090] Updated weights for policy 1, policy_version 1885219 (0.0009) [2023-12-26 14:44:47,017][123090] Updated weights for policy 1, policy_version 1885229 (0.0006) [2023-12-26 14:44:47,083][123090] Updated weights for policy 1, policy_version 1885239 (0.0005) [2023-12-26 14:44:47,158][123091] Updated weights for policy 0, policy_version 1897014 (0.0010) [2023-12-26 14:44:47,220][123091] Updated weights for policy 0, policy_version 1897024 (0.0010) [2023-12-26 14:44:47,282][123091] Updated weights for policy 0, policy_version 1897034 (0.0010) [2023-12-26 14:44:47,738][123090] Updated weights for policy 1, policy_version 1885249 (0.0006) [2023-12-26 14:44:47,797][123090] Updated weights for policy 1, policy_version 1885259 (0.0006) [2023-12-26 14:44:47,849][123090] Updated weights for policy 1, policy_version 1885269 (0.0005) [2023-12-26 14:44:47,900][123090] Updated weights for policy 1, policy_version 1885279 (0.0007) [2023-12-26 14:44:47,974][123091] Updated weights for policy 0, policy_version 1897044 (0.0008) [2023-12-26 14:44:48,052][123091] Updated weights for policy 0, policy_version 1897054 (0.0007) [2023-12-26 14:44:48,120][123091] Updated weights for policy 0, policy_version 1897064 (0.0008) [2023-12-26 14:44:48,727][123090] Updated weights for policy 1, policy_version 1885289 (0.0006) [2023-12-26 14:44:48,784][123090] Updated weights for policy 1, policy_version 1885299 (0.0008) [2023-12-26 14:44:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 968286208. Throughput: 0: 9051.1, 1: 8579.1. Samples: 968304204. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:44:48,785][121949] Avg episode reward: [(0, '6346.532'), (1, '5890.808')] [2023-12-26 14:44:48,801][123091] Updated weights for policy 0, policy_version 1897074 (0.0007) [2023-12-26 14:44:48,852][123090] Updated weights for policy 1, policy_version 1885309 (0.0008) [2023-12-26 14:44:48,860][123091] Updated weights for policy 0, policy_version 1897084 (0.0009) [2023-12-26 14:44:48,917][123091] Updated weights for policy 0, policy_version 1897094 (0.0006) [2023-12-26 14:44:48,970][123091] Updated weights for policy 0, policy_version 1897104 (0.0006) [2023-12-26 14:44:49,721][123090] Updated weights for policy 1, policy_version 1885319 (0.0008) [2023-12-26 14:44:49,776][123091] Updated weights for policy 0, policy_version 1897114 (0.0011) [2023-12-26 14:44:49,784][123090] Updated weights for policy 1, policy_version 1885329 (0.0007) [2023-12-26 14:44:49,845][123091] Updated weights for policy 0, policy_version 1897124 (0.0009) [2023-12-26 14:44:49,855][123090] Updated weights for policy 1, policy_version 1885339 (0.0008) [2023-12-26 14:44:49,911][123091] Updated weights for policy 0, policy_version 1897134 (0.0008) [2023-12-26 14:44:50,575][123091] Updated weights for policy 0, policy_version 1897144 (0.0006) [2023-12-26 14:44:50,650][123091] Updated weights for policy 0, policy_version 1897154 (0.0007) [2023-12-26 14:44:50,720][123091] Updated weights for policy 0, policy_version 1897164 (0.0007) [2023-12-26 14:44:50,790][123090] Updated weights for policy 1, policy_version 1885349 (0.0008) [2023-12-26 14:44:50,854][123090] Updated weights for policy 1, policy_version 1885359 (0.0009) [2023-12-26 14:44:50,932][123090] Updated weights for policy 1, policy_version 1885369 (0.0008) [2023-12-26 14:44:51,404][123091] Updated weights for policy 0, policy_version 1897174 (0.0008) [2023-12-26 14:44:51,463][123091] Updated weights for policy 0, policy_version 1897184 (0.0009) [2023-12-26 14:44:51,510][123091] Updated weights for policy 0, policy_version 1897194 (0.0005) [2023-12-26 14:44:51,699][123090] Updated weights for policy 1, policy_version 1885379 (0.0006) [2023-12-26 14:44:51,777][123090] Updated weights for policy 1, policy_version 1885389 (0.0009) [2023-12-26 14:44:51,839][123090] Updated weights for policy 1, policy_version 1885399 (0.0009) [2023-12-26 14:44:52,296][123091] Updated weights for policy 0, policy_version 1897204 (0.0006) [2023-12-26 14:44:52,360][123091] Updated weights for policy 0, policy_version 1897214 (0.0007) [2023-12-26 14:44:52,416][123091] Updated weights for policy 0, policy_version 1897224 (0.0006) [2023-12-26 14:44:52,752][123090] Updated weights for policy 1, policy_version 1885409 (0.0009) [2023-12-26 14:44:52,808][123090] Updated weights for policy 1, policy_version 1885419 (0.0008) [2023-12-26 14:44:52,866][123090] Updated weights for policy 1, policy_version 1885429 (0.0009) [2023-12-26 14:44:52,923][123090] Updated weights for policy 1, policy_version 1885439 (0.0010) [2023-12-26 14:44:53,133][123091] Updated weights for policy 0, policy_version 1897234 (0.0006) [2023-12-26 14:44:53,188][123091] Updated weights for policy 0, policy_version 1897244 (0.0010) [2023-12-26 14:44:53,240][123091] Updated weights for policy 0, policy_version 1897254 (0.0009) [2023-12-26 14:44:53,293][123091] Updated weights for policy 0, policy_version 1897264 (0.0010) [2023-12-26 14:44:53,636][123090] Updated weights for policy 1, policy_version 1885449 (0.0008) [2023-12-26 14:44:53,707][123090] Updated weights for policy 1, policy_version 1885459 (0.0009) [2023-12-26 14:44:53,771][123090] Updated weights for policy 1, policy_version 1885469 (0.0008) [2023-12-26 14:44:53,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 968376320. Throughput: 0: 9056.8, 1: 8566.1. Samples: 968356504. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:44:53,785][121949] Avg episode reward: [(0, '6270.544'), (1, '5848.481')] [2023-12-26 14:44:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001897264_485703680.pth... [2023-12-26 14:44:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001885472_482680832.pth... [2023-12-26 14:44:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001896208_485433344.pth [2023-12-26 14:44:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001884480_482426880.pth [2023-12-26 14:44:54,155][123091] Updated weights for policy 0, policy_version 1897274 (0.0010) [2023-12-26 14:44:54,209][123091] Updated weights for policy 0, policy_version 1897284 (0.0010) [2023-12-26 14:44:54,260][123091] Updated weights for policy 0, policy_version 1897294 (0.0009) [2023-12-26 14:44:54,620][123090] Updated weights for policy 1, policy_version 1885479 (0.0010) [2023-12-26 14:44:54,682][123090] Updated weights for policy 1, policy_version 1885489 (0.0009) [2023-12-26 14:44:54,744][123090] Updated weights for policy 1, policy_version 1885499 (0.0009) [2023-12-26 14:44:55,056][123091] Updated weights for policy 0, policy_version 1897304 (0.0010) [2023-12-26 14:44:55,113][123091] Updated weights for policy 0, policy_version 1897314 (0.0009) [2023-12-26 14:44:55,161][123091] Updated weights for policy 0, policy_version 1897324 (0.0009) [2023-12-26 14:44:55,535][123090] Updated weights for policy 1, policy_version 1885509 (0.0010) [2023-12-26 14:44:55,582][123090] Updated weights for policy 1, policy_version 1885519 (0.0010) [2023-12-26 14:44:55,626][123090] Updated weights for policy 1, policy_version 1885529 (0.0010) [2023-12-26 14:44:55,932][123091] Updated weights for policy 0, policy_version 1897334 (0.0010) [2023-12-26 14:44:55,991][123091] Updated weights for policy 0, policy_version 1897344 (0.0010) [2023-12-26 14:44:56,057][123091] Updated weights for policy 0, policy_version 1897354 (0.0011) [2023-12-26 14:44:56,397][123090] Updated weights for policy 1, policy_version 1885539 (0.0009) [2023-12-26 14:44:56,463][123090] Updated weights for policy 1, policy_version 1885549 (0.0005) [2023-12-26 14:44:56,521][123090] Updated weights for policy 1, policy_version 1885559 (0.0005) [2023-12-26 14:44:56,863][123091] Updated weights for policy 0, policy_version 1897364 (0.0008) [2023-12-26 14:44:56,936][123091] Updated weights for policy 0, policy_version 1897374 (0.0005) [2023-12-26 14:44:56,989][123091] Updated weights for policy 0, policy_version 1897384 (0.0005) [2023-12-26 14:44:57,226][123090] Updated weights for policy 1, policy_version 1885569 (0.0008) [2023-12-26 14:44:57,273][123090] Updated weights for policy 1, policy_version 1885579 (0.0005) [2023-12-26 14:44:57,331][123090] Updated weights for policy 1, policy_version 1885589 (0.0006) [2023-12-26 14:44:57,390][123090] Updated weights for policy 1, policy_version 1885599 (0.0006) [2023-12-26 14:44:57,622][123091] Updated weights for policy 0, policy_version 1897394 (0.0005) [2023-12-26 14:44:57,695][123091] Updated weights for policy 0, policy_version 1897404 (0.0005) [2023-12-26 14:44:57,770][123091] Updated weights for policy 0, policy_version 1897414 (0.0010) [2023-12-26 14:44:57,823][123091] Updated weights for policy 0, policy_version 1897424 (0.0010) [2023-12-26 14:44:58,125][123090] Updated weights for policy 1, policy_version 1885609 (0.0008) [2023-12-26 14:44:58,181][123090] Updated weights for policy 1, policy_version 1885619 (0.0008) [2023-12-26 14:44:58,243][123090] Updated weights for policy 1, policy_version 1885629 (0.0007) [2023-12-26 14:44:58,576][123091] Updated weights for policy 0, policy_version 1897434 (0.0008) [2023-12-26 14:44:58,638][123091] Updated weights for policy 0, policy_version 1897444 (0.0008) [2023-12-26 14:44:58,720][123091] Updated weights for policy 0, policy_version 1897454 (0.0008) [2023-12-26 14:44:58,788][121949] Fps is (10 sec: 18834.7, 60 sec: 17748.2, 300 sec: 17661.2). Total num frames: 968474624. Throughput: 0: 9046.6, 1: 8659.4. Samples: 968466064. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:44:58,788][121949] Avg episode reward: [(0, '6228.978'), (1, '5753.795')] [2023-12-26 14:44:59,163][123090] Updated weights for policy 1, policy_version 1885639 (0.0009) [2023-12-26 14:44:59,239][123090] Updated weights for policy 1, policy_version 1885650 (0.0007) [2023-12-26 14:44:59,304][123090] Updated weights for policy 1, policy_version 1885660 (0.0008) [2023-12-26 14:44:59,543][123091] Updated weights for policy 0, policy_version 1897464 (0.0009) [2023-12-26 14:44:59,614][123091] Updated weights for policy 0, policy_version 1897474 (0.0009) [2023-12-26 14:44:59,679][123091] Updated weights for policy 0, policy_version 1897484 (0.0009) [2023-12-26 14:45:00,110][123090] Updated weights for policy 1, policy_version 1885670 (0.0009) [2023-12-26 14:45:00,180][123090] Updated weights for policy 1, policy_version 1885680 (0.0010) [2023-12-26 14:45:00,250][123090] Updated weights for policy 1, policy_version 1885690 (0.0010) [2023-12-26 14:45:00,503][123091] Updated weights for policy 0, policy_version 1897494 (0.0011) [2023-12-26 14:45:00,557][123091] Updated weights for policy 0, policy_version 1897504 (0.0008) [2023-12-26 14:45:00,612][123091] Updated weights for policy 0, policy_version 1897514 (0.0006) [2023-12-26 14:45:00,972][123090] Updated weights for policy 1, policy_version 1885700 (0.0009) [2023-12-26 14:45:01,028][123090] Updated weights for policy 1, policy_version 1885710 (0.0009) [2023-12-26 14:45:01,084][123090] Updated weights for policy 1, policy_version 1885720 (0.0009) [2023-12-26 14:45:01,392][123091] Updated weights for policy 0, policy_version 1897524 (0.0007) [2023-12-26 14:45:01,453][123091] Updated weights for policy 0, policy_version 1897534 (0.0010) [2023-12-26 14:45:01,512][123091] Updated weights for policy 0, policy_version 1897544 (0.0011) [2023-12-26 14:45:01,867][123090] Updated weights for policy 1, policy_version 1885730 (0.0008) [2023-12-26 14:45:01,931][123090] Updated weights for policy 1, policy_version 1885740 (0.0010) [2023-12-26 14:45:02,003][123090] Updated weights for policy 1, policy_version 1885750 (0.0011) [2023-12-26 14:45:02,074][123090] Updated weights for policy 1, policy_version 1885760 (0.0007) [2023-12-26 14:45:02,277][123091] Updated weights for policy 0, policy_version 1897554 (0.0010) [2023-12-26 14:45:02,339][123091] Updated weights for policy 0, policy_version 1897564 (0.0009) [2023-12-26 14:45:02,404][123091] Updated weights for policy 0, policy_version 1897574 (0.0009) [2023-12-26 14:45:02,464][123091] Updated weights for policy 0, policy_version 1897584 (0.0009) [2023-12-26 14:45:02,857][123090] Updated weights for policy 1, policy_version 1885770 (0.0010) [2023-12-26 14:45:02,921][123090] Updated weights for policy 1, policy_version 1885780 (0.0010) [2023-12-26 14:45:02,977][123090] Updated weights for policy 1, policy_version 1885790 (0.0011) [2023-12-26 14:45:03,290][123091] Updated weights for policy 0, policy_version 1897594 (0.0009) [2023-12-26 14:45:03,337][123091] Updated weights for policy 0, policy_version 1897604 (0.0009) [2023-12-26 14:45:03,384][123091] Updated weights for policy 0, policy_version 1897614 (0.0008) [2023-12-26 14:45:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 968556544. Throughput: 0: 8966.7, 1: 8579.9. Samples: 968570856. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:03,785][121949] Avg episode reward: [(0, '6270.920'), (1, '5842.768')] [2023-12-26 14:45:03,793][123090] Updated weights for policy 1, policy_version 1885800 (0.0010) [2023-12-26 14:45:03,845][123090] Updated weights for policy 1, policy_version 1885810 (0.0010) [2023-12-26 14:45:03,904][123090] Updated weights for policy 1, policy_version 1885820 (0.0010) [2023-12-26 14:45:04,245][123091] Updated weights for policy 0, policy_version 1897624 (0.0009) [2023-12-26 14:45:04,307][123091] Updated weights for policy 0, policy_version 1897634 (0.0009) [2023-12-26 14:45:04,367][123091] Updated weights for policy 0, policy_version 1897644 (0.0009) [2023-12-26 14:45:04,775][123090] Updated weights for policy 1, policy_version 1885830 (0.0010) [2023-12-26 14:45:04,829][123090] Updated weights for policy 1, policy_version 1885840 (0.0010) [2023-12-26 14:45:04,876][123090] Updated weights for policy 1, policy_version 1885850 (0.0010) [2023-12-26 14:45:05,182][123091] Updated weights for policy 0, policy_version 1897654 (0.0010) [2023-12-26 14:45:05,249][123091] Updated weights for policy 0, policy_version 1897664 (0.0011) [2023-12-26 14:45:05,314][123091] Updated weights for policy 0, policy_version 1897674 (0.0011) [2023-12-26 14:45:05,691][123090] Updated weights for policy 1, policy_version 1885860 (0.0010) [2023-12-26 14:45:05,743][123090] Updated weights for policy 1, policy_version 1885870 (0.0010) [2023-12-26 14:45:05,794][123090] Updated weights for policy 1, policy_version 1885880 (0.0010) [2023-12-26 14:45:06,111][123091] Updated weights for policy 0, policy_version 1897684 (0.0010) [2023-12-26 14:45:06,188][123091] Updated weights for policy 0, policy_version 1897694 (0.0009) [2023-12-26 14:45:06,256][123091] Updated weights for policy 0, policy_version 1897704 (0.0010) [2023-12-26 14:45:06,620][123090] Updated weights for policy 1, policy_version 1885890 (0.0010) [2023-12-26 14:45:06,688][123090] Updated weights for policy 1, policy_version 1885900 (0.0011) [2023-12-26 14:45:06,756][123090] Updated weights for policy 1, policy_version 1885910 (0.0011) [2023-12-26 14:45:06,824][123090] Updated weights for policy 1, policy_version 1885920 (0.0011) [2023-12-26 14:45:07,066][123091] Updated weights for policy 0, policy_version 1897714 (0.0009) [2023-12-26 14:45:07,114][123091] Updated weights for policy 0, policy_version 1897724 (0.0009) [2023-12-26 14:45:07,164][123091] Updated weights for policy 0, policy_version 1897735 (0.0009) [2023-12-26 14:45:07,642][123090] Updated weights for policy 1, policy_version 1885930 (0.0007) [2023-12-26 14:45:07,690][123090] Updated weights for policy 1, policy_version 1885940 (0.0010) [2023-12-26 14:45:07,746][123090] Updated weights for policy 1, policy_version 1885950 (0.0010) [2023-12-26 14:45:07,904][123091] Updated weights for policy 0, policy_version 1897745 (0.0009) [2023-12-26 14:45:07,963][123091] Updated weights for policy 0, policy_version 1897755 (0.0005) [2023-12-26 14:45:08,012][123091] Updated weights for policy 0, policy_version 1897765 (0.0005) [2023-12-26 14:45:08,067][123091] Updated weights for policy 0, policy_version 1897775 (0.0007) [2023-12-26 14:45:08,569][123090] Updated weights for policy 1, policy_version 1885960 (0.0009) [2023-12-26 14:45:08,632][123090] Updated weights for policy 1, policy_version 1885970 (0.0009) [2023-12-26 14:45:08,698][123090] Updated weights for policy 1, policy_version 1885980 (0.0009) [2023-12-26 14:45:08,784][121949] Fps is (10 sec: 17209.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 968646656. Throughput: 0: 8988.0, 1: 8541.2. Samples: 968622284. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:08,785][121949] Avg episode reward: [(0, '6288.567'), (1, '5836.754')] [2023-12-26 14:45:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001897776_485834752.pth... [2023-12-26 14:45:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001885984_482811904.pth... [2023-12-26 14:45:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001896720_485564416.pth [2023-12-26 14:45:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001884960_482549760.pth [2023-12-26 14:45:08,864][123091] Updated weights for policy 0, policy_version 1897785 (0.0005) [2023-12-26 14:45:08,933][123091] Updated weights for policy 0, policy_version 1897795 (0.0005) [2023-12-26 14:45:08,994][123091] Updated weights for policy 0, policy_version 1897805 (0.0005) [2023-12-26 14:45:09,598][123090] Updated weights for policy 1, policy_version 1885990 (0.0008) [2023-12-26 14:45:09,645][123091] Updated weights for policy 0, policy_version 1897815 (0.0006) [2023-12-26 14:45:09,661][123090] Updated weights for policy 1, policy_version 1886000 (0.0010) [2023-12-26 14:45:09,703][123091] Updated weights for policy 0, policy_version 1897825 (0.0007) [2023-12-26 14:45:09,726][123090] Updated weights for policy 1, policy_version 1886010 (0.0008) [2023-12-26 14:45:09,760][123091] Updated weights for policy 0, policy_version 1897835 (0.0006) [2023-12-26 14:45:10,559][123090] Updated weights for policy 1, policy_version 1886020 (0.0008) [2023-12-26 14:45:10,619][123090] Updated weights for policy 1, policy_version 1886030 (0.0005) [2023-12-26 14:45:10,637][123091] Updated weights for policy 0, policy_version 1897845 (0.0009) [2023-12-26 14:45:10,679][123090] Updated weights for policy 1, policy_version 1886040 (0.0005) [2023-12-26 14:45:10,695][123091] Updated weights for policy 0, policy_version 1897855 (0.0009) [2023-12-26 14:45:10,751][123091] Updated weights for policy 0, policy_version 1897865 (0.0009) [2023-12-26 14:45:11,504][123090] Updated weights for policy 1, policy_version 1886050 (0.0008) [2023-12-26 14:45:11,570][123090] Updated weights for policy 1, policy_version 1886060 (0.0010) [2023-12-26 14:45:11,632][123090] Updated weights for policy 1, policy_version 1886070 (0.0009) [2023-12-26 14:45:11,633][123091] Updated weights for policy 0, policy_version 1897875 (0.0009) [2023-12-26 14:45:11,691][123091] Updated weights for policy 0, policy_version 1897885 (0.0006) [2023-12-26 14:45:11,701][123090] Updated weights for policy 1, policy_version 1886080 (0.0007) [2023-12-26 14:45:11,755][123091] Updated weights for policy 0, policy_version 1897895 (0.0008) [2023-12-26 14:45:12,375][123091] Updated weights for policy 0, policy_version 1897905 (0.0006) [2023-12-26 14:45:12,447][123091] Updated weights for policy 0, policy_version 1897915 (0.0007) [2023-12-26 14:45:12,500][123091] Updated weights for policy 0, policy_version 1897925 (0.0006) [2023-12-26 14:45:12,500][123090] Updated weights for policy 1, policy_version 1886090 (0.0011) [2023-12-26 14:45:12,568][123091] Updated weights for policy 0, policy_version 1897935 (0.0006) [2023-12-26 14:45:12,577][123090] Updated weights for policy 1, policy_version 1886100 (0.0011) [2023-12-26 14:45:12,641][123090] Updated weights for policy 1, policy_version 1886110 (0.0011) [2023-12-26 14:45:13,286][123091] Updated weights for policy 0, policy_version 1897946 (0.0010) [2023-12-26 14:45:13,350][123091] Updated weights for policy 0, policy_version 1897956 (0.0009) [2023-12-26 14:45:13,372][123090] Updated weights for policy 1, policy_version 1886120 (0.0008) [2023-12-26 14:45:13,416][123091] Updated weights for policy 0, policy_version 1897966 (0.0008) [2023-12-26 14:45:13,417][123090] Updated weights for policy 1, policy_version 1886130 (0.0008) [2023-12-26 14:45:13,480][123090] Updated weights for policy 1, policy_version 1886140 (0.0009) [2023-12-26 14:45:13,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 968736768. Throughput: 0: 9054.8, 1: 8516.9. Samples: 968727912. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:13,785][121949] Avg episode reward: [(0, '6165.866'), (1, '5830.916')] [2023-12-26 14:45:14,173][123091] Updated weights for policy 0, policy_version 1897976 (0.0005) [2023-12-26 14:45:14,236][123091] Updated weights for policy 0, policy_version 1897986 (0.0005) [2023-12-26 14:45:14,285][123090] Updated weights for policy 1, policy_version 1886150 (0.0007) [2023-12-26 14:45:14,304][123091] Updated weights for policy 0, policy_version 1897996 (0.0006) [2023-12-26 14:45:14,344][123090] Updated weights for policy 1, policy_version 1886160 (0.0005) [2023-12-26 14:45:14,415][123090] Updated weights for policy 1, policy_version 1886170 (0.0005) [2023-12-26 14:45:15,066][123091] Updated weights for policy 0, policy_version 1898006 (0.0009) [2023-12-26 14:45:15,118][123091] Updated weights for policy 0, policy_version 1898016 (0.0009) [2023-12-26 14:45:15,180][123091] Updated weights for policy 0, policy_version 1898026 (0.0009) [2023-12-26 14:45:15,201][123090] Updated weights for policy 1, policy_version 1886180 (0.0008) [2023-12-26 14:45:15,258][123090] Updated weights for policy 1, policy_version 1886190 (0.0009) [2023-12-26 14:45:15,314][123090] Updated weights for policy 1, policy_version 1886200 (0.0010) [2023-12-26 14:45:15,974][123091] Updated weights for policy 0, policy_version 1898036 (0.0010) [2023-12-26 14:45:16,024][123091] Updated weights for policy 0, policy_version 1898046 (0.0009) [2023-12-26 14:45:16,077][123091] Updated weights for policy 0, policy_version 1898056 (0.0009) [2023-12-26 14:45:16,218][123090] Updated weights for policy 1, policy_version 1886210 (0.0009) [2023-12-26 14:45:16,268][123090] Updated weights for policy 1, policy_version 1886220 (0.0009) [2023-12-26 14:45:16,332][123090] Updated weights for policy 1, policy_version 1886230 (0.0009) [2023-12-26 14:45:16,385][123090] Updated weights for policy 1, policy_version 1886240 (0.0009) [2023-12-26 14:45:16,860][123091] Updated weights for policy 0, policy_version 1898066 (0.0009) [2023-12-26 14:45:16,921][123091] Updated weights for policy 0, policy_version 1898076 (0.0005) [2023-12-26 14:45:16,977][123091] Updated weights for policy 0, policy_version 1898086 (0.0005) [2023-12-26 14:45:17,038][123091] Updated weights for policy 0, policy_version 1898096 (0.0005) [2023-12-26 14:45:17,282][123090] Updated weights for policy 1, policy_version 1886250 (0.0010) [2023-12-26 14:45:17,347][123090] Updated weights for policy 1, policy_version 1886260 (0.0009) [2023-12-26 14:45:17,405][123090] Updated weights for policy 1, policy_version 1886270 (0.0009) [2023-12-26 14:45:17,622][123091] Updated weights for policy 0, policy_version 1898106 (0.0005) [2023-12-26 14:45:17,677][123091] Updated weights for policy 0, policy_version 1898116 (0.0005) [2023-12-26 14:45:17,739][123091] Updated weights for policy 0, policy_version 1898126 (0.0008) [2023-12-26 14:45:18,247][123090] Updated weights for policy 1, policy_version 1886280 (0.0009) [2023-12-26 14:45:18,302][123090] Updated weights for policy 1, policy_version 1886290 (0.0008) [2023-12-26 14:45:18,369][123090] Updated weights for policy 1, policy_version 1886300 (0.0008) [2023-12-26 14:45:18,527][123091] Updated weights for policy 0, policy_version 1898136 (0.0006) [2023-12-26 14:45:18,593][123091] Updated weights for policy 0, policy_version 1898146 (0.0005) [2023-12-26 14:45:18,658][123091] Updated weights for policy 0, policy_version 1898156 (0.0005) [2023-12-26 14:45:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 968826880. Throughput: 0: 9084.2, 1: 8556.6. Samples: 968834880. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:18,784][121949] Avg episode reward: [(0, '6116.290'), (1, '5987.672')] [2023-12-26 14:45:19,306][123090] Updated weights for policy 1, policy_version 1886310 (0.0009) [2023-12-26 14:45:19,344][123091] Updated weights for policy 0, policy_version 1898166 (0.0009) [2023-12-26 14:45:19,377][123090] Updated weights for policy 1, policy_version 1886320 (0.0009) [2023-12-26 14:45:19,414][123091] Updated weights for policy 0, policy_version 1898176 (0.0010) [2023-12-26 14:45:19,440][123090] Updated weights for policy 1, policy_version 1886330 (0.0007) [2023-12-26 14:45:19,470][123091] Updated weights for policy 0, policy_version 1898186 (0.0011) [2023-12-26 14:45:20,230][123091] Updated weights for policy 0, policy_version 1898196 (0.0008) [2023-12-26 14:45:20,300][123091] Updated weights for policy 0, policy_version 1898206 (0.0008) [2023-12-26 14:45:20,331][123090] Updated weights for policy 1, policy_version 1886340 (0.0007) [2023-12-26 14:45:20,365][123091] Updated weights for policy 0, policy_version 1898216 (0.0008) [2023-12-26 14:45:20,391][123090] Updated weights for policy 1, policy_version 1886350 (0.0010) [2023-12-26 14:45:20,457][123090] Updated weights for policy 1, policy_version 1886360 (0.0008) [2023-12-26 14:45:21,164][123091] Updated weights for policy 0, policy_version 1898226 (0.0009) [2023-12-26 14:45:21,226][123091] Updated weights for policy 0, policy_version 1898236 (0.0010) [2023-12-26 14:45:21,296][123091] Updated weights for policy 0, policy_version 1898246 (0.0010) [2023-12-26 14:45:21,317][123090] Updated weights for policy 1, policy_version 1886370 (0.0009) [2023-12-26 14:45:21,362][123091] Updated weights for policy 0, policy_version 1898256 (0.0010) [2023-12-26 14:45:21,394][123090] Updated weights for policy 1, policy_version 1886380 (0.0007) [2023-12-26 14:45:21,464][123090] Updated weights for policy 1, policy_version 1886390 (0.0007) [2023-12-26 14:45:21,521][123090] Updated weights for policy 1, policy_version 1886400 (0.0011) [2023-12-26 14:45:22,180][123091] Updated weights for policy 0, policy_version 1898266 (0.0006) [2023-12-26 14:45:22,244][123091] Updated weights for policy 0, policy_version 1898276 (0.0010) [2023-12-26 14:45:22,303][123091] Updated weights for policy 0, policy_version 1898286 (0.0007) [2023-12-26 14:45:22,310][123090] Updated weights for policy 1, policy_version 1886410 (0.0010) [2023-12-26 14:45:22,372][123090] Updated weights for policy 1, policy_version 1886420 (0.0011) [2023-12-26 14:45:22,428][123090] Updated weights for policy 1, policy_version 1886430 (0.0010) [2023-12-26 14:45:23,032][123091] Updated weights for policy 0, policy_version 1898296 (0.0010) [2023-12-26 14:45:23,095][123091] Updated weights for policy 0, policy_version 1898306 (0.0010) [2023-12-26 14:45:23,149][123091] Updated weights for policy 0, policy_version 1898316 (0.0006) [2023-12-26 14:45:23,282][123090] Updated weights for policy 1, policy_version 1886440 (0.0010) [2023-12-26 14:45:23,341][123090] Updated weights for policy 1, policy_version 1886450 (0.0010) [2023-12-26 14:45:23,389][123090] Updated weights for policy 1, policy_version 1886460 (0.0010) [2023-12-26 14:45:23,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17476.3, 300 sec: 17605.8). Total num frames: 968908800. Throughput: 0: 9107.1, 1: 8508.4. Samples: 968885244. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:23,785][121949] Avg episode reward: [(0, '6272.699'), (1, '5884.944')] [2023-12-26 14:45:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001898320_485974016.pth... [2023-12-26 14:45:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001886464_482934784.pth... [2023-12-26 14:45:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001897264_485703680.pth [2023-12-26 14:45:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001885472_482680832.pth [2023-12-26 14:45:23,848][123091] Updated weights for policy 0, policy_version 1898326 (0.0008) [2023-12-26 14:45:23,899][123091] Updated weights for policy 0, policy_version 1898336 (0.0006) [2023-12-26 14:45:23,971][123091] Updated weights for policy 0, policy_version 1898346 (0.0005) [2023-12-26 14:45:24,221][123090] Updated weights for policy 1, policy_version 1886470 (0.0008) [2023-12-26 14:45:24,283][123090] Updated weights for policy 1, policy_version 1886480 (0.0010) [2023-12-26 14:45:24,345][123090] Updated weights for policy 1, policy_version 1886490 (0.0010) [2023-12-26 14:45:24,758][123091] Updated weights for policy 0, policy_version 1898356 (0.0007) [2023-12-26 14:45:24,825][123091] Updated weights for policy 0, policy_version 1898366 (0.0009) [2023-12-26 14:45:24,877][123091] Updated weights for policy 0, policy_version 1898376 (0.0009) [2023-12-26 14:45:25,113][123090] Updated weights for policy 1, policy_version 1886500 (0.0010) [2023-12-26 14:45:25,168][123090] Updated weights for policy 1, policy_version 1886510 (0.0007) [2023-12-26 14:45:25,230][123090] Updated weights for policy 1, policy_version 1886520 (0.0005) [2023-12-26 14:45:25,678][123091] Updated weights for policy 0, policy_version 1898386 (0.0009) [2023-12-26 14:45:25,740][123091] Updated weights for policy 0, policy_version 1898396 (0.0007) [2023-12-26 14:45:25,802][123091] Updated weights for policy 0, policy_version 1898406 (0.0009) [2023-12-26 14:45:25,860][123091] Updated weights for policy 0, policy_version 1898416 (0.0009) [2023-12-26 14:45:25,986][123090] Updated weights for policy 1, policy_version 1886530 (0.0006) [2023-12-26 14:45:26,043][123090] Updated weights for policy 1, policy_version 1886540 (0.0009) [2023-12-26 14:45:26,105][123090] Updated weights for policy 1, policy_version 1886550 (0.0008) [2023-12-26 14:45:26,158][123090] Updated weights for policy 1, policy_version 1886560 (0.0009) [2023-12-26 14:45:26,663][123091] Updated weights for policy 0, policy_version 1898426 (0.0010) [2023-12-26 14:45:26,726][123091] Updated weights for policy 0, policy_version 1898436 (0.0009) [2023-12-26 14:45:26,794][123091] Updated weights for policy 0, policy_version 1898446 (0.0009) [2023-12-26 14:45:27,003][123090] Updated weights for policy 1, policy_version 1886570 (0.0007) [2023-12-26 14:45:27,059][123090] Updated weights for policy 1, policy_version 1886580 (0.0008) [2023-12-26 14:45:27,107][123090] Updated weights for policy 1, policy_version 1886590 (0.0005) [2023-12-26 14:45:27,570][123091] Updated weights for policy 0, policy_version 1898456 (0.0009) [2023-12-26 14:45:27,628][123091] Updated weights for policy 0, policy_version 1898467 (0.0010) [2023-12-26 14:45:27,693][123091] Updated weights for policy 0, policy_version 1898477 (0.0009) [2023-12-26 14:45:27,723][123090] Updated weights for policy 1, policy_version 1886600 (0.0005) [2023-12-26 14:45:27,779][123090] Updated weights for policy 1, policy_version 1886610 (0.0005) [2023-12-26 14:45:27,832][123090] Updated weights for policy 1, policy_version 1886620 (0.0005) [2023-12-26 14:45:28,516][123091] Updated weights for policy 0, policy_version 1898487 (0.0009) [2023-12-26 14:45:28,581][123091] Updated weights for policy 0, policy_version 1898497 (0.0010) [2023-12-26 14:45:28,630][123090] Updated weights for policy 1, policy_version 1886630 (0.0006) [2023-12-26 14:45:28,636][123091] Updated weights for policy 0, policy_version 1898507 (0.0010) [2023-12-26 14:45:28,688][123090] Updated weights for policy 1, policy_version 1886640 (0.0008) [2023-12-26 14:45:28,746][123090] Updated weights for policy 1, policy_version 1886650 (0.0009) [2023-12-26 14:45:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17661.4). Total num frames: 969007104. Throughput: 0: 9110.8, 1: 8636.1. Samples: 968993772. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:28,785][121949] Avg episode reward: [(0, '6293.098'), (1, '5890.613')] [2023-12-26 14:45:29,531][123091] Updated weights for policy 0, policy_version 1898517 (0.0009) [2023-12-26 14:45:29,541][123090] Updated weights for policy 1, policy_version 1886660 (0.0008) [2023-12-26 14:45:29,587][123091] Updated weights for policy 0, policy_version 1898527 (0.0006) [2023-12-26 14:45:29,605][123090] Updated weights for policy 1, policy_version 1886670 (0.0010) [2023-12-26 14:45:29,647][123091] Updated weights for policy 0, policy_version 1898537 (0.0008) [2023-12-26 14:45:29,658][123090] Updated weights for policy 1, policy_version 1886680 (0.0008) [2023-12-26 14:45:30,490][123090] Updated weights for policy 1, policy_version 1886690 (0.0007) [2023-12-26 14:45:30,526][123091] Updated weights for policy 0, policy_version 1898547 (0.0009) [2023-12-26 14:45:30,547][123090] Updated weights for policy 1, policy_version 1886700 (0.0005) [2023-12-26 14:45:30,592][123091] Updated weights for policy 0, policy_version 1898557 (0.0009) [2023-12-26 14:45:30,608][123090] Updated weights for policy 1, policy_version 1886710 (0.0007) [2023-12-26 14:45:30,654][123091] Updated weights for policy 0, policy_version 1898567 (0.0010) [2023-12-26 14:45:30,657][123090] Updated weights for policy 1, policy_version 1886720 (0.0006) [2023-12-26 14:45:31,437][123090] Updated weights for policy 1, policy_version 1886730 (0.0010) [2023-12-26 14:45:31,500][123090] Updated weights for policy 1, policy_version 1886740 (0.0010) [2023-12-26 14:45:31,528][123091] Updated weights for policy 0, policy_version 1898577 (0.0009) [2023-12-26 14:45:31,565][123090] Updated weights for policy 1, policy_version 1886750 (0.0009) [2023-12-26 14:45:31,586][123091] Updated weights for policy 0, policy_version 1898587 (0.0007) [2023-12-26 14:45:31,647][123091] Updated weights for policy 0, policy_version 1898597 (0.0008) [2023-12-26 14:45:31,695][123091] Updated weights for policy 0, policy_version 1898607 (0.0009) [2023-12-26 14:45:32,406][123090] Updated weights for policy 1, policy_version 1886760 (0.0011) [2023-12-26 14:45:32,458][123090] Updated weights for policy 1, policy_version 1886770 (0.0010) [2023-12-26 14:45:32,511][123090] Updated weights for policy 1, policy_version 1886780 (0.0007) [2023-12-26 14:45:32,573][123091] Updated weights for policy 0, policy_version 1898617 (0.0010) [2023-12-26 14:45:32,642][123091] Updated weights for policy 0, policy_version 1898627 (0.0009) [2023-12-26 14:45:32,703][123091] Updated weights for policy 0, policy_version 1898637 (0.0009) [2023-12-26 14:45:33,260][123090] Updated weights for policy 1, policy_version 1886790 (0.0008) [2023-12-26 14:45:33,320][123090] Updated weights for policy 1, policy_version 1886800 (0.0010) [2023-12-26 14:45:33,380][123090] Updated weights for policy 1, policy_version 1886810 (0.0010) [2023-12-26 14:45:33,503][123091] Updated weights for policy 0, policy_version 1898647 (0.0008) [2023-12-26 14:45:33,555][123091] Updated weights for policy 0, policy_version 1898657 (0.0009) [2023-12-26 14:45:33,617][123091] Updated weights for policy 0, policy_version 1898667 (0.0009) [2023-12-26 14:45:33,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17633.7). Total num frames: 969089024. Throughput: 0: 8958.6, 1: 8641.8. Samples: 969096220. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:33,785][121949] Avg episode reward: [(0, '6367.817'), (1, '5794.796')] [2023-12-26 14:45:34,228][123090] Updated weights for policy 1, policy_version 1886820 (0.0010) [2023-12-26 14:45:34,297][123090] Updated weights for policy 1, policy_version 1886830 (0.0009) [2023-12-26 14:45:34,358][123090] Updated weights for policy 1, policy_version 1886840 (0.0010) [2023-12-26 14:45:34,386][123091] Updated weights for policy 0, policy_version 1898677 (0.0009) [2023-12-26 14:45:34,455][123091] Updated weights for policy 0, policy_version 1898687 (0.0008) [2023-12-26 14:45:34,521][123091] Updated weights for policy 0, policy_version 1898697 (0.0008) [2023-12-26 14:45:35,077][123090] Updated weights for policy 1, policy_version 1886850 (0.0008) [2023-12-26 14:45:35,148][123090] Updated weights for policy 1, policy_version 1886860 (0.0007) [2023-12-26 14:45:35,217][123090] Updated weights for policy 1, policy_version 1886870 (0.0008) [2023-12-26 14:45:35,238][123091] Updated weights for policy 0, policy_version 1898707 (0.0007) [2023-12-26 14:45:35,280][123090] Updated weights for policy 1, policy_version 1886880 (0.0007) [2023-12-26 14:45:35,292][123091] Updated weights for policy 0, policy_version 1898717 (0.0006) [2023-12-26 14:45:35,362][123091] Updated weights for policy 0, policy_version 1898727 (0.0011) [2023-12-26 14:45:35,907][123090] Updated weights for policy 1, policy_version 1886890 (0.0005) [2023-12-26 14:45:35,979][123090] Updated weights for policy 1, policy_version 1886900 (0.0005) [2023-12-26 14:45:36,053][123090] Updated weights for policy 1, policy_version 1886910 (0.0006) [2023-12-26 14:45:36,109][123091] Updated weights for policy 0, policy_version 1898737 (0.0011) [2023-12-26 14:45:36,177][123091] Updated weights for policy 0, policy_version 1898747 (0.0010) [2023-12-26 14:45:36,246][123091] Updated weights for policy 0, policy_version 1898757 (0.0009) [2023-12-26 14:45:36,319][123091] Updated weights for policy 0, policy_version 1898767 (0.0010) [2023-12-26 14:45:36,734][123090] Updated weights for policy 1, policy_version 1886920 (0.0008) [2023-12-26 14:45:36,805][123090] Updated weights for policy 1, policy_version 1886930 (0.0007) [2023-12-26 14:45:36,882][123090] Updated weights for policy 1, policy_version 1886940 (0.0008) [2023-12-26 14:45:37,187][123091] Updated weights for policy 0, policy_version 1898777 (0.0009) [2023-12-26 14:45:37,249][123091] Updated weights for policy 0, policy_version 1898787 (0.0010) [2023-12-26 14:45:37,312][123091] Updated weights for policy 0, policy_version 1898797 (0.0009) [2023-12-26 14:45:37,701][123090] Updated weights for policy 1, policy_version 1886950 (0.0009) [2023-12-26 14:45:37,773][123090] Updated weights for policy 1, policy_version 1886960 (0.0009) [2023-12-26 14:45:37,837][123090] Updated weights for policy 1, policy_version 1886970 (0.0010) [2023-12-26 14:45:38,064][123091] Updated weights for policy 0, policy_version 1898807 (0.0009) [2023-12-26 14:45:38,122][123091] Updated weights for policy 0, policy_version 1898817 (0.0010) [2023-12-26 14:45:38,185][123091] Updated weights for policy 0, policy_version 1898827 (0.0010) [2023-12-26 14:45:38,648][123090] Updated weights for policy 1, policy_version 1886980 (0.0008) [2023-12-26 14:45:38,720][123090] Updated weights for policy 1, policy_version 1886990 (0.0006) [2023-12-26 14:45:38,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 969170944. Throughput: 0: 8954.4, 1: 8727.8. Samples: 969152200. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:38,785][121949] Avg episode reward: [(0, '6409.340'), (1, '5621.335')] [2023-12-26 14:45:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001898832_486105088.pth... [2023-12-26 14:45:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001897776_485834752.pth [2023-12-26 14:45:38,798][123090] Updated weights for policy 1, policy_version 1887000 (0.0006) [2023-12-26 14:45:38,860][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001887008_483074048.pth... [2023-12-26 14:45:38,865][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001885984_482811904.pth [2023-12-26 14:45:39,031][123091] Updated weights for policy 0, policy_version 1898837 (0.0007) [2023-12-26 14:45:39,090][123091] Updated weights for policy 0, policy_version 1898847 (0.0005) [2023-12-26 14:45:39,147][123091] Updated weights for policy 0, policy_version 1898857 (0.0005) [2023-12-26 14:45:39,543][123090] Updated weights for policy 1, policy_version 1887010 (0.0007) [2023-12-26 14:45:39,607][123090] Updated weights for policy 1, policy_version 1887020 (0.0010) [2023-12-26 14:45:39,671][123090] Updated weights for policy 1, policy_version 1887030 (0.0010) [2023-12-26 14:45:39,731][123090] Updated weights for policy 1, policy_version 1887040 (0.0009) [2023-12-26 14:45:39,890][123091] Updated weights for policy 0, policy_version 1898867 (0.0006) [2023-12-26 14:45:39,957][123091] Updated weights for policy 0, policy_version 1898877 (0.0009) [2023-12-26 14:45:40,024][123091] Updated weights for policy 0, policy_version 1898887 (0.0009) [2023-12-26 14:45:40,628][123090] Updated weights for policy 1, policy_version 1887050 (0.0009) [2023-12-26 14:45:40,695][123090] Updated weights for policy 1, policy_version 1887060 (0.0009) [2023-12-26 14:45:40,727][123091] Updated weights for policy 0, policy_version 1898897 (0.0009) [2023-12-26 14:45:40,763][123090] Updated weights for policy 1, policy_version 1887070 (0.0005) [2023-12-26 14:45:40,797][123091] Updated weights for policy 0, policy_version 1898907 (0.0007) [2023-12-26 14:45:40,864][123091] Updated weights for policy 0, policy_version 1898917 (0.0008) [2023-12-26 14:45:40,931][123091] Updated weights for policy 0, policy_version 1898927 (0.0010) [2023-12-26 14:45:41,530][123090] Updated weights for policy 1, policy_version 1887080 (0.0005) [2023-12-26 14:45:41,598][123090] Updated weights for policy 1, policy_version 1887090 (0.0008) [2023-12-26 14:45:41,671][123090] Updated weights for policy 1, policy_version 1887100 (0.0008) [2023-12-26 14:45:41,781][123091] Updated weights for policy 0, policy_version 1898937 (0.0010) [2023-12-26 14:45:41,849][123091] Updated weights for policy 0, policy_version 1898947 (0.0006) [2023-12-26 14:45:41,922][123091] Updated weights for policy 0, policy_version 1898957 (0.0007) [2023-12-26 14:45:42,485][123090] Updated weights for policy 1, policy_version 1887110 (0.0009) [2023-12-26 14:45:42,550][123090] Updated weights for policy 1, policy_version 1887120 (0.0011) [2023-12-26 14:45:42,611][123090] Updated weights for policy 1, policy_version 1887130 (0.0010) [2023-12-26 14:45:42,758][123091] Updated weights for policy 0, policy_version 1898967 (0.0010) [2023-12-26 14:45:42,821][123091] Updated weights for policy 0, policy_version 1898977 (0.0009) [2023-12-26 14:45:42,877][123091] Updated weights for policy 0, policy_version 1898987 (0.0010) [2023-12-26 14:45:43,415][123090] Updated weights for policy 1, policy_version 1887140 (0.0008) [2023-12-26 14:45:43,470][123090] Updated weights for policy 1, policy_version 1887150 (0.0010) [2023-12-26 14:45:43,524][123090] Updated weights for policy 1, policy_version 1887160 (0.0010) [2023-12-26 14:45:43,602][123091] Updated weights for policy 0, policy_version 1898997 (0.0007) [2023-12-26 14:45:43,648][123091] Updated weights for policy 0, policy_version 1899007 (0.0005) [2023-12-26 14:45:43,699][123091] Updated weights for policy 0, policy_version 1899017 (0.0005) [2023-12-26 14:45:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 969269248. Throughput: 0: 8888.4, 1: 8681.8. Samples: 969256656. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:43,785][121949] Avg episode reward: [(0, '6371.178'), (1, '5535.388')] [2023-12-26 14:45:44,301][123090] Updated weights for policy 1, policy_version 1887170 (0.0009) [2023-12-26 14:45:44,330][123091] Updated weights for policy 0, policy_version 1899027 (0.0006) [2023-12-26 14:45:44,366][123090] Updated weights for policy 1, policy_version 1887180 (0.0005) [2023-12-26 14:45:44,387][123091] Updated weights for policy 0, policy_version 1899037 (0.0007) [2023-12-26 14:45:44,429][123090] Updated weights for policy 1, policy_version 1887190 (0.0005) [2023-12-26 14:45:44,445][123091] Updated weights for policy 0, policy_version 1899047 (0.0008) [2023-12-26 14:45:44,491][123090] Updated weights for policy 1, policy_version 1887200 (0.0005) [2023-12-26 14:45:45,074][123091] Updated weights for policy 0, policy_version 1899057 (0.0008) [2023-12-26 14:45:45,077][123090] Updated weights for policy 1, policy_version 1887210 (0.0011) [2023-12-26 14:45:45,137][123091] Updated weights for policy 0, policy_version 1899067 (0.0008) [2023-12-26 14:45:45,145][123090] Updated weights for policy 1, policy_version 1887220 (0.0011) [2023-12-26 14:45:45,200][123091] Updated weights for policy 0, policy_version 1899077 (0.0006) [2023-12-26 14:45:45,213][123090] Updated weights for policy 1, policy_version 1887230 (0.0011) [2023-12-26 14:45:45,267][123091] Updated weights for policy 0, policy_version 1899087 (0.0006) [2023-12-26 14:45:45,993][123091] Updated weights for policy 0, policy_version 1899097 (0.0006) [2023-12-26 14:45:46,012][123090] Updated weights for policy 1, policy_version 1887240 (0.0006) [2023-12-26 14:45:46,045][123091] Updated weights for policy 0, policy_version 1899107 (0.0005) [2023-12-26 14:45:46,063][123090] Updated weights for policy 1, policy_version 1887250 (0.0006) [2023-12-26 14:45:46,094][123091] Updated weights for policy 0, policy_version 1899117 (0.0005) [2023-12-26 14:45:46,122][123090] Updated weights for policy 1, policy_version 1887260 (0.0010) [2023-12-26 14:45:46,880][123091] Updated weights for policy 0, policy_version 1899127 (0.0010) [2023-12-26 14:45:46,911][123090] Updated weights for policy 1, policy_version 1887270 (0.0011) [2023-12-26 14:45:46,943][123091] Updated weights for policy 0, policy_version 1899137 (0.0011) [2023-12-26 14:45:46,969][123090] Updated weights for policy 1, policy_version 1887280 (0.0006) [2023-12-26 14:45:47,010][123091] Updated weights for policy 0, policy_version 1899147 (0.0011) [2023-12-26 14:45:47,038][123090] Updated weights for policy 1, policy_version 1887290 (0.0006) [2023-12-26 14:45:47,758][123090] Updated weights for policy 1, policy_version 1887300 (0.0005) [2023-12-26 14:45:47,811][123090] Updated weights for policy 1, policy_version 1887310 (0.0006) [2023-12-26 14:45:47,837][123091] Updated weights for policy 0, policy_version 1899157 (0.0008) [2023-12-26 14:45:47,871][123090] Updated weights for policy 1, policy_version 1887320 (0.0005) [2023-12-26 14:45:47,902][123091] Updated weights for policy 0, policy_version 1899167 (0.0009) [2023-12-26 14:45:47,958][123091] Updated weights for policy 0, policy_version 1899177 (0.0005) [2023-12-26 14:45:48,539][123090] Updated weights for policy 1, policy_version 1887330 (0.0006) [2023-12-26 14:45:48,595][123090] Updated weights for policy 1, policy_version 1887340 (0.0009) [2023-12-26 14:45:48,652][123090] Updated weights for policy 1, policy_version 1887350 (0.0009) [2023-12-26 14:45:48,660][123091] Updated weights for policy 0, policy_version 1899187 (0.0006) [2023-12-26 14:45:48,714][123090] Updated weights for policy 1, policy_version 1887360 (0.0009) [2023-12-26 14:45:48,729][123091] Updated weights for policy 0, policy_version 1899197 (0.0009) [2023-12-26 14:45:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17661.4). Total num frames: 969359360. Throughput: 0: 9016.6, 1: 8761.4. Samples: 969370868. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:48,784][121949] Avg episode reward: [(0, '6316.527'), (1, '5481.022')] [2023-12-26 14:45:48,786][123091] Updated weights for policy 0, policy_version 1899207 (0.0010) [2023-12-26 14:45:49,509][123090] Updated weights for policy 1, policy_version 1887370 (0.0009) [2023-12-26 14:45:49,562][123090] Updated weights for policy 1, policy_version 1887380 (0.0009) [2023-12-26 14:45:49,621][123090] Updated weights for policy 1, policy_version 1887390 (0.0010) [2023-12-26 14:45:49,647][123091] Updated weights for policy 0, policy_version 1899217 (0.0009) [2023-12-26 14:45:49,702][123091] Updated weights for policy 0, policy_version 1899227 (0.0010) [2023-12-26 14:45:49,755][123091] Updated weights for policy 0, policy_version 1899237 (0.0009) [2023-12-26 14:45:49,812][123091] Updated weights for policy 0, policy_version 1899247 (0.0009) [2023-12-26 14:45:50,402][123090] Updated weights for policy 1, policy_version 1887400 (0.0006) [2023-12-26 14:45:50,462][123090] Updated weights for policy 1, policy_version 1887410 (0.0006) [2023-12-26 14:45:50,539][123090] Updated weights for policy 1, policy_version 1887420 (0.0007) [2023-12-26 14:45:50,694][123091] Updated weights for policy 0, policy_version 1899257 (0.0009) [2023-12-26 14:45:50,751][123091] Updated weights for policy 0, policy_version 1899267 (0.0009) [2023-12-26 14:45:50,806][123091] Updated weights for policy 0, policy_version 1899277 (0.0008) [2023-12-26 14:45:51,345][123090] Updated weights for policy 1, policy_version 1887430 (0.0008) [2023-12-26 14:45:51,417][123090] Updated weights for policy 1, policy_version 1887440 (0.0009) [2023-12-26 14:45:51,481][123090] Updated weights for policy 1, policy_version 1887450 (0.0011) [2023-12-26 14:45:51,603][123091] Updated weights for policy 0, policy_version 1899287 (0.0011) [2023-12-26 14:45:51,670][123091] Updated weights for policy 0, policy_version 1899297 (0.0010) [2023-12-26 14:45:51,734][123091] Updated weights for policy 0, policy_version 1899307 (0.0011) [2023-12-26 14:45:52,215][123090] Updated weights for policy 1, policy_version 1887460 (0.0009) [2023-12-26 14:45:52,280][123090] Updated weights for policy 1, policy_version 1887470 (0.0007) [2023-12-26 14:45:52,348][123090] Updated weights for policy 1, policy_version 1887480 (0.0007) [2023-12-26 14:45:52,548][123091] Updated weights for policy 0, policy_version 1899317 (0.0006) [2023-12-26 14:45:52,611][123091] Updated weights for policy 0, policy_version 1899327 (0.0005) [2023-12-26 14:45:52,681][123091] Updated weights for policy 0, policy_version 1899337 (0.0005) [2023-12-26 14:45:53,136][123090] Updated weights for policy 1, policy_version 1887490 (0.0010) [2023-12-26 14:45:53,203][123090] Updated weights for policy 1, policy_version 1887500 (0.0010) [2023-12-26 14:45:53,273][123090] Updated weights for policy 1, policy_version 1887510 (0.0010) [2023-12-26 14:45:53,324][123090] Updated weights for policy 1, policy_version 1887520 (0.0010) [2023-12-26 14:45:53,421][123091] Updated weights for policy 0, policy_version 1899347 (0.0007) [2023-12-26 14:45:53,473][123091] Updated weights for policy 0, policy_version 1899357 (0.0009) [2023-12-26 14:45:53,541][123091] Updated weights for policy 0, policy_version 1899367 (0.0008) [2023-12-26 14:45:53,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 969449472. Throughput: 0: 8999.3, 1: 8780.7. Samples: 969422388. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:53,786][121949] Avg episode reward: [(0, '6211.145'), (1, '5626.318')] [2023-12-26 14:45:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001899376_486244352.pth... [2023-12-26 14:45:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001887520_483205120.pth... [2023-12-26 14:45:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001898320_485974016.pth [2023-12-26 14:45:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001886464_482934784.pth [2023-12-26 14:45:54,125][123090] Updated weights for policy 1, policy_version 1887530 (0.0010) [2023-12-26 14:45:54,178][123090] Updated weights for policy 1, policy_version 1887540 (0.0010) [2023-12-26 14:45:54,225][123090] Updated weights for policy 1, policy_version 1887550 (0.0010) [2023-12-26 14:45:54,376][123091] Updated weights for policy 0, policy_version 1899377 (0.0009) [2023-12-26 14:45:54,430][123091] Updated weights for policy 0, policy_version 1899387 (0.0011) [2023-12-26 14:45:54,486][123091] Updated weights for policy 0, policy_version 1899397 (0.0011) [2023-12-26 14:45:54,541][123091] Updated weights for policy 0, policy_version 1899407 (0.0011) [2023-12-26 14:45:55,067][123090] Updated weights for policy 1, policy_version 1887560 (0.0010) [2023-12-26 14:45:55,120][123090] Updated weights for policy 1, policy_version 1887570 (0.0010) [2023-12-26 14:45:55,190][123090] Updated weights for policy 1, policy_version 1887580 (0.0010) [2023-12-26 14:45:55,375][123091] Updated weights for policy 0, policy_version 1899417 (0.0009) [2023-12-26 14:45:55,428][123091] Updated weights for policy 0, policy_version 1899428 (0.0009) [2023-12-26 14:45:55,485][123091] Updated weights for policy 0, policy_version 1899438 (0.0009) [2023-12-26 14:45:56,026][123090] Updated weights for policy 1, policy_version 1887590 (0.0010) [2023-12-26 14:45:56,088][123090] Updated weights for policy 1, policy_version 1887600 (0.0010) [2023-12-26 14:45:56,154][123090] Updated weights for policy 1, policy_version 1887610 (0.0010) [2023-12-26 14:45:56,337][123091] Updated weights for policy 0, policy_version 1899448 (0.0009) [2023-12-26 14:45:56,397][123091] Updated weights for policy 0, policy_version 1899458 (0.0009) [2023-12-26 14:45:56,458][123091] Updated weights for policy 0, policy_version 1899468 (0.0009) [2023-12-26 14:45:56,958][123090] Updated weights for policy 1, policy_version 1887620 (0.0010) [2023-12-26 14:45:57,004][123090] Updated weights for policy 1, policy_version 1887630 (0.0010) [2023-12-26 14:45:57,058][123090] Updated weights for policy 1, policy_version 1887640 (0.0010) [2023-12-26 14:45:57,278][123091] Updated weights for policy 0, policy_version 1899478 (0.0010) [2023-12-26 14:45:57,338][123091] Updated weights for policy 0, policy_version 1899488 (0.0011) [2023-12-26 14:45:57,399][123091] Updated weights for policy 0, policy_version 1899498 (0.0011) [2023-12-26 14:45:57,876][123090] Updated weights for policy 1, policy_version 1887650 (0.0010) [2023-12-26 14:45:57,923][123090] Updated weights for policy 1, policy_version 1887660 (0.0010) [2023-12-26 14:45:57,970][123090] Updated weights for policy 1, policy_version 1887670 (0.0010) [2023-12-26 14:45:58,020][123090] Updated weights for policy 1, policy_version 1887680 (0.0010) [2023-12-26 14:45:58,142][123091] Updated weights for policy 0, policy_version 1899508 (0.0009) [2023-12-26 14:45:58,205][123091] Updated weights for policy 0, policy_version 1899518 (0.0008) [2023-12-26 14:45:58,271][123091] Updated weights for policy 0, policy_version 1899528 (0.0008) [2023-12-26 14:45:58,787][121949] Fps is (10 sec: 17197.6, 60 sec: 17613.0, 300 sec: 17661.2). Total num frames: 969531392. Throughput: 0: 8918.1, 1: 8822.2. Samples: 969526284. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:45:58,788][121949] Avg episode reward: [(0, '6241.212'), (1, '5685.776')] [2023-12-26 14:45:58,983][123090] Updated weights for policy 1, policy_version 1887690 (0.0008) [2023-12-26 14:45:59,053][123090] Updated weights for policy 1, policy_version 1887700 (0.0008) [2023-12-26 14:45:59,054][123091] Updated weights for policy 0, policy_version 1899538 (0.0008) [2023-12-26 14:45:59,118][123090] Updated weights for policy 1, policy_version 1887710 (0.0008) [2023-12-26 14:45:59,124][123091] Updated weights for policy 0, policy_version 1899548 (0.0008) [2023-12-26 14:45:59,192][123091] Updated weights for policy 0, policy_version 1899558 (0.0011) [2023-12-26 14:45:59,262][123091] Updated weights for policy 0, policy_version 1899568 (0.0012) [2023-12-26 14:45:59,981][123090] Updated weights for policy 1, policy_version 1887720 (0.0007) [2023-12-26 14:46:00,011][123091] Updated weights for policy 0, policy_version 1899578 (0.0009) [2023-12-26 14:46:00,041][123090] Updated weights for policy 1, policy_version 1887730 (0.0009) [2023-12-26 14:46:00,059][123091] Updated weights for policy 0, policy_version 1899588 (0.0010) [2023-12-26 14:46:00,104][123090] Updated weights for policy 1, policy_version 1887740 (0.0008) [2023-12-26 14:46:00,113][123091] Updated weights for policy 0, policy_version 1899598 (0.0005) [2023-12-26 14:46:00,822][123091] Updated weights for policy 0, policy_version 1899608 (0.0005) [2023-12-26 14:46:00,879][123091] Updated weights for policy 0, policy_version 1899618 (0.0005) [2023-12-26 14:46:00,922][123091] Updated weights for policy 0, policy_version 1899628 (0.0005) [2023-12-26 14:46:01,035][123090] Updated weights for policy 1, policy_version 1887750 (0.0009) [2023-12-26 14:46:01,095][123090] Updated weights for policy 1, policy_version 1887760 (0.0010) [2023-12-26 14:46:01,162][123090] Updated weights for policy 1, policy_version 1887770 (0.0009) [2023-12-26 14:46:01,709][123091] Updated weights for policy 0, policy_version 1899638 (0.0008) [2023-12-26 14:46:01,775][123091] Updated weights for policy 0, policy_version 1899648 (0.0010) [2023-12-26 14:46:01,825][123091] Updated weights for policy 0, policy_version 1899658 (0.0008) [2023-12-26 14:46:02,013][123090] Updated weights for policy 1, policy_version 1887780 (0.0007) [2023-12-26 14:46:02,064][123090] Updated weights for policy 1, policy_version 1887790 (0.0005) [2023-12-26 14:46:02,131][123090] Updated weights for policy 1, policy_version 1887800 (0.0009) [2023-12-26 14:46:02,683][123091] Updated weights for policy 0, policy_version 1899668 (0.0010) [2023-12-26 14:46:02,744][123091] Updated weights for policy 0, policy_version 1899678 (0.0009) [2023-12-26 14:46:02,802][123091] Updated weights for policy 0, policy_version 1899688 (0.0009) [2023-12-26 14:46:02,946][123090] Updated weights for policy 1, policy_version 1887810 (0.0009) [2023-12-26 14:46:03,017][123090] Updated weights for policy 1, policy_version 1887820 (0.0008) [2023-12-26 14:46:03,084][123090] Updated weights for policy 1, policy_version 1887830 (0.0009) [2023-12-26 14:46:03,133][123090] Updated weights for policy 1, policy_version 1887840 (0.0009) [2023-12-26 14:46:03,640][123091] Updated weights for policy 0, policy_version 1899698 (0.0009) [2023-12-26 14:46:03,708][123091] Updated weights for policy 0, policy_version 1899708 (0.0005) [2023-12-26 14:46:03,774][123091] Updated weights for policy 0, policy_version 1899718 (0.0005) [2023-12-26 14:46:03,784][121949] Fps is (10 sec: 16384.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 969613312. Throughput: 0: 8888.7, 1: 8785.9. Samples: 969630240. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:03,785][121949] Avg episode reward: [(0, '6310.942'), (1, '5522.429')] [2023-12-26 14:46:03,841][123091] Updated weights for policy 0, policy_version 1899728 (0.0006) [2023-12-26 14:46:03,991][123090] Updated weights for policy 1, policy_version 1887850 (0.0007) [2023-12-26 14:46:04,063][123090] Updated weights for policy 1, policy_version 1887860 (0.0008) [2023-12-26 14:46:04,143][123090] Updated weights for policy 1, policy_version 1887870 (0.0010) [2023-12-26 14:46:04,544][123091] Updated weights for policy 0, policy_version 1899738 (0.0010) [2023-12-26 14:46:04,606][123091] Updated weights for policy 0, policy_version 1899748 (0.0010) [2023-12-26 14:46:04,663][123091] Updated weights for policy 0, policy_version 1899758 (0.0009) [2023-12-26 14:46:04,945][123090] Updated weights for policy 1, policy_version 1887880 (0.0009) [2023-12-26 14:46:05,002][123090] Updated weights for policy 1, policy_version 1887890 (0.0010) [2023-12-26 14:46:05,058][123090] Updated weights for policy 1, policy_version 1887900 (0.0009) [2023-12-26 14:46:05,458][123091] Updated weights for policy 0, policy_version 1899768 (0.0009) [2023-12-26 14:46:05,524][123091] Updated weights for policy 0, policy_version 1899778 (0.0009) [2023-12-26 14:46:05,588][123091] Updated weights for policy 0, policy_version 1899788 (0.0010) [2023-12-26 14:46:05,909][123090] Updated weights for policy 1, policy_version 1887910 (0.0008) [2023-12-26 14:46:05,973][123090] Updated weights for policy 1, policy_version 1887920 (0.0009) [2023-12-26 14:46:06,039][123090] Updated weights for policy 1, policy_version 1887930 (0.0009) [2023-12-26 14:46:06,389][123091] Updated weights for policy 0, policy_version 1899798 (0.0009) [2023-12-26 14:46:06,463][123091] Updated weights for policy 0, policy_version 1899808 (0.0010) [2023-12-26 14:46:06,530][123091] Updated weights for policy 0, policy_version 1899818 (0.0009) [2023-12-26 14:46:06,919][123090] Updated weights for policy 1, policy_version 1887940 (0.0009) [2023-12-26 14:46:06,976][123090] Updated weights for policy 1, policy_version 1887950 (0.0009) [2023-12-26 14:46:07,034][123090] Updated weights for policy 1, policy_version 1887960 (0.0009) [2023-12-26 14:46:07,275][123091] Updated weights for policy 0, policy_version 1899828 (0.0007) [2023-12-26 14:46:07,321][123091] Updated weights for policy 0, policy_version 1899838 (0.0005) [2023-12-26 14:46:07,372][123091] Updated weights for policy 0, policy_version 1899848 (0.0005) [2023-12-26 14:46:07,908][123090] Updated weights for policy 1, policy_version 1887970 (0.0009) [2023-12-26 14:46:07,957][123090] Updated weights for policy 1, policy_version 1887980 (0.0009) [2023-12-26 14:46:08,011][123090] Updated weights for policy 1, policy_version 1887990 (0.0009) [2023-12-26 14:46:08,058][123090] Updated weights for policy 1, policy_version 1888000 (0.0009) [2023-12-26 14:46:08,167][123091] Updated weights for policy 0, policy_version 1899858 (0.0006) [2023-12-26 14:46:08,236][123091] Updated weights for policy 0, policy_version 1899868 (0.0009) [2023-12-26 14:46:08,302][123091] Updated weights for policy 0, policy_version 1899878 (0.0008) [2023-12-26 14:46:08,366][123091] Updated weights for policy 0, policy_version 1899888 (0.0007) [2023-12-26 14:46:08,784][121949] Fps is (10 sec: 17208.7, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 969703424. Throughput: 0: 8880.9, 1: 8816.9. Samples: 969681640. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:08,785][121949] Avg episode reward: [(0, '6209.677'), (1, '5676.074')] [2023-12-26 14:46:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001899888_486375424.pth... [2023-12-26 14:46:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888000_483328000.pth... [2023-12-26 14:46:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001898832_486105088.pth [2023-12-26 14:46:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001887008_483074048.pth [2023-12-26 14:46:08,934][123090] Updated weights for policy 1, policy_version 1888010 (0.0009) [2023-12-26 14:46:08,995][123090] Updated weights for policy 1, policy_version 1888020 (0.0009) [2023-12-26 14:46:09,044][123090] Updated weights for policy 1, policy_version 1888030 (0.0008) [2023-12-26 14:46:09,174][123091] Updated weights for policy 0, policy_version 1899898 (0.0011) [2023-12-26 14:46:09,232][123091] Updated weights for policy 0, policy_version 1899908 (0.0009) [2023-12-26 14:46:09,294][123091] Updated weights for policy 0, policy_version 1899918 (0.0010) [2023-12-26 14:46:09,958][123090] Updated weights for policy 1, policy_version 1888040 (0.0009) [2023-12-26 14:46:10,029][123090] Updated weights for policy 1, policy_version 1888050 (0.0009) [2023-12-26 14:46:10,093][123090] Updated weights for policy 1, policy_version 1888060 (0.0008) [2023-12-26 14:46:10,097][123091] Updated weights for policy 0, policy_version 1899928 (0.0010) [2023-12-26 14:46:10,163][123091] Updated weights for policy 0, policy_version 1899938 (0.0010) [2023-12-26 14:46:10,237][123091] Updated weights for policy 0, policy_version 1899948 (0.0007) [2023-12-26 14:46:10,905][123091] Updated weights for policy 0, policy_version 1899958 (0.0007) [2023-12-26 14:46:10,920][123090] Updated weights for policy 1, policy_version 1888070 (0.0009) [2023-12-26 14:46:10,962][123091] Updated weights for policy 0, policy_version 1899968 (0.0005) [2023-12-26 14:46:10,974][123090] Updated weights for policy 1, policy_version 1888080 (0.0009) [2023-12-26 14:46:11,021][123091] Updated weights for policy 0, policy_version 1899978 (0.0009) [2023-12-26 14:46:11,041][123090] Updated weights for policy 1, policy_version 1888090 (0.0007) [2023-12-26 14:46:11,886][123091] Updated weights for policy 0, policy_version 1899988 (0.0010) [2023-12-26 14:46:11,905][123090] Updated weights for policy 1, policy_version 1888100 (0.0009) [2023-12-26 14:46:11,934][123091] Updated weights for policy 0, policy_version 1899998 (0.0008) [2023-12-26 14:46:11,969][123090] Updated weights for policy 1, policy_version 1888110 (0.0008) [2023-12-26 14:46:11,985][123091] Updated weights for policy 0, policy_version 1900008 (0.0009) [2023-12-26 14:46:12,041][123090] Updated weights for policy 1, policy_version 1888120 (0.0009) [2023-12-26 14:46:12,818][123091] Updated weights for policy 0, policy_version 1900018 (0.0008) [2023-12-26 14:46:12,883][123091] Updated weights for policy 0, policy_version 1900028 (0.0006) [2023-12-26 14:46:12,937][123090] Updated weights for policy 1, policy_version 1888130 (0.0010) [2023-12-26 14:46:12,946][123091] Updated weights for policy 0, policy_version 1900038 (0.0010) [2023-12-26 14:46:13,003][123090] Updated weights for policy 1, policy_version 1888140 (0.0007) [2023-12-26 14:46:13,008][123091] Updated weights for policy 0, policy_version 1900048 (0.0010) [2023-12-26 14:46:13,070][123090] Updated weights for policy 1, policy_version 1888150 (0.0009) [2023-12-26 14:46:13,134][123090] Updated weights for policy 1, policy_version 1888160 (0.0009) [2023-12-26 14:46:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 969785344. Throughput: 0: 8853.7, 1: 8715.1. Samples: 969784372. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:13,785][121949] Avg episode reward: [(0, '6256.908'), (1, '5746.484')] [2023-12-26 14:46:13,801][123091] Updated weights for policy 0, policy_version 1900058 (0.0010) [2023-12-26 14:46:13,855][123091] Updated weights for policy 0, policy_version 1900068 (0.0010) [2023-12-26 14:46:13,907][123091] Updated weights for policy 0, policy_version 1900078 (0.0010) [2023-12-26 14:46:13,937][123090] Updated weights for policy 1, policy_version 1888170 (0.0007) [2023-12-26 14:46:13,986][123090] Updated weights for policy 1, policy_version 1888180 (0.0009) [2023-12-26 14:46:14,036][123090] Updated weights for policy 1, policy_version 1888190 (0.0009) [2023-12-26 14:46:14,660][123091] Updated weights for policy 0, policy_version 1900088 (0.0006) [2023-12-26 14:46:14,724][123091] Updated weights for policy 0, policy_version 1900098 (0.0005) [2023-12-26 14:46:14,789][123091] Updated weights for policy 0, policy_version 1900108 (0.0007) [2023-12-26 14:46:14,960][123090] Updated weights for policy 1, policy_version 1888200 (0.0009) [2023-12-26 14:46:15,012][123090] Updated weights for policy 1, policy_version 1888210 (0.0008) [2023-12-26 14:46:15,078][123090] Updated weights for policy 1, policy_version 1888220 (0.0009) [2023-12-26 14:46:15,532][123091] Updated weights for policy 0, policy_version 1900118 (0.0011) [2023-12-26 14:46:15,594][123091] Updated weights for policy 0, policy_version 1900128 (0.0010) [2023-12-26 14:46:15,657][123091] Updated weights for policy 0, policy_version 1900138 (0.0010) [2023-12-26 14:46:15,967][123090] Updated weights for policy 1, policy_version 1888230 (0.0009) [2023-12-26 14:46:16,034][123090] Updated weights for policy 1, policy_version 1888240 (0.0009) [2023-12-26 14:46:16,106][123090] Updated weights for policy 1, policy_version 1888250 (0.0009) [2023-12-26 14:46:16,477][123091] Updated weights for policy 0, policy_version 1900148 (0.0011) [2023-12-26 14:46:16,531][123091] Updated weights for policy 0, policy_version 1900158 (0.0010) [2023-12-26 14:46:16,583][123091] Updated weights for policy 0, policy_version 1900168 (0.0010) [2023-12-26 14:46:16,957][123090] Updated weights for policy 1, policy_version 1888260 (0.0010) [2023-12-26 14:46:17,012][123090] Updated weights for policy 1, policy_version 1888270 (0.0010) [2023-12-26 14:46:17,065][123090] Updated weights for policy 1, policy_version 1888280 (0.0010) [2023-12-26 14:46:17,280][123091] Updated weights for policy 0, policy_version 1900178 (0.0010) [2023-12-26 14:46:17,331][123091] Updated weights for policy 0, policy_version 1900188 (0.0008) [2023-12-26 14:46:17,377][123091] Updated weights for policy 0, policy_version 1900198 (0.0005) [2023-12-26 14:46:17,422][123091] Updated weights for policy 0, policy_version 1900208 (0.0005) [2023-12-26 14:46:18,040][123090] Updated weights for policy 1, policy_version 1888290 (0.0009) [2023-12-26 14:46:18,071][123091] Updated weights for policy 0, policy_version 1900218 (0.0010) [2023-12-26 14:46:18,095][123090] Updated weights for policy 1, policy_version 1888300 (0.0009) [2023-12-26 14:46:18,129][123091] Updated weights for policy 0, policy_version 1900228 (0.0010) [2023-12-26 14:46:18,154][123090] Updated weights for policy 1, policy_version 1888310 (0.0007) [2023-12-26 14:46:18,186][123091] Updated weights for policy 0, policy_version 1900238 (0.0009) [2023-12-26 14:46:18,201][123090] Updated weights for policy 1, policy_version 1888320 (0.0009) [2023-12-26 14:46:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 969875456. Throughput: 0: 9041.9, 1: 8592.7. Samples: 969889776. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:18,785][121949] Avg episode reward: [(0, '6278.100'), (1, '6010.027')] [2023-12-26 14:46:18,912][123091] Updated weights for policy 0, policy_version 1900248 (0.0010) [2023-12-26 14:46:18,982][123091] Updated weights for policy 0, policy_version 1900258 (0.0011) [2023-12-26 14:46:19,045][123091] Updated weights for policy 0, policy_version 1900268 (0.0010) [2023-12-26 14:46:19,129][123090] Updated weights for policy 1, policy_version 1888330 (0.0009) [2023-12-26 14:46:19,193][123090] Updated weights for policy 1, policy_version 1888340 (0.0009) [2023-12-26 14:46:19,258][123090] Updated weights for policy 1, policy_version 1888350 (0.0009) [2023-12-26 14:46:19,860][123091] Updated weights for policy 0, policy_version 1900278 (0.0009) [2023-12-26 14:46:19,936][123091] Updated weights for policy 0, policy_version 1900288 (0.0008) [2023-12-26 14:46:20,004][123091] Updated weights for policy 0, policy_version 1900298 (0.0007) [2023-12-26 14:46:20,100][123090] Updated weights for policy 1, policy_version 1888360 (0.0007) [2023-12-26 14:46:20,164][123090] Updated weights for policy 1, policy_version 1888370 (0.0010) [2023-12-26 14:46:20,236][123090] Updated weights for policy 1, policy_version 1888380 (0.0009) [2023-12-26 14:46:20,798][123091] Updated weights for policy 0, policy_version 1900308 (0.0008) [2023-12-26 14:46:20,866][123091] Updated weights for policy 0, policy_version 1900318 (0.0011) [2023-12-26 14:46:20,938][123091] Updated weights for policy 0, policy_version 1900328 (0.0011) [2023-12-26 14:46:21,087][123090] Updated weights for policy 1, policy_version 1888390 (0.0008) [2023-12-26 14:46:21,152][123090] Updated weights for policy 1, policy_version 1888400 (0.0009) [2023-12-26 14:46:21,216][123090] Updated weights for policy 1, policy_version 1888410 (0.0009) [2023-12-26 14:46:21,783][123091] Updated weights for policy 0, policy_version 1900338 (0.0010) [2023-12-26 14:46:21,844][123091] Updated weights for policy 0, policy_version 1900348 (0.0010) [2023-12-26 14:46:21,910][123091] Updated weights for policy 0, policy_version 1900358 (0.0010) [2023-12-26 14:46:21,974][123091] Updated weights for policy 0, policy_version 1900368 (0.0010) [2023-12-26 14:46:22,063][123090] Updated weights for policy 1, policy_version 1888420 (0.0010) [2023-12-26 14:46:22,118][123090] Updated weights for policy 1, policy_version 1888430 (0.0009) [2023-12-26 14:46:22,171][123090] Updated weights for policy 1, policy_version 1888440 (0.0009) [2023-12-26 14:46:22,840][123091] Updated weights for policy 0, policy_version 1900378 (0.0011) [2023-12-26 14:46:22,911][123091] Updated weights for policy 0, policy_version 1900388 (0.0011) [2023-12-26 14:46:22,985][123091] Updated weights for policy 0, policy_version 1900398 (0.0010) [2023-12-26 14:46:23,007][123090] Updated weights for policy 1, policy_version 1888450 (0.0009) [2023-12-26 14:46:23,073][123090] Updated weights for policy 1, policy_version 1888460 (0.0009) [2023-12-26 14:46:23,139][123090] Updated weights for policy 1, policy_version 1888470 (0.0008) [2023-12-26 14:46:23,204][123090] Updated weights for policy 1, policy_version 1888480 (0.0009) [2023-12-26 14:46:23,779][123091] Updated weights for policy 0, policy_version 1900408 (0.0011) [2023-12-26 14:46:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 969957376. Throughput: 0: 9008.8, 1: 8496.8. Samples: 969939952. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:23,785][121949] Avg episode reward: [(0, '6252.283'), (1, '5769.855')] [2023-12-26 14:46:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888480_483450880.pth... [2023-12-26 14:46:23,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001887520_483205120.pth [2023-12-26 14:46:23,845][123091] Updated weights for policy 0, policy_version 1900418 (0.0010) [2023-12-26 14:46:23,913][123091] Updated weights for policy 0, policy_version 1900428 (0.0010) [2023-12-26 14:46:23,941][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001900432_486514688.pth... [2023-12-26 14:46:23,945][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001899376_486244352.pth [2023-12-26 14:46:24,028][123090] Updated weights for policy 1, policy_version 1888490 (0.0009) [2023-12-26 14:46:24,096][123090] Updated weights for policy 1, policy_version 1888500 (0.0009) [2023-12-26 14:46:24,156][123090] Updated weights for policy 1, policy_version 1888510 (0.0009) [2023-12-26 14:46:24,702][123091] Updated weights for policy 0, policy_version 1900438 (0.0010) [2023-12-26 14:46:24,760][123091] Updated weights for policy 0, policy_version 1900448 (0.0010) [2023-12-26 14:46:24,812][123091] Updated weights for policy 0, policy_version 1900458 (0.0010) [2023-12-26 14:46:24,980][123090] Updated weights for policy 1, policy_version 1888520 (0.0009) [2023-12-26 14:46:25,038][123090] Updated weights for policy 1, policy_version 1888530 (0.0010) [2023-12-26 14:46:25,092][123090] Updated weights for policy 1, policy_version 1888540 (0.0010) [2023-12-26 14:46:25,606][123091] Updated weights for policy 0, policy_version 1900468 (0.0010) [2023-12-26 14:46:25,656][123091] Updated weights for policy 0, policy_version 1900478 (0.0010) [2023-12-26 14:46:25,705][123091] Updated weights for policy 0, policy_version 1900488 (0.0010) [2023-12-26 14:46:25,963][123090] Updated weights for policy 1, policy_version 1888550 (0.0010) [2023-12-26 14:46:26,022][123090] Updated weights for policy 1, policy_version 1888560 (0.0009) [2023-12-26 14:46:26,078][123090] Updated weights for policy 1, policy_version 1888570 (0.0010) [2023-12-26 14:46:26,476][123091] Updated weights for policy 0, policy_version 1900498 (0.0009) [2023-12-26 14:46:26,523][123091] Updated weights for policy 0, policy_version 1900508 (0.0009) [2023-12-26 14:46:26,579][123091] Updated weights for policy 0, policy_version 1900518 (0.0008) [2023-12-26 14:46:26,627][123091] Updated weights for policy 0, policy_version 1900528 (0.0009) [2023-12-26 14:46:26,980][123090] Updated weights for policy 1, policy_version 1888580 (0.0010) [2023-12-26 14:46:27,038][123090] Updated weights for policy 1, policy_version 1888590 (0.0010) [2023-12-26 14:46:27,095][123090] Updated weights for policy 1, policy_version 1888600 (0.0009) [2023-12-26 14:46:27,429][123091] Updated weights for policy 0, policy_version 1900538 (0.0009) [2023-12-26 14:46:27,481][123091] Updated weights for policy 0, policy_version 1900548 (0.0009) [2023-12-26 14:46:27,541][123091] Updated weights for policy 0, policy_version 1900558 (0.0010) [2023-12-26 14:46:27,867][123090] Updated weights for policy 1, policy_version 1888610 (0.0008) [2023-12-26 14:46:27,930][123090] Updated weights for policy 1, policy_version 1888620 (0.0006) [2023-12-26 14:46:27,996][123090] Updated weights for policy 1, policy_version 1888630 (0.0006) [2023-12-26 14:46:28,069][123090] Updated weights for policy 1, policy_version 1888640 (0.0005) [2023-12-26 14:46:28,353][123091] Updated weights for policy 0, policy_version 1900568 (0.0008) [2023-12-26 14:46:28,419][123091] Updated weights for policy 0, policy_version 1900578 (0.0008) [2023-12-26 14:46:28,481][123091] Updated weights for policy 0, policy_version 1900588 (0.0008) [2023-12-26 14:46:28,746][123090] Updated weights for policy 1, policy_version 1888650 (0.0008) [2023-12-26 14:46:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 970047488. Throughput: 0: 8999.0, 1: 8462.4. Samples: 970042420. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:28,785][121949] Avg episode reward: [(0, '6291.967'), (1, '5661.508')] [2023-12-26 14:46:28,800][123090] Updated weights for policy 1, policy_version 1888660 (0.0009) [2023-12-26 14:46:28,849][123090] Updated weights for policy 1, policy_version 1888670 (0.0009) [2023-12-26 14:46:29,255][123091] Updated weights for policy 0, policy_version 1900598 (0.0009) [2023-12-26 14:46:29,313][123091] Updated weights for policy 0, policy_version 1900608 (0.0010) [2023-12-26 14:46:29,378][123091] Updated weights for policy 0, policy_version 1900618 (0.0010) [2023-12-26 14:46:29,671][123090] Updated weights for policy 1, policy_version 1888680 (0.0006) [2023-12-26 14:46:29,733][123090] Updated weights for policy 1, policy_version 1888690 (0.0005) [2023-12-26 14:46:29,801][123090] Updated weights for policy 1, policy_version 1888700 (0.0007) [2023-12-26 14:46:30,290][123091] Updated weights for policy 0, policy_version 1900628 (0.0007) [2023-12-26 14:46:30,344][123091] Updated weights for policy 0, policy_version 1900638 (0.0005) [2023-12-26 14:46:30,406][123091] Updated weights for policy 0, policy_version 1900648 (0.0005) [2023-12-26 14:46:30,640][123090] Updated weights for policy 1, policy_version 1888710 (0.0009) [2023-12-26 14:46:30,694][123090] Updated weights for policy 1, policy_version 1888720 (0.0010) [2023-12-26 14:46:30,747][123090] Updated weights for policy 1, policy_version 1888731 (0.0010) [2023-12-26 14:46:31,024][123091] Updated weights for policy 0, policy_version 1900658 (0.0007) [2023-12-26 14:46:31,089][123091] Updated weights for policy 0, policy_version 1900668 (0.0009) [2023-12-26 14:46:31,152][123091] Updated weights for policy 0, policy_version 1900679 (0.0009) [2023-12-26 14:46:31,695][123090] Updated weights for policy 1, policy_version 1888741 (0.0009) [2023-12-26 14:46:31,769][123090] Updated weights for policy 1, policy_version 1888751 (0.0008) [2023-12-26 14:46:31,832][123090] Updated weights for policy 1, policy_version 1888761 (0.0007) [2023-12-26 14:46:31,910][123091] Updated weights for policy 0, policy_version 1900689 (0.0008) [2023-12-26 14:46:31,965][123091] Updated weights for policy 0, policy_version 1900699 (0.0010) [2023-12-26 14:46:32,023][123091] Updated weights for policy 0, policy_version 1900709 (0.0010) [2023-12-26 14:46:32,090][123091] Updated weights for policy 0, policy_version 1900719 (0.0011) [2023-12-26 14:46:32,587][123090] Updated weights for policy 1, policy_version 1888771 (0.0006) [2023-12-26 14:46:32,641][123090] Updated weights for policy 1, policy_version 1888781 (0.0010) [2023-12-26 14:46:32,703][123090] Updated weights for policy 1, policy_version 1888792 (0.0010) [2023-12-26 14:46:32,843][123091] Updated weights for policy 0, policy_version 1900729 (0.0006) [2023-12-26 14:46:32,898][123091] Updated weights for policy 0, policy_version 1900739 (0.0005) [2023-12-26 14:46:32,966][123091] Updated weights for policy 0, policy_version 1900749 (0.0006) [2023-12-26 14:46:33,578][123090] Updated weights for policy 1, policy_version 1888802 (0.0009) [2023-12-26 14:46:33,636][123090] Updated weights for policy 1, policy_version 1888812 (0.0013) [2023-12-26 14:46:33,687][123090] Updated weights for policy 1, policy_version 1888822 (0.0009) [2023-12-26 14:46:33,708][123091] Updated weights for policy 0, policy_version 1900759 (0.0005) [2023-12-26 14:46:33,743][123090] Updated weights for policy 1, policy_version 1888832 (0.0009) [2023-12-26 14:46:33,751][123091] Updated weights for policy 0, policy_version 1900769 (0.0005) [2023-12-26 14:46:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 970137600. Throughput: 0: 8933.4, 1: 8372.5. Samples: 970149636. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:33,785][121949] Avg episode reward: [(0, '6233.321'), (1, '5849.178')] [2023-12-26 14:46:33,797][123091] Updated weights for policy 0, policy_version 1900779 (0.0005) [2023-12-26 14:46:34,539][123091] Updated weights for policy 0, policy_version 1900789 (0.0007) [2023-12-26 14:46:34,606][123091] Updated weights for policy 0, policy_version 1900799 (0.0010) [2023-12-26 14:46:34,665][123090] Updated weights for policy 1, policy_version 1888842 (0.0008) [2023-12-26 14:46:34,676][123091] Updated weights for policy 0, policy_version 1900809 (0.0010) [2023-12-26 14:46:34,736][123090] Updated weights for policy 1, policy_version 1888852 (0.0009) [2023-12-26 14:46:34,803][123090] Updated weights for policy 1, policy_version 1888862 (0.0010) [2023-12-26 14:46:35,503][123091] Updated weights for policy 0, policy_version 1900819 (0.0008) [2023-12-26 14:46:35,562][123091] Updated weights for policy 0, policy_version 1900829 (0.0010) [2023-12-26 14:46:35,617][123091] Updated weights for policy 0, policy_version 1900839 (0.0008) [2023-12-26 14:46:35,630][123090] Updated weights for policy 1, policy_version 1888872 (0.0008) [2023-12-26 14:46:35,697][123090] Updated weights for policy 1, policy_version 1888882 (0.0007) [2023-12-26 14:46:35,772][123090] Updated weights for policy 1, policy_version 1888892 (0.0008) [2023-12-26 14:46:36,455][123091] Updated weights for policy 0, policy_version 1900849 (0.0009) [2023-12-26 14:46:36,469][123090] Updated weights for policy 1, policy_version 1888902 (0.0006) [2023-12-26 14:46:36,523][123090] Updated weights for policy 1, policy_version 1888912 (0.0006) [2023-12-26 14:46:36,528][123091] Updated weights for policy 0, policy_version 1900859 (0.0009) [2023-12-26 14:46:36,580][123090] Updated weights for policy 1, policy_version 1888922 (0.0007) [2023-12-26 14:46:36,600][123091] Updated weights for policy 0, policy_version 1900869 (0.0007) [2023-12-26 14:46:36,657][123091] Updated weights for policy 0, policy_version 1900879 (0.0011) [2023-12-26 14:46:37,332][123090] Updated weights for policy 1, policy_version 1888932 (0.0007) [2023-12-26 14:46:37,394][123090] Updated weights for policy 1, policy_version 1888942 (0.0006) [2023-12-26 14:46:37,447][123090] Updated weights for policy 1, policy_version 1888952 (0.0007) [2023-12-26 14:46:37,461][123091] Updated weights for policy 0, policy_version 1900889 (0.0011) [2023-12-26 14:46:37,517][123091] Updated weights for policy 0, policy_version 1900899 (0.0010) [2023-12-26 14:46:37,576][123091] Updated weights for policy 0, policy_version 1900909 (0.0010) [2023-12-26 14:46:38,298][123090] Updated weights for policy 1, policy_version 1888962 (0.0007) [2023-12-26 14:46:38,325][123091] Updated weights for policy 0, policy_version 1900919 (0.0010) [2023-12-26 14:46:38,364][123090] Updated weights for policy 1, policy_version 1888972 (0.0007) [2023-12-26 14:46:38,386][123091] Updated weights for policy 0, policy_version 1900929 (0.0011) [2023-12-26 14:46:38,420][123090] Updated weights for policy 1, policy_version 1888982 (0.0008) [2023-12-26 14:46:38,447][123091] Updated weights for policy 0, policy_version 1900939 (0.0011) [2023-12-26 14:46:38,487][123090] Updated weights for policy 1, policy_version 1888992 (0.0008) [2023-12-26 14:46:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 970227712. Throughput: 0: 8977.0, 1: 8351.5. Samples: 970202164. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:38,785][121949] Avg episode reward: [(0, '6224.464'), (1, '5797.219')] [2023-12-26 14:46:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001900944_486645760.pth... [2023-12-26 14:46:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888992_483581952.pth... [2023-12-26 14:46:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001899888_486375424.pth [2023-12-26 14:46:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888000_483328000.pth [2023-12-26 14:46:39,262][123091] Updated weights for policy 0, policy_version 1900949 (0.0008) [2023-12-26 14:46:39,279][123090] Updated weights for policy 1, policy_version 1889002 (0.0007) [2023-12-26 14:46:39,330][123091] Updated weights for policy 0, policy_version 1900959 (0.0008) [2023-12-26 14:46:39,343][123090] Updated weights for policy 1, policy_version 1889012 (0.0007) [2023-12-26 14:46:39,396][123091] Updated weights for policy 0, policy_version 1900969 (0.0008) [2023-12-26 14:46:39,408][123090] Updated weights for policy 1, policy_version 1889022 (0.0008) [2023-12-26 14:46:40,193][123091] Updated weights for policy 0, policy_version 1900979 (0.0009) [2023-12-26 14:46:40,206][123090] Updated weights for policy 1, policy_version 1889032 (0.0008) [2023-12-26 14:46:40,261][123091] Updated weights for policy 0, policy_version 1900989 (0.0011) [2023-12-26 14:46:40,273][123090] Updated weights for policy 1, policy_version 1889042 (0.0009) [2023-12-26 14:46:40,318][123091] Updated weights for policy 0, policy_version 1900999 (0.0010) [2023-12-26 14:46:40,324][123090] Updated weights for policy 1, policy_version 1889052 (0.0007) [2023-12-26 14:46:41,043][123091] Updated weights for policy 0, policy_version 1901009 (0.0011) [2023-12-26 14:46:41,107][123091] Updated weights for policy 0, policy_version 1901019 (0.0011) [2023-12-26 14:46:41,171][123091] Updated weights for policy 0, policy_version 1901029 (0.0010) [2023-12-26 14:46:41,208][123090] Updated weights for policy 1, policy_version 1889062 (0.0007) [2023-12-26 14:46:41,244][123091] Updated weights for policy 0, policy_version 1901039 (0.0013) [2023-12-26 14:46:41,272][123090] Updated weights for policy 1, policy_version 1889072 (0.0009) [2023-12-26 14:46:41,327][123090] Updated weights for policy 1, policy_version 1889082 (0.0008) [2023-12-26 14:46:42,157][123091] Updated weights for policy 0, policy_version 1901049 (0.0010) [2023-12-26 14:46:42,188][123090] Updated weights for policy 1, policy_version 1889092 (0.0008) [2023-12-26 14:46:42,210][123091] Updated weights for policy 0, policy_version 1901059 (0.0008) [2023-12-26 14:46:42,241][123090] Updated weights for policy 1, policy_version 1889102 (0.0009) [2023-12-26 14:46:42,275][123091] Updated weights for policy 0, policy_version 1901069 (0.0008) [2023-12-26 14:46:42,301][123090] Updated weights for policy 1, policy_version 1889112 (0.0008) [2023-12-26 14:46:43,113][123091] Updated weights for policy 0, policy_version 1901079 (0.0009) [2023-12-26 14:46:43,142][123090] Updated weights for policy 1, policy_version 1889122 (0.0008) [2023-12-26 14:46:43,174][123091] Updated weights for policy 0, policy_version 1901089 (0.0009) [2023-12-26 14:46:43,191][123090] Updated weights for policy 1, policy_version 1889132 (0.0007) [2023-12-26 14:46:43,243][123091] Updated weights for policy 0, policy_version 1901099 (0.0008) [2023-12-26 14:46:43,245][123090] Updated weights for policy 1, policy_version 1889142 (0.0009) [2023-12-26 14:46:43,311][123090] Updated weights for policy 1, policy_version 1889152 (0.0008) [2023-12-26 14:46:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17605.8). Total num frames: 970309632. Throughput: 0: 8980.3, 1: 8324.9. Samples: 970304968. Policy #0 lag: (min: 31.0, avg: 41.0, max: 63.0) [2023-12-26 14:46:43,785][121949] Avg episode reward: [(0, '6195.572'), (1, '5859.705')] [2023-12-26 14:46:43,985][123091] Updated weights for policy 0, policy_version 1901109 (0.0010) [2023-12-26 14:46:44,046][123091] Updated weights for policy 0, policy_version 1901119 (0.0010) [2023-12-26 14:46:44,111][123091] Updated weights for policy 0, policy_version 1901129 (0.0010) [2023-12-26 14:46:44,159][123090] Updated weights for policy 1, policy_version 1889162 (0.0009) [2023-12-26 14:46:44,223][123090] Updated weights for policy 1, policy_version 1889172 (0.0010) [2023-12-26 14:46:44,280][123090] Updated weights for policy 1, policy_version 1889183 (0.0009) [2023-12-26 14:46:44,933][123091] Updated weights for policy 0, policy_version 1901139 (0.0007) [2023-12-26 14:46:45,005][123091] Updated weights for policy 0, policy_version 1901149 (0.0007) [2023-12-26 14:46:45,081][123091] Updated weights for policy 0, policy_version 1901159 (0.0006) [2023-12-26 14:46:45,144][123090] Updated weights for policy 1, policy_version 1889193 (0.0007) [2023-12-26 14:46:45,197][123090] Updated weights for policy 1, policy_version 1889203 (0.0009) [2023-12-26 14:46:45,253][123090] Updated weights for policy 1, policy_version 1889213 (0.0010) [2023-12-26 14:46:45,737][123091] Updated weights for policy 0, policy_version 1901169 (0.0008) [2023-12-26 14:46:45,805][123091] Updated weights for policy 0, policy_version 1901179 (0.0009) [2023-12-26 14:46:45,867][123091] Updated weights for policy 0, policy_version 1901189 (0.0005) [2023-12-26 14:46:45,932][123091] Updated weights for policy 0, policy_version 1901199 (0.0006) [2023-12-26 14:46:46,183][123090] Updated weights for policy 1, policy_version 1889223 (0.0009) [2023-12-26 14:46:46,242][123090] Updated weights for policy 1, policy_version 1889235 (0.0010) [2023-12-26 14:46:46,295][123090] Updated weights for policy 1, policy_version 1889245 (0.0009) [2023-12-26 14:46:46,684][123091] Updated weights for policy 0, policy_version 1901209 (0.0009) [2023-12-26 14:46:46,752][123091] Updated weights for policy 0, policy_version 1901219 (0.0009) [2023-12-26 14:46:46,810][123091] Updated weights for policy 0, policy_version 1901229 (0.0009) [2023-12-26 14:46:47,132][123090] Updated weights for policy 1, policy_version 1889255 (0.0009) [2023-12-26 14:46:47,180][123090] Updated weights for policy 1, policy_version 1889265 (0.0009) [2023-12-26 14:46:47,227][123090] Updated weights for policy 1, policy_version 1889275 (0.0009) [2023-12-26 14:46:47,626][123091] Updated weights for policy 0, policy_version 1901239 (0.0007) [2023-12-26 14:46:47,678][123091] Updated weights for policy 0, policy_version 1901249 (0.0008) [2023-12-26 14:46:47,727][123091] Updated weights for policy 0, policy_version 1901259 (0.0005) [2023-12-26 14:46:48,053][123090] Updated weights for policy 1, policy_version 1889286 (0.0008) [2023-12-26 14:46:48,130][123090] Updated weights for policy 1, policy_version 1889296 (0.0011) [2023-12-26 14:46:48,189][123090] Updated weights for policy 1, policy_version 1889306 (0.0010) [2023-12-26 14:46:48,460][123091] Updated weights for policy 0, policy_version 1901269 (0.0007) [2023-12-26 14:46:48,516][123091] Updated weights for policy 0, policy_version 1901279 (0.0008) [2023-12-26 14:46:48,565][123091] Updated weights for policy 0, policy_version 1901289 (0.0009) [2023-12-26 14:46:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17605.9). Total num frames: 970399744. Throughput: 0: 8970.5, 1: 8363.8. Samples: 970410280. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:46:48,785][121949] Avg episode reward: [(0, '6307.117'), (1, '6051.964')] [2023-12-26 14:46:48,984][123090] Updated weights for policy 1, policy_version 1889316 (0.0011) [2023-12-26 14:46:49,033][123090] Updated weights for policy 1, policy_version 1889326 (0.0010) [2023-12-26 14:46:49,081][123090] Updated weights for policy 1, policy_version 1889336 (0.0010) [2023-12-26 14:46:49,433][123091] Updated weights for policy 0, policy_version 1901299 (0.0009) [2023-12-26 14:46:49,498][123091] Updated weights for policy 0, policy_version 1901309 (0.0009) [2023-12-26 14:46:49,547][123091] Updated weights for policy 0, policy_version 1901319 (0.0008) [2023-12-26 14:46:49,962][123090] Updated weights for policy 1, policy_version 1889346 (0.0010) [2023-12-26 14:46:50,029][123090] Updated weights for policy 1, policy_version 1889356 (0.0009) [2023-12-26 14:46:50,100][123090] Updated weights for policy 1, policy_version 1889366 (0.0006) [2023-12-26 14:46:50,166][123090] Updated weights for policy 1, policy_version 1889376 (0.0010) [2023-12-26 14:46:50,386][123091] Updated weights for policy 0, policy_version 1901329 (0.0009) [2023-12-26 14:46:50,445][123091] Updated weights for policy 0, policy_version 1901339 (0.0008) [2023-12-26 14:46:50,499][123091] Updated weights for policy 0, policy_version 1901349 (0.0009) [2023-12-26 14:46:50,564][123091] Updated weights for policy 0, policy_version 1901359 (0.0009) [2023-12-26 14:46:50,974][123090] Updated weights for policy 1, policy_version 1889386 (0.0011) [2023-12-26 14:46:51,054][123090] Updated weights for policy 1, policy_version 1889396 (0.0013) [2023-12-26 14:46:51,125][123090] Updated weights for policy 1, policy_version 1889406 (0.0010) [2023-12-26 14:46:51,461][123091] Updated weights for policy 0, policy_version 1901369 (0.0009) [2023-12-26 14:46:51,514][123091] Updated weights for policy 0, policy_version 1901379 (0.0010) [2023-12-26 14:46:51,569][123091] Updated weights for policy 0, policy_version 1901389 (0.0010) [2023-12-26 14:46:51,912][123090] Updated weights for policy 1, policy_version 1889416 (0.0010) [2023-12-26 14:46:51,985][123090] Updated weights for policy 1, policy_version 1889426 (0.0010) [2023-12-26 14:46:52,058][123090] Updated weights for policy 1, policy_version 1889436 (0.0009) [2023-12-26 14:46:52,431][123091] Updated weights for policy 0, policy_version 1901399 (0.0009) [2023-12-26 14:46:52,502][123091] Updated weights for policy 0, policy_version 1901409 (0.0010) [2023-12-26 14:46:52,568][123091] Updated weights for policy 0, policy_version 1901419 (0.0010) [2023-12-26 14:46:52,875][123090] Updated weights for policy 1, policy_version 1889447 (0.0009) [2023-12-26 14:46:52,929][123090] Updated weights for policy 1, policy_version 1889457 (0.0009) [2023-12-26 14:46:52,987][123090] Updated weights for policy 1, policy_version 1889467 (0.0009) [2023-12-26 14:46:53,307][123091] Updated weights for policy 0, policy_version 1901429 (0.0010) [2023-12-26 14:46:53,374][123091] Updated weights for policy 0, policy_version 1901439 (0.0006) [2023-12-26 14:46:53,432][123091] Updated weights for policy 0, policy_version 1901449 (0.0008) [2023-12-26 14:46:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.3, 300 sec: 17578.1). Total num frames: 970481664. Throughput: 0: 8941.7, 1: 8371.9. Samples: 970460756. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:46:53,785][121949] Avg episode reward: [(0, '6338.085'), (1, '5896.889')] [2023-12-26 14:46:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001901456_486776832.pth... [2023-12-26 14:46:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001889472_483704832.pth... [2023-12-26 14:46:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001900432_486514688.pth [2023-12-26 14:46:53,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888480_483450880.pth [2023-12-26 14:46:53,902][123090] Updated weights for policy 1, policy_version 1889477 (0.0009) [2023-12-26 14:46:53,961][123090] Updated weights for policy 1, policy_version 1889487 (0.0010) [2023-12-26 14:46:54,027][123090] Updated weights for policy 1, policy_version 1889497 (0.0009) [2023-12-26 14:46:54,048][123091] Updated weights for policy 0, policy_version 1901459 (0.0006) [2023-12-26 14:46:54,108][123091] Updated weights for policy 0, policy_version 1901469 (0.0008) [2023-12-26 14:46:54,177][123091] Updated weights for policy 0, policy_version 1901479 (0.0009) [2023-12-26 14:46:54,910][123090] Updated weights for policy 1, policy_version 1889507 (0.0008) [2023-12-26 14:46:54,968][123090] Updated weights for policy 1, policy_version 1889517 (0.0009) [2023-12-26 14:46:54,977][123091] Updated weights for policy 0, policy_version 1901489 (0.0009) [2023-12-26 14:46:55,030][123090] Updated weights for policy 1, policy_version 1889527 (0.0009) [2023-12-26 14:46:55,043][123091] Updated weights for policy 0, policy_version 1901499 (0.0005) [2023-12-26 14:46:55,109][123091] Updated weights for policy 0, policy_version 1901509 (0.0008) [2023-12-26 14:46:55,162][123091] Updated weights for policy 0, policy_version 1901519 (0.0009) [2023-12-26 14:46:55,884][123090] Updated weights for policy 1, policy_version 1889537 (0.0009) [2023-12-26 14:46:55,948][123090] Updated weights for policy 1, policy_version 1889547 (0.0008) [2023-12-26 14:46:55,970][123091] Updated weights for policy 0, policy_version 1901529 (0.0010) [2023-12-26 14:46:56,005][123090] Updated weights for policy 1, policy_version 1889557 (0.0009) [2023-12-26 14:46:56,041][123091] Updated weights for policy 0, policy_version 1901539 (0.0008) [2023-12-26 14:46:56,052][123090] Updated weights for policy 1, policy_version 1889567 (0.0008) [2023-12-26 14:46:56,102][123091] Updated weights for policy 0, policy_version 1901549 (0.0009) [2023-12-26 14:46:56,889][123090] Updated weights for policy 1, policy_version 1889577 (0.0008) [2023-12-26 14:46:56,900][123091] Updated weights for policy 0, policy_version 1901559 (0.0008) [2023-12-26 14:46:56,949][123091] Updated weights for policy 0, policy_version 1901569 (0.0008) [2023-12-26 14:46:56,951][123090] Updated weights for policy 1, policy_version 1889587 (0.0008) [2023-12-26 14:46:56,998][123091] Updated weights for policy 0, policy_version 1901579 (0.0009) [2023-12-26 14:46:57,011][123090] Updated weights for policy 1, policy_version 1889597 (0.0008) [2023-12-26 14:46:57,821][123090] Updated weights for policy 1, policy_version 1889607 (0.0008) [2023-12-26 14:46:57,841][123091] Updated weights for policy 0, policy_version 1901589 (0.0008) [2023-12-26 14:46:57,883][123090] Updated weights for policy 1, policy_version 1889617 (0.0010) [2023-12-26 14:46:57,891][123091] Updated weights for policy 0, policy_version 1901599 (0.0006) [2023-12-26 14:46:57,935][123090] Updated weights for policy 1, policy_version 1889627 (0.0008) [2023-12-26 14:46:57,946][123091] Updated weights for policy 0, policy_version 1901609 (0.0008) [2023-12-26 14:46:58,703][123091] Updated weights for policy 0, policy_version 1901619 (0.0006) [2023-12-26 14:46:58,776][123091] Updated weights for policy 0, policy_version 1901629 (0.0010) [2023-12-26 14:46:58,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17204.1, 300 sec: 17550.3). Total num frames: 970563584. Throughput: 0: 8942.8, 1: 8389.7. Samples: 970564332. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:46:58,784][121949] Avg episode reward: [(0, '6426.133'), (1, '5846.051')] [2023-12-26 14:46:58,845][123091] Updated weights for policy 0, policy_version 1901639 (0.0009) [2023-12-26 14:46:58,864][123090] Updated weights for policy 1, policy_version 1889637 (0.0008) [2023-12-26 14:46:58,933][123090] Updated weights for policy 1, policy_version 1889647 (0.0009) [2023-12-26 14:46:59,001][123090] Updated weights for policy 1, policy_version 1889657 (0.0007) [2023-12-26 14:46:59,703][123091] Updated weights for policy 0, policy_version 1901649 (0.0007) [2023-12-26 14:46:59,762][123090] Updated weights for policy 1, policy_version 1889667 (0.0007) [2023-12-26 14:46:59,764][123091] Updated weights for policy 0, policy_version 1901659 (0.0008) [2023-12-26 14:46:59,820][123090] Updated weights for policy 1, policy_version 1889677 (0.0008) [2023-12-26 14:46:59,832][123091] Updated weights for policy 0, policy_version 1901669 (0.0008) [2023-12-26 14:46:59,886][123090] Updated weights for policy 1, policy_version 1889687 (0.0008) [2023-12-26 14:46:59,893][123091] Updated weights for policy 0, policy_version 1901679 (0.0009) [2023-12-26 14:47:00,615][123091] Updated weights for policy 0, policy_version 1901689 (0.0009) [2023-12-26 14:47:00,683][123091] Updated weights for policy 0, policy_version 1901699 (0.0007) [2023-12-26 14:47:00,714][123090] Updated weights for policy 1, policy_version 1889697 (0.0008) [2023-12-26 14:47:00,743][123091] Updated weights for policy 0, policy_version 1901709 (0.0008) [2023-12-26 14:47:00,768][123090] Updated weights for policy 1, policy_version 1889707 (0.0005) [2023-12-26 14:47:00,819][123090] Updated weights for policy 1, policy_version 1889717 (0.0005) [2023-12-26 14:47:00,872][123090] Updated weights for policy 1, policy_version 1889727 (0.0005) [2023-12-26 14:47:01,463][123091] Updated weights for policy 0, policy_version 1901719 (0.0009) [2023-12-26 14:47:01,523][123091] Updated weights for policy 0, policy_version 1901729 (0.0009) [2023-12-26 14:47:01,588][123091] Updated weights for policy 0, policy_version 1901739 (0.0007) [2023-12-26 14:47:01,594][123090] Updated weights for policy 1, policy_version 1889737 (0.0008) [2023-12-26 14:47:01,659][123090] Updated weights for policy 1, policy_version 1889747 (0.0008) [2023-12-26 14:47:01,725][123090] Updated weights for policy 1, policy_version 1889757 (0.0007) [2023-12-26 14:47:02,334][123091] Updated weights for policy 0, policy_version 1901749 (0.0007) [2023-12-26 14:47:02,392][123091] Updated weights for policy 0, policy_version 1901759 (0.0008) [2023-12-26 14:47:02,442][123091] Updated weights for policy 0, policy_version 1901769 (0.0006) [2023-12-26 14:47:02,515][123090] Updated weights for policy 1, policy_version 1889767 (0.0010) [2023-12-26 14:47:02,587][123090] Updated weights for policy 1, policy_version 1889777 (0.0007) [2023-12-26 14:47:02,659][123090] Updated weights for policy 1, policy_version 1889787 (0.0006) [2023-12-26 14:47:03,288][123091] Updated weights for policy 0, policy_version 1901779 (0.0009) [2023-12-26 14:47:03,336][123091] Updated weights for policy 0, policy_version 1901789 (0.0009) [2023-12-26 14:47:03,384][123091] Updated weights for policy 0, policy_version 1901800 (0.0009) [2023-12-26 14:47:03,414][123090] Updated weights for policy 1, policy_version 1889797 (0.0009) [2023-12-26 14:47:03,462][123090] Updated weights for policy 1, policy_version 1889807 (0.0009) [2023-12-26 14:47:03,518][123090] Updated weights for policy 1, policy_version 1889817 (0.0009) [2023-12-26 14:47:03,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 970661888. Throughput: 0: 8867.9, 1: 8488.6. Samples: 970670820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:03,785][121949] Avg episode reward: [(0, '6388.238'), (1, '5927.821')] [2023-12-26 14:47:04,256][123091] Updated weights for policy 0, policy_version 1901810 (0.0008) [2023-12-26 14:47:04,318][123091] Updated weights for policy 0, policy_version 1901820 (0.0010) [2023-12-26 14:47:04,341][123090] Updated weights for policy 1, policy_version 1889827 (0.0009) [2023-12-26 14:47:04,374][123091] Updated weights for policy 0, policy_version 1901830 (0.0009) [2023-12-26 14:47:04,411][123090] Updated weights for policy 1, policy_version 1889837 (0.0007) [2023-12-26 14:47:04,433][123091] Updated weights for policy 0, policy_version 1901840 (0.0010) [2023-12-26 14:47:04,477][123090] Updated weights for policy 1, policy_version 1889847 (0.0008) [2023-12-26 14:47:05,276][123090] Updated weights for policy 1, policy_version 1889857 (0.0008) [2023-12-26 14:47:05,293][123091] Updated weights for policy 0, policy_version 1901850 (0.0009) [2023-12-26 14:47:05,338][123090] Updated weights for policy 1, policy_version 1889867 (0.0010) [2023-12-26 14:47:05,353][123091] Updated weights for policy 0, policy_version 1901860 (0.0007) [2023-12-26 14:47:05,402][123090] Updated weights for policy 1, policy_version 1889877 (0.0009) [2023-12-26 14:47:05,417][123091] Updated weights for policy 0, policy_version 1901870 (0.0007) [2023-12-26 14:47:05,457][123090] Updated weights for policy 1, policy_version 1889887 (0.0008) [2023-12-26 14:47:06,238][123091] Updated weights for policy 0, policy_version 1901880 (0.0009) [2023-12-26 14:47:06,291][123090] Updated weights for policy 1, policy_version 1889897 (0.0008) [2023-12-26 14:47:06,299][123091] Updated weights for policy 0, policy_version 1901890 (0.0008) [2023-12-26 14:47:06,345][123090] Updated weights for policy 1, policy_version 1889907 (0.0009) [2023-12-26 14:47:06,360][123091] Updated weights for policy 0, policy_version 1901900 (0.0009) [2023-12-26 14:47:06,397][123090] Updated weights for policy 1, policy_version 1889917 (0.0008) [2023-12-26 14:47:07,186][123091] Updated weights for policy 0, policy_version 1901910 (0.0009) [2023-12-26 14:47:07,244][123091] Updated weights for policy 0, policy_version 1901920 (0.0009) [2023-12-26 14:47:07,249][123090] Updated weights for policy 1, policy_version 1889927 (0.0008) [2023-12-26 14:47:07,307][123091] Updated weights for policy 0, policy_version 1901930 (0.0006) [2023-12-26 14:47:07,308][123090] Updated weights for policy 1, policy_version 1889937 (0.0007) [2023-12-26 14:47:07,372][123090] Updated weights for policy 1, policy_version 1889947 (0.0005) [2023-12-26 14:47:08,017][123091] Updated weights for policy 0, policy_version 1901940 (0.0006) [2023-12-26 14:47:08,071][123091] Updated weights for policy 0, policy_version 1901950 (0.0005) [2023-12-26 14:47:08,141][123091] Updated weights for policy 0, policy_version 1901960 (0.0005) [2023-12-26 14:47:08,149][123090] Updated weights for policy 1, policy_version 1889957 (0.0007) [2023-12-26 14:47:08,205][123090] Updated weights for policy 1, policy_version 1889967 (0.0009) [2023-12-26 14:47:08,261][123090] Updated weights for policy 1, policy_version 1889979 (0.0011) [2023-12-26 14:47:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 970743808. Throughput: 0: 8855.6, 1: 8524.5. Samples: 970722052. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:08,785][121949] Avg episode reward: [(0, '6273.051'), (1, '5809.978')] [2023-12-26 14:47:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001889984_483835904.pth... [2023-12-26 14:47:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001901968_486907904.pth... [2023-12-26 14:47:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001900944_486645760.pth [2023-12-26 14:47:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001888992_483581952.pth [2023-12-26 14:47:08,877][123091] Updated weights for policy 0, policy_version 1901970 (0.0006) [2023-12-26 14:47:08,930][123091] Updated weights for policy 0, policy_version 1901980 (0.0010) [2023-12-26 14:47:08,980][123091] Updated weights for policy 0, policy_version 1901990 (0.0009) [2023-12-26 14:47:09,031][123091] Updated weights for policy 0, policy_version 1902000 (0.0009) [2023-12-26 14:47:09,133][123090] Updated weights for policy 1, policy_version 1889989 (0.0009) [2023-12-26 14:47:09,180][123090] Updated weights for policy 1, policy_version 1889999 (0.0008) [2023-12-26 14:47:09,247][123090] Updated weights for policy 1, policy_version 1890009 (0.0010) [2023-12-26 14:47:09,959][123091] Updated weights for policy 0, policy_version 1902010 (0.0010) [2023-12-26 14:47:10,018][123091] Updated weights for policy 0, policy_version 1902020 (0.0007) [2023-12-26 14:47:10,073][123091] Updated weights for policy 0, policy_version 1902030 (0.0005) [2023-12-26 14:47:10,129][123090] Updated weights for policy 1, policy_version 1890019 (0.0010) [2023-12-26 14:47:10,188][123090] Updated weights for policy 1, policy_version 1890029 (0.0009) [2023-12-26 14:47:10,259][123090] Updated weights for policy 1, policy_version 1890039 (0.0009) [2023-12-26 14:47:10,876][123091] Updated weights for policy 0, policy_version 1902040 (0.0009) [2023-12-26 14:47:10,926][123091] Updated weights for policy 0, policy_version 1902050 (0.0009) [2023-12-26 14:47:10,975][123091] Updated weights for policy 0, policy_version 1902061 (0.0009) [2023-12-26 14:47:11,093][123090] Updated weights for policy 1, policy_version 1890049 (0.0009) [2023-12-26 14:47:11,173][123090] Updated weights for policy 1, policy_version 1890059 (0.0008) [2023-12-26 14:47:11,233][123090] Updated weights for policy 1, policy_version 1890069 (0.0008) [2023-12-26 14:47:11,303][123090] Updated weights for policy 1, policy_version 1890079 (0.0008) [2023-12-26 14:47:11,910][123091] Updated weights for policy 0, policy_version 1902071 (0.0010) [2023-12-26 14:47:11,977][123091] Updated weights for policy 0, policy_version 1902081 (0.0009) [2023-12-26 14:47:12,045][123091] Updated weights for policy 0, policy_version 1902091 (0.0009) [2023-12-26 14:47:12,079][123090] Updated weights for policy 1, policy_version 1890089 (0.0006) [2023-12-26 14:47:12,145][123090] Updated weights for policy 1, policy_version 1890099 (0.0005) [2023-12-26 14:47:12,208][123090] Updated weights for policy 1, policy_version 1890109 (0.0005) [2023-12-26 14:47:12,907][123091] Updated weights for policy 0, policy_version 1902101 (0.0010) [2023-12-26 14:47:12,969][123091] Updated weights for policy 0, policy_version 1902111 (0.0010) [2023-12-26 14:47:13,013][123090] Updated weights for policy 1, policy_version 1890119 (0.0008) [2023-12-26 14:47:13,030][123091] Updated weights for policy 0, policy_version 1902121 (0.0008) [2023-12-26 14:47:13,073][123090] Updated weights for policy 1, policy_version 1890129 (0.0010) [2023-12-26 14:47:13,141][123090] Updated weights for policy 1, policy_version 1890139 (0.0009) [2023-12-26 14:47:13,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 970825728. Throughput: 0: 8830.7, 1: 8559.1. Samples: 970824964. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:13,785][121949] Avg episode reward: [(0, '6275.788'), (1, '5866.107')] [2023-12-26 14:47:13,830][123091] Updated weights for policy 0, policy_version 1902131 (0.0008) [2023-12-26 14:47:13,882][123091] Updated weights for policy 0, policy_version 1902141 (0.0010) [2023-12-26 14:47:13,917][123090] Updated weights for policy 1, policy_version 1890149 (0.0007) [2023-12-26 14:47:13,935][123091] Updated weights for policy 0, policy_version 1902151 (0.0009) [2023-12-26 14:47:13,971][123090] Updated weights for policy 1, policy_version 1890159 (0.0006) [2023-12-26 14:47:14,023][123090] Updated weights for policy 1, policy_version 1890169 (0.0010) [2023-12-26 14:47:14,696][123090] Updated weights for policy 1, policy_version 1890179 (0.0009) [2023-12-26 14:47:14,752][123090] Updated weights for policy 1, policy_version 1890189 (0.0005) [2023-12-26 14:47:14,821][123090] Updated weights for policy 1, policy_version 1890199 (0.0011) [2023-12-26 14:47:14,845][123091] Updated weights for policy 0, policy_version 1902161 (0.0007) [2023-12-26 14:47:14,906][123091] Updated weights for policy 0, policy_version 1902171 (0.0008) [2023-12-26 14:47:14,968][123091] Updated weights for policy 0, policy_version 1902181 (0.0009) [2023-12-26 14:47:15,022][123091] Updated weights for policy 0, policy_version 1902191 (0.0009) [2023-12-26 14:47:15,649][123090] Updated weights for policy 1, policy_version 1890209 (0.0011) [2023-12-26 14:47:15,707][123090] Updated weights for policy 1, policy_version 1890219 (0.0010) [2023-12-26 14:47:15,773][123090] Updated weights for policy 1, policy_version 1890229 (0.0010) [2023-12-26 14:47:15,833][123090] Updated weights for policy 1, policy_version 1890239 (0.0008) [2023-12-26 14:47:15,879][123091] Updated weights for policy 0, policy_version 1902201 (0.0009) [2023-12-26 14:47:15,931][123091] Updated weights for policy 0, policy_version 1902211 (0.0009) [2023-12-26 14:47:15,991][123091] Updated weights for policy 0, policy_version 1902221 (0.0009) [2023-12-26 14:47:16,516][123090] Updated weights for policy 1, policy_version 1890249 (0.0006) [2023-12-26 14:47:16,570][123090] Updated weights for policy 1, policy_version 1890259 (0.0005) [2023-12-26 14:47:16,633][123090] Updated weights for policy 1, policy_version 1890269 (0.0005) [2023-12-26 14:47:16,743][123091] Updated weights for policy 0, policy_version 1902231 (0.0009) [2023-12-26 14:47:16,794][123091] Updated weights for policy 0, policy_version 1902241 (0.0009) [2023-12-26 14:47:16,850][123091] Updated weights for policy 0, policy_version 1902251 (0.0010) [2023-12-26 14:47:17,365][123090] Updated weights for policy 1, policy_version 1890279 (0.0009) [2023-12-26 14:47:17,432][123090] Updated weights for policy 1, policy_version 1890289 (0.0010) [2023-12-26 14:47:17,501][123090] Updated weights for policy 1, policy_version 1890299 (0.0010) [2023-12-26 14:47:17,607][123091] Updated weights for policy 0, policy_version 1902261 (0.0009) [2023-12-26 14:47:17,668][123091] Updated weights for policy 0, policy_version 1902271 (0.0009) [2023-12-26 14:47:17,736][123091] Updated weights for policy 0, policy_version 1902281 (0.0009) [2023-12-26 14:47:18,206][123090] Updated weights for policy 1, policy_version 1890309 (0.0007) [2023-12-26 14:47:18,258][123090] Updated weights for policy 1, policy_version 1890319 (0.0006) [2023-12-26 14:47:18,308][123090] Updated weights for policy 1, policy_version 1890329 (0.0009) [2023-12-26 14:47:18,649][123091] Updated weights for policy 0, policy_version 1902291 (0.0010) [2023-12-26 14:47:18,715][123091] Updated weights for policy 0, policy_version 1902301 (0.0009) [2023-12-26 14:47:18,779][123091] Updated weights for policy 0, policy_version 1902311 (0.0009) [2023-12-26 14:47:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 970915840. Throughput: 0: 8755.5, 1: 8644.9. Samples: 970932652. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:18,785][121949] Avg episode reward: [(0, '6097.585'), (1, '5859.330')] [2023-12-26 14:47:18,986][123090] Updated weights for policy 1, policy_version 1890339 (0.0009) [2023-12-26 14:47:19,042][123090] Updated weights for policy 1, policy_version 1890349 (0.0009) [2023-12-26 14:47:19,113][123090] Updated weights for policy 1, policy_version 1890359 (0.0008) [2023-12-26 14:47:19,585][123091] Updated weights for policy 0, policy_version 1902321 (0.0010) [2023-12-26 14:47:19,644][123091] Updated weights for policy 0, policy_version 1902331 (0.0005) [2023-12-26 14:47:19,707][123091] Updated weights for policy 0, policy_version 1902341 (0.0010) [2023-12-26 14:47:19,778][123091] Updated weights for policy 0, policy_version 1902351 (0.0011) [2023-12-26 14:47:19,970][123090] Updated weights for policy 1, policy_version 1890369 (0.0009) [2023-12-26 14:47:20,028][123090] Updated weights for policy 1, policy_version 1890379 (0.0009) [2023-12-26 14:47:20,092][123090] Updated weights for policy 1, policy_version 1890389 (0.0009) [2023-12-26 14:47:20,147][123090] Updated weights for policy 1, policy_version 1890399 (0.0010) [2023-12-26 14:47:20,540][123091] Updated weights for policy 0, policy_version 1902361 (0.0011) [2023-12-26 14:47:20,610][123091] Updated weights for policy 0, policy_version 1902371 (0.0009) [2023-12-26 14:47:20,671][123091] Updated weights for policy 0, policy_version 1902381 (0.0006) [2023-12-26 14:47:21,058][123090] Updated weights for policy 1, policy_version 1890409 (0.0010) [2023-12-26 14:47:21,132][123090] Updated weights for policy 1, policy_version 1890419 (0.0011) [2023-12-26 14:47:21,201][123090] Updated weights for policy 1, policy_version 1890429 (0.0011) [2023-12-26 14:47:21,414][123091] Updated weights for policy 0, policy_version 1902391 (0.0009) [2023-12-26 14:47:21,478][123091] Updated weights for policy 0, policy_version 1902401 (0.0011) [2023-12-26 14:47:21,542][123091] Updated weights for policy 0, policy_version 1902411 (0.0011) [2023-12-26 14:47:21,989][123090] Updated weights for policy 1, policy_version 1890439 (0.0010) [2023-12-26 14:47:22,038][123090] Updated weights for policy 1, policy_version 1890449 (0.0008) [2023-12-26 14:47:22,092][123090] Updated weights for policy 1, policy_version 1890459 (0.0009) [2023-12-26 14:47:22,388][123091] Updated weights for policy 0, policy_version 1902421 (0.0010) [2023-12-26 14:47:22,452][123091] Updated weights for policy 0, policy_version 1902431 (0.0011) [2023-12-26 14:47:22,520][123091] Updated weights for policy 0, policy_version 1902441 (0.0011) [2023-12-26 14:47:22,997][123090] Updated weights for policy 1, policy_version 1890469 (0.0009) [2023-12-26 14:47:23,064][123090] Updated weights for policy 1, policy_version 1890479 (0.0009) [2023-12-26 14:47:23,130][123090] Updated weights for policy 1, policy_version 1890489 (0.0009) [2023-12-26 14:47:23,344][123091] Updated weights for policy 0, policy_version 1902451 (0.0009) [2023-12-26 14:47:23,405][123091] Updated weights for policy 0, policy_version 1902461 (0.0005) [2023-12-26 14:47:23,452][123091] Updated weights for policy 0, policy_version 1902471 (0.0006) [2023-12-26 14:47:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 971005952. Throughput: 0: 8739.5, 1: 8631.0. Samples: 970983836. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:23,785][121949] Avg episode reward: [(0, '6189.375'), (1, '5755.514')] [2023-12-26 14:47:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001902480_487038976.pth... [2023-12-26 14:47:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001890496_483966976.pth... [2023-12-26 14:47:23,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001901456_486776832.pth [2023-12-26 14:47:23,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001889472_483704832.pth [2023-12-26 14:47:23,993][123090] Updated weights for policy 1, policy_version 1890499 (0.0010) [2023-12-26 14:47:24,052][123090] Updated weights for policy 1, policy_version 1890509 (0.0009) [2023-12-26 14:47:24,107][123090] Updated weights for policy 1, policy_version 1890519 (0.0009) [2023-12-26 14:47:24,188][123091] Updated weights for policy 0, policy_version 1902481 (0.0007) [2023-12-26 14:47:24,244][123091] Updated weights for policy 0, policy_version 1902491 (0.0009) [2023-12-26 14:47:24,297][123091] Updated weights for policy 0, policy_version 1902501 (0.0009) [2023-12-26 14:47:24,347][123091] Updated weights for policy 0, policy_version 1902511 (0.0009) [2023-12-26 14:47:24,927][123090] Updated weights for policy 1, policy_version 1890529 (0.0010) [2023-12-26 14:47:24,991][123090] Updated weights for policy 1, policy_version 1890539 (0.0009) [2023-12-26 14:47:25,060][123090] Updated weights for policy 1, policy_version 1890549 (0.0009) [2023-12-26 14:47:25,129][123090] Updated weights for policy 1, policy_version 1890559 (0.0009) [2023-12-26 14:47:25,199][123091] Updated weights for policy 0, policy_version 1902521 (0.0010) [2023-12-26 14:47:25,257][123091] Updated weights for policy 0, policy_version 1902531 (0.0010) [2023-12-26 14:47:25,317][123091] Updated weights for policy 0, policy_version 1902541 (0.0009) [2023-12-26 14:47:25,870][123090] Updated weights for policy 1, policy_version 1890569 (0.0006) [2023-12-26 14:47:25,920][123090] Updated weights for policy 1, policy_version 1890579 (0.0005) [2023-12-26 14:47:25,967][123090] Updated weights for policy 1, policy_version 1890589 (0.0005) [2023-12-26 14:47:26,223][123091] Updated weights for policy 0, policy_version 1902551 (0.0010) [2023-12-26 14:47:26,275][123091] Updated weights for policy 0, policy_version 1902561 (0.0009) [2023-12-26 14:47:26,326][123091] Updated weights for policy 0, policy_version 1902571 (0.0008) [2023-12-26 14:47:26,776][123090] Updated weights for policy 1, policy_version 1890599 (0.0008) [2023-12-26 14:47:26,832][123090] Updated weights for policy 1, policy_version 1890609 (0.0009) [2023-12-26 14:47:26,883][123090] Updated weights for policy 1, policy_version 1890620 (0.0009) [2023-12-26 14:47:27,163][123091] Updated weights for policy 0, policy_version 1902581 (0.0010) [2023-12-26 14:47:27,221][123091] Updated weights for policy 0, policy_version 1902591 (0.0010) [2023-12-26 14:47:27,275][123091] Updated weights for policy 0, policy_version 1902602 (0.0009) [2023-12-26 14:47:27,664][123090] Updated weights for policy 1, policy_version 1890630 (0.0006) [2023-12-26 14:47:27,712][123090] Updated weights for policy 1, policy_version 1890640 (0.0006) [2023-12-26 14:47:27,765][123090] Updated weights for policy 1, policy_version 1890650 (0.0009) [2023-12-26 14:47:28,173][123091] Updated weights for policy 0, policy_version 1902612 (0.0010) [2023-12-26 14:47:28,228][123091] Updated weights for policy 0, policy_version 1902622 (0.0009) [2023-12-26 14:47:28,281][123091] Updated weights for policy 0, policy_version 1902633 (0.0010) [2023-12-26 14:47:28,443][123090] Updated weights for policy 1, policy_version 1890660 (0.0010) [2023-12-26 14:47:28,498][123090] Updated weights for policy 1, policy_version 1890670 (0.0009) [2023-12-26 14:47:28,546][123090] Updated weights for policy 1, policy_version 1890680 (0.0009) [2023-12-26 14:47:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 971096064. Throughput: 0: 8720.7, 1: 8663.1. Samples: 971087232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:28,785][121949] Avg episode reward: [(0, '6305.157'), (1, '5613.940')] [2023-12-26 14:47:29,123][123091] Updated weights for policy 0, policy_version 1902644 (0.0010) [2023-12-26 14:47:29,173][123091] Updated weights for policy 0, policy_version 1902654 (0.0009) [2023-12-26 14:47:29,235][123091] Updated weights for policy 0, policy_version 1902664 (0.0009) [2023-12-26 14:47:29,411][123090] Updated weights for policy 1, policy_version 1890690 (0.0009) [2023-12-26 14:47:29,466][123090] Updated weights for policy 1, policy_version 1890700 (0.0009) [2023-12-26 14:47:29,530][123090] Updated weights for policy 1, policy_version 1890710 (0.0009) [2023-12-26 14:47:29,592][123090] Updated weights for policy 1, policy_version 1890720 (0.0009) [2023-12-26 14:47:30,089][123091] Updated weights for policy 0, policy_version 1902674 (0.0009) [2023-12-26 14:47:30,137][123091] Updated weights for policy 0, policy_version 1902684 (0.0009) [2023-12-26 14:47:30,187][123091] Updated weights for policy 0, policy_version 1902694 (0.0009) [2023-12-26 14:47:30,239][123091] Updated weights for policy 0, policy_version 1902704 (0.0010) [2023-12-26 14:47:30,438][123090] Updated weights for policy 1, policy_version 1890730 (0.0010) [2023-12-26 14:47:30,499][123090] Updated weights for policy 1, policy_version 1890740 (0.0009) [2023-12-26 14:47:30,563][123090] Updated weights for policy 1, policy_version 1890750 (0.0005) [2023-12-26 14:47:30,997][123091] Updated weights for policy 0, policy_version 1902714 (0.0009) [2023-12-26 14:47:31,062][123091] Updated weights for policy 0, policy_version 1902724 (0.0009) [2023-12-26 14:47:31,119][123091] Updated weights for policy 0, policy_version 1902734 (0.0009) [2023-12-26 14:47:31,268][123090] Updated weights for policy 1, policy_version 1890760 (0.0007) [2023-12-26 14:47:31,321][123090] Updated weights for policy 1, policy_version 1890770 (0.0009) [2023-12-26 14:47:31,381][123090] Updated weights for policy 1, policy_version 1890780 (0.0009) [2023-12-26 14:47:31,879][123091] Updated weights for policy 0, policy_version 1902744 (0.0006) [2023-12-26 14:47:31,936][123091] Updated weights for policy 0, policy_version 1902754 (0.0006) [2023-12-26 14:47:31,995][123091] Updated weights for policy 0, policy_version 1902764 (0.0007) [2023-12-26 14:47:32,270][123090] Updated weights for policy 1, policy_version 1890790 (0.0010) [2023-12-26 14:47:32,334][123090] Updated weights for policy 1, policy_version 1890800 (0.0009) [2023-12-26 14:47:32,406][123090] Updated weights for policy 1, policy_version 1890810 (0.0006) [2023-12-26 14:47:32,674][123091] Updated weights for policy 0, policy_version 1902774 (0.0009) [2023-12-26 14:47:32,731][123091] Updated weights for policy 0, policy_version 1902785 (0.0010) [2023-12-26 14:47:32,787][123091] Updated weights for policy 0, policy_version 1902795 (0.0009) [2023-12-26 14:47:33,161][123090] Updated weights for policy 1, policy_version 1890820 (0.0007) [2023-12-26 14:47:33,227][123090] Updated weights for policy 1, policy_version 1890830 (0.0010) [2023-12-26 14:47:33,319][123090] Updated weights for policy 1, policy_version 1890840 (0.0009) [2023-12-26 14:47:33,599][123091] Updated weights for policy 0, policy_version 1902805 (0.0009) [2023-12-26 14:47:33,652][123091] Updated weights for policy 0, policy_version 1902816 (0.0009) [2023-12-26 14:47:33,708][123091] Updated weights for policy 0, policy_version 1902826 (0.0010) [2023-12-26 14:47:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 971186176. Throughput: 0: 8701.5, 1: 8719.7. Samples: 971194236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:33,785][121949] Avg episode reward: [(0, '6357.587'), (1, '5802.750')] [2023-12-26 14:47:34,100][123090] Updated weights for policy 1, policy_version 1890850 (0.0009) [2023-12-26 14:47:34,162][123090] Updated weights for policy 1, policy_version 1890860 (0.0009) [2023-12-26 14:47:34,221][123090] Updated weights for policy 1, policy_version 1890870 (0.0008) [2023-12-26 14:47:34,271][123090] Updated weights for policy 1, policy_version 1890880 (0.0008) [2023-12-26 14:47:34,542][123091] Updated weights for policy 0, policy_version 1902836 (0.0011) [2023-12-26 14:47:34,605][123091] Updated weights for policy 0, policy_version 1902846 (0.0011) [2023-12-26 14:47:34,664][123091] Updated weights for policy 0, policy_version 1902856 (0.0010) [2023-12-26 14:47:35,007][123090] Updated weights for policy 1, policy_version 1890890 (0.0005) [2023-12-26 14:47:35,065][123090] Updated weights for policy 1, policy_version 1890900 (0.0005) [2023-12-26 14:47:35,119][123090] Updated weights for policy 1, policy_version 1890910 (0.0005) [2023-12-26 14:47:35,410][123091] Updated weights for policy 0, policy_version 1902866 (0.0010) [2023-12-26 14:47:35,478][123091] Updated weights for policy 0, policy_version 1902876 (0.0005) [2023-12-26 14:47:35,554][123091] Updated weights for policy 0, policy_version 1902886 (0.0008) [2023-12-26 14:47:35,627][123091] Updated weights for policy 0, policy_version 1902896 (0.0010) [2023-12-26 14:47:35,762][123090] Updated weights for policy 1, policy_version 1890920 (0.0009) [2023-12-26 14:47:35,812][123090] Updated weights for policy 1, policy_version 1890930 (0.0009) [2023-12-26 14:47:35,866][123090] Updated weights for policy 1, policy_version 1890940 (0.0010) [2023-12-26 14:47:36,375][123091] Updated weights for policy 0, policy_version 1902906 (0.0010) [2023-12-26 14:47:36,439][123091] Updated weights for policy 0, policy_version 1902916 (0.0010) [2023-12-26 14:47:36,508][123091] Updated weights for policy 0, policy_version 1902926 (0.0009) [2023-12-26 14:47:36,754][123090] Updated weights for policy 1, policy_version 1890950 (0.0009) [2023-12-26 14:47:36,818][123090] Updated weights for policy 1, policy_version 1890960 (0.0009) [2023-12-26 14:47:36,883][123090] Updated weights for policy 1, policy_version 1890970 (0.0008) [2023-12-26 14:47:37,318][123091] Updated weights for policy 0, policy_version 1902936 (0.0010) [2023-12-26 14:47:37,372][123091] Updated weights for policy 0, policy_version 1902946 (0.0009) [2023-12-26 14:47:37,443][123091] Updated weights for policy 0, policy_version 1902956 (0.0008) [2023-12-26 14:47:37,741][123090] Updated weights for policy 1, policy_version 1890980 (0.0010) [2023-12-26 14:47:37,802][123090] Updated weights for policy 1, policy_version 1890990 (0.0011) [2023-12-26 14:47:37,859][123090] Updated weights for policy 1, policy_version 1891000 (0.0011) [2023-12-26 14:47:38,320][123091] Updated weights for policy 0, policy_version 1902966 (0.0009) [2023-12-26 14:47:38,385][123091] Updated weights for policy 0, policy_version 1902976 (0.0010) [2023-12-26 14:47:38,441][123091] Updated weights for policy 0, policy_version 1902986 (0.0010) [2023-12-26 14:47:38,678][123090] Updated weights for policy 1, policy_version 1891010 (0.0010) [2023-12-26 14:47:38,742][123090] Updated weights for policy 1, policy_version 1891020 (0.0009) [2023-12-26 14:47:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 971268096. Throughput: 0: 8739.4, 1: 8770.0. Samples: 971248676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:38,785][121949] Avg episode reward: [(0, '6418.210'), (1, '6030.753')] [2023-12-26 14:47:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001902992_487170048.pth... [2023-12-26 14:47:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001901968_486907904.pth [2023-12-26 14:47:38,805][123090] Updated weights for policy 1, policy_version 1891030 (0.0010) [2023-12-26 14:47:38,863][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001891040_484106240.pth... [2023-12-26 14:47:38,864][123090] Updated weights for policy 1, policy_version 1891040 (0.0010) [2023-12-26 14:47:38,868][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001889984_483835904.pth [2023-12-26 14:47:39,215][123091] Updated weights for policy 0, policy_version 1902996 (0.0009) [2023-12-26 14:47:39,295][123091] Updated weights for policy 0, policy_version 1903006 (0.0007) [2023-12-26 14:47:39,370][123091] Updated weights for policy 0, policy_version 1903016 (0.0008) [2023-12-26 14:47:39,722][123090] Updated weights for policy 1, policy_version 1891050 (0.0008) [2023-12-26 14:47:39,795][123090] Updated weights for policy 1, policy_version 1891060 (0.0008) [2023-12-26 14:47:39,871][123090] Updated weights for policy 1, policy_version 1891070 (0.0008) [2023-12-26 14:47:40,215][123091] Updated weights for policy 0, policy_version 1903026 (0.0009) [2023-12-26 14:47:40,278][123091] Updated weights for policy 0, policy_version 1903036 (0.0010) [2023-12-26 14:47:40,347][123091] Updated weights for policy 0, policy_version 1903046 (0.0007) [2023-12-26 14:47:40,409][123091] Updated weights for policy 0, policy_version 1903056 (0.0010) [2023-12-26 14:47:40,619][123090] Updated weights for policy 1, policy_version 1891080 (0.0008) [2023-12-26 14:47:40,685][123090] Updated weights for policy 1, policy_version 1891090 (0.0008) [2023-12-26 14:47:40,755][123090] Updated weights for policy 1, policy_version 1891100 (0.0008) [2023-12-26 14:47:41,199][123091] Updated weights for policy 0, policy_version 1903066 (0.0010) [2023-12-26 14:47:41,265][123091] Updated weights for policy 0, policy_version 1903076 (0.0011) [2023-12-26 14:47:41,332][123091] Updated weights for policy 0, policy_version 1903086 (0.0010) [2023-12-26 14:47:41,593][123090] Updated weights for policy 1, policy_version 1891110 (0.0008) [2023-12-26 14:47:41,661][123090] Updated weights for policy 1, policy_version 1891120 (0.0008) [2023-12-26 14:47:41,718][123090] Updated weights for policy 1, policy_version 1891130 (0.0008) [2023-12-26 14:47:42,047][123091] Updated weights for policy 0, policy_version 1903096 (0.0009) [2023-12-26 14:47:42,107][123091] Updated weights for policy 0, policy_version 1903106 (0.0008) [2023-12-26 14:47:42,169][123091] Updated weights for policy 0, policy_version 1903116 (0.0006) [2023-12-26 14:47:42,556][123090] Updated weights for policy 1, policy_version 1891140 (0.0009) [2023-12-26 14:47:42,607][123090] Updated weights for policy 1, policy_version 1891150 (0.0009) [2023-12-26 14:47:42,666][123090] Updated weights for policy 1, policy_version 1891160 (0.0010) [2023-12-26 14:47:42,940][123091] Updated weights for policy 0, policy_version 1903126 (0.0010) [2023-12-26 14:47:43,009][123091] Updated weights for policy 0, policy_version 1903136 (0.0010) [2023-12-26 14:47:43,072][123091] Updated weights for policy 0, policy_version 1903146 (0.0008) [2023-12-26 14:47:43,486][123090] Updated weights for policy 1, policy_version 1891170 (0.0008) [2023-12-26 14:47:43,535][123090] Updated weights for policy 1, policy_version 1891180 (0.0005) [2023-12-26 14:47:43,591][123090] Updated weights for policy 1, policy_version 1891190 (0.0005) [2023-12-26 14:47:43,643][123090] Updated weights for policy 1, policy_version 1891200 (0.0005) [2023-12-26 14:47:43,718][123091] Updated weights for policy 0, policy_version 1903156 (0.0005) [2023-12-26 14:47:43,775][123091] Updated weights for policy 0, policy_version 1903166 (0.0005) [2023-12-26 14:47:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 971358208. Throughput: 0: 8702.1, 1: 8794.9. Samples: 971351700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:43,785][121949] Avg episode reward: [(0, '6269.051'), (1, '5910.223')] [2023-12-26 14:47:43,840][123091] Updated weights for policy 0, policy_version 1903176 (0.0007) [2023-12-26 14:47:44,333][123090] Updated weights for policy 1, policy_version 1891210 (0.0009) [2023-12-26 14:47:44,402][123090] Updated weights for policy 1, policy_version 1891220 (0.0009) [2023-12-26 14:47:44,475][123090] Updated weights for policy 1, policy_version 1891230 (0.0009) [2023-12-26 14:47:44,589][123091] Updated weights for policy 0, policy_version 1903186 (0.0006) [2023-12-26 14:47:44,648][123091] Updated weights for policy 0, policy_version 1903196 (0.0005) [2023-12-26 14:47:44,703][123091] Updated weights for policy 0, policy_version 1903206 (0.0005) [2023-12-26 14:47:44,766][123091] Updated weights for policy 0, policy_version 1903216 (0.0006) [2023-12-26 14:47:45,358][123090] Updated weights for policy 1, policy_version 1891240 (0.0009) [2023-12-26 14:47:45,428][123090] Updated weights for policy 1, policy_version 1891250 (0.0010) [2023-12-26 14:47:45,491][123090] Updated weights for policy 1, policy_version 1891260 (0.0009) [2023-12-26 14:47:45,548][123091] Updated weights for policy 0, policy_version 1903226 (0.0005) [2023-12-26 14:47:45,605][123091] Updated weights for policy 0, policy_version 1903236 (0.0006) [2023-12-26 14:47:45,659][123091] Updated weights for policy 0, policy_version 1903246 (0.0005) [2023-12-26 14:47:46,326][123091] Updated weights for policy 0, policy_version 1903256 (0.0005) [2023-12-26 14:47:46,391][123091] Updated weights for policy 0, policy_version 1903266 (0.0008) [2023-12-26 14:47:46,393][123090] Updated weights for policy 1, policy_version 1891270 (0.0009) [2023-12-26 14:47:46,443][123091] Updated weights for policy 0, policy_version 1903276 (0.0007) [2023-12-26 14:47:46,446][123090] Updated weights for policy 1, policy_version 1891280 (0.0008) [2023-12-26 14:47:46,497][123090] Updated weights for policy 1, policy_version 1891290 (0.0008) [2023-12-26 14:47:47,247][123090] Updated weights for policy 1, policy_version 1891300 (0.0007) [2023-12-26 14:47:47,255][123091] Updated weights for policy 0, policy_version 1903286 (0.0008) [2023-12-26 14:47:47,303][123091] Updated weights for policy 0, policy_version 1903296 (0.0009) [2023-12-26 14:47:47,312][123090] Updated weights for policy 1, policy_version 1891310 (0.0006) [2023-12-26 14:47:47,353][123091] Updated weights for policy 0, policy_version 1903306 (0.0010) [2023-12-26 14:47:47,374][123090] Updated weights for policy 1, policy_version 1891320 (0.0007) [2023-12-26 14:47:48,058][123091] Updated weights for policy 0, policy_version 1903316 (0.0006) [2023-12-26 14:47:48,112][123091] Updated weights for policy 0, policy_version 1903326 (0.0006) [2023-12-26 14:47:48,164][123091] Updated weights for policy 0, policy_version 1903336 (0.0009) [2023-12-26 14:47:48,266][123090] Updated weights for policy 1, policy_version 1891330 (0.0010) [2023-12-26 14:47:48,318][123090] Updated weights for policy 1, policy_version 1891340 (0.0009) [2023-12-26 14:47:48,383][123090] Updated weights for policy 1, policy_version 1891350 (0.0009) [2023-12-26 14:47:48,453][123090] Updated weights for policy 1, policy_version 1891360 (0.0010) [2023-12-26 14:47:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 971448320. Throughput: 0: 8780.1, 1: 8759.9. Samples: 971460124. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:48,785][121949] Avg episode reward: [(0, '6200.339'), (1, '5900.560')] [2023-12-26 14:47:48,905][123091] Updated weights for policy 0, policy_version 1903347 (0.0010) [2023-12-26 14:47:48,971][123091] Updated weights for policy 0, policy_version 1903357 (0.0010) [2023-12-26 14:47:49,030][123091] Updated weights for policy 0, policy_version 1903367 (0.0009) [2023-12-26 14:47:49,350][123090] Updated weights for policy 1, policy_version 1891370 (0.0007) [2023-12-26 14:47:49,414][123090] Updated weights for policy 1, policy_version 1891380 (0.0009) [2023-12-26 14:47:49,488][123090] Updated weights for policy 1, policy_version 1891390 (0.0009) [2023-12-26 14:47:49,774][123091] Updated weights for policy 0, policy_version 1903377 (0.0006) [2023-12-26 14:47:49,828][123091] Updated weights for policy 0, policy_version 1903387 (0.0009) [2023-12-26 14:47:49,879][123091] Updated weights for policy 0, policy_version 1903397 (0.0009) [2023-12-26 14:47:49,945][123091] Updated weights for policy 0, policy_version 1903407 (0.0010) [2023-12-26 14:47:50,283][123090] Updated weights for policy 1, policy_version 1891400 (0.0008) [2023-12-26 14:47:50,354][123090] Updated weights for policy 1, policy_version 1891410 (0.0007) [2023-12-26 14:47:50,421][123090] Updated weights for policy 1, policy_version 1891420 (0.0010) [2023-12-26 14:47:50,838][123091] Updated weights for policy 0, policy_version 1903417 (0.0008) [2023-12-26 14:47:50,908][123091] Updated weights for policy 0, policy_version 1903427 (0.0008) [2023-12-26 14:47:50,991][123091] Updated weights for policy 0, policy_version 1903437 (0.0009) [2023-12-26 14:47:51,196][123090] Updated weights for policy 1, policy_version 1891430 (0.0010) [2023-12-26 14:47:51,253][123090] Updated weights for policy 1, policy_version 1891440 (0.0008) [2023-12-26 14:47:51,321][123090] Updated weights for policy 1, policy_version 1891450 (0.0006) [2023-12-26 14:47:51,746][123091] Updated weights for policy 0, policy_version 1903447 (0.0007) [2023-12-26 14:47:51,816][123091] Updated weights for policy 0, policy_version 1903457 (0.0006) [2023-12-26 14:47:51,898][123091] Updated weights for policy 0, policy_version 1903467 (0.0006) [2023-12-26 14:47:52,022][123090] Updated weights for policy 1, policy_version 1891460 (0.0012) [2023-12-26 14:47:52,094][123090] Updated weights for policy 1, policy_version 1891470 (0.0011) [2023-12-26 14:47:52,172][123090] Updated weights for policy 1, policy_version 1891480 (0.0010) [2023-12-26 14:47:52,548][123091] Updated weights for policy 0, policy_version 1903477 (0.0007) [2023-12-26 14:47:52,596][123091] Updated weights for policy 0, policy_version 1903487 (0.0008) [2023-12-26 14:47:52,654][123091] Updated weights for policy 0, policy_version 1903497 (0.0008) [2023-12-26 14:47:52,971][123090] Updated weights for policy 1, policy_version 1891490 (0.0008) [2023-12-26 14:47:53,022][123090] Updated weights for policy 1, policy_version 1891500 (0.0010) [2023-12-26 14:47:53,082][123090] Updated weights for policy 1, policy_version 1891510 (0.0010) [2023-12-26 14:47:53,146][123090] Updated weights for policy 1, policy_version 1891520 (0.0011) [2023-12-26 14:47:53,420][123091] Updated weights for policy 0, policy_version 1903507 (0.0007) [2023-12-26 14:47:53,476][123091] Updated weights for policy 0, policy_version 1903517 (0.0005) [2023-12-26 14:47:53,528][123091] Updated weights for policy 0, policy_version 1903527 (0.0005) [2023-12-26 14:47:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 971538432. Throughput: 0: 8797.0, 1: 8770.9. Samples: 971512608. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:53,785][121949] Avg episode reward: [(0, '6253.123'), (1, '5886.028')] [2023-12-26 14:47:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001903536_487309312.pth... [2023-12-26 14:47:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001891520_484229120.pth... [2023-12-26 14:47:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001902480_487038976.pth [2023-12-26 14:47:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001890496_483966976.pth [2023-12-26 14:47:53,866][123090] Updated weights for policy 1, policy_version 1891530 (0.0008) [2023-12-26 14:47:53,918][123090] Updated weights for policy 1, policy_version 1891540 (0.0010) [2023-12-26 14:47:53,971][123090] Updated weights for policy 1, policy_version 1891550 (0.0010) [2023-12-26 14:47:54,242][123091] Updated weights for policy 0, policy_version 1903537 (0.0005) [2023-12-26 14:47:54,305][123091] Updated weights for policy 0, policy_version 1903547 (0.0005) [2023-12-26 14:47:54,365][123091] Updated weights for policy 0, policy_version 1903557 (0.0005) [2023-12-26 14:47:54,428][123091] Updated weights for policy 0, policy_version 1903567 (0.0005) [2023-12-26 14:47:54,883][123090] Updated weights for policy 1, policy_version 1891560 (0.0010) [2023-12-26 14:47:54,942][123090] Updated weights for policy 1, policy_version 1891571 (0.0010) [2023-12-26 14:47:54,991][123090] Updated weights for policy 1, policy_version 1891581 (0.0008) [2023-12-26 14:47:55,141][123091] Updated weights for policy 0, policy_version 1903577 (0.0010) [2023-12-26 14:47:55,207][123091] Updated weights for policy 0, policy_version 1903587 (0.0011) [2023-12-26 14:47:55,269][123091] Updated weights for policy 0, policy_version 1903597 (0.0010) [2023-12-26 14:47:55,869][123090] Updated weights for policy 1, policy_version 1891591 (0.0009) [2023-12-26 14:47:55,918][123090] Updated weights for policy 1, policy_version 1891601 (0.0008) [2023-12-26 14:47:55,975][123090] Updated weights for policy 1, policy_version 1891611 (0.0009) [2023-12-26 14:47:56,065][123091] Updated weights for policy 0, policy_version 1903607 (0.0010) [2023-12-26 14:47:56,124][123091] Updated weights for policy 0, policy_version 1903617 (0.0010) [2023-12-26 14:47:56,178][123091] Updated weights for policy 0, policy_version 1903627 (0.0008) [2023-12-26 14:47:56,833][123090] Updated weights for policy 1, policy_version 1891621 (0.0009) [2023-12-26 14:47:56,883][123090] Updated weights for policy 1, policy_version 1891631 (0.0008) [2023-12-26 14:47:56,941][123090] Updated weights for policy 1, policy_version 1891641 (0.0008) [2023-12-26 14:47:56,982][123091] Updated weights for policy 0, policy_version 1903637 (0.0008) [2023-12-26 14:47:57,040][123091] Updated weights for policy 0, policy_version 1903647 (0.0010) [2023-12-26 14:47:57,109][123091] Updated weights for policy 0, policy_version 1903657 (0.0010) [2023-12-26 14:47:57,771][123090] Updated weights for policy 1, policy_version 1891651 (0.0008) [2023-12-26 14:47:57,819][123090] Updated weights for policy 1, policy_version 1891661 (0.0009) [2023-12-26 14:47:57,868][123090] Updated weights for policy 1, policy_version 1891671 (0.0008) [2023-12-26 14:47:57,912][123091] Updated weights for policy 0, policy_version 1903667 (0.0010) [2023-12-26 14:47:57,978][123091] Updated weights for policy 0, policy_version 1903677 (0.0010) [2023-12-26 14:47:58,043][123091] Updated weights for policy 0, policy_version 1903687 (0.0010) [2023-12-26 14:47:58,707][123090] Updated weights for policy 1, policy_version 1891681 (0.0008) [2023-12-26 14:47:58,781][123090] Updated weights for policy 1, policy_version 1891691 (0.0007) [2023-12-26 14:47:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 971620352. Throughput: 0: 8896.5, 1: 8765.0. Samples: 971619732. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:47:58,785][121949] Avg episode reward: [(0, '6202.722'), (1, '5975.137')] [2023-12-26 14:47:58,862][123090] Updated weights for policy 1, policy_version 1891701 (0.0007) [2023-12-26 14:47:58,924][123090] Updated weights for policy 1, policy_version 1891711 (0.0009) [2023-12-26 14:47:58,938][123091] Updated weights for policy 0, policy_version 1903697 (0.0010) [2023-12-26 14:47:59,000][123091] Updated weights for policy 0, policy_version 1903707 (0.0010) [2023-12-26 14:47:59,063][123091] Updated weights for policy 0, policy_version 1903717 (0.0007) [2023-12-26 14:47:59,131][123091] Updated weights for policy 0, policy_version 1903727 (0.0008) [2023-12-26 14:47:59,724][123090] Updated weights for policy 1, policy_version 1891721 (0.0010) [2023-12-26 14:47:59,787][123090] Updated weights for policy 1, policy_version 1891732 (0.0010) [2023-12-26 14:47:59,856][123090] Updated weights for policy 1, policy_version 1891742 (0.0010) [2023-12-26 14:47:59,916][123091] Updated weights for policy 0, policy_version 1903737 (0.0008) [2023-12-26 14:47:59,976][123091] Updated weights for policy 0, policy_version 1903747 (0.0008) [2023-12-26 14:48:00,040][123091] Updated weights for policy 0, policy_version 1903757 (0.0008) [2023-12-26 14:48:00,735][123090] Updated weights for policy 1, policy_version 1891752 (0.0007) [2023-12-26 14:48:00,780][123090] Updated weights for policy 1, policy_version 1891762 (0.0005) [2023-12-26 14:48:00,832][123090] Updated weights for policy 1, policy_version 1891772 (0.0007) [2023-12-26 14:48:00,847][123091] Updated weights for policy 0, policy_version 1903767 (0.0008) [2023-12-26 14:48:00,896][123091] Updated weights for policy 0, policy_version 1903777 (0.0009) [2023-12-26 14:48:00,943][123091] Updated weights for policy 0, policy_version 1903787 (0.0008) [2023-12-26 14:48:01,643][123090] Updated weights for policy 1, policy_version 1891782 (0.0009) [2023-12-26 14:48:01,698][123090] Updated weights for policy 1, policy_version 1891792 (0.0009) [2023-12-26 14:48:01,762][123090] Updated weights for policy 1, policy_version 1891802 (0.0009) [2023-12-26 14:48:01,847][123091] Updated weights for policy 0, policy_version 1903797 (0.0009) [2023-12-26 14:48:01,908][123091] Updated weights for policy 0, policy_version 1903807 (0.0010) [2023-12-26 14:48:01,967][123091] Updated weights for policy 0, policy_version 1903817 (0.0005) [2023-12-26 14:48:02,586][123090] Updated weights for policy 1, policy_version 1891812 (0.0008) [2023-12-26 14:48:02,662][123090] Updated weights for policy 1, policy_version 1891822 (0.0005) [2023-12-26 14:48:02,735][123090] Updated weights for policy 1, policy_version 1891832 (0.0006) [2023-12-26 14:48:02,757][123091] Updated weights for policy 0, policy_version 1903827 (0.0006) [2023-12-26 14:48:02,816][123091] Updated weights for policy 0, policy_version 1903837 (0.0008) [2023-12-26 14:48:02,879][123091] Updated weights for policy 0, policy_version 1903847 (0.0009) [2023-12-26 14:48:03,345][123090] Updated weights for policy 1, policy_version 1891842 (0.0009) [2023-12-26 14:48:03,397][123090] Updated weights for policy 1, policy_version 1891852 (0.0009) [2023-12-26 14:48:03,446][123090] Updated weights for policy 1, policy_version 1891863 (0.0009) [2023-12-26 14:48:03,764][123091] Updated weights for policy 0, policy_version 1903857 (0.0009) [2023-12-26 14:48:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 971710464. Throughput: 0: 8881.8, 1: 8686.2. Samples: 971723212. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:03,785][121949] Avg episode reward: [(0, '6279.753'), (1, '5962.145')] [2023-12-26 14:48:03,822][123091] Updated weights for policy 0, policy_version 1903867 (0.0010) [2023-12-26 14:48:03,885][123091] Updated weights for policy 0, policy_version 1903877 (0.0009) [2023-12-26 14:48:03,950][123091] Updated weights for policy 0, policy_version 1903887 (0.0010) [2023-12-26 14:48:04,251][123090] Updated weights for policy 1, policy_version 1891873 (0.0009) [2023-12-26 14:48:04,317][123090] Updated weights for policy 1, policy_version 1891883 (0.0010) [2023-12-26 14:48:04,381][123090] Updated weights for policy 1, policy_version 1891893 (0.0009) [2023-12-26 14:48:04,449][123090] Updated weights for policy 1, policy_version 1891903 (0.0007) [2023-12-26 14:48:04,758][123091] Updated weights for policy 0, policy_version 1903897 (0.0006) [2023-12-26 14:48:04,805][123091] Updated weights for policy 0, policy_version 1903907 (0.0005) [2023-12-26 14:48:04,852][123091] Updated weights for policy 0, policy_version 1903917 (0.0005) [2023-12-26 14:48:05,199][123090] Updated weights for policy 1, policy_version 1891913 (0.0005) [2023-12-26 14:48:05,255][123090] Updated weights for policy 1, policy_version 1891923 (0.0009) [2023-12-26 14:48:05,310][123090] Updated weights for policy 1, policy_version 1891933 (0.0009) [2023-12-26 14:48:05,620][123091] Updated weights for policy 0, policy_version 1903927 (0.0008) [2023-12-26 14:48:05,671][123091] Updated weights for policy 0, policy_version 1903937 (0.0006) [2023-12-26 14:48:05,734][123091] Updated weights for policy 0, policy_version 1903947 (0.0005) [2023-12-26 14:48:06,046][123090] Updated weights for policy 1, policy_version 1891943 (0.0008) [2023-12-26 14:48:06,116][123090] Updated weights for policy 1, policy_version 1891953 (0.0009) [2023-12-26 14:48:06,185][123090] Updated weights for policy 1, policy_version 1891963 (0.0006) [2023-12-26 14:48:06,534][123091] Updated weights for policy 0, policy_version 1903957 (0.0008) [2023-12-26 14:48:06,582][123091] Updated weights for policy 0, policy_version 1903967 (0.0009) [2023-12-26 14:48:06,640][123091] Updated weights for policy 0, policy_version 1903977 (0.0009) [2023-12-26 14:48:06,947][123090] Updated weights for policy 1, policy_version 1891973 (0.0006) [2023-12-26 14:48:07,009][123090] Updated weights for policy 1, policy_version 1891983 (0.0005) [2023-12-26 14:48:07,081][123090] Updated weights for policy 1, policy_version 1891993 (0.0005) [2023-12-26 14:48:07,505][123091] Updated weights for policy 0, policy_version 1903987 (0.0008) [2023-12-26 14:48:07,565][123091] Updated weights for policy 0, policy_version 1903997 (0.0009) [2023-12-26 14:48:07,617][123091] Updated weights for policy 0, policy_version 1904007 (0.0010) [2023-12-26 14:48:07,713][123090] Updated weights for policy 1, policy_version 1892003 (0.0006) [2023-12-26 14:48:07,778][123090] Updated weights for policy 1, policy_version 1892013 (0.0008) [2023-12-26 14:48:07,845][123090] Updated weights for policy 1, policy_version 1892023 (0.0008) [2023-12-26 14:48:08,454][123091] Updated weights for policy 0, policy_version 1904017 (0.0009) [2023-12-26 14:48:08,480][123090] Updated weights for policy 1, policy_version 1892033 (0.0006) [2023-12-26 14:48:08,518][123091] Updated weights for policy 0, policy_version 1904027 (0.0006) [2023-12-26 14:48:08,546][123090] Updated weights for policy 1, policy_version 1892043 (0.0006) [2023-12-26 14:48:08,586][123091] Updated weights for policy 0, policy_version 1904037 (0.0006) [2023-12-26 14:48:08,606][123090] Updated weights for policy 1, policy_version 1892053 (0.0007) [2023-12-26 14:48:08,659][123091] Updated weights for policy 0, policy_version 1904047 (0.0009) [2023-12-26 14:48:08,664][123090] Updated weights for policy 1, policy_version 1892063 (0.0007) [2023-12-26 14:48:08,784][121949] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 971808768. Throughput: 0: 8894.6, 1: 8748.6. Samples: 971777784. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:08,785][121949] Avg episode reward: [(0, '6199.623'), (1, '6044.091')] [2023-12-26 14:48:08,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001904048_487440384.pth... [2023-12-26 14:48:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001892064_484368384.pth... [2023-12-26 14:48:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001902992_487170048.pth [2023-12-26 14:48:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001891040_484106240.pth [2023-12-26 14:48:09,341][123090] Updated weights for policy 1, policy_version 1892073 (0.0007) [2023-12-26 14:48:09,413][123090] Updated weights for policy 1, policy_version 1892083 (0.0010) [2023-12-26 14:48:09,456][123091] Updated weights for policy 0, policy_version 1904057 (0.0011) [2023-12-26 14:48:09,480][123090] Updated weights for policy 1, policy_version 1892093 (0.0011) [2023-12-26 14:48:09,513][123091] Updated weights for policy 0, policy_version 1904067 (0.0011) [2023-12-26 14:48:09,580][123091] Updated weights for policy 0, policy_version 1904077 (0.0011) [2023-12-26 14:48:10,297][123090] Updated weights for policy 1, policy_version 1892103 (0.0007) [2023-12-26 14:48:10,367][123090] Updated weights for policy 1, policy_version 1892113 (0.0006) [2023-12-26 14:48:10,418][123091] Updated weights for policy 0, policy_version 1904087 (0.0009) [2023-12-26 14:48:10,436][123090] Updated weights for policy 1, policy_version 1892123 (0.0007) [2023-12-26 14:48:10,486][123091] Updated weights for policy 0, policy_version 1904097 (0.0010) [2023-12-26 14:48:10,565][123091] Updated weights for policy 0, policy_version 1904107 (0.0010) [2023-12-26 14:48:11,133][123090] Updated weights for policy 1, policy_version 1892133 (0.0009) [2023-12-26 14:48:11,202][123090] Updated weights for policy 1, policy_version 1892143 (0.0011) [2023-12-26 14:48:11,262][123090] Updated weights for policy 1, policy_version 1892153 (0.0010) [2023-12-26 14:48:11,459][123091] Updated weights for policy 0, policy_version 1904117 (0.0009) [2023-12-26 14:48:11,525][123091] Updated weights for policy 0, policy_version 1904127 (0.0008) [2023-12-26 14:48:11,594][123091] Updated weights for policy 0, policy_version 1904137 (0.0009) [2023-12-26 14:48:12,137][123090] Updated weights for policy 1, policy_version 1892163 (0.0010) [2023-12-26 14:48:12,196][123090] Updated weights for policy 1, policy_version 1892173 (0.0009) [2023-12-26 14:48:12,252][123090] Updated weights for policy 1, policy_version 1892183 (0.0010) [2023-12-26 14:48:12,419][123091] Updated weights for policy 0, policy_version 1904147 (0.0008) [2023-12-26 14:48:12,493][123091] Updated weights for policy 0, policy_version 1904157 (0.0007) [2023-12-26 14:48:12,559][123091] Updated weights for policy 0, policy_version 1904167 (0.0011) [2023-12-26 14:48:13,170][123090] Updated weights for policy 1, policy_version 1892193 (0.0009) [2023-12-26 14:48:13,239][123090] Updated weights for policy 1, policy_version 1892203 (0.0010) [2023-12-26 14:48:13,291][123091] Updated weights for policy 0, policy_version 1904177 (0.0009) [2023-12-26 14:48:13,308][123090] Updated weights for policy 1, policy_version 1892213 (0.0009) [2023-12-26 14:48:13,348][123091] Updated weights for policy 0, policy_version 1904187 (0.0005) [2023-12-26 14:48:13,376][123090] Updated weights for policy 1, policy_version 1892223 (0.0009) [2023-12-26 14:48:13,407][123091] Updated weights for policy 0, policy_version 1904197 (0.0005) [2023-12-26 14:48:13,470][123091] Updated weights for policy 0, policy_version 1904207 (0.0010) [2023-12-26 14:48:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 971890688. Throughput: 0: 8878.0, 1: 8822.0. Samples: 971883736. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:13,785][121949] Avg episode reward: [(0, '6238.366'), (1, '6054.927')] [2023-12-26 14:48:14,060][123090] Updated weights for policy 1, policy_version 1892234 (0.0008) [2023-12-26 14:48:14,123][123090] Updated weights for policy 1, policy_version 1892244 (0.0006) [2023-12-26 14:48:14,182][123090] Updated weights for policy 1, policy_version 1892254 (0.0005) [2023-12-26 14:48:14,330][123091] Updated weights for policy 0, policy_version 1904218 (0.0010) [2023-12-26 14:48:14,384][123091] Updated weights for policy 0, policy_version 1904229 (0.0010) [2023-12-26 14:48:14,440][123091] Updated weights for policy 0, policy_version 1904239 (0.0009) [2023-12-26 14:48:14,957][123090] Updated weights for policy 1, policy_version 1892264 (0.0010) [2023-12-26 14:48:15,025][123090] Updated weights for policy 1, policy_version 1892274 (0.0010) [2023-12-26 14:48:15,093][123090] Updated weights for policy 1, policy_version 1892284 (0.0011) [2023-12-26 14:48:15,329][123091] Updated weights for policy 0, policy_version 1904249 (0.0008) [2023-12-26 14:48:15,391][123091] Updated weights for policy 0, policy_version 1904259 (0.0009) [2023-12-26 14:48:15,456][123091] Updated weights for policy 0, policy_version 1904269 (0.0009) [2023-12-26 14:48:15,857][123090] Updated weights for policy 1, policy_version 1892294 (0.0008) [2023-12-26 14:48:15,907][123090] Updated weights for policy 1, policy_version 1892304 (0.0005) [2023-12-26 14:48:15,972][123090] Updated weights for policy 1, policy_version 1892314 (0.0009) [2023-12-26 14:48:16,314][123091] Updated weights for policy 0, policy_version 1904279 (0.0008) [2023-12-26 14:48:16,385][123091] Updated weights for policy 0, policy_version 1904289 (0.0010) [2023-12-26 14:48:16,444][123091] Updated weights for policy 0, policy_version 1904299 (0.0009) [2023-12-26 14:48:16,743][123090] Updated weights for policy 1, policy_version 1892324 (0.0009) [2023-12-26 14:48:16,809][123090] Updated weights for policy 1, policy_version 1892334 (0.0010) [2023-12-26 14:48:16,880][123090] Updated weights for policy 1, policy_version 1892344 (0.0011) [2023-12-26 14:48:17,261][123091] Updated weights for policy 0, policy_version 1904309 (0.0007) [2023-12-26 14:48:17,327][123091] Updated weights for policy 0, policy_version 1904319 (0.0005) [2023-12-26 14:48:17,400][123091] Updated weights for policy 0, policy_version 1904329 (0.0005) [2023-12-26 14:48:17,548][123090] Updated weights for policy 1, policy_version 1892354 (0.0009) [2023-12-26 14:48:17,596][123090] Updated weights for policy 1, policy_version 1892364 (0.0006) [2023-12-26 14:48:17,648][123090] Updated weights for policy 1, policy_version 1892374 (0.0005) [2023-12-26 14:48:17,712][123090] Updated weights for policy 1, policy_version 1892384 (0.0006) [2023-12-26 14:48:18,119][123091] Updated weights for policy 0, policy_version 1904339 (0.0007) [2023-12-26 14:48:18,182][123091] Updated weights for policy 0, policy_version 1904349 (0.0011) [2023-12-26 14:48:18,245][123091] Updated weights for policy 0, policy_version 1904359 (0.0010) [2023-12-26 14:48:18,374][123090] Updated weights for policy 1, policy_version 1892394 (0.0006) [2023-12-26 14:48:18,441][123090] Updated weights for policy 1, policy_version 1892404 (0.0006) [2023-12-26 14:48:18,514][123090] Updated weights for policy 1, policy_version 1892414 (0.0005) [2023-12-26 14:48:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 971980800. Throughput: 0: 8833.9, 1: 8904.3. Samples: 971992452. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:18,785][121949] Avg episode reward: [(0, '6202.649'), (1, '5983.203')] [2023-12-26 14:48:19,005][123091] Updated weights for policy 0, policy_version 1904369 (0.0010) [2023-12-26 14:48:19,071][123091] Updated weights for policy 0, policy_version 1904379 (0.0010) [2023-12-26 14:48:19,138][123091] Updated weights for policy 0, policy_version 1904389 (0.0005) [2023-12-26 14:48:19,211][123091] Updated weights for policy 0, policy_version 1904399 (0.0006) [2023-12-26 14:48:19,229][123090] Updated weights for policy 1, policy_version 1892424 (0.0009) [2023-12-26 14:48:19,303][123090] Updated weights for policy 1, policy_version 1892434 (0.0011) [2023-12-26 14:48:19,373][123090] Updated weights for policy 1, policy_version 1892444 (0.0010) [2023-12-26 14:48:19,949][123091] Updated weights for policy 0, policy_version 1904409 (0.0008) [2023-12-26 14:48:20,008][123091] Updated weights for policy 0, policy_version 1904419 (0.0008) [2023-12-26 14:48:20,071][123091] Updated weights for policy 0, policy_version 1904429 (0.0008) [2023-12-26 14:48:20,143][123090] Updated weights for policy 1, policy_version 1892454 (0.0010) [2023-12-26 14:48:20,222][123090] Updated weights for policy 1, policy_version 1892464 (0.0010) [2023-12-26 14:48:20,284][123090] Updated weights for policy 1, policy_version 1892474 (0.0006) [2023-12-26 14:48:20,917][123090] Updated weights for policy 1, policy_version 1892484 (0.0007) [2023-12-26 14:48:20,920][123091] Updated weights for policy 0, policy_version 1904439 (0.0008) [2023-12-26 14:48:20,977][123090] Updated weights for policy 1, policy_version 1892494 (0.0008) [2023-12-26 14:48:20,984][123091] Updated weights for policy 0, policy_version 1904449 (0.0006) [2023-12-26 14:48:21,050][123090] Updated weights for policy 1, policy_version 1892504 (0.0008) [2023-12-26 14:48:21,055][123091] Updated weights for policy 0, policy_version 1904459 (0.0008) [2023-12-26 14:48:21,847][123090] Updated weights for policy 1, policy_version 1892514 (0.0008) [2023-12-26 14:48:21,925][123090] Updated weights for policy 1, policy_version 1892524 (0.0006) [2023-12-26 14:48:21,952][123091] Updated weights for policy 0, policy_version 1904469 (0.0008) [2023-12-26 14:48:21,995][123090] Updated weights for policy 1, policy_version 1892534 (0.0006) [2023-12-26 14:48:22,008][123091] Updated weights for policy 0, policy_version 1904479 (0.0009) [2023-12-26 14:48:22,073][123091] Updated weights for policy 0, policy_version 1904489 (0.0009) [2023-12-26 14:48:22,078][123090] Updated weights for policy 1, policy_version 1892544 (0.0009) [2023-12-26 14:48:22,838][123090] Updated weights for policy 1, policy_version 1892554 (0.0006) [2023-12-26 14:48:22,901][123090] Updated weights for policy 1, policy_version 1892564 (0.0006) [2023-12-26 14:48:22,945][123091] Updated weights for policy 0, policy_version 1904499 (0.0009) [2023-12-26 14:48:22,964][123090] Updated weights for policy 1, policy_version 1892574 (0.0007) [2023-12-26 14:48:23,008][123091] Updated weights for policy 0, policy_version 1904509 (0.0008) [2023-12-26 14:48:23,073][123091] Updated weights for policy 0, policy_version 1904519 (0.0010) [2023-12-26 14:48:23,759][123091] Updated weights for policy 0, policy_version 1904529 (0.0009) [2023-12-26 14:48:23,782][123090] Updated weights for policy 1, policy_version 1892584 (0.0010) [2023-12-26 14:48:23,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 972062720. Throughput: 0: 8822.3, 1: 8894.3. Samples: 972045920. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:23,785][121949] Avg episode reward: [(0, '6330.906'), (1, '5997.214')] [2023-12-26 14:48:23,808][123091] Updated weights for policy 0, policy_version 1904539 (0.0006) [2023-12-26 14:48:23,833][123090] Updated weights for policy 1, policy_version 1892594 (0.0008) [2023-12-26 14:48:23,869][123091] Updated weights for policy 0, policy_version 1904549 (0.0007) [2023-12-26 14:48:23,901][123090] Updated weights for policy 1, policy_version 1892604 (0.0008) [2023-12-26 14:48:23,923][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001892608_484507648.pth... [2023-12-26 14:48:23,926][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001891520_484229120.pth [2023-12-26 14:48:23,931][123091] Updated weights for policy 0, policy_version 1904559 (0.0005) [2023-12-26 14:48:23,936][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001904560_487571456.pth... [2023-12-26 14:48:23,941][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001903536_487309312.pth [2023-12-26 14:48:24,588][123091] Updated weights for policy 0, policy_version 1904569 (0.0008) [2023-12-26 14:48:24,661][123091] Updated weights for policy 0, policy_version 1904579 (0.0009) [2023-12-26 14:48:24,721][123090] Updated weights for policy 1, policy_version 1892614 (0.0006) [2023-12-26 14:48:24,723][123091] Updated weights for policy 0, policy_version 1904589 (0.0010) [2023-12-26 14:48:24,791][123090] Updated weights for policy 1, policy_version 1892624 (0.0009) [2023-12-26 14:48:24,856][123090] Updated weights for policy 1, policy_version 1892634 (0.0008) [2023-12-26 14:48:25,383][123091] Updated weights for policy 0, policy_version 1904599 (0.0006) [2023-12-26 14:48:25,440][123091] Updated weights for policy 0, policy_version 1904609 (0.0005) [2023-12-26 14:48:25,484][123091] Updated weights for policy 0, policy_version 1904619 (0.0005) [2023-12-26 14:48:25,750][123090] Updated weights for policy 1, policy_version 1892644 (0.0010) [2023-12-26 14:48:25,816][123090] Updated weights for policy 1, policy_version 1892654 (0.0009) [2023-12-26 14:48:25,866][123090] Updated weights for policy 1, policy_version 1892664 (0.0009) [2023-12-26 14:48:26,274][123091] Updated weights for policy 0, policy_version 1904629 (0.0008) [2023-12-26 14:48:26,326][123091] Updated weights for policy 0, policy_version 1904639 (0.0009) [2023-12-26 14:48:26,375][123091] Updated weights for policy 0, policy_version 1904649 (0.0009) [2023-12-26 14:48:26,721][123090] Updated weights for policy 1, policy_version 1892674 (0.0009) [2023-12-26 14:48:26,789][123090] Updated weights for policy 1, policy_version 1892684 (0.0009) [2023-12-26 14:48:26,838][123090] Updated weights for policy 1, policy_version 1892694 (0.0009) [2023-12-26 14:48:26,897][123090] Updated weights for policy 1, policy_version 1892704 (0.0009) [2023-12-26 14:48:27,241][123091] Updated weights for policy 0, policy_version 1904659 (0.0009) [2023-12-26 14:48:27,295][123091] Updated weights for policy 0, policy_version 1904669 (0.0010) [2023-12-26 14:48:27,356][123091] Updated weights for policy 0, policy_version 1904679 (0.0009) [2023-12-26 14:48:27,717][123090] Updated weights for policy 1, policy_version 1892714 (0.0009) [2023-12-26 14:48:27,773][123090] Updated weights for policy 1, policy_version 1892724 (0.0008) [2023-12-26 14:48:27,829][123090] Updated weights for policy 1, policy_version 1892734 (0.0010) [2023-12-26 14:48:28,198][123091] Updated weights for policy 0, policy_version 1904689 (0.0010) [2023-12-26 14:48:28,263][123091] Updated weights for policy 0, policy_version 1904699 (0.0009) [2023-12-26 14:48:28,323][123091] Updated weights for policy 0, policy_version 1904709 (0.0010) [2023-12-26 14:48:28,396][123091] Updated weights for policy 0, policy_version 1904719 (0.0009) [2023-12-26 14:48:28,674][123090] Updated weights for policy 1, policy_version 1892744 (0.0009) [2023-12-26 14:48:28,732][123090] Updated weights for policy 1, policy_version 1892754 (0.0010) [2023-12-26 14:48:28,784][123090] Updated weights for policy 1, policy_version 1892764 (0.0009) [2023-12-26 14:48:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 972152832. Throughput: 0: 8873.6, 1: 8896.6. Samples: 972151360. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:28,785][121949] Avg episode reward: [(0, '6380.070'), (1, '5894.025')] [2023-12-26 14:48:29,169][123091] Updated weights for policy 0, policy_version 1904729 (0.0009) [2023-12-26 14:48:29,218][123091] Updated weights for policy 0, policy_version 1904739 (0.0009) [2023-12-26 14:48:29,293][123091] Updated weights for policy 0, policy_version 1904750 (0.0009) [2023-12-26 14:48:29,696][123090] Updated weights for policy 1, policy_version 1892774 (0.0009) [2023-12-26 14:48:29,746][123090] Updated weights for policy 1, policy_version 1892784 (0.0009) [2023-12-26 14:48:29,806][123090] Updated weights for policy 1, policy_version 1892794 (0.0009) [2023-12-26 14:48:30,108][123091] Updated weights for policy 0, policy_version 1904760 (0.0008) [2023-12-26 14:48:30,169][123091] Updated weights for policy 0, policy_version 1904770 (0.0005) [2023-12-26 14:48:30,221][123091] Updated weights for policy 0, policy_version 1904780 (0.0007) [2023-12-26 14:48:30,699][123090] Updated weights for policy 1, policy_version 1892804 (0.0010) [2023-12-26 14:48:30,758][123090] Updated weights for policy 1, policy_version 1892814 (0.0009) [2023-12-26 14:48:30,805][123090] Updated weights for policy 1, policy_version 1892824 (0.0008) [2023-12-26 14:48:30,920][123091] Updated weights for policy 0, policy_version 1904790 (0.0010) [2023-12-26 14:48:30,978][123091] Updated weights for policy 0, policy_version 1904800 (0.0010) [2023-12-26 14:48:31,028][123091] Updated weights for policy 0, policy_version 1904810 (0.0010) [2023-12-26 14:48:31,654][123090] Updated weights for policy 1, policy_version 1892834 (0.0008) [2023-12-26 14:48:31,729][123090] Updated weights for policy 1, policy_version 1892844 (0.0007) [2023-12-26 14:48:31,795][123090] Updated weights for policy 1, policy_version 1892854 (0.0009) [2023-12-26 14:48:31,864][123090] Updated weights for policy 1, policy_version 1892864 (0.0009) [2023-12-26 14:48:31,908][123091] Updated weights for policy 0, policy_version 1904820 (0.0010) [2023-12-26 14:48:31,962][123091] Updated weights for policy 0, policy_version 1904830 (0.0009) [2023-12-26 14:48:32,014][123091] Updated weights for policy 0, policy_version 1904840 (0.0009) [2023-12-26 14:48:32,595][123090] Updated weights for policy 1, policy_version 1892874 (0.0009) [2023-12-26 14:48:32,664][123090] Updated weights for policy 1, policy_version 1892885 (0.0009) [2023-12-26 14:48:32,720][123090] Updated weights for policy 1, policy_version 1892895 (0.0009) [2023-12-26 14:48:32,872][123091] Updated weights for policy 0, policy_version 1904850 (0.0009) [2023-12-26 14:48:32,947][123091] Updated weights for policy 0, policy_version 1904860 (0.0006) [2023-12-26 14:48:33,003][123091] Updated weights for policy 0, policy_version 1904870 (0.0005) [2023-12-26 14:48:33,064][123091] Updated weights for policy 0, policy_version 1904880 (0.0005) [2023-12-26 14:48:33,464][123090] Updated weights for policy 1, policy_version 1892905 (0.0006) [2023-12-26 14:48:33,519][123090] Updated weights for policy 1, policy_version 1892915 (0.0005) [2023-12-26 14:48:33,577][123090] Updated weights for policy 1, policy_version 1892925 (0.0005) [2023-12-26 14:48:33,741][123091] Updated weights for policy 0, policy_version 1904890 (0.0009) [2023-12-26 14:48:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 972242944. Throughput: 0: 8800.3, 1: 8919.5. Samples: 972257512. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:33,784][121949] Avg episode reward: [(0, '6285.522'), (1, '5929.221')] [2023-12-26 14:48:33,799][123091] Updated weights for policy 0, policy_version 1904900 (0.0010) [2023-12-26 14:48:33,843][123091] Updated weights for policy 0, policy_version 1904910 (0.0010) [2023-12-26 14:48:34,176][123090] Updated weights for policy 1, policy_version 1892935 (0.0008) [2023-12-26 14:48:34,237][123090] Updated weights for policy 1, policy_version 1892945 (0.0005) [2023-12-26 14:48:34,309][123090] Updated weights for policy 1, policy_version 1892955 (0.0006) [2023-12-26 14:48:34,681][123091] Updated weights for policy 0, policy_version 1904920 (0.0011) [2023-12-26 14:48:34,752][123091] Updated weights for policy 0, policy_version 1904930 (0.0011) [2023-12-26 14:48:34,803][123091] Updated weights for policy 0, policy_version 1904940 (0.0010) [2023-12-26 14:48:35,076][123090] Updated weights for policy 1, policy_version 1892965 (0.0007) [2023-12-26 14:48:35,130][123090] Updated weights for policy 1, policy_version 1892975 (0.0010) [2023-12-26 14:48:35,186][123090] Updated weights for policy 1, policy_version 1892985 (0.0010) [2023-12-26 14:48:35,609][123091] Updated weights for policy 0, policy_version 1904950 (0.0010) [2023-12-26 14:48:35,678][123091] Updated weights for policy 0, policy_version 1904960 (0.0010) [2023-12-26 14:48:35,737][123091] Updated weights for policy 0, policy_version 1904970 (0.0010) [2023-12-26 14:48:35,892][123090] Updated weights for policy 1, policy_version 1892995 (0.0009) [2023-12-26 14:48:35,944][123090] Updated weights for policy 1, policy_version 1893005 (0.0005) [2023-12-26 14:48:35,999][123090] Updated weights for policy 1, policy_version 1893015 (0.0005) [2023-12-26 14:48:36,448][123091] Updated weights for policy 0, policy_version 1904980 (0.0009) [2023-12-26 14:48:36,507][123091] Updated weights for policy 0, policy_version 1904990 (0.0006) [2023-12-26 14:48:36,566][123091] Updated weights for policy 0, policy_version 1905000 (0.0006) [2023-12-26 14:48:36,867][123090] Updated weights for policy 1, policy_version 1893025 (0.0006) [2023-12-26 14:48:36,936][123090] Updated weights for policy 1, policy_version 1893035 (0.0011) [2023-12-26 14:48:37,001][123090] Updated weights for policy 1, policy_version 1893045 (0.0011) [2023-12-26 14:48:37,056][123090] Updated weights for policy 1, policy_version 1893055 (0.0007) [2023-12-26 14:48:37,321][123091] Updated weights for policy 0, policy_version 1905010 (0.0009) [2023-12-26 14:48:37,383][123091] Updated weights for policy 0, policy_version 1905020 (0.0011) [2023-12-26 14:48:37,441][123091] Updated weights for policy 0, policy_version 1905030 (0.0010) [2023-12-26 14:48:37,493][123091] Updated weights for policy 0, policy_version 1905040 (0.0010) [2023-12-26 14:48:37,819][123090] Updated weights for policy 1, policy_version 1893065 (0.0008) [2023-12-26 14:48:37,883][123090] Updated weights for policy 1, policy_version 1893075 (0.0011) [2023-12-26 14:48:37,958][123090] Updated weights for policy 1, policy_version 1893085 (0.0011) [2023-12-26 14:48:38,313][123091] Updated weights for policy 0, policy_version 1905050 (0.0008) [2023-12-26 14:48:38,380][123091] Updated weights for policy 0, policy_version 1905060 (0.0008) [2023-12-26 14:48:38,448][123091] Updated weights for policy 0, policy_version 1905070 (0.0008) [2023-12-26 14:48:38,768][123090] Updated weights for policy 1, policy_version 1893095 (0.0011) [2023-12-26 14:48:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 972333056. Throughput: 0: 8816.1, 1: 8977.4. Samples: 972313316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:38,785][121949] Avg episode reward: [(0, '6170.639'), (1, '5955.644')] [2023-12-26 14:48:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001905072_487702528.pth... [2023-12-26 14:48:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001904048_487440384.pth [2023-12-26 14:48:38,828][123090] Updated weights for policy 1, policy_version 1893105 (0.0010) [2023-12-26 14:48:38,875][123090] Updated weights for policy 1, policy_version 1893115 (0.0010) [2023-12-26 14:48:38,904][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001893120_484638720.pth... [2023-12-26 14:48:38,907][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001892064_484368384.pth [2023-12-26 14:48:39,175][123091] Updated weights for policy 0, policy_version 1905080 (0.0010) [2023-12-26 14:48:39,243][123091] Updated weights for policy 0, policy_version 1905090 (0.0011) [2023-12-26 14:48:39,307][123091] Updated weights for policy 0, policy_version 1905100 (0.0011) [2023-12-26 14:48:39,736][123090] Updated weights for policy 1, policy_version 1893125 (0.0010) [2023-12-26 14:48:39,802][123090] Updated weights for policy 1, policy_version 1893135 (0.0009) [2023-12-26 14:48:39,874][123090] Updated weights for policy 1, policy_version 1893145 (0.0009) [2023-12-26 14:48:40,158][123091] Updated weights for policy 0, policy_version 1905110 (0.0011) [2023-12-26 14:48:40,225][123091] Updated weights for policy 0, policy_version 1905120 (0.0011) [2023-12-26 14:48:40,294][123091] Updated weights for policy 0, policy_version 1905130 (0.0011) [2023-12-26 14:48:40,569][123090] Updated weights for policy 1, policy_version 1893155 (0.0009) [2023-12-26 14:48:40,631][123090] Updated weights for policy 1, policy_version 1893165 (0.0006) [2023-12-26 14:48:40,691][123090] Updated weights for policy 1, policy_version 1893175 (0.0007) [2023-12-26 14:48:41,027][123091] Updated weights for policy 0, policy_version 1905140 (0.0011) [2023-12-26 14:48:41,100][123091] Updated weights for policy 0, policy_version 1905150 (0.0011) [2023-12-26 14:48:41,171][123091] Updated weights for policy 0, policy_version 1905160 (0.0011) [2023-12-26 14:48:41,464][123090] Updated weights for policy 1, policy_version 1893185 (0.0006) [2023-12-26 14:48:41,531][123090] Updated weights for policy 1, policy_version 1893195 (0.0010) [2023-12-26 14:48:41,591][123090] Updated weights for policy 1, policy_version 1893205 (0.0010) [2023-12-26 14:48:41,653][123090] Updated weights for policy 1, policy_version 1893215 (0.0009) [2023-12-26 14:48:41,922][123091] Updated weights for policy 0, policy_version 1905170 (0.0008) [2023-12-26 14:48:41,983][123091] Updated weights for policy 0, policy_version 1905180 (0.0005) [2023-12-26 14:48:42,052][123091] Updated weights for policy 0, policy_version 1905190 (0.0009) [2023-12-26 14:48:42,123][123091] Updated weights for policy 0, policy_version 1905200 (0.0010) [2023-12-26 14:48:42,544][123090] Updated weights for policy 1, policy_version 1893225 (0.0009) [2023-12-26 14:48:42,610][123090] Updated weights for policy 1, policy_version 1893235 (0.0010) [2023-12-26 14:48:42,679][123090] Updated weights for policy 1, policy_version 1893245 (0.0009) [2023-12-26 14:48:42,890][123091] Updated weights for policy 0, policy_version 1905210 (0.0010) [2023-12-26 14:48:42,947][123091] Updated weights for policy 0, policy_version 1905220 (0.0009) [2023-12-26 14:48:43,001][123091] Updated weights for policy 0, policy_version 1905230 (0.0009) [2023-12-26 14:48:43,528][123090] Updated weights for policy 1, policy_version 1893255 (0.0010) [2023-12-26 14:48:43,588][123090] Updated weights for policy 1, policy_version 1893265 (0.0010) [2023-12-26 14:48:43,651][123090] Updated weights for policy 1, policy_version 1893275 (0.0010) [2023-12-26 14:48:43,728][123091] Updated weights for policy 0, policy_version 1905241 (0.0008) [2023-12-26 14:48:43,777][123091] Updated weights for policy 0, policy_version 1905251 (0.0009) [2023-12-26 14:48:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 972423168. Throughput: 0: 8754.3, 1: 8993.4. Samples: 972418380. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:48:43,784][121949] Avg episode reward: [(0, '6114.146'), (1, '5869.686')] [2023-12-26 14:48:43,837][123091] Updated weights for policy 0, policy_version 1905261 (0.0010) [2023-12-26 14:48:44,483][123090] Updated weights for policy 1, policy_version 1893285 (0.0010) [2023-12-26 14:48:44,532][123090] Updated weights for policy 1, policy_version 1893295 (0.0009) [2023-12-26 14:48:44,595][123090] Updated weights for policy 1, policy_version 1893305 (0.0009) [2023-12-26 14:48:44,646][123091] Updated weights for policy 0, policy_version 1905271 (0.0009) [2023-12-26 14:48:44,706][123091] Updated weights for policy 0, policy_version 1905281 (0.0009) [2023-12-26 14:48:44,781][123091] Updated weights for policy 0, policy_version 1905291 (0.0009) [2023-12-26 14:48:45,418][123090] Updated weights for policy 1, policy_version 1893315 (0.0009) [2023-12-26 14:48:45,471][123090] Updated weights for policy 1, policy_version 1893325 (0.0009) [2023-12-26 14:48:45,531][123090] Updated weights for policy 1, policy_version 1893335 (0.0008) [2023-12-26 14:48:45,632][123091] Updated weights for policy 0, policy_version 1905301 (0.0010) [2023-12-26 14:48:45,698][123091] Updated weights for policy 0, policy_version 1905311 (0.0009) [2023-12-26 14:48:45,766][123091] Updated weights for policy 0, policy_version 1905321 (0.0010) [2023-12-26 14:48:46,349][123090] Updated weights for policy 1, policy_version 1893345 (0.0006) [2023-12-26 14:48:46,402][123090] Updated weights for policy 1, policy_version 1893355 (0.0009) [2023-12-26 14:48:46,473][123090] Updated weights for policy 1, policy_version 1893365 (0.0009) [2023-12-26 14:48:46,539][123090] Updated weights for policy 1, policy_version 1893375 (0.0009) [2023-12-26 14:48:46,586][123091] Updated weights for policy 0, policy_version 1905331 (0.0010) [2023-12-26 14:48:46,654][123091] Updated weights for policy 0, policy_version 1905341 (0.0010) [2023-12-26 14:48:46,722][123091] Updated weights for policy 0, policy_version 1905351 (0.0010) [2023-12-26 14:48:47,112][123090] Updated weights for policy 1, policy_version 1893385 (0.0005) [2023-12-26 14:48:47,174][123090] Updated weights for policy 1, policy_version 1893395 (0.0005) [2023-12-26 14:48:47,234][123090] Updated weights for policy 1, policy_version 1893405 (0.0009) [2023-12-26 14:48:47,617][123091] Updated weights for policy 0, policy_version 1905361 (0.0009) [2023-12-26 14:48:47,677][123091] Updated weights for policy 0, policy_version 1905371 (0.0010) [2023-12-26 14:48:47,732][123091] Updated weights for policy 0, policy_version 1905381 (0.0008) [2023-12-26 14:48:47,792][123091] Updated weights for policy 0, policy_version 1905391 (0.0008) [2023-12-26 14:48:47,911][123090] Updated weights for policy 1, policy_version 1893415 (0.0010) [2023-12-26 14:48:47,960][123090] Updated weights for policy 1, policy_version 1893425 (0.0009) [2023-12-26 14:48:48,009][123090] Updated weights for policy 1, policy_version 1893435 (0.0009) [2023-12-26 14:48:48,586][123091] Updated weights for policy 0, policy_version 1905401 (0.0010) [2023-12-26 14:48:48,650][123091] Updated weights for policy 0, policy_version 1905411 (0.0010) [2023-12-26 14:48:48,724][123091] Updated weights for policy 0, policy_version 1905421 (0.0011) [2023-12-26 14:48:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 972513280. Throughput: 0: 8763.0, 1: 8998.7. Samples: 972522492. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:48:48,785][121949] Avg episode reward: [(0, '6126.915'), (1, '5854.777')] [2023-12-26 14:48:48,845][123090] Updated weights for policy 1, policy_version 1893445 (0.0009) [2023-12-26 14:48:48,913][123090] Updated weights for policy 1, policy_version 1893455 (0.0009) [2023-12-26 14:48:48,984][123090] Updated weights for policy 1, policy_version 1893465 (0.0006) [2023-12-26 14:48:49,546][123091] Updated weights for policy 0, policy_version 1905431 (0.0010) [2023-12-26 14:48:49,610][123091] Updated weights for policy 0, policy_version 1905441 (0.0010) [2023-12-26 14:48:49,680][123091] Updated weights for policy 0, policy_version 1905451 (0.0011) [2023-12-26 14:48:49,774][123090] Updated weights for policy 1, policy_version 1893475 (0.0009) [2023-12-26 14:48:49,837][123090] Updated weights for policy 1, policy_version 1893485 (0.0007) [2023-12-26 14:48:49,894][123090] Updated weights for policy 1, policy_version 1893495 (0.0009) [2023-12-26 14:48:50,477][123091] Updated weights for policy 0, policy_version 1905461 (0.0008) [2023-12-26 14:48:50,547][123091] Updated weights for policy 0, policy_version 1905471 (0.0005) [2023-12-26 14:48:50,618][123091] Updated weights for policy 0, policy_version 1905481 (0.0009) [2023-12-26 14:48:50,650][123090] Updated weights for policy 1, policy_version 1893505 (0.0009) [2023-12-26 14:48:50,722][123090] Updated weights for policy 1, policy_version 1893515 (0.0008) [2023-12-26 14:48:50,796][123090] Updated weights for policy 1, policy_version 1893525 (0.0009) [2023-12-26 14:48:50,870][123090] Updated weights for policy 1, policy_version 1893535 (0.0009) [2023-12-26 14:48:51,395][123091] Updated weights for policy 0, policy_version 1905491 (0.0009) [2023-12-26 14:48:51,457][123091] Updated weights for policy 0, policy_version 1905501 (0.0005) [2023-12-26 14:48:51,509][123091] Updated weights for policy 0, policy_version 1905511 (0.0005) [2023-12-26 14:48:51,783][123090] Updated weights for policy 1, policy_version 1893545 (0.0007) [2023-12-26 14:48:51,847][123090] Updated weights for policy 1, policy_version 1893555 (0.0006) [2023-12-26 14:48:51,904][123090] Updated weights for policy 1, policy_version 1893565 (0.0006) [2023-12-26 14:48:52,233][123091] Updated weights for policy 0, policy_version 1905521 (0.0007) [2023-12-26 14:48:52,301][123091] Updated weights for policy 0, policy_version 1905531 (0.0008) [2023-12-26 14:48:52,364][123091] Updated weights for policy 0, policy_version 1905541 (0.0008) [2023-12-26 14:48:52,437][123091] Updated weights for policy 0, policy_version 1905551 (0.0008) [2023-12-26 14:48:52,628][123090] Updated weights for policy 1, policy_version 1893575 (0.0005) [2023-12-26 14:48:52,676][123090] Updated weights for policy 1, policy_version 1893585 (0.0005) [2023-12-26 14:48:52,744][123090] Updated weights for policy 1, policy_version 1893595 (0.0008) [2023-12-26 14:48:53,206][123091] Updated weights for policy 0, policy_version 1905561 (0.0008) [2023-12-26 14:48:53,254][123091] Updated weights for policy 0, policy_version 1905571 (0.0008) [2023-12-26 14:48:53,309][123091] Updated weights for policy 0, policy_version 1905581 (0.0008) [2023-12-26 14:48:53,520][123090] Updated weights for policy 1, policy_version 1893605 (0.0009) [2023-12-26 14:48:53,578][123090] Updated weights for policy 1, policy_version 1893615 (0.0010) [2023-12-26 14:48:53,649][123090] Updated weights for policy 1, policy_version 1893625 (0.0010) [2023-12-26 14:48:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 972603392. Throughput: 0: 8751.9, 1: 8966.4. Samples: 972575108. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:48:53,785][121949] Avg episode reward: [(0, '6220.967'), (1, '5926.774')] [2023-12-26 14:48:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001905584_487833600.pth... [2023-12-26 14:48:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001893632_484769792.pth... [2023-12-26 14:48:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001904560_487571456.pth [2023-12-26 14:48:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001892608_484507648.pth [2023-12-26 14:48:54,074][123091] Updated weights for policy 0, policy_version 1905591 (0.0009) [2023-12-26 14:48:54,136][123091] Updated weights for policy 0, policy_version 1905601 (0.0009) [2023-12-26 14:48:54,197][123091] Updated weights for policy 0, policy_version 1905611 (0.0010) [2023-12-26 14:48:54,491][123090] Updated weights for policy 1, policy_version 1893635 (0.0009) [2023-12-26 14:48:54,551][123090] Updated weights for policy 1, policy_version 1893645 (0.0009) [2023-12-26 14:48:54,618][123090] Updated weights for policy 1, policy_version 1893656 (0.0009) [2023-12-26 14:48:54,993][123091] Updated weights for policy 0, policy_version 1905621 (0.0010) [2023-12-26 14:48:55,045][123091] Updated weights for policy 0, policy_version 1905631 (0.0010) [2023-12-26 14:48:55,094][123091] Updated weights for policy 0, policy_version 1905641 (0.0010) [2023-12-26 14:48:55,449][123090] Updated weights for policy 1, policy_version 1893666 (0.0007) [2023-12-26 14:48:55,522][123090] Updated weights for policy 1, policy_version 1893676 (0.0011) [2023-12-26 14:48:55,591][123090] Updated weights for policy 1, policy_version 1893686 (0.0010) [2023-12-26 14:48:55,654][123090] Updated weights for policy 1, policy_version 1893696 (0.0010) [2023-12-26 14:48:55,933][123091] Updated weights for policy 0, policy_version 1905651 (0.0010) [2023-12-26 14:48:55,987][123091] Updated weights for policy 0, policy_version 1905661 (0.0005) [2023-12-26 14:48:56,039][123091] Updated weights for policy 0, policy_version 1905671 (0.0006) [2023-12-26 14:48:56,452][123090] Updated weights for policy 1, policy_version 1893706 (0.0010) [2023-12-26 14:48:56,518][123090] Updated weights for policy 1, policy_version 1893716 (0.0010) [2023-12-26 14:48:56,579][123090] Updated weights for policy 1, policy_version 1893726 (0.0010) [2023-12-26 14:48:56,805][123091] Updated weights for policy 0, policy_version 1905681 (0.0006) [2023-12-26 14:48:56,860][123091] Updated weights for policy 0, policy_version 1905691 (0.0010) [2023-12-26 14:48:56,904][123091] Updated weights for policy 0, policy_version 1905701 (0.0010) [2023-12-26 14:48:56,951][123091] Updated weights for policy 0, policy_version 1905711 (0.0010) [2023-12-26 14:48:57,341][123090] Updated weights for policy 1, policy_version 1893736 (0.0008) [2023-12-26 14:48:57,388][123090] Updated weights for policy 1, policy_version 1893746 (0.0005) [2023-12-26 14:48:57,442][123090] Updated weights for policy 1, policy_version 1893756 (0.0005) [2023-12-26 14:48:57,803][123091] Updated weights for policy 0, policy_version 1905721 (0.0010) [2023-12-26 14:48:57,854][123091] Updated weights for policy 0, policy_version 1905731 (0.0010) [2023-12-26 14:48:57,898][123091] Updated weights for policy 0, policy_version 1905741 (0.0010) [2023-12-26 14:48:58,098][123090] Updated weights for policy 1, policy_version 1893766 (0.0008) [2023-12-26 14:48:58,175][123090] Updated weights for policy 1, policy_version 1893776 (0.0008) [2023-12-26 14:48:58,239][123090] Updated weights for policy 1, policy_version 1893786 (0.0011) [2023-12-26 14:48:58,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 972685312. Throughput: 0: 8852.0, 1: 8908.8. Samples: 972682968. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:48:58,785][121949] Avg episode reward: [(0, '6326.431'), (1, '5876.483')] [2023-12-26 14:48:58,792][123091] Updated weights for policy 0, policy_version 1905751 (0.0008) [2023-12-26 14:48:58,879][123091] Updated weights for policy 0, policy_version 1905762 (0.0011) [2023-12-26 14:48:58,959][123091] Updated weights for policy 0, policy_version 1905772 (0.0010) [2023-12-26 14:48:59,073][123090] Updated weights for policy 1, policy_version 1893796 (0.0009) [2023-12-26 14:48:59,134][123090] Updated weights for policy 1, policy_version 1893806 (0.0008) [2023-12-26 14:48:59,184][123090] Updated weights for policy 1, policy_version 1893816 (0.0007) [2023-12-26 14:48:59,757][123091] Updated weights for policy 0, policy_version 1905782 (0.0008) [2023-12-26 14:48:59,827][123091] Updated weights for policy 0, policy_version 1905792 (0.0007) [2023-12-26 14:48:59,900][123091] Updated weights for policy 0, policy_version 1905802 (0.0006) [2023-12-26 14:49:00,128][123090] Updated weights for policy 1, policy_version 1893826 (0.0008) [2023-12-26 14:49:00,182][123090] Updated weights for policy 1, policy_version 1893836 (0.0009) [2023-12-26 14:49:00,241][123090] Updated weights for policy 1, policy_version 1893846 (0.0009) [2023-12-26 14:49:00,304][123090] Updated weights for policy 1, policy_version 1893856 (0.0010) [2023-12-26 14:49:00,506][123091] Updated weights for policy 0, policy_version 1905812 (0.0006) [2023-12-26 14:49:00,568][123091] Updated weights for policy 0, policy_version 1905822 (0.0005) [2023-12-26 14:49:00,629][123091] Updated weights for policy 0, policy_version 1905832 (0.0005) [2023-12-26 14:49:01,242][123090] Updated weights for policy 1, policy_version 1893866 (0.0009) [2023-12-26 14:49:01,307][123090] Updated weights for policy 1, policy_version 1893876 (0.0009) [2023-12-26 14:49:01,334][123091] Updated weights for policy 0, policy_version 1905842 (0.0006) [2023-12-26 14:49:01,371][123090] Updated weights for policy 1, policy_version 1893886 (0.0009) [2023-12-26 14:49:01,399][123091] Updated weights for policy 0, policy_version 1905852 (0.0011) [2023-12-26 14:49:01,455][123091] Updated weights for policy 0, policy_version 1905862 (0.0010) [2023-12-26 14:49:01,502][123091] Updated weights for policy 0, policy_version 1905872 (0.0010) [2023-12-26 14:49:02,151][123090] Updated weights for policy 1, policy_version 1893896 (0.0008) [2023-12-26 14:49:02,217][123090] Updated weights for policy 1, policy_version 1893906 (0.0008) [2023-12-26 14:49:02,252][123091] Updated weights for policy 0, policy_version 1905882 (0.0007) [2023-12-26 14:49:02,281][123090] Updated weights for policy 1, policy_version 1893916 (0.0008) [2023-12-26 14:49:02,315][123091] Updated weights for policy 0, policy_version 1905892 (0.0011) [2023-12-26 14:49:02,385][123091] Updated weights for policy 0, policy_version 1905902 (0.0011) [2023-12-26 14:49:02,944][123090] Updated weights for policy 1, policy_version 1893926 (0.0009) [2023-12-26 14:49:02,988][123090] Updated weights for policy 1, policy_version 1893936 (0.0010) [2023-12-26 14:49:03,039][123090] Updated weights for policy 1, policy_version 1893946 (0.0010) [2023-12-26 14:49:03,175][123091] Updated weights for policy 0, policy_version 1905912 (0.0006) [2023-12-26 14:49:03,233][123091] Updated weights for policy 0, policy_version 1905922 (0.0005) [2023-12-26 14:49:03,309][123091] Updated weights for policy 0, policy_version 1905932 (0.0005) [2023-12-26 14:49:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 972775424. Throughput: 0: 8935.3, 1: 8805.6. Samples: 972790792. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:03,785][121949] Avg episode reward: [(0, '6381.701'), (1, '5841.108')] [2023-12-26 14:49:03,804][123090] Updated weights for policy 1, policy_version 1893956 (0.0009) [2023-12-26 14:49:03,869][123090] Updated weights for policy 1, policy_version 1893966 (0.0008) [2023-12-26 14:49:03,939][123090] Updated weights for policy 1, policy_version 1893976 (0.0009) [2023-12-26 14:49:03,965][123091] Updated weights for policy 0, policy_version 1905942 (0.0008) [2023-12-26 14:49:04,028][123091] Updated weights for policy 0, policy_version 1905952 (0.0011) [2023-12-26 14:49:04,090][123091] Updated weights for policy 0, policy_version 1905962 (0.0010) [2023-12-26 14:49:04,705][123090] Updated weights for policy 1, policy_version 1893986 (0.0009) [2023-12-26 14:49:04,770][123090] Updated weights for policy 1, policy_version 1893996 (0.0005) [2023-12-26 14:49:04,836][123090] Updated weights for policy 1, policy_version 1894006 (0.0005) [2023-12-26 14:49:04,891][123091] Updated weights for policy 0, policy_version 1905972 (0.0009) [2023-12-26 14:49:04,896][123090] Updated weights for policy 1, policy_version 1894016 (0.0005) [2023-12-26 14:49:04,959][123091] Updated weights for policy 0, policy_version 1905982 (0.0009) [2023-12-26 14:49:05,021][123091] Updated weights for policy 0, policy_version 1905992 (0.0010) [2023-12-26 14:49:05,582][123090] Updated weights for policy 1, policy_version 1894026 (0.0005) [2023-12-26 14:49:05,641][123090] Updated weights for policy 1, policy_version 1894036 (0.0006) [2023-12-26 14:49:05,697][123090] Updated weights for policy 1, policy_version 1894046 (0.0005) [2023-12-26 14:49:05,753][123091] Updated weights for policy 0, policy_version 1906002 (0.0009) [2023-12-26 14:49:05,814][123091] Updated weights for policy 0, policy_version 1906012 (0.0006) [2023-12-26 14:49:05,872][123091] Updated weights for policy 0, policy_version 1906022 (0.0007) [2023-12-26 14:49:05,930][123091] Updated weights for policy 0, policy_version 1906032 (0.0006) [2023-12-26 14:49:06,470][123090] Updated weights for policy 1, policy_version 1894056 (0.0009) [2023-12-26 14:49:06,524][123090] Updated weights for policy 1, policy_version 1894066 (0.0010) [2023-12-26 14:49:06,582][123090] Updated weights for policy 1, policy_version 1894076 (0.0009) [2023-12-26 14:49:06,628][123091] Updated weights for policy 0, policy_version 1906042 (0.0007) [2023-12-26 14:49:06,699][123091] Updated weights for policy 0, policy_version 1906052 (0.0006) [2023-12-26 14:49:06,769][123091] Updated weights for policy 0, policy_version 1906062 (0.0008) [2023-12-26 14:49:07,428][123091] Updated weights for policy 0, policy_version 1906072 (0.0005) [2023-12-26 14:49:07,495][123091] Updated weights for policy 0, policy_version 1906082 (0.0005) [2023-12-26 14:49:07,538][123090] Updated weights for policy 1, policy_version 1894086 (0.0008) [2023-12-26 14:49:07,567][123091] Updated weights for policy 0, policy_version 1906092 (0.0007) [2023-12-26 14:49:07,593][123090] Updated weights for policy 1, policy_version 1894096 (0.0007) [2023-12-26 14:49:07,658][123090] Updated weights for policy 1, policy_version 1894106 (0.0008) [2023-12-26 14:49:08,246][123091] Updated weights for policy 0, policy_version 1906102 (0.0006) [2023-12-26 14:49:08,316][123091] Updated weights for policy 0, policy_version 1906112 (0.0005) [2023-12-26 14:49:08,388][123091] Updated weights for policy 0, policy_version 1906122 (0.0008) [2023-12-26 14:49:08,441][123090] Updated weights for policy 1, policy_version 1894116 (0.0009) [2023-12-26 14:49:08,492][123090] Updated weights for policy 1, policy_version 1894126 (0.0008) [2023-12-26 14:49:08,558][123090] Updated weights for policy 1, policy_version 1894136 (0.0005) [2023-12-26 14:49:08,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 972873728. Throughput: 0: 8987.1, 1: 8821.7. Samples: 972847316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:08,785][121949] Avg episode reward: [(0, '6250.980'), (1, '5652.753')] [2023-12-26 14:49:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001906128_487972864.pth... [2023-12-26 14:49:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001894144_484900864.pth... [2023-12-26 14:49:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001893120_484638720.pth [2023-12-26 14:49:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001905072_487702528.pth [2023-12-26 14:49:09,123][123091] Updated weights for policy 0, policy_version 1906132 (0.0009) [2023-12-26 14:49:09,181][123091] Updated weights for policy 0, policy_version 1906142 (0.0009) [2023-12-26 14:49:09,233][123090] Updated weights for policy 1, policy_version 1894146 (0.0006) [2023-12-26 14:49:09,249][123091] Updated weights for policy 0, policy_version 1906152 (0.0008) [2023-12-26 14:49:09,301][123090] Updated weights for policy 1, policy_version 1894156 (0.0008) [2023-12-26 14:49:09,368][123090] Updated weights for policy 1, policy_version 1894166 (0.0010) [2023-12-26 14:49:09,443][123090] Updated weights for policy 1, policy_version 1894176 (0.0010) [2023-12-26 14:49:10,078][123091] Updated weights for policy 0, policy_version 1906162 (0.0009) [2023-12-26 14:49:10,141][123091] Updated weights for policy 0, policy_version 1906172 (0.0010) [2023-12-26 14:49:10,205][123091] Updated weights for policy 0, policy_version 1906182 (0.0009) [2023-12-26 14:49:10,264][123091] Updated weights for policy 0, policy_version 1906192 (0.0007) [2023-12-26 14:49:10,280][123090] Updated weights for policy 1, policy_version 1894186 (0.0009) [2023-12-26 14:49:10,337][123090] Updated weights for policy 1, policy_version 1894196 (0.0010) [2023-12-26 14:49:10,389][123090] Updated weights for policy 1, policy_version 1894206 (0.0010) [2023-12-26 14:49:11,106][123091] Updated weights for policy 0, policy_version 1906202 (0.0009) [2023-12-26 14:49:11,171][123091] Updated weights for policy 0, policy_version 1906212 (0.0010) [2023-12-26 14:49:11,226][123091] Updated weights for policy 0, policy_version 1906222 (0.0010) [2023-12-26 14:49:11,286][123090] Updated weights for policy 1, policy_version 1894216 (0.0009) [2023-12-26 14:49:11,346][123090] Updated weights for policy 1, policy_version 1894226 (0.0010) [2023-12-26 14:49:11,426][123090] Updated weights for policy 1, policy_version 1894236 (0.0008) [2023-12-26 14:49:12,071][123091] Updated weights for policy 0, policy_version 1906232 (0.0007) [2023-12-26 14:49:12,131][123091] Updated weights for policy 0, policy_version 1906242 (0.0006) [2023-12-26 14:49:12,185][123090] Updated weights for policy 1, policy_version 1894246 (0.0008) [2023-12-26 14:49:12,189][123091] Updated weights for policy 0, policy_version 1906252 (0.0006) [2023-12-26 14:49:12,241][123090] Updated weights for policy 1, policy_version 1894256 (0.0008) [2023-12-26 14:49:12,315][123090] Updated weights for policy 1, policy_version 1894266 (0.0008) [2023-12-26 14:49:12,955][123091] Updated weights for policy 0, policy_version 1906262 (0.0009) [2023-12-26 14:49:13,008][123091] Updated weights for policy 0, policy_version 1906272 (0.0009) [2023-12-26 14:49:13,060][123091] Updated weights for policy 0, policy_version 1906282 (0.0011) [2023-12-26 14:49:13,152][123090] Updated weights for policy 1, policy_version 1894276 (0.0008) [2023-12-26 14:49:13,209][123090] Updated weights for policy 1, policy_version 1894286 (0.0009) [2023-12-26 14:49:13,274][123090] Updated weights for policy 1, policy_version 1894296 (0.0009) [2023-12-26 14:49:13,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 972955648. Throughput: 0: 8984.7, 1: 8816.4. Samples: 972952412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:13,785][121949] Avg episode reward: [(0, '6194.563'), (1, '5593.803')] [2023-12-26 14:49:13,915][123091] Updated weights for policy 0, policy_version 1906292 (0.0011) [2023-12-26 14:49:13,966][123091] Updated weights for policy 0, policy_version 1906302 (0.0011) [2023-12-26 14:49:14,018][123091] Updated weights for policy 0, policy_version 1906312 (0.0010) [2023-12-26 14:49:14,024][123090] Updated weights for policy 1, policy_version 1894306 (0.0009) [2023-12-26 14:49:14,090][123090] Updated weights for policy 1, policy_version 1894316 (0.0010) [2023-12-26 14:49:14,158][123090] Updated weights for policy 1, policy_version 1894326 (0.0011) [2023-12-26 14:49:14,216][123090] Updated weights for policy 1, policy_version 1894336 (0.0011) [2023-12-26 14:49:14,776][123091] Updated weights for policy 0, policy_version 1906322 (0.0024) [2023-12-26 14:49:14,836][123091] Updated weights for policy 0, policy_version 1906332 (0.0009) [2023-12-26 14:49:14,901][123091] Updated weights for policy 0, policy_version 1906342 (0.0009) [2023-12-26 14:49:14,961][123091] Updated weights for policy 0, policy_version 1906352 (0.0009) [2023-12-26 14:49:15,051][123090] Updated weights for policy 1, policy_version 1894346 (0.0011) [2023-12-26 14:49:15,119][123090] Updated weights for policy 1, policy_version 1894356 (0.0009) [2023-12-26 14:49:15,200][123090] Updated weights for policy 1, policy_version 1894366 (0.0006) [2023-12-26 14:49:15,744][123091] Updated weights for policy 0, policy_version 1906362 (0.0009) [2023-12-26 14:49:15,800][123091] Updated weights for policy 0, policy_version 1906372 (0.0009) [2023-12-26 14:49:15,859][123091] Updated weights for policy 0, policy_version 1906382 (0.0010) [2023-12-26 14:49:15,932][123090] Updated weights for policy 1, policy_version 1894376 (0.0006) [2023-12-26 14:49:15,978][123090] Updated weights for policy 1, policy_version 1894386 (0.0005) [2023-12-26 14:49:16,037][123090] Updated weights for policy 1, policy_version 1894396 (0.0005) [2023-12-26 14:49:16,686][123091] Updated weights for policy 0, policy_version 1906392 (0.0009) [2023-12-26 14:49:16,713][123090] Updated weights for policy 1, policy_version 1894406 (0.0009) [2023-12-26 14:49:16,746][123091] Updated weights for policy 0, policy_version 1906402 (0.0006) [2023-12-26 14:49:16,772][123090] Updated weights for policy 1, policy_version 1894416 (0.0010) [2023-12-26 14:49:16,797][123091] Updated weights for policy 0, policy_version 1906412 (0.0006) [2023-12-26 14:49:16,828][123090] Updated weights for policy 1, policy_version 1894426 (0.0010) [2023-12-26 14:49:17,561][123090] Updated weights for policy 1, policy_version 1894436 (0.0008) [2023-12-26 14:49:17,624][123090] Updated weights for policy 1, policy_version 1894446 (0.0008) [2023-12-26 14:49:17,665][123091] Updated weights for policy 0, policy_version 1906422 (0.0008) [2023-12-26 14:49:17,683][123090] Updated weights for policy 1, policy_version 1894456 (0.0007) [2023-12-26 14:49:17,719][123091] Updated weights for policy 0, policy_version 1906432 (0.0008) [2023-12-26 14:49:17,770][123091] Updated weights for policy 0, policy_version 1906442 (0.0008) [2023-12-26 14:49:18,435][123090] Updated weights for policy 1, policy_version 1894466 (0.0008) [2023-12-26 14:49:18,506][123090] Updated weights for policy 1, policy_version 1894476 (0.0005) [2023-12-26 14:49:18,580][123090] Updated weights for policy 1, policy_version 1894486 (0.0008) [2023-12-26 14:49:18,600][123091] Updated weights for policy 0, policy_version 1906452 (0.0007) [2023-12-26 14:49:18,648][123090] Updated weights for policy 1, policy_version 1894496 (0.0011) [2023-12-26 14:49:18,663][123091] Updated weights for policy 0, policy_version 1906462 (0.0011) [2023-12-26 14:49:18,725][123091] Updated weights for policy 0, policy_version 1906472 (0.0008) [2023-12-26 14:49:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17605.9). Total num frames: 973053952. Throughput: 0: 8947.3, 1: 8912.8. Samples: 973061216. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:18,785][121949] Avg episode reward: [(0, '6300.592'), (1, '5864.460')] [2023-12-26 14:49:19,446][123090] Updated weights for policy 1, policy_version 1894506 (0.0010) [2023-12-26 14:49:19,448][123091] Updated weights for policy 0, policy_version 1906482 (0.0010) [2023-12-26 14:49:19,518][123090] Updated weights for policy 1, policy_version 1894516 (0.0010) [2023-12-26 14:49:19,521][123091] Updated weights for policy 0, policy_version 1906492 (0.0008) [2023-12-26 14:49:19,584][123091] Updated weights for policy 0, policy_version 1906502 (0.0009) [2023-12-26 14:49:19,588][123090] Updated weights for policy 1, policy_version 1894526 (0.0006) [2023-12-26 14:49:19,656][123091] Updated weights for policy 0, policy_version 1906512 (0.0007) [2023-12-26 14:49:20,368][123091] Updated weights for policy 0, policy_version 1906522 (0.0006) [2023-12-26 14:49:20,405][123090] Updated weights for policy 1, policy_version 1894536 (0.0009) [2023-12-26 14:49:20,435][123091] Updated weights for policy 0, policy_version 1906532 (0.0006) [2023-12-26 14:49:20,467][123090] Updated weights for policy 1, policy_version 1894546 (0.0009) [2023-12-26 14:49:20,497][123091] Updated weights for policy 0, policy_version 1906542 (0.0009) [2023-12-26 14:49:20,518][123090] Updated weights for policy 1, policy_version 1894556 (0.0008) [2023-12-26 14:49:21,310][123091] Updated weights for policy 0, policy_version 1906552 (0.0010) [2023-12-26 14:49:21,377][123091] Updated weights for policy 0, policy_version 1906562 (0.0009) [2023-12-26 14:49:21,425][123090] Updated weights for policy 1, policy_version 1894566 (0.0008) [2023-12-26 14:49:21,450][123091] Updated weights for policy 0, policy_version 1906572 (0.0008) [2023-12-26 14:49:21,491][123090] Updated weights for policy 1, policy_version 1894576 (0.0010) [2023-12-26 14:49:21,549][123090] Updated weights for policy 1, policy_version 1894586 (0.0007) [2023-12-26 14:49:22,293][123091] Updated weights for policy 0, policy_version 1906582 (0.0008) [2023-12-26 14:49:22,361][123091] Updated weights for policy 0, policy_version 1906592 (0.0010) [2023-12-26 14:49:22,382][123090] Updated weights for policy 1, policy_version 1894596 (0.0009) [2023-12-26 14:49:22,424][123091] Updated weights for policy 0, policy_version 1906602 (0.0007) [2023-12-26 14:49:22,440][123090] Updated weights for policy 1, policy_version 1894606 (0.0010) [2023-12-26 14:49:22,505][123090] Updated weights for policy 1, policy_version 1894616 (0.0009) [2023-12-26 14:49:23,267][123091] Updated weights for policy 0, policy_version 1906612 (0.0009) [2023-12-26 14:49:23,325][123091] Updated weights for policy 0, policy_version 1906622 (0.0009) [2023-12-26 14:49:23,334][123090] Updated weights for policy 1, policy_version 1894626 (0.0009) [2023-12-26 14:49:23,383][123091] Updated weights for policy 0, policy_version 1906632 (0.0009) [2023-12-26 14:49:23,400][123090] Updated weights for policy 1, policy_version 1894636 (0.0008) [2023-12-26 14:49:23,470][123090] Updated weights for policy 1, policy_version 1894646 (0.0010) [2023-12-26 14:49:23,531][123090] Updated weights for policy 1, policy_version 1894656 (0.0009) [2023-12-26 14:49:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 973135872. Throughput: 0: 8933.2, 1: 8819.7. Samples: 973112196. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:23,785][121949] Avg episode reward: [(0, '6326.156'), (1, '6024.713')] [2023-12-26 14:49:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001894656_485031936.pth... [2023-12-26 14:49:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001906640_488103936.pth... [2023-12-26 14:49:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001905584_487833600.pth [2023-12-26 14:49:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001893632_484769792.pth [2023-12-26 14:49:24,246][123091] Updated weights for policy 0, policy_version 1906642 (0.0009) [2023-12-26 14:49:24,306][123091] Updated weights for policy 0, policy_version 1906652 (0.0008) [2023-12-26 14:49:24,308][123090] Updated weights for policy 1, policy_version 1894666 (0.0008) [2023-12-26 14:49:24,357][123091] Updated weights for policy 0, policy_version 1906662 (0.0009) [2023-12-26 14:49:24,367][123090] Updated weights for policy 1, policy_version 1894676 (0.0008) [2023-12-26 14:49:24,422][123091] Updated weights for policy 0, policy_version 1906672 (0.0008) [2023-12-26 14:49:24,436][123090] Updated weights for policy 1, policy_version 1894686 (0.0008) [2023-12-26 14:49:25,244][123090] Updated weights for policy 1, policy_version 1894696 (0.0008) [2023-12-26 14:49:25,270][123091] Updated weights for policy 0, policy_version 1906682 (0.0009) [2023-12-26 14:49:25,299][123090] Updated weights for policy 1, policy_version 1894706 (0.0008) [2023-12-26 14:49:25,339][123091] Updated weights for policy 0, policy_version 1906692 (0.0008) [2023-12-26 14:49:25,363][123090] Updated weights for policy 1, policy_version 1894716 (0.0005) [2023-12-26 14:49:25,412][123091] Updated weights for policy 0, policy_version 1906702 (0.0009) [2023-12-26 14:49:25,928][123090] Updated weights for policy 1, policy_version 1894726 (0.0005) [2023-12-26 14:49:25,987][123090] Updated weights for policy 1, policy_version 1894736 (0.0005) [2023-12-26 14:49:26,054][123090] Updated weights for policy 1, policy_version 1894746 (0.0005) [2023-12-26 14:49:26,284][123091] Updated weights for policy 0, policy_version 1906712 (0.0010) [2023-12-26 14:49:26,344][123091] Updated weights for policy 0, policy_version 1906722 (0.0008) [2023-12-26 14:49:26,401][123091] Updated weights for policy 0, policy_version 1906732 (0.0006) [2023-12-26 14:49:26,831][123090] Updated weights for policy 1, policy_version 1894756 (0.0006) [2023-12-26 14:49:26,898][123090] Updated weights for policy 1, policy_version 1894766 (0.0008) [2023-12-26 14:49:26,968][123090] Updated weights for policy 1, policy_version 1894776 (0.0005) [2023-12-26 14:49:27,112][123091] Updated weights for policy 0, policy_version 1906742 (0.0005) [2023-12-26 14:49:27,187][123091] Updated weights for policy 0, policy_version 1906752 (0.0005) [2023-12-26 14:49:27,243][123091] Updated weights for policy 0, policy_version 1906762 (0.0007) [2023-12-26 14:49:27,662][123090] Updated weights for policy 1, policy_version 1894786 (0.0006) [2023-12-26 14:49:27,721][123090] Updated weights for policy 1, policy_version 1894796 (0.0010) [2023-12-26 14:49:27,783][123090] Updated weights for policy 1, policy_version 1894806 (0.0010) [2023-12-26 14:49:27,841][123090] Updated weights for policy 1, policy_version 1894816 (0.0010) [2023-12-26 14:49:27,908][123091] Updated weights for policy 0, policy_version 1906772 (0.0009) [2023-12-26 14:49:27,962][123091] Updated weights for policy 0, policy_version 1906782 (0.0010) [2023-12-26 14:49:28,015][123091] Updated weights for policy 0, policy_version 1906792 (0.0009) [2023-12-26 14:49:28,641][123090] Updated weights for policy 1, policy_version 1894826 (0.0009) [2023-12-26 14:49:28,696][123090] Updated weights for policy 1, policy_version 1894836 (0.0008) [2023-12-26 14:49:28,752][123090] Updated weights for policy 1, policy_version 1894846 (0.0009) [2023-12-26 14:49:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17605.9). Total num frames: 973225984. Throughput: 0: 8909.1, 1: 8878.1. Samples: 973218808. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:28,785][121949] Avg episode reward: [(0, '6310.473'), (1, '5844.669')] [2023-12-26 14:49:28,823][123091] Updated weights for policy 0, policy_version 1906802 (0.0010) [2023-12-26 14:49:28,875][123091] Updated weights for policy 0, policy_version 1906812 (0.0010) [2023-12-26 14:49:28,931][123091] Updated weights for policy 0, policy_version 1906822 (0.0010) [2023-12-26 14:49:28,986][123091] Updated weights for policy 0, policy_version 1906832 (0.0010) [2023-12-26 14:49:29,592][123090] Updated weights for policy 1, policy_version 1894856 (0.0009) [2023-12-26 14:49:29,649][123090] Updated weights for policy 1, policy_version 1894866 (0.0009) [2023-12-26 14:49:29,710][123090] Updated weights for policy 1, policy_version 1894876 (0.0009) [2023-12-26 14:49:29,844][123091] Updated weights for policy 0, policy_version 1906842 (0.0010) [2023-12-26 14:49:29,912][123091] Updated weights for policy 0, policy_version 1906852 (0.0007) [2023-12-26 14:49:29,990][123091] Updated weights for policy 0, policy_version 1906862 (0.0010) [2023-12-26 14:49:30,550][123090] Updated weights for policy 1, policy_version 1894886 (0.0007) [2023-12-26 14:49:30,623][123090] Updated weights for policy 1, policy_version 1894896 (0.0007) [2023-12-26 14:49:30,683][123090] Updated weights for policy 1, policy_version 1894906 (0.0005) [2023-12-26 14:49:30,817][123091] Updated weights for policy 0, policy_version 1906872 (0.0006) [2023-12-26 14:49:30,871][123091] Updated weights for policy 0, policy_version 1906882 (0.0005) [2023-12-26 14:49:30,930][123091] Updated weights for policy 0, policy_version 1906892 (0.0005) [2023-12-26 14:49:31,500][123090] Updated weights for policy 1, policy_version 1894916 (0.0007) [2023-12-26 14:49:31,555][123090] Updated weights for policy 1, policy_version 1894926 (0.0009) [2023-12-26 14:49:31,618][123090] Updated weights for policy 1, policy_version 1894936 (0.0008) [2023-12-26 14:49:31,619][123091] Updated weights for policy 0, policy_version 1906902 (0.0009) [2023-12-26 14:49:31,683][123091] Updated weights for policy 0, policy_version 1906912 (0.0010) [2023-12-26 14:49:31,748][123091] Updated weights for policy 0, policy_version 1906922 (0.0011) [2023-12-26 14:49:32,466][123091] Updated weights for policy 0, policy_version 1906932 (0.0009) [2023-12-26 14:49:32,494][123090] Updated weights for policy 1, policy_version 1894946 (0.0007) [2023-12-26 14:49:32,523][123091] Updated weights for policy 0, policy_version 1906942 (0.0010) [2023-12-26 14:49:32,557][123090] Updated weights for policy 1, policy_version 1894956 (0.0007) [2023-12-26 14:49:32,577][123091] Updated weights for policy 0, policy_version 1906952 (0.0007) [2023-12-26 14:49:32,611][123090] Updated weights for policy 1, policy_version 1894966 (0.0008) [2023-12-26 14:49:32,660][123090] Updated weights for policy 1, policy_version 1894976 (0.0009) [2023-12-26 14:49:33,283][123091] Updated weights for policy 0, policy_version 1906962 (0.0008) [2023-12-26 14:49:33,353][123091] Updated weights for policy 0, policy_version 1906972 (0.0005) [2023-12-26 14:49:33,418][123091] Updated weights for policy 0, policy_version 1906982 (0.0005) [2023-12-26 14:49:33,482][123091] Updated weights for policy 0, policy_version 1906992 (0.0006) [2023-12-26 14:49:33,535][123090] Updated weights for policy 1, policy_version 1894986 (0.0008) [2023-12-26 14:49:33,587][123090] Updated weights for policy 1, policy_version 1894996 (0.0009) [2023-12-26 14:49:33,648][123090] Updated weights for policy 1, policy_version 1895007 (0.0008) [2023-12-26 14:49:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 973316096. Throughput: 0: 8998.3, 1: 8816.7. Samples: 973324168. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:33,785][121949] Avg episode reward: [(0, '6364.820'), (1, '5845.103')] [2023-12-26 14:49:34,093][123091] Updated weights for policy 0, policy_version 1907002 (0.0005) [2023-12-26 14:49:34,151][123091] Updated weights for policy 0, policy_version 1907012 (0.0006) [2023-12-26 14:49:34,210][123091] Updated weights for policy 0, policy_version 1907022 (0.0006) [2023-12-26 14:49:34,578][123090] Updated weights for policy 1, policy_version 1895017 (0.0010) [2023-12-26 14:49:34,650][123090] Updated weights for policy 1, policy_version 1895027 (0.0007) [2023-12-26 14:49:34,707][123090] Updated weights for policy 1, policy_version 1895037 (0.0006) [2023-12-26 14:49:34,908][123091] Updated weights for policy 0, policy_version 1907032 (0.0006) [2023-12-26 14:49:34,976][123091] Updated weights for policy 0, policy_version 1907042 (0.0006) [2023-12-26 14:49:35,037][123091] Updated weights for policy 0, policy_version 1907052 (0.0006) [2023-12-26 14:49:35,375][123090] Updated weights for policy 1, policy_version 1895047 (0.0005) [2023-12-26 14:49:35,432][123090] Updated weights for policy 1, policy_version 1895057 (0.0005) [2023-12-26 14:49:35,493][123090] Updated weights for policy 1, policy_version 1895067 (0.0008) [2023-12-26 14:49:35,743][123091] Updated weights for policy 0, policy_version 1907062 (0.0006) [2023-12-26 14:49:35,794][123091] Updated weights for policy 0, policy_version 1907072 (0.0005) [2023-12-26 14:49:35,852][123091] Updated weights for policy 0, policy_version 1907082 (0.0006) [2023-12-26 14:49:36,219][123090] Updated weights for policy 1, policy_version 1895077 (0.0010) [2023-12-26 14:49:36,283][123090] Updated weights for policy 1, policy_version 1895087 (0.0010) [2023-12-26 14:49:36,347][123090] Updated weights for policy 1, policy_version 1895097 (0.0010) [2023-12-26 14:49:36,461][123091] Updated weights for policy 0, policy_version 1907092 (0.0008) [2023-12-26 14:49:36,510][123091] Updated weights for policy 0, policy_version 1907102 (0.0011) [2023-12-26 14:49:36,574][123091] Updated weights for policy 0, policy_version 1907112 (0.0011) [2023-12-26 14:49:37,205][123090] Updated weights for policy 1, policy_version 1895107 (0.0008) [2023-12-26 14:49:37,266][123090] Updated weights for policy 1, policy_version 1895117 (0.0010) [2023-12-26 14:49:37,320][123090] Updated weights for policy 1, policy_version 1895127 (0.0010) [2023-12-26 14:49:37,381][123091] Updated weights for policy 0, policy_version 1907122 (0.0010) [2023-12-26 14:49:37,433][123091] Updated weights for policy 0, policy_version 1907132 (0.0005) [2023-12-26 14:49:37,499][123091] Updated weights for policy 0, policy_version 1907142 (0.0005) [2023-12-26 14:49:37,568][123091] Updated weights for policy 0, policy_version 1907152 (0.0005) [2023-12-26 14:49:38,207][123090] Updated weights for policy 1, policy_version 1895137 (0.0009) [2023-12-26 14:49:38,272][123091] Updated weights for policy 0, policy_version 1907162 (0.0007) [2023-12-26 14:49:38,277][123090] Updated weights for policy 1, policy_version 1895147 (0.0009) [2023-12-26 14:49:38,332][123091] Updated weights for policy 0, policy_version 1907172 (0.0006) [2023-12-26 14:49:38,346][123090] Updated weights for policy 1, policy_version 1895157 (0.0009) [2023-12-26 14:49:38,402][123091] Updated weights for policy 0, policy_version 1907182 (0.0008) [2023-12-26 14:49:38,417][123090] Updated weights for policy 1, policy_version 1895167 (0.0008) [2023-12-26 14:49:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17633.6). Total num frames: 973406208. Throughput: 0: 9081.0, 1: 8831.3. Samples: 973381160. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:38,785][121949] Avg episode reward: [(0, '6255.326'), (1, '5907.615')] [2023-12-26 14:49:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001907184_488243200.pth... [2023-12-26 14:49:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001895168_485163008.pth... [2023-12-26 14:49:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001906128_487972864.pth [2023-12-26 14:49:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001894144_484900864.pth [2023-12-26 14:49:39,106][123091] Updated weights for policy 0, policy_version 1907192 (0.0010) [2023-12-26 14:49:39,162][123091] Updated weights for policy 0, policy_version 1907202 (0.0011) [2023-12-26 14:49:39,174][123090] Updated weights for policy 1, policy_version 1895177 (0.0008) [2023-12-26 14:49:39,210][123091] Updated weights for policy 0, policy_version 1907212 (0.0010) [2023-12-26 14:49:39,232][123090] Updated weights for policy 1, policy_version 1895187 (0.0007) [2023-12-26 14:49:39,295][123090] Updated weights for policy 1, policy_version 1895197 (0.0009) [2023-12-26 14:49:40,075][123091] Updated weights for policy 0, policy_version 1907222 (0.0011) [2023-12-26 14:49:40,131][123090] Updated weights for policy 1, policy_version 1895207 (0.0009) [2023-12-26 14:49:40,143][123091] Updated weights for policy 0, policy_version 1907232 (0.0009) [2023-12-26 14:49:40,196][123090] Updated weights for policy 1, policy_version 1895217 (0.0010) [2023-12-26 14:49:40,196][123091] Updated weights for policy 0, policy_version 1907242 (0.0007) [2023-12-26 14:49:40,260][123090] Updated weights for policy 1, policy_version 1895227 (0.0010) [2023-12-26 14:49:41,043][123090] Updated weights for policy 1, policy_version 1895237 (0.0009) [2023-12-26 14:49:41,051][123091] Updated weights for policy 0, policy_version 1907252 (0.0009) [2023-12-26 14:49:41,113][123090] Updated weights for policy 1, policy_version 1895247 (0.0011) [2023-12-26 14:49:41,125][123091] Updated weights for policy 0, policy_version 1907262 (0.0007) [2023-12-26 14:49:41,184][123090] Updated weights for policy 1, policy_version 1895257 (0.0011) [2023-12-26 14:49:41,201][123091] Updated weights for policy 0, policy_version 1907272 (0.0009) [2023-12-26 14:49:42,003][123090] Updated weights for policy 1, policy_version 1895267 (0.0010) [2023-12-26 14:49:42,064][123090] Updated weights for policy 1, policy_version 1895277 (0.0006) [2023-12-26 14:49:42,093][123091] Updated weights for policy 0, policy_version 1907282 (0.0008) [2023-12-26 14:49:42,128][123090] Updated weights for policy 1, policy_version 1895287 (0.0006) [2023-12-26 14:49:42,155][123091] Updated weights for policy 0, policy_version 1907292 (0.0007) [2023-12-26 14:49:42,218][123091] Updated weights for policy 0, policy_version 1907302 (0.0008) [2023-12-26 14:49:42,283][123091] Updated weights for policy 0, policy_version 1907312 (0.0011) [2023-12-26 14:49:42,950][123090] Updated weights for policy 1, policy_version 1895297 (0.0008) [2023-12-26 14:49:43,024][123090] Updated weights for policy 1, policy_version 1895307 (0.0009) [2023-12-26 14:49:43,087][123090] Updated weights for policy 1, policy_version 1895317 (0.0009) [2023-12-26 14:49:43,132][123091] Updated weights for policy 0, policy_version 1907322 (0.0005) [2023-12-26 14:49:43,152][123090] Updated weights for policy 1, policy_version 1895327 (0.0009) [2023-12-26 14:49:43,198][123091] Updated weights for policy 0, policy_version 1907332 (0.0006) [2023-12-26 14:49:43,264][123091] Updated weights for policy 0, policy_version 1907342 (0.0005) [2023-12-26 14:49:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 973488128. Throughput: 0: 9042.0, 1: 8790.0. Samples: 973485412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:43,785][121949] Avg episode reward: [(0, '6161.998'), (1, '5825.690')] [2023-12-26 14:49:43,838][123091] Updated weights for policy 0, policy_version 1907352 (0.0005) [2023-12-26 14:49:43,896][123091] Updated weights for policy 0, policy_version 1907362 (0.0005) [2023-12-26 14:49:43,963][123091] Updated weights for policy 0, policy_version 1907372 (0.0005) [2023-12-26 14:49:44,040][123090] Updated weights for policy 1, policy_version 1895337 (0.0010) [2023-12-26 14:49:44,102][123090] Updated weights for policy 1, policy_version 1895347 (0.0009) [2023-12-26 14:49:44,160][123090] Updated weights for policy 1, policy_version 1895357 (0.0010) [2023-12-26 14:49:44,605][123091] Updated weights for policy 0, policy_version 1907382 (0.0007) [2023-12-26 14:49:44,656][123091] Updated weights for policy 0, policy_version 1907392 (0.0010) [2023-12-26 14:49:44,715][123091] Updated weights for policy 0, policy_version 1907402 (0.0010) [2023-12-26 14:49:45,096][123090] Updated weights for policy 1, policy_version 1895367 (0.0009) [2023-12-26 14:49:45,166][123090] Updated weights for policy 1, policy_version 1895377 (0.0009) [2023-12-26 14:49:45,237][123090] Updated weights for policy 1, policy_version 1895387 (0.0007) [2023-12-26 14:49:45,512][123091] Updated weights for policy 0, policy_version 1907412 (0.0010) [2023-12-26 14:49:45,569][123091] Updated weights for policy 0, policy_version 1907422 (0.0009) [2023-12-26 14:49:45,632][123091] Updated weights for policy 0, policy_version 1907432 (0.0009) [2023-12-26 14:49:46,058][123090] Updated weights for policy 1, policy_version 1895397 (0.0009) [2023-12-26 14:49:46,112][123090] Updated weights for policy 1, policy_version 1895407 (0.0009) [2023-12-26 14:49:46,171][123090] Updated weights for policy 1, policy_version 1895417 (0.0009) [2023-12-26 14:49:46,411][123091] Updated weights for policy 0, policy_version 1907442 (0.0008) [2023-12-26 14:49:46,465][123091] Updated weights for policy 0, policy_version 1907452 (0.0009) [2023-12-26 14:49:46,513][123091] Updated weights for policy 0, policy_version 1907462 (0.0010) [2023-12-26 14:49:46,563][123091] Updated weights for policy 0, policy_version 1907472 (0.0010) [2023-12-26 14:49:46,915][123090] Updated weights for policy 1, policy_version 1895427 (0.0007) [2023-12-26 14:49:46,971][123090] Updated weights for policy 1, policy_version 1895437 (0.0005) [2023-12-26 14:49:47,024][123090] Updated weights for policy 1, policy_version 1895447 (0.0005) [2023-12-26 14:49:47,351][123091] Updated weights for policy 0, policy_version 1907482 (0.0005) [2023-12-26 14:49:47,398][123091] Updated weights for policy 0, policy_version 1907492 (0.0005) [2023-12-26 14:49:47,449][123091] Updated weights for policy 0, policy_version 1907502 (0.0005) [2023-12-26 14:49:47,744][123090] Updated weights for policy 1, policy_version 1895457 (0.0006) [2023-12-26 14:49:47,805][123090] Updated weights for policy 1, policy_version 1895467 (0.0010) [2023-12-26 14:49:47,868][123090] Updated weights for policy 1, policy_version 1895477 (0.0010) [2023-12-26 14:49:47,932][123090] Updated weights for policy 1, policy_version 1895487 (0.0009) [2023-12-26 14:49:48,192][123091] Updated weights for policy 0, policy_version 1907512 (0.0008) [2023-12-26 14:49:48,259][123091] Updated weights for policy 0, policy_version 1907522 (0.0007) [2023-12-26 14:49:48,322][123091] Updated weights for policy 0, policy_version 1907532 (0.0006) [2023-12-26 14:49:48,680][123090] Updated weights for policy 1, policy_version 1895497 (0.0005) [2023-12-26 14:49:48,745][123090] Updated weights for policy 1, policy_version 1895507 (0.0005) [2023-12-26 14:49:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 973578240. Throughput: 0: 9090.2, 1: 8788.0. Samples: 973595312. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:48,785][121949] Avg episode reward: [(0, '6136.321'), (1, '5828.229')] [2023-12-26 14:49:48,804][123090] Updated weights for policy 1, policy_version 1895517 (0.0005) [2023-12-26 14:49:49,036][123091] Updated weights for policy 0, policy_version 1907542 (0.0007) [2023-12-26 14:49:49,100][123091] Updated weights for policy 0, policy_version 1907552 (0.0005) [2023-12-26 14:49:49,175][123091] Updated weights for policy 0, policy_version 1907562 (0.0006) [2023-12-26 14:49:49,463][123090] Updated weights for policy 1, policy_version 1895527 (0.0008) [2023-12-26 14:49:49,521][123090] Updated weights for policy 1, policy_version 1895537 (0.0010) [2023-12-26 14:49:49,573][123090] Updated weights for policy 1, policy_version 1895547 (0.0010) [2023-12-26 14:49:49,919][123091] Updated weights for policy 0, policy_version 1907572 (0.0007) [2023-12-26 14:49:49,986][123091] Updated weights for policy 0, policy_version 1907582 (0.0009) [2023-12-26 14:49:50,053][123091] Updated weights for policy 0, policy_version 1907592 (0.0009) [2023-12-26 14:49:50,441][123090] Updated weights for policy 1, policy_version 1895557 (0.0010) [2023-12-26 14:49:50,511][123090] Updated weights for policy 1, policy_version 1895567 (0.0010) [2023-12-26 14:49:50,585][123090] Updated weights for policy 1, policy_version 1895577 (0.0010) [2023-12-26 14:49:50,877][123091] Updated weights for policy 0, policy_version 1907602 (0.0009) [2023-12-26 14:49:50,929][123091] Updated weights for policy 0, policy_version 1907612 (0.0009) [2023-12-26 14:49:50,981][123091] Updated weights for policy 0, policy_version 1907622 (0.0009) [2023-12-26 14:49:51,036][123091] Updated weights for policy 0, policy_version 1907632 (0.0009) [2023-12-26 14:49:51,438][123090] Updated weights for policy 1, policy_version 1895587 (0.0010) [2023-12-26 14:49:51,508][123090] Updated weights for policy 1, policy_version 1895597 (0.0010) [2023-12-26 14:49:51,576][123090] Updated weights for policy 1, policy_version 1895607 (0.0009) [2023-12-26 14:49:51,889][123091] Updated weights for policy 0, policy_version 1907642 (0.0010) [2023-12-26 14:49:51,950][123091] Updated weights for policy 0, policy_version 1907652 (0.0010) [2023-12-26 14:49:52,013][123091] Updated weights for policy 0, policy_version 1907662 (0.0008) [2023-12-26 14:49:52,432][123090] Updated weights for policy 1, policy_version 1895618 (0.0010) [2023-12-26 14:49:52,499][123090] Updated weights for policy 1, policy_version 1895628 (0.0009) [2023-12-26 14:49:52,564][123090] Updated weights for policy 1, policy_version 1895638 (0.0009) [2023-12-26 14:49:52,627][123090] Updated weights for policy 1, policy_version 1895648 (0.0009) [2023-12-26 14:49:52,794][123091] Updated weights for policy 0, policy_version 1907672 (0.0010) [2023-12-26 14:49:52,845][123091] Updated weights for policy 0, policy_version 1907682 (0.0010) [2023-12-26 14:49:52,897][123091] Updated weights for policy 0, policy_version 1907692 (0.0011) [2023-12-26 14:49:53,465][123090] Updated weights for policy 1, policy_version 1895658 (0.0009) [2023-12-26 14:49:53,532][123090] Updated weights for policy 1, policy_version 1895668 (0.0009) [2023-12-26 14:49:53,560][123091] Updated weights for policy 0, policy_version 1907702 (0.0009) [2023-12-26 14:49:53,597][123090] Updated weights for policy 1, policy_version 1895678 (0.0008) [2023-12-26 14:49:53,619][123091] Updated weights for policy 0, policy_version 1907712 (0.0008) [2023-12-26 14:49:53,679][123091] Updated weights for policy 0, policy_version 1907722 (0.0010) [2023-12-26 14:49:53,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17633.9). Total num frames: 973676544. Throughput: 0: 9046.8, 1: 8741.8. Samples: 973647800. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:53,785][121949] Avg episode reward: [(0, '6248.578'), (1, '5906.609')] [2023-12-26 14:49:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001907728_488382464.pth... [2023-12-26 14:49:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001895680_485294080.pth... [2023-12-26 14:49:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001906640_488103936.pth [2023-12-26 14:49:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001894656_485031936.pth [2023-12-26 14:49:54,397][123091] Updated weights for policy 0, policy_version 1907732 (0.0009) [2023-12-26 14:49:54,451][123091] Updated weights for policy 0, policy_version 1907742 (0.0010) [2023-12-26 14:49:54,508][123090] Updated weights for policy 1, policy_version 1895688 (0.0008) [2023-12-26 14:49:54,512][123091] Updated weights for policy 0, policy_version 1907752 (0.0006) [2023-12-26 14:49:54,578][123090] Updated weights for policy 1, policy_version 1895698 (0.0009) [2023-12-26 14:49:54,640][123090] Updated weights for policy 1, policy_version 1895708 (0.0009) [2023-12-26 14:49:55,275][123091] Updated weights for policy 0, policy_version 1907762 (0.0006) [2023-12-26 14:49:55,319][123091] Updated weights for policy 0, policy_version 1907772 (0.0010) [2023-12-26 14:49:55,372][123091] Updated weights for policy 0, policy_version 1907782 (0.0008) [2023-12-26 14:49:55,428][123091] Updated weights for policy 0, policy_version 1907792 (0.0005) [2023-12-26 14:49:55,469][123090] Updated weights for policy 1, policy_version 1895718 (0.0010) [2023-12-26 14:49:55,536][123090] Updated weights for policy 1, policy_version 1895728 (0.0011) [2023-12-26 14:49:55,598][123090] Updated weights for policy 1, policy_version 1895738 (0.0011) [2023-12-26 14:49:56,144][123091] Updated weights for policy 0, policy_version 1907802 (0.0005) [2023-12-26 14:49:56,192][123091] Updated weights for policy 0, policy_version 1907812 (0.0005) [2023-12-26 14:49:56,237][123091] Updated weights for policy 0, policy_version 1907822 (0.0005) [2023-12-26 14:49:56,335][123090] Updated weights for policy 1, policy_version 1895748 (0.0009) [2023-12-26 14:49:56,397][123090] Updated weights for policy 1, policy_version 1895758 (0.0005) [2023-12-26 14:49:56,464][123090] Updated weights for policy 1, policy_version 1895768 (0.0006) [2023-12-26 14:49:56,888][123091] Updated weights for policy 0, policy_version 1907832 (0.0005) [2023-12-26 14:49:56,940][123091] Updated weights for policy 0, policy_version 1907842 (0.0005) [2023-12-26 14:49:57,001][123091] Updated weights for policy 0, policy_version 1907852 (0.0005) [2023-12-26 14:49:57,190][123090] Updated weights for policy 1, policy_version 1895778 (0.0008) [2023-12-26 14:49:57,249][123090] Updated weights for policy 1, policy_version 1895788 (0.0010) [2023-12-26 14:49:57,308][123090] Updated weights for policy 1, policy_version 1895798 (0.0010) [2023-12-26 14:49:57,370][123090] Updated weights for policy 1, policy_version 1895808 (0.0011) [2023-12-26 14:49:57,775][123091] Updated weights for policy 0, policy_version 1907862 (0.0005) [2023-12-26 14:49:57,830][123091] Updated weights for policy 0, policy_version 1907872 (0.0005) [2023-12-26 14:49:57,881][123091] Updated weights for policy 0, policy_version 1907882 (0.0006) [2023-12-26 14:49:58,146][123090] Updated weights for policy 1, policy_version 1895818 (0.0006) [2023-12-26 14:49:58,222][123090] Updated weights for policy 1, policy_version 1895828 (0.0007) [2023-12-26 14:49:58,289][123090] Updated weights for policy 1, policy_version 1895838 (0.0010) [2023-12-26 14:49:58,660][123091] Updated weights for policy 0, policy_version 1907892 (0.0006) [2023-12-26 14:49:58,742][123091] Updated weights for policy 0, policy_version 1907902 (0.0007) [2023-12-26 14:49:58,786][121949] Fps is (10 sec: 18019.2, 60 sec: 17885.3, 300 sec: 17633.5). Total num frames: 973758464. Throughput: 0: 9120.2, 1: 8757.8. Samples: 973756952. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:49:58,787][121949] Avg episode reward: [(0, '6352.440'), (1, '5762.286')] [2023-12-26 14:49:58,817][123091] Updated weights for policy 0, policy_version 1907912 (0.0007) [2023-12-26 14:49:59,108][123090] Updated weights for policy 1, policy_version 1895848 (0.0009) [2023-12-26 14:49:59,171][123090] Updated weights for policy 1, policy_version 1895858 (0.0008) [2023-12-26 14:49:59,235][123090] Updated weights for policy 1, policy_version 1895868 (0.0009) [2023-12-26 14:49:59,646][123091] Updated weights for policy 0, policy_version 1907922 (0.0008) [2023-12-26 14:49:59,702][123091] Updated weights for policy 0, policy_version 1907932 (0.0009) [2023-12-26 14:49:59,762][123091] Updated weights for policy 0, policy_version 1907942 (0.0009) [2023-12-26 14:49:59,817][123091] Updated weights for policy 0, policy_version 1907952 (0.0010) [2023-12-26 14:50:00,092][123090] Updated weights for policy 1, policy_version 1895878 (0.0008) [2023-12-26 14:50:00,147][123090] Updated weights for policy 1, policy_version 1895888 (0.0008) [2023-12-26 14:50:00,212][123090] Updated weights for policy 1, policy_version 1895898 (0.0008) [2023-12-26 14:50:00,661][123091] Updated weights for policy 0, policy_version 1907962 (0.0010) [2023-12-26 14:50:00,718][123091] Updated weights for policy 0, policy_version 1907972 (0.0008) [2023-12-26 14:50:00,790][123091] Updated weights for policy 0, policy_version 1907982 (0.0005) [2023-12-26 14:50:00,979][123090] Updated weights for policy 1, policy_version 1895908 (0.0007) [2023-12-26 14:50:01,037][123090] Updated weights for policy 1, policy_version 1895918 (0.0006) [2023-12-26 14:50:01,115][123090] Updated weights for policy 1, policy_version 1895928 (0.0007) [2023-12-26 14:50:01,472][123091] Updated weights for policy 0, policy_version 1907992 (0.0005) [2023-12-26 14:50:01,534][123091] Updated weights for policy 0, policy_version 1908002 (0.0006) [2023-12-26 14:50:01,595][123091] Updated weights for policy 0, policy_version 1908012 (0.0011) [2023-12-26 14:50:01,814][123090] Updated weights for policy 1, policy_version 1895938 (0.0007) [2023-12-26 14:50:01,875][123090] Updated weights for policy 1, policy_version 1895948 (0.0005) [2023-12-26 14:50:01,935][123090] Updated weights for policy 1, policy_version 1895958 (0.0005) [2023-12-26 14:50:02,009][123090] Updated weights for policy 1, policy_version 1895968 (0.0005) [2023-12-26 14:50:02,311][123091] Updated weights for policy 0, policy_version 1908022 (0.0007) [2023-12-26 14:50:02,375][123091] Updated weights for policy 0, policy_version 1908032 (0.0008) [2023-12-26 14:50:02,441][123091] Updated weights for policy 0, policy_version 1908042 (0.0008) [2023-12-26 14:50:02,653][123090] Updated weights for policy 1, policy_version 1895978 (0.0005) [2023-12-26 14:50:02,712][123090] Updated weights for policy 1, policy_version 1895988 (0.0005) [2023-12-26 14:50:02,781][123090] Updated weights for policy 1, policy_version 1895998 (0.0006) [2023-12-26 14:50:03,225][123091] Updated weights for policy 0, policy_version 1908052 (0.0008) [2023-12-26 14:50:03,268][123091] Updated weights for policy 0, policy_version 1908062 (0.0010) [2023-12-26 14:50:03,315][123091] Updated weights for policy 0, policy_version 1908072 (0.0010) [2023-12-26 14:50:03,427][123090] Updated weights for policy 1, policy_version 1896008 (0.0009) [2023-12-26 14:50:03,491][123090] Updated weights for policy 1, policy_version 1896018 (0.0007) [2023-12-26 14:50:03,560][123090] Updated weights for policy 1, policy_version 1896028 (0.0005) [2023-12-26 14:50:03,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 973856768. Throughput: 0: 9174.1, 1: 8736.1. Samples: 973867176. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:03,785][121949] Avg episode reward: [(0, '6325.647'), (1, '5790.139')] [2023-12-26 14:50:04,068][123091] Updated weights for policy 0, policy_version 1908082 (0.0010) [2023-12-26 14:50:04,139][123091] Updated weights for policy 0, policy_version 1908092 (0.0011) [2023-12-26 14:50:04,210][123091] Updated weights for policy 0, policy_version 1908102 (0.0011) [2023-12-26 14:50:04,228][123090] Updated weights for policy 1, policy_version 1896038 (0.0006) [2023-12-26 14:50:04,277][123091] Updated weights for policy 0, policy_version 1908112 (0.0011) [2023-12-26 14:50:04,294][123090] Updated weights for policy 1, policy_version 1896048 (0.0006) [2023-12-26 14:50:04,364][123090] Updated weights for policy 1, policy_version 1896058 (0.0006) [2023-12-26 14:50:04,967][123091] Updated weights for policy 0, policy_version 1908122 (0.0010) [2023-12-26 14:50:05,030][123091] Updated weights for policy 0, policy_version 1908132 (0.0011) [2023-12-26 14:50:05,088][123091] Updated weights for policy 0, policy_version 1908142 (0.0010) [2023-12-26 14:50:05,128][123090] Updated weights for policy 1, policy_version 1896068 (0.0008) [2023-12-26 14:50:05,186][123090] Updated weights for policy 1, policy_version 1896078 (0.0010) [2023-12-26 14:50:05,254][123090] Updated weights for policy 1, policy_version 1896088 (0.0010) [2023-12-26 14:50:05,881][123091] Updated weights for policy 0, policy_version 1908152 (0.0011) [2023-12-26 14:50:05,943][123091] Updated weights for policy 0, policy_version 1908162 (0.0011) [2023-12-26 14:50:05,945][123090] Updated weights for policy 1, policy_version 1896098 (0.0010) [2023-12-26 14:50:05,993][123090] Updated weights for policy 1, policy_version 1896108 (0.0010) [2023-12-26 14:50:06,007][123091] Updated weights for policy 0, policy_version 1908172 (0.0011) [2023-12-26 14:50:06,040][123090] Updated weights for policy 1, policy_version 1896118 (0.0010) [2023-12-26 14:50:06,099][123090] Updated weights for policy 1, policy_version 1896128 (0.0010) [2023-12-26 14:50:06,850][123091] Updated weights for policy 0, policy_version 1908182 (0.0011) [2023-12-26 14:50:06,920][123091] Updated weights for policy 0, policy_version 1908192 (0.0011) [2023-12-26 14:50:06,959][123090] Updated weights for policy 1, policy_version 1896138 (0.0010) [2023-12-26 14:50:06,979][123091] Updated weights for policy 0, policy_version 1908202 (0.0011) [2023-12-26 14:50:07,015][123090] Updated weights for policy 1, policy_version 1896148 (0.0010) [2023-12-26 14:50:07,080][123090] Updated weights for policy 1, policy_version 1896158 (0.0011) [2023-12-26 14:50:07,799][123091] Updated weights for policy 0, policy_version 1908212 (0.0011) [2023-12-26 14:50:07,831][123090] Updated weights for policy 1, policy_version 1896168 (0.0010) [2023-12-26 14:50:07,846][123091] Updated weights for policy 0, policy_version 1908222 (0.0011) [2023-12-26 14:50:07,889][123090] Updated weights for policy 1, policy_version 1896178 (0.0010) [2023-12-26 14:50:07,897][123091] Updated weights for policy 0, policy_version 1908232 (0.0010) [2023-12-26 14:50:07,943][123090] Updated weights for policy 1, policy_version 1896188 (0.0010) [2023-12-26 14:50:08,653][123091] Updated weights for policy 0, policy_version 1908242 (0.0010) [2023-12-26 14:50:08,718][123091] Updated weights for policy 0, policy_version 1908252 (0.0011) [2023-12-26 14:50:08,727][123090] Updated weights for policy 1, policy_version 1896198 (0.0010) [2023-12-26 14:50:08,784][121949] Fps is (10 sec: 18025.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 973938688. Throughput: 0: 9181.5, 1: 8805.7. Samples: 973921620. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:08,785][121949] Avg episode reward: [(0, '6216.522'), (1, '5949.309')] [2023-12-26 14:50:08,787][123091] Updated weights for policy 0, policy_version 1908262 (0.0011) [2023-12-26 14:50:08,792][123090] Updated weights for policy 1, policy_version 1896208 (0.0011) [2023-12-26 14:50:08,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001908272_488521728.pth... [2023-12-26 14:50:08,852][123091] Updated weights for policy 0, policy_version 1908272 (0.0011) [2023-12-26 14:50:08,855][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001907184_488243200.pth [2023-12-26 14:50:08,856][123090] Updated weights for policy 1, policy_version 1896218 (0.0011) [2023-12-26 14:50:08,895][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001896224_485433344.pth... [2023-12-26 14:50:08,900][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001895168_485163008.pth [2023-12-26 14:50:09,665][123091] Updated weights for policy 0, policy_version 1908282 (0.0006) [2023-12-26 14:50:09,669][123090] Updated weights for policy 1, policy_version 1896228 (0.0008) [2023-12-26 14:50:09,725][123091] Updated weights for policy 0, policy_version 1908292 (0.0006) [2023-12-26 14:50:09,735][123090] Updated weights for policy 1, policy_version 1896238 (0.0005) [2023-12-26 14:50:09,782][123091] Updated weights for policy 0, policy_version 1908302 (0.0006) [2023-12-26 14:50:09,802][123090] Updated weights for policy 1, policy_version 1896248 (0.0008) [2023-12-26 14:50:10,532][123091] Updated weights for policy 0, policy_version 1908312 (0.0010) [2023-12-26 14:50:10,551][123090] Updated weights for policy 1, policy_version 1896258 (0.0010) [2023-12-26 14:50:10,596][123091] Updated weights for policy 0, policy_version 1908322 (0.0011) [2023-12-26 14:50:10,612][123090] Updated weights for policy 1, policy_version 1896268 (0.0006) [2023-12-26 14:50:10,652][123091] Updated weights for policy 0, policy_version 1908332 (0.0011) [2023-12-26 14:50:10,672][123090] Updated weights for policy 1, policy_version 1896278 (0.0007) [2023-12-26 14:50:10,719][123090] Updated weights for policy 1, policy_version 1896288 (0.0006) [2023-12-26 14:50:11,497][123091] Updated weights for policy 0, policy_version 1908342 (0.0008) [2023-12-26 14:50:11,532][123090] Updated weights for policy 1, policy_version 1896298 (0.0008) [2023-12-26 14:50:11,561][123091] Updated weights for policy 0, policy_version 1908352 (0.0007) [2023-12-26 14:50:11,585][123090] Updated weights for policy 1, policy_version 1896308 (0.0007) [2023-12-26 14:50:11,627][123091] Updated weights for policy 0, policy_version 1908362 (0.0009) [2023-12-26 14:50:11,660][123090] Updated weights for policy 1, policy_version 1896318 (0.0011) [2023-12-26 14:50:12,467][123091] Updated weights for policy 0, policy_version 1908372 (0.0009) [2023-12-26 14:50:12,529][123091] Updated weights for policy 0, policy_version 1908382 (0.0009) [2023-12-26 14:50:12,544][123090] Updated weights for policy 1, policy_version 1896328 (0.0011) [2023-12-26 14:50:12,589][123091] Updated weights for policy 0, policy_version 1908392 (0.0006) [2023-12-26 14:50:12,605][123090] Updated weights for policy 1, policy_version 1896338 (0.0011) [2023-12-26 14:50:12,674][123090] Updated weights for policy 1, policy_version 1896348 (0.0011) [2023-12-26 14:50:13,421][123091] Updated weights for policy 0, policy_version 1908402 (0.0008) [2023-12-26 14:50:13,482][123091] Updated weights for policy 0, policy_version 1908412 (0.0007) [2023-12-26 14:50:13,489][123090] Updated weights for policy 1, policy_version 1896358 (0.0008) [2023-12-26 14:50:13,547][123091] Updated weights for policy 0, policy_version 1908422 (0.0005) [2023-12-26 14:50:13,550][123090] Updated weights for policy 1, policy_version 1896368 (0.0005) [2023-12-26 14:50:13,609][123091] Updated weights for policy 0, policy_version 1908432 (0.0006) [2023-12-26 14:50:13,620][123090] Updated weights for policy 1, policy_version 1896378 (0.0007) [2023-12-26 14:50:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 974036992. Throughput: 0: 9192.7, 1: 8762.4. Samples: 974026788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:13,784][121949] Avg episode reward: [(0, '6239.771'), (1, '5846.908')] [2023-12-26 14:50:14,248][123090] Updated weights for policy 1, policy_version 1896388 (0.0007) [2023-12-26 14:50:14,273][123091] Updated weights for policy 0, policy_version 1908442 (0.0006) [2023-12-26 14:50:14,312][123090] Updated weights for policy 1, policy_version 1896398 (0.0006) [2023-12-26 14:50:14,336][123091] Updated weights for policy 0, policy_version 1908452 (0.0005) [2023-12-26 14:50:14,375][123090] Updated weights for policy 1, policy_version 1896408 (0.0009) [2023-12-26 14:50:14,409][123091] Updated weights for policy 0, policy_version 1908462 (0.0006) [2023-12-26 14:50:15,024][123090] Updated weights for policy 1, policy_version 1896418 (0.0007) [2023-12-26 14:50:15,074][123090] Updated weights for policy 1, policy_version 1896428 (0.0005) [2023-12-26 14:50:15,148][123090] Updated weights for policy 1, policy_version 1896438 (0.0007) [2023-12-26 14:50:15,214][123090] Updated weights for policy 1, policy_version 1896448 (0.0008) [2023-12-26 14:50:15,244][123091] Updated weights for policy 0, policy_version 1908472 (0.0010) [2023-12-26 14:50:15,302][123091] Updated weights for policy 0, policy_version 1908482 (0.0009) [2023-12-26 14:50:15,368][123091] Updated weights for policy 0, policy_version 1908492 (0.0009) [2023-12-26 14:50:15,928][123090] Updated weights for policy 1, policy_version 1896458 (0.0010) [2023-12-26 14:50:15,985][123090] Updated weights for policy 1, policy_version 1896468 (0.0010) [2023-12-26 14:50:16,043][123090] Updated weights for policy 1, policy_version 1896478 (0.0008) [2023-12-26 14:50:16,167][123091] Updated weights for policy 0, policy_version 1908502 (0.0010) [2023-12-26 14:50:16,219][123091] Updated weights for policy 0, policy_version 1908512 (0.0010) [2023-12-26 14:50:16,285][123091] Updated weights for policy 0, policy_version 1908522 (0.0011) [2023-12-26 14:50:16,790][123090] Updated weights for policy 1, policy_version 1896488 (0.0006) [2023-12-26 14:50:16,860][123090] Updated weights for policy 1, policy_version 1896498 (0.0005) [2023-12-26 14:50:16,905][123090] Updated weights for policy 1, policy_version 1896508 (0.0005) [2023-12-26 14:50:17,133][123091] Updated weights for policy 0, policy_version 1908532 (0.0010) [2023-12-26 14:50:17,176][123091] Updated weights for policy 0, policy_version 1908542 (0.0005) [2023-12-26 14:50:17,239][123091] Updated weights for policy 0, policy_version 1908552 (0.0008) [2023-12-26 14:50:17,605][123090] Updated weights for policy 1, policy_version 1896518 (0.0007) [2023-12-26 14:50:17,667][123090] Updated weights for policy 1, policy_version 1896528 (0.0006) [2023-12-26 14:50:17,724][123090] Updated weights for policy 1, policy_version 1896538 (0.0006) [2023-12-26 14:50:18,021][123091] Updated weights for policy 0, policy_version 1908562 (0.0007) [2023-12-26 14:50:18,099][123091] Updated weights for policy 0, policy_version 1908572 (0.0005) [2023-12-26 14:50:18,174][123091] Updated weights for policy 0, policy_version 1908582 (0.0005) [2023-12-26 14:50:18,237][123091] Updated weights for policy 0, policy_version 1908592 (0.0007) [2023-12-26 14:50:18,467][123090] Updated weights for policy 1, policy_version 1896548 (0.0007) [2023-12-26 14:50:18,537][123090] Updated weights for policy 1, policy_version 1896558 (0.0010) [2023-12-26 14:50:18,599][123090] Updated weights for policy 1, policy_version 1896568 (0.0009) [2023-12-26 14:50:18,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17689.2). Total num frames: 974127104. Throughput: 0: 9176.9, 1: 8923.3. Samples: 974138676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:18,784][121949] Avg episode reward: [(0, '6040.302'), (1, '5774.367')] [2023-12-26 14:50:18,877][123091] Updated weights for policy 0, policy_version 1908602 (0.0011) [2023-12-26 14:50:18,921][123091] Updated weights for policy 0, policy_version 1908612 (0.0010) [2023-12-26 14:50:18,984][123091] Updated weights for policy 0, policy_version 1908622 (0.0011) [2023-12-26 14:50:19,283][123090] Updated weights for policy 1, policy_version 1896578 (0.0006) [2023-12-26 14:50:19,348][123090] Updated weights for policy 1, policy_version 1896588 (0.0008) [2023-12-26 14:50:19,414][123090] Updated weights for policy 1, policy_version 1896598 (0.0009) [2023-12-26 14:50:19,468][123090] Updated weights for policy 1, policy_version 1896608 (0.0008) [2023-12-26 14:50:19,856][123091] Updated weights for policy 0, policy_version 1908632 (0.0010) [2023-12-26 14:50:19,923][123091] Updated weights for policy 0, policy_version 1908642 (0.0010) [2023-12-26 14:50:19,984][123091] Updated weights for policy 0, policy_version 1908652 (0.0011) [2023-12-26 14:50:20,337][123090] Updated weights for policy 1, policy_version 1896618 (0.0008) [2023-12-26 14:50:20,401][123090] Updated weights for policy 1, policy_version 1896628 (0.0009) [2023-12-26 14:50:20,465][123090] Updated weights for policy 1, policy_version 1896638 (0.0009) [2023-12-26 14:50:20,821][123091] Updated weights for policy 0, policy_version 1908662 (0.0011) [2023-12-26 14:50:20,892][123091] Updated weights for policy 0, policy_version 1908672 (0.0011) [2023-12-26 14:50:20,956][123091] Updated weights for policy 0, policy_version 1908682 (0.0011) [2023-12-26 14:50:21,353][123090] Updated weights for policy 1, policy_version 1896648 (0.0008) [2023-12-26 14:50:21,425][123090] Updated weights for policy 1, policy_version 1896658 (0.0008) [2023-12-26 14:50:21,498][123090] Updated weights for policy 1, policy_version 1896668 (0.0006) [2023-12-26 14:50:21,810][123091] Updated weights for policy 0, policy_version 1908692 (0.0010) [2023-12-26 14:50:21,866][123091] Updated weights for policy 0, policy_version 1908702 (0.0008) [2023-12-26 14:50:21,921][123091] Updated weights for policy 0, policy_version 1908712 (0.0008) [2023-12-26 14:50:22,275][123090] Updated weights for policy 1, policy_version 1896678 (0.0008) [2023-12-26 14:50:22,333][123090] Updated weights for policy 1, policy_version 1896688 (0.0010) [2023-12-26 14:50:22,402][123090] Updated weights for policy 1, policy_version 1896698 (0.0009) [2023-12-26 14:50:22,754][123091] Updated weights for policy 0, policy_version 1908722 (0.0010) [2023-12-26 14:50:22,817][123091] Updated weights for policy 0, policy_version 1908732 (0.0010) [2023-12-26 14:50:22,876][123091] Updated weights for policy 0, policy_version 1908742 (0.0011) [2023-12-26 14:50:22,941][123091] Updated weights for policy 0, policy_version 1908752 (0.0011) [2023-12-26 14:50:23,235][123090] Updated weights for policy 1, policy_version 1896708 (0.0008) [2023-12-26 14:50:23,308][123090] Updated weights for policy 1, policy_version 1896718 (0.0006) [2023-12-26 14:50:23,373][123090] Updated weights for policy 1, policy_version 1896728 (0.0005) [2023-12-26 14:50:23,584][123091] Updated weights for policy 0, policy_version 1908762 (0.0006) [2023-12-26 14:50:23,635][123091] Updated weights for policy 0, policy_version 1908772 (0.0006) [2023-12-26 14:50:23,695][123091] Updated weights for policy 0, policy_version 1908782 (0.0007) [2023-12-26 14:50:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17661.4). Total num frames: 974217216. Throughput: 0: 9066.8, 1: 8901.2. Samples: 974189724. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:23,785][121949] Avg episode reward: [(0, '6130.440'), (1, '5730.345')] [2023-12-26 14:50:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001908784_488652800.pth... [2023-12-26 14:50:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001896736_485564416.pth... [2023-12-26 14:50:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001907728_488382464.pth [2023-12-26 14:50:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001895680_485294080.pth [2023-12-26 14:50:24,005][123090] Updated weights for policy 1, policy_version 1896738 (0.0006) [2023-12-26 14:50:24,076][123090] Updated weights for policy 1, policy_version 1896748 (0.0006) [2023-12-26 14:50:24,139][123090] Updated weights for policy 1, policy_version 1896758 (0.0007) [2023-12-26 14:50:24,198][123090] Updated weights for policy 1, policy_version 1896768 (0.0005) [2023-12-26 14:50:24,540][123091] Updated weights for policy 0, policy_version 1908792 (0.0011) [2023-12-26 14:50:24,597][123091] Updated weights for policy 0, policy_version 1908802 (0.0009) [2023-12-26 14:50:24,652][123091] Updated weights for policy 0, policy_version 1908812 (0.0010) [2023-12-26 14:50:24,922][123090] Updated weights for policy 1, policy_version 1896778 (0.0007) [2023-12-26 14:50:24,978][123090] Updated weights for policy 1, policy_version 1896788 (0.0005) [2023-12-26 14:50:25,031][123090] Updated weights for policy 1, policy_version 1896798 (0.0006) [2023-12-26 14:50:25,456][123091] Updated weights for policy 0, policy_version 1908822 (0.0008) [2023-12-26 14:50:25,517][123091] Updated weights for policy 0, policy_version 1908832 (0.0006) [2023-12-26 14:50:25,574][123091] Updated weights for policy 0, policy_version 1908842 (0.0006) [2023-12-26 14:50:25,674][123090] Updated weights for policy 1, policy_version 1896808 (0.0006) [2023-12-26 14:50:25,743][123090] Updated weights for policy 1, policy_version 1896818 (0.0006) [2023-12-26 14:50:25,850][123090] Updated weights for policy 1, policy_version 1896828 (0.0005) [2023-12-26 14:50:26,207][123091] Updated weights for policy 0, policy_version 1908852 (0.0008) [2023-12-26 14:50:26,261][123091] Updated weights for policy 0, policy_version 1908862 (0.0010) [2023-12-26 14:50:26,319][123091] Updated weights for policy 0, policy_version 1908872 (0.0007) [2023-12-26 14:50:26,497][123090] Updated weights for policy 1, policy_version 1896838 (0.0009) [2023-12-26 14:50:26,562][123090] Updated weights for policy 1, policy_version 1896848 (0.0008) [2023-12-26 14:50:26,623][123090] Updated weights for policy 1, policy_version 1896858 (0.0008) [2023-12-26 14:50:27,001][123091] Updated weights for policy 0, policy_version 1908882 (0.0006) [2023-12-26 14:50:27,061][123091] Updated weights for policy 0, policy_version 1908892 (0.0006) [2023-12-26 14:50:27,117][123091] Updated weights for policy 0, policy_version 1908902 (0.0008) [2023-12-26 14:50:27,168][123091] Updated weights for policy 0, policy_version 1908912 (0.0010) [2023-12-26 14:50:27,289][123090] Updated weights for policy 1, policy_version 1896868 (0.0008) [2023-12-26 14:50:27,354][123090] Updated weights for policy 1, policy_version 1896878 (0.0008) [2023-12-26 14:50:27,424][123090] Updated weights for policy 1, policy_version 1896888 (0.0008) [2023-12-26 14:50:27,973][123091] Updated weights for policy 0, policy_version 1908922 (0.0010) [2023-12-26 14:50:28,024][123091] Updated weights for policy 0, policy_version 1908932 (0.0010) [2023-12-26 14:50:28,071][123091] Updated weights for policy 0, policy_version 1908942 (0.0010) [2023-12-26 14:50:28,090][123090] Updated weights for policy 1, policy_version 1896898 (0.0008) [2023-12-26 14:50:28,150][123090] Updated weights for policy 1, policy_version 1896908 (0.0008) [2023-12-26 14:50:28,218][123090] Updated weights for policy 1, policy_version 1896918 (0.0008) [2023-12-26 14:50:28,280][123090] Updated weights for policy 1, policy_version 1896928 (0.0008) [2023-12-26 14:50:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 974307328. Throughput: 0: 9134.0, 1: 9055.3. Samples: 974303928. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:28,784][121949] Avg episode reward: [(0, '6335.030'), (1, '5984.196')] [2023-12-26 14:50:28,862][123091] Updated weights for policy 0, policy_version 1908952 (0.0006) [2023-12-26 14:50:28,917][123091] Updated weights for policy 0, policy_version 1908962 (0.0006) [2023-12-26 14:50:28,967][123091] Updated weights for policy 0, policy_version 1908972 (0.0006) [2023-12-26 14:50:29,045][123090] Updated weights for policy 1, policy_version 1896938 (0.0005) [2023-12-26 14:50:29,093][123090] Updated weights for policy 1, policy_version 1896948 (0.0005) [2023-12-26 14:50:29,141][123090] Updated weights for policy 1, policy_version 1896958 (0.0005) [2023-12-26 14:50:29,787][123090] Updated weights for policy 1, policy_version 1896968 (0.0010) [2023-12-26 14:50:29,800][123091] Updated weights for policy 0, policy_version 1908982 (0.0005) [2023-12-26 14:50:29,850][123090] Updated weights for policy 1, policy_version 1896978 (0.0010) [2023-12-26 14:50:29,868][123091] Updated weights for policy 0, policy_version 1908992 (0.0009) [2023-12-26 14:50:29,924][123090] Updated weights for policy 1, policy_version 1896988 (0.0006) [2023-12-26 14:50:29,938][123091] Updated weights for policy 0, policy_version 1909002 (0.0008) [2023-12-26 14:50:30,589][123090] Updated weights for policy 1, policy_version 1896998 (0.0009) [2023-12-26 14:50:30,655][123090] Updated weights for policy 1, policy_version 1897008 (0.0010) [2023-12-26 14:50:30,699][123091] Updated weights for policy 0, policy_version 1909012 (0.0008) [2023-12-26 14:50:30,722][123090] Updated weights for policy 1, policy_version 1897018 (0.0010) [2023-12-26 14:50:30,759][123091] Updated weights for policy 0, policy_version 1909022 (0.0006) [2023-12-26 14:50:30,810][123091] Updated weights for policy 0, policy_version 1909032 (0.0009) [2023-12-26 14:50:31,524][123090] Updated weights for policy 1, policy_version 1897028 (0.0010) [2023-12-26 14:50:31,587][123090] Updated weights for policy 1, policy_version 1897038 (0.0011) [2023-12-26 14:50:31,650][123090] Updated weights for policy 1, policy_version 1897048 (0.0009) [2023-12-26 14:50:31,705][123091] Updated weights for policy 0, policy_version 1909042 (0.0009) [2023-12-26 14:50:31,777][123091] Updated weights for policy 0, policy_version 1909052 (0.0009) [2023-12-26 14:50:31,840][123091] Updated weights for policy 0, policy_version 1909062 (0.0009) [2023-12-26 14:50:31,912][123091] Updated weights for policy 0, policy_version 1909072 (0.0009) [2023-12-26 14:50:32,469][123090] Updated weights for policy 1, policy_version 1897058 (0.0008) [2023-12-26 14:50:32,533][123090] Updated weights for policy 1, policy_version 1897068 (0.0009) [2023-12-26 14:50:32,545][123091] Updated weights for policy 0, policy_version 1909082 (0.0008) [2023-12-26 14:50:32,586][123090] Updated weights for policy 1, policy_version 1897078 (0.0007) [2023-12-26 14:50:32,604][123091] Updated weights for policy 0, policy_version 1909092 (0.0009) [2023-12-26 14:50:32,644][123090] Updated weights for policy 1, policy_version 1897088 (0.0010) [2023-12-26 14:50:32,661][123091] Updated weights for policy 0, policy_version 1909102 (0.0006) [2023-12-26 14:50:33,367][123090] Updated weights for policy 1, policy_version 1897098 (0.0010) [2023-12-26 14:50:33,422][123090] Updated weights for policy 1, policy_version 1897108 (0.0009) [2023-12-26 14:50:33,473][123090] Updated weights for policy 1, policy_version 1897118 (0.0009) [2023-12-26 14:50:33,502][123091] Updated weights for policy 0, policy_version 1909112 (0.0009) [2023-12-26 14:50:33,558][123091] Updated weights for policy 0, policy_version 1909122 (0.0011) [2023-12-26 14:50:33,613][123091] Updated weights for policy 0, policy_version 1909133 (0.0010) [2023-12-26 14:50:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18159.0, 300 sec: 17744.7). Total num frames: 974405632. Throughput: 0: 9015.2, 1: 9131.0. Samples: 974411892. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:33,785][121949] Avg episode reward: [(0, '6198.219'), (1, '6006.494')] [2023-12-26 14:50:34,277][123090] Updated weights for policy 1, policy_version 1897128 (0.0008) [2023-12-26 14:50:34,335][123090] Updated weights for policy 1, policy_version 1897138 (0.0009) [2023-12-26 14:50:34,395][123090] Updated weights for policy 1, policy_version 1897148 (0.0009) [2023-12-26 14:50:34,462][123091] Updated weights for policy 0, policy_version 1909143 (0.0009) [2023-12-26 14:50:34,518][123091] Updated weights for policy 0, policy_version 1909153 (0.0009) [2023-12-26 14:50:34,571][123091] Updated weights for policy 0, policy_version 1909163 (0.0009) [2023-12-26 14:50:35,186][123090] Updated weights for policy 1, policy_version 1897158 (0.0007) [2023-12-26 14:50:35,240][123090] Updated weights for policy 1, policy_version 1897168 (0.0005) [2023-12-26 14:50:35,295][123090] Updated weights for policy 1, policy_version 1897178 (0.0006) [2023-12-26 14:50:35,446][123091] Updated weights for policy 0, policy_version 1909173 (0.0009) [2023-12-26 14:50:35,505][123091] Updated weights for policy 0, policy_version 1909183 (0.0010) [2023-12-26 14:50:35,563][123091] Updated weights for policy 0, policy_version 1909193 (0.0010) [2023-12-26 14:50:36,067][123090] Updated weights for policy 1, policy_version 1897188 (0.0007) [2023-12-26 14:50:36,131][123090] Updated weights for policy 1, policy_version 1897198 (0.0008) [2023-12-26 14:50:36,197][123090] Updated weights for policy 1, policy_version 1897208 (0.0007) [2023-12-26 14:50:36,355][123091] Updated weights for policy 0, policy_version 1909203 (0.0011) [2023-12-26 14:50:36,419][123091] Updated weights for policy 0, policy_version 1909213 (0.0011) [2023-12-26 14:50:36,495][123091] Updated weights for policy 0, policy_version 1909223 (0.0011) [2023-12-26 14:50:36,964][123090] Updated weights for policy 1, policy_version 1897218 (0.0006) [2023-12-26 14:50:37,037][123090] Updated weights for policy 1, policy_version 1897228 (0.0005) [2023-12-26 14:50:37,110][123090] Updated weights for policy 1, policy_version 1897238 (0.0006) [2023-12-26 14:50:37,186][123090] Updated weights for policy 1, policy_version 1897248 (0.0009) [2023-12-26 14:50:37,271][123091] Updated weights for policy 0, policy_version 1909233 (0.0006) [2023-12-26 14:50:37,322][123091] Updated weights for policy 0, policy_version 1909243 (0.0010) [2023-12-26 14:50:37,398][123091] Updated weights for policy 0, policy_version 1909253 (0.0011) [2023-12-26 14:50:37,461][123091] Updated weights for policy 0, policy_version 1909263 (0.0011) [2023-12-26 14:50:37,933][123090] Updated weights for policy 1, policy_version 1897258 (0.0009) [2023-12-26 14:50:37,988][123090] Updated weights for policy 1, policy_version 1897268 (0.0010) [2023-12-26 14:50:38,051][123090] Updated weights for policy 1, policy_version 1897278 (0.0010) [2023-12-26 14:50:38,194][123091] Updated weights for policy 0, policy_version 1909273 (0.0010) [2023-12-26 14:50:38,242][123091] Updated weights for policy 0, policy_version 1909283 (0.0010) [2023-12-26 14:50:38,311][123091] Updated weights for policy 0, policy_version 1909293 (0.0011) [2023-12-26 14:50:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 974487552. Throughput: 0: 8997.8, 1: 9159.9. Samples: 974464900. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:38,785][121949] Avg episode reward: [(0, '6035.401'), (1, '5652.252')] [2023-12-26 14:50:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001909296_488783872.pth... [2023-12-26 14:50:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001897280_485703680.pth... [2023-12-26 14:50:38,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001908272_488521728.pth [2023-12-26 14:50:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001896224_485433344.pth [2023-12-26 14:50:38,872][123090] Updated weights for policy 1, policy_version 1897288 (0.0011) [2023-12-26 14:50:38,934][123090] Updated weights for policy 1, policy_version 1897298 (0.0011) [2023-12-26 14:50:38,983][123090] Updated weights for policy 1, policy_version 1897308 (0.0011) [2023-12-26 14:50:39,097][123091] Updated weights for policy 0, policy_version 1909303 (0.0011) [2023-12-26 14:50:39,167][123091] Updated weights for policy 0, policy_version 1909313 (0.0011) [2023-12-26 14:50:39,236][123091] Updated weights for policy 0, policy_version 1909323 (0.0010) [2023-12-26 14:50:39,875][123090] Updated weights for policy 1, policy_version 1897318 (0.0009) [2023-12-26 14:50:39,941][123090] Updated weights for policy 1, policy_version 1897328 (0.0009) [2023-12-26 14:50:40,003][123090] Updated weights for policy 1, policy_version 1897338 (0.0009) [2023-12-26 14:50:40,059][123091] Updated weights for policy 0, policy_version 1909333 (0.0007) [2023-12-26 14:50:40,124][123091] Updated weights for policy 0, policy_version 1909343 (0.0006) [2023-12-26 14:50:40,187][123091] Updated weights for policy 0, policy_version 1909353 (0.0009) [2023-12-26 14:50:40,800][123090] Updated weights for policy 1, policy_version 1897348 (0.0008) [2023-12-26 14:50:40,859][123090] Updated weights for policy 1, policy_version 1897358 (0.0007) [2023-12-26 14:50:40,917][123090] Updated weights for policy 1, policy_version 1897368 (0.0006) [2023-12-26 14:50:40,981][123091] Updated weights for policy 0, policy_version 1909363 (0.0009) [2023-12-26 14:50:41,046][123091] Updated weights for policy 0, policy_version 1909374 (0.0011) [2023-12-26 14:50:41,118][123091] Updated weights for policy 0, policy_version 1909384 (0.0010) [2023-12-26 14:50:41,783][123090] Updated weights for policy 1, policy_version 1897378 (0.0007) [2023-12-26 14:50:41,836][123090] Updated weights for policy 1, policy_version 1897388 (0.0008) [2023-12-26 14:50:41,890][123090] Updated weights for policy 1, policy_version 1897398 (0.0010) [2023-12-26 14:50:41,943][123090] Updated weights for policy 1, policy_version 1897408 (0.0009) [2023-12-26 14:50:41,947][123091] Updated weights for policy 0, policy_version 1909394 (0.0009) [2023-12-26 14:50:41,997][123091] Updated weights for policy 0, policy_version 1909404 (0.0010) [2023-12-26 14:50:42,054][123091] Updated weights for policy 0, policy_version 1909414 (0.0009) [2023-12-26 14:50:42,109][123091] Updated weights for policy 0, policy_version 1909424 (0.0009) [2023-12-26 14:50:42,822][123090] Updated weights for policy 1, policy_version 1897418 (0.0009) [2023-12-26 14:50:42,880][123090] Updated weights for policy 1, policy_version 1897428 (0.0008) [2023-12-26 14:50:42,891][123091] Updated weights for policy 0, policy_version 1909434 (0.0007) [2023-12-26 14:50:42,944][123090] Updated weights for policy 1, policy_version 1897438 (0.0009) [2023-12-26 14:50:42,951][123091] Updated weights for policy 0, policy_version 1909444 (0.0006) [2023-12-26 14:50:43,004][123091] Updated weights for policy 0, policy_version 1909454 (0.0009) [2023-12-26 14:50:43,738][123091] Updated weights for policy 0, policy_version 1909464 (0.0006) [2023-12-26 14:50:43,784][121949] Fps is (10 sec: 16384.1, 60 sec: 18022.4, 300 sec: 17661.4). Total num frames: 974569472. Throughput: 0: 8903.0, 1: 9147.8. Samples: 974569208. Policy #0 lag: (min: 31.0, avg: 31.0, max: 34.0) [2023-12-26 14:50:43,785][121949] Avg episode reward: [(0, '6116.498'), (1, '5352.132')] [2023-12-26 14:50:43,801][123091] Updated weights for policy 0, policy_version 1909474 (0.0005) [2023-12-26 14:50:43,823][123090] Updated weights for policy 1, policy_version 1897448 (0.0009) [2023-12-26 14:50:43,859][123091] Updated weights for policy 0, policy_version 1909484 (0.0005) [2023-12-26 14:50:43,884][123090] Updated weights for policy 1, policy_version 1897458 (0.0009) [2023-12-26 14:50:43,937][123090] Updated weights for policy 1, policy_version 1897468 (0.0009) [2023-12-26 14:50:44,595][123091] Updated weights for policy 0, policy_version 1909494 (0.0009) [2023-12-26 14:50:44,659][123091] Updated weights for policy 0, policy_version 1909504 (0.0009) [2023-12-26 14:50:44,710][123091] Updated weights for policy 0, policy_version 1909514 (0.0008) [2023-12-26 14:50:44,777][123090] Updated weights for policy 1, policy_version 1897478 (0.0009) [2023-12-26 14:50:44,839][123090] Updated weights for policy 1, policy_version 1897488 (0.0010) [2023-12-26 14:50:44,903][123090] Updated weights for policy 1, policy_version 1897498 (0.0010) [2023-12-26 14:50:45,561][123091] Updated weights for policy 0, policy_version 1909524 (0.0009) [2023-12-26 14:50:45,626][123091] Updated weights for policy 0, policy_version 1909534 (0.0009) [2023-12-26 14:50:45,694][123091] Updated weights for policy 0, policy_version 1909544 (0.0009) [2023-12-26 14:50:45,740][123090] Updated weights for policy 1, policy_version 1897508 (0.0010) [2023-12-26 14:50:45,803][123090] Updated weights for policy 1, policy_version 1897518 (0.0010) [2023-12-26 14:50:45,877][123090] Updated weights for policy 1, policy_version 1897528 (0.0011) [2023-12-26 14:50:46,448][123091] Updated weights for policy 0, policy_version 1909554 (0.0007) [2023-12-26 14:50:46,507][123091] Updated weights for policy 0, policy_version 1909564 (0.0008) [2023-12-26 14:50:46,576][123091] Updated weights for policy 0, policy_version 1909574 (0.0005) [2023-12-26 14:50:46,640][123091] Updated weights for policy 0, policy_version 1909584 (0.0005) [2023-12-26 14:50:46,671][123090] Updated weights for policy 1, policy_version 1897538 (0.0009) [2023-12-26 14:50:46,727][123090] Updated weights for policy 1, policy_version 1897548 (0.0006) [2023-12-26 14:50:46,773][123090] Updated weights for policy 1, policy_version 1897558 (0.0005) [2023-12-26 14:50:46,820][123090] Updated weights for policy 1, policy_version 1897568 (0.0005) [2023-12-26 14:50:47,262][123091] Updated weights for policy 0, policy_version 1909594 (0.0006) [2023-12-26 14:50:47,325][123091] Updated weights for policy 0, policy_version 1909604 (0.0006) [2023-12-26 14:50:47,381][123091] Updated weights for policy 0, policy_version 1909614 (0.0009) [2023-12-26 14:50:47,569][123090] Updated weights for policy 1, policy_version 1897578 (0.0010) [2023-12-26 14:50:47,628][123090] Updated weights for policy 1, policy_version 1897588 (0.0010) [2023-12-26 14:50:47,675][123090] Updated weights for policy 1, policy_version 1897598 (0.0010) [2023-12-26 14:50:48,097][123091] Updated weights for policy 0, policy_version 1909624 (0.0010) [2023-12-26 14:50:48,149][123091] Updated weights for policy 0, policy_version 1909634 (0.0009) [2023-12-26 14:50:48,218][123091] Updated weights for policy 0, policy_version 1909644 (0.0005) [2023-12-26 14:50:48,471][123090] Updated weights for policy 1, policy_version 1897608 (0.0007) [2023-12-26 14:50:48,529][123090] Updated weights for policy 1, policy_version 1897618 (0.0005) [2023-12-26 14:50:48,593][123090] Updated weights for policy 1, policy_version 1897628 (0.0006) [2023-12-26 14:50:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18158.9, 300 sec: 17689.2). Total num frames: 974667776. Throughput: 0: 8926.6, 1: 9087.3. Samples: 974677800. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:50:48,785][121949] Avg episode reward: [(0, '6220.513'), (1, '5589.263')] [2023-12-26 14:50:49,026][123091] Updated weights for policy 0, policy_version 1909654 (0.0009) [2023-12-26 14:50:49,092][123091] Updated weights for policy 0, policy_version 1909664 (0.0010) [2023-12-26 14:50:49,151][123091] Updated weights for policy 0, policy_version 1909674 (0.0010) [2023-12-26 14:50:49,334][123090] Updated weights for policy 1, policy_version 1897638 (0.0008) [2023-12-26 14:50:49,403][123090] Updated weights for policy 1, policy_version 1897648 (0.0009) [2023-12-26 14:50:49,472][123090] Updated weights for policy 1, policy_version 1897658 (0.0009) [2023-12-26 14:50:49,984][123091] Updated weights for policy 0, policy_version 1909684 (0.0010) [2023-12-26 14:50:50,044][123091] Updated weights for policy 0, policy_version 1909694 (0.0010) [2023-12-26 14:50:50,111][123091] Updated weights for policy 0, policy_version 1909704 (0.0009) [2023-12-26 14:50:50,305][123090] Updated weights for policy 1, policy_version 1897668 (0.0009) [2023-12-26 14:50:50,373][123090] Updated weights for policy 1, policy_version 1897678 (0.0009) [2023-12-26 14:50:50,451][123090] Updated weights for policy 1, policy_version 1897688 (0.0005) [2023-12-26 14:50:51,002][123091] Updated weights for policy 0, policy_version 1909714 (0.0010) [2023-12-26 14:50:51,072][123091] Updated weights for policy 0, policy_version 1909724 (0.0009) [2023-12-26 14:50:51,138][123091] Updated weights for policy 0, policy_version 1909734 (0.0010) [2023-12-26 14:50:51,173][123090] Updated weights for policy 1, policy_version 1897698 (0.0006) [2023-12-26 14:50:51,206][123091] Updated weights for policy 0, policy_version 1909744 (0.0009) [2023-12-26 14:50:51,235][123090] Updated weights for policy 1, policy_version 1897708 (0.0006) [2023-12-26 14:50:51,298][123090] Updated weights for policy 1, policy_version 1897718 (0.0006) [2023-12-26 14:50:51,363][123090] Updated weights for policy 1, policy_version 1897728 (0.0007) [2023-12-26 14:50:52,070][123091] Updated weights for policy 0, policy_version 1909754 (0.0009) [2023-12-26 14:50:52,127][123091] Updated weights for policy 0, policy_version 1909764 (0.0009) [2023-12-26 14:50:52,173][123090] Updated weights for policy 1, policy_version 1897738 (0.0008) [2023-12-26 14:50:52,179][123091] Updated weights for policy 0, policy_version 1909774 (0.0007) [2023-12-26 14:50:52,235][123090] Updated weights for policy 1, policy_version 1897748 (0.0010) [2023-12-26 14:50:52,303][123090] Updated weights for policy 1, policy_version 1897758 (0.0010) [2023-12-26 14:50:52,995][123091] Updated weights for policy 0, policy_version 1909784 (0.0010) [2023-12-26 14:50:53,037][123090] Updated weights for policy 1, policy_version 1897768 (0.0006) [2023-12-26 14:50:53,061][123091] Updated weights for policy 0, policy_version 1909794 (0.0008) [2023-12-26 14:50:53,093][123090] Updated weights for policy 1, policy_version 1897778 (0.0007) [2023-12-26 14:50:53,121][123091] Updated weights for policy 0, policy_version 1909804 (0.0010) [2023-12-26 14:50:53,142][123090] Updated weights for policy 1, policy_version 1897788 (0.0007) [2023-12-26 14:50:53,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17885.8, 300 sec: 17689.3). Total num frames: 974749696. Throughput: 0: 8877.8, 1: 9084.7. Samples: 974729936. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:50:53,786][121949] Avg episode reward: [(0, '6272.156'), (1, '5835.675')] [2023-12-26 14:50:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001909808_488914944.pth... [2023-12-26 14:50:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001897792_485834752.pth... [2023-12-26 14:50:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001896736_485564416.pth [2023-12-26 14:50:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001908784_488652800.pth [2023-12-26 14:50:53,869][123090] Updated weights for policy 1, policy_version 1897798 (0.0007) [2023-12-26 14:50:53,924][123090] Updated weights for policy 1, policy_version 1897808 (0.0005) [2023-12-26 14:50:53,931][123091] Updated weights for policy 0, policy_version 1909814 (0.0011) [2023-12-26 14:50:53,996][123090] Updated weights for policy 1, policy_version 1897818 (0.0009) [2023-12-26 14:50:53,998][123091] Updated weights for policy 0, policy_version 1909824 (0.0011) [2023-12-26 14:50:54,058][123091] Updated weights for policy 0, policy_version 1909834 (0.0008) [2023-12-26 14:50:54,811][123091] Updated weights for policy 0, policy_version 1909844 (0.0008) [2023-12-26 14:50:54,858][123090] Updated weights for policy 1, policy_version 1897828 (0.0009) [2023-12-26 14:50:54,879][123091] Updated weights for policy 0, policy_version 1909854 (0.0011) [2023-12-26 14:50:54,913][123090] Updated weights for policy 1, policy_version 1897838 (0.0006) [2023-12-26 14:50:54,946][123091] Updated weights for policy 0, policy_version 1909864 (0.0007) [2023-12-26 14:50:54,970][123090] Updated weights for policy 1, policy_version 1897848 (0.0009) [2023-12-26 14:50:55,646][123091] Updated weights for policy 0, policy_version 1909874 (0.0008) [2023-12-26 14:50:55,688][123090] Updated weights for policy 1, policy_version 1897858 (0.0009) [2023-12-26 14:50:55,703][123091] Updated weights for policy 0, policy_version 1909884 (0.0010) [2023-12-26 14:50:55,740][123090] Updated weights for policy 1, policy_version 1897868 (0.0008) [2023-12-26 14:50:55,746][123091] Updated weights for policy 0, policy_version 1909894 (0.0010) [2023-12-26 14:50:55,787][123090] Updated weights for policy 1, policy_version 1897878 (0.0010) [2023-12-26 14:50:55,793][123091] Updated weights for policy 0, policy_version 1909904 (0.0010) [2023-12-26 14:50:55,849][123090] Updated weights for policy 1, policy_version 1897888 (0.0010) [2023-12-26 14:50:56,560][123090] Updated weights for policy 1, policy_version 1897898 (0.0007) [2023-12-26 14:50:56,622][123090] Updated weights for policy 1, policy_version 1897908 (0.0006) [2023-12-26 14:50:56,686][123091] Updated weights for policy 0, policy_version 1909914 (0.0010) [2023-12-26 14:50:56,687][123090] Updated weights for policy 1, policy_version 1897918 (0.0005) [2023-12-26 14:50:56,741][123091] Updated weights for policy 0, policy_version 1909924 (0.0010) [2023-12-26 14:50:56,791][123091] Updated weights for policy 0, policy_version 1909934 (0.0010) [2023-12-26 14:50:57,453][123090] Updated weights for policy 1, policy_version 1897928 (0.0006) [2023-12-26 14:50:57,508][123090] Updated weights for policy 1, policy_version 1897938 (0.0005) [2023-12-26 14:50:57,555][123091] Updated weights for policy 0, policy_version 1909944 (0.0009) [2023-12-26 14:50:57,562][123090] Updated weights for policy 1, policy_version 1897948 (0.0005) [2023-12-26 14:50:57,615][123091] Updated weights for policy 0, policy_version 1909954 (0.0010) [2023-12-26 14:50:57,673][123091] Updated weights for policy 0, policy_version 1909964 (0.0010) [2023-12-26 14:50:58,268][123090] Updated weights for policy 1, policy_version 1897958 (0.0008) [2023-12-26 14:50:58,327][123090] Updated weights for policy 1, policy_version 1897968 (0.0010) [2023-12-26 14:50:58,397][123090] Updated weights for policy 1, policy_version 1897978 (0.0010) [2023-12-26 14:50:58,584][123091] Updated weights for policy 0, policy_version 1909974 (0.0009) [2023-12-26 14:50:58,659][123091] Updated weights for policy 0, policy_version 1909984 (0.0008) [2023-12-26 14:50:58,728][123091] Updated weights for policy 0, policy_version 1909994 (0.0009) [2023-12-26 14:50:58,786][121949] Fps is (10 sec: 18019.7, 60 sec: 18159.0, 300 sec: 17744.6). Total num frames: 974848000. Throughput: 0: 8884.7, 1: 9141.9. Samples: 974838016. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:50:58,787][121949] Avg episode reward: [(0, '6262.462'), (1, '5945.102')] [2023-12-26 14:50:59,331][123090] Updated weights for policy 1, policy_version 1897988 (0.0010) [2023-12-26 14:50:59,401][123090] Updated weights for policy 1, policy_version 1897998 (0.0009) [2023-12-26 14:50:59,468][123090] Updated weights for policy 1, policy_version 1898008 (0.0009) [2023-12-26 14:50:59,663][123091] Updated weights for policy 0, policy_version 1910004 (0.0007) [2023-12-26 14:50:59,729][123091] Updated weights for policy 0, policy_version 1910014 (0.0009) [2023-12-26 14:50:59,795][123091] Updated weights for policy 0, policy_version 1910024 (0.0011) [2023-12-26 14:51:00,274][123090] Updated weights for policy 1, policy_version 1898018 (0.0009) [2023-12-26 14:51:00,338][123090] Updated weights for policy 1, policy_version 1898028 (0.0009) [2023-12-26 14:51:00,408][123090] Updated weights for policy 1, policy_version 1898038 (0.0009) [2023-12-26 14:51:00,475][123090] Updated weights for policy 1, policy_version 1898048 (0.0008) [2023-12-26 14:51:00,605][123091] Updated weights for policy 0, policy_version 1910034 (0.0009) [2023-12-26 14:51:00,662][123091] Updated weights for policy 0, policy_version 1910044 (0.0010) [2023-12-26 14:51:00,731][123091] Updated weights for policy 0, policy_version 1910054 (0.0010) [2023-12-26 14:51:00,796][123091] Updated weights for policy 0, policy_version 1910064 (0.0010) [2023-12-26 14:51:01,200][123090] Updated weights for policy 1, policy_version 1898058 (0.0007) [2023-12-26 14:51:01,263][123090] Updated weights for policy 1, policy_version 1898068 (0.0008) [2023-12-26 14:51:01,315][123090] Updated weights for policy 1, policy_version 1898078 (0.0010) [2023-12-26 14:51:01,590][123091] Updated weights for policy 0, policy_version 1910074 (0.0009) [2023-12-26 14:51:01,667][123091] Updated weights for policy 0, policy_version 1910084 (0.0009) [2023-12-26 14:51:01,738][123091] Updated weights for policy 0, policy_version 1910094 (0.0009) [2023-12-26 14:51:02,241][123090] Updated weights for policy 1, policy_version 1898088 (0.0008) [2023-12-26 14:51:02,308][123090] Updated weights for policy 1, policy_version 1898098 (0.0009) [2023-12-26 14:51:02,383][123090] Updated weights for policy 1, policy_version 1898108 (0.0009) [2023-12-26 14:51:02,527][123091] Updated weights for policy 0, policy_version 1910104 (0.0009) [2023-12-26 14:51:02,587][123091] Updated weights for policy 0, policy_version 1910114 (0.0009) [2023-12-26 14:51:02,644][123091] Updated weights for policy 0, policy_version 1910124 (0.0009) [2023-12-26 14:51:03,195][123090] Updated weights for policy 1, policy_version 1898118 (0.0010) [2023-12-26 14:51:03,258][123090] Updated weights for policy 1, policy_version 1898128 (0.0009) [2023-12-26 14:51:03,318][123090] Updated weights for policy 1, policy_version 1898138 (0.0010) [2023-12-26 14:51:03,458][123091] Updated weights for policy 0, policy_version 1910134 (0.0010) [2023-12-26 14:51:03,518][123091] Updated weights for policy 0, policy_version 1910145 (0.0009) [2023-12-26 14:51:03,563][123091] Updated weights for policy 0, policy_version 1910155 (0.0005) [2023-12-26 14:51:03,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 974929920. Throughput: 0: 8797.8, 1: 9005.9. Samples: 974939844. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:03,785][121949] Avg episode reward: [(0, '6293.693'), (1, '5900.841')] [2023-12-26 14:51:04,067][123090] Updated weights for policy 1, policy_version 1898148 (0.0008) [2023-12-26 14:51:04,134][123090] Updated weights for policy 1, policy_version 1898158 (0.0005) [2023-12-26 14:51:04,203][123090] Updated weights for policy 1, policy_version 1898168 (0.0006) [2023-12-26 14:51:04,368][123091] Updated weights for policy 0, policy_version 1910165 (0.0008) [2023-12-26 14:51:04,421][123091] Updated weights for policy 0, policy_version 1910175 (0.0011) [2023-12-26 14:51:04,474][123091] Updated weights for policy 0, policy_version 1910185 (0.0011) [2023-12-26 14:51:04,937][123090] Updated weights for policy 1, policy_version 1898178 (0.0006) [2023-12-26 14:51:04,986][123090] Updated weights for policy 1, policy_version 1898188 (0.0009) [2023-12-26 14:51:05,048][123090] Updated weights for policy 1, policy_version 1898198 (0.0010) [2023-12-26 14:51:05,103][123090] Updated weights for policy 1, policy_version 1898208 (0.0010) [2023-12-26 14:51:05,288][123091] Updated weights for policy 0, policy_version 1910195 (0.0009) [2023-12-26 14:51:05,349][123091] Updated weights for policy 0, policy_version 1910205 (0.0006) [2023-12-26 14:51:05,415][123091] Updated weights for policy 0, policy_version 1910215 (0.0008) [2023-12-26 14:51:05,891][123090] Updated weights for policy 1, policy_version 1898218 (0.0005) [2023-12-26 14:51:05,968][123090] Updated weights for policy 1, policy_version 1898228 (0.0005) [2023-12-26 14:51:06,040][123090] Updated weights for policy 1, policy_version 1898238 (0.0005) [2023-12-26 14:51:06,184][123091] Updated weights for policy 0, policy_version 1910225 (0.0008) [2023-12-26 14:51:06,254][123091] Updated weights for policy 0, policy_version 1910235 (0.0009) [2023-12-26 14:51:06,317][123091] Updated weights for policy 0, policy_version 1910245 (0.0011) [2023-12-26 14:51:06,383][123091] Updated weights for policy 0, policy_version 1910255 (0.0011) [2023-12-26 14:51:06,738][123090] Updated weights for policy 1, policy_version 1898248 (0.0010) [2023-12-26 14:51:06,805][123090] Updated weights for policy 1, policy_version 1898258 (0.0010) [2023-12-26 14:51:06,864][123090] Updated weights for policy 1, policy_version 1898268 (0.0010) [2023-12-26 14:51:07,180][123091] Updated weights for policy 0, policy_version 1910265 (0.0011) [2023-12-26 14:51:07,243][123091] Updated weights for policy 0, policy_version 1910275 (0.0011) [2023-12-26 14:51:07,291][123091] Updated weights for policy 0, policy_version 1910285 (0.0010) [2023-12-26 14:51:07,649][123090] Updated weights for policy 1, policy_version 1898278 (0.0007) [2023-12-26 14:51:07,704][123090] Updated weights for policy 1, policy_version 1898288 (0.0005) [2023-12-26 14:51:07,756][123090] Updated weights for policy 1, policy_version 1898298 (0.0006) [2023-12-26 14:51:08,057][123091] Updated weights for policy 0, policy_version 1910295 (0.0007) [2023-12-26 14:51:08,125][123091] Updated weights for policy 0, policy_version 1910305 (0.0009) [2023-12-26 14:51:08,191][123091] Updated weights for policy 0, policy_version 1910315 (0.0009) [2023-12-26 14:51:08,491][123090] Updated weights for policy 1, policy_version 1898308 (0.0008) [2023-12-26 14:51:08,558][123090] Updated weights for policy 1, policy_version 1898318 (0.0011) [2023-12-26 14:51:08,624][123090] Updated weights for policy 1, policy_version 1898328 (0.0010) [2023-12-26 14:51:08,784][121949] Fps is (10 sec: 17205.8, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 975020032. Throughput: 0: 8847.6, 1: 9044.3. Samples: 974994856. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:08,785][121949] Avg episode reward: [(0, '6259.448'), (1, '5857.725')] [2023-12-26 14:51:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001898336_485974016.pth... [2023-12-26 14:51:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001897280_485703680.pth [2023-12-26 14:51:08,816][123091] Updated weights for policy 0, policy_version 1910325 (0.0009) [2023-12-26 14:51:08,890][123091] Updated weights for policy 0, policy_version 1910335 (0.0011) [2023-12-26 14:51:08,957][123091] Updated weights for policy 0, policy_version 1910345 (0.0008) [2023-12-26 14:51:09,006][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001910352_489054208.pth... [2023-12-26 14:51:09,011][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001909296_488783872.pth [2023-12-26 14:51:09,436][123090] Updated weights for policy 1, policy_version 1898338 (0.0011) [2023-12-26 14:51:09,507][123090] Updated weights for policy 1, policy_version 1898348 (0.0011) [2023-12-26 14:51:09,578][123090] Updated weights for policy 1, policy_version 1898358 (0.0011) [2023-12-26 14:51:09,642][123090] Updated weights for policy 1, policy_version 1898368 (0.0011) [2023-12-26 14:51:09,740][123091] Updated weights for policy 0, policy_version 1910355 (0.0009) [2023-12-26 14:51:09,790][123091] Updated weights for policy 0, policy_version 1910365 (0.0005) [2023-12-26 14:51:09,850][123091] Updated weights for policy 0, policy_version 1910375 (0.0008) [2023-12-26 14:51:10,510][123090] Updated weights for policy 1, policy_version 1898378 (0.0010) [2023-12-26 14:51:10,571][123090] Updated weights for policy 1, policy_version 1898388 (0.0009) [2023-12-26 14:51:10,636][123090] Updated weights for policy 1, policy_version 1898398 (0.0010) [2023-12-26 14:51:10,653][123091] Updated weights for policy 0, policy_version 1910385 (0.0009) [2023-12-26 14:51:10,702][123091] Updated weights for policy 0, policy_version 1910395 (0.0009) [2023-12-26 14:51:10,753][123091] Updated weights for policy 0, policy_version 1910405 (0.0010) [2023-12-26 14:51:10,801][123091] Updated weights for policy 0, policy_version 1910415 (0.0009) [2023-12-26 14:51:11,488][123090] Updated weights for policy 1, policy_version 1898408 (0.0010) [2023-12-26 14:51:11,561][123090] Updated weights for policy 1, policy_version 1898419 (0.0009) [2023-12-26 14:51:11,645][123090] Updated weights for policy 1, policy_version 1898432 (0.0009) [2023-12-26 14:51:11,747][123091] Updated weights for policy 0, policy_version 1910425 (0.0007) [2023-12-26 14:51:11,804][123091] Updated weights for policy 0, policy_version 1910435 (0.0009) [2023-12-26 14:51:11,862][123091] Updated weights for policy 0, policy_version 1910445 (0.0009) [2023-12-26 14:51:12,560][123090] Updated weights for policy 1, policy_version 1898442 (0.0011) [2023-12-26 14:51:12,584][123091] Updated weights for policy 0, policy_version 1910455 (0.0008) [2023-12-26 14:51:12,621][123090] Updated weights for policy 1, policy_version 1898452 (0.0010) [2023-12-26 14:51:12,641][123091] Updated weights for policy 0, policy_version 1910465 (0.0006) [2023-12-26 14:51:12,689][123090] Updated weights for policy 1, policy_version 1898462 (0.0011) [2023-12-26 14:51:12,696][123091] Updated weights for policy 0, policy_version 1910475 (0.0006) [2023-12-26 14:51:13,358][123090] Updated weights for policy 1, policy_version 1898472 (0.0006) [2023-12-26 14:51:13,403][123091] Updated weights for policy 0, policy_version 1910485 (0.0006) [2023-12-26 14:51:13,413][123090] Updated weights for policy 1, policy_version 1898482 (0.0005) [2023-12-26 14:51:13,460][123091] Updated weights for policy 0, policy_version 1910495 (0.0005) [2023-12-26 14:51:13,472][123090] Updated weights for policy 1, policy_version 1898492 (0.0005) [2023-12-26 14:51:13,515][123091] Updated weights for policy 0, policy_version 1910505 (0.0005) [2023-12-26 14:51:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 975110144. Throughput: 0: 8798.1, 1: 8879.9. Samples: 975099440. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:13,785][121949] Avg episode reward: [(0, '6102.522'), (1, '5705.739')] [2023-12-26 14:51:14,011][123090] Updated weights for policy 1, policy_version 1898502 (0.0005) [2023-12-26 14:51:14,061][123090] Updated weights for policy 1, policy_version 1898512 (0.0005) [2023-12-26 14:51:14,119][123090] Updated weights for policy 1, policy_version 1898522 (0.0007) [2023-12-26 14:51:14,215][123091] Updated weights for policy 0, policy_version 1910515 (0.0008) [2023-12-26 14:51:14,274][123091] Updated weights for policy 0, policy_version 1910525 (0.0010) [2023-12-26 14:51:14,324][123091] Updated weights for policy 0, policy_version 1910535 (0.0010) [2023-12-26 14:51:14,890][123090] Updated weights for policy 1, policy_version 1898532 (0.0010) [2023-12-26 14:51:14,957][123090] Updated weights for policy 1, policy_version 1898542 (0.0010) [2023-12-26 14:51:15,028][123090] Updated weights for policy 1, policy_version 1898552 (0.0010) [2023-12-26 14:51:15,171][123091] Updated weights for policy 0, policy_version 1910545 (0.0010) [2023-12-26 14:51:15,231][123091] Updated weights for policy 0, policy_version 1910555 (0.0011) [2023-12-26 14:51:15,302][123091] Updated weights for policy 0, policy_version 1910565 (0.0011) [2023-12-26 14:51:15,370][123091] Updated weights for policy 0, policy_version 1910575 (0.0011) [2023-12-26 14:51:15,822][123090] Updated weights for policy 1, policy_version 1898562 (0.0010) [2023-12-26 14:51:15,888][123090] Updated weights for policy 1, policy_version 1898572 (0.0010) [2023-12-26 14:51:15,958][123090] Updated weights for policy 1, policy_version 1898582 (0.0010) [2023-12-26 14:51:16,031][123090] Updated weights for policy 1, policy_version 1898592 (0.0010) [2023-12-26 14:51:16,178][123091] Updated weights for policy 0, policy_version 1910585 (0.0010) [2023-12-26 14:51:16,225][123091] Updated weights for policy 0, policy_version 1910595 (0.0010) [2023-12-26 14:51:16,284][123091] Updated weights for policy 0, policy_version 1910605 (0.0009) [2023-12-26 14:51:16,823][123090] Updated weights for policy 1, policy_version 1898602 (0.0010) [2023-12-26 14:51:16,874][123090] Updated weights for policy 1, policy_version 1898612 (0.0010) [2023-12-26 14:51:16,924][123090] Updated weights for policy 1, policy_version 1898622 (0.0010) [2023-12-26 14:51:16,981][123091] Updated weights for policy 0, policy_version 1910615 (0.0005) [2023-12-26 14:51:17,046][123091] Updated weights for policy 0, policy_version 1910625 (0.0008) [2023-12-26 14:51:17,094][123091] Updated weights for policy 0, policy_version 1910635 (0.0009) [2023-12-26 14:51:17,752][123090] Updated weights for policy 1, policy_version 1898632 (0.0010) [2023-12-26 14:51:17,807][123090] Updated weights for policy 1, policy_version 1898642 (0.0010) [2023-12-26 14:51:17,862][123090] Updated weights for policy 1, policy_version 1898652 (0.0010) [2023-12-26 14:51:17,886][123091] Updated weights for policy 0, policy_version 1910645 (0.0007) [2023-12-26 14:51:17,935][123091] Updated weights for policy 0, policy_version 1910655 (0.0009) [2023-12-26 14:51:17,983][123091] Updated weights for policy 0, policy_version 1910666 (0.0009) [2023-12-26 14:51:18,706][123090] Updated weights for policy 1, policy_version 1898662 (0.0007) [2023-12-26 14:51:18,773][123090] Updated weights for policy 1, policy_version 1898672 (0.0006) [2023-12-26 14:51:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 975192064. Throughput: 0: 8867.9, 1: 8856.9. Samples: 975209508. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:18,785][121949] Avg episode reward: [(0, '6211.987'), (1, '5776.689')] [2023-12-26 14:51:18,832][123090] Updated weights for policy 1, policy_version 1898682 (0.0010) [2023-12-26 14:51:18,875][123091] Updated weights for policy 0, policy_version 1910676 (0.0009) [2023-12-26 14:51:18,941][123091] Updated weights for policy 0, policy_version 1910686 (0.0008) [2023-12-26 14:51:19,000][123091] Updated weights for policy 0, policy_version 1910696 (0.0009) [2023-12-26 14:51:19,591][123090] Updated weights for policy 1, policy_version 1898692 (0.0009) [2023-12-26 14:51:19,641][123090] Updated weights for policy 1, policy_version 1898702 (0.0005) [2023-12-26 14:51:19,698][123090] Updated weights for policy 1, policy_version 1898712 (0.0006) [2023-12-26 14:51:19,905][123091] Updated weights for policy 0, policy_version 1910706 (0.0010) [2023-12-26 14:51:19,972][123091] Updated weights for policy 0, policy_version 1910716 (0.0009) [2023-12-26 14:51:20,027][123091] Updated weights for policy 0, policy_version 1910726 (0.0009) [2023-12-26 14:51:20,089][123091] Updated weights for policy 0, policy_version 1910736 (0.0009) [2023-12-26 14:51:20,480][123090] Updated weights for policy 1, policy_version 1898722 (0.0006) [2023-12-26 14:51:20,539][123090] Updated weights for policy 1, policy_version 1898732 (0.0008) [2023-12-26 14:51:20,610][123090] Updated weights for policy 1, policy_version 1898742 (0.0008) [2023-12-26 14:51:20,678][123090] Updated weights for policy 1, policy_version 1898752 (0.0009) [2023-12-26 14:51:20,952][123091] Updated weights for policy 0, policy_version 1910746 (0.0007) [2023-12-26 14:51:21,018][123091] Updated weights for policy 0, policy_version 1910756 (0.0008) [2023-12-26 14:51:21,091][123091] Updated weights for policy 0, policy_version 1910766 (0.0007) [2023-12-26 14:51:21,563][123090] Updated weights for policy 1, policy_version 1898762 (0.0010) [2023-12-26 14:51:21,629][123090] Updated weights for policy 1, policy_version 1898772 (0.0008) [2023-12-26 14:51:21,703][123090] Updated weights for policy 1, policy_version 1898782 (0.0009) [2023-12-26 14:51:21,827][123091] Updated weights for policy 0, policy_version 1910776 (0.0008) [2023-12-26 14:51:21,897][123091] Updated weights for policy 0, policy_version 1910786 (0.0008) [2023-12-26 14:51:21,968][123091] Updated weights for policy 0, policy_version 1910796 (0.0009) [2023-12-26 14:51:22,524][123090] Updated weights for policy 1, policy_version 1898792 (0.0008) [2023-12-26 14:51:22,602][123090] Updated weights for policy 1, policy_version 1898802 (0.0008) [2023-12-26 14:51:22,648][123091] Updated weights for policy 0, policy_version 1910806 (0.0006) [2023-12-26 14:51:22,674][123090] Updated weights for policy 1, policy_version 1898812 (0.0008) [2023-12-26 14:51:22,719][123091] Updated weights for policy 0, policy_version 1910816 (0.0009) [2023-12-26 14:51:22,786][123091] Updated weights for policy 0, policy_version 1910826 (0.0010) [2023-12-26 14:51:23,423][123090] Updated weights for policy 1, policy_version 1898822 (0.0009) [2023-12-26 14:51:23,471][123090] Updated weights for policy 1, policy_version 1898832 (0.0008) [2023-12-26 14:51:23,520][123090] Updated weights for policy 1, policy_version 1898842 (0.0009) [2023-12-26 14:51:23,593][123091] Updated weights for policy 0, policy_version 1910836 (0.0010) [2023-12-26 14:51:23,656][123091] Updated weights for policy 0, policy_version 1910846 (0.0011) [2023-12-26 14:51:23,707][123091] Updated weights for policy 0, policy_version 1910856 (0.0010) [2023-12-26 14:51:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 975290368. Throughput: 0: 8854.4, 1: 8829.5. Samples: 975260676. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:23,785][121949] Avg episode reward: [(0, '6383.842'), (1, '5811.382')] [2023-12-26 14:51:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001898848_486105088.pth... [2023-12-26 14:51:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001910864_489185280.pth... [2023-12-26 14:51:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001909808_488914944.pth [2023-12-26 14:51:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001897792_485834752.pth [2023-12-26 14:51:24,221][123090] Updated weights for policy 1, policy_version 1898852 (0.0007) [2023-12-26 14:51:24,279][123090] Updated weights for policy 1, policy_version 1898862 (0.0007) [2023-12-26 14:51:24,336][123090] Updated weights for policy 1, policy_version 1898872 (0.0009) [2023-12-26 14:51:24,447][123091] Updated weights for policy 0, policy_version 1910866 (0.0009) [2023-12-26 14:51:24,511][123091] Updated weights for policy 0, policy_version 1910876 (0.0008) [2023-12-26 14:51:24,579][123091] Updated weights for policy 0, policy_version 1910886 (0.0006) [2023-12-26 14:51:24,644][123091] Updated weights for policy 0, policy_version 1910896 (0.0009) [2023-12-26 14:51:25,083][123090] Updated weights for policy 1, policy_version 1898882 (0.0009) [2023-12-26 14:51:25,146][123090] Updated weights for policy 1, policy_version 1898892 (0.0009) [2023-12-26 14:51:25,206][123090] Updated weights for policy 1, policy_version 1898903 (0.0009) [2023-12-26 14:51:25,460][123091] Updated weights for policy 0, policy_version 1910906 (0.0009) [2023-12-26 14:51:25,522][123091] Updated weights for policy 0, policy_version 1910916 (0.0009) [2023-12-26 14:51:25,574][123091] Updated weights for policy 0, policy_version 1910926 (0.0009) [2023-12-26 14:51:26,013][123090] Updated weights for policy 1, policy_version 1898913 (0.0009) [2023-12-26 14:51:26,071][123090] Updated weights for policy 1, policy_version 1898923 (0.0010) [2023-12-26 14:51:26,135][123090] Updated weights for policy 1, policy_version 1898933 (0.0011) [2023-12-26 14:51:26,194][123090] Updated weights for policy 1, policy_version 1898943 (0.0010) [2023-12-26 14:51:26,368][123091] Updated weights for policy 0, policy_version 1910936 (0.0010) [2023-12-26 14:51:26,426][123091] Updated weights for policy 0, policy_version 1910946 (0.0010) [2023-12-26 14:51:26,488][123091] Updated weights for policy 0, policy_version 1910956 (0.0010) [2023-12-26 14:51:26,978][123090] Updated weights for policy 1, policy_version 1898953 (0.0006) [2023-12-26 14:51:27,025][123090] Updated weights for policy 1, policy_version 1898963 (0.0005) [2023-12-26 14:51:27,079][123090] Updated weights for policy 1, policy_version 1898973 (0.0005) [2023-12-26 14:51:27,334][123091] Updated weights for policy 0, policy_version 1910966 (0.0007) [2023-12-26 14:51:27,408][123091] Updated weights for policy 0, policy_version 1910976 (0.0005) [2023-12-26 14:51:27,486][123091] Updated weights for policy 0, policy_version 1910986 (0.0005) [2023-12-26 14:51:27,697][123090] Updated weights for policy 1, policy_version 1898983 (0.0005) [2023-12-26 14:51:27,758][123090] Updated weights for policy 1, policy_version 1898993 (0.0009) [2023-12-26 14:51:27,822][123090] Updated weights for policy 1, policy_version 1899003 (0.0010) [2023-12-26 14:51:28,213][123091] Updated weights for policy 0, policy_version 1910996 (0.0006) [2023-12-26 14:51:28,265][123091] Updated weights for policy 0, policy_version 1911006 (0.0007) [2023-12-26 14:51:28,313][123091] Updated weights for policy 0, policy_version 1911016 (0.0009) [2023-12-26 14:51:28,617][123090] Updated weights for policy 1, policy_version 1899013 (0.0007) [2023-12-26 14:51:28,691][123090] Updated weights for policy 1, policy_version 1899023 (0.0005) [2023-12-26 14:51:28,761][123090] Updated weights for policy 1, policy_version 1899033 (0.0005) [2023-12-26 14:51:28,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 975372288. Throughput: 0: 8857.0, 1: 8934.3. Samples: 975369816. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:28,785][121949] Avg episode reward: [(0, '6275.230'), (1, '5862.267')] [2023-12-26 14:51:29,135][123091] Updated weights for policy 0, policy_version 1911026 (0.0008) [2023-12-26 14:51:29,184][123091] Updated weights for policy 0, policy_version 1911036 (0.0009) [2023-12-26 14:51:29,250][123091] Updated weights for policy 0, policy_version 1911046 (0.0010) [2023-12-26 14:51:29,313][123091] Updated weights for policy 0, policy_version 1911056 (0.0012) [2023-12-26 14:51:29,470][123090] Updated weights for policy 1, policy_version 1899043 (0.0006) [2023-12-26 14:51:29,518][123090] Updated weights for policy 1, policy_version 1899053 (0.0009) [2023-12-26 14:51:29,578][123090] Updated weights for policy 1, policy_version 1899063 (0.0006) [2023-12-26 14:51:30,159][123091] Updated weights for policy 0, policy_version 1911066 (0.0010) [2023-12-26 14:51:30,214][123091] Updated weights for policy 0, policy_version 1911076 (0.0010) [2023-12-26 14:51:30,264][123091] Updated weights for policy 0, policy_version 1911086 (0.0009) [2023-12-26 14:51:30,351][123090] Updated weights for policy 1, policy_version 1899073 (0.0005) [2023-12-26 14:51:30,416][123090] Updated weights for policy 1, policy_version 1899083 (0.0005) [2023-12-26 14:51:30,491][123090] Updated weights for policy 1, policy_version 1899093 (0.0005) [2023-12-26 14:51:30,545][123090] Updated weights for policy 1, policy_version 1899103 (0.0005) [2023-12-26 14:51:30,993][123091] Updated weights for policy 0, policy_version 1911096 (0.0006) [2023-12-26 14:51:31,061][123091] Updated weights for policy 0, policy_version 1911106 (0.0007) [2023-12-26 14:51:31,120][123091] Updated weights for policy 0, policy_version 1911116 (0.0008) [2023-12-26 14:51:31,194][123090] Updated weights for policy 1, policy_version 1899113 (0.0009) [2023-12-26 14:51:31,270][123090] Updated weights for policy 1, policy_version 1899123 (0.0008) [2023-12-26 14:51:31,337][123090] Updated weights for policy 1, policy_version 1899133 (0.0008) [2023-12-26 14:51:31,918][123091] Updated weights for policy 0, policy_version 1911126 (0.0009) [2023-12-26 14:51:31,980][123091] Updated weights for policy 0, policy_version 1911136 (0.0009) [2023-12-26 14:51:32,048][123091] Updated weights for policy 0, policy_version 1911146 (0.0009) [2023-12-26 14:51:32,124][123090] Updated weights for policy 1, policy_version 1899143 (0.0009) [2023-12-26 14:51:32,201][123090] Updated weights for policy 1, policy_version 1899153 (0.0009) [2023-12-26 14:51:32,272][123090] Updated weights for policy 1, policy_version 1899163 (0.0010) [2023-12-26 14:51:32,799][123091] Updated weights for policy 0, policy_version 1911156 (0.0009) [2023-12-26 14:51:32,863][123091] Updated weights for policy 0, policy_version 1911166 (0.0009) [2023-12-26 14:51:32,911][123091] Updated weights for policy 0, policy_version 1911176 (0.0009) [2023-12-26 14:51:33,008][123090] Updated weights for policy 1, policy_version 1899173 (0.0010) [2023-12-26 14:51:33,074][123090] Updated weights for policy 1, policy_version 1899183 (0.0010) [2023-12-26 14:51:33,134][123090] Updated weights for policy 1, policy_version 1899193 (0.0009) [2023-12-26 14:51:33,653][123091] Updated weights for policy 0, policy_version 1911186 (0.0008) [2023-12-26 14:51:33,709][123091] Updated weights for policy 0, policy_version 1911196 (0.0009) [2023-12-26 14:51:33,764][123091] Updated weights for policy 0, policy_version 1911206 (0.0007) [2023-12-26 14:51:33,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 975462400. Throughput: 0: 8821.5, 1: 8992.4. Samples: 975479424. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:33,785][121949] Avg episode reward: [(0, '6259.252'), (1, '5947.264')] [2023-12-26 14:51:33,823][123091] Updated weights for policy 0, policy_version 1911216 (0.0006) [2023-12-26 14:51:33,899][123090] Updated weights for policy 1, policy_version 1899203 (0.0009) [2023-12-26 14:51:33,961][123090] Updated weights for policy 1, policy_version 1899213 (0.0005) [2023-12-26 14:51:34,012][123090] Updated weights for policy 1, policy_version 1899223 (0.0005) [2023-12-26 14:51:34,618][123091] Updated weights for policy 0, policy_version 1911226 (0.0010) [2023-12-26 14:51:34,680][123091] Updated weights for policy 0, policy_version 1911236 (0.0010) [2023-12-26 14:51:34,732][123091] Updated weights for policy 0, policy_version 1911246 (0.0009) [2023-12-26 14:51:34,766][123090] Updated weights for policy 1, policy_version 1899233 (0.0005) [2023-12-26 14:51:34,833][123090] Updated weights for policy 1, policy_version 1899243 (0.0005) [2023-12-26 14:51:34,882][123090] Updated weights for policy 1, policy_version 1899253 (0.0005) [2023-12-26 14:51:34,935][123090] Updated weights for policy 1, policy_version 1899263 (0.0005) [2023-12-26 14:51:35,559][123091] Updated weights for policy 0, policy_version 1911256 (0.0007) [2023-12-26 14:51:35,613][123091] Updated weights for policy 0, policy_version 1911266 (0.0005) [2023-12-26 14:51:35,662][123091] Updated weights for policy 0, policy_version 1911276 (0.0005) [2023-12-26 14:51:35,682][123090] Updated weights for policy 1, policy_version 1899273 (0.0009) [2023-12-26 14:51:35,734][123090] Updated weights for policy 1, policy_version 1899283 (0.0010) [2023-12-26 14:51:35,794][123090] Updated weights for policy 1, policy_version 1899295 (0.0011) [2023-12-26 14:51:36,349][123091] Updated weights for policy 0, policy_version 1911286 (0.0005) [2023-12-26 14:51:36,422][123091] Updated weights for policy 0, policy_version 1911296 (0.0007) [2023-12-26 14:51:36,499][123091] Updated weights for policy 0, policy_version 1911306 (0.0006) [2023-12-26 14:51:36,667][123090] Updated weights for policy 1, policy_version 1899305 (0.0008) [2023-12-26 14:51:36,722][123090] Updated weights for policy 1, policy_version 1899315 (0.0010) [2023-12-26 14:51:36,771][123090] Updated weights for policy 1, policy_version 1899325 (0.0009) [2023-12-26 14:51:37,268][123091] Updated weights for policy 0, policy_version 1911316 (0.0007) [2023-12-26 14:51:37,329][123091] Updated weights for policy 0, policy_version 1911326 (0.0009) [2023-12-26 14:51:37,394][123091] Updated weights for policy 0, policy_version 1911336 (0.0009) [2023-12-26 14:51:37,545][123090] Updated weights for policy 1, policy_version 1899335 (0.0008) [2023-12-26 14:51:37,611][123090] Updated weights for policy 1, policy_version 1899345 (0.0009) [2023-12-26 14:51:37,675][123090] Updated weights for policy 1, policy_version 1899355 (0.0010) [2023-12-26 14:51:38,173][123091] Updated weights for policy 0, policy_version 1911346 (0.0009) [2023-12-26 14:51:38,228][123091] Updated weights for policy 0, policy_version 1911356 (0.0005) [2023-12-26 14:51:38,283][123091] Updated weights for policy 0, policy_version 1911366 (0.0005) [2023-12-26 14:51:38,342][123091] Updated weights for policy 0, policy_version 1911376 (0.0007) [2023-12-26 14:51:38,471][123090] Updated weights for policy 1, policy_version 1899365 (0.0009) [2023-12-26 14:51:38,538][123090] Updated weights for policy 1, policy_version 1899375 (0.0010) [2023-12-26 14:51:38,592][123090] Updated weights for policy 1, policy_version 1899385 (0.0010) [2023-12-26 14:51:38,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 975560704. Throughput: 0: 8895.5, 1: 8999.1. Samples: 975535188. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:38,785][121949] Avg episode reward: [(0, '6176.190'), (1, '5934.055')] [2023-12-26 14:51:38,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001911376_489316352.pth... [2023-12-26 14:51:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001899392_486244352.pth... [2023-12-26 14:51:38,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001910352_489054208.pth [2023-12-26 14:51:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001898336_485974016.pth [2023-12-26 14:51:39,085][123091] Updated weights for policy 0, policy_version 1911386 (0.0011) [2023-12-26 14:51:39,137][123091] Updated weights for policy 0, policy_version 1911396 (0.0009) [2023-12-26 14:51:39,206][123091] Updated weights for policy 0, policy_version 1911406 (0.0006) [2023-12-26 14:51:39,450][123090] Updated weights for policy 1, policy_version 1899395 (0.0008) [2023-12-26 14:51:39,516][123090] Updated weights for policy 1, policy_version 1899405 (0.0008) [2023-12-26 14:51:39,571][123090] Updated weights for policy 1, policy_version 1899415 (0.0009) [2023-12-26 14:51:40,021][123091] Updated weights for policy 0, policy_version 1911416 (0.0009) [2023-12-26 14:51:40,093][123091] Updated weights for policy 0, policy_version 1911426 (0.0010) [2023-12-26 14:51:40,146][123091] Updated weights for policy 0, policy_version 1911436 (0.0009) [2023-12-26 14:51:40,338][123090] Updated weights for policy 1, policy_version 1899425 (0.0009) [2023-12-26 14:51:40,391][123090] Updated weights for policy 1, policy_version 1899435 (0.0010) [2023-12-26 14:51:40,445][123090] Updated weights for policy 1, policy_version 1899445 (0.0009) [2023-12-26 14:51:40,512][123090] Updated weights for policy 1, policy_version 1899455 (0.0010) [2023-12-26 14:51:40,939][123091] Updated weights for policy 0, policy_version 1911446 (0.0010) [2023-12-26 14:51:40,999][123091] Updated weights for policy 0, policy_version 1911456 (0.0008) [2023-12-26 14:51:41,068][123091] Updated weights for policy 0, policy_version 1911466 (0.0008) [2023-12-26 14:51:41,416][123090] Updated weights for policy 1, policy_version 1899465 (0.0010) [2023-12-26 14:51:41,473][123090] Updated weights for policy 1, policy_version 1899475 (0.0010) [2023-12-26 14:51:41,528][123090] Updated weights for policy 1, policy_version 1899485 (0.0010) [2023-12-26 14:51:41,791][123091] Updated weights for policy 0, policy_version 1911476 (0.0008) [2023-12-26 14:51:41,859][123091] Updated weights for policy 0, policy_version 1911486 (0.0011) [2023-12-26 14:51:41,923][123091] Updated weights for policy 0, policy_version 1911496 (0.0010) [2023-12-26 14:51:42,408][123090] Updated weights for policy 1, policy_version 1899495 (0.0009) [2023-12-26 14:51:42,466][123090] Updated weights for policy 1, policy_version 1899505 (0.0008) [2023-12-26 14:51:42,526][123090] Updated weights for policy 1, policy_version 1899515 (0.0008) [2023-12-26 14:51:42,618][123091] Updated weights for policy 0, policy_version 1911506 (0.0007) [2023-12-26 14:51:42,684][123091] Updated weights for policy 0, policy_version 1911516 (0.0011) [2023-12-26 14:51:42,747][123091] Updated weights for policy 0, policy_version 1911526 (0.0010) [2023-12-26 14:51:42,802][123091] Updated weights for policy 0, policy_version 1911536 (0.0011) [2023-12-26 14:51:43,238][123090] Updated weights for policy 1, policy_version 1899525 (0.0007) [2023-12-26 14:51:43,304][123090] Updated weights for policy 1, policy_version 1899535 (0.0005) [2023-12-26 14:51:43,365][123090] Updated weights for policy 1, policy_version 1899545 (0.0005) [2023-12-26 14:51:43,627][123091] Updated weights for policy 0, policy_version 1911546 (0.0010) [2023-12-26 14:51:43,675][123091] Updated weights for policy 0, policy_version 1911556 (0.0010) [2023-12-26 14:51:43,722][123091] Updated weights for policy 0, policy_version 1911566 (0.0010) [2023-12-26 14:51:43,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 975650816. Throughput: 0: 8923.1, 1: 8893.4. Samples: 975639732. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:43,785][121949] Avg episode reward: [(0, '6066.373'), (1, '5792.895')] [2023-12-26 14:51:43,997][123090] Updated weights for policy 1, policy_version 1899555 (0.0005) [2023-12-26 14:51:44,045][123090] Updated weights for policy 1, policy_version 1899565 (0.0008) [2023-12-26 14:51:44,094][123090] Updated weights for policy 1, policy_version 1899575 (0.0008) [2023-12-26 14:51:44,560][123091] Updated weights for policy 0, policy_version 1911576 (0.0010) [2023-12-26 14:51:44,621][123091] Updated weights for policy 0, policy_version 1911586 (0.0010) [2023-12-26 14:51:44,686][123091] Updated weights for policy 0, policy_version 1911596 (0.0010) [2023-12-26 14:51:44,906][123090] Updated weights for policy 1, policy_version 1899585 (0.0009) [2023-12-26 14:51:44,977][123090] Updated weights for policy 1, policy_version 1899595 (0.0006) [2023-12-26 14:51:45,043][123090] Updated weights for policy 1, policy_version 1899605 (0.0010) [2023-12-26 14:51:45,108][123090] Updated weights for policy 1, policy_version 1899615 (0.0010) [2023-12-26 14:51:45,441][123091] Updated weights for policy 0, policy_version 1911606 (0.0007) [2023-12-26 14:51:45,501][123091] Updated weights for policy 0, policy_version 1911616 (0.0008) [2023-12-26 14:51:45,576][123091] Updated weights for policy 0, policy_version 1911626 (0.0005) [2023-12-26 14:51:45,873][123090] Updated weights for policy 1, policy_version 1899625 (0.0010) [2023-12-26 14:51:45,935][123090] Updated weights for policy 1, policy_version 1899635 (0.0010) [2023-12-26 14:51:45,990][123090] Updated weights for policy 1, policy_version 1899645 (0.0010) [2023-12-26 14:51:46,296][123091] Updated weights for policy 0, policy_version 1911636 (0.0007) [2023-12-26 14:51:46,352][123091] Updated weights for policy 0, policy_version 1911646 (0.0009) [2023-12-26 14:51:46,401][123091] Updated weights for policy 0, policy_version 1911656 (0.0009) [2023-12-26 14:51:46,819][123090] Updated weights for policy 1, policy_version 1899655 (0.0010) [2023-12-26 14:51:46,881][123090] Updated weights for policy 1, policy_version 1899665 (0.0010) [2023-12-26 14:51:46,939][123090] Updated weights for policy 1, policy_version 1899675 (0.0010) [2023-12-26 14:51:47,172][123091] Updated weights for policy 0, policy_version 1911666 (0.0009) [2023-12-26 14:51:47,220][123091] Updated weights for policy 0, policy_version 1911676 (0.0009) [2023-12-26 14:51:47,268][123091] Updated weights for policy 0, policy_version 1911686 (0.0008) [2023-12-26 14:51:47,332][123091] Updated weights for policy 0, policy_version 1911696 (0.0009) [2023-12-26 14:51:47,755][123090] Updated weights for policy 1, policy_version 1899685 (0.0010) [2023-12-26 14:51:47,814][123090] Updated weights for policy 1, policy_version 1899695 (0.0008) [2023-12-26 14:51:47,876][123090] Updated weights for policy 1, policy_version 1899705 (0.0005) [2023-12-26 14:51:48,096][123091] Updated weights for policy 0, policy_version 1911706 (0.0006) [2023-12-26 14:51:48,151][123091] Updated weights for policy 0, policy_version 1911716 (0.0009) [2023-12-26 14:51:48,207][123091] Updated weights for policy 0, policy_version 1911726 (0.0010) [2023-12-26 14:51:48,586][123090] Updated weights for policy 1, policy_version 1899715 (0.0007) [2023-12-26 14:51:48,648][123090] Updated weights for policy 1, policy_version 1899725 (0.0007) [2023-12-26 14:51:48,721][123090] Updated weights for policy 1, policy_version 1899735 (0.0005) [2023-12-26 14:51:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 975740928. Throughput: 0: 8993.5, 1: 8991.7. Samples: 975749180. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:48,785][121949] Avg episode reward: [(0, '6066.895'), (1, '5913.143')] [2023-12-26 14:51:49,124][123091] Updated weights for policy 0, policy_version 1911736 (0.0008) [2023-12-26 14:51:49,195][123091] Updated weights for policy 0, policy_version 1911746 (0.0006) [2023-12-26 14:51:49,275][123091] Updated weights for policy 0, policy_version 1911756 (0.0008) [2023-12-26 14:51:49,403][123090] Updated weights for policy 1, policy_version 1899745 (0.0006) [2023-12-26 14:51:49,471][123090] Updated weights for policy 1, policy_version 1899755 (0.0011) [2023-12-26 14:51:49,540][123090] Updated weights for policy 1, policy_version 1899765 (0.0011) [2023-12-26 14:51:49,596][123090] Updated weights for policy 1, policy_version 1899775 (0.0011) [2023-12-26 14:51:49,990][123091] Updated weights for policy 0, policy_version 1911766 (0.0008) [2023-12-26 14:51:50,042][123091] Updated weights for policy 0, policy_version 1911776 (0.0009) [2023-12-26 14:51:50,090][123091] Updated weights for policy 0, policy_version 1911786 (0.0008) [2023-12-26 14:51:50,387][123090] Updated weights for policy 1, policy_version 1899785 (0.0010) [2023-12-26 14:51:50,438][123090] Updated weights for policy 1, policy_version 1899795 (0.0010) [2023-12-26 14:51:50,486][123090] Updated weights for policy 1, policy_version 1899805 (0.0010) [2023-12-26 14:51:50,971][123091] Updated weights for policy 0, policy_version 1911796 (0.0009) [2023-12-26 14:51:51,038][123091] Updated weights for policy 0, policy_version 1911806 (0.0009) [2023-12-26 14:51:51,106][123091] Updated weights for policy 0, policy_version 1911816 (0.0009) [2023-12-26 14:51:51,359][123090] Updated weights for policy 1, policy_version 1899815 (0.0010) [2023-12-26 14:51:51,431][123090] Updated weights for policy 1, policy_version 1899825 (0.0011) [2023-12-26 14:51:51,501][123090] Updated weights for policy 1, policy_version 1899835 (0.0010) [2023-12-26 14:51:51,926][123091] Updated weights for policy 0, policy_version 1911826 (0.0008) [2023-12-26 14:51:52,004][123091] Updated weights for policy 0, policy_version 1911836 (0.0005) [2023-12-26 14:51:52,077][123091] Updated weights for policy 0, policy_version 1911846 (0.0005) [2023-12-26 14:51:52,149][123091] Updated weights for policy 0, policy_version 1911856 (0.0005) [2023-12-26 14:51:52,220][123090] Updated weights for policy 1, policy_version 1899845 (0.0008) [2023-12-26 14:51:52,288][123090] Updated weights for policy 1, policy_version 1899855 (0.0007) [2023-12-26 14:51:52,358][123090] Updated weights for policy 1, policy_version 1899865 (0.0007) [2023-12-26 14:51:52,862][123091] Updated weights for policy 0, policy_version 1911866 (0.0007) [2023-12-26 14:51:52,915][123091] Updated weights for policy 0, policy_version 1911876 (0.0010) [2023-12-26 14:51:52,974][123091] Updated weights for policy 0, policy_version 1911886 (0.0011) [2023-12-26 14:51:53,075][123090] Updated weights for policy 1, policy_version 1899875 (0.0007) [2023-12-26 14:51:53,138][123090] Updated weights for policy 1, policy_version 1899885 (0.0009) [2023-12-26 14:51:53,202][123090] Updated weights for policy 1, policy_version 1899895 (0.0009) [2023-12-26 14:51:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17886.0, 300 sec: 17828.0). Total num frames: 975822848. Throughput: 0: 8955.7, 1: 8958.7. Samples: 975801004. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:53,784][121949] Avg episode reward: [(0, '6241.961'), (1, '6012.119')] [2023-12-26 14:51:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001899904_486375424.pth... [2023-12-26 14:51:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001898848_486105088.pth [2023-12-26 14:51:53,804][123091] Updated weights for policy 0, policy_version 1911896 (0.0011) [2023-12-26 14:51:53,869][123091] Updated weights for policy 0, policy_version 1911906 (0.0010) [2023-12-26 14:51:53,916][123091] Updated weights for policy 0, policy_version 1911916 (0.0010) [2023-12-26 14:51:53,935][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001911920_489455616.pth... [2023-12-26 14:51:53,938][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001910864_489185280.pth [2023-12-26 14:51:53,941][123090] Updated weights for policy 1, policy_version 1899905 (0.0008) [2023-12-26 14:51:54,002][123090] Updated weights for policy 1, policy_version 1899915 (0.0009) [2023-12-26 14:51:54,064][123090] Updated weights for policy 1, policy_version 1899925 (0.0008) [2023-12-26 14:51:54,123][123090] Updated weights for policy 1, policy_version 1899935 (0.0009) [2023-12-26 14:51:54,737][123091] Updated weights for policy 0, policy_version 1911926 (0.0011) [2023-12-26 14:51:54,797][123091] Updated weights for policy 0, policy_version 1911936 (0.0011) [2023-12-26 14:51:54,852][123091] Updated weights for policy 0, policy_version 1911946 (0.0011) [2023-12-26 14:51:54,949][123090] Updated weights for policy 1, policy_version 1899945 (0.0006) [2023-12-26 14:51:55,017][123090] Updated weights for policy 1, policy_version 1899955 (0.0009) [2023-12-26 14:51:55,080][123090] Updated weights for policy 1, policy_version 1899965 (0.0009) [2023-12-26 14:51:55,688][123091] Updated weights for policy 0, policy_version 1911956 (0.0009) [2023-12-26 14:51:55,744][123091] Updated weights for policy 0, policy_version 1911967 (0.0006) [2023-12-26 14:51:55,791][123091] Updated weights for policy 0, policy_version 1911977 (0.0009) [2023-12-26 14:51:55,901][123090] Updated weights for policy 1, policy_version 1899975 (0.0009) [2023-12-26 14:51:55,956][123090] Updated weights for policy 1, policy_version 1899985 (0.0009) [2023-12-26 14:51:56,010][123090] Updated weights for policy 1, policy_version 1899995 (0.0009) [2023-12-26 14:51:56,586][123091] Updated weights for policy 0, policy_version 1911987 (0.0010) [2023-12-26 14:51:56,637][123091] Updated weights for policy 0, policy_version 1911997 (0.0009) [2023-12-26 14:51:56,688][123091] Updated weights for policy 0, policy_version 1912007 (0.0009) [2023-12-26 14:51:56,862][123090] Updated weights for policy 1, policy_version 1900005 (0.0009) [2023-12-26 14:51:56,919][123090] Updated weights for policy 1, policy_version 1900015 (0.0009) [2023-12-26 14:51:56,974][123090] Updated weights for policy 1, policy_version 1900025 (0.0009) [2023-12-26 14:51:57,520][123091] Updated weights for policy 0, policy_version 1912018 (0.0010) [2023-12-26 14:51:57,579][123091] Updated weights for policy 0, policy_version 1912028 (0.0010) [2023-12-26 14:51:57,644][123091] Updated weights for policy 0, policy_version 1912038 (0.0007) [2023-12-26 14:51:57,700][123091] Updated weights for policy 0, policy_version 1912048 (0.0010) [2023-12-26 14:51:57,829][123090] Updated weights for policy 1, policy_version 1900035 (0.0009) [2023-12-26 14:51:57,895][123090] Updated weights for policy 1, policy_version 1900045 (0.0009) [2023-12-26 14:51:57,950][123090] Updated weights for policy 1, policy_version 1900055 (0.0009) [2023-12-26 14:51:58,554][123091] Updated weights for policy 0, policy_version 1912058 (0.0009) [2023-12-26 14:51:58,621][123091] Updated weights for policy 0, policy_version 1912068 (0.0009) [2023-12-26 14:51:58,690][123091] Updated weights for policy 0, policy_version 1912078 (0.0008) [2023-12-26 14:51:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.8, 300 sec: 17800.2). Total num frames: 975912960. Throughput: 0: 8930.3, 1: 9019.6. Samples: 975907188. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:51:58,785][121949] Avg episode reward: [(0, '6257.553'), (1, '5982.908')] [2023-12-26 14:51:58,855][123090] Updated weights for policy 1, policy_version 1900065 (0.0008) [2023-12-26 14:51:58,931][123090] Updated weights for policy 1, policy_version 1900075 (0.0008) [2023-12-26 14:51:58,990][123090] Updated weights for policy 1, policy_version 1900085 (0.0010) [2023-12-26 14:51:59,051][123090] Updated weights for policy 1, policy_version 1900096 (0.0010) [2023-12-26 14:51:59,476][123091] Updated weights for policy 0, policy_version 1912088 (0.0008) [2023-12-26 14:51:59,543][123091] Updated weights for policy 0, policy_version 1912098 (0.0006) [2023-12-26 14:51:59,618][123091] Updated weights for policy 0, policy_version 1912108 (0.0007) [2023-12-26 14:51:59,909][123090] Updated weights for policy 1, policy_version 1900106 (0.0010) [2023-12-26 14:51:59,973][123090] Updated weights for policy 1, policy_version 1900116 (0.0009) [2023-12-26 14:52:00,039][123090] Updated weights for policy 1, policy_version 1900126 (0.0006) [2023-12-26 14:52:00,339][123091] Updated weights for policy 0, policy_version 1912118 (0.0008) [2023-12-26 14:52:00,390][123091] Updated weights for policy 0, policy_version 1912128 (0.0010) [2023-12-26 14:52:00,437][123091] Updated weights for policy 0, policy_version 1912138 (0.0010) [2023-12-26 14:52:00,672][123090] Updated weights for policy 1, policy_version 1900136 (0.0005) [2023-12-26 14:52:00,728][123090] Updated weights for policy 1, policy_version 1900146 (0.0005) [2023-12-26 14:52:00,777][123090] Updated weights for policy 1, policy_version 1900156 (0.0005) [2023-12-26 14:52:01,176][123091] Updated weights for policy 0, policy_version 1912148 (0.0010) [2023-12-26 14:52:01,230][123091] Updated weights for policy 0, policy_version 1912158 (0.0010) [2023-12-26 14:52:01,286][123091] Updated weights for policy 0, policy_version 1912168 (0.0010) [2023-12-26 14:52:01,547][123090] Updated weights for policy 1, policy_version 1900167 (0.0006) [2023-12-26 14:52:01,601][123090] Updated weights for policy 1, policy_version 1900177 (0.0009) [2023-12-26 14:52:01,668][123090] Updated weights for policy 1, policy_version 1900187 (0.0010) [2023-12-26 14:52:02,116][123091] Updated weights for policy 0, policy_version 1912178 (0.0010) [2023-12-26 14:52:02,181][123091] Updated weights for policy 0, policy_version 1912188 (0.0009) [2023-12-26 14:52:02,235][123091] Updated weights for policy 0, policy_version 1912198 (0.0009) [2023-12-26 14:52:02,296][123091] Updated weights for policy 0, policy_version 1912208 (0.0006) [2023-12-26 14:52:02,473][123090] Updated weights for policy 1, policy_version 1900197 (0.0010) [2023-12-26 14:52:02,542][123090] Updated weights for policy 1, policy_version 1900207 (0.0010) [2023-12-26 14:52:02,605][123090] Updated weights for policy 1, policy_version 1900217 (0.0009) [2023-12-26 14:52:03,045][123091] Updated weights for policy 0, policy_version 1912218 (0.0007) [2023-12-26 14:52:03,107][123091] Updated weights for policy 0, policy_version 1912228 (0.0010) [2023-12-26 14:52:03,161][123091] Updated weights for policy 0, policy_version 1912238 (0.0010) [2023-12-26 14:52:03,440][123090] Updated weights for policy 1, policy_version 1900227 (0.0009) [2023-12-26 14:52:03,506][123090] Updated weights for policy 1, policy_version 1900237 (0.0008) [2023-12-26 14:52:03,562][123090] Updated weights for policy 1, policy_version 1900247 (0.0009) [2023-12-26 14:52:03,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 976003072. Throughput: 0: 8901.1, 1: 8980.0. Samples: 976014156. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:03,785][121949] Avg episode reward: [(0, '6315.308'), (1, '5831.346')] [2023-12-26 14:52:03,981][123091] Updated weights for policy 0, policy_version 1912248 (0.0007) [2023-12-26 14:52:04,044][123091] Updated weights for policy 0, policy_version 1912258 (0.0010) [2023-12-26 14:52:04,103][123091] Updated weights for policy 0, policy_version 1912268 (0.0011) [2023-12-26 14:52:04,359][123090] Updated weights for policy 1, policy_version 1900257 (0.0010) [2023-12-26 14:52:04,431][123090] Updated weights for policy 1, policy_version 1900267 (0.0010) [2023-12-26 14:52:04,485][123090] Updated weights for policy 1, policy_version 1900277 (0.0010) [2023-12-26 14:52:04,540][123090] Updated weights for policy 1, policy_version 1900287 (0.0010) [2023-12-26 14:52:04,823][123091] Updated weights for policy 0, policy_version 1912278 (0.0011) [2023-12-26 14:52:04,879][123091] Updated weights for policy 0, policy_version 1912288 (0.0010) [2023-12-26 14:52:04,938][123091] Updated weights for policy 0, policy_version 1912298 (0.0010) [2023-12-26 14:52:05,353][123090] Updated weights for policy 1, policy_version 1900297 (0.0006) [2023-12-26 14:52:05,403][123090] Updated weights for policy 1, policy_version 1900307 (0.0005) [2023-12-26 14:52:05,461][123090] Updated weights for policy 1, policy_version 1900317 (0.0005) [2023-12-26 14:52:05,738][123091] Updated weights for policy 0, policy_version 1912308 (0.0010) [2023-12-26 14:52:05,802][123091] Updated weights for policy 0, policy_version 1912318 (0.0010) [2023-12-26 14:52:05,876][123091] Updated weights for policy 0, policy_version 1912328 (0.0010) [2023-12-26 14:52:06,160][123090] Updated weights for policy 1, policy_version 1900327 (0.0008) [2023-12-26 14:52:06,226][123090] Updated weights for policy 1, policy_version 1900337 (0.0009) [2023-12-26 14:52:06,286][123090] Updated weights for policy 1, policy_version 1900347 (0.0010) [2023-12-26 14:52:06,561][123091] Updated weights for policy 0, policy_version 1912338 (0.0005) [2023-12-26 14:52:06,625][123091] Updated weights for policy 0, policy_version 1912348 (0.0005) [2023-12-26 14:52:06,683][123091] Updated weights for policy 0, policy_version 1912358 (0.0005) [2023-12-26 14:52:06,751][123091] Updated weights for policy 0, policy_version 1912368 (0.0005) [2023-12-26 14:52:07,201][123090] Updated weights for policy 1, policy_version 1900357 (0.0010) [2023-12-26 14:52:07,253][123090] Updated weights for policy 1, policy_version 1900367 (0.0007) [2023-12-26 14:52:07,305][123090] Updated weights for policy 1, policy_version 1900377 (0.0005) [2023-12-26 14:52:07,449][123091] Updated weights for policy 0, policy_version 1912378 (0.0006) [2023-12-26 14:52:07,517][123091] Updated weights for policy 0, policy_version 1912388 (0.0006) [2023-12-26 14:52:07,575][123091] Updated weights for policy 0, policy_version 1912398 (0.0006) [2023-12-26 14:52:07,980][123090] Updated weights for policy 1, policy_version 1900387 (0.0005) [2023-12-26 14:52:08,035][123090] Updated weights for policy 1, policy_version 1900397 (0.0005) [2023-12-26 14:52:08,098][123090] Updated weights for policy 1, policy_version 1900407 (0.0008) [2023-12-26 14:52:08,337][123091] Updated weights for policy 0, policy_version 1912408 (0.0010) [2023-12-26 14:52:08,406][123091] Updated weights for policy 0, policy_version 1912418 (0.0009) [2023-12-26 14:52:08,468][123091] Updated weights for policy 0, policy_version 1912428 (0.0008) [2023-12-26 14:52:08,763][123090] Updated weights for policy 1, policy_version 1900417 (0.0009) [2023-12-26 14:52:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 976093184. Throughput: 0: 8968.0, 1: 8994.2. Samples: 976068972. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:08,784][121949] Avg episode reward: [(0, '6384.988'), (1, '5966.047')] [2023-12-26 14:52:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001912432_489586688.pth... [2023-12-26 14:52:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001911376_489316352.pth [2023-12-26 14:52:08,828][123090] Updated weights for policy 1, policy_version 1900427 (0.0010) [2023-12-26 14:52:08,889][123090] Updated weights for policy 1, policy_version 1900437 (0.0009) [2023-12-26 14:52:08,953][123090] Updated weights for policy 1, policy_version 1900447 (0.0010) [2023-12-26 14:52:08,955][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001900448_486514688.pth... [2023-12-26 14:52:08,960][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001899392_486244352.pth [2023-12-26 14:52:09,241][123091] Updated weights for policy 0, policy_version 1912438 (0.0010) [2023-12-26 14:52:09,314][123091] Updated weights for policy 0, policy_version 1912448 (0.0009) [2023-12-26 14:52:09,383][123091] Updated weights for policy 0, policy_version 1912458 (0.0010) [2023-12-26 14:52:09,832][123090] Updated weights for policy 1, policy_version 1900457 (0.0008) [2023-12-26 14:52:09,896][123090] Updated weights for policy 1, policy_version 1900467 (0.0010) [2023-12-26 14:52:09,969][123090] Updated weights for policy 1, policy_version 1900477 (0.0007) [2023-12-26 14:52:10,261][123091] Updated weights for policy 0, policy_version 1912468 (0.0010) [2023-12-26 14:52:10,321][123091] Updated weights for policy 0, policy_version 1912478 (0.0009) [2023-12-26 14:52:10,394][123091] Updated weights for policy 0, policy_version 1912488 (0.0008) [2023-12-26 14:52:10,674][123090] Updated weights for policy 1, policy_version 1900487 (0.0009) [2023-12-26 14:52:10,732][123090] Updated weights for policy 1, policy_version 1900497 (0.0010) [2023-12-26 14:52:10,796][123090] Updated weights for policy 1, policy_version 1900507 (0.0010) [2023-12-26 14:52:11,207][123091] Updated weights for policy 0, policy_version 1912498 (0.0009) [2023-12-26 14:52:11,274][123091] Updated weights for policy 0, policy_version 1912508 (0.0011) [2023-12-26 14:52:11,340][123091] Updated weights for policy 0, policy_version 1912518 (0.0010) [2023-12-26 14:52:11,415][123091] Updated weights for policy 0, policy_version 1912528 (0.0016) [2023-12-26 14:52:11,660][123090] Updated weights for policy 1, policy_version 1900517 (0.0010) [2023-12-26 14:52:11,730][123090] Updated weights for policy 1, policy_version 1900527 (0.0006) [2023-12-26 14:52:11,796][123090] Updated weights for policy 1, policy_version 1900537 (0.0010) [2023-12-26 14:52:12,230][123091] Updated weights for policy 0, policy_version 1912538 (0.0011) [2023-12-26 14:52:12,294][123091] Updated weights for policy 0, policy_version 1912548 (0.0011) [2023-12-26 14:52:12,370][123091] Updated weights for policy 0, policy_version 1912558 (0.0008) [2023-12-26 14:52:12,610][123090] Updated weights for policy 1, policy_version 1900547 (0.0009) [2023-12-26 14:52:12,674][123090] Updated weights for policy 1, policy_version 1900557 (0.0005) [2023-12-26 14:52:12,722][123090] Updated weights for policy 1, policy_version 1900567 (0.0005) [2023-12-26 14:52:13,193][123091] Updated weights for policy 0, policy_version 1912568 (0.0009) [2023-12-26 14:52:13,242][123091] Updated weights for policy 0, policy_version 1912578 (0.0010) [2023-12-26 14:52:13,295][123091] Updated weights for policy 0, policy_version 1912588 (0.0009) [2023-12-26 14:52:13,422][123090] Updated weights for policy 1, policy_version 1900577 (0.0006) [2023-12-26 14:52:13,491][123090] Updated weights for policy 1, policy_version 1900587 (0.0009) [2023-12-26 14:52:13,569][123090] Updated weights for policy 1, policy_version 1900597 (0.0010) [2023-12-26 14:52:13,637][123090] Updated weights for policy 1, policy_version 1900607 (0.0010) [2023-12-26 14:52:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 976183296. Throughput: 0: 8931.8, 1: 8957.8. Samples: 976174852. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:13,785][121949] Avg episode reward: [(0, '6338.295'), (1, '6013.955')] [2023-12-26 14:52:13,990][123091] Updated weights for policy 0, policy_version 1912598 (0.0009) [2023-12-26 14:52:14,051][123091] Updated weights for policy 0, policy_version 1912608 (0.0009) [2023-12-26 14:52:14,117][123091] Updated weights for policy 0, policy_version 1912618 (0.0009) [2023-12-26 14:52:14,433][123090] Updated weights for policy 1, policy_version 1900617 (0.0010) [2023-12-26 14:52:14,488][123090] Updated weights for policy 1, policy_version 1900627 (0.0010) [2023-12-26 14:52:14,539][123090] Updated weights for policy 1, policy_version 1900637 (0.0010) [2023-12-26 14:52:14,852][123091] Updated weights for policy 0, policy_version 1912628 (0.0008) [2023-12-26 14:52:14,904][123091] Updated weights for policy 0, policy_version 1912638 (0.0010) [2023-12-26 14:52:14,963][123091] Updated weights for policy 0, policy_version 1912648 (0.0009) [2023-12-26 14:52:15,376][123090] Updated weights for policy 1, policy_version 1900647 (0.0010) [2023-12-26 14:52:15,434][123090] Updated weights for policy 1, policy_version 1900657 (0.0009) [2023-12-26 14:52:15,483][123090] Updated weights for policy 1, policy_version 1900667 (0.0009) [2023-12-26 14:52:15,813][123091] Updated weights for policy 0, policy_version 1912658 (0.0009) [2023-12-26 14:52:15,865][123091] Updated weights for policy 0, policy_version 1912668 (0.0009) [2023-12-26 14:52:15,920][123091] Updated weights for policy 0, policy_version 1912680 (0.0011) [2023-12-26 14:52:16,221][123090] Updated weights for policy 1, policy_version 1900677 (0.0007) [2023-12-26 14:52:16,291][123090] Updated weights for policy 1, policy_version 1900687 (0.0006) [2023-12-26 14:52:16,359][123090] Updated weights for policy 1, policy_version 1900697 (0.0007) [2023-12-26 14:52:16,896][123091] Updated weights for policy 0, policy_version 1912691 (0.0010) [2023-12-26 14:52:16,958][123091] Updated weights for policy 0, policy_version 1912701 (0.0010) [2023-12-26 14:52:16,965][123090] Updated weights for policy 1, policy_version 1900707 (0.0005) [2023-12-26 14:52:17,008][123091] Updated weights for policy 0, policy_version 1912711 (0.0009) [2023-12-26 14:52:17,022][123090] Updated weights for policy 1, policy_version 1900717 (0.0008) [2023-12-26 14:52:17,077][123090] Updated weights for policy 1, policy_version 1900727 (0.0010) [2023-12-26 14:52:17,818][123090] Updated weights for policy 1, policy_version 1900737 (0.0010) [2023-12-26 14:52:17,881][123090] Updated weights for policy 1, policy_version 1900747 (0.0010) [2023-12-26 14:52:17,905][123091] Updated weights for policy 0, policy_version 1912721 (0.0008) [2023-12-26 14:52:17,944][123090] Updated weights for policy 1, policy_version 1900757 (0.0008) [2023-12-26 14:52:17,959][123091] Updated weights for policy 0, policy_version 1912731 (0.0008) [2023-12-26 14:52:17,992][123090] Updated weights for policy 1, policy_version 1900767 (0.0010) [2023-12-26 14:52:18,004][123091] Updated weights for policy 0, policy_version 1912741 (0.0006) [2023-12-26 14:52:18,048][123091] Updated weights for policy 0, policy_version 1912751 (0.0005) [2023-12-26 14:52:18,781][123090] Updated weights for policy 1, policy_version 1900777 (0.0006) [2023-12-26 14:52:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 976265216. Throughput: 0: 8877.2, 1: 8977.2. Samples: 976282868. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:18,784][121949] Avg episode reward: [(0, '6259.504'), (1, '5933.006')] [2023-12-26 14:52:18,855][123090] Updated weights for policy 1, policy_version 1900787 (0.0007) [2023-12-26 14:52:18,892][123091] Updated weights for policy 0, policy_version 1912761 (0.0007) [2023-12-26 14:52:18,917][123090] Updated weights for policy 1, policy_version 1900797 (0.0009) [2023-12-26 14:52:18,958][123091] Updated weights for policy 0, policy_version 1912771 (0.0008) [2023-12-26 14:52:19,022][123091] Updated weights for policy 0, policy_version 1912781 (0.0009) [2023-12-26 14:52:19,685][123090] Updated weights for policy 1, policy_version 1900807 (0.0009) [2023-12-26 14:52:19,741][123090] Updated weights for policy 1, policy_version 1900817 (0.0008) [2023-12-26 14:52:19,788][123091] Updated weights for policy 0, policy_version 1912791 (0.0006) [2023-12-26 14:52:19,807][123090] Updated weights for policy 1, policy_version 1900827 (0.0007) [2023-12-26 14:52:19,853][123091] Updated weights for policy 0, policy_version 1912801 (0.0009) [2023-12-26 14:52:19,920][123091] Updated weights for policy 0, policy_version 1912811 (0.0010) [2023-12-26 14:52:20,634][123090] Updated weights for policy 1, policy_version 1900837 (0.0009) [2023-12-26 14:52:20,692][123090] Updated weights for policy 1, policy_version 1900847 (0.0010) [2023-12-26 14:52:20,755][123090] Updated weights for policy 1, policy_version 1900857 (0.0010) [2023-12-26 14:52:20,807][123091] Updated weights for policy 0, policy_version 1912821 (0.0009) [2023-12-26 14:52:20,866][123091] Updated weights for policy 0, policy_version 1912831 (0.0009) [2023-12-26 14:52:20,928][123091] Updated weights for policy 0, policy_version 1912841 (0.0010) [2023-12-26 14:52:21,603][123090] Updated weights for policy 1, policy_version 1900867 (0.0009) [2023-12-26 14:52:21,669][123090] Updated weights for policy 1, policy_version 1900877 (0.0008) [2023-12-26 14:52:21,744][123090] Updated weights for policy 1, policy_version 1900887 (0.0008) [2023-12-26 14:52:21,819][123091] Updated weights for policy 0, policy_version 1912851 (0.0009) [2023-12-26 14:52:21,879][123091] Updated weights for policy 0, policy_version 1912861 (0.0009) [2023-12-26 14:52:21,932][123091] Updated weights for policy 0, policy_version 1912871 (0.0010) [2023-12-26 14:52:22,559][123090] Updated weights for policy 1, policy_version 1900897 (0.0008) [2023-12-26 14:52:22,612][123090] Updated weights for policy 1, policy_version 1900907 (0.0009) [2023-12-26 14:52:22,670][123090] Updated weights for policy 1, policy_version 1900917 (0.0009) [2023-12-26 14:52:22,732][123090] Updated weights for policy 1, policy_version 1900927 (0.0008) [2023-12-26 14:52:22,760][123091] Updated weights for policy 0, policy_version 1912881 (0.0010) [2023-12-26 14:52:22,813][123091] Updated weights for policy 0, policy_version 1912891 (0.0010) [2023-12-26 14:52:22,863][123091] Updated weights for policy 0, policy_version 1912901 (0.0010) [2023-12-26 14:52:22,923][123091] Updated weights for policy 0, policy_version 1912912 (0.0010) [2023-12-26 14:52:23,568][123090] Updated weights for policy 1, policy_version 1900937 (0.0005) [2023-12-26 14:52:23,638][123090] Updated weights for policy 1, policy_version 1900947 (0.0005) [2023-12-26 14:52:23,702][123090] Updated weights for policy 1, policy_version 1900957 (0.0005) [2023-12-26 14:52:23,776][123091] Updated weights for policy 0, policy_version 1912922 (0.0006) [2023-12-26 14:52:23,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 976355328. Throughput: 0: 8808.9, 1: 8935.9. Samples: 976333704. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:23,785][121949] Avg episode reward: [(0, '6278.720'), (1, '5938.842')] [2023-12-26 14:52:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001900960_486645760.pth... [2023-12-26 14:52:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001899904_486375424.pth [2023-12-26 14:52:23,843][123091] Updated weights for policy 0, policy_version 1912932 (0.0005) [2023-12-26 14:52:23,916][123091] Updated weights for policy 0, policy_version 1912942 (0.0007) [2023-12-26 14:52:23,930][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001912944_489717760.pth... [2023-12-26 14:52:23,934][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001911920_489455616.pth [2023-12-26 14:52:24,300][123090] Updated weights for policy 1, policy_version 1900967 (0.0005) [2023-12-26 14:52:24,368][123090] Updated weights for policy 1, policy_version 1900977 (0.0009) [2023-12-26 14:52:24,437][123090] Updated weights for policy 1, policy_version 1900987 (0.0009) [2023-12-26 14:52:24,697][123091] Updated weights for policy 0, policy_version 1912952 (0.0010) [2023-12-26 14:52:24,768][123091] Updated weights for policy 0, policy_version 1912962 (0.0011) [2023-12-26 14:52:24,839][123091] Updated weights for policy 0, policy_version 1912972 (0.0011) [2023-12-26 14:52:25,191][123090] Updated weights for policy 1, policy_version 1900997 (0.0008) [2023-12-26 14:52:25,242][123090] Updated weights for policy 1, policy_version 1901007 (0.0005) [2023-12-26 14:52:25,305][123090] Updated weights for policy 1, policy_version 1901017 (0.0005) [2023-12-26 14:52:25,645][123091] Updated weights for policy 0, policy_version 1912982 (0.0010) [2023-12-26 14:52:25,704][123091] Updated weights for policy 0, policy_version 1912992 (0.0005) [2023-12-26 14:52:25,772][123091] Updated weights for policy 0, policy_version 1913002 (0.0010) [2023-12-26 14:52:26,007][123090] Updated weights for policy 1, policy_version 1901027 (0.0005) [2023-12-26 14:52:26,060][123090] Updated weights for policy 1, policy_version 1901037 (0.0005) [2023-12-26 14:52:26,114][123090] Updated weights for policy 1, policy_version 1901047 (0.0005) [2023-12-26 14:52:26,445][123091] Updated weights for policy 0, policy_version 1913012 (0.0006) [2023-12-26 14:52:26,500][123091] Updated weights for policy 0, policy_version 1913022 (0.0005) [2023-12-26 14:52:26,554][123091] Updated weights for policy 0, policy_version 1913032 (0.0005) [2023-12-26 14:52:26,792][123090] Updated weights for policy 1, policy_version 1901057 (0.0006) [2023-12-26 14:52:26,862][123090] Updated weights for policy 1, policy_version 1901067 (0.0005) [2023-12-26 14:52:26,920][123090] Updated weights for policy 1, policy_version 1901077 (0.0005) [2023-12-26 14:52:26,966][123090] Updated weights for policy 1, policy_version 1901087 (0.0005) [2023-12-26 14:52:27,197][123091] Updated weights for policy 0, policy_version 1913042 (0.0007) [2023-12-26 14:52:27,244][123091] Updated weights for policy 0, policy_version 1913052 (0.0005) [2023-12-26 14:52:27,297][123091] Updated weights for policy 0, policy_version 1913062 (0.0005) [2023-12-26 14:52:27,354][123091] Updated weights for policy 0, policy_version 1913072 (0.0008) [2023-12-26 14:52:27,627][123090] Updated weights for policy 1, policy_version 1901097 (0.0005) [2023-12-26 14:52:27,696][123090] Updated weights for policy 1, policy_version 1901107 (0.0005) [2023-12-26 14:52:27,767][123090] Updated weights for policy 1, policy_version 1901117 (0.0006) [2023-12-26 14:52:28,137][123091] Updated weights for policy 0, policy_version 1913082 (0.0005) [2023-12-26 14:52:28,204][123091] Updated weights for policy 0, policy_version 1913092 (0.0005) [2023-12-26 14:52:28,251][123091] Updated weights for policy 0, policy_version 1913102 (0.0005) [2023-12-26 14:52:28,381][123090] Updated weights for policy 1, policy_version 1901127 (0.0007) [2023-12-26 14:52:28,451][123090] Updated weights for policy 1, policy_version 1901137 (0.0007) [2023-12-26 14:52:28,512][123090] Updated weights for policy 1, policy_version 1901147 (0.0009) [2023-12-26 14:52:28,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 976453632. Throughput: 0: 8816.6, 1: 9083.0. Samples: 976445212. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:28,785][121949] Avg episode reward: [(0, '6150.862'), (1, '5897.775')] [2023-12-26 14:52:28,988][123091] Updated weights for policy 0, policy_version 1913112 (0.0007) [2023-12-26 14:52:29,042][123091] Updated weights for policy 0, policy_version 1913122 (0.0007) [2023-12-26 14:52:29,100][123091] Updated weights for policy 0, policy_version 1913132 (0.0008) [2023-12-26 14:52:29,367][123090] Updated weights for policy 1, policy_version 1901157 (0.0009) [2023-12-26 14:52:29,417][123090] Updated weights for policy 1, policy_version 1901167 (0.0010) [2023-12-26 14:52:29,468][123090] Updated weights for policy 1, policy_version 1901177 (0.0009) [2023-12-26 14:52:29,916][123091] Updated weights for policy 0, policy_version 1913142 (0.0010) [2023-12-26 14:52:29,990][123091] Updated weights for policy 0, policy_version 1913152 (0.0010) [2023-12-26 14:52:30,041][123091] Updated weights for policy 0, policy_version 1913162 (0.0008) [2023-12-26 14:52:30,393][123090] Updated weights for policy 1, policy_version 1901188 (0.0010) [2023-12-26 14:52:30,463][123090] Updated weights for policy 1, policy_version 1901198 (0.0008) [2023-12-26 14:52:30,520][123090] Updated weights for policy 1, policy_version 1901208 (0.0009) [2023-12-26 14:52:30,820][123091] Updated weights for policy 0, policy_version 1913172 (0.0008) [2023-12-26 14:52:30,874][123091] Updated weights for policy 0, policy_version 1913182 (0.0006) [2023-12-26 14:52:30,934][123091] Updated weights for policy 0, policy_version 1913192 (0.0006) [2023-12-26 14:52:31,328][123090] Updated weights for policy 1, policy_version 1901218 (0.0009) [2023-12-26 14:52:31,400][123090] Updated weights for policy 1, policy_version 1901228 (0.0010) [2023-12-26 14:52:31,461][123090] Updated weights for policy 1, policy_version 1901238 (0.0009) [2023-12-26 14:52:31,517][123090] Updated weights for policy 1, policy_version 1901248 (0.0009) [2023-12-26 14:52:31,724][123091] Updated weights for policy 0, policy_version 1913202 (0.0009) [2023-12-26 14:52:31,780][123091] Updated weights for policy 0, policy_version 1913212 (0.0009) [2023-12-26 14:52:31,837][123091] Updated weights for policy 0, policy_version 1913222 (0.0009) [2023-12-26 14:52:31,896][123091] Updated weights for policy 0, policy_version 1913232 (0.0008) [2023-12-26 14:52:32,370][123090] Updated weights for policy 1, policy_version 1901258 (0.0008) [2023-12-26 14:52:32,433][123090] Updated weights for policy 1, policy_version 1901268 (0.0006) [2023-12-26 14:52:32,489][123090] Updated weights for policy 1, policy_version 1901278 (0.0005) [2023-12-26 14:52:32,625][123091] Updated weights for policy 0, policy_version 1913242 (0.0010) [2023-12-26 14:52:32,681][123091] Updated weights for policy 0, policy_version 1913252 (0.0010) [2023-12-26 14:52:32,740][123091] Updated weights for policy 0, policy_version 1913262 (0.0010) [2023-12-26 14:52:33,285][123090] Updated weights for policy 1, policy_version 1901288 (0.0007) [2023-12-26 14:52:33,356][123090] Updated weights for policy 1, policy_version 1901298 (0.0007) [2023-12-26 14:52:33,423][123090] Updated weights for policy 1, policy_version 1901308 (0.0010) [2023-12-26 14:52:33,485][123091] Updated weights for policy 0, policy_version 1913272 (0.0006) [2023-12-26 14:52:33,553][123091] Updated weights for policy 0, policy_version 1913282 (0.0005) [2023-12-26 14:52:33,617][123091] Updated weights for policy 0, policy_version 1913292 (0.0005) [2023-12-26 14:52:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 976543744. Throughput: 0: 8866.5, 1: 8982.0. Samples: 976552360. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:33,785][121949] Avg episode reward: [(0, '6096.340'), (1, '5797.361')] [2023-12-26 14:52:34,170][123090] Updated weights for policy 1, policy_version 1901318 (0.0010) [2023-12-26 14:52:34,231][123090] Updated weights for policy 1, policy_version 1901328 (0.0011) [2023-12-26 14:52:34,273][123091] Updated weights for policy 0, policy_version 1913302 (0.0007) [2023-12-26 14:52:34,299][123090] Updated weights for policy 1, policy_version 1901338 (0.0011) [2023-12-26 14:52:34,326][123091] Updated weights for policy 0, policy_version 1913312 (0.0008) [2023-12-26 14:52:34,376][123091] Updated weights for policy 0, policy_version 1913322 (0.0009) [2023-12-26 14:52:35,046][123090] Updated weights for policy 1, policy_version 1901348 (0.0009) [2023-12-26 14:52:35,054][123091] Updated weights for policy 0, policy_version 1913332 (0.0006) [2023-12-26 14:52:35,104][123090] Updated weights for policy 1, policy_version 1901358 (0.0008) [2023-12-26 14:52:35,115][123091] Updated weights for policy 0, policy_version 1913342 (0.0007) [2023-12-26 14:52:35,164][123090] Updated weights for policy 1, policy_version 1901368 (0.0011) [2023-12-26 14:52:35,180][123091] Updated weights for policy 0, policy_version 1913352 (0.0009) [2023-12-26 14:52:35,877][123091] Updated weights for policy 0, policy_version 1913362 (0.0008) [2023-12-26 14:52:35,925][123091] Updated weights for policy 0, policy_version 1913372 (0.0005) [2023-12-26 14:52:35,974][123091] Updated weights for policy 0, policy_version 1913382 (0.0006) [2023-12-26 14:52:35,989][123090] Updated weights for policy 1, policy_version 1901378 (0.0010) [2023-12-26 14:52:36,023][123091] Updated weights for policy 0, policy_version 1913392 (0.0006) [2023-12-26 14:52:36,048][123090] Updated weights for policy 1, policy_version 1901388 (0.0010) [2023-12-26 14:52:36,119][123090] Updated weights for policy 1, policy_version 1901398 (0.0010) [2023-12-26 14:52:36,185][123090] Updated weights for policy 1, policy_version 1901408 (0.0011) [2023-12-26 14:52:36,871][123091] Updated weights for policy 0, policy_version 1913402 (0.0009) [2023-12-26 14:52:36,936][123091] Updated weights for policy 0, policy_version 1913412 (0.0009) [2023-12-26 14:52:36,992][123090] Updated weights for policy 1, policy_version 1901418 (0.0011) [2023-12-26 14:52:36,998][123091] Updated weights for policy 0, policy_version 1913422 (0.0006) [2023-12-26 14:52:37,057][123090] Updated weights for policy 1, policy_version 1901428 (0.0008) [2023-12-26 14:52:37,121][123090] Updated weights for policy 1, policy_version 1901438 (0.0010) [2023-12-26 14:52:37,771][123091] Updated weights for policy 0, policy_version 1913432 (0.0009) [2023-12-26 14:52:37,821][123090] Updated weights for policy 1, policy_version 1901448 (0.0006) [2023-12-26 14:52:37,832][123091] Updated weights for policy 0, policy_version 1913442 (0.0009) [2023-12-26 14:52:37,866][123090] Updated weights for policy 1, policy_version 1901458 (0.0005) [2023-12-26 14:52:37,893][123091] Updated weights for policy 0, policy_version 1913452 (0.0007) [2023-12-26 14:52:37,919][123090] Updated weights for policy 1, policy_version 1901468 (0.0005) [2023-12-26 14:52:38,651][123090] Updated weights for policy 1, policy_version 1901478 (0.0005) [2023-12-26 14:52:38,697][123091] Updated weights for policy 0, policy_version 1913462 (0.0006) [2023-12-26 14:52:38,716][123090] Updated weights for policy 1, policy_version 1901488 (0.0006) [2023-12-26 14:52:38,760][123091] Updated weights for policy 0, policy_version 1913472 (0.0009) [2023-12-26 14:52:38,775][123090] Updated weights for policy 1, policy_version 1901498 (0.0005) [2023-12-26 14:52:38,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 976625664. Throughput: 0: 8937.4, 1: 9002.2. Samples: 976608288. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:38,785][121949] Avg episode reward: [(0, '6195.686'), (1, '5711.766')] [2023-12-26 14:52:38,820][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001901504_486785024.pth... [2023-12-26 14:52:38,820][123091] Updated weights for policy 0, policy_version 1913482 (0.0007) [2023-12-26 14:52:38,825][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001900448_486514688.pth [2023-12-26 14:52:38,862][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001913488_489857024.pth... [2023-12-26 14:52:38,867][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001912432_489586688.pth [2023-12-26 14:52:39,498][123090] Updated weights for policy 1, policy_version 1901508 (0.0008) [2023-12-26 14:52:39,515][123091] Updated weights for policy 0, policy_version 1913492 (0.0008) [2023-12-26 14:52:39,571][123090] Updated weights for policy 1, policy_version 1901518 (0.0006) [2023-12-26 14:52:39,576][123091] Updated weights for policy 0, policy_version 1913502 (0.0008) [2023-12-26 14:52:39,641][123091] Updated weights for policy 0, policy_version 1913512 (0.0009) [2023-12-26 14:52:39,641][123090] Updated weights for policy 1, policy_version 1901528 (0.0009) [2023-12-26 14:52:40,445][123091] Updated weights for policy 0, policy_version 1913522 (0.0010) [2023-12-26 14:52:40,451][123090] Updated weights for policy 1, policy_version 1901538 (0.0007) [2023-12-26 14:52:40,510][123091] Updated weights for policy 0, policy_version 1913532 (0.0009) [2023-12-26 14:52:40,515][123090] Updated weights for policy 1, policy_version 1901548 (0.0009) [2023-12-26 14:52:40,571][123091] Updated weights for policy 0, policy_version 1913542 (0.0008) [2023-12-26 14:52:40,581][123090] Updated weights for policy 1, policy_version 1901558 (0.0008) [2023-12-26 14:52:40,618][123091] Updated weights for policy 0, policy_version 1913552 (0.0009) [2023-12-26 14:52:40,646][123090] Updated weights for policy 1, policy_version 1901568 (0.0008) [2023-12-26 14:52:41,464][123091] Updated weights for policy 0, policy_version 1913562 (0.0008) [2023-12-26 14:52:41,524][123091] Updated weights for policy 0, policy_version 1913572 (0.0008) [2023-12-26 14:52:41,540][123090] Updated weights for policy 1, policy_version 1901578 (0.0008) [2023-12-26 14:52:41,587][123091] Updated weights for policy 0, policy_version 1913582 (0.0007) [2023-12-26 14:52:41,610][123090] Updated weights for policy 1, policy_version 1901588 (0.0008) [2023-12-26 14:52:41,681][123090] Updated weights for policy 1, policy_version 1901598 (0.0008) [2023-12-26 14:52:42,419][123090] Updated weights for policy 1, policy_version 1901608 (0.0008) [2023-12-26 14:52:42,478][123090] Updated weights for policy 1, policy_version 1901618 (0.0008) [2023-12-26 14:52:42,481][123091] Updated weights for policy 0, policy_version 1913592 (0.0009) [2023-12-26 14:52:42,542][123090] Updated weights for policy 1, policy_version 1901628 (0.0010) [2023-12-26 14:52:42,545][123091] Updated weights for policy 0, policy_version 1913602 (0.0006) [2023-12-26 14:52:42,615][123091] Updated weights for policy 0, policy_version 1913612 (0.0009) [2023-12-26 14:52:43,304][123090] Updated weights for policy 1, policy_version 1901638 (0.0009) [2023-12-26 14:52:43,364][123090] Updated weights for policy 1, policy_version 1901648 (0.0008) [2023-12-26 14:52:43,429][123090] Updated weights for policy 1, policy_version 1901658 (0.0008) [2023-12-26 14:52:43,454][123091] Updated weights for policy 0, policy_version 1913622 (0.0008) [2023-12-26 14:52:43,502][123091] Updated weights for policy 0, policy_version 1913632 (0.0009) [2023-12-26 14:52:43,554][123091] Updated weights for policy 0, policy_version 1913642 (0.0009) [2023-12-26 14:52:43,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 976723968. Throughput: 0: 8928.2, 1: 8999.7. Samples: 976713940. Policy #0 lag: (min: 9.0, avg: 21.3, max: 41.0) [2023-12-26 14:52:43,785][121949] Avg episode reward: [(0, '6313.292'), (1, '5640.899')] [2023-12-26 14:52:44,249][123090] Updated weights for policy 1, policy_version 1901668 (0.0009) [2023-12-26 14:52:44,309][123090] Updated weights for policy 1, policy_version 1901678 (0.0009) [2023-12-26 14:52:44,368][123090] Updated weights for policy 1, policy_version 1901689 (0.0010) [2023-12-26 14:52:44,394][123091] Updated weights for policy 0, policy_version 1913652 (0.0008) [2023-12-26 14:52:44,444][123091] Updated weights for policy 0, policy_version 1913662 (0.0005) [2023-12-26 14:52:44,497][123091] Updated weights for policy 0, policy_version 1913672 (0.0005) [2023-12-26 14:52:45,255][123091] Updated weights for policy 0, policy_version 1913682 (0.0005) [2023-12-26 14:52:45,257][123090] Updated weights for policy 1, policy_version 1901699 (0.0010) [2023-12-26 14:52:45,319][123091] Updated weights for policy 0, policy_version 1913692 (0.0008) [2023-12-26 14:52:45,320][123090] Updated weights for policy 1, policy_version 1901709 (0.0009) [2023-12-26 14:52:45,387][123090] Updated weights for policy 1, policy_version 1901719 (0.0009) [2023-12-26 14:52:45,388][123091] Updated weights for policy 0, policy_version 1913702 (0.0007) [2023-12-26 14:52:45,454][123091] Updated weights for policy 0, policy_version 1913712 (0.0008) [2023-12-26 14:52:46,186][123091] Updated weights for policy 0, policy_version 1913722 (0.0007) [2023-12-26 14:52:46,235][123090] Updated weights for policy 1, policy_version 1901729 (0.0008) [2023-12-26 14:52:46,237][123091] Updated weights for policy 0, policy_version 1913732 (0.0005) [2023-12-26 14:52:46,284][123091] Updated weights for policy 0, policy_version 1913742 (0.0005) [2023-12-26 14:52:46,297][123090] Updated weights for policy 1, policy_version 1901739 (0.0010) [2023-12-26 14:52:46,359][123090] Updated weights for policy 1, policy_version 1901749 (0.0010) [2023-12-26 14:52:46,418][123090] Updated weights for policy 1, policy_version 1901759 (0.0010) [2023-12-26 14:52:46,971][123091] Updated weights for policy 0, policy_version 1913752 (0.0009) [2023-12-26 14:52:47,022][123091] Updated weights for policy 0, policy_version 1913762 (0.0008) [2023-12-26 14:52:47,090][123091] Updated weights for policy 0, policy_version 1913772 (0.0005) [2023-12-26 14:52:47,108][123090] Updated weights for policy 1, policy_version 1901769 (0.0006) [2023-12-26 14:52:47,157][123090] Updated weights for policy 1, policy_version 1901779 (0.0005) [2023-12-26 14:52:47,210][123090] Updated weights for policy 1, policy_version 1901789 (0.0009) [2023-12-26 14:52:47,775][123091] Updated weights for policy 0, policy_version 1913782 (0.0006) [2023-12-26 14:52:47,827][123091] Updated weights for policy 0, policy_version 1913792 (0.0005) [2023-12-26 14:52:47,875][123091] Updated weights for policy 0, policy_version 1913802 (0.0005) [2023-12-26 14:52:48,035][123090] Updated weights for policy 1, policy_version 1901799 (0.0007) [2023-12-26 14:52:48,101][123090] Updated weights for policy 1, policy_version 1901809 (0.0006) [2023-12-26 14:52:48,172][123090] Updated weights for policy 1, policy_version 1901819 (0.0006) [2023-12-26 14:52:48,547][123091] Updated weights for policy 0, policy_version 1913812 (0.0005) [2023-12-26 14:52:48,605][123091] Updated weights for policy 0, policy_version 1913822 (0.0010) [2023-12-26 14:52:48,661][123091] Updated weights for policy 0, policy_version 1913832 (0.0010) [2023-12-26 14:52:48,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 976814080. Throughput: 0: 8992.9, 1: 9006.2. Samples: 976824112. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:52:48,784][121949] Avg episode reward: [(0, '6376.803'), (1, '5505.414')] [2023-12-26 14:52:48,862][123090] Updated weights for policy 1, policy_version 1901829 (0.0006) [2023-12-26 14:52:48,914][123090] Updated weights for policy 1, policy_version 1901839 (0.0005) [2023-12-26 14:52:48,974][123090] Updated weights for policy 1, policy_version 1901849 (0.0005) [2023-12-26 14:52:49,442][123091] Updated weights for policy 0, policy_version 1913843 (0.0010) [2023-12-26 14:52:49,505][123091] Updated weights for policy 0, policy_version 1913853 (0.0009) [2023-12-26 14:52:49,572][123091] Updated weights for policy 0, policy_version 1913863 (0.0007) [2023-12-26 14:52:49,735][123090] Updated weights for policy 1, policy_version 1901859 (0.0006) [2023-12-26 14:52:49,795][123090] Updated weights for policy 1, policy_version 1901869 (0.0009) [2023-12-26 14:52:49,854][123090] Updated weights for policy 1, policy_version 1901879 (0.0009) [2023-12-26 14:52:50,360][123091] Updated weights for policy 0, policy_version 1913873 (0.0010) [2023-12-26 14:52:50,417][123091] Updated weights for policy 0, policy_version 1913883 (0.0009) [2023-12-26 14:52:50,471][123091] Updated weights for policy 0, policy_version 1913893 (0.0010) [2023-12-26 14:52:50,526][123091] Updated weights for policy 0, policy_version 1913903 (0.0009) [2023-12-26 14:52:50,733][123090] Updated weights for policy 1, policy_version 1901889 (0.0010) [2023-12-26 14:52:50,795][123090] Updated weights for policy 1, policy_version 1901899 (0.0010) [2023-12-26 14:52:50,851][123090] Updated weights for policy 1, policy_version 1901909 (0.0009) [2023-12-26 14:52:50,903][123090] Updated weights for policy 1, policy_version 1901919 (0.0009) [2023-12-26 14:52:51,381][123091] Updated weights for policy 0, policy_version 1913913 (0.0008) [2023-12-26 14:52:51,446][123091] Updated weights for policy 0, policy_version 1913923 (0.0010) [2023-12-26 14:52:51,508][123091] Updated weights for policy 0, policy_version 1913933 (0.0010) [2023-12-26 14:52:51,792][123090] Updated weights for policy 1, policy_version 1901929 (0.0009) [2023-12-26 14:52:51,859][123090] Updated weights for policy 1, policy_version 1901939 (0.0010) [2023-12-26 14:52:51,930][123090] Updated weights for policy 1, policy_version 1901949 (0.0010) [2023-12-26 14:52:52,277][123091] Updated weights for policy 0, policy_version 1913943 (0.0009) [2023-12-26 14:52:52,345][123091] Updated weights for policy 0, policy_version 1913953 (0.0007) [2023-12-26 14:52:52,409][123091] Updated weights for policy 0, policy_version 1913963 (0.0007) [2023-12-26 14:52:52,806][123090] Updated weights for policy 1, policy_version 1901959 (0.0010) [2023-12-26 14:52:52,864][123090] Updated weights for policy 1, policy_version 1901969 (0.0010) [2023-12-26 14:52:52,927][123090] Updated weights for policy 1, policy_version 1901979 (0.0009) [2023-12-26 14:52:53,169][123091] Updated weights for policy 0, policy_version 1913973 (0.0007) [2023-12-26 14:52:53,215][123091] Updated weights for policy 0, policy_version 1913983 (0.0008) [2023-12-26 14:52:53,264][123091] Updated weights for policy 0, policy_version 1913993 (0.0009) [2023-12-26 14:52:53,772][123090] Updated weights for policy 1, policy_version 1901989 (0.0010) [2023-12-26 14:52:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 976896000. Throughput: 0: 8936.9, 1: 8984.9. Samples: 976875460. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:52:53,785][121949] Avg episode reward: [(0, '6255.299'), (1, '5729.738')] [2023-12-26 14:52:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001914000_489988096.pth... [2023-12-26 14:52:53,800][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001912944_489717760.pth [2023-12-26 14:52:53,838][123090] Updated weights for policy 1, policy_version 1901999 (0.0008) [2023-12-26 14:52:53,894][123090] Updated weights for policy 1, policy_version 1902009 (0.0005) [2023-12-26 14:52:53,933][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001902016_486916096.pth... [2023-12-26 14:52:53,936][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001900960_486645760.pth [2023-12-26 14:52:54,055][123091] Updated weights for policy 0, policy_version 1914003 (0.0008) [2023-12-26 14:52:54,113][123091] Updated weights for policy 0, policy_version 1914013 (0.0005) [2023-12-26 14:52:54,174][123091] Updated weights for policy 0, policy_version 1914023 (0.0005) [2023-12-26 14:52:54,633][123090] Updated weights for policy 1, policy_version 1902019 (0.0007) [2023-12-26 14:52:54,687][123090] Updated weights for policy 1, policy_version 1902029 (0.0010) [2023-12-26 14:52:54,741][123090] Updated weights for policy 1, policy_version 1902040 (0.0010) [2023-12-26 14:52:54,853][123091] Updated weights for policy 0, policy_version 1914033 (0.0005) [2023-12-26 14:52:54,908][123091] Updated weights for policy 0, policy_version 1914043 (0.0005) [2023-12-26 14:52:54,971][123091] Updated weights for policy 0, policy_version 1914053 (0.0007) [2023-12-26 14:52:55,042][123091] Updated weights for policy 0, policy_version 1914063 (0.0007) [2023-12-26 14:52:55,659][123090] Updated weights for policy 1, policy_version 1902051 (0.0010) [2023-12-26 14:52:55,684][123091] Updated weights for policy 0, policy_version 1914073 (0.0006) [2023-12-26 14:52:55,708][123090] Updated weights for policy 1, policy_version 1902061 (0.0009) [2023-12-26 14:52:55,739][123091] Updated weights for policy 0, policy_version 1914083 (0.0007) [2023-12-26 14:52:55,763][123090] Updated weights for policy 1, policy_version 1902071 (0.0007) [2023-12-26 14:52:55,792][123091] Updated weights for policy 0, policy_version 1914093 (0.0006) [2023-12-26 14:52:56,481][123091] Updated weights for policy 0, policy_version 1914103 (0.0007) [2023-12-26 14:52:56,530][123091] Updated weights for policy 0, policy_version 1914113 (0.0008) [2023-12-26 14:52:56,577][123090] Updated weights for policy 1, policy_version 1902081 (0.0009) [2023-12-26 14:52:56,582][123091] Updated weights for policy 0, policy_version 1914123 (0.0007) [2023-12-26 14:52:56,644][123090] Updated weights for policy 1, policy_version 1902091 (0.0009) [2023-12-26 14:52:56,709][123090] Updated weights for policy 1, policy_version 1902101 (0.0009) [2023-12-26 14:52:56,779][123090] Updated weights for policy 1, policy_version 1902111 (0.0008) [2023-12-26 14:52:57,272][123091] Updated weights for policy 0, policy_version 1914133 (0.0006) [2023-12-26 14:52:57,333][123091] Updated weights for policy 0, policy_version 1914143 (0.0010) [2023-12-26 14:52:57,387][123091] Updated weights for policy 0, policy_version 1914153 (0.0010) [2023-12-26 14:52:57,533][123090] Updated weights for policy 1, policy_version 1902121 (0.0005) [2023-12-26 14:52:57,592][123090] Updated weights for policy 1, policy_version 1902131 (0.0005) [2023-12-26 14:52:57,644][123090] Updated weights for policy 1, policy_version 1902141 (0.0005) [2023-12-26 14:52:58,073][123091] Updated weights for policy 0, policy_version 1914163 (0.0010) [2023-12-26 14:52:58,137][123091] Updated weights for policy 0, policy_version 1914173 (0.0010) [2023-12-26 14:52:58,199][123091] Updated weights for policy 0, policy_version 1914183 (0.0009) [2023-12-26 14:52:58,509][123090] Updated weights for policy 1, policy_version 1902151 (0.0007) [2023-12-26 14:52:58,577][123090] Updated weights for policy 1, policy_version 1902161 (0.0010) [2023-12-26 14:52:58,647][123090] Updated weights for policy 1, policy_version 1902171 (0.0009) [2023-12-26 14:52:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 976994304. Throughput: 0: 9087.9, 1: 8926.3. Samples: 976985488. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:52:58,785][121949] Avg episode reward: [(0, '6258.737'), (1, '5888.673')] [2023-12-26 14:52:59,089][123091] Updated weights for policy 0, policy_version 1914193 (0.0007) [2023-12-26 14:52:59,161][123091] Updated weights for policy 0, policy_version 1914203 (0.0006) [2023-12-26 14:52:59,218][123091] Updated weights for policy 0, policy_version 1914213 (0.0006) [2023-12-26 14:52:59,283][123091] Updated weights for policy 0, policy_version 1914223 (0.0008) [2023-12-26 14:52:59,471][123090] Updated weights for policy 1, policy_version 1902181 (0.0010) [2023-12-26 14:52:59,522][123090] Updated weights for policy 1, policy_version 1902191 (0.0010) [2023-12-26 14:52:59,584][123090] Updated weights for policy 1, policy_version 1902201 (0.0010) [2023-12-26 14:53:00,058][123091] Updated weights for policy 0, policy_version 1914233 (0.0010) [2023-12-26 14:53:00,116][123091] Updated weights for policy 0, policy_version 1914243 (0.0009) [2023-12-26 14:53:00,174][123091] Updated weights for policy 0, policy_version 1914253 (0.0009) [2023-12-26 14:53:00,390][123090] Updated weights for policy 1, policy_version 1902211 (0.0010) [2023-12-26 14:53:00,450][123090] Updated weights for policy 1, policy_version 1902221 (0.0009) [2023-12-26 14:53:00,503][123090] Updated weights for policy 1, policy_version 1902231 (0.0010) [2023-12-26 14:53:00,923][123091] Updated weights for policy 0, policy_version 1914264 (0.0008) [2023-12-26 14:53:00,973][123091] Updated weights for policy 0, policy_version 1914274 (0.0009) [2023-12-26 14:53:01,040][123091] Updated weights for policy 0, policy_version 1914284 (0.0009) [2023-12-26 14:53:01,387][123090] Updated weights for policy 1, policy_version 1902241 (0.0010) [2023-12-26 14:53:01,454][123090] Updated weights for policy 1, policy_version 1902251 (0.0009) [2023-12-26 14:53:01,511][123090] Updated weights for policy 1, policy_version 1902261 (0.0008) [2023-12-26 14:53:01,561][123090] Updated weights for policy 1, policy_version 1902272 (0.0010) [2023-12-26 14:53:01,899][123091] Updated weights for policy 0, policy_version 1914294 (0.0010) [2023-12-26 14:53:01,956][123091] Updated weights for policy 0, policy_version 1914304 (0.0009) [2023-12-26 14:53:02,013][123091] Updated weights for policy 0, policy_version 1914314 (0.0009) [2023-12-26 14:53:02,417][123090] Updated weights for policy 1, policy_version 1902282 (0.0009) [2023-12-26 14:53:02,474][123090] Updated weights for policy 1, policy_version 1902292 (0.0009) [2023-12-26 14:53:02,526][123090] Updated weights for policy 1, policy_version 1902302 (0.0009) [2023-12-26 14:53:02,802][123091] Updated weights for policy 0, policy_version 1914324 (0.0010) [2023-12-26 14:53:02,851][123091] Updated weights for policy 0, policy_version 1914334 (0.0009) [2023-12-26 14:53:02,904][123091] Updated weights for policy 0, policy_version 1914344 (0.0009) [2023-12-26 14:53:03,327][123090] Updated weights for policy 1, policy_version 1902312 (0.0008) [2023-12-26 14:53:03,383][123090] Updated weights for policy 1, policy_version 1902322 (0.0005) [2023-12-26 14:53:03,436][123090] Updated weights for policy 1, policy_version 1902332 (0.0005) [2023-12-26 14:53:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 977076224. Throughput: 0: 9094.4, 1: 8827.9. Samples: 977089372. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:03,785][121949] Avg episode reward: [(0, '6383.240'), (1, '5867.131')] [2023-12-26 14:53:03,826][123091] Updated weights for policy 0, policy_version 1914354 (0.0009) [2023-12-26 14:53:03,897][123091] Updated weights for policy 0, policy_version 1914364 (0.0010) [2023-12-26 14:53:03,968][123091] Updated weights for policy 0, policy_version 1914374 (0.0009) [2023-12-26 14:53:04,037][123091] Updated weights for policy 0, policy_version 1914384 (0.0009) [2023-12-26 14:53:04,171][123090] Updated weights for policy 1, policy_version 1902342 (0.0008) [2023-12-26 14:53:04,246][123090] Updated weights for policy 1, policy_version 1902352 (0.0009) [2023-12-26 14:53:04,309][123090] Updated weights for policy 1, policy_version 1902362 (0.0009) [2023-12-26 14:53:04,874][123091] Updated weights for policy 0, policy_version 1914394 (0.0005) [2023-12-26 14:53:04,939][123091] Updated weights for policy 0, policy_version 1914404 (0.0006) [2023-12-26 14:53:04,995][123091] Updated weights for policy 0, policy_version 1914414 (0.0005) [2023-12-26 14:53:05,019][123090] Updated weights for policy 1, policy_version 1902372 (0.0007) [2023-12-26 14:53:05,066][123090] Updated weights for policy 1, policy_version 1902382 (0.0005) [2023-12-26 14:53:05,120][123090] Updated weights for policy 1, policy_version 1902392 (0.0005) [2023-12-26 14:53:05,665][123091] Updated weights for policy 0, policy_version 1914424 (0.0005) [2023-12-26 14:53:05,715][123091] Updated weights for policy 0, policy_version 1914434 (0.0005) [2023-12-26 14:53:05,769][123091] Updated weights for policy 0, policy_version 1914444 (0.0005) [2023-12-26 14:53:05,776][123090] Updated weights for policy 1, policy_version 1902402 (0.0005) [2023-12-26 14:53:05,838][123090] Updated weights for policy 1, policy_version 1902412 (0.0008) [2023-12-26 14:53:05,900][123090] Updated weights for policy 1, policy_version 1902422 (0.0008) [2023-12-26 14:53:05,957][123090] Updated weights for policy 1, policy_version 1902432 (0.0009) [2023-12-26 14:53:06,604][123091] Updated weights for policy 0, policy_version 1914454 (0.0009) [2023-12-26 14:53:06,661][123091] Updated weights for policy 0, policy_version 1914464 (0.0009) [2023-12-26 14:53:06,717][123091] Updated weights for policy 0, policy_version 1914474 (0.0009) [2023-12-26 14:53:06,776][123090] Updated weights for policy 1, policy_version 1902442 (0.0007) [2023-12-26 14:53:06,852][123090] Updated weights for policy 1, policy_version 1902452 (0.0006) [2023-12-26 14:53:06,922][123090] Updated weights for policy 1, policy_version 1902462 (0.0008) [2023-12-26 14:53:07,523][123091] Updated weights for policy 0, policy_version 1914484 (0.0008) [2023-12-26 14:53:07,570][123091] Updated weights for policy 0, policy_version 1914494 (0.0005) [2023-12-26 14:53:07,624][123091] Updated weights for policy 0, policy_version 1914504 (0.0005) [2023-12-26 14:53:07,753][123090] Updated weights for policy 1, policy_version 1902472 (0.0007) [2023-12-26 14:53:07,808][123090] Updated weights for policy 1, policy_version 1902482 (0.0008) [2023-12-26 14:53:07,862][123090] Updated weights for policy 1, policy_version 1902492 (0.0006) [2023-12-26 14:53:08,349][123091] Updated weights for policy 0, policy_version 1914514 (0.0006) [2023-12-26 14:53:08,412][123091] Updated weights for policy 0, policy_version 1914524 (0.0009) [2023-12-26 14:53:08,465][123091] Updated weights for policy 0, policy_version 1914534 (0.0009) [2023-12-26 14:53:08,518][123091] Updated weights for policy 0, policy_version 1914544 (0.0009) [2023-12-26 14:53:08,625][123090] Updated weights for policy 1, policy_version 1902502 (0.0008) [2023-12-26 14:53:08,688][123090] Updated weights for policy 1, policy_version 1902512 (0.0010) [2023-12-26 14:53:08,745][123090] Updated weights for policy 1, policy_version 1902522 (0.0009) [2023-12-26 14:53:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 977174528. Throughput: 0: 9138.7, 1: 8885.3. Samples: 977144780. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:08,785][121949] Avg episode reward: [(0, '6322.347'), (1, '5855.808')] [2023-12-26 14:53:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001902528_487047168.pth... [2023-12-26 14:53:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001914544_490127360.pth... [2023-12-26 14:53:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001901504_486785024.pth [2023-12-26 14:53:08,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001913488_489857024.pth [2023-12-26 14:53:09,354][123091] Updated weights for policy 0, policy_version 1914554 (0.0010) [2023-12-26 14:53:09,448][123091] Updated weights for policy 0, policy_version 1914564 (0.0009) [2023-12-26 14:53:09,512][123091] Updated weights for policy 0, policy_version 1914574 (0.0011) [2023-12-26 14:53:09,612][123090] Updated weights for policy 1, policy_version 1902532 (0.0008) [2023-12-26 14:53:09,669][123090] Updated weights for policy 1, policy_version 1902542 (0.0008) [2023-12-26 14:53:09,741][123090] Updated weights for policy 1, policy_version 1902552 (0.0006) [2023-12-26 14:53:10,228][123091] Updated weights for policy 0, policy_version 1914584 (0.0010) [2023-12-26 14:53:10,284][123091] Updated weights for policy 0, policy_version 1914594 (0.0010) [2023-12-26 14:53:10,345][123091] Updated weights for policy 0, policy_version 1914604 (0.0011) [2023-12-26 14:53:10,551][123090] Updated weights for policy 1, policy_version 1902562 (0.0006) [2023-12-26 14:53:10,614][123090] Updated weights for policy 1, policy_version 1902572 (0.0006) [2023-12-26 14:53:10,686][123090] Updated weights for policy 1, policy_version 1902582 (0.0006) [2023-12-26 14:53:10,746][123090] Updated weights for policy 1, policy_version 1902592 (0.0005) [2023-12-26 14:53:11,097][123091] Updated weights for policy 0, policy_version 1914614 (0.0008) [2023-12-26 14:53:11,173][123091] Updated weights for policy 0, policy_version 1914624 (0.0010) [2023-12-26 14:53:11,247][123091] Updated weights for policy 0, policy_version 1914634 (0.0007) [2023-12-26 14:53:11,451][123090] Updated weights for policy 1, policy_version 1902602 (0.0011) [2023-12-26 14:53:11,519][123090] Updated weights for policy 1, policy_version 1902612 (0.0011) [2023-12-26 14:53:11,583][123090] Updated weights for policy 1, policy_version 1902622 (0.0011) [2023-12-26 14:53:12,059][123091] Updated weights for policy 0, policy_version 1914644 (0.0008) [2023-12-26 14:53:12,123][123091] Updated weights for policy 0, policy_version 1914654 (0.0011) [2023-12-26 14:53:12,186][123091] Updated weights for policy 0, policy_version 1914664 (0.0011) [2023-12-26 14:53:12,455][123090] Updated weights for policy 1, policy_version 1902632 (0.0009) [2023-12-26 14:53:12,519][123090] Updated weights for policy 1, policy_version 1902642 (0.0010) [2023-12-26 14:53:12,588][123090] Updated weights for policy 1, policy_version 1902652 (0.0009) [2023-12-26 14:53:13,032][123091] Updated weights for policy 0, policy_version 1914674 (0.0011) [2023-12-26 14:53:13,099][123091] Updated weights for policy 0, policy_version 1914684 (0.0009) [2023-12-26 14:53:13,162][123091] Updated weights for policy 0, policy_version 1914694 (0.0009) [2023-12-26 14:53:13,217][123091] Updated weights for policy 0, policy_version 1914704 (0.0009) [2023-12-26 14:53:13,412][123090] Updated weights for policy 1, policy_version 1902662 (0.0010) [2023-12-26 14:53:13,470][123090] Updated weights for policy 1, policy_version 1902672 (0.0009) [2023-12-26 14:53:13,520][123090] Updated weights for policy 1, policy_version 1902682 (0.0010) [2023-12-26 14:53:13,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 977256448. Throughput: 0: 9106.0, 1: 8759.9. Samples: 977249180. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:13,785][121949] Avg episode reward: [(0, '6205.927'), (1, '5943.333')] [2023-12-26 14:53:14,044][123091] Updated weights for policy 0, policy_version 1914714 (0.0010) [2023-12-26 14:53:14,104][123091] Updated weights for policy 0, policy_version 1914724 (0.0010) [2023-12-26 14:53:14,166][123091] Updated weights for policy 0, policy_version 1914734 (0.0010) [2023-12-26 14:53:14,302][123090] Updated weights for policy 1, policy_version 1902692 (0.0009) [2023-12-26 14:53:14,359][123090] Updated weights for policy 1, policy_version 1902702 (0.0008) [2023-12-26 14:53:14,414][123090] Updated weights for policy 1, policy_version 1902712 (0.0005) [2023-12-26 14:53:14,972][123091] Updated weights for policy 0, policy_version 1914744 (0.0009) [2023-12-26 14:53:15,034][123091] Updated weights for policy 0, policy_version 1914754 (0.0009) [2023-12-26 14:53:15,100][123091] Updated weights for policy 0, policy_version 1914764 (0.0009) [2023-12-26 14:53:15,152][123090] Updated weights for policy 1, policy_version 1902722 (0.0006) [2023-12-26 14:53:15,216][123090] Updated weights for policy 1, policy_version 1902732 (0.0011) [2023-12-26 14:53:15,284][123090] Updated weights for policy 1, policy_version 1902742 (0.0011) [2023-12-26 14:53:15,352][123090] Updated weights for policy 1, policy_version 1902752 (0.0011) [2023-12-26 14:53:15,970][123091] Updated weights for policy 0, policy_version 1914775 (0.0009) [2023-12-26 14:53:16,022][123091] Updated weights for policy 0, policy_version 1914785 (0.0010) [2023-12-26 14:53:16,055][123090] Updated weights for policy 1, policy_version 1902762 (0.0005) [2023-12-26 14:53:16,080][123091] Updated weights for policy 0, policy_version 1914795 (0.0009) [2023-12-26 14:53:16,111][123090] Updated weights for policy 1, policy_version 1902772 (0.0009) [2023-12-26 14:53:16,162][123090] Updated weights for policy 1, policy_version 1902782 (0.0010) [2023-12-26 14:53:16,796][123090] Updated weights for policy 1, policy_version 1902792 (0.0006) [2023-12-26 14:53:16,846][123090] Updated weights for policy 1, policy_version 1902802 (0.0005) [2023-12-26 14:53:16,883][123091] Updated weights for policy 0, policy_version 1914805 (0.0008) [2023-12-26 14:53:16,927][123090] Updated weights for policy 1, policy_version 1902812 (0.0006) [2023-12-26 14:53:16,948][123091] Updated weights for policy 0, policy_version 1914815 (0.0008) [2023-12-26 14:53:17,014][123091] Updated weights for policy 0, policy_version 1914825 (0.0008) [2023-12-26 14:53:17,600][123090] Updated weights for policy 1, policy_version 1902822 (0.0008) [2023-12-26 14:53:17,654][123090] Updated weights for policy 1, policy_version 1902832 (0.0009) [2023-12-26 14:53:17,712][123091] Updated weights for policy 0, policy_version 1914835 (0.0008) [2023-12-26 14:53:17,717][123090] Updated weights for policy 1, policy_version 1902842 (0.0010) [2023-12-26 14:53:17,766][123091] Updated weights for policy 0, policy_version 1914845 (0.0009) [2023-12-26 14:53:17,828][123091] Updated weights for policy 0, policy_version 1914855 (0.0009) [2023-12-26 14:53:18,539][123090] Updated weights for policy 1, policy_version 1902852 (0.0010) [2023-12-26 14:53:18,602][123090] Updated weights for policy 1, policy_version 1902862 (0.0005) [2023-12-26 14:53:18,659][123090] Updated weights for policy 1, policy_version 1902872 (0.0005) [2023-12-26 14:53:18,704][123091] Updated weights for policy 0, policy_version 1914865 (0.0008) [2023-12-26 14:53:18,766][123091] Updated weights for policy 0, policy_version 1914875 (0.0010) [2023-12-26 14:53:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 977346560. Throughput: 0: 9024.2, 1: 8865.3. Samples: 977357388. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:18,784][121949] Avg episode reward: [(0, '6182.698'), (1, '5836.570')] [2023-12-26 14:53:18,821][123091] Updated weights for policy 0, policy_version 1914885 (0.0010) [2023-12-26 14:53:18,879][123091] Updated weights for policy 0, policy_version 1914895 (0.0010) [2023-12-26 14:53:19,389][123090] Updated weights for policy 1, policy_version 1902882 (0.0006) [2023-12-26 14:53:19,449][123090] Updated weights for policy 1, policy_version 1902892 (0.0006) [2023-12-26 14:53:19,517][123090] Updated weights for policy 1, policy_version 1902902 (0.0009) [2023-12-26 14:53:19,574][123090] Updated weights for policy 1, policy_version 1902912 (0.0009) [2023-12-26 14:53:19,822][123091] Updated weights for policy 0, policy_version 1914905 (0.0010) [2023-12-26 14:53:19,891][123091] Updated weights for policy 0, policy_version 1914915 (0.0009) [2023-12-26 14:53:19,954][123091] Updated weights for policy 0, policy_version 1914925 (0.0007) [2023-12-26 14:53:20,422][123090] Updated weights for policy 1, policy_version 1902922 (0.0010) [2023-12-26 14:53:20,491][123090] Updated weights for policy 1, policy_version 1902932 (0.0009) [2023-12-26 14:53:20,561][123090] Updated weights for policy 1, policy_version 1902942 (0.0009) [2023-12-26 14:53:20,788][123091] Updated weights for policy 0, policy_version 1914935 (0.0010) [2023-12-26 14:53:20,858][123091] Updated weights for policy 0, policy_version 1914945 (0.0009) [2023-12-26 14:53:20,922][123091] Updated weights for policy 0, policy_version 1914955 (0.0009) [2023-12-26 14:53:21,440][123090] Updated weights for policy 1, policy_version 1902952 (0.0007) [2023-12-26 14:53:21,497][123090] Updated weights for policy 1, policy_version 1902962 (0.0006) [2023-12-26 14:53:21,562][123090] Updated weights for policy 1, policy_version 1902972 (0.0005) [2023-12-26 14:53:21,763][123091] Updated weights for policy 0, policy_version 1914965 (0.0009) [2023-12-26 14:53:21,828][123091] Updated weights for policy 0, policy_version 1914975 (0.0007) [2023-12-26 14:53:21,903][123091] Updated weights for policy 0, policy_version 1914985 (0.0005) [2023-12-26 14:53:22,367][123090] Updated weights for policy 1, policy_version 1902982 (0.0008) [2023-12-26 14:53:22,432][123090] Updated weights for policy 1, policy_version 1902992 (0.0010) [2023-12-26 14:53:22,496][123090] Updated weights for policy 1, policy_version 1903002 (0.0009) [2023-12-26 14:53:22,716][123091] Updated weights for policy 0, policy_version 1914995 (0.0010) [2023-12-26 14:53:22,770][123091] Updated weights for policy 0, policy_version 1915005 (0.0010) [2023-12-26 14:53:22,830][123091] Updated weights for policy 0, policy_version 1915015 (0.0007) [2023-12-26 14:53:23,407][123090] Updated weights for policy 1, policy_version 1903012 (0.0010) [2023-12-26 14:53:23,460][123090] Updated weights for policy 1, policy_version 1903023 (0.0010) [2023-12-26 14:53:23,510][123090] Updated weights for policy 1, policy_version 1903033 (0.0010) [2023-12-26 14:53:23,623][123091] Updated weights for policy 0, policy_version 1915025 (0.0006) [2023-12-26 14:53:23,674][123091] Updated weights for policy 0, policy_version 1915035 (0.0010) [2023-12-26 14:53:23,727][123091] Updated weights for policy 0, policy_version 1915045 (0.0009) [2023-12-26 14:53:23,778][123091] Updated weights for policy 0, policy_version 1915055 (0.0009) [2023-12-26 14:53:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.5, 300 sec: 17911.3). Total num frames: 977436672. Throughput: 0: 8936.6, 1: 8844.0. Samples: 977408412. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:23,784][121949] Avg episode reward: [(0, '6077.612'), (1, '5721.000')] [2023-12-26 14:53:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001915056_490258432.pth... [2023-12-26 14:53:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001903040_487178240.pth... [2023-12-26 14:53:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001902016_486916096.pth [2023-12-26 14:53:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001914000_489988096.pth [2023-12-26 14:53:24,367][123090] Updated weights for policy 1, policy_version 1903043 (0.0009) [2023-12-26 14:53:24,426][123090] Updated weights for policy 1, policy_version 1903053 (0.0008) [2023-12-26 14:53:24,484][123090] Updated weights for policy 1, policy_version 1903063 (0.0009) [2023-12-26 14:53:24,614][123091] Updated weights for policy 0, policy_version 1915065 (0.0008) [2023-12-26 14:53:24,664][123091] Updated weights for policy 0, policy_version 1915075 (0.0008) [2023-12-26 14:53:24,716][123091] Updated weights for policy 0, policy_version 1915086 (0.0009) [2023-12-26 14:53:25,338][123090] Updated weights for policy 1, policy_version 1903073 (0.0009) [2023-12-26 14:53:25,399][123090] Updated weights for policy 1, policy_version 1903083 (0.0009) [2023-12-26 14:53:25,467][123090] Updated weights for policy 1, policy_version 1903093 (0.0009) [2023-12-26 14:53:25,539][123090] Updated weights for policy 1, policy_version 1903103 (0.0009) [2023-12-26 14:53:25,605][123091] Updated weights for policy 0, policy_version 1915096 (0.0010) [2023-12-26 14:53:25,674][123091] Updated weights for policy 0, policy_version 1915106 (0.0009) [2023-12-26 14:53:25,743][123091] Updated weights for policy 0, policy_version 1915116 (0.0010) [2023-12-26 14:53:26,369][123090] Updated weights for policy 1, policy_version 1903113 (0.0009) [2023-12-26 14:53:26,436][123090] Updated weights for policy 1, policy_version 1903123 (0.0009) [2023-12-26 14:53:26,485][123090] Updated weights for policy 1, policy_version 1903133 (0.0009) [2023-12-26 14:53:26,572][123091] Updated weights for policy 0, policy_version 1915126 (0.0009) [2023-12-26 14:53:26,621][123091] Updated weights for policy 0, policy_version 1915136 (0.0009) [2023-12-26 14:53:26,674][123091] Updated weights for policy 0, policy_version 1915146 (0.0009) [2023-12-26 14:53:27,349][123090] Updated weights for policy 1, policy_version 1903143 (0.0009) [2023-12-26 14:53:27,404][123090] Updated weights for policy 1, policy_version 1903153 (0.0009) [2023-12-26 14:53:27,455][123090] Updated weights for policy 1, policy_version 1903163 (0.0009) [2023-12-26 14:53:27,526][123091] Updated weights for policy 0, policy_version 1915156 (0.0010) [2023-12-26 14:53:27,573][123091] Updated weights for policy 0, policy_version 1915166 (0.0008) [2023-12-26 14:53:27,631][123091] Updated weights for policy 0, policy_version 1915176 (0.0009) [2023-12-26 14:53:28,282][123090] Updated weights for policy 1, policy_version 1903173 (0.0009) [2023-12-26 14:53:28,347][123090] Updated weights for policy 1, policy_version 1903183 (0.0009) [2023-12-26 14:53:28,411][123090] Updated weights for policy 1, policy_version 1903193 (0.0009) [2023-12-26 14:53:28,480][123091] Updated weights for policy 0, policy_version 1915187 (0.0010) [2023-12-26 14:53:28,542][123091] Updated weights for policy 0, policy_version 1915197 (0.0008) [2023-12-26 14:53:28,601][123091] Updated weights for policy 0, policy_version 1915207 (0.0009) [2023-12-26 14:53:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 977518592. Throughput: 0: 8924.5, 1: 8769.4. Samples: 977510164. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:28,784][121949] Avg episode reward: [(0, '6222.529'), (1, '5829.409')] [2023-12-26 14:53:29,238][123090] Updated weights for policy 1, policy_version 1903203 (0.0013) [2023-12-26 14:53:29,302][123090] Updated weights for policy 1, policy_version 1903213 (0.0008) [2023-12-26 14:53:29,367][123090] Updated weights for policy 1, policy_version 1903223 (0.0009) [2023-12-26 14:53:29,452][123091] Updated weights for policy 0, policy_version 1915217 (0.0009) [2023-12-26 14:53:29,512][123091] Updated weights for policy 0, policy_version 1915227 (0.0005) [2023-12-26 14:53:29,561][123091] Updated weights for policy 0, policy_version 1915237 (0.0005) [2023-12-26 14:53:29,615][123091] Updated weights for policy 0, policy_version 1915247 (0.0005) [2023-12-26 14:53:30,246][123090] Updated weights for policy 1, policy_version 1903233 (0.0009) [2023-12-26 14:53:30,304][123090] Updated weights for policy 1, policy_version 1903243 (0.0005) [2023-12-26 14:53:30,306][123091] Updated weights for policy 0, policy_version 1915257 (0.0009) [2023-12-26 14:53:30,368][123090] Updated weights for policy 1, policy_version 1903253 (0.0006) [2023-12-26 14:53:30,371][123091] Updated weights for policy 0, policy_version 1915267 (0.0010) [2023-12-26 14:53:30,427][123090] Updated weights for policy 1, policy_version 1903263 (0.0005) [2023-12-26 14:53:30,429][123091] Updated weights for policy 0, policy_version 1915277 (0.0007) [2023-12-26 14:53:31,071][123091] Updated weights for policy 0, policy_version 1915287 (0.0007) [2023-12-26 14:53:31,145][123091] Updated weights for policy 0, policy_version 1915297 (0.0007) [2023-12-26 14:53:31,208][123091] Updated weights for policy 0, policy_version 1915307 (0.0006) [2023-12-26 14:53:31,286][123090] Updated weights for policy 1, policy_version 1903273 (0.0009) [2023-12-26 14:53:31,356][123090] Updated weights for policy 1, policy_version 1903283 (0.0009) [2023-12-26 14:53:31,428][123090] Updated weights for policy 1, policy_version 1903293 (0.0009) [2023-12-26 14:53:31,902][123091] Updated weights for policy 0, policy_version 1915317 (0.0008) [2023-12-26 14:53:31,973][123091] Updated weights for policy 0, policy_version 1915327 (0.0005) [2023-12-26 14:53:32,047][123091] Updated weights for policy 0, policy_version 1915337 (0.0005) [2023-12-26 14:53:32,307][123090] Updated weights for policy 1, policy_version 1903303 (0.0010) [2023-12-26 14:53:32,379][123090] Updated weights for policy 1, policy_version 1903313 (0.0010) [2023-12-26 14:53:32,432][123090] Updated weights for policy 1, policy_version 1903323 (0.0009) [2023-12-26 14:53:32,811][123091] Updated weights for policy 0, policy_version 1915347 (0.0008) [2023-12-26 14:53:32,866][123091] Updated weights for policy 0, policy_version 1915357 (0.0008) [2023-12-26 14:53:32,914][123091] Updated weights for policy 0, policy_version 1915367 (0.0009) [2023-12-26 14:53:33,274][123090] Updated weights for policy 1, policy_version 1903333 (0.0010) [2023-12-26 14:53:33,325][123090] Updated weights for policy 1, policy_version 1903343 (0.0009) [2023-12-26 14:53:33,372][123090] Updated weights for policy 1, policy_version 1903353 (0.0008) [2023-12-26 14:53:33,772][123091] Updated weights for policy 0, policy_version 1915377 (0.0009) [2023-12-26 14:53:33,784][121949] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 977600512. Throughput: 0: 8890.6, 1: 8695.8. Samples: 977615500. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:33,785][121949] Avg episode reward: [(0, '6197.196'), (1, '5927.311')] [2023-12-26 14:53:33,829][123091] Updated weights for policy 0, policy_version 1915387 (0.0009) [2023-12-26 14:53:33,882][123091] Updated weights for policy 0, policy_version 1915397 (0.0009) [2023-12-26 14:53:33,935][123091] Updated weights for policy 0, policy_version 1915407 (0.0009) [2023-12-26 14:53:34,223][123090] Updated weights for policy 1, policy_version 1903363 (0.0010) [2023-12-26 14:53:34,286][123090] Updated weights for policy 1, policy_version 1903373 (0.0011) [2023-12-26 14:53:34,356][123090] Updated weights for policy 1, policy_version 1903383 (0.0010) [2023-12-26 14:53:34,754][123091] Updated weights for policy 0, policy_version 1915417 (0.0007) [2023-12-26 14:53:34,819][123091] Updated weights for policy 0, policy_version 1915427 (0.0009) [2023-12-26 14:53:34,882][123091] Updated weights for policy 0, policy_version 1915437 (0.0009) [2023-12-26 14:53:35,111][123090] Updated weights for policy 1, policy_version 1903393 (0.0010) [2023-12-26 14:53:35,183][123090] Updated weights for policy 1, policy_version 1903403 (0.0005) [2023-12-26 14:53:35,253][123090] Updated weights for policy 1, policy_version 1903413 (0.0007) [2023-12-26 14:53:35,309][123090] Updated weights for policy 1, policy_version 1903423 (0.0009) [2023-12-26 14:53:35,753][123091] Updated weights for policy 0, policy_version 1915447 (0.0009) [2023-12-26 14:53:35,818][123091] Updated weights for policy 0, policy_version 1915457 (0.0009) [2023-12-26 14:53:35,877][123091] Updated weights for policy 0, policy_version 1915467 (0.0009) [2023-12-26 14:53:36,063][123090] Updated weights for policy 1, policy_version 1903433 (0.0010) [2023-12-26 14:53:36,124][123090] Updated weights for policy 1, policy_version 1903443 (0.0010) [2023-12-26 14:53:36,186][123090] Updated weights for policy 1, policy_version 1903453 (0.0009) [2023-12-26 14:53:36,688][123091] Updated weights for policy 0, policy_version 1915477 (0.0010) [2023-12-26 14:53:36,751][123091] Updated weights for policy 0, policy_version 1915487 (0.0010) [2023-12-26 14:53:36,817][123091] Updated weights for policy 0, policy_version 1915497 (0.0010) [2023-12-26 14:53:37,029][123090] Updated weights for policy 1, policy_version 1903463 (0.0010) [2023-12-26 14:53:37,078][123090] Updated weights for policy 1, policy_version 1903473 (0.0009) [2023-12-26 14:53:37,136][123090] Updated weights for policy 1, policy_version 1903483 (0.0010) [2023-12-26 14:53:37,626][123091] Updated weights for policy 0, policy_version 1915507 (0.0009) [2023-12-26 14:53:37,679][123091] Updated weights for policy 0, policy_version 1915517 (0.0009) [2023-12-26 14:53:37,729][123091] Updated weights for policy 0, policy_version 1915527 (0.0009) [2023-12-26 14:53:37,998][123090] Updated weights for policy 1, policy_version 1903493 (0.0009) [2023-12-26 14:53:38,055][123090] Updated weights for policy 1, policy_version 1903503 (0.0008) [2023-12-26 14:53:38,110][123090] Updated weights for policy 1, policy_version 1903513 (0.0009) [2023-12-26 14:53:38,594][123091] Updated weights for policy 0, policy_version 1915537 (0.0009) [2023-12-26 14:53:38,660][123091] Updated weights for policy 0, policy_version 1915547 (0.0011) [2023-12-26 14:53:38,720][123091] Updated weights for policy 0, policy_version 1915557 (0.0010) [2023-12-26 14:53:38,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 977682432. Throughput: 0: 8886.0, 1: 8708.9. Samples: 977667232. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:38,785][121949] Avg episode reward: [(0, '6193.518'), (1, '5971.259')] [2023-12-26 14:53:38,789][123091] Updated weights for policy 0, policy_version 1915567 (0.0011) [2023-12-26 14:53:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001903520_487301120.pth... [2023-12-26 14:53:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001915568_490389504.pth... [2023-12-26 14:53:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001902528_487047168.pth [2023-12-26 14:53:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001914544_490127360.pth [2023-12-26 14:53:38,967][123090] Updated weights for policy 1, policy_version 1903523 (0.0009) [2023-12-26 14:53:39,027][123090] Updated weights for policy 1, policy_version 1903533 (0.0009) [2023-12-26 14:53:39,076][123090] Updated weights for policy 1, policy_version 1903543 (0.0008) [2023-12-26 14:53:39,590][123091] Updated weights for policy 0, policy_version 1915577 (0.0006) [2023-12-26 14:53:39,642][123091] Updated weights for policy 0, policy_version 1915587 (0.0006) [2023-12-26 14:53:39,703][123091] Updated weights for policy 0, policy_version 1915597 (0.0005) [2023-12-26 14:53:39,974][123090] Updated weights for policy 1, policy_version 1903553 (0.0009) [2023-12-26 14:53:40,034][123090] Updated weights for policy 1, policy_version 1903563 (0.0009) [2023-12-26 14:53:40,098][123090] Updated weights for policy 1, policy_version 1903573 (0.0007) [2023-12-26 14:53:40,148][123090] Updated weights for policy 1, policy_version 1903583 (0.0009) [2023-12-26 14:53:40,507][123091] Updated weights for policy 0, policy_version 1915607 (0.0008) [2023-12-26 14:53:40,568][123091] Updated weights for policy 0, policy_version 1915617 (0.0009) [2023-12-26 14:53:40,628][123091] Updated weights for policy 0, policy_version 1915627 (0.0009) [2023-12-26 14:53:41,000][123090] Updated weights for policy 1, policy_version 1903593 (0.0010) [2023-12-26 14:53:41,066][123090] Updated weights for policy 1, policy_version 1903603 (0.0010) [2023-12-26 14:53:41,138][123090] Updated weights for policy 1, policy_version 1903613 (0.0009) [2023-12-26 14:53:41,506][123091] Updated weights for policy 0, policy_version 1915637 (0.0009) [2023-12-26 14:53:41,561][123091] Updated weights for policy 0, policy_version 1915647 (0.0010) [2023-12-26 14:53:41,630][123091] Updated weights for policy 0, policy_version 1915657 (0.0008) [2023-12-26 14:53:42,012][123090] Updated weights for policy 1, policy_version 1903623 (0.0010) [2023-12-26 14:53:42,072][123090] Updated weights for policy 1, policy_version 1903633 (0.0011) [2023-12-26 14:53:42,132][123090] Updated weights for policy 1, policy_version 1903643 (0.0011) [2023-12-26 14:53:42,430][123091] Updated weights for policy 0, policy_version 1915667 (0.0009) [2023-12-26 14:53:42,493][123091] Updated weights for policy 0, policy_version 1915677 (0.0009) [2023-12-26 14:53:42,542][123091] Updated weights for policy 0, policy_version 1915687 (0.0009) [2023-12-26 14:53:42,971][123090] Updated weights for policy 1, policy_version 1903653 (0.0011) [2023-12-26 14:53:43,027][123090] Updated weights for policy 1, policy_version 1903663 (0.0010) [2023-12-26 14:53:43,090][123090] Updated weights for policy 1, policy_version 1903673 (0.0011) [2023-12-26 14:53:43,393][123091] Updated weights for policy 0, policy_version 1915697 (0.0009) [2023-12-26 14:53:43,438][123091] Updated weights for policy 0, policy_version 1915707 (0.0008) [2023-12-26 14:53:43,482][123091] Updated weights for policy 0, policy_version 1915717 (0.0006) [2023-12-26 14:53:43,530][123091] Updated weights for policy 0, policy_version 1915727 (0.0005) [2023-12-26 14:53:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 977772544. Throughput: 0: 8717.3, 1: 8671.8. Samples: 977768000. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:43,785][121949] Avg episode reward: [(0, '6218.314'), (1, '5808.768')] [2023-12-26 14:53:43,907][123090] Updated weights for policy 1, policy_version 1903683 (0.0009) [2023-12-26 14:53:43,956][123090] Updated weights for policy 1, policy_version 1903693 (0.0005) [2023-12-26 14:53:44,001][123090] Updated weights for policy 1, policy_version 1903703 (0.0006) [2023-12-26 14:53:44,298][123091] Updated weights for policy 0, policy_version 1915737 (0.0010) [2023-12-26 14:53:44,347][123091] Updated weights for policy 0, policy_version 1915747 (0.0006) [2023-12-26 14:53:44,403][123091] Updated weights for policy 0, policy_version 1915757 (0.0005) [2023-12-26 14:53:44,703][123090] Updated weights for policy 1, policy_version 1903713 (0.0010) [2023-12-26 14:53:44,765][123090] Updated weights for policy 1, policy_version 1903723 (0.0006) [2023-12-26 14:53:44,839][123090] Updated weights for policy 1, policy_version 1903733 (0.0007) [2023-12-26 14:53:44,911][123090] Updated weights for policy 1, policy_version 1903743 (0.0005) [2023-12-26 14:53:45,222][123091] Updated weights for policy 0, policy_version 1915767 (0.0008) [2023-12-26 14:53:45,288][123091] Updated weights for policy 0, policy_version 1915777 (0.0010) [2023-12-26 14:53:45,351][123091] Updated weights for policy 0, policy_version 1915787 (0.0010) [2023-12-26 14:53:45,599][123090] Updated weights for policy 1, policy_version 1903753 (0.0009) [2023-12-26 14:53:45,664][123090] Updated weights for policy 1, policy_version 1903763 (0.0009) [2023-12-26 14:53:45,728][123090] Updated weights for policy 1, policy_version 1903773 (0.0009) [2023-12-26 14:53:46,197][123091] Updated weights for policy 0, policy_version 1915797 (0.0010) [2023-12-26 14:53:46,249][123091] Updated weights for policy 0, policy_version 1915807 (0.0010) [2023-12-26 14:53:46,292][123091] Updated weights for policy 0, policy_version 1915817 (0.0010) [2023-12-26 14:53:46,566][123090] Updated weights for policy 1, policy_version 1903783 (0.0009) [2023-12-26 14:53:46,636][123090] Updated weights for policy 1, policy_version 1903793 (0.0009) [2023-12-26 14:53:46,697][123090] Updated weights for policy 1, policy_version 1903803 (0.0009) [2023-12-26 14:53:47,013][123091] Updated weights for policy 0, policy_version 1915827 (0.0007) [2023-12-26 14:53:47,065][123091] Updated weights for policy 0, policy_version 1915837 (0.0009) [2023-12-26 14:53:47,121][123091] Updated weights for policy 0, policy_version 1915847 (0.0009) [2023-12-26 14:53:47,563][123090] Updated weights for policy 1, policy_version 1903813 (0.0007) [2023-12-26 14:53:47,635][123090] Updated weights for policy 1, policy_version 1903823 (0.0005) [2023-12-26 14:53:47,683][123090] Updated weights for policy 1, policy_version 1903833 (0.0005) [2023-12-26 14:53:47,915][123091] Updated weights for policy 0, policy_version 1915857 (0.0009) [2023-12-26 14:53:47,987][123091] Updated weights for policy 0, policy_version 1915867 (0.0007) [2023-12-26 14:53:48,049][123091] Updated weights for policy 0, policy_version 1915877 (0.0008) [2023-12-26 14:53:48,120][123091] Updated weights for policy 0, policy_version 1915887 (0.0008) [2023-12-26 14:53:48,244][123090] Updated weights for policy 1, policy_version 1903843 (0.0007) [2023-12-26 14:53:48,307][123090] Updated weights for policy 1, policy_version 1903854 (0.0010) [2023-12-26 14:53:48,376][123090] Updated weights for policy 1, policy_version 1903864 (0.0009) [2023-12-26 14:53:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 977862656. Throughput: 0: 8761.1, 1: 8724.8. Samples: 977876236. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:48,785][121949] Avg episode reward: [(0, '6264.274'), (1, '5903.844')] [2023-12-26 14:53:48,857][123091] Updated weights for policy 0, policy_version 1915897 (0.0010) [2023-12-26 14:53:48,917][123091] Updated weights for policy 0, policy_version 1915908 (0.0011) [2023-12-26 14:53:48,971][123091] Updated weights for policy 0, policy_version 1915918 (0.0010) [2023-12-26 14:53:49,165][123090] Updated weights for policy 1, policy_version 1903874 (0.0009) [2023-12-26 14:53:49,223][123090] Updated weights for policy 1, policy_version 1903884 (0.0010) [2023-12-26 14:53:49,293][123090] Updated weights for policy 1, policy_version 1903894 (0.0009) [2023-12-26 14:53:49,368][123090] Updated weights for policy 1, policy_version 1903904 (0.0009) [2023-12-26 14:53:49,776][123091] Updated weights for policy 0, policy_version 1915928 (0.0006) [2023-12-26 14:53:49,844][123091] Updated weights for policy 0, policy_version 1915938 (0.0007) [2023-12-26 14:53:49,903][123091] Updated weights for policy 0, policy_version 1915948 (0.0008) [2023-12-26 14:53:50,295][123090] Updated weights for policy 1, policy_version 1903914 (0.0009) [2023-12-26 14:53:50,350][123090] Updated weights for policy 1, policy_version 1903924 (0.0010) [2023-12-26 14:53:50,407][123090] Updated weights for policy 1, policy_version 1903934 (0.0009) [2023-12-26 14:53:50,476][123091] Updated weights for policy 0, policy_version 1915958 (0.0007) [2023-12-26 14:53:50,542][123091] Updated weights for policy 0, policy_version 1915968 (0.0008) [2023-12-26 14:53:50,608][123091] Updated weights for policy 0, policy_version 1915978 (0.0009) [2023-12-26 14:53:51,354][123090] Updated weights for policy 1, policy_version 1903944 (0.0010) [2023-12-26 14:53:51,405][123091] Updated weights for policy 0, policy_version 1915988 (0.0008) [2023-12-26 14:53:51,416][123090] Updated weights for policy 1, policy_version 1903954 (0.0009) [2023-12-26 14:53:51,462][123091] Updated weights for policy 0, policy_version 1915998 (0.0008) [2023-12-26 14:53:51,479][123090] Updated weights for policy 1, policy_version 1903964 (0.0008) [2023-12-26 14:53:51,520][123091] Updated weights for policy 0, policy_version 1916008 (0.0007) [2023-12-26 14:53:52,329][123090] Updated weights for policy 1, policy_version 1903974 (0.0009) [2023-12-26 14:53:52,376][123091] Updated weights for policy 0, policy_version 1916018 (0.0009) [2023-12-26 14:53:52,405][123090] Updated weights for policy 1, policy_version 1903984 (0.0009) [2023-12-26 14:53:52,428][123091] Updated weights for policy 0, policy_version 1916028 (0.0006) [2023-12-26 14:53:52,472][123090] Updated weights for policy 1, policy_version 1903994 (0.0010) [2023-12-26 14:53:52,479][123091] Updated weights for policy 0, policy_version 1916038 (0.0006) [2023-12-26 14:53:52,531][123091] Updated weights for policy 0, policy_version 1916048 (0.0006) [2023-12-26 14:53:53,327][123091] Updated weights for policy 0, policy_version 1916058 (0.0009) [2023-12-26 14:53:53,331][123090] Updated weights for policy 1, policy_version 1904004 (0.0008) [2023-12-26 14:53:53,377][123091] Updated weights for policy 0, policy_version 1916068 (0.0008) [2023-12-26 14:53:53,382][123090] Updated weights for policy 1, policy_version 1904014 (0.0008) [2023-12-26 14:53:53,426][123091] Updated weights for policy 0, policy_version 1916078 (0.0008) [2023-12-26 14:53:53,449][123090] Updated weights for policy 1, policy_version 1904024 (0.0009) [2023-12-26 14:53:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 977952768. Throughput: 0: 8765.7, 1: 8630.7. Samples: 977927616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:53,785][121949] Avg episode reward: [(0, '6313.854'), (1, '5925.340')] [2023-12-26 14:53:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001916080_490520576.pth... [2023-12-26 14:53:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001904032_487432192.pth... [2023-12-26 14:53:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001915056_490258432.pth [2023-12-26 14:53:53,799][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001916080_490520576.pth [2023-12-26 14:53:53,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001903040_487178240.pth [2023-12-26 14:53:53,803][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001904032_487432192.pth [2023-12-26 14:53:54,273][123091] Updated weights for policy 0, policy_version 1916088 (0.0009) [2023-12-26 14:53:54,275][123090] Updated weights for policy 1, policy_version 1904034 (0.0009) [2023-12-26 14:53:54,324][123090] Updated weights for policy 1, policy_version 1904044 (0.0008) [2023-12-26 14:53:54,328][123091] Updated weights for policy 0, policy_version 1916098 (0.0007) [2023-12-26 14:53:54,383][123090] Updated weights for policy 1, policy_version 1904054 (0.0008) [2023-12-26 14:53:54,388][123091] Updated weights for policy 0, policy_version 1916108 (0.0006) [2023-12-26 14:53:54,445][123090] Updated weights for policy 1, policy_version 1904064 (0.0009) [2023-12-26 14:53:55,193][123091] Updated weights for policy 0, policy_version 1916118 (0.0008) [2023-12-26 14:53:55,255][123091] Updated weights for policy 0, policy_version 1916128 (0.0009) [2023-12-26 14:53:55,279][123090] Updated weights for policy 1, policy_version 1904074 (0.0008) [2023-12-26 14:53:55,316][123091] Updated weights for policy 0, policy_version 1916138 (0.0007) [2023-12-26 14:53:55,340][123090] Updated weights for policy 1, policy_version 1904084 (0.0010) [2023-12-26 14:53:55,392][123090] Updated weights for policy 1, policy_version 1904094 (0.0008) [2023-12-26 14:53:56,149][123091] Updated weights for policy 0, policy_version 1916148 (0.0009) [2023-12-26 14:53:56,203][123091] Updated weights for policy 0, policy_version 1916158 (0.0009) [2023-12-26 14:53:56,227][123090] Updated weights for policy 1, policy_version 1904104 (0.0009) [2023-12-26 14:53:56,257][123091] Updated weights for policy 0, policy_version 1916168 (0.0007) [2023-12-26 14:53:56,272][123090] Updated weights for policy 1, policy_version 1904114 (0.0007) [2023-12-26 14:53:56,327][123090] Updated weights for policy 1, policy_version 1904125 (0.0008) [2023-12-26 14:53:57,091][123091] Updated weights for policy 0, policy_version 1916178 (0.0009) [2023-12-26 14:53:57,153][123091] Updated weights for policy 0, policy_version 1916188 (0.0008) [2023-12-26 14:53:57,159][123090] Updated weights for policy 1, policy_version 1904135 (0.0009) [2023-12-26 14:53:57,207][123091] Updated weights for policy 0, policy_version 1916198 (0.0010) [2023-12-26 14:53:57,207][123090] Updated weights for policy 1, policy_version 1904145 (0.0007) [2023-12-26 14:53:57,253][123090] Updated weights for policy 1, policy_version 1904155 (0.0009) [2023-12-26 14:53:57,273][123091] Updated weights for policy 0, policy_version 1916208 (0.0007) [2023-12-26 14:53:58,066][123090] Updated weights for policy 1, policy_version 1904165 (0.0009) [2023-12-26 14:53:58,107][123091] Updated weights for policy 0, policy_version 1916218 (0.0007) [2023-12-26 14:53:58,132][123090] Updated weights for policy 1, policy_version 1904175 (0.0009) [2023-12-26 14:53:58,162][123091] Updated weights for policy 0, policy_version 1916228 (0.0006) [2023-12-26 14:53:58,201][123090] Updated weights for policy 1, policy_version 1904185 (0.0008) [2023-12-26 14:53:58,214][123091] Updated weights for policy 0, policy_version 1916238 (0.0006) [2023-12-26 14:53:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17828.0). Total num frames: 978034688. Throughput: 0: 8756.2, 1: 8632.4. Samples: 978031668. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:53:58,785][121949] Avg episode reward: [(0, '6251.277'), (1, '5928.340')] [2023-12-26 14:53:59,043][123091] Updated weights for policy 0, policy_version 1916248 (0.0006) [2023-12-26 14:53:59,047][123090] Updated weights for policy 1, policy_version 1904195 (0.0008) [2023-12-26 14:53:59,109][123091] Updated weights for policy 0, policy_version 1916258 (0.0007) [2023-12-26 14:53:59,123][123090] Updated weights for policy 1, policy_version 1904205 (0.0008) [2023-12-26 14:53:59,171][123091] Updated weights for policy 0, policy_version 1916268 (0.0008) [2023-12-26 14:53:59,188][123090] Updated weights for policy 1, policy_version 1904215 (0.0007) [2023-12-26 14:53:59,904][123091] Updated weights for policy 0, policy_version 1916278 (0.0008) [2023-12-26 14:53:59,972][123091] Updated weights for policy 0, policy_version 1916288 (0.0012) [2023-12-26 14:54:00,041][123091] Updated weights for policy 0, policy_version 1916298 (0.0006) [2023-12-26 14:54:00,142][123090] Updated weights for policy 1, policy_version 1904225 (0.0009) [2023-12-26 14:54:00,204][123090] Updated weights for policy 1, policy_version 1904235 (0.0010) [2023-12-26 14:54:00,265][123090] Updated weights for policy 1, policy_version 1904245 (0.0010) [2023-12-26 14:54:00,327][123090] Updated weights for policy 1, policy_version 1904255 (0.0009) [2023-12-26 14:54:00,738][123091] Updated weights for policy 0, policy_version 1916308 (0.0005) [2023-12-26 14:54:00,790][123091] Updated weights for policy 0, policy_version 1916318 (0.0006) [2023-12-26 14:54:00,845][123091] Updated weights for policy 0, policy_version 1916328 (0.0006) [2023-12-26 14:54:01,266][123090] Updated weights for policy 1, policy_version 1904265 (0.0009) [2023-12-26 14:54:01,335][123090] Updated weights for policy 1, policy_version 1904275 (0.0010) [2023-12-26 14:54:01,406][123090] Updated weights for policy 1, policy_version 1904285 (0.0009) [2023-12-26 14:54:01,465][123091] Updated weights for policy 0, policy_version 1916338 (0.0006) [2023-12-26 14:54:01,521][123091] Updated weights for policy 0, policy_version 1916348 (0.0010) [2023-12-26 14:54:01,577][123091] Updated weights for policy 0, policy_version 1916358 (0.0009) [2023-12-26 14:54:01,636][123091] Updated weights for policy 0, policy_version 1916368 (0.0009) [2023-12-26 14:54:02,235][123090] Updated weights for policy 1, policy_version 1904295 (0.0008) [2023-12-26 14:54:02,293][123090] Updated weights for policy 1, policy_version 1904305 (0.0009) [2023-12-26 14:54:02,345][123090] Updated weights for policy 1, policy_version 1904315 (0.0008) [2023-12-26 14:54:02,438][123091] Updated weights for policy 0, policy_version 1916378 (0.0008) [2023-12-26 14:54:02,497][123091] Updated weights for policy 0, policy_version 1916388 (0.0007) [2023-12-26 14:54:02,563][123091] Updated weights for policy 0, policy_version 1916398 (0.0008) [2023-12-26 14:54:03,141][123090] Updated weights for policy 1, policy_version 1904325 (0.0007) [2023-12-26 14:54:03,198][123090] Updated weights for policy 1, policy_version 1904335 (0.0006) [2023-12-26 14:54:03,254][123090] Updated weights for policy 1, policy_version 1904345 (0.0005) [2023-12-26 14:54:03,356][123091] Updated weights for policy 0, policy_version 1916408 (0.0008) [2023-12-26 14:54:03,411][123091] Updated weights for policy 0, policy_version 1916418 (0.0005) [2023-12-26 14:54:03,467][123091] Updated weights for policy 0, policy_version 1916428 (0.0005) [2023-12-26 14:54:03,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17800.2). Total num frames: 978124800. Throughput: 0: 8832.8, 1: 8505.5. Samples: 978137616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:03,785][121949] Avg episode reward: [(0, '6290.399'), (1, '5873.208')] [2023-12-26 14:54:03,939][123090] Updated weights for policy 1, policy_version 1904355 (0.0006) [2023-12-26 14:54:04,012][123090] Updated weights for policy 1, policy_version 1904365 (0.0009) [2023-12-26 14:54:04,082][123090] Updated weights for policy 1, policy_version 1904375 (0.0009) [2023-12-26 14:54:04,200][123091] Updated weights for policy 0, policy_version 1916438 (0.0009) [2023-12-26 14:54:04,265][123091] Updated weights for policy 0, policy_version 1916448 (0.0011) [2023-12-26 14:54:04,325][123091] Updated weights for policy 0, policy_version 1916458 (0.0011) [2023-12-26 14:54:04,927][123090] Updated weights for policy 1, policy_version 1904385 (0.0009) [2023-12-26 14:54:04,990][123090] Updated weights for policy 1, policy_version 1904395 (0.0009) [2023-12-26 14:54:05,056][123090] Updated weights for policy 1, policy_version 1904405 (0.0009) [2023-12-26 14:54:05,116][123090] Updated weights for policy 1, policy_version 1904415 (0.0009) [2023-12-26 14:54:05,171][123091] Updated weights for policy 0, policy_version 1916468 (0.0011) [2023-12-26 14:54:05,232][123091] Updated weights for policy 0, policy_version 1916478 (0.0011) [2023-12-26 14:54:05,291][123091] Updated weights for policy 0, policy_version 1916488 (0.0009) [2023-12-26 14:54:06,009][123091] Updated weights for policy 0, policy_version 1916498 (0.0006) [2023-12-26 14:54:06,020][123090] Updated weights for policy 1, policy_version 1904425 (0.0010) [2023-12-26 14:54:06,066][123091] Updated weights for policy 0, policy_version 1916508 (0.0009) [2023-12-26 14:54:06,074][123090] Updated weights for policy 1, policy_version 1904435 (0.0007) [2023-12-26 14:54:06,133][123091] Updated weights for policy 0, policy_version 1916518 (0.0009) [2023-12-26 14:54:06,138][123090] Updated weights for policy 1, policy_version 1904445 (0.0007) [2023-12-26 14:54:06,194][123091] Updated weights for policy 0, policy_version 1916528 (0.0009) [2023-12-26 14:54:06,894][123090] Updated weights for policy 1, policy_version 1904455 (0.0006) [2023-12-26 14:54:06,951][123090] Updated weights for policy 1, policy_version 1904465 (0.0005) [2023-12-26 14:54:06,998][123090] Updated weights for policy 1, policy_version 1904475 (0.0007) [2023-12-26 14:54:07,085][123091] Updated weights for policy 0, policy_version 1916538 (0.0009) [2023-12-26 14:54:07,146][123091] Updated weights for policy 0, policy_version 1916548 (0.0009) [2023-12-26 14:54:07,208][123091] Updated weights for policy 0, policy_version 1916558 (0.0008) [2023-12-26 14:54:07,803][123091] Updated weights for policy 0, policy_version 1916568 (0.0009) [2023-12-26 14:54:07,811][123090] Updated weights for policy 1, policy_version 1904485 (0.0007) [2023-12-26 14:54:07,860][123090] Updated weights for policy 1, policy_version 1904495 (0.0007) [2023-12-26 14:54:07,865][123091] Updated weights for policy 0, policy_version 1916578 (0.0009) [2023-12-26 14:54:07,909][123090] Updated weights for policy 1, policy_version 1904505 (0.0008) [2023-12-26 14:54:07,926][123091] Updated weights for policy 0, policy_version 1916588 (0.0008) [2023-12-26 14:54:08,746][123091] Updated weights for policy 0, policy_version 1916598 (0.0009) [2023-12-26 14:54:08,770][123090] Updated weights for policy 1, policy_version 1904515 (0.0009) [2023-12-26 14:54:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17800.2). Total num frames: 978206720. Throughput: 0: 8880.5, 1: 8463.3. Samples: 978188884. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:08,785][121949] Avg episode reward: [(0, '6295.180'), (1, '5822.010')] [2023-12-26 14:54:08,803][123091] Updated weights for policy 0, policy_version 1916608 (0.0007) [2023-12-26 14:54:08,831][123090] Updated weights for policy 1, policy_version 1904525 (0.0011) [2023-12-26 14:54:08,864][123091] Updated weights for policy 0, policy_version 1916618 (0.0006) [2023-12-26 14:54:08,896][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001916624_490659840.pth... [2023-12-26 14:54:08,899][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001915568_490389504.pth [2023-12-26 14:54:08,900][123090] Updated weights for policy 1, policy_version 1904535 (0.0011) [2023-12-26 14:54:08,959][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001904544_487563264.pth... [2023-12-26 14:54:08,964][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001903520_487301120.pth [2023-12-26 14:54:09,702][123091] Updated weights for policy 0, policy_version 1916628 (0.0008) [2023-12-26 14:54:09,713][123090] Updated weights for policy 1, policy_version 1904545 (0.0010) [2023-12-26 14:54:09,750][123091] Updated weights for policy 0, policy_version 1916638 (0.0009) [2023-12-26 14:54:09,779][123090] Updated weights for policy 1, policy_version 1904555 (0.0009) [2023-12-26 14:54:09,815][123091] Updated weights for policy 0, policy_version 1916648 (0.0007) [2023-12-26 14:54:09,848][123090] Updated weights for policy 1, policy_version 1904565 (0.0009) [2023-12-26 14:54:09,914][123090] Updated weights for policy 1, policy_version 1904575 (0.0010) [2023-12-26 14:54:10,703][123091] Updated weights for policy 0, policy_version 1916658 (0.0007) [2023-12-26 14:54:10,749][123090] Updated weights for policy 1, policy_version 1904585 (0.0010) [2023-12-26 14:54:10,765][123091] Updated weights for policy 0, policy_version 1916668 (0.0008) [2023-12-26 14:54:10,813][123090] Updated weights for policy 1, policy_version 1904595 (0.0008) [2023-12-26 14:54:10,831][123091] Updated weights for policy 0, policy_version 1916678 (0.0006) [2023-12-26 14:54:10,869][123090] Updated weights for policy 1, policy_version 1904605 (0.0010) [2023-12-26 14:54:10,898][123091] Updated weights for policy 0, policy_version 1916688 (0.0006) [2023-12-26 14:54:11,715][123091] Updated weights for policy 0, policy_version 1916698 (0.0009) [2023-12-26 14:54:11,763][123090] Updated weights for policy 1, policy_version 1904615 (0.0008) [2023-12-26 14:54:11,778][123091] Updated weights for policy 0, policy_version 1916708 (0.0008) [2023-12-26 14:54:11,837][123090] Updated weights for policy 1, policy_version 1904625 (0.0006) [2023-12-26 14:54:11,849][123091] Updated weights for policy 0, policy_version 1916718 (0.0010) [2023-12-26 14:54:11,908][123090] Updated weights for policy 1, policy_version 1904635 (0.0008) [2023-12-26 14:54:12,668][123091] Updated weights for policy 0, policy_version 1916728 (0.0010) [2023-12-26 14:54:12,714][123090] Updated weights for policy 1, policy_version 1904645 (0.0007) [2023-12-26 14:54:12,726][123091] Updated weights for policy 0, policy_version 1916738 (0.0011) [2023-12-26 14:54:12,766][123090] Updated weights for policy 1, policy_version 1904655 (0.0007) [2023-12-26 14:54:12,791][123091] Updated weights for policy 0, policy_version 1916748 (0.0007) [2023-12-26 14:54:12,819][123090] Updated weights for policy 1, policy_version 1904665 (0.0009) [2023-12-26 14:54:13,607][123091] Updated weights for policy 0, policy_version 1916758 (0.0008) [2023-12-26 14:54:13,666][123090] Updated weights for policy 1, policy_version 1904675 (0.0009) [2023-12-26 14:54:13,668][123091] Updated weights for policy 0, policy_version 1916768 (0.0009) [2023-12-26 14:54:13,724][123090] Updated weights for policy 1, policy_version 1904685 (0.0007) [2023-12-26 14:54:13,726][123091] Updated weights for policy 0, policy_version 1916778 (0.0009) [2023-12-26 14:54:13,779][123090] Updated weights for policy 1, policy_version 1904695 (0.0007) [2023-12-26 14:54:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17772.5). Total num frames: 978296832. Throughput: 0: 8897.3, 1: 8492.2. Samples: 978292692. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:13,784][121949] Avg episode reward: [(0, '6206.672'), (1, '5861.771')] [2023-12-26 14:54:14,476][123090] Updated weights for policy 1, policy_version 1904705 (0.0009) [2023-12-26 14:54:14,541][123090] Updated weights for policy 1, policy_version 1904715 (0.0007) [2023-12-26 14:54:14,573][123091] Updated weights for policy 0, policy_version 1916788 (0.0009) [2023-12-26 14:54:14,589][123090] Updated weights for policy 1, policy_version 1904725 (0.0009) [2023-12-26 14:54:14,636][123091] Updated weights for policy 0, policy_version 1916798 (0.0009) [2023-12-26 14:54:14,648][123090] Updated weights for policy 1, policy_version 1904735 (0.0006) [2023-12-26 14:54:14,694][123091] Updated weights for policy 0, policy_version 1916808 (0.0010) [2023-12-26 14:54:15,450][123091] Updated weights for policy 0, policy_version 1916818 (0.0008) [2023-12-26 14:54:15,474][123090] Updated weights for policy 1, policy_version 1904745 (0.0009) [2023-12-26 14:54:15,513][123091] Updated weights for policy 0, policy_version 1916828 (0.0005) [2023-12-26 14:54:15,531][123090] Updated weights for policy 1, policy_version 1904755 (0.0009) [2023-12-26 14:54:15,571][123091] Updated weights for policy 0, policy_version 1916838 (0.0007) [2023-12-26 14:54:15,593][123090] Updated weights for policy 1, policy_version 1904765 (0.0009) [2023-12-26 14:54:15,620][123091] Updated weights for policy 0, policy_version 1916848 (0.0007) [2023-12-26 14:54:16,358][123091] Updated weights for policy 0, policy_version 1916858 (0.0009) [2023-12-26 14:54:16,418][123091] Updated weights for policy 0, policy_version 1916868 (0.0010) [2023-12-26 14:54:16,437][123090] Updated weights for policy 1, policy_version 1904775 (0.0008) [2023-12-26 14:54:16,467][123091] Updated weights for policy 0, policy_version 1916878 (0.0006) [2023-12-26 14:54:16,488][123090] Updated weights for policy 1, policy_version 1904785 (0.0010) [2023-12-26 14:54:16,537][123090] Updated weights for policy 1, policy_version 1904795 (0.0009) [2023-12-26 14:54:17,270][123091] Updated weights for policy 0, policy_version 1916888 (0.0008) [2023-12-26 14:54:17,277][123090] Updated weights for policy 1, policy_version 1904805 (0.0007) [2023-12-26 14:54:17,323][123091] Updated weights for policy 0, policy_version 1916898 (0.0009) [2023-12-26 14:54:17,340][123090] Updated weights for policy 1, policy_version 1904815 (0.0010) [2023-12-26 14:54:17,368][123091] Updated weights for policy 0, policy_version 1916908 (0.0007) [2023-12-26 14:54:17,399][123090] Updated weights for policy 1, policy_version 1904825 (0.0010) [2023-12-26 14:54:18,193][123091] Updated weights for policy 0, policy_version 1916918 (0.0009) [2023-12-26 14:54:18,222][123090] Updated weights for policy 1, policy_version 1904835 (0.0010) [2023-12-26 14:54:18,254][123091] Updated weights for policy 0, policy_version 1916928 (0.0009) [2023-12-26 14:54:18,278][123090] Updated weights for policy 1, policy_version 1904845 (0.0007) [2023-12-26 14:54:18,310][123091] Updated weights for policy 0, policy_version 1916938 (0.0009) [2023-12-26 14:54:18,350][123090] Updated weights for policy 1, policy_version 1904855 (0.0010) [2023-12-26 14:54:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17800.2). Total num frames: 978386944. Throughput: 0: 8826.0, 1: 8542.8. Samples: 978397092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:18,785][121949] Avg episode reward: [(0, '6268.644'), (1, '5903.815')] [2023-12-26 14:54:19,170][123091] Updated weights for policy 0, policy_version 1916948 (0.0009) [2023-12-26 14:54:19,195][123090] Updated weights for policy 1, policy_version 1904865 (0.0010) [2023-12-26 14:54:19,236][123091] Updated weights for policy 0, policy_version 1916958 (0.0008) [2023-12-26 14:54:19,265][123090] Updated weights for policy 1, policy_version 1904875 (0.0011) [2023-12-26 14:54:19,303][123091] Updated weights for policy 0, policy_version 1916968 (0.0009) [2023-12-26 14:54:19,319][123090] Updated weights for policy 1, policy_version 1904885 (0.0007) [2023-12-26 14:54:19,389][123090] Updated weights for policy 1, policy_version 1904895 (0.0009) [2023-12-26 14:54:20,172][123091] Updated weights for policy 0, policy_version 1916978 (0.0010) [2023-12-26 14:54:20,234][123091] Updated weights for policy 0, policy_version 1916988 (0.0008) [2023-12-26 14:54:20,275][123090] Updated weights for policy 1, policy_version 1904905 (0.0010) [2023-12-26 14:54:20,295][123091] Updated weights for policy 0, policy_version 1916998 (0.0007) [2023-12-26 14:54:20,336][123090] Updated weights for policy 1, policy_version 1904915 (0.0011) [2023-12-26 14:54:20,360][123091] Updated weights for policy 0, policy_version 1917008 (0.0009) [2023-12-26 14:54:20,395][123090] Updated weights for policy 1, policy_version 1904925 (0.0010) [2023-12-26 14:54:21,172][123091] Updated weights for policy 0, policy_version 1917018 (0.0009) [2023-12-26 14:54:21,201][123090] Updated weights for policy 1, policy_version 1904935 (0.0008) [2023-12-26 14:54:21,230][123091] Updated weights for policy 0, policy_version 1917028 (0.0009) [2023-12-26 14:54:21,267][123090] Updated weights for policy 1, policy_version 1904945 (0.0008) [2023-12-26 14:54:21,301][123091] Updated weights for policy 0, policy_version 1917038 (0.0009) [2023-12-26 14:54:21,330][123090] Updated weights for policy 1, policy_version 1904955 (0.0008) [2023-12-26 14:54:22,101][123091] Updated weights for policy 0, policy_version 1917048 (0.0010) [2023-12-26 14:54:22,165][123091] Updated weights for policy 0, policy_version 1917058 (0.0009) [2023-12-26 14:54:22,230][123091] Updated weights for policy 0, policy_version 1917068 (0.0009) [2023-12-26 14:54:22,251][123090] Updated weights for policy 1, policy_version 1904965 (0.0009) [2023-12-26 14:54:22,327][123090] Updated weights for policy 1, policy_version 1904975 (0.0008) [2023-12-26 14:54:22,400][123090] Updated weights for policy 1, policy_version 1904985 (0.0010) [2023-12-26 14:54:23,006][123091] Updated weights for policy 0, policy_version 1917078 (0.0006) [2023-12-26 14:54:23,065][123091] Updated weights for policy 0, policy_version 1917088 (0.0005) [2023-12-26 14:54:23,129][123091] Updated weights for policy 0, policy_version 1917098 (0.0009) [2023-12-26 14:54:23,258][123090] Updated weights for policy 1, policy_version 1904995 (0.0009) [2023-12-26 14:54:23,322][123090] Updated weights for policy 1, policy_version 1905005 (0.0008) [2023-12-26 14:54:23,373][123090] Updated weights for policy 1, policy_version 1905015 (0.0008) [2023-12-26 14:54:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17203.1, 300 sec: 17772.5). Total num frames: 978468864. Throughput: 0: 8827.6, 1: 8507.8. Samples: 978447328. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:23,785][121949] Avg episode reward: [(0, '6297.099'), (1, '5922.768')] [2023-12-26 14:54:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001917104_490782720.pth... [2023-12-26 14:54:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001905024_487686144.pth... [2023-12-26 14:54:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001904032_487432192.pth [2023-12-26 14:54:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001916080_490520576.pth [2023-12-26 14:54:23,859][123091] Updated weights for policy 0, policy_version 1917109 (0.0011) [2023-12-26 14:54:23,909][123091] Updated weights for policy 0, policy_version 1917119 (0.0006) [2023-12-26 14:54:23,965][123091] Updated weights for policy 0, policy_version 1917129 (0.0005) [2023-12-26 14:54:24,265][123090] Updated weights for policy 1, policy_version 1905025 (0.0008) [2023-12-26 14:54:24,316][123090] Updated weights for policy 1, policy_version 1905035 (0.0008) [2023-12-26 14:54:24,363][123090] Updated weights for policy 1, policy_version 1905045 (0.0006) [2023-12-26 14:54:24,418][123090] Updated weights for policy 1, policy_version 1905055 (0.0005) [2023-12-26 14:54:24,762][123091] Updated weights for policy 0, policy_version 1917139 (0.0006) [2023-12-26 14:54:24,815][123091] Updated weights for policy 0, policy_version 1917149 (0.0009) [2023-12-26 14:54:24,868][123091] Updated weights for policy 0, policy_version 1917159 (0.0009) [2023-12-26 14:54:25,173][123090] Updated weights for policy 1, policy_version 1905065 (0.0010) [2023-12-26 14:54:25,231][123090] Updated weights for policy 1, policy_version 1905075 (0.0010) [2023-12-26 14:54:25,301][123090] Updated weights for policy 1, policy_version 1905085 (0.0010) [2023-12-26 14:54:25,735][123091] Updated weights for policy 0, policy_version 1917169 (0.0009) [2023-12-26 14:54:25,805][123091] Updated weights for policy 0, policy_version 1917179 (0.0008) [2023-12-26 14:54:25,867][123091] Updated weights for policy 0, policy_version 1917189 (0.0008) [2023-12-26 14:54:25,932][123091] Updated weights for policy 0, policy_version 1917199 (0.0007) [2023-12-26 14:54:26,115][123090] Updated weights for policy 1, policy_version 1905095 (0.0011) [2023-12-26 14:54:26,175][123090] Updated weights for policy 1, policy_version 1905105 (0.0011) [2023-12-26 14:54:26,235][123090] Updated weights for policy 1, policy_version 1905115 (0.0011) [2023-12-26 14:54:26,586][123091] Updated weights for policy 0, policy_version 1917209 (0.0008) [2023-12-26 14:54:26,636][123091] Updated weights for policy 0, policy_version 1917219 (0.0009) [2023-12-26 14:54:26,684][123091] Updated weights for policy 0, policy_version 1917229 (0.0009) [2023-12-26 14:54:27,074][123090] Updated weights for policy 1, policy_version 1905125 (0.0010) [2023-12-26 14:54:27,136][123090] Updated weights for policy 1, policy_version 1905135 (0.0010) [2023-12-26 14:54:27,190][123090] Updated weights for policy 1, policy_version 1905145 (0.0009) [2023-12-26 14:54:27,546][123091] Updated weights for policy 0, policy_version 1917239 (0.0006) [2023-12-26 14:54:27,601][123091] Updated weights for policy 0, policy_version 1917249 (0.0005) [2023-12-26 14:54:27,660][123091] Updated weights for policy 0, policy_version 1917259 (0.0005) [2023-12-26 14:54:28,034][123090] Updated weights for policy 1, policy_version 1905155 (0.0009) [2023-12-26 14:54:28,080][123090] Updated weights for policy 1, policy_version 1905165 (0.0009) [2023-12-26 14:54:28,134][123090] Updated weights for policy 1, policy_version 1905175 (0.0005) [2023-12-26 14:54:28,408][123091] Updated weights for policy 0, policy_version 1917269 (0.0010) [2023-12-26 14:54:28,467][123091] Updated weights for policy 0, policy_version 1917279 (0.0010) [2023-12-26 14:54:28,533][123091] Updated weights for policy 0, policy_version 1917289 (0.0010) [2023-12-26 14:54:28,784][121949] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17772.5). Total num frames: 978558976. Throughput: 0: 8889.6, 1: 8528.1. Samples: 978551804. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:28,786][121949] Avg episode reward: [(0, '6362.439'), (1, '5801.190')] [2023-12-26 14:54:28,813][123090] Updated weights for policy 1, policy_version 1905185 (0.0006) [2023-12-26 14:54:28,862][123090] Updated weights for policy 1, policy_version 1905195 (0.0005) [2023-12-26 14:54:28,911][123090] Updated weights for policy 1, policy_version 1905205 (0.0009) [2023-12-26 14:54:28,980][123090] Updated weights for policy 1, policy_version 1905215 (0.0010) [2023-12-26 14:54:29,245][123091] Updated weights for policy 0, policy_version 1917299 (0.0011) [2023-12-26 14:54:29,311][123091] Updated weights for policy 0, policy_version 1917309 (0.0011) [2023-12-26 14:54:29,382][123091] Updated weights for policy 0, policy_version 1917319 (0.0008) [2023-12-26 14:54:29,779][123090] Updated weights for policy 1, policy_version 1905225 (0.0006) [2023-12-26 14:54:29,840][123090] Updated weights for policy 1, policy_version 1905235 (0.0006) [2023-12-26 14:54:29,905][123090] Updated weights for policy 1, policy_version 1905245 (0.0006) [2023-12-26 14:54:30,178][123091] Updated weights for policy 0, policy_version 1917329 (0.0007) [2023-12-26 14:54:30,246][123091] Updated weights for policy 0, policy_version 1917339 (0.0007) [2023-12-26 14:54:30,305][123091] Updated weights for policy 0, policy_version 1917349 (0.0006) [2023-12-26 14:54:30,377][123091] Updated weights for policy 0, policy_version 1917359 (0.0006) [2023-12-26 14:54:30,592][123090] Updated weights for policy 1, policy_version 1905255 (0.0006) [2023-12-26 14:54:30,654][123090] Updated weights for policy 1, policy_version 1905265 (0.0005) [2023-12-26 14:54:30,715][123090] Updated weights for policy 1, policy_version 1905275 (0.0006) [2023-12-26 14:54:31,018][123091] Updated weights for policy 0, policy_version 1917369 (0.0006) [2023-12-26 14:54:31,079][123091] Updated weights for policy 0, policy_version 1917379 (0.0010) [2023-12-26 14:54:31,149][123091] Updated weights for policy 0, policy_version 1917389 (0.0011) [2023-12-26 14:54:31,511][123090] Updated weights for policy 1, policy_version 1905285 (0.0010) [2023-12-26 14:54:31,567][123090] Updated weights for policy 1, policy_version 1905295 (0.0010) [2023-12-26 14:54:31,624][123090] Updated weights for policy 1, policy_version 1905305 (0.0009) [2023-12-26 14:54:31,874][123091] Updated weights for policy 0, policy_version 1917399 (0.0011) [2023-12-26 14:54:31,933][123091] Updated weights for policy 0, policy_version 1917409 (0.0011) [2023-12-26 14:54:31,999][123091] Updated weights for policy 0, policy_version 1917419 (0.0010) [2023-12-26 14:54:32,433][123090] Updated weights for policy 1, policy_version 1905315 (0.0009) [2023-12-26 14:54:32,497][123090] Updated weights for policy 1, policy_version 1905325 (0.0010) [2023-12-26 14:54:32,552][123090] Updated weights for policy 1, policy_version 1905335 (0.0005) [2023-12-26 14:54:32,748][123091] Updated weights for policy 0, policy_version 1917429 (0.0008) [2023-12-26 14:54:32,801][123091] Updated weights for policy 0, policy_version 1917439 (0.0006) [2023-12-26 14:54:32,855][123091] Updated weights for policy 0, policy_version 1917449 (0.0005) [2023-12-26 14:54:33,304][123090] Updated weights for policy 1, policy_version 1905345 (0.0005) [2023-12-26 14:54:33,361][123090] Updated weights for policy 1, policy_version 1905355 (0.0005) [2023-12-26 14:54:33,411][123090] Updated weights for policy 1, policy_version 1905365 (0.0005) [2023-12-26 14:54:33,466][123090] Updated weights for policy 1, policy_version 1905375 (0.0005) [2023-12-26 14:54:33,578][123091] Updated weights for policy 0, policy_version 1917459 (0.0006) [2023-12-26 14:54:33,643][123091] Updated weights for policy 0, policy_version 1917469 (0.0009) [2023-12-26 14:54:33,696][123091] Updated weights for policy 0, policy_version 1917479 (0.0010) [2023-12-26 14:54:33,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 978657280. Throughput: 0: 8956.8, 1: 8580.8. Samples: 978665436. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:33,785][121949] Avg episode reward: [(0, '6405.171'), (1, '5958.233')] [2023-12-26 14:54:34,131][123090] Updated weights for policy 1, policy_version 1905385 (0.0005) [2023-12-26 14:54:34,199][123090] Updated weights for policy 1, policy_version 1905395 (0.0008) [2023-12-26 14:54:34,270][123090] Updated weights for policy 1, policy_version 1905405 (0.0008) [2023-12-26 14:54:34,430][123091] Updated weights for policy 0, policy_version 1917489 (0.0010) [2023-12-26 14:54:34,508][123091] Updated weights for policy 0, policy_version 1917499 (0.0011) [2023-12-26 14:54:34,570][123091] Updated weights for policy 0, policy_version 1917509 (0.0011) [2023-12-26 14:54:34,645][123091] Updated weights for policy 0, policy_version 1917519 (0.0011) [2023-12-26 14:54:34,992][123090] Updated weights for policy 1, policy_version 1905415 (0.0008) [2023-12-26 14:54:35,057][123090] Updated weights for policy 1, policy_version 1905425 (0.0009) [2023-12-26 14:54:35,122][123090] Updated weights for policy 1, policy_version 1905435 (0.0009) [2023-12-26 14:54:35,465][123091] Updated weights for policy 0, policy_version 1917529 (0.0010) [2023-12-26 14:54:35,521][123091] Updated weights for policy 0, policy_version 1917539 (0.0011) [2023-12-26 14:54:35,571][123091] Updated weights for policy 0, policy_version 1917549 (0.0010) [2023-12-26 14:54:35,916][123090] Updated weights for policy 1, policy_version 1905445 (0.0008) [2023-12-26 14:54:35,969][123090] Updated weights for policy 1, policy_version 1905455 (0.0008) [2023-12-26 14:54:36,021][123090] Updated weights for policy 1, policy_version 1905465 (0.0005) [2023-12-26 14:54:36,408][123091] Updated weights for policy 0, policy_version 1917559 (0.0010) [2023-12-26 14:54:36,460][123091] Updated weights for policy 0, policy_version 1917569 (0.0010) [2023-12-26 14:54:36,519][123091] Updated weights for policy 0, policy_version 1917579 (0.0011) [2023-12-26 14:54:36,809][123090] Updated weights for policy 1, policy_version 1905475 (0.0006) [2023-12-26 14:54:36,871][123090] Updated weights for policy 1, policy_version 1905485 (0.0009) [2023-12-26 14:54:36,929][123090] Updated weights for policy 1, policy_version 1905495 (0.0009) [2023-12-26 14:54:37,371][123091] Updated weights for policy 0, policy_version 1917589 (0.0011) [2023-12-26 14:54:37,437][123091] Updated weights for policy 0, policy_version 1917599 (0.0010) [2023-12-26 14:54:37,503][123091] Updated weights for policy 0, policy_version 1917609 (0.0010) [2023-12-26 14:54:37,809][123090] Updated weights for policy 1, policy_version 1905505 (0.0009) [2023-12-26 14:54:37,867][123090] Updated weights for policy 1, policy_version 1905516 (0.0011) [2023-12-26 14:54:37,930][123090] Updated weights for policy 1, policy_version 1905526 (0.0010) [2023-12-26 14:54:37,984][123090] Updated weights for policy 1, policy_version 1905536 (0.0009) [2023-12-26 14:54:38,236][123091] Updated weights for policy 0, policy_version 1917619 (0.0010) [2023-12-26 14:54:38,294][123091] Updated weights for policy 0, policy_version 1917629 (0.0010) [2023-12-26 14:54:38,364][123091] Updated weights for policy 0, policy_version 1917639 (0.0009) [2023-12-26 14:54:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 978739200. Throughput: 0: 8933.0, 1: 8663.8. Samples: 978719476. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:38,785][121949] Avg episode reward: [(0, '6307.650'), (1, '5765.995')] [2023-12-26 14:54:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001917648_490921984.pth... [2023-12-26 14:54:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001905536_487817216.pth... [2023-12-26 14:54:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001916624_490659840.pth [2023-12-26 14:54:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001904544_487563264.pth [2023-12-26 14:54:38,880][123090] Updated weights for policy 1, policy_version 1905546 (0.0010) [2023-12-26 14:54:38,946][123090] Updated weights for policy 1, policy_version 1905556 (0.0009) [2023-12-26 14:54:39,005][123090] Updated weights for policy 1, policy_version 1905566 (0.0010) [2023-12-26 14:54:39,117][123091] Updated weights for policy 0, policy_version 1917649 (0.0010) [2023-12-26 14:54:39,180][123091] Updated weights for policy 0, policy_version 1917659 (0.0005) [2023-12-26 14:54:39,236][123091] Updated weights for policy 0, policy_version 1917669 (0.0007) [2023-12-26 14:54:39,300][123091] Updated weights for policy 0, policy_version 1917679 (0.0008) [2023-12-26 14:54:39,901][123090] Updated weights for policy 1, policy_version 1905576 (0.0013) [2023-12-26 14:54:39,970][123090] Updated weights for policy 1, policy_version 1905586 (0.0011) [2023-12-26 14:54:40,034][123090] Updated weights for policy 1, policy_version 1905596 (0.0011) [2023-12-26 14:54:40,119][123091] Updated weights for policy 0, policy_version 1917689 (0.0010) [2023-12-26 14:54:40,190][123091] Updated weights for policy 0, policy_version 1917699 (0.0011) [2023-12-26 14:54:40,257][123091] Updated weights for policy 0, policy_version 1917709 (0.0011) [2023-12-26 14:54:40,787][123090] Updated weights for policy 1, policy_version 1905606 (0.0010) [2023-12-26 14:54:40,858][123090] Updated weights for policy 1, policy_version 1905616 (0.0011) [2023-12-26 14:54:40,925][123090] Updated weights for policy 1, policy_version 1905626 (0.0011) [2023-12-26 14:54:41,048][123091] Updated weights for policy 0, policy_version 1917719 (0.0009) [2023-12-26 14:54:41,108][123091] Updated weights for policy 0, policy_version 1917729 (0.0008) [2023-12-26 14:54:41,184][123091] Updated weights for policy 0, policy_version 1917739 (0.0008) [2023-12-26 14:54:41,777][123090] Updated weights for policy 1, policy_version 1905636 (0.0010) [2023-12-26 14:54:41,842][123090] Updated weights for policy 1, policy_version 1905646 (0.0009) [2023-12-26 14:54:41,907][123090] Updated weights for policy 1, policy_version 1905656 (0.0009) [2023-12-26 14:54:41,983][123091] Updated weights for policy 0, policy_version 1917749 (0.0009) [2023-12-26 14:54:42,040][123091] Updated weights for policy 0, policy_version 1917759 (0.0011) [2023-12-26 14:54:42,108][123091] Updated weights for policy 0, policy_version 1917769 (0.0009) [2023-12-26 14:54:42,773][123090] Updated weights for policy 1, policy_version 1905666 (0.0009) [2023-12-26 14:54:42,837][123090] Updated weights for policy 1, policy_version 1905676 (0.0010) [2023-12-26 14:54:42,880][123091] Updated weights for policy 0, policy_version 1917779 (0.0007) [2023-12-26 14:54:42,901][123090] Updated weights for policy 1, policy_version 1905686 (0.0007) [2023-12-26 14:54:42,934][123091] Updated weights for policy 0, policy_version 1917789 (0.0009) [2023-12-26 14:54:42,960][123090] Updated weights for policy 1, policy_version 1905696 (0.0007) [2023-12-26 14:54:42,993][123091] Updated weights for policy 0, policy_version 1917799 (0.0009) [2023-12-26 14:54:43,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17772.5). Total num frames: 978821120. Throughput: 0: 8949.1, 1: 8609.8. Samples: 978821820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:43,785][121949] Avg episode reward: [(0, '6255.032'), (1, '5727.934')] [2023-12-26 14:54:43,801][123091] Updated weights for policy 0, policy_version 1917809 (0.0009) [2023-12-26 14:54:43,835][123090] Updated weights for policy 1, policy_version 1905706 (0.0010) [2023-12-26 14:54:43,865][123091] Updated weights for policy 0, policy_version 1917819 (0.0008) [2023-12-26 14:54:43,891][123090] Updated weights for policy 1, policy_version 1905716 (0.0007) [2023-12-26 14:54:43,910][123091] Updated weights for policy 0, policy_version 1917829 (0.0009) [2023-12-26 14:54:43,957][123090] Updated weights for policy 1, policy_version 1905726 (0.0008) [2023-12-26 14:54:43,957][123091] Updated weights for policy 0, policy_version 1917839 (0.0008) [2023-12-26 14:54:44,804][123090] Updated weights for policy 1, policy_version 1905736 (0.0008) [2023-12-26 14:54:44,813][123091] Updated weights for policy 0, policy_version 1917849 (0.0008) [2023-12-26 14:54:44,861][123090] Updated weights for policy 1, policy_version 1905746 (0.0009) [2023-12-26 14:54:44,867][123091] Updated weights for policy 0, policy_version 1917859 (0.0008) [2023-12-26 14:54:44,918][123090] Updated weights for policy 1, policy_version 1905756 (0.0007) [2023-12-26 14:54:44,934][123091] Updated weights for policy 0, policy_version 1917869 (0.0008) [2023-12-26 14:54:45,731][123090] Updated weights for policy 1, policy_version 1905767 (0.0010) [2023-12-26 14:54:45,773][123091] Updated weights for policy 0, policy_version 1917879 (0.0008) [2023-12-26 14:54:45,795][123090] Updated weights for policy 1, policy_version 1905777 (0.0009) [2023-12-26 14:54:45,828][123091] Updated weights for policy 0, policy_version 1917889 (0.0005) [2023-12-26 14:54:45,851][123090] Updated weights for policy 1, policy_version 1905787 (0.0009) [2023-12-26 14:54:45,881][123091] Updated weights for policy 0, policy_version 1917899 (0.0005) [2023-12-26 14:54:46,528][123090] Updated weights for policy 1, policy_version 1905797 (0.0007) [2023-12-26 14:54:46,557][123091] Updated weights for policy 0, policy_version 1917909 (0.0005) [2023-12-26 14:54:46,584][123090] Updated weights for policy 1, policy_version 1905807 (0.0005) [2023-12-26 14:54:46,608][123091] Updated weights for policy 0, policy_version 1917919 (0.0005) [2023-12-26 14:54:46,641][123090] Updated weights for policy 1, policy_version 1905817 (0.0008) [2023-12-26 14:54:46,653][123091] Updated weights for policy 0, policy_version 1917929 (0.0005) [2023-12-26 14:54:47,343][123090] Updated weights for policy 1, policy_version 1905827 (0.0005) [2023-12-26 14:54:47,388][123091] Updated weights for policy 0, policy_version 1917939 (0.0006) [2023-12-26 14:54:47,395][123090] Updated weights for policy 1, policy_version 1905837 (0.0005) [2023-12-26 14:54:47,440][123090] Updated weights for policy 1, policy_version 1905847 (0.0005) [2023-12-26 14:54:47,446][123091] Updated weights for policy 0, policy_version 1917950 (0.0009) [2023-12-26 14:54:47,496][123091] Updated weights for policy 0, policy_version 1917960 (0.0009) [2023-12-26 14:54:48,123][123090] Updated weights for policy 1, policy_version 1905857 (0.0005) [2023-12-26 14:54:48,192][123090] Updated weights for policy 1, policy_version 1905867 (0.0006) [2023-12-26 14:54:48,260][123090] Updated weights for policy 1, policy_version 1905877 (0.0006) [2023-12-26 14:54:48,340][123090] Updated weights for policy 1, policy_version 1905887 (0.0007) [2023-12-26 14:54:48,351][123091] Updated weights for policy 0, policy_version 1917970 (0.0009) [2023-12-26 14:54:48,415][123091] Updated weights for policy 0, policy_version 1917980 (0.0006) [2023-12-26 14:54:48,482][123091] Updated weights for policy 0, policy_version 1917990 (0.0009) [2023-12-26 14:54:48,549][123091] Updated weights for policy 0, policy_version 1918000 (0.0011) [2023-12-26 14:54:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17772.5). Total num frames: 978919424. Throughput: 0: 8912.9, 1: 8711.3. Samples: 978930704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:54:48,785][121949] Avg episode reward: [(0, '6247.307'), (1, '5811.050')] [2023-12-26 14:54:49,017][123090] Updated weights for policy 1, policy_version 1905897 (0.0008) [2023-12-26 14:54:49,097][123090] Updated weights for policy 1, policy_version 1905907 (0.0008) [2023-12-26 14:54:49,174][123090] Updated weights for policy 1, policy_version 1905917 (0.0009) [2023-12-26 14:54:49,320][123091] Updated weights for policy 0, policy_version 1918010 (0.0006) [2023-12-26 14:54:49,390][123091] Updated weights for policy 0, policy_version 1918020 (0.0008) [2023-12-26 14:54:49,450][123091] Updated weights for policy 0, policy_version 1918030 (0.0011) [2023-12-26 14:54:49,948][123090] Updated weights for policy 1, policy_version 1905927 (0.0011) [2023-12-26 14:54:50,005][123090] Updated weights for policy 1, policy_version 1905937 (0.0009) [2023-12-26 14:54:50,064][123090] Updated weights for policy 1, policy_version 1905947 (0.0007) [2023-12-26 14:54:50,298][123091] Updated weights for policy 0, policy_version 1918040 (0.0011) [2023-12-26 14:54:50,361][123091] Updated weights for policy 0, policy_version 1918050 (0.0011) [2023-12-26 14:54:50,419][123091] Updated weights for policy 0, policy_version 1918060 (0.0011) [2023-12-26 14:54:50,889][123090] Updated weights for policy 1, policy_version 1905957 (0.0008) [2023-12-26 14:54:50,951][123090] Updated weights for policy 1, policy_version 1905967 (0.0009) [2023-12-26 14:54:51,015][123090] Updated weights for policy 1, policy_version 1905977 (0.0010) [2023-12-26 14:54:51,181][123091] Updated weights for policy 0, policy_version 1918070 (0.0009) [2023-12-26 14:54:51,246][123091] Updated weights for policy 0, policy_version 1918080 (0.0008) [2023-12-26 14:54:51,302][123091] Updated weights for policy 0, policy_version 1918090 (0.0009) [2023-12-26 14:54:51,862][123090] Updated weights for policy 1, policy_version 1905987 (0.0009) [2023-12-26 14:54:51,930][123090] Updated weights for policy 1, policy_version 1905997 (0.0009) [2023-12-26 14:54:51,984][123090] Updated weights for policy 1, policy_version 1906007 (0.0006) [2023-12-26 14:54:52,195][123091] Updated weights for policy 0, policy_version 1918100 (0.0009) [2023-12-26 14:54:52,254][123091] Updated weights for policy 0, policy_version 1918110 (0.0010) [2023-12-26 14:54:52,313][123091] Updated weights for policy 0, policy_version 1918120 (0.0010) [2023-12-26 14:54:52,711][123090] Updated weights for policy 1, policy_version 1906017 (0.0006) [2023-12-26 14:54:52,777][123090] Updated weights for policy 1, policy_version 1906027 (0.0008) [2023-12-26 14:54:52,850][123090] Updated weights for policy 1, policy_version 1906037 (0.0008) [2023-12-26 14:54:52,921][123090] Updated weights for policy 1, policy_version 1906047 (0.0009) [2023-12-26 14:54:53,168][123091] Updated weights for policy 0, policy_version 1918130 (0.0009) [2023-12-26 14:54:53,217][123091] Updated weights for policy 0, policy_version 1918140 (0.0009) [2023-12-26 14:54:53,272][123091] Updated weights for policy 0, policy_version 1918151 (0.0010) [2023-12-26 14:54:53,716][123090] Updated weights for policy 1, policy_version 1906057 (0.0009) [2023-12-26 14:54:53,778][123090] Updated weights for policy 1, policy_version 1906067 (0.0009) [2023-12-26 14:54:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17772.6). Total num frames: 979001344. Throughput: 0: 8889.2, 1: 8748.1. Samples: 978982560. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:54:53,785][121949] Avg episode reward: [(0, '6260.449'), (1, '5887.625')] [2023-12-26 14:54:53,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001918160_491053056.pth... [2023-12-26 14:54:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001917104_490782720.pth [2023-12-26 14:54:53,832][123090] Updated weights for policy 1, policy_version 1906077 (0.0009) [2023-12-26 14:54:53,846][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001906080_487956480.pth... [2023-12-26 14:54:53,850][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001905024_487686144.pth [2023-12-26 14:54:54,069][123091] Updated weights for policy 0, policy_version 1918161 (0.0010) [2023-12-26 14:54:54,127][123091] Updated weights for policy 0, policy_version 1918171 (0.0008) [2023-12-26 14:54:54,178][123091] Updated weights for policy 0, policy_version 1918181 (0.0010) [2023-12-26 14:54:54,232][123091] Updated weights for policy 0, policy_version 1918191 (0.0007) [2023-12-26 14:54:54,632][123090] Updated weights for policy 1, policy_version 1906087 (0.0010) [2023-12-26 14:54:54,691][123090] Updated weights for policy 1, policy_version 1906097 (0.0010) [2023-12-26 14:54:54,749][123090] Updated weights for policy 1, policy_version 1906107 (0.0008) [2023-12-26 14:54:55,096][123091] Updated weights for policy 0, policy_version 1918201 (0.0008) [2023-12-26 14:54:55,166][123091] Updated weights for policy 0, policy_version 1918211 (0.0007) [2023-12-26 14:54:55,233][123091] Updated weights for policy 0, policy_version 1918221 (0.0007) [2023-12-26 14:54:55,373][123090] Updated weights for policy 1, policy_version 1906117 (0.0008) [2023-12-26 14:54:55,435][123090] Updated weights for policy 1, policy_version 1906127 (0.0010) [2023-12-26 14:54:55,500][123090] Updated weights for policy 1, policy_version 1906137 (0.0006) [2023-12-26 14:54:55,832][123091] Updated weights for policy 0, policy_version 1918231 (0.0009) [2023-12-26 14:54:55,887][123091] Updated weights for policy 0, policy_version 1918241 (0.0010) [2023-12-26 14:54:55,945][123091] Updated weights for policy 0, policy_version 1918251 (0.0010) [2023-12-26 14:54:56,171][123090] Updated weights for policy 1, policy_version 1906147 (0.0008) [2023-12-26 14:54:56,244][123090] Updated weights for policy 1, policy_version 1906157 (0.0005) [2023-12-26 14:54:56,314][123090] Updated weights for policy 1, policy_version 1906167 (0.0009) [2023-12-26 14:54:56,798][123091] Updated weights for policy 0, policy_version 1918261 (0.0010) [2023-12-26 14:54:56,856][123091] Updated weights for policy 0, policy_version 1918271 (0.0010) [2023-12-26 14:54:56,920][123091] Updated weights for policy 0, policy_version 1918281 (0.0010) [2023-12-26 14:54:56,956][123090] Updated weights for policy 1, policy_version 1906177 (0.0010) [2023-12-26 14:54:57,014][123090] Updated weights for policy 1, policy_version 1906187 (0.0005) [2023-12-26 14:54:57,068][123090] Updated weights for policy 1, policy_version 1906197 (0.0005) [2023-12-26 14:54:57,139][123090] Updated weights for policy 1, policy_version 1906207 (0.0005) [2023-12-26 14:54:57,679][123091] Updated weights for policy 0, policy_version 1918291 (0.0008) [2023-12-26 14:54:57,734][123091] Updated weights for policy 0, policy_version 1918301 (0.0005) [2023-12-26 14:54:57,790][123091] Updated weights for policy 0, policy_version 1918311 (0.0005) [2023-12-26 14:54:57,810][123090] Updated weights for policy 1, policy_version 1906217 (0.0005) [2023-12-26 14:54:57,880][123090] Updated weights for policy 1, policy_version 1906227 (0.0005) [2023-12-26 14:54:57,929][123090] Updated weights for policy 1, policy_version 1906237 (0.0005) [2023-12-26 14:54:58,495][123091] Updated weights for policy 0, policy_version 1918321 (0.0006) [2023-12-26 14:54:58,559][123091] Updated weights for policy 0, policy_version 1918331 (0.0009) [2023-12-26 14:54:58,622][123091] Updated weights for policy 0, policy_version 1918341 (0.0008) [2023-12-26 14:54:58,634][123090] Updated weights for policy 1, policy_version 1906247 (0.0008) [2023-12-26 14:54:58,688][123091] Updated weights for policy 0, policy_version 1918351 (0.0008) [2023-12-26 14:54:58,707][123090] Updated weights for policy 1, policy_version 1906257 (0.0008) [2023-12-26 14:54:58,772][123090] Updated weights for policy 1, policy_version 1906267 (0.0010) [2023-12-26 14:54:58,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 979099648. Throughput: 0: 8906.4, 1: 8881.3. Samples: 979093140. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:54:58,785][121949] Avg episode reward: [(0, '6439.753'), (1, '5869.194')] [2023-12-26 14:54:59,542][123090] Updated weights for policy 1, policy_version 1906277 (0.0011) [2023-12-26 14:54:59,562][123091] Updated weights for policy 0, policy_version 1918361 (0.0007) [2023-12-26 14:54:59,590][123090] Updated weights for policy 1, policy_version 1906287 (0.0010) [2023-12-26 14:54:59,618][123091] Updated weights for policy 0, policy_version 1918371 (0.0006) [2023-12-26 14:54:59,653][123090] Updated weights for policy 1, policy_version 1906297 (0.0010) [2023-12-26 14:54:59,677][123091] Updated weights for policy 0, policy_version 1918381 (0.0007) [2023-12-26 14:55:00,475][123090] Updated weights for policy 1, policy_version 1906307 (0.0010) [2023-12-26 14:55:00,495][123091] Updated weights for policy 0, policy_version 1918391 (0.0007) [2023-12-26 14:55:00,528][123090] Updated weights for policy 1, policy_version 1906317 (0.0007) [2023-12-26 14:55:00,550][123091] Updated weights for policy 0, policy_version 1918401 (0.0008) [2023-12-26 14:55:00,592][123090] Updated weights for policy 1, policy_version 1906327 (0.0007) [2023-12-26 14:55:00,604][123091] Updated weights for policy 0, policy_version 1918411 (0.0008) [2023-12-26 14:55:01,392][123091] Updated weights for policy 0, policy_version 1918421 (0.0008) [2023-12-26 14:55:01,425][123090] Updated weights for policy 1, policy_version 1906337 (0.0008) [2023-12-26 14:55:01,461][123091] Updated weights for policy 0, policy_version 1918431 (0.0008) [2023-12-26 14:55:01,487][123090] Updated weights for policy 1, policy_version 1906347 (0.0006) [2023-12-26 14:55:01,524][123091] Updated weights for policy 0, policy_version 1918441 (0.0009) [2023-12-26 14:55:01,550][123090] Updated weights for policy 1, policy_version 1906357 (0.0005) [2023-12-26 14:55:01,613][123090] Updated weights for policy 1, policy_version 1906367 (0.0006) [2023-12-26 14:55:02,326][123091] Updated weights for policy 0, policy_version 1918451 (0.0009) [2023-12-26 14:55:02,396][123091] Updated weights for policy 0, policy_version 1918461 (0.0008) [2023-12-26 14:55:02,423][123090] Updated weights for policy 1, policy_version 1906377 (0.0011) [2023-12-26 14:55:02,460][123091] Updated weights for policy 0, policy_version 1918471 (0.0008) [2023-12-26 14:55:02,486][123090] Updated weights for policy 1, policy_version 1906387 (0.0010) [2023-12-26 14:55:02,545][123090] Updated weights for policy 1, policy_version 1906397 (0.0010) [2023-12-26 14:55:03,116][123091] Updated weights for policy 0, policy_version 1918481 (0.0005) [2023-12-26 14:55:03,176][123091] Updated weights for policy 0, policy_version 1918491 (0.0005) [2023-12-26 14:55:03,236][123091] Updated weights for policy 0, policy_version 1918501 (0.0005) [2023-12-26 14:55:03,295][123091] Updated weights for policy 0, policy_version 1918511 (0.0005) [2023-12-26 14:55:03,355][123090] Updated weights for policy 1, policy_version 1906407 (0.0010) [2023-12-26 14:55:03,406][123090] Updated weights for policy 1, policy_version 1906417 (0.0010) [2023-12-26 14:55:03,469][123090] Updated weights for policy 1, policy_version 1906428 (0.0010) [2023-12-26 14:55:03,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 979189760. Throughput: 0: 8968.8, 1: 8896.4. Samples: 979201028. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:03,784][121949] Avg episode reward: [(0, '6328.275'), (1, '5751.125')] [2023-12-26 14:55:03,999][123091] Updated weights for policy 0, policy_version 1918521 (0.0006) [2023-12-26 14:55:04,071][123091] Updated weights for policy 0, policy_version 1918531 (0.0005) [2023-12-26 14:55:04,136][123091] Updated weights for policy 0, policy_version 1918541 (0.0009) [2023-12-26 14:55:04,386][123090] Updated weights for policy 1, policy_version 1906438 (0.0010) [2023-12-26 14:55:04,438][123090] Updated weights for policy 1, policy_version 1906448 (0.0010) [2023-12-26 14:55:04,501][123090] Updated weights for policy 1, policy_version 1906458 (0.0010) [2023-12-26 14:55:04,926][123091] Updated weights for policy 0, policy_version 1918551 (0.0010) [2023-12-26 14:55:04,992][123091] Updated weights for policy 0, policy_version 1918561 (0.0010) [2023-12-26 14:55:05,057][123091] Updated weights for policy 0, policy_version 1918571 (0.0010) [2023-12-26 14:55:05,272][123090] Updated weights for policy 1, policy_version 1906468 (0.0010) [2023-12-26 14:55:05,330][123090] Updated weights for policy 1, policy_version 1906478 (0.0009) [2023-12-26 14:55:05,388][123090] Updated weights for policy 1, policy_version 1906488 (0.0005) [2023-12-26 14:55:05,767][123091] Updated weights for policy 0, policy_version 1918581 (0.0008) [2023-12-26 14:55:05,832][123091] Updated weights for policy 0, policy_version 1918591 (0.0010) [2023-12-26 14:55:05,902][123091] Updated weights for policy 0, policy_version 1918601 (0.0011) [2023-12-26 14:55:06,088][123090] Updated weights for policy 1, policy_version 1906498 (0.0006) [2023-12-26 14:55:06,170][123090] Updated weights for policy 1, policy_version 1906508 (0.0009) [2023-12-26 14:55:06,241][123090] Updated weights for policy 1, policy_version 1906518 (0.0006) [2023-12-26 14:55:06,313][123090] Updated weights for policy 1, policy_version 1906528 (0.0006) [2023-12-26 14:55:06,725][123091] Updated weights for policy 0, policy_version 1918611 (0.0011) [2023-12-26 14:55:06,786][123091] Updated weights for policy 0, policy_version 1918621 (0.0010) [2023-12-26 14:55:06,836][123091] Updated weights for policy 0, policy_version 1918631 (0.0009) [2023-12-26 14:55:07,099][123090] Updated weights for policy 1, policy_version 1906538 (0.0010) [2023-12-26 14:55:07,149][123090] Updated weights for policy 1, policy_version 1906548 (0.0009) [2023-12-26 14:55:07,210][123090] Updated weights for policy 1, policy_version 1906558 (0.0009) [2023-12-26 14:55:07,737][123091] Updated weights for policy 0, policy_version 1918641 (0.0009) [2023-12-26 14:55:07,791][123091] Updated weights for policy 0, policy_version 1918651 (0.0009) [2023-12-26 14:55:07,820][123090] Updated weights for policy 1, policy_version 1906568 (0.0008) [2023-12-26 14:55:07,839][123091] Updated weights for policy 0, policy_version 1918661 (0.0008) [2023-12-26 14:55:07,871][123090] Updated weights for policy 1, policy_version 1906578 (0.0010) [2023-12-26 14:55:07,886][123091] Updated weights for policy 0, policy_version 1918671 (0.0006) [2023-12-26 14:55:07,930][123090] Updated weights for policy 1, policy_version 1906588 (0.0008) [2023-12-26 14:55:08,695][123090] Updated weights for policy 1, policy_version 1906598 (0.0008) [2023-12-26 14:55:08,754][123091] Updated weights for policy 0, policy_version 1918681 (0.0006) [2023-12-26 14:55:08,757][123090] Updated weights for policy 1, policy_version 1906608 (0.0009) [2023-12-26 14:55:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 979271680. Throughput: 0: 8993.3, 1: 8944.6. Samples: 979254528. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:08,785][121949] Avg episode reward: [(0, '6127.950'), (1, '5649.422')] [2023-12-26 14:55:08,824][123090] Updated weights for policy 1, policy_version 1906618 (0.0007) [2023-12-26 14:55:08,828][123091] Updated weights for policy 0, policy_version 1918691 (0.0007) [2023-12-26 14:55:08,868][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001906624_488095744.pth... [2023-12-26 14:55:08,872][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001905536_487817216.pth [2023-12-26 14:55:08,901][123091] Updated weights for policy 0, policy_version 1918701 (0.0007) [2023-12-26 14:55:08,918][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001918704_491192320.pth... [2023-12-26 14:55:08,921][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001917648_490921984.pth [2023-12-26 14:55:09,588][123091] Updated weights for policy 0, policy_version 1918711 (0.0006) [2023-12-26 14:55:09,655][123091] Updated weights for policy 0, policy_version 1918721 (0.0006) [2023-12-26 14:55:09,701][123090] Updated weights for policy 1, policy_version 1906628 (0.0008) [2023-12-26 14:55:09,719][123091] Updated weights for policy 0, policy_version 1918731 (0.0008) [2023-12-26 14:55:09,761][123090] Updated weights for policy 1, policy_version 1906638 (0.0008) [2023-12-26 14:55:09,827][123090] Updated weights for policy 1, policy_version 1906648 (0.0008) [2023-12-26 14:55:10,401][123091] Updated weights for policy 0, policy_version 1918741 (0.0011) [2023-12-26 14:55:10,468][123091] Updated weights for policy 0, policy_version 1918751 (0.0011) [2023-12-26 14:55:10,533][123091] Updated weights for policy 0, policy_version 1918761 (0.0009) [2023-12-26 14:55:10,613][123090] Updated weights for policy 1, policy_version 1906658 (0.0007) [2023-12-26 14:55:10,679][123090] Updated weights for policy 1, policy_version 1906668 (0.0005) [2023-12-26 14:55:10,744][123090] Updated weights for policy 1, policy_version 1906678 (0.0005) [2023-12-26 14:55:10,795][123090] Updated weights for policy 1, policy_version 1906688 (0.0009) [2023-12-26 14:55:11,261][123091] Updated weights for policy 0, policy_version 1918771 (0.0006) [2023-12-26 14:55:11,331][123091] Updated weights for policy 0, policy_version 1918781 (0.0009) [2023-12-26 14:55:11,413][123091] Updated weights for policy 0, policy_version 1918791 (0.0009) [2023-12-26 14:55:11,699][123090] Updated weights for policy 1, policy_version 1906698 (0.0010) [2023-12-26 14:55:11,764][123090] Updated weights for policy 1, policy_version 1906708 (0.0010) [2023-12-26 14:55:11,828][123090] Updated weights for policy 1, policy_version 1906718 (0.0011) [2023-12-26 14:55:12,154][123091] Updated weights for policy 0, policy_version 1918801 (0.0007) [2023-12-26 14:55:12,211][123091] Updated weights for policy 0, policy_version 1918811 (0.0006) [2023-12-26 14:55:12,276][123091] Updated weights for policy 0, policy_version 1918821 (0.0008) [2023-12-26 14:55:12,343][123091] Updated weights for policy 0, policy_version 1918831 (0.0010) [2023-12-26 14:55:12,582][123090] Updated weights for policy 1, policy_version 1906728 (0.0008) [2023-12-26 14:55:12,641][123090] Updated weights for policy 1, policy_version 1906738 (0.0010) [2023-12-26 14:55:12,694][123090] Updated weights for policy 1, policy_version 1906748 (0.0007) [2023-12-26 14:55:13,117][123091] Updated weights for policy 0, policy_version 1918841 (0.0006) [2023-12-26 14:55:13,195][123091] Updated weights for policy 0, policy_version 1918851 (0.0006) [2023-12-26 14:55:13,271][123091] Updated weights for policy 0, policy_version 1918861 (0.0005) [2023-12-26 14:55:13,393][123090] Updated weights for policy 1, policy_version 1906758 (0.0006) [2023-12-26 14:55:13,441][123090] Updated weights for policy 1, policy_version 1906768 (0.0005) [2023-12-26 14:55:13,518][123090] Updated weights for policy 1, policy_version 1906778 (0.0007) [2023-12-26 14:55:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 979369984. Throughput: 0: 8978.7, 1: 9001.2. Samples: 979360896. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:13,785][121949] Avg episode reward: [(0, '6120.973'), (1, '5638.757')] [2023-12-26 14:55:13,830][123091] Updated weights for policy 0, policy_version 1918871 (0.0006) [2023-12-26 14:55:13,900][123091] Updated weights for policy 0, policy_version 1918881 (0.0005) [2023-12-26 14:55:13,968][123091] Updated weights for policy 0, policy_version 1918891 (0.0005) [2023-12-26 14:55:14,283][123090] Updated weights for policy 1, policy_version 1906788 (0.0008) [2023-12-26 14:55:14,343][123090] Updated weights for policy 1, policy_version 1906798 (0.0007) [2023-12-26 14:55:14,415][123090] Updated weights for policy 1, policy_version 1906808 (0.0010) [2023-12-26 14:55:14,648][123091] Updated weights for policy 0, policy_version 1918901 (0.0008) [2023-12-26 14:55:14,693][123091] Updated weights for policy 0, policy_version 1918911 (0.0010) [2023-12-26 14:55:14,755][123091] Updated weights for policy 0, policy_version 1918921 (0.0011) [2023-12-26 14:55:15,207][123090] Updated weights for policy 1, policy_version 1906818 (0.0006) [2023-12-26 14:55:15,278][123090] Updated weights for policy 1, policy_version 1906828 (0.0005) [2023-12-26 14:55:15,346][123090] Updated weights for policy 1, policy_version 1906838 (0.0006) [2023-12-26 14:55:15,402][123090] Updated weights for policy 1, policy_version 1906848 (0.0010) [2023-12-26 14:55:15,575][123091] Updated weights for policy 0, policy_version 1918931 (0.0009) [2023-12-26 14:55:15,621][123091] Updated weights for policy 0, policy_version 1918941 (0.0005) [2023-12-26 14:55:15,670][123091] Updated weights for policy 0, policy_version 1918951 (0.0005) [2023-12-26 14:55:16,237][123090] Updated weights for policy 1, policy_version 1906858 (0.0009) [2023-12-26 14:55:16,287][123090] Updated weights for policy 1, policy_version 1906868 (0.0008) [2023-12-26 14:55:16,349][123090] Updated weights for policy 1, policy_version 1906878 (0.0010) [2023-12-26 14:55:16,453][123091] Updated weights for policy 0, policy_version 1918961 (0.0006) [2023-12-26 14:55:16,515][123091] Updated weights for policy 0, policy_version 1918971 (0.0010) [2023-12-26 14:55:16,575][123091] Updated weights for policy 0, policy_version 1918982 (0.0010) [2023-12-26 14:55:16,633][123091] Updated weights for policy 0, policy_version 1918992 (0.0010) [2023-12-26 14:55:16,920][123090] Updated weights for policy 1, policy_version 1906888 (0.0008) [2023-12-26 14:55:16,981][123090] Updated weights for policy 1, policy_version 1906898 (0.0010) [2023-12-26 14:55:17,046][123090] Updated weights for policy 1, policy_version 1906908 (0.0009) [2023-12-26 14:55:17,531][123091] Updated weights for policy 0, policy_version 1919002 (0.0009) [2023-12-26 14:55:17,591][123091] Updated weights for policy 0, policy_version 1919012 (0.0009) [2023-12-26 14:55:17,642][123091] Updated weights for policy 0, policy_version 1919022 (0.0009) [2023-12-26 14:55:17,838][123090] Updated weights for policy 1, policy_version 1906918 (0.0010) [2023-12-26 14:55:17,886][123090] Updated weights for policy 1, policy_version 1906928 (0.0009) [2023-12-26 14:55:17,935][123090] Updated weights for policy 1, policy_version 1906938 (0.0009) [2023-12-26 14:55:18,477][123091] Updated weights for policy 0, policy_version 1919032 (0.0006) [2023-12-26 14:55:18,536][123091] Updated weights for policy 0, policy_version 1919042 (0.0006) [2023-12-26 14:55:18,600][123091] Updated weights for policy 0, policy_version 1919052 (0.0009) [2023-12-26 14:55:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 979460096. Throughput: 0: 8926.4, 1: 8968.8. Samples: 979470712. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:18,784][121949] Avg episode reward: [(0, '6074.025'), (1, '5784.413')] [2023-12-26 14:55:18,796][123090] Updated weights for policy 1, policy_version 1906948 (0.0010) [2023-12-26 14:55:18,863][123090] Updated weights for policy 1, policy_version 1906958 (0.0009) [2023-12-26 14:55:18,924][123090] Updated weights for policy 1, policy_version 1906968 (0.0009) [2023-12-26 14:55:19,270][123091] Updated weights for policy 0, policy_version 1919062 (0.0007) [2023-12-26 14:55:19,344][123091] Updated weights for policy 0, policy_version 1919072 (0.0007) [2023-12-26 14:55:19,406][123091] Updated weights for policy 0, policy_version 1919082 (0.0010) [2023-12-26 14:55:19,833][123090] Updated weights for policy 1, policy_version 1906978 (0.0009) [2023-12-26 14:55:19,914][123090] Updated weights for policy 1, policy_version 1906988 (0.0009) [2023-12-26 14:55:19,984][123090] Updated weights for policy 1, policy_version 1906998 (0.0010) [2023-12-26 14:55:20,045][123090] Updated weights for policy 1, policy_version 1907008 (0.0009) [2023-12-26 14:55:20,199][123091] Updated weights for policy 0, policy_version 1919092 (0.0010) [2023-12-26 14:55:20,270][123091] Updated weights for policy 0, policy_version 1919102 (0.0009) [2023-12-26 14:55:20,340][123091] Updated weights for policy 0, policy_version 1919112 (0.0010) [2023-12-26 14:55:20,837][123090] Updated weights for policy 1, policy_version 1907018 (0.0009) [2023-12-26 14:55:20,898][123090] Updated weights for policy 1, policy_version 1907028 (0.0009) [2023-12-26 14:55:20,965][123090] Updated weights for policy 1, policy_version 1907038 (0.0009) [2023-12-26 14:55:21,207][123091] Updated weights for policy 0, policy_version 1919122 (0.0010) [2023-12-26 14:55:21,275][123091] Updated weights for policy 0, policy_version 1919132 (0.0011) [2023-12-26 14:55:21,344][123091] Updated weights for policy 0, policy_version 1919142 (0.0011) [2023-12-26 14:55:21,417][123091] Updated weights for policy 0, policy_version 1919152 (0.0010) [2023-12-26 14:55:21,836][123090] Updated weights for policy 1, policy_version 1907048 (0.0009) [2023-12-26 14:55:21,901][123090] Updated weights for policy 1, policy_version 1907058 (0.0009) [2023-12-26 14:55:21,971][123090] Updated weights for policy 1, policy_version 1907068 (0.0009) [2023-12-26 14:55:22,281][123091] Updated weights for policy 0, policy_version 1919162 (0.0011) [2023-12-26 14:55:22,329][123091] Updated weights for policy 0, policy_version 1919172 (0.0011) [2023-12-26 14:55:22,400][123091] Updated weights for policy 0, policy_version 1919182 (0.0011) [2023-12-26 14:55:22,761][123090] Updated weights for policy 1, policy_version 1907078 (0.0009) [2023-12-26 14:55:22,823][123090] Updated weights for policy 1, policy_version 1907088 (0.0009) [2023-12-26 14:55:22,891][123090] Updated weights for policy 1, policy_version 1907098 (0.0009) [2023-12-26 14:55:23,239][123091] Updated weights for policy 0, policy_version 1919192 (0.0010) [2023-12-26 14:55:23,293][123091] Updated weights for policy 0, policy_version 1919202 (0.0009) [2023-12-26 14:55:23,348][123091] Updated weights for policy 0, policy_version 1919212 (0.0010) [2023-12-26 14:55:23,687][123090] Updated weights for policy 1, policy_version 1907108 (0.0010) [2023-12-26 14:55:23,752][123090] Updated weights for policy 1, policy_version 1907118 (0.0009) [2023-12-26 14:55:23,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 979542016. Throughput: 0: 8937.8, 1: 8883.1. Samples: 979521416. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:23,785][121949] Avg episode reward: [(0, '6194.946'), (1, '5662.736')] [2023-12-26 14:55:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001919216_491323392.pth... [2023-12-26 14:55:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001918160_491053056.pth [2023-12-26 14:55:23,815][123090] Updated weights for policy 1, policy_version 1907128 (0.0009) [2023-12-26 14:55:23,862][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001907136_488226816.pth... [2023-12-26 14:55:23,866][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001906080_487956480.pth [2023-12-26 14:55:24,220][123091] Updated weights for policy 0, policy_version 1919222 (0.0010) [2023-12-26 14:55:24,270][123091] Updated weights for policy 0, policy_version 1919232 (0.0010) [2023-12-26 14:55:24,327][123091] Updated weights for policy 0, policy_version 1919243 (0.0010) [2023-12-26 14:55:24,580][123090] Updated weights for policy 1, policy_version 1907138 (0.0009) [2023-12-26 14:55:24,638][123090] Updated weights for policy 1, policy_version 1907148 (0.0009) [2023-12-26 14:55:24,700][123090] Updated weights for policy 1, policy_version 1907158 (0.0009) [2023-12-26 14:55:24,762][123090] Updated weights for policy 1, policy_version 1907168 (0.0009) [2023-12-26 14:55:25,201][123091] Updated weights for policy 0, policy_version 1919253 (0.0007) [2023-12-26 14:55:25,252][123091] Updated weights for policy 0, policy_version 1919263 (0.0005) [2023-12-26 14:55:25,312][123091] Updated weights for policy 0, policy_version 1919273 (0.0005) [2023-12-26 14:55:25,617][123090] Updated weights for policy 1, policy_version 1907179 (0.0010) [2023-12-26 14:55:25,670][123090] Updated weights for policy 1, policy_version 1907190 (0.0010) [2023-12-26 14:55:26,039][123091] Updated weights for policy 0, policy_version 1919283 (0.0007) [2023-12-26 14:55:26,099][123091] Updated weights for policy 0, policy_version 1919293 (0.0009) [2023-12-26 14:55:26,165][123091] Updated weights for policy 0, policy_version 1919303 (0.0010) [2023-12-26 14:55:26,497][123090] Updated weights for policy 1, policy_version 1907201 (0.0010) [2023-12-26 14:55:26,564][123090] Updated weights for policy 1, policy_version 1907211 (0.0010) [2023-12-26 14:55:26,624][123090] Updated weights for policy 1, policy_version 1907221 (0.0006) [2023-12-26 14:55:26,687][123090] Updated weights for policy 1, policy_version 1907231 (0.0010) [2023-12-26 14:55:26,976][123091] Updated weights for policy 0, policy_version 1919313 (0.0010) [2023-12-26 14:55:27,026][123091] Updated weights for policy 0, policy_version 1919323 (0.0010) [2023-12-26 14:55:27,085][123091] Updated weights for policy 0, policy_version 1919333 (0.0010) [2023-12-26 14:55:27,149][123091] Updated weights for policy 0, policy_version 1919343 (0.0009) [2023-12-26 14:55:27,504][123090] Updated weights for policy 1, policy_version 1907242 (0.0009) [2023-12-26 14:55:27,565][123090] Updated weights for policy 1, policy_version 1907252 (0.0005) [2023-12-26 14:55:27,641][123090] Updated weights for policy 1, policy_version 1907262 (0.0005) [2023-12-26 14:55:27,880][123091] Updated weights for policy 0, policy_version 1919353 (0.0006) [2023-12-26 14:55:27,924][123091] Updated weights for policy 0, policy_version 1919363 (0.0005) [2023-12-26 14:55:27,977][123091] Updated weights for policy 0, policy_version 1919373 (0.0005) [2023-12-26 14:55:28,303][123090] Updated weights for policy 1, policy_version 1907272 (0.0006) [2023-12-26 14:55:28,367][123090] Updated weights for policy 1, policy_version 1907282 (0.0009) [2023-12-26 14:55:28,434][123090] Updated weights for policy 1, policy_version 1907292 (0.0008) [2023-12-26 14:55:28,739][123091] Updated weights for policy 0, policy_version 1919383 (0.0009) [2023-12-26 14:55:28,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 979632128. Throughput: 0: 8916.8, 1: 8952.4. Samples: 979625932. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:28,785][121949] Avg episode reward: [(0, '6315.368'), (1, '5702.526')] [2023-12-26 14:55:28,805][123091] Updated weights for policy 0, policy_version 1919393 (0.0006) [2023-12-26 14:55:28,875][123091] Updated weights for policy 0, policy_version 1919403 (0.0006) [2023-12-26 14:55:29,171][123090] Updated weights for policy 1, policy_version 1907302 (0.0007) [2023-12-26 14:55:29,239][123090] Updated weights for policy 1, policy_version 1907312 (0.0007) [2023-12-26 14:55:29,306][123090] Updated weights for policy 1, policy_version 1907322 (0.0006) [2023-12-26 14:55:29,632][123091] Updated weights for policy 0, policy_version 1919413 (0.0007) [2023-12-26 14:55:29,681][123091] Updated weights for policy 0, policy_version 1919423 (0.0008) [2023-12-26 14:55:29,735][123091] Updated weights for policy 0, policy_version 1919433 (0.0005) [2023-12-26 14:55:30,055][123090] Updated weights for policy 1, policy_version 1907332 (0.0008) [2023-12-26 14:55:30,116][123090] Updated weights for policy 1, policy_version 1907342 (0.0008) [2023-12-26 14:55:30,178][123090] Updated weights for policy 1, policy_version 1907352 (0.0008) [2023-12-26 14:55:30,545][123091] Updated weights for policy 0, policy_version 1919443 (0.0006) [2023-12-26 14:55:30,593][123091] Updated weights for policy 0, policy_version 1919453 (0.0008) [2023-12-26 14:55:30,659][123091] Updated weights for policy 0, policy_version 1919463 (0.0009) [2023-12-26 14:55:30,982][123090] Updated weights for policy 1, policy_version 1907362 (0.0006) [2023-12-26 14:55:31,035][123090] Updated weights for policy 1, policy_version 1907372 (0.0009) [2023-12-26 14:55:31,099][123090] Updated weights for policy 1, policy_version 1907382 (0.0009) [2023-12-26 14:55:31,168][123090] Updated weights for policy 1, policy_version 1907392 (0.0008) [2023-12-26 14:55:31,389][123091] Updated weights for policy 0, policy_version 1919473 (0.0009) [2023-12-26 14:55:31,453][123091] Updated weights for policy 0, policy_version 1919483 (0.0008) [2023-12-26 14:55:31,512][123091] Updated weights for policy 0, policy_version 1919493 (0.0008) [2023-12-26 14:55:31,568][123091] Updated weights for policy 0, policy_version 1919503 (0.0008) [2023-12-26 14:55:31,936][123090] Updated weights for policy 1, policy_version 1907402 (0.0005) [2023-12-26 14:55:31,994][123090] Updated weights for policy 1, policy_version 1907412 (0.0005) [2023-12-26 14:55:32,053][123090] Updated weights for policy 1, policy_version 1907422 (0.0007) [2023-12-26 14:55:32,443][123091] Updated weights for policy 0, policy_version 1919513 (0.0009) [2023-12-26 14:55:32,498][123091] Updated weights for policy 0, policy_version 1919523 (0.0009) [2023-12-26 14:55:32,553][123091] Updated weights for policy 0, policy_version 1919533 (0.0008) [2023-12-26 14:55:32,844][123090] Updated weights for policy 1, policy_version 1907432 (0.0009) [2023-12-26 14:55:32,901][123090] Updated weights for policy 1, policy_version 1907442 (0.0009) [2023-12-26 14:55:32,967][123090] Updated weights for policy 1, policy_version 1907452 (0.0009) [2023-12-26 14:55:33,356][123091] Updated weights for policy 0, policy_version 1919543 (0.0009) [2023-12-26 14:55:33,417][123091] Updated weights for policy 0, policy_version 1919553 (0.0010) [2023-12-26 14:55:33,482][123091] Updated weights for policy 0, policy_version 1919563 (0.0010) [2023-12-26 14:55:33,780][123090] Updated weights for policy 1, policy_version 1907462 (0.0009) [2023-12-26 14:55:33,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 979722240. Throughput: 0: 8938.2, 1: 8951.7. Samples: 979735744. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:33,785][121949] Avg episode reward: [(0, '6269.445'), (1, '5810.572')] [2023-12-26 14:55:33,831][123090] Updated weights for policy 1, policy_version 1907472 (0.0010) [2023-12-26 14:55:33,881][123090] Updated weights for policy 1, policy_version 1907482 (0.0010) [2023-12-26 14:55:34,248][123091] Updated weights for policy 0, policy_version 1919573 (0.0008) [2023-12-26 14:55:34,320][123091] Updated weights for policy 0, policy_version 1919583 (0.0008) [2023-12-26 14:55:34,391][123091] Updated weights for policy 0, policy_version 1919593 (0.0009) [2023-12-26 14:55:34,606][123090] Updated weights for policy 1, policy_version 1907492 (0.0010) [2023-12-26 14:55:34,676][123090] Updated weights for policy 1, policy_version 1907502 (0.0010) [2023-12-26 14:55:34,743][123090] Updated weights for policy 1, policy_version 1907512 (0.0007) [2023-12-26 14:55:35,137][123091] Updated weights for policy 0, policy_version 1919603 (0.0009) [2023-12-26 14:55:35,208][123091] Updated weights for policy 0, policy_version 1919613 (0.0006) [2023-12-26 14:55:35,259][123091] Updated weights for policy 0, policy_version 1919623 (0.0006) [2023-12-26 14:55:35,478][123090] Updated weights for policy 1, policy_version 1907522 (0.0008) [2023-12-26 14:55:35,546][123090] Updated weights for policy 1, policy_version 1907532 (0.0005) [2023-12-26 14:55:35,605][123090] Updated weights for policy 1, policy_version 1907542 (0.0005) [2023-12-26 14:55:35,668][123090] Updated weights for policy 1, policy_version 1907552 (0.0008) [2023-12-26 14:55:36,038][123091] Updated weights for policy 0, policy_version 1919633 (0.0007) [2023-12-26 14:55:36,085][123091] Updated weights for policy 0, policy_version 1919643 (0.0008) [2023-12-26 14:55:36,147][123091] Updated weights for policy 0, policy_version 1919653 (0.0010) [2023-12-26 14:55:36,203][123091] Updated weights for policy 0, policy_version 1919663 (0.0010) [2023-12-26 14:55:36,481][123090] Updated weights for policy 1, policy_version 1907562 (0.0009) [2023-12-26 14:55:36,538][123090] Updated weights for policy 1, policy_version 1907572 (0.0009) [2023-12-26 14:55:36,604][123090] Updated weights for policy 1, policy_version 1907582 (0.0010) [2023-12-26 14:55:37,059][123091] Updated weights for policy 0, policy_version 1919673 (0.0010) [2023-12-26 14:55:37,119][123091] Updated weights for policy 0, policy_version 1919683 (0.0009) [2023-12-26 14:55:37,182][123091] Updated weights for policy 0, policy_version 1919693 (0.0008) [2023-12-26 14:55:37,444][123090] Updated weights for policy 1, policy_version 1907592 (0.0009) [2023-12-26 14:55:37,500][123090] Updated weights for policy 1, policy_version 1907602 (0.0009) [2023-12-26 14:55:37,567][123090] Updated weights for policy 1, policy_version 1907612 (0.0008) [2023-12-26 14:55:37,863][123091] Updated weights for policy 0, policy_version 1919703 (0.0006) [2023-12-26 14:55:37,930][123091] Updated weights for policy 0, policy_version 1919713 (0.0006) [2023-12-26 14:55:37,980][123091] Updated weights for policy 0, policy_version 1919723 (0.0006) [2023-12-26 14:55:38,520][123090] Updated weights for policy 1, policy_version 1907622 (0.0010) [2023-12-26 14:55:38,587][123090] Updated weights for policy 1, policy_version 1907632 (0.0010) [2023-12-26 14:55:38,649][123090] Updated weights for policy 1, policy_version 1907642 (0.0008) [2023-12-26 14:55:38,674][123091] Updated weights for policy 0, policy_version 1919733 (0.0007) [2023-12-26 14:55:38,741][123091] Updated weights for policy 0, policy_version 1919743 (0.0010) [2023-12-26 14:55:38,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 979812352. Throughput: 0: 8959.9, 1: 8980.8. Samples: 979789892. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:38,785][121949] Avg episode reward: [(0, '6269.877'), (1, '5711.346')] [2023-12-26 14:55:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001907648_488357888.pth... [2023-12-26 14:55:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001906624_488095744.pth [2023-12-26 14:55:38,810][123091] Updated weights for policy 0, policy_version 1919753 (0.0010) [2023-12-26 14:55:38,849][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001919760_491462656.pth... [2023-12-26 14:55:38,854][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001918704_491192320.pth [2023-12-26 14:55:39,526][123090] Updated weights for policy 1, policy_version 1907652 (0.0009) [2023-12-26 14:55:39,596][123090] Updated weights for policy 1, policy_version 1907662 (0.0009) [2023-12-26 14:55:39,620][123091] Updated weights for policy 0, policy_version 1919763 (0.0009) [2023-12-26 14:55:39,658][123090] Updated weights for policy 1, policy_version 1907672 (0.0009) [2023-12-26 14:55:39,670][123091] Updated weights for policy 0, policy_version 1919773 (0.0007) [2023-12-26 14:55:39,737][123091] Updated weights for policy 0, policy_version 1919783 (0.0009) [2023-12-26 14:55:40,516][123090] Updated weights for policy 1, policy_version 1907682 (0.0008) [2023-12-26 14:55:40,544][123091] Updated weights for policy 0, policy_version 1919793 (0.0009) [2023-12-26 14:55:40,583][123090] Updated weights for policy 1, policy_version 1907692 (0.0008) [2023-12-26 14:55:40,606][123091] Updated weights for policy 0, policy_version 1919803 (0.0008) [2023-12-26 14:55:40,654][123090] Updated weights for policy 1, policy_version 1907702 (0.0009) [2023-12-26 14:55:40,668][123091] Updated weights for policy 0, policy_version 1919813 (0.0006) [2023-12-26 14:55:40,717][123090] Updated weights for policy 1, policy_version 1907712 (0.0010) [2023-12-26 14:55:40,734][123091] Updated weights for policy 0, policy_version 1919823 (0.0009) [2023-12-26 14:55:41,489][123090] Updated weights for policy 1, policy_version 1907722 (0.0008) [2023-12-26 14:55:41,540][123091] Updated weights for policy 0, policy_version 1919833 (0.0008) [2023-12-26 14:55:41,549][123090] Updated weights for policy 1, policy_version 1907732 (0.0008) [2023-12-26 14:55:41,601][123091] Updated weights for policy 0, policy_version 1919843 (0.0011) [2023-12-26 14:55:41,616][123090] Updated weights for policy 1, policy_version 1907742 (0.0008) [2023-12-26 14:55:41,670][123091] Updated weights for policy 0, policy_version 1919853 (0.0008) [2023-12-26 14:55:42,376][123090] Updated weights for policy 1, policy_version 1907752 (0.0010) [2023-12-26 14:55:42,449][123090] Updated weights for policy 1, policy_version 1907762 (0.0007) [2023-12-26 14:55:42,526][123090] Updated weights for policy 1, policy_version 1907772 (0.0005) [2023-12-26 14:55:42,549][123091] Updated weights for policy 0, policy_version 1919863 (0.0009) [2023-12-26 14:55:42,625][123091] Updated weights for policy 0, policy_version 1919873 (0.0011) [2023-12-26 14:55:42,689][123091] Updated weights for policy 0, policy_version 1919883 (0.0010) [2023-12-26 14:55:43,281][123090] Updated weights for policy 1, policy_version 1907782 (0.0008) [2023-12-26 14:55:43,329][123090] Updated weights for policy 1, policy_version 1907792 (0.0009) [2023-12-26 14:55:43,379][123090] Updated weights for policy 1, policy_version 1907802 (0.0009) [2023-12-26 14:55:43,462][123091] Updated weights for policy 0, policy_version 1919893 (0.0008) [2023-12-26 14:55:43,519][123091] Updated weights for policy 0, policy_version 1919903 (0.0010) [2023-12-26 14:55:43,566][123091] Updated weights for policy 0, policy_version 1919913 (0.0009) [2023-12-26 14:55:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.5, 300 sec: 17744.7). Total num frames: 979902464. Throughput: 0: 8957.0, 1: 8818.9. Samples: 979893056. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:43,785][121949] Avg episode reward: [(0, '6187.138'), (1, '5587.499')] [2023-12-26 14:55:44,229][123090] Updated weights for policy 1, policy_version 1907812 (0.0010) [2023-12-26 14:55:44,293][123090] Updated weights for policy 1, policy_version 1907822 (0.0009) [2023-12-26 14:55:44,350][123090] Updated weights for policy 1, policy_version 1907832 (0.0007) [2023-12-26 14:55:44,386][123091] Updated weights for policy 0, policy_version 1919923 (0.0009) [2023-12-26 14:55:44,442][123091] Updated weights for policy 0, policy_version 1919933 (0.0009) [2023-12-26 14:55:44,496][123091] Updated weights for policy 0, policy_version 1919943 (0.0010) [2023-12-26 14:55:45,138][123090] Updated weights for policy 1, policy_version 1907842 (0.0006) [2023-12-26 14:55:45,214][123090] Updated weights for policy 1, policy_version 1907852 (0.0006) [2023-12-26 14:55:45,289][123090] Updated weights for policy 1, policy_version 1907862 (0.0009) [2023-12-26 14:55:45,346][123091] Updated weights for policy 0, policy_version 1919953 (0.0009) [2023-12-26 14:55:45,362][123090] Updated weights for policy 1, policy_version 1907872 (0.0011) [2023-12-26 14:55:45,415][123091] Updated weights for policy 0, policy_version 1919963 (0.0007) [2023-12-26 14:55:45,481][123091] Updated weights for policy 0, policy_version 1919973 (0.0009) [2023-12-26 14:55:45,531][123091] Updated weights for policy 0, policy_version 1919983 (0.0009) [2023-12-26 14:55:46,086][123090] Updated weights for policy 1, policy_version 1907882 (0.0006) [2023-12-26 14:55:46,186][123090] Updated weights for policy 1, policy_version 1907892 (0.0005) [2023-12-26 14:55:46,258][123090] Updated weights for policy 1, policy_version 1907902 (0.0005) [2023-12-26 14:55:46,306][123091] Updated weights for policy 0, policy_version 1919993 (0.0009) [2023-12-26 14:55:46,357][123091] Updated weights for policy 0, policy_version 1920004 (0.0010) [2023-12-26 14:55:46,404][123091] Updated weights for policy 0, policy_version 1920014 (0.0008) [2023-12-26 14:55:46,843][123090] Updated weights for policy 1, policy_version 1907912 (0.0005) [2023-12-26 14:55:46,897][123090] Updated weights for policy 1, policy_version 1907922 (0.0005) [2023-12-26 14:55:46,954][123090] Updated weights for policy 1, policy_version 1907932 (0.0007) [2023-12-26 14:55:47,301][123091] Updated weights for policy 0, policy_version 1920024 (0.0009) [2023-12-26 14:55:47,357][123091] Updated weights for policy 0, policy_version 1920034 (0.0009) [2023-12-26 14:55:47,415][123091] Updated weights for policy 0, policy_version 1920044 (0.0009) [2023-12-26 14:55:47,756][123090] Updated weights for policy 1, policy_version 1907942 (0.0009) [2023-12-26 14:55:47,813][123090] Updated weights for policy 1, policy_version 1907952 (0.0009) [2023-12-26 14:55:47,866][123090] Updated weights for policy 1, policy_version 1907962 (0.0009) [2023-12-26 14:55:48,242][123091] Updated weights for policy 0, policy_version 1920054 (0.0009) [2023-12-26 14:55:48,297][123091] Updated weights for policy 0, policy_version 1920064 (0.0009) [2023-12-26 14:55:48,361][123091] Updated weights for policy 0, policy_version 1920074 (0.0010) [2023-12-26 14:55:48,730][123090] Updated weights for policy 1, policy_version 1907972 (0.0009) [2023-12-26 14:55:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 979984384. Throughput: 0: 8883.9, 1: 8851.5. Samples: 979999120. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:48,784][121949] Avg episode reward: [(0, '6126.322'), (1, '5322.278')] [2023-12-26 14:55:48,787][123090] Updated weights for policy 1, policy_version 1907982 (0.0009) [2023-12-26 14:55:48,846][123090] Updated weights for policy 1, policy_version 1907992 (0.0010) [2023-12-26 14:55:49,128][123091] Updated weights for policy 0, policy_version 1920084 (0.0009) [2023-12-26 14:55:49,180][123091] Updated weights for policy 0, policy_version 1920094 (0.0010) [2023-12-26 14:55:49,241][123091] Updated weights for policy 0, policy_version 1920104 (0.0009) [2023-12-26 14:55:49,666][123090] Updated weights for policy 1, policy_version 1908002 (0.0008) [2023-12-26 14:55:49,715][123090] Updated weights for policy 1, policy_version 1908012 (0.0005) [2023-12-26 14:55:49,763][123090] Updated weights for policy 1, policy_version 1908022 (0.0006) [2023-12-26 14:55:49,813][123090] Updated weights for policy 1, policy_version 1908032 (0.0008) [2023-12-26 14:55:50,038][123091] Updated weights for policy 0, policy_version 1920114 (0.0008) [2023-12-26 14:55:50,100][123091] Updated weights for policy 0, policy_version 1920124 (0.0007) [2023-12-26 14:55:50,168][123091] Updated weights for policy 0, policy_version 1920134 (0.0007) [2023-12-26 14:55:50,238][123091] Updated weights for policy 0, policy_version 1920144 (0.0006) [2023-12-26 14:55:50,699][123090] Updated weights for policy 1, policy_version 1908042 (0.0009) [2023-12-26 14:55:50,769][123090] Updated weights for policy 1, policy_version 1908052 (0.0009) [2023-12-26 14:55:50,838][123090] Updated weights for policy 1, policy_version 1908062 (0.0009) [2023-12-26 14:55:50,978][123091] Updated weights for policy 0, policy_version 1920154 (0.0010) [2023-12-26 14:55:51,053][123091] Updated weights for policy 0, policy_version 1920164 (0.0010) [2023-12-26 14:55:51,118][123091] Updated weights for policy 0, policy_version 1920174 (0.0010) [2023-12-26 14:55:51,688][123090] Updated weights for policy 1, policy_version 1908072 (0.0006) [2023-12-26 14:55:51,765][123090] Updated weights for policy 1, policy_version 1908082 (0.0010) [2023-12-26 14:55:51,830][123090] Updated weights for policy 1, policy_version 1908092 (0.0010) [2023-12-26 14:55:51,944][123091] Updated weights for policy 0, policy_version 1920184 (0.0010) [2023-12-26 14:55:52,013][123091] Updated weights for policy 0, policy_version 1920194 (0.0010) [2023-12-26 14:55:52,079][123091] Updated weights for policy 0, policy_version 1920204 (0.0010) [2023-12-26 14:55:52,643][123090] Updated weights for policy 1, policy_version 1908102 (0.0009) [2023-12-26 14:55:52,714][123090] Updated weights for policy 1, policy_version 1908112 (0.0007) [2023-12-26 14:55:52,785][123090] Updated weights for policy 1, policy_version 1908122 (0.0006) [2023-12-26 14:55:52,929][123091] Updated weights for policy 0, policy_version 1920214 (0.0009) [2023-12-26 14:55:52,988][123091] Updated weights for policy 0, policy_version 1920224 (0.0010) [2023-12-26 14:55:53,049][123091] Updated weights for policy 0, policy_version 1920234 (0.0010) [2023-12-26 14:55:53,493][123090] Updated weights for policy 1, policy_version 1908132 (0.0005) [2023-12-26 14:55:53,556][123090] Updated weights for policy 1, policy_version 1908142 (0.0005) [2023-12-26 14:55:53,627][123090] Updated weights for policy 1, policy_version 1908152 (0.0005) [2023-12-26 14:55:53,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17717.0). Total num frames: 980074496. Throughput: 0: 8880.6, 1: 8818.4. Samples: 980050984. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:53,784][121949] Avg episode reward: [(0, '6076.935'), (1, '5503.417')] [2023-12-26 14:55:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001908160_488488960.pth... [2023-12-26 14:55:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001920240_491585536.pth... [2023-12-26 14:55:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001907136_488226816.pth [2023-12-26 14:55:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001919216_491323392.pth [2023-12-26 14:55:53,950][123091] Updated weights for policy 0, policy_version 1920244 (0.0010) [2023-12-26 14:55:54,007][123091] Updated weights for policy 0, policy_version 1920254 (0.0010) [2023-12-26 14:55:54,064][123091] Updated weights for policy 0, policy_version 1920264 (0.0009) [2023-12-26 14:55:54,203][123090] Updated weights for policy 1, policy_version 1908162 (0.0005) [2023-12-26 14:55:54,277][123090] Updated weights for policy 1, policy_version 1908172 (0.0005) [2023-12-26 14:55:54,346][123090] Updated weights for policy 1, policy_version 1908182 (0.0005) [2023-12-26 14:55:54,400][123090] Updated weights for policy 1, policy_version 1908192 (0.0005) [2023-12-26 14:55:54,922][123091] Updated weights for policy 0, policy_version 1920274 (0.0010) [2023-12-26 14:55:54,985][123091] Updated weights for policy 0, policy_version 1920284 (0.0007) [2023-12-26 14:55:55,050][123091] Updated weights for policy 0, policy_version 1920294 (0.0006) [2023-12-26 14:55:55,077][123090] Updated weights for policy 1, policy_version 1908202 (0.0009) [2023-12-26 14:55:55,120][123091] Updated weights for policy 0, policy_version 1920304 (0.0006) [2023-12-26 14:55:55,127][123090] Updated weights for policy 1, policy_version 1908212 (0.0009) [2023-12-26 14:55:55,176][123090] Updated weights for policy 1, policy_version 1908222 (0.0009) [2023-12-26 14:55:55,944][123090] Updated weights for policy 1, policy_version 1908232 (0.0010) [2023-12-26 14:55:55,951][123091] Updated weights for policy 0, policy_version 1920314 (0.0008) [2023-12-26 14:55:55,999][123090] Updated weights for policy 1, policy_version 1908242 (0.0007) [2023-12-26 14:55:56,005][123091] Updated weights for policy 0, policy_version 1920324 (0.0008) [2023-12-26 14:55:56,054][123091] Updated weights for policy 0, policy_version 1920334 (0.0009) [2023-12-26 14:55:56,058][123090] Updated weights for policy 1, policy_version 1908252 (0.0005) [2023-12-26 14:55:56,748][123090] Updated weights for policy 1, policy_version 1908262 (0.0008) [2023-12-26 14:55:56,815][123090] Updated weights for policy 1, policy_version 1908272 (0.0010) [2023-12-26 14:55:56,884][123090] Updated weights for policy 1, policy_version 1908282 (0.0009) [2023-12-26 14:55:56,931][123091] Updated weights for policy 0, policy_version 1920344 (0.0008) [2023-12-26 14:55:56,989][123091] Updated weights for policy 0, policy_version 1920354 (0.0009) [2023-12-26 14:55:57,043][123091] Updated weights for policy 0, policy_version 1920364 (0.0007) [2023-12-26 14:55:57,670][123090] Updated weights for policy 1, policy_version 1908292 (0.0007) [2023-12-26 14:55:57,723][123090] Updated weights for policy 1, policy_version 1908302 (0.0005) [2023-12-26 14:55:57,775][123090] Updated weights for policy 1, policy_version 1908312 (0.0007) [2023-12-26 14:55:57,867][123091] Updated weights for policy 0, policy_version 1920374 (0.0009) [2023-12-26 14:55:57,926][123091] Updated weights for policy 0, policy_version 1920384 (0.0009) [2023-12-26 14:55:57,988][123091] Updated weights for policy 0, policy_version 1920394 (0.0008) [2023-12-26 14:55:58,588][123090] Updated weights for policy 1, policy_version 1908322 (0.0008) [2023-12-26 14:55:58,648][123090] Updated weights for policy 1, policy_version 1908332 (0.0008) [2023-12-26 14:55:58,712][123090] Updated weights for policy 1, policy_version 1908342 (0.0008) [2023-12-26 14:55:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 980164608. Throughput: 0: 8810.9, 1: 8907.2. Samples: 980158208. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:55:58,784][121949] Avg episode reward: [(0, '6071.025'), (1, '5645.998')] [2023-12-26 14:55:58,787][123090] Updated weights for policy 1, policy_version 1908352 (0.0008) [2023-12-26 14:55:58,950][123091] Updated weights for policy 0, policy_version 1920404 (0.0009) [2023-12-26 14:55:59,013][123091] Updated weights for policy 0, policy_version 1920414 (0.0010) [2023-12-26 14:55:59,066][123091] Updated weights for policy 0, policy_version 1920424 (0.0009) [2023-12-26 14:55:59,618][123090] Updated weights for policy 1, policy_version 1908362 (0.0010) [2023-12-26 14:55:59,684][123090] Updated weights for policy 1, policy_version 1908372 (0.0009) [2023-12-26 14:55:59,740][123090] Updated weights for policy 1, policy_version 1908382 (0.0009) [2023-12-26 14:55:59,770][123091] Updated weights for policy 0, policy_version 1920434 (0.0009) [2023-12-26 14:55:59,823][123091] Updated weights for policy 0, policy_version 1920444 (0.0007) [2023-12-26 14:55:59,882][123091] Updated weights for policy 0, policy_version 1920454 (0.0006) [2023-12-26 14:55:59,948][123091] Updated weights for policy 0, policy_version 1920464 (0.0006) [2023-12-26 14:56:00,551][123090] Updated weights for policy 1, policy_version 1908392 (0.0008) [2023-12-26 14:56:00,608][123090] Updated weights for policy 1, policy_version 1908402 (0.0005) [2023-12-26 14:56:00,661][123090] Updated weights for policy 1, policy_version 1908412 (0.0005) [2023-12-26 14:56:00,703][123091] Updated weights for policy 0, policy_version 1920474 (0.0008) [2023-12-26 14:56:00,758][123091] Updated weights for policy 0, policy_version 1920484 (0.0009) [2023-12-26 14:56:00,810][123091] Updated weights for policy 0, policy_version 1920494 (0.0009) [2023-12-26 14:56:01,467][123090] Updated weights for policy 1, policy_version 1908422 (0.0008) [2023-12-26 14:56:01,523][123090] Updated weights for policy 1, policy_version 1908432 (0.0009) [2023-12-26 14:56:01,591][123090] Updated weights for policy 1, policy_version 1908442 (0.0009) [2023-12-26 14:56:01,660][123091] Updated weights for policy 0, policy_version 1920504 (0.0009) [2023-12-26 14:56:01,718][123091] Updated weights for policy 0, policy_version 1920514 (0.0010) [2023-12-26 14:56:01,786][123091] Updated weights for policy 0, policy_version 1920524 (0.0010) [2023-12-26 14:56:02,351][123090] Updated weights for policy 1, policy_version 1908452 (0.0008) [2023-12-26 14:56:02,425][123090] Updated weights for policy 1, policy_version 1908462 (0.0007) [2023-12-26 14:56:02,495][123090] Updated weights for policy 1, policy_version 1908472 (0.0006) [2023-12-26 14:56:02,700][123091] Updated weights for policy 0, policy_version 1920534 (0.0009) [2023-12-26 14:56:02,765][123091] Updated weights for policy 0, policy_version 1920544 (0.0010) [2023-12-26 14:56:02,839][123091] Updated weights for policy 0, policy_version 1920554 (0.0008) [2023-12-26 14:56:03,167][123090] Updated weights for policy 1, policy_version 1908482 (0.0009) [2023-12-26 14:56:03,218][123090] Updated weights for policy 1, policy_version 1908492 (0.0005) [2023-12-26 14:56:03,265][123090] Updated weights for policy 1, policy_version 1908502 (0.0006) [2023-12-26 14:56:03,313][123090] Updated weights for policy 1, policy_version 1908512 (0.0005) [2023-12-26 14:56:03,604][123091] Updated weights for policy 0, policy_version 1920564 (0.0007) [2023-12-26 14:56:03,656][123091] Updated weights for policy 0, policy_version 1920574 (0.0005) [2023-12-26 14:56:03,709][123091] Updated weights for policy 0, policy_version 1920584 (0.0005) [2023-12-26 14:56:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 980254720. Throughput: 0: 8725.0, 1: 8899.7. Samples: 980263820. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:03,785][121949] Avg episode reward: [(0, '6273.883'), (1, '5427.799')] [2023-12-26 14:56:04,089][123090] Updated weights for policy 1, policy_version 1908522 (0.0011) [2023-12-26 14:56:04,150][123090] Updated weights for policy 1, policy_version 1908532 (0.0011) [2023-12-26 14:56:04,214][123090] Updated weights for policy 1, policy_version 1908542 (0.0011) [2023-12-26 14:56:04,413][123091] Updated weights for policy 0, policy_version 1920594 (0.0006) [2023-12-26 14:56:04,470][123091] Updated weights for policy 0, policy_version 1920604 (0.0011) [2023-12-26 14:56:04,522][123091] Updated weights for policy 0, policy_version 1920614 (0.0010) [2023-12-26 14:56:04,574][123091] Updated weights for policy 0, policy_version 1920624 (0.0010) [2023-12-26 14:56:04,960][123090] Updated weights for policy 1, policy_version 1908552 (0.0006) [2023-12-26 14:56:05,022][123090] Updated weights for policy 1, policy_version 1908562 (0.0006) [2023-12-26 14:56:05,069][123090] Updated weights for policy 1, policy_version 1908572 (0.0010) [2023-12-26 14:56:05,346][123091] Updated weights for policy 0, policy_version 1920634 (0.0010) [2023-12-26 14:56:05,393][123091] Updated weights for policy 0, policy_version 1920644 (0.0010) [2023-12-26 14:56:05,447][123091] Updated weights for policy 0, policy_version 1920654 (0.0010) [2023-12-26 14:56:05,862][123090] Updated weights for policy 1, policy_version 1908582 (0.0010) [2023-12-26 14:56:05,922][123090] Updated weights for policy 1, policy_version 1908592 (0.0006) [2023-12-26 14:56:05,992][123090] Updated weights for policy 1, policy_version 1908602 (0.0009) [2023-12-26 14:56:06,235][123091] Updated weights for policy 0, policy_version 1920664 (0.0009) [2023-12-26 14:56:06,305][123091] Updated weights for policy 0, policy_version 1920674 (0.0009) [2023-12-26 14:56:06,365][123091] Updated weights for policy 0, policy_version 1920684 (0.0010) [2023-12-26 14:56:06,724][123090] Updated weights for policy 1, policy_version 1908612 (0.0007) [2023-12-26 14:56:06,795][123090] Updated weights for policy 1, policy_version 1908622 (0.0009) [2023-12-26 14:56:06,862][123090] Updated weights for policy 1, policy_version 1908632 (0.0008) [2023-12-26 14:56:07,204][123091] Updated weights for policy 0, policy_version 1920694 (0.0009) [2023-12-26 14:56:07,262][123091] Updated weights for policy 0, policy_version 1920704 (0.0009) [2023-12-26 14:56:07,320][123091] Updated weights for policy 0, policy_version 1920715 (0.0012) [2023-12-26 14:56:07,693][123090] Updated weights for policy 1, policy_version 1908642 (0.0009) [2023-12-26 14:56:07,746][123090] Updated weights for policy 1, policy_version 1908652 (0.0010) [2023-12-26 14:56:07,801][123090] Updated weights for policy 1, policy_version 1908662 (0.0009) [2023-12-26 14:56:07,856][123090] Updated weights for policy 1, policy_version 1908672 (0.0008) [2023-12-26 14:56:08,158][123091] Updated weights for policy 0, policy_version 1920725 (0.0009) [2023-12-26 14:56:08,207][123091] Updated weights for policy 0, policy_version 1920735 (0.0010) [2023-12-26 14:56:08,262][123091] Updated weights for policy 0, policy_version 1920745 (0.0010) [2023-12-26 14:56:08,718][123090] Updated weights for policy 1, policy_version 1908682 (0.0006) [2023-12-26 14:56:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 980336640. Throughput: 0: 8752.3, 1: 8963.9. Samples: 980318644. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:08,785][121949] Avg episode reward: [(0, '6329.740'), (1, '5551.457')] [2023-12-26 14:56:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001920752_491716608.pth... [2023-12-26 14:56:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001919760_491462656.pth [2023-12-26 14:56:08,795][123090] Updated weights for policy 1, policy_version 1908692 (0.0006) [2023-12-26 14:56:08,873][123090] Updated weights for policy 1, policy_version 1908702 (0.0005) [2023-12-26 14:56:08,889][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001908704_488628224.pth... [2023-12-26 14:56:08,894][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001907648_488357888.pth [2023-12-26 14:56:09,094][123091] Updated weights for policy 0, policy_version 1920755 (0.0009) [2023-12-26 14:56:09,147][123091] Updated weights for policy 0, policy_version 1920765 (0.0010) [2023-12-26 14:56:09,203][123091] Updated weights for policy 0, policy_version 1920775 (0.0008) [2023-12-26 14:56:09,550][123090] Updated weights for policy 1, policy_version 1908712 (0.0009) [2023-12-26 14:56:09,610][123090] Updated weights for policy 1, policy_version 1908722 (0.0008) [2023-12-26 14:56:09,676][123090] Updated weights for policy 1, policy_version 1908732 (0.0009) [2023-12-26 14:56:10,154][123091] Updated weights for policy 0, policy_version 1920785 (0.0009) [2023-12-26 14:56:10,226][123091] Updated weights for policy 0, policy_version 1920795 (0.0006) [2023-12-26 14:56:10,301][123091] Updated weights for policy 0, policy_version 1920805 (0.0007) [2023-12-26 14:56:10,361][123091] Updated weights for policy 0, policy_version 1920815 (0.0009) [2023-12-26 14:56:10,532][123090] Updated weights for policy 1, policy_version 1908742 (0.0009) [2023-12-26 14:56:10,601][123090] Updated weights for policy 1, policy_version 1908752 (0.0009) [2023-12-26 14:56:10,669][123090] Updated weights for policy 1, policy_version 1908762 (0.0009) [2023-12-26 14:56:11,193][123091] Updated weights for policy 0, policy_version 1920825 (0.0010) [2023-12-26 14:56:11,251][123091] Updated weights for policy 0, policy_version 1920835 (0.0009) [2023-12-26 14:56:11,320][123091] Updated weights for policy 0, policy_version 1920845 (0.0010) [2023-12-26 14:56:11,486][123090] Updated weights for policy 1, policy_version 1908772 (0.0008) [2023-12-26 14:56:11,541][123090] Updated weights for policy 1, policy_version 1908782 (0.0009) [2023-12-26 14:56:11,611][123090] Updated weights for policy 1, policy_version 1908792 (0.0010) [2023-12-26 14:56:12,202][123091] Updated weights for policy 0, policy_version 1920855 (0.0010) [2023-12-26 14:56:12,255][123091] Updated weights for policy 0, policy_version 1920865 (0.0009) [2023-12-26 14:56:12,326][123091] Updated weights for policy 0, policy_version 1920875 (0.0010) [2023-12-26 14:56:12,511][123090] Updated weights for policy 1, policy_version 1908802 (0.0009) [2023-12-26 14:56:12,578][123090] Updated weights for policy 1, policy_version 1908812 (0.0008) [2023-12-26 14:56:12,635][123090] Updated weights for policy 1, policy_version 1908822 (0.0010) [2023-12-26 14:56:12,701][123090] Updated weights for policy 1, policy_version 1908832 (0.0008) [2023-12-26 14:56:13,140][123091] Updated weights for policy 0, policy_version 1920885 (0.0008) [2023-12-26 14:56:13,199][123091] Updated weights for policy 0, policy_version 1920895 (0.0005) [2023-12-26 14:56:13,262][123091] Updated weights for policy 0, policy_version 1920905 (0.0010) [2023-12-26 14:56:13,568][123090] Updated weights for policy 1, policy_version 1908842 (0.0010) [2023-12-26 14:56:13,625][123090] Updated weights for policy 1, policy_version 1908852 (0.0011) [2023-12-26 14:56:13,681][123090] Updated weights for policy 1, policy_version 1908862 (0.0011) [2023-12-26 14:56:13,784][121949] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 980426752. Throughput: 0: 8695.6, 1: 8936.4. Samples: 980419368. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:13,785][121949] Avg episode reward: [(0, '6172.874'), (1, '5389.795')] [2023-12-26 14:56:13,979][123091] Updated weights for policy 0, policy_version 1920915 (0.0010) [2023-12-26 14:56:14,040][123091] Updated weights for policy 0, policy_version 1920925 (0.0010) [2023-12-26 14:56:14,095][123091] Updated weights for policy 0, policy_version 1920935 (0.0010) [2023-12-26 14:56:14,407][123090] Updated weights for policy 1, policy_version 1908872 (0.0008) [2023-12-26 14:56:14,476][123090] Updated weights for policy 1, policy_version 1908882 (0.0006) [2023-12-26 14:56:14,542][123090] Updated weights for policy 1, policy_version 1908892 (0.0009) [2023-12-26 14:56:14,920][123091] Updated weights for policy 0, policy_version 1920945 (0.0011) [2023-12-26 14:56:14,975][123091] Updated weights for policy 0, policy_version 1920955 (0.0010) [2023-12-26 14:56:15,031][123091] Updated weights for policy 0, policy_version 1920965 (0.0011) [2023-12-26 14:56:15,086][123091] Updated weights for policy 0, policy_version 1920975 (0.0006) [2023-12-26 14:56:15,317][123090] Updated weights for policy 1, policy_version 1908902 (0.0008) [2023-12-26 14:56:15,379][123090] Updated weights for policy 1, policy_version 1908912 (0.0008) [2023-12-26 14:56:15,427][123090] Updated weights for policy 1, policy_version 1908922 (0.0007) [2023-12-26 14:56:15,921][123091] Updated weights for policy 0, policy_version 1920985 (0.0007) [2023-12-26 14:56:15,979][123091] Updated weights for policy 0, policy_version 1920995 (0.0011) [2023-12-26 14:56:16,031][123091] Updated weights for policy 0, policy_version 1921005 (0.0010) [2023-12-26 14:56:16,116][123090] Updated weights for policy 1, policy_version 1908932 (0.0007) [2023-12-26 14:56:16,169][123090] Updated weights for policy 1, policy_version 1908942 (0.0011) [2023-12-26 14:56:16,221][123090] Updated weights for policy 1, policy_version 1908952 (0.0010) [2023-12-26 14:56:16,883][123091] Updated weights for policy 0, policy_version 1921015 (0.0009) [2023-12-26 14:56:16,933][123091] Updated weights for policy 0, policy_version 1921025 (0.0008) [2023-12-26 14:56:16,982][123091] Updated weights for policy 0, policy_version 1921035 (0.0008) [2023-12-26 14:56:16,986][123090] Updated weights for policy 1, policy_version 1908962 (0.0011) [2023-12-26 14:56:17,053][123090] Updated weights for policy 1, policy_version 1908972 (0.0010) [2023-12-26 14:56:17,111][123090] Updated weights for policy 1, policy_version 1908982 (0.0010) [2023-12-26 14:56:17,162][123090] Updated weights for policy 1, policy_version 1908992 (0.0010) [2023-12-26 14:56:17,825][123091] Updated weights for policy 0, policy_version 1921045 (0.0009) [2023-12-26 14:56:17,896][123091] Updated weights for policy 0, policy_version 1921055 (0.0009) [2023-12-26 14:56:17,962][123091] Updated weights for policy 0, policy_version 1921065 (0.0009) [2023-12-26 14:56:17,985][123090] Updated weights for policy 1, policy_version 1909002 (0.0010) [2023-12-26 14:56:18,036][123090] Updated weights for policy 1, policy_version 1909012 (0.0010) [2023-12-26 14:56:18,099][123090] Updated weights for policy 1, policy_version 1909022 (0.0010) [2023-12-26 14:56:18,720][123091] Updated weights for policy 0, policy_version 1921075 (0.0008) [2023-12-26 14:56:18,782][123091] Updated weights for policy 0, policy_version 1921085 (0.0009) [2023-12-26 14:56:18,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 980508672. Throughput: 0: 8654.7, 1: 8912.7. Samples: 980526276. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:18,784][121949] Avg episode reward: [(0, '6113.007'), (1, '5476.759')] [2023-12-26 14:56:18,846][123091] Updated weights for policy 0, policy_version 1921095 (0.0009) [2023-12-26 14:56:18,906][123090] Updated weights for policy 1, policy_version 1909032 (0.0009) [2023-12-26 14:56:18,978][123090] Updated weights for policy 1, policy_version 1909042 (0.0010) [2023-12-26 14:56:19,037][123090] Updated weights for policy 1, policy_version 1909052 (0.0009) [2023-12-26 14:56:19,656][123091] Updated weights for policy 0, policy_version 1921105 (0.0008) [2023-12-26 14:56:19,720][123091] Updated weights for policy 0, policy_version 1921115 (0.0009) [2023-12-26 14:56:19,776][123091] Updated weights for policy 0, policy_version 1921125 (0.0009) [2023-12-26 14:56:19,848][123091] Updated weights for policy 0, policy_version 1921135 (0.0009) [2023-12-26 14:56:19,863][123090] Updated weights for policy 1, policy_version 1909062 (0.0011) [2023-12-26 14:56:19,934][123090] Updated weights for policy 1, policy_version 1909072 (0.0011) [2023-12-26 14:56:20,004][123090] Updated weights for policy 1, policy_version 1909082 (0.0006) [2023-12-26 14:56:20,595][123090] Updated weights for policy 1, policy_version 1909092 (0.0006) [2023-12-26 14:56:20,651][123090] Updated weights for policy 1, policy_version 1909102 (0.0009) [2023-12-26 14:56:20,668][123091] Updated weights for policy 0, policy_version 1921145 (0.0008) [2023-12-26 14:56:20,711][123090] Updated weights for policy 1, policy_version 1909112 (0.0011) [2023-12-26 14:56:20,735][123091] Updated weights for policy 0, policy_version 1921155 (0.0008) [2023-12-26 14:56:20,798][123091] Updated weights for policy 0, policy_version 1921165 (0.0008) [2023-12-26 14:56:21,518][123090] Updated weights for policy 1, policy_version 1909122 (0.0010) [2023-12-26 14:56:21,572][123090] Updated weights for policy 1, policy_version 1909132 (0.0006) [2023-12-26 14:56:21,641][123090] Updated weights for policy 1, policy_version 1909142 (0.0008) [2023-12-26 14:56:21,668][123091] Updated weights for policy 0, policy_version 1921175 (0.0009) [2023-12-26 14:56:21,707][123090] Updated weights for policy 1, policy_version 1909152 (0.0009) [2023-12-26 14:56:21,740][123091] Updated weights for policy 0, policy_version 1921185 (0.0008) [2023-12-26 14:56:21,810][123091] Updated weights for policy 0, policy_version 1921195 (0.0007) [2023-12-26 14:56:22,456][123090] Updated weights for policy 1, policy_version 1909162 (0.0007) [2023-12-26 14:56:22,524][123090] Updated weights for policy 1, policy_version 1909172 (0.0006) [2023-12-26 14:56:22,526][123091] Updated weights for policy 0, policy_version 1921205 (0.0008) [2023-12-26 14:56:22,580][123090] Updated weights for policy 1, policy_version 1909182 (0.0005) [2023-12-26 14:56:22,589][123091] Updated weights for policy 0, policy_version 1921215 (0.0009) [2023-12-26 14:56:22,657][123091] Updated weights for policy 0, policy_version 1921225 (0.0010) [2023-12-26 14:56:23,282][123090] Updated weights for policy 1, policy_version 1909192 (0.0006) [2023-12-26 14:56:23,355][123090] Updated weights for policy 1, policy_version 1909202 (0.0010) [2023-12-26 14:56:23,425][123090] Updated weights for policy 1, policy_version 1909212 (0.0005) [2023-12-26 14:56:23,573][123091] Updated weights for policy 0, policy_version 1921235 (0.0010) [2023-12-26 14:56:23,627][123091] Updated weights for policy 0, policy_version 1921245 (0.0010) [2023-12-26 14:56:23,685][123091] Updated weights for policy 0, policy_version 1921255 (0.0010) [2023-12-26 14:56:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 980606976. Throughput: 0: 8622.5, 1: 8911.8. Samples: 980578932. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:23,784][121949] Avg episode reward: [(0, '6204.637'), (1, '5718.803')] [2023-12-26 14:56:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001921264_491847680.pth... [2023-12-26 14:56:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001909216_488759296.pth... [2023-12-26 14:56:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001920240_491585536.pth [2023-12-26 14:56:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001908160_488488960.pth [2023-12-26 14:56:24,126][123090] Updated weights for policy 1, policy_version 1909222 (0.0008) [2023-12-26 14:56:24,199][123090] Updated weights for policy 1, policy_version 1909232 (0.0010) [2023-12-26 14:56:24,262][123090] Updated weights for policy 1, policy_version 1909242 (0.0010) [2023-12-26 14:56:24,409][123091] Updated weights for policy 0, policy_version 1921265 (0.0009) [2023-12-26 14:56:24,473][123091] Updated weights for policy 0, policy_version 1921275 (0.0009) [2023-12-26 14:56:24,535][123091] Updated weights for policy 0, policy_version 1921285 (0.0010) [2023-12-26 14:56:24,598][123091] Updated weights for policy 0, policy_version 1921295 (0.0008) [2023-12-26 14:56:25,011][123090] Updated weights for policy 1, policy_version 1909252 (0.0008) [2023-12-26 14:56:25,074][123090] Updated weights for policy 1, policy_version 1909262 (0.0010) [2023-12-26 14:56:25,139][123090] Updated weights for policy 1, policy_version 1909272 (0.0010) [2023-12-26 14:56:25,329][123091] Updated weights for policy 0, policy_version 1921305 (0.0009) [2023-12-26 14:56:25,382][123091] Updated weights for policy 0, policy_version 1921315 (0.0010) [2023-12-26 14:56:25,439][123091] Updated weights for policy 0, policy_version 1921326 (0.0008) [2023-12-26 14:56:25,814][123090] Updated weights for policy 1, policy_version 1909282 (0.0009) [2023-12-26 14:56:25,885][123090] Updated weights for policy 1, policy_version 1909292 (0.0005) [2023-12-26 14:56:25,950][123090] Updated weights for policy 1, policy_version 1909302 (0.0007) [2023-12-26 14:56:26,012][123090] Updated weights for policy 1, policy_version 1909312 (0.0010) [2023-12-26 14:56:26,346][123091] Updated weights for policy 0, policy_version 1921336 (0.0009) [2023-12-26 14:56:26,393][123091] Updated weights for policy 0, policy_version 1921346 (0.0008) [2023-12-26 14:56:26,440][123091] Updated weights for policy 0, policy_version 1921356 (0.0008) [2023-12-26 14:56:26,770][123090] Updated weights for policy 1, policy_version 1909322 (0.0010) [2023-12-26 14:56:26,827][123090] Updated weights for policy 1, policy_version 1909332 (0.0009) [2023-12-26 14:56:26,884][123090] Updated weights for policy 1, policy_version 1909342 (0.0009) [2023-12-26 14:56:27,296][123091] Updated weights for policy 0, policy_version 1921366 (0.0010) [2023-12-26 14:56:27,347][123091] Updated weights for policy 0, policy_version 1921376 (0.0009) [2023-12-26 14:56:27,399][123091] Updated weights for policy 0, policy_version 1921386 (0.0009) [2023-12-26 14:56:27,734][123090] Updated weights for policy 1, policy_version 1909352 (0.0008) [2023-12-26 14:56:27,784][123090] Updated weights for policy 1, policy_version 1909362 (0.0009) [2023-12-26 14:56:27,836][123090] Updated weights for policy 1, policy_version 1909372 (0.0009) [2023-12-26 14:56:28,183][123091] Updated weights for policy 0, policy_version 1921396 (0.0010) [2023-12-26 14:56:28,237][123091] Updated weights for policy 0, policy_version 1921406 (0.0010) [2023-12-26 14:56:28,292][123091] Updated weights for policy 0, policy_version 1921416 (0.0009) [2023-12-26 14:56:28,598][123090] Updated weights for policy 1, policy_version 1909382 (0.0009) [2023-12-26 14:56:28,668][123090] Updated weights for policy 1, policy_version 1909392 (0.0009) [2023-12-26 14:56:28,727][123090] Updated weights for policy 1, policy_version 1909402 (0.0008) [2023-12-26 14:56:28,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 980697088. Throughput: 0: 8590.7, 1: 9041.7. Samples: 980686512. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:28,784][121949] Avg episode reward: [(0, '6275.334'), (1, '5804.629')] [2023-12-26 14:56:29,222][123091] Updated weights for policy 0, policy_version 1921426 (0.0009) [2023-12-26 14:56:29,286][123091] Updated weights for policy 0, policy_version 1921436 (0.0010) [2023-12-26 14:56:29,344][123091] Updated weights for policy 0, policy_version 1921446 (0.0010) [2023-12-26 14:56:29,378][123090] Updated weights for policy 1, policy_version 1909412 (0.0008) [2023-12-26 14:56:29,413][123091] Updated weights for policy 0, policy_version 1921456 (0.0008) [2023-12-26 14:56:29,437][123090] Updated weights for policy 1, policy_version 1909422 (0.0007) [2023-12-26 14:56:29,506][123090] Updated weights for policy 1, policy_version 1909432 (0.0006) [2023-12-26 14:56:30,183][123090] Updated weights for policy 1, policy_version 1909442 (0.0005) [2023-12-26 14:56:30,249][123090] Updated weights for policy 1, policy_version 1909452 (0.0010) [2023-12-26 14:56:30,312][123090] Updated weights for policy 1, policy_version 1909462 (0.0010) [2023-12-26 14:56:30,332][123091] Updated weights for policy 0, policy_version 1921466 (0.0005) [2023-12-26 14:56:30,374][123090] Updated weights for policy 1, policy_version 1909472 (0.0010) [2023-12-26 14:56:30,388][123091] Updated weights for policy 0, policy_version 1921476 (0.0008) [2023-12-26 14:56:30,448][123091] Updated weights for policy 0, policy_version 1921486 (0.0009) [2023-12-26 14:56:31,179][123090] Updated weights for policy 1, policy_version 1909482 (0.0010) [2023-12-26 14:56:31,242][123090] Updated weights for policy 1, policy_version 1909492 (0.0006) [2023-12-26 14:56:31,257][123091] Updated weights for policy 0, policy_version 1921496 (0.0009) [2023-12-26 14:56:31,306][123090] Updated weights for policy 1, policy_version 1909502 (0.0009) [2023-12-26 14:56:31,308][123091] Updated weights for policy 0, policy_version 1921506 (0.0008) [2023-12-26 14:56:31,374][123091] Updated weights for policy 0, policy_version 1921516 (0.0007) [2023-12-26 14:56:32,051][123090] Updated weights for policy 1, policy_version 1909512 (0.0006) [2023-12-26 14:56:32,110][123090] Updated weights for policy 1, policy_version 1909522 (0.0005) [2023-12-26 14:56:32,169][123090] Updated weights for policy 1, policy_version 1909532 (0.0005) [2023-12-26 14:56:32,252][123091] Updated weights for policy 0, policy_version 1921526 (0.0010) [2023-12-26 14:56:32,314][123091] Updated weights for policy 0, policy_version 1921536 (0.0009) [2023-12-26 14:56:32,375][123091] Updated weights for policy 0, policy_version 1921546 (0.0009) [2023-12-26 14:56:32,959][123090] Updated weights for policy 1, policy_version 1909542 (0.0008) [2023-12-26 14:56:33,024][123090] Updated weights for policy 1, policy_version 1909552 (0.0010) [2023-12-26 14:56:33,071][123090] Updated weights for policy 1, policy_version 1909562 (0.0010) [2023-12-26 14:56:33,222][123091] Updated weights for policy 0, policy_version 1921556 (0.0009) [2023-12-26 14:56:33,274][123091] Updated weights for policy 0, policy_version 1921566 (0.0007) [2023-12-26 14:56:33,321][123091] Updated weights for policy 0, policy_version 1921576 (0.0008) [2023-12-26 14:56:33,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17689.2). Total num frames: 980779008. Throughput: 0: 8560.1, 1: 9084.3. Samples: 980793124. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:33,785][121949] Avg episode reward: [(0, '6321.273'), (1, '5736.897')] [2023-12-26 14:56:33,891][123090] Updated weights for policy 1, policy_version 1909572 (0.0010) [2023-12-26 14:56:33,952][123090] Updated weights for policy 1, policy_version 1909582 (0.0010) [2023-12-26 14:56:34,014][123090] Updated weights for policy 1, policy_version 1909592 (0.0008) [2023-12-26 14:56:34,179][123091] Updated weights for policy 0, policy_version 1921587 (0.0010) [2023-12-26 14:56:34,240][123091] Updated weights for policy 0, policy_version 1921597 (0.0009) [2023-12-26 14:56:34,293][123091] Updated weights for policy 0, policy_version 1921607 (0.0009) [2023-12-26 14:56:34,748][123090] Updated weights for policy 1, policy_version 1909602 (0.0006) [2023-12-26 14:56:34,813][123090] Updated weights for policy 1, policy_version 1909612 (0.0010) [2023-12-26 14:56:34,869][123090] Updated weights for policy 1, policy_version 1909622 (0.0010) [2023-12-26 14:56:34,921][123090] Updated weights for policy 1, policy_version 1909632 (0.0010) [2023-12-26 14:56:35,142][123091] Updated weights for policy 0, policy_version 1921617 (0.0008) [2023-12-26 14:56:35,195][123091] Updated weights for policy 0, policy_version 1921628 (0.0009) [2023-12-26 14:56:35,248][123091] Updated weights for policy 0, policy_version 1921639 (0.0010) [2023-12-26 14:56:35,655][123090] Updated weights for policy 1, policy_version 1909642 (0.0005) [2023-12-26 14:56:35,732][123090] Updated weights for policy 1, policy_version 1909652 (0.0005) [2023-12-26 14:56:35,801][123090] Updated weights for policy 1, policy_version 1909662 (0.0006) [2023-12-26 14:56:36,115][123091] Updated weights for policy 0, policy_version 1921649 (0.0009) [2023-12-26 14:56:36,185][123091] Updated weights for policy 0, policy_version 1921659 (0.0009) [2023-12-26 14:56:36,250][123091] Updated weights for policy 0, policy_version 1921669 (0.0009) [2023-12-26 14:56:36,317][123091] Updated weights for policy 0, policy_version 1921679 (0.0009) [2023-12-26 14:56:36,527][123090] Updated weights for policy 1, policy_version 1909672 (0.0007) [2023-12-26 14:56:36,577][123090] Updated weights for policy 1, policy_version 1909682 (0.0005) [2023-12-26 14:56:36,630][123090] Updated weights for policy 1, policy_version 1909692 (0.0006) [2023-12-26 14:56:37,188][123091] Updated weights for policy 0, policy_version 1921689 (0.0008) [2023-12-26 14:56:37,256][123091] Updated weights for policy 0, policy_version 1921699 (0.0006) [2023-12-26 14:56:37,315][123091] Updated weights for policy 0, policy_version 1921709 (0.0006) [2023-12-26 14:56:37,392][123090] Updated weights for policy 1, policy_version 1909702 (0.0006) [2023-12-26 14:56:37,440][123090] Updated weights for policy 1, policy_version 1909712 (0.0006) [2023-12-26 14:56:37,492][123090] Updated weights for policy 1, policy_version 1909722 (0.0005) [2023-12-26 14:56:38,123][123091] Updated weights for policy 0, policy_version 1921719 (0.0006) [2023-12-26 14:56:38,183][123091] Updated weights for policy 0, policy_version 1921729 (0.0006) [2023-12-26 14:56:38,241][123091] Updated weights for policy 0, policy_version 1921739 (0.0006) [2023-12-26 14:56:38,280][123090] Updated weights for policy 1, policy_version 1909732 (0.0008) [2023-12-26 14:56:38,340][123090] Updated weights for policy 1, policy_version 1909742 (0.0010) [2023-12-26 14:56:38,404][123090] Updated weights for policy 1, policy_version 1909752 (0.0010) [2023-12-26 14:56:38,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 980869120. Throughput: 0: 8527.0, 1: 9138.5. Samples: 980845932. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:38,785][121949] Avg episode reward: [(0, '6327.592'), (1, '5445.837')] [2023-12-26 14:56:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001921744_491970560.pth... [2023-12-26 14:56:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001909760_488898560.pth... [2023-12-26 14:56:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001908704_488628224.pth [2023-12-26 14:56:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001920752_491716608.pth [2023-12-26 14:56:39,033][123091] Updated weights for policy 0, policy_version 1921749 (0.0008) [2023-12-26 14:56:39,081][123091] Updated weights for policy 0, policy_version 1921759 (0.0009) [2023-12-26 14:56:39,133][123091] Updated weights for policy 0, policy_version 1921769 (0.0009) [2023-12-26 14:56:39,245][123090] Updated weights for policy 1, policy_version 1909762 (0.0011) [2023-12-26 14:56:39,305][123090] Updated weights for policy 1, policy_version 1909772 (0.0010) [2023-12-26 14:56:39,373][123090] Updated weights for policy 1, policy_version 1909782 (0.0011) [2023-12-26 14:56:39,448][123090] Updated weights for policy 1, policy_version 1909792 (0.0011) [2023-12-26 14:56:40,033][123091] Updated weights for policy 0, policy_version 1921779 (0.0009) [2023-12-26 14:56:40,099][123091] Updated weights for policy 0, policy_version 1921789 (0.0009) [2023-12-26 14:56:40,151][123091] Updated weights for policy 0, policy_version 1921799 (0.0008) [2023-12-26 14:56:40,282][123090] Updated weights for policy 1, policy_version 1909802 (0.0011) [2023-12-26 14:56:40,342][123090] Updated weights for policy 1, policy_version 1909812 (0.0011) [2023-12-26 14:56:40,409][123090] Updated weights for policy 1, policy_version 1909822 (0.0010) [2023-12-26 14:56:41,001][123091] Updated weights for policy 0, policy_version 1921809 (0.0009) [2023-12-26 14:56:41,071][123091] Updated weights for policy 0, policy_version 1921819 (0.0009) [2023-12-26 14:56:41,137][123091] Updated weights for policy 0, policy_version 1921829 (0.0009) [2023-12-26 14:56:41,208][123091] Updated weights for policy 0, policy_version 1921839 (0.0009) [2023-12-26 14:56:41,253][123090] Updated weights for policy 1, policy_version 1909832 (0.0011) [2023-12-26 14:56:41,339][123090] Updated weights for policy 1, policy_version 1909842 (0.0011) [2023-12-26 14:56:41,427][123090] Updated weights for policy 1, policy_version 1909852 (0.0010) [2023-12-26 14:56:42,072][123091] Updated weights for policy 0, policy_version 1921849 (0.0009) [2023-12-26 14:56:42,134][123091] Updated weights for policy 0, policy_version 1921859 (0.0009) [2023-12-26 14:56:42,202][123091] Updated weights for policy 0, policy_version 1921869 (0.0009) [2023-12-26 14:56:42,238][123090] Updated weights for policy 1, policy_version 1909862 (0.0011) [2023-12-26 14:56:42,304][123090] Updated weights for policy 1, policy_version 1909872 (0.0011) [2023-12-26 14:56:42,387][123090] Updated weights for policy 1, policy_version 1909882 (0.0011) [2023-12-26 14:56:43,000][123091] Updated weights for policy 0, policy_version 1921879 (0.0009) [2023-12-26 14:56:43,059][123091] Updated weights for policy 0, policy_version 1921889 (0.0008) [2023-12-26 14:56:43,117][123091] Updated weights for policy 0, policy_version 1921899 (0.0009) [2023-12-26 14:56:43,129][123090] Updated weights for policy 1, policy_version 1909892 (0.0010) [2023-12-26 14:56:43,201][123090] Updated weights for policy 1, policy_version 1909902 (0.0009) [2023-12-26 14:56:43,261][123090] Updated weights for policy 1, policy_version 1909912 (0.0009) [2023-12-26 14:56:43,769][123091] Updated weights for policy 0, policy_version 1921909 (0.0005) [2023-12-26 14:56:43,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 980951040. Throughput: 0: 8516.6, 1: 9021.2. Samples: 980947412. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:43,785][121949] Avg episode reward: [(0, '6268.037'), (1, '5420.011')] [2023-12-26 14:56:43,846][123091] Updated weights for policy 0, policy_version 1921919 (0.0007) [2023-12-26 14:56:43,897][123091] Updated weights for policy 0, policy_version 1921929 (0.0009) [2023-12-26 14:56:43,979][123090] Updated weights for policy 1, policy_version 1909922 (0.0009) [2023-12-26 14:56:44,030][123090] Updated weights for policy 1, policy_version 1909932 (0.0009) [2023-12-26 14:56:44,082][123090] Updated weights for policy 1, policy_version 1909942 (0.0009) [2023-12-26 14:56:44,150][123090] Updated weights for policy 1, policy_version 1909952 (0.0009) [2023-12-26 14:56:44,655][123091] Updated weights for policy 0, policy_version 1921939 (0.0008) [2023-12-26 14:56:44,715][123091] Updated weights for policy 0, policy_version 1921949 (0.0005) [2023-12-26 14:56:44,776][123091] Updated weights for policy 0, policy_version 1921959 (0.0006) [2023-12-26 14:56:45,044][123090] Updated weights for policy 1, policy_version 1909962 (0.0009) [2023-12-26 14:56:45,105][123090] Updated weights for policy 1, policy_version 1909972 (0.0009) [2023-12-26 14:56:45,177][123090] Updated weights for policy 1, policy_version 1909982 (0.0006) [2023-12-26 14:56:45,505][123091] Updated weights for policy 0, policy_version 1921969 (0.0008) [2023-12-26 14:56:45,565][123091] Updated weights for policy 0, policy_version 1921979 (0.0009) [2023-12-26 14:56:45,621][123091] Updated weights for policy 0, policy_version 1921989 (0.0010) [2023-12-26 14:56:45,689][123091] Updated weights for policy 0, policy_version 1921999 (0.0009) [2023-12-26 14:56:45,942][123090] Updated weights for policy 1, policy_version 1909992 (0.0006) [2023-12-26 14:56:46,009][123090] Updated weights for policy 1, policy_version 1910002 (0.0006) [2023-12-26 14:56:46,065][123090] Updated weights for policy 1, policy_version 1910012 (0.0009) [2023-12-26 14:56:46,471][123091] Updated weights for policy 0, policy_version 1922009 (0.0009) [2023-12-26 14:56:46,520][123091] Updated weights for policy 0, policy_version 1922019 (0.0009) [2023-12-26 14:56:46,587][123091] Updated weights for policy 0, policy_version 1922029 (0.0009) [2023-12-26 14:56:46,865][123090] Updated weights for policy 1, policy_version 1910022 (0.0009) [2023-12-26 14:56:46,932][123090] Updated weights for policy 1, policy_version 1910032 (0.0009) [2023-12-26 14:56:47,005][123090] Updated weights for policy 1, policy_version 1910042 (0.0009) [2023-12-26 14:56:47,287][123091] Updated weights for policy 0, policy_version 1922039 (0.0009) [2023-12-26 14:56:47,339][123091] Updated weights for policy 0, policy_version 1922049 (0.0009) [2023-12-26 14:56:47,393][123091] Updated weights for policy 0, policy_version 1922059 (0.0008) [2023-12-26 14:56:47,799][123090] Updated weights for policy 1, policy_version 1910052 (0.0008) [2023-12-26 14:56:47,871][123090] Updated weights for policy 1, policy_version 1910062 (0.0005) [2023-12-26 14:56:47,926][123090] Updated weights for policy 1, policy_version 1910072 (0.0005) [2023-12-26 14:56:48,276][123091] Updated weights for policy 0, policy_version 1922069 (0.0010) [2023-12-26 14:56:48,343][123091] Updated weights for policy 0, policy_version 1922079 (0.0010) [2023-12-26 14:56:48,409][123091] Updated weights for policy 0, policy_version 1922089 (0.0010) [2023-12-26 14:56:48,492][123090] Updated weights for policy 1, policy_version 1910082 (0.0005) [2023-12-26 14:56:48,560][123090] Updated weights for policy 1, policy_version 1910092 (0.0005) [2023-12-26 14:56:48,623][123090] Updated weights for policy 1, policy_version 1910102 (0.0006) [2023-12-26 14:56:48,681][123090] Updated weights for policy 1, policy_version 1910112 (0.0008) [2023-12-26 14:56:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 981049344. Throughput: 0: 8602.4, 1: 9012.9. Samples: 981056508. Policy #0 lag: (min: 30.0, avg: 32.6, max: 62.0) [2023-12-26 14:56:48,784][121949] Avg episode reward: [(0, '6299.766'), (1, '5517.141')] [2023-12-26 14:56:49,265][123091] Updated weights for policy 0, policy_version 1922099 (0.0009) [2023-12-26 14:56:49,328][123091] Updated weights for policy 0, policy_version 1922109 (0.0010) [2023-12-26 14:56:49,400][123091] Updated weights for policy 0, policy_version 1922119 (0.0009) [2023-12-26 14:56:49,481][123090] Updated weights for policy 1, policy_version 1910122 (0.0009) [2023-12-26 14:56:49,546][123090] Updated weights for policy 1, policy_version 1910132 (0.0009) [2023-12-26 14:56:49,613][123090] Updated weights for policy 1, policy_version 1910142 (0.0008) [2023-12-26 14:56:50,255][123091] Updated weights for policy 0, policy_version 1922129 (0.0009) [2023-12-26 14:56:50,309][123091] Updated weights for policy 0, policy_version 1922139 (0.0010) [2023-12-26 14:56:50,366][123091] Updated weights for policy 0, policy_version 1922149 (0.0010) [2023-12-26 14:56:50,377][123090] Updated weights for policy 1, policy_version 1910152 (0.0007) [2023-12-26 14:56:50,414][123091] Updated weights for policy 0, policy_version 1922159 (0.0009) [2023-12-26 14:56:50,440][123090] Updated weights for policy 1, policy_version 1910162 (0.0006) [2023-12-26 14:56:50,514][123090] Updated weights for policy 1, policy_version 1910172 (0.0006) [2023-12-26 14:56:51,236][123090] Updated weights for policy 1, policy_version 1910182 (0.0008) [2023-12-26 14:56:51,293][123091] Updated weights for policy 0, policy_version 1922169 (0.0009) [2023-12-26 14:56:51,301][123090] Updated weights for policy 1, policy_version 1910192 (0.0008) [2023-12-26 14:56:51,365][123091] Updated weights for policy 0, policy_version 1922179 (0.0008) [2023-12-26 14:56:51,370][123090] Updated weights for policy 1, policy_version 1910202 (0.0008) [2023-12-26 14:56:51,428][123091] Updated weights for policy 0, policy_version 1922189 (0.0008) [2023-12-26 14:56:52,171][123090] Updated weights for policy 1, policy_version 1910212 (0.0009) [2023-12-26 14:56:52,226][123090] Updated weights for policy 1, policy_version 1910222 (0.0008) [2023-12-26 14:56:52,280][123091] Updated weights for policy 0, policy_version 1922199 (0.0009) [2023-12-26 14:56:52,294][123090] Updated weights for policy 1, policy_version 1910232 (0.0008) [2023-12-26 14:56:52,352][123091] Updated weights for policy 0, policy_version 1922209 (0.0009) [2023-12-26 14:56:52,418][123091] Updated weights for policy 0, policy_version 1922219 (0.0009) [2023-12-26 14:56:52,984][123090] Updated weights for policy 1, policy_version 1910242 (0.0008) [2023-12-26 14:56:53,042][123090] Updated weights for policy 1, policy_version 1910252 (0.0005) [2023-12-26 14:56:53,102][123090] Updated weights for policy 1, policy_version 1910262 (0.0005) [2023-12-26 14:56:53,156][123090] Updated weights for policy 1, policy_version 1910272 (0.0005) [2023-12-26 14:56:53,243][123091] Updated weights for policy 0, policy_version 1922229 (0.0010) [2023-12-26 14:56:53,299][123091] Updated weights for policy 0, policy_version 1922239 (0.0009) [2023-12-26 14:56:53,360][123091] Updated weights for policy 0, policy_version 1922249 (0.0009) [2023-12-26 14:56:53,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 981131264. Throughput: 0: 8540.6, 1: 8990.3. Samples: 981107536. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:56:53,785][121949] Avg episode reward: [(0, '6311.665'), (1, '5468.821')] [2023-12-26 14:56:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001922256_492101632.pth... [2023-12-26 14:56:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001921264_491847680.pth [2023-12-26 14:56:53,848][123090] Updated weights for policy 1, policy_version 1910282 (0.0006) [2023-12-26 14:56:53,907][123090] Updated weights for policy 1, policy_version 1910292 (0.0009) [2023-12-26 14:56:53,959][123090] Updated weights for policy 1, policy_version 1910302 (0.0009) [2023-12-26 14:56:53,969][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001910304_489037824.pth... [2023-12-26 14:56:53,973][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001909216_488759296.pth [2023-12-26 14:56:54,235][123091] Updated weights for policy 0, policy_version 1922259 (0.0009) [2023-12-26 14:56:54,285][123091] Updated weights for policy 0, policy_version 1922269 (0.0010) [2023-12-26 14:56:54,343][123091] Updated weights for policy 0, policy_version 1922279 (0.0010) [2023-12-26 14:56:54,784][123090] Updated weights for policy 1, policy_version 1910312 (0.0009) [2023-12-26 14:56:54,852][123090] Updated weights for policy 1, policy_version 1910322 (0.0011) [2023-12-26 14:56:54,911][123090] Updated weights for policy 1, policy_version 1910332 (0.0010) [2023-12-26 14:56:55,178][123091] Updated weights for policy 0, policy_version 1922289 (0.0008) [2023-12-26 14:56:55,231][123091] Updated weights for policy 0, policy_version 1922299 (0.0009) [2023-12-26 14:56:55,289][123091] Updated weights for policy 0, policy_version 1922309 (0.0009) [2023-12-26 14:56:55,347][123091] Updated weights for policy 0, policy_version 1922319 (0.0010) [2023-12-26 14:56:55,683][123090] Updated weights for policy 1, policy_version 1910342 (0.0010) [2023-12-26 14:56:55,736][123090] Updated weights for policy 1, policy_version 1910352 (0.0009) [2023-12-26 14:56:55,788][123090] Updated weights for policy 1, policy_version 1910362 (0.0009) [2023-12-26 14:56:56,086][123091] Updated weights for policy 0, policy_version 1922329 (0.0006) [2023-12-26 14:56:56,139][123091] Updated weights for policy 0, policy_version 1922339 (0.0005) [2023-12-26 14:56:56,189][123091] Updated weights for policy 0, policy_version 1922349 (0.0005) [2023-12-26 14:56:56,524][123090] Updated weights for policy 1, policy_version 1910372 (0.0007) [2023-12-26 14:56:56,570][123090] Updated weights for policy 1, policy_version 1910382 (0.0010) [2023-12-26 14:56:56,617][123090] Updated weights for policy 1, policy_version 1910392 (0.0010) [2023-12-26 14:56:56,885][123091] Updated weights for policy 0, policy_version 1922359 (0.0005) [2023-12-26 14:56:56,951][123091] Updated weights for policy 0, policy_version 1922369 (0.0011) [2023-12-26 14:56:57,014][123091] Updated weights for policy 0, policy_version 1922379 (0.0011) [2023-12-26 14:56:57,486][123090] Updated weights for policy 1, policy_version 1910402 (0.0010) [2023-12-26 14:56:57,544][123090] Updated weights for policy 1, policy_version 1910412 (0.0010) [2023-12-26 14:56:57,593][123090] Updated weights for policy 1, policy_version 1910422 (0.0010) [2023-12-26 14:56:57,647][123090] Updated weights for policy 1, policy_version 1910432 (0.0010) [2023-12-26 14:56:57,845][123091] Updated weights for policy 0, policy_version 1922389 (0.0010) [2023-12-26 14:56:57,913][123091] Updated weights for policy 0, policy_version 1922399 (0.0010) [2023-12-26 14:56:57,969][123091] Updated weights for policy 0, policy_version 1922409 (0.0008) [2023-12-26 14:56:58,460][123090] Updated weights for policy 1, policy_version 1910442 (0.0010) [2023-12-26 14:56:58,529][123090] Updated weights for policy 1, policy_version 1910452 (0.0008) [2023-12-26 14:56:58,595][123090] Updated weights for policy 1, policy_version 1910462 (0.0008) [2023-12-26 14:56:58,724][123091] Updated weights for policy 0, policy_version 1922419 (0.0006) [2023-12-26 14:56:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 981221376. Throughput: 0: 8634.1, 1: 9076.8. Samples: 981216356. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:56:58,785][121949] Avg episode reward: [(0, '6275.243'), (1, '5433.920')] [2023-12-26 14:56:58,797][123091] Updated weights for policy 0, policy_version 1922429 (0.0008) [2023-12-26 14:56:58,869][123091] Updated weights for policy 0, policy_version 1922439 (0.0008) [2023-12-26 14:56:59,345][123090] Updated weights for policy 1, policy_version 1910472 (0.0009) [2023-12-26 14:56:59,409][123090] Updated weights for policy 1, policy_version 1910482 (0.0010) [2023-12-26 14:56:59,457][123090] Updated weights for policy 1, policy_version 1910492 (0.0009) [2023-12-26 14:56:59,631][123091] Updated weights for policy 0, policy_version 1922449 (0.0007) [2023-12-26 14:56:59,680][123091] Updated weights for policy 0, policy_version 1922459 (0.0009) [2023-12-26 14:56:59,729][123091] Updated weights for policy 0, policy_version 1922469 (0.0009) [2023-12-26 14:56:59,778][123091] Updated weights for policy 0, policy_version 1922479 (0.0009) [2023-12-26 14:57:00,331][123090] Updated weights for policy 1, policy_version 1910502 (0.0009) [2023-12-26 14:57:00,393][123090] Updated weights for policy 1, policy_version 1910512 (0.0009) [2023-12-26 14:57:00,447][123090] Updated weights for policy 1, policy_version 1910522 (0.0010) [2023-12-26 14:57:00,650][123091] Updated weights for policy 0, policy_version 1922489 (0.0009) [2023-12-26 14:57:00,701][123091] Updated weights for policy 0, policy_version 1922499 (0.0009) [2023-12-26 14:57:00,751][123091] Updated weights for policy 0, policy_version 1922509 (0.0010) [2023-12-26 14:57:01,268][123090] Updated weights for policy 1, policy_version 1910533 (0.0011) [2023-12-26 14:57:01,318][123090] Updated weights for policy 1, policy_version 1910543 (0.0007) [2023-12-26 14:57:01,386][123090] Updated weights for policy 1, policy_version 1910553 (0.0007) [2023-12-26 14:57:01,573][123091] Updated weights for policy 0, policy_version 1922519 (0.0010) [2023-12-26 14:57:01,631][123091] Updated weights for policy 0, policy_version 1922529 (0.0009) [2023-12-26 14:57:01,703][123091] Updated weights for policy 0, policy_version 1922539 (0.0009) [2023-12-26 14:57:02,169][123090] Updated weights for policy 1, policy_version 1910563 (0.0007) [2023-12-26 14:57:02,242][123090] Updated weights for policy 1, policy_version 1910573 (0.0006) [2023-12-26 14:57:02,311][123090] Updated weights for policy 1, policy_version 1910583 (0.0007) [2023-12-26 14:57:02,562][123091] Updated weights for policy 0, policy_version 1922549 (0.0010) [2023-12-26 14:57:02,624][123091] Updated weights for policy 0, policy_version 1922559 (0.0009) [2023-12-26 14:57:02,668][123091] Updated weights for policy 0, policy_version 1922569 (0.0010) [2023-12-26 14:57:03,010][123090] Updated weights for policy 1, policy_version 1910593 (0.0008) [2023-12-26 14:57:03,073][123090] Updated weights for policy 1, policy_version 1910603 (0.0005) [2023-12-26 14:57:03,138][123090] Updated weights for policy 1, policy_version 1910613 (0.0005) [2023-12-26 14:57:03,198][123090] Updated weights for policy 1, policy_version 1910623 (0.0005) [2023-12-26 14:57:03,492][123091] Updated weights for policy 0, policy_version 1922579 (0.0010) [2023-12-26 14:57:03,554][123091] Updated weights for policy 0, policy_version 1922589 (0.0010) [2023-12-26 14:57:03,611][123091] Updated weights for policy 0, policy_version 1922599 (0.0007) [2023-12-26 14:57:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 981311488. Throughput: 0: 8610.1, 1: 9097.8. Samples: 981323132. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:03,785][121949] Avg episode reward: [(0, '6282.188'), (1, '5770.232')] [2023-12-26 14:57:03,861][123090] Updated weights for policy 1, policy_version 1910633 (0.0007) [2023-12-26 14:57:03,913][123090] Updated weights for policy 1, policy_version 1910643 (0.0006) [2023-12-26 14:57:03,978][123090] Updated weights for policy 1, policy_version 1910653 (0.0008) [2023-12-26 14:57:04,360][123091] Updated weights for policy 0, policy_version 1922609 (0.0006) [2023-12-26 14:57:04,427][123091] Updated weights for policy 0, policy_version 1922619 (0.0008) [2023-12-26 14:57:04,495][123091] Updated weights for policy 0, policy_version 1922629 (0.0006) [2023-12-26 14:57:04,561][123091] Updated weights for policy 0, policy_version 1922639 (0.0006) [2023-12-26 14:57:04,665][123090] Updated weights for policy 1, policy_version 1910663 (0.0009) [2023-12-26 14:57:04,724][123090] Updated weights for policy 1, policy_version 1910673 (0.0008) [2023-12-26 14:57:04,772][123090] Updated weights for policy 1, policy_version 1910683 (0.0010) [2023-12-26 14:57:05,233][123091] Updated weights for policy 0, policy_version 1922649 (0.0010) [2023-12-26 14:57:05,288][123091] Updated weights for policy 0, policy_version 1922659 (0.0010) [2023-12-26 14:57:05,346][123091] Updated weights for policy 0, policy_version 1922669 (0.0009) [2023-12-26 14:57:05,453][123090] Updated weights for policy 1, policy_version 1910693 (0.0010) [2023-12-26 14:57:05,511][123090] Updated weights for policy 1, policy_version 1910703 (0.0010) [2023-12-26 14:57:05,566][123090] Updated weights for policy 1, policy_version 1910713 (0.0010) [2023-12-26 14:57:06,130][123091] Updated weights for policy 0, policy_version 1922679 (0.0009) [2023-12-26 14:57:06,189][123091] Updated weights for policy 0, policy_version 1922689 (0.0009) [2023-12-26 14:57:06,254][123091] Updated weights for policy 0, policy_version 1922699 (0.0009) [2023-12-26 14:57:06,405][123090] Updated weights for policy 1, policy_version 1910723 (0.0010) [2023-12-26 14:57:06,463][123090] Updated weights for policy 1, policy_version 1910733 (0.0009) [2023-12-26 14:57:06,531][123090] Updated weights for policy 1, policy_version 1910743 (0.0005) [2023-12-26 14:57:07,070][123091] Updated weights for policy 0, policy_version 1922709 (0.0010) [2023-12-26 14:57:07,125][123091] Updated weights for policy 0, policy_version 1922719 (0.0010) [2023-12-26 14:57:07,187][123091] Updated weights for policy 0, policy_version 1922729 (0.0010) [2023-12-26 14:57:07,326][123090] Updated weights for policy 1, policy_version 1910753 (0.0007) [2023-12-26 14:57:07,389][123090] Updated weights for policy 1, policy_version 1910763 (0.0006) [2023-12-26 14:57:07,443][123090] Updated weights for policy 1, policy_version 1910773 (0.0009) [2023-12-26 14:57:07,490][123090] Updated weights for policy 1, policy_version 1910783 (0.0010) [2023-12-26 14:57:07,972][123091] Updated weights for policy 0, policy_version 1922739 (0.0010) [2023-12-26 14:57:08,026][123091] Updated weights for policy 0, policy_version 1922749 (0.0006) [2023-12-26 14:57:08,090][123091] Updated weights for policy 0, policy_version 1922759 (0.0005) [2023-12-26 14:57:08,329][123090] Updated weights for policy 1, policy_version 1910793 (0.0007) [2023-12-26 14:57:08,398][123090] Updated weights for policy 1, policy_version 1910803 (0.0009) [2023-12-26 14:57:08,466][123090] Updated weights for policy 1, policy_version 1910813 (0.0010) [2023-12-26 14:57:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 981401600. Throughput: 0: 8649.3, 1: 9119.9. Samples: 981378548. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:08,785][121949] Avg episode reward: [(0, '6199.735'), (1, '5784.591')] [2023-12-26 14:57:08,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001910816_489168896.pth... [2023-12-26 14:57:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001922768_492232704.pth... [2023-12-26 14:57:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001909760_488898560.pth [2023-12-26 14:57:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001921744_491970560.pth [2023-12-26 14:57:08,903][123091] Updated weights for policy 0, policy_version 1922769 (0.0007) [2023-12-26 14:57:08,965][123091] Updated weights for policy 0, policy_version 1922779 (0.0009) [2023-12-26 14:57:09,023][123091] Updated weights for policy 0, policy_version 1922789 (0.0009) [2023-12-26 14:57:09,078][123091] Updated weights for policy 0, policy_version 1922799 (0.0010) [2023-12-26 14:57:09,172][123090] Updated weights for policy 1, policy_version 1910823 (0.0006) [2023-12-26 14:57:09,231][123090] Updated weights for policy 1, policy_version 1910833 (0.0007) [2023-12-26 14:57:09,291][123090] Updated weights for policy 1, policy_version 1910843 (0.0009) [2023-12-26 14:57:09,891][123091] Updated weights for policy 0, policy_version 1922809 (0.0009) [2023-12-26 14:57:09,958][123091] Updated weights for policy 0, policy_version 1922819 (0.0009) [2023-12-26 14:57:10,016][123091] Updated weights for policy 0, policy_version 1922829 (0.0009) [2023-12-26 14:57:10,137][123090] Updated weights for policy 1, policy_version 1910853 (0.0007) [2023-12-26 14:57:10,205][123090] Updated weights for policy 1, policy_version 1910863 (0.0009) [2023-12-26 14:57:10,273][123090] Updated weights for policy 1, policy_version 1910873 (0.0010) [2023-12-26 14:57:10,840][123091] Updated weights for policy 0, policy_version 1922839 (0.0007) [2023-12-26 14:57:10,892][123091] Updated weights for policy 0, policy_version 1922849 (0.0005) [2023-12-26 14:57:10,943][123091] Updated weights for policy 0, policy_version 1922859 (0.0005) [2023-12-26 14:57:11,088][123090] Updated weights for policy 1, policy_version 1910883 (0.0008) [2023-12-26 14:57:11,160][123090] Updated weights for policy 1, policy_version 1910893 (0.0007) [2023-12-26 14:57:11,236][123090] Updated weights for policy 1, policy_version 1910903 (0.0006) [2023-12-26 14:57:11,754][123091] Updated weights for policy 0, policy_version 1922869 (0.0008) [2023-12-26 14:57:11,819][123091] Updated weights for policy 0, policy_version 1922879 (0.0011) [2023-12-26 14:57:11,886][123091] Updated weights for policy 0, policy_version 1922889 (0.0011) [2023-12-26 14:57:12,014][123090] Updated weights for policy 1, policy_version 1910913 (0.0007) [2023-12-26 14:57:12,079][123090] Updated weights for policy 1, policy_version 1910923 (0.0009) [2023-12-26 14:57:12,144][123090] Updated weights for policy 1, policy_version 1910933 (0.0009) [2023-12-26 14:57:12,205][123090] Updated weights for policy 1, policy_version 1910943 (0.0009) [2023-12-26 14:57:12,733][123091] Updated weights for policy 0, policy_version 1922899 (0.0011) [2023-12-26 14:57:12,798][123091] Updated weights for policy 0, policy_version 1922909 (0.0011) [2023-12-26 14:57:12,866][123091] Updated weights for policy 0, policy_version 1922919 (0.0010) [2023-12-26 14:57:13,078][123090] Updated weights for policy 1, policy_version 1910953 (0.0009) [2023-12-26 14:57:13,131][123090] Updated weights for policy 1, policy_version 1910963 (0.0009) [2023-12-26 14:57:13,193][123090] Updated weights for policy 1, policy_version 1910973 (0.0009) [2023-12-26 14:57:13,659][123091] Updated weights for policy 0, policy_version 1922929 (0.0009) [2023-12-26 14:57:13,718][123091] Updated weights for policy 0, policy_version 1922939 (0.0006) [2023-12-26 14:57:13,774][123091] Updated weights for policy 0, policy_version 1922949 (0.0007) [2023-12-26 14:57:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 981483520. Throughput: 0: 8664.9, 1: 9022.5. Samples: 981482444. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:13,785][121949] Avg episode reward: [(0, '6154.408'), (1, '5566.311')] [2023-12-26 14:57:13,831][123091] Updated weights for policy 0, policy_version 1922959 (0.0009) [2023-12-26 14:57:14,002][123090] Updated weights for policy 1, policy_version 1910983 (0.0009) [2023-12-26 14:57:14,054][123090] Updated weights for policy 1, policy_version 1910993 (0.0009) [2023-12-26 14:57:14,114][123090] Updated weights for policy 1, policy_version 1911003 (0.0009) [2023-12-26 14:57:14,505][123091] Updated weights for policy 0, policy_version 1922969 (0.0007) [2023-12-26 14:57:14,565][123091] Updated weights for policy 0, policy_version 1922979 (0.0005) [2023-12-26 14:57:14,626][123091] Updated weights for policy 0, policy_version 1922989 (0.0005) [2023-12-26 14:57:14,999][123090] Updated weights for policy 1, policy_version 1911013 (0.0009) [2023-12-26 14:57:15,066][123090] Updated weights for policy 1, policy_version 1911023 (0.0010) [2023-12-26 14:57:15,128][123090] Updated weights for policy 1, policy_version 1911033 (0.0009) [2023-12-26 14:57:15,402][123091] Updated weights for policy 0, policy_version 1922999 (0.0009) [2023-12-26 14:57:15,459][123091] Updated weights for policy 0, policy_version 1923009 (0.0006) [2023-12-26 14:57:15,518][123091] Updated weights for policy 0, policy_version 1923019 (0.0006) [2023-12-26 14:57:16,006][123090] Updated weights for policy 1, policy_version 1911043 (0.0010) [2023-12-26 14:57:16,070][123090] Updated weights for policy 1, policy_version 1911053 (0.0010) [2023-12-26 14:57:16,129][123090] Updated weights for policy 1, policy_version 1911063 (0.0010) [2023-12-26 14:57:16,278][123091] Updated weights for policy 0, policy_version 1923029 (0.0005) [2023-12-26 14:57:16,332][123091] Updated weights for policy 0, policy_version 1923039 (0.0005) [2023-12-26 14:57:16,379][123091] Updated weights for policy 0, policy_version 1923049 (0.0005) [2023-12-26 14:57:16,958][123090] Updated weights for policy 1, policy_version 1911073 (0.0010) [2023-12-26 14:57:17,021][123090] Updated weights for policy 1, policy_version 1911083 (0.0011) [2023-12-26 14:57:17,092][123090] Updated weights for policy 1, policy_version 1911093 (0.0010) [2023-12-26 14:57:17,094][123091] Updated weights for policy 0, policy_version 1923059 (0.0006) [2023-12-26 14:57:17,151][123090] Updated weights for policy 1, policy_version 1911103 (0.0010) [2023-12-26 14:57:17,161][123091] Updated weights for policy 0, policy_version 1923069 (0.0010) [2023-12-26 14:57:17,229][123091] Updated weights for policy 0, policy_version 1923079 (0.0008) [2023-12-26 14:57:17,937][123090] Updated weights for policy 1, policy_version 1911113 (0.0006) [2023-12-26 14:57:17,963][123091] Updated weights for policy 0, policy_version 1923089 (0.0008) [2023-12-26 14:57:17,990][123090] Updated weights for policy 1, policy_version 1911123 (0.0005) [2023-12-26 14:57:18,014][123091] Updated weights for policy 0, policy_version 1923099 (0.0010) [2023-12-26 14:57:18,046][123090] Updated weights for policy 1, policy_version 1911133 (0.0006) [2023-12-26 14:57:18,073][123091] Updated weights for policy 0, policy_version 1923109 (0.0010) [2023-12-26 14:57:18,120][123091] Updated weights for policy 0, policy_version 1923119 (0.0010) [2023-12-26 14:57:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17689.2). Total num frames: 981573632. Throughput: 0: 8778.1, 1: 8920.8. Samples: 981589568. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:18,785][121949] Avg episode reward: [(0, '6196.840'), (1, '5258.712')] [2023-12-26 14:57:18,795][123090] Updated weights for policy 1, policy_version 1911143 (0.0008) [2023-12-26 14:57:18,853][123090] Updated weights for policy 1, policy_version 1911153 (0.0009) [2023-12-26 14:57:18,907][123090] Updated weights for policy 1, policy_version 1911163 (0.0006) [2023-12-26 14:57:18,936][123091] Updated weights for policy 0, policy_version 1923129 (0.0010) [2023-12-26 14:57:18,992][123091] Updated weights for policy 0, policy_version 1923139 (0.0010) [2023-12-26 14:57:19,057][123091] Updated weights for policy 0, policy_version 1923149 (0.0010) [2023-12-26 14:57:19,766][123090] Updated weights for policy 1, policy_version 1911173 (0.0007) [2023-12-26 14:57:19,824][123090] Updated weights for policy 1, policy_version 1911183 (0.0008) [2023-12-26 14:57:19,873][123091] Updated weights for policy 0, policy_version 1923159 (0.0009) [2023-12-26 14:57:19,894][123090] Updated weights for policy 1, policy_version 1911193 (0.0008) [2023-12-26 14:57:19,943][123091] Updated weights for policy 0, policy_version 1923169 (0.0006) [2023-12-26 14:57:20,012][123091] Updated weights for policy 0, policy_version 1923179 (0.0010) [2023-12-26 14:57:20,673][123090] Updated weights for policy 1, policy_version 1911203 (0.0009) [2023-12-26 14:57:20,743][123090] Updated weights for policy 1, policy_version 1911213 (0.0006) [2023-12-26 14:57:20,814][123090] Updated weights for policy 1, policy_version 1911223 (0.0009) [2023-12-26 14:57:20,820][123091] Updated weights for policy 0, policy_version 1923189 (0.0010) [2023-12-26 14:57:20,886][123091] Updated weights for policy 0, policy_version 1923199 (0.0007) [2023-12-26 14:57:20,954][123091] Updated weights for policy 0, policy_version 1923209 (0.0007) [2023-12-26 14:57:21,657][123090] Updated weights for policy 1, policy_version 1911233 (0.0010) [2023-12-26 14:57:21,717][123090] Updated weights for policy 1, policy_version 1911243 (0.0008) [2023-12-26 14:57:21,783][123090] Updated weights for policy 1, policy_version 1911253 (0.0008) [2023-12-26 14:57:21,790][123091] Updated weights for policy 0, policy_version 1923219 (0.0008) [2023-12-26 14:57:21,843][123090] Updated weights for policy 1, policy_version 1911263 (0.0008) [2023-12-26 14:57:21,850][123091] Updated weights for policy 0, policy_version 1923229 (0.0005) [2023-12-26 14:57:21,914][123091] Updated weights for policy 0, policy_version 1923239 (0.0006) [2023-12-26 14:57:22,709][123090] Updated weights for policy 1, policy_version 1911273 (0.0009) [2023-12-26 14:57:22,720][123091] Updated weights for policy 0, policy_version 1923249 (0.0007) [2023-12-26 14:57:22,766][123090] Updated weights for policy 1, policy_version 1911283 (0.0006) [2023-12-26 14:57:22,773][123091] Updated weights for policy 0, policy_version 1923259 (0.0010) [2023-12-26 14:57:22,824][123091] Updated weights for policy 0, policy_version 1923269 (0.0010) [2023-12-26 14:57:22,827][123090] Updated weights for policy 1, policy_version 1911293 (0.0006) [2023-12-26 14:57:22,880][123091] Updated weights for policy 0, policy_version 1923279 (0.0011) [2023-12-26 14:57:23,681][123090] Updated weights for policy 1, policy_version 1911303 (0.0005) [2023-12-26 14:57:23,721][123091] Updated weights for policy 0, policy_version 1923289 (0.0011) [2023-12-26 14:57:23,728][123090] Updated weights for policy 1, policy_version 1911313 (0.0005) [2023-12-26 14:57:23,769][123091] Updated weights for policy 0, policy_version 1923299 (0.0010) [2023-12-26 14:57:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17633.6). Total num frames: 981655552. Throughput: 0: 8801.6, 1: 8863.1. Samples: 981640844. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:23,785][123090] Updated weights for policy 1, policy_version 1911323 (0.0008) [2023-12-26 14:57:23,785][121949] Avg episode reward: [(0, '6156.996'), (1, '5186.050')] [2023-12-26 14:57:23,809][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001911328_489299968.pth... [2023-12-26 14:57:23,813][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001910304_489037824.pth [2023-12-26 14:57:23,824][123091] Updated weights for policy 0, policy_version 1923309 (0.0010) [2023-12-26 14:57:23,837][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001923312_492371968.pth... [2023-12-26 14:57:23,840][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001922256_492101632.pth [2023-12-26 14:57:24,532][123090] Updated weights for policy 1, policy_version 1911333 (0.0008) [2023-12-26 14:57:24,581][123090] Updated weights for policy 1, policy_version 1911343 (0.0005) [2023-12-26 14:57:24,637][123090] Updated weights for policy 1, policy_version 1911353 (0.0006) [2023-12-26 14:57:24,664][123091] Updated weights for policy 0, policy_version 1923319 (0.0010) [2023-12-26 14:57:24,730][123091] Updated weights for policy 0, policy_version 1923329 (0.0010) [2023-12-26 14:57:24,780][123091] Updated weights for policy 0, policy_version 1923339 (0.0010) [2023-12-26 14:57:25,448][123091] Updated weights for policy 0, policy_version 1923349 (0.0011) [2023-12-26 14:57:25,480][123090] Updated weights for policy 1, policy_version 1911363 (0.0007) [2023-12-26 14:57:25,499][123091] Updated weights for policy 0, policy_version 1923359 (0.0011) [2023-12-26 14:57:25,536][123090] Updated weights for policy 1, policy_version 1911373 (0.0005) [2023-12-26 14:57:25,555][123091] Updated weights for policy 0, policy_version 1923369 (0.0010) [2023-12-26 14:57:25,583][123090] Updated weights for policy 1, policy_version 1911383 (0.0006) [2023-12-26 14:57:26,309][123090] Updated weights for policy 1, policy_version 1911393 (0.0009) [2023-12-26 14:57:26,319][123091] Updated weights for policy 0, policy_version 1923379 (0.0009) [2023-12-26 14:57:26,368][123090] Updated weights for policy 1, policy_version 1911403 (0.0005) [2023-12-26 14:57:26,380][123091] Updated weights for policy 0, policy_version 1923389 (0.0010) [2023-12-26 14:57:26,429][123090] Updated weights for policy 1, policy_version 1911413 (0.0007) [2023-12-26 14:57:26,440][123091] Updated weights for policy 0, policy_version 1923399 (0.0011) [2023-12-26 14:57:26,494][123090] Updated weights for policy 1, policy_version 1911423 (0.0007) [2023-12-26 14:57:27,159][123091] Updated weights for policy 0, policy_version 1923409 (0.0009) [2023-12-26 14:57:27,219][123091] Updated weights for policy 0, policy_version 1923419 (0.0010) [2023-12-26 14:57:27,276][123091] Updated weights for policy 0, policy_version 1923429 (0.0008) [2023-12-26 14:57:27,295][123090] Updated weights for policy 1, policy_version 1911433 (0.0008) [2023-12-26 14:57:27,339][123091] Updated weights for policy 0, policy_version 1923439 (0.0007) [2023-12-26 14:57:27,363][123090] Updated weights for policy 1, policy_version 1911443 (0.0010) [2023-12-26 14:57:27,427][123090] Updated weights for policy 1, policy_version 1911453 (0.0011) [2023-12-26 14:57:28,073][123091] Updated weights for policy 0, policy_version 1923449 (0.0009) [2023-12-26 14:57:28,122][123091] Updated weights for policy 0, policy_version 1923459 (0.0009) [2023-12-26 14:57:28,172][123091] Updated weights for policy 0, policy_version 1923469 (0.0009) [2023-12-26 14:57:28,235][123090] Updated weights for policy 1, policy_version 1911463 (0.0009) [2023-12-26 14:57:28,291][123090] Updated weights for policy 1, policy_version 1911473 (0.0010) [2023-12-26 14:57:28,349][123090] Updated weights for policy 1, policy_version 1911483 (0.0009) [2023-12-26 14:57:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17661.4). Total num frames: 981753856. Throughput: 0: 8902.8, 1: 8887.2. Samples: 981747964. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:28,785][121949] Avg episode reward: [(0, '6316.712'), (1, '5511.106')] [2023-12-26 14:57:28,955][123091] Updated weights for policy 0, policy_version 1923479 (0.0010) [2023-12-26 14:57:29,009][123091] Updated weights for policy 0, policy_version 1923489 (0.0010) [2023-12-26 14:57:29,067][123091] Updated weights for policy 0, policy_version 1923499 (0.0010) [2023-12-26 14:57:29,202][123090] Updated weights for policy 1, policy_version 1911493 (0.0009) [2023-12-26 14:57:29,277][123090] Updated weights for policy 1, policy_version 1911503 (0.0008) [2023-12-26 14:57:29,344][123090] Updated weights for policy 1, policy_version 1911513 (0.0006) [2023-12-26 14:57:29,926][123091] Updated weights for policy 0, policy_version 1923509 (0.0011) [2023-12-26 14:57:29,989][123091] Updated weights for policy 0, policy_version 1923519 (0.0010) [2023-12-26 14:57:30,048][123091] Updated weights for policy 0, policy_version 1923529 (0.0010) [2023-12-26 14:57:30,122][123090] Updated weights for policy 1, policy_version 1911523 (0.0008) [2023-12-26 14:57:30,186][123090] Updated weights for policy 1, policy_version 1911533 (0.0009) [2023-12-26 14:57:30,235][123090] Updated weights for policy 1, policy_version 1911543 (0.0009) [2023-12-26 14:57:30,882][123091] Updated weights for policy 0, policy_version 1923539 (0.0011) [2023-12-26 14:57:30,940][123091] Updated weights for policy 0, policy_version 1923549 (0.0010) [2023-12-26 14:57:30,987][123091] Updated weights for policy 0, policy_version 1923559 (0.0010) [2023-12-26 14:57:31,071][123090] Updated weights for policy 1, policy_version 1911553 (0.0009) [2023-12-26 14:57:31,135][123090] Updated weights for policy 1, policy_version 1911563 (0.0009) [2023-12-26 14:57:31,195][123090] Updated weights for policy 1, policy_version 1911573 (0.0010) [2023-12-26 14:57:31,253][123090] Updated weights for policy 1, policy_version 1911583 (0.0009) [2023-12-26 14:57:31,780][123091] Updated weights for policy 0, policy_version 1923569 (0.0010) [2023-12-26 14:57:31,833][123091] Updated weights for policy 0, policy_version 1923579 (0.0005) [2023-12-26 14:57:31,894][123091] Updated weights for policy 0, policy_version 1923589 (0.0006) [2023-12-26 14:57:31,962][123091] Updated weights for policy 0, policy_version 1923599 (0.0009) [2023-12-26 14:57:32,161][123090] Updated weights for policy 1, policy_version 1911593 (0.0010) [2023-12-26 14:57:32,212][123090] Updated weights for policy 1, policy_version 1911603 (0.0009) [2023-12-26 14:57:32,268][123090] Updated weights for policy 1, policy_version 1911613 (0.0009) [2023-12-26 14:57:32,646][123091] Updated weights for policy 0, policy_version 1923609 (0.0005) [2023-12-26 14:57:32,694][123091] Updated weights for policy 0, policy_version 1923619 (0.0005) [2023-12-26 14:57:32,743][123091] Updated weights for policy 0, policy_version 1923629 (0.0005) [2023-12-26 14:57:33,224][123090] Updated weights for policy 1, policy_version 1911623 (0.0010) [2023-12-26 14:57:33,276][123090] Updated weights for policy 1, policy_version 1911634 (0.0009) [2023-12-26 14:57:33,324][123090] Updated weights for policy 1, policy_version 1911644 (0.0008) [2023-12-26 14:57:33,332][123091] Updated weights for policy 0, policy_version 1923639 (0.0005) [2023-12-26 14:57:33,385][123091] Updated weights for policy 0, policy_version 1923649 (0.0005) [2023-12-26 14:57:33,451][123091] Updated weights for policy 0, policy_version 1923659 (0.0006) [2023-12-26 14:57:33,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 981843968. Throughput: 0: 8927.5, 1: 8802.4. Samples: 981854356. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:33,785][121949] Avg episode reward: [(0, '6277.932'), (1, '5872.787')] [2023-12-26 14:57:34,125][123091] Updated weights for policy 0, policy_version 1923669 (0.0006) [2023-12-26 14:57:34,174][123090] Updated weights for policy 1, policy_version 1911654 (0.0008) [2023-12-26 14:57:34,195][123091] Updated weights for policy 0, policy_version 1923679 (0.0009) [2023-12-26 14:57:34,230][123090] Updated weights for policy 1, policy_version 1911664 (0.0009) [2023-12-26 14:57:34,255][123091] Updated weights for policy 0, policy_version 1923689 (0.0009) [2023-12-26 14:57:34,288][123090] Updated weights for policy 1, policy_version 1911674 (0.0009) [2023-12-26 14:57:34,964][123091] Updated weights for policy 0, policy_version 1923699 (0.0007) [2023-12-26 14:57:35,015][123091] Updated weights for policy 0, policy_version 1923709 (0.0005) [2023-12-26 14:57:35,075][123091] Updated weights for policy 0, policy_version 1923719 (0.0005) [2023-12-26 14:57:35,179][123090] Updated weights for policy 1, policy_version 1911684 (0.0009) [2023-12-26 14:57:35,236][123090] Updated weights for policy 1, policy_version 1911694 (0.0010) [2023-12-26 14:57:35,289][123090] Updated weights for policy 1, policy_version 1911704 (0.0009) [2023-12-26 14:57:35,768][123091] Updated weights for policy 0, policy_version 1923729 (0.0006) [2023-12-26 14:57:35,833][123091] Updated weights for policy 0, policy_version 1923739 (0.0009) [2023-12-26 14:57:35,894][123091] Updated weights for policy 0, policy_version 1923749 (0.0009) [2023-12-26 14:57:35,947][123091] Updated weights for policy 0, policy_version 1923759 (0.0009) [2023-12-26 14:57:36,205][123090] Updated weights for policy 1, policy_version 1911714 (0.0010) [2023-12-26 14:57:36,261][123090] Updated weights for policy 1, policy_version 1911724 (0.0010) [2023-12-26 14:57:36,317][123090] Updated weights for policy 1, policy_version 1911734 (0.0009) [2023-12-26 14:57:36,373][123090] Updated weights for policy 1, policy_version 1911744 (0.0008) [2023-12-26 14:57:36,790][123091] Updated weights for policy 0, policy_version 1923769 (0.0010) [2023-12-26 14:57:36,844][123091] Updated weights for policy 0, policy_version 1923779 (0.0010) [2023-12-26 14:57:36,909][123091] Updated weights for policy 0, policy_version 1923789 (0.0010) [2023-12-26 14:57:37,236][123090] Updated weights for policy 1, policy_version 1911754 (0.0009) [2023-12-26 14:57:37,284][123090] Updated weights for policy 1, policy_version 1911764 (0.0009) [2023-12-26 14:57:37,336][123090] Updated weights for policy 1, policy_version 1911774 (0.0008) [2023-12-26 14:57:37,731][123091] Updated weights for policy 0, policy_version 1923799 (0.0010) [2023-12-26 14:57:37,794][123091] Updated weights for policy 0, policy_version 1923809 (0.0008) [2023-12-26 14:57:37,859][123091] Updated weights for policy 0, policy_version 1923819 (0.0005) [2023-12-26 14:57:38,263][123090] Updated weights for policy 1, policy_version 1911784 (0.0010) [2023-12-26 14:57:38,322][123090] Updated weights for policy 1, policy_version 1911795 (0.0010) [2023-12-26 14:57:38,391][123090] Updated weights for policy 1, policy_version 1911805 (0.0008) [2023-12-26 14:57:38,464][123091] Updated weights for policy 0, policy_version 1923829 (0.0006) [2023-12-26 14:57:38,526][123091] Updated weights for policy 0, policy_version 1923839 (0.0006) [2023-12-26 14:57:38,593][123091] Updated weights for policy 0, policy_version 1923849 (0.0006) [2023-12-26 14:57:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 981934080. Throughput: 0: 9024.7, 1: 8759.7. Samples: 981907836. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:38,784][121949] Avg episode reward: [(0, '6207.768'), (1, '5812.178')] [2023-12-26 14:57:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001911808_489422848.pth... [2023-12-26 14:57:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001923856_492511232.pth... [2023-12-26 14:57:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001910816_489168896.pth [2023-12-26 14:57:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001922768_492232704.pth [2023-12-26 14:57:39,188][123090] Updated weights for policy 1, policy_version 1911815 (0.0009) [2023-12-26 14:57:39,255][123090] Updated weights for policy 1, policy_version 1911825 (0.0008) [2023-12-26 14:57:39,319][123090] Updated weights for policy 1, policy_version 1911835 (0.0006) [2023-12-26 14:57:39,363][123091] Updated weights for policy 0, policy_version 1923859 (0.0007) [2023-12-26 14:57:39,443][123091] Updated weights for policy 0, policy_version 1923869 (0.0008) [2023-12-26 14:57:39,511][123091] Updated weights for policy 0, policy_version 1923879 (0.0008) [2023-12-26 14:57:40,193][123090] Updated weights for policy 1, policy_version 1911845 (0.0009) [2023-12-26 14:57:40,247][123090] Updated weights for policy 1, policy_version 1911855 (0.0009) [2023-12-26 14:57:40,293][123091] Updated weights for policy 0, policy_version 1923889 (0.0008) [2023-12-26 14:57:40,298][123090] Updated weights for policy 1, policy_version 1911865 (0.0010) [2023-12-26 14:57:40,342][123091] Updated weights for policy 0, policy_version 1923899 (0.0008) [2023-12-26 14:57:40,399][123091] Updated weights for policy 0, policy_version 1923909 (0.0009) [2023-12-26 14:57:40,461][123091] Updated weights for policy 0, policy_version 1923919 (0.0010) [2023-12-26 14:57:41,188][123090] Updated weights for policy 1, policy_version 1911875 (0.0009) [2023-12-26 14:57:41,245][123090] Updated weights for policy 1, policy_version 1911885 (0.0009) [2023-12-26 14:57:41,297][123091] Updated weights for policy 0, policy_version 1923929 (0.0008) [2023-12-26 14:57:41,304][123090] Updated weights for policy 1, policy_version 1911895 (0.0009) [2023-12-26 14:57:41,362][123091] Updated weights for policy 0, policy_version 1923939 (0.0008) [2023-12-26 14:57:41,426][123091] Updated weights for policy 0, policy_version 1923949 (0.0010) [2023-12-26 14:57:42,219][123090] Updated weights for policy 1, policy_version 1911905 (0.0009) [2023-12-26 14:57:42,255][123091] Updated weights for policy 0, policy_version 1923959 (0.0010) [2023-12-26 14:57:42,286][123090] Updated weights for policy 1, policy_version 1911915 (0.0008) [2023-12-26 14:57:42,317][123091] Updated weights for policy 0, policy_version 1923969 (0.0007) [2023-12-26 14:57:42,353][123090] Updated weights for policy 1, policy_version 1911925 (0.0010) [2023-12-26 14:57:42,389][123091] Updated weights for policy 0, policy_version 1923979 (0.0008) [2023-12-26 14:57:42,424][123090] Updated weights for policy 1, policy_version 1911935 (0.0008) [2023-12-26 14:57:43,165][123091] Updated weights for policy 0, policy_version 1923989 (0.0007) [2023-12-26 14:57:43,211][123091] Updated weights for policy 0, policy_version 1923999 (0.0005) [2023-12-26 14:57:43,281][123091] Updated weights for policy 0, policy_version 1924009 (0.0007) [2023-12-26 14:57:43,311][123090] Updated weights for policy 1, policy_version 1911945 (0.0009) [2023-12-26 14:57:43,373][123090] Updated weights for policy 1, policy_version 1911955 (0.0009) [2023-12-26 14:57:43,423][123090] Updated weights for policy 1, policy_version 1911965 (0.0008) [2023-12-26 14:57:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 982016000. Throughput: 0: 8992.3, 1: 8625.0. Samples: 982009136. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:43,785][121949] Avg episode reward: [(0, '6117.436'), (1, '5859.843')] [2023-12-26 14:57:43,984][123091] Updated weights for policy 0, policy_version 1924019 (0.0007) [2023-12-26 14:57:44,045][123091] Updated weights for policy 0, policy_version 1924029 (0.0005) [2023-12-26 14:57:44,115][123091] Updated weights for policy 0, policy_version 1924039 (0.0005) [2023-12-26 14:57:44,356][123090] Updated weights for policy 1, policy_version 1911975 (0.0010) [2023-12-26 14:57:44,424][123090] Updated weights for policy 1, policy_version 1911985 (0.0010) [2023-12-26 14:57:44,487][123090] Updated weights for policy 1, policy_version 1911995 (0.0010) [2023-12-26 14:57:44,771][123091] Updated weights for policy 0, policy_version 1924049 (0.0006) [2023-12-26 14:57:44,842][123091] Updated weights for policy 0, policy_version 1924059 (0.0011) [2023-12-26 14:57:44,898][123091] Updated weights for policy 0, policy_version 1924069 (0.0011) [2023-12-26 14:57:44,959][123091] Updated weights for policy 0, policy_version 1924079 (0.0011) [2023-12-26 14:57:45,376][123090] Updated weights for policy 1, policy_version 1912005 (0.0010) [2023-12-26 14:57:45,442][123090] Updated weights for policy 1, policy_version 1912015 (0.0006) [2023-12-26 14:57:45,501][123090] Updated weights for policy 1, policy_version 1912025 (0.0006) [2023-12-26 14:57:45,733][123091] Updated weights for policy 0, policy_version 1924089 (0.0006) [2023-12-26 14:57:45,794][123091] Updated weights for policy 0, policy_version 1924099 (0.0006) [2023-12-26 14:57:45,846][123091] Updated weights for policy 0, policy_version 1924109 (0.0005) [2023-12-26 14:57:46,346][123090] Updated weights for policy 1, policy_version 1912035 (0.0006) [2023-12-26 14:57:46,407][123090] Updated weights for policy 1, policy_version 1912045 (0.0009) [2023-12-26 14:57:46,468][123090] Updated weights for policy 1, policy_version 1912055 (0.0009) [2023-12-26 14:57:46,475][123091] Updated weights for policy 0, policy_version 1924119 (0.0008) [2023-12-26 14:57:46,533][123091] Updated weights for policy 0, policy_version 1924129 (0.0009) [2023-12-26 14:57:46,596][123091] Updated weights for policy 0, policy_version 1924139 (0.0010) [2023-12-26 14:57:47,341][123090] Updated weights for policy 1, policy_version 1912065 (0.0008) [2023-12-26 14:57:47,368][123091] Updated weights for policy 0, policy_version 1924149 (0.0009) [2023-12-26 14:57:47,397][123090] Updated weights for policy 1, policy_version 1912075 (0.0008) [2023-12-26 14:57:47,431][123091] Updated weights for policy 0, policy_version 1924159 (0.0008) [2023-12-26 14:57:47,444][123090] Updated weights for policy 1, policy_version 1912085 (0.0008) [2023-12-26 14:57:47,492][123091] Updated weights for policy 0, policy_version 1924169 (0.0008) [2023-12-26 14:57:47,498][123090] Updated weights for policy 1, policy_version 1912095 (0.0008) [2023-12-26 14:57:48,250][123091] Updated weights for policy 0, policy_version 1924179 (0.0009) [2023-12-26 14:57:48,297][123090] Updated weights for policy 1, policy_version 1912105 (0.0009) [2023-12-26 14:57:48,313][123091] Updated weights for policy 0, policy_version 1924189 (0.0007) [2023-12-26 14:57:48,351][123090] Updated weights for policy 1, policy_version 1912115 (0.0009) [2023-12-26 14:57:48,382][123091] Updated weights for policy 0, policy_version 1924201 (0.0010) [2023-12-26 14:57:48,416][123090] Updated weights for policy 1, policy_version 1912125 (0.0006) [2023-12-26 14:57:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17661.4). Total num frames: 982106112. Throughput: 0: 9132.3, 1: 8510.6. Samples: 982117060. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:48,785][121949] Avg episode reward: [(0, '6117.052'), (1, '5983.620')] [2023-12-26 14:57:49,089][123091] Updated weights for policy 0, policy_version 1924211 (0.0008) [2023-12-26 14:57:49,154][123091] Updated weights for policy 0, policy_version 1924221 (0.0008) [2023-12-26 14:57:49,189][123090] Updated weights for policy 1, policy_version 1912135 (0.0009) [2023-12-26 14:57:49,221][123091] Updated weights for policy 0, policy_version 1924231 (0.0010) [2023-12-26 14:57:49,258][123090] Updated weights for policy 1, policy_version 1912145 (0.0008) [2023-12-26 14:57:49,321][123090] Updated weights for policy 1, policy_version 1912155 (0.0008) [2023-12-26 14:57:49,935][123091] Updated weights for policy 0, policy_version 1924241 (0.0009) [2023-12-26 14:57:50,005][123091] Updated weights for policy 0, policy_version 1924251 (0.0011) [2023-12-26 14:57:50,069][123091] Updated weights for policy 0, policy_version 1924261 (0.0011) [2023-12-26 14:57:50,121][123090] Updated weights for policy 1, policy_version 1912165 (0.0008) [2023-12-26 14:57:50,140][123091] Updated weights for policy 0, policy_version 1924271 (0.0011) [2023-12-26 14:57:50,195][123090] Updated weights for policy 1, policy_version 1912175 (0.0007) [2023-12-26 14:57:50,251][123090] Updated weights for policy 1, policy_version 1912185 (0.0010) [2023-12-26 14:57:50,895][123091] Updated weights for policy 0, policy_version 1924281 (0.0006) [2023-12-26 14:57:50,962][123091] Updated weights for policy 0, policy_version 1924291 (0.0006) [2023-12-26 14:57:51,032][123091] Updated weights for policy 0, policy_version 1924301 (0.0006) [2023-12-26 14:57:51,073][123090] Updated weights for policy 1, policy_version 1912195 (0.0009) [2023-12-26 14:57:51,148][123090] Updated weights for policy 1, policy_version 1912205 (0.0009) [2023-12-26 14:57:51,217][123090] Updated weights for policy 1, policy_version 1912215 (0.0009) [2023-12-26 14:57:51,748][123091] Updated weights for policy 0, policy_version 1924311 (0.0009) [2023-12-26 14:57:51,802][123091] Updated weights for policy 0, policy_version 1924321 (0.0007) [2023-12-26 14:57:51,872][123091] Updated weights for policy 0, policy_version 1924331 (0.0005) [2023-12-26 14:57:52,011][123090] Updated weights for policy 1, policy_version 1912225 (0.0010) [2023-12-26 14:57:52,074][123090] Updated weights for policy 1, policy_version 1912235 (0.0010) [2023-12-26 14:57:52,135][123090] Updated weights for policy 1, policy_version 1912245 (0.0010) [2023-12-26 14:57:52,195][123090] Updated weights for policy 1, policy_version 1912255 (0.0009) [2023-12-26 14:57:52,612][123091] Updated weights for policy 0, policy_version 1924341 (0.0008) [2023-12-26 14:57:52,680][123091] Updated weights for policy 0, policy_version 1924351 (0.0006) [2023-12-26 14:57:52,742][123091] Updated weights for policy 0, policy_version 1924361 (0.0006) [2023-12-26 14:57:53,043][123090] Updated weights for policy 1, policy_version 1912265 (0.0006) [2023-12-26 14:57:53,096][123090] Updated weights for policy 1, policy_version 1912275 (0.0009) [2023-12-26 14:57:53,155][123090] Updated weights for policy 1, policy_version 1912285 (0.0008) [2023-12-26 14:57:53,511][123091] Updated weights for policy 0, policy_version 1924371 (0.0007) [2023-12-26 14:57:53,569][123091] Updated weights for policy 0, policy_version 1924381 (0.0010) [2023-12-26 14:57:53,629][123091] Updated weights for policy 0, policy_version 1924391 (0.0010) [2023-12-26 14:57:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 982196224. Throughput: 0: 9163.0, 1: 8468.8. Samples: 982171984. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:53,785][121949] Avg episode reward: [(0, '6273.962'), (1, '5933.650')] [2023-12-26 14:57:53,796][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001912288_489545728.pth... [2023-12-26 14:57:53,796][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001924400_492650496.pth... [2023-12-26 14:57:53,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001923312_492371968.pth [2023-12-26 14:57:53,804][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001911328_489299968.pth [2023-12-26 14:57:53,941][123090] Updated weights for policy 1, policy_version 1912295 (0.0009) [2023-12-26 14:57:53,998][123090] Updated weights for policy 1, policy_version 1912305 (0.0010) [2023-12-26 14:57:54,065][123090] Updated weights for policy 1, policy_version 1912315 (0.0010) [2023-12-26 14:57:54,328][123091] Updated weights for policy 0, policy_version 1924401 (0.0005) [2023-12-26 14:57:54,385][123091] Updated weights for policy 0, policy_version 1924411 (0.0005) [2023-12-26 14:57:54,437][123091] Updated weights for policy 0, policy_version 1924421 (0.0007) [2023-12-26 14:57:54,485][123091] Updated weights for policy 0, policy_version 1924431 (0.0010) [2023-12-26 14:57:54,933][123090] Updated weights for policy 1, policy_version 1912325 (0.0009) [2023-12-26 14:57:54,986][123090] Updated weights for policy 1, policy_version 1912335 (0.0007) [2023-12-26 14:57:55,033][123090] Updated weights for policy 1, policy_version 1912345 (0.0005) [2023-12-26 14:57:55,310][123091] Updated weights for policy 0, policy_version 1924441 (0.0010) [2023-12-26 14:57:55,362][123091] Updated weights for policy 0, policy_version 1924451 (0.0006) [2023-12-26 14:57:55,425][123091] Updated weights for policy 0, policy_version 1924461 (0.0005) [2023-12-26 14:57:55,728][123090] Updated weights for policy 1, policy_version 1912355 (0.0006) [2023-12-26 14:57:55,777][123090] Updated weights for policy 1, policy_version 1912365 (0.0005) [2023-12-26 14:57:55,822][123090] Updated weights for policy 1, policy_version 1912375 (0.0005) [2023-12-26 14:57:56,020][123091] Updated weights for policy 0, policy_version 1924471 (0.0005) [2023-12-26 14:57:56,077][123091] Updated weights for policy 0, policy_version 1924481 (0.0005) [2023-12-26 14:57:56,143][123091] Updated weights for policy 0, policy_version 1924491 (0.0008) [2023-12-26 14:57:56,537][123090] Updated weights for policy 1, policy_version 1912385 (0.0005) [2023-12-26 14:57:56,593][123090] Updated weights for policy 1, policy_version 1912395 (0.0005) [2023-12-26 14:57:56,649][123090] Updated weights for policy 1, policy_version 1912405 (0.0005) [2023-12-26 14:57:56,707][123090] Updated weights for policy 1, policy_version 1912415 (0.0008) [2023-12-26 14:57:56,957][123091] Updated weights for policy 0, policy_version 1924501 (0.0010) [2023-12-26 14:57:57,004][123091] Updated weights for policy 0, policy_version 1924511 (0.0010) [2023-12-26 14:57:57,047][123091] Updated weights for policy 0, policy_version 1924521 (0.0010) [2023-12-26 14:57:57,518][123090] Updated weights for policy 1, policy_version 1912425 (0.0009) [2023-12-26 14:57:57,586][123090] Updated weights for policy 1, policy_version 1912435 (0.0009) [2023-12-26 14:57:57,652][123090] Updated weights for policy 1, policy_version 1912445 (0.0009) [2023-12-26 14:57:57,881][123091] Updated weights for policy 0, policy_version 1924531 (0.0010) [2023-12-26 14:57:57,950][123091] Updated weights for policy 0, policy_version 1924541 (0.0010) [2023-12-26 14:57:58,021][123091] Updated weights for policy 0, policy_version 1924551 (0.0011) [2023-12-26 14:57:58,468][123090] Updated weights for policy 1, policy_version 1912455 (0.0008) [2023-12-26 14:57:58,535][123090] Updated weights for policy 1, policy_version 1912465 (0.0008) [2023-12-26 14:57:58,610][123090] Updated weights for policy 1, policy_version 1912475 (0.0011) [2023-12-26 14:57:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 982286336. Throughput: 0: 9244.2, 1: 8513.4. Samples: 982281536. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:57:58,785][121949] Avg episode reward: [(0, '6278.730'), (1, '5692.502')] [2023-12-26 14:57:58,849][123091] Updated weights for policy 0, policy_version 1924561 (0.0012) [2023-12-26 14:57:58,924][123091] Updated weights for policy 0, policy_version 1924571 (0.0007) [2023-12-26 14:57:58,993][123091] Updated weights for policy 0, policy_version 1924581 (0.0010) [2023-12-26 14:57:59,065][123091] Updated weights for policy 0, policy_version 1924591 (0.0011) [2023-12-26 14:57:59,502][123090] Updated weights for policy 1, policy_version 1912485 (0.0010) [2023-12-26 14:57:59,565][123090] Updated weights for policy 1, policy_version 1912495 (0.0008) [2023-12-26 14:57:59,627][123090] Updated weights for policy 1, policy_version 1912505 (0.0006) [2023-12-26 14:57:59,816][123091] Updated weights for policy 0, policy_version 1924601 (0.0006) [2023-12-26 14:57:59,885][123091] Updated weights for policy 0, policy_version 1924611 (0.0006) [2023-12-26 14:57:59,951][123091] Updated weights for policy 0, policy_version 1924621 (0.0008) [2023-12-26 14:58:00,436][123090] Updated weights for policy 1, policy_version 1912515 (0.0010) [2023-12-26 14:58:00,485][123090] Updated weights for policy 1, policy_version 1912525 (0.0008) [2023-12-26 14:58:00,545][123090] Updated weights for policy 1, policy_version 1912535 (0.0009) [2023-12-26 14:58:00,718][123091] Updated weights for policy 0, policy_version 1924631 (0.0010) [2023-12-26 14:58:00,765][123091] Updated weights for policy 0, policy_version 1924641 (0.0006) [2023-12-26 14:58:00,820][123091] Updated weights for policy 0, policy_version 1924651 (0.0006) [2023-12-26 14:58:01,320][123090] Updated weights for policy 1, policy_version 1912545 (0.0009) [2023-12-26 14:58:01,392][123090] Updated weights for policy 1, policy_version 1912555 (0.0006) [2023-12-26 14:58:01,456][123090] Updated weights for policy 1, policy_version 1912565 (0.0006) [2023-12-26 14:58:01,516][123090] Updated weights for policy 1, policy_version 1912575 (0.0005) [2023-12-26 14:58:01,580][123091] Updated weights for policy 0, policy_version 1924661 (0.0008) [2023-12-26 14:58:01,643][123091] Updated weights for policy 0, policy_version 1924671 (0.0007) [2023-12-26 14:58:01,695][123091] Updated weights for policy 0, policy_version 1924681 (0.0010) [2023-12-26 14:58:02,208][123090] Updated weights for policy 1, policy_version 1912585 (0.0005) [2023-12-26 14:58:02,277][123090] Updated weights for policy 1, policy_version 1912595 (0.0007) [2023-12-26 14:58:02,353][123090] Updated weights for policy 1, policy_version 1912605 (0.0008) [2023-12-26 14:58:02,462][123091] Updated weights for policy 0, policy_version 1924691 (0.0011) [2023-12-26 14:58:02,527][123091] Updated weights for policy 0, policy_version 1924701 (0.0005) [2023-12-26 14:58:02,580][123091] Updated weights for policy 0, policy_version 1924711 (0.0005) [2023-12-26 14:58:03,126][123090] Updated weights for policy 1, policy_version 1912615 (0.0011) [2023-12-26 14:58:03,185][123090] Updated weights for policy 1, policy_version 1912625 (0.0010) [2023-12-26 14:58:03,229][123090] Updated weights for policy 1, policy_version 1912635 (0.0010) [2023-12-26 14:58:03,238][123091] Updated weights for policy 0, policy_version 1924721 (0.0005) [2023-12-26 14:58:03,296][123091] Updated weights for policy 0, policy_version 1924731 (0.0006) [2023-12-26 14:58:03,358][123091] Updated weights for policy 0, policy_version 1924741 (0.0006) [2023-12-26 14:58:03,409][123091] Updated weights for policy 0, policy_version 1924751 (0.0010) [2023-12-26 14:58:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 982376448. Throughput: 0: 9228.8, 1: 8540.1. Samples: 982389168. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:03,785][121949] Avg episode reward: [(0, '6309.943'), (1, '5647.960')] [2023-12-26 14:58:03,948][123090] Updated weights for policy 1, policy_version 1912645 (0.0008) [2023-12-26 14:58:04,014][123090] Updated weights for policy 1, policy_version 1912655 (0.0005) [2023-12-26 14:58:04,073][123090] Updated weights for policy 1, policy_version 1912665 (0.0005) [2023-12-26 14:58:04,148][123091] Updated weights for policy 0, policy_version 1924761 (0.0011) [2023-12-26 14:58:04,206][123091] Updated weights for policy 0, policy_version 1924771 (0.0008) [2023-12-26 14:58:04,257][123091] Updated weights for policy 0, policy_version 1924781 (0.0008) [2023-12-26 14:58:04,825][123090] Updated weights for policy 1, policy_version 1912675 (0.0008) [2023-12-26 14:58:04,891][123090] Updated weights for policy 1, policy_version 1912685 (0.0010) [2023-12-26 14:58:04,946][123090] Updated weights for policy 1, policy_version 1912695 (0.0010) [2023-12-26 14:58:05,042][123091] Updated weights for policy 0, policy_version 1924791 (0.0006) [2023-12-26 14:58:05,092][123091] Updated weights for policy 0, policy_version 1924801 (0.0005) [2023-12-26 14:58:05,140][123091] Updated weights for policy 0, policy_version 1924811 (0.0005) [2023-12-26 14:58:05,752][123090] Updated weights for policy 1, policy_version 1912705 (0.0010) [2023-12-26 14:58:05,806][123090] Updated weights for policy 1, policy_version 1912715 (0.0010) [2023-12-26 14:58:05,841][123091] Updated weights for policy 0, policy_version 1924821 (0.0005) [2023-12-26 14:58:05,857][123090] Updated weights for policy 1, policy_version 1912725 (0.0010) [2023-12-26 14:58:05,888][123091] Updated weights for policy 0, policy_version 1924831 (0.0009) [2023-12-26 14:58:05,911][123090] Updated weights for policy 1, policy_version 1912735 (0.0010) [2023-12-26 14:58:05,939][123091] Updated weights for policy 0, policy_version 1924841 (0.0010) [2023-12-26 14:58:06,695][123090] Updated weights for policy 1, policy_version 1912745 (0.0010) [2023-12-26 14:58:06,759][123090] Updated weights for policy 1, policy_version 1912755 (0.0011) [2023-12-26 14:58:06,771][123091] Updated weights for policy 0, policy_version 1924851 (0.0009) [2023-12-26 14:58:06,823][123090] Updated weights for policy 1, policy_version 1912765 (0.0010) [2023-12-26 14:58:06,835][123091] Updated weights for policy 0, policy_version 1924861 (0.0005) [2023-12-26 14:58:06,905][123091] Updated weights for policy 0, policy_version 1924871 (0.0005) [2023-12-26 14:58:07,510][123090] Updated weights for policy 1, policy_version 1912775 (0.0006) [2023-12-26 14:58:07,577][123090] Updated weights for policy 1, policy_version 1912785 (0.0005) [2023-12-26 14:58:07,644][123091] Updated weights for policy 0, policy_version 1924881 (0.0006) [2023-12-26 14:58:07,647][123090] Updated weights for policy 1, policy_version 1912795 (0.0005) [2023-12-26 14:58:07,701][123091] Updated weights for policy 0, policy_version 1924891 (0.0010) [2023-12-26 14:58:07,770][123091] Updated weights for policy 0, policy_version 1924901 (0.0010) [2023-12-26 14:58:07,826][123091] Updated weights for policy 0, policy_version 1924911 (0.0010) [2023-12-26 14:58:08,317][123090] Updated weights for policy 1, policy_version 1912805 (0.0008) [2023-12-26 14:58:08,385][123090] Updated weights for policy 1, policy_version 1912815 (0.0011) [2023-12-26 14:58:08,454][123090] Updated weights for policy 1, policy_version 1912825 (0.0011) [2023-12-26 14:58:08,690][123091] Updated weights for policy 0, policy_version 1924921 (0.0010) [2023-12-26 14:58:08,753][123091] Updated weights for policy 0, policy_version 1924931 (0.0010) [2023-12-26 14:58:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17661.4). Total num frames: 982466560. Throughput: 0: 9279.3, 1: 8587.6. Samples: 982444856. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:08,785][121949] Avg episode reward: [(0, '6388.002'), (1, '5481.582')] [2023-12-26 14:58:08,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001912832_489684992.pth... [2023-12-26 14:58:08,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001911808_489422848.pth [2023-12-26 14:58:08,808][123091] Updated weights for policy 0, policy_version 1924941 (0.0010) [2023-12-26 14:58:08,822][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001924944_492789760.pth... [2023-12-26 14:58:08,825][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001923856_492511232.pth [2023-12-26 14:58:09,208][123090] Updated weights for policy 1, policy_version 1912835 (0.0011) [2023-12-26 14:58:09,282][123090] Updated weights for policy 1, policy_version 1912845 (0.0006) [2023-12-26 14:58:09,349][123090] Updated weights for policy 1, policy_version 1912855 (0.0008) [2023-12-26 14:58:09,671][123091] Updated weights for policy 0, policy_version 1924951 (0.0009) [2023-12-26 14:58:09,728][123091] Updated weights for policy 0, policy_version 1924961 (0.0008) [2023-12-26 14:58:09,798][123091] Updated weights for policy 0, policy_version 1924971 (0.0008) [2023-12-26 14:58:10,017][123090] Updated weights for policy 1, policy_version 1912865 (0.0008) [2023-12-26 14:58:10,091][123090] Updated weights for policy 1, policy_version 1912875 (0.0006) [2023-12-26 14:58:10,159][123090] Updated weights for policy 1, policy_version 1912885 (0.0006) [2023-12-26 14:58:10,232][123090] Updated weights for policy 1, policy_version 1912895 (0.0008) [2023-12-26 14:58:10,630][123091] Updated weights for policy 0, policy_version 1924981 (0.0007) [2023-12-26 14:58:10,700][123091] Updated weights for policy 0, policy_version 1924991 (0.0005) [2023-12-26 14:58:10,761][123091] Updated weights for policy 0, policy_version 1925001 (0.0008) [2023-12-26 14:58:10,975][123090] Updated weights for policy 1, policy_version 1912905 (0.0010) [2023-12-26 14:58:11,035][123090] Updated weights for policy 1, policy_version 1912915 (0.0009) [2023-12-26 14:58:11,098][123090] Updated weights for policy 1, policy_version 1912925 (0.0011) [2023-12-26 14:58:11,555][123091] Updated weights for policy 0, policy_version 1925011 (0.0011) [2023-12-26 14:58:11,623][123091] Updated weights for policy 0, policy_version 1925021 (0.0010) [2023-12-26 14:58:11,693][123091] Updated weights for policy 0, policy_version 1925031 (0.0011) [2023-12-26 14:58:11,964][123090] Updated weights for policy 1, policy_version 1912935 (0.0009) [2023-12-26 14:58:12,013][123090] Updated weights for policy 1, policy_version 1912945 (0.0009) [2023-12-26 14:58:12,070][123090] Updated weights for policy 1, policy_version 1912955 (0.0009) [2023-12-26 14:58:12,580][123091] Updated weights for policy 0, policy_version 1925041 (0.0010) [2023-12-26 14:58:12,651][123091] Updated weights for policy 0, policy_version 1925051 (0.0010) [2023-12-26 14:58:12,715][123091] Updated weights for policy 0, policy_version 1925061 (0.0009) [2023-12-26 14:58:12,768][123091] Updated weights for policy 0, policy_version 1925071 (0.0009) [2023-12-26 14:58:12,988][123090] Updated weights for policy 1, policy_version 1912965 (0.0009) [2023-12-26 14:58:13,045][123090] Updated weights for policy 1, policy_version 1912975 (0.0009) [2023-12-26 14:58:13,095][123090] Updated weights for policy 1, policy_version 1912985 (0.0009) [2023-12-26 14:58:13,535][123091] Updated weights for policy 0, policy_version 1925081 (0.0010) [2023-12-26 14:58:13,579][123091] Updated weights for policy 0, policy_version 1925091 (0.0009) [2023-12-26 14:58:13,634][123091] Updated weights for policy 0, policy_version 1925101 (0.0005) [2023-12-26 14:58:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 982556672. Throughput: 0: 9207.4, 1: 8608.8. Samples: 982549692. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:13,785][121949] Avg episode reward: [(0, '6338.782'), (1, '5434.165')] [2023-12-26 14:58:13,970][123090] Updated weights for policy 1, policy_version 1912995 (0.0008) [2023-12-26 14:58:14,037][123090] Updated weights for policy 1, policy_version 1913005 (0.0005) [2023-12-26 14:58:14,097][123090] Updated weights for policy 1, policy_version 1913015 (0.0005) [2023-12-26 14:58:14,374][123091] Updated weights for policy 0, policy_version 1925111 (0.0009) [2023-12-26 14:58:14,434][123091] Updated weights for policy 0, policy_version 1925122 (0.0010) [2023-12-26 14:58:14,482][123091] Updated weights for policy 0, policy_version 1925132 (0.0009) [2023-12-26 14:58:14,832][123090] Updated weights for policy 1, policy_version 1913025 (0.0006) [2023-12-26 14:58:14,898][123090] Updated weights for policy 1, policy_version 1913035 (0.0011) [2023-12-26 14:58:14,963][123090] Updated weights for policy 1, policy_version 1913045 (0.0011) [2023-12-26 14:58:15,030][123090] Updated weights for policy 1, policy_version 1913055 (0.0009) [2023-12-26 14:58:15,363][123091] Updated weights for policy 0, policy_version 1925142 (0.0009) [2023-12-26 14:58:15,430][123091] Updated weights for policy 0, policy_version 1925152 (0.0009) [2023-12-26 14:58:15,488][123091] Updated weights for policy 0, policy_version 1925162 (0.0010) [2023-12-26 14:58:15,668][123090] Updated weights for policy 1, policy_version 1913065 (0.0005) [2023-12-26 14:58:15,728][123090] Updated weights for policy 1, policy_version 1913075 (0.0005) [2023-12-26 14:58:15,790][123090] Updated weights for policy 1, policy_version 1913085 (0.0005) [2023-12-26 14:58:16,414][123091] Updated weights for policy 0, policy_version 1925172 (0.0010) [2023-12-26 14:58:16,475][123091] Updated weights for policy 0, policy_version 1925182 (0.0008) [2023-12-26 14:58:16,479][123090] Updated weights for policy 1, policy_version 1913095 (0.0005) [2023-12-26 14:58:16,540][123091] Updated weights for policy 0, policy_version 1925192 (0.0009) [2023-12-26 14:58:16,551][123090] Updated weights for policy 1, policy_version 1913105 (0.0005) [2023-12-26 14:58:16,605][123090] Updated weights for policy 1, policy_version 1913115 (0.0005) [2023-12-26 14:58:17,134][123090] Updated weights for policy 1, policy_version 1913125 (0.0006) [2023-12-26 14:58:17,185][123090] Updated weights for policy 1, policy_version 1913135 (0.0010) [2023-12-26 14:58:17,247][123090] Updated weights for policy 1, policy_version 1913145 (0.0010) [2023-12-26 14:58:17,406][123091] Updated weights for policy 0, policy_version 1925202 (0.0010) [2023-12-26 14:58:17,468][123091] Updated weights for policy 0, policy_version 1925212 (0.0009) [2023-12-26 14:58:17,536][123091] Updated weights for policy 0, policy_version 1925222 (0.0008) [2023-12-26 14:58:17,601][123091] Updated weights for policy 0, policy_version 1925232 (0.0009) [2023-12-26 14:58:17,982][123090] Updated weights for policy 1, policy_version 1913155 (0.0009) [2023-12-26 14:58:18,049][123090] Updated weights for policy 1, policy_version 1913165 (0.0006) [2023-12-26 14:58:18,108][123090] Updated weights for policy 1, policy_version 1913175 (0.0006) [2023-12-26 14:58:18,322][123091] Updated weights for policy 0, policy_version 1925242 (0.0006) [2023-12-26 14:58:18,399][123091] Updated weights for policy 0, policy_version 1925252 (0.0008) [2023-12-26 14:58:18,473][123091] Updated weights for policy 0, policy_version 1925262 (0.0006) [2023-12-26 14:58:18,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17661.4). Total num frames: 982646784. Throughput: 0: 9110.8, 1: 8769.8. Samples: 982658980. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:18,785][121949] Avg episode reward: [(0, '6235.082'), (1, '5795.118')] [2023-12-26 14:58:18,869][123090] Updated weights for policy 1, policy_version 1913185 (0.0006) [2023-12-26 14:58:18,929][123090] Updated weights for policy 1, policy_version 1913195 (0.0009) [2023-12-26 14:58:18,999][123090] Updated weights for policy 1, policy_version 1913205 (0.0005) [2023-12-26 14:58:19,066][123090] Updated weights for policy 1, policy_version 1913215 (0.0005) [2023-12-26 14:58:19,222][123091] Updated weights for policy 0, policy_version 1925272 (0.0008) [2023-12-26 14:58:19,282][123091] Updated weights for policy 0, policy_version 1925282 (0.0009) [2023-12-26 14:58:19,333][123091] Updated weights for policy 0, policy_version 1925292 (0.0009) [2023-12-26 14:58:19,872][123090] Updated weights for policy 1, policy_version 1913225 (0.0007) [2023-12-26 14:58:19,940][123090] Updated weights for policy 1, policy_version 1913235 (0.0008) [2023-12-26 14:58:20,009][123090] Updated weights for policy 1, policy_version 1913245 (0.0010) [2023-12-26 14:58:20,203][123091] Updated weights for policy 0, policy_version 1925302 (0.0009) [2023-12-26 14:58:20,270][123091] Updated weights for policy 0, policy_version 1925312 (0.0009) [2023-12-26 14:58:20,344][123091] Updated weights for policy 0, policy_version 1925322 (0.0009) [2023-12-26 14:58:20,773][123090] Updated weights for policy 1, policy_version 1913255 (0.0006) [2023-12-26 14:58:20,850][123090] Updated weights for policy 1, policy_version 1913265 (0.0006) [2023-12-26 14:58:20,925][123090] Updated weights for policy 1, policy_version 1913275 (0.0006) [2023-12-26 14:58:21,161][123091] Updated weights for policy 0, policy_version 1925332 (0.0009) [2023-12-26 14:58:21,216][123091] Updated weights for policy 0, policy_version 1925342 (0.0005) [2023-12-26 14:58:21,284][123091] Updated weights for policy 0, policy_version 1925352 (0.0009) [2023-12-26 14:58:21,652][123090] Updated weights for policy 1, policy_version 1913285 (0.0007) [2023-12-26 14:58:21,726][123090] Updated weights for policy 1, policy_version 1913295 (0.0013) [2023-12-26 14:58:21,790][123090] Updated weights for policy 1, policy_version 1913305 (0.0007) [2023-12-26 14:58:22,087][123091] Updated weights for policy 0, policy_version 1925362 (0.0006) [2023-12-26 14:58:22,150][123091] Updated weights for policy 0, policy_version 1925372 (0.0006) [2023-12-26 14:58:22,212][123091] Updated weights for policy 0, policy_version 1925382 (0.0006) [2023-12-26 14:58:22,277][123091] Updated weights for policy 0, policy_version 1925392 (0.0008) [2023-12-26 14:58:22,681][123090] Updated weights for policy 1, policy_version 1913315 (0.0008) [2023-12-26 14:58:22,746][123090] Updated weights for policy 1, policy_version 1913325 (0.0010) [2023-12-26 14:58:22,815][123090] Updated weights for policy 1, policy_version 1913335 (0.0009) [2023-12-26 14:58:23,041][123091] Updated weights for policy 0, policy_version 1925402 (0.0009) [2023-12-26 14:58:23,102][123091] Updated weights for policy 0, policy_version 1925412 (0.0008) [2023-12-26 14:58:23,162][123091] Updated weights for policy 0, policy_version 1925422 (0.0011) [2023-12-26 14:58:23,547][123090] Updated weights for policy 1, policy_version 1913345 (0.0009) [2023-12-26 14:58:23,609][123090] Updated weights for policy 1, policy_version 1913355 (0.0005) [2023-12-26 14:58:23,675][123090] Updated weights for policy 1, policy_version 1913365 (0.0005) [2023-12-26 14:58:23,746][123090] Updated weights for policy 1, policy_version 1913375 (0.0005) [2023-12-26 14:58:23,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 982736896. Throughput: 0: 9035.7, 1: 8831.2. Samples: 982711848. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:23,785][121949] Avg episode reward: [(0, '6146.990'), (1, '5579.664')] [2023-12-26 14:58:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001925424_492912640.pth... [2023-12-26 14:58:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001913376_489824256.pth... [2023-12-26 14:58:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001924400_492650496.pth [2023-12-26 14:58:23,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001912288_489545728.pth [2023-12-26 14:58:23,964][123091] Updated weights for policy 0, policy_version 1925432 (0.0006) [2023-12-26 14:58:24,043][123091] Updated weights for policy 0, policy_version 1925442 (0.0005) [2023-12-26 14:58:24,111][123091] Updated weights for policy 0, policy_version 1925452 (0.0005) [2023-12-26 14:58:24,370][123090] Updated weights for policy 1, policy_version 1913385 (0.0005) [2023-12-26 14:58:24,435][123090] Updated weights for policy 1, policy_version 1913395 (0.0006) [2023-12-26 14:58:24,504][123090] Updated weights for policy 1, policy_version 1913405 (0.0005) [2023-12-26 14:58:24,733][123091] Updated weights for policy 0, policy_version 1925462 (0.0005) [2023-12-26 14:58:24,794][123091] Updated weights for policy 0, policy_version 1925472 (0.0006) [2023-12-26 14:58:24,847][123091] Updated weights for policy 0, policy_version 1925482 (0.0005) [2023-12-26 14:58:25,255][123090] Updated weights for policy 1, policy_version 1913415 (0.0009) [2023-12-26 14:58:25,308][123090] Updated weights for policy 1, policy_version 1913425 (0.0011) [2023-12-26 14:58:25,351][123090] Updated weights for policy 1, policy_version 1913435 (0.0010) [2023-12-26 14:58:25,533][123091] Updated weights for policy 0, policy_version 1925492 (0.0008) [2023-12-26 14:58:25,588][123091] Updated weights for policy 0, policy_version 1925502 (0.0010) [2023-12-26 14:58:25,642][123091] Updated weights for policy 0, policy_version 1925512 (0.0010) [2023-12-26 14:58:26,185][123090] Updated weights for policy 1, policy_version 1913445 (0.0010) [2023-12-26 14:58:26,247][123090] Updated weights for policy 1, policy_version 1913455 (0.0010) [2023-12-26 14:58:26,312][123090] Updated weights for policy 1, policy_version 1913465 (0.0010) [2023-12-26 14:58:26,324][123091] Updated weights for policy 0, policy_version 1925522 (0.0010) [2023-12-26 14:58:26,371][123091] Updated weights for policy 0, policy_version 1925532 (0.0010) [2023-12-26 14:58:26,430][123091] Updated weights for policy 0, policy_version 1925542 (0.0010) [2023-12-26 14:58:26,481][123091] Updated weights for policy 0, policy_version 1925552 (0.0010) [2023-12-26 14:58:26,971][123090] Updated weights for policy 1, policy_version 1913475 (0.0009) [2023-12-26 14:58:27,041][123090] Updated weights for policy 1, policy_version 1913485 (0.0005) [2023-12-26 14:58:27,104][123090] Updated weights for policy 1, policy_version 1913495 (0.0005) [2023-12-26 14:58:27,185][123091] Updated weights for policy 0, policy_version 1925562 (0.0010) [2023-12-26 14:58:27,238][123091] Updated weights for policy 0, policy_version 1925572 (0.0009) [2023-12-26 14:58:27,295][123091] Updated weights for policy 0, policy_version 1925582 (0.0008) [2023-12-26 14:58:27,849][123090] Updated weights for policy 1, policy_version 1913505 (0.0006) [2023-12-26 14:58:27,923][123090] Updated weights for policy 1, policy_version 1913515 (0.0011) [2023-12-26 14:58:27,990][123090] Updated weights for policy 1, policy_version 1913525 (0.0011) [2023-12-26 14:58:28,015][123091] Updated weights for policy 0, policy_version 1925592 (0.0007) [2023-12-26 14:58:28,046][123090] Updated weights for policy 1, policy_version 1913535 (0.0010) [2023-12-26 14:58:28,078][123091] Updated weights for policy 0, policy_version 1925602 (0.0010) [2023-12-26 14:58:28,148][123091] Updated weights for policy 0, policy_version 1925612 (0.0011) [2023-12-26 14:58:28,753][123090] Updated weights for policy 1, policy_version 1913545 (0.0006) [2023-12-26 14:58:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 982827008. Throughput: 0: 9154.2, 1: 8963.4. Samples: 982824432. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:28,785][121949] Avg episode reward: [(0, '6210.251'), (1, '5475.619')] [2023-12-26 14:58:28,821][123090] Updated weights for policy 1, policy_version 1913555 (0.0005) [2023-12-26 14:58:28,881][123090] Updated weights for policy 1, policy_version 1913565 (0.0005) [2023-12-26 14:58:28,917][123091] Updated weights for policy 0, policy_version 1925622 (0.0009) [2023-12-26 14:58:28,972][123091] Updated weights for policy 0, policy_version 1925632 (0.0009) [2023-12-26 14:58:29,021][123091] Updated weights for policy 0, policy_version 1925642 (0.0005) [2023-12-26 14:58:29,603][123090] Updated weights for policy 1, policy_version 1913575 (0.0009) [2023-12-26 14:58:29,667][123090] Updated weights for policy 1, policy_version 1913585 (0.0011) [2023-12-26 14:58:29,731][123090] Updated weights for policy 1, policy_version 1913595 (0.0011) [2023-12-26 14:58:29,739][123091] Updated weights for policy 0, policy_version 1925652 (0.0006) [2023-12-26 14:58:29,784][123091] Updated weights for policy 0, policy_version 1925662 (0.0006) [2023-12-26 14:58:29,848][123091] Updated weights for policy 0, policy_version 1925672 (0.0006) [2023-12-26 14:58:30,469][123090] Updated weights for policy 1, policy_version 1913605 (0.0008) [2023-12-26 14:58:30,528][123090] Updated weights for policy 1, policy_version 1913615 (0.0006) [2023-12-26 14:58:30,593][123090] Updated weights for policy 1, policy_version 1913625 (0.0005) [2023-12-26 14:58:30,600][123091] Updated weights for policy 0, policy_version 1925682 (0.0006) [2023-12-26 14:58:30,670][123091] Updated weights for policy 0, policy_version 1925692 (0.0006) [2023-12-26 14:58:30,730][123091] Updated weights for policy 0, policy_version 1925702 (0.0006) [2023-12-26 14:58:30,786][123091] Updated weights for policy 0, policy_version 1925712 (0.0010) [2023-12-26 14:58:31,273][123090] Updated weights for policy 1, policy_version 1913635 (0.0006) [2023-12-26 14:58:31,338][123090] Updated weights for policy 1, policy_version 1913645 (0.0008) [2023-12-26 14:58:31,412][123090] Updated weights for policy 1, policy_version 1913655 (0.0007) [2023-12-26 14:58:31,559][123091] Updated weights for policy 0, policy_version 1925722 (0.0005) [2023-12-26 14:58:31,611][123091] Updated weights for policy 0, policy_version 1925732 (0.0006) [2023-12-26 14:58:31,671][123091] Updated weights for policy 0, policy_version 1925742 (0.0007) [2023-12-26 14:58:32,062][123090] Updated weights for policy 1, policy_version 1913665 (0.0005) [2023-12-26 14:58:32,130][123090] Updated weights for policy 1, policy_version 1913675 (0.0005) [2023-12-26 14:58:32,198][123090] Updated weights for policy 1, policy_version 1913685 (0.0007) [2023-12-26 14:58:32,267][123090] Updated weights for policy 1, policy_version 1913695 (0.0006) [2023-12-26 14:58:32,433][123091] Updated weights for policy 0, policy_version 1925752 (0.0010) [2023-12-26 14:58:32,481][123091] Updated weights for policy 0, policy_version 1925762 (0.0010) [2023-12-26 14:58:32,539][123091] Updated weights for policy 0, policy_version 1925772 (0.0010) [2023-12-26 14:58:32,946][123090] Updated weights for policy 1, policy_version 1913705 (0.0007) [2023-12-26 14:58:33,007][123090] Updated weights for policy 1, policy_version 1913715 (0.0006) [2023-12-26 14:58:33,069][123090] Updated weights for policy 1, policy_version 1913725 (0.0009) [2023-12-26 14:58:33,244][123091] Updated weights for policy 0, policy_version 1925782 (0.0007) [2023-12-26 14:58:33,289][123091] Updated weights for policy 0, policy_version 1925792 (0.0005) [2023-12-26 14:58:33,333][123091] Updated weights for policy 0, policy_version 1925802 (0.0005) [2023-12-26 14:58:33,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 982925312. Throughput: 0: 9134.6, 1: 9167.2. Samples: 982940640. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:33,785][121949] Avg episode reward: [(0, '6343.354'), (1, '5731.639')] [2023-12-26 14:58:33,790][123090] Updated weights for policy 1, policy_version 1913735 (0.0007) [2023-12-26 14:58:33,850][123090] Updated weights for policy 1, policy_version 1913745 (0.0005) [2023-12-26 14:58:33,903][123090] Updated weights for policy 1, policy_version 1913755 (0.0005) [2023-12-26 14:58:34,025][123091] Updated weights for policy 0, policy_version 1925812 (0.0006) [2023-12-26 14:58:34,080][123091] Updated weights for policy 0, policy_version 1925822 (0.0009) [2023-12-26 14:58:34,129][123091] Updated weights for policy 0, policy_version 1925832 (0.0009) [2023-12-26 14:58:34,707][123090] Updated weights for policy 1, policy_version 1913765 (0.0008) [2023-12-26 14:58:34,759][123090] Updated weights for policy 1, policy_version 1913775 (0.0010) [2023-12-26 14:58:34,823][123090] Updated weights for policy 1, policy_version 1913785 (0.0011) [2023-12-26 14:58:34,981][123091] Updated weights for policy 0, policy_version 1925842 (0.0010) [2023-12-26 14:58:35,038][123091] Updated weights for policy 0, policy_version 1925852 (0.0009) [2023-12-26 14:58:35,090][123091] Updated weights for policy 0, policy_version 1925862 (0.0009) [2023-12-26 14:58:35,137][123091] Updated weights for policy 0, policy_version 1925872 (0.0008) [2023-12-26 14:58:35,578][123090] Updated weights for policy 1, policy_version 1913795 (0.0009) [2023-12-26 14:58:35,658][123090] Updated weights for policy 1, policy_version 1913805 (0.0005) [2023-12-26 14:58:35,723][123090] Updated weights for policy 1, policy_version 1913815 (0.0005) [2023-12-26 14:58:36,045][123091] Updated weights for policy 0, policy_version 1925882 (0.0010) [2023-12-26 14:58:36,097][123091] Updated weights for policy 0, policy_version 1925892 (0.0010) [2023-12-26 14:58:36,156][123091] Updated weights for policy 0, policy_version 1925902 (0.0009) [2023-12-26 14:58:36,348][123090] Updated weights for policy 1, policy_version 1913825 (0.0006) [2023-12-26 14:58:36,416][123090] Updated weights for policy 1, policy_version 1913835 (0.0011) [2023-12-26 14:58:36,489][123090] Updated weights for policy 1, policy_version 1913845 (0.0011) [2023-12-26 14:58:36,553][123090] Updated weights for policy 1, policy_version 1913855 (0.0007) [2023-12-26 14:58:37,068][123091] Updated weights for policy 0, policy_version 1925912 (0.0007) [2023-12-26 14:58:37,131][123091] Updated weights for policy 0, policy_version 1925922 (0.0010) [2023-12-26 14:58:37,140][123090] Updated weights for policy 1, policy_version 1913865 (0.0005) [2023-12-26 14:58:37,193][123090] Updated weights for policy 1, policy_version 1913875 (0.0005) [2023-12-26 14:58:37,195][123091] Updated weights for policy 0, policy_version 1925932 (0.0011) [2023-12-26 14:58:37,257][123090] Updated weights for policy 1, policy_version 1913885 (0.0009) [2023-12-26 14:58:37,978][123090] Updated weights for policy 1, policy_version 1913895 (0.0009) [2023-12-26 14:58:37,992][123091] Updated weights for policy 0, policy_version 1925942 (0.0008) [2023-12-26 14:58:38,034][123090] Updated weights for policy 1, policy_version 1913905 (0.0010) [2023-12-26 14:58:38,044][123091] Updated weights for policy 0, policy_version 1925952 (0.0005) [2023-12-26 14:58:38,101][123090] Updated weights for policy 1, policy_version 1913915 (0.0010) [2023-12-26 14:58:38,108][123091] Updated weights for policy 0, policy_version 1925962 (0.0006) [2023-12-26 14:58:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 983015424. Throughput: 0: 9055.8, 1: 9212.2. Samples: 982994040. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:38,785][121949] Avg episode reward: [(0, '6275.944'), (1, '5832.643')] [2023-12-26 14:58:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001913920_489963520.pth... [2023-12-26 14:58:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001912832_489684992.pth [2023-12-26 14:58:38,829][123091] Updated weights for policy 0, policy_version 1925972 (0.0008) [2023-12-26 14:58:38,877][123091] Updated weights for policy 0, policy_version 1925982 (0.0009) [2023-12-26 14:58:38,912][123090] Updated weights for policy 1, policy_version 1913925 (0.0011) [2023-12-26 14:58:38,935][123091] Updated weights for policy 0, policy_version 1925992 (0.0007) [2023-12-26 14:58:38,967][123090] Updated weights for policy 1, policy_version 1913935 (0.0010) [2023-12-26 14:58:38,985][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001926000_493060096.pth... [2023-12-26 14:58:38,988][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001924944_492789760.pth [2023-12-26 14:58:39,024][123090] Updated weights for policy 1, policy_version 1913945 (0.0010) [2023-12-26 14:58:39,796][123091] Updated weights for policy 0, policy_version 1926002 (0.0006) [2023-12-26 14:58:39,869][123091] Updated weights for policy 0, policy_version 1926012 (0.0009) [2023-12-26 14:58:39,890][123090] Updated weights for policy 1, policy_version 1913955 (0.0010) [2023-12-26 14:58:39,936][123091] Updated weights for policy 0, policy_version 1926022 (0.0006) [2023-12-26 14:58:39,952][123090] Updated weights for policy 1, policy_version 1913965 (0.0011) [2023-12-26 14:58:40,002][123091] Updated weights for policy 0, policy_version 1926032 (0.0006) [2023-12-26 14:58:40,016][123090] Updated weights for policy 1, policy_version 1913975 (0.0011) [2023-12-26 14:58:40,812][123091] Updated weights for policy 0, policy_version 1926042 (0.0005) [2023-12-26 14:58:40,857][123091] Updated weights for policy 0, policy_version 1926052 (0.0005) [2023-12-26 14:58:40,894][123090] Updated weights for policy 1, policy_version 1913985 (0.0011) [2023-12-26 14:58:40,902][123091] Updated weights for policy 0, policy_version 1926062 (0.0006) [2023-12-26 14:58:40,950][123090] Updated weights for policy 1, policy_version 1913995 (0.0009) [2023-12-26 14:58:41,005][123090] Updated weights for policy 1, policy_version 1914005 (0.0009) [2023-12-26 14:58:41,072][123090] Updated weights for policy 1, policy_version 1914015 (0.0010) [2023-12-26 14:58:41,757][123091] Updated weights for policy 0, policy_version 1926072 (0.0008) [2023-12-26 14:58:41,821][123091] Updated weights for policy 0, policy_version 1926082 (0.0009) [2023-12-26 14:58:41,877][123091] Updated weights for policy 0, policy_version 1926092 (0.0008) [2023-12-26 14:58:41,930][123090] Updated weights for policy 1, policy_version 1914025 (0.0011) [2023-12-26 14:58:42,001][123090] Updated weights for policy 1, policy_version 1914035 (0.0011) [2023-12-26 14:58:42,068][123090] Updated weights for policy 1, policy_version 1914045 (0.0011) [2023-12-26 14:58:42,753][123091] Updated weights for policy 0, policy_version 1926102 (0.0008) [2023-12-26 14:58:42,825][123091] Updated weights for policy 0, policy_version 1926112 (0.0009) [2023-12-26 14:58:42,861][123090] Updated weights for policy 1, policy_version 1914055 (0.0011) [2023-12-26 14:58:42,898][123091] Updated weights for policy 0, policy_version 1926122 (0.0008) [2023-12-26 14:58:42,929][123090] Updated weights for policy 1, policy_version 1914065 (0.0011) [2023-12-26 14:58:42,993][123090] Updated weights for policy 1, policy_version 1914075 (0.0010) [2023-12-26 14:58:43,655][123091] Updated weights for policy 0, policy_version 1926132 (0.0009) [2023-12-26 14:58:43,701][123091] Updated weights for policy 0, policy_version 1926142 (0.0005) [2023-12-26 14:58:43,757][123091] Updated weights for policy 0, policy_version 1926152 (0.0006) [2023-12-26 14:58:43,784][121949] Fps is (10 sec: 17203.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 983097344. Throughput: 0: 8956.8, 1: 9188.3. Samples: 983098064. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:43,784][121949] Avg episode reward: [(0, '6196.895'), (1, '5811.471')] [2023-12-26 14:58:43,786][123090] Updated weights for policy 1, policy_version 1914085 (0.0010) [2023-12-26 14:58:43,833][123090] Updated weights for policy 1, policy_version 1914095 (0.0010) [2023-12-26 14:58:43,884][123090] Updated weights for policy 1, policy_version 1914105 (0.0010) [2023-12-26 14:58:44,457][123091] Updated weights for policy 0, policy_version 1926162 (0.0006) [2023-12-26 14:58:44,512][123091] Updated weights for policy 0, policy_version 1926172 (0.0010) [2023-12-26 14:58:44,574][123091] Updated weights for policy 0, policy_version 1926182 (0.0010) [2023-12-26 14:58:44,636][123091] Updated weights for policy 0, policy_version 1926192 (0.0010) [2023-12-26 14:58:44,693][123090] Updated weights for policy 1, policy_version 1914115 (0.0009) [2023-12-26 14:58:44,748][123090] Updated weights for policy 1, policy_version 1914125 (0.0005) [2023-12-26 14:58:44,820][123090] Updated weights for policy 1, policy_version 1914135 (0.0007) [2023-12-26 14:58:45,455][123091] Updated weights for policy 0, policy_version 1926202 (0.0010) [2023-12-26 14:58:45,467][123090] Updated weights for policy 1, policy_version 1914145 (0.0005) [2023-12-26 14:58:45,531][123091] Updated weights for policy 0, policy_version 1926212 (0.0006) [2023-12-26 14:58:45,542][123090] Updated weights for policy 1, policy_version 1914155 (0.0008) [2023-12-26 14:58:45,594][123091] Updated weights for policy 0, policy_version 1926222 (0.0007) [2023-12-26 14:58:45,607][123090] Updated weights for policy 1, policy_version 1914165 (0.0011) [2023-12-26 14:58:45,674][123090] Updated weights for policy 1, policy_version 1914175 (0.0010) [2023-12-26 14:58:46,375][123091] Updated weights for policy 0, policy_version 1926232 (0.0010) [2023-12-26 14:58:46,426][123091] Updated weights for policy 0, policy_version 1926242 (0.0010) [2023-12-26 14:58:46,463][123090] Updated weights for policy 1, policy_version 1914185 (0.0010) [2023-12-26 14:58:46,470][123091] Updated weights for policy 0, policy_version 1926252 (0.0010) [2023-12-26 14:58:46,515][123090] Updated weights for policy 1, policy_version 1914195 (0.0010) [2023-12-26 14:58:46,565][123090] Updated weights for policy 1, policy_version 1914205 (0.0008) [2023-12-26 14:58:47,216][123091] Updated weights for policy 0, policy_version 1926262 (0.0011) [2023-12-26 14:58:47,275][123091] Updated weights for policy 0, policy_version 1926272 (0.0011) [2023-12-26 14:58:47,300][123090] Updated weights for policy 1, policy_version 1914215 (0.0009) [2023-12-26 14:58:47,332][123091] Updated weights for policy 0, policy_version 1926282 (0.0011) [2023-12-26 14:58:47,364][123090] Updated weights for policy 1, policy_version 1914225 (0.0011) [2023-12-26 14:58:47,427][123090] Updated weights for policy 1, policy_version 1914235 (0.0010) [2023-12-26 14:58:48,116][123091] Updated weights for policy 0, policy_version 1926292 (0.0010) [2023-12-26 14:58:48,169][123091] Updated weights for policy 0, policy_version 1926302 (0.0009) [2023-12-26 14:58:48,238][123091] Updated weights for policy 0, policy_version 1926312 (0.0008) [2023-12-26 14:58:48,248][123090] Updated weights for policy 1, policy_version 1914245 (0.0010) [2023-12-26 14:58:48,295][123090] Updated weights for policy 1, policy_version 1914255 (0.0010) [2023-12-26 14:58:48,361][123090] Updated weights for policy 1, policy_version 1914265 (0.0010) [2023-12-26 14:58:48,785][121949] Fps is (10 sec: 18021.7, 60 sec: 18158.8, 300 sec: 17772.4). Total num frames: 983195648. Throughput: 0: 8934.5, 1: 9219.2. Samples: 983206092. Policy #0 lag: (min: 31.0, avg: 38.2, max: 63.0) [2023-12-26 14:58:48,786][121949] Avg episode reward: [(0, '6288.204'), (1, '5622.413')] [2023-12-26 14:58:49,056][123091] Updated weights for policy 0, policy_version 1926322 (0.0007) [2023-12-26 14:58:49,099][123090] Updated weights for policy 1, policy_version 1914275 (0.0009) [2023-12-26 14:58:49,127][123091] Updated weights for policy 0, policy_version 1926332 (0.0011) [2023-12-26 14:58:49,168][123090] Updated weights for policy 1, policy_version 1914285 (0.0006) [2023-12-26 14:58:49,196][123091] Updated weights for policy 0, policy_version 1926342 (0.0011) [2023-12-26 14:58:49,244][123090] Updated weights for policy 1, policy_version 1914295 (0.0008) [2023-12-26 14:58:49,275][123091] Updated weights for policy 0, policy_version 1926352 (0.0011) [2023-12-26 14:58:50,047][123090] Updated weights for policy 1, policy_version 1914305 (0.0011) [2023-12-26 14:58:50,104][123091] Updated weights for policy 0, policy_version 1926362 (0.0011) [2023-12-26 14:58:50,107][123090] Updated weights for policy 1, policy_version 1914315 (0.0010) [2023-12-26 14:58:50,158][123090] Updated weights for policy 1, policy_version 1914325 (0.0010) [2023-12-26 14:58:50,167][123091] Updated weights for policy 0, policy_version 1926372 (0.0011) [2023-12-26 14:58:50,210][123090] Updated weights for policy 1, policy_version 1914335 (0.0010) [2023-12-26 14:58:50,231][123091] Updated weights for policy 0, policy_version 1926382 (0.0011) [2023-12-26 14:58:51,055][123091] Updated weights for policy 0, policy_version 1926392 (0.0011) [2023-12-26 14:58:51,070][123090] Updated weights for policy 1, policy_version 1914345 (0.0010) [2023-12-26 14:58:51,118][123091] Updated weights for policy 0, policy_version 1926402 (0.0010) [2023-12-26 14:58:51,132][123090] Updated weights for policy 1, policy_version 1914355 (0.0010) [2023-12-26 14:58:51,178][123091] Updated weights for policy 0, policy_version 1926412 (0.0011) [2023-12-26 14:58:51,192][123090] Updated weights for policy 1, policy_version 1914365 (0.0011) [2023-12-26 14:58:51,947][123091] Updated weights for policy 0, policy_version 1926422 (0.0009) [2023-12-26 14:58:52,008][123091] Updated weights for policy 0, policy_version 1926432 (0.0009) [2023-12-26 14:58:52,043][123090] Updated weights for policy 1, policy_version 1914375 (0.0009) [2023-12-26 14:58:52,057][123091] Updated weights for policy 0, policy_version 1926442 (0.0008) [2023-12-26 14:58:52,100][123090] Updated weights for policy 1, policy_version 1914385 (0.0008) [2023-12-26 14:58:52,157][123090] Updated weights for policy 1, policy_version 1914395 (0.0009) [2023-12-26 14:58:52,903][123091] Updated weights for policy 0, policy_version 1926452 (0.0009) [2023-12-26 14:58:52,960][123091] Updated weights for policy 0, policy_version 1926462 (0.0008) [2023-12-26 14:58:52,981][123090] Updated weights for policy 1, policy_version 1914405 (0.0009) [2023-12-26 14:58:53,022][123091] Updated weights for policy 0, policy_version 1926472 (0.0010) [2023-12-26 14:58:53,042][123090] Updated weights for policy 1, policy_version 1914415 (0.0008) [2023-12-26 14:58:53,093][123090] Updated weights for policy 1, policy_version 1914425 (0.0008) [2023-12-26 14:58:53,774][123091] Updated weights for policy 0, policy_version 1926482 (0.0007) [2023-12-26 14:58:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 983277568. Throughput: 0: 8882.6, 1: 9179.7. Samples: 983257660. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:58:53,785][121949] Avg episode reward: [(0, '6240.871'), (1, '5773.502')] [2023-12-26 14:58:53,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001914432_490094592.pth... [2023-12-26 14:58:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001913376_489824256.pth [2023-12-26 14:58:53,826][123091] Updated weights for policy 0, policy_version 1926492 (0.0005) [2023-12-26 14:58:53,888][123090] Updated weights for policy 1, policy_version 1914435 (0.0010) [2023-12-26 14:58:53,898][123091] Updated weights for policy 0, policy_version 1926502 (0.0007) [2023-12-26 14:58:53,941][123090] Updated weights for policy 1, policy_version 1914446 (0.0009) [2023-12-26 14:58:53,971][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001926512_493191168.pth... [2023-12-26 14:58:53,972][123091] Updated weights for policy 0, policy_version 1926512 (0.0006) [2023-12-26 14:58:53,976][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001925424_492912640.pth [2023-12-26 14:58:54,007][123090] Updated weights for policy 1, policy_version 1914456 (0.0010) [2023-12-26 14:58:54,729][123091] Updated weights for policy 0, policy_version 1926522 (0.0010) [2023-12-26 14:58:54,787][123091] Updated weights for policy 0, policy_version 1926532 (0.0009) [2023-12-26 14:58:54,798][123090] Updated weights for policy 1, policy_version 1914466 (0.0009) [2023-12-26 14:58:54,864][123090] Updated weights for policy 1, policy_version 1914476 (0.0009) [2023-12-26 14:58:54,867][123091] Updated weights for policy 0, policy_version 1926542 (0.0007) [2023-12-26 14:58:54,932][123090] Updated weights for policy 1, policy_version 1914486 (0.0011) [2023-12-26 14:58:54,995][123090] Updated weights for policy 1, policy_version 1914496 (0.0009) [2023-12-26 14:58:55,725][123090] Updated weights for policy 1, policy_version 1914506 (0.0007) [2023-12-26 14:58:55,758][123091] Updated weights for policy 0, policy_version 1926552 (0.0007) [2023-12-26 14:58:55,772][123090] Updated weights for policy 1, policy_version 1914516 (0.0010) [2023-12-26 14:58:55,814][123091] Updated weights for policy 0, policy_version 1926562 (0.0009) [2023-12-26 14:58:55,831][123090] Updated weights for policy 1, policy_version 1914526 (0.0011) [2023-12-26 14:58:55,862][123091] Updated weights for policy 0, policy_version 1926572 (0.0008) [2023-12-26 14:58:56,547][123090] Updated weights for policy 1, policy_version 1914536 (0.0010) [2023-12-26 14:58:56,594][123090] Updated weights for policy 1, policy_version 1914546 (0.0010) [2023-12-26 14:58:56,640][123090] Updated weights for policy 1, policy_version 1914556 (0.0007) [2023-12-26 14:58:56,765][123091] Updated weights for policy 0, policy_version 1926582 (0.0009) [2023-12-26 14:58:56,820][123091] Updated weights for policy 0, policy_version 1926592 (0.0010) [2023-12-26 14:58:56,874][123091] Updated weights for policy 0, policy_version 1926603 (0.0010) [2023-12-26 14:58:57,327][123090] Updated weights for policy 1, policy_version 1914566 (0.0005) [2023-12-26 14:58:57,384][123090] Updated weights for policy 1, policy_version 1914576 (0.0006) [2023-12-26 14:58:57,449][123090] Updated weights for policy 1, policy_version 1914586 (0.0005) [2023-12-26 14:58:57,558][123091] Updated weights for policy 0, policy_version 1926613 (0.0008) [2023-12-26 14:58:57,606][123091] Updated weights for policy 0, policy_version 1926623 (0.0005) [2023-12-26 14:58:57,671][123091] Updated weights for policy 0, policy_version 1926633 (0.0005) [2023-12-26 14:58:58,167][123090] Updated weights for policy 1, policy_version 1914596 (0.0006) [2023-12-26 14:58:58,230][123090] Updated weights for policy 1, policy_version 1914606 (0.0008) [2023-12-26 14:58:58,282][123090] Updated weights for policy 1, policy_version 1914616 (0.0008) [2023-12-26 14:58:58,443][123091] Updated weights for policy 0, policy_version 1926643 (0.0007) [2023-12-26 14:58:58,507][123091] Updated weights for policy 0, policy_version 1926653 (0.0009) [2023-12-26 14:58:58,573][123091] Updated weights for policy 0, policy_version 1926663 (0.0008) [2023-12-26 14:58:58,784][121949] Fps is (10 sec: 18023.2, 60 sec: 18159.0, 300 sec: 17800.3). Total num frames: 983375872. Throughput: 0: 8917.6, 1: 9243.7. Samples: 983366948. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:58:58,785][121949] Avg episode reward: [(0, '6153.133'), (1, '5886.920')] [2023-12-26 14:58:59,133][123090] Updated weights for policy 1, policy_version 1914626 (0.0007) [2023-12-26 14:58:59,187][123090] Updated weights for policy 1, policy_version 1914636 (0.0006) [2023-12-26 14:58:59,255][123090] Updated weights for policy 1, policy_version 1914646 (0.0010) [2023-12-26 14:58:59,317][123090] Updated weights for policy 1, policy_version 1914656 (0.0009) [2023-12-26 14:58:59,391][123091] Updated weights for policy 0, policy_version 1926673 (0.0008) [2023-12-26 14:58:59,449][123091] Updated weights for policy 0, policy_version 1926683 (0.0009) [2023-12-26 14:58:59,502][123091] Updated weights for policy 0, policy_version 1926693 (0.0009) [2023-12-26 14:58:59,559][123091] Updated weights for policy 0, policy_version 1926703 (0.0006) [2023-12-26 14:59:00,157][123090] Updated weights for policy 1, policy_version 1914666 (0.0010) [2023-12-26 14:59:00,223][123090] Updated weights for policy 1, policy_version 1914676 (0.0010) [2023-12-26 14:59:00,282][123090] Updated weights for policy 1, policy_version 1914686 (0.0010) [2023-12-26 14:59:00,377][123091] Updated weights for policy 0, policy_version 1926713 (0.0008) [2023-12-26 14:59:00,432][123091] Updated weights for policy 0, policy_version 1926723 (0.0009) [2023-12-26 14:59:00,484][123091] Updated weights for policy 0, policy_version 1926733 (0.0009) [2023-12-26 14:59:01,062][123090] Updated weights for policy 1, policy_version 1914696 (0.0009) [2023-12-26 14:59:01,122][123090] Updated weights for policy 1, policy_version 1914706 (0.0010) [2023-12-26 14:59:01,190][123090] Updated weights for policy 1, policy_version 1914716 (0.0008) [2023-12-26 14:59:01,356][123091] Updated weights for policy 0, policy_version 1926743 (0.0009) [2023-12-26 14:59:01,431][123091] Updated weights for policy 0, policy_version 1926753 (0.0009) [2023-12-26 14:59:01,484][123091] Updated weights for policy 0, policy_version 1926763 (0.0010) [2023-12-26 14:59:01,992][123090] Updated weights for policy 1, policy_version 1914726 (0.0009) [2023-12-26 14:59:02,051][123090] Updated weights for policy 1, policy_version 1914736 (0.0008) [2023-12-26 14:59:02,119][123090] Updated weights for policy 1, policy_version 1914746 (0.0009) [2023-12-26 14:59:02,323][123091] Updated weights for policy 0, policy_version 1926773 (0.0009) [2023-12-26 14:59:02,395][123091] Updated weights for policy 0, policy_version 1926783 (0.0009) [2023-12-26 14:59:02,467][123091] Updated weights for policy 0, policy_version 1926793 (0.0006) [2023-12-26 14:59:02,884][123090] Updated weights for policy 1, policy_version 1914756 (0.0007) [2023-12-26 14:59:02,945][123090] Updated weights for policy 1, policy_version 1914766 (0.0007) [2023-12-26 14:59:03,004][123090] Updated weights for policy 1, policy_version 1914776 (0.0009) [2023-12-26 14:59:03,113][123091] Updated weights for policy 0, policy_version 1926803 (0.0007) [2023-12-26 14:59:03,174][123091] Updated weights for policy 0, policy_version 1926813 (0.0005) [2023-12-26 14:59:03,226][123091] Updated weights for policy 0, policy_version 1926823 (0.0005) [2023-12-26 14:59:03,782][123091] Updated weights for policy 0, policy_version 1926833 (0.0005) [2023-12-26 14:59:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 983457792. Throughput: 0: 8970.7, 1: 9135.4. Samples: 983473752. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:03,785][121949] Avg episode reward: [(0, '6141.465'), (1, '5816.831')] [2023-12-26 14:59:03,841][123091] Updated weights for policy 0, policy_version 1926843 (0.0006) [2023-12-26 14:59:03,894][123090] Updated weights for policy 1, policy_version 1914786 (0.0010) [2023-12-26 14:59:03,901][123091] Updated weights for policy 0, policy_version 1926853 (0.0008) [2023-12-26 14:59:03,950][123090] Updated weights for policy 1, policy_version 1914796 (0.0007) [2023-12-26 14:59:03,962][123091] Updated weights for policy 0, policy_version 1926863 (0.0008) [2023-12-26 14:59:04,009][123090] Updated weights for policy 1, policy_version 1914806 (0.0006) [2023-12-26 14:59:04,066][123090] Updated weights for policy 1, policy_version 1914816 (0.0006) [2023-12-26 14:59:04,821][123090] Updated weights for policy 1, policy_version 1914826 (0.0009) [2023-12-26 14:59:04,866][123091] Updated weights for policy 0, policy_version 1926873 (0.0010) [2023-12-26 14:59:04,881][123090] Updated weights for policy 1, policy_version 1914836 (0.0006) [2023-12-26 14:59:04,925][123091] Updated weights for policy 0, policy_version 1926883 (0.0010) [2023-12-26 14:59:04,943][123090] Updated weights for policy 1, policy_version 1914846 (0.0006) [2023-12-26 14:59:04,990][123091] Updated weights for policy 0, policy_version 1926893 (0.0005) [2023-12-26 14:59:05,635][123090] Updated weights for policy 1, policy_version 1914856 (0.0005) [2023-12-26 14:59:05,695][123090] Updated weights for policy 1, policy_version 1914866 (0.0005) [2023-12-26 14:59:05,717][123091] Updated weights for policy 0, policy_version 1926903 (0.0008) [2023-12-26 14:59:05,767][123090] Updated weights for policy 1, policy_version 1914876 (0.0005) [2023-12-26 14:59:05,767][123091] Updated weights for policy 0, policy_version 1926913 (0.0009) [2023-12-26 14:59:05,816][123091] Updated weights for policy 0, policy_version 1926923 (0.0009) [2023-12-26 14:59:06,451][123090] Updated weights for policy 1, policy_version 1914886 (0.0007) [2023-12-26 14:59:06,517][123090] Updated weights for policy 1, policy_version 1914896 (0.0008) [2023-12-26 14:59:06,585][123090] Updated weights for policy 1, policy_version 1914906 (0.0008) [2023-12-26 14:59:06,636][123091] Updated weights for policy 0, policy_version 1926934 (0.0010) [2023-12-26 14:59:06,696][123091] Updated weights for policy 0, policy_version 1926944 (0.0011) [2023-12-26 14:59:06,753][123091] Updated weights for policy 0, policy_version 1926954 (0.0010) [2023-12-26 14:59:07,313][123090] Updated weights for policy 1, policy_version 1914916 (0.0007) [2023-12-26 14:59:07,369][123090] Updated weights for policy 1, policy_version 1914926 (0.0005) [2023-12-26 14:59:07,420][123090] Updated weights for policy 1, policy_version 1914936 (0.0005) [2023-12-26 14:59:07,609][123091] Updated weights for policy 0, policy_version 1926964 (0.0011) [2023-12-26 14:59:07,667][123091] Updated weights for policy 0, policy_version 1926974 (0.0010) [2023-12-26 14:59:07,734][123091] Updated weights for policy 0, policy_version 1926984 (0.0010) [2023-12-26 14:59:08,022][123090] Updated weights for policy 1, policy_version 1914946 (0.0006) [2023-12-26 14:59:08,080][123090] Updated weights for policy 1, policy_version 1914956 (0.0007) [2023-12-26 14:59:08,134][123090] Updated weights for policy 1, policy_version 1914966 (0.0010) [2023-12-26 14:59:08,192][123090] Updated weights for policy 1, policy_version 1914976 (0.0010) [2023-12-26 14:59:08,569][123091] Updated weights for policy 0, policy_version 1926994 (0.0009) [2023-12-26 14:59:08,637][123091] Updated weights for policy 0, policy_version 1927004 (0.0008) [2023-12-26 14:59:08,701][123091] Updated weights for policy 0, policy_version 1927014 (0.0007) [2023-12-26 14:59:08,759][123091] Updated weights for policy 0, policy_version 1927024 (0.0005) [2023-12-26 14:59:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 983556096. Throughput: 0: 8995.9, 1: 9148.4. Samples: 983528344. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:08,785][121949] Avg episode reward: [(0, '6228.663'), (1, '5865.000')] [2023-12-26 14:59:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001927024_493322240.pth... [2023-12-26 14:59:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001914976_490233856.pth... [2023-12-26 14:59:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001926000_493060096.pth [2023-12-26 14:59:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001913920_489963520.pth [2023-12-26 14:59:08,964][123090] Updated weights for policy 1, policy_version 1914986 (0.0006) [2023-12-26 14:59:09,020][123090] Updated weights for policy 1, policy_version 1914996 (0.0005) [2023-12-26 14:59:09,086][123090] Updated weights for policy 1, policy_version 1915006 (0.0006) [2023-12-26 14:59:09,499][123091] Updated weights for policy 0, policy_version 1927034 (0.0009) [2023-12-26 14:59:09,570][123091] Updated weights for policy 0, policy_version 1927044 (0.0011) [2023-12-26 14:59:09,637][123091] Updated weights for policy 0, policy_version 1927054 (0.0008) [2023-12-26 14:59:09,868][123090] Updated weights for policy 1, policy_version 1915016 (0.0007) [2023-12-26 14:59:09,920][123090] Updated weights for policy 1, policy_version 1915026 (0.0005) [2023-12-26 14:59:09,992][123090] Updated weights for policy 1, policy_version 1915036 (0.0010) [2023-12-26 14:59:10,393][123091] Updated weights for policy 0, policy_version 1927064 (0.0010) [2023-12-26 14:59:10,449][123091] Updated weights for policy 0, policy_version 1927074 (0.0010) [2023-12-26 14:59:10,523][123091] Updated weights for policy 0, policy_version 1927084 (0.0008) [2023-12-26 14:59:10,759][123090] Updated weights for policy 1, policy_version 1915046 (0.0010) [2023-12-26 14:59:10,826][123090] Updated weights for policy 1, policy_version 1915056 (0.0008) [2023-12-26 14:59:10,886][123090] Updated weights for policy 1, policy_version 1915066 (0.0005) [2023-12-26 14:59:11,326][123091] Updated weights for policy 0, policy_version 1927094 (0.0009) [2023-12-26 14:59:11,394][123091] Updated weights for policy 0, policy_version 1927104 (0.0010) [2023-12-26 14:59:11,454][123091] Updated weights for policy 0, policy_version 1927114 (0.0009) [2023-12-26 14:59:11,718][123090] Updated weights for policy 1, policy_version 1915076 (0.0009) [2023-12-26 14:59:11,804][123090] Updated weights for policy 1, policy_version 1915086 (0.0009) [2023-12-26 14:59:11,873][123090] Updated weights for policy 1, policy_version 1915096 (0.0010) [2023-12-26 14:59:12,296][123091] Updated weights for policy 0, policy_version 1927124 (0.0010) [2023-12-26 14:59:12,366][123091] Updated weights for policy 0, policy_version 1927134 (0.0011) [2023-12-26 14:59:12,430][123091] Updated weights for policy 0, policy_version 1927144 (0.0011) [2023-12-26 14:59:12,701][123090] Updated weights for policy 1, policy_version 1915106 (0.0007) [2023-12-26 14:59:12,762][123090] Updated weights for policy 1, policy_version 1915116 (0.0009) [2023-12-26 14:59:12,829][123090] Updated weights for policy 1, policy_version 1915126 (0.0010) [2023-12-26 14:59:12,898][123090] Updated weights for policy 1, policy_version 1915136 (0.0009) [2023-12-26 14:59:13,241][123091] Updated weights for policy 0, policy_version 1927154 (0.0010) [2023-12-26 14:59:13,302][123091] Updated weights for policy 0, policy_version 1927164 (0.0010) [2023-12-26 14:59:13,354][123091] Updated weights for policy 0, policy_version 1927175 (0.0010) [2023-12-26 14:59:13,709][123090] Updated weights for policy 1, policy_version 1915146 (0.0010) [2023-12-26 14:59:13,757][123090] Updated weights for policy 1, policy_version 1915156 (0.0009) [2023-12-26 14:59:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 983638016. Throughput: 0: 8866.4, 1: 9150.3. Samples: 983635184. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:13,785][121949] Avg episode reward: [(0, '6305.966'), (1, '5880.833')] [2023-12-26 14:59:13,812][123090] Updated weights for policy 1, policy_version 1915166 (0.0009) [2023-12-26 14:59:14,194][123091] Updated weights for policy 0, policy_version 1927185 (0.0009) [2023-12-26 14:59:14,254][123091] Updated weights for policy 0, policy_version 1927195 (0.0009) [2023-12-26 14:59:14,312][123091] Updated weights for policy 0, policy_version 1927205 (0.0009) [2023-12-26 14:59:14,374][123091] Updated weights for policy 0, policy_version 1927215 (0.0009) [2023-12-26 14:59:14,616][123090] Updated weights for policy 1, policy_version 1915176 (0.0008) [2023-12-26 14:59:14,668][123090] Updated weights for policy 1, policy_version 1915186 (0.0009) [2023-12-26 14:59:14,718][123090] Updated weights for policy 1, policy_version 1915197 (0.0009) [2023-12-26 14:59:15,267][123091] Updated weights for policy 0, policy_version 1927225 (0.0009) [2023-12-26 14:59:15,334][123091] Updated weights for policy 0, policy_version 1927236 (0.0010) [2023-12-26 14:59:15,394][123091] Updated weights for policy 0, policy_version 1927246 (0.0009) [2023-12-26 14:59:15,577][123090] Updated weights for policy 1, policy_version 1915207 (0.0007) [2023-12-26 14:59:15,638][123090] Updated weights for policy 1, policy_version 1915217 (0.0007) [2023-12-26 14:59:15,715][123090] Updated weights for policy 1, policy_version 1915227 (0.0010) [2023-12-26 14:59:16,086][123091] Updated weights for policy 0, policy_version 1927256 (0.0006) [2023-12-26 14:59:16,137][123091] Updated weights for policy 0, policy_version 1927266 (0.0008) [2023-12-26 14:59:16,185][123091] Updated weights for policy 0, policy_version 1927276 (0.0009) [2023-12-26 14:59:16,433][123090] Updated weights for policy 1, policy_version 1915237 (0.0008) [2023-12-26 14:59:16,488][123090] Updated weights for policy 1, policy_version 1915247 (0.0010) [2023-12-26 14:59:16,536][123090] Updated weights for policy 1, policy_version 1915257 (0.0010) [2023-12-26 14:59:16,922][123091] Updated weights for policy 0, policy_version 1927286 (0.0007) [2023-12-26 14:59:16,989][123091] Updated weights for policy 0, policy_version 1927296 (0.0007) [2023-12-26 14:59:17,062][123091] Updated weights for policy 0, policy_version 1927306 (0.0005) [2023-12-26 14:59:17,391][123090] Updated weights for policy 1, policy_version 1915267 (0.0010) [2023-12-26 14:59:17,446][123090] Updated weights for policy 1, policy_version 1915277 (0.0010) [2023-12-26 14:59:17,497][123090] Updated weights for policy 1, policy_version 1915287 (0.0010) [2023-12-26 14:59:17,756][123091] Updated weights for policy 0, policy_version 1927316 (0.0007) [2023-12-26 14:59:17,804][123091] Updated weights for policy 0, policy_version 1927326 (0.0009) [2023-12-26 14:59:17,858][123091] Updated weights for policy 0, policy_version 1927336 (0.0009) [2023-12-26 14:59:18,334][123090] Updated weights for policy 1, policy_version 1915297 (0.0010) [2023-12-26 14:59:18,402][123090] Updated weights for policy 1, policy_version 1915307 (0.0008) [2023-12-26 14:59:18,465][123090] Updated weights for policy 1, policy_version 1915317 (0.0011) [2023-12-26 14:59:18,532][123090] Updated weights for policy 1, policy_version 1915327 (0.0011) [2023-12-26 14:59:18,653][123091] Updated weights for policy 0, policy_version 1927346 (0.0009) [2023-12-26 14:59:18,728][123091] Updated weights for policy 0, policy_version 1927356 (0.0010) [2023-12-26 14:59:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 983728128. Throughput: 0: 8808.3, 1: 8997.0. Samples: 983741876. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:18,784][123091] Updated weights for policy 0, policy_version 1927366 (0.0011) [2023-12-26 14:59:18,785][121949] Avg episode reward: [(0, '6336.772'), (1, '5759.279')] [2023-12-26 14:59:18,838][123091] Updated weights for policy 0, policy_version 1927376 (0.0009) [2023-12-26 14:59:19,344][123090] Updated weights for policy 1, policy_version 1915337 (0.0007) [2023-12-26 14:59:19,414][123090] Updated weights for policy 1, policy_version 1915347 (0.0008) [2023-12-26 14:59:19,485][123090] Updated weights for policy 1, policy_version 1915357 (0.0009) [2023-12-26 14:59:19,563][123091] Updated weights for policy 0, policy_version 1927386 (0.0009) [2023-12-26 14:59:19,633][123091] Updated weights for policy 0, policy_version 1927396 (0.0009) [2023-12-26 14:59:19,698][123091] Updated weights for policy 0, policy_version 1927406 (0.0009) [2023-12-26 14:59:20,348][123090] Updated weights for policy 1, policy_version 1915367 (0.0009) [2023-12-26 14:59:20,411][123090] Updated weights for policy 1, policy_version 1915377 (0.0009) [2023-12-26 14:59:20,473][123090] Updated weights for policy 1, policy_version 1915387 (0.0008) [2023-12-26 14:59:20,611][123091] Updated weights for policy 0, policy_version 1927416 (0.0008) [2023-12-26 14:59:20,681][123091] Updated weights for policy 0, policy_version 1927426 (0.0006) [2023-12-26 14:59:20,752][123091] Updated weights for policy 0, policy_version 1927436 (0.0006) [2023-12-26 14:59:21,282][123090] Updated weights for policy 1, policy_version 1915397 (0.0007) [2023-12-26 14:59:21,351][123090] Updated weights for policy 1, policy_version 1915407 (0.0006) [2023-12-26 14:59:21,422][123090] Updated weights for policy 1, policy_version 1915417 (0.0008) [2023-12-26 14:59:21,490][123091] Updated weights for policy 0, policy_version 1927446 (0.0008) [2023-12-26 14:59:21,560][123091] Updated weights for policy 0, policy_version 1927456 (0.0010) [2023-12-26 14:59:21,628][123091] Updated weights for policy 0, policy_version 1927466 (0.0010) [2023-12-26 14:59:22,278][123090] Updated weights for policy 1, policy_version 1915427 (0.0009) [2023-12-26 14:59:22,352][123090] Updated weights for policy 1, policy_version 1915437 (0.0008) [2023-12-26 14:59:22,412][123090] Updated weights for policy 1, policy_version 1915447 (0.0008) [2023-12-26 14:59:22,433][123091] Updated weights for policy 0, policy_version 1927476 (0.0010) [2023-12-26 14:59:22,493][123091] Updated weights for policy 0, policy_version 1927486 (0.0008) [2023-12-26 14:59:22,563][123091] Updated weights for policy 0, policy_version 1927496 (0.0008) [2023-12-26 14:59:23,184][123090] Updated weights for policy 1, policy_version 1915457 (0.0008) [2023-12-26 14:59:23,245][123090] Updated weights for policy 1, policy_version 1915467 (0.0009) [2023-12-26 14:59:23,303][123090] Updated weights for policy 1, policy_version 1915477 (0.0009) [2023-12-26 14:59:23,353][123090] Updated weights for policy 1, policy_version 1915487 (0.0009) [2023-12-26 14:59:23,364][123091] Updated weights for policy 0, policy_version 1927506 (0.0009) [2023-12-26 14:59:23,416][123091] Updated weights for policy 0, policy_version 1927516 (0.0010) [2023-12-26 14:59:23,471][123091] Updated weights for policy 0, policy_version 1927526 (0.0010) [2023-12-26 14:59:23,519][123091] Updated weights for policy 0, policy_version 1927536 (0.0010) [2023-12-26 14:59:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 983818240. Throughput: 0: 8831.5, 1: 8925.2. Samples: 983793092. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:23,785][121949] Avg episode reward: [(0, '6293.014'), (1, '5662.560')] [2023-12-26 14:59:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001915488_490364928.pth... [2023-12-26 14:59:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001927536_493453312.pth... [2023-12-26 14:59:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001914432_490094592.pth [2023-12-26 14:59:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001926512_493191168.pth [2023-12-26 14:59:24,225][123090] Updated weights for policy 1, policy_version 1915497 (0.0009) [2023-12-26 14:59:24,288][123090] Updated weights for policy 1, policy_version 1915507 (0.0010) [2023-12-26 14:59:24,330][123091] Updated weights for policy 0, policy_version 1927546 (0.0009) [2023-12-26 14:59:24,349][123090] Updated weights for policy 1, policy_version 1915517 (0.0008) [2023-12-26 14:59:24,383][123091] Updated weights for policy 0, policy_version 1927556 (0.0006) [2023-12-26 14:59:24,441][123091] Updated weights for policy 0, policy_version 1927566 (0.0005) [2023-12-26 14:59:25,228][123090] Updated weights for policy 1, policy_version 1915527 (0.0009) [2023-12-26 14:59:25,231][123091] Updated weights for policy 0, policy_version 1927576 (0.0005) [2023-12-26 14:59:25,286][123091] Updated weights for policy 0, policy_version 1927586 (0.0006) [2023-12-26 14:59:25,291][123090] Updated weights for policy 1, policy_version 1915537 (0.0008) [2023-12-26 14:59:25,345][123091] Updated weights for policy 0, policy_version 1927596 (0.0006) [2023-12-26 14:59:25,355][123090] Updated weights for policy 1, policy_version 1915547 (0.0005) [2023-12-26 14:59:25,985][123091] Updated weights for policy 0, policy_version 1927606 (0.0008) [2023-12-26 14:59:25,988][123090] Updated weights for policy 1, policy_version 1915557 (0.0005) [2023-12-26 14:59:26,038][123090] Updated weights for policy 1, policy_version 1915567 (0.0006) [2023-12-26 14:59:26,054][123091] Updated weights for policy 0, policy_version 1927616 (0.0006) [2023-12-26 14:59:26,091][123090] Updated weights for policy 1, policy_version 1915577 (0.0008) [2023-12-26 14:59:26,103][123091] Updated weights for policy 0, policy_version 1927626 (0.0007) [2023-12-26 14:59:26,815][123091] Updated weights for policy 0, policy_version 1927636 (0.0008) [2023-12-26 14:59:26,862][123091] Updated weights for policy 0, policy_version 1927646 (0.0005) [2023-12-26 14:59:26,904][123090] Updated weights for policy 1, policy_version 1915587 (0.0008) [2023-12-26 14:59:26,910][123091] Updated weights for policy 0, policy_version 1927656 (0.0005) [2023-12-26 14:59:26,950][123090] Updated weights for policy 1, policy_version 1915597 (0.0005) [2023-12-26 14:59:27,007][123090] Updated weights for policy 1, policy_version 1915607 (0.0005) [2023-12-26 14:59:27,661][123091] Updated weights for policy 0, policy_version 1927666 (0.0006) [2023-12-26 14:59:27,716][123091] Updated weights for policy 0, policy_version 1927676 (0.0009) [2023-12-26 14:59:27,769][123091] Updated weights for policy 0, policy_version 1927686 (0.0005) [2023-12-26 14:59:27,825][123091] Updated weights for policy 0, policy_version 1927696 (0.0009) [2023-12-26 14:59:27,834][123090] Updated weights for policy 1, policy_version 1915617 (0.0008) [2023-12-26 14:59:27,893][123090] Updated weights for policy 1, policy_version 1915627 (0.0008) [2023-12-26 14:59:27,950][123090] Updated weights for policy 1, policy_version 1915637 (0.0009) [2023-12-26 14:59:27,998][123090] Updated weights for policy 1, policy_version 1915647 (0.0009) [2023-12-26 14:59:28,586][123091] Updated weights for policy 0, policy_version 1927706 (0.0009) [2023-12-26 14:59:28,636][123091] Updated weights for policy 0, policy_version 1927716 (0.0009) [2023-12-26 14:59:28,694][123091] Updated weights for policy 0, policy_version 1927726 (0.0009) [2023-12-26 14:59:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.3). Total num frames: 983908352. Throughput: 0: 8941.0, 1: 8924.5. Samples: 983902016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:28,785][121949] Avg episode reward: [(0, '6358.352'), (1, '5789.906')] [2023-12-26 14:59:28,877][123090] Updated weights for policy 1, policy_version 1915657 (0.0009) [2023-12-26 14:59:28,946][123090] Updated weights for policy 1, policy_version 1915667 (0.0009) [2023-12-26 14:59:28,999][123090] Updated weights for policy 1, policy_version 1915677 (0.0010) [2023-12-26 14:59:29,504][123091] Updated weights for policy 0, policy_version 1927736 (0.0010) [2023-12-26 14:59:29,557][123091] Updated weights for policy 0, policy_version 1927746 (0.0009) [2023-12-26 14:59:29,611][123091] Updated weights for policy 0, policy_version 1927756 (0.0010) [2023-12-26 14:59:29,822][123090] Updated weights for policy 1, policy_version 1915688 (0.0008) [2023-12-26 14:59:29,890][123090] Updated weights for policy 1, policy_version 1915698 (0.0010) [2023-12-26 14:59:29,958][123090] Updated weights for policy 1, policy_version 1915708 (0.0009) [2023-12-26 14:59:30,472][123091] Updated weights for policy 0, policy_version 1927766 (0.0009) [2023-12-26 14:59:30,532][123091] Updated weights for policy 0, policy_version 1927776 (0.0009) [2023-12-26 14:59:30,583][123091] Updated weights for policy 0, policy_version 1927787 (0.0010) [2023-12-26 14:59:30,796][123090] Updated weights for policy 1, policy_version 1915718 (0.0009) [2023-12-26 14:59:30,850][123090] Updated weights for policy 1, policy_version 1915728 (0.0009) [2023-12-26 14:59:30,908][123090] Updated weights for policy 1, policy_version 1915738 (0.0010) [2023-12-26 14:59:31,483][123091] Updated weights for policy 0, policy_version 1927797 (0.0009) [2023-12-26 14:59:31,542][123091] Updated weights for policy 0, policy_version 1927807 (0.0010) [2023-12-26 14:59:31,606][123091] Updated weights for policy 0, policy_version 1927817 (0.0010) [2023-12-26 14:59:31,683][123090] Updated weights for policy 1, policy_version 1915748 (0.0009) [2023-12-26 14:59:31,757][123090] Updated weights for policy 1, policy_version 1915758 (0.0012) [2023-12-26 14:59:31,816][123090] Updated weights for policy 1, policy_version 1915768 (0.0010) [2023-12-26 14:59:32,499][123091] Updated weights for policy 0, policy_version 1927827 (0.0009) [2023-12-26 14:59:32,505][123090] Updated weights for policy 1, policy_version 1915778 (0.0009) [2023-12-26 14:59:32,560][123091] Updated weights for policy 0, policy_version 1927837 (0.0009) [2023-12-26 14:59:32,569][123090] Updated weights for policy 1, policy_version 1915788 (0.0005) [2023-12-26 14:59:32,627][123091] Updated weights for policy 0, policy_version 1927847 (0.0009) [2023-12-26 14:59:32,637][123090] Updated weights for policy 1, policy_version 1915798 (0.0005) [2023-12-26 14:59:32,700][123090] Updated weights for policy 1, policy_version 1915808 (0.0006) [2023-12-26 14:59:33,457][123090] Updated weights for policy 1, policy_version 1915818 (0.0009) [2023-12-26 14:59:33,473][123091] Updated weights for policy 0, policy_version 1927857 (0.0008) [2023-12-26 14:59:33,505][123090] Updated weights for policy 1, policy_version 1915828 (0.0007) [2023-12-26 14:59:33,519][123091] Updated weights for policy 0, policy_version 1927867 (0.0008) [2023-12-26 14:59:33,562][123090] Updated weights for policy 1, policy_version 1915838 (0.0008) [2023-12-26 14:59:33,569][123091] Updated weights for policy 0, policy_version 1927877 (0.0009) [2023-12-26 14:59:33,620][123091] Updated weights for policy 0, policy_version 1927887 (0.0009) [2023-12-26 14:59:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 983998464. Throughput: 0: 8861.5, 1: 8899.7. Samples: 984005340. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:33,785][121949] Avg episode reward: [(0, '6364.935'), (1, '5877.764')] [2023-12-26 14:59:34,378][123090] Updated weights for policy 1, policy_version 1915848 (0.0007) [2023-12-26 14:59:34,444][123090] Updated weights for policy 1, policy_version 1915858 (0.0009) [2023-12-26 14:59:34,503][123091] Updated weights for policy 0, policy_version 1927897 (0.0010) [2023-12-26 14:59:34,510][123090] Updated weights for policy 1, policy_version 1915868 (0.0009) [2023-12-26 14:59:34,555][123091] Updated weights for policy 0, policy_version 1927907 (0.0008) [2023-12-26 14:59:34,611][123091] Updated weights for policy 0, policy_version 1927918 (0.0007) [2023-12-26 14:59:35,342][123090] Updated weights for policy 1, policy_version 1915878 (0.0008) [2023-12-26 14:59:35,388][123091] Updated weights for policy 0, policy_version 1927928 (0.0009) [2023-12-26 14:59:35,403][123090] Updated weights for policy 1, policy_version 1915888 (0.0007) [2023-12-26 14:59:35,451][123091] Updated weights for policy 0, policy_version 1927938 (0.0011) [2023-12-26 14:59:35,462][123090] Updated weights for policy 1, policy_version 1915898 (0.0006) [2023-12-26 14:59:35,499][123091] Updated weights for policy 0, policy_version 1927948 (0.0010) [2023-12-26 14:59:36,139][123090] Updated weights for policy 1, policy_version 1915908 (0.0008) [2023-12-26 14:59:36,199][123090] Updated weights for policy 1, policy_version 1915918 (0.0009) [2023-12-26 14:59:36,264][123090] Updated weights for policy 1, policy_version 1915928 (0.0009) [2023-12-26 14:59:36,355][123091] Updated weights for policy 0, policy_version 1927958 (0.0010) [2023-12-26 14:59:36,404][123091] Updated weights for policy 0, policy_version 1927968 (0.0011) [2023-12-26 14:59:36,457][123091] Updated weights for policy 0, policy_version 1927978 (0.0008) [2023-12-26 14:59:37,163][123090] Updated weights for policy 1, policy_version 1915938 (0.0008) [2023-12-26 14:59:37,239][123090] Updated weights for policy 1, policy_version 1915948 (0.0005) [2023-12-26 14:59:37,247][123091] Updated weights for policy 0, policy_version 1927988 (0.0008) [2023-12-26 14:59:37,298][123091] Updated weights for policy 0, policy_version 1927998 (0.0009) [2023-12-26 14:59:37,308][123090] Updated weights for policy 1, policy_version 1915958 (0.0005) [2023-12-26 14:59:37,363][123091] Updated weights for policy 0, policy_version 1928008 (0.0005) [2023-12-26 14:59:37,386][123090] Updated weights for policy 1, policy_version 1915968 (0.0005) [2023-12-26 14:59:37,978][123090] Updated weights for policy 1, policy_version 1915978 (0.0009) [2023-12-26 14:59:38,044][123090] Updated weights for policy 1, policy_version 1915988 (0.0009) [2023-12-26 14:59:38,103][123090] Updated weights for policy 1, policy_version 1915998 (0.0010) [2023-12-26 14:59:38,118][123091] Updated weights for policy 0, policy_version 1928018 (0.0005) [2023-12-26 14:59:38,167][123091] Updated weights for policy 0, policy_version 1928028 (0.0005) [2023-12-26 14:59:38,220][123091] Updated weights for policy 0, policy_version 1928038 (0.0005) [2023-12-26 14:59:38,271][123091] Updated weights for policy 0, policy_version 1928048 (0.0006) [2023-12-26 14:59:38,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 984080384. Throughput: 0: 8867.5, 1: 8924.9. Samples: 984058316. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:38,785][121949] Avg episode reward: [(0, '6327.092'), (1, '5797.414')] [2023-12-26 14:59:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001928048_493584384.pth... [2023-12-26 14:59:38,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001916000_490496000.pth... [2023-12-26 14:59:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001927024_493322240.pth [2023-12-26 14:59:38,802][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001914976_490233856.pth [2023-12-26 14:59:38,953][123090] Updated weights for policy 1, policy_version 1916008 (0.0007) [2023-12-26 14:59:38,960][123091] Updated weights for policy 0, policy_version 1928058 (0.0008) [2023-12-26 14:59:39,015][123090] Updated weights for policy 1, policy_version 1916018 (0.0007) [2023-12-26 14:59:39,027][123091] Updated weights for policy 0, policy_version 1928068 (0.0011) [2023-12-26 14:59:39,077][123090] Updated weights for policy 1, policy_version 1916028 (0.0009) [2023-12-26 14:59:39,080][123091] Updated weights for policy 0, policy_version 1928078 (0.0010) [2023-12-26 14:59:39,876][123091] Updated weights for policy 0, policy_version 1928088 (0.0008) [2023-12-26 14:59:39,942][123090] Updated weights for policy 1, policy_version 1916038 (0.0008) [2023-12-26 14:59:39,944][123091] Updated weights for policy 0, policy_version 1928098 (0.0007) [2023-12-26 14:59:40,001][123091] Updated weights for policy 0, policy_version 1928108 (0.0006) [2023-12-26 14:59:40,008][123090] Updated weights for policy 1, policy_version 1916048 (0.0006) [2023-12-26 14:59:40,073][123090] Updated weights for policy 1, policy_version 1916058 (0.0005) [2023-12-26 14:59:40,714][123091] Updated weights for policy 0, policy_version 1928118 (0.0006) [2023-12-26 14:59:40,769][123091] Updated weights for policy 0, policy_version 1928128 (0.0006) [2023-12-26 14:59:40,788][123090] Updated weights for policy 1, policy_version 1916068 (0.0006) [2023-12-26 14:59:40,816][123091] Updated weights for policy 0, policy_version 1928138 (0.0005) [2023-12-26 14:59:40,867][123090] Updated weights for policy 1, policy_version 1916078 (0.0005) [2023-12-26 14:59:40,943][123090] Updated weights for policy 1, policy_version 1916088 (0.0008) [2023-12-26 14:59:41,575][123091] Updated weights for policy 0, policy_version 1928148 (0.0008) [2023-12-26 14:59:41,638][123091] Updated weights for policy 0, policy_version 1928158 (0.0008) [2023-12-26 14:59:41,697][123090] Updated weights for policy 1, policy_version 1916098 (0.0010) [2023-12-26 14:59:41,706][123091] Updated weights for policy 0, policy_version 1928168 (0.0010) [2023-12-26 14:59:41,760][123090] Updated weights for policy 1, policy_version 1916108 (0.0007) [2023-12-26 14:59:41,825][123090] Updated weights for policy 1, policy_version 1916118 (0.0005) [2023-12-26 14:59:41,896][123090] Updated weights for policy 1, policy_version 1916128 (0.0005) [2023-12-26 14:59:42,565][123091] Updated weights for policy 0, policy_version 1928178 (0.0011) [2023-12-26 14:59:42,586][123090] Updated weights for policy 1, policy_version 1916138 (0.0009) [2023-12-26 14:59:42,627][123091] Updated weights for policy 0, policy_version 1928188 (0.0008) [2023-12-26 14:59:42,647][123090] Updated weights for policy 1, policy_version 1916148 (0.0008) [2023-12-26 14:59:42,676][123091] Updated weights for policy 0, policy_version 1928198 (0.0007) [2023-12-26 14:59:42,703][123090] Updated weights for policy 1, policy_version 1916158 (0.0009) [2023-12-26 14:59:42,736][123091] Updated weights for policy 0, policy_version 1928208 (0.0008) [2023-12-26 14:59:43,363][123090] Updated weights for policy 1, policy_version 1916168 (0.0006) [2023-12-26 14:59:43,424][123090] Updated weights for policy 1, policy_version 1916178 (0.0009) [2023-12-26 14:59:43,482][123090] Updated weights for policy 1, policy_version 1916188 (0.0010) [2023-12-26 14:59:43,580][123091] Updated weights for policy 0, policy_version 1928218 (0.0008) [2023-12-26 14:59:43,648][123091] Updated weights for policy 0, policy_version 1928228 (0.0005) [2023-12-26 14:59:43,716][123091] Updated weights for policy 0, policy_version 1928238 (0.0009) [2023-12-26 14:59:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 984178688. Throughput: 0: 8921.7, 1: 8858.7. Samples: 984167064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:43,785][121949] Avg episode reward: [(0, '6261.153'), (1, '5797.384')] [2023-12-26 14:59:44,325][123090] Updated weights for policy 1, policy_version 1916198 (0.0009) [2023-12-26 14:59:44,395][123090] Updated weights for policy 1, policy_version 1916208 (0.0009) [2023-12-26 14:59:44,454][123090] Updated weights for policy 1, policy_version 1916218 (0.0009) [2023-12-26 14:59:44,473][123091] Updated weights for policy 0, policy_version 1928248 (0.0010) [2023-12-26 14:59:44,526][123091] Updated weights for policy 0, policy_version 1928258 (0.0009) [2023-12-26 14:59:44,585][123091] Updated weights for policy 0, policy_version 1928268 (0.0005) [2023-12-26 14:59:45,186][123090] Updated weights for policy 1, policy_version 1916228 (0.0007) [2023-12-26 14:59:45,258][123090] Updated weights for policy 1, policy_version 1916238 (0.0007) [2023-12-26 14:59:45,317][123090] Updated weights for policy 1, policy_version 1916248 (0.0010) [2023-12-26 14:59:45,367][123091] Updated weights for policy 0, policy_version 1928278 (0.0006) [2023-12-26 14:59:45,423][123091] Updated weights for policy 0, policy_version 1928288 (0.0005) [2023-12-26 14:59:45,478][123091] Updated weights for policy 0, policy_version 1928298 (0.0005) [2023-12-26 14:59:46,076][123090] Updated weights for policy 1, policy_version 1916258 (0.0009) [2023-12-26 14:59:46,132][123090] Updated weights for policy 1, policy_version 1916268 (0.0005) [2023-12-26 14:59:46,145][123091] Updated weights for policy 0, policy_version 1928308 (0.0005) [2023-12-26 14:59:46,180][123090] Updated weights for policy 1, policy_version 1916278 (0.0006) [2023-12-26 14:59:46,201][123091] Updated weights for policy 0, policy_version 1928318 (0.0005) [2023-12-26 14:59:46,234][123090] Updated weights for policy 1, policy_version 1916288 (0.0007) [2023-12-26 14:59:46,256][123091] Updated weights for policy 0, policy_version 1928328 (0.0005) [2023-12-26 14:59:46,995][123091] Updated weights for policy 0, policy_version 1928338 (0.0005) [2023-12-26 14:59:47,003][123090] Updated weights for policy 1, policy_version 1916298 (0.0010) [2023-12-26 14:59:47,051][123091] Updated weights for policy 0, policy_version 1928348 (0.0005) [2023-12-26 14:59:47,058][123090] Updated weights for policy 1, policy_version 1916308 (0.0010) [2023-12-26 14:59:47,101][123091] Updated weights for policy 0, policy_version 1928358 (0.0005) [2023-12-26 14:59:47,113][123090] Updated weights for policy 1, policy_version 1916318 (0.0009) [2023-12-26 14:59:47,151][123091] Updated weights for policy 0, policy_version 1928368 (0.0006) [2023-12-26 14:59:47,876][123090] Updated weights for policy 1, policy_version 1916328 (0.0010) [2023-12-26 14:59:47,941][123090] Updated weights for policy 1, policy_version 1916338 (0.0010) [2023-12-26 14:59:47,979][123091] Updated weights for policy 0, policy_version 1928378 (0.0008) [2023-12-26 14:59:48,004][123090] Updated weights for policy 1, policy_version 1916348 (0.0010) [2023-12-26 14:59:48,033][123091] Updated weights for policy 0, policy_version 1928388 (0.0007) [2023-12-26 14:59:48,096][123091] Updated weights for policy 0, policy_version 1928398 (0.0009) [2023-12-26 14:59:48,744][123090] Updated weights for policy 1, policy_version 1916358 (0.0007) [2023-12-26 14:59:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17828.0). Total num frames: 984260608. Throughput: 0: 8942.9, 1: 8913.7. Samples: 984277300. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:48,785][121949] Avg episode reward: [(0, '6209.792'), (1, '5964.194')] [2023-12-26 14:59:48,813][123090] Updated weights for policy 1, policy_version 1916368 (0.0008) [2023-12-26 14:59:48,854][123091] Updated weights for policy 0, policy_version 1928408 (0.0007) [2023-12-26 14:59:48,873][123090] Updated weights for policy 1, policy_version 1916378 (0.0008) [2023-12-26 14:59:48,920][123091] Updated weights for policy 0, policy_version 1928418 (0.0007) [2023-12-26 14:59:48,986][123091] Updated weights for policy 0, policy_version 1928428 (0.0009) [2023-12-26 14:59:49,689][123090] Updated weights for policy 1, policy_version 1916388 (0.0009) [2023-12-26 14:59:49,754][123090] Updated weights for policy 1, policy_version 1916398 (0.0008) [2023-12-26 14:59:49,814][123091] Updated weights for policy 0, policy_version 1928438 (0.0009) [2023-12-26 14:59:49,817][123090] Updated weights for policy 1, policy_version 1916408 (0.0010) [2023-12-26 14:59:49,880][123091] Updated weights for policy 0, policy_version 1928448 (0.0010) [2023-12-26 14:59:49,942][123091] Updated weights for policy 0, policy_version 1928458 (0.0010) [2023-12-26 14:59:50,678][123090] Updated weights for policy 1, policy_version 1916418 (0.0009) [2023-12-26 14:59:50,743][123090] Updated weights for policy 1, policy_version 1916428 (0.0009) [2023-12-26 14:59:50,807][123091] Updated weights for policy 0, policy_version 1928468 (0.0006) [2023-12-26 14:59:50,816][123090] Updated weights for policy 1, policy_version 1916438 (0.0010) [2023-12-26 14:59:50,878][123091] Updated weights for policy 0, policy_version 1928478 (0.0010) [2023-12-26 14:59:50,887][123090] Updated weights for policy 1, policy_version 1916448 (0.0009) [2023-12-26 14:59:50,947][123091] Updated weights for policy 0, policy_version 1928488 (0.0006) [2023-12-26 14:59:51,760][123091] Updated weights for policy 0, policy_version 1928498 (0.0008) [2023-12-26 14:59:51,816][123090] Updated weights for policy 1, policy_version 1916458 (0.0008) [2023-12-26 14:59:51,826][123091] Updated weights for policy 0, policy_version 1928508 (0.0011) [2023-12-26 14:59:51,878][123090] Updated weights for policy 1, policy_version 1916468 (0.0006) [2023-12-26 14:59:51,883][123091] Updated weights for policy 0, policy_version 1928518 (0.0009) [2023-12-26 14:59:51,931][123091] Updated weights for policy 0, policy_version 1928528 (0.0009) [2023-12-26 14:59:51,943][123090] Updated weights for policy 1, policy_version 1916478 (0.0008) [2023-12-26 14:59:52,664][123091] Updated weights for policy 0, policy_version 1928538 (0.0009) [2023-12-26 14:59:52,728][123091] Updated weights for policy 0, policy_version 1928548 (0.0010) [2023-12-26 14:59:52,792][123091] Updated weights for policy 0, policy_version 1928558 (0.0010) [2023-12-26 14:59:52,821][123090] Updated weights for policy 1, policy_version 1916488 (0.0006) [2023-12-26 14:59:52,875][123090] Updated weights for policy 1, policy_version 1916498 (0.0006) [2023-12-26 14:59:52,937][123090] Updated weights for policy 1, policy_version 1916508 (0.0005) [2023-12-26 14:59:53,575][123091] Updated weights for policy 0, policy_version 1928568 (0.0006) [2023-12-26 14:59:53,632][123091] Updated weights for policy 0, policy_version 1928578 (0.0007) [2023-12-26 14:59:53,665][123090] Updated weights for policy 1, policy_version 1916518 (0.0008) [2023-12-26 14:59:53,684][123091] Updated weights for policy 0, policy_version 1928588 (0.0005) [2023-12-26 14:59:53,720][123090] Updated weights for policy 1, policy_version 1916528 (0.0007) [2023-12-26 14:59:53,777][123090] Updated weights for policy 1, policy_version 1916538 (0.0005) [2023-12-26 14:59:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 984350720. Throughput: 0: 8910.5, 1: 8849.1. Samples: 984327528. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:53,785][121949] Avg episode reward: [(0, '6240.814'), (1, '6019.315')] [2023-12-26 14:59:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001928592_493723648.pth... [2023-12-26 14:59:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001927536_493453312.pth [2023-12-26 14:59:53,807][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001916544_490635264.pth... [2023-12-26 14:59:53,810][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001915488_490364928.pth [2023-12-26 14:59:54,361][123091] Updated weights for policy 0, policy_version 1928598 (0.0005) [2023-12-26 14:59:54,414][123090] Updated weights for policy 1, policy_version 1916548 (0.0006) [2023-12-26 14:59:54,429][123091] Updated weights for policy 0, policy_version 1928608 (0.0006) [2023-12-26 14:59:54,474][123090] Updated weights for policy 1, policy_version 1916558 (0.0006) [2023-12-26 14:59:54,494][123091] Updated weights for policy 0, policy_version 1928618 (0.0010) [2023-12-26 14:59:54,536][123090] Updated weights for policy 1, policy_version 1916568 (0.0006) [2023-12-26 14:59:55,235][123091] Updated weights for policy 0, policy_version 1928628 (0.0008) [2023-12-26 14:59:55,294][123091] Updated weights for policy 0, policy_version 1928638 (0.0005) [2023-12-26 14:59:55,294][123090] Updated weights for policy 1, policy_version 1916578 (0.0006) [2023-12-26 14:59:55,343][123090] Updated weights for policy 1, policy_version 1916588 (0.0009) [2023-12-26 14:59:55,357][123091] Updated weights for policy 0, policy_version 1928648 (0.0005) [2023-12-26 14:59:55,396][123090] Updated weights for policy 1, policy_version 1916598 (0.0009) [2023-12-26 14:59:55,445][123090] Updated weights for policy 1, policy_version 1916608 (0.0009) [2023-12-26 14:59:56,064][123091] Updated weights for policy 0, policy_version 1928658 (0.0005) [2023-12-26 14:59:56,128][123091] Updated weights for policy 0, policy_version 1928668 (0.0007) [2023-12-26 14:59:56,186][123091] Updated weights for policy 0, policy_version 1928678 (0.0007) [2023-12-26 14:59:56,194][123090] Updated weights for policy 1, policy_version 1916618 (0.0005) [2023-12-26 14:59:56,247][123090] Updated weights for policy 1, policy_version 1916628 (0.0005) [2023-12-26 14:59:56,252][123091] Updated weights for policy 0, policy_version 1928688 (0.0006) [2023-12-26 14:59:56,323][123090] Updated weights for policy 1, policy_version 1916638 (0.0005) [2023-12-26 14:59:56,852][123091] Updated weights for policy 0, policy_version 1928698 (0.0007) [2023-12-26 14:59:56,907][123091] Updated weights for policy 0, policy_version 1928708 (0.0005) [2023-12-26 14:59:56,933][123090] Updated weights for policy 1, policy_version 1916648 (0.0005) [2023-12-26 14:59:56,951][123091] Updated weights for policy 0, policy_version 1928718 (0.0005) [2023-12-26 14:59:56,983][123090] Updated weights for policy 1, policy_version 1916658 (0.0010) [2023-12-26 14:59:57,037][123090] Updated weights for policy 1, policy_version 1916668 (0.0010) [2023-12-26 14:59:57,714][123091] Updated weights for policy 0, policy_version 1928728 (0.0005) [2023-12-26 14:59:57,767][123091] Updated weights for policy 0, policy_version 1928738 (0.0006) [2023-12-26 14:59:57,778][123090] Updated weights for policy 1, policy_version 1916678 (0.0007) [2023-12-26 14:59:57,819][123091] Updated weights for policy 0, policy_version 1928748 (0.0005) [2023-12-26 14:59:57,830][123090] Updated weights for policy 1, policy_version 1916688 (0.0005) [2023-12-26 14:59:57,879][123090] Updated weights for policy 1, policy_version 1916698 (0.0008) [2023-12-26 14:59:58,542][123091] Updated weights for policy 0, policy_version 1928758 (0.0007) [2023-12-26 14:59:58,604][123091] Updated weights for policy 0, policy_version 1928768 (0.0008) [2023-12-26 14:59:58,671][123091] Updated weights for policy 0, policy_version 1928778 (0.0007) [2023-12-26 14:59:58,713][123090] Updated weights for policy 1, policy_version 1916708 (0.0009) [2023-12-26 14:59:58,784][121949] Fps is (10 sec: 18841.3, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 984449024. Throughput: 0: 9040.3, 1: 8891.9. Samples: 984442136. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 14:59:58,785][121949] Avg episode reward: [(0, '6228.833'), (1, '5808.759')] [2023-12-26 14:59:58,788][123090] Updated weights for policy 1, policy_version 1916718 (0.0008) [2023-12-26 14:59:58,861][123090] Updated weights for policy 1, policy_version 1916728 (0.0008) [2023-12-26 14:59:59,611][123091] Updated weights for policy 0, policy_version 1928788 (0.0008) [2023-12-26 14:59:59,677][123091] Updated weights for policy 0, policy_version 1928798 (0.0010) [2023-12-26 14:59:59,681][123090] Updated weights for policy 1, policy_version 1916738 (0.0008) [2023-12-26 14:59:59,737][123091] Updated weights for policy 0, policy_version 1928808 (0.0009) [2023-12-26 14:59:59,738][123090] Updated weights for policy 1, policy_version 1916748 (0.0006) [2023-12-26 14:59:59,800][123090] Updated weights for policy 1, policy_version 1916758 (0.0005) [2023-12-26 14:59:59,875][123090] Updated weights for policy 1, policy_version 1916768 (0.0010) [2023-12-26 15:00:00,594][123090] Updated weights for policy 1, policy_version 1916778 (0.0005) [2023-12-26 15:00:00,596][123091] Updated weights for policy 0, policy_version 1928818 (0.0010) [2023-12-26 15:00:00,649][123091] Updated weights for policy 0, policy_version 1928828 (0.0009) [2023-12-26 15:00:00,653][123090] Updated weights for policy 1, policy_version 1916788 (0.0005) [2023-12-26 15:00:00,703][123091] Updated weights for policy 0, policy_version 1928838 (0.0008) [2023-12-26 15:00:00,711][123090] Updated weights for policy 1, policy_version 1916798 (0.0009) [2023-12-26 15:00:00,766][123091] Updated weights for policy 0, policy_version 1928848 (0.0009) [2023-12-26 15:00:01,482][123090] Updated weights for policy 1, policy_version 1916808 (0.0010) [2023-12-26 15:00:01,540][123090] Updated weights for policy 1, policy_version 1916818 (0.0010) [2023-12-26 15:00:01,543][123091] Updated weights for policy 0, policy_version 1928858 (0.0007) [2023-12-26 15:00:01,596][123090] Updated weights for policy 1, policy_version 1916828 (0.0010) [2023-12-26 15:00:01,607][123091] Updated weights for policy 0, policy_version 1928868 (0.0007) [2023-12-26 15:00:01,678][123091] Updated weights for policy 0, policy_version 1928878 (0.0008) [2023-12-26 15:00:02,343][123090] Updated weights for policy 1, policy_version 1916838 (0.0009) [2023-12-26 15:00:02,408][123090] Updated weights for policy 1, policy_version 1916848 (0.0009) [2023-12-26 15:00:02,468][123090] Updated weights for policy 1, policy_version 1916858 (0.0008) [2023-12-26 15:00:02,501][123091] Updated weights for policy 0, policy_version 1928888 (0.0006) [2023-12-26 15:00:02,555][123091] Updated weights for policy 0, policy_version 1928898 (0.0007) [2023-12-26 15:00:02,614][123091] Updated weights for policy 0, policy_version 1928908 (0.0010) [2023-12-26 15:00:03,218][123090] Updated weights for policy 1, policy_version 1916868 (0.0009) [2023-12-26 15:00:03,273][123090] Updated weights for policy 1, policy_version 1916878 (0.0008) [2023-12-26 15:00:03,328][123090] Updated weights for policy 1, policy_version 1916888 (0.0007) [2023-12-26 15:00:03,451][123091] Updated weights for policy 0, policy_version 1928918 (0.0009) [2023-12-26 15:00:03,512][123091] Updated weights for policy 0, policy_version 1928928 (0.0010) [2023-12-26 15:00:03,572][123091] Updated weights for policy 0, policy_version 1928938 (0.0010) [2023-12-26 15:00:03,784][121949] Fps is (10 sec: 18841.5, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 984539136. Throughput: 0: 8960.7, 1: 8944.9. Samples: 984547632. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:03,786][121949] Avg episode reward: [(0, '6324.302'), (1, '5916.991')] [2023-12-26 15:00:04,117][123090] Updated weights for policy 1, policy_version 1916898 (0.0006) [2023-12-26 15:00:04,170][123090] Updated weights for policy 1, policy_version 1916908 (0.0009) [2023-12-26 15:00:04,228][123090] Updated weights for policy 1, policy_version 1916918 (0.0010) [2023-12-26 15:00:04,287][123090] Updated weights for policy 1, policy_version 1916928 (0.0009) [2023-12-26 15:00:04,349][123091] Updated weights for policy 0, policy_version 1928948 (0.0010) [2023-12-26 15:00:04,397][123091] Updated weights for policy 0, policy_version 1928958 (0.0009) [2023-12-26 15:00:04,456][123091] Updated weights for policy 0, policy_version 1928968 (0.0010) [2023-12-26 15:00:05,147][123090] Updated weights for policy 1, policy_version 1916938 (0.0005) [2023-12-26 15:00:05,222][123090] Updated weights for policy 1, policy_version 1916948 (0.0005) [2023-12-26 15:00:05,251][123091] Updated weights for policy 0, policy_version 1928978 (0.0009) [2023-12-26 15:00:05,294][123090] Updated weights for policy 1, policy_version 1916958 (0.0008) [2023-12-26 15:00:05,303][123091] Updated weights for policy 0, policy_version 1928988 (0.0008) [2023-12-26 15:00:05,356][123091] Updated weights for policy 0, policy_version 1928998 (0.0009) [2023-12-26 15:00:05,407][123091] Updated weights for policy 0, policy_version 1929008 (0.0010) [2023-12-26 15:00:05,866][123090] Updated weights for policy 1, policy_version 1916968 (0.0006) [2023-12-26 15:00:05,929][123090] Updated weights for policy 1, policy_version 1916978 (0.0008) [2023-12-26 15:00:05,992][123090] Updated weights for policy 1, policy_version 1916988 (0.0010) [2023-12-26 15:00:06,178][123091] Updated weights for policy 0, policy_version 1929018 (0.0007) [2023-12-26 15:00:06,249][123091] Updated weights for policy 0, policy_version 1929028 (0.0008) [2023-12-26 15:00:06,314][123091] Updated weights for policy 0, policy_version 1929038 (0.0011) [2023-12-26 15:00:06,710][123090] Updated weights for policy 1, policy_version 1916998 (0.0007) [2023-12-26 15:00:06,777][123090] Updated weights for policy 1, policy_version 1917008 (0.0005) [2023-12-26 15:00:06,844][123090] Updated weights for policy 1, policy_version 1917018 (0.0006) [2023-12-26 15:00:07,120][123091] Updated weights for policy 0, policy_version 1929048 (0.0011) [2023-12-26 15:00:07,189][123091] Updated weights for policy 0, policy_version 1929058 (0.0011) [2023-12-26 15:00:07,256][123091] Updated weights for policy 0, policy_version 1929068 (0.0011) [2023-12-26 15:00:07,549][123090] Updated weights for policy 1, policy_version 1917028 (0.0005) [2023-12-26 15:00:07,611][123090] Updated weights for policy 1, policy_version 1917038 (0.0010) [2023-12-26 15:00:07,659][123090] Updated weights for policy 1, policy_version 1917048 (0.0010) [2023-12-26 15:00:08,029][123091] Updated weights for policy 0, policy_version 1929078 (0.0008) [2023-12-26 15:00:08,081][123091] Updated weights for policy 0, policy_version 1929088 (0.0005) [2023-12-26 15:00:08,146][123091] Updated weights for policy 0, policy_version 1929098 (0.0005) [2023-12-26 15:00:08,510][123090] Updated weights for policy 1, policy_version 1917058 (0.0010) [2023-12-26 15:00:08,562][123090] Updated weights for policy 1, policy_version 1917068 (0.0010) [2023-12-26 15:00:08,632][123090] Updated weights for policy 1, policy_version 1917078 (0.0011) [2023-12-26 15:00:08,695][123090] Updated weights for policy 1, policy_version 1917088 (0.0010) [2023-12-26 15:00:08,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 984629248. Throughput: 0: 8988.3, 1: 9010.0. Samples: 984603016. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:08,785][121949] Avg episode reward: [(0, '6328.139'), (1, '6018.633')] [2023-12-26 15:00:08,788][123091] Updated weights for policy 0, policy_version 1929108 (0.0005) [2023-12-26 15:00:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001917088_490774528.pth... [2023-12-26 15:00:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001916000_490496000.pth [2023-12-26 15:00:08,850][123091] Updated weights for policy 0, policy_version 1929118 (0.0005) [2023-12-26 15:00:08,918][123091] Updated weights for policy 0, policy_version 1929128 (0.0005) [2023-12-26 15:00:08,967][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001929136_493862912.pth... [2023-12-26 15:00:08,970][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001928048_493584384.pth [2023-12-26 15:00:09,559][123090] Updated weights for policy 1, policy_version 1917098 (0.0010) [2023-12-26 15:00:09,624][123090] Updated weights for policy 1, policy_version 1917108 (0.0011) [2023-12-26 15:00:09,641][123091] Updated weights for policy 0, policy_version 1929138 (0.0006) [2023-12-26 15:00:09,688][123090] Updated weights for policy 1, policy_version 1917118 (0.0010) [2023-12-26 15:00:09,695][123091] Updated weights for policy 0, policy_version 1929148 (0.0007) [2023-12-26 15:00:09,751][123091] Updated weights for policy 0, policy_version 1929158 (0.0009) [2023-12-26 15:00:09,818][123091] Updated weights for policy 0, policy_version 1929168 (0.0010) [2023-12-26 15:00:10,436][123090] Updated weights for policy 1, policy_version 1917128 (0.0006) [2023-12-26 15:00:10,497][123090] Updated weights for policy 1, policy_version 1917138 (0.0005) [2023-12-26 15:00:10,550][123090] Updated weights for policy 1, policy_version 1917148 (0.0005) [2023-12-26 15:00:10,611][123091] Updated weights for policy 0, policy_version 1929178 (0.0005) [2023-12-26 15:00:10,683][123091] Updated weights for policy 0, policy_version 1929188 (0.0008) [2023-12-26 15:00:10,751][123091] Updated weights for policy 0, policy_version 1929198 (0.0009) [2023-12-26 15:00:11,322][123090] Updated weights for policy 1, policy_version 1917158 (0.0008) [2023-12-26 15:00:11,395][123090] Updated weights for policy 1, policy_version 1917168 (0.0008) [2023-12-26 15:00:11,465][123090] Updated weights for policy 1, policy_version 1917178 (0.0009) [2023-12-26 15:00:11,536][123091] Updated weights for policy 0, policy_version 1929208 (0.0010) [2023-12-26 15:00:11,592][123091] Updated weights for policy 0, policy_version 1929218 (0.0010) [2023-12-26 15:00:11,660][123091] Updated weights for policy 0, policy_version 1929228 (0.0011) [2023-12-26 15:00:12,271][123090] Updated weights for policy 1, policy_version 1917188 (0.0007) [2023-12-26 15:00:12,339][123090] Updated weights for policy 1, policy_version 1917198 (0.0008) [2023-12-26 15:00:12,413][123090] Updated weights for policy 1, policy_version 1917208 (0.0008) [2023-12-26 15:00:12,519][123091] Updated weights for policy 0, policy_version 1929238 (0.0008) [2023-12-26 15:00:12,579][123091] Updated weights for policy 0, policy_version 1929248 (0.0008) [2023-12-26 15:00:12,639][123091] Updated weights for policy 0, policy_version 1929258 (0.0010) [2023-12-26 15:00:13,227][123090] Updated weights for policy 1, policy_version 1917218 (0.0009) [2023-12-26 15:00:13,296][123090] Updated weights for policy 1, policy_version 1917228 (0.0008) [2023-12-26 15:00:13,367][123090] Updated weights for policy 1, policy_version 1917238 (0.0009) [2023-12-26 15:00:13,412][123091] Updated weights for policy 0, policy_version 1929268 (0.0008) [2023-12-26 15:00:13,431][123090] Updated weights for policy 1, policy_version 1917248 (0.0009) [2023-12-26 15:00:13,467][123091] Updated weights for policy 0, policy_version 1929278 (0.0008) [2023-12-26 15:00:13,524][123091] Updated weights for policy 0, policy_version 1929288 (0.0009) [2023-12-26 15:00:13,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.4, 300 sec: 17828.0). Total num frames: 984719360. Throughput: 0: 8931.0, 1: 9029.9. Samples: 984710256. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:13,785][121949] Avg episode reward: [(0, '6297.669'), (1, '5988.331')] [2023-12-26 15:00:14,221][123090] Updated weights for policy 1, policy_version 1917258 (0.0009) [2023-12-26 15:00:14,284][123090] Updated weights for policy 1, policy_version 1917268 (0.0008) [2023-12-26 15:00:14,333][123091] Updated weights for policy 0, policy_version 1929298 (0.0008) [2023-12-26 15:00:14,341][123090] Updated weights for policy 1, policy_version 1917278 (0.0008) [2023-12-26 15:00:14,395][123091] Updated weights for policy 0, policy_version 1929308 (0.0008) [2023-12-26 15:00:14,456][123091] Updated weights for policy 0, policy_version 1929318 (0.0008) [2023-12-26 15:00:14,522][123091] Updated weights for policy 0, policy_version 1929328 (0.0007) [2023-12-26 15:00:15,164][123090] Updated weights for policy 1, policy_version 1917288 (0.0010) [2023-12-26 15:00:15,231][123090] Updated weights for policy 1, policy_version 1917298 (0.0009) [2023-12-26 15:00:15,298][123091] Updated weights for policy 0, policy_version 1929338 (0.0009) [2023-12-26 15:00:15,298][123090] Updated weights for policy 1, policy_version 1917308 (0.0007) [2023-12-26 15:00:15,364][123091] Updated weights for policy 0, policy_version 1929348 (0.0009) [2023-12-26 15:00:15,423][123091] Updated weights for policy 0, policy_version 1929358 (0.0010) [2023-12-26 15:00:16,088][123090] Updated weights for policy 1, policy_version 1917318 (0.0007) [2023-12-26 15:00:16,144][123090] Updated weights for policy 1, policy_version 1917328 (0.0009) [2023-12-26 15:00:16,204][123090] Updated weights for policy 1, policy_version 1917338 (0.0009) [2023-12-26 15:00:16,260][123091] Updated weights for policy 0, policy_version 1929368 (0.0010) [2023-12-26 15:00:16,314][123091] Updated weights for policy 0, policy_version 1929378 (0.0009) [2023-12-26 15:00:16,385][123091] Updated weights for policy 0, policy_version 1929388 (0.0009) [2023-12-26 15:00:17,032][123090] Updated weights for policy 1, policy_version 1917348 (0.0010) [2023-12-26 15:00:17,096][123090] Updated weights for policy 1, policy_version 1917358 (0.0009) [2023-12-26 15:00:17,156][123090] Updated weights for policy 1, policy_version 1917368 (0.0009) [2023-12-26 15:00:17,200][123091] Updated weights for policy 0, policy_version 1929398 (0.0009) [2023-12-26 15:00:17,252][123091] Updated weights for policy 0, policy_version 1929408 (0.0009) [2023-12-26 15:00:17,313][123091] Updated weights for policy 0, policy_version 1929418 (0.0010) [2023-12-26 15:00:17,994][123090] Updated weights for policy 1, policy_version 1917378 (0.0006) [2023-12-26 15:00:18,059][123090] Updated weights for policy 1, policy_version 1917388 (0.0009) [2023-12-26 15:00:18,065][123091] Updated weights for policy 0, policy_version 1929428 (0.0010) [2023-12-26 15:00:18,123][123090] Updated weights for policy 1, policy_version 1917398 (0.0006) [2023-12-26 15:00:18,129][123091] Updated weights for policy 0, policy_version 1929438 (0.0007) [2023-12-26 15:00:18,186][123090] Updated weights for policy 1, policy_version 1917408 (0.0005) [2023-12-26 15:00:18,194][123091] Updated weights for policy 0, policy_version 1929448 (0.0005) [2023-12-26 15:00:18,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 984801280. Throughput: 0: 8997.1, 1: 9031.3. Samples: 984816616. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:18,785][121949] Avg episode reward: [(0, '6354.521'), (1, '6138.592')] [2023-12-26 15:00:18,920][123090] Updated weights for policy 1, policy_version 1917418 (0.0011) [2023-12-26 15:00:18,982][123091] Updated weights for policy 0, policy_version 1929458 (0.0006) [2023-12-26 15:00:18,988][123090] Updated weights for policy 1, policy_version 1917428 (0.0010) [2023-12-26 15:00:19,045][123091] Updated weights for policy 0, policy_version 1929468 (0.0008) [2023-12-26 15:00:19,056][123090] Updated weights for policy 1, policy_version 1917438 (0.0011) [2023-12-26 15:00:19,105][123091] Updated weights for policy 0, policy_version 1929478 (0.0006) [2023-12-26 15:00:19,177][123091] Updated weights for policy 0, policy_version 1929488 (0.0005) [2023-12-26 15:00:19,845][123091] Updated weights for policy 0, policy_version 1929498 (0.0008) [2023-12-26 15:00:19,854][123090] Updated weights for policy 1, policy_version 1917448 (0.0011) [2023-12-26 15:00:19,917][123091] Updated weights for policy 0, policy_version 1929508 (0.0008) [2023-12-26 15:00:19,926][123090] Updated weights for policy 1, policy_version 1917458 (0.0010) [2023-12-26 15:00:19,975][123091] Updated weights for policy 0, policy_version 1929518 (0.0007) [2023-12-26 15:00:19,994][123090] Updated weights for policy 1, policy_version 1917468 (0.0010) [2023-12-26 15:00:20,703][123091] Updated weights for policy 0, policy_version 1929528 (0.0007) [2023-12-26 15:00:20,768][123091] Updated weights for policy 0, policy_version 1929538 (0.0009) [2023-12-26 15:00:20,832][123091] Updated weights for policy 0, policy_version 1929548 (0.0009) [2023-12-26 15:00:20,844][123090] Updated weights for policy 1, policy_version 1917478 (0.0011) [2023-12-26 15:00:20,916][123090] Updated weights for policy 1, policy_version 1917488 (0.0011) [2023-12-26 15:00:20,989][123090] Updated weights for policy 1, policy_version 1917498 (0.0011) [2023-12-26 15:00:21,722][123091] Updated weights for policy 0, policy_version 1929558 (0.0008) [2023-12-26 15:00:21,795][123091] Updated weights for policy 0, policy_version 1929568 (0.0008) [2023-12-26 15:00:21,806][123090] Updated weights for policy 1, policy_version 1917508 (0.0010) [2023-12-26 15:00:21,867][123091] Updated weights for policy 0, policy_version 1929578 (0.0006) [2023-12-26 15:00:21,878][123090] Updated weights for policy 1, policy_version 1917518 (0.0008) [2023-12-26 15:00:21,935][123090] Updated weights for policy 1, policy_version 1917528 (0.0008) [2023-12-26 15:00:22,658][123091] Updated weights for policy 0, policy_version 1929588 (0.0007) [2023-12-26 15:00:22,727][123091] Updated weights for policy 0, policy_version 1929598 (0.0008) [2023-12-26 15:00:22,743][123090] Updated weights for policy 1, policy_version 1917538 (0.0009) [2023-12-26 15:00:22,792][123091] Updated weights for policy 0, policy_version 1929608 (0.0010) [2023-12-26 15:00:22,800][123090] Updated weights for policy 1, policy_version 1917548 (0.0007) [2023-12-26 15:00:22,862][123090] Updated weights for policy 1, policy_version 1917558 (0.0009) [2023-12-26 15:00:22,920][123090] Updated weights for policy 1, policy_version 1917568 (0.0009) [2023-12-26 15:00:23,635][123091] Updated weights for policy 0, policy_version 1929618 (0.0010) [2023-12-26 15:00:23,690][123091] Updated weights for policy 0, policy_version 1929628 (0.0008) [2023-12-26 15:00:23,733][123090] Updated weights for policy 1, policy_version 1917578 (0.0008) [2023-12-26 15:00:23,756][123091] Updated weights for policy 0, policy_version 1929638 (0.0010) [2023-12-26 15:00:23,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 984883200. Throughput: 0: 9019.4, 1: 8989.1. Samples: 984868696. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:23,785][121949] Avg episode reward: [(0, '6367.261'), (1, '6100.399')] [2023-12-26 15:00:23,793][123090] Updated weights for policy 1, policy_version 1917588 (0.0007) [2023-12-26 15:00:23,813][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001929648_493993984.pth... [2023-12-26 15:00:23,813][123091] Updated weights for policy 0, policy_version 1929648 (0.0010) [2023-12-26 15:00:23,818][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001928592_493723648.pth [2023-12-26 15:00:23,849][123090] Updated weights for policy 1, policy_version 1917598 (0.0009) [2023-12-26 15:00:23,855][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001917600_490905600.pth... [2023-12-26 15:00:23,858][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001916544_490635264.pth [2023-12-26 15:00:24,589][123091] Updated weights for policy 0, policy_version 1929658 (0.0009) [2023-12-26 15:00:24,650][123091] Updated weights for policy 0, policy_version 1929668 (0.0010) [2023-12-26 15:00:24,671][123090] Updated weights for policy 1, policy_version 1917608 (0.0007) [2023-12-26 15:00:24,712][123091] Updated weights for policy 0, policy_version 1929678 (0.0007) [2023-12-26 15:00:24,736][123090] Updated weights for policy 1, policy_version 1917618 (0.0009) [2023-12-26 15:00:24,793][123090] Updated weights for policy 1, policy_version 1917628 (0.0008) [2023-12-26 15:00:25,439][123091] Updated weights for policy 0, policy_version 1929688 (0.0008) [2023-12-26 15:00:25,440][123090] Updated weights for policy 1, policy_version 1917638 (0.0006) [2023-12-26 15:00:25,499][123091] Updated weights for policy 0, policy_version 1929698 (0.0007) [2023-12-26 15:00:25,502][123090] Updated weights for policy 1, policy_version 1917648 (0.0005) [2023-12-26 15:00:25,554][123091] Updated weights for policy 0, policy_version 1929708 (0.0006) [2023-12-26 15:00:25,561][123090] Updated weights for policy 1, policy_version 1917658 (0.0005) [2023-12-26 15:00:26,222][123090] Updated weights for policy 1, policy_version 1917668 (0.0005) [2023-12-26 15:00:26,245][123091] Updated weights for policy 0, policy_version 1929718 (0.0007) [2023-12-26 15:00:26,269][123090] Updated weights for policy 1, policy_version 1917678 (0.0005) [2023-12-26 15:00:26,291][123091] Updated weights for policy 0, policy_version 1929728 (0.0007) [2023-12-26 15:00:26,329][123090] Updated weights for policy 1, policy_version 1917688 (0.0005) [2023-12-26 15:00:26,345][123091] Updated weights for policy 0, policy_version 1929738 (0.0006) [2023-12-26 15:00:27,003][123090] Updated weights for policy 1, policy_version 1917698 (0.0006) [2023-12-26 15:00:27,032][123091] Updated weights for policy 0, policy_version 1929748 (0.0007) [2023-12-26 15:00:27,069][123090] Updated weights for policy 1, policy_version 1917708 (0.0009) [2023-12-26 15:00:27,079][123091] Updated weights for policy 0, policy_version 1929758 (0.0007) [2023-12-26 15:00:27,132][123091] Updated weights for policy 0, policy_version 1929768 (0.0007) [2023-12-26 15:00:27,134][123090] Updated weights for policy 1, policy_version 1917718 (0.0008) [2023-12-26 15:00:27,196][123090] Updated weights for policy 1, policy_version 1917728 (0.0009) [2023-12-26 15:00:27,866][123091] Updated weights for policy 0, policy_version 1929778 (0.0008) [2023-12-26 15:00:27,922][123091] Updated weights for policy 0, policy_version 1929788 (0.0010) [2023-12-26 15:00:27,943][123090] Updated weights for policy 1, policy_version 1917738 (0.0006) [2023-12-26 15:00:27,974][123091] Updated weights for policy 0, policy_version 1929798 (0.0009) [2023-12-26 15:00:28,010][123090] Updated weights for policy 1, policy_version 1917748 (0.0008) [2023-12-26 15:00:28,026][123091] Updated weights for policy 0, policy_version 1929808 (0.0009) [2023-12-26 15:00:28,062][123090] Updated weights for policy 1, policy_version 1917758 (0.0010) [2023-12-26 15:00:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 984981504. Throughput: 0: 9041.3, 1: 9037.0. Samples: 984980588. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:28,785][121949] Avg episode reward: [(0, '6250.325'), (1, '6021.973')] [2023-12-26 15:00:28,833][123090] Updated weights for policy 1, policy_version 1917768 (0.0008) [2023-12-26 15:00:28,876][123091] Updated weights for policy 0, policy_version 1929818 (0.0008) [2023-12-26 15:00:28,903][123090] Updated weights for policy 1, policy_version 1917778 (0.0009) [2023-12-26 15:00:28,938][123091] Updated weights for policy 0, policy_version 1929828 (0.0007) [2023-12-26 15:00:28,971][123090] Updated weights for policy 1, policy_version 1917788 (0.0008) [2023-12-26 15:00:29,008][123091] Updated weights for policy 0, policy_version 1929838 (0.0006) [2023-12-26 15:00:29,787][123091] Updated weights for policy 0, policy_version 1929848 (0.0006) [2023-12-26 15:00:29,838][123090] Updated weights for policy 1, policy_version 1917798 (0.0009) [2023-12-26 15:00:29,858][123091] Updated weights for policy 0, policy_version 1929858 (0.0007) [2023-12-26 15:00:29,901][123090] Updated weights for policy 1, policy_version 1917808 (0.0009) [2023-12-26 15:00:29,916][123091] Updated weights for policy 0, policy_version 1929868 (0.0009) [2023-12-26 15:00:29,967][123090] Updated weights for policy 1, policy_version 1917818 (0.0008) [2023-12-26 15:00:30,697][123091] Updated weights for policy 0, policy_version 1929878 (0.0010) [2023-12-26 15:00:30,761][123091] Updated weights for policy 0, policy_version 1929888 (0.0009) [2023-12-26 15:00:30,775][123090] Updated weights for policy 1, policy_version 1917828 (0.0007) [2023-12-26 15:00:30,829][123091] Updated weights for policy 0, policy_version 1929898 (0.0008) [2023-12-26 15:00:30,843][123090] Updated weights for policy 1, policy_version 1917838 (0.0010) [2023-12-26 15:00:30,895][123090] Updated weights for policy 1, policy_version 1917848 (0.0010) [2023-12-26 15:00:31,649][123091] Updated weights for policy 0, policy_version 1929908 (0.0008) [2023-12-26 15:00:31,698][123090] Updated weights for policy 1, policy_version 1917858 (0.0010) [2023-12-26 15:00:31,719][123091] Updated weights for policy 0, policy_version 1929918 (0.0007) [2023-12-26 15:00:31,761][123090] Updated weights for policy 1, policy_version 1917868 (0.0008) [2023-12-26 15:00:31,778][123091] Updated weights for policy 0, policy_version 1929928 (0.0008) [2023-12-26 15:00:31,820][123090] Updated weights for policy 1, policy_version 1917878 (0.0006) [2023-12-26 15:00:31,879][123090] Updated weights for policy 1, policy_version 1917888 (0.0010) [2023-12-26 15:00:32,562][123091] Updated weights for policy 0, policy_version 1929938 (0.0008) [2023-12-26 15:00:32,633][123091] Updated weights for policy 0, policy_version 1929948 (0.0005) [2023-12-26 15:00:32,701][123091] Updated weights for policy 0, policy_version 1929958 (0.0006) [2023-12-26 15:00:32,721][123090] Updated weights for policy 1, policy_version 1917898 (0.0007) [2023-12-26 15:00:32,765][123091] Updated weights for policy 0, policy_version 1929968 (0.0008) [2023-12-26 15:00:32,791][123090] Updated weights for policy 1, policy_version 1917908 (0.0007) [2023-12-26 15:00:32,851][123090] Updated weights for policy 1, policy_version 1917918 (0.0009) [2023-12-26 15:00:33,479][123091] Updated weights for policy 0, policy_version 1929978 (0.0009) [2023-12-26 15:00:33,511][123090] Updated weights for policy 1, policy_version 1917928 (0.0008) [2023-12-26 15:00:33,526][123091] Updated weights for policy 0, policy_version 1929988 (0.0007) [2023-12-26 15:00:33,562][123090] Updated weights for policy 1, policy_version 1917938 (0.0008) [2023-12-26 15:00:33,579][123091] Updated weights for policy 0, policy_version 1929998 (0.0007) [2023-12-26 15:00:33,626][123090] Updated weights for policy 1, policy_version 1917948 (0.0008) [2023-12-26 15:00:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 985079808. Throughput: 0: 8983.1, 1: 8988.6. Samples: 985086028. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:33,785][121949] Avg episode reward: [(0, '6186.806'), (1, '6028.737')] [2023-12-26 15:00:34,280][123091] Updated weights for policy 0, policy_version 1930008 (0.0006) [2023-12-26 15:00:34,357][123091] Updated weights for policy 0, policy_version 1930018 (0.0009) [2023-12-26 15:00:34,422][123091] Updated weights for policy 0, policy_version 1930028 (0.0010) [2023-12-26 15:00:34,551][123090] Updated weights for policy 1, policy_version 1917958 (0.0007) [2023-12-26 15:00:34,619][123090] Updated weights for policy 1, policy_version 1917968 (0.0007) [2023-12-26 15:00:34,693][123090] Updated weights for policy 1, policy_version 1917978 (0.0006) [2023-12-26 15:00:35,194][123091] Updated weights for policy 0, policy_version 1930038 (0.0008) [2023-12-26 15:00:35,255][123091] Updated weights for policy 0, policy_version 1930048 (0.0005) [2023-12-26 15:00:35,320][123091] Updated weights for policy 0, policy_version 1930058 (0.0005) [2023-12-26 15:00:35,397][123090] Updated weights for policy 1, policy_version 1917988 (0.0007) [2023-12-26 15:00:35,449][123090] Updated weights for policy 1, policy_version 1917998 (0.0009) [2023-12-26 15:00:35,513][123090] Updated weights for policy 1, policy_version 1918008 (0.0007) [2023-12-26 15:00:36,007][123091] Updated weights for policy 0, policy_version 1930068 (0.0007) [2023-12-26 15:00:36,065][123091] Updated weights for policy 0, policy_version 1930078 (0.0005) [2023-12-26 15:00:36,160][123091] Updated weights for policy 0, policy_version 1930091 (0.0007) [2023-12-26 15:00:36,163][123090] Updated weights for policy 1, policy_version 1918018 (0.0006) [2023-12-26 15:00:36,231][123090] Updated weights for policy 1, policy_version 1918028 (0.0009) [2023-12-26 15:00:36,300][123090] Updated weights for policy 1, policy_version 1918038 (0.0011) [2023-12-26 15:00:36,365][123090] Updated weights for policy 1, policy_version 1918048 (0.0011) [2023-12-26 15:00:36,921][123091] Updated weights for policy 0, policy_version 1930101 (0.0007) [2023-12-26 15:00:36,989][123091] Updated weights for policy 0, policy_version 1930111 (0.0008) [2023-12-26 15:00:37,052][123091] Updated weights for policy 0, policy_version 1930121 (0.0009) [2023-12-26 15:00:37,168][123090] Updated weights for policy 1, policy_version 1918058 (0.0005) [2023-12-26 15:00:37,232][123090] Updated weights for policy 1, policy_version 1918068 (0.0007) [2023-12-26 15:00:37,296][123090] Updated weights for policy 1, policy_version 1918078 (0.0011) [2023-12-26 15:00:37,860][123091] Updated weights for policy 0, policy_version 1930131 (0.0010) [2023-12-26 15:00:37,931][123091] Updated weights for policy 0, policy_version 1930141 (0.0011) [2023-12-26 15:00:38,002][123091] Updated weights for policy 0, policy_version 1930151 (0.0011) [2023-12-26 15:00:38,099][123090] Updated weights for policy 1, policy_version 1918088 (0.0011) [2023-12-26 15:00:38,167][123090] Updated weights for policy 1, policy_version 1918098 (0.0011) [2023-12-26 15:00:38,232][123090] Updated weights for policy 1, policy_version 1918108 (0.0011) [2023-12-26 15:00:38,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 985161728. Throughput: 0: 9064.4, 1: 9029.7. Samples: 985141764. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:38,786][121949] Avg episode reward: [(0, '6240.088'), (1, '6014.419')] [2023-12-26 15:00:38,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001918112_491036672.pth... [2023-12-26 15:00:38,795][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001930160_494125056.pth... [2023-12-26 15:00:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001917088_490774528.pth [2023-12-26 15:00:38,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001929136_493862912.pth [2023-12-26 15:00:38,827][123091] Updated weights for policy 0, policy_version 1930161 (0.0011) [2023-12-26 15:00:38,895][123091] Updated weights for policy 0, policy_version 1930171 (0.0009) [2023-12-26 15:00:38,962][123091] Updated weights for policy 0, policy_version 1930181 (0.0009) [2023-12-26 15:00:39,030][123091] Updated weights for policy 0, policy_version 1930191 (0.0009) [2023-12-26 15:00:39,033][123090] Updated weights for policy 1, policy_version 1918118 (0.0008) [2023-12-26 15:00:39,093][123090] Updated weights for policy 1, policy_version 1918128 (0.0008) [2023-12-26 15:00:39,158][123090] Updated weights for policy 1, policy_version 1918138 (0.0009) [2023-12-26 15:00:39,808][123091] Updated weights for policy 0, policy_version 1930201 (0.0008) [2023-12-26 15:00:39,879][123091] Updated weights for policy 0, policy_version 1930211 (0.0009) [2023-12-26 15:00:39,943][123091] Updated weights for policy 0, policy_version 1930221 (0.0009) [2023-12-26 15:00:40,014][123090] Updated weights for policy 1, policy_version 1918148 (0.0009) [2023-12-26 15:00:40,072][123090] Updated weights for policy 1, policy_version 1918158 (0.0010) [2023-12-26 15:00:40,139][123090] Updated weights for policy 1, policy_version 1918168 (0.0010) [2023-12-26 15:00:40,772][123091] Updated weights for policy 0, policy_version 1930231 (0.0006) [2023-12-26 15:00:40,823][123091] Updated weights for policy 0, policy_version 1930241 (0.0005) [2023-12-26 15:00:40,884][123091] Updated weights for policy 0, policy_version 1930251 (0.0006) [2023-12-26 15:00:40,961][123090] Updated weights for policy 1, policy_version 1918178 (0.0009) [2023-12-26 15:00:41,023][123090] Updated weights for policy 1, policy_version 1918188 (0.0007) [2023-12-26 15:00:41,095][123090] Updated weights for policy 1, policy_version 1918198 (0.0008) [2023-12-26 15:00:41,177][123090] Updated weights for policy 1, policy_version 1918208 (0.0009) [2023-12-26 15:00:41,628][123091] Updated weights for policy 0, policy_version 1930261 (0.0008) [2023-12-26 15:00:41,699][123091] Updated weights for policy 0, policy_version 1930271 (0.0010) [2023-12-26 15:00:41,773][123091] Updated weights for policy 0, policy_version 1930281 (0.0010) [2023-12-26 15:00:41,976][123090] Updated weights for policy 1, policy_version 1918218 (0.0010) [2023-12-26 15:00:42,029][123090] Updated weights for policy 1, policy_version 1918228 (0.0009) [2023-12-26 15:00:42,101][123090] Updated weights for policy 1, policy_version 1918238 (0.0009) [2023-12-26 15:00:42,618][123091] Updated weights for policy 0, policy_version 1930291 (0.0009) [2023-12-26 15:00:42,676][123091] Updated weights for policy 0, policy_version 1930301 (0.0007) [2023-12-26 15:00:42,742][123091] Updated weights for policy 0, policy_version 1930311 (0.0009) [2023-12-26 15:00:42,921][123090] Updated weights for policy 1, policy_version 1918248 (0.0009) [2023-12-26 15:00:42,986][123090] Updated weights for policy 1, policy_version 1918258 (0.0008) [2023-12-26 15:00:43,045][123090] Updated weights for policy 1, policy_version 1918268 (0.0005) [2023-12-26 15:00:43,478][123091] Updated weights for policy 0, policy_version 1930321 (0.0010) [2023-12-26 15:00:43,535][123091] Updated weights for policy 0, policy_version 1930331 (0.0009) [2023-12-26 15:00:43,585][123091] Updated weights for policy 0, policy_version 1930341 (0.0009) [2023-12-26 15:00:43,655][123091] Updated weights for policy 0, policy_version 1930351 (0.0011) [2023-12-26 15:00:43,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 985251840. Throughput: 0: 8938.4, 1: 8896.8. Samples: 985244716. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:43,784][121949] Avg episode reward: [(0, '6318.795'), (1, '5917.686')] [2023-12-26 15:00:43,842][123090] Updated weights for policy 1, policy_version 1918278 (0.0008) [2023-12-26 15:00:43,899][123090] Updated weights for policy 1, policy_version 1918288 (0.0009) [2023-12-26 15:00:43,959][123090] Updated weights for policy 1, policy_version 1918298 (0.0009) [2023-12-26 15:00:44,500][123091] Updated weights for policy 0, policy_version 1930361 (0.0011) [2023-12-26 15:00:44,556][123091] Updated weights for policy 0, policy_version 1930371 (0.0010) [2023-12-26 15:00:44,619][123091] Updated weights for policy 0, policy_version 1930381 (0.0010) [2023-12-26 15:00:44,814][123090] Updated weights for policy 1, policy_version 1918308 (0.0009) [2023-12-26 15:00:44,873][123090] Updated weights for policy 1, policy_version 1918318 (0.0010) [2023-12-26 15:00:44,932][123090] Updated weights for policy 1, policy_version 1918328 (0.0010) [2023-12-26 15:00:45,383][123091] Updated weights for policy 0, policy_version 1930391 (0.0005) [2023-12-26 15:00:45,443][123091] Updated weights for policy 0, policy_version 1930401 (0.0006) [2023-12-26 15:00:45,520][123091] Updated weights for policy 0, policy_version 1930411 (0.0008) [2023-12-26 15:00:45,780][123090] Updated weights for policy 1, policy_version 1918338 (0.0010) [2023-12-26 15:00:45,850][123090] Updated weights for policy 1, policy_version 1918348 (0.0010) [2023-12-26 15:00:45,923][123090] Updated weights for policy 1, policy_version 1918358 (0.0010) [2023-12-26 15:00:45,985][123090] Updated weights for policy 1, policy_version 1918368 (0.0010) [2023-12-26 15:00:46,210][123091] Updated weights for policy 0, policy_version 1930421 (0.0008) [2023-12-26 15:00:46,271][123091] Updated weights for policy 0, policy_version 1930431 (0.0005) [2023-12-26 15:00:46,329][123091] Updated weights for policy 0, policy_version 1930441 (0.0005) [2023-12-26 15:00:46,755][123090] Updated weights for policy 1, policy_version 1918378 (0.0005) [2023-12-26 15:00:46,803][123090] Updated weights for policy 1, policy_version 1918388 (0.0006) [2023-12-26 15:00:46,855][123090] Updated weights for policy 1, policy_version 1918399 (0.0006) [2023-12-26 15:00:46,928][123091] Updated weights for policy 0, policy_version 1930451 (0.0007) [2023-12-26 15:00:46,984][123091] Updated weights for policy 0, policy_version 1930461 (0.0008) [2023-12-26 15:00:47,047][123091] Updated weights for policy 0, policy_version 1930471 (0.0005) [2023-12-26 15:00:47,542][123090] Updated weights for policy 1, policy_version 1918409 (0.0005) [2023-12-26 15:00:47,591][123090] Updated weights for policy 1, policy_version 1918419 (0.0005) [2023-12-26 15:00:47,643][123090] Updated weights for policy 1, policy_version 1918429 (0.0005) [2023-12-26 15:00:47,740][123091] Updated weights for policy 0, policy_version 1930481 (0.0005) [2023-12-26 15:00:47,805][123091] Updated weights for policy 0, policy_version 1930491 (0.0005) [2023-12-26 15:00:47,866][123091] Updated weights for policy 0, policy_version 1930501 (0.0006) [2023-12-26 15:00:47,910][123091] Updated weights for policy 0, policy_version 1930511 (0.0005) [2023-12-26 15:00:48,432][123090] Updated weights for policy 1, policy_version 1918439 (0.0006) [2023-12-26 15:00:48,495][123090] Updated weights for policy 1, policy_version 1918449 (0.0005) [2023-12-26 15:00:48,558][123090] Updated weights for policy 1, policy_version 1918459 (0.0006) [2023-12-26 15:00:48,649][123091] Updated weights for policy 0, policy_version 1930521 (0.0007) [2023-12-26 15:00:48,722][123091] Updated weights for policy 0, policy_version 1930531 (0.0006) [2023-12-26 15:00:48,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 985341952. Throughput: 0: 9086.9, 1: 8892.0. Samples: 985356676. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:00:48,785][121949] Avg episode reward: [(0, '6293.806'), (1, '5650.308')] [2023-12-26 15:00:48,790][123091] Updated weights for policy 0, policy_version 1930541 (0.0008) [2023-12-26 15:00:49,152][123090] Updated weights for policy 1, policy_version 1918469 (0.0006) [2023-12-26 15:00:49,210][123090] Updated weights for policy 1, policy_version 1918479 (0.0006) [2023-12-26 15:00:49,281][123090] Updated weights for policy 1, policy_version 1918489 (0.0007) [2023-12-26 15:00:49,470][123091] Updated weights for policy 0, policy_version 1930551 (0.0009) [2023-12-26 15:00:49,527][123091] Updated weights for policy 0, policy_version 1930561 (0.0008) [2023-12-26 15:00:49,584][123091] Updated weights for policy 0, policy_version 1930571 (0.0009) [2023-12-26 15:00:49,998][123090] Updated weights for policy 1, policy_version 1918499 (0.0007) [2023-12-26 15:00:50,065][123090] Updated weights for policy 1, policy_version 1918509 (0.0005) [2023-12-26 15:00:50,136][123090] Updated weights for policy 1, policy_version 1918519 (0.0007) [2023-12-26 15:00:50,461][123091] Updated weights for policy 0, policy_version 1930581 (0.0010) [2023-12-26 15:00:50,513][123091] Updated weights for policy 0, policy_version 1930591 (0.0009) [2023-12-26 15:00:50,577][123091] Updated weights for policy 0, policy_version 1930601 (0.0010) [2023-12-26 15:00:50,945][123090] Updated weights for policy 1, policy_version 1918529 (0.0010) [2023-12-26 15:00:51,013][123090] Updated weights for policy 1, policy_version 1918539 (0.0010) [2023-12-26 15:00:51,081][123090] Updated weights for policy 1, policy_version 1918549 (0.0010) [2023-12-26 15:00:51,151][123090] Updated weights for policy 1, policy_version 1918559 (0.0008) [2023-12-26 15:00:51,404][123091] Updated weights for policy 0, policy_version 1930611 (0.0010) [2023-12-26 15:00:51,463][123091] Updated weights for policy 0, policy_version 1930621 (0.0008) [2023-12-26 15:00:51,511][123091] Updated weights for policy 0, policy_version 1930631 (0.0009) [2023-12-26 15:00:52,022][123090] Updated weights for policy 1, policy_version 1918569 (0.0009) [2023-12-26 15:00:52,091][123090] Updated weights for policy 1, policy_version 1918579 (0.0008) [2023-12-26 15:00:52,158][123090] Updated weights for policy 1, policy_version 1918589 (0.0007) [2023-12-26 15:00:52,375][123091] Updated weights for policy 0, policy_version 1930641 (0.0009) [2023-12-26 15:00:52,443][123091] Updated weights for policy 0, policy_version 1930651 (0.0009) [2023-12-26 15:00:52,515][123091] Updated weights for policy 0, policy_version 1930661 (0.0010) [2023-12-26 15:00:52,581][123091] Updated weights for policy 0, policy_version 1930671 (0.0010) [2023-12-26 15:00:52,909][123090] Updated weights for policy 1, policy_version 1918599 (0.0006) [2023-12-26 15:00:52,965][123090] Updated weights for policy 1, policy_version 1918609 (0.0009) [2023-12-26 15:00:53,019][123090] Updated weights for policy 1, policy_version 1918619 (0.0009) [2023-12-26 15:00:53,455][123091] Updated weights for policy 0, policy_version 1930681 (0.0009) [2023-12-26 15:00:53,513][123091] Updated weights for policy 0, policy_version 1930691 (0.0009) [2023-12-26 15:00:53,574][123091] Updated weights for policy 0, policy_version 1930701 (0.0009) [2023-12-26 15:00:53,773][123090] Updated weights for policy 1, policy_version 1918629 (0.0009) [2023-12-26 15:00:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 985432064. Throughput: 0: 9054.6, 1: 8878.2. Samples: 985409992. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:00:53,785][121949] Avg episode reward: [(0, '6264.788'), (1, '5528.176')] [2023-12-26 15:00:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001930704_494264320.pth... [2023-12-26 15:00:53,792][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001929648_493993984.pth [2023-12-26 15:00:53,831][123090] Updated weights for policy 1, policy_version 1918639 (0.0009) [2023-12-26 15:00:53,889][123090] Updated weights for policy 1, policy_version 1918649 (0.0010) [2023-12-26 15:00:53,920][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001918656_491175936.pth... [2023-12-26 15:00:53,923][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001917600_490905600.pth [2023-12-26 15:00:54,455][123091] Updated weights for policy 0, policy_version 1930711 (0.0010) [2023-12-26 15:00:54,511][123091] Updated weights for policy 0, policy_version 1930721 (0.0009) [2023-12-26 15:00:54,578][123091] Updated weights for policy 0, policy_version 1930731 (0.0009) [2023-12-26 15:00:54,706][123090] Updated weights for policy 1, policy_version 1918659 (0.0009) [2023-12-26 15:00:54,763][123090] Updated weights for policy 1, policy_version 1918669 (0.0010) [2023-12-26 15:00:54,835][123090] Updated weights for policy 1, policy_version 1918679 (0.0010) [2023-12-26 15:00:55,411][123091] Updated weights for policy 0, policy_version 1930741 (0.0009) [2023-12-26 15:00:55,457][123091] Updated weights for policy 0, policy_version 1930751 (0.0009) [2023-12-26 15:00:55,491][123090] Updated weights for policy 1, policy_version 1918689 (0.0009) [2023-12-26 15:00:55,518][123091] Updated weights for policy 0, policy_version 1930761 (0.0005) [2023-12-26 15:00:55,554][123090] Updated weights for policy 1, policy_version 1918699 (0.0005) [2023-12-26 15:00:55,608][123090] Updated weights for policy 1, policy_version 1918709 (0.0005) [2023-12-26 15:00:55,666][123090] Updated weights for policy 1, policy_version 1918719 (0.0010) [2023-12-26 15:00:56,198][123091] Updated weights for policy 0, policy_version 1930771 (0.0006) [2023-12-26 15:00:56,247][123091] Updated weights for policy 0, policy_version 1930781 (0.0005) [2023-12-26 15:00:56,297][123091] Updated weights for policy 0, policy_version 1930791 (0.0005) [2023-12-26 15:00:56,426][123090] Updated weights for policy 1, policy_version 1918729 (0.0010) [2023-12-26 15:00:56,473][123090] Updated weights for policy 1, policy_version 1918739 (0.0010) [2023-12-26 15:00:56,520][123090] Updated weights for policy 1, policy_version 1918749 (0.0010) [2023-12-26 15:00:57,002][123091] Updated weights for policy 0, policy_version 1930801 (0.0006) [2023-12-26 15:00:57,048][123091] Updated weights for policy 0, policy_version 1930811 (0.0010) [2023-12-26 15:00:57,091][123091] Updated weights for policy 0, policy_version 1930821 (0.0010) [2023-12-26 15:00:57,135][123091] Updated weights for policy 0, policy_version 1930831 (0.0010) [2023-12-26 15:00:57,261][123090] Updated weights for policy 1, policy_version 1918759 (0.0009) [2023-12-26 15:00:57,315][123090] Updated weights for policy 1, policy_version 1918769 (0.0009) [2023-12-26 15:00:57,367][123090] Updated weights for policy 1, policy_version 1918779 (0.0009) [2023-12-26 15:00:57,965][123091] Updated weights for policy 0, policy_version 1930841 (0.0008) [2023-12-26 15:00:58,018][123091] Updated weights for policy 0, policy_version 1930851 (0.0009) [2023-12-26 15:00:58,077][123091] Updated weights for policy 0, policy_version 1930862 (0.0010) [2023-12-26 15:00:58,195][123090] Updated weights for policy 1, policy_version 1918789 (0.0008) [2023-12-26 15:00:58,258][123090] Updated weights for policy 1, policy_version 1918799 (0.0007) [2023-12-26 15:00:58,325][123090] Updated weights for policy 1, policy_version 1918809 (0.0008) [2023-12-26 15:00:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 985522176. Throughput: 0: 9029.0, 1: 8922.8. Samples: 985518084. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:00:58,785][121949] Avg episode reward: [(0, '6283.989'), (1, '5785.550')] [2023-12-26 15:00:58,930][123091] Updated weights for policy 0, policy_version 1930872 (0.0010) [2023-12-26 15:00:58,980][123091] Updated weights for policy 0, policy_version 1930882 (0.0009) [2023-12-26 15:00:59,035][123091] Updated weights for policy 0, policy_version 1930892 (0.0009) [2023-12-26 15:00:59,208][123090] Updated weights for policy 1, policy_version 1918819 (0.0009) [2023-12-26 15:00:59,277][123090] Updated weights for policy 1, policy_version 1918829 (0.0011) [2023-12-26 15:00:59,321][123090] Updated weights for policy 1, policy_version 1918839 (0.0010) [2023-12-26 15:00:59,889][123091] Updated weights for policy 0, policy_version 1930902 (0.0008) [2023-12-26 15:00:59,948][123091] Updated weights for policy 0, policy_version 1930913 (0.0010) [2023-12-26 15:01:00,012][123091] Updated weights for policy 0, policy_version 1930923 (0.0010) [2023-12-26 15:01:00,158][123090] Updated weights for policy 1, policy_version 1918849 (0.0010) [2023-12-26 15:01:00,216][123090] Updated weights for policy 1, policy_version 1918859 (0.0009) [2023-12-26 15:01:00,265][123090] Updated weights for policy 1, policy_version 1918869 (0.0009) [2023-12-26 15:01:00,320][123090] Updated weights for policy 1, policy_version 1918879 (0.0009) [2023-12-26 15:01:00,871][123091] Updated weights for policy 0, policy_version 1930933 (0.0010) [2023-12-26 15:01:00,934][123091] Updated weights for policy 0, policy_version 1930943 (0.0010) [2023-12-26 15:01:00,987][123091] Updated weights for policy 0, policy_version 1930955 (0.0010) [2023-12-26 15:01:01,074][123090] Updated weights for policy 1, policy_version 1918889 (0.0007) [2023-12-26 15:01:01,140][123090] Updated weights for policy 1, policy_version 1918899 (0.0009) [2023-12-26 15:01:01,198][123090] Updated weights for policy 1, policy_version 1918909 (0.0009) [2023-12-26 15:01:01,849][123091] Updated weights for policy 0, policy_version 1930965 (0.0010) [2023-12-26 15:01:01,910][123091] Updated weights for policy 0, policy_version 1930975 (0.0009) [2023-12-26 15:01:01,971][123091] Updated weights for policy 0, policy_version 1930985 (0.0009) [2023-12-26 15:01:02,005][123090] Updated weights for policy 1, policy_version 1918919 (0.0009) [2023-12-26 15:01:02,067][123090] Updated weights for policy 1, policy_version 1918929 (0.0009) [2023-12-26 15:01:02,123][123090] Updated weights for policy 1, policy_version 1918939 (0.0009) [2023-12-26 15:01:02,754][123091] Updated weights for policy 0, policy_version 1930995 (0.0008) [2023-12-26 15:01:02,819][123091] Updated weights for policy 0, policy_version 1931005 (0.0006) [2023-12-26 15:01:02,882][123091] Updated weights for policy 0, policy_version 1931015 (0.0006) [2023-12-26 15:01:02,976][123090] Updated weights for policy 1, policy_version 1918949 (0.0009) [2023-12-26 15:01:03,037][123090] Updated weights for policy 1, policy_version 1918959 (0.0010) [2023-12-26 15:01:03,090][123090] Updated weights for policy 1, policy_version 1918969 (0.0009) [2023-12-26 15:01:03,556][123091] Updated weights for policy 0, policy_version 1931025 (0.0006) [2023-12-26 15:01:03,607][123091] Updated weights for policy 0, policy_version 1931035 (0.0006) [2023-12-26 15:01:03,669][123091] Updated weights for policy 0, policy_version 1931045 (0.0007) [2023-12-26 15:01:03,729][123091] Updated weights for policy 0, policy_version 1931055 (0.0005) [2023-12-26 15:01:03,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 985612288. Throughput: 0: 9011.0, 1: 8901.7. Samples: 985622688. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:03,784][121949] Avg episode reward: [(0, '6340.596'), (1, '5896.054')] [2023-12-26 15:01:03,822][123090] Updated weights for policy 1, policy_version 1918979 (0.0008) [2023-12-26 15:01:03,886][123090] Updated weights for policy 1, policy_version 1918989 (0.0007) [2023-12-26 15:01:03,958][123090] Updated weights for policy 1, policy_version 1918999 (0.0006) [2023-12-26 15:01:04,472][123091] Updated weights for policy 0, policy_version 1931065 (0.0007) [2023-12-26 15:01:04,539][123091] Updated weights for policy 0, policy_version 1931075 (0.0011) [2023-12-26 15:01:04,602][123091] Updated weights for policy 0, policy_version 1931085 (0.0011) [2023-12-26 15:01:04,678][123090] Updated weights for policy 1, policy_version 1919009 (0.0006) [2023-12-26 15:01:04,727][123090] Updated weights for policy 1, policy_version 1919019 (0.0005) [2023-12-26 15:01:04,776][123090] Updated weights for policy 1, policy_version 1919029 (0.0005) [2023-12-26 15:01:04,824][123090] Updated weights for policy 1, policy_version 1919039 (0.0006) [2023-12-26 15:01:05,343][123091] Updated weights for policy 0, policy_version 1931095 (0.0010) [2023-12-26 15:01:05,394][123091] Updated weights for policy 0, policy_version 1931105 (0.0010) [2023-12-26 15:01:05,449][123091] Updated weights for policy 0, policy_version 1931115 (0.0010) [2023-12-26 15:01:05,487][123090] Updated weights for policy 1, policy_version 1919049 (0.0010) [2023-12-26 15:01:05,542][123090] Updated weights for policy 1, policy_version 1919061 (0.0011) [2023-12-26 15:01:05,598][123090] Updated weights for policy 1, policy_version 1919071 (0.0008) [2023-12-26 15:01:06,287][123091] Updated weights for policy 0, policy_version 1931125 (0.0009) [2023-12-26 15:01:06,349][123091] Updated weights for policy 0, policy_version 1931135 (0.0005) [2023-12-26 15:01:06,399][123090] Updated weights for policy 1, policy_version 1919081 (0.0012) [2023-12-26 15:01:06,409][123091] Updated weights for policy 0, policy_version 1931145 (0.0005) [2023-12-26 15:01:06,449][123090] Updated weights for policy 1, policy_version 1919091 (0.0009) [2023-12-26 15:01:06,511][123090] Updated weights for policy 1, policy_version 1919101 (0.0010) [2023-12-26 15:01:07,208][123091] Updated weights for policy 0, policy_version 1931155 (0.0007) [2023-12-26 15:01:07,271][123091] Updated weights for policy 0, policy_version 1931165 (0.0009) [2023-12-26 15:01:07,275][123090] Updated weights for policy 1, policy_version 1919111 (0.0007) [2023-12-26 15:01:07,327][123091] Updated weights for policy 0, policy_version 1931175 (0.0009) [2023-12-26 15:01:07,349][123090] Updated weights for policy 1, policy_version 1919121 (0.0006) [2023-12-26 15:01:07,415][123090] Updated weights for policy 1, policy_version 1919131 (0.0008) [2023-12-26 15:01:08,146][123090] Updated weights for policy 1, policy_version 1919141 (0.0010) [2023-12-26 15:01:08,154][123091] Updated weights for policy 0, policy_version 1931185 (0.0009) [2023-12-26 15:01:08,206][123090] Updated weights for policy 1, policy_version 1919151 (0.0007) [2023-12-26 15:01:08,209][123091] Updated weights for policy 0, policy_version 1931195 (0.0009) [2023-12-26 15:01:08,259][123091] Updated weights for policy 0, policy_version 1931205 (0.0009) [2023-12-26 15:01:08,271][123090] Updated weights for policy 1, policy_version 1919161 (0.0008) [2023-12-26 15:01:08,310][123091] Updated weights for policy 0, policy_version 1931215 (0.0008) [2023-12-26 15:01:08,785][121949] Fps is (10 sec: 18021.5, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 985702400. Throughput: 0: 9027.5, 1: 8985.5. Samples: 985679288. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:08,786][121949] Avg episode reward: [(0, '6320.681'), (1, '5784.326')] [2023-12-26 15:01:08,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001931216_494395392.pth... [2023-12-26 15:01:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001919168_491307008.pth... [2023-12-26 15:01:08,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001918112_491036672.pth [2023-12-26 15:01:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001930160_494125056.pth [2023-12-26 15:01:08,987][123090] Updated weights for policy 1, policy_version 1919171 (0.0009) [2023-12-26 15:01:09,043][123090] Updated weights for policy 1, policy_version 1919181 (0.0009) [2023-12-26 15:01:09,105][123090] Updated weights for policy 1, policy_version 1919191 (0.0008) [2023-12-26 15:01:09,231][123091] Updated weights for policy 0, policy_version 1931225 (0.0009) [2023-12-26 15:01:09,299][123091] Updated weights for policy 0, policy_version 1931235 (0.0010) [2023-12-26 15:01:09,369][123091] Updated weights for policy 0, policy_version 1931245 (0.0009) [2023-12-26 15:01:09,915][123090] Updated weights for policy 1, policy_version 1919201 (0.0009) [2023-12-26 15:01:09,985][123090] Updated weights for policy 1, policy_version 1919211 (0.0010) [2023-12-26 15:01:10,055][123090] Updated weights for policy 1, policy_version 1919221 (0.0009) [2023-12-26 15:01:10,128][123090] Updated weights for policy 1, policy_version 1919231 (0.0009) [2023-12-26 15:01:10,228][123091] Updated weights for policy 0, policy_version 1931255 (0.0007) [2023-12-26 15:01:10,292][123091] Updated weights for policy 0, policy_version 1931265 (0.0008) [2023-12-26 15:01:10,358][123091] Updated weights for policy 0, policy_version 1931275 (0.0009) [2023-12-26 15:01:10,945][123090] Updated weights for policy 1, policy_version 1919241 (0.0010) [2023-12-26 15:01:11,003][123090] Updated weights for policy 1, policy_version 1919251 (0.0010) [2023-12-26 15:01:11,068][123090] Updated weights for policy 1, policy_version 1919261 (0.0009) [2023-12-26 15:01:11,113][123091] Updated weights for policy 0, policy_version 1931285 (0.0010) [2023-12-26 15:01:11,178][123091] Updated weights for policy 0, policy_version 1931295 (0.0009) [2023-12-26 15:01:11,236][123091] Updated weights for policy 0, policy_version 1931305 (0.0009) [2023-12-26 15:01:11,954][123090] Updated weights for policy 1, policy_version 1919271 (0.0009) [2023-12-26 15:01:12,009][123090] Updated weights for policy 1, policy_version 1919281 (0.0010) [2023-12-26 15:01:12,070][123090] Updated weights for policy 1, policy_version 1919291 (0.0009) [2023-12-26 15:01:12,128][123091] Updated weights for policy 0, policy_version 1931315 (0.0010) [2023-12-26 15:01:12,199][123091] Updated weights for policy 0, policy_version 1931325 (0.0009) [2023-12-26 15:01:12,266][123091] Updated weights for policy 0, policy_version 1931335 (0.0009) [2023-12-26 15:01:12,905][123090] Updated weights for policy 1, policy_version 1919301 (0.0009) [2023-12-26 15:01:12,967][123090] Updated weights for policy 1, policy_version 1919311 (0.0010) [2023-12-26 15:01:13,028][123090] Updated weights for policy 1, policy_version 1919321 (0.0009) [2023-12-26 15:01:13,110][123091] Updated weights for policy 0, policy_version 1931345 (0.0009) [2023-12-26 15:01:13,167][123091] Updated weights for policy 0, policy_version 1931355 (0.0005) [2023-12-26 15:01:13,233][123091] Updated weights for policy 0, policy_version 1931365 (0.0006) [2023-12-26 15:01:13,293][123091] Updated weights for policy 0, policy_version 1931375 (0.0009) [2023-12-26 15:01:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17883.6). Total num frames: 985784320. Throughput: 0: 8884.9, 1: 8922.8. Samples: 985781932. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:13,785][121949] Avg episode reward: [(0, '6320.292'), (1, '5831.462')] [2023-12-26 15:01:13,876][123090] Updated weights for policy 1, policy_version 1919331 (0.0009) [2023-12-26 15:01:13,942][123090] Updated weights for policy 1, policy_version 1919341 (0.0009) [2023-12-26 15:01:14,006][123090] Updated weights for policy 1, policy_version 1919351 (0.0009) [2023-12-26 15:01:14,027][123091] Updated weights for policy 0, policy_version 1931385 (0.0008) [2023-12-26 15:01:14,080][123091] Updated weights for policy 0, policy_version 1931395 (0.0009) [2023-12-26 15:01:14,143][123091] Updated weights for policy 0, policy_version 1931405 (0.0009) [2023-12-26 15:01:14,776][123090] Updated weights for policy 1, policy_version 1919361 (0.0009) [2023-12-26 15:01:14,829][123090] Updated weights for policy 1, policy_version 1919371 (0.0007) [2023-12-26 15:01:14,891][123090] Updated weights for policy 1, policy_version 1919381 (0.0007) [2023-12-26 15:01:14,947][123090] Updated weights for policy 1, policy_version 1919391 (0.0010) [2023-12-26 15:01:15,046][123091] Updated weights for policy 0, policy_version 1931415 (0.0009) [2023-12-26 15:01:15,094][123091] Updated weights for policy 0, policy_version 1931425 (0.0009) [2023-12-26 15:01:15,159][123091] Updated weights for policy 0, policy_version 1931435 (0.0009) [2023-12-26 15:01:15,782][123090] Updated weights for policy 1, policy_version 1919401 (0.0010) [2023-12-26 15:01:15,826][123090] Updated weights for policy 1, policy_version 1919411 (0.0010) [2023-12-26 15:01:15,881][123090] Updated weights for policy 1, policy_version 1919421 (0.0010) [2023-12-26 15:01:16,007][123091] Updated weights for policy 0, policy_version 1931445 (0.0009) [2023-12-26 15:01:16,072][123091] Updated weights for policy 0, policy_version 1931455 (0.0009) [2023-12-26 15:01:16,123][123091] Updated weights for policy 0, policy_version 1931465 (0.0009) [2023-12-26 15:01:16,742][123090] Updated weights for policy 1, policy_version 1919431 (0.0007) [2023-12-26 15:01:16,801][123090] Updated weights for policy 1, policy_version 1919441 (0.0005) [2023-12-26 15:01:16,857][123090] Updated weights for policy 1, policy_version 1919451 (0.0005) [2023-12-26 15:01:16,951][123091] Updated weights for policy 0, policy_version 1931475 (0.0008) [2023-12-26 15:01:16,998][123091] Updated weights for policy 0, policy_version 1931485 (0.0005) [2023-12-26 15:01:17,045][123091] Updated weights for policy 0, policy_version 1931495 (0.0005) [2023-12-26 15:01:17,566][123090] Updated weights for policy 1, policy_version 1919461 (0.0010) [2023-12-26 15:01:17,617][123090] Updated weights for policy 1, policy_version 1919471 (0.0010) [2023-12-26 15:01:17,676][123090] Updated weights for policy 1, policy_version 1919481 (0.0010) [2023-12-26 15:01:17,701][123091] Updated weights for policy 0, policy_version 1931505 (0.0005) [2023-12-26 15:01:17,764][123091] Updated weights for policy 0, policy_version 1931515 (0.0006) [2023-12-26 15:01:17,829][123091] Updated weights for policy 0, policy_version 1931525 (0.0006) [2023-12-26 15:01:17,877][123091] Updated weights for policy 0, policy_version 1931535 (0.0006) [2023-12-26 15:01:18,444][123090] Updated weights for policy 1, policy_version 1919491 (0.0010) [2023-12-26 15:01:18,513][123090] Updated weights for policy 1, policy_version 1919501 (0.0009) [2023-12-26 15:01:18,583][123090] Updated weights for policy 1, policy_version 1919511 (0.0007) [2023-12-26 15:01:18,626][123091] Updated weights for policy 0, policy_version 1931545 (0.0005) [2023-12-26 15:01:18,697][123091] Updated weights for policy 0, policy_version 1931555 (0.0006) [2023-12-26 15:01:18,770][123091] Updated weights for policy 0, policy_version 1931565 (0.0006) [2023-12-26 15:01:18,784][121949] Fps is (10 sec: 17203.9, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 985874432. Throughput: 0: 8901.5, 1: 8921.4. Samples: 985888060. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:18,785][121949] Avg episode reward: [(0, '6239.595'), (1, '5726.386')] [2023-12-26 15:01:19,448][123090] Updated weights for policy 1, policy_version 1919521 (0.0009) [2023-12-26 15:01:19,516][123090] Updated weights for policy 1, policy_version 1919531 (0.0010) [2023-12-26 15:01:19,523][123091] Updated weights for policy 0, policy_version 1931575 (0.0009) [2023-12-26 15:01:19,577][123090] Updated weights for policy 1, policy_version 1919541 (0.0008) [2023-12-26 15:01:19,579][123091] Updated weights for policy 0, policy_version 1931585 (0.0011) [2023-12-26 15:01:19,641][123090] Updated weights for policy 1, policy_version 1919551 (0.0006) [2023-12-26 15:01:19,643][123091] Updated weights for policy 0, policy_version 1931595 (0.0011) [2023-12-26 15:01:20,364][123091] Updated weights for policy 0, policy_version 1931605 (0.0008) [2023-12-26 15:01:20,409][123090] Updated weights for policy 1, policy_version 1919561 (0.0007) [2023-12-26 15:01:20,431][123091] Updated weights for policy 0, policy_version 1931615 (0.0008) [2023-12-26 15:01:20,465][123090] Updated weights for policy 1, policy_version 1919571 (0.0005) [2023-12-26 15:01:20,505][123091] Updated weights for policy 0, policy_version 1931625 (0.0009) [2023-12-26 15:01:20,534][123090] Updated weights for policy 1, policy_version 1919581 (0.0006) [2023-12-26 15:01:21,246][123091] Updated weights for policy 0, policy_version 1931635 (0.0010) [2023-12-26 15:01:21,294][123090] Updated weights for policy 1, policy_version 1919591 (0.0007) [2023-12-26 15:01:21,316][123091] Updated weights for policy 0, policy_version 1931645 (0.0006) [2023-12-26 15:01:21,366][123090] Updated weights for policy 1, policy_version 1919601 (0.0008) [2023-12-26 15:01:21,402][123091] Updated weights for policy 0, policy_version 1931655 (0.0007) [2023-12-26 15:01:21,439][123090] Updated weights for policy 1, policy_version 1919611 (0.0008) [2023-12-26 15:01:22,112][123091] Updated weights for policy 0, policy_version 1931665 (0.0006) [2023-12-26 15:01:22,165][123091] Updated weights for policy 0, policy_version 1931675 (0.0006) [2023-12-26 15:01:22,217][123091] Updated weights for policy 0, policy_version 1931685 (0.0005) [2023-12-26 15:01:22,267][123090] Updated weights for policy 1, policy_version 1919621 (0.0007) [2023-12-26 15:01:22,283][123091] Updated weights for policy 0, policy_version 1931695 (0.0007) [2023-12-26 15:01:22,332][123090] Updated weights for policy 1, policy_version 1919631 (0.0009) [2023-12-26 15:01:22,406][123090] Updated weights for policy 1, policy_version 1919641 (0.0009) [2023-12-26 15:01:23,086][123091] Updated weights for policy 0, policy_version 1931705 (0.0011) [2023-12-26 15:01:23,142][123091] Updated weights for policy 0, policy_version 1931715 (0.0011) [2023-12-26 15:01:23,197][123091] Updated weights for policy 0, policy_version 1931725 (0.0010) [2023-12-26 15:01:23,245][123090] Updated weights for policy 1, policy_version 1919651 (0.0008) [2023-12-26 15:01:23,314][123090] Updated weights for policy 1, policy_version 1919661 (0.0009) [2023-12-26 15:01:23,376][123090] Updated weights for policy 1, policy_version 1919671 (0.0009) [2023-12-26 15:01:23,784][121949] Fps is (10 sec: 18021.9, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 985964544. Throughput: 0: 8861.6, 1: 8918.2. Samples: 985941856. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:23,785][121949] Avg episode reward: [(0, '6308.276'), (1, '5708.808')] [2023-12-26 15:01:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001919680_491438080.pth... [2023-12-26 15:01:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001931728_494526464.pth... [2023-12-26 15:01:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001918656_491175936.pth [2023-12-26 15:01:23,802][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001930704_494264320.pth [2023-12-26 15:01:23,902][123091] Updated weights for policy 0, policy_version 1931735 (0.0010) [2023-12-26 15:01:23,957][123091] Updated weights for policy 0, policy_version 1931745 (0.0010) [2023-12-26 15:01:24,024][123091] Updated weights for policy 0, policy_version 1931755 (0.0011) [2023-12-26 15:01:24,115][123090] Updated weights for policy 1, policy_version 1919681 (0.0009) [2023-12-26 15:01:24,176][123090] Updated weights for policy 1, policy_version 1919691 (0.0009) [2023-12-26 15:01:24,232][123090] Updated weights for policy 1, policy_version 1919701 (0.0009) [2023-12-26 15:01:24,282][123090] Updated weights for policy 1, policy_version 1919711 (0.0009) [2023-12-26 15:01:24,816][123091] Updated weights for policy 0, policy_version 1931765 (0.0011) [2023-12-26 15:01:24,880][123091] Updated weights for policy 0, policy_version 1931775 (0.0011) [2023-12-26 15:01:24,944][123091] Updated weights for policy 0, policy_version 1931785 (0.0011) [2023-12-26 15:01:25,163][123090] Updated weights for policy 1, policy_version 1919721 (0.0009) [2023-12-26 15:01:25,227][123090] Updated weights for policy 1, policy_version 1919731 (0.0010) [2023-12-26 15:01:25,299][123090] Updated weights for policy 1, policy_version 1919741 (0.0009) [2023-12-26 15:01:25,687][123091] Updated weights for policy 0, policy_version 1931795 (0.0009) [2023-12-26 15:01:25,752][123091] Updated weights for policy 0, policy_version 1931805 (0.0005) [2023-12-26 15:01:25,812][123091] Updated weights for policy 0, policy_version 1931815 (0.0007) [2023-12-26 15:01:26,218][123090] Updated weights for policy 1, policy_version 1919751 (0.0007) [2023-12-26 15:01:26,285][123090] Updated weights for policy 1, policy_version 1919761 (0.0006) [2023-12-26 15:01:26,362][123090] Updated weights for policy 1, policy_version 1919771 (0.0005) [2023-12-26 15:01:26,467][123091] Updated weights for policy 0, policy_version 1931825 (0.0010) [2023-12-26 15:01:26,521][123091] Updated weights for policy 0, policy_version 1931835 (0.0005) [2023-12-26 15:01:26,567][123091] Updated weights for policy 0, policy_version 1931845 (0.0005) [2023-12-26 15:01:26,615][123091] Updated weights for policy 0, policy_version 1931855 (0.0005) [2023-12-26 15:01:26,997][123090] Updated weights for policy 1, policy_version 1919781 (0.0005) [2023-12-26 15:01:27,048][123090] Updated weights for policy 1, policy_version 1919791 (0.0005) [2023-12-26 15:01:27,099][123090] Updated weights for policy 1, policy_version 1919801 (0.0005) [2023-12-26 15:01:27,267][123091] Updated weights for policy 0, policy_version 1931865 (0.0005) [2023-12-26 15:01:27,327][123091] Updated weights for policy 0, policy_version 1931875 (0.0006) [2023-12-26 15:01:27,389][123091] Updated weights for policy 0, policy_version 1931885 (0.0010) [2023-12-26 15:01:27,840][123090] Updated weights for policy 1, policy_version 1919811 (0.0007) [2023-12-26 15:01:27,891][123090] Updated weights for policy 1, policy_version 1919821 (0.0010) [2023-12-26 15:01:27,942][123090] Updated weights for policy 1, policy_version 1919831 (0.0010) [2023-12-26 15:01:28,032][123091] Updated weights for policy 0, policy_version 1931895 (0.0007) [2023-12-26 15:01:28,078][123091] Updated weights for policy 0, policy_version 1931905 (0.0005) [2023-12-26 15:01:28,133][123091] Updated weights for policy 0, policy_version 1931915 (0.0005) [2023-12-26 15:01:28,782][123090] Updated weights for policy 1, policy_version 1919841 (0.0010) [2023-12-26 15:01:28,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 986054656. Throughput: 0: 9004.0, 1: 8944.3. Samples: 986052388. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:28,784][121949] Avg episode reward: [(0, '6248.984'), (1, '5621.982')] [2023-12-26 15:01:28,845][123090] Updated weights for policy 1, policy_version 1919851 (0.0010) [2023-12-26 15:01:28,912][123090] Updated weights for policy 1, policy_version 1919861 (0.0011) [2023-12-26 15:01:28,915][123091] Updated weights for policy 0, policy_version 1931925 (0.0008) [2023-12-26 15:01:28,971][123091] Updated weights for policy 0, policy_version 1931935 (0.0011) [2023-12-26 15:01:28,971][123090] Updated weights for policy 1, policy_version 1919871 (0.0011) [2023-12-26 15:01:29,025][123091] Updated weights for policy 0, policy_version 1931945 (0.0010) [2023-12-26 15:01:29,757][123091] Updated weights for policy 0, policy_version 1931955 (0.0008) [2023-12-26 15:01:29,816][123091] Updated weights for policy 0, policy_version 1931965 (0.0011) [2023-12-26 15:01:29,828][123090] Updated weights for policy 1, policy_version 1919881 (0.0007) [2023-12-26 15:01:29,879][123091] Updated weights for policy 0, policy_version 1931975 (0.0011) [2023-12-26 15:01:29,892][123090] Updated weights for policy 1, policy_version 1919891 (0.0008) [2023-12-26 15:01:29,950][123090] Updated weights for policy 1, policy_version 1919901 (0.0011) [2023-12-26 15:01:30,697][123091] Updated weights for policy 0, policy_version 1931985 (0.0010) [2023-12-26 15:01:30,707][123090] Updated weights for policy 1, policy_version 1919911 (0.0010) [2023-12-26 15:01:30,745][123091] Updated weights for policy 0, policy_version 1931995 (0.0010) [2023-12-26 15:01:30,758][123090] Updated weights for policy 1, policy_version 1919921 (0.0010) [2023-12-26 15:01:30,795][123091] Updated weights for policy 0, policy_version 1932005 (0.0010) [2023-12-26 15:01:30,820][123090] Updated weights for policy 1, policy_version 1919931 (0.0010) [2023-12-26 15:01:30,846][123091] Updated weights for policy 0, policy_version 1932015 (0.0010) [2023-12-26 15:01:31,624][123090] Updated weights for policy 1, policy_version 1919941 (0.0010) [2023-12-26 15:01:31,695][123090] Updated weights for policy 1, policy_version 1919951 (0.0009) [2023-12-26 15:01:31,730][123091] Updated weights for policy 0, policy_version 1932025 (0.0011) [2023-12-26 15:01:31,756][123090] Updated weights for policy 1, policy_version 1919961 (0.0011) [2023-12-26 15:01:31,790][123091] Updated weights for policy 0, policy_version 1932035 (0.0010) [2023-12-26 15:01:31,848][123091] Updated weights for policy 0, policy_version 1932045 (0.0010) [2023-12-26 15:01:32,461][123090] Updated weights for policy 1, policy_version 1919971 (0.0008) [2023-12-26 15:01:32,512][123090] Updated weights for policy 1, policy_version 1919981 (0.0010) [2023-12-26 15:01:32,559][123090] Updated weights for policy 1, policy_version 1919991 (0.0010) [2023-12-26 15:01:32,646][123091] Updated weights for policy 0, policy_version 1932055 (0.0010) [2023-12-26 15:01:32,701][123091] Updated weights for policy 0, policy_version 1932065 (0.0010) [2023-12-26 15:01:32,766][123091] Updated weights for policy 0, policy_version 1932075 (0.0011) [2023-12-26 15:01:33,227][123090] Updated weights for policy 1, policy_version 1920001 (0.0008) [2023-12-26 15:01:33,279][123090] Updated weights for policy 1, policy_version 1920011 (0.0005) [2023-12-26 15:01:33,325][123090] Updated weights for policy 1, policy_version 1920021 (0.0005) [2023-12-26 15:01:33,392][123090] Updated weights for policy 1, policy_version 1920031 (0.0006) [2023-12-26 15:01:33,465][123091] Updated weights for policy 0, policy_version 1932085 (0.0008) [2023-12-26 15:01:33,528][123091] Updated weights for policy 0, policy_version 1932095 (0.0005) [2023-12-26 15:01:33,590][123091] Updated weights for policy 0, policy_version 1932105 (0.0005) [2023-12-26 15:01:33,784][121949] Fps is (10 sec: 18841.9, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 986152960. Throughput: 0: 8943.5, 1: 8959.5. Samples: 986162316. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:33,785][121949] Avg episode reward: [(0, '6196.768'), (1, '5717.705')] [2023-12-26 15:01:34,150][123090] Updated weights for policy 1, policy_version 1920041 (0.0010) [2023-12-26 15:01:34,178][123091] Updated weights for policy 0, policy_version 1932115 (0.0007) [2023-12-26 15:01:34,204][123090] Updated weights for policy 1, policy_version 1920051 (0.0009) [2023-12-26 15:01:34,241][123091] Updated weights for policy 0, policy_version 1932125 (0.0011) [2023-12-26 15:01:34,272][123090] Updated weights for policy 1, policy_version 1920061 (0.0011) [2023-12-26 15:01:34,305][123091] Updated weights for policy 0, policy_version 1932135 (0.0011) [2023-12-26 15:01:35,052][123091] Updated weights for policy 0, policy_version 1932145 (0.0010) [2023-12-26 15:01:35,112][123091] Updated weights for policy 0, policy_version 1932155 (0.0005) [2023-12-26 15:01:35,132][123090] Updated weights for policy 1, policy_version 1920071 (0.0011) [2023-12-26 15:01:35,164][123091] Updated weights for policy 0, policy_version 1932165 (0.0005) [2023-12-26 15:01:35,187][123090] Updated weights for policy 1, policy_version 1920081 (0.0010) [2023-12-26 15:01:35,225][123091] Updated weights for policy 0, policy_version 1932175 (0.0005) [2023-12-26 15:01:35,235][123090] Updated weights for policy 1, policy_version 1920091 (0.0010) [2023-12-26 15:01:35,830][123091] Updated weights for policy 0, policy_version 1932185 (0.0005) [2023-12-26 15:01:35,894][123090] Updated weights for policy 1, policy_version 1920101 (0.0008) [2023-12-26 15:01:35,898][123091] Updated weights for policy 0, policy_version 1932195 (0.0005) [2023-12-26 15:01:35,945][123090] Updated weights for policy 1, policy_version 1920111 (0.0005) [2023-12-26 15:01:35,949][123091] Updated weights for policy 0, policy_version 1932205 (0.0005) [2023-12-26 15:01:36,006][123090] Updated weights for policy 1, policy_version 1920121 (0.0005) [2023-12-26 15:01:36,726][123091] Updated weights for policy 0, policy_version 1932215 (0.0009) [2023-12-26 15:01:36,742][123090] Updated weights for policy 1, policy_version 1920131 (0.0005) [2023-12-26 15:01:36,786][123091] Updated weights for policy 0, policy_version 1932225 (0.0011) [2023-12-26 15:01:36,806][123090] Updated weights for policy 1, policy_version 1920141 (0.0007) [2023-12-26 15:01:36,851][123091] Updated weights for policy 0, policy_version 1932235 (0.0011) [2023-12-26 15:01:36,871][123090] Updated weights for policy 1, policy_version 1920151 (0.0006) [2023-12-26 15:01:37,645][123090] Updated weights for policy 1, policy_version 1920161 (0.0007) [2023-12-26 15:01:37,680][123091] Updated weights for policy 0, policy_version 1932245 (0.0008) [2023-12-26 15:01:37,699][123090] Updated weights for policy 1, policy_version 1920171 (0.0008) [2023-12-26 15:01:37,737][123091] Updated weights for policy 0, policy_version 1932255 (0.0006) [2023-12-26 15:01:37,760][123090] Updated weights for policy 1, policy_version 1920181 (0.0008) [2023-12-26 15:01:37,801][123091] Updated weights for policy 0, policy_version 1932265 (0.0005) [2023-12-26 15:01:37,835][123090] Updated weights for policy 1, policy_version 1920191 (0.0008) [2023-12-26 15:01:38,556][123091] Updated weights for policy 0, policy_version 1932275 (0.0007) [2023-12-26 15:01:38,615][123090] Updated weights for policy 1, policy_version 1920201 (0.0008) [2023-12-26 15:01:38,618][123091] Updated weights for policy 0, policy_version 1932285 (0.0010) [2023-12-26 15:01:38,667][123090] Updated weights for policy 1, policy_version 1920211 (0.0006) [2023-12-26 15:01:38,685][123091] Updated weights for policy 0, policy_version 1932295 (0.0010) [2023-12-26 15:01:38,723][123090] Updated weights for policy 1, policy_version 1920221 (0.0005) [2023-12-26 15:01:38,784][121949] Fps is (10 sec: 19660.7, 60 sec: 18159.0, 300 sec: 17966.9). Total num frames: 986251264. Throughput: 0: 9040.7, 1: 8962.1. Samples: 986220116. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:38,785][121949] Avg episode reward: [(0, '6268.730'), (1, '5748.217')] [2023-12-26 15:01:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001932304_494673920.pth... [2023-12-26 15:01:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001920224_491577344.pth... [2023-12-26 15:01:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001931216_494395392.pth [2023-12-26 15:01:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001919168_491307008.pth [2023-12-26 15:01:39,409][123091] Updated weights for policy 0, policy_version 1932305 (0.0010) [2023-12-26 15:01:39,475][123091] Updated weights for policy 0, policy_version 1932315 (0.0010) [2023-12-26 15:01:39,539][123091] Updated weights for policy 0, policy_version 1932325 (0.0011) [2023-12-26 15:01:39,604][123091] Updated weights for policy 0, policy_version 1932335 (0.0011) [2023-12-26 15:01:39,645][123090] Updated weights for policy 1, policy_version 1920231 (0.0009) [2023-12-26 15:01:39,717][123090] Updated weights for policy 1, policy_version 1920241 (0.0008) [2023-12-26 15:01:39,774][123090] Updated weights for policy 1, policy_version 1920251 (0.0009) [2023-12-26 15:01:40,460][123091] Updated weights for policy 0, policy_version 1932345 (0.0007) [2023-12-26 15:01:40,531][123091] Updated weights for policy 0, policy_version 1932355 (0.0006) [2023-12-26 15:01:40,601][123091] Updated weights for policy 0, policy_version 1932365 (0.0006) [2023-12-26 15:01:40,615][123090] Updated weights for policy 1, policy_version 1920261 (0.0007) [2023-12-26 15:01:40,672][123090] Updated weights for policy 1, policy_version 1920271 (0.0005) [2023-12-26 15:01:40,739][123090] Updated weights for policy 1, policy_version 1920281 (0.0005) [2023-12-26 15:01:41,226][123091] Updated weights for policy 0, policy_version 1932375 (0.0007) [2023-12-26 15:01:41,292][123091] Updated weights for policy 0, policy_version 1932385 (0.0011) [2023-12-26 15:01:41,349][123091] Updated weights for policy 0, policy_version 1932395 (0.0010) [2023-12-26 15:01:41,645][123090] Updated weights for policy 1, policy_version 1920291 (0.0010) [2023-12-26 15:01:41,712][123090] Updated weights for policy 1, policy_version 1920301 (0.0011) [2023-12-26 15:01:41,785][123090] Updated weights for policy 1, policy_version 1920311 (0.0010) [2023-12-26 15:01:42,188][123091] Updated weights for policy 0, policy_version 1932405 (0.0009) [2023-12-26 15:01:42,245][123091] Updated weights for policy 0, policy_version 1932415 (0.0009) [2023-12-26 15:01:42,308][123091] Updated weights for policy 0, policy_version 1932425 (0.0007) [2023-12-26 15:01:42,579][123090] Updated weights for policy 1, policy_version 1920321 (0.0010) [2023-12-26 15:01:42,634][123090] Updated weights for policy 1, policy_version 1920331 (0.0007) [2023-12-26 15:01:42,693][123090] Updated weights for policy 1, policy_version 1920341 (0.0010) [2023-12-26 15:01:42,745][123090] Updated weights for policy 1, policy_version 1920351 (0.0008) [2023-12-26 15:01:43,095][123091] Updated weights for policy 0, policy_version 1932435 (0.0007) [2023-12-26 15:01:43,146][123091] Updated weights for policy 0, policy_version 1932445 (0.0005) [2023-12-26 15:01:43,202][123091] Updated weights for policy 0, policy_version 1932455 (0.0007) [2023-12-26 15:01:43,426][123090] Updated weights for policy 1, policy_version 1920361 (0.0006) [2023-12-26 15:01:43,473][123090] Updated weights for policy 1, policy_version 1920371 (0.0005) [2023-12-26 15:01:43,521][123090] Updated weights for policy 1, policy_version 1920381 (0.0005) [2023-12-26 15:01:43,784][121949] Fps is (10 sec: 18022.2, 60 sec: 18022.3, 300 sec: 17911.3). Total num frames: 986333184. Throughput: 0: 9065.0, 1: 8868.2. Samples: 986325084. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:43,785][121949] Avg episode reward: [(0, '6284.371'), (1, '5904.089')] [2023-12-26 15:01:44,010][123091] Updated weights for policy 0, policy_version 1932465 (0.0010) [2023-12-26 15:01:44,065][123091] Updated weights for policy 0, policy_version 1932475 (0.0010) [2023-12-26 15:01:44,091][123090] Updated weights for policy 1, policy_version 1920391 (0.0006) [2023-12-26 15:01:44,131][123091] Updated weights for policy 0, policy_version 1932485 (0.0010) [2023-12-26 15:01:44,145][123090] Updated weights for policy 1, policy_version 1920401 (0.0006) [2023-12-26 15:01:44,197][123091] Updated weights for policy 0, policy_version 1932495 (0.0010) [2023-12-26 15:01:44,204][123090] Updated weights for policy 1, policy_version 1920411 (0.0005) [2023-12-26 15:01:44,993][123090] Updated weights for policy 1, policy_version 1920421 (0.0010) [2023-12-26 15:01:45,030][123091] Updated weights for policy 0, policy_version 1932505 (0.0007) [2023-12-26 15:01:45,049][123090] Updated weights for policy 1, policy_version 1920431 (0.0010) [2023-12-26 15:01:45,106][123091] Updated weights for policy 0, policy_version 1932515 (0.0006) [2023-12-26 15:01:45,114][123090] Updated weights for policy 1, policy_version 1920441 (0.0011) [2023-12-26 15:01:45,196][123091] Updated weights for policy 0, policy_version 1932525 (0.0008) [2023-12-26 15:01:45,852][123090] Updated weights for policy 1, policy_version 1920451 (0.0009) [2023-12-26 15:01:45,906][123090] Updated weights for policy 1, policy_version 1920461 (0.0005) [2023-12-26 15:01:45,956][123090] Updated weights for policy 1, policy_version 1920471 (0.0005) [2023-12-26 15:01:46,017][123091] Updated weights for policy 0, policy_version 1932535 (0.0007) [2023-12-26 15:01:46,064][123091] Updated weights for policy 0, policy_version 1932545 (0.0008) [2023-12-26 15:01:46,115][123091] Updated weights for policy 0, policy_version 1932555 (0.0008) [2023-12-26 15:01:46,690][123090] Updated weights for policy 1, policy_version 1920481 (0.0008) [2023-12-26 15:01:46,750][123090] Updated weights for policy 1, policy_version 1920491 (0.0005) [2023-12-26 15:01:46,825][123090] Updated weights for policy 1, policy_version 1920501 (0.0006) [2023-12-26 15:01:46,901][123090] Updated weights for policy 1, policy_version 1920511 (0.0006) [2023-12-26 15:01:46,939][123091] Updated weights for policy 0, policy_version 1932565 (0.0008) [2023-12-26 15:01:46,994][123091] Updated weights for policy 0, policy_version 1932575 (0.0010) [2023-12-26 15:01:47,052][123091] Updated weights for policy 0, policy_version 1932585 (0.0010) [2023-12-26 15:01:47,468][123090] Updated weights for policy 1, policy_version 1920521 (0.0006) [2023-12-26 15:01:47,532][123090] Updated weights for policy 1, policy_version 1920531 (0.0006) [2023-12-26 15:01:47,601][123090] Updated weights for policy 1, policy_version 1920541 (0.0006) [2023-12-26 15:01:47,754][123091] Updated weights for policy 0, policy_version 1932595 (0.0010) [2023-12-26 15:01:47,820][123091] Updated weights for policy 0, policy_version 1932605 (0.0010) [2023-12-26 15:01:47,885][123091] Updated weights for policy 0, policy_version 1932615 (0.0010) [2023-12-26 15:01:48,366][123090] Updated weights for policy 1, policy_version 1920551 (0.0009) [2023-12-26 15:01:48,433][123090] Updated weights for policy 1, policy_version 1920561 (0.0011) [2023-12-26 15:01:48,502][123090] Updated weights for policy 1, policy_version 1920571 (0.0011) [2023-12-26 15:01:48,696][123091] Updated weights for policy 0, policy_version 1932625 (0.0010) [2023-12-26 15:01:48,755][123091] Updated weights for policy 0, policy_version 1932635 (0.0011) [2023-12-26 15:01:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 986423296. Throughput: 0: 9072.9, 1: 9007.7. Samples: 986436316. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:48,785][121949] Avg episode reward: [(0, '6341.517'), (1, '5951.248')] [2023-12-26 15:01:48,818][123091] Updated weights for policy 0, policy_version 1932645 (0.0011) [2023-12-26 15:01:48,881][123091] Updated weights for policy 0, policy_version 1932655 (0.0011) [2023-12-26 15:01:49,183][123090] Updated weights for policy 1, policy_version 1920581 (0.0008) [2023-12-26 15:01:49,246][123090] Updated weights for policy 1, policy_version 1920591 (0.0009) [2023-12-26 15:01:49,299][123090] Updated weights for policy 1, policy_version 1920601 (0.0008) [2023-12-26 15:01:49,719][123091] Updated weights for policy 0, policy_version 1932665 (0.0011) [2023-12-26 15:01:49,786][123091] Updated weights for policy 0, policy_version 1932675 (0.0010) [2023-12-26 15:01:49,860][123091] Updated weights for policy 0, policy_version 1932685 (0.0010) [2023-12-26 15:01:50,106][123090] Updated weights for policy 1, policy_version 1920611 (0.0007) [2023-12-26 15:01:50,159][123090] Updated weights for policy 1, policy_version 1920621 (0.0010) [2023-12-26 15:01:50,213][123090] Updated weights for policy 1, policy_version 1920631 (0.0010) [2023-12-26 15:01:50,573][123091] Updated weights for policy 0, policy_version 1932695 (0.0009) [2023-12-26 15:01:50,644][123091] Updated weights for policy 0, policy_version 1932705 (0.0011) [2023-12-26 15:01:50,715][123091] Updated weights for policy 0, policy_version 1932715 (0.0011) [2023-12-26 15:01:51,124][123090] Updated weights for policy 1, policy_version 1920641 (0.0009) [2023-12-26 15:01:51,196][123090] Updated weights for policy 1, policy_version 1920651 (0.0006) [2023-12-26 15:01:51,268][123090] Updated weights for policy 1, policy_version 1920661 (0.0006) [2023-12-26 15:01:51,340][123090] Updated weights for policy 1, policy_version 1920671 (0.0010) [2023-12-26 15:01:51,537][123091] Updated weights for policy 0, policy_version 1932725 (0.0010) [2023-12-26 15:01:51,603][123091] Updated weights for policy 0, policy_version 1932735 (0.0009) [2023-12-26 15:01:51,673][123091] Updated weights for policy 0, policy_version 1932745 (0.0009) [2023-12-26 15:01:52,086][123090] Updated weights for policy 1, policy_version 1920681 (0.0008) [2023-12-26 15:01:52,148][123090] Updated weights for policy 1, policy_version 1920691 (0.0008) [2023-12-26 15:01:52,210][123090] Updated weights for policy 1, policy_version 1920701 (0.0008) [2023-12-26 15:01:52,422][123091] Updated weights for policy 0, policy_version 1932755 (0.0008) [2023-12-26 15:01:52,473][123091] Updated weights for policy 0, policy_version 1932765 (0.0006) [2023-12-26 15:01:52,527][123091] Updated weights for policy 0, policy_version 1932775 (0.0006) [2023-12-26 15:01:52,993][123090] Updated weights for policy 1, policy_version 1920711 (0.0009) [2023-12-26 15:01:53,059][123090] Updated weights for policy 1, policy_version 1920721 (0.0009) [2023-12-26 15:01:53,129][123090] Updated weights for policy 1, policy_version 1920731 (0.0009) [2023-12-26 15:01:53,323][123091] Updated weights for policy 0, policy_version 1932785 (0.0006) [2023-12-26 15:01:53,385][123091] Updated weights for policy 0, policy_version 1932795 (0.0006) [2023-12-26 15:01:53,441][123091] Updated weights for policy 0, policy_version 1932805 (0.0005) [2023-12-26 15:01:53,502][123091] Updated weights for policy 0, policy_version 1932815 (0.0009) [2023-12-26 15:01:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 986513408. Throughput: 0: 9025.5, 1: 8954.4. Samples: 986488376. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:53,785][121949] Avg episode reward: [(0, '6422.371'), (1, '6012.629')] [2023-12-26 15:01:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001932816_494804992.pth... [2023-12-26 15:01:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001920736_491708416.pth... [2023-12-26 15:01:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001931728_494526464.pth [2023-12-26 15:01:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001919680_491438080.pth [2023-12-26 15:01:53,982][123090] Updated weights for policy 1, policy_version 1920741 (0.0008) [2023-12-26 15:01:54,030][123090] Updated weights for policy 1, policy_version 1920751 (0.0005) [2023-12-26 15:01:54,080][123090] Updated weights for policy 1, policy_version 1920761 (0.0005) [2023-12-26 15:01:54,153][123091] Updated weights for policy 0, policy_version 1932825 (0.0006) [2023-12-26 15:01:54,204][123091] Updated weights for policy 0, policy_version 1932835 (0.0005) [2023-12-26 15:01:54,267][123091] Updated weights for policy 0, policy_version 1932845 (0.0005) [2023-12-26 15:01:54,762][123090] Updated weights for policy 1, policy_version 1920771 (0.0005) [2023-12-26 15:01:54,819][123090] Updated weights for policy 1, policy_version 1920781 (0.0008) [2023-12-26 15:01:54,874][123090] Updated weights for policy 1, policy_version 1920791 (0.0009) [2023-12-26 15:01:55,037][123091] Updated weights for policy 0, policy_version 1932855 (0.0008) [2023-12-26 15:01:55,094][123091] Updated weights for policy 0, policy_version 1932865 (0.0008) [2023-12-26 15:01:55,151][123091] Updated weights for policy 0, policy_version 1932875 (0.0010) [2023-12-26 15:01:55,708][123090] Updated weights for policy 1, policy_version 1920801 (0.0010) [2023-12-26 15:01:55,766][123090] Updated weights for policy 1, policy_version 1920811 (0.0009) [2023-12-26 15:01:55,827][123090] Updated weights for policy 1, policy_version 1920821 (0.0009) [2023-12-26 15:01:55,877][123090] Updated weights for policy 1, policy_version 1920831 (0.0009) [2023-12-26 15:01:55,988][123091] Updated weights for policy 0, policy_version 1932885 (0.0010) [2023-12-26 15:01:56,037][123091] Updated weights for policy 0, policy_version 1932895 (0.0011) [2023-12-26 15:01:56,086][123091] Updated weights for policy 0, policy_version 1932905 (0.0011) [2023-12-26 15:01:56,745][123090] Updated weights for policy 1, policy_version 1920841 (0.0010) [2023-12-26 15:01:56,800][123091] Updated weights for policy 0, policy_version 1932915 (0.0009) [2023-12-26 15:01:56,812][123090] Updated weights for policy 1, policy_version 1920851 (0.0009) [2023-12-26 15:01:56,861][123091] Updated weights for policy 0, policy_version 1932925 (0.0009) [2023-12-26 15:01:56,864][123090] Updated weights for policy 1, policy_version 1920861 (0.0006) [2023-12-26 15:01:56,925][123091] Updated weights for policy 0, policy_version 1932935 (0.0008) [2023-12-26 15:01:57,702][123091] Updated weights for policy 0, policy_version 1932945 (0.0009) [2023-12-26 15:01:57,720][123090] Updated weights for policy 1, policy_version 1920871 (0.0009) [2023-12-26 15:01:57,768][123091] Updated weights for policy 0, policy_version 1932955 (0.0005) [2023-12-26 15:01:57,777][123090] Updated weights for policy 1, policy_version 1920881 (0.0009) [2023-12-26 15:01:57,825][123091] Updated weights for policy 0, policy_version 1932965 (0.0005) [2023-12-26 15:01:57,830][123090] Updated weights for policy 1, policy_version 1920891 (0.0008) [2023-12-26 15:01:57,872][123091] Updated weights for policy 0, policy_version 1932975 (0.0005) [2023-12-26 15:01:58,700][123091] Updated weights for policy 0, policy_version 1932985 (0.0010) [2023-12-26 15:01:58,728][123090] Updated weights for policy 1, policy_version 1920901 (0.0009) [2023-12-26 15:01:58,765][123091] Updated weights for policy 0, policy_version 1932995 (0.0009) [2023-12-26 15:01:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 986595328. Throughput: 0: 9151.9, 1: 8950.1. Samples: 986596524. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:01:58,785][121949] Avg episode reward: [(0, '6394.460'), (1, '5968.125')] [2023-12-26 15:01:58,793][123090] Updated weights for policy 1, policy_version 1920911 (0.0009) [2023-12-26 15:01:58,834][123091] Updated weights for policy 0, policy_version 1933005 (0.0007) [2023-12-26 15:01:58,858][123090] Updated weights for policy 1, policy_version 1920921 (0.0008) [2023-12-26 15:01:59,536][123091] Updated weights for policy 0, policy_version 1933015 (0.0008) [2023-12-26 15:01:59,595][123091] Updated weights for policy 0, policy_version 1933025 (0.0009) [2023-12-26 15:01:59,655][123091] Updated weights for policy 0, policy_version 1933035 (0.0007) [2023-12-26 15:01:59,759][123090] Updated weights for policy 1, policy_version 1920931 (0.0010) [2023-12-26 15:01:59,824][123090] Updated weights for policy 1, policy_version 1920941 (0.0009) [2023-12-26 15:01:59,887][123090] Updated weights for policy 1, policy_version 1920951 (0.0010) [2023-12-26 15:02:00,483][123091] Updated weights for policy 0, policy_version 1933045 (0.0006) [2023-12-26 15:02:00,544][123091] Updated weights for policy 0, policy_version 1933055 (0.0009) [2023-12-26 15:02:00,598][123091] Updated weights for policy 0, policy_version 1933065 (0.0009) [2023-12-26 15:02:00,727][123090] Updated weights for policy 1, policy_version 1920961 (0.0010) [2023-12-26 15:02:00,795][123090] Updated weights for policy 1, policy_version 1920971 (0.0008) [2023-12-26 15:02:00,865][123090] Updated weights for policy 1, policy_version 1920981 (0.0005) [2023-12-26 15:02:00,939][123090] Updated weights for policy 1, policy_version 1920991 (0.0007) [2023-12-26 15:02:01,401][123091] Updated weights for policy 0, policy_version 1933075 (0.0009) [2023-12-26 15:02:01,462][123091] Updated weights for policy 0, policy_version 1933085 (0.0010) [2023-12-26 15:02:01,515][123091] Updated weights for policy 0, policy_version 1933095 (0.0010) [2023-12-26 15:02:01,691][123090] Updated weights for policy 1, policy_version 1921001 (0.0007) [2023-12-26 15:02:01,762][123090] Updated weights for policy 1, policy_version 1921011 (0.0006) [2023-12-26 15:02:01,825][123090] Updated weights for policy 1, policy_version 1921021 (0.0009) [2023-12-26 15:02:02,279][123091] Updated weights for policy 0, policy_version 1933106 (0.0010) [2023-12-26 15:02:02,349][123091] Updated weights for policy 0, policy_version 1933116 (0.0006) [2023-12-26 15:02:02,410][123091] Updated weights for policy 0, policy_version 1933126 (0.0012) [2023-12-26 15:02:02,476][123091] Updated weights for policy 0, policy_version 1933136 (0.0010) [2023-12-26 15:02:02,634][123090] Updated weights for policy 1, policy_version 1921031 (0.0010) [2023-12-26 15:02:02,705][123090] Updated weights for policy 1, policy_version 1921041 (0.0010) [2023-12-26 15:02:02,779][123090] Updated weights for policy 1, policy_version 1921051 (0.0010) [2023-12-26 15:02:03,212][123091] Updated weights for policy 0, policy_version 1933146 (0.0010) [2023-12-26 15:02:03,270][123091] Updated weights for policy 0, policy_version 1933156 (0.0010) [2023-12-26 15:02:03,331][123091] Updated weights for policy 0, policy_version 1933166 (0.0010) [2023-12-26 15:02:03,485][123090] Updated weights for policy 1, policy_version 1921061 (0.0010) [2023-12-26 15:02:03,557][123090] Updated weights for policy 1, policy_version 1921071 (0.0008) [2023-12-26 15:02:03,613][123090] Updated weights for policy 1, policy_version 1921081 (0.0009) [2023-12-26 15:02:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17939.1). Total num frames: 986693632. Throughput: 0: 9180.4, 1: 8900.8. Samples: 986701716. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:03,785][121949] Avg episode reward: [(0, '6288.768'), (1, '5852.381')] [2023-12-26 15:02:04,142][123091] Updated weights for policy 0, policy_version 1933176 (0.0011) [2023-12-26 15:02:04,210][123091] Updated weights for policy 0, policy_version 1933186 (0.0011) [2023-12-26 15:02:04,280][123091] Updated weights for policy 0, policy_version 1933196 (0.0011) [2023-12-26 15:02:04,498][123090] Updated weights for policy 1, policy_version 1921091 (0.0009) [2023-12-26 15:02:04,561][123090] Updated weights for policy 1, policy_version 1921101 (0.0009) [2023-12-26 15:02:04,618][123090] Updated weights for policy 1, policy_version 1921111 (0.0009) [2023-12-26 15:02:05,097][123091] Updated weights for policy 0, policy_version 1933206 (0.0010) [2023-12-26 15:02:05,149][123091] Updated weights for policy 0, policy_version 1933216 (0.0008) [2023-12-26 15:02:05,210][123091] Updated weights for policy 0, policy_version 1933226 (0.0005) [2023-12-26 15:02:05,415][123090] Updated weights for policy 1, policy_version 1921121 (0.0008) [2023-12-26 15:02:05,486][123090] Updated weights for policy 1, policy_version 1921131 (0.0005) [2023-12-26 15:02:05,545][123090] Updated weights for policy 1, policy_version 1921141 (0.0005) [2023-12-26 15:02:05,592][123090] Updated weights for policy 1, policy_version 1921151 (0.0005) [2023-12-26 15:02:05,892][123091] Updated weights for policy 0, policy_version 1933236 (0.0007) [2023-12-26 15:02:05,944][123091] Updated weights for policy 0, policy_version 1933246 (0.0009) [2023-12-26 15:02:05,996][123091] Updated weights for policy 0, policy_version 1933256 (0.0009) [2023-12-26 15:02:06,355][123090] Updated weights for policy 1, policy_version 1921161 (0.0010) [2023-12-26 15:02:06,426][123090] Updated weights for policy 1, policy_version 1921171 (0.0011) [2023-12-26 15:02:06,491][123090] Updated weights for policy 1, policy_version 1921181 (0.0011) [2023-12-26 15:02:06,862][123091] Updated weights for policy 0, policy_version 1933266 (0.0008) [2023-12-26 15:02:06,919][123091] Updated weights for policy 0, policy_version 1933276 (0.0009) [2023-12-26 15:02:06,968][123091] Updated weights for policy 0, policy_version 1933286 (0.0008) [2023-12-26 15:02:07,020][123091] Updated weights for policy 0, policy_version 1933296 (0.0010) [2023-12-26 15:02:07,306][123090] Updated weights for policy 1, policy_version 1921191 (0.0011) [2023-12-26 15:02:07,376][123090] Updated weights for policy 1, policy_version 1921201 (0.0011) [2023-12-26 15:02:07,427][123090] Updated weights for policy 1, policy_version 1921211 (0.0010) [2023-12-26 15:02:07,852][123091] Updated weights for policy 0, policy_version 1933306 (0.0006) [2023-12-26 15:02:07,911][123091] Updated weights for policy 0, policy_version 1933316 (0.0011) [2023-12-26 15:02:07,974][123091] Updated weights for policy 0, policy_version 1933326 (0.0010) [2023-12-26 15:02:08,255][123090] Updated weights for policy 1, policy_version 1921221 (0.0010) [2023-12-26 15:02:08,311][123090] Updated weights for policy 1, policy_version 1921231 (0.0011) [2023-12-26 15:02:08,391][123090] Updated weights for policy 1, policy_version 1921241 (0.0009) [2023-12-26 15:02:08,678][123091] Updated weights for policy 0, policy_version 1933336 (0.0006) [2023-12-26 15:02:08,740][123091] Updated weights for policy 0, policy_version 1933346 (0.0006) [2023-12-26 15:02:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17886.0, 300 sec: 17939.1). Total num frames: 986775552. Throughput: 0: 9173.8, 1: 8904.8. Samples: 986755392. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:08,785][121949] Avg episode reward: [(0, '6307.860'), (1, '5862.895')] [2023-12-26 15:02:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001921248_491839488.pth... [2023-12-26 15:02:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001920224_491577344.pth [2023-12-26 15:02:08,800][123091] Updated weights for policy 0, policy_version 1933356 (0.0006) [2023-12-26 15:02:08,819][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001933360_494944256.pth... [2023-12-26 15:02:08,822][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001932304_494673920.pth [2023-12-26 15:02:09,160][123090] Updated weights for policy 1, policy_version 1921251 (0.0009) [2023-12-26 15:02:09,213][123090] Updated weights for policy 1, policy_version 1921261 (0.0010) [2023-12-26 15:02:09,284][123090] Updated weights for policy 1, policy_version 1921271 (0.0009) [2023-12-26 15:02:09,505][123091] Updated weights for policy 0, policy_version 1933366 (0.0008) [2023-12-26 15:02:09,577][123091] Updated weights for policy 0, policy_version 1933376 (0.0011) [2023-12-26 15:02:09,631][123091] Updated weights for policy 0, policy_version 1933386 (0.0010) [2023-12-26 15:02:10,140][123090] Updated weights for policy 1, policy_version 1921281 (0.0009) [2023-12-26 15:02:10,217][123090] Updated weights for policy 1, policy_version 1921291 (0.0010) [2023-12-26 15:02:10,290][123090] Updated weights for policy 1, policy_version 1921301 (0.0009) [2023-12-26 15:02:10,358][123090] Updated weights for policy 1, policy_version 1921311 (0.0010) [2023-12-26 15:02:10,430][123091] Updated weights for policy 0, policy_version 1933396 (0.0010) [2023-12-26 15:02:10,476][123091] Updated weights for policy 0, policy_version 1933406 (0.0005) [2023-12-26 15:02:10,540][123091] Updated weights for policy 0, policy_version 1933416 (0.0006) [2023-12-26 15:02:11,179][123090] Updated weights for policy 1, policy_version 1921321 (0.0009) [2023-12-26 15:02:11,245][123090] Updated weights for policy 1, policy_version 1921331 (0.0009) [2023-12-26 15:02:11,312][123090] Updated weights for policy 1, policy_version 1921341 (0.0009) [2023-12-26 15:02:11,313][123091] Updated weights for policy 0, policy_version 1933426 (0.0006) [2023-12-26 15:02:11,397][123091] Updated weights for policy 0, policy_version 1933436 (0.0012) [2023-12-26 15:02:11,466][123091] Updated weights for policy 0, policy_version 1933446 (0.0011) [2023-12-26 15:02:11,533][123091] Updated weights for policy 0, policy_version 1933456 (0.0010) [2023-12-26 15:02:12,171][123090] Updated weights for policy 1, policy_version 1921351 (0.0009) [2023-12-26 15:02:12,234][123090] Updated weights for policy 1, policy_version 1921361 (0.0009) [2023-12-26 15:02:12,303][123090] Updated weights for policy 1, policy_version 1921371 (0.0009) [2023-12-26 15:02:12,377][123091] Updated weights for policy 0, policy_version 1933466 (0.0008) [2023-12-26 15:02:12,433][123091] Updated weights for policy 0, policy_version 1933476 (0.0008) [2023-12-26 15:02:12,497][123091] Updated weights for policy 0, policy_version 1933486 (0.0008) [2023-12-26 15:02:13,137][123090] Updated weights for policy 1, policy_version 1921381 (0.0009) [2023-12-26 15:02:13,186][123090] Updated weights for policy 1, policy_version 1921391 (0.0009) [2023-12-26 15:02:13,241][123090] Updated weights for policy 1, policy_version 1921401 (0.0009) [2023-12-26 15:02:13,318][123091] Updated weights for policy 0, policy_version 1933496 (0.0009) [2023-12-26 15:02:13,378][123091] Updated weights for policy 0, policy_version 1933506 (0.0009) [2023-12-26 15:02:13,454][123091] Updated weights for policy 0, policy_version 1933516 (0.0007) [2023-12-26 15:02:13,784][121949] Fps is (10 sec: 17203.6, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 986865664. Throughput: 0: 9057.6, 1: 8863.2. Samples: 986858824. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:13,785][121949] Avg episode reward: [(0, '6380.038'), (1, '5860.208')] [2023-12-26 15:02:14,119][123090] Updated weights for policy 1, policy_version 1921411 (0.0010) [2023-12-26 15:02:14,177][123090] Updated weights for policy 1, policy_version 1921421 (0.0008) [2023-12-26 15:02:14,201][123091] Updated weights for policy 0, policy_version 1933526 (0.0008) [2023-12-26 15:02:14,243][123090] Updated weights for policy 1, policy_version 1921431 (0.0008) [2023-12-26 15:02:14,255][123091] Updated weights for policy 0, policy_version 1933536 (0.0008) [2023-12-26 15:02:14,321][123091] Updated weights for policy 0, policy_version 1933546 (0.0009) [2023-12-26 15:02:15,073][123090] Updated weights for policy 1, policy_version 1921441 (0.0009) [2023-12-26 15:02:15,145][123090] Updated weights for policy 1, policy_version 1921451 (0.0009) [2023-12-26 15:02:15,176][123091] Updated weights for policy 0, policy_version 1933556 (0.0010) [2023-12-26 15:02:15,209][123090] Updated weights for policy 1, policy_version 1921461 (0.0007) [2023-12-26 15:02:15,234][123091] Updated weights for policy 0, policy_version 1933566 (0.0010) [2023-12-26 15:02:15,271][123090] Updated weights for policy 1, policy_version 1921471 (0.0006) [2023-12-26 15:02:15,299][123091] Updated weights for policy 0, policy_version 1933576 (0.0008) [2023-12-26 15:02:16,025][123091] Updated weights for policy 0, policy_version 1933586 (0.0006) [2023-12-26 15:02:16,086][123091] Updated weights for policy 0, policy_version 1933596 (0.0006) [2023-12-26 15:02:16,123][123090] Updated weights for policy 1, policy_version 1921481 (0.0010) [2023-12-26 15:02:16,153][123091] Updated weights for policy 0, policy_version 1933606 (0.0006) [2023-12-26 15:02:16,183][123090] Updated weights for policy 1, policy_version 1921491 (0.0010) [2023-12-26 15:02:16,210][123091] Updated weights for policy 0, policy_version 1933616 (0.0006) [2023-12-26 15:02:16,247][123090] Updated weights for policy 1, policy_version 1921501 (0.0010) [2023-12-26 15:02:16,845][123091] Updated weights for policy 0, policy_version 1933626 (0.0006) [2023-12-26 15:02:16,903][123090] Updated weights for policy 1, policy_version 1921511 (0.0008) [2023-12-26 15:02:16,907][123091] Updated weights for policy 0, policy_version 1933636 (0.0005) [2023-12-26 15:02:16,961][123091] Updated weights for policy 0, policy_version 1933646 (0.0005) [2023-12-26 15:02:16,967][123090] Updated weights for policy 1, policy_version 1921521 (0.0008) [2023-12-26 15:02:17,033][123090] Updated weights for policy 1, policy_version 1921531 (0.0008) [2023-12-26 15:02:17,615][123091] Updated weights for policy 0, policy_version 1933656 (0.0006) [2023-12-26 15:02:17,670][123091] Updated weights for policy 0, policy_version 1933666 (0.0006) [2023-12-26 15:02:17,705][123090] Updated weights for policy 1, policy_version 1921541 (0.0005) [2023-12-26 15:02:17,730][123091] Updated weights for policy 0, policy_version 1933676 (0.0006) [2023-12-26 15:02:17,763][123090] Updated weights for policy 1, policy_version 1921551 (0.0005) [2023-12-26 15:02:17,813][123090] Updated weights for policy 1, policy_version 1921561 (0.0005) [2023-12-26 15:02:18,466][123091] Updated weights for policy 0, policy_version 1933686 (0.0007) [2023-12-26 15:02:18,515][123090] Updated weights for policy 1, policy_version 1921571 (0.0010) [2023-12-26 15:02:18,533][123091] Updated weights for policy 0, policy_version 1933696 (0.0010) [2023-12-26 15:02:18,581][123090] Updated weights for policy 1, policy_version 1921581 (0.0008) [2023-12-26 15:02:18,590][123091] Updated weights for policy 0, policy_version 1933706 (0.0007) [2023-12-26 15:02:18,635][123090] Updated weights for policy 1, policy_version 1921591 (0.0010) [2023-12-26 15:02:18,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18158.9, 300 sec: 17994.6). Total num frames: 986963968. Throughput: 0: 9092.8, 1: 8847.3. Samples: 986969620. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:18,785][121949] Avg episode reward: [(0, '6071.826'), (1, '5631.346')] [2023-12-26 15:02:19,427][123091] Updated weights for policy 0, policy_version 1933716 (0.0008) [2023-12-26 15:02:19,431][123090] Updated weights for policy 1, policy_version 1921601 (0.0010) [2023-12-26 15:02:19,494][123091] Updated weights for policy 0, policy_version 1933726 (0.0007) [2023-12-26 15:02:19,500][123090] Updated weights for policy 1, policy_version 1921611 (0.0009) [2023-12-26 15:02:19,561][123091] Updated weights for policy 0, policy_version 1933736 (0.0009) [2023-12-26 15:02:19,566][123090] Updated weights for policy 1, policy_version 1921621 (0.0009) [2023-12-26 15:02:19,627][123090] Updated weights for policy 1, policy_version 1921631 (0.0008) [2023-12-26 15:02:20,430][123091] Updated weights for policy 0, policy_version 1933746 (0.0008) [2023-12-26 15:02:20,498][123091] Updated weights for policy 0, policy_version 1933756 (0.0009) [2023-12-26 15:02:20,501][123090] Updated weights for policy 1, policy_version 1921641 (0.0008) [2023-12-26 15:02:20,567][123090] Updated weights for policy 1, policy_version 1921651 (0.0007) [2023-12-26 15:02:20,568][123091] Updated weights for policy 0, policy_version 1933766 (0.0008) [2023-12-26 15:02:20,634][123090] Updated weights for policy 1, policy_version 1921661 (0.0008) [2023-12-26 15:02:20,640][123091] Updated weights for policy 0, policy_version 1933776 (0.0009) [2023-12-26 15:02:21,463][123090] Updated weights for policy 1, policy_version 1921671 (0.0006) [2023-12-26 15:02:21,470][123091] Updated weights for policy 0, policy_version 1933786 (0.0009) [2023-12-26 15:02:21,517][123090] Updated weights for policy 1, policy_version 1921681 (0.0008) [2023-12-26 15:02:21,519][123091] Updated weights for policy 0, policy_version 1933796 (0.0009) [2023-12-26 15:02:21,571][123091] Updated weights for policy 0, policy_version 1933806 (0.0009) [2023-12-26 15:02:21,576][123090] Updated weights for policy 1, policy_version 1921691 (0.0008) [2023-12-26 15:02:22,426][123090] Updated weights for policy 1, policy_version 1921701 (0.0009) [2023-12-26 15:02:22,488][123090] Updated weights for policy 1, policy_version 1921711 (0.0007) [2023-12-26 15:02:22,509][123091] Updated weights for policy 0, policy_version 1933816 (0.0009) [2023-12-26 15:02:22,554][123090] Updated weights for policy 1, policy_version 1921721 (0.0005) [2023-12-26 15:02:22,568][123091] Updated weights for policy 0, policy_version 1933826 (0.0008) [2023-12-26 15:02:22,628][123091] Updated weights for policy 0, policy_version 1933836 (0.0006) [2023-12-26 15:02:23,307][123090] Updated weights for policy 1, policy_version 1921731 (0.0005) [2023-12-26 15:02:23,326][123091] Updated weights for policy 0, policy_version 1933846 (0.0005) [2023-12-26 15:02:23,365][123090] Updated weights for policy 1, policy_version 1921741 (0.0005) [2023-12-26 15:02:23,387][123091] Updated weights for policy 0, policy_version 1933856 (0.0005) [2023-12-26 15:02:23,414][123090] Updated weights for policy 1, policy_version 1921751 (0.0005) [2023-12-26 15:02:23,454][123091] Updated weights for policy 0, policy_version 1933866 (0.0006) [2023-12-26 15:02:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 987045888. Throughput: 0: 8973.6, 1: 8794.4. Samples: 987019684. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:23,785][121949] Avg episode reward: [(0, '6081.002'), (1, '5833.262')] [2023-12-26 15:02:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001933872_495075328.pth... [2023-12-26 15:02:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001921760_491970560.pth... [2023-12-26 15:02:23,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001932816_494804992.pth [2023-12-26 15:02:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001920736_491708416.pth [2023-12-26 15:02:24,152][123090] Updated weights for policy 1, policy_version 1921761 (0.0006) [2023-12-26 15:02:24,157][123091] Updated weights for policy 0, policy_version 1933876 (0.0008) [2023-12-26 15:02:24,212][123091] Updated weights for policy 0, policy_version 1933886 (0.0010) [2023-12-26 15:02:24,215][123090] Updated weights for policy 1, policy_version 1921771 (0.0006) [2023-12-26 15:02:24,264][123091] Updated weights for policy 0, policy_version 1933896 (0.0010) [2023-12-26 15:02:24,271][123090] Updated weights for policy 1, policy_version 1921781 (0.0005) [2023-12-26 15:02:24,346][123090] Updated weights for policy 1, policy_version 1921791 (0.0008) [2023-12-26 15:02:24,932][123091] Updated weights for policy 0, policy_version 1933906 (0.0008) [2023-12-26 15:02:25,008][123091] Updated weights for policy 0, policy_version 1933916 (0.0006) [2023-12-26 15:02:25,071][123091] Updated weights for policy 0, policy_version 1933926 (0.0005) [2023-12-26 15:02:25,141][123091] Updated weights for policy 0, policy_version 1933936 (0.0005) [2023-12-26 15:02:25,190][123090] Updated weights for policy 1, policy_version 1921801 (0.0006) [2023-12-26 15:02:25,245][123090] Updated weights for policy 1, policy_version 1921811 (0.0005) [2023-12-26 15:02:25,305][123090] Updated weights for policy 1, policy_version 1921821 (0.0005) [2023-12-26 15:02:25,703][123091] Updated weights for policy 0, policy_version 1933946 (0.0005) [2023-12-26 15:02:25,775][123091] Updated weights for policy 0, policy_version 1933956 (0.0005) [2023-12-26 15:02:25,847][123091] Updated weights for policy 0, policy_version 1933966 (0.0005) [2023-12-26 15:02:25,918][123090] Updated weights for policy 1, policy_version 1921831 (0.0005) [2023-12-26 15:02:25,973][123090] Updated weights for policy 1, policy_version 1921841 (0.0005) [2023-12-26 15:02:26,025][123090] Updated weights for policy 1, policy_version 1921851 (0.0006) [2023-12-26 15:02:26,483][123091] Updated weights for policy 0, policy_version 1933976 (0.0009) [2023-12-26 15:02:26,535][123091] Updated weights for policy 0, policy_version 1933986 (0.0010) [2023-12-26 15:02:26,600][123091] Updated weights for policy 0, policy_version 1933996 (0.0010) [2023-12-26 15:02:26,864][123090] Updated weights for policy 1, policy_version 1921861 (0.0010) [2023-12-26 15:02:26,919][123090] Updated weights for policy 1, policy_version 1921871 (0.0010) [2023-12-26 15:02:26,979][123090] Updated weights for policy 1, policy_version 1921881 (0.0006) [2023-12-26 15:02:27,274][123091] Updated weights for policy 0, policy_version 1934006 (0.0008) [2023-12-26 15:02:27,325][123091] Updated weights for policy 0, policy_version 1934016 (0.0010) [2023-12-26 15:02:27,372][123091] Updated weights for policy 0, policy_version 1934026 (0.0007) [2023-12-26 15:02:27,735][123090] Updated weights for policy 1, policy_version 1921891 (0.0007) [2023-12-26 15:02:27,786][123090] Updated weights for policy 1, policy_version 1921901 (0.0010) [2023-12-26 15:02:27,846][123090] Updated weights for policy 1, policy_version 1921911 (0.0010) [2023-12-26 15:02:28,052][123091] Updated weights for policy 0, policy_version 1934036 (0.0008) [2023-12-26 15:02:28,101][123091] Updated weights for policy 0, policy_version 1934046 (0.0005) [2023-12-26 15:02:28,154][123091] Updated weights for policy 0, policy_version 1934056 (0.0009) [2023-12-26 15:02:28,607][123090] Updated weights for policy 1, policy_version 1921921 (0.0010) [2023-12-26 15:02:28,658][123090] Updated weights for policy 1, policy_version 1921931 (0.0005) [2023-12-26 15:02:28,724][123090] Updated weights for policy 1, policy_version 1921941 (0.0008) [2023-12-26 15:02:28,781][123090] Updated weights for policy 1, policy_version 1921951 (0.0006) [2023-12-26 15:02:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17939.1). Total num frames: 987136000. Throughput: 0: 9090.1, 1: 8895.1. Samples: 987134412. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:28,785][121949] Avg episode reward: [(0, '6239.037'), (1, '5532.607')] [2023-12-26 15:02:28,865][123091] Updated weights for policy 0, policy_version 1934066 (0.0010) [2023-12-26 15:02:28,926][123091] Updated weights for policy 0, policy_version 1934076 (0.0011) [2023-12-26 15:02:28,981][123091] Updated weights for policy 0, policy_version 1934086 (0.0011) [2023-12-26 15:02:29,030][123091] Updated weights for policy 0, policy_version 1934096 (0.0008) [2023-12-26 15:02:29,464][123090] Updated weights for policy 1, policy_version 1921961 (0.0010) [2023-12-26 15:02:29,511][123090] Updated weights for policy 1, policy_version 1921971 (0.0010) [2023-12-26 15:02:29,559][123090] Updated weights for policy 1, policy_version 1921981 (0.0010) [2023-12-26 15:02:29,771][123091] Updated weights for policy 0, policy_version 1934106 (0.0010) [2023-12-26 15:02:29,829][123091] Updated weights for policy 0, policy_version 1934116 (0.0011) [2023-12-26 15:02:29,901][123091] Updated weights for policy 0, policy_version 1934126 (0.0010) [2023-12-26 15:02:30,397][123090] Updated weights for policy 1, policy_version 1921991 (0.0007) [2023-12-26 15:02:30,461][123090] Updated weights for policy 1, policy_version 1922001 (0.0009) [2023-12-26 15:02:30,512][123090] Updated weights for policy 1, policy_version 1922011 (0.0010) [2023-12-26 15:02:30,618][123091] Updated weights for policy 0, policy_version 1934136 (0.0009) [2023-12-26 15:02:30,687][123091] Updated weights for policy 0, policy_version 1934146 (0.0008) [2023-12-26 15:02:30,751][123091] Updated weights for policy 0, policy_version 1934156 (0.0010) [2023-12-26 15:02:31,197][123090] Updated weights for policy 1, policy_version 1922021 (0.0009) [2023-12-26 15:02:31,246][123090] Updated weights for policy 1, policy_version 1922031 (0.0009) [2023-12-26 15:02:31,308][123090] Updated weights for policy 1, policy_version 1922041 (0.0009) [2023-12-26 15:02:31,512][123091] Updated weights for policy 0, policy_version 1934166 (0.0010) [2023-12-26 15:02:31,579][123091] Updated weights for policy 0, policy_version 1934176 (0.0009) [2023-12-26 15:02:31,642][123091] Updated weights for policy 0, policy_version 1934186 (0.0007) [2023-12-26 15:02:32,198][123090] Updated weights for policy 1, policy_version 1922051 (0.0009) [2023-12-26 15:02:32,272][123090] Updated weights for policy 1, policy_version 1922061 (0.0010) [2023-12-26 15:02:32,341][123090] Updated weights for policy 1, policy_version 1922071 (0.0010) [2023-12-26 15:02:32,342][123091] Updated weights for policy 0, policy_version 1934196 (0.0008) [2023-12-26 15:02:32,407][123091] Updated weights for policy 0, policy_version 1934206 (0.0009) [2023-12-26 15:02:32,466][123091] Updated weights for policy 0, policy_version 1934216 (0.0009) [2023-12-26 15:02:33,165][123090] Updated weights for policy 1, policy_version 1922081 (0.0009) [2023-12-26 15:02:33,218][123090] Updated weights for policy 1, policy_version 1922091 (0.0007) [2023-12-26 15:02:33,271][123090] Updated weights for policy 1, policy_version 1922101 (0.0006) [2023-12-26 15:02:33,304][123091] Updated weights for policy 0, policy_version 1934226 (0.0009) [2023-12-26 15:02:33,320][123090] Updated weights for policy 1, policy_version 1922111 (0.0005) [2023-12-26 15:02:33,366][123091] Updated weights for policy 0, policy_version 1934236 (0.0009) [2023-12-26 15:02:33,424][123091] Updated weights for policy 0, policy_version 1934246 (0.0010) [2023-12-26 15:02:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17966.8). Total num frames: 987234304. Throughput: 0: 9172.3, 1: 8804.3. Samples: 987245268. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:33,785][121949] Avg episode reward: [(0, '6393.622'), (1, '5499.650')] [2023-12-26 15:02:33,954][123090] Updated weights for policy 1, policy_version 1922121 (0.0005) [2023-12-26 15:02:34,000][123090] Updated weights for policy 1, policy_version 1922131 (0.0005) [2023-12-26 15:02:34,048][123090] Updated weights for policy 1, policy_version 1922141 (0.0005) [2023-12-26 15:02:34,174][123091] Updated weights for policy 0, policy_version 1934257 (0.0009) [2023-12-26 15:02:34,238][123091] Updated weights for policy 0, policy_version 1934267 (0.0011) [2023-12-26 15:02:34,290][123091] Updated weights for policy 0, policy_version 1934277 (0.0010) [2023-12-26 15:02:34,347][123091] Updated weights for policy 0, policy_version 1934287 (0.0011) [2023-12-26 15:02:34,826][123090] Updated weights for policy 1, policy_version 1922151 (0.0008) [2023-12-26 15:02:34,900][123090] Updated weights for policy 1, policy_version 1922161 (0.0008) [2023-12-26 15:02:34,963][123090] Updated weights for policy 1, policy_version 1922171 (0.0009) [2023-12-26 15:02:35,178][123091] Updated weights for policy 0, policy_version 1934297 (0.0010) [2023-12-26 15:02:35,239][123091] Updated weights for policy 0, policy_version 1934307 (0.0009) [2023-12-26 15:02:35,305][123091] Updated weights for policy 0, policy_version 1934317 (0.0007) [2023-12-26 15:02:35,812][123090] Updated weights for policy 1, policy_version 1922181 (0.0009) [2023-12-26 15:02:35,880][123090] Updated weights for policy 1, policy_version 1922191 (0.0010) [2023-12-26 15:02:35,948][123090] Updated weights for policy 1, policy_version 1922201 (0.0009) [2023-12-26 15:02:35,962][123091] Updated weights for policy 0, policy_version 1934327 (0.0005) [2023-12-26 15:02:36,026][123091] Updated weights for policy 0, policy_version 1934337 (0.0005) [2023-12-26 15:02:36,085][123091] Updated weights for policy 0, policy_version 1934347 (0.0005) [2023-12-26 15:02:36,726][123090] Updated weights for policy 1, policy_version 1922211 (0.0007) [2023-12-26 15:02:36,792][123090] Updated weights for policy 1, policy_version 1922221 (0.0006) [2023-12-26 15:02:36,828][123091] Updated weights for policy 0, policy_version 1934357 (0.0009) [2023-12-26 15:02:36,857][123090] Updated weights for policy 1, policy_version 1922231 (0.0006) [2023-12-26 15:02:36,883][123091] Updated weights for policy 0, policy_version 1934367 (0.0008) [2023-12-26 15:02:36,948][123091] Updated weights for policy 0, policy_version 1934377 (0.0009) [2023-12-26 15:02:37,514][123090] Updated weights for policy 1, policy_version 1922241 (0.0009) [2023-12-26 15:02:37,583][123090] Updated weights for policy 1, policy_version 1922251 (0.0005) [2023-12-26 15:02:37,636][123090] Updated weights for policy 1, policy_version 1922261 (0.0005) [2023-12-26 15:02:37,691][123090] Updated weights for policy 1, policy_version 1922271 (0.0005) [2023-12-26 15:02:37,800][123091] Updated weights for policy 0, policy_version 1934387 (0.0007) [2023-12-26 15:02:37,860][123091] Updated weights for policy 0, policy_version 1934397 (0.0011) [2023-12-26 15:02:37,930][123091] Updated weights for policy 0, policy_version 1934407 (0.0011) [2023-12-26 15:02:38,443][123090] Updated weights for policy 1, policy_version 1922281 (0.0006) [2023-12-26 15:02:38,504][123090] Updated weights for policy 1, policy_version 1922291 (0.0005) [2023-12-26 15:02:38,581][123090] Updated weights for policy 1, policy_version 1922301 (0.0005) [2023-12-26 15:02:38,671][123091] Updated weights for policy 0, policy_version 1934417 (0.0010) [2023-12-26 15:02:38,724][123091] Updated weights for policy 0, policy_version 1934427 (0.0006) [2023-12-26 15:02:38,773][123091] Updated weights for policy 0, policy_version 1934437 (0.0007) [2023-12-26 15:02:38,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.9, 300 sec: 17994.6). Total num frames: 987324416. Throughput: 0: 9229.4, 1: 8821.9. Samples: 987300684. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:38,785][121949] Avg episode reward: [(0, '6393.347'), (1, '5897.513')] [2023-12-26 15:02:38,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001922304_492109824.pth... [2023-12-26 15:02:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001921248_491839488.pth [2023-12-26 15:02:38,827][123091] Updated weights for policy 0, policy_version 1934447 (0.0010) [2023-12-26 15:02:38,831][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001934448_495222784.pth... [2023-12-26 15:02:38,834][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001933360_494944256.pth [2023-12-26 15:02:39,300][123090] Updated weights for policy 1, policy_version 1922311 (0.0008) [2023-12-26 15:02:39,376][123090] Updated weights for policy 1, policy_version 1922321 (0.0008) [2023-12-26 15:02:39,460][123090] Updated weights for policy 1, policy_version 1922331 (0.0007) [2023-12-26 15:02:39,621][123091] Updated weights for policy 0, policy_version 1934457 (0.0008) [2023-12-26 15:02:39,678][123091] Updated weights for policy 0, policy_version 1934467 (0.0009) [2023-12-26 15:02:39,747][123091] Updated weights for policy 0, policy_version 1934477 (0.0006) [2023-12-26 15:02:40,269][123090] Updated weights for policy 1, policy_version 1922341 (0.0009) [2023-12-26 15:02:40,335][123090] Updated weights for policy 1, policy_version 1922351 (0.0010) [2023-12-26 15:02:40,395][123090] Updated weights for policy 1, policy_version 1922361 (0.0010) [2023-12-26 15:02:40,531][123091] Updated weights for policy 0, policy_version 1934487 (0.0009) [2023-12-26 15:02:40,595][123091] Updated weights for policy 0, policy_version 1934497 (0.0010) [2023-12-26 15:02:40,663][123091] Updated weights for policy 0, policy_version 1934507 (0.0010) [2023-12-26 15:02:41,205][123090] Updated weights for policy 1, policy_version 1922371 (0.0009) [2023-12-26 15:02:41,274][123090] Updated weights for policy 1, policy_version 1922381 (0.0009) [2023-12-26 15:02:41,341][123090] Updated weights for policy 1, policy_version 1922391 (0.0009) [2023-12-26 15:02:41,483][123091] Updated weights for policy 0, policy_version 1934517 (0.0008) [2023-12-26 15:02:41,542][123091] Updated weights for policy 0, policy_version 1934527 (0.0008) [2023-12-26 15:02:41,597][123091] Updated weights for policy 0, policy_version 1934537 (0.0008) [2023-12-26 15:02:42,259][123090] Updated weights for policy 1, policy_version 1922401 (0.0010) [2023-12-26 15:02:42,329][123090] Updated weights for policy 1, policy_version 1922411 (0.0009) [2023-12-26 15:02:42,401][123090] Updated weights for policy 1, policy_version 1922421 (0.0009) [2023-12-26 15:02:42,407][123091] Updated weights for policy 0, policy_version 1934547 (0.0008) [2023-12-26 15:02:42,463][123090] Updated weights for policy 1, policy_version 1922431 (0.0008) [2023-12-26 15:02:42,471][123091] Updated weights for policy 0, policy_version 1934557 (0.0010) [2023-12-26 15:02:42,540][123091] Updated weights for policy 0, policy_version 1934567 (0.0010) [2023-12-26 15:02:43,322][123091] Updated weights for policy 0, policy_version 1934577 (0.0010) [2023-12-26 15:02:43,325][123090] Updated weights for policy 1, policy_version 1922441 (0.0009) [2023-12-26 15:02:43,378][123091] Updated weights for policy 0, policy_version 1934587 (0.0009) [2023-12-26 15:02:43,387][123090] Updated weights for policy 1, policy_version 1922451 (0.0006) [2023-12-26 15:02:43,431][123091] Updated weights for policy 0, policy_version 1934597 (0.0009) [2023-12-26 15:02:43,459][123090] Updated weights for policy 1, policy_version 1922461 (0.0006) [2023-12-26 15:02:43,488][123091] Updated weights for policy 0, policy_version 1934607 (0.0009) [2023-12-26 15:02:43,784][121949] Fps is (10 sec: 18022.9, 60 sec: 18022.5, 300 sec: 17994.6). Total num frames: 987414528. Throughput: 0: 9163.1, 1: 8826.7. Samples: 987406060. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:43,785][121949] Avg episode reward: [(0, '6338.215'), (1, '5855.667')] [2023-12-26 15:02:44,217][123090] Updated weights for policy 1, policy_version 1922471 (0.0006) [2023-12-26 15:02:44,269][123090] Updated weights for policy 1, policy_version 1922481 (0.0005) [2023-12-26 15:02:44,304][123091] Updated weights for policy 0, policy_version 1934617 (0.0005) [2023-12-26 15:02:44,321][123090] Updated weights for policy 1, policy_version 1922491 (0.0006) [2023-12-26 15:02:44,361][123091] Updated weights for policy 0, policy_version 1934627 (0.0005) [2023-12-26 15:02:44,418][123091] Updated weights for policy 0, policy_version 1934637 (0.0005) [2023-12-26 15:02:45,039][123090] Updated weights for policy 1, policy_version 1922501 (0.0008) [2023-12-26 15:02:45,111][123090] Updated weights for policy 1, policy_version 1922511 (0.0008) [2023-12-26 15:02:45,178][123090] Updated weights for policy 1, policy_version 1922521 (0.0005) [2023-12-26 15:02:45,183][123091] Updated weights for policy 0, policy_version 1934647 (0.0007) [2023-12-26 15:02:45,233][123091] Updated weights for policy 0, policy_version 1934657 (0.0009) [2023-12-26 15:02:45,288][123091] Updated weights for policy 0, policy_version 1934667 (0.0010) [2023-12-26 15:02:45,906][123090] Updated weights for policy 1, policy_version 1922531 (0.0007) [2023-12-26 15:02:45,974][123090] Updated weights for policy 1, policy_version 1922541 (0.0011) [2023-12-26 15:02:46,045][123090] Updated weights for policy 1, policy_version 1922551 (0.0010) [2023-12-26 15:02:46,174][123091] Updated weights for policy 0, policy_version 1934677 (0.0010) [2023-12-26 15:02:46,244][123091] Updated weights for policy 0, policy_version 1934687 (0.0010) [2023-12-26 15:02:46,307][123091] Updated weights for policy 0, policy_version 1934697 (0.0009) [2023-12-26 15:02:46,845][123090] Updated weights for policy 1, policy_version 1922561 (0.0010) [2023-12-26 15:02:46,893][123090] Updated weights for policy 1, policy_version 1922571 (0.0010) [2023-12-26 15:02:46,937][123090] Updated weights for policy 1, policy_version 1922581 (0.0007) [2023-12-26 15:02:46,987][123090] Updated weights for policy 1, policy_version 1922591 (0.0005) [2023-12-26 15:02:47,160][123091] Updated weights for policy 0, policy_version 1934707 (0.0009) [2023-12-26 15:02:47,218][123091] Updated weights for policy 0, policy_version 1934717 (0.0008) [2023-12-26 15:02:47,275][123091] Updated weights for policy 0, policy_version 1934727 (0.0009) [2023-12-26 15:02:47,600][123090] Updated weights for policy 1, policy_version 1922601 (0.0008) [2023-12-26 15:02:47,659][123090] Updated weights for policy 1, policy_version 1922611 (0.0010) [2023-12-26 15:02:47,719][123090] Updated weights for policy 1, policy_version 1922621 (0.0010) [2023-12-26 15:02:48,120][123091] Updated weights for policy 0, policy_version 1934737 (0.0009) [2023-12-26 15:02:48,177][123091] Updated weights for policy 0, policy_version 1934747 (0.0009) [2023-12-26 15:02:48,234][123091] Updated weights for policy 0, policy_version 1934757 (0.0005) [2023-12-26 15:02:48,279][123091] Updated weights for policy 0, policy_version 1934767 (0.0005) [2023-12-26 15:02:48,525][123090] Updated weights for policy 1, policy_version 1922631 (0.0010) [2023-12-26 15:02:48,585][123090] Updated weights for policy 1, policy_version 1922641 (0.0010) [2023-12-26 15:02:48,651][123090] Updated weights for policy 1, policy_version 1922651 (0.0010) [2023-12-26 15:02:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17994.7). Total num frames: 987504640. Throughput: 0: 9117.5, 1: 8916.8. Samples: 987513256. Policy #0 lag: (min: 12.0, avg: 14.6, max: 44.0) [2023-12-26 15:02:48,784][121949] Avg episode reward: [(0, '6280.126'), (1, '6022.214')] [2023-12-26 15:02:49,064][123091] Updated weights for policy 0, policy_version 1934777 (0.0010) [2023-12-26 15:02:49,128][123091] Updated weights for policy 0, policy_version 1934787 (0.0010) [2023-12-26 15:02:49,184][123091] Updated weights for policy 0, policy_version 1934797 (0.0010) [2023-12-26 15:02:49,496][123090] Updated weights for policy 1, policy_version 1922661 (0.0009) [2023-12-26 15:02:49,544][123090] Updated weights for policy 1, policy_version 1922671 (0.0008) [2023-12-26 15:02:49,596][123090] Updated weights for policy 1, policy_version 1922681 (0.0009) [2023-12-26 15:02:50,015][123091] Updated weights for policy 0, policy_version 1934807 (0.0010) [2023-12-26 15:02:50,068][123091] Updated weights for policy 0, policy_version 1934817 (0.0011) [2023-12-26 15:02:50,124][123091] Updated weights for policy 0, policy_version 1934827 (0.0011) [2023-12-26 15:02:50,454][123090] Updated weights for policy 1, policy_version 1922691 (0.0009) [2023-12-26 15:02:50,523][123090] Updated weights for policy 1, policy_version 1922701 (0.0007) [2023-12-26 15:02:50,587][123090] Updated weights for policy 1, policy_version 1922711 (0.0006) [2023-12-26 15:02:50,970][123091] Updated weights for policy 0, policy_version 1934837 (0.0011) [2023-12-26 15:02:51,044][123091] Updated weights for policy 0, policy_version 1934847 (0.0011) [2023-12-26 15:02:51,118][123091] Updated weights for policy 0, policy_version 1934857 (0.0011) [2023-12-26 15:02:51,366][123090] Updated weights for policy 1, policy_version 1922721 (0.0009) [2023-12-26 15:02:51,434][123090] Updated weights for policy 1, policy_version 1922731 (0.0009) [2023-12-26 15:02:51,490][123090] Updated weights for policy 1, policy_version 1922741 (0.0009) [2023-12-26 15:02:51,555][123090] Updated weights for policy 1, policy_version 1922751 (0.0009) [2023-12-26 15:02:51,921][123091] Updated weights for policy 0, policy_version 1934867 (0.0011) [2023-12-26 15:02:51,981][123091] Updated weights for policy 0, policy_version 1934877 (0.0011) [2023-12-26 15:02:52,044][123091] Updated weights for policy 0, policy_version 1934887 (0.0011) [2023-12-26 15:02:52,385][123090] Updated weights for policy 1, policy_version 1922761 (0.0009) [2023-12-26 15:02:52,450][123090] Updated weights for policy 1, policy_version 1922771 (0.0008) [2023-12-26 15:02:52,514][123090] Updated weights for policy 1, policy_version 1922781 (0.0008) [2023-12-26 15:02:52,878][123091] Updated weights for policy 0, policy_version 1934897 (0.0010) [2023-12-26 15:02:52,937][123091] Updated weights for policy 0, policy_version 1934907 (0.0011) [2023-12-26 15:02:52,984][123091] Updated weights for policy 0, policy_version 1934917 (0.0010) [2023-12-26 15:02:53,036][123091] Updated weights for policy 0, policy_version 1934927 (0.0010) [2023-12-26 15:02:53,259][123090] Updated weights for policy 1, policy_version 1922791 (0.0009) [2023-12-26 15:02:53,321][123090] Updated weights for policy 1, policy_version 1922801 (0.0008) [2023-12-26 15:02:53,396][123090] Updated weights for policy 1, policy_version 1922811 (0.0005) [2023-12-26 15:02:53,784][121949] Fps is (10 sec: 17202.4, 60 sec: 17885.8, 300 sec: 17966.8). Total num frames: 987586560. Throughput: 0: 9076.6, 1: 8896.6. Samples: 987564188. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:02:53,786][121949] Avg episode reward: [(0, '6344.413'), (1, '5969.146')] [2023-12-26 15:02:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001934928_495345664.pth... [2023-12-26 15:02:53,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001922816_492240896.pth... [2023-12-26 15:02:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001921760_491970560.pth [2023-12-26 15:02:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001933872_495075328.pth [2023-12-26 15:02:53,879][123091] Updated weights for policy 0, policy_version 1934937 (0.0011) [2023-12-26 15:02:53,939][123091] Updated weights for policy 0, policy_version 1934947 (0.0011) [2023-12-26 15:02:53,987][123091] Updated weights for policy 0, policy_version 1934957 (0.0010) [2023-12-26 15:02:54,083][123090] Updated weights for policy 1, policy_version 1922821 (0.0007) [2023-12-26 15:02:54,136][123090] Updated weights for policy 1, policy_version 1922831 (0.0007) [2023-12-26 15:02:54,194][123090] Updated weights for policy 1, policy_version 1922841 (0.0008) [2023-12-26 15:02:54,833][123091] Updated weights for policy 0, policy_version 1934967 (0.0011) [2023-12-26 15:02:54,899][123091] Updated weights for policy 0, policy_version 1934977 (0.0011) [2023-12-26 15:02:54,966][123091] Updated weights for policy 0, policy_version 1934987 (0.0008) [2023-12-26 15:02:55,005][123090] Updated weights for policy 1, policy_version 1922851 (0.0009) [2023-12-26 15:02:55,056][123090] Updated weights for policy 1, policy_version 1922861 (0.0009) [2023-12-26 15:02:55,119][123090] Updated weights for policy 1, policy_version 1922871 (0.0010) [2023-12-26 15:02:55,751][123091] Updated weights for policy 0, policy_version 1934997 (0.0008) [2023-12-26 15:02:55,810][123091] Updated weights for policy 0, policy_version 1935007 (0.0010) [2023-12-26 15:02:55,868][123091] Updated weights for policy 0, policy_version 1935017 (0.0010) [2023-12-26 15:02:55,956][123090] Updated weights for policy 1, policy_version 1922881 (0.0010) [2023-12-26 15:02:56,020][123090] Updated weights for policy 1, policy_version 1922891 (0.0009) [2023-12-26 15:02:56,080][123090] Updated weights for policy 1, policy_version 1922901 (0.0005) [2023-12-26 15:02:56,143][123090] Updated weights for policy 1, policy_version 1922911 (0.0008) [2023-12-26 15:02:56,671][123091] Updated weights for policy 0, policy_version 1935027 (0.0010) [2023-12-26 15:02:56,729][123091] Updated weights for policy 0, policy_version 1935037 (0.0010) [2023-12-26 15:02:56,787][123091] Updated weights for policy 0, policy_version 1935047 (0.0010) [2023-12-26 15:02:56,943][123090] Updated weights for policy 1, policy_version 1922921 (0.0010) [2023-12-26 15:02:57,005][123090] Updated weights for policy 1, policy_version 1922931 (0.0010) [2023-12-26 15:02:57,058][123090] Updated weights for policy 1, policy_version 1922941 (0.0010) [2023-12-26 15:02:57,603][123091] Updated weights for policy 0, policy_version 1935057 (0.0010) [2023-12-26 15:02:57,655][123091] Updated weights for policy 0, policy_version 1935067 (0.0008) [2023-12-26 15:02:57,702][123091] Updated weights for policy 0, policy_version 1935077 (0.0010) [2023-12-26 15:02:57,749][123091] Updated weights for policy 0, policy_version 1935087 (0.0010) [2023-12-26 15:02:57,794][123090] Updated weights for policy 1, policy_version 1922951 (0.0008) [2023-12-26 15:02:57,844][123090] Updated weights for policy 1, policy_version 1922961 (0.0010) [2023-12-26 15:02:57,896][123090] Updated weights for policy 1, policy_version 1922971 (0.0007) [2023-12-26 15:02:58,581][123091] Updated weights for policy 0, policy_version 1935097 (0.0011) [2023-12-26 15:02:58,649][123091] Updated weights for policy 0, policy_version 1935107 (0.0011) [2023-12-26 15:02:58,716][123091] Updated weights for policy 0, policy_version 1935117 (0.0010) [2023-12-26 15:02:58,748][123090] Updated weights for policy 1, policy_version 1922981 (0.0008) [2023-12-26 15:02:58,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.4, 300 sec: 17966.9). Total num frames: 987676672. Throughput: 0: 9043.0, 1: 8994.1. Samples: 987670496. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:02:58,785][121949] Avg episode reward: [(0, '6338.159'), (1, '5682.346')] [2023-12-26 15:02:58,819][123090] Updated weights for policy 1, policy_version 1922991 (0.0009) [2023-12-26 15:02:58,883][123090] Updated weights for policy 1, policy_version 1923001 (0.0009) [2023-12-26 15:02:59,571][123091] Updated weights for policy 0, policy_version 1935127 (0.0011) [2023-12-26 15:02:59,631][123091] Updated weights for policy 0, policy_version 1935137 (0.0011) [2023-12-26 15:02:59,690][123091] Updated weights for policy 0, policy_version 1935147 (0.0011) [2023-12-26 15:02:59,733][123090] Updated weights for policy 1, policy_version 1923011 (0.0009) [2023-12-26 15:02:59,797][123090] Updated weights for policy 1, policy_version 1923021 (0.0009) [2023-12-26 15:02:59,866][123090] Updated weights for policy 1, policy_version 1923031 (0.0009) [2023-12-26 15:03:00,536][123091] Updated weights for policy 0, policy_version 1935157 (0.0011) [2023-12-26 15:03:00,580][123091] Updated weights for policy 0, policy_version 1935167 (0.0010) [2023-12-26 15:03:00,640][123091] Updated weights for policy 0, policy_version 1935177 (0.0011) [2023-12-26 15:03:00,715][123090] Updated weights for policy 1, policy_version 1923041 (0.0009) [2023-12-26 15:03:00,767][123090] Updated weights for policy 1, policy_version 1923051 (0.0009) [2023-12-26 15:03:00,819][123090] Updated weights for policy 1, policy_version 1923061 (0.0009) [2023-12-26 15:03:00,867][123090] Updated weights for policy 1, policy_version 1923072 (0.0009) [2023-12-26 15:03:01,495][123091] Updated weights for policy 0, policy_version 1935187 (0.0010) [2023-12-26 15:03:01,553][123091] Updated weights for policy 0, policy_version 1935197 (0.0010) [2023-12-26 15:03:01,608][123091] Updated weights for policy 0, policy_version 1935207 (0.0010) [2023-12-26 15:03:01,778][123090] Updated weights for policy 1, policy_version 1923082 (0.0009) [2023-12-26 15:03:01,843][123090] Updated weights for policy 1, policy_version 1923092 (0.0009) [2023-12-26 15:03:01,907][123090] Updated weights for policy 1, policy_version 1923102 (0.0009) [2023-12-26 15:03:02,445][123091] Updated weights for policy 0, policy_version 1935217 (0.0011) [2023-12-26 15:03:02,512][123091] Updated weights for policy 0, policy_version 1935227 (0.0011) [2023-12-26 15:03:02,577][123091] Updated weights for policy 0, policy_version 1935237 (0.0010) [2023-12-26 15:03:02,635][123091] Updated weights for policy 0, policy_version 1935247 (0.0010) [2023-12-26 15:03:02,739][123090] Updated weights for policy 1, policy_version 1923112 (0.0008) [2023-12-26 15:03:02,802][123090] Updated weights for policy 1, policy_version 1923122 (0.0008) [2023-12-26 15:03:02,865][123090] Updated weights for policy 1, policy_version 1923132 (0.0009) [2023-12-26 15:03:03,316][123091] Updated weights for policy 0, policy_version 1935257 (0.0006) [2023-12-26 15:03:03,371][123091] Updated weights for policy 0, policy_version 1935267 (0.0007) [2023-12-26 15:03:03,426][123091] Updated weights for policy 0, policy_version 1935277 (0.0010) [2023-12-26 15:03:03,507][123090] Updated weights for policy 1, policy_version 1923142 (0.0007) [2023-12-26 15:03:03,558][123090] Updated weights for policy 1, policy_version 1923152 (0.0005) [2023-12-26 15:03:03,604][123090] Updated weights for policy 1, policy_version 1923162 (0.0005) [2023-12-26 15:03:03,784][121949] Fps is (10 sec: 18023.2, 60 sec: 17885.9, 300 sec: 17966.9). Total num frames: 987766784. Throughput: 0: 8943.8, 1: 8939.0. Samples: 987774340. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:03,785][121949] Avg episode reward: [(0, '6388.142'), (1, '5767.994')] [2023-12-26 15:03:04,225][123091] Updated weights for policy 0, policy_version 1935287 (0.0010) [2023-12-26 15:03:04,251][123090] Updated weights for policy 1, policy_version 1923172 (0.0007) [2023-12-26 15:03:04,284][123091] Updated weights for policy 0, policy_version 1935297 (0.0011) [2023-12-26 15:03:04,315][123090] Updated weights for policy 1, policy_version 1923182 (0.0011) [2023-12-26 15:03:04,343][123091] Updated weights for policy 0, policy_version 1935307 (0.0010) [2023-12-26 15:03:04,376][123090] Updated weights for policy 1, policy_version 1923192 (0.0010) [2023-12-26 15:03:05,124][123090] Updated weights for policy 1, policy_version 1923202 (0.0011) [2023-12-26 15:03:05,159][123091] Updated weights for policy 0, policy_version 1935317 (0.0009) [2023-12-26 15:03:05,176][123090] Updated weights for policy 1, policy_version 1923212 (0.0010) [2023-12-26 15:03:05,218][123091] Updated weights for policy 0, policy_version 1935327 (0.0010) [2023-12-26 15:03:05,227][123090] Updated weights for policy 1, policy_version 1923222 (0.0010) [2023-12-26 15:03:05,272][123091] Updated weights for policy 0, policy_version 1935337 (0.0010) [2023-12-26 15:03:05,287][123090] Updated weights for policy 1, policy_version 1923232 (0.0010) [2023-12-26 15:03:06,093][123091] Updated weights for policy 0, policy_version 1935347 (0.0010) [2023-12-26 15:03:06,140][123090] Updated weights for policy 1, policy_version 1923242 (0.0009) [2023-12-26 15:03:06,156][123091] Updated weights for policy 0, policy_version 1935357 (0.0011) [2023-12-26 15:03:06,198][123090] Updated weights for policy 1, policy_version 1923252 (0.0005) [2023-12-26 15:03:06,224][123091] Updated weights for policy 0, policy_version 1935367 (0.0011) [2023-12-26 15:03:06,262][123090] Updated weights for policy 1, policy_version 1923262 (0.0008) [2023-12-26 15:03:07,043][123091] Updated weights for policy 0, policy_version 1935377 (0.0010) [2023-12-26 15:03:07,077][123090] Updated weights for policy 1, policy_version 1923272 (0.0010) [2023-12-26 15:03:07,102][123091] Updated weights for policy 0, policy_version 1935387 (0.0010) [2023-12-26 15:03:07,131][123090] Updated weights for policy 1, policy_version 1923282 (0.0008) [2023-12-26 15:03:07,158][123091] Updated weights for policy 0, policy_version 1935397 (0.0011) [2023-12-26 15:03:07,195][123090] Updated weights for policy 1, policy_version 1923292 (0.0010) [2023-12-26 15:03:07,220][123091] Updated weights for policy 0, policy_version 1935407 (0.0010) [2023-12-26 15:03:07,952][123091] Updated weights for policy 0, policy_version 1935417 (0.0006) [2023-12-26 15:03:07,981][123090] Updated weights for policy 1, policy_version 1923302 (0.0010) [2023-12-26 15:03:08,015][123091] Updated weights for policy 0, policy_version 1935427 (0.0007) [2023-12-26 15:03:08,044][123090] Updated weights for policy 1, policy_version 1923312 (0.0010) [2023-12-26 15:03:08,063][123091] Updated weights for policy 0, policy_version 1935437 (0.0005) [2023-12-26 15:03:08,117][123090] Updated weights for policy 1, policy_version 1923322 (0.0010) [2023-12-26 15:03:08,765][123091] Updated weights for policy 0, policy_version 1935447 (0.0008) [2023-12-26 15:03:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 987848704. Throughput: 0: 8967.1, 1: 8986.5. Samples: 987827596. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:08,785][121949] Avg episode reward: [(0, '6410.150'), (1, '5775.403')] [2023-12-26 15:03:08,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001923328_492371968.pth... [2023-12-26 15:03:08,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001922304_492109824.pth [2023-12-26 15:03:08,822][123091] Updated weights for policy 0, policy_version 1935457 (0.0010) [2023-12-26 15:03:08,837][123090] Updated weights for policy 1, policy_version 1923332 (0.0010) [2023-12-26 15:03:08,875][123091] Updated weights for policy 0, policy_version 1935467 (0.0007) [2023-12-26 15:03:08,897][123090] Updated weights for policy 1, policy_version 1923342 (0.0010) [2023-12-26 15:03:08,900][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001935472_495484928.pth... [2023-12-26 15:03:08,904][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001934448_495222784.pth [2023-12-26 15:03:08,945][123090] Updated weights for policy 1, policy_version 1923352 (0.0010) [2023-12-26 15:03:09,774][123091] Updated weights for policy 0, policy_version 1935477 (0.0009) [2023-12-26 15:03:09,816][123090] Updated weights for policy 1, policy_version 1923362 (0.0010) [2023-12-26 15:03:09,843][123091] Updated weights for policy 0, policy_version 1935487 (0.0009) [2023-12-26 15:03:09,885][123090] Updated weights for policy 1, policy_version 1923372 (0.0011) [2023-12-26 15:03:09,906][123091] Updated weights for policy 0, policy_version 1935497 (0.0009) [2023-12-26 15:03:09,951][123090] Updated weights for policy 1, policy_version 1923382 (0.0010) [2023-12-26 15:03:10,018][123090] Updated weights for policy 1, policy_version 1923392 (0.0009) [2023-12-26 15:03:10,794][123091] Updated weights for policy 0, policy_version 1935507 (0.0008) [2023-12-26 15:03:10,795][123090] Updated weights for policy 1, policy_version 1923402 (0.0007) [2023-12-26 15:03:10,866][123091] Updated weights for policy 0, policy_version 1935517 (0.0009) [2023-12-26 15:03:10,868][123090] Updated weights for policy 1, policy_version 1923412 (0.0006) [2023-12-26 15:03:10,928][123091] Updated weights for policy 0, policy_version 1935527 (0.0008) [2023-12-26 15:03:10,934][123090] Updated weights for policy 1, policy_version 1923422 (0.0009) [2023-12-26 15:03:11,771][123090] Updated weights for policy 1, policy_version 1923432 (0.0009) [2023-12-26 15:03:11,803][123091] Updated weights for policy 0, policy_version 1935537 (0.0009) [2023-12-26 15:03:11,829][123090] Updated weights for policy 1, policy_version 1923442 (0.0007) [2023-12-26 15:03:11,866][123091] Updated weights for policy 0, policy_version 1935547 (0.0008) [2023-12-26 15:03:11,889][123090] Updated weights for policy 1, policy_version 1923452 (0.0009) [2023-12-26 15:03:11,929][123091] Updated weights for policy 0, policy_version 1935557 (0.0009) [2023-12-26 15:03:11,989][123091] Updated weights for policy 0, policy_version 1935567 (0.0010) [2023-12-26 15:03:12,668][123090] Updated weights for policy 1, policy_version 1923462 (0.0008) [2023-12-26 15:03:12,727][123090] Updated weights for policy 1, policy_version 1923472 (0.0009) [2023-12-26 15:03:12,793][123090] Updated weights for policy 1, policy_version 1923482 (0.0008) [2023-12-26 15:03:12,848][123091] Updated weights for policy 0, policy_version 1935577 (0.0010) [2023-12-26 15:03:12,905][123091] Updated weights for policy 0, policy_version 1935587 (0.0009) [2023-12-26 15:03:12,955][123091] Updated weights for policy 0, policy_version 1935597 (0.0009) [2023-12-26 15:03:13,517][123090] Updated weights for policy 1, policy_version 1923492 (0.0008) [2023-12-26 15:03:13,581][123090] Updated weights for policy 1, policy_version 1923502 (0.0009) [2023-12-26 15:03:13,646][123090] Updated weights for policy 1, policy_version 1923512 (0.0009) [2023-12-26 15:03:13,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17939.1). Total num frames: 987938816. Throughput: 0: 8798.1, 1: 8932.6. Samples: 987932296. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:13,785][121949] Avg episode reward: [(0, '6424.823'), (1, '5900.467')] [2023-12-26 15:03:13,796][123091] Updated weights for policy 0, policy_version 1935607 (0.0010) [2023-12-26 15:03:13,849][123091] Updated weights for policy 0, policy_version 1935617 (0.0009) [2023-12-26 15:03:13,906][123091] Updated weights for policy 0, policy_version 1935627 (0.0009) [2023-12-26 15:03:14,480][123090] Updated weights for policy 1, policy_version 1923522 (0.0010) [2023-12-26 15:03:14,536][123090] Updated weights for policy 1, policy_version 1923532 (0.0009) [2023-12-26 15:03:14,590][123090] Updated weights for policy 1, policy_version 1923542 (0.0009) [2023-12-26 15:03:14,647][123090] Updated weights for policy 1, policy_version 1923552 (0.0006) [2023-12-26 15:03:14,740][123091] Updated weights for policy 0, policy_version 1935637 (0.0009) [2023-12-26 15:03:14,812][123091] Updated weights for policy 0, policy_version 1935647 (0.0009) [2023-12-26 15:03:14,879][123091] Updated weights for policy 0, policy_version 1935657 (0.0010) [2023-12-26 15:03:15,475][123090] Updated weights for policy 1, policy_version 1923562 (0.0009) [2023-12-26 15:03:15,530][123090] Updated weights for policy 1, policy_version 1923572 (0.0009) [2023-12-26 15:03:15,586][123090] Updated weights for policy 1, policy_version 1923582 (0.0009) [2023-12-26 15:03:15,726][123091] Updated weights for policy 0, policy_version 1935667 (0.0010) [2023-12-26 15:03:15,782][123091] Updated weights for policy 0, policy_version 1935677 (0.0009) [2023-12-26 15:03:15,841][123091] Updated weights for policy 0, policy_version 1935687 (0.0010) [2023-12-26 15:03:16,412][123090] Updated weights for policy 1, policy_version 1923592 (0.0010) [2023-12-26 15:03:16,478][123090] Updated weights for policy 1, policy_version 1923602 (0.0010) [2023-12-26 15:03:16,544][123090] Updated weights for policy 1, policy_version 1923612 (0.0010) [2023-12-26 15:03:16,679][123091] Updated weights for policy 0, policy_version 1935697 (0.0009) [2023-12-26 15:03:16,743][123091] Updated weights for policy 0, policy_version 1935707 (0.0009) [2023-12-26 15:03:16,811][123091] Updated weights for policy 0, policy_version 1935717 (0.0009) [2023-12-26 15:03:16,875][123091] Updated weights for policy 0, policy_version 1935727 (0.0009) [2023-12-26 15:03:17,331][123090] Updated weights for policy 1, policy_version 1923622 (0.0010) [2023-12-26 15:03:17,382][123090] Updated weights for policy 1, policy_version 1923632 (0.0009) [2023-12-26 15:03:17,431][123090] Updated weights for policy 1, policy_version 1923642 (0.0008) [2023-12-26 15:03:17,691][123091] Updated weights for policy 0, policy_version 1935737 (0.0008) [2023-12-26 15:03:17,747][123091] Updated weights for policy 0, policy_version 1935747 (0.0009) [2023-12-26 15:03:17,804][123091] Updated weights for policy 0, policy_version 1935757 (0.0007) [2023-12-26 15:03:18,273][123090] Updated weights for policy 1, policy_version 1923652 (0.0009) [2023-12-26 15:03:18,340][123090] Updated weights for policy 1, policy_version 1923662 (0.0009) [2023-12-26 15:03:18,400][123090] Updated weights for policy 1, policy_version 1923672 (0.0009) [2023-12-26 15:03:18,577][123091] Updated weights for policy 0, policy_version 1935767 (0.0009) [2023-12-26 15:03:18,628][123091] Updated weights for policy 0, policy_version 1935777 (0.0008) [2023-12-26 15:03:18,686][123091] Updated weights for policy 0, policy_version 1935787 (0.0009) [2023-12-26 15:03:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 988028928. Throughput: 0: 8680.7, 1: 8879.5. Samples: 988035480. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:18,785][121949] Avg episode reward: [(0, '6362.823'), (1, '6063.574')] [2023-12-26 15:03:19,253][123090] Updated weights for policy 1, policy_version 1923682 (0.0006) [2023-12-26 15:03:19,326][123090] Updated weights for policy 1, policy_version 1923692 (0.0008) [2023-12-26 15:03:19,395][123090] Updated weights for policy 1, policy_version 1923702 (0.0008) [2023-12-26 15:03:19,467][123090] Updated weights for policy 1, policy_version 1923712 (0.0008) [2023-12-26 15:03:19,510][123091] Updated weights for policy 0, policy_version 1935797 (0.0009) [2023-12-26 15:03:19,569][123091] Updated weights for policy 0, policy_version 1935807 (0.0007) [2023-12-26 15:03:19,629][123091] Updated weights for policy 0, policy_version 1935817 (0.0007) [2023-12-26 15:03:20,300][123090] Updated weights for policy 1, policy_version 1923722 (0.0009) [2023-12-26 15:03:20,358][123090] Updated weights for policy 1, policy_version 1923732 (0.0009) [2023-12-26 15:03:20,399][123091] Updated weights for policy 0, policy_version 1935827 (0.0009) [2023-12-26 15:03:20,418][123090] Updated weights for policy 1, policy_version 1923742 (0.0009) [2023-12-26 15:03:20,462][123091] Updated weights for policy 0, policy_version 1935837 (0.0011) [2023-12-26 15:03:20,534][123091] Updated weights for policy 0, policy_version 1935847 (0.0011) [2023-12-26 15:03:21,314][123090] Updated weights for policy 1, policy_version 1923752 (0.0009) [2023-12-26 15:03:21,337][123091] Updated weights for policy 0, policy_version 1935857 (0.0010) [2023-12-26 15:03:21,377][123090] Updated weights for policy 1, policy_version 1923762 (0.0008) [2023-12-26 15:03:21,407][123091] Updated weights for policy 0, policy_version 1935867 (0.0010) [2023-12-26 15:03:21,453][123090] Updated weights for policy 1, policy_version 1923772 (0.0007) [2023-12-26 15:03:21,479][123091] Updated weights for policy 0, policy_version 1935877 (0.0011) [2023-12-26 15:03:21,545][123091] Updated weights for policy 0, policy_version 1935887 (0.0011) [2023-12-26 15:03:22,247][123090] Updated weights for policy 1, policy_version 1923782 (0.0009) [2023-12-26 15:03:22,315][123090] Updated weights for policy 1, policy_version 1923792 (0.0009) [2023-12-26 15:03:22,382][123090] Updated weights for policy 1, policy_version 1923802 (0.0009) [2023-12-26 15:03:22,400][123091] Updated weights for policy 0, policy_version 1935897 (0.0010) [2023-12-26 15:03:22,459][123091] Updated weights for policy 0, policy_version 1935907 (0.0011) [2023-12-26 15:03:22,526][123091] Updated weights for policy 0, policy_version 1935917 (0.0011) [2023-12-26 15:03:23,161][123090] Updated weights for policy 1, policy_version 1923812 (0.0010) [2023-12-26 15:03:23,217][123090] Updated weights for policy 1, policy_version 1923822 (0.0010) [2023-12-26 15:03:23,265][123090] Updated weights for policy 1, policy_version 1923832 (0.0010) [2023-12-26 15:03:23,324][123091] Updated weights for policy 0, policy_version 1935927 (0.0010) [2023-12-26 15:03:23,390][123091] Updated weights for policy 0, policy_version 1935937 (0.0009) [2023-12-26 15:03:23,456][123091] Updated weights for policy 0, policy_version 1935947 (0.0007) [2023-12-26 15:03:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17911.3). Total num frames: 988110848. Throughput: 0: 8636.9, 1: 8820.6. Samples: 988086272. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:23,785][121949] Avg episode reward: [(0, '6309.157'), (1, '5998.937')] [2023-12-26 15:03:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001923840_492503040.pth... [2023-12-26 15:03:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001935952_495607808.pth... [2023-12-26 15:03:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001922816_492240896.pth [2023-12-26 15:03:23,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001934928_495345664.pth [2023-12-26 15:03:24,045][123090] Updated weights for policy 1, policy_version 1923842 (0.0010) [2023-12-26 15:03:24,106][123090] Updated weights for policy 1, policy_version 1923852 (0.0007) [2023-12-26 15:03:24,128][123091] Updated weights for policy 0, policy_version 1935957 (0.0006) [2023-12-26 15:03:24,168][123090] Updated weights for policy 1, policy_version 1923862 (0.0010) [2023-12-26 15:03:24,197][123091] Updated weights for policy 0, policy_version 1935967 (0.0006) [2023-12-26 15:03:24,230][123090] Updated weights for policy 1, policy_version 1923872 (0.0008) [2023-12-26 15:03:24,259][123091] Updated weights for policy 0, policy_version 1935977 (0.0010) [2023-12-26 15:03:24,943][123090] Updated weights for policy 1, policy_version 1923882 (0.0006) [2023-12-26 15:03:25,004][123090] Updated weights for policy 1, policy_version 1923892 (0.0009) [2023-12-26 15:03:25,064][123090] Updated weights for policy 1, policy_version 1923902 (0.0010) [2023-12-26 15:03:25,113][123091] Updated weights for policy 0, policy_version 1935988 (0.0010) [2023-12-26 15:03:25,168][123091] Updated weights for policy 0, policy_version 1935999 (0.0011) [2023-12-26 15:03:25,225][123091] Updated weights for policy 0, policy_version 1936009 (0.0009) [2023-12-26 15:03:25,783][123090] Updated weights for policy 1, policy_version 1923912 (0.0006) [2023-12-26 15:03:25,854][123090] Updated weights for policy 1, policy_version 1923922 (0.0007) [2023-12-26 15:03:25,916][123090] Updated weights for policy 1, policy_version 1923932 (0.0011) [2023-12-26 15:03:26,020][123091] Updated weights for policy 0, policy_version 1936019 (0.0010) [2023-12-26 15:03:26,087][123091] Updated weights for policy 0, policy_version 1936029 (0.0009) [2023-12-26 15:03:26,147][123091] Updated weights for policy 0, policy_version 1936039 (0.0005) [2023-12-26 15:03:26,651][123090] Updated weights for policy 1, policy_version 1923942 (0.0010) [2023-12-26 15:03:26,713][123090] Updated weights for policy 1, policy_version 1923952 (0.0005) [2023-12-26 15:03:26,769][123090] Updated weights for policy 1, policy_version 1923962 (0.0005) [2023-12-26 15:03:26,857][123091] Updated weights for policy 0, policy_version 1936049 (0.0009) [2023-12-26 15:03:26,917][123091] Updated weights for policy 0, policy_version 1936059 (0.0005) [2023-12-26 15:03:26,962][123091] Updated weights for policy 0, policy_version 1936069 (0.0005) [2023-12-26 15:03:27,025][123091] Updated weights for policy 0, policy_version 1936079 (0.0005) [2023-12-26 15:03:27,429][123090] Updated weights for policy 1, policy_version 1923972 (0.0005) [2023-12-26 15:03:27,483][123090] Updated weights for policy 1, policy_version 1923982 (0.0006) [2023-12-26 15:03:27,530][123090] Updated weights for policy 1, policy_version 1923992 (0.0010) [2023-12-26 15:03:27,699][123091] Updated weights for policy 0, policy_version 1936089 (0.0005) [2023-12-26 15:03:27,745][123091] Updated weights for policy 0, policy_version 1936099 (0.0005) [2023-12-26 15:03:27,789][123091] Updated weights for policy 0, policy_version 1936109 (0.0005) [2023-12-26 15:03:28,340][123090] Updated weights for policy 1, policy_version 1924002 (0.0010) [2023-12-26 15:03:28,407][123090] Updated weights for policy 1, policy_version 1924012 (0.0011) [2023-12-26 15:03:28,425][123091] Updated weights for policy 0, policy_version 1936119 (0.0005) [2023-12-26 15:03:28,470][123090] Updated weights for policy 1, policy_version 1924022 (0.0010) [2023-12-26 15:03:28,480][123091] Updated weights for policy 0, policy_version 1936129 (0.0006) [2023-12-26 15:03:28,530][123090] Updated weights for policy 1, policy_version 1924032 (0.0010) [2023-12-26 15:03:28,534][123091] Updated weights for policy 0, policy_version 1936139 (0.0005) [2023-12-26 15:03:28,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 988209152. Throughput: 0: 8721.0, 1: 8895.5. Samples: 988198808. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:28,785][121949] Avg episode reward: [(0, '6257.875'), (1, '5854.569')] [2023-12-26 15:03:29,093][123091] Updated weights for policy 0, policy_version 1936149 (0.0005) [2023-12-26 15:03:29,159][123091] Updated weights for policy 0, policy_version 1936159 (0.0005) [2023-12-26 15:03:29,223][123091] Updated weights for policy 0, policy_version 1936169 (0.0008) [2023-12-26 15:03:29,414][123090] Updated weights for policy 1, policy_version 1924042 (0.0011) [2023-12-26 15:03:29,466][123090] Updated weights for policy 1, policy_version 1924052 (0.0010) [2023-12-26 15:03:29,533][123090] Updated weights for policy 1, policy_version 1924062 (0.0010) [2023-12-26 15:03:30,019][123091] Updated weights for policy 0, policy_version 1936179 (0.0009) [2023-12-26 15:03:30,082][123091] Updated weights for policy 0, policy_version 1936189 (0.0005) [2023-12-26 15:03:30,151][123091] Updated weights for policy 0, policy_version 1936199 (0.0007) [2023-12-26 15:03:30,326][123090] Updated weights for policy 1, policy_version 1924072 (0.0009) [2023-12-26 15:03:30,393][123090] Updated weights for policy 1, policy_version 1924082 (0.0009) [2023-12-26 15:03:30,443][123090] Updated weights for policy 1, policy_version 1924092 (0.0009) [2023-12-26 15:03:30,965][123091] Updated weights for policy 0, policy_version 1936209 (0.0007) [2023-12-26 15:03:31,035][123091] Updated weights for policy 0, policy_version 1936219 (0.0009) [2023-12-26 15:03:31,098][123091] Updated weights for policy 0, policy_version 1936229 (0.0010) [2023-12-26 15:03:31,159][123090] Updated weights for policy 1, policy_version 1924102 (0.0007) [2023-12-26 15:03:31,169][123091] Updated weights for policy 0, policy_version 1936239 (0.0008) [2023-12-26 15:03:31,212][123090] Updated weights for policy 1, policy_version 1924112 (0.0006) [2023-12-26 15:03:31,278][123090] Updated weights for policy 1, policy_version 1924122 (0.0010) [2023-12-26 15:03:32,009][123091] Updated weights for policy 0, policy_version 1936249 (0.0009) [2023-12-26 15:03:32,064][123090] Updated weights for policy 1, policy_version 1924132 (0.0011) [2023-12-26 15:03:32,073][123091] Updated weights for policy 0, policy_version 1936259 (0.0010) [2023-12-26 15:03:32,120][123090] Updated weights for policy 1, policy_version 1924142 (0.0011) [2023-12-26 15:03:32,127][123091] Updated weights for policy 0, policy_version 1936269 (0.0008) [2023-12-26 15:03:32,172][123090] Updated weights for policy 1, policy_version 1924152 (0.0010) [2023-12-26 15:03:32,961][123091] Updated weights for policy 0, policy_version 1936279 (0.0007) [2023-12-26 15:03:32,967][123090] Updated weights for policy 1, policy_version 1924162 (0.0009) [2023-12-26 15:03:33,017][123090] Updated weights for policy 1, policy_version 1924172 (0.0005) [2023-12-26 15:03:33,025][123091] Updated weights for policy 0, policy_version 1936289 (0.0009) [2023-12-26 15:03:33,080][123090] Updated weights for policy 1, policy_version 1924182 (0.0006) [2023-12-26 15:03:33,090][123091] Updated weights for policy 0, policy_version 1936299 (0.0009) [2023-12-26 15:03:33,143][123090] Updated weights for policy 1, policy_version 1924192 (0.0006) [2023-12-26 15:03:33,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 988291072. Throughput: 0: 8769.1, 1: 8871.1. Samples: 988307068. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:33,785][121949] Avg episode reward: [(0, '6210.449'), (1, '5871.718')] [2023-12-26 15:03:33,829][123090] Updated weights for policy 1, policy_version 1924202 (0.0009) [2023-12-26 15:03:33,898][123090] Updated weights for policy 1, policy_version 1924212 (0.0009) [2023-12-26 15:03:33,901][123091] Updated weights for policy 0, policy_version 1936309 (0.0007) [2023-12-26 15:03:33,955][123091] Updated weights for policy 0, policy_version 1936319 (0.0005) [2023-12-26 15:03:33,961][123090] Updated weights for policy 1, policy_version 1924222 (0.0009) [2023-12-26 15:03:34,004][123091] Updated weights for policy 0, policy_version 1936329 (0.0009) [2023-12-26 15:03:34,700][123090] Updated weights for policy 1, policy_version 1924232 (0.0008) [2023-12-26 15:03:34,766][123090] Updated weights for policy 1, policy_version 1924242 (0.0009) [2023-12-26 15:03:34,780][123091] Updated weights for policy 0, policy_version 1936339 (0.0009) [2023-12-26 15:03:34,818][123090] Updated weights for policy 1, policy_version 1924252 (0.0007) [2023-12-26 15:03:34,829][123091] Updated weights for policy 0, policy_version 1936349 (0.0008) [2023-12-26 15:03:34,886][123091] Updated weights for policy 0, policy_version 1936359 (0.0007) [2023-12-26 15:03:35,427][123091] Updated weights for policy 0, policy_version 1936369 (0.0005) [2023-12-26 15:03:35,482][123091] Updated weights for policy 0, policy_version 1936379 (0.0005) [2023-12-26 15:03:35,531][123091] Updated weights for policy 0, policy_version 1936389 (0.0005) [2023-12-26 15:03:35,585][123091] Updated weights for policy 0, policy_version 1936399 (0.0005) [2023-12-26 15:03:35,702][123090] Updated weights for policy 1, policy_version 1924262 (0.0009) [2023-12-26 15:03:35,757][123090] Updated weights for policy 1, policy_version 1924273 (0.0011) [2023-12-26 15:03:35,811][123090] Updated weights for policy 1, policy_version 1924284 (0.0007) [2023-12-26 15:03:36,259][123091] Updated weights for policy 0, policy_version 1936409 (0.0007) [2023-12-26 15:03:36,325][123091] Updated weights for policy 0, policy_version 1936419 (0.0009) [2023-12-26 15:03:36,391][123091] Updated weights for policy 0, policy_version 1936429 (0.0009) [2023-12-26 15:03:36,597][123090] Updated weights for policy 1, policy_version 1924294 (0.0008) [2023-12-26 15:03:36,671][123090] Updated weights for policy 1, policy_version 1924304 (0.0011) [2023-12-26 15:03:36,749][123090] Updated weights for policy 1, policy_version 1924314 (0.0006) [2023-12-26 15:03:37,205][123091] Updated weights for policy 0, policy_version 1936439 (0.0010) [2023-12-26 15:03:37,263][123091] Updated weights for policy 0, policy_version 1936449 (0.0010) [2023-12-26 15:03:37,316][123091] Updated weights for policy 0, policy_version 1936460 (0.0010) [2023-12-26 15:03:37,441][123090] Updated weights for policy 1, policy_version 1924324 (0.0007) [2023-12-26 15:03:37,511][123090] Updated weights for policy 1, policy_version 1924334 (0.0009) [2023-12-26 15:03:37,580][123090] Updated weights for policy 1, policy_version 1924344 (0.0005) [2023-12-26 15:03:38,208][123091] Updated weights for policy 0, policy_version 1936470 (0.0009) [2023-12-26 15:03:38,260][123091] Updated weights for policy 0, policy_version 1936480 (0.0009) [2023-12-26 15:03:38,297][123090] Updated weights for policy 1, policy_version 1924354 (0.0009) [2023-12-26 15:03:38,322][123091] Updated weights for policy 0, policy_version 1936490 (0.0008) [2023-12-26 15:03:38,372][123090] Updated weights for policy 1, policy_version 1924364 (0.0009) [2023-12-26 15:03:38,440][123090] Updated weights for policy 1, policy_version 1924374 (0.0011) [2023-12-26 15:03:38,511][123090] Updated weights for policy 1, policy_version 1924384 (0.0011) [2023-12-26 15:03:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17939.1). Total num frames: 988389376. Throughput: 0: 8866.7, 1: 8870.5. Samples: 988362356. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:38,785][121949] Avg episode reward: [(0, '6199.574'), (1, '5896.000')] [2023-12-26 15:03:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001936496_495747072.pth... [2023-12-26 15:03:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001924384_492642304.pth... [2023-12-26 15:03:38,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001923328_492371968.pth [2023-12-26 15:03:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001935472_495484928.pth [2023-12-26 15:03:39,086][123091] Updated weights for policy 0, policy_version 1936500 (0.0007) [2023-12-26 15:03:39,148][123091] Updated weights for policy 0, policy_version 1936510 (0.0007) [2023-12-26 15:03:39,216][123091] Updated weights for policy 0, policy_version 1936520 (0.0008) [2023-12-26 15:03:39,315][123090] Updated weights for policy 1, policy_version 1924394 (0.0010) [2023-12-26 15:03:39,381][123090] Updated weights for policy 1, policy_version 1924404 (0.0010) [2023-12-26 15:03:39,451][123090] Updated weights for policy 1, policy_version 1924414 (0.0007) [2023-12-26 15:03:40,067][123091] Updated weights for policy 0, policy_version 1936530 (0.0009) [2023-12-26 15:03:40,125][123091] Updated weights for policy 0, policy_version 1936540 (0.0009) [2023-12-26 15:03:40,195][123091] Updated weights for policy 0, policy_version 1936550 (0.0009) [2023-12-26 15:03:40,249][123090] Updated weights for policy 1, policy_version 1924424 (0.0008) [2023-12-26 15:03:40,319][123090] Updated weights for policy 1, policy_version 1924434 (0.0009) [2023-12-26 15:03:40,385][123090] Updated weights for policy 1, policy_version 1924444 (0.0010) [2023-12-26 15:03:41,030][123091] Updated weights for policy 0, policy_version 1936561 (0.0009) [2023-12-26 15:03:41,100][123091] Updated weights for policy 0, policy_version 1936571 (0.0006) [2023-12-26 15:03:41,187][123091] Updated weights for policy 0, policy_version 1936581 (0.0006) [2023-12-26 15:03:41,196][123090] Updated weights for policy 1, policy_version 1924454 (0.0008) [2023-12-26 15:03:41,258][123091] Updated weights for policy 0, policy_version 1936591 (0.0006) [2023-12-26 15:03:41,269][123090] Updated weights for policy 1, policy_version 1924464 (0.0008) [2023-12-26 15:03:41,341][123090] Updated weights for policy 1, policy_version 1924474 (0.0011) [2023-12-26 15:03:42,081][123091] Updated weights for policy 0, policy_version 1936601 (0.0008) [2023-12-26 15:03:42,150][123090] Updated weights for policy 1, policy_version 1924484 (0.0010) [2023-12-26 15:03:42,154][123091] Updated weights for policy 0, policy_version 1936611 (0.0008) [2023-12-26 15:03:42,213][123090] Updated weights for policy 1, policy_version 1924494 (0.0009) [2023-12-26 15:03:42,218][123091] Updated weights for policy 0, policy_version 1936621 (0.0008) [2023-12-26 15:03:42,278][123090] Updated weights for policy 1, policy_version 1924504 (0.0009) [2023-12-26 15:03:42,999][123091] Updated weights for policy 0, policy_version 1936631 (0.0009) [2023-12-26 15:03:43,050][123091] Updated weights for policy 0, policy_version 1936641 (0.0010) [2023-12-26 15:03:43,102][123091] Updated weights for policy 0, policy_version 1936652 (0.0010) [2023-12-26 15:03:43,122][123090] Updated weights for policy 1, policy_version 1924514 (0.0010) [2023-12-26 15:03:43,171][123090] Updated weights for policy 1, policy_version 1924524 (0.0009) [2023-12-26 15:03:43,226][123090] Updated weights for policy 1, policy_version 1924534 (0.0009) [2023-12-26 15:03:43,278][123090] Updated weights for policy 1, policy_version 1924544 (0.0009) [2023-12-26 15:03:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 988471296. Throughput: 0: 8853.1, 1: 8845.7. Samples: 988466940. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:43,785][121949] Avg episode reward: [(0, '6159.821'), (1, '5972.895')] [2023-12-26 15:03:43,983][123091] Updated weights for policy 0, policy_version 1936662 (0.0009) [2023-12-26 15:03:44,032][123091] Updated weights for policy 0, policy_version 1936672 (0.0007) [2023-12-26 15:03:44,035][123090] Updated weights for policy 1, policy_version 1924554 (0.0008) [2023-12-26 15:03:44,082][123091] Updated weights for policy 0, policy_version 1936682 (0.0008) [2023-12-26 15:03:44,086][123090] Updated weights for policy 1, policy_version 1924564 (0.0007) [2023-12-26 15:03:44,133][123090] Updated weights for policy 1, policy_version 1924574 (0.0005) [2023-12-26 15:03:44,940][123090] Updated weights for policy 1, policy_version 1924584 (0.0008) [2023-12-26 15:03:44,942][123091] Updated weights for policy 0, policy_version 1936692 (0.0009) [2023-12-26 15:03:44,996][123091] Updated weights for policy 0, policy_version 1936702 (0.0010) [2023-12-26 15:03:44,996][123090] Updated weights for policy 1, policy_version 1924594 (0.0007) [2023-12-26 15:03:45,050][123090] Updated weights for policy 1, policy_version 1924604 (0.0007) [2023-12-26 15:03:45,056][123091] Updated weights for policy 0, policy_version 1936712 (0.0009) [2023-12-26 15:03:45,894][123090] Updated weights for policy 1, policy_version 1924614 (0.0009) [2023-12-26 15:03:45,910][123091] Updated weights for policy 0, policy_version 1936722 (0.0009) [2023-12-26 15:03:45,957][123090] Updated weights for policy 1, policy_version 1924624 (0.0009) [2023-12-26 15:03:45,968][123091] Updated weights for policy 0, policy_version 1936732 (0.0007) [2023-12-26 15:03:46,019][123090] Updated weights for policy 1, policy_version 1924634 (0.0009) [2023-12-26 15:03:46,021][123091] Updated weights for policy 0, policy_version 1936742 (0.0006) [2023-12-26 15:03:46,078][123091] Updated weights for policy 0, policy_version 1936752 (0.0008) [2023-12-26 15:03:46,847][123090] Updated weights for policy 1, policy_version 1924644 (0.0009) [2023-12-26 15:03:46,908][123090] Updated weights for policy 1, policy_version 1924654 (0.0008) [2023-12-26 15:03:46,914][123091] Updated weights for policy 0, policy_version 1936762 (0.0010) [2023-12-26 15:03:46,975][123090] Updated weights for policy 1, policy_version 1924664 (0.0006) [2023-12-26 15:03:46,977][123091] Updated weights for policy 0, policy_version 1936772 (0.0009) [2023-12-26 15:03:47,034][123091] Updated weights for policy 0, policy_version 1936782 (0.0010) [2023-12-26 15:03:47,717][123090] Updated weights for policy 1, policy_version 1924674 (0.0007) [2023-12-26 15:03:47,775][123090] Updated weights for policy 1, policy_version 1924684 (0.0009) [2023-12-26 15:03:47,806][123091] Updated weights for policy 0, policy_version 1936792 (0.0008) [2023-12-26 15:03:47,838][123090] Updated weights for policy 1, policy_version 1924694 (0.0009) [2023-12-26 15:03:47,865][123091] Updated weights for policy 0, policy_version 1936802 (0.0005) [2023-12-26 15:03:47,899][123090] Updated weights for policy 1, policy_version 1924704 (0.0008) [2023-12-26 15:03:47,917][123091] Updated weights for policy 0, policy_version 1936812 (0.0005) [2023-12-26 15:03:48,679][123090] Updated weights for policy 1, policy_version 1924714 (0.0005) [2023-12-26 15:03:48,727][123091] Updated weights for policy 0, policy_version 1936822 (0.0007) [2023-12-26 15:03:48,743][123090] Updated weights for policy 1, policy_version 1924724 (0.0006) [2023-12-26 15:03:48,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17883.6). Total num frames: 988553216. Throughput: 0: 8831.5, 1: 8897.0. Samples: 988572124. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:48,785][121949] Avg episode reward: [(0, '6160.634'), (1, '6029.904')] [2023-12-26 15:03:48,792][123091] Updated weights for policy 0, policy_version 1936832 (0.0009) [2023-12-26 15:03:48,806][123090] Updated weights for policy 1, policy_version 1924734 (0.0005) [2023-12-26 15:03:48,843][123091] Updated weights for policy 0, policy_version 1936842 (0.0009) [2023-12-26 15:03:49,534][123090] Updated weights for policy 1, policy_version 1924744 (0.0009) [2023-12-26 15:03:49,595][123090] Updated weights for policy 1, policy_version 1924754 (0.0008) [2023-12-26 15:03:49,669][123090] Updated weights for policy 1, policy_version 1924764 (0.0006) [2023-12-26 15:03:49,698][123091] Updated weights for policy 0, policy_version 1936852 (0.0008) [2023-12-26 15:03:49,754][123091] Updated weights for policy 0, policy_version 1936862 (0.0006) [2023-12-26 15:03:49,811][123091] Updated weights for policy 0, policy_version 1936872 (0.0006) [2023-12-26 15:03:50,514][123090] Updated weights for policy 1, policy_version 1924774 (0.0010) [2023-12-26 15:03:50,576][123090] Updated weights for policy 1, policy_version 1924784 (0.0010) [2023-12-26 15:03:50,616][123091] Updated weights for policy 0, policy_version 1936882 (0.0009) [2023-12-26 15:03:50,642][123090] Updated weights for policy 1, policy_version 1924794 (0.0009) [2023-12-26 15:03:50,677][123091] Updated weights for policy 0, policy_version 1936892 (0.0007) [2023-12-26 15:03:50,729][123091] Updated weights for policy 0, policy_version 1936902 (0.0009) [2023-12-26 15:03:50,791][123091] Updated weights for policy 0, policy_version 1936912 (0.0009) [2023-12-26 15:03:51,493][123090] Updated weights for policy 1, policy_version 1924804 (0.0010) [2023-12-26 15:03:51,558][123090] Updated weights for policy 1, policy_version 1924814 (0.0009) [2023-12-26 15:03:51,604][123091] Updated weights for policy 0, policy_version 1936922 (0.0009) [2023-12-26 15:03:51,622][123090] Updated weights for policy 1, policy_version 1924824 (0.0008) [2023-12-26 15:03:51,670][123091] Updated weights for policy 0, policy_version 1936932 (0.0009) [2023-12-26 15:03:51,732][123091] Updated weights for policy 0, policy_version 1936942 (0.0010) [2023-12-26 15:03:52,473][123090] Updated weights for policy 1, policy_version 1924834 (0.0009) [2023-12-26 15:03:52,528][123090] Updated weights for policy 1, policy_version 1924844 (0.0009) [2023-12-26 15:03:52,590][123090] Updated weights for policy 1, policy_version 1924854 (0.0007) [2023-12-26 15:03:52,592][123091] Updated weights for policy 0, policy_version 1936952 (0.0009) [2023-12-26 15:03:52,650][123090] Updated weights for policy 1, policy_version 1924864 (0.0008) [2023-12-26 15:03:52,655][123091] Updated weights for policy 0, policy_version 1936962 (0.0009) [2023-12-26 15:03:52,715][123091] Updated weights for policy 0, policy_version 1936972 (0.0009) [2023-12-26 15:03:53,460][123090] Updated weights for policy 1, policy_version 1924874 (0.0005) [2023-12-26 15:03:53,509][123090] Updated weights for policy 1, policy_version 1924884 (0.0005) [2023-12-26 15:03:53,533][123091] Updated weights for policy 0, policy_version 1936982 (0.0009) [2023-12-26 15:03:53,554][123090] Updated weights for policy 1, policy_version 1924894 (0.0006) [2023-12-26 15:03:53,581][123091] Updated weights for policy 0, policy_version 1936992 (0.0009) [2023-12-26 15:03:53,629][123091] Updated weights for policy 0, policy_version 1937003 (0.0009) [2023-12-26 15:03:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17883.5). Total num frames: 988651520. Throughput: 0: 8836.1, 1: 8861.2. Samples: 988623976. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:53,785][121949] Avg episode reward: [(0, '6244.061'), (1, '5769.306')] [2023-12-26 15:03:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001937008_495878144.pth... [2023-12-26 15:03:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001924896_492773376.pth... [2023-12-26 15:03:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001935952_495607808.pth [2023-12-26 15:03:53,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001923840_492503040.pth [2023-12-26 15:03:54,349][123090] Updated weights for policy 1, policy_version 1924904 (0.0009) [2023-12-26 15:03:54,405][123090] Updated weights for policy 1, policy_version 1924914 (0.0009) [2023-12-26 15:03:54,460][123090] Updated weights for policy 1, policy_version 1924924 (0.0009) [2023-12-26 15:03:54,515][123091] Updated weights for policy 0, policy_version 1937013 (0.0009) [2023-12-26 15:03:54,569][123091] Updated weights for policy 0, policy_version 1937023 (0.0010) [2023-12-26 15:03:54,632][123091] Updated weights for policy 0, policy_version 1937033 (0.0009) [2023-12-26 15:03:55,306][123090] Updated weights for policy 1, policy_version 1924934 (0.0009) [2023-12-26 15:03:55,379][123090] Updated weights for policy 1, policy_version 1924944 (0.0007) [2023-12-26 15:03:55,440][123090] Updated weights for policy 1, policy_version 1924954 (0.0009) [2023-12-26 15:03:55,461][123091] Updated weights for policy 0, policy_version 1937043 (0.0009) [2023-12-26 15:03:55,516][123091] Updated weights for policy 0, policy_version 1937053 (0.0008) [2023-12-26 15:03:55,565][123091] Updated weights for policy 0, policy_version 1937063 (0.0009) [2023-12-26 15:03:56,235][123090] Updated weights for policy 1, policy_version 1924964 (0.0008) [2023-12-26 15:03:56,284][123090] Updated weights for policy 1, policy_version 1924974 (0.0006) [2023-12-26 15:03:56,330][123090] Updated weights for policy 1, policy_version 1924984 (0.0005) [2023-12-26 15:03:56,442][123091] Updated weights for policy 0, policy_version 1937073 (0.0010) [2023-12-26 15:03:56,502][123091] Updated weights for policy 0, policy_version 1937083 (0.0009) [2023-12-26 15:03:56,559][123091] Updated weights for policy 0, policy_version 1937093 (0.0010) [2023-12-26 15:03:56,612][123091] Updated weights for policy 0, policy_version 1937104 (0.0009) [2023-12-26 15:03:57,102][123090] Updated weights for policy 1, policy_version 1924994 (0.0006) [2023-12-26 15:03:57,159][123090] Updated weights for policy 1, policy_version 1925004 (0.0009) [2023-12-26 15:03:57,205][123090] Updated weights for policy 1, policy_version 1925014 (0.0007) [2023-12-26 15:03:57,251][123090] Updated weights for policy 1, policy_version 1925024 (0.0005) [2023-12-26 15:03:57,462][123091] Updated weights for policy 0, policy_version 1937114 (0.0009) [2023-12-26 15:03:57,521][123091] Updated weights for policy 0, policy_version 1937124 (0.0010) [2023-12-26 15:03:57,580][123091] Updated weights for policy 0, policy_version 1937134 (0.0010) [2023-12-26 15:03:57,949][123090] Updated weights for policy 1, policy_version 1925034 (0.0005) [2023-12-26 15:03:57,998][123090] Updated weights for policy 1, policy_version 1925044 (0.0005) [2023-12-26 15:03:58,044][123090] Updated weights for policy 1, policy_version 1925054 (0.0006) [2023-12-26 15:03:58,549][123091] Updated weights for policy 0, policy_version 1937145 (0.0010) [2023-12-26 15:03:58,615][123091] Updated weights for policy 0, policy_version 1937155 (0.0010) [2023-12-26 15:03:58,681][123091] Updated weights for policy 0, policy_version 1937165 (0.0010) [2023-12-26 15:03:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 988733440. Throughput: 0: 8806.5, 1: 8855.1. Samples: 988727068. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:03:58,785][121949] Avg episode reward: [(0, '6151.298'), (1, '5627.003')] [2023-12-26 15:03:58,829][123090] Updated weights for policy 1, policy_version 1925064 (0.0008) [2023-12-26 15:03:58,899][123090] Updated weights for policy 1, policy_version 1925074 (0.0008) [2023-12-26 15:03:58,966][123090] Updated weights for policy 1, policy_version 1925084 (0.0008) [2023-12-26 15:03:59,537][123091] Updated weights for policy 0, policy_version 1937175 (0.0010) [2023-12-26 15:03:59,593][123091] Updated weights for policy 0, policy_version 1937185 (0.0009) [2023-12-26 15:03:59,649][123091] Updated weights for policy 0, policy_version 1937195 (0.0010) [2023-12-26 15:03:59,749][123090] Updated weights for policy 1, policy_version 1925094 (0.0009) [2023-12-26 15:03:59,803][123090] Updated weights for policy 1, policy_version 1925104 (0.0009) [2023-12-26 15:03:59,873][123090] Updated weights for policy 1, policy_version 1925114 (0.0009) [2023-12-26 15:04:00,478][123091] Updated weights for policy 0, policy_version 1937205 (0.0009) [2023-12-26 15:04:00,528][123091] Updated weights for policy 0, policy_version 1937215 (0.0008) [2023-12-26 15:04:00,578][123091] Updated weights for policy 0, policy_version 1937225 (0.0009) [2023-12-26 15:04:00,701][123090] Updated weights for policy 1, policy_version 1925124 (0.0008) [2023-12-26 15:04:00,769][123090] Updated weights for policy 1, policy_version 1925134 (0.0006) [2023-12-26 15:04:00,823][123090] Updated weights for policy 1, policy_version 1925144 (0.0006) [2023-12-26 15:04:01,491][123091] Updated weights for policy 0, policy_version 1937237 (0.0010) [2023-12-26 15:04:01,549][123091] Updated weights for policy 0, policy_version 1937248 (0.0009) [2023-12-26 15:04:01,593][123090] Updated weights for policy 1, policy_version 1925154 (0.0006) [2023-12-26 15:04:01,602][123091] Updated weights for policy 0, policy_version 1937258 (0.0008) [2023-12-26 15:04:01,666][123090] Updated weights for policy 1, policy_version 1925164 (0.0010) [2023-12-26 15:04:01,735][123090] Updated weights for policy 1, policy_version 1925175 (0.0008) [2023-12-26 15:04:02,416][123091] Updated weights for policy 0, policy_version 1937268 (0.0009) [2023-12-26 15:04:02,427][123090] Updated weights for policy 1, policy_version 1925185 (0.0009) [2023-12-26 15:04:02,480][123091] Updated weights for policy 0, policy_version 1937278 (0.0009) [2023-12-26 15:04:02,485][123090] Updated weights for policy 1, policy_version 1925195 (0.0008) [2023-12-26 15:04:02,537][123091] Updated weights for policy 0, policy_version 1937288 (0.0008) [2023-12-26 15:04:02,539][123090] Updated weights for policy 1, policy_version 1925205 (0.0007) [2023-12-26 15:04:02,585][123090] Updated weights for policy 1, policy_version 1925215 (0.0005) [2023-12-26 15:04:03,344][123090] Updated weights for policy 1, policy_version 1925225 (0.0009) [2023-12-26 15:04:03,391][123091] Updated weights for policy 0, policy_version 1937298 (0.0008) [2023-12-26 15:04:03,393][123090] Updated weights for policy 1, policy_version 1925235 (0.0005) [2023-12-26 15:04:03,445][123090] Updated weights for policy 1, policy_version 1925245 (0.0005) [2023-12-26 15:04:03,447][123091] Updated weights for policy 0, policy_version 1937308 (0.0009) [2023-12-26 15:04:03,500][123091] Updated weights for policy 0, policy_version 1937318 (0.0009) [2023-12-26 15:04:03,563][123091] Updated weights for policy 0, policy_version 1937328 (0.0009) [2023-12-26 15:04:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 988823552. Throughput: 0: 8761.9, 1: 8928.4. Samples: 988831540. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:03,785][121949] Avg episode reward: [(0, '6182.399'), (1, '5867.449')] [2023-12-26 15:04:04,248][123090] Updated weights for policy 1, policy_version 1925255 (0.0007) [2023-12-26 15:04:04,307][123090] Updated weights for policy 1, policy_version 1925265 (0.0010) [2023-12-26 15:04:04,379][123090] Updated weights for policy 1, policy_version 1925275 (0.0010) [2023-12-26 15:04:04,447][123091] Updated weights for policy 0, policy_version 1937338 (0.0009) [2023-12-26 15:04:04,514][123091] Updated weights for policy 0, policy_version 1937348 (0.0009) [2023-12-26 15:04:04,575][123091] Updated weights for policy 0, policy_version 1937358 (0.0009) [2023-12-26 15:04:05,113][123090] Updated weights for policy 1, policy_version 1925285 (0.0007) [2023-12-26 15:04:05,166][123090] Updated weights for policy 1, policy_version 1925295 (0.0005) [2023-12-26 15:04:05,217][123090] Updated weights for policy 1, policy_version 1925305 (0.0005) [2023-12-26 15:04:05,477][123091] Updated weights for policy 0, policy_version 1937368 (0.0010) [2023-12-26 15:04:05,525][123091] Updated weights for policy 0, policy_version 1937378 (0.0010) [2023-12-26 15:04:05,579][123091] Updated weights for policy 0, policy_version 1937388 (0.0010) [2023-12-26 15:04:06,008][123090] Updated weights for policy 1, policy_version 1925315 (0.0005) [2023-12-26 15:04:06,061][123090] Updated weights for policy 1, policy_version 1925325 (0.0006) [2023-12-26 15:04:06,124][123090] Updated weights for policy 1, policy_version 1925335 (0.0007) [2023-12-26 15:04:06,380][123091] Updated weights for policy 0, policy_version 1937398 (0.0007) [2023-12-26 15:04:06,449][123091] Updated weights for policy 0, policy_version 1937408 (0.0006) [2023-12-26 15:04:06,519][123091] Updated weights for policy 0, policy_version 1937418 (0.0005) [2023-12-26 15:04:06,929][123090] Updated weights for policy 1, policy_version 1925345 (0.0008) [2023-12-26 15:04:06,996][123090] Updated weights for policy 1, policy_version 1925355 (0.0010) [2023-12-26 15:04:07,059][123090] Updated weights for policy 1, policy_version 1925365 (0.0010) [2023-12-26 15:04:07,121][123090] Updated weights for policy 1, policy_version 1925375 (0.0007) [2023-12-26 15:04:07,244][123091] Updated weights for policy 0, policy_version 1937428 (0.0005) [2023-12-26 15:04:07,314][123091] Updated weights for policy 0, policy_version 1937438 (0.0005) [2023-12-26 15:04:07,385][123091] Updated weights for policy 0, policy_version 1937448 (0.0005) [2023-12-26 15:04:07,855][123090] Updated weights for policy 1, policy_version 1925385 (0.0006) [2023-12-26 15:04:07,904][123090] Updated weights for policy 1, policy_version 1925395 (0.0009) [2023-12-26 15:04:07,948][123090] Updated weights for policy 1, policy_version 1925405 (0.0010) [2023-12-26 15:04:08,099][123091] Updated weights for policy 0, policy_version 1937458 (0.0005) [2023-12-26 15:04:08,169][123091] Updated weights for policy 0, policy_version 1937468 (0.0005) [2023-12-26 15:04:08,235][123091] Updated weights for policy 0, policy_version 1937478 (0.0006) [2023-12-26 15:04:08,310][123091] Updated weights for policy 0, policy_version 1937488 (0.0006) [2023-12-26 15:04:08,677][123090] Updated weights for policy 1, policy_version 1925415 (0.0007) [2023-12-26 15:04:08,739][123090] Updated weights for policy 1, policy_version 1925425 (0.0010) [2023-12-26 15:04:08,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 988905472. Throughput: 0: 8751.7, 1: 8994.8. Samples: 988884868. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:08,785][121949] Avg episode reward: [(0, '6262.958'), (1, '5801.346')] [2023-12-26 15:04:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001937488_496001024.pth... [2023-12-26 15:04:08,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001936496_495747072.pth [2023-12-26 15:04:08,803][123090] Updated weights for policy 1, policy_version 1925435 (0.0011) [2023-12-26 15:04:08,834][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001925440_492912640.pth... [2023-12-26 15:04:08,839][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001924384_492642304.pth [2023-12-26 15:04:08,966][123091] Updated weights for policy 0, policy_version 1937498 (0.0005) [2023-12-26 15:04:09,014][123091] Updated weights for policy 0, policy_version 1937508 (0.0005) [2023-12-26 15:04:09,061][123091] Updated weights for policy 0, policy_version 1937518 (0.0005) [2023-12-26 15:04:09,617][123090] Updated weights for policy 1, policy_version 1925445 (0.0010) [2023-12-26 15:04:09,683][123090] Updated weights for policy 1, policy_version 1925455 (0.0010) [2023-12-26 15:04:09,749][123090] Updated weights for policy 1, policy_version 1925465 (0.0009) [2023-12-26 15:04:09,838][123091] Updated weights for policy 0, policy_version 1937528 (0.0009) [2023-12-26 15:04:09,910][123091] Updated weights for policy 0, policy_version 1937538 (0.0011) [2023-12-26 15:04:09,976][123091] Updated weights for policy 0, policy_version 1937548 (0.0011) [2023-12-26 15:04:10,564][123090] Updated weights for policy 1, policy_version 1925475 (0.0008) [2023-12-26 15:04:10,630][123090] Updated weights for policy 1, policy_version 1925485 (0.0007) [2023-12-26 15:04:10,699][123090] Updated weights for policy 1, policy_version 1925495 (0.0005) [2023-12-26 15:04:10,813][123091] Updated weights for policy 0, policy_version 1937558 (0.0011) [2023-12-26 15:04:10,861][123091] Updated weights for policy 0, policy_version 1937568 (0.0010) [2023-12-26 15:04:10,912][123091] Updated weights for policy 0, policy_version 1937578 (0.0010) [2023-12-26 15:04:11,504][123090] Updated weights for policy 1, policy_version 1925505 (0.0008) [2023-12-26 15:04:11,574][123090] Updated weights for policy 1, policy_version 1925515 (0.0010) [2023-12-26 15:04:11,641][123090] Updated weights for policy 1, policy_version 1925525 (0.0011) [2023-12-26 15:04:11,719][123090] Updated weights for policy 1, policy_version 1925535 (0.0013) [2023-12-26 15:04:11,802][123091] Updated weights for policy 0, policy_version 1937588 (0.0011) [2023-12-26 15:04:11,865][123091] Updated weights for policy 0, policy_version 1937598 (0.0011) [2023-12-26 15:04:11,935][123091] Updated weights for policy 0, policy_version 1937608 (0.0011) [2023-12-26 15:04:12,520][123090] Updated weights for policy 1, policy_version 1925545 (0.0009) [2023-12-26 15:04:12,592][123090] Updated weights for policy 1, policy_version 1925555 (0.0010) [2023-12-26 15:04:12,660][123090] Updated weights for policy 1, policy_version 1925565 (0.0011) [2023-12-26 15:04:12,702][123091] Updated weights for policy 0, policy_version 1937618 (0.0009) [2023-12-26 15:04:12,756][123091] Updated weights for policy 0, policy_version 1937628 (0.0008) [2023-12-26 15:04:12,812][123091] Updated weights for policy 0, policy_version 1937638 (0.0009) [2023-12-26 15:04:12,876][123091] Updated weights for policy 0, policy_version 1937648 (0.0009) [2023-12-26 15:04:13,474][123090] Updated weights for policy 1, policy_version 1925575 (0.0011) [2023-12-26 15:04:13,536][123090] Updated weights for policy 1, policy_version 1925585 (0.0010) [2023-12-26 15:04:13,594][123090] Updated weights for policy 1, policy_version 1925595 (0.0008) [2023-12-26 15:04:13,666][123091] Updated weights for policy 0, policy_version 1937658 (0.0005) [2023-12-26 15:04:13,729][123091] Updated weights for policy 0, policy_version 1937668 (0.0005) [2023-12-26 15:04:13,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17855.8). Total num frames: 988995584. Throughput: 0: 8708.4, 1: 8906.8. Samples: 988991488. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:13,785][121949] Avg episode reward: [(0, '6311.060'), (1, '5794.081')] [2023-12-26 15:04:13,785][123091] Updated weights for policy 0, policy_version 1937678 (0.0005) [2023-12-26 15:04:14,220][123090] Updated weights for policy 1, policy_version 1925605 (0.0008) [2023-12-26 15:04:14,284][123090] Updated weights for policy 1, policy_version 1925615 (0.0009) [2023-12-26 15:04:14,360][123090] Updated weights for policy 1, policy_version 1925625 (0.0009) [2023-12-26 15:04:14,366][123091] Updated weights for policy 0, policy_version 1937688 (0.0005) [2023-12-26 15:04:14,419][123091] Updated weights for policy 0, policy_version 1937698 (0.0005) [2023-12-26 15:04:14,490][123091] Updated weights for policy 0, policy_version 1937708 (0.0005) [2023-12-26 15:04:15,051][123090] Updated weights for policy 1, policy_version 1925635 (0.0007) [2023-12-26 15:04:15,126][123090] Updated weights for policy 1, policy_version 1925645 (0.0006) [2023-12-26 15:04:15,152][123091] Updated weights for policy 0, policy_version 1937718 (0.0005) [2023-12-26 15:04:15,189][123090] Updated weights for policy 1, policy_version 1925655 (0.0007) [2023-12-26 15:04:15,219][123091] Updated weights for policy 0, policy_version 1937728 (0.0006) [2023-12-26 15:04:15,282][123091] Updated weights for policy 0, policy_version 1937738 (0.0010) [2023-12-26 15:04:15,946][123090] Updated weights for policy 1, policy_version 1925665 (0.0007) [2023-12-26 15:04:16,010][123090] Updated weights for policy 1, policy_version 1925675 (0.0006) [2023-12-26 15:04:16,068][123090] Updated weights for policy 1, policy_version 1925685 (0.0005) [2023-12-26 15:04:16,079][123091] Updated weights for policy 0, policy_version 1937748 (0.0009) [2023-12-26 15:04:16,126][123090] Updated weights for policy 1, policy_version 1925695 (0.0006) [2023-12-26 15:04:16,141][123091] Updated weights for policy 0, policy_version 1937758 (0.0008) [2023-12-26 15:04:16,199][123091] Updated weights for policy 0, policy_version 1937768 (0.0008) [2023-12-26 15:04:16,867][123091] Updated weights for policy 0, policy_version 1937778 (0.0007) [2023-12-26 15:04:16,910][123090] Updated weights for policy 1, policy_version 1925705 (0.0010) [2023-12-26 15:04:16,927][123091] Updated weights for policy 0, policy_version 1937788 (0.0005) [2023-12-26 15:04:16,973][123090] Updated weights for policy 1, policy_version 1925715 (0.0010) [2023-12-26 15:04:16,986][123091] Updated weights for policy 0, policy_version 1937798 (0.0005) [2023-12-26 15:04:17,036][123090] Updated weights for policy 1, policy_version 1925725 (0.0010) [2023-12-26 15:04:17,054][123091] Updated weights for policy 0, policy_version 1937808 (0.0005) [2023-12-26 15:04:17,676][123091] Updated weights for policy 0, policy_version 1937818 (0.0006) [2023-12-26 15:04:17,733][123091] Updated weights for policy 0, policy_version 1937828 (0.0010) [2023-12-26 15:04:17,784][123091] Updated weights for policy 0, policy_version 1937838 (0.0010) [2023-12-26 15:04:17,850][123090] Updated weights for policy 1, policy_version 1925735 (0.0011) [2023-12-26 15:04:17,906][123090] Updated weights for policy 1, policy_version 1925745 (0.0011) [2023-12-26 15:04:17,953][123090] Updated weights for policy 1, policy_version 1925755 (0.0010) [2023-12-26 15:04:18,601][123091] Updated weights for policy 0, policy_version 1937848 (0.0011) [2023-12-26 15:04:18,654][123091] Updated weights for policy 0, policy_version 1937858 (0.0011) [2023-12-26 15:04:18,707][123091] Updated weights for policy 0, policy_version 1937868 (0.0011) [2023-12-26 15:04:18,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 989093888. Throughput: 0: 8789.1, 1: 8913.3. Samples: 989103672. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:18,784][121949] Avg episode reward: [(0, '6349.717'), (1, '5804.794')] [2023-12-26 15:04:18,819][123090] Updated weights for policy 1, policy_version 1925765 (0.0011) [2023-12-26 15:04:18,878][123090] Updated weights for policy 1, policy_version 1925775 (0.0010) [2023-12-26 15:04:18,931][123090] Updated weights for policy 1, policy_version 1925785 (0.0010) [2023-12-26 15:04:19,574][123091] Updated weights for policy 0, policy_version 1937878 (0.0011) [2023-12-26 15:04:19,627][123091] Updated weights for policy 0, policy_version 1937888 (0.0011) [2023-12-26 15:04:19,680][123091] Updated weights for policy 0, policy_version 1937898 (0.0010) [2023-12-26 15:04:19,703][123090] Updated weights for policy 1, policy_version 1925795 (0.0009) [2023-12-26 15:04:19,770][123090] Updated weights for policy 1, policy_version 1925805 (0.0008) [2023-12-26 15:04:19,834][123090] Updated weights for policy 1, policy_version 1925815 (0.0006) [2023-12-26 15:04:20,503][123091] Updated weights for policy 0, policy_version 1937908 (0.0008) [2023-12-26 15:04:20,575][123091] Updated weights for policy 0, policy_version 1937918 (0.0008) [2023-12-26 15:04:20,625][123090] Updated weights for policy 1, policy_version 1925825 (0.0009) [2023-12-26 15:04:20,638][123091] Updated weights for policy 0, policy_version 1937928 (0.0011) [2023-12-26 15:04:20,693][123090] Updated weights for policy 1, policy_version 1925835 (0.0007) [2023-12-26 15:04:20,769][123090] Updated weights for policy 1, policy_version 1925845 (0.0008) [2023-12-26 15:04:20,838][123090] Updated weights for policy 1, policy_version 1925855 (0.0011) [2023-12-26 15:04:21,362][123091] Updated weights for policy 0, policy_version 1937938 (0.0011) [2023-12-26 15:04:21,431][123091] Updated weights for policy 0, policy_version 1937948 (0.0010) [2023-12-26 15:04:21,498][123091] Updated weights for policy 0, policy_version 1937958 (0.0011) [2023-12-26 15:04:21,566][123091] Updated weights for policy 0, policy_version 1937968 (0.0011) [2023-12-26 15:04:21,578][123090] Updated weights for policy 1, policy_version 1925865 (0.0011) [2023-12-26 15:04:21,651][123090] Updated weights for policy 1, policy_version 1925875 (0.0011) [2023-12-26 15:04:21,723][123090] Updated weights for policy 1, policy_version 1925885 (0.0011) [2023-12-26 15:04:22,378][123091] Updated weights for policy 0, policy_version 1937978 (0.0010) [2023-12-26 15:04:22,445][123091] Updated weights for policy 0, policy_version 1937988 (0.0011) [2023-12-26 15:04:22,514][123091] Updated weights for policy 0, policy_version 1937998 (0.0006) [2023-12-26 15:04:22,550][123090] Updated weights for policy 1, policy_version 1925895 (0.0008) [2023-12-26 15:04:22,610][123090] Updated weights for policy 1, policy_version 1925905 (0.0005) [2023-12-26 15:04:22,683][123090] Updated weights for policy 1, policy_version 1925915 (0.0008) [2023-12-26 15:04:23,255][123091] Updated weights for policy 0, policy_version 1938008 (0.0006) [2023-12-26 15:04:23,304][123091] Updated weights for policy 0, policy_version 1938018 (0.0005) [2023-12-26 15:04:23,358][123091] Updated weights for policy 0, policy_version 1938028 (0.0006) [2023-12-26 15:04:23,549][123090] Updated weights for policy 1, policy_version 1925925 (0.0009) [2023-12-26 15:04:23,612][123090] Updated weights for policy 1, policy_version 1925935 (0.0010) [2023-12-26 15:04:23,668][123090] Updated weights for policy 1, policy_version 1925945 (0.0010) [2023-12-26 15:04:23,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17885.8, 300 sec: 17883.6). Total num frames: 989184000. Throughput: 0: 8708.6, 1: 8939.2. Samples: 989156508. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:23,785][121949] Avg episode reward: [(0, '6350.369'), (1, '5809.216')] [2023-12-26 15:04:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001938032_496140288.pth... [2023-12-26 15:04:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001925952_493043712.pth... [2023-12-26 15:04:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001937008_495878144.pth [2023-12-26 15:04:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001924896_492773376.pth [2023-12-26 15:04:23,992][123091] Updated weights for policy 0, policy_version 1938038 (0.0006) [2023-12-26 15:04:24,054][123091] Updated weights for policy 0, policy_version 1938048 (0.0010) [2023-12-26 15:04:24,113][123091] Updated weights for policy 0, policy_version 1938058 (0.0010) [2023-12-26 15:04:24,476][123090] Updated weights for policy 1, policy_version 1925955 (0.0010) [2023-12-26 15:04:24,538][123090] Updated weights for policy 1, policy_version 1925965 (0.0010) [2023-12-26 15:04:24,596][123090] Updated weights for policy 1, policy_version 1925975 (0.0010) [2023-12-26 15:04:24,890][123091] Updated weights for policy 0, policy_version 1938068 (0.0010) [2023-12-26 15:04:24,945][123091] Updated weights for policy 0, policy_version 1938078 (0.0010) [2023-12-26 15:04:24,996][123091] Updated weights for policy 0, policy_version 1938088 (0.0010) [2023-12-26 15:04:25,421][123090] Updated weights for policy 1, policy_version 1925985 (0.0010) [2023-12-26 15:04:25,474][123090] Updated weights for policy 1, policy_version 1925995 (0.0010) [2023-12-26 15:04:25,527][123090] Updated weights for policy 1, policy_version 1926006 (0.0010) [2023-12-26 15:04:25,705][123091] Updated weights for policy 0, policy_version 1938098 (0.0009) [2023-12-26 15:04:25,750][123091] Updated weights for policy 0, policy_version 1938108 (0.0005) [2023-12-26 15:04:25,796][123091] Updated weights for policy 0, policy_version 1938118 (0.0005) [2023-12-26 15:04:25,846][123091] Updated weights for policy 0, policy_version 1938128 (0.0005) [2023-12-26 15:04:26,253][123090] Updated weights for policy 1, policy_version 1926017 (0.0009) [2023-12-26 15:04:26,305][123090] Updated weights for policy 1, policy_version 1926027 (0.0006) [2023-12-26 15:04:26,357][123090] Updated weights for policy 1, policy_version 1926037 (0.0006) [2023-12-26 15:04:26,417][123090] Updated weights for policy 1, policy_version 1926047 (0.0006) [2023-12-26 15:04:26,572][123091] Updated weights for policy 0, policy_version 1938138 (0.0010) [2023-12-26 15:04:26,625][123091] Updated weights for policy 0, policy_version 1938148 (0.0011) [2023-12-26 15:04:26,673][123091] Updated weights for policy 0, policy_version 1938158 (0.0010) [2023-12-26 15:04:27,095][123090] Updated weights for policy 1, policy_version 1926057 (0.0006) [2023-12-26 15:04:27,150][123090] Updated weights for policy 1, policy_version 1926067 (0.0006) [2023-12-26 15:04:27,205][123090] Updated weights for policy 1, policy_version 1926077 (0.0006) [2023-12-26 15:04:27,557][123091] Updated weights for policy 0, policy_version 1938168 (0.0007) [2023-12-26 15:04:27,600][123091] Updated weights for policy 0, policy_version 1938178 (0.0005) [2023-12-26 15:04:27,647][123091] Updated weights for policy 0, policy_version 1938188 (0.0005) [2023-12-26 15:04:27,891][123090] Updated weights for policy 1, policy_version 1926087 (0.0006) [2023-12-26 15:04:27,939][123090] Updated weights for policy 1, policy_version 1926097 (0.0006) [2023-12-26 15:04:27,986][123090] Updated weights for policy 1, policy_version 1926107 (0.0005) [2023-12-26 15:04:28,375][123091] Updated weights for policy 0, policy_version 1938198 (0.0007) [2023-12-26 15:04:28,444][123091] Updated weights for policy 0, policy_version 1938208 (0.0009) [2023-12-26 15:04:28,491][123091] Updated weights for policy 0, policy_version 1938218 (0.0009) [2023-12-26 15:04:28,715][123090] Updated weights for policy 1, policy_version 1926117 (0.0009) [2023-12-26 15:04:28,766][123090] Updated weights for policy 1, policy_version 1926127 (0.0010) [2023-12-26 15:04:28,784][121949] Fps is (10 sec: 18021.8, 60 sec: 17749.3, 300 sec: 17883.5). Total num frames: 989274112. Throughput: 0: 8853.7, 1: 8962.3. Samples: 989268660. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:28,785][121949] Avg episode reward: [(0, '6219.952'), (1, '5837.057')] [2023-12-26 15:04:28,819][123090] Updated weights for policy 1, policy_version 1926137 (0.0010) [2023-12-26 15:04:29,278][123091] Updated weights for policy 0, policy_version 1938228 (0.0009) [2023-12-26 15:04:29,344][123091] Updated weights for policy 0, policy_version 1938238 (0.0009) [2023-12-26 15:04:29,411][123091] Updated weights for policy 0, policy_version 1938248 (0.0009) [2023-12-26 15:04:29,648][123090] Updated weights for policy 1, policy_version 1926147 (0.0010) [2023-12-26 15:04:29,710][123090] Updated weights for policy 1, policy_version 1926157 (0.0009) [2023-12-26 15:04:29,780][123090] Updated weights for policy 1, policy_version 1926167 (0.0008) [2023-12-26 15:04:30,231][123091] Updated weights for policy 0, policy_version 1938258 (0.0007) [2023-12-26 15:04:30,287][123091] Updated weights for policy 0, policy_version 1938268 (0.0010) [2023-12-26 15:04:30,338][123091] Updated weights for policy 0, policy_version 1938278 (0.0010) [2023-12-26 15:04:30,402][123091] Updated weights for policy 0, policy_version 1938288 (0.0006) [2023-12-26 15:04:30,504][123090] Updated weights for policy 1, policy_version 1926177 (0.0009) [2023-12-26 15:04:30,551][123090] Updated weights for policy 1, policy_version 1926187 (0.0005) [2023-12-26 15:04:30,598][123090] Updated weights for policy 1, policy_version 1926197 (0.0005) [2023-12-26 15:04:30,652][123090] Updated weights for policy 1, policy_version 1926207 (0.0009) [2023-12-26 15:04:31,105][123091] Updated weights for policy 0, policy_version 1938298 (0.0009) [2023-12-26 15:04:31,171][123091] Updated weights for policy 0, policy_version 1938308 (0.0008) [2023-12-26 15:04:31,220][123091] Updated weights for policy 0, policy_version 1938318 (0.0007) [2023-12-26 15:04:31,429][123090] Updated weights for policy 1, policy_version 1926217 (0.0008) [2023-12-26 15:04:31,497][123090] Updated weights for policy 1, policy_version 1926227 (0.0008) [2023-12-26 15:04:31,549][123090] Updated weights for policy 1, policy_version 1926237 (0.0008) [2023-12-26 15:04:31,960][123091] Updated weights for policy 0, policy_version 1938328 (0.0009) [2023-12-26 15:04:32,016][123091] Updated weights for policy 0, policy_version 1938338 (0.0009) [2023-12-26 15:04:32,064][123091] Updated weights for policy 0, policy_version 1938348 (0.0009) [2023-12-26 15:04:32,380][123090] Updated weights for policy 1, policy_version 1926247 (0.0010) [2023-12-26 15:04:32,439][123090] Updated weights for policy 1, policy_version 1926257 (0.0010) [2023-12-26 15:04:32,508][123090] Updated weights for policy 1, policy_version 1926267 (0.0010) [2023-12-26 15:04:32,923][123091] Updated weights for policy 0, policy_version 1938358 (0.0010) [2023-12-26 15:04:32,976][123091] Updated weights for policy 0, policy_version 1938368 (0.0010) [2023-12-26 15:04:33,034][123091] Updated weights for policy 0, policy_version 1938378 (0.0010) [2023-12-26 15:04:33,228][123090] Updated weights for policy 1, policy_version 1926277 (0.0008) [2023-12-26 15:04:33,275][123090] Updated weights for policy 1, policy_version 1926287 (0.0005) [2023-12-26 15:04:33,323][123090] Updated weights for policy 1, policy_version 1926297 (0.0005) [2023-12-26 15:04:33,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 989364224. Throughput: 0: 8919.9, 1: 9010.3. Samples: 989378992. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:33,786][121949] Avg episode reward: [(0, '6235.783'), (1, '5915.973')] [2023-12-26 15:04:33,865][123091] Updated weights for policy 0, policy_version 1938388 (0.0009) [2023-12-26 15:04:33,917][123091] Updated weights for policy 0, policy_version 1938398 (0.0009) [2023-12-26 15:04:33,972][123091] Updated weights for policy 0, policy_version 1938408 (0.0010) [2023-12-26 15:04:34,027][123090] Updated weights for policy 1, policy_version 1926307 (0.0005) [2023-12-26 15:04:34,085][123090] Updated weights for policy 1, policy_version 1926317 (0.0005) [2023-12-26 15:04:34,141][123090] Updated weights for policy 1, policy_version 1926327 (0.0006) [2023-12-26 15:04:34,836][123091] Updated weights for policy 0, policy_version 1938418 (0.0009) [2023-12-26 15:04:34,896][123091] Updated weights for policy 0, policy_version 1938428 (0.0010) [2023-12-26 15:04:34,936][123090] Updated weights for policy 1, policy_version 1926337 (0.0009) [2023-12-26 15:04:34,958][123091] Updated weights for policy 0, policy_version 1938438 (0.0007) [2023-12-26 15:04:35,004][123090] Updated weights for policy 1, policy_version 1926347 (0.0007) [2023-12-26 15:04:35,029][123091] Updated weights for policy 0, policy_version 1938448 (0.0006) [2023-12-26 15:04:35,070][123090] Updated weights for policy 1, policy_version 1926357 (0.0010) [2023-12-26 15:04:35,131][123090] Updated weights for policy 1, policy_version 1926367 (0.0010) [2023-12-26 15:04:35,728][123091] Updated weights for policy 0, policy_version 1938458 (0.0006) [2023-12-26 15:04:35,784][123091] Updated weights for policy 0, policy_version 1938468 (0.0008) [2023-12-26 15:04:35,836][123090] Updated weights for policy 1, policy_version 1926377 (0.0006) [2023-12-26 15:04:35,843][123091] Updated weights for policy 0, policy_version 1938478 (0.0009) [2023-12-26 15:04:35,883][123090] Updated weights for policy 1, policy_version 1926387 (0.0005) [2023-12-26 15:04:35,933][123090] Updated weights for policy 1, policy_version 1926397 (0.0007) [2023-12-26 15:04:36,592][123091] Updated weights for policy 0, policy_version 1938488 (0.0010) [2023-12-26 15:04:36,652][123091] Updated weights for policy 0, policy_version 1938498 (0.0011) [2023-12-26 15:04:36,712][123091] Updated weights for policy 0, policy_version 1938508 (0.0011) [2023-12-26 15:04:36,727][123090] Updated weights for policy 1, policy_version 1926407 (0.0009) [2023-12-26 15:04:36,791][123090] Updated weights for policy 1, policy_version 1926417 (0.0011) [2023-12-26 15:04:36,847][123090] Updated weights for policy 1, policy_version 1926427 (0.0011) [2023-12-26 15:04:37,517][123091] Updated weights for policy 0, policy_version 1938518 (0.0008) [2023-12-26 15:04:37,569][123091] Updated weights for policy 0, policy_version 1938528 (0.0006) [2023-12-26 15:04:37,622][123091] Updated weights for policy 0, policy_version 1938538 (0.0006) [2023-12-26 15:04:37,644][123090] Updated weights for policy 1, policy_version 1926437 (0.0008) [2023-12-26 15:04:37,707][123090] Updated weights for policy 1, policy_version 1926447 (0.0006) [2023-12-26 15:04:37,768][123090] Updated weights for policy 1, policy_version 1926457 (0.0010) [2023-12-26 15:04:38,325][123091] Updated weights for policy 0, policy_version 1938548 (0.0006) [2023-12-26 15:04:38,386][123091] Updated weights for policy 0, policy_version 1938558 (0.0009) [2023-12-26 15:04:38,436][123091] Updated weights for policy 0, policy_version 1938568 (0.0009) [2023-12-26 15:04:38,617][123090] Updated weights for policy 1, policy_version 1926467 (0.0010) [2023-12-26 15:04:38,682][123090] Updated weights for policy 1, policy_version 1926477 (0.0009) [2023-12-26 15:04:38,746][123090] Updated weights for policy 1, policy_version 1926487 (0.0010) [2023-12-26 15:04:38,784][121949] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17883.6). Total num frames: 989454336. Throughput: 0: 8939.7, 1: 9061.9. Samples: 989434044. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:38,785][121949] Avg episode reward: [(0, '6287.707'), (1, '5822.026')] [2023-12-26 15:04:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001938576_496279552.pth... [2023-12-26 15:04:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001937488_496001024.pth [2023-12-26 15:04:38,808][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001926496_493182976.pth... [2023-12-26 15:04:38,811][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001925440_492912640.pth [2023-12-26 15:04:39,229][123091] Updated weights for policy 0, policy_version 1938578 (0.0009) [2023-12-26 15:04:39,293][123091] Updated weights for policy 0, policy_version 1938588 (0.0007) [2023-12-26 15:04:39,364][123091] Updated weights for policy 0, policy_version 1938598 (0.0007) [2023-12-26 15:04:39,443][123091] Updated weights for policy 0, policy_version 1938608 (0.0009) [2023-12-26 15:04:39,601][123090] Updated weights for policy 1, policy_version 1926497 (0.0010) [2023-12-26 15:04:39,650][123090] Updated weights for policy 1, policy_version 1926507 (0.0009) [2023-12-26 15:04:39,705][123090] Updated weights for policy 1, policy_version 1926517 (0.0009) [2023-12-26 15:04:39,764][123090] Updated weights for policy 1, policy_version 1926527 (0.0009) [2023-12-26 15:04:40,309][123091] Updated weights for policy 0, policy_version 1938618 (0.0010) [2023-12-26 15:04:40,376][123091] Updated weights for policy 0, policy_version 1938628 (0.0011) [2023-12-26 15:04:40,439][123091] Updated weights for policy 0, policy_version 1938638 (0.0011) [2023-12-26 15:04:40,596][123090] Updated weights for policy 1, policy_version 1926537 (0.0006) [2023-12-26 15:04:40,659][123090] Updated weights for policy 1, policy_version 1926547 (0.0006) [2023-12-26 15:04:40,725][123090] Updated weights for policy 1, policy_version 1926557 (0.0005) [2023-12-26 15:04:41,205][123091] Updated weights for policy 0, policy_version 1938648 (0.0009) [2023-12-26 15:04:41,269][123091] Updated weights for policy 0, policy_version 1938658 (0.0008) [2023-12-26 15:04:41,332][123091] Updated weights for policy 0, policy_version 1938668 (0.0006) [2023-12-26 15:04:41,408][123090] Updated weights for policy 1, policy_version 1926567 (0.0008) [2023-12-26 15:04:41,481][123090] Updated weights for policy 1, policy_version 1926577 (0.0010) [2023-12-26 15:04:41,548][123090] Updated weights for policy 1, policy_version 1926587 (0.0009) [2023-12-26 15:04:42,085][123091] Updated weights for policy 0, policy_version 1938678 (0.0010) [2023-12-26 15:04:42,142][123091] Updated weights for policy 0, policy_version 1938688 (0.0009) [2023-12-26 15:04:42,206][123091] Updated weights for policy 0, policy_version 1938698 (0.0010) [2023-12-26 15:04:42,399][123090] Updated weights for policy 1, policy_version 1926597 (0.0009) [2023-12-26 15:04:42,457][123090] Updated weights for policy 1, policy_version 1926607 (0.0009) [2023-12-26 15:04:42,517][123090] Updated weights for policy 1, policy_version 1926617 (0.0009) [2023-12-26 15:04:42,966][123091] Updated weights for policy 0, policy_version 1938708 (0.0009) [2023-12-26 15:04:43,027][123091] Updated weights for policy 0, policy_version 1938718 (0.0010) [2023-12-26 15:04:43,084][123091] Updated weights for policy 0, policy_version 1938728 (0.0010) [2023-12-26 15:04:43,346][123090] Updated weights for policy 1, policy_version 1926627 (0.0010) [2023-12-26 15:04:43,406][123090] Updated weights for policy 1, policy_version 1926637 (0.0009) [2023-12-26 15:04:43,459][123090] Updated weights for policy 1, policy_version 1926647 (0.0009) [2023-12-26 15:04:43,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17911.3). Total num frames: 989544448. Throughput: 0: 9013.1, 1: 9028.1. Samples: 989538924. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:43,785][121949] Avg episode reward: [(0, '6208.882'), (1, '5873.615')] [2023-12-26 15:04:43,914][123091] Updated weights for policy 0, policy_version 1938738 (0.0010) [2023-12-26 15:04:43,965][123091] Updated weights for policy 0, policy_version 1938748 (0.0010) [2023-12-26 15:04:44,015][123091] Updated weights for policy 0, policy_version 1938758 (0.0010) [2023-12-26 15:04:44,077][123091] Updated weights for policy 0, policy_version 1938768 (0.0010) [2023-12-26 15:04:44,309][123090] Updated weights for policy 1, policy_version 1926657 (0.0008) [2023-12-26 15:04:44,367][123090] Updated weights for policy 1, policy_version 1926667 (0.0009) [2023-12-26 15:04:44,433][123090] Updated weights for policy 1, policy_version 1926677 (0.0010) [2023-12-26 15:04:44,490][123090] Updated weights for policy 1, policy_version 1926687 (0.0009) [2023-12-26 15:04:44,885][123091] Updated weights for policy 0, policy_version 1938778 (0.0009) [2023-12-26 15:04:44,948][123091] Updated weights for policy 0, policy_version 1938788 (0.0009) [2023-12-26 15:04:45,011][123091] Updated weights for policy 0, policy_version 1938798 (0.0009) [2023-12-26 15:04:45,324][123090] Updated weights for policy 1, policy_version 1926697 (0.0008) [2023-12-26 15:04:45,388][123090] Updated weights for policy 1, policy_version 1926707 (0.0008) [2023-12-26 15:04:45,454][123090] Updated weights for policy 1, policy_version 1926717 (0.0008) [2023-12-26 15:04:45,880][123091] Updated weights for policy 0, policy_version 1938808 (0.0009) [2023-12-26 15:04:45,954][123091] Updated weights for policy 0, policy_version 1938818 (0.0009) [2023-12-26 15:04:46,018][123091] Updated weights for policy 0, policy_version 1938828 (0.0010) [2023-12-26 15:04:46,205][123090] Updated weights for policy 1, policy_version 1926727 (0.0009) [2023-12-26 15:04:46,269][123090] Updated weights for policy 1, policy_version 1926737 (0.0010) [2023-12-26 15:04:46,330][123090] Updated weights for policy 1, policy_version 1926747 (0.0009) [2023-12-26 15:04:46,837][123091] Updated weights for policy 0, policy_version 1938838 (0.0007) [2023-12-26 15:04:46,902][123091] Updated weights for policy 0, policy_version 1938848 (0.0008) [2023-12-26 15:04:46,966][123091] Updated weights for policy 0, policy_version 1938858 (0.0009) [2023-12-26 15:04:47,101][123090] Updated weights for policy 1, policy_version 1926757 (0.0007) [2023-12-26 15:04:47,167][123090] Updated weights for policy 1, policy_version 1926767 (0.0006) [2023-12-26 15:04:47,231][123090] Updated weights for policy 1, policy_version 1926777 (0.0005) [2023-12-26 15:04:47,687][123091] Updated weights for policy 0, policy_version 1938868 (0.0008) [2023-12-26 15:04:47,750][123091] Updated weights for policy 0, policy_version 1938878 (0.0005) [2023-12-26 15:04:47,780][123090] Updated weights for policy 1, policy_version 1926787 (0.0005) [2023-12-26 15:04:47,814][123091] Updated weights for policy 0, policy_version 1938888 (0.0008) [2023-12-26 15:04:47,844][123090] Updated weights for policy 1, policy_version 1926797 (0.0005) [2023-12-26 15:04:47,908][123090] Updated weights for policy 1, policy_version 1926807 (0.0005) [2023-12-26 15:04:48,501][123091] Updated weights for policy 0, policy_version 1938898 (0.0007) [2023-12-26 15:04:48,567][123091] Updated weights for policy 0, policy_version 1938908 (0.0006) [2023-12-26 15:04:48,568][123090] Updated weights for policy 1, policy_version 1926817 (0.0005) [2023-12-26 15:04:48,618][123091] Updated weights for policy 0, policy_version 1938918 (0.0008) [2023-12-26 15:04:48,634][123090] Updated weights for policy 1, policy_version 1926827 (0.0009) [2023-12-26 15:04:48,680][123091] Updated weights for policy 0, policy_version 1938928 (0.0007) [2023-12-26 15:04:48,683][123090] Updated weights for policy 1, policy_version 1926837 (0.0008) [2023-12-26 15:04:48,733][123090] Updated weights for policy 1, policy_version 1926847 (0.0009) [2023-12-26 15:04:48,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17939.1). Total num frames: 989642752. Throughput: 0: 9114.0, 1: 9029.1. Samples: 989647976. Policy #0 lag: (min: 2.0, avg: 8.9, max: 34.0) [2023-12-26 15:04:48,785][121949] Avg episode reward: [(0, '6232.854'), (1, '6156.337')] [2023-12-26 15:04:49,491][123091] Updated weights for policy 0, policy_version 1938938 (0.0011) [2023-12-26 15:04:49,557][123091] Updated weights for policy 0, policy_version 1938948 (0.0011) [2023-12-26 15:04:49,603][123090] Updated weights for policy 1, policy_version 1926857 (0.0008) [2023-12-26 15:04:49,613][123091] Updated weights for policy 0, policy_version 1938958 (0.0010) [2023-12-26 15:04:49,665][123090] Updated weights for policy 1, policy_version 1926867 (0.0007) [2023-12-26 15:04:49,732][123090] Updated weights for policy 1, policy_version 1926877 (0.0009) [2023-12-26 15:04:50,377][123091] Updated weights for policy 0, policy_version 1938968 (0.0008) [2023-12-26 15:04:50,442][123091] Updated weights for policy 0, policy_version 1938978 (0.0006) [2023-12-26 15:04:50,498][123091] Updated weights for policy 0, policy_version 1938988 (0.0006) [2023-12-26 15:04:50,608][123090] Updated weights for policy 1, policy_version 1926887 (0.0010) [2023-12-26 15:04:50,663][123090] Updated weights for policy 1, policy_version 1926897 (0.0009) [2023-12-26 15:04:50,726][123090] Updated weights for policy 1, policy_version 1926907 (0.0009) [2023-12-26 15:04:51,254][123091] Updated weights for policy 0, policy_version 1938998 (0.0009) [2023-12-26 15:04:51,324][123091] Updated weights for policy 0, policy_version 1939008 (0.0009) [2023-12-26 15:04:51,395][123091] Updated weights for policy 0, policy_version 1939018 (0.0010) [2023-12-26 15:04:51,625][123090] Updated weights for policy 1, policy_version 1926917 (0.0008) [2023-12-26 15:04:51,685][123090] Updated weights for policy 1, policy_version 1926927 (0.0007) [2023-12-26 15:04:51,757][123090] Updated weights for policy 1, policy_version 1926937 (0.0007) [2023-12-26 15:04:52,180][123091] Updated weights for policy 0, policy_version 1939028 (0.0008) [2023-12-26 15:04:52,244][123091] Updated weights for policy 0, policy_version 1939038 (0.0009) [2023-12-26 15:04:52,311][123091] Updated weights for policy 0, policy_version 1939048 (0.0011) [2023-12-26 15:04:52,600][123090] Updated weights for policy 1, policy_version 1926947 (0.0010) [2023-12-26 15:04:52,653][123090] Updated weights for policy 1, policy_version 1926957 (0.0008) [2023-12-26 15:04:52,710][123090] Updated weights for policy 1, policy_version 1926967 (0.0009) [2023-12-26 15:04:52,954][123091] Updated weights for policy 0, policy_version 1939058 (0.0009) [2023-12-26 15:04:53,018][123091] Updated weights for policy 0, policy_version 1939068 (0.0010) [2023-12-26 15:04:53,072][123091] Updated weights for policy 0, policy_version 1939078 (0.0010) [2023-12-26 15:04:53,123][123091] Updated weights for policy 0, policy_version 1939088 (0.0010) [2023-12-26 15:04:53,575][123090] Updated weights for policy 1, policy_version 1926977 (0.0009) [2023-12-26 15:04:53,631][123090] Updated weights for policy 1, policy_version 1926987 (0.0008) [2023-12-26 15:04:53,701][123090] Updated weights for policy 1, policy_version 1926997 (0.0005) [2023-12-26 15:04:53,766][123090] Updated weights for policy 1, policy_version 1927007 (0.0005) [2023-12-26 15:04:53,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 989724672. Throughput: 0: 9126.3, 1: 8958.8. Samples: 989698700. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:04:53,785][121949] Avg episode reward: [(0, '6277.942'), (1, '6094.534')] [2023-12-26 15:04:53,788][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001927008_493314048.pth... [2023-12-26 15:04:53,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001925952_493043712.pth [2023-12-26 15:04:53,835][123091] Updated weights for policy 0, policy_version 1939098 (0.0010) [2023-12-26 15:04:53,886][123091] Updated weights for policy 0, policy_version 1939108 (0.0010) [2023-12-26 15:04:53,937][123091] Updated weights for policy 0, policy_version 1939118 (0.0010) [2023-12-26 15:04:53,943][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001939120_496418816.pth... [2023-12-26 15:04:53,946][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001938032_496140288.pth [2023-12-26 15:04:54,465][123090] Updated weights for policy 1, policy_version 1927017 (0.0010) [2023-12-26 15:04:54,531][123090] Updated weights for policy 1, policy_version 1927027 (0.0010) [2023-12-26 15:04:54,586][123090] Updated weights for policy 1, policy_version 1927037 (0.0010) [2023-12-26 15:04:54,758][123091] Updated weights for policy 0, policy_version 1939128 (0.0006) [2023-12-26 15:04:54,818][123091] Updated weights for policy 0, policy_version 1939138 (0.0005) [2023-12-26 15:04:54,880][123091] Updated weights for policy 0, policy_version 1939148 (0.0005) [2023-12-26 15:04:55,441][123090] Updated weights for policy 1, policy_version 1927047 (0.0009) [2023-12-26 15:04:55,504][123090] Updated weights for policy 1, policy_version 1927057 (0.0008) [2023-12-26 15:04:55,567][123090] Updated weights for policy 1, policy_version 1927067 (0.0009) [2023-12-26 15:04:55,637][123091] Updated weights for policy 0, policy_version 1939158 (0.0007) [2023-12-26 15:04:55,687][123091] Updated weights for policy 0, policy_version 1939168 (0.0009) [2023-12-26 15:04:55,741][123091] Updated weights for policy 0, policy_version 1939178 (0.0006) [2023-12-26 15:04:56,321][123090] Updated weights for policy 1, policy_version 1927077 (0.0008) [2023-12-26 15:04:56,386][123090] Updated weights for policy 1, policy_version 1927087 (0.0005) [2023-12-26 15:04:56,457][123090] Updated weights for policy 1, policy_version 1927097 (0.0005) [2023-12-26 15:04:56,558][123091] Updated weights for policy 0, policy_version 1939188 (0.0007) [2023-12-26 15:04:56,625][123091] Updated weights for policy 0, policy_version 1939198 (0.0009) [2023-12-26 15:04:56,696][123091] Updated weights for policy 0, policy_version 1939208 (0.0009) [2023-12-26 15:04:57,094][123090] Updated weights for policy 1, policy_version 1927107 (0.0005) [2023-12-26 15:04:57,160][123090] Updated weights for policy 1, policy_version 1927117 (0.0005) [2023-12-26 15:04:57,219][123090] Updated weights for policy 1, policy_version 1927127 (0.0006) [2023-12-26 15:04:57,404][123091] Updated weights for policy 0, policy_version 1939218 (0.0009) [2023-12-26 15:04:57,468][123091] Updated weights for policy 0, policy_version 1939228 (0.0006) [2023-12-26 15:04:57,534][123091] Updated weights for policy 0, policy_version 1939238 (0.0005) [2023-12-26 15:04:57,586][123091] Updated weights for policy 0, policy_version 1939248 (0.0005) [2023-12-26 15:04:57,989][123090] Updated weights for policy 1, policy_version 1927137 (0.0006) [2023-12-26 15:04:58,043][123090] Updated weights for policy 1, policy_version 1927147 (0.0010) [2023-12-26 15:04:58,113][123090] Updated weights for policy 1, policy_version 1927157 (0.0009) [2023-12-26 15:04:58,173][123090] Updated weights for policy 1, policy_version 1927167 (0.0010) [2023-12-26 15:04:58,261][123091] Updated weights for policy 0, policy_version 1939258 (0.0008) [2023-12-26 15:04:58,318][123091] Updated weights for policy 0, policy_version 1939268 (0.0008) [2023-12-26 15:04:58,392][123091] Updated weights for policy 0, policy_version 1939278 (0.0008) [2023-12-26 15:04:58,784][121949] Fps is (10 sec: 17203.0, 60 sec: 18022.4, 300 sec: 17883.6). Total num frames: 989814784. Throughput: 0: 9172.8, 1: 8994.0. Samples: 989808992. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:04:58,785][121949] Avg episode reward: [(0, '6293.427'), (1, '5982.478')] [2023-12-26 15:04:59,118][123090] Updated weights for policy 1, policy_version 1927177 (0.0007) [2023-12-26 15:04:59,193][123090] Updated weights for policy 1, policy_version 1927187 (0.0006) [2023-12-26 15:04:59,269][123090] Updated weights for policy 1, policy_version 1927197 (0.0011) [2023-12-26 15:04:59,362][123091] Updated weights for policy 0, policy_version 1939288 (0.0012) [2023-12-26 15:04:59,416][123091] Updated weights for policy 0, policy_version 1939298 (0.0006) [2023-12-26 15:04:59,469][123091] Updated weights for policy 0, policy_version 1939308 (0.0011) [2023-12-26 15:04:59,995][123090] Updated weights for policy 1, policy_version 1927207 (0.0010) [2023-12-26 15:05:00,066][123090] Updated weights for policy 1, policy_version 1927217 (0.0010) [2023-12-26 15:05:00,118][123090] Updated weights for policy 1, policy_version 1927227 (0.0010) [2023-12-26 15:05:00,300][123091] Updated weights for policy 0, policy_version 1939318 (0.0010) [2023-12-26 15:05:00,366][123091] Updated weights for policy 0, policy_version 1939328 (0.0011) [2023-12-26 15:05:00,433][123091] Updated weights for policy 0, policy_version 1939338 (0.0011) [2023-12-26 15:05:00,921][123090] Updated weights for policy 1, policy_version 1927237 (0.0010) [2023-12-26 15:05:00,969][123090] Updated weights for policy 1, policy_version 1927247 (0.0010) [2023-12-26 15:05:01,017][123090] Updated weights for policy 1, policy_version 1927257 (0.0010) [2023-12-26 15:05:01,147][123091] Updated weights for policy 0, policy_version 1939348 (0.0010) [2023-12-26 15:05:01,211][123091] Updated weights for policy 0, policy_version 1939358 (0.0009) [2023-12-26 15:05:01,264][123091] Updated weights for policy 0, policy_version 1939368 (0.0009) [2023-12-26 15:05:01,800][123090] Updated weights for policy 1, policy_version 1927267 (0.0011) [2023-12-26 15:05:01,852][123090] Updated weights for policy 1, policy_version 1927277 (0.0010) [2023-12-26 15:05:01,907][123090] Updated weights for policy 1, policy_version 1927287 (0.0010) [2023-12-26 15:05:02,028][123091] Updated weights for policy 0, policy_version 1939378 (0.0010) [2023-12-26 15:05:02,076][123091] Updated weights for policy 0, policy_version 1939388 (0.0006) [2023-12-26 15:05:02,153][123091] Updated weights for policy 0, policy_version 1939398 (0.0005) [2023-12-26 15:05:02,221][123091] Updated weights for policy 0, policy_version 1939408 (0.0008) [2023-12-26 15:05:02,768][123090] Updated weights for policy 1, policy_version 1927297 (0.0010) [2023-12-26 15:05:02,826][123090] Updated weights for policy 1, policy_version 1927307 (0.0011) [2023-12-26 15:05:02,892][123090] Updated weights for policy 1, policy_version 1927317 (0.0010) [2023-12-26 15:05:02,955][123090] Updated weights for policy 1, policy_version 1927327 (0.0010) [2023-12-26 15:05:02,962][123091] Updated weights for policy 0, policy_version 1939418 (0.0006) [2023-12-26 15:05:03,027][123091] Updated weights for policy 0, policy_version 1939428 (0.0009) [2023-12-26 15:05:03,082][123091] Updated weights for policy 0, policy_version 1939438 (0.0009) [2023-12-26 15:05:03,746][123090] Updated weights for policy 1, policy_version 1927337 (0.0010) [2023-12-26 15:05:03,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 989896704. Throughput: 0: 9058.8, 1: 8950.0. Samples: 989914064. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:03,784][121949] Avg episode reward: [(0, '6371.219'), (1, '5888.545')] [2023-12-26 15:05:03,814][123090] Updated weights for policy 1, policy_version 1927347 (0.0010) [2023-12-26 15:05:03,875][123090] Updated weights for policy 1, policy_version 1927357 (0.0010) [2023-12-26 15:05:03,892][123091] Updated weights for policy 0, policy_version 1939448 (0.0008) [2023-12-26 15:05:03,948][123091] Updated weights for policy 0, policy_version 1939458 (0.0005) [2023-12-26 15:05:04,003][123091] Updated weights for policy 0, policy_version 1939468 (0.0005) [2023-12-26 15:05:04,686][123090] Updated weights for policy 1, policy_version 1927367 (0.0010) [2023-12-26 15:05:04,742][123090] Updated weights for policy 1, policy_version 1927377 (0.0010) [2023-12-26 15:05:04,802][123090] Updated weights for policy 1, policy_version 1927387 (0.0011) [2023-12-26 15:05:04,815][123091] Updated weights for policy 0, policy_version 1939478 (0.0009) [2023-12-26 15:05:04,862][123091] Updated weights for policy 0, policy_version 1939488 (0.0008) [2023-12-26 15:05:04,909][123091] Updated weights for policy 0, policy_version 1939498 (0.0009) [2023-12-26 15:05:05,630][123090] Updated weights for policy 1, policy_version 1927397 (0.0010) [2023-12-26 15:05:05,685][123090] Updated weights for policy 1, policy_version 1927407 (0.0010) [2023-12-26 15:05:05,739][123091] Updated weights for policy 0, policy_version 1939509 (0.0007) [2023-12-26 15:05:05,745][123090] Updated weights for policy 1, policy_version 1927417 (0.0010) [2023-12-26 15:05:05,791][123091] Updated weights for policy 0, policy_version 1939519 (0.0007) [2023-12-26 15:05:05,850][123091] Updated weights for policy 0, policy_version 1939529 (0.0009) [2023-12-26 15:05:06,554][123090] Updated weights for policy 1, policy_version 1927427 (0.0011) [2023-12-26 15:05:06,619][123090] Updated weights for policy 1, policy_version 1927437 (0.0011) [2023-12-26 15:05:06,680][123090] Updated weights for policy 1, policy_version 1927447 (0.0009) [2023-12-26 15:05:06,747][123091] Updated weights for policy 0, policy_version 1939539 (0.0009) [2023-12-26 15:05:06,810][123091] Updated weights for policy 0, policy_version 1939549 (0.0010) [2023-12-26 15:05:06,876][123091] Updated weights for policy 0, policy_version 1939559 (0.0010) [2023-12-26 15:05:07,477][123090] Updated weights for policy 1, policy_version 1927457 (0.0006) [2023-12-26 15:05:07,532][123090] Updated weights for policy 1, policy_version 1927467 (0.0007) [2023-12-26 15:05:07,588][123090] Updated weights for policy 1, policy_version 1927477 (0.0007) [2023-12-26 15:05:07,659][123090] Updated weights for policy 1, policy_version 1927487 (0.0006) [2023-12-26 15:05:07,690][123091] Updated weights for policy 0, policy_version 1939569 (0.0009) [2023-12-26 15:05:07,742][123091] Updated weights for policy 0, policy_version 1939579 (0.0007) [2023-12-26 15:05:07,792][123091] Updated weights for policy 0, policy_version 1939589 (0.0005) [2023-12-26 15:05:07,846][123091] Updated weights for policy 0, policy_version 1939599 (0.0005) [2023-12-26 15:05:08,349][123090] Updated weights for policy 1, policy_version 1927497 (0.0007) [2023-12-26 15:05:08,420][123090] Updated weights for policy 1, policy_version 1927507 (0.0008) [2023-12-26 15:05:08,490][123090] Updated weights for policy 1, policy_version 1927517 (0.0011) [2023-12-26 15:05:08,638][123091] Updated weights for policy 0, policy_version 1939609 (0.0010) [2023-12-26 15:05:08,710][123091] Updated weights for policy 0, policy_version 1939619 (0.0009) [2023-12-26 15:05:08,783][123091] Updated weights for policy 0, policy_version 1939629 (0.0010) [2023-12-26 15:05:08,784][121949] Fps is (10 sec: 17203.1, 60 sec: 18022.3, 300 sec: 17855.8). Total num frames: 989986816. Throughput: 0: 9058.3, 1: 8927.5. Samples: 989965872. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:08,785][121949] Avg episode reward: [(0, '6389.281'), (1, '5977.856')] [2023-12-26 15:05:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001927520_493445120.pth... [2023-12-26 15:05:08,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001926496_493182976.pth [2023-12-26 15:05:08,801][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001939632_496549888.pth... [2023-12-26 15:05:08,807][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001938576_496279552.pth [2023-12-26 15:05:09,131][123090] Updated weights for policy 1, policy_version 1927527 (0.0007) [2023-12-26 15:05:09,191][123090] Updated weights for policy 1, policy_version 1927537 (0.0006) [2023-12-26 15:05:09,267][123090] Updated weights for policy 1, policy_version 1927547 (0.0006) [2023-12-26 15:05:09,674][123091] Updated weights for policy 0, policy_version 1939639 (0.0008) [2023-12-26 15:05:09,738][123091] Updated weights for policy 0, policy_version 1939649 (0.0010) [2023-12-26 15:05:09,801][123091] Updated weights for policy 0, policy_version 1939659 (0.0009) [2023-12-26 15:05:10,027][123090] Updated weights for policy 1, policy_version 1927557 (0.0008) [2023-12-26 15:05:10,088][123090] Updated weights for policy 1, policy_version 1927567 (0.0011) [2023-12-26 15:05:10,144][123090] Updated weights for policy 1, policy_version 1927577 (0.0011) [2023-12-26 15:05:10,588][123091] Updated weights for policy 0, policy_version 1939669 (0.0009) [2023-12-26 15:05:10,644][123091] Updated weights for policy 0, policy_version 1939679 (0.0009) [2023-12-26 15:05:10,703][123091] Updated weights for policy 0, policy_version 1939689 (0.0009) [2023-12-26 15:05:10,983][123090] Updated weights for policy 1, policy_version 1927587 (0.0011) [2023-12-26 15:05:11,052][123090] Updated weights for policy 1, policy_version 1927597 (0.0011) [2023-12-26 15:05:11,116][123090] Updated weights for policy 1, policy_version 1927607 (0.0011) [2023-12-26 15:05:11,562][123091] Updated weights for policy 0, policy_version 1939699 (0.0009) [2023-12-26 15:05:11,630][123091] Updated weights for policy 0, policy_version 1939709 (0.0010) [2023-12-26 15:05:11,702][123091] Updated weights for policy 0, policy_version 1939719 (0.0010) [2023-12-26 15:05:11,906][123090] Updated weights for policy 1, policy_version 1927617 (0.0009) [2023-12-26 15:05:11,970][123090] Updated weights for policy 1, policy_version 1927627 (0.0010) [2023-12-26 15:05:12,030][123090] Updated weights for policy 1, policy_version 1927637 (0.0010) [2023-12-26 15:05:12,093][123090] Updated weights for policy 1, policy_version 1927647 (0.0010) [2023-12-26 15:05:12,557][123091] Updated weights for policy 0, policy_version 1939729 (0.0010) [2023-12-26 15:05:12,621][123091] Updated weights for policy 0, policy_version 1939739 (0.0006) [2023-12-26 15:05:12,684][123091] Updated weights for policy 0, policy_version 1939749 (0.0006) [2023-12-26 15:05:12,744][123091] Updated weights for policy 0, policy_version 1939759 (0.0006) [2023-12-26 15:05:12,851][123090] Updated weights for policy 1, policy_version 1927657 (0.0011) [2023-12-26 15:05:12,912][123090] Updated weights for policy 1, policy_version 1927667 (0.0011) [2023-12-26 15:05:12,964][123090] Updated weights for policy 1, policy_version 1927677 (0.0011) [2023-12-26 15:05:13,602][123091] Updated weights for policy 0, policy_version 1939769 (0.0010) [2023-12-26 15:05:13,669][123091] Updated weights for policy 0, policy_version 1939779 (0.0009) [2023-12-26 15:05:13,701][123090] Updated weights for policy 1, policy_version 1927687 (0.0007) [2023-12-26 15:05:13,740][123091] Updated weights for policy 0, policy_version 1939789 (0.0009) [2023-12-26 15:05:13,752][123090] Updated weights for policy 1, policy_version 1927697 (0.0006) [2023-12-26 15:05:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.5, 300 sec: 17883.6). Total num frames: 990076928. Throughput: 0: 8892.9, 1: 8938.1. Samples: 990071048. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:13,784][121949] Avg episode reward: [(0, '6335.726'), (1, '5893.514')] [2023-12-26 15:05:13,806][123090] Updated weights for policy 1, policy_version 1927707 (0.0008) [2023-12-26 15:05:14,578][123091] Updated weights for policy 0, policy_version 1939799 (0.0009) [2023-12-26 15:05:14,581][123090] Updated weights for policy 1, policy_version 1927717 (0.0008) [2023-12-26 15:05:14,633][123090] Updated weights for policy 1, policy_version 1927727 (0.0008) [2023-12-26 15:05:14,642][123091] Updated weights for policy 0, policy_version 1939809 (0.0007) [2023-12-26 15:05:14,697][123090] Updated weights for policy 1, policy_version 1927737 (0.0009) [2023-12-26 15:05:14,704][123091] Updated weights for policy 0, policy_version 1939819 (0.0006) [2023-12-26 15:05:15,548][123090] Updated weights for policy 1, policy_version 1927747 (0.0006) [2023-12-26 15:05:15,554][123091] Updated weights for policy 0, policy_version 1939829 (0.0010) [2023-12-26 15:05:15,611][123091] Updated weights for policy 0, policy_version 1939839 (0.0007) [2023-12-26 15:05:15,616][123090] Updated weights for policy 1, policy_version 1927757 (0.0008) [2023-12-26 15:05:15,657][123091] Updated weights for policy 0, policy_version 1939849 (0.0006) [2023-12-26 15:05:15,676][123090] Updated weights for policy 1, policy_version 1927767 (0.0010) [2023-12-26 15:05:16,504][123090] Updated weights for policy 1, policy_version 1927777 (0.0008) [2023-12-26 15:05:16,520][123091] Updated weights for policy 0, policy_version 1939859 (0.0008) [2023-12-26 15:05:16,570][123090] Updated weights for policy 1, policy_version 1927787 (0.0009) [2023-12-26 15:05:16,580][123091] Updated weights for policy 0, policy_version 1939869 (0.0007) [2023-12-26 15:05:16,631][123090] Updated weights for policy 1, policy_version 1927797 (0.0006) [2023-12-26 15:05:16,641][123091] Updated weights for policy 0, policy_version 1939879 (0.0008) [2023-12-26 15:05:16,688][123090] Updated weights for policy 1, policy_version 1927807 (0.0005) [2023-12-26 15:05:17,457][123091] Updated weights for policy 0, policy_version 1939889 (0.0009) [2023-12-26 15:05:17,471][123090] Updated weights for policy 1, policy_version 1927817 (0.0006) [2023-12-26 15:05:17,519][123091] Updated weights for policy 0, policy_version 1939899 (0.0009) [2023-12-26 15:05:17,541][123090] Updated weights for policy 1, policy_version 1927827 (0.0008) [2023-12-26 15:05:17,585][123091] Updated weights for policy 0, policy_version 1939909 (0.0009) [2023-12-26 15:05:17,602][123090] Updated weights for policy 1, policy_version 1927837 (0.0009) [2023-12-26 15:05:17,650][123091] Updated weights for policy 0, policy_version 1939919 (0.0008) [2023-12-26 15:05:18,316][123090] Updated weights for policy 1, policy_version 1927847 (0.0010) [2023-12-26 15:05:18,378][123090] Updated weights for policy 1, policy_version 1927857 (0.0011) [2023-12-26 15:05:18,439][123090] Updated weights for policy 1, policy_version 1927867 (0.0009) [2023-12-26 15:05:18,524][123091] Updated weights for policy 0, policy_version 1939929 (0.0010) [2023-12-26 15:05:18,598][123091] Updated weights for policy 0, policy_version 1939939 (0.0011) [2023-12-26 15:05:18,665][123091] Updated weights for policy 0, policy_version 1939949 (0.0011) [2023-12-26 15:05:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 990167040. Throughput: 0: 8805.1, 1: 8899.7. Samples: 990175704. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:18,785][121949] Avg episode reward: [(0, '6352.477'), (1, '5853.335')] [2023-12-26 15:05:19,191][123090] Updated weights for policy 1, policy_version 1927877 (0.0009) [2023-12-26 15:05:19,266][123090] Updated weights for policy 1, policy_version 1927887 (0.0010) [2023-12-26 15:05:19,332][123090] Updated weights for policy 1, policy_version 1927897 (0.0009) [2023-12-26 15:05:19,490][123091] Updated weights for policy 0, policy_version 1939959 (0.0011) [2023-12-26 15:05:19,558][123091] Updated weights for policy 0, policy_version 1939969 (0.0010) [2023-12-26 15:05:19,622][123091] Updated weights for policy 0, policy_version 1939979 (0.0006) [2023-12-26 15:05:20,225][123090] Updated weights for policy 1, policy_version 1927907 (0.0010) [2023-12-26 15:05:20,283][123090] Updated weights for policy 1, policy_version 1927917 (0.0009) [2023-12-26 15:05:20,308][123091] Updated weights for policy 0, policy_version 1939989 (0.0008) [2023-12-26 15:05:20,333][123090] Updated weights for policy 1, policy_version 1927927 (0.0007) [2023-12-26 15:05:20,366][123091] Updated weights for policy 0, policy_version 1939999 (0.0010) [2023-12-26 15:05:20,425][123091] Updated weights for policy 0, policy_version 1940009 (0.0008) [2023-12-26 15:05:21,238][123090] Updated weights for policy 1, policy_version 1927937 (0.0007) [2023-12-26 15:05:21,310][123090] Updated weights for policy 1, policy_version 1927947 (0.0009) [2023-12-26 15:05:21,316][123091] Updated weights for policy 0, policy_version 1940019 (0.0009) [2023-12-26 15:05:21,377][123090] Updated weights for policy 1, policy_version 1927957 (0.0008) [2023-12-26 15:05:21,388][123091] Updated weights for policy 0, policy_version 1940029 (0.0010) [2023-12-26 15:05:21,451][123090] Updated weights for policy 1, policy_version 1927967 (0.0009) [2023-12-26 15:05:21,458][123091] Updated weights for policy 0, policy_version 1940039 (0.0007) [2023-12-26 15:05:22,205][123091] Updated weights for policy 0, policy_version 1940049 (0.0005) [2023-12-26 15:05:22,227][123090] Updated weights for policy 1, policy_version 1927977 (0.0008) [2023-12-26 15:05:22,275][123091] Updated weights for policy 0, policy_version 1940059 (0.0009) [2023-12-26 15:05:22,299][123090] Updated weights for policy 1, policy_version 1927987 (0.0007) [2023-12-26 15:05:22,340][123091] Updated weights for policy 0, policy_version 1940069 (0.0011) [2023-12-26 15:05:22,376][123090] Updated weights for policy 1, policy_version 1927997 (0.0008) [2023-12-26 15:05:22,404][123091] Updated weights for policy 0, policy_version 1940079 (0.0008) [2023-12-26 15:05:23,048][123090] Updated weights for policy 1, policy_version 1928007 (0.0007) [2023-12-26 15:05:23,121][123090] Updated weights for policy 1, policy_version 1928017 (0.0006) [2023-12-26 15:05:23,181][123090] Updated weights for policy 1, policy_version 1928027 (0.0005) [2023-12-26 15:05:23,314][123091] Updated weights for policy 0, policy_version 1940089 (0.0010) [2023-12-26 15:05:23,376][123091] Updated weights for policy 0, policy_version 1940099 (0.0009) [2023-12-26 15:05:23,430][123091] Updated weights for policy 0, policy_version 1940109 (0.0010) [2023-12-26 15:05:23,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 990248960. Throughput: 0: 8782.7, 1: 8821.3. Samples: 990226224. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:23,785][121949] Avg episode reward: [(0, '6327.614'), (1, '5876.252')] [2023-12-26 15:05:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001940112_496672768.pth... [2023-12-26 15:05:23,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001928032_493576192.pth... [2023-12-26 15:05:23,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001939120_496418816.pth [2023-12-26 15:05:23,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001927008_493314048.pth [2023-12-26 15:05:23,872][123090] Updated weights for policy 1, policy_version 1928037 (0.0005) [2023-12-26 15:05:23,923][123090] Updated weights for policy 1, policy_version 1928047 (0.0005) [2023-12-26 15:05:23,982][123090] Updated weights for policy 1, policy_version 1928057 (0.0006) [2023-12-26 15:05:24,331][123091] Updated weights for policy 0, policy_version 1940119 (0.0010) [2023-12-26 15:05:24,388][123091] Updated weights for policy 0, policy_version 1940129 (0.0009) [2023-12-26 15:05:24,439][123091] Updated weights for policy 0, policy_version 1940139 (0.0009) [2023-12-26 15:05:24,683][123090] Updated weights for policy 1, policy_version 1928067 (0.0005) [2023-12-26 15:05:24,764][123090] Updated weights for policy 1, policy_version 1928077 (0.0005) [2023-12-26 15:05:24,841][123090] Updated weights for policy 1, policy_version 1928087 (0.0006) [2023-12-26 15:05:25,313][123091] Updated weights for policy 0, policy_version 1940149 (0.0007) [2023-12-26 15:05:25,363][123091] Updated weights for policy 0, policy_version 1940159 (0.0005) [2023-12-26 15:05:25,373][123090] Updated weights for policy 1, policy_version 1928097 (0.0005) [2023-12-26 15:05:25,411][123091] Updated weights for policy 0, policy_version 1940169 (0.0005) [2023-12-26 15:05:25,420][123090] Updated weights for policy 1, policy_version 1928107 (0.0005) [2023-12-26 15:05:25,469][123090] Updated weights for policy 1, policy_version 1928117 (0.0005) [2023-12-26 15:05:25,513][123090] Updated weights for policy 1, policy_version 1928127 (0.0006) [2023-12-26 15:05:26,178][123090] Updated weights for policy 1, policy_version 1928137 (0.0007) [2023-12-26 15:05:26,237][123090] Updated weights for policy 1, policy_version 1928147 (0.0009) [2023-12-26 15:05:26,268][123091] Updated weights for policy 0, policy_version 1940179 (0.0008) [2023-12-26 15:05:26,297][123090] Updated weights for policy 1, policy_version 1928157 (0.0007) [2023-12-26 15:05:26,327][123091] Updated weights for policy 0, policy_version 1940189 (0.0010) [2023-12-26 15:05:26,379][123091] Updated weights for policy 0, policy_version 1940199 (0.0009) [2023-12-26 15:05:27,094][123090] Updated weights for policy 1, policy_version 1928167 (0.0009) [2023-12-26 15:05:27,153][123090] Updated weights for policy 1, policy_version 1928177 (0.0008) [2023-12-26 15:05:27,168][123091] Updated weights for policy 0, policy_version 1940209 (0.0010) [2023-12-26 15:05:27,206][123090] Updated weights for policy 1, policy_version 1928187 (0.0007) [2023-12-26 15:05:27,216][123091] Updated weights for policy 0, policy_version 1940219 (0.0008) [2023-12-26 15:05:27,273][123091] Updated weights for policy 0, policy_version 1940229 (0.0009) [2023-12-26 15:05:27,324][123091] Updated weights for policy 0, policy_version 1940239 (0.0009) [2023-12-26 15:05:27,980][123090] Updated weights for policy 1, policy_version 1928197 (0.0007) [2023-12-26 15:05:28,045][123090] Updated weights for policy 1, policy_version 1928207 (0.0010) [2023-12-26 15:05:28,112][123090] Updated weights for policy 1, policy_version 1928217 (0.0009) [2023-12-26 15:05:28,221][123091] Updated weights for policy 0, policy_version 1940249 (0.0006) [2023-12-26 15:05:28,276][123091] Updated weights for policy 0, policy_version 1940259 (0.0005) [2023-12-26 15:05:28,327][123091] Updated weights for policy 0, policy_version 1940269 (0.0006) [2023-12-26 15:05:28,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 990339072. Throughput: 0: 8708.9, 1: 8986.0. Samples: 990335192. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:28,785][121949] Avg episode reward: [(0, '6325.940'), (1, '5832.621')] [2023-12-26 15:05:28,813][123090] Updated weights for policy 1, policy_version 1928227 (0.0009) [2023-12-26 15:05:28,884][123090] Updated weights for policy 1, policy_version 1928237 (0.0006) [2023-12-26 15:05:28,959][123090] Updated weights for policy 1, policy_version 1928247 (0.0005) [2023-12-26 15:05:29,059][123091] Updated weights for policy 0, policy_version 1940279 (0.0010) [2023-12-26 15:05:29,112][123091] Updated weights for policy 0, policy_version 1940289 (0.0006) [2023-12-26 15:05:29,171][123091] Updated weights for policy 0, policy_version 1940299 (0.0006) [2023-12-26 15:05:29,744][123090] Updated weights for policy 1, policy_version 1928257 (0.0006) [2023-12-26 15:05:29,799][123090] Updated weights for policy 1, policy_version 1928267 (0.0008) [2023-12-26 15:05:29,873][123090] Updated weights for policy 1, policy_version 1928277 (0.0008) [2023-12-26 15:05:29,875][123091] Updated weights for policy 0, policy_version 1940309 (0.0008) [2023-12-26 15:05:29,941][123091] Updated weights for policy 0, policy_version 1940319 (0.0009) [2023-12-26 15:05:29,952][123090] Updated weights for policy 1, policy_version 1928287 (0.0008) [2023-12-26 15:05:30,000][123091] Updated weights for policy 0, policy_version 1940329 (0.0009) [2023-12-26 15:05:30,674][123091] Updated weights for policy 0, policy_version 1940339 (0.0006) [2023-12-26 15:05:30,730][123091] Updated weights for policy 0, policy_version 1940349 (0.0006) [2023-12-26 15:05:30,788][123091] Updated weights for policy 0, policy_version 1940359 (0.0007) [2023-12-26 15:05:30,844][123090] Updated weights for policy 1, policy_version 1928297 (0.0008) [2023-12-26 15:05:30,905][123090] Updated weights for policy 1, policy_version 1928307 (0.0008) [2023-12-26 15:05:30,971][123090] Updated weights for policy 1, policy_version 1928317 (0.0008) [2023-12-26 15:05:31,535][123091] Updated weights for policy 0, policy_version 1940369 (0.0006) [2023-12-26 15:05:31,586][123091] Updated weights for policy 0, policy_version 1940379 (0.0008) [2023-12-26 15:05:31,647][123091] Updated weights for policy 0, policy_version 1940389 (0.0010) [2023-12-26 15:05:31,708][123091] Updated weights for policy 0, policy_version 1940399 (0.0010) [2023-12-26 15:05:31,746][123090] Updated weights for policy 1, policy_version 1928327 (0.0008) [2023-12-26 15:05:31,801][123090] Updated weights for policy 1, policy_version 1928337 (0.0008) [2023-12-26 15:05:31,861][123090] Updated weights for policy 1, policy_version 1928347 (0.0009) [2023-12-26 15:05:32,483][123091] Updated weights for policy 0, policy_version 1940409 (0.0009) [2023-12-26 15:05:32,537][123091] Updated weights for policy 0, policy_version 1940419 (0.0009) [2023-12-26 15:05:32,595][123091] Updated weights for policy 0, policy_version 1940429 (0.0009) [2023-12-26 15:05:32,667][123090] Updated weights for policy 1, policy_version 1928357 (0.0009) [2023-12-26 15:05:32,722][123090] Updated weights for policy 1, policy_version 1928367 (0.0010) [2023-12-26 15:05:32,779][123090] Updated weights for policy 1, policy_version 1928377 (0.0009) [2023-12-26 15:05:33,470][123091] Updated weights for policy 0, policy_version 1940440 (0.0007) [2023-12-26 15:05:33,528][123091] Updated weights for policy 0, policy_version 1940450 (0.0006) [2023-12-26 15:05:33,592][123091] Updated weights for policy 0, policy_version 1940460 (0.0006) [2023-12-26 15:05:33,614][123090] Updated weights for policy 1, policy_version 1928387 (0.0009) [2023-12-26 15:05:33,666][123090] Updated weights for policy 1, policy_version 1928397 (0.0008) [2023-12-26 15:05:33,714][123090] Updated weights for policy 1, policy_version 1928407 (0.0009) [2023-12-26 15:05:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17886.0, 300 sec: 17883.6). Total num frames: 990437376. Throughput: 0: 8751.4, 1: 8926.8. Samples: 990443496. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:33,785][121949] Avg episode reward: [(0, '6336.177'), (1, '5671.434')] [2023-12-26 15:05:34,310][123091] Updated weights for policy 0, policy_version 1940470 (0.0006) [2023-12-26 15:05:34,365][123091] Updated weights for policy 0, policy_version 1940480 (0.0005) [2023-12-26 15:05:34,427][123091] Updated weights for policy 0, policy_version 1940490 (0.0006) [2023-12-26 15:05:34,596][123090] Updated weights for policy 1, policy_version 1928417 (0.0009) [2023-12-26 15:05:34,651][123090] Updated weights for policy 1, policy_version 1928427 (0.0010) [2023-12-26 15:05:34,714][123090] Updated weights for policy 1, policy_version 1928437 (0.0010) [2023-12-26 15:05:34,769][123090] Updated weights for policy 1, policy_version 1928447 (0.0010) [2023-12-26 15:05:35,102][123091] Updated weights for policy 0, policy_version 1940500 (0.0006) [2023-12-26 15:05:35,155][123091] Updated weights for policy 0, policy_version 1940510 (0.0009) [2023-12-26 15:05:35,199][123091] Updated weights for policy 0, policy_version 1940520 (0.0010) [2023-12-26 15:05:35,692][123090] Updated weights for policy 1, policy_version 1928457 (0.0010) [2023-12-26 15:05:35,763][123090] Updated weights for policy 1, policy_version 1928467 (0.0010) [2023-12-26 15:05:35,826][123090] Updated weights for policy 1, policy_version 1928477 (0.0010) [2023-12-26 15:05:35,898][123091] Updated weights for policy 0, policy_version 1940530 (0.0009) [2023-12-26 15:05:35,959][123091] Updated weights for policy 0, policy_version 1940540 (0.0005) [2023-12-26 15:05:36,016][123091] Updated weights for policy 0, policy_version 1940550 (0.0006) [2023-12-26 15:05:36,080][123091] Updated weights for policy 0, policy_version 1940560 (0.0010) [2023-12-26 15:05:36,709][123090] Updated weights for policy 1, policy_version 1928487 (0.0009) [2023-12-26 15:05:36,755][123091] Updated weights for policy 0, policy_version 1940570 (0.0006) [2023-12-26 15:05:36,775][123090] Updated weights for policy 1, policy_version 1928497 (0.0009) [2023-12-26 15:05:36,820][123091] Updated weights for policy 0, policy_version 1940580 (0.0006) [2023-12-26 15:05:36,839][123090] Updated weights for policy 1, policy_version 1928507 (0.0008) [2023-12-26 15:05:36,895][123091] Updated weights for policy 0, policy_version 1940590 (0.0006) [2023-12-26 15:05:37,564][123091] Updated weights for policy 0, policy_version 1940600 (0.0009) [2023-12-26 15:05:37,620][123091] Updated weights for policy 0, policy_version 1940610 (0.0011) [2023-12-26 15:05:37,672][123091] Updated weights for policy 0, policy_version 1940620 (0.0010) [2023-12-26 15:05:37,693][123090] Updated weights for policy 1, policy_version 1928517 (0.0009) [2023-12-26 15:05:37,751][123090] Updated weights for policy 1, policy_version 1928527 (0.0009) [2023-12-26 15:05:37,800][123090] Updated weights for policy 1, policy_version 1928537 (0.0009) [2023-12-26 15:05:38,484][123091] Updated weights for policy 0, policy_version 1940630 (0.0008) [2023-12-26 15:05:38,536][123091] Updated weights for policy 0, policy_version 1940640 (0.0010) [2023-12-26 15:05:38,598][123091] Updated weights for policy 0, policy_version 1940650 (0.0010) [2023-12-26 15:05:38,686][123090] Updated weights for policy 1, policy_version 1928547 (0.0009) [2023-12-26 15:05:38,758][123090] Updated weights for policy 1, policy_version 1928557 (0.0009) [2023-12-26 15:05:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 990519296. Throughput: 0: 8822.5, 1: 8915.6. Samples: 990496912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:38,785][121949] Avg episode reward: [(0, '6364.193'), (1, '5801.223')] [2023-12-26 15:05:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001940656_496812032.pth... [2023-12-26 15:05:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001939632_496549888.pth [2023-12-26 15:05:38,815][123090] Updated weights for policy 1, policy_version 1928567 (0.0010) [2023-12-26 15:05:38,865][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001928576_493715456.pth... [2023-12-26 15:05:38,868][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001927520_493445120.pth [2023-12-26 15:05:39,326][123091] Updated weights for policy 0, policy_version 1940660 (0.0009) [2023-12-26 15:05:39,392][123091] Updated weights for policy 0, policy_version 1940670 (0.0010) [2023-12-26 15:05:39,461][123091] Updated weights for policy 0, policy_version 1940680 (0.0008) [2023-12-26 15:05:39,742][123090] Updated weights for policy 1, policy_version 1928577 (0.0010) [2023-12-26 15:05:39,806][123090] Updated weights for policy 1, policy_version 1928587 (0.0010) [2023-12-26 15:05:39,875][123090] Updated weights for policy 1, policy_version 1928597 (0.0009) [2023-12-26 15:05:39,952][123090] Updated weights for policy 1, policy_version 1928607 (0.0007) [2023-12-26 15:05:40,243][123091] Updated weights for policy 0, policy_version 1940690 (0.0008) [2023-12-26 15:05:40,306][123091] Updated weights for policy 0, policy_version 1940700 (0.0005) [2023-12-26 15:05:40,361][123091] Updated weights for policy 0, policy_version 1940710 (0.0006) [2023-12-26 15:05:40,412][123091] Updated weights for policy 0, policy_version 1940720 (0.0005) [2023-12-26 15:05:40,761][123090] Updated weights for policy 1, policy_version 1928617 (0.0009) [2023-12-26 15:05:40,837][123090] Updated weights for policy 1, policy_version 1928627 (0.0010) [2023-12-26 15:05:40,909][123090] Updated weights for policy 1, policy_version 1928637 (0.0009) [2023-12-26 15:05:41,047][123091] Updated weights for policy 0, policy_version 1940730 (0.0009) [2023-12-26 15:05:41,108][123091] Updated weights for policy 0, policy_version 1940740 (0.0010) [2023-12-26 15:05:41,178][123091] Updated weights for policy 0, policy_version 1940750 (0.0009) [2023-12-26 15:05:41,806][123090] Updated weights for policy 1, policy_version 1928647 (0.0009) [2023-12-26 15:05:41,876][123090] Updated weights for policy 1, policy_version 1928657 (0.0009) [2023-12-26 15:05:41,935][123090] Updated weights for policy 1, policy_version 1928667 (0.0010) [2023-12-26 15:05:41,979][123091] Updated weights for policy 0, policy_version 1940760 (0.0009) [2023-12-26 15:05:42,037][123091] Updated weights for policy 0, policy_version 1940770 (0.0010) [2023-12-26 15:05:42,101][123091] Updated weights for policy 0, policy_version 1940780 (0.0009) [2023-12-26 15:05:42,796][123090] Updated weights for policy 1, policy_version 1928677 (0.0009) [2023-12-26 15:05:42,855][123090] Updated weights for policy 1, policy_version 1928687 (0.0010) [2023-12-26 15:05:42,929][123090] Updated weights for policy 1, policy_version 1928697 (0.0011) [2023-12-26 15:05:42,958][123091] Updated weights for policy 0, policy_version 1940790 (0.0007) [2023-12-26 15:05:43,008][123091] Updated weights for policy 0, policy_version 1940800 (0.0008) [2023-12-26 15:05:43,072][123091] Updated weights for policy 0, policy_version 1940810 (0.0008) [2023-12-26 15:05:43,635][123090] Updated weights for policy 1, policy_version 1928707 (0.0009) [2023-12-26 15:05:43,697][123090] Updated weights for policy 1, policy_version 1928717 (0.0006) [2023-12-26 15:05:43,755][123090] Updated weights for policy 1, policy_version 1928727 (0.0006) [2023-12-26 15:05:43,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 990601216. Throughput: 0: 8803.0, 1: 8784.8. Samples: 990600444. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:43,785][121949] Avg episode reward: [(0, '6369.275'), (1, '5855.855')] [2023-12-26 15:05:43,884][123091] Updated weights for policy 0, policy_version 1940820 (0.0008) [2023-12-26 15:05:43,935][123091] Updated weights for policy 0, policy_version 1940830 (0.0005) [2023-12-26 15:05:43,986][123091] Updated weights for policy 0, policy_version 1940840 (0.0005) [2023-12-26 15:05:44,551][123090] Updated weights for policy 1, policy_version 1928737 (0.0006) [2023-12-26 15:05:44,607][123090] Updated weights for policy 1, policy_version 1928747 (0.0008) [2023-12-26 15:05:44,665][123090] Updated weights for policy 1, policy_version 1928757 (0.0009) [2023-12-26 15:05:44,699][123091] Updated weights for policy 0, policy_version 1940850 (0.0006) [2023-12-26 15:05:44,719][123090] Updated weights for policy 1, policy_version 1928767 (0.0008) [2023-12-26 15:05:44,746][123091] Updated weights for policy 0, policy_version 1940860 (0.0005) [2023-12-26 15:05:44,811][123091] Updated weights for policy 0, policy_version 1940870 (0.0008) [2023-12-26 15:05:44,864][123091] Updated weights for policy 0, policy_version 1940880 (0.0008) [2023-12-26 15:05:45,603][123090] Updated weights for policy 1, policy_version 1928777 (0.0009) [2023-12-26 15:05:45,666][123090] Updated weights for policy 1, policy_version 1928787 (0.0009) [2023-12-26 15:05:45,683][123091] Updated weights for policy 0, policy_version 1940890 (0.0011) [2023-12-26 15:05:45,729][123090] Updated weights for policy 1, policy_version 1928797 (0.0008) [2023-12-26 15:05:45,743][123091] Updated weights for policy 0, policy_version 1940900 (0.0011) [2023-12-26 15:05:45,790][123091] Updated weights for policy 0, policy_version 1940910 (0.0010) [2023-12-26 15:05:46,523][123090] Updated weights for policy 1, policy_version 1928807 (0.0007) [2023-12-26 15:05:46,587][123091] Updated weights for policy 0, policy_version 1940920 (0.0006) [2023-12-26 15:05:46,589][123090] Updated weights for policy 1, policy_version 1928817 (0.0007) [2023-12-26 15:05:46,653][123090] Updated weights for policy 1, policy_version 1928827 (0.0006) [2023-12-26 15:05:46,653][123091] Updated weights for policy 0, policy_version 1940930 (0.0009) [2023-12-26 15:05:46,720][123091] Updated weights for policy 0, policy_version 1940940 (0.0009) [2023-12-26 15:05:47,445][123090] Updated weights for policy 1, policy_version 1928837 (0.0008) [2023-12-26 15:05:47,494][123091] Updated weights for policy 0, policy_version 1940950 (0.0008) [2023-12-26 15:05:47,512][123090] Updated weights for policy 1, policy_version 1928847 (0.0010) [2023-12-26 15:05:47,558][123091] Updated weights for policy 0, policy_version 1940960 (0.0006) [2023-12-26 15:05:47,568][123090] Updated weights for policy 1, policy_version 1928857 (0.0011) [2023-12-26 15:05:47,617][123091] Updated weights for policy 0, policy_version 1940970 (0.0007) [2023-12-26 15:05:48,266][123090] Updated weights for policy 1, policy_version 1928867 (0.0009) [2023-12-26 15:05:48,314][123090] Updated weights for policy 1, policy_version 1928877 (0.0005) [2023-12-26 15:05:48,351][123091] Updated weights for policy 0, policy_version 1940980 (0.0010) [2023-12-26 15:05:48,383][123090] Updated weights for policy 1, policy_version 1928887 (0.0007) [2023-12-26 15:05:48,417][123091] Updated weights for policy 0, policy_version 1940990 (0.0008) [2023-12-26 15:05:48,481][123091] Updated weights for policy 0, policy_version 1941000 (0.0007) [2023-12-26 15:05:48,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 990699520. Throughput: 0: 8829.8, 1: 8832.8. Samples: 990708880. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:48,784][121949] Avg episode reward: [(0, '6276.004'), (1, '6062.994')] [2023-12-26 15:05:49,157][123090] Updated weights for policy 1, policy_version 1928897 (0.0007) [2023-12-26 15:05:49,219][123090] Updated weights for policy 1, policy_version 1928907 (0.0009) [2023-12-26 15:05:49,286][123090] Updated weights for policy 1, policy_version 1928917 (0.0009) [2023-12-26 15:05:49,307][123091] Updated weights for policy 0, policy_version 1941010 (0.0009) [2023-12-26 15:05:49,343][123090] Updated weights for policy 1, policy_version 1928927 (0.0008) [2023-12-26 15:05:49,378][123091] Updated weights for policy 0, policy_version 1941020 (0.0008) [2023-12-26 15:05:49,449][123091] Updated weights for policy 0, policy_version 1941030 (0.0009) [2023-12-26 15:05:49,512][123091] Updated weights for policy 0, policy_version 1941040 (0.0009) [2023-12-26 15:05:50,266][123090] Updated weights for policy 1, policy_version 1928937 (0.0008) [2023-12-26 15:05:50,295][123091] Updated weights for policy 0, policy_version 1941050 (0.0008) [2023-12-26 15:05:50,330][123090] Updated weights for policy 1, policy_version 1928947 (0.0008) [2023-12-26 15:05:50,363][123091] Updated weights for policy 0, policy_version 1941060 (0.0007) [2023-12-26 15:05:50,397][123090] Updated weights for policy 1, policy_version 1928957 (0.0009) [2023-12-26 15:05:50,428][123091] Updated weights for policy 0, policy_version 1941070 (0.0011) [2023-12-26 15:05:51,175][123091] Updated weights for policy 0, policy_version 1941080 (0.0009) [2023-12-26 15:05:51,230][123091] Updated weights for policy 0, policy_version 1941090 (0.0009) [2023-12-26 15:05:51,260][123090] Updated weights for policy 1, policy_version 1928967 (0.0009) [2023-12-26 15:05:51,296][123091] Updated weights for policy 0, policy_version 1941100 (0.0009) [2023-12-26 15:05:51,324][123090] Updated weights for policy 1, policy_version 1928977 (0.0008) [2023-12-26 15:05:51,388][123090] Updated weights for policy 1, policy_version 1928987 (0.0010) [2023-12-26 15:05:52,091][123091] Updated weights for policy 0, policy_version 1941110 (0.0010) [2023-12-26 15:05:52,143][123091] Updated weights for policy 0, policy_version 1941120 (0.0010) [2023-12-26 15:05:52,195][123091] Updated weights for policy 0, policy_version 1941130 (0.0007) [2023-12-26 15:05:52,269][123090] Updated weights for policy 1, policy_version 1928997 (0.0009) [2023-12-26 15:05:52,334][123090] Updated weights for policy 1, policy_version 1929007 (0.0009) [2023-12-26 15:05:52,395][123090] Updated weights for policy 1, policy_version 1929017 (0.0008) [2023-12-26 15:05:53,027][123091] Updated weights for policy 0, policy_version 1941140 (0.0008) [2023-12-26 15:05:53,097][123091] Updated weights for policy 0, policy_version 1941150 (0.0010) [2023-12-26 15:05:53,175][123091] Updated weights for policy 0, policy_version 1941160 (0.0011) [2023-12-26 15:05:53,175][123090] Updated weights for policy 1, policy_version 1929027 (0.0008) [2023-12-26 15:05:53,229][123090] Updated weights for policy 1, policy_version 1929037 (0.0006) [2023-12-26 15:05:53,297][123090] Updated weights for policy 1, policy_version 1929047 (0.0005) [2023-12-26 15:05:53,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 990781440. Throughput: 0: 8840.5, 1: 8792.5. Samples: 990759352. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:53,785][121949] Avg episode reward: [(0, '6249.426'), (1, '5902.575')] [2023-12-26 15:05:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001941168_496943104.pth... [2023-12-26 15:05:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001929056_493838336.pth... [2023-12-26 15:05:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001940112_496672768.pth [2023-12-26 15:05:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001928032_493576192.pth [2023-12-26 15:05:53,954][123090] Updated weights for policy 1, policy_version 1929057 (0.0006) [2023-12-26 15:05:53,960][123091] Updated weights for policy 0, policy_version 1941170 (0.0010) [2023-12-26 15:05:54,004][123091] Updated weights for policy 0, policy_version 1941180 (0.0010) [2023-12-26 15:05:54,012][123090] Updated weights for policy 1, policy_version 1929067 (0.0010) [2023-12-26 15:05:54,048][123091] Updated weights for policy 0, policy_version 1941190 (0.0010) [2023-12-26 15:05:54,064][123090] Updated weights for policy 1, policy_version 1929077 (0.0006) [2023-12-26 15:05:54,100][123091] Updated weights for policy 0, policy_version 1941200 (0.0010) [2023-12-26 15:05:54,113][123090] Updated weights for policy 1, policy_version 1929087 (0.0006) [2023-12-26 15:05:54,823][123090] Updated weights for policy 1, policy_version 1929097 (0.0005) [2023-12-26 15:05:54,879][123090] Updated weights for policy 1, policy_version 1929107 (0.0005) [2023-12-26 15:05:54,938][123090] Updated weights for policy 1, policy_version 1929117 (0.0009) [2023-12-26 15:05:54,993][123091] Updated weights for policy 0, policy_version 1941210 (0.0011) [2023-12-26 15:05:55,050][123091] Updated weights for policy 0, policy_version 1941220 (0.0011) [2023-12-26 15:05:55,117][123091] Updated weights for policy 0, policy_version 1941230 (0.0011) [2023-12-26 15:05:55,726][123090] Updated weights for policy 1, policy_version 1929127 (0.0011) [2023-12-26 15:05:55,789][123090] Updated weights for policy 1, policy_version 1929137 (0.0010) [2023-12-26 15:05:55,855][123090] Updated weights for policy 1, policy_version 1929147 (0.0010) [2023-12-26 15:05:55,855][123091] Updated weights for policy 0, policy_version 1941240 (0.0006) [2023-12-26 15:05:55,914][123091] Updated weights for policy 0, policy_version 1941250 (0.0005) [2023-12-26 15:05:55,976][123091] Updated weights for policy 0, policy_version 1941260 (0.0005) [2023-12-26 15:05:56,629][123091] Updated weights for policy 0, policy_version 1941270 (0.0008) [2023-12-26 15:05:56,649][123090] Updated weights for policy 1, policy_version 1929157 (0.0009) [2023-12-26 15:05:56,684][123091] Updated weights for policy 0, policy_version 1941280 (0.0010) [2023-12-26 15:05:56,705][123090] Updated weights for policy 1, policy_version 1929167 (0.0007) [2023-12-26 15:05:56,743][123091] Updated weights for policy 0, policy_version 1941290 (0.0010) [2023-12-26 15:05:56,751][123090] Updated weights for policy 1, policy_version 1929177 (0.0008) [2023-12-26 15:05:57,435][123091] Updated weights for policy 0, policy_version 1941300 (0.0008) [2023-12-26 15:05:57,447][123090] Updated weights for policy 1, policy_version 1929187 (0.0007) [2023-12-26 15:05:57,483][123091] Updated weights for policy 0, policy_version 1941310 (0.0005) [2023-12-26 15:05:57,496][123090] Updated weights for policy 1, policy_version 1929197 (0.0007) [2023-12-26 15:05:57,537][123091] Updated weights for policy 0, policy_version 1941320 (0.0005) [2023-12-26 15:05:57,546][123090] Updated weights for policy 1, policy_version 1929207 (0.0008) [2023-12-26 15:05:58,226][123091] Updated weights for policy 0, policy_version 1941330 (0.0006) [2023-12-26 15:05:58,292][123091] Updated weights for policy 0, policy_version 1941340 (0.0011) [2023-12-26 15:05:58,327][123090] Updated weights for policy 1, policy_version 1929217 (0.0009) [2023-12-26 15:05:58,363][123091] Updated weights for policy 0, policy_version 1941350 (0.0010) [2023-12-26 15:05:58,394][123090] Updated weights for policy 1, policy_version 1929227 (0.0009) [2023-12-26 15:05:58,433][123091] Updated weights for policy 0, policy_version 1941360 (0.0007) [2023-12-26 15:05:58,461][123090] Updated weights for policy 1, policy_version 1929237 (0.0009) [2023-12-26 15:05:58,536][123090] Updated weights for policy 1, policy_version 1929247 (0.0008) [2023-12-26 15:05:58,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 990879744. Throughput: 0: 8964.0, 1: 8804.1. Samples: 990870612. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:05:58,785][121949] Avg episode reward: [(0, '6431.542'), (1, '5794.874')] [2023-12-26 15:05:59,197][123091] Updated weights for policy 0, policy_version 1941370 (0.0006) [2023-12-26 15:05:59,264][123091] Updated weights for policy 0, policy_version 1941380 (0.0008) [2023-12-26 15:05:59,319][123091] Updated weights for policy 0, policy_version 1941390 (0.0006) [2023-12-26 15:05:59,429][123090] Updated weights for policy 1, policy_version 1929257 (0.0008) [2023-12-26 15:05:59,491][123090] Updated weights for policy 1, policy_version 1929267 (0.0008) [2023-12-26 15:05:59,555][123090] Updated weights for policy 1, policy_version 1929277 (0.0010) [2023-12-26 15:06:00,113][123091] Updated weights for policy 0, policy_version 1941400 (0.0009) [2023-12-26 15:06:00,177][123091] Updated weights for policy 0, policy_version 1941410 (0.0009) [2023-12-26 15:06:00,243][123091] Updated weights for policy 0, policy_version 1941420 (0.0009) [2023-12-26 15:06:00,355][123090] Updated weights for policy 1, policy_version 1929287 (0.0007) [2023-12-26 15:06:00,415][123090] Updated weights for policy 1, policy_version 1929297 (0.0005) [2023-12-26 15:06:00,475][123090] Updated weights for policy 1, policy_version 1929307 (0.0005) [2023-12-26 15:06:00,914][123091] Updated weights for policy 0, policy_version 1941430 (0.0008) [2023-12-26 15:06:00,962][123091] Updated weights for policy 0, policy_version 1941440 (0.0009) [2023-12-26 15:06:01,019][123091] Updated weights for policy 0, policy_version 1941450 (0.0009) [2023-12-26 15:06:01,179][123090] Updated weights for policy 1, policy_version 1929317 (0.0008) [2023-12-26 15:06:01,250][123090] Updated weights for policy 1, policy_version 1929327 (0.0010) [2023-12-26 15:06:01,317][123090] Updated weights for policy 1, policy_version 1929337 (0.0010) [2023-12-26 15:06:01,824][123091] Updated weights for policy 0, policy_version 1941460 (0.0008) [2023-12-26 15:06:01,876][123091] Updated weights for policy 0, policy_version 1941470 (0.0005) [2023-12-26 15:06:01,928][123091] Updated weights for policy 0, policy_version 1941480 (0.0005) [2023-12-26 15:06:02,091][123090] Updated weights for policy 1, policy_version 1929347 (0.0009) [2023-12-26 15:06:02,156][123090] Updated weights for policy 1, policy_version 1929357 (0.0009) [2023-12-26 15:06:02,219][123090] Updated weights for policy 1, policy_version 1929367 (0.0010) [2023-12-26 15:06:02,730][123091] Updated weights for policy 0, policy_version 1941490 (0.0007) [2023-12-26 15:06:02,796][123091] Updated weights for policy 0, policy_version 1941500 (0.0009) [2023-12-26 15:06:02,866][123091] Updated weights for policy 0, policy_version 1941510 (0.0010) [2023-12-26 15:06:02,940][123091] Updated weights for policy 0, policy_version 1941520 (0.0010) [2023-12-26 15:06:02,975][123090] Updated weights for policy 1, policy_version 1929377 (0.0009) [2023-12-26 15:06:03,045][123090] Updated weights for policy 1, policy_version 1929387 (0.0010) [2023-12-26 15:06:03,100][123090] Updated weights for policy 1, policy_version 1929397 (0.0010) [2023-12-26 15:06:03,147][123090] Updated weights for policy 1, policy_version 1929407 (0.0010) [2023-12-26 15:06:03,738][123091] Updated weights for policy 0, policy_version 1941530 (0.0009) [2023-12-26 15:06:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 990961664. Throughput: 0: 9041.9, 1: 8776.3. Samples: 990977520. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:03,784][121949] Avg episode reward: [(0, '6398.104'), (1, '5808.796')] [2023-12-26 15:06:03,791][123091] Updated weights for policy 0, policy_version 1941540 (0.0008) [2023-12-26 15:06:03,850][123091] Updated weights for policy 0, policy_version 1941550 (0.0009) [2023-12-26 15:06:03,973][123090] Updated weights for policy 1, policy_version 1929417 (0.0011) [2023-12-26 15:06:04,034][123090] Updated weights for policy 1, policy_version 1929427 (0.0011) [2023-12-26 15:06:04,096][123090] Updated weights for policy 1, policy_version 1929437 (0.0010) [2023-12-26 15:06:04,732][123091] Updated weights for policy 0, policy_version 1941560 (0.0009) [2023-12-26 15:06:04,793][123091] Updated weights for policy 0, policy_version 1941570 (0.0009) [2023-12-26 15:06:04,856][123091] Updated weights for policy 0, policy_version 1941580 (0.0008) [2023-12-26 15:06:04,937][123090] Updated weights for policy 1, policy_version 1929447 (0.0010) [2023-12-26 15:06:04,985][123090] Updated weights for policy 1, policy_version 1929457 (0.0010) [2023-12-26 15:06:05,033][123090] Updated weights for policy 1, policy_version 1929467 (0.0010) [2023-12-26 15:06:05,691][123091] Updated weights for policy 0, policy_version 1941590 (0.0009) [2023-12-26 15:06:05,746][123091] Updated weights for policy 0, policy_version 1941600 (0.0009) [2023-12-26 15:06:05,810][123091] Updated weights for policy 0, policy_version 1941610 (0.0006) [2023-12-26 15:06:05,875][123090] Updated weights for policy 1, policy_version 1929477 (0.0010) [2023-12-26 15:06:05,922][123090] Updated weights for policy 1, policy_version 1929487 (0.0010) [2023-12-26 15:06:05,974][123090] Updated weights for policy 1, policy_version 1929497 (0.0010) [2023-12-26 15:06:06,511][123091] Updated weights for policy 0, policy_version 1941620 (0.0005) [2023-12-26 15:06:06,573][123091] Updated weights for policy 0, policy_version 1941630 (0.0006) [2023-12-26 15:06:06,634][123091] Updated weights for policy 0, policy_version 1941640 (0.0006) [2023-12-26 15:06:06,825][123090] Updated weights for policy 1, policy_version 1929507 (0.0009) [2023-12-26 15:06:06,873][123090] Updated weights for policy 1, policy_version 1929517 (0.0006) [2023-12-26 15:06:06,922][123090] Updated weights for policy 1, policy_version 1929527 (0.0010) [2023-12-26 15:06:07,274][123091] Updated weights for policy 0, policy_version 1941650 (0.0006) [2023-12-26 15:06:07,338][123091] Updated weights for policy 0, policy_version 1941660 (0.0005) [2023-12-26 15:06:07,414][123091] Updated weights for policy 0, policy_version 1941670 (0.0005) [2023-12-26 15:06:07,484][123091] Updated weights for policy 0, policy_version 1941680 (0.0005) [2023-12-26 15:06:07,749][123090] Updated weights for policy 1, policy_version 1929537 (0.0010) [2023-12-26 15:06:07,801][123090] Updated weights for policy 1, policy_version 1929547 (0.0010) [2023-12-26 15:06:07,852][123090] Updated weights for policy 1, policy_version 1929557 (0.0010) [2023-12-26 15:06:07,899][123090] Updated weights for policy 1, policy_version 1929567 (0.0010) [2023-12-26 15:06:08,079][123091] Updated weights for policy 0, policy_version 1941690 (0.0005) [2023-12-26 15:06:08,148][123091] Updated weights for policy 0, policy_version 1941700 (0.0005) [2023-12-26 15:06:08,225][123091] Updated weights for policy 0, policy_version 1941710 (0.0005) [2023-12-26 15:06:08,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 991051776. Throughput: 0: 9061.4, 1: 8798.3. Samples: 991029912. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:08,784][121949] Avg episode reward: [(0, '6386.963'), (1, '5907.086')] [2023-12-26 15:06:08,786][123090] Updated weights for policy 1, policy_version 1929577 (0.0010) [2023-12-26 15:06:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001941712_497082368.pth... [2023-12-26 15:06:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001940656_496812032.pth [2023-12-26 15:06:08,857][123090] Updated weights for policy 1, policy_version 1929587 (0.0010) [2023-12-26 15:06:08,859][123091] Updated weights for policy 0, policy_version 1941720 (0.0006) [2023-12-26 15:06:08,918][123091] Updated weights for policy 0, policy_version 1941730 (0.0009) [2023-12-26 15:06:08,920][123090] Updated weights for policy 1, policy_version 1929597 (0.0011) [2023-12-26 15:06:08,936][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001929600_493977600.pth... [2023-12-26 15:06:08,942][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001928576_493715456.pth [2023-12-26 15:06:08,983][123091] Updated weights for policy 0, policy_version 1941740 (0.0009) [2023-12-26 15:06:09,768][123090] Updated weights for policy 1, policy_version 1929607 (0.0011) [2023-12-26 15:06:09,795][123091] Updated weights for policy 0, policy_version 1941750 (0.0008) [2023-12-26 15:06:09,835][123090] Updated weights for policy 1, policy_version 1929617 (0.0010) [2023-12-26 15:06:09,867][123091] Updated weights for policy 0, policy_version 1941760 (0.0008) [2023-12-26 15:06:09,914][123090] Updated weights for policy 1, policy_version 1929627 (0.0009) [2023-12-26 15:06:09,940][123091] Updated weights for policy 0, policy_version 1941770 (0.0007) [2023-12-26 15:06:10,748][123090] Updated weights for policy 1, policy_version 1929637 (0.0009) [2023-12-26 15:06:10,767][123091] Updated weights for policy 0, policy_version 1941780 (0.0009) [2023-12-26 15:06:10,806][123090] Updated weights for policy 1, policy_version 1929648 (0.0009) [2023-12-26 15:06:10,834][123091] Updated weights for policy 0, policy_version 1941790 (0.0009) [2023-12-26 15:06:10,866][123090] Updated weights for policy 1, policy_version 1929658 (0.0007) [2023-12-26 15:06:10,894][123091] Updated weights for policy 0, policy_version 1941800 (0.0009) [2023-12-26 15:06:11,718][123090] Updated weights for policy 1, policy_version 1929668 (0.0008) [2023-12-26 15:06:11,753][123091] Updated weights for policy 0, policy_version 1941810 (0.0008) [2023-12-26 15:06:11,787][123090] Updated weights for policy 1, policy_version 1929678 (0.0009) [2023-12-26 15:06:11,806][123091] Updated weights for policy 0, policy_version 1941820 (0.0006) [2023-12-26 15:06:11,841][123090] Updated weights for policy 1, policy_version 1929688 (0.0009) [2023-12-26 15:06:11,867][123091] Updated weights for policy 0, policy_version 1941830 (0.0006) [2023-12-26 15:06:11,928][123091] Updated weights for policy 0, policy_version 1941840 (0.0009) [2023-12-26 15:06:12,684][123090] Updated weights for policy 1, policy_version 1929698 (0.0008) [2023-12-26 15:06:12,737][123091] Updated weights for policy 0, policy_version 1941850 (0.0008) [2023-12-26 15:06:12,739][123090] Updated weights for policy 1, policy_version 1929708 (0.0005) [2023-12-26 15:06:12,798][123091] Updated weights for policy 0, policy_version 1941860 (0.0009) [2023-12-26 15:06:12,802][123090] Updated weights for policy 1, policy_version 1929718 (0.0006) [2023-12-26 15:06:12,858][123091] Updated weights for policy 0, policy_version 1941870 (0.0009) [2023-12-26 15:06:12,874][123090] Updated weights for policy 1, policy_version 1929728 (0.0005) [2023-12-26 15:06:13,563][123090] Updated weights for policy 1, policy_version 1929738 (0.0005) [2023-12-26 15:06:13,574][123091] Updated weights for policy 0, policy_version 1941880 (0.0006) [2023-12-26 15:06:13,631][123091] Updated weights for policy 0, policy_version 1941890 (0.0005) [2023-12-26 15:06:13,633][123090] Updated weights for policy 1, policy_version 1929748 (0.0005) [2023-12-26 15:06:13,703][123091] Updated weights for policy 0, policy_version 1941900 (0.0005) [2023-12-26 15:06:13,708][123090] Updated weights for policy 1, policy_version 1929758 (0.0006) [2023-12-26 15:06:13,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 991150080. Throughput: 0: 9181.2, 1: 8610.5. Samples: 991135820. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:13,785][121949] Avg episode reward: [(0, '6419.983'), (1, '5883.933')] [2023-12-26 15:06:14,292][123090] Updated weights for policy 1, policy_version 1929768 (0.0005) [2023-12-26 15:06:14,341][123090] Updated weights for policy 1, policy_version 1929778 (0.0005) [2023-12-26 15:06:14,384][123091] Updated weights for policy 0, policy_version 1941910 (0.0006) [2023-12-26 15:06:14,406][123090] Updated weights for policy 1, policy_version 1929788 (0.0006) [2023-12-26 15:06:14,451][123091] Updated weights for policy 0, policy_version 1941920 (0.0006) [2023-12-26 15:06:14,529][123091] Updated weights for policy 0, policy_version 1941930 (0.0006) [2023-12-26 15:06:15,167][123090] Updated weights for policy 1, policy_version 1929798 (0.0008) [2023-12-26 15:06:15,221][123090] Updated weights for policy 1, policy_version 1929808 (0.0009) [2023-12-26 15:06:15,283][123090] Updated weights for policy 1, policy_version 1929818 (0.0009) [2023-12-26 15:06:15,311][123091] Updated weights for policy 0, policy_version 1941940 (0.0007) [2023-12-26 15:06:15,373][123091] Updated weights for policy 0, policy_version 1941950 (0.0008) [2023-12-26 15:06:15,425][123091] Updated weights for policy 0, policy_version 1941960 (0.0010) [2023-12-26 15:06:16,048][123090] Updated weights for policy 1, policy_version 1929828 (0.0007) [2023-12-26 15:06:16,104][123090] Updated weights for policy 1, policy_version 1929838 (0.0006) [2023-12-26 15:06:16,160][123091] Updated weights for policy 0, policy_version 1941970 (0.0010) [2023-12-26 15:06:16,165][123090] Updated weights for policy 1, policy_version 1929848 (0.0007) [2023-12-26 15:06:16,211][123091] Updated weights for policy 0, policy_version 1941980 (0.0010) [2023-12-26 15:06:16,258][123091] Updated weights for policy 0, policy_version 1941990 (0.0010) [2023-12-26 15:06:16,305][123091] Updated weights for policy 0, policy_version 1942000 (0.0010) [2023-12-26 15:06:16,916][123090] Updated weights for policy 1, policy_version 1929858 (0.0010) [2023-12-26 15:06:16,988][123090] Updated weights for policy 1, policy_version 1929868 (0.0007) [2023-12-26 15:06:17,014][123091] Updated weights for policy 0, policy_version 1942010 (0.0009) [2023-12-26 15:06:17,044][123090] Updated weights for policy 1, policy_version 1929878 (0.0005) [2023-12-26 15:06:17,070][123091] Updated weights for policy 0, policy_version 1942020 (0.0009) [2023-12-26 15:06:17,101][123090] Updated weights for policy 1, policy_version 1929888 (0.0009) [2023-12-26 15:06:17,128][123091] Updated weights for policy 0, policy_version 1942030 (0.0010) [2023-12-26 15:06:17,887][123090] Updated weights for policy 1, policy_version 1929898 (0.0005) [2023-12-26 15:06:17,935][123090] Updated weights for policy 1, policy_version 1929908 (0.0005) [2023-12-26 15:06:17,993][123090] Updated weights for policy 1, policy_version 1929918 (0.0005) [2023-12-26 15:06:17,994][123091] Updated weights for policy 0, policy_version 1942040 (0.0008) [2023-12-26 15:06:18,047][123091] Updated weights for policy 0, policy_version 1942050 (0.0009) [2023-12-26 15:06:18,101][123091] Updated weights for policy 0, policy_version 1942061 (0.0010) [2023-12-26 15:06:18,757][123090] Updated weights for policy 1, policy_version 1929928 (0.0006) [2023-12-26 15:06:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 991232000. Throughput: 0: 9166.4, 1: 8731.7. Samples: 991248908. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:18,785][121949] Avg episode reward: [(0, '6468.087'), (1, '5951.359')] [2023-12-26 15:06:18,824][123090] Updated weights for policy 1, policy_version 1929938 (0.0005) [2023-12-26 15:06:18,896][123090] Updated weights for policy 1, policy_version 1929948 (0.0011) [2023-12-26 15:06:18,908][123091] Updated weights for policy 0, policy_version 1942072 (0.0007) [2023-12-26 15:06:18,966][123091] Updated weights for policy 0, policy_version 1942082 (0.0009) [2023-12-26 15:06:19,014][123091] Updated weights for policy 0, policy_version 1942092 (0.0008) [2023-12-26 15:06:19,685][123090] Updated weights for policy 1, policy_version 1929958 (0.0011) [2023-12-26 15:06:19,757][123090] Updated weights for policy 1, policy_version 1929968 (0.0011) [2023-12-26 15:06:19,822][123090] Updated weights for policy 1, policy_version 1929978 (0.0011) [2023-12-26 15:06:19,864][123091] Updated weights for policy 0, policy_version 1942102 (0.0008) [2023-12-26 15:06:19,940][123091] Updated weights for policy 0, policy_version 1942112 (0.0007) [2023-12-26 15:06:20,002][123091] Updated weights for policy 0, policy_version 1942122 (0.0009) [2023-12-26 15:06:20,686][123090] Updated weights for policy 1, policy_version 1929988 (0.0009) [2023-12-26 15:06:20,755][123090] Updated weights for policy 1, policy_version 1929998 (0.0010) [2023-12-26 15:06:20,817][123090] Updated weights for policy 1, policy_version 1930008 (0.0010) [2023-12-26 15:06:20,834][123091] Updated weights for policy 0, policy_version 1942132 (0.0009) [2023-12-26 15:06:20,894][123091] Updated weights for policy 0, policy_version 1942142 (0.0008) [2023-12-26 15:06:20,958][123091] Updated weights for policy 0, policy_version 1942152 (0.0009) [2023-12-26 15:06:21,701][123090] Updated weights for policy 1, policy_version 1930018 (0.0009) [2023-12-26 15:06:21,772][123090] Updated weights for policy 1, policy_version 1930028 (0.0009) [2023-12-26 15:06:21,809][123091] Updated weights for policy 0, policy_version 1942162 (0.0010) [2023-12-26 15:06:21,835][123090] Updated weights for policy 1, policy_version 1930038 (0.0010) [2023-12-26 15:06:21,876][123091] Updated weights for policy 0, policy_version 1942172 (0.0011) [2023-12-26 15:06:21,896][123090] Updated weights for policy 1, policy_version 1930048 (0.0007) [2023-12-26 15:06:21,939][123091] Updated weights for policy 0, policy_version 1942182 (0.0010) [2023-12-26 15:06:22,013][123091] Updated weights for policy 0, policy_version 1942192 (0.0011) [2023-12-26 15:06:22,740][123090] Updated weights for policy 1, policy_version 1930058 (0.0010) [2023-12-26 15:06:22,808][123090] Updated weights for policy 1, policy_version 1930068 (0.0009) [2023-12-26 15:06:22,843][123091] Updated weights for policy 0, policy_version 1942202 (0.0009) [2023-12-26 15:06:22,867][123090] Updated weights for policy 1, policy_version 1930078 (0.0008) [2023-12-26 15:06:22,909][123091] Updated weights for policy 0, policy_version 1942212 (0.0009) [2023-12-26 15:06:22,964][123091] Updated weights for policy 0, policy_version 1942222 (0.0009) [2023-12-26 15:06:23,738][123091] Updated weights for policy 0, policy_version 1942232 (0.0009) [2023-12-26 15:06:23,748][123090] Updated weights for policy 1, policy_version 1930088 (0.0009) [2023-12-26 15:06:23,784][121949] Fps is (10 sec: 16383.7, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 991313920. Throughput: 0: 9079.8, 1: 8747.8. Samples: 991299156. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:23,785][123091] Updated weights for policy 0, policy_version 1942242 (0.0009) [2023-12-26 15:06:23,785][121949] Avg episode reward: [(0, '6341.523'), (1, '6002.433')] [2023-12-26 15:06:23,812][123090] Updated weights for policy 1, policy_version 1930098 (0.0008) [2023-12-26 15:06:23,840][123091] Updated weights for policy 0, policy_version 1942252 (0.0009) [2023-12-26 15:06:23,860][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001942256_497221632.pth... [2023-12-26 15:06:23,863][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001941168_496943104.pth [2023-12-26 15:06:23,873][123090] Updated weights for policy 1, policy_version 1930108 (0.0007) [2023-12-26 15:06:23,897][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001930112_494108672.pth... [2023-12-26 15:06:23,902][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001929056_493838336.pth [2023-12-26 15:06:24,468][123090] Updated weights for policy 1, policy_version 1930118 (0.0005) [2023-12-26 15:06:24,522][123090] Updated weights for policy 1, policy_version 1930128 (0.0005) [2023-12-26 15:06:24,574][123090] Updated weights for policy 1, policy_version 1930138 (0.0005) [2023-12-26 15:06:24,635][123091] Updated weights for policy 0, policy_version 1942262 (0.0009) [2023-12-26 15:06:24,695][123091] Updated weights for policy 0, policy_version 1942272 (0.0010) [2023-12-26 15:06:24,768][123091] Updated weights for policy 0, policy_version 1942282 (0.0011) [2023-12-26 15:06:25,236][123090] Updated weights for policy 1, policy_version 1930148 (0.0006) [2023-12-26 15:06:25,296][123090] Updated weights for policy 1, policy_version 1930158 (0.0007) [2023-12-26 15:06:25,350][123090] Updated weights for policy 1, policy_version 1930169 (0.0010) [2023-12-26 15:06:25,540][123091] Updated weights for policy 0, policy_version 1942292 (0.0010) [2023-12-26 15:06:25,592][123091] Updated weights for policy 0, policy_version 1942302 (0.0010) [2023-12-26 15:06:25,639][123091] Updated weights for policy 0, policy_version 1942312 (0.0010) [2023-12-26 15:06:26,084][123090] Updated weights for policy 1, policy_version 1930179 (0.0008) [2023-12-26 15:06:26,138][123090] Updated weights for policy 1, policy_version 1930189 (0.0005) [2023-12-26 15:06:26,191][123090] Updated weights for policy 1, policy_version 1930199 (0.0005) [2023-12-26 15:06:26,464][123091] Updated weights for policy 0, policy_version 1942322 (0.0010) [2023-12-26 15:06:26,522][123091] Updated weights for policy 0, policy_version 1942332 (0.0010) [2023-12-26 15:06:26,576][123091] Updated weights for policy 0, policy_version 1942342 (0.0010) [2023-12-26 15:06:26,630][123091] Updated weights for policy 0, policy_version 1942352 (0.0010) [2023-12-26 15:06:26,973][123090] Updated weights for policy 1, policy_version 1930209 (0.0008) [2023-12-26 15:06:27,035][123090] Updated weights for policy 1, policy_version 1930219 (0.0008) [2023-12-26 15:06:27,083][123090] Updated weights for policy 1, policy_version 1930229 (0.0008) [2023-12-26 15:06:27,134][123090] Updated weights for policy 1, policy_version 1930239 (0.0008) [2023-12-26 15:06:27,443][123091] Updated weights for policy 0, policy_version 1942362 (0.0010) [2023-12-26 15:06:27,490][123091] Updated weights for policy 0, policy_version 1942372 (0.0010) [2023-12-26 15:06:27,544][123091] Updated weights for policy 0, policy_version 1942382 (0.0010) [2023-12-26 15:06:27,909][123090] Updated weights for policy 1, policy_version 1930249 (0.0006) [2023-12-26 15:06:27,957][123090] Updated weights for policy 1, policy_version 1930259 (0.0005) [2023-12-26 15:06:28,013][123090] Updated weights for policy 1, policy_version 1930269 (0.0008) [2023-12-26 15:06:28,397][123091] Updated weights for policy 0, policy_version 1942392 (0.0010) [2023-12-26 15:06:28,462][123091] Updated weights for policy 0, policy_version 1942402 (0.0010) [2023-12-26 15:06:28,516][123091] Updated weights for policy 0, policy_version 1942412 (0.0010) [2023-12-26 15:06:28,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 991412224. Throughput: 0: 9025.5, 1: 8897.7. Samples: 991406988. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:28,785][121949] Avg episode reward: [(0, '6250.755'), (1, '5914.100')] [2023-12-26 15:06:28,790][123090] Updated weights for policy 1, policy_version 1930279 (0.0010) [2023-12-26 15:06:28,849][123090] Updated weights for policy 1, policy_version 1930289 (0.0010) [2023-12-26 15:06:28,916][123090] Updated weights for policy 1, policy_version 1930299 (0.0010) [2023-12-26 15:06:29,357][123091] Updated weights for policy 0, policy_version 1942422 (0.0011) [2023-12-26 15:06:29,411][123091] Updated weights for policy 0, policy_version 1942432 (0.0010) [2023-12-26 15:06:29,462][123091] Updated weights for policy 0, policy_version 1942442 (0.0010) [2023-12-26 15:06:29,656][123090] Updated weights for policy 1, policy_version 1930309 (0.0010) [2023-12-26 15:06:29,722][123090] Updated weights for policy 1, policy_version 1930319 (0.0010) [2023-12-26 15:06:29,783][123090] Updated weights for policy 1, policy_version 1930329 (0.0010) [2023-12-26 15:06:30,300][123091] Updated weights for policy 0, policy_version 1942452 (0.0010) [2023-12-26 15:06:30,363][123091] Updated weights for policy 0, policy_version 1942462 (0.0011) [2023-12-26 15:06:30,414][123091] Updated weights for policy 0, policy_version 1942472 (0.0010) [2023-12-26 15:06:30,565][123090] Updated weights for policy 1, policy_version 1930339 (0.0009) [2023-12-26 15:06:30,632][123090] Updated weights for policy 1, policy_version 1930349 (0.0009) [2023-12-26 15:06:30,684][123090] Updated weights for policy 1, policy_version 1930359 (0.0011) [2023-12-26 15:06:31,245][123091] Updated weights for policy 0, policy_version 1942482 (0.0010) [2023-12-26 15:06:31,302][123091] Updated weights for policy 0, policy_version 1942492 (0.0009) [2023-12-26 15:06:31,362][123091] Updated weights for policy 0, policy_version 1942502 (0.0010) [2023-12-26 15:06:31,422][123091] Updated weights for policy 0, policy_version 1942512 (0.0007) [2023-12-26 15:06:31,507][123090] Updated weights for policy 1, policy_version 1930369 (0.0010) [2023-12-26 15:06:31,556][123090] Updated weights for policy 1, policy_version 1930379 (0.0008) [2023-12-26 15:06:31,609][123090] Updated weights for policy 1, policy_version 1930389 (0.0005) [2023-12-26 15:06:31,678][123090] Updated weights for policy 1, policy_version 1930399 (0.0007) [2023-12-26 15:06:32,309][123091] Updated weights for policy 0, policy_version 1942522 (0.0009) [2023-12-26 15:06:32,374][123091] Updated weights for policy 0, policy_version 1942532 (0.0008) [2023-12-26 15:06:32,378][123090] Updated weights for policy 1, policy_version 1930409 (0.0010) [2023-12-26 15:06:32,441][123091] Updated weights for policy 0, policy_version 1942542 (0.0010) [2023-12-26 15:06:32,447][123090] Updated weights for policy 1, policy_version 1930419 (0.0006) [2023-12-26 15:06:32,505][123090] Updated weights for policy 1, policy_version 1930429 (0.0006) [2023-12-26 15:06:33,164][123090] Updated weights for policy 1, policy_version 1930439 (0.0005) [2023-12-26 15:06:33,224][123090] Updated weights for policy 1, policy_version 1930449 (0.0005) [2023-12-26 15:06:33,267][123090] Updated weights for policy 1, policy_version 1930459 (0.0005) [2023-12-26 15:06:33,332][123091] Updated weights for policy 0, policy_version 1942552 (0.0009) [2023-12-26 15:06:33,389][123091] Updated weights for policy 0, policy_version 1942562 (0.0008) [2023-12-26 15:06:33,447][123091] Updated weights for policy 0, policy_version 1942572 (0.0009) [2023-12-26 15:06:33,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 991502336. Throughput: 0: 8924.7, 1: 8951.8. Samples: 991513324. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:33,785][121949] Avg episode reward: [(0, '6308.759'), (1, '5636.621')] [2023-12-26 15:06:33,948][123090] Updated weights for policy 1, policy_version 1930469 (0.0005) [2023-12-26 15:06:33,997][123090] Updated weights for policy 1, policy_version 1930479 (0.0008) [2023-12-26 15:06:34,048][123090] Updated weights for policy 1, policy_version 1930489 (0.0008) [2023-12-26 15:06:34,365][123091] Updated weights for policy 0, policy_version 1942582 (0.0010) [2023-12-26 15:06:34,424][123091] Updated weights for policy 0, policy_version 1942592 (0.0010) [2023-12-26 15:06:34,484][123091] Updated weights for policy 0, policy_version 1942602 (0.0010) [2023-12-26 15:06:34,919][123090] Updated weights for policy 1, policy_version 1930499 (0.0009) [2023-12-26 15:06:34,973][123090] Updated weights for policy 1, policy_version 1930509 (0.0010) [2023-12-26 15:06:35,038][123090] Updated weights for policy 1, policy_version 1930519 (0.0008) [2023-12-26 15:06:35,306][123091] Updated weights for policy 0, policy_version 1942612 (0.0010) [2023-12-26 15:06:35,369][123091] Updated weights for policy 0, policy_version 1942622 (0.0010) [2023-12-26 15:06:35,436][123091] Updated weights for policy 0, policy_version 1942632 (0.0010) [2023-12-26 15:06:35,738][123090] Updated weights for policy 1, policy_version 1930529 (0.0008) [2023-12-26 15:06:35,791][123090] Updated weights for policy 1, policy_version 1930539 (0.0009) [2023-12-26 15:06:35,839][123090] Updated weights for policy 1, policy_version 1930549 (0.0008) [2023-12-26 15:06:35,899][123090] Updated weights for policy 1, policy_version 1930559 (0.0009) [2023-12-26 15:06:36,231][123091] Updated weights for policy 0, policy_version 1942642 (0.0011) [2023-12-26 15:06:36,284][123091] Updated weights for policy 0, policy_version 1942652 (0.0008) [2023-12-26 15:06:36,344][123091] Updated weights for policy 0, policy_version 1942662 (0.0009) [2023-12-26 15:06:36,400][123091] Updated weights for policy 0, policy_version 1942672 (0.0010) [2023-12-26 15:06:36,795][123090] Updated weights for policy 1, policy_version 1930569 (0.0008) [2023-12-26 15:06:36,855][123090] Updated weights for policy 1, policy_version 1930579 (0.0009) [2023-12-26 15:06:36,931][123090] Updated weights for policy 1, policy_version 1930589 (0.0009) [2023-12-26 15:06:37,210][123091] Updated weights for policy 0, policy_version 1942682 (0.0010) [2023-12-26 15:06:37,279][123091] Updated weights for policy 0, policy_version 1942692 (0.0011) [2023-12-26 15:06:37,342][123091] Updated weights for policy 0, policy_version 1942702 (0.0011) [2023-12-26 15:06:37,805][123090] Updated weights for policy 1, policy_version 1930599 (0.0008) [2023-12-26 15:06:37,857][123090] Updated weights for policy 1, policy_version 1930609 (0.0009) [2023-12-26 15:06:37,913][123090] Updated weights for policy 1, policy_version 1930619 (0.0009) [2023-12-26 15:06:38,086][123091] Updated weights for policy 0, policy_version 1942712 (0.0008) [2023-12-26 15:06:38,150][123091] Updated weights for policy 0, policy_version 1942722 (0.0008) [2023-12-26 15:06:38,203][123091] Updated weights for policy 0, policy_version 1942732 (0.0006) [2023-12-26 15:06:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 991584256. Throughput: 0: 8903.2, 1: 9015.4. Samples: 991565688. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:38,784][121949] Avg episode reward: [(0, '6399.286'), (1, '5734.875')] [2023-12-26 15:06:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001942736_497344512.pth... [2023-12-26 15:06:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001941712_497082368.pth [2023-12-26 15:06:38,801][123090] Updated weights for policy 1, policy_version 1930629 (0.0009) [2023-12-26 15:06:38,851][123090] Updated weights for policy 1, policy_version 1930639 (0.0009) [2023-12-26 15:06:38,905][123090] Updated weights for policy 1, policy_version 1930649 (0.0010) [2023-12-26 15:06:38,942][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001930656_494247936.pth... [2023-12-26 15:06:38,945][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001929600_493977600.pth [2023-12-26 15:06:38,966][123091] Updated weights for policy 0, policy_version 1942742 (0.0008) [2023-12-26 15:06:39,020][123091] Updated weights for policy 0, policy_version 1942752 (0.0009) [2023-12-26 15:06:39,067][123091] Updated weights for policy 0, policy_version 1942762 (0.0009) [2023-12-26 15:06:39,741][123090] Updated weights for policy 1, policy_version 1930659 (0.0009) [2023-12-26 15:06:39,807][123090] Updated weights for policy 1, policy_version 1930669 (0.0010) [2023-12-26 15:06:39,871][123090] Updated weights for policy 1, policy_version 1930679 (0.0008) [2023-12-26 15:06:39,972][123091] Updated weights for policy 0, policy_version 1942772 (0.0009) [2023-12-26 15:06:40,033][123091] Updated weights for policy 0, policy_version 1942783 (0.0010) [2023-12-26 15:06:40,102][123091] Updated weights for policy 0, policy_version 1942793 (0.0009) [2023-12-26 15:06:40,671][123090] Updated weights for policy 1, policy_version 1930689 (0.0008) [2023-12-26 15:06:40,738][123090] Updated weights for policy 1, policy_version 1930699 (0.0010) [2023-12-26 15:06:40,805][123090] Updated weights for policy 1, policy_version 1930709 (0.0010) [2023-12-26 15:06:40,861][123090] Updated weights for policy 1, policy_version 1930719 (0.0010) [2023-12-26 15:06:40,961][123091] Updated weights for policy 0, policy_version 1942803 (0.0009) [2023-12-26 15:06:41,038][123091] Updated weights for policy 0, policy_version 1942813 (0.0009) [2023-12-26 15:06:41,109][123091] Updated weights for policy 0, policy_version 1942823 (0.0009) [2023-12-26 15:06:41,723][123090] Updated weights for policy 1, policy_version 1930729 (0.0011) [2023-12-26 15:06:41,801][123090] Updated weights for policy 1, policy_version 1930739 (0.0008) [2023-12-26 15:06:41,860][123090] Updated weights for policy 1, policy_version 1930749 (0.0006) [2023-12-26 15:06:41,953][123091] Updated weights for policy 0, policy_version 1942833 (0.0008) [2023-12-26 15:06:42,015][123091] Updated weights for policy 0, policy_version 1942843 (0.0005) [2023-12-26 15:06:42,086][123091] Updated weights for policy 0, policy_version 1942853 (0.0006) [2023-12-26 15:06:42,148][123091] Updated weights for policy 0, policy_version 1942863 (0.0006) [2023-12-26 15:06:42,637][123090] Updated weights for policy 1, policy_version 1930759 (0.0008) [2023-12-26 15:06:42,703][123090] Updated weights for policy 1, policy_version 1930769 (0.0009) [2023-12-26 15:06:42,759][123090] Updated weights for policy 1, policy_version 1930779 (0.0009) [2023-12-26 15:06:42,962][123091] Updated weights for policy 0, policy_version 1942873 (0.0009) [2023-12-26 15:06:43,023][123091] Updated weights for policy 0, policy_version 1942883 (0.0009) [2023-12-26 15:06:43,082][123091] Updated weights for policy 0, policy_version 1942893 (0.0009) [2023-12-26 15:06:43,590][123090] Updated weights for policy 1, policy_version 1930789 (0.0009) [2023-12-26 15:06:43,638][123090] Updated weights for policy 1, policy_version 1930799 (0.0009) [2023-12-26 15:06:43,696][123090] Updated weights for policy 1, policy_version 1930809 (0.0009) [2023-12-26 15:06:43,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 991674368. Throughput: 0: 8812.8, 1: 8905.6. Samples: 991667940. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:43,785][121949] Avg episode reward: [(0, '6384.089'), (1, '5899.125')] [2023-12-26 15:06:43,856][123091] Updated weights for policy 0, policy_version 1942903 (0.0009) [2023-12-26 15:06:43,921][123091] Updated weights for policy 0, policy_version 1942913 (0.0008) [2023-12-26 15:06:43,999][123091] Updated weights for policy 0, policy_version 1942923 (0.0010) [2023-12-26 15:06:44,582][123090] Updated weights for policy 1, policy_version 1930819 (0.0009) [2023-12-26 15:06:44,633][123090] Updated weights for policy 1, policy_version 1930829 (0.0010) [2023-12-26 15:06:44,691][123090] Updated weights for policy 1, policy_version 1930839 (0.0010) [2023-12-26 15:06:44,707][123091] Updated weights for policy 0, policy_version 1942933 (0.0007) [2023-12-26 15:06:44,765][123091] Updated weights for policy 0, policy_version 1942943 (0.0006) [2023-12-26 15:06:44,832][123091] Updated weights for policy 0, policy_version 1942953 (0.0010) [2023-12-26 15:06:45,446][123090] Updated weights for policy 1, policy_version 1930849 (0.0010) [2023-12-26 15:06:45,517][123090] Updated weights for policy 1, policy_version 1930859 (0.0011) [2023-12-26 15:06:45,545][123091] Updated weights for policy 0, policy_version 1942963 (0.0011) [2023-12-26 15:06:45,582][123090] Updated weights for policy 1, policy_version 1930869 (0.0011) [2023-12-26 15:06:45,611][123091] Updated weights for policy 0, policy_version 1942973 (0.0009) [2023-12-26 15:06:45,644][123090] Updated weights for policy 1, policy_version 1930879 (0.0011) [2023-12-26 15:06:45,674][123091] Updated weights for policy 0, policy_version 1942983 (0.0006) [2023-12-26 15:06:46,304][123090] Updated weights for policy 1, policy_version 1930889 (0.0006) [2023-12-26 15:06:46,359][123090] Updated weights for policy 1, policy_version 1930899 (0.0005) [2023-12-26 15:06:46,360][123091] Updated weights for policy 0, policy_version 1942993 (0.0006) [2023-12-26 15:06:46,414][123090] Updated weights for policy 1, policy_version 1930909 (0.0005) [2023-12-26 15:06:46,431][123091] Updated weights for policy 0, policy_version 1943003 (0.0005) [2023-12-26 15:06:46,482][123091] Updated weights for policy 0, policy_version 1943013 (0.0005) [2023-12-26 15:06:46,534][123091] Updated weights for policy 0, policy_version 1943023 (0.0005) [2023-12-26 15:06:47,058][123090] Updated weights for policy 1, policy_version 1930919 (0.0009) [2023-12-26 15:06:47,113][123090] Updated weights for policy 1, policy_version 1930929 (0.0010) [2023-12-26 15:06:47,181][123090] Updated weights for policy 1, policy_version 1930939 (0.0011) [2023-12-26 15:06:47,256][123091] Updated weights for policy 0, policy_version 1943033 (0.0007) [2023-12-26 15:06:47,310][123091] Updated weights for policy 0, policy_version 1943043 (0.0006) [2023-12-26 15:06:47,379][123091] Updated weights for policy 0, policy_version 1943053 (0.0006) [2023-12-26 15:06:47,952][123090] Updated weights for policy 1, policy_version 1930949 (0.0010) [2023-12-26 15:06:47,983][123091] Updated weights for policy 0, policy_version 1943063 (0.0009) [2023-12-26 15:06:48,004][123090] Updated weights for policy 1, policy_version 1930959 (0.0010) [2023-12-26 15:06:48,040][123091] Updated weights for policy 0, policy_version 1943073 (0.0011) [2023-12-26 15:06:48,052][123090] Updated weights for policy 1, policy_version 1930969 (0.0010) [2023-12-26 15:06:48,094][123091] Updated weights for policy 0, policy_version 1943083 (0.0008) [2023-12-26 15:06:48,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 991764480. Throughput: 0: 8896.2, 1: 8954.1. Samples: 991780788. Policy #0 lag: (min: 31.0, avg: 31.0, max: 31.0) [2023-12-26 15:06:48,785][121949] Avg episode reward: [(0, '6365.442'), (1, '5812.862')] [2023-12-26 15:06:48,794][123090] Updated weights for policy 1, policy_version 1930979 (0.0009) [2023-12-26 15:06:48,830][123091] Updated weights for policy 0, policy_version 1943093 (0.0005) [2023-12-26 15:06:48,861][123090] Updated weights for policy 1, policy_version 1930989 (0.0011) [2023-12-26 15:06:48,898][123091] Updated weights for policy 0, policy_version 1943103 (0.0006) [2023-12-26 15:06:48,925][123090] Updated weights for policy 1, policy_version 1930999 (0.0011) [2023-12-26 15:06:48,967][123091] Updated weights for policy 0, policy_version 1943113 (0.0010) [2023-12-26 15:06:49,677][123091] Updated weights for policy 0, policy_version 1943123 (0.0010) [2023-12-26 15:06:49,729][123091] Updated weights for policy 0, policy_version 1943133 (0.0010) [2023-12-26 15:06:49,735][123090] Updated weights for policy 1, policy_version 1931009 (0.0010) [2023-12-26 15:06:49,795][123091] Updated weights for policy 0, policy_version 1943143 (0.0011) [2023-12-26 15:06:49,803][123090] Updated weights for policy 1, policy_version 1931019 (0.0011) [2023-12-26 15:06:49,870][123090] Updated weights for policy 1, policy_version 1931029 (0.0010) [2023-12-26 15:06:49,945][123090] Updated weights for policy 1, policy_version 1931039 (0.0009) [2023-12-26 15:06:50,563][123091] Updated weights for policy 0, policy_version 1943153 (0.0010) [2023-12-26 15:06:50,621][123091] Updated weights for policy 0, policy_version 1943163 (0.0007) [2023-12-26 15:06:50,677][123091] Updated weights for policy 0, policy_version 1943173 (0.0005) [2023-12-26 15:06:50,741][123091] Updated weights for policy 0, policy_version 1943183 (0.0006) [2023-12-26 15:06:50,852][123090] Updated weights for policy 1, policy_version 1931049 (0.0009) [2023-12-26 15:06:50,926][123090] Updated weights for policy 1, policy_version 1931059 (0.0010) [2023-12-26 15:06:50,999][123090] Updated weights for policy 1, policy_version 1931069 (0.0010) [2023-12-26 15:06:51,552][123091] Updated weights for policy 0, policy_version 1943193 (0.0009) [2023-12-26 15:06:51,619][123091] Updated weights for policy 0, policy_version 1943203 (0.0009) [2023-12-26 15:06:51,683][123091] Updated weights for policy 0, policy_version 1943213 (0.0007) [2023-12-26 15:06:51,856][123090] Updated weights for policy 1, policy_version 1931079 (0.0010) [2023-12-26 15:06:51,914][123090] Updated weights for policy 1, policy_version 1931089 (0.0010) [2023-12-26 15:06:51,980][123090] Updated weights for policy 1, policy_version 1931099 (0.0009) [2023-12-26 15:06:52,496][123091] Updated weights for policy 0, policy_version 1943223 (0.0009) [2023-12-26 15:06:52,560][123091] Updated weights for policy 0, policy_version 1943233 (0.0008) [2023-12-26 15:06:52,621][123091] Updated weights for policy 0, policy_version 1943243 (0.0008) [2023-12-26 15:06:52,842][123090] Updated weights for policy 1, policy_version 1931109 (0.0009) [2023-12-26 15:06:52,901][123090] Updated weights for policy 1, policy_version 1931119 (0.0009) [2023-12-26 15:06:52,959][123090] Updated weights for policy 1, policy_version 1931129 (0.0010) [2023-12-26 15:06:53,403][123091] Updated weights for policy 0, policy_version 1943253 (0.0009) [2023-12-26 15:06:53,453][123091] Updated weights for policy 0, policy_version 1943263 (0.0010) [2023-12-26 15:06:53,509][123091] Updated weights for policy 0, policy_version 1943273 (0.0010) [2023-12-26 15:06:53,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 991854592. Throughput: 0: 8918.9, 1: 8924.5. Samples: 991832868. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:06:53,785][121949] Avg episode reward: [(0, '6376.467'), (1, '5616.348')] [2023-12-26 15:06:53,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001943280_497483776.pth... [2023-12-26 15:06:53,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001942256_497221632.pth [2023-12-26 15:06:53,808][123090] Updated weights for policy 1, policy_version 1931139 (0.0009) [2023-12-26 15:06:53,864][123090] Updated weights for policy 1, policy_version 1931149 (0.0005) [2023-12-26 15:06:53,909][123090] Updated weights for policy 1, policy_version 1931159 (0.0005) [2023-12-26 15:06:53,950][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001931168_494379008.pth... [2023-12-26 15:06:53,953][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001930112_494108672.pth [2023-12-26 15:06:54,287][123091] Updated weights for policy 0, policy_version 1943283 (0.0010) [2023-12-26 15:06:54,348][123091] Updated weights for policy 0, policy_version 1943293 (0.0010) [2023-12-26 15:06:54,399][123091] Updated weights for policy 0, policy_version 1943303 (0.0010) [2023-12-26 15:06:54,718][123090] Updated weights for policy 1, policy_version 1931169 (0.0005) [2023-12-26 15:06:54,766][123090] Updated weights for policy 1, policy_version 1931179 (0.0009) [2023-12-26 15:06:54,816][123090] Updated weights for policy 1, policy_version 1931189 (0.0008) [2023-12-26 15:06:54,875][123090] Updated weights for policy 1, policy_version 1931199 (0.0009) [2023-12-26 15:06:55,225][123091] Updated weights for policy 0, policy_version 1943313 (0.0010) [2023-12-26 15:06:55,272][123091] Updated weights for policy 0, policy_version 1943323 (0.0010) [2023-12-26 15:06:55,327][123091] Updated weights for policy 0, policy_version 1943333 (0.0010) [2023-12-26 15:06:55,389][123091] Updated weights for policy 0, policy_version 1943343 (0.0010) [2023-12-26 15:06:55,710][123090] Updated weights for policy 1, policy_version 1931209 (0.0010) [2023-12-26 15:06:55,764][123090] Updated weights for policy 1, policy_version 1931220 (0.0010) [2023-12-26 15:06:55,819][123090] Updated weights for policy 1, policy_version 1931230 (0.0010) [2023-12-26 15:06:56,141][123091] Updated weights for policy 0, policy_version 1943353 (0.0007) [2023-12-26 15:06:56,211][123091] Updated weights for policy 0, policy_version 1943363 (0.0007) [2023-12-26 15:06:56,276][123091] Updated weights for policy 0, policy_version 1943373 (0.0010) [2023-12-26 15:06:56,704][123090] Updated weights for policy 1, policy_version 1931240 (0.0009) [2023-12-26 15:06:56,751][123090] Updated weights for policy 1, policy_version 1931250 (0.0008) [2023-12-26 15:06:56,802][123090] Updated weights for policy 1, policy_version 1931260 (0.0008) [2023-12-26 15:06:57,040][123091] Updated weights for policy 0, policy_version 1943383 (0.0007) [2023-12-26 15:06:57,089][123091] Updated weights for policy 0, policy_version 1943393 (0.0008) [2023-12-26 15:06:57,137][123091] Updated weights for policy 0, policy_version 1943403 (0.0007) [2023-12-26 15:06:57,670][123090] Updated weights for policy 1, policy_version 1931270 (0.0008) [2023-12-26 15:06:57,728][123090] Updated weights for policy 1, policy_version 1931280 (0.0008) [2023-12-26 15:06:57,793][123090] Updated weights for policy 1, policy_version 1931290 (0.0005) [2023-12-26 15:06:57,870][123091] Updated weights for policy 0, policy_version 1943413 (0.0008) [2023-12-26 15:06:57,924][123091] Updated weights for policy 0, policy_version 1943423 (0.0010) [2023-12-26 15:06:57,982][123091] Updated weights for policy 0, policy_version 1943433 (0.0010) [2023-12-26 15:06:58,632][123090] Updated weights for policy 1, policy_version 1931300 (0.0007) [2023-12-26 15:06:58,697][123090] Updated weights for policy 1, policy_version 1931310 (0.0009) [2023-12-26 15:06:58,766][123090] Updated weights for policy 1, policy_version 1931320 (0.0009) [2023-12-26 15:06:58,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 991936512. Throughput: 0: 8897.5, 1: 8923.0. Samples: 991937744. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:06:58,785][121949] Avg episode reward: [(0, '6419.497'), (1, '5671.615')] [2023-12-26 15:06:58,819][123091] Updated weights for policy 0, policy_version 1943443 (0.0009) [2023-12-26 15:06:58,890][123091] Updated weights for policy 0, policy_version 1943453 (0.0008) [2023-12-26 15:06:58,961][123091] Updated weights for policy 0, policy_version 1943463 (0.0008) [2023-12-26 15:06:59,533][123090] Updated weights for policy 1, policy_version 1931330 (0.0009) [2023-12-26 15:06:59,592][123090] Updated weights for policy 1, policy_version 1931340 (0.0009) [2023-12-26 15:06:59,640][123090] Updated weights for policy 1, policy_version 1931350 (0.0008) [2023-12-26 15:06:59,705][123090] Updated weights for policy 1, policy_version 1931360 (0.0009) [2023-12-26 15:06:59,741][123091] Updated weights for policy 0, policy_version 1943475 (0.0011) [2023-12-26 15:06:59,800][123091] Updated weights for policy 0, policy_version 1943485 (0.0010) [2023-12-26 15:06:59,867][123091] Updated weights for policy 0, policy_version 1943495 (0.0011) [2023-12-26 15:07:00,555][123090] Updated weights for policy 1, policy_version 1931370 (0.0009) [2023-12-26 15:07:00,613][123090] Updated weights for policy 1, policy_version 1931380 (0.0009) [2023-12-26 15:07:00,663][123090] Updated weights for policy 1, policy_version 1931390 (0.0009) [2023-12-26 15:07:00,664][123091] Updated weights for policy 0, policy_version 1943505 (0.0013) [2023-12-26 15:07:00,739][123091] Updated weights for policy 0, policy_version 1943515 (0.0009) [2023-12-26 15:07:00,796][123091] Updated weights for policy 0, policy_version 1943525 (0.0010) [2023-12-26 15:07:00,859][123091] Updated weights for policy 0, policy_version 1943535 (0.0006) [2023-12-26 15:07:01,441][123090] Updated weights for policy 1, policy_version 1931400 (0.0008) [2023-12-26 15:07:01,493][123090] Updated weights for policy 1, policy_version 1931410 (0.0008) [2023-12-26 15:07:01,547][123090] Updated weights for policy 1, policy_version 1931420 (0.0009) [2023-12-26 15:07:01,614][123091] Updated weights for policy 0, policy_version 1943545 (0.0007) [2023-12-26 15:07:01,681][123091] Updated weights for policy 0, policy_version 1943555 (0.0008) [2023-12-26 15:07:01,750][123091] Updated weights for policy 0, policy_version 1943565 (0.0008) [2023-12-26 15:07:02,311][123090] Updated weights for policy 1, policy_version 1931430 (0.0008) [2023-12-26 15:07:02,366][123090] Updated weights for policy 1, policy_version 1931440 (0.0007) [2023-12-26 15:07:02,430][123090] Updated weights for policy 1, policy_version 1931450 (0.0008) [2023-12-26 15:07:02,452][123091] Updated weights for policy 0, policy_version 1943575 (0.0006) [2023-12-26 15:07:02,517][123091] Updated weights for policy 0, policy_version 1943585 (0.0006) [2023-12-26 15:07:02,582][123091] Updated weights for policy 0, policy_version 1943595 (0.0005) [2023-12-26 15:07:03,201][123090] Updated weights for policy 1, policy_version 1931460 (0.0009) [2023-12-26 15:07:03,260][123090] Updated weights for policy 1, policy_version 1931470 (0.0009) [2023-12-26 15:07:03,319][123091] Updated weights for policy 0, policy_version 1943605 (0.0008) [2023-12-26 15:07:03,323][123090] Updated weights for policy 1, policy_version 1931480 (0.0008) [2023-12-26 15:07:03,378][123091] Updated weights for policy 0, policy_version 1943615 (0.0006) [2023-12-26 15:07:03,430][123091] Updated weights for policy 0, policy_version 1943625 (0.0005) [2023-12-26 15:07:03,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 992034816. Throughput: 0: 8892.6, 1: 8815.1. Samples: 992045756. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:03,785][121949] Avg episode reward: [(0, '6416.301'), (1, '5924.057')] [2023-12-26 15:07:04,135][123091] Updated weights for policy 0, policy_version 1943635 (0.0007) [2023-12-26 15:07:04,187][123091] Updated weights for policy 0, policy_version 1943645 (0.0009) [2023-12-26 15:07:04,232][123090] Updated weights for policy 1, policy_version 1931490 (0.0009) [2023-12-26 15:07:04,242][123091] Updated weights for policy 0, policy_version 1943655 (0.0009) [2023-12-26 15:07:04,293][123090] Updated weights for policy 1, policy_version 1931500 (0.0009) [2023-12-26 15:07:04,353][123090] Updated weights for policy 1, policy_version 1931510 (0.0009) [2023-12-26 15:07:04,412][123090] Updated weights for policy 1, policy_version 1931520 (0.0009) [2023-12-26 15:07:05,142][123091] Updated weights for policy 0, policy_version 1943665 (0.0007) [2023-12-26 15:07:05,168][123090] Updated weights for policy 1, policy_version 1931530 (0.0009) [2023-12-26 15:07:05,192][123091] Updated weights for policy 0, policy_version 1943675 (0.0009) [2023-12-26 15:07:05,222][123090] Updated weights for policy 1, policy_version 1931540 (0.0007) [2023-12-26 15:07:05,239][123091] Updated weights for policy 0, policy_version 1943685 (0.0008) [2023-12-26 15:07:05,273][123090] Updated weights for policy 1, policy_version 1931550 (0.0008) [2023-12-26 15:07:05,289][123091] Updated weights for policy 0, policy_version 1943695 (0.0009) [2023-12-26 15:07:06,076][123090] Updated weights for policy 1, policy_version 1931560 (0.0009) [2023-12-26 15:07:06,136][123090] Updated weights for policy 1, policy_version 1931570 (0.0009) [2023-12-26 15:07:06,151][123091] Updated weights for policy 0, policy_version 1943705 (0.0009) [2023-12-26 15:07:06,191][123090] Updated weights for policy 1, policy_version 1931580 (0.0009) [2023-12-26 15:07:06,216][123091] Updated weights for policy 0, policy_version 1943715 (0.0007) [2023-12-26 15:07:06,271][123091] Updated weights for policy 0, policy_version 1943725 (0.0010) [2023-12-26 15:07:07,040][123090] Updated weights for policy 1, policy_version 1931590 (0.0007) [2023-12-26 15:07:07,097][123090] Updated weights for policy 1, policy_version 1931600 (0.0009) [2023-12-26 15:07:07,138][123091] Updated weights for policy 0, policy_version 1943735 (0.0010) [2023-12-26 15:07:07,153][123090] Updated weights for policy 1, policy_version 1931610 (0.0006) [2023-12-26 15:07:07,199][123091] Updated weights for policy 0, policy_version 1943745 (0.0009) [2023-12-26 15:07:07,247][123091] Updated weights for policy 0, policy_version 1943755 (0.0009) [2023-12-26 15:07:07,942][123090] Updated weights for policy 1, policy_version 1931620 (0.0007) [2023-12-26 15:07:07,993][123090] Updated weights for policy 1, policy_version 1931631 (0.0009) [2023-12-26 15:07:08,065][123090] Updated weights for policy 1, policy_version 1931641 (0.0006) [2023-12-26 15:07:08,099][123091] Updated weights for policy 0, policy_version 1943765 (0.0010) [2023-12-26 15:07:08,163][123091] Updated weights for policy 0, policy_version 1943775 (0.0010) [2023-12-26 15:07:08,228][123091] Updated weights for policy 0, policy_version 1943785 (0.0010) [2023-12-26 15:07:08,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17800.2). Total num frames: 992116736. Throughput: 0: 8889.5, 1: 8848.5. Samples: 992097368. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:08,785][121949] Avg episode reward: [(0, '6287.470'), (1, '5763.926')] [2023-12-26 15:07:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001943792_497614848.pth... [2023-12-26 15:07:08,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001931648_494501888.pth... [2023-12-26 15:07:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001942736_497344512.pth [2023-12-26 15:07:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001930656_494247936.pth [2023-12-26 15:07:08,919][123090] Updated weights for policy 1, policy_version 1931651 (0.0007) [2023-12-26 15:07:08,984][123090] Updated weights for policy 1, policy_version 1931661 (0.0009) [2023-12-26 15:07:09,023][123091] Updated weights for policy 0, policy_version 1943795 (0.0009) [2023-12-26 15:07:09,050][123090] Updated weights for policy 1, policy_version 1931671 (0.0008) [2023-12-26 15:07:09,084][123091] Updated weights for policy 0, policy_version 1943805 (0.0009) [2023-12-26 15:07:09,149][123091] Updated weights for policy 0, policy_version 1943815 (0.0006) [2023-12-26 15:07:09,883][123090] Updated weights for policy 1, policy_version 1931681 (0.0006) [2023-12-26 15:07:09,896][123091] Updated weights for policy 0, policy_version 1943825 (0.0006) [2023-12-26 15:07:09,943][123090] Updated weights for policy 1, policy_version 1931691 (0.0007) [2023-12-26 15:07:09,966][123091] Updated weights for policy 0, policy_version 1943835 (0.0011) [2023-12-26 15:07:10,009][123090] Updated weights for policy 1, policy_version 1931701 (0.0007) [2023-12-26 15:07:10,032][123091] Updated weights for policy 0, policy_version 1943845 (0.0011) [2023-12-26 15:07:10,074][123090] Updated weights for policy 1, policy_version 1931711 (0.0006) [2023-12-26 15:07:10,084][123091] Updated weights for policy 0, policy_version 1943855 (0.0011) [2023-12-26 15:07:10,912][123090] Updated weights for policy 1, policy_version 1931721 (0.0009) [2023-12-26 15:07:10,912][123091] Updated weights for policy 0, policy_version 1943865 (0.0008) [2023-12-26 15:07:10,967][123091] Updated weights for policy 0, policy_version 1943875 (0.0006) [2023-12-26 15:07:10,969][123090] Updated weights for policy 1, policy_version 1931731 (0.0010) [2023-12-26 15:07:11,017][123091] Updated weights for policy 0, policy_version 1943885 (0.0008) [2023-12-26 15:07:11,029][123090] Updated weights for policy 1, policy_version 1931741 (0.0008) [2023-12-26 15:07:11,871][123091] Updated weights for policy 0, policy_version 1943895 (0.0010) [2023-12-26 15:07:11,887][123090] Updated weights for policy 1, policy_version 1931751 (0.0008) [2023-12-26 15:07:11,937][123091] Updated weights for policy 0, policy_version 1943905 (0.0009) [2023-12-26 15:07:11,949][123090] Updated weights for policy 1, policy_version 1931761 (0.0007) [2023-12-26 15:07:12,000][123091] Updated weights for policy 0, policy_version 1943915 (0.0010) [2023-12-26 15:07:12,014][123090] Updated weights for policy 1, policy_version 1931771 (0.0009) [2023-12-26 15:07:12,853][123091] Updated weights for policy 0, policy_version 1943925 (0.0009) [2023-12-26 15:07:12,882][123090] Updated weights for policy 1, policy_version 1931781 (0.0008) [2023-12-26 15:07:12,916][123091] Updated weights for policy 0, policy_version 1943935 (0.0009) [2023-12-26 15:07:12,954][123090] Updated weights for policy 1, policy_version 1931791 (0.0009) [2023-12-26 15:07:12,983][123091] Updated weights for policy 0, policy_version 1943945 (0.0008) [2023-12-26 15:07:13,016][123090] Updated weights for policy 1, policy_version 1931801 (0.0010) [2023-12-26 15:07:13,773][123091] Updated weights for policy 0, policy_version 1943955 (0.0008) [2023-12-26 15:07:13,784][121949] Fps is (10 sec: 16384.2, 60 sec: 17476.2, 300 sec: 17744.7). Total num frames: 992198656. Throughput: 0: 8860.4, 1: 8756.1. Samples: 992199728. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:13,785][121949] Avg episode reward: [(0, '6295.525'), (1, '5767.087')] [2023-12-26 15:07:13,826][123091] Updated weights for policy 0, policy_version 1943965 (0.0009) [2023-12-26 15:07:13,856][123090] Updated weights for policy 1, policy_version 1931811 (0.0009) [2023-12-26 15:07:13,873][123091] Updated weights for policy 0, policy_version 1943975 (0.0008) [2023-12-26 15:07:13,908][123090] Updated weights for policy 1, policy_version 1931821 (0.0007) [2023-12-26 15:07:13,955][123090] Updated weights for policy 1, policy_version 1931831 (0.0007) [2023-12-26 15:07:14,661][123090] Updated weights for policy 1, policy_version 1931841 (0.0005) [2023-12-26 15:07:14,687][123091] Updated weights for policy 0, policy_version 1943985 (0.0008) [2023-12-26 15:07:14,723][123090] Updated weights for policy 1, policy_version 1931851 (0.0006) [2023-12-26 15:07:14,746][123091] Updated weights for policy 0, policy_version 1943995 (0.0011) [2023-12-26 15:07:14,783][123090] Updated weights for policy 1, policy_version 1931861 (0.0011) [2023-12-26 15:07:14,812][123091] Updated weights for policy 0, policy_version 1944005 (0.0011) [2023-12-26 15:07:14,842][123090] Updated weights for policy 1, policy_version 1931871 (0.0011) [2023-12-26 15:07:14,865][123091] Updated weights for policy 0, policy_version 1944015 (0.0010) [2023-12-26 15:07:15,594][123090] Updated weights for policy 1, policy_version 1931881 (0.0008) [2023-12-26 15:07:15,640][123090] Updated weights for policy 1, policy_version 1931891 (0.0011) [2023-12-26 15:07:15,696][123090] Updated weights for policy 1, policy_version 1931901 (0.0010) [2023-12-26 15:07:15,716][123091] Updated weights for policy 0, policy_version 1944025 (0.0006) [2023-12-26 15:07:15,770][123091] Updated weights for policy 0, policy_version 1944035 (0.0008) [2023-12-26 15:07:15,826][123091] Updated weights for policy 0, policy_version 1944045 (0.0010) [2023-12-26 15:07:16,352][123090] Updated weights for policy 1, policy_version 1931911 (0.0010) [2023-12-26 15:07:16,405][123090] Updated weights for policy 1, policy_version 1931921 (0.0009) [2023-12-26 15:07:16,455][123090] Updated weights for policy 1, policy_version 1931931 (0.0009) [2023-12-26 15:07:16,690][123091] Updated weights for policy 0, policy_version 1944055 (0.0009) [2023-12-26 15:07:16,760][123091] Updated weights for policy 0, policy_version 1944065 (0.0008) [2023-12-26 15:07:16,827][123091] Updated weights for policy 0, policy_version 1944075 (0.0009) [2023-12-26 15:07:17,221][123090] Updated weights for policy 1, policy_version 1931941 (0.0007) [2023-12-26 15:07:17,283][123090] Updated weights for policy 1, policy_version 1931951 (0.0006) [2023-12-26 15:07:17,345][123090] Updated weights for policy 1, policy_version 1931961 (0.0008) [2023-12-26 15:07:17,661][123091] Updated weights for policy 0, policy_version 1944085 (0.0009) [2023-12-26 15:07:17,733][123091] Updated weights for policy 0, policy_version 1944095 (0.0008) [2023-12-26 15:07:17,796][123091] Updated weights for policy 0, policy_version 1944105 (0.0006) [2023-12-26 15:07:18,110][123090] Updated weights for policy 1, policy_version 1931971 (0.0009) [2023-12-26 15:07:18,173][123090] Updated weights for policy 1, policy_version 1931981 (0.0009) [2023-12-26 15:07:18,238][123090] Updated weights for policy 1, policy_version 1931991 (0.0010) [2023-12-26 15:07:18,441][123091] Updated weights for policy 0, policy_version 1944115 (0.0007) [2023-12-26 15:07:18,500][123091] Updated weights for policy 0, policy_version 1944125 (0.0009) [2023-12-26 15:07:18,564][123091] Updated weights for policy 0, policy_version 1944135 (0.0005) [2023-12-26 15:07:18,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17800.3). Total num frames: 992296960. Throughput: 0: 8917.5, 1: 8724.7. Samples: 992307220. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:18,785][121949] Avg episode reward: [(0, '6341.921'), (1, '5902.879')] [2023-12-26 15:07:19,131][123090] Updated weights for policy 1, policy_version 1932001 (0.0010) [2023-12-26 15:07:19,193][123090] Updated weights for policy 1, policy_version 1932011 (0.0010) [2023-12-26 15:07:19,263][123090] Updated weights for policy 1, policy_version 1932021 (0.0010) [2023-12-26 15:07:19,330][123090] Updated weights for policy 1, policy_version 1932031 (0.0011) [2023-12-26 15:07:19,344][123091] Updated weights for policy 0, policy_version 1944145 (0.0006) [2023-12-26 15:07:19,413][123091] Updated weights for policy 0, policy_version 1944155 (0.0011) [2023-12-26 15:07:19,478][123091] Updated weights for policy 0, policy_version 1944165 (0.0011) [2023-12-26 15:07:19,550][123091] Updated weights for policy 0, policy_version 1944175 (0.0011) [2023-12-26 15:07:20,033][123090] Updated weights for policy 1, policy_version 1932041 (0.0007) [2023-12-26 15:07:20,097][123090] Updated weights for policy 1, policy_version 1932051 (0.0006) [2023-12-26 15:07:20,156][123090] Updated weights for policy 1, policy_version 1932061 (0.0006) [2023-12-26 15:07:20,389][123091] Updated weights for policy 0, policy_version 1944185 (0.0011) [2023-12-26 15:07:20,453][123091] Updated weights for policy 0, policy_version 1944195 (0.0011) [2023-12-26 15:07:20,517][123091] Updated weights for policy 0, policy_version 1944205 (0.0011) [2023-12-26 15:07:20,864][123090] Updated weights for policy 1, policy_version 1932071 (0.0007) [2023-12-26 15:07:20,931][123090] Updated weights for policy 1, policy_version 1932081 (0.0008) [2023-12-26 15:07:20,991][123090] Updated weights for policy 1, policy_version 1932091 (0.0008) [2023-12-26 15:07:21,352][123091] Updated weights for policy 0, policy_version 1944215 (0.0010) [2023-12-26 15:07:21,430][123091] Updated weights for policy 0, policy_version 1944225 (0.0010) [2023-12-26 15:07:21,496][123091] Updated weights for policy 0, policy_version 1944235 (0.0009) [2023-12-26 15:07:21,844][123090] Updated weights for policy 1, policy_version 1932101 (0.0009) [2023-12-26 15:07:21,909][123090] Updated weights for policy 1, policy_version 1932111 (0.0008) [2023-12-26 15:07:21,983][123090] Updated weights for policy 1, policy_version 1932121 (0.0010) [2023-12-26 15:07:22,343][123091] Updated weights for policy 0, policy_version 1944245 (0.0010) [2023-12-26 15:07:22,413][123091] Updated weights for policy 0, policy_version 1944255 (0.0010) [2023-12-26 15:07:22,475][123091] Updated weights for policy 0, policy_version 1944265 (0.0010) [2023-12-26 15:07:22,879][123090] Updated weights for policy 1, policy_version 1932131 (0.0009) [2023-12-26 15:07:22,939][123090] Updated weights for policy 1, policy_version 1932141 (0.0009) [2023-12-26 15:07:23,004][123090] Updated weights for policy 1, policy_version 1932151 (0.0009) [2023-12-26 15:07:23,316][123091] Updated weights for policy 0, policy_version 1944275 (0.0008) [2023-12-26 15:07:23,388][123091] Updated weights for policy 0, policy_version 1944285 (0.0005) [2023-12-26 15:07:23,450][123091] Updated weights for policy 0, policy_version 1944295 (0.0007) [2023-12-26 15:07:23,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 992378880. Throughput: 0: 8913.1, 1: 8721.3. Samples: 992359240. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:23,785][121949] Avg episode reward: [(0, '6355.523'), (1, '5857.115')] [2023-12-26 15:07:23,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001932160_494632960.pth... [2023-12-26 15:07:23,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001944304_497745920.pth... [2023-12-26 15:07:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001931168_494379008.pth [2023-12-26 15:07:23,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001943280_497483776.pth [2023-12-26 15:07:23,887][123090] Updated weights for policy 1, policy_version 1932161 (0.0009) [2023-12-26 15:07:23,961][123090] Updated weights for policy 1, policy_version 1932171 (0.0009) [2023-12-26 15:07:24,032][123090] Updated weights for policy 1, policy_version 1932181 (0.0009) [2023-12-26 15:07:24,053][123091] Updated weights for policy 0, policy_version 1944305 (0.0008) [2023-12-26 15:07:24,098][123090] Updated weights for policy 1, policy_version 1932191 (0.0010) [2023-12-26 15:07:24,105][123091] Updated weights for policy 0, policy_version 1944315 (0.0006) [2023-12-26 15:07:24,165][123091] Updated weights for policy 0, policy_version 1944325 (0.0009) [2023-12-26 15:07:24,223][123091] Updated weights for policy 0, policy_version 1944335 (0.0010) [2023-12-26 15:07:24,843][123090] Updated weights for policy 1, policy_version 1932201 (0.0006) [2023-12-26 15:07:24,893][123090] Updated weights for policy 1, policy_version 1932211 (0.0005) [2023-12-26 15:07:24,917][123091] Updated weights for policy 0, policy_version 1944345 (0.0006) [2023-12-26 15:07:24,947][123090] Updated weights for policy 1, policy_version 1932221 (0.0005) [2023-12-26 15:07:24,969][123091] Updated weights for policy 0, policy_version 1944355 (0.0005) [2023-12-26 15:07:25,022][123091] Updated weights for policy 0, policy_version 1944365 (0.0010) [2023-12-26 15:07:25,635][123090] Updated weights for policy 1, policy_version 1932231 (0.0005) [2023-12-26 15:07:25,688][123090] Updated weights for policy 1, policy_version 1932241 (0.0005) [2023-12-26 15:07:25,745][123090] Updated weights for policy 1, policy_version 1932251 (0.0005) [2023-12-26 15:07:25,759][123091] Updated weights for policy 0, policy_version 1944375 (0.0007) [2023-12-26 15:07:25,815][123091] Updated weights for policy 0, policy_version 1944385 (0.0006) [2023-12-26 15:07:25,867][123091] Updated weights for policy 0, policy_version 1944395 (0.0009) [2023-12-26 15:07:26,342][123090] Updated weights for policy 1, policy_version 1932261 (0.0005) [2023-12-26 15:07:26,394][123090] Updated weights for policy 1, policy_version 1932271 (0.0005) [2023-12-26 15:07:26,455][123090] Updated weights for policy 1, policy_version 1932281 (0.0008) [2023-12-26 15:07:26,646][123091] Updated weights for policy 0, policy_version 1944405 (0.0008) [2023-12-26 15:07:26,701][123091] Updated weights for policy 0, policy_version 1944415 (0.0005) [2023-12-26 15:07:26,763][123091] Updated weights for policy 0, policy_version 1944425 (0.0006) [2023-12-26 15:07:27,054][123090] Updated weights for policy 1, policy_version 1932291 (0.0008) [2023-12-26 15:07:27,125][123090] Updated weights for policy 1, policy_version 1932301 (0.0005) [2023-12-26 15:07:27,182][123090] Updated weights for policy 1, policy_version 1932311 (0.0006) [2023-12-26 15:07:27,437][123091] Updated weights for policy 0, policy_version 1944435 (0.0007) [2023-12-26 15:07:27,496][123091] Updated weights for policy 0, policy_version 1944445 (0.0006) [2023-12-26 15:07:27,552][123091] Updated weights for policy 0, policy_version 1944455 (0.0006) [2023-12-26 15:07:27,844][123090] Updated weights for policy 1, policy_version 1932321 (0.0005) [2023-12-26 15:07:27,891][123090] Updated weights for policy 1, policy_version 1932331 (0.0005) [2023-12-26 15:07:27,940][123090] Updated weights for policy 1, policy_version 1932341 (0.0005) [2023-12-26 15:07:27,992][123090] Updated weights for policy 1, policy_version 1932351 (0.0009) [2023-12-26 15:07:28,217][123091] Updated weights for policy 0, policy_version 1944465 (0.0006) [2023-12-26 15:07:28,264][123091] Updated weights for policy 0, policy_version 1944475 (0.0010) [2023-12-26 15:07:28,314][123091] Updated weights for policy 0, policy_version 1944485 (0.0010) [2023-12-26 15:07:28,377][123091] Updated weights for policy 0, policy_version 1944495 (0.0010) [2023-12-26 15:07:28,730][123090] Updated weights for policy 1, policy_version 1932361 (0.0006) [2023-12-26 15:07:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 992477184. Throughput: 0: 9010.4, 1: 8857.7. Samples: 992472000. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:28,785][121949] Avg episode reward: [(0, '6325.301'), (1, '5795.987')] [2023-12-26 15:07:28,788][123090] Updated weights for policy 1, policy_version 1932371 (0.0007) [2023-12-26 15:07:28,855][123090] Updated weights for policy 1, policy_version 1932381 (0.0011) [2023-12-26 15:07:29,181][123091] Updated weights for policy 0, policy_version 1944505 (0.0006) [2023-12-26 15:07:29,250][123091] Updated weights for policy 0, policy_version 1944515 (0.0006) [2023-12-26 15:07:29,314][123091] Updated weights for policy 0, policy_version 1944525 (0.0007) [2023-12-26 15:07:29,640][123090] Updated weights for policy 1, policy_version 1932391 (0.0010) [2023-12-26 15:07:29,698][123090] Updated weights for policy 1, policy_version 1932401 (0.0010) [2023-12-26 15:07:29,764][123090] Updated weights for policy 1, policy_version 1932411 (0.0010) [2023-12-26 15:07:29,944][123091] Updated weights for policy 0, policy_version 1944535 (0.0008) [2023-12-26 15:07:29,992][123091] Updated weights for policy 0, policy_version 1944545 (0.0008) [2023-12-26 15:07:30,068][123091] Updated weights for policy 0, policy_version 1944555 (0.0008) [2023-12-26 15:07:30,486][123090] Updated weights for policy 1, policy_version 1932421 (0.0008) [2023-12-26 15:07:30,549][123090] Updated weights for policy 1, policy_version 1932431 (0.0005) [2023-12-26 15:07:30,614][123090] Updated weights for policy 1, policy_version 1932441 (0.0005) [2023-12-26 15:07:30,854][123091] Updated weights for policy 0, policy_version 1944565 (0.0009) [2023-12-26 15:07:30,905][123091] Updated weights for policy 0, policy_version 1944575 (0.0010) [2023-12-26 15:07:30,959][123091] Updated weights for policy 0, policy_version 1944585 (0.0010) [2023-12-26 15:07:31,346][123090] Updated weights for policy 1, policy_version 1932451 (0.0007) [2023-12-26 15:07:31,414][123090] Updated weights for policy 1, policy_version 1932461 (0.0011) [2023-12-26 15:07:31,467][123090] Updated weights for policy 1, policy_version 1932471 (0.0006) [2023-12-26 15:07:31,800][123091] Updated weights for policy 0, policy_version 1944595 (0.0009) [2023-12-26 15:07:31,869][123091] Updated weights for policy 0, policy_version 1944605 (0.0005) [2023-12-26 15:07:31,939][123091] Updated weights for policy 0, policy_version 1944615 (0.0006) [2023-12-26 15:07:32,184][123090] Updated weights for policy 1, policy_version 1932481 (0.0006) [2023-12-26 15:07:32,245][123090] Updated weights for policy 1, policy_version 1932491 (0.0006) [2023-12-26 15:07:32,319][123090] Updated weights for policy 1, policy_version 1932501 (0.0009) [2023-12-26 15:07:32,384][123090] Updated weights for policy 1, policy_version 1932511 (0.0008) [2023-12-26 15:07:32,648][123091] Updated weights for policy 0, policy_version 1944625 (0.0011) [2023-12-26 15:07:32,721][123091] Updated weights for policy 0, policy_version 1944635 (0.0010) [2023-12-26 15:07:32,790][123091] Updated weights for policy 0, policy_version 1944645 (0.0010) [2023-12-26 15:07:32,848][123091] Updated weights for policy 0, policy_version 1944655 (0.0010) [2023-12-26 15:07:33,085][123090] Updated weights for policy 1, policy_version 1932521 (0.0009) [2023-12-26 15:07:33,141][123090] Updated weights for policy 1, policy_version 1932531 (0.0008) [2023-12-26 15:07:33,189][123090] Updated weights for policy 1, policy_version 1932541 (0.0009) [2023-12-26 15:07:33,539][123091] Updated weights for policy 0, policy_version 1944665 (0.0006) [2023-12-26 15:07:33,586][123091] Updated weights for policy 0, policy_version 1944675 (0.0005) [2023-12-26 15:07:33,641][123091] Updated weights for policy 0, policy_version 1944685 (0.0005) [2023-12-26 15:07:33,784][121949] Fps is (10 sec: 19660.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 992575488. Throughput: 0: 8992.6, 1: 8866.3. Samples: 992584440. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:33,785][121949] Avg episode reward: [(0, '6198.656'), (1, '5693.681')] [2023-12-26 15:07:34,117][123090] Updated weights for policy 1, policy_version 1932551 (0.0009) [2023-12-26 15:07:34,185][123090] Updated weights for policy 1, policy_version 1932561 (0.0008) [2023-12-26 15:07:34,226][123091] Updated weights for policy 0, policy_version 1944695 (0.0008) [2023-12-26 15:07:34,249][123090] Updated weights for policy 1, policy_version 1932571 (0.0009) [2023-12-26 15:07:34,290][123091] Updated weights for policy 0, policy_version 1944705 (0.0009) [2023-12-26 15:07:34,360][123091] Updated weights for policy 0, policy_version 1944715 (0.0008) [2023-12-26 15:07:34,991][123090] Updated weights for policy 1, policy_version 1932581 (0.0007) [2023-12-26 15:07:35,051][123091] Updated weights for policy 0, policy_version 1944725 (0.0006) [2023-12-26 15:07:35,057][123090] Updated weights for policy 1, policy_version 1932591 (0.0005) [2023-12-26 15:07:35,106][123091] Updated weights for policy 0, policy_version 1944735 (0.0005) [2023-12-26 15:07:35,129][123090] Updated weights for policy 1, policy_version 1932601 (0.0005) [2023-12-26 15:07:35,162][123091] Updated weights for policy 0, policy_version 1944745 (0.0005) [2023-12-26 15:07:35,783][123090] Updated weights for policy 1, policy_version 1932611 (0.0007) [2023-12-26 15:07:35,837][123090] Updated weights for policy 1, policy_version 1932622 (0.0010) [2023-12-26 15:07:35,893][123090] Updated weights for policy 1, policy_version 1932632 (0.0010) [2023-12-26 15:07:35,934][123091] Updated weights for policy 0, policy_version 1944755 (0.0005) [2023-12-26 15:07:35,982][123091] Updated weights for policy 0, policy_version 1944765 (0.0009) [2023-12-26 15:07:36,038][123091] Updated weights for policy 0, policy_version 1944775 (0.0009) [2023-12-26 15:07:36,793][123090] Updated weights for policy 1, policy_version 1932642 (0.0009) [2023-12-26 15:07:36,834][123091] Updated weights for policy 0, policy_version 1944785 (0.0009) [2023-12-26 15:07:36,849][123090] Updated weights for policy 1, policy_version 1932652 (0.0010) [2023-12-26 15:07:36,882][123091] Updated weights for policy 0, policy_version 1944795 (0.0007) [2023-12-26 15:07:36,902][123090] Updated weights for policy 1, policy_version 1932662 (0.0007) [2023-12-26 15:07:36,933][123091] Updated weights for policy 0, policy_version 1944805 (0.0010) [2023-12-26 15:07:36,955][123090] Updated weights for policy 1, policy_version 1932672 (0.0008) [2023-12-26 15:07:37,001][123091] Updated weights for policy 0, policy_version 1944815 (0.0008) [2023-12-26 15:07:37,807][123091] Updated weights for policy 0, policy_version 1944825 (0.0010) [2023-12-26 15:07:37,823][123090] Updated weights for policy 1, policy_version 1932682 (0.0005) [2023-12-26 15:07:37,859][123091] Updated weights for policy 0, policy_version 1944835 (0.0011) [2023-12-26 15:07:37,883][123090] Updated weights for policy 1, policy_version 1932692 (0.0005) [2023-12-26 15:07:37,914][123091] Updated weights for policy 0, policy_version 1944845 (0.0011) [2023-12-26 15:07:37,944][123090] Updated weights for policy 1, policy_version 1932702 (0.0007) [2023-12-26 15:07:38,726][123091] Updated weights for policy 0, policy_version 1944855 (0.0007) [2023-12-26 15:07:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 992657408. Throughput: 0: 9013.0, 1: 8925.5. Samples: 992640100. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:38,785][121949] Avg episode reward: [(0, '6183.211'), (1, '5609.462')] [2023-12-26 15:07:38,786][123091] Updated weights for policy 0, policy_version 1944865 (0.0008) [2023-12-26 15:07:38,801][123090] Updated weights for policy 1, policy_version 1932712 (0.0009) [2023-12-26 15:07:38,847][123091] Updated weights for policy 0, policy_version 1944875 (0.0006) [2023-12-26 15:07:38,861][123090] Updated weights for policy 1, policy_version 1932722 (0.0009) [2023-12-26 15:07:38,878][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001944880_497893376.pth... [2023-12-26 15:07:38,881][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001943792_497614848.pth [2023-12-26 15:07:38,926][123090] Updated weights for policy 1, policy_version 1932732 (0.0009) [2023-12-26 15:07:38,948][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001932736_494780416.pth... [2023-12-26 15:07:38,952][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001931648_494501888.pth [2023-12-26 15:07:39,685][123091] Updated weights for policy 0, policy_version 1944885 (0.0007) [2023-12-26 15:07:39,740][123091] Updated weights for policy 0, policy_version 1944895 (0.0010) [2023-12-26 15:07:39,772][123090] Updated weights for policy 1, policy_version 1932742 (0.0009) [2023-12-26 15:07:39,806][123091] Updated weights for policy 0, policy_version 1944905 (0.0010) [2023-12-26 15:07:39,842][123090] Updated weights for policy 1, policy_version 1932752 (0.0009) [2023-12-26 15:07:39,903][123090] Updated weights for policy 1, policy_version 1932762 (0.0008) [2023-12-26 15:07:40,653][123091] Updated weights for policy 0, policy_version 1944915 (0.0010) [2023-12-26 15:07:40,713][123090] Updated weights for policy 1, policy_version 1932772 (0.0008) [2023-12-26 15:07:40,717][123091] Updated weights for policy 0, policy_version 1944925 (0.0008) [2023-12-26 15:07:40,770][123091] Updated weights for policy 0, policy_version 1944935 (0.0006) [2023-12-26 15:07:40,778][123090] Updated weights for policy 1, policy_version 1932782 (0.0010) [2023-12-26 15:07:40,835][123090] Updated weights for policy 1, policy_version 1932792 (0.0008) [2023-12-26 15:07:41,599][123091] Updated weights for policy 0, policy_version 1944945 (0.0010) [2023-12-26 15:07:41,669][123091] Updated weights for policy 0, policy_version 1944955 (0.0009) [2023-12-26 15:07:41,701][123090] Updated weights for policy 1, policy_version 1932802 (0.0009) [2023-12-26 15:07:41,739][123091] Updated weights for policy 0, policy_version 1944965 (0.0009) [2023-12-26 15:07:41,780][123090] Updated weights for policy 1, policy_version 1932812 (0.0009) [2023-12-26 15:07:41,802][123091] Updated weights for policy 0, policy_version 1944975 (0.0007) [2023-12-26 15:07:41,845][123090] Updated weights for policy 1, policy_version 1932822 (0.0008) [2023-12-26 15:07:41,910][123090] Updated weights for policy 1, policy_version 1932832 (0.0009) [2023-12-26 15:07:42,606][123091] Updated weights for policy 0, policy_version 1944985 (0.0006) [2023-12-26 15:07:42,658][123091] Updated weights for policy 0, policy_version 1944995 (0.0005) [2023-12-26 15:07:42,714][123090] Updated weights for policy 1, policy_version 1932842 (0.0008) [2023-12-26 15:07:42,722][123091] Updated weights for policy 0, policy_version 1945005 (0.0006) [2023-12-26 15:07:42,779][123090] Updated weights for policy 1, policy_version 1932852 (0.0009) [2023-12-26 15:07:42,839][123090] Updated weights for policy 1, policy_version 1932862 (0.0009) [2023-12-26 15:07:43,497][123091] Updated weights for policy 0, policy_version 1945015 (0.0010) [2023-12-26 15:07:43,551][123091] Updated weights for policy 0, policy_version 1945025 (0.0010) [2023-12-26 15:07:43,601][123091] Updated weights for policy 0, policy_version 1945035 (0.0009) [2023-12-26 15:07:43,614][123090] Updated weights for policy 1, policy_version 1932872 (0.0007) [2023-12-26 15:07:43,674][123090] Updated weights for policy 1, policy_version 1932882 (0.0010) [2023-12-26 15:07:43,737][123090] Updated weights for policy 1, policy_version 1932892 (0.0006) [2023-12-26 15:07:43,784][121949] Fps is (10 sec: 18022.8, 60 sec: 18022.5, 300 sec: 17800.2). Total num frames: 992755712. Throughput: 0: 8966.7, 1: 8923.6. Samples: 992742804. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:43,784][121949] Avg episode reward: [(0, '6331.504'), (1, '5795.172')] [2023-12-26 15:07:44,311][123091] Updated weights for policy 0, policy_version 1945045 (0.0006) [2023-12-26 15:07:44,365][123091] Updated weights for policy 0, policy_version 1945055 (0.0005) [2023-12-26 15:07:44,416][123091] Updated weights for policy 0, policy_version 1945065 (0.0005) [2023-12-26 15:07:44,595][123090] Updated weights for policy 1, policy_version 1932902 (0.0008) [2023-12-26 15:07:44,662][123090] Updated weights for policy 1, policy_version 1932912 (0.0009) [2023-12-26 15:07:44,728][123090] Updated weights for policy 1, policy_version 1932922 (0.0009) [2023-12-26 15:07:45,216][123091] Updated weights for policy 0, policy_version 1945075 (0.0007) [2023-12-26 15:07:45,270][123091] Updated weights for policy 0, policy_version 1945085 (0.0009) [2023-12-26 15:07:45,335][123091] Updated weights for policy 0, policy_version 1945095 (0.0010) [2023-12-26 15:07:45,562][123090] Updated weights for policy 1, policy_version 1932932 (0.0008) [2023-12-26 15:07:45,619][123090] Updated weights for policy 1, policy_version 1932942 (0.0009) [2023-12-26 15:07:45,671][123090] Updated weights for policy 1, policy_version 1932952 (0.0009) [2023-12-26 15:07:46,139][123091] Updated weights for policy 0, policy_version 1945105 (0.0010) [2023-12-26 15:07:46,194][123091] Updated weights for policy 0, policy_version 1945115 (0.0009) [2023-12-26 15:07:46,246][123091] Updated weights for policy 0, policy_version 1945125 (0.0009) [2023-12-26 15:07:46,300][123091] Updated weights for policy 0, policy_version 1945135 (0.0009) [2023-12-26 15:07:46,537][123090] Updated weights for policy 1, policy_version 1932962 (0.0009) [2023-12-26 15:07:46,599][123090] Updated weights for policy 1, policy_version 1932972 (0.0010) [2023-12-26 15:07:46,651][123090] Updated weights for policy 1, policy_version 1932983 (0.0009) [2023-12-26 15:07:47,116][123091] Updated weights for policy 0, policy_version 1945145 (0.0006) [2023-12-26 15:07:47,170][123091] Updated weights for policy 0, policy_version 1945155 (0.0006) [2023-12-26 15:07:47,225][123091] Updated weights for policy 0, policy_version 1945165 (0.0006) [2023-12-26 15:07:47,550][123090] Updated weights for policy 1, policy_version 1932993 (0.0009) [2023-12-26 15:07:47,620][123090] Updated weights for policy 1, policy_version 1933003 (0.0010) [2023-12-26 15:07:47,689][123090] Updated weights for policy 1, policy_version 1933013 (0.0009) [2023-12-26 15:07:47,755][123090] Updated weights for policy 1, policy_version 1933023 (0.0010) [2023-12-26 15:07:47,993][123091] Updated weights for policy 0, policy_version 1945175 (0.0008) [2023-12-26 15:07:48,044][123091] Updated weights for policy 0, policy_version 1945185 (0.0010) [2023-12-26 15:07:48,096][123091] Updated weights for policy 0, policy_version 1945195 (0.0009) [2023-12-26 15:07:48,571][123090] Updated weights for policy 1, policy_version 1933033 (0.0009) [2023-12-26 15:07:48,637][123090] Updated weights for policy 1, policy_version 1933043 (0.0009) [2023-12-26 15:07:48,710][123090] Updated weights for policy 1, policy_version 1933053 (0.0010) [2023-12-26 15:07:48,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 992837632. Throughput: 0: 8952.5, 1: 8862.7. Samples: 992847436. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:48,785][121949] Avg episode reward: [(0, '6373.519'), (1, '5903.238')] [2023-12-26 15:07:48,942][123091] Updated weights for policy 0, policy_version 1945206 (0.0010) [2023-12-26 15:07:49,012][123091] Updated weights for policy 0, policy_version 1945216 (0.0010) [2023-12-26 15:07:49,072][123091] Updated weights for policy 0, policy_version 1945226 (0.0009) [2023-12-26 15:07:49,497][123090] Updated weights for policy 1, policy_version 1933063 (0.0008) [2023-12-26 15:07:49,555][123090] Updated weights for policy 1, policy_version 1933073 (0.0008) [2023-12-26 15:07:49,611][123090] Updated weights for policy 1, policy_version 1933083 (0.0009) [2023-12-26 15:07:49,896][123091] Updated weights for policy 0, policy_version 1945236 (0.0010) [2023-12-26 15:07:49,970][123091] Updated weights for policy 0, policy_version 1945246 (0.0011) [2023-12-26 15:07:50,035][123091] Updated weights for policy 0, policy_version 1945256 (0.0011) [2023-12-26 15:07:50,421][123090] Updated weights for policy 1, policy_version 1933093 (0.0009) [2023-12-26 15:07:50,475][123090] Updated weights for policy 1, policy_version 1933103 (0.0009) [2023-12-26 15:07:50,529][123090] Updated weights for policy 1, policy_version 1933113 (0.0010) [2023-12-26 15:07:50,804][123091] Updated weights for policy 0, policy_version 1945266 (0.0010) [2023-12-26 15:07:50,869][123091] Updated weights for policy 0, policy_version 1945276 (0.0008) [2023-12-26 15:07:50,935][123091] Updated weights for policy 0, policy_version 1945286 (0.0008) [2023-12-26 15:07:50,996][123091] Updated weights for policy 0, policy_version 1945296 (0.0008) [2023-12-26 15:07:51,483][123090] Updated weights for policy 1, policy_version 1933123 (0.0010) [2023-12-26 15:07:51,550][123090] Updated weights for policy 1, policy_version 1933133 (0.0009) [2023-12-26 15:07:51,616][123090] Updated weights for policy 1, policy_version 1933143 (0.0009) [2023-12-26 15:07:51,780][123091] Updated weights for policy 0, policy_version 1945306 (0.0009) [2023-12-26 15:07:51,840][123091] Updated weights for policy 0, policy_version 1945316 (0.0010) [2023-12-26 15:07:51,889][123091] Updated weights for policy 0, policy_version 1945326 (0.0008) [2023-12-26 15:07:52,457][123090] Updated weights for policy 1, policy_version 1933153 (0.0008) [2023-12-26 15:07:52,520][123090] Updated weights for policy 1, policy_version 1933163 (0.0010) [2023-12-26 15:07:52,584][123090] Updated weights for policy 1, policy_version 1933173 (0.0011) [2023-12-26 15:07:52,642][123090] Updated weights for policy 1, policy_version 1933183 (0.0010) [2023-12-26 15:07:52,722][123091] Updated weights for policy 0, policy_version 1945336 (0.0010) [2023-12-26 15:07:52,773][123091] Updated weights for policy 0, policy_version 1945346 (0.0005) [2023-12-26 15:07:52,821][123091] Updated weights for policy 0, policy_version 1945356 (0.0006) [2023-12-26 15:07:53,480][123090] Updated weights for policy 1, policy_version 1933193 (0.0011) [2023-12-26 15:07:53,543][123090] Updated weights for policy 1, policy_version 1933203 (0.0011) [2023-12-26 15:07:53,596][123091] Updated weights for policy 0, policy_version 1945366 (0.0005) [2023-12-26 15:07:53,602][123090] Updated weights for policy 1, policy_version 1933213 (0.0010) [2023-12-26 15:07:53,653][123091] Updated weights for policy 0, policy_version 1945376 (0.0007) [2023-12-26 15:07:53,709][123091] Updated weights for policy 0, policy_version 1945386 (0.0008) [2023-12-26 15:07:53,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 992927744. Throughput: 0: 8974.4, 1: 8836.9. Samples: 992898876. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:53,785][121949] Avg episode reward: [(0, '6436.235'), (1, '5907.889')] [2023-12-26 15:07:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001945392_498024448.pth... [2023-12-26 15:07:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001933216_494903296.pth... [2023-12-26 15:07:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001944304_497745920.pth [2023-12-26 15:07:53,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001932160_494632960.pth [2023-12-26 15:07:54,427][123090] Updated weights for policy 1, policy_version 1933223 (0.0011) [2023-12-26 15:07:54,472][123091] Updated weights for policy 0, policy_version 1945396 (0.0008) [2023-12-26 15:07:54,482][123090] Updated weights for policy 1, policy_version 1933233 (0.0010) [2023-12-26 15:07:54,535][123091] Updated weights for policy 0, policy_version 1945406 (0.0006) [2023-12-26 15:07:54,544][123090] Updated weights for policy 1, policy_version 1933243 (0.0010) [2023-12-26 15:07:54,596][123091] Updated weights for policy 0, policy_version 1945416 (0.0009) [2023-12-26 15:07:55,324][123090] Updated weights for policy 1, policy_version 1933253 (0.0008) [2023-12-26 15:07:55,328][123091] Updated weights for policy 0, policy_version 1945426 (0.0009) [2023-12-26 15:07:55,383][123090] Updated weights for policy 1, policy_version 1933263 (0.0006) [2023-12-26 15:07:55,396][123091] Updated weights for policy 0, policy_version 1945436 (0.0011) [2023-12-26 15:07:55,444][123090] Updated weights for policy 1, policy_version 1933273 (0.0007) [2023-12-26 15:07:55,455][123091] Updated weights for policy 0, policy_version 1945446 (0.0010) [2023-12-26 15:07:55,522][123091] Updated weights for policy 0, policy_version 1945456 (0.0007) [2023-12-26 15:07:56,202][123091] Updated weights for policy 0, policy_version 1945466 (0.0005) [2023-12-26 15:07:56,226][123090] Updated weights for policy 1, policy_version 1933283 (0.0006) [2023-12-26 15:07:56,252][123091] Updated weights for policy 0, policy_version 1945476 (0.0006) [2023-12-26 15:07:56,283][123090] Updated weights for policy 1, policy_version 1933293 (0.0005) [2023-12-26 15:07:56,307][123091] Updated weights for policy 0, policy_version 1945486 (0.0005) [2023-12-26 15:07:56,345][123090] Updated weights for policy 1, policy_version 1933303 (0.0005) [2023-12-26 15:07:56,931][123090] Updated weights for policy 1, policy_version 1933313 (0.0006) [2023-12-26 15:07:56,959][123091] Updated weights for policy 0, policy_version 1945496 (0.0005) [2023-12-26 15:07:56,988][123090] Updated weights for policy 1, policy_version 1933323 (0.0008) [2023-12-26 15:07:57,007][123091] Updated weights for policy 0, policy_version 1945506 (0.0005) [2023-12-26 15:07:57,049][123090] Updated weights for policy 1, policy_version 1933333 (0.0009) [2023-12-26 15:07:57,053][123091] Updated weights for policy 0, policy_version 1945516 (0.0005) [2023-12-26 15:07:57,111][123090] Updated weights for policy 1, policy_version 1933343 (0.0009) [2023-12-26 15:07:57,684][123091] Updated weights for policy 0, policy_version 1945526 (0.0008) [2023-12-26 15:07:57,749][123091] Updated weights for policy 0, policy_version 1945536 (0.0008) [2023-12-26 15:07:57,813][123091] Updated weights for policy 0, policy_version 1945546 (0.0008) [2023-12-26 15:07:57,875][123090] Updated weights for policy 1, policy_version 1933353 (0.0006) [2023-12-26 15:07:57,919][123090] Updated weights for policy 1, policy_version 1933363 (0.0005) [2023-12-26 15:07:57,972][123090] Updated weights for policy 1, policy_version 1933373 (0.0005) [2023-12-26 15:07:58,507][123091] Updated weights for policy 0, policy_version 1945556 (0.0009) [2023-12-26 15:07:58,575][123091] Updated weights for policy 0, policy_version 1945566 (0.0008) [2023-12-26 15:07:58,637][123091] Updated weights for policy 0, policy_version 1945576 (0.0008) [2023-12-26 15:07:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 993017856. Throughput: 0: 9117.0, 1: 8890.5. Samples: 993010064. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:07:58,785][121949] Avg episode reward: [(0, '6356.927'), (1, '5822.623')] [2023-12-26 15:07:58,869][123090] Updated weights for policy 1, policy_version 1933383 (0.0007) [2023-12-26 15:07:58,935][123090] Updated weights for policy 1, policy_version 1933393 (0.0009) [2023-12-26 15:07:59,007][123090] Updated weights for policy 1, policy_version 1933403 (0.0009) [2023-12-26 15:07:59,552][123091] Updated weights for policy 0, policy_version 1945586 (0.0008) [2023-12-26 15:07:59,618][123091] Updated weights for policy 0, policy_version 1945596 (0.0011) [2023-12-26 15:07:59,676][123091] Updated weights for policy 0, policy_version 1945606 (0.0010) [2023-12-26 15:07:59,726][123091] Updated weights for policy 0, policy_version 1945616 (0.0010) [2023-12-26 15:07:59,859][123090] Updated weights for policy 1, policy_version 1933413 (0.0009) [2023-12-26 15:07:59,923][123090] Updated weights for policy 1, policy_version 1933423 (0.0009) [2023-12-26 15:07:59,986][123090] Updated weights for policy 1, policy_version 1933433 (0.0009) [2023-12-26 15:08:00,536][123091] Updated weights for policy 0, policy_version 1945626 (0.0009) [2023-12-26 15:08:00,588][123091] Updated weights for policy 0, policy_version 1945636 (0.0010) [2023-12-26 15:08:00,642][123091] Updated weights for policy 0, policy_version 1945646 (0.0010) [2023-12-26 15:08:00,811][123090] Updated weights for policy 1, policy_version 1933443 (0.0010) [2023-12-26 15:08:00,869][123090] Updated weights for policy 1, policy_version 1933453 (0.0009) [2023-12-26 15:08:00,930][123090] Updated weights for policy 1, policy_version 1933463 (0.0009) [2023-12-26 15:08:01,485][123091] Updated weights for policy 0, policy_version 1945656 (0.0009) [2023-12-26 15:08:01,543][123091] Updated weights for policy 0, policy_version 1945666 (0.0010) [2023-12-26 15:08:01,601][123091] Updated weights for policy 0, policy_version 1945676 (0.0008) [2023-12-26 15:08:01,777][123090] Updated weights for policy 1, policy_version 1933473 (0.0009) [2023-12-26 15:08:01,843][123090] Updated weights for policy 1, policy_version 1933483 (0.0009) [2023-12-26 15:08:01,901][123090] Updated weights for policy 1, policy_version 1933493 (0.0009) [2023-12-26 15:08:01,954][123090] Updated weights for policy 1, policy_version 1933503 (0.0006) [2023-12-26 15:08:02,423][123091] Updated weights for policy 0, policy_version 1945686 (0.0010) [2023-12-26 15:08:02,481][123091] Updated weights for policy 0, policy_version 1945696 (0.0010) [2023-12-26 15:08:02,549][123091] Updated weights for policy 0, policy_version 1945706 (0.0008) [2023-12-26 15:08:02,808][123090] Updated weights for policy 1, policy_version 1933513 (0.0010) [2023-12-26 15:08:02,871][123090] Updated weights for policy 1, policy_version 1933523 (0.0010) [2023-12-26 15:08:02,926][123090] Updated weights for policy 1, policy_version 1933533 (0.0010) [2023-12-26 15:08:03,374][123091] Updated weights for policy 0, policy_version 1945716 (0.0008) [2023-12-26 15:08:03,423][123091] Updated weights for policy 0, policy_version 1945726 (0.0005) [2023-12-26 15:08:03,484][123091] Updated weights for policy 0, policy_version 1945736 (0.0005) [2023-12-26 15:08:03,704][123090] Updated weights for policy 1, policy_version 1933543 (0.0008) [2023-12-26 15:08:03,751][123090] Updated weights for policy 1, policy_version 1933553 (0.0010) [2023-12-26 15:08:03,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17749.4, 300 sec: 17800.3). Total num frames: 993099776. Throughput: 0: 9123.1, 1: 8791.1. Samples: 993113360. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:03,785][121949] Avg episode reward: [(0, '6318.502'), (1, '5805.617')] [2023-12-26 15:08:03,797][123090] Updated weights for policy 1, policy_version 1933563 (0.0008) [2023-12-26 15:08:04,143][123091] Updated weights for policy 0, policy_version 1945746 (0.0007) [2023-12-26 15:08:04,207][123091] Updated weights for policy 0, policy_version 1945756 (0.0011) [2023-12-26 15:08:04,274][123091] Updated weights for policy 0, policy_version 1945766 (0.0010) [2023-12-26 15:08:04,337][123091] Updated weights for policy 0, policy_version 1945776 (0.0011) [2023-12-26 15:08:04,563][123090] Updated weights for policy 1, policy_version 1933573 (0.0005) [2023-12-26 15:08:04,625][123090] Updated weights for policy 1, policy_version 1933583 (0.0005) [2023-12-26 15:08:04,685][123090] Updated weights for policy 1, policy_version 1933593 (0.0005) [2023-12-26 15:08:05,165][123091] Updated weights for policy 0, policy_version 1945786 (0.0010) [2023-12-26 15:08:05,226][123091] Updated weights for policy 0, policy_version 1945796 (0.0009) [2023-12-26 15:08:05,290][123091] Updated weights for policy 0, policy_version 1945806 (0.0010) [2023-12-26 15:08:05,410][123090] Updated weights for policy 1, policy_version 1933603 (0.0007) [2023-12-26 15:08:05,479][123090] Updated weights for policy 1, policy_version 1933613 (0.0010) [2023-12-26 15:08:05,549][123090] Updated weights for policy 1, policy_version 1933623 (0.0010) [2023-12-26 15:08:06,036][123091] Updated weights for policy 0, policy_version 1945816 (0.0010) [2023-12-26 15:08:06,085][123091] Updated weights for policy 0, policy_version 1945826 (0.0009) [2023-12-26 15:08:06,155][123091] Updated weights for policy 0, policy_version 1945836 (0.0009) [2023-12-26 15:08:06,299][123090] Updated weights for policy 1, policy_version 1933633 (0.0009) [2023-12-26 15:08:06,354][123090] Updated weights for policy 1, policy_version 1933643 (0.0008) [2023-12-26 15:08:06,404][123090] Updated weights for policy 1, policy_version 1933653 (0.0009) [2023-12-26 15:08:06,465][123090] Updated weights for policy 1, policy_version 1933663 (0.0009) [2023-12-26 15:08:07,031][123091] Updated weights for policy 0, policy_version 1945846 (0.0010) [2023-12-26 15:08:07,094][123091] Updated weights for policy 0, policy_version 1945856 (0.0010) [2023-12-26 15:08:07,156][123091] Updated weights for policy 0, policy_version 1945866 (0.0009) [2023-12-26 15:08:07,298][123090] Updated weights for policy 1, policy_version 1933673 (0.0009) [2023-12-26 15:08:07,358][123090] Updated weights for policy 1, policy_version 1933683 (0.0009) [2023-12-26 15:08:07,422][123090] Updated weights for policy 1, policy_version 1933693 (0.0008) [2023-12-26 15:08:08,000][123091] Updated weights for policy 0, policy_version 1945876 (0.0010) [2023-12-26 15:08:08,061][123091] Updated weights for policy 0, policy_version 1945886 (0.0009) [2023-12-26 15:08:08,116][123091] Updated weights for policy 0, policy_version 1945896 (0.0009) [2023-12-26 15:08:08,174][123090] Updated weights for policy 1, policy_version 1933703 (0.0009) [2023-12-26 15:08:08,223][123090] Updated weights for policy 1, policy_version 1933713 (0.0009) [2023-12-26 15:08:08,289][123090] Updated weights for policy 1, policy_version 1933723 (0.0009) [2023-12-26 15:08:08,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 993189888. Throughput: 0: 9138.0, 1: 8823.7. Samples: 993167516. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:08,785][121949] Avg episode reward: [(0, '6360.592'), (1, '5994.569')] [2023-12-26 15:08:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001945904_498155520.pth... [2023-12-26 15:08:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001933728_495034368.pth... [2023-12-26 15:08:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001932736_494780416.pth [2023-12-26 15:08:08,803][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001944880_497893376.pth [2023-12-26 15:08:08,954][123091] Updated weights for policy 0, policy_version 1945906 (0.0008) [2023-12-26 15:08:09,013][123091] Updated weights for policy 0, policy_version 1945916 (0.0010) [2023-12-26 15:08:09,079][123091] Updated weights for policy 0, policy_version 1945926 (0.0006) [2023-12-26 15:08:09,135][123091] Updated weights for policy 0, policy_version 1945936 (0.0005) [2023-12-26 15:08:09,156][123090] Updated weights for policy 1, policy_version 1933733 (0.0009) [2023-12-26 15:08:09,222][123090] Updated weights for policy 1, policy_version 1933743 (0.0010) [2023-12-26 15:08:09,295][123090] Updated weights for policy 1, policy_version 1933753 (0.0008) [2023-12-26 15:08:09,868][123091] Updated weights for policy 0, policy_version 1945946 (0.0009) [2023-12-26 15:08:09,931][123091] Updated weights for policy 0, policy_version 1945956 (0.0007) [2023-12-26 15:08:10,002][123091] Updated weights for policy 0, policy_version 1945966 (0.0011) [2023-12-26 15:08:10,149][123090] Updated weights for policy 1, policy_version 1933763 (0.0007) [2023-12-26 15:08:10,209][123090] Updated weights for policy 1, policy_version 1933773 (0.0009) [2023-12-26 15:08:10,282][123090] Updated weights for policy 1, policy_version 1933783 (0.0009) [2023-12-26 15:08:10,822][123091] Updated weights for policy 0, policy_version 1945976 (0.0010) [2023-12-26 15:08:10,876][123091] Updated weights for policy 0, policy_version 1945986 (0.0010) [2023-12-26 15:08:10,941][123091] Updated weights for policy 0, policy_version 1945996 (0.0010) [2023-12-26 15:08:11,109][123090] Updated weights for policy 1, policy_version 1933793 (0.0010) [2023-12-26 15:08:11,189][123090] Updated weights for policy 1, policy_version 1933803 (0.0008) [2023-12-26 15:08:11,268][123090] Updated weights for policy 1, policy_version 1933813 (0.0008) [2023-12-26 15:08:11,340][123090] Updated weights for policy 1, policy_version 1933823 (0.0008) [2023-12-26 15:08:11,864][123091] Updated weights for policy 0, policy_version 1946006 (0.0010) [2023-12-26 15:08:11,930][123091] Updated weights for policy 0, policy_version 1946016 (0.0008) [2023-12-26 15:08:12,004][123091] Updated weights for policy 0, policy_version 1946026 (0.0006) [2023-12-26 15:08:12,148][123090] Updated weights for policy 1, policy_version 1933833 (0.0007) [2023-12-26 15:08:12,214][123090] Updated weights for policy 1, policy_version 1933843 (0.0005) [2023-12-26 15:08:12,282][123090] Updated weights for policy 1, policy_version 1933853 (0.0007) [2023-12-26 15:08:12,800][123091] Updated weights for policy 0, policy_version 1946036 (0.0006) [2023-12-26 15:08:12,868][123091] Updated weights for policy 0, policy_version 1946046 (0.0005) [2023-12-26 15:08:12,939][123091] Updated weights for policy 0, policy_version 1946056 (0.0007) [2023-12-26 15:08:13,087][123090] Updated weights for policy 1, policy_version 1933863 (0.0009) [2023-12-26 15:08:13,149][123090] Updated weights for policy 1, policy_version 1933873 (0.0009) [2023-12-26 15:08:13,205][123090] Updated weights for policy 1, policy_version 1933883 (0.0008) [2023-12-26 15:08:13,694][123091] Updated weights for policy 0, policy_version 1946066 (0.0009) [2023-12-26 15:08:13,757][123091] Updated weights for policy 0, policy_version 1946076 (0.0009) [2023-12-26 15:08:13,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 993271808. Throughput: 0: 9038.6, 1: 8703.0. Samples: 993270372. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:13,785][121949] Avg episode reward: [(0, '6310.480'), (1, '5878.808')] [2023-12-26 15:08:13,823][123091] Updated weights for policy 0, policy_version 1946086 (0.0009) [2023-12-26 15:08:13,884][123091] Updated weights for policy 0, policy_version 1946096 (0.0010) [2023-12-26 15:08:14,049][123090] Updated weights for policy 1, policy_version 1933893 (0.0010) [2023-12-26 15:08:14,107][123090] Updated weights for policy 1, policy_version 1933903 (0.0008) [2023-12-26 15:08:14,169][123090] Updated weights for policy 1, policy_version 1933913 (0.0010) [2023-12-26 15:08:14,676][123091] Updated weights for policy 0, policy_version 1946106 (0.0009) [2023-12-26 15:08:14,732][123091] Updated weights for policy 0, policy_version 1946116 (0.0009) [2023-12-26 15:08:14,795][123091] Updated weights for policy 0, policy_version 1946126 (0.0009) [2023-12-26 15:08:14,984][123090] Updated weights for policy 1, policy_version 1933923 (0.0008) [2023-12-26 15:08:15,051][123090] Updated weights for policy 1, policy_version 1933933 (0.0006) [2023-12-26 15:08:15,112][123090] Updated weights for policy 1, policy_version 1933943 (0.0010) [2023-12-26 15:08:15,624][123091] Updated weights for policy 0, policy_version 1946137 (0.0008) [2023-12-26 15:08:15,679][123091] Updated weights for policy 0, policy_version 1946147 (0.0010) [2023-12-26 15:08:15,728][123091] Updated weights for policy 0, policy_version 1946157 (0.0009) [2023-12-26 15:08:15,924][123090] Updated weights for policy 1, policy_version 1933953 (0.0010) [2023-12-26 15:08:15,983][123090] Updated weights for policy 1, policy_version 1933963 (0.0009) [2023-12-26 15:08:16,042][123090] Updated weights for policy 1, policy_version 1933973 (0.0010) [2023-12-26 15:08:16,106][123090] Updated weights for policy 1, policy_version 1933983 (0.0010) [2023-12-26 15:08:16,524][123091] Updated weights for policy 0, policy_version 1946167 (0.0009) [2023-12-26 15:08:16,590][123091] Updated weights for policy 0, policy_version 1946177 (0.0009) [2023-12-26 15:08:16,650][123091] Updated weights for policy 0, policy_version 1946187 (0.0009) [2023-12-26 15:08:16,924][123090] Updated weights for policy 1, policy_version 1933993 (0.0006) [2023-12-26 15:08:16,988][123090] Updated weights for policy 1, policy_version 1934003 (0.0008) [2023-12-26 15:08:17,046][123090] Updated weights for policy 1, policy_version 1934013 (0.0010) [2023-12-26 15:08:17,518][123091] Updated weights for policy 0, policy_version 1946197 (0.0010) [2023-12-26 15:08:17,582][123091] Updated weights for policy 0, policy_version 1946207 (0.0010) [2023-12-26 15:08:17,649][123091] Updated weights for policy 0, policy_version 1946217 (0.0010) [2023-12-26 15:08:17,746][123090] Updated weights for policy 1, policy_version 1934023 (0.0007) [2023-12-26 15:08:17,807][123090] Updated weights for policy 1, policy_version 1934033 (0.0005) [2023-12-26 15:08:17,873][123090] Updated weights for policy 1, policy_version 1934043 (0.0007) [2023-12-26 15:08:18,534][123091] Updated weights for policy 0, policy_version 1946227 (0.0010) [2023-12-26 15:08:18,588][123091] Updated weights for policy 0, policy_version 1946237 (0.0009) [2023-12-26 15:08:18,642][123091] Updated weights for policy 0, policy_version 1946247 (0.0009) [2023-12-26 15:08:18,711][123090] Updated weights for policy 1, policy_version 1934053 (0.0009) [2023-12-26 15:08:18,782][123090] Updated weights for policy 1, policy_version 1934063 (0.0006) [2023-12-26 15:08:18,784][121949] Fps is (10 sec: 17203.6, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 993361920. Throughput: 0: 8911.4, 1: 8638.2. Samples: 993374168. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:18,784][121949] Avg episode reward: [(0, '6318.672'), (1, '5751.214')] [2023-12-26 15:08:18,849][123090] Updated weights for policy 1, policy_version 1934073 (0.0005) [2023-12-26 15:08:19,502][123091] Updated weights for policy 0, policy_version 1946257 (0.0009) [2023-12-26 15:08:19,506][123090] Updated weights for policy 1, policy_version 1934083 (0.0006) [2023-12-26 15:08:19,557][123090] Updated weights for policy 1, policy_version 1934093 (0.0006) [2023-12-26 15:08:19,562][123091] Updated weights for policy 0, policy_version 1946267 (0.0009) [2023-12-26 15:08:19,617][123090] Updated weights for policy 1, policy_version 1934103 (0.0006) [2023-12-26 15:08:19,628][123091] Updated weights for policy 0, policy_version 1946277 (0.0008) [2023-12-26 15:08:19,692][123091] Updated weights for policy 0, policy_version 1946287 (0.0009) [2023-12-26 15:08:20,298][123090] Updated weights for policy 1, policy_version 1934113 (0.0005) [2023-12-26 15:08:20,363][123090] Updated weights for policy 1, policy_version 1934123 (0.0007) [2023-12-26 15:08:20,427][123090] Updated weights for policy 1, policy_version 1934133 (0.0005) [2023-12-26 15:08:20,483][123090] Updated weights for policy 1, policy_version 1934143 (0.0005) [2023-12-26 15:08:20,566][123091] Updated weights for policy 0, policy_version 1946297 (0.0009) [2023-12-26 15:08:20,638][123091] Updated weights for policy 0, policy_version 1946307 (0.0009) [2023-12-26 15:08:20,715][123091] Updated weights for policy 0, policy_version 1946317 (0.0010) [2023-12-26 15:08:21,088][123090] Updated weights for policy 1, policy_version 1934153 (0.0013) [2023-12-26 15:08:21,209][123090] Updated weights for policy 1, policy_version 1934163 (0.0010) [2023-12-26 15:08:21,280][123090] Updated weights for policy 1, policy_version 1934173 (0.0009) [2023-12-26 15:08:21,700][123091] Updated weights for policy 0, policy_version 1946327 (0.0009) [2023-12-26 15:08:21,765][123091] Updated weights for policy 0, policy_version 1946337 (0.0009) [2023-12-26 15:08:21,827][123091] Updated weights for policy 0, policy_version 1946347 (0.0009) [2023-12-26 15:08:22,107][123090] Updated weights for policy 1, policy_version 1934183 (0.0011) [2023-12-26 15:08:22,171][123090] Updated weights for policy 1, policy_version 1934193 (0.0011) [2023-12-26 15:08:22,223][123090] Updated weights for policy 1, policy_version 1934203 (0.0010) [2023-12-26 15:08:22,699][123091] Updated weights for policy 0, policy_version 1946357 (0.0009) [2023-12-26 15:08:22,761][123091] Updated weights for policy 0, policy_version 1946367 (0.0009) [2023-12-26 15:08:22,823][123091] Updated weights for policy 0, policy_version 1946377 (0.0009) [2023-12-26 15:08:23,088][123090] Updated weights for policy 1, policy_version 1934213 (0.0011) [2023-12-26 15:08:23,156][123090] Updated weights for policy 1, policy_version 1934223 (0.0011) [2023-12-26 15:08:23,219][123090] Updated weights for policy 1, policy_version 1934233 (0.0010) [2023-12-26 15:08:23,667][123091] Updated weights for policy 0, policy_version 1946387 (0.0009) [2023-12-26 15:08:23,731][123091] Updated weights for policy 0, policy_version 1946397 (0.0009) [2023-12-26 15:08:23,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 993443840. Throughput: 0: 8794.1, 1: 8666.5. Samples: 993425824. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:23,784][121949] Avg episode reward: [(0, '6237.067'), (1, '5839.226')] [2023-12-26 15:08:23,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001934240_495165440.pth... [2023-12-26 15:08:23,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001933216_494903296.pth [2023-12-26 15:08:23,796][123091] Updated weights for policy 0, policy_version 1946407 (0.0009) [2023-12-26 15:08:23,850][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001946416_498286592.pth... [2023-12-26 15:08:23,855][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001945392_498024448.pth [2023-12-26 15:08:24,039][123090] Updated weights for policy 1, policy_version 1934243 (0.0011) [2023-12-26 15:08:24,096][123090] Updated weights for policy 1, policy_version 1934253 (0.0011) [2023-12-26 15:08:24,143][123090] Updated weights for policy 1, policy_version 1934263 (0.0010) [2023-12-26 15:08:24,538][123091] Updated weights for policy 0, policy_version 1946417 (0.0009) [2023-12-26 15:08:24,593][123091] Updated weights for policy 0, policy_version 1946429 (0.0011) [2023-12-26 15:08:24,657][123091] Updated weights for policy 0, policy_version 1946439 (0.0010) [2023-12-26 15:08:24,862][123090] Updated weights for policy 1, policy_version 1934273 (0.0006) [2023-12-26 15:08:24,912][123090] Updated weights for policy 1, policy_version 1934283 (0.0005) [2023-12-26 15:08:24,967][123090] Updated weights for policy 1, policy_version 1934293 (0.0005) [2023-12-26 15:08:25,022][123090] Updated weights for policy 1, policy_version 1934303 (0.0005) [2023-12-26 15:08:25,575][123091] Updated weights for policy 0, policy_version 1946449 (0.0010) [2023-12-26 15:08:25,639][123091] Updated weights for policy 0, policy_version 1946459 (0.0009) [2023-12-26 15:08:25,695][123091] Updated weights for policy 0, policy_version 1946470 (0.0010) [2023-12-26 15:08:25,742][123090] Updated weights for policy 1, policy_version 1934313 (0.0007) [2023-12-26 15:08:25,751][123091] Updated weights for policy 0, policy_version 1946480 (0.0009) [2023-12-26 15:08:25,803][123090] Updated weights for policy 1, policy_version 1934323 (0.0005) [2023-12-26 15:08:25,858][123090] Updated weights for policy 1, policy_version 1934333 (0.0009) [2023-12-26 15:08:26,536][123090] Updated weights for policy 1, policy_version 1934343 (0.0008) [2023-12-26 15:08:26,599][123090] Updated weights for policy 1, policy_version 1934353 (0.0006) [2023-12-26 15:08:26,636][123091] Updated weights for policy 0, policy_version 1946491 (0.0010) [2023-12-26 15:08:26,657][123090] Updated weights for policy 1, policy_version 1934363 (0.0006) [2023-12-26 15:08:26,693][123091] Updated weights for policy 0, policy_version 1946502 (0.0009) [2023-12-26 15:08:26,747][123091] Updated weights for policy 0, policy_version 1946512 (0.0008) [2023-12-26 15:08:27,483][123091] Updated weights for policy 0, policy_version 1946522 (0.0006) [2023-12-26 15:08:27,498][123090] Updated weights for policy 1, policy_version 1934373 (0.0008) [2023-12-26 15:08:27,534][123091] Updated weights for policy 0, policy_version 1946532 (0.0006) [2023-12-26 15:08:27,561][123090] Updated weights for policy 1, policy_version 1934383 (0.0009) [2023-12-26 15:08:27,594][123091] Updated weights for policy 0, policy_version 1946542 (0.0005) [2023-12-26 15:08:27,618][123090] Updated weights for policy 1, policy_version 1934393 (0.0005) [2023-12-26 15:08:28,319][123090] Updated weights for policy 1, policy_version 1934403 (0.0006) [2023-12-26 15:08:28,360][123091] Updated weights for policy 0, policy_version 1946552 (0.0008) [2023-12-26 15:08:28,385][123090] Updated weights for policy 1, policy_version 1934413 (0.0008) [2023-12-26 15:08:28,420][123091] Updated weights for policy 0, policy_version 1946562 (0.0007) [2023-12-26 15:08:28,447][123090] Updated weights for policy 1, policy_version 1934423 (0.0008) [2023-12-26 15:08:28,479][123091] Updated weights for policy 0, policy_version 1946572 (0.0010) [2023-12-26 15:08:28,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17800.2). Total num frames: 993542144. Throughput: 0: 8775.3, 1: 8766.9. Samples: 993532208. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:28,785][121949] Avg episode reward: [(0, '6215.073'), (1, '5751.973')] [2023-12-26 15:08:29,194][123090] Updated weights for policy 1, policy_version 1934433 (0.0006) [2023-12-26 15:08:29,259][123090] Updated weights for policy 1, policy_version 1934443 (0.0008) [2023-12-26 15:08:29,291][123091] Updated weights for policy 0, policy_version 1946582 (0.0009) [2023-12-26 15:08:29,322][123090] Updated weights for policy 1, policy_version 1934453 (0.0006) [2023-12-26 15:08:29,360][123091] Updated weights for policy 0, policy_version 1946592 (0.0010) [2023-12-26 15:08:29,387][123090] Updated weights for policy 1, policy_version 1934463 (0.0009) [2023-12-26 15:08:29,417][123091] Updated weights for policy 0, policy_version 1946602 (0.0009) [2023-12-26 15:08:30,180][123091] Updated weights for policy 0, policy_version 1946612 (0.0008) [2023-12-26 15:08:30,186][123090] Updated weights for policy 1, policy_version 1934473 (0.0011) [2023-12-26 15:08:30,226][123091] Updated weights for policy 0, policy_version 1946622 (0.0008) [2023-12-26 15:08:30,252][123090] Updated weights for policy 1, policy_version 1934483 (0.0010) [2023-12-26 15:08:30,272][123091] Updated weights for policy 0, policy_version 1946632 (0.0008) [2023-12-26 15:08:30,304][123090] Updated weights for policy 1, policy_version 1934493 (0.0010) [2023-12-26 15:08:31,010][123091] Updated weights for policy 0, policy_version 1946642 (0.0008) [2023-12-26 15:08:31,077][123090] Updated weights for policy 1, policy_version 1934503 (0.0008) [2023-12-26 15:08:31,083][123091] Updated weights for policy 0, policy_version 1946652 (0.0009) [2023-12-26 15:08:31,127][123090] Updated weights for policy 1, policy_version 1934513 (0.0006) [2023-12-26 15:08:31,139][123091] Updated weights for policy 0, policy_version 1946662 (0.0010) [2023-12-26 15:08:31,193][123090] Updated weights for policy 1, policy_version 1934523 (0.0008) [2023-12-26 15:08:31,205][123091] Updated weights for policy 0, policy_version 1946672 (0.0007) [2023-12-26 15:08:31,952][123090] Updated weights for policy 1, policy_version 1934533 (0.0009) [2023-12-26 15:08:32,016][123090] Updated weights for policy 1, policy_version 1934543 (0.0007) [2023-12-26 15:08:32,082][123091] Updated weights for policy 0, policy_version 1946682 (0.0008) [2023-12-26 15:08:32,083][123090] Updated weights for policy 1, policy_version 1934553 (0.0007) [2023-12-26 15:08:32,143][123091] Updated weights for policy 0, policy_version 1946692 (0.0009) [2023-12-26 15:08:32,201][123091] Updated weights for policy 0, policy_version 1946703 (0.0010) [2023-12-26 15:08:32,772][123090] Updated weights for policy 1, policy_version 1934563 (0.0006) [2023-12-26 15:08:32,823][123090] Updated weights for policy 1, policy_version 1934573 (0.0005) [2023-12-26 15:08:32,872][123090] Updated weights for policy 1, policy_version 1934583 (0.0005) [2023-12-26 15:08:33,100][123091] Updated weights for policy 0, policy_version 1946713 (0.0010) [2023-12-26 15:08:33,151][123091] Updated weights for policy 0, policy_version 1946723 (0.0009) [2023-12-26 15:08:33,208][123091] Updated weights for policy 0, policy_version 1946733 (0.0009) [2023-12-26 15:08:33,692][123090] Updated weights for policy 1, policy_version 1934593 (0.0006) [2023-12-26 15:08:33,754][123090] Updated weights for policy 1, policy_version 1934603 (0.0010) [2023-12-26 15:08:33,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17744.7). Total num frames: 993624064. Throughput: 0: 8737.5, 1: 8887.0. Samples: 993640540. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:33,785][121949] Avg episode reward: [(0, '6047.569'), (1, '5708.086')] [2023-12-26 15:08:33,807][123090] Updated weights for policy 1, policy_version 1934614 (0.0010) [2023-12-26 15:08:33,887][123091] Updated weights for policy 0, policy_version 1946743 (0.0007) [2023-12-26 15:08:33,940][123091] Updated weights for policy 0, policy_version 1946753 (0.0009) [2023-12-26 15:08:33,998][123091] Updated weights for policy 0, policy_version 1946763 (0.0010) [2023-12-26 15:08:34,720][123090] Updated weights for policy 1, policy_version 1934625 (0.0009) [2023-12-26 15:08:34,763][123091] Updated weights for policy 0, policy_version 1946773 (0.0011) [2023-12-26 15:08:34,778][123090] Updated weights for policy 1, policy_version 1934635 (0.0008) [2023-12-26 15:08:34,823][123091] Updated weights for policy 0, policy_version 1946783 (0.0010) [2023-12-26 15:08:34,838][123090] Updated weights for policy 1, policy_version 1934645 (0.0005) [2023-12-26 15:08:34,877][123091] Updated weights for policy 0, policy_version 1946793 (0.0010) [2023-12-26 15:08:34,893][123090] Updated weights for policy 1, policy_version 1934655 (0.0009) [2023-12-26 15:08:35,674][123091] Updated weights for policy 0, policy_version 1946803 (0.0009) [2023-12-26 15:08:35,734][123091] Updated weights for policy 0, policy_version 1946813 (0.0005) [2023-12-26 15:08:35,749][123090] Updated weights for policy 1, policy_version 1934665 (0.0009) [2023-12-26 15:08:35,795][123091] Updated weights for policy 0, policy_version 1946823 (0.0005) [2023-12-26 15:08:35,800][123090] Updated weights for policy 1, policy_version 1934676 (0.0010) [2023-12-26 15:08:35,858][123090] Updated weights for policy 1, policy_version 1934686 (0.0009) [2023-12-26 15:08:36,550][123091] Updated weights for policy 0, policy_version 1946833 (0.0005) [2023-12-26 15:08:36,623][123091] Updated weights for policy 0, policy_version 1946843 (0.0009) [2023-12-26 15:08:36,693][123091] Updated weights for policy 0, policy_version 1946853 (0.0009) [2023-12-26 15:08:36,730][123090] Updated weights for policy 1, policy_version 1934696 (0.0008) [2023-12-26 15:08:36,762][123091] Updated weights for policy 0, policy_version 1946863 (0.0008) [2023-12-26 15:08:36,803][123090] Updated weights for policy 1, policy_version 1934706 (0.0006) [2023-12-26 15:08:36,873][123090] Updated weights for policy 1, policy_version 1934716 (0.0005) [2023-12-26 15:08:37,586][123091] Updated weights for policy 0, policy_version 1946873 (0.0010) [2023-12-26 15:08:37,596][123090] Updated weights for policy 1, policy_version 1934726 (0.0007) [2023-12-26 15:08:37,656][123091] Updated weights for policy 0, policy_version 1946883 (0.0011) [2023-12-26 15:08:37,662][123090] Updated weights for policy 1, policy_version 1934736 (0.0009) [2023-12-26 15:08:37,725][123091] Updated weights for policy 0, policy_version 1946893 (0.0011) [2023-12-26 15:08:37,725][123090] Updated weights for policy 1, policy_version 1934746 (0.0008) [2023-12-26 15:08:38,393][123090] Updated weights for policy 1, policy_version 1934756 (0.0008) [2023-12-26 15:08:38,461][123091] Updated weights for policy 0, policy_version 1946903 (0.0009) [2023-12-26 15:08:38,461][123090] Updated weights for policy 1, policy_version 1934766 (0.0008) [2023-12-26 15:08:38,514][123091] Updated weights for policy 0, policy_version 1946913 (0.0008) [2023-12-26 15:08:38,531][123090] Updated weights for policy 1, policy_version 1934776 (0.0008) [2023-12-26 15:08:38,574][123091] Updated weights for policy 0, policy_version 1946923 (0.0009) [2023-12-26 15:08:38,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17800.2). Total num frames: 993722368. Throughput: 0: 8772.3, 1: 8887.0. Samples: 993693540. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:38,785][121949] Avg episode reward: [(0, '6090.827'), (1, '5820.701')] [2023-12-26 15:08:38,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001934784_495304704.pth... [2023-12-26 15:08:38,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001946928_498417664.pth... [2023-12-26 15:08:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001933728_495034368.pth [2023-12-26 15:08:38,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001945904_498155520.pth [2023-12-26 15:08:39,274][123090] Updated weights for policy 1, policy_version 1934786 (0.0008) [2023-12-26 15:08:39,340][123090] Updated weights for policy 1, policy_version 1934796 (0.0010) [2023-12-26 15:08:39,415][123090] Updated weights for policy 1, policy_version 1934806 (0.0009) [2023-12-26 15:08:39,436][123091] Updated weights for policy 0, policy_version 1946933 (0.0009) [2023-12-26 15:08:39,481][123090] Updated weights for policy 1, policy_version 1934816 (0.0009) [2023-12-26 15:08:39,505][123091] Updated weights for policy 0, policy_version 1946943 (0.0009) [2023-12-26 15:08:39,573][123091] Updated weights for policy 0, policy_version 1946953 (0.0009) [2023-12-26 15:08:40,337][123091] Updated weights for policy 0, policy_version 1946963 (0.0006) [2023-12-26 15:08:40,365][123090] Updated weights for policy 1, policy_version 1934826 (0.0010) [2023-12-26 15:08:40,402][123091] Updated weights for policy 0, policy_version 1946973 (0.0009) [2023-12-26 15:08:40,426][123090] Updated weights for policy 1, policy_version 1934836 (0.0007) [2023-12-26 15:08:40,463][123091] Updated weights for policy 0, policy_version 1946983 (0.0008) [2023-12-26 15:08:40,487][123090] Updated weights for policy 1, policy_version 1934846 (0.0007) [2023-12-26 15:08:41,311][123091] Updated weights for policy 0, policy_version 1946993 (0.0009) [2023-12-26 15:08:41,380][123091] Updated weights for policy 0, policy_version 1947003 (0.0010) [2023-12-26 15:08:41,386][123090] Updated weights for policy 1, policy_version 1934856 (0.0009) [2023-12-26 15:08:41,449][123090] Updated weights for policy 1, policy_version 1934866 (0.0008) [2023-12-26 15:08:41,449][123091] Updated weights for policy 0, policy_version 1947013 (0.0008) [2023-12-26 15:08:41,505][123090] Updated weights for policy 1, policy_version 1934876 (0.0005) [2023-12-26 15:08:41,516][123091] Updated weights for policy 0, policy_version 1947023 (0.0008) [2023-12-26 15:08:42,319][123090] Updated weights for policy 1, policy_version 1934886 (0.0008) [2023-12-26 15:08:42,387][123091] Updated weights for policy 0, policy_version 1947033 (0.0007) [2023-12-26 15:08:42,392][123090] Updated weights for policy 1, policy_version 1934896 (0.0007) [2023-12-26 15:08:42,453][123091] Updated weights for policy 0, policy_version 1947043 (0.0008) [2023-12-26 15:08:42,463][123090] Updated weights for policy 1, policy_version 1934906 (0.0006) [2023-12-26 15:08:42,510][123091] Updated weights for policy 0, policy_version 1947053 (0.0009) [2023-12-26 15:08:43,262][123090] Updated weights for policy 1, policy_version 1934916 (0.0006) [2023-12-26 15:08:43,262][123091] Updated weights for policy 0, policy_version 1947063 (0.0009) [2023-12-26 15:08:43,312][123091] Updated weights for policy 0, policy_version 1947073 (0.0008) [2023-12-26 15:08:43,325][123090] Updated weights for policy 1, policy_version 1934926 (0.0009) [2023-12-26 15:08:43,363][123091] Updated weights for policy 0, policy_version 1947083 (0.0008) [2023-12-26 15:08:43,390][123090] Updated weights for policy 1, policy_version 1934936 (0.0009) [2023-12-26 15:08:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17800.2). Total num frames: 993804288. Throughput: 0: 8620.1, 1: 8882.7. Samples: 993797688. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:43,785][121949] Avg episode reward: [(0, '6263.141'), (1, '5878.414')] [2023-12-26 15:08:44,185][123091] Updated weights for policy 0, policy_version 1947093 (0.0009) [2023-12-26 15:08:44,216][123090] Updated weights for policy 1, policy_version 1934946 (0.0008) [2023-12-26 15:08:44,237][123091] Updated weights for policy 0, policy_version 1947103 (0.0008) [2023-12-26 15:08:44,281][123090] Updated weights for policy 1, policy_version 1934956 (0.0010) [2023-12-26 15:08:44,293][123091] Updated weights for policy 0, policy_version 1947113 (0.0007) [2023-12-26 15:08:44,343][123090] Updated weights for policy 1, policy_version 1934966 (0.0010) [2023-12-26 15:08:44,409][123090] Updated weights for policy 1, policy_version 1934976 (0.0009) [2023-12-26 15:08:45,021][123091] Updated weights for policy 0, policy_version 1947123 (0.0006) [2023-12-26 15:08:45,090][123091] Updated weights for policy 0, policy_version 1947133 (0.0007) [2023-12-26 15:08:45,140][123091] Updated weights for policy 0, policy_version 1947143 (0.0006) [2023-12-26 15:08:45,312][123090] Updated weights for policy 1, policy_version 1934986 (0.0009) [2023-12-26 15:08:45,370][123090] Updated weights for policy 1, policy_version 1934997 (0.0010) [2023-12-26 15:08:45,447][123090] Updated weights for policy 1, policy_version 1935007 (0.0007) [2023-12-26 15:08:45,866][123091] Updated weights for policy 0, policy_version 1947153 (0.0006) [2023-12-26 15:08:45,911][123091] Updated weights for policy 0, policy_version 1947163 (0.0005) [2023-12-26 15:08:45,961][123091] Updated weights for policy 0, policy_version 1947173 (0.0006) [2023-12-26 15:08:46,015][123091] Updated weights for policy 0, policy_version 1947183 (0.0005) [2023-12-26 15:08:46,349][123090] Updated weights for policy 1, policy_version 1935017 (0.0010) [2023-12-26 15:08:46,405][123090] Updated weights for policy 1, policy_version 1935027 (0.0009) [2023-12-26 15:08:46,453][123090] Updated weights for policy 1, policy_version 1935037 (0.0009) [2023-12-26 15:08:46,646][123091] Updated weights for policy 0, policy_version 1947193 (0.0008) [2023-12-26 15:08:46,697][123091] Updated weights for policy 0, policy_version 1947204 (0.0009) [2023-12-26 15:08:46,747][123091] Updated weights for policy 0, policy_version 1947214 (0.0009) [2023-12-26 15:08:47,261][123090] Updated weights for policy 1, policy_version 1935047 (0.0009) [2023-12-26 15:08:47,313][123090] Updated weights for policy 1, policy_version 1935057 (0.0009) [2023-12-26 15:08:47,365][123090] Updated weights for policy 1, policy_version 1935067 (0.0009) [2023-12-26 15:08:47,526][123091] Updated weights for policy 0, policy_version 1947224 (0.0006) [2023-12-26 15:08:47,578][123091] Updated weights for policy 0, policy_version 1947234 (0.0006) [2023-12-26 15:08:47,635][123091] Updated weights for policy 0, policy_version 1947244 (0.0005) [2023-12-26 15:08:48,331][123091] Updated weights for policy 0, policy_version 1947254 (0.0009) [2023-12-26 15:08:48,346][123090] Updated weights for policy 1, policy_version 1935077 (0.0009) [2023-12-26 15:08:48,397][123091] Updated weights for policy 0, policy_version 1947264 (0.0007) [2023-12-26 15:08:48,412][123090] Updated weights for policy 1, policy_version 1935087 (0.0009) [2023-12-26 15:08:48,462][123091] Updated weights for policy 0, policy_version 1947274 (0.0006) [2023-12-26 15:08:48,477][123090] Updated weights for policy 1, policy_version 1935097 (0.0009) [2023-12-26 15:08:48,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17772.5). Total num frames: 993894400. Throughput: 0: 8716.4, 1: 8836.7. Samples: 993903248. Policy #0 lag: (min: 31.0, avg: 38.9, max: 63.0) [2023-12-26 15:08:48,785][121949] Avg episode reward: [(0, '6189.347'), (1, '5923.373')] [2023-12-26 15:08:49,212][123091] Updated weights for policy 0, policy_version 1947284 (0.0007) [2023-12-26 15:08:49,280][123091] Updated weights for policy 0, policy_version 1947294 (0.0008) [2023-12-26 15:08:49,307][123090] Updated weights for policy 1, policy_version 1935107 (0.0009) [2023-12-26 15:08:49,339][123091] Updated weights for policy 0, policy_version 1947304 (0.0008) [2023-12-26 15:08:49,381][123090] Updated weights for policy 1, policy_version 1935117 (0.0009) [2023-12-26 15:08:49,445][123090] Updated weights for policy 1, policy_version 1935127 (0.0008) [2023-12-26 15:08:50,170][123090] Updated weights for policy 1, policy_version 1935137 (0.0006) [2023-12-26 15:08:50,181][123091] Updated weights for policy 0, policy_version 1947314 (0.0008) [2023-12-26 15:08:50,231][123090] Updated weights for policy 1, policy_version 1935147 (0.0010) [2023-12-26 15:08:50,237][123091] Updated weights for policy 0, policy_version 1947324 (0.0007) [2023-12-26 15:08:50,293][123090] Updated weights for policy 1, policy_version 1935157 (0.0008) [2023-12-26 15:08:50,300][123091] Updated weights for policy 0, policy_version 1947334 (0.0007) [2023-12-26 15:08:50,357][123091] Updated weights for policy 0, policy_version 1947344 (0.0007) [2023-12-26 15:08:50,360][123090] Updated weights for policy 1, policy_version 1935167 (0.0008) [2023-12-26 15:08:51,127][123091] Updated weights for policy 0, policy_version 1947354 (0.0009) [2023-12-26 15:08:51,180][123090] Updated weights for policy 1, policy_version 1935177 (0.0008) [2023-12-26 15:08:51,190][123091] Updated weights for policy 0, policy_version 1947364 (0.0011) [2023-12-26 15:08:51,247][123090] Updated weights for policy 1, policy_version 1935187 (0.0007) [2023-12-26 15:08:51,250][123091] Updated weights for policy 0, policy_version 1947374 (0.0011) [2023-12-26 15:08:51,323][123090] Updated weights for policy 1, policy_version 1935197 (0.0007) [2023-12-26 15:08:51,981][123091] Updated weights for policy 0, policy_version 1947384 (0.0009) [2023-12-26 15:08:52,038][123090] Updated weights for policy 1, policy_version 1935207 (0.0008) [2023-12-26 15:08:52,042][123091] Updated weights for policy 0, policy_version 1947394 (0.0009) [2023-12-26 15:08:52,095][123091] Updated weights for policy 0, policy_version 1947404 (0.0009) [2023-12-26 15:08:52,095][123090] Updated weights for policy 1, policy_version 1935217 (0.0009) [2023-12-26 15:08:52,153][123090] Updated weights for policy 1, policy_version 1935227 (0.0009) [2023-12-26 15:08:52,973][123091] Updated weights for policy 0, policy_version 1947414 (0.0010) [2023-12-26 15:08:53,025][123091] Updated weights for policy 0, policy_version 1947424 (0.0009) [2023-12-26 15:08:53,036][123090] Updated weights for policy 1, policy_version 1935237 (0.0008) [2023-12-26 15:08:53,087][123091] Updated weights for policy 0, policy_version 1947434 (0.0009) [2023-12-26 15:08:53,103][123090] Updated weights for policy 1, policy_version 1935247 (0.0008) [2023-12-26 15:08:53,155][123090] Updated weights for policy 1, policy_version 1935257 (0.0009) [2023-12-26 15:08:53,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17772.5). Total num frames: 993976320. Throughput: 0: 8744.4, 1: 8799.5. Samples: 993956992. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:08:53,785][121949] Avg episode reward: [(0, '6213.859'), (1, '5921.146')] [2023-12-26 15:08:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001935264_495427584.pth... [2023-12-26 15:08:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001947440_498548736.pth... [2023-12-26 15:08:53,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001934240_495165440.pth [2023-12-26 15:08:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001946416_498286592.pth [2023-12-26 15:08:53,925][123091] Updated weights for policy 0, policy_version 1947444 (0.0009) [2023-12-26 15:08:53,984][123091] Updated weights for policy 0, policy_version 1947454 (0.0010) [2023-12-26 15:08:53,987][123090] Updated weights for policy 1, policy_version 1935267 (0.0008) [2023-12-26 15:08:54,047][123090] Updated weights for policy 1, policy_version 1935277 (0.0008) [2023-12-26 15:08:54,049][123091] Updated weights for policy 0, policy_version 1947464 (0.0007) [2023-12-26 15:08:54,118][123090] Updated weights for policy 1, policy_version 1935287 (0.0009) [2023-12-26 15:08:54,892][123091] Updated weights for policy 0, policy_version 1947474 (0.0008) [2023-12-26 15:08:54,947][123090] Updated weights for policy 1, policy_version 1935297 (0.0008) [2023-12-26 15:08:54,948][123091] Updated weights for policy 0, policy_version 1947484 (0.0009) [2023-12-26 15:08:55,011][123090] Updated weights for policy 1, policy_version 1935307 (0.0007) [2023-12-26 15:08:55,013][123091] Updated weights for policy 0, policy_version 1947494 (0.0009) [2023-12-26 15:08:55,067][123090] Updated weights for policy 1, policy_version 1935317 (0.0005) [2023-12-26 15:08:55,074][123091] Updated weights for policy 0, policy_version 1947504 (0.0010) [2023-12-26 15:08:55,141][123090] Updated weights for policy 1, policy_version 1935327 (0.0007) [2023-12-26 15:08:55,907][123090] Updated weights for policy 1, policy_version 1935337 (0.0006) [2023-12-26 15:08:55,933][123091] Updated weights for policy 0, policy_version 1947514 (0.0008) [2023-12-26 15:08:55,977][123090] Updated weights for policy 1, policy_version 1935347 (0.0007) [2023-12-26 15:08:55,993][123091] Updated weights for policy 0, policy_version 1947524 (0.0006) [2023-12-26 15:08:56,035][123090] Updated weights for policy 1, policy_version 1935357 (0.0009) [2023-12-26 15:08:56,051][123091] Updated weights for policy 0, policy_version 1947534 (0.0005) [2023-12-26 15:08:56,681][123090] Updated weights for policy 1, policy_version 1935367 (0.0006) [2023-12-26 15:08:56,726][123091] Updated weights for policy 0, policy_version 1947544 (0.0005) [2023-12-26 15:08:56,738][123090] Updated weights for policy 1, policy_version 1935377 (0.0005) [2023-12-26 15:08:56,787][123090] Updated weights for policy 1, policy_version 1935387 (0.0005) [2023-12-26 15:08:56,788][123091] Updated weights for policy 0, policy_version 1947554 (0.0005) [2023-12-26 15:08:56,844][123091] Updated weights for policy 0, policy_version 1947564 (0.0005) [2023-12-26 15:08:57,418][123090] Updated weights for policy 1, policy_version 1935397 (0.0007) [2023-12-26 15:08:57,478][123090] Updated weights for policy 1, policy_version 1935407 (0.0009) [2023-12-26 15:08:57,528][123090] Updated weights for policy 1, policy_version 1935418 (0.0009) [2023-12-26 15:08:57,539][123091] Updated weights for policy 0, policy_version 1947574 (0.0005) [2023-12-26 15:08:57,593][123091] Updated weights for policy 0, policy_version 1947584 (0.0005) [2023-12-26 15:08:57,659][123091] Updated weights for policy 0, policy_version 1947594 (0.0005) [2023-12-26 15:08:58,395][123090] Updated weights for policy 1, policy_version 1935428 (0.0007) [2023-12-26 15:08:58,397][123091] Updated weights for policy 0, policy_version 1947604 (0.0006) [2023-12-26 15:08:58,462][123090] Updated weights for policy 1, policy_version 1935438 (0.0008) [2023-12-26 15:08:58,466][123091] Updated weights for policy 0, policy_version 1947614 (0.0007) [2023-12-26 15:08:58,528][123090] Updated weights for policy 1, policy_version 1935448 (0.0007) [2023-12-26 15:08:58,533][123091] Updated weights for policy 0, policy_version 1947624 (0.0008) [2023-12-26 15:08:58,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 994074624. Throughput: 0: 8782.7, 1: 8870.0. Samples: 994064740. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:08:58,785][121949] Avg episode reward: [(0, '6254.223'), (1, '5822.424')] [2023-12-26 15:08:59,360][123090] Updated weights for policy 1, policy_version 1935458 (0.0008) [2023-12-26 15:08:59,384][123091] Updated weights for policy 0, policy_version 1947634 (0.0009) [2023-12-26 15:08:59,423][123090] Updated weights for policy 1, policy_version 1935468 (0.0007) [2023-12-26 15:08:59,438][123091] Updated weights for policy 0, policy_version 1947644 (0.0008) [2023-12-26 15:08:59,484][123090] Updated weights for policy 1, policy_version 1935478 (0.0006) [2023-12-26 15:08:59,485][123091] Updated weights for policy 0, policy_version 1947654 (0.0008) [2023-12-26 15:08:59,530][123091] Updated weights for policy 0, policy_version 1947664 (0.0008) [2023-12-26 15:08:59,550][123090] Updated weights for policy 1, policy_version 1935488 (0.0007) [2023-12-26 15:09:00,335][123090] Updated weights for policy 1, policy_version 1935498 (0.0009) [2023-12-26 15:09:00,372][123091] Updated weights for policy 0, policy_version 1947674 (0.0007) [2023-12-26 15:09:00,396][123090] Updated weights for policy 1, policy_version 1935508 (0.0008) [2023-12-26 15:09:00,433][123091] Updated weights for policy 0, policy_version 1947684 (0.0009) [2023-12-26 15:09:00,452][123090] Updated weights for policy 1, policy_version 1935518 (0.0008) [2023-12-26 15:09:00,493][123091] Updated weights for policy 0, policy_version 1947694 (0.0008) [2023-12-26 15:09:01,172][123090] Updated weights for policy 1, policy_version 1935528 (0.0009) [2023-12-26 15:09:01,245][123090] Updated weights for policy 1, policy_version 1935538 (0.0008) [2023-12-26 15:09:01,306][123090] Updated weights for policy 1, policy_version 1935548 (0.0008) [2023-12-26 15:09:01,330][123091] Updated weights for policy 0, policy_version 1947704 (0.0009) [2023-12-26 15:09:01,398][123091] Updated weights for policy 0, policy_version 1947714 (0.0010) [2023-12-26 15:09:01,461][123091] Updated weights for policy 0, policy_version 1947724 (0.0009) [2023-12-26 15:09:02,062][123090] Updated weights for policy 1, policy_version 1935558 (0.0006) [2023-12-26 15:09:02,121][123090] Updated weights for policy 1, policy_version 1935568 (0.0005) [2023-12-26 15:09:02,182][123090] Updated weights for policy 1, policy_version 1935578 (0.0008) [2023-12-26 15:09:02,322][123091] Updated weights for policy 0, policy_version 1947734 (0.0010) [2023-12-26 15:09:02,385][123091] Updated weights for policy 0, policy_version 1947744 (0.0010) [2023-12-26 15:09:02,443][123091] Updated weights for policy 0, policy_version 1947754 (0.0009) [2023-12-26 15:09:02,958][123090] Updated weights for policy 1, policy_version 1935588 (0.0009) [2023-12-26 15:09:03,022][123090] Updated weights for policy 1, policy_version 1935598 (0.0007) [2023-12-26 15:09:03,099][123090] Updated weights for policy 1, policy_version 1935608 (0.0005) [2023-12-26 15:09:03,330][123091] Updated weights for policy 0, policy_version 1947764 (0.0009) [2023-12-26 15:09:03,395][123091] Updated weights for policy 0, policy_version 1947774 (0.0009) [2023-12-26 15:09:03,458][123091] Updated weights for policy 0, policy_version 1947784 (0.0009) [2023-12-26 15:09:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17800.2). Total num frames: 994156544. Throughput: 0: 8771.6, 1: 8892.4. Samples: 994169052. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:03,785][121949] Avg episode reward: [(0, '6364.617'), (1, '5848.922')] [2023-12-26 15:09:03,816][123090] Updated weights for policy 1, policy_version 1935618 (0.0006) [2023-12-26 15:09:03,880][123090] Updated weights for policy 1, policy_version 1935628 (0.0009) [2023-12-26 15:09:03,945][123090] Updated weights for policy 1, policy_version 1935638 (0.0010) [2023-12-26 15:09:04,010][123090] Updated weights for policy 1, policy_version 1935648 (0.0009) [2023-12-26 15:09:04,290][123091] Updated weights for policy 0, policy_version 1947794 (0.0009) [2023-12-26 15:09:04,352][123091] Updated weights for policy 0, policy_version 1947804 (0.0010) [2023-12-26 15:09:04,414][123091] Updated weights for policy 0, policy_version 1947814 (0.0009) [2023-12-26 15:09:04,474][123091] Updated weights for policy 0, policy_version 1947824 (0.0008) [2023-12-26 15:09:04,754][123090] Updated weights for policy 1, policy_version 1935658 (0.0005) [2023-12-26 15:09:04,809][123090] Updated weights for policy 1, policy_version 1935668 (0.0005) [2023-12-26 15:09:04,857][123090] Updated weights for policy 1, policy_version 1935678 (0.0005) [2023-12-26 15:09:05,200][123091] Updated weights for policy 0, policy_version 1947834 (0.0006) [2023-12-26 15:09:05,261][123091] Updated weights for policy 0, policy_version 1947844 (0.0005) [2023-12-26 15:09:05,318][123091] Updated weights for policy 0, policy_version 1947854 (0.0005) [2023-12-26 15:09:05,516][123090] Updated weights for policy 1, policy_version 1935688 (0.0006) [2023-12-26 15:09:05,583][123090] Updated weights for policy 1, policy_version 1935698 (0.0006) [2023-12-26 15:09:05,659][123090] Updated weights for policy 1, policy_version 1935708 (0.0007) [2023-12-26 15:09:06,028][123091] Updated weights for policy 0, policy_version 1947864 (0.0005) [2023-12-26 15:09:06,089][123091] Updated weights for policy 0, policy_version 1947874 (0.0005) [2023-12-26 15:09:06,157][123091] Updated weights for policy 0, policy_version 1947884 (0.0007) [2023-12-26 15:09:06,395][123090] Updated weights for policy 1, policy_version 1935718 (0.0006) [2023-12-26 15:09:06,459][123090] Updated weights for policy 1, policy_version 1935728 (0.0006) [2023-12-26 15:09:06,517][123090] Updated weights for policy 1, policy_version 1935738 (0.0005) [2023-12-26 15:09:06,896][123091] Updated weights for policy 0, policy_version 1947894 (0.0009) [2023-12-26 15:09:06,969][123091] Updated weights for policy 0, policy_version 1947904 (0.0006) [2023-12-26 15:09:07,035][123091] Updated weights for policy 0, policy_version 1947914 (0.0005) [2023-12-26 15:09:07,247][123090] Updated weights for policy 1, policy_version 1935748 (0.0007) [2023-12-26 15:09:07,314][123090] Updated weights for policy 1, policy_version 1935758 (0.0010) [2023-12-26 15:09:07,381][123090] Updated weights for policy 1, policy_version 1935768 (0.0010) [2023-12-26 15:09:07,649][123091] Updated weights for policy 0, policy_version 1947924 (0.0006) [2023-12-26 15:09:07,716][123091] Updated weights for policy 0, policy_version 1947934 (0.0006) [2023-12-26 15:09:07,778][123091] Updated weights for policy 0, policy_version 1947944 (0.0010) [2023-12-26 15:09:08,129][123090] Updated weights for policy 1, policy_version 1935778 (0.0010) [2023-12-26 15:09:08,192][123090] Updated weights for policy 1, policy_version 1935788 (0.0009) [2023-12-26 15:09:08,264][123090] Updated weights for policy 1, policy_version 1935798 (0.0006) [2023-12-26 15:09:08,332][123090] Updated weights for policy 1, policy_version 1935808 (0.0008) [2023-12-26 15:09:08,549][123091] Updated weights for policy 0, policy_version 1947954 (0.0010) [2023-12-26 15:09:08,602][123091] Updated weights for policy 0, policy_version 1947964 (0.0009) [2023-12-26 15:09:08,668][123091] Updated weights for policy 0, policy_version 1947974 (0.0010) [2023-12-26 15:09:08,738][123091] Updated weights for policy 0, policy_version 1947984 (0.0011) [2023-12-26 15:09:08,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 994254848. Throughput: 0: 8872.4, 1: 8911.3. Samples: 994226088. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:08,785][121949] Avg episode reward: [(0, '6355.594'), (1, '5871.323')] [2023-12-26 15:09:08,788][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001947984_498688000.pth... [2023-12-26 15:09:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001935808_495566848.pth... [2023-12-26 15:09:08,792][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001934784_495304704.pth [2023-12-26 15:09:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001946928_498417664.pth [2023-12-26 15:09:09,157][123090] Updated weights for policy 1, policy_version 1935818 (0.0005) [2023-12-26 15:09:09,237][123090] Updated weights for policy 1, policy_version 1935828 (0.0006) [2023-12-26 15:09:09,307][123090] Updated weights for policy 1, policy_version 1935838 (0.0010) [2023-12-26 15:09:09,604][123091] Updated weights for policy 0, policy_version 1947994 (0.0009) [2023-12-26 15:09:09,663][123091] Updated weights for policy 0, policy_version 1948004 (0.0008) [2023-12-26 15:09:09,730][123091] Updated weights for policy 0, policy_version 1948014 (0.0011) [2023-12-26 15:09:10,075][123090] Updated weights for policy 1, policy_version 1935848 (0.0008) [2023-12-26 15:09:10,138][123090] Updated weights for policy 1, policy_version 1935858 (0.0010) [2023-12-26 15:09:10,203][123090] Updated weights for policy 1, policy_version 1935868 (0.0009) [2023-12-26 15:09:10,572][123091] Updated weights for policy 0, policy_version 1948024 (0.0010) [2023-12-26 15:09:10,630][123091] Updated weights for policy 0, policy_version 1948034 (0.0009) [2023-12-26 15:09:10,686][123091] Updated weights for policy 0, policy_version 1948044 (0.0009) [2023-12-26 15:09:11,018][123090] Updated weights for policy 1, policy_version 1935878 (0.0009) [2023-12-26 15:09:11,086][123090] Updated weights for policy 1, policy_version 1935888 (0.0009) [2023-12-26 15:09:11,145][123090] Updated weights for policy 1, policy_version 1935898 (0.0008) [2023-12-26 15:09:11,592][123091] Updated weights for policy 0, policy_version 1948054 (0.0010) [2023-12-26 15:09:11,664][123091] Updated weights for policy 0, policy_version 1948064 (0.0009) [2023-12-26 15:09:11,726][123091] Updated weights for policy 0, policy_version 1948074 (0.0010) [2023-12-26 15:09:11,978][123090] Updated weights for policy 1, policy_version 1935908 (0.0010) [2023-12-26 15:09:12,043][123090] Updated weights for policy 1, policy_version 1935918 (0.0009) [2023-12-26 15:09:12,095][123090] Updated weights for policy 1, policy_version 1935928 (0.0010) [2023-12-26 15:09:12,585][123091] Updated weights for policy 0, policy_version 1948084 (0.0010) [2023-12-26 15:09:12,634][123091] Updated weights for policy 0, policy_version 1948094 (0.0009) [2023-12-26 15:09:12,683][123091] Updated weights for policy 0, policy_version 1948105 (0.0009) [2023-12-26 15:09:12,945][123090] Updated weights for policy 1, policy_version 1935938 (0.0009) [2023-12-26 15:09:13,015][123090] Updated weights for policy 1, policy_version 1935948 (0.0010) [2023-12-26 15:09:13,086][123090] Updated weights for policy 1, policy_version 1935958 (0.0010) [2023-12-26 15:09:13,141][123090] Updated weights for policy 1, policy_version 1935968 (0.0009) [2023-12-26 15:09:13,546][123091] Updated weights for policy 0, policy_version 1948115 (0.0010) [2023-12-26 15:09:13,608][123091] Updated weights for policy 0, policy_version 1948125 (0.0010) [2023-12-26 15:09:13,666][123091] Updated weights for policy 0, policy_version 1948135 (0.0010) [2023-12-26 15:09:13,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 994336768. Throughput: 0: 8887.8, 1: 8846.5. Samples: 994330252. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:13,785][121949] Avg episode reward: [(0, '6294.216'), (1, '5698.316')] [2023-12-26 15:09:13,947][123090] Updated weights for policy 1, policy_version 1935978 (0.0009) [2023-12-26 15:09:14,003][123090] Updated weights for policy 1, policy_version 1935988 (0.0009) [2023-12-26 15:09:14,071][123090] Updated weights for policy 1, policy_version 1935998 (0.0008) [2023-12-26 15:09:14,483][123091] Updated weights for policy 0, policy_version 1948145 (0.0010) [2023-12-26 15:09:14,556][123091] Updated weights for policy 0, policy_version 1948155 (0.0011) [2023-12-26 15:09:14,622][123091] Updated weights for policy 0, policy_version 1948165 (0.0010) [2023-12-26 15:09:14,675][123091] Updated weights for policy 0, policy_version 1948175 (0.0006) [2023-12-26 15:09:14,944][123090] Updated weights for policy 1, policy_version 1936008 (0.0010) [2023-12-26 15:09:15,007][123090] Updated weights for policy 1, policy_version 1936018 (0.0010) [2023-12-26 15:09:15,070][123090] Updated weights for policy 1, policy_version 1936028 (0.0010) [2023-12-26 15:09:15,352][123091] Updated weights for policy 0, policy_version 1948185 (0.0010) [2023-12-26 15:09:15,411][123091] Updated weights for policy 0, policy_version 1948195 (0.0011) [2023-12-26 15:09:15,474][123091] Updated weights for policy 0, policy_version 1948205 (0.0011) [2023-12-26 15:09:15,949][123090] Updated weights for policy 1, policy_version 1936038 (0.0010) [2023-12-26 15:09:16,001][123090] Updated weights for policy 1, policy_version 1936048 (0.0008) [2023-12-26 15:09:16,056][123090] Updated weights for policy 1, policy_version 1936058 (0.0007) [2023-12-26 15:09:16,299][123091] Updated weights for policy 0, policy_version 1948215 (0.0011) [2023-12-26 15:09:16,350][123091] Updated weights for policy 0, policy_version 1948225 (0.0010) [2023-12-26 15:09:16,409][123091] Updated weights for policy 0, policy_version 1948235 (0.0010) [2023-12-26 15:09:16,759][123090] Updated weights for policy 1, policy_version 1936068 (0.0006) [2023-12-26 15:09:16,839][123090] Updated weights for policy 1, policy_version 1936078 (0.0005) [2023-12-26 15:09:16,894][123090] Updated weights for policy 1, policy_version 1936088 (0.0005) [2023-12-26 15:09:17,161][123091] Updated weights for policy 0, policy_version 1948245 (0.0008) [2023-12-26 15:09:17,224][123091] Updated weights for policy 0, policy_version 1948255 (0.0005) [2023-12-26 15:09:17,284][123091] Updated weights for policy 0, policy_version 1948265 (0.0006) [2023-12-26 15:09:17,566][123090] Updated weights for policy 1, policy_version 1936098 (0.0006) [2023-12-26 15:09:17,638][123090] Updated weights for policy 1, policy_version 1936108 (0.0009) [2023-12-26 15:09:17,699][123090] Updated weights for policy 1, policy_version 1936118 (0.0009) [2023-12-26 15:09:17,758][123090] Updated weights for policy 1, policy_version 1936128 (0.0009) [2023-12-26 15:09:18,064][123091] Updated weights for policy 0, policy_version 1948275 (0.0009) [2023-12-26 15:09:18,126][123091] Updated weights for policy 0, policy_version 1948285 (0.0005) [2023-12-26 15:09:18,191][123091] Updated weights for policy 0, policy_version 1948295 (0.0006) [2023-12-26 15:09:18,489][123090] Updated weights for policy 1, policy_version 1936138 (0.0009) [2023-12-26 15:09:18,550][123090] Updated weights for policy 1, policy_version 1936148 (0.0008) [2023-12-26 15:09:18,614][123090] Updated weights for policy 1, policy_version 1936158 (0.0009) [2023-12-26 15:09:18,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 994426880. Throughput: 0: 8924.3, 1: 8793.5. Samples: 994437840. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:18,784][121949] Avg episode reward: [(0, '6401.902'), (1, '5742.761')] [2023-12-26 15:09:18,921][123091] Updated weights for policy 0, policy_version 1948305 (0.0005) [2023-12-26 15:09:18,992][123091] Updated weights for policy 0, policy_version 1948315 (0.0005) [2023-12-26 15:09:19,061][123091] Updated weights for policy 0, policy_version 1948325 (0.0006) [2023-12-26 15:09:19,119][123091] Updated weights for policy 0, policy_version 1948335 (0.0006) [2023-12-26 15:09:19,517][123090] Updated weights for policy 1, policy_version 1936168 (0.0008) [2023-12-26 15:09:19,596][123090] Updated weights for policy 1, policy_version 1936178 (0.0007) [2023-12-26 15:09:19,664][123090] Updated weights for policy 1, policy_version 1936188 (0.0011) [2023-12-26 15:09:19,924][123091] Updated weights for policy 0, policy_version 1948345 (0.0011) [2023-12-26 15:09:19,993][123091] Updated weights for policy 0, policy_version 1948355 (0.0011) [2023-12-26 15:09:20,066][123091] Updated weights for policy 0, policy_version 1948365 (0.0011) [2023-12-26 15:09:20,409][123090] Updated weights for policy 1, policy_version 1936198 (0.0008) [2023-12-26 15:09:20,468][123090] Updated weights for policy 1, policy_version 1936208 (0.0010) [2023-12-26 15:09:20,520][123090] Updated weights for policy 1, policy_version 1936218 (0.0010) [2023-12-26 15:09:20,914][123091] Updated weights for policy 0, policy_version 1948375 (0.0011) [2023-12-26 15:09:20,985][123091] Updated weights for policy 0, policy_version 1948385 (0.0011) [2023-12-26 15:09:21,052][123091] Updated weights for policy 0, policy_version 1948395 (0.0011) [2023-12-26 15:09:21,250][123090] Updated weights for policy 1, policy_version 1936228 (0.0011) [2023-12-26 15:09:21,317][123090] Updated weights for policy 1, policy_version 1936238 (0.0011) [2023-12-26 15:09:21,395][123090] Updated weights for policy 1, policy_version 1936248 (0.0011) [2023-12-26 15:09:21,868][123091] Updated weights for policy 0, policy_version 1948405 (0.0011) [2023-12-26 15:09:21,931][123091] Updated weights for policy 0, policy_version 1948415 (0.0009) [2023-12-26 15:09:21,995][123091] Updated weights for policy 0, policy_version 1948425 (0.0011) [2023-12-26 15:09:22,221][123090] Updated weights for policy 1, policy_version 1936258 (0.0009) [2023-12-26 15:09:22,284][123090] Updated weights for policy 1, policy_version 1936268 (0.0009) [2023-12-26 15:09:22,356][123090] Updated weights for policy 1, policy_version 1936278 (0.0009) [2023-12-26 15:09:22,421][123090] Updated weights for policy 1, policy_version 1936288 (0.0010) [2023-12-26 15:09:22,773][123091] Updated weights for policy 0, policy_version 1948435 (0.0009) [2023-12-26 15:09:22,844][123091] Updated weights for policy 0, policy_version 1948445 (0.0006) [2023-12-26 15:09:22,909][123091] Updated weights for policy 0, policy_version 1948455 (0.0006) [2023-12-26 15:09:23,345][123090] Updated weights for policy 1, policy_version 1936298 (0.0006) [2023-12-26 15:09:23,414][123090] Updated weights for policy 1, policy_version 1936308 (0.0006) [2023-12-26 15:09:23,477][123090] Updated weights for policy 1, policy_version 1936318 (0.0006) [2023-12-26 15:09:23,557][123091] Updated weights for policy 0, policy_version 1948465 (0.0006) [2023-12-26 15:09:23,616][123091] Updated weights for policy 0, policy_version 1948475 (0.0010) [2023-12-26 15:09:23,663][123091] Updated weights for policy 0, policy_version 1948485 (0.0010) [2023-12-26 15:09:23,708][123091] Updated weights for policy 0, policy_version 1948495 (0.0007) [2023-12-26 15:09:23,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17772.5). Total num frames: 994516992. Throughput: 0: 8875.5, 1: 8807.2. Samples: 994489268. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:23,785][121949] Avg episode reward: [(0, '6309.959'), (1, '5933.429')] [2023-12-26 15:09:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001948496_498819072.pth... [2023-12-26 15:09:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001936320_495697920.pth... [2023-12-26 15:09:23,805][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001935264_495427584.pth [2023-12-26 15:09:23,805][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001947440_498548736.pth [2023-12-26 15:09:24,111][123090] Updated weights for policy 1, policy_version 1936328 (0.0006) [2023-12-26 15:09:24,165][123090] Updated weights for policy 1, policy_version 1936338 (0.0010) [2023-12-26 15:09:24,226][123090] Updated weights for policy 1, policy_version 1936348 (0.0009) [2023-12-26 15:09:24,471][123091] Updated weights for policy 0, policy_version 1948505 (0.0007) [2023-12-26 15:09:24,522][123091] Updated weights for policy 0, policy_version 1948515 (0.0010) [2023-12-26 15:09:24,574][123091] Updated weights for policy 0, policy_version 1948525 (0.0010) [2023-12-26 15:09:25,088][123090] Updated weights for policy 1, policy_version 1936358 (0.0009) [2023-12-26 15:09:25,140][123090] Updated weights for policy 1, policy_version 1936368 (0.0009) [2023-12-26 15:09:25,188][123090] Updated weights for policy 1, policy_version 1936378 (0.0009) [2023-12-26 15:09:25,365][123091] Updated weights for policy 0, policy_version 1948535 (0.0010) [2023-12-26 15:09:25,423][123091] Updated weights for policy 0, policy_version 1948545 (0.0010) [2023-12-26 15:09:25,483][123091] Updated weights for policy 0, policy_version 1948555 (0.0009) [2023-12-26 15:09:26,091][123090] Updated weights for policy 1, policy_version 1936388 (0.0010) [2023-12-26 15:09:26,142][123091] Updated weights for policy 0, policy_version 1948565 (0.0009) [2023-12-26 15:09:26,144][123090] Updated weights for policy 1, policy_version 1936398 (0.0009) [2023-12-26 15:09:26,196][123090] Updated weights for policy 1, policy_version 1936408 (0.0007) [2023-12-26 15:09:26,198][123091] Updated weights for policy 0, policy_version 1948575 (0.0009) [2023-12-26 15:09:26,251][123091] Updated weights for policy 0, policy_version 1948585 (0.0007) [2023-12-26 15:09:27,022][123091] Updated weights for policy 0, policy_version 1948595 (0.0010) [2023-12-26 15:09:27,058][123090] Updated weights for policy 1, policy_version 1936418 (0.0007) [2023-12-26 15:09:27,077][123091] Updated weights for policy 0, policy_version 1948605 (0.0009) [2023-12-26 15:09:27,119][123090] Updated weights for policy 1, policy_version 1936428 (0.0005) [2023-12-26 15:09:27,129][123091] Updated weights for policy 0, policy_version 1948615 (0.0009) [2023-12-26 15:09:27,175][123090] Updated weights for policy 1, policy_version 1936438 (0.0005) [2023-12-26 15:09:27,240][123090] Updated weights for policy 1, policy_version 1936448 (0.0005) [2023-12-26 15:09:27,889][123090] Updated weights for policy 1, policy_version 1936458 (0.0005) [2023-12-26 15:09:27,939][123090] Updated weights for policy 1, policy_version 1936468 (0.0005) [2023-12-26 15:09:27,985][123090] Updated weights for policy 1, policy_version 1936478 (0.0005) [2023-12-26 15:09:28,039][123091] Updated weights for policy 0, policy_version 1948625 (0.0008) [2023-12-26 15:09:28,100][123091] Updated weights for policy 0, policy_version 1948635 (0.0010) [2023-12-26 15:09:28,156][123091] Updated weights for policy 0, policy_version 1948645 (0.0010) [2023-12-26 15:09:28,206][123091] Updated weights for policy 0, policy_version 1948655 (0.0009) [2023-12-26 15:09:28,716][123090] Updated weights for policy 1, policy_version 1936488 (0.0009) [2023-12-26 15:09:28,776][123090] Updated weights for policy 1, policy_version 1936498 (0.0009) [2023-12-26 15:09:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17744.7). Total num frames: 994598912. Throughput: 0: 8983.4, 1: 8791.6. Samples: 994597564. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:28,785][121949] Avg episode reward: [(0, '6127.121'), (1, '5997.439')] [2023-12-26 15:09:28,838][123090] Updated weights for policy 1, policy_version 1936508 (0.0010) [2023-12-26 15:09:29,063][123091] Updated weights for policy 0, policy_version 1948665 (0.0008) [2023-12-26 15:09:29,128][123091] Updated weights for policy 0, policy_version 1948675 (0.0009) [2023-12-26 15:09:29,185][123091] Updated weights for policy 0, policy_version 1948685 (0.0009) [2023-12-26 15:09:29,687][123090] Updated weights for policy 1, policy_version 1936518 (0.0010) [2023-12-26 15:09:29,756][123090] Updated weights for policy 1, policy_version 1936528 (0.0009) [2023-12-26 15:09:29,820][123090] Updated weights for policy 1, policy_version 1936538 (0.0009) [2023-12-26 15:09:29,977][123091] Updated weights for policy 0, policy_version 1948695 (0.0008) [2023-12-26 15:09:30,031][123091] Updated weights for policy 0, policy_version 1948705 (0.0007) [2023-12-26 15:09:30,083][123091] Updated weights for policy 0, policy_version 1948715 (0.0005) [2023-12-26 15:09:30,621][123090] Updated weights for policy 1, policy_version 1936548 (0.0009) [2023-12-26 15:09:30,676][123090] Updated weights for policy 1, policy_version 1936558 (0.0010) [2023-12-26 15:09:30,726][123090] Updated weights for policy 1, policy_version 1936568 (0.0010) [2023-12-26 15:09:30,839][123091] Updated weights for policy 0, policy_version 1948725 (0.0008) [2023-12-26 15:09:30,897][123091] Updated weights for policy 0, policy_version 1948735 (0.0010) [2023-12-26 15:09:30,959][123091] Updated weights for policy 0, policy_version 1948745 (0.0011) [2023-12-26 15:09:31,538][123090] Updated weights for policy 1, policy_version 1936578 (0.0010) [2023-12-26 15:09:31,585][123090] Updated weights for policy 1, policy_version 1936588 (0.0010) [2023-12-26 15:09:31,653][123090] Updated weights for policy 1, policy_version 1936598 (0.0009) [2023-12-26 15:09:31,742][123091] Updated weights for policy 0, policy_version 1948755 (0.0009) [2023-12-26 15:09:31,809][123091] Updated weights for policy 0, policy_version 1948765 (0.0010) [2023-12-26 15:09:31,870][123091] Updated weights for policy 0, policy_version 1948775 (0.0010) [2023-12-26 15:09:32,420][123090] Updated weights for policy 1, policy_version 1936609 (0.0011) [2023-12-26 15:09:32,501][123090] Updated weights for policy 1, policy_version 1936619 (0.0006) [2023-12-26 15:09:32,572][123090] Updated weights for policy 1, policy_version 1936629 (0.0007) [2023-12-26 15:09:32,580][123091] Updated weights for policy 0, policy_version 1948785 (0.0006) [2023-12-26 15:09:32,644][123090] Updated weights for policy 1, policy_version 1936639 (0.0007) [2023-12-26 15:09:32,656][123091] Updated weights for policy 0, policy_version 1948795 (0.0005) [2023-12-26 15:09:32,727][123091] Updated weights for policy 0, policy_version 1948805 (0.0005) [2023-12-26 15:09:32,800][123091] Updated weights for policy 0, policy_version 1948815 (0.0005) [2023-12-26 15:09:33,265][123090] Updated weights for policy 1, policy_version 1936649 (0.0009) [2023-12-26 15:09:33,316][123090] Updated weights for policy 1, policy_version 1936659 (0.0009) [2023-12-26 15:09:33,384][123090] Updated weights for policy 1, policy_version 1936669 (0.0010) [2023-12-26 15:09:33,422][123091] Updated weights for policy 0, policy_version 1948825 (0.0005) [2023-12-26 15:09:33,467][123091] Updated weights for policy 0, policy_version 1948835 (0.0005) [2023-12-26 15:09:33,532][123091] Updated weights for policy 0, policy_version 1948845 (0.0007) [2023-12-26 15:09:33,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 994697216. Throughput: 0: 8934.7, 1: 8924.3. Samples: 994706908. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:33,785][121949] Avg episode reward: [(0, '6295.569'), (1, '6009.938')] [2023-12-26 15:09:34,284][123091] Updated weights for policy 0, policy_version 1948855 (0.0010) [2023-12-26 15:09:34,311][123090] Updated weights for policy 1, policy_version 1936679 (0.0008) [2023-12-26 15:09:34,332][123091] Updated weights for policy 0, policy_version 1948865 (0.0008) [2023-12-26 15:09:34,377][123090] Updated weights for policy 1, policy_version 1936689 (0.0009) [2023-12-26 15:09:34,382][123091] Updated weights for policy 0, policy_version 1948875 (0.0008) [2023-12-26 15:09:34,444][123090] Updated weights for policy 1, policy_version 1936699 (0.0008) [2023-12-26 15:09:35,090][123091] Updated weights for policy 0, policy_version 1948885 (0.0007) [2023-12-26 15:09:35,150][123091] Updated weights for policy 0, policy_version 1948895 (0.0005) [2023-12-26 15:09:35,206][123091] Updated weights for policy 0, policy_version 1948905 (0.0007) [2023-12-26 15:09:35,303][123090] Updated weights for policy 1, policy_version 1936709 (0.0009) [2023-12-26 15:09:35,352][123090] Updated weights for policy 1, policy_version 1936719 (0.0007) [2023-12-26 15:09:35,397][123090] Updated weights for policy 1, policy_version 1936729 (0.0005) [2023-12-26 15:09:35,939][123091] Updated weights for policy 0, policy_version 1948915 (0.0007) [2023-12-26 15:09:36,000][123091] Updated weights for policy 0, policy_version 1948925 (0.0011) [2023-12-26 15:09:36,073][123091] Updated weights for policy 0, policy_version 1948935 (0.0010) [2023-12-26 15:09:36,182][123090] Updated weights for policy 1, policy_version 1936739 (0.0008) [2023-12-26 15:09:36,250][123090] Updated weights for policy 1, policy_version 1936749 (0.0009) [2023-12-26 15:09:36,311][123090] Updated weights for policy 1, policy_version 1936759 (0.0009) [2023-12-26 15:09:36,903][123091] Updated weights for policy 0, policy_version 1948945 (0.0011) [2023-12-26 15:09:36,961][123091] Updated weights for policy 0, policy_version 1948955 (0.0010) [2023-12-26 15:09:37,017][123091] Updated weights for policy 0, policy_version 1948965 (0.0010) [2023-12-26 15:09:37,068][123091] Updated weights for policy 0, policy_version 1948975 (0.0010) [2023-12-26 15:09:37,149][123090] Updated weights for policy 1, policy_version 1936769 (0.0009) [2023-12-26 15:09:37,202][123090] Updated weights for policy 1, policy_version 1936779 (0.0010) [2023-12-26 15:09:37,251][123090] Updated weights for policy 1, policy_version 1936789 (0.0009) [2023-12-26 15:09:37,304][123090] Updated weights for policy 1, policy_version 1936799 (0.0008) [2023-12-26 15:09:37,896][123091] Updated weights for policy 0, policy_version 1948985 (0.0010) [2023-12-26 15:09:37,943][123091] Updated weights for policy 0, policy_version 1948995 (0.0010) [2023-12-26 15:09:38,011][123091] Updated weights for policy 0, policy_version 1949005 (0.0011) [2023-12-26 15:09:38,168][123090] Updated weights for policy 1, policy_version 1936809 (0.0009) [2023-12-26 15:09:38,216][123090] Updated weights for policy 1, policy_version 1936819 (0.0009) [2023-12-26 15:09:38,264][123090] Updated weights for policy 1, policy_version 1936829 (0.0009) [2023-12-26 15:09:38,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 994779136. Throughput: 0: 8946.7, 1: 8892.6. Samples: 994759756. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:38,785][121949] Avg episode reward: [(0, '6286.947'), (1, '5958.140')] [2023-12-26 15:09:38,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001949008_498950144.pth... [2023-12-26 15:09:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001936832_495828992.pth... [2023-12-26 15:09:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001935808_495566848.pth [2023-12-26 15:09:38,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001947984_498688000.pth [2023-12-26 15:09:38,857][123091] Updated weights for policy 0, policy_version 1949015 (0.0011) [2023-12-26 15:09:38,928][123091] Updated weights for policy 0, policy_version 1949025 (0.0011) [2023-12-26 15:09:38,999][123091] Updated weights for policy 0, policy_version 1949035 (0.0011) [2023-12-26 15:09:39,145][123090] Updated weights for policy 1, policy_version 1936839 (0.0010) [2023-12-26 15:09:39,197][123090] Updated weights for policy 1, policy_version 1936849 (0.0010) [2023-12-26 15:09:39,274][123090] Updated weights for policy 1, policy_version 1936859 (0.0009) [2023-12-26 15:09:39,823][123091] Updated weights for policy 0, policy_version 1949045 (0.0011) [2023-12-26 15:09:39,906][123091] Updated weights for policy 0, policy_version 1949055 (0.0011) [2023-12-26 15:09:39,969][123091] Updated weights for policy 0, policy_version 1949065 (0.0011) [2023-12-26 15:09:40,154][123090] Updated weights for policy 1, policy_version 1936869 (0.0009) [2023-12-26 15:09:40,213][123090] Updated weights for policy 1, policy_version 1936879 (0.0009) [2023-12-26 15:09:40,276][123090] Updated weights for policy 1, policy_version 1936889 (0.0010) [2023-12-26 15:09:40,749][123091] Updated weights for policy 0, policy_version 1949075 (0.0010) [2023-12-26 15:09:40,806][123091] Updated weights for policy 0, policy_version 1949085 (0.0009) [2023-12-26 15:09:40,855][123091] Updated weights for policy 0, policy_version 1949095 (0.0009) [2023-12-26 15:09:41,134][123090] Updated weights for policy 1, policy_version 1936899 (0.0010) [2023-12-26 15:09:41,201][123090] Updated weights for policy 1, policy_version 1936909 (0.0010) [2023-12-26 15:09:41,268][123090] Updated weights for policy 1, policy_version 1936919 (0.0009) [2023-12-26 15:09:41,698][123091] Updated weights for policy 0, policy_version 1949105 (0.0010) [2023-12-26 15:09:41,769][123091] Updated weights for policy 0, policy_version 1949115 (0.0009) [2023-12-26 15:09:41,824][123091] Updated weights for policy 0, policy_version 1949125 (0.0009) [2023-12-26 15:09:41,887][123091] Updated weights for policy 0, policy_version 1949135 (0.0010) [2023-12-26 15:09:42,003][123090] Updated weights for policy 1, policy_version 1936929 (0.0008) [2023-12-26 15:09:42,067][123090] Updated weights for policy 1, policy_version 1936939 (0.0010) [2023-12-26 15:09:42,129][123090] Updated weights for policy 1, policy_version 1936949 (0.0009) [2023-12-26 15:09:42,192][123090] Updated weights for policy 1, policy_version 1936959 (0.0010) [2023-12-26 15:09:42,730][123091] Updated weights for policy 0, policy_version 1949145 (0.0010) [2023-12-26 15:09:42,785][123091] Updated weights for policy 0, policy_version 1949155 (0.0010) [2023-12-26 15:09:42,852][123091] Updated weights for policy 0, policy_version 1949165 (0.0006) [2023-12-26 15:09:43,014][123090] Updated weights for policy 1, policy_version 1936969 (0.0010) [2023-12-26 15:09:43,077][123090] Updated weights for policy 1, policy_version 1936979 (0.0009) [2023-12-26 15:09:43,125][123090] Updated weights for policy 1, policy_version 1936989 (0.0008) [2023-12-26 15:09:43,543][123091] Updated weights for policy 0, policy_version 1949175 (0.0009) [2023-12-26 15:09:43,590][123091] Updated weights for policy 0, policy_version 1949185 (0.0010) [2023-12-26 15:09:43,637][123091] Updated weights for policy 0, policy_version 1949195 (0.0010) [2023-12-26 15:09:43,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 994869248. Throughput: 0: 8902.4, 1: 8790.3. Samples: 994860912. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:43,785][121949] Avg episode reward: [(0, '6264.783'), (1, '5964.055')] [2023-12-26 15:09:43,868][123090] Updated weights for policy 1, policy_version 1936999 (0.0006) [2023-12-26 15:09:43,920][123090] Updated weights for policy 1, policy_version 1937009 (0.0005) [2023-12-26 15:09:43,976][123090] Updated weights for policy 1, policy_version 1937019 (0.0005) [2023-12-26 15:09:44,491][123091] Updated weights for policy 0, policy_version 1949205 (0.0011) [2023-12-26 15:09:44,541][123091] Updated weights for policy 0, policy_version 1949215 (0.0010) [2023-12-26 15:09:44,588][123091] Updated weights for policy 0, policy_version 1949225 (0.0010) [2023-12-26 15:09:44,739][123090] Updated weights for policy 1, policy_version 1937029 (0.0007) [2023-12-26 15:09:44,826][123090] Updated weights for policy 1, policy_version 1937039 (0.0009) [2023-12-26 15:09:44,890][123090] Updated weights for policy 1, policy_version 1937049 (0.0006) [2023-12-26 15:09:45,424][123091] Updated weights for policy 0, policy_version 1949235 (0.0010) [2023-12-26 15:09:45,501][123091] Updated weights for policy 0, policy_version 1949245 (0.0011) [2023-12-26 15:09:45,553][123091] Updated weights for policy 0, policy_version 1949255 (0.0011) [2023-12-26 15:09:45,611][123090] Updated weights for policy 1, policy_version 1937059 (0.0006) [2023-12-26 15:09:45,664][123090] Updated weights for policy 1, policy_version 1937069 (0.0005) [2023-12-26 15:09:45,723][123090] Updated weights for policy 1, policy_version 1937079 (0.0005) [2023-12-26 15:09:46,381][123091] Updated weights for policy 0, policy_version 1949265 (0.0011) [2023-12-26 15:09:46,433][123091] Updated weights for policy 0, policy_version 1949275 (0.0008) [2023-12-26 15:09:46,479][123090] Updated weights for policy 1, policy_version 1937089 (0.0006) [2023-12-26 15:09:46,490][123091] Updated weights for policy 0, policy_version 1949285 (0.0008) [2023-12-26 15:09:46,531][123090] Updated weights for policy 1, policy_version 1937099 (0.0010) [2023-12-26 15:09:46,542][123091] Updated weights for policy 0, policy_version 1949295 (0.0005) [2023-12-26 15:09:46,590][123090] Updated weights for policy 1, policy_version 1937109 (0.0010) [2023-12-26 15:09:46,649][123090] Updated weights for policy 1, policy_version 1937119 (0.0010) [2023-12-26 15:09:47,298][123091] Updated weights for policy 0, policy_version 1949305 (0.0005) [2023-12-26 15:09:47,372][123091] Updated weights for policy 0, policy_version 1949315 (0.0005) [2023-12-26 15:09:47,429][123090] Updated weights for policy 1, policy_version 1937129 (0.0008) [2023-12-26 15:09:47,433][123091] Updated weights for policy 0, policy_version 1949325 (0.0008) [2023-12-26 15:09:47,494][123090] Updated weights for policy 1, policy_version 1937139 (0.0005) [2023-12-26 15:09:47,540][123090] Updated weights for policy 1, policy_version 1937149 (0.0005) [2023-12-26 15:09:48,093][123091] Updated weights for policy 0, policy_version 1949335 (0.0007) [2023-12-26 15:09:48,165][123091] Updated weights for policy 0, policy_version 1949345 (0.0007) [2023-12-26 15:09:48,191][123090] Updated weights for policy 1, policy_version 1937159 (0.0006) [2023-12-26 15:09:48,227][123091] Updated weights for policy 0, policy_version 1949355 (0.0008) [2023-12-26 15:09:48,253][123090] Updated weights for policy 1, policy_version 1937169 (0.0010) [2023-12-26 15:09:48,327][123090] Updated weights for policy 1, policy_version 1937179 (0.0011) [2023-12-26 15:09:48,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 994959360. Throughput: 0: 8999.9, 1: 8862.7. Samples: 994972872. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:48,785][121949] Avg episode reward: [(0, '6411.190'), (1, '6113.199')] [2023-12-26 15:09:48,916][123091] Updated weights for policy 0, policy_version 1949365 (0.0008) [2023-12-26 15:09:48,979][123091] Updated weights for policy 0, policy_version 1949375 (0.0011) [2023-12-26 15:09:49,042][123091] Updated weights for policy 0, policy_version 1949385 (0.0011) [2023-12-26 15:09:49,132][123090] Updated weights for policy 1, policy_version 1937189 (0.0009) [2023-12-26 15:09:49,187][123090] Updated weights for policy 1, policy_version 1937199 (0.0010) [2023-12-26 15:09:49,251][123090] Updated weights for policy 1, policy_version 1937209 (0.0011) [2023-12-26 15:09:49,851][123091] Updated weights for policy 0, policy_version 1949395 (0.0010) [2023-12-26 15:09:49,912][123091] Updated weights for policy 0, policy_version 1949405 (0.0009) [2023-12-26 15:09:49,981][123091] Updated weights for policy 0, policy_version 1949415 (0.0009) [2023-12-26 15:09:50,138][123090] Updated weights for policy 1, policy_version 1937219 (0.0011) [2023-12-26 15:09:50,207][123090] Updated weights for policy 1, policy_version 1937229 (0.0011) [2023-12-26 15:09:50,267][123090] Updated weights for policy 1, policy_version 1937239 (0.0011) [2023-12-26 15:09:50,861][123091] Updated weights for policy 0, policy_version 1949425 (0.0009) [2023-12-26 15:09:50,926][123091] Updated weights for policy 0, policy_version 1949435 (0.0009) [2023-12-26 15:09:50,985][123091] Updated weights for policy 0, policy_version 1949445 (0.0009) [2023-12-26 15:09:51,053][123091] Updated weights for policy 0, policy_version 1949455 (0.0009) [2023-12-26 15:09:51,099][123090] Updated weights for policy 1, policy_version 1937249 (0.0010) [2023-12-26 15:09:51,169][123090] Updated weights for policy 1, policy_version 1937259 (0.0008) [2023-12-26 15:09:51,235][123090] Updated weights for policy 1, policy_version 1937269 (0.0008) [2023-12-26 15:09:51,304][123090] Updated weights for policy 1, policy_version 1937279 (0.0008) [2023-12-26 15:09:51,965][123091] Updated weights for policy 0, policy_version 1949465 (0.0009) [2023-12-26 15:09:52,018][123091] Updated weights for policy 0, policy_version 1949475 (0.0009) [2023-12-26 15:09:52,065][123091] Updated weights for policy 0, policy_version 1949485 (0.0009) [2023-12-26 15:09:52,097][123090] Updated weights for policy 1, policy_version 1937289 (0.0010) [2023-12-26 15:09:52,168][123090] Updated weights for policy 1, policy_version 1937299 (0.0010) [2023-12-26 15:09:52,231][123090] Updated weights for policy 1, policy_version 1937309 (0.0010) [2023-12-26 15:09:52,951][123091] Updated weights for policy 0, policy_version 1949495 (0.0009) [2023-12-26 15:09:53,001][123091] Updated weights for policy 0, policy_version 1949505 (0.0009) [2023-12-26 15:09:53,020][123090] Updated weights for policy 1, policy_version 1937319 (0.0008) [2023-12-26 15:09:53,058][123091] Updated weights for policy 0, policy_version 1949515 (0.0007) [2023-12-26 15:09:53,077][123090] Updated weights for policy 1, policy_version 1937329 (0.0007) [2023-12-26 15:09:53,135][123090] Updated weights for policy 1, policy_version 1937339 (0.0005) [2023-12-26 15:09:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 995041280. Throughput: 0: 8927.5, 1: 8783.8. Samples: 995023096. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:53,785][121949] Avg episode reward: [(0, '6341.681'), (1, '6161.967')] [2023-12-26 15:09:53,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001937344_495960064.pth... [2023-12-26 15:09:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001949520_499081216.pth... [2023-12-26 15:09:53,793][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001936320_495697920.pth [2023-12-26 15:09:53,794][123008] Saving new best policy, reward=6161.967! [2023-12-26 15:09:53,798][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001948496_498819072.pth [2023-12-26 15:09:53,880][123091] Updated weights for policy 0, policy_version 1949525 (0.0008) [2023-12-26 15:09:53,922][123090] Updated weights for policy 1, policy_version 1937349 (0.0008) [2023-12-26 15:09:53,939][123091] Updated weights for policy 0, policy_version 1949535 (0.0007) [2023-12-26 15:09:53,986][123091] Updated weights for policy 0, policy_version 1949545 (0.0005) [2023-12-26 15:09:53,989][123090] Updated weights for policy 1, policy_version 1937359 (0.0008) [2023-12-26 15:09:54,070][123090] Updated weights for policy 1, policy_version 1937369 (0.0010) [2023-12-26 15:09:54,732][123091] Updated weights for policy 0, policy_version 1949555 (0.0007) [2023-12-26 15:09:54,799][123091] Updated weights for policy 0, policy_version 1949565 (0.0010) [2023-12-26 15:09:54,863][123091] Updated weights for policy 0, policy_version 1949575 (0.0010) [2023-12-26 15:09:54,874][123090] Updated weights for policy 1, policy_version 1937379 (0.0009) [2023-12-26 15:09:54,947][123090] Updated weights for policy 1, policy_version 1937389 (0.0009) [2023-12-26 15:09:55,009][123090] Updated weights for policy 1, policy_version 1937399 (0.0009) [2023-12-26 15:09:55,566][123091] Updated weights for policy 0, policy_version 1949585 (0.0006) [2023-12-26 15:09:55,640][123091] Updated weights for policy 0, policy_version 1949595 (0.0006) [2023-12-26 15:09:55,711][123091] Updated weights for policy 0, policy_version 1949605 (0.0005) [2023-12-26 15:09:55,759][123091] Updated weights for policy 0, policy_version 1949615 (0.0005) [2023-12-26 15:09:55,801][123090] Updated weights for policy 1, policy_version 1937409 (0.0009) [2023-12-26 15:09:55,860][123090] Updated weights for policy 1, policy_version 1937419 (0.0010) [2023-12-26 15:09:55,919][123090] Updated weights for policy 1, policy_version 1937429 (0.0010) [2023-12-26 15:09:55,985][123090] Updated weights for policy 1, policy_version 1937439 (0.0010) [2023-12-26 15:09:56,416][123091] Updated weights for policy 0, policy_version 1949625 (0.0009) [2023-12-26 15:09:56,467][123091] Updated weights for policy 0, policy_version 1949635 (0.0010) [2023-12-26 15:09:56,530][123091] Updated weights for policy 0, policy_version 1949645 (0.0011) [2023-12-26 15:09:56,902][123090] Updated weights for policy 1, policy_version 1937449 (0.0010) [2023-12-26 15:09:56,960][123090] Updated weights for policy 1, policy_version 1937459 (0.0010) [2023-12-26 15:09:57,018][123090] Updated weights for policy 1, policy_version 1937469 (0.0010) [2023-12-26 15:09:57,233][123091] Updated weights for policy 0, policy_version 1949655 (0.0007) [2023-12-26 15:09:57,286][123091] Updated weights for policy 0, policy_version 1949665 (0.0005) [2023-12-26 15:09:57,348][123091] Updated weights for policy 0, policy_version 1949675 (0.0006) [2023-12-26 15:09:57,929][123091] Updated weights for policy 0, policy_version 1949685 (0.0005) [2023-12-26 15:09:57,942][123090] Updated weights for policy 1, policy_version 1937479 (0.0008) [2023-12-26 15:09:57,986][123091] Updated weights for policy 0, policy_version 1949695 (0.0005) [2023-12-26 15:09:58,003][123090] Updated weights for policy 1, policy_version 1937489 (0.0009) [2023-12-26 15:09:58,044][123091] Updated weights for policy 0, policy_version 1949705 (0.0006) [2023-12-26 15:09:58,063][123090] Updated weights for policy 1, policy_version 1937499 (0.0008) [2023-12-26 15:09:58,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17744.7). Total num frames: 995131392. Throughput: 0: 9021.8, 1: 8752.9. Samples: 995130120. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:09:58,785][121949] Avg episode reward: [(0, '6152.722'), (1, '5971.029')] [2023-12-26 15:09:58,811][123091] Updated weights for policy 0, policy_version 1949715 (0.0007) [2023-12-26 15:09:58,871][123091] Updated weights for policy 0, policy_version 1949725 (0.0007) [2023-12-26 15:09:58,932][123091] Updated weights for policy 0, policy_version 1949735 (0.0005) [2023-12-26 15:09:58,937][123090] Updated weights for policy 1, policy_version 1937509 (0.0010) [2023-12-26 15:09:59,004][123090] Updated weights for policy 1, policy_version 1937519 (0.0011) [2023-12-26 15:09:59,083][123090] Updated weights for policy 1, policy_version 1937529 (0.0010) [2023-12-26 15:09:59,663][123091] Updated weights for policy 0, policy_version 1949745 (0.0006) [2023-12-26 15:09:59,726][123091] Updated weights for policy 0, policy_version 1949755 (0.0011) [2023-12-26 15:09:59,788][123091] Updated weights for policy 0, policy_version 1949765 (0.0010) [2023-12-26 15:09:59,852][123091] Updated weights for policy 0, policy_version 1949775 (0.0011) [2023-12-26 15:09:59,875][123090] Updated weights for policy 1, policy_version 1937539 (0.0010) [2023-12-26 15:09:59,925][123090] Updated weights for policy 1, policy_version 1937549 (0.0009) [2023-12-26 15:09:59,995][123090] Updated weights for policy 1, policy_version 1937559 (0.0009) [2023-12-26 15:10:00,508][123091] Updated weights for policy 0, policy_version 1949785 (0.0006) [2023-12-26 15:10:00,566][123091] Updated weights for policy 0, policy_version 1949795 (0.0010) [2023-12-26 15:10:00,626][123091] Updated weights for policy 0, policy_version 1949805 (0.0010) [2023-12-26 15:10:00,852][123090] Updated weights for policy 1, policy_version 1937569 (0.0010) [2023-12-26 15:10:00,910][123090] Updated weights for policy 1, policy_version 1937579 (0.0010) [2023-12-26 15:10:00,971][123090] Updated weights for policy 1, policy_version 1937589 (0.0010) [2023-12-26 15:10:01,021][123090] Updated weights for policy 1, policy_version 1937599 (0.0009) [2023-12-26 15:10:01,380][123091] Updated weights for policy 0, policy_version 1949815 (0.0009) [2023-12-26 15:10:01,439][123091] Updated weights for policy 0, policy_version 1949825 (0.0006) [2023-12-26 15:10:01,487][123091] Updated weights for policy 0, policy_version 1949835 (0.0005) [2023-12-26 15:10:01,851][123090] Updated weights for policy 1, policy_version 1937609 (0.0010) [2023-12-26 15:10:01,919][123090] Updated weights for policy 1, policy_version 1937619 (0.0009) [2023-12-26 15:10:01,990][123090] Updated weights for policy 1, policy_version 1937629 (0.0009) [2023-12-26 15:10:02,174][123091] Updated weights for policy 0, policy_version 1949845 (0.0006) [2023-12-26 15:10:02,225][123091] Updated weights for policy 0, policy_version 1949855 (0.0008) [2023-12-26 15:10:02,293][123091] Updated weights for policy 0, policy_version 1949865 (0.0008) [2023-12-26 15:10:02,795][123090] Updated weights for policy 1, policy_version 1937639 (0.0007) [2023-12-26 15:10:02,846][123090] Updated weights for policy 1, policy_version 1937649 (0.0009) [2023-12-26 15:10:02,900][123090] Updated weights for policy 1, policy_version 1937659 (0.0009) [2023-12-26 15:10:03,136][123091] Updated weights for policy 0, policy_version 1949875 (0.0008) [2023-12-26 15:10:03,195][123091] Updated weights for policy 0, policy_version 1949885 (0.0009) [2023-12-26 15:10:03,259][123091] Updated weights for policy 0, policy_version 1949895 (0.0009) [2023-12-26 15:10:03,707][123090] Updated weights for policy 1, policy_version 1937669 (0.0009) [2023-12-26 15:10:03,766][123090] Updated weights for policy 1, policy_version 1937679 (0.0009) [2023-12-26 15:10:03,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 995221504. Throughput: 0: 9069.2, 1: 8693.5. Samples: 995237164. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:03,785][121949] Avg episode reward: [(0, '6190.990'), (1, '5864.281')] [2023-12-26 15:10:03,834][123090] Updated weights for policy 1, policy_version 1937689 (0.0008) [2023-12-26 15:10:04,027][123091] Updated weights for policy 0, policy_version 1949905 (0.0009) [2023-12-26 15:10:04,094][123091] Updated weights for policy 0, policy_version 1949915 (0.0009) [2023-12-26 15:10:04,167][123091] Updated weights for policy 0, policy_version 1949925 (0.0009) [2023-12-26 15:10:04,235][123091] Updated weights for policy 0, policy_version 1949935 (0.0010) [2023-12-26 15:10:04,653][123090] Updated weights for policy 1, policy_version 1937699 (0.0008) [2023-12-26 15:10:04,703][123090] Updated weights for policy 1, policy_version 1937709 (0.0009) [2023-12-26 15:10:04,764][123090] Updated weights for policy 1, policy_version 1937720 (0.0010) [2023-12-26 15:10:05,044][123091] Updated weights for policy 0, policy_version 1949945 (0.0009) [2023-12-26 15:10:05,102][123091] Updated weights for policy 0, policy_version 1949955 (0.0010) [2023-12-26 15:10:05,157][123091] Updated weights for policy 0, policy_version 1949965 (0.0009) [2023-12-26 15:10:05,562][123090] Updated weights for policy 1, policy_version 1937730 (0.0008) [2023-12-26 15:10:05,624][123090] Updated weights for policy 1, policy_version 1937740 (0.0005) [2023-12-26 15:10:05,679][123090] Updated weights for policy 1, policy_version 1937750 (0.0005) [2023-12-26 15:10:05,729][123090] Updated weights for policy 1, policy_version 1937760 (0.0005) [2023-12-26 15:10:05,978][123091] Updated weights for policy 0, policy_version 1949975 (0.0009) [2023-12-26 15:10:06,042][123091] Updated weights for policy 0, policy_version 1949985 (0.0010) [2023-12-26 15:10:06,095][123091] Updated weights for policy 0, policy_version 1949995 (0.0010) [2023-12-26 15:10:06,402][123090] Updated weights for policy 1, policy_version 1937770 (0.0009) [2023-12-26 15:10:06,463][123090] Updated weights for policy 1, policy_version 1937780 (0.0009) [2023-12-26 15:10:06,522][123090] Updated weights for policy 1, policy_version 1937790 (0.0010) [2023-12-26 15:10:06,950][123091] Updated weights for policy 0, policy_version 1950005 (0.0009) [2023-12-26 15:10:07,002][123091] Updated weights for policy 0, policy_version 1950015 (0.0009) [2023-12-26 15:10:07,056][123091] Updated weights for policy 0, policy_version 1950025 (0.0009) [2023-12-26 15:10:07,262][123090] Updated weights for policy 1, policy_version 1937800 (0.0006) [2023-12-26 15:10:07,311][123090] Updated weights for policy 1, policy_version 1937810 (0.0005) [2023-12-26 15:10:07,359][123090] Updated weights for policy 1, policy_version 1937820 (0.0006) [2023-12-26 15:10:07,959][123091] Updated weights for policy 0, policy_version 1950035 (0.0009) [2023-12-26 15:10:08,025][123091] Updated weights for policy 0, policy_version 1950045 (0.0009) [2023-12-26 15:10:08,085][123091] Updated weights for policy 0, policy_version 1950055 (0.0009) [2023-12-26 15:10:08,143][123090] Updated weights for policy 1, policy_version 1937830 (0.0007) [2023-12-26 15:10:08,200][123090] Updated weights for policy 1, policy_version 1937840 (0.0009) [2023-12-26 15:10:08,248][123090] Updated weights for policy 1, policy_version 1937850 (0.0009) [2023-12-26 15:10:08,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 995311616. Throughput: 0: 9072.1, 1: 8733.4. Samples: 995290512. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:08,785][121949] Avg episode reward: [(0, '6309.245'), (1, '5957.945')] [2023-12-26 15:10:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001950064_499220480.pth... [2023-12-26 15:10:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001937856_496091136.pth... [2023-12-26 15:10:08,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001949008_498950144.pth [2023-12-26 15:10:08,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001936832_495828992.pth [2023-12-26 15:10:08,896][123091] Updated weights for policy 0, policy_version 1950065 (0.0009) [2023-12-26 15:10:08,948][123091] Updated weights for policy 0, policy_version 1950075 (0.0009) [2023-12-26 15:10:08,999][123091] Updated weights for policy 0, policy_version 1950086 (0.0010) [2023-12-26 15:10:09,044][123090] Updated weights for policy 1, policy_version 1937860 (0.0008) [2023-12-26 15:10:09,098][123090] Updated weights for policy 1, policy_version 1937870 (0.0005) [2023-12-26 15:10:09,153][123090] Updated weights for policy 1, policy_version 1937880 (0.0005) [2023-12-26 15:10:09,842][123090] Updated weights for policy 1, policy_version 1937890 (0.0006) [2023-12-26 15:10:09,844][123091] Updated weights for policy 0, policy_version 1950097 (0.0009) [2023-12-26 15:10:09,912][123090] Updated weights for policy 1, policy_version 1937900 (0.0007) [2023-12-26 15:10:09,917][123091] Updated weights for policy 0, policy_version 1950107 (0.0007) [2023-12-26 15:10:09,980][123090] Updated weights for policy 1, policy_version 1937910 (0.0008) [2023-12-26 15:10:09,987][123091] Updated weights for policy 0, policy_version 1950117 (0.0007) [2023-12-26 15:10:10,041][123090] Updated weights for policy 1, policy_version 1937920 (0.0008) [2023-12-26 15:10:10,044][123091] Updated weights for policy 0, policy_version 1950127 (0.0006) [2023-12-26 15:10:10,846][123090] Updated weights for policy 1, policy_version 1937930 (0.0009) [2023-12-26 15:10:10,868][123091] Updated weights for policy 0, policy_version 1950137 (0.0008) [2023-12-26 15:10:10,896][123090] Updated weights for policy 1, policy_version 1937940 (0.0008) [2023-12-26 15:10:10,928][123091] Updated weights for policy 0, policy_version 1950147 (0.0007) [2023-12-26 15:10:10,940][123090] Updated weights for policy 1, policy_version 1937950 (0.0007) [2023-12-26 15:10:10,994][123091] Updated weights for policy 0, policy_version 1950157 (0.0009) [2023-12-26 15:10:11,740][123090] Updated weights for policy 1, policy_version 1937960 (0.0008) [2023-12-26 15:10:11,785][123091] Updated weights for policy 0, policy_version 1950167 (0.0009) [2023-12-26 15:10:11,813][123090] Updated weights for policy 1, policy_version 1937970 (0.0007) [2023-12-26 15:10:11,859][123091] Updated weights for policy 0, policy_version 1950177 (0.0010) [2023-12-26 15:10:11,875][123090] Updated weights for policy 1, policy_version 1937980 (0.0006) [2023-12-26 15:10:11,918][123091] Updated weights for policy 0, policy_version 1950187 (0.0008) [2023-12-26 15:10:12,640][123090] Updated weights for policy 1, policy_version 1937990 (0.0007) [2023-12-26 15:10:12,683][123091] Updated weights for policy 0, policy_version 1950197 (0.0008) [2023-12-26 15:10:12,703][123090] Updated weights for policy 1, policy_version 1938000 (0.0009) [2023-12-26 15:10:12,737][123091] Updated weights for policy 0, policy_version 1950207 (0.0005) [2023-12-26 15:10:12,764][123090] Updated weights for policy 1, policy_version 1938010 (0.0008) [2023-12-26 15:10:12,804][123091] Updated weights for policy 0, policy_version 1950217 (0.0010) [2023-12-26 15:10:13,588][123091] Updated weights for policy 0, policy_version 1950227 (0.0010) [2023-12-26 15:10:13,612][123090] Updated weights for policy 1, policy_version 1938020 (0.0009) [2023-12-26 15:10:13,639][123091] Updated weights for policy 0, policy_version 1950237 (0.0005) [2023-12-26 15:10:13,659][123090] Updated weights for policy 1, policy_version 1938030 (0.0010) [2023-12-26 15:10:13,707][123091] Updated weights for policy 0, policy_version 1950247 (0.0005) [2023-12-26 15:10:13,715][123090] Updated weights for policy 1, policy_version 1938040 (0.0005) [2023-12-26 15:10:13,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17885.9, 300 sec: 17772.5). Total num frames: 995409920. Throughput: 0: 8960.2, 1: 8779.6. Samples: 995395856. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:13,785][121949] Avg episode reward: [(0, '6343.714'), (1, '5962.229')] [2023-12-26 15:10:14,383][123091] Updated weights for policy 0, policy_version 1950257 (0.0005) [2023-12-26 15:10:14,430][123091] Updated weights for policy 0, policy_version 1950267 (0.0005) [2023-12-26 15:10:14,475][123091] Updated weights for policy 0, policy_version 1950277 (0.0005) [2023-12-26 15:10:14,524][123091] Updated weights for policy 0, policy_version 1950287 (0.0005) [2023-12-26 15:10:14,554][123090] Updated weights for policy 1, policy_version 1938050 (0.0008) [2023-12-26 15:10:14,615][123090] Updated weights for policy 1, policy_version 1938060 (0.0007) [2023-12-26 15:10:14,671][123090] Updated weights for policy 1, policy_version 1938070 (0.0010) [2023-12-26 15:10:14,742][123090] Updated weights for policy 1, policy_version 1938080 (0.0008) [2023-12-26 15:10:15,312][123091] Updated weights for policy 0, policy_version 1950297 (0.0009) [2023-12-26 15:10:15,367][123091] Updated weights for policy 0, policy_version 1950307 (0.0010) [2023-12-26 15:10:15,422][123091] Updated weights for policy 0, policy_version 1950317 (0.0010) [2023-12-26 15:10:15,518][123090] Updated weights for policy 1, policy_version 1938090 (0.0005) [2023-12-26 15:10:15,591][123090] Updated weights for policy 1, policy_version 1938100 (0.0005) [2023-12-26 15:10:15,651][123090] Updated weights for policy 1, policy_version 1938110 (0.0007) [2023-12-26 15:10:16,342][123091] Updated weights for policy 0, policy_version 1950327 (0.0009) [2023-12-26 15:10:16,367][123090] Updated weights for policy 1, policy_version 1938120 (0.0006) [2023-12-26 15:10:16,411][123091] Updated weights for policy 0, policy_version 1950337 (0.0009) [2023-12-26 15:10:16,419][123090] Updated weights for policy 1, policy_version 1938130 (0.0005) [2023-12-26 15:10:16,473][123091] Updated weights for policy 0, policy_version 1950347 (0.0008) [2023-12-26 15:10:16,486][123090] Updated weights for policy 1, policy_version 1938140 (0.0005) [2023-12-26 15:10:17,258][123090] Updated weights for policy 1, policy_version 1938150 (0.0005) [2023-12-26 15:10:17,321][123090] Updated weights for policy 1, policy_version 1938160 (0.0006) [2023-12-26 15:10:17,326][123091] Updated weights for policy 0, policy_version 1950357 (0.0009) [2023-12-26 15:10:17,372][123090] Updated weights for policy 1, policy_version 1938170 (0.0007) [2023-12-26 15:10:17,375][123091] Updated weights for policy 0, policy_version 1950367 (0.0010) [2023-12-26 15:10:17,429][123091] Updated weights for policy 0, policy_version 1950377 (0.0009) [2023-12-26 15:10:18,125][123090] Updated weights for policy 1, policy_version 1938180 (0.0007) [2023-12-26 15:10:18,187][123090] Updated weights for policy 1, policy_version 1938190 (0.0008) [2023-12-26 15:10:18,255][123090] Updated weights for policy 1, policy_version 1938200 (0.0005) [2023-12-26 15:10:18,299][123091] Updated weights for policy 0, policy_version 1950387 (0.0007) [2023-12-26 15:10:18,366][123091] Updated weights for policy 0, policy_version 1950397 (0.0008) [2023-12-26 15:10:18,430][123091] Updated weights for policy 0, policy_version 1950407 (0.0005) [2023-12-26 15:10:18,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 995491840. Throughput: 0: 8922.6, 1: 8793.4. Samples: 995504132. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:18,786][121949] Avg episode reward: [(0, '6227.518'), (1, '5904.803')] [2023-12-26 15:10:18,864][123090] Updated weights for policy 1, policy_version 1938210 (0.0007) [2023-12-26 15:10:18,930][123090] Updated weights for policy 1, policy_version 1938220 (0.0009) [2023-12-26 15:10:19,006][123090] Updated weights for policy 1, policy_version 1938230 (0.0010) [2023-12-26 15:10:19,071][123090] Updated weights for policy 1, policy_version 1938240 (0.0009) [2023-12-26 15:10:19,210][123091] Updated weights for policy 0, policy_version 1950417 (0.0008) [2023-12-26 15:10:19,277][123091] Updated weights for policy 0, policy_version 1950427 (0.0009) [2023-12-26 15:10:19,339][123091] Updated weights for policy 0, policy_version 1950437 (0.0009) [2023-12-26 15:10:19,404][123091] Updated weights for policy 0, policy_version 1950447 (0.0010) [2023-12-26 15:10:19,926][123090] Updated weights for policy 1, policy_version 1938250 (0.0007) [2023-12-26 15:10:19,992][123090] Updated weights for policy 1, policy_version 1938260 (0.0010) [2023-12-26 15:10:20,063][123090] Updated weights for policy 1, policy_version 1938270 (0.0007) [2023-12-26 15:10:20,288][123091] Updated weights for policy 0, policy_version 1950457 (0.0008) [2023-12-26 15:10:20,360][123091] Updated weights for policy 0, policy_version 1950467 (0.0009) [2023-12-26 15:10:20,424][123091] Updated weights for policy 0, policy_version 1950477 (0.0009) [2023-12-26 15:10:20,847][123090] Updated weights for policy 1, policy_version 1938280 (0.0010) [2023-12-26 15:10:20,915][123090] Updated weights for policy 1, policy_version 1938290 (0.0011) [2023-12-26 15:10:20,982][123090] Updated weights for policy 1, policy_version 1938300 (0.0010) [2023-12-26 15:10:21,282][123091] Updated weights for policy 0, policy_version 1950487 (0.0007) [2023-12-26 15:10:21,354][123091] Updated weights for policy 0, policy_version 1950497 (0.0009) [2023-12-26 15:10:21,426][123091] Updated weights for policy 0, policy_version 1950507 (0.0008) [2023-12-26 15:10:21,861][123090] Updated weights for policy 1, policy_version 1938310 (0.0011) [2023-12-26 15:10:21,922][123090] Updated weights for policy 1, policy_version 1938320 (0.0009) [2023-12-26 15:10:21,985][123090] Updated weights for policy 1, policy_version 1938330 (0.0009) [2023-12-26 15:10:22,226][123091] Updated weights for policy 0, policy_version 1950517 (0.0010) [2023-12-26 15:10:22,283][123091] Updated weights for policy 0, policy_version 1950527 (0.0009) [2023-12-26 15:10:22,347][123091] Updated weights for policy 0, policy_version 1950537 (0.0009) [2023-12-26 15:10:22,849][123090] Updated weights for policy 1, policy_version 1938340 (0.0010) [2023-12-26 15:10:22,918][123090] Updated weights for policy 1, policy_version 1938350 (0.0010) [2023-12-26 15:10:22,985][123090] Updated weights for policy 1, policy_version 1938360 (0.0008) [2023-12-26 15:10:23,209][123091] Updated weights for policy 0, policy_version 1950547 (0.0010) [2023-12-26 15:10:23,267][123091] Updated weights for policy 0, policy_version 1950557 (0.0010) [2023-12-26 15:10:23,320][123091] Updated weights for policy 0, policy_version 1950567 (0.0010) [2023-12-26 15:10:23,713][123090] Updated weights for policy 1, policy_version 1938370 (0.0010) [2023-12-26 15:10:23,772][123090] Updated weights for policy 1, policy_version 1938380 (0.0006) [2023-12-26 15:10:23,784][121949] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 995573760. Throughput: 0: 8862.5, 1: 8786.9. Samples: 995553980. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:23,785][121949] Avg episode reward: [(0, '6306.246'), (1, '5917.705')] [2023-12-26 15:10:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001950576_499351552.pth... [2023-12-26 15:10:23,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001949520_499081216.pth [2023-12-26 15:10:23,835][123090] Updated weights for policy 1, policy_version 1938390 (0.0005) [2023-12-26 15:10:23,889][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001938400_496230400.pth... [2023-12-26 15:10:23,891][123090] Updated weights for policy 1, policy_version 1938400 (0.0005) [2023-12-26 15:10:23,892][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001937344_495960064.pth [2023-12-26 15:10:24,247][123091] Updated weights for policy 0, policy_version 1950577 (0.0010) [2023-12-26 15:10:24,306][123091] Updated weights for policy 0, policy_version 1950587 (0.0009) [2023-12-26 15:10:24,361][123091] Updated weights for policy 0, policy_version 1950597 (0.0009) [2023-12-26 15:10:24,419][123091] Updated weights for policy 0, policy_version 1950607 (0.0010) [2023-12-26 15:10:24,612][123090] Updated weights for policy 1, policy_version 1938410 (0.0007) [2023-12-26 15:10:24,677][123090] Updated weights for policy 1, policy_version 1938420 (0.0006) [2023-12-26 15:10:24,739][123090] Updated weights for policy 1, policy_version 1938430 (0.0005) [2023-12-26 15:10:25,335][123091] Updated weights for policy 0, policy_version 1950617 (0.0009) [2023-12-26 15:10:25,363][123090] Updated weights for policy 1, policy_version 1938440 (0.0006) [2023-12-26 15:10:25,395][123091] Updated weights for policy 0, policy_version 1950627 (0.0009) [2023-12-26 15:10:25,417][123090] Updated weights for policy 1, policy_version 1938450 (0.0007) [2023-12-26 15:10:25,453][123091] Updated weights for policy 0, policy_version 1950637 (0.0009) [2023-12-26 15:10:25,465][123090] Updated weights for policy 1, policy_version 1938460 (0.0007) [2023-12-26 15:10:26,167][123090] Updated weights for policy 1, policy_version 1938470 (0.0005) [2023-12-26 15:10:26,228][123090] Updated weights for policy 1, policy_version 1938480 (0.0006) [2023-12-26 15:10:26,287][123090] Updated weights for policy 1, policy_version 1938490 (0.0006) [2023-12-26 15:10:26,350][123091] Updated weights for policy 0, policy_version 1950647 (0.0009) [2023-12-26 15:10:26,406][123091] Updated weights for policy 0, policy_version 1950657 (0.0009) [2023-12-26 15:10:26,459][123091] Updated weights for policy 0, policy_version 1950667 (0.0010) [2023-12-26 15:10:26,986][123090] Updated weights for policy 1, policy_version 1938500 (0.0007) [2023-12-26 15:10:27,033][123090] Updated weights for policy 1, policy_version 1938510 (0.0010) [2023-12-26 15:10:27,080][123090] Updated weights for policy 1, policy_version 1938520 (0.0010) [2023-12-26 15:10:27,295][123091] Updated weights for policy 0, policy_version 1950677 (0.0010) [2023-12-26 15:10:27,363][123091] Updated weights for policy 0, policy_version 1950687 (0.0009) [2023-12-26 15:10:27,411][123091] Updated weights for policy 0, policy_version 1950697 (0.0010) [2023-12-26 15:10:27,826][123090] Updated weights for policy 1, policy_version 1938530 (0.0009) [2023-12-26 15:10:27,873][123090] Updated weights for policy 1, policy_version 1938540 (0.0005) [2023-12-26 15:10:27,917][123090] Updated weights for policy 1, policy_version 1938550 (0.0005) [2023-12-26 15:10:27,971][123090] Updated weights for policy 1, policy_version 1938560 (0.0007) [2023-12-26 15:10:28,303][123091] Updated weights for policy 0, policy_version 1950707 (0.0010) [2023-12-26 15:10:28,360][123091] Updated weights for policy 0, policy_version 1950717 (0.0008) [2023-12-26 15:10:28,422][123091] Updated weights for policy 0, policy_version 1950727 (0.0010) [2023-12-26 15:10:28,695][123090] Updated weights for policy 1, policy_version 1938570 (0.0009) [2023-12-26 15:10:28,762][123090] Updated weights for policy 1, policy_version 1938580 (0.0008) [2023-12-26 15:10:28,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 995663872. Throughput: 0: 8798.3, 1: 8948.0. Samples: 995659492. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:28,784][121949] Avg episode reward: [(0, '6324.771'), (1, '6057.506')] [2023-12-26 15:10:28,831][123090] Updated weights for policy 1, policy_version 1938590 (0.0007) [2023-12-26 15:10:29,310][123091] Updated weights for policy 0, policy_version 1950737 (0.0009) [2023-12-26 15:10:29,375][123091] Updated weights for policy 0, policy_version 1950747 (0.0010) [2023-12-26 15:10:29,445][123091] Updated weights for policy 0, policy_version 1950758 (0.0010) [2023-12-26 15:10:29,508][123091] Updated weights for policy 0, policy_version 1950768 (0.0009) [2023-12-26 15:10:29,616][123090] Updated weights for policy 1, policy_version 1938600 (0.0009) [2023-12-26 15:10:29,671][123090] Updated weights for policy 1, policy_version 1938610 (0.0009) [2023-12-26 15:10:29,731][123090] Updated weights for policy 1, policy_version 1938620 (0.0009) [2023-12-26 15:10:30,321][123091] Updated weights for policy 0, policy_version 1950778 (0.0009) [2023-12-26 15:10:30,381][123091] Updated weights for policy 0, policy_version 1950788 (0.0009) [2023-12-26 15:10:30,442][123091] Updated weights for policy 0, policy_version 1950798 (0.0010) [2023-12-26 15:10:30,566][123090] Updated weights for policy 1, policy_version 1938630 (0.0009) [2023-12-26 15:10:30,623][123090] Updated weights for policy 1, policy_version 1938640 (0.0010) [2023-12-26 15:10:30,671][123090] Updated weights for policy 1, policy_version 1938650 (0.0010) [2023-12-26 15:10:31,288][123091] Updated weights for policy 0, policy_version 1950808 (0.0009) [2023-12-26 15:10:31,347][123091] Updated weights for policy 0, policy_version 1950818 (0.0009) [2023-12-26 15:10:31,400][123091] Updated weights for policy 0, policy_version 1950828 (0.0009) [2023-12-26 15:10:31,520][123090] Updated weights for policy 1, policy_version 1938660 (0.0008) [2023-12-26 15:10:31,588][123090] Updated weights for policy 1, policy_version 1938670 (0.0005) [2023-12-26 15:10:31,658][123090] Updated weights for policy 1, policy_version 1938680 (0.0007) [2023-12-26 15:10:32,222][123091] Updated weights for policy 0, policy_version 1950838 (0.0010) [2023-12-26 15:10:32,298][123091] Updated weights for policy 0, policy_version 1950848 (0.0009) [2023-12-26 15:10:32,330][123090] Updated weights for policy 1, policy_version 1938690 (0.0006) [2023-12-26 15:10:32,359][123091] Updated weights for policy 0, policy_version 1950858 (0.0006) [2023-12-26 15:10:32,393][123090] Updated weights for policy 1, policy_version 1938700 (0.0008) [2023-12-26 15:10:32,446][123090] Updated weights for policy 1, policy_version 1938711 (0.0010) [2023-12-26 15:10:33,113][123091] Updated weights for policy 0, policy_version 1950868 (0.0009) [2023-12-26 15:10:33,144][123090] Updated weights for policy 1, policy_version 1938721 (0.0009) [2023-12-26 15:10:33,168][123091] Updated weights for policy 0, policy_version 1950878 (0.0010) [2023-12-26 15:10:33,199][123090] Updated weights for policy 1, policy_version 1938731 (0.0005) [2023-12-26 15:10:33,215][123091] Updated weights for policy 0, policy_version 1950888 (0.0010) [2023-12-26 15:10:33,248][123090] Updated weights for policy 1, policy_version 1938741 (0.0005) [2023-12-26 15:10:33,293][123090] Updated weights for policy 1, policy_version 1938751 (0.0005) [2023-12-26 15:10:33,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 995753984. Throughput: 0: 8703.0, 1: 8929.9. Samples: 995766356. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:33,785][121949] Avg episode reward: [(0, '6205.262'), (1, '5927.487')] [2023-12-26 15:10:33,963][123091] Updated weights for policy 0, policy_version 1950898 (0.0009) [2023-12-26 15:10:34,024][123091] Updated weights for policy 0, policy_version 1950908 (0.0005) [2023-12-26 15:10:34,028][123090] Updated weights for policy 1, policy_version 1938761 (0.0007) [2023-12-26 15:10:34,076][123091] Updated weights for policy 0, policy_version 1950918 (0.0006) [2023-12-26 15:10:34,080][123090] Updated weights for policy 1, policy_version 1938771 (0.0008) [2023-12-26 15:10:34,146][123091] Updated weights for policy 0, policy_version 1950928 (0.0011) [2023-12-26 15:10:34,147][123090] Updated weights for policy 1, policy_version 1938781 (0.0009) [2023-12-26 15:10:34,876][123091] Updated weights for policy 0, policy_version 1950938 (0.0011) [2023-12-26 15:10:34,920][123091] Updated weights for policy 0, policy_version 1950948 (0.0010) [2023-12-26 15:10:34,967][123090] Updated weights for policy 1, policy_version 1938791 (0.0007) [2023-12-26 15:10:34,970][123091] Updated weights for policy 0, policy_version 1950958 (0.0011) [2023-12-26 15:10:35,028][123090] Updated weights for policy 1, policy_version 1938801 (0.0008) [2023-12-26 15:10:35,078][123090] Updated weights for policy 1, policy_version 1938811 (0.0009) [2023-12-26 15:10:35,815][123091] Updated weights for policy 0, policy_version 1950968 (0.0011) [2023-12-26 15:10:35,874][123091] Updated weights for policy 0, policy_version 1950978 (0.0011) [2023-12-26 15:10:35,899][123090] Updated weights for policy 1, policy_version 1938821 (0.0007) [2023-12-26 15:10:35,926][123091] Updated weights for policy 0, policy_version 1950988 (0.0010) [2023-12-26 15:10:35,960][123090] Updated weights for policy 1, policy_version 1938831 (0.0007) [2023-12-26 15:10:36,008][123090] Updated weights for policy 1, policy_version 1938841 (0.0008) [2023-12-26 15:10:36,732][123091] Updated weights for policy 0, policy_version 1950998 (0.0010) [2023-12-26 15:10:36,775][123091] Updated weights for policy 0, policy_version 1951008 (0.0010) [2023-12-26 15:10:36,830][123091] Updated weights for policy 0, policy_version 1951018 (0.0010) [2023-12-26 15:10:36,886][123090] Updated weights for policy 1, policy_version 1938851 (0.0009) [2023-12-26 15:10:36,950][123090] Updated weights for policy 1, policy_version 1938861 (0.0009) [2023-12-26 15:10:37,015][123090] Updated weights for policy 1, policy_version 1938871 (0.0009) [2023-12-26 15:10:37,679][123091] Updated weights for policy 0, policy_version 1951028 (0.0011) [2023-12-26 15:10:37,738][123091] Updated weights for policy 0, policy_version 1951038 (0.0011) [2023-12-26 15:10:37,805][123091] Updated weights for policy 0, policy_version 1951048 (0.0011) [2023-12-26 15:10:37,850][123090] Updated weights for policy 1, policy_version 1938881 (0.0008) [2023-12-26 15:10:37,912][123090] Updated weights for policy 1, policy_version 1938891 (0.0009) [2023-12-26 15:10:37,974][123090] Updated weights for policy 1, policy_version 1938901 (0.0010) [2023-12-26 15:10:38,026][123090] Updated weights for policy 1, policy_version 1938911 (0.0010) [2023-12-26 15:10:38,568][123091] Updated weights for policy 0, policy_version 1951058 (0.0009) [2023-12-26 15:10:38,618][123091] Updated weights for policy 0, policy_version 1951068 (0.0006) [2023-12-26 15:10:38,672][123091] Updated weights for policy 0, policy_version 1951078 (0.0008) [2023-12-26 15:10:38,735][123091] Updated weights for policy 0, policy_version 1951088 (0.0011) [2023-12-26 15:10:38,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17772.5). Total num frames: 995844096. Throughput: 0: 8750.5, 1: 8939.5. Samples: 995819148. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:38,785][121949] Avg episode reward: [(0, '6231.442'), (1, '5749.302')] [2023-12-26 15:10:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001951088_499482624.pth... [2023-12-26 15:10:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001938912_496361472.pth... [2023-12-26 15:10:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001950064_499220480.pth [2023-12-26 15:10:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001937856_496091136.pth [2023-12-26 15:10:38,879][123090] Updated weights for policy 1, policy_version 1938921 (0.0010) [2023-12-26 15:10:38,944][123090] Updated weights for policy 1, policy_version 1938931 (0.0010) [2023-12-26 15:10:38,993][123090] Updated weights for policy 1, policy_version 1938941 (0.0009) [2023-12-26 15:10:39,584][123091] Updated weights for policy 0, policy_version 1951098 (0.0011) [2023-12-26 15:10:39,633][123091] Updated weights for policy 0, policy_version 1951108 (0.0010) [2023-12-26 15:10:39,681][123091] Updated weights for policy 0, policy_version 1951118 (0.0011) [2023-12-26 15:10:39,882][123090] Updated weights for policy 1, policy_version 1938951 (0.0009) [2023-12-26 15:10:39,954][123090] Updated weights for policy 1, policy_version 1938961 (0.0010) [2023-12-26 15:10:40,015][123090] Updated weights for policy 1, policy_version 1938971 (0.0008) [2023-12-26 15:10:40,650][123091] Updated weights for policy 0, policy_version 1951128 (0.0010) [2023-12-26 15:10:40,722][123091] Updated weights for policy 0, policy_version 1951138 (0.0009) [2023-12-26 15:10:40,770][123090] Updated weights for policy 1, policy_version 1938981 (0.0008) [2023-12-26 15:10:40,785][123091] Updated weights for policy 0, policy_version 1951148 (0.0009) [2023-12-26 15:10:40,829][123090] Updated weights for policy 1, policy_version 1938991 (0.0008) [2023-12-26 15:10:40,896][123090] Updated weights for policy 1, policy_version 1939001 (0.0009) [2023-12-26 15:10:41,596][123091] Updated weights for policy 0, policy_version 1951158 (0.0010) [2023-12-26 15:10:41,665][123091] Updated weights for policy 0, policy_version 1951168 (0.0010) [2023-12-26 15:10:41,732][123091] Updated weights for policy 0, policy_version 1951178 (0.0008) [2023-12-26 15:10:41,775][123090] Updated weights for policy 1, policy_version 1939011 (0.0008) [2023-12-26 15:10:41,833][123090] Updated weights for policy 1, policy_version 1939021 (0.0006) [2023-12-26 15:10:41,906][123090] Updated weights for policy 1, policy_version 1939031 (0.0010) [2023-12-26 15:10:42,545][123091] Updated weights for policy 0, policy_version 1951188 (0.0009) [2023-12-26 15:10:42,612][123091] Updated weights for policy 0, policy_version 1951198 (0.0011) [2023-12-26 15:10:42,683][123091] Updated weights for policy 0, policy_version 1951208 (0.0011) [2023-12-26 15:10:42,774][123090] Updated weights for policy 1, policy_version 1939041 (0.0009) [2023-12-26 15:10:42,834][123090] Updated weights for policy 1, policy_version 1939051 (0.0005) [2023-12-26 15:10:42,902][123090] Updated weights for policy 1, policy_version 1939061 (0.0005) [2023-12-26 15:10:42,963][123090] Updated weights for policy 1, policy_version 1939071 (0.0008) [2023-12-26 15:10:43,406][123091] Updated weights for policy 0, policy_version 1951218 (0.0010) [2023-12-26 15:10:43,480][123091] Updated weights for policy 0, policy_version 1951228 (0.0005) [2023-12-26 15:10:43,550][123091] Updated weights for policy 0, policy_version 1951238 (0.0005) [2023-12-26 15:10:43,624][123091] Updated weights for policy 0, policy_version 1951248 (0.0005) [2023-12-26 15:10:43,763][123090] Updated weights for policy 1, policy_version 1939081 (0.0009) [2023-12-26 15:10:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 995926016. Throughput: 0: 8637.8, 1: 8937.7. Samples: 995921016. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:43,785][121949] Avg episode reward: [(0, '6261.342'), (1, '5618.511')] [2023-12-26 15:10:43,825][123090] Updated weights for policy 1, policy_version 1939091 (0.0008) [2023-12-26 15:10:43,895][123090] Updated weights for policy 1, policy_version 1939101 (0.0008) [2023-12-26 15:10:44,309][123091] Updated weights for policy 0, policy_version 1951258 (0.0010) [2023-12-26 15:10:44,379][123091] Updated weights for policy 0, policy_version 1951268 (0.0005) [2023-12-26 15:10:44,437][123091] Updated weights for policy 0, policy_version 1951278 (0.0008) [2023-12-26 15:10:44,637][123090] Updated weights for policy 1, policy_version 1939111 (0.0008) [2023-12-26 15:10:44,705][123090] Updated weights for policy 1, policy_version 1939121 (0.0006) [2023-12-26 15:10:44,761][123090] Updated weights for policy 1, policy_version 1939131 (0.0006) [2023-12-26 15:10:45,270][123091] Updated weights for policy 0, policy_version 1951288 (0.0010) [2023-12-26 15:10:45,344][123091] Updated weights for policy 0, policy_version 1951298 (0.0010) [2023-12-26 15:10:45,412][123091] Updated weights for policy 0, policy_version 1951308 (0.0010) [2023-12-26 15:10:45,523][123090] Updated weights for policy 1, policy_version 1939141 (0.0008) [2023-12-26 15:10:45,580][123090] Updated weights for policy 1, policy_version 1939151 (0.0009) [2023-12-26 15:10:45,630][123090] Updated weights for policy 1, policy_version 1939161 (0.0009) [2023-12-26 15:10:46,214][123091] Updated weights for policy 0, policy_version 1951318 (0.0009) [2023-12-26 15:10:46,277][123091] Updated weights for policy 0, policy_version 1951328 (0.0010) [2023-12-26 15:10:46,326][123091] Updated weights for policy 0, policy_version 1951338 (0.0009) [2023-12-26 15:10:46,475][123090] Updated weights for policy 1, policy_version 1939171 (0.0009) [2023-12-26 15:10:46,529][123090] Updated weights for policy 1, policy_version 1939181 (0.0009) [2023-12-26 15:10:46,579][123090] Updated weights for policy 1, policy_version 1939191 (0.0010) [2023-12-26 15:10:47,123][123091] Updated weights for policy 0, policy_version 1951348 (0.0008) [2023-12-26 15:10:47,175][123091] Updated weights for policy 0, policy_version 1951358 (0.0005) [2023-12-26 15:10:47,226][123091] Updated weights for policy 0, policy_version 1951368 (0.0005) [2023-12-26 15:10:47,300][123090] Updated weights for policy 1, policy_version 1939201 (0.0009) [2023-12-26 15:10:47,351][123090] Updated weights for policy 1, policy_version 1939211 (0.0005) [2023-12-26 15:10:47,409][123090] Updated weights for policy 1, policy_version 1939221 (0.0005) [2023-12-26 15:10:47,458][123090] Updated weights for policy 1, policy_version 1939231 (0.0005) [2023-12-26 15:10:48,009][123091] Updated weights for policy 0, policy_version 1951378 (0.0006) [2023-12-26 15:10:48,067][123091] Updated weights for policy 0, policy_version 1951388 (0.0005) [2023-12-26 15:10:48,122][123091] Updated weights for policy 0, policy_version 1951398 (0.0005) [2023-12-26 15:10:48,125][123090] Updated weights for policy 1, policy_version 1939241 (0.0006) [2023-12-26 15:10:48,184][123091] Updated weights for policy 0, policy_version 1951408 (0.0008) [2023-12-26 15:10:48,188][123090] Updated weights for policy 1, policy_version 1939251 (0.0008) [2023-12-26 15:10:48,251][123090] Updated weights for policy 1, policy_version 1939261 (0.0010) [2023-12-26 15:10:48,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17744.7). Total num frames: 996016128. Throughput: 0: 8598.1, 1: 9008.5. Samples: 996029460. Policy #0 lag: (min: 16.0, avg: 45.3, max: 48.0) [2023-12-26 15:10:48,784][121949] Avg episode reward: [(0, '6309.906'), (1, '5664.606')] [2023-12-26 15:10:48,921][123091] Updated weights for policy 0, policy_version 1951418 (0.0006) [2023-12-26 15:10:48,987][123091] Updated weights for policy 0, policy_version 1951428 (0.0008) [2023-12-26 15:10:49,059][123091] Updated weights for policy 0, policy_version 1951438 (0.0006) [2023-12-26 15:10:49,129][123090] Updated weights for policy 1, policy_version 1939271 (0.0010) [2023-12-26 15:10:49,197][123090] Updated weights for policy 1, policy_version 1939281 (0.0009) [2023-12-26 15:10:49,265][123090] Updated weights for policy 1, policy_version 1939291 (0.0008) [2023-12-26 15:10:49,864][123091] Updated weights for policy 0, policy_version 1951448 (0.0008) [2023-12-26 15:10:49,936][123091] Updated weights for policy 0, policy_version 1951458 (0.0009) [2023-12-26 15:10:50,006][123091] Updated weights for policy 0, policy_version 1951468 (0.0010) [2023-12-26 15:10:50,038][123090] Updated weights for policy 1, policy_version 1939301 (0.0010) [2023-12-26 15:10:50,105][123090] Updated weights for policy 1, policy_version 1939311 (0.0009) [2023-12-26 15:10:50,173][123090] Updated weights for policy 1, policy_version 1939321 (0.0009) [2023-12-26 15:10:50,841][123091] Updated weights for policy 0, policy_version 1951478 (0.0006) [2023-12-26 15:10:50,913][123091] Updated weights for policy 0, policy_version 1951488 (0.0006) [2023-12-26 15:10:50,940][123090] Updated weights for policy 1, policy_version 1939331 (0.0009) [2023-12-26 15:10:50,973][123091] Updated weights for policy 0, policy_version 1951498 (0.0009) [2023-12-26 15:10:50,998][123090] Updated weights for policy 1, policy_version 1939341 (0.0007) [2023-12-26 15:10:51,065][123090] Updated weights for policy 1, policy_version 1939351 (0.0009) [2023-12-26 15:10:51,781][123091] Updated weights for policy 0, policy_version 1951508 (0.0009) [2023-12-26 15:10:51,845][123091] Updated weights for policy 0, policy_version 1951518 (0.0010) [2023-12-26 15:10:51,899][123090] Updated weights for policy 1, policy_version 1939361 (0.0009) [2023-12-26 15:10:51,914][123091] Updated weights for policy 0, policy_version 1951528 (0.0009) [2023-12-26 15:10:51,963][123090] Updated weights for policy 1, policy_version 1939371 (0.0008) [2023-12-26 15:10:52,027][123090] Updated weights for policy 1, policy_version 1939381 (0.0005) [2023-12-26 15:10:52,097][123090] Updated weights for policy 1, policy_version 1939391 (0.0005) [2023-12-26 15:10:52,647][123091] Updated weights for policy 0, policy_version 1951538 (0.0007) [2023-12-26 15:10:52,710][123091] Updated weights for policy 0, policy_version 1951548 (0.0007) [2023-12-26 15:10:52,750][123090] Updated weights for policy 1, policy_version 1939401 (0.0006) [2023-12-26 15:10:52,775][123091] Updated weights for policy 0, policy_version 1951558 (0.0007) [2023-12-26 15:10:52,818][123090] Updated weights for policy 1, policy_version 1939411 (0.0009) [2023-12-26 15:10:52,843][123091] Updated weights for policy 0, policy_version 1951568 (0.0007) [2023-12-26 15:10:52,880][123090] Updated weights for policy 1, policy_version 1939421 (0.0009) [2023-12-26 15:10:53,555][123091] Updated weights for policy 0, policy_version 1951578 (0.0010) [2023-12-26 15:10:53,615][123091] Updated weights for policy 0, policy_version 1951588 (0.0009) [2023-12-26 15:10:53,674][123091] Updated weights for policy 0, policy_version 1951598 (0.0010) [2023-12-26 15:10:53,717][123090] Updated weights for policy 1, policy_version 1939431 (0.0008) [2023-12-26 15:10:53,773][123090] Updated weights for policy 1, policy_version 1939441 (0.0008) [2023-12-26 15:10:53,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.2, 300 sec: 17716.9). Total num frames: 996106240. Throughput: 0: 8586.3, 1: 8982.4. Samples: 996081104. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:10:53,785][121949] Avg episode reward: [(0, '6361.101'), (1, '5769.198')] [2023-12-26 15:10:53,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001951600_499613696.pth... [2023-12-26 15:10:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001950576_499351552.pth [2023-12-26 15:10:53,827][123090] Updated weights for policy 1, policy_version 1939451 (0.0009) [2023-12-26 15:10:53,848][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001939456_496500736.pth... [2023-12-26 15:10:53,851][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001938400_496230400.pth [2023-12-26 15:10:54,455][123091] Updated weights for policy 0, policy_version 1951608 (0.0009) [2023-12-26 15:10:54,512][123091] Updated weights for policy 0, policy_version 1951618 (0.0008) [2023-12-26 15:10:54,576][123091] Updated weights for policy 0, policy_version 1951628 (0.0010) [2023-12-26 15:10:54,653][123090] Updated weights for policy 1, policy_version 1939461 (0.0009) [2023-12-26 15:10:54,705][123090] Updated weights for policy 1, policy_version 1939471 (0.0009) [2023-12-26 15:10:54,769][123090] Updated weights for policy 1, policy_version 1939482 (0.0009) [2023-12-26 15:10:55,372][123091] Updated weights for policy 0, policy_version 1951638 (0.0010) [2023-12-26 15:10:55,430][123091] Updated weights for policy 0, policy_version 1951648 (0.0009) [2023-12-26 15:10:55,494][123091] Updated weights for policy 0, policy_version 1951658 (0.0008) [2023-12-26 15:10:55,550][123090] Updated weights for policy 1, policy_version 1939492 (0.0009) [2023-12-26 15:10:55,602][123090] Updated weights for policy 1, policy_version 1939502 (0.0009) [2023-12-26 15:10:55,665][123090] Updated weights for policy 1, policy_version 1939512 (0.0009) [2023-12-26 15:10:56,156][123091] Updated weights for policy 0, policy_version 1951668 (0.0010) [2023-12-26 15:10:56,204][123091] Updated weights for policy 0, policy_version 1951678 (0.0008) [2023-12-26 15:10:56,258][123091] Updated weights for policy 0, policy_version 1951688 (0.0007) [2023-12-26 15:10:56,541][123090] Updated weights for policy 1, policy_version 1939522 (0.0010) [2023-12-26 15:10:56,603][123090] Updated weights for policy 1, policy_version 1939532 (0.0009) [2023-12-26 15:10:56,651][123090] Updated weights for policy 1, policy_version 1939542 (0.0008) [2023-12-26 15:10:56,715][123090] Updated weights for policy 1, policy_version 1939552 (0.0009) [2023-12-26 15:10:57,090][123091] Updated weights for policy 0, policy_version 1951698 (0.0006) [2023-12-26 15:10:57,143][123091] Updated weights for policy 0, policy_version 1951708 (0.0010) [2023-12-26 15:10:57,196][123091] Updated weights for policy 0, policy_version 1951719 (0.0007) [2023-12-26 15:10:57,467][123090] Updated weights for policy 1, policy_version 1939562 (0.0009) [2023-12-26 15:10:57,517][123090] Updated weights for policy 1, policy_version 1939572 (0.0009) [2023-12-26 15:10:57,572][123090] Updated weights for policy 1, policy_version 1939582 (0.0009) [2023-12-26 15:10:58,027][123091] Updated weights for policy 0, policy_version 1951729 (0.0006) [2023-12-26 15:10:58,097][123091] Updated weights for policy 0, policy_version 1951739 (0.0009) [2023-12-26 15:10:58,159][123091] Updated weights for policy 0, policy_version 1951749 (0.0008) [2023-12-26 15:10:58,218][123091] Updated weights for policy 0, policy_version 1951759 (0.0008) [2023-12-26 15:10:58,490][123090] Updated weights for policy 1, policy_version 1939592 (0.0010) [2023-12-26 15:10:58,551][123090] Updated weights for policy 1, policy_version 1939602 (0.0011) [2023-12-26 15:10:58,607][123090] Updated weights for policy 1, policy_version 1939612 (0.0009) [2023-12-26 15:10:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17744.7). Total num frames: 996196352. Throughput: 0: 8682.9, 1: 8939.5. Samples: 996188864. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:10:58,785][121949] Avg episode reward: [(0, '6284.916'), (1, '5770.835')] [2023-12-26 15:10:59,002][123091] Updated weights for policy 0, policy_version 1951769 (0.0010) [2023-12-26 15:10:59,053][123091] Updated weights for policy 0, policy_version 1951779 (0.0009) [2023-12-26 15:10:59,112][123091] Updated weights for policy 0, policy_version 1951789 (0.0009) [2023-12-26 15:10:59,552][123090] Updated weights for policy 1, policy_version 1939622 (0.0008) [2023-12-26 15:10:59,617][123090] Updated weights for policy 1, policy_version 1939632 (0.0008) [2023-12-26 15:10:59,679][123090] Updated weights for policy 1, policy_version 1939642 (0.0008) [2023-12-26 15:10:59,996][123091] Updated weights for policy 0, policy_version 1951799 (0.0008) [2023-12-26 15:11:00,057][123091] Updated weights for policy 0, policy_version 1951809 (0.0009) [2023-12-26 15:11:00,115][123091] Updated weights for policy 0, policy_version 1951819 (0.0010) [2023-12-26 15:11:00,463][123090] Updated weights for policy 1, policy_version 1939652 (0.0007) [2023-12-26 15:11:00,515][123090] Updated weights for policy 1, policy_version 1939662 (0.0011) [2023-12-26 15:11:00,563][123090] Updated weights for policy 1, policy_version 1939672 (0.0010) [2023-12-26 15:11:00,984][123091] Updated weights for policy 0, policy_version 1951829 (0.0009) [2023-12-26 15:11:01,040][123091] Updated weights for policy 0, policy_version 1951839 (0.0009) [2023-12-26 15:11:01,103][123091] Updated weights for policy 0, policy_version 1951849 (0.0009) [2023-12-26 15:11:01,341][123090] Updated weights for policy 1, policy_version 1939682 (0.0008) [2023-12-26 15:11:01,402][123090] Updated weights for policy 1, policy_version 1939692 (0.0010) [2023-12-26 15:11:01,454][123090] Updated weights for policy 1, policy_version 1939702 (0.0010) [2023-12-26 15:11:01,510][123090] Updated weights for policy 1, policy_version 1939712 (0.0010) [2023-12-26 15:11:01,963][123091] Updated weights for policy 0, policy_version 1951859 (0.0008) [2023-12-26 15:11:02,021][123091] Updated weights for policy 0, policy_version 1951869 (0.0005) [2023-12-26 15:11:02,075][123091] Updated weights for policy 0, policy_version 1951879 (0.0005) [2023-12-26 15:11:02,312][123090] Updated weights for policy 1, policy_version 1939722 (0.0008) [2023-12-26 15:11:02,374][123090] Updated weights for policy 1, policy_version 1939732 (0.0008) [2023-12-26 15:11:02,434][123090] Updated weights for policy 1, policy_version 1939742 (0.0008) [2023-12-26 15:11:02,900][123091] Updated weights for policy 0, policy_version 1951889 (0.0008) [2023-12-26 15:11:02,965][123091] Updated weights for policy 0, policy_version 1951899 (0.0009) [2023-12-26 15:11:03,030][123091] Updated weights for policy 0, policy_version 1951909 (0.0009) [2023-12-26 15:11:03,088][123091] Updated weights for policy 0, policy_version 1951919 (0.0009) [2023-12-26 15:11:03,239][123090] Updated weights for policy 1, policy_version 1939752 (0.0010) [2023-12-26 15:11:03,293][123090] Updated weights for policy 1, policy_version 1939762 (0.0010) [2023-12-26 15:11:03,351][123090] Updated weights for policy 1, policy_version 1939772 (0.0010) [2023-12-26 15:11:03,784][121949] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 996278272. Throughput: 0: 8620.8, 1: 8862.2. Samples: 996290864. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:03,784][121949] Avg episode reward: [(0, '6220.552'), (1, '5727.343')] [2023-12-26 15:11:03,921][123091] Updated weights for policy 0, policy_version 1951929 (0.0009) [2023-12-26 15:11:03,979][123091] Updated weights for policy 0, policy_version 1951939 (0.0009) [2023-12-26 15:11:04,035][123091] Updated weights for policy 0, policy_version 1951949 (0.0010) [2023-12-26 15:11:04,154][123090] Updated weights for policy 1, policy_version 1939782 (0.0010) [2023-12-26 15:11:04,220][123090] Updated weights for policy 1, policy_version 1939792 (0.0010) [2023-12-26 15:11:04,289][123090] Updated weights for policy 1, policy_version 1939802 (0.0010) [2023-12-26 15:11:04,806][123091] Updated weights for policy 0, policy_version 1951959 (0.0007) [2023-12-26 15:11:04,876][123091] Updated weights for policy 0, policy_version 1951969 (0.0007) [2023-12-26 15:11:04,945][123091] Updated weights for policy 0, policy_version 1951979 (0.0009) [2023-12-26 15:11:05,079][123090] Updated weights for policy 1, policy_version 1939812 (0.0008) [2023-12-26 15:11:05,141][123090] Updated weights for policy 1, policy_version 1939822 (0.0005) [2023-12-26 15:11:05,199][123090] Updated weights for policy 1, policy_version 1939832 (0.0005) [2023-12-26 15:11:05,831][123091] Updated weights for policy 0, policy_version 1951989 (0.0010) [2023-12-26 15:11:05,856][123090] Updated weights for policy 1, policy_version 1939842 (0.0006) [2023-12-26 15:11:05,878][123091] Updated weights for policy 0, policy_version 1951999 (0.0009) [2023-12-26 15:11:05,916][123090] Updated weights for policy 1, policy_version 1939852 (0.0009) [2023-12-26 15:11:05,922][123091] Updated weights for policy 0, policy_version 1952009 (0.0007) [2023-12-26 15:11:05,978][123090] Updated weights for policy 1, policy_version 1939862 (0.0008) [2023-12-26 15:11:06,039][123090] Updated weights for policy 1, policy_version 1939872 (0.0010) [2023-12-26 15:11:06,763][123091] Updated weights for policy 0, policy_version 1952019 (0.0007) [2023-12-26 15:11:06,821][123091] Updated weights for policy 0, policy_version 1952029 (0.0009) [2023-12-26 15:11:06,882][123091] Updated weights for policy 0, policy_version 1952039 (0.0009) [2023-12-26 15:11:06,900][123090] Updated weights for policy 1, policy_version 1939882 (0.0008) [2023-12-26 15:11:06,970][123090] Updated weights for policy 1, policy_version 1939892 (0.0009) [2023-12-26 15:11:07,032][123090] Updated weights for policy 1, policy_version 1939902 (0.0009) [2023-12-26 15:11:07,692][123091] Updated weights for policy 0, policy_version 1952049 (0.0007) [2023-12-26 15:11:07,752][123091] Updated weights for policy 0, policy_version 1952059 (0.0007) [2023-12-26 15:11:07,812][123091] Updated weights for policy 0, policy_version 1952069 (0.0005) [2023-12-26 15:11:07,875][123090] Updated weights for policy 1, policy_version 1939912 (0.0008) [2023-12-26 15:11:07,877][123091] Updated weights for policy 0, policy_version 1952079 (0.0008) [2023-12-26 15:11:07,937][123090] Updated weights for policy 1, policy_version 1939922 (0.0008) [2023-12-26 15:11:08,010][123090] Updated weights for policy 1, policy_version 1939932 (0.0010) [2023-12-26 15:11:08,671][123091] Updated weights for policy 0, policy_version 1952089 (0.0010) [2023-12-26 15:11:08,734][123091] Updated weights for policy 0, policy_version 1952099 (0.0011) [2023-12-26 15:11:08,784][121949] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17661.4). Total num frames: 996360192. Throughput: 0: 8627.6, 1: 8917.6. Samples: 996343512. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:08,785][121949] Avg episode reward: [(0, '6296.533'), (1, '5793.827')] [2023-12-26 15:11:08,793][123091] Updated weights for policy 0, policy_version 1952109 (0.0011) [2023-12-26 15:11:08,809][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001952112_499744768.pth... [2023-12-26 15:11:08,813][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001951088_499482624.pth [2023-12-26 15:11:08,831][123090] Updated weights for policy 1, policy_version 1939942 (0.0008) [2023-12-26 15:11:08,879][123090] Updated weights for policy 1, policy_version 1939952 (0.0009) [2023-12-26 15:11:08,931][123090] Updated weights for policy 1, policy_version 1939962 (0.0009) [2023-12-26 15:11:08,961][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001939968_496631808.pth... [2023-12-26 15:11:08,965][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001938912_496361472.pth [2023-12-26 15:11:09,539][123091] Updated weights for policy 0, policy_version 1952119 (0.0007) [2023-12-26 15:11:09,587][123091] Updated weights for policy 0, policy_version 1952129 (0.0005) [2023-12-26 15:11:09,654][123091] Updated weights for policy 0, policy_version 1952139 (0.0011) [2023-12-26 15:11:09,857][123090] Updated weights for policy 1, policy_version 1939972 (0.0009) [2023-12-26 15:11:09,917][123090] Updated weights for policy 1, policy_version 1939982 (0.0008) [2023-12-26 15:11:09,987][123090] Updated weights for policy 1, policy_version 1939992 (0.0008) [2023-12-26 15:11:10,522][123091] Updated weights for policy 0, policy_version 1952149 (0.0009) [2023-12-26 15:11:10,599][123091] Updated weights for policy 0, policy_version 1952159 (0.0005) [2023-12-26 15:11:10,662][123091] Updated weights for policy 0, policy_version 1952169 (0.0005) [2023-12-26 15:11:10,814][123090] Updated weights for policy 1, policy_version 1940002 (0.0009) [2023-12-26 15:11:10,886][123090] Updated weights for policy 1, policy_version 1940012 (0.0009) [2023-12-26 15:11:10,950][123090] Updated weights for policy 1, policy_version 1940022 (0.0010) [2023-12-26 15:11:11,013][123090] Updated weights for policy 1, policy_version 1940032 (0.0010) [2023-12-26 15:11:11,348][123091] Updated weights for policy 0, policy_version 1952179 (0.0006) [2023-12-26 15:11:11,412][123091] Updated weights for policy 0, policy_version 1952189 (0.0009) [2023-12-26 15:11:11,467][123091] Updated weights for policy 0, policy_version 1952199 (0.0010) [2023-12-26 15:11:11,844][123090] Updated weights for policy 1, policy_version 1940042 (0.0006) [2023-12-26 15:11:11,904][123090] Updated weights for policy 1, policy_version 1940052 (0.0006) [2023-12-26 15:11:11,967][123090] Updated weights for policy 1, policy_version 1940062 (0.0006) [2023-12-26 15:11:12,450][123091] Updated weights for policy 0, policy_version 1952209 (0.0011) [2023-12-26 15:11:12,504][123091] Updated weights for policy 0, policy_version 1952219 (0.0006) [2023-12-26 15:11:12,560][123091] Updated weights for policy 0, policy_version 1952229 (0.0009) [2023-12-26 15:11:12,618][123091] Updated weights for policy 0, policy_version 1952239 (0.0009) [2023-12-26 15:11:12,716][123090] Updated weights for policy 1, policy_version 1940072 (0.0009) [2023-12-26 15:11:12,777][123090] Updated weights for policy 1, policy_version 1940082 (0.0009) [2023-12-26 15:11:12,838][123090] Updated weights for policy 1, policy_version 1940092 (0.0006) [2023-12-26 15:11:13,496][123091] Updated weights for policy 0, policy_version 1952249 (0.0010) [2023-12-26 15:11:13,554][123091] Updated weights for policy 0, policy_version 1952260 (0.0010) [2023-12-26 15:11:13,594][123090] Updated weights for policy 1, policy_version 1940102 (0.0006) [2023-12-26 15:11:13,608][123091] Updated weights for policy 0, policy_version 1952270 (0.0009) [2023-12-26 15:11:13,645][123090] Updated weights for policy 1, policy_version 1940112 (0.0008) [2023-12-26 15:11:13,698][123090] Updated weights for policy 1, policy_version 1940122 (0.0009) [2023-12-26 15:11:13,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17716.9). Total num frames: 996458496. Throughput: 0: 8705.9, 1: 8774.3. Samples: 996446104. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:13,785][121949] Avg episode reward: [(0, '6333.300'), (1, '5778.475')] [2023-12-26 15:11:14,443][123091] Updated weights for policy 0, policy_version 1952280 (0.0011) [2023-12-26 15:11:14,498][123091] Updated weights for policy 0, policy_version 1952290 (0.0010) [2023-12-26 15:11:14,546][123090] Updated weights for policy 1, policy_version 1940132 (0.0009) [2023-12-26 15:11:14,561][123091] Updated weights for policy 0, policy_version 1952300 (0.0010) [2023-12-26 15:11:14,600][123090] Updated weights for policy 1, policy_version 1940142 (0.0006) [2023-12-26 15:11:14,652][123090] Updated weights for policy 1, policy_version 1940152 (0.0009) [2023-12-26 15:11:15,385][123091] Updated weights for policy 0, policy_version 1952310 (0.0009) [2023-12-26 15:11:15,438][123091] Updated weights for policy 0, policy_version 1952320 (0.0010) [2023-12-26 15:11:15,465][123090] Updated weights for policy 1, policy_version 1940162 (0.0008) [2023-12-26 15:11:15,492][123091] Updated weights for policy 0, policy_version 1952330 (0.0009) [2023-12-26 15:11:15,524][123090] Updated weights for policy 1, policy_version 1940172 (0.0006) [2023-12-26 15:11:15,590][123090] Updated weights for policy 1, policy_version 1940182 (0.0006) [2023-12-26 15:11:15,640][123090] Updated weights for policy 1, policy_version 1940192 (0.0006) [2023-12-26 15:11:16,213][123091] Updated weights for policy 0, policy_version 1952340 (0.0010) [2023-12-26 15:11:16,273][123091] Updated weights for policy 0, policy_version 1952350 (0.0009) [2023-12-26 15:11:16,307][123090] Updated weights for policy 1, policy_version 1940202 (0.0005) [2023-12-26 15:11:16,331][123091] Updated weights for policy 0, policy_version 1952360 (0.0008) [2023-12-26 15:11:16,366][123090] Updated weights for policy 1, policy_version 1940212 (0.0006) [2023-12-26 15:11:16,420][123090] Updated weights for policy 1, policy_version 1940222 (0.0005) [2023-12-26 15:11:17,027][123091] Updated weights for policy 0, policy_version 1952370 (0.0008) [2023-12-26 15:11:17,086][123091] Updated weights for policy 0, policy_version 1952380 (0.0006) [2023-12-26 15:11:17,132][123091] Updated weights for policy 0, policy_version 1952390 (0.0008) [2023-12-26 15:11:17,185][123091] Updated weights for policy 0, policy_version 1952400 (0.0006) [2023-12-26 15:11:17,237][123090] Updated weights for policy 1, policy_version 1940232 (0.0009) [2023-12-26 15:11:17,319][123090] Updated weights for policy 1, policy_version 1940242 (0.0010) [2023-12-26 15:11:17,386][123090] Updated weights for policy 1, policy_version 1940252 (0.0009) [2023-12-26 15:11:17,858][123091] Updated weights for policy 0, policy_version 1952410 (0.0010) [2023-12-26 15:11:17,923][123091] Updated weights for policy 0, policy_version 1952420 (0.0011) [2023-12-26 15:11:17,981][123091] Updated weights for policy 0, policy_version 1952430 (0.0010) [2023-12-26 15:11:18,045][123090] Updated weights for policy 1, policy_version 1940262 (0.0009) [2023-12-26 15:11:18,096][123090] Updated weights for policy 1, policy_version 1940272 (0.0009) [2023-12-26 15:11:18,148][123090] Updated weights for policy 1, policy_version 1940282 (0.0009) [2023-12-26 15:11:18,662][123091] Updated weights for policy 0, policy_version 1952440 (0.0009) [2023-12-26 15:11:18,727][123091] Updated weights for policy 0, policy_version 1952450 (0.0009) [2023-12-26 15:11:18,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17716.9). Total num frames: 996540416. Throughput: 0: 8824.2, 1: 8745.1. Samples: 996556972. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:18,785][121949] Avg episode reward: [(0, '6311.426'), (1, '5709.738')] [2023-12-26 15:11:18,800][123091] Updated weights for policy 0, policy_version 1952460 (0.0009) [2023-12-26 15:11:18,969][123090] Updated weights for policy 1, policy_version 1940292 (0.0009) [2023-12-26 15:11:19,034][123090] Updated weights for policy 1, policy_version 1940302 (0.0010) [2023-12-26 15:11:19,091][123090] Updated weights for policy 1, policy_version 1940312 (0.0009) [2023-12-26 15:11:19,535][123091] Updated weights for policy 0, policy_version 1952470 (0.0008) [2023-12-26 15:11:19,605][123091] Updated weights for policy 0, policy_version 1952480 (0.0008) [2023-12-26 15:11:19,660][123091] Updated weights for policy 0, policy_version 1952490 (0.0008) [2023-12-26 15:11:19,960][123090] Updated weights for policy 1, policy_version 1940322 (0.0009) [2023-12-26 15:11:20,015][123090] Updated weights for policy 1, policy_version 1940332 (0.0009) [2023-12-26 15:11:20,080][123090] Updated weights for policy 1, policy_version 1940342 (0.0009) [2023-12-26 15:11:20,135][123090] Updated weights for policy 1, policy_version 1940352 (0.0009) [2023-12-26 15:11:20,380][123091] Updated weights for policy 0, policy_version 1952500 (0.0007) [2023-12-26 15:11:20,434][123091] Updated weights for policy 0, policy_version 1952510 (0.0006) [2023-12-26 15:11:20,495][123091] Updated weights for policy 0, policy_version 1952520 (0.0010) [2023-12-26 15:11:21,007][123090] Updated weights for policy 1, policy_version 1940362 (0.0009) [2023-12-26 15:11:21,081][123090] Updated weights for policy 1, policy_version 1940373 (0.0009) [2023-12-26 15:11:21,150][123090] Updated weights for policy 1, policy_version 1940383 (0.0008) [2023-12-26 15:11:21,348][123091] Updated weights for policy 0, policy_version 1952530 (0.0010) [2023-12-26 15:11:21,420][123091] Updated weights for policy 0, policy_version 1952540 (0.0009) [2023-12-26 15:11:21,478][123091] Updated weights for policy 0, policy_version 1952550 (0.0005) [2023-12-26 15:11:21,548][123091] Updated weights for policy 0, policy_version 1952560 (0.0009) [2023-12-26 15:11:22,020][123090] Updated weights for policy 1, policy_version 1940393 (0.0008) [2023-12-26 15:11:22,079][123090] Updated weights for policy 1, policy_version 1940403 (0.0010) [2023-12-26 15:11:22,133][123090] Updated weights for policy 1, policy_version 1940413 (0.0009) [2023-12-26 15:11:22,315][123091] Updated weights for policy 0, policy_version 1952570 (0.0008) [2023-12-26 15:11:22,385][123091] Updated weights for policy 0, policy_version 1952580 (0.0009) [2023-12-26 15:11:22,453][123091] Updated weights for policy 0, policy_version 1952590 (0.0011) [2023-12-26 15:11:23,101][123090] Updated weights for policy 1, policy_version 1940423 (0.0009) [2023-12-26 15:11:23,152][123090] Updated weights for policy 1, policy_version 1940433 (0.0006) [2023-12-26 15:11:23,158][123091] Updated weights for policy 0, policy_version 1952600 (0.0010) [2023-12-26 15:11:23,205][123090] Updated weights for policy 1, policy_version 1940443 (0.0006) [2023-12-26 15:11:23,215][123091] Updated weights for policy 0, policy_version 1952610 (0.0010) [2023-12-26 15:11:23,267][123091] Updated weights for policy 0, policy_version 1952620 (0.0011) [2023-12-26 15:11:23,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 996630528. Throughput: 0: 8813.8, 1: 8719.5. Samples: 996608148. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:23,785][121949] Avg episode reward: [(0, '6249.378'), (1, '5788.962')] [2023-12-26 15:11:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001940448_496754688.pth... [2023-12-26 15:11:23,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001952624_499875840.pth... [2023-12-26 15:11:23,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001939456_496500736.pth [2023-12-26 15:11:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001951600_499613696.pth [2023-12-26 15:11:24,054][123090] Updated weights for policy 1, policy_version 1940453 (0.0007) [2023-12-26 15:11:24,115][123091] Updated weights for policy 0, policy_version 1952630 (0.0010) [2023-12-26 15:11:24,121][123090] Updated weights for policy 1, policy_version 1940463 (0.0010) [2023-12-26 15:11:24,171][123091] Updated weights for policy 0, policy_version 1952640 (0.0007) [2023-12-26 15:11:24,186][123090] Updated weights for policy 1, policy_version 1940473 (0.0008) [2023-12-26 15:11:24,229][123091] Updated weights for policy 0, policy_version 1952650 (0.0007) [2023-12-26 15:11:24,936][123090] Updated weights for policy 1, policy_version 1940483 (0.0008) [2023-12-26 15:11:24,998][123090] Updated weights for policy 1, policy_version 1940493 (0.0005) [2023-12-26 15:11:25,011][123091] Updated weights for policy 0, policy_version 1952660 (0.0008) [2023-12-26 15:11:25,062][123091] Updated weights for policy 0, policy_version 1952670 (0.0008) [2023-12-26 15:11:25,070][123090] Updated weights for policy 1, policy_version 1940503 (0.0010) [2023-12-26 15:11:25,126][123091] Updated weights for policy 0, policy_version 1952680 (0.0008) [2023-12-26 15:11:25,859][123090] Updated weights for policy 1, policy_version 1940513 (0.0007) [2023-12-26 15:11:25,907][123090] Updated weights for policy 1, policy_version 1940523 (0.0010) [2023-12-26 15:11:25,917][123091] Updated weights for policy 0, policy_version 1952690 (0.0006) [2023-12-26 15:11:25,958][123090] Updated weights for policy 1, policy_version 1940533 (0.0010) [2023-12-26 15:11:25,978][123091] Updated weights for policy 0, policy_version 1952700 (0.0007) [2023-12-26 15:11:26,006][123090] Updated weights for policy 1, policy_version 1940543 (0.0010) [2023-12-26 15:11:26,035][123091] Updated weights for policy 0, policy_version 1952710 (0.0007) [2023-12-26 15:11:26,091][123091] Updated weights for policy 0, policy_version 1952720 (0.0009) [2023-12-26 15:11:26,853][123090] Updated weights for policy 1, policy_version 1940553 (0.0010) [2023-12-26 15:11:26,915][123090] Updated weights for policy 1, policy_version 1940563 (0.0010) [2023-12-26 15:11:26,930][123091] Updated weights for policy 0, policy_version 1952730 (0.0008) [2023-12-26 15:11:26,979][123090] Updated weights for policy 1, policy_version 1940573 (0.0011) [2023-12-26 15:11:26,987][123091] Updated weights for policy 0, policy_version 1952740 (0.0007) [2023-12-26 15:11:27,039][123091] Updated weights for policy 0, policy_version 1952750 (0.0009) [2023-12-26 15:11:27,829][123091] Updated weights for policy 0, policy_version 1952760 (0.0008) [2023-12-26 15:11:27,830][123090] Updated weights for policy 1, policy_version 1940583 (0.0009) [2023-12-26 15:11:27,884][123091] Updated weights for policy 0, policy_version 1952770 (0.0010) [2023-12-26 15:11:27,890][123090] Updated weights for policy 1, policy_version 1940593 (0.0007) [2023-12-26 15:11:27,940][123091] Updated weights for policy 0, policy_version 1952780 (0.0011) [2023-12-26 15:11:27,942][123090] Updated weights for policy 1, policy_version 1940603 (0.0005) [2023-12-26 15:11:28,714][123091] Updated weights for policy 0, policy_version 1952790 (0.0007) [2023-12-26 15:11:28,773][123091] Updated weights for policy 0, policy_version 1952800 (0.0006) [2023-12-26 15:11:28,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17661.4). Total num frames: 996712448. Throughput: 0: 8867.3, 1: 8727.5. Samples: 996712780. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:28,785][123090] Updated weights for policy 1, policy_version 1940613 (0.0006) [2023-12-26 15:11:28,785][121949] Avg episode reward: [(0, '6234.641'), (1, '5765.074')] [2023-12-26 15:11:28,829][123091] Updated weights for policy 0, policy_version 1952810 (0.0010) [2023-12-26 15:11:28,841][123090] Updated weights for policy 1, policy_version 1940623 (0.0006) [2023-12-26 15:11:28,891][123090] Updated weights for policy 1, policy_version 1940633 (0.0007) [2023-12-26 15:11:29,587][123091] Updated weights for policy 0, policy_version 1952820 (0.0010) [2023-12-26 15:11:29,636][123091] Updated weights for policy 0, policy_version 1952830 (0.0009) [2023-12-26 15:11:29,665][123090] Updated weights for policy 1, policy_version 1940643 (0.0009) [2023-12-26 15:11:29,696][123091] Updated weights for policy 0, policy_version 1952840 (0.0008) [2023-12-26 15:11:29,715][123090] Updated weights for policy 1, policy_version 1940653 (0.0005) [2023-12-26 15:11:29,765][123090] Updated weights for policy 1, policy_version 1940663 (0.0005) [2023-12-26 15:11:30,411][123091] Updated weights for policy 0, policy_version 1952850 (0.0008) [2023-12-26 15:11:30,460][123090] Updated weights for policy 1, policy_version 1940673 (0.0006) [2023-12-26 15:11:30,468][123091] Updated weights for policy 0, policy_version 1952860 (0.0006) [2023-12-26 15:11:30,516][123091] Updated weights for policy 0, policy_version 1952870 (0.0009) [2023-12-26 15:11:30,523][123090] Updated weights for policy 1, policy_version 1940683 (0.0007) [2023-12-26 15:11:30,577][123091] Updated weights for policy 0, policy_version 1952880 (0.0009) [2023-12-26 15:11:30,581][123090] Updated weights for policy 1, policy_version 1940693 (0.0009) [2023-12-26 15:11:30,652][123090] Updated weights for policy 1, policy_version 1940703 (0.0008) [2023-12-26 15:11:31,411][123090] Updated weights for policy 1, policy_version 1940713 (0.0010) [2023-12-26 15:11:31,446][123091] Updated weights for policy 0, policy_version 1952890 (0.0007) [2023-12-26 15:11:31,469][123090] Updated weights for policy 1, policy_version 1940723 (0.0010) [2023-12-26 15:11:31,506][123091] Updated weights for policy 0, policy_version 1952900 (0.0006) [2023-12-26 15:11:31,525][123090] Updated weights for policy 1, policy_version 1940733 (0.0010) [2023-12-26 15:11:31,563][123091] Updated weights for policy 0, policy_version 1952910 (0.0007) [2023-12-26 15:11:32,323][123090] Updated weights for policy 1, policy_version 1940743 (0.0007) [2023-12-26 15:11:32,374][123091] Updated weights for policy 0, policy_version 1952920 (0.0008) [2023-12-26 15:11:32,394][123090] Updated weights for policy 1, policy_version 1940753 (0.0009) [2023-12-26 15:11:32,425][123091] Updated weights for policy 0, policy_version 1952930 (0.0008) [2023-12-26 15:11:32,459][123090] Updated weights for policy 1, policy_version 1940763 (0.0008) [2023-12-26 15:11:32,475][123091] Updated weights for policy 0, policy_version 1952940 (0.0009) [2023-12-26 15:11:33,219][123090] Updated weights for policy 1, policy_version 1940773 (0.0008) [2023-12-26 15:11:33,278][123090] Updated weights for policy 1, policy_version 1940783 (0.0009) [2023-12-26 15:11:33,336][123091] Updated weights for policy 0, policy_version 1952950 (0.0007) [2023-12-26 15:11:33,338][123090] Updated weights for policy 1, policy_version 1940793 (0.0009) [2023-12-26 15:11:33,385][123091] Updated weights for policy 0, policy_version 1952960 (0.0005) [2023-12-26 15:11:33,429][123091] Updated weights for policy 0, policy_version 1952970 (0.0005) [2023-12-26 15:11:33,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17716.9). Total num frames: 996810752. Throughput: 0: 8858.8, 1: 8730.6. Samples: 996820984. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:33,785][121949] Avg episode reward: [(0, '6380.089'), (1, '5788.077')] [2023-12-26 15:11:34,098][123090] Updated weights for policy 1, policy_version 1940803 (0.0008) [2023-12-26 15:11:34,162][123090] Updated weights for policy 1, policy_version 1940813 (0.0009) [2023-12-26 15:11:34,174][123091] Updated weights for policy 0, policy_version 1952980 (0.0008) [2023-12-26 15:11:34,227][123090] Updated weights for policy 1, policy_version 1940823 (0.0009) [2023-12-26 15:11:34,241][123091] Updated weights for policy 0, policy_version 1952990 (0.0011) [2023-12-26 15:11:34,304][123091] Updated weights for policy 0, policy_version 1953000 (0.0011) [2023-12-26 15:11:35,071][123090] Updated weights for policy 1, policy_version 1940833 (0.0006) [2023-12-26 15:11:35,121][123091] Updated weights for policy 0, policy_version 1953010 (0.0011) [2023-12-26 15:11:35,133][123090] Updated weights for policy 1, policy_version 1940843 (0.0008) [2023-12-26 15:11:35,184][123091] Updated weights for policy 0, policy_version 1953020 (0.0011) [2023-12-26 15:11:35,195][123090] Updated weights for policy 1, policy_version 1940853 (0.0005) [2023-12-26 15:11:35,249][123091] Updated weights for policy 0, policy_version 1953030 (0.0010) [2023-12-26 15:11:35,257][123090] Updated weights for policy 1, policy_version 1940863 (0.0006) [2023-12-26 15:11:35,308][123091] Updated weights for policy 0, policy_version 1953040 (0.0011) [2023-12-26 15:11:35,997][123090] Updated weights for policy 1, policy_version 1940873 (0.0006) [2023-12-26 15:11:36,045][123090] Updated weights for policy 1, policy_version 1940883 (0.0009) [2023-12-26 15:11:36,102][123090] Updated weights for policy 1, policy_version 1940893 (0.0008) [2023-12-26 15:11:36,141][123091] Updated weights for policy 0, policy_version 1953050 (0.0011) [2023-12-26 15:11:36,205][123091] Updated weights for policy 0, policy_version 1953060 (0.0011) [2023-12-26 15:11:36,271][123091] Updated weights for policy 0, policy_version 1953070 (0.0011) [2023-12-26 15:11:36,976][123090] Updated weights for policy 1, policy_version 1940903 (0.0009) [2023-12-26 15:11:37,034][123090] Updated weights for policy 1, policy_version 1940913 (0.0009) [2023-12-26 15:11:37,035][123091] Updated weights for policy 0, policy_version 1953080 (0.0006) [2023-12-26 15:11:37,089][123091] Updated weights for policy 0, policy_version 1953090 (0.0005) [2023-12-26 15:11:37,102][123090] Updated weights for policy 1, policy_version 1940923 (0.0008) [2023-12-26 15:11:37,126][123007] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000009 [2023-12-26 15:11:37,882][123091] Updated weights for policy 0, policy_version 1953100 (0.0006) [2023-12-26 15:11:37,910][123090] Updated weights for policy 1, policy_version 1940933 (0.0008) [2023-12-26 15:11:37,937][123091] Updated weights for policy 0, policy_version 1953110 (0.0008) [2023-12-26 15:11:37,946][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:37,982][123090] Updated weights for policy 1, policy_version 1940943 (0.0007) [2023-12-26 15:11:38,059][123090] Updated weights for policy 1, policy_version 1940953 (0.0006) [2023-12-26 15:11:38,777][123091] Updated weights for policy 0, policy_version 1953120 (0.0007) [2023-12-26 15:11:38,783][123090] Updated weights for policy 1, policy_version 1940963 (0.0007) [2023-12-26 15:11:38,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17689.2). Total num frames: 996892672. Throughput: 0: 8877.6, 1: 8733.4. Samples: 996873592. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:38,785][121949] Avg episode reward: [(0, '6445.538'), (1, '5988.598')] [2023-12-26 15:11:38,826][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:38,827][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953128_500015104.pth... [2023-12-26 15:11:38,832][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001952112_499744768.pth [2023-12-26 15:11:38,849][123090] Updated weights for policy 1, policy_version 1940973 (0.0011) [2023-12-26 15:11:38,911][123090] Updated weights for policy 1, policy_version 1940983 (0.0011) [2023-12-26 15:11:38,962][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001940992_496893952.pth... [2023-12-26 15:11:38,967][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001939968_496631808.pth [2023-12-26 15:11:39,637][123090] Updated weights for policy 1, policy_version 1940993 (0.0011) [2023-12-26 15:11:39,686][123091] Updated weights for policy 0, policy_version 1953130 (0.0007) [2023-12-26 15:11:39,694][123090] Updated weights for policy 1, policy_version 1941003 (0.0011) [2023-12-26 15:11:39,738][123091] Updated weights for policy 0, policy_version 1953140 (0.0010) [2023-12-26 15:11:39,746][123090] Updated weights for policy 1, policy_version 1941013 (0.0010) [2023-12-26 15:11:39,758][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:39,806][123090] Updated weights for policy 1, policy_version 1941023 (0.0011) [2023-12-26 15:11:40,622][123091] Updated weights for policy 0, policy_version 1953150 (0.0007) [2023-12-26 15:11:40,653][123090] Updated weights for policy 1, policy_version 1941033 (0.0011) [2023-12-26 15:11:40,677][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:40,681][123091] Updated weights for policy 0, policy_version 1953160 (0.0006) [2023-12-26 15:11:40,712][123090] Updated weights for policy 1, policy_version 1941043 (0.0010) [2023-12-26 15:11:40,768][123090] Updated weights for policy 1, policy_version 1941053 (0.0010) [2023-12-26 15:11:41,596][123091] Updated weights for policy 0, policy_version 1953170 (0.0010) [2023-12-26 15:11:41,605][123090] Updated weights for policy 1, policy_version 1941063 (0.0007) [2023-12-26 15:11:41,636][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:41,684][123090] Updated weights for policy 1, policy_version 1941074 (0.0008) [2023-12-26 15:11:41,752][123090] Updated weights for policy 1, policy_version 1941084 (0.0009) [2023-12-26 15:11:42,500][123091] Updated weights for policy 0, policy_version 1953180 (0.0008) [2023-12-26 15:11:42,574][123091] Updated weights for policy 0, policy_version 1953190 (0.0008) [2023-12-26 15:11:42,585][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:42,601][123090] Updated weights for policy 1, policy_version 1941094 (0.0007) [2023-12-26 15:11:42,659][123090] Updated weights for policy 1, policy_version 1941104 (0.0005) [2023-12-26 15:11:42,720][123090] Updated weights for policy 1, policy_version 1941114 (0.0005) [2023-12-26 15:11:43,489][123091] Updated weights for policy 0, policy_version 1953201 (0.0008) [2023-12-26 15:11:43,518][123090] Updated weights for policy 1, policy_version 1941124 (0.0007) [2023-12-26 15:11:43,530][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:43,565][123090] Updated weights for policy 1, policy_version 1941134 (0.0010) [2023-12-26 15:11:43,612][123090] Updated weights for policy 1, policy_version 1941144 (0.0010) [2023-12-26 15:11:43,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 996990976. Throughput: 0: 8837.2, 1: 8735.8. Samples: 996979652. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:43,785][121949] Avg episode reward: [(0, '6410.896'), (1, '6036.016')] [2023-12-26 15:11:44,335][123091] Updated weights for policy 0, policy_version 1953211 (0.0008) [2023-12-26 15:11:44,388][123091] Updated weights for policy 0, policy_version 1953221 (0.0006) [2023-12-26 15:11:44,405][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:44,466][123090] Updated weights for policy 1, policy_version 1941154 (0.0010) [2023-12-26 15:11:44,539][123090] Updated weights for policy 1, policy_version 1941164 (0.0010) [2023-12-26 15:11:44,606][123090] Updated weights for policy 1, policy_version 1941174 (0.0008) [2023-12-26 15:11:44,675][123090] Updated weights for policy 1, policy_version 1941184 (0.0008) [2023-12-26 15:11:45,075][123091] Updated weights for policy 0, policy_version 1953231 (0.0008) [2023-12-26 15:11:45,126][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:45,367][123090] Updated weights for policy 1, policy_version 1941194 (0.0011) [2023-12-26 15:11:45,428][123090] Updated weights for policy 1, policy_version 1941204 (0.0007) [2023-12-26 15:11:45,490][123090] Updated weights for policy 1, policy_version 1941214 (0.0005) [2023-12-26 15:11:46,027][123091] Updated weights for policy 0, policy_version 1953241 (0.0010) [2023-12-26 15:11:46,086][123091] Updated weights for policy 0, policy_version 1953251 (0.0009) [2023-12-26 15:11:46,113][123090] Updated weights for policy 1, policy_version 1941224 (0.0009) [2023-12-26 15:11:46,115][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:46,176][123090] Updated weights for policy 1, policy_version 1941234 (0.0005) [2023-12-26 15:11:46,239][123090] Updated weights for policy 1, policy_version 1941244 (0.0005) [2023-12-26 15:11:46,829][123091] Updated weights for policy 0, policy_version 1953261 (0.0006) [2023-12-26 15:11:46,883][123091] Updated weights for policy 0, policy_version 1953271 (0.0005) [2023-12-26 15:11:46,886][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:46,933][123090] Updated weights for policy 1, policy_version 1941254 (0.0005) [2023-12-26 15:11:46,982][123090] Updated weights for policy 1, policy_version 1941264 (0.0007) [2023-12-26 15:11:47,037][123090] Updated weights for policy 1, policy_version 1941274 (0.0010) [2023-12-26 15:11:47,650][123091] Updated weights for policy 0, policy_version 1953281 (0.0008) [2023-12-26 15:11:47,680][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:47,841][123090] Updated weights for policy 1, policy_version 1941284 (0.0011) [2023-12-26 15:11:47,895][123090] Updated weights for policy 1, policy_version 1941294 (0.0010) [2023-12-26 15:11:47,943][123090] Updated weights for policy 1, policy_version 1941304 (0.0010) [2023-12-26 15:11:48,560][123091] Updated weights for policy 0, policy_version 1953291 (0.0008) [2023-12-26 15:11:48,620][123091] Updated weights for policy 0, policy_version 1953301 (0.0005) [2023-12-26 15:11:48,641][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:48,784][121949] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 997081088. Throughput: 0: 8986.9, 1: 8813.8. Samples: 997091896. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:48,784][121949] Avg episode reward: [(0, '6261.448'), (1, '6008.850')] [2023-12-26 15:11:48,789][123090] Updated weights for policy 1, policy_version 1941314 (0.0010) [2023-12-26 15:11:48,861][123090] Updated weights for policy 1, policy_version 1941324 (0.0008) [2023-12-26 15:11:48,933][123090] Updated weights for policy 1, policy_version 1941334 (0.0006) [2023-12-26 15:11:49,002][123090] Updated weights for policy 1, policy_version 1941344 (0.0005) [2023-12-26 15:11:49,517][123091] Updated weights for policy 0, policy_version 1953311 (0.0011) [2023-12-26 15:11:49,566][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:49,713][123090] Updated weights for policy 1, policy_version 1941354 (0.0010) [2023-12-26 15:11:49,771][123090] Updated weights for policy 1, policy_version 1941364 (0.0010) [2023-12-26 15:11:49,870][123090] Updated weights for policy 1, policy_version 1941374 (0.0008) [2023-12-26 15:11:50,508][123091] Updated weights for policy 0, policy_version 1953321 (0.0010) [2023-12-26 15:11:50,560][123090] Updated weights for policy 1, policy_version 1941384 (0.0009) [2023-12-26 15:11:50,575][123091] Updated weights for policy 0, policy_version 1953331 (0.0009) [2023-12-26 15:11:50,604][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:50,623][123090] Updated weights for policy 1, policy_version 1941394 (0.0009) [2023-12-26 15:11:50,692][123090] Updated weights for policy 1, policy_version 1941404 (0.0006) [2023-12-26 15:11:51,500][123091] Updated weights for policy 0, policy_version 1953341 (0.0009) [2023-12-26 15:11:51,557][123091] Updated weights for policy 0, policy_version 1953351 (0.0008) [2023-12-26 15:11:51,562][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:51,562][123090] Updated weights for policy 1, policy_version 1941414 (0.0010) [2023-12-26 15:11:51,630][123090] Updated weights for policy 1, policy_version 1941424 (0.0009) [2023-12-26 15:11:51,705][123090] Updated weights for policy 1, policy_version 1941434 (0.0007) [2023-12-26 15:11:52,431][123091] Updated weights for policy 0, policy_version 1953361 (0.0010) [2023-12-26 15:11:52,477][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:52,545][123090] Updated weights for policy 1, policy_version 1941444 (0.0010) [2023-12-26 15:11:52,613][123090] Updated weights for policy 1, policy_version 1941455 (0.0009) [2023-12-26 15:11:52,667][123090] Updated weights for policy 1, policy_version 1941466 (0.0009) [2023-12-26 15:11:53,269][123091] Updated weights for policy 0, policy_version 1953371 (0.0008) [2023-12-26 15:11:53,322][123091] Updated weights for policy 0, policy_version 1953381 (0.0005) [2023-12-26 15:11:53,336][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:53,542][123090] Updated weights for policy 1, policy_version 1941476 (0.0007) [2023-12-26 15:11:53,609][123090] Updated weights for policy 1, policy_version 1941486 (0.0005) [2023-12-26 15:11:53,669][123090] Updated weights for policy 1, policy_version 1941496 (0.0005) [2023-12-26 15:11:53,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17744.7). Total num frames: 997171200. Throughput: 0: 8977.6, 1: 8813.9. Samples: 997144136. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:53,785][121949] Avg episode reward: [(0, '6251.460'), (1, '5974.132')] [2023-12-26 15:11:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001941504_497025024.pth... [2023-12-26 15:11:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953384_500146176.pth... [2023-12-26 15:11:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001940448_496754688.pth [2023-12-26 15:11:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001952624_499875840.pth [2023-12-26 15:11:54,192][123091] Updated weights for policy 0, policy_version 1953391 (0.0008) [2023-12-26 15:11:54,242][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:54,404][123090] Updated weights for policy 1, policy_version 1941506 (0.0006) [2023-12-26 15:11:54,462][123090] Updated weights for policy 1, policy_version 1941516 (0.0008) [2023-12-26 15:11:54,519][123090] Updated weights for policy 1, policy_version 1941526 (0.0009) [2023-12-26 15:11:54,572][123090] Updated weights for policy 1, policy_version 1941536 (0.0005) [2023-12-26 15:11:55,136][123091] Updated weights for policy 0, policy_version 1953401 (0.0009) [2023-12-26 15:11:55,185][123091] Updated weights for policy 0, policy_version 1953411 (0.0007) [2023-12-26 15:11:55,204][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:55,215][123090] Updated weights for policy 1, policy_version 1941546 (0.0011) [2023-12-26 15:11:55,279][123090] Updated weights for policy 1, policy_version 1941556 (0.0010) [2023-12-26 15:11:55,350][123090] Updated weights for policy 1, policy_version 1941566 (0.0005) [2023-12-26 15:11:55,968][123090] Updated weights for policy 1, policy_version 1941576 (0.0005) [2023-12-26 15:11:56,015][123090] Updated weights for policy 1, policy_version 1941586 (0.0007) [2023-12-26 15:11:56,075][123090] Updated weights for policy 1, policy_version 1941596 (0.0009) [2023-12-26 15:11:56,143][123091] Updated weights for policy 0, policy_version 1953421 (0.0010) [2023-12-26 15:11:56,193][123091] Updated weights for policy 0, policy_version 1953431 (0.0010) [2023-12-26 15:11:56,195][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:56,797][123090] Updated weights for policy 1, policy_version 1941606 (0.0007) [2023-12-26 15:11:56,860][123090] Updated weights for policy 1, policy_version 1941616 (0.0005) [2023-12-26 15:11:56,922][123090] Updated weights for policy 1, policy_version 1941626 (0.0007) [2023-12-26 15:11:57,190][123091] Updated weights for policy 0, policy_version 1953441 (0.0010) [2023-12-26 15:11:57,226][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:57,629][123090] Updated weights for policy 1, policy_version 1941636 (0.0007) [2023-12-26 15:11:57,687][123090] Updated weights for policy 1, policy_version 1941646 (0.0008) [2023-12-26 15:11:57,749][123090] Updated weights for policy 1, policy_version 1941656 (0.0009) [2023-12-26 15:11:58,110][123091] Updated weights for policy 0, policy_version 1953451 (0.0010) [2023-12-26 15:11:58,178][123091] Updated weights for policy 0, policy_version 1953461 (0.0009) [2023-12-26 15:11:58,195][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:58,637][123090] Updated weights for policy 1, policy_version 1941666 (0.0009) [2023-12-26 15:11:58,716][123090] Updated weights for policy 1, policy_version 1941676 (0.0010) [2023-12-26 15:11:58,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 997253120. Throughput: 0: 8978.8, 1: 8934.4. Samples: 997252196. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:11:58,785][121949] Avg episode reward: [(0, '6351.798'), (1, '5799.816')] [2023-12-26 15:11:58,800][123090] Updated weights for policy 1, policy_version 1941686 (0.0010) [2023-12-26 15:11:58,877][123090] Updated weights for policy 1, policy_version 1941696 (0.0009) [2023-12-26 15:11:59,188][123091] Updated weights for policy 0, policy_version 1953471 (0.0010) [2023-12-26 15:11:59,246][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:11:59,800][123090] Updated weights for policy 1, policy_version 1941706 (0.0006) [2023-12-26 15:11:59,864][123090] Updated weights for policy 1, policy_version 1941717 (0.0007) [2023-12-26 15:11:59,920][123090] Updated weights for policy 1, policy_version 1941727 (0.0009) [2023-12-26 15:12:00,102][123091] Updated weights for policy 0, policy_version 1953481 (0.0009) [2023-12-26 15:12:00,161][123091] Updated weights for policy 0, policy_version 1953491 (0.0010) [2023-12-26 15:12:00,190][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:00,695][123090] Updated weights for policy 1, policy_version 1941737 (0.0010) [2023-12-26 15:12:00,757][123090] Updated weights for policy 1, policy_version 1941747 (0.0010) [2023-12-26 15:12:00,830][123090] Updated weights for policy 1, policy_version 1941757 (0.0005) [2023-12-26 15:12:01,000][123091] Updated weights for policy 0, policy_version 1953501 (0.0006) [2023-12-26 15:12:01,068][123091] Updated weights for policy 0, policy_version 1953511 (0.0009) [2023-12-26 15:12:01,070][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:01,553][123090] Updated weights for policy 1, policy_version 1941767 (0.0005) [2023-12-26 15:12:01,620][123090] Updated weights for policy 1, policy_version 1941777 (0.0006) [2023-12-26 15:12:01,681][123090] Updated weights for policy 1, policy_version 1941787 (0.0009) [2023-12-26 15:12:01,964][123091] Updated weights for policy 0, policy_version 1953521 (0.0006) [2023-12-26 15:12:02,009][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:02,533][123090] Updated weights for policy 1, policy_version 1941797 (0.0010) [2023-12-26 15:12:02,585][123090] Updated weights for policy 1, policy_version 1941807 (0.0009) [2023-12-26 15:12:02,645][123090] Updated weights for policy 1, policy_version 1941817 (0.0009) [2023-12-26 15:12:02,735][123091] Updated weights for policy 0, policy_version 1953531 (0.0007) [2023-12-26 15:12:02,792][123091] Updated weights for policy 0, policy_version 1953541 (0.0009) [2023-12-26 15:12:02,805][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:03,491][123090] Updated weights for policy 1, policy_version 1941827 (0.0009) [2023-12-26 15:12:03,548][123090] Updated weights for policy 1, policy_version 1941837 (0.0009) [2023-12-26 15:12:03,600][123090] Updated weights for policy 1, policy_version 1941847 (0.0009) [2023-12-26 15:12:03,670][123091] Updated weights for policy 0, policy_version 1953551 (0.0008) [2023-12-26 15:12:03,720][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:03,784][121949] Fps is (10 sec: 18022.7, 60 sec: 17885.8, 300 sec: 17744.7). Total num frames: 997351424. Throughput: 0: 8914.3, 1: 8826.4. Samples: 997355304. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:03,785][121949] Avg episode reward: [(0, '6350.539'), (1, '5699.051')] [2023-12-26 15:12:04,452][123090] Updated weights for policy 1, policy_version 1941857 (0.0010) [2023-12-26 15:12:04,495][123091] Updated weights for policy 0, policy_version 1953561 (0.0008) [2023-12-26 15:12:04,505][123090] Updated weights for policy 1, policy_version 1941867 (0.0010) [2023-12-26 15:12:04,550][123091] Updated weights for policy 0, policy_version 1953571 (0.0008) [2023-12-26 15:12:04,566][123090] Updated weights for policy 1, policy_version 1941877 (0.0008) [2023-12-26 15:12:04,572][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:04,621][123090] Updated weights for policy 1, policy_version 1941887 (0.0009) [2023-12-26 15:12:05,427][123091] Updated weights for policy 0, policy_version 1953581 (0.0009) [2023-12-26 15:12:05,478][123091] Updated weights for policy 0, policy_version 1953591 (0.0007) [2023-12-26 15:12:05,480][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:05,484][123090] Updated weights for policy 1, policy_version 1941897 (0.0008) [2023-12-26 15:12:05,537][123090] Updated weights for policy 1, policy_version 1941907 (0.0009) [2023-12-26 15:12:05,606][123090] Updated weights for policy 1, policy_version 1941917 (0.0010) [2023-12-26 15:12:06,399][123090] Updated weights for policy 1, policy_version 1941927 (0.0009) [2023-12-26 15:12:06,411][123091] Updated weights for policy 0, policy_version 1953601 (0.0008) [2023-12-26 15:12:06,450][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:06,460][123090] Updated weights for policy 1, policy_version 1941937 (0.0009) [2023-12-26 15:12:06,513][123090] Updated weights for policy 1, policy_version 1941947 (0.0009) [2023-12-26 15:12:07,288][123091] Updated weights for policy 0, policy_version 1953611 (0.0007) [2023-12-26 15:12:07,338][123091] Updated weights for policy 0, policy_version 1953621 (0.0005) [2023-12-26 15:12:07,350][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:07,385][123090] Updated weights for policy 1, policy_version 1941957 (0.0010) [2023-12-26 15:12:07,443][123090] Updated weights for policy 1, policy_version 1941967 (0.0010) [2023-12-26 15:12:07,497][123090] Updated weights for policy 1, policy_version 1941977 (0.0009) [2023-12-26 15:12:08,183][123091] Updated weights for policy 0, policy_version 1953631 (0.0005) [2023-12-26 15:12:08,227][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:08,316][123090] Updated weights for policy 1, policy_version 1941987 (0.0009) [2023-12-26 15:12:08,389][123090] Updated weights for policy 1, policy_version 1941997 (0.0010) [2023-12-26 15:12:08,456][123090] Updated weights for policy 1, policy_version 1942007 (0.0011) [2023-12-26 15:12:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17744.7). Total num frames: 997433344. Throughput: 0: 8912.0, 1: 8845.4. Samples: 997407232. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:08,784][121949] Avg episode reward: [(0, '6202.960'), (1, '5614.153')] [2023-12-26 15:12:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001942016_497156096.pth... [2023-12-26 15:12:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953640_500277248.pth... [2023-12-26 15:12:08,794][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001940992_496893952.pth [2023-12-26 15:12:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953128_500015104.pth [2023-12-26 15:12:09,048][123091] Updated weights for policy 0, policy_version 1953641 (0.0006) [2023-12-26 15:12:09,105][123091] Updated weights for policy 0, policy_version 1953651 (0.0009) [2023-12-26 15:12:09,134][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:09,254][123090] Updated weights for policy 1, policy_version 1942017 (0.0010) [2023-12-26 15:12:09,314][123090] Updated weights for policy 1, policy_version 1942027 (0.0007) [2023-12-26 15:12:09,405][123090] Updated weights for policy 1, policy_version 1942037 (0.0010) [2023-12-26 15:12:09,473][123090] Updated weights for policy 1, policy_version 1942047 (0.0010) [2023-12-26 15:12:10,052][123091] Updated weights for policy 0, policy_version 1953661 (0.0010) [2023-12-26 15:12:10,116][123091] Updated weights for policy 0, policy_version 1953671 (0.0009) [2023-12-26 15:12:10,122][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:10,275][123090] Updated weights for policy 1, policy_version 1942057 (0.0009) [2023-12-26 15:12:10,326][123090] Updated weights for policy 1, policy_version 1942067 (0.0010) [2023-12-26 15:12:10,385][123090] Updated weights for policy 1, policy_version 1942077 (0.0009) [2023-12-26 15:12:10,974][123091] Updated weights for policy 0, policy_version 1953681 (0.0009) [2023-12-26 15:12:11,015][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:11,285][123090] Updated weights for policy 1, policy_version 1942087 (0.0010) [2023-12-26 15:12:11,349][123090] Updated weights for policy 1, policy_version 1942097 (0.0010) [2023-12-26 15:12:11,425][123090] Updated weights for policy 1, policy_version 1942107 (0.0009) [2023-12-26 15:12:11,912][123091] Updated weights for policy 0, policy_version 1953691 (0.0010) [2023-12-26 15:12:11,988][123091] Updated weights for policy 0, policy_version 1953701 (0.0009) [2023-12-26 15:12:12,004][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:12,269][123090] Updated weights for policy 1, policy_version 1942117 (0.0009) [2023-12-26 15:12:12,341][123090] Updated weights for policy 1, policy_version 1942127 (0.0008) [2023-12-26 15:12:12,410][123090] Updated weights for policy 1, policy_version 1942137 (0.0009) [2023-12-26 15:12:12,931][123091] Updated weights for policy 0, policy_version 1953711 (0.0010) [2023-12-26 15:12:12,976][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:13,191][123090] Updated weights for policy 1, policy_version 1942147 (0.0008) [2023-12-26 15:12:13,241][123090] Updated weights for policy 1, policy_version 1942157 (0.0005) [2023-12-26 15:12:13,302][123090] Updated weights for policy 1, policy_version 1942167 (0.0005) [2023-12-26 15:12:13,784][121949] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17689.2). Total num frames: 997515264. Throughput: 0: 8908.5, 1: 8826.8. Samples: 997510868. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:13,785][121949] Avg episode reward: [(0, '6225.175'), (1, '5838.478')] [2023-12-26 15:12:13,876][123091] Updated weights for policy 0, policy_version 1953721 (0.0010) [2023-12-26 15:12:13,933][123091] Updated weights for policy 0, policy_version 1953731 (0.0008) [2023-12-26 15:12:13,963][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:14,096][123090] Updated weights for policy 1, policy_version 1942177 (0.0007) [2023-12-26 15:12:14,169][123090] Updated weights for policy 1, policy_version 1942187 (0.0010) [2023-12-26 15:12:14,233][123090] Updated weights for policy 1, policy_version 1942197 (0.0009) [2023-12-26 15:12:14,293][123090] Updated weights for policy 1, policy_version 1942207 (0.0009) [2023-12-26 15:12:14,753][123091] Updated weights for policy 0, policy_version 1953741 (0.0008) [2023-12-26 15:12:14,827][123091] Updated weights for policy 0, policy_version 1953751 (0.0007) [2023-12-26 15:12:14,834][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:15,111][123090] Updated weights for policy 1, policy_version 1942217 (0.0010) [2023-12-26 15:12:15,175][123090] Updated weights for policy 1, policy_version 1942227 (0.0010) [2023-12-26 15:12:15,228][123090] Updated weights for policy 1, policy_version 1942237 (0.0009) [2023-12-26 15:12:15,703][123091] Updated weights for policy 0, policy_version 1953761 (0.0010) [2023-12-26 15:12:15,745][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:16,085][123090] Updated weights for policy 1, policy_version 1942247 (0.0009) [2023-12-26 15:12:16,145][123090] Updated weights for policy 1, policy_version 1942257 (0.0008) [2023-12-26 15:12:16,205][123090] Updated weights for policy 1, policy_version 1942267 (0.0008) [2023-12-26 15:12:16,512][123091] Updated weights for policy 0, policy_version 1953771 (0.0009) [2023-12-26 15:12:16,559][123091] Updated weights for policy 0, policy_version 1953781 (0.0005) [2023-12-26 15:12:16,571][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:16,929][123090] Updated weights for policy 1, policy_version 1942277 (0.0007) [2023-12-26 15:12:16,978][123090] Updated weights for policy 1, policy_version 1942287 (0.0005) [2023-12-26 15:12:17,027][123090] Updated weights for policy 1, policy_version 1942297 (0.0005) [2023-12-26 15:12:17,324][123091] Updated weights for policy 0, policy_version 1953791 (0.0009) [2023-12-26 15:12:17,361][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:17,746][123090] Updated weights for policy 1, policy_version 1942307 (0.0007) [2023-12-26 15:12:17,809][123090] Updated weights for policy 1, policy_version 1942317 (0.0007) [2023-12-26 15:12:17,868][123090] Updated weights for policy 1, policy_version 1942327 (0.0009) [2023-12-26 15:12:18,212][123091] Updated weights for policy 0, policy_version 1953801 (0.0010) [2023-12-26 15:12:18,266][123091] Updated weights for policy 0, policy_version 1953811 (0.0009) [2023-12-26 15:12:18,299][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:18,695][123090] Updated weights for policy 1, policy_version 1942337 (0.0009) [2023-12-26 15:12:18,768][123090] Updated weights for policy 1, policy_version 1942347 (0.0006) [2023-12-26 15:12:18,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17716.9). Total num frames: 997605376. Throughput: 0: 8919.9, 1: 8836.5. Samples: 997620024. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:18,785][121949] Avg episode reward: [(0, '6331.972'), (1, '5929.689')] [2023-12-26 15:12:18,846][123090] Updated weights for policy 1, policy_version 1942357 (0.0005) [2023-12-26 15:12:18,912][123090] Updated weights for policy 1, policy_version 1942367 (0.0006) [2023-12-26 15:12:19,205][123091] Updated weights for policy 0, policy_version 1953821 (0.0009) [2023-12-26 15:12:19,271][123091] Updated weights for policy 0, policy_version 1953831 (0.0008) [2023-12-26 15:12:19,274][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:19,496][123090] Updated weights for policy 1, policy_version 1942377 (0.0007) [2023-12-26 15:12:19,563][123090] Updated weights for policy 1, policy_version 1942387 (0.0007) [2023-12-26 15:12:19,637][123090] Updated weights for policy 1, policy_version 1942397 (0.0010) [2023-12-26 15:12:20,151][123091] Updated weights for policy 0, policy_version 1953841 (0.0010) [2023-12-26 15:12:20,192][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:20,478][123090] Updated weights for policy 1, policy_version 1942407 (0.0009) [2023-12-26 15:12:20,529][123090] Updated weights for policy 1, policy_version 1942417 (0.0010) [2023-12-26 15:12:20,598][123090] Updated weights for policy 1, policy_version 1942427 (0.0009) [2023-12-26 15:12:21,084][123091] Updated weights for policy 0, policy_version 1953851 (0.0009) [2023-12-26 15:12:21,149][123091] Updated weights for policy 0, policy_version 1953861 (0.0010) [2023-12-26 15:12:21,162][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:21,505][123090] Updated weights for policy 1, policy_version 1942437 (0.0010) [2023-12-26 15:12:21,566][123090] Updated weights for policy 1, policy_version 1942447 (0.0010) [2023-12-26 15:12:21,631][123090] Updated weights for policy 1, policy_version 1942457 (0.0010) [2023-12-26 15:12:22,101][123091] Updated weights for policy 0, policy_version 1953871 (0.0007) [2023-12-26 15:12:22,145][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:22,387][123090] Updated weights for policy 1, policy_version 1942467 (0.0009) [2023-12-26 15:12:22,447][123090] Updated weights for policy 1, policy_version 1942477 (0.0006) [2023-12-26 15:12:22,506][123090] Updated weights for policy 1, policy_version 1942487 (0.0006) [2023-12-26 15:12:23,041][123091] Updated weights for policy 0, policy_version 1953882 (0.0009) [2023-12-26 15:12:23,116][123091] Updated weights for policy 0, policy_version 1953892 (0.0005) [2023-12-26 15:12:23,145][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:23,273][123090] Updated weights for policy 1, policy_version 1942497 (0.0006) [2023-12-26 15:12:23,334][123090] Updated weights for policy 1, policy_version 1942507 (0.0009) [2023-12-26 15:12:23,401][123090] Updated weights for policy 1, policy_version 1942517 (0.0006) [2023-12-26 15:12:23,476][123090] Updated weights for policy 1, policy_version 1942527 (0.0006) [2023-12-26 15:12:23,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17689.2). Total num frames: 997695488. Throughput: 0: 8903.6, 1: 8829.2. Samples: 997671564. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:23,784][121949] Avg episode reward: [(0, '6426.184'), (1, '5871.853')] [2023-12-26 15:12:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001942528_497287168.pth... [2023-12-26 15:12:23,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001941504_497025024.pth [2023-12-26 15:12:23,819][123091] Updated weights for policy 0, policy_version 1953902 (0.0006) [2023-12-26 15:12:23,880][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:23,881][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953912_500416512.pth... [2023-12-26 15:12:23,884][123091] Updated weights for policy 0, policy_version 1953912 (0.0007) [2023-12-26 15:12:23,885][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953384_500146176.pth [2023-12-26 15:12:24,140][123090] Updated weights for policy 1, policy_version 1942537 (0.0009) [2023-12-26 15:12:24,197][123090] Updated weights for policy 1, policy_version 1942547 (0.0009) [2023-12-26 15:12:24,262][123090] Updated weights for policy 1, policy_version 1942557 (0.0009) [2023-12-26 15:12:24,787][123091] Updated weights for policy 0, policy_version 1953922 (0.0010) [2023-12-26 15:12:24,830][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:25,013][123090] Updated weights for policy 1, policy_version 1942567 (0.0006) [2023-12-26 15:12:25,073][123090] Updated weights for policy 1, policy_version 1942577 (0.0006) [2023-12-26 15:12:25,136][123090] Updated weights for policy 1, policy_version 1942587 (0.0006) [2023-12-26 15:12:25,606][123091] Updated weights for policy 0, policy_version 1953932 (0.0007) [2023-12-26 15:12:25,662][123091] Updated weights for policy 0, policy_version 1953942 (0.0010) [2023-12-26 15:12:25,670][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:25,786][123090] Updated weights for policy 1, policy_version 1942597 (0.0006) [2023-12-26 15:12:25,852][123090] Updated weights for policy 1, policy_version 1942607 (0.0005) [2023-12-26 15:12:25,917][123090] Updated weights for policy 1, policy_version 1942617 (0.0008) [2023-12-26 15:12:26,471][123091] Updated weights for policy 0, policy_version 1953952 (0.0006) [2023-12-26 15:12:26,531][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:26,575][123090] Updated weights for policy 1, policy_version 1942627 (0.0008) [2023-12-26 15:12:26,641][123090] Updated weights for policy 1, policy_version 1942637 (0.0005) [2023-12-26 15:12:26,707][123090] Updated weights for policy 1, policy_version 1942647 (0.0005) [2023-12-26 15:12:27,139][123091] Updated weights for policy 0, policy_version 1953962 (0.0005) [2023-12-26 15:12:27,203][123091] Updated weights for policy 0, policy_version 1953972 (0.0006) [2023-12-26 15:12:27,223][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:27,393][123090] Updated weights for policy 1, policy_version 1942657 (0.0005) [2023-12-26 15:12:27,442][123090] Updated weights for policy 1, policy_version 1942667 (0.0005) [2023-12-26 15:12:27,486][123090] Updated weights for policy 1, policy_version 1942677 (0.0005) [2023-12-26 15:12:27,531][123090] Updated weights for policy 1, policy_version 1942687 (0.0005) [2023-12-26 15:12:28,064][123091] Updated weights for policy 0, policy_version 1953982 (0.0010) [2023-12-26 15:12:28,125][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:28,127][123091] Updated weights for policy 0, policy_version 1953992 (0.0010) [2023-12-26 15:12:28,229][123090] Updated weights for policy 1, policy_version 1942697 (0.0005) [2023-12-26 15:12:28,274][123090] Updated weights for policy 1, policy_version 1942707 (0.0005) [2023-12-26 15:12:28,326][123090] Updated weights for policy 1, policy_version 1942717 (0.0006) [2023-12-26 15:12:28,784][121949] Fps is (10 sec: 18841.8, 60 sec: 18022.4, 300 sec: 17689.2). Total num frames: 997793792. Throughput: 0: 9003.3, 1: 8955.6. Samples: 997787804. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:28,785][121949] Avg episode reward: [(0, '6255.682'), (1, '5926.209')] [2023-12-26 15:12:29,052][123091] Updated weights for policy 0, policy_version 1954002 (0.0011) [2023-12-26 15:12:29,082][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:29,143][123090] Updated weights for policy 1, policy_version 1942727 (0.0011) [2023-12-26 15:12:29,209][123090] Updated weights for policy 1, policy_version 1942737 (0.0010) [2023-12-26 15:12:29,268][123090] Updated weights for policy 1, policy_version 1942747 (0.0011) [2023-12-26 15:12:30,031][123091] Updated weights for policy 0, policy_version 1954012 (0.0010) [2023-12-26 15:12:30,102][123090] Updated weights for policy 1, policy_version 1942757 (0.0011) [2023-12-26 15:12:30,103][123091] Updated weights for policy 0, policy_version 1954022 (0.0011) [2023-12-26 15:12:30,110][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:30,151][123090] Updated weights for policy 1, policy_version 1942767 (0.0009) [2023-12-26 15:12:30,210][123090] Updated weights for policy 1, policy_version 1942777 (0.0009) [2023-12-26 15:12:30,955][123091] Updated weights for policy 0, policy_version 1954032 (0.0006) [2023-12-26 15:12:31,008][123090] Updated weights for policy 1, policy_version 1942787 (0.0009) [2023-12-26 15:12:31,008][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:31,074][123090] Updated weights for policy 1, policy_version 1942797 (0.0009) [2023-12-26 15:12:31,132][123090] Updated weights for policy 1, policy_version 1942807 (0.0010) [2023-12-26 15:12:31,749][123091] Updated weights for policy 0, policy_version 1954042 (0.0006) [2023-12-26 15:12:31,802][123091] Updated weights for policy 0, policy_version 1954052 (0.0010) [2023-12-26 15:12:31,816][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:31,977][123090] Updated weights for policy 1, policy_version 1942817 (0.0009) [2023-12-26 15:12:32,051][123090] Updated weights for policy 1, policy_version 1942827 (0.0006) [2023-12-26 15:12:32,116][123090] Updated weights for policy 1, policy_version 1942837 (0.0006) [2023-12-26 15:12:32,174][123090] Updated weights for policy 1, policy_version 1942847 (0.0010) [2023-12-26 15:12:32,558][123091] Updated weights for policy 0, policy_version 1954063 (0.0007) [2023-12-26 15:12:32,618][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:32,945][123090] Updated weights for policy 1, policy_version 1942857 (0.0006) [2023-12-26 15:12:32,991][123090] Updated weights for policy 1, policy_version 1942867 (0.0005) [2023-12-26 15:12:33,037][123090] Updated weights for policy 1, policy_version 1942877 (0.0005) [2023-12-26 15:12:33,258][123091] Updated weights for policy 0, policy_version 1954073 (0.0006) [2023-12-26 15:12:33,307][123091] Updated weights for policy 0, policy_version 1954083 (0.0005) [2023-12-26 15:12:33,327][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:33,784][121949] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 997883904. Throughput: 0: 8977.0, 1: 8927.4. Samples: 997897592. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:33,784][121949] Avg episode reward: [(0, '6217.928'), (1, '5996.389')] [2023-12-26 15:12:33,803][123090] Updated weights for policy 1, policy_version 1942887 (0.0009) [2023-12-26 15:12:33,849][123090] Updated weights for policy 1, policy_version 1942897 (0.0010) [2023-12-26 15:12:33,896][123090] Updated weights for policy 1, policy_version 1942907 (0.0010) [2023-12-26 15:12:34,117][123091] Updated weights for policy 0, policy_version 1954093 (0.0008) [2023-12-26 15:12:34,184][123091] Updated weights for policy 0, policy_version 1954103 (0.0011) [2023-12-26 15:12:34,188][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:34,718][123090] Updated weights for policy 1, policy_version 1942917 (0.0008) [2023-12-26 15:12:34,780][123090] Updated weights for policy 1, policy_version 1942927 (0.0006) [2023-12-26 15:12:34,844][123090] Updated weights for policy 1, policy_version 1942937 (0.0009) [2023-12-26 15:12:34,938][123091] Updated weights for policy 0, policy_version 1954113 (0.0006) [2023-12-26 15:12:34,980][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:35,678][123090] Updated weights for policy 1, policy_version 1942947 (0.0011) [2023-12-26 15:12:35,718][123091] Updated weights for policy 0, policy_version 1954123 (0.0007) [2023-12-26 15:12:35,730][123090] Updated weights for policy 1, policy_version 1942957 (0.0010) [2023-12-26 15:12:35,774][123091] Updated weights for policy 0, policy_version 1954133 (0.0011) [2023-12-26 15:12:35,782][123090] Updated weights for policy 1, policy_version 1942967 (0.0010) [2023-12-26 15:12:35,793][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:36,620][123091] Updated weights for policy 0, policy_version 1954143 (0.0009) [2023-12-26 15:12:36,625][123090] Updated weights for policy 1, policy_version 1942977 (0.0010) [2023-12-26 15:12:36,662][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:36,687][123090] Updated weights for policy 1, policy_version 1942987 (0.0009) [2023-12-26 15:12:36,745][123090] Updated weights for policy 1, policy_version 1942997 (0.0009) [2023-12-26 15:12:36,795][123090] Updated weights for policy 1, policy_version 1943007 (0.0009) [2023-12-26 15:12:37,512][123090] Updated weights for policy 1, policy_version 1943017 (0.0006) [2023-12-26 15:12:37,562][123091] Updated weights for policy 0, policy_version 1954153 (0.0009) [2023-12-26 15:12:37,565][123090] Updated weights for policy 1, policy_version 1943027 (0.0005) [2023-12-26 15:12:37,619][123091] Updated weights for policy 0, policy_version 1954163 (0.0011) [2023-12-26 15:12:37,620][123090] Updated weights for policy 1, policy_version 1943037 (0.0006) [2023-12-26 15:12:37,641][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:38,340][123090] Updated weights for policy 1, policy_version 1943047 (0.0007) [2023-12-26 15:12:38,400][123090] Updated weights for policy 1, policy_version 1943057 (0.0011) [2023-12-26 15:12:38,452][123090] Updated weights for policy 1, policy_version 1943067 (0.0009) [2023-12-26 15:12:38,467][123091] Updated weights for policy 0, policy_version 1954173 (0.0008) [2023-12-26 15:12:38,538][123091] Updated weights for policy 0, policy_version 1954183 (0.0006) [2023-12-26 15:12:38,544][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:38,784][121949] Fps is (10 sec: 18841.6, 60 sec: 18158.9, 300 sec: 17716.9). Total num frames: 997982208. Throughput: 0: 9063.3, 1: 8894.1. Samples: 997952216. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:38,785][121949] Avg episode reward: [(0, '6299.675'), (1, '5780.204')] [2023-12-26 15:12:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954184_500555776.pth... [2023-12-26 15:12:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001943072_497426432.pth... [2023-12-26 15:12:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953640_500277248.pth [2023-12-26 15:12:38,800][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001942016_497156096.pth [2023-12-26 15:12:39,219][123090] Updated weights for policy 1, policy_version 1943077 (0.0009) [2023-12-26 15:12:39,285][123090] Updated weights for policy 1, policy_version 1943087 (0.0009) [2023-12-26 15:12:39,304][123091] Updated weights for policy 0, policy_version 1954193 (0.0006) [2023-12-26 15:12:39,345][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:39,356][123090] Updated weights for policy 1, policy_version 1943097 (0.0009) [2023-12-26 15:12:40,149][123091] Updated weights for policy 0, policy_version 1954203 (0.0008) [2023-12-26 15:12:40,198][123090] Updated weights for policy 1, policy_version 1943107 (0.0009) [2023-12-26 15:12:40,210][123091] Updated weights for policy 0, policy_version 1954213 (0.0009) [2023-12-26 15:12:40,222][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:40,268][123090] Updated weights for policy 1, policy_version 1943117 (0.0008) [2023-12-26 15:12:40,341][123090] Updated weights for policy 1, policy_version 1943127 (0.0006) [2023-12-26 15:12:41,009][123090] Updated weights for policy 1, policy_version 1943137 (0.0006) [2023-12-26 15:12:41,086][123091] Updated weights for policy 0, policy_version 1954223 (0.0008) [2023-12-26 15:12:41,095][123090] Updated weights for policy 1, policy_version 1943147 (0.0008) [2023-12-26 15:12:41,154][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:41,168][123090] Updated weights for policy 1, policy_version 1943157 (0.0008) [2023-12-26 15:12:41,236][123090] Updated weights for policy 1, policy_version 1943167 (0.0008) [2023-12-26 15:12:42,048][123091] Updated weights for policy 0, policy_version 1954233 (0.0008) [2023-12-26 15:12:42,048][123090] Updated weights for policy 1, policy_version 1943177 (0.0009) [2023-12-26 15:12:42,097][123090] Updated weights for policy 1, policy_version 1943187 (0.0009) [2023-12-26 15:12:42,112][123091] Updated weights for policy 0, policy_version 1954243 (0.0008) [2023-12-26 15:12:42,140][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:42,158][123090] Updated weights for policy 1, policy_version 1943197 (0.0009) [2023-12-26 15:12:43,014][123090] Updated weights for policy 1, policy_version 1943207 (0.0008) [2023-12-26 15:12:43,029][123091] Updated weights for policy 0, policy_version 1954253 (0.0009) [2023-12-26 15:12:43,077][123090] Updated weights for policy 1, policy_version 1943217 (0.0009) [2023-12-26 15:12:43,085][123091] Updated weights for policy 0, policy_version 1954263 (0.0005) [2023-12-26 15:12:43,090][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:43,129][123090] Updated weights for policy 1, policy_version 1943227 (0.0009) [2023-12-26 15:12:43,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 998064128. Throughput: 0: 9097.5, 1: 8863.6. Samples: 998060448. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:43,785][121949] Avg episode reward: [(0, '6350.131'), (1, '5643.668')] [2023-12-26 15:12:43,793][123090] Updated weights for policy 1, policy_version 1943237 (0.0007) [2023-12-26 15:12:43,846][123090] Updated weights for policy 1, policy_version 1943247 (0.0005) [2023-12-26 15:12:43,891][123090] Updated weights for policy 1, policy_version 1943257 (0.0005) [2023-12-26 15:12:44,077][123091] Updated weights for policy 0, policy_version 1954273 (0.0009) [2023-12-26 15:12:44,116][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:44,622][123090] Updated weights for policy 1, policy_version 1943267 (0.0006) [2023-12-26 15:12:44,674][123090] Updated weights for policy 1, policy_version 1943277 (0.0009) [2023-12-26 15:12:44,730][123090] Updated weights for policy 1, policy_version 1943287 (0.0009) [2023-12-26 15:12:45,059][123091] Updated weights for policy 0, policy_version 1954283 (0.0010) [2023-12-26 15:12:45,141][123091] Updated weights for policy 0, policy_version 1954293 (0.0009) [2023-12-26 15:12:45,156][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:45,493][123090] Updated weights for policy 1, policy_version 1943297 (0.0009) [2023-12-26 15:12:45,567][123090] Updated weights for policy 1, policy_version 1943307 (0.0009) [2023-12-26 15:12:45,632][123090] Updated weights for policy 1, policy_version 1943317 (0.0010) [2023-12-26 15:12:45,706][123090] Updated weights for policy 1, policy_version 1943327 (0.0010) [2023-12-26 15:12:46,002][123091] Updated weights for policy 0, policy_version 1954303 (0.0009) [2023-12-26 15:12:46,049][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:46,384][123090] Updated weights for policy 1, policy_version 1943337 (0.0006) [2023-12-26 15:12:46,449][123090] Updated weights for policy 1, policy_version 1943347 (0.0006) [2023-12-26 15:12:46,505][123090] Updated weights for policy 1, policy_version 1943357 (0.0007) [2023-12-26 15:12:46,862][123091] Updated weights for policy 0, policy_version 1954313 (0.0008) [2023-12-26 15:12:46,924][123091] Updated weights for policy 0, policy_version 1954323 (0.0009) [2023-12-26 15:12:46,950][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:47,151][123090] Updated weights for policy 1, policy_version 1943367 (0.0006) [2023-12-26 15:12:47,208][123090] Updated weights for policy 1, policy_version 1943377 (0.0006) [2023-12-26 15:12:47,272][123090] Updated weights for policy 1, policy_version 1943387 (0.0006) [2023-12-26 15:12:47,827][123091] Updated weights for policy 0, policy_version 1954333 (0.0009) [2023-12-26 15:12:47,889][123091] Updated weights for policy 0, policy_version 1954343 (0.0009) [2023-12-26 15:12:47,894][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:48,029][123090] Updated weights for policy 1, policy_version 1943397 (0.0006) [2023-12-26 15:12:48,079][123090] Updated weights for policy 1, policy_version 1943407 (0.0005) [2023-12-26 15:12:48,128][123090] Updated weights for policy 1, policy_version 1943417 (0.0005) [2023-12-26 15:12:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 998154240. Throughput: 0: 9070.2, 1: 9048.2. Samples: 998170628. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:48,785][121949] Avg episode reward: [(0, '6408.247'), (1, '5867.353')] [2023-12-26 15:12:48,850][123090] Updated weights for policy 1, policy_version 1943427 (0.0007) [2023-12-26 15:12:48,869][123091] Updated weights for policy 0, policy_version 1954353 (0.0009) [2023-12-26 15:12:48,901][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:48,905][123090] Updated weights for policy 1, policy_version 1943437 (0.0007) [2023-12-26 15:12:48,970][123090] Updated weights for policy 1, policy_version 1943447 (0.0010) [2023-12-26 15:12:49,779][123091] Updated weights for policy 0, policy_version 1954363 (0.0009) [2023-12-26 15:12:49,788][123090] Updated weights for policy 1, policy_version 1943457 (0.0011) [2023-12-26 15:12:49,846][123091] Updated weights for policy 0, policy_version 1954373 (0.0008) [2023-12-26 15:12:49,853][123090] Updated weights for policy 1, policy_version 1943467 (0.0010) [2023-12-26 15:12:49,865][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:49,929][123090] Updated weights for policy 1, policy_version 1943477 (0.0011) [2023-12-26 15:12:49,999][123090] Updated weights for policy 1, policy_version 1943487 (0.0013) [2023-12-26 15:12:50,764][123091] Updated weights for policy 0, policy_version 1954383 (0.0008) [2023-12-26 15:12:50,800][123090] Updated weights for policy 1, policy_version 1943497 (0.0011) [2023-12-26 15:12:50,816][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:50,859][123090] Updated weights for policy 1, policy_version 1943507 (0.0010) [2023-12-26 15:12:50,930][123090] Updated weights for policy 1, policy_version 1943517 (0.0010) [2023-12-26 15:12:51,673][123091] Updated weights for policy 0, policy_version 1954393 (0.0009) [2023-12-26 15:12:51,729][123091] Updated weights for policy 0, policy_version 1954403 (0.0009) [2023-12-26 15:12:51,763][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:51,764][123090] Updated weights for policy 1, policy_version 1943527 (0.0011) [2023-12-26 15:12:51,834][123090] Updated weights for policy 1, policy_version 1943537 (0.0011) [2023-12-26 15:12:51,902][123090] Updated weights for policy 1, policy_version 1943547 (0.0011) [2023-12-26 15:12:52,682][123091] Updated weights for policy 0, policy_version 1954413 (0.0007) [2023-12-26 15:12:52,729][123090] Updated weights for policy 1, policy_version 1943557 (0.0010) [2023-12-26 15:12:52,740][123091] Updated weights for policy 0, policy_version 1954423 (0.0007) [2023-12-26 15:12:52,745][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:52,780][123090] Updated weights for policy 1, policy_version 1943567 (0.0010) [2023-12-26 15:12:52,848][123090] Updated weights for policy 1, policy_version 1943577 (0.0011) [2023-12-26 15:12:53,630][123091] Updated weights for policy 0, policy_version 1954433 (0.0009) [2023-12-26 15:12:53,674][123090] Updated weights for policy 1, policy_version 1943587 (0.0010) [2023-12-26 15:12:53,676][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:53,741][123090] Updated weights for policy 1, policy_version 1943597 (0.0009) [2023-12-26 15:12:53,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17716.9). Total num frames: 998244352. Throughput: 0: 9055.8, 1: 9056.6. Samples: 998222292. Policy #0 lag: (min: 31.0, avg: 33.3, max: 63.0) [2023-12-26 15:12:53,785][121949] Avg episode reward: [(0, '6377.580'), (1, '5979.788')] [2023-12-26 15:12:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954440_500686848.pth... [2023-12-26 15:12:53,795][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001953912_500416512.pth [2023-12-26 15:12:53,804][123090] Updated weights for policy 1, policy_version 1943607 (0.0009) [2023-12-26 15:12:53,861][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001943616_497565696.pth... [2023-12-26 15:12:53,867][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001942528_497287168.pth [2023-12-26 15:12:54,542][123091] Updated weights for policy 0, policy_version 1954443 (0.0008) [2023-12-26 15:12:54,568][123090] Updated weights for policy 1, policy_version 1943617 (0.0009) [2023-12-26 15:12:54,607][123091] Updated weights for policy 0, policy_version 1954453 (0.0008) [2023-12-26 15:12:54,617][123090] Updated weights for policy 1, policy_version 1943627 (0.0008) [2023-12-26 15:12:54,623][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:54,677][123090] Updated weights for policy 1, policy_version 1943637 (0.0009) [2023-12-26 15:12:54,740][123090] Updated weights for policy 1, policy_version 1943647 (0.0010) [2023-12-26 15:12:55,487][123091] Updated weights for policy 0, policy_version 1954463 (0.0009) [2023-12-26 15:12:55,527][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:55,566][123090] Updated weights for policy 1, policy_version 1943657 (0.0010) [2023-12-26 15:12:55,613][123090] Updated weights for policy 1, policy_version 1943667 (0.0010) [2023-12-26 15:12:55,664][123090] Updated weights for policy 1, policy_version 1943677 (0.0010) [2023-12-26 15:12:56,435][123091] Updated weights for policy 0, policy_version 1954473 (0.0008) [2023-12-26 15:12:56,445][123090] Updated weights for policy 1, policy_version 1943687 (0.0009) [2023-12-26 15:12:56,490][123091] Updated weights for policy 0, policy_version 1954483 (0.0008) [2023-12-26 15:12:56,504][123090] Updated weights for policy 1, policy_version 1943697 (0.0010) [2023-12-26 15:12:56,511][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:56,573][123090] Updated weights for policy 1, policy_version 1943707 (0.0010) [2023-12-26 15:12:57,358][123090] Updated weights for policy 1, policy_version 1943717 (0.0008) [2023-12-26 15:12:57,416][123090] Updated weights for policy 1, policy_version 1943727 (0.0005) [2023-12-26 15:12:57,423][123091] Updated weights for policy 0, policy_version 1954493 (0.0008) [2023-12-26 15:12:57,470][123090] Updated weights for policy 1, policy_version 1943737 (0.0005) [2023-12-26 15:12:57,475][123091] Updated weights for policy 0, policy_version 1954503 (0.0011) [2023-12-26 15:12:57,477][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:58,103][123090] Updated weights for policy 1, policy_version 1943747 (0.0007) [2023-12-26 15:12:58,158][123090] Updated weights for policy 1, policy_version 1943757 (0.0010) [2023-12-26 15:12:58,222][123090] Updated weights for policy 1, policy_version 1943767 (0.0011) [2023-12-26 15:12:58,290][123091] Updated weights for policy 0, policy_version 1954513 (0.0009) [2023-12-26 15:12:58,334][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:12:58,784][121949] Fps is (10 sec: 18022.3, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 998334464. Throughput: 0: 9005.5, 1: 9128.7. Samples: 998326908. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:12:58,785][121949] Avg episode reward: [(0, '6326.020'), (1, '5934.385')] [2023-12-26 15:12:59,160][123090] Updated weights for policy 1, policy_version 1943777 (0.0010) [2023-12-26 15:12:59,232][123090] Updated weights for policy 1, policy_version 1943787 (0.0011) [2023-12-26 15:12:59,292][123090] Updated weights for policy 1, policy_version 1943797 (0.0011) [2023-12-26 15:12:59,352][123091] Updated weights for policy 0, policy_version 1954523 (0.0008) [2023-12-26 15:12:59,363][123090] Updated weights for policy 1, policy_version 1943807 (0.0011) [2023-12-26 15:12:59,417][123091] Updated weights for policy 0, policy_version 1954533 (0.0009) [2023-12-26 15:12:59,434][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:00,173][123090] Updated weights for policy 1, policy_version 1943817 (0.0007) [2023-12-26 15:13:00,241][123090] Updated weights for policy 1, policy_version 1943827 (0.0007) [2023-12-26 15:13:00,301][123090] Updated weights for policy 1, policy_version 1943837 (0.0008) [2023-12-26 15:13:00,309][123091] Updated weights for policy 0, policy_version 1954543 (0.0007) [2023-12-26 15:13:00,368][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:01,055][123090] Updated weights for policy 1, policy_version 1943847 (0.0009) [2023-12-26 15:13:01,086][123091] Updated weights for policy 0, policy_version 1954553 (0.0009) [2023-12-26 15:13:01,112][123090] Updated weights for policy 1, policy_version 1943857 (0.0008) [2023-12-26 15:13:01,165][123091] Updated weights for policy 0, policy_version 1954563 (0.0006) [2023-12-26 15:13:01,183][123090] Updated weights for policy 1, policy_version 1943867 (0.0008) [2023-12-26 15:13:01,194][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:01,946][123090] Updated weights for policy 1, policy_version 1943877 (0.0009) [2023-12-26 15:13:02,008][123090] Updated weights for policy 1, policy_version 1943887 (0.0010) [2023-12-26 15:13:02,029][123091] Updated weights for policy 0, policy_version 1954573 (0.0008) [2023-12-26 15:13:02,070][123090] Updated weights for policy 1, policy_version 1943897 (0.0010) [2023-12-26 15:13:02,088][123091] Updated weights for policy 0, policy_version 1954583 (0.0008) [2023-12-26 15:13:02,093][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:02,793][123090] Updated weights for policy 1, policy_version 1943907 (0.0007) [2023-12-26 15:13:02,854][123090] Updated weights for policy 1, policy_version 1943917 (0.0009) [2023-12-26 15:13:02,914][123090] Updated weights for policy 1, policy_version 1943927 (0.0009) [2023-12-26 15:13:03,027][123091] Updated weights for policy 0, policy_version 1954593 (0.0010) [2023-12-26 15:13:03,061][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:03,678][123090] Updated weights for policy 1, policy_version 1943937 (0.0008) [2023-12-26 15:13:03,752][123090] Updated weights for policy 1, policy_version 1943947 (0.0005) [2023-12-26 15:13:03,784][121949] Fps is (10 sec: 17203.5, 60 sec: 17749.4, 300 sec: 17716.9). Total num frames: 998416384. Throughput: 0: 8954.7, 1: 9109.8. Samples: 998432924. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:03,784][121949] Avg episode reward: [(0, '6348.821'), (1, '5900.321')] [2023-12-26 15:13:03,799][123090] Updated weights for policy 1, policy_version 1943957 (0.0005) [2023-12-26 15:13:03,853][123090] Updated weights for policy 1, policy_version 1943967 (0.0007) [2023-12-26 15:13:03,987][123091] Updated weights for policy 0, policy_version 1954603 (0.0009) [2023-12-26 15:13:04,054][123091] Updated weights for policy 0, policy_version 1954613 (0.0006) [2023-12-26 15:13:04,073][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:04,614][123090] Updated weights for policy 1, policy_version 1943977 (0.0010) [2023-12-26 15:13:04,676][123090] Updated weights for policy 1, policy_version 1943987 (0.0010) [2023-12-26 15:13:04,737][123090] Updated weights for policy 1, policy_version 1943997 (0.0008) [2023-12-26 15:13:04,857][123091] Updated weights for policy 0, policy_version 1954623 (0.0006) [2023-12-26 15:13:04,920][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:05,420][123090] Updated weights for policy 1, policy_version 1944007 (0.0008) [2023-12-26 15:13:05,492][123090] Updated weights for policy 1, policy_version 1944017 (0.0008) [2023-12-26 15:13:05,545][123090] Updated weights for policy 1, policy_version 1944027 (0.0005) [2023-12-26 15:13:05,616][123091] Updated weights for policy 0, policy_version 1954633 (0.0006) [2023-12-26 15:13:05,665][123091] Updated weights for policy 0, policy_version 1954643 (0.0008) [2023-12-26 15:13:05,690][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:06,305][123090] Updated weights for policy 1, policy_version 1944037 (0.0007) [2023-12-26 15:13:06,370][123090] Updated weights for policy 1, policy_version 1944047 (0.0011) [2023-12-26 15:13:06,437][123090] Updated weights for policy 1, policy_version 1944057 (0.0011) [2023-12-26 15:13:06,563][123091] Updated weights for policy 0, policy_version 1954653 (0.0009) [2023-12-26 15:13:06,632][123091] Updated weights for policy 0, policy_version 1954663 (0.0007) [2023-12-26 15:13:06,635][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:07,276][123090] Updated weights for policy 1, policy_version 1944067 (0.0011) [2023-12-26 15:13:07,331][123090] Updated weights for policy 1, policy_version 1944077 (0.0009) [2023-12-26 15:13:07,388][123090] Updated weights for policy 1, policy_version 1944087 (0.0009) [2023-12-26 15:13:07,450][123091] Updated weights for policy 0, policy_version 1954673 (0.0008) [2023-12-26 15:13:07,481][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:08,232][123090] Updated weights for policy 1, policy_version 1944097 (0.0008) [2023-12-26 15:13:08,290][123090] Updated weights for policy 1, policy_version 1944107 (0.0009) [2023-12-26 15:13:08,357][123090] Updated weights for policy 1, policy_version 1944117 (0.0008) [2023-12-26 15:13:08,380][123091] Updated weights for policy 0, policy_version 1954683 (0.0008) [2023-12-26 15:13:08,419][123090] Updated weights for policy 1, policy_version 1944127 (0.0008) [2023-12-26 15:13:08,443][123091] Updated weights for policy 0, policy_version 1954693 (0.0008) [2023-12-26 15:13:08,458][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 998514688. Throughput: 0: 9018.2, 1: 9156.1. Samples: 998489412. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:08,785][121949] Avg episode reward: [(0, '6342.541'), (1, '5890.271')] [2023-12-26 15:13:08,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001944128_497696768.pth... [2023-12-26 15:13:08,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954696_500817920.pth... [2023-12-26 15:13:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001943072_497426432.pth [2023-12-26 15:13:08,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954184_500555776.pth [2023-12-26 15:13:09,264][123090] Updated weights for policy 1, policy_version 1944137 (0.0010) [2023-12-26 15:13:09,293][123091] Updated weights for policy 0, policy_version 1954703 (0.0008) [2023-12-26 15:13:09,323][123090] Updated weights for policy 1, policy_version 1944147 (0.0009) [2023-12-26 15:13:09,352][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:09,392][123090] Updated weights for policy 1, policy_version 1944157 (0.0009) [2023-12-26 15:13:10,211][123091] Updated weights for policy 0, policy_version 1954713 (0.0009) [2023-12-26 15:13:10,252][123090] Updated weights for policy 1, policy_version 1944167 (0.0009) [2023-12-26 15:13:10,278][123091] Updated weights for policy 0, policy_version 1954723 (0.0006) [2023-12-26 15:13:10,311][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:10,319][123090] Updated weights for policy 1, policy_version 1944177 (0.0009) [2023-12-26 15:13:10,389][123090] Updated weights for policy 1, policy_version 1944187 (0.0009) [2023-12-26 15:13:11,075][123090] Updated weights for policy 1, policy_version 1944197 (0.0008) [2023-12-26 15:13:11,143][123090] Updated weights for policy 1, policy_version 1944207 (0.0007) [2023-12-26 15:13:11,216][123090] Updated weights for policy 1, policy_version 1944217 (0.0006) [2023-12-26 15:13:11,229][123091] Updated weights for policy 0, policy_version 1954733 (0.0008) [2023-12-26 15:13:11,292][123091] Updated weights for policy 0, policy_version 1954743 (0.0011) [2023-12-26 15:13:11,296][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:12,067][123090] Updated weights for policy 1, policy_version 1944227 (0.0008) [2023-12-26 15:13:12,129][123090] Updated weights for policy 1, policy_version 1944237 (0.0009) [2023-12-26 15:13:12,176][123091] Updated weights for policy 0, policy_version 1954753 (0.0006) [2023-12-26 15:13:12,190][123090] Updated weights for policy 1, policy_version 1944247 (0.0009) [2023-12-26 15:13:12,221][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:12,931][123091] Updated weights for policy 0, policy_version 1954763 (0.0006) [2023-12-26 15:13:12,991][123091] Updated weights for policy 0, policy_version 1954773 (0.0005) [2023-12-26 15:13:13,007][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:13,143][123090] Updated weights for policy 1, policy_version 1944257 (0.0010) [2023-12-26 15:13:13,206][123090] Updated weights for policy 1, policy_version 1944267 (0.0010) [2023-12-26 15:13:13,268][123090] Updated weights for policy 1, policy_version 1944277 (0.0009) [2023-12-26 15:13:13,321][123090] Updated weights for policy 1, policy_version 1944288 (0.0010) [2023-12-26 15:13:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17744.7). Total num frames: 998596608. Throughput: 0: 8903.8, 1: 8975.4. Samples: 998592364. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:13,784][121949] Avg episode reward: [(0, '6406.978'), (1, '5889.913')] [2023-12-26 15:13:13,799][123091] Updated weights for policy 0, policy_version 1954783 (0.0009) [2023-12-26 15:13:13,848][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:14,171][123090] Updated weights for policy 1, policy_version 1944298 (0.0009) [2023-12-26 15:13:14,232][123090] Updated weights for policy 1, policy_version 1944309 (0.0008) [2023-12-26 15:13:14,294][123090] Updated weights for policy 1, policy_version 1944319 (0.0005) [2023-12-26 15:13:14,605][123091] Updated weights for policy 0, policy_version 1954793 (0.0010) [2023-12-26 15:13:14,667][123091] Updated weights for policy 0, policy_version 1954803 (0.0006) [2023-12-26 15:13:14,693][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:15,139][123090] Updated weights for policy 1, policy_version 1944329 (0.0008) [2023-12-26 15:13:15,200][123090] Updated weights for policy 1, policy_version 1944339 (0.0009) [2023-12-26 15:13:15,261][123090] Updated weights for policy 1, policy_version 1944349 (0.0009) [2023-12-26 15:13:15,529][123091] Updated weights for policy 0, policy_version 1954813 (0.0008) [2023-12-26 15:13:15,587][123091] Updated weights for policy 0, policy_version 1954823 (0.0010) [2023-12-26 15:13:15,590][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:15,993][123090] Updated weights for policy 1, policy_version 1944359 (0.0007) [2023-12-26 15:13:16,063][123090] Updated weights for policy 1, policy_version 1944369 (0.0005) [2023-12-26 15:13:16,118][123090] Updated weights for policy 1, policy_version 1944379 (0.0006) [2023-12-26 15:13:16,486][123091] Updated weights for policy 0, policy_version 1954833 (0.0011) [2023-12-26 15:13:16,514][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:16,731][123090] Updated weights for policy 1, policy_version 1944389 (0.0005) [2023-12-26 15:13:16,791][123090] Updated weights for policy 1, policy_version 1944399 (0.0005) [2023-12-26 15:13:16,858][123090] Updated weights for policy 1, policy_version 1944409 (0.0009) [2023-12-26 15:13:17,407][123091] Updated weights for policy 0, policy_version 1954843 (0.0010) [2023-12-26 15:13:17,467][123091] Updated weights for policy 0, policy_version 1954853 (0.0010) [2023-12-26 15:13:17,484][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:17,674][123090] Updated weights for policy 1, policy_version 1944419 (0.0008) [2023-12-26 15:13:17,730][123090] Updated weights for policy 1, policy_version 1944429 (0.0009) [2023-12-26 15:13:17,786][123090] Updated weights for policy 1, policy_version 1944439 (0.0008) [2023-12-26 15:13:18,298][123091] Updated weights for policy 0, policy_version 1954863 (0.0007) [2023-12-26 15:13:18,363][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:18,688][123090] Updated weights for policy 1, policy_version 1944449 (0.0009) [2023-12-26 15:13:18,742][123090] Updated weights for policy 1, policy_version 1944459 (0.0010) [2023-12-26 15:13:18,784][121949] Fps is (10 sec: 17203.8, 60 sec: 18022.5, 300 sec: 17772.5). Total num frames: 998686720. Throughput: 0: 8922.9, 1: 8929.3. Samples: 998700936. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:18,784][121949] Avg episode reward: [(0, '6467.139'), (1, '5822.318')] [2023-12-26 15:13:18,808][123090] Updated weights for policy 1, policy_version 1944469 (0.0009) [2023-12-26 15:13:18,868][123090] Updated weights for policy 1, policy_version 1944479 (0.0010) [2023-12-26 15:13:19,084][123091] Updated weights for policy 0, policy_version 1954873 (0.0006) [2023-12-26 15:13:19,142][123091] Updated weights for policy 0, policy_version 1954883 (0.0005) [2023-12-26 15:13:19,173][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:19,755][123090] Updated weights for policy 1, policy_version 1944489 (0.0010) [2023-12-26 15:13:19,816][123090] Updated weights for policy 1, policy_version 1944499 (0.0011) [2023-12-26 15:13:19,887][123090] Updated weights for policy 1, policy_version 1944509 (0.0008) [2023-12-26 15:13:20,056][123091] Updated weights for policy 0, policy_version 1954893 (0.0010) [2023-12-26 15:13:20,124][123091] Updated weights for policy 0, policy_version 1954903 (0.0011) [2023-12-26 15:13:20,127][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:20,713][123090] Updated weights for policy 1, policy_version 1944519 (0.0008) [2023-12-26 15:13:20,764][123090] Updated weights for policy 1, policy_version 1944529 (0.0009) [2023-12-26 15:13:20,825][123090] Updated weights for policy 1, policy_version 1944539 (0.0009) [2023-12-26 15:13:21,079][123091] Updated weights for policy 0, policy_version 1954913 (0.0009) [2023-12-26 15:13:21,122][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:21,775][123090] Updated weights for policy 1, policy_version 1944549 (0.0009) [2023-12-26 15:13:21,830][123090] Updated weights for policy 1, policy_version 1944559 (0.0009) [2023-12-26 15:13:21,884][123090] Updated weights for policy 1, policy_version 1944569 (0.0009) [2023-12-26 15:13:22,077][123091] Updated weights for policy 0, policy_version 1954923 (0.0009) [2023-12-26 15:13:22,140][123091] Updated weights for policy 0, policy_version 1954933 (0.0009) [2023-12-26 15:13:22,155][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:22,762][123090] Updated weights for policy 1, policy_version 1944579 (0.0009) [2023-12-26 15:13:22,829][123090] Updated weights for policy 1, policy_version 1944589 (0.0011) [2023-12-26 15:13:22,897][123090] Updated weights for policy 1, policy_version 1944599 (0.0011) [2023-12-26 15:13:23,029][123091] Updated weights for policy 0, policy_version 1954943 (0.0009) [2023-12-26 15:13:23,069][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:23,640][123090] Updated weights for policy 1, policy_version 1944609 (0.0010) [2023-12-26 15:13:23,694][123090] Updated weights for policy 1, policy_version 1944619 (0.0007) [2023-12-26 15:13:23,741][123090] Updated weights for policy 1, policy_version 1944629 (0.0010) [2023-12-26 15:13:23,755][123091] Updated weights for policy 0, policy_version 1954953 (0.0006) [2023-12-26 15:13:23,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17716.9). Total num frames: 998768640. Throughput: 0: 8862.0, 1: 8887.9. Samples: 998750964. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:23,785][121949] Avg episode reward: [(0, '6246.390'), (1, '5754.688')] [2023-12-26 15:13:23,789][123090] Updated weights for policy 1, policy_version 1944639 (0.0010) [2023-12-26 15:13:23,794][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001944640_497827840.pth... [2023-12-26 15:13:23,799][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001943616_497565696.pth [2023-12-26 15:13:23,816][123091] Updated weights for policy 0, policy_version 1954963 (0.0005) [2023-12-26 15:13:23,850][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:23,851][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954968_500957184.pth... [2023-12-26 15:13:23,856][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954440_500686848.pth [2023-12-26 15:13:24,552][123091] Updated weights for policy 0, policy_version 1954973 (0.0005) [2023-12-26 15:13:24,603][123091] Updated weights for policy 0, policy_version 1954983 (0.0009) [2023-12-26 15:13:24,605][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:24,624][123090] Updated weights for policy 1, policy_version 1944649 (0.0010) [2023-12-26 15:13:24,690][123090] Updated weights for policy 1, policy_version 1944659 (0.0010) [2023-12-26 15:13:24,747][123090] Updated weights for policy 1, policy_version 1944669 (0.0010) [2023-12-26 15:13:25,396][123091] Updated weights for policy 0, policy_version 1954993 (0.0006) [2023-12-26 15:13:25,434][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:25,474][123090] Updated weights for policy 1, policy_version 1944679 (0.0007) [2023-12-26 15:13:25,543][123090] Updated weights for policy 1, policy_version 1944689 (0.0006) [2023-12-26 15:13:25,593][123090] Updated weights for policy 1, policy_version 1944699 (0.0005) [2023-12-26 15:13:26,088][123091] Updated weights for policy 0, policy_version 1955003 (0.0005) [2023-12-26 15:13:26,152][123091] Updated weights for policy 0, policy_version 1955013 (0.0005) [2023-12-26 15:13:26,167][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:26,236][123090] Updated weights for policy 1, policy_version 1944709 (0.0005) [2023-12-26 15:13:26,299][123090] Updated weights for policy 1, policy_version 1944719 (0.0005) [2023-12-26 15:13:26,351][123090] Updated weights for policy 1, policy_version 1944729 (0.0005) [2023-12-26 15:13:26,933][123091] Updated weights for policy 0, policy_version 1955023 (0.0005) [2023-12-26 15:13:26,980][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:27,015][123090] Updated weights for policy 1, policy_version 1944739 (0.0005) [2023-12-26 15:13:27,067][123090] Updated weights for policy 1, policy_version 1944749 (0.0005) [2023-12-26 15:13:27,113][123090] Updated weights for policy 1, policy_version 1944759 (0.0005) [2023-12-26 15:13:27,679][123091] Updated weights for policy 0, policy_version 1955033 (0.0005) [2023-12-26 15:13:27,740][123091] Updated weights for policy 0, policy_version 1955043 (0.0010) [2023-12-26 15:13:27,768][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:27,803][123090] Updated weights for policy 1, policy_version 1944769 (0.0005) [2023-12-26 15:13:27,864][123090] Updated weights for policy 1, policy_version 1944779 (0.0005) [2023-12-26 15:13:27,917][123090] Updated weights for policy 1, policy_version 1944789 (0.0008) [2023-12-26 15:13:27,975][123090] Updated weights for policy 1, policy_version 1944799 (0.0010) [2023-12-26 15:13:28,627][123091] Updated weights for policy 0, policy_version 1955053 (0.0011) [2023-12-26 15:13:28,676][123091] Updated weights for policy 0, policy_version 1955063 (0.0010) [2023-12-26 15:13:28,678][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:28,728][123090] Updated weights for policy 1, policy_version 1944809 (0.0011) [2023-12-26 15:13:28,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 998875136. Throughput: 0: 9014.1, 1: 8938.9. Samples: 998868328. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:28,785][121949] Avg episode reward: [(0, '6203.587'), (1, '5631.764')] [2023-12-26 15:13:28,789][123090] Updated weights for policy 1, policy_version 1944819 (0.0009) [2023-12-26 15:13:28,854][123090] Updated weights for policy 1, policy_version 1944829 (0.0009) [2023-12-26 15:13:29,598][123091] Updated weights for policy 0, policy_version 1955073 (0.0006) [2023-12-26 15:13:29,632][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:29,709][123090] Updated weights for policy 1, policy_version 1944839 (0.0010) [2023-12-26 15:13:29,776][123090] Updated weights for policy 1, policy_version 1944849 (0.0010) [2023-12-26 15:13:29,835][123090] Updated weights for policy 1, policy_version 1944859 (0.0010) [2023-12-26 15:13:30,324][123091] Updated weights for policy 0, policy_version 1955083 (0.0006) [2023-12-26 15:13:30,393][123091] Updated weights for policy 0, policy_version 1955093 (0.0006) [2023-12-26 15:13:30,410][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:30,657][123090] Updated weights for policy 1, policy_version 1944869 (0.0008) [2023-12-26 15:13:30,728][123090] Updated weights for policy 1, policy_version 1944879 (0.0010) [2023-12-26 15:13:30,793][123090] Updated weights for policy 1, policy_version 1944889 (0.0008) [2023-12-26 15:13:31,179][123091] Updated weights for policy 0, policy_version 1955103 (0.0007) [2023-12-26 15:13:31,245][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:31,530][123090] Updated weights for policy 1, policy_version 1944899 (0.0007) [2023-12-26 15:13:31,584][123090] Updated weights for policy 1, policy_version 1944909 (0.0009) [2023-12-26 15:13:31,645][123090] Updated weights for policy 1, policy_version 1944919 (0.0009) [2023-12-26 15:13:32,040][123091] Updated weights for policy 0, policy_version 1955113 (0.0006) [2023-12-26 15:13:32,110][123091] Updated weights for policy 0, policy_version 1955123 (0.0010) [2023-12-26 15:13:32,142][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:32,487][123090] Updated weights for policy 1, policy_version 1944929 (0.0010) [2023-12-26 15:13:32,561][123090] Updated weights for policy 1, policy_version 1944939 (0.0008) [2023-12-26 15:13:32,618][123090] Updated weights for policy 1, policy_version 1944949 (0.0005) [2023-12-26 15:13:32,672][123090] Updated weights for policy 1, policy_version 1944959 (0.0005) [2023-12-26 15:13:33,078][123091] Updated weights for policy 0, policy_version 1955133 (0.0010) [2023-12-26 15:13:33,130][123091] Updated weights for policy 0, policy_version 1955143 (0.0010) [2023-12-26 15:13:33,133][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:33,377][123090] Updated weights for policy 1, policy_version 1944969 (0.0008) [2023-12-26 15:13:33,426][123090] Updated weights for policy 1, policy_version 1944979 (0.0009) [2023-12-26 15:13:33,481][123090] Updated weights for policy 1, policy_version 1944991 (0.0011) [2023-12-26 15:13:33,784][121949] Fps is (10 sec: 19660.8, 60 sec: 18022.3, 300 sec: 17772.5). Total num frames: 998965248. Throughput: 0: 9073.4, 1: 8797.7. Samples: 998974832. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:33,785][121949] Avg episode reward: [(0, '6349.924'), (1, '5656.315')] [2023-12-26 15:13:33,876][123091] Updated weights for policy 0, policy_version 1955153 (0.0006) [2023-12-26 15:13:33,914][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:34,413][123090] Updated weights for policy 1, policy_version 1945001 (0.0008) [2023-12-26 15:13:34,480][123090] Updated weights for policy 1, policy_version 1945011 (0.0007) [2023-12-26 15:13:34,546][123090] Updated weights for policy 1, policy_version 1945021 (0.0006) [2023-12-26 15:13:34,774][123091] Updated weights for policy 0, policy_version 1955163 (0.0007) [2023-12-26 15:13:34,832][123091] Updated weights for policy 0, policy_version 1955173 (0.0009) [2023-12-26 15:13:34,849][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:35,318][123090] Updated weights for policy 1, policy_version 1945031 (0.0008) [2023-12-26 15:13:35,378][123090] Updated weights for policy 1, policy_version 1945041 (0.0009) [2023-12-26 15:13:35,431][123090] Updated weights for policy 1, policy_version 1945051 (0.0009) [2023-12-26 15:13:35,721][123091] Updated weights for policy 0, policy_version 1955183 (0.0009) [2023-12-26 15:13:35,773][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:36,229][123090] Updated weights for policy 1, policy_version 1945061 (0.0009) [2023-12-26 15:13:36,297][123090] Updated weights for policy 1, policy_version 1945071 (0.0010) [2023-12-26 15:13:36,361][123090] Updated weights for policy 1, policy_version 1945081 (0.0010) [2023-12-26 15:13:36,659][123091] Updated weights for policy 0, policy_version 1955193 (0.0007) [2023-12-26 15:13:36,733][123091] Updated weights for policy 0, policy_version 1955203 (0.0006) [2023-12-26 15:13:36,767][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:37,255][123090] Updated weights for policy 1, policy_version 1945091 (0.0009) [2023-12-26 15:13:37,311][123090] Updated weights for policy 1, policy_version 1945101 (0.0005) [2023-12-26 15:13:37,359][123090] Updated weights for policy 1, policy_version 1945111 (0.0007) [2023-12-26 15:13:37,436][123091] Updated weights for policy 0, policy_version 1955213 (0.0005) [2023-12-26 15:13:37,491][123091] Updated weights for policy 0, policy_version 1955223 (0.0005) [2023-12-26 15:13:37,496][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:38,229][123091] Updated weights for policy 0, policy_version 1955233 (0.0009) [2023-12-26 15:13:38,259][123090] Updated weights for policy 1, policy_version 1945121 (0.0009) [2023-12-26 15:13:38,264][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:38,330][123090] Updated weights for policy 1, policy_version 1945131 (0.0005) [2023-12-26 15:13:38,402][123090] Updated weights for policy 1, policy_version 1945141 (0.0006) [2023-12-26 15:13:38,471][123090] Updated weights for policy 1, policy_version 1945151 (0.0010) [2023-12-26 15:13:38,784][121949] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17800.2). Total num frames: 999055360. Throughput: 0: 9105.8, 1: 8810.3. Samples: 999028516. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:38,785][121949] Avg episode reward: [(0, '6266.710'), (1, '5705.391')] [2023-12-26 15:13:38,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955240_501096448.pth... [2023-12-26 15:13:38,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001945152_497958912.pth... [2023-12-26 15:13:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954696_500817920.pth [2023-12-26 15:13:38,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001944128_497696768.pth [2023-12-26 15:13:39,033][123091] Updated weights for policy 0, policy_version 1955243 (0.0009) [2023-12-26 15:13:39,100][123091] Updated weights for policy 0, policy_version 1955253 (0.0009) [2023-12-26 15:13:39,114][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:39,282][123090] Updated weights for policy 1, policy_version 1945161 (0.0008) [2023-12-26 15:13:39,359][123090] Updated weights for policy 1, policy_version 1945171 (0.0008) [2023-12-26 15:13:39,442][123090] Updated weights for policy 1, policy_version 1945181 (0.0008) [2023-12-26 15:13:40,027][123091] Updated weights for policy 0, policy_version 1955263 (0.0009) [2023-12-26 15:13:40,084][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:40,220][123090] Updated weights for policy 1, policy_version 1945191 (0.0010) [2023-12-26 15:13:40,291][123090] Updated weights for policy 1, policy_version 1945201 (0.0009) [2023-12-26 15:13:40,355][123090] Updated weights for policy 1, policy_version 1945212 (0.0010) [2023-12-26 15:13:40,891][123091] Updated weights for policy 0, policy_version 1955273 (0.0009) [2023-12-26 15:13:40,952][123091] Updated weights for policy 0, policy_version 1955283 (0.0005) [2023-12-26 15:13:40,974][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:41,186][123090] Updated weights for policy 1, policy_version 1945222 (0.0010) [2023-12-26 15:13:41,265][123090] Updated weights for policy 1, policy_version 1945232 (0.0009) [2023-12-26 15:13:41,331][123090] Updated weights for policy 1, policy_version 1945242 (0.0008) [2023-12-26 15:13:41,802][123091] Updated weights for policy 0, policy_version 1955293 (0.0007) [2023-12-26 15:13:41,857][123091] Updated weights for policy 0, policy_version 1955303 (0.0009) [2023-12-26 15:13:41,858][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:42,148][123090] Updated weights for policy 1, policy_version 1945252 (0.0009) [2023-12-26 15:13:42,206][123090] Updated weights for policy 1, policy_version 1945262 (0.0010) [2023-12-26 15:13:42,269][123090] Updated weights for policy 1, policy_version 1945272 (0.0012) [2023-12-26 15:13:42,761][123091] Updated weights for policy 0, policy_version 1955313 (0.0006) [2023-12-26 15:13:42,803][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:43,143][123090] Updated weights for policy 1, policy_version 1945282 (0.0009) [2023-12-26 15:13:43,211][123090] Updated weights for policy 1, policy_version 1945292 (0.0009) [2023-12-26 15:13:43,272][123090] Updated weights for policy 1, policy_version 1945302 (0.0007) [2023-12-26 15:13:43,340][123090] Updated weights for policy 1, policy_version 1945312 (0.0006) [2023-12-26 15:13:43,572][123091] Updated weights for policy 0, policy_version 1955323 (0.0007) [2023-12-26 15:13:43,624][123091] Updated weights for policy 0, policy_version 1955333 (0.0009) [2023-12-26 15:13:43,639][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:43,784][121949] Fps is (10 sec: 18022.6, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 999145472. Throughput: 0: 9231.0, 1: 8726.0. Samples: 999134976. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:43,785][121949] Avg episode reward: [(0, '6215.525'), (1, '5792.170')] [2023-12-26 15:13:44,000][123090] Updated weights for policy 1, policy_version 1945322 (0.0005) [2023-12-26 15:13:44,074][123090] Updated weights for policy 1, policy_version 1945332 (0.0005) [2023-12-26 15:13:44,144][123090] Updated weights for policy 1, policy_version 1945342 (0.0005) [2023-12-26 15:13:44,537][123091] Updated weights for policy 0, policy_version 1955343 (0.0009) [2023-12-26 15:13:44,587][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:44,857][123090] Updated weights for policy 1, policy_version 1945352 (0.0008) [2023-12-26 15:13:44,915][123090] Updated weights for policy 1, policy_version 1945362 (0.0009) [2023-12-26 15:13:44,982][123090] Updated weights for policy 1, policy_version 1945372 (0.0008) [2023-12-26 15:13:45,468][123091] Updated weights for policy 0, policy_version 1955353 (0.0010) [2023-12-26 15:13:45,535][123091] Updated weights for policy 0, policy_version 1955363 (0.0009) [2023-12-26 15:13:45,562][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:45,814][123090] Updated weights for policy 1, policy_version 1945382 (0.0010) [2023-12-26 15:13:45,873][123090] Updated weights for policy 1, policy_version 1945392 (0.0010) [2023-12-26 15:13:45,924][123090] Updated weights for policy 1, policy_version 1945402 (0.0010) [2023-12-26 15:13:46,439][123091] Updated weights for policy 0, policy_version 1955373 (0.0009) [2023-12-26 15:13:46,488][123091] Updated weights for policy 0, policy_version 1955383 (0.0009) [2023-12-26 15:13:46,491][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:46,748][123090] Updated weights for policy 1, policy_version 1945412 (0.0010) [2023-12-26 15:13:46,799][123090] Updated weights for policy 1, policy_version 1945422 (0.0010) [2023-12-26 15:13:46,851][123090] Updated weights for policy 1, policy_version 1945432 (0.0010) [2023-12-26 15:13:47,394][123091] Updated weights for policy 0, policy_version 1955393 (0.0009) [2023-12-26 15:13:47,432][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:47,699][123090] Updated weights for policy 1, policy_version 1945442 (0.0010) [2023-12-26 15:13:47,747][123090] Updated weights for policy 1, policy_version 1945452 (0.0010) [2023-12-26 15:13:47,798][123090] Updated weights for policy 1, policy_version 1945462 (0.0010) [2023-12-26 15:13:47,852][123090] Updated weights for policy 1, policy_version 1945472 (0.0010) [2023-12-26 15:13:48,289][123091] Updated weights for policy 0, policy_version 1955403 (0.0008) [2023-12-26 15:13:48,357][123091] Updated weights for policy 0, policy_version 1955413 (0.0009) [2023-12-26 15:13:48,377][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:48,752][123090] Updated weights for policy 1, policy_version 1945482 (0.0010) [2023-12-26 15:13:48,784][121949] Fps is (10 sec: 17203.7, 60 sec: 17885.9, 300 sec: 17800.3). Total num frames: 999227392. Throughput: 0: 9242.3, 1: 8720.6. Samples: 999241256. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:48,785][121949] Avg episode reward: [(0, '6270.836'), (1, '5903.664')] [2023-12-26 15:13:48,808][123090] Updated weights for policy 1, policy_version 1945492 (0.0010) [2023-12-26 15:13:48,860][123090] Updated weights for policy 1, policy_version 1945502 (0.0008) [2023-12-26 15:13:49,292][123091] Updated weights for policy 0, policy_version 1955423 (0.0009) [2023-12-26 15:13:49,351][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:49,727][123090] Updated weights for policy 1, policy_version 1945512 (0.0011) [2023-12-26 15:13:49,783][123090] Updated weights for policy 1, policy_version 1945522 (0.0009) [2023-12-26 15:13:49,854][123090] Updated weights for policy 1, policy_version 1945532 (0.0011) [2023-12-26 15:13:50,091][123091] Updated weights for policy 0, policy_version 1955433 (0.0009) [2023-12-26 15:13:50,152][123091] Updated weights for policy 0, policy_version 1955443 (0.0010) [2023-12-26 15:13:50,176][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:50,625][123090] Updated weights for policy 1, policy_version 1945542 (0.0009) [2023-12-26 15:13:50,681][123090] Updated weights for policy 1, policy_version 1945552 (0.0009) [2023-12-26 15:13:50,750][123090] Updated weights for policy 1, policy_version 1945562 (0.0008) [2023-12-26 15:13:51,070][123091] Updated weights for policy 0, policy_version 1955453 (0.0007) [2023-12-26 15:13:51,137][123091] Updated weights for policy 0, policy_version 1955463 (0.0007) [2023-12-26 15:13:51,143][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:51,631][123090] Updated weights for policy 1, policy_version 1945572 (0.0010) [2023-12-26 15:13:51,695][123090] Updated weights for policy 1, policy_version 1945582 (0.0009) [2023-12-26 15:13:51,768][123090] Updated weights for policy 1, policy_version 1945592 (0.0010) [2023-12-26 15:13:52,045][123091] Updated weights for policy 0, policy_version 1955473 (0.0008) [2023-12-26 15:13:52,087][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:52,519][123090] Updated weights for policy 1, policy_version 1945602 (0.0010) [2023-12-26 15:13:52,571][123090] Updated weights for policy 1, policy_version 1945612 (0.0006) [2023-12-26 15:13:52,618][123090] Updated weights for policy 1, policy_version 1945622 (0.0005) [2023-12-26 15:13:52,681][123090] Updated weights for policy 1, policy_version 1945632 (0.0005) [2023-12-26 15:13:52,879][123091] Updated weights for policy 0, policy_version 1955483 (0.0006) [2023-12-26 15:13:52,949][123091] Updated weights for policy 0, policy_version 1955493 (0.0005) [2023-12-26 15:13:52,963][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:53,471][123090] Updated weights for policy 1, policy_version 1945642 (0.0010) [2023-12-26 15:13:53,537][123090] Updated weights for policy 1, policy_version 1945652 (0.0010) [2023-12-26 15:13:53,600][123090] Updated weights for policy 1, policy_version 1945662 (0.0011) [2023-12-26 15:13:53,610][123091] Updated weights for policy 0, policy_version 1955503 (0.0009) [2023-12-26 15:13:53,663][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:53,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 999325696. Throughput: 0: 9206.8, 1: 8650.6. Samples: 999292992. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:53,784][121949] Avg episode reward: [(0, '6224.489'), (1, '5845.593')] [2023-12-26 15:13:53,792][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955512_501235712.pth... [2023-12-26 15:13:53,792][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001945664_498089984.pth... [2023-12-26 15:13:53,797][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001944640_497827840.pth [2023-12-26 15:13:53,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001954968_500957184.pth [2023-12-26 15:13:53,797][123008] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/milestones/checkpoint_001945664_498089984.pth [2023-12-26 15:13:53,797][123007] Saving a milestone ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/milestones/checkpoint_001955512_501235712.pth [2023-12-26 15:13:54,428][123090] Updated weights for policy 1, policy_version 1945672 (0.0011) [2023-12-26 15:13:54,449][123091] Updated weights for policy 0, policy_version 1955513 (0.0010) [2023-12-26 15:13:54,483][123090] Updated weights for policy 1, policy_version 1945682 (0.0010) [2023-12-26 15:13:54,502][123091] Updated weights for policy 0, policy_version 1955523 (0.0005) [2023-12-26 15:13:54,530][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:54,531][123090] Updated weights for policy 1, policy_version 1945692 (0.0010) [2023-12-26 15:13:55,365][123090] Updated weights for policy 1, policy_version 1945702 (0.0010) [2023-12-26 15:13:55,396][123091] Updated weights for policy 0, policy_version 1955533 (0.0009) [2023-12-26 15:13:55,433][123090] Updated weights for policy 1, policy_version 1945712 (0.0011) [2023-12-26 15:13:55,453][123091] Updated weights for policy 0, policy_version 1955543 (0.0011) [2023-12-26 15:13:55,459][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:55,493][123090] Updated weights for policy 1, policy_version 1945722 (0.0010) [2023-12-26 15:13:56,224][123090] Updated weights for policy 1, policy_version 1945732 (0.0008) [2023-12-26 15:13:56,271][123090] Updated weights for policy 1, policy_version 1945742 (0.0005) [2023-12-26 15:13:56,327][123090] Updated weights for policy 1, policy_version 1945752 (0.0005) [2023-12-26 15:13:56,378][123091] Updated weights for policy 0, policy_version 1955553 (0.0009) [2023-12-26 15:13:56,413][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:57,016][123090] Updated weights for policy 1, policy_version 1945762 (0.0005) [2023-12-26 15:13:57,066][123090] Updated weights for policy 1, policy_version 1945772 (0.0005) [2023-12-26 15:13:57,117][123090] Updated weights for policy 1, policy_version 1945782 (0.0005) [2023-12-26 15:13:57,174][123090] Updated weights for policy 1, policy_version 1945792 (0.0006) [2023-12-26 15:13:57,336][123091] Updated weights for policy 0, policy_version 1955563 (0.0010) [2023-12-26 15:13:57,389][123091] Updated weights for policy 0, policy_version 1955573 (0.0009) [2023-12-26 15:13:57,402][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:57,981][123090] Updated weights for policy 1, policy_version 1945802 (0.0010) [2023-12-26 15:13:58,050][123090] Updated weights for policy 1, policy_version 1945812 (0.0010) [2023-12-26 15:13:58,118][123090] Updated weights for policy 1, policy_version 1945822 (0.0010) [2023-12-26 15:13:58,258][123091] Updated weights for policy 0, policy_version 1955583 (0.0008) [2023-12-26 15:13:58,322][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 999407616. Throughput: 0: 9244.8, 1: 8754.2. Samples: 999402320. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:13:58,785][121949] Avg episode reward: [(0, '6176.449'), (1, '5723.239')] [2023-12-26 15:13:59,016][123090] Updated weights for policy 1, policy_version 1945832 (0.0009) [2023-12-26 15:13:59,085][123090] Updated weights for policy 1, policy_version 1945842 (0.0008) [2023-12-26 15:13:59,156][123090] Updated weights for policy 1, policy_version 1945852 (0.0007) [2023-12-26 15:13:59,232][123091] Updated weights for policy 0, policy_version 1955593 (0.0008) [2023-12-26 15:13:59,302][123091] Updated weights for policy 0, policy_version 1955603 (0.0007) [2023-12-26 15:13:59,339][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:13:59,868][123090] Updated weights for policy 1, policy_version 1945862 (0.0007) [2023-12-26 15:13:59,920][123090] Updated weights for policy 1, policy_version 1945872 (0.0006) [2023-12-26 15:13:59,994][123090] Updated weights for policy 1, policy_version 1945882 (0.0008) [2023-12-26 15:14:00,125][123091] Updated weights for policy 0, policy_version 1955613 (0.0008) [2023-12-26 15:14:00,185][123091] Updated weights for policy 0, policy_version 1955623 (0.0008) [2023-12-26 15:14:00,190][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:00,723][123090] Updated weights for policy 1, policy_version 1945892 (0.0006) [2023-12-26 15:14:00,795][123090] Updated weights for policy 1, policy_version 1945902 (0.0005) [2023-12-26 15:14:00,857][123090] Updated weights for policy 1, policy_version 1945912 (0.0005) [2023-12-26 15:14:01,070][123091] Updated weights for policy 0, policy_version 1955633 (0.0008) [2023-12-26 15:14:01,108][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:01,633][123090] Updated weights for policy 1, policy_version 1945922 (0.0006) [2023-12-26 15:14:01,701][123090] Updated weights for policy 1, policy_version 1945932 (0.0008) [2023-12-26 15:14:01,768][123090] Updated weights for policy 1, policy_version 1945942 (0.0007) [2023-12-26 15:14:01,826][123090] Updated weights for policy 1, policy_version 1945952 (0.0005) [2023-12-26 15:14:01,961][123091] Updated weights for policy 0, policy_version 1955643 (0.0008) [2023-12-26 15:14:02,018][123091] Updated weights for policy 0, policy_version 1955653 (0.0006) [2023-12-26 15:14:02,041][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:02,453][123090] Updated weights for policy 1, policy_version 1945962 (0.0007) [2023-12-26 15:14:02,513][123090] Updated weights for policy 1, policy_version 1945972 (0.0009) [2023-12-26 15:14:02,567][123090] Updated weights for policy 1, policy_version 1945982 (0.0009) [2023-12-26 15:14:02,830][123091] Updated weights for policy 0, policy_version 1955663 (0.0008) [2023-12-26 15:14:02,893][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:03,293][123090] Updated weights for policy 1, policy_version 1945992 (0.0006) [2023-12-26 15:14:03,352][123090] Updated weights for policy 1, policy_version 1946002 (0.0009) [2023-12-26 15:14:03,420][123090] Updated weights for policy 1, policy_version 1946013 (0.0008) [2023-12-26 15:14:03,731][123091] Updated weights for policy 0, policy_version 1955673 (0.0010) [2023-12-26 15:14:03,784][121949] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 17772.5). Total num frames: 999497728. Throughput: 0: 9183.5, 1: 8825.8. Samples: 999511360. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:03,785][121949] Avg episode reward: [(0, '6258.767'), (1, '5772.506')] [2023-12-26 15:14:03,801][123091] Updated weights for policy 0, policy_version 1955683 (0.0005) [2023-12-26 15:14:03,827][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:04,152][123090] Updated weights for policy 1, policy_version 1946023 (0.0007) [2023-12-26 15:14:04,219][123090] Updated weights for policy 1, policy_version 1946033 (0.0008) [2023-12-26 15:14:04,285][123090] Updated weights for policy 1, policy_version 1946043 (0.0010) [2023-12-26 15:14:04,527][123091] Updated weights for policy 0, policy_version 1955694 (0.0008) [2023-12-26 15:14:04,574][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:04,577][123091] Updated weights for policy 0, policy_version 1955704 (0.0009) [2023-12-26 15:14:05,080][123090] Updated weights for policy 1, policy_version 1946053 (0.0011) [2023-12-26 15:14:05,135][123090] Updated weights for policy 1, policy_version 1946063 (0.0010) [2023-12-26 15:14:05,193][123090] Updated weights for policy 1, policy_version 1946073 (0.0010) [2023-12-26 15:14:05,482][123091] Updated weights for policy 0, policy_version 1955714 (0.0005) [2023-12-26 15:14:05,524][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:05,979][123090] Updated weights for policy 1, policy_version 1946083 (0.0009) [2023-12-26 15:14:06,050][123090] Updated weights for policy 1, policy_version 1946093 (0.0008) [2023-12-26 15:14:06,121][123090] Updated weights for policy 1, policy_version 1946103 (0.0008) [2023-12-26 15:14:06,305][123091] Updated weights for policy 0, policy_version 1955724 (0.0006) [2023-12-26 15:14:06,373][123091] Updated weights for policy 0, policy_version 1955734 (0.0006) [2023-12-26 15:14:06,384][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:06,896][123090] Updated weights for policy 1, policy_version 1946113 (0.0006) [2023-12-26 15:14:06,955][123090] Updated weights for policy 1, policy_version 1946123 (0.0010) [2023-12-26 15:14:07,020][123090] Updated weights for policy 1, policy_version 1946133 (0.0009) [2023-12-26 15:14:07,079][123090] Updated weights for policy 1, policy_version 1946143 (0.0009) [2023-12-26 15:14:07,091][123091] Updated weights for policy 0, policy_version 1955744 (0.0006) [2023-12-26 15:14:07,130][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:07,933][123091] Updated weights for policy 0, policy_version 1955754 (0.0005) [2023-12-26 15:14:07,979][123090] Updated weights for policy 1, policy_version 1946153 (0.0009) [2023-12-26 15:14:07,981][123091] Updated weights for policy 0, policy_version 1955764 (0.0005) [2023-12-26 15:14:07,998][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:08,044][123090] Updated weights for policy 1, policy_version 1946163 (0.0010) [2023-12-26 15:14:08,095][123090] Updated weights for policy 1, policy_version 1946173 (0.0009) [2023-12-26 15:14:08,784][121949] Fps is (10 sec: 18022.0, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 999587840. Throughput: 0: 9245.7, 1: 8894.7. Samples: 999567280. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:08,785][121949] Avg episode reward: [(0, '6272.471'), (1, '5871.601')] [2023-12-26 15:14:08,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955768_501366784.pth... [2023-12-26 15:14:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001946176_498221056.pth... [2023-12-26 15:14:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001945152_497958912.pth [2023-12-26 15:14:08,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955240_501096448.pth [2023-12-26 15:14:08,876][123091] Updated weights for policy 0, policy_version 1955774 (0.0007) [2023-12-26 15:14:08,936][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:08,938][123091] Updated weights for policy 0, policy_version 1955784 (0.0011) [2023-12-26 15:14:08,968][123090] Updated weights for policy 1, policy_version 1946183 (0.0009) [2023-12-26 15:14:09,034][123090] Updated weights for policy 1, policy_version 1946193 (0.0009) [2023-12-26 15:14:09,099][123090] Updated weights for policy 1, policy_version 1946203 (0.0009) [2023-12-26 15:14:09,803][123091] Updated weights for policy 0, policy_version 1955794 (0.0009) [2023-12-26 15:14:09,847][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:09,861][123090] Updated weights for policy 1, policy_version 1946213 (0.0008) [2023-12-26 15:14:09,924][123090] Updated weights for policy 1, policy_version 1946223 (0.0009) [2023-12-26 15:14:09,997][123090] Updated weights for policy 1, policy_version 1946233 (0.0008) [2023-12-26 15:14:10,736][123090] Updated weights for policy 1, policy_version 1946243 (0.0009) [2023-12-26 15:14:10,770][123091] Updated weights for policy 0, policy_version 1955804 (0.0012) [2023-12-26 15:14:10,803][123090] Updated weights for policy 1, policy_version 1946253 (0.0011) [2023-12-26 15:14:10,829][123091] Updated weights for policy 0, policy_version 1955814 (0.0008) [2023-12-26 15:14:10,835][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:10,867][123090] Updated weights for policy 1, policy_version 1946263 (0.0009) [2023-12-26 15:14:11,698][123091] Updated weights for policy 0, policy_version 1955824 (0.0008) [2023-12-26 15:14:11,712][123090] Updated weights for policy 1, policy_version 1946273 (0.0006) [2023-12-26 15:14:11,756][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:11,781][123090] Updated weights for policy 1, policy_version 1946283 (0.0009) [2023-12-26 15:14:11,844][123090] Updated weights for policy 1, policy_version 1946293 (0.0009) [2023-12-26 15:14:11,907][123090] Updated weights for policy 1, policy_version 1946303 (0.0009) [2023-12-26 15:14:12,573][123091] Updated weights for policy 0, policy_version 1955834 (0.0009) [2023-12-26 15:14:12,642][123091] Updated weights for policy 0, policy_version 1955844 (0.0006) [2023-12-26 15:14:12,663][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:12,809][123090] Updated weights for policy 1, policy_version 1946313 (0.0009) [2023-12-26 15:14:12,867][123090] Updated weights for policy 1, policy_version 1946323 (0.0009) [2023-12-26 15:14:12,928][123090] Updated weights for policy 1, policy_version 1946333 (0.0009) [2023-12-26 15:14:13,531][123091] Updated weights for policy 0, policy_version 1955854 (0.0009) [2023-12-26 15:14:13,576][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:13,580][123091] Updated weights for policy 0, policy_version 1955864 (0.0009) [2023-12-26 15:14:13,762][123090] Updated weights for policy 1, policy_version 1946343 (0.0009) [2023-12-26 15:14:13,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17800.2). Total num frames: 999677952. Throughput: 0: 9114.8, 1: 8737.3. Samples: 999671676. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:13,785][121949] Avg episode reward: [(0, '6325.309'), (1, '5820.686')] [2023-12-26 15:14:13,833][123090] Updated weights for policy 1, policy_version 1946353 (0.0010) [2023-12-26 15:14:13,891][123090] Updated weights for policy 1, policy_version 1946363 (0.0010) [2023-12-26 15:14:14,502][123091] Updated weights for policy 0, policy_version 1955874 (0.0009) [2023-12-26 15:14:14,537][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:14,653][123090] Updated weights for policy 1, policy_version 1946373 (0.0009) [2023-12-26 15:14:14,704][123090] Updated weights for policy 1, policy_version 1946383 (0.0009) [2023-12-26 15:14:14,766][123090] Updated weights for policy 1, policy_version 1946393 (0.0009) [2023-12-26 15:14:15,368][123091] Updated weights for policy 0, policy_version 1955884 (0.0010) [2023-12-26 15:14:15,446][123091] Updated weights for policy 0, policy_version 1955894 (0.0009) [2023-12-26 15:14:15,459][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:15,551][123090] Updated weights for policy 1, policy_version 1946403 (0.0009) [2023-12-26 15:14:15,606][123090] Updated weights for policy 1, policy_version 1946413 (0.0005) [2023-12-26 15:14:15,652][123090] Updated weights for policy 1, policy_version 1946423 (0.0005) [2023-12-26 15:14:16,228][123091] Updated weights for policy 0, policy_version 1955904 (0.0010) [2023-12-26 15:14:16,270][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:16,345][123090] Updated weights for policy 1, policy_version 1946433 (0.0005) [2023-12-26 15:14:16,391][123090] Updated weights for policy 1, policy_version 1946443 (0.0005) [2023-12-26 15:14:16,447][123090] Updated weights for policy 1, policy_version 1946453 (0.0008) [2023-12-26 15:14:16,506][123090] Updated weights for policy 1, policy_version 1946463 (0.0010) [2023-12-26 15:14:17,130][123091] Updated weights for policy 0, policy_version 1955914 (0.0008) [2023-12-26 15:14:17,184][123091] Updated weights for policy 0, policy_version 1955924 (0.0005) [2023-12-26 15:14:17,208][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:17,260][123090] Updated weights for policy 1, policy_version 1946473 (0.0010) [2023-12-26 15:14:17,323][123090] Updated weights for policy 1, policy_version 1946483 (0.0008) [2023-12-26 15:14:17,381][123090] Updated weights for policy 1, policy_version 1946493 (0.0008) [2023-12-26 15:14:17,911][123091] Updated weights for policy 0, policy_version 1955934 (0.0006) [2023-12-26 15:14:17,971][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:17,972][123091] Updated weights for policy 0, policy_version 1955944 (0.0005) [2023-12-26 15:14:18,213][123090] Updated weights for policy 1, policy_version 1946504 (0.0010) [2023-12-26 15:14:18,266][123090] Updated weights for policy 1, policy_version 1946514 (0.0010) [2023-12-26 15:14:18,349][123090] Updated weights for policy 1, policy_version 1946525 (0.0010) [2023-12-26 15:14:18,740][123091] Updated weights for policy 0, policy_version 1955954 (0.0010) [2023-12-26 15:14:18,775][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:18,784][121949] Fps is (10 sec: 18842.1, 60 sec: 18158.9, 300 sec: 17828.0). Total num frames: 999776256. Throughput: 0: 9154.3, 1: 8788.1. Samples: 999782232. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:18,785][121949] Avg episode reward: [(0, '6301.000'), (1, '5936.866')] [2023-12-26 15:14:19,262][123090] Updated weights for policy 1, policy_version 1946535 (0.0008) [2023-12-26 15:14:19,318][123090] Updated weights for policy 1, policy_version 1946545 (0.0008) [2023-12-26 15:14:19,391][123090] Updated weights for policy 1, policy_version 1946555 (0.0008) [2023-12-26 15:14:19,560][123091] Updated weights for policy 0, policy_version 1955964 (0.0009) [2023-12-26 15:14:19,632][123091] Updated weights for policy 0, policy_version 1955974 (0.0008) [2023-12-26 15:14:19,642][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:20,220][123090] Updated weights for policy 1, policy_version 1946565 (0.0008) [2023-12-26 15:14:20,270][123090] Updated weights for policy 1, policy_version 1946575 (0.0009) [2023-12-26 15:14:20,333][123090] Updated weights for policy 1, policy_version 1946585 (0.0009) [2023-12-26 15:14:20,551][123091] Updated weights for policy 0, policy_version 1955984 (0.0009) [2023-12-26 15:14:20,600][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:21,129][123090] Updated weights for policy 1, policy_version 1946595 (0.0009) [2023-12-26 15:14:21,200][123090] Updated weights for policy 1, policy_version 1946605 (0.0007) [2023-12-26 15:14:21,272][123090] Updated weights for policy 1, policy_version 1946615 (0.0007) [2023-12-26 15:14:21,414][123091] Updated weights for policy 0, policy_version 1955994 (0.0008) [2023-12-26 15:14:21,484][123091] Updated weights for policy 0, policy_version 1956004 (0.0008) [2023-12-26 15:14:21,507][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:22,028][123090] Updated weights for policy 1, policy_version 1946625 (0.0009) [2023-12-26 15:14:22,101][123090] Updated weights for policy 1, policy_version 1946635 (0.0009) [2023-12-26 15:14:22,159][123090] Updated weights for policy 1, policy_version 1946645 (0.0009) [2023-12-26 15:14:22,231][123090] Updated weights for policy 1, policy_version 1946655 (0.0007) [2023-12-26 15:14:22,408][123091] Updated weights for policy 0, policy_version 1956014 (0.0010) [2023-12-26 15:14:22,474][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:22,477][123091] Updated weights for policy 0, policy_version 1956024 (0.0011) [2023-12-26 15:14:22,990][123090] Updated weights for policy 1, policy_version 1946665 (0.0010) [2023-12-26 15:14:23,054][123090] Updated weights for policy 1, policy_version 1946675 (0.0010) [2023-12-26 15:14:23,112][123090] Updated weights for policy 1, policy_version 1946685 (0.0010) [2023-12-26 15:14:23,344][123091] Updated weights for policy 0, policy_version 1956034 (0.0006) [2023-12-26 15:14:23,383][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 18159.0, 300 sec: 17828.0). Total num frames: 999858176. Throughput: 0: 9156.0, 1: 8776.3. Samples: 999835464. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:23,785][121949] Avg episode reward: [(0, '6269.205'), (1, '5898.294')] [2023-12-26 15:14:23,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956040_501506048.pth... [2023-12-26 15:14:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955512_501235712.pth [2023-12-26 15:14:23,804][123090] Updated weights for policy 1, policy_version 1946695 (0.0007) [2023-12-26 15:14:23,856][123090] Updated weights for policy 1, policy_version 1946705 (0.0006) [2023-12-26 15:14:23,921][123090] Updated weights for policy 1, policy_version 1946715 (0.0008) [2023-12-26 15:14:23,948][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001946720_498360320.pth... [2023-12-26 15:14:23,951][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001945664_498089984.pth [2023-12-26 15:14:24,129][123091] Updated weights for policy 0, policy_version 1956044 (0.0009) [2023-12-26 15:14:24,192][123091] Updated weights for policy 0, policy_version 1956054 (0.0010) [2023-12-26 15:14:24,199][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:24,721][123090] Updated weights for policy 1, policy_version 1946725 (0.0010) [2023-12-26 15:14:24,784][123090] Updated weights for policy 1, policy_version 1946735 (0.0010) [2023-12-26 15:14:24,839][123090] Updated weights for policy 1, policy_version 1946745 (0.0010) [2023-12-26 15:14:24,975][123091] Updated weights for policy 0, policy_version 1956064 (0.0006) [2023-12-26 15:14:25,015][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:25,689][123090] Updated weights for policy 1, policy_version 1946755 (0.0010) [2023-12-26 15:14:25,694][123091] Updated weights for policy 0, policy_version 1956074 (0.0006) [2023-12-26 15:14:25,741][123091] Updated weights for policy 0, policy_version 1956084 (0.0005) [2023-12-26 15:14:25,759][123090] Updated weights for policy 1, policy_version 1946765 (0.0006) [2023-12-26 15:14:25,768][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:25,831][123090] Updated weights for policy 1, policy_version 1946775 (0.0006) [2023-12-26 15:14:26,442][123091] Updated weights for policy 0, policy_version 1956094 (0.0007) [2023-12-26 15:14:26,447][123090] Updated weights for policy 1, policy_version 1946785 (0.0005) [2023-12-26 15:14:26,502][123090] Updated weights for policy 1, policy_version 1946795 (0.0005) [2023-12-26 15:14:26,504][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:26,507][123091] Updated weights for policy 0, policy_version 1956104 (0.0008) [2023-12-26 15:14:26,561][123090] Updated weights for policy 1, policy_version 1946805 (0.0005) [2023-12-26 15:14:26,627][123090] Updated weights for policy 1, policy_version 1946815 (0.0005) [2023-12-26 15:14:27,230][123090] Updated weights for policy 1, policy_version 1946825 (0.0005) [2023-12-26 15:14:27,279][123090] Updated weights for policy 1, policy_version 1946835 (0.0008) [2023-12-26 15:14:27,338][123090] Updated weights for policy 1, policy_version 1946845 (0.0010) [2023-12-26 15:14:27,426][123091] Updated weights for policy 0, policy_version 1956114 (0.0006) [2023-12-26 15:14:27,455][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:28,096][123090] Updated weights for policy 1, policy_version 1946855 (0.0007) [2023-12-26 15:14:28,149][123090] Updated weights for policy 1, policy_version 1946865 (0.0005) [2023-12-26 15:14:28,178][123091] Updated weights for policy 0, policy_version 1956124 (0.0006) [2023-12-26 15:14:28,204][123090] Updated weights for policy 1, policy_version 1946875 (0.0005) [2023-12-26 15:14:28,238][123091] Updated weights for policy 0, policy_version 1956134 (0.0005) [2023-12-26 15:14:28,246][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:28,784][121949] Fps is (10 sec: 18022.0, 60 sec: 18022.3, 300 sec: 17828.0). Total num frames: 999956480. Throughput: 0: 9157.8, 1: 8935.9. Samples: 999949192. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:28,785][121949] Avg episode reward: [(0, '6232.559'), (1, '5880.027')] [2023-12-26 15:14:28,920][123090] Updated weights for policy 1, policy_version 1946885 (0.0005) [2023-12-26 15:14:28,977][123090] Updated weights for policy 1, policy_version 1946895 (0.0009) [2023-12-26 15:14:29,039][123090] Updated weights for policy 1, policy_version 1946905 (0.0010) [2023-12-26 15:14:29,144][123091] Updated weights for policy 0, policy_version 1956144 (0.0009) [2023-12-26 15:14:29,188][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:29,797][123090] Updated weights for policy 1, policy_version 1946915 (0.0010) [2023-12-26 15:14:29,866][123090] Updated weights for policy 1, policy_version 1946925 (0.0009) [2023-12-26 15:14:29,935][123090] Updated weights for policy 1, policy_version 1946935 (0.0009) [2023-12-26 15:14:30,051][123091] Updated weights for policy 0, policy_version 1956154 (0.0009) [2023-12-26 15:14:30,106][123091] Updated weights for policy 0, policy_version 1956164 (0.0008) [2023-12-26 15:14:30,128][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:30,757][123090] Updated weights for policy 1, policy_version 1946945 (0.0009) [2023-12-26 15:14:30,812][123090] Updated weights for policy 1, policy_version 1946955 (0.0009) [2023-12-26 15:14:30,877][123090] Updated weights for policy 1, policy_version 1946965 (0.0009) [2023-12-26 15:14:30,950][123090] Updated weights for policy 1, policy_version 1946975 (0.0008) [2023-12-26 15:14:30,999][123091] Updated weights for policy 0, policy_version 1956174 (0.0009) [2023-12-26 15:14:31,062][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:31,063][123091] Updated weights for policy 0, policy_version 1956184 (0.0009) [2023-12-26 15:14:31,779][123090] Updated weights for policy 1, policy_version 1946985 (0.0010) [2023-12-26 15:14:31,833][123090] Updated weights for policy 1, policy_version 1946995 (0.0010) [2023-12-26 15:14:31,904][123090] Updated weights for policy 1, policy_version 1947005 (0.0008) [2023-12-26 15:14:31,930][123091] Updated weights for policy 0, policy_version 1956194 (0.0010) [2023-12-26 15:14:31,960][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:32,778][123091] Updated weights for policy 0, policy_version 1956204 (0.0008) [2023-12-26 15:14:32,810][123090] Updated weights for policy 1, policy_version 1947015 (0.0008) [2023-12-26 15:14:32,830][123091] Updated weights for policy 0, policy_version 1956214 (0.0005) [2023-12-26 15:14:32,841][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:32,879][123090] Updated weights for policy 1, policy_version 1947025 (0.0010) [2023-12-26 15:14:32,941][123090] Updated weights for policy 1, policy_version 1947035 (0.0010) [2023-12-26 15:14:33,518][123091] Updated weights for policy 0, policy_version 1956224 (0.0008) [2023-12-26 15:14:33,551][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:33,778][123090] Updated weights for policy 1, policy_version 1947045 (0.0009) [2023-12-26 15:14:33,784][121949] Fps is (10 sec: 18841.7, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 1000046592. Throughput: 0: 9226.9, 1: 8910.3. Samples: 1000057432. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:33,784][121949] Avg episode reward: [(0, '6213.126'), (1, '5680.089')] [2023-12-26 15:14:33,827][123090] Updated weights for policy 1, policy_version 1947055 (0.0006) [2023-12-26 15:14:33,872][123090] Updated weights for policy 1, policy_version 1947065 (0.0006) [2023-12-26 15:14:34,493][123091] Updated weights for policy 0, policy_version 1956235 (0.0010) [2023-12-26 15:14:34,564][123091] Updated weights for policy 0, policy_version 1956245 (0.0010) [2023-12-26 15:14:34,581][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:34,594][123090] Updated weights for policy 1, policy_version 1947075 (0.0006) [2023-12-26 15:14:34,656][123090] Updated weights for policy 1, policy_version 1947085 (0.0009) [2023-12-26 15:14:34,714][123090] Updated weights for policy 1, policy_version 1947095 (0.0009) [2023-12-26 15:14:35,495][123091] Updated weights for policy 0, policy_version 1956255 (0.0009) [2023-12-26 15:14:35,538][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:35,555][123090] Updated weights for policy 1, policy_version 1947105 (0.0009) [2023-12-26 15:14:35,616][123090] Updated weights for policy 1, policy_version 1947115 (0.0010) [2023-12-26 15:14:35,668][123090] Updated weights for policy 1, policy_version 1947125 (0.0009) [2023-12-26 15:14:35,724][123090] Updated weights for policy 1, policy_version 1947135 (0.0010) [2023-12-26 15:14:36,431][123091] Updated weights for policy 0, policy_version 1956265 (0.0009) [2023-12-26 15:14:36,483][123091] Updated weights for policy 0, policy_version 1956275 (0.0009) [2023-12-26 15:14:36,506][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:36,590][123090] Updated weights for policy 1, policy_version 1947145 (0.0009) [2023-12-26 15:14:36,649][123090] Updated weights for policy 1, policy_version 1947155 (0.0010) [2023-12-26 15:14:36,704][123090] Updated weights for policy 1, policy_version 1947165 (0.0009) [2023-12-26 15:14:37,357][123091] Updated weights for policy 0, policy_version 1956285 (0.0010) [2023-12-26 15:14:37,406][123091] Updated weights for policy 0, policy_version 1956295 (0.0009) [2023-12-26 15:14:37,407][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:37,592][123090] Updated weights for policy 1, policy_version 1947175 (0.0010) [2023-12-26 15:14:37,643][123090] Updated weights for policy 1, policy_version 1947185 (0.0009) [2023-12-26 15:14:37,697][123090] Updated weights for policy 1, policy_version 1947195 (0.0008) [2023-12-26 15:14:38,306][123091] Updated weights for policy 0, policy_version 1956305 (0.0008) [2023-12-26 15:14:38,356][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:38,583][123090] Updated weights for policy 1, policy_version 1947205 (0.0009) [2023-12-26 15:14:38,637][123090] Updated weights for policy 1, policy_version 1947215 (0.0009) [2023-12-26 15:14:38,692][123090] Updated weights for policy 1, policy_version 1947225 (0.0010) [2023-12-26 15:14:38,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.5, 300 sec: 17855.8). Total num frames: 1000136704. Throughput: 0: 9191.1, 1: 8948.4. Samples: 1000109268. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:38,785][121949] Avg episode reward: [(0, '6194.549'), (1, '5576.659')] [2023-12-26 15:14:38,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956312_501645312.pth... [2023-12-26 15:14:38,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001947232_498491392.pth... [2023-12-26 15:14:38,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001946176_498221056.pth [2023-12-26 15:14:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001955768_501366784.pth [2023-12-26 15:14:39,170][123091] Updated weights for policy 0, policy_version 1956315 (0.0007) [2023-12-26 15:14:39,225][123091] Updated weights for policy 0, policy_version 1956325 (0.0006) [2023-12-26 15:14:39,242][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:39,515][123090] Updated weights for policy 1, policy_version 1947235 (0.0009) [2023-12-26 15:14:39,578][123090] Updated weights for policy 1, policy_version 1947245 (0.0009) [2023-12-26 15:14:39,645][123090] Updated weights for policy 1, policy_version 1947255 (0.0005) [2023-12-26 15:14:40,152][123091] Updated weights for policy 0, policy_version 1956335 (0.0010) [2023-12-26 15:14:40,195][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:40,411][123090] Updated weights for policy 1, policy_version 1947265 (0.0006) [2023-12-26 15:14:40,476][123090] Updated weights for policy 1, policy_version 1947275 (0.0010) [2023-12-26 15:14:40,533][123090] Updated weights for policy 1, policy_version 1947285 (0.0009) [2023-12-26 15:14:40,585][123090] Updated weights for policy 1, policy_version 1947295 (0.0010) [2023-12-26 15:14:41,055][123091] Updated weights for policy 0, policy_version 1956345 (0.0009) [2023-12-26 15:14:41,132][123091] Updated weights for policy 0, policy_version 1956355 (0.0009) [2023-12-26 15:14:41,164][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:41,515][123090] Updated weights for policy 1, policy_version 1947305 (0.0006) [2023-12-26 15:14:41,580][123090] Updated weights for policy 1, policy_version 1947315 (0.0009) [2023-12-26 15:14:41,660][123090] Updated weights for policy 1, policy_version 1947325 (0.0010) [2023-12-26 15:14:42,069][123091] Updated weights for policy 0, policy_version 1956365 (0.0009) [2023-12-26 15:14:42,147][123091] Updated weights for policy 0, policy_version 1956375 (0.0009) [2023-12-26 15:14:42,150][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:42,300][123090] Updated weights for policy 1, policy_version 1947335 (0.0008) [2023-12-26 15:14:42,370][123090] Updated weights for policy 1, policy_version 1947345 (0.0009) [2023-12-26 15:14:42,453][123090] Updated weights for policy 1, policy_version 1947355 (0.0006) [2023-12-26 15:14:43,030][123091] Updated weights for policy 0, policy_version 1956385 (0.0009) [2023-12-26 15:14:43,075][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:43,208][123090] Updated weights for policy 1, policy_version 1947365 (0.0005) [2023-12-26 15:14:43,286][123090] Updated weights for policy 1, policy_version 1947375 (0.0005) [2023-12-26 15:14:43,346][123090] Updated weights for policy 1, policy_version 1947385 (0.0005) [2023-12-26 15:14:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 1000218624. Throughput: 0: 9152.3, 1: 8876.3. Samples: 1000213604. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:43,785][121949] Avg episode reward: [(0, '6182.546'), (1, '5839.175')] [2023-12-26 15:14:43,865][123091] Updated weights for policy 0, policy_version 1956395 (0.0007) [2023-12-26 15:14:43,920][123091] Updated weights for policy 0, policy_version 1956405 (0.0009) [2023-12-26 15:14:43,935][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:44,054][123090] Updated weights for policy 1, policy_version 1947395 (0.0007) [2023-12-26 15:14:44,111][123090] Updated weights for policy 1, policy_version 1947405 (0.0009) [2023-12-26 15:14:44,166][123090] Updated weights for policy 1, policy_version 1947415 (0.0010) [2023-12-26 15:14:44,800][123091] Updated weights for policy 0, policy_version 1956415 (0.0008) [2023-12-26 15:14:44,849][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:44,994][123090] Updated weights for policy 1, policy_version 1947425 (0.0009) [2023-12-26 15:14:45,071][123090] Updated weights for policy 1, policy_version 1947435 (0.0008) [2023-12-26 15:14:45,144][123090] Updated weights for policy 1, policy_version 1947445 (0.0008) [2023-12-26 15:14:45,215][123090] Updated weights for policy 1, policy_version 1947455 (0.0009) [2023-12-26 15:14:45,660][123091] Updated weights for policy 0, policy_version 1956425 (0.0009) [2023-12-26 15:14:45,728][123091] Updated weights for policy 0, policy_version 1956435 (0.0010) [2023-12-26 15:14:45,755][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:45,851][123090] Updated weights for policy 1, policy_version 1947465 (0.0009) [2023-12-26 15:14:45,906][123090] Updated weights for policy 1, policy_version 1947475 (0.0009) [2023-12-26 15:14:45,966][123090] Updated weights for policy 1, policy_version 1947485 (0.0008) [2023-12-26 15:14:46,630][123091] Updated weights for policy 0, policy_version 1956445 (0.0010) [2023-12-26 15:14:46,692][123091] Updated weights for policy 0, policy_version 1956455 (0.0010) [2023-12-26 15:14:46,694][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:46,825][123090] Updated weights for policy 1, policy_version 1947495 (0.0010) [2023-12-26 15:14:46,878][123090] Updated weights for policy 1, policy_version 1947505 (0.0010) [2023-12-26 15:14:46,932][123090] Updated weights for policy 1, policy_version 1947515 (0.0010) [2023-12-26 15:14:47,545][123091] Updated weights for policy 0, policy_version 1956465 (0.0009) [2023-12-26 15:14:47,571][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:47,802][123090] Updated weights for policy 1, policy_version 1947525 (0.0010) [2023-12-26 15:14:47,852][123090] Updated weights for policy 1, policy_version 1947535 (0.0009) [2023-12-26 15:14:47,905][123090] Updated weights for policy 1, policy_version 1947545 (0.0009) [2023-12-26 15:14:48,438][123091] Updated weights for policy 0, policy_version 1956476 (0.0010) [2023-12-26 15:14:48,499][123091] Updated weights for policy 0, policy_version 1956486 (0.0011) [2023-12-26 15:14:48,510][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:48,784][121949] Fps is (10 sec: 17203.3, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 1000308736. Throughput: 0: 9168.5, 1: 8824.7. Samples: 1000321052. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:48,784][121949] Avg episode reward: [(0, '6199.198'), (1, '5950.004')] [2023-12-26 15:14:48,786][123090] Updated weights for policy 1, policy_version 1947555 (0.0009) [2023-12-26 15:14:48,850][123090] Updated weights for policy 1, policy_version 1947565 (0.0009) [2023-12-26 15:14:48,910][123090] Updated weights for policy 1, policy_version 1947575 (0.0009) [2023-12-26 15:14:49,421][123091] Updated weights for policy 0, policy_version 1956496 (0.0011) [2023-12-26 15:14:49,471][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:49,781][123090] Updated weights for policy 1, policy_version 1947585 (0.0008) [2023-12-26 15:14:49,847][123090] Updated weights for policy 1, policy_version 1947595 (0.0009) [2023-12-26 15:14:49,915][123090] Updated weights for policy 1, policy_version 1947605 (0.0009) [2023-12-26 15:14:49,985][123090] Updated weights for policy 1, policy_version 1947615 (0.0009) [2023-12-26 15:14:50,336][123091] Updated weights for policy 0, policy_version 1956506 (0.0011) [2023-12-26 15:14:50,385][123091] Updated weights for policy 0, policy_version 1956516 (0.0010) [2023-12-26 15:14:50,401][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:50,805][123090] Updated weights for policy 1, policy_version 1947625 (0.0009) [2023-12-26 15:14:50,870][123090] Updated weights for policy 1, policy_version 1947635 (0.0009) [2023-12-26 15:14:50,925][123090] Updated weights for policy 1, policy_version 1947645 (0.0009) [2023-12-26 15:14:51,301][123091] Updated weights for policy 0, policy_version 1956526 (0.0009) [2023-12-26 15:14:51,361][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:51,363][123091] Updated weights for policy 0, policy_version 1956536 (0.0007) [2023-12-26 15:14:51,848][123090] Updated weights for policy 1, policy_version 1947655 (0.0009) [2023-12-26 15:14:51,897][123090] Updated weights for policy 1, policy_version 1947665 (0.0010) [2023-12-26 15:14:51,949][123090] Updated weights for policy 1, policy_version 1947675 (0.0008) [2023-12-26 15:14:52,224][123091] Updated weights for policy 0, policy_version 1956546 (0.0009) [2023-12-26 15:14:52,263][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:52,816][123090] Updated weights for policy 1, policy_version 1947685 (0.0008) [2023-12-26 15:14:52,877][123090] Updated weights for policy 1, policy_version 1947695 (0.0010) [2023-12-26 15:14:52,930][123090] Updated weights for policy 1, policy_version 1947705 (0.0010) [2023-12-26 15:14:53,028][123091] Updated weights for policy 0, policy_version 1956556 (0.0008) [2023-12-26 15:14:53,082][123091] Updated weights for policy 0, policy_version 1956566 (0.0005) [2023-12-26 15:14:53,089][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:53,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 1000390656. Throughput: 0: 9109.7, 1: 8763.8. Samples: 1000371584. Policy #0 lag: (min: 10.0, avg: 16.8, max: 26.0) [2023-12-26 15:14:53,784][121949] Avg episode reward: [(0, '6217.941'), (1, '5846.880')] [2023-12-26 15:14:53,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956568_501776384.pth... [2023-12-26 15:14:53,791][123090] Updated weights for policy 1, policy_version 1947715 (0.0009) [2023-12-26 15:14:53,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956040_501506048.pth [2023-12-26 15:14:53,858][123090] Updated weights for policy 1, policy_version 1947725 (0.0009) [2023-12-26 15:14:53,920][123090] Updated weights for policy 1, policy_version 1947735 (0.0009) [2023-12-26 15:14:53,936][123091] Updated weights for policy 0, policy_version 1956576 (0.0006) [2023-12-26 15:14:53,972][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001947744_498622464.pth... [2023-12-26 15:14:53,976][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001946720_498360320.pth [2023-12-26 15:14:53,984][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:54,780][123090] Updated weights for policy 1, policy_version 1947745 (0.0009) [2023-12-26 15:14:54,787][123091] Updated weights for policy 0, policy_version 1956586 (0.0009) [2023-12-26 15:14:54,849][123090] Updated weights for policy 1, policy_version 1947755 (0.0008) [2023-12-26 15:14:54,854][123091] Updated weights for policy 0, policy_version 1956596 (0.0007) [2023-12-26 15:14:54,877][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:54,909][123090] Updated weights for policy 1, policy_version 1947765 (0.0008) [2023-12-26 15:14:54,966][123090] Updated weights for policy 1, policy_version 1947776 (0.0010) [2023-12-26 15:14:55,580][123091] Updated weights for policy 0, policy_version 1956606 (0.0008) [2023-12-26 15:14:55,643][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:55,644][123091] Updated weights for policy 0, policy_version 1956616 (0.0008) [2023-12-26 15:14:55,892][123090] Updated weights for policy 1, policy_version 1947786 (0.0010) [2023-12-26 15:14:55,954][123090] Updated weights for policy 1, policy_version 1947796 (0.0009) [2023-12-26 15:14:56,016][123090] Updated weights for policy 1, policy_version 1947806 (0.0010) [2023-12-26 15:14:56,394][123091] Updated weights for policy 0, policy_version 1956626 (0.0009) [2023-12-26 15:14:56,421][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:56,918][123090] Updated weights for policy 1, policy_version 1947816 (0.0010) [2023-12-26 15:14:56,972][123090] Updated weights for policy 1, policy_version 1947826 (0.0010) [2023-12-26 15:14:57,024][123090] Updated weights for policy 1, policy_version 1947837 (0.0010) [2023-12-26 15:14:57,221][123091] Updated weights for policy 0, policy_version 1956636 (0.0007) [2023-12-26 15:14:57,288][123091] Updated weights for policy 0, policy_version 1956646 (0.0006) [2023-12-26 15:14:57,295][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:57,907][123090] Updated weights for policy 1, policy_version 1947847 (0.0009) [2023-12-26 15:14:57,965][123090] Updated weights for policy 1, policy_version 1947857 (0.0009) [2023-12-26 15:14:58,016][123090] Updated weights for policy 1, policy_version 1947867 (0.0009) [2023-12-26 15:14:58,124][123091] Updated weights for policy 0, policy_version 1956656 (0.0010) [2023-12-26 15:14:58,164][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:58,784][121949] Fps is (10 sec: 17202.7, 60 sec: 17885.8, 300 sec: 17828.0). Total num frames: 1000480768. Throughput: 0: 9190.9, 1: 8739.3. Samples: 1000478540. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:14:58,785][121949] Avg episode reward: [(0, '6255.141'), (1, '5745.788')] [2023-12-26 15:14:58,903][123090] Updated weights for policy 1, policy_version 1947877 (0.0009) [2023-12-26 15:14:58,972][123090] Updated weights for policy 1, policy_version 1947887 (0.0010) [2023-12-26 15:14:59,044][123090] Updated weights for policy 1, policy_version 1947897 (0.0011) [2023-12-26 15:14:59,137][123091] Updated weights for policy 0, policy_version 1956666 (0.0009) [2023-12-26 15:14:59,206][123091] Updated weights for policy 0, policy_version 1956676 (0.0007) [2023-12-26 15:14:59,230][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:14:59,771][123090] Updated weights for policy 1, policy_version 1947907 (0.0010) [2023-12-26 15:14:59,827][123090] Updated weights for policy 1, policy_version 1947917 (0.0010) [2023-12-26 15:14:59,898][123090] Updated weights for policy 1, policy_version 1947927 (0.0010) [2023-12-26 15:15:00,158][123091] Updated weights for policy 0, policy_version 1956687 (0.0010) [2023-12-26 15:15:00,208][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:00,592][123090] Updated weights for policy 1, policy_version 1947937 (0.0010) [2023-12-26 15:15:00,650][123090] Updated weights for policy 1, policy_version 1947947 (0.0010) [2023-12-26 15:15:00,704][123090] Updated weights for policy 1, policy_version 1947957 (0.0010) [2023-12-26 15:15:00,751][123090] Updated weights for policy 1, policy_version 1947967 (0.0010) [2023-12-26 15:15:00,958][123091] Updated weights for policy 0, policy_version 1956697 (0.0010) [2023-12-26 15:15:01,018][123091] Updated weights for policy 0, policy_version 1956707 (0.0006) [2023-12-26 15:15:01,048][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:01,605][123090] Updated weights for policy 1, policy_version 1947977 (0.0006) [2023-12-26 15:15:01,674][123090] Updated weights for policy 1, policy_version 1947987 (0.0009) [2023-12-26 15:15:01,740][123090] Updated weights for policy 1, policy_version 1947997 (0.0010) [2023-12-26 15:15:01,843][123091] Updated weights for policy 0, policy_version 1956717 (0.0007) [2023-12-26 15:15:01,896][123091] Updated weights for policy 0, policy_version 1956727 (0.0009) [2023-12-26 15:15:01,897][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:02,573][123090] Updated weights for policy 1, policy_version 1948007 (0.0009) [2023-12-26 15:15:02,639][123090] Updated weights for policy 1, policy_version 1948017 (0.0007) [2023-12-26 15:15:02,664][123091] Updated weights for policy 0, policy_version 1956737 (0.0007) [2023-12-26 15:15:02,704][123090] Updated weights for policy 1, policy_version 1948027 (0.0009) [2023-12-26 15:15:02,705][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:03,501][123090] Updated weights for policy 1, policy_version 1948037 (0.0005) [2023-12-26 15:15:03,549][123090] Updated weights for policy 1, policy_version 1948047 (0.0006) [2023-12-26 15:15:03,583][123091] Updated weights for policy 0, policy_version 1956747 (0.0008) [2023-12-26 15:15:03,600][123090] Updated weights for policy 1, policy_version 1948057 (0.0005) [2023-12-26 15:15:03,636][123091] Updated weights for policy 0, policy_version 1956757 (0.0010) [2023-12-26 15:15:03,647][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:03,784][121949] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 1000579072. Throughput: 0: 9119.9, 1: 8699.8. Samples: 1000584120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:03,785][121949] Avg episode reward: [(0, '6260.535'), (1, '5746.497')] [2023-12-26 15:15:04,362][123090] Updated weights for policy 1, policy_version 1948067 (0.0007) [2023-12-26 15:15:04,420][123090] Updated weights for policy 1, policy_version 1948077 (0.0009) [2023-12-26 15:15:04,481][123090] Updated weights for policy 1, policy_version 1948087 (0.0009) [2023-12-26 15:15:04,500][123091] Updated weights for policy 0, policy_version 1956767 (0.0008) [2023-12-26 15:15:04,546][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:05,264][123091] Updated weights for policy 0, policy_version 1956777 (0.0006) [2023-12-26 15:15:05,319][123091] Updated weights for policy 0, policy_version 1956787 (0.0005) [2023-12-26 15:15:05,340][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:05,382][123090] Updated weights for policy 1, policy_version 1948097 (0.0008) [2023-12-26 15:15:05,433][123090] Updated weights for policy 1, policy_version 1948107 (0.0010) [2023-12-26 15:15:05,487][123090] Updated weights for policy 1, policy_version 1948117 (0.0010) [2023-12-26 15:15:05,535][123090] Updated weights for policy 1, policy_version 1948127 (0.0010) [2023-12-26 15:15:06,126][123091] Updated weights for policy 0, policy_version 1956797 (0.0007) [2023-12-26 15:15:06,188][123091] Updated weights for policy 0, policy_version 1956807 (0.0008) [2023-12-26 15:15:06,194][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:06,354][123090] Updated weights for policy 1, policy_version 1948137 (0.0011) [2023-12-26 15:15:06,427][123090] Updated weights for policy 1, policy_version 1948147 (0.0011) [2023-12-26 15:15:06,485][123090] Updated weights for policy 1, policy_version 1948157 (0.0009) [2023-12-26 15:15:07,095][123091] Updated weights for policy 0, policy_version 1956817 (0.0010) [2023-12-26 15:15:07,140][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:07,278][123090] Updated weights for policy 1, policy_version 1948167 (0.0007) [2023-12-26 15:15:07,341][123090] Updated weights for policy 1, policy_version 1948177 (0.0005) [2023-12-26 15:15:07,392][123090] Updated weights for policy 1, policy_version 1948187 (0.0009) [2023-12-26 15:15:07,908][123091] Updated weights for policy 0, policy_version 1956827 (0.0009) [2023-12-26 15:15:07,970][123091] Updated weights for policy 0, policy_version 1956837 (0.0010) [2023-12-26 15:15:07,982][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:08,173][123090] Updated weights for policy 1, policy_version 1948197 (0.0010) [2023-12-26 15:15:08,230][123090] Updated weights for policy 1, policy_version 1948207 (0.0009) [2023-12-26 15:15:08,286][123090] Updated weights for policy 1, policy_version 1948217 (0.0006) [2023-12-26 15:15:08,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17800.2). Total num frames: 1000660992. Throughput: 0: 9173.9, 1: 8687.0. Samples: 1000639208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:08,785][121949] Avg episode reward: [(0, '6311.730'), (1, '5757.121')] [2023-12-26 15:15:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001948224_498745344.pth... [2023-12-26 15:15:08,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956840_501915648.pth... [2023-12-26 15:15:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001947232_498491392.pth [2023-12-26 15:15:08,797][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956312_501645312.pth [2023-12-26 15:15:08,877][123091] Updated weights for policy 0, policy_version 1956847 (0.0010) [2023-12-26 15:15:08,917][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:09,142][123090] Updated weights for policy 1, policy_version 1948227 (0.0008) [2023-12-26 15:15:09,198][123090] Updated weights for policy 1, policy_version 1948237 (0.0010) [2023-12-26 15:15:09,259][123090] Updated weights for policy 1, policy_version 1948247 (0.0009) [2023-12-26 15:15:09,852][123091] Updated weights for policy 0, policy_version 1956857 (0.0009) [2023-12-26 15:15:09,921][123091] Updated weights for policy 0, policy_version 1956867 (0.0008) [2023-12-26 15:15:09,955][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:10,160][123090] Updated weights for policy 1, policy_version 1948257 (0.0010) [2023-12-26 15:15:10,231][123090] Updated weights for policy 1, policy_version 1948267 (0.0010) [2023-12-26 15:15:10,286][123090] Updated weights for policy 1, policy_version 1948277 (0.0009) [2023-12-26 15:15:10,344][123090] Updated weights for policy 1, policy_version 1948287 (0.0010) [2023-12-26 15:15:10,840][123091] Updated weights for policy 0, policy_version 1956877 (0.0009) [2023-12-26 15:15:10,894][123091] Updated weights for policy 0, policy_version 1956887 (0.0009) [2023-12-26 15:15:10,896][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:11,229][123090] Updated weights for policy 1, policy_version 1948297 (0.0010) [2023-12-26 15:15:11,297][123090] Updated weights for policy 1, policy_version 1948307 (0.0010) [2023-12-26 15:15:11,367][123090] Updated weights for policy 1, policy_version 1948317 (0.0010) [2023-12-26 15:15:11,793][123091] Updated weights for policy 0, policy_version 1956897 (0.0009) [2023-12-26 15:15:11,825][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:12,220][123090] Updated weights for policy 1, policy_version 1948327 (0.0010) [2023-12-26 15:15:12,284][123090] Updated weights for policy 1, policy_version 1948337 (0.0010) [2023-12-26 15:15:12,353][123090] Updated weights for policy 1, policy_version 1948347 (0.0010) [2023-12-26 15:15:12,707][123091] Updated weights for policy 0, policy_version 1956907 (0.0008) [2023-12-26 15:15:12,768][123091] Updated weights for policy 0, policy_version 1956917 (0.0009) [2023-12-26 15:15:12,780][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:13,137][123090] Updated weights for policy 1, policy_version 1948357 (0.0009) [2023-12-26 15:15:13,199][123090] Updated weights for policy 1, policy_version 1948367 (0.0010) [2023-12-26 15:15:13,265][123090] Updated weights for policy 1, policy_version 1948377 (0.0009) [2023-12-26 15:15:13,649][123091] Updated weights for policy 0, policy_version 1956927 (0.0006) [2023-12-26 15:15:13,703][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17828.0). Total num frames: 1000751104. Throughput: 0: 9076.0, 1: 8559.6. Samples: 1000742792. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:13,785][121949] Avg episode reward: [(0, '6310.809'), (1, '5767.712')] [2023-12-26 15:15:14,142][123090] Updated weights for policy 1, policy_version 1948387 (0.0009) [2023-12-26 15:15:14,192][123090] Updated weights for policy 1, policy_version 1948397 (0.0010) [2023-12-26 15:15:14,242][123090] Updated weights for policy 1, policy_version 1948407 (0.0009) [2023-12-26 15:15:14,426][123091] Updated weights for policy 0, policy_version 1956937 (0.0006) [2023-12-26 15:15:14,476][123091] Updated weights for policy 0, policy_version 1956947 (0.0009) [2023-12-26 15:15:14,496][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:15,135][123090] Updated weights for policy 1, policy_version 1948417 (0.0010) [2023-12-26 15:15:15,197][123090] Updated weights for policy 1, policy_version 1948427 (0.0010) [2023-12-26 15:15:15,263][123090] Updated weights for policy 1, policy_version 1948437 (0.0010) [2023-12-26 15:15:15,329][123090] Updated weights for policy 1, policy_version 1948447 (0.0010) [2023-12-26 15:15:15,398][123091] Updated weights for policy 0, policy_version 1956957 (0.0009) [2023-12-26 15:15:15,466][123091] Updated weights for policy 0, policy_version 1956967 (0.0009) [2023-12-26 15:15:15,468][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:16,172][123090] Updated weights for policy 1, policy_version 1948457 (0.0010) [2023-12-26 15:15:16,224][123090] Updated weights for policy 1, policy_version 1948467 (0.0009) [2023-12-26 15:15:16,285][123090] Updated weights for policy 1, policy_version 1948477 (0.0010) [2023-12-26 15:15:16,357][123091] Updated weights for policy 0, policy_version 1956977 (0.0009) [2023-12-26 15:15:16,397][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:17,118][123091] Updated weights for policy 0, policy_version 1956987 (0.0007) [2023-12-26 15:15:17,184][123091] Updated weights for policy 0, policy_version 1956997 (0.0006) [2023-12-26 15:15:17,189][123090] Updated weights for policy 1, policy_version 1948487 (0.0009) [2023-12-26 15:15:17,205][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:17,252][123090] Updated weights for policy 1, policy_version 1948497 (0.0009) [2023-12-26 15:15:17,318][123090] Updated weights for policy 1, policy_version 1948507 (0.0009) [2023-12-26 15:15:17,822][123091] Updated weights for policy 0, policy_version 1957007 (0.0005) [2023-12-26 15:15:17,860][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:18,228][123090] Updated weights for policy 1, policy_version 1948517 (0.0009) [2023-12-26 15:15:18,275][123090] Updated weights for policy 1, policy_version 1948527 (0.0009) [2023-12-26 15:15:18,324][123090] Updated weights for policy 1, policy_version 1948537 (0.0009) [2023-12-26 15:15:18,594][123091] Updated weights for policy 0, policy_version 1957017 (0.0006) [2023-12-26 15:15:18,648][123091] Updated weights for policy 0, policy_version 1957027 (0.0011) [2023-12-26 15:15:18,671][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 1000841216. Throughput: 0: 9092.3, 1: 8475.6. Samples: 1000847992. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:18,785][121949] Avg episode reward: [(0, '6354.746'), (1, '5872.478')] [2023-12-26 15:15:19,187][123090] Updated weights for policy 1, policy_version 1948547 (0.0010) [2023-12-26 15:15:19,251][123090] Updated weights for policy 1, policy_version 1948557 (0.0009) [2023-12-26 15:15:19,305][123090] Updated weights for policy 1, policy_version 1948567 (0.0009) [2023-12-26 15:15:19,574][123091] Updated weights for policy 0, policy_version 1957037 (0.0009) [2023-12-26 15:15:19,632][123091] Updated weights for policy 0, policy_version 1957047 (0.0009) [2023-12-26 15:15:19,635][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:20,155][123090] Updated weights for policy 1, policy_version 1948577 (0.0010) [2023-12-26 15:15:20,223][123090] Updated weights for policy 1, policy_version 1948587 (0.0010) [2023-12-26 15:15:20,289][123090] Updated weights for policy 1, policy_version 1948597 (0.0010) [2023-12-26 15:15:20,352][123090] Updated weights for policy 1, policy_version 1948607 (0.0010) [2023-12-26 15:15:20,596][123091] Updated weights for policy 0, policy_version 1957057 (0.0008) [2023-12-26 15:15:20,644][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:21,246][123090] Updated weights for policy 1, policy_version 1948617 (0.0010) [2023-12-26 15:15:21,317][123090] Updated weights for policy 1, policy_version 1948627 (0.0009) [2023-12-26 15:15:21,387][123090] Updated weights for policy 1, policy_version 1948637 (0.0010) [2023-12-26 15:15:21,494][123091] Updated weights for policy 0, policy_version 1957067 (0.0010) [2023-12-26 15:15:21,558][123091] Updated weights for policy 0, policy_version 1957077 (0.0008) [2023-12-26 15:15:21,572][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:22,248][123090] Updated weights for policy 1, policy_version 1948647 (0.0008) [2023-12-26 15:15:22,316][123090] Updated weights for policy 1, policy_version 1948657 (0.0008) [2023-12-26 15:15:22,386][123090] Updated weights for policy 1, policy_version 1948667 (0.0007) [2023-12-26 15:15:22,459][123091] Updated weights for policy 0, policy_version 1957087 (0.0008) [2023-12-26 15:15:22,519][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:23,172][123090] Updated weights for policy 1, policy_version 1948677 (0.0008) [2023-12-26 15:15:23,233][123090] Updated weights for policy 1, policy_version 1948687 (0.0007) [2023-12-26 15:15:23,286][123090] Updated weights for policy 1, policy_version 1948697 (0.0005) [2023-12-26 15:15:23,397][123091] Updated weights for policy 0, policy_version 1957097 (0.0009) [2023-12-26 15:15:23,452][123091] Updated weights for policy 0, policy_version 1957107 (0.0010) [2023-12-26 15:15:23,475][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:23,784][121949] Fps is (10 sec: 17202.9, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 1000923136. Throughput: 0: 9111.5, 1: 8430.0. Samples: 1000898640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:23,785][121949] Avg episode reward: [(0, '6350.931'), (1, '5817.048')] [2023-12-26 15:15:23,794][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957112_502054912.pth... [2023-12-26 15:15:23,795][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001948704_498868224.pth... [2023-12-26 15:15:23,799][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956568_501776384.pth [2023-12-26 15:15:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001947744_498622464.pth [2023-12-26 15:15:23,920][123090] Updated weights for policy 1, policy_version 1948707 (0.0007) [2023-12-26 15:15:23,988][123090] Updated weights for policy 1, policy_version 1948717 (0.0009) [2023-12-26 15:15:24,056][123090] Updated weights for policy 1, policy_version 1948727 (0.0010) [2023-12-26 15:15:24,408][123091] Updated weights for policy 0, policy_version 1957117 (0.0010) [2023-12-26 15:15:24,456][123091] Updated weights for policy 0, policy_version 1957127 (0.0010) [2023-12-26 15:15:24,459][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:24,887][123090] Updated weights for policy 1, policy_version 1948737 (0.0008) [2023-12-26 15:15:24,965][123090] Updated weights for policy 1, policy_version 1948747 (0.0005) [2023-12-26 15:15:25,027][123090] Updated weights for policy 1, policy_version 1948757 (0.0005) [2023-12-26 15:15:25,078][123090] Updated weights for policy 1, policy_version 1948767 (0.0005) [2023-12-26 15:15:25,369][123091] Updated weights for policy 0, policy_version 1957137 (0.0011) [2023-12-26 15:15:25,409][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:25,701][123090] Updated weights for policy 1, policy_version 1948777 (0.0005) [2023-12-26 15:15:25,763][123090] Updated weights for policy 1, policy_version 1948787 (0.0006) [2023-12-26 15:15:25,829][123090] Updated weights for policy 1, policy_version 1948798 (0.0008) [2023-12-26 15:15:26,273][123091] Updated weights for policy 0, policy_version 1957147 (0.0011) [2023-12-26 15:15:26,329][123091] Updated weights for policy 0, policy_version 1957157 (0.0010) [2023-12-26 15:15:26,349][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:26,541][123090] Updated weights for policy 1, policy_version 1948808 (0.0005) [2023-12-26 15:15:26,600][123090] Updated weights for policy 1, policy_version 1948818 (0.0005) [2023-12-26 15:15:26,658][123090] Updated weights for policy 1, policy_version 1948828 (0.0005) [2023-12-26 15:15:27,242][123091] Updated weights for policy 0, policy_version 1957167 (0.0011) [2023-12-26 15:15:27,296][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:27,379][123090] Updated weights for policy 1, policy_version 1948838 (0.0008) [2023-12-26 15:15:27,431][123090] Updated weights for policy 1, policy_version 1948848 (0.0010) [2023-12-26 15:15:27,482][123090] Updated weights for policy 1, policy_version 1948858 (0.0010) [2023-12-26 15:15:28,120][123091] Updated weights for policy 0, policy_version 1957177 (0.0011) [2023-12-26 15:15:28,183][123091] Updated weights for policy 0, policy_version 1957187 (0.0009) [2023-12-26 15:15:28,217][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:28,345][123090] Updated weights for policy 1, policy_version 1948868 (0.0009) [2023-12-26 15:15:28,408][123090] Updated weights for policy 1, policy_version 1948878 (0.0006) [2023-12-26 15:15:28,465][123090] Updated weights for policy 1, policy_version 1948888 (0.0005) [2023-12-26 15:15:28,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17828.0). Total num frames: 1001013248. Throughput: 0: 9086.4, 1: 8534.2. Samples: 1001006532. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:28,784][121949] Avg episode reward: [(0, '6166.532'), (1, '5777.546')] [2023-12-26 15:15:29,088][123091] Updated weights for policy 0, policy_version 1957197 (0.0010) [2023-12-26 15:15:29,151][123091] Updated weights for policy 0, policy_version 1957207 (0.0011) [2023-12-26 15:15:29,155][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:29,185][123090] Updated weights for policy 1, policy_version 1948898 (0.0006) [2023-12-26 15:15:29,258][123090] Updated weights for policy 1, policy_version 1948908 (0.0009) [2023-12-26 15:15:29,322][123090] Updated weights for policy 1, policy_version 1948918 (0.0008) [2023-12-26 15:15:29,389][123090] Updated weights for policy 1, policy_version 1948928 (0.0009) [2023-12-26 15:15:30,066][123091] Updated weights for policy 0, policy_version 1957217 (0.0010) [2023-12-26 15:15:30,104][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:30,225][123090] Updated weights for policy 1, policy_version 1948938 (0.0009) [2023-12-26 15:15:30,286][123090] Updated weights for policy 1, policy_version 1948948 (0.0009) [2023-12-26 15:15:30,349][123090] Updated weights for policy 1, policy_version 1948958 (0.0010) [2023-12-26 15:15:30,984][123091] Updated weights for policy 0, policy_version 1957227 (0.0009) [2023-12-26 15:15:31,039][123091] Updated weights for policy 0, policy_version 1957237 (0.0009) [2023-12-26 15:15:31,056][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:31,107][123090] Updated weights for policy 1, policy_version 1948968 (0.0009) [2023-12-26 15:15:31,172][123090] Updated weights for policy 1, policy_version 1948978 (0.0009) [2023-12-26 15:15:31,225][123090] Updated weights for policy 1, policy_version 1948988 (0.0009) [2023-12-26 15:15:31,980][123091] Updated weights for policy 0, policy_version 1957247 (0.0009) [2023-12-26 15:15:32,028][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:32,082][123090] Updated weights for policy 1, policy_version 1948998 (0.0009) [2023-12-26 15:15:32,141][123090] Updated weights for policy 1, policy_version 1949008 (0.0010) [2023-12-26 15:15:32,190][123090] Updated weights for policy 1, policy_version 1949018 (0.0009) [2023-12-26 15:15:32,827][123091] Updated weights for policy 0, policy_version 1957257 (0.0009) [2023-12-26 15:15:32,874][123091] Updated weights for policy 0, policy_version 1957267 (0.0005) [2023-12-26 15:15:32,896][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:33,074][123090] Updated weights for policy 1, policy_version 1949028 (0.0010) [2023-12-26 15:15:33,133][123090] Updated weights for policy 1, policy_version 1949038 (0.0010) [2023-12-26 15:15:33,197][123090] Updated weights for policy 1, policy_version 1949048 (0.0010) [2023-12-26 15:15:33,706][123091] Updated weights for policy 0, policy_version 1957277 (0.0007) [2023-12-26 15:15:33,760][123091] Updated weights for policy 0, policy_version 1957287 (0.0009) [2023-12-26 15:15:33,764][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:33,784][121949] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 1001103360. Throughput: 0: 9043.4, 1: 8513.5. Samples: 1001111112. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:33,785][121949] Avg episode reward: [(0, '6224.650'), (1, '5936.616')] [2023-12-26 15:15:34,033][123090] Updated weights for policy 1, policy_version 1949058 (0.0010) [2023-12-26 15:15:34,100][123090] Updated weights for policy 1, policy_version 1949068 (0.0009) [2023-12-26 15:15:34,167][123090] Updated weights for policy 1, policy_version 1949078 (0.0009) [2023-12-26 15:15:34,233][123090] Updated weights for policy 1, policy_version 1949088 (0.0009) [2023-12-26 15:15:34,683][123091] Updated weights for policy 0, policy_version 1957297 (0.0010) [2023-12-26 15:15:34,730][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:35,083][123090] Updated weights for policy 1, policy_version 1949098 (0.0009) [2023-12-26 15:15:35,141][123090] Updated weights for policy 1, policy_version 1949108 (0.0009) [2023-12-26 15:15:35,190][123090] Updated weights for policy 1, policy_version 1949118 (0.0009) [2023-12-26 15:15:35,520][123091] Updated weights for policy 0, policy_version 1957307 (0.0008) [2023-12-26 15:15:35,579][123091] Updated weights for policy 0, policy_version 1957317 (0.0008) [2023-12-26 15:15:35,592][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:35,899][123090] Updated weights for policy 1, policy_version 1949128 (0.0008) [2023-12-26 15:15:35,956][123090] Updated weights for policy 1, policy_version 1949138 (0.0008) [2023-12-26 15:15:36,015][123090] Updated weights for policy 1, policy_version 1949148 (0.0008) [2023-12-26 15:15:36,562][123091] Updated weights for policy 0, policy_version 1957327 (0.0009) [2023-12-26 15:15:36,617][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:36,808][123090] Updated weights for policy 1, policy_version 1949158 (0.0009) [2023-12-26 15:15:36,875][123090] Updated weights for policy 1, policy_version 1949168 (0.0010) [2023-12-26 15:15:36,950][123090] Updated weights for policy 1, policy_version 1949178 (0.0006) [2023-12-26 15:15:37,488][123091] Updated weights for policy 0, policy_version 1957337 (0.0009) [2023-12-26 15:15:37,549][123091] Updated weights for policy 0, policy_version 1957347 (0.0010) [2023-12-26 15:15:37,573][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:37,698][123090] Updated weights for policy 1, policy_version 1949188 (0.0007) [2023-12-26 15:15:37,771][123090] Updated weights for policy 1, policy_version 1949198 (0.0008) [2023-12-26 15:15:37,835][123090] Updated weights for policy 1, policy_version 1949208 (0.0009) [2023-12-26 15:15:38,526][123091] Updated weights for policy 0, policy_version 1957357 (0.0010) [2023-12-26 15:15:38,590][123091] Updated weights for policy 0, policy_version 1957367 (0.0010) [2023-12-26 15:15:38,595][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:38,619][123090] Updated weights for policy 1, policy_version 1949218 (0.0009) [2023-12-26 15:15:38,692][123090] Updated weights for policy 1, policy_version 1949228 (0.0010) [2023-12-26 15:15:38,767][123090] Updated weights for policy 1, policy_version 1949238 (0.0008) [2023-12-26 15:15:38,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17828.0). Total num frames: 1001185280. Throughput: 0: 9027.9, 1: 8562.6. Samples: 1001163156. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:38,785][121949] Avg episode reward: [(0, '6305.740'), (1, '6017.457')] [2023-12-26 15:15:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957368_502185984.pth... [2023-12-26 15:15:38,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001956840_501915648.pth [2023-12-26 15:15:38,835][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001949248_499007488.pth... [2023-12-26 15:15:38,838][123090] Updated weights for policy 1, policy_version 1949248 (0.0009) [2023-12-26 15:15:38,840][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001948224_498745344.pth [2023-12-26 15:15:39,535][123091] Updated weights for policy 0, policy_version 1957377 (0.0008) [2023-12-26 15:15:39,578][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:39,610][123090] Updated weights for policy 1, policy_version 1949258 (0.0007) [2023-12-26 15:15:39,676][123090] Updated weights for policy 1, policy_version 1949268 (0.0009) [2023-12-26 15:15:39,743][123090] Updated weights for policy 1, policy_version 1949278 (0.0009) [2023-12-26 15:15:40,462][123091] Updated weights for policy 0, policy_version 1957387 (0.0011) [2023-12-26 15:15:40,523][123091] Updated weights for policy 0, policy_version 1957397 (0.0010) [2023-12-26 15:15:40,544][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:40,608][123090] Updated weights for policy 1, policy_version 1949288 (0.0006) [2023-12-26 15:15:40,671][123090] Updated weights for policy 1, policy_version 1949298 (0.0005) [2023-12-26 15:15:40,722][123090] Updated weights for policy 1, policy_version 1949308 (0.0006) [2023-12-26 15:15:41,456][123091] Updated weights for policy 0, policy_version 1957407 (0.0009) [2023-12-26 15:15:41,505][123090] Updated weights for policy 1, policy_version 1949318 (0.0008) [2023-12-26 15:15:41,508][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:41,572][123090] Updated weights for policy 1, policy_version 1949328 (0.0008) [2023-12-26 15:15:41,633][123090] Updated weights for policy 1, policy_version 1949338 (0.0008) [2023-12-26 15:15:42,390][123090] Updated weights for policy 1, policy_version 1949348 (0.0008) [2023-12-26 15:15:42,408][123091] Updated weights for policy 0, policy_version 1957417 (0.0010) [2023-12-26 15:15:42,458][123090] Updated weights for policy 1, policy_version 1949358 (0.0006) [2023-12-26 15:15:42,476][123091] Updated weights for policy 0, policy_version 1957427 (0.0009) [2023-12-26 15:15:42,510][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:42,530][123090] Updated weights for policy 1, policy_version 1949368 (0.0007) [2023-12-26 15:15:43,316][123090] Updated weights for policy 1, policy_version 1949378 (0.0010) [2023-12-26 15:15:43,385][123090] Updated weights for policy 1, policy_version 1949388 (0.0008) [2023-12-26 15:15:43,387][123091] Updated weights for policy 0, policy_version 1957437 (0.0009) [2023-12-26 15:15:43,446][123090] Updated weights for policy 1, policy_version 1949398 (0.0008) [2023-12-26 15:15:43,449][123091] Updated weights for policy 0, policy_version 1957447 (0.0007) [2023-12-26 15:15:43,453][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:43,509][123090] Updated weights for policy 1, policy_version 1949408 (0.0010) [2023-12-26 15:15:43,784][121949] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17828.0). Total num frames: 1001275392. Throughput: 0: 8859.0, 1: 8644.3. Samples: 1001266184. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:43,785][121949] Avg episode reward: [(0, '6172.839'), (1, '5996.558')] [2023-12-26 15:15:44,327][123090] Updated weights for policy 1, policy_version 1949418 (0.0009) [2023-12-26 15:15:44,355][123091] Updated weights for policy 0, policy_version 1957457 (0.0008) [2023-12-26 15:15:44,391][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:44,397][123090] Updated weights for policy 1, policy_version 1949428 (0.0009) [2023-12-26 15:15:44,460][123090] Updated weights for policy 1, policy_version 1949438 (0.0009) [2023-12-26 15:15:45,238][123090] Updated weights for policy 1, policy_version 1949448 (0.0008) [2023-12-26 15:15:45,250][123091] Updated weights for policy 0, policy_version 1957467 (0.0007) [2023-12-26 15:15:45,304][123090] Updated weights for policy 1, policy_version 1949458 (0.0008) [2023-12-26 15:15:45,312][123091] Updated weights for policy 0, policy_version 1957477 (0.0006) [2023-12-26 15:15:45,327][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:45,362][123090] Updated weights for policy 1, policy_version 1949468 (0.0006) [2023-12-26 15:15:46,014][123090] Updated weights for policy 1, policy_version 1949478 (0.0007) [2023-12-26 15:15:46,038][123091] Updated weights for policy 0, policy_version 1957487 (0.0007) [2023-12-26 15:15:46,081][123090] Updated weights for policy 1, policy_version 1949488 (0.0007) [2023-12-26 15:15:46,100][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:46,140][123090] Updated weights for policy 1, policy_version 1949498 (0.0006) [2023-12-26 15:15:46,907][123090] Updated weights for policy 1, policy_version 1949508 (0.0005) [2023-12-26 15:15:46,939][123091] Updated weights for policy 0, policy_version 1957497 (0.0005) [2023-12-26 15:15:46,971][123090] Updated weights for policy 1, policy_version 1949518 (0.0005) [2023-12-26 15:15:46,997][123091] Updated weights for policy 0, policy_version 1957507 (0.0009) [2023-12-26 15:15:47,022][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:47,028][123090] Updated weights for policy 1, policy_version 1949528 (0.0005) [2023-12-26 15:15:47,755][123091] Updated weights for policy 0, policy_version 1957517 (0.0010) [2023-12-26 15:15:47,817][123091] Updated weights for policy 0, policy_version 1957527 (0.0010) [2023-12-26 15:15:47,822][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:47,853][123090] Updated weights for policy 1, policy_version 1949538 (0.0009) [2023-12-26 15:15:47,908][123090] Updated weights for policy 1, policy_version 1949548 (0.0009) [2023-12-26 15:15:47,969][123090] Updated weights for policy 1, policy_version 1949558 (0.0010) [2023-12-26 15:15:48,027][123090] Updated weights for policy 1, policy_version 1949568 (0.0010) [2023-12-26 15:15:48,756][123091] Updated weights for policy 0, policy_version 1957537 (0.0007) [2023-12-26 15:15:48,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17800.3). Total num frames: 1001357312. Throughput: 0: 8908.8, 1: 8690.2. Samples: 1001376072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:48,784][121949] Avg episode reward: [(0, '6197.194'), (1, '5754.743')] [2023-12-26 15:15:48,789][123090] Updated weights for policy 1, policy_version 1949578 (0.0007) [2023-12-26 15:15:48,798][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:48,851][123090] Updated weights for policy 1, policy_version 1949588 (0.0009) [2023-12-26 15:15:48,903][123090] Updated weights for policy 1, policy_version 1949598 (0.0010) [2023-12-26 15:15:49,662][123090] Updated weights for policy 1, policy_version 1949608 (0.0006) [2023-12-26 15:15:49,706][123091] Updated weights for policy 0, policy_version 1957547 (0.0008) [2023-12-26 15:15:49,720][123090] Updated weights for policy 1, policy_version 1949618 (0.0005) [2023-12-26 15:15:49,763][123091] Updated weights for policy 0, policy_version 1957557 (0.0009) [2023-12-26 15:15:49,770][123090] Updated weights for policy 1, policy_version 1949628 (0.0006) [2023-12-26 15:15:49,776][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:50,445][123090] Updated weights for policy 1, policy_version 1949638 (0.0005) [2023-12-26 15:15:50,509][123090] Updated weights for policy 1, policy_version 1949648 (0.0005) [2023-12-26 15:15:50,579][123090] Updated weights for policy 1, policy_version 1949658 (0.0008) [2023-12-26 15:15:50,753][123091] Updated weights for policy 0, policy_version 1957567 (0.0009) [2023-12-26 15:15:50,802][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:51,375][123090] Updated weights for policy 1, policy_version 1949668 (0.0010) [2023-12-26 15:15:51,433][123090] Updated weights for policy 1, policy_version 1949678 (0.0009) [2023-12-26 15:15:51,491][123090] Updated weights for policy 1, policy_version 1949689 (0.0009) [2023-12-26 15:15:51,725][123091] Updated weights for policy 0, policy_version 1957577 (0.0010) [2023-12-26 15:15:51,799][123091] Updated weights for policy 0, policy_version 1957587 (0.0010) [2023-12-26 15:15:51,825][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:52,396][123090] Updated weights for policy 1, policy_version 1949699 (0.0010) [2023-12-26 15:15:52,461][123090] Updated weights for policy 1, policy_version 1949709 (0.0009) [2023-12-26 15:15:52,527][123090] Updated weights for policy 1, policy_version 1949719 (0.0010) [2023-12-26 15:15:52,720][123091] Updated weights for policy 0, policy_version 1957597 (0.0008) [2023-12-26 15:15:52,779][123091] Updated weights for policy 0, policy_version 1957607 (0.0009) [2023-12-26 15:15:52,782][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:53,346][123090] Updated weights for policy 1, policy_version 1949729 (0.0010) [2023-12-26 15:15:53,424][123090] Updated weights for policy 1, policy_version 1949739 (0.0007) [2023-12-26 15:15:53,482][123090] Updated weights for policy 1, policy_version 1949749 (0.0005) [2023-12-26 15:15:53,536][123090] Updated weights for policy 1, policy_version 1949759 (0.0005) [2023-12-26 15:15:53,636][123091] Updated weights for policy 0, policy_version 1957617 (0.0006) [2023-12-26 15:15:53,677][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:53,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17828.0). Total num frames: 1001455616. Throughput: 0: 8793.3, 1: 8739.4. Samples: 1001428180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:53,785][121949] Avg episode reward: [(0, '6347.588'), (1, '5629.006')] [2023-12-26 15:15:53,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957624_502317056.pth... [2023-12-26 15:15:53,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001949760_499138560.pth... [2023-12-26 15:15:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957112_502054912.pth [2023-12-26 15:15:53,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001948704_498868224.pth [2023-12-26 15:15:54,260][123090] Updated weights for policy 1, policy_version 1949769 (0.0010) [2023-12-26 15:15:54,319][123090] Updated weights for policy 1, policy_version 1949779 (0.0010) [2023-12-26 15:15:54,375][123090] Updated weights for policy 1, policy_version 1949789 (0.0010) [2023-12-26 15:15:54,407][123091] Updated weights for policy 0, policy_version 1957627 (0.0006) [2023-12-26 15:15:54,469][123091] Updated weights for policy 0, policy_version 1957637 (0.0008) [2023-12-26 15:15:54,486][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:55,173][123090] Updated weights for policy 1, policy_version 1949799 (0.0007) [2023-12-26 15:15:55,233][123090] Updated weights for policy 1, policy_version 1949809 (0.0005) [2023-12-26 15:15:55,296][123090] Updated weights for policy 1, policy_version 1949819 (0.0006) [2023-12-26 15:15:55,313][123091] Updated weights for policy 0, policy_version 1957647 (0.0009) [2023-12-26 15:15:55,356][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:55,938][123090] Updated weights for policy 1, policy_version 1949829 (0.0005) [2023-12-26 15:15:55,992][123090] Updated weights for policy 1, policy_version 1949839 (0.0006) [2023-12-26 15:15:56,058][123090] Updated weights for policy 1, policy_version 1949849 (0.0010) [2023-12-26 15:15:56,210][123091] Updated weights for policy 0, policy_version 1957658 (0.0010) [2023-12-26 15:15:56,271][123091] Updated weights for policy 0, policy_version 1957668 (0.0006) [2023-12-26 15:15:56,295][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:56,756][123090] Updated weights for policy 1, policy_version 1949859 (0.0009) [2023-12-26 15:15:56,805][123090] Updated weights for policy 1, policy_version 1949869 (0.0005) [2023-12-26 15:15:56,852][123090] Updated weights for policy 1, policy_version 1949879 (0.0005) [2023-12-26 15:15:57,083][123091] Updated weights for policy 0, policy_version 1957678 (0.0006) [2023-12-26 15:15:57,147][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:57,148][123091] Updated weights for policy 0, policy_version 1957688 (0.0006) [2023-12-26 15:15:57,599][123090] Updated weights for policy 1, policy_version 1949889 (0.0006) [2023-12-26 15:15:57,655][123090] Updated weights for policy 1, policy_version 1949899 (0.0010) [2023-12-26 15:15:57,718][123090] Updated weights for policy 1, policy_version 1949909 (0.0010) [2023-12-26 15:15:57,768][123090] Updated weights for policy 1, policy_version 1949919 (0.0007) [2023-12-26 15:15:57,822][123091] Updated weights for policy 0, policy_version 1957698 (0.0010) [2023-12-26 15:15:57,856][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:58,584][123090] Updated weights for policy 1, policy_version 1949929 (0.0010) [2023-12-26 15:15:58,653][123090] Updated weights for policy 1, policy_version 1949939 (0.0009) [2023-12-26 15:15:58,732][123090] Updated weights for policy 1, policy_version 1949949 (0.0009) [2023-12-26 15:15:58,784][121949] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 1001545728. Throughput: 0: 8874.2, 1: 8853.3. Samples: 1001540532. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:15:58,785][121949] Avg episode reward: [(0, '6241.237'), (1, '5831.452')] [2023-12-26 15:15:58,878][123091] Updated weights for policy 0, policy_version 1957708 (0.0009) [2023-12-26 15:15:58,951][123091] Updated weights for policy 0, policy_version 1957718 (0.0006) [2023-12-26 15:15:58,963][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:15:59,595][123090] Updated weights for policy 1, policy_version 1949959 (0.0007) [2023-12-26 15:15:59,651][123090] Updated weights for policy 1, policy_version 1949969 (0.0005) [2023-12-26 15:15:59,704][123090] Updated weights for policy 1, policy_version 1949979 (0.0005) [2023-12-26 15:15:59,787][123091] Updated weights for policy 0, policy_version 1957728 (0.0010) [2023-12-26 15:15:59,835][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:00,505][123090] Updated weights for policy 1, policy_version 1949989 (0.0009) [2023-12-26 15:16:00,556][123090] Updated weights for policy 1, policy_version 1949999 (0.0010) [2023-12-26 15:16:00,615][123090] Updated weights for policy 1, policy_version 1950009 (0.0010) [2023-12-26 15:16:00,726][123091] Updated weights for policy 0, policy_version 1957738 (0.0010) [2023-12-26 15:16:00,779][123091] Updated weights for policy 0, policy_version 1957748 (0.0008) [2023-12-26 15:16:00,803][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:01,463][123090] Updated weights for policy 1, policy_version 1950019 (0.0010) [2023-12-26 15:16:01,513][123090] Updated weights for policy 1, policy_version 1950029 (0.0008) [2023-12-26 15:16:01,563][123090] Updated weights for policy 1, policy_version 1950039 (0.0008) [2023-12-26 15:16:01,686][123091] Updated weights for policy 0, policy_version 1957758 (0.0008) [2023-12-26 15:16:01,756][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:01,758][123091] Updated weights for policy 0, policy_version 1957768 (0.0008) [2023-12-26 15:16:02,301][123090] Updated weights for policy 1, policy_version 1950049 (0.0007) [2023-12-26 15:16:02,367][123090] Updated weights for policy 1, policy_version 1950059 (0.0006) [2023-12-26 15:16:02,440][123090] Updated weights for policy 1, policy_version 1950069 (0.0009) [2023-12-26 15:16:02,470][123091] Updated weights for policy 0, policy_version 1957778 (0.0007) [2023-12-26 15:16:02,500][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:02,500][123090] Updated weights for policy 1, policy_version 1950079 (0.0010) [2023-12-26 15:16:03,267][123091] Updated weights for policy 0, policy_version 1957788 (0.0008) [2023-12-26 15:16:03,322][123090] Updated weights for policy 1, policy_version 1950089 (0.0008) [2023-12-26 15:16:03,326][123091] Updated weights for policy 0, policy_version 1957798 (0.0005) [2023-12-26 15:16:03,334][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:03,378][123090] Updated weights for policy 1, policy_version 1950099 (0.0009) [2023-12-26 15:16:03,430][123090] Updated weights for policy 1, policy_version 1950109 (0.0009) [2023-12-26 15:16:03,784][121949] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17883.6). Total num frames: 1001635840. Throughput: 0: 8832.7, 1: 8914.2. Samples: 1001646600. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:03,785][121949] Avg episode reward: [(0, '6125.864'), (1, '5870.143')] [2023-12-26 15:16:04,124][123091] Updated weights for policy 0, policy_version 1957808 (0.0011) [2023-12-26 15:16:04,176][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:04,266][123090] Updated weights for policy 1, policy_version 1950119 (0.0010) [2023-12-26 15:16:04,335][123090] Updated weights for policy 1, policy_version 1950129 (0.0011) [2023-12-26 15:16:04,404][123090] Updated weights for policy 1, policy_version 1950139 (0.0011) [2023-12-26 15:16:04,961][123091] Updated weights for policy 0, policy_version 1957818 (0.0009) [2023-12-26 15:16:05,024][123091] Updated weights for policy 0, policy_version 1957828 (0.0005) [2023-12-26 15:16:05,044][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:05,218][123090] Updated weights for policy 1, policy_version 1950149 (0.0010) [2023-12-26 15:16:05,288][123090] Updated weights for policy 1, policy_version 1950159 (0.0010) [2023-12-26 15:16:05,343][123090] Updated weights for policy 1, policy_version 1950169 (0.0010) [2023-12-26 15:16:05,875][123091] Updated weights for policy 0, policy_version 1957838 (0.0005) [2023-12-26 15:16:05,934][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:05,936][123091] Updated weights for policy 0, policy_version 1957848 (0.0005) [2023-12-26 15:16:06,079][123090] Updated weights for policy 1, policy_version 1950179 (0.0007) [2023-12-26 15:16:06,144][123090] Updated weights for policy 1, policy_version 1950189 (0.0007) [2023-12-26 15:16:06,206][123090] Updated weights for policy 1, policy_version 1950199 (0.0009) [2023-12-26 15:16:06,710][123091] Updated weights for policy 0, policy_version 1957858 (0.0011) [2023-12-26 15:16:06,749][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:07,060][123090] Updated weights for policy 1, policy_version 1950209 (0.0009) [2023-12-26 15:16:07,125][123090] Updated weights for policy 1, policy_version 1950219 (0.0009) [2023-12-26 15:16:07,190][123090] Updated weights for policy 1, policy_version 1950229 (0.0008) [2023-12-26 15:16:07,259][123090] Updated weights for policy 1, policy_version 1950239 (0.0009) [2023-12-26 15:16:07,598][123091] Updated weights for policy 0, policy_version 1957868 (0.0011) [2023-12-26 15:16:07,663][123091] Updated weights for policy 0, policy_version 1957878 (0.0011) [2023-12-26 15:16:07,676][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:08,115][123090] Updated weights for policy 1, policy_version 1950249 (0.0010) [2023-12-26 15:16:08,184][123090] Updated weights for policy 1, policy_version 1950259 (0.0009) [2023-12-26 15:16:08,245][123090] Updated weights for policy 1, policy_version 1950269 (0.0010) [2023-12-26 15:16:08,555][123091] Updated weights for policy 0, policy_version 1957888 (0.0010) [2023-12-26 15:16:08,593][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:08,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17855.8). Total num frames: 1001725952. Throughput: 0: 8893.4, 1: 8952.2. Samples: 1001701688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:08,785][121949] Avg episode reward: [(0, '6180.194'), (1, '5794.950')] [2023-12-26 15:16:08,789][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957896_502456320.pth... [2023-12-26 15:16:08,789][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001950272_499269632.pth... [2023-12-26 15:16:08,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957368_502185984.pth [2023-12-26 15:16:08,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001949248_499007488.pth [2023-12-26 15:16:08,883][123090] Updated weights for policy 1, policy_version 1950279 (0.0007) [2023-12-26 15:16:08,938][123090] Updated weights for policy 1, policy_version 1950289 (0.0005) [2023-12-26 15:16:08,990][123090] Updated weights for policy 1, policy_version 1950299 (0.0005) [2023-12-26 15:16:09,576][123091] Updated weights for policy 0, policy_version 1957898 (0.0009) [2023-12-26 15:16:09,652][123091] Updated weights for policy 0, policy_version 1957908 (0.0009) [2023-12-26 15:16:09,674][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:09,798][123090] Updated weights for policy 1, policy_version 1950309 (0.0006) [2023-12-26 15:16:09,868][123090] Updated weights for policy 1, policy_version 1950319 (0.0009) [2023-12-26 15:16:09,934][123090] Updated weights for policy 1, policy_version 1950329 (0.0009) [2023-12-26 15:16:10,590][123091] Updated weights for policy 0, policy_version 1957918 (0.0010) [2023-12-26 15:16:10,652][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:10,655][123091] Updated weights for policy 0, policy_version 1957928 (0.0010) [2023-12-26 15:16:10,790][123090] Updated weights for policy 1, policy_version 1950339 (0.0009) [2023-12-26 15:16:10,846][123090] Updated weights for policy 1, policy_version 1950349 (0.0009) [2023-12-26 15:16:10,901][123090] Updated weights for policy 1, policy_version 1950359 (0.0009) [2023-12-26 15:16:11,562][123091] Updated weights for policy 0, policy_version 1957938 (0.0006) [2023-12-26 15:16:11,603][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:11,842][123090] Updated weights for policy 1, policy_version 1950369 (0.0010) [2023-12-26 15:16:11,916][123090] Updated weights for policy 1, policy_version 1950379 (0.0006) [2023-12-26 15:16:11,994][123090] Updated weights for policy 1, policy_version 1950389 (0.0007) [2023-12-26 15:16:12,058][123090] Updated weights for policy 1, policy_version 1950399 (0.0009) [2023-12-26 15:16:12,481][123091] Updated weights for policy 0, policy_version 1957948 (0.0009) [2023-12-26 15:16:12,541][123091] Updated weights for policy 0, policy_version 1957958 (0.0010) [2023-12-26 15:16:12,548][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:12,853][123090] Updated weights for policy 1, policy_version 1950409 (0.0009) [2023-12-26 15:16:12,913][123090] Updated weights for policy 1, policy_version 1950419 (0.0006) [2023-12-26 15:16:12,980][123090] Updated weights for policy 1, policy_version 1950429 (0.0010) [2023-12-26 15:16:13,468][123091] Updated weights for policy 0, policy_version 1957968 (0.0010) [2023-12-26 15:16:13,514][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:13,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 1001807872. Throughput: 0: 8875.3, 1: 8836.8. Samples: 1001803576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:13,784][121949] Avg episode reward: [(0, '6144.544'), (1, '5767.853')] [2023-12-26 15:16:13,833][123090] Updated weights for policy 1, policy_version 1950439 (0.0009) [2023-12-26 15:16:13,887][123090] Updated weights for policy 1, policy_version 1950449 (0.0009) [2023-12-26 15:16:13,944][123090] Updated weights for policy 1, policy_version 1950459 (0.0009) [2023-12-26 15:16:14,283][123091] Updated weights for policy 0, policy_version 1957978 (0.0007) [2023-12-26 15:16:14,352][123091] Updated weights for policy 0, policy_version 1957988 (0.0005) [2023-12-26 15:16:14,375][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:14,859][123090] Updated weights for policy 1, policy_version 1950469 (0.0010) [2023-12-26 15:16:14,916][123090] Updated weights for policy 1, policy_version 1950479 (0.0009) [2023-12-26 15:16:14,979][123090] Updated weights for policy 1, policy_version 1950489 (0.0010) [2023-12-26 15:16:15,114][123091] Updated weights for policy 0, policy_version 1957998 (0.0009) [2023-12-26 15:16:15,182][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:15,183][123091] Updated weights for policy 0, policy_version 1958008 (0.0009) [2023-12-26 15:16:15,859][123091] Updated weights for policy 0, policy_version 1958018 (0.0011) [2023-12-26 15:16:15,882][123090] Updated weights for policy 1, policy_version 1950499 (0.0009) [2023-12-26 15:16:15,896][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:15,944][123090] Updated weights for policy 1, policy_version 1950509 (0.0008) [2023-12-26 15:16:16,001][123090] Updated weights for policy 1, policy_version 1950519 (0.0009) [2023-12-26 15:16:16,767][123091] Updated weights for policy 0, policy_version 1958028 (0.0010) [2023-12-26 15:16:16,814][123091] Updated weights for policy 0, policy_version 1958038 (0.0008) [2023-12-26 15:16:16,822][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:16,852][123090] Updated weights for policy 1, policy_version 1950529 (0.0009) [2023-12-26 15:16:16,905][123090] Updated weights for policy 1, policy_version 1950539 (0.0009) [2023-12-26 15:16:16,960][123090] Updated weights for policy 1, policy_version 1950549 (0.0009) [2023-12-26 15:16:17,018][123090] Updated weights for policy 1, policy_version 1950559 (0.0010) [2023-12-26 15:16:17,679][123091] Updated weights for policy 0, policy_version 1958048 (0.0009) [2023-12-26 15:16:17,727][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:17,867][123090] Updated weights for policy 1, policy_version 1950569 (0.0009) [2023-12-26 15:16:17,914][123090] Updated weights for policy 1, policy_version 1950579 (0.0010) [2023-12-26 15:16:17,970][123090] Updated weights for policy 1, policy_version 1950589 (0.0005) [2023-12-26 15:16:18,566][123091] Updated weights for policy 0, policy_version 1958058 (0.0008) [2023-12-26 15:16:18,632][123091] Updated weights for policy 0, policy_version 1958068 (0.0009) [2023-12-26 15:16:18,656][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:18,771][123090] Updated weights for policy 1, policy_version 1950599 (0.0010) [2023-12-26 15:16:18,784][121949] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 1001897984. Throughput: 0: 8945.2, 1: 8794.4. Samples: 1001909396. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:18,785][121949] Avg episode reward: [(0, '6230.332'), (1, '5739.315')] [2023-12-26 15:16:18,831][123090] Updated weights for policy 1, policy_version 1950609 (0.0010) [2023-12-26 15:16:18,890][123090] Updated weights for policy 1, policy_version 1950619 (0.0010) [2023-12-26 15:16:19,568][123091] Updated weights for policy 0, policy_version 1958078 (0.0007) [2023-12-26 15:16:19,615][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:19,617][123091] Updated weights for policy 0, policy_version 1958088 (0.0005) [2023-12-26 15:16:19,719][123090] Updated weights for policy 1, policy_version 1950629 (0.0010) [2023-12-26 15:16:19,784][123090] Updated weights for policy 1, policy_version 1950639 (0.0009) [2023-12-26 15:16:19,855][123090] Updated weights for policy 1, policy_version 1950649 (0.0010) [2023-12-26 15:16:20,484][123091] Updated weights for policy 0, policy_version 1958098 (0.0005) [2023-12-26 15:16:20,513][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:20,778][123090] Updated weights for policy 1, policy_version 1950659 (0.0009) [2023-12-26 15:16:20,846][123090] Updated weights for policy 1, policy_version 1950669 (0.0009) [2023-12-26 15:16:20,930][123090] Updated weights for policy 1, policy_version 1950679 (0.0010) [2023-12-26 15:16:21,313][123091] Updated weights for policy 0, policy_version 1958108 (0.0007) [2023-12-26 15:16:21,385][123091] Updated weights for policy 0, policy_version 1958118 (0.0009) [2023-12-26 15:16:21,393][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:21,773][123090] Updated weights for policy 1, policy_version 1950689 (0.0008) [2023-12-26 15:16:21,837][123090] Updated weights for policy 1, policy_version 1950699 (0.0005) [2023-12-26 15:16:21,902][123090] Updated weights for policy 1, policy_version 1950709 (0.0005) [2023-12-26 15:16:21,973][123090] Updated weights for policy 1, policy_version 1950719 (0.0008) [2023-12-26 15:16:22,327][123091] Updated weights for policy 0, policy_version 1958128 (0.0009) [2023-12-26 15:16:22,377][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:22,785][123090] Updated weights for policy 1, policy_version 1950729 (0.0011) [2023-12-26 15:16:22,850][123090] Updated weights for policy 1, policy_version 1950739 (0.0011) [2023-12-26 15:16:22,914][123090] Updated weights for policy 1, policy_version 1950749 (0.0011) [2023-12-26 15:16:23,289][123091] Updated weights for policy 0, policy_version 1958138 (0.0010) [2023-12-26 15:16:23,345][123091] Updated weights for policy 0, policy_version 1958148 (0.0009) [2023-12-26 15:16:23,359][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:23,592][123090] Updated weights for policy 1, policy_version 1950759 (0.0010) [2023-12-26 15:16:23,639][123090] Updated weights for policy 1, policy_version 1950769 (0.0008) [2023-12-26 15:16:23,693][123090] Updated weights for policy 1, policy_version 1950779 (0.0007) [2023-12-26 15:16:23,784][121949] Fps is (10 sec: 18022.1, 60 sec: 17749.4, 300 sec: 17883.5). Total num frames: 1001988096. Throughput: 0: 8971.4, 1: 8735.2. Samples: 1001959952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:23,785][121949] Avg episode reward: [(0, '6312.732'), (1, '5661.619')] [2023-12-26 15:16:23,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958152_502587392.pth... [2023-12-26 15:16:23,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001950784_499400704.pth... [2023-12-26 15:16:23,801][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957624_502317056.pth [2023-12-26 15:16:23,801][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001949760_499138560.pth [2023-12-26 15:16:24,327][123091] Updated weights for policy 0, policy_version 1958159 (0.0009) [2023-12-26 15:16:24,376][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:24,418][123090] Updated weights for policy 1, policy_version 1950789 (0.0007) [2023-12-26 15:16:24,468][123090] Updated weights for policy 1, policy_version 1950799 (0.0006) [2023-12-26 15:16:24,531][123090] Updated weights for policy 1, policy_version 1950809 (0.0010) [2023-12-26 15:16:25,274][123090] Updated weights for policy 1, policy_version 1950819 (0.0008) [2023-12-26 15:16:25,311][123091] Updated weights for policy 0, policy_version 1958169 (0.0009) [2023-12-26 15:16:25,339][123090] Updated weights for policy 1, policy_version 1950829 (0.0006) [2023-12-26 15:16:25,373][123091] Updated weights for policy 0, policy_version 1958179 (0.0009) [2023-12-26 15:16:25,400][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:25,406][123090] Updated weights for policy 1, policy_version 1950839 (0.0005) [2023-12-26 15:16:26,082][123090] Updated weights for policy 1, policy_version 1950849 (0.0005) [2023-12-26 15:16:26,139][123090] Updated weights for policy 1, policy_version 1950859 (0.0005) [2023-12-26 15:16:26,188][123090] Updated weights for policy 1, policy_version 1950869 (0.0006) [2023-12-26 15:16:26,250][123090] Updated weights for policy 1, policy_version 1950879 (0.0006) [2023-12-26 15:16:26,252][123091] Updated weights for policy 0, policy_version 1958189 (0.0008) [2023-12-26 15:16:26,305][123091] Updated weights for policy 0, policy_version 1958199 (0.0010) [2023-12-26 15:16:26,308][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:26,887][123090] Updated weights for policy 1, policy_version 1950889 (0.0009) [2023-12-26 15:16:26,936][123090] Updated weights for policy 1, policy_version 1950900 (0.0009) [2023-12-26 15:16:26,992][123090] Updated weights for policy 1, policy_version 1950910 (0.0009) [2023-12-26 15:16:27,224][123091] Updated weights for policy 0, policy_version 1958209 (0.0009) [2023-12-26 15:16:27,258][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:27,819][123090] Updated weights for policy 1, policy_version 1950920 (0.0006) [2023-12-26 15:16:27,879][123090] Updated weights for policy 1, policy_version 1950930 (0.0005) [2023-12-26 15:16:27,933][123090] Updated weights for policy 1, policy_version 1950940 (0.0005) [2023-12-26 15:16:28,177][123091] Updated weights for policy 0, policy_version 1958219 (0.0009) [2023-12-26 15:16:28,242][123091] Updated weights for policy 0, policy_version 1958229 (0.0009) [2023-12-26 15:16:28,259][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:28,621][123090] Updated weights for policy 1, policy_version 1950950 (0.0008) [2023-12-26 15:16:28,677][123090] Updated weights for policy 1, policy_version 1950960 (0.0009) [2023-12-26 15:16:28,737][123090] Updated weights for policy 1, policy_version 1950970 (0.0009) [2023-12-26 15:16:28,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 1002078208. Throughput: 0: 8973.8, 1: 8847.2. Samples: 1002068128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:28,785][121949] Avg episode reward: [(0, '6246.442'), (1, '5682.266')] [2023-12-26 15:16:29,189][123091] Updated weights for policy 0, policy_version 1958240 (0.0010) [2023-12-26 15:16:29,232][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:29,519][123090] Updated weights for policy 1, policy_version 1950980 (0.0009) [2023-12-26 15:16:29,590][123090] Updated weights for policy 1, policy_version 1950990 (0.0006) [2023-12-26 15:16:29,661][123090] Updated weights for policy 1, policy_version 1951000 (0.0006) [2023-12-26 15:16:30,147][123091] Updated weights for policy 0, policy_version 1958250 (0.0010) [2023-12-26 15:16:30,212][123091] Updated weights for policy 0, policy_version 1958260 (0.0009) [2023-12-26 15:16:30,236][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:30,241][123090] Updated weights for policy 1, policy_version 1951010 (0.0005) [2023-12-26 15:16:30,308][123090] Updated weights for policy 1, policy_version 1951020 (0.0006) [2023-12-26 15:16:30,370][123090] Updated weights for policy 1, policy_version 1951030 (0.0005) [2023-12-26 15:16:30,421][123090] Updated weights for policy 1, policy_version 1951040 (0.0006) [2023-12-26 15:16:31,150][123090] Updated weights for policy 1, policy_version 1951050 (0.0008) [2023-12-26 15:16:31,183][123091] Updated weights for policy 0, policy_version 1958270 (0.0009) [2023-12-26 15:16:31,210][123090] Updated weights for policy 1, policy_version 1951060 (0.0007) [2023-12-26 15:16:31,246][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:31,249][123091] Updated weights for policy 0, policy_version 1958280 (0.0008) [2023-12-26 15:16:31,269][123090] Updated weights for policy 1, policy_version 1951070 (0.0008) [2023-12-26 15:16:32,040][123090] Updated weights for policy 1, policy_version 1951080 (0.0009) [2023-12-26 15:16:32,112][123090] Updated weights for policy 1, policy_version 1951090 (0.0006) [2023-12-26 15:16:32,171][123090] Updated weights for policy 1, policy_version 1951100 (0.0007) [2023-12-26 15:16:32,204][123091] Updated weights for policy 0, policy_version 1958290 (0.0008) [2023-12-26 15:16:32,231][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:32,847][123090] Updated weights for policy 1, policy_version 1951110 (0.0010) [2023-12-26 15:16:32,902][123090] Updated weights for policy 1, policy_version 1951120 (0.0008) [2023-12-26 15:16:32,955][123090] Updated weights for policy 1, policy_version 1951130 (0.0009) [2023-12-26 15:16:33,058][123091] Updated weights for policy 0, policy_version 1958300 (0.0009) [2023-12-26 15:16:33,108][123091] Updated weights for policy 0, policy_version 1958310 (0.0009) [2023-12-26 15:16:33,114][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:33,784][121949] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17855.8). Total num frames: 1002160128. Throughput: 0: 8857.9, 1: 8894.1. Samples: 1002174916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:33,785][121949] Avg episode reward: [(0, '6262.500'), (1, '5896.824')] [2023-12-26 15:16:33,788][123090] Updated weights for policy 1, policy_version 1951140 (0.0010) [2023-12-26 15:16:33,847][123090] Updated weights for policy 1, policy_version 1951150 (0.0008) [2023-12-26 15:16:33,906][123090] Updated weights for policy 1, policy_version 1951160 (0.0009) [2023-12-26 15:16:34,013][123091] Updated weights for policy 0, policy_version 1958320 (0.0010) [2023-12-26 15:16:34,072][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:34,647][123090] Updated weights for policy 1, policy_version 1951170 (0.0008) [2023-12-26 15:16:34,714][123090] Updated weights for policy 1, policy_version 1951180 (0.0006) [2023-12-26 15:16:34,784][123090] Updated weights for policy 1, policy_version 1951190 (0.0008) [2023-12-26 15:16:34,837][123091] Updated weights for policy 0, policy_version 1958330 (0.0006) [2023-12-26 15:16:34,855][123090] Updated weights for policy 1, policy_version 1951200 (0.0007) [2023-12-26 15:16:34,912][123091] Updated weights for policy 0, policy_version 1958340 (0.0007) [2023-12-26 15:16:34,936][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:35,607][123090] Updated weights for policy 1, policy_version 1951210 (0.0005) [2023-12-26 15:16:35,654][123091] Updated weights for policy 0, policy_version 1958350 (0.0009) [2023-12-26 15:16:35,668][123090] Updated weights for policy 1, policy_version 1951220 (0.0005) [2023-12-26 15:16:35,704][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:35,708][123091] Updated weights for policy 0, policy_version 1958360 (0.0010) [2023-12-26 15:16:35,724][123090] Updated weights for policy 1, policy_version 1951230 (0.0005) [2023-12-26 15:16:36,441][123090] Updated weights for policy 1, policy_version 1951240 (0.0008) [2023-12-26 15:16:36,501][123090] Updated weights for policy 1, policy_version 1951250 (0.0008) [2023-12-26 15:16:36,555][123090] Updated weights for policy 1, policy_version 1951260 (0.0009) [2023-12-26 15:16:36,618][123091] Updated weights for policy 0, policy_version 1958370 (0.0011) [2023-12-26 15:16:36,648][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:37,419][123091] Updated weights for policy 0, policy_version 1958380 (0.0009) [2023-12-26 15:16:37,456][123090] Updated weights for policy 1, policy_version 1951270 (0.0008) [2023-12-26 15:16:37,488][123091] Updated weights for policy 0, policy_version 1958390 (0.0010) [2023-12-26 15:16:37,498][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:37,519][123090] Updated weights for policy 1, policy_version 1951280 (0.0009) [2023-12-26 15:16:37,588][123090] Updated weights for policy 1, policy_version 1951290 (0.0008) [2023-12-26 15:16:38,314][123091] Updated weights for policy 0, policy_version 1958400 (0.0011) [2023-12-26 15:16:38,367][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:38,379][123090] Updated weights for policy 1, policy_version 1951300 (0.0009) [2023-12-26 15:16:38,439][123090] Updated weights for policy 1, policy_version 1951310 (0.0011) [2023-12-26 15:16:38,503][123090] Updated weights for policy 1, policy_version 1951320 (0.0010) [2023-12-26 15:16:38,784][121949] Fps is (10 sec: 18022.3, 60 sec: 17885.8, 300 sec: 17855.8). Total num frames: 1002258432. Throughput: 0: 8945.6, 1: 8900.6. Samples: 1002231260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:38,785][121949] Avg episode reward: [(0, '6275.912'), (1, '6025.000')] [2023-12-26 15:16:38,791][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958408_502718464.pth... [2023-12-26 15:16:38,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001951328_499539968.pth... [2023-12-26 15:16:38,794][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001957896_502456320.pth [2023-12-26 15:16:38,796][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001950272_499269632.pth [2023-12-26 15:16:39,220][123091] Updated weights for policy 0, policy_version 1958410 (0.0010) [2023-12-26 15:16:39,246][123090] Updated weights for policy 1, policy_version 1951330 (0.0011) [2023-12-26 15:16:39,288][123091] Updated weights for policy 0, policy_version 1958420 (0.0009) [2023-12-26 15:16:39,311][123090] Updated weights for policy 1, policy_version 1951340 (0.0011) [2023-12-26 15:16:39,311][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:39,388][123090] Updated weights for policy 1, policy_version 1951350 (0.0008) [2023-12-26 15:16:39,457][123090] Updated weights for policy 1, policy_version 1951360 (0.0008) [2023-12-26 15:16:40,184][123091] Updated weights for policy 0, policy_version 1958430 (0.0010) [2023-12-26 15:16:40,234][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:40,237][123091] Updated weights for policy 0, policy_version 1958440 (0.0009) [2023-12-26 15:16:40,306][123090] Updated weights for policy 1, policy_version 1951370 (0.0011) [2023-12-26 15:16:40,379][123090] Updated weights for policy 1, policy_version 1951380 (0.0011) [2023-12-26 15:16:40,442][123090] Updated weights for policy 1, policy_version 1951390 (0.0006) [2023-12-26 15:16:41,141][123091] Updated weights for policy 0, policy_version 1958450 (0.0009) [2023-12-26 15:16:41,168][123090] Updated weights for policy 1, policy_version 1951400 (0.0009) [2023-12-26 15:16:41,180][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:41,238][123090] Updated weights for policy 1, policy_version 1951410 (0.0011) [2023-12-26 15:16:41,306][123090] Updated weights for policy 1, policy_version 1951420 (0.0011) [2023-12-26 15:16:42,127][123090] Updated weights for policy 1, policy_version 1951430 (0.0009) [2023-12-26 15:16:42,134][123091] Updated weights for policy 0, policy_version 1958460 (0.0008) [2023-12-26 15:16:42,180][123090] Updated weights for policy 1, policy_version 1951440 (0.0011) [2023-12-26 15:16:42,200][123091] Updated weights for policy 0, policy_version 1958470 (0.0006) [2023-12-26 15:16:42,212][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:42,237][123090] Updated weights for policy 1, policy_version 1951450 (0.0010) [2023-12-26 15:16:43,074][123091] Updated weights for policy 0, policy_version 1958480 (0.0005) [2023-12-26 15:16:43,077][123090] Updated weights for policy 1, policy_version 1951460 (0.0011) [2023-12-26 15:16:43,118][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:43,132][123090] Updated weights for policy 1, policy_version 1951470 (0.0010) [2023-12-26 15:16:43,187][123090] Updated weights for policy 1, policy_version 1951480 (0.0010) [2023-12-26 15:16:43,784][121949] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17828.0). Total num frames: 1002340352. Throughput: 0: 8857.5, 1: 8788.9. Samples: 1002334620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:43,785][121949] Avg episode reward: [(0, '6339.078'), (1, '6022.684')] [2023-12-26 15:16:43,824][123091] Updated weights for policy 0, policy_version 1958490 (0.0007) [2023-12-26 15:16:43,887][123091] Updated weights for policy 0, policy_version 1958500 (0.0009) [2023-12-26 15:16:43,911][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:43,996][123090] Updated weights for policy 1, policy_version 1951490 (0.0010) [2023-12-26 15:16:44,066][123090] Updated weights for policy 1, policy_version 1951500 (0.0011) [2023-12-26 15:16:44,122][123090] Updated weights for policy 1, policy_version 1951510 (0.0010) [2023-12-26 15:16:44,169][123090] Updated weights for policy 1, policy_version 1951520 (0.0010) [2023-12-26 15:16:44,771][123091] Updated weights for policy 0, policy_version 1958510 (0.0008) [2023-12-26 15:16:44,834][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:44,836][123091] Updated weights for policy 0, policy_version 1958520 (0.0009) [2023-12-26 15:16:44,976][123090] Updated weights for policy 1, policy_version 1951530 (0.0008) [2023-12-26 15:16:45,037][123090] Updated weights for policy 1, policy_version 1951540 (0.0011) [2023-12-26 15:16:45,104][123090] Updated weights for policy 1, policy_version 1951550 (0.0011) [2023-12-26 15:16:45,838][123090] Updated weights for policy 1, policy_version 1951560 (0.0007) [2023-12-26 15:16:45,857][123091] Updated weights for policy 0, policy_version 1958530 (0.0008) [2023-12-26 15:16:45,891][123090] Updated weights for policy 1, policy_version 1951570 (0.0005) [2023-12-26 15:16:45,896][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:45,936][123090] Updated weights for policy 1, policy_version 1951580 (0.0005) [2023-12-26 15:16:46,627][123090] Updated weights for policy 1, policy_version 1951590 (0.0007) [2023-12-26 15:16:46,678][123090] Updated weights for policy 1, policy_version 1951600 (0.0006) [2023-12-26 15:16:46,735][123090] Updated weights for policy 1, policy_version 1951610 (0.0009) [2023-12-26 15:16:46,790][123091] Updated weights for policy 0, policy_version 1958540 (0.0006) [2023-12-26 15:16:46,859][123091] Updated weights for policy 0, policy_version 1958550 (0.0005) [2023-12-26 15:16:46,869][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:47,528][123090] Updated weights for policy 1, policy_version 1951621 (0.0010) [2023-12-26 15:16:47,531][123091] Updated weights for policy 0, policy_version 1958560 (0.0007) [2023-12-26 15:16:47,574][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:47,579][123090] Updated weights for policy 1, policy_version 1951631 (0.0010) [2023-12-26 15:16:47,644][123090] Updated weights for policy 1, policy_version 1951641 (0.0010) [2023-12-26 15:16:48,398][123090] Updated weights for policy 1, policy_version 1951651 (0.0009) [2023-12-26 15:16:48,454][123090] Updated weights for policy 1, policy_version 1951661 (0.0006) [2023-12-26 15:16:48,503][123091] Updated weights for policy 0, policy_version 1958570 (0.0007) [2023-12-26 15:16:48,512][123090] Updated weights for policy 1, policy_version 1951671 (0.0006) [2023-12-26 15:16:48,570][123091] Updated weights for policy 0, policy_version 1958580 (0.0009) [2023-12-26 15:16:48,596][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:48,784][121949] Fps is (10 sec: 18022.7, 60 sec: 18022.4, 300 sec: 17855.8). Total num frames: 1002438656. Throughput: 0: 8838.9, 1: 8897.9. Samples: 1002444752. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:48,784][121949] Avg episode reward: [(0, '6266.818'), (1, '5794.303')] [2023-12-26 15:16:49,234][123090] Updated weights for policy 1, policy_version 1951681 (0.0006) [2023-12-26 15:16:49,298][123090] Updated weights for policy 1, policy_version 1951691 (0.0011) [2023-12-26 15:16:49,369][123090] Updated weights for policy 1, policy_version 1951701 (0.0011) [2023-12-26 15:16:49,428][123090] Updated weights for policy 1, policy_version 1951711 (0.0010) [2023-12-26 15:16:49,506][123091] Updated weights for policy 0, policy_version 1958590 (0.0009) [2023-12-26 15:16:49,567][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:49,568][123091] Updated weights for policy 0, policy_version 1958600 (0.0009) [2023-12-26 15:16:50,259][123090] Updated weights for policy 1, policy_version 1951721 (0.0006) [2023-12-26 15:16:50,319][123090] Updated weights for policy 1, policy_version 1951731 (0.0006) [2023-12-26 15:16:50,377][123090] Updated weights for policy 1, policy_version 1951741 (0.0010) [2023-12-26 15:16:50,517][123091] Updated weights for policy 0, policy_version 1958610 (0.0009) [2023-12-26 15:16:50,552][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:51,232][123090] Updated weights for policy 1, policy_version 1951751 (0.0010) [2023-12-26 15:16:51,303][123090] Updated weights for policy 1, policy_version 1951761 (0.0010) [2023-12-26 15:16:51,378][123090] Updated weights for policy 1, policy_version 1951771 (0.0010) [2023-12-26 15:16:51,409][123091] Updated weights for policy 0, policy_version 1958620 (0.0009) [2023-12-26 15:16:51,458][123091] Updated weights for policy 0, policy_version 1958630 (0.0009) [2023-12-26 15:16:51,466][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:52,233][123090] Updated weights for policy 1, policy_version 1951781 (0.0011) [2023-12-26 15:16:52,290][123090] Updated weights for policy 1, policy_version 1951791 (0.0011) [2023-12-26 15:16:52,356][123090] Updated weights for policy 1, policy_version 1951801 (0.0010) [2023-12-26 15:16:52,404][123091] Updated weights for policy 0, policy_version 1958640 (0.0007) [2023-12-26 15:16:52,451][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:53,114][123090] Updated weights for policy 1, policy_version 1951811 (0.0010) [2023-12-26 15:16:53,180][123090] Updated weights for policy 1, policy_version 1951821 (0.0011) [2023-12-26 15:16:53,239][123090] Updated weights for policy 1, policy_version 1951831 (0.0010) [2023-12-26 15:16:53,277][123091] Updated weights for policy 0, policy_version 1958650 (0.0008) [2023-12-26 15:16:53,328][123091] Updated weights for policy 0, policy_version 1958660 (0.0005) [2023-12-26 15:16:53,344][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:53,784][121949] Fps is (10 sec: 18021.7, 60 sec: 17749.3, 300 sec: 17855.8). Total num frames: 1002520576. Throughput: 0: 8765.0, 1: 8892.6. Samples: 1002496288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:53,786][121949] Avg episode reward: [(0, '6200.962'), (1, '5880.479')] [2023-12-26 15:16:53,793][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958664_502849536.pth... [2023-12-26 15:16:53,793][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001951840_499671040.pth... [2023-12-26 15:16:53,796][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958152_502587392.pth [2023-12-26 15:16:53,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001950784_499400704.pth [2023-12-26 15:16:54,015][123090] Updated weights for policy 1, policy_version 1951841 (0.0010) [2023-12-26 15:16:54,074][123090] Updated weights for policy 1, policy_version 1951851 (0.0010) [2023-12-26 15:16:54,111][123091] Updated weights for policy 0, policy_version 1958670 (0.0006) [2023-12-26 15:16:54,130][123090] Updated weights for policy 1, policy_version 1951861 (0.0011) [2023-12-26 15:16:54,170][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:54,173][123091] Updated weights for policy 0, policy_version 1958680 (0.0007) [2023-12-26 15:16:54,192][123090] Updated weights for policy 1, policy_version 1951871 (0.0010) [2023-12-26 15:16:54,948][123090] Updated weights for policy 1, policy_version 1951881 (0.0006) [2023-12-26 15:16:54,991][123091] Updated weights for policy 0, policy_version 1958690 (0.0009) [2023-12-26 15:16:55,011][123090] Updated weights for policy 1, policy_version 1951891 (0.0006) [2023-12-26 15:16:55,025][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:55,063][123090] Updated weights for policy 1, policy_version 1951901 (0.0005) [2023-12-26 15:16:55,825][123090] Updated weights for policy 1, policy_version 1951911 (0.0008) [2023-12-26 15:16:55,828][123091] Updated weights for policy 0, policy_version 1958700 (0.0007) [2023-12-26 15:16:55,879][123090] Updated weights for policy 1, policy_version 1951921 (0.0005) [2023-12-26 15:16:55,899][123091] Updated weights for policy 0, policy_version 1958710 (0.0005) [2023-12-26 15:16:55,909][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:55,928][123090] Updated weights for policy 1, policy_version 1951931 (0.0005) [2023-12-26 15:16:56,607][123091] Updated weights for policy 0, policy_version 1958720 (0.0005) [2023-12-26 15:16:56,611][123090] Updated weights for policy 1, policy_version 1951941 (0.0005) [2023-12-26 15:16:56,642][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:56,668][123090] Updated weights for policy 1, policy_version 1951951 (0.0005) [2023-12-26 15:16:56,717][123090] Updated weights for policy 1, policy_version 1951961 (0.0005) [2023-12-26 15:16:57,267][123091] Updated weights for policy 0, policy_version 1958730 (0.0005) [2023-12-26 15:16:57,333][123091] Updated weights for policy 0, policy_version 1958740 (0.0006) [2023-12-26 15:16:57,342][123090] Updated weights for policy 1, policy_version 1951971 (0.0006) [2023-12-26 15:16:57,352][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:57,410][123090] Updated weights for policy 1, policy_version 1951981 (0.0005) [2023-12-26 15:16:57,468][123090] Updated weights for policy 1, policy_version 1951991 (0.0005) [2023-12-26 15:16:58,137][123090] Updated weights for policy 1, policy_version 1952001 (0.0006) [2023-12-26 15:16:58,192][123090] Updated weights for policy 1, policy_version 1952011 (0.0008) [2023-12-26 15:16:58,239][123091] Updated weights for policy 0, policy_version 1958750 (0.0009) [2023-12-26 15:16:58,257][123090] Updated weights for policy 1, policy_version 1952021 (0.0007) [2023-12-26 15:16:58,294][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:58,296][123091] Updated weights for policy 0, policy_version 1958760 (0.0008) [2023-12-26 15:16:58,324][123090] Updated weights for policy 1, policy_version 1952031 (0.0007) [2023-12-26 15:16:58,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 1002618880. Throughput: 0: 8947.6, 1: 9011.3. Samples: 1002611724. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:16:58,785][121949] Avg episode reward: [(0, '6286.851'), (1, '5978.774')] [2023-12-26 15:16:59,140][123091] Updated weights for policy 0, policy_version 1958770 (0.0005) [2023-12-26 15:16:59,172][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:16:59,179][123090] Updated weights for policy 1, policy_version 1952041 (0.0010) [2023-12-26 15:16:59,249][123090] Updated weights for policy 1, policy_version 1952051 (0.0011) [2023-12-26 15:16:59,318][123090] Updated weights for policy 1, policy_version 1952061 (0.0010) [2023-12-26 15:16:59,918][123091] Updated weights for policy 0, policy_version 1958780 (0.0007) [2023-12-26 15:16:59,981][123091] Updated weights for policy 0, policy_version 1958790 (0.0009) [2023-12-26 15:16:59,991][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:00,065][123090] Updated weights for policy 1, policy_version 1952071 (0.0010) [2023-12-26 15:17:00,116][123090] Updated weights for policy 1, policy_version 1952081 (0.0009) [2023-12-26 15:17:00,175][123090] Updated weights for policy 1, policy_version 1952092 (0.0011) [2023-12-26 15:17:00,761][123091] Updated weights for policy 0, policy_version 1958800 (0.0008) [2023-12-26 15:17:00,799][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:00,971][123090] Updated weights for policy 1, policy_version 1952103 (0.0007) [2023-12-26 15:17:01,033][123090] Updated weights for policy 1, policy_version 1952113 (0.0006) [2023-12-26 15:17:01,103][123090] Updated weights for policy 1, policy_version 1952123 (0.0008) [2023-12-26 15:17:01,666][123091] Updated weights for policy 0, policy_version 1958810 (0.0006) [2023-12-26 15:17:01,730][123091] Updated weights for policy 0, policy_version 1958820 (0.0007) [2023-12-26 15:17:01,750][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:01,908][123090] Updated weights for policy 1, policy_version 1952133 (0.0007) [2023-12-26 15:17:01,972][123090] Updated weights for policy 1, policy_version 1952143 (0.0005) [2023-12-26 15:17:02,035][123090] Updated weights for policy 1, policy_version 1952153 (0.0005) [2023-12-26 15:17:02,561][123091] Updated weights for policy 0, policy_version 1958830 (0.0008) [2023-12-26 15:17:02,610][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:02,612][123091] Updated weights for policy 0, policy_version 1958840 (0.0009) [2023-12-26 15:17:02,768][123090] Updated weights for policy 1, policy_version 1952163 (0.0005) [2023-12-26 15:17:02,822][123090] Updated weights for policy 1, policy_version 1952173 (0.0006) [2023-12-26 15:17:02,887][123090] Updated weights for policy 1, policy_version 1952183 (0.0010) [2023-12-26 15:17:03,413][123091] Updated weights for policy 0, policy_version 1958850 (0.0006) [2023-12-26 15:17:03,439][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:03,640][123090] Updated weights for policy 1, policy_version 1952193 (0.0010) [2023-12-26 15:17:03,691][123090] Updated weights for policy 1, policy_version 1952203 (0.0005) [2023-12-26 15:17:03,740][123090] Updated weights for policy 1, policy_version 1952213 (0.0005) [2023-12-26 15:17:03,784][121949] Fps is (10 sec: 18842.1, 60 sec: 17885.8, 300 sec: 17883.5). Total num frames: 1002708992. Throughput: 0: 8973.3, 1: 9116.2. Samples: 1002723424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-12-26 15:17:03,785][121949] Avg episode reward: [(0, '6263.059'), (1, '6105.678')] [2023-12-26 15:17:03,789][123090] Updated weights for policy 1, policy_version 1952223 (0.0005) [2023-12-26 15:17:04,149][123091] Updated weights for policy 0, policy_version 1958860 (0.0005) [2023-12-26 15:17:04,217][123091] Updated weights for policy 0, policy_version 1958870 (0.0007) [2023-12-26 15:17:04,226][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:04,562][123090] Updated weights for policy 1, policy_version 1952233 (0.0010) [2023-12-26 15:17:04,624][123090] Updated weights for policy 1, policy_version 1952243 (0.0010) [2023-12-26 15:17:04,687][123090] Updated weights for policy 1, policy_version 1952253 (0.0009) [2023-12-26 15:17:05,073][123091] Updated weights for policy 0, policy_version 1958880 (0.0008) [2023-12-26 15:17:05,109][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:05,371][123090] Updated weights for policy 1, policy_version 1952263 (0.0009) [2023-12-26 15:17:05,434][123090] Updated weights for policy 1, policy_version 1952273 (0.0010) [2023-12-26 15:17:05,505][123090] Updated weights for policy 1, policy_version 1952283 (0.0010) [2023-12-26 15:17:06,026][123091] Updated weights for policy 0, policy_version 1958890 (0.0009) [2023-12-26 15:17:06,087][123091] Updated weights for policy 0, policy_version 1958900 (0.0009) [2023-12-26 15:17:06,106][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:06,325][123090] Updated weights for policy 1, policy_version 1952293 (0.0010) [2023-12-26 15:17:06,392][123090] Updated weights for policy 1, policy_version 1952303 (0.0010) [2023-12-26 15:17:06,458][123090] Updated weights for policy 1, policy_version 1952313 (0.0010) [2023-12-26 15:17:06,966][123091] Updated weights for policy 0, policy_version 1958910 (0.0010) [2023-12-26 15:17:07,034][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:07,038][123091] Updated weights for policy 0, policy_version 1958920 (0.0010) [2023-12-26 15:17:07,273][123090] Updated weights for policy 1, policy_version 1952323 (0.0010) [2023-12-26 15:17:07,338][123090] Updated weights for policy 1, policy_version 1952333 (0.0010) [2023-12-26 15:17:07,394][123090] Updated weights for policy 1, policy_version 1952343 (0.0010) [2023-12-26 15:17:07,936][123091] Updated weights for policy 0, policy_version 1958930 (0.0009) [2023-12-26 15:17:07,972][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:08,245][123090] Updated weights for policy 1, policy_version 1952353 (0.0009) [2023-12-26 15:17:08,296][123090] Updated weights for policy 1, policy_version 1952363 (0.0009) [2023-12-26 15:17:08,360][123090] Updated weights for policy 1, policy_version 1952373 (0.0010) [2023-12-26 15:17:08,428][123090] Updated weights for policy 1, policy_version 1952383 (0.0010) [2023-12-26 15:17:08,784][121949] Fps is (10 sec: 18022.2, 60 sec: 17885.9, 300 sec: 17911.3). Total num frames: 1002799104. Throughput: 0: 8984.1, 1: 9185.6. Samples: 1002777588. Policy #0 lag: (min: 4.0, avg: 4.9, max: 20.0) [2023-12-26 15:17:08,785][121949] Avg episode reward: [(0, '6328.145'), (1, '6013.976')] [2023-12-26 15:17:08,791][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001952384_499810304.pth... [2023-12-26 15:17:08,798][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001951328_499539968.pth [2023-12-26 15:17:08,811][123091] Updated weights for policy 0, policy_version 1958940 (0.0008) [2023-12-26 15:17:08,872][123091] Updated weights for policy 0, policy_version 1958950 (0.0009) [2023-12-26 15:17:08,883][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:08,884][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958952_502996992.pth... [2023-12-26 15:17:08,887][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958408_502718464.pth [2023-12-26 15:17:09,282][123090] Updated weights for policy 1, policy_version 1952393 (0.0010) [2023-12-26 15:17:09,350][123090] Updated weights for policy 1, policy_version 1952403 (0.0009) [2023-12-26 15:17:09,418][123090] Updated weights for policy 1, policy_version 1952413 (0.0010) [2023-12-26 15:17:09,844][123091] Updated weights for policy 0, policy_version 1958960 (0.0010) [2023-12-26 15:17:09,892][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:10,235][123090] Updated weights for policy 1, policy_version 1952423 (0.0007) [2023-12-26 15:17:10,301][123090] Updated weights for policy 1, policy_version 1952433 (0.0009) [2023-12-26 15:17:10,358][123090] Updated weights for policy 1, policy_version 1952443 (0.0009) [2023-12-26 15:17:10,829][123091] Updated weights for policy 0, policy_version 1958970 (0.0010) [2023-12-26 15:17:10,899][123091] Updated weights for policy 0, policy_version 1958980 (0.0010) [2023-12-26 15:17:10,917][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:11,114][123090] Updated weights for policy 1, policy_version 1952453 (0.0010) [2023-12-26 15:17:11,195][123090] Updated weights for policy 1, policy_version 1952463 (0.0010) [2023-12-26 15:17:11,260][123090] Updated weights for policy 1, policy_version 1952473 (0.0008) [2023-12-26 15:17:11,810][123091] Updated weights for policy 0, policy_version 1958990 (0.0009) [2023-12-26 15:17:11,865][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:11,868][123091] Updated weights for policy 0, policy_version 1959000 (0.0009) [2023-12-26 15:17:12,125][123090] Updated weights for policy 1, policy_version 1952483 (0.0009) [2023-12-26 15:17:12,192][123090] Updated weights for policy 1, policy_version 1952493 (0.0010) [2023-12-26 15:17:12,261][123090] Updated weights for policy 1, policy_version 1952503 (0.0010) [2023-12-26 15:17:12,824][123091] Updated weights for policy 0, policy_version 1959010 (0.0009) [2023-12-26 15:17:12,858][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:13,091][123090] Updated weights for policy 1, policy_version 1952513 (0.0010) [2023-12-26 15:17:13,157][123090] Updated weights for policy 1, policy_version 1952523 (0.0007) [2023-12-26 15:17:13,225][123090] Updated weights for policy 1, policy_version 1952533 (0.0005) [2023-12-26 15:17:13,301][123090] Updated weights for policy 1, policy_version 1952543 (0.0005) [2023-12-26 15:17:13,784][121949] Fps is (10 sec: 17203.4, 60 sec: 17885.9, 300 sec: 17883.6). Total num frames: 1002881024. Throughput: 0: 8991.1, 1: 9033.9. Samples: 1002879252. Policy #0 lag: (min: 4.0, avg: 4.9, max: 20.0) [2023-12-26 15:17:13,784][121949] Avg episode reward: [(0, '6332.452'), (1, '5906.346')] [2023-12-26 15:17:13,798][123091] Updated weights for policy 0, policy_version 1959020 (0.0010) [2023-12-26 15:17:13,864][123091] Updated weights for policy 0, policy_version 1959030 (0.0009) [2023-12-26 15:17:13,873][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:13,990][123090] Updated weights for policy 1, policy_version 1952553 (0.0006) [2023-12-26 15:17:14,048][123090] Updated weights for policy 1, policy_version 1952563 (0.0005) [2023-12-26 15:17:14,109][123090] Updated weights for policy 1, policy_version 1952573 (0.0006) [2023-12-26 15:17:14,849][123091] Updated weights for policy 0, policy_version 1959040 (0.0007) [2023-12-26 15:17:14,853][123090] Updated weights for policy 1, policy_version 1952583 (0.0007) [2023-12-26 15:17:14,896][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:14,913][123090] Updated weights for policy 1, policy_version 1952593 (0.0008) [2023-12-26 15:17:14,975][123090] Updated weights for policy 1, policy_version 1952603 (0.0008) [2023-12-26 15:17:15,780][123090] Updated weights for policy 1, policy_version 1952613 (0.0009) [2023-12-26 15:17:15,782][123091] Updated weights for policy 0, policy_version 1959050 (0.0008) [2023-12-26 15:17:15,832][123091] Updated weights for policy 0, policy_version 1959060 (0.0008) [2023-12-26 15:17:15,839][123090] Updated weights for policy 1, policy_version 1952623 (0.0010) [2023-12-26 15:17:15,849][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:15,896][123090] Updated weights for policy 1, policy_version 1952633 (0.0010) [2023-12-26 15:17:16,716][123090] Updated weights for policy 1, policy_version 1952643 (0.0009) [2023-12-26 15:17:16,757][123091] Updated weights for policy 0, policy_version 1959070 (0.0006) [2023-12-26 15:17:16,771][123090] Updated weights for policy 1, policy_version 1952653 (0.0009) [2023-12-26 15:17:16,811][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:16,812][123091] Updated weights for policy 0, policy_version 1959080 (0.0008) [2023-12-26 15:17:16,831][123090] Updated weights for policy 1, policy_version 1952663 (0.0010) [2023-12-26 15:17:17,653][123090] Updated weights for policy 1, policy_version 1952673 (0.0010) [2023-12-26 15:17:17,717][123090] Updated weights for policy 1, policy_version 1952683 (0.0005) [2023-12-26 15:17:17,726][123091] Updated weights for policy 0, policy_version 1959090 (0.0009) [2023-12-26 15:17:17,758][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:17,796][123090] Updated weights for policy 1, policy_version 1952693 (0.0005) [2023-12-26 15:17:17,873][123090] Updated weights for policy 1, policy_version 1952703 (0.0006) [2023-12-26 15:17:18,586][123090] Updated weights for policy 1, policy_version 1952713 (0.0007) [2023-12-26 15:17:18,657][123090] Updated weights for policy 1, policy_version 1952723 (0.0006) [2023-12-26 15:17:18,664][123091] Updated weights for policy 0, policy_version 1959100 (0.0007) [2023-12-26 15:17:18,722][123090] Updated weights for policy 1, policy_version 1952733 (0.0008) [2023-12-26 15:17:18,725][123091] Updated weights for policy 0, policy_version 1959110 (0.0009) [2023-12-26 15:17:18,732][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:18,784][121949] Fps is (10 sec: 18022.5, 60 sec: 18022.4, 300 sec: 17911.3). Total num frames: 1002979328. Throughput: 0: 8988.0, 1: 8983.4. Samples: 1002983628. Policy #0 lag: (min: 4.0, avg: 4.9, max: 20.0) [2023-12-26 15:17:18,785][121949] Avg episode reward: [(0, '6324.560'), (1, '5844.498')] [2023-12-26 15:17:19,400][123090] Updated weights for policy 1, policy_version 1952743 (0.0007) [2023-12-26 15:17:19,456][123090] Updated weights for policy 1, policy_version 1952753 (0.0005) [2023-12-26 15:17:19,522][123090] Updated weights for policy 1, policy_version 1952763 (0.0009) [2023-12-26 15:17:19,678][123091] Updated weights for policy 0, policy_version 1959120 (0.0009) [2023-12-26 15:17:19,728][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:20,318][123090] Updated weights for policy 1, policy_version 1952773 (0.0008) [2023-12-26 15:17:20,388][123090] Updated weights for policy 1, policy_version 1952783 (0.0009) [2023-12-26 15:17:20,460][123090] Updated weights for policy 1, policy_version 1952793 (0.0009) [2023-12-26 15:17:20,603][123091] Updated weights for policy 0, policy_version 1959130 (0.0010) [2023-12-26 15:17:20,665][123091] Updated weights for policy 0, policy_version 1959140 (0.0009) [2023-12-26 15:17:20,690][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:21,315][123090] Updated weights for policy 1, policy_version 1952803 (0.0008) [2023-12-26 15:17:21,387][123090] Updated weights for policy 1, policy_version 1952813 (0.0008) [2023-12-26 15:17:21,443][123090] Updated weights for policy 1, policy_version 1952823 (0.0008) [2023-12-26 15:17:21,617][123091] Updated weights for policy 0, policy_version 1959150 (0.0008) [2023-12-26 15:17:21,687][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:21,691][123091] Updated weights for policy 0, policy_version 1959160 (0.0008) [2023-12-26 15:17:22,223][123090] Updated weights for policy 1, policy_version 1952833 (0.0008) [2023-12-26 15:17:22,292][123090] Updated weights for policy 1, policy_version 1952843 (0.0009) [2023-12-26 15:17:22,358][123090] Updated weights for policy 1, policy_version 1952853 (0.0010) [2023-12-26 15:17:22,430][123090] Updated weights for policy 1, policy_version 1952863 (0.0010) [2023-12-26 15:17:22,647][123091] Updated weights for policy 0, policy_version 1959170 (0.0009) [2023-12-26 15:17:22,682][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:23,333][123090] Updated weights for policy 1, policy_version 1952873 (0.0010) [2023-12-26 15:17:23,392][123090] Updated weights for policy 1, policy_version 1952883 (0.0010) [2023-12-26 15:17:23,450][123090] Updated weights for policy 1, policy_version 1952893 (0.0010) [2023-12-26 15:17:23,516][123091] Updated weights for policy 0, policy_version 1959180 (0.0008) [2023-12-26 15:17:23,573][123091] Updated weights for policy 0, policy_version 1959190 (0.0005) [2023-12-26 15:17:23,583][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:23,784][121949] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 1003061248. Throughput: 0: 8912.5, 1: 8943.8. Samples: 1003034792. Policy #0 lag: (min: 4.0, avg: 4.9, max: 20.0) [2023-12-26 15:17:23,785][121949] Avg episode reward: [(0, '6268.333'), (1, '5848.894')] [2023-12-26 15:17:23,790][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001959192_503119872.pth... [2023-12-26 15:17:23,790][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001952896_499941376.pth... [2023-12-26 15:17:23,793][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958664_502849536.pth [2023-12-26 15:17:23,795][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001951840_499671040.pth [2023-12-26 15:17:24,191][123090] Updated weights for policy 1, policy_version 1952903 (0.0006) [2023-12-26 15:17:24,240][123090] Updated weights for policy 1, policy_version 1952913 (0.0007) [2023-12-26 15:17:24,307][123090] Updated weights for policy 1, policy_version 1952923 (0.0009) [2023-12-26 15:17:24,361][123091] Updated weights for policy 0, policy_version 1959200 (0.0009) [2023-12-26 15:17:24,399][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:25,154][123090] Updated weights for policy 1, policy_version 1952933 (0.0010) [2023-12-26 15:17:25,206][123090] Updated weights for policy 1, policy_version 1952944 (0.0009) [2023-12-26 15:17:25,231][123091] Updated weights for policy 0, policy_version 1959210 (0.0010) [2023-12-26 15:17:25,268][123090] Updated weights for policy 1, policy_version 1952954 (0.0010) [2023-12-26 15:17:25,290][123091] Updated weights for policy 0, policy_version 1959220 (0.0007) [2023-12-26 15:17:25,314][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:26,091][123090] Updated weights for policy 1, policy_version 1952964 (0.0007) [2023-12-26 15:17:26,110][123091] Updated weights for policy 0, policy_version 1959230 (0.0010) [2023-12-26 15:17:26,159][123090] Updated weights for policy 1, policy_version 1952974 (0.0009) [2023-12-26 15:17:26,164][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:26,165][123091] Updated weights for policy 0, policy_version 1959240 (0.0006) [2023-12-26 15:17:26,220][123090] Updated weights for policy 1, policy_version 1952984 (0.0009) [2023-12-26 15:17:26,962][123090] Updated weights for policy 1, policy_version 1952994 (0.0009) [2023-12-26 15:17:27,010][123091] Updated weights for policy 0, policy_version 1959250 (0.0010) [2023-12-26 15:17:27,015][123090] Updated weights for policy 1, policy_version 1953004 (0.0007) [2023-12-26 15:17:27,036][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:27,082][123090] Updated weights for policy 1, policy_version 1953014 (0.0010) [2023-12-26 15:17:27,145][123090] Updated weights for policy 1, policy_version 1953024 (0.0010) [2023-12-26 15:17:27,807][123091] Updated weights for policy 0, policy_version 1959260 (0.0009) [2023-12-26 15:17:27,847][123090] Updated weights for policy 1, policy_version 1953034 (0.0005) [2023-12-26 15:17:27,858][123091] Updated weights for policy 0, policy_version 1959270 (0.0006) [2023-12-26 15:17:27,867][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:27,905][123090] Updated weights for policy 1, policy_version 1953044 (0.0005) [2023-12-26 15:17:27,970][123090] Updated weights for policy 1, policy_version 1953054 (0.0005) [2023-12-26 15:17:28,685][123091] Updated weights for policy 0, policy_version 1959280 (0.0005) [2023-12-26 15:17:28,690][123090] Updated weights for policy 1, policy_version 1953064 (0.0010) [2023-12-26 15:17:28,725][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:28,753][123090] Updated weights for policy 1, policy_version 1953074 (0.0010) [2023-12-26 15:17:28,784][121949] Fps is (10 sec: 17203.3, 60 sec: 17885.9, 300 sec: 17855.8). Total num frames: 1003151360. Throughput: 0: 8988.5, 1: 8992.1. Samples: 1003143748. Policy #0 lag: (min: 4.0, avg: 4.9, max: 20.0) [2023-12-26 15:17:28,784][121949] Avg episode reward: [(0, '6300.994'), (1, '5764.158')] [2023-12-26 15:17:28,818][123090] Updated weights for policy 1, policy_version 1953084 (0.0009) [2023-12-26 15:17:29,470][123091] Updated weights for policy 0, policy_version 1959290 (0.0005) [2023-12-26 15:17:29,530][123090] Updated weights for policy 1, policy_version 1953094 (0.0007) [2023-12-26 15:17:29,534][123091] Updated weights for policy 0, policy_version 1959300 (0.0005) [2023-12-26 15:17:29,551][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:29,576][123090] Updated weights for policy 1, policy_version 1953104 (0.0005) [2023-12-26 15:17:29,614][123008] Early stopping after 3 epochs (24 sgd steps), loss delta 0.0000007 [2023-12-26 15:17:30,263][123090] Updated weights for policy 1, policy_version 1953114 (0.0005) [2023-12-26 15:17:30,314][123090] Updated weights for policy 1, policy_version 1953124 (0.0010) [2023-12-26 15:17:30,337][123008] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:30,366][123091] Updated weights for policy 0, policy_version 1959310 (0.0006) [2023-12-26 15:17:30,428][123007] Early stopping after 2 epochs (16 sgd steps), loss delta 0.0000000 [2023-12-26 15:17:30,429][123091] Updated weights for policy 0, policy_version 1959320 (0.0005) [2023-12-26 15:17:30,430][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001959320_503185408.pth... [2023-12-26 15:17:30,430][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001953128_500006912.pth... [2023-12-26 15:17:30,431][123166] Stopping RolloutWorker_w14... [2023-12-26 15:17:30,431][123100] Stopping RolloutWorker_w8... [2023-12-26 15:17:30,431][123100] Loop rollout_proc8_evt_loop terminating... [2023-12-26 15:17:30,431][123097] Stopping RolloutWorker_w6... [2023-12-26 15:17:30,431][123166] Loop rollout_proc14_evt_loop terminating... [2023-12-26 15:17:30,431][123101] Stopping RolloutWorker_w12... [2023-12-26 15:17:30,431][121949] Component RolloutWorker_w14 stopped! [2023-12-26 15:17:30,431][123097] Loop rollout_proc6_evt_loop terminating... [2023-12-26 15:17:30,431][123101] Loop rollout_proc12_evt_loop terminating... [2023-12-26 15:17:30,431][123098] Stopping RolloutWorker_w5... [2023-12-26 15:17:30,431][123167] Stopping RolloutWorker_w13... [2023-12-26 15:17:30,431][123096] Stopping RolloutWorker_w4... [2023-12-26 15:17:30,432][123098] Loop rollout_proc5_evt_loop terminating... [2023-12-26 15:17:30,432][123167] Loop rollout_proc13_evt_loop terminating... [2023-12-26 15:17:30,431][121949] Component RolloutWorker_w8 stopped! [2023-12-26 15:17:30,432][123096] Loop rollout_proc4_evt_loop terminating... [2023-12-26 15:17:30,432][123093] Stopping RolloutWorker_w0... [2023-12-26 15:17:30,432][123099] Stopping RolloutWorker_w9... [2023-12-26 15:17:30,432][121949] Component RolloutWorker_w6 stopped! [2023-12-26 15:17:30,432][123092] Stopping RolloutWorker_w2... [2023-12-26 15:17:30,432][123137] Stopping RolloutWorker_w10... [2023-12-26 15:17:30,432][123099] Loop rollout_proc9_evt_loop terminating... [2023-12-26 15:17:30,432][123093] Loop rollout_proc0_evt_loop terminating... [2023-12-26 15:17:30,432][121949] Component RolloutWorker_w12 stopped! [2023-12-26 15:17:30,432][123092] Loop rollout_proc2_evt_loop terminating... [2023-12-26 15:17:30,433][123137] Loop rollout_proc10_evt_loop terminating... [2023-12-26 15:17:30,433][123094] Stopping RolloutWorker_w1... [2023-12-26 15:17:30,433][121949] Component RolloutWorker_w13 stopped! [2023-12-26 15:17:30,433][123095] Stopping RolloutWorker_w3... [2023-12-26 15:17:30,433][123134] Stopping RolloutWorker_w11... [2023-12-26 15:17:30,433][123102] Stopping RolloutWorker_w7... [2023-12-26 15:17:30,433][123094] Loop rollout_proc1_evt_loop terminating... [2023-12-26 15:17:30,433][123201] Stopping RolloutWorker_w15... [2023-12-26 15:17:30,433][121949] Component RolloutWorker_w5 stopped! [2023-12-26 15:17:30,433][123134] Loop rollout_proc11_evt_loop terminating... [2023-12-26 15:17:30,433][123095] Loop rollout_proc3_evt_loop terminating... [2023-12-26 15:17:30,433][123102] Loop rollout_proc7_evt_loop terminating... [2023-12-26 15:17:30,433][123201] Loop rollout_proc15_evt_loop terminating... [2023-12-26 15:17:30,433][121949] Component RolloutWorker_w4 stopped! [2023-12-26 15:17:30,434][121949] Component RolloutWorker_w0 stopped! [2023-12-26 15:17:30,434][121949] Component RolloutWorker_w9 stopped! [2023-12-26 15:17:30,435][121949] Component RolloutWorker_w2 stopped! [2023-12-26 15:17:30,435][121949] Component RolloutWorker_w10 stopped! [2023-12-26 15:17:30,435][123007] Stopping Batcher_0... [2023-12-26 15:17:30,436][121949] Component RolloutWorker_w1 stopped! [2023-12-26 15:17:30,436][123007] Loop batcher_evt_loop terminating... [2023-12-26 15:17:30,436][121949] Component RolloutWorker_w3 stopped! [2023-12-26 15:17:30,436][123008] Stopping Batcher_1... [2023-12-26 15:17:30,436][123007] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001958952_502996992.pth [2023-12-26 15:17:30,436][121949] Component RolloutWorker_w11 stopped! [2023-12-26 15:17:30,436][123008] Loop batcher_evt_loop terminating... [2023-12-26 15:17:30,437][121949] Component RolloutWorker_w7 stopped! [2023-12-26 15:17:30,437][123008] Removing ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001952384_499810304.pth [2023-12-26 15:17:30,437][121949] Component RolloutWorker_w15 stopped! [2023-12-26 15:17:30,437][123007] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p0/checkpoint_001959320_503185408.pth... [2023-12-26 15:17:30,437][121949] Component Batcher_0 stopped! [2023-12-26 15:17:30,438][123008] Saving ./train_mujoco/mujoco_walker_APPO/checkpoint_p1/checkpoint_001953128_500006912.pth... [2023-12-26 15:17:30,438][121949] Component Batcher_1 stopped! [2023-12-26 15:17:30,442][123008] Stopping LearnerWorker_p1... [2023-12-26 15:17:30,442][123008] Loop learner_proc1_evt_loop terminating... [2023-12-26 15:17:30,442][121949] Component LearnerWorker_p1 stopped! [2023-12-26 15:17:30,443][123007] Stopping LearnerWorker_p0... [2023-12-26 15:17:30,444][123007] Loop learner_proc0_evt_loop terminating... [2023-12-26 15:17:30,443][121949] Component LearnerWorker_p0 stopped! [2023-12-26 15:17:30,452][123090] Weights refcount: 2 0 [2023-12-26 15:17:30,453][123091] Weights refcount: 2 0 [2023-12-26 15:17:30,454][123090] Stopping InferenceWorker_p1-w0... [2023-12-26 15:17:30,454][123091] Stopping InferenceWorker_p0-w0... [2023-12-26 15:17:30,454][123090] Loop inference_proc1-0_evt_loop terminating... [2023-12-26 15:17:30,454][121949] Component InferenceWorker_p1-w0 stopped! [2023-12-26 15:17:30,454][123091] Loop inference_proc0-0_evt_loop terminating... [2023-12-26 15:17:30,455][121949] Component InferenceWorker_p0-w0 stopped! [2023-12-26 15:17:30,455][121949] Waiting for process learner_proc0 to stop... [2023-12-26 15:17:31,335][121949] Waiting for process learner_proc1 to stop... [2023-12-26 15:17:31,336][121949] Waiting for process inference_proc0-0 to join... [2023-12-26 15:17:31,336][121949] Waiting for process inference_proc1-0 to join... [2023-12-26 15:17:31,337][121949] Waiting for process rollout_proc0 to join... [2023-12-26 15:17:31,338][121949] Waiting for process rollout_proc1 to join... [2023-12-26 15:17:31,338][121949] Waiting for process rollout_proc2 to join... [2023-12-26 15:17:31,339][121949] Waiting for process rollout_proc3 to join... [2023-12-26 15:17:31,339][121949] Waiting for process rollout_proc4 to join... [2023-12-26 15:17:31,340][121949] Waiting for process rollout_proc5 to join... [2023-12-26 15:17:31,340][121949] Waiting for process rollout_proc6 to join... [2023-12-26 15:17:31,341][121949] Waiting for process rollout_proc7 to join... [2023-12-26 15:17:31,342][121949] Waiting for process rollout_proc8 to join... [2023-12-26 15:17:31,342][121949] Waiting for process rollout_proc9 to join... [2023-12-26 15:17:31,343][121949] Waiting for process rollout_proc10 to join... [2023-12-26 15:17:31,343][121949] Waiting for process rollout_proc11 to join... [2023-12-26 15:17:31,343][121949] Waiting for process rollout_proc12 to join... [2023-12-26 15:17:31,344][121949] Waiting for process rollout_proc13 to join... [2023-12-26 15:17:31,344][121949] Waiting for process rollout_proc14 to join... [2023-12-26 15:17:31,344][121949] Waiting for process rollout_proc15 to join... [2023-12-26 15:17:31,345][121949] Batcher 0 profile tree view: batching: 804.0814, releasing_batches: 1.2343 [2023-12-26 15:17:31,345][121949] Batcher 1 profile tree view: batching: 805.3641, releasing_batches: 1.2145 [2023-12-26 15:17:31,346][121949] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 1173.8386 update_model: 2165.1414 weight_update: 0.0005 one_step: 0.0028 handle_policy_step: 50702.3605 deserialize: 476.0990, stack: 564.5313, obs_to_device_normalize: 7325.4026, forward: 18193.5704, prepare_outputs: 18848.7829, send_messages: 3235.2709 [2023-12-26 15:17:31,346][121949] InferenceWorker_p1-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 1186.8645 update_model: 2153.3059 weight_update: 0.0011 one_step: 0.0022 handle_policy_step: 50663.3427 deserialize: 481.4029, stack: 572.0794, obs_to_device_normalize: 7361.2922, forward: 18217.7850, prepare_outputs: 18729.8980, send_messages: 3256.0202 [2023-12-26 15:17:31,346][121949] Learner 0 profile tree view: misc: 0.3233, prepare_batch: 423.0663 train: 11914.2811 epoch_init: 3.9529, minibatch_init: 220.8031, losses_postprocess: 435.1587, kl_divergence: 234.8114, update: 6235.0753, after_optimizer: 165.2894 calculate_losses: 4375.0958 losses_init: 7.8071, forward_head: 485.0600, bptt_initial: 25.7037, bptt: 28.6574, tail: 1511.1157, advantages_returns: 213.4350, losses: 1840.6339 [2023-12-26 15:17:31,347][121949] Learner 1 profile tree view: misc: 0.3125, prepare_batch: 423.2194 train: 12065.3686 epoch_init: 3.9423, minibatch_init: 227.3663, losses_postprocess: 440.3576, kl_divergence: 236.2872, update: 6329.2349, after_optimizer: 164.6495 calculate_losses: 4422.4457 losses_init: 7.9693, forward_head: 485.6575, bptt_initial: 26.5206, bptt: 29.8604, tail: 1532.9555, advantages_returns: 215.9565, losses: 1862.2049 [2023-12-26 15:17:31,347][121949] RolloutWorker_w0 profile tree view: wait_for_trajectories: 24.3090, enqueue_policy_requests: 3972.8555, process_policy_outputs: 1408.4732, env_step: 29767.7821, finalize_trajectories: 59.1036, complete_rollouts: 46.8231 post_env_step: 4123.6426 process_env_step: 991.8027 [2023-12-26 15:17:31,347][121949] RolloutWorker_w15 profile tree view: wait_for_trajectories: 24.0183, enqueue_policy_requests: 3925.3952, process_policy_outputs: 1393.1263, env_step: 29514.6303, finalize_trajectories: 58.5860, complete_rollouts: 45.6838 post_env_step: 4028.5671 process_env_step: 963.1877 [2023-12-26 15:17:31,348][121949] Loop Runner_EvtLoop terminating... [2023-12-26 15:17:31,348][121949] Runner profile tree view: main_loop: 56612.4420 [2023-12-26 15:17:31,348][121949] Collected {0: 503185408, 1: 500006912}, FPS: 17720.4